2023-05-08T03:09:28.161 INFO:root:teuthology version: 0.0.1.dev98+g69caab8 2023-05-08T03:09:28.162 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-workunit/postgres}} --name vshankar-2023-05-06_17:28:05-fs-wip-vshankar-testing-20230506.143554-testing-default-smithi --owner scheduled_vshankar@teuthology --verbose --archive /home/teuthworker/archive/vshankar-2023-05-06_17:28:05-fs-wip-vshankar-testing-20230506.143554-testing-default-smithi/7264876 -- /home/teuthworker/archive/vshankar-2023-05-06_17:28:05-fs-wip-vshankar-testing-20230506.143554-testing-default-smithi/7264876/orig.config.yaml 2023-05-08T03:09:28.230 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2023-05-08T03:09:33.332 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2023-05-06_17:28:05-fs-wip-vshankar-testing-20230506.143554-testing-default-smithi/7264876 branch: wip-vshankar-testing-20230506.143554 description: fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-workunit/postgres}} email: vshankar@redhat.com first_in_suite: false job_id: '7264876' kernel: client: sha1: distro flavor: default kdb: true sha1: 88d7b7ea23211021eec165a0a33c522f4fe4ebf4 ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2023-05-06_17:28:05-fs-wip-vshankar-testing-20230506.143554-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: wip-vshankar-testing-20230506.143554 ceph: cephfs: max_mds: 3 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug cephsqlite: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 4b086ba51b906a75bac7252b2239e8f120a38c8c subvols: create: 2 subvol_options: --size 25000000000 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mount_subvol_num: 0 mountpoint: /tmp/cephfs check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount install: ceph: flavor: default sha1: 4b086ba51b906a75bac7252b2239e8f120a38c8c kclient: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mount_subvol_num: 1 mountpoint: /tmp/cephfs mntopts: - ms_mode=secure - nowsync syntax: v2 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20230506.143554 sha1: 4b086ba51b906a75bac7252b2239e8f120a38c8c owner: scheduled_vshankar@teuthology priority: 80 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 sha1: 4b086ba51b906a75bac7252b2239e8f120a38c8c sleep_before_teardown: 0 suite: fs suite_branch: wip-vshankar-testing-20230506.143554 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_4b086ba51b906a75bac7252b2239e8f120a38c8c/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 4b086ba51b906a75bac7252b2239e8f120a38c8c syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi096.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= smithi133.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi186.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= tasks: - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools:rhel8 --allowerasing --nobest - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - kclient: null - check-counter: {} - exec: mon.a: - ceph mgr module enable snap_schedule - ceph config set mgr mgr/snap_schedule/allow_m_granularity true - ceph config set mgr mgr/snap_schedule/dump_on_update true - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1M - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6M3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - exec: client.0: - sudo ls -l /tmp/cephfs/ && sudo df -h /tmp/cephfs/ - sudo mkdir -m 755 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres && sudo chown postgres:postgres /tmp/cephfs/postgres - sudo -u postgres -- mkdir -m 700 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres/data - sudo semanage fcontext -a -t postgresql_db_t "/tmp/cephfs/postgres(/.*)?" - sudo grep -i postgresql /etc/selinux/targeted/contexts/files/file_contexts.local - sudo restorecon -R -v /tmp/cephfs/postgres - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo mkdir -p /etc/systemd/system/postgresql.service.d/ && printf '[Service]\nEnvironment=PGDATA=/tmp/cephfs/postgres/data\nEnvironment=PGLOG=/tmp/cephfs/postgres/pgstartup.log\n' | sudo tee /etc/systemd/system/postgresql.service.d/env.conf - sudo -u postgres -- postgresql-setup --initdb - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo systemctl start postgresql - sudo -u postgres -- pgbench -s 500 -i - sudo -u postgres -- pgbench -c 100 -j 4 --progress=5 --time=900 - sudo systemctl stop postgresql - sudo ls -lZaR /tmp/cephfs/postgres/ teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 69caab8ec6f44c61c991ae693e8e7b8cd859a896 timestamp: 2023-05-06_17:28:05 tube: smithi user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.23459 2023-05-08T03:09:33.332 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_4b086ba51b906a75bac7252b2239e8f120a38c8c/qa; will attempt to use it 2023-05-08T03:09:33.333 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_4b086ba51b906a75bac7252b2239e8f120a38c8c/qa/tasks 2023-05-08T03:09:33.333 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-05-08T03:09:33.335 INFO:teuthology.task.internal:Checking packages... 2023-05-08T03:09:33.367 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '4b086ba51b906a75bac7252b2239e8f120a38c8c' 2023-05-08T03:09:33.367 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-05-08T03:09:33.368 INFO:teuthology.packaging:ref: None 2023-05-08T03:09:33.368 INFO:teuthology.packaging:tag: None 2023-05-08T03:09:33.368 INFO:teuthology.packaging:branch: wip-vshankar-testing-20230506.143554 2023-05-08T03:09:33.368 INFO:teuthology.packaging:sha1: 4b086ba51b906a75bac7252b2239e8f120a38c8c 2023-05-08T03:09:33.369 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-vshankar-testing-20230506.143554 2023-05-08T03:09:48.517 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-3786.g4b086ba5 2023-05-08T03:09:48.517 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-05-08T03:09:48.526 INFO:teuthology.task.internal:no buildpackages task found 2023-05-08T03:09:48.527 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-05-08T03:09:48.557 INFO:teuthology.task.internal:Saving configuration 2023-05-08T03:09:48.579 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-05-08T03:09:48.591 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-05-08T03:09:53.618 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi096.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-05-06_17:28:05-fs-wip-vshankar-testing-20230506.143554-testing-default-smithi/7264876', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-05-08 03:02:26.262172', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-05-08T03:09:58.649 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi133.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-05-06_17:28:05-fs-wip-vshankar-testing-20230506.143554-testing-default-smithi/7264876', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-05-08 03:02:26.263657', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-05-08T03:10:03.680 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi186.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-05-06_17:28:05-fs-wip-vshankar-testing-20230506.143554-testing-default-smithi/7264876', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-05-08 03:02:26.260219', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-05-08T03:10:03.680 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-05-08T03:10:03.687 INFO:teuthology.task.internal:roles: ubuntu@smithi096.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2023-05-08T03:10:03.687 INFO:teuthology.task.internal:roles: ubuntu@smithi133.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2023-05-08T03:10:03.687 INFO:teuthology.task.internal:roles: ubuntu@smithi186.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2023-05-08T03:10:03.688 INFO:teuthology.run_tasks:Running task console_log... 2023-05-08T03:10:04.843 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc9a64e30d0>, signals=[15]) 2023-05-08T03:10:04.844 INFO:teuthology.run_tasks:Running task internal.connect... 2023-05-08T03:10:04.854 INFO:teuthology.task.internal:Opening connections... 2023-05-08T03:10:04.854 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi096.front.sepia.ceph.com 2023-05-08T03:10:04.857 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-08T03:10:04.927 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi133.front.sepia.ceph.com 2023-05-08T03:10:04.929 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-08T03:10:04.996 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi186.front.sepia.ceph.com 2023-05-08T03:10:04.997 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-08T03:10:05.065 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-05-08T03:10:05.077 DEBUG:teuthology.orchestra.run.smithi096:> uname -m 2023-05-08T03:10:05.096 INFO:teuthology.orchestra.run.smithi096.stdout:x86_64 2023-05-08T03:10:05.096 DEBUG:teuthology.orchestra.run.smithi096:> cat /etc/os-release 2023-05-08T03:10:05.153 INFO:teuthology.orchestra.run.smithi096.stdout:NAME="Red Hat Enterprise Linux" 2023-05-08T03:10:05.154 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION="8.6 (Ootpa)" 2023-05-08T03:10:05.154 INFO:teuthology.orchestra.run.smithi096.stdout:ID="rhel" 2023-05-08T03:10:05.154 INFO:teuthology.orchestra.run.smithi096.stdout:ID_LIKE="fedora" 2023-05-08T03:10:05.154 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION_ID="8.6" 2023-05-08T03:10:05.154 INFO:teuthology.orchestra.run.smithi096.stdout:PLATFORM_ID="platform:el8" 2023-05-08T03:10:05.155 INFO:teuthology.orchestra.run.smithi096.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-05-08T03:10:05.155 INFO:teuthology.orchestra.run.smithi096.stdout:ANSI_COLOR="0;31" 2023-05-08T03:10:05.155 INFO:teuthology.orchestra.run.smithi096.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-05-08T03:10:05.155 INFO:teuthology.orchestra.run.smithi096.stdout:HOME_URL="https://www.redhat.com/" 2023-05-08T03:10:05.155 INFO:teuthology.orchestra.run.smithi096.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-05-08T03:10:05.155 INFO:teuthology.orchestra.run.smithi096.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-05-08T03:10:05.155 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:10:05.155 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-05-08T03:10:05.156 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-05-08T03:10:05.156 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-05-08T03:10:05.156 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-05-08T03:10:05.157 INFO:teuthology.lock.ops:Updating smithi096.front.sepia.ceph.com on lock server 2023-05-08T03:10:05.185 DEBUG:teuthology.orchestra.run.smithi133:> uname -m 2023-05-08T03:10:05.206 INFO:teuthology.orchestra.run.smithi133.stdout:x86_64 2023-05-08T03:10:05.206 DEBUG:teuthology.orchestra.run.smithi133:> cat /etc/os-release 2023-05-08T03:10:05.264 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="Red Hat Enterprise Linux" 2023-05-08T03:10:05.264 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="8.6 (Ootpa)" 2023-05-08T03:10:05.264 INFO:teuthology.orchestra.run.smithi133.stdout:ID="rhel" 2023-05-08T03:10:05.265 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE="fedora" 2023-05-08T03:10:05.265 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="8.6" 2023-05-08T03:10:05.265 INFO:teuthology.orchestra.run.smithi133.stdout:PLATFORM_ID="platform:el8" 2023-05-08T03:10:05.265 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-05-08T03:10:05.265 INFO:teuthology.orchestra.run.smithi133.stdout:ANSI_COLOR="0;31" 2023-05-08T03:10:05.265 INFO:teuthology.orchestra.run.smithi133.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-05-08T03:10:05.265 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://www.redhat.com/" 2023-05-08T03:10:05.265 INFO:teuthology.orchestra.run.smithi133.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-05-08T03:10:05.266 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-05-08T03:10:05.266 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-05-08T03:10:05.266 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-05-08T03:10:05.266 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-05-08T03:10:05.266 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-05-08T03:10:05.266 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-05-08T03:10:05.267 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server 2023-05-08T03:10:05.293 DEBUG:teuthology.orchestra.run.smithi186:> uname -m 2023-05-08T03:10:05.313 INFO:teuthology.orchestra.run.smithi186.stdout:x86_64 2023-05-08T03:10:05.314 DEBUG:teuthology.orchestra.run.smithi186:> cat /etc/os-release 2023-05-08T03:10:05.373 INFO:teuthology.orchestra.run.smithi186.stdout:NAME="Red Hat Enterprise Linux" 2023-05-08T03:10:05.373 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION="8.6 (Ootpa)" 2023-05-08T03:10:05.374 INFO:teuthology.orchestra.run.smithi186.stdout:ID="rhel" 2023-05-08T03:10:05.374 INFO:teuthology.orchestra.run.smithi186.stdout:ID_LIKE="fedora" 2023-05-08T03:10:05.374 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION_ID="8.6" 2023-05-08T03:10:05.374 INFO:teuthology.orchestra.run.smithi186.stdout:PLATFORM_ID="platform:el8" 2023-05-08T03:10:05.374 INFO:teuthology.orchestra.run.smithi186.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-05-08T03:10:05.374 INFO:teuthology.orchestra.run.smithi186.stdout:ANSI_COLOR="0;31" 2023-05-08T03:10:05.374 INFO:teuthology.orchestra.run.smithi186.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-05-08T03:10:05.375 INFO:teuthology.orchestra.run.smithi186.stdout:HOME_URL="https://www.redhat.com/" 2023-05-08T03:10:05.375 INFO:teuthology.orchestra.run.smithi186.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-05-08T03:10:05.375 INFO:teuthology.orchestra.run.smithi186.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-05-08T03:10:05.375 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-05-08T03:10:05.375 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-05-08T03:10:05.375 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-05-08T03:10:05.375 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-05-08T03:10:05.376 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-05-08T03:10:05.376 INFO:teuthology.lock.ops:Updating smithi186.front.sepia.ceph.com on lock server 2023-05-08T03:10:05.401 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-05-08T03:10:05.418 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-05-08T03:10:05.457 INFO:teuthology.task.internal:Checking for old test directory... 2023-05-08T03:10:05.457 DEBUG:teuthology.orchestra.run.smithi096:> test '!' -e /home/ubuntu/cephtest 2023-05-08T03:10:05.460 DEBUG:teuthology.orchestra.run.smithi133:> test '!' -e /home/ubuntu/cephtest 2023-05-08T03:10:05.463 DEBUG:teuthology.orchestra.run.smithi186:> test '!' -e /home/ubuntu/cephtest 2023-05-08T03:10:05.482 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-05-08T03:10:05.505 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-05-08T03:10:05.505 DEBUG:teuthology.orchestra.run.smithi096:> test -z $(ls -A /var/lib/ceph) 2023-05-08T03:10:05.518 DEBUG:teuthology.orchestra.run.smithi133:> test -z $(ls -A /var/lib/ceph) 2023-05-08T03:10:05.521 DEBUG:teuthology.orchestra.run.smithi186:> test -z $(ls -A /var/lib/ceph) 2023-05-08T03:10:05.555 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-05-08T03:10:05.639 INFO:teuthology.run_tasks:Running task kernel... 2023-05-08T03:10:05.656 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '88d7b7ea23211021eec165a0a33c522f4fe4ebf4'} 2023-05-08T03:10:05.657 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2023-05-08T03:10:05.657 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2023-05-08T03:10:05.658 DEBUG:teuthology.orchestra.run.smithi096:> test -f /run/.containerenv -o -f /.dockerenv 2023-05-08T03:10:05.676 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-08T03:10:05.677 DEBUG:teuthology.orchestra.run.smithi096:> uname -r 2023-05-08T03:10:05.735 INFO:teuthology.orchestra.run.smithi096.stdout:4.18.0-372.9.1.el8.x86_64 2023-05-08T03:10:05.735 INFO:teuthology.task.kernel:Running kernel on smithi096: 4.18.0-372.9.1.el8.x86_64 2023-05-08T03:10:05.736 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum install -y kernel 2023-05-08T03:10:06.918 INFO:teuthology.orchestra.run.smithi096.stdout:Updating Subscription Management repositories. 2023-05-08T03:10:06.918 INFO:teuthology.orchestra.run.smithi096.stdout:Unable to read consumer identity 2023-05-08T03:10:10.768 INFO:teuthology.orchestra.run.smithi096.stdout:Copr repo for python3-asyncssh owned by ceph 1.4 kB/s | 3.5 kB 00:02 2023-05-08T03:10:12.360 INFO:teuthology.orchestra.run.smithi096.stdout:Extra Packages for Enterprise Linux 8.8 MB/s | 14 MB 00:01 2023-05-08T03:10:15.518 INFO:teuthology.orchestra.run.smithi096.stdout:lab-extras 387 kB/s | 24 kB 00:00 2023-05-08T03:10:16.204 INFO:teuthology.orchestra.run.smithi096.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-05-08T03:10:16.247 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2023-05-08T03:10:16.248 INFO:teuthology.orchestra.run.smithi096.stdout:Nothing to do. 2023-05-08T03:10:16.249 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2023-05-08T03:10:16.360 DEBUG:teuthology.orchestra.run.smithi096:> echo no | sudo yum reinstall kernel || true 2023-05-08T03:10:16.692 INFO:teuthology.orchestra.run.smithi096.stdout:Updating Subscription Management repositories. 2023-05-08T03:10:16.692 INFO:teuthology.orchestra.run.smithi096.stdout:Unable to read consumer identity 2023-05-08T03:10:16.943 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:00:01 ago on Mon 08 May 2023 03:10:15 AM UTC. 2023-05-08T03:10:16.983 INFO:teuthology.orchestra.run.smithi096.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-05-08T03:10:17.022 INFO:teuthology.orchestra.run.smithi096.stderr:Error: No packages marked for reinstall. 2023-05-08T03:10:17.067 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum reinstall -y kernel || true 2023-05-08T03:10:17.394 INFO:teuthology.orchestra.run.smithi096.stdout:Updating Subscription Management repositories. 2023-05-08T03:10:17.394 INFO:teuthology.orchestra.run.smithi096.stdout:Unable to read consumer identity 2023-05-08T03:10:17.640 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:00:02 ago on Mon 08 May 2023 03:10:15 AM UTC. 2023-05-08T03:10:17.679 INFO:teuthology.orchestra.run.smithi096.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-05-08T03:10:17.702 INFO:teuthology.orchestra.run.smithi096.stderr:Error: No packages marked for reinstall. 2023-05-08T03:10:17.746 DEBUG:teuthology.orchestra.run.smithi096:> rpm -q kernel --last | head -n 1 2023-05-08T03:10:17.825 INFO:teuthology.orchestra.run.smithi096.stdout:kernel-4.18.0-372.9.1.el8.x86_64 Thu 14 Jul 2022 06:23:21 PM UTC 2023-05-08T03:10:17.827 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-05-08T03:10:17.827 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-05-08T03:10:17.827 DEBUG:teuthology.parallel:result is None 2023-05-08T03:10:17.828 INFO:teuthology.run_tasks:Running task internal.base... 2023-05-08T03:10:17.835 INFO:teuthology.task.internal:Creating test directory... 2023-05-08T03:10:17.835 DEBUG:teuthology.orchestra.run.smithi096:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-05-08T03:10:17.837 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-05-08T03:10:17.839 DEBUG:teuthology.orchestra.run.smithi186:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-05-08T03:10:17.859 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-05-08T03:10:17.872 INFO:teuthology.run_tasks:Running task internal.archive... 2023-05-08T03:10:17.912 INFO:teuthology.task.internal:Creating archive directory... 2023-05-08T03:10:17.913 DEBUG:teuthology.orchestra.run.smithi096:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-05-08T03:10:17.915 DEBUG:teuthology.orchestra.run.smithi133:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-05-08T03:10:17.917 DEBUG:teuthology.orchestra.run.smithi186:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-05-08T03:10:17.955 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-05-08T03:10:17.962 INFO:teuthology.task.internal:Enabling coredump saving... 2023-05-08T03:10:17.962 DEBUG:teuthology.orchestra.run.smithi133:> test -f /run/.containerenv -o -f /.dockerenv 2023-05-08T03:10:17.999 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-08T03:10:18.000 DEBUG:teuthology.orchestra.run.smithi186:> test -f /run/.containerenv -o -f /.dockerenv 2023-05-08T03:10:18.018 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-08T03:10:18.019 DEBUG:teuthology.orchestra.run.smithi096:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-05-08T03:10:18.021 DEBUG:teuthology.orchestra.run.smithi133:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-05-08T03:10:18.042 DEBUG:teuthology.orchestra.run.smithi186:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-05-08T03:10:18.059 INFO:teuthology.orchestra.run.smithi096.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-05-08T03:10:18.079 INFO:teuthology.orchestra.run.smithi133.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-05-08T03:10:18.096 INFO:teuthology.orchestra.run.smithi096.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-05-08T03:10:18.097 INFO:teuthology.orchestra.run.smithi133.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-05-08T03:10:18.103 INFO:teuthology.orchestra.run.smithi186.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-05-08T03:10:18.123 INFO:teuthology.orchestra.run.smithi186.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-05-08T03:10:18.124 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-05-08T03:10:18.131 INFO:teuthology.task.internal:Configuring sudo... 2023-05-08T03:10:18.131 DEBUG:teuthology.orchestra.run.smithi096:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-05-08T03:10:18.139 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-05-08T03:10:18.141 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-05-08T03:10:18.170 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-05-08T03:10:18.178 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-05-08T03:10:18.179 DEBUG:teuthology.orchestra.run.smithi096:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-05-08T03:10:18.206 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-05-08T03:10:18.210 DEBUG:teuthology.orchestra.run.smithi186:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-05-08T03:10:18.228 DEBUG:teuthology.orchestra.run.smithi096:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-05-08T03:10:23.314 DEBUG:teuthology.orchestra.run.smithi096:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-05-08T03:10:23.354 DEBUG:teuthology.orchestra.run.smithi096:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-05-08T03:10:23.793 DEBUG:teuthology.orchestra.run.smithi096:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-05-08T03:10:23.825 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-05-08T03:10:23.826 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-05-08T03:10:23.897 DEBUG:teuthology.orchestra.run.smithi133:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-05-08T03:10:23.941 DEBUG:teuthology.orchestra.run.smithi133:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-05-08T03:10:24.010 DEBUG:teuthology.orchestra.run.smithi133:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-05-08T03:10:24.061 DEBUG:teuthology.orchestra.run.smithi133:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-05-08T03:10:24.100 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-05-08T03:10:24.101 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-05-08T03:10:24.168 DEBUG:teuthology.orchestra.run.smithi186:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-05-08T03:10:24.221 DEBUG:teuthology.orchestra.run.smithi186:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-05-08T03:10:24.273 DEBUG:teuthology.orchestra.run.smithi186:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-05-08T03:10:24.361 DEBUG:teuthology.orchestra.run.smithi186:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-05-08T03:10:24.404 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2023-05-08T03:10:24.405 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-05-08T03:10:24.475 DEBUG:teuthology.orchestra.run.smithi096:> sudo service rsyslog restart 2023-05-08T03:10:24.477 DEBUG:teuthology.orchestra.run.smithi133:> sudo service rsyslog restart 2023-05-08T03:10:24.480 DEBUG:teuthology.orchestra.run.smithi186:> sudo service rsyslog restart 2023-05-08T03:10:24.537 INFO:teuthology.orchestra.run.smithi096.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-05-08T03:10:24.539 INFO:teuthology.orchestra.run.smithi133.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-05-08T03:10:24.615 INFO:teuthology.orchestra.run.smithi186.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-05-08T03:10:25.003 INFO:teuthology.run_tasks:Running task internal.timer... 2023-05-08T03:10:25.016 INFO:teuthology.task.internal:Starting timer... 2023-05-08T03:10:25.017 INFO:teuthology.run_tasks:Running task pcp... 2023-05-08T03:10:25.049 INFO:teuthology.run_tasks:Running task selinux... 2023-05-08T03:10:25.098 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']} 2023-05-08T03:10:25.098 DEBUG:teuthology.orchestra.run.smithi096:> sudo service auditd rotate 2023-05-08T03:10:25.168 INFO:teuthology.orchestra.run.smithi096.stdout:Rotating logs: 2023-05-08T03:10:25.168 DEBUG:teuthology.orchestra.run.smithi133:> sudo service auditd rotate 2023-05-08T03:10:25.234 INFO:teuthology.orchestra.run.smithi133.stdout:Rotating logs: 2023-05-08T03:10:25.236 DEBUG:teuthology.orchestra.run.smithi186:> sudo service auditd rotate 2023-05-08T03:10:25.304 INFO:teuthology.orchestra.run.smithi186.stdout:Rotating logs: 2023-05-08T03:10:25.306 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-05-08T03:10:25.306 DEBUG:teuthology.orchestra.run.smithi096:> /usr/sbin/getenforce 2023-05-08T03:10:25.330 INFO:teuthology.orchestra.run.smithi096.stdout:Permissive 2023-05-08T03:10:25.331 DEBUG:teuthology.orchestra.run.smithi133:> /usr/sbin/getenforce 2023-05-08T03:10:25.359 INFO:teuthology.orchestra.run.smithi133.stdout:Permissive 2023-05-08T03:10:25.359 DEBUG:teuthology.orchestra.run.smithi186:> /usr/sbin/getenforce 2023-05-08T03:10:25.386 INFO:teuthology.orchestra.run.smithi186.stdout:Permissive 2023-05-08T03:10:25.387 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi096.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi133.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi186.front.sepia.ceph.com': 'permissive'} 2023-05-08T03:10:25.387 DEBUG:teuthology.orchestra.run.smithi096:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-05-08T03:10:25.413 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-08T03:10:25.414 DEBUG:teuthology.orchestra.run.smithi133:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-05-08T03:10:25.441 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-08T03:10:25.442 DEBUG:teuthology.orchestra.run.smithi186:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-05-08T03:10:25.469 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-08T03:10:25.470 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-05-08T03:10:25.470 DEBUG:teuthology.orchestra.run.smithi096:> sudo /usr/sbin/setenforce permissive 2023-05-08T03:10:25.496 DEBUG:teuthology.orchestra.run.smithi133:> sudo /usr/sbin/setenforce permissive 2023-05-08T03:10:25.525 DEBUG:teuthology.orchestra.run.smithi186:> sudo /usr/sbin/setenforce permissive 2023-05-08T03:10:25.556 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-05-08T03:10:25.568 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-05-08T03:10:25.574 INFO:teuthology.repo_utils:Fetching main from origin 2023-05-08T03:10:30.742 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-05-08T03:10:30.760 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-05-08T03:10:30.762 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi096.front.sepia.ceph.com,smithi133.front.sepia.ceph.com,smithi186.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-05-08T03:25:38.344 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi096.front.sepia.ceph.com'), Remote(name='ubuntu@smithi133.front.sepia.ceph.com'), Remote(name='ubuntu@smithi186.front.sepia.ceph.com')] 2023-05-08T03:25:38.368 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2023-05-08T03:25:38.369 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-08T03:25:38.437 DEBUG:teuthology.orchestra.run.smithi096:> true 2023-05-08T03:25:38.509 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2023-05-08T03:25:38.510 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-08T03:25:38.577 DEBUG:teuthology.orchestra.run.smithi133:> true 2023-05-08T03:25:38.649 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi186.front.sepia.ceph.com' 2023-05-08T03:25:38.650 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-08T03:25:38.720 DEBUG:teuthology.orchestra.run.smithi186:> true 2023-05-08T03:25:38.791 INFO:teuthology.run_tasks:Running task clock... 2023-05-08T03:25:38.802 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-05-08T03:25:38.803 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-05-08T03:25:38.803 DEBUG:teuthology.orchestra.run.smithi096:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-05-08T03:25:38.806 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-05-08T03:25:38.806 DEBUG:teuthology.orchestra.run.smithi133:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-05-08T03:25:38.808 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-05-08T03:25:38.809 DEBUG:teuthology.orchestra.run.smithi186:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-05-08T03:25:38.835 INFO:teuthology.orchestra.run.smithi096.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-05-08T03:25:38.839 INFO:teuthology.orchestra.run.smithi133.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-05-08T03:25:38.849 INFO:teuthology.orchestra.run.smithi096.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-05-08T03:25:38.855 INFO:teuthology.orchestra.run.smithi133.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-05-08T03:25:38.878 INFO:teuthology.orchestra.run.smithi186.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-05-08T03:25:38.893 INFO:teuthology.orchestra.run.smithi186.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-05-08T03:25:38.921 INFO:teuthology.orchestra.run.smithi096.stderr:sudo: ntpd: command not found 2023-05-08T03:25:38.926 INFO:teuthology.orchestra.run.smithi133.stderr:sudo: ntpd: command not found 2023-05-08T03:25:38.932 INFO:teuthology.orchestra.run.smithi096.stdout:506 Cannot talk to daemon 2023-05-08T03:25:38.938 INFO:teuthology.orchestra.run.smithi133.stdout:506 Cannot talk to daemon 2023-05-08T03:25:38.946 INFO:teuthology.orchestra.run.smithi096.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-05-08T03:25:38.953 INFO:teuthology.orchestra.run.smithi133.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-05-08T03:25:38.960 INFO:teuthology.orchestra.run.smithi096.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-05-08T03:25:38.965 INFO:teuthology.orchestra.run.smithi186.stderr:sudo: ntpd: command not found 2023-05-08T03:25:38.967 INFO:teuthology.orchestra.run.smithi133.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-05-08T03:25:38.977 INFO:teuthology.orchestra.run.smithi186.stdout:506 Cannot talk to daemon 2023-05-08T03:25:38.992 INFO:teuthology.orchestra.run.smithi186.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-05-08T03:25:39.005 INFO:teuthology.orchestra.run.smithi186.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-05-08T03:25:39.030 INFO:teuthology.orchestra.run.smithi096.stderr:bash: ntpq: command not found 2023-05-08T03:25:39.033 INFO:teuthology.orchestra.run.smithi096.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-05-08T03:25:39.034 INFO:teuthology.orchestra.run.smithi096.stdout:=============================================================================== 2023-05-08T03:25:39.034 INFO:teuthology.orchestra.run.smithi096.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-05-08T03:25:39.034 INFO:teuthology.orchestra.run.smithi096.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-05-08T03:25:39.034 INFO:teuthology.orchestra.run.smithi096.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-05-08T03:25:39.034 INFO:teuthology.orchestra.run.smithi096.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-05-08T03:25:39.040 INFO:teuthology.orchestra.run.smithi133.stderr:bash: ntpq: command not found 2023-05-08T03:25:39.043 INFO:teuthology.orchestra.run.smithi133.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-05-08T03:25:39.044 INFO:teuthology.orchestra.run.smithi133.stdout:=============================================================================== 2023-05-08T03:25:39.044 INFO:teuthology.orchestra.run.smithi133.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-05-08T03:25:39.044 INFO:teuthology.orchestra.run.smithi133.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-05-08T03:25:39.044 INFO:teuthology.orchestra.run.smithi133.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-05-08T03:25:39.045 INFO:teuthology.orchestra.run.smithi133.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-05-08T03:25:39.071 INFO:teuthology.orchestra.run.smithi186.stderr:bash: ntpq: command not found 2023-05-08T03:25:39.075 INFO:teuthology.orchestra.run.smithi186.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-05-08T03:25:39.076 INFO:teuthology.orchestra.run.smithi186.stdout:=============================================================================== 2023-05-08T03:25:39.076 INFO:teuthology.orchestra.run.smithi186.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-05-08T03:25:39.076 INFO:teuthology.orchestra.run.smithi186.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-05-08T03:25:39.077 INFO:teuthology.orchestra.run.smithi186.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-05-08T03:25:39.077 INFO:teuthology.orchestra.run.smithi186.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-05-08T03:25:39.077 INFO:teuthology.run_tasks:Running task pexec... 2023-05-08T03:25:39.087 INFO:teuthology.task.pexec:Executing custom commands... 2023-05-08T03:25:39.088 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi096.front.sepia.ceph.com 2023-05-08T03:25:39.088 DEBUG:teuthology.orchestra.run.smithi096:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-05-08T03:25:39.089 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi133.front.sepia.ceph.com 2023-05-08T03:25:39.089 DEBUG:teuthology.orchestra.run.smithi133:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-05-08T03:25:39.090 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi186.front.sepia.ceph.com 2023-05-08T03:25:39.091 DEBUG:teuthology.orchestra.run.smithi186:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-05-08T03:25:39.463 INFO:teuthology.orchestra.run.smithi096.stdout:Updating Subscription Management repositories. 2023-05-08T03:25:39.464 INFO:teuthology.orchestra.run.smithi133.stdout:Updating Subscription Management repositories. 2023-05-08T03:25:39.464 INFO:teuthology.orchestra.run.smithi186.stdout:Updating Subscription Management repositories. 2023-05-08T03:25:40.252 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:08:23 ago on Mon 08 May 2023 03:17:16 AM UTC. 2023-05-08T03:25:40.259 INFO:teuthology.orchestra.run.smithi186.stdout:Last metadata expiration check: 0:01:34 ago on Mon 08 May 2023 03:24:05 AM UTC. 2023-05-08T03:25:40.270 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:06:01 ago on Mon 08 May 2023 03:19:38 AM UTC. 2023-05-08T03:25:41.991 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2023-05-08T03:25:41.992 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2023-05-08T03:25:41.993 INFO:teuthology.orchestra.run.smithi133.stdout: Package Architecture Version Repository Size 2023-05-08T03:25:41.993 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2023-05-08T03:25:41.993 INFO:teuthology.orchestra.run.smithi133.stdout:Resetting modules: 2023-05-08T03:25:41.993 INFO:teuthology.orchestra.run.smithi133.stdout: container-tools 2023-05-08T03:25:41.993 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-05-08T03:25:41.993 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction Summary 2023-05-08T03:25:41.994 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2023-05-08T03:25:41.994 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-05-08T03:25:41.994 INFO:teuthology.orchestra.run.smithi186.stdout:Dependencies resolved. 2023-05-08T03:25:41.994 INFO:teuthology.orchestra.run.smithi186.stdout:================================================================================ 2023-05-08T03:25:41.995 INFO:teuthology.orchestra.run.smithi186.stdout: Package Architecture Version Repository Size 2023-05-08T03:25:41.995 INFO:teuthology.orchestra.run.smithi186.stdout:================================================================================ 2023-05-08T03:25:41.995 INFO:teuthology.orchestra.run.smithi186.stdout:Resetting modules: 2023-05-08T03:25:41.995 INFO:teuthology.orchestra.run.smithi186.stdout: container-tools 2023-05-08T03:25:41.995 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-05-08T03:25:41.995 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction Summary 2023-05-08T03:25:41.995 INFO:teuthology.orchestra.run.smithi186.stdout:================================================================================ 2023-05-08T03:25:41.995 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-05-08T03:25:42.131 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2023-05-08T03:25:42.132 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2023-05-08T03:25:42.132 INFO:teuthology.orchestra.run.smithi096.stdout: Package Architecture Version Repository Size 2023-05-08T03:25:42.132 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2023-05-08T03:25:42.132 INFO:teuthology.orchestra.run.smithi096.stdout:Resetting modules: 2023-05-08T03:25:42.132 INFO:teuthology.orchestra.run.smithi096.stdout: container-tools 2023-05-08T03:25:42.133 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:25:42.133 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction Summary 2023-05-08T03:25:42.133 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2023-05-08T03:25:42.133 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:25:42.933 INFO:teuthology.orchestra.run.smithi186.stdout:Last metadata expiration check: 0:01:37 ago on Mon 08 May 2023 03:24:05 AM UTC. 2023-05-08T03:25:42.938 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:06:04 ago on Mon 08 May 2023 03:19:38 AM UTC. 2023-05-08T03:25:43.084 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:08:26 ago on Mon 08 May 2023 03:17:16 AM UTC. 2023-05-08T03:25:45.411 INFO:teuthology.orchestra.run.smithi186.stdout:Complete! 2023-05-08T03:25:45.854 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2023-05-08T03:25:45.928 INFO:teuthology.orchestra.run.smithi186.stdout:Updating Subscription Management repositories. 2023-05-08T03:25:45.971 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2023-05-08T03:25:46.362 INFO:teuthology.orchestra.run.smithi133.stdout:Updating Subscription Management repositories. 2023-05-08T03:25:46.416 INFO:teuthology.orchestra.run.smithi096.stdout:Updating Subscription Management repositories. 2023-05-08T03:25:46.696 INFO:teuthology.orchestra.run.smithi186.stdout:Last metadata expiration check: 0:01:41 ago on Mon 08 May 2023 03:24:05 AM UTC. 2023-05-08T03:25:47.143 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:06:08 ago on Mon 08 May 2023 03:19:38 AM UTC. 2023-05-08T03:25:47.164 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:08:30 ago on Mon 08 May 2023 03:17:16 AM UTC. 2023-05-08T03:25:48.433 INFO:teuthology.orchestra.run.smithi186.stdout:Dependencies resolved. 2023-05-08T03:25:48.527 INFO:teuthology.orchestra.run.smithi186.stdout:============================================================================================================ 2023-05-08T03:25:48.527 INFO:teuthology.orchestra.run.smithi186.stdout: Package Arch Version Repository Size 2023-05-08T03:25:48.527 INFO:teuthology.orchestra.run.smithi186.stdout:============================================================================================================ 2023-05-08T03:25:48.528 INFO:teuthology.orchestra.run.smithi186.stdout:Installing group/module packages: 2023-05-08T03:25:48.528 INFO:teuthology.orchestra.run.smithi186.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-05-08T03:25:48.528 INFO:teuthology.orchestra.run.smithi186.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-05-08T03:25:48.528 INFO:teuthology.orchestra.run.smithi186.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-05-08T03:25:48.528 INFO:teuthology.orchestra.run.smithi186.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-05-08T03:25:48.528 INFO:teuthology.orchestra.run.smithi186.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-05-08T03:25:48.529 INFO:teuthology.orchestra.run.smithi186.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-05-08T03:25:48.529 INFO:teuthology.orchestra.run.smithi186.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-05-08T03:25:48.529 INFO:teuthology.orchestra.run.smithi186.stdout:Installing dependencies: 2023-05-08T03:25:48.529 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-05-08T03:25:48.530 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-05-08T03:25:48.530 INFO:teuthology.orchestra.run.smithi186.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-05-08T03:25:48.530 INFO:teuthology.orchestra.run.smithi186.stdout:Installing module profiles: 2023-05-08T03:25:48.530 INFO:teuthology.orchestra.run.smithi186.stdout: container-tools/common 2023-05-08T03:25:48.531 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-05-08T03:25:48.531 INFO:teuthology.orchestra.run.smithi186.stdout:Enabling module streams: 2023-05-08T03:25:48.531 INFO:teuthology.orchestra.run.smithi186.stdout: container-tools rhel8 2023-05-08T03:25:48.531 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-05-08T03:25:48.532 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction Summary 2023-05-08T03:25:48.532 INFO:teuthology.orchestra.run.smithi186.stdout:============================================================================================================ 2023-05-08T03:25:48.532 INFO:teuthology.orchestra.run.smithi186.stdout:Install 10 Packages 2023-05-08T03:25:48.532 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-05-08T03:25:48.533 INFO:teuthology.orchestra.run.smithi186.stdout:Total download size: 18 M 2023-05-08T03:25:48.534 INFO:teuthology.orchestra.run.smithi186.stdout:Installed size: 65 M 2023-05-08T03:25:48.534 INFO:teuthology.orchestra.run.smithi186.stdout:Downloading Packages: 2023-05-08T03:25:48.609 INFO:teuthology.orchestra.run.smithi186.stdout:(1/10): python3-pyxdg-0.25-16.el8.noarch.rpm 1.1 MB/s | 94 kB 00:00 2023-05-08T03:25:48.634 INFO:teuthology.orchestra.run.smithi186.stdout:(2/10): python3-pytoml-0.1.14-5.git7dea353.el8. 237 kB/s | 25 kB 00:00 2023-05-08T03:25:48.660 INFO:teuthology.orchestra.run.smithi186.stdout:(3/10): yajl-2.1.0-10.el8.x86_64.rpm 314 kB/s | 41 kB 00:00 2023-05-08T03:25:48.719 INFO:teuthology.orchestra.run.smithi186.stdout:(4/10): udica-0.2.6-4.module+el8.6.0+16771+28df 453 kB/s | 49 kB 00:00 2023-05-08T03:25:48.760 INFO:teuthology.orchestra.run.smithi186.stdout:(5/10): cockpit-podman-49.1-1.module+el8.6.0+16 4.1 MB/s | 524 kB 00:00 2023-05-08T03:25:48.777 INFO:teuthology.orchestra.run.smithi186.stdout:(6/10): python3-podman-4.0.1-1.module+el8.6.0+1 2.5 MB/s | 149 kB 00:00 2023-05-08T03:25:48.811 INFO:teuthology.orchestra.run.smithi186.stdout:(7/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 4.1 MB/s | 213 kB 00:00 2023-05-08T03:25:48.847 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2023-05-08T03:25:48.924 INFO:teuthology.orchestra.run.smithi186.stdout:(8/10): toolbox-0.0.99.3-0.6.module+el8.6.0+167 20 MB/s | 2.2 MB 00:00 2023-05-08T03:25:48.941 INFO:teuthology.orchestra.run.smithi133.stdout:============================================================================================================ 2023-05-08T03:25:48.941 INFO:teuthology.orchestra.run.smithi133.stdout: Package Arch Version Repository Size 2023-05-08T03:25:48.941 INFO:teuthology.orchestra.run.smithi133.stdout:============================================================================================================ 2023-05-08T03:25:48.941 INFO:teuthology.orchestra.run.smithi133.stdout:Installing group/module packages: 2023-05-08T03:25:48.942 INFO:teuthology.orchestra.run.smithi133.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-05-08T03:25:48.942 INFO:teuthology.orchestra.run.smithi133.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-05-08T03:25:48.942 INFO:teuthology.orchestra.run.smithi133.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-05-08T03:25:48.942 INFO:teuthology.orchestra.run.smithi133.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-05-08T03:25:48.942 INFO:teuthology.orchestra.run.smithi133.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-05-08T03:25:48.942 INFO:teuthology.orchestra.run.smithi133.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-05-08T03:25:48.942 INFO:teuthology.orchestra.run.smithi133.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-05-08T03:25:48.943 INFO:teuthology.orchestra.run.smithi133.stdout:Installing dependencies: 2023-05-08T03:25:48.943 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-05-08T03:25:48.943 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-05-08T03:25:48.943 INFO:teuthology.orchestra.run.smithi133.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-05-08T03:25:48.943 INFO:teuthology.orchestra.run.smithi133.stdout:Installing module profiles: 2023-05-08T03:25:48.943 INFO:teuthology.orchestra.run.smithi133.stdout: container-tools/common 2023-05-08T03:25:48.943 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-05-08T03:25:48.943 INFO:teuthology.orchestra.run.smithi133.stdout:Enabling module streams: 2023-05-08T03:25:48.944 INFO:teuthology.orchestra.run.smithi133.stdout: container-tools rhel8 2023-05-08T03:25:48.944 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-05-08T03:25:48.944 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction Summary 2023-05-08T03:25:48.944 INFO:teuthology.orchestra.run.smithi133.stdout:============================================================================================================ 2023-05-08T03:25:48.944 INFO:teuthology.orchestra.run.smithi133.stdout:Install 10 Packages 2023-05-08T03:25:48.944 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-05-08T03:25:48.945 INFO:teuthology.orchestra.run.smithi133.stdout:Total download size: 18 M 2023-05-08T03:25:48.945 INFO:teuthology.orchestra.run.smithi133.stdout:Installed size: 65 M 2023-05-08T03:25:48.945 INFO:teuthology.orchestra.run.smithi133.stdout:Downloading Packages: 2023-05-08T03:25:49.004 INFO:teuthology.orchestra.run.smithi133.stdout:(1/10): python3-pytoml-0.1.14-5.git7dea353.el8. 409 kB/s | 25 kB 00:00 2023-05-08T03:25:49.021 INFO:teuthology.orchestra.run.smithi133.stdout:(2/10): yajl-2.1.0-10.el8.x86_64.rpm 525 kB/s | 41 kB 00:00 2023-05-08T03:25:49.023 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2023-05-08T03:25:49.028 INFO:teuthology.orchestra.run.smithi186.stdout:(9/10): buildah-1.26.2-1.module+el8.6.0+16771+2 22 MB/s | 8.0 MB 00:00 2023-05-08T03:25:49.046 INFO:teuthology.orchestra.run.smithi133.stdout:(3/10): python3-pyxdg-0.25-16.el8.noarch.rpm 912 kB/s | 94 kB 00:00 2023-05-08T03:25:49.072 INFO:teuthology.orchestra.run.smithi133.stdout:(4/10): udica-0.2.6-4.module+el8.6.0+16771+28df 735 kB/s | 49 kB 00:00 2023-05-08T03:25:49.105 INFO:teuthology.orchestra.run.smithi133.stdout:(5/10): cockpit-podman-49.1-1.module+el8.6.0+16 6.1 MB/s | 524 kB 00:00 2023-05-08T03:25:49.116 INFO:teuthology.orchestra.run.smithi096.stdout:============================================================================================================ 2023-05-08T03:25:49.117 INFO:teuthology.orchestra.run.smithi096.stdout: Package Arch Version Repository Size 2023-05-08T03:25:49.117 INFO:teuthology.orchestra.run.smithi096.stdout:============================================================================================================ 2023-05-08T03:25:49.117 INFO:teuthology.orchestra.run.smithi096.stdout:Installing group/module packages: 2023-05-08T03:25:49.117 INFO:teuthology.orchestra.run.smithi096.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-05-08T03:25:49.117 INFO:teuthology.orchestra.run.smithi096.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-05-08T03:25:49.117 INFO:teuthology.orchestra.run.smithi096.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-05-08T03:25:49.118 INFO:teuthology.orchestra.run.smithi096.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-05-08T03:25:49.118 INFO:teuthology.orchestra.run.smithi096.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-05-08T03:25:49.118 INFO:teuthology.orchestra.run.smithi096.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-05-08T03:25:49.118 INFO:teuthology.orchestra.run.smithi096.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-05-08T03:25:49.118 INFO:teuthology.orchestra.run.smithi096.stdout:Installing dependencies: 2023-05-08T03:25:49.118 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-05-08T03:25:49.118 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-05-08T03:25:49.118 INFO:teuthology.orchestra.run.smithi096.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-05-08T03:25:49.119 INFO:teuthology.orchestra.run.smithi096.stdout:Installing module profiles: 2023-05-08T03:25:49.119 INFO:teuthology.orchestra.run.smithi096.stdout: container-tools/common 2023-05-08T03:25:49.119 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:25:49.119 INFO:teuthology.orchestra.run.smithi096.stdout:Enabling module streams: 2023-05-08T03:25:49.120 INFO:teuthology.orchestra.run.smithi096.stdout: container-tools rhel8 2023-05-08T03:25:49.120 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:25:49.120 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction Summary 2023-05-08T03:25:49.120 INFO:teuthology.orchestra.run.smithi096.stdout:============================================================================================================ 2023-05-08T03:25:49.121 INFO:teuthology.orchestra.run.smithi096.stdout:Install 10 Packages 2023-05-08T03:25:49.121 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:25:49.123 INFO:teuthology.orchestra.run.smithi096.stdout:Total download size: 18 M 2023-05-08T03:25:49.123 INFO:teuthology.orchestra.run.smithi096.stdout:Installed size: 65 M 2023-05-08T03:25:49.123 INFO:teuthology.orchestra.run.smithi096.stdout:Downloading Packages: 2023-05-08T03:25:49.130 INFO:teuthology.orchestra.run.smithi133.stdout:(6/10): python3-podman-4.0.1-1.module+el8.6.0+1 2.5 MB/s | 149 kB 00:00 2023-05-08T03:25:49.145 INFO:teuthology.orchestra.run.smithi186.stdout:(10/10): skopeo-1.9.1-1.module+el8.6.0+16771+28 19 MB/s | 7.0 MB 00:00 2023-05-08T03:25:49.146 INFO:teuthology.orchestra.run.smithi186.stdout:-------------------------------------------------------------------------------- 2023-05-08T03:25:49.146 INFO:teuthology.orchestra.run.smithi186.stdout:Total 30 MB/s | 18 MB 00:00 2023-05-08T03:25:49.155 INFO:teuthology.orchestra.run.smithi133.stdout:(7/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 4.1 MB/s | 213 kB 00:00 2023-05-08T03:25:49.184 INFO:teuthology.orchestra.run.smithi096.stdout:(1/10): python3-pytoml-0.1.14-5.git7dea353.el8. 385 kB/s | 25 kB 00:00 2023-05-08T03:25:49.209 INFO:teuthology.orchestra.run.smithi096.stdout:(2/10): yajl-2.1.0-10.el8.x86_64.rpm 453 kB/s | 41 kB 00:00 2023-05-08T03:25:49.234 INFO:teuthology.orchestra.run.smithi096.stdout:(3/10): python3-pyxdg-0.25-16.el8.noarch.rpm 814 kB/s | 94 kB 00:00 2023-05-08T03:25:49.239 INFO:teuthology.orchestra.run.smithi133.stdout:(8/10): toolbox-0.0.99.3-0.6.module+el8.6.0+167 26 MB/s | 2.2 MB 00:00 2023-05-08T03:25:49.260 INFO:teuthology.orchestra.run.smithi096.stdout:(4/10): udica-0.2.6-4.module+el8.6.0+16771+28df 653 kB/s | 49 kB 00:00 2023-05-08T03:25:49.302 INFO:teuthology.orchestra.run.smithi096.stdout:(5/10): cockpit-podman-49.1-1.module+el8.6.0+16 5.6 MB/s | 524 kB 00:00 2023-05-08T03:25:49.327 INFO:teuthology.orchestra.run.smithi096.stdout:(6/10): python3-podman-4.0.1-1.module+el8.6.0+1 2.2 MB/s | 149 kB 00:00 2023-05-08T03:25:49.346 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction check 2023-05-08T03:25:49.352 INFO:teuthology.orchestra.run.smithi096.stdout:(7/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 4.1 MB/s | 213 kB 00:00 2023-05-08T03:25:49.365 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction check succeeded. 2023-05-08T03:25:49.365 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction test 2023-05-08T03:25:49.381 INFO:teuthology.orchestra.run.smithi133.stdout:(9/10): skopeo-1.9.1-1.module+el8.6.0+16771+28d 28 MB/s | 7.0 MB 00:00 2023-05-08T03:25:49.436 INFO:teuthology.orchestra.run.smithi096.stdout:(8/10): toolbox-0.0.99.3-0.6.module+el8.6.0+167 26 MB/s | 2.2 MB 00:00 2023-05-08T03:25:49.465 INFO:teuthology.orchestra.run.smithi133.stdout:(10/10): buildah-1.26.2-1.module+el8.6.0+16771+ 19 MB/s | 8.0 MB 00:00 2023-05-08T03:25:49.465 INFO:teuthology.orchestra.run.smithi133.stdout:-------------------------------------------------------------------------------- 2023-05-08T03:25:49.466 INFO:teuthology.orchestra.run.smithi133.stdout:Total 35 MB/s | 18 MB 00:00 2023-05-08T03:25:49.547 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction test succeeded. 2023-05-08T03:25:49.551 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction 2023-05-08T03:25:49.553 INFO:teuthology.orchestra.run.smithi096.stdout:(9/10): skopeo-1.9.1-1.module+el8.6.0+16771+28d 31 MB/s | 7.0 MB 00:00 2023-05-08T03:25:49.653 INFO:teuthology.orchestra.run.smithi096.stdout:(10/10): buildah-1.26.2-1.module+el8.6.0+16771+ 19 MB/s | 8.0 MB 00:00 2023-05-08T03:25:49.653 INFO:teuthology.orchestra.run.smithi096.stdout:-------------------------------------------------------------------------------- 2023-05-08T03:25:49.654 INFO:teuthology.orchestra.run.smithi096.stdout:Total 34 MB/s | 18 MB 00:00 2023-05-08T03:25:49.665 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction check 2023-05-08T03:25:49.684 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction check succeeded. 2023-05-08T03:25:49.684 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction test 2023-05-08T03:25:49.852 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction check 2023-05-08T03:25:49.866 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction test succeeded. 2023-05-08T03:25:49.870 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction 2023-05-08T03:25:49.871 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction check succeeded. 2023-05-08T03:25:49.871 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction test 2023-05-08T03:25:50.053 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction test succeeded. 2023-05-08T03:25:50.057 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction 2023-05-08T03:25:50.096 INFO:teuthology.orchestra.run.smithi186.stdout: Preparing : 1/1 2023-05-08T03:25:50.314 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-05-08T03:25:50.463 INFO:teuthology.orchestra.run.smithi133.stdout: Preparing : 1/1 2023-05-08T03:25:50.497 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-05-08T03:25:50.553 INFO:teuthology.orchestra.run.smithi096.stdout: Preparing : 1/1 2023-05-08T03:25:50.673 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-05-08T03:25:50.716 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-05-08T03:25:50.759 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-05-08T03:25:50.845 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-05-08T03:25:50.920 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-05-08T03:25:50.961 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-05-08T03:25:51.039 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-05-08T03:25:51.097 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-05-08T03:25:51.284 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-05-08T03:25:51.297 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-05-08T03:25:51.309 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-05-08T03:25:51.632 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-05-08T03:25:51.641 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-05-08T03:25:52.055 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-05-08T03:25:52.395 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-05-08T03:25:52.395 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-05-08T03:25:52.954 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-05-08T03:25:53.223 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-05-08T03:25:53.267 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-05-08T03:25:53.293 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-05-08T03:25:53.455 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-05-08T03:25:53.490 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-05-08T03:25:53.526 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-05-08T03:25:53.648 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-05-08T03:25:53.652 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-05-08T03:25:53.685 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-05-08T03:25:53.760 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-05-08T03:25:53.761 INFO:teuthology.orchestra.run.smithi186.stdout:[/usr/lib/tmpfiles.d/journal-nocow.conf:26] Failed to resolve specifier: uninitialized /etc detected, skipping 2023-05-08T03:25:53.761 INFO:teuthology.orchestra.run.smithi186.stdout:All rules containing unresolvable specifiers will be skipped. 2023-05-08T03:25:53.761 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-05-08T03:25:53.830 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-05-08T03:25:53.854 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-05-08T03:25:53.915 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-05-08T03:25:53.916 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-05-08T03:25:53.916 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-05-08T03:25:53.916 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-05-08T03:25:53.916 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-05-08T03:25:53.916 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-05-08T03:25:53.916 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-05-08T03:25:53.917 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-05-08T03:25:53.917 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-05-08T03:25:53.939 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-05-08T03:25:53.940 INFO:teuthology.orchestra.run.smithi133.stdout:[/usr/lib/tmpfiles.d/journal-nocow.conf:26] Failed to resolve specifier: uninitialized /etc detected, skipping 2023-05-08T03:25:53.940 INFO:teuthology.orchestra.run.smithi133.stdout:All rules containing unresolvable specifiers will be skipped. 2023-05-08T03:25:53.940 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-05-08T03:25:53.968 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-05-08T03:25:53.969 INFO:teuthology.orchestra.run.smithi096.stdout:[/usr/lib/tmpfiles.d/journal-nocow.conf:26] Failed to resolve specifier: uninitialized /etc detected, skipping 2023-05-08T03:25:53.969 INFO:teuthology.orchestra.run.smithi096.stdout:All rules containing unresolvable specifiers will be skipped. 2023-05-08T03:25:53.969 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:25:54.096 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-05-08T03:25:54.096 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-05-08T03:25:54.097 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-05-08T03:25:54.097 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-05-08T03:25:54.097 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-05-08T03:25:54.097 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-05-08T03:25:54.097 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-05-08T03:25:54.097 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-05-08T03:25:54.097 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-05-08T03:25:54.118 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-05-08T03:25:54.118 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-05-08T03:25:54.118 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-05-08T03:25:54.118 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-05-08T03:25:54.118 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-05-08T03:25:54.118 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-05-08T03:25:54.119 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-05-08T03:25:54.119 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-05-08T03:25:54.119 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-05-08T03:25:55.129 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-05-08T03:25:55.130 INFO:teuthology.orchestra.run.smithi186.stdout:Last metadata expiration check: 0:01:49 ago on Mon 08 May 2023 03:24:05 AM UTC. 2023-05-08T03:25:55.277 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-05-08T03:25:55.277 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:08:38 ago on Mon 08 May 2023 03:17:16 AM UTC. 2023-05-08T03:25:55.296 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-05-08T03:25:55.296 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:06:16 ago on Mon 08 May 2023 03:19:38 AM UTC. 2023-05-08T03:25:58.121 INFO:teuthology.orchestra.run.smithi186.stdout:Installed products updated. 2023-05-08T03:25:58.323 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-05-08T03:25:58.324 INFO:teuthology.orchestra.run.smithi186.stdout:Installed: 2023-05-08T03:25:58.324 INFO:teuthology.orchestra.run.smithi186.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-05-08T03:25:58.324 INFO:teuthology.orchestra.run.smithi186.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-05-08T03:25:58.324 INFO:teuthology.orchestra.run.smithi186.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-05-08T03:25:58.325 INFO:teuthology.orchestra.run.smithi186.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-05-08T03:25:58.325 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-05-08T03:25:58.325 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-05-08T03:25:58.325 INFO:teuthology.orchestra.run.smithi186.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-05-08T03:25:58.325 INFO:teuthology.orchestra.run.smithi186.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-05-08T03:25:58.325 INFO:teuthology.orchestra.run.smithi186.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-05-08T03:25:58.325 INFO:teuthology.orchestra.run.smithi186.stdout: yajl-2.1.0-10.el8.x86_64 2023-05-08T03:25:58.326 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-05-08T03:25:58.326 INFO:teuthology.orchestra.run.smithi186.stdout:Complete! 2023-05-08T03:25:58.326 INFO:teuthology.orchestra.run.smithi096.stdout:Installed products updated. 2023-05-08T03:25:58.432 INFO:teuthology.orchestra.run.smithi133.stdout:Installed products updated. 2023-05-08T03:25:58.502 DEBUG:teuthology.parallel:result is None 2023-05-08T03:25:58.536 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:25:58.536 INFO:teuthology.orchestra.run.smithi096.stdout:Installed: 2023-05-08T03:25:58.536 INFO:teuthology.orchestra.run.smithi096.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-05-08T03:25:58.536 INFO:teuthology.orchestra.run.smithi096.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-05-08T03:25:58.536 INFO:teuthology.orchestra.run.smithi096.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-05-08T03:25:58.537 INFO:teuthology.orchestra.run.smithi096.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-05-08T03:25:58.537 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-05-08T03:25:58.537 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-05-08T03:25:58.537 INFO:teuthology.orchestra.run.smithi096.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-05-08T03:25:58.537 INFO:teuthology.orchestra.run.smithi096.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-05-08T03:25:58.537 INFO:teuthology.orchestra.run.smithi096.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-05-08T03:25:58.537 INFO:teuthology.orchestra.run.smithi096.stdout: yajl-2.1.0-10.el8.x86_64 2023-05-08T03:25:58.538 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:25:58.538 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2023-05-08T03:25:58.635 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-05-08T03:25:58.636 INFO:teuthology.orchestra.run.smithi133.stdout:Installed: 2023-05-08T03:25:58.636 INFO:teuthology.orchestra.run.smithi133.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-05-08T03:25:58.636 INFO:teuthology.orchestra.run.smithi133.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-05-08T03:25:58.636 INFO:teuthology.orchestra.run.smithi133.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-05-08T03:25:58.636 INFO:teuthology.orchestra.run.smithi133.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-05-08T03:25:58.636 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-05-08T03:25:58.636 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-05-08T03:25:58.637 INFO:teuthology.orchestra.run.smithi133.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-05-08T03:25:58.637 INFO:teuthology.orchestra.run.smithi133.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-05-08T03:25:58.637 INFO:teuthology.orchestra.run.smithi133.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-05-08T03:25:58.637 INFO:teuthology.orchestra.run.smithi133.stdout: yajl-2.1.0-10.el8.x86_64 2023-05-08T03:25:58.637 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-05-08T03:25:58.637 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2023-05-08T03:25:58.724 DEBUG:teuthology.parallel:result is None 2023-05-08T03:25:58.895 DEBUG:teuthology.parallel:result is None 2023-05-08T03:25:58.896 INFO:teuthology.run_tasks:Running task install... 2023-05-08T03:25:58.904 DEBUG:teuthology.task.install:project ceph 2023-05-08T03:25:58.905 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '4b086ba51b906a75bac7252b2239e8f120a38c8c'}} 2023-05-08T03:25:58.905 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '4b086ba51b906a75bac7252b2239e8f120a38c8c'} 2023-05-08T03:25:58.905 INFO:teuthology.task.install:Using flavor: default 2023-05-08T03:25:58.911 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-05-08T03:25:58.911 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-05-08T03:25:58.912 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '4b086ba51b906a75bac7252b2239e8f120a38c8c', 'tag': None, 'wait_for_package': False} 2023-05-08T03:25:58.912 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4b086ba51b906a75bac7252b2239e8f120a38c8c 2023-05-08T03:25:58.914 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '4b086ba51b906a75bac7252b2239e8f120a38c8c', 'tag': None, 'wait_for_package': False} 2023-05-08T03:25:58.915 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4b086ba51b906a75bac7252b2239e8f120a38c8c 2023-05-08T03:25:58.916 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '4b086ba51b906a75bac7252b2239e8f120a38c8c', 'tag': None, 'wait_for_package': False} 2023-05-08T03:25:58.916 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4b086ba51b906a75bac7252b2239e8f120a38c8c 2023-05-08T03:25:59.062 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230506.143554/4b086ba51b906a75bac7252b2239e8f120a38c8c/centos/8/flavors/default/ 2023-05-08T03:25:59.062 INFO:teuthology.task.install.rpm:Package version is 18.0.0-3786.g4b086ba5 2023-05-08T03:25:59.070 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230506.143554/4b086ba51b906a75bac7252b2239e8f120a38c8c/centos/8/flavors/default/ 2023-05-08T03:25:59.070 INFO:teuthology.task.install.rpm:Package version is 18.0.0-3786.g4b086ba5 2023-05-08T03:25:59.071 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230506.143554/4b086ba51b906a75bac7252b2239e8f120a38c8c/centos/8/flavors/default/ 2023-05-08T03:25:59.072 INFO:teuthology.task.install.rpm:Package version is 18.0.0-3786.g4b086ba5 2023-05-08T03:25:59.170 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230506.143554/4b086ba51b906a75bac7252b2239e8f120a38c8c/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230506.143554/4b086ba51b906a75bac7252b2239e8f120a38c8c/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230506.143554/4b086ba51b906a75bac7252b2239e8f120a38c8c/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-05-08T03:25:59.170 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-05-08T03:25:59.171 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-05-08T03:25:59.177 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230506.143554/4b086ba51b906a75bac7252b2239e8f120a38c8c/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230506.143554/4b086ba51b906a75bac7252b2239e8f120a38c8c/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230506.143554/4b086ba51b906a75bac7252b2239e8f120a38c8c/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-05-08T03:25:59.177 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-05-08T03:25:59.178 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-05-08T03:25:59.182 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230506.143554/4b086ba51b906a75bac7252b2239e8f120a38c8c/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230506.143554/4b086ba51b906a75bac7252b2239e8f120a38c8c/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230506.143554/4b086ba51b906a75bac7252b2239e8f120a38c8c/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-05-08T03:25:59.183 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2023-05-08T03:25:59.183 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-05-08T03:25:59.198 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-05-08T03:25:59.198 DEBUG:teuthology.orchestra.run.smithi096:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/4b086ba51b906a75bac7252b2239e8f120a38c8c/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-05-08T03:25:59.204 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-05-08T03:25:59.204 DEBUG:teuthology.orchestra.run.smithi133:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/4b086ba51b906a75bac7252b2239e8f120a38c8c/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-05-08T03:25:59.209 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-05-08T03:25:59.209 DEBUG:teuthology.orchestra.run.smithi186:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/4b086ba51b906a75bac7252b2239e8f120a38c8c/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-05-08T03:25:59.265 DEBUG:teuthology.orchestra.run.smithi096:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-05-08T03:25:59.270 DEBUG:teuthology.orchestra.run.smithi133:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-05-08T03:25:59.276 DEBUG:teuthology.orchestra.run.smithi186:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-05-08T03:25:59.342 DEBUG:teuthology.orchestra.run.smithi096:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-05-08T03:25:59.346 DEBUG:teuthology.orchestra.run.smithi133:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-05-08T03:25:59.353 DEBUG:teuthology.orchestra.run.smithi186:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-05-08T03:25:59.408 INFO:teuthology.orchestra.run.smithi096.stdout:check_obsoletes = 1 2023-05-08T03:25:59.409 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum clean all 2023-05-08T03:25:59.410 INFO:teuthology.orchestra.run.smithi133.stdout:check_obsoletes = 1 2023-05-08T03:25:59.412 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum clean all 2023-05-08T03:25:59.420 INFO:teuthology.orchestra.run.smithi186.stdout:check_obsoletes = 1 2023-05-08T03:25:59.421 DEBUG:teuthology.orchestra.run.smithi186:> sudo yum clean all 2023-05-08T03:25:59.795 INFO:teuthology.orchestra.run.smithi096.stdout:Updating Subscription Management repositories. 2023-05-08T03:25:59.798 INFO:teuthology.orchestra.run.smithi133.stdout:Updating Subscription Management repositories. 2023-05-08T03:25:59.848 INFO:teuthology.orchestra.run.smithi186.stdout:Updating Subscription Management repositories. 2023-05-08T03:26:00.059 INFO:teuthology.orchestra.run.smithi096.stdout:44 files removed 2023-05-08T03:26:00.081 INFO:teuthology.orchestra.run.smithi133.stdout:44 files removed 2023-05-08T03:26:00.106 INFO:teuthology.orchestra.run.smithi186.stdout:44 files removed 2023-05-08T03:26:00.111 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-05-08T03:26:00.134 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-05-08T03:26:00.165 DEBUG:teuthology.orchestra.run.smithi186:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-05-08T03:26:00.461 INFO:teuthology.orchestra.run.smithi096.stdout:Updating Subscription Management repositories. 2023-05-08T03:26:00.514 INFO:teuthology.orchestra.run.smithi186.stdout:Updating Subscription Management repositories. 2023-05-08T03:26:00.526 INFO:teuthology.orchestra.run.smithi133.stdout:Updating Subscription Management repositories. 2023-05-08T03:26:01.122 INFO:teuthology.orchestra.run.smithi096.stdout:ceph packages for x86_64 298 kB/s | 80 kB 00:00 2023-05-08T03:26:01.175 INFO:teuthology.orchestra.run.smithi186.stdout:ceph packages for x86_64 330 kB/s | 80 kB 00:00 2023-05-08T03:26:01.178 INFO:teuthology.orchestra.run.smithi133.stdout:ceph packages for x86_64 316 kB/s | 80 kB 00:00 2023-05-08T03:26:01.400 INFO:teuthology.orchestra.run.smithi096.stdout:ceph noarch packages 39 kB/s | 9.4 kB 00:00 2023-05-08T03:26:01.469 INFO:teuthology.orchestra.run.smithi186.stdout:ceph noarch packages 36 kB/s | 9.4 kB 00:00 2023-05-08T03:26:01.471 INFO:teuthology.orchestra.run.smithi133.stdout:ceph noarch packages 36 kB/s | 9.4 kB 00:00 2023-05-08T03:26:01.659 INFO:teuthology.orchestra.run.smithi096.stdout:ceph source packages 6.3 kB/s | 1.5 kB 00:00 2023-05-08T03:26:01.721 INFO:teuthology.orchestra.run.smithi186.stdout:ceph source packages 6.5 kB/s | 1.5 kB 00:00 2023-05-08T03:26:01.722 INFO:teuthology.orchestra.run.smithi133.stdout:ceph source packages 6.5 kB/s | 1.5 kB 00:00 2023-05-08T03:26:03.958 INFO:teuthology.orchestra.run.smithi133.stdout:Copr repo for python3-asyncssh owned by ceph 1.6 kB/s | 3.5 kB 00:02 2023-05-08T03:26:04.178 INFO:teuthology.orchestra.run.smithi096.stdout:Copr repo for python3-asyncssh owned by ceph 1.4 kB/s | 3.5 kB 00:02 2023-05-08T03:26:04.215 INFO:teuthology.orchestra.run.smithi186.stdout:Copr repo for python3-asyncssh owned by ceph 1.4 kB/s | 3.5 kB 00:02 2023-05-08T03:26:05.527 INFO:teuthology.orchestra.run.smithi133.stdout:Extra Packages for Enterprise Linux 8.9 MB/s | 14 MB 00:01 2023-05-08T03:26:08.757 INFO:teuthology.orchestra.run.smithi133.stdout:lab-extras 458 kB/s | 24 kB 00:00 2023-05-08T03:26:09.761 INFO:teuthology.orchestra.run.smithi133.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 51 MB/s | 47 MB 00:00 2023-05-08T03:26:17.715 INFO:teuthology.orchestra.run.smithi133.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 62 MB/s | 53 MB 00:00 2023-05-08T03:26:18.160 INFO:teuthology.orchestra.run.smithi186.stdout:Extra Packages for Enterprise Linux 1.0 MB/s | 14 MB 00:13 2023-05-08T03:26:18.407 INFO:teuthology.orchestra.run.smithi096.stdout:Extra Packages for Enterprise Linux 998 kB/s | 14 MB 00:14 2023-05-08T03:26:21.383 INFO:teuthology.orchestra.run.smithi186.stdout:lab-extras 152 kB/s | 24 kB 00:00 2023-05-08T03:26:21.538 INFO:teuthology.orchestra.run.smithi096.stdout:lab-extras 532 kB/s | 24 kB 00:00 2023-05-08T03:26:22.310 INFO:teuthology.orchestra.run.smithi186.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 62 MB/s | 53 MB 00:00 2023-05-08T03:26:22.464 INFO:teuthology.orchestra.run.smithi096.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 62 MB/s | 53 MB 00:00 2023-05-08T03:26:28.947 INFO:teuthology.orchestra.run.smithi133.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-05-08T03:26:28.948 INFO:teuthology.orchestra.run.smithi133.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-05-08T03:26:28.962 INFO:teuthology.orchestra.run.smithi133.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-05-08T03:26:28.963 INFO:teuthology.orchestra.run.smithi133.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-05-08T03:26:28.964 INFO:teuthology.orchestra.run.smithi133.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-05-08T03:26:28.965 INFO:teuthology.orchestra.run.smithi133.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-05-08T03:26:28.968 INFO:teuthology.orchestra.run.smithi133.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-05-08T03:26:28.971 INFO:teuthology.orchestra.run.smithi133.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-05-08T03:26:28.972 INFO:teuthology.orchestra.run.smithi133.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-05-08T03:26:29.105 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2023-05-08T03:26:29.116 INFO:teuthology.orchestra.run.smithi133.stdout:=========================================================================================================================== 2023-05-08T03:26:29.117 INFO:teuthology.orchestra.run.smithi133.stdout: Package Arch Version Repository Size 2023-05-08T03:26:29.117 INFO:teuthology.orchestra.run.smithi133.stdout:=========================================================================================================================== 2023-05-08T03:26:29.117 INFO:teuthology.orchestra.run.smithi133.stdout:Installing: 2023-05-08T03:26:29.117 INFO:teuthology.orchestra.run.smithi133.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-05-08T03:26:29.117 INFO:teuthology.orchestra.run.smithi133.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-05-08T03:26:29.117 INFO:teuthology.orchestra.run.smithi133.stdout: ceph x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 6.4 k 2023-05-08T03:26:29.118 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-base x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 5.3 M 2023-05-08T03:26:29.118 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-fuse x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 848 k 2023-05-08T03:26:29.118 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 165 k 2023-05-08T03:26:29.118 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 1.5 M 2023-05-08T03:26:29.118 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-cephadm noarch 2:18.0.0-3786.g4b086ba5.el8 ceph-noarch 127 k 2023-05-08T03:26:29.118 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-dashboard noarch 2:18.0.0-3786.g4b086ba5.el8 ceph-noarch 1.7 M 2023-05-08T03:26:29.118 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-3786.g4b086ba5.el8 ceph-noarch 7.4 M 2023-05-08T03:26:29.118 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-rook noarch 2:18.0.0-3786.g4b086ba5.el8 ceph-noarch 47 k 2023-05-08T03:26:29.119 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-radosgw x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 13 M 2023-05-08T03:26:29.119 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-test x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 41 M 2023-05-08T03:26:29.119 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-volume noarch 2:18.0.0-3786.g4b086ba5.el8 ceph-noarch 265 k 2023-05-08T03:26:29.119 INFO:teuthology.orchestra.run.smithi133.stdout: cephadm noarch 2:18.0.0-3786.g4b086ba5.el8 ceph-noarch 83 k 2023-05-08T03:26:29.119 INFO:teuthology.orchestra.run.smithi133.stdout: cephfs-mirror x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 258 k 2023-05-08T03:26:29.119 INFO:teuthology.orchestra.run.smithi133.stdout: cephfs-top noarch 2:18.0.0-3786.g4b086ba5.el8 ceph-noarch 18 k 2023-05-08T03:26:29.119 INFO:teuthology.orchestra.run.smithi133.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-05-08T03:26:29.119 INFO:teuthology.orchestra.run.smithi133.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-05-08T03:26:29.120 INFO:teuthology.orchestra.run.smithi133.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-05-08T03:26:29.120 INFO:teuthology.orchestra.run.smithi133.stdout: libcephfs-devel x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 31 k 2023-05-08T03:26:29.120 INFO:teuthology.orchestra.run.smithi133.stdout: libcephfs2 x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 771 k 2023-05-08T03:26:29.120 INFO:teuthology.orchestra.run.smithi133.stdout: librados-devel x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 139 k 2023-05-08T03:26:29.120 INFO:teuthology.orchestra.run.smithi133.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-05-08T03:26:29.120 INFO:teuthology.orchestra.run.smithi133.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-05-08T03:26:29.120 INFO:teuthology.orchestra.run.smithi133.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-05-08T03:26:29.121 INFO:teuthology.orchestra.run.smithi133.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-05-08T03:26:29.121 INFO:teuthology.orchestra.run.smithi133.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-05-08T03:26:29.121 INFO:teuthology.orchestra.run.smithi133.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-05-08T03:26:29.121 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cephfs x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 197 k 2023-05-08T03:26:29.121 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rados x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 371 k 2023-05-08T03:26:29.121 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rbd x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 364 k 2023-05-08T03:26:29.121 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rgw x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 107 k 2023-05-08T03:26:29.122 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-fuse x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 94 k 2023-05-08T03:26:29.122 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-mirror x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 3.4 M 2023-05-08T03:26:29.122 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-nbd x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 179 k 2023-05-08T03:26:29.122 INFO:teuthology.orchestra.run.smithi133.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-05-08T03:26:29.122 INFO:teuthology.orchestra.run.smithi133.stdout:Upgrading: 2023-05-08T03:26:29.122 INFO:teuthology.orchestra.run.smithi133.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-05-08T03:26:29.122 INFO:teuthology.orchestra.run.smithi133.stdout: librados2 x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 3.7 M 2023-05-08T03:26:29.122 INFO:teuthology.orchestra.run.smithi133.stdout: librbd1 x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 3.6 M 2023-05-08T03:26:29.123 INFO:teuthology.orchestra.run.smithi133.stdout:Installing dependencies: 2023-05-08T03:26:29.123 INFO:teuthology.orchestra.run.smithi133.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-05-08T03:26:29.123 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-common x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 22 M 2023-05-08T03:26:29.123 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-grafana-dashboards noarch 2:18.0.0-3786.g4b086ba5.el8 ceph-noarch 23 k 2023-05-08T03:26:29.123 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mds x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 2.3 M 2023-05-08T03:26:29.123 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-modules-core noarch 2:18.0.0-3786.g4b086ba5.el8 ceph-noarch 240 k 2023-05-08T03:26:29.123 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mon x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 4.6 M 2023-05-08T03:26:29.124 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-osd x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 18 M 2023-05-08T03:26:29.124 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-prometheus-alerts noarch 2:18.0.0-3786.g4b086ba5.el8 ceph-noarch 15 k 2023-05-08T03:26:29.124 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-selinux x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 24 k 2023-05-08T03:26:29.124 INFO:teuthology.orchestra.run.smithi133.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-05-08T03:26:29.124 INFO:teuthology.orchestra.run.smithi133.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-05-08T03:26:29.124 INFO:teuthology.orchestra.run.smithi133.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-05-08T03:26:29.124 INFO:teuthology.orchestra.run.smithi133.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-05-08T03:26:29.124 INFO:teuthology.orchestra.run.smithi133.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-05-08T03:26:29.125 INFO:teuthology.orchestra.run.smithi133.stdout: libcephsqlite x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 137 k 2023-05-08T03:26:29.125 INFO:teuthology.orchestra.run.smithi133.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-05-08T03:26:29.125 INFO:teuthology.orchestra.run.smithi133.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-05-08T03:26:29.125 INFO:teuthology.orchestra.run.smithi133.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-05-08T03:26:29.125 INFO:teuthology.orchestra.run.smithi133.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-05-08T03:26:29.125 INFO:teuthology.orchestra.run.smithi133.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-05-08T03:26:29.125 INFO:teuthology.orchestra.run.smithi133.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-05-08T03:26:29.125 INFO:teuthology.orchestra.run.smithi133.stdout: libradosstriper1 x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 473 k 2023-05-08T03:26:29.126 INFO:teuthology.orchestra.run.smithi133.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-05-08T03:26:29.126 INFO:teuthology.orchestra.run.smithi133.stdout: librgw2 x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 6.5 M 2023-05-08T03:26:29.126 INFO:teuthology.orchestra.run.smithi133.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-05-08T03:26:29.126 INFO:teuthology.orchestra.run.smithi133.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-05-08T03:26:29.126 INFO:teuthology.orchestra.run.smithi133.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-05-08T03:26:29.126 INFO:teuthology.orchestra.run.smithi133.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-05-08T03:26:29.126 INFO:teuthology.orchestra.run.smithi133.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-05-08T03:26:29.127 INFO:teuthology.orchestra.run.smithi133.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-05-08T03:26:29.127 INFO:teuthology.orchestra.run.smithi133.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-05-08T03:26:29.127 INFO:teuthology.orchestra.run.smithi133.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-05-08T03:26:29.127 INFO:teuthology.orchestra.run.smithi133.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-05-08T03:26:29.127 INFO:teuthology.orchestra.run.smithi133.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-05-08T03:26:29.127 INFO:teuthology.orchestra.run.smithi133.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-05-08T03:26:29.127 INFO:teuthology.orchestra.run.smithi133.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-05-08T03:26:29.127 INFO:teuthology.orchestra.run.smithi133.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-05-08T03:26:29.128 INFO:teuthology.orchestra.run.smithi133.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-05-08T03:26:29.128 INFO:teuthology.orchestra.run.smithi133.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-05-08T03:26:29.128 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-05-08T03:26:29.128 INFO:teuthology.orchestra.run.smithi133.stdout: python3-ceph-argparse x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 45 k 2023-05-08T03:26:29.128 INFO:teuthology.orchestra.run.smithi133.stdout: python3-ceph-common x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 119 k 2023-05-08T03:26:29.128 INFO:teuthology.orchestra.run.smithi133.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-05-08T03:26:29.128 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-05-08T03:26:29.129 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-05-08T03:26:29.129 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-05-08T03:26:29.129 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-05-08T03:26:29.129 INFO:teuthology.orchestra.run.smithi133.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-05-08T03:26:29.129 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-05-08T03:26:29.129 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-05-08T03:26:29.129 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-05-08T03:26:29.129 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-05-08T03:26:29.130 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-05-08T03:26:29.130 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-05-08T03:26:29.130 INFO:teuthology.orchestra.run.smithi133.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-05-08T03:26:29.130 INFO:teuthology.orchestra.run.smithi133.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-05-08T03:26:29.130 INFO:teuthology.orchestra.run.smithi133.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-05-08T03:26:29.130 INFO:teuthology.orchestra.run.smithi133.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-05-08T03:26:29.130 INFO:teuthology.orchestra.run.smithi133.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-05-08T03:26:29.130 INFO:teuthology.orchestra.run.smithi133.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-05-08T03:26:29.131 INFO:teuthology.orchestra.run.smithi133.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-05-08T03:26:29.131 INFO:teuthology.orchestra.run.smithi133.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-05-08T03:26:29.131 INFO:teuthology.orchestra.run.smithi133.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-05-08T03:26:29.131 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-05-08T03:26:29.131 INFO:teuthology.orchestra.run.smithi133.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-05-08T03:26:29.132 INFO:teuthology.orchestra.run.smithi133.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-05-08T03:26:29.132 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-05-08T03:26:29.132 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-05-08T03:26:29.132 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-05-08T03:26:29.132 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-05-08T03:26:29.133 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-05-08T03:26:29.133 INFO:teuthology.orchestra.run.smithi133.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-05-08T03:26:29.133 INFO:teuthology.orchestra.run.smithi133.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-05-08T03:26:29.133 INFO:teuthology.orchestra.run.smithi133.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-05-08T03:26:29.133 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-05-08T03:26:29.133 INFO:teuthology.orchestra.run.smithi133.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-05-08T03:26:29.133 INFO:teuthology.orchestra.run.smithi133.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-05-08T03:26:29.134 INFO:teuthology.orchestra.run.smithi133.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-05-08T03:26:29.134 INFO:teuthology.orchestra.run.smithi133.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-05-08T03:26:29.134 INFO:teuthology.orchestra.run.smithi133.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-05-08T03:26:29.134 INFO:teuthology.orchestra.run.smithi133.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2023-05-08T03:26:29.134 INFO:teuthology.orchestra.run.smithi133.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-05-08T03:26:29.134 INFO:teuthology.orchestra.run.smithi133.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-05-08T03:26:29.134 INFO:teuthology.orchestra.run.smithi133.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-05-08T03:26:29.135 INFO:teuthology.orchestra.run.smithi133.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-05-08T03:26:29.135 INFO:teuthology.orchestra.run.smithi133.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-05-08T03:26:29.135 INFO:teuthology.orchestra.run.smithi133.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-05-08T03:26:29.135 INFO:teuthology.orchestra.run.smithi133.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-05-08T03:26:29.135 INFO:teuthology.orchestra.run.smithi133.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-05-08T03:26:29.135 INFO:teuthology.orchestra.run.smithi133.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-05-08T03:26:29.135 INFO:teuthology.orchestra.run.smithi133.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-05-08T03:26:29.135 INFO:teuthology.orchestra.run.smithi133.stdout:Enabling module streams: 2023-05-08T03:26:29.136 INFO:teuthology.orchestra.run.smithi133.stdout: postgresql 10 2023-05-08T03:26:29.136 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-05-08T03:26:29.136 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction Summary 2023-05-08T03:26:29.136 INFO:teuthology.orchestra.run.smithi133.stdout:=========================================================================================================================== 2023-05-08T03:26:29.136 INFO:teuthology.orchestra.run.smithi133.stdout:Install 128 Packages 2023-05-08T03:26:29.136 INFO:teuthology.orchestra.run.smithi133.stdout:Upgrade 3 Packages 2023-05-08T03:26:29.136 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-05-08T03:26:29.137 INFO:teuthology.orchestra.run.smithi133.stdout:Total download size: 197 M 2023-05-08T03:26:29.137 INFO:teuthology.orchestra.run.smithi133.stdout:Downloading Packages: 2023-05-08T03:26:29.575 INFO:teuthology.orchestra.run.smithi133.stdout:(1/131): ceph-18.0.0-3786.g4b086ba5.el8.x86_64. 47 kB/s | 6.4 kB 00:00 2023-05-08T03:26:30.049 INFO:teuthology.orchestra.run.smithi133.stdout:(2/131): ceph-base-18.0.0-3786.g4b086ba5.el8.x8 8.7 MB/s | 5.3 MB 00:00 2023-05-08T03:26:30.083 INFO:teuthology.orchestra.run.smithi133.stdout:(3/131): ceph-fuse-18.0.0-3786.g4b086ba5.el8.x8 1.6 MB/s | 848 kB 00:00 2023-05-08T03:26:30.116 INFO:teuthology.orchestra.run.smithi133.stdout:(4/131): ceph-immutable-object-cache-18.0.0-378 2.4 MB/s | 165 kB 00:00 2023-05-08T03:26:30.317 INFO:teuthology.orchestra.run.smithi133.stdout:(5/131): ceph-mgr-18.0.0-3786.g4b086ba5.el8.x86 7.7 MB/s | 1.5 MB 00:00 2023-05-08T03:26:30.394 INFO:teuthology.orchestra.run.smithi186.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 58 MB/s | 47 MB 00:00 2023-05-08T03:26:30.799 INFO:teuthology.orchestra.run.smithi096.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 45 MB/s | 47 MB 00:01 2023-05-08T03:26:30.867 INFO:teuthology.orchestra.run.smithi133.stdout:(6/131): ceph-mon-18.0.0-3786.g4b086ba5.el8.x86 8.4 MB/s | 4.6 MB 00:00 2023-05-08T03:26:31.092 INFO:teuthology.orchestra.run.smithi133.stdout:(7/131): ceph-common-18.0.0-3786.g4b086ba5.el8. 13 MB/s | 22 MB 00:01 2023-05-08T03:26:31.142 INFO:teuthology.orchestra.run.smithi133.stdout:(8/131): ceph-mds-18.0.0-3786.g4b086ba5.el8.x86 2.2 MB/s | 2.3 MB 00:01 2023-05-08T03:26:31.226 INFO:teuthology.orchestra.run.smithi133.stdout:(9/131): ceph-selinux-18.0.0-3786.g4b086ba5.el8 291 kB/s | 24 kB 00:00 2023-05-08T03:26:32.051 INFO:teuthology.orchestra.run.smithi133.stdout:(10/131): ceph-radosgw-18.0.0-3786.g4b086ba5.el 14 MB/s | 13 MB 00:00 2023-05-08T03:26:32.128 INFO:teuthology.orchestra.run.smithi133.stdout:(11/131): cephfs-mirror-18.0.0-3786.g4b086ba5.e 3.4 MB/s | 258 kB 00:00 2023-05-08T03:26:32.235 INFO:teuthology.orchestra.run.smithi133.stdout:(12/131): libcephfs-devel-18.0.0-3786.g4b086ba5 285 kB/s | 31 kB 00:00 2023-05-08T03:26:32.411 INFO:teuthology.orchestra.run.smithi133.stdout:(13/131): ceph-osd-18.0.0-3786.g4b086ba5.el8.x8 11 MB/s | 18 MB 00:01 2023-05-08T03:26:32.453 INFO:teuthology.orchestra.run.smithi133.stdout:(14/131): libcephfs2-18.0.0-3786.g4b086ba5.el8. 3.5 MB/s | 771 kB 00:00 2023-05-08T03:26:32.478 INFO:teuthology.orchestra.run.smithi133.stdout:(15/131): libcephsqlite-18.0.0-3786.g4b086ba5.e 2.0 MB/s | 137 kB 00:00 2023-05-08T03:26:32.503 INFO:teuthology.orchestra.run.smithi133.stdout:(16/131): librados-devel-18.0.0-3786.g4b086ba5. 2.7 MB/s | 139 kB 00:00 2023-05-08T03:26:32.537 INFO:teuthology.orchestra.run.smithi133.stdout:(17/131): libradosstriper1-18.0.0-3786.g4b086ba 7.9 MB/s | 473 kB 00:00 2023-05-08T03:26:32.587 INFO:teuthology.orchestra.run.smithi133.stdout:(18/131): python3-ceph-argparse-18.0.0-3786.g4b 897 kB/s | 45 kB 00:00 2023-05-08T03:26:32.673 INFO:teuthology.orchestra.run.smithi133.stdout:(19/131): python3-ceph-common-18.0.0-3786.g4b08 1.4 MB/s | 119 kB 00:00 2023-05-08T03:26:32.754 INFO:teuthology.orchestra.run.smithi133.stdout:(20/131): python3-cephfs-18.0.0-3786.g4b086ba5. 2.4 MB/s | 197 kB 00:00 2023-05-08T03:26:32.863 INFO:teuthology.orchestra.run.smithi133.stdout:(21/131): librgw2-18.0.0-3786.g4b086ba5.el8.x86 18 MB/s | 6.5 MB 00:00 2023-05-08T03:26:32.888 INFO:teuthology.orchestra.run.smithi133.stdout:(22/131): python3-rados-18.0.0-3786.g4b086ba5.e 2.7 MB/s | 371 kB 00:00 2023-05-08T03:26:32.913 INFO:teuthology.orchestra.run.smithi133.stdout:(23/131): python3-rbd-18.0.0-3786.g4b086ba5.el8 7.1 MB/s | 364 kB 00:00 2023-05-08T03:26:32.939 INFO:teuthology.orchestra.run.smithi133.stdout:(24/131): python3-rgw-18.0.0-3786.g4b086ba5.el8 2.1 MB/s | 107 kB 00:00 2023-05-08T03:26:32.956 INFO:teuthology.orchestra.run.smithi133.stdout:(25/131): rbd-fuse-18.0.0-3786.g4b086ba5.el8.x8 2.2 MB/s | 94 kB 00:00 2023-05-08T03:26:33.014 INFO:teuthology.orchestra.run.smithi133.stdout:(26/131): rbd-nbd-18.0.0-3786.g4b086ba5.el8.x86 3.0 MB/s | 179 kB 00:00 2023-05-08T03:26:33.081 INFO:teuthology.orchestra.run.smithi133.stdout:(27/131): ceph-grafana-dashboards-18.0.0-3786.g 346 kB/s | 23 kB 00:00 2023-05-08T03:26:33.165 INFO:teuthology.orchestra.run.smithi133.stdout:(28/131): rbd-mirror-18.0.0-3786.g4b086ba5.el8. 15 MB/s | 3.4 MB 00:00 2023-05-08T03:26:33.190 INFO:teuthology.orchestra.run.smithi133.stdout:(29/131): ceph-mgr-cephadm-18.0.0-3786.g4b086ba 1.1 MB/s | 127 kB 00:00 2023-05-08T03:26:33.324 INFO:teuthology.orchestra.run.smithi133.stdout:(30/131): ceph-mgr-dashboard-18.0.0-3786.g4b086 11 MB/s | 1.7 MB 00:00 2023-05-08T03:26:33.416 INFO:teuthology.orchestra.run.smithi133.stdout:(31/131): ceph-mgr-modules-core-18.0.0-3786.g4b 2.6 MB/s | 240 kB 00:00 2023-05-08T03:26:33.483 INFO:teuthology.orchestra.run.smithi133.stdout:(32/131): ceph-mgr-rook-18.0.0-3786.g4b086ba5.e 713 kB/s | 47 kB 00:00 2023-05-08T03:26:33.550 INFO:teuthology.orchestra.run.smithi133.stdout:(33/131): ceph-prometheus-alerts-18.0.0-3786.g4 218 kB/s | 15 kB 00:00 2023-05-08T03:26:33.633 INFO:teuthology.orchestra.run.smithi133.stdout:(34/131): ceph-mgr-diskprediction-local-18.0.0- 17 MB/s | 7.4 MB 00:00 2023-05-08T03:26:33.658 INFO:teuthology.orchestra.run.smithi133.stdout:(35/131): ceph-volume-18.0.0-3786.g4b086ba5.el8 2.4 MB/s | 265 kB 00:00 2023-05-08T03:26:33.684 INFO:teuthology.orchestra.run.smithi133.stdout:(36/131): cephadm-18.0.0-3786.g4b086ba5.el8.noa 1.6 MB/s | 83 kB 00:00 2023-05-08T03:26:33.709 INFO:teuthology.orchestra.run.smithi133.stdout:(37/131): cephfs-top-18.0.0-3786.g4b086ba5.el8. 359 kB/s | 18 kB 00:00 2023-05-08T03:26:37.051 INFO:teuthology.orchestra.run.smithi133.stdout:(38/131): ceph-test-18.0.0-3786.g4b086ba5.el8.x 7.0 MB/s | 41 MB 00:05 2023-05-08T03:26:41.286 INFO:teuthology.orchestra.run.smithi186.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-05-08T03:26:41.287 INFO:teuthology.orchestra.run.smithi186.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-05-08T03:26:41.301 INFO:teuthology.orchestra.run.smithi186.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-05-08T03:26:41.303 INFO:teuthology.orchestra.run.smithi186.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-05-08T03:26:41.303 INFO:teuthology.orchestra.run.smithi186.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-05-08T03:26:41.304 INFO:teuthology.orchestra.run.smithi186.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-05-08T03:26:41.306 INFO:teuthology.orchestra.run.smithi186.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-05-08T03:26:41.310 INFO:teuthology.orchestra.run.smithi186.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-05-08T03:26:41.311 INFO:teuthology.orchestra.run.smithi186.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-05-08T03:26:41.443 INFO:teuthology.orchestra.run.smithi186.stdout:Dependencies resolved. 2023-05-08T03:26:41.455 INFO:teuthology.orchestra.run.smithi186.stdout:=========================================================================================================================== 2023-05-08T03:26:41.455 INFO:teuthology.orchestra.run.smithi186.stdout: Package Arch Version Repository Size 2023-05-08T03:26:41.455 INFO:teuthology.orchestra.run.smithi186.stdout:=========================================================================================================================== 2023-05-08T03:26:41.456 INFO:teuthology.orchestra.run.smithi186.stdout:Installing: 2023-05-08T03:26:41.456 INFO:teuthology.orchestra.run.smithi186.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-05-08T03:26:41.456 INFO:teuthology.orchestra.run.smithi186.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-05-08T03:26:41.456 INFO:teuthology.orchestra.run.smithi186.stdout: ceph x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 6.4 k 2023-05-08T03:26:41.456 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-base x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 5.3 M 2023-05-08T03:26:41.456 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-fuse x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 848 k 2023-05-08T03:26:41.456 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 165 k 2023-05-08T03:26:41.457 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 1.5 M 2023-05-08T03:26:41.457 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-cephadm noarch 2:18.0.0-3786.g4b086ba5.el8 ceph-noarch 127 k 2023-05-08T03:26:41.457 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-dashboard noarch 2:18.0.0-3786.g4b086ba5.el8 ceph-noarch 1.7 M 2023-05-08T03:26:41.457 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-3786.g4b086ba5.el8 ceph-noarch 7.4 M 2023-05-08T03:26:41.457 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-rook noarch 2:18.0.0-3786.g4b086ba5.el8 ceph-noarch 47 k 2023-05-08T03:26:41.457 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-radosgw x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 13 M 2023-05-08T03:26:41.457 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-test x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 41 M 2023-05-08T03:26:41.457 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-volume noarch 2:18.0.0-3786.g4b086ba5.el8 ceph-noarch 265 k 2023-05-08T03:26:41.458 INFO:teuthology.orchestra.run.smithi186.stdout: cephadm noarch 2:18.0.0-3786.g4b086ba5.el8 ceph-noarch 83 k 2023-05-08T03:26:41.458 INFO:teuthology.orchestra.run.smithi186.stdout: cephfs-mirror x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 258 k 2023-05-08T03:26:41.458 INFO:teuthology.orchestra.run.smithi186.stdout: cephfs-top noarch 2:18.0.0-3786.g4b086ba5.el8 ceph-noarch 18 k 2023-05-08T03:26:41.458 INFO:teuthology.orchestra.run.smithi186.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-05-08T03:26:41.458 INFO:teuthology.orchestra.run.smithi186.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-05-08T03:26:41.458 INFO:teuthology.orchestra.run.smithi186.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-05-08T03:26:41.458 INFO:teuthology.orchestra.run.smithi186.stdout: libcephfs-devel x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 31 k 2023-05-08T03:26:41.458 INFO:teuthology.orchestra.run.smithi186.stdout: libcephfs2 x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 771 k 2023-05-08T03:26:41.459 INFO:teuthology.orchestra.run.smithi186.stdout: librados-devel x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 139 k 2023-05-08T03:26:41.459 INFO:teuthology.orchestra.run.smithi186.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-05-08T03:26:41.459 INFO:teuthology.orchestra.run.smithi186.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-05-08T03:26:41.459 INFO:teuthology.orchestra.run.smithi186.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-05-08T03:26:41.459 INFO:teuthology.orchestra.run.smithi186.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-05-08T03:26:41.459 INFO:teuthology.orchestra.run.smithi186.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-05-08T03:26:41.459 INFO:teuthology.orchestra.run.smithi186.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-05-08T03:26:41.460 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cephfs x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 197 k 2023-05-08T03:26:41.460 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rados x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 371 k 2023-05-08T03:26:41.460 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rbd x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 364 k 2023-05-08T03:26:41.460 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rgw x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 107 k 2023-05-08T03:26:41.460 INFO:teuthology.orchestra.run.smithi186.stdout: rbd-fuse x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 94 k 2023-05-08T03:26:41.460 INFO:teuthology.orchestra.run.smithi186.stdout: rbd-mirror x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 3.4 M 2023-05-08T03:26:41.460 INFO:teuthology.orchestra.run.smithi186.stdout: rbd-nbd x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 179 k 2023-05-08T03:26:41.460 INFO:teuthology.orchestra.run.smithi186.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-05-08T03:26:41.461 INFO:teuthology.orchestra.run.smithi186.stdout:Upgrading: 2023-05-08T03:26:41.461 INFO:teuthology.orchestra.run.smithi186.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-05-08T03:26:41.461 INFO:teuthology.orchestra.run.smithi186.stdout: librados2 x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 3.7 M 2023-05-08T03:26:41.461 INFO:teuthology.orchestra.run.smithi186.stdout: librbd1 x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 3.6 M 2023-05-08T03:26:41.461 INFO:teuthology.orchestra.run.smithi186.stdout:Installing dependencies: 2023-05-08T03:26:41.461 INFO:teuthology.orchestra.run.smithi186.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-05-08T03:26:41.461 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-common x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 22 M 2023-05-08T03:26:41.462 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-grafana-dashboards noarch 2:18.0.0-3786.g4b086ba5.el8 ceph-noarch 23 k 2023-05-08T03:26:41.462 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mds x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 2.3 M 2023-05-08T03:26:41.462 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-modules-core noarch 2:18.0.0-3786.g4b086ba5.el8 ceph-noarch 240 k 2023-05-08T03:26:41.462 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mon x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 4.6 M 2023-05-08T03:26:41.462 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-osd x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 18 M 2023-05-08T03:26:41.462 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-prometheus-alerts noarch 2:18.0.0-3786.g4b086ba5.el8 ceph-noarch 15 k 2023-05-08T03:26:41.462 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-selinux x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 24 k 2023-05-08T03:26:41.462 INFO:teuthology.orchestra.run.smithi186.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-05-08T03:26:41.463 INFO:teuthology.orchestra.run.smithi186.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-05-08T03:26:41.463 INFO:teuthology.orchestra.run.smithi186.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-05-08T03:26:41.463 INFO:teuthology.orchestra.run.smithi186.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-05-08T03:26:41.463 INFO:teuthology.orchestra.run.smithi186.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-05-08T03:26:41.463 INFO:teuthology.orchestra.run.smithi186.stdout: libcephsqlite x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 137 k 2023-05-08T03:26:41.463 INFO:teuthology.orchestra.run.smithi186.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-05-08T03:26:41.463 INFO:teuthology.orchestra.run.smithi186.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-05-08T03:26:41.463 INFO:teuthology.orchestra.run.smithi186.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-05-08T03:26:41.464 INFO:teuthology.orchestra.run.smithi186.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-05-08T03:26:41.464 INFO:teuthology.orchestra.run.smithi186.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-05-08T03:26:41.464 INFO:teuthology.orchestra.run.smithi186.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-05-08T03:26:41.464 INFO:teuthology.orchestra.run.smithi186.stdout: libradosstriper1 x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 473 k 2023-05-08T03:26:41.464 INFO:teuthology.orchestra.run.smithi186.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-05-08T03:26:41.464 INFO:teuthology.orchestra.run.smithi186.stdout: librgw2 x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 6.5 M 2023-05-08T03:26:41.464 INFO:teuthology.orchestra.run.smithi186.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-05-08T03:26:41.465 INFO:teuthology.orchestra.run.smithi186.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-05-08T03:26:41.465 INFO:teuthology.orchestra.run.smithi186.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-05-08T03:26:41.465 INFO:teuthology.orchestra.run.smithi186.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-05-08T03:26:41.465 INFO:teuthology.orchestra.run.smithi186.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-05-08T03:26:41.465 INFO:teuthology.orchestra.run.smithi186.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-05-08T03:26:41.465 INFO:teuthology.orchestra.run.smithi186.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-05-08T03:26:41.465 INFO:teuthology.orchestra.run.smithi186.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-05-08T03:26:41.465 INFO:teuthology.orchestra.run.smithi186.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-05-08T03:26:41.466 INFO:teuthology.orchestra.run.smithi186.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-05-08T03:26:41.466 INFO:teuthology.orchestra.run.smithi186.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-05-08T03:26:41.466 INFO:teuthology.orchestra.run.smithi186.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-05-08T03:26:41.466 INFO:teuthology.orchestra.run.smithi186.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-05-08T03:26:41.466 INFO:teuthology.orchestra.run.smithi186.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-05-08T03:26:41.466 INFO:teuthology.orchestra.run.smithi186.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-05-08T03:26:41.466 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-05-08T03:26:41.466 INFO:teuthology.orchestra.run.smithi186.stdout: python3-ceph-argparse x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 45 k 2023-05-08T03:26:41.467 INFO:teuthology.orchestra.run.smithi186.stdout: python3-ceph-common x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 119 k 2023-05-08T03:26:41.467 INFO:teuthology.orchestra.run.smithi186.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-05-08T03:26:41.467 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-05-08T03:26:41.467 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-05-08T03:26:41.467 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-05-08T03:26:41.467 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-05-08T03:26:41.467 INFO:teuthology.orchestra.run.smithi186.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-05-08T03:26:41.467 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-05-08T03:26:41.468 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-05-08T03:26:41.468 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-05-08T03:26:41.468 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-05-08T03:26:41.468 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-05-08T03:26:41.468 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-05-08T03:26:41.468 INFO:teuthology.orchestra.run.smithi186.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-05-08T03:26:41.468 INFO:teuthology.orchestra.run.smithi186.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-05-08T03:26:41.469 INFO:teuthology.orchestra.run.smithi186.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-05-08T03:26:41.469 INFO:teuthology.orchestra.run.smithi186.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-05-08T03:26:41.469 INFO:teuthology.orchestra.run.smithi186.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-05-08T03:26:41.469 INFO:teuthology.orchestra.run.smithi186.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-05-08T03:26:41.469 INFO:teuthology.orchestra.run.smithi186.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-05-08T03:26:41.469 INFO:teuthology.orchestra.run.smithi186.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-05-08T03:26:41.469 INFO:teuthology.orchestra.run.smithi186.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-05-08T03:26:41.469 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-05-08T03:26:41.470 INFO:teuthology.orchestra.run.smithi186.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-05-08T03:26:41.470 INFO:teuthology.orchestra.run.smithi186.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-05-08T03:26:41.470 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-05-08T03:26:41.470 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-05-08T03:26:41.470 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-05-08T03:26:41.470 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-05-08T03:26:41.470 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-05-08T03:26:41.470 INFO:teuthology.orchestra.run.smithi186.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-05-08T03:26:41.471 INFO:teuthology.orchestra.run.smithi186.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-05-08T03:26:41.471 INFO:teuthology.orchestra.run.smithi186.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-05-08T03:26:41.471 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-05-08T03:26:41.471 INFO:teuthology.orchestra.run.smithi186.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-05-08T03:26:41.471 INFO:teuthology.orchestra.run.smithi186.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-05-08T03:26:41.471 INFO:teuthology.orchestra.run.smithi186.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-05-08T03:26:41.471 INFO:teuthology.orchestra.run.smithi186.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-05-08T03:26:41.472 INFO:teuthology.orchestra.run.smithi186.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-05-08T03:26:41.472 INFO:teuthology.orchestra.run.smithi186.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2023-05-08T03:26:41.472 INFO:teuthology.orchestra.run.smithi186.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-05-08T03:26:41.472 INFO:teuthology.orchestra.run.smithi186.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-05-08T03:26:41.472 INFO:teuthology.orchestra.run.smithi186.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-05-08T03:26:41.472 INFO:teuthology.orchestra.run.smithi186.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-05-08T03:26:41.472 INFO:teuthology.orchestra.run.smithi186.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-05-08T03:26:41.472 INFO:teuthology.orchestra.run.smithi186.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-05-08T03:26:41.473 INFO:teuthology.orchestra.run.smithi186.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-05-08T03:26:41.473 INFO:teuthology.orchestra.run.smithi186.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-05-08T03:26:41.473 INFO:teuthology.orchestra.run.smithi186.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-05-08T03:26:41.473 INFO:teuthology.orchestra.run.smithi186.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-05-08T03:26:41.473 INFO:teuthology.orchestra.run.smithi186.stdout:Enabling module streams: 2023-05-08T03:26:41.473 INFO:teuthology.orchestra.run.smithi186.stdout: postgresql 10 2023-05-08T03:26:41.473 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-05-08T03:26:41.474 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction Summary 2023-05-08T03:26:41.474 INFO:teuthology.orchestra.run.smithi186.stdout:=========================================================================================================================== 2023-05-08T03:26:41.474 INFO:teuthology.orchestra.run.smithi186.stdout:Install 128 Packages 2023-05-08T03:26:41.474 INFO:teuthology.orchestra.run.smithi186.stdout:Upgrade 3 Packages 2023-05-08T03:26:41.474 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-05-08T03:26:41.475 INFO:teuthology.orchestra.run.smithi186.stdout:Total download size: 197 M 2023-05-08T03:26:41.475 INFO:teuthology.orchestra.run.smithi186.stdout:Downloading Packages: 2023-05-08T03:26:41.628 INFO:teuthology.orchestra.run.smithi186.stdout:(1/131): ceph-18.0.0-3786.g4b086ba5.el8.x86_64. 51 kB/s | 6.4 kB 00:00 2023-05-08T03:26:41.706 INFO:teuthology.orchestra.run.smithi096.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-05-08T03:26:41.707 INFO:teuthology.orchestra.run.smithi096.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-05-08T03:26:41.722 INFO:teuthology.orchestra.run.smithi096.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-05-08T03:26:41.723 INFO:teuthology.orchestra.run.smithi096.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-05-08T03:26:41.724 INFO:teuthology.orchestra.run.smithi096.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-05-08T03:26:41.726 INFO:teuthology.orchestra.run.smithi096.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-05-08T03:26:41.728 INFO:teuthology.orchestra.run.smithi096.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-05-08T03:26:41.731 INFO:teuthology.orchestra.run.smithi096.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-05-08T03:26:41.732 INFO:teuthology.orchestra.run.smithi096.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-05-08T03:26:41.863 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2023-05-08T03:26:41.870 INFO:teuthology.orchestra.run.smithi186.stdout:(2/131): ceph-fuse-18.0.0-3786.g4b086ba5.el8.x8 3.4 MB/s | 848 kB 00:00 2023-05-08T03:26:41.875 INFO:teuthology.orchestra.run.smithi096.stdout:=========================================================================================================================== 2023-05-08T03:26:41.875 INFO:teuthology.orchestra.run.smithi096.stdout: Package Arch Version Repository Size 2023-05-08T03:26:41.875 INFO:teuthology.orchestra.run.smithi096.stdout:=========================================================================================================================== 2023-05-08T03:26:41.875 INFO:teuthology.orchestra.run.smithi096.stdout:Installing: 2023-05-08T03:26:41.875 INFO:teuthology.orchestra.run.smithi096.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-05-08T03:26:41.876 INFO:teuthology.orchestra.run.smithi096.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-05-08T03:26:41.876 INFO:teuthology.orchestra.run.smithi096.stdout: ceph x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 6.4 k 2023-05-08T03:26:41.876 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-base x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 5.3 M 2023-05-08T03:26:41.876 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-fuse x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 848 k 2023-05-08T03:26:41.876 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 165 k 2023-05-08T03:26:41.876 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 1.5 M 2023-05-08T03:26:41.876 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-cephadm noarch 2:18.0.0-3786.g4b086ba5.el8 ceph-noarch 127 k 2023-05-08T03:26:41.877 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-dashboard noarch 2:18.0.0-3786.g4b086ba5.el8 ceph-noarch 1.7 M 2023-05-08T03:26:41.877 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-3786.g4b086ba5.el8 ceph-noarch 7.4 M 2023-05-08T03:26:41.877 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-rook noarch 2:18.0.0-3786.g4b086ba5.el8 ceph-noarch 47 k 2023-05-08T03:26:41.877 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-radosgw x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 13 M 2023-05-08T03:26:41.877 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-test x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 41 M 2023-05-08T03:26:41.877 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-volume noarch 2:18.0.0-3786.g4b086ba5.el8 ceph-noarch 265 k 2023-05-08T03:26:41.877 INFO:teuthology.orchestra.run.smithi096.stdout: cephadm noarch 2:18.0.0-3786.g4b086ba5.el8 ceph-noarch 83 k 2023-05-08T03:26:41.878 INFO:teuthology.orchestra.run.smithi096.stdout: cephfs-mirror x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 258 k 2023-05-08T03:26:41.878 INFO:teuthology.orchestra.run.smithi096.stdout: cephfs-top noarch 2:18.0.0-3786.g4b086ba5.el8 ceph-noarch 18 k 2023-05-08T03:26:41.878 INFO:teuthology.orchestra.run.smithi096.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-05-08T03:26:41.878 INFO:teuthology.orchestra.run.smithi096.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-05-08T03:26:41.878 INFO:teuthology.orchestra.run.smithi096.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-05-08T03:26:41.878 INFO:teuthology.orchestra.run.smithi096.stdout: libcephfs-devel x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 31 k 2023-05-08T03:26:41.878 INFO:teuthology.orchestra.run.smithi096.stdout: libcephfs2 x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 771 k 2023-05-08T03:26:41.878 INFO:teuthology.orchestra.run.smithi096.stdout: librados-devel x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 139 k 2023-05-08T03:26:41.879 INFO:teuthology.orchestra.run.smithi096.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-05-08T03:26:41.879 INFO:teuthology.orchestra.run.smithi096.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-05-08T03:26:41.879 INFO:teuthology.orchestra.run.smithi096.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-05-08T03:26:41.879 INFO:teuthology.orchestra.run.smithi096.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-05-08T03:26:41.879 INFO:teuthology.orchestra.run.smithi096.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-05-08T03:26:41.879 INFO:teuthology.orchestra.run.smithi096.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-05-08T03:26:41.879 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cephfs x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 197 k 2023-05-08T03:26:41.879 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rados x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 371 k 2023-05-08T03:26:41.880 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rbd x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 364 k 2023-05-08T03:26:41.880 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rgw x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 107 k 2023-05-08T03:26:41.880 INFO:teuthology.orchestra.run.smithi096.stdout: rbd-fuse x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 94 k 2023-05-08T03:26:41.880 INFO:teuthology.orchestra.run.smithi096.stdout: rbd-mirror x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 3.4 M 2023-05-08T03:26:41.880 INFO:teuthology.orchestra.run.smithi096.stdout: rbd-nbd x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 179 k 2023-05-08T03:26:41.880 INFO:teuthology.orchestra.run.smithi096.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-05-08T03:26:41.880 INFO:teuthology.orchestra.run.smithi096.stdout:Upgrading: 2023-05-08T03:26:41.881 INFO:teuthology.orchestra.run.smithi096.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-05-08T03:26:41.881 INFO:teuthology.orchestra.run.smithi096.stdout: librados2 x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 3.7 M 2023-05-08T03:26:41.881 INFO:teuthology.orchestra.run.smithi096.stdout: librbd1 x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 3.6 M 2023-05-08T03:26:41.881 INFO:teuthology.orchestra.run.smithi096.stdout:Installing dependencies: 2023-05-08T03:26:41.881 INFO:teuthology.orchestra.run.smithi096.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-05-08T03:26:41.881 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-common x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 22 M 2023-05-08T03:26:41.881 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-grafana-dashboards noarch 2:18.0.0-3786.g4b086ba5.el8 ceph-noarch 23 k 2023-05-08T03:26:41.881 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mds x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 2.3 M 2023-05-08T03:26:41.882 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-modules-core noarch 2:18.0.0-3786.g4b086ba5.el8 ceph-noarch 240 k 2023-05-08T03:26:41.882 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mon x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 4.6 M 2023-05-08T03:26:41.882 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-osd x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 18 M 2023-05-08T03:26:41.882 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-prometheus-alerts noarch 2:18.0.0-3786.g4b086ba5.el8 ceph-noarch 15 k 2023-05-08T03:26:41.882 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-selinux x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 24 k 2023-05-08T03:26:41.882 INFO:teuthology.orchestra.run.smithi096.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-05-08T03:26:41.882 INFO:teuthology.orchestra.run.smithi096.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-05-08T03:26:41.882 INFO:teuthology.orchestra.run.smithi096.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-05-08T03:26:41.883 INFO:teuthology.orchestra.run.smithi096.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-05-08T03:26:41.883 INFO:teuthology.orchestra.run.smithi096.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-05-08T03:26:41.883 INFO:teuthology.orchestra.run.smithi096.stdout: libcephsqlite x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 137 k 2023-05-08T03:26:41.883 INFO:teuthology.orchestra.run.smithi096.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-05-08T03:26:41.883 INFO:teuthology.orchestra.run.smithi096.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-05-08T03:26:41.883 INFO:teuthology.orchestra.run.smithi096.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-05-08T03:26:41.884 INFO:teuthology.orchestra.run.smithi096.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-05-08T03:26:41.884 INFO:teuthology.orchestra.run.smithi096.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-05-08T03:26:41.884 INFO:teuthology.orchestra.run.smithi096.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-05-08T03:26:41.884 INFO:teuthology.orchestra.run.smithi096.stdout: libradosstriper1 x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 473 k 2023-05-08T03:26:41.884 INFO:teuthology.orchestra.run.smithi096.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-05-08T03:26:41.884 INFO:teuthology.orchestra.run.smithi096.stdout: librgw2 x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 6.5 M 2023-05-08T03:26:41.884 INFO:teuthology.orchestra.run.smithi096.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-05-08T03:26:41.885 INFO:teuthology.orchestra.run.smithi096.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-05-08T03:26:41.885 INFO:teuthology.orchestra.run.smithi096.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-05-08T03:26:41.885 INFO:teuthology.orchestra.run.smithi096.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-05-08T03:26:41.885 INFO:teuthology.orchestra.run.smithi096.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-05-08T03:26:41.885 INFO:teuthology.orchestra.run.smithi096.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-05-08T03:26:41.885 INFO:teuthology.orchestra.run.smithi096.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-05-08T03:26:41.885 INFO:teuthology.orchestra.run.smithi096.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-05-08T03:26:41.886 INFO:teuthology.orchestra.run.smithi096.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-05-08T03:26:41.886 INFO:teuthology.orchestra.run.smithi096.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-05-08T03:26:41.886 INFO:teuthology.orchestra.run.smithi096.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-05-08T03:26:41.886 INFO:teuthology.orchestra.run.smithi096.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-05-08T03:26:41.886 INFO:teuthology.orchestra.run.smithi096.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-05-08T03:26:41.886 INFO:teuthology.orchestra.run.smithi096.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-05-08T03:26:41.886 INFO:teuthology.orchestra.run.smithi096.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-05-08T03:26:41.886 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-05-08T03:26:41.887 INFO:teuthology.orchestra.run.smithi096.stdout: python3-ceph-argparse x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 45 k 2023-05-08T03:26:41.887 INFO:teuthology.orchestra.run.smithi096.stdout: python3-ceph-common x86_64 2:18.0.0-3786.g4b086ba5.el8 ceph 119 k 2023-05-08T03:26:41.887 INFO:teuthology.orchestra.run.smithi096.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-05-08T03:26:41.887 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-05-08T03:26:41.887 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-05-08T03:26:41.887 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-05-08T03:26:41.887 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-05-08T03:26:41.887 INFO:teuthology.orchestra.run.smithi096.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-05-08T03:26:41.888 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-05-08T03:26:41.888 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-05-08T03:26:41.888 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-05-08T03:26:41.888 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-05-08T03:26:41.888 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-05-08T03:26:41.888 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-05-08T03:26:41.888 INFO:teuthology.orchestra.run.smithi096.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-05-08T03:26:41.889 INFO:teuthology.orchestra.run.smithi096.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-05-08T03:26:41.889 INFO:teuthology.orchestra.run.smithi096.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-05-08T03:26:41.889 INFO:teuthology.orchestra.run.smithi096.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-05-08T03:26:41.889 INFO:teuthology.orchestra.run.smithi096.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-05-08T03:26:41.889 INFO:teuthology.orchestra.run.smithi096.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-05-08T03:26:41.889 INFO:teuthology.orchestra.run.smithi096.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-05-08T03:26:41.889 INFO:teuthology.orchestra.run.smithi096.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-05-08T03:26:41.889 INFO:teuthology.orchestra.run.smithi096.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-05-08T03:26:41.890 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-05-08T03:26:41.890 INFO:teuthology.orchestra.run.smithi096.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-05-08T03:26:41.890 INFO:teuthology.orchestra.run.smithi096.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-05-08T03:26:41.890 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-05-08T03:26:41.890 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-05-08T03:26:41.890 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-05-08T03:26:41.890 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-05-08T03:26:41.891 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-05-08T03:26:41.891 INFO:teuthology.orchestra.run.smithi096.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-05-08T03:26:41.891 INFO:teuthology.orchestra.run.smithi096.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-05-08T03:26:41.891 INFO:teuthology.orchestra.run.smithi096.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-05-08T03:26:41.891 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-05-08T03:26:41.891 INFO:teuthology.orchestra.run.smithi096.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-05-08T03:26:41.891 INFO:teuthology.orchestra.run.smithi096.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-05-08T03:26:41.891 INFO:teuthology.orchestra.run.smithi096.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-05-08T03:26:41.892 INFO:teuthology.orchestra.run.smithi096.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-05-08T03:26:41.892 INFO:teuthology.orchestra.run.smithi096.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-05-08T03:26:41.892 INFO:teuthology.orchestra.run.smithi096.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2023-05-08T03:26:41.892 INFO:teuthology.orchestra.run.smithi096.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-05-08T03:26:41.892 INFO:teuthology.orchestra.run.smithi096.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-05-08T03:26:41.892 INFO:teuthology.orchestra.run.smithi096.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-05-08T03:26:41.892 INFO:teuthology.orchestra.run.smithi096.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-05-08T03:26:41.893 INFO:teuthology.orchestra.run.smithi096.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-05-08T03:26:41.893 INFO:teuthology.orchestra.run.smithi096.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-05-08T03:26:41.893 INFO:teuthology.orchestra.run.smithi096.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-05-08T03:26:41.893 INFO:teuthology.orchestra.run.smithi096.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-05-08T03:26:41.893 INFO:teuthology.orchestra.run.smithi096.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-05-08T03:26:41.893 INFO:teuthology.orchestra.run.smithi096.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-05-08T03:26:41.893 INFO:teuthology.orchestra.run.smithi096.stdout:Enabling module streams: 2023-05-08T03:26:41.893 INFO:teuthology.orchestra.run.smithi096.stdout: postgresql 10 2023-05-08T03:26:41.894 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:26:41.894 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction Summary 2023-05-08T03:26:41.894 INFO:teuthology.orchestra.run.smithi096.stdout:=========================================================================================================================== 2023-05-08T03:26:41.894 INFO:teuthology.orchestra.run.smithi096.stdout:Install 128 Packages 2023-05-08T03:26:41.894 INFO:teuthology.orchestra.run.smithi096.stdout:Upgrade 3 Packages 2023-05-08T03:26:41.894 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:26:41.895 INFO:teuthology.orchestra.run.smithi096.stdout:Total download size: 197 M 2023-05-08T03:26:41.895 INFO:teuthology.orchestra.run.smithi096.stdout:Downloading Packages: 2023-05-08T03:26:41.945 INFO:teuthology.orchestra.run.smithi186.stdout:(3/131): ceph-immutable-object-cache-18.0.0-378 2.2 MB/s | 165 kB 00:00 2023-05-08T03:26:42.154 INFO:teuthology.orchestra.run.smithi186.stdout:(4/131): ceph-base-18.0.0-3786.g4b086ba5.el8.x8 8.2 MB/s | 5.3 MB 00:00 2023-05-08T03:26:42.379 INFO:teuthology.orchestra.run.smithi186.stdout:(5/131): ceph-mds-18.0.0-3786.g4b086ba5.el8.x86 5.3 MB/s | 2.3 MB 00:00 2023-05-08T03:26:42.398 INFO:teuthology.orchestra.run.smithi096.stdout:(1/131): ceph-18.0.0-3786.g4b086ba5.el8.x86_64. 28 kB/s | 6.4 kB 00:00 2023-05-08T03:26:42.413 INFO:teuthology.orchestra.run.smithi186.stdout:(6/131): ceph-mgr-18.0.0-3786.g4b086ba5.el8.x86 6.0 MB/s | 1.5 MB 00:00 2023-05-08T03:26:43.205 INFO:teuthology.orchestra.run.smithi186.stdout:(7/131): ceph-mon-18.0.0-3786.g4b086ba5.el8.x86 5.6 MB/s | 4.6 MB 00:00 2023-05-08T03:26:43.456 INFO:teuthology.orchestra.run.smithi186.stdout:(8/131): ceph-common-18.0.0-3786.g4b086ba5.el8. 11 MB/s | 22 MB 00:01 2023-05-08T03:26:43.522 INFO:teuthology.orchestra.run.smithi186.stdout:(9/131): ceph-selinux-18.0.0-3786.g4b086ba5.el8 366 kB/s | 24 kB 00:00 2023-05-08T03:26:44.091 INFO:teuthology.orchestra.run.smithi096.stdout:(2/131): ceph-fuse-18.0.0-3786.g4b086ba5.el8.x8 501 kB/s | 848 kB 00:01 2023-05-08T03:26:44.432 INFO:teuthology.orchestra.run.smithi096.stdout:(3/131): ceph-immutable-object-cache-18.0.0-378 485 kB/s | 165 kB 00:00 2023-05-08T03:26:44.455 INFO:teuthology.orchestra.run.smithi186.stdout:(10/131): ceph-osd-18.0.0-3786.g4b086ba5.el8.x8 8.7 MB/s | 18 MB 00:02 2023-05-08T03:26:44.556 INFO:teuthology.orchestra.run.smithi186.stdout:(11/131): cephfs-mirror-18.0.0-3786.g4b086ba5.e 2.5 MB/s | 258 kB 00:00 2023-05-08T03:26:44.639 INFO:teuthology.orchestra.run.smithi186.stdout:(12/131): libcephfs-devel-18.0.0-3786.g4b086ba5 373 kB/s | 31 kB 00:00 2023-05-08T03:26:44.940 INFO:teuthology.orchestra.run.smithi186.stdout:(13/131): libcephfs2-18.0.0-3786.g4b086ba5.el8. 2.5 MB/s | 771 kB 00:00 2023-05-08T03:26:45.015 INFO:teuthology.orchestra.run.smithi186.stdout:(14/131): libcephsqlite-18.0.0-3786.g4b086ba5.e 1.8 MB/s | 137 kB 00:00 2023-05-08T03:26:45.090 INFO:teuthology.orchestra.run.smithi186.stdout:(15/131): librados-devel-18.0.0-3786.g4b086ba5. 1.8 MB/s | 139 kB 00:00 2023-05-08T03:26:45.256 INFO:teuthology.orchestra.run.smithi186.stdout:(16/131): libradosstriper1-18.0.0-3786.g4b086ba 2.8 MB/s | 473 kB 00:00 2023-05-08T03:26:45.391 INFO:teuthology.orchestra.run.smithi186.stdout:(17/131): ceph-radosgw-18.0.0-3786.g4b086ba5.el 6.0 MB/s | 13 MB 00:02 2023-05-08T03:26:45.474 INFO:teuthology.orchestra.run.smithi186.stdout:(18/131): python3-ceph-argparse-18.0.0-3786.g4b 539 kB/s | 45 kB 00:00 2023-05-08T03:26:45.559 INFO:teuthology.orchestra.run.smithi186.stdout:(19/131): python3-ceph-common-18.0.0-3786.g4b08 1.4 MB/s | 119 kB 00:00 2023-05-08T03:26:45.650 INFO:teuthology.orchestra.run.smithi186.stdout:(20/131): python3-cephfs-18.0.0-3786.g4b086ba5. 2.1 MB/s | 197 kB 00:00 2023-05-08T03:26:45.742 INFO:teuthology.orchestra.run.smithi186.stdout:(21/131): python3-rados-18.0.0-3786.g4b086ba5.e 4.0 MB/s | 371 kB 00:00 2023-05-08T03:26:45.834 INFO:teuthology.orchestra.run.smithi186.stdout:(22/131): python3-rbd-18.0.0-3786.g4b086ba5.el8 3.9 MB/s | 364 kB 00:00 2023-05-08T03:26:45.917 INFO:teuthology.orchestra.run.smithi186.stdout:(23/131): python3-rgw-18.0.0-3786.g4b086ba5.el8 1.3 MB/s | 107 kB 00:00 2023-05-08T03:26:46.009 INFO:teuthology.orchestra.run.smithi186.stdout:(24/131): rbd-fuse-18.0.0-3786.g4b086ba5.el8.x8 1.0 MB/s | 94 kB 00:00 2023-05-08T03:26:46.218 INFO:teuthology.orchestra.run.smithi186.stdout:(25/131): librgw2-18.0.0-3786.g4b086ba5.el8.x86 6.8 MB/s | 6.5 MB 00:00 2023-05-08T03:26:46.301 INFO:teuthology.orchestra.run.smithi186.stdout:(26/131): rbd-nbd-18.0.0-3786.g4b086ba5.el8.x86 2.1 MB/s | 179 kB 00:00 2023-05-08T03:26:46.376 INFO:teuthology.orchestra.run.smithi186.stdout:(27/131): ceph-grafana-dashboards-18.0.0-3786.g 308 kB/s | 23 kB 00:00 2023-05-08T03:26:46.460 INFO:teuthology.orchestra.run.smithi186.stdout:(28/131): ceph-mgr-cephadm-18.0.0-3786.g4b086ba 1.5 MB/s | 127 kB 00:00 2023-05-08T03:26:46.611 INFO:teuthology.orchestra.run.smithi186.stdout:(29/131): rbd-mirror-18.0.0-3786.g4b086ba5.el8. 5.7 MB/s | 3.4 MB 00:00 2023-05-08T03:26:46.777 INFO:teuthology.orchestra.run.smithi186.stdout:(30/131): ceph-mgr-dashboard-18.0.0-3786.g4b086 5.4 MB/s | 1.7 MB 00:00 2023-05-08T03:26:46.869 INFO:teuthology.orchestra.run.smithi186.stdout:(31/131): ceph-mgr-modules-core-18.0.0-3786.g4b 2.6 MB/s | 240 kB 00:00 2023-05-08T03:26:46.953 INFO:teuthology.orchestra.run.smithi186.stdout:(32/131): ceph-mgr-rook-18.0.0-3786.g4b086ba5.e 570 kB/s | 47 kB 00:00 2023-05-08T03:26:47.290 INFO:teuthology.orchestra.run.smithi096.stdout:(4/131): ceph-common-18.0.0-3786.g4b086ba5.el8. 4.2 MB/s | 22 MB 00:05 2023-05-08T03:26:47.328 INFO:teuthology.orchestra.run.smithi186.stdout:(33/131): ceph-test-18.0.0-3786.g4b086ba5.el8.x 11 MB/s | 41 MB 00:03 2023-05-08T03:26:47.332 INFO:teuthology.orchestra.run.smithi096.stdout:(5/131): ceph-mds-18.0.0-3786.g4b086ba5.el8.x86 806 kB/s | 2.3 MB 00:02 2023-05-08T03:26:47.353 INFO:teuthology.orchestra.run.smithi186.stdout:(34/131): ceph-prometheus-alerts-18.0.0-3786.g4 36 kB/s | 15 kB 00:00 2023-05-08T03:26:47.446 INFO:teuthology.orchestra.run.smithi186.stdout:(35/131): cephadm-18.0.0-3786.g4b086ba5.el8.noa 909 kB/s | 83 kB 00:00 2023-05-08T03:26:47.471 INFO:teuthology.orchestra.run.smithi186.stdout:(36/131): ceph-volume-18.0.0-3786.g4b086ba5.el8 1.8 MB/s | 265 kB 00:00 2023-05-08T03:26:47.496 INFO:teuthology.orchestra.run.smithi186.stdout:(37/131): cephfs-top-18.0.0-3786.g4b086ba5.el8. 358 kB/s | 18 kB 00:00 2023-05-08T03:26:47.507 INFO:teuthology.orchestra.run.smithi096.stdout:(6/131): ceph-base-18.0.0-3786.g4b086ba5.el8.x8 1.0 MB/s | 5.3 MB 00:05 2023-05-08T03:26:47.549 INFO:teuthology.orchestra.run.smithi096.stdout:(7/131): ceph-mgr-18.0.0-3786.g4b086ba5.el8.x86 6.0 MB/s | 1.5 MB 00:00 2023-05-08T03:26:47.596 INFO:teuthology.orchestra.run.smithi186.stdout:(38/131): ceph-mgr-diskprediction-local-18.0.0- 7.5 MB/s | 7.4 MB 00:00 2023-05-08T03:26:47.872 INFO:teuthology.orchestra.run.smithi186.stdout:(39/131): liboath-2.6.2-3.el8.x86_64.rpm 157 kB/s | 59 kB 00:00 2023-05-08T03:26:47.897 INFO:teuthology.orchestra.run.smithi186.stdout:(40/131): libunwind-1.3.1-3.el8.x86_64.rpm 250 kB/s | 75 kB 00:00 2023-05-08T03:26:47.972 INFO:teuthology.orchestra.run.smithi186.stdout:(41/131): gperftools-libs-2.7-9.el8.x86_64.rpm 611 kB/s | 306 kB 00:00 2023-05-08T03:26:48.181 INFO:teuthology.orchestra.run.smithi186.stdout:(42/131): python3-asyncssh-2.7.0-2.el8.noarch.r 1.5 MB/s | 476 kB 00:00 2023-05-08T03:26:48.206 INFO:teuthology.orchestra.run.smithi186.stdout:(43/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 141 kB/s | 44 kB 00:00 2023-05-08T03:26:48.231 INFO:teuthology.orchestra.run.smithi186.stdout:(44/131): python3-beautifulsoup4-4.6.3-2.el8.1. 715 kB/s | 185 kB 00:00 2023-05-08T03:26:48.290 INFO:teuthology.orchestra.run.smithi186.stdout:(45/131): python3-cachetools-3.1.1-4.el8.noarch 303 kB/s | 33 kB 00:00 2023-05-08T03:26:48.307 INFO:teuthology.orchestra.run.smithi186.stdout:(46/131): python3-certifi-2018.10.15-7.el8.noar 162 kB/s | 16 kB 00:00 2023-05-08T03:26:48.340 INFO:teuthology.orchestra.run.smithi186.stdout:(47/131): python3-cheroot-8.5.2-1.el8.noarch.rp 1.6 MB/s | 173 kB 00:00 2023-05-08T03:26:48.382 INFO:teuthology.orchestra.run.smithi186.stdout:(48/131): python3-cherrypy-18.4.0-1.el8.noarch. 4.1 MB/s | 384 kB 00:00 2023-05-08T03:26:48.407 INFO:teuthology.orchestra.run.smithi096.stdout:(8/131): ceph-radosgw-18.0.0-3786.g4b086ba5.el8 15 MB/s | 13 MB 00:00 2023-05-08T03:26:48.458 INFO:teuthology.orchestra.run.smithi096.stdout:(9/131): ceph-selinux-18.0.0-3786.g4b086ba5.el8 488 kB/s | 24 kB 00:00 2023-05-08T03:26:48.474 INFO:teuthology.orchestra.run.smithi186.stdout:(49/131): python3-google-auth-1.1.1-10.el8.noar 486 kB/s | 81 kB 00:00 2023-05-08T03:26:48.524 INFO:teuthology.orchestra.run.smithi186.stdout:(50/131): python3-jaraco-6.2-6.el8.noarch.rpm 60 kB/s | 11 kB 00:00 2023-05-08T03:26:48.541 INFO:teuthology.orchestra.run.smithi186.stdout:(51/131): python3-jaraco-functools-2.0-4.el8.no 110 kB/s | 18 kB 00:00 2023-05-08T03:26:48.650 INFO:teuthology.orchestra.run.smithi186.stdout:(52/131): python3-logutils-0.3.5-11.el8.noarch. 389 kB/s | 49 kB 00:00 2023-05-08T03:26:48.667 INFO:teuthology.orchestra.run.smithi186.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 469 kB/s | 59 kB 00:00 2023-05-08T03:26:48.758 INFO:teuthology.orchestra.run.smithi096.stdout:(10/131): ceph-mon-18.0.0-3786.g4b086ba5.el8.x8 3.2 MB/s | 4.6 MB 00:01 2023-05-08T03:26:48.759 INFO:teuthology.orchestra.run.smithi186.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 555 kB/s | 60 kB 00:00 2023-05-08T03:26:48.809 INFO:teuthology.orchestra.run.smithi186.stdout:(55/131): python3-pecan-1.3.2-9.el8.noarch.rpm 1.9 MB/s | 283 kB 00:00 2023-05-08T03:26:48.841 INFO:teuthology.orchestra.run.smithi096.stdout:(11/131): cephfs-mirror-18.0.0-3786.g4b086ba5.e 3.0 MB/s | 258 kB 00:00 2023-05-08T03:26:48.877 INFO:teuthology.orchestra.run.smithi186.stdout:(56/131): python3-kubernetes-11.0.0-6.el8.noarc 2.9 MB/s | 1.2 MB 00:00 2023-05-08T03:26:48.892 INFO:teuthology.orchestra.run.smithi096.stdout:(12/131): libcephfs-devel-18.0.0-3786.g4b086ba5 622 kB/s | 31 kB 00:00 2023-05-08T03:26:48.918 INFO:teuthology.orchestra.run.smithi186.stdout:(57/131): python3-portend-2.6-1.el8.noarch.rpm 98 kB/s | 16 kB 00:00 2023-05-08T03:26:48.935 INFO:teuthology.orchestra.run.smithi186.stdout:(58/131): python3-repoze-lru-0.7-6.el8.noarch.r 268 kB/s | 34 kB 00:00 2023-05-08T03:26:49.010 INFO:teuthology.orchestra.run.smithi186.stdout:(59/131): python3-routes-2.4.1-12.el8.noarch.rp 1.4 MB/s | 196 kB 00:00 2023-05-08T03:26:49.027 INFO:teuthology.orchestra.run.smithi186.stdout:(60/131): python3-rsa-4.8-1.el8.noarch.rpm 566 kB/s | 61 kB 00:00 2023-05-08T03:26:49.077 INFO:teuthology.orchestra.run.smithi186.stdout:(61/131): python3-simplegeneric-0.8.1-17.el8.no 132 kB/s | 19 kB 00:00 2023-05-08T03:26:49.094 INFO:teuthology.orchestra.run.smithi186.stdout:(62/131): python3-tempora-1.14.1-5.el8.noarch.r 437 kB/s | 29 kB 00:00 2023-05-08T03:26:49.117 INFO:teuthology.orchestra.run.smithi096.stdout:(13/131): libcephfs2-18.0.0-3786.g4b086ba5.el8. 3.3 MB/s | 771 kB 00:00 2023-05-08T03:26:49.136 INFO:teuthology.orchestra.run.smithi186.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 470 kB/s | 27 kB 00:00 2023-05-08T03:26:49.153 INFO:teuthology.orchestra.run.smithi186.stdout:(64/131): python3-singledispatch-3.4.0.3-18.el8 168 kB/s | 24 kB 00:00 2023-05-08T03:26:49.184 INFO:teuthology.orchestra.run.smithi096.stdout:(14/131): libcephsqlite-18.0.0-3786.g4b086ba5.e 2.0 MB/s | 137 kB 00:00 2023-05-08T03:26:49.203 INFO:teuthology.orchestra.run.smithi186.stdout:(65/131): python3-waitress-1.2.1-2.el8.1.noarch 2.2 MB/s | 241 kB 00:00 2023-05-08T03:26:49.271 INFO:teuthology.orchestra.run.smithi186.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 523 kB/s | 61 kB 00:00 2023-05-08T03:26:49.276 INFO:teuthology.orchestra.run.smithi096.stdout:(15/131): librados-devel-18.0.0-3786.g4b086ba5. 1.5 MB/s | 139 kB 00:00 2023-05-08T03:26:49.296 INFO:teuthology.orchestra.run.smithi186.stdout:(67/131): python3-webtest-2.0.33-1.el8.noarch.r 926 kB/s | 85 kB 00:00 2023-05-08T03:26:49.329 INFO:teuthology.orchestra.run.smithi186.stdout:(68/131): python3-webob-1.8.5-1.el8.1.noarch.rp 1.3 MB/s | 251 kB 00:00 2023-05-08T03:26:49.355 INFO:teuthology.orchestra.run.smithi186.stdout:(69/131): python3-zc-lockfile-2.0-2.el8.noarch. 274 kB/s | 23 kB 00:00 2023-05-08T03:26:49.380 INFO:teuthology.orchestra.run.smithi186.stdout:(70/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.4 MB/s | 70 kB 00:00 2023-05-08T03:26:49.426 INFO:teuthology.orchestra.run.smithi096.stdout:(16/131): libradosstriper1-18.0.0-3786.g4b086ba 3.1 MB/s | 473 kB 00:00 2023-05-08T03:26:49.430 INFO:teuthology.orchestra.run.smithi186.stdout:(71/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 624 kB/s | 47 kB 00:00 2023-05-08T03:26:49.456 INFO:teuthology.orchestra.run.smithi186.stdout:(72/131): libselinux-devel-2.9-5.el8.x86_64.rpm 2.8 MB/s | 200 kB 00:00 2023-05-08T03:26:49.481 INFO:teuthology.orchestra.run.smithi186.stdout:(73/131): python3-jwt-1.6.1-2.el8.noarch.rpm 851 kB/s | 43 kB 00:00 2023-05-08T03:26:49.506 INFO:teuthology.orchestra.run.smithi186.stdout:(74/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2023-05-08T03:26:49.532 INFO:teuthology.orchestra.run.smithi186.stdout:(75/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 958 kB/s | 48 kB 00:00 2023-05-08T03:26:49.557 INFO:teuthology.orchestra.run.smithi186.stdout:(76/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-05-08T03:26:49.632 INFO:teuthology.orchestra.run.smithi186.stdout:(77/131): thrift-0.13.0-2.el8.x86_64.rpm 5.2 MB/s | 1.7 MB 00:00 2023-05-08T03:26:49.658 INFO:teuthology.orchestra.run.smithi186.stdout:(78/131): python3-requests-oauthlib-1.0.0-1.el8 340 kB/s | 43 kB 00:00 2023-05-08T03:26:49.683 INFO:teuthology.orchestra.run.smithi186.stdout:(79/131): python3-pycparser-2.14-14.el8.noarch. 870 kB/s | 109 kB 00:00 2023-05-08T03:26:49.716 INFO:teuthology.orchestra.run.smithi186.stdout:(80/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 2.7 MB/s | 229 kB 00:00 2023-05-08T03:26:49.741 INFO:teuthology.orchestra.run.smithi186.stdout:(81/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 354 kB/s | 19 kB 00:00 2023-05-08T03:26:49.767 INFO:teuthology.orchestra.run.smithi186.stdout:(82/131): python3-oauthlib-2.1.0-1.el8.noarch.r 3.0 MB/s | 155 kB 00:00 2023-05-08T03:26:49.800 INFO:teuthology.orchestra.run.smithi186.stdout:(83/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 3.8 MB/s | 560 kB 00:00 2023-05-08T03:26:49.826 INFO:teuthology.orchestra.run.smithi186.stdout:(84/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 305 kB/s | 18 kB 00:00 2023-05-08T03:26:49.851 INFO:teuthology.orchestra.run.smithi186.stdout:(85/131): python3-cryptography-3.2.1-5.el8.x86_ 5.0 MB/s | 559 kB 00:00 2023-05-08T03:26:49.876 INFO:teuthology.orchestra.run.smithi186.stdout:(86/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 4.6 MB/s | 238 kB 00:00 2023-05-08T03:26:49.910 INFO:teuthology.orchestra.run.smithi186.stdout:(87/131): pcre2-devel-10.32-2.el8.x86_64.rpm 5.4 MB/s | 605 kB 00:00 2023-05-08T03:26:49.963 INFO:teuthology.orchestra.run.smithi186.stdout:(88/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 836 kB/s | 72 kB 00:00 2023-05-08T03:26:49.994 INFO:teuthology.orchestra.run.smithi186.stdout:(89/131): fuse-2.9.7-15.el8.x86_64.rpm 991 kB/s | 83 kB 00:00 2023-05-08T03:26:50.019 INFO:teuthology.orchestra.run.smithi186.stdout:(90/131): elfutils-libelf-devel-0.186-1.el8.x86 1.1 MB/s | 60 kB 00:00 2023-05-08T03:26:50.044 INFO:teuthology.orchestra.run.smithi186.stdout:(91/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 1.9 MB/s | 98 kB 00:00 2023-05-08T03:26:50.070 INFO:teuthology.orchestra.run.smithi186.stdout:(92/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2023-05-08T03:26:50.095 INFO:teuthology.orchestra.run.smithi186.stdout:(93/131): libcom_err-devel-1.45.6-4.el8.x86_64. 771 kB/s | 39 kB 00:00 2023-05-08T03:26:50.128 INFO:teuthology.orchestra.run.smithi186.stdout:(94/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 11 MB/s | 644 kB 00:00 2023-05-08T03:26:50.154 INFO:teuthology.orchestra.run.smithi186.stdout:(95/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 2.9 MB/s | 171 kB 00:00 2023-05-08T03:26:50.180 INFO:teuthology.orchestra.run.smithi186.stdout:(96/131): NetworkManager-initscripts-updown-1.3 2.7 MB/s | 138 kB 00:00 2023-05-08T03:26:50.238 INFO:teuthology.orchestra.run.smithi186.stdout:(97/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 6.0 MB/s | 2.3 MB 00:00 2023-05-08T03:26:50.263 INFO:teuthology.orchestra.run.smithi186.stdout:(98/131): python3-pyasn1-modules-0.3.7-6.el8.no 1.3 MB/s | 110 kB 00:00 2023-05-08T03:26:50.280 INFO:teuthology.orchestra.run.smithi186.stdout:(99/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.3 MB/s | 54 kB 00:00 2023-05-08T03:26:50.347 INFO:teuthology.orchestra.run.smithi186.stdout:(100/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 3.0 MB/s | 259 kB 00:00 2023-05-08T03:26:50.380 INFO:teuthology.orchestra.run.smithi186.stdout:(101/131): socat-1.7.4.1-1.el8.x86_64.rpm 3.2 MB/s | 323 kB 00:00 2023-05-08T03:26:50.406 INFO:teuthology.orchestra.run.smithi186.stdout:(102/131): python3-markupsafe-0.23-19.el8.x86_6 664 kB/s | 39 kB 00:00 2023-05-08T03:26:50.456 INFO:teuthology.orchestra.run.smithi186.stdout:(103/131): bison-3.0.4-10.el8.x86_64.rpm 8.9 MB/s | 688 kB 00:00 2023-05-08T03:26:50.490 INFO:teuthology.orchestra.run.smithi186.stdout:(104/131): python3-jinja2-2.10.1-3.el8.noarch.r 6.3 MB/s | 538 kB 00:00 2023-05-08T03:26:50.515 INFO:teuthology.orchestra.run.smithi186.stdout:(105/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.6 MB/s | 157 kB 00:00 2023-05-08T03:26:50.540 INFO:teuthology.orchestra.run.smithi186.stdout:(106/131): oniguruma-6.8.2-2.el8.x86_64.rpm 3.7 MB/s | 187 kB 00:00 2023-05-08T03:26:50.582 INFO:teuthology.orchestra.run.smithi186.stdout:(107/131): automake-1.16.1-7.el8.noarch.rpm 10 MB/s | 713 kB 00:00 2023-05-08T03:26:50.607 INFO:teuthology.orchestra.run.smithi186.stdout:(108/131): python3-jsonpatch-1.21-2.el8.noarch. 1.0 MB/s | 27 kB 00:00 2023-05-08T03:26:50.649 INFO:teuthology.orchestra.run.smithi186.stdout:(109/131): flex-2.6.1-9.el8.x86_64.rpm 7.5 MB/s | 320 kB 00:00 2023-05-08T03:26:50.693 INFO:teuthology.orchestra.run.smithi096.stdout:(17/131): librgw2-18.0.0-3786.g4b086ba5.el8.x86 5.1 MB/s | 6.5 MB 00:01 2023-05-08T03:26:50.703 INFO:teuthology.orchestra.run.smithi186.stdout:(110/131): python3-prettytable-0.7.2-14.el8.noa 820 kB/s | 44 kB 00:00 2023-05-08T03:26:50.751 INFO:teuthology.orchestra.run.smithi096.stdout:(18/131): python3-ceph-argparse-18.0.0-3786.g4b 771 kB/s | 45 kB 00:00 2023-05-08T03:26:50.800 INFO:teuthology.orchestra.run.smithi186.stdout:(111/131): python3-babel-2.5.1-7.el8.noarch.rpm 18 MB/s | 4.8 MB 00:00 2023-05-08T03:26:50.810 INFO:teuthology.orchestra.run.smithi096.stdout:(19/131): python3-ceph-common-18.0.0-3786.g4b08 2.0 MB/s | 119 kB 00:00 2023-05-08T03:26:50.842 INFO:teuthology.orchestra.run.smithi186.stdout:(112/131): python3-werkzeug-0.12.2-4.el8.noarch 11 MB/s | 457 kB 00:00 2023-05-08T03:26:50.909 INFO:teuthology.orchestra.run.smithi186.stdout:(113/131): python3-numpy-1.14.3-10.el8.x86_64.r 18 MB/s | 3.7 MB 00:00 2023-05-08T03:26:50.934 INFO:teuthology.orchestra.run.smithi186.stdout:(114/131): python3-numpy-f2py-1.14.3-10.el8.x86 2.4 MB/s | 225 kB 00:00 2023-05-08T03:26:50.959 INFO:teuthology.orchestra.run.smithi186.stdout:(115/131): uuid-1.6.2-43.el8.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2023-05-08T03:26:50.985 INFO:teuthology.orchestra.run.smithi186.stdout:(116/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 2.5 MB/s | 126 kB 00:00 2023-05-08T03:26:51.010 INFO:teuthology.orchestra.run.smithi186.stdout:(117/131): python3-jsonpointer-1.10-11.el8.noar 398 kB/s | 20 kB 00:00 2023-05-08T03:26:51.035 INFO:teuthology.orchestra.run.smithi186.stdout:(118/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 2.0 MB/s | 103 kB 00:00 2023-05-08T03:26:51.102 INFO:teuthology.orchestra.run.smithi186.stdout:(119/131): libtool-2.4.6-25.el8.x86_64.rpm 7.5 MB/s | 709 kB 00:00 2023-05-08T03:26:51.144 INFO:teuthology.orchestra.run.smithi096.stdout:(20/131): ceph-osd-18.0.0-3786.g4b086ba5.el8.x8 4.9 MB/s | 18 MB 00:03 2023-05-08T03:26:51.144 INFO:teuthology.orchestra.run.smithi186.stdout:(120/131): libpq-13.5-1.el8.x86_64.rpm 4.7 MB/s | 198 kB 00:00 2023-05-08T03:26:51.169 INFO:teuthology.orchestra.run.smithi096.stdout:(21/131): python3-cephfs-18.0.0-3786.g4b086ba5. 550 kB/s | 197 kB 00:00 2023-05-08T03:26:51.278 INFO:teuthology.orchestra.run.smithi186.stdout:(121/131): python3-scipy-1.0.0-21.module+el8.5. 12 MB/s | 14 MB 00:01 2023-05-08T03:26:51.320 INFO:teuthology.orchestra.run.smithi186.stdout:(122/131): jq-1.6-3.el8.x86_64.rpm 4.8 MB/s | 202 kB 00:00 2023-05-08T03:26:51.361 INFO:teuthology.orchestra.run.smithi186.stdout:(123/131): librdkafka-0.11.4-3.el8.x86_64.rpm 8.3 MB/s | 354 kB 00:00 2023-05-08T03:26:51.462 INFO:teuthology.orchestra.run.smithi186.stdout:(124/131): openblas-threads-0.3.15-3.el8.x86_64 11 MB/s | 4.9 MB 00:00 2023-05-08T03:26:51.545 INFO:teuthology.orchestra.run.smithi186.stdout:(125/131): openblas-0.3.15-3.el8.x86_64.rpm 12 MB/s | 4.7 MB 00:00 2023-05-08T03:26:51.552 INFO:teuthology.orchestra.run.smithi096.stdout:(22/131): ceph-test-18.0.0-3786.g4b086ba5.el8.x 13 MB/s | 41 MB 00:03 2023-05-08T03:26:51.578 INFO:teuthology.orchestra.run.smithi096.stdout:(23/131): python3-rados-18.0.0-3786.g4b086ba5.e 857 kB/s | 371 kB 00:00 2023-05-08T03:26:51.596 INFO:teuthology.orchestra.run.smithi186.stdout:(126/131): postgresql-contrib-10.21-2.module+el 5.9 MB/s | 808 kB 00:00 2023-05-08T03:26:51.603 INFO:teuthology.orchestra.run.smithi096.stdout:(24/131): python3-rgw-18.0.0-3786.g4b086ba5.el8 2.1 MB/s | 107 kB 00:00 2023-05-08T03:26:51.628 INFO:teuthology.orchestra.run.smithi096.stdout:(25/131): python3-rbd-18.0.0-3786.g4b086ba5.el8 793 kB/s | 364 kB 00:00 2023-05-08T03:26:51.646 INFO:teuthology.orchestra.run.smithi186.stdout:(127/131): postgresql-10.21-2.module+el8.6.0+15 15 MB/s | 1.5 MB 00:00 2023-05-08T03:26:51.653 INFO:teuthology.orchestra.run.smithi096.stdout:(26/131): rbd-fuse-18.0.0-3786.g4b086ba5.el8.x8 1.2 MB/s | 94 kB 00:00 2023-05-08T03:26:51.704 INFO:teuthology.orchestra.run.smithi096.stdout:(27/131): rbd-nbd-18.0.0-3786.g4b086ba5.el8.x86 2.3 MB/s | 179 kB 00:00 2023-05-08T03:26:51.729 INFO:teuthology.orchestra.run.smithi096.stdout:(28/131): ceph-grafana-dashboards-18.0.0-3786.g 307 kB/s | 23 kB 00:00 2023-05-08T03:26:51.729 INFO:teuthology.orchestra.run.smithi186.stdout:(128/131): postgresql-server-10.21-2.module+el8 14 MB/s | 5.1 MB 00:00 2023-05-08T03:26:51.754 INFO:teuthology.orchestra.run.smithi096.stdout:(29/131): ceph-mgr-cephadm-18.0.0-3786.g4b086ba 2.5 MB/s | 127 kB 00:00 2023-05-08T03:26:51.806 INFO:teuthology.orchestra.run.smithi186.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 10 MB/s | 798 kB 00:00 2023-05-08T03:26:51.938 INFO:teuthology.orchestra.run.smithi096.stdout:(30/131): rbd-mirror-18.0.0-3786.g4b086ba5.el8. 10 MB/s | 3.4 MB 00:00 2023-05-08T03:26:52.021 INFO:teuthology.orchestra.run.smithi096.stdout:(31/131): ceph-mgr-modules-core-18.0.0-3786.g4b 2.8 MB/s | 240 kB 00:00 2023-05-08T03:26:52.097 INFO:teuthology.orchestra.run.smithi096.stdout:(32/131): ceph-mgr-rook-18.0.0-3786.g4b086ba5.e 633 kB/s | 47 kB 00:00 2023-05-08T03:26:52.149 INFO:teuthology.orchestra.run.smithi096.stdout:(33/131): ceph-prometheus-alerts-18.0.0-3786.g4 279 kB/s | 15 kB 00:00 2023-05-08T03:26:52.197 INFO:teuthology.orchestra.run.smithi186.stdout:(130/131): librados2-18.0.0-3786.g4b086ba5.el8. 6.1 MB/s | 3.7 MB 00:00 2023-05-08T03:26:52.216 INFO:teuthology.orchestra.run.smithi096.stdout:(34/131): ceph-mgr-dashboard-18.0.0-3786.g4b086 3.5 MB/s | 1.7 MB 00:00 2023-05-08T03:26:52.241 INFO:teuthology.orchestra.run.smithi096.stdout:(35/131): ceph-volume-18.0.0-3786.g4b086ba5.el8 2.8 MB/s | 265 kB 00:00 2023-05-08T03:26:52.247 INFO:teuthology.orchestra.run.smithi186.stdout:(131/131): librbd1-18.0.0-3786.g4b086ba5.el8.x8 5.9 MB/s | 3.6 MB 00:00 2023-05-08T03:26:52.249 INFO:teuthology.orchestra.run.smithi186.stdout:-------------------------------------------------------------------------------- 2023-05-08T03:26:52.250 INFO:teuthology.orchestra.run.smithi186.stdout:Total 18 MB/s | 197 MB 00:10 2023-05-08T03:26:52.258 INFO:teuthology.orchestra.run.smithi096.stdout:(36/131): cephadm-18.0.0-3786.g4b086ba5.el8.noa 2.0 MB/s | 83 kB 00:00 2023-05-08T03:26:52.283 INFO:teuthology.orchestra.run.smithi096.stdout:(37/131): cephfs-top-18.0.0-3786.g4b086ba5.el8. 431 kB/s | 18 kB 00:00 2023-05-08T03:26:52.459 INFO:teuthology.orchestra.run.smithi096.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 336 kB/s | 59 kB 00:00 2023-05-08T03:26:52.509 INFO:teuthology.orchestra.run.smithi096.stdout:(39/131): gperftools-libs-2.7-9.el8.x86_64.rpm 1.2 MB/s | 306 kB 00:00 2023-05-08T03:26:52.543 INFO:teuthology.orchestra.run.smithi096.stdout:(40/131): libunwind-1.3.1-3.el8.x86_64.rpm 897 kB/s | 75 kB 00:00 2023-05-08T03:26:52.593 INFO:teuthology.orchestra.run.smithi096.stdout:(41/131): python3-asyncssh-2.7.0-2.el8.noarch.r 5.6 MB/s | 476 kB 00:00 2023-05-08T03:26:52.610 INFO:teuthology.orchestra.run.smithi096.stdout:(42/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 653 kB/s | 44 kB 00:00 2023-05-08T03:26:52.635 INFO:teuthology.orchestra.run.smithi096.stdout:(43/131): python3-beautifulsoup4-4.6.3-2.el8.1. 4.3 MB/s | 185 kB 00:00 2023-05-08T03:26:52.652 INFO:teuthology.orchestra.run.smithi096.stdout:(44/131): python3-cachetools-3.1.1-4.el8.noarch 789 kB/s | 33 kB 00:00 2023-05-08T03:26:52.677 INFO:teuthology.orchestra.run.smithi096.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 391 kB/s | 16 kB 00:00 2023-05-08T03:26:52.736 INFO:teuthology.orchestra.run.smithi096.stdout:(46/131): python3-cheroot-8.5.2-1.el8.noarch.rp 2.0 MB/s | 173 kB 00:00 2023-05-08T03:26:52.761 INFO:teuthology.orchestra.run.smithi096.stdout:(47/131): python3-cherrypy-18.4.0-1.el8.noarch. 4.5 MB/s | 384 kB 00:00 2023-05-08T03:26:52.812 INFO:teuthology.orchestra.run.smithi096.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 1.0 MB/s | 81 kB 00:00 2023-05-08T03:26:52.837 INFO:teuthology.orchestra.run.smithi096.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 147 kB/s | 11 kB 00:00 2023-05-08T03:26:52.862 INFO:teuthology.orchestra.run.smithi096.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 356 kB/s | 18 kB 00:00 2023-05-08T03:26:52.913 INFO:teuthology.orchestra.run.smithi096.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 976 kB/s | 49 kB 00:00 2023-05-08T03:26:52.946 INFO:teuthology.orchestra.run.smithi096.stdout:(52/131): python3-kubernetes-11.0.0-6.el8.noarc 11 MB/s | 1.2 MB 00:00 2023-05-08T03:26:52.971 INFO:teuthology.orchestra.run.smithi096.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 1.0 MB/s | 59 kB 00:00 2023-05-08T03:26:52.997 INFO:teuthology.orchestra.run.smithi096.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 1.2 MB/s | 60 kB 00:00 2023-05-08T03:26:53.030 INFO:teuthology.orchestra.run.smithi096.stdout:(55/131): python3-pecan-1.3.2-9.el8.noarch.rpm 4.7 MB/s | 283 kB 00:00 2023-05-08T03:26:53.056 INFO:teuthology.orchestra.run.smithi096.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 266 kB/s | 16 kB 00:00 2023-05-08T03:26:53.081 INFO:teuthology.orchestra.run.smithi096.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 671 kB/s | 34 kB 00:00 2023-05-08T03:26:53.111 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction check 2023-05-08T03:26:53.164 INFO:teuthology.orchestra.run.smithi096.stdout:(58/131): ceph-mgr-diskprediction-local-18.0.0- 5.3 MB/s | 7.4 MB 00:01 2023-05-08T03:26:53.190 INFO:teuthology.orchestra.run.smithi096.stdout:(59/131): python3-rsa-4.8-1.el8.noarch.rpm 566 kB/s | 61 kB 00:00 2023-05-08T03:26:53.215 INFO:teuthology.orchestra.run.smithi096.stdout:(60/131): python3-routes-2.4.1-12.el8.noarch.rp 1.2 MB/s | 196 kB 00:00 2023-05-08T03:26:53.232 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction check succeeded. 2023-05-08T03:26:53.232 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction test 2023-05-08T03:26:53.240 INFO:teuthology.orchestra.run.smithi096.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 478 kB/s | 24 kB 00:00 2023-05-08T03:26:53.274 INFO:teuthology.orchestra.run.smithi096.stdout:(62/131): python3-tempora-1.14.1-5.el8.noarch.r 538 kB/s | 29 kB 00:00 2023-05-08T03:26:53.299 INFO:teuthology.orchestra.run.smithi096.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 468 kB/s | 27 kB 00:00 2023-05-08T03:26:53.333 INFO:teuthology.orchestra.run.smithi096.stdout:(64/131): python3-waitress-1.2.1-2.el8.1.noarch 4.2 MB/s | 241 kB 00:00 2023-05-08T03:26:53.358 INFO:teuthology.orchestra.run.smithi096.stdout:(65/131): python3-simplegeneric-0.8.1-17.el8.no 97 kB/s | 19 kB 00:00 2023-05-08T03:26:53.384 INFO:teuthology.orchestra.run.smithi096.stdout:(66/131): python3-webob-1.8.5-1.el8.1.noarch.rp 2.9 MB/s | 251 kB 00:00 2023-05-08T03:26:53.409 INFO:teuthology.orchestra.run.smithi096.stdout:(67/131): python3-websocket-client-0.56.0-5.el8 811 kB/s | 61 kB 00:00 2023-05-08T03:26:53.434 INFO:teuthology.orchestra.run.smithi096.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 458 kB/s | 23 kB 00:00 2023-05-08T03:26:53.459 INFO:teuthology.orchestra.run.smithi096.stdout:(69/131): python3-webtest-2.0.33-1.el8.noarch.r 849 kB/s | 85 kB 00:00 2023-05-08T03:26:53.485 INFO:teuthology.orchestra.run.smithi096.stdout:(70/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.4 MB/s | 70 kB 00:00 2023-05-08T03:26:53.535 INFO:teuthology.orchestra.run.smithi096.stdout:(71/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 623 kB/s | 47 kB 00:00 2023-05-08T03:26:53.577 INFO:teuthology.orchestra.run.smithi096.stdout:(72/131): thrift-0.13.0-2.el8.x86_64.rpm 10 MB/s | 1.7 MB 00:00 2023-05-08T03:26:53.616 INFO:teuthology.orchestra.run.smithi096.stdout:(73/131): python3-jwt-1.6.1-2.el8.noarch.rpm 636 kB/s | 43 kB 00:00 2023-05-08T03:26:53.644 INFO:teuthology.orchestra.run.smithi096.stdout:(74/131): libselinux-devel-2.9-5.el8.x86_64.rpm 1.3 MB/s | 200 kB 00:00 2023-05-08T03:26:53.669 INFO:teuthology.orchestra.run.smithi096.stdout:(75/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 786 kB/s | 48 kB 00:00 2023-05-08T03:26:53.695 INFO:teuthology.orchestra.run.smithi096.stdout:(76/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-05-08T03:26:53.720 INFO:teuthology.orchestra.run.smithi096.stdout:(77/131): python3-requests-oauthlib-1.0.0-1.el8 851 kB/s | 43 kB 00:00 2023-05-08T03:26:53.773 INFO:teuthology.orchestra.run.smithi096.stdout:(78/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.1 MB/s | 220 kB 00:00 2023-05-08T03:26:53.795 INFO:teuthology.orchestra.run.smithi096.stdout:(79/131): python3-pycparser-2.14-14.el8.noarch. 1.1 MB/s | 109 kB 00:00 2023-05-08T03:26:53.829 INFO:teuthology.orchestra.run.smithi096.stdout:(80/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 2.1 MB/s | 229 kB 00:00 2023-05-08T03:26:53.846 INFO:teuthology.orchestra.run.smithi096.stdout:(81/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 372 kB/s | 19 kB 00:00 2023-05-08T03:26:53.871 INFO:teuthology.orchestra.run.smithi096.stdout:(82/131): python3-oauthlib-2.1.0-1.el8.noarch.r 3.6 MB/s | 155 kB 00:00 2023-05-08T03:26:53.905 INFO:teuthology.orchestra.run.smithi096.stdout:(83/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 4.2 MB/s | 560 kB 00:00 2023-05-08T03:26:53.921 INFO:teuthology.orchestra.run.smithi096.stdout:(84/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 358 kB/s | 18 kB 00:00 2023-05-08T03:26:53.955 INFO:teuthology.orchestra.run.smithi096.stdout:(85/131): python3-cryptography-3.2.1-5.el8.x86_ 5.0 MB/s | 559 kB 00:00 2023-05-08T03:26:53.981 INFO:teuthology.orchestra.run.smithi096.stdout:(86/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 4.0 MB/s | 238 kB 00:00 2023-05-08T03:26:54.006 INFO:teuthology.orchestra.run.smithi096.stdout:(87/131): pcre2-devel-10.32-2.el8.x86_64.rpm 5.9 MB/s | 605 kB 00:00 2023-05-08T03:26:54.031 INFO:teuthology.orchestra.run.smithi096.stdout:(88/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 1.4 MB/s | 72 kB 00:00 2023-05-08T03:26:54.056 INFO:teuthology.orchestra.run.smithi096.stdout:(89/131): fuse-2.9.7-15.el8.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2023-05-08T03:26:54.084 INFO:teuthology.orchestra.run.smithi096.stdout:(90/131): elfutils-libelf-devel-0.186-1.el8.x86 1.2 MB/s | 60 kB 00:00 2023-05-08T03:26:54.107 INFO:teuthology.orchestra.run.smithi096.stdout:(91/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 1.9 MB/s | 98 kB 00:00 2023-05-08T03:26:54.132 INFO:teuthology.orchestra.run.smithi096.stdout:(92/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2023-05-08T03:26:54.158 INFO:teuthology.orchestra.run.smithi096.stdout:(93/131): libcom_err-devel-1.45.6-4.el8.x86_64. 766 kB/s | 39 kB 00:00 2023-05-08T03:26:54.191 INFO:teuthology.orchestra.run.smithi096.stdout:(94/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 11 MB/s | 644 kB 00:00 2023-05-08T03:26:54.216 INFO:teuthology.orchestra.run.smithi096.stdout:(95/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 2.9 MB/s | 171 kB 00:00 2023-05-08T03:26:54.241 INFO:teuthology.orchestra.run.smithi096.stdout:(96/131): NetworkManager-initscripts-updown-1.3 2.7 MB/s | 138 kB 00:00 2023-05-08T03:26:54.292 INFO:teuthology.orchestra.run.smithi096.stdout:(97/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 6.9 MB/s | 2.3 MB 00:00 2023-05-08T03:26:54.312 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction test succeeded. 2023-05-08T03:26:54.315 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction 2023-05-08T03:26:54.317 INFO:teuthology.orchestra.run.smithi096.stdout:(98/131): python3-pyasn1-modules-0.3.7-6.el8.no 1.4 MB/s | 110 kB 00:00 2023-05-08T03:26:54.342 INFO:teuthology.orchestra.run.smithi096.stdout:(99/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.1 MB/s | 54 kB 00:00 2023-05-08T03:26:54.368 INFO:teuthology.orchestra.run.smithi096.stdout:(100/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 5.0 MB/s | 259 kB 00:00 2023-05-08T03:26:54.401 INFO:teuthology.orchestra.run.smithi096.stdout:(101/131): socat-1.7.4.1-1.el8.x86_64.rpm 5.4 MB/s | 323 kB 00:00 2023-05-08T03:26:54.427 INFO:teuthology.orchestra.run.smithi096.stdout:(102/131): python3-markupsafe-0.23-19.el8.x86_6 662 kB/s | 39 kB 00:00 2023-05-08T03:26:54.460 INFO:teuthology.orchestra.run.smithi096.stdout:(103/131): bison-3.0.4-10.el8.x86_64.rpm 11 MB/s | 688 kB 00:00 2023-05-08T03:26:54.494 INFO:teuthology.orchestra.run.smithi096.stdout:(104/131): python3-jinja2-2.10.1-3.el8.noarch.r 7.9 MB/s | 538 kB 00:00 2023-05-08T03:26:54.519 INFO:teuthology.orchestra.run.smithi096.stdout:(105/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.6 MB/s | 157 kB 00:00 2023-05-08T03:26:54.544 INFO:teuthology.orchestra.run.smithi096.stdout:(106/131): oniguruma-6.8.2-2.el8.x86_64.rpm 3.6 MB/s | 187 kB 00:00 2023-05-08T03:26:54.578 INFO:teuthology.orchestra.run.smithi096.stdout:(107/131): automake-1.16.1-7.el8.noarch.rpm 12 MB/s | 713 kB 00:00 2023-05-08T03:26:54.603 INFO:teuthology.orchestra.run.smithi096.stdout:(108/131): python3-jsonpatch-1.21-2.el8.noarch. 1.0 MB/s | 27 kB 00:00 2023-05-08T03:26:54.645 INFO:teuthology.orchestra.run.smithi096.stdout:(109/131): flex-2.6.1-9.el8.x86_64.rpm 7.5 MB/s | 320 kB 00:00 2023-05-08T03:26:54.670 INFO:teuthology.orchestra.run.smithi096.stdout:(110/131): python3-prettytable-0.7.2-14.el8.noa 1.7 MB/s | 44 kB 00:00 2023-05-08T03:26:54.771 INFO:teuthology.orchestra.run.smithi096.stdout:(111/131): python3-babel-2.5.1-7.el8.noarch.rpm 21 MB/s | 4.8 MB 00:00 2023-05-08T03:26:54.813 INFO:teuthology.orchestra.run.smithi096.stdout:(112/131): python3-werkzeug-0.12.2-4.el8.noarch 11 MB/s | 457 kB 00:00 2023-05-08T03:26:54.855 INFO:teuthology.orchestra.run.smithi096.stdout:(113/131): python3-numpy-f2py-1.14.3-10.el8.x86 5.3 MB/s | 225 kB 00:00 2023-05-08T03:26:54.913 INFO:teuthology.orchestra.run.smithi096.stdout:(114/131): python3-numpy-1.14.3-10.el8.x86_64.r 15 MB/s | 3.7 MB 00:00 2023-05-08T03:26:54.938 INFO:teuthology.orchestra.run.smithi096.stdout:(115/131): uuid-1.6.2-43.el8.x86_64.rpm 767 kB/s | 64 kB 00:00 2023-05-08T03:26:54.964 INFO:teuthology.orchestra.run.smithi096.stdout:(116/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 2.5 MB/s | 126 kB 00:00 2023-05-08T03:26:54.989 INFO:teuthology.orchestra.run.smithi096.stdout:(117/131): python3-jsonpointer-1.10-11.el8.noar 398 kB/s | 20 kB 00:00 2023-05-08T03:26:55.014 INFO:teuthology.orchestra.run.smithi096.stdout:(118/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 2.0 MB/s | 103 kB 00:00 2023-05-08T03:26:55.048 INFO:teuthology.orchestra.run.smithi096.stdout:(119/131): libtool-2.4.6-25.el8.x86_64.rpm 12 MB/s | 709 kB 00:00 2023-05-08T03:26:55.198 INFO:teuthology.orchestra.run.smithi096.stdout:(120/131): python3-scipy-1.0.0-21.module+el8.5. 14 MB/s | 14 MB 00:00 2023-05-08T03:26:55.224 INFO:teuthology.orchestra.run.smithi096.stdout:(121/131): libpq-13.5-1.el8.x86_64.rpm 1.1 MB/s | 198 kB 00:00 2023-05-08T03:26:55.274 INFO:teuthology.orchestra.run.smithi096.stdout:(122/131): jq-1.6-3.el8.x86_64.rpm 3.9 MB/s | 202 kB 00:00 2023-05-08T03:26:55.316 INFO:teuthology.orchestra.run.smithi096.stdout:(123/131): librdkafka-0.11.4-3.el8.x86_64.rpm 8.3 MB/s | 354 kB 00:00 2023-05-08T03:26:55.401 INFO:teuthology.orchestra.run.smithi096.stdout:(124/131): openblas-threads-0.3.15-3.el8.x86_64 13 MB/s | 4.9 MB 00:00 2023-05-08T03:26:55.475 INFO:teuthology.orchestra.run.smithi096.stdout:(125/131): openblas-0.3.15-3.el8.x86_64.rpm 17 MB/s | 4.7 MB 00:00 2023-05-08T03:26:55.509 INFO:teuthology.orchestra.run.smithi096.stdout:(126/131): postgresql-contrib-10.21-2.module+el 7.3 MB/s | 808 kB 00:00 2023-05-08T03:26:55.559 INFO:teuthology.orchestra.run.smithi096.stdout:(127/131): postgresql-10.21-2.module+el8.6.0+15 18 MB/s | 1.5 MB 00:00 2023-05-08T03:26:55.659 INFO:teuthology.orchestra.run.smithi096.stdout:(128/131): postgresql-server-10.21-2.module+el8 15 MB/s | 5.1 MB 00:00 2023-05-08T03:26:55.709 INFO:teuthology.orchestra.run.smithi096.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 16 MB/s | 798 kB 00:00 2023-05-08T03:26:56.101 INFO:teuthology.orchestra.run.smithi096.stdout:(130/131): librados2-18.0.0-3786.g4b086ba5.el8. 6.2 MB/s | 3.7 MB 00:00 2023-05-08T03:26:56.168 INFO:teuthology.orchestra.run.smithi096.stdout:(131/131): librbd1-18.0.0-3786.g4b086ba5.el8.x8 5.8 MB/s | 3.6 MB 00:00 2023-05-08T03:26:56.172 INFO:teuthology.orchestra.run.smithi096.stdout:-------------------------------------------------------------------------------- 2023-05-08T03:26:56.172 INFO:teuthology.orchestra.run.smithi096.stdout:Total 14 MB/s | 197 MB 00:14 2023-05-08T03:26:57.012 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction check 2023-05-08T03:26:57.132 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction check succeeded. 2023-05-08T03:26:57.132 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction test 2023-05-08T03:26:58.208 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction test succeeded. 2023-05-08T03:26:58.212 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction 2023-05-08T03:26:59.397 INFO:teuthology.orchestra.run.smithi186.stdout: Preparing : 1/1 2023-05-08T03:26:59.640 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-05-08T03:26:59.864 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-05-08T03:27:00.058 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-05-08T03:27:00.177 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-05-08T03:27:00.425 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-05-08T03:27:00.812 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-05-08T03:27:01.050 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : librados2-2:18.0.0-3786.g4b086ba5.el8.x86_64 5/134 2023-05-08T03:27:01.457 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: librados2-2:18.0.0-3786.g4b086ba5.el8.x86_64 5/134 2023-05-08T03:27:01.683 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : librbd1-2:18.0.0-3786.g4b086ba5.el8.x86_64 6/134 2023-05-08T03:27:01.813 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: librbd1-2:18.0.0-3786.g4b086ba5.el8.x86_64 6/134 2023-05-08T03:27:02.008 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libcephfs2-2:18.0.0-3786.g4b086ba5.el8.x86_64 7/134 2023-05-08T03:27:02.109 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: libcephfs2-2:18.0.0-3786.g4b086ba5.el8.x86_64 7/134 2023-05-08T03:27:02.271 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-rados-2:18.0.0-3786.g4b086ba5.el8.x86_64 8/134 2023-05-08T03:27:02.480 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-05-08T03:27:02.719 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-05-08T03:27:02.944 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-05-08T03:27:03.321 INFO:teuthology.orchestra.run.smithi096.stdout: Preparing : 1/1 2023-05-08T03:27:03.497 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-05-08T03:27:03.582 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-05-08T03:27:03.689 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-05-08T03:27:03.844 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-05-08T03:27:03.849 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-05-08T03:27:03.956 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-05-08T03:27:03.991 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libcephsqlite-2:18.0.0-3786.g4b086ba5.el8.x86_64 14/134 2023-05-08T03:27:04.108 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: libcephsqlite-2:18.0.0-3786.g4b086ba5.el8.x86_64 14/134 2023-05-08T03:27:04.200 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-05-08T03:27:04.299 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libradosstriper1-2:18.0.0-3786.g4b086ba5.el8.x86 15/134 2023-05-08T03:27:04.442 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: libradosstriper1-2:18.0.0-3786.g4b086ba5.el8.x86 15/134 2023-05-08T03:27:04.619 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-05-08T03:27:04.694 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-05-08T03:27:04.825 INFO:teuthology.orchestra.run.smithi096.stdout: Upgrading : librados2-2:18.0.0-3786.g4b086ba5.el8.x86_64 5/134 2023-05-08T03:27:04.872 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-05-08T03:27:05.080 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-05-08T03:27:05.207 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-05-08T03:27:05.221 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: librados2-2:18.0.0-3786.g4b086ba5.el8.x86_64 5/134 2023-05-08T03:27:05.348 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-05-08T03:27:05.382 INFO:teuthology.orchestra.run.smithi096.stdout: Upgrading : librbd1-2:18.0.0-3786.g4b086ba5.el8.x86_64 6/134 2023-05-08T03:27:05.499 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: librbd1-2:18.0.0-3786.g4b086ba5.el8.x86_64 6/134 2023-05-08T03:27:05.507 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-05-08T03:27:05.700 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libcephfs2-2:18.0.0-3786.g4b086ba5.el8.x86_64 7/134 2023-05-08T03:27:05.779 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: libcephfs2-2:18.0.0-3786.g4b086ba5.el8.x86_64 7/134 2023-05-08T03:27:05.937 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-rados-2:18.0.0-3786.g4b086ba5.el8.x86_64 8/134 2023-05-08T03:27:06.106 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-05-08T03:27:06.125 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-05-08T03:27:06.274 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-05-08T03:27:06.336 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-05-08T03:27:06.518 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-05-08T03:27:06.901 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-05-08T03:27:06.915 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-05-08T03:27:07.144 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-05-08T03:27:07.157 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-05-08T03:27:07.549 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libcephsqlite-2:18.0.0-3786.g4b086ba5.el8.x86_64 14/134 2023-05-08T03:27:07.645 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: libcephsqlite-2:18.0.0-3786.g4b086ba5.el8.x86_64 14/134 2023-05-08T03:27:07.798 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libradosstriper1-2:18.0.0-3786.g4b086ba5.el8.x86 15/134 2023-05-08T03:27:07.879 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-05-08T03:27:07.944 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: libradosstriper1-2:18.0.0-3786.g4b086ba5.el8.x86 15/134 2023-05-08T03:27:08.123 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-05-08T03:27:08.171 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-05-08T03:27:08.339 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-05-08T03:27:08.355 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-05-08T03:27:08.527 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-05-08T03:27:08.609 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-05-08T03:27:08.681 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-05-08T03:27:08.763 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-ceph-common-2:18.0.0-3786.g4b086ba5.el8. 26/134 2023-05-08T03:27:08.810 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-05-08T03:27:08.948 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-05-08T03:27:09.202 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-ceph-argparse-2:18.0.0-3786.g4b086ba5.el 27/134 2023-05-08T03:27:09.443 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-cephfs-2:18.0.0-3786.g4b086ba5.el8.x86_6 28/134 2023-05-08T03:27:09.568 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-05-08T03:27:09.682 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-05-08T03:27:09.756 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-05-08T03:27:10.350 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-05-08T03:27:10.506 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-05-08T03:27:11.202 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-05-08T03:27:11.429 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-05-08T03:27:11.463 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-05-08T03:27:11.645 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-05-08T03:27:11.874 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-05-08T03:27:12.037 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-ceph-common-2:18.0.0-3786.g4b086ba5.el8. 26/134 2023-05-08T03:27:12.159 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-ceph-argparse-2:18.0.0-3786.g4b086ba5.el 27/134 2023-05-08T03:27:12.361 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-cephfs-2:18.0.0-3786.g4b086ba5.el8.x86_6 28/134 2023-05-08T03:27:12.531 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-05-08T03:27:12.581 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-05-08T03:27:12.837 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-05-08T03:27:13.133 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-05-08T03:27:13.400 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-05-08T03:27:13.643 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-rsa-4.8-1.el8.noarch 34/134 2023-05-08T03:27:13.816 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-05-08T03:27:14.012 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-rbd-2:18.0.0-3786.g4b086ba5.el8.x86_64 36/134 2023-05-08T03:27:14.163 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : librados-devel-2:18.0.0-3786.g4b086ba5.el8.x86_6 37/134 2023-05-08T03:27:14.347 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-05-08T03:27:14.350 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-05-08T03:27:14.601 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-05-08T03:27:14.972 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-05-08T03:27:15.033 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-05-08T03:27:15.309 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-05-08T03:27:15.365 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-05-08T03:27:15.566 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-05-08T03:27:15.672 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-05-08T03:27:15.722 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-05-08T03:27:15.834 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-05-08T03:27:15.923 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-05-08T03:27:16.062 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-05-08T03:27:16.127 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-05-08T03:27:16.269 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-05-08T03:27:16.358 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-rsa-4.8-1.el8.noarch 34/134 2023-05-08T03:27:16.431 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-05-08T03:27:16.532 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-05-08T03:27:16.641 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-05-08T03:27:16.686 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-rbd-2:18.0.0-3786.g4b086ba5.el8.x86_64 36/134 2023-05-08T03:27:16.825 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-05-08T03:27:16.828 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : librados-devel-2:18.0.0-3786.g4b086ba5.el8.x86_6 37/134 2023-05-08T03:27:16.970 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-05-08T03:27:17.009 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 49/134 2023-05-08T03:27:17.142 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-05-08T03:27:17.214 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 50/134 2023-05-08T03:27:17.296 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-05-08T03:27:17.351 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-05-08T03:27:17.437 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/134 2023-05-08T03:27:17.566 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-05-08T03:27:17.767 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-05-08T03:27:17.867 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/134 2023-05-08T03:27:17.913 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-05-08T03:27:17.988 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-05-08T03:27:18.207 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/134 2023-05-08T03:27:18.225 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-05-08T03:27:18.383 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-05-08T03:27:18.459 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/134 2023-05-08T03:27:18.545 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-05-08T03:27:18.677 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/134 2023-05-08T03:27:18.730 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-05-08T03:27:18.882 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-05-08T03:27:18.927 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/134 2023-05-08T03:27:19.049 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 49/134 2023-05-08T03:27:19.225 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 50/134 2023-05-08T03:27:19.239 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/134 2023-05-08T03:27:19.406 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/134 2023-05-08T03:27:19.472 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/134 2023-05-08T03:27:19.702 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/134 2023-05-08T03:27:19.755 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/134 2023-05-08T03:27:19.987 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/134 2023-05-08T03:27:20.047 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/134 2023-05-08T03:27:20.159 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 61/134 2023-05-08T03:27:20.248 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/134 2023-05-08T03:27:20.350 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 62/134 2023-05-08T03:27:20.466 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/134 2023-05-08T03:27:20.640 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2023-05-08T03:27:20.692 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/134 2023-05-08T03:27:20.902 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2023-05-08T03:27:21.012 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/134 2023-05-08T03:27:21.177 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2023-05-08T03:27:21.212 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/134 2023-05-08T03:27:21.407 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/134 2023-05-08T03:27:21.440 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-05-08T03:27:21.596 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-05-08T03:27:21.624 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/134 2023-05-08T03:27:21.807 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 61/134 2023-05-08T03:27:21.825 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-05-08T03:27:21.964 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 62/134 2023-05-08T03:27:22.071 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-05-08T03:27:22.241 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2023-05-08T03:27:22.303 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 70/134 2023-05-08T03:27:22.475 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2023-05-08T03:27:22.476 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-05-08T03:27:22.625 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-05-08T03:27:22.707 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2023-05-08T03:27:22.858 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-05-08T03:27:22.930 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-05-08T03:27:23.069 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-05-08T03:27:23.086 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-05-08T03:27:23.264 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-05-08T03:27:23.292 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-05-08T03:27:23.458 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-05-08T03:27:23.517 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-05-08T03:27:23.619 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-05-08T03:27:23.752 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 70/134 2023-05-08T03:27:23.845 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-05-08T03:27:23.891 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-05-08T03:27:24.023 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-05-08T03:27:24.126 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-05-08T03:27:24.197 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-05-08T03:27:24.352 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-05-08T03:27:24.367 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-05-08T03:27:24.569 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-05-08T03:27:24.595 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-05-08T03:27:24.773 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-05-08T03:27:24.813 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-05-08T03:27:24.918 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-05-08T03:27:25.016 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-05-08T03:27:25.141 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-05-08T03:27:25.232 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-05-08T03:27:25.391 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-05-08T03:27:25.567 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-05-08T03:27:25.827 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-05-08T03:27:26.027 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-05-08T03:27:26.193 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-05-08T03:27:26.365 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-05-08T03:27:26.401 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-05-08T03:27:26.675 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-05-08T03:27:26.963 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-05-08T03:27:27.293 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-05-08T03:27:27.508 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-05-08T03:27:27.614 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-05-08T03:27:27.781 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-05-08T03:27:27.820 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-05-08T03:27:28.010 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-05-08T03:27:28.312 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-05-08T03:27:28.624 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-05-08T03:27:28.625 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-05-08T03:27:28.818 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-05-08T03:27:28.829 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : librgw2-2:18.0.0-3786.g4b086ba5.el8.x86_64 92/134 2023-05-08T03:27:28.907 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: librgw2-2:18.0.0-3786.g4b086ba5.el8.x86_64 92/134 2023-05-08T03:27:29.138 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-rgw-2:18.0.0-3786.g4b086ba5.el8.x86_64 93/134 2023-05-08T03:27:29.560 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-05-08T03:27:29.719 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : librgw2-2:18.0.0-3786.g4b086ba5.el8.x86_64 92/134 2023-05-08T03:27:29.777 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: librgw2-2:18.0.0-3786.g4b086ba5.el8.x86_64 92/134 2023-05-08T03:27:29.936 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-rgw-2:18.0.0-3786.g4b086ba5.el8.x86_64 93/134 2023-05-08T03:27:32.956 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-common-2:18.0.0-3786.g4b086ba5.el8.x86_64 94/134 2023-05-08T03:27:33.228 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-common-2:18.0.0-3786.g4b086ba5.el8.x86_64 94/134 2023-05-08T03:27:33.475 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-common-2:18.0.0-3786.g4b086ba5.el8.x86_64 94/134 2023-05-08T03:27:33.693 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-common-2:18.0.0-3786.g4b086ba5.el8.x86_64 94/134 2023-05-08T03:27:33.815 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-common-2:18.0.0-3786.g4b086ba5.el8.x86_64 94/134 2023-05-08T03:27:34.154 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-base-2:18.0.0-3786.g4b086ba5.el8.x86_64 95/134 2023-05-08T03:27:34.242 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-base-2:18.0.0-3786.g4b086ba5.el8.x86_64 95/134 2023-05-08T03:27:34.298 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-common-2:18.0.0-3786.g4b086ba5.el8.x86_64 94/134 2023-05-08T03:27:34.386 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-selinux-2:18.0.0-3786.g4b086ba5.el8.x86_64 96/134 2023-05-08T03:27:34.564 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-base-2:18.0.0-3786.g4b086ba5.el8.x86_64 95/134 2023-05-08T03:27:34.645 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-base-2:18.0.0-3786.g4b086ba5.el8.x86_64 95/134 2023-05-08T03:27:34.759 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-selinux-2:18.0.0-3786.g4b086ba5.el8.x86_64 96/134 2023-05-08T03:27:53.109 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-selinux-2:18.0.0-3786.g4b086ba5.el8.x86_64 96/134 2023-05-08T03:27:53.110 INFO:teuthology.orchestra.run.smithi186.stdout:skipping the directory /sys 2023-05-08T03:27:53.110 INFO:teuthology.orchestra.run.smithi186.stdout:skipping the directory /proc 2023-05-08T03:27:53.110 INFO:teuthology.orchestra.run.smithi186.stdout:skipping the directory /dev 2023-05-08T03:27:53.110 INFO:teuthology.orchestra.run.smithi186.stdout:skipping the directory /run 2023-05-08T03:27:53.110 INFO:teuthology.orchestra.run.smithi186.stdout:skipping the directory /mnt 2023-05-08T03:27:53.110 INFO:teuthology.orchestra.run.smithi186.stdout:skipping the directory /var/tmp 2023-05-08T03:27:53.110 INFO:teuthology.orchestra.run.smithi186.stdout:skipping the directory /home 2023-05-08T03:27:53.111 INFO:teuthology.orchestra.run.smithi186.stdout:skipping the directory /tmp 2023-05-08T03:27:53.111 INFO:teuthology.orchestra.run.smithi186.stdout:skipping the directory /dev 2023-05-08T03:27:53.111 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-05-08T03:27:53.492 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-volume-2:18.0.0-3786.g4b086ba5.el8.noarch 97/134 2023-05-08T03:27:53.703 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-selinux-2:18.0.0-3786.g4b086ba5.el8.x86_64 96/134 2023-05-08T03:27:53.704 INFO:teuthology.orchestra.run.smithi096.stdout:skipping the directory /sys 2023-05-08T03:27:53.704 INFO:teuthology.orchestra.run.smithi096.stdout:skipping the directory /proc 2023-05-08T03:27:53.704 INFO:teuthology.orchestra.run.smithi096.stdout:skipping the directory /dev 2023-05-08T03:27:53.704 INFO:teuthology.orchestra.run.smithi096.stdout:skipping the directory /run 2023-05-08T03:27:53.704 INFO:teuthology.orchestra.run.smithi096.stdout:skipping the directory /mnt 2023-05-08T03:27:53.705 INFO:teuthology.orchestra.run.smithi096.stdout:skipping the directory /var/tmp 2023-05-08T03:27:53.705 INFO:teuthology.orchestra.run.smithi096.stdout:skipping the directory /home 2023-05-08T03:27:53.705 INFO:teuthology.orchestra.run.smithi096.stdout:skipping the directory /tmp 2023-05-08T03:27:53.705 INFO:teuthology.orchestra.run.smithi096.stdout:skipping the directory /dev 2023-05-08T03:27:53.705 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:27:54.047 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-volume-2:18.0.0-3786.g4b086ba5.el8.noarch 97/134 2023-05-08T03:27:55.081 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-volume-2:18.0.0-3786.g4b086ba5.el8.noarch 97/134 2023-05-08T03:27:55.267 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-osd-2:18.0.0-3786.g4b086ba5.el8.x86_64 98/134 2023-05-08T03:27:55.486 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-osd-2:18.0.0-3786.g4b086ba5.el8.x86_64 98/134 2023-05-08T03:27:55.616 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-volume-2:18.0.0-3786.g4b086ba5.el8.noarch 97/134 2023-05-08T03:27:55.675 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-mds-2:18.0.0-3786.g4b086ba5.el8.x86_64 99/134 2023-05-08T03:27:55.776 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-osd-2:18.0.0-3786.g4b086ba5.el8.x86_64 98/134 2023-05-08T03:27:55.993 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-osd-2:18.0.0-3786.g4b086ba5.el8.x86_64 98/134 2023-05-08T03:27:56.129 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-mds-2:18.0.0-3786.g4b086ba5.el8.x86_64 99/134 2023-05-08T03:27:56.196 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-mds-2:18.0.0-3786.g4b086ba5.el8.x86_64 99/134 2023-05-08T03:27:56.317 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-mon-2:18.0.0-3786.g4b086ba5.el8.x86_64 100/134 2023-05-08T03:27:56.335 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-mon-2:18.0.0-3786.g4b086ba5.el8.x86_64 100/134 2023-05-08T03:27:56.649 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-mds-2:18.0.0-3786.g4b086ba5.el8.x86_64 99/134 2023-05-08T03:27:56.805 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-mon-2:18.0.0-3786.g4b086ba5.el8.x86_64 100/134 2023-05-08T03:27:56.822 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-mon-2:18.0.0-3786.g4b086ba5.el8.x86_64 100/134 2023-05-08T03:27:58.095 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: cephadm-2:18.0.0-3786.g4b086ba5.el8.noarch 101/134 2023-05-08T03:27:58.320 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : cephadm-2:18.0.0-3786.g4b086ba5.el8.noarch 101/134 2023-05-08T03:27:58.411 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: cephadm-2:18.0.0-3786.g4b086ba5.el8.noarch 101/134 2023-05-08T03:27:58.447 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-3786.g4b086ba5.e 102/134 2023-05-08T03:27:58.578 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : cephadm-2:18.0.0-3786.g4b086ba5.el8.noarch 101/134 2023-05-08T03:27:58.649 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-3786.g4b086ba5. 103/134 2023-05-08T03:27:58.685 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-3786.g4b086ba5.e 102/134 2023-05-08T03:27:58.824 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-3786.g4b086ba5.el8.noa 104/134 2023-05-08T03:27:58.876 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-3786.g4b086ba5. 103/134 2023-05-08T03:27:59.043 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-3786.g4b086ba5.el8.noa 104/134 2023-05-08T03:27:59.054 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-3786.g4b086ba5.el8.noa 104/134 2023-05-08T03:27:59.269 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-3786.g4b086ba5.el8.noa 104/134 2023-05-08T03:27:59.375 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-3786.g4b086ba5.el8.n 105/134 2023-05-08T03:27:59.508 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-3786.g4b086ba5.el8.n 105/134 2023-05-08T03:28:00.338 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-3786.g4b086ba5.el8.n 105/134 2023-05-08T03:28:00.464 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-3786.g4b086ba5.el8.n 105/134 2023-05-08T03:28:00.533 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-3786.g4b0 106/134 2023-05-08T03:28:00.604 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-3786.g4b0 106/134 2023-05-08T03:28:00.624 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-3786.g4b0 106/134 2023-05-08T03:28:00.694 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-3786.g4b0 106/134 2023-05-08T03:28:01.019 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-3786.g4b086ba5.el 107/134 2023-05-08T03:28:01.027 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-3786.g4b086ba5.el 107/134 2023-05-08T03:28:01.219 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-mgr-2:18.0.0-3786.g4b086ba5.el8.x86_64 108/134 2023-05-08T03:28:01.255 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-mgr-2:18.0.0-3786.g4b086ba5.el8.x86_64 108/134 2023-05-08T03:28:01.276 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-mgr-2:18.0.0-3786.g4b086ba5.el8.x86_64 108/134 2023-05-08T03:28:01.312 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-mgr-2:18.0.0-3786.g4b086ba5.el8.x86_64 108/134 2023-05-08T03:28:01.395 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-mgr-rook-2:18.0.0-3786.g4b086ba5.el8.noarch 109/134 2023-05-08T03:28:01.407 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-3786.g4b086ba5.el8.noarch 109/134 2023-05-08T03:28:01.466 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-mgr-rook-2:18.0.0-3786.g4b086ba5.el8.noarch 109/134 2023-05-08T03:28:01.478 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-3786.g4b086ba5.el8.noarch 109/134 2023-05-08T03:28:02.643 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-2:18.0.0-3786.g4b086ba5.el8.x86_64 110/134 2023-05-08T03:28:02.776 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-2:18.0.0-3786.g4b086ba5.el8.x86_64 110/134 2023-05-08T03:28:02.846 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-radosgw-2:18.0.0-3786.g4b086ba5.el8.x86_64 111/134 2023-05-08T03:28:02.878 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-3786.g4b086ba5.el8.x86_64 111/134 2023-05-08T03:28:02.974 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-radosgw-2:18.0.0-3786.g4b086ba5.el8.x86_64 111/134 2023-05-08T03:28:03.008 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-3786.g4b086ba5.el8.x86_64 111/134 2023-05-08T03:28:03.020 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-3786.g4b086 112/134 2023-05-08T03:28:03.062 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-3786.g4b086 112/134 2023-05-08T03:28:03.174 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-3786.g4b086 112/134 2023-05-08T03:28:03.195 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : cephfs-mirror-2:18.0.0-3786.g4b086ba5.el8.x86_64 113/134 2023-05-08T03:28:03.220 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-3786.g4b086 112/134 2023-05-08T03:28:03.416 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : cephfs-mirror-2:18.0.0-3786.g4b086ba5.el8.x86_64 113/134 2023-05-08T03:28:03.540 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-3786.g4b086ba5.el8.x86_64 113/134 2023-05-08T03:28:03.695 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : rbd-mirror-2:18.0.0-3786.g4b086ba5.el8.x86_64 114/134 2023-05-08T03:28:03.763 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-3786.g4b086ba5.el8.x86_64 113/134 2023-05-08T03:28:03.941 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : rbd-mirror-2:18.0.0-3786.g4b086ba5.el8.x86_64 114/134 2023-05-08T03:28:07.602 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: rbd-mirror-2:18.0.0-3786.g4b086ba5.el8.x86_64 114/134 2023-05-08T03:28:07.858 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: rbd-mirror-2:18.0.0-3786.g4b086ba5.el8.x86_64 114/134 2023-05-08T03:28:08.475 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-test-2:18.0.0-3786.g4b086ba5.el8.x86_64 115/134 2023-05-08T03:28:08.758 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-05-08T03:28:08.792 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-test-2:18.0.0-3786.g4b086ba5.el8.x86_64 115/134 2023-05-08T03:28:08.930 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-fuse-2:18.0.0-3786.g4b086ba5.el8.x86_64 117/134 2023-05-08T03:28:09.138 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-05-08T03:28:09.162 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-05-08T03:28:09.318 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-05-08T03:28:09.360 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-fuse-2:18.0.0-3786.g4b086ba5.el8.x86_64 117/134 2023-05-08T03:28:09.509 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-05-08T03:28:09.651 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-05-08T03:28:09.731 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-05-08T03:28:09.798 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-05-08T03:28:09.906 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libcephfs-devel-2:18.0.0-3786.g4b086ba5.el8.x86_ 121/134 2023-05-08T03:28:09.990 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-05-08T03:28:10.069 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-05-08T03:28:10.236 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-05-08T03:28:10.435 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libcephfs-devel-2:18.0.0-3786.g4b086ba5.el8.x86_ 121/134 2023-05-08T03:28:10.591 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-05-08T03:28:12.151 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-05-08T03:28:12.376 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-05-08T03:28:12.394 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-05-08T03:28:12.543 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : cephfs-top-2:18.0.0-3786.g4b086ba5.el8.noarch 124/134 2023-05-08T03:28:12.785 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-05-08T03:28:12.876 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : rbd-fuse-2:18.0.0-3786.g4b086ba5.el8.x86_64 125/134 2023-05-08T03:28:13.048 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-05-08T03:28:13.066 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-05-08T03:28:13.164 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : rbd-nbd-2:18.0.0-3786.g4b086ba5.el8.x86_64 126/134 2023-05-08T03:28:13.333 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : cephfs-top-2:18.0.0-3786.g4b086ba5.el8.noarch 124/134 2023-05-08T03:28:13.483 INFO:teuthology.orchestra.run.smithi096.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-05-08T03:28:13.572 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : rbd-fuse-2:18.0.0-3786.g4b086ba5.el8.x86_64 125/134 2023-05-08T03:28:13.667 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-05-08T03:28:13.747 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-05-08T03:28:13.871 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : rbd-nbd-2:18.0.0-3786.g4b086ba5.el8.x86_64 126/134 2023-05-08T03:28:13.934 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-05-08T03:28:13.947 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-05-08T03:28:14.084 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-05-08T03:28:14.092 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-05-08T03:28:14.228 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-05-08T03:28:14.228 INFO:teuthology.orchestra.run.smithi096.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-05-08T03:28:14.288 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-05-08T03:28:14.420 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-05-08T03:28:14.421 INFO:teuthology.orchestra.run.smithi096.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-05-08T03:28:14.464 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-05-08T03:28:14.544 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-05-08T03:28:14.714 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-05-08T03:28:14.789 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-05-08T03:28:14.802 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-05-08T03:28:14.899 INFO:teuthology.orchestra.run.smithi096.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-05-08T03:28:14.981 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-05-08T03:28:14.989 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-05-08T03:28:15.124 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-05-08T03:28:15.125 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-05-08T03:28:15.192 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-05-08T03:28:15.193 INFO:teuthology.orchestra.run.smithi096.stdout:[/usr/lib/tmpfiles.d/journal-nocow.conf:26] Failed to resolve specifier: uninitialized /etc detected, skipping 2023-05-08T03:28:15.193 INFO:teuthology.orchestra.run.smithi096.stdout:All rules containing unresolvable specifiers will be skipped. 2023-05-08T03:28:15.193 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:28:15.359 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-05-08T03:28:15.359 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-05-08T03:28:15.443 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-2:18.0.0-3786.g4b086ba5.el8.x86_64 1/134 2023-05-08T03:28:15.444 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-base-2:18.0.0-3786.g4b086ba5.el8.x86_64 2/134 2023-05-08T03:28:15.444 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-common-2:18.0.0-3786.g4b086ba5.el8.x86_64 3/134 2023-05-08T03:28:15.444 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-fuse-2:18.0.0-3786.g4b086ba5.el8.x86_64 4/134 2023-05-08T03:28:15.444 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-3786.g4b086 5/134 2023-05-08T03:28:15.444 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mds-2:18.0.0-3786.g4b086ba5.el8.x86_64 6/134 2023-05-08T03:28:15.445 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mgr-2:18.0.0-3786.g4b086ba5.el8.x86_64 7/134 2023-05-08T03:28:15.445 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mon-2:18.0.0-3786.g4b086ba5.el8.x86_64 8/134 2023-05-08T03:28:15.445 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-osd-2:18.0.0-3786.g4b086ba5.el8.x86_64 9/134 2023-05-08T03:28:15.445 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-radosgw-2:18.0.0-3786.g4b086ba5.el8.x86_64 10/134 2023-05-08T03:28:15.445 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-selinux-2:18.0.0-3786.g4b086ba5.el8.x86_64 11/134 2023-05-08T03:28:15.445 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-test-2:18.0.0-3786.g4b086ba5.el8.x86_64 12/134 2023-05-08T03:28:15.445 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : cephfs-mirror-2:18.0.0-3786.g4b086ba5.el8.x86_64 13/134 2023-05-08T03:28:15.445 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libcephfs-devel-2:18.0.0-3786.g4b086ba5.el8.x86_ 14/134 2023-05-08T03:28:15.446 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libcephfs2-2:18.0.0-3786.g4b086ba5.el8.x86_64 15/134 2023-05-08T03:28:15.446 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libcephsqlite-2:18.0.0-3786.g4b086ba5.el8.x86_64 16/134 2023-05-08T03:28:15.446 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librados-devel-2:18.0.0-3786.g4b086ba5.el8.x86_6 17/134 2023-05-08T03:28:15.446 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libradosstriper1-2:18.0.0-3786.g4b086ba5.el8.x86 18/134 2023-05-08T03:28:15.446 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librgw2-2:18.0.0-3786.g4b086ba5.el8.x86_64 19/134 2023-05-08T03:28:15.446 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-ceph-argparse-2:18.0.0-3786.g4b086ba5.el 20/134 2023-05-08T03:28:15.446 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-ceph-common-2:18.0.0-3786.g4b086ba5.el8. 21/134 2023-05-08T03:28:15.447 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-cephfs-2:18.0.0-3786.g4b086ba5.el8.x86_6 22/134 2023-05-08T03:28:15.454 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-rados-2:18.0.0-3786.g4b086ba5.el8.x86_64 23/134 2023-05-08T03:28:15.454 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-rbd-2:18.0.0-3786.g4b086ba5.el8.x86_64 24/134 2023-05-08T03:28:15.454 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-rgw-2:18.0.0-3786.g4b086ba5.el8.x86_64 25/134 2023-05-08T03:28:15.454 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : rbd-fuse-2:18.0.0-3786.g4b086ba5.el8.x86_64 26/134 2023-05-08T03:28:15.454 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : rbd-mirror-2:18.0.0-3786.g4b086ba5.el8.x86_64 27/134 2023-05-08T03:28:15.455 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : rbd-nbd-2:18.0.0-3786.g4b086ba5.el8.x86_64 28/134 2023-05-08T03:28:15.455 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-3786.g4b086ba5. 29/134 2023-05-08T03:28:15.455 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-3786.g4b086ba5.el8.noa 30/134 2023-05-08T03:28:15.455 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-3786.g4b086ba5.el8.n 31/134 2023-05-08T03:28:15.455 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-3786.g4b0 32/134 2023-05-08T03:28:15.455 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-3786.g4b086ba5.el 33/134 2023-05-08T03:28:15.455 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mgr-rook-2:18.0.0-3786.g4b086ba5.el8.noarch 34/134 2023-05-08T03:28:15.455 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-3786.g4b086ba5.e 35/134 2023-05-08T03:28:15.456 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-volume-2:18.0.0-3786.g4b086ba5.el8.noarch 36/134 2023-05-08T03:28:15.456 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : cephadm-2:18.0.0-3786.g4b086ba5.el8.noarch 37/134 2023-05-08T03:28:15.456 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : cephfs-top-2:18.0.0-3786.g4b086ba5.el8.noarch 38/134 2023-05-08T03:28:15.456 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-05-08T03:28:15.456 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-05-08T03:28:15.456 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-05-08T03:28:15.456 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-05-08T03:28:15.457 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-05-08T03:28:15.457 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-05-08T03:28:15.457 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-05-08T03:28:15.457 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-05-08T03:28:15.457 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-05-08T03:28:15.457 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-05-08T03:28:15.457 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-05-08T03:28:15.457 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-05-08T03:28:15.458 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-05-08T03:28:15.458 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-05-08T03:28:15.458 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-05-08T03:28:15.458 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-05-08T03:28:15.458 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-05-08T03:28:15.458 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-05-08T03:28:15.458 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-05-08T03:28:15.458 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-05-08T03:28:15.459 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-05-08T03:28:15.459 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 60/134 2023-05-08T03:28:15.459 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-05-08T03:28:15.459 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-05-08T03:28:15.459 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-05-08T03:28:15.459 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-05-08T03:28:15.459 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 65/134 2023-05-08T03:28:15.459 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-05-08T03:28:15.460 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-05-08T03:28:15.460 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-05-08T03:28:15.460 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-05-08T03:28:15.460 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-05-08T03:28:15.460 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-05-08T03:28:15.460 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/134 2023-05-08T03:28:15.460 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/134 2023-05-08T03:28:15.461 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/134 2023-05-08T03:28:15.461 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/134 2023-05-08T03:28:15.461 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 76/134 2023-05-08T03:28:15.461 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 77/134 2023-05-08T03:28:15.461 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/134 2023-05-08T03:28:15.461 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 79/134 2023-05-08T03:28:15.461 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/134 2023-05-08T03:28:15.461 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/134 2023-05-08T03:28:15.462 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/134 2023-05-08T03:28:15.462 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 83/134 2023-05-08T03:28:15.462 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/134 2023-05-08T03:28:15.462 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2023-05-08T03:28:15.462 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 86/134 2023-05-08T03:28:15.462 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/134 2023-05-08T03:28:15.462 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 88/134 2023-05-08T03:28:15.463 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-05-08T03:28:15.463 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-05-08T03:28:15.463 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-05-08T03:28:15.463 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-05-08T03:28:15.463 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 93/134 2023-05-08T03:28:15.463 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/134 2023-05-08T03:28:15.463 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-05-08T03:28:15.463 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-05-08T03:28:15.464 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-05-08T03:28:15.464 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-05-08T03:28:15.464 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-05-08T03:28:15.464 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-05-08T03:28:15.464 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-05-08T03:28:15.464 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-05-08T03:28:15.464 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-05-08T03:28:15.464 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-05-08T03:28:15.465 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-05-08T03:28:15.465 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-05-08T03:28:15.465 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-05-08T03:28:15.465 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-05-08T03:28:15.465 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-05-08T03:28:15.465 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-05-08T03:28:15.465 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-05-08T03:28:15.466 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-05-08T03:28:15.466 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-05-08T03:28:15.466 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-05-08T03:28:15.466 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-05-08T03:28:15.466 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-05-08T03:28:15.466 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-05-08T03:28:15.466 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-05-08T03:28:15.466 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-05-08T03:28:15.467 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-05-08T03:28:15.467 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-05-08T03:28:15.467 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-05-08T03:28:15.467 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-05-08T03:28:15.467 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-05-08T03:28:15.467 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-05-08T03:28:15.467 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-05-08T03:28:15.468 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-05-08T03:28:15.468 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-05-08T03:28:15.468 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librados2-2:18.0.0-3786.g4b086ba5.el8.x86_64 129/134 2023-05-08T03:28:15.468 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-05-08T03:28:15.468 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librbd1-2:18.0.0-3786.g4b086ba5.el8.x86_64 131/134 2023-05-08T03:28:15.468 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-05-08T03:28:15.468 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-05-08T03:28:15.628 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-05-08T03:28:15.896 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-05-08T03:28:16.197 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-05-08T03:28:16.197 INFO:teuthology.orchestra.run.smithi186.stdout:[/usr/lib/tmpfiles.d/journal-nocow.conf:26] Failed to resolve specifier: uninitialized /etc detected, skipping 2023-05-08T03:28:16.197 INFO:teuthology.orchestra.run.smithi186.stdout:All rules containing unresolvable specifiers will be skipped. 2023-05-08T03:28:16.198 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-05-08T03:28:16.427 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-2:18.0.0-3786.g4b086ba5.el8.x86_64 1/134 2023-05-08T03:28:16.428 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-base-2:18.0.0-3786.g4b086ba5.el8.x86_64 2/134 2023-05-08T03:28:16.428 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-common-2:18.0.0-3786.g4b086ba5.el8.x86_64 3/134 2023-05-08T03:28:16.428 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-fuse-2:18.0.0-3786.g4b086ba5.el8.x86_64 4/134 2023-05-08T03:28:16.428 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-3786.g4b086 5/134 2023-05-08T03:28:16.428 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-mds-2:18.0.0-3786.g4b086ba5.el8.x86_64 6/134 2023-05-08T03:28:16.428 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-mgr-2:18.0.0-3786.g4b086ba5.el8.x86_64 7/134 2023-05-08T03:28:16.429 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-mon-2:18.0.0-3786.g4b086ba5.el8.x86_64 8/134 2023-05-08T03:28:16.429 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-osd-2:18.0.0-3786.g4b086ba5.el8.x86_64 9/134 2023-05-08T03:28:16.429 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-radosgw-2:18.0.0-3786.g4b086ba5.el8.x86_64 10/134 2023-05-08T03:28:16.429 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-selinux-2:18.0.0-3786.g4b086ba5.el8.x86_64 11/134 2023-05-08T03:28:16.429 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-test-2:18.0.0-3786.g4b086ba5.el8.x86_64 12/134 2023-05-08T03:28:16.429 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : cephfs-mirror-2:18.0.0-3786.g4b086ba5.el8.x86_64 13/134 2023-05-08T03:28:16.429 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libcephfs-devel-2:18.0.0-3786.g4b086ba5.el8.x86_ 14/134 2023-05-08T03:28:16.430 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libcephfs2-2:18.0.0-3786.g4b086ba5.el8.x86_64 15/134 2023-05-08T03:28:16.430 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libcephsqlite-2:18.0.0-3786.g4b086ba5.el8.x86_64 16/134 2023-05-08T03:28:16.430 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librados-devel-2:18.0.0-3786.g4b086ba5.el8.x86_6 17/134 2023-05-08T03:28:16.430 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libradosstriper1-2:18.0.0-3786.g4b086ba5.el8.x86 18/134 2023-05-08T03:28:16.430 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librgw2-2:18.0.0-3786.g4b086ba5.el8.x86_64 19/134 2023-05-08T03:28:16.430 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-ceph-argparse-2:18.0.0-3786.g4b086ba5.el 20/134 2023-05-08T03:28:16.430 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-ceph-common-2:18.0.0-3786.g4b086ba5.el8. 21/134 2023-05-08T03:28:16.430 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-cephfs-2:18.0.0-3786.g4b086ba5.el8.x86_6 22/134 2023-05-08T03:28:16.431 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-rados-2:18.0.0-3786.g4b086ba5.el8.x86_64 23/134 2023-05-08T03:28:16.431 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-rbd-2:18.0.0-3786.g4b086ba5.el8.x86_64 24/134 2023-05-08T03:28:16.431 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-rgw-2:18.0.0-3786.g4b086ba5.el8.x86_64 25/134 2023-05-08T03:28:16.431 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : rbd-fuse-2:18.0.0-3786.g4b086ba5.el8.x86_64 26/134 2023-05-08T03:28:16.431 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : rbd-mirror-2:18.0.0-3786.g4b086ba5.el8.x86_64 27/134 2023-05-08T03:28:16.431 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : rbd-nbd-2:18.0.0-3786.g4b086ba5.el8.x86_64 28/134 2023-05-08T03:28:16.432 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-3786.g4b086ba5. 29/134 2023-05-08T03:28:16.432 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-3786.g4b086ba5.el8.noa 30/134 2023-05-08T03:28:16.432 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-3786.g4b086ba5.el8.n 31/134 2023-05-08T03:28:16.432 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-3786.g4b0 32/134 2023-05-08T03:28:16.432 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-3786.g4b086ba5.el 33/134 2023-05-08T03:28:16.432 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-mgr-rook-2:18.0.0-3786.g4b086ba5.el8.noarch 34/134 2023-05-08T03:28:16.432 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-3786.g4b086ba5.e 35/134 2023-05-08T03:28:16.433 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-volume-2:18.0.0-3786.g4b086ba5.el8.noarch 36/134 2023-05-08T03:28:16.433 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : cephadm-2:18.0.0-3786.g4b086ba5.el8.noarch 37/134 2023-05-08T03:28:16.433 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : cephfs-top-2:18.0.0-3786.g4b086ba5.el8.noarch 38/134 2023-05-08T03:28:16.433 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-05-08T03:28:16.433 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-05-08T03:28:16.433 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-05-08T03:28:16.433 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-05-08T03:28:16.433 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-05-08T03:28:16.434 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-05-08T03:28:16.434 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-05-08T03:28:16.434 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-05-08T03:28:16.434 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-05-08T03:28:16.434 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-05-08T03:28:16.434 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-05-08T03:28:16.435 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-05-08T03:28:16.435 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-05-08T03:28:16.435 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-05-08T03:28:16.435 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-05-08T03:28:16.435 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-05-08T03:28:16.435 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-05-08T03:28:16.435 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-05-08T03:28:16.436 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-05-08T03:28:16.436 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-05-08T03:28:16.436 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-05-08T03:28:16.436 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 60/134 2023-05-08T03:28:16.436 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-05-08T03:28:16.436 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-05-08T03:28:16.436 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-05-08T03:28:16.437 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-05-08T03:28:16.437 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 65/134 2023-05-08T03:28:16.437 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-05-08T03:28:16.437 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-05-08T03:28:16.437 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-05-08T03:28:16.437 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-05-08T03:28:16.437 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-05-08T03:28:16.438 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-05-08T03:28:16.438 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/134 2023-05-08T03:28:16.438 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/134 2023-05-08T03:28:16.438 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/134 2023-05-08T03:28:16.438 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/134 2023-05-08T03:28:16.438 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 76/134 2023-05-08T03:28:16.438 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 77/134 2023-05-08T03:28:16.439 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/134 2023-05-08T03:28:16.439 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 79/134 2023-05-08T03:28:16.439 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/134 2023-05-08T03:28:16.439 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/134 2023-05-08T03:28:16.439 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/134 2023-05-08T03:28:16.439 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 83/134 2023-05-08T03:28:16.439 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/134 2023-05-08T03:28:16.439 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2023-05-08T03:28:16.440 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 86/134 2023-05-08T03:28:16.440 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/134 2023-05-08T03:28:16.440 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 88/134 2023-05-08T03:28:16.440 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-05-08T03:28:16.440 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-05-08T03:28:16.440 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-05-08T03:28:16.440 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-05-08T03:28:16.440 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 93/134 2023-05-08T03:28:16.441 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/134 2023-05-08T03:28:16.441 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-05-08T03:28:16.441 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-05-08T03:28:16.441 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-05-08T03:28:16.441 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-05-08T03:28:16.441 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-05-08T03:28:16.441 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-05-08T03:28:16.442 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-05-08T03:28:16.442 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-05-08T03:28:16.442 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-05-08T03:28:16.442 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-05-08T03:28:16.442 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-05-08T03:28:16.442 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-05-08T03:28:16.442 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-05-08T03:28:16.442 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-05-08T03:28:16.443 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-05-08T03:28:16.443 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-05-08T03:28:16.443 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-05-08T03:28:16.443 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-05-08T03:28:16.443 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-05-08T03:28:16.443 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-05-08T03:28:16.443 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-05-08T03:28:16.443 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-05-08T03:28:16.444 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-05-08T03:28:16.444 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-05-08T03:28:16.444 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-05-08T03:28:16.444 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-05-08T03:28:16.444 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-05-08T03:28:16.444 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-05-08T03:28:16.444 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-05-08T03:28:16.445 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-05-08T03:28:16.445 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-05-08T03:28:16.445 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-05-08T03:28:16.445 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-05-08T03:28:16.445 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-05-08T03:28:16.445 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librados2-2:18.0.0-3786.g4b086ba5.el8.x86_64 129/134 2023-05-08T03:28:16.445 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-05-08T03:28:16.445 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librbd1-2:18.0.0-3786.g4b086ba5.el8.x86_64 131/134 2023-05-08T03:28:16.446 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-05-08T03:28:16.446 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-05-08T03:28:17.909 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-05-08T03:28:17.910 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:01:47 ago on Mon 08 May 2023 03:26:30 AM UTC. 2023-05-08T03:28:19.046 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-05-08T03:28:19.047 INFO:teuthology.orchestra.run.smithi186.stdout:Last metadata expiration check: 0:01:50 ago on Mon 08 May 2023 03:26:29 AM UTC. 2023-05-08T03:28:20.481 INFO:teuthology.orchestra.run.smithi096.stdout:Installed products updated. 2023-05-08T03:28:20.696 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:28:20.697 INFO:teuthology.orchestra.run.smithi096.stdout:Upgraded: 2023-05-08T03:28:20.697 INFO:teuthology.orchestra.run.smithi096.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-05-08T03:28:20.697 INFO:teuthology.orchestra.run.smithi096.stdout: librados2-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:28:20.697 INFO:teuthology.orchestra.run.smithi096.stdout: librbd1-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:28:20.697 INFO:teuthology.orchestra.run.smithi096.stdout:Installed: 2023-05-08T03:28:20.698 INFO:teuthology.orchestra.run.smithi096.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-05-08T03:28:20.698 INFO:teuthology.orchestra.run.smithi096.stdout: automake-1.16.1-7.el8.noarch 2023-05-08T03:28:20.698 INFO:teuthology.orchestra.run.smithi096.stdout: bison-3.0.4-10.el8.x86_64 2023-05-08T03:28:20.698 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:28:20.698 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-base-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:28:20.698 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-common-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:28:20.698 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-fuse-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:28:20.698 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-grafana-dashboards-2:18.0.0-3786.g4b086ba5.el8.noarch 2023-05-08T03:28:20.699 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-immutable-object-cache-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:28:20.699 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mds-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:28:20.699 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:28:20.699 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-cephadm-2:18.0.0-3786.g4b086ba5.el8.noarch 2023-05-08T03:28:20.699 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-dashboard-2:18.0.0-3786.g4b086ba5.el8.noarch 2023-05-08T03:28:20.699 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-diskprediction-local-2:18.0.0-3786.g4b086ba5.el8.noarch 2023-05-08T03:28:20.699 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-modules-core-2:18.0.0-3786.g4b086ba5.el8.noarch 2023-05-08T03:28:20.700 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-rook-2:18.0.0-3786.g4b086ba5.el8.noarch 2023-05-08T03:28:20.700 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mon-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:28:20.700 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-osd-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:28:20.700 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-prometheus-alerts-2:18.0.0-3786.g4b086ba5.el8.noarch 2023-05-08T03:28:20.700 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-radosgw-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:28:20.700 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-selinux-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:28:20.700 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-test-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:28:20.701 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-volume-2:18.0.0-3786.g4b086ba5.el8.noarch 2023-05-08T03:28:20.701 INFO:teuthology.orchestra.run.smithi096.stdout: cephadm-2:18.0.0-3786.g4b086ba5.el8.noarch 2023-05-08T03:28:20.701 INFO:teuthology.orchestra.run.smithi096.stdout: cephfs-mirror-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:28:20.701 INFO:teuthology.orchestra.run.smithi096.stdout: cephfs-top-2:18.0.0-3786.g4b086ba5.el8.noarch 2023-05-08T03:28:20.701 INFO:teuthology.orchestra.run.smithi096.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-05-08T03:28:20.701 INFO:teuthology.orchestra.run.smithi096.stdout: flex-2.6.1-9.el8.x86_64 2023-05-08T03:28:20.701 INFO:teuthology.orchestra.run.smithi096.stdout: fuse-2.9.7-15.el8.x86_64 2023-05-08T03:28:20.701 INFO:teuthology.orchestra.run.smithi096.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-05-08T03:28:20.702 INFO:teuthology.orchestra.run.smithi096.stdout: jq-1.6-3.el8.x86_64 2023-05-08T03:28:20.702 INFO:teuthology.orchestra.run.smithi096.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-05-08T03:28:20.702 INFO:teuthology.orchestra.run.smithi096.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-05-08T03:28:20.702 INFO:teuthology.orchestra.run.smithi096.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-05-08T03:28:20.702 INFO:teuthology.orchestra.run.smithi096.stdout: libcephfs-devel-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:28:20.702 INFO:teuthology.orchestra.run.smithi096.stdout: libcephfs2-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:28:20.702 INFO:teuthology.orchestra.run.smithi096.stdout: libcephsqlite-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:28:20.702 INFO:teuthology.orchestra.run.smithi096.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-05-08T03:28:20.703 INFO:teuthology.orchestra.run.smithi096.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-05-08T03:28:20.703 INFO:teuthology.orchestra.run.smithi096.stdout: liboath-2.6.2-3.el8.x86_64 2023-05-08T03:28:20.703 INFO:teuthology.orchestra.run.smithi096.stdout: libpq-13.5-1.el8.x86_64 2023-05-08T03:28:20.703 INFO:teuthology.orchestra.run.smithi096.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-05-08T03:28:20.703 INFO:teuthology.orchestra.run.smithi096.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-05-08T03:28:20.703 INFO:teuthology.orchestra.run.smithi096.stdout: librados-devel-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:28:20.703 INFO:teuthology.orchestra.run.smithi096.stdout: libradosstriper1-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:28:20.703 INFO:teuthology.orchestra.run.smithi096.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-05-08T03:28:20.704 INFO:teuthology.orchestra.run.smithi096.stdout: librgw2-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:28:20.704 INFO:teuthology.orchestra.run.smithi096.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-05-08T03:28:20.704 INFO:teuthology.orchestra.run.smithi096.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-05-08T03:28:20.704 INFO:teuthology.orchestra.run.smithi096.stdout: libtool-2.4.6-25.el8.x86_64 2023-05-08T03:28:20.704 INFO:teuthology.orchestra.run.smithi096.stdout: libunwind-1.3.1-3.el8.x86_64 2023-05-08T03:28:20.704 INFO:teuthology.orchestra.run.smithi096.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-05-08T03:28:20.704 INFO:teuthology.orchestra.run.smithi096.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-05-08T03:28:20.705 INFO:teuthology.orchestra.run.smithi096.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-05-08T03:28:20.705 INFO:teuthology.orchestra.run.smithi096.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-05-08T03:28:20.705 INFO:teuthology.orchestra.run.smithi096.stdout: openblas-0.3.15-3.el8.x86_64 2023-05-08T03:28:20.705 INFO:teuthology.orchestra.run.smithi096.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-05-08T03:28:20.705 INFO:teuthology.orchestra.run.smithi096.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-05-08T03:28:20.705 INFO:teuthology.orchestra.run.smithi096.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-05-08T03:28:20.705 INFO:teuthology.orchestra.run.smithi096.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-05-08T03:28:20.705 INFO:teuthology.orchestra.run.smithi096.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-05-08T03:28:20.706 INFO:teuthology.orchestra.run.smithi096.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-05-08T03:28:20.706 INFO:teuthology.orchestra.run.smithi096.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-05-08T03:28:20.706 INFO:teuthology.orchestra.run.smithi096.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-05-08T03:28:20.706 INFO:teuthology.orchestra.run.smithi096.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-05-08T03:28:20.706 INFO:teuthology.orchestra.run.smithi096.stdout: python3-babel-2.5.1-7.el8.noarch 2023-05-08T03:28:20.706 INFO:teuthology.orchestra.run.smithi096.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-05-08T03:28:20.706 INFO:teuthology.orchestra.run.smithi096.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-05-08T03:28:20.707 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-05-08T03:28:20.707 INFO:teuthology.orchestra.run.smithi096.stdout: python3-ceph-argparse-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:28:20.707 INFO:teuthology.orchestra.run.smithi096.stdout: python3-ceph-common-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:28:20.707 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cephfs-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:28:20.707 INFO:teuthology.orchestra.run.smithi096.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-05-08T03:28:20.707 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-05-08T03:28:20.707 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-05-08T03:28:20.707 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-05-08T03:28:20.708 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-05-08T03:28:20.708 INFO:teuthology.orchestra.run.smithi096.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-05-08T03:28:20.708 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco-6.2-6.el8.noarch 2023-05-08T03:28:20.708 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-05-08T03:28:20.708 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-05-08T03:28:20.708 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-05-08T03:28:20.708 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-05-08T03:28:20.708 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-05-08T03:28:20.709 INFO:teuthology.orchestra.run.smithi096.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-05-08T03:28:20.709 INFO:teuthology.orchestra.run.smithi096.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-05-08T03:28:20.709 INFO:teuthology.orchestra.run.smithi096.stdout: python3-mako-1.0.6-13.el8.noarch 2023-05-08T03:28:20.709 INFO:teuthology.orchestra.run.smithi096.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-05-08T03:28:20.709 INFO:teuthology.orchestra.run.smithi096.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-05-08T03:28:20.709 INFO:teuthology.orchestra.run.smithi096.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-05-08T03:28:20.709 INFO:teuthology.orchestra.run.smithi096.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-05-08T03:28:20.709 INFO:teuthology.orchestra.run.smithi096.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-05-08T03:28:20.710 INFO:teuthology.orchestra.run.smithi096.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-05-08T03:28:20.710 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-05-08T03:28:20.710 INFO:teuthology.orchestra.run.smithi096.stdout: python3-portend-2.6-1.el8.noarch 2023-05-08T03:28:20.710 INFO:teuthology.orchestra.run.smithi096.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-05-08T03:28:20.710 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-05-08T03:28:20.710 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-05-08T03:28:20.711 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-05-08T03:28:20.711 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pycparser-2.14-14.el8.noarch 2023-05-08T03:28:20.711 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pytz-2017.2-9.el8.noarch 2023-05-08T03:28:20.711 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rados-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:28:20.711 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rbd-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:28:20.711 INFO:teuthology.orchestra.run.smithi096.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-05-08T03:28:20.711 INFO:teuthology.orchestra.run.smithi096.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-05-08T03:28:20.711 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rgw-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:28:20.712 INFO:teuthology.orchestra.run.smithi096.stdout: python3-routes-2.4.1-12.el8.noarch 2023-05-08T03:28:20.712 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rsa-4.8-1.el8.noarch 2023-05-08T03:28:20.712 INFO:teuthology.orchestra.run.smithi096.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-05-08T03:28:20.712 INFO:teuthology.orchestra.run.smithi096.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-05-08T03:28:20.712 INFO:teuthology.orchestra.run.smithi096.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-05-08T03:28:20.712 INFO:teuthology.orchestra.run.smithi096.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-05-08T03:28:20.712 INFO:teuthology.orchestra.run.smithi096.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-05-08T03:28:20.713 INFO:teuthology.orchestra.run.smithi096.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2023-05-08T03:28:20.713 INFO:teuthology.orchestra.run.smithi096.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-05-08T03:28:20.713 INFO:teuthology.orchestra.run.smithi096.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-05-08T03:28:20.713 INFO:teuthology.orchestra.run.smithi096.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-05-08T03:28:20.713 INFO:teuthology.orchestra.run.smithi096.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-05-08T03:28:20.713 INFO:teuthology.orchestra.run.smithi096.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-05-08T03:28:20.713 INFO:teuthology.orchestra.run.smithi096.stdout: rbd-fuse-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:28:20.714 INFO:teuthology.orchestra.run.smithi096.stdout: rbd-mirror-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:28:20.714 INFO:teuthology.orchestra.run.smithi096.stdout: rbd-nbd-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:28:20.714 INFO:teuthology.orchestra.run.smithi096.stdout: socat-1.7.4.1-1.el8.x86_64 2023-05-08T03:28:20.714 INFO:teuthology.orchestra.run.smithi096.stdout: thrift-0.13.0-2.el8.x86_64 2023-05-08T03:28:20.715 INFO:teuthology.orchestra.run.smithi096.stdout: uuid-1.6.2-43.el8.x86_64 2023-05-08T03:28:20.715 INFO:teuthology.orchestra.run.smithi096.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-05-08T03:28:20.715 INFO:teuthology.orchestra.run.smithi096.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-05-08T03:28:20.715 INFO:teuthology.orchestra.run.smithi096.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-05-08T03:28:20.716 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:28:20.716 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2023-05-08T03:28:20.913 DEBUG:teuthology.parallel:result is None 2023-05-08T03:28:21.559 INFO:teuthology.orchestra.run.smithi186.stdout:Installed products updated. 2023-05-08T03:28:21.775 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-05-08T03:28:21.775 INFO:teuthology.orchestra.run.smithi186.stdout:Upgraded: 2023-05-08T03:28:21.775 INFO:teuthology.orchestra.run.smithi186.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-05-08T03:28:21.775 INFO:teuthology.orchestra.run.smithi186.stdout: librados2-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:28:21.775 INFO:teuthology.orchestra.run.smithi186.stdout: librbd1-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:28:21.775 INFO:teuthology.orchestra.run.smithi186.stdout:Installed: 2023-05-08T03:28:21.776 INFO:teuthology.orchestra.run.smithi186.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-05-08T03:28:21.776 INFO:teuthology.orchestra.run.smithi186.stdout: automake-1.16.1-7.el8.noarch 2023-05-08T03:28:21.776 INFO:teuthology.orchestra.run.smithi186.stdout: bison-3.0.4-10.el8.x86_64 2023-05-08T03:28:21.776 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:28:21.776 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-base-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:28:21.776 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-common-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:28:21.776 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-fuse-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:28:21.777 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-grafana-dashboards-2:18.0.0-3786.g4b086ba5.el8.noarch 2023-05-08T03:28:21.777 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-immutable-object-cache-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:28:21.777 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mds-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:28:21.777 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:28:21.777 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-cephadm-2:18.0.0-3786.g4b086ba5.el8.noarch 2023-05-08T03:28:21.777 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-dashboard-2:18.0.0-3786.g4b086ba5.el8.noarch 2023-05-08T03:28:21.777 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-diskprediction-local-2:18.0.0-3786.g4b086ba5.el8.noarch 2023-05-08T03:28:21.778 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-modules-core-2:18.0.0-3786.g4b086ba5.el8.noarch 2023-05-08T03:28:21.778 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-rook-2:18.0.0-3786.g4b086ba5.el8.noarch 2023-05-08T03:28:21.778 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mon-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:28:21.778 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-osd-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:28:21.778 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-prometheus-alerts-2:18.0.0-3786.g4b086ba5.el8.noarch 2023-05-08T03:28:21.779 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-radosgw-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:28:21.779 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-selinux-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:28:21.779 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-test-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:28:21.779 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-volume-2:18.0.0-3786.g4b086ba5.el8.noarch 2023-05-08T03:28:21.779 INFO:teuthology.orchestra.run.smithi186.stdout: cephadm-2:18.0.0-3786.g4b086ba5.el8.noarch 2023-05-08T03:28:21.779 INFO:teuthology.orchestra.run.smithi186.stdout: cephfs-mirror-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:28:21.779 INFO:teuthology.orchestra.run.smithi186.stdout: cephfs-top-2:18.0.0-3786.g4b086ba5.el8.noarch 2023-05-08T03:28:21.779 INFO:teuthology.orchestra.run.smithi186.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-05-08T03:28:21.780 INFO:teuthology.orchestra.run.smithi186.stdout: flex-2.6.1-9.el8.x86_64 2023-05-08T03:28:21.780 INFO:teuthology.orchestra.run.smithi186.stdout: fuse-2.9.7-15.el8.x86_64 2023-05-08T03:28:21.780 INFO:teuthology.orchestra.run.smithi186.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-05-08T03:28:21.780 INFO:teuthology.orchestra.run.smithi186.stdout: jq-1.6-3.el8.x86_64 2023-05-08T03:28:21.780 INFO:teuthology.orchestra.run.smithi186.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-05-08T03:28:21.780 INFO:teuthology.orchestra.run.smithi186.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-05-08T03:28:21.780 INFO:teuthology.orchestra.run.smithi186.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-05-08T03:28:21.780 INFO:teuthology.orchestra.run.smithi186.stdout: libcephfs-devel-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:28:21.781 INFO:teuthology.orchestra.run.smithi186.stdout: libcephfs2-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:28:21.781 INFO:teuthology.orchestra.run.smithi186.stdout: libcephsqlite-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:28:21.781 INFO:teuthology.orchestra.run.smithi186.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-05-08T03:28:21.781 INFO:teuthology.orchestra.run.smithi186.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-05-08T03:28:21.781 INFO:teuthology.orchestra.run.smithi186.stdout: liboath-2.6.2-3.el8.x86_64 2023-05-08T03:28:21.781 INFO:teuthology.orchestra.run.smithi186.stdout: libpq-13.5-1.el8.x86_64 2023-05-08T03:28:21.781 INFO:teuthology.orchestra.run.smithi186.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-05-08T03:28:21.781 INFO:teuthology.orchestra.run.smithi186.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-05-08T03:28:21.782 INFO:teuthology.orchestra.run.smithi186.stdout: librados-devel-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:28:21.782 INFO:teuthology.orchestra.run.smithi186.stdout: libradosstriper1-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:28:21.782 INFO:teuthology.orchestra.run.smithi186.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-05-08T03:28:21.782 INFO:teuthology.orchestra.run.smithi186.stdout: librgw2-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:28:21.782 INFO:teuthology.orchestra.run.smithi186.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-05-08T03:28:21.782 INFO:teuthology.orchestra.run.smithi186.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-05-08T03:28:21.782 INFO:teuthology.orchestra.run.smithi186.stdout: libtool-2.4.6-25.el8.x86_64 2023-05-08T03:28:21.783 INFO:teuthology.orchestra.run.smithi186.stdout: libunwind-1.3.1-3.el8.x86_64 2023-05-08T03:28:21.783 INFO:teuthology.orchestra.run.smithi186.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-05-08T03:28:21.783 INFO:teuthology.orchestra.run.smithi186.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-05-08T03:28:21.783 INFO:teuthology.orchestra.run.smithi186.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-05-08T03:28:21.783 INFO:teuthology.orchestra.run.smithi186.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-05-08T03:28:21.783 INFO:teuthology.orchestra.run.smithi186.stdout: openblas-0.3.15-3.el8.x86_64 2023-05-08T03:28:21.783 INFO:teuthology.orchestra.run.smithi186.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-05-08T03:28:21.783 INFO:teuthology.orchestra.run.smithi186.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-05-08T03:28:21.784 INFO:teuthology.orchestra.run.smithi186.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-05-08T03:28:21.784 INFO:teuthology.orchestra.run.smithi186.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-05-08T03:28:21.784 INFO:teuthology.orchestra.run.smithi186.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-05-08T03:28:21.784 INFO:teuthology.orchestra.run.smithi186.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-05-08T03:28:21.784 INFO:teuthology.orchestra.run.smithi186.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-05-08T03:28:21.784 INFO:teuthology.orchestra.run.smithi186.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-05-08T03:28:21.784 INFO:teuthology.orchestra.run.smithi186.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-05-08T03:28:21.784 INFO:teuthology.orchestra.run.smithi186.stdout: python3-babel-2.5.1-7.el8.noarch 2023-05-08T03:28:21.785 INFO:teuthology.orchestra.run.smithi186.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-05-08T03:28:21.785 INFO:teuthology.orchestra.run.smithi186.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-05-08T03:28:21.785 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-05-08T03:28:21.785 INFO:teuthology.orchestra.run.smithi186.stdout: python3-ceph-argparse-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:28:21.785 INFO:teuthology.orchestra.run.smithi186.stdout: python3-ceph-common-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:28:21.785 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cephfs-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:28:21.785 INFO:teuthology.orchestra.run.smithi186.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-05-08T03:28:21.785 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-05-08T03:28:21.786 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-05-08T03:28:21.786 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-05-08T03:28:21.786 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-05-08T03:28:21.786 INFO:teuthology.orchestra.run.smithi186.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-05-08T03:28:21.786 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco-6.2-6.el8.noarch 2023-05-08T03:28:21.786 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-05-08T03:28:21.786 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-05-08T03:28:21.786 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-05-08T03:28:21.787 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-05-08T03:28:21.787 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-05-08T03:28:21.787 INFO:teuthology.orchestra.run.smithi186.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-05-08T03:28:21.787 INFO:teuthology.orchestra.run.smithi186.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-05-08T03:28:21.787 INFO:teuthology.orchestra.run.smithi186.stdout: python3-mako-1.0.6-13.el8.noarch 2023-05-08T03:28:21.787 INFO:teuthology.orchestra.run.smithi186.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-05-08T03:28:21.787 INFO:teuthology.orchestra.run.smithi186.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-05-08T03:28:21.787 INFO:teuthology.orchestra.run.smithi186.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-05-08T03:28:21.788 INFO:teuthology.orchestra.run.smithi186.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-05-08T03:28:21.788 INFO:teuthology.orchestra.run.smithi186.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-05-08T03:28:21.788 INFO:teuthology.orchestra.run.smithi186.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-05-08T03:28:21.788 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-05-08T03:28:21.788 INFO:teuthology.orchestra.run.smithi186.stdout: python3-portend-2.6-1.el8.noarch 2023-05-08T03:28:21.789 INFO:teuthology.orchestra.run.smithi186.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-05-08T03:28:21.789 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-05-08T03:28:21.789 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-05-08T03:28:21.789 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-05-08T03:28:21.789 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pycparser-2.14-14.el8.noarch 2023-05-08T03:28:21.790 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pytz-2017.2-9.el8.noarch 2023-05-08T03:28:21.790 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rados-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:28:21.790 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rbd-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:28:21.790 INFO:teuthology.orchestra.run.smithi186.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-05-08T03:28:21.790 INFO:teuthology.orchestra.run.smithi186.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-05-08T03:28:21.790 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rgw-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:28:21.790 INFO:teuthology.orchestra.run.smithi186.stdout: python3-routes-2.4.1-12.el8.noarch 2023-05-08T03:28:21.790 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rsa-4.8-1.el8.noarch 2023-05-08T03:28:21.791 INFO:teuthology.orchestra.run.smithi186.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-05-08T03:28:21.791 INFO:teuthology.orchestra.run.smithi186.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-05-08T03:28:21.791 INFO:teuthology.orchestra.run.smithi186.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-05-08T03:28:21.791 INFO:teuthology.orchestra.run.smithi186.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-05-08T03:28:21.791 INFO:teuthology.orchestra.run.smithi186.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-05-08T03:28:21.791 INFO:teuthology.orchestra.run.smithi186.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2023-05-08T03:28:21.791 INFO:teuthology.orchestra.run.smithi186.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-05-08T03:28:21.792 INFO:teuthology.orchestra.run.smithi186.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-05-08T03:28:21.792 INFO:teuthology.orchestra.run.smithi186.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-05-08T03:28:21.792 INFO:teuthology.orchestra.run.smithi186.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-05-08T03:28:21.792 INFO:teuthology.orchestra.run.smithi186.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-05-08T03:28:21.792 INFO:teuthology.orchestra.run.smithi186.stdout: rbd-fuse-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:28:21.793 INFO:teuthology.orchestra.run.smithi186.stdout: rbd-mirror-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:28:21.793 INFO:teuthology.orchestra.run.smithi186.stdout: rbd-nbd-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:28:21.793 INFO:teuthology.orchestra.run.smithi186.stdout: socat-1.7.4.1-1.el8.x86_64 2023-05-08T03:28:21.793 INFO:teuthology.orchestra.run.smithi186.stdout: thrift-0.13.0-2.el8.x86_64 2023-05-08T03:28:21.793 INFO:teuthology.orchestra.run.smithi186.stdout: uuid-1.6.2-43.el8.x86_64 2023-05-08T03:28:21.793 INFO:teuthology.orchestra.run.smithi186.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-05-08T03:28:21.793 INFO:teuthology.orchestra.run.smithi186.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-05-08T03:28:21.794 INFO:teuthology.orchestra.run.smithi186.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-05-08T03:28:21.794 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-05-08T03:28:21.794 INFO:teuthology.orchestra.run.smithi186.stdout:Complete! 2023-05-08T03:28:21.974 DEBUG:teuthology.parallel:result is None 2023-05-08T03:28:44.349 INFO:teuthology.orchestra.run.smithi133.stdout:[MIRROR] gperftools-libs-2.7-9.el8.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/g/gperftools-libs-2.7-9.el8.x86_64.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-05-08T03:28:44.349 INFO:teuthology.orchestra.run.smithi133.stdout:[MIRROR] liboath-2.6.2-3.el8.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/l/liboath-2.6.2-3.el8.x86_64.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-05-08T03:28:44.542 INFO:teuthology.orchestra.run.smithi133.stdout:(39/131): liboath-2.6.2-3.el8.x86_64.rpm 460 B/s | 59 kB 02:10 2023-05-08T03:28:44.592 INFO:teuthology.orchestra.run.smithi133.stdout:(40/131): gperftools-libs-2.7-9.el8.x86_64.rpm 2.3 kB/s | 306 kB 02:10 2023-05-08T03:28:48.797 INFO:teuthology.orchestra.run.smithi133.stdout:[MIRROR] libunwind-1.3.1-3.el8.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/l/libunwind-1.3.1-3.el8.x86_64.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-05-08T03:28:48.917 INFO:teuthology.orchestra.run.smithi133.stdout:(41/131): libunwind-1.3.1-3.el8.x86_64.rpm 582 B/s | 75 kB 02:11 2023-05-08T03:28:49.050 INFO:teuthology.orchestra.run.smithi133.stdout:(42/131): python3-beautifulsoup4-4.6.3-2.el8.1. 1.4 MB/s | 185 kB 00:00 2023-05-08T03:28:49.117 INFO:teuthology.orchestra.run.smithi133.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 495 kB/s | 33 kB 00:00 2023-05-08T03:28:49.268 INFO:teuthology.orchestra.run.smithi133.stdout:(44/131): python3-certifi-2018.10.15-7.el8.noar 109 kB/s | 16 kB 00:00 2023-05-08T03:28:49.335 INFO:teuthology.orchestra.run.smithi133.stdout:(45/131): python3-cheroot-8.5.2-1.el8.noarch.rp 2.5 MB/s | 173 kB 00:00 2023-05-08T03:28:49.501 INFO:teuthology.orchestra.run.smithi133.stdout:(46/131): python3-cherrypy-18.4.0-1.el8.noarch. 2.3 MB/s | 384 kB 00:00 2023-05-08T03:28:49.577 INFO:teuthology.orchestra.run.smithi133.stdout:(47/131): python3-google-auth-1.1.1-10.el8.noar 1.1 MB/s | 81 kB 00:00 2023-05-08T03:28:49.635 INFO:teuthology.orchestra.run.smithi133.stdout:(48/131): python3-jaraco-6.2-6.el8.noarch.rpm 191 kB/s | 11 kB 00:00 2023-05-08T03:28:49.727 INFO:teuthology.orchestra.run.smithi133.stdout:(49/131): python3-jaraco-functools-2.0-4.el8.no 192 kB/s | 18 kB 00:00 2023-05-08T03:28:49.869 INFO:teuthology.orchestra.run.smithi133.stdout:(50/131): python3-kubernetes-11.0.0-6.el8.noarc 8.2 MB/s | 1.2 MB 00:00 2023-05-08T03:28:49.977 INFO:teuthology.orchestra.run.smithi133.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 450 kB/s | 49 kB 00:00 2023-05-08T03:28:50.361 INFO:teuthology.orchestra.run.smithi133.stdout:(52/131): python3-more-itertools-7.2.0-3.el8.no 153 kB/s | 59 kB 00:00 2023-05-08T03:28:50.495 INFO:teuthology.orchestra.run.smithi133.stdout:(53/131): python3-natsort-7.1.1-2.el8.noarch.rp 452 kB/s | 60 kB 00:00 2023-05-08T03:28:50.612 INFO:teuthology.orchestra.run.smithi133.stdout:(54/131): python3-pecan-1.3.2-9.el8.noarch.rpm 2.4 MB/s | 283 kB 00:00 2023-05-08T03:28:50.679 INFO:teuthology.orchestra.run.smithi133.stdout:(55/131): python3-portend-2.6-1.el8.noarch.rpm 234 kB/s | 16 kB 00:00 2023-05-08T03:28:50.770 INFO:teuthology.orchestra.run.smithi133.stdout:(56/131): python3-repoze-lru-0.7-6.el8.noarch.r 368 kB/s | 34 kB 00:00 2023-05-08T03:28:50.854 INFO:teuthology.orchestra.run.smithi133.stdout:(57/131): python3-routes-2.4.1-12.el8.noarch.rp 2.3 MB/s | 196 kB 00:00 2023-05-08T03:28:50.988 INFO:teuthology.orchestra.run.smithi133.stdout:(58/131): python3-rsa-4.8-1.el8.noarch.rpm 461 kB/s | 61 kB 00:00 2023-05-08T03:28:51.179 INFO:teuthology.orchestra.run.smithi133.stdout:(59/131): python3-simplegeneric-0.8.1-17.el8.no 98 kB/s | 19 kB 00:00 2023-05-08T03:28:51.288 INFO:teuthology.orchestra.run.smithi133.stdout:(60/131): python3-singledispatch-3.4.0.3-18.el8 221 kB/s | 24 kB 00:00 2023-05-08T03:28:51.405 INFO:teuthology.orchestra.run.smithi133.stdout:(61/131): python3-tempora-1.14.1-5.el8.noarch.r 250 kB/s | 29 kB 00:00 2023-05-08T03:28:51.547 INFO:teuthology.orchestra.run.smithi133.stdout:(62/131): python3-trustme-0.6.0-4.el8.noarch.rp 194 kB/s | 27 kB 00:00 2023-05-08T03:28:51.689 INFO:teuthology.orchestra.run.smithi133.stdout:(63/131): python3-waitress-1.2.1-2.el8.1.noarch 1.7 MB/s | 241 kB 00:00 2023-05-08T03:28:51.798 INFO:teuthology.orchestra.run.smithi133.stdout:(64/131): python3-webob-1.8.5-1.el8.1.noarch.rp 2.3 MB/s | 251 kB 00:00 2023-05-08T03:28:51.856 INFO:teuthology.orchestra.run.smithi133.stdout:(65/131): python3-websocket-client-0.56.0-5.el8 1.0 MB/s | 61 kB 00:00 2023-05-08T03:28:52.082 INFO:teuthology.orchestra.run.smithi133.stdout:(66/131): python3-webtest-2.0.33-1.el8.noarch.r 379 kB/s | 85 kB 00:00 2023-05-08T03:28:52.157 INFO:teuthology.orchestra.run.smithi133.stdout:(67/131): python3-zc-lockfile-2.0-2.el8.noarch. 306 kB/s | 23 kB 00:00 2023-05-08T03:28:52.332 INFO:teuthology.orchestra.run.smithi133.stdout:(68/131): thrift-0.13.0-2.el8.x86_64.rpm 9.9 MB/s | 1.7 MB 00:00 2023-05-08T03:28:52.357 INFO:teuthology.orchestra.run.smithi133.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2023-05-08T03:28:52.665 INFO:teuthology.orchestra.run.smithi133.stdout:(70/131): python3-scipy-1.0.0-21.module+el8.5.0 44 MB/s | 14 MB 00:00 2023-05-08T03:28:52.716 INFO:teuthology.orchestra.run.smithi133.stdout:(71/131): python3-pyasn1-modules-0.3.7-6.el8.no 2.2 MB/s | 110 kB 00:00 2023-05-08T03:28:52.750 INFO:teuthology.orchestra.run.smithi133.stdout:(72/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.6 MB/s | 54 kB 00:00 2023-05-08T03:28:52.791 INFO:teuthology.orchestra.run.smithi133.stdout:(73/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 6.1 MB/s | 259 kB 00:00 2023-05-08T03:28:52.833 INFO:teuthology.orchestra.run.smithi133.stdout:(74/131): socat-1.7.4.1-1.el8.x86_64.rpm 7.6 MB/s | 323 kB 00:00 2023-05-08T03:28:52.867 INFO:teuthology.orchestra.run.smithi133.stdout:(75/131): python3-markupsafe-0.23-19.el8.x86_64 1.1 MB/s | 39 kB 00:00 2023-05-08T03:28:52.925 INFO:teuthology.orchestra.run.smithi133.stdout:(76/131): bison-3.0.4-10.el8.x86_64.rpm 12 MB/s | 688 kB 00:00 2023-05-08T03:28:52.968 INFO:teuthology.orchestra.run.smithi133.stdout:(77/131): python3-jinja2-2.10.1-3.el8.noarch.rp 13 MB/s | 538 kB 00:00 2023-05-08T03:28:53.009 INFO:teuthology.orchestra.run.smithi133.stdout:(78/131): python3-mako-1.0.6-13.el8.noarch.rpm 3.7 MB/s | 157 kB 00:00 2023-05-08T03:28:53.051 INFO:teuthology.orchestra.run.smithi133.stdout:(79/131): oniguruma-6.8.2-2.el8.x86_64.rpm 4.4 MB/s | 187 kB 00:00 2023-05-08T03:28:53.102 INFO:teuthology.orchestra.run.smithi133.stdout:(80/131): automake-1.16.1-7.el8.noarch.rpm 14 MB/s | 713 kB 00:00 2023-05-08T03:28:53.252 INFO:teuthology.orchestra.run.smithi133.stdout:(81/131): python3-babel-2.5.1-7.el8.noarch.rpm 32 MB/s | 4.8 MB 00:00 2023-05-08T03:28:53.294 INFO:teuthology.orchestra.run.smithi133.stdout:(82/131): python3-jsonpatch-1.21-2.el8.noarch.r 639 kB/s | 27 kB 00:00 2023-05-08T03:28:53.336 INFO:teuthology.orchestra.run.smithi133.stdout:(83/131): flex-2.6.1-9.el8.x86_64.rpm 7.5 MB/s | 320 kB 00:00 2023-05-08T03:28:53.377 INFO:teuthology.orchestra.run.smithi133.stdout:(84/131): python3-prettytable-0.7.2-14.el8.noar 1.0 MB/s | 44 kB 00:00 2023-05-08T03:28:53.486 INFO:teuthology.orchestra.run.smithi133.stdout:(85/131): python3-numpy-1.14.3-10.el8.x86_64.rp 34 MB/s | 3.7 MB 00:00 2023-05-08T03:28:53.528 INFO:teuthology.orchestra.run.smithi133.stdout:(86/131): python3-werkzeug-0.12.2-4.el8.noarch. 11 MB/s | 457 kB 00:00 2023-05-08T03:28:53.570 INFO:teuthology.orchestra.run.smithi133.stdout:(87/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 5.3 MB/s | 225 kB 00:00 2023-05-08T03:28:53.612 INFO:teuthology.orchestra.run.smithi133.stdout:(88/131): uuid-1.6.2-43.el8.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2023-05-08T03:28:53.654 INFO:teuthology.orchestra.run.smithi133.stdout:(89/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 3.0 MB/s | 126 kB 00:00 2023-05-08T03:28:53.687 INFO:teuthology.orchestra.run.smithi133.stdout:(90/131): python3-jsonpointer-1.10-11.el8.noarc 602 kB/s | 20 kB 00:00 2023-05-08T03:28:53.729 INFO:teuthology.orchestra.run.smithi133.stdout:(91/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 2.4 MB/s | 103 kB 00:00 2023-05-08T03:28:53.813 INFO:teuthology.orchestra.run.smithi133.stdout:(92/131): libtool-2.4.6-25.el8.x86_64.rpm 8.3 MB/s | 709 kB 00:00 2023-05-08T03:28:53.939 INFO:teuthology.orchestra.run.smithi133.stdout:(93/131): openblas-threads-0.3.15-3.el8.x86_64. 39 MB/s | 4.9 MB 00:00 2023-05-08T03:28:53.981 INFO:teuthology.orchestra.run.smithi133.stdout:(94/131): libpq-13.5-1.el8.x86_64.rpm 4.6 MB/s | 198 kB 00:00 2023-05-08T03:28:54.097 INFO:teuthology.orchestra.run.smithi133.stdout:(95/131): openblas-0.3.15-3.el8.x86_64.rpm 41 MB/s | 4.7 MB 00:00 2023-05-08T03:28:54.139 INFO:teuthology.orchestra.run.smithi133.stdout:(96/131): jq-1.6-3.el8.x86_64.rpm 4.8 MB/s | 202 kB 00:00 2023-05-08T03:28:54.181 INFO:teuthology.orchestra.run.smithi133.stdout:(97/131): librdkafka-0.11.4-3.el8.x86_64.rpm 8.3 MB/s | 354 kB 00:00 2023-05-08T03:28:54.306 INFO:teuthology.orchestra.run.smithi133.stdout:(98/131): postgresql-server-10.21-2.module+el8. 40 MB/s | 5.1 MB 00:00 2023-05-08T03:28:54.391 INFO:teuthology.orchestra.run.smithi133.stdout:(99/131): postgresql-contrib-10.21-2.module+el8 9.4 MB/s | 808 kB 00:00 2023-05-08T03:28:54.457 INFO:teuthology.orchestra.run.smithi133.stdout:(100/131): postgresql-10.21-2.module+el8.6.0+15 23 MB/s | 1.5 MB 00:00 2023-05-08T03:28:54.499 INFO:teuthology.orchestra.run.smithi133.stdout:(101/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2023-05-08T03:28:54.541 INFO:teuthology.orchestra.run.smithi133.stdout:(102/131): libselinux-devel-2.9-5.el8.x86_64.rp 4.7 MB/s | 200 kB 00:00 2023-05-08T03:28:54.574 INFO:teuthology.orchestra.run.smithi133.stdout:(103/131): python3-jwt-1.6.1-2.el8.noarch.rpm 1.2 MB/s | 43 kB 00:00 2023-05-08T03:28:54.616 INFO:teuthology.orchestra.run.smithi133.stdout:(104/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 5.2 MB/s | 220 kB 00:00 2023-05-08T03:28:54.650 INFO:teuthology.orchestra.run.smithi133.stdout:(105/131): keyutils-libs-devel-1.5.10-9.el8.x86 1.4 MB/s | 48 kB 00:00 2023-05-08T03:28:54.683 INFO:teuthology.orchestra.run.smithi133.stdout:(106/131): libsepol-devel-2.9-3.el8.x86_64.rpm 2.5 MB/s | 87 kB 00:00 2023-05-08T03:28:54.717 INFO:teuthology.orchestra.run.smithi133.stdout:(107/131): python3-requests-oauthlib-1.0.0-1.el 1.3 MB/s | 43 kB 00:00 2023-05-08T03:28:54.759 INFO:teuthology.orchestra.run.smithi133.stdout:(108/131): python3-pycparser-2.14-14.el8.noarch 2.6 MB/s | 109 kB 00:00 2023-05-08T03:28:54.801 INFO:teuthology.orchestra.run.smithi133.stdout:(109/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 5.4 MB/s | 229 kB 00:00 2023-05-08T03:28:54.851 INFO:teuthology.orchestra.run.smithi133.stdout:(110/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 11 MB/s | 560 kB 00:00 2023-05-08T03:28:54.885 INFO:teuthology.orchestra.run.smithi133.stdout:(111/131): libaio-devel-0.3.112-1.el8.x86_64.rp 565 kB/s | 19 kB 00:00 2023-05-08T03:28:54.918 INFO:teuthology.orchestra.run.smithi133.stdout:(112/131): python3-oauthlib-2.1.0-1.el8.noarch. 4.5 MB/s | 155 kB 00:00 2023-05-08T03:28:54.968 INFO:teuthology.orchestra.run.smithi133.stdout:(113/131): python3-cryptography-3.2.1-5.el8.x86 11 MB/s | 559 kB 00:00 2023-05-08T03:28:55.002 INFO:teuthology.orchestra.run.smithi133.stdout:(114/131): libverto-devel-0.3.0-5.el8.x86_64.rp 535 kB/s | 18 kB 00:00 2023-05-08T03:28:55.044 INFO:teuthology.orchestra.run.smithi133.stdout:(115/131): pcre2-devel-10.32-2.el8.x86_64.rpm 14 MB/s | 605 kB 00:00 2023-05-08T03:28:55.086 INFO:teuthology.orchestra.run.smithi133.stdout:(116/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 5.6 MB/s | 238 kB 00:00 2023-05-08T03:28:55.161 INFO:teuthology.orchestra.run.smithi133.stdout:(117/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 31 MB/s | 2.3 MB 00:00 2023-05-08T03:28:55.195 INFO:teuthology.orchestra.run.smithi133.stdout:(118/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 2.1 MB/s | 72 kB 00:00 2023-05-08T03:28:55.229 INFO:teuthology.orchestra.run.smithi133.stdout:(119/131): fuse-2.9.7-15.el8.x86_64.rpm 2.4 MB/s | 83 kB 00:00 2023-05-08T03:28:55.262 INFO:teuthology.orchestra.run.smithi133.stdout:(120/131): elfutils-libelf-devel-0.186-1.el8.x8 1.8 MB/s | 60 kB 00:00 2023-05-08T03:28:55.304 INFO:teuthology.orchestra.run.smithi133.stdout:(121/131): libuuid-devel-2.32.1-35.el8.x86_64.r 2.3 MB/s | 98 kB 00:00 2023-05-08T03:28:55.337 INFO:teuthology.orchestra.run.smithi133.stdout:(122/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 1.7 MB/s | 58 kB 00:00 2023-05-08T03:28:55.371 INFO:teuthology.orchestra.run.smithi133.stdout:(123/131): libcom_err-devel-1.45.6-4.el8.x86_64 1.1 MB/s | 39 kB 00:00 2023-05-08T03:28:55.413 INFO:teuthology.orchestra.run.smithi133.stdout:(124/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 15 MB/s | 644 kB 00:00 2023-05-08T03:28:55.455 INFO:teuthology.orchestra.run.smithi133.stdout:(125/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 4.0 MB/s | 171 kB 00:00 2023-05-08T03:28:55.489 INFO:teuthology.orchestra.run.smithi133.stdout:(126/131): NetworkManager-initscripts-updown-1. 4.0 MB/s | 138 kB 00:00 2023-05-08T03:28:55.839 INFO:teuthology.orchestra.run.smithi133.stdout:(127/131): librados2-18.0.0-3786.g4b086ba5.el8. 10 MB/s | 3.7 MB 00:00 2023-05-08T03:28:56.031 INFO:teuthology.orchestra.run.smithi133.stdout:(128/131): librbd1-18.0.0-3786.g4b086ba5.el8.x8 19 MB/s | 3.6 MB 00:00 2023-05-08T03:28:56.100 INFO:teuthology.orchestra.run.smithi133.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 11 MB/s | 798 kB 00:00 2023-05-08T03:30:55.691 INFO:teuthology.orchestra.run.smithi133.stdout:[MIRROR] python3-asyncssh-2.7.0-2.el8.noarch.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/p/python3-asyncssh-2.7.0-2.el8.noarch.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-05-08T03:30:55.692 INFO:teuthology.orchestra.run.smithi133.stdout:[MIRROR] python3-bcrypt-3.1.6-2.el8.1.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/p/python3-bcrypt-3.1.6-2.el8.1.x86_64.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-05-08T03:30:55.846 INFO:teuthology.orchestra.run.smithi133.stdout:(130/131): python3-bcrypt-3.1.6-2.el8.1.x86_64. 340 B/s | 44 kB 02:11 2023-05-08T03:30:55.971 INFO:teuthology.orchestra.run.smithi133.stdout:(131/131): python3-asyncssh-2.7.0-2.el8.noarch. 3.6 kB/s | 476 kB 02:11 2023-05-08T03:30:55.972 INFO:teuthology.orchestra.run.smithi133.stdout:-------------------------------------------------------------------------------- 2023-05-08T03:30:55.972 INFO:teuthology.orchestra.run.smithi133.stdout:Total 755 kB/s | 197 MB 04:26 2023-05-08T03:30:56.744 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction check 2023-05-08T03:30:56.863 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction check succeeded. 2023-05-08T03:30:56.863 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction test 2023-05-08T03:30:57.940 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction test succeeded. 2023-05-08T03:30:57.944 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction 2023-05-08T03:31:02.761 INFO:teuthology.orchestra.run.smithi133.stdout: Preparing : 1/1 2023-05-08T03:31:02.968 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-05-08T03:31:03.127 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-05-08T03:31:03.343 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-05-08T03:31:03.545 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-05-08T03:31:03.656 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-05-08T03:31:03.911 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-05-08T03:31:04.348 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-05-08T03:31:04.562 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : librados2-2:18.0.0-3786.g4b086ba5.el8.x86_64 6/134 2023-05-08T03:31:04.953 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: librados2-2:18.0.0-3786.g4b086ba5.el8.x86_64 6/134 2023-05-08T03:31:05.178 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : librbd1-2:18.0.0-3786.g4b086ba5.el8.x86_64 7/134 2023-05-08T03:31:05.296 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: librbd1-2:18.0.0-3786.g4b086ba5.el8.x86_64 7/134 2023-05-08T03:31:05.470 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libcephfs2-2:18.0.0-3786.g4b086ba5.el8.x86_64 8/134 2023-05-08T03:31:05.568 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libcephfs2-2:18.0.0-3786.g4b086ba5.el8.x86_64 8/134 2023-05-08T03:31:05.779 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-rados-2:18.0.0-3786.g4b086ba5.el8.x86_64 9/134 2023-05-08T03:31:06.006 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-05-08T03:31:06.214 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-05-08T03:31:06.618 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-05-08T03:31:06.890 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-05-08T03:31:07.028 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libcephsqlite-2:18.0.0-3786.g4b086ba5.el8.x86_64 14/134 2023-05-08T03:31:07.113 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libcephsqlite-2:18.0.0-3786.g4b086ba5.el8.x86_64 14/134 2023-05-08T03:31:07.252 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libradosstriper1-2:18.0.0-3786.g4b086ba5.el8.x86 15/134 2023-05-08T03:31:07.331 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libradosstriper1-2:18.0.0-3786.g4b086ba5.el8.x86 15/134 2023-05-08T03:31:07.502 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-05-08T03:31:07.656 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-05-08T03:31:07.811 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-05-08T03:31:08.410 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-05-08T03:31:08.611 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-05-08T03:31:09.203 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-05-08T03:31:09.377 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-05-08T03:31:10.062 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-05-08T03:31:10.366 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-05-08T03:31:10.577 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-05-08T03:31:10.797 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-05-08T03:31:11.016 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-05-08T03:31:11.207 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-05-08T03:31:11.419 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-05-08T03:31:11.600 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-ceph-common-2:18.0.0-3786.g4b086ba5.el8. 26/134 2023-05-08T03:31:11.713 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-ceph-argparse-2:18.0.0-3786.g4b086ba5.el 27/134 2023-05-08T03:31:12.599 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-cephfs-2:18.0.0-3786.g4b086ba5.el8.x86_6 28/134 2023-05-08T03:31:12.922 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-05-08T03:31:13.178 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-05-08T03:31:13.440 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-05-08T03:31:13.651 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-05-08T03:31:15.397 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-05-08T03:31:15.700 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-05-08T03:31:15.888 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-rsa-4.8-1.el8.noarch 34/134 2023-05-08T03:31:16.119 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-05-08T03:31:16.315 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-rbd-2:18.0.0-3786.g4b086ba5.el8.x86_64 36/134 2023-05-08T03:31:16.463 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : librados-devel-2:18.0.0-3786.g4b086ba5.el8.x86_6 37/134 2023-05-08T03:31:16.648 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-05-08T03:31:16.827 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-05-08T03:31:17.020 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-05-08T03:31:17.154 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-05-08T03:31:17.384 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-05-08T03:31:17.583 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-05-08T03:31:18.000 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-05-08T03:31:18.270 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-05-08T03:31:18.493 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-05-08T03:31:18.696 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-05-08T03:31:18.980 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-05-08T03:31:19.267 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-05-08T03:31:19.484 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-05-08T03:31:19.700 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-05-08T03:31:19.905 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-05-08T03:31:20.054 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-05-08T03:31:20.253 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-05-08T03:31:20.552 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-05-08T03:31:20.829 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-05-08T03:31:21.062 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-05-08T03:31:21.315 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-05-08T03:31:21.457 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-05-08T03:31:21.593 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-05-08T03:31:21.784 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-05-08T03:31:21.877 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-05-08T03:31:22.112 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-05-08T03:31:22.303 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-05-08T03:31:22.467 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-05-08T03:31:22.546 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-05-08T03:31:22.762 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-05-08T03:31:22.918 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-05-08T03:31:23.091 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-05-08T03:31:23.261 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-05-08T03:31:23.489 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-05-08T03:31:23.748 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 70/134 2023-05-08T03:31:23.879 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-05-08T03:31:24.011 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-05-08T03:31:24.244 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-05-08T03:31:24.438 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-05-08T03:31:24.618 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-05-08T03:31:24.811 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-05-08T03:31:24.947 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-05-08T03:31:25.163 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-05-08T03:31:25.404 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-05-08T03:31:25.564 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-05-08T03:31:25.795 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-05-08T03:31:26.023 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-05-08T03:31:26.173 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-05-08T03:31:26.367 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-05-08T03:31:27.862 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-05-08T03:31:28.110 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-05-08T03:31:28.374 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-05-08T03:31:28.649 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-05-08T03:31:28.953 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-05-08T03:31:29.132 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-05-08T03:31:29.890 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-05-08T03:31:30.049 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : librgw2-2:18.0.0-3786.g4b086ba5.el8.x86_64 92/134 2023-05-08T03:31:30.106 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: librgw2-2:18.0.0-3786.g4b086ba5.el8.x86_64 92/134 2023-05-08T03:31:30.274 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-rgw-2:18.0.0-3786.g4b086ba5.el8.x86_64 93/134 2023-05-08T03:31:33.784 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-common-2:18.0.0-3786.g4b086ba5.el8.x86_64 94/134 2023-05-08T03:31:34.031 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-common-2:18.0.0-3786.g4b086ba5.el8.x86_64 94/134 2023-05-08T03:31:34.630 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-common-2:18.0.0-3786.g4b086ba5.el8.x86_64 94/134 2023-05-08T03:31:34.900 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-base-2:18.0.0-3786.g4b086ba5.el8.x86_64 95/134 2023-05-08T03:31:34.983 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-base-2:18.0.0-3786.g4b086ba5.el8.x86_64 95/134 2023-05-08T03:31:35.139 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-selinux-2:18.0.0-3786.g4b086ba5.el8.x86_64 96/134 2023-05-08T03:31:54.107 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-selinux-2:18.0.0-3786.g4b086ba5.el8.x86_64 96/134 2023-05-08T03:31:54.107 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /sys 2023-05-08T03:31:54.107 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /proc 2023-05-08T03:31:54.107 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /dev 2023-05-08T03:31:54.108 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /run 2023-05-08T03:31:54.108 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /mnt 2023-05-08T03:31:54.108 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /var/tmp 2023-05-08T03:31:54.108 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /home 2023-05-08T03:31:54.108 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /tmp 2023-05-08T03:31:54.108 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /dev 2023-05-08T03:31:54.108 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-05-08T03:31:54.436 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-volume-2:18.0.0-3786.g4b086ba5.el8.noarch 97/134 2023-05-08T03:31:56.018 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-volume-2:18.0.0-3786.g4b086ba5.el8.noarch 97/134 2023-05-08T03:31:56.172 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-osd-2:18.0.0-3786.g4b086ba5.el8.x86_64 98/134 2023-05-08T03:31:56.389 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-osd-2:18.0.0-3786.g4b086ba5.el8.x86_64 98/134 2023-05-08T03:31:56.553 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mds-2:18.0.0-3786.g4b086ba5.el8.x86_64 99/134 2023-05-08T03:31:57.005 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mds-2:18.0.0-3786.g4b086ba5.el8.x86_64 99/134 2023-05-08T03:31:57.161 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mon-2:18.0.0-3786.g4b086ba5.el8.x86_64 100/134 2023-05-08T03:31:57.177 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mon-2:18.0.0-3786.g4b086ba5.el8.x86_64 100/134 2023-05-08T03:31:58.918 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: cephadm-2:18.0.0-3786.g4b086ba5.el8.noarch 101/134 2023-05-08T03:31:59.107 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : cephadm-2:18.0.0-3786.g4b086ba5.el8.noarch 101/134 2023-05-08T03:31:59.233 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-3786.g4b086ba5.e 102/134 2023-05-08T03:31:59.458 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-3786.g4b086ba5. 103/134 2023-05-08T03:31:59.618 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-3786.g4b086ba5.el8.noa 104/134 2023-05-08T03:31:59.831 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-3786.g4b086ba5.el8.noa 104/134 2023-05-08T03:32:00.112 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-3786.g4b086ba5.el8.n 105/134 2023-05-08T03:32:01.069 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-3786.g4b086ba5.el8.n 105/134 2023-05-08T03:32:01.202 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-3786.g4b0 106/134 2023-05-08T03:32:01.291 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-3786.g4b0 106/134 2023-05-08T03:32:01.640 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-3786.g4b086ba5.el 107/134 2023-05-08T03:32:01.824 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mgr-2:18.0.0-3786.g4b086ba5.el8.x86_64 108/134 2023-05-08T03:32:01.858 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mgr-2:18.0.0-3786.g4b086ba5.el8.x86_64 108/134 2023-05-08T03:32:01.993 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mgr-rook-2:18.0.0-3786.g4b086ba5.el8.noarch 109/134 2023-05-08T03:32:02.003 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-3786.g4b086ba5.el8.noarch 109/134 2023-05-08T03:32:03.255 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-2:18.0.0-3786.g4b086ba5.el8.x86_64 110/134 2023-05-08T03:32:03.460 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-radosgw-2:18.0.0-3786.g4b086ba5.el8.x86_64 111/134 2023-05-08T03:32:03.492 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-3786.g4b086ba5.el8.x86_64 111/134 2023-05-08T03:32:03.643 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-3786.g4b086 112/134 2023-05-08T03:32:03.683 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-3786.g4b086 112/134 2023-05-08T03:32:03.835 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : cephfs-mirror-2:18.0.0-3786.g4b086ba5.el8.x86_64 113/134 2023-05-08T03:32:04.179 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-3786.g4b086ba5.el8.x86_64 113/134 2023-05-08T03:32:04.326 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : rbd-mirror-2:18.0.0-3786.g4b086ba5.el8.x86_64 114/134 2023-05-08T03:32:08.247 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: rbd-mirror-2:18.0.0-3786.g4b086ba5.el8.x86_64 114/134 2023-05-08T03:32:08.561 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-test-2:18.0.0-3786.g4b086ba5.el8.x86_64 115/134 2023-05-08T03:32:08.725 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-05-08T03:32:08.923 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-05-08T03:32:09.835 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-05-08T03:32:10.173 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-05-08T03:32:10.386 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-fuse-2:18.0.0-3786.g4b086ba5.el8.x86_64 119/134 2023-05-08T03:32:10.579 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-05-08T03:32:10.737 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libcephfs-devel-2:18.0.0-3786.g4b086ba5.el8.x86_ 121/134 2023-05-08T03:32:10.901 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-05-08T03:32:12.995 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-05-08T03:32:13.283 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-05-08T03:32:13.301 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-05-08T03:32:13.475 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : cephfs-top-2:18.0.0-3786.g4b086ba5.el8.noarch 124/134 2023-05-08T03:32:13.766 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : rbd-fuse-2:18.0.0-3786.g4b086ba5.el8.x86_64 125/134 2023-05-08T03:32:14.073 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : rbd-nbd-2:18.0.0-3786.g4b086ba5.el8.x86_64 126/134 2023-05-08T03:32:14.384 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-05-08T03:32:14.524 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-05-08T03:32:14.532 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-05-08T03:32:14.705 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-05-08T03:32:14.949 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-05-08T03:32:15.035 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-05-08T03:32:15.240 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-05-08T03:32:15.253 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-05-08T03:32:15.253 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-05-08T03:32:15.469 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-05-08T03:32:15.469 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-05-08T03:32:15.688 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-05-08T03:32:15.865 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-05-08T03:32:16.168 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-05-08T03:32:16.168 INFO:teuthology.orchestra.run.smithi133.stdout:[/usr/lib/tmpfiles.d/journal-nocow.conf:26] Failed to resolve specifier: uninitialized /etc detected, skipping 2023-05-08T03:32:16.168 INFO:teuthology.orchestra.run.smithi133.stdout:All rules containing unresolvable specifiers will be skipped. 2023-05-08T03:32:16.168 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-05-08T03:32:16.435 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-2:18.0.0-3786.g4b086ba5.el8.x86_64 1/134 2023-05-08T03:32:16.435 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-base-2:18.0.0-3786.g4b086ba5.el8.x86_64 2/134 2023-05-08T03:32:16.435 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-common-2:18.0.0-3786.g4b086ba5.el8.x86_64 3/134 2023-05-08T03:32:16.435 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-fuse-2:18.0.0-3786.g4b086ba5.el8.x86_64 4/134 2023-05-08T03:32:16.435 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-3786.g4b086 5/134 2023-05-08T03:32:16.436 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mds-2:18.0.0-3786.g4b086ba5.el8.x86_64 6/134 2023-05-08T03:32:16.436 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mgr-2:18.0.0-3786.g4b086ba5.el8.x86_64 7/134 2023-05-08T03:32:16.436 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mon-2:18.0.0-3786.g4b086ba5.el8.x86_64 8/134 2023-05-08T03:32:16.436 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-osd-2:18.0.0-3786.g4b086ba5.el8.x86_64 9/134 2023-05-08T03:32:16.436 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-radosgw-2:18.0.0-3786.g4b086ba5.el8.x86_64 10/134 2023-05-08T03:32:16.436 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-selinux-2:18.0.0-3786.g4b086ba5.el8.x86_64 11/134 2023-05-08T03:32:16.436 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-test-2:18.0.0-3786.g4b086ba5.el8.x86_64 12/134 2023-05-08T03:32:16.438 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : cephfs-mirror-2:18.0.0-3786.g4b086ba5.el8.x86_64 13/134 2023-05-08T03:32:16.438 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libcephfs-devel-2:18.0.0-3786.g4b086ba5.el8.x86_ 14/134 2023-05-08T03:32:16.438 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libcephfs2-2:18.0.0-3786.g4b086ba5.el8.x86_64 15/134 2023-05-08T03:32:16.438 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libcephsqlite-2:18.0.0-3786.g4b086ba5.el8.x86_64 16/134 2023-05-08T03:32:16.438 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librados-devel-2:18.0.0-3786.g4b086ba5.el8.x86_6 17/134 2023-05-08T03:32:16.438 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libradosstriper1-2:18.0.0-3786.g4b086ba5.el8.x86 18/134 2023-05-08T03:32:16.439 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librgw2-2:18.0.0-3786.g4b086ba5.el8.x86_64 19/134 2023-05-08T03:32:16.439 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-ceph-argparse-2:18.0.0-3786.g4b086ba5.el 20/134 2023-05-08T03:32:16.439 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-ceph-common-2:18.0.0-3786.g4b086ba5.el8. 21/134 2023-05-08T03:32:16.439 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-cephfs-2:18.0.0-3786.g4b086ba5.el8.x86_6 22/134 2023-05-08T03:32:16.439 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-rados-2:18.0.0-3786.g4b086ba5.el8.x86_64 23/134 2023-05-08T03:32:16.439 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-rbd-2:18.0.0-3786.g4b086ba5.el8.x86_64 24/134 2023-05-08T03:32:16.439 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-rgw-2:18.0.0-3786.g4b086ba5.el8.x86_64 25/134 2023-05-08T03:32:16.446 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : rbd-fuse-2:18.0.0-3786.g4b086ba5.el8.x86_64 26/134 2023-05-08T03:32:16.447 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : rbd-mirror-2:18.0.0-3786.g4b086ba5.el8.x86_64 27/134 2023-05-08T03:32:16.447 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : rbd-nbd-2:18.0.0-3786.g4b086ba5.el8.x86_64 28/134 2023-05-08T03:32:16.447 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-3786.g4b086ba5. 29/134 2023-05-08T03:32:16.447 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-3786.g4b086ba5.el8.noa 30/134 2023-05-08T03:32:16.447 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-3786.g4b086ba5.el8.n 31/134 2023-05-08T03:32:16.447 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-3786.g4b0 32/134 2023-05-08T03:32:16.447 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-3786.g4b086ba5.el 33/134 2023-05-08T03:32:16.448 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mgr-rook-2:18.0.0-3786.g4b086ba5.el8.noarch 34/134 2023-05-08T03:32:16.448 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-3786.g4b086ba5.e 35/134 2023-05-08T03:32:16.448 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-volume-2:18.0.0-3786.g4b086ba5.el8.noarch 36/134 2023-05-08T03:32:16.448 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : cephadm-2:18.0.0-3786.g4b086ba5.el8.noarch 37/134 2023-05-08T03:32:16.448 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : cephfs-top-2:18.0.0-3786.g4b086ba5.el8.noarch 38/134 2023-05-08T03:32:16.448 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-05-08T03:32:16.448 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-05-08T03:32:16.449 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-05-08T03:32:16.449 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-05-08T03:32:16.449 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-05-08T03:32:16.449 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-05-08T03:32:16.449 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-05-08T03:32:16.449 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-05-08T03:32:16.449 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-05-08T03:32:16.449 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-05-08T03:32:16.450 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-05-08T03:32:16.450 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-05-08T03:32:16.450 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-05-08T03:32:16.450 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-05-08T03:32:16.450 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-05-08T03:32:16.450 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-05-08T03:32:16.450 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-05-08T03:32:16.450 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-05-08T03:32:16.451 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-05-08T03:32:16.451 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-05-08T03:32:16.451 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-05-08T03:32:16.451 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 60/134 2023-05-08T03:32:16.451 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-05-08T03:32:16.451 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-05-08T03:32:16.451 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-05-08T03:32:16.451 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-05-08T03:32:16.452 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 65/134 2023-05-08T03:32:16.452 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-05-08T03:32:16.452 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-05-08T03:32:16.452 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-05-08T03:32:16.452 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-05-08T03:32:16.452 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-05-08T03:32:16.452 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-05-08T03:32:16.453 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-05-08T03:32:16.453 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-05-08T03:32:16.453 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-05-08T03:32:16.453 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-05-08T03:32:16.453 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-05-08T03:32:16.453 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-05-08T03:32:16.453 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-05-08T03:32:16.453 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-05-08T03:32:16.454 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-05-08T03:32:16.454 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-05-08T03:32:16.454 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-05-08T03:32:16.454 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-05-08T03:32:16.454 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-05-08T03:32:16.454 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-05-08T03:32:16.454 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-05-08T03:32:16.454 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-05-08T03:32:16.455 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-05-08T03:32:16.455 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-05-08T03:32:16.455 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-05-08T03:32:16.455 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-05-08T03:32:16.455 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-05-08T03:32:16.455 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-05-08T03:32:16.455 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-05-08T03:32:16.455 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-05-08T03:32:16.456 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-05-08T03:32:16.456 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-05-08T03:32:16.456 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-05-08T03:32:16.456 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-05-08T03:32:16.456 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-05-08T03:32:16.456 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-05-08T03:32:16.456 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-05-08T03:32:16.457 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-05-08T03:32:16.457 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-05-08T03:32:16.457 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-05-08T03:32:16.457 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-05-08T03:32:16.457 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-05-08T03:32:16.457 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-05-08T03:32:16.457 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-05-08T03:32:16.457 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-05-08T03:32:16.458 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-05-08T03:32:16.458 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-05-08T03:32:16.458 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-05-08T03:32:16.458 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-05-08T03:32:16.458 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-05-08T03:32:16.458 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-05-08T03:32:16.458 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-05-08T03:32:16.458 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-05-08T03:32:16.459 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-05-08T03:32:16.459 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-05-08T03:32:16.459 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-05-08T03:32:16.459 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-05-08T03:32:16.459 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-05-08T03:32:16.459 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-05-08T03:32:16.459 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-05-08T03:32:16.459 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-05-08T03:32:16.460 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-05-08T03:32:16.460 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-05-08T03:32:16.460 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librados2-2:18.0.0-3786.g4b086ba5.el8.x86_64 129/134 2023-05-08T03:32:16.460 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-05-08T03:32:16.460 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librbd1-2:18.0.0-3786.g4b086ba5.el8.x86_64 131/134 2023-05-08T03:32:16.460 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-05-08T03:32:16.460 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-05-08T03:32:18.927 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-05-08T03:32:18.927 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:06:01 ago on Mon 08 May 2023 03:26:17 AM UTC. 2023-05-08T03:32:21.425 INFO:teuthology.orchestra.run.smithi133.stdout:Installed products updated. 2023-05-08T03:32:21.638 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-05-08T03:32:21.638 INFO:teuthology.orchestra.run.smithi133.stdout:Upgraded: 2023-05-08T03:32:21.639 INFO:teuthology.orchestra.run.smithi133.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-05-08T03:32:21.639 INFO:teuthology.orchestra.run.smithi133.stdout: librados2-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:32:21.639 INFO:teuthology.orchestra.run.smithi133.stdout: librbd1-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:32:21.639 INFO:teuthology.orchestra.run.smithi133.stdout:Installed: 2023-05-08T03:32:21.639 INFO:teuthology.orchestra.run.smithi133.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-05-08T03:32:21.639 INFO:teuthology.orchestra.run.smithi133.stdout: automake-1.16.1-7.el8.noarch 2023-05-08T03:32:21.639 INFO:teuthology.orchestra.run.smithi133.stdout: bison-3.0.4-10.el8.x86_64 2023-05-08T03:32:21.640 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:32:21.640 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-base-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:32:21.640 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-common-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:32:21.640 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-fuse-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:32:21.640 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-grafana-dashboards-2:18.0.0-3786.g4b086ba5.el8.noarch 2023-05-08T03:32:21.640 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-immutable-object-cache-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:32:21.640 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mds-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:32:21.641 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:32:21.641 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-cephadm-2:18.0.0-3786.g4b086ba5.el8.noarch 2023-05-08T03:32:21.641 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-dashboard-2:18.0.0-3786.g4b086ba5.el8.noarch 2023-05-08T03:32:21.641 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-diskprediction-local-2:18.0.0-3786.g4b086ba5.el8.noarch 2023-05-08T03:32:21.641 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-modules-core-2:18.0.0-3786.g4b086ba5.el8.noarch 2023-05-08T03:32:21.642 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-rook-2:18.0.0-3786.g4b086ba5.el8.noarch 2023-05-08T03:32:21.642 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mon-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:32:21.642 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-osd-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:32:21.642 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-prometheus-alerts-2:18.0.0-3786.g4b086ba5.el8.noarch 2023-05-08T03:32:21.642 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-radosgw-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:32:21.642 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-selinux-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:32:21.642 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-test-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:32:21.642 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-volume-2:18.0.0-3786.g4b086ba5.el8.noarch 2023-05-08T03:32:21.643 INFO:teuthology.orchestra.run.smithi133.stdout: cephadm-2:18.0.0-3786.g4b086ba5.el8.noarch 2023-05-08T03:32:21.643 INFO:teuthology.orchestra.run.smithi133.stdout: cephfs-mirror-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:32:21.643 INFO:teuthology.orchestra.run.smithi133.stdout: cephfs-top-2:18.0.0-3786.g4b086ba5.el8.noarch 2023-05-08T03:32:21.643 INFO:teuthology.orchestra.run.smithi133.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-05-08T03:32:21.643 INFO:teuthology.orchestra.run.smithi133.stdout: flex-2.6.1-9.el8.x86_64 2023-05-08T03:32:21.643 INFO:teuthology.orchestra.run.smithi133.stdout: fuse-2.9.7-15.el8.x86_64 2023-05-08T03:32:21.643 INFO:teuthology.orchestra.run.smithi133.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-05-08T03:32:21.644 INFO:teuthology.orchestra.run.smithi133.stdout: jq-1.6-3.el8.x86_64 2023-05-08T03:32:21.644 INFO:teuthology.orchestra.run.smithi133.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-05-08T03:32:21.644 INFO:teuthology.orchestra.run.smithi133.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-05-08T03:32:21.644 INFO:teuthology.orchestra.run.smithi133.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-05-08T03:32:21.644 INFO:teuthology.orchestra.run.smithi133.stdout: libcephfs-devel-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:32:21.644 INFO:teuthology.orchestra.run.smithi133.stdout: libcephfs2-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:32:21.644 INFO:teuthology.orchestra.run.smithi133.stdout: libcephsqlite-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:32:21.645 INFO:teuthology.orchestra.run.smithi133.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-05-08T03:32:21.645 INFO:teuthology.orchestra.run.smithi133.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-05-08T03:32:21.645 INFO:teuthology.orchestra.run.smithi133.stdout: liboath-2.6.2-3.el8.x86_64 2023-05-08T03:32:21.645 INFO:teuthology.orchestra.run.smithi133.stdout: libpq-13.5-1.el8.x86_64 2023-05-08T03:32:21.645 INFO:teuthology.orchestra.run.smithi133.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-05-08T03:32:21.645 INFO:teuthology.orchestra.run.smithi133.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-05-08T03:32:21.645 INFO:teuthology.orchestra.run.smithi133.stdout: librados-devel-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:32:21.646 INFO:teuthology.orchestra.run.smithi133.stdout: libradosstriper1-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:32:21.646 INFO:teuthology.orchestra.run.smithi133.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-05-08T03:32:21.646 INFO:teuthology.orchestra.run.smithi133.stdout: librgw2-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:32:21.646 INFO:teuthology.orchestra.run.smithi133.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-05-08T03:32:21.646 INFO:teuthology.orchestra.run.smithi133.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-05-08T03:32:21.646 INFO:teuthology.orchestra.run.smithi133.stdout: libtool-2.4.6-25.el8.x86_64 2023-05-08T03:32:21.646 INFO:teuthology.orchestra.run.smithi133.stdout: libunwind-1.3.1-3.el8.x86_64 2023-05-08T03:32:21.646 INFO:teuthology.orchestra.run.smithi133.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-05-08T03:32:21.647 INFO:teuthology.orchestra.run.smithi133.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-05-08T03:32:21.647 INFO:teuthology.orchestra.run.smithi133.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-05-08T03:32:21.647 INFO:teuthology.orchestra.run.smithi133.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-05-08T03:32:21.647 INFO:teuthology.orchestra.run.smithi133.stdout: openblas-0.3.15-3.el8.x86_64 2023-05-08T03:32:21.647 INFO:teuthology.orchestra.run.smithi133.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-05-08T03:32:21.647 INFO:teuthology.orchestra.run.smithi133.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-05-08T03:32:21.647 INFO:teuthology.orchestra.run.smithi133.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-05-08T03:32:21.647 INFO:teuthology.orchestra.run.smithi133.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-05-08T03:32:21.648 INFO:teuthology.orchestra.run.smithi133.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-05-08T03:32:21.648 INFO:teuthology.orchestra.run.smithi133.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-05-08T03:32:21.648 INFO:teuthology.orchestra.run.smithi133.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-05-08T03:32:21.648 INFO:teuthology.orchestra.run.smithi133.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-05-08T03:32:21.648 INFO:teuthology.orchestra.run.smithi133.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-05-08T03:32:21.648 INFO:teuthology.orchestra.run.smithi133.stdout: python3-babel-2.5.1-7.el8.noarch 2023-05-08T03:32:21.648 INFO:teuthology.orchestra.run.smithi133.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-05-08T03:32:21.649 INFO:teuthology.orchestra.run.smithi133.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-05-08T03:32:21.649 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-05-08T03:32:21.649 INFO:teuthology.orchestra.run.smithi133.stdout: python3-ceph-argparse-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:32:21.649 INFO:teuthology.orchestra.run.smithi133.stdout: python3-ceph-common-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:32:21.649 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cephfs-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:32:21.649 INFO:teuthology.orchestra.run.smithi133.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-05-08T03:32:21.649 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-05-08T03:32:21.650 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-05-08T03:32:21.650 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-05-08T03:32:21.650 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-05-08T03:32:21.650 INFO:teuthology.orchestra.run.smithi133.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-05-08T03:32:21.650 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco-6.2-6.el8.noarch 2023-05-08T03:32:21.650 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-05-08T03:32:21.651 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-05-08T03:32:21.651 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-05-08T03:32:21.651 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-05-08T03:32:21.651 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-05-08T03:32:21.651 INFO:teuthology.orchestra.run.smithi133.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-05-08T03:32:21.651 INFO:teuthology.orchestra.run.smithi133.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-05-08T03:32:21.651 INFO:teuthology.orchestra.run.smithi133.stdout: python3-mako-1.0.6-13.el8.noarch 2023-05-08T03:32:21.652 INFO:teuthology.orchestra.run.smithi133.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-05-08T03:32:21.652 INFO:teuthology.orchestra.run.smithi133.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-05-08T03:32:21.652 INFO:teuthology.orchestra.run.smithi133.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-05-08T03:32:21.652 INFO:teuthology.orchestra.run.smithi133.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-05-08T03:32:21.652 INFO:teuthology.orchestra.run.smithi133.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-05-08T03:32:21.652 INFO:teuthology.orchestra.run.smithi133.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-05-08T03:32:21.652 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-05-08T03:32:21.652 INFO:teuthology.orchestra.run.smithi133.stdout: python3-portend-2.6-1.el8.noarch 2023-05-08T03:32:21.653 INFO:teuthology.orchestra.run.smithi133.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-05-08T03:32:21.653 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-05-08T03:32:21.653 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-05-08T03:32:21.653 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-05-08T03:32:21.653 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pycparser-2.14-14.el8.noarch 2023-05-08T03:32:21.653 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pytz-2017.2-9.el8.noarch 2023-05-08T03:32:21.654 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rados-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:32:21.654 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rbd-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:32:21.654 INFO:teuthology.orchestra.run.smithi133.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-05-08T03:32:21.654 INFO:teuthology.orchestra.run.smithi133.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-05-08T03:32:21.654 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rgw-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:32:21.654 INFO:teuthology.orchestra.run.smithi133.stdout: python3-routes-2.4.1-12.el8.noarch 2023-05-08T03:32:21.654 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rsa-4.8-1.el8.noarch 2023-05-08T03:32:21.654 INFO:teuthology.orchestra.run.smithi133.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-05-08T03:32:21.655 INFO:teuthology.orchestra.run.smithi133.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-05-08T03:32:21.655 INFO:teuthology.orchestra.run.smithi133.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-05-08T03:32:21.655 INFO:teuthology.orchestra.run.smithi133.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-05-08T03:32:21.655 INFO:teuthology.orchestra.run.smithi133.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-05-08T03:32:21.655 INFO:teuthology.orchestra.run.smithi133.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2023-05-08T03:32:21.655 INFO:teuthology.orchestra.run.smithi133.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-05-08T03:32:21.655 INFO:teuthology.orchestra.run.smithi133.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-05-08T03:32:21.656 INFO:teuthology.orchestra.run.smithi133.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-05-08T03:32:21.656 INFO:teuthology.orchestra.run.smithi133.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-05-08T03:32:21.656 INFO:teuthology.orchestra.run.smithi133.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-05-08T03:32:21.656 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-fuse-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:32:21.656 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-mirror-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:32:21.656 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-nbd-2:18.0.0-3786.g4b086ba5.el8.x86_64 2023-05-08T03:32:21.656 INFO:teuthology.orchestra.run.smithi133.stdout: socat-1.7.4.1-1.el8.x86_64 2023-05-08T03:32:21.656 INFO:teuthology.orchestra.run.smithi133.stdout: thrift-0.13.0-2.el8.x86_64 2023-05-08T03:32:21.657 INFO:teuthology.orchestra.run.smithi133.stdout: uuid-1.6.2-43.el8.x86_64 2023-05-08T03:32:21.657 INFO:teuthology.orchestra.run.smithi133.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-05-08T03:32:21.657 INFO:teuthology.orchestra.run.smithi133.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-05-08T03:32:21.657 INFO:teuthology.orchestra.run.smithi133.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-05-08T03:32:21.658 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-05-08T03:32:21.658 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2023-05-08T03:32:21.850 DEBUG:teuthology.parallel:result is None 2023-05-08T03:32:21.851 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4b086ba51b906a75bac7252b2239e8f120a38c8c 2023-05-08T03:32:21.990 DEBUG:teuthology.orchestra.run.smithi096:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-05-08T03:32:22.019 INFO:teuthology.orchestra.run.smithi096.stdout:18.0.0-3786.g4b086ba5.el8 2023-05-08T03:32:22.020 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-3786.g4b086ba5.el8 2023-05-08T03:32:22.020 INFO:teuthology.task.install:The correct ceph version 18.0.0-3786.g4b086ba5 is installed. 2023-05-08T03:32:22.021 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4b086ba51b906a75bac7252b2239e8f120a38c8c 2023-05-08T03:32:27.164 DEBUG:teuthology.orchestra.run.smithi133:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-05-08T03:32:27.192 INFO:teuthology.orchestra.run.smithi133.stdout:18.0.0-3786.g4b086ba5.el8 2023-05-08T03:32:27.193 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-3786.g4b086ba5.el8 2023-05-08T03:32:27.193 INFO:teuthology.task.install:The correct ceph version 18.0.0-3786.g4b086ba5 is installed. 2023-05-08T03:32:27.194 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4b086ba51b906a75bac7252b2239e8f120a38c8c 2023-05-08T03:32:32.336 DEBUG:teuthology.orchestra.run.smithi186:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-05-08T03:32:32.365 INFO:teuthology.orchestra.run.smithi186.stdout:18.0.0-3786.g4b086ba5.el8 2023-05-08T03:32:32.366 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-3786.g4b086ba5.el8 2023-05-08T03:32:32.366 INFO:teuthology.task.install:The correct ceph version 18.0.0-3786.g4b086ba5 is installed. 2023-05-08T03:32:32.367 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-05-08T03:32:32.367 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-05-08T03:32:32.368 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-05-08T03:32:32.414 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-05-08T03:32:32.415 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-05-08T03:32:32.462 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2023-05-08T03:32:32.463 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-05-08T03:32:32.509 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-05-08T03:32:32.510 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-05-08T03:32:32.510 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/usr/bin/daemon-helper 2023-05-08T03:32:32.539 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-05-08T03:32:32.607 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-05-08T03:32:32.608 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/usr/bin/daemon-helper 2023-05-08T03:32:32.638 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-05-08T03:32:32.708 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2023-05-08T03:32:32.708 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/usr/bin/daemon-helper 2023-05-08T03:32:32.740 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-05-08T03:32:32.810 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-05-08T03:32:32.811 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-05-08T03:32:32.811 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/usr/bin/adjust-ulimits 2023-05-08T03:32:32.840 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-05-08T03:32:32.909 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-05-08T03:32:32.910 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/usr/bin/adjust-ulimits 2023-05-08T03:32:32.941 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-05-08T03:32:33.009 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2023-05-08T03:32:33.010 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/usr/bin/adjust-ulimits 2023-05-08T03:32:33.042 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-05-08T03:32:33.113 INFO:teuthology.run_tasks:Running task cephadm... 2023-05-08T03:32:33.213 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '4b086ba51b906a75bac7252b2239e8f120a38c8c', 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2023-05-08T03:32:33.214 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c 2023-05-08T03:32:33.225 INFO:tasks.cephadm:Cluster fsid is f7ffcfb0-ed50-11ed-9b01-001a4aab830c 2023-05-08T03:32:33.226 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2023-05-08T03:32:33.227 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.96', 'mon.b': '172.21.15.133', 'mon.c': '172.21.15.186'} 2023-05-08T03:32:33.227 INFO:tasks.cephadm:First mon is mon.a on smithi096 2023-05-08T03:32:33.227 INFO:tasks.cephadm:First mgr is x 2023-05-08T03:32:33.227 INFO:tasks.cephadm:Normalizing hostnames... 2023-05-08T03:32:33.228 DEBUG:teuthology.orchestra.run.smithi096:> sudo hostname $(hostname -s) 2023-05-08T03:32:33.258 DEBUG:teuthology.orchestra.run.smithi133:> sudo hostname $(hostname -s) 2023-05-08T03:32:33.291 DEBUG:teuthology.orchestra.run.smithi186:> sudo hostname $(hostname -s) 2023-05-08T03:32:33.324 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2023-05-08T03:32:33.325 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4b086ba51b906a75bac7252b2239e8f120a38c8c 2023-05-08T03:32:38.470 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '4b086ba51b906a75bac7252b2239e8f120a38c8c', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic/69712/', 'root_build_cause': 'SCMTRIGGER', 'version': '18.0.0-3786-g4b086ba5', 'node_name': '172.21.2.4+braggi04', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic', 'package_manager_version': '18.0.0-3786.g4b086ba5'}, 'url': 'https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230506.143554/4b086ba51b906a75bac7252b2239e8f120a38c8c/centos/8/flavors/default/', 'distro_codename': None, 'modified': '2023-05-06 16:04:31.586184', 'distro_version': '8', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-vshankar-testing-20230506.143554', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/wip-vshankar-testing-20230506.143554/4b086ba51b906a75bac7252b2239e8f120a38c8c/centos/8/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2023-05-08T03:32:43.610 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref wip-vshankar-testing-20230506.143554, sha1 4b086ba51b906a75bac7252b2239e8f120a38c8c from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F8%2Fx86_64&flavor=default&sha1=4b086ba51b906a75bac7252b2239e8f120a38c8c 2023-05-08T03:32:43.611 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/wip-vshankar-testing-20230506.143554/4b086ba51b906a75bac7252b2239e8f120a38c8c/centos/8/x86_64/flavors/default/cephadm 2023-05-08T03:32:43.611 DEBUG:teuthology.orchestra.run.smithi096:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-vshankar-testing-20230506.143554/4b086ba51b906a75bac7252b2239e8f120a38c8c/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-05-08T03:32:43.951 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-rw-r--. 1 ubuntu ubuntu 384133 May 8 03:32 /home/ubuntu/cephtest/cephadm 2023-05-08T03:32:43.952 DEBUG:teuthology.orchestra.run.smithi133:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-vshankar-testing-20230506.143554/4b086ba51b906a75bac7252b2239e8f120a38c8c/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-05-08T03:32:44.310 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-rw-r--. 1 ubuntu ubuntu 384133 May 8 03:32 /home/ubuntu/cephtest/cephadm 2023-05-08T03:32:44.310 DEBUG:teuthology.orchestra.run.smithi186:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-vshankar-testing-20230506.143554/4b086ba51b906a75bac7252b2239e8f120a38c8c/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-05-08T03:32:44.643 INFO:teuthology.orchestra.run.smithi186.stdout:-rw-rw-r--. 1 ubuntu ubuntu 384133 May 8 03:32 /home/ubuntu/cephtest/cephadm 2023-05-08T03:32:44.644 DEBUG:teuthology.orchestra.run.smithi096:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-05-08T03:32:44.666 DEBUG:teuthology.orchestra.run.smithi133:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-05-08T03:32:44.688 DEBUG:teuthology.orchestra.run.smithi186:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-05-08T03:32:44.745 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c on all hosts... 2023-05-08T03:32:44.746 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c pull 2023-05-08T03:32:44.749 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c pull 2023-05-08T03:32:44.751 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c pull 2023-05-08T03:32:46.120 INFO:teuthology.orchestra.run.smithi096.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c... 2023-05-08T03:32:46.172 INFO:teuthology.orchestra.run.smithi186.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c... 2023-05-08T03:32:46.592 INFO:teuthology.orchestra.run.smithi133.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c... 2023-05-08T03:33:12.577 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-05-08T03:33:12.577 INFO:teuthology.orchestra.run.smithi133.stdout: "ceph_version": "ceph version 18.0.0-3786-g4b086ba5 (4b086ba51b906a75bac7252b2239e8f120a38c8c) reef (dev)", 2023-05-08T03:33:12.577 INFO:teuthology.orchestra.run.smithi133.stdout: "image_id": "1e3affc0cf31ec127eed3777958da2aa87f7b00db13603ccb21d27a8a24354cb", 2023-05-08T03:33:12.577 INFO:teuthology.orchestra.run.smithi133.stdout: "repo_digests": [ 2023-05-08T03:33:12.577 INFO:teuthology.orchestra.run.smithi133.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af1cf28deb819b6a6463a001647f2e66bb0b426159e8b280ae575e4c7336676d" 2023-05-08T03:33:12.578 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2023-05-08T03:33:12.578 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-05-08T03:33:32.524 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2023-05-08T03:33:32.525 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph_version": "ceph version 18.0.0-3786-g4b086ba5 (4b086ba51b906a75bac7252b2239e8f120a38c8c) reef (dev)", 2023-05-08T03:33:32.525 INFO:teuthology.orchestra.run.smithi096.stdout: "image_id": "1e3affc0cf31ec127eed3777958da2aa87f7b00db13603ccb21d27a8a24354cb", 2023-05-08T03:33:32.525 INFO:teuthology.orchestra.run.smithi096.stdout: "repo_digests": [ 2023-05-08T03:33:32.525 INFO:teuthology.orchestra.run.smithi096.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af1cf28deb819b6a6463a001647f2e66bb0b426159e8b280ae575e4c7336676d" 2023-05-08T03:33:32.526 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2023-05-08T03:33:32.526 INFO:teuthology.orchestra.run.smithi096.stdout:} 2023-05-08T03:33:32.765 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2023-05-08T03:33:32.766 INFO:teuthology.orchestra.run.smithi186.stdout: "ceph_version": "ceph version 18.0.0-3786-g4b086ba5 (4b086ba51b906a75bac7252b2239e8f120a38c8c) reef (dev)", 2023-05-08T03:33:32.766 INFO:teuthology.orchestra.run.smithi186.stdout: "image_id": "1e3affc0cf31ec127eed3777958da2aa87f7b00db13603ccb21d27a8a24354cb", 2023-05-08T03:33:32.766 INFO:teuthology.orchestra.run.smithi186.stdout: "repo_digests": [ 2023-05-08T03:33:32.766 INFO:teuthology.orchestra.run.smithi186.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:af1cf28deb819b6a6463a001647f2e66bb0b426159e8b280ae575e4c7336676d" 2023-05-08T03:33:32.766 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2023-05-08T03:33:32.766 INFO:teuthology.orchestra.run.smithi186.stdout:} 2023-05-08T03:33:32.785 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /etc/ceph 2023-05-08T03:33:32.816 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /etc/ceph 2023-05-08T03:33:32.853 DEBUG:teuthology.orchestra.run.smithi186:> sudo mkdir -p /etc/ceph 2023-05-08T03:33:32.885 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 777 /etc/ceph 2023-05-08T03:33:32.912 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 777 /etc/ceph 2023-05-08T03:33:32.944 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod 777 /etc/ceph 2023-05-08T03:33:32.973 INFO:tasks.cephadm:Writing seed config... 2023-05-08T03:33:32.974 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2023-05-08T03:33:32.974 INFO:tasks.cephadm: override: [client] debug client = 20 2023-05-08T03:33:32.975 INFO:tasks.cephadm: override: [client] debug ms = 1 2023-05-08T03:33:32.975 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2023-05-08T03:33:32.975 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2023-05-08T03:33:32.976 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2023-05-08T03:33:32.976 INFO:tasks.cephadm: override: [mds] debug mds = 20 2023-05-08T03:33:32.976 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2023-05-08T03:33:32.976 INFO:tasks.cephadm: override: [mds] debug ms = 1 2023-05-08T03:33:32.977 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2023-05-08T03:33:32.977 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2023-05-08T03:33:32.978 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2023-05-08T03:33:32.978 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2023-05-08T03:33:32.978 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2023-05-08T03:33:32.979 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2023-05-08T03:33:32.979 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2023-05-08T03:33:32.979 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2023-05-08T03:33:32.979 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2023-05-08T03:33:32.980 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2023-05-08T03:33:32.980 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2023-05-08T03:33:32.980 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2023-05-08T03:33:32.980 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2023-05-08T03:33:32.981 INFO:tasks.cephadm: override: [mgr] debug cephsqlite = 20 2023-05-08T03:33:32.981 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2023-05-08T03:33:32.981 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2023-05-08T03:33:32.981 INFO:tasks.cephadm: override: [mon] debug mon = 20 2023-05-08T03:33:32.982 INFO:tasks.cephadm: override: [mon] debug ms = 1 2023-05-08T03:33:32.982 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2023-05-08T03:33:32.982 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2023-05-08T03:33:32.982 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2023-05-08T03:33:32.982 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2023-05-08T03:33:32.983 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2023-05-08T03:33:32.983 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2023-05-08T03:33:32.983 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2023-05-08T03:33:32.983 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2023-05-08T03:33:32.984 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2023-05-08T03:33:32.984 INFO:tasks.cephadm: override: [osd] debug ms = 1 2023-05-08T03:33:32.984 INFO:tasks.cephadm: override: [osd] debug osd = 20 2023-05-08T03:33:32.984 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2023-05-08T03:33:32.984 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2023-05-08T03:33:32.985 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2023-05-08T03:33:32.985 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2023-05-08T03:33:32.985 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2023-05-08T03:33:32.985 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2023-05-08T03:33:32.985 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2023-05-08T03:33:32.986 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2023-05-08T03:33:32.986 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2023-05-08T03:33:32.987 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-05-08T03:33:32.987 DEBUG:teuthology.orchestra.run.smithi096:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2023-05-08T03:33:33.004 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = f7ffcfb0-ed50-11ed-9b01-001a4aab830c ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug cephsqlite = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_bal_replicate_threshold = 1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2023-05-08T03:33:33.005 DEBUG:teuthology.orchestra.run.smithi096:mon.a> sudo journalctl -f -n 0 -u ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c@mon.a.service 2023-05-08T03:33:33.046 DEBUG:teuthology.orchestra.run.smithi096:mgr.x> sudo journalctl -f -n 0 -u ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c@mgr.x.service 2023-05-08T03:33:33.072 INFO:journalctl@ceph.mon.a.smithi096.stdout:-- Logs begin at Mon 2023-05-08 03:07:36 UTC. -- 2023-05-08T03:33:33.073 INFO:tasks.cephadm:Bootstrapping... 2023-05-08T03:33:33.073 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c -v bootstrap --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.96 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2023-05-08T03:33:33.097 INFO:journalctl@ceph.mgr.x.smithi096.stdout:-- Logs begin at Mon 2023-05-08 03:07:36 UTC. -- 2023-05-08T03:33:33.319 INFO:teuthology.orchestra.run.smithi096.stdout:-------------------------------------------------------------------------------- 2023-05-08T03:33:33.320 INFO:teuthology.orchestra.run.smithi096.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c', '-v', 'bootstrap', '--fsid', 'f7ffcfb0-ed50-11ed-9b01-001a4aab830c', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.96', '--skip-admin-label'] 2023-05-08T03:33:33.479 INFO:teuthology.orchestra.run.smithi096.stdout:/bin/podman: stdout 4.1.1 2023-05-08T03:33:33.480 INFO:teuthology.orchestra.run.smithi096.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2023-05-08T03:33:33.480 INFO:teuthology.orchestra.run.smithi096.stdout:Verifying podman|docker is present... 2023-05-08T03:33:33.623 INFO:teuthology.orchestra.run.smithi096.stdout:/bin/podman: stdout 4.1.1 2023-05-08T03:33:33.623 INFO:teuthology.orchestra.run.smithi096.stdout:Verifying lvm2 is present... 2023-05-08T03:33:33.624 INFO:teuthology.orchestra.run.smithi096.stdout:Verifying time synchronization is in place... 2023-05-08T03:33:33.630 INFO:teuthology.orchestra.run.smithi096.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-05-08T03:33:33.631 INFO:teuthology.orchestra.run.smithi096.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-05-08T03:33:33.636 INFO:teuthology.orchestra.run.smithi096.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-05-08T03:33:33.636 INFO:teuthology.orchestra.run.smithi096.stdout:systemctl: stdout inactive 2023-05-08T03:33:33.642 INFO:teuthology.orchestra.run.smithi096.stdout:systemctl: stdout enabled 2023-05-08T03:33:33.648 INFO:teuthology.orchestra.run.smithi096.stdout:systemctl: stdout active 2023-05-08T03:33:33.649 INFO:teuthology.orchestra.run.smithi096.stdout:Unit chronyd.service is enabled and running 2023-05-08T03:33:33.649 INFO:teuthology.orchestra.run.smithi096.stdout:Repeating the final host check... 2023-05-08T03:33:33.791 INFO:teuthology.orchestra.run.smithi096.stdout:/bin/podman: stdout 4.1.1 2023-05-08T03:33:33.791 INFO:teuthology.orchestra.run.smithi096.stdout:podman (/bin/podman) version 4.1.1 is present 2023-05-08T03:33:33.792 INFO:teuthology.orchestra.run.smithi096.stdout:systemctl is present 2023-05-08T03:33:33.792 INFO:teuthology.orchestra.run.smithi096.stdout:lvcreate is present 2023-05-08T03:33:33.797 INFO:teuthology.orchestra.run.smithi096.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-05-08T03:33:33.798 INFO:teuthology.orchestra.run.smithi096.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-05-08T03:33:33.803 INFO:teuthology.orchestra.run.smithi096.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-05-08T03:33:33.803 INFO:teuthology.orchestra.run.smithi096.stdout:systemctl: stdout inactive 2023-05-08T03:33:33.809 INFO:teuthology.orchestra.run.smithi096.stdout:systemctl: stdout enabled 2023-05-08T03:33:33.815 INFO:teuthology.orchestra.run.smithi096.stdout:systemctl: stdout active 2023-05-08T03:33:33.815 INFO:teuthology.orchestra.run.smithi096.stdout:Unit chronyd.service is enabled and running 2023-05-08T03:33:33.815 INFO:teuthology.orchestra.run.smithi096.stdout:Host looks OK 2023-05-08T03:33:33.815 INFO:teuthology.orchestra.run.smithi096.stdout:Cluster fsid: f7ffcfb0-ed50-11ed-9b01-001a4aab830c 2023-05-08T03:33:33.815 INFO:teuthology.orchestra.run.smithi096.stdout:Acquiring lock 140202557925864 on /run/cephadm/f7ffcfb0-ed50-11ed-9b01-001a4aab830c.lock 2023-05-08T03:33:33.816 INFO:teuthology.orchestra.run.smithi096.stdout:Lock 140202557925864 acquired on /run/cephadm/f7ffcfb0-ed50-11ed-9b01-001a4aab830c.lock 2023-05-08T03:33:33.816 INFO:teuthology.orchestra.run.smithi096.stdout:Verifying IP 172.21.15.96 port 3300 ... 2023-05-08T03:33:33.816 INFO:teuthology.orchestra.run.smithi096.stdout:Verifying IP 172.21.15.96 port 6789 ... 2023-05-08T03:33:33.816 INFO:teuthology.orchestra.run.smithi096.stdout:Base mon IP(s) is [172.21.15.96:3300, 172.21.15.96:6789], mon addrv is [v2:172.21.15.96:3300,v1:172.21.15.96:6789] 2023-05-08T03:33:33.819 INFO:teuthology.orchestra.run.smithi096.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp metric 100 2023-05-08T03:33:33.820 INFO:teuthology.orchestra.run.smithi096.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.96 metric 100 2023-05-08T03:33:33.822 INFO:teuthology.orchestra.run.smithi096.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2023-05-08T03:33:33.822 INFO:teuthology.orchestra.run.smithi096.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2023-05-08T03:33:33.822 INFO:teuthology.orchestra.run.smithi096.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2023-05-08T03:33:33.825 INFO:teuthology.orchestra.run.smithi096.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2023-05-08T03:33:33.825 INFO:teuthology.orchestra.run.smithi096.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2023-05-08T03:33:33.825 INFO:teuthology.orchestra.run.smithi096.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-05-08T03:33:33.825 INFO:teuthology.orchestra.run.smithi096.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2023-05-08T03:33:33.826 INFO:teuthology.orchestra.run.smithi096.stdout:/sbin/ip: stdout inet6 fe80::fa9a:6e2c:c102:867a/64 scope link noprefixroute 2023-05-08T03:33:33.826 INFO:teuthology.orchestra.run.smithi096.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-05-08T03:33:33.827 INFO:teuthology.orchestra.run.smithi096.stdout:Mon IP `172.21.15.96` is in CIDR network `172.21.0.0/20` 2023-05-08T03:33:33.827 INFO:teuthology.orchestra.run.smithi096.stdout:Mon IP `172.21.15.96` is in CIDR network `172.21.0.0/20` 2023-05-08T03:33:33.827 INFO:teuthology.orchestra.run.smithi096.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2023-05-08T03:33:33.827 INFO:teuthology.orchestra.run.smithi096.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2023-05-08T03:33:33.828 INFO:teuthology.orchestra.run.smithi096.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c... 2023-05-08T03:33:34.273 INFO:teuthology.orchestra.run.smithi096.stdout:/bin/podman: stdout 1e3affc0cf31ec127eed3777958da2aa87f7b00db13603ccb21d27a8a24354cb 2023-05-08T03:33:34.273 INFO:teuthology.orchestra.run.smithi096.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c... 2023-05-08T03:33:34.273 INFO:teuthology.orchestra.run.smithi096.stdout:/bin/podman: stderr Getting image source signatures 2023-05-08T03:33:34.274 INFO:teuthology.orchestra.run.smithi096.stdout:/bin/podman: stderr Copying blob sha256:ea570be4f2c2a39a83a7034d194c7493cd684a1799fc6afec354e227a042e0cf 2023-05-08T03:33:34.274 INFO:teuthology.orchestra.run.smithi096.stdout:/bin/podman: stderr Copying blob sha256:11122a0ac68afcf11385550f95359b06f4bd8601e8d5c44fa9722d85a8615c4b 2023-05-08T03:33:34.274 INFO:teuthology.orchestra.run.smithi096.stdout:/bin/podman: stderr Copying config sha256:1e3affc0cf31ec127eed3777958da2aa87f7b00db13603ccb21d27a8a24354cb 2023-05-08T03:33:34.274 INFO:teuthology.orchestra.run.smithi096.stdout:/bin/podman: stderr Writing manifest to image destination 2023-05-08T03:33:34.274 INFO:teuthology.orchestra.run.smithi096.stdout:/bin/podman: stderr Storing signatures 2023-05-08T03:33:36.328 INFO:teuthology.orchestra.run.smithi096.stdout:ceph: stdout ceph version 18.0.0-3786-g4b086ba5 (4b086ba51b906a75bac7252b2239e8f120a38c8c) reef (dev) 2023-05-08T03:33:36.328 INFO:teuthology.orchestra.run.smithi096.stdout:Ceph version: ceph version 18.0.0-3786-g4b086ba5 (4b086ba51b906a75bac7252b2239e8f120a38c8c) reef (dev) 2023-05-08T03:33:36.329 INFO:teuthology.orchestra.run.smithi096.stdout:Extracting ceph user uid/gid from container image... 2023-05-08T03:33:38.084 INFO:teuthology.orchestra.run.smithi096.stdout:stat: stdout 167 167 2023-05-08T03:33:38.084 INFO:teuthology.orchestra.run.smithi096.stdout:Creating initial keys... 2023-05-08T03:33:38.829 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph-authtool: stdout AQCSbVhklouoGhAAibYNc3qGdnXd6Kksod+7kA== 2023-05-08T03:33:39.480 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph-authtool: stdout AQCTbVhkYwLuCRAA9VhSoZcRHvFHbtiDvYgP3w== 2023-05-08T03:33:40.225 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph-authtool: stdout AQCTbVhkFfRmNBAAz1QxjdIHA4VcB87HnwWYHQ== 2023-05-08T03:33:40.226 INFO:teuthology.orchestra.run.smithi096.stdout:Creating initial monmap... 2023-05-08T03:33:40.988 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2023-05-08T03:33:40.989 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2023-05-08T03:33:40.989 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to f7ffcfb0-ed50-11ed-9b01-001a4aab830c 2023-05-08T03:33:40.989 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-05-08T03:33:40.989 INFO:teuthology.orchestra.run.smithi096.stdout:monmaptool for a [v2:172.21.15.96:3300,v1:172.21.15.96:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2023-05-08T03:33:40.989 INFO:teuthology.orchestra.run.smithi096.stdout:setting min_mon_release = pacific 2023-05-08T03:33:40.990 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/monmaptool: set fsid to f7ffcfb0-ed50-11ed-9b01-001a4aab830c 2023-05-08T03:33:40.990 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-05-08T03:33:40.990 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:33:40.990 INFO:teuthology.orchestra.run.smithi096.stdout:Creating mon... 2023-05-08T03:33:41.740 INFO:teuthology.orchestra.run.smithi096.stdout:create mon.a on 2023-05-08T03:33:41.835 INFO:teuthology.orchestra.run.smithi096.stdout:systemctl: stderr Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2023-05-08T03:33:41.921 INFO:teuthology.orchestra.run.smithi096.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2023-05-08T03:33:42.015 INFO:teuthology.orchestra.run.smithi096.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c.target → /etc/systemd/system/ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c.target. 2023-05-08T03:33:42.015 INFO:teuthology.orchestra.run.smithi096.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c.target → /etc/systemd/system/ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c.target. 2023-05-08T03:33:42.133 INFO:teuthology.orchestra.run.smithi096.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c@mon.a 2023-05-08T03:33:42.134 INFO:teuthology.orchestra.run.smithi096.stdout:systemctl: stderr Failed to reset failed state of unit ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c@mon.a.service: Unit ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c@mon.a.service not loaded. 2023-05-08T03:33:42.215 INFO:teuthology.orchestra.run.smithi096.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c.target.wants/ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c@mon.a.service → /etc/systemd/system/ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c@.service. 2023-05-08T03:33:42.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:42 smithi096 systemd[1]: Starting Ceph mon.a for f7ffcfb0-ed50-11ed-9b01-001a4aab830c... 2023-05-08T03:33:42.771 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:42 smithi096 podman[124114]: 2023-05-08T03:33:42.772 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:42 smithi096 bash[124114]: 34e0e006cfdca35b304b6cf0e5989229e31c16c33fad81845e1394fe9c469ff1 2023-05-08T03:33:42.819 INFO:teuthology.orchestra.run.smithi096.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-05-08T03:33:42.819 INFO:teuthology.orchestra.run.smithi096.stdout:systemctl: stdout disabled 2023-05-08T03:33:42.825 INFO:teuthology.orchestra.run.smithi096.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-05-08T03:33:42.826 INFO:teuthology.orchestra.run.smithi096.stdout:systemctl: stdout inactive 2023-05-08T03:33:42.826 INFO:teuthology.orchestra.run.smithi096.stdout:firewalld.service is not enabled 2023-05-08T03:33:42.826 INFO:teuthology.orchestra.run.smithi096.stdout:Not possible to enable service . firewalld.service is not available 2023-05-08T03:33:42.826 INFO:teuthology.orchestra.run.smithi096.stdout:Waiting for mon to start... 2023-05-08T03:33:42.827 INFO:teuthology.orchestra.run.smithi096.stdout:Waiting for mon... 2023-05-08T03:33:43.043 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:42 smithi096 ceph-mon[124153]: mkfs f7ffcfb0-ed50-11ed-9b01-001a4aab830c 2023-05-08T03:33:43.043 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:42 smithi096 ceph-mon[124153]: mon.a is new leader, mons a in quorum (ranks 0) 2023-05-08T03:33:43.043 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:42 smithi096 systemd[1]: Started Ceph mon.a for f7ffcfb0-ed50-11ed-9b01-001a4aab830c. 2023-05-08T03:33:43.776 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout cluster: 2023-05-08T03:33:43.776 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout id: f7ffcfb0-ed50-11ed-9b01-001a4aab830c 2023-05-08T03:33:43.777 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2023-05-08T03:33:43.777 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout 2023-05-08T03:33:43.777 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout services: 2023-05-08T03:33:43.777 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.621767s) 2023-05-08T03:33:43.777 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2023-05-08T03:33:43.777 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2023-05-08T03:33:43.777 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout 2023-05-08T03:33:43.778 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout data: 2023-05-08T03:33:43.778 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2023-05-08T03:33:43.778 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2023-05-08T03:33:43.778 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2023-05-08T03:33:43.778 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout pgs: 2023-05-08T03:33:43.778 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout 2023-05-08T03:33:43.778 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:43.308+0000 7fc3c0ac4700 1 Processor -- start 2023-05-08T03:33:43.778 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:43.308+0000 7fc3c0ac4700 1 -- start start 2023-05-08T03:33:43.779 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:43.309+0000 7fc3c0ac4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3bc105c20 0x7fc3bc106030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:33:43.779 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:43.309+0000 7fc3c0ac4700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3bc106570 con 0x7fc3bc105c20 2023-05-08T03:33:43.779 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:43.309+0000 7fc3ba59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3bc105c20 0x7fc3bc106030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:33:43.779 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:43.309+0000 7fc3ba59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3bc105c20 0x7fc3bc106030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39106/0 (socket says 172.21.15.96:39106) 2023-05-08T03:33:43.779 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:43.309+0000 7fc3ba59c700 1 -- 172.21.15.96:0/2979628667 learned_addr learned my addr 172.21.15.96:0/2979628667 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:33:43.779 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:43.309+0000 7fc3ba59c700 1 -- 172.21.15.96:0/2979628667 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3bc1066b0 con 0x7fc3bc105c20 2023-05-08T03:33:43.779 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:43.310+0000 7fc3ba59c700 1 --2- 172.21.15.96:0/2979628667 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3bc105c20 0x7fc3bc106030 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fc3b00098a0 tx=0x7fc3b0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9883472ec3620892 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:33:43.780 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:43.310+0000 7fc3b959a700 1 -- 172.21.15.96:0/2979628667 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc3b0004160 con 0x7fc3bc105c20 2023-05-08T03:33:43.780 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:43.310+0000 7fc3b959a700 1 -- 172.21.15.96:0/2979628667 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3b00042c0 con 0x7fc3bc105c20 2023-05-08T03:33:43.780 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:43.310+0000 7fc3b959a700 1 -- 172.21.15.96:0/2979628667 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc3b00045a0 con 0x7fc3bc105c20 2023-05-08T03:33:43.780 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:43.310+0000 7fc3c0ac4700 1 -- 172.21.15.96:0/2979628667 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3bc105c20 msgr2=0x7fc3bc106030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:33:43.780 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:43.310+0000 7fc3c0ac4700 1 --2- 172.21.15.96:0/2979628667 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3bc105c20 0x7fc3bc106030 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fc3b00098a0 tx=0x7fc3b0009bb0 comp rx=0 tx=0).stop 2023-05-08T03:33:43.780 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:43.310+0000 7fc3c0ac4700 1 -- 172.21.15.96:0/2979628667 shutdown_connections 2023-05-08T03:33:43.780 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:43.310+0000 7fc3c0ac4700 1 --2- 172.21.15.96:0/2979628667 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3bc105c20 0x7fc3bc106030 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:33:43.781 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:43.310+0000 7fc3c0ac4700 1 -- 172.21.15.96:0/2979628667 >> 172.21.15.96:0/2979628667 conn(0x7fc3bc1012b0 msgr2=0x7fc3bc1036c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:33:43.781 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:43.310+0000 7fc3c0ac4700 1 -- 172.21.15.96:0/2979628667 shutdown_connections 2023-05-08T03:33:43.781 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:43.310+0000 7fc3c0ac4700 1 -- 172.21.15.96:0/2979628667 wait complete. 2023-05-08T03:33:43.781 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:43.311+0000 7fc3c0ac4700 1 Processor -- start 2023-05-08T03:33:43.781 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:43.311+0000 7fc3c0ac4700 1 -- start start 2023-05-08T03:33:43.781 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:43.311+0000 7fc3c0ac4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3bc105c20 0x7fc3bc199060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:33:43.781 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:43.312+0000 7fc3c0ac4700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3bc1995a0 con 0x7fc3bc105c20 2023-05-08T03:33:43.781 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:43.312+0000 7fc3ba59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3bc105c20 0x7fc3bc199060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:33:43.782 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:43.312+0000 7fc3ba59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3bc105c20 0x7fc3bc199060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39108/0 (socket says 172.21.15.96:39108) 2023-05-08T03:33:43.782 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:43.312+0000 7fc3ba59c700 1 -- 172.21.15.96:0/3092775347 learned_addr learned my addr 172.21.15.96:0/3092775347 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:33:43.782 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:43.312+0000 7fc3ba59c700 1 -- 172.21.15.96:0/3092775347 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3b0009550 con 0x7fc3bc105c20 2023-05-08T03:33:43.782 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:43.312+0000 7fc3ba59c700 1 --2- 172.21.15.96:0/3092775347 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3bc105c20 0x7fc3bc199060 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc106950 tx=0x7fc3b0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:33:43.782 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:43.312+0000 7fc3ab7fe700 1 -- 172.21.15.96:0/3092775347 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc3b0011630 con 0x7fc3bc105c20 2023-05-08T03:33:43.782 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:43.312+0000 7fc3ab7fe700 1 -- 172.21.15.96:0/3092775347 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3b0011790 con 0x7fc3bc105c20 2023-05-08T03:33:43.782 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:43.312+0000 7fc3ab7fe700 1 -- 172.21.15.96:0/3092775347 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc3b0011a30 con 0x7fc3bc105c20 2023-05-08T03:33:43.783 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:43.312+0000 7fc3c0ac4700 1 -- 172.21.15.96:0/3092775347 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3bc107170 con 0x7fc3bc105c20 2023-05-08T03:33:43.783 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:43.312+0000 7fc3c0ac4700 1 -- 172.21.15.96:0/3092775347 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3bc106fe0 con 0x7fc3bc105c20 2023-05-08T03:33:43.783 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:43.312+0000 7fc3ab7fe700 1 -- 172.21.15.96:0/3092775347 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc3b0022070 con 0x7fc3bc105c20 2023-05-08T03:33:43.783 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:43.313+0000 7fc3ab7fe700 1 -- 172.21.15.96:0/3092775347 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fc3b001c450 con 0x7fc3bc105c20 2023-05-08T03:33:43.783 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:43.313+0000 7fc3c0ac4700 1 -- 172.21.15.96:0/3092775347 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3bc192850 con 0x7fc3bc105c20 2023-05-08T03:33:43.783 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:43.315+0000 7fc3ab7fe700 1 -- 172.21.15.96:0/3092775347 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7fc3b001b450 con 0x7fc3bc105c20 2023-05-08T03:33:43.783 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:43.385+0000 7fc3c0ac4700 1 -- 172.21.15.96:0/3092775347 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7fc3bc062220 con 0x7fc3bc105c20 2023-05-08T03:33:43.783 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:43.385+0000 7fc3ab7fe700 1 -- 172.21.15.96:0/3092775347 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+317 (secure 0 0 0) 0x7fc3bc062220 con 0x7fc3bc105c20 2023-05-08T03:33:43.784 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:43.386+0000 7fc3c0ac4700 1 -- 172.21.15.96:0/3092775347 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3bc105c20 msgr2=0x7fc3bc199060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:33:43.784 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:43.386+0000 7fc3c0ac4700 1 --2- 172.21.15.96:0/3092775347 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3bc105c20 0x7fc3bc199060 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc106950 tx=0x7fc3b0004750 comp rx=0 tx=0).stop 2023-05-08T03:33:43.784 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:43.386+0000 7fc3c0ac4700 1 -- 172.21.15.96:0/3092775347 shutdown_connections 2023-05-08T03:33:43.784 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:43.386+0000 7fc3c0ac4700 1 --2- 172.21.15.96:0/3092775347 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3bc105c20 0x7fc3bc199060 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:33:43.784 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:43.386+0000 7fc3c0ac4700 1 -- 172.21.15.96:0/3092775347 >> 172.21.15.96:0/3092775347 conn(0x7fc3bc1012b0 msgr2=0x7fc3bc18d680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:33:43.784 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:43.386+0000 7fc3c0ac4700 1 -- 172.21.15.96:0/3092775347 shutdown_connections 2023-05-08T03:33:43.784 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:43.386+0000 7fc3c0ac4700 1 -- 172.21.15.96:0/3092775347 wait complete. 2023-05-08T03:33:43.785 INFO:teuthology.orchestra.run.smithi096.stdout:mon is available 2023-05-08T03:33:43.785 INFO:teuthology.orchestra.run.smithi096.stdout:Assimilating anything we can from ceph.conf... 2023-05-08T03:33:44.018 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:43 smithi096 ceph-mon[124153]: mon.a is new leader, mons a in quorum (ranks 0) 2023-05-08T03:33:44.018 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:43 smithi096 ceph-mon[124153]: monmap e1: 1 mons at {a=[v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0]} removed_ranks: {} 2023-05-08T03:33:44.018 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:43 smithi096 ceph-mon[124153]: fsmap 2023-05-08T03:33:44.019 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:43 smithi096 ceph-mon[124153]: osdmap e1: 0 total, 0 up, 0 in 2023-05-08T03:33:44.019 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:43 smithi096 ceph-mon[124153]: mgrmap e1: no daemons active 2023-05-08T03:33:44.019 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:43 smithi096 ceph-mon[124153]: from='client.? 172.21.15.96:0/3092775347' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2023-05-08T03:33:44.719 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout 2023-05-08T03:33:44.720 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout [global] 2023-05-08T03:33:44.720 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout fsid = f7ffcfb0-ed50-11ed-9b01-001a4aab830c 2023-05-08T03:33:44.720 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.96:3300,v1:172.21.15.96:6789] 2023-05-08T03:33:44.720 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-05-08T03:33:44.720 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-05-08T03:33:44.721 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-05-08T03:33:44.721 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-05-08T03:33:44.721 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout 2023-05-08T03:33:44.721 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout [mgr] 2023-05-08T03:33:44.721 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-05-08T03:33:44.721 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout 2023-05-08T03:33:44.721 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout [osd] 2023-05-08T03:33:44.721 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-05-08T03:33:44.722 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-05-08T03:33:44.722 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-05-08T03:33:44.722 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-05-08T03:33:44.722 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-05-08T03:33:44.722 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:44.245+0000 7f8d9337e700 1 Processor -- start 2023-05-08T03:33:44.722 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:44.245+0000 7f8d9337e700 1 -- start start 2023-05-08T03:33:44.722 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:44.246+0000 7f8d9337e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d8c104560 0x7f8d8c106980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:33:44.723 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:44.246+0000 7f8d9337e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8c074230 con 0x7f8d8c104560 2023-05-08T03:33:44.723 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:44.246+0000 7f8d9111a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d8c104560 0x7f8d8c106980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:33:44.723 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:44.246+0000 7f8d9111a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d8c104560 0x7f8d8c106980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39110/0 (socket says 172.21.15.96:39110) 2023-05-08T03:33:44.723 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:44.246+0000 7f8d9111a700 1 -- 172.21.15.96:0/1938070340 learned_addr learned my addr 172.21.15.96:0/1938070340 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:33:44.723 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:44.246+0000 7f8d9111a700 1 -- 172.21.15.96:0/1938070340 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d8c074370 con 0x7f8d8c104560 2023-05-08T03:33:44.723 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:44.246+0000 7f8d9111a700 1 --2- 172.21.15.96:0/1938070340 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d8c104560 0x7f8d8c106980 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f8d880098a0 tx=0x7f8d88009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8e9a1d9615dcfd3 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:33:44.723 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:44.246+0000 7f8d7ffff700 1 -- 172.21.15.96:0/1938070340 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8d88004160 con 0x7f8d8c104560 2023-05-08T03:33:44.724 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:44.246+0000 7f8d7ffff700 1 -- 172.21.15.96:0/1938070340 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d880042c0 con 0x7f8d8c104560 2023-05-08T03:33:44.724 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:44.246+0000 7f8d7ffff700 1 -- 172.21.15.96:0/1938070340 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8d880045a0 con 0x7f8d8c104560 2023-05-08T03:33:44.724 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:44.247+0000 7f8d9337e700 1 -- 172.21.15.96:0/1938070340 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d8c104560 msgr2=0x7f8d8c106980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:33:44.724 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:44.247+0000 7f8d9337e700 1 --2- 172.21.15.96:0/1938070340 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d8c104560 0x7f8d8c106980 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f8d880098a0 tx=0x7f8d88009bb0 comp rx=0 tx=0).stop 2023-05-08T03:33:44.724 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:44.247+0000 7f8d9337e700 1 -- 172.21.15.96:0/1938070340 shutdown_connections 2023-05-08T03:33:44.724 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:44.247+0000 7f8d9337e700 1 --2- 172.21.15.96:0/1938070340 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d8c104560 0x7f8d8c106980 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:33:44.724 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:44.247+0000 7f8d9337e700 1 -- 172.21.15.96:0/1938070340 >> 172.21.15.96:0/1938070340 conn(0x7f8d8c100170 msgr2=0x7f8d8c1025a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:33:44.724 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:44.247+0000 7f8d9337e700 1 -- 172.21.15.96:0/1938070340 shutdown_connections 2023-05-08T03:33:44.725 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:44.247+0000 7f8d9337e700 1 -- 172.21.15.96:0/1938070340 wait complete. 2023-05-08T03:33:44.725 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:44.248+0000 7f8d9337e700 1 Processor -- start 2023-05-08T03:33:44.725 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:44.248+0000 7f8d9337e700 1 -- start start 2023-05-08T03:33:44.725 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:44.248+0000 7f8d9337e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d8c104560 0x7f8d8c19f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:33:44.725 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:44.248+0000 7f8d9337e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8c19fb60 con 0x7f8d8c104560 2023-05-08T03:33:44.725 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:44.248+0000 7f8d9111a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d8c104560 0x7f8d8c19f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:33:44.725 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:44.248+0000 7f8d9111a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d8c104560 0x7f8d8c19f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39112/0 (socket says 172.21.15.96:39112) 2023-05-08T03:33:44.726 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:44.248+0000 7f8d9111a700 1 -- 172.21.15.96:0/3013135045 learned_addr learned my addr 172.21.15.96:0/3013135045 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:33:44.726 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:44.248+0000 7f8d9111a700 1 -- 172.21.15.96:0/3013135045 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d88009550 con 0x7f8d8c104560 2023-05-08T03:33:44.726 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:44.248+0000 7f8d9111a700 1 --2- 172.21.15.96:0/3013135045 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d8c104560 0x7f8d8c19f620 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f8d88004000 tx=0x7f8d88004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:33:44.726 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:44.248+0000 7f8d7e7fc700 1 -- 172.21.15.96:0/3013135045 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8d88011630 con 0x7f8d8c104560 2023-05-08T03:33:44.726 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:44.248+0000 7f8d7e7fc700 1 -- 172.21.15.96:0/3013135045 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d88011790 con 0x7f8d8c104560 2023-05-08T03:33:44.726 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:44.248+0000 7f8d9337e700 1 -- 172.21.15.96:0/3013135045 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d8c107170 con 0x7f8d8c104560 2023-05-08T03:33:44.726 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:44.248+0000 7f8d7e7fc700 1 -- 172.21.15.96:0/3013135045 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8d88011a30 con 0x7f8d8c104560 2023-05-08T03:33:44.726 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:44.249+0000 7f8d9337e700 1 -- 172.21.15.96:0/3013135045 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d8c106fe0 con 0x7f8d8c104560 2023-05-08T03:33:44.727 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:44.249+0000 7f8d7e7fc700 1 -- 172.21.15.96:0/3013135045 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f8d88022070 con 0x7f8d8c104560 2023-05-08T03:33:44.727 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:44.249+0000 7f8d7e7fc700 1 -- 172.21.15.96:0/3013135045 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f8d8801c450 con 0x7f8d8c104560 2023-05-08T03:33:44.727 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:44.249+0000 7f8d9337e700 1 -- 172.21.15.96:0/3013135045 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d8c199840 con 0x7f8d8c104560 2023-05-08T03:33:44.727 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:44.252+0000 7f8d7e7fc700 1 -- 172.21.15.96:0/3013135045 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f8d8801b450 con 0x7f8d8c104560 2023-05-08T03:33:44.727 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:44.319+0000 7f8d9337e700 1 -- 172.21.15.96:0/3013135045 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f8d8c062220 con 0x7f8d8c104560 2023-05-08T03:33:44.727 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:44.322+0000 7f8d7e7fc700 1 -- 172.21.15.96:0/3013135045 <== mon.0 v2:172.21.15.96:3300/0 7 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8d8801b5f0 con 0x7f8d8c104560 2023-05-08T03:33:44.727 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:44.322+0000 7f8d7e7fc700 1 -- 172.21.15.96:0/3013135045 <== mon.0 v2:172.21.15.96:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+429 (secure 0 0 0) 0x7f8d8c062220 con 0x7f8d8c104560 2023-05-08T03:33:44.728 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:44.323+0000 7f8d9337e700 1 -- 172.21.15.96:0/3013135045 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d8c104560 msgr2=0x7f8d8c19f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:33:44.728 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:44.323+0000 7f8d9337e700 1 --2- 172.21.15.96:0/3013135045 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d8c104560 0x7f8d8c19f620 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f8d88004000 tx=0x7f8d88004750 comp rx=0 tx=0).stop 2023-05-08T03:33:44.728 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:44.323+0000 7f8d9337e700 1 -- 172.21.15.96:0/3013135045 shutdown_connections 2023-05-08T03:33:44.728 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:44.323+0000 7f8d9337e700 1 --2- 172.21.15.96:0/3013135045 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d8c104560 0x7f8d8c19f620 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:33:44.728 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:44.323+0000 7f8d9337e700 1 -- 172.21.15.96:0/3013135045 >> 172.21.15.96:0/3013135045 conn(0x7f8d8c100170 msgr2=0x7f8d8c101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:33:44.728 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:44.323+0000 7f8d9337e700 1 -- 172.21.15.96:0/3013135045 shutdown_connections 2023-05-08T03:33:44.728 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:44.323+0000 7f8d9337e700 1 -- 172.21.15.96:0/3013135045 wait complete. 2023-05-08T03:33:44.728 INFO:teuthology.orchestra.run.smithi096.stdout:Generating new minimal ceph.conf... 2023-05-08T03:33:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:44 smithi096 ceph-mon[124153]: from='client.? 172.21.15.96:0/3013135045' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-05-08T03:33:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:44 smithi096 ceph-mon[124153]: from='client.? 172.21.15.96:0/3013135045' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2023-05-08T03:33:45.660 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:45.160+0000 7f8b3fbbd700 1 Processor -- start 2023-05-08T03:33:45.661 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:45.160+0000 7f8b3fbbd700 1 -- start start 2023-05-08T03:33:45.661 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:45.160+0000 7f8b3fbbd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b38106730 0x7f8b38108b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:33:45.661 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:45.160+0000 7f8b3fbbd700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b38074270 con 0x7f8b38106730 2023-05-08T03:33:45.661 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:45.161+0000 7f8b3d959700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b38106730 0x7f8b38108b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:33:45.661 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:45.161+0000 7f8b3d959700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b38106730 0x7f8b38108b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39114/0 (socket says 172.21.15.96:39114) 2023-05-08T03:33:45.661 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:45.161+0000 7f8b3d959700 1 -- 172.21.15.96:0/1763534943 learned_addr learned my addr 172.21.15.96:0/1763534943 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:33:45.662 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:45.161+0000 7f8b3d959700 1 -- 172.21.15.96:0/1763534943 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b380743b0 con 0x7f8b38106730 2023-05-08T03:33:45.662 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:45.161+0000 7f8b3d959700 1 --2- 172.21.15.96:0/1763534943 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b38106730 0x7f8b38108b10 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f8b280098a0 tx=0x7f8b28009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98470f37e15675ee server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:33:45.662 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:45.161+0000 7f8b3c957700 1 -- 172.21.15.96:0/1763534943 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8b28004160 con 0x7f8b38106730 2023-05-08T03:33:45.662 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:45.161+0000 7f8b3c957700 1 -- 172.21.15.96:0/1763534943 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8b280042c0 con 0x7f8b38106730 2023-05-08T03:33:45.662 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:45.161+0000 7f8b3c957700 1 -- 172.21.15.96:0/1763534943 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8b28011a00 con 0x7f8b38106730 2023-05-08T03:33:45.662 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:45.162+0000 7f8b3fbbd700 1 -- 172.21.15.96:0/1763534943 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b38106730 msgr2=0x7f8b38108b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:33:45.662 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:45.162+0000 7f8b3fbbd700 1 --2- 172.21.15.96:0/1763534943 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b38106730 0x7f8b38108b10 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f8b280098a0 tx=0x7f8b28009bb0 comp rx=0 tx=0).stop 2023-05-08T03:33:45.663 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:45.162+0000 7f8b3fbbd700 1 -- 172.21.15.96:0/1763534943 shutdown_connections 2023-05-08T03:33:45.663 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:45.162+0000 7f8b3fbbd700 1 --2- 172.21.15.96:0/1763534943 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b38106730 0x7f8b38108b10 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:33:45.663 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:45.162+0000 7f8b3fbbd700 1 -- 172.21.15.96:0/1763534943 >> 172.21.15.96:0/1763534943 conn(0x7f8b38100170 msgr2=0x7f8b381025a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:33:45.663 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:45.162+0000 7f8b3fbbd700 1 -- 172.21.15.96:0/1763534943 shutdown_connections 2023-05-08T03:33:45.663 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:45.162+0000 7f8b3fbbd700 1 -- 172.21.15.96:0/1763534943 wait complete. 2023-05-08T03:33:45.664 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:45.162+0000 7f8b3fbbd700 1 Processor -- start 2023-05-08T03:33:45.664 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:45.162+0000 7f8b3fbbd700 1 -- start start 2023-05-08T03:33:45.664 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:45.163+0000 7f8b3fbbd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b38106730 0x7f8b38106090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:33:45.664 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:45.163+0000 7f8b3fbbd700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b381065d0 con 0x7f8b38106730 2023-05-08T03:33:45.664 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:45.163+0000 7f8b3d959700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b38106730 0x7f8b38106090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:33:45.664 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:45.163+0000 7f8b3d959700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b38106730 0x7f8b38106090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39116/0 (socket says 172.21.15.96:39116) 2023-05-08T03:33:45.664 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:45.163+0000 7f8b3d959700 1 -- 172.21.15.96:0/3260905188 learned_addr learned my addr 172.21.15.96:0/3260905188 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:33:45.665 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:45.163+0000 7f8b3d959700 1 -- 172.21.15.96:0/3260905188 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b28009550 con 0x7f8b38106730 2023-05-08T03:33:45.665 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:45.163+0000 7f8b3d959700 1 --2- 172.21.15.96:0/3260905188 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b38106730 0x7f8b38106090 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f8b28009fb0 tx=0x7f8b28011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:33:45.665 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:45.163+0000 7f8b2effd700 1 -- 172.21.15.96:0/3260905188 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8b28003930 con 0x7f8b38106730 2023-05-08T03:33:45.665 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:45.163+0000 7f8b2effd700 1 -- 172.21.15.96:0/3260905188 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8b28003a90 con 0x7f8b38106730 2023-05-08T03:33:45.665 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:45.163+0000 7f8b3fbbd700 1 -- 172.21.15.96:0/3260905188 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b38109eb0 con 0x7f8b38106730 2023-05-08T03:33:45.665 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:45.163+0000 7f8b2effd700 1 -- 172.21.15.96:0/3260905188 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8b280195e0 con 0x7f8b38106730 2023-05-08T03:33:45.665 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:45.163+0000 7f8b3fbbd700 1 -- 172.21.15.96:0/3260905188 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b38109d20 con 0x7f8b38106730 2023-05-08T03:33:45.666 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:45.163+0000 7f8b2effd700 1 -- 172.21.15.96:0/3260905188 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f8b28019bc0 con 0x7f8b38106730 2023-05-08T03:33:45.666 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:45.163+0000 7f8b2effd700 1 -- 172.21.15.96:0/3260905188 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f8b280243f0 con 0x7f8b38106730 2023-05-08T03:33:45.666 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:45.164+0000 7f8b3fbbd700 1 -- 172.21.15.96:0/3260905188 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b38062220 con 0x7f8b38106730 2023-05-08T03:33:45.666 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:45.167+0000 7f8b2effd700 1 -- 172.21.15.96:0/3260905188 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f8b28003c00 con 0x7f8b38106730 2023-05-08T03:33:45.666 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:45.233+0000 7f8b3fbbd700 1 -- 172.21.15.96:0/3260905188 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f8b38105500 con 0x7f8b38106730 2023-05-08T03:33:45.666 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:45.233+0000 7f8b2effd700 1 -- 172.21.15.96:0/3260905188 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7f8b2801a9d0 con 0x7f8b38106730 2023-05-08T03:33:45.666 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:45.234+0000 7f8b3fbbd700 1 -- 172.21.15.96:0/3260905188 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b38106730 msgr2=0x7f8b38106090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:33:45.667 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:45.234+0000 7f8b3fbbd700 1 --2- 172.21.15.96:0/3260905188 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b38106730 0x7f8b38106090 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f8b28009fb0 tx=0x7f8b28011ad0 comp rx=0 tx=0).stop 2023-05-08T03:33:45.667 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:45.234+0000 7f8b3fbbd700 1 -- 172.21.15.96:0/3260905188 shutdown_connections 2023-05-08T03:33:45.667 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:45.234+0000 7f8b3fbbd700 1 --2- 172.21.15.96:0/3260905188 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b38106730 0x7f8b38106090 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:33:45.667 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:45.234+0000 7f8b3fbbd700 1 -- 172.21.15.96:0/3260905188 >> 172.21.15.96:0/3260905188 conn(0x7f8b38100170 msgr2=0x7f8b38100ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:33:45.667 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:45.234+0000 7f8b3fbbd700 1 -- 172.21.15.96:0/3260905188 shutdown_connections 2023-05-08T03:33:45.667 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:45.234+0000 7f8b3fbbd700 1 -- 172.21.15.96:0/3260905188 wait complete. 2023-05-08T03:33:45.667 INFO:teuthology.orchestra.run.smithi096.stdout:Restarting the monitor... 2023-05-08T03:33:45.986 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:45 smithi096 systemd[1]: Stopping Ceph mon.a for f7ffcfb0-ed50-11ed-9b01-001a4aab830c... 2023-05-08T03:33:45.987 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:45 smithi096 ceph-mon[124153]: from='client.? 172.21.15.96:0/3260905188' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:33:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:45 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mon-a[124129]: 2023-05-08T03:33:45.984+0000 7f1e23493700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-05-08T03:33:46.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:45 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mon-a[124129]: 2023-05-08T03:33:45.984+0000 7f1e23493700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-05-08T03:33:46.544 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:46 smithi096 bash[124502]: ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mon-a 2023-05-08T03:33:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:46 smithi096 systemd[1]: ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c@mon.a.service: Succeeded. 2023-05-08T03:33:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:46 smithi096 systemd[1]: Stopped Ceph mon.a for f7ffcfb0-ed50-11ed-9b01-001a4aab830c. 2023-05-08T03:33:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:46 smithi096 systemd[1]: Starting Ceph mon.a for f7ffcfb0-ed50-11ed-9b01-001a4aab830c... 2023-05-08T03:33:47.311 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 podman[124626]: 2023-05-08T03:33:47.312 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: set uid:gid to 167:167 (ceph:ceph) 2023-05-08T03:33:47.312 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: ceph version 18.0.0-3786-g4b086ba5 (4b086ba51b906a75bac7252b2239e8f120a38c8c) reef (dev), process ceph-mon, pid 7 2023-05-08T03:33:47.312 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: pidfile_write: ignore empty --pid-file 2023-05-08T03:33:47.312 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 bash[124626]: 73cca45fb9262ba88d7adca6b94f118d159fa0dbb6722f42f5a8dc3f24fa49f8 2023-05-08T03:33:47.312 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: load: jerasure load: lrc 2023-05-08T03:33:47.312 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: RocksDB version: 7.9.2 2023-05-08T03:33:47.313 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Git sha 0 2023-05-08T03:33:47.313 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Compile date 2023-05-06 14:52:08 2023-05-08T03:33:47.313 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: DB SUMMARY 2023-05-08T03:33:47.313 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: DB Session ID: Q8B303WVLVTYPE35I8BK 2023-05-08T03:33:47.313 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: CURRENT file: CURRENT 2023-05-08T03:33:47.313 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: IDENTITY file: IDENTITY 2023-05-08T03:33:47.313 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2023-05-08T03:33:47.314 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2023-05-08T03:33:47.314 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 99497 ; 2023-05-08T03:33:47.314 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.error_if_exists: 0 2023-05-08T03:33:47.314 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.create_if_missing: 0 2023-05-08T03:33:47.314 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.paranoid_checks: 1 2023-05-08T03:33:47.314 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.flush_verify_memtable_count: 1 2023-05-08T03:33:47.314 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-05-08T03:33:47.315 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-05-08T03:33:47.315 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.env: 0x558ca326c720 2023-05-08T03:33:47.315 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.fs: PosixFileSystem 2023-05-08T03:33:47.315 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.info_log: 0x558ca41ed460 2023-05-08T03:33:47.315 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.max_file_opening_threads: 16 2023-05-08T03:33:47.315 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.statistics: (nil) 2023-05-08T03:33:47.315 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.use_fsync: 0 2023-05-08T03:33:47.315 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.max_log_file_size: 0 2023-05-08T03:33:47.316 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-05-08T03:33:47.316 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.log_file_time_to_roll: 0 2023-05-08T03:33:47.316 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.keep_log_file_num: 1000 2023-05-08T03:33:47.316 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.recycle_log_file_num: 0 2023-05-08T03:33:47.316 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.allow_fallocate: 1 2023-05-08T03:33:47.316 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.allow_mmap_reads: 0 2023-05-08T03:33:47.316 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.allow_mmap_writes: 0 2023-05-08T03:33:47.317 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.use_direct_reads: 0 2023-05-08T03:33:47.317 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-05-08T03:33:47.317 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.create_missing_column_families: 0 2023-05-08T03:33:47.317 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.db_log_dir: 2023-05-08T03:33:47.317 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.wal_dir: 2023-05-08T03:33:47.317 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.table_cache_numshardbits: 6 2023-05-08T03:33:47.317 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.WAL_ttl_seconds: 0 2023-05-08T03:33:47.318 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.WAL_size_limit_MB: 0 2023-05-08T03:33:47.318 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-05-08T03:33:47.318 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-05-08T03:33:47.318 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.is_fd_close_on_exec: 1 2023-05-08T03:33:47.318 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.advise_random_on_open: 1 2023-05-08T03:33:47.318 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.db_write_buffer_size: 0 2023-05-08T03:33:47.318 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.write_buffer_manager: 0x558ca41a23c0 2023-05-08T03:33:47.319 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-05-08T03:33:47.319 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-05-08T03:33:47.319 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.use_adaptive_mutex: 0 2023-05-08T03:33:47.319 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.rate_limiter: (nil) 2023-05-08T03:33:47.319 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-05-08T03:33:47.319 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.wal_recovery_mode: 2 2023-05-08T03:33:47.319 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.enable_thread_tracking: 0 2023-05-08T03:33:47.319 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.enable_pipelined_write: 0 2023-05-08T03:33:47.320 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.unordered_write: 0 2023-05-08T03:33:47.320 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-05-08T03:33:47.320 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-05-08T03:33:47.320 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-05-08T03:33:47.320 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-05-08T03:33:47.320 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.row_cache: None 2023-05-08T03:33:47.320 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.wal_filter: None 2023-05-08T03:33:47.321 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-05-08T03:33:47.321 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.allow_ingest_behind: 0 2023-05-08T03:33:47.321 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.two_write_queues: 0 2023-05-08T03:33:47.321 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.manual_wal_flush: 0 2023-05-08T03:33:47.321 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.wal_compression: 0 2023-05-08T03:33:47.321 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.atomic_flush: 0 2023-05-08T03:33:47.321 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-05-08T03:33:47.321 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.persist_stats_to_disk: 0 2023-05-08T03:33:47.322 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.write_dbid_to_manifest: 0 2023-05-08T03:33:47.322 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.log_readahead_size: 0 2023-05-08T03:33:47.322 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-05-08T03:33:47.322 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.best_efforts_recovery: 0 2023-05-08T03:33:47.322 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-05-08T03:33:47.322 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-05-08T03:33:47.323 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.allow_data_in_errors: 0 2023-05-08T03:33:47.323 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.db_host_id: __hostname__ 2023-05-08T03:33:47.324 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.enforce_single_del_contracts: true 2023-05-08T03:33:47.324 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.max_background_jobs: 2 2023-05-08T03:33:47.324 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.max_background_compactions: -1 2023-05-08T03:33:47.324 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.max_subcompactions: 1 2023-05-08T03:33:47.324 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-05-08T03:33:47.324 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-05-08T03:33:47.324 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.delayed_write_rate : 16777216 2023-05-08T03:33:47.325 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.max_total_wal_size: 0 2023-05-08T03:33:47.325 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-05-08T03:33:47.325 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.stats_dump_period_sec: 600 2023-05-08T03:33:47.325 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.stats_persist_period_sec: 600 2023-05-08T03:33:47.325 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-05-08T03:33:47.325 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.max_open_files: -1 2023-05-08T03:33:47.325 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.bytes_per_sync: 0 2023-05-08T03:33:47.326 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.wal_bytes_per_sync: 0 2023-05-08T03:33:47.326 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.strict_bytes_per_sync: 0 2023-05-08T03:33:47.326 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.compaction_readahead_size: 0 2023-05-08T03:33:47.326 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.max_background_flushes: -1 2023-05-08T03:33:47.326 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Compression algorithms supported: 2023-05-08T03:33:47.326 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-05-08T03:33:47.326 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: kZSTD supported: 0 2023-05-08T03:33:47.326 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: kXpressCompression supported: 0 2023-05-08T03:33:47.327 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: kLZ4HCCompression supported: 1 2023-05-08T03:33:47.327 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: kZlibCompression supported: 1 2023-05-08T03:33:47.327 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: kSnappyCompression supported: 1 2023-05-08T03:33:47.327 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: kLZ4Compression supported: 1 2023-05-08T03:33:47.327 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: kBZip2Compression supported: 0 2023-05-08T03:33:47.327 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Fast CRC32 supported: Supported on x86 2023-05-08T03:33:47.327 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: DMutex implementation: pthread_mutex_t 2023-05-08T03:33:47.327 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-05-08T03:33:47.328 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-05-08T03:33:47.328 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-05-08T03:33:47.328 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.merge_operator: 2023-05-08T03:33:47.328 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.compaction_filter: None 2023-05-08T03:33:47.328 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.compaction_filter_factory: None 2023-05-08T03:33:47.328 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.sst_partitioner_factory: None 2023-05-08T03:33:47.328 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.memtable_factory: SkipListFactory 2023-05-08T03:33:47.328 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.table_factory: BlockBasedTable 2023-05-08T03:33:47.329 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x558ca41ed560) 2023-05-08T03:33:47.329 INFO:journalctl@ceph.mon.a.smithi096.stdout: cache_index_and_filter_blocks: 1 2023-05-08T03:33:47.329 INFO:journalctl@ceph.mon.a.smithi096.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-05-08T03:33:47.329 INFO:journalctl@ceph.mon.a.smithi096.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-05-08T03:33:47.329 INFO:journalctl@ceph.mon.a.smithi096.stdout: pin_top_level_index_and_filter: 1 2023-05-08T03:33:47.329 INFO:journalctl@ceph.mon.a.smithi096.stdout: index_type: 0 2023-05-08T03:33:47.329 INFO:journalctl@ceph.mon.a.smithi096.stdout: data_block_index_type: 0 2023-05-08T03:33:47.330 INFO:journalctl@ceph.mon.a.smithi096.stdout: index_shortening: 1 2023-05-08T03:33:47.330 INFO:journalctl@ceph.mon.a.smithi096.stdout: data_block_hash_table_util_ratio: 0.750000 2023-05-08T03:33:47.330 INFO:journalctl@ceph.mon.a.smithi096.stdout: checksum: 4 2023-05-08T03:33:47.330 INFO:journalctl@ceph.mon.a.smithi096.stdout: no_block_cache: 0 2023-05-08T03:33:47.330 INFO:journalctl@ceph.mon.a.smithi096.stdout: block_cache: 0x558ca4243350 2023-05-08T03:33:47.330 INFO:journalctl@ceph.mon.a.smithi096.stdout: block_cache_name: BinnedLRUCache 2023-05-08T03:33:47.330 INFO:journalctl@ceph.mon.a.smithi096.stdout: block_cache_options: 2023-05-08T03:33:47.331 INFO:journalctl@ceph.mon.a.smithi096.stdout: capacity : 536870912 2023-05-08T03:33:47.331 INFO:journalctl@ceph.mon.a.smithi096.stdout: num_shard_bits : 4 2023-05-08T03:33:47.331 INFO:journalctl@ceph.mon.a.smithi096.stdout: strict_capacity_limit : 0 2023-05-08T03:33:47.331 INFO:journalctl@ceph.mon.a.smithi096.stdout: high_pri_pool_ratio: 0.000 2023-05-08T03:33:47.331 INFO:journalctl@ceph.mon.a.smithi096.stdout: block_cache_compressed: (nil) 2023-05-08T03:33:47.331 INFO:journalctl@ceph.mon.a.smithi096.stdout: persistent_cache: (nil) 2023-05-08T03:33:47.331 INFO:journalctl@ceph.mon.a.smithi096.stdout: block_size: 4096 2023-05-08T03:33:47.331 INFO:journalctl@ceph.mon.a.smithi096.stdout: block_size_deviation: 10 2023-05-08T03:33:47.332 INFO:journalctl@ceph.mon.a.smithi096.stdout: block_restart_interval: 16 2023-05-08T03:33:47.332 INFO:journalctl@ceph.mon.a.smithi096.stdout: index_block_restart_interval: 1 2023-05-08T03:33:47.332 INFO:journalctl@ceph.mon.a.smithi096.stdout: metadata_block_size: 4096 2023-05-08T03:33:47.332 INFO:journalctl@ceph.mon.a.smithi096.stdout: partition_filters: 0 2023-05-08T03:33:47.332 INFO:journalctl@ceph.mon.a.smithi096.stdout: use_delta_encoding: 1 2023-05-08T03:33:47.332 INFO:journalctl@ceph.mon.a.smithi096.stdout: filter_policy: bloomfilter 2023-05-08T03:33:47.332 INFO:journalctl@ceph.mon.a.smithi096.stdout: whole_key_filtering: 1 2023-05-08T03:33:47.332 INFO:journalctl@ceph.mon.a.smithi096.stdout: verify_compression: 0 2023-05-08T03:33:47.333 INFO:journalctl@ceph.mon.a.smithi096.stdout: read_amp_bytes_per_bit: 0 2023-05-08T03:33:47.333 INFO:journalctl@ceph.mon.a.smithi096.stdout: format_version: 5 2023-05-08T03:33:47.333 INFO:journalctl@ceph.mon.a.smithi096.stdout: enable_index_compression: 1 2023-05-08T03:33:47.333 INFO:journalctl@ceph.mon.a.smithi096.stdout: block_align: 0 2023-05-08T03:33:47.333 INFO:journalctl@ceph.mon.a.smithi096.stdout: max_auto_readahead_size: 262144 2023-05-08T03:33:47.333 INFO:journalctl@ceph.mon.a.smithi096.stdout: prepopulate_block_cache: 0 2023-05-08T03:33:47.333 INFO:journalctl@ceph.mon.a.smithi096.stdout: initial_auto_readahead_size: 8192 2023-05-08T03:33:47.333 INFO:journalctl@ceph.mon.a.smithi096.stdout: num_file_reads_for_auto_readahead: 2 2023-05-08T03:33:47.334 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.write_buffer_size: 33554432 2023-05-08T03:33:47.334 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.max_write_buffer_number: 2 2023-05-08T03:33:47.334 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.compression: NoCompression 2023-05-08T03:33:47.334 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.bottommost_compression: Disabled 2023-05-08T03:33:47.334 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.prefix_extractor: nullptr 2023-05-08T03:33:47.334 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-05-08T03:33:47.334 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.num_levels: 7 2023-05-08T03:33:47.335 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-05-08T03:33:47.335 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-05-08T03:33:47.335 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-05-08T03:33:47.335 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-05-08T03:33:47.335 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-05-08T03:33:47.335 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-05-08T03:33:47.335 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-05-08T03:33:47.335 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-05-08T03:33:47.336 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-05-08T03:33:47.336 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-05-08T03:33:47.336 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-05-08T03:33:47.336 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-05-08T03:33:47.336 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.compression_opts.window_bits: -14 2023-05-08T03:33:47.336 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.compression_opts.level: 32767 2023-05-08T03:33:47.336 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.compression_opts.strategy: 0 2023-05-08T03:33:47.337 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-05-08T03:33:47.337 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-05-08T03:33:47.337 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-05-08T03:33:47.337 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-05-08T03:33:47.337 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.compression_opts.enabled: false 2023-05-08T03:33:47.337 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-05-08T03:33:47.337 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-05-08T03:33:47.337 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-05-08T03:33:47.338 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-05-08T03:33:47.338 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.target_file_size_base: 67108864 2023-05-08T03:33:47.338 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.target_file_size_multiplier: 1 2023-05-08T03:33:47.338 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-05-08T03:33:47.338 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-05-08T03:33:47.338 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-05-08T03:33:47.338 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-05-08T03:33:47.338 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-05-08T03:33:47.339 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-05-08T03:33:47.339 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-05-08T03:33:47.339 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-05-08T03:33:47.339 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-05-08T03:33:47.339 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-05-08T03:33:47.339 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-05-08T03:33:47.339 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-05-08T03:33:47.339 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-05-08T03:33:47.340 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.arena_block_size: 1048576 2023-05-08T03:33:47.340 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-05-08T03:33:47.340 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-05-08T03:33:47.340 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.disable_auto_compactions: 0 2023-05-08T03:33:47.340 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-05-08T03:33:47.340 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-05-08T03:33:47.340 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-05-08T03:33:47.340 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-05-08T03:33:47.341 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-05-08T03:33:47.341 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-05-08T03:33:47.341 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-05-08T03:33:47.341 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-05-08T03:33:47.341 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-05-08T03:33:47.341 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-05-08T03:33:47.341 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.table_properties_collectors: 2023-05-08T03:33:47.341 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.inplace_update_support: 0 2023-05-08T03:33:47.342 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.inplace_update_num_locks: 10000 2023-05-08T03:33:47.342 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-05-08T03:33:47.342 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-05-08T03:33:47.342 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.memtable_huge_page_size: 0 2023-05-08T03:33:47.342 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.bloom_locality: 0 2023-05-08T03:33:47.342 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.max_successive_merges: 0 2023-05-08T03:33:47.342 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.optimize_filters_for_hits: 0 2023-05-08T03:33:47.343 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.paranoid_file_checks: 0 2023-05-08T03:33:47.343 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.force_consistency_checks: 1 2023-05-08T03:33:47.343 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.report_bg_io_stats: 0 2023-05-08T03:33:47.343 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.ttl: 2592000 2023-05-08T03:33:47.343 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.periodic_compaction_seconds: 0 2023-05-08T03:33:47.343 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-05-08T03:33:47.343 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-05-08T03:33:47.343 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.enable_blob_files: false 2023-05-08T03:33:47.344 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.min_blob_size: 0 2023-05-08T03:33:47.344 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.blob_file_size: 268435456 2023-05-08T03:33:47.344 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.blob_compression_type: NoCompression 2023-05-08T03:33:47.344 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.enable_blob_garbage_collection: false 2023-05-08T03:33:47.344 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-05-08T03:33:47.344 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-05-08T03:33:47.344 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-05-08T03:33:47.345 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.blob_file_starting_level: 0 2023-05-08T03:33:47.345 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-05-08T03:33:47.345 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2023-05-08T03:33:47.345 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2023-05-08T03:33:47.345 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 56501eec-c87a-4057-b102-f515d6200c61 2023-05-08T03:33:47.345 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: EVENT_LOG_v1 {"time_micros": 1683516827237106, "job": 1, "event": "recovery_started", "wal_files": [9]} 2023-05-08T03:33:47.345 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2023-05-08T03:33:47.346 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: EVENT_LOG_v1 {"time_micros": 1683516827238019, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 94621, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 318, "table_properties": {"data_size": 92622, "index_size": 281, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13876, "raw_average_key_size": 50, "raw_value_size": 85092, "raw_average_value_size": 307, "num_data_blocks": 11, "num_entries": 277, "num_filter_entries": 277, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1683516827, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "56501eec-c87a-4057-b102-f515d6200c61", "db_session_id": "Q8B303WVLVTYPE35I8BK", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2023-05-08T03:33:47.346 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: EVENT_LOG_v1 {"time_micros": 1683516827238102, "job": 1, "event": "recovery_finished"} 2023-05-08T03:33:47.346 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2023-05-08T03:33:47.346 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-05-08T03:33:47.346 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x558ca42e0000 2023-05-08T03:33:47.346 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: DB pointer 0x558ca42cc000 2023-05-08T03:33:47.346 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-05-08T03:33:47.346 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-05-08T03:33:47.347 INFO:journalctl@ceph.mon.a.smithi096.stdout: ** DB Stats ** 2023-05-08T03:33:47.347 INFO:journalctl@ceph.mon.a.smithi096.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-05-08T03:33:47.347 INFO:journalctl@ceph.mon.a.smithi096.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-05-08T03:33:47.347 INFO:journalctl@ceph.mon.a.smithi096.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-05-08T03:33:47.347 INFO:journalctl@ceph.mon.a.smithi096.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-05-08T03:33:47.347 INFO:journalctl@ceph.mon.a.smithi096.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-05-08T03:33:47.347 INFO:journalctl@ceph.mon.a.smithi096.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-05-08T03:33:47.348 INFO:journalctl@ceph.mon.a.smithi096.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-05-08T03:33:47.348 INFO:journalctl@ceph.mon.a.smithi096.stdout: 2023-05-08T03:33:47.348 INFO:journalctl@ceph.mon.a.smithi096.stdout: ** Compaction Stats [default] ** 2023-05-08T03:33:47.348 INFO:journalctl@ceph.mon.a.smithi096.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-05-08T03:33:47.348 INFO:journalctl@ceph.mon.a.smithi096.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-05-08T03:33:47.348 INFO:journalctl@ceph.mon.a.smithi096.stdout: L0 2/0 94.24 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 158.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-05-08T03:33:47.348 INFO:journalctl@ceph.mon.a.smithi096.stdout: Sum 2/0 94.24 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 158.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-05-08T03:33:47.348 INFO:journalctl@ceph.mon.a.smithi096.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 158.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-05-08T03:33:47.349 INFO:journalctl@ceph.mon.a.smithi096.stdout: 2023-05-08T03:33:47.349 INFO:journalctl@ceph.mon.a.smithi096.stdout: ** Compaction Stats [default] ** 2023-05-08T03:33:47.349 INFO:journalctl@ceph.mon.a.smithi096.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-05-08T03:33:47.349 INFO:journalctl@ceph.mon.a.smithi096.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-05-08T03:33:47.349 INFO:journalctl@ceph.mon.a.smithi096.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 158.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-05-08T03:33:47.349 INFO:journalctl@ceph.mon.a.smithi096.stdout: 2023-05-08T03:33:47.349 INFO:journalctl@ceph.mon.a.smithi096.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-05-08T03:33:47.350 INFO:journalctl@ceph.mon.a.smithi096.stdout: 2023-05-08T03:33:47.350 INFO:journalctl@ceph.mon.a.smithi096.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-05-08T03:33:47.350 INFO:journalctl@ceph.mon.a.smithi096.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-05-08T03:33:47.350 INFO:journalctl@ceph.mon.a.smithi096.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-05-08T03:33:47.350 INFO:journalctl@ceph.mon.a.smithi096.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-05-08T03:33:47.350 INFO:journalctl@ceph.mon.a.smithi096.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-05-08T03:33:47.350 INFO:journalctl@ceph.mon.a.smithi096.stdout: AddFile(Keys): cumulative 0, interval 0 2023-05-08T03:33:47.350 INFO:journalctl@ceph.mon.a.smithi096.stdout: Cumulative compaction: 0.00 GB write, 31.13 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-05-08T03:33:47.351 INFO:journalctl@ceph.mon.a.smithi096.stdout: Interval compaction: 0.00 GB write, 31.13 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-05-08T03:33:47.351 INFO:journalctl@ceph.mon.a.smithi096.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-05-08T03:33:47.351 INFO:journalctl@ceph.mon.a.smithi096.stdout: Block cache BinnedLRUCache@0x558ca4243350#7 capacity: 512.00 MB usage: 1.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 8e-06 secs_since: 0 2023-05-08T03:33:47.351 INFO:journalctl@ceph.mon.a.smithi096.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.89 KB,0.000169873%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2023-05-08T03:33:47.351 INFO:journalctl@ceph.mon.a.smithi096.stdout: 2023-05-08T03:33:47.351 INFO:journalctl@ceph.mon.a.smithi096.stdout: ** File Read Latency Histogram By Level [default] ** 2023-05-08T03:33:47.351 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: starting mon.a rank 0 at public addrs [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] at bind addrs [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c 2023-05-08T03:33:47.351 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: mon.a@-1(???) e1 preinit fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c 2023-05-08T03:33:47.352 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: mon.a@-1(???).mds e1 new map 2023-05-08T03:33:47.352 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: mon.a@-1(???).mds e1 print_map 2023-05-08T03:33:47.352 INFO:journalctl@ceph.mon.a.smithi096.stdout: e1 2023-05-08T03:33:47.352 INFO:journalctl@ceph.mon.a.smithi096.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-05-08T03:33:47.352 INFO:journalctl@ceph.mon.a.smithi096.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-05-08T03:33:47.352 INFO:journalctl@ceph.mon.a.smithi096.stdout: legacy client fscid: -1 2023-05-08T03:33:47.352 INFO:journalctl@ceph.mon.a.smithi096.stdout: 2023-05-08T03:33:47.353 INFO:journalctl@ceph.mon.a.smithi096.stdout: No filesystems configured 2023-05-08T03:33:47.353 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2023-05-08T03:33:47.353 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-05-08T03:33:47.353 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-05-08T03:33:47.353 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-05-08T03:33:47.353 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2023-05-08T03:33:47.353 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: expand_channel_meta expand map: {default=false} 2023-05-08T03:33:47.353 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: expand_channel_meta from 'false' to 'false' 2023-05-08T03:33:47.354 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: expand_channel_meta expanded map: {default=false} 2023-05-08T03:33:47.354 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: expand_channel_meta expand map: {default=info} 2023-05-08T03:33:47.354 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: expand_channel_meta from 'info' to 'info' 2023-05-08T03:33:47.354 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: expand_channel_meta expanded map: {default=info} 2023-05-08T03:33:47.354 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: expand_channel_meta expand map: {default=daemon} 2023-05-08T03:33:47.354 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: expand_channel_meta from 'daemon' to 'daemon' 2023-05-08T03:33:47.354 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: expand_channel_meta expanded map: {default=daemon} 2023-05-08T03:33:47.354 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: expand_channel_meta expand map: {default=debug} 2023-05-08T03:33:47.355 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: expand_channel_meta from 'debug' to 'debug' 2023-05-08T03:33:47.355 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: expand_channel_meta expanded map: {default=debug} 2023-05-08T03:33:47.355 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: mon.a is new leader, mons a in quorum (ranks 0) 2023-05-08T03:33:47.355 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: monmap e1: 1 mons at {a=[v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0]} removed_ranks: {} 2023-05-08T03:33:47.355 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: fsmap 2023-05-08T03:33:47.355 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: osdmap e1: 0 total, 0 up, 0 in 2023-05-08T03:33:47.355 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 ceph-mon[124666]: mgrmap e1: no daemons active 2023-05-08T03:33:47.356 INFO:teuthology.orchestra.run.smithi096.stdout:Setting mon public_network to 172.21.0.0/20 2023-05-08T03:33:47.576 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:47 smithi096 systemd[1]: Started Ceph mon.a for f7ffcfb0-ed50-11ed-9b01-001a4aab830c. 2023-05-08T03:33:48.566 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:47.940+0000 7fe66f8cd700 1 Processor -- start 2023-05-08T03:33:48.566 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:47.941+0000 7fe66f8cd700 1 -- start start 2023-05-08T03:33:48.566 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:47.941+0000 7fe66f8cd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe668103f10 0x7fe668104320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:33:48.566 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:47.941+0000 7fe66f8cd700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe668104860 con 0x7fe668103f10 2023-05-08T03:33:48.567 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:47.941+0000 7fe66d669700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe668103f10 0x7fe668104320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:33:48.567 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:47.941+0000 7fe66d669700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe668103f10 0x7fe668104320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39118/0 (socket says 172.21.15.96:39118) 2023-05-08T03:33:48.567 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:47.941+0000 7fe66d669700 1 -- 172.21.15.96:0/4239676444 learned_addr learned my addr 172.21.15.96:0/4239676444 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:33:48.567 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:47.942+0000 7fe66d669700 1 -- 172.21.15.96:0/4239676444 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6681049a0 con 0x7fe668103f10 2023-05-08T03:33:48.567 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:47.942+0000 7fe66d669700 1 --2- 172.21.15.96:0/4239676444 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe668103f10 0x7fe668104320 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fe6580098a0 tx=0x7fe658009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4773f96d005bf04 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:33:48.567 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:47.942+0000 7fe65ffff700 1 -- 172.21.15.96:0/4239676444 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe658004160 con 0x7fe668103f10 2023-05-08T03:33:48.567 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:47.942+0000 7fe65ffff700 1 -- 172.21.15.96:0/4239676444 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe6580042c0 con 0x7fe668103f10 2023-05-08T03:33:48.568 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:47.942+0000 7fe65ffff700 1 -- 172.21.15.96:0/4239676444 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe658011a00 con 0x7fe668103f10 2023-05-08T03:33:48.568 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:47.942+0000 7fe66f8cd700 1 -- 172.21.15.96:0/4239676444 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe668103f10 msgr2=0x7fe668104320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:33:48.568 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:47.942+0000 7fe66f8cd700 1 --2- 172.21.15.96:0/4239676444 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe668103f10 0x7fe668104320 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fe6580098a0 tx=0x7fe658009bb0 comp rx=0 tx=0).stop 2023-05-08T03:33:48.568 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:47.942+0000 7fe66f8cd700 1 -- 172.21.15.96:0/4239676444 shutdown_connections 2023-05-08T03:33:48.568 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:47.942+0000 7fe66f8cd700 1 --2- 172.21.15.96:0/4239676444 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe668103f10 0x7fe668104320 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:33:48.568 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:47.942+0000 7fe66f8cd700 1 -- 172.21.15.96:0/4239676444 >> 172.21.15.96:0/4239676444 conn(0x7fe6680ff930 msgr2=0x7fe668101d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:33:48.568 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:47.943+0000 7fe66f8cd700 1 -- 172.21.15.96:0/4239676444 shutdown_connections 2023-05-08T03:33:48.569 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:47.943+0000 7fe66f8cd700 1 -- 172.21.15.96:0/4239676444 wait complete. 2023-05-08T03:33:48.569 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:47.943+0000 7fe66f8cd700 1 Processor -- start 2023-05-08T03:33:48.569 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:47.943+0000 7fe66f8cd700 1 -- start start 2023-05-08T03:33:48.569 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:47.943+0000 7fe66f8cd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe668103f10 0x7fe6681998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:33:48.569 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:47.943+0000 7fe66f8cd700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe668199e10 con 0x7fe668103f10 2023-05-08T03:33:48.569 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:47.943+0000 7fe66d669700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe668103f10 0x7fe6681998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:33:48.569 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:47.943+0000 7fe66d669700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe668103f10 0x7fe6681998d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39120/0 (socket says 172.21.15.96:39120) 2023-05-08T03:33:48.569 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:47.943+0000 7fe66d669700 1 -- 172.21.15.96:0/867688366 learned_addr learned my addr 172.21.15.96:0/867688366 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:33:48.570 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:47.944+0000 7fe66d669700 1 -- 172.21.15.96:0/867688366 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe658009550 con 0x7fe668103f10 2023-05-08T03:33:48.570 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:47.944+0000 7fe66d669700 1 --2- 172.21.15.96:0/867688366 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe668103f10 0x7fe6681998d0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fe658009fb0 tx=0x7fe658011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:33:48.570 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:47.944+0000 7fe65e7fc700 1 -- 172.21.15.96:0/867688366 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe658003930 con 0x7fe668103f10 2023-05-08T03:33:48.570 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:47.944+0000 7fe65e7fc700 1 -- 172.21.15.96:0/867688366 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe658003a90 con 0x7fe668103f10 2023-05-08T03:33:48.570 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:47.944+0000 7fe66f8cd700 1 -- 172.21.15.96:0/867688366 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe668107ce0 con 0x7fe668103f10 2023-05-08T03:33:48.570 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:47.944+0000 7fe65e7fc700 1 -- 172.21.15.96:0/867688366 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe6580195e0 con 0x7fe668103f10 2023-05-08T03:33:48.570 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:47.944+0000 7fe66f8cd700 1 -- 172.21.15.96:0/867688366 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe668107b50 con 0x7fe668103f10 2023-05-08T03:33:48.570 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:47.944+0000 7fe65e7fc700 1 -- 172.21.15.96:0/867688366 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe658019b70 con 0x7fe668103f10 2023-05-08T03:33:48.571 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:47.944+0000 7fe65e7fc700 1 -- 172.21.15.96:0/867688366 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fe6580243f0 con 0x7fe668103f10 2023-05-08T03:33:48.571 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:47.945+0000 7fe66f8cd700 1 -- 172.21.15.96:0/867688366 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe668062220 con 0x7fe668103f10 2023-05-08T03:33:48.571 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:47.948+0000 7fe65e7fc700 1 -- 172.21.15.96:0/867688366 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7fe65802de30 con 0x7fe668103f10 2023-05-08T03:33:48.571 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:48.014+0000 7fe66f8cd700 1 -- 172.21.15.96:0/867688366 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7fe66819a350 con 0x7fe668103f10 2023-05-08T03:33:48.571 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:48.016+0000 7fe65e7fc700 1 -- 172.21.15.96:0/867688366 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7fe658003c00 con 0x7fe668103f10 2023-05-08T03:33:48.571 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:48.017+0000 7fe66f8cd700 1 -- 172.21.15.96:0/867688366 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe668103f10 msgr2=0x7fe6681998d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:33:48.571 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:48.017+0000 7fe66f8cd700 1 --2- 172.21.15.96:0/867688366 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe668103f10 0x7fe6681998d0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fe658009fb0 tx=0x7fe658011ad0 comp rx=0 tx=0).stop 2023-05-08T03:33:48.572 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:48.017+0000 7fe66f8cd700 1 -- 172.21.15.96:0/867688366 shutdown_connections 2023-05-08T03:33:48.572 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:48.017+0000 7fe66f8cd700 1 --2- 172.21.15.96:0/867688366 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe668103f10 0x7fe6681998d0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:33:48.572 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:48.017+0000 7fe66f8cd700 1 -- 172.21.15.96:0/867688366 >> 172.21.15.96:0/867688366 conn(0x7fe6680ff930 msgr2=0x7fe668100650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:33:48.572 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:48.017+0000 7fe66f8cd700 1 -- 172.21.15.96:0/867688366 shutdown_connections 2023-05-08T03:33:48.572 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:48.017+0000 7fe66f8cd700 1 -- 172.21.15.96:0/867688366 wait complete. 2023-05-08T03:33:48.572 INFO:teuthology.orchestra.run.smithi096.stdout:Wrote config to /etc/ceph/ceph.conf 2023-05-08T03:33:48.572 INFO:teuthology.orchestra.run.smithi096.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2023-05-08T03:33:48.572 INFO:teuthology.orchestra.run.smithi096.stdout:Creating mgr... 2023-05-08T03:33:48.573 INFO:teuthology.orchestra.run.smithi096.stdout:Verifying port 9283 ... 2023-05-08T03:33:48.573 INFO:teuthology.orchestra.run.smithi096.stdout:Verifying port 8765 ... 2023-05-08T03:33:48.686 INFO:teuthology.orchestra.run.smithi096.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c@mgr.x 2023-05-08T03:33:48.687 INFO:teuthology.orchestra.run.smithi096.stdout:systemctl: stderr Failed to reset failed state of unit ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c@mgr.x.service: Unit ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c@mgr.x.service not loaded. 2023-05-08T03:33:48.774 INFO:teuthology.orchestra.run.smithi096.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c.target.wants/ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c@mgr.x.service → /etc/systemd/system/ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c@.service. 2023-05-08T03:33:49.095 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:49 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/867688366' entity='client.admin' 2023-05-08T03:33:49.095 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:33:48 smithi096 systemd[1]: Starting Ceph mgr.x for f7ffcfb0-ed50-11ed-9b01-001a4aab830c... 2023-05-08T03:33:49.358 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:33:49 smithi096 podman[124895]: 2023-05-08T03:33:49.374 INFO:teuthology.orchestra.run.smithi096.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-05-08T03:33:49.375 INFO:teuthology.orchestra.run.smithi096.stdout:systemctl: stdout disabled 2023-05-08T03:33:49.382 INFO:teuthology.orchestra.run.smithi096.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-05-08T03:33:49.382 INFO:teuthology.orchestra.run.smithi096.stdout:systemctl: stdout inactive 2023-05-08T03:33:49.382 INFO:teuthology.orchestra.run.smithi096.stdout:firewalld.service is not enabled 2023-05-08T03:33:49.382 INFO:teuthology.orchestra.run.smithi096.stdout:Not possible to enable service . firewalld.service is not available 2023-05-08T03:33:49.390 INFO:teuthology.orchestra.run.smithi096.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-05-08T03:33:49.390 INFO:teuthology.orchestra.run.smithi096.stdout:systemctl: stdout disabled 2023-05-08T03:33:49.398 INFO:teuthology.orchestra.run.smithi096.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-05-08T03:33:49.398 INFO:teuthology.orchestra.run.smithi096.stdout:systemctl: stdout inactive 2023-05-08T03:33:49.399 INFO:teuthology.orchestra.run.smithi096.stdout:firewalld.service is not enabled 2023-05-08T03:33:49.399 INFO:teuthology.orchestra.run.smithi096.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2023-05-08T03:33:49.399 INFO:teuthology.orchestra.run.smithi096.stdout:Waiting for mgr to start... 2023-05-08T03:33:49.399 INFO:teuthology.orchestra.run.smithi096.stdout:Waiting for mgr... 2023-05-08T03:33:49.617 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:33:49 smithi096 bash[124895]: 4112088fd9c906d4cf10a449dc8d897d430c9a1f3f7f01b7ff0d7fecc245386e 2023-05-08T03:33:49.618 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:33:49 smithi096 systemd[1]: Started Ceph mgr.x for f7ffcfb0-ed50-11ed-9b01-001a4aab830c. 2023-05-08T03:33:49.618 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:33:49 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:33:49.483+0000 7f9b1f380200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-05-08T03:33:49.618 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:33:49 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:33:49.563+0000 7f9b1f380200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-08T03:33:49.934 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:33:49 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:33:49.657+0000 7f9b1f380200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-08T03:33:49.934 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:33:49 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:33:49.753+0000 7f9b1f380200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-08T03:33:49.934 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:33:49 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:33:49.931+0000 7f9b1f380200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-08T03:33:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:50 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/1288892003' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-05-08T03:33:50.445 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout 2023-05-08T03:33:50.446 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout { 2023-05-08T03:33:50.446 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "fsid": "f7ffcfb0-ed50-11ed-9b01-001a4aab830c", 2023-05-08T03:33:50.446 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "health": { 2023-05-08T03:33:50.446 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-05-08T03:33:50.446 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-05-08T03:33:50.446 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-05-08T03:33:50.447 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout }, 2023-05-08T03:33:50.447 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-05-08T03:33:50.447 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-05-08T03:33:50.447 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout 0 2023-05-08T03:33:50.447 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout ], 2023-05-08T03:33:50.447 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-05-08T03:33:50.447 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "a" 2023-05-08T03:33:50.447 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout ], 2023-05-08T03:33:50.448 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2023-05-08T03:33:50.448 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "monmap": { 2023-05-08T03:33:50.448 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-05-08T03:33:50.448 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-05-08T03:33:50.448 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-05-08T03:33:50.448 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout }, 2023-05-08T03:33:50.448 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-05-08T03:33:50.449 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-05-08T03:33:50.449 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-05-08T03:33:50.449 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-05-08T03:33:50.449 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-05-08T03:33:50.454 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-05-08T03:33:50.454 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-05-08T03:33:50.455 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-05-08T03:33:50.455 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout }, 2023-05-08T03:33:50.455 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-05-08T03:33:50.455 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-05-08T03:33:50.455 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-05-08T03:33:50.455 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-05-08T03:33:50.455 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-05-08T03:33:50.456 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-05-08T03:33:50.456 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-05-08T03:33:50.456 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-05-08T03:33:50.456 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-05-08T03:33:50.456 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout }, 2023-05-08T03:33:50.456 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-05-08T03:33:50.456 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-05-08T03:33:50.456 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-05-08T03:33:50.457 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-05-08T03:33:50.457 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout }, 2023-05-08T03:33:50.457 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-05-08T03:33:50.457 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "available": false, 2023-05-08T03:33:50.457 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-05-08T03:33:50.457 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "modules": [ 2023-05-08T03:33:50.457 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "iostat", 2023-05-08T03:33:50.457 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "nfs", 2023-05-08T03:33:50.458 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "restful" 2023-05-08T03:33:50.458 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout ], 2023-05-08T03:33:50.458 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "services": {} 2023-05-08T03:33:50.458 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout }, 2023-05-08T03:33:50.458 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-05-08T03:33:50.458 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-05-08T03:33:50.458 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "modified": "2023-05-08T03:33:42.766159+0000", 2023-05-08T03:33:50.458 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "services": {} 2023-05-08T03:33:50.459 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout }, 2023-05-08T03:33:50.459 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-05-08T03:33:50.459 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout } 2023-05-08T03:33:50.459 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:49.913+0000 7f5e6840c700 1 Processor -- start 2023-05-08T03:33:50.459 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:49.913+0000 7f5e6840c700 1 -- start start 2023-05-08T03:33:50.459 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:49.914+0000 7f5e6840c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e60106790 0x7f5e60108b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:33:50.460 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:49.914+0000 7f5e6840c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e60074210 con 0x7f5e60106790 2023-05-08T03:33:50.460 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:49.914+0000 7f5e661a8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e60106790 0x7f5e60108b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:33:50.460 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:49.914+0000 7f5e661a8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e60106790 0x7f5e60108b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39126/0 (socket says 172.21.15.96:39126) 2023-05-08T03:33:50.460 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:49.914+0000 7f5e661a8700 1 -- 172.21.15.96:0/1395813673 learned_addr learned my addr 172.21.15.96:0/1395813673 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:33:50.460 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:49.914+0000 7f5e661a8700 1 -- 172.21.15.96:0/1395813673 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e60074350 con 0x7f5e60106790 2023-05-08T03:33:50.460 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:49.914+0000 7f5e661a8700 1 --2- 172.21.15.96:0/1395813673 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e60106790 0x7f5e60108b70 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c0098a0 tx=0x7f5e5c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63293027bd8dcfe0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:33:50.460 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:49.914+0000 7f5e651a6700 1 -- 172.21.15.96:0/1395813673 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5e5c004160 con 0x7f5e60106790 2023-05-08T03:33:50.460 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:49.914+0000 7f5e651a6700 1 -- 172.21.15.96:0/1395813673 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5e5c0042c0 con 0x7f5e60106790 2023-05-08T03:33:50.461 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:49.914+0000 7f5e651a6700 1 -- 172.21.15.96:0/1395813673 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5e5c011a00 con 0x7f5e60106790 2023-05-08T03:33:50.461 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:49.915+0000 7f5e6840c700 1 -- 172.21.15.96:0/1395813673 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e60106790 msgr2=0x7f5e60108b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:33:50.461 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:49.915+0000 7f5e6840c700 1 --2- 172.21.15.96:0/1395813673 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e60106790 0x7f5e60108b70 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c0098a0 tx=0x7f5e5c009bb0 comp rx=0 tx=0).stop 2023-05-08T03:33:50.461 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:49.915+0000 7f5e6840c700 1 -- 172.21.15.96:0/1395813673 shutdown_connections 2023-05-08T03:33:50.461 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:49.915+0000 7f5e6840c700 1 --2- 172.21.15.96:0/1395813673 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e60106790 0x7f5e60108b70 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:33:50.461 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:49.915+0000 7f5e6840c700 1 -- 172.21.15.96:0/1395813673 >> 172.21.15.96:0/1395813673 conn(0x7f5e60100170 msgr2=0x7f5e601025a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:33:50.461 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:49.915+0000 7f5e6840c700 1 -- 172.21.15.96:0/1395813673 shutdown_connections 2023-05-08T03:33:50.462 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:49.915+0000 7f5e6840c700 1 -- 172.21.15.96:0/1395813673 wait complete. 2023-05-08T03:33:50.462 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:49.916+0000 7f5e6840c700 1 Processor -- start 2023-05-08T03:33:50.462 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:49.916+0000 7f5e6840c700 1 -- start start 2023-05-08T03:33:50.462 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:49.916+0000 7f5e6840c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e60106790 0x7f5e601998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:33:50.462 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:49.916+0000 7f5e6840c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e60199df0 con 0x7f5e60106790 2023-05-08T03:33:50.462 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:49.916+0000 7f5e661a8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e60106790 0x7f5e601998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:33:50.462 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:49.916+0000 7f5e661a8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e60106790 0x7f5e601998b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39128/0 (socket says 172.21.15.96:39128) 2023-05-08T03:33:50.462 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:49.916+0000 7f5e661a8700 1 -- 172.21.15.96:0/1288892003 learned_addr learned my addr 172.21.15.96:0/1288892003 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:33:50.463 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:49.916+0000 7f5e661a8700 1 -- 172.21.15.96:0/1288892003 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e5c009550 con 0x7f5e60106790 2023-05-08T03:33:50.463 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:49.917+0000 7f5e661a8700 1 --2- 172.21.15.96:0/1288892003 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e60106790 0x7f5e601998b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c009fb0 tx=0x7f5e5c011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:33:50.463 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:49.917+0000 7f5e577fe700 1 -- 172.21.15.96:0/1288892003 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5e5c003930 con 0x7f5e60106790 2023-05-08T03:33:50.463 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:49.917+0000 7f5e6840c700 1 -- 172.21.15.96:0/1288892003 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e60109eb0 con 0x7f5e60106790 2023-05-08T03:33:50.463 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:49.917+0000 7f5e577fe700 1 -- 172.21.15.96:0/1288892003 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5e5c003a90 con 0x7f5e60106790 2023-05-08T03:33:50.463 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:49.917+0000 7f5e577fe700 1 -- 172.21.15.96:0/1288892003 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5e5c0195e0 con 0x7f5e60106790 2023-05-08T03:33:50.463 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:49.917+0000 7f5e6840c700 1 -- 172.21.15.96:0/1288892003 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e60109d20 con 0x7f5e60106790 2023-05-08T03:33:50.464 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:49.917+0000 7f5e577fe700 1 -- 172.21.15.96:0/1288892003 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5e5c019ba0 con 0x7f5e60106790 2023-05-08T03:33:50.464 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:49.917+0000 7f5e577fe700 1 -- 172.21.15.96:0/1288892003 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f5e5c0243f0 con 0x7f5e60106790 2023-05-08T03:33:50.464 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:49.918+0000 7f5e6840c700 1 -- 172.21.15.96:0/1288892003 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e6010a040 con 0x7f5e60106790 2023-05-08T03:33:50.464 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:49.922+0000 7f5e577fe700 1 -- 172.21.15.96:0/1288892003 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f5e5c003c00 con 0x7f5e60106790 2023-05-08T03:33:50.464 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:49.993+0000 7f5e6840c700 1 -- 172.21.15.96:0/1288892003 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f5e6019a400 con 0x7f5e60106790 2023-05-08T03:33:50.464 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:49.993+0000 7f5e577fe700 1 -- 172.21.15.96:0/1288892003 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f5e5c01a9d0 con 0x7f5e60106790 2023-05-08T03:33:50.464 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:49.994+0000 7f5e6840c700 1 -- 172.21.15.96:0/1288892003 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e60106790 msgr2=0x7f5e601998b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:33:50.464 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:49.994+0000 7f5e6840c700 1 --2- 172.21.15.96:0/1288892003 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e60106790 0x7f5e601998b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c009fb0 tx=0x7f5e5c011ad0 comp rx=0 tx=0).stop 2023-05-08T03:33:50.465 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:49.994+0000 7f5e6840c700 1 -- 172.21.15.96:0/1288892003 shutdown_connections 2023-05-08T03:33:50.465 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:49.994+0000 7f5e6840c700 1 --2- 172.21.15.96:0/1288892003 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e60106790 0x7f5e601998b0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:33:50.465 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:49.994+0000 7f5e6840c700 1 -- 172.21.15.96:0/1288892003 >> 172.21.15.96:0/1288892003 conn(0x7f5e60100170 msgr2=0x7f5e60100f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:33:50.465 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:49.994+0000 7f5e6840c700 1 -- 172.21.15.96:0/1288892003 shutdown_connections 2023-05-08T03:33:50.465 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:49.994+0000 7f5e6840c700 1 -- 172.21.15.96:0/1288892003 wait complete. 2023-05-08T03:33:50.465 INFO:teuthology.orchestra.run.smithi096.stdout:mgr not available, waiting (1/15)... 2023-05-08T03:33:50.575 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:33:50 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:33:50.256+0000 7f9b1f380200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-08T03:33:50.575 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:33:50 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:33:50.346+0000 7f9b1f380200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-08T03:33:50.576 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:33:50 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:33:50.479+0000 7f9b1f380200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-08T03:33:50.991 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:33:50 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:33:50.573+0000 7f9b1f380200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-08T03:33:51.255 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:33:50 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:33:50.989+0000 7f9b1f380200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-08T03:33:52.005 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:33:51 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:33:51.556+0000 7f9b1f380200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-08T03:33:52.005 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:33:51 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:33:51.723+0000 7f9b1f380200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-08T03:33:52.745 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:33:52 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:33:52.478+0000 7f9b1f380200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-08T03:33:52.745 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:33:52 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:33:52.570+0000 7f9b1f380200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-05-08T03:33:53.005 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:33:52 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:33:52.748+0000 7f9b1f380200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-08T03:33:53.392 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:53 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/2464466010' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-05-08T03:33:53.393 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:33:53 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:33:53.034+0000 7f9b1f380200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-05-08T03:33:53.393 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:33:53 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:33:53.267+0000 7f9b1f380200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-08T03:33:53.396 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout 2023-05-08T03:33:53.396 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout { 2023-05-08T03:33:53.396 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "fsid": "f7ffcfb0-ed50-11ed-9b01-001a4aab830c", 2023-05-08T03:33:53.396 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "health": { 2023-05-08T03:33:53.396 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-05-08T03:33:53.397 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-05-08T03:33:53.397 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-05-08T03:33:53.397 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout }, 2023-05-08T03:33:53.397 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-05-08T03:33:53.397 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-05-08T03:33:53.397 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout 0 2023-05-08T03:33:53.397 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout ], 2023-05-08T03:33:53.398 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-05-08T03:33:53.398 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "a" 2023-05-08T03:33:53.399 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout ], 2023-05-08T03:33:53.399 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2023-05-08T03:33:53.399 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "monmap": { 2023-05-08T03:33:53.399 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-05-08T03:33:53.399 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-05-08T03:33:53.400 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-05-08T03:33:53.400 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout }, 2023-05-08T03:33:53.400 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-05-08T03:33:53.400 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-05-08T03:33:53.400 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-05-08T03:33:53.400 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-05-08T03:33:53.400 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-05-08T03:33:53.406 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-05-08T03:33:53.406 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-05-08T03:33:53.407 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-05-08T03:33:53.407 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout }, 2023-05-08T03:33:53.408 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-05-08T03:33:53.408 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-05-08T03:33:53.408 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-05-08T03:33:53.408 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-05-08T03:33:53.408 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-05-08T03:33:53.408 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-05-08T03:33:53.408 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-05-08T03:33:53.409 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-05-08T03:33:53.409 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-05-08T03:33:53.409 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout }, 2023-05-08T03:33:53.409 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-05-08T03:33:53.409 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-05-08T03:33:53.409 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-05-08T03:33:53.409 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-05-08T03:33:53.410 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout }, 2023-05-08T03:33:53.410 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-05-08T03:33:53.410 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "available": false, 2023-05-08T03:33:53.410 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-05-08T03:33:53.410 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "modules": [ 2023-05-08T03:33:53.410 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "iostat", 2023-05-08T03:33:53.410 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "nfs", 2023-05-08T03:33:53.410 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "restful" 2023-05-08T03:33:53.411 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout ], 2023-05-08T03:33:53.411 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "services": {} 2023-05-08T03:33:53.411 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout }, 2023-05-08T03:33:53.411 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-05-08T03:33:53.411 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-05-08T03:33:53.411 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "modified": "2023-05-08T03:33:42.766159+0000", 2023-05-08T03:33:53.411 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "services": {} 2023-05-08T03:33:53.412 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout }, 2023-05-08T03:33:53.412 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-05-08T03:33:53.412 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout } 2023-05-08T03:33:53.412 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:52.952+0000 7f42c7184700 1 Processor -- start 2023-05-08T03:33:53.412 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:52.952+0000 7f42c7184700 1 -- start start 2023-05-08T03:33:53.412 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:52.953+0000 7f42c7184700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42c0105c20 0x7f42c0106030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:33:53.412 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:52.953+0000 7f42c7184700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c0106570 con 0x7f42c0105c20 2023-05-08T03:33:53.413 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:52.953+0000 7f42c4f20700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42c0105c20 0x7f42c0106030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:33:53.413 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:52.953+0000 7f42c4f20700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42c0105c20 0x7f42c0106030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39130/0 (socket says 172.21.15.96:39130) 2023-05-08T03:33:53.413 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:52.953+0000 7f42c4f20700 1 -- 172.21.15.96:0/1672185177 learned_addr learned my addr 172.21.15.96:0/1672185177 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:33:53.413 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:52.953+0000 7f42c4f20700 1 -- 172.21.15.96:0/1672185177 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c01066b0 con 0x7f42c0105c20 2023-05-08T03:33:53.413 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:52.953+0000 7f42c4f20700 1 --2- 172.21.15.96:0/1672185177 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42c0105c20 0x7f42c0106030 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f42b40098a0 tx=0x7f42b4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a75f662432daab47 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:33:53.413 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:52.953+0000 7f42bf7fe700 1 -- 172.21.15.96:0/1672185177 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f42b4004160 con 0x7f42c0105c20 2023-05-08T03:33:53.414 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:52.954+0000 7f42bf7fe700 1 -- 172.21.15.96:0/1672185177 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f42b40042c0 con 0x7f42c0105c20 2023-05-08T03:33:53.414 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:52.954+0000 7f42bf7fe700 1 -- 172.21.15.96:0/1672185177 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f42b4011a00 con 0x7f42c0105c20 2023-05-08T03:33:53.414 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:52.954+0000 7f42c7184700 1 -- 172.21.15.96:0/1672185177 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42c0105c20 msgr2=0x7f42c0106030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:33:53.414 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:52.954+0000 7f42c7184700 1 --2- 172.21.15.96:0/1672185177 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42c0105c20 0x7f42c0106030 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f42b40098a0 tx=0x7f42b4009bb0 comp rx=0 tx=0).stop 2023-05-08T03:33:53.414 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:52.954+0000 7f42c7184700 1 -- 172.21.15.96:0/1672185177 shutdown_connections 2023-05-08T03:33:53.414 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:52.954+0000 7f42c7184700 1 --2- 172.21.15.96:0/1672185177 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42c0105c20 0x7f42c0106030 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:33:53.414 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:52.954+0000 7f42c7184700 1 -- 172.21.15.96:0/1672185177 >> 172.21.15.96:0/1672185177 conn(0x7f42c01012b0 msgr2=0x7f42c01036c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:33:53.415 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:52.954+0000 7f42c7184700 1 -- 172.21.15.96:0/1672185177 shutdown_connections 2023-05-08T03:33:53.415 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:52.954+0000 7f42c7184700 1 -- 172.21.15.96:0/1672185177 wait complete. 2023-05-08T03:33:53.415 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:52.955+0000 7f42c7184700 1 Processor -- start 2023-05-08T03:33:53.415 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:52.955+0000 7f42c7184700 1 -- start start 2023-05-08T03:33:53.415 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:52.955+0000 7f42c7184700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42c0105c20 0x7f42c0199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:33:53.416 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:52.955+0000 7f42c7184700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c0199dc0 con 0x7f42c0105c20 2023-05-08T03:33:53.416 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:52.955+0000 7f42c4f20700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42c0105c20 0x7f42c0199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:33:53.416 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:52.955+0000 7f42c4f20700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42c0105c20 0x7f42c0199880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39132/0 (socket says 172.21.15.96:39132) 2023-05-08T03:33:53.416 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:52.955+0000 7f42c4f20700 1 -- 172.21.15.96:0/2464466010 learned_addr learned my addr 172.21.15.96:0/2464466010 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:33:53.417 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:52.955+0000 7f42c4f20700 1 -- 172.21.15.96:0/2464466010 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42b4009550 con 0x7f42c0105c20 2023-05-08T03:33:53.417 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:52.955+0000 7f42c4f20700 1 --2- 172.21.15.96:0/2464466010 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42c0105c20 0x7f42c0199880 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f42b4009fb0 tx=0x7f42b4011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:33:53.417 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:52.956+0000 7f42bdffb700 1 -- 172.21.15.96:0/2464466010 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f42b4003930 con 0x7f42c0105c20 2023-05-08T03:33:53.417 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:52.956+0000 7f42bdffb700 1 -- 172.21.15.96:0/2464466010 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f42b4003a90 con 0x7f42c0105c20 2023-05-08T03:33:53.417 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:52.956+0000 7f42bdffb700 1 -- 172.21.15.96:0/2464466010 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f42b4019610 con 0x7f42c0105c20 2023-05-08T03:33:53.417 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:52.956+0000 7f42c7184700 1 -- 172.21.15.96:0/2464466010 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42c0107c70 con 0x7f42c0105c20 2023-05-08T03:33:53.418 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:52.956+0000 7f42c7184700 1 -- 172.21.15.96:0/2464466010 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42c0107ae0 con 0x7f42c0105c20 2023-05-08T03:33:53.418 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:52.956+0000 7f42bdffb700 1 -- 172.21.15.96:0/2464466010 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f42b4019b80 con 0x7f42c0105c20 2023-05-08T03:33:53.418 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:52.956+0000 7f42bdffb700 1 -- 172.21.15.96:0/2464466010 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f42b40243f0 con 0x7f42c0105c20 2023-05-08T03:33:53.418 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:52.957+0000 7f42c7184700 1 -- 172.21.15.96:0/2464466010 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42c0062220 con 0x7f42c0105c20 2023-05-08T03:33:53.418 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:52.959+0000 7f42bdffb700 1 -- 172.21.15.96:0/2464466010 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f42b402de40 con 0x7f42c0105c20 2023-05-08T03:33:53.418 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:53.032+0000 7f42c7184700 1 -- 172.21.15.96:0/2464466010 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f42c019a390 con 0x7f42c0105c20 2023-05-08T03:33:53.418 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:53.033+0000 7f42bdffb700 1 -- 172.21.15.96:0/2464466010 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f42b4003c00 con 0x7f42c0105c20 2023-05-08T03:33:53.419 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:53.033+0000 7f42c7184700 1 -- 172.21.15.96:0/2464466010 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42c0105c20 msgr2=0x7f42c0199880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:33:53.419 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:53.033+0000 7f42c7184700 1 --2- 172.21.15.96:0/2464466010 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42c0105c20 0x7f42c0199880 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f42b4009fb0 tx=0x7f42b4011ad0 comp rx=0 tx=0).stop 2023-05-08T03:33:53.419 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:53.033+0000 7f42c7184700 1 -- 172.21.15.96:0/2464466010 shutdown_connections 2023-05-08T03:33:53.419 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:53.033+0000 7f42c7184700 1 --2- 172.21.15.96:0/2464466010 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42c0105c20 0x7f42c0199880 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:33:53.419 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:53.033+0000 7f42c7184700 1 -- 172.21.15.96:0/2464466010 >> 172.21.15.96:0/2464466010 conn(0x7f42c01012b0 msgr2=0x7f42c0101f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:33:53.419 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:53.034+0000 7f42c7184700 1 -- 172.21.15.96:0/2464466010 shutdown_connections 2023-05-08T03:33:53.419 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:53.034+0000 7f42c7184700 1 -- 172.21.15.96:0/2464466010 wait complete. 2023-05-08T03:33:53.420 INFO:teuthology.orchestra.run.smithi096.stdout:mgr not available, waiting (2/15)... 2023-05-08T03:33:53.683 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:33:53 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:33:53.422+0000 7f9b1f380200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-08T03:33:54.005 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:33:53 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:33:53.681+0000 7f9b1f380200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-08T03:33:54.691 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:33:54 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:33:54.373+0000 7f9b1f380200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-08T03:33:54.692 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:33:54 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:33:54.502+0000 7f9b1f380200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-08T03:33:55.005 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:33:54 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:33:54.689+0000 7f9b1f380200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-08T03:33:55.005 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:33:54 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:33:54.801+0000 7f9b1f380200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-08T03:33:55.505 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:33:55 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:33:55.013+0000 7f9b1f380200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-08T03:33:55.944 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:33:55 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:33:55.875+0000 7f9b1f380200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-08T03:33:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:55 smithi096 ceph-mon[124666]: Activating manager daemon x 2023-05-08T03:33:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:55 smithi096 ceph-mon[124666]: mgrmap e2: x(active, starting, since 0.00299021s) 2023-05-08T03:33:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:55 smithi096 ceph-mon[124666]: from='mgr.14100 172.21.15.96:0/2631599120' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-05-08T03:33:56.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:55 smithi096 ceph-mon[124666]: from='mgr.14100 172.21.15.96:0/2631599120' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-05-08T03:33:56.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:55 smithi096 ceph-mon[124666]: from='mgr.14100 172.21.15.96:0/2631599120' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-05-08T03:33:56.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:55 smithi096 ceph-mon[124666]: from='mgr.14100 172.21.15.96:0/2631599120' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-05-08T03:33:56.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:55 smithi096 ceph-mon[124666]: from='mgr.14100 172.21.15.96:0/2631599120' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-05-08T03:33:56.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:55 smithi096 ceph-mon[124666]: Manager daemon x is now available 2023-05-08T03:33:56.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:55 smithi096 ceph-mon[124666]: from='mgr.14100 172.21.15.96:0/2631599120' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-05-08T03:33:56.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:55 smithi096 ceph-mon[124666]: from='mgr.14100 172.21.15.96:0/2631599120' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-05-08T03:33:56.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:55 smithi096 ceph-mon[124666]: from='mgr.14100 172.21.15.96:0/2631599120' entity='mgr.x' 2023-05-08T03:33:56.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:55 smithi096 ceph-mon[124666]: from='mgr.14100 172.21.15.96:0/2631599120' entity='mgr.x' 2023-05-08T03:33:56.447 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout 2023-05-08T03:33:56.449 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout { 2023-05-08T03:33:56.449 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "fsid": "f7ffcfb0-ed50-11ed-9b01-001a4aab830c", 2023-05-08T03:33:56.450 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "health": { 2023-05-08T03:33:56.450 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-05-08T03:33:56.450 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-05-08T03:33:56.450 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-05-08T03:33:56.450 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout }, 2023-05-08T03:33:56.450 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-05-08T03:33:56.450 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-05-08T03:33:56.451 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout 0 2023-05-08T03:33:56.451 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout ], 2023-05-08T03:33:56.451 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-05-08T03:33:56.451 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "a" 2023-05-08T03:33:56.451 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout ], 2023-05-08T03:33:56.451 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2023-05-08T03:33:56.451 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "monmap": { 2023-05-08T03:33:56.452 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-05-08T03:33:56.452 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-05-08T03:33:56.452 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-05-08T03:33:56.452 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout }, 2023-05-08T03:33:56.452 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-05-08T03:33:56.452 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-05-08T03:33:56.452 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-05-08T03:33:56.452 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-05-08T03:33:56.458 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-05-08T03:33:56.458 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-05-08T03:33:56.458 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-05-08T03:33:56.458 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-05-08T03:33:56.458 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout }, 2023-05-08T03:33:56.459 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-05-08T03:33:56.459 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-05-08T03:33:56.459 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-05-08T03:33:56.459 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-05-08T03:33:56.459 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-05-08T03:33:56.459 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-05-08T03:33:56.459 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-05-08T03:33:56.460 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-05-08T03:33:56.460 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-05-08T03:33:56.460 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout }, 2023-05-08T03:33:56.460 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-05-08T03:33:56.460 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-05-08T03:33:56.460 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-05-08T03:33:56.461 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-05-08T03:33:56.461 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout }, 2023-05-08T03:33:56.461 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-05-08T03:33:56.461 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "available": false, 2023-05-08T03:33:56.461 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-05-08T03:33:56.461 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "modules": [ 2023-05-08T03:33:56.461 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "iostat", 2023-05-08T03:33:56.462 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "nfs", 2023-05-08T03:33:56.462 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "restful" 2023-05-08T03:33:56.462 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout ], 2023-05-08T03:33:56.462 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "services": {} 2023-05-08T03:33:56.462 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout }, 2023-05-08T03:33:56.462 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-05-08T03:33:56.462 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-05-08T03:33:56.462 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "modified": "2023-05-08T03:33:42.766159+0000", 2023-05-08T03:33:56.463 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "services": {} 2023-05-08T03:33:56.463 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout }, 2023-05-08T03:33:56.463 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-05-08T03:33:56.463 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout } 2023-05-08T03:33:56.463 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:55.912+0000 7fefac990700 1 Processor -- start 2023-05-08T03:33:56.463 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:55.912+0000 7fefac990700 1 -- start start 2023-05-08T03:33:56.464 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:55.912+0000 7fefac990700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefa8106770 0x7fefa8108b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:33:56.464 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:55.912+0000 7fefac990700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa8074230 con 0x7fefa8106770 2023-05-08T03:33:56.464 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:55.913+0000 7fefa659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefa8106770 0x7fefa8108b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:33:56.464 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:55.913+0000 7fefa659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefa8106770 0x7fefa8108b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39140/0 (socket says 172.21.15.96:39140) 2023-05-08T03:33:56.464 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:55.913+0000 7fefa659c700 1 -- 172.21.15.96:0/1280194007 learned_addr learned my addr 172.21.15.96:0/1280194007 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:33:56.464 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:55.913+0000 7fefa659c700 1 -- 172.21.15.96:0/1280194007 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefa8074370 con 0x7fefa8106770 2023-05-08T03:33:56.464 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:55.913+0000 7fefa659c700 1 --2- 172.21.15.96:0/1280194007 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefa8106770 0x7fefa8108b50 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fef980098a0 tx=0x7fef98009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e341df2e6642c88a server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:33:56.465 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:55.913+0000 7fefa559a700 1 -- 172.21.15.96:0/1280194007 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef98004160 con 0x7fefa8106770 2023-05-08T03:33:56.465 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:55.913+0000 7fefa559a700 1 -- 172.21.15.96:0/1280194007 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fef980042c0 con 0x7fefa8106770 2023-05-08T03:33:56.465 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:55.913+0000 7fefa559a700 1 -- 172.21.15.96:0/1280194007 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef98011a00 con 0x7fefa8106770 2023-05-08T03:33:56.465 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:55.914+0000 7fefac990700 1 -- 172.21.15.96:0/1280194007 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefa8106770 msgr2=0x7fefa8108b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:33:56.465 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:55.914+0000 7fefac990700 1 --2- 172.21.15.96:0/1280194007 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefa8106770 0x7fefa8108b50 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fef980098a0 tx=0x7fef98009bb0 comp rx=0 tx=0).stop 2023-05-08T03:33:56.465 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:55.914+0000 7fefac990700 1 -- 172.21.15.96:0/1280194007 shutdown_connections 2023-05-08T03:33:56.465 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:55.914+0000 7fefac990700 1 --2- 172.21.15.96:0/1280194007 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefa8106770 0x7fefa8108b50 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:33:56.466 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:55.914+0000 7fefac990700 1 -- 172.21.15.96:0/1280194007 >> 172.21.15.96:0/1280194007 conn(0x7fefa8100170 msgr2=0x7fefa81025a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:33:56.466 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:55.914+0000 7fefac990700 1 -- 172.21.15.96:0/1280194007 shutdown_connections 2023-05-08T03:33:56.466 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:55.914+0000 7fefac990700 1 -- 172.21.15.96:0/1280194007 wait complete. 2023-05-08T03:33:56.466 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:55.915+0000 7fefac990700 1 Processor -- start 2023-05-08T03:33:56.466 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:55.915+0000 7fefac990700 1 -- start start 2023-05-08T03:33:56.466 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:55.915+0000 7fefac990700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefa8106770 0x7fefa81060d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:33:56.466 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:55.915+0000 7fefac990700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa8106610 con 0x7fefa8106770 2023-05-08T03:33:56.467 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:55.915+0000 7fefa659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefa8106770 0x7fefa81060d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:33:56.467 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:55.915+0000 7fefa659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefa8106770 0x7fefa81060d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39142/0 (socket says 172.21.15.96:39142) 2023-05-08T03:33:56.467 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:55.915+0000 7fefa659c700 1 -- 172.21.15.96:0/1856649208 learned_addr learned my addr 172.21.15.96:0/1856649208 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:33:56.467 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:55.916+0000 7fefa659c700 1 -- 172.21.15.96:0/1856649208 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef98009550 con 0x7fefa8106770 2023-05-08T03:33:56.467 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:55.916+0000 7fefa659c700 1 --2- 172.21.15.96:0/1856649208 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefa8106770 0x7fefa81060d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fef98009fb0 tx=0x7fef98011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:33:56.467 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:55.916+0000 7fef977fe700 1 -- 172.21.15.96:0/1856649208 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef98003930 con 0x7fefa8106770 2023-05-08T03:33:56.467 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:55.916+0000 7fefac990700 1 -- 172.21.15.96:0/1856649208 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefa8109e20 con 0x7fefa8106770 2023-05-08T03:33:56.467 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:55.916+0000 7fef977fe700 1 -- 172.21.15.96:0/1856649208 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fef98003a90 con 0x7fefa8106770 2023-05-08T03:33:56.468 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:55.916+0000 7fef977fe700 1 -- 172.21.15.96:0/1856649208 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef980195e0 con 0x7fefa8106770 2023-05-08T03:33:56.468 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:55.916+0000 7fefac990700 1 -- 172.21.15.96:0/1856649208 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefa8109c90 con 0x7fefa8106770 2023-05-08T03:33:56.468 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:55.917+0000 7fefac990700 1 -- 172.21.15.96:0/1856649208 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefa8062220 con 0x7fefa8106770 2023-05-08T03:33:56.468 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:55.918+0000 7fef977fe700 1 -- 172.21.15.96:0/1856649208 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 2) v1 ==== 45239+0+0 (secure 0 0 0) 0x7fef9801a9d0 con 0x7fefa8106770 2023-05-08T03:33:56.468 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:55.918+0000 7fef977fe700 1 -- 172.21.15.96:0/1856649208 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fef9804c470 con 0x7fefa8106770 2023-05-08T03:33:56.468 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:55.920+0000 7fef977fe700 1 -- 172.21.15.96:0/1856649208 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7fef98003c00 con 0x7fefa8106770 2023-05-08T03:33:56.468 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:55.996+0000 7fefac990700 1 -- 172.21.15.96:0/1856649208 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fefa8105230 con 0x7fefa8106770 2023-05-08T03:33:56.469 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:55.996+0000 7fef977fe700 1 -- 172.21.15.96:0/1856649208 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7fef9800bbd0 con 0x7fefa8106770 2023-05-08T03:33:56.469 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:55.997+0000 7fefac990700 1 -- 172.21.15.96:0/1856649208 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefa8106770 msgr2=0x7fefa81060d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:33:56.469 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:55.997+0000 7fefac990700 1 --2- 172.21.15.96:0/1856649208 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefa8106770 0x7fefa81060d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fef98009fb0 tx=0x7fef98011ad0 comp rx=0 tx=0).stop 2023-05-08T03:33:56.469 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:55.997+0000 7fefac990700 1 -- 172.21.15.96:0/1856649208 shutdown_connections 2023-05-08T03:33:56.469 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:55.997+0000 7fefac990700 1 --2- 172.21.15.96:0/1856649208 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefa8106770 0x7fefa81060d0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:33:56.469 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:55.997+0000 7fefac990700 1 -- 172.21.15.96:0/1856649208 >> 172.21.15.96:0/1856649208 conn(0x7fefa8100170 msgr2=0x7fefa8100f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:33:56.469 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:55.997+0000 7fefac990700 1 -- 172.21.15.96:0/1856649208 shutdown_connections 2023-05-08T03:33:56.469 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:33:55.997+0000 7fefac990700 1 -- 172.21.15.96:0/1856649208 wait complete. 2023-05-08T03:33:56.470 INFO:teuthology.orchestra.run.smithi096.stdout:mgr not available, waiting (3/15)... 2023-05-08T03:33:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:56 smithi096 ceph-mon[124666]: from='mgr.14100 172.21.15.96:0/2631599120' entity='mgr.x' 2023-05-08T03:33:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:56 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/1856649208' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-05-08T03:33:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:56 smithi096 ceph-mon[124666]: mgrmap e3: x(active, since 1.00596s) 2023-05-08T03:33:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:33:59 smithi096 ceph-mon[124666]: mgrmap e4: x(active, since 2s) 2023-05-08T03:34:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:00 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/2718853860' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-05-08T03:34:03.515 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout 2023-05-08T03:34:03.516 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout { 2023-05-08T03:34:03.516 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "fsid": "f7ffcfb0-ed50-11ed-9b01-001a4aab830c", 2023-05-08T03:34:03.516 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "health": { 2023-05-08T03:34:03.516 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-05-08T03:34:03.516 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-05-08T03:34:03.516 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-05-08T03:34:03.517 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout }, 2023-05-08T03:34:03.517 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-05-08T03:34:03.517 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-05-08T03:34:03.518 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout 0 2023-05-08T03:34:03.518 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout ], 2023-05-08T03:34:03.518 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-05-08T03:34:03.518 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "a" 2023-05-08T03:34:03.519 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout ], 2023-05-08T03:34:03.519 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "quorum_age": 13, 2023-05-08T03:34:03.519 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "monmap": { 2023-05-08T03:34:03.520 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-05-08T03:34:03.520 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-05-08T03:34:03.520 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-05-08T03:34:03.521 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout }, 2023-05-08T03:34:03.521 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-05-08T03:34:03.521 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-05-08T03:34:03.521 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-05-08T03:34:03.522 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-05-08T03:34:03.522 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-05-08T03:34:03.522 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-05-08T03:34:03.522 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-05-08T03:34:03.523 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-05-08T03:34:03.523 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout }, 2023-05-08T03:34:03.523 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-05-08T03:34:03.524 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-05-08T03:34:03.524 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-05-08T03:34:03.524 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-05-08T03:34:03.536 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-05-08T03:34:03.536 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-05-08T03:34:03.537 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-05-08T03:34:03.537 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-05-08T03:34:03.537 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-05-08T03:34:03.538 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout }, 2023-05-08T03:34:03.538 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-05-08T03:34:03.538 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-05-08T03:34:03.539 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-05-08T03:34:03.539 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-05-08T03:34:03.539 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout }, 2023-05-08T03:34:03.540 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-05-08T03:34:03.540 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "available": true, 2023-05-08T03:34:03.540 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-05-08T03:34:03.540 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "modules": [ 2023-05-08T03:34:03.541 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "iostat", 2023-05-08T03:34:03.541 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "nfs", 2023-05-08T03:34:03.541 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "restful" 2023-05-08T03:34:03.542 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout ], 2023-05-08T03:34:03.542 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "services": {} 2023-05-08T03:34:03.542 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout }, 2023-05-08T03:34:03.542 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-05-08T03:34:03.543 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-05-08T03:34:03.543 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "modified": "2023-05-08T03:33:42.766159+0000", 2023-05-08T03:34:03.543 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "services": {} 2023-05-08T03:34:03.543 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout }, 2023-05-08T03:34:03.544 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-05-08T03:34:03.544 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout } 2023-05-08T03:34:03.544 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:00.268+0000 7fdaaf1ed700 1 Processor -- start 2023-05-08T03:34:03.545 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:00.268+0000 7fdaaf1ed700 1 -- start start 2023-05-08T03:34:03.545 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:00.269+0000 7fdaaf1ed700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdaa8107260 0x7fdaa8107670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:34:03.545 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:00.269+0000 7fdaaf1ed700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa8107bb0 con 0x7fdaa8107260 2023-05-08T03:34:03.545 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:00.269+0000 7fdaacf89700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdaa8107260 0x7fdaa8107670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:34:03.546 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:00.269+0000 7fdaacf89700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdaa8107260 0x7fdaa8107670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39162/0 (socket says 172.21.15.96:39162) 2023-05-08T03:34:03.546 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:00.269+0000 7fdaacf89700 1 -- 172.21.15.96:0/2196677564 learned_addr learned my addr 172.21.15.96:0/2196677564 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:34:03.546 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:00.269+0000 7fdaacf89700 1 -- 172.21.15.96:0/2196677564 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaa8107cf0 con 0x7fdaa8107260 2023-05-08T03:34:03.547 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:00.269+0000 7fdaacf89700 1 --2- 172.21.15.96:0/2196677564 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdaa8107260 0x7fdaa8107670 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fda9c0098a0 tx=0x7fda9c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efff324876836ac5 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:34:03.547 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:00.269+0000 7fdaa77fe700 1 -- 172.21.15.96:0/2196677564 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fda9c004160 con 0x7fdaa8107260 2023-05-08T03:34:03.547 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:00.269+0000 7fdaa77fe700 1 -- 172.21.15.96:0/2196677564 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fda9c0042c0 con 0x7fdaa8107260 2023-05-08T03:34:03.547 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:00.269+0000 7fdaa77fe700 1 -- 172.21.15.96:0/2196677564 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fda9c011a00 con 0x7fdaa8107260 2023-05-08T03:34:03.548 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:00.270+0000 7fdaaf1ed700 1 -- 172.21.15.96:0/2196677564 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdaa8107260 msgr2=0x7fdaa8107670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:34:03.548 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:00.270+0000 7fdaaf1ed700 1 --2- 172.21.15.96:0/2196677564 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdaa8107260 0x7fdaa8107670 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fda9c0098a0 tx=0x7fda9c009bb0 comp rx=0 tx=0).stop 2023-05-08T03:34:03.548 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:00.270+0000 7fdaaf1ed700 1 -- 172.21.15.96:0/2196677564 shutdown_connections 2023-05-08T03:34:03.548 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:00.270+0000 7fdaaf1ed700 1 --2- 172.21.15.96:0/2196677564 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdaa8107260 0x7fdaa8107670 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:03.549 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:00.270+0000 7fdaaf1ed700 1 -- 172.21.15.96:0/2196677564 >> 172.21.15.96:0/2196677564 conn(0x7fdaa80ff930 msgr2=0x7fdaa8101d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:34:03.549 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:00.270+0000 7fdaaf1ed700 1 -- 172.21.15.96:0/2196677564 shutdown_connections 2023-05-08T03:34:03.549 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:00.270+0000 7fdaaf1ed700 1 -- 172.21.15.96:0/2196677564 wait complete. 2023-05-08T03:34:03.550 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:00.270+0000 7fdaaf1ed700 1 Processor -- start 2023-05-08T03:34:03.550 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:00.271+0000 7fdaaf1ed700 1 -- start start 2023-05-08T03:34:03.550 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:00.271+0000 7fdaaf1ed700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdaa8107260 0x7fdaa81998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:34:03.550 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:00.271+0000 7fdaaf1ed700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa8199df0 con 0x7fdaa8107260 2023-05-08T03:34:03.551 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:00.271+0000 7fdaacf89700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdaa8107260 0x7fdaa81998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:34:03.551 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:00.271+0000 7fdaacf89700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdaa8107260 0x7fdaa81998b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39164/0 (socket says 172.21.15.96:39164) 2023-05-08T03:34:03.551 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:00.271+0000 7fdaacf89700 1 -- 172.21.15.96:0/2718853860 learned_addr learned my addr 172.21.15.96:0/2718853860 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:34:03.551 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:00.271+0000 7fdaacf89700 1 -- 172.21.15.96:0/2718853860 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda9c009550 con 0x7fdaa8107260 2023-05-08T03:34:03.552 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:00.271+0000 7fdaacf89700 1 --2- 172.21.15.96:0/2718853860 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdaa8107260 0x7fdaa81998b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fda9c009fb0 tx=0x7fda9c011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:34:03.552 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:00.271+0000 7fdaa5ffb700 1 -- 172.21.15.96:0/2718853860 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fda9c003b70 con 0x7fdaa8107260 2023-05-08T03:34:03.552 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:00.271+0000 7fdaa5ffb700 1 -- 172.21.15.96:0/2718853860 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fda9c003cd0 con 0x7fdaa8107260 2023-05-08T03:34:03.552 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:00.271+0000 7fdaa5ffb700 1 -- 172.21.15.96:0/2718853860 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fda9c024770 con 0x7fdaa8107260 2023-05-08T03:34:03.552 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:00.271+0000 7fdaaf1ed700 1 -- 172.21.15.96:0/2718853860 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaa8104950 con 0x7fdaa8107260 2023-05-08T03:34:03.552 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:00.272+0000 7fdaaf1ed700 1 -- 172.21.15.96:0/2718853860 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaa81047c0 con 0x7fdaa8107260 2023-05-08T03:34:03.552 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:00.272+0000 7fdaaf1ed700 1 -- 172.21.15.96:0/2718853860 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaa8062220 con 0x7fdaa8107260 2023-05-08T03:34:03.553 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:00.273+0000 7fdaa5ffb700 1 -- 172.21.15.96:0/2718853860 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 4) v1 ==== 45472+0+0 (secure 0 0 0) 0x7fda9c01ab40 con 0x7fdaa8107260 2023-05-08T03:34:03.553 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:00.273+0000 7fdaa5ffb700 1 --2- 172.21.15.96:0/2718853860 >> [v2:172.21.15.96:6800/3944122753,v1:172.21.15.96:6801/3944122753] conn(0x7fda98038780 0x7fda9803ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:34:03.554 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:00.273+0000 7fdaa5ffb700 1 -- 172.21.15.96:0/2718853860 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fda9c04c920 con 0x7fdaa8107260 2023-05-08T03:34:03.554 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:00.273+0000 7fdaa7fff700 1 --2- 172.21.15.96:0/2718853860 >> [v2:172.21.15.96:6800/3944122753,v1:172.21.15.96:6801/3944122753] conn(0x7fda98038780 0x7fda9803ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:34:03.554 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:00.274+0000 7fdaa7fff700 1 --2- 172.21.15.96:0/2718853860 >> [v2:172.21.15.96:6800/3944122753,v1:172.21.15.96:6801/3944122753] conn(0x7fda98038780 0x7fda9803ac30 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fda94006fd0 tx=0x7fda94006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:34:03.554 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:00.278+0000 7fdaa5ffb700 1 -- 172.21.15.96:0/2718853860 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fda9c0249e0 con 0x7fdaa8107260 2023-05-08T03:34:03.555 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:00.543+0000 7fdaaf1ed700 1 -- 172.21.15.96:0/2718853860 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fdaa819a330 con 0x7fdaa8107260 2023-05-08T03:34:03.555 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:00.543+0000 7fdaa5ffb700 1 -- 172.21.15.96:0/2718853860 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7fda9c04b090 con 0x7fdaa8107260 2023-05-08T03:34:03.555 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:00.546+0000 7fdaaf1ed700 1 -- 172.21.15.96:0/2718853860 >> [v2:172.21.15.96:6800/3944122753,v1:172.21.15.96:6801/3944122753] conn(0x7fda98038780 msgr2=0x7fda9803ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:34:03.556 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:00.546+0000 7fdaaf1ed700 1 --2- 172.21.15.96:0/2718853860 >> [v2:172.21.15.96:6800/3944122753,v1:172.21.15.96:6801/3944122753] conn(0x7fda98038780 0x7fda9803ac30 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fda94006fd0 tx=0x7fda94006e40 comp rx=0 tx=0).stop 2023-05-08T03:34:03.556 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:00.546+0000 7fdaaf1ed700 1 -- 172.21.15.96:0/2718853860 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdaa8107260 msgr2=0x7fdaa81998b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:34:03.556 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:00.546+0000 7fdaaf1ed700 1 --2- 172.21.15.96:0/2718853860 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdaa8107260 0x7fdaa81998b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fda9c009fb0 tx=0x7fda9c011ad0 comp rx=0 tx=0).stop 2023-05-08T03:34:03.556 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:00.546+0000 7fdaaf1ed700 1 -- 172.21.15.96:0/2718853860 shutdown_connections 2023-05-08T03:34:03.557 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:00.546+0000 7fdaaf1ed700 1 --2- 172.21.15.96:0/2718853860 >> [v2:172.21.15.96:6800/3944122753,v1:172.21.15.96:6801/3944122753] conn(0x7fda98038780 0x7fda9803ac30 secure :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fda94006fd0 tx=0x7fda94006e40 comp rx=0 tx=0).stop 2023-05-08T03:34:03.557 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:00.546+0000 7fdaaf1ed700 1 --2- 172.21.15.96:0/2718853860 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdaa8107260 0x7fdaa81998b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:03.557 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:00.546+0000 7fdaaf1ed700 1 -- 172.21.15.96:0/2718853860 >> 172.21.15.96:0/2718853860 conn(0x7fdaa80ff930 msgr2=0x7fdaa8100660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:34:03.558 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:00.547+0000 7fdaaf1ed700 1 -- 172.21.15.96:0/2718853860 shutdown_connections 2023-05-08T03:34:03.558 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:00.547+0000 7fdaaf1ed700 1 -- 172.21.15.96:0/2718853860 wait complete. 2023-05-08T03:34:03.558 INFO:teuthology.orchestra.run.smithi096.stdout:mgr is available 2023-05-08T03:34:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:05 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/4198723217' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-05-08T03:34:07.178 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout 2023-05-08T03:34:07.178 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout [global] 2023-05-08T03:34:07.178 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout fsid = f7ffcfb0-ed50-11ed-9b01-001a4aab830c 2023-05-08T03:34:07.179 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-05-08T03:34:07.179 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-05-08T03:34:07.179 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-05-08T03:34:07.179 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-05-08T03:34:07.179 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout 2023-05-08T03:34:07.180 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout [mgr] 2023-05-08T03:34:07.180 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-05-08T03:34:07.180 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout 2023-05-08T03:34:07.180 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout [osd] 2023-05-08T03:34:07.180 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-05-08T03:34:07.180 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-05-08T03:34:07.181 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-05-08T03:34:07.181 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-05-08T03:34:07.181 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-05-08T03:34:07.181 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:05.592+0000 7fdff8bc6700 1 Processor -- start 2023-05-08T03:34:07.181 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:05.592+0000 7fdff8bc6700 1 -- start start 2023-05-08T03:34:07.181 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:05.592+0000 7fdff8bc6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdff4106780 0x7fdff4108b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:34:07.182 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:05.592+0000 7fdff8bc6700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdff4079d40 con 0x7fdff4106780 2023-05-08T03:34:07.182 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:05.593+0000 7fdff259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdff4106780 0x7fdff4108b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:34:07.182 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:05.593+0000 7fdff259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdff4106780 0x7fdff4108b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39168/0 (socket says 172.21.15.96:39168) 2023-05-08T03:34:07.182 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:05.593+0000 7fdff259c700 1 -- 172.21.15.96:0/2685751407 learned_addr learned my addr 172.21.15.96:0/2685751407 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:34:07.182 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:05.593+0000 7fdff259c700 1 -- 172.21.15.96:0/2685751407 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff4079e80 con 0x7fdff4106780 2023-05-08T03:34:07.182 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:05.593+0000 7fdff259c700 1 --2- 172.21.15.96:0/2685751407 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdff4106780 0x7fdff4108b60 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fdfe40098a0 tx=0x7fdfe4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbcd8f0f39a3baef server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:34:07.182 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:05.593+0000 7fdff159a700 1 -- 172.21.15.96:0/2685751407 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdfe4004160 con 0x7fdff4106780 2023-05-08T03:34:07.182 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:05.593+0000 7fdff159a700 1 -- 172.21.15.96:0/2685751407 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdfe40042c0 con 0x7fdff4106780 2023-05-08T03:34:07.183 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:05.593+0000 7fdff159a700 1 -- 172.21.15.96:0/2685751407 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdfe4011a00 con 0x7fdff4106780 2023-05-08T03:34:07.183 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:05.594+0000 7fdff8bc6700 1 -- 172.21.15.96:0/2685751407 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdff4106780 msgr2=0x7fdff4108b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:34:07.183 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:05.594+0000 7fdff8bc6700 1 --2- 172.21.15.96:0/2685751407 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdff4106780 0x7fdff4108b60 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fdfe40098a0 tx=0x7fdfe4009bb0 comp rx=0 tx=0).stop 2023-05-08T03:34:07.183 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:05.594+0000 7fdff8bc6700 1 -- 172.21.15.96:0/2685751407 shutdown_connections 2023-05-08T03:34:07.183 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:05.594+0000 7fdff8bc6700 1 --2- 172.21.15.96:0/2685751407 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdff4106780 0x7fdff4108b60 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:07.183 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:05.594+0000 7fdff8bc6700 1 -- 172.21.15.96:0/2685751407 >> 172.21.15.96:0/2685751407 conn(0x7fdff41001e0 msgr2=0x7fdff41025f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:34:07.183 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:05.594+0000 7fdff8bc6700 1 -- 172.21.15.96:0/2685751407 shutdown_connections 2023-05-08T03:34:07.184 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:05.594+0000 7fdff8bc6700 1 -- 172.21.15.96:0/2685751407 wait complete. 2023-05-08T03:34:07.184 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:05.595+0000 7fdff8bc6700 1 Processor -- start 2023-05-08T03:34:07.184 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:05.595+0000 7fdff8bc6700 1 -- start start 2023-05-08T03:34:07.184 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:05.595+0000 7fdff8bc6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdff4106780 0x7fdff41998e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:34:07.184 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:05.595+0000 7fdff8bc6700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdff4199e20 con 0x7fdff4106780 2023-05-08T03:34:07.184 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:05.595+0000 7fdff259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdff4106780 0x7fdff41998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:34:07.184 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:05.595+0000 7fdff259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdff4106780 0x7fdff41998e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39170/0 (socket says 172.21.15.96:39170) 2023-05-08T03:34:07.185 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:05.595+0000 7fdff259c700 1 -- 172.21.15.96:0/4198723217 learned_addr learned my addr 172.21.15.96:0/4198723217 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:34:07.185 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:05.595+0000 7fdff259c700 1 -- 172.21.15.96:0/4198723217 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfe4009550 con 0x7fdff4106780 2023-05-08T03:34:07.185 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:05.595+0000 7fdff259c700 1 --2- 172.21.15.96:0/4198723217 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdff4106780 0x7fdff41998e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdfe4009fb0 tx=0x7fdfe4011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:34:07.185 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:05.595+0000 7fdfe37fe700 1 -- 172.21.15.96:0/4198723217 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdfe4003a40 con 0x7fdff4106780 2023-05-08T03:34:07.185 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:05.595+0000 7fdfe37fe700 1 -- 172.21.15.96:0/4198723217 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdfe4003ba0 con 0x7fdff4106780 2023-05-08T03:34:07.185 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:05.595+0000 7fdff8bc6700 1 -- 172.21.15.96:0/4198723217 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdff4109e30 con 0x7fdff4106780 2023-05-08T03:34:07.186 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:05.595+0000 7fdfe37fe700 1 -- 172.21.15.96:0/4198723217 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdfe401a750 con 0x7fdff4106780 2023-05-08T03:34:07.186 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:05.595+0000 7fdff8bc6700 1 -- 172.21.15.96:0/4198723217 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdff4109ca0 con 0x7fdff4106780 2023-05-08T03:34:07.186 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:05.596+0000 7fdfe37fe700 1 -- 172.21.15.96:0/4198723217 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 4) v1 ==== 45472+0+0 (secure 0 0 0) 0x7fdfe401a980 con 0x7fdff4106780 2023-05-08T03:34:07.186 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:05.596+0000 7fdfe37fe700 1 --2- 172.21.15.96:0/4198723217 >> [v2:172.21.15.96:6800/3944122753,v1:172.21.15.96:6801/3944122753] conn(0x7fdfdc038780 0x7fdfdc03ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:34:07.186 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:05.596+0000 7fdff8bc6700 1 -- 172.21.15.96:0/4198723217 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdff4062220 con 0x7fdff4106780 2023-05-08T03:34:07.186 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:05.596+0000 7fdfe37fe700 1 -- 172.21.15.96:0/4198723217 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fdfe404c2a0 con 0x7fdff4106780 2023-05-08T03:34:07.186 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:05.596+0000 7fdff1d9b700 1 --2- 172.21.15.96:0/4198723217 >> [v2:172.21.15.96:6800/3944122753,v1:172.21.15.96:6801/3944122753] conn(0x7fdfdc038780 0x7fdfdc03ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:34:07.186 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:05.597+0000 7fdff1d9b700 1 --2- 172.21.15.96:0/4198723217 >> [v2:172.21.15.96:6800/3944122753,v1:172.21.15.96:6801/3944122753] conn(0x7fdfdc038780 0x7fdfdc03ac30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fdfe8006fd0 tx=0x7fdfe8006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:34:07.187 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:05.601+0000 7fdfe37fe700 1 -- 172.21.15.96:0/4198723217 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fdfe401ac30 con 0x7fdff4106780 2023-05-08T03:34:07.187 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:05.787+0000 7fdff8bc6700 1 -- 172.21.15.96:0/4198723217 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fdff419d2a0 con 0x7fdff4106780 2023-05-08T03:34:07.187 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:05.788+0000 7fdfe37fe700 1 -- 172.21.15.96:0/4198723217 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7fdfe4048070 con 0x7fdff4106780 2023-05-08T03:34:07.187 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:05.790+0000 7fdff8bc6700 1 -- 172.21.15.96:0/4198723217 >> [v2:172.21.15.96:6800/3944122753,v1:172.21.15.96:6801/3944122753] conn(0x7fdfdc038780 msgr2=0x7fdfdc03ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:34:07.187 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:05.790+0000 7fdff8bc6700 1 --2- 172.21.15.96:0/4198723217 >> [v2:172.21.15.96:6800/3944122753,v1:172.21.15.96:6801/3944122753] conn(0x7fdfdc038780 0x7fdfdc03ac30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fdfe8006fd0 tx=0x7fdfe8006e40 comp rx=0 tx=0).stop 2023-05-08T03:34:07.187 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:05.790+0000 7fdff8bc6700 1 -- 172.21.15.96:0/4198723217 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdff4106780 msgr2=0x7fdff41998e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:34:07.187 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:05.790+0000 7fdff8bc6700 1 --2- 172.21.15.96:0/4198723217 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdff4106780 0x7fdff41998e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdfe4009fb0 tx=0x7fdfe4011ad0 comp rx=0 tx=0).stop 2023-05-08T03:34:07.188 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:05.790+0000 7fdff8bc6700 1 -- 172.21.15.96:0/4198723217 shutdown_connections 2023-05-08T03:34:07.188 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:05.790+0000 7fdff8bc6700 1 --2- 172.21.15.96:0/4198723217 >> [v2:172.21.15.96:6800/3944122753,v1:172.21.15.96:6801/3944122753] conn(0x7fdfdc038780 0x7fdfdc03ac30 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:07.188 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:05.790+0000 7fdff8bc6700 1 --2- 172.21.15.96:0/4198723217 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdff4106780 0x7fdff41998e0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:07.188 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:05.790+0000 7fdff8bc6700 1 -- 172.21.15.96:0/4198723217 >> 172.21.15.96:0/4198723217 conn(0x7fdff41001e0 msgr2=0x7fdff4101860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:34:07.188 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:05.790+0000 7fdff8bc6700 1 -- 172.21.15.96:0/4198723217 shutdown_connections 2023-05-08T03:34:07.188 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:05.790+0000 7fdff8bc6700 1 -- 172.21.15.96:0/4198723217 wait complete. 2023-05-08T03:34:07.189 INFO:teuthology.orchestra.run.smithi096.stdout:Enabling cephadm module... 2023-05-08T03:34:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:08 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/258508660' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2023-05-08T03:34:08.506 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:34:08 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: ignoring --setuser ceph since I am not root 2023-05-08T03:34:08.506 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:34:08 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: ignoring --setgroup ceph since I am not root 2023-05-08T03:34:08.506 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:34:08 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:34:08.411+0000 7f1918ef4200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-05-08T03:34:08.506 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:34:08 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:34:08.491+0000 7f1918ef4200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-08T03:34:08.629 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:07.642+0000 7fda198f8700 1 Processor -- start 2023-05-08T03:34:08.629 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:07.642+0000 7fda198f8700 1 -- start start 2023-05-08T03:34:08.629 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:07.642+0000 7fda198f8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda14106770 0x7fda14108b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:34:08.629 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:07.642+0000 7fda198f8700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda14074230 con 0x7fda14106770 2023-05-08T03:34:08.629 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:07.642+0000 7fda12ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda14106770 0x7fda14108b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:34:08.630 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:07.642+0000 7fda12ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda14106770 0x7fda14108b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39174/0 (socket says 172.21.15.96:39174) 2023-05-08T03:34:08.630 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:07.642+0000 7fda12ffd700 1 -- 172.21.15.96:0/2608808495 learned_addr learned my addr 172.21.15.96:0/2608808495 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:34:08.630 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:07.643+0000 7fda12ffd700 1 -- 172.21.15.96:0/2608808495 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda14074370 con 0x7fda14106770 2023-05-08T03:34:08.630 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:07.643+0000 7fda12ffd700 1 --2- 172.21.15.96:0/2608808495 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda14106770 0x7fda14108b50 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fda080098a0 tx=0x7fda08009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc0e37e722bb741a server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:34:08.630 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:07.643+0000 7fda11ffb700 1 -- 172.21.15.96:0/2608808495 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fda08004160 con 0x7fda14106770 2023-05-08T03:34:08.630 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:07.643+0000 7fda11ffb700 1 -- 172.21.15.96:0/2608808495 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fda080042c0 con 0x7fda14106770 2023-05-08T03:34:08.630 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:07.643+0000 7fda11ffb700 1 -- 172.21.15.96:0/2608808495 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fda08011a00 con 0x7fda14106770 2023-05-08T03:34:08.631 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:07.644+0000 7fda198f8700 1 -- 172.21.15.96:0/2608808495 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda14106770 msgr2=0x7fda14108b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:34:08.631 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:07.644+0000 7fda198f8700 1 --2- 172.21.15.96:0/2608808495 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda14106770 0x7fda14108b50 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fda080098a0 tx=0x7fda08009bb0 comp rx=0 tx=0).stop 2023-05-08T03:34:08.631 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:07.644+0000 7fda198f8700 1 -- 172.21.15.96:0/2608808495 shutdown_connections 2023-05-08T03:34:08.631 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:07.644+0000 7fda198f8700 1 --2- 172.21.15.96:0/2608808495 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda14106770 0x7fda14108b50 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:08.631 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:07.644+0000 7fda198f8700 1 -- 172.21.15.96:0/2608808495 >> 172.21.15.96:0/2608808495 conn(0x7fda14100170 msgr2=0x7fda141025a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:34:08.631 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:07.644+0000 7fda198f8700 1 -- 172.21.15.96:0/2608808495 shutdown_connections 2023-05-08T03:34:08.631 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:07.644+0000 7fda198f8700 1 -- 172.21.15.96:0/2608808495 wait complete. 2023-05-08T03:34:08.631 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:07.644+0000 7fda198f8700 1 Processor -- start 2023-05-08T03:34:08.632 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:07.644+0000 7fda198f8700 1 -- start start 2023-05-08T03:34:08.632 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:07.645+0000 7fda198f8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda14106770 0x7fda14199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:34:08.632 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:07.645+0000 7fda198f8700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda14199d60 con 0x7fda14106770 2023-05-08T03:34:08.632 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:07.645+0000 7fda12ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda14106770 0x7fda14199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:34:08.632 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:07.645+0000 7fda12ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda14106770 0x7fda14199820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39176/0 (socket says 172.21.15.96:39176) 2023-05-08T03:34:08.632 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:07.645+0000 7fda12ffd700 1 -- 172.21.15.96:0/258508660 learned_addr learned my addr 172.21.15.96:0/258508660 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:34:08.632 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:07.645+0000 7fda12ffd700 1 -- 172.21.15.96:0/258508660 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda08009550 con 0x7fda14106770 2023-05-08T03:34:08.633 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:07.645+0000 7fda12ffd700 1 --2- 172.21.15.96:0/258508660 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda14106770 0x7fda14199820 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fda08009fb0 tx=0x7fda08011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:34:08.633 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:07.645+0000 7fda188f6700 1 -- 172.21.15.96:0/258508660 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fda08003930 con 0x7fda14106770 2023-05-08T03:34:08.633 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:07.645+0000 7fda188f6700 1 -- 172.21.15.96:0/258508660 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fda08003a90 con 0x7fda14106770 2023-05-08T03:34:08.633 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:07.645+0000 7fda198f8700 1 -- 172.21.15.96:0/258508660 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda14109e20 con 0x7fda14106770 2023-05-08T03:34:08.633 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:07.645+0000 7fda188f6700 1 -- 172.21.15.96:0/258508660 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fda080195e0 con 0x7fda14106770 2023-05-08T03:34:08.633 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:07.645+0000 7fda198f8700 1 -- 172.21.15.96:0/258508660 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda14109c90 con 0x7fda14106770 2023-05-08T03:34:08.633 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:07.646+0000 7fda188f6700 1 -- 172.21.15.96:0/258508660 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 4) v1 ==== 45472+0+0 (secure 0 0 0) 0x7fda08019850 con 0x7fda14106770 2023-05-08T03:34:08.633 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:07.646+0000 7fda198f8700 1 -- 172.21.15.96:0/258508660 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda14062220 con 0x7fda14106770 2023-05-08T03:34:08.634 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:07.646+0000 7fda188f6700 1 --2- 172.21.15.96:0/258508660 >> [v2:172.21.15.96:6800/3944122753,v1:172.21.15.96:6801/3944122753] conn(0x7fd9fc038780 0x7fd9fc03ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:34:08.634 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:07.646+0000 7fda188f6700 1 -- 172.21.15.96:0/258508660 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fda0804c610 con 0x7fda14106770 2023-05-08T03:34:08.634 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:07.647+0000 7fda127fc700 1 --2- 172.21.15.96:0/258508660 >> [v2:172.21.15.96:6800/3944122753,v1:172.21.15.96:6801/3944122753] conn(0x7fd9fc038780 0x7fd9fc03ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:34:08.634 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:07.647+0000 7fda127fc700 1 --2- 172.21.15.96:0/258508660 >> [v2:172.21.15.96:6800/3944122753,v1:172.21.15.96:6801/3944122753] conn(0x7fd9fc038780 0x7fd9fc03ac30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fda04006fd0 tx=0x7fda04006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:34:08.634 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:07.651+0000 7fda188f6700 1 -- 172.21.15.96:0/258508660 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fda08019b00 con 0x7fda14106770 2023-05-08T03:34:08.634 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:07.888+0000 7fda198f8700 1 -- 172.21.15.96:0/258508660 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7fda1419d1e0 con 0x7fda14106770 2023-05-08T03:34:08.634 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:08.249+0000 7fda188f6700 1 -- 172.21.15.96:0/258508660 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mgrmap(e 5) v1 ==== 45483+0+0 (secure 0 0 0) 0x7fda0802d960 con 0x7fda14106770 2023-05-08T03:34:08.635 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:08.250+0000 7fda188f6700 1 -- 172.21.15.96:0/258508660 <== mon.0 v2:172.21.15.96:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7fda0804c370 con 0x7fda14106770 2023-05-08T03:34:08.635 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:08.253+0000 7fda198f8700 1 -- 172.21.15.96:0/258508660 >> [v2:172.21.15.96:6800/3944122753,v1:172.21.15.96:6801/3944122753] conn(0x7fd9fc038780 msgr2=0x7fd9fc03ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:34:08.635 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:08.253+0000 7fda198f8700 1 --2- 172.21.15.96:0/258508660 >> [v2:172.21.15.96:6800/3944122753,v1:172.21.15.96:6801/3944122753] conn(0x7fd9fc038780 0x7fd9fc03ac30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fda04006fd0 tx=0x7fda04006e40 comp rx=0 tx=0).stop 2023-05-08T03:34:08.635 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:08.253+0000 7fda198f8700 1 -- 172.21.15.96:0/258508660 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda14106770 msgr2=0x7fda14199820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:34:08.635 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:08.253+0000 7fda198f8700 1 --2- 172.21.15.96:0/258508660 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda14106770 0x7fda14199820 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fda08009fb0 tx=0x7fda08011ad0 comp rx=0 tx=0).stop 2023-05-08T03:34:08.635 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:08.253+0000 7fda198f8700 1 -- 172.21.15.96:0/258508660 shutdown_connections 2023-05-08T03:34:08.635 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:08.253+0000 7fda198f8700 1 --2- 172.21.15.96:0/258508660 >> [v2:172.21.15.96:6800/3944122753,v1:172.21.15.96:6801/3944122753] conn(0x7fd9fc038780 0x7fd9fc03ac30 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:08.635 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:08.253+0000 7fda198f8700 1 --2- 172.21.15.96:0/258508660 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda14106770 0x7fda14199820 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:08.636 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:08.253+0000 7fda198f8700 1 -- 172.21.15.96:0/258508660 >> 172.21.15.96:0/258508660 conn(0x7fda14100170 msgr2=0x7fda14100f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:34:08.636 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:08.253+0000 7fda198f8700 1 -- 172.21.15.96:0/258508660 shutdown_connections 2023-05-08T03:34:08.636 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:08.253+0000 7fda198f8700 1 -- 172.21.15.96:0/258508660 wait complete. 2023-05-08T03:34:08.857 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:34:08 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:34:08.581+0000 7f1918ef4200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-08T03:34:08.857 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:34:08 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:34:08.679+0000 7f1918ef4200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-08T03:34:09.179 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:34:08 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:34:08.855+0000 7f1918ef4200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-08T03:34:09.439 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:09 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/258508660' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2023-05-08T03:34:09.440 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:09 smithi096 ceph-mon[124666]: mgrmap e5: x(active, since 12s) 2023-05-08T03:34:09.440 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:34:09 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:34:09.176+0000 7f1918ef4200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-08T03:34:09.440 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:34:09 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:34:09.267+0000 7f1918ef4200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-08T03:34:09.440 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:34:09 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:34:09.399+0000 7f1918ef4200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-08T03:34:09.755 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:34:09 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:34:09.503+0000 7f1918ef4200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-08T03:34:09.774 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout { 2023-05-08T03:34:09.774 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "epoch": 5, 2023-05-08T03:34:09.774 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "available": true, 2023-05-08T03:34:09.774 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "active_name": "x", 2023-05-08T03:34:09.774 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-05-08T03:34:09.775 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout } 2023-05-08T03:34:09.775 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:09.158+0000 7f9ed9b63700 1 Processor -- start 2023-05-08T03:34:09.775 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:09.158+0000 7f9ed9b63700 1 -- start start 2023-05-08T03:34:09.775 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:09.158+0000 7f9ed9b63700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ed4104b20 0x7f9ed4104f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:34:09.775 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:09.158+0000 7f9ed9b63700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed4105470 con 0x7f9ed4104b20 2023-05-08T03:34:09.775 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:09.159+0000 7f9ed37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ed4104b20 0x7f9ed4104f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:34:09.775 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:09.159+0000 7f9ed37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ed4104b20 0x7f9ed4104f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39190/0 (socket says 172.21.15.96:39190) 2023-05-08T03:34:09.776 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:09.159+0000 7f9ed37fe700 1 -- 172.21.15.96:0/3009262200 learned_addr learned my addr 172.21.15.96:0/3009262200 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:34:09.776 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:09.159+0000 7f9ed37fe700 1 -- 172.21.15.96:0/3009262200 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ed41055b0 con 0x7f9ed4104b20 2023-05-08T03:34:09.776 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:09.159+0000 7f9ed37fe700 1 --2- 172.21.15.96:0/3009262200 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ed4104b20 0x7f9ed4104f30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc0098a0 tx=0x7f9ecc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c414967136f8d0e server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:34:09.776 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:09.159+0000 7f9ed27fc700 1 -- 172.21.15.96:0/3009262200 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9ecc004160 con 0x7f9ed4104b20 2023-05-08T03:34:09.776 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:09.159+0000 7f9ed27fc700 1 -- 172.21.15.96:0/3009262200 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9ecc0042c0 con 0x7f9ed4104b20 2023-05-08T03:34:09.776 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:09.159+0000 7f9ed27fc700 1 -- 172.21.15.96:0/3009262200 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9ecc011a00 con 0x7f9ed4104b20 2023-05-08T03:34:09.776 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:09.160+0000 7f9ed9b63700 1 -- 172.21.15.96:0/3009262200 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ed4104b20 msgr2=0x7f9ed4104f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:34:09.777 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:09.160+0000 7f9ed9b63700 1 --2- 172.21.15.96:0/3009262200 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ed4104b20 0x7f9ed4104f30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc0098a0 tx=0x7f9ecc009bb0 comp rx=0 tx=0).stop 2023-05-08T03:34:09.777 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:09.160+0000 7f9ed9b63700 1 -- 172.21.15.96:0/3009262200 shutdown_connections 2023-05-08T03:34:09.777 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:09.160+0000 7f9ed9b63700 1 --2- 172.21.15.96:0/3009262200 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ed4104b20 0x7f9ed4104f30 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:09.777 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:09.160+0000 7f9ed9b63700 1 -- 172.21.15.96:0/3009262200 >> 172.21.15.96:0/3009262200 conn(0x7f9ed4100170 msgr2=0x7f9ed41025a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:34:09.777 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:09.160+0000 7f9ed9b63700 1 -- 172.21.15.96:0/3009262200 shutdown_connections 2023-05-08T03:34:09.777 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:09.160+0000 7f9ed9b63700 1 -- 172.21.15.96:0/3009262200 wait complete. 2023-05-08T03:34:09.777 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:09.161+0000 7f9ed9b63700 1 Processor -- start 2023-05-08T03:34:09.777 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:09.161+0000 7f9ed9b63700 1 -- start start 2023-05-08T03:34:09.778 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:09.161+0000 7f9ed9b63700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ed4104b20 0x7f9ed41987c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:34:09.778 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:09.161+0000 7f9ed9b63700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed4198d00 con 0x7f9ed4104b20 2023-05-08T03:34:09.778 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:09.161+0000 7f9ed37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ed4104b20 0x7f9ed41987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:34:09.778 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:09.161+0000 7f9ed37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ed4104b20 0x7f9ed41987c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39192/0 (socket says 172.21.15.96:39192) 2023-05-08T03:34:09.778 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:09.161+0000 7f9ed37fe700 1 -- 172.21.15.96:0/4152199478 learned_addr learned my addr 172.21.15.96:0/4152199478 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:34:09.778 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:09.161+0000 7f9ed37fe700 1 -- 172.21.15.96:0/4152199478 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ecc009550 con 0x7f9ed4104b20 2023-05-08T03:34:09.778 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:09.162+0000 7f9ed37fe700 1 --2- 172.21.15.96:0/4152199478 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ed4104b20 0x7f9ed41987c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc006af0 tx=0x7f9ecc011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:34:09.779 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:09.162+0000 7f9ed0ff9700 1 -- 172.21.15.96:0/4152199478 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9ecc003a40 con 0x7f9ed4104b20 2023-05-08T03:34:09.779 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:09.162+0000 7f9ed0ff9700 1 -- 172.21.15.96:0/4152199478 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9ecc003ba0 con 0x7f9ed4104b20 2023-05-08T03:34:09.779 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:09.162+0000 7f9ed9b63700 1 -- 172.21.15.96:0/4152199478 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ed4106b70 con 0x7f9ed4104b20 2023-05-08T03:34:09.779 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:09.162+0000 7f9ed0ff9700 1 -- 172.21.15.96:0/4152199478 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9ecc01a6e0 con 0x7f9ed4104b20 2023-05-08T03:34:09.779 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:09.162+0000 7f9ed9b63700 1 -- 172.21.15.96:0/4152199478 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ed41069e0 con 0x7f9ed4104b20 2023-05-08T03:34:09.779 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:09.163+0000 7f9ed0ff9700 1 -- 172.21.15.96:0/4152199478 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 45483+0+0 (secure 0 0 0) 0x7f9ecc01a860 con 0x7f9ed4104b20 2023-05-08T03:34:09.779 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:09.163+0000 7f9ed9b63700 1 -- 172.21.15.96:0/4152199478 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ed4062220 con 0x7f9ed4104b20 2023-05-08T03:34:09.779 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:09.163+0000 7f9ed0ff9700 1 --2- 172.21.15.96:0/4152199478 >> [v2:172.21.15.96:6800/3944122753,v1:172.21.15.96:6801/3944122753] conn(0x7f9ec0038820 0x7f9ec003acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:34:09.780 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:09.163+0000 7f9ed2ffd700 1 -- 172.21.15.96:0/4152199478 >> [v2:172.21.15.96:6800/3944122753,v1:172.21.15.96:6801/3944122753] conn(0x7f9ec0038820 msgr2=0x7f9ec003acd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:6800/3944122753 2023-05-08T03:34:09.780 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:09.163+0000 7f9ed0ff9700 1 -- 172.21.15.96:0/4152199478 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f9ecc04c6c0 con 0x7f9ed4104b20 2023-05-08T03:34:09.780 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:09.163+0000 7f9ed2ffd700 1 --2- 172.21.15.96:0/4152199478 >> [v2:172.21.15.96:6800/3944122753,v1:172.21.15.96:6801/3944122753] conn(0x7f9ec0038820 0x7f9ec003acd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-05-08T03:34:09.780 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:09.168+0000 7f9ed0ff9700 1 -- 172.21.15.96:0/4152199478 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f9ecc02d910 con 0x7f9ed4104b20 2023-05-08T03:34:09.780 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:09.364+0000 7f9ed2ffd700 1 -- 172.21.15.96:0/4152199478 >> [v2:172.21.15.96:6800/3944122753,v1:172.21.15.96:6801/3944122753] conn(0x7f9ec0038820 msgr2=0x7f9ec003acd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:6800/3944122753 2023-05-08T03:34:09.780 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:09.364+0000 7f9ed2ffd700 1 --2- 172.21.15.96:0/4152199478 >> [v2:172.21.15.96:6800/3944122753,v1:172.21.15.96:6801/3944122753] conn(0x7f9ec0038820 0x7f9ec003acd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-05-08T03:34:09.780 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:09.414+0000 7f9ed9b63700 1 -- 172.21.15.96:0/4152199478 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f9ed419c470 con 0x7f9ed4104b20 2023-05-08T03:34:09.781 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:09.414+0000 7f9ed0ff9700 1 -- 172.21.15.96:0/4152199478 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+88 (secure 0 0 0) 0x7f9ecc018350 con 0x7f9ed4104b20 2023-05-08T03:34:09.781 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:09.416+0000 7f9ed9b63700 1 -- 172.21.15.96:0/4152199478 >> [v2:172.21.15.96:6800/3944122753,v1:172.21.15.96:6801/3944122753] conn(0x7f9ec0038820 msgr2=0x7f9ec003acd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-08T03:34:09.781 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:09.416+0000 7f9ed9b63700 1 --2- 172.21.15.96:0/4152199478 >> [v2:172.21.15.96:6800/3944122753,v1:172.21.15.96:6801/3944122753] conn(0x7f9ec0038820 0x7f9ec003acd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:09.781 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:09.416+0000 7f9ed9b63700 1 -- 172.21.15.96:0/4152199478 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ed4104b20 msgr2=0x7f9ed41987c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:34:09.781 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:09.416+0000 7f9ed9b63700 1 --2- 172.21.15.96:0/4152199478 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ed4104b20 0x7f9ed41987c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc006af0 tx=0x7f9ecc011ad0 comp rx=0 tx=0).stop 2023-05-08T03:34:09.781 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:09.416+0000 7f9ed9b63700 1 -- 172.21.15.96:0/4152199478 shutdown_connections 2023-05-08T03:34:09.781 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:09.416+0000 7f9ed9b63700 1 --2- 172.21.15.96:0/4152199478 >> [v2:172.21.15.96:6800/3944122753,v1:172.21.15.96:6801/3944122753] conn(0x7f9ec0038820 0x7f9ec003acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:09.781 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:09.416+0000 7f9ed9b63700 1 --2- 172.21.15.96:0/4152199478 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ed4104b20 0x7f9ed41987c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:09.782 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:09.416+0000 7f9ed9b63700 1 -- 172.21.15.96:0/4152199478 >> 172.21.15.96:0/4152199478 conn(0x7f9ed4100170 msgr2=0x7f9ed4100e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:34:09.782 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:09.416+0000 7f9ed9b63700 1 -- 172.21.15.96:0/4152199478 shutdown_connections 2023-05-08T03:34:09.782 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:09.416+0000 7f9ed9b63700 1 -- 172.21.15.96:0/4152199478 wait complete. 2023-05-08T03:34:09.782 INFO:teuthology.orchestra.run.smithi096.stdout:Waiting for the mgr to restart... 2023-05-08T03:34:09.782 INFO:teuthology.orchestra.run.smithi096.stdout:Waiting for mgr epoch 5... 2023-05-08T03:34:10.042 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:34:09 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:34:09.942+0000 7f1918ef4200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-08T03:34:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:10 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/4152199478' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-05-08T03:34:11.005 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:34:10 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:34:10.524+0000 7f1918ef4200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-08T03:34:11.005 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:34:10 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:34:10.691+0000 7f1918ef4200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-08T03:34:11.701 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:34:11 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:34:11.440+0000 7f1918ef4200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-08T03:34:11.702 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:34:11 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:34:11.529+0000 7f1918ef4200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-05-08T03:34:12.255 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:34:11 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:34:11.699+0000 7f1918ef4200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-08T03:34:12.255 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:34:11 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:34:11.972+0000 7f1918ef4200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-05-08T03:34:12.255 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:34:12 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:34:12.195+0000 7f1918ef4200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-08T03:34:12.600 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:34:12 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:34:12.340+0000 7f1918ef4200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-08T03:34:13.005 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:34:12 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:34:12.598+0000 7f1918ef4200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-08T03:34:13.621 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:34:13 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:34:13.300+0000 7f1918ef4200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-08T03:34:13.622 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:34:13 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:34:13.429+0000 7f1918ef4200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-08T03:34:13.948 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:34:13 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:34:13.619+0000 7f1918ef4200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-08T03:34:13.949 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:34:13 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:34:13.731+0000 7f1918ef4200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-08T03:34:14.255 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:34:13 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:34:13.946+0000 7f1918ef4200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-08T03:34:15.255 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:34:14 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:34:14.785+0000 7f1918ef4200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-08T03:34:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:14 smithi096 ceph-mon[124666]: Active manager daemon x restarted 2023-05-08T03:34:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:14 smithi096 ceph-mon[124666]: Activating manager daemon x 2023-05-08T03:34:15.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:14 smithi096 ceph-mon[124666]: osdmap e2: 0 total, 0 up, 0 in 2023-05-08T03:34:15.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:14 smithi096 ceph-mon[124666]: mgrmap e6: x(active, starting, since 0.00377299s) 2023-05-08T03:34:15.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:14 smithi096 ceph-mon[124666]: from='mgr.14120 172.21.15.96:0/187696170' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-05-08T03:34:15.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:14 smithi096 ceph-mon[124666]: from='mgr.14120 172.21.15.96:0/187696170' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-05-08T03:34:15.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:14 smithi096 ceph-mon[124666]: from='mgr.14120 172.21.15.96:0/187696170' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-05-08T03:34:15.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:14 smithi096 ceph-mon[124666]: from='mgr.14120 172.21.15.96:0/187696170' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-05-08T03:34:15.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:14 smithi096 ceph-mon[124666]: from='mgr.14120 172.21.15.96:0/187696170' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-05-08T03:34:15.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:14 smithi096 ceph-mon[124666]: Manager daemon x is now available 2023-05-08T03:34:15.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:14 smithi096 ceph-mon[124666]: from='mgr.14120 172.21.15.96:0/187696170' entity='mgr.x' 2023-05-08T03:34:15.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:14 smithi096 ceph-mon[124666]: from='mgr.14120 172.21.15.96:0/187696170' entity='mgr.x' 2023-05-08T03:34:15.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:14 smithi096 ceph-mon[124666]: from='mgr.14120 172.21.15.96:0/187696170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:34:15.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:14 smithi096 ceph-mon[124666]: from='mgr.14120 172.21.15.96:0/187696170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:34:15.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:14 smithi096 ceph-mon[124666]: from='mgr.14120 172.21.15.96:0/187696170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:34:16.219 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:15 smithi096 ceph-mon[124666]: Found migration_current of "None". Setting to last migration. 2023-05-08T03:34:16.219 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:15 smithi096 ceph-mon[124666]: from='mgr.14120 172.21.15.96:0/187696170' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-05-08T03:34:16.219 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:15 smithi096 ceph-mon[124666]: from='mgr.14120 172.21.15.96:0/187696170' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-05-08T03:34:16.219 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:15 smithi096 ceph-mon[124666]: mgrmap e7: x(active, since 1.00524s) 2023-05-08T03:34:16.240 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout { 2023-05-08T03:34:16.241 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2023-05-08T03:34:16.241 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "initialized": true 2023-05-08T03:34:16.241 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout } 2023-05-08T03:34:16.241 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:10.247+0000 7ff443737700 1 Processor -- start 2023-05-08T03:34:16.241 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:10.248+0000 7ff443737700 1 -- start start 2023-05-08T03:34:16.242 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:10.248+0000 7ff443737700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff43c104b20 0x7ff43c104f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:34:16.242 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:10.248+0000 7ff443737700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff43c105470 con 0x7ff43c104b20 2023-05-08T03:34:16.242 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:10.248+0000 7ff4414d3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff43c104b20 0x7ff43c104f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:34:16.242 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:10.248+0000 7ff4414d3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff43c104b20 0x7ff43c104f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39200/0 (socket says 172.21.15.96:39200) 2023-05-08T03:34:16.242 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:10.248+0000 7ff4414d3700 1 -- 172.21.15.96:0/2189554129 learned_addr learned my addr 172.21.15.96:0/2189554129 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:34:16.242 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:10.248+0000 7ff4414d3700 1 -- 172.21.15.96:0/2189554129 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff43c1055b0 con 0x7ff43c104b20 2023-05-08T03:34:16.243 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:10.248+0000 7ff4414d3700 1 --2- 172.21.15.96:0/2189554129 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff43c104b20 0x7ff43c104f30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff4380098a0 tx=0x7ff438009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70836a6d457487cf server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:34:16.243 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:10.248+0000 7ff433fff700 1 -- 172.21.15.96:0/2189554129 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff438004160 con 0x7ff43c104b20 2023-05-08T03:34:16.243 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:10.253+0000 7ff433fff700 1 -- 172.21.15.96:0/2189554129 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff4380042c0 con 0x7ff43c104b20 2023-05-08T03:34:16.243 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:10.253+0000 7ff433fff700 1 -- 172.21.15.96:0/2189554129 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff438011a00 con 0x7ff43c104b20 2023-05-08T03:34:16.243 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:10.253+0000 7ff443737700 1 -- 172.21.15.96:0/2189554129 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff43c104b20 msgr2=0x7ff43c104f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:34:16.243 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:10.253+0000 7ff443737700 1 --2- 172.21.15.96:0/2189554129 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff43c104b20 0x7ff43c104f30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff4380098a0 tx=0x7ff438009bb0 comp rx=0 tx=0).stop 2023-05-08T03:34:16.244 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:10.253+0000 7ff443737700 1 -- 172.21.15.96:0/2189554129 shutdown_connections 2023-05-08T03:34:16.244 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:10.253+0000 7ff443737700 1 --2- 172.21.15.96:0/2189554129 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff43c104b20 0x7ff43c104f30 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:16.244 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:10.253+0000 7ff443737700 1 -- 172.21.15.96:0/2189554129 >> 172.21.15.96:0/2189554129 conn(0x7ff43c100170 msgr2=0x7ff43c1025a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:34:16.244 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:10.254+0000 7ff443737700 1 -- 172.21.15.96:0/2189554129 shutdown_connections 2023-05-08T03:34:16.244 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:10.254+0000 7ff443737700 1 -- 172.21.15.96:0/2189554129 wait complete. 2023-05-08T03:34:16.244 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:10.254+0000 7ff443737700 1 Processor -- start 2023-05-08T03:34:16.244 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:10.254+0000 7ff443737700 1 -- start start 2023-05-08T03:34:16.245 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:10.254+0000 7ff443737700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff43c104b20 0x7ff43c199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:34:16.245 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:10.254+0000 7ff443737700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff43c199dc0 con 0x7ff43c104b20 2023-05-08T03:34:16.245 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:10.254+0000 7ff4414d3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff43c104b20 0x7ff43c199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:34:16.245 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:10.255+0000 7ff4414d3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff43c104b20 0x7ff43c199880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39202/0 (socket says 172.21.15.96:39202) 2023-05-08T03:34:16.245 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:10.255+0000 7ff4414d3700 1 -- 172.21.15.96:0/3377730673 learned_addr learned my addr 172.21.15.96:0/3377730673 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:34:16.245 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:10.255+0000 7ff4414d3700 1 -- 172.21.15.96:0/3377730673 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff438009550 con 0x7ff43c104b20 2023-05-08T03:34:16.245 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:10.255+0000 7ff4414d3700 1 --2- 172.21.15.96:0/3377730673 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff43c104b20 0x7ff43c199880 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff438009fb0 tx=0x7ff438011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:34:16.245 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:10.255+0000 7ff4327fc700 1 -- 172.21.15.96:0/3377730673 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff438003930 con 0x7ff43c104b20 2023-05-08T03:34:16.246 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:10.255+0000 7ff443737700 1 -- 172.21.15.96:0/3377730673 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff43c106b70 con 0x7ff43c104b20 2023-05-08T03:34:16.246 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:10.255+0000 7ff4327fc700 1 -- 172.21.15.96:0/3377730673 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff438003a90 con 0x7ff43c104b20 2023-05-08T03:34:16.246 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:10.255+0000 7ff4327fc700 1 -- 172.21.15.96:0/3377730673 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff438019610 con 0x7ff43c104b20 2023-05-08T03:34:16.246 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:10.255+0000 7ff443737700 1 -- 172.21.15.96:0/3377730673 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff43c1069e0 con 0x7ff43c104b20 2023-05-08T03:34:16.246 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:10.256+0000 7ff4327fc700 1 -- 172.21.15.96:0/3377730673 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 45483+0+0 (secure 0 0 0) 0x7ff4380198d0 con 0x7ff43c104b20 2023-05-08T03:34:16.246 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:10.256+0000 7ff4327fc700 1 --2- 172.21.15.96:0/3377730673 >> [v2:172.21.15.96:6800/3944122753,v1:172.21.15.96:6801/3944122753] conn(0x7ff428038780 0x7ff42803ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:34:16.246 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:10.256+0000 7ff4327fc700 1 -- 172.21.15.96:0/3377730673 --> [v2:172.21.15.96:6800/3944122753,v1:172.21.15.96:6801/3944122753] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff42803b340 con 0x7ff428038780 2023-05-08T03:34:16.247 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:10.256+0000 7ff4327fc700 1 -- 172.21.15.96:0/3377730673 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7ff43804c720 con 0x7ff43c104b20 2023-05-08T03:34:16.247 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:10.256+0000 7ff440cd2700 1 -- 172.21.15.96:0/3377730673 >> [v2:172.21.15.96:6800/3944122753,v1:172.21.15.96:6801/3944122753] conn(0x7ff428038780 msgr2=0x7ff42803ac30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:6800/3944122753 2023-05-08T03:34:16.247 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:10.256+0000 7ff440cd2700 1 --2- 172.21.15.96:0/3377730673 >> [v2:172.21.15.96:6800/3944122753,v1:172.21.15.96:6801/3944122753] conn(0x7ff428038780 0x7ff42803ac30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-05-08T03:34:16.247 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:10.457+0000 7ff440cd2700 1 -- 172.21.15.96:0/3377730673 >> [v2:172.21.15.96:6800/3944122753,v1:172.21.15.96:6801/3944122753] conn(0x7ff428038780 msgr2=0x7ff42803ac30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:6800/3944122753 2023-05-08T03:34:16.247 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:10.457+0000 7ff440cd2700 1 --2- 172.21.15.96:0/3377730673 >> [v2:172.21.15.96:6800/3944122753,v1:172.21.15.96:6801/3944122753] conn(0x7ff428038780 0x7ff42803ac30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-05-08T03:34:16.247 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:10.858+0000 7ff440cd2700 1 -- 172.21.15.96:0/3377730673 >> [v2:172.21.15.96:6800/3944122753,v1:172.21.15.96:6801/3944122753] conn(0x7ff428038780 msgr2=0x7ff42803ac30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:6800/3944122753 2023-05-08T03:34:16.248 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:10.858+0000 7ff440cd2700 1 --2- 172.21.15.96:0/3377730673 >> [v2:172.21.15.96:6800/3944122753,v1:172.21.15.96:6801/3944122753] conn(0x7ff428038780 0x7ff42803ac30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-05-08T03:34:16.248 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:11.659+0000 7ff440cd2700 1 -- 172.21.15.96:0/3377730673 >> [v2:172.21.15.96:6800/3944122753,v1:172.21.15.96:6801/3944122753] conn(0x7ff428038780 msgr2=0x7ff42803ac30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:6800/3944122753 2023-05-08T03:34:16.248 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:11.659+0000 7ff440cd2700 1 --2- 172.21.15.96:0/3377730673 >> [v2:172.21.15.96:6800/3944122753,v1:172.21.15.96:6801/3944122753] conn(0x7ff428038780 0x7ff42803ac30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-05-08T03:34:16.248 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:13.260+0000 7ff440cd2700 1 -- 172.21.15.96:0/3377730673 >> [v2:172.21.15.96:6800/3944122753,v1:172.21.15.96:6801/3944122753] conn(0x7ff428038780 msgr2=0x7ff42803ac30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:6800/3944122753 2023-05-08T03:34:16.248 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:13.260+0000 7ff440cd2700 1 --2- 172.21.15.96:0/3377730673 >> [v2:172.21.15.96:6800/3944122753,v1:172.21.15.96:6801/3944122753] conn(0x7ff428038780 0x7ff42803ac30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-05-08T03:34:16.248 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:14.801+0000 7ff4327fc700 1 -- 172.21.15.96:0/3377730673 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mgrmap(e 6) v1 ==== 45250+0+0 (secure 0 0 0) 0x7ff43802d9b0 con 0x7ff43c104b20 2023-05-08T03:34:16.249 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:14.802+0000 7ff4327fc700 1 -- 172.21.15.96:0/3377730673 >> [v2:172.21.15.96:6800/3944122753,v1:172.21.15.96:6801/3944122753] conn(0x7ff428038780 msgr2=0x7ff42803ac30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-08T03:34:16.249 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:14.802+0000 7ff4327fc700 1 --2- 172.21.15.96:0/3377730673 >> [v2:172.21.15.96:6800/3944122753,v1:172.21.15.96:6801/3944122753] conn(0x7ff428038780 0x7ff42803ac30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:16.249 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:15.802+0000 7ff4327fc700 1 -- 172.21.15.96:0/3377730673 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mgrmap(e 7) v1 ==== 45377+0+0 (secure 0 0 0) 0x7ff43804de80 con 0x7ff43c104b20 2023-05-08T03:34:16.249 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:15.802+0000 7ff4327fc700 1 --2- 172.21.15.96:0/3377730673 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7ff42803bfb0 0x7ff42803e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:34:16.249 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:15.802+0000 7ff4327fc700 1 -- 172.21.15.96:0/3377730673 --> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff42803b340 con 0x7ff42803bfb0 2023-05-08T03:34:16.249 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:15.803+0000 7ff440cd2700 1 --2- 172.21.15.96:0/3377730673 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7ff42803bfb0 0x7ff42803e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:34:16.249 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:15.803+0000 7ff440cd2700 1 --2- 172.21.15.96:0/3377730673 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7ff42803bfb0 0x7ff42803e390 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7ff42c003a10 tx=0x7ff42c009290 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:34:16.249 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:15.804+0000 7ff4327fc700 1 -- 172.21.15.96:0/3377730673 <== mgr.14120 v2:172.21.15.96:6800/1979917756 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7ff42803b340 con 0x7ff42803bfb0 2023-05-08T03:34:16.250 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:15.810+0000 7ff443737700 1 -- 172.21.15.96:0/3377730673 --> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7ff43c19abc0 con 0x7ff42803bfb0 2023-05-08T03:34:16.250 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:15.810+0000 7ff4327fc700 1 -- 172.21.15.96:0/3377730673 <== mgr.14120 v2:172.21.15.96:6800/1979917756 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7ff43c19abc0 con 0x7ff42803bfb0 2023-05-08T03:34:16.250 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:15.810+0000 7ff443737700 1 -- 172.21.15.96:0/3377730673 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7ff42803bfb0 msgr2=0x7ff42803e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:34:16.250 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:15.810+0000 7ff443737700 1 --2- 172.21.15.96:0/3377730673 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7ff42803bfb0 0x7ff42803e390 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7ff42c003a10 tx=0x7ff42c009290 comp rx=0 tx=0).stop 2023-05-08T03:34:16.250 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:15.810+0000 7ff443737700 1 -- 172.21.15.96:0/3377730673 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff43c104b20 msgr2=0x7ff43c199880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:34:16.250 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:15.810+0000 7ff443737700 1 --2- 172.21.15.96:0/3377730673 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff43c104b20 0x7ff43c199880 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff438009fb0 tx=0x7ff438011ad0 comp rx=0 tx=0).stop 2023-05-08T03:34:16.251 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:15.811+0000 7ff443737700 1 -- 172.21.15.96:0/3377730673 shutdown_connections 2023-05-08T03:34:16.251 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:15.811+0000 7ff443737700 1 --2- 172.21.15.96:0/3377730673 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7ff42803bfb0 0x7ff42803e390 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:16.251 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:15.811+0000 7ff443737700 1 --2- 172.21.15.96:0/3377730673 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff43c104b20 0x7ff43c199880 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:16.251 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:15.811+0000 7ff443737700 1 --2- 172.21.15.96:0/3377730673 >> [v2:172.21.15.96:6800/3944122753,v1:172.21.15.96:6801/3944122753] conn(0x7ff428038780 0x7ff42803ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:16.252 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:15.811+0000 7ff443737700 1 -- 172.21.15.96:0/3377730673 >> 172.21.15.96:0/3377730673 conn(0x7ff43c100170 msgr2=0x7ff43c073dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:34:16.252 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:15.811+0000 7ff443737700 1 -- 172.21.15.96:0/3377730673 shutdown_connections 2023-05-08T03:34:16.252 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:15.811+0000 7ff443737700 1 -- 172.21.15.96:0/3377730673 wait complete. 2023-05-08T03:34:16.252 INFO:teuthology.orchestra.run.smithi096.stdout:mgr epoch 5 is available 2023-05-08T03:34:16.252 INFO:teuthology.orchestra.run.smithi096.stdout:Setting orchestrator backend to cephadm... 2023-05-08T03:34:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:16 smithi096 ceph-mon[124666]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-05-08T03:34:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:16 smithi096 ceph-mon[124666]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-05-08T03:34:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:16 smithi096 ceph-mon[124666]: from='mgr.14120 172.21.15.96:0/187696170' entity='mgr.x' 2023-05-08T03:34:17.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:16 smithi096 ceph-mon[124666]: from='mgr.14120 172.21.15.96:0/187696170' entity='mgr.x' 2023-05-08T03:34:17.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:16 smithi096 ceph-mon[124666]: from='mgr.14120 172.21.15.96:0/187696170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:34:17.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:16 smithi096 ceph-mon[124666]: from='mgr.14120 172.21.15.96:0/187696170' entity='mgr.x' 2023-05-08T03:34:17.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:16 smithi096 ceph-mon[124666]: from='mgr.14120 172.21.15.96:0/187696170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:34:17.383 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:16.706+0000 7f75de755700 1 Processor -- start 2023-05-08T03:34:17.383 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:16.706+0000 7f75de755700 1 -- start start 2023-05-08T03:34:17.383 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:16.706+0000 7f75de755700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75d8104b20 0x7f75d8104f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:34:17.383 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:16.706+0000 7f75de755700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d8105470 con 0x7f75d8104b20 2023-05-08T03:34:17.384 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:16.707+0000 7f75d7fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75d8104b20 0x7f75d8104f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:34:17.384 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:16.707+0000 7f75d7fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75d8104b20 0x7f75d8104f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39254/0 (socket says 172.21.15.96:39254) 2023-05-08T03:34:17.384 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:16.707+0000 7f75d7fff700 1 -- 172.21.15.96:0/4075166001 learned_addr learned my addr 172.21.15.96:0/4075166001 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:34:17.384 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:16.707+0000 7f75d7fff700 1 -- 172.21.15.96:0/4075166001 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75d81055b0 con 0x7f75d8104b20 2023-05-08T03:34:17.384 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:16.707+0000 7f75d7fff700 1 --2- 172.21.15.96:0/4075166001 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75d8104b20 0x7f75d8104f30 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f75c80098a0 tx=0x7f75c8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1813fba52fc5336 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:34:17.384 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:16.707+0000 7f75d6ffd700 1 -- 172.21.15.96:0/4075166001 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f75c8004160 con 0x7f75d8104b20 2023-05-08T03:34:17.384 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:16.707+0000 7f75d6ffd700 1 -- 172.21.15.96:0/4075166001 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f75c80042c0 con 0x7f75d8104b20 2023-05-08T03:34:17.385 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:16.707+0000 7f75d6ffd700 1 -- 172.21.15.96:0/4075166001 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f75c8011a00 con 0x7f75d8104b20 2023-05-08T03:34:17.385 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:16.708+0000 7f75de755700 1 -- 172.21.15.96:0/4075166001 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75d8104b20 msgr2=0x7f75d8104f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:34:17.385 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:16.708+0000 7f75de755700 1 --2- 172.21.15.96:0/4075166001 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75d8104b20 0x7f75d8104f30 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f75c80098a0 tx=0x7f75c8009bb0 comp rx=0 tx=0).stop 2023-05-08T03:34:17.385 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:16.708+0000 7f75de755700 1 -- 172.21.15.96:0/4075166001 shutdown_connections 2023-05-08T03:34:17.385 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:16.708+0000 7f75de755700 1 --2- 172.21.15.96:0/4075166001 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75d8104b20 0x7f75d8104f30 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:17.385 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:16.708+0000 7f75de755700 1 -- 172.21.15.96:0/4075166001 >> 172.21.15.96:0/4075166001 conn(0x7f75d8100170 msgr2=0x7f75d81025a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:34:17.385 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:16.708+0000 7f75de755700 1 -- 172.21.15.96:0/4075166001 shutdown_connections 2023-05-08T03:34:17.385 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:16.708+0000 7f75de755700 1 -- 172.21.15.96:0/4075166001 wait complete. 2023-05-08T03:34:17.386 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:16.709+0000 7f75de755700 1 Processor -- start 2023-05-08T03:34:17.386 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:16.709+0000 7f75de755700 1 -- start start 2023-05-08T03:34:17.386 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:16.709+0000 7f75de755700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75d8104b20 0x7f75d81998c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:34:17.386 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:16.709+0000 7f75de755700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d8199e00 con 0x7f75d8104b20 2023-05-08T03:34:17.386 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:16.709+0000 7f75d7fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75d8104b20 0x7f75d81998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:34:17.386 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:16.709+0000 7f75d7fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75d8104b20 0x7f75d81998c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39256/0 (socket says 172.21.15.96:39256) 2023-05-08T03:34:17.386 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:16.709+0000 7f75d7fff700 1 -- 172.21.15.96:0/2349701333 learned_addr learned my addr 172.21.15.96:0/2349701333 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:34:17.387 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:16.709+0000 7f75d7fff700 1 -- 172.21.15.96:0/2349701333 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75c8009550 con 0x7f75d8104b20 2023-05-08T03:34:17.387 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:16.710+0000 7f75d7fff700 1 --2- 172.21.15.96:0/2349701333 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75d8104b20 0x7f75d81998c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f75c8006af0 tx=0x7f75c8011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:34:17.387 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:16.710+0000 7f75d57fa700 1 -- 172.21.15.96:0/2349701333 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f75c8003a40 con 0x7f75d8104b20 2023-05-08T03:34:17.387 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:16.710+0000 7f75de755700 1 -- 172.21.15.96:0/2349701333 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75d8106b70 con 0x7f75d8104b20 2023-05-08T03:34:17.387 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:16.710+0000 7f75d57fa700 1 -- 172.21.15.96:0/2349701333 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f75c8003ba0 con 0x7f75d8104b20 2023-05-08T03:34:17.387 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:16.710+0000 7f75d57fa700 1 -- 172.21.15.96:0/2349701333 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f75c801a6e0 con 0x7f75d8104b20 2023-05-08T03:34:17.387 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:16.710+0000 7f75de755700 1 -- 172.21.15.96:0/2349701333 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75d81069e0 con 0x7f75d8104b20 2023-05-08T03:34:17.387 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:16.710+0000 7f75d57fa700 1 -- 172.21.15.96:0/2349701333 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 7) v1 ==== 45377+0+0 (secure 0 0 0) 0x7f75c801a950 con 0x7f75d8104b20 2023-05-08T03:34:17.388 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:16.711+0000 7f75de755700 1 -- 172.21.15.96:0/2349701333 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75d8062220 con 0x7f75d8104b20 2023-05-08T03:34:17.388 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:16.711+0000 7f75d57fa700 1 --2- 172.21.15.96:0/2349701333 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7f75c00386a0 0x7f75c003ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:34:17.388 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:16.711+0000 7f75d57fa700 1 -- 172.21.15.96:0/2349701333 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f75c804c580 con 0x7f75d8104b20 2023-05-08T03:34:17.388 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:16.711+0000 7f75d77fe700 1 --2- 172.21.15.96:0/2349701333 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7f75c00386a0 0x7f75c003ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:34:17.388 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:16.711+0000 7f75d77fe700 1 --2- 172.21.15.96:0/2349701333 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7f75c00386a0 0x7f75c003ab50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f75cc006fd0 tx=0x7f75cc006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:34:17.388 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:16.716+0000 7f75d57fa700 1 -- 172.21.15.96:0/2349701333 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f75c8018db0 con 0x7f75d8104b20 2023-05-08T03:34:17.388 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:16.917+0000 7f75de755700 1 -- 172.21.15.96:0/2349701333 --> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f75d8102210 con 0x7f75c00386a0 2023-05-08T03:34:17.389 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:16.924+0000 7f75d57fa700 1 -- 172.21.15.96:0/2349701333 <== mgr.14120 v2:172.21.15.96:6800/1979917756 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f75d8102210 con 0x7f75c00386a0 2023-05-08T03:34:17.389 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:16.926+0000 7f75de755700 1 -- 172.21.15.96:0/2349701333 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7f75c00386a0 msgr2=0x7f75c003ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:34:17.389 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:16.926+0000 7f75de755700 1 --2- 172.21.15.96:0/2349701333 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7f75c00386a0 0x7f75c003ab50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f75cc006fd0 tx=0x7f75cc006e40 comp rx=0 tx=0).stop 2023-05-08T03:34:17.389 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:16.926+0000 7f75de755700 1 -- 172.21.15.96:0/2349701333 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75d8104b20 msgr2=0x7f75d81998c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:34:17.389 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:16.926+0000 7f75de755700 1 --2- 172.21.15.96:0/2349701333 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75d8104b20 0x7f75d81998c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f75c8006af0 tx=0x7f75c8011ad0 comp rx=0 tx=0).stop 2023-05-08T03:34:17.389 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:16.927+0000 7f75de755700 1 -- 172.21.15.96:0/2349701333 shutdown_connections 2023-05-08T03:34:17.389 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:16.927+0000 7f75de755700 1 --2- 172.21.15.96:0/2349701333 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7f75c00386a0 0x7f75c003ab50 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:17.389 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:16.927+0000 7f75de755700 1 --2- 172.21.15.96:0/2349701333 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75d8104b20 0x7f75d81998c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:17.390 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:16.927+0000 7f75de755700 1 -- 172.21.15.96:0/2349701333 >> 172.21.15.96:0/2349701333 conn(0x7f75d8100170 msgr2=0x7f75d8073d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:34:17.390 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:16.927+0000 7f75de755700 1 -- 172.21.15.96:0/2349701333 shutdown_connections 2023-05-08T03:34:17.390 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:16.927+0000 7f75de755700 1 -- 172.21.15.96:0/2349701333 wait complete. 2023-05-08T03:34:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:17 smithi096 ceph-mon[124666]: [08/May/2023:03:34:16] ENGINE Bus STARTING 2023-05-08T03:34:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:17 smithi096 ceph-mon[124666]: [08/May/2023:03:34:16] ENGINE Serving on https://172.21.15.96:7150 2023-05-08T03:34:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:17 smithi096 ceph-mon[124666]: [08/May/2023:03:34:16] ENGINE Serving on http://172.21.15.96:8765 2023-05-08T03:34:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:17 smithi096 ceph-mon[124666]: [08/May/2023:03:34:16] ENGINE Bus STARTED 2023-05-08T03:34:18.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:17 smithi096 ceph-mon[124666]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:34:18.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:17 smithi096 ceph-mon[124666]: mgrmap e8: x(active, since 2s) 2023-05-08T03:34:18.422 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout value unchanged 2023-05-08T03:34:18.422 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:17.837+0000 7f88c8d67700 1 Processor -- start 2023-05-08T03:34:18.422 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:17.837+0000 7f88c8d67700 1 -- start start 2023-05-08T03:34:18.423 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:17.837+0000 7f88c8d67700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f88c4104b30 0x7f88c4104f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:34:18.423 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:17.837+0000 7f88c8d67700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c4105480 con 0x7f88c4104b30 2023-05-08T03:34:18.423 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:17.837+0000 7f88c259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f88c4104b30 0x7f88c4104f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:34:18.423 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:17.837+0000 7f88c259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f88c4104b30 0x7f88c4104f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39260/0 (socket says 172.21.15.96:39260) 2023-05-08T03:34:18.423 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:17.837+0000 7f88c259c700 1 -- 172.21.15.96:0/2043304747 learned_addr learned my addr 172.21.15.96:0/2043304747 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:34:18.423 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:17.838+0000 7f88c259c700 1 -- 172.21.15.96:0/2043304747 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c41055c0 con 0x7f88c4104b30 2023-05-08T03:34:18.426 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:17.838+0000 7f88c259c700 1 --2- 172.21.15.96:0/2043304747 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f88c4104b30 0x7f88c4104f40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f88b40098a0 tx=0x7f88b4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4595eee1d695bfa8 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:34:18.427 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:17.838+0000 7f88c159a700 1 -- 172.21.15.96:0/2043304747 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f88b4004160 con 0x7f88c4104b30 2023-05-08T03:34:18.427 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:17.838+0000 7f88c159a700 1 -- 172.21.15.96:0/2043304747 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f88b40042c0 con 0x7f88c4104b30 2023-05-08T03:34:18.427 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:17.838+0000 7f88c159a700 1 -- 172.21.15.96:0/2043304747 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f88b4011a00 con 0x7f88c4104b30 2023-05-08T03:34:18.427 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:17.838+0000 7f88c8d67700 1 -- 172.21.15.96:0/2043304747 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f88c4104b30 msgr2=0x7f88c4104f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:34:18.428 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:17.838+0000 7f88c8d67700 1 --2- 172.21.15.96:0/2043304747 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f88c4104b30 0x7f88c4104f40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f88b40098a0 tx=0x7f88b4009bb0 comp rx=0 tx=0).stop 2023-05-08T03:34:18.428 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:17.838+0000 7f88c8d67700 1 -- 172.21.15.96:0/2043304747 shutdown_connections 2023-05-08T03:34:18.428 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:17.838+0000 7f88c8d67700 1 --2- 172.21.15.96:0/2043304747 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f88c4104b30 0x7f88c4104f40 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:18.428 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:17.838+0000 7f88c8d67700 1 -- 172.21.15.96:0/2043304747 >> 172.21.15.96:0/2043304747 conn(0x7f88c41001e0 msgr2=0x7f88c41025f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:34:18.428 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:17.838+0000 7f88c8d67700 1 -- 172.21.15.96:0/2043304747 shutdown_connections 2023-05-08T03:34:18.428 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:17.839+0000 7f88c8d67700 1 -- 172.21.15.96:0/2043304747 wait complete. 2023-05-08T03:34:18.428 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:17.839+0000 7f88c8d67700 1 Processor -- start 2023-05-08T03:34:18.429 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:17.839+0000 7f88c8d67700 1 -- start start 2023-05-08T03:34:18.429 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:17.839+0000 7f88c8d67700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f88c4104b30 0x7f88c4199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:34:18.429 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:17.839+0000 7f88c8d67700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c4199e50 con 0x7f88c4104b30 2023-05-08T03:34:18.429 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:17.839+0000 7f88c259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f88c4104b30 0x7f88c4199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:34:18.429 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:17.840+0000 7f88c259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f88c4104b30 0x7f88c4199910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39262/0 (socket says 172.21.15.96:39262) 2023-05-08T03:34:18.429 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:17.840+0000 7f88c259c700 1 -- 172.21.15.96:0/881195437 learned_addr learned my addr 172.21.15.96:0/881195437 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:34:18.429 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:17.840+0000 7f88c259c700 1 -- 172.21.15.96:0/881195437 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b4009550 con 0x7f88c4104b30 2023-05-08T03:34:18.430 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:17.840+0000 7f88c259c700 1 --2- 172.21.15.96:0/881195437 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f88c4104b30 0x7f88c4199910 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f88b4009130 tx=0x7f88b4011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:34:18.430 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:17.840+0000 7f88b37fe700 1 -- 172.21.15.96:0/881195437 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f88b4003b70 con 0x7f88c4104b30 2023-05-08T03:34:18.430 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:17.840+0000 7f88b37fe700 1 -- 172.21.15.96:0/881195437 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f88b4003cd0 con 0x7f88c4104b30 2023-05-08T03:34:18.430 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:17.840+0000 7f88c8d67700 1 -- 172.21.15.96:0/881195437 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88c4106b80 con 0x7f88c4104b30 2023-05-08T03:34:18.430 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:17.840+0000 7f88b37fe700 1 -- 172.21.15.96:0/881195437 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f88b40197d0 con 0x7f88c4104b30 2023-05-08T03:34:18.430 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:17.840+0000 7f88c8d67700 1 -- 172.21.15.96:0/881195437 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88c41069f0 con 0x7f88c4104b30 2023-05-08T03:34:18.430 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:17.841+0000 7f88b37fe700 1 -- 172.21.15.96:0/881195437 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 8) v1 ==== 45483+0+0 (secure 0 0 0) 0x7f88b401abb0 con 0x7f88c4104b30 2023-05-08T03:34:18.430 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:17.841+0000 7f88c8d67700 1 -- 172.21.15.96:0/881195437 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88c4062220 con 0x7f88c4104b30 2023-05-08T03:34:18.431 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:17.841+0000 7f88b37fe700 1 --2- 172.21.15.96:0/881195437 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7f88ac0387d0 0x7f88ac03ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:34:18.431 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:17.841+0000 7f88b37fe700 1 -- 172.21.15.96:0/881195437 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f88b404c920 con 0x7f88c4104b30 2023-05-08T03:34:18.431 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:17.841+0000 7f88c1d9b700 1 --2- 172.21.15.96:0/881195437 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7f88ac0387d0 0x7f88ac03ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:34:18.431 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:17.842+0000 7f88c1d9b700 1 --2- 172.21.15.96:0/881195437 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7f88ac0387d0 0x7f88ac03ac80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f88b8006fd0 tx=0x7f88b8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:34:18.431 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:17.847+0000 7f88b37fe700 1 -- 172.21.15.96:0/881195437 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f88b401a430 con 0x7f88c4104b30 2023-05-08T03:34:18.431 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:18.036+0000 7f88c8d67700 1 -- 172.21.15.96:0/881195437 --> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f88c4102290 con 0x7f88ac0387d0 2023-05-08T03:34:18.431 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:18.036+0000 7f88b37fe700 1 -- 172.21.15.96:0/881195437 <== mgr.14120 v2:172.21.15.96:6800/1979917756 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f88c4102290 con 0x7f88ac0387d0 2023-05-08T03:34:18.432 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:18.038+0000 7f88c8d67700 1 -- 172.21.15.96:0/881195437 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7f88ac0387d0 msgr2=0x7f88ac03ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:34:18.432 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:18.038+0000 7f88c8d67700 1 --2- 172.21.15.96:0/881195437 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7f88ac0387d0 0x7f88ac03ac80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f88b8006fd0 tx=0x7f88b8006e40 comp rx=0 tx=0).stop 2023-05-08T03:34:18.432 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:18.039+0000 7f88c8d67700 1 -- 172.21.15.96:0/881195437 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f88c4104b30 msgr2=0x7f88c4199910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:34:18.432 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:18.039+0000 7f88c8d67700 1 --2- 172.21.15.96:0/881195437 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f88c4104b30 0x7f88c4199910 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f88b4009130 tx=0x7f88b4011ad0 comp rx=0 tx=0).stop 2023-05-08T03:34:18.432 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:18.039+0000 7f88c8d67700 1 -- 172.21.15.96:0/881195437 shutdown_connections 2023-05-08T03:34:18.432 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:18.039+0000 7f88c8d67700 1 --2- 172.21.15.96:0/881195437 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7f88ac0387d0 0x7f88ac03ac80 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:18.432 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:18.039+0000 7f88c8d67700 1 --2- 172.21.15.96:0/881195437 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f88c4104b30 0x7f88c4199910 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:18.432 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:18.039+0000 7f88c8d67700 1 -- 172.21.15.96:0/881195437 >> 172.21.15.96:0/881195437 conn(0x7f88c41001e0 msgr2=0x7f88c40798c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:34:18.433 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:18.039+0000 7f88c8d67700 1 -- 172.21.15.96:0/881195437 shutdown_connections 2023-05-08T03:34:18.433 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:18.039+0000 7f88c8d67700 1 -- 172.21.15.96:0/881195437 wait complete. 2023-05-08T03:34:18.433 INFO:teuthology.orchestra.run.smithi096.stdout:Generating ssh key... 2023-05-08T03:34:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:18 smithi096 ceph-mon[124666]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:34:19.959 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:34:19 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: Generating public/private rsa key pair. 2023-05-08T03:34:19.959 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:34:19 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: Your identification has been saved in /tmp/tmphdvskb4o/key. 2023-05-08T03:34:19.959 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:34:19 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: Your public key has been saved in /tmp/tmphdvskb4o/key.pub. 2023-05-08T03:34:19.959 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:34:19 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: The key fingerprint is: 2023-05-08T03:34:19.960 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:34:19 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: SHA256:MWHxSkUHlD2Ar9ul9kkAGlTicgO6tyKcYEexFDAYD8g ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c 2023-05-08T03:34:19.960 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:34:19 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: The key's randomart image is: 2023-05-08T03:34:19.960 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:34:19 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: +---[RSA 3072]----+ 2023-05-08T03:34:19.960 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:34:19 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: |*+.+o o.==*=. | 2023-05-08T03:34:19.960 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:34:19 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: |oEo.o+ o.+..o | 2023-05-08T03:34:19.960 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:34:19 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: | oo. = =.. . | 2023-05-08T03:34:19.960 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:34:19 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: | .. o = =. | 2023-05-08T03:34:19.961 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:34:19 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: |..... . S.. | 2023-05-08T03:34:19.961 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:34:19 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: |+ o. . . .. | 2023-05-08T03:34:19.961 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:34:19 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: |.o. . o o. | 2023-05-08T03:34:19.961 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:34:19 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: | . . . +. . | 2023-05-08T03:34:19.961 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:34:19 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: | . .o | 2023-05-08T03:34:19.961 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:34:19 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: +----[SHA256]-----+ 2023-05-08T03:34:20.071 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:18.895+0000 7f9c6b70b700 1 Processor -- start 2023-05-08T03:34:20.072 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:18.895+0000 7f9c6b70b700 1 -- start start 2023-05-08T03:34:20.072 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:18.895+0000 7f9c6b70b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c64105040 0x7f9c64105450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:34:20.072 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:18.895+0000 7f9c6b70b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c64105990 con 0x7f9c64105040 2023-05-08T03:34:20.072 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:18.895+0000 7f9c694a7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c64105040 0x7f9c64105450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:34:20.072 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:18.895+0000 7f9c694a7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c64105040 0x7f9c64105450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39266/0 (socket says 172.21.15.96:39266) 2023-05-08T03:34:20.072 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:18.895+0000 7f9c694a7700 1 -- 172.21.15.96:0/211148802 learned_addr learned my addr 172.21.15.96:0/211148802 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:34:20.073 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:18.896+0000 7f9c694a7700 1 -- 172.21.15.96:0/211148802 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c64105ad0 con 0x7f9c64105040 2023-05-08T03:34:20.073 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:18.896+0000 7f9c694a7700 1 --2- 172.21.15.96:0/211148802 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c64105040 0x7f9c64105450 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9c540098a0 tx=0x7f9c54009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70a04f7517019297 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:34:20.073 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:18.896+0000 7f9c5bfff700 1 -- 172.21.15.96:0/211148802 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9c54004160 con 0x7f9c64105040 2023-05-08T03:34:20.073 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:18.896+0000 7f9c5bfff700 1 -- 172.21.15.96:0/211148802 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9c540042c0 con 0x7f9c64105040 2023-05-08T03:34:20.073 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:18.896+0000 7f9c5bfff700 1 -- 172.21.15.96:0/211148802 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9c54011a00 con 0x7f9c64105040 2023-05-08T03:34:20.073 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:18.896+0000 7f9c6b70b700 1 -- 172.21.15.96:0/211148802 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c64105040 msgr2=0x7f9c64105450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:34:20.073 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:18.897+0000 7f9c6b70b700 1 --2- 172.21.15.96:0/211148802 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c64105040 0x7f9c64105450 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9c540098a0 tx=0x7f9c54009bb0 comp rx=0 tx=0).stop 2023-05-08T03:34:20.074 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:18.897+0000 7f9c6b70b700 1 -- 172.21.15.96:0/211148802 shutdown_connections 2023-05-08T03:34:20.074 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:18.897+0000 7f9c6b70b700 1 --2- 172.21.15.96:0/211148802 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c64105040 0x7f9c64105450 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:20.074 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:18.897+0000 7f9c6b70b700 1 -- 172.21.15.96:0/211148802 >> 172.21.15.96:0/211148802 conn(0x7f9c640ff930 msgr2=0x7f9c64101d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:34:20.074 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:18.897+0000 7f9c6b70b700 1 -- 172.21.15.96:0/211148802 shutdown_connections 2023-05-08T03:34:20.074 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:18.897+0000 7f9c6b70b700 1 -- 172.21.15.96:0/211148802 wait complete. 2023-05-08T03:34:20.074 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:18.897+0000 7f9c6b70b700 1 Processor -- start 2023-05-08T03:34:20.074 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:18.897+0000 7f9c6b70b700 1 -- start start 2023-05-08T03:34:20.075 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:18.897+0000 7f9c6b70b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c64105040 0x7f9c641047a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:34:20.075 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:18.897+0000 7f9c6b70b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6419a3f0 con 0x7f9c64105040 2023-05-08T03:34:20.075 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:18.897+0000 7f9c694a7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c64105040 0x7f9c641047a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:34:20.075 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:18.898+0000 7f9c694a7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c64105040 0x7f9c641047a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39268/0 (socket says 172.21.15.96:39268) 2023-05-08T03:34:20.075 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:18.898+0000 7f9c694a7700 1 -- 172.21.15.96:0/2169499776 learned_addr learned my addr 172.21.15.96:0/2169499776 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:34:20.075 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:18.898+0000 7f9c694a7700 1 -- 172.21.15.96:0/2169499776 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c54009550 con 0x7f9c64105040 2023-05-08T03:34:20.075 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:18.898+0000 7f9c694a7700 1 --2- 172.21.15.96:0/2169499776 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c64105040 0x7f9c641047a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9c54006af0 tx=0x7f9c54011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:34:20.076 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:18.898+0000 7f9c5a7fc700 1 -- 172.21.15.96:0/2169499776 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9c54003a40 con 0x7f9c64105040 2023-05-08T03:34:20.076 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:18.898+0000 7f9c5a7fc700 1 -- 172.21.15.96:0/2169499776 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9c54003ba0 con 0x7f9c64105040 2023-05-08T03:34:20.076 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:18.898+0000 7f9c6b70b700 1 -- 172.21.15.96:0/2169499776 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c64106ba0 con 0x7f9c64105040 2023-05-08T03:34:20.076 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:18.898+0000 7f9c5a7fc700 1 -- 172.21.15.96:0/2169499776 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9c5401a700 con 0x7f9c64105040 2023-05-08T03:34:20.076 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:18.898+0000 7f9c6b70b700 1 -- 172.21.15.96:0/2169499776 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c64106a10 con 0x7f9c64105040 2023-05-08T03:34:20.076 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:18.899+0000 7f9c5a7fc700 1 -- 172.21.15.96:0/2169499776 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 8) v1 ==== 45483+0+0 (secure 0 0 0) 0x7f9c5401a980 con 0x7f9c64105040 2023-05-08T03:34:20.076 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:18.899+0000 7f9c6b70b700 1 -- 172.21.15.96:0/2169499776 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c64062220 con 0x7f9c64105040 2023-05-08T03:34:20.076 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:18.899+0000 7f9c5a7fc700 1 --2- 172.21.15.96:0/2169499776 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7f9c500387d0 0x7f9c5003ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:34:20.077 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:18.899+0000 7f9c5a7fc700 1 -- 172.21.15.96:0/2169499776 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f9c5404c8c0 con 0x7f9c64105040 2023-05-08T03:34:20.077 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:18.899+0000 7f9c68ca6700 1 --2- 172.21.15.96:0/2169499776 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7f9c500387d0 0x7f9c5003ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:34:20.077 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:18.900+0000 7f9c68ca6700 1 --2- 172.21.15.96:0/2169499776 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7f9c500387d0 0x7f9c5003ac80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9c60006fd0 tx=0x7f9c60006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:34:20.077 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:18.904+0000 7f9c5a7fc700 1 -- 172.21.15.96:0/2169499776 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f9c54018710 con 0x7f9c64105040 2023-05-08T03:34:20.077 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:19.091+0000 7f9c6b70b700 1 -- 172.21.15.96:0/2169499776 --> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f9c64100d70 con 0x7f9c500387d0 2023-05-08T03:34:20.077 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:19.686+0000 7f9c5a7fc700 1 -- 172.21.15.96:0/2169499776 <== mgr.14120 v2:172.21.15.96:6800/1979917756 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f9c64100d70 con 0x7f9c500387d0 2023-05-08T03:34:20.077 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:19.688+0000 7f9c6b70b700 1 -- 172.21.15.96:0/2169499776 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7f9c500387d0 msgr2=0x7f9c5003ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:34:20.078 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:19.688+0000 7f9c6b70b700 1 --2- 172.21.15.96:0/2169499776 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7f9c500387d0 0x7f9c5003ac80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9c60006fd0 tx=0x7f9c60006e40 comp rx=0 tx=0).stop 2023-05-08T03:34:20.078 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:19.688+0000 7f9c6b70b700 1 -- 172.21.15.96:0/2169499776 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c64105040 msgr2=0x7f9c641047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:34:20.078 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:19.688+0000 7f9c6b70b700 1 --2- 172.21.15.96:0/2169499776 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c64105040 0x7f9c641047a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9c54006af0 tx=0x7f9c54011ad0 comp rx=0 tx=0).stop 2023-05-08T03:34:20.078 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:19.689+0000 7f9c6b70b700 1 -- 172.21.15.96:0/2169499776 shutdown_connections 2023-05-08T03:34:20.078 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:19.689+0000 7f9c6b70b700 1 --2- 172.21.15.96:0/2169499776 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7f9c500387d0 0x7f9c5003ac80 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:20.078 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:19.689+0000 7f9c6b70b700 1 --2- 172.21.15.96:0/2169499776 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c64105040 0x7f9c641047a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:20.078 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:19.689+0000 7f9c6b70b700 1 -- 172.21.15.96:0/2169499776 >> 172.21.15.96:0/2169499776 conn(0x7f9c640ff930 msgr2=0x7f9c64100660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:34:20.078 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:19.689+0000 7f9c6b70b700 1 -- 172.21.15.96:0/2169499776 shutdown_connections 2023-05-08T03:34:20.079 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:19.689+0000 7f9c6b70b700 1 -- 172.21.15.96:0/2169499776 wait complete. 2023-05-08T03:34:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:19 smithi096 ceph-mon[124666]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:34:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:19 smithi096 ceph-mon[124666]: Generating ssh key... 2023-05-08T03:34:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:19 smithi096 ceph-mon[124666]: from='mgr.14120 172.21.15.96:0/187696170' entity='mgr.x' 2023-05-08T03:34:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:19 smithi096 ceph-mon[124666]: from='mgr.14120 172.21.15.96:0/187696170' entity='mgr.x' 2023-05-08T03:34:21.217 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDedRSMFvd9Tsu9lnT+ArB0gPdrtRw/ssmrzLQxXK496Sqiu873bFCMf6cVCA8foYyAd2h3S3V9+/4xOqrT+znOzmcCDT7sHtqq+FGnKTut2F9zcG72P75HzC1e8dwN8lwib5mwgdAFDL18jGl5G6yVfCsoLiT4Mr02iIWRY2aj6xOITN7836WVKvv1VxBzGyprWPWIMrEMuqZVtNZzwl+PCwJstuxNu7500iwLrVVGo77ciXnZE93sgLc4G+bQQPwciXNwxre3Er1JDmxT3VJn57NuISsj/ny18Jn1Xl4LuRA0Ozxfm8A9ItLZPhvlZUS5rwamancivrMlyg0ARi208Dh7VctgyfNwRIpO2s+m8lx6Gx06Z/XUgsbtGyTHkLCUvPQkmECpH45TmBIMKdynUj2kA2Y19batMxblPKr/MtmVwlZkYJUZIeeeoDj+ifACSCw7pPDQ252w5TQmW/SosUFRgMilDw7pbIdLHSoNsh9KgQS7xzIuv0phKqVyRAs= ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c 2023-05-08T03:34:21.217 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:20.544+0000 7fe80cf9b700 1 Processor -- start 2023-05-08T03:34:21.217 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:20.544+0000 7fe80cf9b700 1 -- start start 2023-05-08T03:34:21.217 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:20.544+0000 7fe80cf9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe808105020 0x7fe808105430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:34:21.217 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:20.544+0000 7fe80cf9b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe808105970 con 0x7fe808105020 2023-05-08T03:34:21.218 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:20.544+0000 7fe80659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe808105020 0x7fe808105430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:34:21.218 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:20.544+0000 7fe80659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe808105020 0x7fe808105430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39272/0 (socket says 172.21.15.96:39272) 2023-05-08T03:34:21.218 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:20.544+0000 7fe80659c700 1 -- 172.21.15.96:0/1430731291 learned_addr learned my addr 172.21.15.96:0/1430731291 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:34:21.218 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:20.544+0000 7fe80659c700 1 -- 172.21.15.96:0/1430731291 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe808105ab0 con 0x7fe808105020 2023-05-08T03:34:21.218 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:20.545+0000 7fe80659c700 1 --2- 172.21.15.96:0/1430731291 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe808105020 0x7fe808105430 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe7f80098a0 tx=0x7fe7f8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d679489e8f3b85cd server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:34:21.218 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:20.545+0000 7fe80559a700 1 -- 172.21.15.96:0/1430731291 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe7f8004160 con 0x7fe808105020 2023-05-08T03:34:21.218 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:20.545+0000 7fe80559a700 1 -- 172.21.15.96:0/1430731291 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe7f80042c0 con 0x7fe808105020 2023-05-08T03:34:21.219 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:20.545+0000 7fe80559a700 1 -- 172.21.15.96:0/1430731291 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe7f8011a00 con 0x7fe808105020 2023-05-08T03:34:21.219 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:20.545+0000 7fe80cf9b700 1 -- 172.21.15.96:0/1430731291 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe808105020 msgr2=0x7fe808105430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:34:21.219 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:20.545+0000 7fe80cf9b700 1 --2- 172.21.15.96:0/1430731291 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe808105020 0x7fe808105430 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe7f80098a0 tx=0x7fe7f8009bb0 comp rx=0 tx=0).stop 2023-05-08T03:34:21.219 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:20.545+0000 7fe80cf9b700 1 -- 172.21.15.96:0/1430731291 shutdown_connections 2023-05-08T03:34:21.219 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:20.545+0000 7fe80cf9b700 1 --2- 172.21.15.96:0/1430731291 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe808105020 0x7fe808105430 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:21.219 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:20.545+0000 7fe80cf9b700 1 -- 172.21.15.96:0/1430731291 >> 172.21.15.96:0/1430731291 conn(0x7fe8080ff930 msgr2=0x7fe808101d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:34:21.219 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:20.545+0000 7fe80cf9b700 1 -- 172.21.15.96:0/1430731291 shutdown_connections 2023-05-08T03:34:21.219 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:20.545+0000 7fe80cf9b700 1 -- 172.21.15.96:0/1430731291 wait complete. 2023-05-08T03:34:21.220 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:20.546+0000 7fe80cf9b700 1 Processor -- start 2023-05-08T03:34:21.220 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:20.546+0000 7fe80cf9b700 1 -- start start 2023-05-08T03:34:21.220 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:20.547+0000 7fe80cf9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe808105020 0x7fe808104780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:34:21.220 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:20.547+0000 7fe80cf9b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe80819c600 con 0x7fe808105020 2023-05-08T03:34:21.220 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:20.547+0000 7fe80659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe808105020 0x7fe808104780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:34:21.220 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:20.547+0000 7fe80659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe808105020 0x7fe808104780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39274/0 (socket says 172.21.15.96:39274) 2023-05-08T03:34:21.220 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:20.547+0000 7fe80659c700 1 -- 172.21.15.96:0/3338301177 learned_addr learned my addr 172.21.15.96:0/3338301177 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:34:21.221 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:20.547+0000 7fe80659c700 1 -- 172.21.15.96:0/3338301177 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7f8009550 con 0x7fe808105020 2023-05-08T03:34:21.221 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:20.547+0000 7fe80659c700 1 --2- 172.21.15.96:0/3338301177 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe808105020 0x7fe808104780 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe7f8006af0 tx=0x7fe7f8011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:34:21.221 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:20.547+0000 7fe7f77fe700 1 -- 172.21.15.96:0/3338301177 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe7f8003a40 con 0x7fe808105020 2023-05-08T03:34:21.221 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:20.547+0000 7fe80cf9b700 1 -- 172.21.15.96:0/3338301177 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe808106be0 con 0x7fe808105020 2023-05-08T03:34:21.221 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:20.547+0000 7fe7f77fe700 1 -- 172.21.15.96:0/3338301177 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe7f8003ba0 con 0x7fe808105020 2023-05-08T03:34:21.221 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:20.547+0000 7fe7f77fe700 1 -- 172.21.15.96:0/3338301177 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe7f801a700 con 0x7fe808105020 2023-05-08T03:34:21.221 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:20.547+0000 7fe80cf9b700 1 -- 172.21.15.96:0/3338301177 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe808106a50 con 0x7fe808105020 2023-05-08T03:34:21.222 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:20.548+0000 7fe80cf9b700 1 -- 172.21.15.96:0/3338301177 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe808062220 con 0x7fe808105020 2023-05-08T03:34:21.222 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:20.549+0000 7fe7f77fe700 1 -- 172.21.15.96:0/3338301177 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 8) v1 ==== 45483+0+0 (secure 0 0 0) 0x7fe7f8024ad0 con 0x7fe808105020 2023-05-08T03:34:21.222 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:20.549+0000 7fe7f77fe700 1 --2- 172.21.15.96:0/3338301177 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7fe7f00387d0 0x7fe7f003ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:34:21.222 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:20.549+0000 7fe7f77fe700 1 -- 172.21.15.96:0/3338301177 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fe7f804c730 con 0x7fe808105020 2023-05-08T03:34:21.222 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:20.549+0000 7fe805d9b700 1 --2- 172.21.15.96:0/3338301177 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7fe7f00387d0 0x7fe7f003ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:34:21.222 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:20.549+0000 7fe805d9b700 1 --2- 172.21.15.96:0/3338301177 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7fe7f00387d0 0x7fe7f003ac80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc006fd0 tx=0x7fe7fc006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:34:21.222 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:20.554+0000 7fe7f77fe700 1 -- 172.21.15.96:0/3338301177 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fe7f8018b80 con 0x7fe808105020 2023-05-08T03:34:21.222 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:20.740+0000 7fe80cf9b700 1 -- 172.21.15.96:0/3338301177 --> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7fe808100d80 con 0x7fe7f00387d0 2023-05-08T03:34:21.223 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:20.741+0000 7fe7f77fe700 1 -- 172.21.15.96:0/3338301177 <== mgr.14120 v2:172.21.15.96:6800/1979917756 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7fe808100d80 con 0x7fe7f00387d0 2023-05-08T03:34:21.223 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:20.743+0000 7fe80cf9b700 1 -- 172.21.15.96:0/3338301177 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7fe7f00387d0 msgr2=0x7fe7f003ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:34:21.223 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:20.743+0000 7fe80cf9b700 1 --2- 172.21.15.96:0/3338301177 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7fe7f00387d0 0x7fe7f003ac80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc006fd0 tx=0x7fe7fc006e40 comp rx=0 tx=0).stop 2023-05-08T03:34:21.223 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:20.743+0000 7fe80cf9b700 1 -- 172.21.15.96:0/3338301177 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe808105020 msgr2=0x7fe808104780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:34:21.223 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:20.743+0000 7fe80cf9b700 1 --2- 172.21.15.96:0/3338301177 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe808105020 0x7fe808104780 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe7f8006af0 tx=0x7fe7f8011ad0 comp rx=0 tx=0).stop 2023-05-08T03:34:21.223 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:20.743+0000 7fe80cf9b700 1 -- 172.21.15.96:0/3338301177 shutdown_connections 2023-05-08T03:34:21.223 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:20.743+0000 7fe80cf9b700 1 --2- 172.21.15.96:0/3338301177 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7fe7f00387d0 0x7fe7f003ac80 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:21.224 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:20.743+0000 7fe80cf9b700 1 --2- 172.21.15.96:0/3338301177 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe808105020 0x7fe808104780 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:21.224 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:20.743+0000 7fe80cf9b700 1 -- 172.21.15.96:0/3338301177 >> 172.21.15.96:0/3338301177 conn(0x7fe8080ff930 msgr2=0x7fe808100670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:34:21.224 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:20.743+0000 7fe80cf9b700 1 -- 172.21.15.96:0/3338301177 shutdown_connections 2023-05-08T03:34:21.224 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:20.743+0000 7fe80cf9b700 1 -- 172.21.15.96:0/3338301177 wait complete. 2023-05-08T03:34:21.224 INFO:teuthology.orchestra.run.smithi096.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2023-05-08T03:34:21.224 INFO:teuthology.orchestra.run.smithi096.stdout:Adding key to root@localhost authorized_keys... 2023-05-08T03:34:21.225 INFO:teuthology.orchestra.run.smithi096.stdout:Adding host smithi096... 2023-05-08T03:34:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:21 smithi096 ceph-mon[124666]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:34:23.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:23 smithi096 ceph-mon[124666]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi096", "addr": "172.21.15.96", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:34:24.367 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout Added host 'smithi096' with addr '172.21.15.96' 2023-05-08T03:34:24.367 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:21.705+0000 7f81f582a700 1 Processor -- start 2023-05-08T03:34:24.367 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:21.705+0000 7f81f582a700 1 -- start start 2023-05-08T03:34:24.367 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:21.705+0000 7f81f582a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81f0106130 0x7f81f0106540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:34:24.367 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:21.705+0000 7f81f582a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f0106a80 con 0x7f81f0106130 2023-05-08T03:34:24.368 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:21.705+0000 7f81eeffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81f0106130 0x7f81f0106540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:34:24.368 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:21.705+0000 7f81eeffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81f0106130 0x7f81f0106540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39278/0 (socket says 172.21.15.96:39278) 2023-05-08T03:34:24.368 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:21.706+0000 7f81eeffd700 1 -- 172.21.15.96:0/3359672307 learned_addr learned my addr 172.21.15.96:0/3359672307 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:34:24.368 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:21.706+0000 7f81eeffd700 1 -- 172.21.15.96:0/3359672307 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81f0106bc0 con 0x7f81f0106130 2023-05-08T03:34:24.368 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:21.706+0000 7f81eeffd700 1 --2- 172.21.15.96:0/3359672307 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81f0106130 0x7f81f0106540 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f81e000bb40 tx=0x7f81e000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a00b3dfc03fa9033 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:34:24.368 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:21.706+0000 7f81edffb700 1 -- 172.21.15.96:0/3359672307 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f81e000dbe0 con 0x7f81f0106130 2023-05-08T03:34:24.368 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:21.706+0000 7f81edffb700 1 -- 172.21.15.96:0/3359672307 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f81e00044d0 con 0x7f81f0106130 2023-05-08T03:34:24.369 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:21.706+0000 7f81edffb700 1 -- 172.21.15.96:0/3359672307 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f81e0010470 con 0x7f81f0106130 2023-05-08T03:34:24.369 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:21.707+0000 7f81f582a700 1 -- 172.21.15.96:0/3359672307 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81f0106130 msgr2=0x7f81f0106540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:34:24.369 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:21.707+0000 7f81f582a700 1 --2- 172.21.15.96:0/3359672307 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81f0106130 0x7f81f0106540 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f81e000bb40 tx=0x7f81e000be50 comp rx=0 tx=0).stop 2023-05-08T03:34:24.369 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:21.707+0000 7f81f582a700 1 -- 172.21.15.96:0/3359672307 shutdown_connections 2023-05-08T03:34:24.369 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:21.707+0000 7f81f582a700 1 --2- 172.21.15.96:0/3359672307 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81f0106130 0x7f81f0106540 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:24.369 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:21.707+0000 7f81f582a700 1 -- 172.21.15.96:0/3359672307 >> 172.21.15.96:0/3359672307 conn(0x7f81f00ff920 msgr2=0x7f81f0101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:34:24.369 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:21.707+0000 7f81f582a700 1 -- 172.21.15.96:0/3359672307 shutdown_connections 2023-05-08T03:34:24.369 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:21.707+0000 7f81f582a700 1 -- 172.21.15.96:0/3359672307 wait complete. 2023-05-08T03:34:24.370 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:21.707+0000 7f81f582a700 1 Processor -- start 2023-05-08T03:34:24.370 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:21.707+0000 7f81f582a700 1 -- start start 2023-05-08T03:34:24.370 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:21.708+0000 7f81f582a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81f0106130 0x7f81f019bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:34:24.370 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:21.708+0000 7f81f582a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f019c060 con 0x7f81f0106130 2023-05-08T03:34:24.370 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:21.708+0000 7f81eeffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81f0106130 0x7f81f019bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:34:24.370 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:21.708+0000 7f81eeffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81f0106130 0x7f81f019bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39280/0 (socket says 172.21.15.96:39280) 2023-05-08T03:34:24.370 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:21.708+0000 7f81eeffd700 1 -- 172.21.15.96:0/3578536170 learned_addr learned my addr 172.21.15.96:0/3578536170 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:34:24.371 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:21.708+0000 7f81eeffd700 1 -- 172.21.15.96:0/3578536170 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e000b7f0 con 0x7f81f0106130 2023-05-08T03:34:24.371 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:21.708+0000 7f81eeffd700 1 --2- 172.21.15.96:0/3578536170 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81f0106130 0x7f81f019bb20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f81e000b340 tx=0x7f81e0004020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:34:24.371 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:21.708+0000 7f81f4828700 1 -- 172.21.15.96:0/3578536170 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f81e0010730 con 0x7f81f0106130 2023-05-08T03:34:24.371 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:21.708+0000 7f81f4828700 1 -- 172.21.15.96:0/3578536170 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f81e0010d30 con 0x7f81f0106130 2023-05-08T03:34:24.371 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:21.708+0000 7f81f582a700 1 -- 172.21.15.96:0/3578536170 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81f0104ab0 con 0x7f81f0106130 2023-05-08T03:34:24.371 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:21.708+0000 7f81f4828700 1 -- 172.21.15.96:0/3578536170 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f81e0019c70 con 0x7f81f0106130 2023-05-08T03:34:24.371 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:21.708+0000 7f81f582a700 1 -- 172.21.15.96:0/3578536170 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81f0104920 con 0x7f81f0106130 2023-05-08T03:34:24.371 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:21.709+0000 7f81f4828700 1 -- 172.21.15.96:0/3578536170 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 8) v1 ==== 45483+0+0 (secure 0 0 0) 0x7f81e002a450 con 0x7f81f0106130 2023-05-08T03:34:24.372 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:21.709+0000 7f81f582a700 1 -- 172.21.15.96:0/3578536170 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81f0191520 con 0x7f81f0106130 2023-05-08T03:34:24.372 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:21.709+0000 7f81f4828700 1 --2- 172.21.15.96:0/3578536170 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7f81d80387d0 0x7f81d803ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:34:24.372 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:21.709+0000 7f81f4828700 1 -- 172.21.15.96:0/3578536170 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f81e004c980 con 0x7f81f0106130 2023-05-08T03:34:24.372 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:21.709+0000 7f81ee7fc700 1 --2- 172.21.15.96:0/3578536170 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7f81d80387d0 0x7f81d803ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:34:24.372 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:21.710+0000 7f81ee7fc700 1 --2- 172.21.15.96:0/3578536170 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7f81d80387d0 0x7f81d803ac80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f81e4006fd0 tx=0x7f81e4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:34:24.372 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:21.714+0000 7f81f4828700 1 -- 172.21.15.96:0/3578536170 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f81e0028530 con 0x7f81f0106130 2023-05-08T03:34:24.373 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:21.905+0000 7f81f582a700 1 -- 172.21.15.96:0/3578536170 --> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi096", "addr": "172.21.15.96", "target": ["mon-mgr", ""]}) v1 -- 0x7f81f0061030 con 0x7f81d80387d0 2023-05-08T03:34:24.373 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:24.002+0000 7f81f4828700 1 -- 172.21.15.96:0/3578536170 <== mgr.14120 v2:172.21.15.96:6800/1979917756 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7f81f0061030 con 0x7f81d80387d0 2023-05-08T03:34:24.373 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:24.005+0000 7f81f582a700 1 -- 172.21.15.96:0/3578536170 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7f81d80387d0 msgr2=0x7f81d803ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:34:24.373 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:24.005+0000 7f81f582a700 1 --2- 172.21.15.96:0/3578536170 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7f81d80387d0 0x7f81d803ac80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f81e4006fd0 tx=0x7f81e4006e40 comp rx=0 tx=0).stop 2023-05-08T03:34:24.373 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:24.005+0000 7f81f582a700 1 -- 172.21.15.96:0/3578536170 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81f0106130 msgr2=0x7f81f019bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:34:24.373 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:24.005+0000 7f81f582a700 1 --2- 172.21.15.96:0/3578536170 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81f0106130 0x7f81f019bb20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f81e000b340 tx=0x7f81e0004020 comp rx=0 tx=0).stop 2023-05-08T03:34:24.373 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:24.005+0000 7f81f582a700 1 -- 172.21.15.96:0/3578536170 shutdown_connections 2023-05-08T03:34:24.373 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:24.005+0000 7f81f582a700 1 --2- 172.21.15.96:0/3578536170 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7f81d80387d0 0x7f81d803ac80 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:24.374 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:24.005+0000 7f81f582a700 1 --2- 172.21.15.96:0/3578536170 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81f0106130 0x7f81f019bb20 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:24.374 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:24.005+0000 7f81f582a700 1 -- 172.21.15.96:0/3578536170 >> 172.21.15.96:0/3578536170 conn(0x7f81f00ff920 msgr2=0x7f81f018e660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:34:24.374 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:24.005+0000 7f81f582a700 1 -- 172.21.15.96:0/3578536170 shutdown_connections 2023-05-08T03:34:24.374 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:24.006+0000 7f81f582a700 1 -- 172.21.15.96:0/3578536170 wait complete. 2023-05-08T03:34:24.374 INFO:teuthology.orchestra.run.smithi096.stdout:Deploying unmanaged mon service... 2023-05-08T03:34:24.403 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:24 smithi096 ceph-mon[124666]: Deploying cephadm binary to smithi096 2023-05-08T03:34:24.403 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:24 smithi096 ceph-mon[124666]: from='mgr.14120 172.21.15.96:0/187696170' entity='mgr.x' 2023-05-08T03:34:24.403 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:24 smithi096 ceph-mon[124666]: from='mgr.14120 172.21.15.96:0/187696170' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:34:25.440 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:25 smithi096 ceph-mon[124666]: Added host smithi096 2023-05-08T03:34:25.441 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:25 smithi096 ceph-mon[124666]: from='mgr.14120 172.21.15.96:0/187696170' entity='mgr.x' 2023-05-08T03:34:25.811 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2023-05-08T03:34:25.812 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:24.892+0000 7fb8132e6700 1 Processor -- start 2023-05-08T03:34:25.812 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:24.892+0000 7fb8132e6700 1 -- start start 2023-05-08T03:34:25.812 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:24.892+0000 7fb8132e6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb80c106730 0x7fb80c108b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:34:25.812 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:24.892+0000 7fb8132e6700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb80c074270 con 0x7fb80c106730 2023-05-08T03:34:25.812 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:24.892+0000 7fb811082700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb80c106730 0x7fb80c108b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:34:25.813 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:24.892+0000 7fb811082700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb80c106730 0x7fb80c108b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39314/0 (socket says 172.21.15.96:39314) 2023-05-08T03:34:25.813 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:24.892+0000 7fb811082700 1 -- 172.21.15.96:0/2844179725 learned_addr learned my addr 172.21.15.96:0/2844179725 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:34:25.813 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:24.892+0000 7fb811082700 1 -- 172.21.15.96:0/2844179725 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb80c0743b0 con 0x7fb80c106730 2023-05-08T03:34:25.813 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:24.893+0000 7fb811082700 1 --2- 172.21.15.96:0/2844179725 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb80c106730 0x7fb80c108b10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc0098a0 tx=0x7fb7fc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4a5d061b1937ae2 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:34:25.813 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:24.893+0000 7fb803fff700 1 -- 172.21.15.96:0/2844179725 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb7fc004160 con 0x7fb80c106730 2023-05-08T03:34:25.813 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:24.893+0000 7fb803fff700 1 -- 172.21.15.96:0/2844179725 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb7fc0042c0 con 0x7fb80c106730 2023-05-08T03:34:25.813 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:24.893+0000 7fb803fff700 1 -- 172.21.15.96:0/2844179725 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb7fc011a00 con 0x7fb80c106730 2023-05-08T03:34:25.814 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:24.893+0000 7fb8132e6700 1 -- 172.21.15.96:0/2844179725 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb80c106730 msgr2=0x7fb80c108b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:34:25.814 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:24.893+0000 7fb8132e6700 1 --2- 172.21.15.96:0/2844179725 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb80c106730 0x7fb80c108b10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc0098a0 tx=0x7fb7fc009bb0 comp rx=0 tx=0).stop 2023-05-08T03:34:25.814 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:24.893+0000 7fb8132e6700 1 -- 172.21.15.96:0/2844179725 shutdown_connections 2023-05-08T03:34:25.814 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:24.893+0000 7fb8132e6700 1 --2- 172.21.15.96:0/2844179725 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb80c106730 0x7fb80c108b10 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:25.814 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:24.893+0000 7fb8132e6700 1 -- 172.21.15.96:0/2844179725 >> 172.21.15.96:0/2844179725 conn(0x7fb80c100170 msgr2=0x7fb80c1025a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:34:25.815 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:24.893+0000 7fb8132e6700 1 -- 172.21.15.96:0/2844179725 shutdown_connections 2023-05-08T03:34:25.815 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:24.894+0000 7fb8132e6700 1 -- 172.21.15.96:0/2844179725 wait complete. 2023-05-08T03:34:25.815 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:24.894+0000 7fb8132e6700 1 Processor -- start 2023-05-08T03:34:25.815 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:24.894+0000 7fb8132e6700 1 -- start start 2023-05-08T03:34:25.815 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:24.894+0000 7fb8132e6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb80c106730 0x7fb80c199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:34:25.815 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:24.894+0000 7fb8132e6700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb80c199d80 con 0x7fb80c106730 2023-05-08T03:34:25.815 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:24.894+0000 7fb811082700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb80c106730 0x7fb80c199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:34:25.816 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:24.894+0000 7fb811082700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb80c106730 0x7fb80c199840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39316/0 (socket says 172.21.15.96:39316) 2023-05-08T03:34:25.816 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:24.894+0000 7fb811082700 1 -- 172.21.15.96:0/2722316429 learned_addr learned my addr 172.21.15.96:0/2722316429 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:34:25.816 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:24.895+0000 7fb811082700 1 -- 172.21.15.96:0/2722316429 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7fc009550 con 0x7fb80c106730 2023-05-08T03:34:25.816 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:24.895+0000 7fb811082700 1 --2- 172.21.15.96:0/2722316429 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb80c106730 0x7fb80c199840 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc009fb0 tx=0x7fb7fc011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:34:25.816 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:24.895+0000 7fb8027fc700 1 -- 172.21.15.96:0/2722316429 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb7fc003930 con 0x7fb80c106730 2023-05-08T03:34:25.816 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:24.895+0000 7fb8027fc700 1 -- 172.21.15.96:0/2722316429 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb7fc003a90 con 0x7fb80c106730 2023-05-08T03:34:25.816 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:24.895+0000 7fb8027fc700 1 -- 172.21.15.96:0/2722316429 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb7fc0195e0 con 0x7fb80c106730 2023-05-08T03:34:25.817 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:24.895+0000 7fb8132e6700 1 -- 172.21.15.96:0/2722316429 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb80c109eb0 con 0x7fb80c106730 2023-05-08T03:34:25.817 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:24.895+0000 7fb8132e6700 1 -- 172.21.15.96:0/2722316429 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb80c109d20 con 0x7fb80c106730 2023-05-08T03:34:25.817 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:24.896+0000 7fb8027fc700 1 -- 172.21.15.96:0/2722316429 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 8) v1 ==== 45483+0+0 (secure 0 0 0) 0x7fb7fc01a9d0 con 0x7fb80c106730 2023-05-08T03:34:25.817 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:24.896+0000 7fb8027fc700 1 --2- 172.21.15.96:0/2722316429 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7fb7f80387d0 0x7fb7f803ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:34:25.817 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:24.896+0000 7fb8132e6700 1 -- 172.21.15.96:0/2722316429 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb80c062220 con 0x7fb80c106730 2023-05-08T03:34:25.817 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:24.896+0000 7fb8027fc700 1 -- 172.21.15.96:0/2722316429 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fb7fc04c7d0 con 0x7fb80c106730 2023-05-08T03:34:25.817 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:24.896+0000 7fb810881700 1 --2- 172.21.15.96:0/2722316429 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7fb7f80387d0 0x7fb7f803ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:34:25.818 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:24.896+0000 7fb810881700 1 --2- 172.21.15.96:0/2722316429 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7fb7f80387d0 0x7fb7f803ac80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb808006fd0 tx=0x7fb808006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:34:25.818 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:24.901+0000 7fb8027fc700 1 -- 172.21.15.96:0/2722316429 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fb7fc019850 con 0x7fb80c106730 2023-05-08T03:34:25.818 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:25.116+0000 7fb8132e6700 1 -- 172.21.15.96:0/2722316429 --> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fb80c19a530 con 0x7fb7f80387d0 2023-05-08T03:34:25.818 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:25.120+0000 7fb8027fc700 1 -- 172.21.15.96:0/2722316429 <== mgr.14120 v2:172.21.15.96:6800/1979917756 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fb80c19a530 con 0x7fb7f80387d0 2023-05-08T03:34:25.818 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:25.123+0000 7fb8132e6700 1 -- 172.21.15.96:0/2722316429 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7fb7f80387d0 msgr2=0x7fb7f803ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:34:25.818 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:25.123+0000 7fb8132e6700 1 --2- 172.21.15.96:0/2722316429 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7fb7f80387d0 0x7fb7f803ac80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb808006fd0 tx=0x7fb808006e40 comp rx=0 tx=0).stop 2023-05-08T03:34:25.818 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:25.123+0000 7fb8132e6700 1 -- 172.21.15.96:0/2722316429 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb80c106730 msgr2=0x7fb80c199840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:34:25.818 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:25.123+0000 7fb8132e6700 1 --2- 172.21.15.96:0/2722316429 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb80c106730 0x7fb80c199840 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc009fb0 tx=0x7fb7fc011ad0 comp rx=0 tx=0).stop 2023-05-08T03:34:25.819 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:25.123+0000 7fb8132e6700 1 -- 172.21.15.96:0/2722316429 shutdown_connections 2023-05-08T03:34:25.819 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:25.123+0000 7fb8132e6700 1 --2- 172.21.15.96:0/2722316429 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7fb7f80387d0 0x7fb7f803ac80 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:25.819 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:25.123+0000 7fb8132e6700 1 --2- 172.21.15.96:0/2722316429 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb80c106730 0x7fb80c199840 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:25.819 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:25.123+0000 7fb8132e6700 1 -- 172.21.15.96:0/2722316429 >> 172.21.15.96:0/2722316429 conn(0x7fb80c100170 msgr2=0x7fb80c100ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:34:25.819 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:25.123+0000 7fb8132e6700 1 -- 172.21.15.96:0/2722316429 shutdown_connections 2023-05-08T03:34:25.819 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:25.123+0000 7fb8132e6700 1 -- 172.21.15.96:0/2722316429 wait complete. 2023-05-08T03:34:25.819 INFO:teuthology.orchestra.run.smithi096.stdout:Deploying unmanaged mgr service... 2023-05-08T03:34:26.460 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:26 smithi096 ceph-mon[124666]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:34:26.460 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:26 smithi096 ceph-mon[124666]: Saving service mon spec with placement count:5 2023-05-08T03:34:26.959 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2023-05-08T03:34:26.959 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:26.384+0000 7fc3dd3e9700 1 Processor -- start 2023-05-08T03:34:26.959 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:26.384+0000 7fc3dd3e9700 1 -- start start 2023-05-08T03:34:26.960 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:26.384+0000 7fc3dd3e9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3d807acd0 0x7fc3d80791d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:34:26.960 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:26.384+0000 7fc3dd3e9700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d8079710 con 0x7fc3d807acd0 2023-05-08T03:34:26.960 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:26.385+0000 7fc3d6ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3d807acd0 0x7fc3d80791d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:34:26.960 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:26.385+0000 7fc3d6ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3d807acd0 0x7fc3d80791d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39320/0 (socket says 172.21.15.96:39320) 2023-05-08T03:34:26.961 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:26.385+0000 7fc3d6ffd700 1 -- 172.21.15.96:0/4215572658 learned_addr learned my addr 172.21.15.96:0/4215572658 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:34:26.961 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:26.385+0000 7fc3d6ffd700 1 -- 172.21.15.96:0/4215572658 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3d8079850 con 0x7fc3d807acd0 2023-05-08T03:34:26.961 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:26.385+0000 7fc3d6ffd700 1 --2- 172.21.15.96:0/4215572658 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3d807acd0 0x7fc3d80791d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc0098a0 tx=0x7fc3cc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac6ae31a891ef335 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:34:26.961 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:26.385+0000 7fc3d5ffb700 1 -- 172.21.15.96:0/4215572658 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc3cc004160 con 0x7fc3d807acd0 2023-05-08T03:34:26.961 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:26.385+0000 7fc3d5ffb700 1 -- 172.21.15.96:0/4215572658 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc3cc0042c0 con 0x7fc3d807acd0 2023-05-08T03:34:26.962 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:26.385+0000 7fc3d5ffb700 1 -- 172.21.15.96:0/4215572658 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc3cc011a00 con 0x7fc3d807acd0 2023-05-08T03:34:26.962 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:26.386+0000 7fc3dd3e9700 1 -- 172.21.15.96:0/4215572658 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3d807acd0 msgr2=0x7fc3d80791d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:34:26.962 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:26.386+0000 7fc3dd3e9700 1 --2- 172.21.15.96:0/4215572658 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3d807acd0 0x7fc3d80791d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc0098a0 tx=0x7fc3cc009bb0 comp rx=0 tx=0).stop 2023-05-08T03:34:26.962 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:26.386+0000 7fc3dd3e9700 1 -- 172.21.15.96:0/4215572658 shutdown_connections 2023-05-08T03:34:26.963 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:26.386+0000 7fc3dd3e9700 1 --2- 172.21.15.96:0/4215572658 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3d807acd0 0x7fc3d80791d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:26.963 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:26.386+0000 7fc3dd3e9700 1 -- 172.21.15.96:0/4215572658 >> 172.21.15.96:0/4215572658 conn(0x7fc3d81012b0 msgr2=0x7fc3d81036c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:34:26.963 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:26.386+0000 7fc3dd3e9700 1 -- 172.21.15.96:0/4215572658 shutdown_connections 2023-05-08T03:34:26.964 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:26.386+0000 7fc3dd3e9700 1 -- 172.21.15.96:0/4215572658 wait complete. 2023-05-08T03:34:26.964 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:26.386+0000 7fc3dd3e9700 1 Processor -- start 2023-05-08T03:34:26.964 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:26.387+0000 7fc3dd3e9700 1 -- start start 2023-05-08T03:34:26.965 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:26.387+0000 7fc3dd3e9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3d807acd0 0x7fc3d819bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:34:26.965 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:26.387+0000 7fc3dd3e9700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d819bff0 con 0x7fc3d807acd0 2023-05-08T03:34:26.965 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:26.387+0000 7fc3d6ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3d807acd0 0x7fc3d819bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:34:26.965 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:26.387+0000 7fc3d6ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3d807acd0 0x7fc3d819bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39322/0 (socket says 172.21.15.96:39322) 2023-05-08T03:34:26.966 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:26.387+0000 7fc3d6ffd700 1 -- 172.21.15.96:0/848207652 learned_addr learned my addr 172.21.15.96:0/848207652 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:34:26.966 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:26.387+0000 7fc3d6ffd700 1 -- 172.21.15.96:0/848207652 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3cc009550 con 0x7fc3d807acd0 2023-05-08T03:34:26.966 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:26.387+0000 7fc3d6ffd700 1 --2- 172.21.15.96:0/848207652 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3d807acd0 0x7fc3d819bab0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc006af0 tx=0x7fc3cc011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:34:26.966 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:26.387+0000 7fc3bffff700 1 -- 172.21.15.96:0/848207652 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc3cc003a40 con 0x7fc3d807acd0 2023-05-08T03:34:26.967 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:26.387+0000 7fc3dd3e9700 1 -- 172.21.15.96:0/848207652 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3d810c110 con 0x7fc3d807acd0 2023-05-08T03:34:26.967 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:26.387+0000 7fc3bffff700 1 -- 172.21.15.96:0/848207652 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc3cc003ba0 con 0x7fc3d807acd0 2023-05-08T03:34:26.967 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:26.387+0000 7fc3bffff700 1 -- 172.21.15.96:0/848207652 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc3cc01a700 con 0x7fc3d807acd0 2023-05-08T03:34:26.967 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:26.387+0000 7fc3dd3e9700 1 -- 172.21.15.96:0/848207652 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3d810bf80 con 0x7fc3d807acd0 2023-05-08T03:34:26.968 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:26.388+0000 7fc3bffff700 1 -- 172.21.15.96:0/848207652 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 8) v1 ==== 45483+0+0 (secure 0 0 0) 0x7fc3cc01a980 con 0x7fc3d807acd0 2023-05-08T03:34:26.968 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:26.388+0000 7fc3bffff700 1 --2- 172.21.15.96:0/848207652 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7fc3c00387d0 0x7fc3c003ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:34:26.968 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:26.388+0000 7fc3dd3e9700 1 -- 172.21.15.96:0/848207652 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3d8062220 con 0x7fc3d807acd0 2023-05-08T03:34:26.969 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:26.388+0000 7fc3bffff700 1 -- 172.21.15.96:0/848207652 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fc3cc04c8c0 con 0x7fc3d807acd0 2023-05-08T03:34:26.969 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:26.389+0000 7fc3d67fc700 1 --2- 172.21.15.96:0/848207652 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7fc3c00387d0 0x7fc3c003ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:34:26.969 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:26.389+0000 7fc3d67fc700 1 --2- 172.21.15.96:0/848207652 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7fc3c00387d0 0x7fc3c003ac80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc3c8006fd0 tx=0x7fc3c8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:34:26.969 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:26.393+0000 7fc3bffff700 1 -- 172.21.15.96:0/848207652 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fc3cc018530 con 0x7fc3d807acd0 2023-05-08T03:34:26.970 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:26.517+0000 7fc3bffff700 1 -- 172.21.15.96:0/848207652 <== mon.0 v2:172.21.15.96:3300/0 7 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc3cc04c2d0 con 0x7fc3d807acd0 2023-05-08T03:34:26.970 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:26.602+0000 7fc3dd3e9700 1 -- 172.21.15.96:0/848207652 --> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fc3d81026a0 con 0x7fc3c00387d0 2023-05-08T03:34:26.970 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:26.607+0000 7fc3bffff700 1 -- 172.21.15.96:0/848207652 <== mgr.14120 v2:172.21.15.96:6800/1979917756 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fc3d81026a0 con 0x7fc3c00387d0 2023-05-08T03:34:26.971 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:26.609+0000 7fc3dd3e9700 1 -- 172.21.15.96:0/848207652 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7fc3c00387d0 msgr2=0x7fc3c003ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:34:26.971 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:26.609+0000 7fc3dd3e9700 1 --2- 172.21.15.96:0/848207652 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7fc3c00387d0 0x7fc3c003ac80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc3c8006fd0 tx=0x7fc3c8006e40 comp rx=0 tx=0).stop 2023-05-08T03:34:26.971 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:26.609+0000 7fc3dd3e9700 1 -- 172.21.15.96:0/848207652 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3d807acd0 msgr2=0x7fc3d819bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:34:26.971 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:26.609+0000 7fc3dd3e9700 1 --2- 172.21.15.96:0/848207652 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3d807acd0 0x7fc3d819bab0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc006af0 tx=0x7fc3cc011ad0 comp rx=0 tx=0).stop 2023-05-08T03:34:26.972 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:26.609+0000 7fc3dd3e9700 1 -- 172.21.15.96:0/848207652 shutdown_connections 2023-05-08T03:34:26.972 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:26.609+0000 7fc3dd3e9700 1 --2- 172.21.15.96:0/848207652 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7fc3c00387d0 0x7fc3c003ac80 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:26.972 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:26.609+0000 7fc3dd3e9700 1 --2- 172.21.15.96:0/848207652 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3d807acd0 0x7fc3d819bab0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:26.973 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:26.609+0000 7fc3dd3e9700 1 -- 172.21.15.96:0/848207652 >> 172.21.15.96:0/848207652 conn(0x7fc3d81012b0 msgr2=0x7fc3d8101f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:34:26.973 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:26.609+0000 7fc3dd3e9700 1 -- 172.21.15.96:0/848207652 shutdown_connections 2023-05-08T03:34:26.973 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:26.609+0000 7fc3dd3e9700 1 -- 172.21.15.96:0/848207652 wait complete. 2023-05-08T03:34:27.860 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:27 smithi096 ceph-mon[124666]: from='mgr.14120 172.21.15.96:0/187696170' entity='mgr.x' 2023-05-08T03:34:27.860 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:27 smithi096 ceph-mon[124666]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:34:27.860 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:27 smithi096 ceph-mon[124666]: Saving service mgr spec with placement count:2 2023-05-08T03:34:27.860 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:27 smithi096 ceph-mon[124666]: from='mgr.14120 172.21.15.96:0/187696170' entity='mgr.x' 2023-05-08T03:34:27.860 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:27 smithi096 ceph-mon[124666]: from='mgr.14120 172.21.15.96:0/187696170' entity='mgr.x' 2023-05-08T03:34:28.099 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:27.487+0000 7ff481292700 1 Processor -- start 2023-05-08T03:34:28.099 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:27.487+0000 7ff481292700 1 -- start start 2023-05-08T03:34:28.099 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:27.487+0000 7ff481292700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff47c1042a0 0x7ff47c1046b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:34:28.099 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:27.487+0000 7ff481292700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff47c104bf0 con 0x7ff47c1042a0 2023-05-08T03:34:28.099 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:27.488+0000 7ff47affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff47c1042a0 0x7ff47c1046b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:34:28.099 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:27.488+0000 7ff47affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff47c1042a0 0x7ff47c1046b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39326/0 (socket says 172.21.15.96:39326) 2023-05-08T03:34:28.100 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:27.488+0000 7ff47affd700 1 -- 172.21.15.96:0/480805686 learned_addr learned my addr 172.21.15.96:0/480805686 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:34:28.100 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:27.488+0000 7ff47affd700 1 -- 172.21.15.96:0/480805686 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff47c104d30 con 0x7ff47c1042a0 2023-05-08T03:34:28.100 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:27.488+0000 7ff47affd700 1 --2- 172.21.15.96:0/480805686 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff47c1042a0 0x7ff47c1046b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff47400d180 tx=0x7ff47400d490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7e9095629276477 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:34:28.100 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:27.488+0000 7ff479ffb700 1 -- 172.21.15.96:0/480805686 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff474010070 con 0x7ff47c1042a0 2023-05-08T03:34:28.100 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:27.488+0000 7ff479ffb700 1 -- 172.21.15.96:0/480805686 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff47400dc10 con 0x7ff47c1042a0 2023-05-08T03:34:28.100 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:27.488+0000 7ff479ffb700 1 -- 172.21.15.96:0/480805686 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4740047b0 con 0x7ff47c1042a0 2023-05-08T03:34:28.100 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:27.489+0000 7ff481292700 1 -- 172.21.15.96:0/480805686 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff47c1042a0 msgr2=0x7ff47c1046b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:34:28.101 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:27.489+0000 7ff481292700 1 --2- 172.21.15.96:0/480805686 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff47c1042a0 0x7ff47c1046b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff47400d180 tx=0x7ff47400d490 comp rx=0 tx=0).stop 2023-05-08T03:34:28.101 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:27.489+0000 7ff481292700 1 -- 172.21.15.96:0/480805686 shutdown_connections 2023-05-08T03:34:28.101 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:27.489+0000 7ff481292700 1 --2- 172.21.15.96:0/480805686 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff47c1042a0 0x7ff47c1046b0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:28.101 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:27.489+0000 7ff481292700 1 -- 172.21.15.96:0/480805686 >> 172.21.15.96:0/480805686 conn(0x7ff47c0ff930 msgr2=0x7ff47c101d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:34:28.101 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:27.489+0000 7ff481292700 1 -- 172.21.15.96:0/480805686 shutdown_connections 2023-05-08T03:34:28.101 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:27.489+0000 7ff481292700 1 -- 172.21.15.96:0/480805686 wait complete. 2023-05-08T03:34:28.101 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:27.489+0000 7ff481292700 1 Processor -- start 2023-05-08T03:34:28.102 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:27.490+0000 7ff481292700 1 -- start start 2023-05-08T03:34:28.102 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:27.490+0000 7ff481292700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff47c1042a0 0x7ff47c1976a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:34:28.102 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:27.490+0000 7ff481292700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff47c197be0 con 0x7ff47c1042a0 2023-05-08T03:34:28.102 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:27.490+0000 7ff47affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff47c1042a0 0x7ff47c1976a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:34:28.102 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:27.490+0000 7ff47affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff47c1042a0 0x7ff47c1976a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39328/0 (socket says 172.21.15.96:39328) 2023-05-08T03:34:28.102 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:27.490+0000 7ff47affd700 1 -- 172.21.15.96:0/3709092429 learned_addr learned my addr 172.21.15.96:0/3709092429 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:34:28.102 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:27.490+0000 7ff47affd700 1 -- 172.21.15.96:0/3709092429 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff47400bd40 con 0x7ff47c1042a0 2023-05-08T03:34:28.102 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:27.490+0000 7ff47affd700 1 --2- 172.21.15.96:0/3709092429 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff47c1042a0 0x7ff47c1976a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff47400d150 tx=0x7ff47400db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:34:28.103 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:27.490+0000 7ff463fff700 1 -- 172.21.15.96:0/3709092429 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff474010040 con 0x7ff47c1042a0 2023-05-08T03:34:28.103 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:27.490+0000 7ff463fff700 1 -- 172.21.15.96:0/3709092429 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff474021c40 con 0x7ff47c1042a0 2023-05-08T03:34:28.103 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:27.490+0000 7ff481292700 1 -- 172.21.15.96:0/3709092429 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff47c105af0 con 0x7ff47c1042a0 2023-05-08T03:34:28.103 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:27.490+0000 7ff463fff700 1 -- 172.21.15.96:0/3709092429 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff474016c70 con 0x7ff47c1042a0 2023-05-08T03:34:28.103 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:27.490+0000 7ff481292700 1 -- 172.21.15.96:0/3709092429 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff47c105960 con 0x7ff47c1042a0 2023-05-08T03:34:28.103 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:27.491+0000 7ff463fff700 1 -- 172.21.15.96:0/3709092429 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 8) v1 ==== 45483+0+0 (secure 0 0 0) 0x7ff47401f410 con 0x7ff47c1042a0 2023-05-08T03:34:28.103 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:27.491+0000 7ff481292700 1 -- 172.21.15.96:0/3709092429 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff47c105c80 con 0x7ff47c1042a0 2023-05-08T03:34:28.104 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:27.491+0000 7ff463fff700 1 --2- 172.21.15.96:0/3709092429 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7ff4640387d0 0x7ff46403ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:34:28.104 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:27.491+0000 7ff463fff700 1 -- 172.21.15.96:0/3709092429 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7ff47404f520 con 0x7ff47c1042a0 2023-05-08T03:34:28.104 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:27.492+0000 7ff47a7fc700 1 --2- 172.21.15.96:0/3709092429 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7ff4640387d0 0x7ff46403ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:34:28.104 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:27.492+0000 7ff47a7fc700 1 --2- 172.21.15.96:0/3709092429 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7ff4640387d0 0x7ff46403ac80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff470006fd0 tx=0x7ff470006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:34:28.104 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:27.497+0000 7ff463fff700 1 -- 172.21.15.96:0/3709092429 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7ff474029d40 con 0x7ff47c1042a0 2023-05-08T03:34:28.104 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:27.703+0000 7ff481292700 1 -- 172.21.15.96:0/3709092429 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7ff47c02d0e0 con 0x7ff47c1042a0 2023-05-08T03:34:28.104 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:27.707+0000 7ff463fff700 1 -- 172.21.15.96:0/3709092429 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7ff474016e60 con 0x7ff47c1042a0 2023-05-08T03:34:28.105 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:27.710+0000 7ff481292700 1 -- 172.21.15.96:0/3709092429 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7ff4640387d0 msgr2=0x7ff46403ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:34:28.105 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:27.710+0000 7ff481292700 1 --2- 172.21.15.96:0/3709092429 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7ff4640387d0 0x7ff46403ac80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff470006fd0 tx=0x7ff470006e40 comp rx=0 tx=0).stop 2023-05-08T03:34:28.105 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:27.710+0000 7ff481292700 1 -- 172.21.15.96:0/3709092429 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff47c1042a0 msgr2=0x7ff47c1976a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:34:28.105 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:27.710+0000 7ff481292700 1 --2- 172.21.15.96:0/3709092429 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff47c1042a0 0x7ff47c1976a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff47400d150 tx=0x7ff47400db90 comp rx=0 tx=0).stop 2023-05-08T03:34:28.105 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:27.710+0000 7ff481292700 1 -- 172.21.15.96:0/3709092429 shutdown_connections 2023-05-08T03:34:28.105 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:27.710+0000 7ff481292700 1 --2- 172.21.15.96:0/3709092429 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7ff4640387d0 0x7ff46403ac80 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:28.105 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:27.710+0000 7ff481292700 1 --2- 172.21.15.96:0/3709092429 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff47c1042a0 0x7ff47c1976a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:28.106 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:27.710+0000 7ff481292700 1 -- 172.21.15.96:0/3709092429 >> 172.21.15.96:0/3709092429 conn(0x7ff47c0ff930 msgr2=0x7ff47c18bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:34:28.106 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:27.711+0000 7ff481292700 1 -- 172.21.15.96:0/3709092429 shutdown_connections 2023-05-08T03:34:28.106 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:27.711+0000 7ff481292700 1 -- 172.21.15.96:0/3709092429 wait complete. 2023-05-08T03:34:28.959 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:28 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/3709092429' entity='client.admin' 2023-05-08T03:34:29.241 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:28.601+0000 7f8e71aa0700 1 Processor -- start 2023-05-08T03:34:29.241 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:28.601+0000 7f8e71aa0700 1 -- start start 2023-05-08T03:34:29.242 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:28.601+0000 7f8e71aa0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e6c105020 0x7f8e6c105430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:34:29.242 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:28.601+0000 7f8e71aa0700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6c105970 con 0x7f8e6c105020 2023-05-08T03:34:29.242 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:28.601+0000 7f8e6b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e6c105020 0x7f8e6c105430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:34:29.242 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:28.601+0000 7f8e6b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e6c105020 0x7f8e6c105430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39332/0 (socket says 172.21.15.96:39332) 2023-05-08T03:34:29.242 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:28.601+0000 7f8e6b7fe700 1 -- 172.21.15.96:0/2028041910 learned_addr learned my addr 172.21.15.96:0/2028041910 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:34:29.242 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:28.601+0000 7f8e6b7fe700 1 -- 172.21.15.96:0/2028041910 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e6c105ab0 con 0x7f8e6c105020 2023-05-08T03:34:29.242 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:28.602+0000 7f8e6b7fe700 1 --2- 172.21.15.96:0/2028041910 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e6c105020 0x7f8e6c105430 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c0098a0 tx=0x7f8e5c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1772d1b708819d9a server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:34:29.243 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:28.602+0000 7f8e6a7fc700 1 -- 172.21.15.96:0/2028041910 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8e5c004160 con 0x7f8e6c105020 2023-05-08T03:34:29.243 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:28.602+0000 7f8e6a7fc700 1 -- 172.21.15.96:0/2028041910 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8e5c0042c0 con 0x7f8e6c105020 2023-05-08T03:34:29.243 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:28.602+0000 7f8e6a7fc700 1 -- 172.21.15.96:0/2028041910 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8e5c0119b0 con 0x7f8e6c105020 2023-05-08T03:34:29.243 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:28.602+0000 7f8e71aa0700 1 -- 172.21.15.96:0/2028041910 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e6c105020 msgr2=0x7f8e6c105430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:34:29.243 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:28.602+0000 7f8e71aa0700 1 --2- 172.21.15.96:0/2028041910 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e6c105020 0x7f8e6c105430 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c0098a0 tx=0x7f8e5c009bb0 comp rx=0 tx=0).stop 2023-05-08T03:34:29.243 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:28.602+0000 7f8e71aa0700 1 -- 172.21.15.96:0/2028041910 shutdown_connections 2023-05-08T03:34:29.243 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:28.603+0000 7f8e71aa0700 1 --2- 172.21.15.96:0/2028041910 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e6c105020 0x7f8e6c105430 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:29.244 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:28.603+0000 7f8e71aa0700 1 -- 172.21.15.96:0/2028041910 >> 172.21.15.96:0/2028041910 conn(0x7f8e6c0ff930 msgr2=0x7f8e6c101d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:34:29.244 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:28.603+0000 7f8e71aa0700 1 -- 172.21.15.96:0/2028041910 shutdown_connections 2023-05-08T03:34:29.244 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:28.603+0000 7f8e71aa0700 1 -- 172.21.15.96:0/2028041910 wait complete. 2023-05-08T03:34:29.244 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:28.603+0000 7f8e71aa0700 1 Processor -- start 2023-05-08T03:34:29.244 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:28.603+0000 7f8e71aa0700 1 -- start start 2023-05-08T03:34:29.244 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:28.603+0000 7f8e71aa0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e6c105020 0x7f8e6c1047a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:34:29.244 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:28.604+0000 7f8e71aa0700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6c19c640 con 0x7f8e6c105020 2023-05-08T03:34:29.245 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:28.604+0000 7f8e6b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e6c105020 0x7f8e6c1047a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:34:29.245 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:28.604+0000 7f8e6b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e6c105020 0x7f8e6c1047a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39334/0 (socket says 172.21.15.96:39334) 2023-05-08T03:34:29.245 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:28.604+0000 7f8e6b7fe700 1 -- 172.21.15.96:0/2308491790 learned_addr learned my addr 172.21.15.96:0/2308491790 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:34:29.245 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:28.604+0000 7f8e6b7fe700 1 -- 172.21.15.96:0/2308491790 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e5c009550 con 0x7f8e6c105020 2023-05-08T03:34:29.245 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:28.604+0000 7f8e6b7fe700 1 --2- 172.21.15.96:0/2308491790 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e6c105020 0x7f8e6c1047a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c000c00 tx=0x7f8e5c011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:34:29.245 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:28.604+0000 7f8e68ff9700 1 -- 172.21.15.96:0/2308491790 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8e5c003970 con 0x7f8e6c105020 2023-05-08T03:34:29.245 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:28.604+0000 7f8e71aa0700 1 -- 172.21.15.96:0/2308491790 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e6c106c20 con 0x7f8e6c105020 2023-05-08T03:34:29.245 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:28.604+0000 7f8e68ff9700 1 -- 172.21.15.96:0/2308491790 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8e5c003ad0 con 0x7f8e6c105020 2023-05-08T03:34:29.246 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:28.604+0000 7f8e68ff9700 1 -- 172.21.15.96:0/2308491790 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8e5c01a6f0 con 0x7f8e6c105020 2023-05-08T03:34:29.246 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:28.604+0000 7f8e71aa0700 1 -- 172.21.15.96:0/2308491790 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e6c106a90 con 0x7f8e6c105020 2023-05-08T03:34:29.246 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:28.605+0000 7f8e68ff9700 1 -- 172.21.15.96:0/2308491790 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 8) v1 ==== 45483+0+0 (secure 0 0 0) 0x7f8e5c01a850 con 0x7f8e6c105020 2023-05-08T03:34:29.246 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:28.606+0000 7f8e68ff9700 1 --2- 172.21.15.96:0/2308491790 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7f8e540387d0 0x7f8e5403ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:34:29.246 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:28.606+0000 7f8e68ff9700 1 -- 172.21.15.96:0/2308491790 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f8e5c04c640 con 0x7f8e6c105020 2023-05-08T03:34:29.246 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:28.606+0000 7f8e71aa0700 1 -- 172.21.15.96:0/2308491790 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e6c062220 con 0x7f8e6c105020 2023-05-08T03:34:29.246 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:28.606+0000 7f8e6affd700 1 --2- 172.21.15.96:0/2308491790 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7f8e540387d0 0x7f8e5403ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:34:29.247 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:28.606+0000 7f8e6affd700 1 --2- 172.21.15.96:0/2308491790 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7f8e540387d0 0x7f8e5403ac80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8e60006fd0 tx=0x7f8e60006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:34:29.247 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:28.612+0000 7f8e68ff9700 1 -- 172.21.15.96:0/2308491790 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f8e5c01ab00 con 0x7f8e6c105020 2023-05-08T03:34:29.247 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:28.806+0000 7f8e71aa0700 1 -- 172.21.15.96:0/2308491790 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f8e6c19ce90 con 0x7f8e6c105020 2023-05-08T03:34:29.247 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:28.809+0000 7f8e68ff9700 1 -- 172.21.15.96:0/2308491790 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f8e5c018350 con 0x7f8e6c105020 2023-05-08T03:34:29.247 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:28.812+0000 7f8e71aa0700 1 -- 172.21.15.96:0/2308491790 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7f8e540387d0 msgr2=0x7f8e5403ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:34:29.247 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:28.812+0000 7f8e71aa0700 1 --2- 172.21.15.96:0/2308491790 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7f8e540387d0 0x7f8e5403ac80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8e60006fd0 tx=0x7f8e60006e40 comp rx=0 tx=0).stop 2023-05-08T03:34:29.247 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:28.812+0000 7f8e71aa0700 1 -- 172.21.15.96:0/2308491790 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e6c105020 msgr2=0x7f8e6c1047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:34:29.247 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:28.812+0000 7f8e71aa0700 1 --2- 172.21.15.96:0/2308491790 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e6c105020 0x7f8e6c1047a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c000c00 tx=0x7f8e5c011a30 comp rx=0 tx=0).stop 2023-05-08T03:34:29.248 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:28.812+0000 7f8e71aa0700 1 -- 172.21.15.96:0/2308491790 shutdown_connections 2023-05-08T03:34:29.248 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:28.812+0000 7f8e71aa0700 1 --2- 172.21.15.96:0/2308491790 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7f8e540387d0 0x7f8e5403ac80 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:29.248 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:28.812+0000 7f8e71aa0700 1 --2- 172.21.15.96:0/2308491790 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e6c105020 0x7f8e6c1047a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:29.248 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:28.812+0000 7f8e71aa0700 1 -- 172.21.15.96:0/2308491790 >> 172.21.15.96:0/2308491790 conn(0x7f8e6c0ff930 msgr2=0x7f8e6c100630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:34:29.248 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:28.812+0000 7f8e71aa0700 1 -- 172.21.15.96:0/2308491790 shutdown_connections 2023-05-08T03:34:29.248 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:28.812+0000 7f8e71aa0700 1 -- 172.21.15.96:0/2308491790 wait complete. 2023-05-08T03:34:29.248 INFO:teuthology.orchestra.run.smithi096.stdout:Enabling the dashboard module... 2023-05-08T03:34:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:29 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/2308491790' entity='client.admin' 2023-05-08T03:34:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:29 smithi096 ceph-mon[124666]: from='mgr.14120 172.21.15.96:0/187696170' entity='mgr.x' 2023-05-08T03:34:31.071 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:30 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/2653841910' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2023-05-08T03:34:31.071 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:30 smithi096 ceph-mon[124666]: from='mgr.14120 172.21.15.96:0/187696170' entity='mgr.x' 2023-05-08T03:34:31.071 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:34:30 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: ignoring --setuser ceph since I am not root 2023-05-08T03:34:31.071 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:34:30 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: ignoring --setgroup ceph since I am not root 2023-05-08T03:34:31.072 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:34:30 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:34:30.988+0000 7fbf03a5a200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-05-08T03:34:31.072 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:34:31 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:34:31.068+0000 7fbf03a5a200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-08T03:34:31.185 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:29.725+0000 7f9030d85700 1 Processor -- start 2023-05-08T03:34:31.185 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:29.725+0000 7f9030d85700 1 -- start start 2023-05-08T03:34:31.185 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:29.725+0000 7f9030d85700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f902c106770 0x7f902c108b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:34:31.185 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:29.725+0000 7f9030d85700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f902c074230 con 0x7f902c106770 2023-05-08T03:34:31.186 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:29.726+0000 7f902a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f902c106770 0x7f902c108b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:34:31.186 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:29.726+0000 7f902a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f902c106770 0x7f902c108b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39338/0 (socket says 172.21.15.96:39338) 2023-05-08T03:34:31.186 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:29.726+0000 7f902a59c700 1 -- 172.21.15.96:0/930984489 learned_addr learned my addr 172.21.15.96:0/930984489 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:34:31.186 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:29.726+0000 7f902a59c700 1 -- 172.21.15.96:0/930984489 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f902c074370 con 0x7f902c106770 2023-05-08T03:34:31.186 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:29.726+0000 7f902a59c700 1 --2- 172.21.15.96:0/930984489 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f902c106770 0x7f902c108b50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f901c0098a0 tx=0x7f901c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3692130e85faa8f7 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:34:31.186 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:29.726+0000 7f902959a700 1 -- 172.21.15.96:0/930984489 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f901c004160 con 0x7f902c106770 2023-05-08T03:34:31.186 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:29.726+0000 7f902959a700 1 -- 172.21.15.96:0/930984489 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f901c0042c0 con 0x7f902c106770 2023-05-08T03:34:31.187 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:29.726+0000 7f902959a700 1 -- 172.21.15.96:0/930984489 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f901c0119b0 con 0x7f902c106770 2023-05-08T03:34:31.187 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:29.727+0000 7f9030d85700 1 -- 172.21.15.96:0/930984489 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f902c106770 msgr2=0x7f902c108b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:34:31.187 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:29.727+0000 7f9030d85700 1 --2- 172.21.15.96:0/930984489 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f902c106770 0x7f902c108b50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f901c0098a0 tx=0x7f901c009bb0 comp rx=0 tx=0).stop 2023-05-08T03:34:31.187 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:29.727+0000 7f9030d85700 1 -- 172.21.15.96:0/930984489 shutdown_connections 2023-05-08T03:34:31.187 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:29.727+0000 7f9030d85700 1 --2- 172.21.15.96:0/930984489 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f902c106770 0x7f902c108b50 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:31.187 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:29.727+0000 7f9030d85700 1 -- 172.21.15.96:0/930984489 >> 172.21.15.96:0/930984489 conn(0x7f902c100170 msgr2=0x7f902c1025a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:34:31.187 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:29.727+0000 7f9030d85700 1 -- 172.21.15.96:0/930984489 shutdown_connections 2023-05-08T03:34:31.188 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:29.727+0000 7f9030d85700 1 -- 172.21.15.96:0/930984489 wait complete. 2023-05-08T03:34:31.188 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:29.728+0000 7f9030d85700 1 Processor -- start 2023-05-08T03:34:31.188 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:29.728+0000 7f9030d85700 1 -- start start 2023-05-08T03:34:31.188 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:29.728+0000 7f9030d85700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f902c106770 0x7f902c199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:34:31.188 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:29.728+0000 7f9030d85700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f902c199d80 con 0x7f902c106770 2023-05-08T03:34:31.188 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:29.728+0000 7f902a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f902c106770 0x7f902c199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:34:31.188 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:29.728+0000 7f902a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f902c106770 0x7f902c199840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39340/0 (socket says 172.21.15.96:39340) 2023-05-08T03:34:31.188 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:29.728+0000 7f902a59c700 1 -- 172.21.15.96:0/2653841910 learned_addr learned my addr 172.21.15.96:0/2653841910 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:34:31.189 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:29.729+0000 7f902a59c700 1 -- 172.21.15.96:0/2653841910 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f901c009550 con 0x7f902c106770 2023-05-08T03:34:31.189 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:29.729+0000 7f902a59c700 1 --2- 172.21.15.96:0/2653841910 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f902c106770 0x7f902c199840 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f901c003e60 tx=0x7f901c011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:34:31.189 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:29.729+0000 7f901b7fe700 1 -- 172.21.15.96:0/2653841910 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f901c003970 con 0x7f902c106770 2023-05-08T03:34:31.189 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:29.729+0000 7f901b7fe700 1 -- 172.21.15.96:0/2653841910 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f901c003ad0 con 0x7f902c106770 2023-05-08T03:34:31.189 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:29.729+0000 7f9030d85700 1 -- 172.21.15.96:0/2653841910 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f902c109ed0 con 0x7f902c106770 2023-05-08T03:34:31.189 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:29.729+0000 7f9030d85700 1 -- 172.21.15.96:0/2653841910 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f902c109d40 con 0x7f902c106770 2023-05-08T03:34:31.189 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:29.729+0000 7f901b7fe700 1 -- 172.21.15.96:0/2653841910 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f901c019590 con 0x7f902c106770 2023-05-08T03:34:31.190 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:29.730+0000 7f901b7fe700 1 -- 172.21.15.96:0/2653841910 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 8) v1 ==== 45483+0+0 (secure 0 0 0) 0x7f901c0198d0 con 0x7f902c106770 2023-05-08T03:34:31.190 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:29.730+0000 7f901b7fe700 1 --2- 172.21.15.96:0/2653841910 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7f9014038760 0x7f901403ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:34:31.190 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:29.730+0000 7f901b7fe700 1 -- 172.21.15.96:0/2653841910 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f901c04d7e0 con 0x7f902c106770 2023-05-08T03:34:31.190 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:29.730+0000 7f9029d9b700 1 --2- 172.21.15.96:0/2653841910 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7f9014038760 0x7f901403ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:34:31.190 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:29.730+0000 7f9030d85700 1 -- 172.21.15.96:0/2653841910 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f900c005320 con 0x7f902c106770 2023-05-08T03:34:31.190 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:29.731+0000 7f9029d9b700 1 --2- 172.21.15.96:0/2653841910 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7f9014038760 0x7f901403ac10 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9020006fd0 tx=0x7f9020006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:34:31.190 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:29.736+0000 7f901b7fe700 1 -- 172.21.15.96:0/2653841910 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f901c018db0 con 0x7f902c106770 2023-05-08T03:34:31.190 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:29.989+0000 7f9030d85700 1 -- 172.21.15.96:0/2653841910 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f900c0059f0 con 0x7f902c106770 2023-05-08T03:34:31.191 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:30.813+0000 7f901b7fe700 1 -- 172.21.15.96:0/2653841910 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mgrmap(e 9) v1 ==== 45496+0+0 (secure 0 0 0) 0x7f901c02d960 con 0x7f902c106770 2023-05-08T03:34:31.191 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:30.814+0000 7f901b7fe700 1 -- 172.21.15.96:0/2653841910 <== mon.0 v2:172.21.15.96:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7f901c018db0 con 0x7f902c106770 2023-05-08T03:34:31.191 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:30.817+0000 7f9030d85700 1 -- 172.21.15.96:0/2653841910 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7f9014038760 msgr2=0x7f901403ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:34:31.191 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:30.817+0000 7f9030d85700 1 --2- 172.21.15.96:0/2653841910 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7f9014038760 0x7f901403ac10 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9020006fd0 tx=0x7f9020006e40 comp rx=0 tx=0).stop 2023-05-08T03:34:31.191 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:30.817+0000 7f9030d85700 1 -- 172.21.15.96:0/2653841910 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f902c106770 msgr2=0x7f902c199840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:34:31.191 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:30.817+0000 7f9030d85700 1 --2- 172.21.15.96:0/2653841910 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f902c106770 0x7f902c199840 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f901c003e60 tx=0x7f901c011aa0 comp rx=0 tx=0).stop 2023-05-08T03:34:31.191 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:30.817+0000 7f9030d85700 1 -- 172.21.15.96:0/2653841910 shutdown_connections 2023-05-08T03:34:31.192 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:30.817+0000 7f9030d85700 1 --2- 172.21.15.96:0/2653841910 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7f9014038760 0x7f901403ac10 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:31.192 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:30.817+0000 7f9030d85700 1 --2- 172.21.15.96:0/2653841910 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f902c106770 0x7f902c199840 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:31.192 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:30.817+0000 7f9030d85700 1 -- 172.21.15.96:0/2653841910 >> 172.21.15.96:0/2653841910 conn(0x7f902c100170 msgr2=0x7f902c100f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:34:31.192 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:30.817+0000 7f9030d85700 1 -- 172.21.15.96:0/2653841910 shutdown_connections 2023-05-08T03:34:31.192 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:30.817+0000 7f9030d85700 1 -- 172.21.15.96:0/2653841910 wait complete. 2023-05-08T03:34:31.444 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:34:31 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:34:31.159+0000 7fbf03a5a200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-08T03:34:31.445 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:34:31 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:34:31.262+0000 7fbf03a5a200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-08T03:34:31.445 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:34:31 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:34:31.441+0000 7fbf03a5a200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-08T03:34:32.096 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:31 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/2653841910' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2023-05-08T03:34:32.096 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:31 smithi096 ceph-mon[124666]: mgrmap e9: x(active, since 16s) 2023-05-08T03:34:32.096 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:34:31 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:34:31.765+0000 7fbf03a5a200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-08T03:34:32.097 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:34:31 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:34:31.856+0000 7fbf03a5a200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-08T03:34:32.097 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:34:31 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:34:31.996+0000 7fbf03a5a200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-08T03:34:32.097 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:34:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:34:32.093+0000 7fbf03a5a200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-08T03:34:32.581 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout { 2023-05-08T03:34:32.581 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "epoch": 9, 2023-05-08T03:34:32.582 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "available": true, 2023-05-08T03:34:32.582 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "active_name": "x", 2023-05-08T03:34:32.582 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-05-08T03:34:32.582 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout } 2023-05-08T03:34:32.582 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:31.953+0000 7ff9dbbdc700 1 Processor -- start 2023-05-08T03:34:32.582 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:31.953+0000 7ff9dbbdc700 1 -- start start 2023-05-08T03:34:32.582 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:31.953+0000 7ff9dbbdc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9d4107240 0x7ff9d4107650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:34:32.583 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:31.953+0000 7ff9dbbdc700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d4107b90 con 0x7ff9d4107240 2023-05-08T03:34:32.583 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:31.953+0000 7ff9d9978700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9d4107240 0x7ff9d4107650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:34:32.583 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:31.953+0000 7ff9d9978700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9d4107240 0x7ff9d4107650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39354/0 (socket says 172.21.15.96:39354) 2023-05-08T03:34:32.583 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:31.953+0000 7ff9d9978700 1 -- 172.21.15.96:0/4250773191 learned_addr learned my addr 172.21.15.96:0/4250773191 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:34:32.583 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:31.954+0000 7ff9d9978700 1 -- 172.21.15.96:0/4250773191 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9d4107cd0 con 0x7ff9d4107240 2023-05-08T03:34:32.583 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:31.954+0000 7ff9d9978700 1 --2- 172.21.15.96:0/4250773191 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9d4107240 0x7ff9d4107650 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff9d00098a0 tx=0x7ff9d0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a7080d356722678 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:34:32.583 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:31.954+0000 7ff9d8976700 1 -- 172.21.15.96:0/4250773191 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff9d0004160 con 0x7ff9d4107240 2023-05-08T03:34:32.584 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:31.954+0000 7ff9d8976700 1 -- 172.21.15.96:0/4250773191 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff9d00042c0 con 0x7ff9d4107240 2023-05-08T03:34:32.584 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:31.954+0000 7ff9d8976700 1 -- 172.21.15.96:0/4250773191 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff9d00119b0 con 0x7ff9d4107240 2023-05-08T03:34:32.584 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:31.955+0000 7ff9dbbdc700 1 -- 172.21.15.96:0/4250773191 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9d4107240 msgr2=0x7ff9d4107650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:34:32.584 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:31.955+0000 7ff9dbbdc700 1 --2- 172.21.15.96:0/4250773191 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9d4107240 0x7ff9d4107650 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff9d00098a0 tx=0x7ff9d0009bb0 comp rx=0 tx=0).stop 2023-05-08T03:34:32.584 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:31.955+0000 7ff9dbbdc700 1 -- 172.21.15.96:0/4250773191 shutdown_connections 2023-05-08T03:34:32.584 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:31.955+0000 7ff9dbbdc700 1 --2- 172.21.15.96:0/4250773191 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9d4107240 0x7ff9d4107650 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:32.584 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:31.955+0000 7ff9dbbdc700 1 -- 172.21.15.96:0/4250773191 >> 172.21.15.96:0/4250773191 conn(0x7ff9d40ff930 msgr2=0x7ff9d4101d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:34:32.585 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:31.955+0000 7ff9dbbdc700 1 -- 172.21.15.96:0/4250773191 shutdown_connections 2023-05-08T03:34:32.585 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:31.955+0000 7ff9dbbdc700 1 -- 172.21.15.96:0/4250773191 wait complete. 2023-05-08T03:34:32.585 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:31.956+0000 7ff9dbbdc700 1 Processor -- start 2023-05-08T03:34:32.585 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:31.956+0000 7ff9dbbdc700 1 -- start start 2023-05-08T03:34:32.585 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:31.956+0000 7ff9dbbdc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9d4107240 0x7ff9d4199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:34:32.586 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:31.956+0000 7ff9dbbdc700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d4199dc0 con 0x7ff9d4107240 2023-05-08T03:34:32.586 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:31.956+0000 7ff9d9978700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9d4107240 0x7ff9d4199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:34:32.586 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:31.956+0000 7ff9d9978700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9d4107240 0x7ff9d4199880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39356/0 (socket says 172.21.15.96:39356) 2023-05-08T03:34:32.586 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:31.956+0000 7ff9d9978700 1 -- 172.21.15.96:0/589113314 learned_addr learned my addr 172.21.15.96:0/589113314 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:34:32.586 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:31.956+0000 7ff9d9978700 1 -- 172.21.15.96:0/589113314 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9d0009550 con 0x7ff9d4107240 2023-05-08T03:34:32.586 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:31.956+0000 7ff9d9978700 1 --2- 172.21.15.96:0/589113314 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9d4107240 0x7ff9d4199880 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff9d0011980 tx=0x7ff9d0011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:34:32.587 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:31.957+0000 7ff9caffd700 1 -- 172.21.15.96:0/589113314 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff9d0003a60 con 0x7ff9d4107240 2023-05-08T03:34:32.587 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:31.957+0000 7ff9caffd700 1 -- 172.21.15.96:0/589113314 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff9d0003bc0 con 0x7ff9d4107240 2023-05-08T03:34:32.587 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:31.957+0000 7ff9dbbdc700 1 -- 172.21.15.96:0/589113314 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9d41049f0 con 0x7ff9d4107240 2023-05-08T03:34:32.587 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:31.957+0000 7ff9caffd700 1 -- 172.21.15.96:0/589113314 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff9d001a670 con 0x7ff9d4107240 2023-05-08T03:34:32.587 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:31.957+0000 7ff9dbbdc700 1 -- 172.21.15.96:0/589113314 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9d4104860 con 0x7ff9d4107240 2023-05-08T03:34:32.587 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:31.958+0000 7ff9dbbdc700 1 -- 172.21.15.96:0/589113314 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9d410a210 con 0x7ff9d4107240 2023-05-08T03:34:32.587 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:31.958+0000 7ff9caffd700 1 -- 172.21.15.96:0/589113314 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 9) v1 ==== 45496+0+0 (secure 0 0 0) 0x7ff9d0024a00 con 0x7ff9d4107240 2023-05-08T03:34:32.587 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:31.958+0000 7ff9caffd700 1 --2- 172.21.15.96:0/589113314 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7ff9c0038820 0x7ff9c003acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:34:32.588 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:31.958+0000 7ff9caffd700 1 -- 172.21.15.96:0/589113314 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7ff9d004c8b0 con 0x7ff9d4107240 2023-05-08T03:34:32.588 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:31.958+0000 7ff9d9177700 1 -- 172.21.15.96:0/589113314 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7ff9c0038820 msgr2=0x7ff9c003acd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:6800/1979917756 2023-05-08T03:34:32.588 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:31.958+0000 7ff9d9177700 1 --2- 172.21.15.96:0/589113314 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7ff9c0038820 0x7ff9c003acd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-05-08T03:34:32.588 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:31.963+0000 7ff9caffd700 1 -- 172.21.15.96:0/589113314 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7ff9d0024440 con 0x7ff9d4107240 2023-05-08T03:34:32.588 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:32.159+0000 7ff9d9177700 1 -- 172.21.15.96:0/589113314 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7ff9c0038820 msgr2=0x7ff9c003acd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:6800/1979917756 2023-05-08T03:34:32.588 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:32.159+0000 7ff9d9177700 1 --2- 172.21.15.96:0/589113314 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7ff9c0038820 0x7ff9c003acd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-05-08T03:34:32.588 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:32.209+0000 7ff9dbbdc700 1 -- 172.21.15.96:0/589113314 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7ff9d419d490 con 0x7ff9d4107240 2023-05-08T03:34:32.589 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:32.210+0000 7ff9caffd700 1 -- 172.21.15.96:0/589113314 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+88 (secure 0 0 0) 0x7ff9d0018350 con 0x7ff9d4107240 2023-05-08T03:34:32.589 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:32.213+0000 7ff9dbbdc700 1 -- 172.21.15.96:0/589113314 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7ff9c0038820 msgr2=0x7ff9c003acd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-08T03:34:32.589 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:32.213+0000 7ff9dbbdc700 1 --2- 172.21.15.96:0/589113314 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7ff9c0038820 0x7ff9c003acd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:32.589 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:32.213+0000 7ff9dbbdc700 1 -- 172.21.15.96:0/589113314 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9d4107240 msgr2=0x7ff9d4199880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:34:32.589 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:32.213+0000 7ff9dbbdc700 1 --2- 172.21.15.96:0/589113314 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9d4107240 0x7ff9d4199880 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff9d0011980 tx=0x7ff9d0011a60 comp rx=0 tx=0).stop 2023-05-08T03:34:32.589 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:32.213+0000 7ff9dbbdc700 1 -- 172.21.15.96:0/589113314 shutdown_connections 2023-05-08T03:34:32.589 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:32.213+0000 7ff9dbbdc700 1 --2- 172.21.15.96:0/589113314 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7ff9c0038820 0x7ff9c003acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:32.589 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:32.213+0000 7ff9dbbdc700 1 --2- 172.21.15.96:0/589113314 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9d4107240 0x7ff9d4199880 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:32.590 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:32.213+0000 7ff9dbbdc700 1 -- 172.21.15.96:0/589113314 >> 172.21.15.96:0/589113314 conn(0x7ff9d40ff930 msgr2=0x7ff9d41005c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:34:32.590 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:32.213+0000 7ff9dbbdc700 1 -- 172.21.15.96:0/589113314 shutdown_connections 2023-05-08T03:34:32.590 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:32.213+0000 7ff9dbbdc700 1 -- 172.21.15.96:0/589113314 wait complete. 2023-05-08T03:34:32.590 INFO:teuthology.orchestra.run.smithi096.stdout:Waiting for the mgr to restart... 2023-05-08T03:34:32.590 INFO:teuthology.orchestra.run.smithi096.stdout:Waiting for mgr epoch 9... 2023-05-08T03:34:32.755 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:34:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:34:32.535+0000 7fbf03a5a200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-08T03:34:33.126 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:32 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/589113314' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-05-08T03:34:33.505 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:34:33 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:34:33.124+0000 7fbf03a5a200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-08T03:34:33.505 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:34:33 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:34:33.295+0000 7fbf03a5a200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-08T03:34:34.312 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:34:34 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:34:34.048+0000 7fbf03a5a200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-08T03:34:34.313 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:34:34 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:34:34.139+0000 7fbf03a5a200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-05-08T03:34:34.962 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:34:34 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:34:34.310+0000 7fbf03a5a200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-08T03:34:34.962 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:34:34 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:34:34.588+0000 7fbf03a5a200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-05-08T03:34:34.962 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:34:34 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:34:34.812+0000 7fbf03a5a200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-08T03:34:34.963 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:34:34 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:34:34.959+0000 7fbf03a5a200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-08T03:34:35.505 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:34:35 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:34:35.225+0000 7fbf03a5a200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-08T03:34:36.249 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:34:35 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:34:35.922+0000 7fbf03a5a200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-08T03:34:36.249 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:34:36 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:34:36.053+0000 7fbf03a5a200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-08T03:34:36.505 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:34:36 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:34:36.247+0000 7fbf03a5a200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-08T03:34:36.505 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:34:36 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:34:36.360+0000 7fbf03a5a200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-08T03:34:37.005 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:34:36 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:34:36.576+0000 7fbf03a5a200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-08T03:34:37.755 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:34:37 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:34:37.458+0000 7fbf03a5a200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-08T03:34:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:38 smithi096 ceph-mon[124666]: Active manager daemon x restarted 2023-05-08T03:34:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:38 smithi096 ceph-mon[124666]: Activating manager daemon x 2023-05-08T03:34:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:38 smithi096 ceph-mon[124666]: osdmap e3: 0 total, 0 up, 0 in 2023-05-08T03:34:38.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:38 smithi096 ceph-mon[124666]: mgrmap e10: x(active, starting, since 0.00368132s) 2023-05-08T03:34:38.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:38 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-05-08T03:34:38.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:38 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-05-08T03:34:38.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:38 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-05-08T03:34:38.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:38 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-05-08T03:34:38.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:38 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-05-08T03:34:38.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:38 smithi096 ceph-mon[124666]: Manager daemon x is now available 2023-05-08T03:34:38.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:38 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:34:38.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:38 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:34:38.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:38 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-05-08T03:34:38.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:38 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-05-08T03:34:39.040 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout { 2023-05-08T03:34:39.040 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2023-05-08T03:34:39.040 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "initialized": true 2023-05-08T03:34:39.040 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout } 2023-05-08T03:34:39.040 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:33.137+0000 7f7e24a14700 1 Processor -- start 2023-05-08T03:34:39.041 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:33.137+0000 7f7e24a14700 1 -- start start 2023-05-08T03:34:39.041 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:33.138+0000 7f7e24a14700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e20105c20 0x7f7e20106030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:34:39.041 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:33.138+0000 7f7e24a14700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e20106570 con 0x7f7e20105c20 2023-05-08T03:34:39.041 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:33.138+0000 7f7e1e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e20105c20 0x7f7e20106030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:34:39.041 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:33.138+0000 7f7e1e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e20105c20 0x7f7e20106030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39364/0 (socket says 172.21.15.96:39364) 2023-05-08T03:34:39.041 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:33.138+0000 7f7e1e59c700 1 -- 172.21.15.96:0/1765145617 learned_addr learned my addr 172.21.15.96:0/1765145617 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:34:39.041 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:33.138+0000 7f7e1e59c700 1 -- 172.21.15.96:0/1765145617 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e201066b0 con 0x7f7e20105c20 2023-05-08T03:34:39.041 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:33.138+0000 7f7e1e59c700 1 --2- 172.21.15.96:0/1765145617 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e20105c20 0x7f7e20106030 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7e140098a0 tx=0x7f7e14009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1800217181271994 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:34:39.042 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:33.139+0000 7f7e1d59a700 1 -- 172.21.15.96:0/1765145617 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7e14004160 con 0x7f7e20105c20 2023-05-08T03:34:39.042 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:33.139+0000 7f7e1d59a700 1 -- 172.21.15.96:0/1765145617 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7e140042c0 con 0x7f7e20105c20 2023-05-08T03:34:39.042 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:33.139+0000 7f7e1d59a700 1 -- 172.21.15.96:0/1765145617 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7e140119b0 con 0x7f7e20105c20 2023-05-08T03:34:39.042 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:33.139+0000 7f7e24a14700 1 -- 172.21.15.96:0/1765145617 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e20105c20 msgr2=0x7f7e20106030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:34:39.042 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:33.139+0000 7f7e24a14700 1 --2- 172.21.15.96:0/1765145617 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e20105c20 0x7f7e20106030 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7e140098a0 tx=0x7f7e14009bb0 comp rx=0 tx=0).stop 2023-05-08T03:34:39.042 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:33.139+0000 7f7e24a14700 1 -- 172.21.15.96:0/1765145617 shutdown_connections 2023-05-08T03:34:39.042 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:33.139+0000 7f7e24a14700 1 --2- 172.21.15.96:0/1765145617 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e20105c20 0x7f7e20106030 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:39.043 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:33.139+0000 7f7e24a14700 1 -- 172.21.15.96:0/1765145617 >> 172.21.15.96:0/1765145617 conn(0x7f7e201012b0 msgr2=0x7f7e201036c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:34:39.043 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:33.139+0000 7f7e24a14700 1 -- 172.21.15.96:0/1765145617 shutdown_connections 2023-05-08T03:34:39.043 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:33.139+0000 7f7e24a14700 1 -- 172.21.15.96:0/1765145617 wait complete. 2023-05-08T03:34:39.043 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:33.140+0000 7f7e24a14700 1 Processor -- start 2023-05-08T03:34:39.043 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:33.140+0000 7f7e24a14700 1 -- start start 2023-05-08T03:34:39.043 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:33.140+0000 7f7e24a14700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e20105c20 0x7f7e2007ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:34:39.043 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:33.140+0000 7f7e24a14700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2007b080 con 0x7f7e20105c20 2023-05-08T03:34:39.043 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:33.140+0000 7f7e1e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e20105c20 0x7f7e2007ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:34:39.044 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:33.141+0000 7f7e1e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e20105c20 0x7f7e2007ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39366/0 (socket says 172.21.15.96:39366) 2023-05-08T03:34:39.044 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:33.141+0000 7f7e1e59c700 1 -- 172.21.15.96:0/259424159 learned_addr learned my addr 172.21.15.96:0/259424159 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:34:39.044 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:33.141+0000 7f7e1e59c700 1 -- 172.21.15.96:0/259424159 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e14009550 con 0x7f7e20105c20 2023-05-08T03:34:39.044 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:33.141+0000 7f7e1e59c700 1 --2- 172.21.15.96:0/259424159 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e20105c20 0x7f7e2007ab40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7e14011980 tx=0x7f7e14011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:34:39.044 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:33.141+0000 7f7e0f7fe700 1 -- 172.21.15.96:0/259424159 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7e14003a60 con 0x7f7e20105c20 2023-05-08T03:34:39.044 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:33.141+0000 7f7e24a14700 1 -- 172.21.15.96:0/259424159 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e20107cb0 con 0x7f7e20105c20 2023-05-08T03:34:39.044 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:33.141+0000 7f7e0f7fe700 1 -- 172.21.15.96:0/259424159 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7e14003bc0 con 0x7f7e20105c20 2023-05-08T03:34:39.045 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:33.141+0000 7f7e0f7fe700 1 -- 172.21.15.96:0/259424159 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7e1401a670 con 0x7f7e20105c20 2023-05-08T03:34:39.045 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:33.141+0000 7f7e24a14700 1 -- 172.21.15.96:0/259424159 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e20107b20 con 0x7f7e20105c20 2023-05-08T03:34:39.045 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:33.142+0000 7f7e0f7fe700 1 -- 172.21.15.96:0/259424159 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 9) v1 ==== 45496+0+0 (secure 0 0 0) 0x7f7e1401a930 con 0x7f7e20105c20 2023-05-08T03:34:39.045 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:33.142+0000 7f7e0f7fe700 1 --2- 172.21.15.96:0/259424159 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7f7e08038820 0x7f7e0803acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:34:39.045 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:33.142+0000 7f7e0f7fe700 1 -- 172.21.15.96:0/259424159 --> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7e0803b3e0 con 0x7f7e08038820 2023-05-08T03:34:39.045 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:33.142+0000 7f7e0f7fe700 1 -- 172.21.15.96:0/259424159 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f7e1404c820 con 0x7f7e20105c20 2023-05-08T03:34:39.045 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:33.142+0000 7f7e1dd9b700 1 -- 172.21.15.96:0/259424159 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7f7e08038820 msgr2=0x7f7e0803acd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:6800/1979917756 2023-05-08T03:34:39.046 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:33.142+0000 7f7e1dd9b700 1 --2- 172.21.15.96:0/259424159 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7f7e08038820 0x7f7e0803acd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-05-08T03:34:39.046 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:33.343+0000 7f7e1dd9b700 1 -- 172.21.15.96:0/259424159 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7f7e08038820 msgr2=0x7f7e0803acd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:6800/1979917756 2023-05-08T03:34:39.046 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:33.343+0000 7f7e1dd9b700 1 --2- 172.21.15.96:0/259424159 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7f7e08038820 0x7f7e0803acd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-05-08T03:34:39.046 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:33.744+0000 7f7e1dd9b700 1 -- 172.21.15.96:0/259424159 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7f7e08038820 msgr2=0x7f7e0803acd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:6800/1979917756 2023-05-08T03:34:39.046 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:33.744+0000 7f7e1dd9b700 1 --2- 172.21.15.96:0/259424159 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7f7e08038820 0x7f7e0803acd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-05-08T03:34:39.046 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:34.545+0000 7f7e1dd9b700 1 -- 172.21.15.96:0/259424159 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7f7e08038820 msgr2=0x7f7e0803acd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:6800/1979917756 2023-05-08T03:34:39.046 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:34.545+0000 7f7e1dd9b700 1 --2- 172.21.15.96:0/259424159 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7f7e08038820 0x7f7e0803acd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-05-08T03:34:39.046 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:36.146+0000 7f7e1dd9b700 1 -- 172.21.15.96:0/259424159 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7f7e08038820 msgr2=0x7f7e0803acd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:6800/1979917756 2023-05-08T03:34:39.047 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:36.146+0000 7f7e1dd9b700 1 --2- 172.21.15.96:0/259424159 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7f7e08038820 0x7f7e0803acd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-05-08T03:34:39.047 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:37.473+0000 7f7e0f7fe700 1 -- 172.21.15.96:0/259424159 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mgrmap(e 10) v1 ==== 45263+0+0 (secure 0 0 0) 0x7f7e1402d960 con 0x7f7e20105c20 2023-05-08T03:34:39.047 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:37.473+0000 7f7e0f7fe700 1 -- 172.21.15.96:0/259424159 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7f7e08038820 msgr2=0x7f7e0803acd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-08T03:34:39.047 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:37.473+0000 7f7e0f7fe700 1 --2- 172.21.15.96:0/259424159 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7f7e08038820 0x7f7e0803acd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:39.047 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:38.475+0000 7f7e0f7fe700 1 -- 172.21.15.96:0/259424159 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mgrmap(e 11) v1 ==== 45390+0+0 (secure 0 0 0) 0x7f7e1404e490 con 0x7f7e20105c20 2023-05-08T03:34:39.047 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:38.476+0000 7f7e0f7fe700 1 --2- 172.21.15.96:0/259424159 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f7e0803c150 0x7f7e0803e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:34:39.047 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:38.476+0000 7f7e0f7fe700 1 -- 172.21.15.96:0/259424159 --> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7e0803b3e0 con 0x7f7e0803c150 2023-05-08T03:34:39.047 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:38.476+0000 7f7e1dd9b700 1 --2- 172.21.15.96:0/259424159 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f7e0803c150 0x7f7e0803e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:34:39.048 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:38.477+0000 7f7e1dd9b700 1 --2- 172.21.15.96:0/259424159 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f7e0803c150 0x7f7e0803e530 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f7e10003a10 tx=0x7f7e100092b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:34:39.048 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:38.477+0000 7f7e0f7fe700 1 -- 172.21.15.96:0/259424159 <== mgr.14152 v2:172.21.15.96:6800/2748629182 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7f7e0803b3e0 con 0x7f7e0803c150 2023-05-08T03:34:39.048 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:38.484+0000 7f7e24a14700 1 -- 172.21.15.96:0/259424159 --> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f7e2007a6e0 con 0x7f7e0803c150 2023-05-08T03:34:39.048 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:38.484+0000 7f7e0f7fe700 1 -- 172.21.15.96:0/259424159 <== mgr.14152 v2:172.21.15.96:6800/2748629182 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f7e2007a6e0 con 0x7f7e0803c150 2023-05-08T03:34:39.048 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:38.485+0000 7f7e24a14700 1 -- 172.21.15.96:0/259424159 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f7e0803c150 msgr2=0x7f7e0803e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:34:39.048 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:38.485+0000 7f7e24a14700 1 --2- 172.21.15.96:0/259424159 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f7e0803c150 0x7f7e0803e530 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f7e10003a10 tx=0x7f7e100092b0 comp rx=0 tx=0).stop 2023-05-08T03:34:39.048 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:38.485+0000 7f7e24a14700 1 -- 172.21.15.96:0/259424159 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e20105c20 msgr2=0x7f7e2007ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:34:39.049 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:38.485+0000 7f7e24a14700 1 --2- 172.21.15.96:0/259424159 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e20105c20 0x7f7e2007ab40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7e14011980 tx=0x7f7e14011a60 comp rx=0 tx=0).stop 2023-05-08T03:34:39.049 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:38.485+0000 7f7e24a14700 1 -- 172.21.15.96:0/259424159 shutdown_connections 2023-05-08T03:34:39.049 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:38.485+0000 7f7e24a14700 1 --2- 172.21.15.96:0/259424159 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f7e0803c150 0x7f7e0803e530 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:39.049 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:38.485+0000 7f7e24a14700 1 --2- 172.21.15.96:0/259424159 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e20105c20 0x7f7e2007ab40 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:39.049 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:38.485+0000 7f7e24a14700 1 --2- 172.21.15.96:0/259424159 >> [v2:172.21.15.96:6800/1979917756,v1:172.21.15.96:6801/1979917756] conn(0x7f7e08038820 0x7f7e0803acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:39.049 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:38.485+0000 7f7e24a14700 1 -- 172.21.15.96:0/259424159 >> 172.21.15.96:0/259424159 conn(0x7f7e201012b0 msgr2=0x7f7e20101f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:34:39.049 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:38.485+0000 7f7e24a14700 1 -- 172.21.15.96:0/259424159 shutdown_connections 2023-05-08T03:34:39.049 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:38.485+0000 7f7e24a14700 1 -- 172.21.15.96:0/259424159 wait complete. 2023-05-08T03:34:39.050 INFO:teuthology.orchestra.run.smithi096.stdout:mgr epoch 9 is available 2023-05-08T03:34:39.050 INFO:teuthology.orchestra.run.smithi096.stdout:Generating a dashboard self-signed certificate... 2023-05-08T03:34:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:39 smithi096 ceph-mon[124666]: [08/May/2023:03:34:37] ENGINE Bus STARTING 2023-05-08T03:34:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:39 smithi096 ceph-mon[124666]: [08/May/2023:03:34:37] ENGINE Serving on http://172.21.15.96:8765 2023-05-08T03:34:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:39 smithi096 ceph-mon[124666]: [08/May/2023:03:34:38] ENGINE Serving on https://172.21.15.96:7150 2023-05-08T03:34:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:39 smithi096 ceph-mon[124666]: [08/May/2023:03:34:38] ENGINE Bus STARTED 2023-05-08T03:34:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:39 smithi096 ceph-mon[124666]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-05-08T03:34:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:39 smithi096 ceph-mon[124666]: mgrmap e11: x(active, since 1.00721s) 2023-05-08T03:34:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:39 smithi096 ceph-mon[124666]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-05-08T03:34:40.385 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2023-05-08T03:34:40.385 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:39.616+0000 7fd60df33700 1 Processor -- start 2023-05-08T03:34:40.386 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:39.616+0000 7fd60df33700 1 -- start start 2023-05-08T03:34:40.386 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:39.616+0000 7fd60df33700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd608104b20 0x7fd608104f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:34:40.386 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:39.616+0000 7fd60df33700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd608105470 con 0x7fd608104b20 2023-05-08T03:34:40.386 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:39.616+0000 7fd6077fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd608104b20 0x7fd608104f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:34:40.386 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:39.616+0000 7fd6077fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd608104b20 0x7fd608104f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39420/0 (socket says 172.21.15.96:39420) 2023-05-08T03:34:40.386 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:39.616+0000 7fd6077fe700 1 -- 172.21.15.96:0/3782079584 learned_addr learned my addr 172.21.15.96:0/3782079584 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:34:40.386 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:39.617+0000 7fd6077fe700 1 -- 172.21.15.96:0/3782079584 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6081055b0 con 0x7fd608104b20 2023-05-08T03:34:40.387 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:39.617+0000 7fd6077fe700 1 --2- 172.21.15.96:0/3782079584 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd608104b20 0x7fd608104f30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd5f80098a0 tx=0x7fd5f8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9766da25655e22f server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:34:40.387 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:39.617+0000 7fd6067fc700 1 -- 172.21.15.96:0/3782079584 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd5f8004160 con 0x7fd608104b20 2023-05-08T03:34:40.387 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:39.617+0000 7fd6067fc700 1 -- 172.21.15.96:0/3782079584 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd5f80042c0 con 0x7fd608104b20 2023-05-08T03:34:40.387 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:39.617+0000 7fd6067fc700 1 -- 172.21.15.96:0/3782079584 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd5f80119b0 con 0x7fd608104b20 2023-05-08T03:34:40.387 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:39.617+0000 7fd60df33700 1 -- 172.21.15.96:0/3782079584 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd608104b20 msgr2=0x7fd608104f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:34:40.387 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:39.617+0000 7fd60df33700 1 --2- 172.21.15.96:0/3782079584 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd608104b20 0x7fd608104f30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd5f80098a0 tx=0x7fd5f8009bb0 comp rx=0 tx=0).stop 2023-05-08T03:34:40.387 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:39.618+0000 7fd60df33700 1 -- 172.21.15.96:0/3782079584 shutdown_connections 2023-05-08T03:34:40.387 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:39.618+0000 7fd60df33700 1 --2- 172.21.15.96:0/3782079584 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd608104b20 0x7fd608104f30 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:40.388 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:39.618+0000 7fd60df33700 1 -- 172.21.15.96:0/3782079584 >> 172.21.15.96:0/3782079584 conn(0x7fd608100170 msgr2=0x7fd6081025a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:34:40.388 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:39.618+0000 7fd60df33700 1 -- 172.21.15.96:0/3782079584 shutdown_connections 2023-05-08T03:34:40.388 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:39.618+0000 7fd60df33700 1 -- 172.21.15.96:0/3782079584 wait complete. 2023-05-08T03:34:40.388 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:39.618+0000 7fd60df33700 1 Processor -- start 2023-05-08T03:34:40.388 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:39.618+0000 7fd60df33700 1 -- start start 2023-05-08T03:34:40.388 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:39.619+0000 7fd60df33700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd608104b20 0x7fd608198790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:34:40.388 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:39.619+0000 7fd60df33700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd608198cd0 con 0x7fd608104b20 2023-05-08T03:34:40.389 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:39.619+0000 7fd6077fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd608104b20 0x7fd608198790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:34:40.389 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:39.619+0000 7fd6077fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd608104b20 0x7fd608198790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39422/0 (socket says 172.21.15.96:39422) 2023-05-08T03:34:40.389 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:39.619+0000 7fd6077fe700 1 -- 172.21.15.96:0/743759456 learned_addr learned my addr 172.21.15.96:0/743759456 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:34:40.389 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:39.619+0000 7fd6077fe700 1 -- 172.21.15.96:0/743759456 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5f8009550 con 0x7fd608104b20 2023-05-08T03:34:40.389 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:39.619+0000 7fd6077fe700 1 --2- 172.21.15.96:0/743759456 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd608104b20 0x7fd608198790 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd5f8003e60 tx=0x7fd5f8011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:34:40.389 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:39.619+0000 7fd604ff9700 1 -- 172.21.15.96:0/743759456 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd5f8003970 con 0x7fd608104b20 2023-05-08T03:34:40.389 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:39.619+0000 7fd604ff9700 1 -- 172.21.15.96:0/743759456 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd5f8003ad0 con 0x7fd608104b20 2023-05-08T03:34:40.389 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:39.619+0000 7fd604ff9700 1 -- 172.21.15.96:0/743759456 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd5f80195e0 con 0x7fd608104b20 2023-05-08T03:34:40.390 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:39.619+0000 7fd60df33700 1 -- 172.21.15.96:0/743759456 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd608106bb0 con 0x7fd608104b20 2023-05-08T03:34:40.390 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:39.619+0000 7fd60df33700 1 -- 172.21.15.96:0/743759456 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd608106a20 con 0x7fd608104b20 2023-05-08T03:34:40.390 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:39.620+0000 7fd604ff9700 1 -- 172.21.15.96:0/743759456 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 11) v1 ==== 45390+0+0 (secure 0 0 0) 0x7fd5f80198a0 con 0x7fd608104b20 2023-05-08T03:34:40.390 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:39.621+0000 7fd604ff9700 1 --2- 172.21.15.96:0/743759456 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fd5f00386b0 0x7fd5f003ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:34:40.390 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:39.621+0000 7fd604ff9700 1 -- 172.21.15.96:0/743759456 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fd5f804c800 con 0x7fd608104b20 2023-05-08T03:34:40.390 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:39.621+0000 7fd606ffd700 1 --2- 172.21.15.96:0/743759456 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fd5f00386b0 0x7fd5f003ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:34:40.390 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:39.621+0000 7fd60df33700 1 -- 172.21.15.96:0/743759456 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd608108ff0 con 0x7fd608104b20 2023-05-08T03:34:40.391 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:39.621+0000 7fd606ffd700 1 --2- 172.21.15.96:0/743759456 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fd5f00386b0 0x7fd5f003ab60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc006fd0 tx=0x7fd5fc006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:34:40.391 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:39.630+0000 7fd604ff9700 1 -- 172.21.15.96:0/743759456 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fd5f802b340 con 0x7fd608104b20 2023-05-08T03:34:40.391 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:39.829+0000 7fd60df33700 1 -- 172.21.15.96:0/743759456 --> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7fd6081015b0 con 0x7fd5f00386b0 2023-05-08T03:34:40.391 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:39.864+0000 7fd604ff9700 1 -- 172.21.15.96:0/743759456 <== mgr.14152 v2:172.21.15.96:6800/2748629182 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7fd6081015b0 con 0x7fd5f00386b0 2023-05-08T03:34:40.391 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:39.866+0000 7fd60df33700 1 -- 172.21.15.96:0/743759456 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fd5f00386b0 msgr2=0x7fd5f003ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:34:40.391 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:39.866+0000 7fd60df33700 1 --2- 172.21.15.96:0/743759456 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fd5f00386b0 0x7fd5f003ab60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc006fd0 tx=0x7fd5fc006e40 comp rx=0 tx=0).stop 2023-05-08T03:34:40.391 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:39.866+0000 7fd60df33700 1 -- 172.21.15.96:0/743759456 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd608104b20 msgr2=0x7fd608198790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:34:40.392 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:39.866+0000 7fd60df33700 1 --2- 172.21.15.96:0/743759456 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd608104b20 0x7fd608198790 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd5f8003e60 tx=0x7fd5f8011aa0 comp rx=0 tx=0).stop 2023-05-08T03:34:40.392 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:39.866+0000 7fd60df33700 1 -- 172.21.15.96:0/743759456 shutdown_connections 2023-05-08T03:34:40.392 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:39.866+0000 7fd60df33700 1 --2- 172.21.15.96:0/743759456 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fd5f00386b0 0x7fd5f003ab60 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:40.392 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:39.866+0000 7fd60df33700 1 --2- 172.21.15.96:0/743759456 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd608104b20 0x7fd608198790 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:40.392 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:39.866+0000 7fd60df33700 1 -- 172.21.15.96:0/743759456 >> 172.21.15.96:0/743759456 conn(0x7fd608100170 msgr2=0x7fd608100ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:34:40.392 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:39.866+0000 7fd60df33700 1 -- 172.21.15.96:0/743759456 shutdown_connections 2023-05-08T03:34:40.392 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:39.866+0000 7fd60df33700 1 -- 172.21.15.96:0/743759456 wait complete. 2023-05-08T03:34:40.392 INFO:teuthology.orchestra.run.smithi096.stdout:Creating initial admin user... 2023-05-08T03:34:40.589 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:40 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:34:40.589 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:40 smithi096 ceph-mon[124666]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:34:40.589 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:40 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:34:40.589 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:40 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:34:40.589 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:40 smithi096 ceph-mon[124666]: mgrmap e12: x(active, since 3s) 2023-05-08T03:34:41.634 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:41 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:34:41.634 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:41 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:34:41.933 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$4QQ75BT9FQfvpD9WNCzBLOhmYLXnx6FymWrKmx8qPpfGplTYzQ5dG", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1683516881, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2023-05-08T03:34:41.933 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:40.888+0000 7f928eee2700 1 Processor -- start 2023-05-08T03:34:41.933 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:40.888+0000 7f928eee2700 1 -- start start 2023-05-08T03:34:41.933 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:40.889+0000 7f928eee2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9288105c20 0x7f9288106030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:34:41.934 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:40.889+0000 7f928eee2700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9288106570 con 0x7f9288105c20 2023-05-08T03:34:41.934 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:40.889+0000 7f928cc7e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9288105c20 0x7f9288106030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:34:41.934 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:40.889+0000 7f928cc7e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9288105c20 0x7f9288106030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39426/0 (socket says 172.21.15.96:39426) 2023-05-08T03:34:41.934 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:40.889+0000 7f928cc7e700 1 -- 172.21.15.96:0/2678262168 learned_addr learned my addr 172.21.15.96:0/2678262168 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:34:41.934 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:40.889+0000 7f928cc7e700 1 -- 172.21.15.96:0/2678262168 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92881066b0 con 0x7f9288105c20 2023-05-08T03:34:41.934 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:40.889+0000 7f928cc7e700 1 --2- 172.21.15.96:0/2678262168 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9288105c20 0x7f9288106030 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f927c0098a0 tx=0x7f927c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=918c0ae4bc10747 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:34:41.934 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:40.889+0000 7f92877fe700 1 -- 172.21.15.96:0/2678262168 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f927c004160 con 0x7f9288105c20 2023-05-08T03:34:41.935 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:40.889+0000 7f92877fe700 1 -- 172.21.15.96:0/2678262168 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f927c0042c0 con 0x7f9288105c20 2023-05-08T03:34:41.935 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:40.889+0000 7f92877fe700 1 -- 172.21.15.96:0/2678262168 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f927c0119b0 con 0x7f9288105c20 2023-05-08T03:34:41.935 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:40.890+0000 7f928eee2700 1 -- 172.21.15.96:0/2678262168 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9288105c20 msgr2=0x7f9288106030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:34:41.935 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:40.890+0000 7f928eee2700 1 --2- 172.21.15.96:0/2678262168 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9288105c20 0x7f9288106030 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f927c0098a0 tx=0x7f927c009bb0 comp rx=0 tx=0).stop 2023-05-08T03:34:41.935 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:40.890+0000 7f928eee2700 1 -- 172.21.15.96:0/2678262168 shutdown_connections 2023-05-08T03:34:41.935 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:40.890+0000 7f928eee2700 1 --2- 172.21.15.96:0/2678262168 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9288105c20 0x7f9288106030 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:41.935 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:40.890+0000 7f928eee2700 1 -- 172.21.15.96:0/2678262168 >> 172.21.15.96:0/2678262168 conn(0x7f92881012b0 msgr2=0x7f92881036c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:34:41.935 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:40.890+0000 7f928eee2700 1 -- 172.21.15.96:0/2678262168 shutdown_connections 2023-05-08T03:34:41.936 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:40.890+0000 7f928eee2700 1 -- 172.21.15.96:0/2678262168 wait complete. 2023-05-08T03:34:41.936 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:40.891+0000 7f928eee2700 1 Processor -- start 2023-05-08T03:34:41.936 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:40.891+0000 7f928eee2700 1 -- start start 2023-05-08T03:34:41.936 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:40.891+0000 7f928eee2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9288105c20 0x7f9288199870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:34:41.936 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:40.891+0000 7f928eee2700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9288199db0 con 0x7f9288105c20 2023-05-08T03:34:41.936 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:40.891+0000 7f928cc7e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9288105c20 0x7f9288199870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:34:41.937 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:40.891+0000 7f928cc7e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9288105c20 0x7f9288199870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39428/0 (socket says 172.21.15.96:39428) 2023-05-08T03:34:41.937 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:40.891+0000 7f928cc7e700 1 -- 172.21.15.96:0/2330386885 learned_addr learned my addr 172.21.15.96:0/2330386885 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:34:41.937 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:40.891+0000 7f928cc7e700 1 -- 172.21.15.96:0/2330386885 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f927c009550 con 0x7f9288105c20 2023-05-08T03:34:41.937 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:40.891+0000 7f928cc7e700 1 --2- 172.21.15.96:0/2330386885 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9288105c20 0x7f9288199870 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f927c011980 tx=0x7f927c011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:34:41.937 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:40.891+0000 7f9285ffb700 1 -- 172.21.15.96:0/2330386885 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f927c003a60 con 0x7f9288105c20 2023-05-08T03:34:41.937 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:40.891+0000 7f9285ffb700 1 -- 172.21.15.96:0/2330386885 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f927c003bc0 con 0x7f9288105c20 2023-05-08T03:34:41.938 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:40.891+0000 7f928eee2700 1 -- 172.21.15.96:0/2330386885 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9288107cb0 con 0x7f9288105c20 2023-05-08T03:34:41.938 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:40.892+0000 7f9285ffb700 1 -- 172.21.15.96:0/2330386885 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f927c01a670 con 0x7f9288105c20 2023-05-08T03:34:41.938 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:40.892+0000 7f928eee2700 1 -- 172.21.15.96:0/2330386885 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9288107b20 con 0x7f9288105c20 2023-05-08T03:34:41.938 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:40.892+0000 7f9285ffb700 1 -- 172.21.15.96:0/2330386885 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 12) v1 ==== 45496+0+0 (secure 0 0 0) 0x7f927c01a8e0 con 0x7f9288105c20 2023-05-08T03:34:41.938 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:40.893+0000 7f928eee2700 1 -- 172.21.15.96:0/2330386885 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f928810a0f0 con 0x7f9288105c20 2023-05-08T03:34:41.938 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:40.893+0000 7f9285ffb700 1 --2- 172.21.15.96:0/2330386885 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f9278038870 0x7f927803ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:34:41.938 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:40.893+0000 7f9285ffb700 1 -- 172.21.15.96:0/2330386885 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f927c04ca60 con 0x7f9288105c20 2023-05-08T03:34:41.939 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:40.893+0000 7f9287fff700 1 --2- 172.21.15.96:0/2330386885 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f9278038870 0x7f927803ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:34:41.939 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:40.893+0000 7f9287fff700 1 --2- 172.21.15.96:0/2330386885 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f9278038870 0x7f927803ad20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9274006fd0 tx=0x7f9274006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:34:41.939 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:40.898+0000 7f9285ffb700 1 -- 172.21.15.96:0/2330386885 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f927c018db0 con 0x7f9288105c20 2023-05-08T03:34:41.939 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:41.116+0000 7f928eee2700 1 -- 172.21.15.96:0/2330386885 --> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f9288062040 con 0x7f9278038870 2023-05-08T03:34:41.939 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:41.340+0000 7f9285ffb700 1 -- 172.21.15.96:0/2330386885 <== mgr.14152 v2:172.21.15.96:6800/2748629182 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f9288062040 con 0x7f9278038870 2023-05-08T03:34:41.940 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:41.343+0000 7f928eee2700 1 -- 172.21.15.96:0/2330386885 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f9278038870 msgr2=0x7f927803ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:34:41.940 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:41.343+0000 7f928eee2700 1 --2- 172.21.15.96:0/2330386885 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f9278038870 0x7f927803ad20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9274006fd0 tx=0x7f9274006e40 comp rx=0 tx=0).stop 2023-05-08T03:34:41.940 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:41.343+0000 7f928eee2700 1 -- 172.21.15.96:0/2330386885 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9288105c20 msgr2=0x7f9288199870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:34:41.940 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:41.343+0000 7f928eee2700 1 --2- 172.21.15.96:0/2330386885 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9288105c20 0x7f9288199870 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f927c011980 tx=0x7f927c011a60 comp rx=0 tx=0).stop 2023-05-08T03:34:41.940 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:41.343+0000 7f928eee2700 1 -- 172.21.15.96:0/2330386885 shutdown_connections 2023-05-08T03:34:41.940 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:41.343+0000 7f928eee2700 1 --2- 172.21.15.96:0/2330386885 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f9278038870 0x7f927803ad20 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:41.941 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:41.343+0000 7f928eee2700 1 --2- 172.21.15.96:0/2330386885 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9288105c20 0x7f9288199870 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:41.941 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:41.343+0000 7f928eee2700 1 -- 172.21.15.96:0/2330386885 >> 172.21.15.96:0/2330386885 conn(0x7f92881012b0 msgr2=0x7f9288101f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:34:41.941 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:41.343+0000 7f928eee2700 1 -- 172.21.15.96:0/2330386885 shutdown_connections 2023-05-08T03:34:41.941 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:41.343+0000 7f928eee2700 1 -- 172.21.15.96:0/2330386885 wait complete. 2023-05-08T03:34:41.941 INFO:teuthology.orchestra.run.smithi096.stdout:Fetching dashboard port number... 2023-05-08T03:34:42.899 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:42 smithi096 ceph-mon[124666]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:34:43.313 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout 8443 2023-05-08T03:34:43.313 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:42.677+0000 7f4f398c3700 1 Processor -- start 2023-05-08T03:34:43.313 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:42.677+0000 7f4f398c3700 1 -- start start 2023-05-08T03:34:43.313 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:42.677+0000 7f4f398c3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f34104b20 0x7f4f34104f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:34:43.313 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:42.677+0000 7f4f398c3700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f34105470 con 0x7f4f34104b20 2023-05-08T03:34:43.314 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:42.677+0000 7f4f32ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f34104b20 0x7f4f34104f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:34:43.314 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:42.677+0000 7f4f32ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f34104b20 0x7f4f34104f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39432/0 (socket says 172.21.15.96:39432) 2023-05-08T03:34:43.314 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:42.677+0000 7f4f32ffd700 1 -- 172.21.15.96:0/1971802493 learned_addr learned my addr 172.21.15.96:0/1971802493 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:34:43.314 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:42.678+0000 7f4f32ffd700 1 -- 172.21.15.96:0/1971802493 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f341055b0 con 0x7f4f34104b20 2023-05-08T03:34:43.314 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:42.678+0000 7f4f32ffd700 1 --2- 172.21.15.96:0/1971802493 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f34104b20 0x7f4f34104f30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4f240098a0 tx=0x7f4f24009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=482d0a4be94c354 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:34:43.314 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:42.678+0000 7f4f31ffb700 1 -- 172.21.15.96:0/1971802493 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4f24004160 con 0x7f4f34104b20 2023-05-08T03:34:43.314 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:42.678+0000 7f4f31ffb700 1 -- 172.21.15.96:0/1971802493 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4f240042c0 con 0x7f4f34104b20 2023-05-08T03:34:43.314 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:42.678+0000 7f4f31ffb700 1 -- 172.21.15.96:0/1971802493 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4f240119b0 con 0x7f4f34104b20 2023-05-08T03:34:43.315 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:42.678+0000 7f4f398c3700 1 -- 172.21.15.96:0/1971802493 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f34104b20 msgr2=0x7f4f34104f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:34:43.315 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:42.678+0000 7f4f398c3700 1 --2- 172.21.15.96:0/1971802493 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f34104b20 0x7f4f34104f30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4f240098a0 tx=0x7f4f24009bb0 comp rx=0 tx=0).stop 2023-05-08T03:34:43.315 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:42.678+0000 7f4f398c3700 1 -- 172.21.15.96:0/1971802493 shutdown_connections 2023-05-08T03:34:43.315 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:42.679+0000 7f4f398c3700 1 --2- 172.21.15.96:0/1971802493 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f34104b20 0x7f4f34104f30 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:43.315 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:42.679+0000 7f4f398c3700 1 -- 172.21.15.96:0/1971802493 >> 172.21.15.96:0/1971802493 conn(0x7f4f34100170 msgr2=0x7f4f341025a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:34:43.315 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:42.679+0000 7f4f398c3700 1 -- 172.21.15.96:0/1971802493 shutdown_connections 2023-05-08T03:34:43.315 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:42.679+0000 7f4f398c3700 1 -- 172.21.15.96:0/1971802493 wait complete. 2023-05-08T03:34:43.316 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:42.679+0000 7f4f398c3700 1 Processor -- start 2023-05-08T03:34:43.316 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:42.679+0000 7f4f398c3700 1 -- start start 2023-05-08T03:34:43.316 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:42.679+0000 7f4f398c3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f34104b20 0x7f4f3418fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:34:43.316 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:42.679+0000 7f4f398c3700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f34190250 con 0x7f4f34104b20 2023-05-08T03:34:43.316 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:42.680+0000 7f4f32ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f34104b20 0x7f4f3418fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:34:43.316 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:42.680+0000 7f4f32ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f34104b20 0x7f4f3418fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39434/0 (socket says 172.21.15.96:39434) 2023-05-08T03:34:43.316 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:42.680+0000 7f4f32ffd700 1 -- 172.21.15.96:0/3257784474 learned_addr learned my addr 172.21.15.96:0/3257784474 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:34:43.317 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:42.680+0000 7f4f32ffd700 1 -- 172.21.15.96:0/3257784474 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f24009550 con 0x7f4f34104b20 2023-05-08T03:34:43.317 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:42.680+0000 7f4f32ffd700 1 --2- 172.21.15.96:0/3257784474 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f34104b20 0x7f4f3418fd10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4f24003e60 tx=0x7f4f24011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:34:43.317 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:42.680+0000 7f4f388c1700 1 -- 172.21.15.96:0/3257784474 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4f24003970 con 0x7f4f34104b20 2023-05-08T03:34:43.317 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:42.680+0000 7f4f388c1700 1 -- 172.21.15.96:0/3257784474 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4f24003ad0 con 0x7f4f34104b20 2023-05-08T03:34:43.317 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:42.680+0000 7f4f388c1700 1 -- 172.21.15.96:0/3257784474 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4f240195e0 con 0x7f4f34104b20 2023-05-08T03:34:43.317 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:42.680+0000 7f4f398c3700 1 -- 172.21.15.96:0/3257784474 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f34106bb0 con 0x7f4f34104b20 2023-05-08T03:34:43.317 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:42.680+0000 7f4f398c3700 1 -- 172.21.15.96:0/3257784474 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f34106a20 con 0x7f4f34104b20 2023-05-08T03:34:43.317 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:42.681+0000 7f4f388c1700 1 -- 172.21.15.96:0/3257784474 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 12) v1 ==== 45496+0+0 (secure 0 0 0) 0x7f4f240198a0 con 0x7f4f34104b20 2023-05-08T03:34:43.318 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:42.681+0000 7f4f388c1700 1 --2- 172.21.15.96:0/3257784474 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f4f1c0387d0 0x7f4f1c03ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:34:43.318 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:42.681+0000 7f4f388c1700 1 -- 172.21.15.96:0/3257784474 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f4f2404c9b0 con 0x7f4f34104b20 2023-05-08T03:34:43.318 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:42.681+0000 7f4f398c3700 1 -- 172.21.15.96:0/3257784474 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f34062220 con 0x7f4f34104b20 2023-05-08T03:34:43.318 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:42.681+0000 7f4f327fc700 1 --2- 172.21.15.96:0/3257784474 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f4f1c0387d0 0x7f4f1c03ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:34:43.318 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:42.682+0000 7f4f327fc700 1 --2- 172.21.15.96:0/3257784474 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f4f1c0387d0 0x7f4f1c03ac80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4f28006fd0 tx=0x7f4f28006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:34:43.318 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:42.686+0000 7f4f388c1700 1 -- 172.21.15.96:0/3257784474 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f4f2402b340 con 0x7f4f34104b20 2023-05-08T03:34:43.318 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:42.874+0000 7f4f398c3700 1 -- 172.21.15.96:0/3257784474 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f4f3418efa0 con 0x7f4f34104b20 2023-05-08T03:34:43.319 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:42.874+0000 7f4f388c1700 1 -- 172.21.15.96:0/3257784474 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f4f24018b40 con 0x7f4f34104b20 2023-05-08T03:34:43.319 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:42.876+0000 7f4f398c3700 1 -- 172.21.15.96:0/3257784474 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f4f1c0387d0 msgr2=0x7f4f1c03ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:34:43.319 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:42.876+0000 7f4f398c3700 1 --2- 172.21.15.96:0/3257784474 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f4f1c0387d0 0x7f4f1c03ac80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4f28006fd0 tx=0x7f4f28006e40 comp rx=0 tx=0).stop 2023-05-08T03:34:43.319 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:42.876+0000 7f4f398c3700 1 -- 172.21.15.96:0/3257784474 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f34104b20 msgr2=0x7f4f3418fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:34:43.319 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:42.876+0000 7f4f398c3700 1 --2- 172.21.15.96:0/3257784474 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f34104b20 0x7f4f3418fd10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4f24003e60 tx=0x7f4f24011aa0 comp rx=0 tx=0).stop 2023-05-08T03:34:43.319 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:42.876+0000 7f4f398c3700 1 -- 172.21.15.96:0/3257784474 shutdown_connections 2023-05-08T03:34:43.319 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:42.876+0000 7f4f398c3700 1 --2- 172.21.15.96:0/3257784474 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f4f1c0387d0 0x7f4f1c03ac80 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:43.319 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:42.876+0000 7f4f398c3700 1 --2- 172.21.15.96:0/3257784474 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f34104b20 0x7f4f3418fd10 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:43.320 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:42.876+0000 7f4f398c3700 1 -- 172.21.15.96:0/3257784474 >> 172.21.15.96:0/3257784474 conn(0x7f4f34100170 msgr2=0x7f4f34073db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:34:43.320 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:42.876+0000 7f4f398c3700 1 -- 172.21.15.96:0/3257784474 shutdown_connections 2023-05-08T03:34:43.320 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:42.876+0000 7f4f398c3700 1 -- 172.21.15.96:0/3257784474 wait complete. 2023-05-08T03:34:43.321 INFO:teuthology.orchestra.run.smithi096.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-05-08T03:34:43.321 INFO:teuthology.orchestra.run.smithi096.stdout:systemctl: stdout disabled 2023-05-08T03:34:43.328 INFO:teuthology.orchestra.run.smithi096.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-05-08T03:34:43.328 INFO:teuthology.orchestra.run.smithi096.stdout:systemctl: stdout inactive 2023-05-08T03:34:43.328 INFO:teuthology.orchestra.run.smithi096.stdout:firewalld.service is not enabled 2023-05-08T03:34:43.329 INFO:teuthology.orchestra.run.smithi096.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2023-05-08T03:34:43.330 INFO:teuthology.orchestra.run.smithi096.stdout:Ceph Dashboard is now available at: 2023-05-08T03:34:43.330 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:34:43.330 INFO:teuthology.orchestra.run.smithi096.stdout: URL: https://smithi096.front.sepia.ceph.com:8443/ 2023-05-08T03:34:43.330 INFO:teuthology.orchestra.run.smithi096.stdout: User: admin 2023-05-08T03:34:43.330 INFO:teuthology.orchestra.run.smithi096.stdout: Password: vg7g021u7z 2023-05-08T03:34:43.331 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:34:43.331 INFO:teuthology.orchestra.run.smithi096.stdout:Saving cluster configuration to /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/config directory 2023-05-08T03:34:43.331 INFO:teuthology.orchestra.run.smithi096.stdout:Enabling autotune for osd_memory_target 2023-05-08T03:34:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:43 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/3257784474' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2023-05-08T03:34:44.375 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:43.807+0000 7f907c896700 1 Processor -- start 2023-05-08T03:34:44.376 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:43.808+0000 7f907c896700 1 -- start start 2023-05-08T03:34:44.376 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:43.808+0000 7f907c896700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9078106790 0x7f9078108b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:34:44.376 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:43.808+0000 7f907c896700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9078074210 con 0x7f9078106790 2023-05-08T03:34:44.376 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:43.808+0000 7f907659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9078106790 0x7f9078108b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:34:44.376 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:43.808+0000 7f907659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9078106790 0x7f9078108b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39442/0 (socket says 172.21.15.96:39442) 2023-05-08T03:34:44.376 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:43.808+0000 7f907659c700 1 -- 172.21.15.96:0/2562902209 learned_addr learned my addr 172.21.15.96:0/2562902209 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:34:44.376 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:43.808+0000 7f907659c700 1 -- 172.21.15.96:0/2562902209 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9078074350 con 0x7f9078106790 2023-05-08T03:34:44.377 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:43.809+0000 7f907659c700 1 --2- 172.21.15.96:0/2562902209 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9078106790 0x7f9078108b70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f90600098a0 tx=0x7f9060009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbf86bf3750f9ce3 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:34:44.377 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:43.809+0000 7f907559a700 1 -- 172.21.15.96:0/2562902209 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9060004160 con 0x7f9078106790 2023-05-08T03:34:44.377 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:43.809+0000 7f907559a700 1 -- 172.21.15.96:0/2562902209 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f90600042c0 con 0x7f9078106790 2023-05-08T03:34:44.377 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:43.809+0000 7f907559a700 1 -- 172.21.15.96:0/2562902209 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f90600119b0 con 0x7f9078106790 2023-05-08T03:34:44.377 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:43.809+0000 7f907c896700 1 -- 172.21.15.96:0/2562902209 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9078106790 msgr2=0x7f9078108b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:34:44.377 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:43.809+0000 7f907c896700 1 --2- 172.21.15.96:0/2562902209 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9078106790 0x7f9078108b70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f90600098a0 tx=0x7f9060009bb0 comp rx=0 tx=0).stop 2023-05-08T03:34:44.377 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:43.809+0000 7f907c896700 1 -- 172.21.15.96:0/2562902209 shutdown_connections 2023-05-08T03:34:44.378 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:43.809+0000 7f907c896700 1 --2- 172.21.15.96:0/2562902209 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9078106790 0x7f9078108b70 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:44.378 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:43.809+0000 7f907c896700 1 -- 172.21.15.96:0/2562902209 >> 172.21.15.96:0/2562902209 conn(0x7f9078100170 msgr2=0x7f90781025a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:34:44.378 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:43.809+0000 7f907c896700 1 -- 172.21.15.96:0/2562902209 shutdown_connections 2023-05-08T03:34:44.378 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:43.810+0000 7f907c896700 1 -- 172.21.15.96:0/2562902209 wait complete. 2023-05-08T03:34:44.378 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:43.810+0000 7f907c896700 1 Processor -- start 2023-05-08T03:34:44.378 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:43.810+0000 7f907c896700 1 -- start start 2023-05-08T03:34:44.378 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:43.810+0000 7f907c896700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9078106790 0x7f9078199920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:34:44.379 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:43.810+0000 7f907c896700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9078199e60 con 0x7f9078106790 2023-05-08T03:34:44.379 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:43.810+0000 7f907659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9078106790 0x7f9078199920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:34:44.379 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:43.810+0000 7f907659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9078106790 0x7f9078199920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39444/0 (socket says 172.21.15.96:39444) 2023-05-08T03:34:44.379 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:43.810+0000 7f907659c700 1 -- 172.21.15.96:0/3977516500 learned_addr learned my addr 172.21.15.96:0/3977516500 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:34:44.379 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:43.811+0000 7f907659c700 1 -- 172.21.15.96:0/3977516500 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9060009550 con 0x7f9078106790 2023-05-08T03:34:44.379 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:43.811+0000 7f907659c700 1 --2- 172.21.15.96:0/3977516500 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9078106790 0x7f9078199920 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9060000c00 tx=0x7f9060011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:34:44.379 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:43.811+0000 7f906f7fe700 1 -- 172.21.15.96:0/3977516500 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f90600039f0 con 0x7f9078106790 2023-05-08T03:34:44.379 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:43.811+0000 7f906f7fe700 1 -- 172.21.15.96:0/3977516500 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9060003b50 con 0x7f9078106790 2023-05-08T03:34:44.380 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:43.811+0000 7f906f7fe700 1 -- 172.21.15.96:0/3977516500 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f906001a780 con 0x7f9078106790 2023-05-08T03:34:44.380 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:43.811+0000 7f907c896700 1 -- 172.21.15.96:0/3977516500 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9078109ef0 con 0x7f9078106790 2023-05-08T03:34:44.380 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:43.811+0000 7f907c896700 1 -- 172.21.15.96:0/3977516500 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9078109d60 con 0x7f9078106790 2023-05-08T03:34:44.380 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:43.812+0000 7f906f7fe700 1 -- 172.21.15.96:0/3977516500 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 13) v1 ==== 45539+0+0 (secure 0 0 0) 0x7f906001aa40 con 0x7f9078106790 2023-05-08T03:34:44.380 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:43.812+0000 7f906f7fe700 1 --2- 172.21.15.96:0/3977516500 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f90640388c0 0x7f906403ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:34:44.380 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:43.812+0000 7f906f7fe700 1 -- 172.21.15.96:0/3977516500 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f906004d860 con 0x7f9078106790 2023-05-08T03:34:44.380 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:43.812+0000 7f9075d9b700 1 --2- 172.21.15.96:0/3977516500 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f90640388c0 0x7f906403ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:34:44.381 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:43.812+0000 7f907c896700 1 -- 172.21.15.96:0/3977516500 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f907810a080 con 0x7f9078106790 2023-05-08T03:34:44.381 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:43.813+0000 7f9075d9b700 1 --2- 172.21.15.96:0/3977516500 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f90640388c0 0x7f906403ad70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9068006fd0 tx=0x7f9068006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:34:44.381 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:43.817+0000 7f906f7fe700 1 -- 172.21.15.96:0/3977516500 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f90600237b0 con 0x7f9078106790 2023-05-08T03:34:44.381 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:44.003+0000 7f907c896700 1 -- 172.21.15.96:0/3977516500 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7f9078062220 con 0x7f9078106790 2023-05-08T03:34:44.381 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:44.003+0000 7f906f7fe700 1 -- 172.21.15.96:0/3977516500 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7f906002c350 con 0x7f9078106790 2023-05-08T03:34:44.381 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:44.005+0000 7f907c896700 1 -- 172.21.15.96:0/3977516500 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f90640388c0 msgr2=0x7f906403ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:34:44.381 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:44.005+0000 7f907c896700 1 --2- 172.21.15.96:0/3977516500 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f90640388c0 0x7f906403ad70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9068006fd0 tx=0x7f9068006e40 comp rx=0 tx=0).stop 2023-05-08T03:34:44.381 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:44.005+0000 7f907c896700 1 -- 172.21.15.96:0/3977516500 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9078106790 msgr2=0x7f9078199920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:34:44.382 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:44.005+0000 7f907c896700 1 --2- 172.21.15.96:0/3977516500 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9078106790 0x7f9078199920 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9060000c00 tx=0x7f9060011a30 comp rx=0 tx=0).stop 2023-05-08T03:34:44.382 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:44.005+0000 7f907c896700 1 -- 172.21.15.96:0/3977516500 shutdown_connections 2023-05-08T03:34:44.382 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:44.005+0000 7f907c896700 1 --2- 172.21.15.96:0/3977516500 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f90640388c0 0x7f906403ad70 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:44.382 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:44.005+0000 7f907c896700 1 --2- 172.21.15.96:0/3977516500 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9078106790 0x7f9078199920 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:44.382 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:44.005+0000 7f907c896700 1 -- 172.21.15.96:0/3977516500 >> 172.21.15.96:0/3977516500 conn(0x7f9078100170 msgr2=0x7f9078100f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:34:44.382 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:44.005+0000 7f907c896700 1 -- 172.21.15.96:0/3977516500 shutdown_connections 2023-05-08T03:34:44.382 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:44.005+0000 7f907c896700 1 -- 172.21.15.96:0/3977516500 wait complete. 2023-05-08T03:34:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:44 smithi096 ceph-mon[124666]: mgrmap e13: x(active, since 6s) 2023-05-08T03:34:45.520 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:44.821+0000 7f37b9f10700 1 Processor -- start 2023-05-08T03:34:45.521 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:44.821+0000 7f37b9f10700 1 -- start start 2023-05-08T03:34:45.521 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:44.821+0000 7f37b9f10700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37b4106790 0x7f37b4108b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:34:45.521 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:44.821+0000 7f37b9f10700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37b4074210 con 0x7f37b4106790 2023-05-08T03:34:45.521 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:44.821+0000 7f37b37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37b4106790 0x7f37b4108b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:34:45.521 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:44.822+0000 7f37b37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37b4106790 0x7f37b4108b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39448/0 (socket says 172.21.15.96:39448) 2023-05-08T03:34:45.521 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:44.822+0000 7f37b37fe700 1 -- 172.21.15.96:0/224107604 learned_addr learned my addr 172.21.15.96:0/224107604 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:34:45.521 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:44.822+0000 7f37b37fe700 1 -- 172.21.15.96:0/224107604 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b4074350 con 0x7f37b4106790 2023-05-08T03:34:45.522 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:44.822+0000 7f37b37fe700 1 --2- 172.21.15.96:0/224107604 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37b4106790 0x7f37b4108b70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f37a80098a0 tx=0x7f37a8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41103ff31f6d1e94 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:34:45.522 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:44.822+0000 7f37b27fc700 1 -- 172.21.15.96:0/224107604 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f37a8004160 con 0x7f37b4106790 2023-05-08T03:34:45.522 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:44.822+0000 7f37b27fc700 1 -- 172.21.15.96:0/224107604 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f37a80042c0 con 0x7f37b4106790 2023-05-08T03:34:45.522 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:44.822+0000 7f37b27fc700 1 -- 172.21.15.96:0/224107604 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f37a80119b0 con 0x7f37b4106790 2023-05-08T03:34:45.522 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:44.823+0000 7f37b9f10700 1 -- 172.21.15.96:0/224107604 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37b4106790 msgr2=0x7f37b4108b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:34:45.522 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:44.823+0000 7f37b9f10700 1 --2- 172.21.15.96:0/224107604 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37b4106790 0x7f37b4108b70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f37a80098a0 tx=0x7f37a8009bb0 comp rx=0 tx=0).stop 2023-05-08T03:34:45.522 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:44.823+0000 7f37b9f10700 1 -- 172.21.15.96:0/224107604 shutdown_connections 2023-05-08T03:34:45.522 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:44.823+0000 7f37b9f10700 1 --2- 172.21.15.96:0/224107604 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37b4106790 0x7f37b4108b70 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:45.523 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:44.823+0000 7f37b9f10700 1 -- 172.21.15.96:0/224107604 >> 172.21.15.96:0/224107604 conn(0x7f37b4100170 msgr2=0x7f37b41025a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:34:45.523 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:44.823+0000 7f37b9f10700 1 -- 172.21.15.96:0/224107604 shutdown_connections 2023-05-08T03:34:45.523 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:44.823+0000 7f37b9f10700 1 -- 172.21.15.96:0/224107604 wait complete. 2023-05-08T03:34:45.523 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:44.823+0000 7f37b9f10700 1 Processor -- start 2023-05-08T03:34:45.523 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:44.823+0000 7f37b9f10700 1 -- start start 2023-05-08T03:34:45.523 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:44.824+0000 7f37b9f10700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37b4106790 0x7f37b4199920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:34:45.523 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:44.824+0000 7f37b9f10700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37b4199e60 con 0x7f37b4106790 2023-05-08T03:34:45.524 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:44.824+0000 7f37b37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37b4106790 0x7f37b4199920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:34:45.524 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:44.824+0000 7f37b37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37b4106790 0x7f37b4199920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39450/0 (socket says 172.21.15.96:39450) 2023-05-08T03:34:45.524 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:44.824+0000 7f37b37fe700 1 -- 172.21.15.96:0/3898898892 learned_addr learned my addr 172.21.15.96:0/3898898892 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:34:45.524 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:44.824+0000 7f37b37fe700 1 -- 172.21.15.96:0/3898898892 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37a8009550 con 0x7f37b4106790 2023-05-08T03:34:45.524 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:44.824+0000 7f37b37fe700 1 --2- 172.21.15.96:0/3898898892 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37b4106790 0x7f37b4199920 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f37a8003e60 tx=0x7f37a8011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:34:45.524 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:44.824+0000 7f37b0ff9700 1 -- 172.21.15.96:0/3898898892 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f37a8003970 con 0x7f37b4106790 2023-05-08T03:34:45.524 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:44.824+0000 7f37b0ff9700 1 -- 172.21.15.96:0/3898898892 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f37a8003ad0 con 0x7f37b4106790 2023-05-08T03:34:45.524 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:44.824+0000 7f37b0ff9700 1 -- 172.21.15.96:0/3898898892 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f37a80195e0 con 0x7f37b4106790 2023-05-08T03:34:45.525 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:44.824+0000 7f37b9f10700 1 -- 172.21.15.96:0/3898898892 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37b4109ef0 con 0x7f37b4106790 2023-05-08T03:34:45.525 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:44.824+0000 7f37b9f10700 1 -- 172.21.15.96:0/3898898892 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37b4109d60 con 0x7f37b4106790 2023-05-08T03:34:45.525 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:44.825+0000 7f37b0ff9700 1 -- 172.21.15.96:0/3898898892 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 13) v1 ==== 45539+0+0 (secure 0 0 0) 0x7f37a8019850 con 0x7f37b4106790 2023-05-08T03:34:45.525 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:44.825+0000 7f37b0ff9700 1 --2- 172.21.15.96:0/3898898892 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f379c0388c0 0x7f379c03ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:34:45.525 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:44.825+0000 7f37b0ff9700 1 -- 172.21.15.96:0/3898898892 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f37a804ca40 con 0x7f37b4106790 2023-05-08T03:34:45.525 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:44.825+0000 7f37b9f10700 1 -- 172.21.15.96:0/3898898892 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37b410a080 con 0x7f37b4106790 2023-05-08T03:34:45.525 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:44.825+0000 7f37b2ffd700 1 --2- 172.21.15.96:0/3898898892 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f379c0388c0 0x7f379c03ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:34:45.526 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:44.826+0000 7f37b2ffd700 1 --2- 172.21.15.96:0/3898898892 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f379c0388c0 0x7f379c03ad70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f37a4006fd0 tx=0x7f37a4006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:34:45.526 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:44.830+0000 7f37b0ff9700 1 -- 172.21.15.96:0/3898898892 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f37a8019ba0 con 0x7f37b4106790 2023-05-08T03:34:45.526 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:45.123+0000 7f37b9f10700 1 -- 172.21.15.96:0/3898898892 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f37b419a3a0 con 0x7f37b4106790 2023-05-08T03:34:45.526 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:45.125+0000 7f37b0ff9700 1 -- 172.21.15.96:0/3898898892 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) v1 ==== 153+0+0 (secure 0 0 0) 0x7f37a8018b40 con 0x7f37b4106790 2023-05-08T03:34:45.526 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:45.127+0000 7f37b9f10700 1 -- 172.21.15.96:0/3898898892 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f379c0388c0 msgr2=0x7f379c03ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:34:45.526 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:45.127+0000 7f37b9f10700 1 --2- 172.21.15.96:0/3898898892 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f379c0388c0 0x7f379c03ad70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f37a4006fd0 tx=0x7f37a4006e40 comp rx=0 tx=0).stop 2023-05-08T03:34:45.526 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:45.127+0000 7f37b9f10700 1 -- 172.21.15.96:0/3898898892 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37b4106790 msgr2=0x7f37b4199920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:34:45.526 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:45.127+0000 7f37b9f10700 1 --2- 172.21.15.96:0/3898898892 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37b4106790 0x7f37b4199920 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f37a8003e60 tx=0x7f37a8011aa0 comp rx=0 tx=0).stop 2023-05-08T03:34:45.527 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:45.127+0000 7f37b9f10700 1 -- 172.21.15.96:0/3898898892 shutdown_connections 2023-05-08T03:34:45.527 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:45.127+0000 7f37b9f10700 1 --2- 172.21.15.96:0/3898898892 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f379c0388c0 0x7f379c03ad70 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:45.527 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:45.127+0000 7f37b9f10700 1 --2- 172.21.15.96:0/3898898892 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37b4106790 0x7f37b4199920 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:45.527 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:45.127+0000 7f37b9f10700 1 -- 172.21.15.96:0/3898898892 >> 172.21.15.96:0/3898898892 conn(0x7f37b4100170 msgr2=0x7f37b4100f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:34:45.527 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:45.128+0000 7f37b9f10700 1 -- 172.21.15.96:0/3898898892 shutdown_connections 2023-05-08T03:34:45.527 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2023-05-08T03:34:45.128+0000 7f37b9f10700 1 -- 172.21.15.96:0/3898898892 wait complete. 2023-05-08T03:34:45.527 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2023-05-08T03:34:45.528 INFO:teuthology.orchestra.run.smithi096.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2023-05-08T03:34:45.528 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:34:45.528 INFO:teuthology.orchestra.run.smithi096.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2023-05-08T03:34:45.528 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:34:45.528 INFO:teuthology.orchestra.run.smithi096.stdout:Or, if you are only running a single cluster on this host: 2023-05-08T03:34:45.528 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:34:45.528 INFO:teuthology.orchestra.run.smithi096.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2023-05-08T03:34:45.528 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:34:45.529 INFO:teuthology.orchestra.run.smithi096.stdout:Please consider enabling telemetry to help improve Ceph: 2023-05-08T03:34:45.529 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:34:45.529 INFO:teuthology.orchestra.run.smithi096.stdout: ceph telemetry on 2023-05-08T03:34:45.529 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:34:45.529 INFO:teuthology.orchestra.run.smithi096.stdout:For more information see: 2023-05-08T03:34:45.529 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:34:45.529 INFO:teuthology.orchestra.run.smithi096.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2023-05-08T03:34:45.529 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:34:45.530 INFO:teuthology.orchestra.run.smithi096.stdout:Bootstrap complete. 2023-05-08T03:34:45.554 INFO:tasks.cephadm:Fetching config... 2023-05-08T03:34:45.554 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-05-08T03:34:45.555 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2023-05-08T03:34:45.611 INFO:tasks.cephadm:Fetching client.admin keyring... 2023-05-08T03:34:45.611 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-05-08T03:34:45.612 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2023-05-08T03:34:45.667 INFO:tasks.cephadm:Fetching mon keyring... 2023-05-08T03:34:45.668 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-05-08T03:34:45.668 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.a/keyring of=/dev/stdout 2023-05-08T03:34:45.735 INFO:tasks.cephadm:Fetching pub ssh key... 2023-05-08T03:34:45.735 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-05-08T03:34:45.735 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2023-05-08T03:34:45.791 INFO:tasks.cephadm:Installing pub ssh key for root users... 2023-05-08T03:34:45.792 DEBUG:teuthology.orchestra.run.smithi096:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDedRSMFvd9Tsu9lnT+ArB0gPdrtRw/ssmrzLQxXK496Sqiu873bFCMf6cVCA8foYyAd2h3S3V9+/4xOqrT+znOzmcCDT7sHtqq+FGnKTut2F9zcG72P75HzC1e8dwN8lwib5mwgdAFDL18jGl5G6yVfCsoLiT4Mr02iIWRY2aj6xOITN7836WVKvv1VxBzGyprWPWIMrEMuqZVtNZzwl+PCwJstuxNu7500iwLrVVGo77ciXnZE93sgLc4G+bQQPwciXNwxre3Er1JDmxT3VJn57NuISsj/ny18Jn1Xl4LuRA0Ozxfm8A9ItLZPhvlZUS5rwamancivrMlyg0ARi208Dh7VctgyfNwRIpO2s+m8lx6Gx06Z/XUgsbtGyTHkLCUvPQkmECpH45TmBIMKdynUj2kA2Y19batMxblPKr/MtmVwlZkYJUZIeeeoDj+ifACSCw7pPDQ252w5TQmW/SosUFRgMilDw7pbIdLHSoNsh9KgQS7xzIuv0phKqVyRAs= ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-05-08T03:34:45.870 INFO:teuthology.orchestra.run.smithi096.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDedRSMFvd9Tsu9lnT+ArB0gPdrtRw/ssmrzLQxXK496Sqiu873bFCMf6cVCA8foYyAd2h3S3V9+/4xOqrT+znOzmcCDT7sHtqq+FGnKTut2F9zcG72P75HzC1e8dwN8lwib5mwgdAFDL18jGl5G6yVfCsoLiT4Mr02iIWRY2aj6xOITN7836WVKvv1VxBzGyprWPWIMrEMuqZVtNZzwl+PCwJstuxNu7500iwLrVVGo77ciXnZE93sgLc4G+bQQPwciXNwxre3Er1JDmxT3VJn57NuISsj/ny18Jn1Xl4LuRA0Ozxfm8A9ItLZPhvlZUS5rwamancivrMlyg0ARi208Dh7VctgyfNwRIpO2s+m8lx6Gx06Z/XUgsbtGyTHkLCUvPQkmECpH45TmBIMKdynUj2kA2Y19batMxblPKr/MtmVwlZkYJUZIeeeoDj+ifACSCw7pPDQ252w5TQmW/SosUFRgMilDw7pbIdLHSoNsh9KgQS7xzIuv0phKqVyRAs= ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c 2023-05-08T03:34:45.882 DEBUG:teuthology.orchestra.run.smithi133:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDedRSMFvd9Tsu9lnT+ArB0gPdrtRw/ssmrzLQxXK496Sqiu873bFCMf6cVCA8foYyAd2h3S3V9+/4xOqrT+znOzmcCDT7sHtqq+FGnKTut2F9zcG72P75HzC1e8dwN8lwib5mwgdAFDL18jGl5G6yVfCsoLiT4Mr02iIWRY2aj6xOITN7836WVKvv1VxBzGyprWPWIMrEMuqZVtNZzwl+PCwJstuxNu7500iwLrVVGo77ciXnZE93sgLc4G+bQQPwciXNwxre3Er1JDmxT3VJn57NuISsj/ny18Jn1Xl4LuRA0Ozxfm8A9ItLZPhvlZUS5rwamancivrMlyg0ARi208Dh7VctgyfNwRIpO2s+m8lx6Gx06Z/XUgsbtGyTHkLCUvPQkmECpH45TmBIMKdynUj2kA2Y19batMxblPKr/MtmVwlZkYJUZIeeeoDj+ifACSCw7pPDQ252w5TQmW/SosUFRgMilDw7pbIdLHSoNsh9KgQS7xzIuv0phKqVyRAs= ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-05-08T03:34:45.926 INFO:teuthology.orchestra.run.smithi133.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDedRSMFvd9Tsu9lnT+ArB0gPdrtRw/ssmrzLQxXK496Sqiu873bFCMf6cVCA8foYyAd2h3S3V9+/4xOqrT+znOzmcCDT7sHtqq+FGnKTut2F9zcG72P75HzC1e8dwN8lwib5mwgdAFDL18jGl5G6yVfCsoLiT4Mr02iIWRY2aj6xOITN7836WVKvv1VxBzGyprWPWIMrEMuqZVtNZzwl+PCwJstuxNu7500iwLrVVGo77ciXnZE93sgLc4G+bQQPwciXNwxre3Er1JDmxT3VJn57NuISsj/ny18Jn1Xl4LuRA0Ozxfm8A9ItLZPhvlZUS5rwamancivrMlyg0ARi208Dh7VctgyfNwRIpO2s+m8lx6Gx06Z/XUgsbtGyTHkLCUvPQkmECpH45TmBIMKdynUj2kA2Y19batMxblPKr/MtmVwlZkYJUZIeeeoDj+ifACSCw7pPDQ252w5TQmW/SosUFRgMilDw7pbIdLHSoNsh9KgQS7xzIuv0phKqVyRAs= ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c 2023-05-08T03:34:45.939 DEBUG:teuthology.orchestra.run.smithi186:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDedRSMFvd9Tsu9lnT+ArB0gPdrtRw/ssmrzLQxXK496Sqiu873bFCMf6cVCA8foYyAd2h3S3V9+/4xOqrT+znOzmcCDT7sHtqq+FGnKTut2F9zcG72P75HzC1e8dwN8lwib5mwgdAFDL18jGl5G6yVfCsoLiT4Mr02iIWRY2aj6xOITN7836WVKvv1VxBzGyprWPWIMrEMuqZVtNZzwl+PCwJstuxNu7500iwLrVVGo77ciXnZE93sgLc4G+bQQPwciXNwxre3Er1JDmxT3VJn57NuISsj/ny18Jn1Xl4LuRA0Ozxfm8A9ItLZPhvlZUS5rwamancivrMlyg0ARi208Dh7VctgyfNwRIpO2s+m8lx6Gx06Z/XUgsbtGyTHkLCUvPQkmECpH45TmBIMKdynUj2kA2Y19batMxblPKr/MtmVwlZkYJUZIeeeoDj+ifACSCw7pPDQ252w5TQmW/SosUFRgMilDw7pbIdLHSoNsh9KgQS7xzIuv0phKqVyRAs= ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-05-08T03:34:45.984 INFO:teuthology.orchestra.run.smithi186.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDedRSMFvd9Tsu9lnT+ArB0gPdrtRw/ssmrzLQxXK496Sqiu873bFCMf6cVCA8foYyAd2h3S3V9+/4xOqrT+znOzmcCDT7sHtqq+FGnKTut2F9zcG72P75HzC1e8dwN8lwib5mwgdAFDL18jGl5G6yVfCsoLiT4Mr02iIWRY2aj6xOITN7836WVKvv1VxBzGyprWPWIMrEMuqZVtNZzwl+PCwJstuxNu7500iwLrVVGo77ciXnZE93sgLc4G+bQQPwciXNwxre3Er1JDmxT3VJn57NuISsj/ny18Jn1Xl4LuRA0Ozxfm8A9ItLZPhvlZUS5rwamancivrMlyg0ARi208Dh7VctgyfNwRIpO2s+m8lx6Gx06Z/XUgsbtGyTHkLCUvPQkmECpH45TmBIMKdynUj2kA2Y19batMxblPKr/MtmVwlZkYJUZIeeeoDj+ifACSCw7pPDQ252w5TQmW/SosUFRgMilDw7pbIdLHSoNsh9KgQS7xzIuv0phKqVyRAs= ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c 2023-05-08T03:34:45.997 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- ceph config set mgr mgr/cephadm/allow_ptrace true 2023-05-08T03:34:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:46 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/3898898892' entity='client.admin' 2023-05-08T03:34:46.914 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.a/config 2023-05-08T03:34:48.112 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:47 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:34:48.113 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:47 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:34:48.113 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:47 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:34:48.113 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:47 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:34:48.113 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:47 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:34:48.113 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:47 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:34:48.326 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:48.324+0000 7fe309b10700 1 -- 172.21.15.96:0/4161630697 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3040fecf0 msgr2=0x7fe3040ff100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:34:48.327 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:48.324+0000 7fe309b10700 1 --2- 172.21.15.96:0/4161630697 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3040fecf0 0x7fe3040ff100 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe2f4009910 tx=0x7fe2f4009c20 comp rx=0 tx=0).stop 2023-05-08T03:34:48.327 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:48.324+0000 7fe309b10700 1 -- 172.21.15.96:0/4161630697 shutdown_connections 2023-05-08T03:34:48.327 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:48.324+0000 7fe309b10700 1 --2- 172.21.15.96:0/4161630697 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3040fecf0 0x7fe3040ff100 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:48.327 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:48.324+0000 7fe309b10700 1 -- 172.21.15.96:0/4161630697 >> 172.21.15.96:0/4161630697 conn(0x7fe3040fa340 msgr2=0x7fe3040fc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:34:48.327 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:48.324+0000 7fe309b10700 1 -- 172.21.15.96:0/4161630697 shutdown_connections 2023-05-08T03:34:48.327 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:48.324+0000 7fe309b10700 1 -- 172.21.15.96:0/4161630697 wait complete. 2023-05-08T03:34:48.329 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:48.325+0000 7fe309b10700 1 Processor -- start 2023-05-08T03:34:48.329 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:48.325+0000 7fe309b10700 1 -- start start 2023-05-08T03:34:48.329 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:48.325+0000 7fe309b10700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3040fecf0 0x7fe304193dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:34:48.329 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:48.325+0000 7fe309b10700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe304194300 con 0x7fe3040fecf0 2023-05-08T03:34:48.329 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:48.325+0000 7fe3037fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3040fecf0 0x7fe304193dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:34:48.329 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:48.325+0000 7fe3037fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3040fecf0 0x7fe304193dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39456/0 (socket says 172.21.15.96:39456) 2023-05-08T03:34:48.330 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:48.325+0000 7fe3037fe700 1 -- 172.21.15.96:0/2951047213 learned_addr learned my addr 172.21.15.96:0/2951047213 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:34:48.330 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:48.326+0000 7fe3037fe700 1 -- 172.21.15.96:0/2951047213 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f40095f0 con 0x7fe3040fecf0 2023-05-08T03:34:48.330 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:48.326+0000 7fe3037fe700 1 --2- 172.21.15.96:0/2951047213 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3040fecf0 0x7fe304193dc0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe2f4004f40 tx=0x7fe2f40057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:34:48.330 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:48.326+0000 7fe300ff9700 1 -- 172.21.15.96:0/2951047213 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe2f401d070 con 0x7fe3040fecf0 2023-05-08T03:34:48.330 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:48.326+0000 7fe300ff9700 1 -- 172.21.15.96:0/2951047213 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe2f40044e0 con 0x7fe3040fecf0 2023-05-08T03:34:48.330 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:48.326+0000 7fe300ff9700 1 -- 172.21.15.96:0/2951047213 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe2f4003a20 con 0x7fe3040fecf0 2023-05-08T03:34:48.330 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:48.326+0000 7fe309b10700 1 -- 172.21.15.96:0/2951047213 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe304104b40 con 0x7fe3040fecf0 2023-05-08T03:34:48.331 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:48.326+0000 7fe309b10700 1 -- 172.21.15.96:0/2951047213 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3041049b0 con 0x7fe3040fecf0 2023-05-08T03:34:48.331 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:48.327+0000 7fe300ff9700 1 -- 172.21.15.96:0/2951047213 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 13) v1 ==== 45539+0+0 (secure 0 0 0) 0x7fe2f4003c50 con 0x7fe3040fecf0 2023-05-08T03:34:48.331 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:48.327+0000 7fe300ff9700 1 --2- 172.21.15.96:0/2951047213 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fe2ec0388c0 0x7fe2ec03ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:34:48.331 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:48.327+0000 7fe300ff9700 1 -- 172.21.15.96:0/2951047213 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fe2f404c970 con 0x7fe3040fecf0 2023-05-08T03:34:48.332 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:48.327+0000 7fe309b10700 1 -- 172.21.15.96:0/2951047213 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe304104cd0 con 0x7fe3040fecf0 2023-05-08T03:34:48.332 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:48.327+0000 7fe302ffd700 1 --2- 172.21.15.96:0/2951047213 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fe2ec0388c0 0x7fe2ec03ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:34:48.332 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:48.328+0000 7fe302ffd700 1 --2- 172.21.15.96:0/2951047213 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fe2ec0388c0 0x7fe2ec03ad70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe2f8006fd0 tx=0x7fe2f8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:34:48.334 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:48.332+0000 7fe300ff9700 1 -- 172.21.15.96:0/2951047213 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fe2f400f460 con 0x7fe3040fecf0 2023-05-08T03:34:48.534 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:48.532+0000 7fe309b10700 1 -- 172.21.15.96:0/2951047213 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7fe30402d0e0 con 0x7fe3040fecf0 2023-05-08T03:34:48.537 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:48.535+0000 7fe300ff9700 1 -- 172.21.15.96:0/2951047213 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7fe2f402a360 con 0x7fe3040fecf0 2023-05-08T03:34:48.539 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:48.537+0000 7fe309b10700 1 -- 172.21.15.96:0/2951047213 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fe2ec0388c0 msgr2=0x7fe2ec03ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:34:48.540 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:48.537+0000 7fe309b10700 1 --2- 172.21.15.96:0/2951047213 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fe2ec0388c0 0x7fe2ec03ad70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe2f8006fd0 tx=0x7fe2f8006e40 comp rx=0 tx=0).stop 2023-05-08T03:34:48.540 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:48.537+0000 7fe309b10700 1 -- 172.21.15.96:0/2951047213 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3040fecf0 msgr2=0x7fe304193dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:34:48.540 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:48.537+0000 7fe309b10700 1 --2- 172.21.15.96:0/2951047213 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3040fecf0 0x7fe304193dc0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe2f4004f40 tx=0x7fe2f40057c0 comp rx=0 tx=0).stop 2023-05-08T03:34:48.540 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:48.537+0000 7fe309b10700 1 -- 172.21.15.96:0/2951047213 shutdown_connections 2023-05-08T03:34:48.540 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:48.537+0000 7fe309b10700 1 --2- 172.21.15.96:0/2951047213 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fe2ec0388c0 0x7fe2ec03ad70 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:48.540 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:48.537+0000 7fe309b10700 1 --2- 172.21.15.96:0/2951047213 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3040fecf0 0x7fe304193dc0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:48.541 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:48.537+0000 7fe309b10700 1 -- 172.21.15.96:0/2951047213 >> 172.21.15.96:0/2951047213 conn(0x7fe3040fa340 msgr2=0x7fe3040faff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:34:48.541 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:48.537+0000 7fe309b10700 1 -- 172.21.15.96:0/2951047213 shutdown_connections 2023-05-08T03:34:48.541 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:48.537+0000 7fe309b10700 1 -- 172.21.15.96:0/2951047213 wait complete. 2023-05-08T03:34:49.167 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2023-05-08T03:34:49.168 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- ceph orch client-keyring set client.admin '*' --mode 0755 2023-05-08T03:34:49.806 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.a/config 2023-05-08T03:34:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:49 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/2951047213' entity='client.admin' 2023-05-08T03:34:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:49 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:34:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:49 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:34:51.094 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:51.091+0000 7f5103e3d700 1 -- 172.21.15.96:0/1398055804 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50fc0fe470 msgr2=0x7f50fc0fe880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:34:51.094 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:51.091+0000 7f5103e3d700 1 --2- 172.21.15.96:0/1398055804 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50fc0fe470 0x7f50fc0fe880 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f50f8009910 tx=0x7f50f8009c20 comp rx=0 tx=0).stop 2023-05-08T03:34:51.094 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:51.091+0000 7f5103e3d700 1 -- 172.21.15.96:0/1398055804 shutdown_connections 2023-05-08T03:34:51.094 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:51.092+0000 7f5103e3d700 1 --2- 172.21.15.96:0/1398055804 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50fc0fe470 0x7f50fc0fe880 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:51.095 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:51.092+0000 7f5103e3d700 1 -- 172.21.15.96:0/1398055804 >> 172.21.15.96:0/1398055804 conn(0x7f50fc0f9ae0 msgr2=0x7f50fc0fbef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:34:51.095 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:51.092+0000 7f5103e3d700 1 -- 172.21.15.96:0/1398055804 shutdown_connections 2023-05-08T03:34:51.095 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:51.092+0000 7f5103e3d700 1 -- 172.21.15.96:0/1398055804 wait complete. 2023-05-08T03:34:51.096 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:51.092+0000 7f5103e3d700 1 Processor -- start 2023-05-08T03:34:51.097 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:51.092+0000 7f5103e3d700 1 -- start start 2023-05-08T03:34:51.097 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:51.092+0000 7f5103e3d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50fc0fe470 0x7f50fc193e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:34:51.097 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:51.092+0000 7f5103e3d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50fc194360 con 0x7f50fc0fe470 2023-05-08T03:34:51.097 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:51.092+0000 7f5101bd9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50fc0fe470 0x7f50fc193e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:34:51.097 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:51.092+0000 7f5101bd9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50fc0fe470 0x7f50fc193e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39462/0 (socket says 172.21.15.96:39462) 2023-05-08T03:34:51.097 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:51.092+0000 7f5101bd9700 1 -- 172.21.15.96:0/3017616184 learned_addr learned my addr 172.21.15.96:0/3017616184 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:34:51.098 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:51.093+0000 7f5101bd9700 1 -- 172.21.15.96:0/3017616184 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50f80095f0 con 0x7f50fc0fe470 2023-05-08T03:34:51.098 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:51.093+0000 7f5101bd9700 1 --2- 172.21.15.96:0/3017616184 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50fc0fe470 0x7f50fc193e20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f50f8004f40 tx=0x7f50f80057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:34:51.098 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:51.093+0000 7f50f2ffd700 1 -- 172.21.15.96:0/3017616184 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f50f801d070 con 0x7f50fc0fe470 2023-05-08T03:34:51.098 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:51.093+0000 7f50f2ffd700 1 -- 172.21.15.96:0/3017616184 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f50f80044e0 con 0x7f50fc0fe470 2023-05-08T03:34:51.098 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:51.093+0000 7f5103e3d700 1 -- 172.21.15.96:0/3017616184 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50fc104b50 con 0x7f50fc0fe470 2023-05-08T03:34:51.098 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:51.093+0000 7f50f2ffd700 1 -- 172.21.15.96:0/3017616184 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f50f8003a20 con 0x7f50fc0fe470 2023-05-08T03:34:51.098 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:51.093+0000 7f5103e3d700 1 -- 172.21.15.96:0/3017616184 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50fc1049c0 con 0x7f50fc0fe470 2023-05-08T03:34:51.099 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:51.094+0000 7f50f2ffd700 1 -- 172.21.15.96:0/3017616184 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 13) v1 ==== 45539+0+0 (secure 0 0 0) 0x7f50f800bb60 con 0x7f50fc0fe470 2023-05-08T03:34:51.099 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:51.094+0000 7f5103e3d700 1 -- 172.21.15.96:0/3017616184 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50fc104ce0 con 0x7f50fc0fe470 2023-05-08T03:34:51.099 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:51.094+0000 7f50f2ffd700 1 --2- 172.21.15.96:0/3017616184 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f50e80388c0 0x7f50e803ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:34:51.099 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:51.094+0000 7f50f2ffd700 1 -- 172.21.15.96:0/3017616184 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f50f804c840 con 0x7f50fc0fe470 2023-05-08T03:34:51.099 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:51.094+0000 7f51013d8700 1 --2- 172.21.15.96:0/3017616184 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f50e80388c0 0x7f50e803ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:34:51.099 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:51.094+0000 7f51013d8700 1 --2- 172.21.15.96:0/3017616184 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f50e80388c0 0x7f50e803ad70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f50ec006fd0 tx=0x7f50ec006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:34:51.101 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:51.099+0000 7f50f2ffd700 1 -- 172.21.15.96:0/3017616184 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f50f800eb40 con 0x7f50fc0fe470 2023-05-08T03:34:51.290 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:51.288+0000 7f5103e3d700 1 -- 172.21.15.96:0/3017616184 --> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f50fc061030 con 0x7f50e80388c0 2023-05-08T03:34:51.293 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:51.291+0000 7f50f2ffd700 1 -- 172.21.15.96:0/3017616184 <== mgr.14152 v2:172.21.15.96:6800/2748629182 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f50fc061030 con 0x7f50e80388c0 2023-05-08T03:34:51.296 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:51.293+0000 7f5103e3d700 1 -- 172.21.15.96:0/3017616184 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f50e80388c0 msgr2=0x7f50e803ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:34:51.297 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:51.294+0000 7f5103e3d700 1 --2- 172.21.15.96:0/3017616184 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f50e80388c0 0x7f50e803ad70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f50ec006fd0 tx=0x7f50ec006e40 comp rx=0 tx=0).stop 2023-05-08T03:34:51.297 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:51.294+0000 7f5103e3d700 1 -- 172.21.15.96:0/3017616184 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50fc0fe470 msgr2=0x7f50fc193e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:34:51.297 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:51.294+0000 7f5103e3d700 1 --2- 172.21.15.96:0/3017616184 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50fc0fe470 0x7f50fc193e20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f50f8004f40 tx=0x7f50f80057c0 comp rx=0 tx=0).stop 2023-05-08T03:34:51.297 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:51.294+0000 7f5103e3d700 1 -- 172.21.15.96:0/3017616184 shutdown_connections 2023-05-08T03:34:51.297 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:51.294+0000 7f5103e3d700 1 --2- 172.21.15.96:0/3017616184 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f50e80388c0 0x7f50e803ad70 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:51.297 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:51.294+0000 7f5103e3d700 1 --2- 172.21.15.96:0/3017616184 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50fc0fe470 0x7f50fc193e20 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:51.297 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:51.294+0000 7f5103e3d700 1 -- 172.21.15.96:0/3017616184 >> 172.21.15.96:0/3017616184 conn(0x7f50fc0f9ae0 msgr2=0x7f50fc0fa740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:34:51.298 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:51.294+0000 7f5103e3d700 1 -- 172.21.15.96:0/3017616184 shutdown_connections 2023-05-08T03:34:51.298 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:51.294+0000 7f5103e3d700 1 -- 172.21.15.96:0/3017616184 wait complete. 2023-05-08T03:34:51.754 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi133 2023-05-08T03:34:51.754 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-05-08T03:34:51.755 DEBUG:teuthology.orchestra.run.smithi133:> dd of=/etc/ceph/ceph.conf 2023-05-08T03:34:51.775 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-05-08T03:34:51.775 DEBUG:teuthology.orchestra.run.smithi133:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-05-08T03:34:51.834 INFO:tasks.cephadm:Adding host smithi133 to orchestrator... 2023-05-08T03:34:51.835 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- ceph orch host add smithi133 2023-05-08T03:34:52.499 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.a/config 2023-05-08T03:34:52.677 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:52 smithi096 ceph-mon[124666]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:34:52.678 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:52 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:34:52.678 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:52 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:34:52.678 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:52 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:34:52.678 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:52 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:34:52.678 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:52 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:34:52.679 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:52 smithi096 ceph-mon[124666]: Updating smithi096:/etc/ceph/ceph.conf 2023-05-08T03:34:52.679 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:52 smithi096 ceph-mon[124666]: Updating smithi096:/var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/config/ceph.conf 2023-05-08T03:34:52.679 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:52 smithi096 ceph-mon[124666]: Updating smithi096:/etc/ceph/ceph.client.admin.keyring 2023-05-08T03:34:52.679 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:52 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:34:52.679 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:52 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:34:52.679 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:52 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:34:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:53 smithi096 ceph-mon[124666]: Updating smithi096:/var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/config/ceph.client.admin.keyring 2023-05-08T03:34:54.019 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:54.016+0000 7f46beacd700 1 -- 172.21.15.96:0/2140499587 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46b80ff080 msgr2=0x7f46b80ff450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:34:54.019 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:54.016+0000 7f46beacd700 1 --2- 172.21.15.96:0/2140499587 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46b80ff080 0x7f46b80ff450 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f46ac009910 tx=0x7f46ac009c20 comp rx=0 tx=0).stop 2023-05-08T03:34:54.020 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:54.016+0000 7f46beacd700 1 -- 172.21.15.96:0/2140499587 shutdown_connections 2023-05-08T03:34:54.020 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:54.016+0000 7f46beacd700 1 --2- 172.21.15.96:0/2140499587 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46b80ff080 0x7f46b80ff450 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:54.020 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:54.016+0000 7f46beacd700 1 -- 172.21.15.96:0/2140499587 >> 172.21.15.96:0/2140499587 conn(0x7f46b80fa980 msgr2=0x7f46b80fcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:34:54.020 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:54.016+0000 7f46beacd700 1 -- 172.21.15.96:0/2140499587 shutdown_connections 2023-05-08T03:34:54.020 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:54.016+0000 7f46beacd700 1 -- 172.21.15.96:0/2140499587 wait complete. 2023-05-08T03:34:54.020 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:54.017+0000 7f46beacd700 1 Processor -- start 2023-05-08T03:34:54.020 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:54.017+0000 7f46beacd700 1 -- start start 2023-05-08T03:34:54.022 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:54.017+0000 7f46beacd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46b80ff080 0x7f46b8194180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:34:54.022 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:54.017+0000 7f46beacd700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b81946c0 con 0x7f46b80ff080 2023-05-08T03:34:54.022 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:54.017+0000 7f46bc869700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46b80ff080 0x7f46b8194180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:34:54.022 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:54.017+0000 7f46bc869700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46b80ff080 0x7f46b8194180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39468/0 (socket says 172.21.15.96:39468) 2023-05-08T03:34:54.023 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:54.017+0000 7f46bc869700 1 -- 172.21.15.96:0/687638855 learned_addr learned my addr 172.21.15.96:0/687638855 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:34:54.023 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:54.018+0000 7f46bc869700 1 -- 172.21.15.96:0/687638855 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46ac0095f0 con 0x7f46b80ff080 2023-05-08T03:34:54.023 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:54.018+0000 7f46bc869700 1 --2- 172.21.15.96:0/687638855 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46b80ff080 0x7f46b8194180 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f46ac004f40 tx=0x7f46ac005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:34:54.023 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:54.018+0000 7f46b5ffb700 1 -- 172.21.15.96:0/687638855 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f46ac01d070 con 0x7f46b80ff080 2023-05-08T03:34:54.023 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:54.018+0000 7f46b5ffb700 1 -- 172.21.15.96:0/687638855 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f46ac004370 con 0x7f46b80ff080 2023-05-08T03:34:54.023 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:54.018+0000 7f46b5ffb700 1 -- 172.21.15.96:0/687638855 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f46ac0039b0 con 0x7f46b80ff080 2023-05-08T03:34:54.024 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:54.018+0000 7f46beacd700 1 -- 172.21.15.96:0/687638855 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46b8109260 con 0x7f46b80ff080 2023-05-08T03:34:54.024 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:54.018+0000 7f46beacd700 1 -- 172.21.15.96:0/687638855 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46b81090d0 con 0x7f46b80ff080 2023-05-08T03:34:54.024 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:54.019+0000 7f46b5ffb700 1 -- 172.21.15.96:0/687638855 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 13) v1 ==== 45539+0+0 (secure 0 0 0) 0x7f46ac003c20 con 0x7f46b80ff080 2023-05-08T03:34:54.024 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:54.019+0000 7f46beacd700 1 -- 172.21.15.96:0/687638855 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46b81093f0 con 0x7f46b80ff080 2023-05-08T03:34:54.024 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:54.019+0000 7f46b5ffb700 1 --2- 172.21.15.96:0/687638855 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f46a80388c0 0x7f46a803ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:34:54.024 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:54.019+0000 7f46b5ffb700 1 -- 172.21.15.96:0/687638855 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f46ac04c4f0 con 0x7f46b80ff080 2023-05-08T03:34:54.024 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:54.019+0000 7f46b7fff700 1 --2- 172.21.15.96:0/687638855 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f46a80388c0 0x7f46a803ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:34:54.025 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:54.020+0000 7f46b7fff700 1 --2- 172.21.15.96:0/687638855 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f46a80388c0 0x7f46a803ad70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f46a4006fd0 tx=0x7f46a4006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:34:54.026 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:54.024+0000 7f46b5ffb700 1 -- 172.21.15.96:0/687638855 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f46ac02a980 con 0x7f46b80ff080 2023-05-08T03:34:54.216 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:54.214+0000 7f46beacd700 1 -- 172.21.15.96:0/687638855 --> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi133", "target": ["mon-mgr", ""]}) v1 -- 0x7f46b81071c0 con 0x7f46a80388c0 2023-05-08T03:34:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:54 smithi096 ceph-mon[124666]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi133", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:34:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:54 smithi096 ceph-mon[124666]: Deploying cephadm binary to smithi133 2023-05-08T03:34:56.313 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:56.311+0000 7f46b5ffb700 1 -- 172.21.15.96:0/687638855 <== mgr.14152 v2:172.21.15.96:6800/2748629182 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f46b81071c0 con 0x7f46a80388c0 2023-05-08T03:34:56.314 INFO:teuthology.orchestra.run.smithi096.stdout:Added host 'smithi133' with addr '172.21.15.133' 2023-05-08T03:34:56.315 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:56.313+0000 7f46beacd700 1 -- 172.21.15.96:0/687638855 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f46a80388c0 msgr2=0x7f46a803ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:34:56.316 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:56.313+0000 7f46beacd700 1 --2- 172.21.15.96:0/687638855 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f46a80388c0 0x7f46a803ad70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f46a4006fd0 tx=0x7f46a4006e40 comp rx=0 tx=0).stop 2023-05-08T03:34:56.316 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:56.313+0000 7f46beacd700 1 -- 172.21.15.96:0/687638855 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46b80ff080 msgr2=0x7f46b8194180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:34:56.316 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:56.313+0000 7f46beacd700 1 --2- 172.21.15.96:0/687638855 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46b80ff080 0x7f46b8194180 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f46ac004f40 tx=0x7f46ac005020 comp rx=0 tx=0).stop 2023-05-08T03:34:56.316 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:56.313+0000 7f46beacd700 1 -- 172.21.15.96:0/687638855 shutdown_connections 2023-05-08T03:34:56.316 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:56.313+0000 7f46beacd700 1 --2- 172.21.15.96:0/687638855 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f46a80388c0 0x7f46a803ad70 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:56.316 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:56.313+0000 7f46beacd700 1 --2- 172.21.15.96:0/687638855 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46b80ff080 0x7f46b8194180 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:56.317 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:56.313+0000 7f46beacd700 1 -- 172.21.15.96:0/687638855 >> 172.21.15.96:0/687638855 conn(0x7f46b80fa980 msgr2=0x7f46b8103260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:34:56.317 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:56.313+0000 7f46beacd700 1 -- 172.21.15.96:0/687638855 shutdown_connections 2023-05-08T03:34:56.317 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:56.313+0000 7f46beacd700 1 -- 172.21.15.96:0/687638855 wait complete. 2023-05-08T03:34:56.745 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- ceph orch host ls --format=json 2023-05-08T03:34:57.387 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.a/config 2023-05-08T03:34:57.584 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:57 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:34:57.584 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:57 smithi096 ceph-mon[124666]: Added host smithi133 2023-05-08T03:34:57.584 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:57 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:34:57.584 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:57 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:34:58.617 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:58.614+0000 7f65fcd3a700 1 -- 172.21.15.96:0/2484226255 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65f81010e0 msgr2=0x7f65f81014b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:34:58.618 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:58.614+0000 7f65fcd3a700 1 --2- 172.21.15.96:0/2484226255 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65f81010e0 0x7f65f81014b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f65e8009910 tx=0x7f65e8009c20 comp rx=0 tx=0).stop 2023-05-08T03:34:58.618 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:58.615+0000 7f65fcd3a700 1 -- 172.21.15.96:0/2484226255 shutdown_connections 2023-05-08T03:34:58.618 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:58.615+0000 7f65fcd3a700 1 --2- 172.21.15.96:0/2484226255 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65f81010e0 0x7f65f81014b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:58.618 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:58.615+0000 7f65fcd3a700 1 -- 172.21.15.96:0/2484226255 >> 172.21.15.96:0/2484226255 conn(0x7f65f80fa980 msgr2=0x7f65f80fcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:34:58.618 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:58.615+0000 7f65fcd3a700 1 -- 172.21.15.96:0/2484226255 shutdown_connections 2023-05-08T03:34:58.618 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:58.615+0000 7f65fcd3a700 1 -- 172.21.15.96:0/2484226255 wait complete. 2023-05-08T03:34:58.619 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:58.615+0000 7f65fcd3a700 1 Processor -- start 2023-05-08T03:34:58.619 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:58.615+0000 7f65fcd3a700 1 -- start start 2023-05-08T03:34:58.620 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:58.616+0000 7f65fcd3a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65f81010e0 0x7f65f80fed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:34:58.620 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:58.616+0000 7f65fcd3a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f8100cc0 con 0x7f65f81010e0 2023-05-08T03:34:58.620 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:58.616+0000 7f65f659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65f81010e0 0x7f65f80fed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:34:58.621 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:58.616+0000 7f65f659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65f81010e0 0x7f65f80fed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39494/0 (socket says 172.21.15.96:39494) 2023-05-08T03:34:58.621 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:58.616+0000 7f65f659c700 1 -- 172.21.15.96:0/1556819611 learned_addr learned my addr 172.21.15.96:0/1556819611 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:34:58.621 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:58.616+0000 7f65f659c700 1 -- 172.21.15.96:0/1556819611 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65e80095f0 con 0x7f65f81010e0 2023-05-08T03:34:58.621 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:58.616+0000 7f65f659c700 1 --2- 172.21.15.96:0/1556819611 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65f81010e0 0x7f65f80fed40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f65e8004f40 tx=0x7f65e8005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:34:58.621 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:58.616+0000 7f65e77fe700 1 -- 172.21.15.96:0/1556819611 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f65e801d070 con 0x7f65f81010e0 2023-05-08T03:34:58.621 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:58.616+0000 7f65e77fe700 1 -- 172.21.15.96:0/1556819611 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f65e8004370 con 0x7f65f81010e0 2023-05-08T03:34:58.622 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:58.616+0000 7f65e77fe700 1 -- 172.21.15.96:0/1556819611 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f65e80039b0 con 0x7f65f81010e0 2023-05-08T03:34:58.622 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:58.616+0000 7f65fcd3a700 1 -- 172.21.15.96:0/1556819611 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65f810a3e0 con 0x7f65f81010e0 2023-05-08T03:34:58.622 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:58.616+0000 7f65fcd3a700 1 -- 172.21.15.96:0/1556819611 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65f810a250 con 0x7f65f81010e0 2023-05-08T03:34:58.622 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:58.617+0000 7f65e77fe700 1 -- 172.21.15.96:0/1556819611 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 13) v1 ==== 45539+0+0 (secure 0 0 0) 0x7f65e8003c70 con 0x7f65f81010e0 2023-05-08T03:34:58.622 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:58.617+0000 7f65fcd3a700 1 -- 172.21.15.96:0/1556819611 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65f810a570 con 0x7f65f81010e0 2023-05-08T03:34:58.622 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:58.617+0000 7f65e77fe700 1 --2- 172.21.15.96:0/1556819611 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f65e0038870 0x7f65e003ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:34:58.622 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:58.617+0000 7f65e77fe700 1 -- 172.21.15.96:0/1556819611 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f65e804c690 con 0x7f65f81010e0 2023-05-08T03:34:58.622 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:58.617+0000 7f65f5d9b700 1 --2- 172.21.15.96:0/1556819611 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f65e0038870 0x7f65e003ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:34:58.623 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:58.618+0000 7f65f5d9b700 1 --2- 172.21.15.96:0/1556819611 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f65e0038870 0x7f65e003ad20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f65ec006fd0 tx=0x7f65ec006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:34:58.624 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:58.622+0000 7f65e77fe700 1 -- 172.21.15.96:0/1556819611 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f65e8029360 con 0x7f65f81010e0 2023-05-08T03:34:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:58 smithi096 ceph-mon[124666]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:34:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:58 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:34:58.818 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:58.816+0000 7f65fcd3a700 1 -- 172.21.15.96:0/1556819611 --> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f65f8100270 con 0x7f65e0038870 2023-05-08T03:34:58.819 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:58.817+0000 7f65e77fe700 1 -- 172.21.15.96:0/1556819611 <== mgr.14152 v2:172.21.15.96:6800/2748629182 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+160 (secure 0 0 0) 0x7f65f8100270 con 0x7f65e0038870 2023-05-08T03:34:58.819 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:34:58.820 INFO:teuthology.orchestra.run.smithi096.stdout:[{"addr": "172.21.15.96", "hostname": "smithi096", "labels": [], "status": ""}, {"addr": "172.21.15.133", "hostname": "smithi133", "labels": [], "status": ""}] 2023-05-08T03:34:58.821 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:58.819+0000 7f65fcd3a700 1 -- 172.21.15.96:0/1556819611 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f65e0038870 msgr2=0x7f65e003ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:34:58.821 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:58.819+0000 7f65fcd3a700 1 --2- 172.21.15.96:0/1556819611 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f65e0038870 0x7f65e003ad20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f65ec006fd0 tx=0x7f65ec006e40 comp rx=0 tx=0).stop 2023-05-08T03:34:58.822 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:58.819+0000 7f65fcd3a700 1 -- 172.21.15.96:0/1556819611 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65f81010e0 msgr2=0x7f65f80fed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:34:58.822 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:58.819+0000 7f65fcd3a700 1 --2- 172.21.15.96:0/1556819611 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65f81010e0 0x7f65f80fed40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f65e8004f40 tx=0x7f65e8005020 comp rx=0 tx=0).stop 2023-05-08T03:34:58.822 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:58.819+0000 7f65fcd3a700 1 -- 172.21.15.96:0/1556819611 shutdown_connections 2023-05-08T03:34:58.822 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:58.819+0000 7f65fcd3a700 1 --2- 172.21.15.96:0/1556819611 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f65e0038870 0x7f65e003ad20 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:58.822 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:58.819+0000 7f65fcd3a700 1 --2- 172.21.15.96:0/1556819611 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65f81010e0 0x7f65f80fed40 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:34:58.822 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:58.819+0000 7f65fcd3a700 1 -- 172.21.15.96:0/1556819611 >> 172.21.15.96:0/1556819611 conn(0x7f65f80fa980 msgr2=0x7f65f8104730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:34:58.822 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:58.819+0000 7f65fcd3a700 1 -- 172.21.15.96:0/1556819611 shutdown_connections 2023-05-08T03:34:58.823 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:34:58.819+0000 7f65fcd3a700 1 -- 172.21.15.96:0/1556819611 wait complete. 2023-05-08T03:34:59.228 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi186 2023-05-08T03:34:59.228 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2023-05-08T03:34:59.229 DEBUG:teuthology.orchestra.run.smithi186:> dd of=/etc/ceph/ceph.conf 2023-05-08T03:34:59.249 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2023-05-08T03:34:59.250 DEBUG:teuthology.orchestra.run.smithi186:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-05-08T03:34:59.309 INFO:tasks.cephadm:Adding host smithi186 to orchestrator... 2023-05-08T03:34:59.309 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- ceph orch host add smithi186 2023-05-08T03:34:59.946 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.a/config 2023-05-08T03:35:00.142 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:59 smithi096 ceph-mon[124666]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-05-08T03:35:00.142 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:34:59 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:00 smithi096 ceph-mon[124666]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:01.276 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:01.272+0000 7f15d224c700 1 -- 172.21.15.96:0/1701502450 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15cc0fee70 msgr2=0x7f15cc0ff240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:35:01.277 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:01.272+0000 7f15d224c700 1 --2- 172.21.15.96:0/1701502450 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15cc0fee70 0x7f15cc0ff240 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f15bc009910 tx=0x7f15bc009c20 comp rx=0 tx=0).stop 2023-05-08T03:35:01.277 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:01.272+0000 7f15d224c700 1 -- 172.21.15.96:0/1701502450 shutdown_connections 2023-05-08T03:35:01.277 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:01.272+0000 7f15d224c700 1 --2- 172.21.15.96:0/1701502450 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15cc0fee70 0x7f15cc0ff240 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:35:01.277 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:01.272+0000 7f15d224c700 1 -- 172.21.15.96:0/1701502450 >> 172.21.15.96:0/1701502450 conn(0x7f15cc074450 msgr2=0x7f15cc074850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:35:01.277 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:01.273+0000 7f15d224c700 1 -- 172.21.15.96:0/1701502450 shutdown_connections 2023-05-08T03:35:01.277 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:01.273+0000 7f15d224c700 1 -- 172.21.15.96:0/1701502450 wait complete. 2023-05-08T03:35:01.278 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:01.273+0000 7f15d224c700 1 Processor -- start 2023-05-08T03:35:01.278 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:01.273+0000 7f15d224c700 1 -- start start 2023-05-08T03:35:01.278 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:01.273+0000 7f15d224c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15cc0fee70 0x7f15cc195360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:35:01.278 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:01.273+0000 7f15d224c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15cc1958a0 con 0x7f15cc0fee70 2023-05-08T03:35:01.278 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:01.274+0000 7f15cb7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15cc0fee70 0x7f15cc195360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:35:01.278 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:01.274+0000 7f15cb7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15cc0fee70 0x7f15cc195360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39500/0 (socket says 172.21.15.96:39500) 2023-05-08T03:35:01.278 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:01.274+0000 7f15cb7fe700 1 -- 172.21.15.96:0/1599937668 learned_addr learned my addr 172.21.15.96:0/1599937668 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:35:01.278 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:01.274+0000 7f15cb7fe700 1 -- 172.21.15.96:0/1599937668 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15bc0095f0 con 0x7f15cc0fee70 2023-05-08T03:35:01.279 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:01.274+0000 7f15cb7fe700 1 --2- 172.21.15.96:0/1599937668 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15cc0fee70 0x7f15cc195360 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f15bc004f40 tx=0x7f15bc005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:35:01.279 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:01.274+0000 7f15c8ff9700 1 -- 172.21.15.96:0/1599937668 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f15bc01d070 con 0x7f15cc0fee70 2023-05-08T03:35:01.279 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:01.274+0000 7f15c8ff9700 1 -- 172.21.15.96:0/1599937668 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f15bc004370 con 0x7f15cc0fee70 2023-05-08T03:35:01.279 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:01.274+0000 7f15d224c700 1 -- 172.21.15.96:0/1599937668 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15cc10a430 con 0x7f15cc0fee70 2023-05-08T03:35:01.279 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:01.274+0000 7f15c8ff9700 1 -- 172.21.15.96:0/1599937668 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f15bc0039b0 con 0x7f15cc0fee70 2023-05-08T03:35:01.279 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:01.274+0000 7f15d224c700 1 -- 172.21.15.96:0/1599937668 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15cc10a2a0 con 0x7f15cc0fee70 2023-05-08T03:35:01.280 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:01.275+0000 7f15c8ff9700 1 -- 172.21.15.96:0/1599937668 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 13) v1 ==== 45539+0+0 (secure 0 0 0) 0x7f15bc003c70 con 0x7f15cc0fee70 2023-05-08T03:35:01.280 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:01.275+0000 7f15d224c700 1 -- 172.21.15.96:0/1599937668 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15cc10a5c0 con 0x7f15cc0fee70 2023-05-08T03:35:01.280 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:01.275+0000 7f15c8ff9700 1 --2- 172.21.15.96:0/1599937668 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f15b4038870 0x7f15b403ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:35:01.281 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:01.275+0000 7f15c8ff9700 1 -- 172.21.15.96:0/1599937668 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f15bc04c5b0 con 0x7f15cc0fee70 2023-05-08T03:35:01.281 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:01.275+0000 7f15caffd700 1 --2- 172.21.15.96:0/1599937668 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f15b4038870 0x7f15b403ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:35:01.281 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:01.276+0000 7f15caffd700 1 --2- 172.21.15.96:0/1599937668 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f15b4038870 0x7f15b403ad20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f15c0006fd0 tx=0x7f15c0006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:35:01.282 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:01.280+0000 7f15c8ff9700 1 -- 172.21.15.96:0/1599937668 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f15bc029770 con 0x7f15cc0fee70 2023-05-08T03:35:01.473 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:01.471+0000 7f15d224c700 1 -- 172.21.15.96:0/1599937668 --> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi186", "target": ["mon-mgr", ""]}) v1 -- 0x7f15cc1076f0 con 0x7f15b4038870 2023-05-08T03:35:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:02 smithi096 ceph-mon[124666]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi186", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:35:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:02 smithi096 ceph-mon[124666]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:03.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:02 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:03.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:02 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:03.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:02 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:03.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:02 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:03.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:02 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi133", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:35:03.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:02 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:35:03.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:02 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:35:03.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:02 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:35:03.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:02 smithi096 ceph-mon[124666]: Updating smithi133:/etc/ceph/ceph.conf 2023-05-08T03:35:03.623 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:03.621+0000 7f15c8ff9700 1 -- 172.21.15.96:0/1599937668 <== mgr.14152 v2:172.21.15.96:6800/2748629182 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f15cc1076f0 con 0x7f15b4038870 2023-05-08T03:35:03.623 INFO:teuthology.orchestra.run.smithi096.stdout:Added host 'smithi186' with addr '172.21.15.186' 2023-05-08T03:35:03.625 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:03.623+0000 7f15d224c700 1 -- 172.21.15.96:0/1599937668 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f15b4038870 msgr2=0x7f15b403ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:35:03.625 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:03.623+0000 7f15d224c700 1 --2- 172.21.15.96:0/1599937668 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f15b4038870 0x7f15b403ad20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f15c0006fd0 tx=0x7f15c0006e40 comp rx=0 tx=0).stop 2023-05-08T03:35:03.626 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:03.623+0000 7f15d224c700 1 -- 172.21.15.96:0/1599937668 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15cc0fee70 msgr2=0x7f15cc195360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:35:03.626 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:03.623+0000 7f15d224c700 1 --2- 172.21.15.96:0/1599937668 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15cc0fee70 0x7f15cc195360 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f15bc004f40 tx=0x7f15bc005020 comp rx=0 tx=0).stop 2023-05-08T03:35:03.626 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:03.623+0000 7f15d224c700 1 -- 172.21.15.96:0/1599937668 shutdown_connections 2023-05-08T03:35:03.626 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:03.623+0000 7f15d224c700 1 --2- 172.21.15.96:0/1599937668 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f15b4038870 0x7f15b403ad20 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:35:03.626 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:03.623+0000 7f15d224c700 1 --2- 172.21.15.96:0/1599937668 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15cc0fee70 0x7f15cc195360 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:35:03.626 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:03.623+0000 7f15d224c700 1 -- 172.21.15.96:0/1599937668 >> 172.21.15.96:0/1599937668 conn(0x7f15cc074450 msgr2=0x7f15cc104a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:35:03.626 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:03.623+0000 7f15d224c700 1 -- 172.21.15.96:0/1599937668 shutdown_connections 2023-05-08T03:35:03.627 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:03.623+0000 7f15d224c700 1 -- 172.21.15.96:0/1599937668 wait complete. 2023-05-08T03:35:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:03 smithi096 ceph-mon[124666]: Updating smithi133:/var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/config/ceph.conf 2023-05-08T03:35:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:03 smithi096 ceph-mon[124666]: Deploying cephadm binary to smithi186 2023-05-08T03:35:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:03 smithi096 ceph-mon[124666]: Updating smithi133:/etc/ceph/ceph.client.admin.keyring 2023-05-08T03:35:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:03 smithi096 ceph-mon[124666]: Updating smithi133:/var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/config/ceph.client.admin.keyring 2023-05-08T03:35:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:03 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:03 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:03 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:03 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:03 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:35:04.007 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- ceph orch host ls --format=json 2023-05-08T03:35:04.662 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.a/config 2023-05-08T03:35:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:04 smithi096 ceph-mon[124666]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:04 smithi096 ceph-mon[124666]: Added host smithi186 2023-05-08T03:35:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:04 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:06.021 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:06.017+0000 7fd92d4a8700 1 -- 172.21.15.96:0/1665898621 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd928100ff0 msgr2=0x7fd9281013c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:35:06.021 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:06.017+0000 7fd92d4a8700 1 --2- 172.21.15.96:0/1665898621 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd928100ff0 0x7fd9281013c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd910009910 tx=0x7fd910009c20 comp rx=0 tx=0).stop 2023-05-08T03:35:06.021 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:06.017+0000 7fd92d4a8700 1 -- 172.21.15.96:0/1665898621 shutdown_connections 2023-05-08T03:35:06.021 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:06.017+0000 7fd92d4a8700 1 --2- 172.21.15.96:0/1665898621 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd928100ff0 0x7fd9281013c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:35:06.022 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:06.017+0000 7fd92d4a8700 1 -- 172.21.15.96:0/1665898621 >> 172.21.15.96:0/1665898621 conn(0x7fd9280fa850 msgr2=0x7fd9280fcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:35:06.022 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:06.017+0000 7fd92d4a8700 1 -- 172.21.15.96:0/1665898621 shutdown_connections 2023-05-08T03:35:06.022 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:06.017+0000 7fd92d4a8700 1 -- 172.21.15.96:0/1665898621 wait complete. 2023-05-08T03:35:06.022 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:06.018+0000 7fd92d4a8700 1 Processor -- start 2023-05-08T03:35:06.022 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:06.018+0000 7fd92d4a8700 1 -- start start 2023-05-08T03:35:06.022 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:06.018+0000 7fd92d4a8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd928100ff0 0x7fd9280fec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:35:06.022 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:06.018+0000 7fd92d4a8700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd928100bd0 con 0x7fd928100ff0 2023-05-08T03:35:06.023 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:06.018+0000 7fd926ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd928100ff0 0x7fd9280fec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:35:06.023 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:06.018+0000 7fd926ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd928100ff0 0x7fd9280fec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39526/0 (socket says 172.21.15.96:39526) 2023-05-08T03:35:06.023 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:06.018+0000 7fd926ffd700 1 -- 172.21.15.96:0/2708423793 learned_addr learned my addr 172.21.15.96:0/2708423793 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:35:06.023 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:06.018+0000 7fd926ffd700 1 -- 172.21.15.96:0/2708423793 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9100095f0 con 0x7fd928100ff0 2023-05-08T03:35:06.023 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:06.019+0000 7fd926ffd700 1 --2- 172.21.15.96:0/2708423793 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd928100ff0 0x7fd9280fec50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd910005850 tx=0x7fd910004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:35:06.023 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:06.019+0000 7fd91ffff700 1 -- 172.21.15.96:0/2708423793 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd91001d070 con 0x7fd928100ff0 2023-05-08T03:35:06.024 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:06.019+0000 7fd91ffff700 1 -- 172.21.15.96:0/2708423793 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd910004370 con 0x7fd928100ff0 2023-05-08T03:35:06.024 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:06.019+0000 7fd92d4a8700 1 -- 172.21.15.96:0/2708423793 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd92810a280 con 0x7fd928100ff0 2023-05-08T03:35:06.024 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:06.019+0000 7fd91ffff700 1 -- 172.21.15.96:0/2708423793 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd910003ab0 con 0x7fd928100ff0 2023-05-08T03:35:06.025 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:06.019+0000 7fd92d4a8700 1 -- 172.21.15.96:0/2708423793 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd92810a0f0 con 0x7fd928100ff0 2023-05-08T03:35:06.025 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:06.020+0000 7fd91ffff700 1 -- 172.21.15.96:0/2708423793 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 13) v1 ==== 45539+0+0 (secure 0 0 0) 0x7fd91000f460 con 0x7fd928100ff0 2023-05-08T03:35:06.025 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:06.020+0000 7fd91ffff700 1 --2- 172.21.15.96:0/2708423793 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fd914038870 0x7fd91403ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:35:06.025 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:06.020+0000 7fd91ffff700 1 -- 172.21.15.96:0/2708423793 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fd91004d4d0 con 0x7fd928100ff0 2023-05-08T03:35:06.025 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:06.020+0000 7fd9267fc700 1 --2- 172.21.15.96:0/2708423793 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fd914038870 0x7fd91403ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:35:06.025 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:06.020+0000 7fd92d4a8700 1 -- 172.21.15.96:0/2708423793 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd92810a410 con 0x7fd928100ff0 2023-05-08T03:35:06.025 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:06.020+0000 7fd9267fc700 1 --2- 172.21.15.96:0/2708423793 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fd914038870 0x7fd91403ad20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd918006fd0 tx=0x7fd918006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:35:06.027 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:06.025+0000 7fd91ffff700 1 -- 172.21.15.96:0/2708423793 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fd910026020 con 0x7fd928100ff0 2023-05-08T03:35:06.219 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:06.217+0000 7fd92d4a8700 1 -- 172.21.15.96:0/2708423793 --> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd928062290 con 0x7fd914038870 2023-05-08T03:35:06.220 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:06.218+0000 7fd91ffff700 1 -- 172.21.15.96:0/2708423793 <== mgr.14152 v2:172.21.15.96:6800/2748629182 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+240 (secure 0 0 0) 0x7fd928062290 con 0x7fd914038870 2023-05-08T03:35:06.221 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:35:06.221 INFO:teuthology.orchestra.run.smithi096.stdout:[{"addr": "172.21.15.96", "hostname": "smithi096", "labels": [], "status": ""}, {"addr": "172.21.15.133", "hostname": "smithi133", "labels": [], "status": ""}, {"addr": "172.21.15.186", "hostname": "smithi186", "labels": [], "status": ""}] 2023-05-08T03:35:06.223 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:06.220+0000 7fd92d4a8700 1 -- 172.21.15.96:0/2708423793 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fd914038870 msgr2=0x7fd91403ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:35:06.223 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:06.220+0000 7fd92d4a8700 1 --2- 172.21.15.96:0/2708423793 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fd914038870 0x7fd91403ad20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd918006fd0 tx=0x7fd918006e40 comp rx=0 tx=0).stop 2023-05-08T03:35:06.223 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:06.220+0000 7fd92d4a8700 1 -- 172.21.15.96:0/2708423793 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd928100ff0 msgr2=0x7fd9280fec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:35:06.223 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:06.220+0000 7fd92d4a8700 1 --2- 172.21.15.96:0/2708423793 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd928100ff0 0x7fd9280fec50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd910005850 tx=0x7fd910004ff0 comp rx=0 tx=0).stop 2023-05-08T03:35:06.223 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:06.220+0000 7fd92d4a8700 1 -- 172.21.15.96:0/2708423793 shutdown_connections 2023-05-08T03:35:06.224 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:06.220+0000 7fd92d4a8700 1 --2- 172.21.15.96:0/2708423793 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fd914038870 0x7fd91403ad20 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:35:06.224 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:06.220+0000 7fd92d4a8700 1 --2- 172.21.15.96:0/2708423793 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd928100ff0 0x7fd9280fec50 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:35:06.224 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:06.220+0000 7fd92d4a8700 1 -- 172.21.15.96:0/2708423793 >> 172.21.15.96:0/2708423793 conn(0x7fd9280fa850 msgr2=0x7fd928104640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:35:06.224 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:06.220+0000 7fd92d4a8700 1 -- 172.21.15.96:0/2708423793 shutdown_connections 2023-05-08T03:35:06.224 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:06.221+0000 7fd92d4a8700 1 -- 172.21.15.96:0/2708423793 wait complete. 2023-05-08T03:35:06.250 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:05 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:06.620 INFO:tasks.cephadm:Setting crush tunables to default 2023-05-08T03:35:06.621 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- ceph osd crush tunables default 2023-05-08T03:35:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:06 smithi096 ceph-mon[124666]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:06 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:07.262 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.a/config 2023-05-08T03:35:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:07 smithi096 ceph-mon[124666]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-05-08T03:35:08.489 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:08.484+0000 7f3bf399a700 1 -- 172.21.15.96:0/2719574997 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3bec100090 msgr2=0x7f3bec100460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:35:08.489 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:08.484+0000 7f3bf399a700 1 --2- 172.21.15.96:0/2719574997 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3bec100090 0x7f3bec100460 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc009910 tx=0x7f3bdc009c20 comp rx=0 tx=0).stop 2023-05-08T03:35:08.489 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:08.484+0000 7f3bf399a700 1 -- 172.21.15.96:0/2719574997 shutdown_connections 2023-05-08T03:35:08.490 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:08.484+0000 7f3bf399a700 1 --2- 172.21.15.96:0/2719574997 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3bec100090 0x7f3bec100460 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:35:08.490 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:08.484+0000 7f3bf399a700 1 -- 172.21.15.96:0/2719574997 >> 172.21.15.96:0/2719574997 conn(0x7f3bec0fb970 msgr2=0x7f3bec0fdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:35:08.490 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:08.484+0000 7f3bf399a700 1 -- 172.21.15.96:0/2719574997 shutdown_connections 2023-05-08T03:35:08.490 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:08.484+0000 7f3bf399a700 1 -- 172.21.15.96:0/2719574997 wait complete. 2023-05-08T03:35:08.491 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:08.485+0000 7f3bf399a700 1 Processor -- start 2023-05-08T03:35:08.491 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:08.485+0000 7f3bf399a700 1 -- start start 2023-05-08T03:35:08.491 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:08.485+0000 7f3bf399a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3bec100090 0x7f3bec1952b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:35:08.492 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:08.485+0000 7f3bf399a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bec1957f0 con 0x7f3bec100090 2023-05-08T03:35:08.492 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:08.485+0000 7f3bf1736700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3bec100090 0x7f3bec1952b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:35:08.492 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:08.485+0000 7f3bf1736700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3bec100090 0x7f3bec1952b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39532/0 (socket says 172.21.15.96:39532) 2023-05-08T03:35:08.492 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:08.485+0000 7f3bf1736700 1 -- 172.21.15.96:0/1186493892 learned_addr learned my addr 172.21.15.96:0/1186493892 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:35:08.493 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:08.486+0000 7f3bf1736700 1 -- 172.21.15.96:0/1186493892 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bdc0095f0 con 0x7f3bec100090 2023-05-08T03:35:08.493 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:08.486+0000 7f3bf1736700 1 --2- 172.21.15.96:0/1186493892 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3bec100090 0x7f3bec1952b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc004f40 tx=0x7f3bdc005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:35:08.493 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:08.486+0000 7f3be27fc700 1 -- 172.21.15.96:0/1186493892 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3bdc01d070 con 0x7f3bec100090 2023-05-08T03:35:08.494 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:08.486+0000 7f3be27fc700 1 -- 172.21.15.96:0/1186493892 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3bdc004370 con 0x7f3bec100090 2023-05-08T03:35:08.494 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:08.486+0000 7f3be27fc700 1 -- 172.21.15.96:0/1186493892 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3bdc0039b0 con 0x7f3bec100090 2023-05-08T03:35:08.494 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:08.486+0000 7f3bf399a700 1 -- 172.21.15.96:0/1186493892 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bec10a270 con 0x7f3bec100090 2023-05-08T03:35:08.495 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:08.486+0000 7f3bf399a700 1 -- 172.21.15.96:0/1186493892 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bec10a0e0 con 0x7f3bec100090 2023-05-08T03:35:08.496 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:08.487+0000 7f3be27fc700 1 -- 172.21.15.96:0/1186493892 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 13) v1 ==== 45539+0+0 (secure 0 0 0) 0x7f3bdc003c70 con 0x7f3bec100090 2023-05-08T03:35:08.496 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:08.487+0000 7f3be27fc700 1 --2- 172.21.15.96:0/1186493892 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f3bd8038870 0x7f3bd803ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:35:08.496 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:08.487+0000 7f3be27fc700 1 -- 172.21.15.96:0/1186493892 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f3bdc04c560 con 0x7f3bec100090 2023-05-08T03:35:08.497 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:08.487+0000 7f3bf399a700 1 -- 172.21.15.96:0/1186493892 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bec10a400 con 0x7f3bec100090 2023-05-08T03:35:08.497 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:08.487+0000 7f3bf0f35700 1 --2- 172.21.15.96:0/1186493892 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f3bd8038870 0x7f3bd803ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:35:08.497 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:08.487+0000 7f3bf0f35700 1 --2- 172.21.15.96:0/1186493892 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f3bd8038870 0x7f3bd803ad20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3be8006fd0 tx=0x7f3be8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:35:08.497 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:08.492+0000 7f3be27fc700 1 -- 172.21.15.96:0/1186493892 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f3bdc026020 con 0x7f3bec100090 2023-05-08T03:35:08.689 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:08.687+0000 7f3bf399a700 1 -- 172.21.15.96:0/1186493892 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f3bec062220 con 0x7f3bec100090 2023-05-08T03:35:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:08 smithi096 ceph-mon[124666]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:08 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/1186493892' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-05-08T03:35:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:08 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:08 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:08 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:09.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:08 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:09.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:08 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi186", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:35:09.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:08 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:35:09.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:08 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:35:09.260 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:09.257+0000 7f3be27fc700 1 -- 172.21.15.96:0/1186493892 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f3bdc02b440 con 0x7f3bec100090 2023-05-08T03:35:09.262 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:09.259+0000 7f3bf399a700 1 -- 172.21.15.96:0/1186493892 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f3bd8038870 msgr2=0x7f3bd803ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:35:09.262 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:09.259+0000 7f3bf399a700 1 --2- 172.21.15.96:0/1186493892 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f3bd8038870 0x7f3bd803ad20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3be8006fd0 tx=0x7f3be8006e40 comp rx=0 tx=0).stop 2023-05-08T03:35:09.262 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:09.259+0000 7f3bf399a700 1 -- 172.21.15.96:0/1186493892 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3bec100090 msgr2=0x7f3bec1952b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:35:09.262 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:09.259+0000 7f3bf399a700 1 --2- 172.21.15.96:0/1186493892 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3bec100090 0x7f3bec1952b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc004f40 tx=0x7f3bdc005020 comp rx=0 tx=0).stop 2023-05-08T03:35:09.262 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:09.260+0000 7f3bf399a700 1 -- 172.21.15.96:0/1186493892 shutdown_connections 2023-05-08T03:35:09.262 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:09.260+0000 7f3bf399a700 1 --2- 172.21.15.96:0/1186493892 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f3bd8038870 0x7f3bd803ad20 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:35:09.263 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:09.260+0000 7f3bf399a700 1 --2- 172.21.15.96:0/1186493892 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3bec100090 0x7f3bec1952b0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:35:09.263 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:09.260+0000 7f3bf399a700 1 -- 172.21.15.96:0/1186493892 >> 172.21.15.96:0/1186493892 conn(0x7f3bec0fb970 msgr2=0x7f3bec104270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:35:09.263 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:09.260+0000 7f3bf399a700 1 -- 172.21.15.96:0/1186493892 shutdown_connections 2023-05-08T03:35:09.263 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:09.260+0000 7f3bf399a700 1 -- 172.21.15.96:0/1186493892 wait complete. 2023-05-08T03:35:09.263 INFO:teuthology.orchestra.run.smithi096.stderr:adjusted tunables profile to default 2023-05-08T03:35:09.718 INFO:tasks.cephadm:Adding mon.a on smithi096 2023-05-08T03:35:09.719 INFO:tasks.cephadm:Adding mon.b on smithi133 2023-05-08T03:35:09.719 INFO:tasks.cephadm:Adding mon.c on smithi186 2023-05-08T03:35:09.719 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- ceph orch apply mon '3;smithi096:172.21.15.96=a;smithi133:172.21.15.133=b;smithi186:172.21.15.186=c' 2023-05-08T03:35:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:09 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:35:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:09 smithi096 ceph-mon[124666]: Updating smithi186:/etc/ceph/ceph.conf 2023-05-08T03:35:10.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:09 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/1186493892' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-05-08T03:35:10.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:09 smithi096 ceph-mon[124666]: osdmap e4: 0 total, 0 up, 0 in 2023-05-08T03:35:10.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:09 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:10.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:09 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:10.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:09 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:10.386 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/config/ceph.conf 2023-05-08T03:35:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:10 smithi096 ceph-mon[124666]: Updating smithi186:/var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/config/ceph.conf 2023-05-08T03:35:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:10 smithi096 ceph-mon[124666]: Updating smithi186:/etc/ceph/ceph.client.admin.keyring 2023-05-08T03:35:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:10 smithi096 ceph-mon[124666]: Updating smithi186:/var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/config/ceph.client.admin.keyring 2023-05-08T03:35:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:10 smithi096 ceph-mon[124666]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:11.615 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:11.611+0000 7fcdd3da8700 1 -- 172.21.15.186:0/3304059061 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcdcc0ff080 msgr2=0x7fcdcc0ff450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:35:11.615 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:11.611+0000 7fcdd3da8700 1 --2- 172.21.15.186:0/3304059061 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcdcc0ff080 0x7fcdcc0ff450 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcdc8009910 tx=0x7fcdc8009c20 comp rx=0 tx=0).stop 2023-05-08T03:35:11.615 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:11.611+0000 7fcdd3da8700 1 -- 172.21.15.186:0/3304059061 shutdown_connections 2023-05-08T03:35:11.616 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:11.611+0000 7fcdd3da8700 1 --2- 172.21.15.186:0/3304059061 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcdcc0ff080 0x7fcdcc0ff450 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:35:11.616 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:11.611+0000 7fcdd3da8700 1 -- 172.21.15.186:0/3304059061 >> 172.21.15.186:0/3304059061 conn(0x7fcdcc0fa980 msgr2=0x7fcdcc0fcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:35:11.616 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:11.611+0000 7fcdd3da8700 1 -- 172.21.15.186:0/3304059061 shutdown_connections 2023-05-08T03:35:11.616 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:11.611+0000 7fcdd3da8700 1 -- 172.21.15.186:0/3304059061 wait complete. 2023-05-08T03:35:11.616 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:11.612+0000 7fcdd3da8700 1 Processor -- start 2023-05-08T03:35:11.616 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:11.612+0000 7fcdd3da8700 1 -- start start 2023-05-08T03:35:11.616 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:11.612+0000 7fcdd3da8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcdcc0ff080 0x7fcdcc1960f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:35:11.617 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:11.612+0000 7fcdd3da8700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdcc196630 con 0x7fcdcc0ff080 2023-05-08T03:35:11.617 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:11.612+0000 7fcdd1b44700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcdcc0ff080 0x7fcdcc1960f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:35:11.617 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:11.612+0000 7fcdd1b44700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcdcc0ff080 0x7fcdcc1960f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.186:38616/0 (socket says 172.21.15.186:38616) 2023-05-08T03:35:11.617 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:11.612+0000 7fcdd1b44700 1 -- 172.21.15.186:0/3923695934 learned_addr learned my addr 172.21.15.186:0/3923695934 (peer_addr_for_me v2:172.21.15.186:0/0) 2023-05-08T03:35:11.617 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:11.612+0000 7fcdd1b44700 1 -- 172.21.15.186:0/3923695934 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdc80095f0 con 0x7fcdcc0ff080 2023-05-08T03:35:11.618 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:11.613+0000 7fcdd1b44700 1 --2- 172.21.15.186:0/3923695934 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcdcc0ff080 0x7fcdcc1960f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcdc8006010 tx=0x7fcdc8004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:35:11.618 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:11.613+0000 7fcdc2ffd700 1 -- 172.21.15.186:0/3923695934 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcdc801d070 con 0x7fcdcc0ff080 2023-05-08T03:35:11.619 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:11.613+0000 7fcdc2ffd700 1 -- 172.21.15.186:0/3923695934 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcdc800bc10 con 0x7fcdcc0ff080 2023-05-08T03:35:11.619 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:11.613+0000 7fcdd3da8700 1 -- 172.21.15.186:0/3923695934 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdcc109260 con 0x7fcdcc0ff080 2023-05-08T03:35:11.619 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:11.613+0000 7fcdc2ffd700 1 -- 172.21.15.186:0/3923695934 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcdc8003910 con 0x7fcdcc0ff080 2023-05-08T03:35:11.619 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:11.613+0000 7fcdd3da8700 1 -- 172.21.15.186:0/3923695934 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdcc1090d0 con 0x7fcdcc0ff080 2023-05-08T03:35:11.619 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:11.614+0000 7fcdd3da8700 1 -- 172.21.15.186:0/3923695934 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdcc1093f0 con 0x7fcdcc0ff080 2023-05-08T03:35:11.619 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:11.614+0000 7fcdc2ffd700 1 -- 172.21.15.186:0/3923695934 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 13) v1 ==== 45539+0+0 (secure 0 0 0) 0x7fcdc800bd80 con 0x7fcdcc0ff080 2023-05-08T03:35:11.619 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:11.614+0000 7fcdc2ffd700 1 --2- 172.21.15.186:0/3923695934 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fcdb8038870 0x7fcdb803ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:35:11.619 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:11.614+0000 7fcdc2ffd700 1 -- 172.21.15.186:0/3923695934 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fcdc804c540 con 0x7fcdcc0ff080 2023-05-08T03:35:11.620 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:11.614+0000 7fcdd1343700 1 --2- 172.21.15.186:0/3923695934 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fcdb8038870 0x7fcdb803ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:35:11.620 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:11.615+0000 7fcdd1343700 1 --2- 172.21.15.186:0/3923695934 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fcdb8038870 0x7fcdb803ad20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc006fd0 tx=0x7fcdbc006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:35:11.622 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:11.619+0000 7fcdc2ffd700 1 -- 172.21.15.186:0/3923695934 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fcdc8029360 con 0x7fcdcc0ff080 2023-05-08T03:35:11.818 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:11.815+0000 7fcdd3da8700 1 -- 172.21.15.186:0/3923695934 --> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi096:172.21.15.96=a;smithi133:172.21.15.133=b;smithi186:172.21.15.186=c", "target": ["mon-mgr", ""]}) v1 -- 0x7fcdcc068d30 con 0x7fcdb8038870 2023-05-08T03:35:11.825 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:11.823+0000 7fcdc2ffd700 1 -- 172.21.15.186:0/3923695934 <== mgr.14152 v2:172.21.15.96:6800/2748629182 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fcdcc068d30 con 0x7fcdb8038870 2023-05-08T03:35:11.825 INFO:teuthology.orchestra.run.smithi186.stdout:Scheduled mon update... 2023-05-08T03:35:11.827 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:11.824+0000 7fcdd3da8700 1 -- 172.21.15.186:0/3923695934 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fcdb8038870 msgr2=0x7fcdb803ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:35:11.827 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:11.824+0000 7fcdd3da8700 1 --2- 172.21.15.186:0/3923695934 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fcdb8038870 0x7fcdb803ad20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc006fd0 tx=0x7fcdbc006e40 comp rx=0 tx=0).stop 2023-05-08T03:35:11.827 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:11.824+0000 7fcdd3da8700 1 -- 172.21.15.186:0/3923695934 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcdcc0ff080 msgr2=0x7fcdcc1960f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:35:11.827 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:11.824+0000 7fcdd3da8700 1 --2- 172.21.15.186:0/3923695934 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcdcc0ff080 0x7fcdcc1960f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcdc8006010 tx=0x7fcdc8004ff0 comp rx=0 tx=0).stop 2023-05-08T03:35:11.828 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:11.824+0000 7fcdd3da8700 1 -- 172.21.15.186:0/3923695934 shutdown_connections 2023-05-08T03:35:11.828 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:11.824+0000 7fcdd3da8700 1 --2- 172.21.15.186:0/3923695934 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fcdb8038870 0x7fcdb803ad20 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:35:11.828 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:11.824+0000 7fcdd3da8700 1 --2- 172.21.15.186:0/3923695934 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcdcc0ff080 0x7fcdcc1960f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:35:11.828 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:11.824+0000 7fcdd3da8700 1 -- 172.21.15.186:0/3923695934 >> 172.21.15.186:0/3923695934 conn(0x7fcdcc0fa980 msgr2=0x7fcdcc103260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:35:11.828 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:11.824+0000 7fcdd3da8700 1 -- 172.21.15.186:0/3923695934 shutdown_connections 2023-05-08T03:35:11.828 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:11.824+0000 7fcdd3da8700 1 -- 172.21.15.186:0/3923695934 wait complete. 2023-05-08T03:35:12.366 DEBUG:teuthology.orchestra.run.smithi133:mon.b> sudo journalctl -f -n 0 -u ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c@mon.b.service 2023-05-08T03:35:12.369 DEBUG:teuthology.orchestra.run.smithi186:mon.c> sudo journalctl -f -n 0 -u ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c@mon.c.service 2023-05-08T03:35:12.371 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-05-08T03:35:12.371 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- ceph mon dump -f json 2023-05-08T03:35:12.400 INFO:journalctl@ceph.mon.c.smithi186.stdout:-- Logs begin at Mon 2023-05-08 03:08:31 UTC. -- 2023-05-08T03:35:12.404 INFO:journalctl@ceph.mon.b.smithi133.stdout:-- Logs begin at Mon 2023-05-08 03:07:41 UTC. -- 2023-05-08T03:35:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:12 smithi096 ceph-mon[124666]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:13.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:12 smithi096 ceph-mon[124666]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi096:172.21.15.96=a;smithi133:172.21.15.133=b;smithi186:172.21.15.186=c", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:35:13.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:12 smithi096 ceph-mon[124666]: Saving service mon spec with placement smithi096:172.21.15.96=a;smithi133:172.21.15.133=b;smithi186:172.21.15.186=c;count:3 2023-05-08T03:35:13.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:12 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:13.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:12 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:35:13.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:12 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:35:13.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:12 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:35:13.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:12 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:35:13.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:12 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:13.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:12 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:35:13.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:12 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-05-08T03:35:13.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:12 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:35:13.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:12 smithi096 ceph-mon[124666]: Deploying daemon mon.c on smithi186 2023-05-08T03:35:13.487 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/config/ceph.conf 2023-05-08T03:35:15.150 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:15.146+0000 7fee95794700 1 -- 172.21.15.186:0/922183803 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee90100310 msgr2=0x7fee901006e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:35:15.151 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:15.146+0000 7fee95794700 1 --2- 172.21.15.186:0/922183803 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee90100310 0x7fee901006e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fee80009910 tx=0x7fee80009c20 comp rx=0 tx=0).stop 2023-05-08T03:35:15.151 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:15.146+0000 7fee95794700 1 -- 172.21.15.186:0/922183803 shutdown_connections 2023-05-08T03:35:15.151 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:15.146+0000 7fee95794700 1 --2- 172.21.15.186:0/922183803 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee90100310 0x7fee901006e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:35:15.151 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:15.146+0000 7fee95794700 1 -- 172.21.15.186:0/922183803 >> 172.21.15.186:0/922183803 conn(0x7fee90074450 msgr2=0x7fee90074850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:35:15.151 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:15.146+0000 7fee95794700 1 -- 172.21.15.186:0/922183803 shutdown_connections 2023-05-08T03:35:15.151 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:15.146+0000 7fee95794700 1 -- 172.21.15.186:0/922183803 wait complete. 2023-05-08T03:35:15.151 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:15.146+0000 7fee95794700 1 Processor -- start 2023-05-08T03:35:15.152 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:15.147+0000 7fee95794700 1 -- start start 2023-05-08T03:35:15.152 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:15.147+0000 7fee95794700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee90100310 0x7fee901962d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:35:15.152 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:15.147+0000 7fee95794700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee90196810 con 0x7fee90100310 2023-05-08T03:35:15.152 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:15.147+0000 7fee8effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee90100310 0x7fee901962d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:35:15.152 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:15.147+0000 7fee8effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee90100310 0x7fee901962d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.186:38622/0 (socket says 172.21.15.186:38622) 2023-05-08T03:35:15.152 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:15.147+0000 7fee8effd700 1 -- 172.21.15.186:0/1789392313 learned_addr learned my addr 172.21.15.186:0/1789392313 (peer_addr_for_me v2:172.21.15.186:0/0) 2023-05-08T03:35:15.152 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:15.147+0000 7fee8effd700 1 -- 172.21.15.186:0/1789392313 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee800095f0 con 0x7fee90100310 2023-05-08T03:35:15.152 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:15.148+0000 7fee8effd700 1 --2- 172.21.15.186:0/1789392313 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee90100310 0x7fee901962d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fee80004f40 tx=0x7fee80005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:35:15.153 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:15.148+0000 7fee77fff700 1 -- 172.21.15.186:0/1789392313 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fee8001d070 con 0x7fee90100310 2023-05-08T03:35:15.154 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:15.148+0000 7fee77fff700 1 -- 172.21.15.186:0/1789392313 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fee80004370 con 0x7fee90100310 2023-05-08T03:35:15.154 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:15.148+0000 7fee95794700 1 -- 172.21.15.186:0/1789392313 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee90108a20 con 0x7fee90100310 2023-05-08T03:35:15.154 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:15.148+0000 7fee77fff700 1 -- 172.21.15.186:0/1789392313 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fee800039b0 con 0x7fee90100310 2023-05-08T03:35:15.154 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:15.148+0000 7fee95794700 1 -- 172.21.15.186:0/1789392313 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee90108890 con 0x7fee90100310 2023-05-08T03:35:15.154 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:15.149+0000 7fee95794700 1 -- 172.21.15.186:0/1789392313 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee90108bb0 con 0x7fee90100310 2023-05-08T03:35:15.154 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:15.149+0000 7fee77fff700 1 -- 172.21.15.186:0/1789392313 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 13) v1 ==== 45539+0+0 (secure 0 0 0) 0x7fee80003c70 con 0x7fee90100310 2023-05-08T03:35:15.155 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:15.149+0000 7fee77fff700 1 --2- 172.21.15.186:0/1789392313 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fee78038870 0x7fee7803ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:35:15.155 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:15.149+0000 7fee77fff700 1 -- 172.21.15.186:0/1789392313 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fee8004c5d0 con 0x7fee90100310 2023-05-08T03:35:15.155 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:15.150+0000 7fee8e7fc700 1 --2- 172.21.15.186:0/1789392313 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fee78038870 0x7fee7803ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:35:15.155 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:15.150+0000 7fee8e7fc700 1 --2- 172.21.15.186:0/1789392313 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fee78038870 0x7fee7803ad20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fee84006fd0 tx=0x7fee84006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:35:15.158 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:15.155+0000 7fee77fff700 1 -- 172.21.15.186:0/1789392313 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fee80029770 con 0x7fee90100310 2023-05-08T03:35:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:14 smithi096 ceph-mon[124666]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:15.437 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:15.434+0000 7fee95794700 1 -- 172.21.15.186:0/1789392313 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fee90101760 con 0x7fee90100310 2023-05-08T03:35:15.438 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-05-08T03:35:15.438 INFO:teuthology.orchestra.run.smithi186.stdout:{"epoch":1,"fsid":"f7ffcfb0-ed50-11ed-9b01-001a4aab830c","modified":"2023-05-08T03:33:40.613031Z","created":"2023-05-08T03:33:40.613031Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-05-08T03:35:15.438 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:15.434+0000 7fee77fff700 1 -- 172.21.15.186:0/1789392313 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+736 (secure 0 0 0) 0x7fee80026030 con 0x7fee90100310 2023-05-08T03:35:15.439 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:15.436+0000 7fee95794700 1 -- 172.21.15.186:0/1789392313 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fee78038870 msgr2=0x7fee7803ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:35:15.439 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:15.436+0000 7fee95794700 1 --2- 172.21.15.186:0/1789392313 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fee78038870 0x7fee7803ad20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fee84006fd0 tx=0x7fee84006e40 comp rx=0 tx=0).stop 2023-05-08T03:35:15.440 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:15.436+0000 7fee95794700 1 -- 172.21.15.186:0/1789392313 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee90100310 msgr2=0x7fee901962d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:35:15.440 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:15.436+0000 7fee95794700 1 --2- 172.21.15.186:0/1789392313 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee90100310 0x7fee901962d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fee80004f40 tx=0x7fee80005020 comp rx=0 tx=0).stop 2023-05-08T03:35:15.440 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:15.437+0000 7fee95794700 1 -- 172.21.15.186:0/1789392313 shutdown_connections 2023-05-08T03:35:15.440 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:15.437+0000 7fee95794700 1 --2- 172.21.15.186:0/1789392313 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fee78038870 0x7fee7803ad20 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:35:15.440 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:15.437+0000 7fee95794700 1 --2- 172.21.15.186:0/1789392313 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee90100310 0x7fee901962d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:35:15.440 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:15.437+0000 7fee95794700 1 -- 172.21.15.186:0/1789392313 >> 172.21.15.186:0/1789392313 conn(0x7fee90074450 msgr2=0x7fee90106220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:35:15.440 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:15.437+0000 7fee95794700 1 -- 172.21.15.186:0/1789392313 shutdown_connections 2023-05-08T03:35:15.441 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:15.437+0000 7fee95794700 1 -- 172.21.15.186:0/1789392313 wait complete. 2023-05-08T03:35:15.441 INFO:teuthology.orchestra.run.smithi186.stderr:dumped monmap epoch 1 2023-05-08T03:35:15.548 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: mon.c@-1(???) e0 preinit fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c 2023-05-08T03:35:15.548 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: mon.c@-1(synchronizing).mds e1 new map 2023-05-08T03:35:15.549 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: mon.c@-1(synchronizing).mds e1 print_map 2023-05-08T03:35:15.549 INFO:journalctl@ceph.mon.c.smithi186.stdout: e1 2023-05-08T03:35:15.549 INFO:journalctl@ceph.mon.c.smithi186.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-05-08T03:35:15.549 INFO:journalctl@ceph.mon.c.smithi186.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-05-08T03:35:15.549 INFO:journalctl@ceph.mon.c.smithi186.stdout: legacy client fscid: -1 2023-05-08T03:35:15.549 INFO:journalctl@ceph.mon.c.smithi186.stdout: 2023-05-08T03:35:15.549 INFO:journalctl@ceph.mon.c.smithi186.stdout: No filesystems configured 2023-05-08T03:35:15.550 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2023-05-08T03:35:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2023-05-08T03:35:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2023-05-08T03:35:15.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2023-05-08T03:35:15.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2023-05-08T03:35:15.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2023-05-08T03:35:15.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2023-05-08T03:35:15.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-05-08T03:35:15.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-05-08T03:35:15.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-05-08T03:35:15.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi186", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:35:15.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:15.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:15.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:15.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:15.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:15.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi133", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:35:15.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:35:15.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:35:15.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:35:15.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: Updating smithi133:/etc/ceph/ceph.conf 2023-05-08T03:35:15.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: Updating smithi133:/var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/config/ceph.conf 2023-05-08T03:35:15.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: Deploying cephadm binary to smithi186 2023-05-08T03:35:15.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: Updating smithi133:/etc/ceph/ceph.client.admin.keyring 2023-05-08T03:35:15.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: Updating smithi133:/var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/config/ceph.client.admin.keyring 2023-05-08T03:35:15.873 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:15.873 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:15.873 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:15.873 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:15.873 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:35:15.873 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:15.873 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: Added host smithi186 2023-05-08T03:35:15.873 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:15.874 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:15.874 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:15.874 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:15.874 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-05-08T03:35:15.874 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:15.874 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/1186493892' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-05-08T03:35:15.874 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:15.875 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:15.875 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:15.875 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:15.875 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi186", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:35:15.875 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:35:15.875 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:35:15.875 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:35:15.875 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: Updating smithi186:/etc/ceph/ceph.conf 2023-05-08T03:35:15.876 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/1186493892' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-05-08T03:35:15.876 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: osdmap e4: 0 total, 0 up, 0 in 2023-05-08T03:35:15.876 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:15.876 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:15.876 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:15.876 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: Updating smithi186:/var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/config/ceph.conf 2023-05-08T03:35:15.876 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: Updating smithi186:/etc/ceph/ceph.client.admin.keyring 2023-05-08T03:35:15.876 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: Updating smithi186:/var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/config/ceph.client.admin.keyring 2023-05-08T03:35:15.877 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:15.877 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:15.877 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi096:172.21.15.96=a;smithi133:172.21.15.133=b;smithi186:172.21.15.186=c", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:35:15.877 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: Saving service mon spec with placement smithi096:172.21.15.96=a;smithi133:172.21.15.133=b;smithi186:172.21.15.186=c;count:3 2023-05-08T03:35:15.877 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:15.877 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:35:15.877 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:35:15.878 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:35:15.878 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:35:15.878 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:15.878 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:35:15.878 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-05-08T03:35:15.878 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:35:15.878 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: Deploying daemon mon.c on smithi186 2023-05-08T03:35:15.878 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:15.879 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2023-05-08T03:35:15.879 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: mon.c@-1(synchronizing) e1 handle_conf_change mon_allow_pool_delete 2023-05-08T03:35:15.879 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: expand_channel_meta expand map: {default=false} 2023-05-08T03:35:15.879 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: expand_channel_meta from 'false' to 'false' 2023-05-08T03:35:15.879 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: expand_channel_meta expanded map: {default=false} 2023-05-08T03:35:15.879 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: expand_channel_meta expand map: {default=info} 2023-05-08T03:35:15.879 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: expand_channel_meta from 'info' to 'info' 2023-05-08T03:35:15.879 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: expand_channel_meta expanded map: {default=info} 2023-05-08T03:35:15.880 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: expand_channel_meta expand map: {default=daemon} 2023-05-08T03:35:15.880 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: expand_channel_meta from 'daemon' to 'daemon' 2023-05-08T03:35:15.880 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: expand_channel_meta expanded map: {default=daemon} 2023-05-08T03:35:15.880 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: expand_channel_meta expand map: {default=debug} 2023-05-08T03:35:15.880 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: expand_channel_meta from 'debug' to 'debug' 2023-05-08T03:35:15.880 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 ceph-mon[126480]: expand_channel_meta expanded map: {default=debug} 2023-05-08T03:35:15.880 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 bash[126419]: b450874c0ceffba3f29390e6caea6e509ed9e80effab6590d1b119b915adf880 2023-05-08T03:35:15.880 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:15 smithi186 systemd[1]: Started Ceph mon.c for f7ffcfb0-ed50-11ed-9b01-001a4aab830c. 2023-05-08T03:35:16.955 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-05-08T03:35:16.955 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- ceph mon dump -f json 2023-05-08T03:35:17.606 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.c/config 2023-05-08T03:35:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:20 smithi096 ceph-mon[124666]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:20 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-05-08T03:35:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:20 smithi096 ceph-mon[124666]: mon.a calling monitor election 2023-05-08T03:35:21.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:20 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-05-08T03:35:21.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:20 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-05-08T03:35:21.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:20 smithi096 ceph-mon[124666]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:21.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:20 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-05-08T03:35:21.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:20 smithi096 ceph-mon[124666]: mon.c calling monitor election 2023-05-08T03:35:21.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:20 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-05-08T03:35:21.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:20 smithi096 ceph-mon[124666]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:21.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:20 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-05-08T03:35:21.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:20 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-05-08T03:35:21.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:20 smithi096 ceph-mon[124666]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-05-08T03:35:21.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:20 smithi096 ceph-mon[124666]: monmap e2: 2 mons at {a=[v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0],c=[v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0]} removed_ranks: {} 2023-05-08T03:35:21.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:20 smithi096 ceph-mon[124666]: fsmap 2023-05-08T03:35:21.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:20 smithi096 ceph-mon[124666]: osdmap e4: 0 total, 0 up, 0 in 2023-05-08T03:35:21.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:20 smithi096 ceph-mon[124666]: mgrmap e13: x(active, since 43s) 2023-05-08T03:35:21.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:20 smithi096 ceph-mon[124666]: overall HEALTH_OK 2023-05-08T03:35:21.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:20 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:21.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:20 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:21.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:20 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:21.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:20 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-05-08T03:35:21.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:20 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:35:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:20 smithi186 ceph-mon[126480]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:20 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-05-08T03:35:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:20 smithi186 ceph-mon[126480]: mon.a calling monitor election 2023-05-08T03:35:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:20 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-05-08T03:35:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:20 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-05-08T03:35:21.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:20 smithi186 ceph-mon[126480]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:21.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:20 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-05-08T03:35:21.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:20 smithi186 ceph-mon[126480]: mon.c calling monitor election 2023-05-08T03:35:21.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:20 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-05-08T03:35:21.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:20 smithi186 ceph-mon[126480]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:21.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:20 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-05-08T03:35:21.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:20 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-05-08T03:35:21.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:20 smithi186 ceph-mon[126480]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-05-08T03:35:21.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:20 smithi186 ceph-mon[126480]: monmap e2: 2 mons at {a=[v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0],c=[v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0]} removed_ranks: {} 2023-05-08T03:35:21.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:20 smithi186 ceph-mon[126480]: fsmap 2023-05-08T03:35:21.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:20 smithi186 ceph-mon[126480]: osdmap e4: 0 total, 0 up, 0 in 2023-05-08T03:35:21.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:20 smithi186 ceph-mon[126480]: mgrmap e13: x(active, since 43s) 2023-05-08T03:35:21.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:20 smithi186 ceph-mon[126480]: overall HEALTH_OK 2023-05-08T03:35:21.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:20 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:21.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:20 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:21.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:20 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:21.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:20 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-05-08T03:35:21.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:20 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:35:21.899 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:21.896+0000 7f8d2e4e8700 1 -- 172.21.15.186:0/3827845331 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d140035c0 msgr2=0x7f8d14005a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:35:21.899 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:21.896+0000 7f8d2e4e8700 1 --2- 172.21.15.186:0/3827845331 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d140035c0 0x7f8d14005a40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8d28076250 tx=0x7f8d1800fe60 comp rx=0 tx=0).stop 2023-05-08T03:35:21.899 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:21.896+0000 7f8d2e4e8700 1 -- 172.21.15.186:0/3827845331 shutdown_connections 2023-05-08T03:35:21.900 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:21.896+0000 7f8d2e4e8700 1 --2- 172.21.15.186:0/3827845331 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d140035c0 0x7f8d14005a40 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:35:21.900 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:21.896+0000 7f8d2e4e8700 1 -- 172.21.15.186:0/3827845331 >> 172.21.15.186:0/3827845331 conn(0x7f8d28074d40 msgr2=0x7f8d28075140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:35:21.900 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:21.896+0000 7f8d2e4e8700 1 -- 172.21.15.186:0/3827845331 shutdown_connections 2023-05-08T03:35:21.900 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:21.896+0000 7f8d2e4e8700 1 -- 172.21.15.186:0/3827845331 wait complete. 2023-05-08T03:35:21.901 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:21.897+0000 7f8d2e4e8700 1 Processor -- start 2023-05-08T03:35:21.901 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:21.897+0000 7f8d2e4e8700 1 -- start start 2023-05-08T03:35:21.901 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:21.897+0000 7f8d2e4e8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d140035c0 0x7f8d28196240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:35:21.901 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:21.898+0000 7f8d2e4e8700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8d28196780 0x7f8d28196bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:35:21.902 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:21.898+0000 7f8d2e4e8700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2819f2b0 con 0x7f8d140035c0 2023-05-08T03:35:21.902 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:21.898+0000 7f8d2e4e8700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2819f3f0 con 0x7f8d28196780 2023-05-08T03:35:21.902 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:21.898+0000 7f8d277fe700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8d28196780 0x7f8d28196bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:35:21.902 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:21.898+0000 7f8d277fe700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8d28196780 0x7f8d28196bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.186:52470/0 (socket says 172.21.15.186:52470) 2023-05-08T03:35:21.902 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:21.898+0000 7f8d277fe700 1 -- 172.21.15.186:0/2676692152 learned_addr learned my addr 172.21.15.186:0/2676692152 (peer_addr_for_me v2:172.21.15.186:0/0) 2023-05-08T03:35:21.902 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:21.898+0000 7f8d277fe700 1 -- 172.21.15.186:0/2676692152 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8d28196780 msgr2=0x7f8d28196bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2023-05-08T03:35:21.902 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:21.898+0000 7f8d277fe700 1 -- 172.21.15.186:0/2676692152 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8d28196780 msgr2=0x7f8d28196bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-05-08T03:35:21.903 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:21.898+0000 7f8d277fe700 1 --2- 172.21.15.186:0/2676692152 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8d28196780 0x7f8d28196bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-05-08T03:35:21.903 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:21.898+0000 7f8d27fff700 1 --2- 172.21.15.186:0/2676692152 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d140035c0 0x7f8d28196240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:35:21.903 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:21.898+0000 7f8d277fe700 1 --2- 172.21.15.186:0/2676692152 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8d28196780 0x7f8d28196bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-05-08T03:35:21.903 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:21.898+0000 7f8d27fff700 1 -- 172.21.15.186:0/2676692152 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8d28196780 msgr2=0x7f8d28196bf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-08T03:35:21.903 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:21.898+0000 7f8d27fff700 1 --2- 172.21.15.186:0/2676692152 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8d28196780 0x7f8d28196bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:35:21.903 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:21.898+0000 7f8d27fff700 1 -- 172.21.15.186:0/2676692152 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d1800f8b0 con 0x7f8d140035c0 2023-05-08T03:35:21.903 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:21.898+0000 7f8d27fff700 1 --2- 172.21.15.186:0/2676692152 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d140035c0 0x7f8d28196240 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8d1801b000 tx=0x7f8d18013c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:35:21.904 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:21.899+0000 7f8d257fa700 1 -- 172.21.15.186:0/2676692152 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7f8d18023070 con 0x7f8d140035c0 2023-05-08T03:35:21.904 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:21.899+0000 7f8d257fa700 1 -- 172.21.15.186:0/2676692152 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8d18004bd0 con 0x7f8d140035c0 2023-05-08T03:35:21.905 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:21.899+0000 7f8d257fa700 1 -- 172.21.15.186:0/2676692152 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7f8d18003d80 con 0x7f8d140035c0 2023-05-08T03:35:21.905 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:21.899+0000 7f8d2e4e8700 1 -- 172.21.15.186:0/2676692152 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d28106d50 con 0x7f8d140035c0 2023-05-08T03:35:21.905 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:21.899+0000 7f8d2e4e8700 1 -- 172.21.15.186:0/2676692152 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d28106bc0 con 0x7f8d140035c0 2023-05-08T03:35:21.905 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:21.900+0000 7f8d257fa700 1 -- 172.21.15.186:0/2676692152 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 13) v1 ==== 45539+0+0 (secure 0 0 0) 0x7f8d18004040 con 0x7f8d140035c0 2023-05-08T03:35:21.905 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:21.900+0000 7f8d257fa700 1 --2- 172.21.15.186:0/2676692152 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f8d080386b0 0x7f8d0803ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:35:21.905 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:21.900+0000 7f8d257fa700 1 -- 172.21.15.186:0/2676692152 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f8d1804d630 con 0x7f8d140035c0 2023-05-08T03:35:21.905 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:21.900+0000 7f8d2e4e8700 1 -- 172.21.15.186:0/2676692152 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d28106ee0 con 0x7f8d140035c0 2023-05-08T03:35:21.906 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:21.900+0000 7f8d277fe700 1 --2- 172.21.15.186:0/2676692152 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f8d080386b0 0x7f8d0803ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:35:21.906 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:21.901+0000 7f8d277fe700 1 --2- 172.21.15.186:0/2676692152 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f8d080386b0 0x7f8d0803ab60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8d10009180 tx=0x7f8d10008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:35:21.908 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:21.906+0000 7f8d257fa700 1 -- 172.21.15.186:0/2676692152 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f8d1801abc0 con 0x7f8d140035c0 2023-05-08T03:35:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:21 smithi096 ceph-mon[124666]: Deploying daemon mon.b on smithi133 2023-05-08T03:35:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:21 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-05-08T03:35:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:21 smithi186 ceph-mon[126480]: Deploying daemon mon.b on smithi133 2023-05-08T03:35:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:21 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-05-08T03:35:22.172 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:22.169+0000 7f8d2e4e8700 1 -- 172.21.15.186:0/2676692152 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f8d28062220 con 0x7f8d140035c0 2023-05-08T03:35:22.173 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:22.171+0000 7f8d257fa700 1 -- 172.21.15.186:0/2676692152 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1006 (secure 0 0 0) 0x7f8d1801a990 con 0x7f8d140035c0 2023-05-08T03:35:22.173 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-05-08T03:35:22.173 INFO:teuthology.orchestra.run.smithi186.stdout:{"epoch":2,"fsid":"f7ffcfb0-ed50-11ed-9b01-001a4aab830c","modified":"2023-05-08T03:35:15.552908Z","created":"2023-05-08T03:33:40.613031Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:3300","nonce":0},{"type":"v1","addr":"172.21.15.186:6789","nonce":0}]},"addr":"172.21.15.186:6789/0","public_addr":"172.21.15.186:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2023-05-08T03:35:22.175 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:22.172+0000 7f8d2e4e8700 1 -- 172.21.15.186:0/2676692152 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f8d080386b0 msgr2=0x7f8d0803ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:35:22.175 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:22.172+0000 7f8d2e4e8700 1 --2- 172.21.15.186:0/2676692152 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f8d080386b0 0x7f8d0803ab60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8d10009180 tx=0x7f8d10008040 comp rx=0 tx=0).stop 2023-05-08T03:35:22.175 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:22.172+0000 7f8d2e4e8700 1 -- 172.21.15.186:0/2676692152 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d140035c0 msgr2=0x7f8d28196240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:35:22.175 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:22.172+0000 7f8d2e4e8700 1 --2- 172.21.15.186:0/2676692152 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d140035c0 0x7f8d28196240 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8d1801b000 tx=0x7f8d18013c40 comp rx=0 tx=0).stop 2023-05-08T03:35:22.175 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:22.172+0000 7f8d2e4e8700 1 -- 172.21.15.186:0/2676692152 shutdown_connections 2023-05-08T03:35:22.176 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:22.172+0000 7f8d2e4e8700 1 --2- 172.21.15.186:0/2676692152 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f8d080386b0 0x7f8d0803ab60 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:35:22.176 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:22.172+0000 7f8d2e4e8700 1 --2- 172.21.15.186:0/2676692152 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d140035c0 0x7f8d28196240 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:35:22.176 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:22.172+0000 7f8d2e4e8700 1 --2- 172.21.15.186:0/2676692152 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8d28196780 0x7f8d28196bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:35:22.176 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:22.172+0000 7f8d2e4e8700 1 -- 172.21.15.186:0/2676692152 >> 172.21.15.186:0/2676692152 conn(0x7f8d28074d40 msgr2=0x7f8d2818cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:35:22.176 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:22.172+0000 7f8d2e4e8700 1 -- 172.21.15.186:0/2676692152 shutdown_connections 2023-05-08T03:35:22.176 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:22.172+0000 7f8d2e4e8700 1 -- 172.21.15.186:0/2676692152 wait complete. 2023-05-08T03:35:22.177 INFO:teuthology.orchestra.run.smithi186.stderr:dumped monmap epoch 2 2023-05-08T03:35:22.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:22 smithi186 ceph-mon[126480]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:22.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:22 smithi186 ceph-mon[126480]: from='client.? 172.21.15.186:0/2676692152' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-05-08T03:35:23.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:22 smithi096 ceph-mon[124666]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:23.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:22 smithi096 ceph-mon[124666]: from='client.? 172.21.15.186:0/2676692152' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-05-08T03:35:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 systemd[1]: Starting Ceph mon.b for f7ffcfb0-ed50-11ed-9b01-001a4aab830c... 2023-05-08T03:35:23.559 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-05-08T03:35:23.559 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- ceph mon dump -f json 2023-05-08T03:35:23.906 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 podman[125899]: 2023-05-08T03:35:23.906 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: set uid:gid to 167:167 (ceph:ceph) 2023-05-08T03:35:23.906 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: ceph version 18.0.0-3786-g4b086ba5 (4b086ba51b906a75bac7252b2239e8f120a38c8c) reef (dev), process ceph-mon, pid 7 2023-05-08T03:35:23.906 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: pidfile_write: ignore empty --pid-file 2023-05-08T03:35:23.907 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: load: jerasure load: lrc 2023-05-08T03:35:23.907 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: RocksDB version: 7.9.2 2023-05-08T03:35:23.907 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Git sha 0 2023-05-08T03:35:23.907 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Compile date 2023-05-06 14:52:08 2023-05-08T03:35:23.907 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: DB SUMMARY 2023-05-08T03:35:23.907 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: DB Session ID: DNE2LKW5JEOX5P3RZDKH 2023-05-08T03:35:23.907 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: CURRENT file: CURRENT 2023-05-08T03:35:23.907 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: IDENTITY file: IDENTITY 2023-05-08T03:35:23.908 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2023-05-08T03:35:23.908 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2023-05-08T03:35:23.908 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2023-05-08T03:35:23.908 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.error_if_exists: 0 2023-05-08T03:35:23.908 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.create_if_missing: 0 2023-05-08T03:35:23.908 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.paranoid_checks: 1 2023-05-08T03:35:23.908 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.flush_verify_memtable_count: 1 2023-05-08T03:35:23.909 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-05-08T03:35:23.909 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-05-08T03:35:23.909 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.env: 0x5582f5023720 2023-05-08T03:35:23.909 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.fs: PosixFileSystem 2023-05-08T03:35:23.909 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.info_log: 0x5582f670f460 2023-05-08T03:35:23.909 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.max_file_opening_threads: 16 2023-05-08T03:35:23.909 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.statistics: (nil) 2023-05-08T03:35:23.909 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.use_fsync: 0 2023-05-08T03:35:23.910 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.max_log_file_size: 0 2023-05-08T03:35:23.910 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-05-08T03:35:23.910 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.log_file_time_to_roll: 0 2023-05-08T03:35:23.910 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.keep_log_file_num: 1000 2023-05-08T03:35:23.910 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.recycle_log_file_num: 0 2023-05-08T03:35:23.910 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.allow_fallocate: 1 2023-05-08T03:35:23.910 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.allow_mmap_reads: 0 2023-05-08T03:35:23.911 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.allow_mmap_writes: 0 2023-05-08T03:35:23.911 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.use_direct_reads: 0 2023-05-08T03:35:23.911 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-05-08T03:35:23.911 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.create_missing_column_families: 0 2023-05-08T03:35:23.911 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.db_log_dir: 2023-05-08T03:35:23.912 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.wal_dir: 2023-05-08T03:35:23.912 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.table_cache_numshardbits: 6 2023-05-08T03:35:23.912 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.WAL_ttl_seconds: 0 2023-05-08T03:35:23.912 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.WAL_size_limit_MB: 0 2023-05-08T03:35:23.912 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-05-08T03:35:23.912 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-05-08T03:35:23.912 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.is_fd_close_on_exec: 1 2023-05-08T03:35:23.913 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.advise_random_on_open: 1 2023-05-08T03:35:23.913 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.db_write_buffer_size: 0 2023-05-08T03:35:23.913 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.write_buffer_manager: 0x5582f66c43c0 2023-05-08T03:35:23.913 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-05-08T03:35:23.913 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-05-08T03:35:23.913 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.use_adaptive_mutex: 0 2023-05-08T03:35:23.913 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.rate_limiter: (nil) 2023-05-08T03:35:23.913 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-05-08T03:35:23.914 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.wal_recovery_mode: 2 2023-05-08T03:35:23.914 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.enable_thread_tracking: 0 2023-05-08T03:35:23.914 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.enable_pipelined_write: 0 2023-05-08T03:35:23.914 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.unordered_write: 0 2023-05-08T03:35:23.914 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-05-08T03:35:23.914 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-05-08T03:35:23.914 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-05-08T03:35:23.914 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-05-08T03:35:23.915 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.row_cache: None 2023-05-08T03:35:23.915 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.wal_filter: None 2023-05-08T03:35:23.915 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-05-08T03:35:23.915 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.allow_ingest_behind: 0 2023-05-08T03:35:23.915 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.two_write_queues: 0 2023-05-08T03:35:23.915 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.manual_wal_flush: 0 2023-05-08T03:35:23.915 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.wal_compression: 0 2023-05-08T03:35:23.915 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.atomic_flush: 0 2023-05-08T03:35:23.916 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-05-08T03:35:23.916 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.persist_stats_to_disk: 0 2023-05-08T03:35:23.916 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.write_dbid_to_manifest: 0 2023-05-08T03:35:23.916 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.log_readahead_size: 0 2023-05-08T03:35:23.916 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-05-08T03:35:23.916 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.best_efforts_recovery: 0 2023-05-08T03:35:23.916 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-05-08T03:35:23.917 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-05-08T03:35:23.917 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.allow_data_in_errors: 0 2023-05-08T03:35:23.917 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.db_host_id: __hostname__ 2023-05-08T03:35:23.917 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.enforce_single_del_contracts: true 2023-05-08T03:35:23.917 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.max_background_jobs: 2 2023-05-08T03:35:23.917 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.max_background_compactions: -1 2023-05-08T03:35:23.917 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.max_subcompactions: 1 2023-05-08T03:35:23.917 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-05-08T03:35:23.918 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-05-08T03:35:23.918 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.delayed_write_rate : 16777216 2023-05-08T03:35:23.918 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.max_total_wal_size: 0 2023-05-08T03:35:23.918 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-05-08T03:35:23.918 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.stats_dump_period_sec: 600 2023-05-08T03:35:23.918 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.stats_persist_period_sec: 600 2023-05-08T03:35:23.918 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-05-08T03:35:23.918 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.max_open_files: -1 2023-05-08T03:35:23.919 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.bytes_per_sync: 0 2023-05-08T03:35:23.919 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.wal_bytes_per_sync: 0 2023-05-08T03:35:23.919 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.strict_bytes_per_sync: 0 2023-05-08T03:35:23.919 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.compaction_readahead_size: 0 2023-05-08T03:35:23.919 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.max_background_flushes: -1 2023-05-08T03:35:23.919 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Compression algorithms supported: 2023-05-08T03:35:23.919 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-05-08T03:35:23.920 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: kZSTD supported: 0 2023-05-08T03:35:23.920 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: kXpressCompression supported: 0 2023-05-08T03:35:23.920 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: kLZ4HCCompression supported: 1 2023-05-08T03:35:23.920 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: kZlibCompression supported: 1 2023-05-08T03:35:23.920 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: kSnappyCompression supported: 1 2023-05-08T03:35:23.920 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: kLZ4Compression supported: 1 2023-05-08T03:35:23.920 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: kBZip2Compression supported: 0 2023-05-08T03:35:23.920 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Fast CRC32 supported: Supported on x86 2023-05-08T03:35:23.921 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: DMutex implementation: pthread_mutex_t 2023-05-08T03:35:23.921 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2023-05-08T03:35:23.921 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-05-08T03:35:23.921 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-05-08T03:35:23.921 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.merge_operator: 2023-05-08T03:35:23.921 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.compaction_filter: None 2023-05-08T03:35:23.921 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.compaction_filter_factory: None 2023-05-08T03:35:23.922 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.sst_partitioner_factory: None 2023-05-08T03:35:23.922 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.memtable_factory: SkipListFactory 2023-05-08T03:35:23.922 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.table_factory: BlockBasedTable 2023-05-08T03:35:23.922 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5582f670f560) 2023-05-08T03:35:23.922 INFO:journalctl@ceph.mon.b.smithi133.stdout: cache_index_and_filter_blocks: 1 2023-05-08T03:35:23.922 INFO:journalctl@ceph.mon.b.smithi133.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-05-08T03:35:23.922 INFO:journalctl@ceph.mon.b.smithi133.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-05-08T03:35:23.922 INFO:journalctl@ceph.mon.b.smithi133.stdout: pin_top_level_index_and_filter: 1 2023-05-08T03:35:23.923 INFO:journalctl@ceph.mon.b.smithi133.stdout: index_type: 0 2023-05-08T03:35:23.923 INFO:journalctl@ceph.mon.b.smithi133.stdout: data_block_index_type: 0 2023-05-08T03:35:23.923 INFO:journalctl@ceph.mon.b.smithi133.stdout: index_shortening: 1 2023-05-08T03:35:23.923 INFO:journalctl@ceph.mon.b.smithi133.stdout: data_block_hash_table_util_ratio: 0.750000 2023-05-08T03:35:23.923 INFO:journalctl@ceph.mon.b.smithi133.stdout: checksum: 4 2023-05-08T03:35:23.923 INFO:journalctl@ceph.mon.b.smithi133.stdout: no_block_cache: 0 2023-05-08T03:35:23.923 INFO:journalctl@ceph.mon.b.smithi133.stdout: block_cache: 0x5582f6765350 2023-05-08T03:35:23.923 INFO:journalctl@ceph.mon.b.smithi133.stdout: block_cache_name: BinnedLRUCache 2023-05-08T03:35:23.924 INFO:journalctl@ceph.mon.b.smithi133.stdout: block_cache_options: 2023-05-08T03:35:23.924 INFO:journalctl@ceph.mon.b.smithi133.stdout: capacity : 536870912 2023-05-08T03:35:23.924 INFO:journalctl@ceph.mon.b.smithi133.stdout: num_shard_bits : 4 2023-05-08T03:35:23.924 INFO:journalctl@ceph.mon.b.smithi133.stdout: strict_capacity_limit : 0 2023-05-08T03:35:23.924 INFO:journalctl@ceph.mon.b.smithi133.stdout: high_pri_pool_ratio: 0.000 2023-05-08T03:35:23.924 INFO:journalctl@ceph.mon.b.smithi133.stdout: block_cache_compressed: (nil) 2023-05-08T03:35:23.924 INFO:journalctl@ceph.mon.b.smithi133.stdout: persistent_cache: (nil) 2023-05-08T03:35:23.925 INFO:journalctl@ceph.mon.b.smithi133.stdout: block_size: 4096 2023-05-08T03:35:23.925 INFO:journalctl@ceph.mon.b.smithi133.stdout: block_size_deviation: 10 2023-05-08T03:35:23.925 INFO:journalctl@ceph.mon.b.smithi133.stdout: block_restart_interval: 16 2023-05-08T03:35:23.925 INFO:journalctl@ceph.mon.b.smithi133.stdout: index_block_restart_interval: 1 2023-05-08T03:35:23.925 INFO:journalctl@ceph.mon.b.smithi133.stdout: metadata_block_size: 4096 2023-05-08T03:35:23.925 INFO:journalctl@ceph.mon.b.smithi133.stdout: partition_filters: 0 2023-05-08T03:35:23.925 INFO:journalctl@ceph.mon.b.smithi133.stdout: use_delta_encoding: 1 2023-05-08T03:35:23.925 INFO:journalctl@ceph.mon.b.smithi133.stdout: filter_policy: bloomfilter 2023-05-08T03:35:23.926 INFO:journalctl@ceph.mon.b.smithi133.stdout: whole_key_filtering: 1 2023-05-08T03:35:23.926 INFO:journalctl@ceph.mon.b.smithi133.stdout: verify_compression: 0 2023-05-08T03:35:23.926 INFO:journalctl@ceph.mon.b.smithi133.stdout: read_amp_bytes_per_bit: 0 2023-05-08T03:35:23.926 INFO:journalctl@ceph.mon.b.smithi133.stdout: format_version: 5 2023-05-08T03:35:23.926 INFO:journalctl@ceph.mon.b.smithi133.stdout: enable_index_compression: 1 2023-05-08T03:35:23.926 INFO:journalctl@ceph.mon.b.smithi133.stdout: block_align: 0 2023-05-08T03:35:23.926 INFO:journalctl@ceph.mon.b.smithi133.stdout: max_auto_readahead_size: 262144 2023-05-08T03:35:23.926 INFO:journalctl@ceph.mon.b.smithi133.stdout: prepopulate_block_cache: 0 2023-05-08T03:35:23.927 INFO:journalctl@ceph.mon.b.smithi133.stdout: initial_auto_readahead_size: 8192 2023-05-08T03:35:23.927 INFO:journalctl@ceph.mon.b.smithi133.stdout: num_file_reads_for_auto_readahead: 2 2023-05-08T03:35:23.927 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.write_buffer_size: 33554432 2023-05-08T03:35:23.927 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.max_write_buffer_number: 2 2023-05-08T03:35:23.927 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.compression: NoCompression 2023-05-08T03:35:23.927 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.bottommost_compression: Disabled 2023-05-08T03:35:23.927 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.prefix_extractor: nullptr 2023-05-08T03:35:23.928 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-05-08T03:35:23.928 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.num_levels: 7 2023-05-08T03:35:23.928 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-05-08T03:35:23.928 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-05-08T03:35:23.928 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-05-08T03:35:23.928 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-05-08T03:35:23.929 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-05-08T03:35:23.929 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-05-08T03:35:23.929 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-05-08T03:35:23.929 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-05-08T03:35:23.929 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-05-08T03:35:23.929 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-05-08T03:35:23.929 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-05-08T03:35:23.929 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-05-08T03:35:23.930 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.compression_opts.window_bits: -14 2023-05-08T03:35:23.930 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.compression_opts.level: 32767 2023-05-08T03:35:23.930 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.compression_opts.strategy: 0 2023-05-08T03:35:23.930 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-05-08T03:35:23.930 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-05-08T03:35:23.930 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-05-08T03:35:23.930 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-05-08T03:35:23.931 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.compression_opts.enabled: false 2023-05-08T03:35:23.931 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-05-08T03:35:23.931 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-05-08T03:35:23.931 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-05-08T03:35:23.931 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-05-08T03:35:23.931 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.target_file_size_base: 67108864 2023-05-08T03:35:23.931 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.target_file_size_multiplier: 1 2023-05-08T03:35:23.931 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-05-08T03:35:23.932 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-05-08T03:35:23.932 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-05-08T03:35:23.932 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-05-08T03:35:23.932 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-05-08T03:35:23.932 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-05-08T03:35:23.932 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-05-08T03:35:23.932 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-05-08T03:35:23.933 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-05-08T03:35:23.933 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-05-08T03:35:23.933 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-05-08T03:35:23.933 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-05-08T03:35:23.933 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-05-08T03:35:23.933 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.arena_block_size: 1048576 2023-05-08T03:35:23.933 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-05-08T03:35:23.933 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-05-08T03:35:23.934 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.disable_auto_compactions: 0 2023-05-08T03:35:23.934 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-05-08T03:35:23.934 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-05-08T03:35:23.934 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-05-08T03:35:23.934 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-05-08T03:35:23.934 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-05-08T03:35:23.934 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-05-08T03:35:23.934 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-05-08T03:35:23.935 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-05-08T03:35:23.935 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-05-08T03:35:23.935 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-05-08T03:35:23.935 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.table_properties_collectors: 2023-05-08T03:35:23.935 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.inplace_update_support: 0 2023-05-08T03:35:23.935 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.inplace_update_num_locks: 10000 2023-05-08T03:35:23.935 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-05-08T03:35:23.935 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-05-08T03:35:23.936 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.memtable_huge_page_size: 0 2023-05-08T03:35:23.936 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.bloom_locality: 0 2023-05-08T03:35:23.936 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.max_successive_merges: 0 2023-05-08T03:35:23.936 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.optimize_filters_for_hits: 0 2023-05-08T03:35:23.936 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.paranoid_file_checks: 0 2023-05-08T03:35:23.936 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.force_consistency_checks: 1 2023-05-08T03:35:23.936 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.report_bg_io_stats: 0 2023-05-08T03:35:23.937 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.ttl: 2592000 2023-05-08T03:35:23.937 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.periodic_compaction_seconds: 0 2023-05-08T03:35:23.937 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-05-08T03:35:23.937 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-05-08T03:35:23.937 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.enable_blob_files: false 2023-05-08T03:35:23.937 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.min_blob_size: 0 2023-05-08T03:35:23.937 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.blob_file_size: 268435456 2023-05-08T03:35:23.937 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.blob_compression_type: NoCompression 2023-05-08T03:35:23.938 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.enable_blob_garbage_collection: false 2023-05-08T03:35:23.938 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-05-08T03:35:23.938 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-05-08T03:35:23.938 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-05-08T03:35:23.938 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.blob_file_starting_level: 0 2023-05-08T03:35:23.938 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-05-08T03:35:23.938 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-05-08T03:35:23.938 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2023-05-08T03:35:23.939 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: e9b57385-3ba3-4c59-b6da-0ab55826e370 2023-05-08T03:35:23.939 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: EVENT_LOG_v1 {"time_micros": 1683516923879494, "job": 1, "event": "recovery_started", "wal_files": [4]} 2023-05-08T03:35:23.939 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2023-05-08T03:35:23.939 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: EVENT_LOG_v1 {"time_micros": 1683516923880062, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1747, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1683516923, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "e9b57385-3ba3-4c59-b6da-0ab55826e370", "db_session_id": "DNE2LKW5JEOX5P3RZDKH", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2023-05-08T03:35:23.939 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: EVENT_LOG_v1 {"time_micros": 1683516923880152, "job": 1, "event": "recovery_finished"} 2023-05-08T03:35:23.939 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2023-05-08T03:35:23.939 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-05-08T03:35:23.939 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5582f6802000 2023-05-08T03:35:23.940 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: DB pointer 0x5582f67ee000 2023-05-08T03:35:23.940 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-05-08T03:35:23.940 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-05-08T03:35:23.940 INFO:journalctl@ceph.mon.b.smithi133.stdout: ** DB Stats ** 2023-05-08T03:35:23.940 INFO:journalctl@ceph.mon.b.smithi133.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-05-08T03:35:23.940 INFO:journalctl@ceph.mon.b.smithi133.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-05-08T03:35:23.940 INFO:journalctl@ceph.mon.b.smithi133.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-05-08T03:35:23.941 INFO:journalctl@ceph.mon.b.smithi133.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-05-08T03:35:23.941 INFO:journalctl@ceph.mon.b.smithi133.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-05-08T03:35:23.941 INFO:journalctl@ceph.mon.b.smithi133.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-05-08T03:35:23.941 INFO:journalctl@ceph.mon.b.smithi133.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-05-08T03:35:23.941 INFO:journalctl@ceph.mon.b.smithi133.stdout: 2023-05-08T03:35:23.941 INFO:journalctl@ceph.mon.b.smithi133.stdout: ** Compaction Stats [default] ** 2023-05-08T03:35:23.941 INFO:journalctl@ceph.mon.b.smithi133.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-05-08T03:35:23.942 INFO:journalctl@ceph.mon.b.smithi133.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-05-08T03:35:23.942 INFO:journalctl@ceph.mon.b.smithi133.stdout: L0 1/0 1.71 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-05-08T03:35:23.942 INFO:journalctl@ceph.mon.b.smithi133.stdout: Sum 1/0 1.71 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-05-08T03:35:23.942 INFO:journalctl@ceph.mon.b.smithi133.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-05-08T03:35:23.942 INFO:journalctl@ceph.mon.b.smithi133.stdout: 2023-05-08T03:35:23.942 INFO:journalctl@ceph.mon.b.smithi133.stdout: ** Compaction Stats [default] ** 2023-05-08T03:35:23.942 INFO:journalctl@ceph.mon.b.smithi133.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-05-08T03:35:23.942 INFO:journalctl@ceph.mon.b.smithi133.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-05-08T03:35:23.943 INFO:journalctl@ceph.mon.b.smithi133.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-05-08T03:35:23.943 INFO:journalctl@ceph.mon.b.smithi133.stdout: 2023-05-08T03:35:23.943 INFO:journalctl@ceph.mon.b.smithi133.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-05-08T03:35:23.943 INFO:journalctl@ceph.mon.b.smithi133.stdout: 2023-05-08T03:35:23.943 INFO:journalctl@ceph.mon.b.smithi133.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-05-08T03:35:23.943 INFO:journalctl@ceph.mon.b.smithi133.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-05-08T03:35:23.943 INFO:journalctl@ceph.mon.b.smithi133.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-05-08T03:35:23.944 INFO:journalctl@ceph.mon.b.smithi133.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-05-08T03:35:23.944 INFO:journalctl@ceph.mon.b.smithi133.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-05-08T03:35:23.944 INFO:journalctl@ceph.mon.b.smithi133.stdout: AddFile(Keys): cumulative 0, interval 0 2023-05-08T03:35:23.945 INFO:journalctl@ceph.mon.b.smithi133.stdout: Cumulative compaction: 0.00 GB write, 0.51 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-05-08T03:35:23.945 INFO:journalctl@ceph.mon.b.smithi133.stdout: Interval compaction: 0.00 GB write, 0.51 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-05-08T03:35:23.945 INFO:journalctl@ceph.mon.b.smithi133.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-05-08T03:35:23.945 INFO:journalctl@ceph.mon.b.smithi133.stdout: Block cache BinnedLRUCache@0x5582f6765350#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 8e-06 secs_since: 0 2023-05-08T03:35:23.945 INFO:journalctl@ceph.mon.b.smithi133.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2023-05-08T03:35:23.945 INFO:journalctl@ceph.mon.b.smithi133.stdout: 2023-05-08T03:35:23.946 INFO:journalctl@ceph.mon.b.smithi133.stdout: ** File Read Latency Histogram By Level [default] ** 2023-05-08T03:35:23.946 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: mon.b does not exist in monmap, will attempt to join an existing cluster 2023-05-08T03:35:23.946 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: using public_addr v2:172.21.15.133:0/0 -> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2023-05-08T03:35:23.946 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: starting mon.b rank -1 at public addrs [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] at bind addrs [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c 2023-05-08T03:35:23.946 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: mon.b@-1(???) e0 preinit fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c 2023-05-08T03:35:23.946 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 bash[125899]: be402a26a63f80ca08527ea50d29214bf337683e75a97ceacf1fd457063ec94a 2023-05-08T03:35:23.946 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: mon.b@-1(synchronizing).mds e1 new map 2023-05-08T03:35:23.947 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: mon.b@-1(synchronizing).mds e1 print_map 2023-05-08T03:35:23.947 INFO:journalctl@ceph.mon.b.smithi133.stdout: e1 2023-05-08T03:35:23.947 INFO:journalctl@ceph.mon.b.smithi133.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-05-08T03:35:23.947 INFO:journalctl@ceph.mon.b.smithi133.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-05-08T03:35:23.947 INFO:journalctl@ceph.mon.b.smithi133.stdout: legacy client fscid: -1 2023-05-08T03:35:23.947 INFO:journalctl@ceph.mon.b.smithi133.stdout: 2023-05-08T03:35:23.947 INFO:journalctl@ceph.mon.b.smithi133.stdout: No filesystems configured 2023-05-08T03:35:23.947 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2023-05-08T03:35:23.948 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2023-05-08T03:35:23.948 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2023-05-08T03:35:23.948 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2023-05-08T03:35:23.948 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2023-05-08T03:35:23.948 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2023-05-08T03:35:23.948 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2023-05-08T03:35:23.948 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-05-08T03:35:23.949 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-05-08T03:35:23.949 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-05-08T03:35:23.949 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi186", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:35:23.949 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:23.949 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:23.949 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:23.949 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:23.949 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:23.950 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi133", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:35:23.950 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:35:23.950 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:35:23.950 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:35:23.950 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: Updating smithi133:/etc/ceph/ceph.conf 2023-05-08T03:35:23.950 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: Updating smithi133:/var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/config/ceph.conf 2023-05-08T03:35:23.950 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: Deploying cephadm binary to smithi186 2023-05-08T03:35:23.950 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: Updating smithi133:/etc/ceph/ceph.client.admin.keyring 2023-05-08T03:35:23.951 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: Updating smithi133:/var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/config/ceph.client.admin.keyring 2023-05-08T03:35:23.951 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:23.951 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:23.951 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:23.951 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:23.951 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:35:23.951 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:23.952 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: Added host smithi186 2023-05-08T03:35:23.952 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:23.952 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:23.952 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:23.952 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:23.952 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-05-08T03:35:23.952 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:23.952 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/1186493892' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-05-08T03:35:23.953 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:23.953 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:23.953 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:23.953 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:23.953 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi186", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:35:23.953 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:35:23.953 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:35:23.954 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:35:23.954 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: Updating smithi186:/etc/ceph/ceph.conf 2023-05-08T03:35:23.954 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/1186493892' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-05-08T03:35:23.954 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: osdmap e4: 0 total, 0 up, 0 in 2023-05-08T03:35:23.954 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:23.954 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:23.954 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:23.954 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: Updating smithi186:/var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/config/ceph.conf 2023-05-08T03:35:23.955 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: Updating smithi186:/etc/ceph/ceph.client.admin.keyring 2023-05-08T03:35:23.955 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: Updating smithi186:/var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/config/ceph.client.admin.keyring 2023-05-08T03:35:23.955 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:23.955 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:23.956 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi096:172.21.15.96=a;smithi133:172.21.15.133=b;smithi186:172.21.15.186=c", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:35:23.956 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: Saving service mon spec with placement smithi096:172.21.15.96=a;smithi133:172.21.15.133=b;smithi186:172.21.15.186=c;count:3 2023-05-08T03:35:23.956 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:23.956 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:35:23.956 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:35:23.956 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:35:23.957 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:35:23.957 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:23.957 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:35:23.957 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-05-08T03:35:23.957 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:35:23.957 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: Deploying daemon mon.c on smithi186 2023-05-08T03:35:23.957 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:23.958 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:23.958 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-05-08T03:35:23.958 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: mon.a calling monitor election 2023-05-08T03:35:23.958 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-05-08T03:35:23.958 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-05-08T03:35:23.958 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:23.958 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-05-08T03:35:23.959 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: mon.c calling monitor election 2023-05-08T03:35:23.959 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-05-08T03:35:23.959 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:23.959 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-05-08T03:35:23.959 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-05-08T03:35:23.959 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-05-08T03:35:23.959 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: monmap e2: 2 mons at {a=[v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0],c=[v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0]} removed_ranks: {} 2023-05-08T03:35:23.959 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: fsmap 2023-05-08T03:35:23.960 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: osdmap e4: 0 total, 0 up, 0 in 2023-05-08T03:35:23.960 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: mgrmap e13: x(active, since 43s) 2023-05-08T03:35:23.960 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: overall HEALTH_OK 2023-05-08T03:35:23.960 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:23.960 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:23.960 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:23.960 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-05-08T03:35:23.961 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:35:23.961 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: Deploying daemon mon.b on smithi133 2023-05-08T03:35:23.961 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-05-08T03:35:23.961 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:23.961 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: from='client.? 172.21.15.186:0/2676692152' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-05-08T03:35:23.961 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2023-05-08T03:35:23.961 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: mon.b@-1(synchronizing) e2 handle_conf_change mon_allow_pool_delete 2023-05-08T03:35:23.961 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: expand_channel_meta expand map: {default=false} 2023-05-08T03:35:23.962 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: expand_channel_meta from 'false' to 'false' 2023-05-08T03:35:23.962 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: expand_channel_meta expanded map: {default=false} 2023-05-08T03:35:23.962 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: expand_channel_meta expand map: {default=info} 2023-05-08T03:35:23.962 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: expand_channel_meta from 'info' to 'info' 2023-05-08T03:35:23.962 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: expand_channel_meta expanded map: {default=info} 2023-05-08T03:35:23.962 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: expand_channel_meta expand map: {default=daemon} 2023-05-08T03:35:23.962 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: expand_channel_meta from 'daemon' to 'daemon' 2023-05-08T03:35:23.962 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: expand_channel_meta expanded map: {default=daemon} 2023-05-08T03:35:23.963 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: expand_channel_meta expand map: {default=debug} 2023-05-08T03:35:23.963 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: expand_channel_meta from 'debug' to 'debug' 2023-05-08T03:35:23.963 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 ceph-mon[125939]: expand_channel_meta expanded map: {default=debug} 2023-05-08T03:35:24.209 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.c/config 2023-05-08T03:35:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:23 smithi133 systemd[1]: Started Ceph mon.b for f7ffcfb0-ed50-11ed-9b01-001a4aab830c. 2023-05-08T03:35:29.007 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:29.003+0000 7fa78e63d700 1 -- 172.21.15.186:0/2103216007 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7740035c0 msgr2=0x7fa774005a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:35:29.007 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:29.003+0000 7fa78e63d700 1 --2- 172.21.15.186:0/2103216007 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7740035c0 0x7fa774005a40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa7880ffe80 tx=0x7fa778014ec0 comp rx=0 tx=0).stop 2023-05-08T03:35:29.007 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:29.003+0000 7fa78e63d700 1 -- 172.21.15.186:0/2103216007 shutdown_connections 2023-05-08T03:35:29.007 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:29.003+0000 7fa78e63d700 1 --2- 172.21.15.186:0/2103216007 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7740035c0 0x7fa774005a40 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:35:29.008 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:29.003+0000 7fa78e63d700 1 -- 172.21.15.186:0/2103216007 >> 172.21.15.186:0/2103216007 conn(0x7fa7880fba70 msgr2=0x7fa7880fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:35:29.008 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:29.003+0000 7fa78e63d700 1 -- 172.21.15.186:0/2103216007 shutdown_connections 2023-05-08T03:35:29.008 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:29.003+0000 7fa78e63d700 1 -- 172.21.15.186:0/2103216007 wait complete. 2023-05-08T03:35:29.008 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:29.004+0000 7fa78e63d700 1 Processor -- start 2023-05-08T03:35:29.008 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:29.004+0000 7fa78e63d700 1 -- start start 2023-05-08T03:35:29.008 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:29.004+0000 7fa78e63d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7740035c0 0x7fa78819d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:35:29.008 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:29.004+0000 7fa78e63d700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa78819da70 0x7fa7881975b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:35:29.009 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:29.004+0000 7fa78e63d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa788197af0 0x7fa788197f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:35:29.009 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:29.004+0000 7fa78e63d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa78819e080 con 0x7fa7740035c0 2023-05-08T03:35:29.009 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:29.004+0000 7fa78e63d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7881a4350 con 0x7fa788197af0 2023-05-08T03:35:29.009 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:29.004+0000 7fa78e63d700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7881a4490 con 0x7fa78819da70 2023-05-08T03:35:29.009 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:29.004+0000 7fa77ffff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa78819da70 0x7fa7881975b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:35:29.009 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:29.004+0000 7fa787fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7740035c0 0x7fa78819d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:35:29.009 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:29.004+0000 7fa787fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7740035c0 0x7fa78819d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.186:38678/0 (socket says 172.21.15.186:38678) 2023-05-08T03:35:29.009 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:29.004+0000 7fa787fff700 1 -- 172.21.15.186:0/2847024313 learned_addr learned my addr 172.21.15.186:0/2847024313 (peer_addr_for_me v2:172.21.15.186:0/0) 2023-05-08T03:35:29.010 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:29.004+0000 7fa78cbda700 1 --2- 172.21.15.186:0/2847024313 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa788197af0 0x7fa788197f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:35:29.010 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:29.004+0000 7fa78cbda700 1 -- 172.21.15.186:0/2847024313 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa788197af0 msgr2=0x7fa788197f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2023-05-08T03:35:29.010 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:29.004+0000 7fa77ffff700 1 -- 172.21.15.186:0/2847024313 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa78819da70 msgr2=0x7fa7881975b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2023-05-08T03:35:29.010 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:29.004+0000 7fa77ffff700 1 -- 172.21.15.186:0/2847024313 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa78819da70 msgr2=0x7fa7881975b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-05-08T03:35:29.010 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:29.004+0000 7fa77ffff700 1 --2- 172.21.15.186:0/2847024313 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa78819da70 0x7fa7881975b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-05-08T03:35:29.010 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:29.004+0000 7fa78cbda700 1 -- 172.21.15.186:0/2847024313 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa788197af0 msgr2=0x7fa788197f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-05-08T03:35:29.010 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:29.004+0000 7fa78cbda700 1 --2- 172.21.15.186:0/2847024313 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa788197af0 0x7fa788197f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-05-08T03:35:29.011 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:29.004+0000 7fa78cbda700 1 --2- 172.21.15.186:0/2847024313 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa788197af0 0x7fa788197f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-05-08T03:35:29.011 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:29.005+0000 7fa77ffff700 1 --2- 172.21.15.186:0/2847024313 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa78819da70 0x7fa7881975b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-05-08T03:35:29.011 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:29.005+0000 7fa787fff700 1 -- 172.21.15.186:0/2847024313 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa78819da70 msgr2=0x7fa7881975b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-08T03:35:29.011 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:29.005+0000 7fa787fff700 1 --2- 172.21.15.186:0/2847024313 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa78819da70 0x7fa7881975b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:35:29.011 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:29.005+0000 7fa787fff700 1 -- 172.21.15.186:0/2847024313 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa788197af0 msgr2=0x7fa788197f90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-08T03:35:29.011 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:29.005+0000 7fa787fff700 1 --2- 172.21.15.186:0/2847024313 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa788197af0 0x7fa788197f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:35:29.011 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:29.005+0000 7fa787fff700 1 -- 172.21.15.186:0/2847024313 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa778014910 con 0x7fa7740035c0 2023-05-08T03:35:29.011 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:29.005+0000 7fa787fff700 1 --2- 172.21.15.186:0/2847024313 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7740035c0 0x7fa78819d530 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa778000c00 tx=0x7fa77801f480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:35:29.013 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:29.008+0000 7fa785ffb700 1 -- 172.21.15.186:0/2847024313 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa778019040 con 0x7fa7740035c0 2023-05-08T03:35:29.013 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:29.008+0000 7fa78e63d700 1 -- 172.21.15.186:0/2847024313 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa788107d50 con 0x7fa7740035c0 2023-05-08T03:35:29.013 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:29.008+0000 7fa78e63d700 1 -- 172.21.15.186:0/2847024313 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa788107bc0 con 0x7fa7740035c0 2023-05-08T03:35:29.013 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:29.008+0000 7fa785ffb700 1 -- 172.21.15.186:0/2847024313 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa77801fb70 con 0x7fa7740035c0 2023-05-08T03:35:29.013 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:29.008+0000 7fa785ffb700 1 -- 172.21.15.186:0/2847024313 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa778004ef0 con 0x7fa7740035c0 2023-05-08T03:35:29.013 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:29.009+0000 7fa785ffb700 1 -- 172.21.15.186:0/2847024313 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 13) v1 ==== 45539+0+0 (secure 0 0 0) 0x7fa778005050 con 0x7fa7740035c0 2023-05-08T03:35:29.014 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:29.009+0000 7fa785ffb700 1 --2- 172.21.15.186:0/2847024313 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fa768038d40 0x7fa76803b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:35:29.014 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:29.010+0000 7fa785ffb700 1 -- 172.21.15.186:0/2847024313 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fa77804ec20 con 0x7fa7740035c0 2023-05-08T03:35:29.014 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:29.010+0000 7fa78e63d700 1 -- 172.21.15.186:0/2847024313 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa788107ee0 con 0x7fa7740035c0 2023-05-08T03:35:29.014 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:29.010+0000 7fa77ffff700 1 --2- 172.21.15.186:0/2847024313 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fa768038d40 0x7fa76803b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:35:29.014 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:29.010+0000 7fa77ffff700 1 --2- 172.21.15.186:0/2847024313 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fa768038d40 0x7fa76803b1f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa770009850 tx=0x7fa770008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:35:29.017 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:29.016+0000 7fa785ffb700 1 -- 172.21.15.186:0/2847024313 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fa7780053a0 con 0x7fa7740035c0 2023-05-08T03:35:29.300 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:29.299+0000 7fa78e63d700 1 -- 172.21.15.186:0/2847024313 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fa788198b90 con 0x7fa7740035c0 2023-05-08T03:35:29.301 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:29.299+0000 7fa785ffb700 1 -- 172.21.15.186:0/2847024313 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) v1 ==== 95+0+1276 (secure 0 0 0) 0x7fa778035510 con 0x7fa7740035c0 2023-05-08T03:35:29.301 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-05-08T03:35:29.302 INFO:teuthology.orchestra.run.smithi186.stdout:{"epoch":3,"fsid":"f7ffcfb0-ed50-11ed-9b01-001a4aab830c","modified":"2023-05-08T03:35:23.905703Z","created":"2023-05-08T03:33:40.613031Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:3300","nonce":0},{"type":"v1","addr":"172.21.15.186:6789","nonce":0}]},"addr":"172.21.15.186:6789/0","public_addr":"172.21.15.186:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:3300","nonce":0},{"type":"v1","addr":"172.21.15.133:6789","nonce":0}]},"addr":"172.21.15.133:6789/0","public_addr":"172.21.15.133:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-05-08T03:35:29.303 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:29.302+0000 7fa78e63d700 1 -- 172.21.15.186:0/2847024313 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fa768038d40 msgr2=0x7fa76803b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:35:29.304 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:29.302+0000 7fa78e63d700 1 --2- 172.21.15.186:0/2847024313 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fa768038d40 0x7fa76803b1f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa770009850 tx=0x7fa770008040 comp rx=0 tx=0).stop 2023-05-08T03:35:29.304 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:29.302+0000 7fa78e63d700 1 -- 172.21.15.186:0/2847024313 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7740035c0 msgr2=0x7fa78819d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:35:29.304 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:29.302+0000 7fa78e63d700 1 --2- 172.21.15.186:0/2847024313 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7740035c0 0x7fa78819d530 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa778000c00 tx=0x7fa77801f480 comp rx=0 tx=0).stop 2023-05-08T03:35:29.304 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:29.302+0000 7fa78e63d700 1 -- 172.21.15.186:0/2847024313 shutdown_connections 2023-05-08T03:35:29.304 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:29.302+0000 7fa78e63d700 1 --2- 172.21.15.186:0/2847024313 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fa768038d40 0x7fa76803b1f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:35:29.304 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:29.302+0000 7fa78e63d700 1 --2- 172.21.15.186:0/2847024313 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa788197af0 0x7fa788197f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:35:29.305 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:29.302+0000 7fa78e63d700 1 --2- 172.21.15.186:0/2847024313 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7740035c0 0x7fa78819d530 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:35:29.305 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:29.302+0000 7fa78e63d700 1 --2- 172.21.15.186:0/2847024313 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa78819da70 0x7fa7881975b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:35:29.305 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:29.302+0000 7fa78e63d700 1 -- 172.21.15.186:0/2847024313 >> 172.21.15.186:0/2847024313 conn(0x7fa7880fba70 msgr2=0x7fa788101af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:35:29.305 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:29.302+0000 7fa78e63d700 1 -- 172.21.15.186:0/2847024313 shutdown_connections 2023-05-08T03:35:29.305 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:29.302+0000 7fa78e63d700 1 -- 172.21.15.186:0/2847024313 wait complete. 2023-05-08T03:35:29.305 INFO:teuthology.orchestra.run.smithi186.stderr:dumped monmap epoch 3 2023-05-08T03:35:29.331 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:29 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-05-08T03:35:29.332 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:29 smithi186 ceph-mon[126480]: mon.a calling monitor election 2023-05-08T03:35:29.332 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:29 smithi186 ceph-mon[126480]: mon.c calling monitor election 2023-05-08T03:35:29.332 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:29 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-05-08T03:35:29.332 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:29 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-05-08T03:35:29.332 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:29 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-05-08T03:35:29.332 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:29 smithi186 ceph-mon[126480]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:29.333 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:29 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-05-08T03:35:29.333 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:29 smithi186 ceph-mon[126480]: mon.b calling monitor election 2023-05-08T03:35:29.333 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:29 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-05-08T03:35:29.333 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:29 smithi186 ceph-mon[126480]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:29.333 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:29 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-05-08T03:35:29.333 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:29 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-05-08T03:35:29.334 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:29 smithi186 ceph-mon[126480]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-05-08T03:35:29.334 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:29 smithi186 ceph-mon[126480]: monmap e3: 3 mons at {a=[v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0],b=[v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0],c=[v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0]} removed_ranks: {} 2023-05-08T03:35:29.334 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:29 smithi186 ceph-mon[126480]: fsmap 2023-05-08T03:35:29.334 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:29 smithi186 ceph-mon[126480]: osdmap e4: 0 total, 0 up, 0 in 2023-05-08T03:35:29.334 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:29 smithi186 ceph-mon[126480]: mgrmap e13: x(active, since 51s) 2023-05-08T03:35:29.334 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:29 smithi186 ceph-mon[126480]: overall HEALTH_OK 2023-05-08T03:35:29.334 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:29 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:29.335 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:29 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:29.335 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:29 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:29.335 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:29 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:29 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-05-08T03:35:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:29 smithi133 ceph-mon[125939]: mon.a calling monitor election 2023-05-08T03:35:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:29 smithi133 ceph-mon[125939]: mon.c calling monitor election 2023-05-08T03:35:29.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:29 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-05-08T03:35:29.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:29 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-05-08T03:35:29.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:29 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-05-08T03:35:29.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:29 smithi133 ceph-mon[125939]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:29.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:29 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-05-08T03:35:29.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:29 smithi133 ceph-mon[125939]: mon.b calling monitor election 2023-05-08T03:35:29.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:29 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-05-08T03:35:29.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:29 smithi133 ceph-mon[125939]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:29.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:29 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-05-08T03:35:29.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:29 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-05-08T03:35:29.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:29 smithi133 ceph-mon[125939]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-05-08T03:35:29.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:29 smithi133 ceph-mon[125939]: monmap e3: 3 mons at {a=[v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0],b=[v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0],c=[v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0]} removed_ranks: {} 2023-05-08T03:35:29.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:29 smithi133 ceph-mon[125939]: fsmap 2023-05-08T03:35:29.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:29 smithi133 ceph-mon[125939]: osdmap e4: 0 total, 0 up, 0 in 2023-05-08T03:35:29.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:29 smithi133 ceph-mon[125939]: mgrmap e13: x(active, since 51s) 2023-05-08T03:35:29.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:29 smithi133 ceph-mon[125939]: overall HEALTH_OK 2023-05-08T03:35:29.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:29 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:29.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:29 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:29.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:29 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:29.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:29 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:29 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-05-08T03:35:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:29 smithi096 ceph-mon[124666]: mon.a calling monitor election 2023-05-08T03:35:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:29 smithi096 ceph-mon[124666]: mon.c calling monitor election 2023-05-08T03:35:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:29 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-05-08T03:35:29.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:29 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-05-08T03:35:29.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:29 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-05-08T03:35:29.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:29 smithi096 ceph-mon[124666]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:29.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:29 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-05-08T03:35:29.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:29 smithi096 ceph-mon[124666]: mon.b calling monitor election 2023-05-08T03:35:29.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:29 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-05-08T03:35:29.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:29 smithi096 ceph-mon[124666]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:29.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:29 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-05-08T03:35:29.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:29 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-05-08T03:35:29.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:29 smithi096 ceph-mon[124666]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-05-08T03:35:29.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:29 smithi096 ceph-mon[124666]: monmap e3: 3 mons at {a=[v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0],b=[v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0],c=[v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0]} removed_ranks: {} 2023-05-08T03:35:29.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:29 smithi096 ceph-mon[124666]: fsmap 2023-05-08T03:35:29.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:29 smithi096 ceph-mon[124666]: osdmap e4: 0 total, 0 up, 0 in 2023-05-08T03:35:29.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:29 smithi096 ceph-mon[124666]: mgrmap e13: x(active, since 51s) 2023-05-08T03:35:29.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:29 smithi096 ceph-mon[124666]: overall HEALTH_OK 2023-05-08T03:35:29.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:29 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:29.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:29 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:29.509 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:29 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:29.509 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:29 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:29.677 INFO:tasks.cephadm:Generating final ceph.conf file... 2023-05-08T03:35:29.678 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- ceph config generate-minimal-conf 2023-05-08T03:35:30.328 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.a/config 2023-05-08T03:35:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:30 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:35:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:30 smithi186 ceph-mon[126480]: from='client.? 172.21.15.186:0/2847024313' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-05-08T03:35:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:30 smithi186 ceph-mon[126480]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:30 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-05-08T03:35:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:30 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:35:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:30 smithi133 ceph-mon[125939]: from='client.? 172.21.15.186:0/2847024313' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-05-08T03:35:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:30 smithi133 ceph-mon[125939]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:30 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-05-08T03:35:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:30 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:35:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:30 smithi096 ceph-mon[124666]: from='client.? 172.21.15.186:0/2847024313' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-05-08T03:35:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:30 smithi096 ceph-mon[124666]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:30 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-05-08T03:35:31.581 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:31.577+0000 7fbb9e3d8700 1 -- 172.21.15.96:0/2414482642 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb98104dc0 msgr2=0x7fbb98105190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:35:31.581 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:31.577+0000 7fbb9e3d8700 1 --2- 172.21.15.96:0/2414482642 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb98104dc0 0x7fbb98105190 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fbb88009910 tx=0x7fbb88009c20 comp rx=0 tx=0).stop 2023-05-08T03:35:31.581 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:31.577+0000 7fbb9e3d8700 1 -- 172.21.15.96:0/2414482642 shutdown_connections 2023-05-08T03:35:31.581 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:31.577+0000 7fbb9e3d8700 1 --2- 172.21.15.96:0/2414482642 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb98104dc0 0x7fbb98105190 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:35:31.581 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:31.577+0000 7fbb9e3d8700 1 -- 172.21.15.96:0/2414482642 >> 172.21.15.96:0/2414482642 conn(0x7fbb98074c30 msgr2=0x7fbb98075030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:35:31.582 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:31.577+0000 7fbb9e3d8700 1 -- 172.21.15.96:0/2414482642 shutdown_connections 2023-05-08T03:35:31.582 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:31.577+0000 7fbb9e3d8700 1 -- 172.21.15.96:0/2414482642 wait complete. 2023-05-08T03:35:31.582 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:31.578+0000 7fbb9e3d8700 1 Processor -- start 2023-05-08T03:35:31.582 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:31.578+0000 7fbb9e3d8700 1 -- start start 2023-05-08T03:35:31.582 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:31.578+0000 7fbb9e3d8700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbb98104dc0 0x7fbb981953a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:35:31.582 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:31.578+0000 7fbb9e3d8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb981958e0 0x7fbb98199d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:35:31.582 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:31.578+0000 7fbb9e3d8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb9819a290 0x7fbb9819a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:35:31.582 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:31.578+0000 7fbb9e3d8700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb98195fb0 con 0x7fbb981958e0 2023-05-08T03:35:31.583 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:31.578+0000 7fbb9e3d8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb981a2000 con 0x7fbb9819a290 2023-05-08T03:35:31.583 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:31.578+0000 7fbb9e3d8700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb981a2140 con 0x7fbb98104dc0 2023-05-08T03:35:31.583 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:31.578+0000 7fbb977fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb981958e0 0x7fbb98199d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:35:31.583 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:31.578+0000 7fbb977fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb981958e0 0x7fbb98199d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39540/0 (socket says 172.21.15.96:39540) 2023-05-08T03:35:31.583 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:31.578+0000 7fbb977fe700 1 -- 172.21.15.96:0/3335127826 learned_addr learned my addr 172.21.15.96:0/3335127826 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:35:31.583 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:31.579+0000 7fbb9c975700 1 --2- 172.21.15.96:0/3335127826 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb9819a290 0x7fbb9819a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:35:31.583 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:31.579+0000 7fbb97fff700 1 --2- 172.21.15.96:0/3335127826 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbb98104dc0 0x7fbb981953a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:35:31.584 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:31.579+0000 7fbb977fe700 1 -- 172.21.15.96:0/3335127826 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbb98104dc0 msgr2=0x7fbb981953a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:35:31.584 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:31.579+0000 7fbb977fe700 1 --2- 172.21.15.96:0/3335127826 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbb98104dc0 0x7fbb981953a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:35:31.584 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:31.579+0000 7fbb977fe700 1 -- 172.21.15.96:0/3335127826 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb9819a290 msgr2=0x7fbb9819a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:35:31.584 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:31.579+0000 7fbb977fe700 1 --2- 172.21.15.96:0/3335127826 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb9819a290 0x7fbb9819a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:35:31.584 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:31.579+0000 7fbb977fe700 1 -- 172.21.15.96:0/3335127826 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb880095f0 con 0x7fbb981958e0 2023-05-08T03:35:31.584 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:31.579+0000 7fbb977fe700 1 --2- 172.21.15.96:0/3335127826 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb981958e0 0x7fbb98199d50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c00b7b0 tx=0x7fbb8c00bb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:35:31.585 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:31.579+0000 7fbb957fa700 1 -- 172.21.15.96:0/3335127826 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb8c004230 con 0x7fbb981958e0 2023-05-08T03:35:31.585 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:31.579+0000 7fbb957fa700 1 -- 172.21.15.96:0/3335127826 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbb8c004390 con 0x7fbb981958e0 2023-05-08T03:35:31.586 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:31.579+0000 7fbb9e3d8700 1 -- 172.21.15.96:0/3335127826 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb9810a2f0 con 0x7fbb981958e0 2023-05-08T03:35:31.586 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:31.579+0000 7fbb957fa700 1 -- 172.21.15.96:0/3335127826 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb8c011ad0 con 0x7fbb981958e0 2023-05-08T03:35:31.586 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:31.579+0000 7fbb9e3d8700 1 -- 172.21.15.96:0/3335127826 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb9810a160 con 0x7fbb981958e0 2023-05-08T03:35:31.586 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:31.580+0000 7fbb957fa700 1 -- 172.21.15.96:0/3335127826 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 13) v1 ==== 45539+0+0 (secure 0 0 0) 0x7fbb8c011c70 con 0x7fbb981958e0 2023-05-08T03:35:31.586 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:31.580+0000 7fbb957fa700 1 --2- 172.21.15.96:0/3335127826 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fbb80038d40 0x7fbb8003b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:35:31.586 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:31.580+0000 7fbb9e3d8700 1 -- 172.21.15.96:0/3335127826 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb9810a480 con 0x7fbb981958e0 2023-05-08T03:35:31.586 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:31.580+0000 7fbb957fa700 1 -- 172.21.15.96:0/3335127826 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fbb8c04ad50 con 0x7fbb981958e0 2023-05-08T03:35:31.587 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:31.580+0000 7fbb97fff700 1 --2- 172.21.15.96:0/3335127826 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fbb80038d40 0x7fbb8003b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:35:31.587 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:31.581+0000 7fbb97fff700 1 --2- 172.21.15.96:0/3335127826 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fbb80038d40 0x7fbb8003b1f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fbb88006010 tx=0x7fbb8800b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:35:31.588 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:31.586+0000 7fbb957fa700 1 -- 172.21.15.96:0/3335127826 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fbb8c01ae40 con 0x7fbb981958e0 2023-05-08T03:35:31.786 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:31.783+0000 7fbb9e3d8700 1 -- 172.21.15.96:0/3335127826 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7fbb981a2cc0 con 0x7fbb981958e0 2023-05-08T03:35:31.786 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:31.783+0000 7fbb957fa700 1 -- 172.21.15.96:0/3335127826 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) v1 ==== 76+0+275 (secure 0 0 0) 0x7fbb8c01ecf0 con 0x7fbb981958e0 2023-05-08T03:35:31.786 INFO:teuthology.orchestra.run.smithi096.stdout:# minimal ceph.conf for f7ffcfb0-ed50-11ed-9b01-001a4aab830c 2023-05-08T03:35:31.787 INFO:teuthology.orchestra.run.smithi096.stdout:[global] 2023-05-08T03:35:31.787 INFO:teuthology.orchestra.run.smithi096.stdout: fsid = f7ffcfb0-ed50-11ed-9b01-001a4aab830c 2023-05-08T03:35:31.787 INFO:teuthology.orchestra.run.smithi096.stdout: mon_host = [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] 2023-05-08T03:35:31.788 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:31.786+0000 7fbb9e3d8700 1 -- 172.21.15.96:0/3335127826 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fbb80038d40 msgr2=0x7fbb8003b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:35:31.788 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:31.786+0000 7fbb9e3d8700 1 --2- 172.21.15.96:0/3335127826 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fbb80038d40 0x7fbb8003b1f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fbb88006010 tx=0x7fbb8800b540 comp rx=0 tx=0).stop 2023-05-08T03:35:31.789 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:31.786+0000 7fbb9e3d8700 1 -- 172.21.15.96:0/3335127826 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb981958e0 msgr2=0x7fbb98199d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:35:31.789 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:31.786+0000 7fbb9e3d8700 1 --2- 172.21.15.96:0/3335127826 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb981958e0 0x7fbb98199d50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c00b7b0 tx=0x7fbb8c00bb70 comp rx=0 tx=0).stop 2023-05-08T03:35:31.789 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:31.786+0000 7fbb9e3d8700 1 -- 172.21.15.96:0/3335127826 shutdown_connections 2023-05-08T03:35:31.789 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:31.786+0000 7fbb9e3d8700 1 --2- 172.21.15.96:0/3335127826 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fbb80038d40 0x7fbb8003b1f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:35:31.789 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:31.786+0000 7fbb9e3d8700 1 --2- 172.21.15.96:0/3335127826 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb9819a290 0x7fbb9819a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:35:31.789 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:31.786+0000 7fbb9e3d8700 1 --2- 172.21.15.96:0/3335127826 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbb98104dc0 0x7fbb981953a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:35:31.789 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:31.786+0000 7fbb9e3d8700 1 --2- 172.21.15.96:0/3335127826 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb981958e0 0x7fbb98199d50 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:35:31.790 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:31.786+0000 7fbb9e3d8700 1 -- 172.21.15.96:0/3335127826 >> 172.21.15.96:0/3335127826 conn(0x7fbb98074c30 msgr2=0x7fbb981019f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:35:31.790 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:31.786+0000 7fbb9e3d8700 1 -- 172.21.15.96:0/3335127826 shutdown_connections 2023-05-08T03:35:31.790 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:31.786+0000 7fbb9e3d8700 1 -- 172.21.15.96:0/3335127826 wait complete. 2023-05-08T03:35:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:31 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:31 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:31 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:31 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:31.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:31 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:35:31.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:31 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:35:31.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:31 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:35:31.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:31 smithi133 ceph-mon[125939]: Updating smithi096:/etc/ceph/ceph.conf 2023-05-08T03:35:31.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:31 smithi133 ceph-mon[125939]: Updating smithi133:/etc/ceph/ceph.conf 2023-05-08T03:35:31.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:31 smithi133 ceph-mon[125939]: Updating smithi186:/etc/ceph/ceph.conf 2023-05-08T03:35:31.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:31 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:31.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:31 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:31.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:31 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:31.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:31 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:31.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:31 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:31.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:31 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:31.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:31 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:31.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:31 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-05-08T03:35:31.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:31 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-05-08T03:35:31.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:31 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:35:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:31 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:31 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:32.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:31 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:32.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:31 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:32.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:31 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:35:32.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:31 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:35:32.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:31 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:35:32.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:31 smithi096 ceph-mon[124666]: Updating smithi096:/etc/ceph/ceph.conf 2023-05-08T03:35:32.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:31 smithi096 ceph-mon[124666]: Updating smithi133:/etc/ceph/ceph.conf 2023-05-08T03:35:32.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:31 smithi096 ceph-mon[124666]: Updating smithi186:/etc/ceph/ceph.conf 2023-05-08T03:35:32.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:31 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:32.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:31 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:32.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:31 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:32.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:31 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:32.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:31 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:32.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:31 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:32.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:31 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:32.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:31 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-05-08T03:35:32.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:31 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-05-08T03:35:32.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:31 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:35:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:31 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:31 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:31 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:31 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:31 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:35:32.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:31 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:35:32.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:31 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:35:32.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:31 smithi186 ceph-mon[126480]: Updating smithi096:/etc/ceph/ceph.conf 2023-05-08T03:35:32.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:31 smithi186 ceph-mon[126480]: Updating smithi133:/etc/ceph/ceph.conf 2023-05-08T03:35:32.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:31 smithi186 ceph-mon[126480]: Updating smithi186:/etc/ceph/ceph.conf 2023-05-08T03:35:32.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:31 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:32.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:31 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:32.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:31 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:32.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:31 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:32.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:31 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:32.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:31 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:32.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:31 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:32.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:31 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-05-08T03:35:32.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:31 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-05-08T03:35:32.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:31 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:35:32.492 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2023-05-08T03:35:32.493 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-05-08T03:35:32.493 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/etc/ceph/ceph.conf 2023-05-08T03:35:32.522 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-05-08T03:35:32.522 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-05-08T03:35:32.589 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-05-08T03:35:32.589 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/etc/ceph/ceph.conf 2023-05-08T03:35:32.625 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-05-08T03:35:32.626 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-05-08T03:35:32.693 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2023-05-08T03:35:32.694 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/etc/ceph/ceph.conf 2023-05-08T03:35:32.732 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2023-05-08T03:35:32.733 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-05-08T03:35:32.802 INFO:tasks.cephadm:Adding mgr.x on smithi096 2023-05-08T03:35:32.803 INFO:tasks.cephadm:Adding mgr.y on smithi133 2023-05-08T03:35:32.803 INFO:tasks.cephadm:Adding mgr.z on smithi186 2023-05-08T03:35:32.803 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- ceph orch apply mgr '3;smithi096=x;smithi133=y;smithi186=z' 2023-05-08T03:35:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:32 smithi133 ceph-mon[125939]: Updating smithi096:/var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/config/ceph.conf 2023-05-08T03:35:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:32 smithi133 ceph-mon[125939]: Updating smithi133:/var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/config/ceph.conf 2023-05-08T03:35:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:32 smithi133 ceph-mon[125939]: Updating smithi186:/var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/config/ceph.conf 2023-05-08T03:35:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:32 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:35:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:32 smithi133 ceph-mon[125939]: Reconfiguring mon.a (unknown last config time)... 2023-05-08T03:35:32.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:32 smithi133 ceph-mon[125939]: Reconfiguring daemon mon.a on smithi096 2023-05-08T03:35:32.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:32 smithi133 ceph-mon[125939]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:32.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:32 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/3335127826' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:35:32.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:32 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:32 smithi096 ceph-mon[124666]: Updating smithi096:/var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/config/ceph.conf 2023-05-08T03:35:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:32 smithi096 ceph-mon[124666]: Updating smithi133:/var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/config/ceph.conf 2023-05-08T03:35:33.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:32 smithi096 ceph-mon[124666]: Updating smithi186:/var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/config/ceph.conf 2023-05-08T03:35:33.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:32 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:35:33.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:32 smithi096 ceph-mon[124666]: Reconfiguring mon.a (unknown last config time)... 2023-05-08T03:35:33.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:32 smithi096 ceph-mon[124666]: Reconfiguring daemon mon.a on smithi096 2023-05-08T03:35:33.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:32 smithi096 ceph-mon[124666]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:33.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:32 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/3335127826' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:35:33.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:32 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:33.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:32 smithi186 ceph-mon[126480]: Updating smithi096:/var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/config/ceph.conf 2023-05-08T03:35:33.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:32 smithi186 ceph-mon[126480]: Updating smithi133:/var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/config/ceph.conf 2023-05-08T03:35:33.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:32 smithi186 ceph-mon[126480]: Updating smithi186:/var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/config/ceph.conf 2023-05-08T03:35:33.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:32 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:35:33.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:32 smithi186 ceph-mon[126480]: Reconfiguring mon.a (unknown last config time)... 2023-05-08T03:35:33.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:32 smithi186 ceph-mon[126480]: Reconfiguring daemon mon.a on smithi096 2023-05-08T03:35:33.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:32 smithi186 ceph-mon[126480]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:33.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:32 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/3335127826' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:35:33.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:32 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:33.478 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.c/config 2023-05-08T03:35:34.091 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:33 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:34.091 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:33 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:34.091 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:33 smithi186 ceph-mon[126480]: Reconfiguring mon.b (monmap changed)... 2023-05-08T03:35:34.091 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:33 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-05-08T03:35:34.092 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:33 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-05-08T03:35:34.092 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:33 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:35:34.092 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:33 smithi186 ceph-mon[126480]: Reconfiguring daemon mon.b on smithi133 2023-05-08T03:35:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:33 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:33 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:34.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:33 smithi133 ceph-mon[125939]: Reconfiguring mon.b (monmap changed)... 2023-05-08T03:35:34.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:33 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-05-08T03:35:34.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:33 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-05-08T03:35:34.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:33 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:35:34.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:33 smithi133 ceph-mon[125939]: Reconfiguring daemon mon.b on smithi133 2023-05-08T03:35:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:33 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:33 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:34.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:33 smithi096 ceph-mon[124666]: Reconfiguring mon.b (monmap changed)... 2023-05-08T03:35:34.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:33 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-05-08T03:35:34.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:33 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-05-08T03:35:34.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:33 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:35:34.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:33 smithi096 ceph-mon[124666]: Reconfiguring daemon mon.b on smithi133 2023-05-08T03:35:34.804 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:34.802+0000 7f4c2e3d6700 1 -- 172.21.15.186:0/1576206267 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c280fee40 msgr2=0x7f4c280ff250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:35:34.804 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:34.802+0000 7f4c2e3d6700 1 --2- 172.21.15.186:0/1576206267 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c280fee40 0x7f4c280ff250 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4c18009910 tx=0x7f4c18009c20 comp rx=0 tx=0).stop 2023-05-08T03:35:34.804 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:34.802+0000 7f4c2e3d6700 1 -- 172.21.15.186:0/1576206267 shutdown_connections 2023-05-08T03:35:34.805 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:34.802+0000 7f4c2e3d6700 1 --2- 172.21.15.186:0/1576206267 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c280fee40 0x7f4c280ff250 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:35:34.805 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:34.802+0000 7f4c2e3d6700 1 -- 172.21.15.186:0/1576206267 >> 172.21.15.186:0/1576206267 conn(0x7f4c280fa3f0 msgr2=0x7f4c280fc820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:35:34.805 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:34.802+0000 7f4c2e3d6700 1 -- 172.21.15.186:0/1576206267 shutdown_connections 2023-05-08T03:35:34.805 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:34.802+0000 7f4c2e3d6700 1 -- 172.21.15.186:0/1576206267 wait complete. 2023-05-08T03:35:34.807 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:34.803+0000 7f4c2e3d6700 1 Processor -- start 2023-05-08T03:35:34.807 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:34.803+0000 7f4c2e3d6700 1 -- start start 2023-05-08T03:35:34.807 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:34.803+0000 7f4c2e3d6700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4c280fee40 0x7f4c28194070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:35:34.807 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:34.803+0000 7f4c2e3d6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c281945b0 0x7f4c28199620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:35:34.808 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:34.803+0000 7f4c2e3d6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c28194a20 0x7f4c2819bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:35:34.808 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:34.803+0000 7f4c2e3d6700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2819c330 con 0x7f4c281945b0 2023-05-08T03:35:34.808 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:34.803+0000 7f4c2e3d6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2819c4a0 con 0x7f4c28194a20 2023-05-08T03:35:34.808 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:34.803+0000 7f4c2e3d6700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2819c660 con 0x7f4c280fee40 2023-05-08T03:35:34.808 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:34.803+0000 7f4c27fff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4c280fee40 0x7f4c28194070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:35:34.808 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:34.803+0000 7f4c27fff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4c280fee40 0x7f4c28194070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.186:52502/0 (socket says 172.21.15.186:52502) 2023-05-08T03:35:34.808 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:34.803+0000 7f4c27fff700 1 -- 172.21.15.186:0/530982991 learned_addr learned my addr 172.21.15.186:0/530982991 (peer_addr_for_me v2:172.21.15.186:0/0) 2023-05-08T03:35:34.809 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:34.803+0000 7f4c277fe700 1 --2- 172.21.15.186:0/530982991 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c281945b0 0x7f4c28199620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:35:34.809 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:34.804+0000 7f4c2c973700 1 --2- 172.21.15.186:0/530982991 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c28194a20 0x7f4c2819bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:35:34.809 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:34.804+0000 7f4c27fff700 1 -- 172.21.15.186:0/530982991 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c28194a20 msgr2=0x7f4c2819bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:35:34.809 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:34.804+0000 7f4c27fff700 1 --2- 172.21.15.186:0/530982991 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c28194a20 0x7f4c2819bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:35:34.809 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:34.804+0000 7f4c27fff700 1 -- 172.21.15.186:0/530982991 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c281945b0 msgr2=0x7f4c28199620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:35:34.809 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:34.804+0000 7f4c27fff700 1 --2- 172.21.15.186:0/530982991 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c281945b0 0x7f4c28199620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:35:34.809 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:34.804+0000 7f4c27fff700 1 -- 172.21.15.186:0/530982991 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c180095f0 con 0x7f4c280fee40 2023-05-08T03:35:34.809 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:34.804+0000 7f4c2c973700 1 --2- 172.21.15.186:0/530982991 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c28194a20 0x7f4c2819bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-08T03:35:34.810 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:34.804+0000 7f4c27fff700 1 --2- 172.21.15.186:0/530982991 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4c280fee40 0x7f4c28194070 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4c18004690 tx=0x7f4c18004cb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:35:34.810 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:34.804+0000 7f4c257fa700 1 -- 172.21.15.186:0/530982991 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1801d070 con 0x7f4c280fee40 2023-05-08T03:35:34.810 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:34.804+0000 7f4c257fa700 1 -- 172.21.15.186:0/530982991 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4c1800be20 con 0x7f4c280fee40 2023-05-08T03:35:34.810 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:34.804+0000 7f4c2e3d6700 1 -- 172.21.15.186:0/530982991 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c28104c40 con 0x7f4c280fee40 2023-05-08T03:35:34.810 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:34.804+0000 7f4c257fa700 1 -- 172.21.15.186:0/530982991 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1800f460 con 0x7f4c280fee40 2023-05-08T03:35:34.810 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:34.804+0000 7f4c2e3d6700 1 -- 172.21.15.186:0/530982991 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c28104ab0 con 0x7f4c280fee40 2023-05-08T03:35:34.810 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:34.805+0000 7f4c257fa700 1 -- 172.21.15.186:0/530982991 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 13) v1 ==== 45539+0+0 (secure 0 0 0) 0x7f4c1800f5c0 con 0x7f4c280fee40 2023-05-08T03:35:34.810 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:34.805+0000 7f4c2e3d6700 1 -- 172.21.15.186:0/530982991 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c2818d970 con 0x7f4c280fee40 2023-05-08T03:35:34.811 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:34.805+0000 7f4c257fa700 1 --2- 172.21.15.186:0/530982991 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f4c14038cf0 0x7f4c1403b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:35:34.811 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:34.805+0000 7f4c257fa700 1 -- 172.21.15.186:0/530982991 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f4c1804c7a0 con 0x7f4c280fee40 2023-05-08T03:35:34.811 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:34.805+0000 7f4c277fe700 1 --2- 172.21.15.186:0/530982991 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f4c14038cf0 0x7f4c1403b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:35:34.811 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:34.806+0000 7f4c277fe700 1 --2- 172.21.15.186:0/530982991 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f4c14038cf0 0x7f4c1403b1a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4c10009ad0 tx=0x7f4c10009210 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:35:34.812 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:34.810+0000 7f4c257fa700 1 -- 172.21.15.186:0/530982991 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f4c18020550 con 0x7f4c280fee40 2023-05-08T03:35:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:34 smithi186 ceph-mon[126480]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:34 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:34 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:34 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-05-08T03:35:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:34 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-05-08T03:35:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:34 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:35:35.023 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:35.021+0000 7f4c2e3d6700 1 -- 172.21.15.186:0/530982991 --> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi096=x;smithi133=y;smithi186=z", "target": ["mon-mgr", ""]}) v1 -- 0x7f4c280ff8d0 con 0x7f4c14038cf0 2023-05-08T03:35:35.029 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:35.027+0000 7f4c257fa700 1 -- 172.21.15.186:0/530982991 <== mgr.14152 v2:172.21.15.96:6800/2748629182 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f4c280ff8d0 con 0x7f4c14038cf0 2023-05-08T03:35:35.029 INFO:teuthology.orchestra.run.smithi186.stdout:Scheduled mgr update... 2023-05-08T03:35:35.032 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:35.029+0000 7f4c2e3d6700 1 -- 172.21.15.186:0/530982991 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f4c14038cf0 msgr2=0x7f4c1403b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:35:35.032 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:35.029+0000 7f4c2e3d6700 1 --2- 172.21.15.186:0/530982991 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f4c14038cf0 0x7f4c1403b1a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4c10009ad0 tx=0x7f4c10009210 comp rx=0 tx=0).stop 2023-05-08T03:35:35.032 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:35.029+0000 7f4c2e3d6700 1 -- 172.21.15.186:0/530982991 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4c280fee40 msgr2=0x7f4c28194070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:35:35.032 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:35.029+0000 7f4c2e3d6700 1 --2- 172.21.15.186:0/530982991 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4c280fee40 0x7f4c28194070 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4c18004690 tx=0x7f4c18004cb0 comp rx=0 tx=0).stop 2023-05-08T03:35:35.032 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:35.030+0000 7f4c2e3d6700 1 -- 172.21.15.186:0/530982991 shutdown_connections 2023-05-08T03:35:35.032 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:35.030+0000 7f4c2e3d6700 1 --2- 172.21.15.186:0/530982991 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f4c14038cf0 0x7f4c1403b1a0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:35:35.033 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:35.030+0000 7f4c2e3d6700 1 --2- 172.21.15.186:0/530982991 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c28194a20 0x7f4c2819bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:35:35.033 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:35.030+0000 7f4c2e3d6700 1 --2- 172.21.15.186:0/530982991 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4c280fee40 0x7f4c28194070 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:35:35.033 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:35.030+0000 7f4c2e3d6700 1 --2- 172.21.15.186:0/530982991 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c281945b0 0x7f4c28199620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:35:35.033 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:35.030+0000 7f4c2e3d6700 1 -- 172.21.15.186:0/530982991 >> 172.21.15.186:0/530982991 conn(0x7f4c280fa3f0 msgr2=0x7f4c280fb0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:35:35.033 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:35.030+0000 7f4c2e3d6700 1 -- 172.21.15.186:0/530982991 shutdown_connections 2023-05-08T03:35:35.033 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:35:35.030+0000 7f4c2e3d6700 1 -- 172.21.15.186:0/530982991 wait complete. 2023-05-08T03:35:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:34 smithi133 ceph-mon[125939]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:35.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:34 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:35.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:34 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:35.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:34 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-05-08T03:35:35.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:34 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-05-08T03:35:35.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:34 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:35:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:34 smithi096 ceph-mon[124666]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:34 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:34 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:34 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-05-08T03:35:35.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:34 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-05-08T03:35:35.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:34 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:35:35.736 DEBUG:teuthology.orchestra.run.smithi133:mgr.y> sudo journalctl -f -n 0 -u ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c@mgr.y.service 2023-05-08T03:35:35.739 DEBUG:teuthology.orchestra.run.smithi186:mgr.z> sudo journalctl -f -n 0 -u ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c@mgr.z.service 2023-05-08T03:35:35.742 INFO:tasks.cephadm:Deploying OSDs... 2023-05-08T03:35:35.742 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-05-08T03:35:35.742 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/scratch_devs of=/dev/stdout 2023-05-08T03:35:35.763 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-05-08T03:35:35.764 DEBUG:teuthology.orchestra.run.smithi096:> stat /dev/vg_nvme/lv_1 2023-05-08T03:35:35.771 INFO:journalctl@ceph.mgr.z.smithi186.stdout:-- Logs begin at Mon 2023-05-08 03:08:31 UTC. -- 2023-05-08T03:35:35.773 INFO:journalctl@ceph.mgr.y.smithi133.stdout:-- Logs begin at Mon 2023-05-08 03:07:41 UTC. -- 2023-05-08T03:35:35.823 INFO:teuthology.orchestra.run.smithi096.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-05-08T03:35:35.824 INFO:teuthology.orchestra.run.smithi096.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-08T03:35:35.824 INFO:teuthology.orchestra.run.smithi096.stdout:Device: 6h/6d Inode: 369931 Links: 1 2023-05-08T03:35:35.824 INFO:teuthology.orchestra.run.smithi096.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-08T03:35:35.824 INFO:teuthology.orchestra.run.smithi096.stdout:Context: system_u:object_r:device_t:s0 2023-05-08T03:35:35.824 INFO:teuthology.orchestra.run.smithi096.stdout:Access: 2023-05-08 03:34:48.233584218 +0000 2023-05-08T03:35:35.825 INFO:teuthology.orchestra.run.smithi096.stdout:Modify: 2023-05-08 03:18:09.366801921 +0000 2023-05-08T03:35:35.825 INFO:teuthology.orchestra.run.smithi096.stdout:Change: 2023-05-08 03:18:09.366801921 +0000 2023-05-08T03:35:35.825 INFO:teuthology.orchestra.run.smithi096.stdout: Birth: - 2023-05-08T03:35:35.825 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-05-08T03:35:35.893 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records in 2023-05-08T03:35:35.893 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records out 2023-05-08T03:35:35.894 INFO:teuthology.orchestra.run.smithi096.stderr:512 bytes copied, 0.000257466 s, 2.0 MB/s 2023-05-08T03:35:35.894 DEBUG:teuthology.orchestra.run.smithi096:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-05-08T03:35:35.955 DEBUG:teuthology.orchestra.run.smithi096:> stat /dev/vg_nvme/lv_2 2023-05-08T03:35:36.013 INFO:teuthology.orchestra.run.smithi096.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-05-08T03:35:36.013 INFO:teuthology.orchestra.run.smithi096.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-08T03:35:36.014 INFO:teuthology.orchestra.run.smithi096.stdout:Device: 6h/6d Inode: 365080 Links: 1 2023-05-08T03:35:36.014 INFO:teuthology.orchestra.run.smithi096.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-08T03:35:36.014 INFO:teuthology.orchestra.run.smithi096.stdout:Context: system_u:object_r:device_t:s0 2023-05-08T03:35:36.014 INFO:teuthology.orchestra.run.smithi096.stdout:Access: 2023-05-08 03:34:48.233584218 +0000 2023-05-08T03:35:36.014 INFO:teuthology.orchestra.run.smithi096.stdout:Modify: 2023-05-08 03:18:09.893789392 +0000 2023-05-08T03:35:36.014 INFO:teuthology.orchestra.run.smithi096.stdout:Change: 2023-05-08 03:18:09.893789392 +0000 2023-05-08T03:35:36.014 INFO:teuthology.orchestra.run.smithi096.stdout: Birth: - 2023-05-08T03:35:36.015 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-05-08T03:35:36.079 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:35 smithi096 ceph-mon[124666]: Reconfiguring mon.c (monmap changed)... 2023-05-08T03:35:36.079 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:35 smithi096 ceph-mon[124666]: Reconfiguring daemon mon.c on smithi186 2023-05-08T03:35:36.080 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:35 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:36.080 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:35 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:36.080 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:35 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:36.080 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:35 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:35:36.080 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:35 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:35:36.080 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:35 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:35:36.080 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:35 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:36.081 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records in 2023-05-08T03:35:36.081 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records out 2023-05-08T03:35:36.082 INFO:teuthology.orchestra.run.smithi096.stderr:512 bytes copied, 0.00022031 s, 2.3 MB/s 2023-05-08T03:35:36.082 DEBUG:teuthology.orchestra.run.smithi096:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-05-08T03:35:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:35 smithi186 ceph-mon[126480]: Reconfiguring mon.c (monmap changed)... 2023-05-08T03:35:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:35 smithi186 ceph-mon[126480]: Reconfiguring daemon mon.c on smithi186 2023-05-08T03:35:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:35 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:35 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:35 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:36.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:35 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:35:36.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:35 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:35:36.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:35 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:35:36.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:35 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:36.141 DEBUG:teuthology.orchestra.run.smithi096:> stat /dev/vg_nvme/lv_3 2023-05-08T03:35:36.198 INFO:teuthology.orchestra.run.smithi096.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-05-08T03:35:36.199 INFO:teuthology.orchestra.run.smithi096.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-08T03:35:36.199 INFO:teuthology.orchestra.run.smithi096.stdout:Device: 6h/6d Inode: 365206 Links: 1 2023-05-08T03:35:36.199 INFO:teuthology.orchestra.run.smithi096.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-08T03:35:36.199 INFO:teuthology.orchestra.run.smithi096.stdout:Context: system_u:object_r:device_t:s0 2023-05-08T03:35:36.199 INFO:teuthology.orchestra.run.smithi096.stdout:Access: 2023-05-08 03:34:48.233584218 +0000 2023-05-08T03:35:36.199 INFO:teuthology.orchestra.run.smithi096.stdout:Modify: 2023-05-08 03:18:10.414777006 +0000 2023-05-08T03:35:36.199 INFO:teuthology.orchestra.run.smithi096.stdout:Change: 2023-05-08 03:18:10.414777006 +0000 2023-05-08T03:35:36.200 INFO:teuthology.orchestra.run.smithi096.stdout: Birth: - 2023-05-08T03:35:36.200 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-05-08T03:35:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:35 smithi133 ceph-mon[125939]: Reconfiguring mon.c (monmap changed)... 2023-05-08T03:35:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:35 smithi133 ceph-mon[125939]: Reconfiguring daemon mon.c on smithi186 2023-05-08T03:35:36.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:35 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:36.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:35 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:36.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:35 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:36.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:35 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:35:36.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:35 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:35:36.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:35 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:35:36.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:35 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:36.267 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records in 2023-05-08T03:35:36.267 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records out 2023-05-08T03:35:36.267 INFO:teuthology.orchestra.run.smithi096.stderr:512 bytes copied, 0.000226286 s, 2.3 MB/s 2023-05-08T03:35:36.268 DEBUG:teuthology.orchestra.run.smithi096:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-05-08T03:35:36.326 DEBUG:teuthology.orchestra.run.smithi096:> stat /dev/vg_nvme/lv_4 2023-05-08T03:35:36.383 INFO:teuthology.orchestra.run.smithi096.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-05-08T03:35:36.383 INFO:teuthology.orchestra.run.smithi096.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-08T03:35:36.384 INFO:teuthology.orchestra.run.smithi096.stdout:Device: 6h/6d Inode: 370946 Links: 1 2023-05-08T03:35:36.384 INFO:teuthology.orchestra.run.smithi096.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-08T03:35:36.384 INFO:teuthology.orchestra.run.smithi096.stdout:Context: system_u:object_r:device_t:s0 2023-05-08T03:35:36.384 INFO:teuthology.orchestra.run.smithi096.stdout:Access: 2023-05-08 03:34:48.233584218 +0000 2023-05-08T03:35:36.384 INFO:teuthology.orchestra.run.smithi096.stdout:Modify: 2023-05-08 03:18:10.939764525 +0000 2023-05-08T03:35:36.384 INFO:teuthology.orchestra.run.smithi096.stdout:Change: 2023-05-08 03:18:10.939764525 +0000 2023-05-08T03:35:36.384 INFO:teuthology.orchestra.run.smithi096.stdout: Birth: - 2023-05-08T03:35:36.385 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-05-08T03:35:36.448 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records in 2023-05-08T03:35:36.448 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records out 2023-05-08T03:35:36.448 INFO:teuthology.orchestra.run.smithi096.stderr:512 bytes copied, 0.000172696 s, 3.0 MB/s 2023-05-08T03:35:36.449 DEBUG:teuthology.orchestra.run.smithi096:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-05-08T03:35:36.507 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-05-08T03:35:36.507 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/scratch_devs of=/dev/stdout 2023-05-08T03:35:36.528 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-05-08T03:35:36.528 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_1 2023-05-08T03:35:36.587 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-05-08T03:35:36.588 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-08T03:35:36.588 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 6h/6d Inode: 366818 Links: 1 2023-05-08T03:35:36.588 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-08T03:35:36.588 INFO:teuthology.orchestra.run.smithi133.stdout:Context: system_u:object_r:device_t:s0 2023-05-08T03:35:36.588 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2023-05-08 03:35:23.318050487 +0000 2023-05-08T03:35:36.588 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2023-05-08 03:20:29.564765801 +0000 2023-05-08T03:35:36.588 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2023-05-08 03:20:29.564765801 +0000 2023-05-08T03:35:36.589 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: - 2023-05-08T03:35:36.589 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-05-08T03:35:36.657 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2023-05-08T03:35:36.658 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2023-05-08T03:35:36.658 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.000263647 s, 1.9 MB/s 2023-05-08T03:35:36.659 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-05-08T03:35:36.718 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_2 2023-05-08T03:35:36.777 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-05-08T03:35:36.778 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-08T03:35:36.778 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 6h/6d Inode: 362488 Links: 1 2023-05-08T03:35:36.778 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-08T03:35:36.778 INFO:teuthology.orchestra.run.smithi133.stdout:Context: system_u:object_r:device_t:s0 2023-05-08T03:35:36.778 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2023-05-08 03:35:23.318050487 +0000 2023-05-08T03:35:36.778 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2023-05-08 03:20:30.076756336 +0000 2023-05-08T03:35:36.779 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2023-05-08 03:20:30.076756336 +0000 2023-05-08T03:35:36.779 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: - 2023-05-08T03:35:36.780 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-05-08T03:35:36.845 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2023-05-08T03:35:36.845 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2023-05-08T03:35:36.846 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.000229715 s, 2.2 MB/s 2023-05-08T03:35:36.847 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-05-08T03:35:36.906 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_3 2023-05-08T03:35:36.963 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-05-08T03:35:36.963 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-08T03:35:36.963 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 6h/6d Inode: 368181 Links: 1 2023-05-08T03:35:36.963 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-08T03:35:36.964 INFO:teuthology.orchestra.run.smithi133.stdout:Context: system_u:object_r:device_t:s0 2023-05-08T03:35:36.964 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2023-05-08 03:35:23.319050468 +0000 2023-05-08T03:35:36.964 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2023-05-08 03:20:30.592746797 +0000 2023-05-08T03:35:36.964 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2023-05-08 03:20:30.592746797 +0000 2023-05-08T03:35:36.964 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: - 2023-05-08T03:35:36.964 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-05-08T03:35:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:36 smithi133 ceph-mon[125939]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi096=x;smithi133=y;smithi186=z", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:35:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:36 smithi133 ceph-mon[125939]: Saving service mgr spec with placement smithi096=x;smithi133=y;smithi186=z;count:3 2023-05-08T03:35:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:36 smithi133 ceph-mon[125939]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:36 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:35:36.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:36 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T03:35:36.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:36 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-05-08T03:35:36.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:36 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-05-08T03:35:36.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:36 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-05-08T03:35:36.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:36 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:35:36.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:36 smithi133 ceph-mon[125939]: Deploying daemon mgr.z on smithi186 2023-05-08T03:35:37.016 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2023-05-08T03:35:37.017 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2023-05-08T03:35:37.017 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.000222601 s, 2.3 MB/s 2023-05-08T03:35:37.018 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-05-08T03:35:37.075 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_4 2023-05-08T03:35:37.093 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:36 smithi186 ceph-mon[126480]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi096=x;smithi133=y;smithi186=z", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:35:37.093 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:36 smithi186 ceph-mon[126480]: Saving service mgr spec with placement smithi096=x;smithi133=y;smithi186=z;count:3 2023-05-08T03:35:37.093 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:36 smithi186 ceph-mon[126480]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:37.094 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:36 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:35:37.094 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:36 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T03:35:37.094 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:36 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-05-08T03:35:37.094 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:36 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-05-08T03:35:37.094 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:36 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-05-08T03:35:37.094 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:36 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:35:37.094 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:36 smithi186 ceph-mon[126480]: Deploying daemon mgr.z on smithi186 2023-05-08T03:35:37.133 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-05-08T03:35:37.133 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-08T03:35:37.133 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 6h/6d Inode: 368216 Links: 1 2023-05-08T03:35:37.133 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-08T03:35:37.134 INFO:teuthology.orchestra.run.smithi133.stdout:Context: system_u:object_r:device_t:s0 2023-05-08T03:35:37.134 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2023-05-08 03:35:23.319050468 +0000 2023-05-08T03:35:37.134 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2023-05-08 03:20:31.103737351 +0000 2023-05-08T03:35:37.134 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2023-05-08 03:20:31.103737351 +0000 2023-05-08T03:35:37.134 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: - 2023-05-08T03:35:37.134 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-05-08T03:35:37.199 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2023-05-08T03:35:37.200 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2023-05-08T03:35:37.200 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.00017634 s, 2.9 MB/s 2023-05-08T03:35:37.201 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-05-08T03:35:37.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:36 smithi096 ceph-mon[124666]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi096=x;smithi133=y;smithi186=z", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:35:37.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:36 smithi096 ceph-mon[124666]: Saving service mgr spec with placement smithi096=x;smithi133=y;smithi186=z;count:3 2023-05-08T03:35:37.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:36 smithi096 ceph-mon[124666]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:37.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:36 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:35:37.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:36 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T03:35:37.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:36 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-05-08T03:35:37.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:36 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-05-08T03:35:37.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:36 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-05-08T03:35:37.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:36 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:35:37.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:36 smithi096 ceph-mon[124666]: Deploying daemon mgr.z on smithi186 2023-05-08T03:35:37.258 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2023-05-08T03:35:37.258 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/scratch_devs of=/dev/stdout 2023-05-08T03:35:37.276 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-05-08T03:35:37.277 DEBUG:teuthology.orchestra.run.smithi186:> stat /dev/vg_nvme/lv_1 2023-05-08T03:35:37.333 INFO:teuthology.orchestra.run.smithi186.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-05-08T03:35:37.333 INFO:teuthology.orchestra.run.smithi186.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-08T03:35:37.333 INFO:teuthology.orchestra.run.smithi186.stdout:Device: 6h/6d Inode: 368005 Links: 1 2023-05-08T03:35:37.333 INFO:teuthology.orchestra.run.smithi186.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-08T03:35:37.334 INFO:teuthology.orchestra.run.smithi186.stdout:Context: system_u:object_r:device_t:s0 2023-05-08T03:35:37.334 INFO:teuthology.orchestra.run.smithi186.stdout:Access: 2023-05-08 03:35:37.328300337 +0000 2023-05-08T03:35:37.334 INFO:teuthology.orchestra.run.smithi186.stdout:Modify: 2023-05-08 03:24:58.475627725 +0000 2023-05-08T03:35:37.334 INFO:teuthology.orchestra.run.smithi186.stdout:Change: 2023-05-08 03:24:58.475627725 +0000 2023-05-08T03:35:37.334 INFO:teuthology.orchestra.run.smithi186.stdout: Birth: - 2023-05-08T03:35:37.335 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-05-08T03:35:37.409 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records in 2023-05-08T03:35:37.409 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records out 2023-05-08T03:35:37.410 INFO:teuthology.orchestra.run.smithi186.stderr:512 bytes copied, 0.000254187 s, 2.0 MB/s 2023-05-08T03:35:37.411 DEBUG:teuthology.orchestra.run.smithi186:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-05-08T03:35:37.470 DEBUG:teuthology.orchestra.run.smithi186:> stat /dev/vg_nvme/lv_2 2023-05-08T03:35:37.529 INFO:teuthology.orchestra.run.smithi186.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-05-08T03:35:37.529 INFO:teuthology.orchestra.run.smithi186.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-08T03:35:37.530 INFO:teuthology.orchestra.run.smithi186.stdout:Device: 6h/6d Inode: 359379 Links: 1 2023-05-08T03:35:37.530 INFO:teuthology.orchestra.run.smithi186.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-08T03:35:37.530 INFO:teuthology.orchestra.run.smithi186.stdout:Context: system_u:object_r:device_t:s0 2023-05-08T03:35:37.530 INFO:teuthology.orchestra.run.smithi186.stdout:Access: 2023-05-08 03:35:37.328300337 +0000 2023-05-08T03:35:37.530 INFO:teuthology.orchestra.run.smithi186.stdout:Modify: 2023-05-08 03:24:59.005617741 +0000 2023-05-08T03:35:37.530 INFO:teuthology.orchestra.run.smithi186.stdout:Change: 2023-05-08 03:24:59.005617741 +0000 2023-05-08T03:35:37.530 INFO:teuthology.orchestra.run.smithi186.stdout: Birth: - 2023-05-08T03:35:37.531 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-05-08T03:35:37.595 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records in 2023-05-08T03:35:37.595 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records out 2023-05-08T03:35:37.596 INFO:teuthology.orchestra.run.smithi186.stderr:512 bytes copied, 0.000219247 s, 2.3 MB/s 2023-05-08T03:35:37.596 DEBUG:teuthology.orchestra.run.smithi186:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-05-08T03:35:37.654 DEBUG:teuthology.orchestra.run.smithi186:> stat /dev/vg_nvme/lv_3 2023-05-08T03:35:37.691 INFO:journalctl@ceph.mgr.z.smithi186.stdout:May 08 03:35:37 smithi186 systemd[1]: Starting Ceph mgr.z for f7ffcfb0-ed50-11ed-9b01-001a4aab830c... 2023-05-08T03:35:37.707 INFO:teuthology.orchestra.run.smithi186.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-05-08T03:35:37.707 INFO:teuthology.orchestra.run.smithi186.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-08T03:35:37.707 INFO:teuthology.orchestra.run.smithi186.stdout:Device: 6h/6d Inode: 364268 Links: 1 2023-05-08T03:35:37.707 INFO:teuthology.orchestra.run.smithi186.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-08T03:35:37.707 INFO:teuthology.orchestra.run.smithi186.stdout:Context: system_u:object_r:device_t:s0 2023-05-08T03:35:37.707 INFO:teuthology.orchestra.run.smithi186.stdout:Access: 2023-05-08 03:35:37.328300337 +0000 2023-05-08T03:35:37.708 INFO:teuthology.orchestra.run.smithi186.stdout:Modify: 2023-05-08 03:24:59.536607739 +0000 2023-05-08T03:35:37.708 INFO:teuthology.orchestra.run.smithi186.stdout:Change: 2023-05-08 03:24:59.536607739 +0000 2023-05-08T03:35:37.708 INFO:teuthology.orchestra.run.smithi186.stdout: Birth: - 2023-05-08T03:35:37.708 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-05-08T03:35:37.771 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records in 2023-05-08T03:35:37.772 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records out 2023-05-08T03:35:37.772 INFO:teuthology.orchestra.run.smithi186.stderr:512 bytes copied, 0.000241861 s, 2.1 MB/s 2023-05-08T03:35:37.774 DEBUG:teuthology.orchestra.run.smithi186:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-05-08T03:35:37.832 DEBUG:teuthology.orchestra.run.smithi186:> stat /dev/vg_nvme/lv_4 2023-05-08T03:35:37.889 INFO:teuthology.orchestra.run.smithi186.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-05-08T03:35:37.889 INFO:teuthology.orchestra.run.smithi186.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-08T03:35:37.889 INFO:teuthology.orchestra.run.smithi186.stdout:Device: 6h/6d Inode: 371832 Links: 1 2023-05-08T03:35:37.889 INFO:teuthology.orchestra.run.smithi186.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-08T03:35:37.889 INFO:teuthology.orchestra.run.smithi186.stdout:Context: system_u:object_r:device_t:s0 2023-05-08T03:35:37.890 INFO:teuthology.orchestra.run.smithi186.stdout:Access: 2023-05-08 03:35:37.328300337 +0000 2023-05-08T03:35:37.890 INFO:teuthology.orchestra.run.smithi186.stdout:Modify: 2023-05-08 03:25:00.063597812 +0000 2023-05-08T03:35:37.890 INFO:teuthology.orchestra.run.smithi186.stdout:Change: 2023-05-08 03:25:00.063597812 +0000 2023-05-08T03:35:37.890 INFO:teuthology.orchestra.run.smithi186.stdout: Birth: - 2023-05-08T03:35:37.890 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-05-08T03:35:37.951 INFO:journalctl@ceph.mgr.z.smithi186.stdout:May 08 03:35:37 smithi186 podman[128422]: 2023-05-08T03:35:37.954 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records in 2023-05-08T03:35:37.954 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records out 2023-05-08T03:35:37.954 INFO:teuthology.orchestra.run.smithi186.stderr:512 bytes copied, 0.000193307 s, 2.6 MB/s 2023-05-08T03:35:37.955 DEBUG:teuthology.orchestra.run.smithi186:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-05-08T03:35:38.014 INFO:tasks.cephadm:Deploying osd.0 on smithi096 with /dev/vg_nvme/lv_4... 2023-05-08T03:35:38.014 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-05-08T03:35:38.211 INFO:journalctl@ceph.mgr.z.smithi186.stdout:May 08 03:35:38 smithi186 ceph-mgr[128607]: -- 172.21.15.186:0/1899002224 <== mon.1 v2:172.21.15.186:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55b00570cb60 con 0x55b0056e2800 2023-05-08T03:35:38.211 INFO:journalctl@ceph.mgr.z.smithi186.stdout:May 08 03:35:38 smithi186 bash[128422]: adce1a0a92ee7b607641712ce38b1bc89c2ac946faaa24161a33a16286117446 2023-05-08T03:35:38.211 INFO:journalctl@ceph.mgr.z.smithi186.stdout:May 08 03:35:38 smithi186 systemd[1]: Started Ceph mgr.z for f7ffcfb0-ed50-11ed-9b01-001a4aab830c. 2023-05-08T03:35:38.211 INFO:journalctl@ceph.mgr.z.smithi186.stdout:May 08 03:35:38 smithi186 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-z[128521]: 2023-05-08T03:35:38.129+0000 7f53cc76e200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-05-08T03:35:38.212 INFO:journalctl@ceph.mgr.z.smithi186.stdout:May 08 03:35:38 smithi186 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-z[128521]: 2023-05-08T03:35:38.209+0000 7f53cc76e200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-08T03:35:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:38 smithi096 ceph-mon[124666]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:38 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:38 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:38 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:38.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:38 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-05-08T03:35:38.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:38 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-05-08T03:35:38.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:38 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-05-08T03:35:38.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:38 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:35:38.563 INFO:journalctl@ceph.mgr.z.smithi186.stdout:May 08 03:35:38 smithi186 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-z[128521]: 2023-05-08T03:35:38.297+0000 7f53cc76e200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-08T03:35:38.564 INFO:journalctl@ceph.mgr.z.smithi186.stdout:May 08 03:35:38 smithi186 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-z[128521]: 2023-05-08T03:35:38.392+0000 7f53cc76e200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-08T03:35:38.564 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:38 smithi186 ceph-mon[126480]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:38.564 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:38 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:38.564 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:38 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:38.565 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:38 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:38.565 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:38 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-05-08T03:35:38.565 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:38 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-05-08T03:35:38.565 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:38 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-05-08T03:35:38.565 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:38 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:35:38.670 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.a/config 2023-05-08T03:35:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:38 smithi133 ceph-mon[125939]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:38 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:38 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:38.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:38 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:38.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:38 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-05-08T03:35:38.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:38 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-05-08T03:35:38.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:38 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-05-08T03:35:38.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:38 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:35:38.868 INFO:journalctl@ceph.mgr.z.smithi186.stdout:May 08 03:35:38 smithi186 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-z[128521]: 2023-05-08T03:35:38.561+0000 7f53cc76e200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-08T03:35:39.180 INFO:journalctl@ceph.mgr.z.smithi186.stdout:May 08 03:35:38 smithi186 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-z[128521]: 2023-05-08T03:35:38.866+0000 7f53cc76e200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-08T03:35:39.180 INFO:journalctl@ceph.mgr.z.smithi186.stdout:May 08 03:35:38 smithi186 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-z[128521]: 2023-05-08T03:35:38.954+0000 7f53cc76e200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-08T03:35:39.180 INFO:journalctl@ceph.mgr.z.smithi186.stdout:May 08 03:35:39 smithi186 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-z[128521]: 2023-05-08T03:35:39.084+0000 7f53cc76e200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-08T03:35:39.399 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:39 smithi133 ceph-mon[125939]: Deploying daemon mgr.y on smithi133 2023-05-08T03:35:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:39 smithi096 ceph-mon[124666]: Deploying daemon mgr.y on smithi133 2023-05-08T03:35:39.597 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:39 smithi186 ceph-mon[126480]: Deploying daemon mgr.y on smithi133 2023-05-08T03:35:39.598 INFO:journalctl@ceph.mgr.z.smithi186.stdout:May 08 03:35:39 smithi186 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-z[128521]: 2023-05-08T03:35:39.178+0000 7f53cc76e200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-08T03:35:39.740 INFO:journalctl@ceph.mgr.y.smithi133.stdout:May 08 03:35:39 smithi133 systemd[1]: Starting Ceph mgr.y for f7ffcfb0-ed50-11ed-9b01-001a4aab830c... 2023-05-08T03:35:39.868 INFO:journalctl@ceph.mgr.z.smithi186.stdout:May 08 03:35:39 smithi186 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-z[128521]: 2023-05-08T03:35:39.595+0000 7f53cc76e200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-08T03:35:40.171 INFO:journalctl@ceph.mgr.y.smithi133.stdout:May 08 03:35:39 smithi133 podman[127369]: 2023-05-08T03:35:40.226 INFO:teuthology.orchestra.run.smithi096.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-05-08T03:35:40.227 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-05-08T03:35:40.227 INFO:teuthology.orchestra.run.smithi096.stderr: stderr: 10+0 records in 2023-05-08T03:35:40.227 INFO:teuthology.orchestra.run.smithi096.stderr:10+0 records out 2023-05-08T03:35:40.227 INFO:teuthology.orchestra.run.smithi096.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0114018 s, 920 MB/s 2023-05-08T03:35:40.227 INFO:teuthology.orchestra.run.smithi096.stderr:--> Zapping successful for: 2023-05-08T03:35:40.471 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:40 smithi133 ceph-mon[125939]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:40.472 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:40 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:40.472 INFO:journalctl@ceph.mgr.y.smithi133.stdout:May 08 03:35:40 smithi133 bash[127369]: 3f3bf16a2638e68c71d2f2a4ce433512fca4506e38cfa96f71ac6024fd03b8a6 2023-05-08T03:35:40.472 INFO:journalctl@ceph.mgr.y.smithi133.stdout:May 08 03:35:40 smithi133 ceph-mgr[127409]: -- 172.21.15.133:0/2649635968 <== mon.2 v2:172.21.15.133:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x561623b6eb60 con 0x561623b44800 2023-05-08T03:35:40.472 INFO:journalctl@ceph.mgr.y.smithi133.stdout:May 08 03:35:40 smithi133 systemd[1]: Started Ceph mgr.y for f7ffcfb0-ed50-11ed-9b01-001a4aab830c. 2023-05-08T03:35:40.473 INFO:journalctl@ceph.mgr.y.smithi133.stdout:May 08 03:35:40 smithi133 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-y[127385]: 2023-05-08T03:35:40.298+0000 7f090da9e200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-05-08T03:35:40.473 INFO:journalctl@ceph.mgr.y.smithi133.stdout:May 08 03:35:40 smithi133 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-y[127385]: 2023-05-08T03:35:40.377+0000 7f090da9e200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-08T03:35:40.473 INFO:journalctl@ceph.mgr.y.smithi133.stdout:May 08 03:35:40 smithi133 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-y[127385]: 2023-05-08T03:35:40.469+0000 7f090da9e200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-08T03:35:40.618 INFO:journalctl@ceph.mgr.z.smithi186.stdout:May 08 03:35:40 smithi186 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-z[128521]: 2023-05-08T03:35:40.171+0000 7f53cc76e200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-08T03:35:40.619 INFO:journalctl@ceph.mgr.z.smithi186.stdout:May 08 03:35:40 smithi186 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-z[128521]: 2023-05-08T03:35:40.345+0000 7f53cc76e200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-08T03:35:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:40 smithi186 ceph-mon[126480]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:40.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:40 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:40.629 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:40 smithi096 ceph-mon[124666]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:40.629 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:40 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:40.725 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- ceph orch daemon add osd smithi096:vg_nvme/lv_4 2023-05-08T03:35:40.740 INFO:journalctl@ceph.mgr.y.smithi133.stdout:May 08 03:35:40 smithi133 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-y[127385]: 2023-05-08T03:35:40.568+0000 7f090da9e200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-08T03:35:41.068 INFO:journalctl@ceph.mgr.y.smithi133.stdout:May 08 03:35:40 smithi133 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-y[127385]: 2023-05-08T03:35:40.745+0000 7f090da9e200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-08T03:35:41.371 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.a/config 2023-05-08T03:35:41.401 INFO:journalctl@ceph.mgr.y.smithi133.stdout:May 08 03:35:41 smithi133 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-y[127385]: 2023-05-08T03:35:41.064+0000 7f090da9e200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-08T03:35:41.401 INFO:journalctl@ceph.mgr.y.smithi133.stdout:May 08 03:35:41 smithi133 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-y[127385]: 2023-05-08T03:35:41.153+0000 7f090da9e200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-08T03:35:41.402 INFO:journalctl@ceph.mgr.y.smithi133.stdout:May 08 03:35:41 smithi133 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-y[127385]: 2023-05-08T03:35:41.290+0000 7f090da9e200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-08T03:35:41.402 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:41 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:41.402 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:41 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:41.402 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:41 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:41.402 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:41 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:35:41.403 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:41 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:35:41.423 INFO:journalctl@ceph.mgr.z.smithi186.stdout:May 08 03:35:41 smithi186 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-z[128521]: 2023-05-08T03:35:41.147+0000 7f53cc76e200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-08T03:35:41.424 INFO:journalctl@ceph.mgr.z.smithi186.stdout:May 08 03:35:41 smithi186 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-z[128521]: 2023-05-08T03:35:41.245+0000 7f53cc76e200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-05-08T03:35:41.424 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:41 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:41.425 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:41 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:41.425 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:41 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:41.425 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:41 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:35:41.426 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:41 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:35:41.549 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:41 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:41.550 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:41 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:41.550 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:41 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:41.550 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:41 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:35:41.550 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:41 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:35:41.724 INFO:journalctl@ceph.mgr.z.smithi186.stdout:May 08 03:35:41 smithi186 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-z[128521]: 2023-05-08T03:35:41.421+0000 7f53cc76e200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-08T03:35:41.724 INFO:journalctl@ceph.mgr.z.smithi186.stdout:May 08 03:35:41 smithi186 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-z[128521]: 2023-05-08T03:35:41.722+0000 7f53cc76e200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-05-08T03:35:41.740 INFO:journalctl@ceph.mgr.y.smithi133.stdout:May 08 03:35:41 smithi133 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-y[127385]: 2023-05-08T03:35:41.398+0000 7f090da9e200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-08T03:35:42.115 INFO:journalctl@ceph.mgr.z.smithi186.stdout:May 08 03:35:41 smithi186 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-z[128521]: 2023-05-08T03:35:41.963+0000 7f53cc76e200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-08T03:35:42.240 INFO:journalctl@ceph.mgr.y.smithi133.stdout:May 08 03:35:41 smithi133 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-y[127385]: 2023-05-08T03:35:41.848+0000 7f090da9e200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-08T03:35:42.368 INFO:journalctl@ceph.mgr.z.smithi186.stdout:May 08 03:35:42 smithi186 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-z[128521]: 2023-05-08T03:35:42.113+0000 7f53cc76e200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-08T03:35:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:42 smithi186 ceph-mon[126480]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:42 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:42 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:42 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:42 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:42.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:42 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:35:42.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:42 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:35:42.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:42 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:42.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:42 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-05-08T03:35:42.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:42 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-05-08T03:35:42.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:42 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:35:42.608 INFO:journalctl@ceph.mgr.y.smithi133.stdout:May 08 03:35:42 smithi133 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-y[127385]: 2023-05-08T03:35:42.435+0000 7f090da9e200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-08T03:35:42.609 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:42 smithi133 ceph-mon[125939]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:42.609 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:42 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:42.609 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:42 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:42.609 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:42 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:42.609 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:42 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:42.610 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:42 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:35:42.610 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:42 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:35:42.610 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:42 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:42.610 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:42 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-05-08T03:35:42.610 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:42 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-05-08T03:35:42.610 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:42 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:35:42.662 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:42.660+0000 7f26955f3700 1 -- 172.21.15.96:0/1410569447 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26900ff530 msgr2=0x7f26900ff940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:35:42.662 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:42.660+0000 7f26955f3700 1 --2- 172.21.15.96:0/1410569447 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26900ff530 0x7f26900ff940 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2684009990 tx=0x7f2684009ca0 comp rx=0 tx=0).stop 2023-05-08T03:35:42.663 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:42.660+0000 7f26955f3700 1 -- 172.21.15.96:0/1410569447 shutdown_connections 2023-05-08T03:35:42.663 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:42.660+0000 7f26955f3700 1 --2- 172.21.15.96:0/1410569447 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f26901010c0 0x7f2690107980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:35:42.663 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:42.660+0000 7f26955f3700 1 --2- 172.21.15.96:0/1410569447 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26900ff530 0x7f26900ff940 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:35:42.663 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:42.660+0000 7f26955f3700 1 --2- 172.21.15.96:0/1410569447 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2690100730 0x7f2690100b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:35:42.663 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:42.660+0000 7f26955f3700 1 -- 172.21.15.96:0/1410569447 >> 172.21.15.96:0/1410569447 conn(0x7f26900faba0 msgr2=0x7f26900fcfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:35:42.663 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:42.660+0000 7f26955f3700 1 -- 172.21.15.96:0/1410569447 shutdown_connections 2023-05-08T03:35:42.663 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:42.660+0000 7f26955f3700 1 -- 172.21.15.96:0/1410569447 wait complete. 2023-05-08T03:35:42.664 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:42.660+0000 7f26955f3700 1 Processor -- start 2023-05-08T03:35:42.665 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:42.660+0000 7f26955f3700 1 -- start start 2023-05-08T03:35:42.665 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:42.661+0000 7f26955f3700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f26900ff530 0x7f2690069de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:35:42.666 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:42.661+0000 7f26955f3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2690100730 0x7f269019b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:35:42.666 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:42.661+0000 7f26955f3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26901010c0 0x7f269019d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:35:42.666 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:42.661+0000 7f26955f3700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f269019de40 con 0x7f2690100730 2023-05-08T03:35:42.666 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:42.661+0000 7f26955f3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f269019dfb0 con 0x7f26901010c0 2023-05-08T03:35:42.666 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:42.661+0000 7f26955f3700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f269019e170 con 0x7f26900ff530 2023-05-08T03:35:42.666 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:42.661+0000 7f268e7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2690100730 0x7f269019b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:35:42.666 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:42.661+0000 7f268e7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2690100730 0x7f269019b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39552/0 (socket says 172.21.15.96:39552) 2023-05-08T03:35:42.667 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:42.661+0000 7f268e7fc700 1 -- 172.21.15.96:0/2602941057 learned_addr learned my addr 172.21.15.96:0/2602941057 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:35:42.667 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:42.661+0000 7f268effd700 1 --2- 172.21.15.96:0/2602941057 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f26900ff530 0x7f2690069de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:35:42.667 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:42.661+0000 7f268f7fe700 1 --2- 172.21.15.96:0/2602941057 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26901010c0 0x7f269019d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:35:42.667 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:42.661+0000 7f268e7fc700 1 -- 172.21.15.96:0/2602941057 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f26900ff530 msgr2=0x7f2690069de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:35:42.667 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:42.661+0000 7f268e7fc700 1 --2- 172.21.15.96:0/2602941057 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f26900ff530 0x7f2690069de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:35:42.667 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:42.661+0000 7f268e7fc700 1 -- 172.21.15.96:0/2602941057 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26901010c0 msgr2=0x7f269019d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:35:42.667 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:42.661+0000 7f268e7fc700 1 --2- 172.21.15.96:0/2602941057 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26901010c0 0x7f269019d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:35:42.667 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:42.661+0000 7f268e7fc700 1 -- 172.21.15.96:0/2602941057 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26840095f0 con 0x7f2690100730 2023-05-08T03:35:42.668 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:42.661+0000 7f268e7fc700 1 --2- 172.21.15.96:0/2602941057 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2690100730 0x7f269019b010 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f268000d980 tx=0x7f268000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:35:42.668 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:42.661+0000 7f2677fff700 1 -- 172.21.15.96:0/2602941057 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2680004220 con 0x7f2690100730 2023-05-08T03:35:42.668 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:42.661+0000 7f26955f3700 1 -- 172.21.15.96:0/2602941057 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f269010ae80 con 0x7f2690100730 2023-05-08T03:35:42.668 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:42.661+0000 7f2677fff700 1 -- 172.21.15.96:0/2602941057 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2680007640 con 0x7f2690100730 2023-05-08T03:35:42.668 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:42.661+0000 7f2677fff700 1 -- 172.21.15.96:0/2602941057 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2680005690 con 0x7f2690100730 2023-05-08T03:35:42.668 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:42.661+0000 7f26955f3700 1 -- 172.21.15.96:0/2602941057 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f269010acf0 con 0x7f2690100730 2023-05-08T03:35:42.668 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:42.662+0000 7f2677fff700 1 -- 172.21.15.96:0/2602941057 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 13) v1 ==== 45539+0+0 (secure 0 0 0) 0x7f268000f690 con 0x7f2690100730 2023-05-08T03:35:42.669 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:42.662+0000 7f26955f3700 1 -- 172.21.15.96:0/2602941057 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2690067c00 con 0x7f2690100730 2023-05-08T03:35:42.669 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:42.663+0000 7f2677fff700 1 --2- 172.21.15.96:0/2602941057 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f26780389e0 0x7f267803ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:35:42.669 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:42.663+0000 7f2677fff700 1 -- 172.21.15.96:0/2602941057 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f268004b390 con 0x7f2690100730 2023-05-08T03:35:42.669 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:42.663+0000 7f268effd700 1 --2- 172.21.15.96:0/2602941057 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f26780389e0 0x7f267803ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:35:42.669 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:42.663+0000 7f268effd700 1 --2- 172.21.15.96:0/2602941057 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f26780389e0 0x7f267803ae90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f268400b5c0 tx=0x7f2684005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:35:42.670 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:42.668+0000 7f2677fff700 1 -- 172.21.15.96:0/2602941057 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f2680003680 con 0x7f2690100730 2023-05-08T03:35:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:42 smithi096 ceph-mon[124666]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:42 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:42 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:42 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:42.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:42 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:42.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:42 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:35:42.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:42 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:35:42.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:42 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:42.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:42 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-05-08T03:35:42.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:42 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-05-08T03:35:42.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:42 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:35:42.868 INFO:journalctl@ceph.mgr.z.smithi186.stdout:May 08 03:35:42 smithi186 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-z[128521]: 2023-05-08T03:35:42.378+0000 7f53cc76e200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-08T03:35:42.870 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:42.868+0000 7f26955f3700 1 -- 172.21.15.96:0/2602941057 --> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi096:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f269019ed30 con 0x7f26780389e0 2023-05-08T03:35:42.990 INFO:journalctl@ceph.mgr.y.smithi133.stdout:May 08 03:35:42 smithi133 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-y[127385]: 2023-05-08T03:35:42.605+0000 7f090da9e200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-08T03:35:43.368 INFO:journalctl@ceph.mgr.z.smithi186.stdout:May 08 03:35:43 smithi186 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-z[128521]: 2023-05-08T03:35:43.075+0000 7f53cc76e200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-08T03:35:43.369 INFO:journalctl@ceph.mgr.z.smithi186.stdout:May 08 03:35:43 smithi186 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-z[128521]: 2023-05-08T03:35:43.203+0000 7f53cc76e200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-08T03:35:43.621 INFO:journalctl@ceph.mgr.y.smithi133.stdout:May 08 03:35:43 smithi133 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-y[127385]: 2023-05-08T03:35:43.358+0000 7f090da9e200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-08T03:35:43.621 INFO:journalctl@ceph.mgr.y.smithi133.stdout:May 08 03:35:43 smithi133 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-y[127385]: 2023-05-08T03:35:43.447+0000 7f090da9e200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-05-08T03:35:43.621 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:43 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:35:43.622 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:43 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T03:35:43.622 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:43 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:35:43.622 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:43 smithi133 ceph-mon[125939]: Reconfiguring mgr.x (unknown last config time)... 2023-05-08T03:35:43.622 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:43 smithi133 ceph-mon[125939]: Reconfiguring daemon mgr.x on smithi096 2023-05-08T03:35:43.622 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:43 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:43.622 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:43 smithi133 ceph-mon[125939]: from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi096:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:35:43.622 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:43 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-05-08T03:35:43.623 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:43 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-05-08T03:35:43.623 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:43 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:35:43.723 INFO:journalctl@ceph.mgr.z.smithi186.stdout:May 08 03:35:43 smithi186 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-z[128521]: 2023-05-08T03:35:43.393+0000 7f53cc76e200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-08T03:35:43.724 INFO:journalctl@ceph.mgr.z.smithi186.stdout:May 08 03:35:43 smithi186 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-z[128521]: 2023-05-08T03:35:43.505+0000 7f53cc76e200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-08T03:35:43.724 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:43 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:35:43.724 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:43 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T03:35:43.724 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:43 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:35:43.725 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:43 smithi186 ceph-mon[126480]: Reconfiguring mgr.x (unknown last config time)... 2023-05-08T03:35:43.725 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:43 smithi186 ceph-mon[126480]: Reconfiguring daemon mgr.x on smithi096 2023-05-08T03:35:43.725 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:43 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:43.725 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:43 smithi186 ceph-mon[126480]: from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi096:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:35:43.725 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:43 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-05-08T03:35:43.725 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:43 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-05-08T03:35:43.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:43 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:35:43.898 INFO:journalctl@ceph.mgr.y.smithi133.stdout:May 08 03:35:43 smithi133 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-y[127385]: 2023-05-08T03:35:43.618+0000 7f090da9e200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-08T03:35:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:43 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:35:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:43 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T03:35:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:43 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:35:44.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:43 smithi096 ceph-mon[124666]: Reconfiguring mgr.x (unknown last config time)... 2023-05-08T03:35:44.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:43 smithi096 ceph-mon[124666]: Reconfiguring daemon mgr.x on smithi096 2023-05-08T03:35:44.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:43 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:44.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:43 smithi096 ceph-mon[124666]: from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi096:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:35:44.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:43 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-05-08T03:35:44.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:43 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-05-08T03:35:44.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:43 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:35:44.118 INFO:journalctl@ceph.mgr.z.smithi186.stdout:May 08 03:35:43 smithi186 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-z[128521]: 2023-05-08T03:35:43.721+0000 7f53cc76e200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-08T03:35:44.240 INFO:journalctl@ceph.mgr.y.smithi133.stdout:May 08 03:35:43 smithi133 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-y[127385]: 2023-05-08T03:35:43.895+0000 7f090da9e200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-05-08T03:35:44.240 INFO:journalctl@ceph.mgr.y.smithi133.stdout:May 08 03:35:44 smithi133 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-y[127385]: 2023-05-08T03:35:44.121+0000 7f090da9e200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-08T03:35:44.525 INFO:journalctl@ceph.mgr.y.smithi133.stdout:May 08 03:35:44 smithi133 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-y[127385]: 2023-05-08T03:35:44.268+0000 7f090da9e200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-08T03:35:44.646 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:44.644+0000 7f2677fff700 1 -- 172.21.15.96:0/2602941057 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mgrmap(e 14) v1 ==== 90599+0+0 (secure 0 0 0) 0x7f2680003a00 con 0x7f2690100730 2023-05-08T03:35:44.869 INFO:journalctl@ceph.mgr.z.smithi186.stdout:May 08 03:35:44 smithi186 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-z[128521]: 2023-05-08T03:35:44.583+0000 7f53cc76e200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-08T03:35:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:44 smithi186 ceph-mon[126480]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:44 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:44 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:44.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:44 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:35:44.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:44 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:35:44.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:44 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:35:44.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:44 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:35:44.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:44 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:44.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:44 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T03:35:44.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:44 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:35:44.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:44 smithi186 ceph-mon[126480]: Standby manager daemon z started 2023-05-08T03:35:44.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:44 smithi186 ceph-mon[126480]: from='mgr.? 172.21.15.186:0/3553035064' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-05-08T03:35:44.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:44 smithi186 ceph-mon[126480]: from='mgr.? 172.21.15.186:0/3553035064' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-05-08T03:35:44.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:44 smithi186 ceph-mon[126480]: from='mgr.? 172.21.15.186:0/3553035064' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-05-08T03:35:44.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:44 smithi186 ceph-mon[126480]: from='mgr.? 172.21.15.186:0/3553035064' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-05-08T03:35:44.916 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:44 smithi096 ceph-mon[124666]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:44.917 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:44 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:44.917 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:44 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:44.917 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:44 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:35:44.917 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:44 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:35:44.918 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:44 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:35:44.918 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:44 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:35:44.918 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:44 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:44.919 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:44 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T03:35:44.919 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:44 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:35:44.919 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:44 smithi096 ceph-mon[124666]: Standby manager daemon z started 2023-05-08T03:35:44.919 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:44 smithi096 ceph-mon[124666]: from='mgr.? 172.21.15.186:0/3553035064' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-05-08T03:35:44.920 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:44 smithi096 ceph-mon[124666]: from='mgr.? 172.21.15.186:0/3553035064' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-05-08T03:35:44.920 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:44 smithi096 ceph-mon[124666]: from='mgr.? 172.21.15.186:0/3553035064' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-05-08T03:35:44.920 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:44 smithi096 ceph-mon[124666]: from='mgr.? 172.21.15.186:0/3553035064' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-05-08T03:35:44.990 INFO:journalctl@ceph.mgr.y.smithi133.stdout:May 08 03:35:44 smithi133 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-y[127385]: 2023-05-08T03:35:44.522+0000 7f090da9e200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-08T03:35:44.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:44 smithi133 ceph-mon[125939]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:44.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:44 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:44.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:44 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:44.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:44 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:35:44.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:44 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:35:44.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:44 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:35:44.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:44 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:35:44.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:44 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:44.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:44 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T03:35:44.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:44 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:35:44.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:44 smithi133 ceph-mon[125939]: Standby manager daemon z started 2023-05-08T03:35:44.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:44 smithi133 ceph-mon[125939]: from='mgr.? 172.21.15.186:0/3553035064' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-05-08T03:35:44.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:44 smithi133 ceph-mon[125939]: from='mgr.? 172.21.15.186:0/3553035064' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-05-08T03:35:44.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:44 smithi133 ceph-mon[125939]: from='mgr.? 172.21.15.186:0/3553035064' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-05-08T03:35:44.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:44 smithi133 ceph-mon[125939]: from='mgr.? 172.21.15.186:0/3553035064' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-05-08T03:35:45.490 INFO:journalctl@ceph.mgr.y.smithi133.stdout:May 08 03:35:45 smithi133 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-y[127385]: 2023-05-08T03:35:45.217+0000 7f090da9e200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-08T03:35:45.490 INFO:journalctl@ceph.mgr.y.smithi133.stdout:May 08 03:35:45 smithi133 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-y[127385]: 2023-05-08T03:35:45.346+0000 7f090da9e200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-08T03:35:45.861 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:45 smithi133 ceph-mon[125939]: mgrmap e14: x(active, since 67s), standbys: z 2023-05-08T03:35:45.862 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:45 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-05-08T03:35:45.862 INFO:journalctl@ceph.mgr.y.smithi133.stdout:May 08 03:35:45 smithi133 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-y[127385]: 2023-05-08T03:35:45.535+0000 7f090da9e200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-08T03:35:45.862 INFO:journalctl@ceph.mgr.y.smithi133.stdout:May 08 03:35:45 smithi133 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-y[127385]: 2023-05-08T03:35:45.647+0000 7f090da9e200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-08T03:35:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:45 smithi096 ceph-mon[124666]: mgrmap e14: x(active, since 67s), standbys: z 2023-05-08T03:35:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:45 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-05-08T03:35:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:45 smithi186 ceph-mon[126480]: mgrmap e14: x(active, since 67s), standbys: z 2023-05-08T03:35:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:45 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-05-08T03:35:46.240 INFO:journalctl@ceph.mgr.y.smithi133.stdout:May 08 03:35:45 smithi133 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-y[127385]: 2023-05-08T03:35:45.858+0000 7f090da9e200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-08T03:35:46.990 INFO:journalctl@ceph.mgr.y.smithi133.stdout:May 08 03:35:46 smithi133 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-y[127385]: 2023-05-08T03:35:46.717+0000 7f090da9e200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-08T03:35:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:46 smithi133 ceph-mon[125939]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:46 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/744588364' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2ee801e1-8eec-496d-a9ac-fc566b38bbfa"}]: dispatch 2023-05-08T03:35:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:46 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/744588364' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2ee801e1-8eec-496d-a9ac-fc566b38bbfa"}]': finished 2023-05-08T03:35:46.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:46 smithi133 ceph-mon[125939]: osdmap e5: 1 total, 0 up, 1 in 2023-05-08T03:35:46.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:46 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-05-08T03:35:46.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:46 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/1085297240' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-05-08T03:35:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:46 smithi096 ceph-mon[124666]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:46 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/744588364' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2ee801e1-8eec-496d-a9ac-fc566b38bbfa"}]: dispatch 2023-05-08T03:35:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:46 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/744588364' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2ee801e1-8eec-496d-a9ac-fc566b38bbfa"}]': finished 2023-05-08T03:35:47.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:46 smithi096 ceph-mon[124666]: osdmap e5: 1 total, 0 up, 1 in 2023-05-08T03:35:47.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:46 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-05-08T03:35:47.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:46 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/1085297240' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-05-08T03:35:47.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:46 smithi186 ceph-mon[126480]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:47.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:46 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/744588364' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2ee801e1-8eec-496d-a9ac-fc566b38bbfa"}]: dispatch 2023-05-08T03:35:47.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:46 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/744588364' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2ee801e1-8eec-496d-a9ac-fc566b38bbfa"}]': finished 2023-05-08T03:35:47.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:46 smithi186 ceph-mon[126480]: osdmap e5: 1 total, 0 up, 1 in 2023-05-08T03:35:47.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:46 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-05-08T03:35:47.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:46 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/1085297240' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-05-08T03:35:47.682 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:35:47.680+0000 7f2677fff700 1 -- 172.21.15.96:0/2602941057 <== mon.0 v2:172.21.15.96:3300/0 8 ==== mgrmap(e 15) v1 ==== 135659+0+0 (secure 0 0 0) 0x7f268007d3d0 con 0x7f2690100730 2023-05-08T03:35:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:47 smithi133 ceph-mon[125939]: Standby manager daemon y started 2023-05-08T03:35:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:47 smithi133 ceph-mon[125939]: from='mgr.? 172.21.15.133:0/3697353177' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-05-08T03:35:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:47 smithi133 ceph-mon[125939]: from='mgr.? 172.21.15.133:0/3697353177' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-05-08T03:35:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:47 smithi133 ceph-mon[125939]: from='mgr.? 172.21.15.133:0/3697353177' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-05-08T03:35:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:47 smithi133 ceph-mon[125939]: from='mgr.? 172.21.15.133:0/3697353177' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-05-08T03:35:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:47 smithi096 ceph-mon[124666]: Standby manager daemon y started 2023-05-08T03:35:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:47 smithi096 ceph-mon[124666]: from='mgr.? 172.21.15.133:0/3697353177' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-05-08T03:35:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:47 smithi096 ceph-mon[124666]: from='mgr.? 172.21.15.133:0/3697353177' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-05-08T03:35:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:47 smithi096 ceph-mon[124666]: from='mgr.? 172.21.15.133:0/3697353177' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-05-08T03:35:48.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:47 smithi096 ceph-mon[124666]: from='mgr.? 172.21.15.133:0/3697353177' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-05-08T03:35:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:47 smithi186 ceph-mon[126480]: Standby manager daemon y started 2023-05-08T03:35:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:47 smithi186 ceph-mon[126480]: from='mgr.? 172.21.15.133:0/3697353177' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-05-08T03:35:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:47 smithi186 ceph-mon[126480]: from='mgr.? 172.21.15.133:0/3697353177' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-05-08T03:35:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:47 smithi186 ceph-mon[126480]: from='mgr.? 172.21.15.133:0/3697353177' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-05-08T03:35:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:47 smithi186 ceph-mon[126480]: from='mgr.? 172.21.15.133:0/3697353177' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-05-08T03:35:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:48 smithi133 ceph-mon[125939]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:48 smithi133 ceph-mon[125939]: mgrmap e15: x(active, since 70s), standbys: z, y 2023-05-08T03:35:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:48 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-05-08T03:35:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:48 smithi096 ceph-mon[124666]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:48 smithi096 ceph-mon[124666]: mgrmap e15: x(active, since 70s), standbys: z, y 2023-05-08T03:35:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:48 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-05-08T03:35:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:48 smithi186 ceph-mon[126480]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:48 smithi186 ceph-mon[126480]: mgrmap e15: x(active, since 70s), standbys: z, y 2023-05-08T03:35:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:48 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-05-08T03:35:50.989 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:50 smithi096 ceph-mon[124666]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:50 smithi133 ceph-mon[125939]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:51.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:50 smithi186 ceph-mon[126480]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:52 smithi133 ceph-mon[125939]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:52 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-05-08T03:35:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:52 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:35:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:52 smithi096 ceph-mon[124666]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:52 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-05-08T03:35:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:52 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:35:53.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:52 smithi186 ceph-mon[126480]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:52 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-05-08T03:35:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:52 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:35:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:53 smithi133 ceph-mon[125939]: Deploying daemon osd.0 on smithi096 2023-05-08T03:35:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:53 smithi096 ceph-mon[124666]: Deploying daemon osd.0 on smithi096 2023-05-08T03:35:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:53 smithi186 ceph-mon[126480]: Deploying daemon osd.0 on smithi096 2023-05-08T03:35:54.963 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:54 smithi096 ceph-mon[124666]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:54 smithi133 ceph-mon[125939]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:54 smithi186 ceph-mon[126480]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:56.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:56 smithi133 ceph-mon[125939]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:56 smithi096 ceph-mon[124666]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:56 smithi186 ceph-mon[126480]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:58.356 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:58 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:58.357 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:58 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:58.357 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:58 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:35:58.357 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:35:58 smithi096 ceph-mon[124666]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:58 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:58 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:58 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:35:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:35:58 smithi133 ceph-mon[125939]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:35:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:58 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:58 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:35:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:58 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:35:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:35:58 smithi186 ceph-mon[126480]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:36:00.275 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:36:00.273+0000 7f2677fff700 1 -- 172.21.15.96:0/2602941057 <== mgr.14152 v2:172.21.15.96:6800/2748629182 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f269019ed30 con 0x7f26780389e0 2023-05-08T03:36:00.275 INFO:teuthology.orchestra.run.smithi096.stdout:Created osd(s) 0 on host 'smithi096' 2023-05-08T03:36:00.277 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:36:00.275+0000 7f26955f3700 1 -- 172.21.15.96:0/2602941057 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f26780389e0 msgr2=0x7f267803ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:36:00.277 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:36:00.275+0000 7f26955f3700 1 --2- 172.21.15.96:0/2602941057 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f26780389e0 0x7f267803ae90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f268400b5c0 tx=0x7f2684005fd0 comp rx=0 tx=0).stop 2023-05-08T03:36:00.277 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:36:00.275+0000 7f26955f3700 1 -- 172.21.15.96:0/2602941057 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2690100730 msgr2=0x7f269019b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:36:00.278 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:36:00.275+0000 7f26955f3700 1 --2- 172.21.15.96:0/2602941057 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2690100730 0x7f269019b010 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f268000d980 tx=0x7f268000dc90 comp rx=0 tx=0).stop 2023-05-08T03:36:00.278 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:36:00.275+0000 7f26955f3700 1 -- 172.21.15.96:0/2602941057 shutdown_connections 2023-05-08T03:36:00.278 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:36:00.275+0000 7f26955f3700 1 --2- 172.21.15.96:0/2602941057 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f26780389e0 0x7f267803ae90 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:36:00.278 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:36:00.275+0000 7f26955f3700 1 --2- 172.21.15.96:0/2602941057 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26901010c0 0x7f269019d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:36:00.279 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:36:00.275+0000 7f26955f3700 1 --2- 172.21.15.96:0/2602941057 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f26900ff530 0x7f2690069de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:36:00.279 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:36:00.275+0000 7f26955f3700 1 --2- 172.21.15.96:0/2602941057 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2690100730 0x7f269019b010 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:36:00.279 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:36:00.275+0000 7f26955f3700 1 -- 172.21.15.96:0/2602941057 >> 172.21.15.96:0/2602941057 conn(0x7f26900faba0 msgr2=0x7f26900fce10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:36:00.279 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:36:00.276+0000 7f26955f3700 1 -- 172.21.15.96:0/2602941057 shutdown_connections 2023-05-08T03:36:00.279 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:36:00.276+0000 7f26955f3700 1 -- 172.21.15.96:0/2602941057 wait complete. 2023-05-08T03:36:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:00 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:00 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:00 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:36:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:00 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:36:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:00 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:36:00.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:00 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:00.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:00 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T03:36:00.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:00 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:36:00.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:00 smithi096 ceph-mon[124666]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:36:00.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:00 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:00.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:00 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:00.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:00 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:36:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:00 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:00 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:00 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:36:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:00 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:36:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:00 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:36:00.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:00 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:00.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:00 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T03:36:00.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:00 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:36:00.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:00 smithi133 ceph-mon[125939]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:36:00.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:00 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:00.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:00 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:00.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:00 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:36:00.758 DEBUG:teuthology.orchestra.run.smithi096:osd.0> sudo journalctl -f -n 0 -u ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c@osd.0.service 2023-05-08T03:36:00.761 INFO:tasks.cephadm:Deploying osd.1 on smithi133 with /dev/vg_nvme/lv_4... 2023-05-08T03:36:00.762 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-05-08T03:36:00.793 INFO:journalctl@ceph.osd.0.smithi096.stdout:-- Logs begin at Mon 2023-05-08 03:07:36 UTC. -- 2023-05-08T03:36:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:00 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:00 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:00 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:36:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:00 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:36:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:00 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:36:00.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:00 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:00.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:00 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T03:36:00.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:00 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:36:00.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:00 smithi186 ceph-mon[126480]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:36:00.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:00 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:00.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:00 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:00.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:00 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:36:01.398 INFO:teuthology.orchestra.run.smithi133.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.b/config 2023-05-08T03:36:01.412 INFO:journalctl@ceph.osd.0.smithi096.stdout:May 08 03:36:01 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-0[137669]: 2023-05-08T03:36:01.058+0000 7fe37b3a4640 -1 osd.0 0 log_to_monitors true 2023-05-08T03:36:01.667 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:01 smithi133 ceph-mon[125939]: from='osd.0 [v2:172.21.15.96:6802/1816903726,v1:172.21.15.96:6803/1816903726]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-05-08T03:36:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:01 smithi096 ceph-mon[124666]: from='osd.0 [v2:172.21.15.96:6802/1816903726,v1:172.21.15.96:6803/1816903726]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-05-08T03:36:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:01 smithi186 ceph-mon[126480]: from='osd.0 [v2:172.21.15.96:6802/1816903726,v1:172.21.15.96:6803/1816903726]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-05-08T03:36:02.712 INFO:journalctl@ceph.osd.0.smithi096.stdout:May 08 03:36:02 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-0[137669]: 2023-05-08T03:36:02.425+0000 7fe37021a700 -1 osd.0 0 waiting for initial osdmap 2023-05-08T03:36:02.712 INFO:journalctl@ceph.osd.0.smithi096.stdout:May 08 03:36:02 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-0[137669]: 2023-05-08T03:36:02.433+0000 7fe36a80c700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-08T03:36:02.713 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:02 smithi096 ceph-mon[124666]: from='osd.0 [v2:172.21.15.96:6802/1816903726,v1:172.21.15.96:6803/1816903726]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-05-08T03:36:02.713 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:02 smithi096 ceph-mon[124666]: osdmap e6: 1 total, 0 up, 1 in 2023-05-08T03:36:02.713 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:02 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-05-08T03:36:02.713 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:02 smithi096 ceph-mon[124666]: from='osd.0 [v2:172.21.15.96:6802/1816903726,v1:172.21.15.96:6803/1816903726]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2023-05-08T03:36:02.713 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:02 smithi096 ceph-mon[124666]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:36:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:02 smithi133 ceph-mon[125939]: from='osd.0 [v2:172.21.15.96:6802/1816903726,v1:172.21.15.96:6803/1816903726]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-05-08T03:36:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:02 smithi133 ceph-mon[125939]: osdmap e6: 1 total, 0 up, 1 in 2023-05-08T03:36:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:02 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-05-08T03:36:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:02 smithi133 ceph-mon[125939]: from='osd.0 [v2:172.21.15.96:6802/1816903726,v1:172.21.15.96:6803/1816903726]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2023-05-08T03:36:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:02 smithi133 ceph-mon[125939]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:36:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:02 smithi186 ceph-mon[126480]: from='osd.0 [v2:172.21.15.96:6802/1816903726,v1:172.21.15.96:6803/1816903726]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-05-08T03:36:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:02 smithi186 ceph-mon[126480]: osdmap e6: 1 total, 0 up, 1 in 2023-05-08T03:36:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:02 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-05-08T03:36:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:02 smithi186 ceph-mon[126480]: from='osd.0 [v2:172.21.15.96:6802/1816903726,v1:172.21.15.96:6803/1816903726]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2023-05-08T03:36:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:02 smithi186 ceph-mon[126480]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:36:03.053 INFO:teuthology.orchestra.run.smithi133.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-05-08T03:36:03.053 INFO:teuthology.orchestra.run.smithi133.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-05-08T03:36:03.053 INFO:teuthology.orchestra.run.smithi133.stderr: stderr: 10+0 records in 2023-05-08T03:36:03.053 INFO:teuthology.orchestra.run.smithi133.stderr:10+0 records out 2023-05-08T03:36:03.053 INFO:teuthology.orchestra.run.smithi133.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0110874 s, 946 MB/s 2023-05-08T03:36:03.053 INFO:teuthology.orchestra.run.smithi133.stderr:--> Zapping successful for: 2023-05-08T03:36:03.454 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- ceph orch daemon add osd smithi133:vg_nvme/lv_4 2023-05-08T03:36:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:03 smithi133 ceph-mon[125939]: from='osd.0 [v2:172.21.15.96:6802/1816903726,v1:172.21.15.96:6803/1816903726]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]': finished 2023-05-08T03:36:03.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:03 smithi133 ceph-mon[125939]: osdmap e7: 1 total, 0 up, 1 in 2023-05-08T03:36:03.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:03 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-05-08T03:36:03.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:03 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-05-08T03:36:03.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:03 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:03.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:03 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:03.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:03 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:36:03.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:03 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:03.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:03 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:36:03.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:03 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:36:03.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:03 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:03.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:03 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-05-08T03:36:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:03 smithi096 ceph-mon[124666]: from='osd.0 [v2:172.21.15.96:6802/1816903726,v1:172.21.15.96:6803/1816903726]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]': finished 2023-05-08T03:36:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:03 smithi096 ceph-mon[124666]: osdmap e7: 1 total, 0 up, 1 in 2023-05-08T03:36:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:03 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-05-08T03:36:03.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:03 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-05-08T03:36:03.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:03 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:03.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:03 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:03.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:03 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:36:03.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:03 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:03.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:03 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:36:03.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:03 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:36:03.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:03 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:03.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:03 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-05-08T03:36:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:03 smithi186 ceph-mon[126480]: from='osd.0 [v2:172.21.15.96:6802/1816903726,v1:172.21.15.96:6803/1816903726]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]': finished 2023-05-08T03:36:03.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:03 smithi186 ceph-mon[126480]: osdmap e7: 1 total, 0 up, 1 in 2023-05-08T03:36:03.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:03 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-05-08T03:36:03.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:03 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-05-08T03:36:03.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:03 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:03.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:03 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:03.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:03 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:36:03.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:03 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:03.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:03 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:36:03.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:03 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:36:03.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:03 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:03.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:03 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-05-08T03:36:04.092 INFO:teuthology.orchestra.run.smithi133.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.b/config 2023-05-08T03:36:04.618 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:04 smithi133 ceph-mon[125939]: purged_snaps scrub starts 2023-05-08T03:36:04.619 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:04 smithi133 ceph-mon[125939]: purged_snaps scrub ok 2023-05-08T03:36:04.619 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:04 smithi133 ceph-mon[125939]: Detected new or changed devices on smithi096 2023-05-08T03:36:04.619 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:04 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi096 to 17168M 2023-05-08T03:36:04.619 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:04 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:36:04.619 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:04 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T03:36:04.619 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:04 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:36:04.619 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:04 smithi133 ceph-mon[125939]: osd.0 [v2:172.21.15.96:6802/1816903726,v1:172.21.15.96:6803/1816903726] boot 2023-05-08T03:36:04.620 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:04 smithi133 ceph-mon[125939]: osdmap e8: 1 total, 1 up, 1 in 2023-05-08T03:36:04.620 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:04 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-05-08T03:36:04.620 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:04 smithi133 ceph-mon[125939]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:36:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:04 smithi096 ceph-mon[124666]: purged_snaps scrub starts 2023-05-08T03:36:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:04 smithi096 ceph-mon[124666]: purged_snaps scrub ok 2023-05-08T03:36:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:04 smithi096 ceph-mon[124666]: Detected new or changed devices on smithi096 2023-05-08T03:36:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:04 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi096 to 17168M 2023-05-08T03:36:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:04 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:36:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:04 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T03:36:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:04 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:36:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:04 smithi096 ceph-mon[124666]: osd.0 [v2:172.21.15.96:6802/1816903726,v1:172.21.15.96:6803/1816903726] boot 2023-05-08T03:36:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:04 smithi096 ceph-mon[124666]: osdmap e8: 1 total, 1 up, 1 in 2023-05-08T03:36:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:04 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-05-08T03:36:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:04 smithi096 ceph-mon[124666]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:36:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:04 smithi186 ceph-mon[126480]: purged_snaps scrub starts 2023-05-08T03:36:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:04 smithi186 ceph-mon[126480]: purged_snaps scrub ok 2023-05-08T03:36:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:04 smithi186 ceph-mon[126480]: Detected new or changed devices on smithi096 2023-05-08T03:36:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:04 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi096 to 17168M 2023-05-08T03:36:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:04 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:36:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:04 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T03:36:04.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:04 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:36:04.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:04 smithi186 ceph-mon[126480]: osd.0 [v2:172.21.15.96:6802/1816903726,v1:172.21.15.96:6803/1816903726] boot 2023-05-08T03:36:04.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:04 smithi186 ceph-mon[126480]: osdmap e8: 1 total, 1 up, 1 in 2023-05-08T03:36:04.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:04 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-05-08T03:36:04.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:04 smithi186 ceph-mon[126480]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-05-08T03:36:05.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:36:05.371+0000 7f25a83e3700 1 -- 172.21.15.133:0/1927410753 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25a0103810 msgr2=0x7f25a0103c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:36:05.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:36:05.371+0000 7f25a83e3700 1 --2- 172.21.15.133:0/1927410753 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25a0103810 0x7f25a0103c60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2594009990 tx=0x7f2594009ca0 comp rx=0 tx=0).stop 2023-05-08T03:36:05.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:36:05.371+0000 7f25a83e3700 1 -- 172.21.15.133:0/1927410753 shutdown_connections 2023-05-08T03:36:05.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:36:05.371+0000 7f25a83e3700 1 --2- 172.21.15.133:0/1927410753 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f25a01041a0 0x7f25a010aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:36:05.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:36:05.371+0000 7f25a83e3700 1 --2- 172.21.15.133:0/1927410753 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25a0102610 0x7f25a0102a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:36:05.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:36:05.371+0000 7f25a83e3700 1 --2- 172.21.15.133:0/1927410753 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25a0103810 0x7f25a0103c60 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:36:05.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:36:05.371+0000 7f25a83e3700 1 -- 172.21.15.133:0/1927410753 >> 172.21.15.133:0/1927410753 conn(0x7f25a00fdc60 msgr2=0x7f25a0100090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:36:05.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:36:05.371+0000 7f25a83e3700 1 -- 172.21.15.133:0/1927410753 shutdown_connections 2023-05-08T03:36:05.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:36:05.371+0000 7f25a83e3700 1 -- 172.21.15.133:0/1927410753 wait complete. 2023-05-08T03:36:05.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:36:05.371+0000 7f25a83e3700 1 Processor -- start 2023-05-08T03:36:05.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:36:05.371+0000 7f25a83e3700 1 -- start start 2023-05-08T03:36:05.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:36:05.372+0000 7f25a83e3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25a0102610 0x7f25a01983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:36:05.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:36:05.372+0000 7f25a83e3700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f25a0103810 0x7f25a0198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:36:05.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:36:05.372+0000 7f25a83e3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25a01041a0 0x7f25a019f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:36:05.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:36:05.372+0000 7f25a83e3700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25a019ff80 con 0x7f25a01041a0 2023-05-08T03:36:05.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:36:05.372+0000 7f25a83e3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25a01a00c0 con 0x7f25a0102610 2023-05-08T03:36:05.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:36:05.372+0000 7f25a83e3700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25a01a0250 con 0x7f25a0103810 2023-05-08T03:36:05.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:36:05.372+0000 7f25a617f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25a0102610 0x7f25a01983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:36:05.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:36:05.372+0000 7f25a617f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25a0102610 0x7f25a01983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43832/0 (socket says 172.21.15.133:43832) 2023-05-08T03:36:05.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:36:05.372+0000 7f25a617f700 1 -- 172.21.15.133:0/1098493642 learned_addr learned my addr 172.21.15.133:0/1098493642 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-05-08T03:36:05.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:36:05.372+0000 7f25a597e700 1 --2- 172.21.15.133:0/1098493642 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f25a0103810 0x7f25a0198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:36:05.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:36:05.372+0000 7f25a617f700 1 -- 172.21.15.133:0/1098493642 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f25a0103810 msgr2=0x7f25a0198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:36:05.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:36:05.372+0000 7f25a617f700 1 --2- 172.21.15.133:0/1098493642 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f25a0103810 0x7f25a0198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:36:05.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:36:05.372+0000 7f25a617f700 1 -- 172.21.15.133:0/1098493642 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25a01041a0 msgr2=0x7f25a019f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:36:05.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:36:05.372+0000 7f25a6980700 1 --2- 172.21.15.133:0/1098493642 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25a01041a0 0x7f25a019f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:36:05.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:36:05.372+0000 7f25a617f700 1 --2- 172.21.15.133:0/1098493642 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25a01041a0 0x7f25a019f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:36:05.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:36:05.372+0000 7f25a617f700 1 -- 172.21.15.133:0/1098493642 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25940095f0 con 0x7f25a0102610 2023-05-08T03:36:05.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:36:05.372+0000 7f25a6980700 1 --2- 172.21.15.133:0/1098493642 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25a01041a0 0x7f25a019f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-08T03:36:05.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:36:05.372+0000 7f25a617f700 1 --2- 172.21.15.133:0/1098493642 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25a0102610 0x7f25a01983f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f259800b9c0 tx=0x7f259800bcd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:36:05.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:36:05.372+0000 7f259f7fe700 1 -- 172.21.15.133:0/1098493642 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f259800c950 con 0x7f25a0102610 2023-05-08T03:36:05.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:36:05.372+0000 7f25a83e3700 1 -- 172.21.15.133:0/1098493642 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25a010e010 con 0x7f25a0102610 2023-05-08T03:36:05.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:36:05.372+0000 7f259f7fe700 1 -- 172.21.15.133:0/1098493642 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2598014440 con 0x7f25a0102610 2023-05-08T03:36:05.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:36:05.372+0000 7f259f7fe700 1 -- 172.21.15.133:0/1098493642 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2598012580 con 0x7f25a0102610 2023-05-08T03:36:05.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:36:05.372+0000 7f25a83e3700 1 -- 172.21.15.133:0/1098493642 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25a010de80 con 0x7f25a0102610 2023-05-08T03:36:05.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:36:05.373+0000 7f25a83e3700 1 -- 172.21.15.133:0/1098493642 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25a01a09e0 con 0x7f25a0102610 2023-05-08T03:36:05.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:36:05.375+0000 7f259f7fe700 1 -- 172.21.15.133:0/1098493642 <== mon.2 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 15) v1 ==== 135659+0+0 (secure 0 0 0) 0x7f25980145b0 con 0x7f25a0102610 2023-05-08T03:36:05.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:36:05.375+0000 7f259f7fe700 1 --2- 172.21.15.133:0/1098493642 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f25880a10c0 0x7f25880a3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:36:05.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:36:05.375+0000 7f259f7fe700 1 -- 172.21.15.133:0/1098493642 <== mon.2 v2:172.21.15.133:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1767+0+0 (secure 0 0 0) 0x7f2598006e40 con 0x7f25a0102610 2023-05-08T03:36:05.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:36:05.375+0000 7f25a597e700 1 --2- 172.21.15.133:0/1098493642 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f25880a10c0 0x7f25880a3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:36:05.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:36:05.376+0000 7f25a597e700 1 --2- 172.21.15.133:0/1098493642 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f25880a10c0 0x7f25880a3570 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f259400b5c0 tx=0x7f2594005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:36:05.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:36:05.379+0000 7f259f7fe700 1 -- 172.21.15.133:0/1098493642 <== mon.2 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f2598095b70 con 0x7f25a0102610 2023-05-08T03:36:05.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:36:05.572+0000 7f25a83e3700 1 -- 172.21.15.133:0/1098493642 --> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi133:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f25a01a0f90 con 0x7f25880a10c0 2023-05-08T03:36:05.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:05 smithi133 ceph-mon[125939]: osdmap e9: 1 total, 1 up, 1 in 2023-05-08T03:36:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:05 smithi096 ceph-mon[124666]: osdmap e9: 1 total, 1 up, 1 in 2023-05-08T03:36:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:05 smithi186 ceph-mon[126480]: osdmap e9: 1 total, 1 up, 1 in 2023-05-08T03:36:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:06 smithi133 ceph-mon[125939]: pgmap v43: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-05-08T03:36:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:06 smithi133 ceph-mon[125939]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi133:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:36:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:06 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-05-08T03:36:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:06 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-05-08T03:36:06.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:06 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:36:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:06 smithi096 ceph-mon[124666]: pgmap v43: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-05-08T03:36:06.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:06 smithi096 ceph-mon[124666]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi133:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:36:06.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:06 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-05-08T03:36:06.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:06 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-05-08T03:36:06.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:06 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:36:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:06 smithi186 ceph-mon[126480]: pgmap v43: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-05-08T03:36:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:06 smithi186 ceph-mon[126480]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi133:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:36:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:06 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-05-08T03:36:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:06 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-05-08T03:36:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:06 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:36:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:08 smithi186 ceph-mon[126480]: pgmap v44: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-05-08T03:36:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:08 smithi186 ceph-mon[126480]: from='client.? 172.21.15.133:0/1429399575' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eb73deea-fc7c-4f2f-8aef-2d71c598afda"}]: dispatch 2023-05-08T03:36:08.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:08 smithi186 ceph-mon[126480]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eb73deea-fc7c-4f2f-8aef-2d71c598afda"}]: dispatch 2023-05-08T03:36:08.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:08 smithi186 ceph-mon[126480]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "eb73deea-fc7c-4f2f-8aef-2d71c598afda"}]': finished 2023-05-08T03:36:08.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:08 smithi186 ceph-mon[126480]: osdmap e10: 2 total, 1 up, 2 in 2023-05-08T03:36:08.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:08 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-05-08T03:36:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:08 smithi133 ceph-mon[125939]: pgmap v44: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-05-08T03:36:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:08 smithi133 ceph-mon[125939]: from='client.? 172.21.15.133:0/1429399575' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eb73deea-fc7c-4f2f-8aef-2d71c598afda"}]: dispatch 2023-05-08T03:36:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:08 smithi133 ceph-mon[125939]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eb73deea-fc7c-4f2f-8aef-2d71c598afda"}]: dispatch 2023-05-08T03:36:08.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:08 smithi133 ceph-mon[125939]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "eb73deea-fc7c-4f2f-8aef-2d71c598afda"}]': finished 2023-05-08T03:36:08.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:08 smithi133 ceph-mon[125939]: osdmap e10: 2 total, 1 up, 2 in 2023-05-08T03:36:08.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:08 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-05-08T03:36:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:08 smithi096 ceph-mon[124666]: pgmap v44: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-05-08T03:36:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:08 smithi096 ceph-mon[124666]: from='client.? 172.21.15.133:0/1429399575' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eb73deea-fc7c-4f2f-8aef-2d71c598afda"}]: dispatch 2023-05-08T03:36:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:08 smithi096 ceph-mon[124666]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eb73deea-fc7c-4f2f-8aef-2d71c598afda"}]: dispatch 2023-05-08T03:36:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:08 smithi096 ceph-mon[124666]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "eb73deea-fc7c-4f2f-8aef-2d71c598afda"}]': finished 2023-05-08T03:36:08.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:08 smithi096 ceph-mon[124666]: osdmap e10: 2 total, 1 up, 2 in 2023-05-08T03:36:08.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:08 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-05-08T03:36:09.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:09 smithi186 ceph-mon[126480]: from='client.? 172.21.15.133:0/3384939048' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-05-08T03:36:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:09 smithi133 ceph-mon[125939]: from='client.? 172.21.15.133:0/3384939048' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-05-08T03:36:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:09 smithi096 ceph-mon[124666]: from='client.? 172.21.15.133:0/3384939048' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-05-08T03:36:10.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:10 smithi186 ceph-mon[126480]: pgmap v46: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-05-08T03:36:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:10 smithi133 ceph-mon[125939]: pgmap v46: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-05-08T03:36:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:10 smithi096 ceph-mon[124666]: pgmap v46: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-05-08T03:36:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:12 smithi133 ceph-mon[125939]: pgmap v47: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-05-08T03:36:12.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:12 smithi186 ceph-mon[126480]: pgmap v47: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-05-08T03:36:13.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:12 smithi096 ceph-mon[124666]: pgmap v47: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-05-08T03:36:14.867 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:14 smithi133 ceph-mon[125939]: pgmap v48: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-05-08T03:36:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:14 smithi186 ceph-mon[126480]: pgmap v48: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-05-08T03:36:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:14 smithi096 ceph-mon[124666]: pgmap v48: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-05-08T03:36:15.806 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:15 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-05-08T03:36:15.807 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:15 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:36:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:15 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-05-08T03:36:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:15 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:36:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:15 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-05-08T03:36:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:15 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:36:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:16 smithi133 ceph-mon[125939]: Deploying daemon osd.1 on smithi133 2023-05-08T03:36:16.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:16 smithi133 ceph-mon[125939]: pgmap v49: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-05-08T03:36:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:16 smithi186 ceph-mon[126480]: Deploying daemon osd.1 on smithi133 2023-05-08T03:36:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:16 smithi186 ceph-mon[126480]: pgmap v49: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-05-08T03:36:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:16 smithi096 ceph-mon[124666]: Deploying daemon osd.1 on smithi133 2023-05-08T03:36:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:16 smithi096 ceph-mon[124666]: pgmap v49: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-05-08T03:36:18.550 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:18 smithi133 ceph-mon[125939]: pgmap v50: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-05-08T03:36:18.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:18 smithi186 ceph-mon[126480]: pgmap v50: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-05-08T03:36:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:18 smithi096 ceph-mon[124666]: pgmap v50: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-05-08T03:36:20.591 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:20 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:20.591 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:20 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:20.592 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:20 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:36:20.592 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:20 smithi133 ceph-mon[125939]: pgmap v51: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-05-08T03:36:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:20 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:20 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:20 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:36:20.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:20 smithi096 ceph-mon[124666]: pgmap v51: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-05-08T03:36:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:20 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:20 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:20 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:36:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:20 smithi186 ceph-mon[126480]: pgmap v51: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-05-08T03:36:22.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:36:22.233+0000 7f259f7fe700 1 -- 172.21.15.133:0/1098493642 <== mgr.14152 v2:172.21.15.96:6800/2748629182 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f25a01a0f90 con 0x7f25880a10c0 2023-05-08T03:36:22.236 INFO:teuthology.orchestra.run.smithi133.stdout:Created osd(s) 1 on host 'smithi133' 2023-05-08T03:36:22.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:36:22.235+0000 7f25a83e3700 1 -- 172.21.15.133:0/1098493642 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f25880a10c0 msgr2=0x7f25880a3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:36:22.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:36:22.235+0000 7f25a83e3700 1 --2- 172.21.15.133:0/1098493642 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f25880a10c0 0x7f25880a3570 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f259400b5c0 tx=0x7f2594005fd0 comp rx=0 tx=0).stop 2023-05-08T03:36:22.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:36:22.235+0000 7f25a83e3700 1 -- 172.21.15.133:0/1098493642 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25a0102610 msgr2=0x7f25a01983f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:36:22.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:36:22.235+0000 7f25a83e3700 1 --2- 172.21.15.133:0/1098493642 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25a0102610 0x7f25a01983f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f259800b9c0 tx=0x7f259800bcd0 comp rx=0 tx=0).stop 2023-05-08T03:36:22.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:36:22.235+0000 7f25a83e3700 1 -- 172.21.15.133:0/1098493642 shutdown_connections 2023-05-08T03:36:22.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:36:22.235+0000 7f25a83e3700 1 --2- 172.21.15.133:0/1098493642 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f25880a10c0 0x7f25880a3570 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:36:22.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:36:22.235+0000 7f25a83e3700 1 --2- 172.21.15.133:0/1098493642 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25a01041a0 0x7f25a019f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:36:22.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:36:22.235+0000 7f25a83e3700 1 --2- 172.21.15.133:0/1098493642 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25a0102610 0x7f25a01983f0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:36:22.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:36:22.235+0000 7f25a83e3700 1 --2- 172.21.15.133:0/1098493642 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f25a0103810 0x7f25a0198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:36:22.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:36:22.235+0000 7f25a83e3700 1 -- 172.21.15.133:0/1098493642 >> 172.21.15.133:0/1098493642 conn(0x7f25a00fdc60 msgr2=0x7f25a00ffea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:36:22.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:36:22.235+0000 7f25a83e3700 1 -- 172.21.15.133:0/1098493642 shutdown_connections 2023-05-08T03:36:22.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:36:22.235+0000 7f25a83e3700 1 -- 172.21.15.133:0/1098493642 wait complete. 2023-05-08T03:36:22.685 DEBUG:teuthology.orchestra.run.smithi133:osd.1> sudo journalctl -f -n 0 -u ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c@osd.1.service 2023-05-08T03:36:22.687 INFO:tasks.cephadm:Deploying osd.2 on smithi186 with /dev/vg_nvme/lv_4... 2023-05-08T03:36:22.688 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-05-08T03:36:22.717 INFO:journalctl@ceph.osd.1.smithi133.stdout:-- Logs begin at Mon 2023-05-08 03:07:41 UTC. -- 2023-05-08T03:36:22.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:22 smithi133 ceph-mon[125939]: pgmap v52: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-05-08T03:36:22.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:22 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:22.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:22 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:22.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:22 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:36:22.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:22 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:36:22.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:22 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:36:22.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:22 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:22.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:22 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T03:36:22.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:22 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:36:22.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:22 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:22.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:22 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:22.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:22 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:36:23.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:22 smithi096 ceph-mon[124666]: pgmap v52: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-05-08T03:36:23.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:22 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:23.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:22 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:23.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:22 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:36:23.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:22 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:36:23.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:22 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:36:23.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:22 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:23.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:22 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T03:36:23.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:22 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:36:23.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:22 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:23.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:22 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:23.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:22 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:36:23.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:22 smithi186 ceph-mon[126480]: pgmap v52: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-05-08T03:36:23.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:22 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:23.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:22 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:23.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:22 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:36:23.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:22 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:36:23.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:22 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:36:23.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:22 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:23.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:22 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T03:36:23.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:22 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:36:23.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:22 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:23.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:22 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:23.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:22 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:36:23.335 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.c/config 2023-05-08T03:36:23.465 INFO:journalctl@ceph.osd.1.smithi133.stdout:May 08 03:36:23 smithi133 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-1[131040]: 2023-05-08T03:36:23.359+0000 7f3200c83640 -1 osd.1 0 log_to_monitors true 2023-05-08T03:36:23.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:23 smithi133 ceph-mon[125939]: from='osd.1 [v2:172.21.15.133:6800/206989126,v1:172.21.15.133:6801/206989126]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-05-08T03:36:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:23 smithi133 ceph-mon[125939]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-05-08T03:36:23.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:23 smithi186 ceph-mon[126480]: from='osd.1 [v2:172.21.15.133:6800/206989126,v1:172.21.15.133:6801/206989126]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-05-08T03:36:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:23 smithi186 ceph-mon[126480]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-05-08T03:36:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:23 smithi096 ceph-mon[124666]: from='osd.1 [v2:172.21.15.133:6800/206989126,v1:172.21.15.133:6801/206989126]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-05-08T03:36:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:23 smithi096 ceph-mon[124666]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-05-08T03:36:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:24 smithi186 ceph-mon[126480]: pgmap v53: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-05-08T03:36:24.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:24 smithi186 ceph-mon[126480]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-05-08T03:36:24.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:24 smithi186 ceph-mon[126480]: osdmap e11: 2 total, 1 up, 2 in 2023-05-08T03:36:24.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:24 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-05-08T03:36:24.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:24 smithi186 ceph-mon[126480]: from='osd.1 [v2:172.21.15.133:6800/206989126,v1:172.21.15.133:6801/206989126]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2023-05-08T03:36:24.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:24 smithi186 ceph-mon[126480]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2023-05-08T03:36:24.911 INFO:journalctl@ceph.osd.1.smithi133.stdout:May 08 03:36:24 smithi133 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-1[131040]: 2023-05-08T03:36:24.636+0000 7f31f5af9700 -1 osd.1 0 waiting for initial osdmap 2023-05-08T03:36:24.911 INFO:journalctl@ceph.osd.1.smithi133.stdout:May 08 03:36:24 smithi133 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-1[131040]: 2023-05-08T03:36:24.639+0000 7f31f08ec700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-08T03:36:24.912 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:24 smithi133 ceph-mon[125939]: pgmap v53: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-05-08T03:36:24.912 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:24 smithi133 ceph-mon[125939]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-05-08T03:36:24.912 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:24 smithi133 ceph-mon[125939]: osdmap e11: 2 total, 1 up, 2 in 2023-05-08T03:36:24.912 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:24 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-05-08T03:36:24.912 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:24 smithi133 ceph-mon[125939]: from='osd.1 [v2:172.21.15.133:6800/206989126,v1:172.21.15.133:6801/206989126]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2023-05-08T03:36:24.913 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:24 smithi133 ceph-mon[125939]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2023-05-08T03:36:24.961 INFO:teuthology.orchestra.run.smithi186.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-05-08T03:36:24.962 INFO:teuthology.orchestra.run.smithi186.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-05-08T03:36:24.962 INFO:teuthology.orchestra.run.smithi186.stderr: stderr: 10+0 records in 2023-05-08T03:36:24.962 INFO:teuthology.orchestra.run.smithi186.stderr:10+0 records out 2023-05-08T03:36:24.962 INFO:teuthology.orchestra.run.smithi186.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0128687 s, 815 MB/s 2023-05-08T03:36:24.962 INFO:teuthology.orchestra.run.smithi186.stderr:--> Zapping successful for: 2023-05-08T03:36:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:24 smithi096 ceph-mon[124666]: pgmap v53: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-05-08T03:36:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:24 smithi096 ceph-mon[124666]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-05-08T03:36:25.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:24 smithi096 ceph-mon[124666]: osdmap e11: 2 total, 1 up, 2 in 2023-05-08T03:36:25.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:24 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-05-08T03:36:25.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:24 smithi096 ceph-mon[124666]: from='osd.1 [v2:172.21.15.133:6800/206989126,v1:172.21.15.133:6801/206989126]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2023-05-08T03:36:25.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:24 smithi096 ceph-mon[124666]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2023-05-08T03:36:25.390 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- ceph orch daemon add osd smithi186:vg_nvme/lv_4 2023-05-08T03:36:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:25 smithi133 ceph-mon[125939]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]': finished 2023-05-08T03:36:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:25 smithi133 ceph-mon[125939]: osdmap e12: 2 total, 1 up, 2 in 2023-05-08T03:36:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:25 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-05-08T03:36:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:25 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-05-08T03:36:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:25 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:25.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:25 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:25.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:25 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:36:25.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:25 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:25.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:25 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:36:25.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:25 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:36:25.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:25 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:25 smithi096 ceph-mon[124666]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]': finished 2023-05-08T03:36:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:25 smithi096 ceph-mon[124666]: osdmap e12: 2 total, 1 up, 2 in 2023-05-08T03:36:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:25 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-05-08T03:36:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:25 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-05-08T03:36:26.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:25 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:26.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:25 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:26.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:25 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:36:26.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:25 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:26.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:25 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:36:26.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:25 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:36:26.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:25 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:26.027 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.c/config 2023-05-08T03:36:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:25 smithi186 ceph-mon[126480]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]': finished 2023-05-08T03:36:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:25 smithi186 ceph-mon[126480]: osdmap e12: 2 total, 1 up, 2 in 2023-05-08T03:36:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:25 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-05-08T03:36:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:25 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-05-08T03:36:26.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:25 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:26.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:25 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:26.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:25 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:36:26.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:25 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:26.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:25 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:36:26.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:25 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:36:26.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:25 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:26 smithi186 ceph-mon[126480]: purged_snaps scrub starts 2023-05-08T03:36:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:26 smithi186 ceph-mon[126480]: purged_snaps scrub ok 2023-05-08T03:36:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:26 smithi186 ceph-mon[126480]: Detected new or changed devices on smithi133 2023-05-08T03:36:26.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:26 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi133 to 17168M 2023-05-08T03:36:26.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:26 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:36:26.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:26 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T03:36:26.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:26 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:36:26.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:26 smithi186 ceph-mon[126480]: pgmap v56: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-05-08T03:36:26.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:26 smithi186 ceph-mon[126480]: osd.1 [v2:172.21.15.133:6800/206989126,v1:172.21.15.133:6801/206989126] boot 2023-05-08T03:36:26.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:26 smithi186 ceph-mon[126480]: osdmap e13: 2 total, 2 up, 2 in 2023-05-08T03:36:26.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:26 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-05-08T03:36:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:26 smithi133 ceph-mon[125939]: purged_snaps scrub starts 2023-05-08T03:36:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:26 smithi133 ceph-mon[125939]: purged_snaps scrub ok 2023-05-08T03:36:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:26 smithi133 ceph-mon[125939]: Detected new or changed devices on smithi133 2023-05-08T03:36:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:26 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi133 to 17168M 2023-05-08T03:36:26.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:26 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:36:26.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:26 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T03:36:26.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:26 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:36:26.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:26 smithi133 ceph-mon[125939]: pgmap v56: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-05-08T03:36:26.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:26 smithi133 ceph-mon[125939]: osd.1 [v2:172.21.15.133:6800/206989126,v1:172.21.15.133:6801/206989126] boot 2023-05-08T03:36:26.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:26 smithi133 ceph-mon[125939]: osdmap e13: 2 total, 2 up, 2 in 2023-05-08T03:36:26.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:26 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-05-08T03:36:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:26 smithi096 ceph-mon[124666]: purged_snaps scrub starts 2023-05-08T03:36:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:26 smithi096 ceph-mon[124666]: purged_snaps scrub ok 2023-05-08T03:36:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:26 smithi096 ceph-mon[124666]: Detected new or changed devices on smithi133 2023-05-08T03:36:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:26 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi133 to 17168M 2023-05-08T03:36:27.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:26 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:36:27.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:26 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T03:36:27.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:26 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:36:27.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:26 smithi096 ceph-mon[124666]: pgmap v56: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-05-08T03:36:27.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:26 smithi096 ceph-mon[124666]: osd.1 [v2:172.21.15.133:6800/206989126,v1:172.21.15.133:6801/206989126] boot 2023-05-08T03:36:27.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:26 smithi096 ceph-mon[124666]: osdmap e13: 2 total, 2 up, 2 in 2023-05-08T03:36:27.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:26 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-05-08T03:36:27.205 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:36:27.203+0000 7fc509e6c700 1 -- 172.21.15.186:0/2320121181 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc5040ff2e0 msgr2=0x7fc5040ff6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:36:27.205 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:36:27.203+0000 7fc509e6c700 1 --2- 172.21.15.186:0/2320121181 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc5040ff2e0 0x7fc5040ff6f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec009990 tx=0x7fc4ec009ca0 comp rx=0 tx=0).stop 2023-05-08T03:36:27.206 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:36:27.203+0000 7fc509e6c700 1 -- 172.21.15.186:0/2320121181 shutdown_connections 2023-05-08T03:36:27.206 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:36:27.203+0000 7fc509e6c700 1 --2- 172.21.15.186:0/2320121181 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc504100e70 0x7fc504107730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:36:27.206 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:36:27.203+0000 7fc509e6c700 1 --2- 172.21.15.186:0/2320121181 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc5040ff2e0 0x7fc5040ff6f0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:36:27.206 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:36:27.203+0000 7fc509e6c700 1 --2- 172.21.15.186:0/2320121181 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5041004e0 0x7fc504100930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:36:27.206 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:36:27.203+0000 7fc509e6c700 1 -- 172.21.15.186:0/2320121181 >> 172.21.15.186:0/2320121181 conn(0x7fc5040fa8f0 msgr2=0x7fc5040fcd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:36:27.206 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:36:27.203+0000 7fc509e6c700 1 -- 172.21.15.186:0/2320121181 shutdown_connections 2023-05-08T03:36:27.206 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:36:27.203+0000 7fc509e6c700 1 -- 172.21.15.186:0/2320121181 wait complete. 2023-05-08T03:36:27.208 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:36:27.204+0000 7fc509e6c700 1 Processor -- start 2023-05-08T03:36:27.208 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:36:27.204+0000 7fc509e6c700 1 -- start start 2023-05-08T03:36:27.209 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:36:27.204+0000 7fc509e6c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5040ff2e0 0x7fc504103270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:36:27.209 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:36:27.204+0000 7fc509e6c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5041004e0 0x7fc5041018c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:36:27.209 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:36:27.204+0000 7fc509e6c700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc504100e70 0x7fc504101e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:36:27.209 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:36:27.204+0000 7fc509e6c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc504102580 con 0x7fc5041004e0 2023-05-08T03:36:27.209 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:36:27.204+0000 7fc509e6c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5041026f0 con 0x7fc5040ff2e0 2023-05-08T03:36:27.209 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:36:27.204+0000 7fc509e6c700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5041a02c0 con 0x7fc504100e70 2023-05-08T03:36:27.209 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:36:27.204+0000 7fc503fff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc504100e70 0x7fc504101e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:36:27.209 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:36:27.204+0000 7fc503fff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc504100e70 0x7fc504101e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.186:52540/0 (socket says 172.21.15.186:52540) 2023-05-08T03:36:27.210 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:36:27.204+0000 7fc503fff700 1 -- 172.21.15.186:0/502962230 learned_addr learned my addr 172.21.15.186:0/502962230 (peer_addr_for_me v2:172.21.15.186:0/0) 2023-05-08T03:36:27.210 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:36:27.204+0000 7fc502ffd700 1 --2- 172.21.15.186:0/502962230 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5041004e0 0x7fc5041018c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:36:27.210 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:36:27.204+0000 7fc5037fe700 1 --2- 172.21.15.186:0/502962230 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5040ff2e0 0x7fc504103270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:36:27.210 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:36:27.204+0000 7fc503fff700 1 -- 172.21.15.186:0/502962230 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5040ff2e0 msgr2=0x7fc504103270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:36:27.210 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:36:27.204+0000 7fc503fff700 1 --2- 172.21.15.186:0/502962230 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5040ff2e0 0x7fc504103270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:36:27.210 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:36:27.204+0000 7fc503fff700 1 -- 172.21.15.186:0/502962230 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5041004e0 msgr2=0x7fc5041018c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:36:27.210 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:36:27.204+0000 7fc503fff700 1 --2- 172.21.15.186:0/502962230 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5041004e0 0x7fc5041018c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:36:27.211 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:36:27.205+0000 7fc503fff700 1 -- 172.21.15.186:0/502962230 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4ec0095f0 con 0x7fc504100e70 2023-05-08T03:36:27.211 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:36:27.205+0000 7fc503fff700 1 --2- 172.21.15.186:0/502962230 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc504100e70 0x7fc504101e00 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc00ef30 tx=0x7fc4fc00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:36:27.211 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:36:27.205+0000 7fc500ff9700 1 -- 172.21.15.186:0/502962230 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4fc018070 con 0x7fc504100e70 2023-05-08T03:36:27.211 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:36:27.205+0000 7fc509e6c700 1 -- 172.21.15.186:0/502962230 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc50410aca0 con 0x7fc504100e70 2023-05-08T03:36:27.211 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:36:27.205+0000 7fc500ff9700 1 -- 172.21.15.186:0/502962230 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc4fc00f040 con 0x7fc504100e70 2023-05-08T03:36:27.211 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:36:27.205+0000 7fc500ff9700 1 -- 172.21.15.186:0/502962230 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4fc00cdb0 con 0x7fc504100e70 2023-05-08T03:36:27.211 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:36:27.205+0000 7fc509e6c700 1 -- 172.21.15.186:0/502962230 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc50410ab10 con 0x7fc504100e70 2023-05-08T03:36:27.211 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:36:27.206+0000 7fc509e6c700 1 -- 172.21.15.186:0/502962230 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5041a08f0 con 0x7fc504100e70 2023-05-08T03:36:27.212 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:36:27.207+0000 7fc500ff9700 1 -- 172.21.15.186:0/502962230 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 15) v1 ==== 135659+0+0 (secure 0 0 0) 0x7fc4fc003a00 con 0x7fc504100e70 2023-05-08T03:36:27.212 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:36:27.208+0000 7fc500ff9700 1 --2- 172.21.15.186:0/502962230 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fc4f00a10c0 0x7fc4f00a3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:36:27.213 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:36:27.208+0000 7fc500ff9700 1 -- 172.21.15.186:0/502962230 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2309+0+0 (secure 0 0 0) 0x7fc4fc0cb5b0 con 0x7fc504100e70 2023-05-08T03:36:27.213 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:36:27.208+0000 7fc5037fe700 1 --2- 172.21.15.186:0/502962230 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fc4f00a10c0 0x7fc4f00a3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:36:27.213 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:36:27.208+0000 7fc5037fe700 1 --2- 172.21.15.186:0/502962230 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fc4f00a10c0 0x7fc4f00a3570 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec00b2e0 tx=0x7fc4ec005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:36:27.213 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:36:27.211+0000 7fc500ff9700 1 -- 172.21.15.186:0/502962230 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fc4fc0965e0 con 0x7fc504100e70 2023-05-08T03:36:27.408 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:36:27.406+0000 7fc509e6c700 1 -- 172.21.15.186:0/502962230 --> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fc504068e40 con 0x7fc4f00a10c0 2023-05-08T03:36:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:27 smithi133 ceph-mon[125939]: osdmap e14: 2 total, 2 up, 2 in 2023-05-08T03:36:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:27 smithi133 ceph-mon[125939]: from='client.24166 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:36:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:27 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-05-08T03:36:28.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:27 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-05-08T03:36:28.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:27 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:36:28.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:27 smithi133 ceph-mon[125939]: pgmap v59: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2023-05-08T03:36:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:27 smithi096 ceph-mon[124666]: osdmap e14: 2 total, 2 up, 2 in 2023-05-08T03:36:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:27 smithi096 ceph-mon[124666]: from='client.24166 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:36:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:27 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-05-08T03:36:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:27 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-05-08T03:36:28.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:27 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:36:28.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:27 smithi096 ceph-mon[124666]: pgmap v59: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2023-05-08T03:36:28.313 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:27 smithi186 ceph-mon[126480]: osdmap e14: 2 total, 2 up, 2 in 2023-05-08T03:36:28.314 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:27 smithi186 ceph-mon[126480]: from='client.24166 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:36:28.314 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:27 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-05-08T03:36:28.314 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:27 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-05-08T03:36:28.314 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:27 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:36:28.314 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:27 smithi186 ceph-mon[126480]: pgmap v59: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2023-05-08T03:36:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:30 smithi186 ceph-mon[126480]: pgmap v60: 0 pgs: ; 0 B data, 9.9 MiB used, 179 GiB / 179 GiB avail 2023-05-08T03:36:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:30 smithi186 ceph-mon[126480]: from='client.? 172.21.15.186:0/1915650113' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "74a2f239-e82d-4d87-9458-5373b6cbbffd"}]: dispatch 2023-05-08T03:36:30.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:30 smithi186 ceph-mon[126480]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "74a2f239-e82d-4d87-9458-5373b6cbbffd"}]: dispatch 2023-05-08T03:36:30.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:30 smithi186 ceph-mon[126480]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "74a2f239-e82d-4d87-9458-5373b6cbbffd"}]': finished 2023-05-08T03:36:30.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:30 smithi186 ceph-mon[126480]: osdmap e15: 3 total, 2 up, 3 in 2023-05-08T03:36:30.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:30 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-05-08T03:36:30.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:30 smithi186 ceph-mon[126480]: from='client.? 172.21.15.186:0/1497621683' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-05-08T03:36:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:30 smithi133 ceph-mon[125939]: pgmap v60: 0 pgs: ; 0 B data, 9.9 MiB used, 179 GiB / 179 GiB avail 2023-05-08T03:36:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:30 smithi133 ceph-mon[125939]: from='client.? 172.21.15.186:0/1915650113' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "74a2f239-e82d-4d87-9458-5373b6cbbffd"}]: dispatch 2023-05-08T03:36:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:30 smithi133 ceph-mon[125939]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "74a2f239-e82d-4d87-9458-5373b6cbbffd"}]: dispatch 2023-05-08T03:36:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:30 smithi133 ceph-mon[125939]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "74a2f239-e82d-4d87-9458-5373b6cbbffd"}]': finished 2023-05-08T03:36:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:30 smithi133 ceph-mon[125939]: osdmap e15: 3 total, 2 up, 3 in 2023-05-08T03:36:30.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:30 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-05-08T03:36:30.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:30 smithi133 ceph-mon[125939]: from='client.? 172.21.15.186:0/1497621683' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-05-08T03:36:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:30 smithi096 ceph-mon[124666]: pgmap v60: 0 pgs: ; 0 B data, 9.9 MiB used, 179 GiB / 179 GiB avail 2023-05-08T03:36:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:30 smithi096 ceph-mon[124666]: from='client.? 172.21.15.186:0/1915650113' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "74a2f239-e82d-4d87-9458-5373b6cbbffd"}]: dispatch 2023-05-08T03:36:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:30 smithi096 ceph-mon[124666]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "74a2f239-e82d-4d87-9458-5373b6cbbffd"}]: dispatch 2023-05-08T03:36:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:30 smithi096 ceph-mon[124666]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "74a2f239-e82d-4d87-9458-5373b6cbbffd"}]': finished 2023-05-08T03:36:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:30 smithi096 ceph-mon[124666]: osdmap e15: 3 total, 2 up, 3 in 2023-05-08T03:36:31.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:30 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-05-08T03:36:31.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:30 smithi096 ceph-mon[124666]: from='client.? 172.21.15.186:0/1497621683' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-05-08T03:36:32.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:32 smithi186 ceph-mon[126480]: pgmap v62: 0 pgs: ; 0 B data, 9.9 MiB used, 179 GiB / 179 GiB avail 2023-05-08T03:36:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:32 smithi133 ceph-mon[125939]: pgmap v62: 0 pgs: ; 0 B data, 9.9 MiB used, 179 GiB / 179 GiB avail 2023-05-08T03:36:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:32 smithi096 ceph-mon[124666]: pgmap v62: 0 pgs: ; 0 B data, 9.9 MiB used, 179 GiB / 179 GiB avail 2023-05-08T03:36:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:34 smithi186 ceph-mon[126480]: pgmap v63: 0 pgs: ; 0 B data, 9.9 MiB used, 179 GiB / 179 GiB avail 2023-05-08T03:36:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:34 smithi133 ceph-mon[125939]: pgmap v63: 0 pgs: ; 0 B data, 9.9 MiB used, 179 GiB / 179 GiB avail 2023-05-08T03:36:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:34 smithi096 ceph-mon[124666]: pgmap v63: 0 pgs: ; 0 B data, 9.9 MiB used, 179 GiB / 179 GiB avail 2023-05-08T03:36:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:36 smithi186 ceph-mon[126480]: pgmap v64: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-05-08T03:36:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:36 smithi133 ceph-mon[125939]: pgmap v64: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-05-08T03:36:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:36 smithi096 ceph-mon[124666]: pgmap v64: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-05-08T03:36:37.765 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:37 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-05-08T03:36:37.765 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:37 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:36:37.765 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:37 smithi186 ceph-mon[126480]: Deploying daemon osd.2 on smithi186 2023-05-08T03:36:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:37 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-05-08T03:36:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:37 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:36:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:37 smithi133 ceph-mon[125939]: Deploying daemon osd.2 on smithi186 2023-05-08T03:36:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:37 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-05-08T03:36:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:37 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:36:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:37 smithi096 ceph-mon[124666]: Deploying daemon osd.2 on smithi186 2023-05-08T03:36:38.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:38 smithi186 ceph-mon[126480]: pgmap v65: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-05-08T03:36:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:38 smithi133 ceph-mon[125939]: pgmap v65: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-05-08T03:36:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:38 smithi096 ceph-mon[124666]: pgmap v65: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-05-08T03:36:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:40 smithi186 ceph-mon[126480]: pgmap v66: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-05-08T03:36:40.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:40 smithi133 ceph-mon[125939]: pgmap v66: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-05-08T03:36:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:40 smithi096 ceph-mon[124666]: pgmap v66: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-05-08T03:36:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:42 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:42 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:42 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:36:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:42 smithi186 ceph-mon[126480]: pgmap v67: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-05-08T03:36:42.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:42 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:42.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:42 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:42.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:42 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:36:42.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:42 smithi133 ceph-mon[125939]: pgmap v67: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-05-08T03:36:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:42 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:42 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:42 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:36:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:42 smithi096 ceph-mon[124666]: pgmap v67: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-05-08T03:36:44.320 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:36:44.318+0000 7fc500ff9700 1 -- 172.21.15.186:0/502962230 <== mgr.14152 v2:172.21.15.96:6800/2748629182 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fc504068e40 con 0x7fc4f00a10c0 2023-05-08T03:36:44.320 INFO:teuthology.orchestra.run.smithi186.stdout:Created osd(s) 2 on host 'smithi186' 2023-05-08T03:36:44.322 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:36:44.320+0000 7fc509e6c700 1 -- 172.21.15.186:0/502962230 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fc4f00a10c0 msgr2=0x7fc4f00a3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:36:44.322 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:36:44.320+0000 7fc509e6c700 1 --2- 172.21.15.186:0/502962230 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fc4f00a10c0 0x7fc4f00a3570 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec00b2e0 tx=0x7fc4ec005fb0 comp rx=0 tx=0).stop 2023-05-08T03:36:44.322 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:36:44.320+0000 7fc509e6c700 1 -- 172.21.15.186:0/502962230 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc504100e70 msgr2=0x7fc504101e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:36:44.323 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:36:44.320+0000 7fc509e6c700 1 --2- 172.21.15.186:0/502962230 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc504100e70 0x7fc504101e00 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc00ef30 tx=0x7fc4fc00c3a0 comp rx=0 tx=0).stop 2023-05-08T03:36:44.323 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:36:44.320+0000 7fc509e6c700 1 -- 172.21.15.186:0/502962230 shutdown_connections 2023-05-08T03:36:44.323 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:36:44.320+0000 7fc509e6c700 1 --2- 172.21.15.186:0/502962230 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fc4f00a10c0 0x7fc4f00a3570 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:36:44.323 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:36:44.320+0000 7fc509e6c700 1 --2- 172.21.15.186:0/502962230 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc504100e70 0x7fc504101e00 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:36:44.323 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:36:44.320+0000 7fc509e6c700 1 --2- 172.21.15.186:0/502962230 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5040ff2e0 0x7fc504103270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:36:44.323 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:36:44.320+0000 7fc509e6c700 1 --2- 172.21.15.186:0/502962230 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5041004e0 0x7fc5041018c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:36:44.323 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:36:44.320+0000 7fc509e6c700 1 -- 172.21.15.186:0/502962230 >> 172.21.15.186:0/502962230 conn(0x7fc5040fa8f0 msgr2=0x7fc504068730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:36:44.324 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:36:44.321+0000 7fc509e6c700 1 -- 172.21.15.186:0/502962230 shutdown_connections 2023-05-08T03:36:44.324 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:36:44.321+0000 7fc509e6c700 1 -- 172.21.15.186:0/502962230 wait complete. 2023-05-08T03:36:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:44 smithi186 ceph-mon[126480]: pgmap v68: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-05-08T03:36:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:44 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:44 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:44 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:36:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:44 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:36:44.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:44 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:36:44.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:44 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:44.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:44 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T03:36:44.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:44 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:36:44.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:44 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:44.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:44 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:44.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:44 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:36:44.807 DEBUG:teuthology.orchestra.run.smithi186:osd.2> sudo journalctl -f -n 0 -u ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c@osd.2.service 2023-05-08T03:36:44.809 INFO:tasks.cephadm:Deploying osd.3 on smithi096 with /dev/vg_nvme/lv_3... 2023-05-08T03:36:44.809 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-05-08T03:36:44.841 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:44 smithi096 ceph-mon[124666]: pgmap v68: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-05-08T03:36:44.842 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:44 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:44.842 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:44 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:44.842 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:44 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:36:44.842 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:44 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:36:44.842 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:44 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:36:44.843 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:44 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:44.843 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:44 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T03:36:44.843 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:44 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:36:44.843 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:44 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:44.843 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:44 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:44.843 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:44 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:36:44.844 INFO:journalctl@ceph.osd.2.smithi186.stdout:-- Logs begin at Mon 2023-05-08 03:08:31 UTC. -- 2023-05-08T03:36:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:44 smithi133 ceph-mon[125939]: pgmap v68: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-05-08T03:36:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:44 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:44 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:44.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:44 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:36:44.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:44 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:36:44.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:44 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:36:44.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:44 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:44.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:44 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T03:36:44.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:44 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:36:44.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:44 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:44.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:44 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:44.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:44 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:36:45.394 INFO:journalctl@ceph.osd.2.smithi186.stdout:May 08 03:36:45 smithi186 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-2[132352]: 2023-05-08T03:36:45.133+0000 7f6c1edf0640 -1 osd.2 0 log_to_monitors true 2023-05-08T03:36:45.464 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.a/config 2023-05-08T03:36:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:45 smithi186 ceph-mon[126480]: from='osd.2 [v2:172.21.15.186:6800/1791188143,v1:172.21.15.186:6801/1791188143]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-05-08T03:36:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:45 smithi186 ceph-mon[126480]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-05-08T03:36:45.870 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:45 smithi096 ceph-mon[124666]: from='osd.2 [v2:172.21.15.186:6800/1791188143,v1:172.21.15.186:6801/1791188143]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-05-08T03:36:45.870 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:45 smithi096 ceph-mon[124666]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-05-08T03:36:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:45 smithi133 ceph-mon[125939]: from='osd.2 [v2:172.21.15.186:6800/1791188143,v1:172.21.15.186:6801/1791188143]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-05-08T03:36:45.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:45 smithi133 ceph-mon[125939]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-05-08T03:36:46.785 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:46 smithi186 ceph-mon[126480]: pgmap v69: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-05-08T03:36:46.785 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:46 smithi186 ceph-mon[126480]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-05-08T03:36:46.785 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:46 smithi186 ceph-mon[126480]: osdmap e16: 3 total, 2 up, 3 in 2023-05-08T03:36:46.785 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:46 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-05-08T03:36:46.786 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:46 smithi186 ceph-mon[126480]: from='osd.2 [v2:172.21.15.186:6800/1791188143,v1:172.21.15.186:6801/1791188143]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2023-05-08T03:36:46.786 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:46 smithi186 ceph-mon[126480]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2023-05-08T03:36:46.786 INFO:journalctl@ceph.osd.2.smithi186.stdout:May 08 03:36:46 smithi186 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-2[132352]: 2023-05-08T03:36:46.527+0000 7f6c13c66700 -1 osd.2 0 waiting for initial osdmap 2023-05-08T03:36:46.786 INFO:journalctl@ceph.osd.2.smithi186.stdout:May 08 03:36:46 smithi186 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-2[132352]: 2023-05-08T03:36:46.533+0000 7f6c0da57700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-08T03:36:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:46 smithi133 ceph-mon[125939]: pgmap v69: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-05-08T03:36:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:46 smithi133 ceph-mon[125939]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-05-08T03:36:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:46 smithi133 ceph-mon[125939]: osdmap e16: 3 total, 2 up, 3 in 2023-05-08T03:36:46.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:46 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-05-08T03:36:46.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:46 smithi133 ceph-mon[125939]: from='osd.2 [v2:172.21.15.186:6800/1791188143,v1:172.21.15.186:6801/1791188143]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2023-05-08T03:36:46.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:46 smithi133 ceph-mon[125939]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2023-05-08T03:36:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:46 smithi096 ceph-mon[124666]: pgmap v69: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-05-08T03:36:47.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:46 smithi096 ceph-mon[124666]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-05-08T03:36:47.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:46 smithi096 ceph-mon[124666]: osdmap e16: 3 total, 2 up, 3 in 2023-05-08T03:36:47.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:46 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-05-08T03:36:47.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:46 smithi096 ceph-mon[124666]: from='osd.2 [v2:172.21.15.186:6800/1791188143,v1:172.21.15.186:6801/1791188143]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2023-05-08T03:36:47.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:46 smithi096 ceph-mon[124666]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2023-05-08T03:36:47.042 INFO:teuthology.orchestra.run.smithi096.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-05-08T03:36:47.043 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-05-08T03:36:47.043 INFO:teuthology.orchestra.run.smithi096.stderr: stderr: 10+0 records in 2023-05-08T03:36:47.043 INFO:teuthology.orchestra.run.smithi096.stderr:10+0 records out 2023-05-08T03:36:47.043 INFO:teuthology.orchestra.run.smithi096.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0145853 s, 719 MB/s 2023-05-08T03:36:47.043 INFO:teuthology.orchestra.run.smithi096.stderr:--> Zapping successful for: 2023-05-08T03:36:47.518 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- ceph orch daemon add osd smithi096:vg_nvme/lv_3 2023-05-08T03:36:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:47 smithi096 ceph-mon[124666]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]': finished 2023-05-08T03:36:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:47 smithi096 ceph-mon[124666]: osdmap e17: 3 total, 2 up, 3 in 2023-05-08T03:36:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:47 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-05-08T03:36:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:47 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-05-08T03:36:47.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:47 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:47.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:47 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:47.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:47 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:36:47.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:47 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:47.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:47 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:36:47.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:47 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:36:47.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:47 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:47 smithi186 ceph-mon[126480]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]': finished 2023-05-08T03:36:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:47 smithi186 ceph-mon[126480]: osdmap e17: 3 total, 2 up, 3 in 2023-05-08T03:36:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:47 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-05-08T03:36:47.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:47 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-05-08T03:36:47.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:47 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:47.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:47 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:47.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:47 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:36:47.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:47 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:47.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:47 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:36:47.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:47 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:36:47.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:47 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:47 smithi133 ceph-mon[125939]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]': finished 2023-05-08T03:36:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:47 smithi133 ceph-mon[125939]: osdmap e17: 3 total, 2 up, 3 in 2023-05-08T03:36:47.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:47 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-05-08T03:36:47.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:47 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-05-08T03:36:47.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:47 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:47.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:47 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:47.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:47 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:36:47.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:47 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:47.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:47 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:36:47.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:47 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:36:47.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:47 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:48.203 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.a/config 2023-05-08T03:36:48.745 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:48 smithi096 ceph-mon[124666]: purged_snaps scrub starts 2023-05-08T03:36:48.746 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:48 smithi096 ceph-mon[124666]: purged_snaps scrub ok 2023-05-08T03:36:48.746 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:48 smithi096 ceph-mon[124666]: Detected new or changed devices on smithi186 2023-05-08T03:36:48.746 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:48 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi186 to 17168M 2023-05-08T03:36:48.746 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:48 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:36:48.746 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:48 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T03:36:48.746 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:48 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:36:48.747 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:48 smithi096 ceph-mon[124666]: pgmap v72: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-05-08T03:36:48.747 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:48 smithi096 ceph-mon[124666]: osd.2 [v2:172.21.15.186:6800/1791188143,v1:172.21.15.186:6801/1791188143] boot 2023-05-08T03:36:48.747 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:48 smithi096 ceph-mon[124666]: osdmap e18: 3 total, 3 up, 3 in 2023-05-08T03:36:48.747 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:48 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-05-08T03:36:48.747 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:48 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-05-08T03:36:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:48 smithi186 ceph-mon[126480]: purged_snaps scrub starts 2023-05-08T03:36:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:48 smithi186 ceph-mon[126480]: purged_snaps scrub ok 2023-05-08T03:36:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:48 smithi186 ceph-mon[126480]: Detected new or changed devices on smithi186 2023-05-08T03:36:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:48 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi186 to 17168M 2023-05-08T03:36:48.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:48 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:36:48.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:48 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T03:36:48.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:48 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:36:48.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:48 smithi186 ceph-mon[126480]: pgmap v72: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-05-08T03:36:48.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:48 smithi186 ceph-mon[126480]: osd.2 [v2:172.21.15.186:6800/1791188143,v1:172.21.15.186:6801/1791188143] boot 2023-05-08T03:36:48.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:48 smithi186 ceph-mon[126480]: osdmap e18: 3 total, 3 up, 3 in 2023-05-08T03:36:48.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:48 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-05-08T03:36:48.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:48 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-05-08T03:36:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:48 smithi133 ceph-mon[125939]: purged_snaps scrub starts 2023-05-08T03:36:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:48 smithi133 ceph-mon[125939]: purged_snaps scrub ok 2023-05-08T03:36:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:48 smithi133 ceph-mon[125939]: Detected new or changed devices on smithi186 2023-05-08T03:36:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:48 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi186 to 17168M 2023-05-08T03:36:48.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:48 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:36:48.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:48 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T03:36:48.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:48 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:36:48.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:48 smithi133 ceph-mon[125939]: pgmap v72: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-05-08T03:36:48.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:48 smithi133 ceph-mon[125939]: osd.2 [v2:172.21.15.186:6800/1791188143,v1:172.21.15.186:6801/1791188143] boot 2023-05-08T03:36:48.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:48 smithi133 ceph-mon[125939]: osdmap e18: 3 total, 3 up, 3 in 2023-05-08T03:36:48.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:48 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-05-08T03:36:48.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:48 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-05-08T03:36:49.391 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:36:49.388+0000 7f008ceef700 1 -- 172.21.15.96:0/4095178336 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00881037d0 msgr2=0x7f0088105bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:36:49.391 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:36:49.388+0000 7f008ceef700 1 --2- 172.21.15.96:0/4095178336 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00881037d0 0x7f0088105bb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0078009990 tx=0x7f0078009ca0 comp rx=0 tx=0).stop 2023-05-08T03:36:49.391 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:36:49.388+0000 7f008ceef700 1 -- 172.21.15.96:0/4095178336 shutdown_connections 2023-05-08T03:36:49.392 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:36:49.388+0000 7f008ceef700 1 --2- 172.21.15.96:0/4095178336 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f00881060f0 0x7f0088108510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:36:49.392 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:36:49.388+0000 7f008ceef700 1 --2- 172.21.15.96:0/4095178336 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0088100eb0 0x7f0088103290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:36:49.392 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:36:49.388+0000 7f008ceef700 1 --2- 172.21.15.96:0/4095178336 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00881037d0 0x7f0088105bb0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:36:49.392 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:36:49.388+0000 7f008ceef700 1 -- 172.21.15.96:0/4095178336 >> 172.21.15.96:0/4095178336 conn(0x7f00880fa8f0 msgr2=0x7f00880fcd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:36:49.392 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:36:49.388+0000 7f008ceef700 1 -- 172.21.15.96:0/4095178336 shutdown_connections 2023-05-08T03:36:49.392 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:36:49.389+0000 7f008ceef700 1 -- 172.21.15.96:0/4095178336 wait complete. 2023-05-08T03:36:49.394 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:36:49.389+0000 7f008ceef700 1 Processor -- start 2023-05-08T03:36:49.394 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:36:49.389+0000 7f008ceef700 1 -- start start 2023-05-08T03:36:49.395 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:36:49.389+0000 7f008ceef700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0088100eb0 0x7f00881961b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:36:49.395 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:36:49.389+0000 7f008ceef700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f00881037d0 0x7f00881966f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:36:49.395 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:36:49.389+0000 7f008ceef700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00881060f0 0x7f008819d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:36:49.395 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:36:49.389+0000 7f008ceef700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f008819dd40 con 0x7f00881060f0 2023-05-08T03:36:49.395 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:36:49.389+0000 7f008ceef700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f008819de80 con 0x7f0088100eb0 2023-05-08T03:36:49.395 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:36:49.389+0000 7f008ceef700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f008819e010 con 0x7f00881037d0 2023-05-08T03:36:49.395 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:36:49.390+0000 7f0086d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00881060f0 0x7f008819d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:36:49.395 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:36:49.390+0000 7f0086d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00881060f0 0x7f008819d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39626/0 (socket says 172.21.15.96:39626) 2023-05-08T03:36:49.396 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:36:49.390+0000 7f0086d9d700 1 -- 172.21.15.96:0/4240329861 learned_addr learned my addr 172.21.15.96:0/4240329861 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:36:49.396 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:36:49.390+0000 7f008659c700 1 --2- 172.21.15.96:0/4240329861 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0088100eb0 0x7f00881961b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:36:49.396 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:36:49.390+0000 7f0085d9b700 1 --2- 172.21.15.96:0/4240329861 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f00881037d0 0x7f00881966f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:36:49.396 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:36:49.390+0000 7f0086d9d700 1 -- 172.21.15.96:0/4240329861 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f00881037d0 msgr2=0x7f00881966f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:36:49.396 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:36:49.390+0000 7f0086d9d700 1 --2- 172.21.15.96:0/4240329861 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f00881037d0 0x7f00881966f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:36:49.396 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:36:49.390+0000 7f0086d9d700 1 -- 172.21.15.96:0/4240329861 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0088100eb0 msgr2=0x7f00881961b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:36:49.396 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:36:49.390+0000 7f0086d9d700 1 --2- 172.21.15.96:0/4240329861 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0088100eb0 0x7f00881961b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:36:49.397 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:36:49.390+0000 7f0086d9d700 1 -- 172.21.15.96:0/4240329861 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00780095f0 con 0x7f00881060f0 2023-05-08T03:36:49.397 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:36:49.390+0000 7f0085d9b700 1 --2- 172.21.15.96:0/4240329861 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f00881037d0 0x7f00881966f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-08T03:36:49.397 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:36:49.390+0000 7f0086d9d700 1 --2- 172.21.15.96:0/4240329861 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00881060f0 0x7f008819d770 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0080007ef0 tx=0x7f008000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:36:49.397 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:36:49.390+0000 7f00777fe700 1 -- 172.21.15.96:0/4240329861 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0080017070 con 0x7f00881060f0 2023-05-08T03:36:49.397 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:36:49.390+0000 7f008ceef700 1 -- 172.21.15.96:0/4240329861 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f008810bdb0 con 0x7f00881060f0 2023-05-08T03:36:49.397 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:36:49.390+0000 7f00777fe700 1 -- 172.21.15.96:0/4240329861 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f008000f040 con 0x7f00881060f0 2023-05-08T03:36:49.397 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:36:49.390+0000 7f00777fe700 1 -- 172.21.15.96:0/4240329861 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0080004280 con 0x7f00881060f0 2023-05-08T03:36:49.397 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:36:49.390+0000 7f008ceef700 1 -- 172.21.15.96:0/4240329861 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f008810bc20 con 0x7f00881060f0 2023-05-08T03:36:49.398 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:36:49.391+0000 7f008ceef700 1 -- 172.21.15.96:0/4240329861 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00880fc460 con 0x7f00881060f0 2023-05-08T03:36:49.398 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:36:49.393+0000 7f00777fe700 1 -- 172.21.15.96:0/4240329861 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 15) v1 ==== 135659+0+0 (secure 0 0 0) 0x7f0080004c40 con 0x7f00881060f0 2023-05-08T03:36:49.399 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:36:49.393+0000 7f00777fe700 1 --2- 172.21.15.96:0/4240329861 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f00700a10c0 0x7f00700a3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:36:49.399 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:36:49.393+0000 7f008659c700 1 --2- 172.21.15.96:0/4240329861 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f00700a10c0 0x7f00700a3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:36:49.399 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:36:49.393+0000 7f00777fe700 1 -- 172.21.15.96:0/4240329861 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3226+0+0 (secure 0 0 0) 0x7f00800cb020 con 0x7f00881060f0 2023-05-08T03:36:49.399 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:36:49.394+0000 7f008659c700 1 --2- 172.21.15.96:0/4240329861 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f00700a10c0 0x7f00700a3570 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f007c005950 tx=0x7f007c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:36:49.399 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:36:49.397+0000 7f00777fe700 1 -- 172.21.15.96:0/4240329861 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f0080095cc0 con 0x7f00881060f0 2023-05-08T03:36:49.612 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:36:49.610+0000 7f008ceef700 1 -- 172.21.15.96:0/4240329861 --> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi096:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f0088061ac0 con 0x7f00700a10c0 2023-05-08T03:36:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:49 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-05-08T03:36:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:49 smithi186 ceph-mon[126480]: osdmap e19: 3 total, 3 up, 3 in 2023-05-08T03:36:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:49 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-05-08T03:36:49.903 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:49 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-05-08T03:36:49.904 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:49 smithi096 ceph-mon[124666]: osdmap e19: 3 total, 3 up, 3 in 2023-05-08T03:36:49.904 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:49 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-05-08T03:36:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:49 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-05-08T03:36:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:49 smithi133 ceph-mon[125939]: osdmap e19: 3 total, 3 up, 3 in 2023-05-08T03:36:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:49 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-05-08T03:36:50.163 INFO:journalctl@ceph.osd.0.smithi096.stdout:May 08 03:36:49 smithi096 sudo[140758]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-05-08T03:36:50.163 INFO:journalctl@ceph.osd.0.smithi096.stdout:May 08 03:36:49 smithi096 sudo[140758]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-05-08T03:36:50.163 INFO:journalctl@ceph.osd.0.smithi096.stdout:May 08 03:36:49 smithi096 sudo[140758]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-05-08T03:36:50.164 INFO:journalctl@ceph.osd.0.smithi096.stdout:May 08 03:36:49 smithi096 sudo[140758]: pam_unix(sudo:session): session closed for user root 2023-05-08T03:36:50.505 INFO:journalctl@ceph.osd.0.smithi096.stdout:May 08 03:36:50 smithi096 sudo[140782]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-05-08T03:36:50.505 INFO:journalctl@ceph.osd.0.smithi096.stdout:May 08 03:36:50 smithi096 sudo[140782]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-05-08T03:36:50.505 INFO:journalctl@ceph.osd.0.smithi096.stdout:May 08 03:36:50 smithi096 sudo[140782]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-05-08T03:36:50.505 INFO:journalctl@ceph.osd.0.smithi096.stdout:May 08 03:36:50 smithi096 sudo[140782]: pam_unix(sudo:session): session closed for user root 2023-05-08T03:36:50.559 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:36:50.557+0000 7f00777fe700 1 -- 172.21.15.96:0/4240329861 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f0080096090 con 0x7f00881060f0 2023-05-08T03:36:50.686 INFO:journalctl@ceph.osd.1.smithi133.stdout:May 08 03:36:50 smithi133 sudo[133281]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-05-08T03:36:50.687 INFO:journalctl@ceph.osd.1.smithi133.stdout:May 08 03:36:50 smithi133 sudo[133281]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-05-08T03:36:50.687 INFO:journalctl@ceph.osd.1.smithi133.stdout:May 08 03:36:50 smithi133 sudo[133281]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-05-08T03:36:50.687 INFO:journalctl@ceph.osd.1.smithi133.stdout:May 08 03:36:50 smithi133 sudo[133281]: pam_unix(sudo:session): session closed for user root 2023-05-08T03:36:50.687 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:50 smithi133 ceph-mon[125939]: pgmap v75: 1 pgs: 1 unknown; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2023-05-08T03:36:50.688 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:50 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-05-08T03:36:50.688 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:50 smithi133 ceph-mon[125939]: osdmap e20: 3 total, 3 up, 3 in 2023-05-08T03:36:50.688 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:50 smithi133 ceph-mon[125939]: from='client.14277 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi096:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:36:50.688 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:50 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-05-08T03:36:50.688 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:50 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-05-08T03:36:50.688 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:50 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:36:50.689 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:50 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:50.836 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:50 smithi096 ceph-mon[124666]: pgmap v75: 1 pgs: 1 unknown; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2023-05-08T03:36:50.836 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:50 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-05-08T03:36:50.837 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:50 smithi096 ceph-mon[124666]: osdmap e20: 3 total, 3 up, 3 in 2023-05-08T03:36:50.837 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:50 smithi096 ceph-mon[124666]: from='client.14277 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi096:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:36:50.837 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:50 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-05-08T03:36:50.837 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:50 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-05-08T03:36:50.837 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:50 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:36:50.837 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:50 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:50 smithi186 ceph-mon[126480]: pgmap v75: 1 pgs: 1 unknown; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2023-05-08T03:36:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:50 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-05-08T03:36:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:50 smithi186 ceph-mon[126480]: osdmap e20: 3 total, 3 up, 3 in 2023-05-08T03:36:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:50 smithi186 ceph-mon[126480]: from='client.14277 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi096:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:36:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:50 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-05-08T03:36:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:50 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-05-08T03:36:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:50 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:36:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:50 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:50.990 INFO:journalctl@ceph.osd.1.smithi133.stdout:May 08 03:36:50 smithi133 sudo[133284]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-05-08T03:36:50.990 INFO:journalctl@ceph.osd.1.smithi133.stdout:May 08 03:36:50 smithi133 sudo[133284]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-05-08T03:36:50.990 INFO:journalctl@ceph.osd.1.smithi133.stdout:May 08 03:36:50 smithi133 sudo[133284]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-05-08T03:36:50.991 INFO:journalctl@ceph.osd.1.smithi133.stdout:May 08 03:36:50 smithi133 sudo[133284]: pam_unix(sudo:session): session closed for user root 2023-05-08T03:36:51.205 INFO:journalctl@ceph.osd.2.smithi186.stdout:May 08 03:36:50 smithi186 sudo[134593]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-05-08T03:36:51.206 INFO:journalctl@ceph.osd.2.smithi186.stdout:May 08 03:36:50 smithi186 sudo[134593]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-05-08T03:36:51.206 INFO:journalctl@ceph.osd.2.smithi186.stdout:May 08 03:36:50 smithi186 sudo[134593]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-05-08T03:36:51.206 INFO:journalctl@ceph.osd.2.smithi186.stdout:May 08 03:36:50 smithi186 sudo[134593]: pam_unix(sudo:session): session closed for user root 2023-05-08T03:36:51.618 INFO:journalctl@ceph.osd.2.smithi186.stdout:May 08 03:36:51 smithi186 sudo[134596]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-05-08T03:36:51.619 INFO:journalctl@ceph.osd.2.smithi186.stdout:May 08 03:36:51 smithi186 sudo[134596]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-05-08T03:36:51.619 INFO:journalctl@ceph.osd.2.smithi186.stdout:May 08 03:36:51 smithi186 sudo[134596]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-05-08T03:36:51.619 INFO:journalctl@ceph.osd.2.smithi186.stdout:May 08 03:36:51 smithi186 sudo[134596]: pam_unix(sudo:session): session closed for user root 2023-05-08T03:36:51.751 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:51 smithi096 sudo[140905]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-05-08T03:36:51.752 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:51 smithi096 sudo[140905]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-05-08T03:36:51.752 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:51 smithi096 sudo[140905]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-05-08T03:36:51.752 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:51 smithi096 sudo[140905]: pam_unix(sudo:session): session closed for user root 2023-05-08T03:36:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:51 smithi096 sudo[140920]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-05-08T03:36:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:51 smithi096 sudo[140920]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-05-08T03:36:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:51 smithi096 sudo[140920]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-05-08T03:36:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:51 smithi096 sudo[140920]: pam_unix(sudo:session): session closed for user root 2023-05-08T03:36:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:51 smithi096 ceph-mon[124666]: osdmap e21: 3 total, 3 up, 3 in 2023-05-08T03:36:52.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:51 smithi096 ceph-mon[124666]: mgrmap e16: x(active, since 2m), standbys: z, y 2023-05-08T03:36:52.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:51 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:52.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:51 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:52.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:51 smithi096 ceph-mon[124666]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-05-08T03:36:52.008 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:51 smithi186 ceph-mon[126480]: osdmap e21: 3 total, 3 up, 3 in 2023-05-08T03:36:52.009 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:51 smithi186 ceph-mon[126480]: mgrmap e16: x(active, since 2m), standbys: z, y 2023-05-08T03:36:52.009 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:51 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:52.009 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:51 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:52.009 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:51 smithi186 ceph-mon[126480]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-05-08T03:36:52.009 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:51 smithi186 sudo[134599]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-05-08T03:36:52.009 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:51 smithi186 sudo[134599]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-05-08T03:36:52.009 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:51 smithi186 sudo[134599]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-05-08T03:36:52.009 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:52 smithi186 sudo[134599]: pam_unix(sudo:session): session closed for user root 2023-05-08T03:36:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:51 smithi133 ceph-mon[125939]: osdmap e21: 3 total, 3 up, 3 in 2023-05-08T03:36:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:51 smithi133 ceph-mon[125939]: mgrmap e16: x(active, since 2m), standbys: z, y 2023-05-08T03:36:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:51 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:52.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:51 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:36:52.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:51 smithi133 ceph-mon[125939]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-05-08T03:36:52.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:52 smithi186 sudo[134602]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-05-08T03:36:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:52 smithi186 sudo[134602]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-05-08T03:36:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:52 smithi186 sudo[134602]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-05-08T03:36:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:52 smithi186 sudo[134602]: pam_unix(sudo:session): session closed for user root 2023-05-08T03:36:52.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:52 smithi133 sudo[133295]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-05-08T03:36:52.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:52 smithi133 sudo[133295]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-05-08T03:36:52.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:52 smithi133 sudo[133295]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-05-08T03:36:52.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:52 smithi133 sudo[133295]: pam_unix(sudo:session): session closed for user root 2023-05-08T03:36:52.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:52 smithi133 sudo[133298]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-05-08T03:36:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:52 smithi186 ceph-mon[126480]: pgmap v78: 1 pgs: 1 unknown; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2023-05-08T03:36:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:52 smithi186 ceph-mon[126480]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-05-08T03:36:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:52 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-05-08T03:36:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:52 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-05-08T03:36:53.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:52 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-05-08T03:36:53.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:52 smithi186 ceph-mon[126480]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-05-08T03:36:53.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:52 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-05-08T03:36:53.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:52 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-05-08T03:36:53.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:52 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-05-08T03:36:53.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:52 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/1279340687' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "421eedf5-ba6e-484e-b715-78c1c10d684e"}]: dispatch 2023-05-08T03:36:53.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:52 smithi186 ceph-mon[126480]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-05-08T03:36:53.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:52 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/1279340687' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "421eedf5-ba6e-484e-b715-78c1c10d684e"}]': finished 2023-05-08T03:36:53.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:52 smithi186 ceph-mon[126480]: osdmap e22: 4 total, 3 up, 4 in 2023-05-08T03:36:53.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:52 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-05-08T03:36:53.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:52 smithi186 ceph-mon[126480]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-05-08T03:36:53.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:52 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-05-08T03:36:53.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:52 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-05-08T03:36:53.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:52 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-05-08T03:36:53.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:52 smithi186 ceph-mon[126480]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-05-08T03:36:53.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:52 smithi133 sudo[133298]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-05-08T03:36:53.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:52 smithi133 sudo[133298]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-05-08T03:36:53.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:52 smithi133 sudo[133298]: pam_unix(sudo:session): session closed for user root 2023-05-08T03:36:53.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:52 smithi133 ceph-mon[125939]: pgmap v78: 1 pgs: 1 unknown; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2023-05-08T03:36:53.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:52 smithi133 ceph-mon[125939]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-05-08T03:36:53.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:52 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-05-08T03:36:53.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:52 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-05-08T03:36:53.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:52 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-05-08T03:36:53.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:52 smithi133 ceph-mon[125939]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-05-08T03:36:53.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:52 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-05-08T03:36:53.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:52 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-05-08T03:36:53.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:52 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-05-08T03:36:53.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:52 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/1279340687' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "421eedf5-ba6e-484e-b715-78c1c10d684e"}]: dispatch 2023-05-08T03:36:53.244 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:52 smithi133 ceph-mon[125939]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-05-08T03:36:53.244 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:52 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/1279340687' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "421eedf5-ba6e-484e-b715-78c1c10d684e"}]': finished 2023-05-08T03:36:53.244 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:52 smithi133 ceph-mon[125939]: osdmap e22: 4 total, 3 up, 4 in 2023-05-08T03:36:53.244 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:52 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-05-08T03:36:53.244 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:52 smithi133 ceph-mon[125939]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-05-08T03:36:53.244 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:52 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-05-08T03:36:53.244 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:52 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-05-08T03:36:53.245 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:52 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-05-08T03:36:53.245 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:52 smithi133 ceph-mon[125939]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-05-08T03:36:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:52 smithi096 ceph-mon[124666]: pgmap v78: 1 pgs: 1 unknown; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2023-05-08T03:36:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:52 smithi096 ceph-mon[124666]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-05-08T03:36:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:52 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-05-08T03:36:53.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:52 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-05-08T03:36:53.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:52 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-05-08T03:36:53.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:52 smithi096 ceph-mon[124666]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-05-08T03:36:53.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:52 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-05-08T03:36:53.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:52 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-05-08T03:36:53.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:52 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-05-08T03:36:53.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:52 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/1279340687' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "421eedf5-ba6e-484e-b715-78c1c10d684e"}]: dispatch 2023-05-08T03:36:53.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:52 smithi096 ceph-mon[124666]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-05-08T03:36:53.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:52 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/1279340687' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "421eedf5-ba6e-484e-b715-78c1c10d684e"}]': finished 2023-05-08T03:36:53.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:52 smithi096 ceph-mon[124666]: osdmap e22: 4 total, 3 up, 4 in 2023-05-08T03:36:53.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:52 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-05-08T03:36:53.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:52 smithi096 ceph-mon[124666]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-05-08T03:36:53.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:52 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-05-08T03:36:53.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:52 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-05-08T03:36:53.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:52 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-05-08T03:36:53.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:52 smithi096 ceph-mon[124666]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-05-08T03:36:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:53 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/2332295268' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-05-08T03:36:54.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:53 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/2332295268' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-05-08T03:36:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:53 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/2332295268' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-05-08T03:36:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:54 smithi186 ceph-mon[126480]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail 2023-05-08T03:36:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:54 smithi133 ceph-mon[125939]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail 2023-05-08T03:36:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:54 smithi096 ceph-mon[124666]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail 2023-05-08T03:36:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:56 smithi096 ceph-mon[124666]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-05-08T03:36:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:56 smithi186 ceph-mon[126480]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-05-08T03:36:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:56 smithi133 ceph-mon[125939]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-05-08T03:36:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:58 smithi186 ceph-mon[126480]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 50 KiB/s wr, 4 op/s 2023-05-08T03:36:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:58 smithi133 ceph-mon[125939]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 50 KiB/s wr, 4 op/s 2023-05-08T03:36:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:58 smithi096 ceph-mon[124666]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 50 KiB/s wr, 4 op/s 2023-05-08T03:36:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:59 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-05-08T03:36:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:36:59 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:36:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:59 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-05-08T03:36:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:36:59 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:36:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:59 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-05-08T03:36:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:36:59 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:37:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:00 smithi096 ceph-mon[124666]: Deploying daemon osd.3 on smithi096 2023-05-08T03:37:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:00 smithi096 ceph-mon[124666]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 36 KiB/s wr, 3 op/s 2023-05-08T03:37:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:00 smithi186 ceph-mon[126480]: Deploying daemon osd.3 on smithi096 2023-05-08T03:37:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:00 smithi186 ceph-mon[126480]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 36 KiB/s wr, 3 op/s 2023-05-08T03:37:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:00 smithi133 ceph-mon[125939]: Deploying daemon osd.3 on smithi096 2023-05-08T03:37:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:00 smithi133 ceph-mon[125939]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 36 KiB/s wr, 3 op/s 2023-05-08T03:37:02.818 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:02 smithi096 ceph-mon[124666]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 28 KiB/s wr, 2 op/s 2023-05-08T03:37:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:02 smithi186 ceph-mon[126480]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 28 KiB/s wr, 2 op/s 2023-05-08T03:37:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:02 smithi133 ceph-mon[125939]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 28 KiB/s wr, 2 op/s 2023-05-08T03:37:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:04 smithi133 ceph-mon[125939]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail; 910 B/s rd, 23 KiB/s wr, 2 op/s 2023-05-08T03:37:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:04 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:04 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:04.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:04 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:37:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:04 smithi096 ceph-mon[124666]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail; 910 B/s rd, 23 KiB/s wr, 2 op/s 2023-05-08T03:37:05.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:04 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:05.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:04 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:05.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:04 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:37:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:04 smithi186 ceph-mon[126480]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail; 910 B/s rd, 23 KiB/s wr, 2 op/s 2023-05-08T03:37:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:04 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:04 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:04 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:37:06.845 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:06 smithi096 ceph-mon[124666]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2023-05-08T03:37:06.845 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:06 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:06.846 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:06 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:06.846 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:06 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:37:06.846 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:06 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:37:06.846 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:06 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:06.969 INFO:teuthology.orchestra.run.smithi096.stdout:Created osd(s) 3 on host 'smithi096' 2023-05-08T03:37:06.970 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:37:06.967+0000 7f00777fe700 1 -- 172.21.15.96:0/4240329861 <== mgr.14152 v2:172.21.15.96:6800/2748629182 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f0088061ac0 con 0x7f00700a10c0 2023-05-08T03:37:06.972 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:37:06.969+0000 7f008ceef700 1 -- 172.21.15.96:0/4240329861 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f00700a10c0 msgr2=0x7f00700a3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:37:06.972 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:37:06.969+0000 7f008ceef700 1 --2- 172.21.15.96:0/4240329861 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f00700a10c0 0x7f00700a3570 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f007c005950 tx=0x7f007c00b410 comp rx=0 tx=0).stop 2023-05-08T03:37:06.972 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:37:06.970+0000 7f008ceef700 1 -- 172.21.15.96:0/4240329861 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00881060f0 msgr2=0x7f008819d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:37:06.973 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:37:06.970+0000 7f008ceef700 1 --2- 172.21.15.96:0/4240329861 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00881060f0 0x7f008819d770 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0080007ef0 tx=0x7f008000d3b0 comp rx=0 tx=0).stop 2023-05-08T03:37:06.973 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:37:06.970+0000 7f008ceef700 1 -- 172.21.15.96:0/4240329861 shutdown_connections 2023-05-08T03:37:06.973 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:37:06.970+0000 7f008ceef700 1 --2- 172.21.15.96:0/4240329861 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f00700a10c0 0x7f00700a3570 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:37:06.973 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:37:06.970+0000 7f008ceef700 1 --2- 172.21.15.96:0/4240329861 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00881060f0 0x7f008819d770 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:37:06.973 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:37:06.970+0000 7f008ceef700 1 --2- 172.21.15.96:0/4240329861 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0088100eb0 0x7f00881961b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:37:06.973 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:37:06.970+0000 7f008ceef700 1 --2- 172.21.15.96:0/4240329861 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f00881037d0 0x7f00881966f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:37:06.973 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:37:06.970+0000 7f008ceef700 1 -- 172.21.15.96:0/4240329861 >> 172.21.15.96:0/4240329861 conn(0x7f00880fa8f0 msgr2=0x7f0088101b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:37:06.973 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:37:06.970+0000 7f008ceef700 1 -- 172.21.15.96:0/4240329861 shutdown_connections 2023-05-08T03:37:06.974 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:37:06.970+0000 7f008ceef700 1 -- 172.21.15.96:0/4240329861 wait complete. 2023-05-08T03:37:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:06 smithi133 ceph-mon[125939]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2023-05-08T03:37:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:06 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:06 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:06 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:37:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:06 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:37:06.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:06 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:07.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:06 smithi186 ceph-mon[126480]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2023-05-08T03:37:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:06 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:06 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:06 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:37:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:06 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:37:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:06 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:07.394 DEBUG:teuthology.orchestra.run.smithi096:osd.3> sudo journalctl -f -n 0 -u ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c@osd.3.service 2023-05-08T03:37:07.396 INFO:tasks.cephadm:Deploying osd.4 on smithi133 with /dev/vg_nvme/lv_3... 2023-05-08T03:37:07.396 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-05-08T03:37:07.427 INFO:journalctl@ceph.osd.3.smithi096.stdout:-- Logs begin at Mon 2023-05-08 03:07:36 UTC. -- 2023-05-08T03:37:07.656 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:37:07 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 2023-05-08T03:37:07.564+0000 7f4a7dbf3640 -1 osd.3 0 log_to_monitors true 2023-05-08T03:37:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:07 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:37:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:07 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T03:37:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:07 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:37:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:07 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:07 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:37:07.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:07 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:07.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:07 smithi133 ceph-mon[125939]: from='osd.3 [v2:172.21.15.96:6810/3430402140,v1:172.21.15.96:6811/3430402140]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-05-08T03:37:07.909 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:07 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:37:07.909 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:07 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T03:37:07.910 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:07 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:37:07.910 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:07 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:07.910 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:07 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:37:07.910 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:07 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:07.910 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:07 smithi096 ceph-mon[124666]: from='osd.3 [v2:172.21.15.96:6810/3430402140,v1:172.21.15.96:6811/3430402140]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-05-08T03:37:08.045 INFO:teuthology.orchestra.run.smithi133.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.b/config 2023-05-08T03:37:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:07 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:37:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:07 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T03:37:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:07 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:37:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:07 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:07 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:37:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:07 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:08.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:07 smithi186 ceph-mon[126480]: from='osd.3 [v2:172.21.15.96:6810/3430402140,v1:172.21.15.96:6811/3430402140]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-05-08T03:37:08.658 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:08 smithi096 ceph-mon[124666]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2023-05-08T03:37:08.658 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:08 smithi096 ceph-mon[124666]: from='osd.3 [v2:172.21.15.96:6810/3430402140,v1:172.21.15.96:6811/3430402140]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-05-08T03:37:08.658 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:08 smithi096 ceph-mon[124666]: osdmap e23: 4 total, 3 up, 4 in 2023-05-08T03:37:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:08 smithi133 ceph-mon[125939]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2023-05-08T03:37:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:08 smithi133 ceph-mon[125939]: from='osd.3 [v2:172.21.15.96:6810/3430402140,v1:172.21.15.96:6811/3430402140]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-05-08T03:37:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:08 smithi133 ceph-mon[125939]: osdmap e23: 4 total, 3 up, 4 in 2023-05-08T03:37:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:08 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-05-08T03:37:08.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:08 smithi133 ceph-mon[125939]: from='osd.3 [v2:172.21.15.96:6810/3430402140,v1:172.21.15.96:6811/3430402140]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2023-05-08T03:37:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:08 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-05-08T03:37:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:08 smithi096 ceph-mon[124666]: from='osd.3 [v2:172.21.15.96:6810/3430402140,v1:172.21.15.96:6811/3430402140]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2023-05-08T03:37:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:08 smithi186 ceph-mon[126480]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2023-05-08T03:37:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:08 smithi186 ceph-mon[126480]: from='osd.3 [v2:172.21.15.96:6810/3430402140,v1:172.21.15.96:6811/3430402140]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-05-08T03:37:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:08 smithi186 ceph-mon[126480]: osdmap e23: 4 total, 3 up, 4 in 2023-05-08T03:37:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:08 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-05-08T03:37:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:08 smithi186 ceph-mon[126480]: from='osd.3 [v2:172.21.15.96:6810/3430402140,v1:172.21.15.96:6811/3430402140]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2023-05-08T03:37:09.588 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:37:09 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 2023-05-08T03:37:09.295+0000 7f4a72a69700 -1 osd.3 0 waiting for initial osdmap 2023-05-08T03:37:09.588 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:37:09 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 2023-05-08T03:37:09.302+0000 7f4a6b057700 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-08T03:37:09.592 INFO:teuthology.orchestra.run.smithi133.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-05-08T03:37:09.592 INFO:teuthology.orchestra.run.smithi133.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-05-08T03:37:09.592 INFO:teuthology.orchestra.run.smithi133.stderr: stderr: 10+0 records in 2023-05-08T03:37:09.593 INFO:teuthology.orchestra.run.smithi133.stderr:10+0 records out 2023-05-08T03:37:09.593 INFO:teuthology.orchestra.run.smithi133.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0128899 s, 813 MB/s 2023-05-08T03:37:09.593 INFO:teuthology.orchestra.run.smithi133.stderr: stderr: 2023-05-08T03:37:09.593 INFO:teuthology.orchestra.run.smithi133.stderr:--> Zapping successful for: 2023-05-08T03:37:10.000 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- ceph orch daemon add osd smithi133:vg_nvme/lv_3 2023-05-08T03:37:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:10 smithi186 ceph-mon[126480]: from='osd.3 [v2:172.21.15.96:6810/3430402140,v1:172.21.15.96:6811/3430402140]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]': finished 2023-05-08T03:37:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:10 smithi186 ceph-mon[126480]: osdmap e24: 4 total, 3 up, 4 in 2023-05-08T03:37:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:10 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-05-08T03:37:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:10 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-05-08T03:37:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:10 smithi186 ceph-mon[126480]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail 2023-05-08T03:37:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:10 smithi186 ceph-mon[126480]: Detected new or changed devices on smithi096 2023-05-08T03:37:10.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:10 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:10.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:10 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:10.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:10 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:37:10.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:10 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:37:10.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:10 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi096 to 8584M 2023-05-08T03:37:10.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:10 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:10.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:10 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:37:10.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:10 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:37:10.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:10 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:37:10.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:10 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:10.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:10 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T03:37:10.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:10 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:37:10.640 INFO:teuthology.orchestra.run.smithi133.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.b/config 2023-05-08T03:37:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:10 smithi133 ceph-mon[125939]: from='osd.3 [v2:172.21.15.96:6810/3430402140,v1:172.21.15.96:6811/3430402140]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]': finished 2023-05-08T03:37:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:10 smithi133 ceph-mon[125939]: osdmap e24: 4 total, 3 up, 4 in 2023-05-08T03:37:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:10 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-05-08T03:37:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:10 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-05-08T03:37:10.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:10 smithi133 ceph-mon[125939]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail 2023-05-08T03:37:10.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:10 smithi133 ceph-mon[125939]: Detected new or changed devices on smithi096 2023-05-08T03:37:10.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:10 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:10.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:10 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:10.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:10 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:37:10.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:10 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:37:10.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:10 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi096 to 8584M 2023-05-08T03:37:10.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:10 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:10.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:10 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:37:10.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:10 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:37:10.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:10 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:37:10.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:10 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:10.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:10 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T03:37:10.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:10 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:37:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:10 smithi096 ceph-mon[124666]: from='osd.3 [v2:172.21.15.96:6810/3430402140,v1:172.21.15.96:6811/3430402140]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]': finished 2023-05-08T03:37:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:10 smithi096 ceph-mon[124666]: osdmap e24: 4 total, 3 up, 4 in 2023-05-08T03:37:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:10 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-05-08T03:37:10.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:10 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-05-08T03:37:10.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:10 smithi096 ceph-mon[124666]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail 2023-05-08T03:37:10.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:10 smithi096 ceph-mon[124666]: Detected new or changed devices on smithi096 2023-05-08T03:37:10.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:10 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:10.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:10 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:10.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:10 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:37:10.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:10 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:37:10.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:10 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi096 to 8584M 2023-05-08T03:37:10.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:10 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:10.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:10 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:37:10.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:10 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:37:10.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:10 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:37:10.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:10 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:10.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:10 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T03:37:10.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:10 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:37:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:11 smithi133 ceph-mon[125939]: purged_snaps scrub starts 2023-05-08T03:37:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:11 smithi133 ceph-mon[125939]: purged_snaps scrub ok 2023-05-08T03:37:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:11 smithi133 ceph-mon[125939]: osd.3 [v2:172.21.15.96:6810/3430402140,v1:172.21.15.96:6811/3430402140] boot 2023-05-08T03:37:11.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:11 smithi133 ceph-mon[125939]: osdmap e25: 4 total, 4 up, 4 in 2023-05-08T03:37:11.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:11 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-05-08T03:37:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:11 smithi186 ceph-mon[126480]: purged_snaps scrub starts 2023-05-08T03:37:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:11 smithi186 ceph-mon[126480]: purged_snaps scrub ok 2023-05-08T03:37:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:11 smithi186 ceph-mon[126480]: osd.3 [v2:172.21.15.96:6810/3430402140,v1:172.21.15.96:6811/3430402140] boot 2023-05-08T03:37:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:11 smithi186 ceph-mon[126480]: osdmap e25: 4 total, 4 up, 4 in 2023-05-08T03:37:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:11 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-05-08T03:37:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:11 smithi096 ceph-mon[124666]: purged_snaps scrub starts 2023-05-08T03:37:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:11 smithi096 ceph-mon[124666]: purged_snaps scrub ok 2023-05-08T03:37:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:11 smithi096 ceph-mon[124666]: osd.3 [v2:172.21.15.96:6810/3430402140,v1:172.21.15.96:6811/3430402140] boot 2023-05-08T03:37:11.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:11 smithi096 ceph-mon[124666]: osdmap e25: 4 total, 4 up, 4 in 2023-05-08T03:37:11.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:11 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-05-08T03:37:11.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:37:11.912+0000 7f2dfcd44700 1 -- 172.21.15.133:0/317521563 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2df80feb10 msgr2=0x7f2df81089b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:37:11.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:37:11.912+0000 7f2dfcd44700 1 --2- 172.21.15.133:0/317521563 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2df80feb10 0x7f2df81089b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2df000b0a0 tx=0x7f2df000b3b0 comp rx=0 tx=0).stop 2023-05-08T03:37:11.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:37:11.912+0000 7f2dfcd44700 1 -- 172.21.15.133:0/317521563 shutdown_connections 2023-05-08T03:37:11.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:37:11.912+0000 7f2dfcd44700 1 --2- 172.21.15.133:0/317521563 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2df80feb10 0x7f2df81089b0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:37:11.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:37:11.912+0000 7f2dfcd44700 1 --2- 172.21.15.133:0/317521563 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2df81019c0 0x7f2df8101dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:37:11.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:37:11.912+0000 7f2dfcd44700 1 --2- 172.21.15.133:0/317521563 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2df81023a0 0x7f2df80fe480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:37:11.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:37:11.912+0000 7f2dfcd44700 1 -- 172.21.15.133:0/317521563 >> 172.21.15.133:0/317521563 conn(0x7f2df80fa070 msgr2=0x7f2df80fc4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:37:11.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:37:11.913+0000 7f2dfcd44700 1 -- 172.21.15.133:0/317521563 shutdown_connections 2023-05-08T03:37:11.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:37:11.913+0000 7f2dfcd44700 1 -- 172.21.15.133:0/317521563 wait complete. 2023-05-08T03:37:11.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:37:11.913+0000 7f2dfcd44700 1 Processor -- start 2023-05-08T03:37:11.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:37:11.913+0000 7f2dfcd44700 1 -- start start 2023-05-08T03:37:11.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:37:11.913+0000 7f2dfcd44700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2df80feb10 0x7f2df81010c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:37:11.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:37:11.913+0000 7f2dfcd44700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2df81019c0 0x7f2df80ff710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:37:11.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:37:11.913+0000 7f2dfcd44700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2df81023a0 0x7f2df80ffc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:37:11.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:37:11.913+0000 7f2dfcd44700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df81003d0 con 0x7f2df81023a0 2023-05-08T03:37:11.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:37:11.913+0000 7f2dfcd44700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df8100540 con 0x7f2df81019c0 2023-05-08T03:37:11.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:37:11.913+0000 7f2dfcd44700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df81a0280 con 0x7f2df80feb10 2023-05-08T03:37:11.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:37:11.914+0000 7f2df5d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2df81019c0 0x7f2df80ff710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:37:11.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:37:11.914+0000 7f2df5d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2df81019c0 0x7f2df80ff710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43912/0 (socket says 172.21.15.133:43912) 2023-05-08T03:37:11.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:37:11.914+0000 7f2df5d9b700 1 -- 172.21.15.133:0/3013509907 learned_addr learned my addr 172.21.15.133:0/3013509907 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-05-08T03:37:11.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:37:11.914+0000 7f2df659c700 1 --2- 172.21.15.133:0/3013509907 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2df80feb10 0x7f2df81010c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:37:11.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:37:11.914+0000 7f2df6d9d700 1 --2- 172.21.15.133:0/3013509907 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2df81023a0 0x7f2df80ffc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:37:11.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:37:11.914+0000 7f2df5d9b700 1 -- 172.21.15.133:0/3013509907 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2df80feb10 msgr2=0x7f2df81010c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:37:11.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:37:11.914+0000 7f2df5d9b700 1 --2- 172.21.15.133:0/3013509907 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2df80feb10 0x7f2df81010c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:37:11.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:37:11.914+0000 7f2df5d9b700 1 -- 172.21.15.133:0/3013509907 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2df81023a0 msgr2=0x7f2df80ffc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:37:11.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:37:11.914+0000 7f2df5d9b700 1 --2- 172.21.15.133:0/3013509907 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2df81023a0 0x7f2df80ffc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:37:11.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:37:11.914+0000 7f2df5d9b700 1 -- 172.21.15.133:0/3013509907 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2df0009d00 con 0x7f2df81019c0 2023-05-08T03:37:11.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:37:11.914+0000 7f2df5d9b700 1 --2- 172.21.15.133:0/3013509907 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2df81019c0 0x7f2df80ff710 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2de800d980 tx=0x7f2de800dc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:37:11.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:37:11.914+0000 7f2de77fe700 1 -- 172.21.15.133:0/3013509907 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de800f890 con 0x7f2df81019c0 2023-05-08T03:37:11.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:37:11.914+0000 7f2dfcd44700 1 -- 172.21.15.133:0/3013509907 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2df810bd70 con 0x7f2df81019c0 2023-05-08T03:37:11.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:37:11.914+0000 7f2de77fe700 1 -- 172.21.15.133:0/3013509907 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2de8010460 con 0x7f2df81019c0 2023-05-08T03:37:11.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:37:11.914+0000 7f2de77fe700 1 -- 172.21.15.133:0/3013509907 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de800e610 con 0x7f2df81019c0 2023-05-08T03:37:11.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:37:11.914+0000 7f2dfcd44700 1 -- 172.21.15.133:0/3013509907 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2df810bbe0 con 0x7f2df81019c0 2023-05-08T03:37:11.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:37:11.915+0000 7f2dfcd44700 1 -- 172.21.15.133:0/3013509907 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2df8107b10 con 0x7f2df81019c0 2023-05-08T03:37:11.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:37:11.916+0000 7f2de77fe700 1 -- 172.21.15.133:0/3013509907 <== mon.2 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f2de80105d0 con 0x7f2df81019c0 2023-05-08T03:37:11.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:37:11.917+0000 7f2de77fe700 1 --2- 172.21.15.133:0/3013509907 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f2de00a11d0 0x7f2de00a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:37:11.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:37:11.917+0000 7f2de77fe700 1 -- 172.21.15.133:0/3013509907 <== mon.2 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 3698+0+0 (secure 0 0 0) 0x7f2de80cb180 con 0x7f2df81019c0 2023-05-08T03:37:11.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:37:11.917+0000 7f2df659c700 1 --2- 172.21.15.133:0/3013509907 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f2de00a11d0 0x7f2de00a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:37:11.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:37:11.917+0000 7f2df659c700 1 --2- 172.21.15.133:0/3013509907 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f2de00a11d0 0x7f2de00a3680 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2df80683d0 tx=0x7f2dec00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:37:11.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:37:11.920+0000 7f2de77fe700 1 -- 172.21.15.133:0/3013509907 <== mon.2 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f2de8095a30 con 0x7f2df81019c0 2023-05-08T03:37:12.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:37:12.115+0000 7f2dfcd44700 1 -- 172.21.15.133:0/3013509907 --> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi133:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f2df8061d30 con 0x7f2de00a11d0 2023-05-08T03:37:12.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:12 smithi186 ceph-mon[126480]: osdmap e26: 4 total, 4 up, 4 in 2023-05-08T03:37:12.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:12 smithi186 ceph-mon[126480]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail 2023-05-08T03:37:12.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:12 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-05-08T03:37:12.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:12 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-05-08T03:37:12.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:12 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:37:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:12 smithi133 ceph-mon[125939]: osdmap e26: 4 total, 4 up, 4 in 2023-05-08T03:37:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:12 smithi133 ceph-mon[125939]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail 2023-05-08T03:37:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:12 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-05-08T03:37:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:12 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-05-08T03:37:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:12 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:37:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:12 smithi096 ceph-mon[124666]: osdmap e26: 4 total, 4 up, 4 in 2023-05-08T03:37:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:12 smithi096 ceph-mon[124666]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail 2023-05-08T03:37:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:12 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-05-08T03:37:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:12 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-05-08T03:37:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:12 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:37:13.574 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:13 smithi133 ceph-mon[125939]: from='client.24215 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi133:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:37:13.574 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:13 smithi133 ceph-mon[125939]: osdmap e27: 4 total, 4 up, 4 in 2023-05-08T03:37:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:13 smithi186 ceph-mon[126480]: from='client.24215 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi133:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:37:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:13 smithi186 ceph-mon[126480]: osdmap e27: 4 total, 4 up, 4 in 2023-05-08T03:37:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:13 smithi096 ceph-mon[124666]: from='client.24215 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi133:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:37:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:13 smithi096 ceph-mon[124666]: osdmap e27: 4 total, 4 up, 4 in 2023-05-08T03:37:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:14 smithi186 ceph-mon[126480]: osdmap e28: 4 total, 4 up, 4 in 2023-05-08T03:37:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:14 smithi186 ceph-mon[126480]: pgmap v96: 1 pgs: 1 remapped+peering; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail 2023-05-08T03:37:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:14 smithi133 ceph-mon[125939]: osdmap e28: 4 total, 4 up, 4 in 2023-05-08T03:37:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:14 smithi133 ceph-mon[125939]: pgmap v96: 1 pgs: 1 remapped+peering; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail 2023-05-08T03:37:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:14 smithi096 ceph-mon[124666]: osdmap e28: 4 total, 4 up, 4 in 2023-05-08T03:37:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:14 smithi096 ceph-mon[124666]: pgmap v96: 1 pgs: 1 remapped+peering; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail 2023-05-08T03:37:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:15 smithi186 ceph-mon[126480]: osdmap e29: 4 total, 4 up, 4 in 2023-05-08T03:37:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:15 smithi186 ceph-mon[126480]: from='client.? 172.21.15.133:0/430917689' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fb20100b-6a5a-462d-955d-1697a3861e96"}]: dispatch 2023-05-08T03:37:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:15 smithi186 ceph-mon[126480]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fb20100b-6a5a-462d-955d-1697a3861e96"}]: dispatch 2023-05-08T03:37:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:15 smithi186 ceph-mon[126480]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fb20100b-6a5a-462d-955d-1697a3861e96"}]': finished 2023-05-08T03:37:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:15 smithi186 ceph-mon[126480]: osdmap e30: 5 total, 4 up, 5 in 2023-05-08T03:37:15.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:15 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-05-08T03:37:15.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:15 smithi186 ceph-mon[126480]: from='client.? 172.21.15.133:0/3243042051' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-05-08T03:37:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:15 smithi133 ceph-mon[125939]: osdmap e29: 4 total, 4 up, 4 in 2023-05-08T03:37:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:15 smithi133 ceph-mon[125939]: from='client.? 172.21.15.133:0/430917689' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fb20100b-6a5a-462d-955d-1697a3861e96"}]: dispatch 2023-05-08T03:37:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:15 smithi133 ceph-mon[125939]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fb20100b-6a5a-462d-955d-1697a3861e96"}]: dispatch 2023-05-08T03:37:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:15 smithi133 ceph-mon[125939]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fb20100b-6a5a-462d-955d-1697a3861e96"}]': finished 2023-05-08T03:37:15.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:15 smithi133 ceph-mon[125939]: osdmap e30: 5 total, 4 up, 5 in 2023-05-08T03:37:15.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:15 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-05-08T03:37:15.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:15 smithi133 ceph-mon[125939]: from='client.? 172.21.15.133:0/3243042051' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-05-08T03:37:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:15 smithi096 ceph-mon[124666]: osdmap e29: 4 total, 4 up, 4 in 2023-05-08T03:37:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:15 smithi096 ceph-mon[124666]: from='client.? 172.21.15.133:0/430917689' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fb20100b-6a5a-462d-955d-1697a3861e96"}]: dispatch 2023-05-08T03:37:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:15 smithi096 ceph-mon[124666]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fb20100b-6a5a-462d-955d-1697a3861e96"}]: dispatch 2023-05-08T03:37:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:15 smithi096 ceph-mon[124666]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fb20100b-6a5a-462d-955d-1697a3861e96"}]': finished 2023-05-08T03:37:15.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:15 smithi096 ceph-mon[124666]: osdmap e30: 5 total, 4 up, 5 in 2023-05-08T03:37:15.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:15 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-05-08T03:37:15.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:15 smithi096 ceph-mon[124666]: from='client.? 172.21.15.133:0/3243042051' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-05-08T03:37:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:16 smithi186 ceph-mon[126480]: pgmap v99: 1 pgs: 1 remapped+peering; 577 KiB data, 25 MiB used, 358 GiB / 358 GiB avail 2023-05-08T03:37:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:16 smithi133 ceph-mon[125939]: pgmap v99: 1 pgs: 1 remapped+peering; 577 KiB data, 25 MiB used, 358 GiB / 358 GiB avail 2023-05-08T03:37:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:16 smithi096 ceph-mon[124666]: pgmap v99: 1 pgs: 1 remapped+peering; 577 KiB data, 25 MiB used, 358 GiB / 358 GiB avail 2023-05-08T03:37:18.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:18 smithi186 ceph-mon[126480]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 25 MiB used, 358 GiB / 358 GiB avail; 111 KiB/s, 0 objects/s recovering 2023-05-08T03:37:18.622 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:18 smithi133 ceph-mon[125939]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 25 MiB used, 358 GiB / 358 GiB avail; 111 KiB/s, 0 objects/s recovering 2023-05-08T03:37:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:18 smithi096 ceph-mon[124666]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 25 MiB used, 358 GiB / 358 GiB avail; 111 KiB/s, 0 objects/s recovering 2023-05-08T03:37:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:20 smithi186 ceph-mon[126480]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail; 93 KiB/s, 0 objects/s recovering 2023-05-08T03:37:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:20 smithi133 ceph-mon[125939]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail; 93 KiB/s, 0 objects/s recovering 2023-05-08T03:37:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:20 smithi096 ceph-mon[124666]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail; 93 KiB/s, 0 objects/s recovering 2023-05-08T03:37:21.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:21 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-05-08T03:37:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:21 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:37:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:21 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-05-08T03:37:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:21 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:37:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:21 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-05-08T03:37:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:21 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:37:22.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:22 smithi133 ceph-mon[125939]: Deploying daemon osd.4 on smithi133 2023-05-08T03:37:22.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:22 smithi133 ceph-mon[125939]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-05-08T03:37:22.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:22 smithi186 ceph-mon[126480]: Deploying daemon osd.4 on smithi133 2023-05-08T03:37:22.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:22 smithi186 ceph-mon[126480]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-05-08T03:37:23.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:22 smithi096 ceph-mon[124666]: Deploying daemon osd.4 on smithi133 2023-05-08T03:37:23.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:22 smithi096 ceph-mon[124666]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-05-08T03:37:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:24 smithi133 ceph-mon[125939]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail; 63 KiB/s, 0 objects/s recovering 2023-05-08T03:37:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:24 smithi186 ceph-mon[126480]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail; 63 KiB/s, 0 objects/s recovering 2023-05-08T03:37:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:24 smithi096 ceph-mon[124666]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail; 63 KiB/s, 0 objects/s recovering 2023-05-08T03:37:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:26 smithi133 ceph-mon[125939]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail; 53 KiB/s, 0 objects/s recovering 2023-05-08T03:37:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:26 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:26 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:27.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:26 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:37:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:26 smithi096 ceph-mon[124666]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail; 53 KiB/s, 0 objects/s recovering 2023-05-08T03:37:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:26 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:27.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:26 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:27.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:26 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:37:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:26 smithi186 ceph-mon[126480]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail; 53 KiB/s, 0 objects/s recovering 2023-05-08T03:37:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:26 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:26 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:27.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:26 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:37:28.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:28 smithi186 ceph-mon[126480]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-05-08T03:37:28.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:28 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:28.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:28 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:28.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:28 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:37:28.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:28 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:37:28.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:28 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:28.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:28 smithi133 ceph-mon[125939]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-05-08T03:37:28.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:28 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:28.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:28 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:28.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:28 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:37:28.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:28 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:37:28.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:28 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:28 smithi096 ceph-mon[124666]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-05-08T03:37:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:28 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:28 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:28 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:37:28.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:28 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:37:28.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:28 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:28.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:37:28.874+0000 7f2de77fe700 1 -- 172.21.15.133:0/3013509907 <== mgr.14152 v2:172.21.15.96:6800/2748629182 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f2df8061d30 con 0x7f2de00a11d0 2023-05-08T03:37:28.877 INFO:teuthology.orchestra.run.smithi133.stdout:Created osd(s) 4 on host 'smithi133' 2023-05-08T03:37:28.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:37:28.876+0000 7f2dfcd44700 1 -- 172.21.15.133:0/3013509907 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f2de00a11d0 msgr2=0x7f2de00a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:37:28.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:37:28.876+0000 7f2dfcd44700 1 --2- 172.21.15.133:0/3013509907 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f2de00a11d0 0x7f2de00a3680 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2df80683d0 tx=0x7f2dec00b410 comp rx=0 tx=0).stop 2023-05-08T03:37:28.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:37:28.876+0000 7f2dfcd44700 1 -- 172.21.15.133:0/3013509907 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2df81019c0 msgr2=0x7f2df80ff710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:37:28.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:37:28.876+0000 7f2dfcd44700 1 --2- 172.21.15.133:0/3013509907 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2df81019c0 0x7f2df80ff710 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2de800d980 tx=0x7f2de800dc90 comp rx=0 tx=0).stop 2023-05-08T03:37:28.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:37:28.876+0000 7f2dfcd44700 1 -- 172.21.15.133:0/3013509907 shutdown_connections 2023-05-08T03:37:28.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:37:28.876+0000 7f2dfcd44700 1 --2- 172.21.15.133:0/3013509907 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f2de00a11d0 0x7f2de00a3680 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:37:28.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:37:28.876+0000 7f2dfcd44700 1 --2- 172.21.15.133:0/3013509907 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2df81023a0 0x7f2df80ffc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:37:28.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:37:28.876+0000 7f2dfcd44700 1 --2- 172.21.15.133:0/3013509907 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2df80feb10 0x7f2df81010c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:37:28.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:37:28.876+0000 7f2dfcd44700 1 --2- 172.21.15.133:0/3013509907 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2df81019c0 0x7f2df80ff710 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:37:28.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:37:28.876+0000 7f2dfcd44700 1 -- 172.21.15.133:0/3013509907 >> 172.21.15.133:0/3013509907 conn(0x7f2df80fa070 msgr2=0x7f2df8104c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:37:28.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:37:28.877+0000 7f2dfcd44700 1 -- 172.21.15.133:0/3013509907 shutdown_connections 2023-05-08T03:37:28.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:37:28.877+0000 7f2dfcd44700 1 -- 172.21.15.133:0/3013509907 wait complete. 2023-05-08T03:37:29.536 DEBUG:teuthology.orchestra.run.smithi133:osd.4> sudo journalctl -f -n 0 -u ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c@osd.4.service 2023-05-08T03:37:29.538 INFO:tasks.cephadm:Deploying osd.5 on smithi186 with /dev/vg_nvme/lv_3... 2023-05-08T03:37:29.539 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-05-08T03:37:29.570 INFO:journalctl@ceph.osd.4.smithi133.stdout:-- Logs begin at Mon 2023-05-08 03:07:41 UTC. -- 2023-05-08T03:37:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:29 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:37:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:29 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T03:37:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:29 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:37:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:29 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:29 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:29 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:37:30.186 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.c/config 2023-05-08T03:37:30.187 INFO:journalctl@ceph.osd.4.smithi133.stdout:May 08 03:37:29 smithi133 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-4[136530]: 2023-05-08T03:37:29.928+0000 7f6acb230640 -1 osd.4 0 log_to_monitors true 2023-05-08T03:37:30.187 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:29 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:37:30.187 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:29 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T03:37:30.187 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:29 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:37:30.187 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:29 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:30.187 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:29 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:30.188 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:29 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:37:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:29 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:37:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:29 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T03:37:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:29 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:37:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:29 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:30.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:29 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:30.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:29 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:37:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:30 smithi133 ceph-mon[125939]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail 2023-05-08T03:37:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:30 smithi133 ceph-mon[125939]: from='osd.4 [v2:172.21.15.133:6808/1237495996,v1:172.21.15.133:6809/1237495996]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-05-08T03:37:30.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:30 smithi133 ceph-mon[125939]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-05-08T03:37:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:30 smithi186 ceph-mon[126480]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail 2023-05-08T03:37:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:30 smithi186 ceph-mon[126480]: from='osd.4 [v2:172.21.15.133:6808/1237495996,v1:172.21.15.133:6809/1237495996]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-05-08T03:37:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:30 smithi186 ceph-mon[126480]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-05-08T03:37:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:30 smithi096 ceph-mon[124666]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail 2023-05-08T03:37:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:30 smithi096 ceph-mon[124666]: from='osd.4 [v2:172.21.15.133:6808/1237495996,v1:172.21.15.133:6809/1237495996]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-05-08T03:37:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:30 smithi096 ceph-mon[124666]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-05-08T03:37:31.775 INFO:teuthology.orchestra.run.smithi186.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-05-08T03:37:31.775 INFO:teuthology.orchestra.run.smithi186.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-05-08T03:37:31.775 INFO:teuthology.orchestra.run.smithi186.stderr: stderr: 10+0 records in 2023-05-08T03:37:31.776 INFO:teuthology.orchestra.run.smithi186.stderr:10+0 records out 2023-05-08T03:37:31.776 INFO:teuthology.orchestra.run.smithi186.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0112344 s, 933 MB/s 2023-05-08T03:37:31.776 INFO:teuthology.orchestra.run.smithi186.stderr:--> Zapping successful for: 2023-05-08T03:37:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:31 smithi186 ceph-mon[126480]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-05-08T03:37:32.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:31 smithi186 ceph-mon[126480]: osdmap e31: 5 total, 4 up, 5 in 2023-05-08T03:37:32.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:31 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-05-08T03:37:32.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:31 smithi186 ceph-mon[126480]: from='osd.4 [v2:172.21.15.133:6808/1237495996,v1:172.21.15.133:6809/1237495996]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2023-05-08T03:37:32.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:31 smithi186 ceph-mon[126480]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2023-05-08T03:37:32.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:31 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:32.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:31 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:32.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:31 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:37:32.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:31 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:37:32.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:31 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:32.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:31 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:37:32.123 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:31 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:37:32.123 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:31 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:32.240 INFO:journalctl@ceph.osd.4.smithi133.stdout:May 08 03:37:31 smithi133 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-4[136530]: 2023-05-08T03:37:31.856+0000 7f6ac00a6700 -1 osd.4 0 waiting for initial osdmap 2023-05-08T03:37:32.240 INFO:journalctl@ceph.osd.4.smithi133.stdout:May 08 03:37:31 smithi133 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-4[136530]: 2023-05-08T03:37:31.863+0000 7f6ab8e95700 -1 osd.4 32 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-08T03:37:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:31 smithi133 ceph-mon[125939]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-05-08T03:37:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:31 smithi133 ceph-mon[125939]: osdmap e31: 5 total, 4 up, 5 in 2023-05-08T03:37:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:31 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-05-08T03:37:32.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:31 smithi133 ceph-mon[125939]: from='osd.4 [v2:172.21.15.133:6808/1237495996,v1:172.21.15.133:6809/1237495996]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2023-05-08T03:37:32.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:31 smithi133 ceph-mon[125939]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2023-05-08T03:37:32.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:31 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:32.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:31 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:32.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:31 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:37:32.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:31 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:37:32.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:31 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:32.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:31 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:37:32.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:31 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:37:32.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:31 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:32.243 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- ceph orch daemon add osd smithi186:vg_nvme/lv_3 2023-05-08T03:37:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:31 smithi096 ceph-mon[124666]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-05-08T03:37:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:31 smithi096 ceph-mon[124666]: osdmap e31: 5 total, 4 up, 5 in 2023-05-08T03:37:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:31 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-05-08T03:37:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:31 smithi096 ceph-mon[124666]: from='osd.4 [v2:172.21.15.133:6808/1237495996,v1:172.21.15.133:6809/1237495996]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2023-05-08T03:37:32.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:31 smithi096 ceph-mon[124666]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2023-05-08T03:37:32.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:31 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:32.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:31 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:32.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:31 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:37:32.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:31 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:37:32.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:31 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:32.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:31 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:37:32.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:31 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:37:32.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:31 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:32.884 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.c/config 2023-05-08T03:37:33.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:32 smithi186 ceph-mon[126480]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail 2023-05-08T03:37:33.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:32 smithi186 ceph-mon[126480]: Detected new or changed devices on smithi133 2023-05-08T03:37:33.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:32 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi133 to 8584M 2023-05-08T03:37:33.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:32 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:37:33.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:32 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T03:37:33.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:32 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:37:33.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:32 smithi186 ceph-mon[126480]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]': finished 2023-05-08T03:37:33.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:32 smithi186 ceph-mon[126480]: osdmap e32: 5 total, 4 up, 5 in 2023-05-08T03:37:33.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:32 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-05-08T03:37:33.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:32 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-05-08T03:37:33.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:32 smithi133 ceph-mon[125939]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail 2023-05-08T03:37:33.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:32 smithi133 ceph-mon[125939]: Detected new or changed devices on smithi133 2023-05-08T03:37:33.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:32 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi133 to 8584M 2023-05-08T03:37:33.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:32 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:37:33.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:32 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T03:37:33.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:32 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:37:33.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:32 smithi133 ceph-mon[125939]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]': finished 2023-05-08T03:37:33.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:32 smithi133 ceph-mon[125939]: osdmap e32: 5 total, 4 up, 5 in 2023-05-08T03:37:33.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:32 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-05-08T03:37:33.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:32 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-05-08T03:37:33.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:32 smithi096 ceph-mon[124666]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail 2023-05-08T03:37:33.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:32 smithi096 ceph-mon[124666]: Detected new or changed devices on smithi133 2023-05-08T03:37:33.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:32 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi133 to 8584M 2023-05-08T03:37:33.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:32 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:37:33.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:32 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T03:37:33.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:32 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:37:33.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:32 smithi096 ceph-mon[124666]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]': finished 2023-05-08T03:37:33.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:32 smithi096 ceph-mon[124666]: osdmap e32: 5 total, 4 up, 5 in 2023-05-08T03:37:33.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:32 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-05-08T03:37:33.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:32 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-05-08T03:37:34.029 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:33 smithi186 ceph-mon[126480]: purged_snaps scrub starts 2023-05-08T03:37:34.029 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:33 smithi186 ceph-mon[126480]: purged_snaps scrub ok 2023-05-08T03:37:34.029 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:33 smithi186 ceph-mon[126480]: osd.4 [v2:172.21.15.133:6808/1237495996,v1:172.21.15.133:6809/1237495996] boot 2023-05-08T03:37:34.029 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:33 smithi186 ceph-mon[126480]: osdmap e33: 5 total, 5 up, 5 in 2023-05-08T03:37:34.029 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:33 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-05-08T03:37:34.171 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:37:34.169+0000 7f54badf7700 1 -- 172.21.15.186:0/494341235 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f54b40fff00 msgr2=0x7f54b41077d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:37:34.172 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:37:34.169+0000 7f54badf7700 1 --2- 172.21.15.186:0/494341235 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f54b40fff00 0x7f54b41077d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f54ac00b0a0 tx=0x7f54ac00b3b0 comp rx=0 tx=0).stop 2023-05-08T03:37:34.172 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:37:34.170+0000 7f54badf7700 1 -- 172.21.15.186:0/494341235 shutdown_connections 2023-05-08T03:37:34.172 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:37:34.170+0000 7f54badf7700 1 --2- 172.21.15.186:0/494341235 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f54b40fff00 0x7f54b41077d0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:37:34.172 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:37:34.170+0000 7f54badf7700 1 --2- 172.21.15.186:0/494341235 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54b41008c0 0x7f54b4100cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:37:34.172 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:37:34.170+0000 7f54badf7700 1 --2- 172.21.15.186:0/494341235 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54b40ff570 0x7f54b40ff9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:37:34.172 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:37:34.170+0000 7f54badf7700 1 -- 172.21.15.186:0/494341235 >> 172.21.15.186:0/494341235 conn(0x7f54b40fa070 msgr2=0x7f54b40fc4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:37:34.173 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:37:34.170+0000 7f54badf7700 1 -- 172.21.15.186:0/494341235 shutdown_connections 2023-05-08T03:37:34.173 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:37:34.170+0000 7f54badf7700 1 -- 172.21.15.186:0/494341235 wait complete. 2023-05-08T03:37:34.174 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:37:34.170+0000 7f54badf7700 1 Processor -- start 2023-05-08T03:37:34.174 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:37:34.170+0000 7f54badf7700 1 -- start start 2023-05-08T03:37:34.175 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:37:34.170+0000 7f54badf7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54b40ff570 0x7f54b4103310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:37:34.175 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:37:34.170+0000 7f54badf7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54b40fff00 0x7f54b4101960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:37:34.175 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:37:34.170+0000 7f54badf7700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f54b41008c0 0x7f54b4101ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:37:34.175 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:37:34.170+0000 7f54badf7700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b4102620 con 0x7f54b40ff570 2023-05-08T03:37:34.175 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:37:34.170+0000 7f54badf7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b4102790 con 0x7f54b40fff00 2023-05-08T03:37:34.176 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:37:34.170+0000 7f54badf7700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b41a0240 con 0x7f54b41008c0 2023-05-08T03:37:34.176 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:37:34.170+0000 7f54b9394700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f54b41008c0 0x7f54b4101ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:37:34.176 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:37:34.170+0000 7f54b9394700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f54b41008c0 0x7f54b4101ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.186:52620/0 (socket says 172.21.15.186:52620) 2023-05-08T03:37:34.176 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:37:34.170+0000 7f54b9394700 1 -- 172.21.15.186:0/3511683370 learned_addr learned my addr 172.21.15.186:0/3511683370 (peer_addr_for_me v2:172.21.15.186:0/0) 2023-05-08T03:37:34.176 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:37:34.171+0000 7f54b8b93700 1 --2- 172.21.15.186:0/3511683370 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54b40ff570 0x7f54b4103310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:37:34.176 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:37:34.171+0000 7f54b3fff700 1 --2- 172.21.15.186:0/3511683370 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54b40fff00 0x7f54b4101960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:37:34.176 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:37:34.171+0000 7f54b9394700 1 -- 172.21.15.186:0/3511683370 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54b40fff00 msgr2=0x7f54b4101960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:37:34.177 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:37:34.171+0000 7f54b9394700 1 --2- 172.21.15.186:0/3511683370 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54b40fff00 0x7f54b4101960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:37:34.177 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:37:34.171+0000 7f54b9394700 1 -- 172.21.15.186:0/3511683370 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54b40ff570 msgr2=0x7f54b4103310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:37:34.178 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:37:34.171+0000 7f54b9394700 1 --2- 172.21.15.186:0/3511683370 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54b40ff570 0x7f54b4103310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:37:34.178 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:37:34.171+0000 7f54b9394700 1 -- 172.21.15.186:0/3511683370 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54ac009d00 con 0x7f54b41008c0 2023-05-08T03:37:34.178 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:37:34.171+0000 7f54b9394700 1 --2- 172.21.15.186:0/3511683370 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f54b41008c0 0x7f54b4101ea0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f54ac0062a0 tx=0x7f54ac004d00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:37:34.178 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:37:34.171+0000 7f54b1ffb700 1 -- 172.21.15.186:0/3511683370 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ac00e040 con 0x7f54b41008c0 2023-05-08T03:37:34.178 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:37:34.171+0000 7f54badf7700 1 -- 172.21.15.186:0/3511683370 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54b410ac60 con 0x7f54b41008c0 2023-05-08T03:37:34.178 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:37:34.171+0000 7f54b1ffb700 1 -- 172.21.15.186:0/3511683370 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f54ac00cec0 con 0x7f54b41008c0 2023-05-08T03:37:34.178 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:37:34.171+0000 7f54b1ffb700 1 -- 172.21.15.186:0/3511683370 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ac01baf0 con 0x7f54b41008c0 2023-05-08T03:37:34.180 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:37:34.171+0000 7f54badf7700 1 -- 172.21.15.186:0/3511683370 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54b410aad0 con 0x7f54b41008c0 2023-05-08T03:37:34.180 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:37:34.172+0000 7f54badf7700 1 -- 172.21.15.186:0/3511683370 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54b410adf0 con 0x7f54b41008c0 2023-05-08T03:37:34.181 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:37:34.173+0000 7f54b1ffb700 1 -- 172.21.15.186:0/3511683370 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f54ac01bc50 con 0x7f54b41008c0 2023-05-08T03:37:34.181 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:37:34.174+0000 7f54b1ffb700 1 --2- 172.21.15.186:0/3511683370 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f54a40a1150 0x7f54a40a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:37:34.181 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:37:34.174+0000 7f54b1ffb700 1 -- 172.21.15.186:0/3511683370 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4101+0+0 (secure 0 0 0) 0x7f54ac0cd880 con 0x7f54b41008c0 2023-05-08T03:37:34.181 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:37:34.174+0000 7f54b8b93700 1 --2- 172.21.15.186:0/3511683370 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f54a40a1150 0x7f54a40a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:37:34.181 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:37:34.174+0000 7f54b8b93700 1 --2- 172.21.15.186:0/3511683370 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f54a40a1150 0x7f54a40a3600 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f54b4068470 tx=0x7f54a800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:37:34.181 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:37:34.178+0000 7f54b1ffb700 1 -- 172.21.15.186:0/3511683370 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f54ac098030 con 0x7f54b41008c0 2023-05-08T03:37:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:33 smithi133 ceph-mon[125939]: purged_snaps scrub starts 2023-05-08T03:37:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:33 smithi133 ceph-mon[125939]: purged_snaps scrub ok 2023-05-08T03:37:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:33 smithi133 ceph-mon[125939]: osd.4 [v2:172.21.15.133:6808/1237495996,v1:172.21.15.133:6809/1237495996] boot 2023-05-08T03:37:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:33 smithi133 ceph-mon[125939]: osdmap e33: 5 total, 5 up, 5 in 2023-05-08T03:37:34.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:33 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-05-08T03:37:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:33 smithi096 ceph-mon[124666]: purged_snaps scrub starts 2023-05-08T03:37:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:33 smithi096 ceph-mon[124666]: purged_snaps scrub ok 2023-05-08T03:37:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:33 smithi096 ceph-mon[124666]: osd.4 [v2:172.21.15.133:6808/1237495996,v1:172.21.15.133:6809/1237495996] boot 2023-05-08T03:37:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:33 smithi096 ceph-mon[124666]: osdmap e33: 5 total, 5 up, 5 in 2023-05-08T03:37:34.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:33 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-05-08T03:37:34.372 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:37:34.370+0000 7f54badf7700 1 -- 172.21.15.186:0/3511683370 --> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f54b40fec30 con 0x7f54a40a1150 2023-05-08T03:37:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:34 smithi186 ceph-mon[126480]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail 2023-05-08T03:37:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:34 smithi186 ceph-mon[126480]: osdmap e34: 5 total, 5 up, 5 in 2023-05-08T03:37:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:34 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-05-08T03:37:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:34 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-05-08T03:37:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:34 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:37:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:34 smithi133 ceph-mon[125939]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail 2023-05-08T03:37:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:34 smithi133 ceph-mon[125939]: osdmap e34: 5 total, 5 up, 5 in 2023-05-08T03:37:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:34 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-05-08T03:37:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:34 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-05-08T03:37:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:34 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:37:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:34 smithi096 ceph-mon[124666]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail 2023-05-08T03:37:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:34 smithi096 ceph-mon[124666]: osdmap e34: 5 total, 5 up, 5 in 2023-05-08T03:37:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:34 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-05-08T03:37:35.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:34 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-05-08T03:37:35.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:34 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:37:36.131 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:35 smithi186 ceph-mon[126480]: from='client.24247 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:37:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:35 smithi133 ceph-mon[125939]: from='client.24247 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:37:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:35 smithi096 ceph-mon[124666]: from='client.24247 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:37:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:36 smithi133 ceph-mon[125939]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2023-05-08T03:37:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:36 smithi133 ceph-mon[125939]: from='client.? 172.21.15.186:0/4163646548' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "00177913-8bd6-4391-83c3-08c2b1b8ef13"}]: dispatch 2023-05-08T03:37:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:36 smithi133 ceph-mon[125939]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "00177913-8bd6-4391-83c3-08c2b1b8ef13"}]: dispatch 2023-05-08T03:37:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:36 smithi133 ceph-mon[125939]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "00177913-8bd6-4391-83c3-08c2b1b8ef13"}]': finished 2023-05-08T03:37:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:36 smithi133 ceph-mon[125939]: osdmap e35: 6 total, 5 up, 6 in 2023-05-08T03:37:37.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:36 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-05-08T03:37:37.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:36 smithi096 ceph-mon[124666]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2023-05-08T03:37:37.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:36 smithi096 ceph-mon[124666]: from='client.? 172.21.15.186:0/4163646548' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "00177913-8bd6-4391-83c3-08c2b1b8ef13"}]: dispatch 2023-05-08T03:37:37.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:36 smithi096 ceph-mon[124666]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "00177913-8bd6-4391-83c3-08c2b1b8ef13"}]: dispatch 2023-05-08T03:37:37.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:36 smithi096 ceph-mon[124666]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "00177913-8bd6-4391-83c3-08c2b1b8ef13"}]': finished 2023-05-08T03:37:37.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:36 smithi096 ceph-mon[124666]: osdmap e35: 6 total, 5 up, 6 in 2023-05-08T03:37:37.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:36 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-05-08T03:37:37.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:36 smithi186 ceph-mon[126480]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2023-05-08T03:37:37.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:36 smithi186 ceph-mon[126480]: from='client.? 172.21.15.186:0/4163646548' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "00177913-8bd6-4391-83c3-08c2b1b8ef13"}]: dispatch 2023-05-08T03:37:37.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:36 smithi186 ceph-mon[126480]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "00177913-8bd6-4391-83c3-08c2b1b8ef13"}]: dispatch 2023-05-08T03:37:37.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:36 smithi186 ceph-mon[126480]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "00177913-8bd6-4391-83c3-08c2b1b8ef13"}]': finished 2023-05-08T03:37:37.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:36 smithi186 ceph-mon[126480]: osdmap e35: 6 total, 5 up, 6 in 2023-05-08T03:37:37.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:36 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-05-08T03:37:38.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:38 smithi186 ceph-mon[126480]: from='client.? 172.21.15.186:0/1815732136' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-05-08T03:37:38.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:38 smithi186 ceph-mon[126480]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2023-05-08T03:37:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:38 smithi133 ceph-mon[125939]: from='client.? 172.21.15.186:0/1815732136' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-05-08T03:37:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:38 smithi133 ceph-mon[125939]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2023-05-08T03:37:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:38 smithi096 ceph-mon[124666]: from='client.? 172.21.15.186:0/1815732136' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-05-08T03:37:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:38 smithi096 ceph-mon[124666]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2023-05-08T03:37:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:40 smithi186 ceph-mon[126480]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-05-08T03:37:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:40 smithi133 ceph-mon[125939]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-05-08T03:37:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:40 smithi096 ceph-mon[124666]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-05-08T03:37:42.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:42 smithi186 ceph-mon[126480]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-05-08T03:37:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:42 smithi133 ceph-mon[125939]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-05-08T03:37:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:42 smithi096 ceph-mon[124666]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-05-08T03:37:43.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:43 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-05-08T03:37:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:43 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:37:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:43 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-05-08T03:37:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:43 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:37:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:43 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-05-08T03:37:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:43 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:37:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:44 smithi186 ceph-mon[126480]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-05-08T03:37:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:44 smithi186 ceph-mon[126480]: Deploying daemon osd.5 on smithi186 2023-05-08T03:37:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:44 smithi133 ceph-mon[125939]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-05-08T03:37:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:44 smithi133 ceph-mon[125939]: Deploying daemon osd.5 on smithi186 2023-05-08T03:37:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:44 smithi096 ceph-mon[124666]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-05-08T03:37:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:44 smithi096 ceph-mon[124666]: Deploying daemon osd.5 on smithi186 2023-05-08T03:37:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:46 smithi186 ceph-mon[126480]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-05-08T03:37:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:46 smithi133 ceph-mon[125939]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-05-08T03:37:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:46 smithi096 ceph-mon[124666]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-05-08T03:37:48.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:48 smithi186 ceph-mon[126480]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-05-08T03:37:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:48 smithi133 ceph-mon[125939]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-05-08T03:37:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:48 smithi096 ceph-mon[124666]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-05-08T03:37:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:49 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:49 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:49 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:37:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:49 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:49 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:49 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:37:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:49 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:49 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:49 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:37:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:50 smithi186 ceph-mon[126480]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-05-08T03:37:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:50 smithi133 ceph-mon[125939]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-05-08T03:37:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:50 smithi096 ceph-mon[124666]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-05-08T03:37:51.231 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:37:51.228+0000 7f54b1ffb700 1 -- 172.21.15.186:0/3511683370 <== mgr.14152 v2:172.21.15.96:6800/2748629182 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f54b40fec30 con 0x7f54a40a1150 2023-05-08T03:37:51.232 INFO:teuthology.orchestra.run.smithi186.stdout:Created osd(s) 5 on host 'smithi186' 2023-05-08T03:37:51.233 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:37:51.230+0000 7f54badf7700 1 -- 172.21.15.186:0/3511683370 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f54a40a1150 msgr2=0x7f54a40a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:37:51.234 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:37:51.230+0000 7f54badf7700 1 --2- 172.21.15.186:0/3511683370 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f54a40a1150 0x7f54a40a3600 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f54b4068470 tx=0x7f54a800b410 comp rx=0 tx=0).stop 2023-05-08T03:37:51.234 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:37:51.231+0000 7f54badf7700 1 -- 172.21.15.186:0/3511683370 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f54b41008c0 msgr2=0x7f54b4101ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:37:51.234 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:37:51.231+0000 7f54badf7700 1 --2- 172.21.15.186:0/3511683370 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f54b41008c0 0x7f54b4101ea0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f54ac0062a0 tx=0x7f54ac004d00 comp rx=0 tx=0).stop 2023-05-08T03:37:51.234 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:37:51.231+0000 7f54badf7700 1 -- 172.21.15.186:0/3511683370 shutdown_connections 2023-05-08T03:37:51.234 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:37:51.231+0000 7f54badf7700 1 --2- 172.21.15.186:0/3511683370 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f54a40a1150 0x7f54a40a3600 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:37:51.234 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:37:51.231+0000 7f54badf7700 1 --2- 172.21.15.186:0/3511683370 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f54b41008c0 0x7f54b4101ea0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:37:51.234 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:37:51.231+0000 7f54badf7700 1 --2- 172.21.15.186:0/3511683370 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54b40ff570 0x7f54b4103310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:37:51.235 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:37:51.231+0000 7f54badf7700 1 --2- 172.21.15.186:0/3511683370 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54b40fff00 0x7f54b4101960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:37:51.235 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:37:51.231+0000 7f54badf7700 1 -- 172.21.15.186:0/3511683370 >> 172.21.15.186:0/3511683370 conn(0x7f54b40fa070 msgr2=0x7f54b40fe520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:37:51.235 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:37:51.231+0000 7f54badf7700 1 -- 172.21.15.186:0/3511683370 shutdown_connections 2023-05-08T03:37:51.235 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:37:51.231+0000 7f54badf7700 1 -- 172.21.15.186:0/3511683370 wait complete. 2023-05-08T03:37:51.673 DEBUG:teuthology.orchestra.run.smithi186:osd.5> sudo journalctl -f -n 0 -u ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c@osd.5.service 2023-05-08T03:37:51.676 INFO:tasks.cephadm:Deploying osd.6 on smithi096 with /dev/vg_nvme/lv_2... 2023-05-08T03:37:51.676 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-05-08T03:37:51.718 INFO:journalctl@ceph.osd.5.smithi186.stdout:-- Logs begin at Mon 2023-05-08 03:08:31 UTC. -- 2023-05-08T03:37:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:51 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:51 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:52.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:51 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:37:52.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:51 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:37:52.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:51 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:37:52.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:51 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:52.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:51 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T03:37:52.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:51 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:37:52.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:51 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:52.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:51 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:52.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:51 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:37:52.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:51 smithi096 ceph-mon[124666]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-05-08T03:37:52.164 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:51 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:52.164 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:51 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:52.164 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:51 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:37:52.164 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:51 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:37:52.164 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:51 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:37:52.165 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:51 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:52.165 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:51 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T03:37:52.165 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:51 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:37:52.165 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:51 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:52.165 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:51 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:52.165 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:51 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:37:52.165 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:51 smithi186 ceph-mon[126480]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-05-08T03:37:52.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:51 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:52.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:51 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:52.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:51 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:37:52.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:51 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:37:52.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:51 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:37:52.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:51 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:52.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:51 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T03:37:52.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:51 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:37:52.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:51 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:52.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:51 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:52.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:51 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:37:52.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:51 smithi133 ceph-mon[125939]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-05-08T03:37:52.336 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.a/config 2023-05-08T03:37:52.618 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 08 03:37:52 smithi186 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-5[137860]: 2023-05-08T03:37:52.337+0000 7f91c54a0640 -1 osd.5 0 log_to_monitors true 2023-05-08T03:37:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:53 smithi186 ceph-mon[126480]: from='osd.5 [v2:172.21.15.186:6808/541111862,v1:172.21.15.186:6809/541111862]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-05-08T03:37:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:53 smithi186 ceph-mon[126480]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-05-08T03:37:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:53 smithi133 ceph-mon[125939]: from='osd.5 [v2:172.21.15.186:6808/541111862,v1:172.21.15.186:6809/541111862]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-05-08T03:37:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:53 smithi133 ceph-mon[125939]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-05-08T03:37:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:53 smithi096 ceph-mon[124666]: from='osd.5 [v2:172.21.15.186:6808/541111862,v1:172.21.15.186:6809/541111862]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-05-08T03:37:53.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:53 smithi096 ceph-mon[124666]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-05-08T03:37:53.942 INFO:teuthology.orchestra.run.smithi096.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-05-08T03:37:53.942 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-05-08T03:37:53.943 INFO:teuthology.orchestra.run.smithi096.stderr: stderr: 10+0 records in 2023-05-08T03:37:53.943 INFO:teuthology.orchestra.run.smithi096.stderr:10+0 records out 2023-05-08T03:37:53.943 INFO:teuthology.orchestra.run.smithi096.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0110846 s, 946 MB/s 2023-05-08T03:37:53.943 INFO:teuthology.orchestra.run.smithi096.stderr:--> Zapping successful for: 2023-05-08T03:37:54.389 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- ceph orch daemon add osd smithi096:vg_nvme/lv_2 2023-05-08T03:37:54.619 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 08 03:37:54 smithi186 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-5[137860]: 2023-05-08T03:37:54.309+0000 7f91ba316700 -1 osd.5 0 waiting for initial osdmap 2023-05-08T03:37:54.619 INFO:journalctl@ceph.osd.5.smithi186.stdout:May 08 03:37:54 smithi186 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-5[137860]: 2023-05-08T03:37:54.320+0000 7f91b4107700 -1 osd.5 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-08T03:37:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:54 smithi186 ceph-mon[126480]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-05-08T03:37:54.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:54 smithi186 ceph-mon[126480]: osdmap e36: 6 total, 5 up, 6 in 2023-05-08T03:37:54.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:54 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-05-08T03:37:54.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:54 smithi186 ceph-mon[126480]: from='osd.5 [v2:172.21.15.186:6808/541111862,v1:172.21.15.186:6809/541111862]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2023-05-08T03:37:54.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:54 smithi186 ceph-mon[126480]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2023-05-08T03:37:54.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:54 smithi186 ceph-mon[126480]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-05-08T03:37:54.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:54 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:54.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:54 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:54.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:54 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:37:54.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:54 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:37:54.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:54 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:54.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:54 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:37:54.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:54 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:37:54.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:54 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:54 smithi133 ceph-mon[125939]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-05-08T03:37:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:54 smithi133 ceph-mon[125939]: osdmap e36: 6 total, 5 up, 6 in 2023-05-08T03:37:54.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:54 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-05-08T03:37:54.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:54 smithi133 ceph-mon[125939]: from='osd.5 [v2:172.21.15.186:6808/541111862,v1:172.21.15.186:6809/541111862]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2023-05-08T03:37:54.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:54 smithi133 ceph-mon[125939]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2023-05-08T03:37:54.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:54 smithi133 ceph-mon[125939]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-05-08T03:37:54.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:54 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:54.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:54 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:54.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:54 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:37:54.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:54 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:37:54.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:54 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:54.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:54 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:37:54.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:54 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:37:54.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:54 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:54.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:54 smithi096 ceph-mon[124666]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-05-08T03:37:54.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:54 smithi096 ceph-mon[124666]: osdmap e36: 6 total, 5 up, 6 in 2023-05-08T03:37:54.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:54 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-05-08T03:37:54.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:54 smithi096 ceph-mon[124666]: from='osd.5 [v2:172.21.15.186:6808/541111862,v1:172.21.15.186:6809/541111862]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2023-05-08T03:37:54.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:54 smithi096 ceph-mon[124666]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2023-05-08T03:37:54.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:54 smithi096 ceph-mon[124666]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-05-08T03:37:54.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:54 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:54.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:54 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:54.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:54 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:37:54.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:54 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:37:54.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:54 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:54.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:54 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:37:54.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:54 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:37:54.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:54 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:37:55.032 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.a/config 2023-05-08T03:37:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:55 smithi096 ceph-mon[124666]: Detected new or changed devices on smithi186 2023-05-08T03:37:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:55 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi186 to 8584M 2023-05-08T03:37:55.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:55 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:37:55.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:55 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T03:37:55.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:55 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:37:55.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:55 smithi096 ceph-mon[124666]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]': finished 2023-05-08T03:37:55.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:55 smithi096 ceph-mon[124666]: osdmap e37: 6 total, 5 up, 6 in 2023-05-08T03:37:55.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:55 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-05-08T03:37:55.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:55 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-05-08T03:37:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:55 smithi186 ceph-mon[126480]: Detected new or changed devices on smithi186 2023-05-08T03:37:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:55 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi186 to 8584M 2023-05-08T03:37:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:55 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:37:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:55 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T03:37:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:55 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:37:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:55 smithi186 ceph-mon[126480]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]': finished 2023-05-08T03:37:55.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:55 smithi186 ceph-mon[126480]: osdmap e37: 6 total, 5 up, 6 in 2023-05-08T03:37:55.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:55 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-05-08T03:37:55.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:55 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-05-08T03:37:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:55 smithi133 ceph-mon[125939]: Detected new or changed devices on smithi186 2023-05-08T03:37:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:55 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi186 to 8584M 2023-05-08T03:37:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:55 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:37:55.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:55 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T03:37:55.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:55 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:37:55.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:55 smithi133 ceph-mon[125939]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]': finished 2023-05-08T03:37:55.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:55 smithi133 ceph-mon[125939]: osdmap e37: 6 total, 5 up, 6 in 2023-05-08T03:37:55.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:55 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-05-08T03:37:55.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:55 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-05-08T03:37:56.236 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:37:56.232+0000 7f0bc532c700 1 -- 172.21.15.96:0/2918674723 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0bc00fff90 msgr2=0x7f0bc0107860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:37:56.237 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:37:56.232+0000 7f0bc532c700 1 --2- 172.21.15.96:0/2918674723 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0bc00fff90 0x7f0bc0107860 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0bb800b0d0 tx=0x7f0bb800b3e0 comp rx=0 tx=0).stop 2023-05-08T03:37:56.237 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:37:56.232+0000 7f0bc532c700 1 -- 172.21.15.96:0/2918674723 shutdown_connections 2023-05-08T03:37:56.237 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:37:56.232+0000 7f0bc532c700 1 --2- 172.21.15.96:0/2918674723 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0bc00fff90 0x7f0bc0107860 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:37:56.237 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:37:56.232+0000 7f0bc532c700 1 --2- 172.21.15.96:0/2918674723 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0bc01008c0 0x7f0bc0100cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:37:56.237 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:37:56.232+0000 7f0bc532c700 1 --2- 172.21.15.96:0/2918674723 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0bc00ff600 0x7f0bc00ffa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:37:56.238 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:37:56.232+0000 7f0bc532c700 1 -- 172.21.15.96:0/2918674723 >> 172.21.15.96:0/2918674723 conn(0x7f0bc00fa100 msgr2=0x7f0bc00fc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:37:56.238 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:37:56.232+0000 7f0bc532c700 1 -- 172.21.15.96:0/2918674723 shutdown_connections 2023-05-08T03:37:56.238 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:37:56.232+0000 7f0bc532c700 1 -- 172.21.15.96:0/2918674723 wait complete. 2023-05-08T03:37:56.238 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:37:56.233+0000 7f0bc532c700 1 Processor -- start 2023-05-08T03:37:56.238 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:37:56.233+0000 7f0bc532c700 1 -- start start 2023-05-08T03:37:56.239 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:37:56.233+0000 7f0bc532c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0bc00ff600 0x7f0bc00ff070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:37:56.239 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:37:56.233+0000 7f0bc532c700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0bc00fff90 0x7f0bc019afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:37:56.239 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:37:56.233+0000 7f0bc532c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0bc01008c0 0x7f0bc019d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:37:56.239 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:37:56.233+0000 7f0bc532c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc019ddb0 con 0x7f0bc01008c0 2023-05-08T03:37:56.239 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:37:56.233+0000 7f0bc532c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc019df20 con 0x7f0bc00ff600 2023-05-08T03:37:56.239 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:37:56.233+0000 7f0bc532c700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc019e0e0 con 0x7f0bc00fff90 2023-05-08T03:37:56.239 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:37:56.233+0000 7f0bbf7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0bc01008c0 0x7f0bc019d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:37:56.239 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:37:56.233+0000 7f0bbf7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0bc01008c0 0x7f0bc019d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39756/0 (socket says 172.21.15.96:39756) 2023-05-08T03:37:56.240 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:37:56.233+0000 7f0bbf7fe700 1 -- 172.21.15.96:0/3335390940 learned_addr learned my addr 172.21.15.96:0/3335390940 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:37:56.240 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:37:56.234+0000 7f0bbeffd700 1 --2- 172.21.15.96:0/3335390940 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0bc00ff600 0x7f0bc00ff070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:37:56.240 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:37:56.234+0000 7f0bbe7fc700 1 --2- 172.21.15.96:0/3335390940 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0bc00fff90 0x7f0bc019afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:37:56.240 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:37:56.234+0000 7f0bbf7fe700 1 -- 172.21.15.96:0/3335390940 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0bc00fff90 msgr2=0x7f0bc019afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:37:56.240 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:37:56.234+0000 7f0bbf7fe700 1 --2- 172.21.15.96:0/3335390940 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0bc00fff90 0x7f0bc019afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:37:56.240 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:37:56.234+0000 7f0bbf7fe700 1 -- 172.21.15.96:0/3335390940 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0bc00ff600 msgr2=0x7f0bc00ff070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:37:56.240 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:37:56.234+0000 7f0bbf7fe700 1 --2- 172.21.15.96:0/3335390940 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0bc00ff600 0x7f0bc00ff070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:37:56.241 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:37:56.234+0000 7f0bbf7fe700 1 -- 172.21.15.96:0/3335390940 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bb8009d00 con 0x7f0bc01008c0 2023-05-08T03:37:56.241 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:37:56.234+0000 7f0bbe7fc700 1 --2- 172.21.15.96:0/3335390940 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0bc00fff90 0x7f0bc019afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-08T03:37:56.241 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:37:56.234+0000 7f0bbf7fe700 1 --2- 172.21.15.96:0/3335390940 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0bc01008c0 0x7f0bc019d610 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0bb8007a00 tx=0x7f0bb80094c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:37:56.241 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:37:56.234+0000 7f0bb7fff700 1 -- 172.21.15.96:0/3335390940 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb800e040 con 0x7f0bc01008c0 2023-05-08T03:37:56.241 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:37:56.234+0000 7f0bc532c700 1 -- 172.21.15.96:0/3335390940 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bc010ad20 con 0x7f0bc01008c0 2023-05-08T03:37:56.241 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:37:56.234+0000 7f0bb7fff700 1 -- 172.21.15.96:0/3335390940 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0bb8003e10 con 0x7f0bc01008c0 2023-05-08T03:37:56.241 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:37:56.234+0000 7f0bc532c700 1 -- 172.21.15.96:0/3335390940 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bc010ab90 con 0x7f0bc01008c0 2023-05-08T03:37:56.241 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:37:56.234+0000 7f0bb7fff700 1 -- 172.21.15.96:0/3335390940 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb8012b10 con 0x7f0bc01008c0 2023-05-08T03:37:56.242 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:37:56.235+0000 7f0bc532c700 1 -- 172.21.15.96:0/3335390940 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bc0106910 con 0x7f0bc01008c0 2023-05-08T03:37:56.242 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:37:56.236+0000 7f0bb7fff700 1 -- 172.21.15.96:0/3335390940 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f0bb8012d50 con 0x7f0bc01008c0 2023-05-08T03:37:56.243 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:37:56.237+0000 7f0bb7fff700 1 --2- 172.21.15.96:0/3335390940 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f0bac0a1150 0x7f0bac0a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:37:56.243 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:37:56.237+0000 7f0bbeffd700 1 --2- 172.21.15.96:0/3335390940 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f0bac0a1150 0x7f0bac0a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:37:56.243 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:37:56.237+0000 7f0bb7fff700 1 -- 172.21.15.96:0/3335390940 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4566+0+0 (secure 0 0 0) 0x7f0bb80cd9f0 con 0x7f0bc01008c0 2023-05-08T03:37:56.243 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:37:56.237+0000 7f0bbeffd700 1 --2- 172.21.15.96:0/3335390940 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f0bac0a1150 0x7f0bac0a3600 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0bc0068f40 tx=0x7f0ba800a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:37:56.243 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:37:56.241+0000 7f0bb7fff700 1 -- 172.21.15.96:0/3335390940 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f0bb8098070 con 0x7f0bc01008c0 2023-05-08T03:37:56.442 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:37:56.439+0000 7f0bc532c700 1 -- 172.21.15.96:0/3335390940 --> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi096:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f0bc0061ac0 con 0x7f0bac0a1150 2023-05-08T03:37:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:56 smithi186 ceph-mon[126480]: purged_snaps scrub starts 2023-05-08T03:37:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:56 smithi186 ceph-mon[126480]: purged_snaps scrub ok 2023-05-08T03:37:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:56 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-05-08T03:37:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:56 smithi186 ceph-mon[126480]: osd.5 [v2:172.21.15.186:6808/541111862,v1:172.21.15.186:6809/541111862] boot 2023-05-08T03:37:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:56 smithi186 ceph-mon[126480]: osdmap e38: 6 total, 6 up, 6 in 2023-05-08T03:37:56.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:56 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-05-08T03:37:56.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:56 smithi186 ceph-mon[126480]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-05-08T03:37:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:56 smithi133 ceph-mon[125939]: purged_snaps scrub starts 2023-05-08T03:37:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:56 smithi133 ceph-mon[125939]: purged_snaps scrub ok 2023-05-08T03:37:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:56 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-05-08T03:37:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:56 smithi133 ceph-mon[125939]: osd.5 [v2:172.21.15.186:6808/541111862,v1:172.21.15.186:6809/541111862] boot 2023-05-08T03:37:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:56 smithi133 ceph-mon[125939]: osdmap e38: 6 total, 6 up, 6 in 2023-05-08T03:37:56.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:56 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-05-08T03:37:56.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:56 smithi133 ceph-mon[125939]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-05-08T03:37:56.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:56 smithi096 ceph-mon[124666]: purged_snaps scrub starts 2023-05-08T03:37:56.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:56 smithi096 ceph-mon[124666]: purged_snaps scrub ok 2023-05-08T03:37:56.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:56 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-05-08T03:37:56.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:56 smithi096 ceph-mon[124666]: osd.5 [v2:172.21.15.186:6808/541111862,v1:172.21.15.186:6809/541111862] boot 2023-05-08T03:37:56.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:56 smithi096 ceph-mon[124666]: osdmap e38: 6 total, 6 up, 6 in 2023-05-08T03:37:56.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:56 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-05-08T03:37:56.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:56 smithi096 ceph-mon[124666]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-05-08T03:37:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:57 smithi186 ceph-mon[126480]: osdmap e39: 6 total, 6 up, 6 in 2023-05-08T03:37:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:57 smithi186 ceph-mon[126480]: from='client.14355 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi096:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:37:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:57 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-05-08T03:37:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:57 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-05-08T03:37:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:57 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:37:57.721 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:57 smithi096 ceph-mon[124666]: osdmap e39: 6 total, 6 up, 6 in 2023-05-08T03:37:57.722 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:57 smithi096 ceph-mon[124666]: from='client.14355 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi096:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:37:57.722 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:57 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-05-08T03:37:57.722 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:57 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-05-08T03:37:57.722 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:57 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:37:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:57 smithi133 ceph-mon[125939]: osdmap e39: 6 total, 6 up, 6 in 2023-05-08T03:37:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:57 smithi133 ceph-mon[125939]: from='client.14355 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi096:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:37:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:57 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-05-08T03:37:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:57 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-05-08T03:37:57.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:57 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:37:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:58 smithi096 ceph-mon[124666]: osdmap e40: 6 total, 6 up, 6 in 2023-05-08T03:37:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:58 smithi096 ceph-mon[124666]: pgmap v130: 1 pgs: 1 remapped+peering; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2023-05-08T03:37:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:58 smithi186 ceph-mon[126480]: osdmap e40: 6 total, 6 up, 6 in 2023-05-08T03:37:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:58 smithi186 ceph-mon[126480]: pgmap v130: 1 pgs: 1 remapped+peering; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2023-05-08T03:37:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:58 smithi133 ceph-mon[125939]: osdmap e40: 6 total, 6 up, 6 in 2023-05-08T03:37:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:58 smithi133 ceph-mon[125939]: pgmap v130: 1 pgs: 1 remapped+peering; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2023-05-08T03:37:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:59 smithi186 ceph-mon[126480]: osdmap e41: 6 total, 6 up, 6 in 2023-05-08T03:37:59.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:59 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/256331961' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "204baab6-ca6f-4eef-8b9c-91efc04cc30c"}]: dispatch 2023-05-08T03:37:59.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:59 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/256331961' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "204baab6-ca6f-4eef-8b9c-91efc04cc30c"}]': finished 2023-05-08T03:37:59.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:59 smithi186 ceph-mon[126480]: osdmap e42: 7 total, 6 up, 7 in 2023-05-08T03:37:59.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:37:59 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-05-08T03:37:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:59 smithi133 ceph-mon[125939]: osdmap e41: 6 total, 6 up, 6 in 2023-05-08T03:37:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:59 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/256331961' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "204baab6-ca6f-4eef-8b9c-91efc04cc30c"}]: dispatch 2023-05-08T03:37:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:59 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/256331961' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "204baab6-ca6f-4eef-8b9c-91efc04cc30c"}]': finished 2023-05-08T03:37:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:59 smithi133 ceph-mon[125939]: osdmap e42: 7 total, 6 up, 7 in 2023-05-08T03:37:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:37:59 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-05-08T03:37:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:59 smithi096 ceph-mon[124666]: osdmap e41: 6 total, 6 up, 6 in 2023-05-08T03:37:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:59 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/256331961' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "204baab6-ca6f-4eef-8b9c-91efc04cc30c"}]: dispatch 2023-05-08T03:37:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:59 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/256331961' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "204baab6-ca6f-4eef-8b9c-91efc04cc30c"}]': finished 2023-05-08T03:37:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:59 smithi096 ceph-mon[124666]: osdmap e42: 7 total, 6 up, 7 in 2023-05-08T03:37:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:37:59 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-05-08T03:38:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:00 smithi186 ceph-mon[126480]: pgmap v133: 1 pgs: 1 remapped+peering; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2023-05-08T03:38:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:00 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/2359979949' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-05-08T03:38:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:00 smithi133 ceph-mon[125939]: pgmap v133: 1 pgs: 1 remapped+peering; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2023-05-08T03:38:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:00 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/2359979949' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-05-08T03:38:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:00 smithi096 ceph-mon[124666]: pgmap v133: 1 pgs: 1 remapped+peering; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2023-05-08T03:38:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:00 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/2359979949' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-05-08T03:38:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:02 smithi186 ceph-mon[126480]: pgmap v134: 1 pgs: 1 remapped+peering; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2023-05-08T03:38:02.976 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:02 smithi096 ceph-mon[124666]: pgmap v134: 1 pgs: 1 remapped+peering; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2023-05-08T03:38:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:02 smithi133 ceph-mon[125939]: pgmap v134: 1 pgs: 1 remapped+peering; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2023-05-08T03:38:04.820 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:04 smithi096 ceph-mon[124666]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 93 KiB/s, 0 objects/s recovering 2023-05-08T03:38:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:04 smithi186 ceph-mon[126480]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 93 KiB/s, 0 objects/s recovering 2023-05-08T03:38:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:04 smithi133 ceph-mon[125939]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 93 KiB/s, 0 objects/s recovering 2023-05-08T03:38:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:06 smithi186 ceph-mon[126480]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-05-08T03:38:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:06 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-05-08T03:38:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:06 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:38:06.870 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:06 smithi096 ceph-mon[124666]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-05-08T03:38:06.871 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:06 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-05-08T03:38:06.871 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:06 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:38:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:06 smithi133 ceph-mon[125939]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-05-08T03:38:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:06 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-05-08T03:38:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:06 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:38:07.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:07 smithi186 ceph-mon[126480]: Deploying daemon osd.6 on smithi096 2023-05-08T03:38:07.910 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:07 smithi096 ceph-mon[124666]: Deploying daemon osd.6 on smithi096 2023-05-08T03:38:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:07 smithi133 ceph-mon[125939]: Deploying daemon osd.6 on smithi096 2023-05-08T03:38:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:08 smithi096 ceph-mon[124666]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail; 63 KiB/s, 0 objects/s recovering 2023-05-08T03:38:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:08 smithi186 ceph-mon[126480]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail; 63 KiB/s, 0 objects/s recovering 2023-05-08T03:38:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:08 smithi133 ceph-mon[125939]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail; 63 KiB/s, 0 objects/s recovering 2023-05-08T03:38:10.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:10 smithi186 ceph-mon[126480]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail; 55 KiB/s, 0 objects/s recovering 2023-05-08T03:38:10.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:10 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:10.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:10 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:10.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:10 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:38:10.940 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:10 smithi096 ceph-mon[124666]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail; 55 KiB/s, 0 objects/s recovering 2023-05-08T03:38:10.940 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:10 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:10.940 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:10 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:10.941 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:10 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:38:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:10 smithi133 ceph-mon[125939]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail; 55 KiB/s, 0 objects/s recovering 2023-05-08T03:38:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:10 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:10 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:10 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:38:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:12 smithi096 ceph-mon[124666]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-05-08T03:38:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:12 smithi186 ceph-mon[126480]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-05-08T03:38:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:12 smithi133 ceph-mon[125939]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-05-08T03:38:13.298 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:38:13.296+0000 7f0bb7fff700 1 -- 172.21.15.96:0/3335390940 <== mgr.14152 v2:172.21.15.96:6800/2748629182 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f0bc0061ac0 con 0x7f0bac0a1150 2023-05-08T03:38:13.299 INFO:teuthology.orchestra.run.smithi096.stdout:Created osd(s) 6 on host 'smithi096' 2023-05-08T03:38:13.300 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:38:13.298+0000 7f0bc532c700 1 -- 172.21.15.96:0/3335390940 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f0bac0a1150 msgr2=0x7f0bac0a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:38:13.300 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:38:13.298+0000 7f0bc532c700 1 --2- 172.21.15.96:0/3335390940 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f0bac0a1150 0x7f0bac0a3600 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0bc0068f40 tx=0x7f0ba800a380 comp rx=0 tx=0).stop 2023-05-08T03:38:13.301 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:38:13.298+0000 7f0bc532c700 1 -- 172.21.15.96:0/3335390940 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0bc01008c0 msgr2=0x7f0bc019d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:38:13.301 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:38:13.298+0000 7f0bc532c700 1 --2- 172.21.15.96:0/3335390940 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0bc01008c0 0x7f0bc019d610 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0bb8007a00 tx=0x7f0bb80094c0 comp rx=0 tx=0).stop 2023-05-08T03:38:13.301 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:38:13.298+0000 7f0bc532c700 1 -- 172.21.15.96:0/3335390940 shutdown_connections 2023-05-08T03:38:13.301 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:38:13.298+0000 7f0bc532c700 1 --2- 172.21.15.96:0/3335390940 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f0bac0a1150 0x7f0bac0a3600 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:38:13.301 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:38:13.298+0000 7f0bc532c700 1 --2- 172.21.15.96:0/3335390940 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0bc01008c0 0x7f0bc019d610 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:38:13.301 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:38:13.298+0000 7f0bc532c700 1 --2- 172.21.15.96:0/3335390940 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0bc00ff600 0x7f0bc00ff070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:38:13.301 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:38:13.298+0000 7f0bc532c700 1 --2- 172.21.15.96:0/3335390940 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0bc00fff90 0x7f0bc019afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:38:13.302 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:38:13.298+0000 7f0bc532c700 1 -- 172.21.15.96:0/3335390940 >> 172.21.15.96:0/3335390940 conn(0x7f0bc00fa100 msgr2=0x7f0bc0103a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:38:13.302 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:38:13.298+0000 7f0bc532c700 1 -- 172.21.15.96:0/3335390940 shutdown_connections 2023-05-08T03:38:13.302 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:38:13.298+0000 7f0bc532c700 1 -- 172.21.15.96:0/3335390940 wait complete. 2023-05-08T03:38:13.734 DEBUG:teuthology.orchestra.run.smithi096:osd.6> sudo journalctl -f -n 0 -u ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c@osd.6.service 2023-05-08T03:38:13.736 INFO:tasks.cephadm:Deploying osd.7 on smithi133 with /dev/vg_nvme/lv_2... 2023-05-08T03:38:13.736 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-05-08T03:38:13.771 INFO:journalctl@ceph.osd.6.smithi096.stdout:-- Logs begin at Mon 2023-05-08 03:07:36 UTC. -- 2023-05-08T03:38:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:14 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:14 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:14 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:38:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:14 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:38:14.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:14 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:38:14.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:14 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:14.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:14 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T03:38:14.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:14 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:38:14.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:14 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:14.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:14 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:14.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:14 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:38:14.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:14 smithi133 ceph-mon[125939]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-05-08T03:38:14.292 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:14 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:14.292 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:14 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:14.293 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:14 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:38:14.293 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:14 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:38:14.293 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:14 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:38:14.293 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:14 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:14.293 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:14 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T03:38:14.293 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:14 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:38:14.294 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:14 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:14.294 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:14 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:14.294 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:14 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:38:14.294 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:14 smithi096 ceph-mon[124666]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-05-08T03:38:14.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:14 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:14.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:14 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:14.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:14 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:38:14.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:14 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:38:14.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:14 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:38:14.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:14 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:14.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:14 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T03:38:14.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:14 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:38:14.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:14 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:14.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:14 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:14.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:14 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:38:14.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:14 smithi186 ceph-mon[126480]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-05-08T03:38:14.396 INFO:teuthology.orchestra.run.smithi133.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.b/config 2023-05-08T03:38:14.567 INFO:journalctl@ceph.osd.6.smithi096.stdout:May 08 03:38:14 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-6[148676]: 2023-05-08T03:38:14.461+0000 7efdba2fb640 -1 osd.6 0 log_to_monitors true 2023-05-08T03:38:15.419 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:15 smithi133 ceph-mon[125939]: from='osd.6 [v2:172.21.15.96:6818/386227948,v1:172.21.15.96:6819/386227948]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-05-08T03:38:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:15 smithi096 ceph-mon[124666]: from='osd.6 [v2:172.21.15.96:6818/386227948,v1:172.21.15.96:6819/386227948]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-05-08T03:38:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:15 smithi186 ceph-mon[126480]: from='osd.6 [v2:172.21.15.96:6818/386227948,v1:172.21.15.96:6819/386227948]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-05-08T03:38:15.873 INFO:teuthology.orchestra.run.smithi133.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-05-08T03:38:15.874 INFO:teuthology.orchestra.run.smithi133.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-05-08T03:38:15.874 INFO:teuthology.orchestra.run.smithi133.stderr: stderr: 10+0 records in 2023-05-08T03:38:15.874 INFO:teuthology.orchestra.run.smithi133.stderr:10+0 records out 2023-05-08T03:38:15.874 INFO:teuthology.orchestra.run.smithi133.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0113602 s, 923 MB/s 2023-05-08T03:38:15.874 INFO:teuthology.orchestra.run.smithi133.stderr:--> Zapping successful for: 2023-05-08T03:38:16.255 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- ceph orch daemon add osd smithi133:vg_nvme/lv_2 2023-05-08T03:38:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:16 smithi133 ceph-mon[125939]: from='osd.6 [v2:172.21.15.96:6818/386227948,v1:172.21.15.96:6819/386227948]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-05-08T03:38:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:16 smithi133 ceph-mon[125939]: osdmap e43: 7 total, 6 up, 7 in 2023-05-08T03:38:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:16 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-05-08T03:38:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:16 smithi133 ceph-mon[125939]: from='osd.6 [v2:172.21.15.96:6818/386227948,v1:172.21.15.96:6819/386227948]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2023-05-08T03:38:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:16 smithi133 ceph-mon[125939]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-05-08T03:38:16.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:16 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:16.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:16 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:16.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:16 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:38:16.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:16 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:38:16.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:16 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:38:16.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:16 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:16.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:16 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:38:16.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:16 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:38:16.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:16 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:16.505 INFO:journalctl@ceph.osd.6.smithi096.stdout:May 08 03:38:16 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-6[148676]: 2023-05-08T03:38:16.307+0000 7efdaf171700 -1 osd.6 0 waiting for initial osdmap 2023-05-08T03:38:16.505 INFO:journalctl@ceph.osd.6.smithi096.stdout:May 08 03:38:16 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-6[148676]: 2023-05-08T03:38:16.317+0000 7efdab767700 -1 osd.6 44 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-08T03:38:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:16 smithi096 ceph-mon[124666]: from='osd.6 [v2:172.21.15.96:6818/386227948,v1:172.21.15.96:6819/386227948]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-05-08T03:38:16.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:16 smithi096 ceph-mon[124666]: osdmap e43: 7 total, 6 up, 7 in 2023-05-08T03:38:16.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:16 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-05-08T03:38:16.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:16 smithi096 ceph-mon[124666]: from='osd.6 [v2:172.21.15.96:6818/386227948,v1:172.21.15.96:6819/386227948]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2023-05-08T03:38:16.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:16 smithi096 ceph-mon[124666]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-05-08T03:38:16.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:16 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:16.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:16 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:16.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:16 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:38:16.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:16 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:38:16.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:16 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:38:16.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:16 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:16.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:16 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:38:16.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:16 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:38:16.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:16 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:16 smithi186 ceph-mon[126480]: from='osd.6 [v2:172.21.15.96:6818/386227948,v1:172.21.15.96:6819/386227948]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-05-08T03:38:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:16 smithi186 ceph-mon[126480]: osdmap e43: 7 total, 6 up, 7 in 2023-05-08T03:38:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:16 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-05-08T03:38:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:16 smithi186 ceph-mon[126480]: from='osd.6 [v2:172.21.15.96:6818/386227948,v1:172.21.15.96:6819/386227948]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2023-05-08T03:38:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:16 smithi186 ceph-mon[126480]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-05-08T03:38:16.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:16 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:16.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:16 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:16.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:16 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:38:16.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:16 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:38:16.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:16 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:38:16.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:16 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:16.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:16 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:38:16.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:16 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:38:16.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:16 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:16.895 INFO:teuthology.orchestra.run.smithi133.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.b/config 2023-05-08T03:38:17.429 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:17 smithi133 ceph-mon[125939]: Detected new or changed devices on smithi096 2023-05-08T03:38:17.429 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:17 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi096 to 5722M 2023-05-08T03:38:17.429 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:17 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:38:17.429 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:17 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T03:38:17.429 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:17 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:38:17.430 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:17 smithi133 ceph-mon[125939]: from='osd.6 [v2:172.21.15.96:6818/386227948,v1:172.21.15.96:6819/386227948]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]': finished 2023-05-08T03:38:17.430 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:17 smithi133 ceph-mon[125939]: osdmap e44: 7 total, 6 up, 7 in 2023-05-08T03:38:17.430 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:17 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-05-08T03:38:17.430 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:17 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-05-08T03:38:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:17 smithi186 ceph-mon[126480]: Detected new or changed devices on smithi096 2023-05-08T03:38:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:17 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi096 to 5722M 2023-05-08T03:38:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:17 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:38:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:17 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T03:38:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:17 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:38:17.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:17 smithi186 ceph-mon[126480]: from='osd.6 [v2:172.21.15.96:6818/386227948,v1:172.21.15.96:6819/386227948]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]': finished 2023-05-08T03:38:17.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:17 smithi186 ceph-mon[126480]: osdmap e44: 7 total, 6 up, 7 in 2023-05-08T03:38:17.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:17 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-05-08T03:38:17.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:17 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-05-08T03:38:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:17 smithi096 ceph-mon[124666]: Detected new or changed devices on smithi096 2023-05-08T03:38:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:17 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi096 to 5722M 2023-05-08T03:38:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:17 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:38:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:17 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T03:38:17.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:17 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:38:17.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:17 smithi096 ceph-mon[124666]: from='osd.6 [v2:172.21.15.96:6818/386227948,v1:172.21.15.96:6819/386227948]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]': finished 2023-05-08T03:38:17.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:17 smithi096 ceph-mon[124666]: osdmap e44: 7 total, 6 up, 7 in 2023-05-08T03:38:17.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:17 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-05-08T03:38:17.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:17 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-05-08T03:38:18.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:38:18.121+0000 7f0b55567700 1 -- 172.21.15.133:0/1487987877 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0b500ff2e0 msgr2=0x7f0b500ff6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:38:18.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:38:18.121+0000 7f0b55567700 1 --2- 172.21.15.133:0/1487987877 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0b500ff2e0 0x7f0b500ff6f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0b40009990 tx=0x7f0b40009ca0 comp rx=0 tx=0).stop 2023-05-08T03:38:18.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:38:18.121+0000 7f0b55567700 1 -- 172.21.15.133:0/1487987877 shutdown_connections 2023-05-08T03:38:18.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:38:18.121+0000 7f0b55567700 1 --2- 172.21.15.133:0/1487987877 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0b50100e70 0x7f0b50107730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:38:18.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:38:18.121+0000 7f0b55567700 1 --2- 172.21.15.133:0/1487987877 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0b500ff2e0 0x7f0b500ff6f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:38:18.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:38:18.121+0000 7f0b55567700 1 --2- 172.21.15.133:0/1487987877 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0b501004e0 0x7f0b50100930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:38:18.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:38:18.121+0000 7f0b55567700 1 -- 172.21.15.133:0/1487987877 >> 172.21.15.133:0/1487987877 conn(0x7f0b500fa8f0 msgr2=0x7f0b500fcd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:38:18.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:38:18.121+0000 7f0b55567700 1 -- 172.21.15.133:0/1487987877 shutdown_connections 2023-05-08T03:38:18.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:38:18.121+0000 7f0b55567700 1 -- 172.21.15.133:0/1487987877 wait complete. 2023-05-08T03:38:18.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:38:18.122+0000 7f0b55567700 1 Processor -- start 2023-05-08T03:38:18.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:38:18.122+0000 7f0b55567700 1 -- start start 2023-05-08T03:38:18.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:38:18.122+0000 7f0b55567700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0b500ff2e0 0x7f0b50195110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:38:18.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:38:18.122+0000 7f0b55567700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0b501004e0 0x7f0b50195650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:38:18.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:38:18.122+0000 7f0b55567700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0b50100e70 0x7f0b5019c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:38:18.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:38:18.122+0000 7f0b55567700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5019cca0 con 0x7f0b501004e0 2023-05-08T03:38:18.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:38:18.122+0000 7f0b55567700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5019cde0 con 0x7f0b500ff2e0 2023-05-08T03:38:18.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:38:18.122+0000 7f0b55567700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5019cf70 con 0x7f0b50100e70 2023-05-08T03:38:18.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:38:18.122+0000 7f0b4effd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0b500ff2e0 0x7f0b50195110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:38:18.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:38:18.122+0000 7f0b4effd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0b500ff2e0 0x7f0b50195110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44014/0 (socket says 172.21.15.133:44014) 2023-05-08T03:38:18.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:38:18.122+0000 7f0b4effd700 1 -- 172.21.15.133:0/1528316497 learned_addr learned my addr 172.21.15.133:0/1528316497 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-05-08T03:38:18.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:38:18.123+0000 7f0b4e7fc700 1 --2- 172.21.15.133:0/1528316497 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0b501004e0 0x7f0b50195650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:38:18.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:38:18.123+0000 7f0b4f7fe700 1 --2- 172.21.15.133:0/1528316497 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0b50100e70 0x7f0b5019c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:38:18.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:38:18.123+0000 7f0b4effd700 1 -- 172.21.15.133:0/1528316497 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0b50100e70 msgr2=0x7f0b5019c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:38:18.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:38:18.123+0000 7f0b4effd700 1 --2- 172.21.15.133:0/1528316497 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0b50100e70 0x7f0b5019c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:38:18.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:38:18.123+0000 7f0b4effd700 1 -- 172.21.15.133:0/1528316497 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0b501004e0 msgr2=0x7f0b50195650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:38:18.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:38:18.123+0000 7f0b4effd700 1 --2- 172.21.15.133:0/1528316497 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0b501004e0 0x7f0b50195650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:38:18.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:38:18.123+0000 7f0b4effd700 1 -- 172.21.15.133:0/1528316497 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b400095f0 con 0x7f0b500ff2e0 2023-05-08T03:38:18.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:38:18.123+0000 7f0b4e7fc700 1 --2- 172.21.15.133:0/1528316497 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0b501004e0 0x7f0b50195650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-08T03:38:18.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:38:18.123+0000 7f0b4effd700 1 --2- 172.21.15.133:0/1528316497 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0b500ff2e0 0x7f0b50195110 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0b40004730 tx=0x7f0b40005b00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:38:18.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:38:18.123+0000 7f0b47fff700 1 -- 172.21.15.133:0/1528316497 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4001d070 con 0x7f0b500ff2e0 2023-05-08T03:38:18.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:38:18.123+0000 7f0b47fff700 1 -- 172.21.15.133:0/1528316497 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0b40004810 con 0x7f0b500ff2e0 2023-05-08T03:38:18.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:38:18.123+0000 7f0b55567700 1 -- 172.21.15.133:0/1528316497 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b5010aca0 con 0x7f0b500ff2e0 2023-05-08T03:38:18.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:38:18.123+0000 7f0b47fff700 1 -- 172.21.15.133:0/1528316497 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b400054d0 con 0x7f0b500ff2e0 2023-05-08T03:38:18.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:38:18.123+0000 7f0b55567700 1 -- 172.21.15.133:0/1528316497 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b5010ab10 con 0x7f0b500ff2e0 2023-05-08T03:38:18.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:38:18.124+0000 7f0b55567700 1 -- 172.21.15.133:0/1528316497 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b501069b0 con 0x7f0b500ff2e0 2023-05-08T03:38:18.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:38:18.125+0000 7f0b47fff700 1 -- 172.21.15.133:0/1528316497 <== mon.2 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f0b40004980 con 0x7f0b500ff2e0 2023-05-08T03:38:18.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:38:18.126+0000 7f0b47fff700 1 --2- 172.21.15.133:0/1528316497 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f0b3c0a1150 0x7f0b3c0a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:38:18.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:38:18.126+0000 7f0b47fff700 1 -- 172.21.15.133:0/1528316497 <== mon.2 v2:172.21.15.133:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 4965+0+0 (secure 0 0 0) 0x7f0b400cced0 con 0x7f0b500ff2e0 2023-05-08T03:38:18.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:38:18.126+0000 7f0b4e7fc700 1 --2- 172.21.15.133:0/1528316497 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f0b3c0a1150 0x7f0b3c0a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:38:18.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:38:18.127+0000 7f0b4e7fc700 1 --2- 172.21.15.133:0/1528316497 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f0b3c0a1150 0x7f0b3c0a3600 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0b38009cb0 tx=0x7f0b38009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:38:18.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:38:18.130+0000 7f0b47fff700 1 -- 172.21.15.133:0/1528316497 <== mon.2 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f0b4005a730 con 0x7f0b500ff2e0 2023-05-08T03:38:18.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:38:18.326+0000 7f0b55567700 1 -- 172.21.15.133:0/1528316497 --> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi133:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f0b50061c00 con 0x7f0b3c0a1150 2023-05-08T03:38:18.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:18 smithi186 ceph-mon[126480]: purged_snaps scrub starts 2023-05-08T03:38:18.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:18 smithi186 ceph-mon[126480]: purged_snaps scrub ok 2023-05-08T03:38:18.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:18 smithi186 ceph-mon[126480]: osd.6 [v2:172.21.15.96:6818/386227948,v1:172.21.15.96:6819/386227948] boot 2023-05-08T03:38:18.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:18 smithi186 ceph-mon[126480]: osdmap e45: 7 total, 7 up, 7 in 2023-05-08T03:38:18.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:18 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-05-08T03:38:18.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:18 smithi186 ceph-mon[126480]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2023-05-08T03:38:18.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:18 smithi133 ceph-mon[125939]: purged_snaps scrub starts 2023-05-08T03:38:18.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:18 smithi133 ceph-mon[125939]: purged_snaps scrub ok 2023-05-08T03:38:18.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:18 smithi133 ceph-mon[125939]: osd.6 [v2:172.21.15.96:6818/386227948,v1:172.21.15.96:6819/386227948] boot 2023-05-08T03:38:18.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:18 smithi133 ceph-mon[125939]: osdmap e45: 7 total, 7 up, 7 in 2023-05-08T03:38:18.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:18 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-05-08T03:38:18.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:18 smithi133 ceph-mon[125939]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2023-05-08T03:38:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:18 smithi096 ceph-mon[124666]: purged_snaps scrub starts 2023-05-08T03:38:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:18 smithi096 ceph-mon[124666]: purged_snaps scrub ok 2023-05-08T03:38:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:18 smithi096 ceph-mon[124666]: osd.6 [v2:172.21.15.96:6818/386227948,v1:172.21.15.96:6819/386227948] boot 2023-05-08T03:38:18.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:18 smithi096 ceph-mon[124666]: osdmap e45: 7 total, 7 up, 7 in 2023-05-08T03:38:18.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:18 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-05-08T03:38:18.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:18 smithi096 ceph-mon[124666]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2023-05-08T03:38:19.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:19 smithi133 ceph-mon[125939]: osdmap e46: 7 total, 7 up, 7 in 2023-05-08T03:38:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:19 smithi133 ceph-mon[125939]: from='client.24272 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi133:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:38:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:19 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-05-08T03:38:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:19 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-05-08T03:38:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:19 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:38:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:19 smithi186 ceph-mon[126480]: osdmap e46: 7 total, 7 up, 7 in 2023-05-08T03:38:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:19 smithi186 ceph-mon[126480]: from='client.24272 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi133:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:38:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:19 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-05-08T03:38:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:19 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-05-08T03:38:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:19 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:38:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:19 smithi096 ceph-mon[124666]: osdmap e46: 7 total, 7 up, 7 in 2023-05-08T03:38:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:19 smithi096 ceph-mon[124666]: from='client.24272 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi133:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:38:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:19 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-05-08T03:38:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:19 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-05-08T03:38:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:19 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:38:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:20 smithi133 ceph-mon[125939]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2023-05-08T03:38:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:20 smithi186 ceph-mon[126480]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2023-05-08T03:38:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:20 smithi096 ceph-mon[124666]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2023-05-08T03:38:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:21 smithi186 ceph-mon[126480]: from='client.? 172.21.15.133:0/4162397766' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "282db569-a76e-485b-a33d-f2579b956525"}]: dispatch 2023-05-08T03:38:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:21 smithi186 ceph-mon[126480]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "282db569-a76e-485b-a33d-f2579b956525"}]: dispatch 2023-05-08T03:38:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:21 smithi186 ceph-mon[126480]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "282db569-a76e-485b-a33d-f2579b956525"}]': finished 2023-05-08T03:38:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:21 smithi186 ceph-mon[126480]: osdmap e47: 8 total, 7 up, 8 in 2023-05-08T03:38:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:21 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-05-08T03:38:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:21 smithi133 ceph-mon[125939]: from='client.? 172.21.15.133:0/4162397766' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "282db569-a76e-485b-a33d-f2579b956525"}]: dispatch 2023-05-08T03:38:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:21 smithi133 ceph-mon[125939]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "282db569-a76e-485b-a33d-f2579b956525"}]: dispatch 2023-05-08T03:38:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:21 smithi133 ceph-mon[125939]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "282db569-a76e-485b-a33d-f2579b956525"}]': finished 2023-05-08T03:38:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:21 smithi133 ceph-mon[125939]: osdmap e47: 8 total, 7 up, 8 in 2023-05-08T03:38:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:21 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-05-08T03:38:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:21 smithi096 ceph-mon[124666]: from='client.? 172.21.15.133:0/4162397766' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "282db569-a76e-485b-a33d-f2579b956525"}]: dispatch 2023-05-08T03:38:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:21 smithi096 ceph-mon[124666]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "282db569-a76e-485b-a33d-f2579b956525"}]: dispatch 2023-05-08T03:38:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:21 smithi096 ceph-mon[124666]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "282db569-a76e-485b-a33d-f2579b956525"}]': finished 2023-05-08T03:38:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:21 smithi096 ceph-mon[124666]: osdmap e47: 8 total, 7 up, 8 in 2023-05-08T03:38:21.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:21 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-05-08T03:38:22.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:22 smithi186 ceph-mon[126480]: from='client.? 172.21.15.133:0/1410041229' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-05-08T03:38:22.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:22 smithi186 ceph-mon[126480]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2023-05-08T03:38:22.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:22 smithi133 ceph-mon[125939]: from='client.? 172.21.15.133:0/1410041229' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-05-08T03:38:22.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:22 smithi133 ceph-mon[125939]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2023-05-08T03:38:22.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:22 smithi096 ceph-mon[124666]: from='client.? 172.21.15.133:0/1410041229' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-05-08T03:38:22.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:22 smithi096 ceph-mon[124666]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2023-05-08T03:38:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:24 smithi186 ceph-mon[126480]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2023-05-08T03:38:24.945 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:24 smithi133 ceph-mon[125939]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2023-05-08T03:38:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:24 smithi096 ceph-mon[124666]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2023-05-08T03:38:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:26 smithi186 ceph-mon[126480]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2023-05-08T03:38:26.942 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:26 smithi133 ceph-mon[125939]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2023-05-08T03:38:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:26 smithi096 ceph-mon[124666]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2023-05-08T03:38:28.561 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:28 smithi133 ceph-mon[125939]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2023-05-08T03:38:28.561 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:28 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-05-08T03:38:28.561 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:28 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:38:28.562 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:28 smithi133 ceph-mon[125939]: Deploying daemon osd.7 on smithi133 2023-05-08T03:38:28.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:28 smithi186 ceph-mon[126480]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2023-05-08T03:38:28.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:28 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-05-08T03:38:28.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:28 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:38:28.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:28 smithi186 ceph-mon[126480]: Deploying daemon osd.7 on smithi133 2023-05-08T03:38:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:28 smithi096 ceph-mon[124666]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2023-05-08T03:38:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:28 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-05-08T03:38:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:28 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:38:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:28 smithi096 ceph-mon[124666]: Deploying daemon osd.7 on smithi133 2023-05-08T03:38:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:30 smithi186 ceph-mon[126480]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2023-05-08T03:38:30.898 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:30 smithi133 ceph-mon[125939]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2023-05-08T03:38:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:30 smithi096 ceph-mon[124666]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2023-05-08T03:38:32.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:32 smithi133 ceph-mon[125939]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2023-05-08T03:38:32.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:32 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:32.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:32 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:32.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:32 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:38:32.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:32 smithi186 ceph-mon[126480]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2023-05-08T03:38:32.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:32 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:32.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:32 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:32.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:32 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:38:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:32 smithi096 ceph-mon[124666]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2023-05-08T03:38:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:32 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:33.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:32 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:33.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:32 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:38:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:34 smithi186 ceph-mon[126480]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2023-05-08T03:38:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:34 smithi133 ceph-mon[125939]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2023-05-08T03:38:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:34 smithi096 ceph-mon[124666]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2023-05-08T03:38:35.595 INFO:teuthology.orchestra.run.smithi133.stdout:Created osd(s) 7 on host 'smithi133' 2023-05-08T03:38:35.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:38:35.593+0000 7f0b47fff700 1 -- 172.21.15.133:0/1528316497 <== mgr.14152 v2:172.21.15.96:6800/2748629182 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f0b50061c00 con 0x7f0b3c0a1150 2023-05-08T03:38:35.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:38:35.596+0000 7f0b55567700 1 -- 172.21.15.133:0/1528316497 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f0b3c0a1150 msgr2=0x7f0b3c0a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:38:35.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:38:35.596+0000 7f0b55567700 1 --2- 172.21.15.133:0/1528316497 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f0b3c0a1150 0x7f0b3c0a3600 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0b38009cb0 tx=0x7f0b38009260 comp rx=0 tx=0).stop 2023-05-08T03:38:35.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:38:35.596+0000 7f0b55567700 1 -- 172.21.15.133:0/1528316497 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0b500ff2e0 msgr2=0x7f0b50195110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:38:35.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:38:35.596+0000 7f0b55567700 1 --2- 172.21.15.133:0/1528316497 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0b500ff2e0 0x7f0b50195110 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0b40004730 tx=0x7f0b40005b00 comp rx=0 tx=0).stop 2023-05-08T03:38:35.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:38:35.596+0000 7f0b55567700 1 -- 172.21.15.133:0/1528316497 shutdown_connections 2023-05-08T03:38:35.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:38:35.596+0000 7f0b55567700 1 --2- 172.21.15.133:0/1528316497 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f0b3c0a1150 0x7f0b3c0a3600 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:38:35.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:38:35.596+0000 7f0b55567700 1 --2- 172.21.15.133:0/1528316497 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0b50100e70 0x7f0b5019c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:38:35.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:38:35.596+0000 7f0b55567700 1 --2- 172.21.15.133:0/1528316497 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0b500ff2e0 0x7f0b50195110 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:38:35.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:38:35.596+0000 7f0b55567700 1 --2- 172.21.15.133:0/1528316497 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0b501004e0 0x7f0b50195650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:38:35.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:38:35.596+0000 7f0b55567700 1 -- 172.21.15.133:0/1528316497 >> 172.21.15.133:0/1528316497 conn(0x7f0b500fa8f0 msgr2=0x7f0b50103af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:38:35.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:38:35.596+0000 7f0b55567700 1 -- 172.21.15.133:0/1528316497 shutdown_connections 2023-05-08T03:38:35.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:38:35.596+0000 7f0b55567700 1 -- 172.21.15.133:0/1528316497 wait complete. 2023-05-08T03:38:35.993 DEBUG:teuthology.orchestra.run.smithi133:osd.7> sudo journalctl -f -n 0 -u ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c@osd.7.service 2023-05-08T03:38:35.995 INFO:tasks.cephadm:Deploying osd.8 on smithi186 with /dev/vg_nvme/lv_2... 2023-05-08T03:38:35.996 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-05-08T03:38:36.025 INFO:journalctl@ceph.osd.7.smithi133.stdout:-- Logs begin at Mon 2023-05-08 03:07:41 UTC. -- 2023-05-08T03:38:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:36 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:36 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:36 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:38:36.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:36 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:38:36.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:36 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:38:36.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:36 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:36.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:36 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T03:38:36.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:36 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:38:36.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:36 smithi186 ceph-mon[126480]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2023-05-08T03:38:36.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:36 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:36.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:36 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:36.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:36 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:38:36.448 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:36 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:36.448 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:36 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:36.449 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:36 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:38:36.449 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:36 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:38:36.449 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:36 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:38:36.449 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:36 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:36.449 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:36 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T03:38:36.449 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:36 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:38:36.449 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:36 smithi133 ceph-mon[125939]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2023-05-08T03:38:36.450 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:36 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:36.450 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:36 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:36.450 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:36 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:38:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:36 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:36.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:36 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:36.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:36 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:38:36.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:36 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:38:36.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:36 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:38:36.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:36 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:36.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:36 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T03:38:36.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:36 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:38:36.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:36 smithi096 ceph-mon[124666]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2023-05-08T03:38:36.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:36 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:36.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:36 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:36.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:36 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:38:36.647 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.c/config 2023-05-08T03:38:36.740 INFO:journalctl@ceph.osd.7.smithi133.stdout:May 08 03:38:36 smithi133 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-7[142079]: 2023-05-08T03:38:36.445+0000 7fc474f7e640 -1 osd.7 0 log_to_monitors true 2023-05-08T03:38:37.308 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:37 smithi133 ceph-mon[125939]: from='osd.7 [v2:172.21.15.133:6816/218507954,v1:172.21.15.133:6817/218507954]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-05-08T03:38:37.447 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:37 smithi186 ceph-mon[126480]: from='osd.7 [v2:172.21.15.133:6816/218507954,v1:172.21.15.133:6817/218507954]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-05-08T03:38:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:37 smithi096 ceph-mon[124666]: from='osd.7 [v2:172.21.15.133:6816/218507954,v1:172.21.15.133:6817/218507954]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-05-08T03:38:38.221 INFO:teuthology.orchestra.run.smithi186.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-05-08T03:38:38.221 INFO:teuthology.orchestra.run.smithi186.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-05-08T03:38:38.221 INFO:teuthology.orchestra.run.smithi186.stderr: stderr: 10+0 records in 2023-05-08T03:38:38.221 INFO:teuthology.orchestra.run.smithi186.stderr:10+0 records out 2023-05-08T03:38:38.221 INFO:teuthology.orchestra.run.smithi186.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0110706 s, 947 MB/s 2023-05-08T03:38:38.222 INFO:teuthology.orchestra.run.smithi186.stderr:--> Zapping successful for: 2023-05-08T03:38:38.490 INFO:journalctl@ceph.osd.7.smithi133.stdout:May 08 03:38:38 smithi133 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-7[142079]: 2023-05-08T03:38:38.183+0000 7fc469df4700 -1 osd.7 0 waiting for initial osdmap 2023-05-08T03:38:38.490 INFO:journalctl@ceph.osd.7.smithi133.stdout:May 08 03:38:38 smithi133 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-7[142079]: 2023-05-08T03:38:38.195+0000 7fc4653e8700 -1 osd.7 49 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-08T03:38:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:38 smithi133 ceph-mon[125939]: from='osd.7 [v2:172.21.15.133:6816/218507954,v1:172.21.15.133:6817/218507954]' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-05-08T03:38:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:38 smithi133 ceph-mon[125939]: osdmap e48: 8 total, 7 up, 8 in 2023-05-08T03:38:38.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:38 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-05-08T03:38:38.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:38 smithi133 ceph-mon[125939]: from='osd.7 [v2:172.21.15.133:6816/218507954,v1:172.21.15.133:6817/218507954]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2023-05-08T03:38:38.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:38 smithi133 ceph-mon[125939]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2023-05-08T03:38:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:38 smithi096 ceph-mon[124666]: from='osd.7 [v2:172.21.15.133:6816/218507954,v1:172.21.15.133:6817/218507954]' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-05-08T03:38:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:38 smithi096 ceph-mon[124666]: osdmap e48: 8 total, 7 up, 8 in 2023-05-08T03:38:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:38 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-05-08T03:38:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:38 smithi096 ceph-mon[124666]: from='osd.7 [v2:172.21.15.133:6816/218507954,v1:172.21.15.133:6817/218507954]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2023-05-08T03:38:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:38 smithi096 ceph-mon[124666]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2023-05-08T03:38:38.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:38 smithi186 ceph-mon[126480]: from='osd.7 [v2:172.21.15.133:6816/218507954,v1:172.21.15.133:6817/218507954]' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-05-08T03:38:38.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:38 smithi186 ceph-mon[126480]: osdmap e48: 8 total, 7 up, 8 in 2023-05-08T03:38:38.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:38 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-05-08T03:38:38.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:38 smithi186 ceph-mon[126480]: from='osd.7 [v2:172.21.15.133:6816/218507954,v1:172.21.15.133:6817/218507954]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2023-05-08T03:38:38.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:38 smithi186 ceph-mon[126480]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2023-05-08T03:38:38.690 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- ceph orch daemon add osd smithi186:vg_nvme/lv_2 2023-05-08T03:38:39.330 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.c/config 2023-05-08T03:38:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:39 smithi133 ceph-mon[125939]: from='osd.7 [v2:172.21.15.133:6816/218507954,v1:172.21.15.133:6817/218507954]' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]': finished 2023-05-08T03:38:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:39 smithi133 ceph-mon[125939]: osdmap e49: 8 total, 7 up, 8 in 2023-05-08T03:38:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:39 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-05-08T03:38:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:39 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-05-08T03:38:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:39 smithi133 ceph-mon[125939]: Detected new or changed devices on smithi133 2023-05-08T03:38:39.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:39 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:39.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:39 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:39.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:39 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:38:39.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:39 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:38:39.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:39 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:38:39.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:39 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi133 to 5722M 2023-05-08T03:38:39.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:39 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:39.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:39 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:38:39.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:39 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:38:39.494 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:39 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:38:39.494 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:39 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:39.494 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:39 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T03:38:39.494 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:39 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:38:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:39 smithi096 ceph-mon[124666]: from='osd.7 [v2:172.21.15.133:6816/218507954,v1:172.21.15.133:6817/218507954]' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]': finished 2023-05-08T03:38:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:39 smithi096 ceph-mon[124666]: osdmap e49: 8 total, 7 up, 8 in 2023-05-08T03:38:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:39 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-05-08T03:38:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:39 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-05-08T03:38:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:39 smithi096 ceph-mon[124666]: Detected new or changed devices on smithi133 2023-05-08T03:38:39.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:39 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:39.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:39 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:39.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:39 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:38:39.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:39 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:38:39.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:39 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:38:39.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:39 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi133 to 5722M 2023-05-08T03:38:39.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:39 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:39.509 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:39 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:38:39.509 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:39 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:38:39.509 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:39 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:38:39.510 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:39 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:39.510 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:39 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T03:38:39.510 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:39 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:38:39.521 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:39 smithi186 ceph-mon[126480]: from='osd.7 [v2:172.21.15.133:6816/218507954,v1:172.21.15.133:6817/218507954]' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]': finished 2023-05-08T03:38:39.521 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:39 smithi186 ceph-mon[126480]: osdmap e49: 8 total, 7 up, 8 in 2023-05-08T03:38:39.522 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:39 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-05-08T03:38:39.522 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:39 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-05-08T03:38:39.522 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:39 smithi186 ceph-mon[126480]: Detected new or changed devices on smithi133 2023-05-08T03:38:39.522 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:39 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:39.523 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:39 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:39.523 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:39 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:38:39.523 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:39 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:38:39.523 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:39 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:38:39.523 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:39 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi133 to 5722M 2023-05-08T03:38:39.523 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:39 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:39.524 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:39 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:38:39.524 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:39 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:38:39.524 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:39 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:38:39.524 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:39 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:39.525 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:39 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T03:38:39.525 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:39 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:38:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:40 smithi133 ceph-mon[125939]: purged_snaps scrub starts 2023-05-08T03:38:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:40 smithi133 ceph-mon[125939]: purged_snaps scrub ok 2023-05-08T03:38:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:40 smithi133 ceph-mon[125939]: osd.7 [v2:172.21.15.133:6816/218507954,v1:172.21.15.133:6817/218507954] boot 2023-05-08T03:38:40.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:40 smithi133 ceph-mon[125939]: osdmap e50: 8 total, 8 up, 8 in 2023-05-08T03:38:40.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:40 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-05-08T03:38:40.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:40 smithi133 ceph-mon[125939]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail 2023-05-08T03:38:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:40 smithi096 ceph-mon[124666]: purged_snaps scrub starts 2023-05-08T03:38:40.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:40 smithi096 ceph-mon[124666]: purged_snaps scrub ok 2023-05-08T03:38:40.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:40 smithi096 ceph-mon[124666]: osd.7 [v2:172.21.15.133:6816/218507954,v1:172.21.15.133:6817/218507954] boot 2023-05-08T03:38:40.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:40 smithi096 ceph-mon[124666]: osdmap e50: 8 total, 8 up, 8 in 2023-05-08T03:38:40.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:40 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-05-08T03:38:40.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:40 smithi096 ceph-mon[124666]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail 2023-05-08T03:38:40.523 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:38:40.520+0000 7fbbf481d700 1 -- 172.21.15.186:0/1043204080 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbbf0101fa0 msgr2=0x7fbbf0108860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:38:40.523 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:38:40.520+0000 7fbbf481d700 1 --2- 172.21.15.186:0/1043204080 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbbf0101fa0 0x7fbbf0108860 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fbbe800b0a0 tx=0x7fbbe800b3b0 comp rx=0 tx=0).stop 2023-05-08T03:38:40.523 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:38:40.520+0000 7fbbf481d700 1 -- 172.21.15.186:0/1043204080 shutdown_connections 2023-05-08T03:38:40.523 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:38:40.520+0000 7fbbf481d700 1 --2- 172.21.15.186:0/1043204080 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbbf0101fa0 0x7fbbf0108860 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:38:40.524 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:38:40.520+0000 7fbbf481d700 1 --2- 172.21.15.186:0/1043204080 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbf0100410 0x7fbbf0100820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:38:40.524 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:38:40.520+0000 7fbbf481d700 1 --2- 172.21.15.186:0/1043204080 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbbf0101610 0x7fbbf0101a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:38:40.524 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:38:40.520+0000 7fbbf481d700 1 -- 172.21.15.186:0/1043204080 >> 172.21.15.186:0/1043204080 conn(0x7fbbf00fba60 msgr2=0x7fbbf00fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:38:40.524 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:38:40.520+0000 7fbbf481d700 1 -- 172.21.15.186:0/1043204080 shutdown_connections 2023-05-08T03:38:40.524 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:38:40.520+0000 7fbbf481d700 1 -- 172.21.15.186:0/1043204080 wait complete. 2023-05-08T03:38:40.526 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:38:40.521+0000 7fbbf481d700 1 Processor -- start 2023-05-08T03:38:40.526 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:38:40.521+0000 7fbbf481d700 1 -- start start 2023-05-08T03:38:40.526 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:38:40.521+0000 7fbbf481d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbbf0100410 0x7fbbf0074990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:38:40.526 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:38:40.521+0000 7fbbf481d700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbbf0101610 0x7fbbf0072fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:38:40.527 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:38:40.521+0000 7fbbf481d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbf0101fa0 0x7fbbf0073520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:38:40.527 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:38:40.521+0000 7fbbf481d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf0073ca0 con 0x7fbbf0101fa0 2023-05-08T03:38:40.527 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:38:40.521+0000 7fbbf481d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf0073e10 con 0x7fbbf0100410 2023-05-08T03:38:40.527 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:38:40.521+0000 7fbbf481d700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf01a02c0 con 0x7fbbf0101610 2023-05-08T03:38:40.527 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:38:40.521+0000 7fbbedd9b700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbbf0101610 0x7fbbf0072fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:38:40.527 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:38:40.521+0000 7fbbedd9b700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbbf0101610 0x7fbbf0072fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.186:52734/0 (socket says 172.21.15.186:52734) 2023-05-08T03:38:40.527 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:38:40.521+0000 7fbbedd9b700 1 -- 172.21.15.186:0/393258638 learned_addr learned my addr 172.21.15.186:0/393258638 (peer_addr_for_me v2:172.21.15.186:0/0) 2023-05-08T03:38:40.528 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:38:40.521+0000 7fbbee59c700 1 --2- 172.21.15.186:0/393258638 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbbf0100410 0x7fbbf0074990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:38:40.528 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:38:40.521+0000 7fbbeed9d700 1 --2- 172.21.15.186:0/393258638 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbf0101fa0 0x7fbbf0073520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:38:40.528 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:38:40.521+0000 7fbbedd9b700 1 -- 172.21.15.186:0/393258638 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbbf0100410 msgr2=0x7fbbf0074990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:38:40.528 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:38:40.521+0000 7fbbedd9b700 1 --2- 172.21.15.186:0/393258638 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbbf0100410 0x7fbbf0074990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:38:40.528 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:38:40.521+0000 7fbbedd9b700 1 -- 172.21.15.186:0/393258638 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbf0101fa0 msgr2=0x7fbbf0073520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:38:40.528 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:38:40.521+0000 7fbbedd9b700 1 --2- 172.21.15.186:0/393258638 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbf0101fa0 0x7fbbf0073520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:38:40.529 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:38:40.521+0000 7fbbedd9b700 1 -- 172.21.15.186:0/393258638 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbe8009d00 con 0x7fbbf0101610 2023-05-08T03:38:40.529 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:38:40.521+0000 7fbbee59c700 1 --2- 172.21.15.186:0/393258638 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbbf0100410 0x7fbbf0074990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-08T03:38:40.529 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:38:40.521+0000 7fbbeed9d700 1 --2- 172.21.15.186:0/393258638 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbf0101fa0 0x7fbbf0073520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-08T03:38:40.529 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:38:40.521+0000 7fbbedd9b700 1 --2- 172.21.15.186:0/393258638 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbbf0101610 0x7fbbf0072fe0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fbbe400b530 tx=0x7fbbe400b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:38:40.529 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:38:40.522+0000 7fbbdf7fe700 1 -- 172.21.15.186:0/393258638 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe4011830 con 0x7fbbf0101610 2023-05-08T03:38:40.529 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:38:40.522+0000 7fbbdf7fe700 1 -- 172.21.15.186:0/393258638 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbbe4011e50 con 0x7fbbf0101610 2023-05-08T03:38:40.529 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:38:40.522+0000 7fbbf481d700 1 -- 172.21.15.186:0/393258638 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbf010bde0 con 0x7fbbf0101610 2023-05-08T03:38:40.530 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:38:40.522+0000 7fbbdf7fe700 1 -- 172.21.15.186:0/393258638 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe400f2e0 con 0x7fbbf0101610 2023-05-08T03:38:40.530 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:38:40.522+0000 7fbbf481d700 1 -- 172.21.15.186:0/393258638 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbf010bc50 con 0x7fbbf0101610 2023-05-08T03:38:40.530 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:38:40.523+0000 7fbbf481d700 1 -- 172.21.15.186:0/393258638 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbf0107960 con 0x7fbbf0101610 2023-05-08T03:38:40.531 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:38:40.524+0000 7fbbdf7fe700 1 -- 172.21.15.186:0/393258638 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fbbe4010580 con 0x7fbbf0101610 2023-05-08T03:38:40.532 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:38:40.524+0000 7fbbdf7fe700 1 --2- 172.21.15.186:0/393258638 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fbbd80a11d0 0x7fbbd80a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:38:40.532 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:38:40.524+0000 7fbbdf7fe700 1 -- 172.21.15.186:0/393258638 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5426+0+0 (secure 0 0 0) 0x7fbbe40cbe30 con 0x7fbbf0101610 2023-05-08T03:38:40.532 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:38:40.524+0000 7fbbee59c700 1 --2- 172.21.15.186:0/393258638 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fbbd80a11d0 0x7fbbd80a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:38:40.533 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:38:40.525+0000 7fbbee59c700 1 --2- 172.21.15.186:0/393258638 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fbbd80a11d0 0x7fbbd80a3680 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbbe0005950 tx=0x7fbbe00058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:38:40.533 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:38:40.528+0000 7fbbdf7fe700 1 -- 172.21.15.186:0/393258638 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fbbe40960c0 con 0x7fbbf0101610 2023-05-08T03:38:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:40 smithi186 ceph-mon[126480]: purged_snaps scrub starts 2023-05-08T03:38:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:40 smithi186 ceph-mon[126480]: purged_snaps scrub ok 2023-05-08T03:38:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:40 smithi186 ceph-mon[126480]: osd.7 [v2:172.21.15.133:6816/218507954,v1:172.21.15.133:6817/218507954] boot 2023-05-08T03:38:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:40 smithi186 ceph-mon[126480]: osdmap e50: 8 total, 8 up, 8 in 2023-05-08T03:38:40.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:40 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-05-08T03:38:40.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:40 smithi186 ceph-mon[126480]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail 2023-05-08T03:38:40.725 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:38:40.722+0000 7fbbf481d700 1 -- 172.21.15.186:0/393258638 --> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fbbf0061b70 con 0x7fbbd80a11d0 2023-05-08T03:38:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:41 smithi133 ceph-mon[125939]: osdmap e51: 8 total, 8 up, 8 in 2023-05-08T03:38:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:41 smithi133 ceph-mon[125939]: from='client.24307 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:38:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:41 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-05-08T03:38:41.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:41 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-05-08T03:38:41.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:41 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:38:41.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:41 smithi133 ceph-mon[125939]: osdmap e52: 8 total, 8 up, 8 in 2023-05-08T03:38:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:41 smithi096 ceph-mon[124666]: osdmap e51: 8 total, 8 up, 8 in 2023-05-08T03:38:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:41 smithi096 ceph-mon[124666]: from='client.24307 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:38:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:41 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-05-08T03:38:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:41 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-05-08T03:38:41.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:41 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:38:41.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:41 smithi096 ceph-mon[124666]: osdmap e52: 8 total, 8 up, 8 in 2023-05-08T03:38:41.602 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:41 smithi186 ceph-mon[126480]: osdmap e51: 8 total, 8 up, 8 in 2023-05-08T03:38:41.603 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:41 smithi186 ceph-mon[126480]: from='client.24307 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:38:41.603 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:41 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-05-08T03:38:41.603 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:41 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-05-08T03:38:41.603 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:41 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:38:41.603 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:41 smithi186 ceph-mon[126480]: osdmap e52: 8 total, 8 up, 8 in 2023-05-08T03:38:42.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:42 smithi133 ceph-mon[125939]: pgmap v164: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail; 2/6 objects degraded (33.333%) 2023-05-08T03:38:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:42 smithi096 ceph-mon[124666]: pgmap v164: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail; 2/6 objects degraded (33.333%) 2023-05-08T03:38:42.538 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:42 smithi186 ceph-mon[126480]: pgmap v164: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail; 2/6 objects degraded (33.333%) 2023-05-08T03:38:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:43 smithi133 ceph-mon[125939]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2023-05-08T03:38:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:43 smithi133 ceph-mon[125939]: osdmap e53: 8 total, 8 up, 8 in 2023-05-08T03:38:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:43 smithi096 ceph-mon[124666]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2023-05-08T03:38:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:43 smithi096 ceph-mon[124666]: osdmap e53: 8 total, 8 up, 8 in 2023-05-08T03:38:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:43 smithi186 ceph-mon[126480]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2023-05-08T03:38:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:43 smithi186 ceph-mon[126480]: osdmap e53: 8 total, 8 up, 8 in 2023-05-08T03:38:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:44 smithi133 ceph-mon[125939]: osdmap e54: 8 total, 8 up, 8 in 2023-05-08T03:38:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:44 smithi133 ceph-mon[125939]: from='client.? 172.21.15.186:0/1596647453' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "693e25b5-355d-4990-9467-0fac4c9133fc"}]: dispatch 2023-05-08T03:38:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:44 smithi133 ceph-mon[125939]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "693e25b5-355d-4990-9467-0fac4c9133fc"}]: dispatch 2023-05-08T03:38:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:44 smithi133 ceph-mon[125939]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "693e25b5-355d-4990-9467-0fac4c9133fc"}]': finished 2023-05-08T03:38:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:44 smithi133 ceph-mon[125939]: osdmap e55: 9 total, 8 up, 9 in 2023-05-08T03:38:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:44 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-05-08T03:38:44.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:44 smithi133 ceph-mon[125939]: pgmap v168: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail; 2/6 objects degraded (33.333%) 2023-05-08T03:38:44.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:44 smithi133 ceph-mon[125939]: from='client.? 172.21.15.186:0/751497769' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-05-08T03:38:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:44 smithi096 ceph-mon[124666]: osdmap e54: 8 total, 8 up, 8 in 2023-05-08T03:38:44.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:44 smithi096 ceph-mon[124666]: from='client.? 172.21.15.186:0/1596647453' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "693e25b5-355d-4990-9467-0fac4c9133fc"}]: dispatch 2023-05-08T03:38:44.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:44 smithi096 ceph-mon[124666]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "693e25b5-355d-4990-9467-0fac4c9133fc"}]: dispatch 2023-05-08T03:38:44.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:44 smithi096 ceph-mon[124666]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "693e25b5-355d-4990-9467-0fac4c9133fc"}]': finished 2023-05-08T03:38:44.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:44 smithi096 ceph-mon[124666]: osdmap e55: 9 total, 8 up, 9 in 2023-05-08T03:38:44.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:44 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-05-08T03:38:44.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:44 smithi096 ceph-mon[124666]: pgmap v168: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail; 2/6 objects degraded (33.333%) 2023-05-08T03:38:44.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:44 smithi096 ceph-mon[124666]: from='client.? 172.21.15.186:0/751497769' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-05-08T03:38:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:44 smithi186 ceph-mon[126480]: osdmap e54: 8 total, 8 up, 8 in 2023-05-08T03:38:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:44 smithi186 ceph-mon[126480]: from='client.? 172.21.15.186:0/1596647453' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "693e25b5-355d-4990-9467-0fac4c9133fc"}]: dispatch 2023-05-08T03:38:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:44 smithi186 ceph-mon[126480]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "693e25b5-355d-4990-9467-0fac4c9133fc"}]: dispatch 2023-05-08T03:38:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:44 smithi186 ceph-mon[126480]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "693e25b5-355d-4990-9467-0fac4c9133fc"}]': finished 2023-05-08T03:38:44.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:44 smithi186 ceph-mon[126480]: osdmap e55: 9 total, 8 up, 9 in 2023-05-08T03:38:44.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:44 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-05-08T03:38:44.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:44 smithi186 ceph-mon[126480]: pgmap v168: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail; 2/6 objects degraded (33.333%) 2023-05-08T03:38:44.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:44 smithi186 ceph-mon[126480]: from='client.? 172.21.15.186:0/751497769' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-05-08T03:38:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:45 smithi133 ceph-mon[125939]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2023-05-08T03:38:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:45 smithi133 ceph-mon[125939]: Cluster is now healthy 2023-05-08T03:38:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:45 smithi096 ceph-mon[124666]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2023-05-08T03:38:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:45 smithi096 ceph-mon[124666]: Cluster is now healthy 2023-05-08T03:38:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:45 smithi186 ceph-mon[126480]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2023-05-08T03:38:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:45 smithi186 ceph-mon[126480]: Cluster is now healthy 2023-05-08T03:38:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:46 smithi133 ceph-mon[125939]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-05-08T03:38:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:46 smithi096 ceph-mon[124666]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-05-08T03:38:47.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:46 smithi186 ceph-mon[126480]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-05-08T03:38:48.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:48 smithi186 ceph-mon[126480]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-05-08T03:38:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:48 smithi133 ceph-mon[125939]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-05-08T03:38:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:48 smithi096 ceph-mon[124666]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-05-08T03:38:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:50 smithi186 ceph-mon[126480]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-05-08T03:38:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:50 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-05-08T03:38:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:50 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:38:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:50 smithi133 ceph-mon[125939]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-05-08T03:38:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:50 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-05-08T03:38:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:50 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:38:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:50 smithi096 ceph-mon[124666]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-05-08T03:38:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:50 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-05-08T03:38:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:50 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:38:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:51 smithi186 ceph-mon[126480]: Deploying daemon osd.8 on smithi186 2023-05-08T03:38:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:51 smithi133 ceph-mon[125939]: Deploying daemon osd.8 on smithi186 2023-05-08T03:38:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:51 smithi096 ceph-mon[124666]: Deploying daemon osd.8 on smithi186 2023-05-08T03:38:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:52 smithi186 ceph-mon[126480]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-05-08T03:38:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:52 smithi133 ceph-mon[125939]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-05-08T03:38:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:52 smithi096 ceph-mon[124666]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-05-08T03:38:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:54 smithi186 ceph-mon[126480]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-05-08T03:38:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:54 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:54 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:38:54.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:54 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:54.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:54 smithi133 ceph-mon[125939]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-05-08T03:38:54.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:54 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:54.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:54 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:38:54.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:54 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:54 smithi096 ceph-mon[124666]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-05-08T03:38:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:54 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:54 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:38:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:54 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:56.699 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:56 smithi186 ceph-mon[126480]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-05-08T03:38:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:56 smithi133 ceph-mon[125939]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-05-08T03:38:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:56 smithi096 ceph-mon[124666]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-05-08T03:38:57.589 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:38:57.587+0000 7fbbdf7fe700 1 -- 172.21.15.186:0/393258638 <== mgr.14152 v2:172.21.15.96:6800/2748629182 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fbbf0061b70 con 0x7fbbd80a11d0 2023-05-08T03:38:57.590 INFO:teuthology.orchestra.run.smithi186.stdout:Created osd(s) 8 on host 'smithi186' 2023-05-08T03:38:57.592 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:38:57.590+0000 7fbbf481d700 1 -- 172.21.15.186:0/393258638 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fbbd80a11d0 msgr2=0x7fbbd80a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:38:57.592 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:38:57.590+0000 7fbbf481d700 1 --2- 172.21.15.186:0/393258638 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fbbd80a11d0 0x7fbbd80a3680 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbbe0005950 tx=0x7fbbe00058e0 comp rx=0 tx=0).stop 2023-05-08T03:38:57.592 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:38:57.590+0000 7fbbf481d700 1 -- 172.21.15.186:0/393258638 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbbf0101610 msgr2=0x7fbbf0072fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:38:57.592 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:38:57.590+0000 7fbbf481d700 1 --2- 172.21.15.186:0/393258638 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbbf0101610 0x7fbbf0072fe0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fbbe400b530 tx=0x7fbbe400b8f0 comp rx=0 tx=0).stop 2023-05-08T03:38:57.592 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:38:57.590+0000 7fbbf481d700 1 -- 172.21.15.186:0/393258638 shutdown_connections 2023-05-08T03:38:57.592 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:38:57.590+0000 7fbbf481d700 1 --2- 172.21.15.186:0/393258638 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fbbd80a11d0 0x7fbbd80a3680 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:38:57.593 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:38:57.590+0000 7fbbf481d700 1 --2- 172.21.15.186:0/393258638 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbf0101fa0 0x7fbbf0073520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:38:57.593 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:38:57.590+0000 7fbbf481d700 1 --2- 172.21.15.186:0/393258638 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbbf0100410 0x7fbbf0074990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:38:57.593 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:38:57.590+0000 7fbbf481d700 1 --2- 172.21.15.186:0/393258638 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbbf0101610 0x7fbbf0072fe0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:38:57.593 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:38:57.590+0000 7fbbf481d700 1 -- 172.21.15.186:0/393258638 >> 172.21.15.186:0/393258638 conn(0x7fbbf00fba60 msgr2=0x7fbbf0104aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:38:57.593 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:38:57.590+0000 7fbbf481d700 1 -- 172.21.15.186:0/393258638 shutdown_connections 2023-05-08T03:38:57.593 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:38:57.590+0000 7fbbf481d700 1 -- 172.21.15.186:0/393258638 wait complete. 2023-05-08T03:38:58.119 DEBUG:teuthology.orchestra.run.smithi186:osd.8> sudo journalctl -f -n 0 -u ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c@osd.8.service 2023-05-08T03:38:58.122 INFO:tasks.cephadm:Deploying osd.9 on smithi096 with /dev/vg_nvme/lv_1... 2023-05-08T03:38:58.122 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-05-08T03:38:58.153 INFO:journalctl@ceph.osd.8.smithi186.stdout:-- Logs begin at Mon 2023-05-08 03:08:31 UTC. -- 2023-05-08T03:38:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:58 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:58 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:58 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:38:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:58 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:38:58.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:58 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:38:58.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:58 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:58.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:58 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T03:38:58.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:58 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:38:58.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:58 smithi186 ceph-mon[126480]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-05-08T03:38:58.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:58 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:58.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:58 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:58.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:58 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:38:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:58 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:58 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:58 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:38:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:58 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:38:58.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:58 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:38:58.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:58 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:58.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:58 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T03:38:58.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:58 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:38:58.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:58 smithi133 ceph-mon[125939]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-05-08T03:38:58.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:58 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:58.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:58 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:58.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:58 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:38:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:58 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:58 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:58 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:38:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:58 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:38:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:58 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:38:58.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:58 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:58.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:58 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T03:38:58.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:58 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:38:58.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:58 smithi096 ceph-mon[124666]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-05-08T03:38:58.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:58 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:58.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:58 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:38:58.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:58 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:38:58.772 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.a/config 2023-05-08T03:38:58.785 INFO:journalctl@ceph.osd.8.smithi186.stdout:May 08 03:38:58 smithi186 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-8[143329]: 2023-05-08T03:38:58.492+0000 7f63e56d9640 -1 osd.8 0 log_to_monitors true 2023-05-08T03:38:59.491 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:59 smithi186 ceph-mon[126480]: from='osd.8 [v2:172.21.15.186:6816/1648475902,v1:172.21.15.186:6817/1648475902]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-05-08T03:38:59.491 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:38:59 smithi186 ceph-mon[126480]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-05-08T03:38:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:59 smithi133 ceph-mon[125939]: from='osd.8 [v2:172.21.15.186:6816/1648475902,v1:172.21.15.186:6817/1648475902]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-05-08T03:38:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:38:59 smithi133 ceph-mon[125939]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-05-08T03:38:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:59 smithi096 ceph-mon[124666]: from='osd.8 [v2:172.21.15.186:6816/1648475902,v1:172.21.15.186:6817/1648475902]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-05-08T03:38:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:38:59 smithi096 ceph-mon[124666]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-05-08T03:39:00.278 INFO:teuthology.orchestra.run.smithi096.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-05-08T03:39:00.278 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-05-08T03:39:00.279 INFO:teuthology.orchestra.run.smithi096.stderr: stderr: 10+0 records in 2023-05-08T03:39:00.279 INFO:teuthology.orchestra.run.smithi096.stderr:10+0 records out 2023-05-08T03:39:00.279 INFO:teuthology.orchestra.run.smithi096.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0111209 s, 943 MB/s 2023-05-08T03:39:00.279 INFO:teuthology.orchestra.run.smithi096.stderr:--> Zapping successful for: 2023-05-08T03:39:00.618 INFO:journalctl@ceph.osd.8.smithi186.stdout:May 08 03:39:00 smithi186 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-8[143329]: 2023-05-08T03:39:00.328+0000 7f63da54f700 -1 osd.8 0 waiting for initial osdmap 2023-05-08T03:39:00.619 INFO:journalctl@ceph.osd.8.smithi186.stdout:May 08 03:39:00 smithi186 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-8[143329]: 2023-05-08T03:39:00.341+0000 7f63d5b43700 -1 osd.8 57 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-08T03:39:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:00 smithi186 ceph-mon[126480]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-05-08T03:39:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:00 smithi186 ceph-mon[126480]: osdmap e56: 9 total, 8 up, 9 in 2023-05-08T03:39:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:00 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-05-08T03:39:00.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:00 smithi186 ceph-mon[126480]: from='osd.8 [v2:172.21.15.186:6816/1648475902,v1:172.21.15.186:6817/1648475902]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2023-05-08T03:39:00.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:00 smithi186 ceph-mon[126480]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2023-05-08T03:39:00.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:00 smithi186 ceph-mon[126480]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-05-08T03:39:00.718 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:00 smithi096 ceph-mon[124666]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-05-08T03:39:00.718 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:00 smithi096 ceph-mon[124666]: osdmap e56: 9 total, 8 up, 9 in 2023-05-08T03:39:00.718 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:00 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-05-08T03:39:00.719 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:00 smithi096 ceph-mon[124666]: from='osd.8 [v2:172.21.15.186:6816/1648475902,v1:172.21.15.186:6817/1648475902]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2023-05-08T03:39:00.719 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:00 smithi096 ceph-mon[124666]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2023-05-08T03:39:00.719 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:00 smithi096 ceph-mon[124666]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-05-08T03:39:00.723 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- ceph orch daemon add osd smithi096:vg_nvme/lv_1 2023-05-08T03:39:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:00 smithi133 ceph-mon[125939]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-05-08T03:39:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:00 smithi133 ceph-mon[125939]: osdmap e56: 9 total, 8 up, 9 in 2023-05-08T03:39:00.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:00 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-05-08T03:39:00.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:00 smithi133 ceph-mon[125939]: from='osd.8 [v2:172.21.15.186:6816/1648475902,v1:172.21.15.186:6817/1648475902]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2023-05-08T03:39:00.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:00 smithi133 ceph-mon[125939]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2023-05-08T03:39:00.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:00 smithi133 ceph-mon[125939]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-05-08T03:39:01.366 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.a/config 2023-05-08T03:39:01.581 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:01 smithi096 ceph-mon[124666]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]': finished 2023-05-08T03:39:01.581 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:01 smithi096 ceph-mon[124666]: osdmap e57: 9 total, 8 up, 9 in 2023-05-08T03:39:01.581 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:01 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-05-08T03:39:01.581 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:01 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-05-08T03:39:01.582 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:01 smithi096 ceph-mon[124666]: Detected new or changed devices on smithi186 2023-05-08T03:39:01.582 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:01 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:39:01.582 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:01 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:39:01.582 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:01 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:39:01.582 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:01 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:39:01.582 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:01 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:39:01.582 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:01 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi186 to 5722M 2023-05-08T03:39:01.583 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:01 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:39:01.583 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:01 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:39:01.583 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:01 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:39:01.583 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:01 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:39:01.583 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:01 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:39:01.583 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:01 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T03:39:01.583 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:01 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:39:01.583 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:01 smithi096 ceph-mon[124666]: osd.8 [v2:172.21.15.186:6816/1648475902,v1:172.21.15.186:6817/1648475902] boot 2023-05-08T03:39:01.584 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:01 smithi096 ceph-mon[124666]: osdmap e58: 9 total, 9 up, 9 in 2023-05-08T03:39:01.584 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:01 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-05-08T03:39:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:01 smithi186 ceph-mon[126480]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]': finished 2023-05-08T03:39:01.641 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:01 smithi186 ceph-mon[126480]: osdmap e57: 9 total, 8 up, 9 in 2023-05-08T03:39:01.641 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:01 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-05-08T03:39:01.641 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:01 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-05-08T03:39:01.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:01 smithi186 ceph-mon[126480]: Detected new or changed devices on smithi186 2023-05-08T03:39:01.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:01 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:39:01.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:01 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:39:01.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:01 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:39:01.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:01 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:39:01.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:01 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:39:01.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:01 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi186 to 5722M 2023-05-08T03:39:01.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:01 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:39:01.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:01 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:39:01.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:01 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:39:01.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:01 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:39:01.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:01 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:39:01.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:01 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T03:39:01.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:01 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:39:01.643 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:01 smithi186 ceph-mon[126480]: osd.8 [v2:172.21.15.186:6816/1648475902,v1:172.21.15.186:6817/1648475902] boot 2023-05-08T03:39:01.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:01 smithi186 ceph-mon[126480]: osdmap e58: 9 total, 9 up, 9 in 2023-05-08T03:39:01.644 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:01 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-05-08T03:39:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:01 smithi133 ceph-mon[125939]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]': finished 2023-05-08T03:39:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:01 smithi133 ceph-mon[125939]: osdmap e57: 9 total, 8 up, 9 in 2023-05-08T03:39:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:01 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-05-08T03:39:01.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:01 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-05-08T03:39:01.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:01 smithi133 ceph-mon[125939]: Detected new or changed devices on smithi186 2023-05-08T03:39:01.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:01 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:39:01.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:01 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:39:01.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:01 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:39:01.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:01 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:39:01.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:01 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:39:01.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:01 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi186 to 5722M 2023-05-08T03:39:01.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:01 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:39:01.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:01 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:39:01.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:01 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:39:01.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:01 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:39:01.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:01 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:39:01.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:01 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T03:39:01.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:01 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:39:01.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:01 smithi133 ceph-mon[125939]: osd.8 [v2:172.21.15.186:6816/1648475902,v1:172.21.15.186:6817/1648475902] boot 2023-05-08T03:39:01.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:01 smithi133 ceph-mon[125939]: osdmap e58: 9 total, 9 up, 9 in 2023-05-08T03:39:01.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:01 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-05-08T03:39:02.580 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:39:02.578+0000 7fdc2d03b700 1 -- 172.21.15.96:0/2795639287 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc280fea60 msgr2=0x7fdc280fee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:39:02.581 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:39:02.578+0000 7fdc2d03b700 1 --2- 172.21.15.96:0/2795639287 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc280fea60 0x7fdc280fee70 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c009990 tx=0x7fdc1c009ca0 comp rx=0 tx=0).stop 2023-05-08T03:39:02.581 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:39:02.578+0000 7fdc2d03b700 1 -- 172.21.15.96:0/2795639287 shutdown_connections 2023-05-08T03:39:02.582 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:39:02.578+0000 7fdc2d03b700 1 --2- 172.21.15.96:0/2795639287 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdc281005f0 0x7fdc28106eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:39:02.582 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:39:02.578+0000 7fdc2d03b700 1 --2- 172.21.15.96:0/2795639287 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc280fea60 0x7fdc280fee70 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:39:02.582 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:39:02.578+0000 7fdc2d03b700 1 --2- 172.21.15.96:0/2795639287 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc280ffc60 0x7fdc281000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:39:02.583 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:39:02.578+0000 7fdc2d03b700 1 -- 172.21.15.96:0/2795639287 >> 172.21.15.96:0/2795639287 conn(0x7fdc280fa070 msgr2=0x7fdc280fc4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:39:02.583 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:39:02.578+0000 7fdc2d03b700 1 -- 172.21.15.96:0/2795639287 shutdown_connections 2023-05-08T03:39:02.583 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:39:02.578+0000 7fdc2d03b700 1 -- 172.21.15.96:0/2795639287 wait complete. 2023-05-08T03:39:02.586 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:39:02.579+0000 7fdc2d03b700 1 Processor -- start 2023-05-08T03:39:02.587 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:39:02.579+0000 7fdc2d03b700 1 -- start start 2023-05-08T03:39:02.587 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:39:02.579+0000 7fdc2d03b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc280fea60 0x7fdc28108360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:39:02.587 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:39:02.579+0000 7fdc2d03b700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdc280ffc60 0x7fdc2819af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:39:02.588 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:39:02.579+0000 7fdc2d03b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc281005f0 0x7fdc2819d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:39:02.588 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:39:02.579+0000 7fdc2d03b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc2819dd60 con 0x7fdc280fea60 2023-05-08T03:39:02.588 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:39:02.579+0000 7fdc2d03b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc2819ded0 con 0x7fdc281005f0 2023-05-08T03:39:02.588 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:39:02.579+0000 7fdc2d03b700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc2819e090 con 0x7fdc280ffc60 2023-05-08T03:39:02.588 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:39:02.579+0000 7fdc26d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc280fea60 0x7fdc28108360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:39:02.588 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:39:02.579+0000 7fdc26d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc280fea60 0x7fdc28108360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39876/0 (socket says 172.21.15.96:39876) 2023-05-08T03:39:02.589 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:39:02.579+0000 7fdc26d9d700 1 -- 172.21.15.96:0/4043860797 learned_addr learned my addr 172.21.15.96:0/4043860797 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:39:02.589 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:39:02.579+0000 7fdc2659c700 1 --2- 172.21.15.96:0/4043860797 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdc280ffc60 0x7fdc2819af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:39:02.589 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:39:02.579+0000 7fdc2759e700 1 --2- 172.21.15.96:0/4043860797 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc281005f0 0x7fdc2819d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:39:02.589 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:39:02.579+0000 7fdc26d9d700 1 -- 172.21.15.96:0/4043860797 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdc280ffc60 msgr2=0x7fdc2819af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:39:02.589 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:39:02.579+0000 7fdc26d9d700 1 --2- 172.21.15.96:0/4043860797 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdc280ffc60 0x7fdc2819af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:39:02.589 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:39:02.579+0000 7fdc26d9d700 1 -- 172.21.15.96:0/4043860797 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc281005f0 msgr2=0x7fdc2819d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:39:02.590 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:39:02.579+0000 7fdc26d9d700 1 --2- 172.21.15.96:0/4043860797 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc281005f0 0x7fdc2819d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:39:02.590 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:39:02.579+0000 7fdc26d9d700 1 -- 172.21.15.96:0/4043860797 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc1c0095f0 con 0x7fdc280fea60 2023-05-08T03:39:02.590 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:39:02.579+0000 7fdc2759e700 1 --2- 172.21.15.96:0/4043860797 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc281005f0 0x7fdc2819d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-08T03:39:02.590 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:39:02.579+0000 7fdc26d9d700 1 --2- 172.21.15.96:0/4043860797 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc280fea60 0x7fdc28108360 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c00f730 tx=0x7fdc1c00f810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:39:02.590 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:39:02.580+0000 7fdc0ffff700 1 -- 172.21.15.96:0/4043860797 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc1c01d070 con 0x7fdc280fea60 2023-05-08T03:39:02.591 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:39:02.580+0000 7fdc2d03b700 1 -- 172.21.15.96:0/4043860797 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc2810ad80 con 0x7fdc280fea60 2023-05-08T03:39:02.591 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:39:02.580+0000 7fdc0ffff700 1 -- 172.21.15.96:0/4043860797 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdc1c00fd30 con 0x7fdc280fea60 2023-05-08T03:39:02.591 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:39:02.580+0000 7fdc0ffff700 1 -- 172.21.15.96:0/4043860797 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc1c005710 con 0x7fdc280fea60 2023-05-08T03:39:02.591 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:39:02.580+0000 7fdc2d03b700 1 -- 172.21.15.96:0/4043860797 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc2810abf0 con 0x7fdc280fea60 2023-05-08T03:39:02.591 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:39:02.581+0000 7fdc2d03b700 1 -- 172.21.15.96:0/4043860797 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc28106000 con 0x7fdc280fea60 2023-05-08T03:39:02.591 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:39:02.582+0000 7fdc0ffff700 1 -- 172.21.15.96:0/4043860797 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fdc1c0047e0 con 0x7fdc280fea60 2023-05-08T03:39:02.591 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:39:02.582+0000 7fdc0ffff700 1 --2- 172.21.15.96:0/4043860797 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fdc100a1150 0x7fdc100a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:39:02.592 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:39:02.582+0000 7fdc0ffff700 1 -- 172.21.15.96:0/4043860797 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5858+0+0 (secure 0 0 0) 0x7fdc1c0cd710 con 0x7fdc280fea60 2023-05-08T03:39:02.592 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:39:02.582+0000 7fdc2659c700 1 --2- 172.21.15.96:0/4043860797 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fdc100a1150 0x7fdc100a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:39:02.592 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:39:02.583+0000 7fdc2659c700 1 --2- 172.21.15.96:0/4043860797 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fdc100a1150 0x7fdc100a3600 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fdc18006fd0 tx=0x7fdc18008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:39:02.592 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:39:02.586+0000 7fdc0ffff700 1 -- 172.21.15.96:0/4043860797 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fdc1c097880 con 0x7fdc280fea60 2023-05-08T03:39:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:02 smithi186 ceph-mon[126480]: purged_snaps scrub starts 2023-05-08T03:39:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:02 smithi186 ceph-mon[126480]: purged_snaps scrub ok 2023-05-08T03:39:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:02 smithi186 ceph-mon[126480]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 54 MiB used, 805 GiB / 805 GiB avail 2023-05-08T03:39:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:02 smithi186 ceph-mon[126480]: osdmap e59: 9 total, 9 up, 9 in 2023-05-08T03:39:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:02 smithi133 ceph-mon[125939]: purged_snaps scrub starts 2023-05-08T03:39:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:02 smithi133 ceph-mon[125939]: purged_snaps scrub ok 2023-05-08T03:39:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:02 smithi133 ceph-mon[125939]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 54 MiB used, 805 GiB / 805 GiB avail 2023-05-08T03:39:02.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:02 smithi133 ceph-mon[125939]: osdmap e59: 9 total, 9 up, 9 in 2023-05-08T03:39:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:02 smithi096 ceph-mon[124666]: purged_snaps scrub starts 2023-05-08T03:39:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:02 smithi096 ceph-mon[124666]: purged_snaps scrub ok 2023-05-08T03:39:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:02 smithi096 ceph-mon[124666]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 54 MiB used, 805 GiB / 805 GiB avail 2023-05-08T03:39:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:02 smithi096 ceph-mon[124666]: osdmap e59: 9 total, 9 up, 9 in 2023-05-08T03:39:02.785 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:39:02.783+0000 7fdc2d03b700 1 -- 172.21.15.96:0/4043860797 --> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi096:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7fdc28061cc0 con 0x7fdc100a1150 2023-05-08T03:39:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:03 smithi186 ceph-mon[126480]: from='client.14421 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi096:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:39:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:03 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-05-08T03:39:03.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:03 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-05-08T03:39:03.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:03 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:39:03.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:03 smithi186 ceph-mon[126480]: osdmap e60: 9 total, 9 up, 9 in 2023-05-08T03:39:03.671 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:03 smithi096 ceph-mon[124666]: from='client.14421 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi096:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:39:03.671 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:03 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-05-08T03:39:03.671 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:03 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-05-08T03:39:03.672 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:03 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:39:03.672 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:03 smithi096 ceph-mon[124666]: osdmap e60: 9 total, 9 up, 9 in 2023-05-08T03:39:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:03 smithi133 ceph-mon[125939]: from='client.14421 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi096:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:39:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:03 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-05-08T03:39:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:03 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-05-08T03:39:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:03 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:39:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:03 smithi133 ceph-mon[125939]: osdmap e60: 9 total, 9 up, 9 in 2023-05-08T03:39:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:04 smithi186 ceph-mon[126480]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 54 MiB used, 805 GiB / 805 GiB avail 2023-05-08T03:39:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:04 smithi133 ceph-mon[125939]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 54 MiB used, 805 GiB / 805 GiB avail 2023-05-08T03:39:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:04 smithi096 ceph-mon[124666]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 54 MiB used, 805 GiB / 805 GiB avail 2023-05-08T03:39:05.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:05 smithi186 ceph-mon[126480]: osdmap e61: 9 total, 9 up, 9 in 2023-05-08T03:39:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:05 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/2050581265' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "72fbff09-fe28-4014-86fc-c31f95cd19a9"}]: dispatch 2023-05-08T03:39:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:05 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/2050581265' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "72fbff09-fe28-4014-86fc-c31f95cd19a9"}]': finished 2023-05-08T03:39:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:05 smithi186 ceph-mon[126480]: osdmap e62: 10 total, 9 up, 10 in 2023-05-08T03:39:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:05 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-05-08T03:39:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:05 smithi133 ceph-mon[125939]: osdmap e61: 9 total, 9 up, 9 in 2023-05-08T03:39:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:05 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/2050581265' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "72fbff09-fe28-4014-86fc-c31f95cd19a9"}]: dispatch 2023-05-08T03:39:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:05 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/2050581265' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "72fbff09-fe28-4014-86fc-c31f95cd19a9"}]': finished 2023-05-08T03:39:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:05 smithi133 ceph-mon[125939]: osdmap e62: 10 total, 9 up, 10 in 2023-05-08T03:39:05.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:05 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-05-08T03:39:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:05 smithi096 ceph-mon[124666]: osdmap e61: 9 total, 9 up, 9 in 2023-05-08T03:39:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:05 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/2050581265' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "72fbff09-fe28-4014-86fc-c31f95cd19a9"}]: dispatch 2023-05-08T03:39:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:05 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/2050581265' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "72fbff09-fe28-4014-86fc-c31f95cd19a9"}]': finished 2023-05-08T03:39:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:05 smithi096 ceph-mon[124666]: osdmap e62: 10 total, 9 up, 10 in 2023-05-08T03:39:05.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:05 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-05-08T03:39:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:06 smithi186 ceph-mon[126480]: pgmap v186: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 54 MiB used, 805 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-05-08T03:39:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:06 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/2607229236' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-05-08T03:39:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:06 smithi133 ceph-mon[125939]: pgmap v186: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 54 MiB used, 805 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-05-08T03:39:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:06 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/2607229236' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-05-08T03:39:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:06 smithi096 ceph-mon[124666]: pgmap v186: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 54 MiB used, 805 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-05-08T03:39:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:06 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/2607229236' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-05-08T03:39:08.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:08 smithi186 ceph-mon[126480]: pgmap v187: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail; 111 KiB/s, 0 objects/s recovering 2023-05-08T03:39:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:08 smithi133 ceph-mon[125939]: pgmap v187: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail; 111 KiB/s, 0 objects/s recovering 2023-05-08T03:39:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:08 smithi096 ceph-mon[124666]: pgmap v187: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail; 111 KiB/s, 0 objects/s recovering 2023-05-08T03:39:10.747 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:10 smithi096 ceph-mon[124666]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail; 93 KiB/s, 0 objects/s recovering 2023-05-08T03:39:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:10 smithi186 ceph-mon[126480]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail; 93 KiB/s, 0 objects/s recovering 2023-05-08T03:39:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:10 smithi133 ceph-mon[125939]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail; 93 KiB/s, 0 objects/s recovering 2023-05-08T03:39:12.854 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:12 smithi096 ceph-mon[124666]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-05-08T03:39:12.854 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:12 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-05-08T03:39:12.854 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:12 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:39:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:12 smithi186 ceph-mon[126480]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-05-08T03:39:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:12 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-05-08T03:39:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:12 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:39:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:12 smithi133 ceph-mon[125939]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-05-08T03:39:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:12 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-05-08T03:39:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:12 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:39:13.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:13 smithi186 ceph-mon[126480]: Deploying daemon osd.9 on smithi096 2023-05-08T03:39:13.900 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:13 smithi096 ceph-mon[124666]: Deploying daemon osd.9 on smithi096 2023-05-08T03:39:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:13 smithi133 ceph-mon[125939]: Deploying daemon osd.9 on smithi096 2023-05-08T03:39:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:14 smithi186 ceph-mon[126480]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-05-08T03:39:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:14 smithi133 ceph-mon[125939]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-05-08T03:39:15.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:14 smithi096 ceph-mon[124666]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-05-08T03:39:16.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:16 smithi186 ceph-mon[126480]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-05-08T03:39:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:16 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:39:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:16 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:39:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:16 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:39:16.905 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:16 smithi096 ceph-mon[124666]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-05-08T03:39:16.905 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:16 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:39:16.905 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:16 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:39:16.905 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:16 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:39:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:16 smithi133 ceph-mon[125939]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-05-08T03:39:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:16 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:39:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:16 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:39:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:16 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:39:18.578 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:18 smithi096 ceph-mon[124666]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-05-08T03:39:18.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:18 smithi186 ceph-mon[126480]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-05-08T03:39:18.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:18 smithi133 ceph-mon[125939]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-05-08T03:39:19.536 INFO:teuthology.orchestra.run.smithi096.stdout:Created osd(s) 9 on host 'smithi096' 2023-05-08T03:39:19.537 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:39:19.534+0000 7fdc0ffff700 1 -- 172.21.15.96:0/4043860797 <== mgr.14152 v2:172.21.15.96:6800/2748629182 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fdc28061cc0 con 0x7fdc100a1150 2023-05-08T03:39:19.539 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:39:19.536+0000 7fdc2d03b700 1 -- 172.21.15.96:0/4043860797 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fdc100a1150 msgr2=0x7fdc100a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:39:19.539 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:39:19.536+0000 7fdc2d03b700 1 --2- 172.21.15.96:0/4043860797 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fdc100a1150 0x7fdc100a3600 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fdc18006fd0 tx=0x7fdc18008040 comp rx=0 tx=0).stop 2023-05-08T03:39:19.539 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:39:19.536+0000 7fdc2d03b700 1 -- 172.21.15.96:0/4043860797 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc280fea60 msgr2=0x7fdc28108360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:39:19.539 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:39:19.536+0000 7fdc2d03b700 1 --2- 172.21.15.96:0/4043860797 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc280fea60 0x7fdc28108360 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c00f730 tx=0x7fdc1c00f810 comp rx=0 tx=0).stop 2023-05-08T03:39:19.539 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:39:19.537+0000 7fdc2d03b700 1 -- 172.21.15.96:0/4043860797 shutdown_connections 2023-05-08T03:39:19.540 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:39:19.537+0000 7fdc2d03b700 1 --2- 172.21.15.96:0/4043860797 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fdc100a1150 0x7fdc100a3600 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:39:19.540 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:39:19.537+0000 7fdc2d03b700 1 --2- 172.21.15.96:0/4043860797 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc281005f0 0x7fdc2819d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:39:19.540 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:39:19.537+0000 7fdc2d03b700 1 --2- 172.21.15.96:0/4043860797 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc280fea60 0x7fdc28108360 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:39:19.540 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:39:19.537+0000 7fdc2d03b700 1 --2- 172.21.15.96:0/4043860797 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdc280ffc60 0x7fdc2819af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:39:19.540 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:39:19.537+0000 7fdc2d03b700 1 -- 172.21.15.96:0/4043860797 >> 172.21.15.96:0/4043860797 conn(0x7fdc280fa070 msgr2=0x7fdc28103140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:39:19.540 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:39:19.537+0000 7fdc2d03b700 1 -- 172.21.15.96:0/4043860797 shutdown_connections 2023-05-08T03:39:19.540 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:39:19.537+0000 7fdc2d03b700 1 -- 172.21.15.96:0/4043860797 wait complete. 2023-05-08T03:39:20.059 DEBUG:teuthology.orchestra.run.smithi096:osd.9> sudo journalctl -f -n 0 -u ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c@osd.9.service 2023-05-08T03:39:20.062 INFO:tasks.cephadm:Deploying osd.10 on smithi133 with /dev/vg_nvme/lv_1... 2023-05-08T03:39:20.062 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-05-08T03:39:20.096 INFO:journalctl@ceph.osd.9.smithi096.stdout:-- Logs begin at Mon 2023-05-08 03:07:36 UTC. -- 2023-05-08T03:39:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:20 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:39:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:20 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:39:20.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:20 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:39:20.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:20 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:39:20.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:20 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:39:20.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:20 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:39:20.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:20 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T03:39:20.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:20 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:39:20.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:20 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:39:20.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:20 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:39:20.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:20 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:39:20.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:20 smithi096 ceph-mon[124666]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-05-08T03:39:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:20 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:39:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:20 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:39:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:20 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:39:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:20 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:39:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:20 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:39:20.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:20 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:39:20.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:20 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T03:39:20.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:20 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:39:20.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:20 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:39:20.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:20 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:39:20.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:20 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:39:20.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:20 smithi186 ceph-mon[126480]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-05-08T03:39:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:20 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:39:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:20 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:39:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:20 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:39:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:20 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:39:20.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:20 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:39:20.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:20 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:39:20.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:20 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T03:39:20.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:20 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:39:20.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:20 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:39:20.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:20 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:39:20.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:20 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:39:20.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:20 smithi133 ceph-mon[125939]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-05-08T03:39:20.715 INFO:journalctl@ceph.osd.9.smithi096.stdout:May 08 03:39:20 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-9[154140]: 2023-05-08T03:39:20.436+0000 7fa88c379640 -1 osd.9 0 log_to_monitors true 2023-05-08T03:39:20.716 INFO:teuthology.orchestra.run.smithi133.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.b/config 2023-05-08T03:39:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:21 smithi133 ceph-mon[125939]: from='osd.9 [v2:172.21.15.96:6826/543223824,v1:172.21.15.96:6827/543223824]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-05-08T03:39:21.342 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:21 smithi096 ceph-mon[124666]: from='osd.9 [v2:172.21.15.96:6826/543223824,v1:172.21.15.96:6827/543223824]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-05-08T03:39:21.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:21 smithi186 ceph-mon[126480]: from='osd.9 [v2:172.21.15.96:6826/543223824,v1:172.21.15.96:6827/543223824]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-05-08T03:39:22.208 INFO:teuthology.orchestra.run.smithi133.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-05-08T03:39:22.209 INFO:teuthology.orchestra.run.smithi133.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-05-08T03:39:22.209 INFO:teuthology.orchestra.run.smithi133.stderr: stderr: 10+0 records in 2023-05-08T03:39:22.209 INFO:teuthology.orchestra.run.smithi133.stderr:10+0 records out 2023-05-08T03:39:22.209 INFO:teuthology.orchestra.run.smithi133.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0112225 s, 934 MB/s 2023-05-08T03:39:22.209 INFO:teuthology.orchestra.run.smithi133.stderr:--> Zapping successful for: 2023-05-08T03:39:22.255 INFO:journalctl@ceph.osd.9.smithi096.stdout:May 08 03:39:22 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-9[154140]: 2023-05-08T03:39:22.056+0000 7fa8811ef700 -1 osd.9 0 waiting for initial osdmap 2023-05-08T03:39:22.255 INFO:journalctl@ceph.osd.9.smithi096.stdout:May 08 03:39:22 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-9[154140]: 2023-05-08T03:39:22.074+0000 7fa87a7df700 -1 osd.9 64 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-08T03:39:22.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:22 smithi096 ceph-mon[124666]: from='osd.9 [v2:172.21.15.96:6826/543223824,v1:172.21.15.96:6827/543223824]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-05-08T03:39:22.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:22 smithi096 ceph-mon[124666]: osdmap e63: 10 total, 9 up, 10 in 2023-05-08T03:39:22.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:22 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-05-08T03:39:22.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:22 smithi096 ceph-mon[124666]: from='osd.9 [v2:172.21.15.96:6826/543223824,v1:172.21.15.96:6827/543223824]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2023-05-08T03:39:22.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:22 smithi096 ceph-mon[124666]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-05-08T03:39:22.368 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:22 smithi133 ceph-mon[125939]: from='osd.9 [v2:172.21.15.96:6826/543223824,v1:172.21.15.96:6827/543223824]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-05-08T03:39:22.368 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:22 smithi133 ceph-mon[125939]: osdmap e63: 10 total, 9 up, 10 in 2023-05-08T03:39:22.368 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:22 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-05-08T03:39:22.369 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:22 smithi133 ceph-mon[125939]: from='osd.9 [v2:172.21.15.96:6826/543223824,v1:172.21.15.96:6827/543223824]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2023-05-08T03:39:22.369 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:22 smithi133 ceph-mon[125939]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-05-08T03:39:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:22 smithi186 ceph-mon[126480]: from='osd.9 [v2:172.21.15.96:6826/543223824,v1:172.21.15.96:6827/543223824]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-05-08T03:39:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:22 smithi186 ceph-mon[126480]: osdmap e63: 10 total, 9 up, 10 in 2023-05-08T03:39:22.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:22 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-05-08T03:39:22.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:22 smithi186 ceph-mon[126480]: from='osd.9 [v2:172.21.15.96:6826/543223824,v1:172.21.15.96:6827/543223824]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2023-05-08T03:39:22.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:22 smithi186 ceph-mon[126480]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-05-08T03:39:22.670 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- ceph orch daemon add osd smithi133:vg_nvme/lv_1 2023-05-08T03:39:23.306 INFO:teuthology.orchestra.run.smithi133.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.b/config 2023-05-08T03:39:23.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:23 smithi186 ceph-mon[126480]: from='osd.9 [v2:172.21.15.96:6826/543223824,v1:172.21.15.96:6827/543223824]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]': finished 2023-05-08T03:39:23.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:23 smithi186 ceph-mon[126480]: osdmap e64: 10 total, 9 up, 10 in 2023-05-08T03:39:23.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:23 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-05-08T03:39:23.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:23 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-05-08T03:39:23.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:23 smithi186 ceph-mon[126480]: Detected new or changed devices on smithi096 2023-05-08T03:39:23.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:23 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:39:23.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:23 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:39:23.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:23 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:39:23.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:23 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:39:23.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:23 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:39:23.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:23 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:39:23.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:23 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi096 to 4292M 2023-05-08T03:39:23.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:23 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:39:23.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:23 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:39:23.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:23 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:39:23.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:23 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:39:23.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:23 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:39:23.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:23 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T03:39:23.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:23 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:39:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:23 smithi133 ceph-mon[125939]: from='osd.9 [v2:172.21.15.96:6826/543223824,v1:172.21.15.96:6827/543223824]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]': finished 2023-05-08T03:39:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:23 smithi133 ceph-mon[125939]: osdmap e64: 10 total, 9 up, 10 in 2023-05-08T03:39:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:23 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-05-08T03:39:23.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:23 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-05-08T03:39:23.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:23 smithi133 ceph-mon[125939]: Detected new or changed devices on smithi096 2023-05-08T03:39:23.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:23 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:39:23.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:23 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:39:23.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:23 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:39:23.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:23 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:39:23.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:23 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:39:23.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:23 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:39:23.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:23 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi096 to 4292M 2023-05-08T03:39:23.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:23 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:39:23.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:23 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:39:23.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:23 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:39:23.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:23 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:39:23.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:23 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:39:23.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:23 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T03:39:23.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:23 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:39:23.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:23 smithi096 ceph-mon[124666]: from='osd.9 [v2:172.21.15.96:6826/543223824,v1:172.21.15.96:6827/543223824]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]': finished 2023-05-08T03:39:23.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:23 smithi096 ceph-mon[124666]: osdmap e64: 10 total, 9 up, 10 in 2023-05-08T03:39:23.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:23 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-05-08T03:39:23.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:23 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-05-08T03:39:23.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:23 smithi096 ceph-mon[124666]: Detected new or changed devices on smithi096 2023-05-08T03:39:23.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:23 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:39:23.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:23 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:39:23.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:23 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:39:23.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:23 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:39:23.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:23 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:39:23.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:23 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:39:23.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:23 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi096 to 4292M 2023-05-08T03:39:23.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:23 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:39:23.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:23 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:39:23.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:23 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:39:23.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:23 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:39:23.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:23 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:39:23.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:23 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T03:39:23.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:23 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:39:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:24 smithi133 ceph-mon[125939]: purged_snaps scrub starts 2023-05-08T03:39:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:24 smithi133 ceph-mon[125939]: purged_snaps scrub ok 2023-05-08T03:39:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:24 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-05-08T03:39:24.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:24 smithi133 ceph-mon[125939]: osd.9 [v2:172.21.15.96:6826/543223824,v1:172.21.15.96:6827/543223824] boot 2023-05-08T03:39:24.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:24 smithi133 ceph-mon[125939]: osdmap e65: 10 total, 10 up, 10 in 2023-05-08T03:39:24.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:24 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-05-08T03:39:24.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:24 smithi133 ceph-mon[125939]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-05-08T03:39:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:24 smithi186 ceph-mon[126480]: purged_snaps scrub starts 2023-05-08T03:39:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:24 smithi186 ceph-mon[126480]: purged_snaps scrub ok 2023-05-08T03:39:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:24 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-05-08T03:39:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:24 smithi186 ceph-mon[126480]: osd.9 [v2:172.21.15.96:6826/543223824,v1:172.21.15.96:6827/543223824] boot 2023-05-08T03:39:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:24 smithi186 ceph-mon[126480]: osdmap e65: 10 total, 10 up, 10 in 2023-05-08T03:39:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:24 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-05-08T03:39:24.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:24 smithi186 ceph-mon[126480]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-05-08T03:39:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:24 smithi096 ceph-mon[124666]: purged_snaps scrub starts 2023-05-08T03:39:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:24 smithi096 ceph-mon[124666]: purged_snaps scrub ok 2023-05-08T03:39:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:24 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-05-08T03:39:24.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:24 smithi096 ceph-mon[124666]: osd.9 [v2:172.21.15.96:6826/543223824,v1:172.21.15.96:6827/543223824] boot 2023-05-08T03:39:24.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:24 smithi096 ceph-mon[124666]: osdmap e65: 10 total, 10 up, 10 in 2023-05-08T03:39:24.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:24 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-05-08T03:39:24.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:24 smithi096 ceph-mon[124666]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-05-08T03:39:24.609 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:39:24.605+0000 7f2ce630b700 1 -- 172.21.15.133:0/2561475846 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ce01005f0 msgr2=0x7f2ce0106eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:39:24.609 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:39:24.605+0000 7f2ce630b700 1 --2- 172.21.15.133:0/2561475846 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ce01005f0 0x7f2ce0106eb0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2cd800b0a0 tx=0x7f2cd800b3b0 comp rx=0 tx=0).stop 2023-05-08T03:39:24.609 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:39:24.605+0000 7f2ce630b700 1 -- 172.21.15.133:0/2561475846 shutdown_connections 2023-05-08T03:39:24.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:39:24.605+0000 7f2ce630b700 1 --2- 172.21.15.133:0/2561475846 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ce01005f0 0x7f2ce0106eb0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:39:24.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:39:24.605+0000 7f2ce630b700 1 --2- 172.21.15.133:0/2561475846 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2ce00fea60 0x7f2ce00fee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:39:24.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:39:24.605+0000 7f2ce630b700 1 --2- 172.21.15.133:0/2561475846 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ce00ffc60 0x7f2ce01000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:39:24.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:39:24.605+0000 7f2ce630b700 1 -- 172.21.15.133:0/2561475846 >> 172.21.15.133:0/2561475846 conn(0x7f2ce00fa070 msgr2=0x7f2ce00fc4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:39:24.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:39:24.605+0000 7f2ce630b700 1 -- 172.21.15.133:0/2561475846 shutdown_connections 2023-05-08T03:39:24.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:39:24.605+0000 7f2ce630b700 1 -- 172.21.15.133:0/2561475846 wait complete. 2023-05-08T03:39:24.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:39:24.606+0000 7f2ce630b700 1 Processor -- start 2023-05-08T03:39:24.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:39:24.606+0000 7f2ce630b700 1 -- start start 2023-05-08T03:39:24.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:39:24.606+0000 7f2ce630b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ce00fea60 0x7f2ce0108320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:39:24.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:39:24.606+0000 7f2ce630b700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2ce00ffc60 0x7f2ce019afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:39:24.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:39:24.606+0000 7f2ce630b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ce01005f0 0x7f2ce019d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:39:24.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:39:24.606+0000 7f2ce630b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce019ddc0 con 0x7f2ce01005f0 2023-05-08T03:39:24.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:39:24.606+0000 7f2ce630b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce019df30 con 0x7f2ce00fea60 2023-05-08T03:39:24.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:39:24.606+0000 7f2ce630b700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce019e0f0 con 0x7f2ce00ffc60 2023-05-08T03:39:24.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:39:24.606+0000 7f2cdffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ce00fea60 0x7f2ce0108320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:39:24.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:39:24.606+0000 7f2cdffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ce00fea60 0x7f2ce0108320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44162/0 (socket says 172.21.15.133:44162) 2023-05-08T03:39:24.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:39:24.606+0000 7f2cdffff700 1 -- 172.21.15.133:0/1861401751 learned_addr learned my addr 172.21.15.133:0/1861401751 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-05-08T03:39:24.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:39:24.607+0000 7f2ce48a8700 1 --2- 172.21.15.133:0/1861401751 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ce01005f0 0x7f2ce019d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:39:24.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:39:24.607+0000 7f2cdffff700 1 -- 172.21.15.133:0/1861401751 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2ce00ffc60 msgr2=0x7f2ce019afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:39:24.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:39:24.607+0000 7f2cdf7fe700 1 --2- 172.21.15.133:0/1861401751 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2ce00ffc60 0x7f2ce019afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:39:24.613 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:39:24.607+0000 7f2cdffff700 1 --2- 172.21.15.133:0/1861401751 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2ce00ffc60 0x7f2ce019afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:39:24.613 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:39:24.607+0000 7f2cdffff700 1 -- 172.21.15.133:0/1861401751 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ce01005f0 msgr2=0x7f2ce019d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:39:24.613 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:39:24.607+0000 7f2cdffff700 1 --2- 172.21.15.133:0/1861401751 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ce01005f0 0x7f2ce019d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:39:24.613 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:39:24.607+0000 7f2cdffff700 1 -- 172.21.15.133:0/1861401751 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cd8009d00 con 0x7f2ce00fea60 2023-05-08T03:39:24.613 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:39:24.607+0000 7f2ce48a8700 1 --2- 172.21.15.133:0/1861401751 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ce01005f0 0x7f2ce019d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-08T03:39:24.613 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:39:24.607+0000 7f2cdffff700 1 --2- 172.21.15.133:0/1861401751 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ce00fea60 0x7f2ce0108320 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2cd000b500 tx=0x7f2cd000b8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:39:24.614 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:39:24.607+0000 7f2cdd7fa700 1 -- 172.21.15.133:0/1861401751 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd0011830 con 0x7f2ce00fea60 2023-05-08T03:39:24.614 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:39:24.607+0000 7f2cdd7fa700 1 -- 172.21.15.133:0/1861401751 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2cd0011e50 con 0x7f2ce00fea60 2023-05-08T03:39:24.614 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:39:24.607+0000 7f2cdd7fa700 1 -- 172.21.15.133:0/1861401751 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd000f2e0 con 0x7f2ce00fea60 2023-05-08T03:39:24.614 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:39:24.607+0000 7f2ce630b700 1 -- 172.21.15.133:0/1861401751 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ce010ace0 con 0x7f2ce00fea60 2023-05-08T03:39:24.615 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:39:24.607+0000 7f2ce630b700 1 -- 172.21.15.133:0/1861401751 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ce010ab50 con 0x7f2ce00fea60 2023-05-08T03:39:24.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:39:24.608+0000 7f2ce630b700 1 -- 172.21.15.133:0/1861401751 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ce0105fd0 con 0x7f2ce00fea60 2023-05-08T03:39:24.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:39:24.609+0000 7f2cdd7fa700 1 -- 172.21.15.133:0/1861401751 <== mon.2 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f2cd0010580 con 0x7f2ce00fea60 2023-05-08T03:39:24.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:39:24.609+0000 7f2cdd7fa700 1 --2- 172.21.15.133:0/1861401751 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f2cc80a1250 0x7f2cc80a3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:39:24.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:39:24.610+0000 7f2cdd7fa700 1 -- 172.21.15.133:0/1861401751 <== mon.2 v2:172.21.15.133:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6261+0+0 (secure 0 0 0) 0x7f2cd00cbc20 con 0x7f2ce00fea60 2023-05-08T03:39:24.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:39:24.610+0000 7f2cdf7fe700 1 --2- 172.21.15.133:0/1861401751 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f2cc80a1250 0x7f2cc80a3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:39:24.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:39:24.610+0000 7f2cdf7fe700 1 --2- 172.21.15.133:0/1861401751 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f2cc80a1250 0x7f2cc80a3700 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2cd4005950 tx=0x7f2cd40058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:39:24.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:39:24.614+0000 7f2cdd7fa700 1 -- 172.21.15.133:0/1861401751 <== mon.2 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f2cd0095ad0 con 0x7f2ce00fea60 2023-05-08T03:39:24.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:39:24.806+0000 7f2ce630b700 1 -- 172.21.15.133:0/1861401751 --> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi133:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f2ce0061d30 con 0x7f2cc80a1250 2023-05-08T03:39:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:25 smithi186 ceph-mon[126480]: osdmap e66: 10 total, 10 up, 10 in 2023-05-08T03:39:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:25 smithi186 ceph-mon[126480]: from='client.24332 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi133:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:39:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:25 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-05-08T03:39:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:25 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-05-08T03:39:25.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:25 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:39:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:25 smithi133 ceph-mon[125939]: osdmap e66: 10 total, 10 up, 10 in 2023-05-08T03:39:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:25 smithi133 ceph-mon[125939]: from='client.24332 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi133:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:39:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:25 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-05-08T03:39:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:25 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-05-08T03:39:25.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:25 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:39:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:25 smithi096 ceph-mon[124666]: osdmap e66: 10 total, 10 up, 10 in 2023-05-08T03:39:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:25 smithi096 ceph-mon[124666]: from='client.24332 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi133:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:39:25.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:25 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-05-08T03:39:25.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:25 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-05-08T03:39:25.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:25 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:39:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:26 smithi186 ceph-mon[126480]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 60 MiB used, 894 GiB / 894 GiB avail 2023-05-08T03:39:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:26 smithi133 ceph-mon[125939]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 60 MiB used, 894 GiB / 894 GiB avail 2023-05-08T03:39:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:26 smithi096 ceph-mon[124666]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 60 MiB used, 894 GiB / 894 GiB avail 2023-05-08T03:39:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:27 smithi186 ceph-mon[126480]: from='client.? 172.21.15.133:0/3345913605' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6c2b6757-60c2-4962-9409-6051dcb13273"}]: dispatch 2023-05-08T03:39:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:27 smithi186 ceph-mon[126480]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6c2b6757-60c2-4962-9409-6051dcb13273"}]: dispatch 2023-05-08T03:39:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:27 smithi186 ceph-mon[126480]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6c2b6757-60c2-4962-9409-6051dcb13273"}]': finished 2023-05-08T03:39:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:27 smithi186 ceph-mon[126480]: osdmap e67: 11 total, 10 up, 11 in 2023-05-08T03:39:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:27 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-05-08T03:39:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:27 smithi133 ceph-mon[125939]: from='client.? 172.21.15.133:0/3345913605' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6c2b6757-60c2-4962-9409-6051dcb13273"}]: dispatch 2023-05-08T03:39:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:27 smithi133 ceph-mon[125939]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6c2b6757-60c2-4962-9409-6051dcb13273"}]: dispatch 2023-05-08T03:39:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:27 smithi133 ceph-mon[125939]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6c2b6757-60c2-4962-9409-6051dcb13273"}]': finished 2023-05-08T03:39:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:27 smithi133 ceph-mon[125939]: osdmap e67: 11 total, 10 up, 11 in 2023-05-08T03:39:27.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:27 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-05-08T03:39:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:27 smithi096 ceph-mon[124666]: from='client.? 172.21.15.133:0/3345913605' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6c2b6757-60c2-4962-9409-6051dcb13273"}]: dispatch 2023-05-08T03:39:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:27 smithi096 ceph-mon[124666]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6c2b6757-60c2-4962-9409-6051dcb13273"}]: dispatch 2023-05-08T03:39:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:27 smithi096 ceph-mon[124666]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6c2b6757-60c2-4962-9409-6051dcb13273"}]': finished 2023-05-08T03:39:27.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:27 smithi096 ceph-mon[124666]: osdmap e67: 11 total, 10 up, 11 in 2023-05-08T03:39:27.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:27 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-05-08T03:39:28.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:28 smithi186 ceph-mon[126480]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-05-08T03:39:28.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:28 smithi186 ceph-mon[126480]: from='client.? 172.21.15.133:0/805323791' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-05-08T03:39:28.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:28 smithi133 ceph-mon[125939]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-05-08T03:39:28.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:28 smithi133 ceph-mon[125939]: from='client.? 172.21.15.133:0/805323791' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-05-08T03:39:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:28 smithi096 ceph-mon[124666]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-05-08T03:39:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:28 smithi096 ceph-mon[124666]: from='client.? 172.21.15.133:0/805323791' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-05-08T03:39:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:30 smithi186 ceph-mon[126480]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-05-08T03:39:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:30 smithi133 ceph-mon[125939]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-05-08T03:39:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:30 smithi096 ceph-mon[124666]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-05-08T03:39:32.732 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:32 smithi133 ceph-mon[125939]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-05-08T03:39:32.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:32 smithi186 ceph-mon[126480]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-05-08T03:39:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:32 smithi096 ceph-mon[124666]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-05-08T03:39:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:34 smithi186 ceph-mon[126480]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-05-08T03:39:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:34 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-05-08T03:39:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:34 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:39:34.927 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:34 smithi133 ceph-mon[125939]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-05-08T03:39:34.927 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:34 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-05-08T03:39:34.927 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:34 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:39:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:34 smithi096 ceph-mon[124666]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-05-08T03:39:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:34 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-05-08T03:39:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:34 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:39:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:35 smithi186 ceph-mon[126480]: Deploying daemon osd.10 on smithi133 2023-05-08T03:39:35.968 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:35 smithi133 ceph-mon[125939]: Deploying daemon osd.10 on smithi133 2023-05-08T03:39:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:35 smithi096 ceph-mon[124666]: Deploying daemon osd.10 on smithi133 2023-05-08T03:39:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:36 smithi186 ceph-mon[126480]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-05-08T03:39:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:36 smithi133 ceph-mon[125939]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-05-08T03:39:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:36 smithi096 ceph-mon[124666]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-05-08T03:39:38.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:38 smithi133 ceph-mon[125939]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-05-08T03:39:38.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:38 smithi186 ceph-mon[126480]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-05-08T03:39:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:38 smithi096 ceph-mon[124666]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-05-08T03:39:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:39 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:39:39.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:39 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:39:39.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:39 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:39:39.629 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:39 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:39:39.629 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:39 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:39:39.629 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:39 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:39:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:39 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:39:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:39 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:39:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:39 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:39:40.413 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:40 smithi133 ceph-mon[125939]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-05-08T03:39:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:40 smithi186 ceph-mon[126480]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-05-08T03:39:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:40 smithi096 ceph-mon[124666]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-05-08T03:39:41.323 INFO:teuthology.orchestra.run.smithi133.stdout:Created osd(s) 10 on host 'smithi133' 2023-05-08T03:39:41.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:39:41.321+0000 7f2cdd7fa700 1 -- 172.21.15.133:0/1861401751 <== mgr.14152 v2:172.21.15.96:6800/2748629182 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7f2ce0061d30 con 0x7f2cc80a1250 2023-05-08T03:39:41.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:39:41.323+0000 7f2ce630b700 1 -- 172.21.15.133:0/1861401751 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f2cc80a1250 msgr2=0x7f2cc80a3700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:39:41.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:39:41.323+0000 7f2ce630b700 1 --2- 172.21.15.133:0/1861401751 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f2cc80a1250 0x7f2cc80a3700 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2cd4005950 tx=0x7f2cd40058e0 comp rx=0 tx=0).stop 2023-05-08T03:39:41.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:39:41.323+0000 7f2ce630b700 1 -- 172.21.15.133:0/1861401751 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ce00fea60 msgr2=0x7f2ce0108320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:39:41.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:39:41.323+0000 7f2ce630b700 1 --2- 172.21.15.133:0/1861401751 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ce00fea60 0x7f2ce0108320 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2cd000b500 tx=0x7f2cd000b8c0 comp rx=0 tx=0).stop 2023-05-08T03:39:41.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:39:41.323+0000 7f2ce630b700 1 -- 172.21.15.133:0/1861401751 shutdown_connections 2023-05-08T03:39:41.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:39:41.323+0000 7f2ce630b700 1 --2- 172.21.15.133:0/1861401751 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f2cc80a1250 0x7f2cc80a3700 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:39:41.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:39:41.323+0000 7f2ce630b700 1 --2- 172.21.15.133:0/1861401751 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ce01005f0 0x7f2ce019d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:39:41.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:39:41.323+0000 7f2ce630b700 1 --2- 172.21.15.133:0/1861401751 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ce00fea60 0x7f2ce0108320 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:39:41.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:39:41.323+0000 7f2ce630b700 1 --2- 172.21.15.133:0/1861401751 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2ce00ffc60 0x7f2ce019afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:39:41.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:39:41.323+0000 7f2ce630b700 1 -- 172.21.15.133:0/1861401751 >> 172.21.15.133:0/1861401751 conn(0x7f2ce00fa070 msgr2=0x7f2ce0103110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:39:41.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:39:41.323+0000 7f2ce630b700 1 -- 172.21.15.133:0/1861401751 shutdown_connections 2023-05-08T03:39:41.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-05-08T03:39:41.323+0000 7f2ce630b700 1 -- 172.21.15.133:0/1861401751 wait complete. 2023-05-08T03:39:41.701 DEBUG:teuthology.orchestra.run.smithi133:osd.10> sudo journalctl -f -n 0 -u ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c@osd.10.service 2023-05-08T03:39:41.703 INFO:tasks.cephadm:Deploying osd.11 on smithi186 with /dev/vg_nvme/lv_1... 2023-05-08T03:39:41.704 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-05-08T03:39:41.734 INFO:journalctl@ceph.osd.10.smithi133.stdout:-- Logs begin at Mon 2023-05-08 03:07:41 UTC. -- 2023-05-08T03:39:42.357 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.c/config 2023-05-08T03:39:42.440 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:42 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:39:42.440 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:42 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:39:42.440 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:42 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:39:42.441 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:42 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:39:42.441 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:42 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:39:42.441 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:42 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:39:42.441 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:42 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T03:39:42.441 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:42 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:39:42.441 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:42 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:39:42.441 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:42 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:39:42.442 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:42 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:39:42.442 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:42 smithi133 ceph-mon[125939]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-05-08T03:39:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:42 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:39:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:42 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:39:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:42 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:39:42.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:42 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:39:42.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:42 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:39:42.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:42 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:39:42.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:42 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T03:39:42.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:42 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:39:42.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:42 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:39:42.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:42 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:39:42.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:42 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:39:42.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:42 smithi096 ceph-mon[124666]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-05-08T03:39:42.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:42 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:39:42.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:42 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:39:42.613 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:42 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:39:42.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:42 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:39:42.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:42 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:39:42.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:42 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:39:42.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:42 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T03:39:42.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:42 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:39:42.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:42 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:39:42.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:42 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:39:42.614 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:42 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:39:42.615 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:42 smithi186 ceph-mon[126480]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-05-08T03:39:42.740 INFO:journalctl@ceph.osd.10.smithi133.stdout:May 08 03:39:42 smithi133 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-10[147571]: 2023-05-08T03:39:42.484+0000 7f9675dc5640 -1 osd.10 0 log_to_monitors true 2023-05-08T03:39:43.524 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:43 smithi186 ceph-mon[126480]: from='osd.10 [v2:172.21.15.133:6824/2323107912,v1:172.21.15.133:6825/2323107912]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-05-08T03:39:43.524 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:43 smithi186 ceph-mon[126480]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-05-08T03:39:43.611 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:43 smithi133 ceph-mon[125939]: from='osd.10 [v2:172.21.15.133:6824/2323107912,v1:172.21.15.133:6825/2323107912]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-05-08T03:39:43.612 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:43 smithi133 ceph-mon[125939]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-05-08T03:39:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:43 smithi096 ceph-mon[124666]: from='osd.10 [v2:172.21.15.133:6824/2323107912,v1:172.21.15.133:6825/2323107912]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-05-08T03:39:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:43 smithi096 ceph-mon[124666]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-05-08T03:39:43.979 INFO:teuthology.orchestra.run.smithi186.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-05-08T03:39:43.979 INFO:teuthology.orchestra.run.smithi186.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-05-08T03:39:43.980 INFO:teuthology.orchestra.run.smithi186.stderr: stderr: 10+0 records in 2023-05-08T03:39:43.980 INFO:teuthology.orchestra.run.smithi186.stderr:10+0 records out 2023-05-08T03:39:43.980 INFO:teuthology.orchestra.run.smithi186.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0111533 s, 940 MB/s 2023-05-08T03:39:43.980 INFO:teuthology.orchestra.run.smithi186.stderr:--> Zapping successful for: 2023-05-08T03:39:44.335 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:44 smithi133 ceph-mon[125939]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-05-08T03:39:44.335 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:44 smithi133 ceph-mon[125939]: osdmap e68: 11 total, 10 up, 11 in 2023-05-08T03:39:44.335 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:44 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-05-08T03:39:44.335 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:44 smithi133 ceph-mon[125939]: from='osd.10 [v2:172.21.15.133:6824/2323107912,v1:172.21.15.133:6825/2323107912]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2023-05-08T03:39:44.337 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:44 smithi133 ceph-mon[125939]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2023-05-08T03:39:44.337 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:44 smithi133 ceph-mon[125939]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-05-08T03:39:44.337 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:44 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:39:44.337 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:44 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:39:44.337 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:44 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:39:44.337 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:44 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:39:44.338 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:44 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:39:44.338 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:44 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:39:44.338 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:44 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:39:44.338 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:44 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:39:44.338 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:44 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:39:44.338 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:44 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:39:44.402 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- ceph orch daemon add osd smithi186:vg_nvme/lv_1 2023-05-08T03:39:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:44 smithi186 ceph-mon[126480]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-05-08T03:39:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:44 smithi186 ceph-mon[126480]: osdmap e68: 11 total, 10 up, 11 in 2023-05-08T03:39:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:44 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-05-08T03:39:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:44 smithi186 ceph-mon[126480]: from='osd.10 [v2:172.21.15.133:6824/2323107912,v1:172.21.15.133:6825/2323107912]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2023-05-08T03:39:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:44 smithi186 ceph-mon[126480]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2023-05-08T03:39:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:44 smithi186 ceph-mon[126480]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-05-08T03:39:44.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:44 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:39:44.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:44 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:39:44.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:44 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:39:44.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:44 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:39:44.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:44 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:39:44.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:44 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:39:44.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:44 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:39:44.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:44 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:39:44.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:44 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:39:44.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:44 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:39:44.740 INFO:journalctl@ceph.osd.10.smithi133.stdout:May 08 03:39:44 smithi133 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-10[147571]: 2023-05-08T03:39:44.334+0000 7f966ac3b700 -1 osd.10 0 waiting for initial osdmap 2023-05-08T03:39:44.740 INFO:journalctl@ceph.osd.10.smithi133.stdout:May 08 03:39:44 smithi133 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-10[147571]: 2023-05-08T03:39:44.350+0000 7f966622f700 -1 osd.10 69 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-08T03:39:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:44 smithi096 ceph-mon[124666]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-05-08T03:39:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:44 smithi096 ceph-mon[124666]: osdmap e68: 11 total, 10 up, 11 in 2023-05-08T03:39:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:44 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-05-08T03:39:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:44 smithi096 ceph-mon[124666]: from='osd.10 [v2:172.21.15.133:6824/2323107912,v1:172.21.15.133:6825/2323107912]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2023-05-08T03:39:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:44 smithi096 ceph-mon[124666]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]: dispatch 2023-05-08T03:39:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:44 smithi096 ceph-mon[124666]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-05-08T03:39:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:44 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:39:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:44 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:39:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:44 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:39:44.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:44 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:39:44.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:44 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:39:44.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:44 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:39:44.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:44 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:39:44.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:44 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:39:44.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:44 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:39:44.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:44 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:39:45.045 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.c/config 2023-05-08T03:39:45.546 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:45 smithi186 ceph-mon[126480]: Detected new or changed devices on smithi133 2023-05-08T03:39:45.546 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:45 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi133 to 4292M 2023-05-08T03:39:45.547 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:45 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:39:45.547 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:45 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T03:39:45.547 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:45 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:39:45.547 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:45 smithi186 ceph-mon[126480]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]': finished 2023-05-08T03:39:45.547 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:45 smithi186 ceph-mon[126480]: osdmap e69: 11 total, 10 up, 11 in 2023-05-08T03:39:45.548 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:45 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-05-08T03:39:45.548 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:45 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-05-08T03:39:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:45 smithi133 ceph-mon[125939]: Detected new or changed devices on smithi133 2023-05-08T03:39:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:45 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi133 to 4292M 2023-05-08T03:39:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:45 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:39:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:45 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T03:39:45.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:45 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:39:45.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:45 smithi133 ceph-mon[125939]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]': finished 2023-05-08T03:39:45.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:45 smithi133 ceph-mon[125939]: osdmap e69: 11 total, 10 up, 11 in 2023-05-08T03:39:45.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:45 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-05-08T03:39:45.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:45 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-05-08T03:39:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:45 smithi096 ceph-mon[124666]: Detected new or changed devices on smithi133 2023-05-08T03:39:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:45 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi133 to 4292M 2023-05-08T03:39:45.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:45 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:39:45.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:45 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T03:39:45.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:45 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:39:45.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:45 smithi096 ceph-mon[124666]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]': finished 2023-05-08T03:39:45.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:45 smithi096 ceph-mon[124666]: osdmap e69: 11 total, 10 up, 11 in 2023-05-08T03:39:45.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:45 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-05-08T03:39:45.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:45 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-05-08T03:39:46.270 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:39:46.268+0000 7f38020b6700 1 -- 172.21.15.186:0/2765097644 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f37fc103790 msgr2=0x7f37fc105b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:39:46.271 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:39:46.268+0000 7f38020b6700 1 --2- 172.21.15.186:0/2765097644 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f37fc103790 0x7f37fc105b70 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f37ec009990 tx=0x7f37ec009ca0 comp rx=0 tx=0).stop 2023-05-08T03:39:46.271 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:39:46.268+0000 7f38020b6700 1 -- 172.21.15.186:0/2765097644 shutdown_connections 2023-05-08T03:39:46.271 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:39:46.268+0000 7f38020b6700 1 --2- 172.21.15.186:0/2765097644 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37fc1060b0 0x7f37fc108510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:39:46.271 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:39:46.268+0000 7f38020b6700 1 --2- 172.21.15.186:0/2765097644 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f37fc100e70 0x7f37fc103250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:39:46.271 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:39:46.268+0000 7f38020b6700 1 --2- 172.21.15.186:0/2765097644 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f37fc103790 0x7f37fc105b70 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:39:46.271 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:39:46.268+0000 7f38020b6700 1 -- 172.21.15.186:0/2765097644 >> 172.21.15.186:0/2765097644 conn(0x7f37fc0fa8f0 msgr2=0x7f37fc0fcd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:39:46.271 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:39:46.268+0000 7f38020b6700 1 -- 172.21.15.186:0/2765097644 shutdown_connections 2023-05-08T03:39:46.272 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:39:46.268+0000 7f38020b6700 1 -- 172.21.15.186:0/2765097644 wait complete. 2023-05-08T03:39:46.272 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:39:46.269+0000 7f38020b6700 1 Processor -- start 2023-05-08T03:39:46.273 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:39:46.269+0000 7f38020b6700 1 -- start start 2023-05-08T03:39:46.273 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:39:46.269+0000 7f38020b6700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f37fc100e70 0x7f37fc196190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:39:46.273 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:39:46.269+0000 7f38020b6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f37fc103790 0x7f37fc1966d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:39:46.274 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:39:46.269+0000 7f38020b6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37fc1060b0 0x7f37fc19d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:39:46.274 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:39:46.269+0000 7f38020b6700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37fc19dd20 con 0x7f37fc1060b0 2023-05-08T03:39:46.274 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:39:46.269+0000 7f38020b6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37fc19de60 con 0x7f37fc103790 2023-05-08T03:39:46.274 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:39:46.269+0000 7f38020b6700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37fc19dff0 con 0x7f37fc100e70 2023-05-08T03:39:46.274 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:39:46.269+0000 7f37fb7fe700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f37fc100e70 0x7f37fc196190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:39:46.274 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:39:46.269+0000 7f37fb7fe700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f37fc100e70 0x7f37fc196190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.186:52884/0 (socket says 172.21.15.186:52884) 2023-05-08T03:39:46.274 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:39:46.269+0000 7f37fb7fe700 1 -- 172.21.15.186:0/4093340129 learned_addr learned my addr 172.21.15.186:0/4093340129 (peer_addr_for_me v2:172.21.15.186:0/0) 2023-05-08T03:39:46.274 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:39:46.269+0000 7f37fbfff700 1 --2- 172.21.15.186:0/4093340129 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37fc1060b0 0x7f37fc19d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:39:46.275 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:39:46.270+0000 7f37faffd700 1 --2- 172.21.15.186:0/4093340129 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f37fc103790 0x7f37fc1966d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:39:46.275 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:39:46.270+0000 7f37fb7fe700 1 -- 172.21.15.186:0/4093340129 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f37fc103790 msgr2=0x7f37fc1966d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:39:46.275 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:39:46.270+0000 7f37fb7fe700 1 --2- 172.21.15.186:0/4093340129 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f37fc103790 0x7f37fc1966d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:39:46.275 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:39:46.270+0000 7f37fb7fe700 1 -- 172.21.15.186:0/4093340129 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37fc1060b0 msgr2=0x7f37fc19d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:39:46.275 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:39:46.270+0000 7f37fb7fe700 1 --2- 172.21.15.186:0/4093340129 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37fc1060b0 0x7f37fc19d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:39:46.275 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:39:46.270+0000 7f37fb7fe700 1 -- 172.21.15.186:0/4093340129 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37ec0095f0 con 0x7f37fc100e70 2023-05-08T03:39:46.275 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:39:46.270+0000 7f37fbfff700 1 --2- 172.21.15.186:0/4093340129 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37fc1060b0 0x7f37fc19d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-08T03:39:46.276 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:39:46.270+0000 7f37faffd700 1 --2- 172.21.15.186:0/4093340129 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f37fc103790 0x7f37fc1966d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-08T03:39:46.276 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:39:46.270+0000 7f37fb7fe700 1 --2- 172.21.15.186:0/4093340129 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f37fc100e70 0x7f37fc196190 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f37e400d980 tx=0x7f37e400dd40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:39:46.276 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:39:46.270+0000 7f37f8ff9700 1 -- 172.21.15.186:0/4093340129 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e4009b40 con 0x7f37fc100e70 2023-05-08T03:39:46.276 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:39:46.270+0000 7f37f8ff9700 1 -- 172.21.15.186:0/4093340129 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f37e400b6e0 con 0x7f37fc100e70 2023-05-08T03:39:46.276 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:39:46.270+0000 7f38020b6700 1 -- 172.21.15.186:0/4093340129 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37fc10bdb0 con 0x7f37fc100e70 2023-05-08T03:39:46.276 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:39:46.270+0000 7f37f8ff9700 1 -- 172.21.15.186:0/4093340129 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e400f620 con 0x7f37fc100e70 2023-05-08T03:39:46.276 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:39:46.270+0000 7f38020b6700 1 -- 172.21.15.186:0/4093340129 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37fc10bc20 con 0x7f37fc100e70 2023-05-08T03:39:46.276 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:39:46.271+0000 7f38020b6700 1 -- 172.21.15.186:0/4093340129 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37fc0fc460 con 0x7f37fc100e70 2023-05-08T03:39:46.277 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:39:46.272+0000 7f37f8ff9700 1 -- 172.21.15.186:0/4093340129 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f37e4010460 con 0x7f37fc100e70 2023-05-08T03:39:46.277 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:39:46.273+0000 7f37f8ff9700 1 --2- 172.21.15.186:0/4093340129 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f37e80a11d0 0x7f37e80a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:39:46.278 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:39:46.273+0000 7f37f8ff9700 1 -- 172.21.15.186:0/4093340129 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6727+0+0 (secure 0 0 0) 0x7f37e40cc1f0 con 0x7f37fc100e70 2023-05-08T03:39:46.278 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:39:46.273+0000 7f37faffd700 1 --2- 172.21.15.186:0/4093340129 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f37e80a11d0 0x7f37e80a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:39:46.278 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:39:46.273+0000 7f37faffd700 1 --2- 172.21.15.186:0/4093340129 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f37e80a11d0 0x7f37e80a3680 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f37ec0095c0 tx=0x7f37ec009510 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:39:46.278 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:39:46.276+0000 7f37f8ff9700 1 -- 172.21.15.186:0/4093340129 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f37e4095ed0 con 0x7f37fc100e70 2023-05-08T03:39:46.475 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:39:46.473+0000 7f38020b6700 1 -- 172.21.15.186:0/4093340129 --> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f37fc061d80 con 0x7f37e80a11d0 2023-05-08T03:39:46.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:46 smithi186 ceph-mon[126480]: purged_snaps scrub starts 2023-05-08T03:39:46.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:46 smithi186 ceph-mon[126480]: purged_snaps scrub ok 2023-05-08T03:39:46.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:46 smithi186 ceph-mon[126480]: osd.10 [v2:172.21.15.133:6824/2323107912,v1:172.21.15.133:6825/2323107912] boot 2023-05-08T03:39:46.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:46 smithi186 ceph-mon[126480]: osdmap e70: 11 total, 11 up, 11 in 2023-05-08T03:39:46.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:46 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-05-08T03:39:46.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:46 smithi186 ceph-mon[126480]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-05-08T03:39:46.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:46 smithi186 ceph-mon[126480]: osdmap e71: 11 total, 11 up, 11 in 2023-05-08T03:39:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:46 smithi133 ceph-mon[125939]: purged_snaps scrub starts 2023-05-08T03:39:46.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:46 smithi133 ceph-mon[125939]: purged_snaps scrub ok 2023-05-08T03:39:46.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:46 smithi133 ceph-mon[125939]: osd.10 [v2:172.21.15.133:6824/2323107912,v1:172.21.15.133:6825/2323107912] boot 2023-05-08T03:39:46.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:46 smithi133 ceph-mon[125939]: osdmap e70: 11 total, 11 up, 11 in 2023-05-08T03:39:46.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:46 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-05-08T03:39:46.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:46 smithi133 ceph-mon[125939]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-05-08T03:39:46.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:46 smithi133 ceph-mon[125939]: osdmap e71: 11 total, 11 up, 11 in 2023-05-08T03:39:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:46 smithi096 ceph-mon[124666]: purged_snaps scrub starts 2023-05-08T03:39:46.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:46 smithi096 ceph-mon[124666]: purged_snaps scrub ok 2023-05-08T03:39:46.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:46 smithi096 ceph-mon[124666]: osd.10 [v2:172.21.15.133:6824/2323107912,v1:172.21.15.133:6825/2323107912] boot 2023-05-08T03:39:46.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:46 smithi096 ceph-mon[124666]: osdmap e70: 11 total, 11 up, 11 in 2023-05-08T03:39:46.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:46 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-05-08T03:39:46.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:46 smithi096 ceph-mon[124666]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-05-08T03:39:46.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:46 smithi096 ceph-mon[124666]: osdmap e71: 11 total, 11 up, 11 in 2023-05-08T03:39:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:47 smithi186 ceph-mon[126480]: from='client.24364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:39:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:47 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-05-08T03:39:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:47 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-05-08T03:39:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:47 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:39:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:47 smithi186 ceph-mon[126480]: osdmap e72: 11 total, 11 up, 11 in 2023-05-08T03:39:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:47 smithi133 ceph-mon[125939]: from='client.24364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:39:47.797 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:47 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-05-08T03:39:47.797 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:47 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-05-08T03:39:47.797 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:47 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:39:47.797 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:47 smithi133 ceph-mon[125939]: osdmap e72: 11 total, 11 up, 11 in 2023-05-08T03:39:47.798 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:47 smithi096 ceph-mon[124666]: from='client.24364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:39:47.798 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:47 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-05-08T03:39:47.798 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:47 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-05-08T03:39:47.798 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:47 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:39:47.799 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:47 smithi096 ceph-mon[124666]: osdmap e72: 11 total, 11 up, 11 in 2023-05-08T03:39:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:48 smithi186 ceph-mon[126480]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail 2023-05-08T03:39:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:48 smithi133 ceph-mon[125939]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail 2023-05-08T03:39:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:48 smithi096 ceph-mon[124666]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail 2023-05-08T03:39:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:49 smithi186 ceph-mon[126480]: osdmap e73: 11 total, 11 up, 11 in 2023-05-08T03:39:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:49 smithi186 ceph-mon[126480]: from='client.? 172.21.15.186:0/1979631938' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "03c0bb25-2921-446b-960e-6a7a328d36a0"}]: dispatch 2023-05-08T03:39:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:49 smithi186 ceph-mon[126480]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "03c0bb25-2921-446b-960e-6a7a328d36a0"}]: dispatch 2023-05-08T03:39:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:49 smithi186 ceph-mon[126480]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "03c0bb25-2921-446b-960e-6a7a328d36a0"}]': finished 2023-05-08T03:39:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:49 smithi186 ceph-mon[126480]: osdmap e74: 12 total, 11 up, 12 in 2023-05-08T03:39:49.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:49 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-05-08T03:39:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:49 smithi133 ceph-mon[125939]: osdmap e73: 11 total, 11 up, 11 in 2023-05-08T03:39:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:49 smithi133 ceph-mon[125939]: from='client.? 172.21.15.186:0/1979631938' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "03c0bb25-2921-446b-960e-6a7a328d36a0"}]: dispatch 2023-05-08T03:39:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:49 smithi133 ceph-mon[125939]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "03c0bb25-2921-446b-960e-6a7a328d36a0"}]: dispatch 2023-05-08T03:39:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:49 smithi133 ceph-mon[125939]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "03c0bb25-2921-446b-960e-6a7a328d36a0"}]': finished 2023-05-08T03:39:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:49 smithi133 ceph-mon[125939]: osdmap e74: 12 total, 11 up, 12 in 2023-05-08T03:39:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:49 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-05-08T03:39:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:49 smithi096 ceph-mon[124666]: osdmap e73: 11 total, 11 up, 11 in 2023-05-08T03:39:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:49 smithi096 ceph-mon[124666]: from='client.? 172.21.15.186:0/1979631938' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "03c0bb25-2921-446b-960e-6a7a328d36a0"}]: dispatch 2023-05-08T03:39:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:49 smithi096 ceph-mon[124666]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "03c0bb25-2921-446b-960e-6a7a328d36a0"}]: dispatch 2023-05-08T03:39:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:49 smithi096 ceph-mon[124666]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "03c0bb25-2921-446b-960e-6a7a328d36a0"}]': finished 2023-05-08T03:39:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:49 smithi096 ceph-mon[124666]: osdmap e74: 12 total, 11 up, 12 in 2023-05-08T03:39:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:49 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-05-08T03:39:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:50 smithi186 ceph-mon[126480]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-05-08T03:39:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:50 smithi186 ceph-mon[126480]: from='client.? 172.21.15.186:0/3450606784' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-05-08T03:39:50.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:50 smithi133 ceph-mon[125939]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-05-08T03:39:50.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:50 smithi133 ceph-mon[125939]: from='client.? 172.21.15.186:0/3450606784' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-05-08T03:39:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:50 smithi096 ceph-mon[124666]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-05-08T03:39:50.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:50 smithi096 ceph-mon[124666]: from='client.? 172.21.15.186:0/3450606784' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-05-08T03:39:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:52 smithi186 ceph-mon[126480]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 68 MiB used, 983 GiB / 983 GiB avail; 111 KiB/s, 0 objects/s recovering 2023-05-08T03:39:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:52 smithi133 ceph-mon[125939]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 68 MiB used, 983 GiB / 983 GiB avail; 111 KiB/s, 0 objects/s recovering 2023-05-08T03:39:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:52 smithi096 ceph-mon[124666]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 68 MiB used, 983 GiB / 983 GiB avail; 111 KiB/s, 0 objects/s recovering 2023-05-08T03:39:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:54 smithi186 ceph-mon[126480]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 68 MiB used, 983 GiB / 983 GiB avail; 93 KiB/s, 0 objects/s recovering 2023-05-08T03:39:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:54 smithi133 ceph-mon[125939]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 68 MiB used, 983 GiB / 983 GiB avail; 93 KiB/s, 0 objects/s recovering 2023-05-08T03:39:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:54 smithi096 ceph-mon[124666]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 68 MiB used, 983 GiB / 983 GiB avail; 93 KiB/s, 0 objects/s recovering 2023-05-08T03:39:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:56 smithi186 ceph-mon[126480]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 68 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-05-08T03:39:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:56 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-05-08T03:39:56.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:56 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:39:56.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:56 smithi133 ceph-mon[125939]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 68 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-05-08T03:39:56.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:56 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-05-08T03:39:56.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:56 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:39:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:56 smithi096 ceph-mon[124666]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 68 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-05-08T03:39:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:56 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-05-08T03:39:57.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:56 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:39:57.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:57 smithi186 ceph-mon[126480]: Deploying daemon osd.11 on smithi186 2023-05-08T03:39:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:57 smithi133 ceph-mon[125939]: Deploying daemon osd.11 on smithi186 2023-05-08T03:39:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:57 smithi096 ceph-mon[124666]: Deploying daemon osd.11 on smithi186 2023-05-08T03:39:58.718 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:39:58 smithi186 ceph-mon[126480]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 68 MiB used, 983 GiB / 983 GiB avail; 63 KiB/s, 0 objects/s recovering 2023-05-08T03:39:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:39:58 smithi133 ceph-mon[125939]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 68 MiB used, 983 GiB / 983 GiB avail; 63 KiB/s, 0 objects/s recovering 2023-05-08T03:39:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:39:58 smithi096 ceph-mon[124666]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 68 MiB used, 983 GiB / 983 GiB avail; 63 KiB/s, 0 objects/s recovering 2023-05-08T03:40:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:00 smithi186 ceph-mon[126480]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 68 MiB used, 983 GiB / 983 GiB avail; 55 KiB/s, 0 objects/s recovering 2023-05-08T03:40:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:00 smithi186 ceph-mon[126480]: overall HEALTH_OK 2023-05-08T03:40:00.945 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:00 smithi096 ceph-mon[124666]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 68 MiB used, 983 GiB / 983 GiB avail; 55 KiB/s, 0 objects/s recovering 2023-05-08T03:40:00.946 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:00 smithi096 ceph-mon[124666]: overall HEALTH_OK 2023-05-08T03:40:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:00 smithi133 ceph-mon[125939]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 68 MiB used, 983 GiB / 983 GiB avail; 55 KiB/s, 0 objects/s recovering 2023-05-08T03:40:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:00 smithi133 ceph-mon[125939]: overall HEALTH_OK 2023-05-08T03:40:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:01 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:01 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:01 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:40:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:01 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:01 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:01 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:40:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:01 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:01 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:01 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:40:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:02 smithi186 ceph-mon[126480]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 68 MiB used, 983 GiB / 983 GiB avail 2023-05-08T03:40:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:02 smithi133 ceph-mon[125939]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 68 MiB used, 983 GiB / 983 GiB avail 2023-05-08T03:40:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:02 smithi096 ceph-mon[124666]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 68 MiB used, 983 GiB / 983 GiB avail 2023-05-08T03:40:03.588 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:40:03.586+0000 7f37f8ff9700 1 -- 172.21.15.186:0/4093340129 <== mgr.14152 v2:172.21.15.96:6800/2748629182 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7f37fc061d80 con 0x7f37e80a11d0 2023-05-08T03:40:03.589 INFO:teuthology.orchestra.run.smithi186.stdout:Created osd(s) 11 on host 'smithi186' 2023-05-08T03:40:03.591 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:40:03.589+0000 7f38020b6700 1 -- 172.21.15.186:0/4093340129 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f37e80a11d0 msgr2=0x7f37e80a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:03.591 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:40:03.589+0000 7f38020b6700 1 --2- 172.21.15.186:0/4093340129 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f37e80a11d0 0x7f37e80a3680 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f37ec0095c0 tx=0x7f37ec009510 comp rx=0 tx=0).stop 2023-05-08T03:40:03.591 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:40:03.589+0000 7f38020b6700 1 -- 172.21.15.186:0/4093340129 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f37fc100e70 msgr2=0x7f37fc196190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:03.591 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:40:03.589+0000 7f38020b6700 1 --2- 172.21.15.186:0/4093340129 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f37fc100e70 0x7f37fc196190 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f37e400d980 tx=0x7f37e400dd40 comp rx=0 tx=0).stop 2023-05-08T03:40:03.591 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:40:03.589+0000 7f38020b6700 1 -- 172.21.15.186:0/4093340129 shutdown_connections 2023-05-08T03:40:03.591 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:40:03.589+0000 7f38020b6700 1 --2- 172.21.15.186:0/4093340129 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f37e80a11d0 0x7f37e80a3680 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:03.592 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:40:03.589+0000 7f38020b6700 1 --2- 172.21.15.186:0/4093340129 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37fc1060b0 0x7f37fc19d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:03.592 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:40:03.589+0000 7f38020b6700 1 --2- 172.21.15.186:0/4093340129 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f37fc100e70 0x7f37fc196190 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:03.592 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:40:03.589+0000 7f38020b6700 1 --2- 172.21.15.186:0/4093340129 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f37fc103790 0x7f37fc1966d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:03.592 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:40:03.589+0000 7f38020b6700 1 -- 172.21.15.186:0/4093340129 >> 172.21.15.186:0/4093340129 conn(0x7f37fc0fa8f0 msgr2=0x7f37fc101ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:03.592 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:40:03.589+0000 7f38020b6700 1 -- 172.21.15.186:0/4093340129 shutdown_connections 2023-05-08T03:40:03.592 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:40:03.589+0000 7f38020b6700 1 -- 172.21.15.186:0/4093340129 wait complete. 2023-05-08T03:40:04.139 DEBUG:teuthology.orchestra.run.smithi186:osd.11> sudo journalctl -f -n 0 -u ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c@osd.11.service 2023-05-08T03:40:04.142 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2023-05-08T03:40:04.142 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- ceph osd stat -f json 2023-05-08T03:40:04.171 INFO:journalctl@ceph.osd.11.smithi186.stdout:-- Logs begin at Mon 2023-05-08 03:08:31 UTC. -- 2023-05-08T03:40:04.795 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.a/config 2023-05-08T03:40:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:04 smithi186 ceph-mon[126480]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 68 MiB used, 983 GiB / 983 GiB avail 2023-05-08T03:40:04.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:04 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:04.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:04 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:04.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:04 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:04.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:04 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:04.870 INFO:journalctl@ceph.osd.11.smithi186.stdout:May 08 03:40:04 smithi186 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-11[148894]: 2023-05-08T03:40:04.580+0000 7f82579bf640 -1 osd.11 0 log_to_monitors true 2023-05-08T03:40:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:04 smithi133 ceph-mon[125939]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 68 MiB used, 983 GiB / 983 GiB avail 2023-05-08T03:40:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:04 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:04 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:04 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:04 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:04 smithi096 ceph-mon[124666]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 68 MiB used, 983 GiB / 983 GiB avail 2023-05-08T03:40:05.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:04 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:05.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:04 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:05.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:04 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:05.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:04 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:05 smithi096 ceph-mon[124666]: from='osd.11 [v2:172.21.15.186:6824/3853499290,v1:172.21.15.186:6825/3853499290]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-05-08T03:40:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:05 smithi096 ceph-mon[124666]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-05-08T03:40:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:05 smithi186 ceph-mon[126480]: from='osd.11 [v2:172.21.15.186:6824/3853499290,v1:172.21.15.186:6825/3853499290]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-05-08T03:40:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:05 smithi186 ceph-mon[126480]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-05-08T03:40:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:05 smithi133 ceph-mon[125939]: from='osd.11 [v2:172.21.15.186:6824/3853499290,v1:172.21.15.186:6825/3853499290]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-05-08T03:40:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:05 smithi133 ceph-mon[125939]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-05-08T03:40:06.071 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:06.066+0000 7f4a7d43f700 1 -- 172.21.15.96:0/1120079295 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a780feab0 msgr2=0x7f4a780feec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:06.071 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:06.066+0000 7f4a7d43f700 1 --2- 172.21.15.96:0/1120079295 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a780feab0 0x7f4a780feec0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4a68009990 tx=0x7f4a68009ca0 comp rx=0 tx=0).stop 2023-05-08T03:40:06.071 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:06.067+0000 7f4a7d43f700 1 -- 172.21.15.96:0/1120079295 shutdown_connections 2023-05-08T03:40:06.072 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:06.067+0000 7f4a7d43f700 1 --2- 172.21.15.96:0/1120079295 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4a78100640 0x7f4a78106f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:06.072 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:06.067+0000 7f4a7d43f700 1 --2- 172.21.15.96:0/1120079295 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a780feab0 0x7f4a780feec0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:06.072 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:06.067+0000 7f4a7d43f700 1 --2- 172.21.15.96:0/1120079295 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a780ffcb0 0x7f4a78100100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:06.072 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:06.067+0000 7f4a7d43f700 1 -- 172.21.15.96:0/1120079295 >> 172.21.15.96:0/1120079295 conn(0x7f4a780fa100 msgr2=0x7f4a780fc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:06.072 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:06.067+0000 7f4a7d43f700 1 -- 172.21.15.96:0/1120079295 shutdown_connections 2023-05-08T03:40:06.072 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:06.067+0000 7f4a7d43f700 1 -- 172.21.15.96:0/1120079295 wait complete. 2023-05-08T03:40:06.072 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:06.067+0000 7f4a7d43f700 1 Processor -- start 2023-05-08T03:40:06.073 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:06.067+0000 7f4a7d43f700 1 -- start start 2023-05-08T03:40:06.073 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:06.068+0000 7f4a7d43f700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4a780feab0 0x7f4a78198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:06.073 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:06.068+0000 7f4a7d43f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a780ffcb0 0x7f4a78198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:06.073 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:06.068+0000 7f4a7d43f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a78100640 0x7f4a7819f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:06.073 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:06.068+0000 7f4a7d43f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7819fec0 con 0x7f4a780ffcb0 2023-05-08T03:40:06.073 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:06.068+0000 7f4a7d43f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a781a0000 con 0x7f4a78100640 2023-05-08T03:40:06.073 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:06.068+0000 7f4a7d43f700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a781a0190 con 0x7f4a780feab0 2023-05-08T03:40:06.073 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:06.068+0000 7f4a767fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a780ffcb0 0x7f4a78198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:06.074 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:06.068+0000 7f4a767fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a780ffcb0 0x7f4a78198870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40044/0 (socket says 172.21.15.96:40044) 2023-05-08T03:40:06.075 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:06.068+0000 7f4a767fc700 1 -- 172.21.15.96:0/756016794 learned_addr learned my addr 172.21.15.96:0/756016794 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:40:06.075 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:06.068+0000 7f4a777fe700 1 --2- 172.21.15.96:0/756016794 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a78100640 0x7f4a7819f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:06.075 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:06.068+0000 7f4a76ffd700 1 --2- 172.21.15.96:0/756016794 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4a780feab0 0x7f4a78198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:06.075 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:06.068+0000 7f4a767fc700 1 -- 172.21.15.96:0/756016794 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4a780feab0 msgr2=0x7f4a78198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:06.076 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:06.068+0000 7f4a767fc700 1 --2- 172.21.15.96:0/756016794 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4a780feab0 0x7f4a78198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:06.076 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:06.068+0000 7f4a767fc700 1 -- 172.21.15.96:0/756016794 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a78100640 msgr2=0x7f4a7819f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:06.076 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:06.068+0000 7f4a767fc700 1 --2- 172.21.15.96:0/756016794 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a78100640 0x7f4a7819f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:06.076 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:06.068+0000 7f4a767fc700 1 -- 172.21.15.96:0/756016794 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a680095f0 con 0x7f4a780ffcb0 2023-05-08T03:40:06.076 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:06.068+0000 7f4a767fc700 1 --2- 172.21.15.96:0/756016794 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a780ffcb0 0x7f4a78198870 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c00d9b0 tx=0x7f4a6c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:06.076 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:06.068+0000 7f4a5ffff700 1 -- 172.21.15.96:0/756016794 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c004220 con 0x7f4a780ffcb0 2023-05-08T03:40:06.076 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:06.068+0000 7f4a7d43f700 1 -- 172.21.15.96:0/756016794 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a7810aca0 con 0x7f4a780ffcb0 2023-05-08T03:40:06.077 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:06.068+0000 7f4a5ffff700 1 -- 172.21.15.96:0/756016794 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4a6c007640 con 0x7f4a780ffcb0 2023-05-08T03:40:06.077 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:06.068+0000 7f4a5ffff700 1 -- 172.21.15.96:0/756016794 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c005650 con 0x7f4a780ffcb0 2023-05-08T03:40:06.077 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:06.068+0000 7f4a7d43f700 1 -- 172.21.15.96:0/756016794 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a7810ab10 con 0x7f4a780ffcb0 2023-05-08T03:40:06.078 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:06.069+0000 7f4a7d43f700 1 -- 172.21.15.96:0/756016794 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a781a08c0 con 0x7f4a780ffcb0 2023-05-08T03:40:06.078 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:06.071+0000 7f4a5ffff700 1 -- 172.21.15.96:0/756016794 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f4a6c004750 con 0x7f4a780ffcb0 2023-05-08T03:40:06.078 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:06.071+0000 7f4a5ffff700 1 --2- 172.21.15.96:0/756016794 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f4a600a1150 0x7f4a600a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:06.078 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:06.072+0000 7f4a76ffd700 1 --2- 172.21.15.96:0/756016794 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f4a600a1150 0x7f4a600a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:06.078 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:06.072+0000 7f4a5ffff700 1 -- 172.21.15.96:0/756016794 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6831+0+0 (secure 0 0 0) 0x7f4a6c0cc7e0 con 0x7f4a780ffcb0 2023-05-08T03:40:06.079 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:06.072+0000 7f4a76ffd700 1 --2- 172.21.15.96:0/756016794 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f4a600a1150 0x7f4a600a3600 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4a68006010 tx=0x7f4a6800b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:06.079 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:06.075+0000 7f4a5ffff700 1 -- 172.21.15.96:0/756016794 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f4a6c096460 con 0x7f4a780ffcb0 2023-05-08T03:40:06.267 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:06.264+0000 7f4a7d43f700 1 -- 172.21.15.96:0/756016794 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f4a781a0e70 con 0x7f4a780ffcb0 2023-05-08T03:40:06.267 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:06.265+0000 7f4a5ffff700 1 -- 172.21.15.96:0/756016794 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v75) v1 ==== 74+0+133 (secure 0 0 0) 0x7f4a6c0160a0 con 0x7f4a780ffcb0 2023-05-08T03:40:06.267 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:40:06.269 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:06.267+0000 7f4a7d43f700 1 -- 172.21.15.96:0/756016794 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f4a600a1150 msgr2=0x7f4a600a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:06.269 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:06.267+0000 7f4a7d43f700 1 --2- 172.21.15.96:0/756016794 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f4a600a1150 0x7f4a600a3600 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4a68006010 tx=0x7f4a6800b260 comp rx=0 tx=0).stop 2023-05-08T03:40:06.269 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:06.267+0000 7f4a7d43f700 1 -- 172.21.15.96:0/756016794 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a780ffcb0 msgr2=0x7f4a78198870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:06.270 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:06.267+0000 7f4a7d43f700 1 --2- 172.21.15.96:0/756016794 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a780ffcb0 0x7f4a78198870 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c00d9b0 tx=0x7f4a6c00dcc0 comp rx=0 tx=0).stop 2023-05-08T03:40:06.270 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:06.267+0000 7f4a7d43f700 1 -- 172.21.15.96:0/756016794 shutdown_connections 2023-05-08T03:40:06.270 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:06.267+0000 7f4a7d43f700 1 --2- 172.21.15.96:0/756016794 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f4a600a1150 0x7f4a600a3600 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:06.270 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:06.267+0000 7f4a7d43f700 1 --2- 172.21.15.96:0/756016794 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a78100640 0x7f4a7819f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:06.270 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:06.267+0000 7f4a7d43f700 1 --2- 172.21.15.96:0/756016794 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4a780feab0 0x7f4a78198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:06.270 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:06.267+0000 7f4a7d43f700 1 --2- 172.21.15.96:0/756016794 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a780ffcb0 0x7f4a78198870 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:06.270 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:06.267+0000 7f4a7d43f700 1 -- 172.21.15.96:0/756016794 >> 172.21.15.96:0/756016794 conn(0x7f4a780fa100 msgr2=0x7f4a78107850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:06.270 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:06.267+0000 7f4a7d43f700 1 -- 172.21.15.96:0/756016794 shutdown_connections 2023-05-08T03:40:06.271 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:06.267+0000 7f4a7d43f700 1 -- 172.21.15.96:0/756016794 wait complete. 2023-05-08T03:40:06.574 INFO:journalctl@ceph.osd.11.smithi186.stdout:May 08 03:40:06 smithi186 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-11[148894]: 2023-05-08T03:40:06.554+0000 7f824c835700 -1 osd.11 0 waiting for initial osdmap 2023-05-08T03:40:06.574 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:06 smithi186 ceph-mon[126480]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 68 MiB used, 983 GiB / 983 GiB avail 2023-05-08T03:40:06.574 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:06 smithi186 ceph-mon[126480]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-05-08T03:40:06.574 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:06 smithi186 ceph-mon[126480]: osdmap e75: 12 total, 11 up, 12 in 2023-05-08T03:40:06.575 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:06 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-05-08T03:40:06.575 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:06 smithi186 ceph-mon[126480]: from='osd.11 [v2:172.21.15.186:6824/3853499290,v1:172.21.15.186:6825/3853499290]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2023-05-08T03:40:06.575 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:06 smithi186 ceph-mon[126480]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2023-05-08T03:40:06.575 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:06 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/756016794' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-05-08T03:40:06.575 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:06 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:06.575 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:06 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:06.575 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:06 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:40:06.576 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:06 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:40:06.576 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:06 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:40:06.576 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:06 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:40:06.576 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:06 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:06.576 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:06 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:40:06.576 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:06 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:40:06.576 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:06 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:06.577 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:06 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:40:06.577 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:06 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:40:06.577 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:06 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:40:06.577 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:06 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:06.636 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":75,"num_osds":12,"num_up_osds":11,"osd_up_since":1683517185,"num_in_osds":12,"osd_in_since":1683517189,"num_remapped_pgs":0} 2023-05-08T03:40:06.869 INFO:journalctl@ceph.osd.11.smithi186.stdout:May 08 03:40:06 smithi186 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-11[148894]: 2023-05-08T03:40:06.571+0000 7f8247e29700 -1 osd.11 76 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-08T03:40:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:06 smithi133 ceph-mon[125939]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 68 MiB used, 983 GiB / 983 GiB avail 2023-05-08T03:40:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:06 smithi133 ceph-mon[125939]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-05-08T03:40:06.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:06 smithi133 ceph-mon[125939]: osdmap e75: 12 total, 11 up, 12 in 2023-05-08T03:40:06.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:06 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-05-08T03:40:06.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:06 smithi133 ceph-mon[125939]: from='osd.11 [v2:172.21.15.186:6824/3853499290,v1:172.21.15.186:6825/3853499290]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2023-05-08T03:40:06.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:06 smithi133 ceph-mon[125939]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2023-05-08T03:40:06.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:06 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/756016794' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-05-08T03:40:06.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:06 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:06.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:06 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:06.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:06 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:40:06.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:06 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:40:06.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:06 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:40:06.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:06 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:40:06.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:06 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:06.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:06 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:40:06.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:06 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:40:06.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:06 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:06.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:06 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:40:06.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:06 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:40:06.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:06 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:40:06.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:06 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:06 smithi096 ceph-mon[124666]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 68 MiB used, 983 GiB / 983 GiB avail 2023-05-08T03:40:07.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:06 smithi096 ceph-mon[124666]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-05-08T03:40:07.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:06 smithi096 ceph-mon[124666]: osdmap e75: 12 total, 11 up, 12 in 2023-05-08T03:40:07.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:06 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-05-08T03:40:07.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:06 smithi096 ceph-mon[124666]: from='osd.11 [v2:172.21.15.186:6824/3853499290,v1:172.21.15.186:6825/3853499290]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2023-05-08T03:40:07.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:06 smithi096 ceph-mon[124666]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2023-05-08T03:40:07.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:06 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/756016794' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-05-08T03:40:07.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:06 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:07.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:06 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:07.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:06 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:40:07.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:06 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:40:07.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:06 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:40:07.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:06 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:40:07.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:06 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:07.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:06 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:40:07.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:06 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:40:07.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:06 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:07.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:06 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:40:07.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:06 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:40:07.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:06 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:40:07.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:06 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:07.637 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- ceph osd stat -f json 2023-05-08T03:40:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:07 smithi186 ceph-mon[126480]: Detected new or changed devices on smithi186 2023-05-08T03:40:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:07 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi186 to 4292M 2023-05-08T03:40:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:07 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:40:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:07 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T03:40:07.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:07 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:40:07.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:07 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:40:07.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:07 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T03:40:07.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:07 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:40:07.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:07 smithi186 ceph-mon[126480]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]': finished 2023-05-08T03:40:07.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:07 smithi186 ceph-mon[126480]: osdmap e76: 12 total, 11 up, 12 in 2023-05-08T03:40:07.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:07 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-05-08T03:40:07.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:07 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-05-08T03:40:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:07 smithi133 ceph-mon[125939]: Detected new or changed devices on smithi186 2023-05-08T03:40:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:07 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi186 to 4292M 2023-05-08T03:40:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:07 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:40:07.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:07 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T03:40:07.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:07 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:40:07.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:07 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:40:07.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:07 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T03:40:07.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:07 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:40:07.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:07 smithi133 ceph-mon[125939]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]': finished 2023-05-08T03:40:07.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:07 smithi133 ceph-mon[125939]: osdmap e76: 12 total, 11 up, 12 in 2023-05-08T03:40:07.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:07 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-05-08T03:40:07.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:07 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-05-08T03:40:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:07 smithi096 ceph-mon[124666]: Detected new or changed devices on smithi186 2023-05-08T03:40:08.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:07 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi186 to 4292M 2023-05-08T03:40:08.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:07 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:40:08.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:07 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T03:40:08.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:07 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:40:08.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:07 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:40:08.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:07 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T03:40:08.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:07 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:40:08.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:07 smithi096 ceph-mon[124666]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]': finished 2023-05-08T03:40:08.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:07 smithi096 ceph-mon[124666]: osdmap e76: 12 total, 11 up, 12 in 2023-05-08T03:40:08.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:07 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-05-08T03:40:08.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:07 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-05-08T03:40:08.287 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.a/config 2023-05-08T03:40:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:08 smithi096 ceph-mon[124666]: purged_snaps scrub starts 2023-05-08T03:40:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:08 smithi096 ceph-mon[124666]: purged_snaps scrub ok 2023-05-08T03:40:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:08 smithi096 ceph-mon[124666]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 68 MiB used, 983 GiB / 983 GiB avail 2023-05-08T03:40:08.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:08 smithi096 ceph-mon[124666]: osd.11 [v2:172.21.15.186:6824/3853499290,v1:172.21.15.186:6825/3853499290] boot 2023-05-08T03:40:08.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:08 smithi096 ceph-mon[124666]: osdmap e77: 12 total, 12 up, 12 in 2023-05-08T03:40:08.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:08 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-05-08T03:40:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:08 smithi186 ceph-mon[126480]: purged_snaps scrub starts 2023-05-08T03:40:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:08 smithi186 ceph-mon[126480]: purged_snaps scrub ok 2023-05-08T03:40:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:08 smithi186 ceph-mon[126480]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 68 MiB used, 983 GiB / 983 GiB avail 2023-05-08T03:40:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:08 smithi186 ceph-mon[126480]: osd.11 [v2:172.21.15.186:6824/3853499290,v1:172.21.15.186:6825/3853499290] boot 2023-05-08T03:40:08.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:08 smithi186 ceph-mon[126480]: osdmap e77: 12 total, 12 up, 12 in 2023-05-08T03:40:08.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:08 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-05-08T03:40:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:08 smithi133 ceph-mon[125939]: purged_snaps scrub starts 2023-05-08T03:40:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:08 smithi133 ceph-mon[125939]: purged_snaps scrub ok 2023-05-08T03:40:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:08 smithi133 ceph-mon[125939]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 68 MiB used, 983 GiB / 983 GiB avail 2023-05-08T03:40:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:08 smithi133 ceph-mon[125939]: osd.11 [v2:172.21.15.186:6824/3853499290,v1:172.21.15.186:6825/3853499290] boot 2023-05-08T03:40:08.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:08 smithi133 ceph-mon[125939]: osdmap e77: 12 total, 12 up, 12 in 2023-05-08T03:40:08.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:08 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-05-08T03:40:09.566 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:09.562+0000 7fcb780c0700 1 -- 172.21.15.96:0/2329012055 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb701004e0 msgr2=0x7fcb70100930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:09.566 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:09.562+0000 7fcb780c0700 1 --2- 172.21.15.96:0/2329012055 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb701004e0 0x7fcb70100930 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c009990 tx=0x7fcb6c009ca0 comp rx=0 tx=0).stop 2023-05-08T03:40:09.566 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:09.562+0000 7fcb780c0700 1 -- 172.21.15.96:0/2329012055 shutdown_connections 2023-05-08T03:40:09.566 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:09.562+0000 7fcb780c0700 1 --2- 172.21.15.96:0/2329012055 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb70100e70 0x7fcb70107730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:09.566 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:09.562+0000 7fcb780c0700 1 --2- 172.21.15.96:0/2329012055 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcb700ff2e0 0x7fcb700ff6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:09.567 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:09.562+0000 7fcb780c0700 1 --2- 172.21.15.96:0/2329012055 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb701004e0 0x7fcb70100930 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:09.567 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:09.562+0000 7fcb780c0700 1 -- 172.21.15.96:0/2329012055 >> 172.21.15.96:0/2329012055 conn(0x7fcb700fa8f0 msgr2=0x7fcb700fcd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:09.567 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:09.562+0000 7fcb780c0700 1 -- 172.21.15.96:0/2329012055 shutdown_connections 2023-05-08T03:40:09.567 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:09.562+0000 7fcb780c0700 1 -- 172.21.15.96:0/2329012055 wait complete. 2023-05-08T03:40:09.567 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:09.562+0000 7fcb780c0700 1 Processor -- start 2023-05-08T03:40:09.568 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:09.563+0000 7fcb780c0700 1 -- start start 2023-05-08T03:40:09.568 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:09.563+0000 7fcb780c0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb700ff2e0 0x7fcb70069210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:09.568 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:09.563+0000 7fcb780c0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb701004e0 0x7fcb7019d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:09.568 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:09.563+0000 7fcb780c0700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcb70100e70 0x7fcb7019f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:09.569 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:09.563+0000 7fcb780c0700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7019fe20 con 0x7fcb700ff2e0 2023-05-08T03:40:09.569 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:09.563+0000 7fcb780c0700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7019ff90 con 0x7fcb701004e0 2023-05-08T03:40:09.569 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:09.563+0000 7fcb780c0700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb701a0150 con 0x7fcb70100e70 2023-05-08T03:40:09.570 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:09.563+0000 7fcb75e5c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb700ff2e0 0x7fcb70069210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:09.570 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:09.563+0000 7fcb75e5c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb700ff2e0 0x7fcb70069210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40062/0 (socket says 172.21.15.96:40062) 2023-05-08T03:40:09.570 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:09.563+0000 7fcb75e5c700 1 -- 172.21.15.96:0/4134237161 learned_addr learned my addr 172.21.15.96:0/4134237161 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:40:09.570 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:09.563+0000 7fcb7665d700 1 --2- 172.21.15.96:0/4134237161 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcb70100e70 0x7fcb7019f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:09.571 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:09.563+0000 7fcb7565b700 1 --2- 172.21.15.96:0/4134237161 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb701004e0 0x7fcb7019d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:09.571 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:09.563+0000 7fcb75e5c700 1 -- 172.21.15.96:0/4134237161 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcb70100e70 msgr2=0x7fcb7019f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:09.571 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:09.563+0000 7fcb75e5c700 1 --2- 172.21.15.96:0/4134237161 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcb70100e70 0x7fcb7019f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:09.572 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:09.563+0000 7fcb75e5c700 1 -- 172.21.15.96:0/4134237161 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb701004e0 msgr2=0x7fcb7019d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:09.572 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:09.563+0000 7fcb75e5c700 1 --2- 172.21.15.96:0/4134237161 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb701004e0 0x7fcb7019d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:09.572 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:09.563+0000 7fcb75e5c700 1 -- 172.21.15.96:0/4134237161 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb6c0095f0 con 0x7fcb700ff2e0 2023-05-08T03:40:09.572 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:09.563+0000 7fcb75e5c700 1 --2- 172.21.15.96:0/4134237161 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb700ff2e0 0x7fcb70069210 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fcb6000c990 tx=0x7fcb6000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:09.573 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:09.563+0000 7fcb66ffd700 1 -- 172.21.15.96:0/4134237161 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb60007b00 con 0x7fcb700ff2e0 2023-05-08T03:40:09.573 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:09.564+0000 7fcb780c0700 1 -- 172.21.15.96:0/4134237161 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb7010ac80 con 0x7fcb700ff2e0 2023-05-08T03:40:09.573 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:09.564+0000 7fcb66ffd700 1 -- 172.21.15.96:0/4134237161 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcb60007c60 con 0x7fcb700ff2e0 2023-05-08T03:40:09.575 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:09.564+0000 7fcb66ffd700 1 -- 172.21.15.96:0/4134237161 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb60018660 con 0x7fcb700ff2e0 2023-05-08T03:40:09.575 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:09.564+0000 7fcb780c0700 1 -- 172.21.15.96:0/4134237161 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb7010aaf0 con 0x7fcb700ff2e0 2023-05-08T03:40:09.576 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:09.564+0000 7fcb780c0700 1 -- 172.21.15.96:0/4134237161 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb70106890 con 0x7fcb700ff2e0 2023-05-08T03:40:09.576 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:09.566+0000 7fcb66ffd700 1 -- 172.21.15.96:0/4134237161 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fcb60004020 con 0x7fcb700ff2e0 2023-05-08T03:40:09.576 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:09.567+0000 7fcb66ffd700 1 --2- 172.21.15.96:0/4134237161 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fcb5c0a1150 0x7fcb5c0a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:09.576 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:09.567+0000 7fcb7565b700 1 --2- 172.21.15.96:0/4134237161 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fcb5c0a1150 0x7fcb5c0a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:09.576 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:09.567+0000 7fcb66ffd700 1 -- 172.21.15.96:0/4134237161 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fcb600cc5d0 con 0x7fcb700ff2e0 2023-05-08T03:40:09.577 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:09.567+0000 7fcb7565b700 1 --2- 172.21.15.96:0/4134237161 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fcb5c0a1150 0x7fcb5c0a3600 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c00b5c0 tx=0x7fcb6c005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:09.577 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:09.573+0000 7fcb66ffd700 1 -- 172.21.15.96:0/4134237161 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fcb60096250 con 0x7fcb700ff2e0 2023-05-08T03:40:09.765 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:09.764+0000 7fcb780c0700 1 -- 172.21.15.96:0/4134237161 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7fcb7002d0e0 con 0x7fcb700ff2e0 2023-05-08T03:40:09.766 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:09.764+0000 7fcb66ffd700 1 -- 172.21.15.96:0/4134237161 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v78) v1 ==== 74+0+133 (secure 0 0 0) 0x7fcb60099870 con 0x7fcb700ff2e0 2023-05-08T03:40:09.766 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:40:09.768 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:09.766+0000 7fcb780c0700 1 -- 172.21.15.96:0/4134237161 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fcb5c0a1150 msgr2=0x7fcb5c0a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:09.768 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:09.766+0000 7fcb780c0700 1 --2- 172.21.15.96:0/4134237161 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fcb5c0a1150 0x7fcb5c0a3600 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c00b5c0 tx=0x7fcb6c005fb0 comp rx=0 tx=0).stop 2023-05-08T03:40:09.768 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:09.766+0000 7fcb780c0700 1 -- 172.21.15.96:0/4134237161 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb700ff2e0 msgr2=0x7fcb70069210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:09.768 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:09.766+0000 7fcb780c0700 1 --2- 172.21.15.96:0/4134237161 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb700ff2e0 0x7fcb70069210 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fcb6000c990 tx=0x7fcb6000cd50 comp rx=0 tx=0).stop 2023-05-08T03:40:09.769 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:09.766+0000 7fcb780c0700 1 -- 172.21.15.96:0/4134237161 shutdown_connections 2023-05-08T03:40:09.769 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:09.766+0000 7fcb780c0700 1 --2- 172.21.15.96:0/4134237161 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fcb5c0a1150 0x7fcb5c0a3600 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:09.769 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:09.766+0000 7fcb780c0700 1 --2- 172.21.15.96:0/4134237161 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcb70100e70 0x7fcb7019f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:09.769 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:09.766+0000 7fcb780c0700 1 --2- 172.21.15.96:0/4134237161 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb700ff2e0 0x7fcb70069210 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:09.769 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:09.766+0000 7fcb780c0700 1 --2- 172.21.15.96:0/4134237161 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb701004e0 0x7fcb7019d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:09.769 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:09.766+0000 7fcb780c0700 1 -- 172.21.15.96:0/4134237161 >> 172.21.15.96:0/4134237161 conn(0x7fcb700fa8f0 msgr2=0x7fcb701039d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:09.769 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:09.766+0000 7fcb780c0700 1 -- 172.21.15.96:0/4134237161 shutdown_connections 2023-05-08T03:40:09.770 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:09.766+0000 7fcb780c0700 1 -- 172.21.15.96:0/4134237161 wait complete. 2023-05-08T03:40:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:09 smithi186 ceph-mon[126480]: osdmap e78: 12 total, 12 up, 12 in 2023-05-08T03:40:09.917 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:09 smithi096 ceph-mon[124666]: osdmap e78: 12 total, 12 up, 12 in 2023-05-08T03:40:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:09 smithi133 ceph-mon[125939]: osdmap e78: 12 total, 12 up, 12 in 2023-05-08T03:40:10.229 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":78,"num_osds":12,"num_up_osds":12,"osd_up_since":1683517207,"num_in_osds":12,"osd_in_since":1683517189,"num_remapped_pgs":0} 2023-05-08T03:40:10.230 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- ceph osd dump --format=json 2023-05-08T03:40:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:10 smithi186 ceph-mon[126480]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 74 MiB used, 1.0 TiB / 1.0 TiB avail 2023-05-08T03:40:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:10 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/4134237161' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-05-08T03:40:10.871 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.a/config 2023-05-08T03:40:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:10 smithi133 ceph-mon[125939]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 74 MiB used, 1.0 TiB / 1.0 TiB avail 2023-05-08T03:40:10.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:10 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/4134237161' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-05-08T03:40:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:10 smithi096 ceph-mon[124666]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 74 MiB used, 1.0 TiB / 1.0 TiB avail 2023-05-08T03:40:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:10 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/4134237161' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-05-08T03:40:12.165 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:12.160+0000 7f32a0a8e700 1 -- 172.21.15.96:0/1218891939 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f329c106420 msgr2=0x7f329c1067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:12.165 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:12.160+0000 7f32a0a8e700 1 --2- 172.21.15.96:0/1218891939 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f329c106420 0x7f329c1067f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3284009990 tx=0x7f3284009ca0 comp rx=0 tx=0).stop 2023-05-08T03:40:12.165 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:12.160+0000 7f32a0a8e700 1 -- 172.21.15.96:0/1218891939 shutdown_connections 2023-05-08T03:40:12.165 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:12.160+0000 7f32a0a8e700 1 --2- 172.21.15.96:0/1218891939 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f329c0ff320 0x7f329c10d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:12.166 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:12.160+0000 7f32a0a8e700 1 --2- 172.21.15.96:0/1218891939 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f329c106420 0x7f329c1067f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:12.166 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:12.160+0000 7f32a0a8e700 1 --2- 172.21.15.96:0/1218891939 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f329c0fe970 0x7f329c0fede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:12.166 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:12.160+0000 7f32a0a8e700 1 -- 172.21.15.96:0/1218891939 >> 172.21.15.96:0/1218891939 conn(0x7f329c0759a0 msgr2=0x7f329c075da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:12.166 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:12.160+0000 7f32a0a8e700 1 -- 172.21.15.96:0/1218891939 shutdown_connections 2023-05-08T03:40:12.166 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:12.160+0000 7f32a0a8e700 1 -- 172.21.15.96:0/1218891939 wait complete. 2023-05-08T03:40:12.167 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:12.161+0000 7f32a0a8e700 1 Processor -- start 2023-05-08T03:40:12.167 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:12.161+0000 7f32a0a8e700 1 -- start start 2023-05-08T03:40:12.167 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:12.162+0000 7f32a0a8e700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f329c0fe970 0x7f329c1963f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:12.167 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:12.162+0000 7f32a0a8e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f329c0ff320 0x7f329c196930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:12.167 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:12.162+0000 7f32a0a8e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f329c106420 0x7f329c19ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:12.168 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:12.162+0000 7f32a0a8e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f329c19b3b0 con 0x7f329c0ff320 2023-05-08T03:40:12.168 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:12.162+0000 7f32a0a8e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f329c19b520 con 0x7f329c106420 2023-05-08T03:40:12.168 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:12.162+0000 7f32a0a8e700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f329c19b6e0 con 0x7f329c0fe970 2023-05-08T03:40:12.168 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:12.162+0000 7f3299d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f329c0ff320 0x7f329c196930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:12.168 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:12.162+0000 7f3299d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f329c0ff320 0x7f329c196930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40084/0 (socket says 172.21.15.96:40084) 2023-05-08T03:40:12.168 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:12.162+0000 7f3299d9b700 1 -- 172.21.15.96:0/3721525951 learned_addr learned my addr 172.21.15.96:0/3721525951 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:40:12.169 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:12.162+0000 7f329a59c700 1 --2- 172.21.15.96:0/3721525951 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f329c0fe970 0x7f329c1963f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:12.169 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:12.162+0000 7f329ad9d700 1 --2- 172.21.15.96:0/3721525951 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f329c106420 0x7f329c19ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:12.169 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:12.162+0000 7f3299d9b700 1 -- 172.21.15.96:0/3721525951 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f329c0fe970 msgr2=0x7f329c1963f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:12.170 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:12.162+0000 7f3299d9b700 1 --2- 172.21.15.96:0/3721525951 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f329c0fe970 0x7f329c1963f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:12.170 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:12.162+0000 7f3299d9b700 1 -- 172.21.15.96:0/3721525951 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f329c106420 msgr2=0x7f329c19ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:12.170 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:12.162+0000 7f3299d9b700 1 --2- 172.21.15.96:0/3721525951 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f329c106420 0x7f329c19ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:12.172 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:12.162+0000 7f3299d9b700 1 -- 172.21.15.96:0/3721525951 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32840095f0 con 0x7f329c0ff320 2023-05-08T03:40:12.172 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:12.162+0000 7f3299d9b700 1 --2- 172.21.15.96:0/3721525951 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f329c0ff320 0x7f329c196930 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f328c00c9b0 tx=0x7f328c00ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:12.172 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:12.162+0000 7f32937fe700 1 -- 172.21.15.96:0/3721525951 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f328c007b00 con 0x7f329c0ff320 2023-05-08T03:40:12.172 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:12.162+0000 7f32a0a8e700 1 -- 172.21.15.96:0/3721525951 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f329c110470 con 0x7f329c0ff320 2023-05-08T03:40:12.172 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:12.162+0000 7f32937fe700 1 -- 172.21.15.96:0/3721525951 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f328c00ce50 con 0x7f329c0ff320 2023-05-08T03:40:12.173 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:12.162+0000 7f32937fe700 1 -- 172.21.15.96:0/3721525951 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f328c018660 con 0x7f329c0ff320 2023-05-08T03:40:12.173 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:12.162+0000 7f32a0a8e700 1 -- 172.21.15.96:0/3721525951 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f329c1102e0 con 0x7f329c0ff320 2023-05-08T03:40:12.174 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:12.163+0000 7f32a0a8e700 1 -- 172.21.15.96:0/3721525951 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f329c110600 con 0x7f329c0ff320 2023-05-08T03:40:12.174 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:12.164+0000 7f32937fe700 1 -- 172.21.15.96:0/3721525951 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f328c00f450 con 0x7f329c0ff320 2023-05-08T03:40:12.175 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:12.165+0000 7f32937fe700 1 --2- 172.21.15.96:0/3721525951 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f32880a1150 0x7f32880a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:12.175 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:12.165+0000 7f329a59c700 1 --2- 172.21.15.96:0/3721525951 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f32880a1150 0x7f32880a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:12.175 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:12.165+0000 7f32937fe700 1 -- 172.21.15.96:0/3721525951 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f328c0cc3b0 con 0x7f329c0ff320 2023-05-08T03:40:12.175 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:12.165+0000 7f329a59c700 1 --2- 172.21.15.96:0/3721525951 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f32880a1150 0x7f32880a3600 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f328400b5c0 tx=0x7f3284005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:12.175 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:12.169+0000 7f32937fe700 1 -- 172.21.15.96:0/3721525951 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f328c095fa0 con 0x7f329c0ff320 2023-05-08T03:40:12.362 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:12.359+0000 7f32a0a8e700 1 -- 172.21.15.96:0/3721525951 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f329c1a3530 con 0x7f329c0ff320 2023-05-08T03:40:12.363 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:12.360+0000 7f32937fe700 1 -- 172.21.15.96:0/3721525951 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+18399 (secure 0 0 0) 0x7f328c007e60 con 0x7f329c0ff320 2023-05-08T03:40:12.364 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:40:12.364 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":78,"fsid":"f7ffcfb0-ed50-11ed-9b01-001a4aab830c","created":"2023-05-08T03:33:42.765680+0000","modified":"2023-05-08T03:40:08.557646+0000","last_up_change":"2023-05-08T03:40:07.550882+0000","last_in_change":"2023-05-08T03:39:49.027947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-08T03:36:47.800739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2ee801e1-8eec-496d-a9ac-fc566b38bbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":1816903726},{"type":"v1","addr":"172.21.15.96:6803","nonce":1816903726}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":1816903726},{"type":"v1","addr":"172.21.15.96:6805","nonce":1816903726}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":1816903726},{"type":"v1","addr":"172.21.15.96:6809","nonce":1816903726}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":1816903726},{"type":"v1","addr":"172.21.15.96:6807","nonce":1816903726}]},"public_addr":"172.21.15.96:6803/1816903726","cluster_addr":"172.21.15.96:6805/1816903726","heartbeat_back_addr":"172.21.15.96:6809/1816903726","heartbeat_front_addr":"172.21.15.96:6807/1816903726","state":["exists","up"]},{"osd":1,"uuid":"eb73deea-fc7c-4f2f-8aef-2d71c598afda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":206989126},{"type":"v1","addr":"172.21.15.133:6801","nonce":206989126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":206989126},{"type":"v1","addr":"172.21.15.133:6803","nonce":206989126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":206989126},{"type":"v1","addr":"172.21.15.133:6807","nonce":206989126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":206989126},{"type":"v1","addr":"172.21.15.133:6805","nonce":206989126}]},"public_addr":"172.21.15.133:6801/206989126","cluster_addr":"172.21.15.133:6803/206989126","heartbeat_back_addr":"172.21.15.133:6807/206989126","heartbeat_front_addr":"172.21.15.133:6805/206989126","state":["exists","up"]},{"osd":2,"uuid":"74a2f239-e82d-4d87-9458-5373b6cbbffd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":1791188143},{"type":"v1","addr":"172.21.15.186:6801","nonce":1791188143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":1791188143},{"type":"v1","addr":"172.21.15.186:6803","nonce":1791188143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":1791188143},{"type":"v1","addr":"172.21.15.186:6807","nonce":1791188143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":1791188143},{"type":"v1","addr":"172.21.15.186:6805","nonce":1791188143}]},"public_addr":"172.21.15.186:6801/1791188143","cluster_addr":"172.21.15.186:6803/1791188143","heartbeat_back_addr":"172.21.15.186:6807/1791188143","heartbeat_front_addr":"172.21.15.186:6805/1791188143","state":["exists","up"]},{"osd":3,"uuid":"421eedf5-ba6e-484e-b715-78c1c10d684e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":3430402140},{"type":"v1","addr":"172.21.15.96:6811","nonce":3430402140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":3430402140},{"type":"v1","addr":"172.21.15.96:6813","nonce":3430402140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":3430402140},{"type":"v1","addr":"172.21.15.96:6817","nonce":3430402140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":3430402140},{"type":"v1","addr":"172.21.15.96:6815","nonce":3430402140}]},"public_addr":"172.21.15.96:6811/3430402140","cluster_addr":"172.21.15.96:6813/3430402140","heartbeat_back_addr":"172.21.15.96:6817/3430402140","heartbeat_front_addr":"172.21.15.96:6815/3430402140","state":["exists","up"]},{"osd":4,"uuid":"fb20100b-6a5a-462d-955d-1697a3861e96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":1237495996},{"type":"v1","addr":"172.21.15.133:6809","nonce":1237495996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":1237495996},{"type":"v1","addr":"172.21.15.133:6811","nonce":1237495996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":1237495996},{"type":"v1","addr":"172.21.15.133:6815","nonce":1237495996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":1237495996},{"type":"v1","addr":"172.21.15.133:6813","nonce":1237495996}]},"public_addr":"172.21.15.133:6809/1237495996","cluster_addr":"172.21.15.133:6811/1237495996","heartbeat_back_addr":"172.21.15.133:6815/1237495996","heartbeat_front_addr":"172.21.15.133:6813/1237495996","state":["exists","up"]},{"osd":5,"uuid":"00177913-8bd6-4391-83c3-08c2b1b8ef13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":541111862},{"type":"v1","addr":"172.21.15.186:6809","nonce":541111862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":541111862},{"type":"v1","addr":"172.21.15.186:6811","nonce":541111862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":541111862},{"type":"v1","addr":"172.21.15.186:6815","nonce":541111862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":541111862},{"type":"v1","addr":"172.21.15.186:6813","nonce":541111862}]},"public_addr":"172.21.15.186:6809/541111862","cluster_addr":"172.21.15.186:6811/541111862","heartbeat_back_addr":"172.21.15.186:6815/541111862","heartbeat_front_addr":"172.21.15.186:6813/541111862","state":["exists","up"]},{"osd":6,"uuid":"204baab6-ca6f-4eef-8b9c-91efc04cc30c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":386227948},{"type":"v1","addr":"172.21.15.96:6819","nonce":386227948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":386227948},{"type":"v1","addr":"172.21.15.96:6821","nonce":386227948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":386227948},{"type":"v1","addr":"172.21.15.96:6825","nonce":386227948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":386227948},{"type":"v1","addr":"172.21.15.96:6823","nonce":386227948}]},"public_addr":"172.21.15.96:6819/386227948","cluster_addr":"172.21.15.96:6821/386227948","heartbeat_back_addr":"172.21.15.96:6825/386227948","heartbeat_front_addr":"172.21.15.96:6823/386227948","state":["exists","up"]},{"osd":7,"uuid":"282db569-a76e-485b-a33d-f2579b956525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":218507954},{"type":"v1","addr":"172.21.15.133:6817","nonce":218507954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":218507954},{"type":"v1","addr":"172.21.15.133:6819","nonce":218507954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":218507954},{"type":"v1","addr":"172.21.15.133:6823","nonce":218507954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":218507954},{"type":"v1","addr":"172.21.15.133:6821","nonce":218507954}]},"public_addr":"172.21.15.133:6817/218507954","cluster_addr":"172.21.15.133:6819/218507954","heartbeat_back_addr":"172.21.15.133:6823/218507954","heartbeat_front_addr":"172.21.15.133:6821/218507954","state":["exists","up"]},{"osd":8,"uuid":"693e25b5-355d-4990-9467-0fac4c9133fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":1648475902},{"type":"v1","addr":"172.21.15.186:6817","nonce":1648475902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":1648475902},{"type":"v1","addr":"172.21.15.186:6819","nonce":1648475902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":1648475902},{"type":"v1","addr":"172.21.15.186:6823","nonce":1648475902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":1648475902},{"type":"v1","addr":"172.21.15.186:6821","nonce":1648475902}]},"public_addr":"172.21.15.186:6817/1648475902","cluster_addr":"172.21.15.186:6819/1648475902","heartbeat_back_addr":"172.21.15.186:6823/1648475902","heartbeat_front_addr":"172.21.15.186:6821/1648475902","state":["exists","up"]},{"osd":9,"uuid":"72fbff09-fe28-4014-86fc-c31f95cd19a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":543223824},{"type":"v1","addr":"172.21.15.96:6827","nonce":543223824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":543223824},{"type":"v1","addr":"172.21.15.96:6829","nonce":543223824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6832","nonce":543223824},{"type":"v1","addr":"172.21.15.96:6833","nonce":543223824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":543223824},{"type":"v1","addr":"172.21.15.96:6831","nonce":543223824}]},"public_addr":"172.21.15.96:6827/543223824","cluster_addr":"172.21.15.96:6829/543223824","heartbeat_back_addr":"172.21.15.96:6833/543223824","heartbeat_front_addr":"172.21.15.96:6831/543223824","state":["exists","up"]},{"osd":10,"uuid":"6c2b6757-60c2-4962-9409-6051dcb13273","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":2323107912},{"type":"v1","addr":"172.21.15.133:6825","nonce":2323107912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":2323107912},{"type":"v1","addr":"172.21.15.133:6827","nonce":2323107912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":2323107912},{"type":"v1","addr":"172.21.15.133:6831","nonce":2323107912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":2323107912},{"type":"v1","addr":"172.21.15.133:6829","nonce":2323107912}]},"public_addr":"172.21.15.133:6825/2323107912","cluster_addr":"172.21.15.133:6827/2323107912","heartbeat_back_addr":"172.21.15.133:6831/2323107912","heartbeat_front_addr":"172.21.15.133:6829/2323107912","state":["exists","up"]},{"osd":11,"uuid":"03c0bb25-2921-446b-960e-6a7a328d36a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":3853499290},{"type":"v1","addr":"172.21.15.186:6825","nonce":3853499290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":3853499290},{"type":"v1","addr":"172.21.15.186:6827","nonce":3853499290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":3853499290},{"type":"v1","addr":"172.21.15.186:6831","nonce":3853499290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":3853499290},{"type":"v1","addr":"172.21.15.186:6829","nonce":3853499290}]},"public_addr":"172.21.15.186:6825/3853499290","cluster_addr":"172.21.15.186:6827/3853499290","heartbeat_back_addr":"172.21.15.186:6831/3853499290","heartbeat_front_addr":"172.21.15.186:6829/3853499290","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:36:02.087281+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:36:24.328783+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:36:46.135576+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:37:08.524145+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:37:30.883871+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:37:53.344554+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:38:15.448162+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:38:37.414878+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:38:59.533953+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:39:21.392102+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:39:43.462696+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:40:05.561808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.96:0/1333468881":"2023-05-09T03:34:37.472043+0000","172.21.15.96:6800/1979917756":"2023-05-09T03:34:37.472043+0000","172.21.15.96:0/1332045367":"2023-05-09T03:34:37.472043+0000","172.21.15.96:0/520278090":"2023-05-09T03:34:14.800324+0000","172.21.15.96:0/1055409415":"2023-05-09T03:34:37.472043+0000","172.21.15.96:6801/1979917756":"2023-05-09T03:34:37.472043+0000","172.21.15.96:0/1541933328":"2023-05-09T03:34:14.800324+0000","172.21.15.96:6800/3944122753":"2023-05-09T03:34:14.800324+0000","172.21.15.96:0/2986058319":"2023-05-09T03:34:14.800324+0000","172.21.15.96:6801/3944122753":"2023-05-09T03:34:14.800324+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-08T03:40:12.366 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:12.362+0000 7f32a0a8e700 1 -- 172.21.15.96:0/3721525951 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f32880a1150 msgr2=0x7f32880a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:12.366 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:12.362+0000 7f32a0a8e700 1 --2- 172.21.15.96:0/3721525951 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f32880a1150 0x7f32880a3600 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f328400b5c0 tx=0x7f3284005fd0 comp rx=0 tx=0).stop 2023-05-08T03:40:12.366 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:12.362+0000 7f32a0a8e700 1 -- 172.21.15.96:0/3721525951 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f329c0ff320 msgr2=0x7f329c196930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:12.367 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:12.362+0000 7f32a0a8e700 1 --2- 172.21.15.96:0/3721525951 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f329c0ff320 0x7f329c196930 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f328c00c9b0 tx=0x7f328c00ccc0 comp rx=0 tx=0).stop 2023-05-08T03:40:12.367 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:12.362+0000 7f32a0a8e700 1 -- 172.21.15.96:0/3721525951 shutdown_connections 2023-05-08T03:40:12.368 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:12.362+0000 7f32a0a8e700 1 --2- 172.21.15.96:0/3721525951 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f32880a1150 0x7f32880a3600 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:12.368 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:12.362+0000 7f32a0a8e700 1 --2- 172.21.15.96:0/3721525951 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f329c106420 0x7f329c19ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:12.368 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:12.362+0000 7f32a0a8e700 1 --2- 172.21.15.96:0/3721525951 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f329c0fe970 0x7f329c1963f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:12.368 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:12.362+0000 7f32a0a8e700 1 --2- 172.21.15.96:0/3721525951 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f329c0ff320 0x7f329c196930 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:12.369 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:12.362+0000 7f32a0a8e700 1 -- 172.21.15.96:0/3721525951 >> 172.21.15.96:0/3721525951 conn(0x7f329c0759a0 msgr2=0x7f329c1072a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:12.369 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:12.362+0000 7f32a0a8e700 1 -- 172.21.15.96:0/3721525951 shutdown_connections 2023-05-08T03:40:12.369 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:12.363+0000 7f32a0a8e700 1 -- 172.21.15.96:0/3721525951 wait complete. 2023-05-08T03:40:12.739 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:12 smithi096 ceph-mon[124666]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 74 MiB used, 1.0 TiB / 1.0 TiB avail 2023-05-08T03:40:12.739 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:12 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/3721525951' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-05-08T03:40:12.826 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-08T03:36:47.800739+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-08T03:40:12.827 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- ceph osd pool get .mgr pg_num 2023-05-08T03:40:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:12 smithi186 ceph-mon[126480]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 74 MiB used, 1.0 TiB / 1.0 TiB avail 2023-05-08T03:40:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:12 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/3721525951' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-05-08T03:40:12.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:12 smithi133 ceph-mon[125939]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 74 MiB used, 1.0 TiB / 1.0 TiB avail 2023-05-08T03:40:12.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:12 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/3721525951' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-05-08T03:40:13.467 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.a/config 2023-05-08T03:40:14.654 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:14.651+0000 7f66997c9700 1 -- 172.21.15.96:0/1799747171 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66940ff3e0 msgr2=0x7f66940ff850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:14.655 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:14.651+0000 7f66997c9700 1 --2- 172.21.15.96:0/1799747171 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66940ff3e0 0x7f66940ff850 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f66880099c0 tx=0x7f6688009cd0 comp rx=0 tx=0).stop 2023-05-08T03:40:14.655 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:14.652+0000 7f66997c9700 1 -- 172.21.15.96:0/1799747171 shutdown_connections 2023-05-08T03:40:14.655 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:14.652+0000 7f66997c9700 1 --2- 172.21.15.96:0/1799747171 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66940ffd90 0x7f669410c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:14.655 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:14.652+0000 7f66997c9700 1 --2- 172.21.15.96:0/1799747171 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6694104280 0x7f6694104650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:14.655 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:14.652+0000 7f66997c9700 1 --2- 172.21.15.96:0/1799747171 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66940ff3e0 0x7f66940ff850 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:14.655 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:14.652+0000 7f66997c9700 1 -- 172.21.15.96:0/1799747171 >> 172.21.15.96:0/1799747171 conn(0x7f6694077390 msgr2=0x7f6694077790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:14.655 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:14.652+0000 7f66997c9700 1 -- 172.21.15.96:0/1799747171 shutdown_connections 2023-05-08T03:40:14.656 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:14.652+0000 7f66997c9700 1 -- 172.21.15.96:0/1799747171 wait complete. 2023-05-08T03:40:14.656 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:14.652+0000 7f66997c9700 1 Processor -- start 2023-05-08T03:40:14.657 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:14.652+0000 7f66997c9700 1 -- start start 2023-05-08T03:40:14.657 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:14.653+0000 7f66997c9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66940ff3e0 0x7f66940fc9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:14.657 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:14.653+0000 7f66997c9700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f66940ffd90 0x7f66940fcf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:14.658 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:14.653+0000 7f66997c9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6694104280 0x7f66940fd490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:14.658 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:14.653+0000 7f66997c9700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66941a49b0 con 0x7f6694104280 2023-05-08T03:40:14.658 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:14.653+0000 7f66997c9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66941a4b20 con 0x7f66940ff3e0 2023-05-08T03:40:14.658 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:14.653+0000 7f66997c9700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66941a4ce0 con 0x7f66940ffd90 2023-05-08T03:40:14.658 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:14.653+0000 7f66937fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6694104280 0x7f66940fd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:14.658 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:14.653+0000 7f66937fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6694104280 0x7f66940fd490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40096/0 (socket says 172.21.15.96:40096) 2023-05-08T03:40:14.658 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:14.653+0000 7f66937fe700 1 -- 172.21.15.96:0/3653720127 learned_addr learned my addr 172.21.15.96:0/3653720127 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:40:14.659 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:14.653+0000 7f6692ffd700 1 --2- 172.21.15.96:0/3653720127 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66940ff3e0 0x7f66940fc9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:14.659 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:14.653+0000 7f66927fc700 1 --2- 172.21.15.96:0/3653720127 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f66940ffd90 0x7f66940fcf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:14.659 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:14.653+0000 7f66937fe700 1 -- 172.21.15.96:0/3653720127 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f66940ffd90 msgr2=0x7f66940fcf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:14.659 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:14.653+0000 7f66937fe700 1 --2- 172.21.15.96:0/3653720127 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f66940ffd90 0x7f66940fcf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:14.659 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:14.653+0000 7f66937fe700 1 -- 172.21.15.96:0/3653720127 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66940ff3e0 msgr2=0x7f66940fc9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:14.659 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:14.653+0000 7f66937fe700 1 --2- 172.21.15.96:0/3653720127 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66940ff3e0 0x7f66940fc9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:14.659 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:14.653+0000 7f66937fe700 1 -- 172.21.15.96:0/3653720127 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66880095f0 con 0x7f6694104280 2023-05-08T03:40:14.660 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:14.653+0000 7f66927fc700 1 --2- 172.21.15.96:0/3653720127 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f66940ffd90 0x7f66940fcf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-08T03:40:14.660 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:14.653+0000 7f66937fe700 1 --2- 172.21.15.96:0/3653720127 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6694104280 0x7f66940fd490 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f668c007ee0 tx=0x7f668c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:14.660 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:14.653+0000 7f667bfff700 1 -- 172.21.15.96:0/3653720127 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668c017070 con 0x7f6694104280 2023-05-08T03:40:14.660 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:14.653+0000 7f667bfff700 1 -- 172.21.15.96:0/3653720127 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f668c00f040 con 0x7f6694104280 2023-05-08T03:40:14.660 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:14.653+0000 7f66997c9700 1 -- 172.21.15.96:0/3653720127 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f669410f4a0 con 0x7f6694104280 2023-05-08T03:40:14.660 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:14.653+0000 7f667bfff700 1 -- 172.21.15.96:0/3653720127 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668c005740 con 0x7f6694104280 2023-05-08T03:40:14.660 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:14.653+0000 7f66997c9700 1 -- 172.21.15.96:0/3653720127 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f669410f310 con 0x7f6694104280 2023-05-08T03:40:14.660 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:14.654+0000 7f66997c9700 1 -- 172.21.15.96:0/3653720127 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f669410f630 con 0x7f6694104280 2023-05-08T03:40:14.661 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:14.655+0000 7f667bfff700 1 -- 172.21.15.96:0/3653720127 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f668c00dc60 con 0x7f6694104280 2023-05-08T03:40:14.661 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:14.656+0000 7f667bfff700 1 --2- 172.21.15.96:0/3653720127 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f667c0a1150 0x7f667c0a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:14.661 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:14.656+0000 7f6692ffd700 1 --2- 172.21.15.96:0/3653720127 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f667c0a1150 0x7f667c0a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:14.662 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:14.656+0000 7f667bfff700 1 -- 172.21.15.96:0/3653720127 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f668c0cbc80 con 0x7f6694104280 2023-05-08T03:40:14.662 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:14.656+0000 7f6692ffd700 1 --2- 172.21.15.96:0/3653720127 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f667c0a1150 0x7f667c0a3600 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6684009a10 tx=0x7f6684009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:14.663 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:14.661+0000 7f667bfff700 1 -- 172.21.15.96:0/3653720127 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f668c095870 con 0x7f6694104280 2023-05-08T03:40:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:14 smithi096 ceph-mon[124666]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-05-08T03:40:14.851 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:14.848+0000 7f66997c9700 1 -- 172.21.15.96:0/3653720127 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f66941a5730 con 0x7f6694104280 2023-05-08T03:40:14.851 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:14.848+0000 7f667bfff700 1 -- 172.21.15.96:0/3653720127 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v78) v1 ==== 93+0+10 (secure 0 0 0) 0x7f668c098e90 con 0x7f6694104280 2023-05-08T03:40:14.851 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2023-05-08T03:40:14.852 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:14.850+0000 7f66997c9700 1 -- 172.21.15.96:0/3653720127 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f667c0a1150 msgr2=0x7f667c0a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:14.853 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:14.850+0000 7f66997c9700 1 --2- 172.21.15.96:0/3653720127 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f667c0a1150 0x7f667c0a3600 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6684009a10 tx=0x7f6684009190 comp rx=0 tx=0).stop 2023-05-08T03:40:14.853 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:14.850+0000 7f66997c9700 1 -- 172.21.15.96:0/3653720127 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6694104280 msgr2=0x7f66940fd490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:14.853 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:14.850+0000 7f66997c9700 1 --2- 172.21.15.96:0/3653720127 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6694104280 0x7f66940fd490 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f668c007ee0 tx=0x7f668c00d3b0 comp rx=0 tx=0).stop 2023-05-08T03:40:14.853 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:14.850+0000 7f66997c9700 1 -- 172.21.15.96:0/3653720127 shutdown_connections 2023-05-08T03:40:14.853 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:14.850+0000 7f66997c9700 1 --2- 172.21.15.96:0/3653720127 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f667c0a1150 0x7f667c0a3600 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:14.853 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:14.850+0000 7f66997c9700 1 --2- 172.21.15.96:0/3653720127 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6694104280 0x7f66940fd490 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:14.854 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:14.850+0000 7f66997c9700 1 --2- 172.21.15.96:0/3653720127 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66940ff3e0 0x7f66940fc9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:14.854 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:14.850+0000 7f66997c9700 1 --2- 172.21.15.96:0/3653720127 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f66940ffd90 0x7f66940fcf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:14.854 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:14.850+0000 7f66997c9700 1 -- 172.21.15.96:0/3653720127 >> 172.21.15.96:0/3653720127 conn(0x7f6694077390 msgr2=0x7f66940692a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:14.854 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:14.850+0000 7f66997c9700 1 -- 172.21.15.96:0/3653720127 shutdown_connections 2023-05-08T03:40:14.854 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:14.850+0000 7f66997c9700 1 -- 172.21.15.96:0/3653720127 wait complete. 2023-05-08T03:40:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:14 smithi186 ceph-mon[126480]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-05-08T03:40:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:14 smithi133 ceph-mon[125939]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-05-08T03:40:15.307 INFO:tasks.cephadm:Adding mds.a on smithi096 2023-05-08T03:40:15.308 INFO:tasks.cephadm:Adding mds.d on smithi096 2023-05-08T03:40:15.308 INFO:tasks.cephadm:Adding mds.g on smithi096 2023-05-08T03:40:15.308 INFO:tasks.cephadm:Adding mds.j on smithi096 2023-05-08T03:40:15.308 INFO:tasks.cephadm:Adding mds.b on smithi133 2023-05-08T03:40:15.309 INFO:tasks.cephadm:Adding mds.e on smithi133 2023-05-08T03:40:15.309 INFO:tasks.cephadm:Adding mds.h on smithi133 2023-05-08T03:40:15.309 INFO:tasks.cephadm:Adding mds.k on smithi133 2023-05-08T03:40:15.309 INFO:tasks.cephadm:Adding mds.c on smithi186 2023-05-08T03:40:15.309 INFO:tasks.cephadm:Adding mds.f on smithi186 2023-05-08T03:40:15.310 INFO:tasks.cephadm:Adding mds.i on smithi186 2023-05-08T03:40:15.310 INFO:tasks.cephadm:Adding mds.l on smithi186 2023-05-08T03:40:15.310 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- ceph orch apply mds all '12;smithi096=a;smithi096=d;smithi096=g;smithi096=j;smithi133=b;smithi133=e;smithi133=h;smithi133=k;smithi186=c;smithi186=f;smithi186=i;smithi186=l' 2023-05-08T03:40:15.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:15 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/3653720127' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-05-08T03:40:15.967 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.c/config 2023-05-08T03:40:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:15 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/3653720127' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-05-08T03:40:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:15 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/3653720127' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-05-08T03:40:16.748 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:16 smithi186 ceph-mon[126480]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-05-08T03:40:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:16 smithi133 ceph-mon[125939]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-05-08T03:40:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:16 smithi096 ceph-mon[124666]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-05-08T03:40:17.191 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:40:17.188+0000 7ff021c2e700 1 -- 172.21.15.186:0/2876359298 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff01c0ffc60 msgr2=0x7ff01c1000b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:17.192 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:40:17.188+0000 7ff021c2e700 1 --2- 172.21.15.186:0/2876359298 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff01c0ffc60 0x7ff01c1000b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff00c00aaa0 tx=0x7ff00c00adb0 comp rx=0 tx=0).stop 2023-05-08T03:40:17.192 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:40:17.188+0000 7ff021c2e700 1 -- 172.21.15.186:0/2876359298 shutdown_connections 2023-05-08T03:40:17.192 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:40:17.188+0000 7ff021c2e700 1 --2- 172.21.15.186:0/2876359298 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff01c1005f0 0x7ff01c106eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:17.192 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:40:17.188+0000 7ff021c2e700 1 --2- 172.21.15.186:0/2876359298 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff01c0fea60 0x7ff01c0fee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:17.192 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:40:17.188+0000 7ff021c2e700 1 --2- 172.21.15.186:0/2876359298 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff01c0ffc60 0x7ff01c1000b0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:17.193 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:40:17.188+0000 7ff021c2e700 1 -- 172.21.15.186:0/2876359298 >> 172.21.15.186:0/2876359298 conn(0x7ff01c0fa070 msgr2=0x7ff01c0fc4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:17.193 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:40:17.188+0000 7ff021c2e700 1 -- 172.21.15.186:0/2876359298 shutdown_connections 2023-05-08T03:40:17.193 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:40:17.188+0000 7ff021c2e700 1 -- 172.21.15.186:0/2876359298 wait complete. 2023-05-08T03:40:17.195 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:40:17.189+0000 7ff021c2e700 1 Processor -- start 2023-05-08T03:40:17.195 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:40:17.189+0000 7ff021c2e700 1 -- start start 2023-05-08T03:40:17.195 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:40:17.189+0000 7ff021c2e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff01c0fea60 0x7ff01c196170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:17.195 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:40:17.189+0000 7ff021c2e700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff01c0ffc60 0x7ff01c1966b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:17.195 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:40:17.189+0000 7ff021c2e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff01c1005f0 0x7ff01c19d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:17.196 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:40:17.189+0000 7ff021c2e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff01c19dd00 con 0x7ff01c1005f0 2023-05-08T03:40:17.196 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:40:17.189+0000 7ff021c2e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff01c19de40 con 0x7ff01c0fea60 2023-05-08T03:40:17.196 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:40:17.189+0000 7ff021c2e700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff01c19dfd0 con 0x7ff01c0ffc60 2023-05-08T03:40:17.196 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:40:17.189+0000 7ff01affd700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff01c0ffc60 0x7ff01c1966b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:17.196 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:40:17.189+0000 7ff01affd700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff01c0ffc60 0x7ff01c1966b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.186:53014/0 (socket says 172.21.15.186:53014) 2023-05-08T03:40:17.196 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:40:17.189+0000 7ff01affd700 1 -- 172.21.15.186:0/1674800519 learned_addr learned my addr 172.21.15.186:0/1674800519 (peer_addr_for_me v2:172.21.15.186:0/0) 2023-05-08T03:40:17.196 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:40:17.190+0000 7ff01b7fe700 1 --2- 172.21.15.186:0/1674800519 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff01c0fea60 0x7ff01c196170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:17.197 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:40:17.190+0000 7ff01bfff700 1 --2- 172.21.15.186:0/1674800519 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff01c1005f0 0x7ff01c19d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:17.197 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:40:17.190+0000 7ff01affd700 1 -- 172.21.15.186:0/1674800519 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff01c0fea60 msgr2=0x7ff01c196170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:17.197 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:40:17.190+0000 7ff01affd700 1 --2- 172.21.15.186:0/1674800519 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff01c0fea60 0x7ff01c196170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:17.197 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:40:17.190+0000 7ff01affd700 1 -- 172.21.15.186:0/1674800519 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff01c1005f0 msgr2=0x7ff01c19d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:17.197 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:40:17.190+0000 7ff01affd700 1 --2- 172.21.15.186:0/1674800519 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff01c1005f0 0x7ff01c19d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:17.197 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:40:17.190+0000 7ff01affd700 1 -- 172.21.15.186:0/1674800519 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff00c00a700 con 0x7ff01c0ffc60 2023-05-08T03:40:17.197 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:40:17.190+0000 7ff01b7fe700 1 --2- 172.21.15.186:0/1674800519 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff01c0fea60 0x7ff01c196170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-08T03:40:17.198 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:40:17.190+0000 7ff01bfff700 1 --2- 172.21.15.186:0/1674800519 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff01c1005f0 0x7ff01c19d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-08T03:40:17.198 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:40:17.190+0000 7ff01affd700 1 --2- 172.21.15.186:0/1674800519 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff01c0ffc60 0x7ff01c1966b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff00c003df0 tx=0x7ff00c003ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:17.198 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:40:17.190+0000 7ff018ff9700 1 -- 172.21.15.186:0/1674800519 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00c005030 con 0x7ff01c0ffc60 2023-05-08T03:40:17.198 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:40:17.190+0000 7ff018ff9700 1 -- 172.21.15.186:0/1674800519 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff00c005650 con 0x7ff01c0ffc60 2023-05-08T03:40:17.198 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:40:17.190+0000 7ff021c2e700 1 -- 172.21.15.186:0/1674800519 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff01c109bc0 con 0x7ff01c0ffc60 2023-05-08T03:40:17.198 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:40:17.190+0000 7ff018ff9700 1 -- 172.21.15.186:0/1674800519 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00c00e450 con 0x7ff01c0ffc60 2023-05-08T03:40:17.198 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:40:17.190+0000 7ff021c2e700 1 -- 172.21.15.186:0/1674800519 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff01c109a30 con 0x7ff01c0ffc60 2023-05-08T03:40:17.199 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:40:17.191+0000 7ff021c2e700 1 -- 172.21.15.186:0/1674800519 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff01c106000 con 0x7ff01c0ffc60 2023-05-08T03:40:17.199 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:40:17.192+0000 7ff018ff9700 1 -- 172.21.15.186:0/1674800519 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7ff00c005190 con 0x7ff01c0ffc60 2023-05-08T03:40:17.200 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:40:17.193+0000 7ff018ff9700 1 --2- 172.21.15.186:0/1674800519 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7ff0040a11d0 0x7ff0040a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:17.200 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:40:17.193+0000 7ff018ff9700 1 -- 172.21.15.186:0/1674800519 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7ff00c012070 con 0x7ff01c0ffc60 2023-05-08T03:40:17.200 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:40:17.193+0000 7ff01b7fe700 1 --2- 172.21.15.186:0/1674800519 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7ff0040a11d0 0x7ff0040a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:17.200 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:40:17.194+0000 7ff01b7fe700 1 --2- 172.21.15.186:0/1674800519 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7ff0040a11d0 0x7ff0040a3680 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff01c0ffac0 tx=0x7ff010008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:17.200 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:40:17.197+0000 7ff018ff9700 1 -- 172.21.15.186:0/1674800519 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7ff00c098410 con 0x7ff01c0ffc60 2023-05-08T03:40:17.397 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:40:17.395+0000 7ff021c2e700 1 -- 172.21.15.186:0/1674800519 --> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi096=a;smithi096=d;smithi096=g;smithi096=j;smithi133=b;smithi133=e;smithi133=h;smithi133=k;smithi186=c;smithi186=f;smithi186=i;smithi186=l", "target": ["mon-mgr", ""]}) v1 -- 0x7ff01c061e10 con 0x7ff0040a11d0 2023-05-08T03:40:17.405 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:40:17.402+0000 7ff018ff9700 1 -- 172.21.15.186:0/1674800519 <== mgr.14152 v2:172.21.15.96:6800/2748629182 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7ff01c061e10 con 0x7ff0040a11d0 2023-05-08T03:40:17.406 INFO:teuthology.orchestra.run.smithi186.stdout:Scheduled mds.all update... 2023-05-08T03:40:17.407 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:40:17.404+0000 7ff021c2e700 1 -- 172.21.15.186:0/1674800519 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7ff0040a11d0 msgr2=0x7ff0040a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:17.407 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:40:17.404+0000 7ff021c2e700 1 --2- 172.21.15.186:0/1674800519 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7ff0040a11d0 0x7ff0040a3680 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff01c0ffac0 tx=0x7ff010008040 comp rx=0 tx=0).stop 2023-05-08T03:40:17.408 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:40:17.404+0000 7ff021c2e700 1 -- 172.21.15.186:0/1674800519 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff01c0ffc60 msgr2=0x7ff01c1966b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:17.408 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:40:17.404+0000 7ff021c2e700 1 --2- 172.21.15.186:0/1674800519 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff01c0ffc60 0x7ff01c1966b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff00c003df0 tx=0x7ff00c003ed0 comp rx=0 tx=0).stop 2023-05-08T03:40:17.408 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:40:17.404+0000 7ff021c2e700 1 -- 172.21.15.186:0/1674800519 shutdown_connections 2023-05-08T03:40:17.408 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:40:17.404+0000 7ff021c2e700 1 --2- 172.21.15.186:0/1674800519 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7ff0040a11d0 0x7ff0040a3680 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:17.409 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:40:17.404+0000 7ff021c2e700 1 --2- 172.21.15.186:0/1674800519 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff01c1005f0 0x7ff01c19d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:17.410 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:40:17.404+0000 7ff021c2e700 1 --2- 172.21.15.186:0/1674800519 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff01c0fea60 0x7ff01c196170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:17.410 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:40:17.404+0000 7ff021c2e700 1 --2- 172.21.15.186:0/1674800519 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff01c0ffc60 0x7ff01c1966b0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:17.410 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:40:17.404+0000 7ff021c2e700 1 -- 172.21.15.186:0/1674800519 >> 172.21.15.186:0/1674800519 conn(0x7ff01c0fa070 msgr2=0x7ff01c103140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:17.410 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:40:17.405+0000 7ff021c2e700 1 -- 172.21.15.186:0/1674800519 shutdown_connections 2023-05-08T03:40:17.410 INFO:teuthology.orchestra.run.smithi186.stderr:2023-05-08T03:40:17.405+0000 7ff021c2e700 1 -- 172.21.15.186:0/1674800519 wait complete. 2023-05-08T03:40:17.811 DEBUG:teuthology.orchestra.run.smithi096:mds.a> sudo journalctl -f -n 0 -u ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c@mds.a.service 2023-05-08T03:40:17.814 DEBUG:teuthology.orchestra.run.smithi096:mds.d> sudo journalctl -f -n 0 -u ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c@mds.d.service 2023-05-08T03:40:17.851 INFO:journalctl@ceph.mds.a.smithi096.stdout:-- Logs begin at Mon 2023-05-08 03:07:36 UTC. -- 2023-05-08T03:40:17.852 DEBUG:teuthology.orchestra.run.smithi096:mds.g> sudo journalctl -f -n 0 -u ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c@mds.g.service 2023-05-08T03:40:17.881 INFO:journalctl@ceph.mds.d.smithi096.stdout:-- Logs begin at Mon 2023-05-08 03:07:36 UTC. -- 2023-05-08T03:40:17.882 DEBUG:teuthology.orchestra.run.smithi096:mds.j> sudo journalctl -f -n 0 -u ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c@mds.j.service 2023-05-08T03:40:17.909 INFO:journalctl@ceph.mds.g.smithi096.stdout:-- Logs begin at Mon 2023-05-08 03:07:36 UTC. -- 2023-05-08T03:40:17.910 DEBUG:teuthology.orchestra.run.smithi133:mds.b> sudo journalctl -f -n 0 -u ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c@mds.b.service 2023-05-08T03:40:17.913 DEBUG:teuthology.orchestra.run.smithi133:mds.e> sudo journalctl -f -n 0 -u ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c@mds.e.service 2023-05-08T03:40:17.936 INFO:journalctl@ceph.mds.j.smithi096.stdout:-- Logs begin at Mon 2023-05-08 03:07:36 UTC. -- 2023-05-08T03:40:17.942 INFO:journalctl@ceph.mds.b.smithi133.stdout:-- Logs begin at Mon 2023-05-08 03:07:41 UTC. -- 2023-05-08T03:40:17.944 DEBUG:teuthology.orchestra.run.smithi133:mds.h> sudo journalctl -f -n 0 -u ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c@mds.h.service 2023-05-08T03:40:17.970 INFO:journalctl@ceph.mds.e.smithi133.stdout:-- Logs begin at Mon 2023-05-08 03:07:41 UTC. -- 2023-05-08T03:40:17.971 DEBUG:teuthology.orchestra.run.smithi133:mds.k> sudo journalctl -f -n 0 -u ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c@mds.k.service 2023-05-08T03:40:17.997 INFO:journalctl@ceph.mds.h.smithi133.stdout:-- Logs begin at Mon 2023-05-08 03:07:41 UTC. -- 2023-05-08T03:40:17.997 DEBUG:teuthology.orchestra.run.smithi186:mds.c> sudo journalctl -f -n 0 -u ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c@mds.c.service 2023-05-08T03:40:18.000 DEBUG:teuthology.orchestra.run.smithi186:mds.f> sudo journalctl -f -n 0 -u ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c@mds.f.service 2023-05-08T03:40:18.023 INFO:journalctl@ceph.mds.k.smithi133.stdout:-- Logs begin at Mon 2023-05-08 03:07:41 UTC. -- 2023-05-08T03:40:18.030 INFO:journalctl@ceph.mds.c.smithi186.stdout:-- Logs begin at Mon 2023-05-08 03:08:31 UTC. -- 2023-05-08T03:40:18.032 DEBUG:teuthology.orchestra.run.smithi186:mds.i> sudo journalctl -f -n 0 -u ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c@mds.i.service 2023-05-08T03:40:18.057 INFO:journalctl@ceph.mds.f.smithi186.stdout:-- Logs begin at Mon 2023-05-08 03:08:31 UTC. -- 2023-05-08T03:40:18.058 DEBUG:teuthology.orchestra.run.smithi186:mds.l> sudo journalctl -f -n 0 -u ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c@mds.l.service 2023-05-08T03:40:18.083 INFO:journalctl@ceph.mds.i.smithi186.stdout:-- Logs begin at Mon 2023-05-08 03:08:31 UTC. -- 2023-05-08T03:40:18.084 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2023-05-08T03:40:18.085 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-08T03:40:18.110 INFO:journalctl@ceph.mds.l.smithi186.stdout:-- Logs begin at Mon 2023-05-08 03:08:31 UTC. -- 2023-05-08T03:40:18.223 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.221+0000 7fec1138e700 1 -- 172.21.15.96:0/472574722 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec0c100610 msgr2=0x7fec0c106ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:18.224 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.221+0000 7fec1138e700 1 --2- 172.21.15.96:0/472574722 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec0c100610 0x7fec0c106ed0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fec0400c210 tx=0x7fec0400c520 comp rx=0 tx=0).stop 2023-05-08T03:40:18.224 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.221+0000 7fec1138e700 1 -- 172.21.15.96:0/472574722 shutdown_connections 2023-05-08T03:40:18.225 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.221+0000 7fec1138e700 1 --2- 172.21.15.96:0/472574722 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec0c100610 0x7fec0c106ed0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:18.225 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.221+0000 7fec1138e700 1 --2- 172.21.15.96:0/472574722 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fec0c0fea90 0x7fec0c0feea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:18.225 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.221+0000 7fec1138e700 1 --2- 172.21.15.96:0/472574722 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fec0c0ffc80 0x7fec0c1000d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:18.225 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.221+0000 7fec1138e700 1 -- 172.21.15.96:0/472574722 >> 172.21.15.96:0/472574722 conn(0x7fec0c0fa0b0 msgr2=0x7fec0c0fc4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:18.226 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.221+0000 7fec1138e700 1 -- 172.21.15.96:0/472574722 shutdown_connections 2023-05-08T03:40:18.226 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.221+0000 7fec1138e700 1 -- 172.21.15.96:0/472574722 wait complete. 2023-05-08T03:40:18.226 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.221+0000 7fec1138e700 1 Processor -- start 2023-05-08T03:40:18.226 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.221+0000 7fec1138e700 1 -- start start 2023-05-08T03:40:18.228 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.222+0000 7fec1138e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec0c0fea90 0x7fec0c196220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:18.228 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.222+0000 7fec1138e700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fec0c0ffc80 0x7fec0c196760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:18.228 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.222+0000 7fec1138e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fec0c100610 0x7fec0c19d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:18.229 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.222+0000 7fec1138e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec0c19dda0 con 0x7fec0c0fea90 2023-05-08T03:40:18.229 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.222+0000 7fec1138e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec0c19dee0 con 0x7fec0c100610 2023-05-08T03:40:18.229 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.222+0000 7fec1138e700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec0c19e070 con 0x7fec0c0ffc80 2023-05-08T03:40:18.229 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.222+0000 7fec0affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec0c0fea90 0x7fec0c196220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:18.229 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.222+0000 7fec0affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec0c0fea90 0x7fec0c196220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40104/0 (socket says 172.21.15.96:40104) 2023-05-08T03:40:18.229 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.222+0000 7fec0affd700 1 -- 172.21.15.96:0/1217253043 learned_addr learned my addr 172.21.15.96:0/1217253043 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:40:18.230 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.222+0000 7fec0a7fc700 1 --2- 172.21.15.96:0/1217253043 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fec0c0ffc80 0x7fec0c196760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:18.230 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.222+0000 7fec0b7fe700 1 --2- 172.21.15.96:0/1217253043 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fec0c100610 0x7fec0c19d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:18.230 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.222+0000 7fec0affd700 1 -- 172.21.15.96:0/1217253043 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fec0c0ffc80 msgr2=0x7fec0c196760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:18.230 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.222+0000 7fec0affd700 1 --2- 172.21.15.96:0/1217253043 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fec0c0ffc80 0x7fec0c196760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:18.230 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.222+0000 7fec0affd700 1 -- 172.21.15.96:0/1217253043 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fec0c100610 msgr2=0x7fec0c19d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:18.231 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.222+0000 7fec0affd700 1 --2- 172.21.15.96:0/1217253043 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fec0c100610 0x7fec0c19d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:18.231 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.222+0000 7fec0affd700 1 -- 172.21.15.96:0/1217253043 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec0400ae10 con 0x7fec0c0fea90 2023-05-08T03:40:18.231 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.222+0000 7fec0affd700 1 --2- 172.21.15.96:0/1217253043 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec0c0fea90 0x7fec0c196220 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7febfc00d980 tx=0x7febfc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:18.231 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.222+0000 7febf3fff700 1 -- 172.21.15.96:0/1217253043 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febfc004020 con 0x7fec0c0fea90 2023-05-08T03:40:18.231 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.222+0000 7fec1138e700 1 -- 172.21.15.96:0/1217253043 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec0c109b70 con 0x7fec0c0fea90 2023-05-08T03:40:18.231 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.222+0000 7febf3fff700 1 -- 172.21.15.96:0/1217253043 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7febfc009730 con 0x7fec0c0fea90 2023-05-08T03:40:18.232 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.222+0000 7febf3fff700 1 -- 172.21.15.96:0/1217253043 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febfc003a30 con 0x7fec0c0fea90 2023-05-08T03:40:18.232 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.222+0000 7fec1138e700 1 -- 172.21.15.96:0/1217253043 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec0c1099e0 con 0x7fec0c0fea90 2023-05-08T03:40:18.232 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.223+0000 7fec1138e700 1 -- 172.21.15.96:0/1217253043 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec0c105fd0 con 0x7fec0c0fea90 2023-05-08T03:40:18.232 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.224+0000 7febf3fff700 1 -- 172.21.15.96:0/1217253043 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7febfc0098a0 con 0x7fec0c0fea90 2023-05-08T03:40:18.232 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.225+0000 7febf3fff700 1 --2- 172.21.15.96:0/1217253043 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7febf40a1150 0x7febf40a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:18.232 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.225+0000 7fec0a7fc700 1 --2- 172.21.15.96:0/1217253043 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7febf40a1150 0x7febf40a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:18.233 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.225+0000 7febf3fff700 1 -- 172.21.15.96:0/1217253043 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7febfc0cc550 con 0x7fec0c0fea90 2023-05-08T03:40:18.233 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.225+0000 7fec0a7fc700 1 --2- 172.21.15.96:0/1217253043 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7febf40a1150 0x7febf40a3600 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fec00009be0 tx=0x7fec00009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:18.233 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.228+0000 7febf3fff700 1 -- 172.21.15.96:0/1217253043 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7febfc0960a0 con 0x7fec0c0fea90 2023-05-08T03:40:18.426 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.423+0000 7fec1138e700 1 -- 172.21.15.96:0/1217253043 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fec0c067f40 con 0x7fec0c0fea90 2023-05-08T03:40:18.427 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.424+0000 7febf3fff700 1 -- 172.21.15.96:0/1217253043 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+18399 (secure 0 0 0) 0x7febfc0996c0 con 0x7fec0c0fea90 2023-05-08T03:40:18.427 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:40:18.427 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":78,"fsid":"f7ffcfb0-ed50-11ed-9b01-001a4aab830c","created":"2023-05-08T03:33:42.765680+0000","modified":"2023-05-08T03:40:08.557646+0000","last_up_change":"2023-05-08T03:40:07.550882+0000","last_in_change":"2023-05-08T03:39:49.027947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-08T03:36:47.800739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2ee801e1-8eec-496d-a9ac-fc566b38bbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":1816903726},{"type":"v1","addr":"172.21.15.96:6803","nonce":1816903726}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":1816903726},{"type":"v1","addr":"172.21.15.96:6805","nonce":1816903726}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":1816903726},{"type":"v1","addr":"172.21.15.96:6809","nonce":1816903726}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":1816903726},{"type":"v1","addr":"172.21.15.96:6807","nonce":1816903726}]},"public_addr":"172.21.15.96:6803/1816903726","cluster_addr":"172.21.15.96:6805/1816903726","heartbeat_back_addr":"172.21.15.96:6809/1816903726","heartbeat_front_addr":"172.21.15.96:6807/1816903726","state":["exists","up"]},{"osd":1,"uuid":"eb73deea-fc7c-4f2f-8aef-2d71c598afda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":206989126},{"type":"v1","addr":"172.21.15.133:6801","nonce":206989126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":206989126},{"type":"v1","addr":"172.21.15.133:6803","nonce":206989126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":206989126},{"type":"v1","addr":"172.21.15.133:6807","nonce":206989126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":206989126},{"type":"v1","addr":"172.21.15.133:6805","nonce":206989126}]},"public_addr":"172.21.15.133:6801/206989126","cluster_addr":"172.21.15.133:6803/206989126","heartbeat_back_addr":"172.21.15.133:6807/206989126","heartbeat_front_addr":"172.21.15.133:6805/206989126","state":["exists","up"]},{"osd":2,"uuid":"74a2f239-e82d-4d87-9458-5373b6cbbffd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":1791188143},{"type":"v1","addr":"172.21.15.186:6801","nonce":1791188143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":1791188143},{"type":"v1","addr":"172.21.15.186:6803","nonce":1791188143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":1791188143},{"type":"v1","addr":"172.21.15.186:6807","nonce":1791188143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":1791188143},{"type":"v1","addr":"172.21.15.186:6805","nonce":1791188143}]},"public_addr":"172.21.15.186:6801/1791188143","cluster_addr":"172.21.15.186:6803/1791188143","heartbeat_back_addr":"172.21.15.186:6807/1791188143","heartbeat_front_addr":"172.21.15.186:6805/1791188143","state":["exists","up"]},{"osd":3,"uuid":"421eedf5-ba6e-484e-b715-78c1c10d684e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":3430402140},{"type":"v1","addr":"172.21.15.96:6811","nonce":3430402140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":3430402140},{"type":"v1","addr":"172.21.15.96:6813","nonce":3430402140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":3430402140},{"type":"v1","addr":"172.21.15.96:6817","nonce":3430402140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":3430402140},{"type":"v1","addr":"172.21.15.96:6815","nonce":3430402140}]},"public_addr":"172.21.15.96:6811/3430402140","cluster_addr":"172.21.15.96:6813/3430402140","heartbeat_back_addr":"172.21.15.96:6817/3430402140","heartbeat_front_addr":"172.21.15.96:6815/3430402140","state":["exists","up"]},{"osd":4,"uuid":"fb20100b-6a5a-462d-955d-1697a3861e96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":1237495996},{"type":"v1","addr":"172.21.15.133:6809","nonce":1237495996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":1237495996},{"type":"v1","addr":"172.21.15.133:6811","nonce":1237495996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":1237495996},{"type":"v1","addr":"172.21.15.133:6815","nonce":1237495996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":1237495996},{"type":"v1","addr":"172.21.15.133:6813","nonce":1237495996}]},"public_addr":"172.21.15.133:6809/1237495996","cluster_addr":"172.21.15.133:6811/1237495996","heartbeat_back_addr":"172.21.15.133:6815/1237495996","heartbeat_front_addr":"172.21.15.133:6813/1237495996","state":["exists","up"]},{"osd":5,"uuid":"00177913-8bd6-4391-83c3-08c2b1b8ef13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":541111862},{"type":"v1","addr":"172.21.15.186:6809","nonce":541111862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":541111862},{"type":"v1","addr":"172.21.15.186:6811","nonce":541111862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":541111862},{"type":"v1","addr":"172.21.15.186:6815","nonce":541111862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":541111862},{"type":"v1","addr":"172.21.15.186:6813","nonce":541111862}]},"public_addr":"172.21.15.186:6809/541111862","cluster_addr":"172.21.15.186:6811/541111862","heartbeat_back_addr":"172.21.15.186:6815/541111862","heartbeat_front_addr":"172.21.15.186:6813/541111862","state":["exists","up"]},{"osd":6,"uuid":"204baab6-ca6f-4eef-8b9c-91efc04cc30c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":386227948},{"type":"v1","addr":"172.21.15.96:6819","nonce":386227948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":386227948},{"type":"v1","addr":"172.21.15.96:6821","nonce":386227948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":386227948},{"type":"v1","addr":"172.21.15.96:6825","nonce":386227948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":386227948},{"type":"v1","addr":"172.21.15.96:6823","nonce":386227948}]},"public_addr":"172.21.15.96:6819/386227948","cluster_addr":"172.21.15.96:6821/386227948","heartbeat_back_addr":"172.21.15.96:6825/386227948","heartbeat_front_addr":"172.21.15.96:6823/386227948","state":["exists","up"]},{"osd":7,"uuid":"282db569-a76e-485b-a33d-f2579b956525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":218507954},{"type":"v1","addr":"172.21.15.133:6817","nonce":218507954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":218507954},{"type":"v1","addr":"172.21.15.133:6819","nonce":218507954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":218507954},{"type":"v1","addr":"172.21.15.133:6823","nonce":218507954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":218507954},{"type":"v1","addr":"172.21.15.133:6821","nonce":218507954}]},"public_addr":"172.21.15.133:6817/218507954","cluster_addr":"172.21.15.133:6819/218507954","heartbeat_back_addr":"172.21.15.133:6823/218507954","heartbeat_front_addr":"172.21.15.133:6821/218507954","state":["exists","up"]},{"osd":8,"uuid":"693e25b5-355d-4990-9467-0fac4c9133fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":1648475902},{"type":"v1","addr":"172.21.15.186:6817","nonce":1648475902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":1648475902},{"type":"v1","addr":"172.21.15.186:6819","nonce":1648475902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":1648475902},{"type":"v1","addr":"172.21.15.186:6823","nonce":1648475902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":1648475902},{"type":"v1","addr":"172.21.15.186:6821","nonce":1648475902}]},"public_addr":"172.21.15.186:6817/1648475902","cluster_addr":"172.21.15.186:6819/1648475902","heartbeat_back_addr":"172.21.15.186:6823/1648475902","heartbeat_front_addr":"172.21.15.186:6821/1648475902","state":["exists","up"]},{"osd":9,"uuid":"72fbff09-fe28-4014-86fc-c31f95cd19a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":543223824},{"type":"v1","addr":"172.21.15.96:6827","nonce":543223824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":543223824},{"type":"v1","addr":"172.21.15.96:6829","nonce":543223824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6832","nonce":543223824},{"type":"v1","addr":"172.21.15.96:6833","nonce":543223824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":543223824},{"type":"v1","addr":"172.21.15.96:6831","nonce":543223824}]},"public_addr":"172.21.15.96:6827/543223824","cluster_addr":"172.21.15.96:6829/543223824","heartbeat_back_addr":"172.21.15.96:6833/543223824","heartbeat_front_addr":"172.21.15.96:6831/543223824","state":["exists","up"]},{"osd":10,"uuid":"6c2b6757-60c2-4962-9409-6051dcb13273","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":2323107912},{"type":"v1","addr":"172.21.15.133:6825","nonce":2323107912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":2323107912},{"type":"v1","addr":"172.21.15.133:6827","nonce":2323107912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":2323107912},{"type":"v1","addr":"172.21.15.133:6831","nonce":2323107912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":2323107912},{"type":"v1","addr":"172.21.15.133:6829","nonce":2323107912}]},"public_addr":"172.21.15.133:6825/2323107912","cluster_addr":"172.21.15.133:6827/2323107912","heartbeat_back_addr":"172.21.15.133:6831/2323107912","heartbeat_front_addr":"172.21.15.133:6829/2323107912","state":["exists","up"]},{"osd":11,"uuid":"03c0bb25-2921-446b-960e-6a7a328d36a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":3853499290},{"type":"v1","addr":"172.21.15.186:6825","nonce":3853499290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":3853499290},{"type":"v1","addr":"172.21.15.186:6827","nonce":3853499290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":3853499290},{"type":"v1","addr":"172.21.15.186:6831","nonce":3853499290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":3853499290},{"type":"v1","addr":"172.21.15.186:6829","nonce":3853499290}]},"public_addr":"172.21.15.186:6825/3853499290","cluster_addr":"172.21.15.186:6827/3853499290","heartbeat_back_addr":"172.21.15.186:6831/3853499290","heartbeat_front_addr":"172.21.15.186:6829/3853499290","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:36:02.087281+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:36:24.328783+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:36:46.135576+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:37:08.524145+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:37:30.883871+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:37:53.344554+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:38:15.448162+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:38:37.414878+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:38:59.533953+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:39:21.392102+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:39:43.462696+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:40:05.561808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.96:0/1333468881":"2023-05-09T03:34:37.472043+0000","172.21.15.96:6800/1979917756":"2023-05-09T03:34:37.472043+0000","172.21.15.96:0/1332045367":"2023-05-09T03:34:37.472043+0000","172.21.15.96:0/520278090":"2023-05-09T03:34:14.800324+0000","172.21.15.96:0/1055409415":"2023-05-09T03:34:37.472043+0000","172.21.15.96:6801/1979917756":"2023-05-09T03:34:37.472043+0000","172.21.15.96:0/1541933328":"2023-05-09T03:34:14.800324+0000","172.21.15.96:6800/3944122753":"2023-05-09T03:34:14.800324+0000","172.21.15.96:0/2986058319":"2023-05-09T03:34:14.800324+0000","172.21.15.96:6801/3944122753":"2023-05-09T03:34:14.800324+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-08T03:40:18.429 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.427+0000 7fec1138e700 1 -- 172.21.15.96:0/1217253043 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7febf40a1150 msgr2=0x7febf40a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:18.429 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.427+0000 7fec1138e700 1 --2- 172.21.15.96:0/1217253043 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7febf40a1150 0x7febf40a3600 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fec00009be0 tx=0x7fec00009260 comp rx=0 tx=0).stop 2023-05-08T03:40:18.430 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.427+0000 7fec1138e700 1 -- 172.21.15.96:0/1217253043 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec0c0fea90 msgr2=0x7fec0c196220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:18.430 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.427+0000 7fec1138e700 1 --2- 172.21.15.96:0/1217253043 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec0c0fea90 0x7fec0c196220 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7febfc00d980 tx=0x7febfc00dc90 comp rx=0 tx=0).stop 2023-05-08T03:40:18.430 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.427+0000 7fec1138e700 1 -- 172.21.15.96:0/1217253043 shutdown_connections 2023-05-08T03:40:18.430 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.427+0000 7fec1138e700 1 --2- 172.21.15.96:0/1217253043 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7febf40a1150 0x7febf40a3600 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:18.430 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.427+0000 7fec1138e700 1 --2- 172.21.15.96:0/1217253043 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fec0c100610 0x7fec0c19d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:18.430 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.427+0000 7fec1138e700 1 --2- 172.21.15.96:0/1217253043 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec0c0fea90 0x7fec0c196220 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:18.430 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.427+0000 7fec1138e700 1 --2- 172.21.15.96:0/1217253043 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fec0c0ffc80 0x7fec0c196760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:18.431 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.427+0000 7fec1138e700 1 -- 172.21.15.96:0/1217253043 >> 172.21.15.96:0/1217253043 conn(0x7fec0c0fa0b0 msgr2=0x7fec0c103110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:18.431 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.427+0000 7fec1138e700 1 -- 172.21.15.96:0/1217253043 shutdown_connections 2023-05-08T03:40:18.431 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.427+0000 7fec1138e700 1 -- 172.21.15.96:0/1217253043 wait complete. 2023-05-08T03:40:18.442 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-08T03:36:47.800739+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-08T03:40:18.442 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-08T03:40:18.567 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.564+0000 7f37de474700 1 -- 172.21.15.96:0/2204814238 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37d8100df0 msgr2=0x7f37d8107690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:18.567 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.564+0000 7f37de474700 1 --2- 172.21.15.96:0/2204814238 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37d8100df0 0x7f37d8107690 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f37d000b0a0 tx=0x7f37d000b3b0 comp rx=0 tx=0).stop 2023-05-08T03:40:18.567 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.564+0000 7f37de474700 1 -- 172.21.15.96:0/2204814238 shutdown_connections 2023-05-08T03:40:18.567 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.564+0000 7f37de474700 1 --2- 172.21.15.96:0/2204814238 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37d8100df0 0x7f37d8107690 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:18.568 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.564+0000 7f37de474700 1 --2- 172.21.15.96:0/2204814238 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f37d80ff730 0x7f37d80ffb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:18.568 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.564+0000 7f37de474700 1 --2- 172.21.15.96:0/2204814238 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f37d8100440 0x7f37d81008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:18.568 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.564+0000 7f37de474700 1 -- 172.21.15.96:0/2204814238 >> 172.21.15.96:0/2204814238 conn(0x7f37d80f9fd0 msgr2=0x7f37d80fc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:18.568 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.564+0000 7f37de474700 1 -- 172.21.15.96:0/2204814238 shutdown_connections 2023-05-08T03:40:18.568 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.564+0000 7f37de474700 1 -- 172.21.15.96:0/2204814238 wait complete. 2023-05-08T03:40:18.568 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.565+0000 7f37de474700 1 Processor -- start 2023-05-08T03:40:18.568 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.565+0000 7f37de474700 1 -- start start 2023-05-08T03:40:18.570 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.565+0000 7f37de474700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f37d80ff730 0x7f37d8103540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:18.571 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.565+0000 7f37de474700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f37d8100440 0x7f37d8101b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:18.571 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.565+0000 7f37de474700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37d8100df0 0x7f37d81020c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:18.571 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.565+0000 7f37de474700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37d8102860 con 0x7f37d8100df0 2023-05-08T03:40:18.571 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.565+0000 7f37de474700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37d81029d0 con 0x7f37d80ff730 2023-05-08T03:40:18.571 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.565+0000 7f37de474700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37d81a0280 con 0x7f37d8100440 2023-05-08T03:40:18.571 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.565+0000 7f37dca11700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37d8100df0 0x7f37d81020c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:18.572 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.565+0000 7f37dca11700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37d8100df0 0x7f37d81020c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40122/0 (socket says 172.21.15.96:40122) 2023-05-08T03:40:18.572 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.565+0000 7f37dca11700 1 -- 172.21.15.96:0/323313854 learned_addr learned my addr 172.21.15.96:0/323313854 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:40:18.572 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.565+0000 7f37d7fff700 1 --2- 172.21.15.96:0/323313854 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f37d80ff730 0x7f37d8103540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:18.572 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.565+0000 7f37d77fe700 1 --2- 172.21.15.96:0/323313854 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f37d8100440 0x7f37d8101b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:18.572 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.565+0000 7f37dca11700 1 -- 172.21.15.96:0/323313854 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f37d8100440 msgr2=0x7f37d8101b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:18.572 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.565+0000 7f37dca11700 1 --2- 172.21.15.96:0/323313854 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f37d8100440 0x7f37d8101b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:18.572 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.565+0000 7f37dca11700 1 -- 172.21.15.96:0/323313854 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f37d80ff730 msgr2=0x7f37d8103540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:18.573 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.565+0000 7f37dca11700 1 --2- 172.21.15.96:0/323313854 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f37d80ff730 0x7f37d8103540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:18.573 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.565+0000 7f37dca11700 1 -- 172.21.15.96:0/323313854 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37d0009d00 con 0x7f37d8100df0 2023-05-08T03:40:18.573 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.565+0000 7f37dca11700 1 --2- 172.21.15.96:0/323313854 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37d8100df0 0x7f37d81020c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f37d000b780 tx=0x7f37d000bd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:18.573 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.566+0000 7f37d57fa700 1 -- 172.21.15.96:0/323313854 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d000e040 con 0x7f37d8100df0 2023-05-08T03:40:18.574 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.566+0000 7f37d57fa700 1 -- 172.21.15.96:0/323313854 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f37d00094a0 con 0x7f37d8100df0 2023-05-08T03:40:18.574 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.566+0000 7f37de474700 1 -- 172.21.15.96:0/323313854 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37d810ac20 con 0x7f37d8100df0 2023-05-08T03:40:18.574 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.566+0000 7f37d57fa700 1 -- 172.21.15.96:0/323313854 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d0005390 con 0x7f37d8100df0 2023-05-08T03:40:18.575 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.566+0000 7f37de474700 1 -- 172.21.15.96:0/323313854 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37d810aa90 con 0x7f37d8100df0 2023-05-08T03:40:18.575 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.567+0000 7f37de474700 1 -- 172.21.15.96:0/323313854 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37d8107380 con 0x7f37d8100df0 2023-05-08T03:40:18.575 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.568+0000 7f37d57fa700 1 -- 172.21.15.96:0/323313854 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f37d001d470 con 0x7f37d8100df0 2023-05-08T03:40:18.575 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.568+0000 7f37d57fa700 1 --2- 172.21.15.96:0/323313854 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f37c40a1150 0x7f37c40a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:18.575 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.568+0000 7f37d7fff700 1 --2- 172.21.15.96:0/323313854 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f37c40a1150 0x7f37c40a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:18.576 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.568+0000 7f37d57fa700 1 -- 172.21.15.96:0/323313854 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f37d00cded0 con 0x7f37d8100df0 2023-05-08T03:40:18.576 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.569+0000 7f37d7fff700 1 --2- 172.21.15.96:0/323313854 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f37c40a1150 0x7f37c40a3600 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f37d8067a40 tx=0x7f37c8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:18.577 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.572+0000 7f37d57fa700 1 -- 172.21.15.96:0/323313854 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f37d0097c70 con 0x7f37d8100df0 2023-05-08T03:40:18.714 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:18 smithi186 ceph-mon[126480]: from='client.24406 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi096=a;smithi096=d;smithi096=g;smithi096=j;smithi133=b;smithi133=e;smithi133=h;smithi133=k;smithi186=c;smithi186=f;smithi186=i;smithi186=l", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:40:18.714 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:18 smithi186 ceph-mon[126480]: Saving service mds.all spec with placement smithi096=a;smithi096=d;smithi096=g;smithi096=j;smithi133=b;smithi133=e;smithi133=h;smithi133=k;smithi186=c;smithi186=f;smithi186=i;smithi186=l;count:12 2023-05-08T03:40:18.714 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:18 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:18.715 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:18 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:40:18.715 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:18 smithi186 ceph-mon[126480]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-05-08T03:40:18.715 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:18 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:40:18.715 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:18 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:40:18.716 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:18 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:18.716 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:18 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-05-08T03:40:18.716 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:18 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-05-08T03:40:18.716 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:18 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:40:18.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:18 smithi133 ceph-mon[125939]: from='client.24406 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi096=a;smithi096=d;smithi096=g;smithi096=j;smithi133=b;smithi133=e;smithi133=h;smithi133=k;smithi186=c;smithi186=f;smithi186=i;smithi186=l", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:40:18.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:18 smithi133 ceph-mon[125939]: Saving service mds.all spec with placement smithi096=a;smithi096=d;smithi096=g;smithi096=j;smithi133=b;smithi133=e;smithi133=h;smithi133=k;smithi186=c;smithi186=f;smithi186=i;smithi186=l;count:12 2023-05-08T03:40:18.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:18 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:18.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:18 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:40:18.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:18 smithi133 ceph-mon[125939]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-05-08T03:40:18.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:18 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:40:18.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:18 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:40:18.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:18 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:18.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:18 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-05-08T03:40:18.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:18 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-05-08T03:40:18.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:18 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:40:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:18 smithi096 ceph-mon[124666]: from='client.24406 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi096=a;smithi096=d;smithi096=g;smithi096=j;smithi133=b;smithi133=e;smithi133=h;smithi133=k;smithi186=c;smithi186=f;smithi186=i;smithi186=l", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:40:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:18 smithi096 ceph-mon[124666]: Saving service mds.all spec with placement smithi096=a;smithi096=d;smithi096=g;smithi096=j;smithi133=b;smithi133=e;smithi133=h;smithi133=k;smithi186=c;smithi186=f;smithi186=i;smithi186=l;count:12 2023-05-08T03:40:18.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:18 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:18.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:18 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:40:18.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:18 smithi096 ceph-mon[124666]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-05-08T03:40:18.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:18 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:40:18.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:18 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:40:18.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:18 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:18.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:18 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-05-08T03:40:18.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:18 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-05-08T03:40:18.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:18 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:40:18.764 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.761+0000 7f37de474700 1 -- 172.21.15.96:0/323313854 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f37d8067260 con 0x7f37d8100df0 2023-05-08T03:40:18.764 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.761+0000 7f37d57fa700 1 -- 172.21.15.96:0/323313854 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v78) v1 ==== 93+0+10 (secure 0 0 0) 0x7f37d009b290 con 0x7f37d8100df0 2023-05-08T03:40:18.764 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2023-05-08T03:40:18.766 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.763+0000 7f37de474700 1 -- 172.21.15.96:0/323313854 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f37c40a1150 msgr2=0x7f37c40a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:18.766 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.763+0000 7f37de474700 1 --2- 172.21.15.96:0/323313854 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f37c40a1150 0x7f37c40a3600 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f37d8067a40 tx=0x7f37c8009260 comp rx=0 tx=0).stop 2023-05-08T03:40:18.766 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.763+0000 7f37de474700 1 -- 172.21.15.96:0/323313854 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37d8100df0 msgr2=0x7f37d81020c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:18.766 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.763+0000 7f37de474700 1 --2- 172.21.15.96:0/323313854 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37d8100df0 0x7f37d81020c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f37d000b780 tx=0x7f37d000bd60 comp rx=0 tx=0).stop 2023-05-08T03:40:18.767 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.764+0000 7f37de474700 1 -- 172.21.15.96:0/323313854 shutdown_connections 2023-05-08T03:40:18.767 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.764+0000 7f37de474700 1 --2- 172.21.15.96:0/323313854 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f37c40a1150 0x7f37c40a3600 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:18.767 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.764+0000 7f37de474700 1 --2- 172.21.15.96:0/323313854 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37d8100df0 0x7f37d81020c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:18.767 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.764+0000 7f37de474700 1 --2- 172.21.15.96:0/323313854 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f37d80ff730 0x7f37d8103540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:18.767 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.764+0000 7f37de474700 1 --2- 172.21.15.96:0/323313854 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f37d8100440 0x7f37d8101b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:18.767 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.764+0000 7f37de474700 1 -- 172.21.15.96:0/323313854 >> 172.21.15.96:0/323313854 conn(0x7f37d80f9fd0 msgr2=0x7f37d80fc1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:18.767 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.764+0000 7f37de474700 1 -- 172.21.15.96:0/323313854 shutdown_connections 2023-05-08T03:40:18.767 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.764+0000 7f37de474700 1 -- 172.21.15.96:0/323313854 wait complete. 2023-05-08T03:40:18.778 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-08T03:40:18.902 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.896+0000 7fb33c7a8700 1 -- 172.21.15.96:0/2612822600 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb334101ec0 msgr2=0x7fb334108780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:18.903 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.896+0000 7fb33c7a8700 1 --2- 172.21.15.96:0/2612822600 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb334101ec0 0x7fb334108780 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb32c00b0a0 tx=0x7fb32c00b3b0 comp rx=0 tx=0).stop 2023-05-08T03:40:18.903 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.896+0000 7fb33c7a8700 1 -- 172.21.15.96:0/2612822600 shutdown_connections 2023-05-08T03:40:18.903 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.896+0000 7fb33c7a8700 1 --2- 172.21.15.96:0/2612822600 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb334101ec0 0x7fb334108780 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:18.903 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.896+0000 7fb33c7a8700 1 --2- 172.21.15.96:0/2612822600 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb334100340 0x7fb334100750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:18.903 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.896+0000 7fb33c7a8700 1 --2- 172.21.15.96:0/2612822600 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb334101530 0x7fb334101980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:18.904 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.896+0000 7fb33c7a8700 1 -- 172.21.15.96:0/2612822600 >> 172.21.15.96:0/2612822600 conn(0x7fb3340fb920 msgr2=0x7fb3340fdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:18.904 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.896+0000 7fb33c7a8700 1 -- 172.21.15.96:0/2612822600 shutdown_connections 2023-05-08T03:40:18.904 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.896+0000 7fb33c7a8700 1 -- 172.21.15.96:0/2612822600 wait complete. 2023-05-08T03:40:18.904 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.897+0000 7fb33c7a8700 1 Processor -- start 2023-05-08T03:40:18.904 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.897+0000 7fb33c7a8700 1 -- start start 2023-05-08T03:40:18.904 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.897+0000 7fb33c7a8700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb334100340 0x7fb334196140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:18.904 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.897+0000 7fb33c7a8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb334101530 0x7fb334196680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:18.905 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.897+0000 7fb33c7a8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb334101ec0 0x7fb33419d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:18.905 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.897+0000 7fb33c7a8700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb33419dcc0 con 0x7fb334101530 2023-05-08T03:40:18.905 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.897+0000 7fb33c7a8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb33419de00 con 0x7fb334101ec0 2023-05-08T03:40:18.905 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.897+0000 7fb33c7a8700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb33419df90 con 0x7fb334100340 2023-05-08T03:40:18.905 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.897+0000 7fb339d43700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb334101530 0x7fb334196680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:18.905 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.897+0000 7fb339d43700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb334101530 0x7fb334196680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40134/0 (socket says 172.21.15.96:40134) 2023-05-08T03:40:18.905 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.897+0000 7fb33a544700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb334100340 0x7fb334196140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:18.906 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.897+0000 7fb339d43700 1 -- 172.21.15.96:0/2576563509 learned_addr learned my addr 172.21.15.96:0/2576563509 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:40:18.906 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.897+0000 7fb33ad45700 1 --2- 172.21.15.96:0/2576563509 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb334101ec0 0x7fb33419d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:18.906 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.898+0000 7fb339d43700 1 -- 172.21.15.96:0/2576563509 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb334100340 msgr2=0x7fb334196140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:18.906 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.898+0000 7fb339d43700 1 --2- 172.21.15.96:0/2576563509 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb334100340 0x7fb334196140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:18.906 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.898+0000 7fb339d43700 1 -- 172.21.15.96:0/2576563509 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb334101ec0 msgr2=0x7fb33419d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:18.906 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.898+0000 7fb339d43700 1 --2- 172.21.15.96:0/2576563509 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb334101ec0 0x7fb33419d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:18.906 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.898+0000 7fb339d43700 1 -- 172.21.15.96:0/2576563509 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb32c009d00 con 0x7fb334101530 2023-05-08T03:40:18.906 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.898+0000 7fb33ad45700 1 --2- 172.21.15.96:0/2576563509 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb334101ec0 0x7fb33419d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-08T03:40:18.907 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.898+0000 7fb339d43700 1 --2- 172.21.15.96:0/2576563509 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb334101530 0x7fb334196680 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb33000c9b0 tx=0x7fb33000ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:18.907 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.898+0000 7fb32b7fe700 1 -- 172.21.15.96:0/2576563509 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb330007b00 con 0x7fb334101530 2023-05-08T03:40:18.907 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.898+0000 7fb32b7fe700 1 -- 172.21.15.96:0/2576563509 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb330007c60 con 0x7fb334101530 2023-05-08T03:40:18.907 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.898+0000 7fb33c7a8700 1 -- 172.21.15.96:0/2576563509 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb33410bcf0 con 0x7fb334101530 2023-05-08T03:40:18.907 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.898+0000 7fb32b7fe700 1 -- 172.21.15.96:0/2576563509 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb330018660 con 0x7fb334101530 2023-05-08T03:40:18.907 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.898+0000 7fb33c7a8700 1 -- 172.21.15.96:0/2576563509 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb33410bb60 con 0x7fb334101530 2023-05-08T03:40:18.907 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.899+0000 7fb33c7a8700 1 -- 172.21.15.96:0/2576563509 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb334107130 con 0x7fb334101530 2023-05-08T03:40:18.908 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.901+0000 7fb32b7fe700 1 -- 172.21.15.96:0/2576563509 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fb33000f450 con 0x7fb334101530 2023-05-08T03:40:18.908 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.901+0000 7fb32b7fe700 1 --2- 172.21.15.96:0/2576563509 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fb3200a11d0 0x7fb3200a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:18.909 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.901+0000 7fb32b7fe700 1 -- 172.21.15.96:0/2576563509 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fb3300cc680 con 0x7fb334101530 2023-05-08T03:40:18.909 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.901+0000 7fb33a544700 1 --2- 172.21.15.96:0/2576563509 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fb3200a11d0 0x7fb3200a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:18.909 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.902+0000 7fb33a544700 1 --2- 172.21.15.96:0/2576563509 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fb3200a11d0 0x7fb3200a3680 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb334101390 tx=0x7fb32400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:18.909 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:18.905+0000 7fb32b7fe700 1 -- 172.21.15.96:0/2576563509 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fb330096380 con 0x7fb334101530 2023-05-08T03:40:19.140 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:19.137+0000 7fb33c7a8700 1 -- 172.21.15.96:0/2576563509 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb33402d0e0 con 0x7fb334101530 2023-05-08T03:40:19.141 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:19.138+0000 7fb32b7fe700 1 -- 172.21.15.96:0/2576563509 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+501 (secure 0 0 0) 0x7fb3300999a0 con 0x7fb334101530 2023-05-08T03:40:19.141 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:40:19.142 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2023-05-08T03:40:19.143 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:19.140+0000 7fb33c7a8700 1 -- 172.21.15.96:0/2576563509 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fb3200a11d0 msgr2=0x7fb3200a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:19.143 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:19.140+0000 7fb33c7a8700 1 --2- 172.21.15.96:0/2576563509 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fb3200a11d0 0x7fb3200a3680 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb334101390 tx=0x7fb32400b410 comp rx=0 tx=0).stop 2023-05-08T03:40:19.144 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:19.140+0000 7fb33c7a8700 1 -- 172.21.15.96:0/2576563509 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb334101530 msgr2=0x7fb334196680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:19.144 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:19.140+0000 7fb33c7a8700 1 --2- 172.21.15.96:0/2576563509 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb334101530 0x7fb334196680 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb33000c9b0 tx=0x7fb33000ccc0 comp rx=0 tx=0).stop 2023-05-08T03:40:19.144 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:19.140+0000 7fb33c7a8700 1 -- 172.21.15.96:0/2576563509 shutdown_connections 2023-05-08T03:40:19.144 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:19.140+0000 7fb33c7a8700 1 --2- 172.21.15.96:0/2576563509 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fb3200a11d0 0x7fb3200a3680 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:19.144 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:19.140+0000 7fb33c7a8700 1 --2- 172.21.15.96:0/2576563509 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb334101ec0 0x7fb33419d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:19.145 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:19.140+0000 7fb33c7a8700 1 --2- 172.21.15.96:0/2576563509 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb334100340 0x7fb334196140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:19.145 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:19.140+0000 7fb33c7a8700 1 --2- 172.21.15.96:0/2576563509 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb334101530 0x7fb334196680 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:19.145 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:19.140+0000 7fb33c7a8700 1 -- 172.21.15.96:0/2576563509 >> 172.21.15.96:0/2576563509 conn(0x7fb3340fb920 msgr2=0x7fb3340fdab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:19.145 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:19.140+0000 7fb33c7a8700 1 -- 172.21.15.96:0/2576563509 shutdown_connections 2023-05-08T03:40:19.145 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:19.140+0000 7fb33c7a8700 1 -- 172.21.15.96:0/2576563509 wait complete. 2023-05-08T03:40:19.146 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 1 2023-05-08T03:40:19.598 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:19 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:40:19.599 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:19 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T03:40:19.599 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:19 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:40:19.599 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:19 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T03:40:19.599 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:19 smithi186 ceph-mon[126480]: Deploying daemon mds.l on smithi186 2023-05-08T03:40:19.599 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:19 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/1217253043' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-05-08T03:40:19.599 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:19 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/323313854' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-05-08T03:40:19.599 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:19 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/2576563509' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-05-08T03:40:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:19 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:40:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:19 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T03:40:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:19 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:40:19.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:19 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T03:40:19.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:19 smithi133 ceph-mon[125939]: Deploying daemon mds.l on smithi186 2023-05-08T03:40:19.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:19 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/1217253043' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-05-08T03:40:19.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:19 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/323313854' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-05-08T03:40:19.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:19 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/2576563509' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-05-08T03:40:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:19 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:40:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:19 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T03:40:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:19 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:40:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:19 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T03:40:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:19 smithi096 ceph-mon[124666]: Deploying daemon mds.l on smithi186 2023-05-08T03:40:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:19 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/1217253043' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-05-08T03:40:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:19 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/323313854' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-05-08T03:40:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:19 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/2576563509' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-05-08T03:40:19.869 INFO:journalctl@ceph.mds.l.smithi186.stdout:May 08 03:40:19 smithi186 systemd[1]: Starting Ceph mds.l for f7ffcfb0-ed50-11ed-9b01-001a4aab830c... 2023-05-08T03:40:20.188 INFO:journalctl@ceph.mds.l.smithi186.stdout:May 08 03:40:19 smithi186 podman[151721]: 2023-05-08T03:40:20.619 INFO:journalctl@ceph.mds.l.smithi186.stdout:May 08 03:40:20 smithi186 ceph-mds[151761]: -- 172.21.15.186:0/3747104826 <== mon.1 v2:172.21.15.186:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55b7c6358b60 con 0x55b7c632e800 2023-05-08T03:40:20.619 INFO:journalctl@ceph.mds.l.smithi186.stdout:May 08 03:40:20 smithi186 bash[151721]: 5e63bd912e19ed37c20ac5f187d2f9f09ed8ee8efbe517b32e3b33e33e9958a0 2023-05-08T03:40:20.619 INFO:journalctl@ceph.mds.l.smithi186.stdout:May 08 03:40:20 smithi186 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mds-l[151737]: starting mds.l at 2023-05-08T03:40:20.620 INFO:journalctl@ceph.mds.l.smithi186.stdout:May 08 03:40:20 smithi186 systemd[1]: Started Ceph mds.l for f7ffcfb0-ed50-11ed-9b01-001a4aab830c. 2023-05-08T03:40:20.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:20 smithi186 ceph-mon[126480]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-05-08T03:40:20.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:20 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6832/2274306880,v1:172.21.15.186:6833/2274306880] up:boot 2023-05-08T03:40:20.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:20 smithi186 ceph-mon[126480]: fsmap 1 up:standby 2023-05-08T03:40:20.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:20 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-05-08T03:40:20.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:20 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:20.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:20 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:20.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:20 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:20.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:20 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-05-08T03:40:20.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:20 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-05-08T03:40:20.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:20 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:40:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:20 smithi133 ceph-mon[125939]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-05-08T03:40:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:20 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6832/2274306880,v1:172.21.15.186:6833/2274306880] up:boot 2023-05-08T03:40:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:20 smithi133 ceph-mon[125939]: fsmap 1 up:standby 2023-05-08T03:40:20.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:20 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-05-08T03:40:20.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:20 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:20.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:20 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:20.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:20 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:20.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:20 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-05-08T03:40:20.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:20 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-05-08T03:40:20.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:20 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:40:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:20 smithi096 ceph-mon[124666]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-05-08T03:40:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:20 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6832/2274306880,v1:172.21.15.186:6833/2274306880] up:boot 2023-05-08T03:40:20.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:20 smithi096 ceph-mon[124666]: fsmap 1 up:standby 2023-05-08T03:40:20.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:20 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-05-08T03:40:20.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:20 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:20.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:20 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:20.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:20 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:20.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:20 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-05-08T03:40:20.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:20 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-05-08T03:40:20.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:20 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:40:21.156 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-08T03:40:21.296 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:21.290+0000 7f4b7d154700 1 -- 172.21.15.96:0/4124901466 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b78101670 msgr2=0x7f4b78101ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:21.296 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:21.290+0000 7f4b7d154700 1 --2- 172.21.15.96:0/4124901466 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b78101670 0x7f4b78101ac0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4b68009990 tx=0x7f4b68009ca0 comp rx=0 tx=0).stop 2023-05-08T03:40:21.297 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:21.290+0000 7f4b7d154700 1 -- 172.21.15.96:0/4124901466 shutdown_connections 2023-05-08T03:40:21.297 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:21.290+0000 7f4b7d154700 1 --2- 172.21.15.96:0/4124901466 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b78102000 0x7f4b781088c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:21.297 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:21.290+0000 7f4b7d154700 1 --2- 172.21.15.96:0/4124901466 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4b780fe600 0x7f4b780fea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:21.297 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:21.290+0000 7f4b7d154700 1 --2- 172.21.15.96:0/4124901466 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b78101670 0x7f4b78101ac0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:21.298 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:21.290+0000 7f4b7d154700 1 -- 172.21.15.96:0/4124901466 >> 172.21.15.96:0/4124901466 conn(0x7f4b780f9f80 msgr2=0x7f4b780fc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:21.298 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:21.290+0000 7f4b7d154700 1 -- 172.21.15.96:0/4124901466 shutdown_connections 2023-05-08T03:40:21.298 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:21.290+0000 7f4b7d154700 1 -- 172.21.15.96:0/4124901466 wait complete. 2023-05-08T03:40:21.298 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:21.291+0000 7f4b7d154700 1 Processor -- start 2023-05-08T03:40:21.299 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:21.291+0000 7f4b7d154700 1 -- start start 2023-05-08T03:40:21.299 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:21.291+0000 7f4b7d154700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b780fe600 0x7f4b78196010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:21.299 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:21.291+0000 7f4b7d154700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b78101670 0x7f4b78196550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:21.299 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:21.291+0000 7f4b7d154700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4b78102000 0x7f4b7819d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:21.300 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:21.291+0000 7f4b7d154700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7819db90 con 0x7f4b780fe600 2023-05-08T03:40:21.300 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:21.291+0000 7f4b7d154700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7819dcd0 con 0x7f4b78101670 2023-05-08T03:40:21.300 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:21.291+0000 7f4b7d154700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7819de60 con 0x7f4b78102000 2023-05-08T03:40:21.301 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:21.291+0000 7f4b76d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b780fe600 0x7f4b78196010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:21.301 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:21.291+0000 7f4b76d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b780fe600 0x7f4b78196010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40146/0 (socket says 172.21.15.96:40146) 2023-05-08T03:40:21.301 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:21.291+0000 7f4b76d9d700 1 -- 172.21.15.96:0/466591522 learned_addr learned my addr 172.21.15.96:0/466591522 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:40:21.301 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:21.291+0000 7f4b7659c700 1 --2- 172.21.15.96:0/466591522 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b78101670 0x7f4b78196550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:21.301 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:21.292+0000 7f4b7759e700 1 --2- 172.21.15.96:0/466591522 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4b78102000 0x7f4b7819d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:21.301 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:21.292+0000 7f4b76d9d700 1 -- 172.21.15.96:0/466591522 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4b78102000 msgr2=0x7f4b7819d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:21.302 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:21.292+0000 7f4b76d9d700 1 --2- 172.21.15.96:0/466591522 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4b78102000 0x7f4b7819d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:21.302 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:21.292+0000 7f4b76d9d700 1 -- 172.21.15.96:0/466591522 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b78101670 msgr2=0x7f4b78196550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:21.302 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:21.292+0000 7f4b76d9d700 1 --2- 172.21.15.96:0/466591522 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b78101670 0x7f4b78196550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:21.302 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:21.292+0000 7f4b76d9d700 1 -- 172.21.15.96:0/466591522 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b680095f0 con 0x7f4b780fe600 2023-05-08T03:40:21.302 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:21.292+0000 7f4b76d9d700 1 --2- 172.21.15.96:0/466591522 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b780fe600 0x7f4b78196010 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c00c990 tx=0x7f4b6c00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:21.302 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:21.292+0000 7f4b5ffff700 1 -- 172.21.15.96:0/466591522 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b6c007b00 con 0x7f4b780fe600 2023-05-08T03:40:21.302 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:21.292+0000 7f4b7d154700 1 -- 172.21.15.96:0/466591522 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b7810bc70 con 0x7f4b780fe600 2023-05-08T03:40:21.303 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:21.292+0000 7f4b5ffff700 1 -- 172.21.15.96:0/466591522 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4b6c007c60 con 0x7f4b780fe600 2023-05-08T03:40:21.303 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:21.292+0000 7f4b5ffff700 1 -- 172.21.15.96:0/466591522 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b6c00fea0 con 0x7f4b780fe600 2023-05-08T03:40:21.303 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:21.292+0000 7f4b7d154700 1 -- 172.21.15.96:0/466591522 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b7810bae0 con 0x7f4b780fe600 2023-05-08T03:40:21.304 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:21.293+0000 7f4b7d154700 1 -- 172.21.15.96:0/466591522 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b78107380 con 0x7f4b780fe600 2023-05-08T03:40:21.306 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:21.294+0000 7f4b5ffff700 1 -- 172.21.15.96:0/466591522 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f4b6c00f450 con 0x7f4b780fe600 2023-05-08T03:40:21.306 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:21.295+0000 7f4b5ffff700 1 --2- 172.21.15.96:0/466591522 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f4b600a1150 0x7f4b600a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:21.306 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:21.295+0000 7f4b7659c700 1 --2- 172.21.15.96:0/466591522 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f4b600a1150 0x7f4b600a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:21.306 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:21.295+0000 7f4b5ffff700 1 -- 172.21.15.96:0/466591522 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f4b6c0cc530 con 0x7f4b780fe600 2023-05-08T03:40:21.306 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:21.295+0000 7f4b7659c700 1 --2- 172.21.15.96:0/466591522 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f4b600a1150 0x7f4b600a3600 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4b6800b2e0 tx=0x7f4b68005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:21.306 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:21.299+0000 7f4b5ffff700 1 -- 172.21.15.96:0/466591522 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f4b6c0961b0 con 0x7f4b780fe600 2023-05-08T03:40:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:21 smithi096 ceph-mon[124666]: Deploying daemon mds.k on smithi133 2023-05-08T03:40:21.536 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:21.533+0000 7f4b7d154700 1 -- 172.21.15.96:0/466591522 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4b7802d0e0 con 0x7f4b780fe600 2023-05-08T03:40:21.536 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:21.533+0000 7f4b5ffff700 1 -- 172.21.15.96:0/466591522 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1260 (secure 0 0 0) 0x7f4b6c0997d0 con 0x7f4b780fe600 2023-05-08T03:40:21.537 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:40:21.537 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/2274306880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":2274306880},{"type":"v1","addr":"172.21.15.186:6833","nonce":2274306880}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-05-08T03:40:21.538 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:21.535+0000 7f4b7d154700 1 -- 172.21.15.96:0/466591522 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f4b600a1150 msgr2=0x7f4b600a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:21.538 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:21.535+0000 7f4b7d154700 1 --2- 172.21.15.96:0/466591522 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f4b600a1150 0x7f4b600a3600 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4b6800b2e0 tx=0x7f4b68005fb0 comp rx=0 tx=0).stop 2023-05-08T03:40:21.538 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:21.535+0000 7f4b7d154700 1 -- 172.21.15.96:0/466591522 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b780fe600 msgr2=0x7f4b78196010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:21.538 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:21.535+0000 7f4b7d154700 1 --2- 172.21.15.96:0/466591522 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b780fe600 0x7f4b78196010 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c00c990 tx=0x7f4b6c00cca0 comp rx=0 tx=0).stop 2023-05-08T03:40:21.538 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:21.536+0000 7f4b7d154700 1 -- 172.21.15.96:0/466591522 shutdown_connections 2023-05-08T03:40:21.539 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:21.536+0000 7f4b7d154700 1 --2- 172.21.15.96:0/466591522 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f4b600a1150 0x7f4b600a3600 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:21.539 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:21.536+0000 7f4b7d154700 1 --2- 172.21.15.96:0/466591522 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4b78102000 0x7f4b7819d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:21.539 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:21.536+0000 7f4b7d154700 1 --2- 172.21.15.96:0/466591522 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b780fe600 0x7f4b78196010 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:21.539 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:21.536+0000 7f4b7d154700 1 --2- 172.21.15.96:0/466591522 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b78101670 0x7f4b78196550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:21.539 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:21.536+0000 7f4b7d154700 1 -- 172.21.15.96:0/466591522 >> 172.21.15.96:0/466591522 conn(0x7f4b780f9f80 msgr2=0x7f4b780fc210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:21.539 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:21.536+0000 7f4b7d154700 1 -- 172.21.15.96:0/466591522 shutdown_connections 2023-05-08T03:40:21.539 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:21.536+0000 7f4b7d154700 1 -- 172.21.15.96:0/466591522 wait complete. 2023-05-08T03:40:21.540 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 2 2023-05-08T03:40:21.646 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:21 smithi133 ceph-mon[125939]: Deploying daemon mds.k on smithi133 2023-05-08T03:40:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:21 smithi186 ceph-mon[126480]: Deploying daemon mds.k on smithi133 2023-05-08T03:40:21.990 INFO:journalctl@ceph.mds.k.smithi133.stdout:May 08 03:40:21 smithi133 systemd[1]: Starting Ceph mds.k for f7ffcfb0-ed50-11ed-9b01-001a4aab830c... 2023-05-08T03:40:22.389 INFO:journalctl@ceph.mds.k.smithi133.stdout:May 08 03:40:22 smithi133 podman[150429]: 2023-05-08T03:40:22.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:22 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/466591522' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-05-08T03:40:22.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:22 smithi133 ceph-mon[125939]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-05-08T03:40:22.740 INFO:journalctl@ceph.mds.k.smithi133.stdout:May 08 03:40:22 smithi133 bash[150429]: cc953c2f5957412690d65ed07f053d527032048e325690af57bedb2e1566a322 2023-05-08T03:40:22.741 INFO:journalctl@ceph.mds.k.smithi133.stdout:May 08 03:40:22 smithi133 ceph-mds[150469]: -- 172.21.15.133:0/3330505640 <== mon.2 v2:172.21.15.133:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55a8d9f70b60 con 0x55a8d9f46800 2023-05-08T03:40:22.741 INFO:journalctl@ceph.mds.k.smithi133.stdout:May 08 03:40:22 smithi133 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mds-k[150445]: starting mds.k at 2023-05-08T03:40:22.741 INFO:journalctl@ceph.mds.k.smithi133.stdout:May 08 03:40:22 smithi133 systemd[1]: Started Ceph mds.k for f7ffcfb0-ed50-11ed-9b01-001a4aab830c. 2023-05-08T03:40:22.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:22 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/466591522' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-05-08T03:40:22.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:22 smithi096 ceph-mon[124666]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-05-08T03:40:22.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:22 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/466591522' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-05-08T03:40:22.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:22 smithi186 ceph-mon[126480]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-05-08T03:40:23.551 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-08T03:40:23.576 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:23 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:23.576 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:23 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:23.576 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:23 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:23.577 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:23 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-05-08T03:40:23.577 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:23 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-05-08T03:40:23.577 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:23 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:40:23.577 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:23 smithi096 ceph-mon[124666]: Deploying daemon mds.j on smithi096 2023-05-08T03:40:23.577 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:23 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6832/2351258784,v1:172.21.15.133:6833/2351258784] up:boot 2023-05-08T03:40:23.577 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:23 smithi096 ceph-mon[124666]: fsmap 2 up:standby 2023-05-08T03:40:23.577 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:23 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-05-08T03:40:23.678 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:23.676+0000 7ff59a90a700 1 -- 172.21.15.96:0/2358881412 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff594101520 msgr2=0x7ff594101970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:23.679 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:23.676+0000 7ff59a90a700 1 --2- 172.21.15.96:0/2358881412 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff594101520 0x7ff594101970 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff57c009990 tx=0x7ff57c009ca0 comp rx=0 tx=0).stop 2023-05-08T03:40:23.679 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:23.676+0000 7ff59a90a700 1 -- 172.21.15.96:0/2358881412 shutdown_connections 2023-05-08T03:40:23.679 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:23.676+0000 7ff59a90a700 1 --2- 172.21.15.96:0/2358881412 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff594101eb0 0x7ff594108770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:23.679 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:23.676+0000 7ff59a90a700 1 --2- 172.21.15.96:0/2358881412 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff594100330 0x7ff594100740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:23.679 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:23.676+0000 7ff59a90a700 1 --2- 172.21.15.96:0/2358881412 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff594101520 0x7ff594101970 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:23.679 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:23.676+0000 7ff59a90a700 1 -- 172.21.15.96:0/2358881412 >> 172.21.15.96:0/2358881412 conn(0x7ff5940fb910 msgr2=0x7ff5940fdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:23.680 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:23.676+0000 7ff59a90a700 1 -- 172.21.15.96:0/2358881412 shutdown_connections 2023-05-08T03:40:23.680 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:23.676+0000 7ff59a90a700 1 -- 172.21.15.96:0/2358881412 wait complete. 2023-05-08T03:40:23.681 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:23.677+0000 7ff59a90a700 1 Processor -- start 2023-05-08T03:40:23.682 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:23.677+0000 7ff59a90a700 1 -- start start 2023-05-08T03:40:23.682 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:23.677+0000 7ff59a90a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff594100330 0x7ff594196210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:23.682 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:23.677+0000 7ff59a90a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff594101520 0x7ff594196750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:23.682 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:23.677+0000 7ff59a90a700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff594101eb0 0x7ff59419d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:23.682 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:23.677+0000 7ff59a90a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff59419dd90 con 0x7ff594101520 2023-05-08T03:40:23.682 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:23.677+0000 7ff59a90a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff59419ded0 con 0x7ff594100330 2023-05-08T03:40:23.683 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:23.677+0000 7ff59a90a700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff59419e060 con 0x7ff594101eb0 2023-05-08T03:40:23.683 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:23.677+0000 7ff58bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff594101520 0x7ff594196750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:23.683 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:23.677+0000 7ff58bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff594101520 0x7ff594196750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40162/0 (socket says 172.21.15.96:40162) 2023-05-08T03:40:23.683 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:23.677+0000 7ff58bfff700 1 -- 172.21.15.96:0/1719067081 learned_addr learned my addr 172.21.15.96:0/1719067081 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:40:23.683 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:23.677+0000 7ff58bfff700 1 -- 172.21.15.96:0/1719067081 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff594101eb0 msgr2=0x7ff59419d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:23.683 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:23.677+0000 7ff58bfff700 1 --2- 172.21.15.96:0/1719067081 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff594101eb0 0x7ff59419d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:23.683 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:23.677+0000 7ff58bfff700 1 -- 172.21.15.96:0/1719067081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff594100330 msgr2=0x7ff594196210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:23.683 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:23.677+0000 7ff593fff700 1 --2- 172.21.15.96:0/1719067081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff594100330 0x7ff594196210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:23.684 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:23.677+0000 7ff58bfff700 1 --2- 172.21.15.96:0/1719067081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff594100330 0x7ff594196210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:23.684 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:23.677+0000 7ff58bfff700 1 -- 172.21.15.96:0/1719067081 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff57c0095f0 con 0x7ff594101520 2023-05-08T03:40:23.684 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:23.677+0000 7ff593fff700 1 --2- 172.21.15.96:0/1719067081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff594100330 0x7ff594196210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-08T03:40:23.684 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:23.677+0000 7ff58bfff700 1 --2- 172.21.15.96:0/1719067081 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff594101520 0x7ff594196750 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff57c004760 tx=0x7ff57c003940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:23.684 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:23.678+0000 7ff591ffb700 1 -- 172.21.15.96:0/1719067081 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff57c01d070 con 0x7ff594101520 2023-05-08T03:40:23.684 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:23.678+0000 7ff591ffb700 1 -- 172.21.15.96:0/1719067081 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff57c005030 con 0x7ff594101520 2023-05-08T03:40:23.685 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:23.678+0000 7ff59a90a700 1 -- 172.21.15.96:0/1719067081 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff59410bdb0 con 0x7ff594101520 2023-05-08T03:40:23.685 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:23.678+0000 7ff591ffb700 1 -- 172.21.15.96:0/1719067081 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff57c004ad0 con 0x7ff594101520 2023-05-08T03:40:23.685 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:23.678+0000 7ff59a90a700 1 -- 172.21.15.96:0/1719067081 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff59410bc20 con 0x7ff594101520 2023-05-08T03:40:23.685 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:23.679+0000 7ff59a90a700 1 -- 172.21.15.96:0/1719067081 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5941072e0 con 0x7ff594101520 2023-05-08T03:40:23.687 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:23.680+0000 7ff591ffb700 1 -- 172.21.15.96:0/1719067081 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7ff57c004c30 con 0x7ff594101520 2023-05-08T03:40:23.687 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:23.680+0000 7ff591ffb700 1 --2- 172.21.15.96:0/1719067081 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7ff5800a1150 0x7ff5800a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:23.687 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:23.680+0000 7ff593fff700 1 --2- 172.21.15.96:0/1719067081 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7ff5800a1150 0x7ff5800a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:23.687 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:23.680+0000 7ff591ffb700 1 -- 172.21.15.96:0/1719067081 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7ff57c0cd9d0 con 0x7ff594101520 2023-05-08T03:40:23.687 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:23.680+0000 7ff593fff700 1 --2- 172.21.15.96:0/1719067081 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7ff5800a1150 0x7ff5800a3600 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff594101380 tx=0x7ff584008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:23.687 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:23.684+0000 7ff591ffb700 1 -- 172.21.15.96:0/1719067081 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7ff57c097650 con 0x7ff594101520 2023-05-08T03:40:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:23 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:23 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:23.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:23 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:23.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:23 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-05-08T03:40:23.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:23 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-05-08T03:40:23.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:23 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:40:23.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:23 smithi186 ceph-mon[126480]: Deploying daemon mds.j on smithi096 2023-05-08T03:40:23.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:23 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6832/2351258784,v1:172.21.15.133:6833/2351258784] up:boot 2023-05-08T03:40:23.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:23 smithi186 ceph-mon[126480]: fsmap 2 up:standby 2023-05-08T03:40:23.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:23 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-05-08T03:40:23.928 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:23.925+0000 7ff59a90a700 1 -- 172.21.15.96:0/1719067081 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff59402d0e0 con 0x7ff594101520 2023-05-08T03:40:23.928 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:23.926+0000 7ff591ffb700 1 -- 172.21.15.96:0/1719067081 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2020 (secure 0 0 0) 0x7ff57c09ac70 con 0x7ff594101520 2023-05-08T03:40:23.929 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:40:23.929 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/2351258784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":2351258784},{"type":"v1","addr":"172.21.15.133:6833","nonce":2351258784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/2274306880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":2274306880},{"type":"v1","addr":"172.21.15.186:6833","nonce":2274306880}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-05-08T03:40:23.930 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:23.928+0000 7ff59a90a700 1 -- 172.21.15.96:0/1719067081 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7ff5800a1150 msgr2=0x7ff5800a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:23.930 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:23.928+0000 7ff59a90a700 1 --2- 172.21.15.96:0/1719067081 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7ff5800a1150 0x7ff5800a3600 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff594101380 tx=0x7ff584008040 comp rx=0 tx=0).stop 2023-05-08T03:40:23.931 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:23.928+0000 7ff59a90a700 1 -- 172.21.15.96:0/1719067081 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff594101520 msgr2=0x7ff594196750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:23.931 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:23.928+0000 7ff59a90a700 1 --2- 172.21.15.96:0/1719067081 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff594101520 0x7ff594196750 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff57c004760 tx=0x7ff57c003940 comp rx=0 tx=0).stop 2023-05-08T03:40:23.931 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:23.928+0000 7ff59a90a700 1 -- 172.21.15.96:0/1719067081 shutdown_connections 2023-05-08T03:40:23.931 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:23.928+0000 7ff59a90a700 1 --2- 172.21.15.96:0/1719067081 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7ff5800a1150 0x7ff5800a3600 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:23.931 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:23.928+0000 7ff59a90a700 1 --2- 172.21.15.96:0/1719067081 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff594101eb0 0x7ff59419d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:23.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:23.928+0000 7ff59a90a700 1 --2- 172.21.15.96:0/1719067081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff594100330 0x7ff594196210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:23.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:23.928+0000 7ff59a90a700 1 --2- 172.21.15.96:0/1719067081 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff594101520 0x7ff594196750 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:23.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:23.928+0000 7ff59a90a700 1 -- 172.21.15.96:0/1719067081 >> 172.21.15.96:0/1719067081 conn(0x7ff5940fb910 msgr2=0x7ff5940fdc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:23.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:23.928+0000 7ff59a90a700 1 -- 172.21.15.96:0/1719067081 shutdown_connections 2023-05-08T03:40:23.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:23.928+0000 7ff59a90a700 1 -- 172.21.15.96:0/1719067081 wait complete. 2023-05-08T03:40:23.933 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 3 2023-05-08T03:40:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:23 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:23 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:23.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:23 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:23.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:23 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-05-08T03:40:23.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:23 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-05-08T03:40:23.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:23 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:40:23.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:23 smithi133 ceph-mon[125939]: Deploying daemon mds.j on smithi096 2023-05-08T03:40:23.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:23 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6832/2351258784,v1:172.21.15.133:6833/2351258784] up:boot 2023-05-08T03:40:23.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:23 smithi133 ceph-mon[125939]: fsmap 2 up:standby 2023-05-08T03:40:23.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:23 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-05-08T03:40:24.423 INFO:journalctl@ceph.mds.j.smithi096.stdout:May 08 03:40:24 smithi096 systemd[1]: Starting Ceph mds.j for f7ffcfb0-ed50-11ed-9b01-001a4aab830c... 2023-05-08T03:40:24.684 INFO:journalctl@ceph.mds.j.smithi096.stdout:May 08 03:40:24 smithi096 podman[158174]: 2023-05-08T03:40:24.684 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:24 smithi096 ceph-mon[124666]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-05-08T03:40:24.684 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:24 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/1719067081' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-05-08T03:40:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:24 smithi186 ceph-mon[126480]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-05-08T03:40:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:24 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/1719067081' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-05-08T03:40:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:24 smithi133 ceph-mon[125939]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-05-08T03:40:24.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:24 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/1719067081' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-05-08T03:40:25.005 INFO:journalctl@ceph.mds.j.smithi096.stdout:May 08 03:40:24 smithi096 ceph-mds[158214]: -- 172.21.15.96:0/4279658278 <== mon.0 v2:172.21.15.96:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5618c69ccb60 con 0x5618c69a2800 2023-05-08T03:40:25.005 INFO:journalctl@ceph.mds.j.smithi096.stdout:May 08 03:40:24 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mds-j[158190]: starting mds.j at 2023-05-08T03:40:25.006 INFO:journalctl@ceph.mds.j.smithi096.stdout:May 08 03:40:24 smithi096 bash[158174]: 83972b89b2fd3b35f28f6a206b450128d31cc5de0c896496355cd7fe7b8ccaed 2023-05-08T03:40:25.006 INFO:journalctl@ceph.mds.j.smithi096.stdout:May 08 03:40:24 smithi096 systemd[1]: Started Ceph mds.j for f7ffcfb0-ed50-11ed-9b01-001a4aab830c. 2023-05-08T03:40:25.951 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-08T03:40:26.047 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:25 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:26.047 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:25 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:26.047 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:25 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:26.047 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:25 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-05-08T03:40:26.048 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:25 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-05-08T03:40:26.048 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:25 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:40:26.048 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:25 smithi096 ceph-mon[124666]: Deploying daemon mds.d on smithi096 2023-05-08T03:40:26.048 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:25 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.96:6834/1518512221,v1:172.21.15.96:6835/1518512221] up:boot 2023-05-08T03:40:26.048 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:25 smithi096 ceph-mon[124666]: fsmap 3 up:standby 2023-05-08T03:40:26.048 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:25 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-05-08T03:40:26.096 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:26.094+0000 7f74917cf700 1 -- 172.21.15.96:0/775608640 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f748c0ffee0 msgr2=0x7f748c107790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:26.097 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:26.094+0000 7f74917cf700 1 --2- 172.21.15.96:0/775608640 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f748c0ffee0 0x7f748c107790 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f748400b0a0 tx=0x7f748400b3b0 comp rx=0 tx=0).stop 2023-05-08T03:40:26.097 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:26.094+0000 7f74917cf700 1 -- 172.21.15.96:0/775608640 shutdown_connections 2023-05-08T03:40:26.097 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:26.094+0000 7f74917cf700 1 --2- 172.21.15.96:0/775608640 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f748c0ffee0 0x7f748c107790 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:26.098 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:26.094+0000 7f74917cf700 1 --2- 172.21.15.96:0/775608640 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f748c1008e0 0x7f748c100cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:26.098 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:26.094+0000 7f74917cf700 1 --2- 172.21.15.96:0/775608640 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f748c0ff530 0x7f748c0ff9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:26.098 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:26.094+0000 7f74917cf700 1 -- 172.21.15.96:0/775608640 >> 172.21.15.96:0/775608640 conn(0x7f748c0fa0b0 msgr2=0x7f748c0fc4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:26.099 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:26.094+0000 7f74917cf700 1 -- 172.21.15.96:0/775608640 shutdown_connections 2023-05-08T03:40:26.099 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:26.094+0000 7f74917cf700 1 -- 172.21.15.96:0/775608640 wait complete. 2023-05-08T03:40:26.101 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:26.095+0000 7f74917cf700 1 Processor -- start 2023-05-08T03:40:26.101 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:26.095+0000 7f74917cf700 1 -- start start 2023-05-08T03:40:26.101 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:26.095+0000 7f74917cf700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f748c0ff530 0x7f748c1950b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:26.101 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:26.095+0000 7f74917cf700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f748c0ffee0 0x7f748c1955f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:26.102 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:26.095+0000 7f74917cf700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f748c1008e0 0x7f748c19c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:26.102 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:26.095+0000 7f74917cf700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f748c19cc30 con 0x7f748c1008e0 2023-05-08T03:40:26.102 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:26.095+0000 7f74917cf700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f748c19cd70 con 0x7f748c0ffee0 2023-05-08T03:40:26.102 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:26.095+0000 7f74917cf700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f748c19cf00 con 0x7f748c0ff530 2023-05-08T03:40:26.102 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:26.095+0000 7f748b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f748c1008e0 0x7f748c19c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:26.102 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:26.095+0000 7f748b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f748c1008e0 0x7f748c19c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40190/0 (socket says 172.21.15.96:40190) 2023-05-08T03:40:26.102 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:26.095+0000 7f748b7fe700 1 -- 172.21.15.96:0/1601973470 learned_addr learned my addr 172.21.15.96:0/1601973470 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:40:26.103 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:26.095+0000 7f748a7fc700 1 --2- 172.21.15.96:0/1601973470 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f748c0ffee0 0x7f748c1955f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:26.103 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:26.095+0000 7f748affd700 1 --2- 172.21.15.96:0/1601973470 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f748c0ff530 0x7f748c1950b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:26.103 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:26.096+0000 7f748b7fe700 1 -- 172.21.15.96:0/1601973470 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f748c0ff530 msgr2=0x7f748c1950b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:26.103 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:26.096+0000 7f748b7fe700 1 --2- 172.21.15.96:0/1601973470 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f748c0ff530 0x7f748c1950b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:26.103 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:26.096+0000 7f748b7fe700 1 -- 172.21.15.96:0/1601973470 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f748c0ffee0 msgr2=0x7f748c1955f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:26.103 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:26.096+0000 7f748b7fe700 1 --2- 172.21.15.96:0/1601973470 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f748c0ffee0 0x7f748c1955f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:26.104 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:26.096+0000 7f748b7fe700 1 -- 172.21.15.96:0/1601973470 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7484009d00 con 0x7f748c1008e0 2023-05-08T03:40:26.104 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:26.096+0000 7f748b7fe700 1 --2- 172.21.15.96:0/1601973470 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f748c1008e0 0x7f748c19c660 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f748400b780 tx=0x7f748400bd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:26.104 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:26.096+0000 7f7473fff700 1 -- 172.21.15.96:0/1601973470 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f748400e040 con 0x7f748c1008e0 2023-05-08T03:40:26.104 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:26.096+0000 7f74917cf700 1 -- 172.21.15.96:0/1601973470 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f748c10ac80 con 0x7f748c1008e0 2023-05-08T03:40:26.104 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:26.096+0000 7f7473fff700 1 -- 172.21.15.96:0/1601973470 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f748401e070 con 0x7f748c1008e0 2023-05-08T03:40:26.104 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:26.096+0000 7f7473fff700 1 -- 172.21.15.96:0/1601973470 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74840256e0 con 0x7f748c1008e0 2023-05-08T03:40:26.104 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:26.096+0000 7f74917cf700 1 -- 172.21.15.96:0/1601973470 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f748c10aaf0 con 0x7f748c1008e0 2023-05-08T03:40:26.105 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:26.097+0000 7f74917cf700 1 -- 172.21.15.96:0/1601973470 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f748c0fef20 con 0x7f748c1008e0 2023-05-08T03:40:26.105 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:26.098+0000 7f7473fff700 1 -- 172.21.15.96:0/1601973470 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f748401a4c0 con 0x7f748c1008e0 2023-05-08T03:40:26.105 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:26.098+0000 7f7473fff700 1 --2- 172.21.15.96:0/1601973470 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f74740a1150 0x7f74740a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:26.105 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:26.099+0000 7f7473fff700 1 -- 172.21.15.96:0/1601973470 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f7484020070 con 0x7f748c1008e0 2023-05-08T03:40:26.105 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:26.099+0000 7f748affd700 1 --2- 172.21.15.96:0/1601973470 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f74740a1150 0x7f74740a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:26.106 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:26.099+0000 7f748affd700 1 --2- 172.21.15.96:0/1601973470 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f74740a1150 0x7f74740a3600 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f748c068be0 tx=0x7f747c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:26.106 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:26.103+0000 7f7473fff700 1 -- 172.21.15.96:0/1601973470 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f7484098f70 con 0x7f748c1008e0 2023-05-08T03:40:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:25 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:25 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:25 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:25 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-05-08T03:40:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:25 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-05-08T03:40:26.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:25 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:40:26.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:25 smithi186 ceph-mon[126480]: Deploying daemon mds.d on smithi096 2023-05-08T03:40:26.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:25 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.96:6834/1518512221,v1:172.21.15.96:6835/1518512221] up:boot 2023-05-08T03:40:26.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:25 smithi186 ceph-mon[126480]: fsmap 3 up:standby 2023-05-08T03:40:26.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:25 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-05-08T03:40:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:25 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:25 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:25 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:25 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-05-08T03:40:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:25 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-05-08T03:40:26.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:25 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:40:26.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:25 smithi133 ceph-mon[125939]: Deploying daemon mds.d on smithi096 2023-05-08T03:40:26.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:25 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.96:6834/1518512221,v1:172.21.15.96:6835/1518512221] up:boot 2023-05-08T03:40:26.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:25 smithi133 ceph-mon[125939]: fsmap 3 up:standby 2023-05-08T03:40:26.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:25 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-05-08T03:40:26.393 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:26.390+0000 7f74917cf700 1 -- 172.21.15.96:0/1601973470 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f748c106690 con 0x7f748c1008e0 2023-05-08T03:40:26.394 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:26.391+0000 7f7473fff700 1 -- 172.21.15.96:0/1601973470 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) v1 ==== 93+0+2777 (secure 0 0 0) 0x7f748409c590 con 0x7f748c1008e0 2023-05-08T03:40:26.394 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:40:26.394 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6835/1518512221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":1518512221},{"type":"v1","addr":"172.21.15.96:6835","nonce":1518512221}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/2351258784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":2351258784},{"type":"v1","addr":"172.21.15.133:6833","nonce":2351258784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/2274306880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":2274306880},{"type":"v1","addr":"172.21.15.186:6833","nonce":2274306880}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-05-08T03:40:26.396 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:26.394+0000 7f74917cf700 1 -- 172.21.15.96:0/1601973470 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f74740a1150 msgr2=0x7f74740a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:26.398 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:26.394+0000 7f74917cf700 1 --2- 172.21.15.96:0/1601973470 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f74740a1150 0x7f74740a3600 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f748c068be0 tx=0x7f747c00b410 comp rx=0 tx=0).stop 2023-05-08T03:40:26.399 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:26.394+0000 7f74917cf700 1 -- 172.21.15.96:0/1601973470 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f748c1008e0 msgr2=0x7f748c19c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:26.399 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:26.394+0000 7f74917cf700 1 --2- 172.21.15.96:0/1601973470 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f748c1008e0 0x7f748c19c660 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f748400b780 tx=0x7f748400bd60 comp rx=0 tx=0).stop 2023-05-08T03:40:26.399 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:26.394+0000 7f74917cf700 1 -- 172.21.15.96:0/1601973470 shutdown_connections 2023-05-08T03:40:26.399 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:26.394+0000 7f74917cf700 1 --2- 172.21.15.96:0/1601973470 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f74740a1150 0x7f74740a3600 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:26.399 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:26.394+0000 7f74917cf700 1 --2- 172.21.15.96:0/1601973470 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f748c1008e0 0x7f748c19c660 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:26.399 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:26.394+0000 7f74917cf700 1 --2- 172.21.15.96:0/1601973470 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f748c0ff530 0x7f748c1950b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:26.399 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:26.394+0000 7f74917cf700 1 --2- 172.21.15.96:0/1601973470 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f748c0ffee0 0x7f748c1955f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:26.399 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:26.394+0000 7f74917cf700 1 -- 172.21.15.96:0/1601973470 >> 172.21.15.96:0/1601973470 conn(0x7f748c0fa0b0 msgr2=0x7f748c1039d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:26.400 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:26.394+0000 7f74917cf700 1 -- 172.21.15.96:0/1601973470 shutdown_connections 2023-05-08T03:40:26.400 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:26.394+0000 7f74917cf700 1 -- 172.21.15.96:0/1601973470 wait complete. 2023-05-08T03:40:26.400 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 4 2023-05-08T03:40:26.409 INFO:journalctl@ceph.mds.d.smithi096.stdout:May 08 03:40:26 smithi096 systemd[1]: Starting Ceph mds.d for f7ffcfb0-ed50-11ed-9b01-001a4aab830c... 2023-05-08T03:40:26.713 INFO:journalctl@ceph.mds.d.smithi096.stdout:May 08 03:40:26 smithi096 podman[158558]: 2023-05-08T03:40:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:26 smithi186 ceph-mon[126480]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-05-08T03:40:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:26 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/1601973470' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-05-08T03:40:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:26 smithi133 ceph-mon[125939]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-05-08T03:40:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:26 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/1601973470' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-05-08T03:40:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:26 smithi096 ceph-mon[124666]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-05-08T03:40:27.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:26 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/1601973470' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-05-08T03:40:27.256 INFO:journalctl@ceph.mds.d.smithi096.stdout:May 08 03:40:26 smithi096 bash[158558]: f49b1cb1e8afa2b3f4ba1bf4903168d3166b5ef4c4bae4c9c1782560a727c9d8 2023-05-08T03:40:27.256 INFO:journalctl@ceph.mds.d.smithi096.stdout:May 08 03:40:26 smithi096 ceph-mds[158598]: -- 172.21.15.96:0/865523045 <== mon.0 v2:172.21.15.96:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55ca40b56b60 con 0x55ca40b2c800 2023-05-08T03:40:27.256 INFO:journalctl@ceph.mds.d.smithi096.stdout:May 08 03:40:26 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mds-d[158574]: starting mds.d at 2023-05-08T03:40:27.256 INFO:journalctl@ceph.mds.d.smithi096.stdout:May 08 03:40:26 smithi096 systemd[1]: Started Ceph mds.d for f7ffcfb0-ed50-11ed-9b01-001a4aab830c. 2023-05-08T03:40:28.236 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:27 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:28.237 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:27 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:28.237 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:27 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:28.237 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:27 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-05-08T03:40:28.237 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:27 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-05-08T03:40:28.237 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:27 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:40:28.237 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:27 smithi133 ceph-mon[125939]: Deploying daemon mds.e on smithi133 2023-05-08T03:40:28.238 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:27 smithi133 ceph-mon[125939]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-05-08T03:40:28.238 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:27 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.96:6836/305967678,v1:172.21.15.96:6837/305967678] up:boot 2023-05-08T03:40:28.238 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:27 smithi133 ceph-mon[125939]: fsmap 4 up:standby 2023-05-08T03:40:28.238 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:27 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-05-08T03:40:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:27 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:27 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:28.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:27 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:28.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:27 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-05-08T03:40:28.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:27 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-05-08T03:40:28.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:27 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:40:28.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:27 smithi096 ceph-mon[124666]: Deploying daemon mds.e on smithi133 2023-05-08T03:40:28.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:27 smithi096 ceph-mon[124666]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-05-08T03:40:28.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:27 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.96:6836/305967678,v1:172.21.15.96:6837/305967678] up:boot 2023-05-08T03:40:28.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:27 smithi096 ceph-mon[124666]: fsmap 4 up:standby 2023-05-08T03:40:28.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:27 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-05-08T03:40:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:27 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:27 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:27 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:27 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-05-08T03:40:28.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:27 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-05-08T03:40:28.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:27 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:40:28.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:27 smithi186 ceph-mon[126480]: Deploying daemon mds.e on smithi133 2023-05-08T03:40:28.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:27 smithi186 ceph-mon[126480]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-05-08T03:40:28.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:27 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.96:6836/305967678,v1:172.21.15.96:6837/305967678] up:boot 2023-05-08T03:40:28.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:27 smithi186 ceph-mon[126480]: fsmap 4 up:standby 2023-05-08T03:40:28.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:27 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-05-08T03:40:28.412 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-08T03:40:28.490 INFO:journalctl@ceph.mds.e.smithi133.stdout:May 08 03:40:28 smithi133 systemd[1]: Starting Ceph mds.e for f7ffcfb0-ed50-11ed-9b01-001a4aab830c... 2023-05-08T03:40:28.551 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:28.549+0000 7ff30f2e0700 1 -- 172.21.15.96:0/805548782 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3081007d0 msgr2=0x7ff308100be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:28.552 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:28.549+0000 7ff30f2e0700 1 --2- 172.21.15.96:0/805548782 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3081007d0 0x7ff308100be0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff2f8009990 tx=0x7ff2f8009ca0 comp rx=0 tx=0).stop 2023-05-08T03:40:28.552 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:28.549+0000 7ff30f2e0700 1 -- 172.21.15.96:0/805548782 shutdown_connections 2023-05-08T03:40:28.552 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:28.549+0000 7ff30f2e0700 1 --2- 172.21.15.96:0/805548782 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3080ffdd0 0x7ff308107680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:28.552 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:28.549+0000 7ff30f2e0700 1 --2- 172.21.15.96:0/805548782 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3081007d0 0x7ff308100be0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:28.553 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:28.549+0000 7ff30f2e0700 1 --2- 172.21.15.96:0/805548782 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff3080ff420 0x7ff3080ff890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:28.553 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:28.549+0000 7ff30f2e0700 1 -- 172.21.15.96:0/805548782 >> 172.21.15.96:0/805548782 conn(0x7ff3080f9f80 msgr2=0x7ff3080fc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:28.553 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:28.549+0000 7ff30f2e0700 1 -- 172.21.15.96:0/805548782 shutdown_connections 2023-05-08T03:40:28.553 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:28.549+0000 7ff30f2e0700 1 -- 172.21.15.96:0/805548782 wait complete. 2023-05-08T03:40:28.553 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:28.549+0000 7ff30f2e0700 1 Processor -- start 2023-05-08T03:40:28.553 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:28.549+0000 7ff30f2e0700 1 -- start start 2023-05-08T03:40:28.555 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:28.550+0000 7ff30f2e0700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff3080ff420 0x7ff3081960d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:28.555 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:28.550+0000 7ff30f2e0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3080ffdd0 0x7ff308196610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:28.556 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:28.550+0000 7ff30f2e0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3081007d0 0x7ff30819d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:28.556 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:28.550+0000 7ff30f2e0700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff30819dc50 con 0x7ff3080ffdd0 2023-05-08T03:40:28.556 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:28.550+0000 7ff30f2e0700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff30819dd90 con 0x7ff3081007d0 2023-05-08T03:40:28.556 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:28.550+0000 7ff30f2e0700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff30819df20 con 0x7ff3080ff420 2023-05-08T03:40:28.556 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:28.550+0000 7ff30c87b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3080ffdd0 0x7ff308196610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:28.556 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:28.550+0000 7ff30c87b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3080ffdd0 0x7ff308196610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40214/0 (socket says 172.21.15.96:40214) 2023-05-08T03:40:28.557 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:28.550+0000 7ff30c87b700 1 -- 172.21.15.96:0/405659601 learned_addr learned my addr 172.21.15.96:0/405659601 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:40:28.557 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:28.550+0000 7ff30d87d700 1 --2- 172.21.15.96:0/405659601 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3081007d0 0x7ff30819d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:28.557 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:28.550+0000 7ff30d07c700 1 --2- 172.21.15.96:0/405659601 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff3080ff420 0x7ff3081960d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:28.557 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:28.550+0000 7ff30c87b700 1 -- 172.21.15.96:0/405659601 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff3080ff420 msgr2=0x7ff3081960d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:28.557 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:28.550+0000 7ff30c87b700 1 --2- 172.21.15.96:0/405659601 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff3080ff420 0x7ff3081960d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:28.557 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:28.550+0000 7ff30c87b700 1 -- 172.21.15.96:0/405659601 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3081007d0 msgr2=0x7ff30819d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:28.557 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:28.550+0000 7ff30c87b700 1 --2- 172.21.15.96:0/405659601 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3081007d0 0x7ff30819d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:28.558 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:28.550+0000 7ff30c87b700 1 -- 172.21.15.96:0/405659601 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2f80095f0 con 0x7ff3080ffdd0 2023-05-08T03:40:28.558 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:28.550+0000 7ff30c87b700 1 --2- 172.21.15.96:0/405659601 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3080ffdd0 0x7ff308196610 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff30400c920 tx=0x7ff30400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:28.558 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:28.550+0000 7ff2fe7fc700 1 -- 172.21.15.96:0/405659601 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff304007b00 con 0x7ff3080ffdd0 2023-05-08T03:40:28.558 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:28.550+0000 7ff2fe7fc700 1 -- 172.21.15.96:0/405659601 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff30400ce70 con 0x7ff3080ffdd0 2023-05-08T03:40:28.558 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:28.550+0000 7ff30f2e0700 1 -- 172.21.15.96:0/405659601 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff30810abb0 con 0x7ff3080ffdd0 2023-05-08T03:40:28.558 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:28.550+0000 7ff2fe7fc700 1 -- 172.21.15.96:0/405659601 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3040054e0 con 0x7ff3080ffdd0 2023-05-08T03:40:28.558 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:28.550+0000 7ff30f2e0700 1 -- 172.21.15.96:0/405659601 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff30810aa20 con 0x7ff3080ffdd0 2023-05-08T03:40:28.559 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:28.551+0000 7ff30f2e0700 1 -- 172.21.15.96:0/405659601 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff30819e670 con 0x7ff3080ffdd0 2023-05-08T03:40:28.559 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:28.552+0000 7ff2fe7fc700 1 -- 172.21.15.96:0/405659601 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7ff304004750 con 0x7ff3080ffdd0 2023-05-08T03:40:28.559 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:28.553+0000 7ff2fe7fc700 1 --2- 172.21.15.96:0/405659601 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7ff2f40a1150 0x7ff2f40a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:28.559 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:28.553+0000 7ff2fe7fc700 1 -- 172.21.15.96:0/405659601 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7ff3040cc3e0 con 0x7ff3080ffdd0 2023-05-08T03:40:28.559 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:28.553+0000 7ff30d07c700 1 --2- 172.21.15.96:0/405659601 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7ff2f40a1150 0x7ff2f40a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:28.559 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:28.553+0000 7ff30d07c700 1 --2- 172.21.15.96:0/405659601 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7ff2f40a1150 0x7ff2f40a3600 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff2f8000c00 tx=0x7ff2f8005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:28.560 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:28.557+0000 7ff2fe7fc700 1 -- 172.21.15.96:0/405659601 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7ff304095fd0 con 0x7ff3080ffdd0 2023-05-08T03:40:28.790 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:28.787+0000 7ff30f2e0700 1 -- 172.21.15.96:0/405659601 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff30819ec20 con 0x7ff3080ffdd0 2023-05-08T03:40:28.790 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:28.788+0000 7ff2fe7fc700 1 -- 172.21.15.96:0/405659601 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+3531 (secure 0 0 0) 0x7ff3040995f0 con 0x7ff3080ffdd0 2023-05-08T03:40:28.791 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:40:28.791 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":5,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6835/1518512221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":1518512221},{"type":"v1","addr":"172.21.15.96:6835","nonce":1518512221}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6837/305967678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6836","nonce":305967678},{"type":"v1","addr":"172.21.15.96:6837","nonce":305967678}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/2351258784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":2351258784},{"type":"v1","addr":"172.21.15.133:6833","nonce":2351258784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/2274306880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":2274306880},{"type":"v1","addr":"172.21.15.186:6833","nonce":2274306880}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-05-08T03:40:28.793 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:28.790+0000 7ff30f2e0700 1 -- 172.21.15.96:0/405659601 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7ff2f40a1150 msgr2=0x7ff2f40a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:28.793 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:28.790+0000 7ff30f2e0700 1 --2- 172.21.15.96:0/405659601 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7ff2f40a1150 0x7ff2f40a3600 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff2f8000c00 tx=0x7ff2f8005fb0 comp rx=0 tx=0).stop 2023-05-08T03:40:28.793 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:28.790+0000 7ff30f2e0700 1 -- 172.21.15.96:0/405659601 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3080ffdd0 msgr2=0x7ff308196610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:28.793 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:28.790+0000 7ff30f2e0700 1 --2- 172.21.15.96:0/405659601 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3080ffdd0 0x7ff308196610 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff30400c920 tx=0x7ff30400cc30 comp rx=0 tx=0).stop 2023-05-08T03:40:28.794 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:28.790+0000 7ff30f2e0700 1 -- 172.21.15.96:0/405659601 shutdown_connections 2023-05-08T03:40:28.794 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:28.790+0000 7ff30f2e0700 1 --2- 172.21.15.96:0/405659601 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7ff2f40a1150 0x7ff2f40a3600 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:28.794 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:28.790+0000 7ff30f2e0700 1 --2- 172.21.15.96:0/405659601 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3081007d0 0x7ff30819d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:28.794 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:28.790+0000 7ff30f2e0700 1 --2- 172.21.15.96:0/405659601 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff3080ff420 0x7ff3081960d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:28.794 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:28.790+0000 7ff30f2e0700 1 --2- 172.21.15.96:0/405659601 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3080ffdd0 0x7ff308196610 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:28.794 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:28.790+0000 7ff30f2e0700 1 -- 172.21.15.96:0/405659601 >> 172.21.15.96:0/405659601 conn(0x7ff3080f9f80 msgr2=0x7ff3080fba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:28.795 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:28.790+0000 7ff30f2e0700 1 -- 172.21.15.96:0/405659601 shutdown_connections 2023-05-08T03:40:28.795 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:28.790+0000 7ff30f2e0700 1 -- 172.21.15.96:0/405659601 wait complete. 2023-05-08T03:40:28.795 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 5 2023-05-08T03:40:29.026 INFO:journalctl@ceph.mds.e.smithi133.stdout:May 08 03:40:28 smithi133 podman[150767]: 2023-05-08T03:40:29.340 INFO:journalctl@ceph.mds.e.smithi133.stdout:May 08 03:40:29 smithi133 ceph-mds[150807]: -- 172.21.15.133:0/1662317663 <== mon.2 v2:172.21.15.133:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5604ccf2ab60 con 0x5604ccf00800 2023-05-08T03:40:29.340 INFO:journalctl@ceph.mds.e.smithi133.stdout:May 08 03:40:29 smithi133 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mds-e[150783]: starting mds.e at 2023-05-08T03:40:29.341 INFO:journalctl@ceph.mds.e.smithi133.stdout:May 08 03:40:29 smithi133 bash[150767]: f9fb01908ffd5ed8f9c9a6840c44dd6438fcf34f473c21c3ba56f7644684cec8 2023-05-08T03:40:29.341 INFO:journalctl@ceph.mds.e.smithi133.stdout:May 08 03:40:29 smithi133 systemd[1]: Started Ceph mds.e for f7ffcfb0-ed50-11ed-9b01-001a4aab830c. 2023-05-08T03:40:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:29 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/405659601' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-05-08T03:40:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:29 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:29 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:29.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:29 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:29.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:29 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-05-08T03:40:29.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:29 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-05-08T03:40:29.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:29 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:40:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:29 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/405659601' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-05-08T03:40:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:29 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:29 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:29 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:29 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-05-08T03:40:29.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:29 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-05-08T03:40:29.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:29 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:40:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:29 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/405659601' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-05-08T03:40:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:29 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:29.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:29 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:29.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:29 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:29.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:29 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-05-08T03:40:29.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:29 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-05-08T03:40:29.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:29 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:40:30.552 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:30 smithi186 ceph-mon[126480]: Deploying daemon mds.f on smithi186 2023-05-08T03:40:30.553 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:30 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6834/1735118966,v1:172.21.15.133:6835/1735118966] up:boot 2023-05-08T03:40:30.553 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:30 smithi186 ceph-mon[126480]: fsmap 5 up:standby 2023-05-08T03:40:30.553 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:30 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-05-08T03:40:30.553 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:30 smithi186 ceph-mon[126480]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-05-08T03:40:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:30 smithi133 ceph-mon[125939]: Deploying daemon mds.f on smithi186 2023-05-08T03:40:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:30 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6834/1735118966,v1:172.21.15.133:6835/1735118966] up:boot 2023-05-08T03:40:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:30 smithi133 ceph-mon[125939]: fsmap 5 up:standby 2023-05-08T03:40:30.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:30 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-05-08T03:40:30.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:30 smithi133 ceph-mon[125939]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-05-08T03:40:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:30 smithi096 ceph-mon[124666]: Deploying daemon mds.f on smithi186 2023-05-08T03:40:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:30 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6834/1735118966,v1:172.21.15.133:6835/1735118966] up:boot 2023-05-08T03:40:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:30 smithi096 ceph-mon[124666]: fsmap 5 up:standby 2023-05-08T03:40:30.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:30 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-05-08T03:40:30.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:30 smithi096 ceph-mon[124666]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-05-08T03:40:30.805 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-08T03:40:30.869 INFO:journalctl@ceph.mds.f.smithi186.stdout:May 08 03:40:30 smithi186 systemd[1]: Starting Ceph mds.f for f7ffcfb0-ed50-11ed-9b01-001a4aab830c... 2023-05-08T03:40:30.939 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:30.936+0000 7fc73b8ee700 1 -- 172.21.15.96:0/1579528786 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc734100450 msgr2=0x7fc7341008a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:30.939 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:30.936+0000 7fc73b8ee700 1 --2- 172.21.15.96:0/1579528786 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc734100450 0x7fc7341008a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc730009990 tx=0x7fc730009ca0 comp rx=0 tx=0).stop 2023-05-08T03:40:30.939 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:30.936+0000 7fc73b8ee700 1 -- 172.21.15.96:0/1579528786 shutdown_connections 2023-05-08T03:40:30.940 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:30.936+0000 7fc73b8ee700 1 --2- 172.21.15.96:0/1579528786 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc734100de0 0x7fc7341076a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:30.940 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:30.936+0000 7fc73b8ee700 1 --2- 172.21.15.96:0/1579528786 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc7340ff260 0x7fc7340ff670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:30.940 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:30.936+0000 7fc73b8ee700 1 --2- 172.21.15.96:0/1579528786 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc734100450 0x7fc7341008a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:30.940 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:30.936+0000 7fc73b8ee700 1 -- 172.21.15.96:0/1579528786 >> 172.21.15.96:0/1579528786 conn(0x7fc7340fa880 msgr2=0x7fc7340fccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:30.940 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:30.936+0000 7fc73b8ee700 1 -- 172.21.15.96:0/1579528786 shutdown_connections 2023-05-08T03:40:30.940 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:30.936+0000 7fc73b8ee700 1 -- 172.21.15.96:0/1579528786 wait complete. 2023-05-08T03:40:30.942 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:30.937+0000 7fc73b8ee700 1 Processor -- start 2023-05-08T03:40:30.942 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:30.937+0000 7fc73b8ee700 1 -- start start 2023-05-08T03:40:30.942 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:30.937+0000 7fc73b8ee700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7340ff260 0x7fc734069c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:30.943 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:30.937+0000 7fc73b8ee700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc734100450 0x7fc73419ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:30.943 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:30.937+0000 7fc73b8ee700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc734100de0 0x7fc73419d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:30.943 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:30.937+0000 7fc73b8ee700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc73419dc20 con 0x7fc7340ff260 2023-05-08T03:40:30.943 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:30.937+0000 7fc73b8ee700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc73419dd90 con 0x7fc734100de0 2023-05-08T03:40:30.943 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:30.937+0000 7fc73b8ee700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc73419df50 con 0x7fc734100450 2023-05-08T03:40:30.943 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:30.937+0000 7fc73968a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7340ff260 0x7fc734069c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:30.943 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:30.937+0000 7fc73968a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7340ff260 0x7fc734069c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40226/0 (socket says 172.21.15.96:40226) 2023-05-08T03:40:30.944 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:30.937+0000 7fc73968a700 1 -- 172.21.15.96:0/4015317297 learned_addr learned my addr 172.21.15.96:0/4015317297 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:40:30.944 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:30.937+0000 7fc738e89700 1 --2- 172.21.15.96:0/4015317297 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc734100450 0x7fc73419ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:30.944 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:30.938+0000 7fc739e8b700 1 --2- 172.21.15.96:0/4015317297 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc734100de0 0x7fc73419d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:30.944 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:30.938+0000 7fc73968a700 1 -- 172.21.15.96:0/4015317297 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc734100450 msgr2=0x7fc73419ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:30.944 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:30.938+0000 7fc73968a700 1 --2- 172.21.15.96:0/4015317297 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc734100450 0x7fc73419ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:30.944 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:30.938+0000 7fc73968a700 1 -- 172.21.15.96:0/4015317297 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc734100de0 msgr2=0x7fc73419d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:30.944 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:30.938+0000 7fc73968a700 1 --2- 172.21.15.96:0/4015317297 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc734100de0 0x7fc73419d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:30.945 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:30.938+0000 7fc73968a700 1 -- 172.21.15.96:0/4015317297 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7300095f0 con 0x7fc7340ff260 2023-05-08T03:40:30.945 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:30.938+0000 7fc73968a700 1 --2- 172.21.15.96:0/4015317297 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7340ff260 0x7fc734069c60 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc72400e970 tx=0x7fc72400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:30.945 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:30.938+0000 7fc72a7fc700 1 -- 172.21.15.96:0/4015317297 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc724009790 con 0x7fc7340ff260 2023-05-08T03:40:30.945 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:30.938+0000 7fc72a7fc700 1 -- 172.21.15.96:0/4015317297 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc72400eec0 con 0x7fc7340ff260 2023-05-08T03:40:30.945 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:30.938+0000 7fc72a7fc700 1 -- 172.21.15.96:0/4015317297 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc724003cf0 con 0x7fc7340ff260 2023-05-08T03:40:30.945 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:30.938+0000 7fc73b8ee700 1 -- 172.21.15.96:0/4015317297 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc73410abd0 con 0x7fc7340ff260 2023-05-08T03:40:30.945 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:30.938+0000 7fc73b8ee700 1 -- 172.21.15.96:0/4015317297 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc73410aa40 con 0x7fc7340ff260 2023-05-08T03:40:30.945 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:30.939+0000 7fc73b8ee700 1 -- 172.21.15.96:0/4015317297 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7341067f0 con 0x7fc7340ff260 2023-05-08T03:40:30.946 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:30.940+0000 7fc72a7fc700 1 -- 172.21.15.96:0/4015317297 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fc72400ccd0 con 0x7fc7340ff260 2023-05-08T03:40:30.946 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:30.941+0000 7fc72a7fc700 1 --2- 172.21.15.96:0/4015317297 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fc7200a1150 0x7fc7200a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:30.947 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:30.941+0000 7fc738e89700 1 --2- 172.21.15.96:0/4015317297 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fc7200a1150 0x7fc7200a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:30.947 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:30.941+0000 7fc72a7fc700 1 -- 172.21.15.96:0/4015317297 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fc724014070 con 0x7fc7340ff260 2023-05-08T03:40:30.947 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:30.941+0000 7fc738e89700 1 --2- 172.21.15.96:0/4015317297 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fc7200a1150 0x7fc7200a3600 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc73000b2e0 tx=0x7fc730005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:30.947 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:30.945+0000 7fc72a7fc700 1 -- 172.21.15.96:0/4015317297 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fc7240963f0 con 0x7fc7340ff260 2023-05-08T03:40:31.177 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:31.174+0000 7fc73b8ee700 1 -- 172.21.15.96:0/4015317297 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc734061a00 con 0x7fc7340ff260 2023-05-08T03:40:31.179 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:31.175+0000 7fc72a7fc700 1 -- 172.21.15.96:0/4015317297 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4291 (secure 0 0 0) 0x7fc724099a10 con 0x7fc7340ff260 2023-05-08T03:40:31.179 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:40:31.179 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6835/1518512221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":1518512221},{"type":"v1","addr":"172.21.15.96:6835","nonce":1518512221}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6837/305967678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6836","nonce":305967678},{"type":"v1","addr":"172.21.15.96:6837","nonce":305967678}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/2351258784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":2351258784},{"type":"v1","addr":"172.21.15.133:6833","nonce":2351258784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/2274306880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":2274306880},{"type":"v1","addr":"172.21.15.186:6833","nonce":2274306880}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24437,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1735118966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1735118966},{"type":"v1","addr":"172.21.15.133:6835","nonce":1735118966}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[]} 2023-05-08T03:40:31.180 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:31.177+0000 7fc73b8ee700 1 -- 172.21.15.96:0/4015317297 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fc7200a1150 msgr2=0x7fc7200a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:31.180 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:31.177+0000 7fc73b8ee700 1 --2- 172.21.15.96:0/4015317297 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fc7200a1150 0x7fc7200a3600 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc73000b2e0 tx=0x7fc730005960 comp rx=0 tx=0).stop 2023-05-08T03:40:31.181 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:31.177+0000 7fc73b8ee700 1 -- 172.21.15.96:0/4015317297 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7340ff260 msgr2=0x7fc734069c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:31.181 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:31.177+0000 7fc73b8ee700 1 --2- 172.21.15.96:0/4015317297 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7340ff260 0x7fc734069c60 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc72400e970 tx=0x7fc72400ec80 comp rx=0 tx=0).stop 2023-05-08T03:40:31.181 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:31.177+0000 7fc73b8ee700 1 -- 172.21.15.96:0/4015317297 shutdown_connections 2023-05-08T03:40:31.181 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:31.177+0000 7fc73b8ee700 1 --2- 172.21.15.96:0/4015317297 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fc7200a1150 0x7fc7200a3600 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:31.181 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:31.177+0000 7fc73b8ee700 1 --2- 172.21.15.96:0/4015317297 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc734100de0 0x7fc73419d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:31.181 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:31.177+0000 7fc73b8ee700 1 --2- 172.21.15.96:0/4015317297 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7340ff260 0x7fc734069c60 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:31.181 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:31.177+0000 7fc73b8ee700 1 --2- 172.21.15.96:0/4015317297 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc734100450 0x7fc73419ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:31.182 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:31.177+0000 7fc73b8ee700 1 -- 172.21.15.96:0/4015317297 >> 172.21.15.96:0/4015317297 conn(0x7fc7340fa880 msgr2=0x7fc734103930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:31.182 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:31.177+0000 7fc73b8ee700 1 -- 172.21.15.96:0/4015317297 shutdown_connections 2023-05-08T03:40:31.182 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:31.177+0000 7fc73b8ee700 1 -- 172.21.15.96:0/4015317297 wait complete. 2023-05-08T03:40:31.182 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 6 2023-05-08T03:40:31.197 INFO:journalctl@ceph.mds.f.smithi186.stdout:May 08 03:40:30 smithi186 podman[152060]: 2023-05-08T03:40:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:31 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/4015317297' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-05-08T03:40:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:31 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:31 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:31 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:31.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:31 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-05-08T03:40:31.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:31 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-05-08T03:40:31.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:31 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:40:31.619 INFO:journalctl@ceph.mds.f.smithi186.stdout:May 08 03:40:31 smithi186 bash[152060]: be2ffb8f0c1ba9ea28de650e7ad95443fbd6de6932eef84dc6d6537e4fa97abb 2023-05-08T03:40:31.619 INFO:journalctl@ceph.mds.f.smithi186.stdout:May 08 03:40:31 smithi186 ceph-mds[152101]: -- 172.21.15.186:0/1185904874 <== mon.1 v2:172.21.15.186:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55961bfe4b60 con 0x55961bfbb000 2023-05-08T03:40:31.619 INFO:journalctl@ceph.mds.f.smithi186.stdout:May 08 03:40:31 smithi186 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mds-f[152076]: starting mds.f at 2023-05-08T03:40:31.620 INFO:journalctl@ceph.mds.f.smithi186.stdout:May 08 03:40:31 smithi186 systemd[1]: Started Ceph mds.f for f7ffcfb0-ed50-11ed-9b01-001a4aab830c. 2023-05-08T03:40:31.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:31 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/4015317297' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-05-08T03:40:31.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:31 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:31.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:31 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:31.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:31 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:31.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:31 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-05-08T03:40:31.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:31 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-05-08T03:40:31.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:31 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:40:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:31 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/4015317297' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-05-08T03:40:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:31 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:31.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:31 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:31.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:31 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:31.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:31 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-05-08T03:40:31.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:31 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-05-08T03:40:31.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:31 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:40:32.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:32 smithi186 ceph-mon[126480]: Deploying daemon mds.c on smithi186 2023-05-08T03:40:32.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:32 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6834/3984391904,v1:172.21.15.186:6835/3984391904] up:boot 2023-05-08T03:40:32.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:32 smithi186 ceph-mon[126480]: fsmap 6 up:standby 2023-05-08T03:40:32.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:32 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-05-08T03:40:32.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:32 smithi186 ceph-mon[126480]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-05-08T03:40:32.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:32 smithi133 ceph-mon[125939]: Deploying daemon mds.c on smithi186 2023-05-08T03:40:32.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:32 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6834/3984391904,v1:172.21.15.186:6835/3984391904] up:boot 2023-05-08T03:40:32.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:32 smithi133 ceph-mon[125939]: fsmap 6 up:standby 2023-05-08T03:40:32.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:32 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-05-08T03:40:32.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:32 smithi133 ceph-mon[125939]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-05-08T03:40:32.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:32 smithi096 ceph-mon[124666]: Deploying daemon mds.c on smithi186 2023-05-08T03:40:32.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:32 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6834/3984391904,v1:172.21.15.186:6835/3984391904] up:boot 2023-05-08T03:40:32.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:32 smithi096 ceph-mon[124666]: fsmap 6 up:standby 2023-05-08T03:40:32.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:32 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-05-08T03:40:32.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:32 smithi096 ceph-mon[124666]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-05-08T03:40:33.119 INFO:journalctl@ceph.mds.c.smithi186.stdout:May 08 03:40:32 smithi186 systemd[1]: Starting Ceph mds.c for f7ffcfb0-ed50-11ed-9b01-001a4aab830c... 2023-05-08T03:40:33.193 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-08T03:40:33.328 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:33.323+0000 7f0d63512700 1 -- 172.21.15.96:0/1518662234 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d5c100350 msgr2=0x7f0d5c100760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:33.328 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:33.323+0000 7f0d63512700 1 --2- 172.21.15.96:0/1518662234 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d5c100350 0x7f0d5c100760 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0d58009990 tx=0x7f0d58009ca0 comp rx=0 tx=0).stop 2023-05-08T03:40:33.328 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:33.323+0000 7f0d63512700 1 -- 172.21.15.96:0/1518662234 shutdown_connections 2023-05-08T03:40:33.329 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:33.323+0000 7f0d63512700 1 --2- 172.21.15.96:0/1518662234 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0d5c101ed0 0x7f0d5c108790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:33.329 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:33.324+0000 7f0d63512700 1 --2- 172.21.15.96:0/1518662234 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d5c100350 0x7f0d5c100760 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:33.329 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:33.324+0000 7f0d63512700 1 --2- 172.21.15.96:0/1518662234 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0d5c101540 0x7f0d5c101990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:33.329 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:33.324+0000 7f0d63512700 1 -- 172.21.15.96:0/1518662234 >> 172.21.15.96:0/1518662234 conn(0x7f0d5c0fb930 msgr2=0x7f0d5c0fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:33.329 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:33.324+0000 7f0d63512700 1 -- 172.21.15.96:0/1518662234 shutdown_connections 2023-05-08T03:40:33.329 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:33.324+0000 7f0d63512700 1 -- 172.21.15.96:0/1518662234 wait complete. 2023-05-08T03:40:33.329 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:33.324+0000 7f0d63512700 1 Processor -- start 2023-05-08T03:40:33.330 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:33.324+0000 7f0d63512700 1 -- start start 2023-05-08T03:40:33.330 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:33.324+0000 7f0d63512700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d5c100350 0x7f0d5c1960e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:33.330 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:33.324+0000 7f0d63512700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0d5c101540 0x7f0d5c196620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:33.330 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:33.324+0000 7f0d63512700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0d5c101ed0 0x7f0d5c19d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:33.330 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:33.324+0000 7f0d63512700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5c19dc60 con 0x7f0d5c100350 2023-05-08T03:40:33.330 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:33.324+0000 7f0d63512700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5c19dda0 con 0x7f0d5c101540 2023-05-08T03:40:33.330 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:33.324+0000 7f0d63512700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5c19df30 con 0x7f0d5c101ed0 2023-05-08T03:40:33.331 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:33.324+0000 7f0d612ae700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d5c100350 0x7f0d5c1960e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:33.331 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:33.325+0000 7f0d612ae700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d5c100350 0x7f0d5c1960e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40240/0 (socket says 172.21.15.96:40240) 2023-05-08T03:40:33.331 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:33.325+0000 7f0d612ae700 1 -- 172.21.15.96:0/2920970717 learned_addr learned my addr 172.21.15.96:0/2920970717 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:40:33.331 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:33.325+0000 7f0d61aaf700 1 --2- 172.21.15.96:0/2920970717 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0d5c101ed0 0x7f0d5c19d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:33.331 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:33.325+0000 7f0d60aad700 1 --2- 172.21.15.96:0/2920970717 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0d5c101540 0x7f0d5c196620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:33.331 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:33.325+0000 7f0d612ae700 1 -- 172.21.15.96:0/2920970717 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0d5c101ed0 msgr2=0x7f0d5c19d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:33.331 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:33.325+0000 7f0d612ae700 1 --2- 172.21.15.96:0/2920970717 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0d5c101ed0 0x7f0d5c19d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:33.331 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:33.325+0000 7f0d612ae700 1 -- 172.21.15.96:0/2920970717 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0d5c101540 msgr2=0x7f0d5c196620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:33.332 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:33.325+0000 7f0d612ae700 1 --2- 172.21.15.96:0/2920970717 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0d5c101540 0x7f0d5c196620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:33.332 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:33.325+0000 7f0d612ae700 1 -- 172.21.15.96:0/2920970717 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d580095f0 con 0x7f0d5c100350 2023-05-08T03:40:33.332 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:33.325+0000 7f0d612ae700 1 --2- 172.21.15.96:0/2920970717 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d5c100350 0x7f0d5c1960e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0d58000c00 tx=0x7f0d580047a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:33.332 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:33.325+0000 7f0d527fc700 1 -- 172.21.15.96:0/2920970717 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d5801d070 con 0x7f0d5c100350 2023-05-08T03:40:33.332 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:33.325+0000 7f0d527fc700 1 -- 172.21.15.96:0/2920970717 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0d58022470 con 0x7f0d5c100350 2023-05-08T03:40:33.332 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:33.325+0000 7f0d527fc700 1 -- 172.21.15.96:0/2920970717 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d58017650 con 0x7f0d5c100350 2023-05-08T03:40:33.332 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:33.325+0000 7f0d63512700 1 -- 172.21.15.96:0/2920970717 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d5c10bcd0 con 0x7f0d5c100350 2023-05-08T03:40:33.333 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:33.325+0000 7f0d63512700 1 -- 172.21.15.96:0/2920970717 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d5c10bb40 con 0x7f0d5c100350 2023-05-08T03:40:33.333 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:33.326+0000 7f0d63512700 1 -- 172.21.15.96:0/2920970717 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d5c19e480 con 0x7f0d5c100350 2023-05-08T03:40:33.334 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:33.327+0000 7f0d527fc700 1 -- 172.21.15.96:0/2920970717 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f0d580225e0 con 0x7f0d5c100350 2023-05-08T03:40:33.334 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:33.328+0000 7f0d527fc700 1 --2- 172.21.15.96:0/2920970717 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f0d480a1150 0x7f0d480a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:33.334 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:33.328+0000 7f0d60aad700 1 --2- 172.21.15.96:0/2920970717 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f0d480a1150 0x7f0d480a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:33.334 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:33.328+0000 7f0d527fc700 1 -- 172.21.15.96:0/2920970717 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f0d580cdf00 con 0x7f0d5c100350 2023-05-08T03:40:33.334 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:33.328+0000 7f0d60aad700 1 --2- 172.21.15.96:0/2920970717 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f0d480a1150 0x7f0d480a3600 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c005950 tx=0x7f0d4c0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:33.335 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:33.332+0000 7f0d527fc700 1 -- 172.21.15.96:0/2920970717 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f0d58097b80 con 0x7f0d5c100350 2023-05-08T03:40:33.371 INFO:journalctl@ceph.mds.c.smithi186.stdout:May 08 03:40:33 smithi186 podman[152403]: 2023-05-08T03:40:33.573 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:33.570+0000 7f0d63512700 1 -- 172.21.15.96:0/2920970717 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0d5c107230 con 0x7f0d5c100350 2023-05-08T03:40:33.573 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:33.571+0000 7f0d527fc700 1 -- 172.21.15.96:0/2920970717 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+5811 (secure 0 0 0) 0x7f0d5809b1a0 con 0x7f0d5c100350 2023-05-08T03:40:33.573 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:40:33.574 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6835/1518512221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":1518512221},{"type":"v1","addr":"172.21.15.96:6835","nonce":1518512221}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6837/305967678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6836","nonce":305967678},{"type":"v1","addr":"172.21.15.96:6837","nonce":305967678}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/2351258784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":2351258784},{"type":"v1","addr":"172.21.15.133:6833","nonce":2351258784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/2274306880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":2274306880},{"type":"v1","addr":"172.21.15.186:6833","nonce":2274306880}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24437,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1735118966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1735118966},{"type":"v1","addr":"172.21.15.133:6835","nonce":1735118966}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/3984391904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":3984391904},{"type":"v1","addr":"172.21.15.186:6835","nonce":3984391904}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24472,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6837/1556405826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":1556405826},{"type":"v1","addr":"172.21.15.186:6837","nonce":1556405826}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8}],"filesystems":[]} 2023-05-08T03:40:33.575 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:33.573+0000 7f0d63512700 1 -- 172.21.15.96:0/2920970717 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f0d480a1150 msgr2=0x7f0d480a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:33.576 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:33.573+0000 7f0d63512700 1 --2- 172.21.15.96:0/2920970717 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f0d480a1150 0x7f0d480a3600 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c005950 tx=0x7f0d4c0058e0 comp rx=0 tx=0).stop 2023-05-08T03:40:33.576 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:33.573+0000 7f0d63512700 1 -- 172.21.15.96:0/2920970717 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d5c100350 msgr2=0x7f0d5c1960e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:33.576 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:33.573+0000 7f0d63512700 1 --2- 172.21.15.96:0/2920970717 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d5c100350 0x7f0d5c1960e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0d58000c00 tx=0x7f0d580047a0 comp rx=0 tx=0).stop 2023-05-08T03:40:33.576 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:33.573+0000 7f0d63512700 1 -- 172.21.15.96:0/2920970717 shutdown_connections 2023-05-08T03:40:33.576 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:33.573+0000 7f0d63512700 1 --2- 172.21.15.96:0/2920970717 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f0d480a1150 0x7f0d480a3600 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:33.576 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:33.573+0000 7f0d63512700 1 --2- 172.21.15.96:0/2920970717 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0d5c101ed0 0x7f0d5c19d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:33.577 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:33.573+0000 7f0d63512700 1 --2- 172.21.15.96:0/2920970717 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d5c100350 0x7f0d5c1960e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:33.577 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:33.573+0000 7f0d63512700 1 --2- 172.21.15.96:0/2920970717 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0d5c101540 0x7f0d5c196620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:33.577 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:33.573+0000 7f0d63512700 1 -- 172.21.15.96:0/2920970717 >> 172.21.15.96:0/2920970717 conn(0x7f0d5c0fb930 msgr2=0x7f0d5c0fdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:33.577 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:33.573+0000 7f0d63512700 1 -- 172.21.15.96:0/2920970717 shutdown_connections 2023-05-08T03:40:33.577 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:33.573+0000 7f0d63512700 1 -- 172.21.15.96:0/2920970717 wait complete. 2023-05-08T03:40:33.577 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 8 2023-05-08T03:40:33.869 INFO:journalctl@ceph.mds.c.smithi186.stdout:May 08 03:40:33 smithi186 bash[152403]: 82354bf1287fde417becf4aaad02ffae8ca2a6ac81c43a63b05ae1b735aa9f86 2023-05-08T03:40:33.869 INFO:journalctl@ceph.mds.c.smithi186.stdout:May 08 03:40:33 smithi186 ceph-mds[152443]: -- 172.21.15.186:0/1090029901 <== mon.1 v2:172.21.15.186:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55e034b04b60 con 0x55e034adac00 2023-05-08T03:40:33.869 INFO:journalctl@ceph.mds.c.smithi186.stdout:May 08 03:40:33 smithi186 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mds-c[152419]: starting mds.c at 2023-05-08T03:40:33.869 INFO:journalctl@ceph.mds.c.smithi186.stdout:May 08 03:40:33 smithi186 systemd[1]: Started Ceph mds.c for f7ffcfb0-ed50-11ed-9b01-001a4aab830c. 2023-05-08T03:40:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:34 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:boot 2023-05-08T03:40:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:34 smithi133 ceph-mon[125939]: fsmap 7 up:standby 2023-05-08T03:40:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:34 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-05-08T03:40:34.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:34 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:34.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:34 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:34.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:34 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:34.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:34 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-05-08T03:40:34.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:34 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-05-08T03:40:34.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:34 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:40:34.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:34 smithi133 ceph-mon[125939]: Deploying daemon mds.h on smithi133 2023-05-08T03:40:34.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:34 smithi133 ceph-mon[125939]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-05-08T03:40:34.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:34 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/2920970717' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-05-08T03:40:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:34 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:boot 2023-05-08T03:40:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:34 smithi096 ceph-mon[124666]: fsmap 7 up:standby 2023-05-08T03:40:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:34 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-05-08T03:40:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:34 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:34 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:34 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:34 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-05-08T03:40:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:34 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-05-08T03:40:34.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:34 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:40:34.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:34 smithi096 ceph-mon[124666]: Deploying daemon mds.h on smithi133 2023-05-08T03:40:34.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:34 smithi096 ceph-mon[124666]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-05-08T03:40:34.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:34 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/2920970717' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-05-08T03:40:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:34 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:boot 2023-05-08T03:40:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:34 smithi186 ceph-mon[126480]: fsmap 7 up:standby 2023-05-08T03:40:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:34 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-05-08T03:40:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:34 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:34.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:34 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:34.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:34 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:34.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:34 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-05-08T03:40:34.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:34 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-05-08T03:40:34.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:34 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:40:34.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:34 smithi186 ceph-mon[126480]: Deploying daemon mds.h on smithi133 2023-05-08T03:40:34.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:34 smithi186 ceph-mon[126480]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-05-08T03:40:34.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:34 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/2920970717' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-05-08T03:40:35.240 INFO:journalctl@ceph.mds.h.smithi133.stdout:May 08 03:40:35 smithi133 systemd[1]: Starting Ceph mds.h for f7ffcfb0-ed50-11ed-9b01-001a4aab830c... 2023-05-08T03:40:35.553 INFO:journalctl@ceph.mds.h.smithi133.stdout:May 08 03:40:35 smithi133 podman[151108]: 2023-05-08T03:40:35.554 INFO:journalctl@ceph.mds.h.smithi133.stdout:May 08 03:40:35 smithi133 bash[151108]: 8e86612776f8c791ff8ceff06e31ba8b586b9acf306c975731833ca66d20e6f2 2023-05-08T03:40:35.588 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-08T03:40:35.735 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:35.728+0000 7fdcce7cf700 1 -- 172.21.15.96:0/2202567492 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdcc80ff210 msgr2=0x7fdcc80ff620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:35.736 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:35.728+0000 7fdcce7cf700 1 --2- 172.21.15.96:0/2202567492 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdcc80ff210 0x7fdcc80ff620 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fdcb8009990 tx=0x7fdcb8009ca0 comp rx=0 tx=0).stop 2023-05-08T03:40:35.736 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:35.728+0000 7fdcce7cf700 1 -- 172.21.15.96:0/2202567492 shutdown_connections 2023-05-08T03:40:35.736 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:35.728+0000 7fdcce7cf700 1 --2- 172.21.15.96:0/2202567492 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdcc8100d90 0x7fdcc8107650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:35.737 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:35.728+0000 7fdcce7cf700 1 --2- 172.21.15.96:0/2202567492 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdcc80ff210 0x7fdcc80ff620 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:35.737 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:35.728+0000 7fdcce7cf700 1 --2- 172.21.15.96:0/2202567492 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdcc8100400 0x7fdcc8100850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:35.738 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:35.728+0000 7fdcce7cf700 1 -- 172.21.15.96:0/2202567492 >> 172.21.15.96:0/2202567492 conn(0x7fdcc80fa7f0 msgr2=0x7fdcc80fcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:35.739 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:35.728+0000 7fdcce7cf700 1 -- 172.21.15.96:0/2202567492 shutdown_connections 2023-05-08T03:40:35.739 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:35.728+0000 7fdcce7cf700 1 -- 172.21.15.96:0/2202567492 wait complete. 2023-05-08T03:40:35.739 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:35.729+0000 7fdcce7cf700 1 Processor -- start 2023-05-08T03:40:35.739 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:35.729+0000 7fdcce7cf700 1 -- start start 2023-05-08T03:40:35.740 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:35.729+0000 7fdcce7cf700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdcc80ff210 0x7fdcc8194fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:35.740 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:35.730+0000 7fdcce7cf700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdcc8100400 0x7fdcc8195510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:35.740 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:35.730+0000 7fdcce7cf700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdcc8100d90 0x7fdcc819c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:35.740 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:35.730+0000 7fdcce7cf700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc819cb50 con 0x7fdcc80ff210 2023-05-08T03:40:35.741 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:35.730+0000 7fdcce7cf700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc819cc90 con 0x7fdcc8100400 2023-05-08T03:40:35.741 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:35.730+0000 7fdcce7cf700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc819ce20 con 0x7fdcc8100d90 2023-05-08T03:40:35.741 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:35.730+0000 7fdcc7fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdcc80ff210 0x7fdcc8194fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:35.741 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:35.730+0000 7fdcc7fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdcc80ff210 0x7fdcc8194fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40254/0 (socket says 172.21.15.96:40254) 2023-05-08T03:40:35.742 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:35.730+0000 7fdcc7fff700 1 -- 172.21.15.96:0/1917516180 learned_addr learned my addr 172.21.15.96:0/1917516180 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:40:35.742 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:35.730+0000 7fdcc77fe700 1 --2- 172.21.15.96:0/1917516180 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdcc8100400 0x7fdcc8195510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:35.742 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:35.730+0000 7fdcccd6c700 1 --2- 172.21.15.96:0/1917516180 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdcc8100d90 0x7fdcc819c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:35.743 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:35.730+0000 7fdcc7fff700 1 -- 172.21.15.96:0/1917516180 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdcc8100d90 msgr2=0x7fdcc819c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:35.743 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:35.730+0000 7fdcc7fff700 1 --2- 172.21.15.96:0/1917516180 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdcc8100d90 0x7fdcc819c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:35.743 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:35.730+0000 7fdcc7fff700 1 -- 172.21.15.96:0/1917516180 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdcc8100400 msgr2=0x7fdcc8195510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:35.744 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:35.730+0000 7fdcc7fff700 1 --2- 172.21.15.96:0/1917516180 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdcc8100400 0x7fdcc8195510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:35.744 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:35.730+0000 7fdcc7fff700 1 -- 172.21.15.96:0/1917516180 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcb80095f0 con 0x7fdcc80ff210 2023-05-08T03:40:35.744 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:35.730+0000 7fdcc77fe700 1 --2- 172.21.15.96:0/1917516180 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdcc8100400 0x7fdcc8195510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-08T03:40:35.744 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:35.730+0000 7fdcc7fff700 1 --2- 172.21.15.96:0/1917516180 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdcc80ff210 0x7fdcc8194fd0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fdcb8004730 tx=0x7fdcb8004760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:35.745 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:35.730+0000 7fdcc57fa700 1 -- 172.21.15.96:0/1917516180 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb801d070 con 0x7fdcc80ff210 2023-05-08T03:40:35.745 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:35.730+0000 7fdcc57fa700 1 -- 172.21.15.96:0/1917516180 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdcb8021410 con 0x7fdcc80ff210 2023-05-08T03:40:35.745 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:35.730+0000 7fdcce7cf700 1 -- 172.21.15.96:0/1917516180 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcc810abc0 con 0x7fdcc80ff210 2023-05-08T03:40:35.745 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:35.730+0000 7fdcc57fa700 1 -- 172.21.15.96:0/1917516180 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb8017650 con 0x7fdcc80ff210 2023-05-08T03:40:35.746 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:35.730+0000 7fdcce7cf700 1 -- 172.21.15.96:0/1917516180 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcc810aa30 con 0x7fdcc80ff210 2023-05-08T03:40:35.746 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:35.731+0000 7fdcce7cf700 1 -- 172.21.15.96:0/1917516180 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcc819d3c0 con 0x7fdcc80ff210 2023-05-08T03:40:35.746 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:35.732+0000 7fdcc57fa700 1 -- 172.21.15.96:0/1917516180 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fdcb8021580 con 0x7fdcc80ff210 2023-05-08T03:40:35.746 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:35.733+0000 7fdcc57fa700 1 --2- 172.21.15.96:0/1917516180 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fdcb00a1150 0x7fdcb00a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:35.747 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:35.733+0000 7fdcc77fe700 1 --2- 172.21.15.96:0/1917516180 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fdcb00a1150 0x7fdcb00a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:35.747 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:35.733+0000 7fdcc57fa700 1 -- 172.21.15.96:0/1917516180 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fdcb80cd850 con 0x7fdcc80ff210 2023-05-08T03:40:35.747 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:35.733+0000 7fdcc77fe700 1 --2- 172.21.15.96:0/1917516180 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fdcb00a1150 0x7fdcb00a3600 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc011490 tx=0x7fdcbc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:35.749 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:35.737+0000 7fdcc57fa700 1 -- 172.21.15.96:0/1917516180 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fdcb80974d0 con 0x7fdcc80ff210 2023-05-08T03:40:35.970 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:35.967+0000 7fdcce7cf700 1 -- 172.21.15.96:0/1917516180 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdcc8106150 con 0x7fdcc80ff210 2023-05-08T03:40:35.970 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:35.968+0000 7fdcc57fa700 1 -- 172.21.15.96:0/1917516180 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+6571 (secure 0 0 0) 0x7fdcb809aaf0 con 0x7fdcc80ff210 2023-05-08T03:40:35.971 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:40:35.971 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6835/1518512221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":1518512221},{"type":"v1","addr":"172.21.15.96:6835","nonce":1518512221}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6837/305967678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6836","nonce":305967678},{"type":"v1","addr":"172.21.15.96:6837","nonce":305967678}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/2351258784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":2351258784},{"type":"v1","addr":"172.21.15.133:6833","nonce":2351258784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/2274306880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":2274306880},{"type":"v1","addr":"172.21.15.186:6833","nonce":2274306880}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24437,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1735118966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1735118966},{"type":"v1","addr":"172.21.15.133:6835","nonce":1735118966}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/3984391904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":3984391904},{"type":"v1","addr":"172.21.15.186:6835","nonce":3984391904}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/2218851414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":2218851414},{"type":"v1","addr":"172.21.15.133:6837","nonce":2218851414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24472,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6837/1556405826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":1556405826},{"type":"v1","addr":"172.21.15.186:6837","nonce":1556405826}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8}],"filesystems":[]} 2023-05-08T03:40:35.973 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:35.970+0000 7fdcce7cf700 1 -- 172.21.15.96:0/1917516180 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fdcb00a1150 msgr2=0x7fdcb00a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:35.973 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:35.970+0000 7fdcce7cf700 1 --2- 172.21.15.96:0/1917516180 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fdcb00a1150 0x7fdcb00a3600 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc011490 tx=0x7fdcbc009260 comp rx=0 tx=0).stop 2023-05-08T03:40:35.973 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:35.970+0000 7fdcce7cf700 1 -- 172.21.15.96:0/1917516180 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdcc80ff210 msgr2=0x7fdcc8194fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:35.973 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:35.970+0000 7fdcce7cf700 1 --2- 172.21.15.96:0/1917516180 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdcc80ff210 0x7fdcc8194fd0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fdcb8004730 tx=0x7fdcb8004760 comp rx=0 tx=0).stop 2023-05-08T03:40:35.973 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:35.970+0000 7fdcce7cf700 1 -- 172.21.15.96:0/1917516180 shutdown_connections 2023-05-08T03:40:35.973 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:35.970+0000 7fdcce7cf700 1 --2- 172.21.15.96:0/1917516180 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fdcb00a1150 0x7fdcb00a3600 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:35.974 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:35.970+0000 7fdcce7cf700 1 --2- 172.21.15.96:0/1917516180 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdcc8100d90 0x7fdcc819c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:35.974 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:35.970+0000 7fdcce7cf700 1 --2- 172.21.15.96:0/1917516180 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdcc80ff210 0x7fdcc8194fd0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:35.974 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:35.970+0000 7fdcce7cf700 1 --2- 172.21.15.96:0/1917516180 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdcc8100400 0x7fdcc8195510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:35.974 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:35.970+0000 7fdcce7cf700 1 -- 172.21.15.96:0/1917516180 >> 172.21.15.96:0/1917516180 conn(0x7fdcc80fa7f0 msgr2=0x7fdcc80fcae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:35.974 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:35.970+0000 7fdcce7cf700 1 -- 172.21.15.96:0/1917516180 shutdown_connections 2023-05-08T03:40:35.974 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:35.970+0000 7fdcce7cf700 1 -- 172.21.15.96:0/1917516180 wait complete. 2023-05-08T03:40:35.975 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 9 2023-05-08T03:40:35.990 INFO:journalctl@ceph.mds.h.smithi133.stdout:May 08 03:40:35 smithi133 ceph-mds[151148]: -- 172.21.15.133:0/2134030861 <== mon.2 v2:172.21.15.133:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55625b4d8b60 con 0x55625b4af000 2023-05-08T03:40:35.990 INFO:journalctl@ceph.mds.h.smithi133.stdout:May 08 03:40:35 smithi133 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mds-h[151124]: starting mds.h at 2023-05-08T03:40:35.990 INFO:journalctl@ceph.mds.h.smithi133.stdout:May 08 03:40:35 smithi133 systemd[1]: Started Ceph mds.h for f7ffcfb0-ed50-11ed-9b01-001a4aab830c. 2023-05-08T03:40:36.764 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:36 smithi186 ceph-mon[126480]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-05-08T03:40:36.764 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:36 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6836/2218851414,v1:172.21.15.133:6837/2218851414] up:boot 2023-05-08T03:40:36.764 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:36 smithi186 ceph-mon[126480]: fsmap 8 up:standby 2023-05-08T03:40:36.764 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:36 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-05-08T03:40:36.765 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:36 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:36.765 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:36 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:36.765 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:36 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:36.765 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:36 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-05-08T03:40:36.765 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:36 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-05-08T03:40:36.765 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:36 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:40:36.765 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:36 smithi186 ceph-mon[126480]: Deploying daemon mds.i on smithi186 2023-05-08T03:40:36.766 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:36 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/1917516180' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-05-08T03:40:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:36 smithi133 ceph-mon[125939]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-05-08T03:40:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:36 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6836/2218851414,v1:172.21.15.133:6837/2218851414] up:boot 2023-05-08T03:40:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:36 smithi133 ceph-mon[125939]: fsmap 8 up:standby 2023-05-08T03:40:36.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:36 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-05-08T03:40:36.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:36 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:36.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:36 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:36.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:36 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:36.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:36 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-05-08T03:40:36.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:36 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-05-08T03:40:36.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:36 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:40:36.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:36 smithi133 ceph-mon[125939]: Deploying daemon mds.i on smithi186 2023-05-08T03:40:36.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:36 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/1917516180' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-05-08T03:40:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:36 smithi096 ceph-mon[124666]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-05-08T03:40:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:36 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6836/2218851414,v1:172.21.15.133:6837/2218851414] up:boot 2023-05-08T03:40:37.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:36 smithi096 ceph-mon[124666]: fsmap 8 up:standby 2023-05-08T03:40:37.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:36 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-05-08T03:40:37.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:36 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:37.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:36 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:37.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:36 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:37.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:36 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-05-08T03:40:37.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:36 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-05-08T03:40:37.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:36 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:40:37.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:36 smithi096 ceph-mon[124666]: Deploying daemon mds.i on smithi186 2023-05-08T03:40:37.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:36 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/1917516180' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-05-08T03:40:37.369 INFO:journalctl@ceph.mds.i.smithi186.stdout:May 08 03:40:37 smithi186 systemd[1]: Starting Ceph mds.i for f7ffcfb0-ed50-11ed-9b01-001a4aab830c... 2023-05-08T03:40:37.869 INFO:journalctl@ceph.mds.i.smithi186.stdout:May 08 03:40:37 smithi186 podman[152742]: 2023-05-08T03:40:37.869 INFO:journalctl@ceph.mds.i.smithi186.stdout:May 08 03:40:37 smithi186 bash[152742]: 86fac25f3c2e1dedca93a52d9f527ccecc10b33335faa8342755f2ae7212e8db 2023-05-08T03:40:37.869 INFO:journalctl@ceph.mds.i.smithi186.stdout:May 08 03:40:37 smithi186 ceph-mds[152782]: -- 172.21.15.186:0/3178992394 <== mon.1 v2:172.21.15.186:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55a900f48b60 con 0x55a900f1e800 2023-05-08T03:40:37.869 INFO:journalctl@ceph.mds.i.smithi186.stdout:May 08 03:40:37 smithi186 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mds-i[152758]: starting mds.i at 2023-05-08T03:40:37.986 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-08T03:40:38.123 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:38.118+0000 7fab29caa700 1 -- 172.21.15.96:0/268707052 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fab24100df0 msgr2=0x7fab241031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:38.124 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:38.118+0000 7fab29caa700 1 --2- 172.21.15.96:0/268707052 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fab24100df0 0x7fab241031d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fab14009990 tx=0x7fab14009ca0 comp rx=0 tx=0).stop 2023-05-08T03:40:38.124 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:38.119+0000 7fab29caa700 1 -- 172.21.15.96:0/268707052 shutdown_connections 2023-05-08T03:40:38.124 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:38.119+0000 7fab29caa700 1 --2- 172.21.15.96:0/268707052 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fab24106030 0x7fab24108430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:38.124 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:38.119+0000 7fab29caa700 1 --2- 172.21.15.96:0/268707052 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fab24100df0 0x7fab241031d0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:38.124 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:38.119+0000 7fab29caa700 1 --2- 172.21.15.96:0/268707052 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab24103710 0x7fab24105af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:38.124 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:38.119+0000 7fab29caa700 1 -- 172.21.15.96:0/268707052 >> 172.21.15.96:0/268707052 conn(0x7fab240fa7f0 msgr2=0x7fab240fcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:38.125 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:38.119+0000 7fab29caa700 1 -- 172.21.15.96:0/268707052 shutdown_connections 2023-05-08T03:40:38.125 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:38.119+0000 7fab29caa700 1 -- 172.21.15.96:0/268707052 wait complete. 2023-05-08T03:40:38.125 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:38.119+0000 7fab29caa700 1 Processor -- start 2023-05-08T03:40:38.125 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:38.119+0000 7fab29caa700 1 -- start start 2023-05-08T03:40:38.125 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:38.119+0000 7fab29caa700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fab24100df0 0x7fab24100760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:38.125 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:38.119+0000 7fab29caa700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fab24103710 0x7fab240feda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:38.126 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:38.119+0000 7fab29caa700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab24106030 0x7fab240ff2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:38.126 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:38.119+0000 7fab29caa700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab240ffa80 con 0x7fab24100df0 2023-05-08T03:40:38.126 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:38.119+0000 7fab29caa700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab240ffbf0 con 0x7fab24106030 2023-05-08T03:40:38.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:38.119+0000 7fab29caa700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab241a00d0 con 0x7fab24103710 2023-05-08T03:40:38.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:38.120+0000 7fab237fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fab24100df0 0x7fab24100760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:38.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:38.120+0000 7fab237fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fab24100df0 0x7fab24100760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40266/0 (socket says 172.21.15.96:40266) 2023-05-08T03:40:38.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:38.120+0000 7fab237fe700 1 -- 172.21.15.96:0/99824339 learned_addr learned my addr 172.21.15.96:0/99824339 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:40:38.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:38.120+0000 7fab22ffd700 1 --2- 172.21.15.96:0/99824339 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fab24103710 0x7fab240feda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:38.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:38.120+0000 7fab23fff700 1 --2- 172.21.15.96:0/99824339 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab24106030 0x7fab240ff2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:38.128 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:38.120+0000 7fab237fe700 1 -- 172.21.15.96:0/99824339 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fab24103710 msgr2=0x7fab240feda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:38.128 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:38.120+0000 7fab237fe700 1 --2- 172.21.15.96:0/99824339 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fab24103710 0x7fab240feda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:38.128 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:38.120+0000 7fab237fe700 1 -- 172.21.15.96:0/99824339 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab24106030 msgr2=0x7fab240ff2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:38.128 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:38.120+0000 7fab237fe700 1 --2- 172.21.15.96:0/99824339 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab24106030 0x7fab240ff2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:38.128 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:38.120+0000 7fab237fe700 1 -- 172.21.15.96:0/99824339 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab140095f0 con 0x7fab24100df0 2023-05-08T03:40:38.128 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:38.120+0000 7fab237fe700 1 --2- 172.21.15.96:0/99824339 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fab24100df0 0x7fab24100760 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fab140059d0 tx=0x7fab14005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:38.128 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:38.120+0000 7fab20ff9700 1 -- 172.21.15.96:0/99824339 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab1401d070 con 0x7fab24100df0 2023-05-08T03:40:38.129 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:38.120+0000 7fab20ff9700 1 -- 172.21.15.96:0/99824339 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fab1400fc40 con 0x7fab24100df0 2023-05-08T03:40:38.129 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:38.120+0000 7fab29caa700 1 -- 172.21.15.96:0/99824339 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab2410bc70 con 0x7fab24100df0 2023-05-08T03:40:38.129 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:38.120+0000 7fab20ff9700 1 -- 172.21.15.96:0/99824339 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab14017650 con 0x7fab24100df0 2023-05-08T03:40:38.129 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:38.120+0000 7fab29caa700 1 -- 172.21.15.96:0/99824339 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab2410bae0 con 0x7fab24100df0 2023-05-08T03:40:38.131 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:38.121+0000 7fab29caa700 1 -- 172.21.15.96:0/99824339 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab240fc360 con 0x7fab24100df0 2023-05-08T03:40:38.131 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:38.123+0000 7fab20ff9700 1 -- 172.21.15.96:0/99824339 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fab14022470 con 0x7fab24100df0 2023-05-08T03:40:38.131 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:38.124+0000 7fab20ff9700 1 --2- 172.21.15.96:0/99824339 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fab0c0a1150 0x7fab0c0a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:38.131 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:38.124+0000 7fab20ff9700 1 -- 172.21.15.96:0/99824339 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fab140ce2b0 con 0x7fab24100df0 2023-05-08T03:40:38.132 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:38.124+0000 7fab22ffd700 1 --2- 172.21.15.96:0/99824339 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fab0c0a1150 0x7fab0c0a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:38.133 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:38.124+0000 7fab22ffd700 1 --2- 172.21.15.96:0/99824339 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fab0c0a1150 0x7fab0c0a3600 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fab18009bf0 tx=0x7fab18009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:38.133 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:38.128+0000 7fab20ff9700 1 -- 172.21.15.96:0/99824339 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fab14097e90 con 0x7fab24100df0 2023-05-08T03:40:38.369 INFO:journalctl@ceph.mds.i.smithi186.stdout:May 08 03:40:37 smithi186 systemd[1]: Started Ceph mds.i for f7ffcfb0-ed50-11ed-9b01-001a4aab830c. 2023-05-08T03:40:38.375 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:38.373+0000 7fab29caa700 1 -- 172.21.15.96:0/99824339 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fab24061980 con 0x7fab24100df0 2023-05-08T03:40:38.376 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:38.374+0000 7fab20ff9700 1 -- 172.21.15.96:0/99824339 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+7333 (secure 0 0 0) 0x7fab1409b4b0 con 0x7fab24100df0 2023-05-08T03:40:38.376 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:40:38.377 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6835/1518512221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":1518512221},{"type":"v1","addr":"172.21.15.96:6835","nonce":1518512221}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6837/305967678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6836","nonce":305967678},{"type":"v1","addr":"172.21.15.96:6837","nonce":305967678}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/2351258784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":2351258784},{"type":"v1","addr":"172.21.15.133:6833","nonce":2351258784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/2274306880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":2274306880},{"type":"v1","addr":"172.21.15.186:6833","nonce":2274306880}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24437,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1735118966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1735118966},{"type":"v1","addr":"172.21.15.133:6835","nonce":1735118966}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/3984391904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":3984391904},{"type":"v1","addr":"172.21.15.186:6835","nonce":3984391904}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/2218851414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":2218851414},{"type":"v1","addr":"172.21.15.133:6837","nonce":2218851414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24472,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6837/1556405826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":1556405826},{"type":"v1","addr":"172.21.15.186:6837","nonce":1556405826}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24487,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6839/1267655485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":1267655485},{"type":"v1","addr":"172.21.15.186:6839","nonce":1267655485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[]} 2023-05-08T03:40:38.378 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:38.376+0000 7fab29caa700 1 -- 172.21.15.96:0/99824339 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fab0c0a1150 msgr2=0x7fab0c0a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:38.379 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:38.376+0000 7fab29caa700 1 --2- 172.21.15.96:0/99824339 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fab0c0a1150 0x7fab0c0a3600 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fab18009bf0 tx=0x7fab18009260 comp rx=0 tx=0).stop 2023-05-08T03:40:38.379 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:38.376+0000 7fab29caa700 1 -- 172.21.15.96:0/99824339 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fab24100df0 msgr2=0x7fab24100760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:38.379 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:38.376+0000 7fab29caa700 1 --2- 172.21.15.96:0/99824339 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fab24100df0 0x7fab24100760 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fab140059d0 tx=0x7fab14005ef0 comp rx=0 tx=0).stop 2023-05-08T03:40:38.379 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:38.376+0000 7fab29caa700 1 -- 172.21.15.96:0/99824339 shutdown_connections 2023-05-08T03:40:38.379 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:38.376+0000 7fab29caa700 1 --2- 172.21.15.96:0/99824339 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fab0c0a1150 0x7fab0c0a3600 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:38.379 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:38.376+0000 7fab29caa700 1 --2- 172.21.15.96:0/99824339 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab24106030 0x7fab240ff2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:38.380 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:38.376+0000 7fab29caa700 1 --2- 172.21.15.96:0/99824339 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fab24100df0 0x7fab24100760 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:38.380 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:38.376+0000 7fab29caa700 1 --2- 172.21.15.96:0/99824339 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fab24103710 0x7fab240feda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:38.380 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:38.376+0000 7fab29caa700 1 -- 172.21.15.96:0/99824339 >> 172.21.15.96:0/99824339 conn(0x7fab240fa7f0 msgr2=0x7fab24101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:38.380 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:38.376+0000 7fab29caa700 1 -- 172.21.15.96:0/99824339 shutdown_connections 2023-05-08T03:40:38.380 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:38.376+0000 7fab29caa700 1 -- 172.21.15.96:0/99824339 wait complete. 2023-05-08T03:40:38.381 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 10 2023-05-08T03:40:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:38 smithi096 ceph-mon[124666]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-05-08T03:40:39.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:38 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:39.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:38 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:39.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:38 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:39.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:38 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-05-08T03:40:39.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:38 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-05-08T03:40:39.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:38 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:40:39.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:38 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:boot 2023-05-08T03:40:39.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:38 smithi096 ceph-mon[124666]: fsmap 9 up:standby 2023-05-08T03:40:39.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:38 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-05-08T03:40:39.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:38 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/99824339' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-05-08T03:40:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:38 smithi133 ceph-mon[125939]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-05-08T03:40:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:38 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:38 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:38 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:38 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-05-08T03:40:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:38 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-05-08T03:40:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:38 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:40:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:38 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:boot 2023-05-08T03:40:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:38 smithi133 ceph-mon[125939]: fsmap 9 up:standby 2023-05-08T03:40:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:38 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-05-08T03:40:39.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:38 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/99824339' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-05-08T03:40:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:38 smithi186 ceph-mon[126480]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-05-08T03:40:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:38 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:38 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:38 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:39.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:38 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-05-08T03:40:39.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:38 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-05-08T03:40:39.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:38 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:40:39.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:38 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:boot 2023-05-08T03:40:39.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:38 smithi186 ceph-mon[126480]: fsmap 9 up:standby 2023-05-08T03:40:39.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:38 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-05-08T03:40:39.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:38 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/99824339' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-05-08T03:40:39.755 INFO:journalctl@ceph.mds.g.smithi096.stdout:May 08 03:40:39 smithi096 systemd[1]: Starting Ceph mds.g for f7ffcfb0-ed50-11ed-9b01-001a4aab830c... 2023-05-08T03:40:40.170 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:39 smithi096 ceph-mon[124666]: Deploying daemon mds.g on smithi096 2023-05-08T03:40:40.170 INFO:journalctl@ceph.mds.g.smithi096.stdout:May 08 03:40:39 smithi096 podman[159123]: 2023-05-08T03:40:40.170 INFO:journalctl@ceph.mds.g.smithi096.stdout:May 08 03:40:40 smithi096 ceph-mds[159163]: -- 172.21.15.96:0/664713658 <== mon.0 v2:172.21.15.96:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55a5216b6b60 con 0x55a52168c800 2023-05-08T03:40:40.170 INFO:journalctl@ceph.mds.g.smithi096.stdout:May 08 03:40:40 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mds-g[159139]: starting mds.g at 2023-05-08T03:40:40.170 INFO:journalctl@ceph.mds.g.smithi096.stdout:May 08 03:40:40 smithi096 bash[159123]: 1f2146b287965c65e23082c05c510e4e12e3cb59c789dd68faba2b777a4cdb6b 2023-05-08T03:40:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:39 smithi133 ceph-mon[125939]: Deploying daemon mds.g on smithi096 2023-05-08T03:40:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:39 smithi186 ceph-mon[126480]: Deploying daemon mds.g on smithi096 2023-05-08T03:40:40.391 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-08T03:40:40.421 INFO:journalctl@ceph.mds.g.smithi096.stdout:May 08 03:40:40 smithi096 systemd[1]: Started Ceph mds.g for f7ffcfb0-ed50-11ed-9b01-001a4aab830c. 2023-05-08T03:40:40.521 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:40.519+0000 7f028679e700 1 -- 172.21.15.96:0/1384996430 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0280105e60 msgr2=0x7f02801082c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:40.521 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:40.519+0000 7f028679e700 1 --2- 172.21.15.96:0/1384996430 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0280105e60 0x7f02801082c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f027800b0a0 tx=0x7f027800b3b0 comp rx=0 tx=0).stop 2023-05-08T03:40:40.522 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:40.519+0000 7f028679e700 1 -- 172.21.15.96:0/1384996430 shutdown_connections 2023-05-08T03:40:40.522 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:40.519+0000 7f028679e700 1 --2- 172.21.15.96:0/1384996430 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0280105e60 0x7f02801082c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:40.522 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:40.519+0000 7f028679e700 1 --2- 172.21.15.96:0/1384996430 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0280100c20 0x7f0280103000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:40.522 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:40.519+0000 7f028679e700 1 --2- 172.21.15.96:0/1384996430 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0280103540 0x7f0280105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:40.522 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:40.519+0000 7f028679e700 1 -- 172.21.15.96:0/1384996430 >> 172.21.15.96:0/1384996430 conn(0x7f02800fa6c0 msgr2=0x7f02800fcaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:40.522 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:40.519+0000 7f028679e700 1 -- 172.21.15.96:0/1384996430 shutdown_connections 2023-05-08T03:40:40.522 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:40.519+0000 7f028679e700 1 -- 172.21.15.96:0/1384996430 wait complete. 2023-05-08T03:40:40.524 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:40.520+0000 7f028679e700 1 Processor -- start 2023-05-08T03:40:40.524 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:40.520+0000 7f028679e700 1 -- start start 2023-05-08T03:40:40.524 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:40.520+0000 7f028679e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0280100c20 0x7f0280100590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:40.524 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:40.520+0000 7f028679e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0280103540 0x7f02800febd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:40.525 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:40.520+0000 7f028679e700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0280105e60 0x7f02800ff110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:40.525 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:40.520+0000 7f028679e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02800ff8b0 con 0x7f0280100c20 2023-05-08T03:40:40.525 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:40.520+0000 7f028679e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02800ffa20 con 0x7f0280103540 2023-05-08T03:40:40.525 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:40.520+0000 7f028679e700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f028019ffb0 con 0x7f0280105e60 2023-05-08T03:40:40.525 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:40.520+0000 7f028579c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0280100c20 0x7f0280100590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:40.525 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:40.520+0000 7f028579c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0280100c20 0x7f0280100590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40288/0 (socket says 172.21.15.96:40288) 2023-05-08T03:40:40.525 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:40.520+0000 7f028579c700 1 -- 172.21.15.96:0/2615442111 learned_addr learned my addr 172.21.15.96:0/2615442111 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:40:40.526 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:40.520+0000 7f0284f9b700 1 --2- 172.21.15.96:0/2615442111 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0280103540 0x7f02800febd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:40.526 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:40.520+0000 7f0285f9d700 1 --2- 172.21.15.96:0/2615442111 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0280105e60 0x7f02800ff110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:40.526 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:40.520+0000 7f028579c700 1 -- 172.21.15.96:0/2615442111 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0280105e60 msgr2=0x7f02800ff110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:40.526 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:40.520+0000 7f028579c700 1 --2- 172.21.15.96:0/2615442111 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0280105e60 0x7f02800ff110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:40.526 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:40.520+0000 7f028579c700 1 -- 172.21.15.96:0/2615442111 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0280103540 msgr2=0x7f02800febd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:40.526 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:40.520+0000 7f028579c700 1 --2- 172.21.15.96:0/2615442111 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0280103540 0x7f02800febd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:40.526 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:40.520+0000 7f028579c700 1 -- 172.21.15.96:0/2615442111 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0278009d00 con 0x7f0280100c20 2023-05-08T03:40:40.526 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:40.521+0000 7f028579c700 1 --2- 172.21.15.96:0/2615442111 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0280100c20 0x7f0280100590 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f027c00d950 tx=0x7f027c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:40.527 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:40.521+0000 7f02767fc700 1 -- 172.21.15.96:0/2615442111 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027c00f890 con 0x7f0280100c20 2023-05-08T03:40:40.527 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:40.521+0000 7f02767fc700 1 -- 172.21.15.96:0/2615442111 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f027c010460 con 0x7f0280100c20 2023-05-08T03:40:40.527 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:40.521+0000 7f028679e700 1 -- 172.21.15.96:0/2615442111 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f028010bb00 con 0x7f0280100c20 2023-05-08T03:40:40.527 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:40.521+0000 7f02767fc700 1 -- 172.21.15.96:0/2615442111 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027c00e610 con 0x7f0280100c20 2023-05-08T03:40:40.527 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:40.521+0000 7f028679e700 1 -- 172.21.15.96:0/2615442111 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f028010b970 con 0x7f0280100c20 2023-05-08T03:40:40.528 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:40.522+0000 7f028679e700 1 -- 172.21.15.96:0/2615442111 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02800fc230 con 0x7f0280100c20 2023-05-08T03:40:40.528 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:40.523+0000 7f02767fc700 1 -- 172.21.15.96:0/2615442111 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f027c0108d0 con 0x7f0280100c20 2023-05-08T03:40:40.529 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:40.524+0000 7f02767fc700 1 --2- 172.21.15.96:0/2615442111 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f026c0a1150 0x7f026c0a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:40.529 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:40.524+0000 7f0284f9b700 1 --2- 172.21.15.96:0/2615442111 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f026c0a1150 0x7f026c0a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:40.529 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:40.524+0000 7f02767fc700 1 -- 172.21.15.96:0/2615442111 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f027c0cc2f0 con 0x7f0280100c20 2023-05-08T03:40:40.529 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:40.524+0000 7f0284f9b700 1 --2- 172.21.15.96:0/2615442111 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f026c0a1150 0x7f026c0a3600 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0270005950 tx=0x7f027000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:40.531 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:40.529+0000 7f02767fc700 1 -- 172.21.15.96:0/2615442111 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f027c095e40 con 0x7f0280100c20 2023-05-08T03:40:40.781 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:40.778+0000 7f028679e700 1 -- 172.21.15.96:0/2615442111 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f028002d0e0 con 0x7f0280100c20 2023-05-08T03:40:40.782 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:40.779+0000 7f02767fc700 1 -- 172.21.15.96:0/2615442111 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+7333 (secure 0 0 0) 0x7f027c099460 con 0x7f0280100c20 2023-05-08T03:40:40.782 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:40:40.782 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6835/1518512221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":1518512221},{"type":"v1","addr":"172.21.15.96:6835","nonce":1518512221}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6837/305967678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6836","nonce":305967678},{"type":"v1","addr":"172.21.15.96:6837","nonce":305967678}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/2351258784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":2351258784},{"type":"v1","addr":"172.21.15.133:6833","nonce":2351258784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/2274306880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":2274306880},{"type":"v1","addr":"172.21.15.186:6833","nonce":2274306880}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24437,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1735118966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1735118966},{"type":"v1","addr":"172.21.15.133:6835","nonce":1735118966}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/3984391904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":3984391904},{"type":"v1","addr":"172.21.15.186:6835","nonce":3984391904}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/2218851414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":2218851414},{"type":"v1","addr":"172.21.15.133:6837","nonce":2218851414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24472,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6837/1556405826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":1556405826},{"type":"v1","addr":"172.21.15.186:6837","nonce":1556405826}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24487,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6839/1267655485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":1267655485},{"type":"v1","addr":"172.21.15.186:6839","nonce":1267655485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[]} 2023-05-08T03:40:40.784 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:40.782+0000 7f028679e700 1 -- 172.21.15.96:0/2615442111 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f026c0a1150 msgr2=0x7f026c0a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:40.784 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:40.782+0000 7f028679e700 1 --2- 172.21.15.96:0/2615442111 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f026c0a1150 0x7f026c0a3600 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0270005950 tx=0x7f027000b410 comp rx=0 tx=0).stop 2023-05-08T03:40:40.784 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:40.782+0000 7f028679e700 1 -- 172.21.15.96:0/2615442111 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0280100c20 msgr2=0x7f0280100590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:40.784 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:40.782+0000 7f028679e700 1 --2- 172.21.15.96:0/2615442111 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0280100c20 0x7f0280100590 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f027c00d950 tx=0x7f027c00dc60 comp rx=0 tx=0).stop 2023-05-08T03:40:40.785 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:40.782+0000 7f028679e700 1 -- 172.21.15.96:0/2615442111 shutdown_connections 2023-05-08T03:40:40.785 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:40.782+0000 7f028679e700 1 --2- 172.21.15.96:0/2615442111 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f026c0a1150 0x7f026c0a3600 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:40.785 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:40.782+0000 7f028679e700 1 --2- 172.21.15.96:0/2615442111 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0280105e60 0x7f02800ff110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:40.786 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:40.782+0000 7f028679e700 1 --2- 172.21.15.96:0/2615442111 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0280100c20 0x7f0280100590 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:40.786 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:40.782+0000 7f028679e700 1 --2- 172.21.15.96:0/2615442111 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0280103540 0x7f02800febd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:40.786 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:40.782+0000 7f028679e700 1 -- 172.21.15.96:0/2615442111 >> 172.21.15.96:0/2615442111 conn(0x7f02800fa6c0 msgr2=0x7f0280101880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:40.786 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:40.782+0000 7f028679e700 1 -- 172.21.15.96:0/2615442111 shutdown_connections 2023-05-08T03:40:40.786 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:40.782+0000 7f028679e700 1 -- 172.21.15.96:0/2615442111 wait complete. 2023-05-08T03:40:40.786 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 10 2023-05-08T03:40:41.047 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:40 smithi096 ceph-mon[124666]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-05-08T03:40:41.048 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:40 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:41.048 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:40 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:41.048 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:40 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:41.048 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:40 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-05-08T03:40:41.048 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:40 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-05-08T03:40:41.048 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:40 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:40:41.048 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:40 smithi096 ceph-mon[124666]: Deploying daemon mds.a on smithi096 2023-05-08T03:40:41.049 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:40 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/2615442111' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-05-08T03:40:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:40 smithi133 ceph-mon[125939]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-05-08T03:40:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:40 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:40 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:40 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:41.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:40 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-05-08T03:40:41.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:40 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-05-08T03:40:41.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:40 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:40:41.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:40 smithi133 ceph-mon[125939]: Deploying daemon mds.a on smithi096 2023-05-08T03:40:41.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:40 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/2615442111' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-05-08T03:40:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:40 smithi186 ceph-mon[126480]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-05-08T03:40:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:40 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:40 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:40 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:41.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:40 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-05-08T03:40:41.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:40 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-05-08T03:40:41.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:40 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:40:41.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:40 smithi186 ceph-mon[126480]: Deploying daemon mds.a on smithi096 2023-05-08T03:40:41.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:40 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/2615442111' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-05-08T03:40:41.944 INFO:journalctl@ceph.mds.a.smithi096.stdout:May 08 03:40:41 smithi096 systemd[1]: Starting Ceph mds.a for f7ffcfb0-ed50-11ed-9b01-001a4aab830c... 2023-05-08T03:40:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:41 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.96:6838/2596991665,v1:172.21.15.96:6839/2596991665] up:boot 2023-05-08T03:40:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:41 smithi133 ceph-mon[125939]: fsmap 10 up:standby 2023-05-08T03:40:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:41 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-05-08T03:40:42.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:41 smithi133 ceph-mon[125939]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-05-08T03:40:42.249 INFO:journalctl@ceph.mds.a.smithi096.stdout:May 08 03:40:42 smithi096 podman[159507]: 2023-05-08T03:40:42.249 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:41 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.96:6838/2596991665,v1:172.21.15.96:6839/2596991665] up:boot 2023-05-08T03:40:42.250 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:41 smithi096 ceph-mon[124666]: fsmap 10 up:standby 2023-05-08T03:40:42.250 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:41 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-05-08T03:40:42.250 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:41 smithi096 ceph-mon[124666]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-05-08T03:40:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:41 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.96:6838/2596991665,v1:172.21.15.96:6839/2596991665] up:boot 2023-05-08T03:40:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:41 smithi186 ceph-mon[126480]: fsmap 10 up:standby 2023-05-08T03:40:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:41 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-05-08T03:40:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:41 smithi186 ceph-mon[126480]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-05-08T03:40:42.755 INFO:journalctl@ceph.mds.a.smithi096.stdout:May 08 03:40:42 smithi096 ceph-mds[159547]: -- 172.21.15.96:0/3074180046 <== mon.0 v2:172.21.15.96:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56148f056b60 con 0x56148f02cc00 2023-05-08T03:40:42.755 INFO:journalctl@ceph.mds.a.smithi096.stdout:May 08 03:40:42 smithi096 bash[159507]: 547b3816cacebb7d2473349ccb06dfe4f48fd5886c1d4a1b8a170a83aaccc3f4 2023-05-08T03:40:42.755 INFO:journalctl@ceph.mds.a.smithi096.stdout:May 08 03:40:42 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mds-a[159523]: starting mds.a at 2023-05-08T03:40:42.755 INFO:journalctl@ceph.mds.a.smithi096.stdout:May 08 03:40:42 smithi096 systemd[1]: Started Ceph mds.a for f7ffcfb0-ed50-11ed-9b01-001a4aab830c. 2023-05-08T03:40:42.799 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-08T03:40:42.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:42.924+0000 7f5f6784e700 1 -- 172.21.15.96:0/778509396 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f60100430 msgr2=0x7f5f60100880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:42.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:42.924+0000 7f5f6784e700 1 --2- 172.21.15.96:0/778509396 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f60100430 0x7f5f60100880 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c009990 tx=0x7f5f5c009ca0 comp rx=0 tx=0).stop 2023-05-08T03:40:42.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:42.924+0000 7f5f6784e700 1 -- 172.21.15.96:0/778509396 shutdown_connections 2023-05-08T03:40:42.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:42.924+0000 7f5f6784e700 1 --2- 172.21.15.96:0/778509396 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f60100dc0 0x7f5f60107680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:42.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:42.924+0000 7f5f6784e700 1 --2- 172.21.15.96:0/778509396 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5f600ff240 0x7f5f600ff650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:42.930 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:42.924+0000 7f5f6784e700 1 --2- 172.21.15.96:0/778509396 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f60100430 0x7f5f60100880 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:42.930 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:42.924+0000 7f5f6784e700 1 -- 172.21.15.96:0/778509396 >> 172.21.15.96:0/778509396 conn(0x7f5f600fa820 msgr2=0x7f5f600fcc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:42.930 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:42.924+0000 7f5f6784e700 1 -- 172.21.15.96:0/778509396 shutdown_connections 2023-05-08T03:40:42.930 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:42.924+0000 7f5f6784e700 1 -- 172.21.15.96:0/778509396 wait complete. 2023-05-08T03:40:42.931 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:42.925+0000 7f5f6784e700 1 Processor -- start 2023-05-08T03:40:42.931 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:42.925+0000 7f5f6784e700 1 -- start start 2023-05-08T03:40:42.931 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:42.925+0000 7f5f6784e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f600ff240 0x7f5f60195030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:42.931 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:42.925+0000 7f5f6784e700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5f60100430 0x7f5f60195570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:42.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:42.925+0000 7f5f6784e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f60100dc0 0x7f5f6019c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:42.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:42.925+0000 7f5f6784e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6019cbb0 con 0x7f5f600ff240 2023-05-08T03:40:42.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:42.925+0000 7f5f6784e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6019ccf0 con 0x7f5f60100dc0 2023-05-08T03:40:42.933 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:42.925+0000 7f5f6784e700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6019ce80 con 0x7f5f60100430 2023-05-08T03:40:42.933 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:42.925+0000 7f5f655ea700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f600ff240 0x7f5f60195030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:42.933 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:42.925+0000 7f5f655ea700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f600ff240 0x7f5f60195030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40314/0 (socket says 172.21.15.96:40314) 2023-05-08T03:40:42.933 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:42.925+0000 7f5f655ea700 1 -- 172.21.15.96:0/993874298 learned_addr learned my addr 172.21.15.96:0/993874298 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:40:42.934 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:42.926+0000 7f5f64de9700 1 --2- 172.21.15.96:0/993874298 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5f60100430 0x7f5f60195570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:42.934 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:42.926+0000 7f5f655ea700 1 -- 172.21.15.96:0/993874298 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5f60100430 msgr2=0x7f5f60195570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:42.934 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:42.926+0000 7f5f655ea700 1 --2- 172.21.15.96:0/993874298 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5f60100430 0x7f5f60195570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:42.934 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:42.926+0000 7f5f655ea700 1 -- 172.21.15.96:0/993874298 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f60100dc0 msgr2=0x7f5f6019c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:42.935 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:42.926+0000 7f5f655ea700 1 --2- 172.21.15.96:0/993874298 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f60100dc0 0x7f5f6019c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:42.935 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:42.926+0000 7f5f655ea700 1 -- 172.21.15.96:0/993874298 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f5c0095f0 con 0x7f5f600ff240 2023-05-08T03:40:42.935 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:42.926+0000 7f5f64de9700 1 --2- 172.21.15.96:0/993874298 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5f60100430 0x7f5f60195570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-08T03:40:42.935 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:42.926+0000 7f5f655ea700 1 --2- 172.21.15.96:0/993874298 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f600ff240 0x7f5f60195030 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5f5000b500 tx=0x7f5f5000b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:42.936 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:42.926+0000 7f5f567fc700 1 -- 172.21.15.96:0/993874298 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f50011830 con 0x7f5f600ff240 2023-05-08T03:40:42.936 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:42.926+0000 7f5f6784e700 1 -- 172.21.15.96:0/993874298 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f6010aca0 con 0x7f5f600ff240 2023-05-08T03:40:42.936 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:42.926+0000 7f5f567fc700 1 -- 172.21.15.96:0/993874298 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5f50011e50 con 0x7f5f600ff240 2023-05-08T03:40:42.937 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:42.926+0000 7f5f567fc700 1 -- 172.21.15.96:0/993874298 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5000f2e0 con 0x7f5f600ff240 2023-05-08T03:40:42.937 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:42.926+0000 7f5f6784e700 1 -- 172.21.15.96:0/993874298 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f6010ab10 con 0x7f5f600ff240 2023-05-08T03:40:42.938 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:42.927+0000 7f5f6784e700 1 -- 172.21.15.96:0/993874298 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f60106140 con 0x7f5f600ff240 2023-05-08T03:40:42.938 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:42.928+0000 7f5f567fc700 1 -- 172.21.15.96:0/993874298 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f5f50010580 con 0x7f5f600ff240 2023-05-08T03:40:42.938 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:42.928+0000 7f5f567fc700 1 --2- 172.21.15.96:0/993874298 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f5f4c0a1150 0x7f5f4c0a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:42.938 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:42.929+0000 7f5f567fc700 1 -- 172.21.15.96:0/993874298 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f5f500cc590 con 0x7f5f600ff240 2023-05-08T03:40:42.938 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:42.929+0000 7f5f64de9700 1 --2- 172.21.15.96:0/993874298 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f5f4c0a1150 0x7f5f4c0a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:42.938 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:42.929+0000 7f5f64de9700 1 --2- 172.21.15.96:0/993874298 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f5f4c0a1150 0x7f5f4c0a3600 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c005f50 tx=0x7f5f5c005e80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:42.939 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:42.932+0000 7f5f567fc700 1 -- 172.21.15.96:0/993874298 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f5f500960e0 con 0x7f5f600ff240 2023-05-08T03:40:43.168 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:43.166+0000 7f5f6784e700 1 -- 172.21.15.96:0/993874298 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5f60061800 con 0x7f5f600ff240 2023-05-08T03:40:43.169 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:43.166+0000 7f5f567fc700 1 -- 172.21.15.96:0/993874298 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+8091 (secure 0 0 0) 0x7f5f50099700 con 0x7f5f600ff240 2023-05-08T03:40:43.169 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:40:43.169 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6835/1518512221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":1518512221},{"type":"v1","addr":"172.21.15.96:6835","nonce":1518512221}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6837/305967678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6836","nonce":305967678},{"type":"v1","addr":"172.21.15.96:6837","nonce":305967678}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14622,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6839/2596991665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6838","nonce":2596991665},{"type":"v1","addr":"172.21.15.96:6839","nonce":2596991665}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/2351258784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":2351258784},{"type":"v1","addr":"172.21.15.133:6833","nonce":2351258784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/2274306880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":2274306880},{"type":"v1","addr":"172.21.15.186:6833","nonce":2274306880}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24437,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1735118966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1735118966},{"type":"v1","addr":"172.21.15.133:6835","nonce":1735118966}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/3984391904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":3984391904},{"type":"v1","addr":"172.21.15.186:6835","nonce":3984391904}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/2218851414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":2218851414},{"type":"v1","addr":"172.21.15.133:6837","nonce":2218851414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24472,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6837/1556405826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":1556405826},{"type":"v1","addr":"172.21.15.186:6837","nonce":1556405826}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24487,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6839/1267655485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":1267655485},{"type":"v1","addr":"172.21.15.186:6839","nonce":1267655485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[]} 2023-05-08T03:40:43.171 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:43.168+0000 7f5f6784e700 1 -- 172.21.15.96:0/993874298 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f5f4c0a1150 msgr2=0x7f5f4c0a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:43.171 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:43.168+0000 7f5f6784e700 1 --2- 172.21.15.96:0/993874298 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f5f4c0a1150 0x7f5f4c0a3600 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c005f50 tx=0x7f5f5c005e80 comp rx=0 tx=0).stop 2023-05-08T03:40:43.171 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:43.168+0000 7f5f6784e700 1 -- 172.21.15.96:0/993874298 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f600ff240 msgr2=0x7f5f60195030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:43.171 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:43.168+0000 7f5f6784e700 1 --2- 172.21.15.96:0/993874298 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f600ff240 0x7f5f60195030 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5f5000b500 tx=0x7f5f5000b8c0 comp rx=0 tx=0).stop 2023-05-08T03:40:43.172 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:43.168+0000 7f5f6784e700 1 -- 172.21.15.96:0/993874298 shutdown_connections 2023-05-08T03:40:43.172 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:43.168+0000 7f5f6784e700 1 --2- 172.21.15.96:0/993874298 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f5f4c0a1150 0x7f5f4c0a3600 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:43.172 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:43.168+0000 7f5f6784e700 1 --2- 172.21.15.96:0/993874298 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f60100dc0 0x7f5f6019c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:43.172 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:43.168+0000 7f5f6784e700 1 --2- 172.21.15.96:0/993874298 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f600ff240 0x7f5f60195030 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:43.172 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:43.168+0000 7f5f6784e700 1 --2- 172.21.15.96:0/993874298 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5f60100430 0x7f5f60195570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:43.172 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:43.168+0000 7f5f6784e700 1 -- 172.21.15.96:0/993874298 >> 172.21.15.96:0/993874298 conn(0x7f5f600fa820 msgr2=0x7f5f600fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:43.172 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:43.168+0000 7f5f6784e700 1 -- 172.21.15.96:0/993874298 shutdown_connections 2023-05-08T03:40:43.173 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:43.168+0000 7f5f6784e700 1 -- 172.21.15.96:0/993874298 wait complete. 2023-05-08T03:40:43.173 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 11 2023-05-08T03:40:43.637 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:43 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:43.637 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:43 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:43.637 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:43 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:43.637 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:43 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-05-08T03:40:43.638 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:43 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-05-08T03:40:43.638 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:43 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:40:43.638 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:43 smithi133 ceph-mon[125939]: Deploying daemon mds.b on smithi133 2023-05-08T03:40:43.638 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:43 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/993874298' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-05-08T03:40:43.638 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.96:6840/1786091200,v1:172.21.15.96:6841/1786091200] up:boot 2023-05-08T03:40:43.638 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:43 smithi133 ceph-mon[125939]: fsmap 11 up:standby 2023-05-08T03:40:43.638 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:43 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-05-08T03:40:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:43 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:43.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:43 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:43.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:43 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:43.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:43 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-05-08T03:40:43.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:43 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-05-08T03:40:43.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:43 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:40:43.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:43 smithi096 ceph-mon[124666]: Deploying daemon mds.b on smithi133 2023-05-08T03:40:43.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:43 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/993874298' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-05-08T03:40:43.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.96:6840/1786091200,v1:172.21.15.96:6841/1786091200] up:boot 2023-05-08T03:40:43.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:43 smithi096 ceph-mon[124666]: fsmap 11 up:standby 2023-05-08T03:40:43.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:43 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-05-08T03:40:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:43 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:43 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:43.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:43 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:43.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:43 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-05-08T03:40:43.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:43 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-05-08T03:40:43.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:43 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:40:43.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:43 smithi186 ceph-mon[126480]: Deploying daemon mds.b on smithi133 2023-05-08T03:40:43.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:43 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/993874298' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-05-08T03:40:43.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.96:6840/1786091200,v1:172.21.15.96:6841/1786091200] up:boot 2023-05-08T03:40:43.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:43 smithi186 ceph-mon[126480]: fsmap 11 up:standby 2023-05-08T03:40:43.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:43 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-05-08T03:40:44.240 INFO:journalctl@ceph.mds.b.smithi133.stdout:May 08 03:40:44 smithi133 systemd[1]: Starting Ceph mds.b for f7ffcfb0-ed50-11ed-9b01-001a4aab830c... 2023-05-08T03:40:44.720 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:44 smithi133 ceph-mon[125939]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-05-08T03:40:44.720 INFO:journalctl@ceph.mds.b.smithi133.stdout:May 08 03:40:44 smithi133 podman[151453]: 2023-05-08T03:40:44.720 INFO:journalctl@ceph.mds.b.smithi133.stdout:May 08 03:40:44 smithi133 ceph-mds[151493]: -- 172.21.15.133:0/1907208945 <== mon.2 v2:172.21.15.133:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56206dba4b60 con 0x56206db7b000 2023-05-08T03:40:44.720 INFO:journalctl@ceph.mds.b.smithi133.stdout:May 08 03:40:44 smithi133 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mds-b[151469]: starting mds.b at 2023-05-08T03:40:44.721 INFO:journalctl@ceph.mds.b.smithi133.stdout:May 08 03:40:44 smithi133 bash[151453]: 501feffaa54f9838723a0295c5c1e150c3c3e0fa7de86e4c690f846e9d0a6877 2023-05-08T03:40:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:44 smithi096 ceph-mon[124666]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-05-08T03:40:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:44 smithi186 ceph-mon[126480]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-05-08T03:40:44.989 INFO:journalctl@ceph.mds.b.smithi133.stdout:May 08 03:40:44 smithi133 systemd[1]: Started Ceph mds.b for f7ffcfb0-ed50-11ed-9b01-001a4aab830c. 2023-05-08T03:40:45.184 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-08T03:40:45.311 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.308+0000 7ff1706fd700 1 -- 172.21.15.96:0/2864054636 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1680fe6d0 msgr2=0x7ff1680feae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:45.311 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.308+0000 7ff1706fd700 1 --2- 172.21.15.96:0/2864054636 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1680fe6d0 0x7ff1680feae0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff164009990 tx=0x7ff164009ca0 comp rx=0 tx=0).stop 2023-05-08T03:40:45.312 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.308+0000 7ff1706fd700 1 -- 172.21.15.96:0/2864054636 shutdown_connections 2023-05-08T03:40:45.312 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.308+0000 7ff1706fd700 1 --2- 172.21.15.96:0/2864054636 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff168102030 0x7ff1681088f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:45.312 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.308+0000 7ff1706fd700 1 --2- 172.21.15.96:0/2864054636 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1680fe6d0 0x7ff1680feae0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:45.312 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.308+0000 7ff1706fd700 1 --2- 172.21.15.96:0/2864054636 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff1681016a0 0x7ff168101af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:45.312 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.308+0000 7ff1706fd700 1 -- 172.21.15.96:0/2864054636 >> 172.21.15.96:0/2864054636 conn(0x7ff1680fa0b0 msgr2=0x7ff1680fc4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:45.312 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.309+0000 7ff1706fd700 1 -- 172.21.15.96:0/2864054636 shutdown_connections 2023-05-08T03:40:45.312 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.309+0000 7ff1706fd700 1 -- 172.21.15.96:0/2864054636 wait complete. 2023-05-08T03:40:45.314 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.309+0000 7ff1706fd700 1 Processor -- start 2023-05-08T03:40:45.314 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.309+0000 7ff1706fd700 1 -- start start 2023-05-08T03:40:45.314 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.310+0000 7ff1706fd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1680fe6d0 0x7ff168193f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:45.315 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.310+0000 7ff1706fd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1681016a0 0x7ff168194450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:45.315 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.310+0000 7ff1706fd700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff168102030 0x7ff16819b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:45.315 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.310+0000 7ff1706fd700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff16819ba90 con 0x7ff1681016a0 2023-05-08T03:40:45.315 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.310+0000 7ff1706fd700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff16819bbd0 con 0x7ff1680fe6d0 2023-05-08T03:40:45.315 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.310+0000 7ff1706fd700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff16819bd60 con 0x7ff168102030 2023-05-08T03:40:45.315 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.310+0000 7ff16dc98700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1681016a0 0x7ff168194450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:45.315 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.310+0000 7ff16dc98700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1681016a0 0x7ff168194450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40332/0 (socket says 172.21.15.96:40332) 2023-05-08T03:40:45.315 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.310+0000 7ff16dc98700 1 -- 172.21.15.96:0/3237864104 learned_addr learned my addr 172.21.15.96:0/3237864104 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:40:45.316 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.310+0000 7ff16ec9a700 1 --2- 172.21.15.96:0/3237864104 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff168102030 0x7ff16819b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:45.316 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.310+0000 7ff16e499700 1 --2- 172.21.15.96:0/3237864104 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1680fe6d0 0x7ff168193f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:45.316 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.310+0000 7ff16ec9a700 1 -- 172.21.15.96:0/3237864104 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1680fe6d0 msgr2=0x7ff168193f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:45.316 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.310+0000 7ff16ec9a700 1 --2- 172.21.15.96:0/3237864104 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1680fe6d0 0x7ff168193f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:45.316 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.310+0000 7ff16ec9a700 1 -- 172.21.15.96:0/3237864104 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1681016a0 msgr2=0x7ff168194450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:45.316 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.310+0000 7ff16ec9a700 1 --2- 172.21.15.96:0/3237864104 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1681016a0 0x7ff168194450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:45.316 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.310+0000 7ff16ec9a700 1 -- 172.21.15.96:0/3237864104 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1640095f0 con 0x7ff168102030 2023-05-08T03:40:45.317 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.310+0000 7ff16dc98700 1 --2- 172.21.15.96:0/3237864104 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1681016a0 0x7ff168194450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-08T03:40:45.317 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.310+0000 7ff16ec9a700 1 --2- 172.21.15.96:0/3237864104 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff168102030 0x7ff16819b4c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff16000efc0 tx=0x7ff16000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:45.317 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.310+0000 7ff15f7fe700 1 -- 172.21.15.96:0/3237864104 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff160018070 con 0x7ff168102030 2023-05-08T03:40:45.317 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.310+0000 7ff1706fd700 1 -- 172.21.15.96:0/3237864104 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff168109c50 con 0x7ff168102030 2023-05-08T03:40:45.317 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.310+0000 7ff15f7fe700 1 -- 172.21.15.96:0/3237864104 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff16000f040 con 0x7ff168102030 2023-05-08T03:40:45.317 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.311+0000 7ff15f7fe700 1 -- 172.21.15.96:0/3237864104 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff16000cd40 con 0x7ff168102030 2023-05-08T03:40:45.317 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.311+0000 7ff1706fd700 1 -- 172.21.15.96:0/3237864104 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff168109ac0 con 0x7ff168102030 2023-05-08T03:40:45.317 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.311+0000 7ff1706fd700 1 -- 172.21.15.96:0/3237864104 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff168107430 con 0x7ff168102030 2023-05-08T03:40:45.318 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.313+0000 7ff15f7fe700 1 -- 172.21.15.96:0/3237864104 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7ff160003a00 con 0x7ff168102030 2023-05-08T03:40:45.318 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.313+0000 7ff15f7fe700 1 --2- 172.21.15.96:0/3237864104 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7ff1540a1150 0x7ff1540a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:45.318 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.313+0000 7ff16e499700 1 --2- 172.21.15.96:0/3237864104 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7ff1540a1150 0x7ff1540a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:45.319 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.313+0000 7ff15f7fe700 1 -- 172.21.15.96:0/3237864104 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7ff1600cc170 con 0x7ff168102030 2023-05-08T03:40:45.319 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.314+0000 7ff16e499700 1 --2- 172.21.15.96:0/3237864104 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7ff1540a1150 0x7ff1540a3600 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff16400b2e0 tx=0x7ff164005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:45.319 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.317+0000 7ff15f7fe700 1 -- 172.21.15.96:0/3237864104 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7ff160095df0 con 0x7ff168102030 2023-05-08T03:40:45.573 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.570+0000 7ff1706fd700 1 -- 172.21.15.96:0/3237864104 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff16802d0e0 con 0x7ff168102030 2023-05-08T03:40:45.574 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.571+0000 7ff15f7fe700 1 -- 172.21.15.96:0/3237864104 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+9610 (secure 0 0 0) 0x7ff160099410 con 0x7ff168102030 2023-05-08T03:40:45.574 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:40:45.575 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6835/1518512221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":1518512221},{"type":"v1","addr":"172.21.15.96:6835","nonce":1518512221}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6837/305967678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6836","nonce":305967678},{"type":"v1","addr":"172.21.15.96:6837","nonce":305967678}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14622,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6839/2596991665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6838","nonce":2596991665},{"type":"v1","addr":"172.21.15.96:6839","nonce":2596991665}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6841/1786091200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6840","nonce":1786091200},{"type":"v1","addr":"172.21.15.96:6841","nonce":1786091200}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/2351258784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":2351258784},{"type":"v1","addr":"172.21.15.133:6833","nonce":2351258784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/2274306880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":2274306880},{"type":"v1","addr":"172.21.15.186:6833","nonce":2274306880}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24437,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1735118966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1735118966},{"type":"v1","addr":"172.21.15.133:6835","nonce":1735118966}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/3984391904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":3984391904},{"type":"v1","addr":"172.21.15.186:6835","nonce":3984391904}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/2218851414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":2218851414},{"type":"v1","addr":"172.21.15.133:6837","nonce":2218851414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24472,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6837/1556405826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":1556405826},{"type":"v1","addr":"172.21.15.186:6837","nonce":1556405826}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24487,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6839/1267655485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":1267655485},{"type":"v1","addr":"172.21.15.186:6839","nonce":1267655485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":24494,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6839/2246041493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6838","nonce":2246041493},{"type":"v1","addr":"172.21.15.133:6839","nonce":2246041493}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[]} 2023-05-08T03:40:45.576 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.573+0000 7ff1706fd700 1 -- 172.21.15.96:0/3237864104 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7ff1540a1150 msgr2=0x7ff1540a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:45.577 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.573+0000 7ff1706fd700 1 --2- 172.21.15.96:0/3237864104 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7ff1540a1150 0x7ff1540a3600 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff16400b2e0 tx=0x7ff164005fb0 comp rx=0 tx=0).stop 2023-05-08T03:40:45.577 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.573+0000 7ff1706fd700 1 -- 172.21.15.96:0/3237864104 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff168102030 msgr2=0x7ff16819b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:45.577 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.573+0000 7ff1706fd700 1 --2- 172.21.15.96:0/3237864104 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff168102030 0x7ff16819b4c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff16000efc0 tx=0x7ff16000c3a0 comp rx=0 tx=0).stop 2023-05-08T03:40:45.578 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.573+0000 7ff1706fd700 1 -- 172.21.15.96:0/3237864104 shutdown_connections 2023-05-08T03:40:45.578 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.573+0000 7ff1706fd700 1 --2- 172.21.15.96:0/3237864104 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7ff1540a1150 0x7ff1540a3600 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:45.578 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.573+0000 7ff1706fd700 1 --2- 172.21.15.96:0/3237864104 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff168102030 0x7ff16819b4c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:45.578 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.573+0000 7ff1706fd700 1 --2- 172.21.15.96:0/3237864104 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1680fe6d0 0x7ff168193f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:45.578 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.573+0000 7ff1706fd700 1 --2- 172.21.15.96:0/3237864104 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1681016a0 0x7ff168194450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:45.578 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.573+0000 7ff1706fd700 1 -- 172.21.15.96:0/3237864104 >> 172.21.15.96:0/3237864104 conn(0x7ff1680fa0b0 msgr2=0x7ff1680fc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:45.579 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.573+0000 7ff1706fd700 1 -- 172.21.15.96:0/3237864104 shutdown_connections 2023-05-08T03:40:45.579 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.573+0000 7ff1706fd700 1 -- 172.21.15.96:0/3237864104 wait complete. 2023-05-08T03:40:45.579 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 13 2023-05-08T03:40:45.588 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-08T03:40:45.712 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.709+0000 7f86917fb700 1 -- 172.21.15.96:0/2717888750 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f868c0ff280 msgr2=0x7f868c0ff690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:45.713 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.709+0000 7f86917fb700 1 --2- 172.21.15.96:0/2717888750 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f868c0ff280 0x7f868c0ff690 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f867c009990 tx=0x7f867c009ca0 comp rx=0 tx=0).stop 2023-05-08T03:40:45.713 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.709+0000 7f86917fb700 1 -- 172.21.15.96:0/2717888750 shutdown_connections 2023-05-08T03:40:45.713 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.709+0000 7f86917fb700 1 --2- 172.21.15.96:0/2717888750 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f868c100e00 0x7f868c1076c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:45.713 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.709+0000 7f86917fb700 1 --2- 172.21.15.96:0/2717888750 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f868c0ff280 0x7f868c0ff690 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:45.713 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.709+0000 7f86917fb700 1 --2- 172.21.15.96:0/2717888750 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f868c100470 0x7f868c1008c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:45.713 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.709+0000 7f86917fb700 1 -- 172.21.15.96:0/2717888750 >> 172.21.15.96:0/2717888750 conn(0x7f868c0fa880 msgr2=0x7f868c0fccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:45.713 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.709+0000 7f86917fb700 1 -- 172.21.15.96:0/2717888750 shutdown_connections 2023-05-08T03:40:45.714 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.710+0000 7f86917fb700 1 -- 172.21.15.96:0/2717888750 wait complete. 2023-05-08T03:40:45.714 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.710+0000 7f86917fb700 1 Processor -- start 2023-05-08T03:40:45.714 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.710+0000 7f86917fb700 1 -- start start 2023-05-08T03:40:45.716 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.710+0000 7f86917fb700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f868c0ff280 0x7f868c069c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:45.717 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.710+0000 7f86917fb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f868c100470 0x7f868c19ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:45.717 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.710+0000 7f86917fb700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f868c100e00 0x7f868c19d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:45.717 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.710+0000 7f86917fb700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f868c19dc60 con 0x7f868c0ff280 2023-05-08T03:40:45.717 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.710+0000 7f86917fb700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f868c19ddd0 con 0x7f868c100470 2023-05-08T03:40:45.718 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.710+0000 7f86917fb700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f868c19df90 con 0x7f868c100e00 2023-05-08T03:40:45.718 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.710+0000 7f868affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f868c0ff280 0x7f868c069c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:45.718 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.711+0000 7f868affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f868c0ff280 0x7f868c069c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40342/0 (socket says 172.21.15.96:40342) 2023-05-08T03:40:45.718 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.711+0000 7f868affd700 1 -- 172.21.15.96:0/215551918 learned_addr learned my addr 172.21.15.96:0/215551918 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:40:45.719 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.711+0000 7f868a7fc700 1 --2- 172.21.15.96:0/215551918 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f868c100470 0x7f868c19ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:45.719 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.711+0000 7f868b7fe700 1 --2- 172.21.15.96:0/215551918 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f868c100e00 0x7f868c19d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:45.719 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.711+0000 7f868affd700 1 -- 172.21.15.96:0/215551918 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f868c100e00 msgr2=0x7f868c19d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:45.719 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.711+0000 7f868affd700 1 --2- 172.21.15.96:0/215551918 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f868c100e00 0x7f868c19d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:45.719 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.711+0000 7f868affd700 1 -- 172.21.15.96:0/215551918 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f868c100470 msgr2=0x7f868c19ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:45.719 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.711+0000 7f868affd700 1 --2- 172.21.15.96:0/215551918 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f868c100470 0x7f868c19ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:45.719 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.711+0000 7f868affd700 1 -- 172.21.15.96:0/215551918 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8680009520 con 0x7f868c0ff280 2023-05-08T03:40:45.720 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.711+0000 7f868affd700 1 --2- 172.21.15.96:0/215551918 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f868c0ff280 0x7f868c069c80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f867c004730 tx=0x7f867c004760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:45.720 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.711+0000 7f8673fff700 1 -- 172.21.15.96:0/215551918 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867c01d070 con 0x7f868c0ff280 2023-05-08T03:40:45.720 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.711+0000 7f8673fff700 1 -- 172.21.15.96:0/215551918 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f867c021410 con 0x7f868c0ff280 2023-05-08T03:40:45.720 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.711+0000 7f86917fb700 1 -- 172.21.15.96:0/215551918 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f867c0095f0 con 0x7f868c0ff280 2023-05-08T03:40:45.720 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.711+0000 7f8673fff700 1 -- 172.21.15.96:0/215551918 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867c017650 con 0x7f868c0ff280 2023-05-08T03:40:45.720 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.711+0000 7f86917fb700 1 -- 172.21.15.96:0/215551918 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f868c10abe0 con 0x7f868c0ff280 2023-05-08T03:40:45.720 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.712+0000 7f86917fb700 1 -- 172.21.15.96:0/215551918 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f868c1067f0 con 0x7f868c0ff280 2023-05-08T03:40:45.721 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.713+0000 7f8673fff700 1 -- 172.21.15.96:0/215551918 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f867c021580 con 0x7f868c0ff280 2023-05-08T03:40:45.721 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.714+0000 7f8673fff700 1 --2- 172.21.15.96:0/215551918 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f86740a1150 0x7f86740a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:45.721 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.714+0000 7f868a7fc700 1 --2- 172.21.15.96:0/215551918 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f86740a1150 0x7f86740a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:45.722 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.714+0000 7f8673fff700 1 -- 172.21.15.96:0/215551918 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f867c0cdc30 con 0x7f868c0ff280 2023-05-08T03:40:45.722 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.714+0000 7f868a7fc700 1 --2- 172.21.15.96:0/215551918 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f86740a1150 0x7f86740a3600 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8680009df0 tx=0x7f8680009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:45.722 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.718+0000 7f8673fff700 1 -- 172.21.15.96:0/215551918 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f867c0979d0 con 0x7f868c0ff280 2023-05-08T03:40:45.928 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.925+0000 7f86917fb700 1 -- 172.21.15.96:0/215551918 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f868c067f40 con 0x7f868c0ff280 2023-05-08T03:40:45.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.926+0000 7f8673fff700 1 -- 172.21.15.96:0/215551918 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+18399 (secure 0 0 0) 0x7f867c09aff0 con 0x7f868c0ff280 2023-05-08T03:40:45.929 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:40:45.929 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":78,"fsid":"f7ffcfb0-ed50-11ed-9b01-001a4aab830c","created":"2023-05-08T03:33:42.765680+0000","modified":"2023-05-08T03:40:08.557646+0000","last_up_change":"2023-05-08T03:40:07.550882+0000","last_in_change":"2023-05-08T03:39:49.027947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-08T03:36:47.800739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2ee801e1-8eec-496d-a9ac-fc566b38bbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":1816903726},{"type":"v1","addr":"172.21.15.96:6803","nonce":1816903726}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":1816903726},{"type":"v1","addr":"172.21.15.96:6805","nonce":1816903726}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":1816903726},{"type":"v1","addr":"172.21.15.96:6809","nonce":1816903726}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":1816903726},{"type":"v1","addr":"172.21.15.96:6807","nonce":1816903726}]},"public_addr":"172.21.15.96:6803/1816903726","cluster_addr":"172.21.15.96:6805/1816903726","heartbeat_back_addr":"172.21.15.96:6809/1816903726","heartbeat_front_addr":"172.21.15.96:6807/1816903726","state":["exists","up"]},{"osd":1,"uuid":"eb73deea-fc7c-4f2f-8aef-2d71c598afda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":206989126},{"type":"v1","addr":"172.21.15.133:6801","nonce":206989126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":206989126},{"type":"v1","addr":"172.21.15.133:6803","nonce":206989126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":206989126},{"type":"v1","addr":"172.21.15.133:6807","nonce":206989126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":206989126},{"type":"v1","addr":"172.21.15.133:6805","nonce":206989126}]},"public_addr":"172.21.15.133:6801/206989126","cluster_addr":"172.21.15.133:6803/206989126","heartbeat_back_addr":"172.21.15.133:6807/206989126","heartbeat_front_addr":"172.21.15.133:6805/206989126","state":["exists","up"]},{"osd":2,"uuid":"74a2f239-e82d-4d87-9458-5373b6cbbffd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":1791188143},{"type":"v1","addr":"172.21.15.186:6801","nonce":1791188143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":1791188143},{"type":"v1","addr":"172.21.15.186:6803","nonce":1791188143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":1791188143},{"type":"v1","addr":"172.21.15.186:6807","nonce":1791188143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":1791188143},{"type":"v1","addr":"172.21.15.186:6805","nonce":1791188143}]},"public_addr":"172.21.15.186:6801/1791188143","cluster_addr":"172.21.15.186:6803/1791188143","heartbeat_back_addr":"172.21.15.186:6807/1791188143","heartbeat_front_addr":"172.21.15.186:6805/1791188143","state":["exists","up"]},{"osd":3,"uuid":"421eedf5-ba6e-484e-b715-78c1c10d684e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":3430402140},{"type":"v1","addr":"172.21.15.96:6811","nonce":3430402140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":3430402140},{"type":"v1","addr":"172.21.15.96:6813","nonce":3430402140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":3430402140},{"type":"v1","addr":"172.21.15.96:6817","nonce":3430402140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":3430402140},{"type":"v1","addr":"172.21.15.96:6815","nonce":3430402140}]},"public_addr":"172.21.15.96:6811/3430402140","cluster_addr":"172.21.15.96:6813/3430402140","heartbeat_back_addr":"172.21.15.96:6817/3430402140","heartbeat_front_addr":"172.21.15.96:6815/3430402140","state":["exists","up"]},{"osd":4,"uuid":"fb20100b-6a5a-462d-955d-1697a3861e96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":1237495996},{"type":"v1","addr":"172.21.15.133:6809","nonce":1237495996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":1237495996},{"type":"v1","addr":"172.21.15.133:6811","nonce":1237495996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":1237495996},{"type":"v1","addr":"172.21.15.133:6815","nonce":1237495996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":1237495996},{"type":"v1","addr":"172.21.15.133:6813","nonce":1237495996}]},"public_addr":"172.21.15.133:6809/1237495996","cluster_addr":"172.21.15.133:6811/1237495996","heartbeat_back_addr":"172.21.15.133:6815/1237495996","heartbeat_front_addr":"172.21.15.133:6813/1237495996","state":["exists","up"]},{"osd":5,"uuid":"00177913-8bd6-4391-83c3-08c2b1b8ef13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":541111862},{"type":"v1","addr":"172.21.15.186:6809","nonce":541111862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":541111862},{"type":"v1","addr":"172.21.15.186:6811","nonce":541111862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":541111862},{"type":"v1","addr":"172.21.15.186:6815","nonce":541111862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":541111862},{"type":"v1","addr":"172.21.15.186:6813","nonce":541111862}]},"public_addr":"172.21.15.186:6809/541111862","cluster_addr":"172.21.15.186:6811/541111862","heartbeat_back_addr":"172.21.15.186:6815/541111862","heartbeat_front_addr":"172.21.15.186:6813/541111862","state":["exists","up"]},{"osd":6,"uuid":"204baab6-ca6f-4eef-8b9c-91efc04cc30c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":386227948},{"type":"v1","addr":"172.21.15.96:6819","nonce":386227948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":386227948},{"type":"v1","addr":"172.21.15.96:6821","nonce":386227948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":386227948},{"type":"v1","addr":"172.21.15.96:6825","nonce":386227948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":386227948},{"type":"v1","addr":"172.21.15.96:6823","nonce":386227948}]},"public_addr":"172.21.15.96:6819/386227948","cluster_addr":"172.21.15.96:6821/386227948","heartbeat_back_addr":"172.21.15.96:6825/386227948","heartbeat_front_addr":"172.21.15.96:6823/386227948","state":["exists","up"]},{"osd":7,"uuid":"282db569-a76e-485b-a33d-f2579b956525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":218507954},{"type":"v1","addr":"172.21.15.133:6817","nonce":218507954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":218507954},{"type":"v1","addr":"172.21.15.133:6819","nonce":218507954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":218507954},{"type":"v1","addr":"172.21.15.133:6823","nonce":218507954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":218507954},{"type":"v1","addr":"172.21.15.133:6821","nonce":218507954}]},"public_addr":"172.21.15.133:6817/218507954","cluster_addr":"172.21.15.133:6819/218507954","heartbeat_back_addr":"172.21.15.133:6823/218507954","heartbeat_front_addr":"172.21.15.133:6821/218507954","state":["exists","up"]},{"osd":8,"uuid":"693e25b5-355d-4990-9467-0fac4c9133fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":1648475902},{"type":"v1","addr":"172.21.15.186:6817","nonce":1648475902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":1648475902},{"type":"v1","addr":"172.21.15.186:6819","nonce":1648475902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":1648475902},{"type":"v1","addr":"172.21.15.186:6823","nonce":1648475902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":1648475902},{"type":"v1","addr":"172.21.15.186:6821","nonce":1648475902}]},"public_addr":"172.21.15.186:6817/1648475902","cluster_addr":"172.21.15.186:6819/1648475902","heartbeat_back_addr":"172.21.15.186:6823/1648475902","heartbeat_front_addr":"172.21.15.186:6821/1648475902","state":["exists","up"]},{"osd":9,"uuid":"72fbff09-fe28-4014-86fc-c31f95cd19a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":543223824},{"type":"v1","addr":"172.21.15.96:6827","nonce":543223824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":543223824},{"type":"v1","addr":"172.21.15.96:6829","nonce":543223824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6832","nonce":543223824},{"type":"v1","addr":"172.21.15.96:6833","nonce":543223824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":543223824},{"type":"v1","addr":"172.21.15.96:6831","nonce":543223824}]},"public_addr":"172.21.15.96:6827/543223824","cluster_addr":"172.21.15.96:6829/543223824","heartbeat_back_addr":"172.21.15.96:6833/543223824","heartbeat_front_addr":"172.21.15.96:6831/543223824","state":["exists","up"]},{"osd":10,"uuid":"6c2b6757-60c2-4962-9409-6051dcb13273","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":2323107912},{"type":"v1","addr":"172.21.15.133:6825","nonce":2323107912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":2323107912},{"type":"v1","addr":"172.21.15.133:6827","nonce":2323107912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":2323107912},{"type":"v1","addr":"172.21.15.133:6831","nonce":2323107912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":2323107912},{"type":"v1","addr":"172.21.15.133:6829","nonce":2323107912}]},"public_addr":"172.21.15.133:6825/2323107912","cluster_addr":"172.21.15.133:6827/2323107912","heartbeat_back_addr":"172.21.15.133:6831/2323107912","heartbeat_front_addr":"172.21.15.133:6829/2323107912","state":["exists","up"]},{"osd":11,"uuid":"03c0bb25-2921-446b-960e-6a7a328d36a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":3853499290},{"type":"v1","addr":"172.21.15.186:6825","nonce":3853499290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":3853499290},{"type":"v1","addr":"172.21.15.186:6827","nonce":3853499290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":3853499290},{"type":"v1","addr":"172.21.15.186:6831","nonce":3853499290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":3853499290},{"type":"v1","addr":"172.21.15.186:6829","nonce":3853499290}]},"public_addr":"172.21.15.186:6825/3853499290","cluster_addr":"172.21.15.186:6827/3853499290","heartbeat_back_addr":"172.21.15.186:6831/3853499290","heartbeat_front_addr":"172.21.15.186:6829/3853499290","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:36:02.087281+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:36:24.328783+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:36:46.135576+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:37:08.524145+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:37:30.883871+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:37:53.344554+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:38:15.448162+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:38:37.414878+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:38:59.533953+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:39:21.392102+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:39:43.462696+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:40:05.561808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.96:0/1333468881":"2023-05-09T03:34:37.472043+0000","172.21.15.96:6800/1979917756":"2023-05-09T03:34:37.472043+0000","172.21.15.96:0/1332045367":"2023-05-09T03:34:37.472043+0000","172.21.15.96:0/520278090":"2023-05-09T03:34:14.800324+0000","172.21.15.96:0/1055409415":"2023-05-09T03:34:37.472043+0000","172.21.15.96:6801/1979917756":"2023-05-09T03:34:37.472043+0000","172.21.15.96:0/1541933328":"2023-05-09T03:34:14.800324+0000","172.21.15.96:6800/3944122753":"2023-05-09T03:34:14.800324+0000","172.21.15.96:0/2986058319":"2023-05-09T03:34:14.800324+0000","172.21.15.96:6801/3944122753":"2023-05-09T03:34:14.800324+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-08T03:40:45.931 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.929+0000 7f86917fb700 1 -- 172.21.15.96:0/215551918 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f86740a1150 msgr2=0x7f86740a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:45.931 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.929+0000 7f86917fb700 1 --2- 172.21.15.96:0/215551918 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f86740a1150 0x7f86740a3600 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8680009df0 tx=0x7f8680009260 comp rx=0 tx=0).stop 2023-05-08T03:40:45.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.929+0000 7f86917fb700 1 -- 172.21.15.96:0/215551918 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f868c0ff280 msgr2=0x7f868c069c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:45.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.929+0000 7f86917fb700 1 --2- 172.21.15.96:0/215551918 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f868c0ff280 0x7f868c069c80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f867c004730 tx=0x7f867c004760 comp rx=0 tx=0).stop 2023-05-08T03:40:45.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.929+0000 7f86917fb700 1 -- 172.21.15.96:0/215551918 shutdown_connections 2023-05-08T03:40:45.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.929+0000 7f86917fb700 1 --2- 172.21.15.96:0/215551918 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f86740a1150 0x7f86740a3600 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:45.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.929+0000 7f86917fb700 1 --2- 172.21.15.96:0/215551918 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f868c100e00 0x7f868c19d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:45.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.929+0000 7f86917fb700 1 --2- 172.21.15.96:0/215551918 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f868c0ff280 0x7f868c069c80 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:45.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.929+0000 7f86917fb700 1 --2- 172.21.15.96:0/215551918 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f868c100470 0x7f868c19ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:45.933 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.929+0000 7f86917fb700 1 -- 172.21.15.96:0/215551918 >> 172.21.15.96:0/215551918 conn(0x7f868c0fa880 msgr2=0x7f868c103930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:45.933 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.929+0000 7f86917fb700 1 -- 172.21.15.96:0/215551918 shutdown_connections 2023-05-08T03:40:45.933 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:45.929+0000 7f86917fb700 1 -- 172.21.15.96:0/215551918 wait complete. 2023-05-08T03:40:45.942 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:45 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:45.942 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:45 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:45.943 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:45 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:45.943 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:45 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:45.943 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:45 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:45.943 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:45 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:40:45.943 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:45 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:boot 2023-05-08T03:40:45.943 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:45 smithi096 ceph-mon[124666]: fsmap 12 up:standby 2023-05-08T03:40:45.944 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:45 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-05-08T03:40:45.944 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:45 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/3237864104' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-05-08T03:40:45.945 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-08T03:36:47.800739+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-08T03:40:45.945 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-08T03:40:46.075 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.072+0000 7fdea1476700 1 -- 172.21.15.96:0/1435208832 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde9c106040 msgr2=0x7fde9c108440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:46.075 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.072+0000 7fdea1476700 1 --2- 172.21.15.96:0/1435208832 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde9c106040 0x7fde9c108440 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fde9400b0a0 tx=0x7fde9400b3b0 comp rx=0 tx=0).stop 2023-05-08T03:40:46.075 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.072+0000 7fdea1476700 1 -- 172.21.15.96:0/1435208832 shutdown_connections 2023-05-08T03:40:46.075 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.072+0000 7fdea1476700 1 --2- 172.21.15.96:0/1435208832 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde9c106040 0x7fde9c108440 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:46.075 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.072+0000 7fdea1476700 1 --2- 172.21.15.96:0/1435208832 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde9c100e00 0x7fde9c1031e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:46.075 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.072+0000 7fdea1476700 1 --2- 172.21.15.96:0/1435208832 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fde9c103720 0x7fde9c105b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:46.076 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.072+0000 7fdea1476700 1 -- 172.21.15.96:0/1435208832 >> 172.21.15.96:0/1435208832 conn(0x7fde9c0fa840 msgr2=0x7fde9c0fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:46.076 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.072+0000 7fdea1476700 1 -- 172.21.15.96:0/1435208832 shutdown_connections 2023-05-08T03:40:46.076 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.072+0000 7fdea1476700 1 -- 172.21.15.96:0/1435208832 wait complete. 2023-05-08T03:40:46.076 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.072+0000 7fdea1476700 1 Processor -- start 2023-05-08T03:40:46.078 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.073+0000 7fdea1476700 1 -- start start 2023-05-08T03:40:46.078 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.073+0000 7fdea1476700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fde9c100e00 0x7fde9c1961a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:46.078 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.073+0000 7fdea1476700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde9c103720 0x7fde9c1966e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:46.078 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.073+0000 7fdea1476700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde9c106040 0x7fde9c19d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:46.078 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.073+0000 7fdea1476700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde9c19dd20 con 0x7fde9c106040 2023-05-08T03:40:46.078 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.073+0000 7fdea1476700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde9c19de60 con 0x7fde9c103720 2023-05-08T03:40:46.079 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.073+0000 7fdea1476700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde9c19dff0 con 0x7fde9c100e00 2023-05-08T03:40:46.079 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.073+0000 7fde9b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde9c106040 0x7fde9c19d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:46.079 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.073+0000 7fde9b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde9c106040 0x7fde9c19d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40360/0 (socket says 172.21.15.96:40360) 2023-05-08T03:40:46.079 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.073+0000 7fde9b7fe700 1 -- 172.21.15.96:0/878979391 learned_addr learned my addr 172.21.15.96:0/878979391 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:40:46.079 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.073+0000 7fde9affd700 1 --2- 172.21.15.96:0/878979391 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fde9c100e00 0x7fde9c1961a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:46.079 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.073+0000 7fde9a7fc700 1 --2- 172.21.15.96:0/878979391 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde9c103720 0x7fde9c1966e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:46.079 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.073+0000 7fde9b7fe700 1 -- 172.21.15.96:0/878979391 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fde9c100e00 msgr2=0x7fde9c1961a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:46.080 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.073+0000 7fde9b7fe700 1 --2- 172.21.15.96:0/878979391 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fde9c100e00 0x7fde9c1961a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:46.080 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.073+0000 7fde9b7fe700 1 -- 172.21.15.96:0/878979391 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde9c103720 msgr2=0x7fde9c1966e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:46.080 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.073+0000 7fde9b7fe700 1 --2- 172.21.15.96:0/878979391 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde9c103720 0x7fde9c1966e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:46.080 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.073+0000 7fde9b7fe700 1 -- 172.21.15.96:0/878979391 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde94009d00 con 0x7fde9c106040 2023-05-08T03:40:46.080 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.073+0000 7fde9b7fe700 1 --2- 172.21.15.96:0/878979391 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde9c106040 0x7fde9c19d750 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fde940062a0 tx=0x7fde94004d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:46.080 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.073+0000 7fde83fff700 1 -- 172.21.15.96:0/878979391 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9400e040 con 0x7fde9c106040 2023-05-08T03:40:46.081 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.073+0000 7fdea1476700 1 -- 172.21.15.96:0/878979391 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde9c10bc80 con 0x7fde9c106040 2023-05-08T03:40:46.081 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.073+0000 7fde83fff700 1 -- 172.21.15.96:0/878979391 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fde9400cec0 con 0x7fde9c106040 2023-05-08T03:40:46.081 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.073+0000 7fde83fff700 1 -- 172.21.15.96:0/878979391 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9401baf0 con 0x7fde9c106040 2023-05-08T03:40:46.081 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.074+0000 7fdea1476700 1 -- 172.21.15.96:0/878979391 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde9c10baf0 con 0x7fde9c106040 2023-05-08T03:40:46.081 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.074+0000 7fdea1476700 1 -- 172.21.15.96:0/878979391 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde9c0fc3b0 con 0x7fde9c106040 2023-05-08T03:40:46.081 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.075+0000 7fde83fff700 1 -- 172.21.15.96:0/878979391 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fde9401bc50 con 0x7fde9c106040 2023-05-08T03:40:46.082 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.076+0000 7fde83fff700 1 --2- 172.21.15.96:0/878979391 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fde840a1150 0x7fde840a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:46.082 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.076+0000 7fde9affd700 1 --2- 172.21.15.96:0/878979391 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fde840a1150 0x7fde840a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:46.082 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.076+0000 7fde83fff700 1 -- 172.21.15.96:0/878979391 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fde940ce770 con 0x7fde9c106040 2023-05-08T03:40:46.083 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.076+0000 7fde9affd700 1 --2- 172.21.15.96:0/878979391 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fde840a1150 0x7fde840a3600 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fde90005950 tx=0x7fde9000a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:46.083 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.080+0000 7fde83fff700 1 -- 172.21.15.96:0/878979391 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fde940983f0 con 0x7fde9c106040 2023-05-08T03:40:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:45 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:45 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:46.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:45 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:46.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:45 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:46.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:45 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:46.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:45 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:40:46.123 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:45 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:boot 2023-05-08T03:40:46.123 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:45 smithi186 ceph-mon[126480]: fsmap 12 up:standby 2023-05-08T03:40:46.123 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:45 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-05-08T03:40:46.123 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:45 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/3237864104' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-05-08T03:40:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:45 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:46.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:45 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:46.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:45 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:46.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:45 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:46.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:45 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:46.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:45 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:40:46.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:45 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:boot 2023-05-08T03:40:46.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:45 smithi133 ceph-mon[125939]: fsmap 12 up:standby 2023-05-08T03:40:46.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:45 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-05-08T03:40:46.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:45 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/3237864104' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-05-08T03:40:46.280 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.277+0000 7fdea1476700 1 -- 172.21.15.96:0/878979391 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fde9c02d0e0 con 0x7fde9c106040 2023-05-08T03:40:46.280 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.277+0000 7fde83fff700 1 -- 172.21.15.96:0/878979391 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v78) v1 ==== 93+0+10 (secure 0 0 0) 0x7fde9409ba10 con 0x7fde9c106040 2023-05-08T03:40:46.281 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2023-05-08T03:40:46.282 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.280+0000 7fdea1476700 1 -- 172.21.15.96:0/878979391 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fde840a1150 msgr2=0x7fde840a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:46.283 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.280+0000 7fdea1476700 1 --2- 172.21.15.96:0/878979391 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fde840a1150 0x7fde840a3600 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fde90005950 tx=0x7fde9000a300 comp rx=0 tx=0).stop 2023-05-08T03:40:46.283 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.280+0000 7fdea1476700 1 -- 172.21.15.96:0/878979391 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde9c106040 msgr2=0x7fde9c19d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:46.283 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.280+0000 7fdea1476700 1 --2- 172.21.15.96:0/878979391 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde9c106040 0x7fde9c19d750 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fde940062a0 tx=0x7fde94004d00 comp rx=0 tx=0).stop 2023-05-08T03:40:46.283 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.280+0000 7fdea1476700 1 -- 172.21.15.96:0/878979391 shutdown_connections 2023-05-08T03:40:46.283 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.280+0000 7fdea1476700 1 --2- 172.21.15.96:0/878979391 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fde840a1150 0x7fde840a3600 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:46.283 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.280+0000 7fdea1476700 1 --2- 172.21.15.96:0/878979391 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde9c106040 0x7fde9c19d750 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:46.284 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.280+0000 7fdea1476700 1 --2- 172.21.15.96:0/878979391 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fde9c100e00 0x7fde9c1961a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:46.284 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.280+0000 7fdea1476700 1 --2- 172.21.15.96:0/878979391 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde9c103720 0x7fde9c1966e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:46.284 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.280+0000 7fdea1476700 1 -- 172.21.15.96:0/878979391 >> 172.21.15.96:0/878979391 conn(0x7fde9c0fa840 msgr2=0x7fde9c101a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:46.284 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.280+0000 7fdea1476700 1 -- 172.21.15.96:0/878979391 shutdown_connections 2023-05-08T03:40:46.284 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.280+0000 7fdea1476700 1 -- 172.21.15.96:0/878979391 wait complete. 2023-05-08T03:40:46.296 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-05-08T03:40:46.424 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.422+0000 7fdfb0fe7700 1 -- 172.21.15.96:0/820567229 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdfac100d90 msgr2=0x7fdfac107650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:46.425 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.422+0000 7fdfb0fe7700 1 --2- 172.21.15.96:0/820567229 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdfac100d90 0x7fdfac107650 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fdfa400b0a0 tx=0x7fdfa400b3b0 comp rx=0 tx=0).stop 2023-05-08T03:40:46.425 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.422+0000 7fdfb0fe7700 1 -- 172.21.15.96:0/820567229 shutdown_connections 2023-05-08T03:40:46.425 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.422+0000 7fdfb0fe7700 1 --2- 172.21.15.96:0/820567229 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdfac100d90 0x7fdfac107650 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:46.425 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.422+0000 7fdfb0fe7700 1 --2- 172.21.15.96:0/820567229 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdfac0ff210 0x7fdfac0ff620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:46.425 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.422+0000 7fdfb0fe7700 1 --2- 172.21.15.96:0/820567229 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfac100400 0x7fdfac100850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:46.426 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.422+0000 7fdfb0fe7700 1 -- 172.21.15.96:0/820567229 >> 172.21.15.96:0/820567229 conn(0x7fdfac0fa7f0 msgr2=0x7fdfac0fcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:46.426 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.422+0000 7fdfb0fe7700 1 -- 172.21.15.96:0/820567229 shutdown_connections 2023-05-08T03:40:46.426 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.422+0000 7fdfb0fe7700 1 -- 172.21.15.96:0/820567229 wait complete. 2023-05-08T03:40:46.428 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.423+0000 7fdfb0fe7700 1 Processor -- start 2023-05-08T03:40:46.429 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.423+0000 7fdfb0fe7700 1 -- start start 2023-05-08T03:40:46.429 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.423+0000 7fdfb0fe7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfac0ff210 0x7fdfac068a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:46.429 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.423+0000 7fdfb0fe7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdfac100400 0x7fdfac19aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:46.429 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.423+0000 7fdfb0fe7700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdfac100d90 0x7fdfac19d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:46.429 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.423+0000 7fdfb0fe7700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfac19dcc0 con 0x7fdfac100400 2023-05-08T03:40:46.430 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.423+0000 7fdfb0fe7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfac19de30 con 0x7fdfac0ff210 2023-05-08T03:40:46.430 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.423+0000 7fdfb0fe7700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfac19dff0 con 0x7fdfac100d90 2023-05-08T03:40:46.430 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.423+0000 7fdfa9d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdfac100400 0x7fdfac19aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:46.430 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.423+0000 7fdfa9d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdfac100400 0x7fdfac19aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40368/0 (socket says 172.21.15.96:40368) 2023-05-08T03:40:46.430 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.423+0000 7fdfa9d9b700 1 -- 172.21.15.96:0/2447212393 learned_addr learned my addr 172.21.15.96:0/2447212393 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:40:46.430 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.423+0000 7fdfaa59c700 1 --2- 172.21.15.96:0/2447212393 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfac0ff210 0x7fdfac068a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:46.430 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.423+0000 7fdfaad9d700 1 --2- 172.21.15.96:0/2447212393 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdfac100d90 0x7fdfac19d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:46.430 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.423+0000 7fdfa9d9b700 1 -- 172.21.15.96:0/2447212393 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdfac100d90 msgr2=0x7fdfac19d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:46.431 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.423+0000 7fdfa9d9b700 1 --2- 172.21.15.96:0/2447212393 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdfac100d90 0x7fdfac19d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:46.431 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.423+0000 7fdfa9d9b700 1 -- 172.21.15.96:0/2447212393 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfac0ff210 msgr2=0x7fdfac068a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:46.431 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.423+0000 7fdfa9d9b700 1 --2- 172.21.15.96:0/2447212393 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfac0ff210 0x7fdfac068a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:46.431 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.423+0000 7fdfa9d9b700 1 -- 172.21.15.96:0/2447212393 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfa4009d00 con 0x7fdfac100400 2023-05-08T03:40:46.431 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.423+0000 7fdfa9d9b700 1 --2- 172.21.15.96:0/2447212393 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdfac100400 0x7fdfac19aea0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fdfa000d950 tx=0x7fdfa000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:46.431 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.423+0000 7fdf9b7fe700 1 -- 172.21.15.96:0/2447212393 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa000f890 con 0x7fdfac100400 2023-05-08T03:40:46.431 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.423+0000 7fdf9b7fe700 1 -- 172.21.15.96:0/2447212393 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdfa0010460 con 0x7fdfac100400 2023-05-08T03:40:46.432 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.423+0000 7fdfb0fe7700 1 -- 172.21.15.96:0/2447212393 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfac10ab80 con 0x7fdfac100400 2023-05-08T03:40:46.432 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.423+0000 7fdf9b7fe700 1 -- 172.21.15.96:0/2447212393 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa000e610 con 0x7fdfac100400 2023-05-08T03:40:46.432 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.424+0000 7fdfb0fe7700 1 -- 172.21.15.96:0/2447212393 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfac10a9f0 con 0x7fdfac100400 2023-05-08T03:40:46.432 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.425+0000 7fdfb0fe7700 1 -- 172.21.15.96:0/2447212393 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfac19e6e0 con 0x7fdfac100400 2023-05-08T03:40:46.432 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.426+0000 7fdf9b7fe700 1 -- 172.21.15.96:0/2447212393 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fdfa00108d0 con 0x7fdfac100400 2023-05-08T03:40:46.433 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.426+0000 7fdf9b7fe700 1 --2- 172.21.15.96:0/2447212393 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fdf940a1150 0x7fdf940a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:46.433 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.426+0000 7fdfaa59c700 1 --2- 172.21.15.96:0/2447212393 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fdf940a1150 0x7fdf940a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:46.433 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.426+0000 7fdf9b7fe700 1 -- 172.21.15.96:0/2447212393 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fdfa00cc230 con 0x7fdfac100400 2023-05-08T03:40:46.433 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.426+0000 7fdfaa59c700 1 --2- 172.21.15.96:0/2447212393 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fdf940a1150 0x7fdf940a3600 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fdfac100260 tx=0x7fdf9c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:46.434 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.430+0000 7fdf9b7fe700 1 -- 172.21.15.96:0/2447212393 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fdfa0095e20 con 0x7fdfac100400 2023-05-08T03:40:46.638 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.635+0000 7fdfb0fe7700 1 -- 172.21.15.96:0/2447212393 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fdfac1060c0 con 0x7fdfac100400 2023-05-08T03:40:46.638 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.636+0000 7fdf9b7fe700 1 -- 172.21.15.96:0/2447212393 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v78) v1 ==== 84+0+65 (secure 0 0 0) 0x7fdfa0099440 con 0x7fdfac100400 2023-05-08T03:40:46.639 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:40:46.639 INFO:teuthology.orchestra.run.smithi096.stdout:[ 2023-05-08T03:40:46.639 INFO:teuthology.orchestra.run.smithi096.stdout: { 2023-05-08T03:40:46.639 INFO:teuthology.orchestra.run.smithi096.stdout: "poolnum": 1, 2023-05-08T03:40:46.639 INFO:teuthology.orchestra.run.smithi096.stdout: "poolname": ".mgr" 2023-05-08T03:40:46.639 INFO:teuthology.orchestra.run.smithi096.stdout: } 2023-05-08T03:40:46.640 INFO:teuthology.orchestra.run.smithi096.stdout:] 2023-05-08T03:40:46.640 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.638+0000 7fdfb0fe7700 1 -- 172.21.15.96:0/2447212393 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fdf940a1150 msgr2=0x7fdf940a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:46.641 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.638+0000 7fdfb0fe7700 1 --2- 172.21.15.96:0/2447212393 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fdf940a1150 0x7fdf940a3600 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fdfac100260 tx=0x7fdf9c009260 comp rx=0 tx=0).stop 2023-05-08T03:40:46.641 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.638+0000 7fdfb0fe7700 1 -- 172.21.15.96:0/2447212393 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdfac100400 msgr2=0x7fdfac19aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:46.641 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.638+0000 7fdfb0fe7700 1 --2- 172.21.15.96:0/2447212393 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdfac100400 0x7fdfac19aea0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fdfa000d950 tx=0x7fdfa000dc60 comp rx=0 tx=0).stop 2023-05-08T03:40:46.641 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.638+0000 7fdfb0fe7700 1 -- 172.21.15.96:0/2447212393 shutdown_connections 2023-05-08T03:40:46.641 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.638+0000 7fdfb0fe7700 1 --2- 172.21.15.96:0/2447212393 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fdf940a1150 0x7fdf940a3600 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:46.641 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.638+0000 7fdfb0fe7700 1 --2- 172.21.15.96:0/2447212393 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdfac100d90 0x7fdfac19d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:46.641 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.638+0000 7fdfb0fe7700 1 --2- 172.21.15.96:0/2447212393 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfac0ff210 0x7fdfac068a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:46.642 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.638+0000 7fdfb0fe7700 1 --2- 172.21.15.96:0/2447212393 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdfac100400 0x7fdfac19aea0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:46.642 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.638+0000 7fdfb0fe7700 1 -- 172.21.15.96:0/2447212393 >> 172.21.15.96:0/2447212393 conn(0x7fdfac0fa7f0 msgr2=0x7fdfac0fca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:46.642 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.638+0000 7fdfb0fe7700 1 -- 172.21.15.96:0/2447212393 shutdown_connections 2023-05-08T03:40:46.642 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.638+0000 7fdfb0fe7700 1 -- 172.21.15.96:0/2447212393 wait complete. 2023-05-08T03:40:46.654 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-05-08T03:40:46.655 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-05-08T03:40:46.784 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.781+0000 7f98891b5700 1 -- 172.21.15.96:0/684571450 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9884101fd0 msgr2=0x7f9884108890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:46.784 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.781+0000 7f98891b5700 1 --2- 172.21.15.96:0/684571450 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9884101fd0 0x7f9884108890 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f987c00b0a0 tx=0x7f987c00b3b0 comp rx=0 tx=0).stop 2023-05-08T03:40:46.784 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.781+0000 7f98891b5700 1 -- 172.21.15.96:0/684571450 shutdown_connections 2023-05-08T03:40:46.784 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.781+0000 7f98891b5700 1 --2- 172.21.15.96:0/684571450 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9884101fd0 0x7f9884108890 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:46.785 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.781+0000 7f98891b5700 1 --2- 172.21.15.96:0/684571450 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98840fe5d0 0x7f98840fe9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:46.785 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.781+0000 7f98891b5700 1 --2- 172.21.15.96:0/684571450 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9884101640 0x7f9884101a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:46.785 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.781+0000 7f98891b5700 1 -- 172.21.15.96:0/684571450 >> 172.21.15.96:0/684571450 conn(0x7f98840f9fd0 msgr2=0x7f98840fc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:46.785 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.781+0000 7f98891b5700 1 -- 172.21.15.96:0/684571450 shutdown_connections 2023-05-08T03:40:46.785 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.781+0000 7f98891b5700 1 -- 172.21.15.96:0/684571450 wait complete. 2023-05-08T03:40:46.787 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.782+0000 7f98891b5700 1 Processor -- start 2023-05-08T03:40:46.787 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.783+0000 7f98891b5700 1 -- start start 2023-05-08T03:40:46.787 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.783+0000 7f98891b5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f98840fe5d0 0x7f9884196220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:46.787 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.783+0000 7f98891b5700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9884101640 0x7f9884196760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:46.787 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.783+0000 7f98891b5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9884101fd0 0x7f988419d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:46.788 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.783+0000 7f98891b5700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f988419dda0 con 0x7f98840fe5d0 2023-05-08T03:40:46.788 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.783+0000 7f98891b5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f988419dee0 con 0x7f9884101fd0 2023-05-08T03:40:46.788 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.783+0000 7f98891b5700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f988419e070 con 0x7f9884101640 2023-05-08T03:40:46.788 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.783+0000 7f9882d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f98840fe5d0 0x7f9884196220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:46.788 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.783+0000 7f9882d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f98840fe5d0 0x7f9884196220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40380/0 (socket says 172.21.15.96:40380) 2023-05-08T03:40:46.788 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.783+0000 7f9882d9d700 1 -- 172.21.15.96:0/2716018070 learned_addr learned my addr 172.21.15.96:0/2716018070 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:40:46.788 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.783+0000 7f988359e700 1 --2- 172.21.15.96:0/2716018070 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9884101fd0 0x7f988419d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:46.789 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.783+0000 7f988259c700 1 --2- 172.21.15.96:0/2716018070 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9884101640 0x7f9884196760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:46.789 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.783+0000 7f9882d9d700 1 -- 172.21.15.96:0/2716018070 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9884101640 msgr2=0x7f9884196760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:46.789 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.783+0000 7f9882d9d700 1 --2- 172.21.15.96:0/2716018070 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9884101640 0x7f9884196760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:46.789 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.783+0000 7f9882d9d700 1 -- 172.21.15.96:0/2716018070 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9884101fd0 msgr2=0x7f988419d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:46.789 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.783+0000 7f9882d9d700 1 --2- 172.21.15.96:0/2716018070 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9884101fd0 0x7f988419d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:46.789 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.783+0000 7f9882d9d700 1 -- 172.21.15.96:0/2716018070 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f987c009d00 con 0x7f98840fe5d0 2023-05-08T03:40:46.789 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.783+0000 7f988259c700 1 --2- 172.21.15.96:0/2716018070 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9884101640 0x7f9884196760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-08T03:40:46.789 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.783+0000 7f9882d9d700 1 --2- 172.21.15.96:0/2716018070 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f98840fe5d0 0x7f9884196220 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f987400e970 tx=0x7f987400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:46.790 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.784+0000 7f986bfff700 1 -- 172.21.15.96:0/2716018070 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9874009790 con 0x7f98840fe5d0 2023-05-08T03:40:46.790 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.784+0000 7f986bfff700 1 -- 172.21.15.96:0/2716018070 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f987400eec0 con 0x7f98840fe5d0 2023-05-08T03:40:46.790 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.784+0000 7f98891b5700 1 -- 172.21.15.96:0/2716018070 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f988410bcc0 con 0x7f98840fe5d0 2023-05-08T03:40:46.790 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.784+0000 7f986bfff700 1 -- 172.21.15.96:0/2716018070 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9874003cf0 con 0x7f98840fe5d0 2023-05-08T03:40:46.790 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.784+0000 7f98891b5700 1 -- 172.21.15.96:0/2716018070 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f988410bb30 con 0x7f98840fe5d0 2023-05-08T03:40:46.790 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.785+0000 7f98891b5700 1 -- 172.21.15.96:0/2716018070 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98841079c0 con 0x7f98840fe5d0 2023-05-08T03:40:46.791 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.786+0000 7f986bfff700 1 -- 172.21.15.96:0/2716018070 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f987400ccd0 con 0x7f98840fe5d0 2023-05-08T03:40:46.791 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.787+0000 7f986bfff700 1 --2- 172.21.15.96:0/2716018070 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f986c0a1150 0x7f986c0a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:46.791 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.787+0000 7f986bfff700 1 -- 172.21.15.96:0/2716018070 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f9874014070 con 0x7f98840fe5d0 2023-05-08T03:40:46.791 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.787+0000 7f988259c700 1 --2- 172.21.15.96:0/2716018070 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f986c0a1150 0x7f986c0a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:46.792 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.788+0000 7f988259c700 1 --2- 172.21.15.96:0/2716018070 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f986c0a1150 0x7f986c0a3600 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9878009fd0 tx=0x7f9878009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:46.792 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.790+0000 7f986bfff700 1 -- 172.21.15.96:0/2716018070 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f98740963f0 con 0x7f98840fe5d0 2023-05-08T03:40:46.991 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:46.988+0000 7f98891b5700 1 -- 172.21.15.96:0/2716018070 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f988402d0e0 con 0x7f98840fe5d0 2023-05-08T03:40:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:46 smithi096 ceph-mon[124666]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-05-08T03:40:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:46 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/215551918' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-05-08T03:40:47.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:46 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/878979391' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-05-08T03:40:47.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:46 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/2447212393' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-05-08T03:40:47.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:46 smithi186 ceph-mon[126480]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-05-08T03:40:47.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:46 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/215551918' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-05-08T03:40:47.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:46 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/878979391' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-05-08T03:40:47.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:46 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/2447212393' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-05-08T03:40:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:46 smithi133 ceph-mon[125939]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-05-08T03:40:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:46 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/215551918' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-05-08T03:40:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:46 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/878979391' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-05-08T03:40:47.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:46 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/2447212393' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-05-08T03:40:47.779 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:47.776+0000 7f986bfff700 1 -- 172.21.15.96:0/2716018070 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v79) v1 ==== 138+0+0 (secure 0 0 0) 0x7f9874099a10 con 0x7f98840fe5d0 2023-05-08T03:40:47.783 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:47.780+0000 7f98891b5700 1 -- 172.21.15.96:0/2716018070 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f986c0a1150 msgr2=0x7f986c0a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:47.783 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:47.780+0000 7f98891b5700 1 --2- 172.21.15.96:0/2716018070 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f986c0a1150 0x7f986c0a3600 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9878009fd0 tx=0x7f9878009260 comp rx=0 tx=0).stop 2023-05-08T03:40:47.783 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:47.780+0000 7f98891b5700 1 -- 172.21.15.96:0/2716018070 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f98840fe5d0 msgr2=0x7f9884196220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:47.783 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:47.780+0000 7f98891b5700 1 --2- 172.21.15.96:0/2716018070 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f98840fe5d0 0x7f9884196220 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f987400e970 tx=0x7f987400ec80 comp rx=0 tx=0).stop 2023-05-08T03:40:47.783 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:47.780+0000 7f98891b5700 1 -- 172.21.15.96:0/2716018070 shutdown_connections 2023-05-08T03:40:47.784 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:47.780+0000 7f98891b5700 1 --2- 172.21.15.96:0/2716018070 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f986c0a1150 0x7f986c0a3600 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:47.784 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:47.780+0000 7f98891b5700 1 --2- 172.21.15.96:0/2716018070 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9884101fd0 0x7f988419d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:47.784 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:47.780+0000 7f98891b5700 1 --2- 172.21.15.96:0/2716018070 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f98840fe5d0 0x7f9884196220 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:47.784 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:47.780+0000 7f98891b5700 1 --2- 172.21.15.96:0/2716018070 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9884101640 0x7f9884196760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:47.784 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:47.780+0000 7f98891b5700 1 -- 172.21.15.96:0/2716018070 >> 172.21.15.96:0/2716018070 conn(0x7f98840f9fd0 msgr2=0x7f9884104b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:47.784 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:47.780+0000 7f98891b5700 1 -- 172.21.15.96:0/2716018070 shutdown_connections 2023-05-08T03:40:47.784 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:47.781+0000 7f98891b5700 1 -- 172.21.15.96:0/2716018070 wait complete. 2023-05-08T03:40:47.785 INFO:teuthology.orchestra.run.smithi096.stderr:pool 'cephfs_metadata' created 2023-05-08T03:40:47.796 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-05-08T03:40:47.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:47.925+0000 7f1ffb13a700 1 -- 172.21.15.96:0/3597587038 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ff4100410 msgr2=0x7f1ff4100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:47.930 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:47.925+0000 7f1ffb13a700 1 --2- 172.21.15.96:0/3597587038 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ff4100410 0x7f1ff4100860 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1fe0009990 tx=0x7f1fe0009ca0 comp rx=0 tx=0).stop 2023-05-08T03:40:47.930 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:47.926+0000 7f1ffb13a700 1 -- 172.21.15.96:0/3597587038 shutdown_connections 2023-05-08T03:40:47.930 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:47.926+0000 7f1ffb13a700 1 --2- 172.21.15.96:0/3597587038 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ff4100da0 0x7f1ff4107660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:47.930 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:47.926+0000 7f1ffb13a700 1 --2- 172.21.15.96:0/3597587038 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1ff40ff220 0x7f1ff40ff630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:47.930 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:47.926+0000 7f1ffb13a700 1 --2- 172.21.15.96:0/3597587038 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ff4100410 0x7f1ff4100860 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:47.931 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:47.926+0000 7f1ffb13a700 1 -- 172.21.15.96:0/3597587038 >> 172.21.15.96:0/3597587038 conn(0x7f1ff40fa840 msgr2=0x7f1ff40fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:47.931 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:47.926+0000 7f1ffb13a700 1 -- 172.21.15.96:0/3597587038 shutdown_connections 2023-05-08T03:40:47.931 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:47.926+0000 7f1ffb13a700 1 -- 172.21.15.96:0/3597587038 wait complete. 2023-05-08T03:40:47.931 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:47.926+0000 7f1ffb13a700 1 Processor -- start 2023-05-08T03:40:47.931 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:47.926+0000 7f1ffb13a700 1 -- start start 2023-05-08T03:40:47.931 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:47.926+0000 7f1ffb13a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ff40ff220 0x7f1ff4194f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:47.931 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:47.926+0000 7f1ffb13a700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1ff4100410 0x7f1ff4195480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:47.931 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:47.926+0000 7f1ffb13a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ff4100da0 0x7f1ff419c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:47.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:47.926+0000 7f1ffb13a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff419cac0 con 0x7f1ff40ff220 2023-05-08T03:40:47.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:47.926+0000 7f1ffb13a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff419cc00 con 0x7f1ff4100da0 2023-05-08T03:40:47.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:47.926+0000 7f1ffb13a700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff419cd90 con 0x7f1ff4100410 2023-05-08T03:40:47.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:47.926+0000 7f1ff8ed6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ff40ff220 0x7f1ff4194f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:47.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:47.926+0000 7f1ff8ed6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ff40ff220 0x7f1ff4194f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40394/0 (socket says 172.21.15.96:40394) 2023-05-08T03:40:47.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:47.926+0000 7f1ff8ed6700 1 -- 172.21.15.96:0/3663283440 learned_addr learned my addr 172.21.15.96:0/3663283440 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:40:47.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:47.927+0000 7f1ff3fff700 1 --2- 172.21.15.96:0/3663283440 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1ff4100410 0x7f1ff4195480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:47.933 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:47.927+0000 7f1ff96d7700 1 --2- 172.21.15.96:0/3663283440 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ff4100da0 0x7f1ff419c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:47.933 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:47.927+0000 7f1ff8ed6700 1 -- 172.21.15.96:0/3663283440 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1ff4100410 msgr2=0x7f1ff4195480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:47.934 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:47.927+0000 7f1ff8ed6700 1 --2- 172.21.15.96:0/3663283440 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1ff4100410 0x7f1ff4195480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:47.934 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:47.927+0000 7f1ff8ed6700 1 -- 172.21.15.96:0/3663283440 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ff4100da0 msgr2=0x7f1ff419c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:47.934 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:47.927+0000 7f1ff8ed6700 1 --2- 172.21.15.96:0/3663283440 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ff4100da0 0x7f1ff419c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:47.934 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:47.927+0000 7f1ff8ed6700 1 -- 172.21.15.96:0/3663283440 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fe00095f0 con 0x7f1ff40ff220 2023-05-08T03:40:47.934 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:47.927+0000 7f1ff3fff700 1 --2- 172.21.15.96:0/3663283440 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1ff4100410 0x7f1ff4195480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-08T03:40:47.935 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:47.927+0000 7f1ff8ed6700 1 --2- 172.21.15.96:0/3663283440 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ff40ff220 0x7f1ff4194f40 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1fe800d980 tx=0x7f1fe800dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:47.935 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:47.927+0000 7f1ff1ffb700 1 -- 172.21.15.96:0/3663283440 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe800de60 con 0x7f1ff40ff220 2023-05-08T03:40:47.935 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:47.927+0000 7f1ffb13a700 1 -- 172.21.15.96:0/3663283440 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ff410ab80 con 0x7f1ff40ff220 2023-05-08T03:40:47.935 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:47.927+0000 7f1ff1ffb700 1 -- 172.21.15.96:0/3663283440 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1fe80044e0 con 0x7f1ff40ff220 2023-05-08T03:40:47.935 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:47.927+0000 7f1ff1ffb700 1 -- 172.21.15.96:0/3663283440 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe8003be0 con 0x7f1ff40ff220 2023-05-08T03:40:47.936 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:47.927+0000 7f1ffb13a700 1 -- 172.21.15.96:0/3663283440 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ff410a9f0 con 0x7f1ff40ff220 2023-05-08T03:40:47.937 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:47.928+0000 7f1ffb13a700 1 -- 172.21.15.96:0/3663283440 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ff4067f40 con 0x7f1ff40ff220 2023-05-08T03:40:47.938 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:47.929+0000 7f1ff1ffb700 1 -- 172.21.15.96:0/3663283440 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f1fe8009bb0 con 0x7f1ff40ff220 2023-05-08T03:40:47.938 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:47.930+0000 7f1ff1ffb700 1 --2- 172.21.15.96:0/3663283440 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f1fe40a1150 0x7f1fe40a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:47.938 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:47.930+0000 7f1ff3fff700 1 --2- 172.21.15.96:0/3663283440 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f1fe40a1150 0x7f1fe40a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:47.938 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:47.930+0000 7f1ff1ffb700 1 -- 172.21.15.96:0/3663283440 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7497+0+0 (secure 0 0 0) 0x7f1fe80cc7d0 con 0x7f1ff40ff220 2023-05-08T03:40:47.938 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:47.930+0000 7f1ff3fff700 1 --2- 172.21.15.96:0/3663283440 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f1fe40a1150 0x7f1fe40a3600 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1fe000b2e0 tx=0x7f1fe0005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:47.938 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:47.934+0000 7f1ff1ffb700 1 -- 172.21.15.96:0/3663283440 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f1fe80961b0 con 0x7f1ff40ff220 2023-05-08T03:40:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:47 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/2716018070' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-05-08T03:40:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:47 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:47 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:47 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:48.126 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:48.123+0000 7f1ffb13a700 1 -- 172.21.15.96:0/3663283440 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f1ff41060c0 con 0x7f1ff40ff220 2023-05-08T03:40:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:47 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/2716018070' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-05-08T03:40:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:47 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:47 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:47 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:47 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/2716018070' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-05-08T03:40:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:47 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:47 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:48.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:47 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:48.787 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:48.784+0000 7f1ff1ffb700 1 -- 172.21.15.96:0/3663283440 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v80) v1 ==== 170+0+0 (secure 0 0 0) 0x7f1fe8009940 con 0x7f1ff40ff220 2023-05-08T03:40:48.805 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:48.802+0000 7f1ffb13a700 1 -- 172.21.15.96:0/3663283440 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f1fe40a1150 msgr2=0x7f1fe40a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:48.805 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:48.802+0000 7f1ffb13a700 1 --2- 172.21.15.96:0/3663283440 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f1fe40a1150 0x7f1fe40a3600 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1fe000b2e0 tx=0x7f1fe0005fd0 comp rx=0 tx=0).stop 2023-05-08T03:40:48.805 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:48.802+0000 7f1ffb13a700 1 -- 172.21.15.96:0/3663283440 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ff40ff220 msgr2=0x7f1ff4194f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:48.806 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:48.802+0000 7f1ffb13a700 1 --2- 172.21.15.96:0/3663283440 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ff40ff220 0x7f1ff4194f40 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1fe800d980 tx=0x7f1fe800dd40 comp rx=0 tx=0).stop 2023-05-08T03:40:48.806 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:48.803+0000 7f1ffb13a700 1 -- 172.21.15.96:0/3663283440 shutdown_connections 2023-05-08T03:40:48.806 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:48.803+0000 7f1ffb13a700 1 --2- 172.21.15.96:0/3663283440 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f1fe40a1150 0x7f1fe40a3600 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:48.806 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:48.803+0000 7f1ffb13a700 1 --2- 172.21.15.96:0/3663283440 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ff4100da0 0x7f1ff419c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:48.807 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:48.803+0000 7f1ffb13a700 1 --2- 172.21.15.96:0/3663283440 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ff40ff220 0x7f1ff4194f40 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:48.807 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:48.803+0000 7f1ffb13a700 1 --2- 172.21.15.96:0/3663283440 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1ff4100410 0x7f1ff4195480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:48.807 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:48.803+0000 7f1ffb13a700 1 -- 172.21.15.96:0/3663283440 >> 172.21.15.96:0/3663283440 conn(0x7f1ff40fa840 msgr2=0x7f1ff40fca60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:48.807 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:48.804+0000 7f1ffb13a700 1 -- 172.21.15.96:0/3663283440 shutdown_connections 2023-05-08T03:40:48.807 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:48.804+0000 7f1ffb13a700 1 -- 172.21.15.96:0/3663283440 wait complete. 2023-05-08T03:40:48.807 INFO:teuthology.orchestra.run.smithi096.stderr:pool 'cephfs_data' created 2023-05-08T03:40:48.823 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-05-08T03:40:48.953 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:48.948+0000 7f6c8f126700 1 -- 172.21.15.96:0/3806019310 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c88100da0 msgr2=0x7f6c88107660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:48.953 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:48.948+0000 7f6c8f126700 1 --2- 172.21.15.96:0/3806019310 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c88100da0 0x7f6c88107660 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6c8000b0a0 tx=0x7f6c8000b3b0 comp rx=0 tx=0).stop 2023-05-08T03:40:48.953 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:48.948+0000 7f6c8f126700 1 -- 172.21.15.96:0/3806019310 shutdown_connections 2023-05-08T03:40:48.953 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:48.948+0000 7f6c8f126700 1 --2- 172.21.15.96:0/3806019310 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c88100da0 0x7f6c88107660 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:48.953 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:48.948+0000 7f6c8f126700 1 --2- 172.21.15.96:0/3806019310 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c880ff220 0x7f6c880ff630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:48.954 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:48.948+0000 7f6c8f126700 1 --2- 172.21.15.96:0/3806019310 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6c88100410 0x7f6c88100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:48.954 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:48.948+0000 7f6c8f126700 1 -- 172.21.15.96:0/3806019310 >> 172.21.15.96:0/3806019310 conn(0x7f6c880fa840 msgr2=0x7f6c880fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:48.954 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:48.948+0000 7f6c8f126700 1 -- 172.21.15.96:0/3806019310 shutdown_connections 2023-05-08T03:40:48.954 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:48.948+0000 7f6c8f126700 1 -- 172.21.15.96:0/3806019310 wait complete. 2023-05-08T03:40:48.954 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:48.949+0000 7f6c8f126700 1 Processor -- start 2023-05-08T03:40:48.954 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:48.949+0000 7f6c8f126700 1 -- start start 2023-05-08T03:40:48.954 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:48.949+0000 7f6c8f126700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c880ff220 0x7f6c88196180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:48.955 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:48.949+0000 7f6c8f126700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c88100410 0x7f6c881966c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:48.955 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:48.949+0000 7f6c8f126700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6c88100da0 0x7f6c8819d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:48.955 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:48.949+0000 7f6c8f126700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8819dd00 con 0x7f6c88100410 2023-05-08T03:40:48.955 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:48.949+0000 7f6c8f126700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8819de40 con 0x7f6c880ff220 2023-05-08T03:40:48.955 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:48.949+0000 7f6c8f126700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8819dfd0 con 0x7f6c88100da0 2023-05-08T03:40:48.955 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:48.949+0000 7f6c87fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c88100410 0x7f6c881966c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:48.955 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:48.949+0000 7f6c87fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c88100410 0x7f6c881966c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40414/0 (socket says 172.21.15.96:40414) 2023-05-08T03:40:48.956 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:48.949+0000 7f6c87fff700 1 -- 172.21.15.96:0/4130433327 learned_addr learned my addr 172.21.15.96:0/4130433327 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:40:48.956 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:48.949+0000 7f6c8cec2700 1 --2- 172.21.15.96:0/4130433327 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c880ff220 0x7f6c88196180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:48.956 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:48.949+0000 7f6c8d6c3700 1 --2- 172.21.15.96:0/4130433327 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6c88100da0 0x7f6c8819d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:48.956 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:48.950+0000 7f6c87fff700 1 -- 172.21.15.96:0/4130433327 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6c88100da0 msgr2=0x7f6c8819d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:48.956 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:48.950+0000 7f6c87fff700 1 --2- 172.21.15.96:0/4130433327 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6c88100da0 0x7f6c8819d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:48.956 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:48.950+0000 7f6c87fff700 1 -- 172.21.15.96:0/4130433327 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c880ff220 msgr2=0x7f6c88196180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:48.957 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:48.950+0000 7f6c87fff700 1 --2- 172.21.15.96:0/4130433327 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c880ff220 0x7f6c88196180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:48.957 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:48.950+0000 7f6c87fff700 1 -- 172.21.15.96:0/4130433327 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c80009d00 con 0x7f6c88100410 2023-05-08T03:40:48.957 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:48.950+0000 7f6c87fff700 1 --2- 172.21.15.96:0/4130433327 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c88100410 0x7f6c881966c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6c7400d980 tx=0x7f6c7400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:48.957 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:48.950+0000 7f6c85ffb700 1 -- 172.21.15.96:0/4130433327 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c74004220 con 0x7f6c88100410 2023-05-08T03:40:48.957 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:48.950+0000 7f6c8f126700 1 -- 172.21.15.96:0/4130433327 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c8810bd50 con 0x7f6c88100410 2023-05-08T03:40:48.957 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:48.950+0000 7f6c85ffb700 1 -- 172.21.15.96:0/4130433327 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6c74007640 con 0x7f6c88100410 2023-05-08T03:40:48.957 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:48.950+0000 7f6c85ffb700 1 -- 172.21.15.96:0/4130433327 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c74005690 con 0x7f6c88100410 2023-05-08T03:40:48.958 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:48.950+0000 7f6c8f126700 1 -- 172.21.15.96:0/4130433327 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c8810bbc0 con 0x7f6c88100410 2023-05-08T03:40:48.959 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:48.951+0000 7f6c8f126700 1 -- 172.21.15.96:0/4130433327 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c88067af0 con 0x7f6c88100410 2023-05-08T03:40:48.959 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:48.952+0000 7f6c85ffb700 1 -- 172.21.15.96:0/4130433327 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f6c74004750 con 0x7f6c88100410 2023-05-08T03:40:48.959 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:48.953+0000 7f6c85ffb700 1 --2- 172.21.15.96:0/4130433327 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f6c780a1150 0x7f6c780a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:48.960 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:48.953+0000 7f6c8cec2700 1 --2- 172.21.15.96:0/4130433327 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f6c780a1150 0x7f6c780a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:48.960 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:48.953+0000 7f6c85ffb700 1 -- 172.21.15.96:0/4130433327 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7879+0+0 (secure 0 0 0) 0x7f6c740cc530 con 0x7f6c88100410 2023-05-08T03:40:48.960 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:48.953+0000 7f6c8cec2700 1 --2- 172.21.15.96:0/4130433327 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f6c780a1150 0x7f6c780a3600 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6c88100270 tx=0x7f6c7c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:48.960 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:48.958+0000 7f6c85ffb700 1 -- 172.21.15.96:0/4130433327 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f6c74095e30 con 0x7f6c88100410 2023-05-08T03:40:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:48 smithi186 ceph-mon[126480]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-05-08T03:40:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:48 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/2716018070' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-05-08T03:40:49.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:48 smithi186 ceph-mon[126480]: osdmap e79: 12 total, 12 up, 12 in 2023-05-08T03:40:49.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:48 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:49.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:48 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:49.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:48 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:49.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:48 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:49.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:48 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/3663283440' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-05-08T03:40:49.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:48 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:40:49.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:48 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:40:49.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:48 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:49.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:48 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:40:49.210 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.208+0000 7f6c8f126700 1 -- 172.21.15.96:0/4130433327 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f6c88106060 con 0x7f6c88100410 2023-05-08T03:40:49.218 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.215+0000 7f6c85ffb700 1 -- 172.21.15.96:0/4130433327 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7f6c740160c0 con 0x7f6c88100410 2023-05-08T03:40:49.224 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.221+0000 7f6c8f126700 1 -- 172.21.15.96:0/4130433327 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f6c780a1150 msgr2=0x7f6c780a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:49.224 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.221+0000 7f6c8f126700 1 --2- 172.21.15.96:0/4130433327 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f6c780a1150 0x7f6c780a3600 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6c88100270 tx=0x7f6c7c009260 comp rx=0 tx=0).stop 2023-05-08T03:40:49.224 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.221+0000 7f6c8f126700 1 -- 172.21.15.96:0/4130433327 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c88100410 msgr2=0x7f6c881966c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:49.224 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.221+0000 7f6c8f126700 1 --2- 172.21.15.96:0/4130433327 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c88100410 0x7f6c881966c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6c7400d980 tx=0x7f6c7400dc90 comp rx=0 tx=0).stop 2023-05-08T03:40:49.225 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.221+0000 7f6c8f126700 1 -- 172.21.15.96:0/4130433327 shutdown_connections 2023-05-08T03:40:49.225 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.221+0000 7f6c8f126700 1 --2- 172.21.15.96:0/4130433327 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f6c780a1150 0x7f6c780a3600 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:49.225 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.221+0000 7f6c8f126700 1 --2- 172.21.15.96:0/4130433327 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6c88100da0 0x7f6c8819d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:49.225 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.221+0000 7f6c8f126700 1 --2- 172.21.15.96:0/4130433327 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c880ff220 0x7f6c88196180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:49.225 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.221+0000 7f6c8f126700 1 --2- 172.21.15.96:0/4130433327 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c88100410 0x7f6c881966c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:49.225 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.221+0000 7f6c8f126700 1 -- 172.21.15.96:0/4130433327 >> 172.21.15.96:0/4130433327 conn(0x7f6c880fa840 msgr2=0x7f6c880fc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:49.225 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.221+0000 7f6c8f126700 1 -- 172.21.15.96:0/4130433327 shutdown_connections 2023-05-08T03:40:49.225 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.221+0000 7f6c8f126700 1 -- 172.21.15.96:0/4130433327 wait complete. 2023-05-08T03:40:49.232 INFO:teuthology.orchestra.run.smithi096.stderr:new fs with metadata pool 2 and data pool 3 2023-05-08T03:40:49.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:48 smithi133 ceph-mon[125939]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-05-08T03:40:49.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:48 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/2716018070' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-05-08T03:40:49.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:48 smithi133 ceph-mon[125939]: osdmap e79: 12 total, 12 up, 12 in 2023-05-08T03:40:49.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:48 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:49.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:48 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:49.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:48 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:49.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:48 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:49.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:48 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/3663283440' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-05-08T03:40:49.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:48 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:40:49.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:48 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:40:49.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:48 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:49.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:48 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:40:49.247 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:48 smithi096 ceph-mon[124666]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-05-08T03:40:49.247 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:48 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/2716018070' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-05-08T03:40:49.248 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:48 smithi096 ceph-mon[124666]: osdmap e79: 12 total, 12 up, 12 in 2023-05-08T03:40:49.248 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:48 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:49.248 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:48 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:49.248 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:48 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:49.248 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:48 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:49.248 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:48 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/3663283440' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-05-08T03:40:49.248 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:48 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:40:49.249 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:48 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:40:49.249 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:48 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:49.249 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:48 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:40:49.250 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-08T03:40:49.372 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.370+0000 7f4e18fa2700 1 -- 172.21.15.96:0/1141854506 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e141007f0 msgr2=0x7f4e14100c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:49.373 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.370+0000 7f4e18fa2700 1 --2- 172.21.15.96:0/1141854506 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e141007f0 0x7f4e14100c00 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4e04009990 tx=0x7f4e04009ca0 comp rx=0 tx=0).stop 2023-05-08T03:40:49.373 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.370+0000 7f4e18fa2700 1 -- 172.21.15.96:0/1141854506 shutdown_connections 2023-05-08T03:40:49.373 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.370+0000 7f4e18fa2700 1 --2- 172.21.15.96:0/1141854506 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4e140ffdf0 0x7f4e141076a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:49.373 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.370+0000 7f4e18fa2700 1 --2- 172.21.15.96:0/1141854506 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e141007f0 0x7f4e14100c00 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:49.373 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.370+0000 7f4e18fa2700 1 --2- 172.21.15.96:0/1141854506 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e140ff440 0x7f4e140ff8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:49.374 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.370+0000 7f4e18fa2700 1 -- 172.21.15.96:0/1141854506 >> 172.21.15.96:0/1141854506 conn(0x7f4e140f9f80 msgr2=0x7f4e140fc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:49.374 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.370+0000 7f4e18fa2700 1 -- 172.21.15.96:0/1141854506 shutdown_connections 2023-05-08T03:40:49.374 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.370+0000 7f4e18fa2700 1 -- 172.21.15.96:0/1141854506 wait complete. 2023-05-08T03:40:49.375 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.371+0000 7f4e18fa2700 1 Processor -- start 2023-05-08T03:40:49.375 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.371+0000 7f4e18fa2700 1 -- start start 2023-05-08T03:40:49.376 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.371+0000 7f4e18fa2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e140ff440 0x7f4e141034f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:49.376 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.371+0000 7f4e18fa2700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4e140ffdf0 0x7f4e14101b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:49.376 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.371+0000 7f4e18fa2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e141007f0 0x7f4e14102070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:49.376 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.371+0000 7f4e18fa2700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e14102810 con 0x7f4e141007f0 2023-05-08T03:40:49.376 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.371+0000 7f4e18fa2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e14102980 con 0x7f4e140ff440 2023-05-08T03:40:49.376 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.371+0000 7f4e18fa2700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e141a0170 con 0x7f4e140ffdf0 2023-05-08T03:40:49.376 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.371+0000 7f4e1259c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e140ff440 0x7f4e141034f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:49.377 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.371+0000 7f4e12d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e141007f0 0x7f4e14102070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:49.377 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.371+0000 7f4e1259c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e140ff440 0x7f4e141034f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.96:36892/0 (socket says 172.21.15.96:36892) 2023-05-08T03:40:49.377 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.371+0000 7f4e1259c700 1 -- 172.21.15.96:0/2059193183 learned_addr learned my addr 172.21.15.96:0/2059193183 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:40:49.377 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.371+0000 7f4e1259c700 1 -- 172.21.15.96:0/2059193183 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4e140ffdf0 msgr2=0x7f4e14101b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:49.377 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.371+0000 7f4e1259c700 1 --2- 172.21.15.96:0/2059193183 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4e140ffdf0 0x7f4e14101b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:49.377 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.371+0000 7f4e1259c700 1 -- 172.21.15.96:0/2059193183 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e141007f0 msgr2=0x7f4e14102070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:49.377 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.371+0000 7f4e1259c700 1 --2- 172.21.15.96:0/2059193183 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e141007f0 0x7f4e14102070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:49.378 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.371+0000 7f4e1259c700 1 -- 172.21.15.96:0/2059193183 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e040095f0 con 0x7f4e140ff440 2023-05-08T03:40:49.378 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.371+0000 7f4e12d9d700 1 --2- 172.21.15.96:0/2059193183 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e141007f0 0x7f4e14102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-08T03:40:49.378 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.372+0000 7f4e1259c700 1 --2- 172.21.15.96:0/2059193183 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e140ff440 0x7f4e141034f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4e04004710 tx=0x7f4e04009580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:49.378 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.372+0000 7f4e037fe700 1 -- 172.21.15.96:0/2059193183 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0401d070 con 0x7f4e140ff440 2023-05-08T03:40:49.378 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.372+0000 7f4e18fa2700 1 -- 172.21.15.96:0/2059193183 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e1410abe0 con 0x7f4e140ff440 2023-05-08T03:40:49.378 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.372+0000 7f4e037fe700 1 -- 172.21.15.96:0/2059193183 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4e04022470 con 0x7f4e140ff440 2023-05-08T03:40:49.378 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.372+0000 7f4e037fe700 1 -- 172.21.15.96:0/2059193183 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e04017650 con 0x7f4e140ff440 2023-05-08T03:40:49.378 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.372+0000 7f4e18fa2700 1 -- 172.21.15.96:0/2059193183 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e1410aa50 con 0x7f4e140ff440 2023-05-08T03:40:49.379 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.373+0000 7f4e18fa2700 1 -- 172.21.15.96:0/2059193183 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e14107330 con 0x7f4e140ff440 2023-05-08T03:40:49.379 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.374+0000 7f4e037fe700 1 -- 172.21.15.96:0/2059193183 <== mon.2 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f4e040225e0 con 0x7f4e140ff440 2023-05-08T03:40:49.379 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.374+0000 7f4e037fe700 1 --2- 172.21.15.96:0/2059193183 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f4dfc0a1150 0x7f4dfc0a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:49.380 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.374+0000 7f4e037fe700 1 -- 172.21.15.96:0/2059193183 <== mon.2 v2:172.21.15.133:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f4e040cdc00 con 0x7f4e140ff440 2023-05-08T03:40:49.380 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.374+0000 7f4e11d9b700 1 --2- 172.21.15.96:0/2059193183 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f4dfc0a1150 0x7f4dfc0a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:49.380 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.375+0000 7f4e11d9b700 1 --2- 172.21.15.96:0/2059193183 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f4dfc0a1150 0x7f4dfc0a3600 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4e14100510 tx=0x7f4e080096c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:49.380 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.378+0000 7f4e037fe700 1 -- 172.21.15.96:0/2059193183 <== mon.2 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f4e0405c730 con 0x7f4e140ff440 2023-05-08T03:40:49.597 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.594+0000 7f4e18fa2700 1 -- 172.21.15.96:0/2059193183 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4e14061c10 con 0x7f4e140ff440 2023-05-08T03:40:49.598 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.596+0000 7f4e037fe700 1 -- 172.21.15.96:0/2059193183 <== mon.2 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+22109 (secure 0 0 0) 0x7f4e04097490 con 0x7f4e140ff440 2023-05-08T03:40:49.599 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:40:49.599 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":81,"fsid":"f7ffcfb0-ed50-11ed-9b01-001a4aab830c","created":"2023-05-08T03:33:42.765680+0000","modified":"2023-05-08T03:40:49.209742+0000","last_up_change":"2023-05-08T03:40:07.550882+0000","last_in_change":"2023-05-08T03:39:49.027947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-08T03:36:47.800739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-05-08T03:40:47.229693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-05-08T03:40:48.359294+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2ee801e1-8eec-496d-a9ac-fc566b38bbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":1816903726},{"type":"v1","addr":"172.21.15.96:6803","nonce":1816903726}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":1816903726},{"type":"v1","addr":"172.21.15.96:6805","nonce":1816903726}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":1816903726},{"type":"v1","addr":"172.21.15.96:6809","nonce":1816903726}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":1816903726},{"type":"v1","addr":"172.21.15.96:6807","nonce":1816903726}]},"public_addr":"172.21.15.96:6803/1816903726","cluster_addr":"172.21.15.96:6805/1816903726","heartbeat_back_addr":"172.21.15.96:6809/1816903726","heartbeat_front_addr":"172.21.15.96:6807/1816903726","state":["exists","up"]},{"osd":1,"uuid":"eb73deea-fc7c-4f2f-8aef-2d71c598afda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":206989126},{"type":"v1","addr":"172.21.15.133:6801","nonce":206989126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":206989126},{"type":"v1","addr":"172.21.15.133:6803","nonce":206989126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":206989126},{"type":"v1","addr":"172.21.15.133:6807","nonce":206989126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":206989126},{"type":"v1","addr":"172.21.15.133:6805","nonce":206989126}]},"public_addr":"172.21.15.133:6801/206989126","cluster_addr":"172.21.15.133:6803/206989126","heartbeat_back_addr":"172.21.15.133:6807/206989126","heartbeat_front_addr":"172.21.15.133:6805/206989126","state":["exists","up"]},{"osd":2,"uuid":"74a2f239-e82d-4d87-9458-5373b6cbbffd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":1791188143},{"type":"v1","addr":"172.21.15.186:6801","nonce":1791188143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":1791188143},{"type":"v1","addr":"172.21.15.186:6803","nonce":1791188143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":1791188143},{"type":"v1","addr":"172.21.15.186:6807","nonce":1791188143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":1791188143},{"type":"v1","addr":"172.21.15.186:6805","nonce":1791188143}]},"public_addr":"172.21.15.186:6801/1791188143","cluster_addr":"172.21.15.186:6803/1791188143","heartbeat_back_addr":"172.21.15.186:6807/1791188143","heartbeat_front_addr":"172.21.15.186:6805/1791188143","state":["exists","up"]},{"osd":3,"uuid":"421eedf5-ba6e-484e-b715-78c1c10d684e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":3430402140},{"type":"v1","addr":"172.21.15.96:6811","nonce":3430402140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":3430402140},{"type":"v1","addr":"172.21.15.96:6813","nonce":3430402140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":3430402140},{"type":"v1","addr":"172.21.15.96:6817","nonce":3430402140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":3430402140},{"type":"v1","addr":"172.21.15.96:6815","nonce":3430402140}]},"public_addr":"172.21.15.96:6811/3430402140","cluster_addr":"172.21.15.96:6813/3430402140","heartbeat_back_addr":"172.21.15.96:6817/3430402140","heartbeat_front_addr":"172.21.15.96:6815/3430402140","state":["exists","up"]},{"osd":4,"uuid":"fb20100b-6a5a-462d-955d-1697a3861e96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":1237495996},{"type":"v1","addr":"172.21.15.133:6809","nonce":1237495996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":1237495996},{"type":"v1","addr":"172.21.15.133:6811","nonce":1237495996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":1237495996},{"type":"v1","addr":"172.21.15.133:6815","nonce":1237495996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":1237495996},{"type":"v1","addr":"172.21.15.133:6813","nonce":1237495996}]},"public_addr":"172.21.15.133:6809/1237495996","cluster_addr":"172.21.15.133:6811/1237495996","heartbeat_back_addr":"172.21.15.133:6815/1237495996","heartbeat_front_addr":"172.21.15.133:6813/1237495996","state":["exists","up"]},{"osd":5,"uuid":"00177913-8bd6-4391-83c3-08c2b1b8ef13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":541111862},{"type":"v1","addr":"172.21.15.186:6809","nonce":541111862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":541111862},{"type":"v1","addr":"172.21.15.186:6811","nonce":541111862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":541111862},{"type":"v1","addr":"172.21.15.186:6815","nonce":541111862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":541111862},{"type":"v1","addr":"172.21.15.186:6813","nonce":541111862}]},"public_addr":"172.21.15.186:6809/541111862","cluster_addr":"172.21.15.186:6811/541111862","heartbeat_back_addr":"172.21.15.186:6815/541111862","heartbeat_front_addr":"172.21.15.186:6813/541111862","state":["exists","up"]},{"osd":6,"uuid":"204baab6-ca6f-4eef-8b9c-91efc04cc30c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":386227948},{"type":"v1","addr":"172.21.15.96:6819","nonce":386227948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":386227948},{"type":"v1","addr":"172.21.15.96:6821","nonce":386227948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":386227948},{"type":"v1","addr":"172.21.15.96:6825","nonce":386227948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":386227948},{"type":"v1","addr":"172.21.15.96:6823","nonce":386227948}]},"public_addr":"172.21.15.96:6819/386227948","cluster_addr":"172.21.15.96:6821/386227948","heartbeat_back_addr":"172.21.15.96:6825/386227948","heartbeat_front_addr":"172.21.15.96:6823/386227948","state":["exists","up"]},{"osd":7,"uuid":"282db569-a76e-485b-a33d-f2579b956525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":218507954},{"type":"v1","addr":"172.21.15.133:6817","nonce":218507954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":218507954},{"type":"v1","addr":"172.21.15.133:6819","nonce":218507954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":218507954},{"type":"v1","addr":"172.21.15.133:6823","nonce":218507954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":218507954},{"type":"v1","addr":"172.21.15.133:6821","nonce":218507954}]},"public_addr":"172.21.15.133:6817/218507954","cluster_addr":"172.21.15.133:6819/218507954","heartbeat_back_addr":"172.21.15.133:6823/218507954","heartbeat_front_addr":"172.21.15.133:6821/218507954","state":["exists","up"]},{"osd":8,"uuid":"693e25b5-355d-4990-9467-0fac4c9133fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":1648475902},{"type":"v1","addr":"172.21.15.186:6817","nonce":1648475902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":1648475902},{"type":"v1","addr":"172.21.15.186:6819","nonce":1648475902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":1648475902},{"type":"v1","addr":"172.21.15.186:6823","nonce":1648475902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":1648475902},{"type":"v1","addr":"172.21.15.186:6821","nonce":1648475902}]},"public_addr":"172.21.15.186:6817/1648475902","cluster_addr":"172.21.15.186:6819/1648475902","heartbeat_back_addr":"172.21.15.186:6823/1648475902","heartbeat_front_addr":"172.21.15.186:6821/1648475902","state":["exists","up"]},{"osd":9,"uuid":"72fbff09-fe28-4014-86fc-c31f95cd19a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":543223824},{"type":"v1","addr":"172.21.15.96:6827","nonce":543223824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":543223824},{"type":"v1","addr":"172.21.15.96:6829","nonce":543223824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6832","nonce":543223824},{"type":"v1","addr":"172.21.15.96:6833","nonce":543223824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":543223824},{"type":"v1","addr":"172.21.15.96:6831","nonce":543223824}]},"public_addr":"172.21.15.96:6827/543223824","cluster_addr":"172.21.15.96:6829/543223824","heartbeat_back_addr":"172.21.15.96:6833/543223824","heartbeat_front_addr":"172.21.15.96:6831/543223824","state":["exists","up"]},{"osd":10,"uuid":"6c2b6757-60c2-4962-9409-6051dcb13273","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":2323107912},{"type":"v1","addr":"172.21.15.133:6825","nonce":2323107912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":2323107912},{"type":"v1","addr":"172.21.15.133:6827","nonce":2323107912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":2323107912},{"type":"v1","addr":"172.21.15.133:6831","nonce":2323107912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":2323107912},{"type":"v1","addr":"172.21.15.133:6829","nonce":2323107912}]},"public_addr":"172.21.15.133:6825/2323107912","cluster_addr":"172.21.15.133:6827/2323107912","heartbeat_back_addr":"172.21.15.133:6831/2323107912","heartbeat_front_addr":"172.21.15.133:6829/2323107912","state":["exists","up"]},{"osd":11,"uuid":"03c0bb25-2921-446b-960e-6a7a328d36a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":3853499290},{"type":"v1","addr":"172.21.15.186:6825","nonce":3853499290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":3853499290},{"type":"v1","addr":"172.21.15.186:6827","nonce":3853499290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":3853499290},{"type":"v1","addr":"172.21.15.186:6831","nonce":3853499290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":3853499290},{"type":"v1","addr":"172.21.15.186:6829","nonce":3853499290}]},"public_addr":"172.21.15.186:6825/3853499290","cluster_addr":"172.21.15.186:6827/3853499290","heartbeat_back_addr":"172.21.15.186:6831/3853499290","heartbeat_front_addr":"172.21.15.186:6829/3853499290","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:36:02.087281+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:36:24.328783+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:36:46.135576+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:37:08.524145+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:37:30.883871+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:37:53.344554+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:38:15.448162+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:38:37.414878+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:38:59.533953+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:39:21.392102+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:39:43.462696+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:40:05.561808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.96:0/1333468881":"2023-05-09T03:34:37.472043+0000","172.21.15.96:6800/1979917756":"2023-05-09T03:34:37.472043+0000","172.21.15.96:0/1332045367":"2023-05-09T03:34:37.472043+0000","172.21.15.96:0/520278090":"2023-05-09T03:34:14.800324+0000","172.21.15.96:0/1055409415":"2023-05-09T03:34:37.472043+0000","172.21.15.96:6801/1979917756":"2023-05-09T03:34:37.472043+0000","172.21.15.96:0/1541933328":"2023-05-09T03:34:14.800324+0000","172.21.15.96:6800/3944122753":"2023-05-09T03:34:14.800324+0000","172.21.15.96:0/2986058319":"2023-05-09T03:34:14.800324+0000","172.21.15.96:6801/3944122753":"2023-05-09T03:34:14.800324+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-08T03:40:49.601 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.598+0000 7f4e18fa2700 1 -- 172.21.15.96:0/2059193183 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f4dfc0a1150 msgr2=0x7f4dfc0a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:49.601 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.598+0000 7f4e18fa2700 1 --2- 172.21.15.96:0/2059193183 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f4dfc0a1150 0x7f4dfc0a3600 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4e14100510 tx=0x7f4e080096c0 comp rx=0 tx=0).stop 2023-05-08T03:40:49.601 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.598+0000 7f4e18fa2700 1 -- 172.21.15.96:0/2059193183 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e140ff440 msgr2=0x7f4e141034f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:49.602 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.598+0000 7f4e18fa2700 1 --2- 172.21.15.96:0/2059193183 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e140ff440 0x7f4e141034f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4e04004710 tx=0x7f4e04009580 comp rx=0 tx=0).stop 2023-05-08T03:40:49.602 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.598+0000 7f4e18fa2700 1 -- 172.21.15.96:0/2059193183 shutdown_connections 2023-05-08T03:40:49.602 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.598+0000 7f4e18fa2700 1 --2- 172.21.15.96:0/2059193183 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f4dfc0a1150 0x7f4dfc0a3600 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:49.602 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.598+0000 7f4e18fa2700 1 --2- 172.21.15.96:0/2059193183 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e141007f0 0x7f4e14102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:49.602 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.598+0000 7f4e18fa2700 1 --2- 172.21.15.96:0/2059193183 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e140ff440 0x7f4e141034f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:49.602 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.598+0000 7f4e18fa2700 1 --2- 172.21.15.96:0/2059193183 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4e140ffdf0 0x7f4e14101b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:49.602 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.598+0000 7f4e18fa2700 1 -- 172.21.15.96:0/2059193183 >> 172.21.15.96:0/2059193183 conn(0x7f4e140f9f80 msgr2=0x7f4e140fc230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:49.603 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.599+0000 7f4e18fa2700 1 -- 172.21.15.96:0/2059193183 shutdown_connections 2023-05-08T03:40:49.603 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.599+0000 7f4e18fa2700 1 -- 172.21.15.96:0/2059193183 wait complete. 2023-05-08T03:40:49.613 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-08T03:40:49.746 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.740+0000 7f7c32023700 1 -- 172.21.15.96:0/1862061369 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c2c0ff210 msgr2=0x7f7c2c0ff620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:49.746 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.740+0000 7f7c32023700 1 --2- 172.21.15.96:0/1862061369 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c2c0ff210 0x7f7c2c0ff620 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c009990 tx=0x7f7c1c009ca0 comp rx=0 tx=0).stop 2023-05-08T03:40:49.746 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.740+0000 7f7c32023700 1 -- 172.21.15.96:0/1862061369 shutdown_connections 2023-05-08T03:40:49.747 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.740+0000 7f7c32023700 1 --2- 172.21.15.96:0/1862061369 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c2c100d90 0x7f7c2c107650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:49.747 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.740+0000 7f7c32023700 1 --2- 172.21.15.96:0/1862061369 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c2c0ff210 0x7f7c2c0ff620 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:49.747 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.740+0000 7f7c32023700 1 --2- 172.21.15.96:0/1862061369 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7c2c100400 0x7f7c2c100850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:49.747 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.740+0000 7f7c32023700 1 -- 172.21.15.96:0/1862061369 >> 172.21.15.96:0/1862061369 conn(0x7f7c2c0fa7f0 msgr2=0x7f7c2c0fcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:49.748 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.740+0000 7f7c32023700 1 -- 172.21.15.96:0/1862061369 shutdown_connections 2023-05-08T03:40:49.748 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.740+0000 7f7c32023700 1 -- 172.21.15.96:0/1862061369 wait complete. 2023-05-08T03:40:49.748 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.741+0000 7f7c32023700 1 Processor -- start 2023-05-08T03:40:49.748 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.741+0000 7f7c32023700 1 -- start start 2023-05-08T03:40:49.749 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.741+0000 7f7c32023700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c2c0ff210 0x7f7c2c195030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:49.749 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.741+0000 7f7c32023700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7c2c100400 0x7f7c2c195570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:49.749 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.741+0000 7f7c32023700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c2c100d90 0x7f7c2c19c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:49.749 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.741+0000 7f7c32023700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2c19cbb0 con 0x7f7c2c100d90 2023-05-08T03:40:49.750 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.741+0000 7f7c32023700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2c19ccf0 con 0x7f7c2c0ff210 2023-05-08T03:40:49.750 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.741+0000 7f7c32023700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2c19ce80 con 0x7f7c2c100400 2023-05-08T03:40:49.750 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.741+0000 7f7c2bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c2c100d90 0x7f7c2c19c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:49.750 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.741+0000 7f7c2bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c2c100d90 0x7f7c2c19c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40448/0 (socket says 172.21.15.96:40448) 2023-05-08T03:40:49.751 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.741+0000 7f7c2bfff700 1 -- 172.21.15.96:0/2488845539 learned_addr learned my addr 172.21.15.96:0/2488845539 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:40:49.751 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.742+0000 7f7c2b7fe700 1 --2- 172.21.15.96:0/2488845539 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c2c0ff210 0x7f7c2c195030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:49.751 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.742+0000 7f7c2affd700 1 --2- 172.21.15.96:0/2488845539 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7c2c100400 0x7f7c2c195570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:49.751 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.742+0000 7f7c2bfff700 1 -- 172.21.15.96:0/2488845539 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7c2c100400 msgr2=0x7f7c2c195570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:49.752 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.742+0000 7f7c2bfff700 1 --2- 172.21.15.96:0/2488845539 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7c2c100400 0x7f7c2c195570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:49.752 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.742+0000 7f7c2bfff700 1 -- 172.21.15.96:0/2488845539 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c2c0ff210 msgr2=0x7f7c2c195030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:49.752 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.742+0000 7f7c2bfff700 1 --2- 172.21.15.96:0/2488845539 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c2c0ff210 0x7f7c2c195030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:49.753 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.742+0000 7f7c2bfff700 1 -- 172.21.15.96:0/2488845539 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c1c0095f0 con 0x7f7c2c100d90 2023-05-08T03:40:49.753 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.742+0000 7f7c2bfff700 1 --2- 172.21.15.96:0/2488845539 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c2c100d90 0x7f7c2c19c5e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7c2400b970 tx=0x7f7c2400bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:49.753 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.742+0000 7f7c28ff9700 1 -- 172.21.15.96:0/2488845539 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2400d860 con 0x7f7c2c100d90 2023-05-08T03:40:49.753 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.742+0000 7f7c32023700 1 -- 172.21.15.96:0/2488845539 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c2c10ac00 con 0x7f7c2c100d90 2023-05-08T03:40:49.754 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.742+0000 7f7c28ff9700 1 -- 172.21.15.96:0/2488845539 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7c2400de80 con 0x7f7c2c100d90 2023-05-08T03:40:49.754 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.742+0000 7f7c28ff9700 1 -- 172.21.15.96:0/2488845539 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c24017400 con 0x7f7c2c100d90 2023-05-08T03:40:49.754 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.742+0000 7f7c32023700 1 -- 172.21.15.96:0/2488845539 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c2c10aa70 con 0x7f7c2c100d90 2023-05-08T03:40:49.755 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.743+0000 7f7c32023700 1 -- 172.21.15.96:0/2488845539 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c2c19d600 con 0x7f7c2c100d90 2023-05-08T03:40:49.756 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.744+0000 7f7c28ff9700 1 -- 172.21.15.96:0/2488845539 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f7c2400e630 con 0x7f7c2c100d90 2023-05-08T03:40:49.756 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.744+0000 7f7c28ff9700 1 --2- 172.21.15.96:0/2488845539 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f7c140a1150 0x7f7c140a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:49.756 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.745+0000 7f7c2b7fe700 1 --2- 172.21.15.96:0/2488845539 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f7c140a1150 0x7f7c140a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:49.757 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.745+0000 7f7c28ff9700 1 -- 172.21.15.96:0/2488845539 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f7c24006e40 con 0x7f7c2c100d90 2023-05-08T03:40:49.757 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.745+0000 7f7c2b7fe700 1 --2- 172.21.15.96:0/2488845539 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f7c140a1150 0x7f7c140a3600 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c00b5c0 tx=0x7f7c1c005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:49.757 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.748+0000 7f7c28ff9700 1 -- 172.21.15.96:0/2488845539 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f7c24095e70 con 0x7f7c2c100d90 2023-05-08T03:40:49.960 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.957+0000 7f7c32023700 1 -- 172.21.15.96:0/2488845539 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7c2c106160 con 0x7f7c2c100d90 2023-05-08T03:40:49.961 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.959+0000 7f7c28ff9700 1 -- 172.21.15.96:0/2488845539 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+22109 (secure 0 0 0) 0x7f7c24099490 con 0x7f7c2c100d90 2023-05-08T03:40:49.962 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:40:49.962 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":81,"fsid":"f7ffcfb0-ed50-11ed-9b01-001a4aab830c","created":"2023-05-08T03:33:42.765680+0000","modified":"2023-05-08T03:40:49.209742+0000","last_up_change":"2023-05-08T03:40:07.550882+0000","last_in_change":"2023-05-08T03:39:49.027947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-08T03:36:47.800739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-05-08T03:40:47.229693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-05-08T03:40:48.359294+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2ee801e1-8eec-496d-a9ac-fc566b38bbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":1816903726},{"type":"v1","addr":"172.21.15.96:6803","nonce":1816903726}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":1816903726},{"type":"v1","addr":"172.21.15.96:6805","nonce":1816903726}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":1816903726},{"type":"v1","addr":"172.21.15.96:6809","nonce":1816903726}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":1816903726},{"type":"v1","addr":"172.21.15.96:6807","nonce":1816903726}]},"public_addr":"172.21.15.96:6803/1816903726","cluster_addr":"172.21.15.96:6805/1816903726","heartbeat_back_addr":"172.21.15.96:6809/1816903726","heartbeat_front_addr":"172.21.15.96:6807/1816903726","state":["exists","up"]},{"osd":1,"uuid":"eb73deea-fc7c-4f2f-8aef-2d71c598afda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":206989126},{"type":"v1","addr":"172.21.15.133:6801","nonce":206989126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":206989126},{"type":"v1","addr":"172.21.15.133:6803","nonce":206989126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":206989126},{"type":"v1","addr":"172.21.15.133:6807","nonce":206989126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":206989126},{"type":"v1","addr":"172.21.15.133:6805","nonce":206989126}]},"public_addr":"172.21.15.133:6801/206989126","cluster_addr":"172.21.15.133:6803/206989126","heartbeat_back_addr":"172.21.15.133:6807/206989126","heartbeat_front_addr":"172.21.15.133:6805/206989126","state":["exists","up"]},{"osd":2,"uuid":"74a2f239-e82d-4d87-9458-5373b6cbbffd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":1791188143},{"type":"v1","addr":"172.21.15.186:6801","nonce":1791188143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":1791188143},{"type":"v1","addr":"172.21.15.186:6803","nonce":1791188143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":1791188143},{"type":"v1","addr":"172.21.15.186:6807","nonce":1791188143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":1791188143},{"type":"v1","addr":"172.21.15.186:6805","nonce":1791188143}]},"public_addr":"172.21.15.186:6801/1791188143","cluster_addr":"172.21.15.186:6803/1791188143","heartbeat_back_addr":"172.21.15.186:6807/1791188143","heartbeat_front_addr":"172.21.15.186:6805/1791188143","state":["exists","up"]},{"osd":3,"uuid":"421eedf5-ba6e-484e-b715-78c1c10d684e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":3430402140},{"type":"v1","addr":"172.21.15.96:6811","nonce":3430402140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":3430402140},{"type":"v1","addr":"172.21.15.96:6813","nonce":3430402140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":3430402140},{"type":"v1","addr":"172.21.15.96:6817","nonce":3430402140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":3430402140},{"type":"v1","addr":"172.21.15.96:6815","nonce":3430402140}]},"public_addr":"172.21.15.96:6811/3430402140","cluster_addr":"172.21.15.96:6813/3430402140","heartbeat_back_addr":"172.21.15.96:6817/3430402140","heartbeat_front_addr":"172.21.15.96:6815/3430402140","state":["exists","up"]},{"osd":4,"uuid":"fb20100b-6a5a-462d-955d-1697a3861e96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":1237495996},{"type":"v1","addr":"172.21.15.133:6809","nonce":1237495996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":1237495996},{"type":"v1","addr":"172.21.15.133:6811","nonce":1237495996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":1237495996},{"type":"v1","addr":"172.21.15.133:6815","nonce":1237495996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":1237495996},{"type":"v1","addr":"172.21.15.133:6813","nonce":1237495996}]},"public_addr":"172.21.15.133:6809/1237495996","cluster_addr":"172.21.15.133:6811/1237495996","heartbeat_back_addr":"172.21.15.133:6815/1237495996","heartbeat_front_addr":"172.21.15.133:6813/1237495996","state":["exists","up"]},{"osd":5,"uuid":"00177913-8bd6-4391-83c3-08c2b1b8ef13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":541111862},{"type":"v1","addr":"172.21.15.186:6809","nonce":541111862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":541111862},{"type":"v1","addr":"172.21.15.186:6811","nonce":541111862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":541111862},{"type":"v1","addr":"172.21.15.186:6815","nonce":541111862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":541111862},{"type":"v1","addr":"172.21.15.186:6813","nonce":541111862}]},"public_addr":"172.21.15.186:6809/541111862","cluster_addr":"172.21.15.186:6811/541111862","heartbeat_back_addr":"172.21.15.186:6815/541111862","heartbeat_front_addr":"172.21.15.186:6813/541111862","state":["exists","up"]},{"osd":6,"uuid":"204baab6-ca6f-4eef-8b9c-91efc04cc30c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":386227948},{"type":"v1","addr":"172.21.15.96:6819","nonce":386227948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":386227948},{"type":"v1","addr":"172.21.15.96:6821","nonce":386227948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":386227948},{"type":"v1","addr":"172.21.15.96:6825","nonce":386227948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":386227948},{"type":"v1","addr":"172.21.15.96:6823","nonce":386227948}]},"public_addr":"172.21.15.96:6819/386227948","cluster_addr":"172.21.15.96:6821/386227948","heartbeat_back_addr":"172.21.15.96:6825/386227948","heartbeat_front_addr":"172.21.15.96:6823/386227948","state":["exists","up"]},{"osd":7,"uuid":"282db569-a76e-485b-a33d-f2579b956525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":218507954},{"type":"v1","addr":"172.21.15.133:6817","nonce":218507954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":218507954},{"type":"v1","addr":"172.21.15.133:6819","nonce":218507954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":218507954},{"type":"v1","addr":"172.21.15.133:6823","nonce":218507954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":218507954},{"type":"v1","addr":"172.21.15.133:6821","nonce":218507954}]},"public_addr":"172.21.15.133:6817/218507954","cluster_addr":"172.21.15.133:6819/218507954","heartbeat_back_addr":"172.21.15.133:6823/218507954","heartbeat_front_addr":"172.21.15.133:6821/218507954","state":["exists","up"]},{"osd":8,"uuid":"693e25b5-355d-4990-9467-0fac4c9133fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":1648475902},{"type":"v1","addr":"172.21.15.186:6817","nonce":1648475902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":1648475902},{"type":"v1","addr":"172.21.15.186:6819","nonce":1648475902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":1648475902},{"type":"v1","addr":"172.21.15.186:6823","nonce":1648475902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":1648475902},{"type":"v1","addr":"172.21.15.186:6821","nonce":1648475902}]},"public_addr":"172.21.15.186:6817/1648475902","cluster_addr":"172.21.15.186:6819/1648475902","heartbeat_back_addr":"172.21.15.186:6823/1648475902","heartbeat_front_addr":"172.21.15.186:6821/1648475902","state":["exists","up"]},{"osd":9,"uuid":"72fbff09-fe28-4014-86fc-c31f95cd19a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":543223824},{"type":"v1","addr":"172.21.15.96:6827","nonce":543223824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":543223824},{"type":"v1","addr":"172.21.15.96:6829","nonce":543223824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6832","nonce":543223824},{"type":"v1","addr":"172.21.15.96:6833","nonce":543223824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":543223824},{"type":"v1","addr":"172.21.15.96:6831","nonce":543223824}]},"public_addr":"172.21.15.96:6827/543223824","cluster_addr":"172.21.15.96:6829/543223824","heartbeat_back_addr":"172.21.15.96:6833/543223824","heartbeat_front_addr":"172.21.15.96:6831/543223824","state":["exists","up"]},{"osd":10,"uuid":"6c2b6757-60c2-4962-9409-6051dcb13273","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":2323107912},{"type":"v1","addr":"172.21.15.133:6825","nonce":2323107912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":2323107912},{"type":"v1","addr":"172.21.15.133:6827","nonce":2323107912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":2323107912},{"type":"v1","addr":"172.21.15.133:6831","nonce":2323107912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":2323107912},{"type":"v1","addr":"172.21.15.133:6829","nonce":2323107912}]},"public_addr":"172.21.15.133:6825/2323107912","cluster_addr":"172.21.15.133:6827/2323107912","heartbeat_back_addr":"172.21.15.133:6831/2323107912","heartbeat_front_addr":"172.21.15.133:6829/2323107912","state":["exists","up"]},{"osd":11,"uuid":"03c0bb25-2921-446b-960e-6a7a328d36a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":3853499290},{"type":"v1","addr":"172.21.15.186:6825","nonce":3853499290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":3853499290},{"type":"v1","addr":"172.21.15.186:6827","nonce":3853499290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":3853499290},{"type":"v1","addr":"172.21.15.186:6831","nonce":3853499290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":3853499290},{"type":"v1","addr":"172.21.15.186:6829","nonce":3853499290}]},"public_addr":"172.21.15.186:6825/3853499290","cluster_addr":"172.21.15.186:6827/3853499290","heartbeat_back_addr":"172.21.15.186:6831/3853499290","heartbeat_front_addr":"172.21.15.186:6829/3853499290","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:36:02.087281+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:36:24.328783+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:36:46.135576+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:37:08.524145+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:37:30.883871+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:37:53.344554+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:38:15.448162+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:38:37.414878+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:38:59.533953+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:39:21.392102+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:39:43.462696+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:40:05.561808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.96:0/1333468881":"2023-05-09T03:34:37.472043+0000","172.21.15.96:6800/1979917756":"2023-05-09T03:34:37.472043+0000","172.21.15.96:0/1332045367":"2023-05-09T03:34:37.472043+0000","172.21.15.96:0/520278090":"2023-05-09T03:34:14.800324+0000","172.21.15.96:0/1055409415":"2023-05-09T03:34:37.472043+0000","172.21.15.96:6801/1979917756":"2023-05-09T03:34:37.472043+0000","172.21.15.96:0/1541933328":"2023-05-09T03:34:14.800324+0000","172.21.15.96:6800/3944122753":"2023-05-09T03:34:14.800324+0000","172.21.15.96:0/2986058319":"2023-05-09T03:34:14.800324+0000","172.21.15.96:6801/3944122753":"2023-05-09T03:34:14.800324+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-08T03:40:49.964 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.961+0000 7f7c32023700 1 -- 172.21.15.96:0/2488845539 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f7c140a1150 msgr2=0x7f7c140a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:49.964 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.961+0000 7f7c32023700 1 --2- 172.21.15.96:0/2488845539 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f7c140a1150 0x7f7c140a3600 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c00b5c0 tx=0x7f7c1c005960 comp rx=0 tx=0).stop 2023-05-08T03:40:49.964 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.961+0000 7f7c32023700 1 -- 172.21.15.96:0/2488845539 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c2c100d90 msgr2=0x7f7c2c19c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:49.964 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.961+0000 7f7c32023700 1 --2- 172.21.15.96:0/2488845539 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c2c100d90 0x7f7c2c19c5e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7c2400b970 tx=0x7f7c2400bc80 comp rx=0 tx=0).stop 2023-05-08T03:40:49.964 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.961+0000 7f7c32023700 1 -- 172.21.15.96:0/2488845539 shutdown_connections 2023-05-08T03:40:49.964 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.961+0000 7f7c32023700 1 --2- 172.21.15.96:0/2488845539 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f7c140a1150 0x7f7c140a3600 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:49.965 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.961+0000 7f7c32023700 1 --2- 172.21.15.96:0/2488845539 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c2c100d90 0x7f7c2c19c5e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:49.965 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.961+0000 7f7c32023700 1 --2- 172.21.15.96:0/2488845539 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c2c0ff210 0x7f7c2c195030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:49.965 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.961+0000 7f7c32023700 1 --2- 172.21.15.96:0/2488845539 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7c2c100400 0x7f7c2c195570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:49.965 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.961+0000 7f7c32023700 1 -- 172.21.15.96:0/2488845539 >> 172.21.15.96:0/2488845539 conn(0x7f7c2c0fa7f0 msgr2=0x7f7c2c0fcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:49.965 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.961+0000 7f7c32023700 1 -- 172.21.15.96:0/2488845539 shutdown_connections 2023-05-08T03:40:49.965 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:49.961+0000 7f7c32023700 1 -- 172.21.15.96:0/2488845539 wait complete. 2023-05-08T03:40:49.975 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:49 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:40:49.975 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:49 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T03:40:49.975 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:49 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:40:49.975 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:49 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T03:40:49.975 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:49 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/3663283440' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-05-08T03:40:49.975 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:49 smithi096 ceph-mon[124666]: osdmap e80: 12 total, 12 up, 12 in 2023-05-08T03:40:49.976 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:49 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/4130433327' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-05-08T03:40:49.976 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:49 smithi096 ceph-mon[124666]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-05-08T03:40:49.976 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:49 smithi096 ceph-mon[124666]: osdmap e81: 12 total, 12 up, 12 in 2023-05-08T03:40:49.976 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:49 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/4130433327' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-05-08T03:40:49.976 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:49 smithi096 ceph-mon[124666]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-05-08T03:40:49.976 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:49 smithi096 ceph-mon[124666]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-05-08T03:40:49.976 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:49 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/2059193183' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-05-08T03:40:49.978 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-05-08T03:40:50.111 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:50.108+0000 7fd708b09700 1 -- 172.21.15.96:0/3786248868 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd704101ea0 msgr2=0x7fd704108760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:50.111 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:50.108+0000 7fd708b09700 1 --2- 172.21.15.96:0/3786248868 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd704101ea0 0x7fd704108760 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc00b0a0 tx=0x7fd6fc00b3b0 comp rx=0 tx=0).stop 2023-05-08T03:40:50.112 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:50.109+0000 7fd708b09700 1 -- 172.21.15.96:0/3786248868 shutdown_connections 2023-05-08T03:40:50.112 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:50.109+0000 7fd708b09700 1 --2- 172.21.15.96:0/3786248868 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd704101ea0 0x7fd704108760 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:50.112 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:50.109+0000 7fd708b09700 1 --2- 172.21.15.96:0/3786248868 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd704100320 0x7fd704100730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:50.112 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:50.109+0000 7fd708b09700 1 --2- 172.21.15.96:0/3786248868 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd704101510 0x7fd704101960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:50.112 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:50.109+0000 7fd708b09700 1 -- 172.21.15.96:0/3786248868 >> 172.21.15.96:0/3786248868 conn(0x7fd7040fb940 msgr2=0x7fd7040fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:50.112 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:50.109+0000 7fd708b09700 1 -- 172.21.15.96:0/3786248868 shutdown_connections 2023-05-08T03:40:50.112 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:50.109+0000 7fd708b09700 1 -- 172.21.15.96:0/3786248868 wait complete. 2023-05-08T03:40:50.114 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:50.109+0000 7fd708b09700 1 Processor -- start 2023-05-08T03:40:50.115 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:50.109+0000 7fd708b09700 1 -- start start 2023-05-08T03:40:50.115 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:50.109+0000 7fd708b09700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd704100320 0x7fd7040749a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:50.115 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:50.109+0000 7fd708b09700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd704101510 0x7fd704072fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:50.116 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:50.109+0000 7fd708b09700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd704101ea0 0x7fd704073520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:50.116 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:50.109+0000 7fd708b09700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd704073cc0 con 0x7fd704101510 2023-05-08T03:40:50.116 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:50.109+0000 7fd708b09700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd704073e30 con 0x7fd704100320 2023-05-08T03:40:50.116 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:50.109+0000 7fd708b09700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7041a0160 con 0x7fd704101ea0 2023-05-08T03:40:50.117 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:50.110+0000 7fd701d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd704101510 0x7fd704072fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:50.117 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:50.110+0000 7fd701d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd704101510 0x7fd704072fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40460/0 (socket says 172.21.15.96:40460) 2023-05-08T03:40:50.117 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:50.110+0000 7fd701d9b700 1 -- 172.21.15.96:0/3229947026 learned_addr learned my addr 172.21.15.96:0/3229947026 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:40:50.117 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:50.110+0000 7fd70259c700 1 --2- 172.21.15.96:0/3229947026 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd704100320 0x7fd7040749a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:50.117 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:50.110+0000 7fd702d9d700 1 --2- 172.21.15.96:0/3229947026 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd704101ea0 0x7fd704073520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:50.117 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:50.110+0000 7fd701d9b700 1 -- 172.21.15.96:0/3229947026 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd704101ea0 msgr2=0x7fd704073520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:50.117 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:50.110+0000 7fd701d9b700 1 --2- 172.21.15.96:0/3229947026 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd704101ea0 0x7fd704073520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:50.117 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:50.110+0000 7fd701d9b700 1 -- 172.21.15.96:0/3229947026 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd704100320 msgr2=0x7fd7040749a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:50.118 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:50.110+0000 7fd701d9b700 1 --2- 172.21.15.96:0/3229947026 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd704100320 0x7fd7040749a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:50.118 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:50.110+0000 7fd701d9b700 1 -- 172.21.15.96:0/3229947026 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6fc009d00 con 0x7fd704101510 2023-05-08T03:40:50.118 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:50.110+0000 7fd701d9b700 1 --2- 172.21.15.96:0/3229947026 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd704101510 0x7fd704072fe0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd6f800e9a0 tx=0x7fd6f800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:50.118 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:50.110+0000 7fd6f37fe700 1 -- 172.21.15.96:0/3229947026 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f8009790 con 0x7fd704101510 2023-05-08T03:40:50.118 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:50.110+0000 7fd6f37fe700 1 -- 172.21.15.96:0/3229947026 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd6f8010430 con 0x7fd704101510 2023-05-08T03:40:50.118 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:50.110+0000 7fd708b09700 1 -- 172.21.15.96:0/3229947026 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd70410bca0 con 0x7fd704101510 2023-05-08T03:40:50.118 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:50.110+0000 7fd6f37fe700 1 -- 172.21.15.96:0/3229947026 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f8018680 con 0x7fd704101510 2023-05-08T03:40:50.118 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:50.110+0000 7fd708b09700 1 -- 172.21.15.96:0/3229947026 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd70410bb10 con 0x7fd704101510 2023-05-08T03:40:50.119 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:50.111+0000 7fd708b09700 1 -- 172.21.15.96:0/3229947026 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7041a08a0 con 0x7fd704101510 2023-05-08T03:40:50.119 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:50.112+0000 7fd6f37fe700 1 -- 172.21.15.96:0/3229947026 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fd6f80105a0 con 0x7fd704101510 2023-05-08T03:40:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:49 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:40:50.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:49 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T03:40:50.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:49 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:40:50.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:49 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T03:40:50.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:49 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/3663283440' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-05-08T03:40:50.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:49 smithi186 ceph-mon[126480]: osdmap e80: 12 total, 12 up, 12 in 2023-05-08T03:40:50.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:49 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/4130433327' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-05-08T03:40:50.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:49 smithi186 ceph-mon[126480]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-05-08T03:40:50.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:49 smithi186 ceph-mon[126480]: osdmap e81: 12 total, 12 up, 12 in 2023-05-08T03:40:50.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:49 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/4130433327' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-05-08T03:40:50.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:49 smithi186 ceph-mon[126480]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-05-08T03:40:50.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:49 smithi186 ceph-mon[126480]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-05-08T03:40:50.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:49 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/2059193183' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-05-08T03:40:50.122 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:50.113+0000 7fd6f37fe700 1 --2- 172.21.15.96:0/3229947026 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fd6ec0a11d0 0x7fd6ec0a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:50.122 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:50.114+0000 7fd70259c700 1 --2- 172.21.15.96:0/3229947026 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fd6ec0a11d0 0x7fd6ec0a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:50.122 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:50.114+0000 7fd6f37fe700 1 -- 172.21.15.96:0/3229947026 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fd6f8014070 con 0x7fd704101510 2023-05-08T03:40:50.122 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:50.114+0000 7fd70259c700 1 --2- 172.21.15.96:0/3229947026 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fd6ec0a11d0 0x7fd6ec0a3680 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd704101370 tx=0x7fd6f400a3b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:50.122 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:50.117+0000 7fd6f37fe700 1 -- 172.21.15.96:0/3229947026 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fd6f8051730 con 0x7fd704101510 2023-05-08T03:40:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:49 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:40:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:49 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T03:40:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:49 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:40:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:49 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T03:40:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:49 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/3663283440' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-05-08T03:40:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:49 smithi133 ceph-mon[125939]: osdmap e80: 12 total, 12 up, 12 in 2023-05-08T03:40:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:49 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/4130433327' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-05-08T03:40:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:49 smithi133 ceph-mon[125939]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-05-08T03:40:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:49 smithi133 ceph-mon[125939]: osdmap e81: 12 total, 12 up, 12 in 2023-05-08T03:40:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:49 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/4130433327' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-05-08T03:40:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:49 smithi133 ceph-mon[125939]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-05-08T03:40:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:49 smithi133 ceph-mon[125939]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-05-08T03:40:50.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:49 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/2059193183' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-05-08T03:40:50.377 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:50.375+0000 7fd708b09700 1 -- 172.21.15.96:0/3229947026 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd704107110 con 0x7fd704101510 2023-05-08T03:40:50.786 INFO:journalctl@ceph.mds.b.smithi133.stdout:May 08 03:40:50 smithi133 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mds-b[151469]: 2023-05-08T03:40:50.491+0000 7f5721767700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-05-08T03:40:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:50 smithi186 ceph-mon[126480]: pgmap v257: 97 pgs: 18 active+clean, 15 creating+peering, 64 unknown; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-05-08T03:40:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:50 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/2488845539' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-05-08T03:40:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:50 smithi186 ceph-mon[126480]: osdmap e82: 12 total, 12 up, 12 in 2023-05-08T03:40:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T03:40:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:50 smithi186 ceph-mon[126480]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-05-08T03:40:51.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:50 smithi186 ceph-mon[126480]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-05-08T03:40:51.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:50 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/3229947026' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-05-08T03:40:51.231 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:51.229+0000 7fd6f37fe700 1 -- 172.21.15.96:0/3229947026 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) v1 ==== 118+0+0 (secure 0 0 0) 0x7fd6f80961d0 con 0x7fd704101510 2023-05-08T03:40:51.234 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:51.232+0000 7fd708b09700 1 -- 172.21.15.96:0/3229947026 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fd6ec0a11d0 msgr2=0x7fd6ec0a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:51.234 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:51.232+0000 7fd708b09700 1 --2- 172.21.15.96:0/3229947026 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fd6ec0a11d0 0x7fd6ec0a3680 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd704101370 tx=0x7fd6f400a3b0 comp rx=0 tx=0).stop 2023-05-08T03:40:51.235 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:51.232+0000 7fd708b09700 1 -- 172.21.15.96:0/3229947026 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd704101510 msgr2=0x7fd704072fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:51.235 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:51.232+0000 7fd708b09700 1 --2- 172.21.15.96:0/3229947026 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd704101510 0x7fd704072fe0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd6f800e9a0 tx=0x7fd6f800ecb0 comp rx=0 tx=0).stop 2023-05-08T03:40:51.235 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:51.232+0000 7fd708b09700 1 -- 172.21.15.96:0/3229947026 shutdown_connections 2023-05-08T03:40:51.235 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:51.232+0000 7fd708b09700 1 --2- 172.21.15.96:0/3229947026 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fd6ec0a11d0 0x7fd6ec0a3680 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:51.235 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:51.232+0000 7fd708b09700 1 --2- 172.21.15.96:0/3229947026 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd704101ea0 0x7fd704073520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:51.235 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:51.232+0000 7fd708b09700 1 --2- 172.21.15.96:0/3229947026 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd704100320 0x7fd7040749a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:51.236 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:51.232+0000 7fd708b09700 1 --2- 172.21.15.96:0/3229947026 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd704101510 0x7fd704072fe0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:51.236 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:51.232+0000 7fd708b09700 1 -- 172.21.15.96:0/3229947026 >> 172.21.15.96:0/3229947026 conn(0x7fd7040fb940 msgr2=0x7fd7040fdad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:51.236 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:51.232+0000 7fd708b09700 1 -- 172.21.15.96:0/3229947026 shutdown_connections 2023-05-08T03:40:51.236 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:51.232+0000 7fd708b09700 1 -- 172.21.15.96:0/3229947026 wait complete. 2023-05-08T03:40:51.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:50 smithi133 ceph-mon[125939]: pgmap v257: 97 pgs: 18 active+clean, 15 creating+peering, 64 unknown; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-05-08T03:40:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:50 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/2488845539' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-05-08T03:40:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:50 smithi133 ceph-mon[125939]: osdmap e82: 12 total, 12 up, 12 in 2023-05-08T03:40:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T03:40:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:50 smithi133 ceph-mon[125939]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-05-08T03:40:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:50 smithi133 ceph-mon[125939]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-05-08T03:40:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:50 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/3229947026' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-05-08T03:40:51.247 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:50 smithi096 ceph-mon[124666]: pgmap v257: 97 pgs: 18 active+clean, 15 creating+peering, 64 unknown; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-05-08T03:40:51.247 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:50 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/2488845539' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-05-08T03:40:51.247 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:50 smithi096 ceph-mon[124666]: osdmap e82: 12 total, 12 up, 12 in 2023-05-08T03:40:51.247 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T03:40:51.247 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:50 smithi096 ceph-mon[124666]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-05-08T03:40:51.247 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:50 smithi096 ceph-mon[124666]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-05-08T03:40:51.248 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:50 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/3229947026' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-05-08T03:40:51.248 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2023-05-08T03:40:51.249 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2023-05-08T03:40:51.376 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:51.373+0000 7fefbbe82700 1 -- 172.21.15.96:0/2365405756 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefb41015a0 msgr2=0x7fefb41019f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:51.376 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:51.373+0000 7fefbbe82700 1 --2- 172.21.15.96:0/2365405756 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefb41015a0 0x7fefb41019f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fefb0009990 tx=0x7fefb0009ca0 comp rx=0 tx=0).stop 2023-05-08T03:40:51.376 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:51.373+0000 7fefbbe82700 1 -- 172.21.15.96:0/2365405756 shutdown_connections 2023-05-08T03:40:51.376 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:51.373+0000 7fefbbe82700 1 --2- 172.21.15.96:0/2365405756 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fefb4101f30 0x7fefb41087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:51.377 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:51.373+0000 7fefbbe82700 1 --2- 172.21.15.96:0/2365405756 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefb40fe5d0 0x7fefb40fe9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:51.377 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:51.373+0000 7fefbbe82700 1 --2- 172.21.15.96:0/2365405756 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefb41015a0 0x7fefb41019f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:51.377 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:51.373+0000 7fefbbe82700 1 -- 172.21.15.96:0/2365405756 >> 172.21.15.96:0/2365405756 conn(0x7fefb40f9fd0 msgr2=0x7fefb40fc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:51.377 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:51.373+0000 7fefbbe82700 1 -- 172.21.15.96:0/2365405756 shutdown_connections 2023-05-08T03:40:51.377 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:51.373+0000 7fefbbe82700 1 -- 172.21.15.96:0/2365405756 wait complete. 2023-05-08T03:40:51.380 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:51.374+0000 7fefbbe82700 1 Processor -- start 2023-05-08T03:40:51.380 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:51.374+0000 7fefbbe82700 1 -- start start 2023-05-08T03:40:51.380 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:51.374+0000 7fefbbe82700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefb40fe5d0 0x7fefb41982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:51.381 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:51.374+0000 7fefbbe82700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefb41015a0 0x7fefb41987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:51.381 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:51.374+0000 7fefbbe82700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fefb4101f30 0x7fefb419f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:51.381 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:51.374+0000 7fefbbe82700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb419fe20 con 0x7fefb41015a0 2023-05-08T03:40:51.381 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:51.374+0000 7fefbbe82700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb419ff60 con 0x7fefb40fe5d0 2023-05-08T03:40:51.382 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:51.374+0000 7fefbbe82700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb41a00f0 con 0x7fefb4101f30 2023-05-08T03:40:51.382 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:51.374+0000 7fefb941d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefb41015a0 0x7fefb41987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:51.382 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:51.375+0000 7fefb941d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefb41015a0 0x7fefb41987e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40474/0 (socket says 172.21.15.96:40474) 2023-05-08T03:40:51.382 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:51.375+0000 7fefb9c1e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefb40fe5d0 0x7fefb41982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:51.383 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:51.375+0000 7fefb941d700 1 -- 172.21.15.96:0/1826937821 learned_addr learned my addr 172.21.15.96:0/1826937821 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:40:51.383 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:51.375+0000 7fefba41f700 1 --2- 172.21.15.96:0/1826937821 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fefb4101f30 0x7fefb419f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:51.383 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:51.375+0000 7fefb941d700 1 -- 172.21.15.96:0/1826937821 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fefb4101f30 msgr2=0x7fefb419f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:51.383 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:51.375+0000 7fefb941d700 1 --2- 172.21.15.96:0/1826937821 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fefb4101f30 0x7fefb419f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:51.384 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:51.375+0000 7fefb941d700 1 -- 172.21.15.96:0/1826937821 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefb40fe5d0 msgr2=0x7fefb41982a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:51.384 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:51.375+0000 7fefb941d700 1 --2- 172.21.15.96:0/1826937821 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefb40fe5d0 0x7fefb41982a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:51.384 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:51.375+0000 7fefb941d700 1 -- 172.21.15.96:0/1826937821 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefb00095f0 con 0x7fefb41015a0 2023-05-08T03:40:51.385 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:51.375+0000 7fefb9c1e700 1 --2- 172.21.15.96:0/1826937821 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefb40fe5d0 0x7fefb41982a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-08T03:40:51.385 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:51.375+0000 7fefb941d700 1 --2- 172.21.15.96:0/1826937821 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefb41015a0 0x7fefb41987e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fefb0000c00 tx=0x7fefb000f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:51.385 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:51.375+0000 7fefaaffd700 1 -- 172.21.15.96:0/1826937821 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb001d070 con 0x7fefb41015a0 2023-05-08T03:40:51.385 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:51.375+0000 7fefaaffd700 1 -- 172.21.15.96:0/1826937821 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fefb000fb50 con 0x7fefb41015a0 2023-05-08T03:40:51.385 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:51.375+0000 7fefbbe82700 1 -- 172.21.15.96:0/1826937821 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefb410bc70 con 0x7fefb41015a0 2023-05-08T03:40:51.386 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:51.375+0000 7fefaaffd700 1 -- 172.21.15.96:0/1826937821 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb00173f0 con 0x7fefb41015a0 2023-05-08T03:40:51.386 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:51.375+0000 7fefbbe82700 1 -- 172.21.15.96:0/1826937821 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefb410bae0 con 0x7fefb41015a0 2023-05-08T03:40:51.386 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:51.376+0000 7fefbbe82700 1 -- 172.21.15.96:0/1826937821 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefb41a0770 con 0x7fefb41015a0 2023-05-08T03:40:51.386 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:51.377+0000 7fefaaffd700 1 -- 172.21.15.96:0/1826937821 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fefb000fcc0 con 0x7fefb41015a0 2023-05-08T03:40:51.387 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:51.378+0000 7fefaaffd700 1 --2- 172.21.15.96:0/1826937821 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fefa00a11d0 0x7fefa00a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:51.387 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:51.378+0000 7fefb9c1e700 1 --2- 172.21.15.96:0/1826937821 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fefa00a11d0 0x7fefa00a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:51.387 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:51.378+0000 7fefaaffd700 1 -- 172.21.15.96:0/1826937821 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fefb00cdd30 con 0x7fefb41015a0 2023-05-08T03:40:51.387 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:51.378+0000 7fefb9c1e700 1 --2- 172.21.15.96:0/1826937821 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fefa00a11d0 0x7fefa00a3680 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fefb4067cd0 tx=0x7fefa4007400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:51.387 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:51.382+0000 7fefaaffd700 1 -- 172.21.15.96:0/1826937821 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fefb0097660 con 0x7fefb41015a0 2023-05-08T03:40:51.632 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:51.630+0000 7fefbbe82700 1 -- 172.21.15.96:0/1826937821 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) v1 -- 0x7fefb41a0d20 con 0x7fefb41015a0 2023-05-08T03:40:52.341 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:52.339+0000 7fefaaffd700 1 -- 172.21.15.96:0/1826937821 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v18) v1 ==== 105+0+0 (secure 0 0 0) 0x7fefb009ac80 con 0x7fefb41015a0 2023-05-08T03:40:52.344 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:52.342+0000 7fefbbe82700 1 -- 172.21.15.96:0/1826937821 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fefa00a11d0 msgr2=0x7fefa00a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:52.345 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:52.342+0000 7fefbbe82700 1 --2- 172.21.15.96:0/1826937821 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fefa00a11d0 0x7fefa00a3680 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fefb4067cd0 tx=0x7fefa4007400 comp rx=0 tx=0).stop 2023-05-08T03:40:52.345 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:52.342+0000 7fefbbe82700 1 -- 172.21.15.96:0/1826937821 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefb41015a0 msgr2=0x7fefb41987e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:52.345 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:52.342+0000 7fefbbe82700 1 --2- 172.21.15.96:0/1826937821 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefb41015a0 0x7fefb41987e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fefb0000c00 tx=0x7fefb000f710 comp rx=0 tx=0).stop 2023-05-08T03:40:52.345 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:52.342+0000 7fefbbe82700 1 -- 172.21.15.96:0/1826937821 shutdown_connections 2023-05-08T03:40:52.345 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:52.342+0000 7fefbbe82700 1 --2- 172.21.15.96:0/1826937821 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fefa00a11d0 0x7fefa00a3680 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:52.345 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:52.342+0000 7fefbbe82700 1 --2- 172.21.15.96:0/1826937821 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fefb4101f30 0x7fefb419f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:52.346 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:52.342+0000 7fefbbe82700 1 --2- 172.21.15.96:0/1826937821 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefb40fe5d0 0x7fefb41982a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:52.346 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:52.342+0000 7fefbbe82700 1 --2- 172.21.15.96:0/1826937821 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefb41015a0 0x7fefb41987e0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:52.346 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:52.342+0000 7fefbbe82700 1 -- 172.21.15.96:0/1826937821 >> 172.21.15.96:0/1826937821 conn(0x7fefb40f9fd0 msgr2=0x7fefb40fc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:52.347 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:52.342+0000 7fefbbe82700 1 -- 172.21.15.96:0/1826937821 shutdown_connections 2023-05-08T03:40:52.347 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:52.342+0000 7fefbbe82700 1 -- 172.21.15.96:0/1826937821 wait complete. 2023-05-08T03:40:52.362 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2023-05-08T03:40:52.491 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:52.486+0000 7fe305a56700 1 -- 172.21.15.96:0/2073470623 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe300100400 msgr2=0x7fe300100850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:52.492 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:52.486+0000 7fe305a56700 1 --2- 172.21.15.96:0/2073470623 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe300100400 0x7fe300100850 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe2f0009990 tx=0x7fe2f0009ca0 comp rx=0 tx=0).stop 2023-05-08T03:40:52.492 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:52.486+0000 7fe305a56700 1 -- 172.21.15.96:0/2073470623 shutdown_connections 2023-05-08T03:40:52.492 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:52.486+0000 7fe305a56700 1 --2- 172.21.15.96:0/2073470623 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe300100d90 0x7fe300107650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:52.492 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:52.487+0000 7fe305a56700 1 --2- 172.21.15.96:0/2073470623 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe3000ff210 0x7fe3000ff620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:52.492 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:52.487+0000 7fe305a56700 1 --2- 172.21.15.96:0/2073470623 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe300100400 0x7fe300100850 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:52.492 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:52.487+0000 7fe305a56700 1 -- 172.21.15.96:0/2073470623 >> 172.21.15.96:0/2073470623 conn(0x7fe3000fa850 msgr2=0x7fe3000fcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:52.492 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:52.487+0000 7fe305a56700 1 -- 172.21.15.96:0/2073470623 shutdown_connections 2023-05-08T03:40:52.493 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:52.487+0000 7fe305a56700 1 -- 172.21.15.96:0/2073470623 wait complete. 2023-05-08T03:40:52.493 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:52.487+0000 7fe305a56700 1 Processor -- start 2023-05-08T03:40:52.493 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:52.487+0000 7fe305a56700 1 -- start start 2023-05-08T03:40:52.493 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:52.487+0000 7fe305a56700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3000ff210 0x7fe3001031a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:52.493 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:52.487+0000 7fe305a56700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe300100400 0x7fe3001017e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:52.494 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:52.487+0000 7fe305a56700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe300100d90 0x7fe300101d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:52.494 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:52.487+0000 7fe305a56700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3001024c0 con 0x7fe3000ff210 2023-05-08T03:40:52.494 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:52.487+0000 7fe305a56700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe300102630 con 0x7fe300100d90 2023-05-08T03:40:52.494 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:52.487+0000 7fe305a56700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3001a0140 con 0x7fe300100400 2023-05-08T03:40:52.494 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:52.488+0000 7fe2feffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3000ff210 0x7fe3001031a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:52.494 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:52.488+0000 7fe2feffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3000ff210 0x7fe3001031a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40486/0 (socket says 172.21.15.96:40486) 2023-05-08T03:40:52.495 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:52.488+0000 7fe2feffd700 1 -- 172.21.15.96:0/1760445768 learned_addr learned my addr 172.21.15.96:0/1760445768 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:40:52.495 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:52.488+0000 7fe2ff7fe700 1 --2- 172.21.15.96:0/1760445768 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe300100d90 0x7fe300101d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:52.495 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:52.488+0000 7fe2fe7fc700 1 --2- 172.21.15.96:0/1760445768 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe300100400 0x7fe3001017e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:52.495 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:52.488+0000 7fe2feffd700 1 -- 172.21.15.96:0/1760445768 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe300100400 msgr2=0x7fe3001017e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:52.495 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:52.488+0000 7fe2feffd700 1 --2- 172.21.15.96:0/1760445768 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe300100400 0x7fe3001017e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:52.496 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:52.488+0000 7fe2feffd700 1 -- 172.21.15.96:0/1760445768 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe300100d90 msgr2=0x7fe300101d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:52.496 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:52.488+0000 7fe2feffd700 1 --2- 172.21.15.96:0/1760445768 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe300100d90 0x7fe300101d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:52.496 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:52.488+0000 7fe2feffd700 1 -- 172.21.15.96:0/1760445768 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f00095f0 con 0x7fe3000ff210 2023-05-08T03:40:52.496 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:52.488+0000 7fe2ff7fe700 1 --2- 172.21.15.96:0/1760445768 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe300100d90 0x7fe300101d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-08T03:40:52.496 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:52.488+0000 7fe2fe7fc700 1 --2- 172.21.15.96:0/1760445768 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe300100400 0x7fe3001017e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-08T03:40:52.496 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:52.488+0000 7fe2feffd700 1 --2- 172.21.15.96:0/1760445768 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3000ff210 0x7fe3001031a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe2f400c970 tx=0x7fe2f400cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:52.497 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:52.488+0000 7fe304a54700 1 -- 172.21.15.96:0/1760445768 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f4004220 con 0x7fe3000ff210 2023-05-08T03:40:52.497 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:52.488+0000 7fe304a54700 1 -- 172.21.15.96:0/1760445768 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe2f4007d60 con 0x7fe3000ff210 2023-05-08T03:40:52.497 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:52.488+0000 7fe305a56700 1 -- 172.21.15.96:0/1760445768 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe30010abf0 con 0x7fe3000ff210 2023-05-08T03:40:52.497 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:52.488+0000 7fe304a54700 1 -- 172.21.15.96:0/1760445768 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f4003d00 con 0x7fe3000ff210 2023-05-08T03:40:52.497 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:52.488+0000 7fe305a56700 1 -- 172.21.15.96:0/1760445768 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe30010aa60 con 0x7fe3000ff210 2023-05-08T03:40:52.498 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:52 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/3229947026' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-05-08T03:40:52.498 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:52 smithi133 ceph-mon[125939]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-05-08T03:40:52.498 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:52 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:52.498 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:52 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:52.499 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:52 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:52.499 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:52 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:52.499 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:52 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:52.499 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:52 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:52.499 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:52 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:40:52.500 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:52 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:40:52.500 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:52 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:40:52.500 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:52 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:52.500 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:52 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T03:40:52.500 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:52 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:40:52.500 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:52 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T03:40:52.500 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:52 smithi133 ceph-mon[125939]: pgmap v259: 97 pgs: 55 active+clean, 15 creating+peering, 27 unknown; 578 KiB data, 76 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 7 op/s 2023-05-08T03:40:52.501 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:52 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/1826937821' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2023-05-08T03:40:52.501 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:52.489+0000 7fe305a56700 1 -- 172.21.15.96:0/1760445768 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe300067f40 con 0x7fe3000ff210 2023-05-08T03:40:52.502 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:52.490+0000 7fe304a54700 1 -- 172.21.15.96:0/1760445768 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fe2f4004380 con 0x7fe3000ff210 2023-05-08T03:40:52.502 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:52.491+0000 7fe304a54700 1 --2- 172.21.15.96:0/1760445768 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fe2e80a1150 0x7fe2e80a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:52.502 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:52.491+0000 7fe304a54700 1 -- 172.21.15.96:0/1760445768 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fe2f40cc790 con 0x7fe3000ff210 2023-05-08T03:40:52.502 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:52.491+0000 7fe2fe7fc700 1 --2- 172.21.15.96:0/1760445768 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fe2e80a1150 0x7fe2e80a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:52.502 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:52.491+0000 7fe2fe7fc700 1 --2- 172.21.15.96:0/1760445768 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fe2e80a1150 0x7fe2e80a3600 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe2f0000c00 tx=0x7fe2f0005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:52.502 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:52.496+0000 7fe304a54700 1 -- 172.21.15.96:0/1760445768 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fe2f4096030 con 0x7fe3000ff210 2023-05-08T03:40:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:52 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/3229947026' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-05-08T03:40:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:52 smithi096 ceph-mon[124666]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-05-08T03:40:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:52 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:52 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:52.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:52 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:52.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:52 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:52.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:52 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:52.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:52 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:52.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:52 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:40:52.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:52 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:40:52.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:52 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:40:52.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:52 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:52.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:52 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T03:40:52.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:52 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:40:52.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:52 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T03:40:52.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:52 smithi096 ceph-mon[124666]: pgmap v259: 97 pgs: 55 active+clean, 15 creating+peering, 27 unknown; 578 KiB data, 76 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 7 op/s 2023-05-08T03:40:52.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:52 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/1826937821' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2023-05-08T03:40:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:52 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/3229947026' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-05-08T03:40:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:52 smithi186 ceph-mon[126480]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-05-08T03:40:52.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:52 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:52.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:52 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:52.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:52 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:52.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:52 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:52.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:52 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:52.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:52 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:52.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:52 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:40:52.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:52 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:40:52.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:52 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:40:52.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:52 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:40:52.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:52 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T03:40:52.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:52 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:40:52.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:52 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T03:40:52.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:52 smithi186 ceph-mon[126480]: pgmap v259: 97 pgs: 55 active+clean, 15 creating+peering, 27 unknown; 578 KiB data, 76 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 7 op/s 2023-05-08T03:40:52.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:52 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/1826937821' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2023-05-08T03:40:52.730 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:52.728+0000 7fe305a56700 1 -- 172.21.15.96:0/1760445768 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7fe3001a10b0 con 0x7fe3000ff210 2023-05-08T03:40:53.348 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:53.346+0000 7fe304a54700 1 -- 172.21.15.96:0/1760445768 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v19) v1 ==== 121+0+0 (secure 0 0 0) 0x7fe2f4099650 con 0x7fe3000ff210 2023-05-08T03:40:53.352 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:53.348+0000 7fe305a56700 1 -- 172.21.15.96:0/1760445768 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fe2e80a1150 msgr2=0x7fe2e80a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:53.352 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:53.348+0000 7fe305a56700 1 --2- 172.21.15.96:0/1760445768 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fe2e80a1150 0x7fe2e80a3600 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe2f0000c00 tx=0x7fe2f0005fb0 comp rx=0 tx=0).stop 2023-05-08T03:40:53.352 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:53.348+0000 7fe305a56700 1 -- 172.21.15.96:0/1760445768 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3000ff210 msgr2=0x7fe3001031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:53.352 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:53.348+0000 7fe305a56700 1 --2- 172.21.15.96:0/1760445768 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3000ff210 0x7fe3001031a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe2f400c970 tx=0x7fe2f400cd30 comp rx=0 tx=0).stop 2023-05-08T03:40:53.353 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:53.348+0000 7fe305a56700 1 -- 172.21.15.96:0/1760445768 shutdown_connections 2023-05-08T03:40:53.353 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:53.348+0000 7fe305a56700 1 --2- 172.21.15.96:0/1760445768 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fe2e80a1150 0x7fe2e80a3600 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:53.353 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:53.348+0000 7fe305a56700 1 --2- 172.21.15.96:0/1760445768 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe300100d90 0x7fe300101d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:53.353 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:53.348+0000 7fe305a56700 1 --2- 172.21.15.96:0/1760445768 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3000ff210 0x7fe3001031a0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:53.353 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:53.348+0000 7fe305a56700 1 --2- 172.21.15.96:0/1760445768 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe300100400 0x7fe3001017e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:53.354 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:53.348+0000 7fe305a56700 1 -- 172.21.15.96:0/1760445768 >> 172.21.15.96:0/1760445768 conn(0x7fe3000fa850 msgr2=0x7fe300069120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:53.354 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:53.349+0000 7fe305a56700 1 -- 172.21.15.96:0/1760445768 shutdown_connections 2023-05-08T03:40:53.354 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:53.349+0000 7fe305a56700 1 -- 172.21.15.96:0/1760445768 wait complete. 2023-05-08T03:40:53.368 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2023-05-08T03:40:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:53 smithi133 ceph-mon[125939]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-05-08T03:40:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:53 smithi133 ceph-mon[125939]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-05-08T03:40:53.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:53 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/1826937821' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2023-05-08T03:40:53.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:53 smithi133 ceph-mon[125939]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2023-05-08T03:40:53.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:53 smithi133 ceph-mon[125939]: daemon mds.i is now active in filesystem cephfs as rank 1 2023-05-08T03:40:53.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:53 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/1760445768' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-05-08T03:40:53.499 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:53.495+0000 7fb3c0d42700 1 -- 172.21.15.96:0/3850697899 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3bc101930 msgr2=0x7fb3bc101d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:53.499 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:53.495+0000 7fb3c0d42700 1 --2- 172.21.15.96:0/3850697899 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3bc101930 0x7fb3bc101d40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb3b0009990 tx=0x7fb3b0009ca0 comp rx=0 tx=0).stop 2023-05-08T03:40:53.499 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:53.495+0000 7fb3c0d42700 1 -- 172.21.15.96:0/3850697899 shutdown_connections 2023-05-08T03:40:53.500 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:53.495+0000 7fb3c0d42700 1 --2- 172.21.15.96:0/3850697899 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb3bc0fed30 0x7fb3bc108910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:53.500 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:53.495+0000 7fb3c0d42700 1 --2- 172.21.15.96:0/3850697899 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3bc101930 0x7fb3bc101d40 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:53.500 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:53.495+0000 7fb3c0d42700 1 --2- 172.21.15.96:0/3850697899 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3bc0fe3a0 0x7fb3bc0fe7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:53.500 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:53.495+0000 7fb3c0d42700 1 -- 172.21.15.96:0/3850697899 >> 172.21.15.96:0/3850697899 conn(0x7fb3bc0f9fd0 msgr2=0x7fb3bc0fc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:53.500 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:53.495+0000 7fb3c0d42700 1 -- 172.21.15.96:0/3850697899 shutdown_connections 2023-05-08T03:40:53.500 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:53.495+0000 7fb3c0d42700 1 -- 172.21.15.96:0/3850697899 wait complete. 2023-05-08T03:40:53.501 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:53.496+0000 7fb3c0d42700 1 Processor -- start 2023-05-08T03:40:53.501 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:53.496+0000 7fb3c0d42700 1 -- start start 2023-05-08T03:40:53.501 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:53.496+0000 7fb3c0d42700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3bc0fe3a0 0x7fb3bc196100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:53.501 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:53.496+0000 7fb3c0d42700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb3bc0fed30 0x7fb3bc196640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:53.501 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:53.496+0000 7fb3c0d42700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3bc101930 0x7fb3bc19d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:53.501 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:53.496+0000 7fb3c0d42700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3bc19dc80 con 0x7fb3bc0fe3a0 2023-05-08T03:40:53.501 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:53.496+0000 7fb3c0d42700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3bc19ddc0 con 0x7fb3bc101930 2023-05-08T03:40:53.502 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:53.496+0000 7fb3c0d42700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3bc19df50 con 0x7fb3bc0fed30 2023-05-08T03:40:53.502 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:53.496+0000 7fb3ba59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3bc0fe3a0 0x7fb3bc196100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:53.502 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:53.496+0000 7fb3ba59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3bc0fe3a0 0x7fb3bc196100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40498/0 (socket says 172.21.15.96:40498) 2023-05-08T03:40:53.502 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:53.496+0000 7fb3ba59c700 1 -- 172.21.15.96:0/200960017 learned_addr learned my addr 172.21.15.96:0/200960017 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:40:53.502 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:53.496+0000 7fb3bad9d700 1 --2- 172.21.15.96:0/200960017 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3bc101930 0x7fb3bc19d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:53.502 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:53.496+0000 7fb3b9d9b700 1 --2- 172.21.15.96:0/200960017 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb3bc0fed30 0x7fb3bc196640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:53.502 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:53.496+0000 7fb3ba59c700 1 -- 172.21.15.96:0/200960017 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb3bc0fed30 msgr2=0x7fb3bc196640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:53.502 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:53.496+0000 7fb3ba59c700 1 --2- 172.21.15.96:0/200960017 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb3bc0fed30 0x7fb3bc196640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:53.503 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:53.496+0000 7fb3ba59c700 1 -- 172.21.15.96:0/200960017 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3bc101930 msgr2=0x7fb3bc19d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:53.503 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:53.496+0000 7fb3ba59c700 1 --2- 172.21.15.96:0/200960017 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3bc101930 0x7fb3bc19d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:53.503 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:53.496+0000 7fb3ba59c700 1 -- 172.21.15.96:0/200960017 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3b00095f0 con 0x7fb3bc0fe3a0 2023-05-08T03:40:53.503 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:53.497+0000 7fb3ba59c700 1 --2- 172.21.15.96:0/200960017 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3bc0fe3a0 0x7fb3bc196100 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb3b0000c00 tx=0x7fb3b000f700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:53.503 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:53.497+0000 7fb3ab7fe700 1 -- 172.21.15.96:0/200960017 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b001d070 con 0x7fb3bc0fe3a0 2023-05-08T03:40:53.503 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:53.497+0000 7fb3c0d42700 1 -- 172.21.15.96:0/200960017 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3bc10bd00 con 0x7fb3bc0fe3a0 2023-05-08T03:40:53.503 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:53.497+0000 7fb3ab7fe700 1 -- 172.21.15.96:0/200960017 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb3b000fbf0 con 0x7fb3bc0fe3a0 2023-05-08T03:40:53.504 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:53.497+0000 7fb3ab7fe700 1 -- 172.21.15.96:0/200960017 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b0017650 con 0x7fb3bc0fe3a0 2023-05-08T03:40:53.504 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:53.497+0000 7fb3c0d42700 1 -- 172.21.15.96:0/200960017 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3bc10bb70 con 0x7fb3bc0fe3a0 2023-05-08T03:40:53.504 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:53.498+0000 7fb3c0d42700 1 -- 172.21.15.96:0/200960017 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3bc107400 con 0x7fb3bc0fe3a0 2023-05-08T03:40:53.505 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:53.499+0000 7fb3ab7fe700 1 -- 172.21.15.96:0/200960017 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fb3b0022470 con 0x7fb3bc0fe3a0 2023-05-08T03:40:53.505 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:53.499+0000 7fb3ab7fe700 1 --2- 172.21.15.96:0/200960017 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fb3a40a1150 0x7fb3a40a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:53.505 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:53.499+0000 7fb3ab7fe700 1 -- 172.21.15.96:0/200960017 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fb3b00ce110 con 0x7fb3bc0fe3a0 2023-05-08T03:40:53.505 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:53.499+0000 7fb3b9d9b700 1 --2- 172.21.15.96:0/200960017 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fb3a40a1150 0x7fb3a40a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:53.505 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:53.500+0000 7fb3b9d9b700 1 --2- 172.21.15.96:0/200960017 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fb3a40a1150 0x7fb3a40a3600 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac005950 tx=0x7fb3ac005cf0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:53.505 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:53.503+0000 7fb3ab7fe700 1 -- 172.21.15.96:0/200960017 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fb3b0097a40 con 0x7fb3bc0fe3a0 2023-05-08T03:40:53.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:53 smithi096 ceph-mon[124666]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-05-08T03:40:53.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:53 smithi096 ceph-mon[124666]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-05-08T03:40:53.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:53 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/1826937821' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2023-05-08T03:40:53.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:53 smithi096 ceph-mon[124666]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2023-05-08T03:40:53.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:53 smithi096 ceph-mon[124666]: daemon mds.i is now active in filesystem cephfs as rank 1 2023-05-08T03:40:53.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:53 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/1760445768' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-05-08T03:40:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:53 smithi186 ceph-mon[126480]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-05-08T03:40:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:53 smithi186 ceph-mon[126480]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-05-08T03:40:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:53 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/1826937821' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2023-05-08T03:40:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:53 smithi186 ceph-mon[126480]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2023-05-08T03:40:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:53 smithi186 ceph-mon[126480]: daemon mds.i is now active in filesystem cephfs as rank 1 2023-05-08T03:40:53.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:53 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/1760445768' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-05-08T03:40:53.739 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:53.738+0000 7fb3c0d42700 1 -- 172.21.15.96:0/200960017 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7fb3bc061a30 con 0x7fb3bc0fe3a0 2023-05-08T03:40:54.358 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.356+0000 7fb3ab7fe700 1 -- 172.21.15.96:0/200960017 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v21) v1 ==== 115+0+0 (secure 0 0 0) 0x7fb3b009b060 con 0x7fb3bc0fe3a0 2023-05-08T03:40:54.360 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.359+0000 7fb3c0d42700 1 -- 172.21.15.96:0/200960017 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fb3a40a1150 msgr2=0x7fb3a40a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:54.361 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.359+0000 7fb3c0d42700 1 --2- 172.21.15.96:0/200960017 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fb3a40a1150 0x7fb3a40a3600 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac005950 tx=0x7fb3ac005cf0 comp rx=0 tx=0).stop 2023-05-08T03:40:54.361 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.359+0000 7fb3c0d42700 1 -- 172.21.15.96:0/200960017 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3bc0fe3a0 msgr2=0x7fb3bc196100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:54.361 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.359+0000 7fb3c0d42700 1 --2- 172.21.15.96:0/200960017 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3bc0fe3a0 0x7fb3bc196100 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb3b0000c00 tx=0x7fb3b000f700 comp rx=0 tx=0).stop 2023-05-08T03:40:54.361 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.359+0000 7fb3c0d42700 1 -- 172.21.15.96:0/200960017 shutdown_connections 2023-05-08T03:40:54.361 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.359+0000 7fb3c0d42700 1 --2- 172.21.15.96:0/200960017 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fb3a40a1150 0x7fb3a40a3600 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:54.361 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.359+0000 7fb3c0d42700 1 --2- 172.21.15.96:0/200960017 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3bc101930 0x7fb3bc19d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:54.362 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.359+0000 7fb3c0d42700 1 --2- 172.21.15.96:0/200960017 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3bc0fe3a0 0x7fb3bc196100 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:54.362 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.359+0000 7fb3c0d42700 1 --2- 172.21.15.96:0/200960017 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb3bc0fed30 0x7fb3bc196640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:54.362 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.359+0000 7fb3c0d42700 1 -- 172.21.15.96:0/200960017 >> 172.21.15.96:0/200960017 conn(0x7fb3bc0f9fd0 msgr2=0x7fb3bc0fc220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:54.362 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.359+0000 7fb3c0d42700 1 -- 172.21.15.96:0/200960017 shutdown_connections 2023-05-08T03:40:54.362 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.359+0000 7fb3c0d42700 1 -- 172.21.15.96:0/200960017 wait complete. 2023-05-08T03:40:54.374 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--size 25000000000'} subvols for filesystem 'cephfs' 2023-05-08T03:40:54.375 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_0 '' 2023-05-08T03:40:54.504 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.502+0000 7f1bd676b700 1 -- 172.21.15.96:0/218548450 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1bd0100330 msgr2=0x7f1bd0100740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:54.505 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.502+0000 7f1bd676b700 1 --2- 172.21.15.96:0/218548450 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1bd0100330 0x7f1bd0100740 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1bc4009990 tx=0x7f1bc4009ca0 comp rx=0 tx=0).stop 2023-05-08T03:40:54.505 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.502+0000 7f1bd676b700 1 -- 172.21.15.96:0/218548450 shutdown_connections 2023-05-08T03:40:54.505 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.502+0000 7f1bd676b700 1 --2- 172.21.15.96:0/218548450 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1bd0101eb0 0x7f1bd0108770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:54.505 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.502+0000 7f1bd676b700 1 --2- 172.21.15.96:0/218548450 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1bd0100330 0x7f1bd0100740 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:54.505 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.502+0000 7f1bd676b700 1 --2- 172.21.15.96:0/218548450 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1bd0101520 0x7f1bd0101970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:54.506 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.502+0000 7f1bd676b700 1 -- 172.21.15.96:0/218548450 >> 172.21.15.96:0/218548450 conn(0x7f1bd00fb950 msgr2=0x7f1bd00fdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:54.506 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.502+0000 7f1bd676b700 1 -- 172.21.15.96:0/218548450 shutdown_connections 2023-05-08T03:40:54.506 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.502+0000 7f1bd676b700 1 -- 172.21.15.96:0/218548450 wait complete. 2023-05-08T03:40:54.506 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.502+0000 7f1bd676b700 1 Processor -- start 2023-05-08T03:40:54.506 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.502+0000 7f1bd676b700 1 -- start start 2023-05-08T03:40:54.508 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.503+0000 7f1bd676b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1bd0100330 0x7f1bd0196170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:54.508 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.503+0000 7f1bd676b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1bd0101520 0x7f1bd01966b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:54.509 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.503+0000 7f1bd676b700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1bd0101eb0 0x7f1bd019d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:54.509 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.503+0000 7f1bd676b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd019dcf0 con 0x7f1bd0100330 2023-05-08T03:40:54.509 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.503+0000 7f1bd676b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd019de30 con 0x7f1bd0101520 2023-05-08T03:40:54.509 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.503+0000 7f1bd676b700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd019dfc0 con 0x7f1bd0101eb0 2023-05-08T03:40:54.509 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.503+0000 7f1bcffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1bd0100330 0x7f1bd0196170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:54.509 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.503+0000 7f1bcffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1bd0100330 0x7f1bd0196170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40512/0 (socket says 172.21.15.96:40512) 2023-05-08T03:40:54.509 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.503+0000 7f1bcffff700 1 -- 172.21.15.96:0/1330450345 learned_addr learned my addr 172.21.15.96:0/1330450345 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:40:54.509 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.503+0000 7f1bcf7fe700 1 --2- 172.21.15.96:0/1330450345 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1bd0101520 0x7f1bd01966b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:54.510 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.503+0000 7f1bcffff700 1 -- 172.21.15.96:0/1330450345 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1bd0101eb0 msgr2=0x7f1bd019d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:54.510 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.503+0000 7f1bd4d08700 1 --2- 172.21.15.96:0/1330450345 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1bd0101eb0 0x7f1bd019d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:54.510 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.503+0000 7f1bcffff700 1 --2- 172.21.15.96:0/1330450345 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1bd0101eb0 0x7f1bd019d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:54.510 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.503+0000 7f1bcffff700 1 -- 172.21.15.96:0/1330450345 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1bd0101520 msgr2=0x7f1bd01966b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:54.510 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.503+0000 7f1bcffff700 1 --2- 172.21.15.96:0/1330450345 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1bd0101520 0x7f1bd01966b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:54.510 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.503+0000 7f1bcffff700 1 -- 172.21.15.96:0/1330450345 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc40095f0 con 0x7f1bd0100330 2023-05-08T03:40:54.510 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.503+0000 7f1bcf7fe700 1 --2- 172.21.15.96:0/1330450345 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1bd0101520 0x7f1bd01966b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-08T03:40:54.511 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.503+0000 7f1bd4d08700 1 --2- 172.21.15.96:0/1330450345 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1bd0101eb0 0x7f1bd019d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-08T03:40:54.511 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.503+0000 7f1bcffff700 1 --2- 172.21.15.96:0/1330450345 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1bd0100330 0x7f1bd0196170 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1bc4004760 tx=0x7f1bc4009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:54.511 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.503+0000 7f1bcd7fa700 1 -- 172.21.15.96:0/1330450345 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc401d070 con 0x7f1bd0100330 2023-05-08T03:40:54.511 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.503+0000 7f1bd676b700 1 -- 172.21.15.96:0/1330450345 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bd010bd60 con 0x7f1bd0100330 2023-05-08T03:40:54.511 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.503+0000 7f1bcd7fa700 1 -- 172.21.15.96:0/1330450345 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1bc4004120 con 0x7f1bd0100330 2023-05-08T03:40:54.511 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.503+0000 7f1bcd7fa700 1 -- 172.21.15.96:0/1330450345 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc4005290 con 0x7f1bd0100330 2023-05-08T03:40:54.511 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.503+0000 7f1bd676b700 1 -- 172.21.15.96:0/1330450345 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bd010bbd0 con 0x7f1bd0100330 2023-05-08T03:40:54.511 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.504+0000 7f1bd676b700 1 -- 172.21.15.96:0/1330450345 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bd01072b0 con 0x7f1bd0100330 2023-05-08T03:40:54.512 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.505+0000 7f1bcd7fa700 1 -- 172.21.15.96:0/1330450345 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f1bc4004810 con 0x7f1bd0100330 2023-05-08T03:40:54.512 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.506+0000 7f1bcd7fa700 1 --2- 172.21.15.96:0/1330450345 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f1bb80a1150 0x7f1bb80a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:54.512 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.506+0000 7f1bcf7fe700 1 --2- 172.21.15.96:0/1330450345 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f1bb80a1150 0x7f1bb80a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:54.512 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.506+0000 7f1bcd7fa700 1 -- 172.21.15.96:0/1330450345 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f1bc40cdc40 con 0x7f1bd0100330 2023-05-08T03:40:54.513 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.506+0000 7f1bcf7fe700 1 --2- 172.21.15.96:0/1330450345 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f1bb80a1150 0x7f1bb80a3600 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1bc0005fd0 tx=0x7f1bc0005ee0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:54.513 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.509+0000 7f1bcd7fa700 1 -- 172.21.15.96:0/1330450345 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f1bc4097570 con 0x7f1bd0100330 2023-05-08T03:40:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:54 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T03:40:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:54 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/1760445768' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-05-08T03:40:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:54 smithi186 ceph-mon[126480]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-05-08T03:40:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:54 smithi186 ceph-mon[126480]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-05-08T03:40:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:54 smithi186 ceph-mon[126480]: Cluster is now healthy 2023-05-08T03:40:54.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:54 smithi186 ceph-mon[126480]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2023-05-08T03:40:54.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:54 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2023-05-08T03:40:54.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:54 smithi186 ceph-mon[126480]: daemon mds.c is now active in filesystem cephfs as rank 2 2023-05-08T03:40:54.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:54 smithi186 ceph-mon[126480]: pgmap v260: 97 pgs: 78 active+clean, 12 creating+peering, 7 unknown; 579 KiB data, 76 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 8 op/s 2023-05-08T03:40:54.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:54 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/200960017' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-05-08T03:40:54.732 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.729+0000 7f1bd676b700 1 -- 172.21.15.96:0/1330450345 --> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}) v1 -- 0x7f1bd0061a70 con 0x7f1bb80a1150 2023-05-08T03:40:54.738 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:54 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T03:40:54.738 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:54 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/1760445768' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-05-08T03:40:54.739 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:54 smithi096 ceph-mon[124666]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-05-08T03:40:54.739 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:54 smithi096 ceph-mon[124666]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-05-08T03:40:54.739 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:54 smithi096 ceph-mon[124666]: Cluster is now healthy 2023-05-08T03:40:54.739 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:54 smithi096 ceph-mon[124666]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2023-05-08T03:40:54.739 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:54 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2023-05-08T03:40:54.739 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:54 smithi096 ceph-mon[124666]: daemon mds.c is now active in filesystem cephfs as rank 2 2023-05-08T03:40:54.739 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:54 smithi096 ceph-mon[124666]: pgmap v260: 97 pgs: 78 active+clean, 12 creating+peering, 7 unknown; 579 KiB data, 76 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 8 op/s 2023-05-08T03:40:54.740 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:54 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/200960017' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-05-08T03:40:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:54 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T03:40:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:54 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/1760445768' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-05-08T03:40:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:54 smithi133 ceph-mon[125939]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-05-08T03:40:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:54 smithi133 ceph-mon[125939]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-05-08T03:40:54.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:54 smithi133 ceph-mon[125939]: Cluster is now healthy 2023-05-08T03:40:54.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:54 smithi133 ceph-mon[125939]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2023-05-08T03:40:54.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:54 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2023-05-08T03:40:54.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:54 smithi133 ceph-mon[125939]: daemon mds.c is now active in filesystem cephfs as rank 2 2023-05-08T03:40:54.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:54 smithi133 ceph-mon[125939]: pgmap v260: 97 pgs: 78 active+clean, 12 creating+peering, 7 unknown; 579 KiB data, 76 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 8 op/s 2023-05-08T03:40:54.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:54 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/200960017' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-05-08T03:40:54.774 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.771+0000 7f1bcd7fa700 1 -- 172.21.15.96:0/1330450345 <== mgr.14152 v2:172.21.15.96:6800/2748629182 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f1bd0061a70 con 0x7f1bb80a1150 2023-05-08T03:40:54.777 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.774+0000 7f1bd676b700 1 -- 172.21.15.96:0/1330450345 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f1bb80a1150 msgr2=0x7f1bb80a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:54.777 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.774+0000 7f1bd676b700 1 --2- 172.21.15.96:0/1330450345 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f1bb80a1150 0x7f1bb80a3600 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1bc0005fd0 tx=0x7f1bc0005ee0 comp rx=0 tx=0).stop 2023-05-08T03:40:54.777 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.774+0000 7f1bd676b700 1 -- 172.21.15.96:0/1330450345 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1bd0100330 msgr2=0x7f1bd0196170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:54.777 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.774+0000 7f1bd676b700 1 --2- 172.21.15.96:0/1330450345 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1bd0100330 0x7f1bd0196170 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1bc4004760 tx=0x7f1bc4009580 comp rx=0 tx=0).stop 2023-05-08T03:40:54.777 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.774+0000 7f1bd676b700 1 -- 172.21.15.96:0/1330450345 shutdown_connections 2023-05-08T03:40:54.777 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.774+0000 7f1bd676b700 1 --2- 172.21.15.96:0/1330450345 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f1bb80a1150 0x7f1bb80a3600 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:54.778 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.774+0000 7f1bd676b700 1 --2- 172.21.15.96:0/1330450345 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1bd0101eb0 0x7f1bd019d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:54.778 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.774+0000 7f1bd676b700 1 --2- 172.21.15.96:0/1330450345 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1bd0100330 0x7f1bd0196170 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:54.778 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.774+0000 7f1bd676b700 1 --2- 172.21.15.96:0/1330450345 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1bd0101520 0x7f1bd01966b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:54.778 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.774+0000 7f1bd676b700 1 -- 172.21.15.96:0/1330450345 >> 172.21.15.96:0/1330450345 conn(0x7f1bd00fb950 msgr2=0x7f1bd00fdbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:54.778 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.774+0000 7f1bd676b700 1 -- 172.21.15.96:0/1330450345 shutdown_connections 2023-05-08T03:40:54.778 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.774+0000 7f1bd676b700 1 -- 172.21.15.96:0/1330450345 wait complete. 2023-05-08T03:40:54.788 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv_0 2023-05-08T03:40:54.912 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.910+0000 7efd58e0e700 1 -- 172.21.15.96:0/2335107508 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd541036c0 msgr2=0x7efd54105aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:54.913 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.910+0000 7efd58e0e700 1 --2- 172.21.15.96:0/2335107508 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd541036c0 0x7efd54105aa0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7efd44009990 tx=0x7efd44009ca0 comp rx=0 tx=0).stop 2023-05-08T03:40:54.913 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.910+0000 7efd58e0e700 1 -- 172.21.15.96:0/2335107508 shutdown_connections 2023-05-08T03:40:54.913 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.910+0000 7efd58e0e700 1 --2- 172.21.15.96:0/2335107508 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efd54105fe0 0x7efd54108440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:54.913 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.910+0000 7efd58e0e700 1 --2- 172.21.15.96:0/2335107508 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd54100da0 0x7efd54103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:54.913 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.910+0000 7efd58e0e700 1 --2- 172.21.15.96:0/2335107508 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd541036c0 0x7efd54105aa0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:54.913 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.910+0000 7efd58e0e700 1 -- 172.21.15.96:0/2335107508 >> 172.21.15.96:0/2335107508 conn(0x7efd540fa840 msgr2=0x7efd540fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:54.914 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.910+0000 7efd58e0e700 1 -- 172.21.15.96:0/2335107508 shutdown_connections 2023-05-08T03:40:54.914 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.910+0000 7efd58e0e700 1 -- 172.21.15.96:0/2335107508 wait complete. 2023-05-08T03:40:54.915 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.910+0000 7efd58e0e700 1 Processor -- start 2023-05-08T03:40:54.916 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.911+0000 7efd58e0e700 1 -- start start 2023-05-08T03:40:54.916 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.911+0000 7efd58e0e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd54100da0 0x7efd54196090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:54.916 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.911+0000 7efd58e0e700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efd541036c0 0x7efd541965d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:54.916 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.911+0000 7efd58e0e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd54105fe0 0x7efd5419d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:54.916 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.911+0000 7efd58e0e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd5419dc10 con 0x7efd54100da0 2023-05-08T03:40:54.916 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.911+0000 7efd58e0e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd5419dd50 con 0x7efd54105fe0 2023-05-08T03:40:54.917 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.911+0000 7efd58e0e700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd5419dee0 con 0x7efd541036c0 2023-05-08T03:40:54.917 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.911+0000 7efd5259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd54100da0 0x7efd54196090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:54.917 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.911+0000 7efd5259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd54100da0 0x7efd54196090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40546/0 (socket says 172.21.15.96:40546) 2023-05-08T03:40:54.917 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.911+0000 7efd5259c700 1 -- 172.21.15.96:0/3073415223 learned_addr learned my addr 172.21.15.96:0/3073415223 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:40:54.917 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.911+0000 7efd51d9b700 1 --2- 172.21.15.96:0/3073415223 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efd541036c0 0x7efd541965d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:54.917 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.911+0000 7efd52d9d700 1 --2- 172.21.15.96:0/3073415223 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd54105fe0 0x7efd5419d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:54.917 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.911+0000 7efd5259c700 1 -- 172.21.15.96:0/3073415223 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efd541036c0 msgr2=0x7efd541965d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:54.918 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.911+0000 7efd5259c700 1 --2- 172.21.15.96:0/3073415223 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efd541036c0 0x7efd541965d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:54.918 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.911+0000 7efd5259c700 1 -- 172.21.15.96:0/3073415223 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd54105fe0 msgr2=0x7efd5419d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:54.918 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.911+0000 7efd5259c700 1 --2- 172.21.15.96:0/3073415223 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd54105fe0 0x7efd5419d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:54.918 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.911+0000 7efd5259c700 1 -- 172.21.15.96:0/3073415223 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd440095f0 con 0x7efd54100da0 2023-05-08T03:40:54.918 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.911+0000 7efd5259c700 1 --2- 172.21.15.96:0/3073415223 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd54100da0 0x7efd54196090 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7efd4800c920 tx=0x7efd4800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:54.918 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.911+0000 7efd437fe700 1 -- 172.21.15.96:0/3073415223 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd48007b00 con 0x7efd54100da0 2023-05-08T03:40:54.918 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.911+0000 7efd58e0e700 1 -- 172.21.15.96:0/3073415223 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd5410bcb0 con 0x7efd54100da0 2023-05-08T03:40:54.918 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.911+0000 7efd437fe700 1 -- 172.21.15.96:0/3073415223 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efd48004cf0 con 0x7efd54100da0 2023-05-08T03:40:54.919 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.911+0000 7efd437fe700 1 -- 172.21.15.96:0/3073415223 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd48005520 con 0x7efd54100da0 2023-05-08T03:40:54.919 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.912+0000 7efd58e0e700 1 -- 172.21.15.96:0/3073415223 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd5410bb20 con 0x7efd54100da0 2023-05-08T03:40:54.919 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.913+0000 7efd58e0e700 1 -- 172.21.15.96:0/3073415223 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd540fc3b0 con 0x7efd54100da0 2023-05-08T03:40:54.919 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.913+0000 7efd437fe700 1 -- 172.21.15.96:0/3073415223 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7efd48004750 con 0x7efd54100da0 2023-05-08T03:40:54.920 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.914+0000 7efd437fe700 1 --2- 172.21.15.96:0/3073415223 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7efd3c0a1150 0x7efd3c0a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:54.920 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.914+0000 7efd51d9b700 1 --2- 172.21.15.96:0/3073415223 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7efd3c0a1150 0x7efd3c0a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:54.920 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.914+0000 7efd437fe700 1 -- 172.21.15.96:0/3073415223 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7efd480cc160 con 0x7efd54100da0 2023-05-08T03:40:54.920 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.914+0000 7efd51d9b700 1 --2- 172.21.15.96:0/3073415223 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7efd3c0a1150 0x7efd3c0a3600 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7efd44006010 tx=0x7efd4400b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:54.921 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:54.918+0000 7efd437fe700 1 -- 172.21.15.96:0/3073415223 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7efd48095a00 con 0x7efd54100da0 2023-05-08T03:40:55.005 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:40:54 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:40:54.734+0000 7fbe671c1700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-08T03:40:55.005 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:40:54 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:40:54.734+0000 7fbe671c1700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-08T03:40:55.006 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:40:54 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:40:54.734+0000 7fbe671c1700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-08T03:40:55.006 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:40:54 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:40:54.734+0000 7fbe671c1700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-08T03:40:55.006 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:40:54 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:40:54.734+0000 7fbe671c1700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-08T03:40:55.142 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.140+0000 7efd58e0e700 1 -- 172.21.15.96:0/3073415223 --> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) v1 -- 0x7efd54061b50 con 0x7efd3c0a1150 2023-05-08T03:40:55.147 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.144+0000 7efd437fe700 1 -- 172.21.15.96:0/3073415223 <== mgr.14152 v2:172.21.15.96:6800/2748629182 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+60 (secure 0 0 0) 0x7efd54061b50 con 0x7efd3c0a1150 2023-05-08T03:40:55.147 INFO:teuthology.orchestra.run.smithi096.stdout:/volumes/_nogroup/sv_0/67162bb2-1408-46f3-8d0d-c57170b2cd41 2023-05-08T03:40:55.149 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.147+0000 7efd58e0e700 1 -- 172.21.15.96:0/3073415223 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7efd3c0a1150 msgr2=0x7efd3c0a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:55.149 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.147+0000 7efd58e0e700 1 --2- 172.21.15.96:0/3073415223 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7efd3c0a1150 0x7efd3c0a3600 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7efd44006010 tx=0x7efd4400b540 comp rx=0 tx=0).stop 2023-05-08T03:40:55.149 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.147+0000 7efd58e0e700 1 -- 172.21.15.96:0/3073415223 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd54100da0 msgr2=0x7efd54196090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:55.150 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.147+0000 7efd58e0e700 1 --2- 172.21.15.96:0/3073415223 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd54100da0 0x7efd54196090 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7efd4800c920 tx=0x7efd4800cce0 comp rx=0 tx=0).stop 2023-05-08T03:40:55.150 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.147+0000 7efd58e0e700 1 -- 172.21.15.96:0/3073415223 shutdown_connections 2023-05-08T03:40:55.150 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.147+0000 7efd58e0e700 1 --2- 172.21.15.96:0/3073415223 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7efd3c0a1150 0x7efd3c0a3600 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:55.150 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.147+0000 7efd58e0e700 1 --2- 172.21.15.96:0/3073415223 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd54105fe0 0x7efd5419d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:55.150 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.147+0000 7efd58e0e700 1 --2- 172.21.15.96:0/3073415223 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd54100da0 0x7efd54196090 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:55.150 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.147+0000 7efd58e0e700 1 --2- 172.21.15.96:0/3073415223 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efd541036c0 0x7efd541965d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:55.150 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.147+0000 7efd58e0e700 1 -- 172.21.15.96:0/3073415223 >> 172.21.15.96:0/3073415223 conn(0x7efd540fa840 msgr2=0x7efd54101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:55.150 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.147+0000 7efd58e0e700 1 -- 172.21.15.96:0/3073415223 shutdown_connections 2023-05-08T03:40:55.151 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.147+0000 7efd58e0e700 1 -- 172.21.15.96:0/3073415223 wait complete. 2023-05-08T03:40:55.161 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_1 '' 2023-05-08T03:40:55.286 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.283+0000 7fdf20bf9700 1 -- 172.21.15.96:0/3476503333 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf1c0ffe00 msgr2=0x7fdf1c1076b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:55.286 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.283+0000 7fdf20bf9700 1 --2- 172.21.15.96:0/3476503333 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf1c0ffe00 0x7fdf1c1076b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fdf1400b0a0 tx=0x7fdf1400b3b0 comp rx=0 tx=0).stop 2023-05-08T03:40:55.286 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.283+0000 7fdf20bf9700 1 -- 172.21.15.96:0/3476503333 shutdown_connections 2023-05-08T03:40:55.287 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.283+0000 7fdf20bf9700 1 --2- 172.21.15.96:0/3476503333 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf1c0ffe00 0x7fdf1c1076b0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:55.287 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.283+0000 7fdf20bf9700 1 --2- 172.21.15.96:0/3476503333 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdf1c100890 0x7fdf1c100ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:55.287 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.283+0000 7fdf20bf9700 1 --2- 172.21.15.96:0/3476503333 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf1c0ff450 0x7fdf1c0ff8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:55.287 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.283+0000 7fdf20bf9700 1 -- 172.21.15.96:0/3476503333 >> 172.21.15.96:0/3476503333 conn(0x7fdf1c0f9fd0 msgr2=0x7fdf1c0fc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:55.287 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.283+0000 7fdf20bf9700 1 -- 172.21.15.96:0/3476503333 shutdown_connections 2023-05-08T03:40:55.287 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.283+0000 7fdf20bf9700 1 -- 172.21.15.96:0/3476503333 wait complete. 2023-05-08T03:40:55.289 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.284+0000 7fdf20bf9700 1 Processor -- start 2023-05-08T03:40:55.289 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.284+0000 7fdf20bf9700 1 -- start start 2023-05-08T03:40:55.289 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.284+0000 7fdf20bf9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf1c0ff450 0x7fdf1c0feeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:55.290 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.284+0000 7fdf20bf9700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdf1c0ffe00 0x7fdf1c19af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:55.290 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.284+0000 7fdf20bf9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf1c100890 0x7fdf1c19d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:55.290 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.284+0000 7fdf20bf9700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1c19dd20 con 0x7fdf1c0ff450 2023-05-08T03:40:55.290 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.284+0000 7fdf20bf9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1c19de90 con 0x7fdf1c100890 2023-05-08T03:40:55.290 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.284+0000 7fdf20bf9700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1c19e050 con 0x7fdf1c0ffe00 2023-05-08T03:40:55.290 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.284+0000 7fdf1a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf1c0ff450 0x7fdf1c0feeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:55.290 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.284+0000 7fdf1a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf1c0ff450 0x7fdf1c0feeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40560/0 (socket says 172.21.15.96:40560) 2023-05-08T03:40:55.290 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.284+0000 7fdf1a59c700 1 -- 172.21.15.96:0/2541335894 learned_addr learned my addr 172.21.15.96:0/2541335894 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:40:55.291 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.285+0000 7fdf19d9b700 1 --2- 172.21.15.96:0/2541335894 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdf1c0ffe00 0x7fdf1c19af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:55.291 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.285+0000 7fdf1ad9d700 1 --2- 172.21.15.96:0/2541335894 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf1c100890 0x7fdf1c19d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:55.291 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.285+0000 7fdf1a59c700 1 -- 172.21.15.96:0/2541335894 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdf1c0ffe00 msgr2=0x7fdf1c19af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:55.291 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.285+0000 7fdf1a59c700 1 --2- 172.21.15.96:0/2541335894 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdf1c0ffe00 0x7fdf1c19af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:55.291 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.285+0000 7fdf1a59c700 1 -- 172.21.15.96:0/2541335894 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf1c100890 msgr2=0x7fdf1c19d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:55.291 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.285+0000 7fdf1a59c700 1 --2- 172.21.15.96:0/2541335894 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf1c100890 0x7fdf1c19d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:55.291 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.285+0000 7fdf1a59c700 1 -- 172.21.15.96:0/2541335894 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf14009d00 con 0x7fdf1c0ff450 2023-05-08T03:40:55.292 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.285+0000 7fdf1ad9d700 1 --2- 172.21.15.96:0/2541335894 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf1c100890 0x7fdf1c19d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-08T03:40:55.292 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.285+0000 7fdf1a59c700 1 --2- 172.21.15.96:0/2541335894 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf1c0ff450 0x7fdf1c0feeb0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c00c920 tx=0x7fdf0c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:55.292 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.285+0000 7fdf137fe700 1 -- 172.21.15.96:0/2541335894 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf0c007b00 con 0x7fdf1c0ff450 2023-05-08T03:40:55.292 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.285+0000 7fdf137fe700 1 -- 172.21.15.96:0/2541335894 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdf0c004cf0 con 0x7fdf1c0ff450 2023-05-08T03:40:55.292 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.285+0000 7fdf20bf9700 1 -- 172.21.15.96:0/2541335894 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf1c10ac60 con 0x7fdf1c0ff450 2023-05-08T03:40:55.292 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.285+0000 7fdf137fe700 1 -- 172.21.15.96:0/2541335894 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf0c005610 con 0x7fdf1c0ff450 2023-05-08T03:40:55.293 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.285+0000 7fdf20bf9700 1 -- 172.21.15.96:0/2541335894 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf1c10aad0 con 0x7fdf1c0ff450 2023-05-08T03:40:55.293 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.286+0000 7fdf20bf9700 1 -- 172.21.15.96:0/2541335894 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf1c106760 con 0x7fdf1c0ff450 2023-05-08T03:40:55.293 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.287+0000 7fdf137fe700 1 -- 172.21.15.96:0/2541335894 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fdf0c004750 con 0x7fdf1c0ff450 2023-05-08T03:40:55.293 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.287+0000 7fdf137fe700 1 --2- 172.21.15.96:0/2541335894 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fdf080a1150 0x7fdf080a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:55.294 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.288+0000 7fdf19d9b700 1 --2- 172.21.15.96:0/2541335894 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fdf080a1150 0x7fdf080a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:55.294 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.288+0000 7fdf137fe700 1 -- 172.21.15.96:0/2541335894 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fdf0c0cc7d0 con 0x7fdf1c0ff450 2023-05-08T03:40:55.294 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.288+0000 7fdf19d9b700 1 --2- 172.21.15.96:0/2541335894 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fdf080a1150 0x7fdf080a3600 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fdf04005950 tx=0x7fdf040058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:55.294 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.291+0000 7fdf137fe700 1 -- 172.21.15.96:0/2541335894 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fdf0c096070 con 0x7fdf1c0ff450 2023-05-08T03:40:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:55 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T03:40:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:55 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/200960017' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-05-08T03:40:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:55 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2023-05-08T03:40:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:55 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:40:55.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:55 smithi096 ceph-mon[124666]: from='client.14727 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:40:55.513 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.510+0000 7fdf20bf9700 1 -- 172.21.15.96:0/2541335894 --> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}) v1 -- 0x7fdf1c061d70 con 0x7fdf080a1150 2023-05-08T03:40:55.537 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.534+0000 7fdf137fe700 1 -- 172.21.15.96:0/2541335894 <== mgr.14152 v2:172.21.15.96:6800/2748629182 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fdf1c061d70 con 0x7fdf080a1150 2023-05-08T03:40:55.539 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.537+0000 7fdf20bf9700 1 -- 172.21.15.96:0/2541335894 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fdf080a1150 msgr2=0x7fdf080a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:55.540 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.537+0000 7fdf20bf9700 1 --2- 172.21.15.96:0/2541335894 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fdf080a1150 0x7fdf080a3600 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fdf04005950 tx=0x7fdf040058e0 comp rx=0 tx=0).stop 2023-05-08T03:40:55.540 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.537+0000 7fdf20bf9700 1 -- 172.21.15.96:0/2541335894 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf1c0ff450 msgr2=0x7fdf1c0feeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:55.540 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.537+0000 7fdf20bf9700 1 --2- 172.21.15.96:0/2541335894 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf1c0ff450 0x7fdf1c0feeb0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c00c920 tx=0x7fdf0c00cce0 comp rx=0 tx=0).stop 2023-05-08T03:40:55.540 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.537+0000 7fdf20bf9700 1 -- 172.21.15.96:0/2541335894 shutdown_connections 2023-05-08T03:40:55.540 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.537+0000 7fdf20bf9700 1 --2- 172.21.15.96:0/2541335894 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fdf080a1150 0x7fdf080a3600 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:55.540 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.537+0000 7fdf20bf9700 1 --2- 172.21.15.96:0/2541335894 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf1c100890 0x7fdf1c19d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:55.541 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.537+0000 7fdf20bf9700 1 --2- 172.21.15.96:0/2541335894 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf1c0ff450 0x7fdf1c0feeb0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:55.541 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.537+0000 7fdf20bf9700 1 --2- 172.21.15.96:0/2541335894 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdf1c0ffe00 0x7fdf1c19af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:55.541 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.537+0000 7fdf20bf9700 1 -- 172.21.15.96:0/2541335894 >> 172.21.15.96:0/2541335894 conn(0x7fdf1c0f9fd0 msgr2=0x7fdf1c1038a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:55.541 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.537+0000 7fdf20bf9700 1 -- 172.21.15.96:0/2541335894 shutdown_connections 2023-05-08T03:40:55.541 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.537+0000 7fdf20bf9700 1 -- 172.21.15.96:0/2541335894 wait complete. 2023-05-08T03:40:55.551 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv_1 2023-05-08T03:40:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:55 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T03:40:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:55 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/200960017' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-05-08T03:40:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:55 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2023-05-08T03:40:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:55 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:40:55.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:55 smithi186 ceph-mon[126480]: from='client.14727 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:40:55.677 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.673+0000 7f8ed81e5700 1 -- 172.21.15.96:0/511739835 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ed0103720 msgr2=0x7f8ed0105b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:55.678 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.673+0000 7f8ed81e5700 1 --2- 172.21.15.96:0/511739835 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ed0103720 0x7f8ed0105b00 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8ec0009990 tx=0x7f8ec0009ca0 comp rx=0 tx=0).stop 2023-05-08T03:40:55.678 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.673+0000 7f8ed81e5700 1 -- 172.21.15.96:0/511739835 shutdown_connections 2023-05-08T03:40:55.678 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.673+0000 7f8ed81e5700 1 --2- 172.21.15.96:0/511739835 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ed0106040 0x7f8ed0108440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:55.678 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.673+0000 7f8ed81e5700 1 --2- 172.21.15.96:0/511739835 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8ed0100e00 0x7f8ed01031e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:55.678 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.674+0000 7f8ed81e5700 1 --2- 172.21.15.96:0/511739835 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ed0103720 0x7f8ed0105b00 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:55.679 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.674+0000 7f8ed81e5700 1 -- 172.21.15.96:0/511739835 >> 172.21.15.96:0/511739835 conn(0x7f8ed00fa840 msgr2=0x7f8ed00fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:55.679 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.674+0000 7f8ed81e5700 1 -- 172.21.15.96:0/511739835 shutdown_connections 2023-05-08T03:40:55.679 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.674+0000 7f8ed81e5700 1 -- 172.21.15.96:0/511739835 wait complete. 2023-05-08T03:40:55.679 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.674+0000 7f8ed81e5700 1 Processor -- start 2023-05-08T03:40:55.679 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.674+0000 7f8ed81e5700 1 -- start start 2023-05-08T03:40:55.679 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.674+0000 7f8ed81e5700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8ed0100e00 0x7f8ed0196000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:55.679 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.674+0000 7f8ed81e5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ed0103720 0x7f8ed0196540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:55.680 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.674+0000 7f8ed81e5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ed0106040 0x7f8ed019d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:55.680 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.674+0000 7f8ed81e5700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed019db80 con 0x7f8ed0106040 2023-05-08T03:40:55.680 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.674+0000 7f8ed81e5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed019dcc0 con 0x7f8ed0103720 2023-05-08T03:40:55.680 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.674+0000 7f8ed81e5700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed019de50 con 0x7f8ed0100e00 2023-05-08T03:40:55.680 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.674+0000 7f8ed6782700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ed0106040 0x7f8ed019d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:55.680 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.675+0000 7f8ed6782700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ed0106040 0x7f8ed019d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40578/0 (socket says 172.21.15.96:40578) 2023-05-08T03:40:55.680 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.675+0000 7f8ed6782700 1 -- 172.21.15.96:0/3949301741 learned_addr learned my addr 172.21.15.96:0/3949301741 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:40:55.680 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.675+0000 7f8ed5780700 1 --2- 172.21.15.96:0/3949301741 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ed0103720 0x7f8ed0196540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:55.681 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.675+0000 7f8ed5f81700 1 --2- 172.21.15.96:0/3949301741 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8ed0100e00 0x7f8ed0196000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:55.681 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.675+0000 7f8ed6782700 1 -- 172.21.15.96:0/3949301741 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8ed0100e00 msgr2=0x7f8ed0196000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:55.681 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.675+0000 7f8ed6782700 1 --2- 172.21.15.96:0/3949301741 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8ed0100e00 0x7f8ed0196000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:55.681 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.675+0000 7f8ed6782700 1 -- 172.21.15.96:0/3949301741 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ed0103720 msgr2=0x7f8ed0196540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:55.681 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.675+0000 7f8ed6782700 1 --2- 172.21.15.96:0/3949301741 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ed0103720 0x7f8ed0196540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:55.681 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.675+0000 7f8ed6782700 1 -- 172.21.15.96:0/3949301741 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec00095f0 con 0x7f8ed0106040 2023-05-08T03:40:55.681 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.675+0000 7f8ed6782700 1 --2- 172.21.15.96:0/3949301741 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ed0106040 0x7f8ed019d5b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8ec8007ee0 tx=0x7f8ec800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:55.682 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.675+0000 7f8ec6ffd700 1 -- 172.21.15.96:0/3949301741 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec800dd20 con 0x7f8ed0106040 2023-05-08T03:40:55.682 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.675+0000 7f8ec6ffd700 1 -- 172.21.15.96:0/3949301741 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8ec800f040 con 0x7f8ed0106040 2023-05-08T03:40:55.682 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.675+0000 7f8ed81e5700 1 -- 172.21.15.96:0/3949301741 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ed010bce0 con 0x7f8ed0106040 2023-05-08T03:40:55.682 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.675+0000 7f8ec6ffd700 1 -- 172.21.15.96:0/3949301741 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec80048a0 con 0x7f8ed0106040 2023-05-08T03:40:55.683 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.675+0000 7f8ed81e5700 1 -- 172.21.15.96:0/3949301741 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ed010bb50 con 0x7f8ed0106040 2023-05-08T03:40:55.683 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.676+0000 7f8ed81e5700 1 -- 172.21.15.96:0/3949301741 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ed00fc3b0 con 0x7f8ed0106040 2023-05-08T03:40:55.683 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.677+0000 7f8ec6ffd700 1 -- 172.21.15.96:0/3949301741 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f8ec8003a00 con 0x7f8ed0106040 2023-05-08T03:40:55.683 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.678+0000 7f8ec6ffd700 1 --2- 172.21.15.96:0/3949301741 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f8ebc0a1150 0x7f8ebc0a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:55.684 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.678+0000 7f8ed5f81700 1 --2- 172.21.15.96:0/3949301741 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f8ebc0a1150 0x7f8ebc0a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:55.684 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.678+0000 7f8ec6ffd700 1 -- 172.21.15.96:0/3949301741 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f8ec80cc020 con 0x7f8ed0106040 2023-05-08T03:40:55.684 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.678+0000 7f8ed5f81700 1 --2- 172.21.15.96:0/3949301741 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f8ebc0a1150 0x7f8ebc0a3600 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc00ac50 tx=0x7f8ecc00a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:55.685 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.682+0000 7f8ec6ffd700 1 -- 172.21.15.96:0/3949301741 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f8ec804e730 con 0x7f8ed0106040 2023-05-08T03:40:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:55 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T03:40:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:55 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/200960017' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-05-08T03:40:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:55 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2023-05-08T03:40:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:55 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:40:55.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:55 smithi133 ceph-mon[125939]: from='client.14727 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:40:55.908 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.906+0000 7f8ed81e5700 1 -- 172.21.15.96:0/3949301741 --> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f8ed0061d90 con 0x7f8ebc0a1150 2023-05-08T03:40:55.912 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.909+0000 7f8ec6ffd700 1 -- 172.21.15.96:0/3949301741 <== mgr.14152 v2:172.21.15.96:6800/2748629182 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+60 (secure 0 0 0) 0x7f8ed0061d90 con 0x7f8ebc0a1150 2023-05-08T03:40:55.912 INFO:teuthology.orchestra.run.smithi096.stdout:/volumes/_nogroup/sv_1/7dade95a-6e77-415d-96f3-d57b5eaa857b 2023-05-08T03:40:55.914 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.911+0000 7f8ed81e5700 1 -- 172.21.15.96:0/3949301741 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f8ebc0a1150 msgr2=0x7f8ebc0a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:55.914 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.911+0000 7f8ed81e5700 1 --2- 172.21.15.96:0/3949301741 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f8ebc0a1150 0x7f8ebc0a3600 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc00ac50 tx=0x7f8ecc00a380 comp rx=0 tx=0).stop 2023-05-08T03:40:55.914 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.911+0000 7f8ed81e5700 1 -- 172.21.15.96:0/3949301741 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ed0106040 msgr2=0x7f8ed019d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:55.914 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.911+0000 7f8ed81e5700 1 --2- 172.21.15.96:0/3949301741 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ed0106040 0x7f8ed019d5b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8ec8007ee0 tx=0x7f8ec800d3b0 comp rx=0 tx=0).stop 2023-05-08T03:40:55.915 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.911+0000 7f8ed81e5700 1 -- 172.21.15.96:0/3949301741 shutdown_connections 2023-05-08T03:40:55.915 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.911+0000 7f8ed81e5700 1 --2- 172.21.15.96:0/3949301741 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f8ebc0a1150 0x7f8ebc0a3600 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:55.915 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.911+0000 7f8ed81e5700 1 --2- 172.21.15.96:0/3949301741 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ed0106040 0x7f8ed019d5b0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:55.915 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.911+0000 7f8ed81e5700 1 --2- 172.21.15.96:0/3949301741 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8ed0100e00 0x7f8ed0196000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:55.915 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.911+0000 7f8ed81e5700 1 --2- 172.21.15.96:0/3949301741 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ed0103720 0x7f8ed0196540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:55.915 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.911+0000 7f8ed81e5700 1 -- 172.21.15.96:0/3949301741 >> 172.21.15.96:0/3949301741 conn(0x7f8ed00fa840 msgr2=0x7f8ed0101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:55.915 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.912+0000 7f8ed81e5700 1 -- 172.21.15.96:0/3949301741 shutdown_connections 2023-05-08T03:40:55.916 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:55.912+0000 7f8ed81e5700 1 -- 172.21.15.96:0/3949301741 wait complete. 2023-05-08T03:40:55.926 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-08T03:40:56.046 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.043+0000 7f6178451700 1 -- 172.21.15.96:0/3005635504 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61700ff460 msgr2=0x7f61700ff8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:56.046 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.043+0000 7f6178451700 1 --2- 172.21.15.96:0/3005635504 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61700ff460 0x7f61700ff8d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f616c009990 tx=0x7f616c009ca0 comp rx=0 tx=0).stop 2023-05-08T03:40:56.047 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.043+0000 7f6178451700 1 -- 172.21.15.96:0/3005635504 shutdown_connections 2023-05-08T03:40:56.047 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.043+0000 7f6178451700 1 --2- 172.21.15.96:0/3005635504 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f61700ffe10 0x7f61701076c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:56.047 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.043+0000 7f6178451700 1 --2- 172.21.15.96:0/3005635504 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61701008a0 0x7f6170100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:56.047 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.043+0000 7f6178451700 1 --2- 172.21.15.96:0/3005635504 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61700ff460 0x7f61700ff8d0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:56.047 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.044+0000 7f6178451700 1 -- 172.21.15.96:0/3005635504 >> 172.21.15.96:0/3005635504 conn(0x7f61700f9f80 msgr2=0x7f61700fc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:56.047 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.044+0000 7f6178451700 1 -- 172.21.15.96:0/3005635504 shutdown_connections 2023-05-08T03:40:56.048 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.044+0000 7f6178451700 1 -- 172.21.15.96:0/3005635504 wait complete. 2023-05-08T03:40:56.050 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.044+0000 7f6178451700 1 Processor -- start 2023-05-08T03:40:56.050 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.044+0000 7f6178451700 1 -- start start 2023-05-08T03:40:56.050 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.044+0000 7f6178451700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61700ff460 0x7f6170194f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:56.050 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.044+0000 7f6178451700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f61700ffe10 0x7f61701954c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:56.050 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.044+0000 7f6178451700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61701008a0 0x7f617019c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:56.051 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.044+0000 7f6178451700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617019cb00 con 0x7f61701008a0 2023-05-08T03:40:56.051 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.044+0000 7f6178451700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617019cc40 con 0x7f61700ff460 2023-05-08T03:40:56.051 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.044+0000 7f6178451700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617019cdd0 con 0x7f61700ffe10 2023-05-08T03:40:56.051 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.044+0000 7f61769ee700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61701008a0 0x7f617019c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:56.052 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.044+0000 7f61769ee700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61701008a0 0x7f617019c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40592/0 (socket says 172.21.15.96:40592) 2023-05-08T03:40:56.052 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.044+0000 7f61769ee700 1 -- 172.21.15.96:0/2435107124 learned_addr learned my addr 172.21.15.96:0/2435107124 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:40:56.052 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.044+0000 7f61761ed700 1 --2- 172.21.15.96:0/2435107124 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61700ff460 0x7f6170194f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:56.052 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.045+0000 7f61759ec700 1 --2- 172.21.15.96:0/2435107124 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f61700ffe10 0x7f61701954c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:56.052 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.045+0000 7f61769ee700 1 -- 172.21.15.96:0/2435107124 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f61700ffe10 msgr2=0x7f61701954c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:56.053 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.045+0000 7f61769ee700 1 --2- 172.21.15.96:0/2435107124 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f61700ffe10 0x7f61701954c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:56.053 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.045+0000 7f61769ee700 1 -- 172.21.15.96:0/2435107124 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61700ff460 msgr2=0x7f6170194f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:56.053 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.045+0000 7f61769ee700 1 --2- 172.21.15.96:0/2435107124 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61700ff460 0x7f6170194f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:56.053 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.045+0000 7f61769ee700 1 -- 172.21.15.96:0/2435107124 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f616c0095f0 con 0x7f61701008a0 2023-05-08T03:40:56.053 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.045+0000 7f61759ec700 1 --2- 172.21.15.96:0/2435107124 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f61700ffe10 0x7f61701954c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-08T03:40:56.053 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.045+0000 7f61761ed700 1 --2- 172.21.15.96:0/2435107124 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61700ff460 0x7f6170194f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-08T03:40:56.053 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.045+0000 7f61769ee700 1 --2- 172.21.15.96:0/2435107124 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61701008a0 0x7f617019c530 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f6168007ee0 tx=0x7f616800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:56.054 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.045+0000 7f61677fe700 1 -- 172.21.15.96:0/2435107124 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6168017070 con 0x7f61701008a0 2023-05-08T03:40:56.054 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.045+0000 7f61677fe700 1 -- 172.21.15.96:0/2435107124 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f616800f040 con 0x7f61701008a0 2023-05-08T03:40:56.054 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.045+0000 7f6178451700 1 -- 172.21.15.96:0/2435107124 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f617010abf0 con 0x7f61701008a0 2023-05-08T03:40:56.054 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.045+0000 7f61677fe700 1 -- 172.21.15.96:0/2435107124 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6168005740 con 0x7f61701008a0 2023-05-08T03:40:56.054 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.045+0000 7f6178451700 1 -- 172.21.15.96:0/2435107124 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f617010aa60 con 0x7f61701008a0 2023-05-08T03:40:56.054 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.046+0000 7f6178451700 1 -- 172.21.15.96:0/2435107124 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6170067260 con 0x7f61701008a0 2023-05-08T03:40:56.054 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.047+0000 7f61677fe700 1 -- 172.21.15.96:0/2435107124 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f616800dc60 con 0x7f61701008a0 2023-05-08T03:40:56.054 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.048+0000 7f61677fe700 1 --2- 172.21.15.96:0/2435107124 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f615c0a1150 0x7f615c0a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:56.055 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.048+0000 7f61761ed700 1 --2- 172.21.15.96:0/2435107124 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f615c0a1150 0x7f615c0a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:56.055 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.048+0000 7f61677fe700 1 -- 172.21.15.96:0/2435107124 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f61680cc610 con 0x7f61701008a0 2023-05-08T03:40:56.055 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.048+0000 7f61761ed700 1 --2- 172.21.15.96:0/2435107124 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f615c0a1150 0x7f615c0a3600 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6160007fd0 tx=0x7f61600073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:56.056 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.051+0000 7f61677fe700 1 -- 172.21.15.96:0/2435107124 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f6168095eb0 con 0x7f61701008a0 2023-05-08T03:40:56.287 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.285+0000 7f6178451700 1 -- 172.21.15.96:0/2435107124 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6170106180 con 0x7f61701008a0 2023-05-08T03:40:56.288 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.286+0000 7f61677fe700 1 -- 172.21.15.96:0/2435107124 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+10813 (secure 0 0 0) 0x7f61680994d0 con 0x7f61701008a0 2023-05-08T03:40:56.288 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:40:56.289 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6835/1518512221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":1518512221},{"type":"v1","addr":"172.21.15.96:6835","nonce":1518512221}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6837/305967678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6836","nonce":305967678},{"type":"v1","addr":"172.21.15.96:6837","nonce":305967678}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14622,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6839/2596991665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6838","nonce":2596991665},{"type":"v1","addr":"172.21.15.96:6839","nonce":2596991665}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6841/1786091200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6840","nonce":1786091200},{"type":"v1","addr":"172.21.15.96:6841","nonce":1786091200}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/2351258784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":2351258784},{"type":"v1","addr":"172.21.15.133:6833","nonce":2351258784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/2274306880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":2274306880},{"type":"v1","addr":"172.21.15.186:6833","nonce":2274306880}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-05-08T03:40:49.210143+0000","modified":"2023-05-08T03:40:54.356833+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24494,"mds_1":24487,"mds_2":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24437":{"gid":24437,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6835/1735118966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1735118966},{"type":"v1","addr":"172.21.15.133:6835","nonce":1735118966}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6835/3984391904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":3984391904},{"type":"v1","addr":"172.21.15.186:6835","nonce":3984391904}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24461":{"gid":24461,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6837/2218851414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":2218851414},{"type":"v1","addr":"172.21.15.133:6837","nonce":2218851414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24472":{"gid":24472,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.186:6837/1556405826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":1556405826},{"type":"v1","addr":"172.21.15.186:6837","nonce":1556405826}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":5,"addr":"172.21.15.186:6839/1267655485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":1267655485},{"type":"v1","addr":"172.21.15.186:6839","nonce":1267655485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6839/2246041493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6838","nonce":2246041493},{"type":"v1","addr":"172.21.15.133:6839","nonce":2246041493}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-08T03:40:56.290 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.288+0000 7f6178451700 1 -- 172.21.15.96:0/2435107124 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f615c0a1150 msgr2=0x7f615c0a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:56.290 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.288+0000 7f6178451700 1 --2- 172.21.15.96:0/2435107124 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f615c0a1150 0x7f615c0a3600 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6160007fd0 tx=0x7f61600073d0 comp rx=0 tx=0).stop 2023-05-08T03:40:56.290 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.288+0000 7f6178451700 1 -- 172.21.15.96:0/2435107124 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61701008a0 msgr2=0x7f617019c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:56.291 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.288+0000 7f6178451700 1 --2- 172.21.15.96:0/2435107124 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61701008a0 0x7f617019c530 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f6168007ee0 tx=0x7f616800d3b0 comp rx=0 tx=0).stop 2023-05-08T03:40:56.291 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.288+0000 7f6178451700 1 -- 172.21.15.96:0/2435107124 shutdown_connections 2023-05-08T03:40:56.291 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.288+0000 7f6178451700 1 --2- 172.21.15.96:0/2435107124 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f615c0a1150 0x7f615c0a3600 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:56.291 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.288+0000 7f6178451700 1 --2- 172.21.15.96:0/2435107124 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61701008a0 0x7f617019c530 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:56.291 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.288+0000 7f6178451700 1 --2- 172.21.15.96:0/2435107124 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61700ff460 0x7f6170194f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:56.291 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.288+0000 7f6178451700 1 --2- 172.21.15.96:0/2435107124 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f61700ffe10 0x7f61701954c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:56.291 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.288+0000 7f6178451700 1 -- 172.21.15.96:0/2435107124 >> 172.21.15.96:0/2435107124 conn(0x7f61700f9f80 msgr2=0x7f61700fc210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:56.292 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.288+0000 7f6178451700 1 -- 172.21.15.96:0/2435107124 shutdown_connections 2023-05-08T03:40:56.292 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.288+0000 7f6178451700 1 -- 172.21.15.96:0/2435107124 wait complete. 2023-05-08T03:40:56.292 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 22 2023-05-08T03:40:56.302 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-08T03:40:56.430 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.427+0000 7efe72e60700 1 -- 172.21.15.96:0/1369551592 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe6c100360 msgr2=0x7efe6c100770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:56.430 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.427+0000 7efe72e60700 1 --2- 172.21.15.96:0/1369551592 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe6c100360 0x7efe6c100770 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7efe6400b0a0 tx=0x7efe6400b3b0 comp rx=0 tx=0).stop 2023-05-08T03:40:56.430 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.427+0000 7efe72e60700 1 -- 172.21.15.96:0/1369551592 shutdown_connections 2023-05-08T03:40:56.430 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.427+0000 7efe72e60700 1 --2- 172.21.15.96:0/1369551592 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efe6c101ee0 0x7efe6c1087a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:56.430 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.427+0000 7efe72e60700 1 --2- 172.21.15.96:0/1369551592 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe6c100360 0x7efe6c100770 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:56.430 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.427+0000 7efe72e60700 1 --2- 172.21.15.96:0/1369551592 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe6c101550 0x7efe6c1019a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:56.431 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.427+0000 7efe72e60700 1 -- 172.21.15.96:0/1369551592 >> 172.21.15.96:0/1369551592 conn(0x7efe6c0fb980 msgr2=0x7efe6c0fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:56.431 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.427+0000 7efe72e60700 1 -- 172.21.15.96:0/1369551592 shutdown_connections 2023-05-08T03:40:56.431 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.427+0000 7efe72e60700 1 -- 172.21.15.96:0/1369551592 wait complete. 2023-05-08T03:40:56.431 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.427+0000 7efe72e60700 1 Processor -- start 2023-05-08T03:40:56.431 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.428+0000 7efe72e60700 1 -- start start 2023-05-08T03:40:56.433 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.428+0000 7efe72e60700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe6c100360 0x7efe6c196210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:56.433 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.428+0000 7efe72e60700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efe6c101550 0x7efe6c196750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:56.433 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.428+0000 7efe72e60700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe6c101ee0 0x7efe6c19d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:56.433 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.428+0000 7efe72e60700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe6c19dd90 con 0x7efe6c100360 2023-05-08T03:40:56.433 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.428+0000 7efe72e60700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe6c19ded0 con 0x7efe6c101ee0 2023-05-08T03:40:56.433 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.428+0000 7efe72e60700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe6c19e060 con 0x7efe6c101550 2023-05-08T03:40:56.434 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.428+0000 7efe70bfc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe6c100360 0x7efe6c196210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:56.434 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.428+0000 7efe70bfc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe6c100360 0x7efe6c196210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40602/0 (socket says 172.21.15.96:40602) 2023-05-08T03:40:56.434 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.428+0000 7efe70bfc700 1 -- 172.21.15.96:0/1388656217 learned_addr learned my addr 172.21.15.96:0/1388656217 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:40:56.434 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.428+0000 7efe70bfc700 1 -- 172.21.15.96:0/1388656217 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efe6c101550 msgr2=0x7efe6c196750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:56.434 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.428+0000 7efe70bfc700 1 --2- 172.21.15.96:0/1388656217 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efe6c101550 0x7efe6c196750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:56.434 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.428+0000 7efe70bfc700 1 -- 172.21.15.96:0/1388656217 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe6c101ee0 msgr2=0x7efe6c19d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:56.434 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.428+0000 7efe70bfc700 1 --2- 172.21.15.96:0/1388656217 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe6c101ee0 0x7efe6c19d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:56.435 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.428+0000 7efe70bfc700 1 -- 172.21.15.96:0/1388656217 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe64009d00 con 0x7efe6c100360 2023-05-08T03:40:56.435 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.428+0000 7efe70bfc700 1 --2- 172.21.15.96:0/1388656217 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe6c100360 0x7efe6c196210 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7efe64004d00 tx=0x7efe64004de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:56.435 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.428+0000 7efe69ffb700 1 -- 172.21.15.96:0/1388656217 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6400e040 con 0x7efe6c100360 2023-05-08T03:40:56.435 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.428+0000 7efe69ffb700 1 -- 172.21.15.96:0/1388656217 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efe6401db50 con 0x7efe6c100360 2023-05-08T03:40:56.435 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.428+0000 7efe72e60700 1 -- 172.21.15.96:0/1388656217 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe6c10bcc0 con 0x7efe6c100360 2023-05-08T03:40:56.435 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.428+0000 7efe69ffb700 1 -- 172.21.15.96:0/1388656217 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6401bbb0 con 0x7efe6c100360 2023-05-08T03:40:56.435 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.429+0000 7efe72e60700 1 -- 172.21.15.96:0/1388656217 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe6c10bb30 con 0x7efe6c100360 2023-05-08T03:40:56.435 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.429+0000 7efe72e60700 1 -- 172.21.15.96:0/1388656217 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe6c107890 con 0x7efe6c100360 2023-05-08T03:40:56.436 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.430+0000 7efe69ffb700 1 -- 172.21.15.96:0/1388656217 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7efe6401bd10 con 0x7efe6c100360 2023-05-08T03:40:56.436 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.431+0000 7efe69ffb700 1 --2- 172.21.15.96:0/1388656217 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7efe580a1260 0x7efe580a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:56.436 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.431+0000 7efe6bfff700 1 --2- 172.21.15.96:0/1388656217 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7efe580a1260 0x7efe580a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:56.437 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.431+0000 7efe69ffb700 1 -- 172.21.15.96:0/1388656217 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7efe640ce6a0 con 0x7efe6c100360 2023-05-08T03:40:56.437 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.431+0000 7efe6bfff700 1 --2- 172.21.15.96:0/1388656217 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7efe580a1260 0x7efe580a3710 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7efe54005950 tx=0x7efe540058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:56.438 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.436+0000 7efe69ffb700 1 -- 172.21.15.96:0/1388656217 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7efe64097ed0 con 0x7efe6c100360 2023-05-08T03:40:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:56 smithi186 ceph-mon[126480]: from='client.14739 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:40:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:56 smithi186 ceph-mon[126480]: from='client.14745 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:40:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:56 smithi186 ceph-mon[126480]: pgmap v261: 97 pgs: 97 active+clean; 580 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s wr, 12 op/s 2023-05-08T03:40:56.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:56 smithi186 ceph-mon[126480]: from='client.14751 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:40:56.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:56 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/2435107124' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-05-08T03:40:56.626 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.624+0000 7efe72e60700 1 -- 172.21.15.96:0/1388656217 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efe6c02d0e0 con 0x7efe6c100360 2023-05-08T03:40:56.628 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.626+0000 7efe69ffb700 1 -- 172.21.15.96:0/1388656217 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+22096 (secure 0 0 0) 0x7efe6409b4f0 con 0x7efe6c100360 2023-05-08T03:40:56.629 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:40:56.629 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":82,"fsid":"f7ffcfb0-ed50-11ed-9b01-001a4aab830c","created":"2023-05-08T03:33:42.765680+0000","modified":"2023-05-08T03:40:50.211915+0000","last_up_change":"2023-05-08T03:40:07.550882+0000","last_in_change":"2023-05-08T03:39:49.027947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-08T03:36:47.800739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-05-08T03:40:47.229693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-05-08T03:40:48.359294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2ee801e1-8eec-496d-a9ac-fc566b38bbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":1816903726},{"type":"v1","addr":"172.21.15.96:6803","nonce":1816903726}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":1816903726},{"type":"v1","addr":"172.21.15.96:6805","nonce":1816903726}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":1816903726},{"type":"v1","addr":"172.21.15.96:6809","nonce":1816903726}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":1816903726},{"type":"v1","addr":"172.21.15.96:6807","nonce":1816903726}]},"public_addr":"172.21.15.96:6803/1816903726","cluster_addr":"172.21.15.96:6805/1816903726","heartbeat_back_addr":"172.21.15.96:6809/1816903726","heartbeat_front_addr":"172.21.15.96:6807/1816903726","state":["exists","up"]},{"osd":1,"uuid":"eb73deea-fc7c-4f2f-8aef-2d71c598afda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":206989126},{"type":"v1","addr":"172.21.15.133:6801","nonce":206989126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":206989126},{"type":"v1","addr":"172.21.15.133:6803","nonce":206989126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":206989126},{"type":"v1","addr":"172.21.15.133:6807","nonce":206989126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":206989126},{"type":"v1","addr":"172.21.15.133:6805","nonce":206989126}]},"public_addr":"172.21.15.133:6801/206989126","cluster_addr":"172.21.15.133:6803/206989126","heartbeat_back_addr":"172.21.15.133:6807/206989126","heartbeat_front_addr":"172.21.15.133:6805/206989126","state":["exists","up"]},{"osd":2,"uuid":"74a2f239-e82d-4d87-9458-5373b6cbbffd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":1791188143},{"type":"v1","addr":"172.21.15.186:6801","nonce":1791188143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":1791188143},{"type":"v1","addr":"172.21.15.186:6803","nonce":1791188143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":1791188143},{"type":"v1","addr":"172.21.15.186:6807","nonce":1791188143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":1791188143},{"type":"v1","addr":"172.21.15.186:6805","nonce":1791188143}]},"public_addr":"172.21.15.186:6801/1791188143","cluster_addr":"172.21.15.186:6803/1791188143","heartbeat_back_addr":"172.21.15.186:6807/1791188143","heartbeat_front_addr":"172.21.15.186:6805/1791188143","state":["exists","up"]},{"osd":3,"uuid":"421eedf5-ba6e-484e-b715-78c1c10d684e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":3430402140},{"type":"v1","addr":"172.21.15.96:6811","nonce":3430402140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":3430402140},{"type":"v1","addr":"172.21.15.96:6813","nonce":3430402140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":3430402140},{"type":"v1","addr":"172.21.15.96:6817","nonce":3430402140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":3430402140},{"type":"v1","addr":"172.21.15.96:6815","nonce":3430402140}]},"public_addr":"172.21.15.96:6811/3430402140","cluster_addr":"172.21.15.96:6813/3430402140","heartbeat_back_addr":"172.21.15.96:6817/3430402140","heartbeat_front_addr":"172.21.15.96:6815/3430402140","state":["exists","up"]},{"osd":4,"uuid":"fb20100b-6a5a-462d-955d-1697a3861e96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":1237495996},{"type":"v1","addr":"172.21.15.133:6809","nonce":1237495996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":1237495996},{"type":"v1","addr":"172.21.15.133:6811","nonce":1237495996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":1237495996},{"type":"v1","addr":"172.21.15.133:6815","nonce":1237495996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":1237495996},{"type":"v1","addr":"172.21.15.133:6813","nonce":1237495996}]},"public_addr":"172.21.15.133:6809/1237495996","cluster_addr":"172.21.15.133:6811/1237495996","heartbeat_back_addr":"172.21.15.133:6815/1237495996","heartbeat_front_addr":"172.21.15.133:6813/1237495996","state":["exists","up"]},{"osd":5,"uuid":"00177913-8bd6-4391-83c3-08c2b1b8ef13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":541111862},{"type":"v1","addr":"172.21.15.186:6809","nonce":541111862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":541111862},{"type":"v1","addr":"172.21.15.186:6811","nonce":541111862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":541111862},{"type":"v1","addr":"172.21.15.186:6815","nonce":541111862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":541111862},{"type":"v1","addr":"172.21.15.186:6813","nonce":541111862}]},"public_addr":"172.21.15.186:6809/541111862","cluster_addr":"172.21.15.186:6811/541111862","heartbeat_back_addr":"172.21.15.186:6815/541111862","heartbeat_front_addr":"172.21.15.186:6813/541111862","state":["exists","up"]},{"osd":6,"uuid":"204baab6-ca6f-4eef-8b9c-91efc04cc30c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":386227948},{"type":"v1","addr":"172.21.15.96:6819","nonce":386227948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":386227948},{"type":"v1","addr":"172.21.15.96:6821","nonce":386227948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":386227948},{"type":"v1","addr":"172.21.15.96:6825","nonce":386227948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":386227948},{"type":"v1","addr":"172.21.15.96:6823","nonce":386227948}]},"public_addr":"172.21.15.96:6819/386227948","cluster_addr":"172.21.15.96:6821/386227948","heartbeat_back_addr":"172.21.15.96:6825/386227948","heartbeat_front_addr":"172.21.15.96:6823/386227948","state":["exists","up"]},{"osd":7,"uuid":"282db569-a76e-485b-a33d-f2579b956525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":218507954},{"type":"v1","addr":"172.21.15.133:6817","nonce":218507954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":218507954},{"type":"v1","addr":"172.21.15.133:6819","nonce":218507954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":218507954},{"type":"v1","addr":"172.21.15.133:6823","nonce":218507954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":218507954},{"type":"v1","addr":"172.21.15.133:6821","nonce":218507954}]},"public_addr":"172.21.15.133:6817/218507954","cluster_addr":"172.21.15.133:6819/218507954","heartbeat_back_addr":"172.21.15.133:6823/218507954","heartbeat_front_addr":"172.21.15.133:6821/218507954","state":["exists","up"]},{"osd":8,"uuid":"693e25b5-355d-4990-9467-0fac4c9133fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":1648475902},{"type":"v1","addr":"172.21.15.186:6817","nonce":1648475902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":1648475902},{"type":"v1","addr":"172.21.15.186:6819","nonce":1648475902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":1648475902},{"type":"v1","addr":"172.21.15.186:6823","nonce":1648475902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":1648475902},{"type":"v1","addr":"172.21.15.186:6821","nonce":1648475902}]},"public_addr":"172.21.15.186:6817/1648475902","cluster_addr":"172.21.15.186:6819/1648475902","heartbeat_back_addr":"172.21.15.186:6823/1648475902","heartbeat_front_addr":"172.21.15.186:6821/1648475902","state":["exists","up"]},{"osd":9,"uuid":"72fbff09-fe28-4014-86fc-c31f95cd19a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":543223824},{"type":"v1","addr":"172.21.15.96:6827","nonce":543223824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":543223824},{"type":"v1","addr":"172.21.15.96:6829","nonce":543223824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6832","nonce":543223824},{"type":"v1","addr":"172.21.15.96:6833","nonce":543223824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":543223824},{"type":"v1","addr":"172.21.15.96:6831","nonce":543223824}]},"public_addr":"172.21.15.96:6827/543223824","cluster_addr":"172.21.15.96:6829/543223824","heartbeat_back_addr":"172.21.15.96:6833/543223824","heartbeat_front_addr":"172.21.15.96:6831/543223824","state":["exists","up"]},{"osd":10,"uuid":"6c2b6757-60c2-4962-9409-6051dcb13273","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":2323107912},{"type":"v1","addr":"172.21.15.133:6825","nonce":2323107912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":2323107912},{"type":"v1","addr":"172.21.15.133:6827","nonce":2323107912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":2323107912},{"type":"v1","addr":"172.21.15.133:6831","nonce":2323107912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":2323107912},{"type":"v1","addr":"172.21.15.133:6829","nonce":2323107912}]},"public_addr":"172.21.15.133:6825/2323107912","cluster_addr":"172.21.15.133:6827/2323107912","heartbeat_back_addr":"172.21.15.133:6831/2323107912","heartbeat_front_addr":"172.21.15.133:6829/2323107912","state":["exists","up"]},{"osd":11,"uuid":"03c0bb25-2921-446b-960e-6a7a328d36a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":3853499290},{"type":"v1","addr":"172.21.15.186:6825","nonce":3853499290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":3853499290},{"type":"v1","addr":"172.21.15.186:6827","nonce":3853499290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":3853499290},{"type":"v1","addr":"172.21.15.186:6831","nonce":3853499290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":3853499290},{"type":"v1","addr":"172.21.15.186:6829","nonce":3853499290}]},"public_addr":"172.21.15.186:6825/3853499290","cluster_addr":"172.21.15.186:6827/3853499290","heartbeat_back_addr":"172.21.15.186:6831/3853499290","heartbeat_front_addr":"172.21.15.186:6829/3853499290","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:36:02.087281+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:36:24.328783+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:36:46.135576+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:37:08.524145+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:37:30.883871+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:37:53.344554+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:38:15.448162+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:38:37.414878+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:38:59.533953+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:39:21.392102+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:39:43.462696+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:40:05.561808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.96:0/1333468881":"2023-05-09T03:34:37.472043+0000","172.21.15.96:6800/1979917756":"2023-05-09T03:34:37.472043+0000","172.21.15.96:0/1332045367":"2023-05-09T03:34:37.472043+0000","172.21.15.96:0/520278090":"2023-05-09T03:34:14.800324+0000","172.21.15.96:0/1055409415":"2023-05-09T03:34:37.472043+0000","172.21.15.96:6801/1979917756":"2023-05-09T03:34:37.472043+0000","172.21.15.96:0/1541933328":"2023-05-09T03:34:14.800324+0000","172.21.15.96:6800/3944122753":"2023-05-09T03:34:14.800324+0000","172.21.15.96:0/2986058319":"2023-05-09T03:34:14.800324+0000","172.21.15.96:6801/3944122753":"2023-05-09T03:34:14.800324+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-08T03:40:56.630 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.628+0000 7efe72e60700 1 -- 172.21.15.96:0/1388656217 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7efe580a1260 msgr2=0x7efe580a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:56.631 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.628+0000 7efe72e60700 1 --2- 172.21.15.96:0/1388656217 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7efe580a1260 0x7efe580a3710 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7efe54005950 tx=0x7efe540058e0 comp rx=0 tx=0).stop 2023-05-08T03:40:56.631 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.628+0000 7efe72e60700 1 -- 172.21.15.96:0/1388656217 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe6c100360 msgr2=0x7efe6c196210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:56.631 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.628+0000 7efe72e60700 1 --2- 172.21.15.96:0/1388656217 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe6c100360 0x7efe6c196210 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7efe64004d00 tx=0x7efe64004de0 comp rx=0 tx=0).stop 2023-05-08T03:40:56.631 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.628+0000 7efe72e60700 1 -- 172.21.15.96:0/1388656217 shutdown_connections 2023-05-08T03:40:56.631 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.628+0000 7efe72e60700 1 --2- 172.21.15.96:0/1388656217 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7efe580a1260 0x7efe580a3710 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:56.631 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.628+0000 7efe72e60700 1 --2- 172.21.15.96:0/1388656217 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe6c101ee0 0x7efe6c19d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:56.632 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.628+0000 7efe72e60700 1 --2- 172.21.15.96:0/1388656217 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe6c100360 0x7efe6c196210 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:56.632 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.628+0000 7efe72e60700 1 --2- 172.21.15.96:0/1388656217 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efe6c101550 0x7efe6c196750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:56.632 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.628+0000 7efe72e60700 1 -- 172.21.15.96:0/1388656217 >> 172.21.15.96:0/1388656217 conn(0x7efe6c0fb980 msgr2=0x7efe6c1049d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:56.632 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.628+0000 7efe72e60700 1 -- 172.21.15.96:0/1388656217 shutdown_connections 2023-05-08T03:40:56.632 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.628+0000 7efe72e60700 1 -- 172.21.15.96:0/1388656217 wait complete. 2023-05-08T03:40:56.642 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:56 smithi096 ceph-mon[124666]: from='client.14739 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:40:56.642 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:56 smithi096 ceph-mon[124666]: from='client.14745 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:40:56.642 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:56 smithi096 ceph-mon[124666]: pgmap v261: 97 pgs: 97 active+clean; 580 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s wr, 12 op/s 2023-05-08T03:40:56.642 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:56 smithi096 ceph-mon[124666]: from='client.14751 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:40:56.642 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:56 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/2435107124' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-05-08T03:40:56.644 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-05-08T03:40:56.644 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-08T03:40:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:56 smithi133 ceph-mon[125939]: from='client.14739 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:40:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:56 smithi133 ceph-mon[125939]: from='client.14745 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:40:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:56 smithi133 ceph-mon[125939]: pgmap v261: 97 pgs: 97 active+clean; 580 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s wr, 12 op/s 2023-05-08T03:40:56.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:56 smithi133 ceph-mon[125939]: from='client.14751 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:40:56.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:56 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/2435107124' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-05-08T03:40:56.765 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.762+0000 7f0146153700 1 -- 172.21.15.96:0/2363901349 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01400fed40 msgr2=0x7f0140108900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:56.765 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.762+0000 7f0146153700 1 --2- 172.21.15.96:0/2363901349 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01400fed40 0x7f0140108900 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f013800b0a0 tx=0x7f013800b3b0 comp rx=0 tx=0).stop 2023-05-08T03:40:56.765 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.762+0000 7f0146153700 1 -- 172.21.15.96:0/2363901349 shutdown_connections 2023-05-08T03:40:56.765 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.762+0000 7f0146153700 1 --2- 172.21.15.96:0/2363901349 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01400fed40 0x7f0140108900 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:56.766 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.762+0000 7f0146153700 1 --2- 172.21.15.96:0/2363901349 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0140101920 0x7f0140101d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:56.766 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.762+0000 7f0146153700 1 --2- 172.21.15.96:0/2363901349 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f01400fe390 0x7f01400fe800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:56.766 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.762+0000 7f0146153700 1 -- 172.21.15.96:0/2363901349 >> 172.21.15.96:0/2363901349 conn(0x7f01400f9f80 msgr2=0x7f01400fc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:56.766 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.762+0000 7f0146153700 1 -- 172.21.15.96:0/2363901349 shutdown_connections 2023-05-08T03:40:56.766 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.762+0000 7f0146153700 1 -- 172.21.15.96:0/2363901349 wait complete. 2023-05-08T03:40:56.766 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.763+0000 7f0146153700 1 Processor -- start 2023-05-08T03:40:56.768 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.763+0000 7f0146153700 1 -- start start 2023-05-08T03:40:56.768 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.763+0000 7f0146153700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01400fe390 0x7f0140196110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:56.768 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.763+0000 7f0146153700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01400fed40 0x7f0140196650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:56.768 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.763+0000 7f0146153700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0140101920 0x7f014019d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:56.768 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.763+0000 7f0146153700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f014019dc90 con 0x7f01400fe390 2023-05-08T03:40:56.769 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.763+0000 7f0146153700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f014019ddd0 con 0x7f01400fed40 2023-05-08T03:40:56.769 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.763+0000 7f0146153700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f014019df60 con 0x7f0140101920 2023-05-08T03:40:56.769 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.763+0000 7f013f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01400fe390 0x7f0140196110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:56.769 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.763+0000 7f013f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01400fe390 0x7f0140196110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40616/0 (socket says 172.21.15.96:40616) 2023-05-08T03:40:56.769 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.763+0000 7f013f7fe700 1 -- 172.21.15.96:0/341839527 learned_addr learned my addr 172.21.15.96:0/341839527 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:40:56.769 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.763+0000 7f013effd700 1 --2- 172.21.15.96:0/341839527 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01400fed40 0x7f0140196650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:56.769 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.763+0000 7f013ffff700 1 --2- 172.21.15.96:0/341839527 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0140101920 0x7f014019d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:56.770 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.764+0000 7f013f7fe700 1 -- 172.21.15.96:0/341839527 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0140101920 msgr2=0x7f014019d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:56.770 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.764+0000 7f013f7fe700 1 --2- 172.21.15.96:0/341839527 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0140101920 0x7f014019d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:56.770 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.764+0000 7f013f7fe700 1 -- 172.21.15.96:0/341839527 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01400fed40 msgr2=0x7f0140196650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:56.770 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.764+0000 7f013f7fe700 1 --2- 172.21.15.96:0/341839527 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01400fed40 0x7f0140196650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:56.770 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.764+0000 7f013f7fe700 1 -- 172.21.15.96:0/341839527 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0138009d00 con 0x7f01400fe390 2023-05-08T03:40:56.770 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.764+0000 7f013ffff700 1 --2- 172.21.15.96:0/341839527 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0140101920 0x7f014019d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-08T03:40:56.770 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.764+0000 7f013f7fe700 1 --2- 172.21.15.96:0/341839527 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01400fe390 0x7f0140196110 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f013400c990 tx=0x7f013400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:56.770 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.764+0000 7f013cff9700 1 -- 172.21.15.96:0/341839527 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0134007b00 con 0x7f01400fe390 2023-05-08T03:40:56.771 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.764+0000 7f013cff9700 1 -- 172.21.15.96:0/341839527 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0134007c60 con 0x7f01400fe390 2023-05-08T03:40:56.771 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.764+0000 7f0146153700 1 -- 172.21.15.96:0/341839527 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f014010bc90 con 0x7f01400fe390 2023-05-08T03:40:56.771 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.764+0000 7f013cff9700 1 -- 172.21.15.96:0/341839527 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0134018660 con 0x7f01400fe390 2023-05-08T03:40:56.771 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.764+0000 7f0146153700 1 -- 172.21.15.96:0/341839527 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f014010bb00 con 0x7f01400fe390 2023-05-08T03:40:56.771 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.765+0000 7f0146153700 1 -- 172.21.15.96:0/341839527 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0140107320 con 0x7f01400fe390 2023-05-08T03:40:56.772 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.767+0000 7f013cff9700 1 -- 172.21.15.96:0/341839527 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f013400f450 con 0x7f01400fe390 2023-05-08T03:40:56.772 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.767+0000 7f013cff9700 1 --2- 172.21.15.96:0/341839527 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f01280a11e0 0x7f01280a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:56.772 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.767+0000 7f013effd700 1 --2- 172.21.15.96:0/341839527 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f01280a11e0 0x7f01280a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:56.772 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.767+0000 7f013cff9700 1 -- 172.21.15.96:0/341839527 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f01340cc9e0 con 0x7f01400fe390 2023-05-08T03:40:56.772 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.768+0000 7f013effd700 1 --2- 172.21.15.96:0/341839527 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f01280a11e0 0x7f01280a3690 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0130005950 tx=0x7f01300058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:56.773 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.771+0000 7f013cff9700 1 -- 172.21.15.96:0/341839527 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f0134096210 con 0x7f01400fe390 2023-05-08T03:40:56.958 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.956+0000 7f0146153700 1 -- 172.21.15.96:0/341839527 --> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0140061c90 con 0x7f01280a11e0 2023-05-08T03:40:56.968 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.966+0000 7f013cff9700 1 -- 172.21.15.96:0/341839527 <== mgr.14152 v2:172.21.15.96:6800/2748629182 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+336250 (secure 0 0 0) 0x7f0140061c90 con 0x7f01280a11e0 2023-05-08T03:40:56.972 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:40:56.975 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.969+0000 7f0146153700 1 -- 172.21.15.96:0/341839527 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f01280a11e0 msgr2=0x7f01280a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:56.975 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.969+0000 7f0146153700 1 --2- 172.21.15.96:0/341839527 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f01280a11e0 0x7f01280a3690 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0130005950 tx=0x7f01300058e0 comp rx=0 tx=0).stop 2023-05-08T03:40:56.975 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.969+0000 7f0146153700 1 -- 172.21.15.96:0/341839527 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01400fe390 msgr2=0x7f0140196110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:56.976 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.969+0000 7f0146153700 1 --2- 172.21.15.96:0/341839527 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01400fe390 0x7f0140196110 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f013400c990 tx=0x7f013400cd50 comp rx=0 tx=0).stop 2023-05-08T03:40:56.976 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.969+0000 7f0146153700 1 -- 172.21.15.96:0/341839527 shutdown_connections 2023-05-08T03:40:56.976 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.969+0000 7f0146153700 1 --2- 172.21.15.96:0/341839527 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f01280a11e0 0x7f01280a3690 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:56.976 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.969+0000 7f0146153700 1 --2- 172.21.15.96:0/341839527 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0140101920 0x7f014019d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:56.976 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.969+0000 7f0146153700 1 --2- 172.21.15.96:0/341839527 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01400fe390 0x7f0140196110 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:56.976 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.970+0000 7f0146153700 1 --2- 172.21.15.96:0/341839527 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01400fed40 0x7f0140196650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:56.976 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.970+0000 7f0146153700 1 -- 172.21.15.96:0/341839527 >> 172.21.15.96:0/341839527 conn(0x7f01400f9f80 msgr2=0x7f01400fc1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:56.977 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.970+0000 7f0146153700 1 -- 172.21.15.96:0/341839527 shutdown_connections 2023-05-08T03:40:56.977 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:56.970+0000 7f0146153700 1 -- 172.21.15.96:0/341839527 wait complete. 2023-05-08T03:40:56.977 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2023-05-08T03:40:56.984 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":261,"stamp":"2023-05-08T03:40:55.547306+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":593976,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":263,"num_write_kb":2962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":207,"ondisk_log_size":207,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":236,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":79184,"kb_used_data":12144,"kb_used_omap":0,"kb_used_meta":66944,"kb_avail":1124862640,"statfs":{"total":1151940427776,"available":1151859343360,"internally_reserved":0,"allocated":12435456,"data_stored":6803843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":68550656},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[7],"upper_bound":2},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3608,"num_objects":38,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.764394"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.290515+0000","last_change":"2023-05-08T03:40:49.238180+0000","last_active":"2023-05-08T03:40:50.290515+0000","last_peered":"2023-05-08T03:40:50.290515+0000","last_clean":"2023-05-08T03:40:50.290515+0000","last_became_active":"2023-05-08T03:40:49.237400+0000","last_became_peered":"2023-05-08T03:40:49.237400+0000","last_unstale":"2023-05-08T03:40:50.290515+0000","last_undegraded":"2023-05-08T03:40:50.290515+0000","last_fullsized":"2023-05-08T03:40:50.290515+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T11:27:00.446105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991619+0000","last_change":"2023-05-08T03:40:49.232533+0000","last_active":"2023-05-08T03:40:51.991619+0000","last_peered":"2023-05-08T03:40:51.991619+0000","last_clean":"2023-05-08T03:40:51.991619+0000","last_became_active":"2023-05-08T03:40:49.232246+0000","last_became_peered":"2023-05-08T03:40:49.232246+0000","last_unstale":"2023-05-08T03:40:51.991619+0000","last_undegraded":"2023-05-08T03:40:51.991619+0000","last_fullsized":"2023-05-08T03:40:51.991619+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T06:19:28.497539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991622+0000","last_change":"2023-05-08T03:40:49.236848+0000","last_active":"2023-05-08T03:40:51.991622+0000","last_peered":"2023-05-08T03:40:51.991622+0000","last_clean":"2023-05-08T03:40:51.991622+0000","last_became_active":"2023-05-08T03:40:49.236506+0000","last_became_peered":"2023-05-08T03:40:49.236506+0000","last_unstale":"2023-05-08T03:40:51.991622+0000","last_undegraded":"2023-05-08T03:40:51.991622+0000","last_fullsized":"2023-05-08T03:40:51.991622+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T09:55:30.234804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.222849+0000","last_change":"2023-05-08T03:40:49.233941+0000","last_active":"2023-05-08T03:40:50.222849+0000","last_peered":"2023-05-08T03:40:50.222849+0000","last_clean":"2023-05-08T03:40:50.222849+0000","last_became_active":"2023-05-08T03:40:49.232969+0000","last_became_peered":"2023-05-08T03:40:49.232969+0000","last_unstale":"2023-05-08T03:40:50.222849+0000","last_undegraded":"2023-05-08T03:40:50.222849+0000","last_fullsized":"2023-05-08T03:40:50.222849+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T05:51:05.543005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.224768+0000","last_change":"2023-05-08T03:40:49.229455+0000","last_active":"2023-05-08T03:40:50.224768+0000","last_peered":"2023-05-08T03:40:50.224768+0000","last_clean":"2023-05-08T03:40:50.224768+0000","last_became_active":"2023-05-08T03:40:49.229118+0000","last_became_peered":"2023-05-08T03:40:49.229118+0000","last_unstale":"2023-05-08T03:40:50.224768+0000","last_undegraded":"2023-05-08T03:40:50.224768+0000","last_fullsized":"2023-05-08T03:40:50.224768+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T09:17:55.353149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.299436+0000","last_change":"2023-05-08T03:40:49.237344+0000","last_active":"2023-05-08T03:40:51.299436+0000","last_peered":"2023-05-08T03:40:51.299436+0000","last_clean":"2023-05-08T03:40:51.299436+0000","last_became_active":"2023-05-08T03:40:49.236775+0000","last_became_peered":"2023-05-08T03:40:49.236775+0000","last_unstale":"2023-05-08T03:40:51.299436+0000","last_undegraded":"2023-05-08T03:40:51.299436+0000","last_fullsized":"2023-05-08T03:40:51.299436+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T12:50:19.957755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991259+0000","last_change":"2023-05-08T03:40:49.235549+0000","last_active":"2023-05-08T03:40:51.991259+0000","last_peered":"2023-05-08T03:40:51.991259+0000","last_clean":"2023-05-08T03:40:51.991259+0000","last_became_active":"2023-05-08T03:40:49.235223+0000","last_became_peered":"2023-05-08T03:40:49.235223+0000","last_unstale":"2023-05-08T03:40:51.991259+0000","last_undegraded":"2023-05-08T03:40:51.991259+0000","last_fullsized":"2023-05-08T03:40:51.991259+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T09:45:50.518957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:52.175162+0000","last_change":"2023-05-08T03:40:49.234923+0000","last_active":"2023-05-08T03:40:52.175162+0000","last_peered":"2023-05-08T03:40:52.175162+0000","last_clean":"2023-05-08T03:40:52.175162+0000","last_became_active":"2023-05-08T03:40:49.234630+0000","last_became_peered":"2023-05-08T03:40:49.234630+0000","last_unstale":"2023-05-08T03:40:52.175162+0000","last_undegraded":"2023-05-08T03:40:52.175162+0000","last_fullsized":"2023-05-08T03:40:52.175162+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T10:54:09.908673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-08T03:40:49.243948+0000","last_change":"2023-05-08T03:40:49.243476+0000","last_active":"2023-05-08T03:40:49.243948+0000","last_peered":"2023-05-08T03:40:49.243948+0000","last_clean":"2023-05-08T03:40:49.243948+0000","last_became_active":"2023-05-08T03:40:49.243134+0000","last_became_peered":"2023-05-08T03:40:49.243134+0000","last_unstale":"2023-05-08T03:40:49.243948+0000","last_undegraded":"2023-05-08T03:40:49.243948+0000","last_fullsized":"2023-05-08T03:40:49.243948+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T04:42:56.917785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.299799+0000","last_change":"2023-05-08T03:40:49.238538+0000","last_active":"2023-05-08T03:40:51.299799+0000","last_peered":"2023-05-08T03:40:51.299799+0000","last_clean":"2023-05-08T03:40:51.299799+0000","last_became_active":"2023-05-08T03:40:49.237867+0000","last_became_peered":"2023-05-08T03:40:49.237867+0000","last_unstale":"2023-05-08T03:40:51.299799+0000","last_undegraded":"2023-05-08T03:40:51.299799+0000","last_fullsized":"2023-05-08T03:40:51.299799+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T15:14:54.147583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991704+0000","last_change":"2023-05-08T03:40:49.242175+0000","last_active":"2023-05-08T03:40:51.991704+0000","last_peered":"2023-05-08T03:40:51.991704+0000","last_clean":"2023-05-08T03:40:51.991704+0000","last_became_active":"2023-05-08T03:40:49.241878+0000","last_became_peered":"2023-05-08T03:40:49.241878+0000","last_unstale":"2023-05-08T03:40:51.991704+0000","last_undegraded":"2023-05-08T03:40:51.991704+0000","last_fullsized":"2023-05-08T03:40:51.991704+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T09:51:42.194781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.222799+0000","last_change":"2023-05-08T03:40:49.234199+0000","last_active":"2023-05-08T03:40:50.222799+0000","last_peered":"2023-05-08T03:40:50.222799+0000","last_clean":"2023-05-08T03:40:50.222799+0000","last_became_active":"2023-05-08T03:40:49.233408+0000","last_became_peered":"2023-05-08T03:40:49.233408+0000","last_unstale":"2023-05-08T03:40:50.222799+0000","last_undegraded":"2023-05-08T03:40:50.222799+0000","last_fullsized":"2023-05-08T03:40:50.222799+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T13:32:03.844376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.222261+0000","last_change":"2023-05-08T03:40:49.235750+0000","last_active":"2023-05-08T03:40:50.222261+0000","last_peered":"2023-05-08T03:40:50.222261+0000","last_clean":"2023-05-08T03:40:50.222261+0000","last_became_active":"2023-05-08T03:40:49.235443+0000","last_became_peered":"2023-05-08T03:40:49.235443+0000","last_unstale":"2023-05-08T03:40:50.222261+0000","last_undegraded":"2023-05-08T03:40:50.222261+0000","last_fullsized":"2023-05-08T03:40:50.222261+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T08:33:00.870579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991226+0000","last_change":"2023-05-08T03:40:49.234269+0000","last_active":"2023-05-08T03:40:51.991226+0000","last_peered":"2023-05-08T03:40:51.991226+0000","last_clean":"2023-05-08T03:40:51.991226+0000","last_became_active":"2023-05-08T03:40:49.233794+0000","last_became_peered":"2023-05-08T03:40:49.233794+0000","last_unstale":"2023-05-08T03:40:51.991226+0000","last_undegraded":"2023-05-08T03:40:51.991226+0000","last_fullsized":"2023-05-08T03:40:51.991226+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T15:01:13.031055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991052+0000","last_change":"2023-05-08T03:40:49.236952+0000","last_active":"2023-05-08T03:40:51.991052+0000","last_peered":"2023-05-08T03:40:51.991052+0000","last_clean":"2023-05-08T03:40:51.991052+0000","last_became_active":"2023-05-08T03:40:49.236406+0000","last_became_peered":"2023-05-08T03:40:49.236406+0000","last_unstale":"2023-05-08T03:40:51.991052+0000","last_undegraded":"2023-05-08T03:40:51.991052+0000","last_fullsized":"2023-05-08T03:40:51.991052+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T11:19:43.015225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-08T03:40:49.236018+0000","last_change":"2023-05-08T03:40:49.231719+0000","last_active":"2023-05-08T03:40:49.236018+0000","last_peered":"2023-05-08T03:40:49.236018+0000","last_clean":"2023-05-08T03:40:49.236018+0000","last_became_active":"2023-05-08T03:40:49.231397+0000","last_became_peered":"2023-05-08T03:40:49.231397+0000","last_unstale":"2023-05-08T03:40:49.236018+0000","last_undegraded":"2023-05-08T03:40:49.236018+0000","last_fullsized":"2023-05-08T03:40:49.236018+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T09:44:33.882379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.290675+0000","last_change":"2023-05-08T03:40:49.238441+0000","last_active":"2023-05-08T03:40:50.290675+0000","last_peered":"2023-05-08T03:40:50.290675+0000","last_clean":"2023-05-08T03:40:50.290675+0000","last_became_active":"2023-05-08T03:40:49.237893+0000","last_became_peered":"2023-05-08T03:40:49.237893+0000","last_unstale":"2023-05-08T03:40:50.290675+0000","last_undegraded":"2023-05-08T03:40:50.290675+0000","last_fullsized":"2023-05-08T03:40:50.290675+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T08:32:34.443745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991614+0000","last_change":"2023-05-08T03:40:49.233431+0000","last_active":"2023-05-08T03:40:51.991614+0000","last_peered":"2023-05-08T03:40:51.991614+0000","last_clean":"2023-05-08T03:40:51.991614+0000","last_became_active":"2023-05-08T03:40:49.233176+0000","last_became_peered":"2023-05-08T03:40:49.233176+0000","last_unstale":"2023-05-08T03:40:51.991614+0000","last_undegraded":"2023-05-08T03:40:51.991614+0000","last_fullsized":"2023-05-08T03:40:51.991614+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T05:33:31.755761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.273400+0000","last_change":"2023-05-08T03:40:49.233907+0000","last_active":"2023-05-08T03:40:51.273400+0000","last_peered":"2023-05-08T03:40:51.273400+0000","last_clean":"2023-05-08T03:40:51.273400+0000","last_became_active":"2023-05-08T03:40:49.233613+0000","last_became_peered":"2023-05-08T03:40:49.233613+0000","last_unstale":"2023-05-08T03:40:51.273400+0000","last_undegraded":"2023-05-08T03:40:51.273400+0000","last_fullsized":"2023-05-08T03:40:51.273400+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T13:34:47.424659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"82'9","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:53.358851+0000","last_change":"2023-05-08T03:40:48.803593+0000","last_active":"2023-05-08T03:40:53.358851+0000","last_peered":"2023-05-08T03:40:53.358851+0000","last_clean":"2023-05-08T03:40:53.358851+0000","last_became_active":"2023-05-08T03:40:48.803287+0000","last_became_peered":"2023-05-08T03:40:48.803287+0000","last_unstale":"2023-05-08T03:40:53.358851+0000","last_undegraded":"2023-05-08T03:40:53.358851+0000","last_fullsized":"2023-05-08T03:40:53.358851+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T14:21:33.903600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:52.175694+0000","last_change":"2023-05-08T03:40:49.238211+0000","last_active":"2023-05-08T03:40:52.175694+0000","last_peered":"2023-05-08T03:40:52.175694+0000","last_clean":"2023-05-08T03:40:52.175694+0000","last_became_active":"2023-05-08T03:40:49.237883+0000","last_became_peered":"2023-05-08T03:40:49.237883+0000","last_unstale":"2023-05-08T03:40:52.175694+0000","last_undegraded":"2023-05-08T03:40:52.175694+0000","last_fullsized":"2023-05-08T03:40:52.175694+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T11:47:15.524106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:52.175718+0000","last_change":"2023-05-08T03:40:48.799399+0000","last_active":"2023-05-08T03:40:52.175718+0000","last_peered":"2023-05-08T03:40:52.175718+0000","last_clean":"2023-05-08T03:40:52.175718+0000","last_became_active":"2023-05-08T03:40:48.798814+0000","last_became_peered":"2023-05-08T03:40:48.798814+0000","last_unstale":"2023-05-08T03:40:52.175718+0000","last_undegraded":"2023-05-08T03:40:52.175718+0000","last_fullsized":"2023-05-08T03:40:52.175718+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T06:10:49.650922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991705+0000","last_change":"2023-05-08T03:40:49.232111+0000","last_active":"2023-05-08T03:40:51.991705+0000","last_peered":"2023-05-08T03:40:51.991705+0000","last_clean":"2023-05-08T03:40:51.991705+0000","last_became_active":"2023-05-08T03:40:49.231440+0000","last_became_peered":"2023-05-08T03:40:49.231440+0000","last_unstale":"2023-05-08T03:40:51.991705+0000","last_undegraded":"2023-05-08T03:40:51.991705+0000","last_fullsized":"2023-05-08T03:40:51.991705+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T10:44:44.588384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"81'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.225246+0000","last_change":"2023-05-08T03:40:48.801407+0000","last_active":"2023-05-08T03:40:50.225246+0000","last_peered":"2023-05-08T03:40:50.225246+0000","last_clean":"2023-05-08T03:40:50.225246+0000","last_became_active":"2023-05-08T03:40:48.801023+0000","last_became_peered":"2023-05-08T03:40:48.801023+0000","last_unstale":"2023-05-08T03:40:50.225246+0000","last_undegraded":"2023-05-08T03:40:50.225246+0000","last_fullsized":"2023-05-08T03:40:50.225246+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T10:23:23.191427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-08T03:40:49.241965+0000","last_change":"2023-05-08T03:40:49.240406+0000","last_active":"2023-05-08T03:40:49.241965+0000","last_peered":"2023-05-08T03:40:49.241965+0000","last_clean":"2023-05-08T03:40:49.241965+0000","last_became_active":"2023-05-08T03:40:49.240078+0000","last_became_peered":"2023-05-08T03:40:49.240078+0000","last_unstale":"2023-05-08T03:40:49.241965+0000","last_undegraded":"2023-05-08T03:40:49.241965+0000","last_fullsized":"2023-05-08T03:40:49.241965+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T04:41:43.319934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.224945+0000","last_change":"2023-05-08T03:40:48.804918+0000","last_active":"2023-05-08T03:40:50.224945+0000","last_peered":"2023-05-08T03:40:50.224945+0000","last_clean":"2023-05-08T03:40:50.224945+0000","last_became_active":"2023-05-08T03:40:48.804489+0000","last_became_peered":"2023-05-08T03:40:48.804489+0000","last_unstale":"2023-05-08T03:40:50.224945+0000","last_undegraded":"2023-05-08T03:40:50.224945+0000","last_fullsized":"2023-05-08T03:40:50.224945+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T15:23:01.925119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.268788+0000","last_change":"2023-05-08T03:40:49.235173+0000","last_active":"2023-05-08T03:40:51.268788+0000","last_peered":"2023-05-08T03:40:51.268788+0000","last_clean":"2023-05-08T03:40:51.268788+0000","last_became_active":"2023-05-08T03:40:49.234823+0000","last_became_peered":"2023-05-08T03:40:49.234823+0000","last_unstale":"2023-05-08T03:40:51.268788+0000","last_undegraded":"2023-05-08T03:40:51.268788+0000","last_fullsized":"2023-05-08T03:40:51.268788+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T08:27:47.581290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"81'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.268575+0000","last_change":"2023-05-08T03:40:48.803696+0000","last_active":"2023-05-08T03:40:51.268575+0000","last_peered":"2023-05-08T03:40:51.268575+0000","last_clean":"2023-05-08T03:40:51.268575+0000","last_became_active":"2023-05-08T03:40:48.803340+0000","last_became_peered":"2023-05-08T03:40:48.803340+0000","last_unstale":"2023-05-08T03:40:51.268575+0000","last_undegraded":"2023-05-08T03:40:51.268575+0000","last_fullsized":"2023-05-08T03:40:51.268575+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T09:28:08.077623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.224896+0000","last_change":"2023-05-08T03:40:49.226368+0000","last_active":"2023-05-08T03:40:50.224896+0000","last_peered":"2023-05-08T03:40:50.224896+0000","last_clean":"2023-05-08T03:40:50.224896+0000","last_became_active":"2023-05-08T03:40:49.226071+0000","last_became_peered":"2023-05-08T03:40:49.226071+0000","last_unstale":"2023-05-08T03:40:50.224896+0000","last_undegraded":"2023-05-08T03:40:50.224896+0000","last_fullsized":"2023-05-08T03:40:50.224896+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T13:09:03.133860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"81'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.299427+0000","last_change":"2023-05-08T03:40:48.801763+0000","last_active":"2023-05-08T03:40:51.299427+0000","last_peered":"2023-05-08T03:40:51.299427+0000","last_clean":"2023-05-08T03:40:51.299427+0000","last_became_active":"2023-05-08T03:40:48.801424+0000","last_became_peered":"2023-05-08T03:40:48.801424+0000","last_unstale":"2023-05-08T03:40:51.299427+0000","last_undegraded":"2023-05-08T03:40:51.299427+0000","last_fullsized":"2023-05-08T03:40:51.299427+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T06:59:02.055492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.268665+0000","last_change":"2023-05-08T03:40:49.228114+0000","last_active":"2023-05-08T03:40:51.268665+0000","last_peered":"2023-05-08T03:40:51.268665+0000","last_clean":"2023-05-08T03:40:51.268665+0000","last_became_active":"2023-05-08T03:40:49.227468+0000","last_became_peered":"2023-05-08T03:40:49.227468+0000","last_unstale":"2023-05-08T03:40:51.268665+0000","last_undegraded":"2023-05-08T03:40:51.268665+0000","last_fullsized":"2023-05-08T03:40:51.268665+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T14:43:43.602206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.221975+0000","last_change":"2023-05-08T03:40:48.799150+0000","last_active":"2023-05-08T03:40:50.221975+0000","last_peered":"2023-05-08T03:40:50.221975+0000","last_clean":"2023-05-08T03:40:50.221975+0000","last_became_active":"2023-05-08T03:40:48.798782+0000","last_became_peered":"2023-05-08T03:40:48.798782+0000","last_unstale":"2023-05-08T03:40:50.221975+0000","last_undegraded":"2023-05-08T03:40:50.221975+0000","last_fullsized":"2023-05-08T03:40:50.221975+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T14:47:45.547983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:52.175062+0000","last_change":"2023-05-08T03:40:49.233927+0000","last_active":"2023-05-08T03:40:52.175062+0000","last_peered":"2023-05-08T03:40:52.175062+0000","last_clean":"2023-05-08T03:40:52.175062+0000","last_became_active":"2023-05-08T03:40:49.232431+0000","last_became_peered":"2023-05-08T03:40:49.232431+0000","last_unstale":"2023-05-08T03:40:52.175062+0000","last_undegraded":"2023-05-08T03:40:52.175062+0000","last_fullsized":"2023-05-08T03:40:52.175062+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T07:21:25.886329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.268374+0000","last_change":"2023-05-08T03:40:48.801966+0000","last_active":"2023-05-08T03:40:51.268374+0000","last_peered":"2023-05-08T03:40:51.268374+0000","last_clean":"2023-05-08T03:40:51.268374+0000","last_became_active":"2023-05-08T03:40:48.801642+0000","last_became_peered":"2023-05-08T03:40:48.801642+0000","last_unstale":"2023-05-08T03:40:51.268374+0000","last_undegraded":"2023-05-08T03:40:51.268374+0000","last_fullsized":"2023-05-08T03:40:51.268374+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T15:03:06.750289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.990929+0000","last_change":"2023-05-08T03:40:49.229373+0000","last_active":"2023-05-08T03:40:51.990929+0000","last_peered":"2023-05-08T03:40:51.990929+0000","last_clean":"2023-05-08T03:40:51.990929+0000","last_became_active":"2023-05-08T03:40:49.229073+0000","last_became_peered":"2023-05-08T03:40:49.229073+0000","last_unstale":"2023-05-08T03:40:51.990929+0000","last_undegraded":"2023-05-08T03:40:51.990929+0000","last_fullsized":"2023-05-08T03:40:51.990929+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T03:46:49.952461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.299835+0000","last_change":"2023-05-08T03:40:48.798753+0000","last_active":"2023-05-08T03:40:51.299835+0000","last_peered":"2023-05-08T03:40:51.299835+0000","last_clean":"2023-05-08T03:40:51.299835+0000","last_became_active":"2023-05-08T03:40:48.798370+0000","last_became_peered":"2023-05-08T03:40:48.798370+0000","last_unstale":"2023-05-08T03:40:51.299835+0000","last_undegraded":"2023-05-08T03:40:51.299835+0000","last_fullsized":"2023-05-08T03:40:51.299835+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T10:12:02.944925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-08T03:40:49.239792+0000","last_change":"2023-05-08T03:40:49.239106+0000","last_active":"2023-05-08T03:40:49.239792+0000","last_peered":"2023-05-08T03:40:49.239792+0000","last_clean":"2023-05-08T03:40:49.239792+0000","last_became_active":"2023-05-08T03:40:49.238801+0000","last_became_peered":"2023-05-08T03:40:49.238801+0000","last_unstale":"2023-05-08T03:40:49.239792+0000","last_undegraded":"2023-05-08T03:40:49.239792+0000","last_fullsized":"2023-05-08T03:40:49.239792+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T09:34:50.394897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:52.351169+0000","last_change":"2023-05-08T03:40:48.800553+0000","last_active":"2023-05-08T03:40:52.351169+0000","last_peered":"2023-05-08T03:40:52.351169+0000","last_clean":"2023-05-08T03:40:52.351169+0000","last_became_active":"2023-05-08T03:40:48.800255+0000","last_became_peered":"2023-05-08T03:40:48.800255+0000","last_unstale":"2023-05-08T03:40:52.351169+0000","last_undegraded":"2023-05-08T03:40:52.351169+0000","last_fullsized":"2023-05-08T03:40:52.351169+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T14:34:04.395527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991717+0000","last_change":"2023-05-08T03:40:49.235832+0000","last_active":"2023-05-08T03:40:51.991717+0000","last_peered":"2023-05-08T03:40:51.991717+0000","last_clean":"2023-05-08T03:40:51.991717+0000","last_became_active":"2023-05-08T03:40:49.235545+0000","last_became_peered":"2023-05-08T03:40:49.235545+0000","last_unstale":"2023-05-08T03:40:51.991717+0000","last_undegraded":"2023-05-08T03:40:51.991717+0000","last_fullsized":"2023-05-08T03:40:51.991717+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T06:40:14.786756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.268832+0000","last_change":"2023-05-08T03:40:48.799767+0000","last_active":"2023-05-08T03:40:51.268832+0000","last_peered":"2023-05-08T03:40:51.268832+0000","last_clean":"2023-05-08T03:40:51.268832+0000","last_became_active":"2023-05-08T03:40:48.799336+0000","last_became_peered":"2023-05-08T03:40:48.799336+0000","last_unstale":"2023-05-08T03:40:51.268832+0000","last_undegraded":"2023-05-08T03:40:51.268832+0000","last_fullsized":"2023-05-08T03:40:51.268832+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T09:47:50.498971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-08T03:40:49.235040+0000","last_change":"2023-05-08T03:40:49.228153+0000","last_active":"2023-05-08T03:40:49.235040+0000","last_peered":"2023-05-08T03:40:49.235040+0000","last_clean":"2023-05-08T03:40:49.235040+0000","last_became_active":"2023-05-08T03:40:49.227584+0000","last_became_peered":"2023-05-08T03:40:49.227584+0000","last_unstale":"2023-05-08T03:40:49.235040+0000","last_undegraded":"2023-05-08T03:40:49.235040+0000","last_fullsized":"2023-05-08T03:40:49.235040+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T10:05:02.487644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'6","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.299590+0000","last_change":"2023-05-08T03:40:48.799126+0000","last_active":"2023-05-08T03:40:51.299590+0000","last_peered":"2023-05-08T03:40:51.299590+0000","last_clean":"2023-05-08T03:40:51.299590+0000","last_became_active":"2023-05-08T03:40:48.798907+0000","last_became_peered":"2023-05-08T03:40:48.798907+0000","last_unstale":"2023-05-08T03:40:51.299590+0000","last_undegraded":"2023-05-08T03:40:51.299590+0000","last_fullsized":"2023-05-08T03:40:51.299590+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T11:24:58.026789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.225118+0000","last_change":"2023-05-08T03:40:49.237489+0000","last_active":"2023-05-08T03:40:50.225118+0000","last_peered":"2023-05-08T03:40:50.225118+0000","last_clean":"2023-05-08T03:40:50.225118+0000","last_became_active":"2023-05-08T03:40:49.237207+0000","last_became_peered":"2023-05-08T03:40:49.237207+0000","last_unstale":"2023-05-08T03:40:50.225118+0000","last_undegraded":"2023-05-08T03:40:50.225118+0000","last_fullsized":"2023-05-08T03:40:50.225118+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T07:31:36.303437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'6","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:53.358451+0000","last_change":"2023-05-08T03:40:48.803375+0000","last_active":"2023-05-08T03:40:53.358451+0000","last_peered":"2023-05-08T03:40:53.358451+0000","last_clean":"2023-05-08T03:40:53.358451+0000","last_became_active":"2023-05-08T03:40:48.803082+0000","last_became_peered":"2023-05-08T03:40:48.803082+0000","last_unstale":"2023-05-08T03:40:53.358451+0000","last_undegraded":"2023-05-08T03:40:53.358451+0000","last_fullsized":"2023-05-08T03:40:53.358451+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T06:24:55.514429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.222036+0000","last_change":"2023-05-08T03:40:49.235859+0000","last_active":"2023-05-08T03:40:50.222036+0000","last_peered":"2023-05-08T03:40:50.222036+0000","last_clean":"2023-05-08T03:40:50.222036+0000","last_became_active":"2023-05-08T03:40:49.235545+0000","last_became_peered":"2023-05-08T03:40:49.235545+0000","last_unstale":"2023-05-08T03:40:50.222036+0000","last_undegraded":"2023-05-08T03:40:50.222036+0000","last_fullsized":"2023-05-08T03:40:50.222036+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T12:06:59.892758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.268458+0000","last_change":"2023-05-08T03:40:48.803838+0000","last_active":"2023-05-08T03:40:51.268458+0000","last_peered":"2023-05-08T03:40:51.268458+0000","last_clean":"2023-05-08T03:40:51.268458+0000","last_became_active":"2023-05-08T03:40:48.803389+0000","last_became_peered":"2023-05-08T03:40:48.803389+0000","last_unstale":"2023-05-08T03:40:51.268458+0000","last_undegraded":"2023-05-08T03:40:51.268458+0000","last_fullsized":"2023-05-08T03:40:51.268458+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T06:25:46.589570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991651+0000","last_change":"2023-05-08T03:40:49.242013+0000","last_active":"2023-05-08T03:40:51.991651+0000","last_peered":"2023-05-08T03:40:51.991651+0000","last_clean":"2023-05-08T03:40:51.991651+0000","last_became_active":"2023-05-08T03:40:49.241649+0000","last_became_peered":"2023-05-08T03:40:49.241649+0000","last_unstale":"2023-05-08T03:40:51.991651+0000","last_undegraded":"2023-05-08T03:40:51.991651+0000","last_fullsized":"2023-05-08T03:40:51.991651+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T11:20:08.806314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:53.357740+0000","last_change":"2023-05-08T03:40:48.798327+0000","last_active":"2023-05-08T03:40:53.357740+0000","last_peered":"2023-05-08T03:40:53.357740+0000","last_clean":"2023-05-08T03:40:53.357740+0000","last_became_active":"2023-05-08T03:40:48.797982+0000","last_became_peered":"2023-05-08T03:40:48.797982+0000","last_unstale":"2023-05-08T03:40:53.357740+0000","last_undegraded":"2023-05-08T03:40:53.357740+0000","last_fullsized":"2023-05-08T03:40:53.357740+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T06:11:20.786843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991343+0000","last_change":"2023-05-08T03:40:49.233294+0000","last_active":"2023-05-08T03:40:51.991343+0000","last_peered":"2023-05-08T03:40:51.991343+0000","last_clean":"2023-05-08T03:40:51.991343+0000","last_became_active":"2023-05-08T03:40:49.232967+0000","last_became_peered":"2023-05-08T03:40:49.232967+0000","last_unstale":"2023-05-08T03:40:51.991343+0000","last_undegraded":"2023-05-08T03:40:51.991343+0000","last_fullsized":"2023-05-08T03:40:51.991343+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T08:56:19.823724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'8","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.224732+0000","last_change":"2023-05-08T03:40:48.800734+0000","last_active":"2023-05-08T03:40:50.224732+0000","last_peered":"2023-05-08T03:40:50.224732+0000","last_clean":"2023-05-08T03:40:50.224732+0000","last_became_active":"2023-05-08T03:40:48.800155+0000","last_became_peered":"2023-05-08T03:40:48.800155+0000","last_unstale":"2023-05-08T03:40:50.224732+0000","last_undegraded":"2023-05-08T03:40:50.224732+0000","last_fullsized":"2023-05-08T03:40:50.224732+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T10:21:52.124912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.268462+0000","last_change":"2023-05-08T03:40:49.230119+0000","last_active":"2023-05-08T03:40:51.268462+0000","last_peered":"2023-05-08T03:40:51.268462+0000","last_clean":"2023-05-08T03:40:51.268462+0000","last_became_active":"2023-05-08T03:40:49.229832+0000","last_became_peered":"2023-05-08T03:40:49.229832+0000","last_unstale":"2023-05-08T03:40:51.268462+0000","last_undegraded":"2023-05-08T03:40:51.268462+0000","last_fullsized":"2023-05-08T03:40:51.268462+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T10:04:22.742738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.225066+0000","last_change":"2023-05-08T03:40:48.801423+0000","last_active":"2023-05-08T03:40:50.225066+0000","last_peered":"2023-05-08T03:40:50.225066+0000","last_clean":"2023-05-08T03:40:50.225066+0000","last_became_active":"2023-05-08T03:40:48.801027+0000","last_became_peered":"2023-05-08T03:40:48.801027+0000","last_unstale":"2023-05-08T03:40:50.225066+0000","last_undegraded":"2023-05-08T03:40:50.225066+0000","last_fullsized":"2023-05-08T03:40:50.225066+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T07:32:19.377168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.290441+0000","last_change":"2023-05-08T03:40:49.239315+0000","last_active":"2023-05-08T03:40:50.290441+0000","last_peered":"2023-05-08T03:40:50.290441+0000","last_clean":"2023-05-08T03:40:50.290441+0000","last_became_active":"2023-05-08T03:40:49.239040+0000","last_became_peered":"2023-05-08T03:40:49.239040+0000","last_unstale":"2023-05-08T03:40:50.290441+0000","last_undegraded":"2023-05-08T03:40:50.290441+0000","last_fullsized":"2023-05-08T03:40:50.290441+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T04:36:38.262164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991307+0000","last_change":"2023-05-08T03:40:48.802650+0000","last_active":"2023-05-08T03:40:51.991307+0000","last_peered":"2023-05-08T03:40:51.991307+0000","last_clean":"2023-05-08T03:40:51.991307+0000","last_became_active":"2023-05-08T03:40:48.802358+0000","last_became_peered":"2023-05-08T03:40:48.802358+0000","last_unstale":"2023-05-08T03:40:51.991307+0000","last_undegraded":"2023-05-08T03:40:51.991307+0000","last_fullsized":"2023-05-08T03:40:51.991307+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T05:13:14.266223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.299660+0000","last_change":"2023-05-08T03:40:49.242103+0000","last_active":"2023-05-08T03:40:51.299660+0000","last_peered":"2023-05-08T03:40:51.299660+0000","last_clean":"2023-05-08T03:40:51.299660+0000","last_became_active":"2023-05-08T03:40:49.241694+0000","last_became_peered":"2023-05-08T03:40:49.241694+0000","last_unstale":"2023-05-08T03:40:51.299660+0000","last_undegraded":"2023-05-08T03:40:51.299660+0000","last_fullsized":"2023-05-08T03:40:51.299660+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T05:51:53.203680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"82'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991825+0000","last_change":"2023-05-08T03:40:48.801754+0000","last_active":"2023-05-08T03:40:51.991825+0000","last_peered":"2023-05-08T03:40:51.991825+0000","last_clean":"2023-05-08T03:40:51.991825+0000","last_became_active":"2023-05-08T03:40:48.801474+0000","last_became_peered":"2023-05-08T03:40:48.801474+0000","last_unstale":"2023-05-08T03:40:51.991825+0000","last_undegraded":"2023-05-08T03:40:51.991825+0000","last_fullsized":"2023-05-08T03:40:51.991825+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T10:17:15.498068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.299563+0000","last_change":"2023-05-08T03:40:49.239292+0000","last_active":"2023-05-08T03:40:51.299563+0000","last_peered":"2023-05-08T03:40:51.299563+0000","last_clean":"2023-05-08T03:40:51.299563+0000","last_became_active":"2023-05-08T03:40:49.238993+0000","last_became_peered":"2023-05-08T03:40:49.238993+0000","last_unstale":"2023-05-08T03:40:51.299563+0000","last_undegraded":"2023-05-08T03:40:51.299563+0000","last_fullsized":"2023-05-08T03:40:51.299563+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T07:31:52.140647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.268485+0000","last_change":"2023-05-08T03:40:49.228268+0000","last_active":"2023-05-08T03:40:51.268485+0000","last_peered":"2023-05-08T03:40:51.268485+0000","last_clean":"2023-05-08T03:40:51.268485+0000","last_became_active":"2023-05-08T03:40:49.227346+0000","last_became_peered":"2023-05-08T03:40:49.227346+0000","last_unstale":"2023-05-08T03:40:51.268485+0000","last_undegraded":"2023-05-08T03:40:51.268485+0000","last_fullsized":"2023-05-08T03:40:51.268485+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T04:14:10.880456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.221855+0000","last_change":"2023-05-08T03:40:48.795133+0000","last_active":"2023-05-08T03:40:50.221855+0000","last_peered":"2023-05-08T03:40:50.221855+0000","last_clean":"2023-05-08T03:40:50.221855+0000","last_became_active":"2023-05-08T03:40:48.794720+0000","last_became_peered":"2023-05-08T03:40:48.794720+0000","last_unstale":"2023-05-08T03:40:50.221855+0000","last_undegraded":"2023-05-08T03:40:50.221855+0000","last_fullsized":"2023-05-08T03:40:50.221855+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T12:37:37.862608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:52.175426+0000","last_change":"2023-05-08T03:40:49.229331+0000","last_active":"2023-05-08T03:40:52.175426+0000","last_peered":"2023-05-08T03:40:52.175426+0000","last_clean":"2023-05-08T03:40:52.175426+0000","last_became_active":"2023-05-08T03:40:49.228878+0000","last_became_peered":"2023-05-08T03:40:49.228878+0000","last_unstale":"2023-05-08T03:40:52.175426+0000","last_undegraded":"2023-05-08T03:40:52.175426+0000","last_fullsized":"2023-05-08T03:40:52.175426+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T03:53:35.836359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"82'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:52.349111+0000","last_change":"2023-05-08T03:40:48.796217+0000","last_active":"2023-05-08T03:40:52.349111+0000","last_peered":"2023-05-08T03:40:52.349111+0000","last_clean":"2023-05-08T03:40:52.349111+0000","last_became_active":"2023-05-08T03:40:48.795887+0000","last_became_peered":"2023-05-08T03:40:48.795887+0000","last_unstale":"2023-05-08T03:40:52.349111+0000","last_undegraded":"2023-05-08T03:40:52.349111+0000","last_fullsized":"2023-05-08T03:40:52.349111+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T14:57:30.575267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":340,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991321+0000","last_change":"2023-05-08T03:39:49.036132+0000","last_active":"2023-05-08T03:40:51.991321+0000","last_peered":"2023-05-08T03:40:51.991321+0000","last_clean":"2023-05-08T03:40:51.991321+0000","last_became_active":"2023-05-08T03:39:49.035717+0000","last_became_peered":"2023-05-08T03:39:49.035717+0000","last_unstale":"2023-05-08T03:40:51.991321+0000","last_undegraded":"2023-05-08T03:40:51.991321+0000","last_fullsized":"2023-05-08T03:40:51.991321+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:36:48.527062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:36:48.527062+0000","last_clean_scrub_stamp":"2023-05-08T03:36:48.527062+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T07:02:26.379800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.221853+0000","last_change":"2023-05-08T03:40:49.227299+0000","last_active":"2023-05-08T03:40:50.221853+0000","last_peered":"2023-05-08T03:40:50.221853+0000","last_clean":"2023-05-08T03:40:50.221853+0000","last_became_active":"2023-05-08T03:40:49.226846+0000","last_became_peered":"2023-05-08T03:40:49.226846+0000","last_unstale":"2023-05-08T03:40:50.221853+0000","last_undegraded":"2023-05-08T03:40:50.221853+0000","last_fullsized":"2023-05-08T03:40:50.221853+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T10:55:57.218170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"82'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:53.358519+0000","last_change":"2023-05-08T03:40:48.803480+0000","last_active":"2023-05-08T03:40:53.358519+0000","last_peered":"2023-05-08T03:40:53.358519+0000","last_clean":"2023-05-08T03:40:53.358519+0000","last_became_active":"2023-05-08T03:40:48.803137+0000","last_became_peered":"2023-05-08T03:40:48.803137+0000","last_unstale":"2023-05-08T03:40:53.358519+0000","last_undegraded":"2023-05-08T03:40:53.358519+0000","last_fullsized":"2023-05-08T03:40:53.358519+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T11:08:55.229134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.225060+0000","last_change":"2023-05-08T03:40:48.802781+0000","last_active":"2023-05-08T03:40:50.225060+0000","last_peered":"2023-05-08T03:40:50.225060+0000","last_clean":"2023-05-08T03:40:50.225060+0000","last_became_active":"2023-05-08T03:40:48.802461+0000","last_became_peered":"2023-05-08T03:40:48.802461+0000","last_unstale":"2023-05-08T03:40:50.225060+0000","last_undegraded":"2023-05-08T03:40:50.225060+0000","last_fullsized":"2023-05-08T03:40:50.225060+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T11:07:12.386341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.222071+0000","last_change":"2023-05-08T03:40:49.227162+0000","last_active":"2023-05-08T03:40:50.222071+0000","last_peered":"2023-05-08T03:40:50.222071+0000","last_clean":"2023-05-08T03:40:50.222071+0000","last_became_active":"2023-05-08T03:40:49.226841+0000","last_became_peered":"2023-05-08T03:40:49.226841+0000","last_unstale":"2023-05-08T03:40:50.222071+0000","last_undegraded":"2023-05-08T03:40:50.222071+0000","last_fullsized":"2023-05-08T03:40:50.222071+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T05:42:31.361505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:53.358169+0000","last_change":"2023-05-08T03:40:48.800841+0000","last_active":"2023-05-08T03:40:53.358169+0000","last_peered":"2023-05-08T03:40:53.358169+0000","last_clean":"2023-05-08T03:40:53.358169+0000","last_became_active":"2023-05-08T03:40:48.800198+0000","last_became_peered":"2023-05-08T03:40:48.800198+0000","last_unstale":"2023-05-08T03:40:53.358169+0000","last_undegraded":"2023-05-08T03:40:53.358169+0000","last_fullsized":"2023-05-08T03:40:53.358169+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T07:43:49.169424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:52.175690+0000","last_change":"2023-05-08T03:40:49.234421+0000","last_active":"2023-05-08T03:40:52.175690+0000","last_peered":"2023-05-08T03:40:52.175690+0000","last_clean":"2023-05-08T03:40:52.175690+0000","last_became_active":"2023-05-08T03:40:49.234108+0000","last_became_peered":"2023-05-08T03:40:49.234108+0000","last_unstale":"2023-05-08T03:40:52.175690+0000","last_undegraded":"2023-05-08T03:40:52.175690+0000","last_fullsized":"2023-05-08T03:40:52.175690+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T07:08:12.366030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'4","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:52.350385+0000","last_change":"2023-05-08T03:40:48.792894+0000","last_active":"2023-05-08T03:40:52.350385+0000","last_peered":"2023-05-08T03:40:52.350385+0000","last_clean":"2023-05-08T03:40:52.350385+0000","last_became_active":"2023-05-08T03:40:48.792579+0000","last_became_peered":"2023-05-08T03:40:48.792579+0000","last_unstale":"2023-05-08T03:40:52.350385+0000","last_undegraded":"2023-05-08T03:40:52.350385+0000","last_fullsized":"2023-05-08T03:40:52.350385+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T12:10:35.808903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991740+0000","last_change":"2023-05-08T03:40:49.239032+0000","last_active":"2023-05-08T03:40:51.991740+0000","last_peered":"2023-05-08T03:40:51.991740+0000","last_clean":"2023-05-08T03:40:51.991740+0000","last_became_active":"2023-05-08T03:40:49.238714+0000","last_became_peered":"2023-05-08T03:40:49.238714+0000","last_unstale":"2023-05-08T03:40:51.991740+0000","last_undegraded":"2023-05-08T03:40:51.991740+0000","last_fullsized":"2023-05-08T03:40:51.991740+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T15:12:46.594644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-08T03:40:49.224427+0000","last_change":"2023-05-08T03:40:48.797158+0000","last_active":"2023-05-08T03:40:49.224427+0000","last_peered":"2023-05-08T03:40:49.224427+0000","last_clean":"2023-05-08T03:40:49.224427+0000","last_became_active":"2023-05-08T03:40:48.796851+0000","last_became_peered":"2023-05-08T03:40:48.796851+0000","last_unstale":"2023-05-08T03:40:49.224427+0000","last_undegraded":"2023-05-08T03:40:49.224427+0000","last_fullsized":"2023-05-08T03:40:49.224427+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T14:12:09.488416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.224714+0000","last_change":"2023-05-08T03:40:49.236833+0000","last_active":"2023-05-08T03:40:50.224714+0000","last_peered":"2023-05-08T03:40:50.224714+0000","last_clean":"2023-05-08T03:40:50.224714+0000","last_became_active":"2023-05-08T03:40:49.236520+0000","last_became_peered":"2023-05-08T03:40:49.236520+0000","last_unstale":"2023-05-08T03:40:50.224714+0000","last_undegraded":"2023-05-08T03:40:50.224714+0000","last_fullsized":"2023-05-08T03:40:50.224714+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T08:36:44.900323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:52.354358+0000","last_change":"2023-05-08T03:40:48.791795+0000","last_active":"2023-05-08T03:40:52.354358+0000","last_peered":"2023-05-08T03:40:52.354358+0000","last_clean":"2023-05-08T03:40:52.354358+0000","last_became_active":"2023-05-08T03:40:48.791489+0000","last_became_peered":"2023-05-08T03:40:48.791489+0000","last_unstale":"2023-05-08T03:40:52.354358+0000","last_undegraded":"2023-05-08T03:40:52.354358+0000","last_fullsized":"2023-05-08T03:40:52.354358+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T08:45:26.675522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.290230+0000","last_change":"2023-05-08T03:40:49.232245+0000","last_active":"2023-05-08T03:40:50.290230+0000","last_peered":"2023-05-08T03:40:50.290230+0000","last_clean":"2023-05-08T03:40:50.290230+0000","last_became_active":"2023-05-08T03:40:49.231934+0000","last_became_peered":"2023-05-08T03:40:49.231934+0000","last_unstale":"2023-05-08T03:40:50.290230+0000","last_undegraded":"2023-05-08T03:40:50.290230+0000","last_fullsized":"2023-05-08T03:40:50.290230+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T08:30:46.523751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.273105+0000","last_change":"2023-05-08T03:40:48.803996+0000","last_active":"2023-05-08T03:40:51.273105+0000","last_peered":"2023-05-08T03:40:51.273105+0000","last_clean":"2023-05-08T03:40:51.273105+0000","last_became_active":"2023-05-08T03:40:48.803684+0000","last_became_peered":"2023-05-08T03:40:48.803684+0000","last_unstale":"2023-05-08T03:40:51.273105+0000","last_undegraded":"2023-05-08T03:40:51.273105+0000","last_fullsized":"2023-05-08T03:40:51.273105+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T08:13:18.973444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:52.175439+0000","last_change":"2023-05-08T03:40:49.234152+0000","last_active":"2023-05-08T03:40:52.175439+0000","last_peered":"2023-05-08T03:40:52.175439+0000","last_clean":"2023-05-08T03:40:52.175439+0000","last_became_active":"2023-05-08T03:40:49.233675+0000","last_became_peered":"2023-05-08T03:40:49.233675+0000","last_unstale":"2023-05-08T03:40:52.175439+0000","last_undegraded":"2023-05-08T03:40:52.175439+0000","last_fullsized":"2023-05-08T03:40:52.175439+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T08:53:30.821743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.224821+0000","last_change":"2023-05-08T03:40:48.798736+0000","last_active":"2023-05-08T03:40:50.224821+0000","last_peered":"2023-05-08T03:40:50.224821+0000","last_clean":"2023-05-08T03:40:50.224821+0000","last_became_active":"2023-05-08T03:40:48.798418+0000","last_became_peered":"2023-05-08T03:40:48.798418+0000","last_unstale":"2023-05-08T03:40:50.224821+0000","last_undegraded":"2023-05-08T03:40:50.224821+0000","last_fullsized":"2023-05-08T03:40:50.224821+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T07:52:30.962269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991638+0000","last_change":"2023-05-08T03:40:49.235205+0000","last_active":"2023-05-08T03:40:51.991638+0000","last_peered":"2023-05-08T03:40:51.991638+0000","last_clean":"2023-05-08T03:40:51.991638+0000","last_became_active":"2023-05-08T03:40:49.234898+0000","last_became_peered":"2023-05-08T03:40:49.234898+0000","last_unstale":"2023-05-08T03:40:51.991638+0000","last_undegraded":"2023-05-08T03:40:51.991638+0000","last_fullsized":"2023-05-08T03:40:51.991638+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T09:51:49.501098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:53.358608+0000","last_change":"2023-05-08T03:40:48.802820+0000","last_active":"2023-05-08T03:40:53.358608+0000","last_peered":"2023-05-08T03:40:53.358608+0000","last_clean":"2023-05-08T03:40:53.358608+0000","last_became_active":"2023-05-08T03:40:48.802457+0000","last_became_peered":"2023-05-08T03:40:48.802457+0000","last_unstale":"2023-05-08T03:40:53.358608+0000","last_undegraded":"2023-05-08T03:40:53.358608+0000","last_fullsized":"2023-05-08T03:40:53.358608+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T05:22:19.608125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991798+0000","last_change":"2023-05-08T03:40:49.238318+0000","last_active":"2023-05-08T03:40:51.991798+0000","last_peered":"2023-05-08T03:40:51.991798+0000","last_clean":"2023-05-08T03:40:51.991798+0000","last_became_active":"2023-05-08T03:40:49.237994+0000","last_became_peered":"2023-05-08T03:40:49.237994+0000","last_unstale":"2023-05-08T03:40:51.991798+0000","last_undegraded":"2023-05-08T03:40:51.991798+0000","last_fullsized":"2023-05-08T03:40:51.991798+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T14:44:53.119130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.268717+0000","last_change":"2023-05-08T03:40:48.803795+0000","last_active":"2023-05-08T03:40:51.268717+0000","last_peered":"2023-05-08T03:40:51.268717+0000","last_clean":"2023-05-08T03:40:51.268717+0000","last_became_active":"2023-05-08T03:40:48.803001+0000","last_became_peered":"2023-05-08T03:40:48.803001+0000","last_unstale":"2023-05-08T03:40:51.268717+0000","last_undegraded":"2023-05-08T03:40:51.268717+0000","last_fullsized":"2023-05-08T03:40:51.268717+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T07:43:47.011238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991462+0000","last_change":"2023-05-08T03:40:49.237298+0000","last_active":"2023-05-08T03:40:51.991462+0000","last_peered":"2023-05-08T03:40:51.991462+0000","last_clean":"2023-05-08T03:40:51.991462+0000","last_became_active":"2023-05-08T03:40:49.236984+0000","last_became_peered":"2023-05-08T03:40:49.236984+0000","last_unstale":"2023-05-08T03:40:51.991462+0000","last_undegraded":"2023-05-08T03:40:51.991462+0000","last_fullsized":"2023-05-08T03:40:51.991462+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T14:05:30.754412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.222153+0000","last_change":"2023-05-08T03:40:48.801987+0000","last_active":"2023-05-08T03:40:50.222153+0000","last_peered":"2023-05-08T03:40:50.222153+0000","last_clean":"2023-05-08T03:40:50.222153+0000","last_became_active":"2023-05-08T03:40:48.801521+0000","last_became_peered":"2023-05-08T03:40:48.801521+0000","last_unstale":"2023-05-08T03:40:50.222153+0000","last_undegraded":"2023-05-08T03:40:50.222153+0000","last_fullsized":"2023-05-08T03:40:50.222153+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T03:49:08.381600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991668+0000","last_change":"2023-05-08T03:40:49.240916+0000","last_active":"2023-05-08T03:40:51.991668+0000","last_peered":"2023-05-08T03:40:51.991668+0000","last_clean":"2023-05-08T03:40:51.991668+0000","last_became_active":"2023-05-08T03:40:49.240626+0000","last_became_peered":"2023-05-08T03:40:49.240626+0000","last_unstale":"2023-05-08T03:40:51.991668+0000","last_undegraded":"2023-05-08T03:40:51.991668+0000","last_fullsized":"2023-05-08T03:40:51.991668+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T06:18:16.782559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.290263+0000","last_change":"2023-05-08T03:40:49.236506+0000","last_active":"2023-05-08T03:40:50.290263+0000","last_peered":"2023-05-08T03:40:50.290263+0000","last_clean":"2023-05-08T03:40:50.290263+0000","last_became_active":"2023-05-08T03:40:49.236065+0000","last_became_peered":"2023-05-08T03:40:49.236065+0000","last_unstale":"2023-05-08T03:40:50.290263+0000","last_undegraded":"2023-05-08T03:40:50.290263+0000","last_fullsized":"2023-05-08T03:40:50.290263+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T04:00:41.965873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.273160+0000","last_change":"2023-05-08T03:40:49.236262+0000","last_active":"2023-05-08T03:40:51.273160+0000","last_peered":"2023-05-08T03:40:51.273160+0000","last_clean":"2023-05-08T03:40:51.273160+0000","last_became_active":"2023-05-08T03:40:49.235892+0000","last_became_peered":"2023-05-08T03:40:49.235892+0000","last_unstale":"2023-05-08T03:40:51.273160+0000","last_undegraded":"2023-05-08T03:40:51.273160+0000","last_fullsized":"2023-05-08T03:40:51.273160+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T11:18:58.158779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.273174+0000","last_change":"2023-05-08T03:40:49.232946+0000","last_active":"2023-05-08T03:40:51.273174+0000","last_peered":"2023-05-08T03:40:51.273174+0000","last_clean":"2023-05-08T03:40:51.273174+0000","last_became_active":"2023-05-08T03:40:49.232642+0000","last_became_peered":"2023-05-08T03:40:49.232642+0000","last_unstale":"2023-05-08T03:40:51.273174+0000","last_undegraded":"2023-05-08T03:40:51.273174+0000","last_fullsized":"2023-05-08T03:40:51.273174+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T05:32:46.280731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991435+0000","last_change":"2023-05-08T03:40:49.238342+0000","last_active":"2023-05-08T03:40:51.991435+0000","last_peered":"2023-05-08T03:40:51.991435+0000","last_clean":"2023-05-08T03:40:51.991435+0000","last_became_active":"2023-05-08T03:40:49.237973+0000","last_became_peered":"2023-05-08T03:40:49.237973+0000","last_unstale":"2023-05-08T03:40:51.991435+0000","last_undegraded":"2023-05-08T03:40:51.991435+0000","last_fullsized":"2023-05-08T03:40:51.991435+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T13:53:38.093200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.222110+0000","last_change":"2023-05-08T03:40:49.226285+0000","last_active":"2023-05-08T03:40:50.222110+0000","last_peered":"2023-05-08T03:40:50.222110+0000","last_clean":"2023-05-08T03:40:50.222110+0000","last_became_active":"2023-05-08T03:40:49.225962+0000","last_became_peered":"2023-05-08T03:40:49.225962+0000","last_unstale":"2023-05-08T03:40:50.222110+0000","last_undegraded":"2023-05-08T03:40:50.222110+0000","last_fullsized":"2023-05-08T03:40:50.222110+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T11:58:59.434249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.290540+0000","last_change":"2023-05-08T03:40:49.238692+0000","last_active":"2023-05-08T03:40:50.290540+0000","last_peered":"2023-05-08T03:40:50.290540+0000","last_clean":"2023-05-08T03:40:50.290540+0000","last_became_active":"2023-05-08T03:40:49.238234+0000","last_became_peered":"2023-05-08T03:40:49.238234+0000","last_unstale":"2023-05-08T03:40:50.290540+0000","last_undegraded":"2023-05-08T03:40:50.290540+0000","last_fullsized":"2023-05-08T03:40:50.290540+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T13:25:41.710681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.273376+0000","last_change":"2023-05-08T03:40:49.227549+0000","last_active":"2023-05-08T03:40:51.273376+0000","last_peered":"2023-05-08T03:40:51.273376+0000","last_clean":"2023-05-08T03:40:51.273376+0000","last_became_active":"2023-05-08T03:40:49.227259+0000","last_became_peered":"2023-05-08T03:40:49.227259+0000","last_unstale":"2023-05-08T03:40:51.273376+0000","last_undegraded":"2023-05-08T03:40:51.273376+0000","last_fullsized":"2023-05-08T03:40:51.273376+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T03:50:25.923147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:52.175680+0000","last_change":"2023-05-08T03:40:49.238832+0000","last_active":"2023-05-08T03:40:52.175680+0000","last_peered":"2023-05-08T03:40:52.175680+0000","last_clean":"2023-05-08T03:40:52.175680+0000","last_became_active":"2023-05-08T03:40:49.238521+0000","last_became_peered":"2023-05-08T03:40:49.238521+0000","last_unstale":"2023-05-08T03:40:52.175680+0000","last_undegraded":"2023-05-08T03:40:52.175680+0000","last_fullsized":"2023-05-08T03:40:52.175680+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T06:59:10.616806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.268410+0000","last_change":"2023-05-08T03:40:49.228489+0000","last_active":"2023-05-08T03:40:51.268410+0000","last_peered":"2023-05-08T03:40:51.268410+0000","last_clean":"2023-05-08T03:40:51.268410+0000","last_became_active":"2023-05-08T03:40:49.228178+0000","last_became_peered":"2023-05-08T03:40:49.228178+0000","last_unstale":"2023-05-08T03:40:51.268410+0000","last_undegraded":"2023-05-08T03:40:51.268410+0000","last_fullsized":"2023-05-08T03:40:51.268410+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T05:47:36.620662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:52.175253+0000","last_change":"2023-05-08T03:40:49.243094+0000","last_active":"2023-05-08T03:40:52.175253+0000","last_peered":"2023-05-08T03:40:52.175253+0000","last_clean":"2023-05-08T03:40:52.175253+0000","last_became_active":"2023-05-08T03:40:49.242775+0000","last_became_peered":"2023-05-08T03:40:49.242775+0000","last_unstale":"2023-05-08T03:40:52.175253+0000","last_undegraded":"2023-05-08T03:40:52.175253+0000","last_fullsized":"2023-05-08T03:40:52.175253+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T12:58:00.099315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-08T03:40:49.235092+0000","last_change":"2023-05-08T03:40:49.228943+0000","last_active":"2023-05-08T03:40:49.235092+0000","last_peered":"2023-05-08T03:40:49.235092+0000","last_clean":"2023-05-08T03:40:49.235092+0000","last_became_active":"2023-05-08T03:40:49.228657+0000","last_became_peered":"2023-05-08T03:40:49.228657+0000","last_unstale":"2023-05-08T03:40:49.235092+0000","last_undegraded":"2023-05-08T03:40:49.235092+0000","last_fullsized":"2023-05-08T03:40:49.235092+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T03:56:38.827039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.222327+0000","last_change":"2023-05-08T03:40:49.233736+0000","last_active":"2023-05-08T03:40:50.222327+0000","last_peered":"2023-05-08T03:40:50.222327+0000","last_clean":"2023-05-08T03:40:50.222327+0000","last_became_active":"2023-05-08T03:40:49.233418+0000","last_became_peered":"2023-05-08T03:40:49.233418+0000","last_unstale":"2023-05-08T03:40:50.222327+0000","last_undegraded":"2023-05-08T03:40:50.222327+0000","last_fullsized":"2023-05-08T03:40:50.222327+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T13:29:20.896557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.290361+0000","last_change":"2023-05-08T03:40:49.235658+0000","last_active":"2023-05-08T03:40:50.290361+0000","last_peered":"2023-05-08T03:40:50.290361+0000","last_clean":"2023-05-08T03:40:50.290361+0000","last_became_active":"2023-05-08T03:40:49.235289+0000","last_became_peered":"2023-05-08T03:40:49.235289+0000","last_unstale":"2023-05-08T03:40:50.290361+0000","last_undegraded":"2023-05-08T03:40:50.290361+0000","last_fullsized":"2023-05-08T03:40:50.290361+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T03:52:16.806774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3608,"num_objects":38,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":192512,"data_stored":12428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":70,"ondisk_log_size":70,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":77,"seq":330712481803,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5920,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":5056,"kb_avail":93739232,"statfs":{"total":95995035648,"available":95988973568,"internally_reserved":0,"allocated":876544,"data_stored":420653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5177344},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]}]},{"osd":10,"up_from":70,"seq":300647710736,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6704,"kb_used_data":1448,"kb_used_omap":0,"kb_used_meta":5248,"kb_avail":93738448,"statfs":{"total":95995035648,"available":95988170752,"internally_reserved":0,"allocated":1482752,"data_stored":1004209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5373952},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":1,"last update":"Mon May 8 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.313},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.33700000000000002}]},{"osd":2,"last update":"Mon May 8 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.55100000000000005}]},{"osd":3,"last update":"Mon May 8 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.441},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.35599999999999998}]},{"osd":4,"last update":"Mon May 8 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.373},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.56599999999999995}]},{"osd":5,"last update":"Mon May 8 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.629},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.47299999999999998}]},{"osd":6,"last update":"Mon May 8 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.46100000000000002}]},{"osd":7,"last update":"Mon May 8 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.68400000000000005}]},{"osd":8,"last update":"Mon May 8 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.67500000000000004}]},{"osd":9,"last update":"Mon May 8 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.69299999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]}]},{"osd":9,"up_from":65,"seq":279172874261,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6068,"kb_used_data":876,"kb_used_omap":0,"kb_used_meta":5184,"kb_avail":93739084,"statfs":{"total":95995035648,"available":95988822016,"internally_reserved":0,"allocated":897024,"data_stored":421471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5308416},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[7],"upper_bound":2},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 8 03:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":2.3570000000000002},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.46100000000000002}]},{"osd":1,"last update":"Mon May 8 03:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":2.339}]},{"osd":2,"last update":"Mon May 8 03:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":2.306},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":2.3839999999999999}]},{"osd":3,"last update":"Mon May 8 03:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":2.2629999999999999}]},{"osd":4,"last update":"Mon May 8 03:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":2.1720000000000002},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":1.5309999999999999}]},{"osd":5,"last update":"Mon May 8 03:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.54800000000000004}]},{"osd":6,"last update":"Mon May 8 03:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":4.7389999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":2.137}]},{"osd":7,"last update":"Mon May 8 03:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":1.458}]},{"osd":8,"last update":"Mon May 8 03:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":2.323},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":1.591}]},{"osd":10,"last update":"Mon May 8 03:40:49 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":2.206}]}]},{"osd":8,"up_from":58,"seq":249108103192,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6180,"kb_used_data":860,"kb_used_omap":0,"kb_used_meta":5312,"kb_avail":93738972,"statfs":{"total":95995035648,"available":95988707328,"internally_reserved":0,"allocated":880640,"data_stored":420926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5439488},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 8 03:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.443}]},{"osd":1,"last update":"Mon May 8 03:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.41299999999999998}]},{"osd":2,"last update":"Mon May 8 03:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.372},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.31}]},{"osd":3,"last update":"Mon May 8 03:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.49399999999999999}]},{"osd":4,"last update":"Mon May 8 03:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.48299999999999998}]},{"osd":5,"last update":"Mon May 8 03:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.55100000000000005}]},{"osd":6,"last update":"Mon May 8 03:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.51100000000000001}]},{"osd":7,"last update":"Mon May 8 03:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.67100000000000004}]},{"osd":9,"last update":"Mon May 8 03:40:25 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.623},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.53900000000000003}]},{"osd":10,"last update":"Mon May 8 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.70799999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]}]},{"osd":7,"up_from":50,"seq":214748364829,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6900,"kb_used_data":1452,"kb_used_omap":0,"kb_used_meta":5440,"kb_avail":93738252,"statfs":{"total":95995035648,"available":95987970048,"internally_reserved":0,"allocated":1486848,"data_stored":1012717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5570560},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 8 03:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.52600000000000002,"15min":0.52000000000000002},"min":{"1min":0.36899999999999999,"5min":0.311,"15min":0.311},"max":{"1min":0.76300000000000001,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.434},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.57699999999999996,"15min":0.58099999999999996},"min":{"1min":0.42799999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.66400000000000003,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.45100000000000001}]},{"osd":1,"last update":"Mon May 8 03:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.40799999999999997,"15min":0.40200000000000002},"min":{"1min":0.29499999999999998,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.45800000000000002,"15min":0.45600000000000002},"min":{"1min":0.311,"5min":0.248,"15min":0.248},"max":{"1min":0.68700000000000006,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.56299999999999994}]},{"osd":2,"last update":"Mon May 8 03:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.61699999999999999,"15min":0.61799999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.59099999999999997,"15min":0.58299999999999996},"min":{"1min":0.48499999999999999,"5min":0.378,"15min":0.378},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.58699999999999997}]},{"osd":3,"last update":"Mon May 8 03:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.54300000000000004,"15min":0.54500000000000004},"min":{"1min":0.38100000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.73399999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.58299999999999996,"15min":0.57699999999999996},"min":{"1min":0.39800000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.82099999999999995}]},{"osd":4,"last update":"Mon May 8 03:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.55600000000000005,"15min":0.56100000000000005},"min":{"1min":0.32300000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.76500000000000001,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.52700000000000002,"15min":0.52600000000000002},"min":{"1min":0.33500000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.73599999999999999,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.66600000000000004}]},{"osd":5,"last update":"Mon May 8 03:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.64200000000000002,"15min":0.63800000000000001},"min":{"1min":0.51300000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.80100000000000005,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.66500000000000004,"15min":0.66100000000000003},"min":{"1min":0.56699999999999995,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.79400000000000004,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.64500000000000002}]},{"osd":6,"last update":"Mon May 8 03:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.67100000000000004,"15min":0.66800000000000004},"min":{"1min":0.52000000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.90000000000000002,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.66200000000000003,"15min":0.65700000000000003},"min":{"1min":0.46000000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.83199999999999996}]},{"osd":8,"last update":"Mon May 8 03:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.63},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.69199999999999995}]},{"osd":9,"last update":"Mon May 8 03:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.94199999999999995}]},{"osd":10,"last update":"Mon May 8 03:40:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.878}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]}]},{"osd":6,"up_from":45,"seq":193273528352,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6176,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":5312,"kb_avail":93738976,"statfs":{"total":95995035648,"available":95988711424,"internally_reserved":0,"allocated":876544,"data_stored":420653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5439488},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 8 03:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.373,"15min":0.36499999999999999},"min":{"1min":0.31900000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.52700000000000002,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.37},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.39500000000000002,"15min":0.39100000000000001},"min":{"1min":0.29899999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.55200000000000005,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.28199999999999997}]},{"osd":1,"last update":"Mon May 8 03:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.54700000000000004,"15min":0.53900000000000003},"min":{"1min":0.45900000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.53800000000000003,"15min":0.53400000000000003},"min":{"1min":0.45100000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.313}]},{"osd":2,"last update":"Mon May 8 03:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.53900000000000003,"15min":0.53600000000000003},"min":{"1min":0.42699999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.56599999999999995,"15min":0.56000000000000005},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.54200000000000004}]},{"osd":3,"last update":"Mon May 8 03:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.434,"15min":0.42899999999999999},"min":{"1min":0.33500000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.497,"5min":0.46400000000000002,"15min":0.45800000000000002},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.64500000000000002,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.40799999999999997}]},{"osd":4,"last update":"Mon May 8 03:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.57099999999999995,"15min":0.56699999999999995},"min":{"1min":0.41299999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.628,"5min":0.59999999999999998,"15min":0.59599999999999997},"min":{"1min":0.497,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.47599999999999998}]},{"osd":5,"last update":"Mon May 8 03:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.60099999999999998,"15min":0.59499999999999997},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.62,"15min":0.61799999999999999},"min":{"1min":0.49099999999999999,"5min":0.433,"15min":0.433},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.5}]},{"osd":7,"last update":"Mon May 8 03:40:43 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.64200000000000002,"15min":0.64000000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.63800000000000001,"15min":0.63200000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.51100000000000001}]},{"osd":8,"last update":"Mon May 8 03:40:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.51900000000000002}]},{"osd":9,"last update":"Mon May 8 03:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.56799999999999995}]},{"osd":10,"last update":"Mon May 8 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.61099999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574904,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7072,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":6208,"kb_avail":93738080,"statfs":{"total":95995035648,"available":95987793920,"internally_reserved":0,"allocated":876544,"data_stored":413647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6356992},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 8 03:40:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.51200000000000001,"15min":0.496},"min":{"1min":0.372,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.81299999999999994,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.50900000000000001,"15min":0.47699999999999998},"min":{"1min":0.39200000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.93200000000000005}]},{"osd":2,"last update":"Mon May 8 03:39:52 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.52400000000000002,"15min":0.50600000000000001},"min":{"1min":0.34599999999999997,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.51400000000000001,"15min":0.49399999999999999},"min":{"1min":0.41999999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.67100000000000004}]},{"osd":3,"last update":"Mon May 8 03:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.53500000000000003,"15min":0.50800000000000001},"min":{"1min":0.44900000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.83099999999999996,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":1.3999999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.53200000000000003,"15min":0.51400000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.70899999999999996,"5min":0.879,"15min":0.879},"last":1.409}]},{"osd":4,"last update":"Mon May 8 03:40:38 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.42399999999999999,"15min":0.40600000000000003},"min":{"1min":0.30499999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.498,"15min":0.46800000000000003},"min":{"1min":0.373,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.375}]},{"osd":5,"last update":"Mon May 8 03:39:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.55400000000000005,"15min":0.55800000000000005},"min":{"1min":0.377,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.753,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56799999999999995,"15min":0.56499999999999995},"min":{"1min":0.44700000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.64000000000000001}]},{"osd":6,"last update":"Mon May 8 03:40:21 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.60699999999999998,"15min":0.59999999999999998},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":1.1719999999999999},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.61599999999999999,"15min":0.60599999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":1.3440000000000001}]},{"osd":7,"last update":"Mon May 8 03:40:43 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.55000000000000004,"15min":0.53000000000000003},"min":{"1min":0.36799999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.58799999999999997,"15min":0.56699999999999995},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.41399999999999998}]},{"osd":8,"last update":"Mon May 8 03:40:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.65100000000000002}]},{"osd":9,"last update":"Mon May 8 03:40:27 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":1.367},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":1.357}]},{"osd":10,"last update":"Mon May 8 03:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.48299999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738429,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7164,"kb_used_data":884,"kb_used_omap":0,"kb_used_meta":6272,"kb_avail":93737988,"statfs":{"total":95995035648,"available":95987699712,"internally_reserved":0,"allocated":905216,"data_stored":422131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6422528},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon May 8 03:40:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.57699999999999996,"15min":0.59799999999999998},"min":{"1min":0.40899999999999997,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.0600000000000001,"5min":1.091,"15min":1.091},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59299999999999997,"15min":0.60699999999999998},"min":{"1min":0.46300000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.66600000000000004}]},{"osd":2,"last update":"Mon May 8 03:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.53500000000000003,"15min":0.53100000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.69399999999999995,"5min":1.159,"15min":1.159},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.51800000000000002,"15min":0.505},"min":{"1min":0.35299999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.67800000000000005,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.61299999999999999}]},{"osd":3,"last update":"Mon May 8 03:39:17 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.34999999999999998,"15min":0.34300000000000003},"min":{"1min":0.26500000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.435,"5min":0.38800000000000001,"15min":0.38},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.42499999999999999}]},{"osd":4,"last update":"Mon May 8 03:40:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.54200000000000004,"15min":0.53500000000000003},"min":{"1min":0.42999999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.51700000000000002,"15min":0.51300000000000001},"min":{"1min":0.38,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.70299999999999996,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.57499999999999996}]},{"osd":5,"last update":"Mon May 8 03:39:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.58499999999999996,"15min":0.58099999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.78600000000000003,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.54000000000000004}]},{"osd":6,"last update":"Mon May 8 03:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.46500000000000002,"15min":0.46100000000000002},"min":{"1min":0.34599999999999997,"5min":0.308,"15min":0.308},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.53900000000000003,"15min":0.53300000000000003},"min":{"1min":0.39400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.74099999999999999,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.48799999999999999}]},{"osd":7,"last update":"Mon May 8 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.61499999999999999,"15min":0.60899999999999999},"min":{"1min":0.48399999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.59499999999999997,"15min":0.59299999999999997},"min":{"1min":0.41999999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.47899999999999998}]},{"osd":8,"last update":"Mon May 8 03:40:04 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.55900000000000005}]},{"osd":9,"last update":"Mon May 8 03:40:26 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.442}]},{"osd":10,"last update":"Mon May 8 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.60499999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]}]},{"osd":2,"up_from":18,"seq":77309411380,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7160,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":6272,"kb_avail":93737992,"statfs":{"total":95995035648,"available":95987703808,"internally_reserved":0,"allocated":901120,"data_stored":422825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6422528},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 8 03:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.52200000000000002,"15min":0.52000000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.9590000000000001,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.53800000000000003,"15min":0.51900000000000002},"min":{"1min":0.38,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":2.044,"5min":2.044,"15min":2.044},"last":0.51600000000000001}]},{"osd":1,"last update":"Mon May 8 03:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.51600000000000001,"15min":0.51300000000000001},"min":{"1min":0.33300000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.52700000000000002,"15min":0.53100000000000003},"min":{"1min":0.38700000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.35499999999999998}]},{"osd":3,"last update":"Mon May 8 03:40:19 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.55000000000000004},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.76900000000000002,"5min":4.8419999999999996,"15min":4.8419999999999996},"last":0.435},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.62,"15min":0.58499999999999996},"min":{"1min":0.44600000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.73799999999999999,"5min":4.8220000000000001,"15min":4.8220000000000001},"last":0.628}]},{"osd":4,"last update":"Mon May 8 03:40:36 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.53100000000000003,"15min":0.51700000000000002},"min":{"1min":0.39900000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.55700000000000005,"15min":0.54800000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.53700000000000003}]},{"osd":5,"last update":"Mon May 8 03:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.45500000000000002,"15min":0.45800000000000002},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.50700000000000001,"15min":0.51300000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.64200000000000002,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.45200000000000001}]},{"osd":6,"last update":"Mon May 8 03:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65000000000000002,"15min":0.64900000000000002},"min":{"1min":0.46400000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.86799999999999999,"5min":1.887,"15min":1.887},"last":0.38},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.58699999999999997,"15min":0.58299999999999996},"min":{"1min":0.45100000000000001,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.81000000000000005,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.55300000000000005}]},{"osd":7,"last update":"Mon May 8 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.61399999999999999,"15min":0.60199999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.58299999999999996,"15min":0.56599999999999995},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.46200000000000002}]},{"osd":8,"last update":"Mon May 8 03:40:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.68999999999999995}]},{"osd":9,"last update":"Mon May 8 03:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.60799999999999998}]},{"osd":10,"last update":"Mon May 8 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.59099999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]}]},{"osd":3,"up_from":25,"seq":107374182447,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6512,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":5632,"kb_avail":93738640,"statfs":{"total":95995035648,"available":95988367360,"internally_reserved":0,"allocated":892928,"data_stored":420729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5767168},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 8 03:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.35599999999999998,"15min":0.34399999999999997},"min":{"1min":0.27700000000000002,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.39200000000000002,"15min":0.38200000000000001},"min":{"1min":0.29999999999999999,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.51000000000000001}]},{"osd":1,"last update":"Mon May 8 03:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.50900000000000001,"15min":0.49299999999999999},"min":{"1min":0.38200000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.497},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.53000000000000003,"15min":0.50800000000000001},"min":{"1min":0.42699999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.80800000000000005,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.61399999999999999}]},{"osd":2,"last update":"Mon May 8 03:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.54500000000000004,"15min":0.52700000000000002},"min":{"1min":0.43099999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.55600000000000005,"15min":0.53000000000000003},"min":{"1min":0.41499999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.78000000000000003,"5min":2.351,"15min":2.351},"last":0.53300000000000003}]},{"osd":4,"last update":"Mon May 8 03:40:38 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.54400000000000004,"15min":0.52100000000000002},"min":{"1min":0.47399999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.878,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.55700000000000005,"15min":0.53300000000000003},"min":{"1min":0.45100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.88400000000000001,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.53800000000000003}]},{"osd":5,"last update":"Mon May 8 03:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.73599999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.58599999999999997,"15min":0.57999999999999996},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.67200000000000004}]},{"osd":6,"last update":"Mon May 8 03:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.47399999999999998,"15min":0.45800000000000002},"min":{"1min":0.378,"5min":0.312,"15min":0.312},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.49099999999999999,"15min":0.47799999999999998},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.45900000000000002}]},{"osd":7,"last update":"Mon May 8 03:40:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.58899999999999997,"15min":0.57899999999999996},"min":{"1min":0.42999999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.71099999999999997,"15min":0.71199999999999997},"min":{"1min":0.44600000000000001,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.01,"5min":2.3740000000000001,"15min":2.3740000000000001},"last":0.64700000000000002}]},{"osd":8,"last update":"Mon May 8 03:40:03 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.46200000000000002}]},{"osd":9,"last update":"Mon May 8 03:40:26 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.57599999999999996}]},{"osd":10,"last update":"Mon May 8 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.621},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.69299999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]}]},{"osd":4,"up_from":33,"seq":141733920810,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6380,"kb_used_data":868,"kb_used_omap":0,"kb_used_meta":5504,"kb_avail":93738772,"statfs":{"total":95995035648,"available":95988502528,"internally_reserved":0,"allocated":888832,"data_stored":421249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5636096},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 8 03:40:39 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.55400000000000005,"15min":0.55000000000000004},"min":{"1min":0.38500000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.80400000000000005,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.53300000000000003,"15min":0.51700000000000002},"min":{"1min":0.42799999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76300000000000001,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.57399999999999995}]},{"osd":1,"last update":"Mon May 8 03:40:39 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.36899999999999999,"15min":0.34000000000000002},"min":{"1min":0.27400000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.38900000000000001,"15min":0.35699999999999998},"min":{"1min":0.29099999999999998,"5min":0.254,"15min":0.254},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.41299999999999998}]},{"osd":2,"last update":"Mon May 8 03:40:39 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.54800000000000004,"15min":0.52800000000000002},"min":{"1min":0.38600000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.56699999999999995,"15min":0.54900000000000004},"min":{"1min":0.40200000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.436}]},{"osd":3,"last update":"Mon May 8 03:40:39 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.54300000000000004,"15min":0.51800000000000002},"min":{"1min":0.41999999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.79800000000000004,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.54800000000000004,"15min":0.53300000000000003},"min":{"1min":0.40400000000000003,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.39200000000000002}]},{"osd":5,"last update":"Mon May 8 03:40:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.57399999999999995,"15min":0.57199999999999995},"min":{"1min":0.41799999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58699999999999997,"15min":0.58499999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.48799999999999999}]},{"osd":6,"last update":"Mon May 8 03:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.61899999999999999,"15min":0.61299999999999999},"min":{"1min":0.47199999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.623,"15min":0.60899999999999999},"min":{"1min":0.48399999999999999,"5min":0.436,"15min":0.436},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.54600000000000004}]},{"osd":7,"last update":"Mon May 8 03:40:39 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.57099999999999995,"15min":0.56000000000000005},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.56899999999999995,"15min":0.55700000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.32400000000000001}]},{"osd":8,"last update":"Mon May 8 03:40:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.53700000000000003}]},{"osd":9,"last update":"Mon May 8 03:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.498},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.57499999999999996}]},{"osd":10,"last update":"Mon May 8 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.61299999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]}]},{"osd":5,"up_from":38,"seq":163208757286,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6948,"kb_used_data":1436,"kb_used_omap":0,"kb_used_meta":5504,"kb_avail":93738204,"statfs":{"total":95995035648,"available":95987920896,"internally_reserved":0,"allocated":1470464,"data_stored":1002633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5636096},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 8 03:40:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.499,"15min":0.48699999999999999},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.51000000000000001,"15min":0.5},"min":{"1min":0.39400000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.42899999999999999}]},{"osd":1,"last update":"Mon May 8 03:40:01 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.53400000000000003,"15min":0.53000000000000003},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.55300000000000005,"15min":0.54800000000000004},"min":{"1min":0.35799999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.60099999999999998}]},{"osd":2,"last update":"Mon May 8 03:40:01 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.378,"15min":0.372},"min":{"1min":0.33300000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.59099999999999997,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.443},{"interface":"front","average":{"1min":0.438,"5min":0.40000000000000002,"15min":0.39400000000000002},"min":{"1min":0.30099999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.77200000000000002,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.30199999999999999}]},{"osd":3,"last update":"Mon May 8 03:40:01 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.51500000000000001,"15min":0.498},"min":{"1min":0.35399999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.52900000000000003,"15min":0.52100000000000002},"min":{"1min":0.39000000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.48699999999999999}]},{"osd":4,"last update":"Mon May 8 03:40:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.56999999999999995,"15min":0.56499999999999995},"min":{"1min":0.44600000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.80300000000000005,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.624,"5min":0.57299999999999995,"15min":0.56499999999999995},"min":{"1min":0.45800000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.624}]},{"osd":6,"last update":"Mon May 8 03:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.56999999999999995,"15min":0.54900000000000004},"min":{"1min":0.42799999999999999,"5min":0.376,"15min":0.376},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.54500000000000004,"15min":0.52900000000000003},"min":{"1min":0.502,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.52900000000000003}]},{"osd":7,"last update":"Mon May 8 03:40:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.627,"15min":0.625},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.92300000000000004,"5min":1.018,"15min":1.018},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.62,"5min":0.63300000000000001,"15min":0.63500000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.82299999999999995,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.65000000000000002}]},{"osd":8,"last update":"Mon May 8 03:40:01 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.47499999999999998}]},{"osd":9,"last update":"Mon May 8 03:40:26 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.504},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.68600000000000005}]},{"osd":10,"last update":"Mon May 8 03:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.70599999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-08T03:40:56.994 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-08T03:40:57.146 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:57.142+0000 7f3b33627700 1 -- 172.21.15.96:0/3168385549 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b2c100ef0 msgr2=0x7f3b2c107790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:57.147 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:57.142+0000 7f3b33627700 1 --2- 172.21.15.96:0/3168385549 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b2c100ef0 0x7f3b2c107790 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3b2400b0a0 tx=0x7f3b2400b3b0 comp rx=0 tx=0).stop 2023-05-08T03:40:57.147 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:57.142+0000 7f3b33627700 1 -- 172.21.15.96:0/3168385549 shutdown_connections 2023-05-08T03:40:57.147 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:57.142+0000 7f3b33627700 1 --2- 172.21.15.96:0/3168385549 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b2c100ef0 0x7f3b2c107790 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:57.147 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:57.142+0000 7f3b33627700 1 --2- 172.21.15.96:0/3168385549 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b2c0ff830 0x7f3b2c0ffc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:57.147 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:57.142+0000 7f3b33627700 1 --2- 172.21.15.96:0/3168385549 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3b2c100540 0x7f3b2c1009b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:57.147 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:57.142+0000 7f3b33627700 1 -- 172.21.15.96:0/3168385549 >> 172.21.15.96:0/3168385549 conn(0x7f3b2c0fa0b0 msgr2=0x7f3b2c0fc4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:57.147 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:57.142+0000 7f3b33627700 1 -- 172.21.15.96:0/3168385549 shutdown_connections 2023-05-08T03:40:57.148 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:57.142+0000 7f3b33627700 1 -- 172.21.15.96:0/3168385549 wait complete. 2023-05-08T03:40:57.148 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:57.143+0000 7f3b33627700 1 Processor -- start 2023-05-08T03:40:57.148 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:57.143+0000 7f3b33627700 1 -- start start 2023-05-08T03:40:57.148 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:57.143+0000 7f3b33627700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3b2c0ff830 0x7f3b2c0fef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:57.148 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:57.143+0000 7f3b33627700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b2c100540 0x7f3b2c19aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:57.148 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:57.143+0000 7f3b33627700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b2c100ef0 0x7f3b2c19d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:57.148 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:57.143+0000 7f3b33627700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2c19dcd0 con 0x7f3b2c100ef0 2023-05-08T03:40:57.149 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:57.143+0000 7f3b33627700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2c19de40 con 0x7f3b2c100540 2023-05-08T03:40:57.149 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:57.143+0000 7f3b33627700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2c19e000 con 0x7f3b2c0ff830 2023-05-08T03:40:57.149 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:57.143+0000 7f3b31bc4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b2c100ef0 0x7f3b2c19d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:57.149 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:57.143+0000 7f3b31bc4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b2c100ef0 0x7f3b2c19d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40634/0 (socket says 172.21.15.96:40634) 2023-05-08T03:40:57.149 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:57.143+0000 7f3b31bc4700 1 -- 172.21.15.96:0/2842014809 learned_addr learned my addr 172.21.15.96:0/2842014809 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:40:57.149 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:57.143+0000 7f3b30bc2700 1 --2- 172.21.15.96:0/2842014809 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b2c100540 0x7f3b2c19aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:57.149 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:57.143+0000 7f3b313c3700 1 --2- 172.21.15.96:0/2842014809 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3b2c0ff830 0x7f3b2c0fef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:57.149 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:57.144+0000 7f3b31bc4700 1 -- 172.21.15.96:0/2842014809 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3b2c0ff830 msgr2=0x7f3b2c0fef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:57.150 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:57.144+0000 7f3b31bc4700 1 --2- 172.21.15.96:0/2842014809 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3b2c0ff830 0x7f3b2c0fef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:57.150 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:57.144+0000 7f3b31bc4700 1 -- 172.21.15.96:0/2842014809 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b2c100540 msgr2=0x7f3b2c19aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:57.150 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:57.144+0000 7f3b31bc4700 1 --2- 172.21.15.96:0/2842014809 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b2c100540 0x7f3b2c19aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:57.150 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:57.144+0000 7f3b31bc4700 1 -- 172.21.15.96:0/2842014809 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b24009d00 con 0x7f3b2c100ef0 2023-05-08T03:40:57.150 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:57.144+0000 7f3b313c3700 1 --2- 172.21.15.96:0/2842014809 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3b2c0ff830 0x7f3b2c0fef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-08T03:40:57.150 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:57.144+0000 7f3b30bc2700 1 --2- 172.21.15.96:0/2842014809 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b2c100540 0x7f3b2c19aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-08T03:40:57.150 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:57.144+0000 7f3b31bc4700 1 --2- 172.21.15.96:0/2842014809 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b2c100ef0 0x7f3b2c19d500 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3b240062a0 tx=0x7f3b24004db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:57.151 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:57.144+0000 7f3b1e7fc700 1 -- 172.21.15.96:0/2842014809 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2400e040 con 0x7f3b2c100ef0 2023-05-08T03:40:57.151 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:57.144+0000 7f3b1e7fc700 1 -- 172.21.15.96:0/2842014809 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3b2401db50 con 0x7f3b2c100ef0 2023-05-08T03:40:57.151 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:57.144+0000 7f3b33627700 1 -- 172.21.15.96:0/2842014809 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b2c10ac80 con 0x7f3b2c100ef0 2023-05-08T03:40:57.151 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:57.144+0000 7f3b1e7fc700 1 -- 172.21.15.96:0/2842014809 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2401bc40 con 0x7f3b2c100ef0 2023-05-08T03:40:57.151 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:57.144+0000 7f3b33627700 1 -- 172.21.15.96:0/2842014809 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b2c10aaf0 con 0x7f3b2c100ef0 2023-05-08T03:40:57.152 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:57.145+0000 7f3b33627700 1 -- 172.21.15.96:0/2842014809 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b2c067f40 con 0x7f3b2c100ef0 2023-05-08T03:40:57.152 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:57.146+0000 7f3b1e7fc700 1 -- 172.21.15.96:0/2842014809 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f3b2401d690 con 0x7f3b2c100ef0 2023-05-08T03:40:57.152 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:57.147+0000 7f3b1e7fc700 1 --2- 172.21.15.96:0/2842014809 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f3b180a11e0 0x7f3b180a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:57.153 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:57.147+0000 7f3b313c3700 1 --2- 172.21.15.96:0/2842014809 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f3b180a11e0 0x7f3b180a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:57.153 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:57.147+0000 7f3b1e7fc700 1 -- 172.21.15.96:0/2842014809 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f3b240cec90 con 0x7f3b2c100ef0 2023-05-08T03:40:57.153 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:57.147+0000 7f3b313c3700 1 --2- 172.21.15.96:0/2842014809 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f3b180a11e0 0x7f3b180a3690 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c068c80 tx=0x7f3b20005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:57.153 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:57.151+0000 7f3b1e7fc700 1 -- 172.21.15.96:0/2842014809 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f3b240984c0 con 0x7f3b2c100ef0 2023-05-08T03:40:57.345 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:57.342+0000 7f3b33627700 1 -- 172.21.15.96:0/2842014809 --> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3b2c061030 con 0x7f3b180a11e0 2023-05-08T03:40:57.354 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:57.352+0000 7f3b1e7fc700 1 -- 172.21.15.96:0/2842014809 <== mgr.14152 v2:172.21.15.96:6800/2748629182 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+336250 (secure 0 0 0) 0x7f3b2c061030 con 0x7f3b180a11e0 2023-05-08T03:40:57.357 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:40:57.359 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:57.355+0000 7f3b33627700 1 -- 172.21.15.96:0/2842014809 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f3b180a11e0 msgr2=0x7f3b180a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:57.359 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:57.355+0000 7f3b33627700 1 --2- 172.21.15.96:0/2842014809 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f3b180a11e0 0x7f3b180a3690 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c068c80 tx=0x7f3b20005f90 comp rx=0 tx=0).stop 2023-05-08T03:40:57.360 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:57.355+0000 7f3b33627700 1 -- 172.21.15.96:0/2842014809 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b2c100ef0 msgr2=0x7f3b2c19d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:57.360 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:57.355+0000 7f3b33627700 1 --2- 172.21.15.96:0/2842014809 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b2c100ef0 0x7f3b2c19d500 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3b240062a0 tx=0x7f3b24004db0 comp rx=0 tx=0).stop 2023-05-08T03:40:57.360 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:57.355+0000 7f3b33627700 1 -- 172.21.15.96:0/2842014809 shutdown_connections 2023-05-08T03:40:57.360 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:57.355+0000 7f3b33627700 1 --2- 172.21.15.96:0/2842014809 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f3b180a11e0 0x7f3b180a3690 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:57.360 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:57.355+0000 7f3b33627700 1 --2- 172.21.15.96:0/2842014809 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b2c100ef0 0x7f3b2c19d500 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:57.360 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:57.355+0000 7f3b33627700 1 --2- 172.21.15.96:0/2842014809 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3b2c0ff830 0x7f3b2c0fef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:57.360 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:57.355+0000 7f3b33627700 1 --2- 172.21.15.96:0/2842014809 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b2c100540 0x7f3b2c19aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:57.361 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:57.355+0000 7f3b33627700 1 -- 172.21.15.96:0/2842014809 >> 172.21.15.96:0/2842014809 conn(0x7f3b2c0fa0b0 msgr2=0x7f3b2c0fc230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:57.361 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:57.355+0000 7f3b33627700 1 -- 172.21.15.96:0/2842014809 shutdown_connections 2023-05-08T03:40:57.361 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:57.355+0000 7f3b33627700 1 -- 172.21.15.96:0/2842014809 wait complete. 2023-05-08T03:40:57.361 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2023-05-08T03:40:57.370 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":261,"stamp":"2023-05-08T03:40:55.547306+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":593976,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":263,"num_write_kb":2962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":207,"ondisk_log_size":207,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":236,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":79184,"kb_used_data":12144,"kb_used_omap":0,"kb_used_meta":66944,"kb_avail":1124862640,"statfs":{"total":1151940427776,"available":1151859343360,"internally_reserved":0,"allocated":12435456,"data_stored":6803843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":68550656},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[7],"upper_bound":2},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3608,"num_objects":38,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.764394"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.290515+0000","last_change":"2023-05-08T03:40:49.238180+0000","last_active":"2023-05-08T03:40:50.290515+0000","last_peered":"2023-05-08T03:40:50.290515+0000","last_clean":"2023-05-08T03:40:50.290515+0000","last_became_active":"2023-05-08T03:40:49.237400+0000","last_became_peered":"2023-05-08T03:40:49.237400+0000","last_unstale":"2023-05-08T03:40:50.290515+0000","last_undegraded":"2023-05-08T03:40:50.290515+0000","last_fullsized":"2023-05-08T03:40:50.290515+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T11:27:00.446105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991619+0000","last_change":"2023-05-08T03:40:49.232533+0000","last_active":"2023-05-08T03:40:51.991619+0000","last_peered":"2023-05-08T03:40:51.991619+0000","last_clean":"2023-05-08T03:40:51.991619+0000","last_became_active":"2023-05-08T03:40:49.232246+0000","last_became_peered":"2023-05-08T03:40:49.232246+0000","last_unstale":"2023-05-08T03:40:51.991619+0000","last_undegraded":"2023-05-08T03:40:51.991619+0000","last_fullsized":"2023-05-08T03:40:51.991619+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T06:19:28.497539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991622+0000","last_change":"2023-05-08T03:40:49.236848+0000","last_active":"2023-05-08T03:40:51.991622+0000","last_peered":"2023-05-08T03:40:51.991622+0000","last_clean":"2023-05-08T03:40:51.991622+0000","last_became_active":"2023-05-08T03:40:49.236506+0000","last_became_peered":"2023-05-08T03:40:49.236506+0000","last_unstale":"2023-05-08T03:40:51.991622+0000","last_undegraded":"2023-05-08T03:40:51.991622+0000","last_fullsized":"2023-05-08T03:40:51.991622+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T09:55:30.234804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.222849+0000","last_change":"2023-05-08T03:40:49.233941+0000","last_active":"2023-05-08T03:40:50.222849+0000","last_peered":"2023-05-08T03:40:50.222849+0000","last_clean":"2023-05-08T03:40:50.222849+0000","last_became_active":"2023-05-08T03:40:49.232969+0000","last_became_peered":"2023-05-08T03:40:49.232969+0000","last_unstale":"2023-05-08T03:40:50.222849+0000","last_undegraded":"2023-05-08T03:40:50.222849+0000","last_fullsized":"2023-05-08T03:40:50.222849+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T05:51:05.543005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.224768+0000","last_change":"2023-05-08T03:40:49.229455+0000","last_active":"2023-05-08T03:40:50.224768+0000","last_peered":"2023-05-08T03:40:50.224768+0000","last_clean":"2023-05-08T03:40:50.224768+0000","last_became_active":"2023-05-08T03:40:49.229118+0000","last_became_peered":"2023-05-08T03:40:49.229118+0000","last_unstale":"2023-05-08T03:40:50.224768+0000","last_undegraded":"2023-05-08T03:40:50.224768+0000","last_fullsized":"2023-05-08T03:40:50.224768+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T09:17:55.353149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.299436+0000","last_change":"2023-05-08T03:40:49.237344+0000","last_active":"2023-05-08T03:40:51.299436+0000","last_peered":"2023-05-08T03:40:51.299436+0000","last_clean":"2023-05-08T03:40:51.299436+0000","last_became_active":"2023-05-08T03:40:49.236775+0000","last_became_peered":"2023-05-08T03:40:49.236775+0000","last_unstale":"2023-05-08T03:40:51.299436+0000","last_undegraded":"2023-05-08T03:40:51.299436+0000","last_fullsized":"2023-05-08T03:40:51.299436+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T12:50:19.957755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991259+0000","last_change":"2023-05-08T03:40:49.235549+0000","last_active":"2023-05-08T03:40:51.991259+0000","last_peered":"2023-05-08T03:40:51.991259+0000","last_clean":"2023-05-08T03:40:51.991259+0000","last_became_active":"2023-05-08T03:40:49.235223+0000","last_became_peered":"2023-05-08T03:40:49.235223+0000","last_unstale":"2023-05-08T03:40:51.991259+0000","last_undegraded":"2023-05-08T03:40:51.991259+0000","last_fullsized":"2023-05-08T03:40:51.991259+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T09:45:50.518957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:52.175162+0000","last_change":"2023-05-08T03:40:49.234923+0000","last_active":"2023-05-08T03:40:52.175162+0000","last_peered":"2023-05-08T03:40:52.175162+0000","last_clean":"2023-05-08T03:40:52.175162+0000","last_became_active":"2023-05-08T03:40:49.234630+0000","last_became_peered":"2023-05-08T03:40:49.234630+0000","last_unstale":"2023-05-08T03:40:52.175162+0000","last_undegraded":"2023-05-08T03:40:52.175162+0000","last_fullsized":"2023-05-08T03:40:52.175162+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T10:54:09.908673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-08T03:40:49.243948+0000","last_change":"2023-05-08T03:40:49.243476+0000","last_active":"2023-05-08T03:40:49.243948+0000","last_peered":"2023-05-08T03:40:49.243948+0000","last_clean":"2023-05-08T03:40:49.243948+0000","last_became_active":"2023-05-08T03:40:49.243134+0000","last_became_peered":"2023-05-08T03:40:49.243134+0000","last_unstale":"2023-05-08T03:40:49.243948+0000","last_undegraded":"2023-05-08T03:40:49.243948+0000","last_fullsized":"2023-05-08T03:40:49.243948+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T04:42:56.917785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.299799+0000","last_change":"2023-05-08T03:40:49.238538+0000","last_active":"2023-05-08T03:40:51.299799+0000","last_peered":"2023-05-08T03:40:51.299799+0000","last_clean":"2023-05-08T03:40:51.299799+0000","last_became_active":"2023-05-08T03:40:49.237867+0000","last_became_peered":"2023-05-08T03:40:49.237867+0000","last_unstale":"2023-05-08T03:40:51.299799+0000","last_undegraded":"2023-05-08T03:40:51.299799+0000","last_fullsized":"2023-05-08T03:40:51.299799+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T15:14:54.147583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991704+0000","last_change":"2023-05-08T03:40:49.242175+0000","last_active":"2023-05-08T03:40:51.991704+0000","last_peered":"2023-05-08T03:40:51.991704+0000","last_clean":"2023-05-08T03:40:51.991704+0000","last_became_active":"2023-05-08T03:40:49.241878+0000","last_became_peered":"2023-05-08T03:40:49.241878+0000","last_unstale":"2023-05-08T03:40:51.991704+0000","last_undegraded":"2023-05-08T03:40:51.991704+0000","last_fullsized":"2023-05-08T03:40:51.991704+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T09:51:42.194781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.222799+0000","last_change":"2023-05-08T03:40:49.234199+0000","last_active":"2023-05-08T03:40:50.222799+0000","last_peered":"2023-05-08T03:40:50.222799+0000","last_clean":"2023-05-08T03:40:50.222799+0000","last_became_active":"2023-05-08T03:40:49.233408+0000","last_became_peered":"2023-05-08T03:40:49.233408+0000","last_unstale":"2023-05-08T03:40:50.222799+0000","last_undegraded":"2023-05-08T03:40:50.222799+0000","last_fullsized":"2023-05-08T03:40:50.222799+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T13:32:03.844376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.222261+0000","last_change":"2023-05-08T03:40:49.235750+0000","last_active":"2023-05-08T03:40:50.222261+0000","last_peered":"2023-05-08T03:40:50.222261+0000","last_clean":"2023-05-08T03:40:50.222261+0000","last_became_active":"2023-05-08T03:40:49.235443+0000","last_became_peered":"2023-05-08T03:40:49.235443+0000","last_unstale":"2023-05-08T03:40:50.222261+0000","last_undegraded":"2023-05-08T03:40:50.222261+0000","last_fullsized":"2023-05-08T03:40:50.222261+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T08:33:00.870579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991226+0000","last_change":"2023-05-08T03:40:49.234269+0000","last_active":"2023-05-08T03:40:51.991226+0000","last_peered":"2023-05-08T03:40:51.991226+0000","last_clean":"2023-05-08T03:40:51.991226+0000","last_became_active":"2023-05-08T03:40:49.233794+0000","last_became_peered":"2023-05-08T03:40:49.233794+0000","last_unstale":"2023-05-08T03:40:51.991226+0000","last_undegraded":"2023-05-08T03:40:51.991226+0000","last_fullsized":"2023-05-08T03:40:51.991226+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T15:01:13.031055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991052+0000","last_change":"2023-05-08T03:40:49.236952+0000","last_active":"2023-05-08T03:40:51.991052+0000","last_peered":"2023-05-08T03:40:51.991052+0000","last_clean":"2023-05-08T03:40:51.991052+0000","last_became_active":"2023-05-08T03:40:49.236406+0000","last_became_peered":"2023-05-08T03:40:49.236406+0000","last_unstale":"2023-05-08T03:40:51.991052+0000","last_undegraded":"2023-05-08T03:40:51.991052+0000","last_fullsized":"2023-05-08T03:40:51.991052+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T11:19:43.015225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-08T03:40:49.236018+0000","last_change":"2023-05-08T03:40:49.231719+0000","last_active":"2023-05-08T03:40:49.236018+0000","last_peered":"2023-05-08T03:40:49.236018+0000","last_clean":"2023-05-08T03:40:49.236018+0000","last_became_active":"2023-05-08T03:40:49.231397+0000","last_became_peered":"2023-05-08T03:40:49.231397+0000","last_unstale":"2023-05-08T03:40:49.236018+0000","last_undegraded":"2023-05-08T03:40:49.236018+0000","last_fullsized":"2023-05-08T03:40:49.236018+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T09:44:33.882379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.290675+0000","last_change":"2023-05-08T03:40:49.238441+0000","last_active":"2023-05-08T03:40:50.290675+0000","last_peered":"2023-05-08T03:40:50.290675+0000","last_clean":"2023-05-08T03:40:50.290675+0000","last_became_active":"2023-05-08T03:40:49.237893+0000","last_became_peered":"2023-05-08T03:40:49.237893+0000","last_unstale":"2023-05-08T03:40:50.290675+0000","last_undegraded":"2023-05-08T03:40:50.290675+0000","last_fullsized":"2023-05-08T03:40:50.290675+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T08:32:34.443745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991614+0000","last_change":"2023-05-08T03:40:49.233431+0000","last_active":"2023-05-08T03:40:51.991614+0000","last_peered":"2023-05-08T03:40:51.991614+0000","last_clean":"2023-05-08T03:40:51.991614+0000","last_became_active":"2023-05-08T03:40:49.233176+0000","last_became_peered":"2023-05-08T03:40:49.233176+0000","last_unstale":"2023-05-08T03:40:51.991614+0000","last_undegraded":"2023-05-08T03:40:51.991614+0000","last_fullsized":"2023-05-08T03:40:51.991614+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T05:33:31.755761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.273400+0000","last_change":"2023-05-08T03:40:49.233907+0000","last_active":"2023-05-08T03:40:51.273400+0000","last_peered":"2023-05-08T03:40:51.273400+0000","last_clean":"2023-05-08T03:40:51.273400+0000","last_became_active":"2023-05-08T03:40:49.233613+0000","last_became_peered":"2023-05-08T03:40:49.233613+0000","last_unstale":"2023-05-08T03:40:51.273400+0000","last_undegraded":"2023-05-08T03:40:51.273400+0000","last_fullsized":"2023-05-08T03:40:51.273400+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T13:34:47.424659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"82'9","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:53.358851+0000","last_change":"2023-05-08T03:40:48.803593+0000","last_active":"2023-05-08T03:40:53.358851+0000","last_peered":"2023-05-08T03:40:53.358851+0000","last_clean":"2023-05-08T03:40:53.358851+0000","last_became_active":"2023-05-08T03:40:48.803287+0000","last_became_peered":"2023-05-08T03:40:48.803287+0000","last_unstale":"2023-05-08T03:40:53.358851+0000","last_undegraded":"2023-05-08T03:40:53.358851+0000","last_fullsized":"2023-05-08T03:40:53.358851+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T14:21:33.903600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:52.175694+0000","last_change":"2023-05-08T03:40:49.238211+0000","last_active":"2023-05-08T03:40:52.175694+0000","last_peered":"2023-05-08T03:40:52.175694+0000","last_clean":"2023-05-08T03:40:52.175694+0000","last_became_active":"2023-05-08T03:40:49.237883+0000","last_became_peered":"2023-05-08T03:40:49.237883+0000","last_unstale":"2023-05-08T03:40:52.175694+0000","last_undegraded":"2023-05-08T03:40:52.175694+0000","last_fullsized":"2023-05-08T03:40:52.175694+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T11:47:15.524106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:52.175718+0000","last_change":"2023-05-08T03:40:48.799399+0000","last_active":"2023-05-08T03:40:52.175718+0000","last_peered":"2023-05-08T03:40:52.175718+0000","last_clean":"2023-05-08T03:40:52.175718+0000","last_became_active":"2023-05-08T03:40:48.798814+0000","last_became_peered":"2023-05-08T03:40:48.798814+0000","last_unstale":"2023-05-08T03:40:52.175718+0000","last_undegraded":"2023-05-08T03:40:52.175718+0000","last_fullsized":"2023-05-08T03:40:52.175718+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T06:10:49.650922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991705+0000","last_change":"2023-05-08T03:40:49.232111+0000","last_active":"2023-05-08T03:40:51.991705+0000","last_peered":"2023-05-08T03:40:51.991705+0000","last_clean":"2023-05-08T03:40:51.991705+0000","last_became_active":"2023-05-08T03:40:49.231440+0000","last_became_peered":"2023-05-08T03:40:49.231440+0000","last_unstale":"2023-05-08T03:40:51.991705+0000","last_undegraded":"2023-05-08T03:40:51.991705+0000","last_fullsized":"2023-05-08T03:40:51.991705+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T10:44:44.588384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"81'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.225246+0000","last_change":"2023-05-08T03:40:48.801407+0000","last_active":"2023-05-08T03:40:50.225246+0000","last_peered":"2023-05-08T03:40:50.225246+0000","last_clean":"2023-05-08T03:40:50.225246+0000","last_became_active":"2023-05-08T03:40:48.801023+0000","last_became_peered":"2023-05-08T03:40:48.801023+0000","last_unstale":"2023-05-08T03:40:50.225246+0000","last_undegraded":"2023-05-08T03:40:50.225246+0000","last_fullsized":"2023-05-08T03:40:50.225246+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T10:23:23.191427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-08T03:40:49.241965+0000","last_change":"2023-05-08T03:40:49.240406+0000","last_active":"2023-05-08T03:40:49.241965+0000","last_peered":"2023-05-08T03:40:49.241965+0000","last_clean":"2023-05-08T03:40:49.241965+0000","last_became_active":"2023-05-08T03:40:49.240078+0000","last_became_peered":"2023-05-08T03:40:49.240078+0000","last_unstale":"2023-05-08T03:40:49.241965+0000","last_undegraded":"2023-05-08T03:40:49.241965+0000","last_fullsized":"2023-05-08T03:40:49.241965+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T04:41:43.319934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.224945+0000","last_change":"2023-05-08T03:40:48.804918+0000","last_active":"2023-05-08T03:40:50.224945+0000","last_peered":"2023-05-08T03:40:50.224945+0000","last_clean":"2023-05-08T03:40:50.224945+0000","last_became_active":"2023-05-08T03:40:48.804489+0000","last_became_peered":"2023-05-08T03:40:48.804489+0000","last_unstale":"2023-05-08T03:40:50.224945+0000","last_undegraded":"2023-05-08T03:40:50.224945+0000","last_fullsized":"2023-05-08T03:40:50.224945+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T15:23:01.925119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.268788+0000","last_change":"2023-05-08T03:40:49.235173+0000","last_active":"2023-05-08T03:40:51.268788+0000","last_peered":"2023-05-08T03:40:51.268788+0000","last_clean":"2023-05-08T03:40:51.268788+0000","last_became_active":"2023-05-08T03:40:49.234823+0000","last_became_peered":"2023-05-08T03:40:49.234823+0000","last_unstale":"2023-05-08T03:40:51.268788+0000","last_undegraded":"2023-05-08T03:40:51.268788+0000","last_fullsized":"2023-05-08T03:40:51.268788+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T08:27:47.581290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"81'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.268575+0000","last_change":"2023-05-08T03:40:48.803696+0000","last_active":"2023-05-08T03:40:51.268575+0000","last_peered":"2023-05-08T03:40:51.268575+0000","last_clean":"2023-05-08T03:40:51.268575+0000","last_became_active":"2023-05-08T03:40:48.803340+0000","last_became_peered":"2023-05-08T03:40:48.803340+0000","last_unstale":"2023-05-08T03:40:51.268575+0000","last_undegraded":"2023-05-08T03:40:51.268575+0000","last_fullsized":"2023-05-08T03:40:51.268575+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T09:28:08.077623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.224896+0000","last_change":"2023-05-08T03:40:49.226368+0000","last_active":"2023-05-08T03:40:50.224896+0000","last_peered":"2023-05-08T03:40:50.224896+0000","last_clean":"2023-05-08T03:40:50.224896+0000","last_became_active":"2023-05-08T03:40:49.226071+0000","last_became_peered":"2023-05-08T03:40:49.226071+0000","last_unstale":"2023-05-08T03:40:50.224896+0000","last_undegraded":"2023-05-08T03:40:50.224896+0000","last_fullsized":"2023-05-08T03:40:50.224896+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T13:09:03.133860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"81'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.299427+0000","last_change":"2023-05-08T03:40:48.801763+0000","last_active":"2023-05-08T03:40:51.299427+0000","last_peered":"2023-05-08T03:40:51.299427+0000","last_clean":"2023-05-08T03:40:51.299427+0000","last_became_active":"2023-05-08T03:40:48.801424+0000","last_became_peered":"2023-05-08T03:40:48.801424+0000","last_unstale":"2023-05-08T03:40:51.299427+0000","last_undegraded":"2023-05-08T03:40:51.299427+0000","last_fullsized":"2023-05-08T03:40:51.299427+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T06:59:02.055492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.268665+0000","last_change":"2023-05-08T03:40:49.228114+0000","last_active":"2023-05-08T03:40:51.268665+0000","last_peered":"2023-05-08T03:40:51.268665+0000","last_clean":"2023-05-08T03:40:51.268665+0000","last_became_active":"2023-05-08T03:40:49.227468+0000","last_became_peered":"2023-05-08T03:40:49.227468+0000","last_unstale":"2023-05-08T03:40:51.268665+0000","last_undegraded":"2023-05-08T03:40:51.268665+0000","last_fullsized":"2023-05-08T03:40:51.268665+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T14:43:43.602206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.221975+0000","last_change":"2023-05-08T03:40:48.799150+0000","last_active":"2023-05-08T03:40:50.221975+0000","last_peered":"2023-05-08T03:40:50.221975+0000","last_clean":"2023-05-08T03:40:50.221975+0000","last_became_active":"2023-05-08T03:40:48.798782+0000","last_became_peered":"2023-05-08T03:40:48.798782+0000","last_unstale":"2023-05-08T03:40:50.221975+0000","last_undegraded":"2023-05-08T03:40:50.221975+0000","last_fullsized":"2023-05-08T03:40:50.221975+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T14:47:45.547983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:52.175062+0000","last_change":"2023-05-08T03:40:49.233927+0000","last_active":"2023-05-08T03:40:52.175062+0000","last_peered":"2023-05-08T03:40:52.175062+0000","last_clean":"2023-05-08T03:40:52.175062+0000","last_became_active":"2023-05-08T03:40:49.232431+0000","last_became_peered":"2023-05-08T03:40:49.232431+0000","last_unstale":"2023-05-08T03:40:52.175062+0000","last_undegraded":"2023-05-08T03:40:52.175062+0000","last_fullsized":"2023-05-08T03:40:52.175062+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T07:21:25.886329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.268374+0000","last_change":"2023-05-08T03:40:48.801966+0000","last_active":"2023-05-08T03:40:51.268374+0000","last_peered":"2023-05-08T03:40:51.268374+0000","last_clean":"2023-05-08T03:40:51.268374+0000","last_became_active":"2023-05-08T03:40:48.801642+0000","last_became_peered":"2023-05-08T03:40:48.801642+0000","last_unstale":"2023-05-08T03:40:51.268374+0000","last_undegraded":"2023-05-08T03:40:51.268374+0000","last_fullsized":"2023-05-08T03:40:51.268374+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T15:03:06.750289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.990929+0000","last_change":"2023-05-08T03:40:49.229373+0000","last_active":"2023-05-08T03:40:51.990929+0000","last_peered":"2023-05-08T03:40:51.990929+0000","last_clean":"2023-05-08T03:40:51.990929+0000","last_became_active":"2023-05-08T03:40:49.229073+0000","last_became_peered":"2023-05-08T03:40:49.229073+0000","last_unstale":"2023-05-08T03:40:51.990929+0000","last_undegraded":"2023-05-08T03:40:51.990929+0000","last_fullsized":"2023-05-08T03:40:51.990929+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T03:46:49.952461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.299835+0000","last_change":"2023-05-08T03:40:48.798753+0000","last_active":"2023-05-08T03:40:51.299835+0000","last_peered":"2023-05-08T03:40:51.299835+0000","last_clean":"2023-05-08T03:40:51.299835+0000","last_became_active":"2023-05-08T03:40:48.798370+0000","last_became_peered":"2023-05-08T03:40:48.798370+0000","last_unstale":"2023-05-08T03:40:51.299835+0000","last_undegraded":"2023-05-08T03:40:51.299835+0000","last_fullsized":"2023-05-08T03:40:51.299835+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T10:12:02.944925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-08T03:40:49.239792+0000","last_change":"2023-05-08T03:40:49.239106+0000","last_active":"2023-05-08T03:40:49.239792+0000","last_peered":"2023-05-08T03:40:49.239792+0000","last_clean":"2023-05-08T03:40:49.239792+0000","last_became_active":"2023-05-08T03:40:49.238801+0000","last_became_peered":"2023-05-08T03:40:49.238801+0000","last_unstale":"2023-05-08T03:40:49.239792+0000","last_undegraded":"2023-05-08T03:40:49.239792+0000","last_fullsized":"2023-05-08T03:40:49.239792+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T09:34:50.394897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:52.351169+0000","last_change":"2023-05-08T03:40:48.800553+0000","last_active":"2023-05-08T03:40:52.351169+0000","last_peered":"2023-05-08T03:40:52.351169+0000","last_clean":"2023-05-08T03:40:52.351169+0000","last_became_active":"2023-05-08T03:40:48.800255+0000","last_became_peered":"2023-05-08T03:40:48.800255+0000","last_unstale":"2023-05-08T03:40:52.351169+0000","last_undegraded":"2023-05-08T03:40:52.351169+0000","last_fullsized":"2023-05-08T03:40:52.351169+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T14:34:04.395527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991717+0000","last_change":"2023-05-08T03:40:49.235832+0000","last_active":"2023-05-08T03:40:51.991717+0000","last_peered":"2023-05-08T03:40:51.991717+0000","last_clean":"2023-05-08T03:40:51.991717+0000","last_became_active":"2023-05-08T03:40:49.235545+0000","last_became_peered":"2023-05-08T03:40:49.235545+0000","last_unstale":"2023-05-08T03:40:51.991717+0000","last_undegraded":"2023-05-08T03:40:51.991717+0000","last_fullsized":"2023-05-08T03:40:51.991717+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T06:40:14.786756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.268832+0000","last_change":"2023-05-08T03:40:48.799767+0000","last_active":"2023-05-08T03:40:51.268832+0000","last_peered":"2023-05-08T03:40:51.268832+0000","last_clean":"2023-05-08T03:40:51.268832+0000","last_became_active":"2023-05-08T03:40:48.799336+0000","last_became_peered":"2023-05-08T03:40:48.799336+0000","last_unstale":"2023-05-08T03:40:51.268832+0000","last_undegraded":"2023-05-08T03:40:51.268832+0000","last_fullsized":"2023-05-08T03:40:51.268832+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T09:47:50.498971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-08T03:40:49.235040+0000","last_change":"2023-05-08T03:40:49.228153+0000","last_active":"2023-05-08T03:40:49.235040+0000","last_peered":"2023-05-08T03:40:49.235040+0000","last_clean":"2023-05-08T03:40:49.235040+0000","last_became_active":"2023-05-08T03:40:49.227584+0000","last_became_peered":"2023-05-08T03:40:49.227584+0000","last_unstale":"2023-05-08T03:40:49.235040+0000","last_undegraded":"2023-05-08T03:40:49.235040+0000","last_fullsized":"2023-05-08T03:40:49.235040+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T10:05:02.487644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'6","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.299590+0000","last_change":"2023-05-08T03:40:48.799126+0000","last_active":"2023-05-08T03:40:51.299590+0000","last_peered":"2023-05-08T03:40:51.299590+0000","last_clean":"2023-05-08T03:40:51.299590+0000","last_became_active":"2023-05-08T03:40:48.798907+0000","last_became_peered":"2023-05-08T03:40:48.798907+0000","last_unstale":"2023-05-08T03:40:51.299590+0000","last_undegraded":"2023-05-08T03:40:51.299590+0000","last_fullsized":"2023-05-08T03:40:51.299590+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T11:24:58.026789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.225118+0000","last_change":"2023-05-08T03:40:49.237489+0000","last_active":"2023-05-08T03:40:50.225118+0000","last_peered":"2023-05-08T03:40:50.225118+0000","last_clean":"2023-05-08T03:40:50.225118+0000","last_became_active":"2023-05-08T03:40:49.237207+0000","last_became_peered":"2023-05-08T03:40:49.237207+0000","last_unstale":"2023-05-08T03:40:50.225118+0000","last_undegraded":"2023-05-08T03:40:50.225118+0000","last_fullsized":"2023-05-08T03:40:50.225118+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T07:31:36.303437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'6","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:53.358451+0000","last_change":"2023-05-08T03:40:48.803375+0000","last_active":"2023-05-08T03:40:53.358451+0000","last_peered":"2023-05-08T03:40:53.358451+0000","last_clean":"2023-05-08T03:40:53.358451+0000","last_became_active":"2023-05-08T03:40:48.803082+0000","last_became_peered":"2023-05-08T03:40:48.803082+0000","last_unstale":"2023-05-08T03:40:53.358451+0000","last_undegraded":"2023-05-08T03:40:53.358451+0000","last_fullsized":"2023-05-08T03:40:53.358451+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T06:24:55.514429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.222036+0000","last_change":"2023-05-08T03:40:49.235859+0000","last_active":"2023-05-08T03:40:50.222036+0000","last_peered":"2023-05-08T03:40:50.222036+0000","last_clean":"2023-05-08T03:40:50.222036+0000","last_became_active":"2023-05-08T03:40:49.235545+0000","last_became_peered":"2023-05-08T03:40:49.235545+0000","last_unstale":"2023-05-08T03:40:50.222036+0000","last_undegraded":"2023-05-08T03:40:50.222036+0000","last_fullsized":"2023-05-08T03:40:50.222036+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T12:06:59.892758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.268458+0000","last_change":"2023-05-08T03:40:48.803838+0000","last_active":"2023-05-08T03:40:51.268458+0000","last_peered":"2023-05-08T03:40:51.268458+0000","last_clean":"2023-05-08T03:40:51.268458+0000","last_became_active":"2023-05-08T03:40:48.803389+0000","last_became_peered":"2023-05-08T03:40:48.803389+0000","last_unstale":"2023-05-08T03:40:51.268458+0000","last_undegraded":"2023-05-08T03:40:51.268458+0000","last_fullsized":"2023-05-08T03:40:51.268458+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T06:25:46.589570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991651+0000","last_change":"2023-05-08T03:40:49.242013+0000","last_active":"2023-05-08T03:40:51.991651+0000","last_peered":"2023-05-08T03:40:51.991651+0000","last_clean":"2023-05-08T03:40:51.991651+0000","last_became_active":"2023-05-08T03:40:49.241649+0000","last_became_peered":"2023-05-08T03:40:49.241649+0000","last_unstale":"2023-05-08T03:40:51.991651+0000","last_undegraded":"2023-05-08T03:40:51.991651+0000","last_fullsized":"2023-05-08T03:40:51.991651+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T11:20:08.806314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:53.357740+0000","last_change":"2023-05-08T03:40:48.798327+0000","last_active":"2023-05-08T03:40:53.357740+0000","last_peered":"2023-05-08T03:40:53.357740+0000","last_clean":"2023-05-08T03:40:53.357740+0000","last_became_active":"2023-05-08T03:40:48.797982+0000","last_became_peered":"2023-05-08T03:40:48.797982+0000","last_unstale":"2023-05-08T03:40:53.357740+0000","last_undegraded":"2023-05-08T03:40:53.357740+0000","last_fullsized":"2023-05-08T03:40:53.357740+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T06:11:20.786843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991343+0000","last_change":"2023-05-08T03:40:49.233294+0000","last_active":"2023-05-08T03:40:51.991343+0000","last_peered":"2023-05-08T03:40:51.991343+0000","last_clean":"2023-05-08T03:40:51.991343+0000","last_became_active":"2023-05-08T03:40:49.232967+0000","last_became_peered":"2023-05-08T03:40:49.232967+0000","last_unstale":"2023-05-08T03:40:51.991343+0000","last_undegraded":"2023-05-08T03:40:51.991343+0000","last_fullsized":"2023-05-08T03:40:51.991343+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T08:56:19.823724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'8","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.224732+0000","last_change":"2023-05-08T03:40:48.800734+0000","last_active":"2023-05-08T03:40:50.224732+0000","last_peered":"2023-05-08T03:40:50.224732+0000","last_clean":"2023-05-08T03:40:50.224732+0000","last_became_active":"2023-05-08T03:40:48.800155+0000","last_became_peered":"2023-05-08T03:40:48.800155+0000","last_unstale":"2023-05-08T03:40:50.224732+0000","last_undegraded":"2023-05-08T03:40:50.224732+0000","last_fullsized":"2023-05-08T03:40:50.224732+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T10:21:52.124912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.268462+0000","last_change":"2023-05-08T03:40:49.230119+0000","last_active":"2023-05-08T03:40:51.268462+0000","last_peered":"2023-05-08T03:40:51.268462+0000","last_clean":"2023-05-08T03:40:51.268462+0000","last_became_active":"2023-05-08T03:40:49.229832+0000","last_became_peered":"2023-05-08T03:40:49.229832+0000","last_unstale":"2023-05-08T03:40:51.268462+0000","last_undegraded":"2023-05-08T03:40:51.268462+0000","last_fullsized":"2023-05-08T03:40:51.268462+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T10:04:22.742738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.225066+0000","last_change":"2023-05-08T03:40:48.801423+0000","last_active":"2023-05-08T03:40:50.225066+0000","last_peered":"2023-05-08T03:40:50.225066+0000","last_clean":"2023-05-08T03:40:50.225066+0000","last_became_active":"2023-05-08T03:40:48.801027+0000","last_became_peered":"2023-05-08T03:40:48.801027+0000","last_unstale":"2023-05-08T03:40:50.225066+0000","last_undegraded":"2023-05-08T03:40:50.225066+0000","last_fullsized":"2023-05-08T03:40:50.225066+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T07:32:19.377168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.290441+0000","last_change":"2023-05-08T03:40:49.239315+0000","last_active":"2023-05-08T03:40:50.290441+0000","last_peered":"2023-05-08T03:40:50.290441+0000","last_clean":"2023-05-08T03:40:50.290441+0000","last_became_active":"2023-05-08T03:40:49.239040+0000","last_became_peered":"2023-05-08T03:40:49.239040+0000","last_unstale":"2023-05-08T03:40:50.290441+0000","last_undegraded":"2023-05-08T03:40:50.290441+0000","last_fullsized":"2023-05-08T03:40:50.290441+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T04:36:38.262164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991307+0000","last_change":"2023-05-08T03:40:48.802650+0000","last_active":"2023-05-08T03:40:51.991307+0000","last_peered":"2023-05-08T03:40:51.991307+0000","last_clean":"2023-05-08T03:40:51.991307+0000","last_became_active":"2023-05-08T03:40:48.802358+0000","last_became_peered":"2023-05-08T03:40:48.802358+0000","last_unstale":"2023-05-08T03:40:51.991307+0000","last_undegraded":"2023-05-08T03:40:51.991307+0000","last_fullsized":"2023-05-08T03:40:51.991307+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T05:13:14.266223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.299660+0000","last_change":"2023-05-08T03:40:49.242103+0000","last_active":"2023-05-08T03:40:51.299660+0000","last_peered":"2023-05-08T03:40:51.299660+0000","last_clean":"2023-05-08T03:40:51.299660+0000","last_became_active":"2023-05-08T03:40:49.241694+0000","last_became_peered":"2023-05-08T03:40:49.241694+0000","last_unstale":"2023-05-08T03:40:51.299660+0000","last_undegraded":"2023-05-08T03:40:51.299660+0000","last_fullsized":"2023-05-08T03:40:51.299660+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T05:51:53.203680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"82'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991825+0000","last_change":"2023-05-08T03:40:48.801754+0000","last_active":"2023-05-08T03:40:51.991825+0000","last_peered":"2023-05-08T03:40:51.991825+0000","last_clean":"2023-05-08T03:40:51.991825+0000","last_became_active":"2023-05-08T03:40:48.801474+0000","last_became_peered":"2023-05-08T03:40:48.801474+0000","last_unstale":"2023-05-08T03:40:51.991825+0000","last_undegraded":"2023-05-08T03:40:51.991825+0000","last_fullsized":"2023-05-08T03:40:51.991825+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T10:17:15.498068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.299563+0000","last_change":"2023-05-08T03:40:49.239292+0000","last_active":"2023-05-08T03:40:51.299563+0000","last_peered":"2023-05-08T03:40:51.299563+0000","last_clean":"2023-05-08T03:40:51.299563+0000","last_became_active":"2023-05-08T03:40:49.238993+0000","last_became_peered":"2023-05-08T03:40:49.238993+0000","last_unstale":"2023-05-08T03:40:51.299563+0000","last_undegraded":"2023-05-08T03:40:51.299563+0000","last_fullsized":"2023-05-08T03:40:51.299563+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T07:31:52.140647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.268485+0000","last_change":"2023-05-08T03:40:49.228268+0000","last_active":"2023-05-08T03:40:51.268485+0000","last_peered":"2023-05-08T03:40:51.268485+0000","last_clean":"2023-05-08T03:40:51.268485+0000","last_became_active":"2023-05-08T03:40:49.227346+0000","last_became_peered":"2023-05-08T03:40:49.227346+0000","last_unstale":"2023-05-08T03:40:51.268485+0000","last_undegraded":"2023-05-08T03:40:51.268485+0000","last_fullsized":"2023-05-08T03:40:51.268485+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T04:14:10.880456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.221855+0000","last_change":"2023-05-08T03:40:48.795133+0000","last_active":"2023-05-08T03:40:50.221855+0000","last_peered":"2023-05-08T03:40:50.221855+0000","last_clean":"2023-05-08T03:40:50.221855+0000","last_became_active":"2023-05-08T03:40:48.794720+0000","last_became_peered":"2023-05-08T03:40:48.794720+0000","last_unstale":"2023-05-08T03:40:50.221855+0000","last_undegraded":"2023-05-08T03:40:50.221855+0000","last_fullsized":"2023-05-08T03:40:50.221855+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T12:37:37.862608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:52.175426+0000","last_change":"2023-05-08T03:40:49.229331+0000","last_active":"2023-05-08T03:40:52.175426+0000","last_peered":"2023-05-08T03:40:52.175426+0000","last_clean":"2023-05-08T03:40:52.175426+0000","last_became_active":"2023-05-08T03:40:49.228878+0000","last_became_peered":"2023-05-08T03:40:49.228878+0000","last_unstale":"2023-05-08T03:40:52.175426+0000","last_undegraded":"2023-05-08T03:40:52.175426+0000","last_fullsized":"2023-05-08T03:40:52.175426+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T03:53:35.836359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"82'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:52.349111+0000","last_change":"2023-05-08T03:40:48.796217+0000","last_active":"2023-05-08T03:40:52.349111+0000","last_peered":"2023-05-08T03:40:52.349111+0000","last_clean":"2023-05-08T03:40:52.349111+0000","last_became_active":"2023-05-08T03:40:48.795887+0000","last_became_peered":"2023-05-08T03:40:48.795887+0000","last_unstale":"2023-05-08T03:40:52.349111+0000","last_undegraded":"2023-05-08T03:40:52.349111+0000","last_fullsized":"2023-05-08T03:40:52.349111+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T14:57:30.575267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":340,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991321+0000","last_change":"2023-05-08T03:39:49.036132+0000","last_active":"2023-05-08T03:40:51.991321+0000","last_peered":"2023-05-08T03:40:51.991321+0000","last_clean":"2023-05-08T03:40:51.991321+0000","last_became_active":"2023-05-08T03:39:49.035717+0000","last_became_peered":"2023-05-08T03:39:49.035717+0000","last_unstale":"2023-05-08T03:40:51.991321+0000","last_undegraded":"2023-05-08T03:40:51.991321+0000","last_fullsized":"2023-05-08T03:40:51.991321+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:36:48.527062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:36:48.527062+0000","last_clean_scrub_stamp":"2023-05-08T03:36:48.527062+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T07:02:26.379800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.221853+0000","last_change":"2023-05-08T03:40:49.227299+0000","last_active":"2023-05-08T03:40:50.221853+0000","last_peered":"2023-05-08T03:40:50.221853+0000","last_clean":"2023-05-08T03:40:50.221853+0000","last_became_active":"2023-05-08T03:40:49.226846+0000","last_became_peered":"2023-05-08T03:40:49.226846+0000","last_unstale":"2023-05-08T03:40:50.221853+0000","last_undegraded":"2023-05-08T03:40:50.221853+0000","last_fullsized":"2023-05-08T03:40:50.221853+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T10:55:57.218170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"82'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:53.358519+0000","last_change":"2023-05-08T03:40:48.803480+0000","last_active":"2023-05-08T03:40:53.358519+0000","last_peered":"2023-05-08T03:40:53.358519+0000","last_clean":"2023-05-08T03:40:53.358519+0000","last_became_active":"2023-05-08T03:40:48.803137+0000","last_became_peered":"2023-05-08T03:40:48.803137+0000","last_unstale":"2023-05-08T03:40:53.358519+0000","last_undegraded":"2023-05-08T03:40:53.358519+0000","last_fullsized":"2023-05-08T03:40:53.358519+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T11:08:55.229134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.225060+0000","last_change":"2023-05-08T03:40:48.802781+0000","last_active":"2023-05-08T03:40:50.225060+0000","last_peered":"2023-05-08T03:40:50.225060+0000","last_clean":"2023-05-08T03:40:50.225060+0000","last_became_active":"2023-05-08T03:40:48.802461+0000","last_became_peered":"2023-05-08T03:40:48.802461+0000","last_unstale":"2023-05-08T03:40:50.225060+0000","last_undegraded":"2023-05-08T03:40:50.225060+0000","last_fullsized":"2023-05-08T03:40:50.225060+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T11:07:12.386341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.222071+0000","last_change":"2023-05-08T03:40:49.227162+0000","last_active":"2023-05-08T03:40:50.222071+0000","last_peered":"2023-05-08T03:40:50.222071+0000","last_clean":"2023-05-08T03:40:50.222071+0000","last_became_active":"2023-05-08T03:40:49.226841+0000","last_became_peered":"2023-05-08T03:40:49.226841+0000","last_unstale":"2023-05-08T03:40:50.222071+0000","last_undegraded":"2023-05-08T03:40:50.222071+0000","last_fullsized":"2023-05-08T03:40:50.222071+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T05:42:31.361505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:53.358169+0000","last_change":"2023-05-08T03:40:48.800841+0000","last_active":"2023-05-08T03:40:53.358169+0000","last_peered":"2023-05-08T03:40:53.358169+0000","last_clean":"2023-05-08T03:40:53.358169+0000","last_became_active":"2023-05-08T03:40:48.800198+0000","last_became_peered":"2023-05-08T03:40:48.800198+0000","last_unstale":"2023-05-08T03:40:53.358169+0000","last_undegraded":"2023-05-08T03:40:53.358169+0000","last_fullsized":"2023-05-08T03:40:53.358169+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T07:43:49.169424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:52.175690+0000","last_change":"2023-05-08T03:40:49.234421+0000","last_active":"2023-05-08T03:40:52.175690+0000","last_peered":"2023-05-08T03:40:52.175690+0000","last_clean":"2023-05-08T03:40:52.175690+0000","last_became_active":"2023-05-08T03:40:49.234108+0000","last_became_peered":"2023-05-08T03:40:49.234108+0000","last_unstale":"2023-05-08T03:40:52.175690+0000","last_undegraded":"2023-05-08T03:40:52.175690+0000","last_fullsized":"2023-05-08T03:40:52.175690+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T07:08:12.366030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'4","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:52.350385+0000","last_change":"2023-05-08T03:40:48.792894+0000","last_active":"2023-05-08T03:40:52.350385+0000","last_peered":"2023-05-08T03:40:52.350385+0000","last_clean":"2023-05-08T03:40:52.350385+0000","last_became_active":"2023-05-08T03:40:48.792579+0000","last_became_peered":"2023-05-08T03:40:48.792579+0000","last_unstale":"2023-05-08T03:40:52.350385+0000","last_undegraded":"2023-05-08T03:40:52.350385+0000","last_fullsized":"2023-05-08T03:40:52.350385+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T12:10:35.808903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991740+0000","last_change":"2023-05-08T03:40:49.239032+0000","last_active":"2023-05-08T03:40:51.991740+0000","last_peered":"2023-05-08T03:40:51.991740+0000","last_clean":"2023-05-08T03:40:51.991740+0000","last_became_active":"2023-05-08T03:40:49.238714+0000","last_became_peered":"2023-05-08T03:40:49.238714+0000","last_unstale":"2023-05-08T03:40:51.991740+0000","last_undegraded":"2023-05-08T03:40:51.991740+0000","last_fullsized":"2023-05-08T03:40:51.991740+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T15:12:46.594644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-08T03:40:49.224427+0000","last_change":"2023-05-08T03:40:48.797158+0000","last_active":"2023-05-08T03:40:49.224427+0000","last_peered":"2023-05-08T03:40:49.224427+0000","last_clean":"2023-05-08T03:40:49.224427+0000","last_became_active":"2023-05-08T03:40:48.796851+0000","last_became_peered":"2023-05-08T03:40:48.796851+0000","last_unstale":"2023-05-08T03:40:49.224427+0000","last_undegraded":"2023-05-08T03:40:49.224427+0000","last_fullsized":"2023-05-08T03:40:49.224427+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T14:12:09.488416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.224714+0000","last_change":"2023-05-08T03:40:49.236833+0000","last_active":"2023-05-08T03:40:50.224714+0000","last_peered":"2023-05-08T03:40:50.224714+0000","last_clean":"2023-05-08T03:40:50.224714+0000","last_became_active":"2023-05-08T03:40:49.236520+0000","last_became_peered":"2023-05-08T03:40:49.236520+0000","last_unstale":"2023-05-08T03:40:50.224714+0000","last_undegraded":"2023-05-08T03:40:50.224714+0000","last_fullsized":"2023-05-08T03:40:50.224714+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T08:36:44.900323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:52.354358+0000","last_change":"2023-05-08T03:40:48.791795+0000","last_active":"2023-05-08T03:40:52.354358+0000","last_peered":"2023-05-08T03:40:52.354358+0000","last_clean":"2023-05-08T03:40:52.354358+0000","last_became_active":"2023-05-08T03:40:48.791489+0000","last_became_peered":"2023-05-08T03:40:48.791489+0000","last_unstale":"2023-05-08T03:40:52.354358+0000","last_undegraded":"2023-05-08T03:40:52.354358+0000","last_fullsized":"2023-05-08T03:40:52.354358+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T08:45:26.675522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.290230+0000","last_change":"2023-05-08T03:40:49.232245+0000","last_active":"2023-05-08T03:40:50.290230+0000","last_peered":"2023-05-08T03:40:50.290230+0000","last_clean":"2023-05-08T03:40:50.290230+0000","last_became_active":"2023-05-08T03:40:49.231934+0000","last_became_peered":"2023-05-08T03:40:49.231934+0000","last_unstale":"2023-05-08T03:40:50.290230+0000","last_undegraded":"2023-05-08T03:40:50.290230+0000","last_fullsized":"2023-05-08T03:40:50.290230+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T08:30:46.523751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.273105+0000","last_change":"2023-05-08T03:40:48.803996+0000","last_active":"2023-05-08T03:40:51.273105+0000","last_peered":"2023-05-08T03:40:51.273105+0000","last_clean":"2023-05-08T03:40:51.273105+0000","last_became_active":"2023-05-08T03:40:48.803684+0000","last_became_peered":"2023-05-08T03:40:48.803684+0000","last_unstale":"2023-05-08T03:40:51.273105+0000","last_undegraded":"2023-05-08T03:40:51.273105+0000","last_fullsized":"2023-05-08T03:40:51.273105+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T08:13:18.973444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:52.175439+0000","last_change":"2023-05-08T03:40:49.234152+0000","last_active":"2023-05-08T03:40:52.175439+0000","last_peered":"2023-05-08T03:40:52.175439+0000","last_clean":"2023-05-08T03:40:52.175439+0000","last_became_active":"2023-05-08T03:40:49.233675+0000","last_became_peered":"2023-05-08T03:40:49.233675+0000","last_unstale":"2023-05-08T03:40:52.175439+0000","last_undegraded":"2023-05-08T03:40:52.175439+0000","last_fullsized":"2023-05-08T03:40:52.175439+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T08:53:30.821743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.224821+0000","last_change":"2023-05-08T03:40:48.798736+0000","last_active":"2023-05-08T03:40:50.224821+0000","last_peered":"2023-05-08T03:40:50.224821+0000","last_clean":"2023-05-08T03:40:50.224821+0000","last_became_active":"2023-05-08T03:40:48.798418+0000","last_became_peered":"2023-05-08T03:40:48.798418+0000","last_unstale":"2023-05-08T03:40:50.224821+0000","last_undegraded":"2023-05-08T03:40:50.224821+0000","last_fullsized":"2023-05-08T03:40:50.224821+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T07:52:30.962269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991638+0000","last_change":"2023-05-08T03:40:49.235205+0000","last_active":"2023-05-08T03:40:51.991638+0000","last_peered":"2023-05-08T03:40:51.991638+0000","last_clean":"2023-05-08T03:40:51.991638+0000","last_became_active":"2023-05-08T03:40:49.234898+0000","last_became_peered":"2023-05-08T03:40:49.234898+0000","last_unstale":"2023-05-08T03:40:51.991638+0000","last_undegraded":"2023-05-08T03:40:51.991638+0000","last_fullsized":"2023-05-08T03:40:51.991638+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T09:51:49.501098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:53.358608+0000","last_change":"2023-05-08T03:40:48.802820+0000","last_active":"2023-05-08T03:40:53.358608+0000","last_peered":"2023-05-08T03:40:53.358608+0000","last_clean":"2023-05-08T03:40:53.358608+0000","last_became_active":"2023-05-08T03:40:48.802457+0000","last_became_peered":"2023-05-08T03:40:48.802457+0000","last_unstale":"2023-05-08T03:40:53.358608+0000","last_undegraded":"2023-05-08T03:40:53.358608+0000","last_fullsized":"2023-05-08T03:40:53.358608+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T05:22:19.608125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991798+0000","last_change":"2023-05-08T03:40:49.238318+0000","last_active":"2023-05-08T03:40:51.991798+0000","last_peered":"2023-05-08T03:40:51.991798+0000","last_clean":"2023-05-08T03:40:51.991798+0000","last_became_active":"2023-05-08T03:40:49.237994+0000","last_became_peered":"2023-05-08T03:40:49.237994+0000","last_unstale":"2023-05-08T03:40:51.991798+0000","last_undegraded":"2023-05-08T03:40:51.991798+0000","last_fullsized":"2023-05-08T03:40:51.991798+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T14:44:53.119130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.268717+0000","last_change":"2023-05-08T03:40:48.803795+0000","last_active":"2023-05-08T03:40:51.268717+0000","last_peered":"2023-05-08T03:40:51.268717+0000","last_clean":"2023-05-08T03:40:51.268717+0000","last_became_active":"2023-05-08T03:40:48.803001+0000","last_became_peered":"2023-05-08T03:40:48.803001+0000","last_unstale":"2023-05-08T03:40:51.268717+0000","last_undegraded":"2023-05-08T03:40:51.268717+0000","last_fullsized":"2023-05-08T03:40:51.268717+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T07:43:47.011238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991462+0000","last_change":"2023-05-08T03:40:49.237298+0000","last_active":"2023-05-08T03:40:51.991462+0000","last_peered":"2023-05-08T03:40:51.991462+0000","last_clean":"2023-05-08T03:40:51.991462+0000","last_became_active":"2023-05-08T03:40:49.236984+0000","last_became_peered":"2023-05-08T03:40:49.236984+0000","last_unstale":"2023-05-08T03:40:51.991462+0000","last_undegraded":"2023-05-08T03:40:51.991462+0000","last_fullsized":"2023-05-08T03:40:51.991462+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T14:05:30.754412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.222153+0000","last_change":"2023-05-08T03:40:48.801987+0000","last_active":"2023-05-08T03:40:50.222153+0000","last_peered":"2023-05-08T03:40:50.222153+0000","last_clean":"2023-05-08T03:40:50.222153+0000","last_became_active":"2023-05-08T03:40:48.801521+0000","last_became_peered":"2023-05-08T03:40:48.801521+0000","last_unstale":"2023-05-08T03:40:50.222153+0000","last_undegraded":"2023-05-08T03:40:50.222153+0000","last_fullsized":"2023-05-08T03:40:50.222153+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T03:49:08.381600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991668+0000","last_change":"2023-05-08T03:40:49.240916+0000","last_active":"2023-05-08T03:40:51.991668+0000","last_peered":"2023-05-08T03:40:51.991668+0000","last_clean":"2023-05-08T03:40:51.991668+0000","last_became_active":"2023-05-08T03:40:49.240626+0000","last_became_peered":"2023-05-08T03:40:49.240626+0000","last_unstale":"2023-05-08T03:40:51.991668+0000","last_undegraded":"2023-05-08T03:40:51.991668+0000","last_fullsized":"2023-05-08T03:40:51.991668+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T06:18:16.782559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.290263+0000","last_change":"2023-05-08T03:40:49.236506+0000","last_active":"2023-05-08T03:40:50.290263+0000","last_peered":"2023-05-08T03:40:50.290263+0000","last_clean":"2023-05-08T03:40:50.290263+0000","last_became_active":"2023-05-08T03:40:49.236065+0000","last_became_peered":"2023-05-08T03:40:49.236065+0000","last_unstale":"2023-05-08T03:40:50.290263+0000","last_undegraded":"2023-05-08T03:40:50.290263+0000","last_fullsized":"2023-05-08T03:40:50.290263+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T04:00:41.965873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.273160+0000","last_change":"2023-05-08T03:40:49.236262+0000","last_active":"2023-05-08T03:40:51.273160+0000","last_peered":"2023-05-08T03:40:51.273160+0000","last_clean":"2023-05-08T03:40:51.273160+0000","last_became_active":"2023-05-08T03:40:49.235892+0000","last_became_peered":"2023-05-08T03:40:49.235892+0000","last_unstale":"2023-05-08T03:40:51.273160+0000","last_undegraded":"2023-05-08T03:40:51.273160+0000","last_fullsized":"2023-05-08T03:40:51.273160+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T11:18:58.158779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.273174+0000","last_change":"2023-05-08T03:40:49.232946+0000","last_active":"2023-05-08T03:40:51.273174+0000","last_peered":"2023-05-08T03:40:51.273174+0000","last_clean":"2023-05-08T03:40:51.273174+0000","last_became_active":"2023-05-08T03:40:49.232642+0000","last_became_peered":"2023-05-08T03:40:49.232642+0000","last_unstale":"2023-05-08T03:40:51.273174+0000","last_undegraded":"2023-05-08T03:40:51.273174+0000","last_fullsized":"2023-05-08T03:40:51.273174+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T05:32:46.280731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991435+0000","last_change":"2023-05-08T03:40:49.238342+0000","last_active":"2023-05-08T03:40:51.991435+0000","last_peered":"2023-05-08T03:40:51.991435+0000","last_clean":"2023-05-08T03:40:51.991435+0000","last_became_active":"2023-05-08T03:40:49.237973+0000","last_became_peered":"2023-05-08T03:40:49.237973+0000","last_unstale":"2023-05-08T03:40:51.991435+0000","last_undegraded":"2023-05-08T03:40:51.991435+0000","last_fullsized":"2023-05-08T03:40:51.991435+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T13:53:38.093200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.222110+0000","last_change":"2023-05-08T03:40:49.226285+0000","last_active":"2023-05-08T03:40:50.222110+0000","last_peered":"2023-05-08T03:40:50.222110+0000","last_clean":"2023-05-08T03:40:50.222110+0000","last_became_active":"2023-05-08T03:40:49.225962+0000","last_became_peered":"2023-05-08T03:40:49.225962+0000","last_unstale":"2023-05-08T03:40:50.222110+0000","last_undegraded":"2023-05-08T03:40:50.222110+0000","last_fullsized":"2023-05-08T03:40:50.222110+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T11:58:59.434249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.290540+0000","last_change":"2023-05-08T03:40:49.238692+0000","last_active":"2023-05-08T03:40:50.290540+0000","last_peered":"2023-05-08T03:40:50.290540+0000","last_clean":"2023-05-08T03:40:50.290540+0000","last_became_active":"2023-05-08T03:40:49.238234+0000","last_became_peered":"2023-05-08T03:40:49.238234+0000","last_unstale":"2023-05-08T03:40:50.290540+0000","last_undegraded":"2023-05-08T03:40:50.290540+0000","last_fullsized":"2023-05-08T03:40:50.290540+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T13:25:41.710681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.273376+0000","last_change":"2023-05-08T03:40:49.227549+0000","last_active":"2023-05-08T03:40:51.273376+0000","last_peered":"2023-05-08T03:40:51.273376+0000","last_clean":"2023-05-08T03:40:51.273376+0000","last_became_active":"2023-05-08T03:40:49.227259+0000","last_became_peered":"2023-05-08T03:40:49.227259+0000","last_unstale":"2023-05-08T03:40:51.273376+0000","last_undegraded":"2023-05-08T03:40:51.273376+0000","last_fullsized":"2023-05-08T03:40:51.273376+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T03:50:25.923147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:52.175680+0000","last_change":"2023-05-08T03:40:49.238832+0000","last_active":"2023-05-08T03:40:52.175680+0000","last_peered":"2023-05-08T03:40:52.175680+0000","last_clean":"2023-05-08T03:40:52.175680+0000","last_became_active":"2023-05-08T03:40:49.238521+0000","last_became_peered":"2023-05-08T03:40:49.238521+0000","last_unstale":"2023-05-08T03:40:52.175680+0000","last_undegraded":"2023-05-08T03:40:52.175680+0000","last_fullsized":"2023-05-08T03:40:52.175680+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T06:59:10.616806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.268410+0000","last_change":"2023-05-08T03:40:49.228489+0000","last_active":"2023-05-08T03:40:51.268410+0000","last_peered":"2023-05-08T03:40:51.268410+0000","last_clean":"2023-05-08T03:40:51.268410+0000","last_became_active":"2023-05-08T03:40:49.228178+0000","last_became_peered":"2023-05-08T03:40:49.228178+0000","last_unstale":"2023-05-08T03:40:51.268410+0000","last_undegraded":"2023-05-08T03:40:51.268410+0000","last_fullsized":"2023-05-08T03:40:51.268410+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T05:47:36.620662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:52.175253+0000","last_change":"2023-05-08T03:40:49.243094+0000","last_active":"2023-05-08T03:40:52.175253+0000","last_peered":"2023-05-08T03:40:52.175253+0000","last_clean":"2023-05-08T03:40:52.175253+0000","last_became_active":"2023-05-08T03:40:49.242775+0000","last_became_peered":"2023-05-08T03:40:49.242775+0000","last_unstale":"2023-05-08T03:40:52.175253+0000","last_undegraded":"2023-05-08T03:40:52.175253+0000","last_fullsized":"2023-05-08T03:40:52.175253+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T12:58:00.099315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-05-08T03:40:49.235092+0000","last_change":"2023-05-08T03:40:49.228943+0000","last_active":"2023-05-08T03:40:49.235092+0000","last_peered":"2023-05-08T03:40:49.235092+0000","last_clean":"2023-05-08T03:40:49.235092+0000","last_became_active":"2023-05-08T03:40:49.228657+0000","last_became_peered":"2023-05-08T03:40:49.228657+0000","last_unstale":"2023-05-08T03:40:49.235092+0000","last_undegraded":"2023-05-08T03:40:49.235092+0000","last_fullsized":"2023-05-08T03:40:49.235092+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T03:56:38.827039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.222327+0000","last_change":"2023-05-08T03:40:49.233736+0000","last_active":"2023-05-08T03:40:50.222327+0000","last_peered":"2023-05-08T03:40:50.222327+0000","last_clean":"2023-05-08T03:40:50.222327+0000","last_became_active":"2023-05-08T03:40:49.233418+0000","last_became_peered":"2023-05-08T03:40:49.233418+0000","last_unstale":"2023-05-08T03:40:50.222327+0000","last_undegraded":"2023-05-08T03:40:50.222327+0000","last_fullsized":"2023-05-08T03:40:50.222327+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T13:29:20.896557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.290361+0000","last_change":"2023-05-08T03:40:49.235658+0000","last_active":"2023-05-08T03:40:50.290361+0000","last_peered":"2023-05-08T03:40:50.290361+0000","last_clean":"2023-05-08T03:40:50.290361+0000","last_became_active":"2023-05-08T03:40:49.235289+0000","last_became_peered":"2023-05-08T03:40:49.235289+0000","last_unstale":"2023-05-08T03:40:50.290361+0000","last_undegraded":"2023-05-08T03:40:50.290361+0000","last_fullsized":"2023-05-08T03:40:50.290361+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T03:52:16.806774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3608,"num_objects":38,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":192512,"data_stored":12428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":70,"ondisk_log_size":70,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":77,"seq":330712481803,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5920,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":5056,"kb_avail":93739232,"statfs":{"total":95995035648,"available":95988973568,"internally_reserved":0,"allocated":876544,"data_stored":420653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5177344},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]}]},{"osd":10,"up_from":70,"seq":300647710736,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6704,"kb_used_data":1448,"kb_used_omap":0,"kb_used_meta":5248,"kb_avail":93738448,"statfs":{"total":95995035648,"available":95988170752,"internally_reserved":0,"allocated":1482752,"data_stored":1004209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5373952},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":1,"last update":"Mon May 8 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.313},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.33700000000000002}]},{"osd":2,"last update":"Mon May 8 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.55100000000000005}]},{"osd":3,"last update":"Mon May 8 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.441},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.35599999999999998}]},{"osd":4,"last update":"Mon May 8 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.373},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.56599999999999995}]},{"osd":5,"last update":"Mon May 8 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.629},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.47299999999999998}]},{"osd":6,"last update":"Mon May 8 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.46100000000000002}]},{"osd":7,"last update":"Mon May 8 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.68400000000000005}]},{"osd":8,"last update":"Mon May 8 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.67500000000000004}]},{"osd":9,"last update":"Mon May 8 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.69299999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]}]},{"osd":9,"up_from":65,"seq":279172874261,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6068,"kb_used_data":876,"kb_used_omap":0,"kb_used_meta":5184,"kb_avail":93739084,"statfs":{"total":95995035648,"available":95988822016,"internally_reserved":0,"allocated":897024,"data_stored":421471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5308416},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[7],"upper_bound":2},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 8 03:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":2.3570000000000002},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.46100000000000002}]},{"osd":1,"last update":"Mon May 8 03:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":2.339}]},{"osd":2,"last update":"Mon May 8 03:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":2.306},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":2.3839999999999999}]},{"osd":3,"last update":"Mon May 8 03:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":2.2629999999999999}]},{"osd":4,"last update":"Mon May 8 03:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":2.1720000000000002},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":1.5309999999999999}]},{"osd":5,"last update":"Mon May 8 03:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.54800000000000004}]},{"osd":6,"last update":"Mon May 8 03:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":4.7389999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":2.137}]},{"osd":7,"last update":"Mon May 8 03:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":1.458}]},{"osd":8,"last update":"Mon May 8 03:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":2.323},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":1.591}]},{"osd":10,"last update":"Mon May 8 03:40:49 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":2.206}]}]},{"osd":8,"up_from":58,"seq":249108103192,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6180,"kb_used_data":860,"kb_used_omap":0,"kb_used_meta":5312,"kb_avail":93738972,"statfs":{"total":95995035648,"available":95988707328,"internally_reserved":0,"allocated":880640,"data_stored":420926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5439488},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 8 03:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.443}]},{"osd":1,"last update":"Mon May 8 03:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.41299999999999998}]},{"osd":2,"last update":"Mon May 8 03:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.372},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.31}]},{"osd":3,"last update":"Mon May 8 03:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.49399999999999999}]},{"osd":4,"last update":"Mon May 8 03:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.48299999999999998}]},{"osd":5,"last update":"Mon May 8 03:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.55100000000000005}]},{"osd":6,"last update":"Mon May 8 03:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.51100000000000001}]},{"osd":7,"last update":"Mon May 8 03:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.67100000000000004}]},{"osd":9,"last update":"Mon May 8 03:40:25 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.623},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.53900000000000003}]},{"osd":10,"last update":"Mon May 8 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.70799999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]}]},{"osd":7,"up_from":50,"seq":214748364829,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6900,"kb_used_data":1452,"kb_used_omap":0,"kb_used_meta":5440,"kb_avail":93738252,"statfs":{"total":95995035648,"available":95987970048,"internally_reserved":0,"allocated":1486848,"data_stored":1012717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5570560},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 8 03:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.52600000000000002,"15min":0.52000000000000002},"min":{"1min":0.36899999999999999,"5min":0.311,"15min":0.311},"max":{"1min":0.76300000000000001,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.434},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.57699999999999996,"15min":0.58099999999999996},"min":{"1min":0.42799999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.66400000000000003,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.45100000000000001}]},{"osd":1,"last update":"Mon May 8 03:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.40799999999999997,"15min":0.40200000000000002},"min":{"1min":0.29499999999999998,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.45800000000000002,"15min":0.45600000000000002},"min":{"1min":0.311,"5min":0.248,"15min":0.248},"max":{"1min":0.68700000000000006,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.56299999999999994}]},{"osd":2,"last update":"Mon May 8 03:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.61699999999999999,"15min":0.61799999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.59099999999999997,"15min":0.58299999999999996},"min":{"1min":0.48499999999999999,"5min":0.378,"15min":0.378},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.58699999999999997}]},{"osd":3,"last update":"Mon May 8 03:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.54300000000000004,"15min":0.54500000000000004},"min":{"1min":0.38100000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.73399999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.58299999999999996,"15min":0.57699999999999996},"min":{"1min":0.39800000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.82099999999999995}]},{"osd":4,"last update":"Mon May 8 03:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.55600000000000005,"15min":0.56100000000000005},"min":{"1min":0.32300000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.76500000000000001,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.52700000000000002,"15min":0.52600000000000002},"min":{"1min":0.33500000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.73599999999999999,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.66600000000000004}]},{"osd":5,"last update":"Mon May 8 03:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.64200000000000002,"15min":0.63800000000000001},"min":{"1min":0.51300000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.80100000000000005,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.66500000000000004,"15min":0.66100000000000003},"min":{"1min":0.56699999999999995,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.79400000000000004,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.64500000000000002}]},{"osd":6,"last update":"Mon May 8 03:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.67100000000000004,"15min":0.66800000000000004},"min":{"1min":0.52000000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.90000000000000002,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.66200000000000003,"15min":0.65700000000000003},"min":{"1min":0.46000000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.83199999999999996}]},{"osd":8,"last update":"Mon May 8 03:40:02 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.63},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.69199999999999995}]},{"osd":9,"last update":"Mon May 8 03:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.94199999999999995}]},{"osd":10,"last update":"Mon May 8 03:40:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.878}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]}]},{"osd":6,"up_from":45,"seq":193273528352,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6176,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":5312,"kb_avail":93738976,"statfs":{"total":95995035648,"available":95988711424,"internally_reserved":0,"allocated":876544,"data_stored":420653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5439488},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 8 03:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.373,"15min":0.36499999999999999},"min":{"1min":0.31900000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.52700000000000002,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.37},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.39500000000000002,"15min":0.39100000000000001},"min":{"1min":0.29899999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.55200000000000005,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.28199999999999997}]},{"osd":1,"last update":"Mon May 8 03:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.54700000000000004,"15min":0.53900000000000003},"min":{"1min":0.45900000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.53800000000000003,"15min":0.53400000000000003},"min":{"1min":0.45100000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.313}]},{"osd":2,"last update":"Mon May 8 03:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.53900000000000003,"15min":0.53600000000000003},"min":{"1min":0.42699999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.56599999999999995,"15min":0.56000000000000005},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.54200000000000004}]},{"osd":3,"last update":"Mon May 8 03:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.434,"15min":0.42899999999999999},"min":{"1min":0.33500000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.497,"5min":0.46400000000000002,"15min":0.45800000000000002},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.64500000000000002,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.40799999999999997}]},{"osd":4,"last update":"Mon May 8 03:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.57099999999999995,"15min":0.56699999999999995},"min":{"1min":0.41299999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.628,"5min":0.59999999999999998,"15min":0.59599999999999997},"min":{"1min":0.497,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.47599999999999998}]},{"osd":5,"last update":"Mon May 8 03:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.60099999999999998,"15min":0.59499999999999997},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.62,"15min":0.61799999999999999},"min":{"1min":0.49099999999999999,"5min":0.433,"15min":0.433},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.5}]},{"osd":7,"last update":"Mon May 8 03:40:43 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.64200000000000002,"15min":0.64000000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.63800000000000001,"15min":0.63200000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.51100000000000001}]},{"osd":8,"last update":"Mon May 8 03:40:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.51900000000000002}]},{"osd":9,"last update":"Mon May 8 03:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.56799999999999995}]},{"osd":10,"last update":"Mon May 8 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.61099999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574904,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7072,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":6208,"kb_avail":93738080,"statfs":{"total":95995035648,"available":95987793920,"internally_reserved":0,"allocated":876544,"data_stored":413647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6356992},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 8 03:40:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.51200000000000001,"15min":0.496},"min":{"1min":0.372,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.81299999999999994,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.50900000000000001,"15min":0.47699999999999998},"min":{"1min":0.39200000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.93200000000000005}]},{"osd":2,"last update":"Mon May 8 03:39:52 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.52400000000000002,"15min":0.50600000000000001},"min":{"1min":0.34599999999999997,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.51400000000000001,"15min":0.49399999999999999},"min":{"1min":0.41999999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.67100000000000004}]},{"osd":3,"last update":"Mon May 8 03:40:13 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.53500000000000003,"15min":0.50800000000000001},"min":{"1min":0.44900000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.83099999999999996,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":1.3999999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.53200000000000003,"15min":0.51400000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.70899999999999996,"5min":0.879,"15min":0.879},"last":1.409}]},{"osd":4,"last update":"Mon May 8 03:40:38 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.42399999999999999,"15min":0.40600000000000003},"min":{"1min":0.30499999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.498,"15min":0.46800000000000003},"min":{"1min":0.373,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.375}]},{"osd":5,"last update":"Mon May 8 03:39:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.55400000000000005,"15min":0.55800000000000005},"min":{"1min":0.377,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.753,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56799999999999995,"15min":0.56499999999999995},"min":{"1min":0.44700000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.64000000000000001}]},{"osd":6,"last update":"Mon May 8 03:40:21 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.60699999999999998,"15min":0.59999999999999998},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":1.1719999999999999},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.61599999999999999,"15min":0.60599999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":1.3440000000000001}]},{"osd":7,"last update":"Mon May 8 03:40:43 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.55000000000000004,"15min":0.53000000000000003},"min":{"1min":0.36799999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.58799999999999997,"15min":0.56699999999999995},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.41399999999999998}]},{"osd":8,"last update":"Mon May 8 03:40:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.65100000000000002}]},{"osd":9,"last update":"Mon May 8 03:40:27 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":1.367},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":1.357}]},{"osd":10,"last update":"Mon May 8 03:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.48299999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738429,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7164,"kb_used_data":884,"kb_used_omap":0,"kb_used_meta":6272,"kb_avail":93737988,"statfs":{"total":95995035648,"available":95987699712,"internally_reserved":0,"allocated":905216,"data_stored":422131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6422528},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon May 8 03:40:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.57699999999999996,"15min":0.59799999999999998},"min":{"1min":0.40899999999999997,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.0600000000000001,"5min":1.091,"15min":1.091},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59299999999999997,"15min":0.60699999999999998},"min":{"1min":0.46300000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.66600000000000004}]},{"osd":2,"last update":"Mon May 8 03:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.53500000000000003,"15min":0.53100000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.69399999999999995,"5min":1.159,"15min":1.159},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.51800000000000002,"15min":0.505},"min":{"1min":0.35299999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.67800000000000005,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.61299999999999999}]},{"osd":3,"last update":"Mon May 8 03:39:17 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.34999999999999998,"15min":0.34300000000000003},"min":{"1min":0.26500000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.435,"5min":0.38800000000000001,"15min":0.38},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.42499999999999999}]},{"osd":4,"last update":"Mon May 8 03:40:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.54200000000000004,"15min":0.53500000000000003},"min":{"1min":0.42999999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.51700000000000002,"15min":0.51300000000000001},"min":{"1min":0.38,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.70299999999999996,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.57499999999999996}]},{"osd":5,"last update":"Mon May 8 03:39:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.58499999999999996,"15min":0.58099999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.78600000000000003,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.54000000000000004}]},{"osd":6,"last update":"Mon May 8 03:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.46500000000000002,"15min":0.46100000000000002},"min":{"1min":0.34599999999999997,"5min":0.308,"15min":0.308},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.53900000000000003,"15min":0.53300000000000003},"min":{"1min":0.39400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.74099999999999999,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.48799999999999999}]},{"osd":7,"last update":"Mon May 8 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.61499999999999999,"15min":0.60899999999999999},"min":{"1min":0.48399999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.59499999999999997,"15min":0.59299999999999997},"min":{"1min":0.41999999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.47899999999999998}]},{"osd":8,"last update":"Mon May 8 03:40:04 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.55900000000000005}]},{"osd":9,"last update":"Mon May 8 03:40:26 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.442}]},{"osd":10,"last update":"Mon May 8 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.60499999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]}]},{"osd":2,"up_from":18,"seq":77309411380,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7160,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":6272,"kb_avail":93737992,"statfs":{"total":95995035648,"available":95987703808,"internally_reserved":0,"allocated":901120,"data_stored":422825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6422528},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 8 03:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.52200000000000002,"15min":0.52000000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.9590000000000001,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.53800000000000003,"15min":0.51900000000000002},"min":{"1min":0.38,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":2.044,"5min":2.044,"15min":2.044},"last":0.51600000000000001}]},{"osd":1,"last update":"Mon May 8 03:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.51600000000000001,"15min":0.51300000000000001},"min":{"1min":0.33300000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.52700000000000002,"15min":0.53100000000000003},"min":{"1min":0.38700000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.35499999999999998}]},{"osd":3,"last update":"Mon May 8 03:40:19 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.55000000000000004},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.76900000000000002,"5min":4.8419999999999996,"15min":4.8419999999999996},"last":0.435},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.62,"15min":0.58499999999999996},"min":{"1min":0.44600000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.73799999999999999,"5min":4.8220000000000001,"15min":4.8220000000000001},"last":0.628}]},{"osd":4,"last update":"Mon May 8 03:40:36 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.53100000000000003,"15min":0.51700000000000002},"min":{"1min":0.39900000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.55700000000000005,"15min":0.54800000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.53700000000000003}]},{"osd":5,"last update":"Mon May 8 03:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.45500000000000002,"15min":0.45800000000000002},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.50700000000000001,"15min":0.51300000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.64200000000000002,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.45200000000000001}]},{"osd":6,"last update":"Mon May 8 03:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65000000000000002,"15min":0.64900000000000002},"min":{"1min":0.46400000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.86799999999999999,"5min":1.887,"15min":1.887},"last":0.38},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.58699999999999997,"15min":0.58299999999999996},"min":{"1min":0.45100000000000001,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.81000000000000005,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.55300000000000005}]},{"osd":7,"last update":"Mon May 8 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.61399999999999999,"15min":0.60199999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.58299999999999996,"15min":0.56599999999999995},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.46200000000000002}]},{"osd":8,"last update":"Mon May 8 03:40:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.68999999999999995}]},{"osd":9,"last update":"Mon May 8 03:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.60799999999999998}]},{"osd":10,"last update":"Mon May 8 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.59099999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]}]},{"osd":3,"up_from":25,"seq":107374182447,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6512,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":5632,"kb_avail":93738640,"statfs":{"total":95995035648,"available":95988367360,"internally_reserved":0,"allocated":892928,"data_stored":420729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5767168},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 8 03:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.35599999999999998,"15min":0.34399999999999997},"min":{"1min":0.27700000000000002,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.39200000000000002,"15min":0.38200000000000001},"min":{"1min":0.29999999999999999,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.51000000000000001}]},{"osd":1,"last update":"Mon May 8 03:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.50900000000000001,"15min":0.49299999999999999},"min":{"1min":0.38200000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.497},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.53000000000000003,"15min":0.50800000000000001},"min":{"1min":0.42699999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.80800000000000005,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.61399999999999999}]},{"osd":2,"last update":"Mon May 8 03:40:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.54500000000000004,"15min":0.52700000000000002},"min":{"1min":0.43099999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.55600000000000005,"15min":0.53000000000000003},"min":{"1min":0.41499999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.78000000000000003,"5min":2.351,"15min":2.351},"last":0.53300000000000003}]},{"osd":4,"last update":"Mon May 8 03:40:38 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.54400000000000004,"15min":0.52100000000000002},"min":{"1min":0.47399999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.878,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.55700000000000005,"15min":0.53300000000000003},"min":{"1min":0.45100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.88400000000000001,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.53800000000000003}]},{"osd":5,"last update":"Mon May 8 03:39:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.73599999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.58599999999999997,"15min":0.57999999999999996},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.67200000000000004}]},{"osd":6,"last update":"Mon May 8 03:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.47399999999999998,"15min":0.45800000000000002},"min":{"1min":0.378,"5min":0.312,"15min":0.312},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.49099999999999999,"15min":0.47799999999999998},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.45900000000000002}]},{"osd":7,"last update":"Mon May 8 03:40:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.58899999999999997,"15min":0.57899999999999996},"min":{"1min":0.42999999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.71099999999999997,"15min":0.71199999999999997},"min":{"1min":0.44600000000000001,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.01,"5min":2.3740000000000001,"15min":2.3740000000000001},"last":0.64700000000000002}]},{"osd":8,"last update":"Mon May 8 03:40:03 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.46200000000000002}]},{"osd":9,"last update":"Mon May 8 03:40:26 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.57599999999999996}]},{"osd":10,"last update":"Mon May 8 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.621},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.69299999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]}]},{"osd":4,"up_from":33,"seq":141733920810,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6380,"kb_used_data":868,"kb_used_omap":0,"kb_used_meta":5504,"kb_avail":93738772,"statfs":{"total":95995035648,"available":95988502528,"internally_reserved":0,"allocated":888832,"data_stored":421249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5636096},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 8 03:40:39 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.55400000000000005,"15min":0.55000000000000004},"min":{"1min":0.38500000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.80400000000000005,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.53300000000000003,"15min":0.51700000000000002},"min":{"1min":0.42799999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76300000000000001,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.57399999999999995}]},{"osd":1,"last update":"Mon May 8 03:40:39 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.36899999999999999,"15min":0.34000000000000002},"min":{"1min":0.27400000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.38900000000000001,"15min":0.35699999999999998},"min":{"1min":0.29099999999999998,"5min":0.254,"15min":0.254},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.41299999999999998}]},{"osd":2,"last update":"Mon May 8 03:40:39 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.54800000000000004,"15min":0.52800000000000002},"min":{"1min":0.38600000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.56699999999999995,"15min":0.54900000000000004},"min":{"1min":0.40200000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.436}]},{"osd":3,"last update":"Mon May 8 03:40:39 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.54300000000000004,"15min":0.51800000000000002},"min":{"1min":0.41999999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.79800000000000004,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.54800000000000004,"15min":0.53300000000000003},"min":{"1min":0.40400000000000003,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.39200000000000002}]},{"osd":5,"last update":"Mon May 8 03:40:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.57399999999999995,"15min":0.57199999999999995},"min":{"1min":0.41799999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58699999999999997,"15min":0.58499999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.48799999999999999}]},{"osd":6,"last update":"Mon May 8 03:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.61899999999999999,"15min":0.61299999999999999},"min":{"1min":0.47199999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.623,"15min":0.60899999999999999},"min":{"1min":0.48399999999999999,"5min":0.436,"15min":0.436},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.54600000000000004}]},{"osd":7,"last update":"Mon May 8 03:40:39 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.57099999999999995,"15min":0.56000000000000005},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.56899999999999995,"15min":0.55700000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.32400000000000001}]},{"osd":8,"last update":"Mon May 8 03:40:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.53700000000000003}]},{"osd":9,"last update":"Mon May 8 03:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.498},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.57499999999999996}]},{"osd":10,"last update":"Mon May 8 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.61299999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]}]},{"osd":5,"up_from":38,"seq":163208757286,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6948,"kb_used_data":1436,"kb_used_omap":0,"kb_used_meta":5504,"kb_avail":93738204,"statfs":{"total":95995035648,"available":95987920896,"internally_reserved":0,"allocated":1470464,"data_stored":1002633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5636096},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 8 03:40:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.499,"15min":0.48699999999999999},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.51000000000000001,"15min":0.5},"min":{"1min":0.39400000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.42899999999999999}]},{"osd":1,"last update":"Mon May 8 03:40:01 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.53400000000000003,"15min":0.53000000000000003},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.55300000000000005,"15min":0.54800000000000004},"min":{"1min":0.35799999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.60099999999999998}]},{"osd":2,"last update":"Mon May 8 03:40:01 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.378,"15min":0.372},"min":{"1min":0.33300000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.59099999999999997,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.443},{"interface":"front","average":{"1min":0.438,"5min":0.40000000000000002,"15min":0.39400000000000002},"min":{"1min":0.30099999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.77200000000000002,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.30199999999999999}]},{"osd":3,"last update":"Mon May 8 03:40:01 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.51500000000000001,"15min":0.498},"min":{"1min":0.35399999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.52900000000000003,"15min":0.52100000000000002},"min":{"1min":0.39000000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.48699999999999999}]},{"osd":4,"last update":"Mon May 8 03:40:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.56999999999999995,"15min":0.56499999999999995},"min":{"1min":0.44600000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.80300000000000005,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.624,"5min":0.57299999999999995,"15min":0.56499999999999995},"min":{"1min":0.45800000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.624}]},{"osd":6,"last update":"Mon May 8 03:40:20 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.56999999999999995,"15min":0.54900000000000004},"min":{"1min":0.42799999999999999,"5min":0.376,"15min":0.376},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.54500000000000004,"15min":0.52900000000000003},"min":{"1min":0.502,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.52900000000000003}]},{"osd":7,"last update":"Mon May 8 03:40:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.627,"15min":0.625},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.92300000000000004,"5min":1.018,"15min":1.018},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.62,"5min":0.63300000000000001,"15min":0.63500000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.82299999999999995,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.65000000000000002}]},{"osd":8,"last update":"Mon May 8 03:40:01 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.47499999999999998}]},{"osd":9,"last update":"Mon May 8 03:40:26 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.504},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.68600000000000005}]},{"osd":10,"last update":"Mon May 8 03:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.70599999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-08T03:40:57.378 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-05-08T03:40:57.379 INFO:tasks.cephadm:Setting up client nodes... 2023-05-08T03:40:57.379 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2023-05-08T03:40:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:57 smithi186 ceph-mon[126480]: mgrmap e17: x(active, since 6m), standbys: z, y 2023-05-08T03:40:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:57 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/1388656217' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-05-08T03:40:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:57 smithi133 ceph-mon[125939]: mgrmap e17: x(active, since 6m), standbys: z, y 2023-05-08T03:40:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:57 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/1388656217' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-05-08T03:40:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:57 smithi096 ceph-mon[124666]: mgrmap e17: x(active, since 6m), standbys: z, y 2023-05-08T03:40:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:57 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/1388656217' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-05-08T03:40:58.046 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.a/config 2023-05-08T03:40:58.598 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:58 smithi096 ceph-mon[124666]: from='client.14769 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-05-08T03:40:58.599 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:58 smithi096 ceph-mon[124666]: from='client.14775 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-05-08T03:40:58.599 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:58 smithi096 ceph-mon[124666]: pgmap v262: 97 pgs: 97 active+clean; 616 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9.0 KiB/s wr, 18 op/s 2023-05-08T03:40:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:58 smithi133 ceph-mon[125939]: from='client.14769 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-05-08T03:40:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:58 smithi133 ceph-mon[125939]: from='client.14775 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-05-08T03:40:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:58 smithi133 ceph-mon[125939]: pgmap v262: 97 pgs: 97 active+clean; 616 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9.0 KiB/s wr, 18 op/s 2023-05-08T03:40:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:58 smithi186 ceph-mon[126480]: from='client.14769 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-05-08T03:40:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:58 smithi186 ceph-mon[126480]: from='client.14775 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-05-08T03:40:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:58 smithi186 ceph-mon[126480]: pgmap v262: 97 pgs: 97 active+clean; 616 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9.0 KiB/s wr, 18 op/s 2023-05-08T03:40:59.317 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:59.315+0000 7fca2ed09700 1 -- 172.21.15.96:0/2931794813 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca28100e70 msgr2=0x7fca28107730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:59.318 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:59.315+0000 7fca2ed09700 1 --2- 172.21.15.96:0/2931794813 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca28100e70 0x7fca28107730 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fca2000b0a0 tx=0x7fca2000b3b0 comp rx=0 tx=0).stop 2023-05-08T03:40:59.318 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:59.315+0000 7fca2ed09700 1 -- 172.21.15.96:0/2931794813 shutdown_connections 2023-05-08T03:40:59.318 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:59.315+0000 7fca2ed09700 1 --2- 172.21.15.96:0/2931794813 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca28100e70 0x7fca28107730 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:59.318 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:59.315+0000 7fca2ed09700 1 --2- 172.21.15.96:0/2931794813 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fca280ff2e0 0x7fca280ff6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:59.318 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:59.315+0000 7fca2ed09700 1 --2- 172.21.15.96:0/2931794813 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca281004e0 0x7fca28100930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:59.318 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:59.315+0000 7fca2ed09700 1 -- 172.21.15.96:0/2931794813 >> 172.21.15.96:0/2931794813 conn(0x7fca280fa8f0 msgr2=0x7fca280fcd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:59.319 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:59.315+0000 7fca2ed09700 1 -- 172.21.15.96:0/2931794813 shutdown_connections 2023-05-08T03:40:59.319 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:59.315+0000 7fca2ed09700 1 -- 172.21.15.96:0/2931794813 wait complete. 2023-05-08T03:40:59.320 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:59.315+0000 7fca2ed09700 1 Processor -- start 2023-05-08T03:40:59.320 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:59.315+0000 7fca2ed09700 1 -- start start 2023-05-08T03:40:59.321 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:59.316+0000 7fca2ed09700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca280ff2e0 0x7fca28069aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:59.321 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:59.316+0000 7fca2ed09700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca281004e0 0x7fca2819af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:59.321 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:59.316+0000 7fca2ed09700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fca28100e70 0x7fca2819d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:59.321 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:59.316+0000 7fca2ed09700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca2819dd20 con 0x7fca281004e0 2023-05-08T03:40:59.321 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:59.316+0000 7fca2ed09700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca2819de90 con 0x7fca280ff2e0 2023-05-08T03:40:59.321 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:59.316+0000 7fca2ed09700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca2819e050 con 0x7fca28100e70 2023-05-08T03:40:59.321 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:59.316+0000 7fca27fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca281004e0 0x7fca2819af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:59.321 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:59.316+0000 7fca27fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca281004e0 0x7fca2819af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40646/0 (socket says 172.21.15.96:40646) 2023-05-08T03:40:59.322 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:59.316+0000 7fca27fff700 1 -- 172.21.15.96:0/3668154794 learned_addr learned my addr 172.21.15.96:0/3668154794 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:40:59.322 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:59.316+0000 7fca2caa5700 1 --2- 172.21.15.96:0/3668154794 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca280ff2e0 0x7fca28069aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:59.322 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:59.316+0000 7fca27fff700 1 -- 172.21.15.96:0/3668154794 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fca28100e70 msgr2=0x7fca2819d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:59.322 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:59.316+0000 7fca27fff700 1 --2- 172.21.15.96:0/3668154794 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fca28100e70 0x7fca2819d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:59.322 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:59.316+0000 7fca27fff700 1 -- 172.21.15.96:0/3668154794 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca280ff2e0 msgr2=0x7fca28069aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:59.322 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:59.316+0000 7fca27fff700 1 --2- 172.21.15.96:0/3668154794 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca280ff2e0 0x7fca28069aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:59.322 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:59.316+0000 7fca27fff700 1 -- 172.21.15.96:0/3668154794 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca20009d00 con 0x7fca281004e0 2023-05-08T03:40:59.323 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:59.316+0000 7fca2caa5700 1 --2- 172.21.15.96:0/3668154794 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca280ff2e0 0x7fca28069aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-08T03:40:59.323 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:59.316+0000 7fca27fff700 1 --2- 172.21.15.96:0/3668154794 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca281004e0 0x7fca2819af40 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fca1400c9b0 tx=0x7fca1400cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:59.323 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:59.316+0000 7fca25ffb700 1 -- 172.21.15.96:0/3668154794 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca14007b00 con 0x7fca281004e0 2023-05-08T03:40:59.323 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:59.316+0000 7fca25ffb700 1 -- 172.21.15.96:0/3668154794 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fca14007c60 con 0x7fca281004e0 2023-05-08T03:40:59.323 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:59.316+0000 7fca2ed09700 1 -- 172.21.15.96:0/3668154794 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca2810acd0 con 0x7fca281004e0 2023-05-08T03:40:59.323 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:59.316+0000 7fca25ffb700 1 -- 172.21.15.96:0/3668154794 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca14018660 con 0x7fca281004e0 2023-05-08T03:40:59.323 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:59.317+0000 7fca2ed09700 1 -- 172.21.15.96:0/3668154794 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca2810ab40 con 0x7fca281004e0 2023-05-08T03:40:59.323 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:59.318+0000 7fca2ed09700 1 -- 172.21.15.96:0/3668154794 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca281067c0 con 0x7fca281004e0 2023-05-08T03:40:59.324 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:59.318+0000 7fca25ffb700 1 -- 172.21.15.96:0/3668154794 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fca14018880 con 0x7fca281004e0 2023-05-08T03:40:59.324 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:59.319+0000 7fca25ffb700 1 --2- 172.21.15.96:0/3668154794 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fca180a11e0 0x7fca180a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:40:59.324 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:59.319+0000 7fca2caa5700 1 --2- 172.21.15.96:0/3668154794 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fca180a11e0 0x7fca180a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:40:59.325 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:59.319+0000 7fca25ffb700 1 -- 172.21.15.96:0/3668154794 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fca140ccab0 con 0x7fca281004e0 2023-05-08T03:40:59.325 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:59.319+0000 7fca2caa5700 1 --2- 172.21.15.96:0/3668154794 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fca180a11e0 0x7fca180a3690 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fca28100340 tx=0x7fca1c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:40:59.326 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:59.324+0000 7fca25ffb700 1 -- 172.21.15.96:0/3668154794 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fca14096150 con 0x7fca281004e0 2023-05-08T03:40:59.588 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:59.585+0000 7fca2ed09700 1 -- 172.21.15.96:0/3668154794 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fca2802d0e0 con 0x7fca281004e0 2023-05-08T03:40:59.592 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:59.590+0000 7fca25ffb700 1 -- 172.21.15.96:0/3668154794 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v31) v1 ==== 170+0+59 (secure 0 0 0) 0x7fca14099770 con 0x7fca281004e0 2023-05-08T03:40:59.593 INFO:teuthology.orchestra.run.smithi096.stdout:[client.0] 2023-05-08T03:40:59.593 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQBLb1hkf/ABIxAANusPEoSPJZK3gmB+1BA5CA== 2023-05-08T03:40:59.595 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:59.592+0000 7fca2ed09700 1 -- 172.21.15.96:0/3668154794 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fca180a11e0 msgr2=0x7fca180a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:59.595 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:59.592+0000 7fca2ed09700 1 --2- 172.21.15.96:0/3668154794 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fca180a11e0 0x7fca180a3690 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fca28100340 tx=0x7fca1c008040 comp rx=0 tx=0).stop 2023-05-08T03:40:59.595 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:59.592+0000 7fca2ed09700 1 -- 172.21.15.96:0/3668154794 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca281004e0 msgr2=0x7fca2819af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:40:59.596 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:59.592+0000 7fca2ed09700 1 --2- 172.21.15.96:0/3668154794 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca281004e0 0x7fca2819af40 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fca1400c9b0 tx=0x7fca1400cd70 comp rx=0 tx=0).stop 2023-05-08T03:40:59.596 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:59.592+0000 7fca2ed09700 1 -- 172.21.15.96:0/3668154794 shutdown_connections 2023-05-08T03:40:59.596 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:59.592+0000 7fca2ed09700 1 --2- 172.21.15.96:0/3668154794 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fca180a11e0 0x7fca180a3690 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:59.596 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:59.592+0000 7fca2ed09700 1 --2- 172.21.15.96:0/3668154794 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fca28100e70 0x7fca2819d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:59.596 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:59.592+0000 7fca2ed09700 1 --2- 172.21.15.96:0/3668154794 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca280ff2e0 0x7fca28069aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:59.596 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:59.592+0000 7fca2ed09700 1 --2- 172.21.15.96:0/3668154794 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca281004e0 0x7fca2819af40 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:40:59.596 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:59.592+0000 7fca2ed09700 1 -- 172.21.15.96:0/3668154794 >> 172.21.15.96:0/3668154794 conn(0x7fca280fa8f0 msgr2=0x7fca28103900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:40:59.597 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:59.592+0000 7fca2ed09700 1 -- 172.21.15.96:0/3668154794 shutdown_connections 2023-05-08T03:40:59.597 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:40:59.592+0000 7fca2ed09700 1 -- 172.21.15.96:0/3668154794 wait complete. 2023-05-08T03:40:59.894 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:59 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/3668154794' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-05-08T03:40:59.894 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:40:59 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/3668154794' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-05-08T03:40:59.990 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-05-08T03:40:59.990 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2023-05-08T03:40:59.991 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-05-08T03:40:59.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:59 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/3668154794' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-05-08T03:40:59.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:40:59 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/3668154794' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-05-08T03:41:00.032 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-05-08T03:41:00.033 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2023-05-08T03:41:00.033 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- ceph mgr dump --format=json 2023-05-08T03:41:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:59 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/3668154794' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-05-08T03:41:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:40:59 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/3668154794' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-05-08T03:41:00.707 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.a/config 2023-05-08T03:41:00.946 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:00 smithi096 ceph-mon[124666]: pgmap v263: 97 pgs: 97 active+clean; 616 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 7.7 KiB/s wr, 17 op/s 2023-05-08T03:41:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:00 smithi133 ceph-mon[125939]: pgmap v263: 97 pgs: 97 active+clean; 616 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 7.7 KiB/s wr, 17 op/s 2023-05-08T03:41:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:00 smithi186 ceph-mon[126480]: pgmap v263: 97 pgs: 97 active+clean; 616 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 7.7 KiB/s wr, 17 op/s 2023-05-08T03:41:01.892 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:01.889+0000 7ff5ea4d8700 1 -- 172.21.15.96:0/3180328914 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5e40ff570 msgr2=0x7ff5e40ff940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:01.893 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:01.889+0000 7ff5ea4d8700 1 --2- 172.21.15.96:0/3180328914 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5e40ff570 0x7ff5e40ff940 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff5d40099c0 tx=0x7ff5d4009cd0 comp rx=0 tx=0).stop 2023-05-08T03:41:01.893 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:01.889+0000 7ff5ea4d8700 1 -- 172.21.15.96:0/3180328914 shutdown_connections 2023-05-08T03:41:01.893 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:01.889+0000 7ff5ea4d8700 1 --2- 172.21.15.96:0/3180328914 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5e4104610 0x7ff5e410c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:01.893 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:01.889+0000 7ff5ea4d8700 1 --2- 172.21.15.96:0/3180328914 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5e40ff570 0x7ff5e40ff940 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:01.893 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:01.889+0000 7ff5ea4d8700 1 --2- 172.21.15.96:0/3180328914 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff5e40fff10 0x7ff5e4103ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:01.893 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:01.889+0000 7ff5ea4d8700 1 -- 172.21.15.96:0/3180328914 >> 172.21.15.96:0/3180328914 conn(0x7ff5e40771d0 msgr2=0x7ff5e40775d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:01.893 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:01.889+0000 7ff5ea4d8700 1 -- 172.21.15.96:0/3180328914 shutdown_connections 2023-05-08T03:41:01.894 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:01.889+0000 7ff5ea4d8700 1 -- 172.21.15.96:0/3180328914 wait complete. 2023-05-08T03:41:01.894 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:01.890+0000 7ff5ea4d8700 1 Processor -- start 2023-05-08T03:41:01.894 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:01.890+0000 7ff5ea4d8700 1 -- start start 2023-05-08T03:41:01.897 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:01.890+0000 7ff5ea4d8700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff5e40ff570 0x7ff5e41972a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:01.897 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:01.890+0000 7ff5ea4d8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5e40fff10 0x7ff5e41977e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:01.897 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:01.890+0000 7ff5ea4d8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5e4104610 0x7ff5e41a2320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:01.897 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:01.890+0000 7ff5ea4d8700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e41a2860 con 0x7ff5e4104610 2023-05-08T03:41:01.897 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:01.890+0000 7ff5ea4d8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e41a29a0 con 0x7ff5e40fff10 2023-05-08T03:41:01.897 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:01.890+0000 7ff5ea4d8700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e41a2ae0 con 0x7ff5e40ff570 2023-05-08T03:41:01.898 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:01.891+0000 7ff5e8a75700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5e4104610 0x7ff5e41a2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:01.898 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:01.891+0000 7ff5e8a75700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5e4104610 0x7ff5e41a2320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40660/0 (socket says 172.21.15.96:40660) 2023-05-08T03:41:01.898 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:01.891+0000 7ff5e8a75700 1 -- 172.21.15.96:0/1035804709 learned_addr learned my addr 172.21.15.96:0/1035804709 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:41:01.898 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:01.891+0000 7ff5e3fff700 1 --2- 172.21.15.96:0/1035804709 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff5e40ff570 0x7ff5e41972a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:01.898 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:01.891+0000 7ff5e37fe700 1 --2- 172.21.15.96:0/1035804709 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5e40fff10 0x7ff5e41977e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:01.898 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:01.891+0000 7ff5e8a75700 1 -- 172.21.15.96:0/1035804709 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff5e40ff570 msgr2=0x7ff5e41972a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:01.898 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:01.891+0000 7ff5e8a75700 1 --2- 172.21.15.96:0/1035804709 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff5e40ff570 0x7ff5e41972a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:01.899 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:01.891+0000 7ff5e8a75700 1 -- 172.21.15.96:0/1035804709 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5e40fff10 msgr2=0x7ff5e41977e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:01.899 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:01.891+0000 7ff5e8a75700 1 --2- 172.21.15.96:0/1035804709 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5e40fff10 0x7ff5e41977e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:01.899 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:01.891+0000 7ff5e8a75700 1 -- 172.21.15.96:0/1035804709 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d40095f0 con 0x7ff5e4104610 2023-05-08T03:41:01.899 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:01.891+0000 7ff5e3fff700 1 --2- 172.21.15.96:0/1035804709 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff5e40ff570 0x7ff5e41972a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-08T03:41:01.899 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:01.891+0000 7ff5e37fe700 1 --2- 172.21.15.96:0/1035804709 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5e40fff10 0x7ff5e41977e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-08T03:41:01.899 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:01.891+0000 7ff5e8a75700 1 --2- 172.21.15.96:0/1035804709 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5e4104610 0x7ff5e41a2320 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc007d70 tx=0x7ff5dc00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:01.899 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:01.891+0000 7ff5e17fa700 1 -- 172.21.15.96:0/1035804709 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5dc00ad40 con 0x7ff5e4104610 2023-05-08T03:41:01.900 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:01.891+0000 7ff5e17fa700 1 -- 172.21.15.96:0/1035804709 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff5dc0128e0 con 0x7ff5e4104610 2023-05-08T03:41:01.900 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:01.891+0000 7ff5ea4d8700 1 -- 172.21.15.96:0/1035804709 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5e410f3a0 con 0x7ff5e4104610 2023-05-08T03:41:01.900 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:01.891+0000 7ff5e17fa700 1 -- 172.21.15.96:0/1035804709 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5dc011780 con 0x7ff5e4104610 2023-05-08T03:41:01.900 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:01.891+0000 7ff5ea4d8700 1 -- 172.21.15.96:0/1035804709 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5e410f210 con 0x7ff5e4104610 2023-05-08T03:41:01.900 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:01.892+0000 7ff5ea4d8700 1 -- 172.21.15.96:0/1035804709 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5e410f530 con 0x7ff5e4104610 2023-05-08T03:41:01.900 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:01.893+0000 7ff5e17fa700 1 -- 172.21.15.96:0/1035804709 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7ff5dc012a50 con 0x7ff5e4104610 2023-05-08T03:41:01.900 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:01.894+0000 7ff5e17fa700 1 --2- 172.21.15.96:0/1035804709 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7ff5cc0a1260 0x7ff5cc0a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:01.901 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:01.894+0000 7ff5e3fff700 1 --2- 172.21.15.96:0/1035804709 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7ff5cc0a1260 0x7ff5cc0a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:01.901 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:01.894+0000 7ff5e17fa700 1 -- 172.21.15.96:0/1035804709 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7ff5dc0ccf80 con 0x7ff5e4104610 2023-05-08T03:41:01.901 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:01.894+0000 7ff5e3fff700 1 --2- 172.21.15.96:0/1035804709 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7ff5cc0a1260 0x7ff5cc0a3710 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff5d4006010 tx=0x7ff5d4000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:01.901 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:01.898+0000 7ff5e17fa700 1 -- 172.21.15.96:0/1035804709 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7ff5dc096730 con 0x7ff5e4104610 2023-05-08T03:41:02.141 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:02.139+0000 7ff5ea4d8700 1 -- 172.21.15.96:0/1035804709 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7ff5e4066fa0 con 0x7ff5e4104610 2023-05-08T03:41:02.146 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:02.143+0000 7ff5e17fa700 1 -- 172.21.15.96:0/1035804709 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) v1 ==== 74+0+260125 (secure 0 0 0) 0x7ff5dc099d50 con 0x7ff5e4104610 2023-05-08T03:41:02.149 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:41:02.150 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:02.146+0000 7ff5ea4d8700 1 -- 172.21.15.96:0/1035804709 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7ff5cc0a1260 msgr2=0x7ff5cc0a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:02.150 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:02.146+0000 7ff5ea4d8700 1 --2- 172.21.15.96:0/1035804709 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7ff5cc0a1260 0x7ff5cc0a3710 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff5d4006010 tx=0x7ff5d4000bc0 comp rx=0 tx=0).stop 2023-05-08T03:41:02.150 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:02.146+0000 7ff5ea4d8700 1 -- 172.21.15.96:0/1035804709 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5e4104610 msgr2=0x7ff5e41a2320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:02.150 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:02.146+0000 7ff5ea4d8700 1 --2- 172.21.15.96:0/1035804709 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5e4104610 0x7ff5e41a2320 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc007d70 tx=0x7ff5dc00a340 comp rx=0 tx=0).stop 2023-05-08T03:41:02.151 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:02.146+0000 7ff5ea4d8700 1 -- 172.21.15.96:0/1035804709 shutdown_connections 2023-05-08T03:41:02.151 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:02.146+0000 7ff5ea4d8700 1 --2- 172.21.15.96:0/1035804709 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7ff5cc0a1260 0x7ff5cc0a3710 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:02.151 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:02.146+0000 7ff5ea4d8700 1 --2- 172.21.15.96:0/1035804709 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5e4104610 0x7ff5e41a2320 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:02.151 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:02.146+0000 7ff5ea4d8700 1 --2- 172.21.15.96:0/1035804709 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff5e40ff570 0x7ff5e41972a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:02.151 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:02.146+0000 7ff5ea4d8700 1 --2- 172.21.15.96:0/1035804709 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5e40fff10 0x7ff5e41977e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:02.151 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:02.146+0000 7ff5ea4d8700 1 -- 172.21.15.96:0/1035804709 >> 172.21.15.96:0/1035804709 conn(0x7ff5e40771d0 msgr2=0x7ff5e40fcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:02.151 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:02.146+0000 7ff5ea4d8700 1 -- 172.21.15.96:0/1035804709 shutdown_connections 2023-05-08T03:41:02.152 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:02.146+0000 7ff5ea4d8700 1 -- 172.21.15.96:0/1035804709 wait complete. 2023-05-08T03:41:02.553 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":17,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":2748629182},{"type":"v1","addr":"172.21.15.96:6801","nonce":2748629182}]},"active_addr":"172.21.15.96:6801/2748629182","active_change":"2023-05-08T03:34:37.472212+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24110,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.96:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.96:0","nonce":2925818678}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.96:0","nonce":2861581689}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.96:0","nonce":3738385714}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.96:0","nonce":786673909}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.96:0","nonce":1814645470}]}]} 2023-05-08T03:41:02.560 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2023-05-08T03:41:02.560 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2023-05-08T03:41:02.561 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- ceph osd dump --format=json 2023-05-08T03:41:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:02 smithi133 ceph-mon[125939]: pgmap v264: 97 pgs: 97 active+clean; 621 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 7.2 KiB/s wr, 17 op/s 2023-05-08T03:41:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:02 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/1035804709' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-05-08T03:41:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:02 smithi096 ceph-mon[124666]: pgmap v264: 97 pgs: 97 active+clean; 621 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 7.2 KiB/s wr, 17 op/s 2023-05-08T03:41:03.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:02 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/1035804709' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-05-08T03:41:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:02 smithi186 ceph-mon[126480]: pgmap v264: 97 pgs: 97 active+clean; 621 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 7.2 KiB/s wr, 17 op/s 2023-05-08T03:41:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:02 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/1035804709' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-05-08T03:41:03.205 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.a/config 2023-05-08T03:41:04.381 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:04.378+0000 7fe65c55a700 1 -- 172.21.15.96:0/3003001734 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6540feaa0 msgr2=0x7fe6540fef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:04.381 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:04.378+0000 7fe65c55a700 1 --2- 172.21.15.96:0/3003001734 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6540feaa0 0x7fe6540fef10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe650009990 tx=0x7fe650009ca0 comp rx=0 tx=0).stop 2023-05-08T03:41:04.382 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:04.378+0000 7fe65c55a700 1 -- 172.21.15.96:0/3003001734 shutdown_connections 2023-05-08T03:41:04.382 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:04.378+0000 7fe65c55a700 1 --2- 172.21.15.96:0/3003001734 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6540ff450 0x7fe65410b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:04.382 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:04.378+0000 7fe65c55a700 1 --2- 172.21.15.96:0/3003001734 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe654104aa0 0x7fe654104e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:04.382 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:04.378+0000 7fe65c55a700 1 --2- 172.21.15.96:0/3003001734 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6540feaa0 0x7fe6540fef10 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:04.382 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:04.378+0000 7fe65c55a700 1 -- 172.21.15.96:0/3003001734 >> 172.21.15.96:0/3003001734 conn(0x7fe6540759a0 msgr2=0x7fe654075da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:04.382 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:04.378+0000 7fe65c55a700 1 -- 172.21.15.96:0/3003001734 shutdown_connections 2023-05-08T03:41:04.382 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:04.378+0000 7fe65c55a700 1 -- 172.21.15.96:0/3003001734 wait complete. 2023-05-08T03:41:04.383 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:04.379+0000 7fe65c55a700 1 Processor -- start 2023-05-08T03:41:04.383 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:04.379+0000 7fe65c55a700 1 -- start start 2023-05-08T03:41:04.383 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:04.379+0000 7fe65c55a700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe6540feaa0 0x7fe654194280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:04.383 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:04.379+0000 7fe65c55a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6540ff450 0x7fe6541947c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:04.383 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:04.379+0000 7fe65c55a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe654104aa0 0x7fe654198c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:04.384 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:04.379+0000 7fe65c55a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe654199240 con 0x7fe654104aa0 2023-05-08T03:41:04.384 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:04.379+0000 7fe65c55a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6541993b0 con 0x7fe6540ff450 2023-05-08T03:41:04.385 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:04.379+0000 7fe65c55a700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe654199570 con 0x7fe6540feaa0 2023-05-08T03:41:04.385 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:04.379+0000 7fe65aaf7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe654104aa0 0x7fe654198c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:04.385 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:04.379+0000 7fe65aaf7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe654104aa0 0x7fe654198c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40668/0 (socket says 172.21.15.96:40668) 2023-05-08T03:41:04.385 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:04.379+0000 7fe65aaf7700 1 -- 172.21.15.96:0/3230883788 learned_addr learned my addr 172.21.15.96:0/3230883788 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:41:04.385 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:04.379+0000 7fe65a2f6700 1 --2- 172.21.15.96:0/3230883788 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe6540feaa0 0x7fe654194280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:04.385 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:04.379+0000 7fe659af5700 1 --2- 172.21.15.96:0/3230883788 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6540ff450 0x7fe6541947c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:04.386 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:04.379+0000 7fe65aaf7700 1 -- 172.21.15.96:0/3230883788 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe6540feaa0 msgr2=0x7fe654194280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:04.386 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:04.379+0000 7fe65aaf7700 1 --2- 172.21.15.96:0/3230883788 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe6540feaa0 0x7fe654194280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:04.386 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:04.379+0000 7fe65aaf7700 1 -- 172.21.15.96:0/3230883788 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6540ff450 msgr2=0x7fe6541947c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:04.386 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:04.379+0000 7fe65aaf7700 1 --2- 172.21.15.96:0/3230883788 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6540ff450 0x7fe6541947c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:04.386 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:04.379+0000 7fe65aaf7700 1 -- 172.21.15.96:0/3230883788 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6500095f0 con 0x7fe654104aa0 2023-05-08T03:41:04.386 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:04.380+0000 7fe65aaf7700 1 --2- 172.21.15.96:0/3230883788 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe654104aa0 0x7fe654198c30 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe64c00d370 tx=0x7fe64c00d680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:04.386 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:04.380+0000 7fe64b7fe700 1 -- 172.21.15.96:0/3230883788 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe64c017070 con 0x7fe654104aa0 2023-05-08T03:41:04.386 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:04.380+0000 7fe64b7fe700 1 -- 172.21.15.96:0/3230883788 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe64c00dea0 con 0x7fe654104aa0 2023-05-08T03:41:04.387 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:04.380+0000 7fe65c55a700 1 -- 172.21.15.96:0/3230883788 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe65410e260 con 0x7fe654104aa0 2023-05-08T03:41:04.387 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:04.380+0000 7fe64b7fe700 1 -- 172.21.15.96:0/3230883788 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe64c00f040 con 0x7fe654104aa0 2023-05-08T03:41:04.387 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:04.380+0000 7fe65c55a700 1 -- 172.21.15.96:0/3230883788 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe65410e0d0 con 0x7fe654104aa0 2023-05-08T03:41:04.387 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:04.381+0000 7fe65c55a700 1 -- 172.21.15.96:0/3230883788 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe65410e3f0 con 0x7fe654104aa0 2023-05-08T03:41:04.387 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:04.382+0000 7fe64b7fe700 1 -- 172.21.15.96:0/3230883788 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fe64c008c00 con 0x7fe654104aa0 2023-05-08T03:41:04.388 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:04.382+0000 7fe64b7fe700 1 --2- 172.21.15.96:0/3230883788 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fe6400a11e0 0x7fe6400a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:04.388 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:04.383+0000 7fe65a2f6700 1 --2- 172.21.15.96:0/3230883788 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fe6400a11e0 0x7fe6400a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:04.388 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:04.383+0000 7fe64b7fe700 1 -- 172.21.15.96:0/3230883788 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fe64c0ccb70 con 0x7fe654104aa0 2023-05-08T03:41:04.389 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:04.383+0000 7fe65a2f6700 1 --2- 172.21.15.96:0/3230883788 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fe6400a11e0 0x7fe6400a3690 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe6540ffbe0 tx=0x7fe64400b580 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:04.389 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:04.386+0000 7fe64b7fe700 1 -- 172.21.15.96:0/3230883788 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fe64c096310 con 0x7fe654104aa0 2023-05-08T03:41:04.579 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:04.576+0000 7fe65c55a700 1 -- 172.21.15.96:0/3230883788 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe6541a1300 con 0x7fe654104aa0 2023-05-08T03:41:04.580 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:04.578+0000 7fe64b7fe700 1 -- 172.21.15.96:0/3230883788 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+22096 (secure 0 0 0) 0x7fe64c099930 con 0x7fe654104aa0 2023-05-08T03:41:04.580 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:41:04.581 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":82,"fsid":"f7ffcfb0-ed50-11ed-9b01-001a4aab830c","created":"2023-05-08T03:33:42.765680+0000","modified":"2023-05-08T03:40:50.211915+0000","last_up_change":"2023-05-08T03:40:07.550882+0000","last_in_change":"2023-05-08T03:39:49.027947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-08T03:36:47.800739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-05-08T03:40:47.229693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-05-08T03:40:48.359294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2ee801e1-8eec-496d-a9ac-fc566b38bbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":1816903726},{"type":"v1","addr":"172.21.15.96:6803","nonce":1816903726}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":1816903726},{"type":"v1","addr":"172.21.15.96:6805","nonce":1816903726}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":1816903726},{"type":"v1","addr":"172.21.15.96:6809","nonce":1816903726}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":1816903726},{"type":"v1","addr":"172.21.15.96:6807","nonce":1816903726}]},"public_addr":"172.21.15.96:6803/1816903726","cluster_addr":"172.21.15.96:6805/1816903726","heartbeat_back_addr":"172.21.15.96:6809/1816903726","heartbeat_front_addr":"172.21.15.96:6807/1816903726","state":["exists","up"]},{"osd":1,"uuid":"eb73deea-fc7c-4f2f-8aef-2d71c598afda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":206989126},{"type":"v1","addr":"172.21.15.133:6801","nonce":206989126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":206989126},{"type":"v1","addr":"172.21.15.133:6803","nonce":206989126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":206989126},{"type":"v1","addr":"172.21.15.133:6807","nonce":206989126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":206989126},{"type":"v1","addr":"172.21.15.133:6805","nonce":206989126}]},"public_addr":"172.21.15.133:6801/206989126","cluster_addr":"172.21.15.133:6803/206989126","heartbeat_back_addr":"172.21.15.133:6807/206989126","heartbeat_front_addr":"172.21.15.133:6805/206989126","state":["exists","up"]},{"osd":2,"uuid":"74a2f239-e82d-4d87-9458-5373b6cbbffd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":1791188143},{"type":"v1","addr":"172.21.15.186:6801","nonce":1791188143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":1791188143},{"type":"v1","addr":"172.21.15.186:6803","nonce":1791188143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":1791188143},{"type":"v1","addr":"172.21.15.186:6807","nonce":1791188143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":1791188143},{"type":"v1","addr":"172.21.15.186:6805","nonce":1791188143}]},"public_addr":"172.21.15.186:6801/1791188143","cluster_addr":"172.21.15.186:6803/1791188143","heartbeat_back_addr":"172.21.15.186:6807/1791188143","heartbeat_front_addr":"172.21.15.186:6805/1791188143","state":["exists","up"]},{"osd":3,"uuid":"421eedf5-ba6e-484e-b715-78c1c10d684e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":3430402140},{"type":"v1","addr":"172.21.15.96:6811","nonce":3430402140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":3430402140},{"type":"v1","addr":"172.21.15.96:6813","nonce":3430402140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":3430402140},{"type":"v1","addr":"172.21.15.96:6817","nonce":3430402140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":3430402140},{"type":"v1","addr":"172.21.15.96:6815","nonce":3430402140}]},"public_addr":"172.21.15.96:6811/3430402140","cluster_addr":"172.21.15.96:6813/3430402140","heartbeat_back_addr":"172.21.15.96:6817/3430402140","heartbeat_front_addr":"172.21.15.96:6815/3430402140","state":["exists","up"]},{"osd":4,"uuid":"fb20100b-6a5a-462d-955d-1697a3861e96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":1237495996},{"type":"v1","addr":"172.21.15.133:6809","nonce":1237495996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":1237495996},{"type":"v1","addr":"172.21.15.133:6811","nonce":1237495996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":1237495996},{"type":"v1","addr":"172.21.15.133:6815","nonce":1237495996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":1237495996},{"type":"v1","addr":"172.21.15.133:6813","nonce":1237495996}]},"public_addr":"172.21.15.133:6809/1237495996","cluster_addr":"172.21.15.133:6811/1237495996","heartbeat_back_addr":"172.21.15.133:6815/1237495996","heartbeat_front_addr":"172.21.15.133:6813/1237495996","state":["exists","up"]},{"osd":5,"uuid":"00177913-8bd6-4391-83c3-08c2b1b8ef13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":541111862},{"type":"v1","addr":"172.21.15.186:6809","nonce":541111862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":541111862},{"type":"v1","addr":"172.21.15.186:6811","nonce":541111862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":541111862},{"type":"v1","addr":"172.21.15.186:6815","nonce":541111862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":541111862},{"type":"v1","addr":"172.21.15.186:6813","nonce":541111862}]},"public_addr":"172.21.15.186:6809/541111862","cluster_addr":"172.21.15.186:6811/541111862","heartbeat_back_addr":"172.21.15.186:6815/541111862","heartbeat_front_addr":"172.21.15.186:6813/541111862","state":["exists","up"]},{"osd":6,"uuid":"204baab6-ca6f-4eef-8b9c-91efc04cc30c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":386227948},{"type":"v1","addr":"172.21.15.96:6819","nonce":386227948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":386227948},{"type":"v1","addr":"172.21.15.96:6821","nonce":386227948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":386227948},{"type":"v1","addr":"172.21.15.96:6825","nonce":386227948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":386227948},{"type":"v1","addr":"172.21.15.96:6823","nonce":386227948}]},"public_addr":"172.21.15.96:6819/386227948","cluster_addr":"172.21.15.96:6821/386227948","heartbeat_back_addr":"172.21.15.96:6825/386227948","heartbeat_front_addr":"172.21.15.96:6823/386227948","state":["exists","up"]},{"osd":7,"uuid":"282db569-a76e-485b-a33d-f2579b956525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":218507954},{"type":"v1","addr":"172.21.15.133:6817","nonce":218507954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":218507954},{"type":"v1","addr":"172.21.15.133:6819","nonce":218507954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":218507954},{"type":"v1","addr":"172.21.15.133:6823","nonce":218507954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":218507954},{"type":"v1","addr":"172.21.15.133:6821","nonce":218507954}]},"public_addr":"172.21.15.133:6817/218507954","cluster_addr":"172.21.15.133:6819/218507954","heartbeat_back_addr":"172.21.15.133:6823/218507954","heartbeat_front_addr":"172.21.15.133:6821/218507954","state":["exists","up"]},{"osd":8,"uuid":"693e25b5-355d-4990-9467-0fac4c9133fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":1648475902},{"type":"v1","addr":"172.21.15.186:6817","nonce":1648475902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":1648475902},{"type":"v1","addr":"172.21.15.186:6819","nonce":1648475902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":1648475902},{"type":"v1","addr":"172.21.15.186:6823","nonce":1648475902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":1648475902},{"type":"v1","addr":"172.21.15.186:6821","nonce":1648475902}]},"public_addr":"172.21.15.186:6817/1648475902","cluster_addr":"172.21.15.186:6819/1648475902","heartbeat_back_addr":"172.21.15.186:6823/1648475902","heartbeat_front_addr":"172.21.15.186:6821/1648475902","state":["exists","up"]},{"osd":9,"uuid":"72fbff09-fe28-4014-86fc-c31f95cd19a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":543223824},{"type":"v1","addr":"172.21.15.96:6827","nonce":543223824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":543223824},{"type":"v1","addr":"172.21.15.96:6829","nonce":543223824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6832","nonce":543223824},{"type":"v1","addr":"172.21.15.96:6833","nonce":543223824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":543223824},{"type":"v1","addr":"172.21.15.96:6831","nonce":543223824}]},"public_addr":"172.21.15.96:6827/543223824","cluster_addr":"172.21.15.96:6829/543223824","heartbeat_back_addr":"172.21.15.96:6833/543223824","heartbeat_front_addr":"172.21.15.96:6831/543223824","state":["exists","up"]},{"osd":10,"uuid":"6c2b6757-60c2-4962-9409-6051dcb13273","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":2323107912},{"type":"v1","addr":"172.21.15.133:6825","nonce":2323107912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":2323107912},{"type":"v1","addr":"172.21.15.133:6827","nonce":2323107912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":2323107912},{"type":"v1","addr":"172.21.15.133:6831","nonce":2323107912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":2323107912},{"type":"v1","addr":"172.21.15.133:6829","nonce":2323107912}]},"public_addr":"172.21.15.133:6825/2323107912","cluster_addr":"172.21.15.133:6827/2323107912","heartbeat_back_addr":"172.21.15.133:6831/2323107912","heartbeat_front_addr":"172.21.15.133:6829/2323107912","state":["exists","up"]},{"osd":11,"uuid":"03c0bb25-2921-446b-960e-6a7a328d36a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":3853499290},{"type":"v1","addr":"172.21.15.186:6825","nonce":3853499290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":3853499290},{"type":"v1","addr":"172.21.15.186:6827","nonce":3853499290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":3853499290},{"type":"v1","addr":"172.21.15.186:6831","nonce":3853499290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":3853499290},{"type":"v1","addr":"172.21.15.186:6829","nonce":3853499290}]},"public_addr":"172.21.15.186:6825/3853499290","cluster_addr":"172.21.15.186:6827/3853499290","heartbeat_back_addr":"172.21.15.186:6831/3853499290","heartbeat_front_addr":"172.21.15.186:6829/3853499290","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:36:02.087281+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:36:24.328783+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:36:46.135576+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:37:08.524145+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:37:30.883871+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:37:53.344554+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:38:15.448162+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:38:37.414878+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:38:59.533953+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:39:21.392102+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:39:43.462696+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:40:05.561808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.96:0/1333468881":"2023-05-09T03:34:37.472043+0000","172.21.15.96:6800/1979917756":"2023-05-09T03:34:37.472043+0000","172.21.15.96:0/1332045367":"2023-05-09T03:34:37.472043+0000","172.21.15.96:0/520278090":"2023-05-09T03:34:14.800324+0000","172.21.15.96:0/1055409415":"2023-05-09T03:34:37.472043+0000","172.21.15.96:6801/1979917756":"2023-05-09T03:34:37.472043+0000","172.21.15.96:0/1541933328":"2023-05-09T03:34:14.800324+0000","172.21.15.96:6800/3944122753":"2023-05-09T03:34:14.800324+0000","172.21.15.96:0/2986058319":"2023-05-09T03:34:14.800324+0000","172.21.15.96:6801/3944122753":"2023-05-09T03:34:14.800324+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-08T03:41:04.582 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:04.580+0000 7fe65c55a700 1 -- 172.21.15.96:0/3230883788 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fe6400a11e0 msgr2=0x7fe6400a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:04.582 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:04.580+0000 7fe65c55a700 1 --2- 172.21.15.96:0/3230883788 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fe6400a11e0 0x7fe6400a3690 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe6540ffbe0 tx=0x7fe64400b580 comp rx=0 tx=0).stop 2023-05-08T03:41:04.582 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:04.580+0000 7fe65c55a700 1 -- 172.21.15.96:0/3230883788 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe654104aa0 msgr2=0x7fe654198c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:04.583 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:04.580+0000 7fe65c55a700 1 --2- 172.21.15.96:0/3230883788 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe654104aa0 0x7fe654198c30 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe64c00d370 tx=0x7fe64c00d680 comp rx=0 tx=0).stop 2023-05-08T03:41:04.583 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:04.580+0000 7fe65c55a700 1 -- 172.21.15.96:0/3230883788 shutdown_connections 2023-05-08T03:41:04.583 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:04.580+0000 7fe65c55a700 1 --2- 172.21.15.96:0/3230883788 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fe6400a11e0 0x7fe6400a3690 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:04.583 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:04.580+0000 7fe65c55a700 1 --2- 172.21.15.96:0/3230883788 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe654104aa0 0x7fe654198c30 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:04.583 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:04.580+0000 7fe65c55a700 1 --2- 172.21.15.96:0/3230883788 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe6540feaa0 0x7fe654194280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:04.583 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:04.580+0000 7fe65c55a700 1 --2- 172.21.15.96:0/3230883788 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6540ff450 0x7fe6541947c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:04.583 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:04.580+0000 7fe65c55a700 1 -- 172.21.15.96:0/3230883788 >> 172.21.15.96:0/3230883788 conn(0x7fe6540759a0 msgr2=0x7fe6540fcf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:04.584 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:04.580+0000 7fe65c55a700 1 -- 172.21.15.96:0/3230883788 shutdown_connections 2023-05-08T03:41:04.584 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:04.580+0000 7fe65c55a700 1 -- 172.21.15.96:0/3230883788 wait complete. 2023-05-08T03:41:04.910 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:04 smithi096 ceph-mon[124666]: pgmap v265: 97 pgs: 97 active+clean; 621 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 6.3 KiB/s wr, 14 op/s 2023-05-08T03:41:04.910 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:04 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/3230883788' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-05-08T03:41:04.959 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2023-05-08T03:41:04.960 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- ceph osd dump --format=json 2023-05-08T03:41:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:04 smithi133 ceph-mon[125939]: pgmap v265: 97 pgs: 97 active+clean; 621 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 6.3 KiB/s wr, 14 op/s 2023-05-08T03:41:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:04 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/3230883788' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-05-08T03:41:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:04 smithi186 ceph-mon[126480]: pgmap v265: 97 pgs: 97 active+clean; 621 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 6.3 KiB/s wr, 14 op/s 2023-05-08T03:41:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:04 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/3230883788' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-05-08T03:41:05.602 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.a/config 2023-05-08T03:41:06.799 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:06.795+0000 7f823c43d700 1 -- 172.21.15.96:0/318031925 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82340feaa0 msgr2=0x7f82340fef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:06.799 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:06.795+0000 7f823c43d700 1 --2- 172.21.15.96:0/318031925 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82340feaa0 0x7f82340fef10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f823000aaa0 tx=0x7f823000adb0 comp rx=0 tx=0).stop 2023-05-08T03:41:06.799 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:06.795+0000 7f823c43d700 1 -- 172.21.15.96:0/318031925 shutdown_connections 2023-05-08T03:41:06.800 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:06.795+0000 7f823c43d700 1 --2- 172.21.15.96:0/318031925 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82340ff450 0x7f823410b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:06.800 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:06.795+0000 7f823c43d700 1 --2- 172.21.15.96:0/318031925 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8234104aa0 0x7f8234104e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:06.800 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:06.796+0000 7f823c43d700 1 --2- 172.21.15.96:0/318031925 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82340feaa0 0x7f82340fef10 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:06.800 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:06.796+0000 7f823c43d700 1 -- 172.21.15.96:0/318031925 >> 172.21.15.96:0/318031925 conn(0x7f82340759a0 msgr2=0x7f8234075da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:06.800 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:06.796+0000 7f823c43d700 1 -- 172.21.15.96:0/318031925 shutdown_connections 2023-05-08T03:41:06.800 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:06.796+0000 7f823c43d700 1 -- 172.21.15.96:0/318031925 wait complete. 2023-05-08T03:41:06.800 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:06.796+0000 7f823c43d700 1 Processor -- start 2023-05-08T03:41:06.801 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:06.796+0000 7f823c43d700 1 -- start start 2023-05-08T03:41:06.801 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:06.796+0000 7f823c43d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82340feaa0 0x7f8234194220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:06.801 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:06.796+0000 7f823c43d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82340ff450 0x7f8234194760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:06.801 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:06.796+0000 7f823c43d700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8234104aa0 0x7f8234198bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:06.801 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:06.796+0000 7f823c43d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82341991e0 con 0x7f82340feaa0 2023-05-08T03:41:06.801 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:06.796+0000 7f823c43d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8234199350 con 0x7f82340ff450 2023-05-08T03:41:06.801 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:06.796+0000 7f823c43d700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8234199510 con 0x7f8234104aa0 2023-05-08T03:41:06.801 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:06.797+0000 7f823a1d9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82340feaa0 0x7f8234194220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:06.802 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:06.797+0000 7f823a1d9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82340feaa0 0x7f8234194220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40678/0 (socket says 172.21.15.96:40678) 2023-05-08T03:41:06.802 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:06.797+0000 7f823a1d9700 1 -- 172.21.15.96:0/1292524076 learned_addr learned my addr 172.21.15.96:0/1292524076 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:41:06.803 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:06.797+0000 7f823a1d9700 1 -- 172.21.15.96:0/1292524076 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8234104aa0 msgr2=0x7f8234198bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:06.803 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:06.797+0000 7f823a1d9700 1 --2- 172.21.15.96:0/1292524076 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8234104aa0 0x7f8234198bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:06.803 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:06.797+0000 7f82399d8700 1 --2- 172.21.15.96:0/1292524076 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82340ff450 0x7f8234194760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:06.803 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:06.797+0000 7f823a1d9700 1 -- 172.21.15.96:0/1292524076 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82340ff450 msgr2=0x7f8234194760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:06.804 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:06.797+0000 7f823a1d9700 1 --2- 172.21.15.96:0/1292524076 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82340ff450 0x7f8234194760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:06.804 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:06.797+0000 7f823a1d9700 1 -- 172.21.15.96:0/1292524076 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f823000a700 con 0x7f82340feaa0 2023-05-08T03:41:06.804 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:06.797+0000 7f823a1d9700 1 --2- 172.21.15.96:0/1292524076 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82340feaa0 0x7f8234194220 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8224007b50 tx=0x7f8224007f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:06.804 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:06.797+0000 7f822b7fe700 1 -- 172.21.15.96:0/1292524076 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8224011070 con 0x7f82340feaa0 2023-05-08T03:41:06.804 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:06.797+0000 7f823c43d700 1 -- 172.21.15.96:0/1292524076 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f823410e2a0 con 0x7f82340feaa0 2023-05-08T03:41:06.804 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:06.797+0000 7f822b7fe700 1 -- 172.21.15.96:0/1292524076 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f822400c2e0 con 0x7f82340feaa0 2023-05-08T03:41:06.804 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:06.797+0000 7f822b7fe700 1 -- 172.21.15.96:0/1292524076 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f822400a980 con 0x7f82340feaa0 2023-05-08T03:41:06.805 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:06.797+0000 7f823c43d700 1 -- 172.21.15.96:0/1292524076 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f823410e110 con 0x7f82340feaa0 2023-05-08T03:41:06.805 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:06.798+0000 7f823c43d700 1 -- 172.21.15.96:0/1292524076 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f823410e430 con 0x7f82340feaa0 2023-05-08T03:41:06.805 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:06.799+0000 7f822b7fe700 1 -- 172.21.15.96:0/1292524076 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f822400aae0 con 0x7f82340feaa0 2023-05-08T03:41:06.805 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:06.800+0000 7f822b7fe700 1 --2- 172.21.15.96:0/1292524076 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f82200a1260 0x7f82200a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:06.805 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:06.800+0000 7f82399d8700 1 --2- 172.21.15.96:0/1292524076 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f82200a1260 0x7f82200a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:06.805 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:06.800+0000 7f822b7fe700 1 -- 172.21.15.96:0/1292524076 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f82240cdff0 con 0x7f82340feaa0 2023-05-08T03:41:06.805 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:06.800+0000 7f82399d8700 1 --2- 172.21.15.96:0/1292524076 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f82200a1260 0x7f82200a3710 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8230005f50 tx=0x7f8230005e80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:06.806 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:06.804+0000 7f822b7fe700 1 -- 172.21.15.96:0/1292524076 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f8224097690 con 0x7f82340feaa0 2023-05-08T03:41:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:06 smithi133 ceph-mon[125939]: pgmap v266: 97 pgs: 97 active+clean; 621 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 5.7 KiB/s wr, 13 op/s 2023-05-08T03:41:06.995 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:06.992+0000 7f823c43d700 1 -- 172.21.15.96:0/1292524076 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f82341a1350 con 0x7f82340feaa0 2023-05-08T03:41:06.996 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:06.994+0000 7f822b7fe700 1 -- 172.21.15.96:0/1292524076 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+22096 (secure 0 0 0) 0x7f822409acb0 con 0x7f82340feaa0 2023-05-08T03:41:06.997 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:41:06.997 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":82,"fsid":"f7ffcfb0-ed50-11ed-9b01-001a4aab830c","created":"2023-05-08T03:33:42.765680+0000","modified":"2023-05-08T03:40:50.211915+0000","last_up_change":"2023-05-08T03:40:07.550882+0000","last_in_change":"2023-05-08T03:39:49.027947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-08T03:36:47.800739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-05-08T03:40:47.229693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-05-08T03:40:48.359294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2ee801e1-8eec-496d-a9ac-fc566b38bbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":1816903726},{"type":"v1","addr":"172.21.15.96:6803","nonce":1816903726}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":1816903726},{"type":"v1","addr":"172.21.15.96:6805","nonce":1816903726}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":1816903726},{"type":"v1","addr":"172.21.15.96:6809","nonce":1816903726}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":1816903726},{"type":"v1","addr":"172.21.15.96:6807","nonce":1816903726}]},"public_addr":"172.21.15.96:6803/1816903726","cluster_addr":"172.21.15.96:6805/1816903726","heartbeat_back_addr":"172.21.15.96:6809/1816903726","heartbeat_front_addr":"172.21.15.96:6807/1816903726","state":["exists","up"]},{"osd":1,"uuid":"eb73deea-fc7c-4f2f-8aef-2d71c598afda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":206989126},{"type":"v1","addr":"172.21.15.133:6801","nonce":206989126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":206989126},{"type":"v1","addr":"172.21.15.133:6803","nonce":206989126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":206989126},{"type":"v1","addr":"172.21.15.133:6807","nonce":206989126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":206989126},{"type":"v1","addr":"172.21.15.133:6805","nonce":206989126}]},"public_addr":"172.21.15.133:6801/206989126","cluster_addr":"172.21.15.133:6803/206989126","heartbeat_back_addr":"172.21.15.133:6807/206989126","heartbeat_front_addr":"172.21.15.133:6805/206989126","state":["exists","up"]},{"osd":2,"uuid":"74a2f239-e82d-4d87-9458-5373b6cbbffd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":1791188143},{"type":"v1","addr":"172.21.15.186:6801","nonce":1791188143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":1791188143},{"type":"v1","addr":"172.21.15.186:6803","nonce":1791188143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":1791188143},{"type":"v1","addr":"172.21.15.186:6807","nonce":1791188143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":1791188143},{"type":"v1","addr":"172.21.15.186:6805","nonce":1791188143}]},"public_addr":"172.21.15.186:6801/1791188143","cluster_addr":"172.21.15.186:6803/1791188143","heartbeat_back_addr":"172.21.15.186:6807/1791188143","heartbeat_front_addr":"172.21.15.186:6805/1791188143","state":["exists","up"]},{"osd":3,"uuid":"421eedf5-ba6e-484e-b715-78c1c10d684e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":3430402140},{"type":"v1","addr":"172.21.15.96:6811","nonce":3430402140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":3430402140},{"type":"v1","addr":"172.21.15.96:6813","nonce":3430402140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":3430402140},{"type":"v1","addr":"172.21.15.96:6817","nonce":3430402140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":3430402140},{"type":"v1","addr":"172.21.15.96:6815","nonce":3430402140}]},"public_addr":"172.21.15.96:6811/3430402140","cluster_addr":"172.21.15.96:6813/3430402140","heartbeat_back_addr":"172.21.15.96:6817/3430402140","heartbeat_front_addr":"172.21.15.96:6815/3430402140","state":["exists","up"]},{"osd":4,"uuid":"fb20100b-6a5a-462d-955d-1697a3861e96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":1237495996},{"type":"v1","addr":"172.21.15.133:6809","nonce":1237495996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":1237495996},{"type":"v1","addr":"172.21.15.133:6811","nonce":1237495996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":1237495996},{"type":"v1","addr":"172.21.15.133:6815","nonce":1237495996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":1237495996},{"type":"v1","addr":"172.21.15.133:6813","nonce":1237495996}]},"public_addr":"172.21.15.133:6809/1237495996","cluster_addr":"172.21.15.133:6811/1237495996","heartbeat_back_addr":"172.21.15.133:6815/1237495996","heartbeat_front_addr":"172.21.15.133:6813/1237495996","state":["exists","up"]},{"osd":5,"uuid":"00177913-8bd6-4391-83c3-08c2b1b8ef13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":541111862},{"type":"v1","addr":"172.21.15.186:6809","nonce":541111862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":541111862},{"type":"v1","addr":"172.21.15.186:6811","nonce":541111862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":541111862},{"type":"v1","addr":"172.21.15.186:6815","nonce":541111862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":541111862},{"type":"v1","addr":"172.21.15.186:6813","nonce":541111862}]},"public_addr":"172.21.15.186:6809/541111862","cluster_addr":"172.21.15.186:6811/541111862","heartbeat_back_addr":"172.21.15.186:6815/541111862","heartbeat_front_addr":"172.21.15.186:6813/541111862","state":["exists","up"]},{"osd":6,"uuid":"204baab6-ca6f-4eef-8b9c-91efc04cc30c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":386227948},{"type":"v1","addr":"172.21.15.96:6819","nonce":386227948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":386227948},{"type":"v1","addr":"172.21.15.96:6821","nonce":386227948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":386227948},{"type":"v1","addr":"172.21.15.96:6825","nonce":386227948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":386227948},{"type":"v1","addr":"172.21.15.96:6823","nonce":386227948}]},"public_addr":"172.21.15.96:6819/386227948","cluster_addr":"172.21.15.96:6821/386227948","heartbeat_back_addr":"172.21.15.96:6825/386227948","heartbeat_front_addr":"172.21.15.96:6823/386227948","state":["exists","up"]},{"osd":7,"uuid":"282db569-a76e-485b-a33d-f2579b956525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":218507954},{"type":"v1","addr":"172.21.15.133:6817","nonce":218507954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":218507954},{"type":"v1","addr":"172.21.15.133:6819","nonce":218507954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":218507954},{"type":"v1","addr":"172.21.15.133:6823","nonce":218507954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":218507954},{"type":"v1","addr":"172.21.15.133:6821","nonce":218507954}]},"public_addr":"172.21.15.133:6817/218507954","cluster_addr":"172.21.15.133:6819/218507954","heartbeat_back_addr":"172.21.15.133:6823/218507954","heartbeat_front_addr":"172.21.15.133:6821/218507954","state":["exists","up"]},{"osd":8,"uuid":"693e25b5-355d-4990-9467-0fac4c9133fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":1648475902},{"type":"v1","addr":"172.21.15.186:6817","nonce":1648475902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":1648475902},{"type":"v1","addr":"172.21.15.186:6819","nonce":1648475902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":1648475902},{"type":"v1","addr":"172.21.15.186:6823","nonce":1648475902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":1648475902},{"type":"v1","addr":"172.21.15.186:6821","nonce":1648475902}]},"public_addr":"172.21.15.186:6817/1648475902","cluster_addr":"172.21.15.186:6819/1648475902","heartbeat_back_addr":"172.21.15.186:6823/1648475902","heartbeat_front_addr":"172.21.15.186:6821/1648475902","state":["exists","up"]},{"osd":9,"uuid":"72fbff09-fe28-4014-86fc-c31f95cd19a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":543223824},{"type":"v1","addr":"172.21.15.96:6827","nonce":543223824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":543223824},{"type":"v1","addr":"172.21.15.96:6829","nonce":543223824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6832","nonce":543223824},{"type":"v1","addr":"172.21.15.96:6833","nonce":543223824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":543223824},{"type":"v1","addr":"172.21.15.96:6831","nonce":543223824}]},"public_addr":"172.21.15.96:6827/543223824","cluster_addr":"172.21.15.96:6829/543223824","heartbeat_back_addr":"172.21.15.96:6833/543223824","heartbeat_front_addr":"172.21.15.96:6831/543223824","state":["exists","up"]},{"osd":10,"uuid":"6c2b6757-60c2-4962-9409-6051dcb13273","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":2323107912},{"type":"v1","addr":"172.21.15.133:6825","nonce":2323107912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":2323107912},{"type":"v1","addr":"172.21.15.133:6827","nonce":2323107912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":2323107912},{"type":"v1","addr":"172.21.15.133:6831","nonce":2323107912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":2323107912},{"type":"v1","addr":"172.21.15.133:6829","nonce":2323107912}]},"public_addr":"172.21.15.133:6825/2323107912","cluster_addr":"172.21.15.133:6827/2323107912","heartbeat_back_addr":"172.21.15.133:6831/2323107912","heartbeat_front_addr":"172.21.15.133:6829/2323107912","state":["exists","up"]},{"osd":11,"uuid":"03c0bb25-2921-446b-960e-6a7a328d36a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":3853499290},{"type":"v1","addr":"172.21.15.186:6825","nonce":3853499290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":3853499290},{"type":"v1","addr":"172.21.15.186:6827","nonce":3853499290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":3853499290},{"type":"v1","addr":"172.21.15.186:6831","nonce":3853499290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":3853499290},{"type":"v1","addr":"172.21.15.186:6829","nonce":3853499290}]},"public_addr":"172.21.15.186:6825/3853499290","cluster_addr":"172.21.15.186:6827/3853499290","heartbeat_back_addr":"172.21.15.186:6831/3853499290","heartbeat_front_addr":"172.21.15.186:6829/3853499290","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:36:02.087281+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:36:24.328783+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:36:46.135576+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:37:08.524145+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:37:30.883871+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:37:53.344554+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:38:15.448162+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:38:37.414878+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:38:59.533953+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:39:21.392102+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:39:43.462696+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:40:05.561808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.96:0/1333468881":"2023-05-09T03:34:37.472043+0000","172.21.15.96:6800/1979917756":"2023-05-09T03:34:37.472043+0000","172.21.15.96:0/1332045367":"2023-05-09T03:34:37.472043+0000","172.21.15.96:0/520278090":"2023-05-09T03:34:14.800324+0000","172.21.15.96:0/1055409415":"2023-05-09T03:34:37.472043+0000","172.21.15.96:6801/1979917756":"2023-05-09T03:34:37.472043+0000","172.21.15.96:0/1541933328":"2023-05-09T03:34:14.800324+0000","172.21.15.96:6800/3944122753":"2023-05-09T03:34:14.800324+0000","172.21.15.96:0/2986058319":"2023-05-09T03:34:14.800324+0000","172.21.15.96:6801/3944122753":"2023-05-09T03:34:14.800324+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-08T03:41:06.998 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:06.996+0000 7f823c43d700 1 -- 172.21.15.96:0/1292524076 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f82200a1260 msgr2=0x7f82200a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:06.999 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:06.996+0000 7f823c43d700 1 --2- 172.21.15.96:0/1292524076 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f82200a1260 0x7f82200a3710 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8230005f50 tx=0x7f8230005e80 comp rx=0 tx=0).stop 2023-05-08T03:41:06.999 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:06.996+0000 7f823c43d700 1 -- 172.21.15.96:0/1292524076 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82340feaa0 msgr2=0x7f8234194220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:06.999 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:06.996+0000 7f823c43d700 1 --2- 172.21.15.96:0/1292524076 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82340feaa0 0x7f8234194220 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8224007b50 tx=0x7f8224007f10 comp rx=0 tx=0).stop 2023-05-08T03:41:06.999 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:06.996+0000 7f823c43d700 1 -- 172.21.15.96:0/1292524076 shutdown_connections 2023-05-08T03:41:06.999 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:06.996+0000 7f823c43d700 1 --2- 172.21.15.96:0/1292524076 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f82200a1260 0x7f82200a3710 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:06.999 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:06.996+0000 7f823c43d700 1 --2- 172.21.15.96:0/1292524076 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8234104aa0 0x7f8234198bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:07.000 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:06.996+0000 7f823c43d700 1 --2- 172.21.15.96:0/1292524076 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82340feaa0 0x7f8234194220 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:07.000 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:06.996+0000 7f823c43d700 1 --2- 172.21.15.96:0/1292524076 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82340ff450 0x7f8234194760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:07.000 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:06.996+0000 7f823c43d700 1 -- 172.21.15.96:0/1292524076 >> 172.21.15.96:0/1292524076 conn(0x7f82340759a0 msgr2=0x7f8234105920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:07.000 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:06.996+0000 7f823c43d700 1 -- 172.21.15.96:0/1292524076 shutdown_connections 2023-05-08T03:41:07.000 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:06.996+0000 7f823c43d700 1 -- 172.21.15.96:0/1292524076 wait complete. 2023-05-08T03:41:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:06 smithi096 ceph-mon[124666]: pgmap v266: 97 pgs: 97 active+clean; 621 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 5.7 KiB/s wr, 13 op/s 2023-05-08T03:41:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:06 smithi186 ceph-mon[126480]: pgmap v266: 97 pgs: 97 active+clean; 621 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 5.7 KiB/s wr, 13 op/s 2023-05-08T03:41:07.361 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- ceph tell osd.0 flush_pg_stats 2023-05-08T03:41:07.362 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- ceph tell osd.1 flush_pg_stats 2023-05-08T03:41:07.362 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- ceph tell osd.2 flush_pg_stats 2023-05-08T03:41:07.363 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- ceph tell osd.3 flush_pg_stats 2023-05-08T03:41:07.363 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- ceph tell osd.4 flush_pg_stats 2023-05-08T03:41:07.364 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- ceph tell osd.5 flush_pg_stats 2023-05-08T03:41:07.364 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- ceph tell osd.6 flush_pg_stats 2023-05-08T03:41:07.365 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- ceph tell osd.7 flush_pg_stats 2023-05-08T03:41:07.365 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- ceph tell osd.8 flush_pg_stats 2023-05-08T03:41:07.366 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- ceph tell osd.9 flush_pg_stats 2023-05-08T03:41:07.366 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- ceph tell osd.10 flush_pg_stats 2023-05-08T03:41:07.367 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- ceph tell osd.11 flush_pg_stats 2023-05-08T03:41:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:07 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/1292524076' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-05-08T03:41:08.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:07 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/1292524076' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-05-08T03:41:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:07 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/1292524076' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-05-08T03:41:08.524 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.a/config 2023-05-08T03:41:08.625 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.a/config 2023-05-08T03:41:08.626 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.a/config 2023-05-08T03:41:08.940 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.a/config 2023-05-08T03:41:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:08 smithi133 ceph-mon[125939]: pgmap v267: 97 pgs: 97 active+clean; 631 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 6.1 KiB/s wr, 13 op/s 2023-05-08T03:41:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:08 smithi096 ceph-mon[124666]: pgmap v267: 97 pgs: 97 active+clean; 631 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 6.1 KiB/s wr, 13 op/s 2023-05-08T03:41:09.046 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.a/config 2023-05-08T03:41:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:08 smithi186 ceph-mon[126480]: pgmap v267: 97 pgs: 97 active+clean; 631 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 6.1 KiB/s wr, 13 op/s 2023-05-08T03:41:09.376 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.a/config 2023-05-08T03:41:09.549 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.a/config 2023-05-08T03:41:09.578 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.a/config 2023-05-08T03:41:09.606 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.a/config 2023-05-08T03:41:10.518 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.a/config 2023-05-08T03:41:10.793 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:10 smithi096 ceph-mon[124666]: pgmap v268: 97 pgs: 97 active+clean; 631 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2023-05-08T03:41:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:10 smithi133 ceph-mon[125939]: pgmap v268: 97 pgs: 97 active+clean; 631 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2023-05-08T03:41:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:10 smithi186 ceph-mon[126480]: pgmap v268: 97 pgs: 97 active+clean; 631 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2023-05-08T03:41:12.858 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:12 smithi096 ceph-mon[124666]: pgmap v269: 97 pgs: 97 active+clean; 631 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2023-05-08T03:41:12.901 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.a/config 2023-05-08T03:41:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:12 smithi133 ceph-mon[125939]: pgmap v269: 97 pgs: 97 active+clean; 631 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2023-05-08T03:41:13.103 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.a/config 2023-05-08T03:41:13.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:12 smithi186 ceph-mon[126480]: pgmap v269: 97 pgs: 97 active+clean; 631 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2023-05-08T03:41:13.359 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:13.356+0000 7f2de142b700 1 -- 172.21.15.96:0/3889860347 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ddc0feaa0 msgr2=0x7f2ddc0fef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:13.359 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:13.356+0000 7f2de142b700 1 --2- 172.21.15.96:0/3889860347 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ddc0feaa0 0x7f2ddc0fef10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc009990 tx=0x7f2dcc009ca0 comp rx=0 tx=0).stop 2023-05-08T03:41:13.359 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:13.356+0000 7f2de142b700 1 -- 172.21.15.96:0/3889860347 shutdown_connections 2023-05-08T03:41:13.359 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:13.356+0000 7f2de142b700 1 --2- 172.21.15.96:0/3889860347 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ddc0ff450 0x7f2ddc10b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:13.360 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:13.356+0000 7f2de142b700 1 --2- 172.21.15.96:0/3889860347 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2ddc104aa0 0x7f2ddc104e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:13.360 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:13.356+0000 7f2de142b700 1 --2- 172.21.15.96:0/3889860347 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ddc0feaa0 0x7f2ddc0fef10 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:13.360 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:13.356+0000 7f2de142b700 1 -- 172.21.15.96:0/3889860347 >> 172.21.15.96:0/3889860347 conn(0x7f2ddc0759a0 msgr2=0x7f2ddc075da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:13.360 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:13.356+0000 7f2de142b700 1 -- 172.21.15.96:0/3889860347 shutdown_connections 2023-05-08T03:41:13.360 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:13.356+0000 7f2de142b700 1 -- 172.21.15.96:0/3889860347 wait complete. 2023-05-08T03:41:13.360 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:13.356+0000 7f2de142b700 1 Processor -- start 2023-05-08T03:41:13.362 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:13.357+0000 7f2de142b700 1 -- start start 2023-05-08T03:41:13.362 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:13.357+0000 7f2de142b700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2ddc0feaa0 0x7f2ddc1953d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:13.362 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:13.357+0000 7f2de142b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ddc0ff450 0x7f2ddc195910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:13.362 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:13.357+0000 7f2de142b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ddc104aa0 0x7f2ddc199d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:13.362 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:13.357+0000 7f2de142b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ddc19a390 con 0x7f2ddc104aa0 2023-05-08T03:41:13.363 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:13.357+0000 7f2de142b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ddc19a500 con 0x7f2ddc0ff450 2023-05-08T03:41:13.363 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:13.357+0000 7f2de142b700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ddc19a6c0 con 0x7f2ddc0feaa0 2023-05-08T03:41:13.363 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:13.357+0000 7f2ddb7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ddc104aa0 0x7f2ddc199d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:13.363 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:13.357+0000 7f2ddb7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ddc104aa0 0x7f2ddc199d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40696/0 (socket says 172.21.15.96:40696) 2023-05-08T03:41:13.363 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:13.357+0000 7f2ddb7fe700 1 -- 172.21.15.96:0/1120562959 learned_addr learned my addr 172.21.15.96:0/1120562959 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:41:13.363 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:13.357+0000 7f2dda7fc700 1 --2- 172.21.15.96:0/1120562959 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ddc0ff450 0x7f2ddc195910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:13.364 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:13.357+0000 7f2ddaffd700 1 --2- 172.21.15.96:0/1120562959 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2ddc0feaa0 0x7f2ddc1953d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:13.364 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:13.357+0000 7f2ddb7fe700 1 -- 172.21.15.96:0/1120562959 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2ddc0feaa0 msgr2=0x7f2ddc1953d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:13.364 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:13.357+0000 7f2ddb7fe700 1 --2- 172.21.15.96:0/1120562959 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2ddc0feaa0 0x7f2ddc1953d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:13.364 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:13.357+0000 7f2ddb7fe700 1 -- 172.21.15.96:0/1120562959 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ddc0ff450 msgr2=0x7f2ddc195910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:13.364 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:13.357+0000 7f2ddb7fe700 1 --2- 172.21.15.96:0/1120562959 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ddc0ff450 0x7f2ddc195910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:13.364 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:13.357+0000 7f2ddb7fe700 1 -- 172.21.15.96:0/1120562959 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dcc0095f0 con 0x7f2ddc104aa0 2023-05-08T03:41:13.364 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:13.357+0000 7f2dda7fc700 1 --2- 172.21.15.96:0/1120562959 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ddc0ff450 0x7f2ddc195910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-08T03:41:13.365 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:13.357+0000 7f2ddb7fe700 1 --2- 172.21.15.96:0/1120562959 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ddc104aa0 0x7f2ddc199d80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2dd4007ee0 tx=0x7f2dd400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:13.365 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:13.358+0000 7f2dc3fff700 1 -- 172.21.15.96:0/1120562959 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd4017070 con 0x7f2ddc104aa0 2023-05-08T03:41:13.365 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:13.358+0000 7f2de142b700 1 -- 172.21.15.96:0/1120562959 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ddc10eb80 con 0x7f2ddc104aa0 2023-05-08T03:41:13.365 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:13.358+0000 7f2dc3fff700 1 -- 172.21.15.96:0/1120562959 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2dd400f040 con 0x7f2ddc104aa0 2023-05-08T03:41:13.366 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:13.358+0000 7f2dc3fff700 1 -- 172.21.15.96:0/1120562959 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd4005740 con 0x7f2ddc104aa0 2023-05-08T03:41:13.366 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:13.358+0000 7f2de142b700 1 -- 172.21.15.96:0/1120562959 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ddc10e9f0 con 0x7f2ddc104aa0 2023-05-08T03:41:13.366 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:13.359+0000 7f2de142b700 1 -- 172.21.15.96:0/1120562959 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2dc8000ff0 con 0x7f2ddc104aa0 2023-05-08T03:41:13.367 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:13.360+0000 7f2dc3fff700 1 -- 172.21.15.96:0/1120562959 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f2dd40058a0 con 0x7f2ddc104aa0 2023-05-08T03:41:13.367 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:13.361+0000 7f2dc3fff700 1 --2- 172.21.15.96:0/1120562959 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f2dc40a11e0 0x7f2dc40a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:13.367 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:13.361+0000 7f2ddaffd700 1 --2- 172.21.15.96:0/1120562959 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f2dc40a11e0 0x7f2dc40a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:13.367 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:13.361+0000 7f2dc3fff700 1 -- 172.21.15.96:0/1120562959 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f2dd40ccb10 con 0x7f2ddc104aa0 2023-05-08T03:41:13.368 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:13.361+0000 7f2dc3fff700 1 --2- 172.21.15.96:0/1120562959 >> [v2:172.21.15.96:6802/1816903726,v1:172.21.15.96:6803/1816903726] conn(0x7f2dc40aa9b0 0x7f2dc40acdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:13.368 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:13.361+0000 7f2dc3fff700 1 -- 172.21.15.96:0/1120562959 --> [v2:172.21.15.96:6802/1816903726,v1:172.21.15.96:6803/1816903726] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2dc40ad470 con 0x7f2dc40aa9b0 2023-05-08T03:41:13.368 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:13.361+0000 7f2dc3fff700 1 -- 172.21.15.96:0/1120562959 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2dd40ccfb0 con 0x7f2ddc104aa0 2023-05-08T03:41:13.368 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:13.361+0000 7f2dda7fc700 1 --2- 172.21.15.96:0/1120562959 >> [v2:172.21.15.96:6802/1816903726,v1:172.21.15.96:6803/1816903726] conn(0x7f2dc40aa9b0 0x7f2dc40acdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:13.368 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:13.361+0000 7f2ddaffd700 1 --2- 172.21.15.96:0/1120562959 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f2dc40a11e0 0x7f2dc40a3690 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2dd0005fd0 tx=0x7f2dd000a4c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:13.368 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:13.361+0000 7f2dda7fc700 1 --2- 172.21.15.96:0/1120562959 >> [v2:172.21.15.96:6802/1816903726,v1:172.21.15.96:6803/1816903726] conn(0x7f2dc40aa9b0 0x7f2dc40acdc0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:13.368 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:13.362+0000 7f2dc3fff700 1 -- 172.21.15.96:0/1120562959 <== osd.0 v2:172.21.15.96:6802/1816903726 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f2dc40ad470 con 0x7f2dc40aa9b0 2023-05-08T03:41:13.381 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:13.378+0000 7f2de142b700 1 -- 172.21.15.96:0/1120562959 --> [v2:172.21.15.96:6802/1816903726,v1:172.21.15.96:6803/1816903726] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2dc8002d70 con 0x7f2dc40aa9b0 2023-05-08T03:41:13.381 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:13.379+0000 7f2dc3fff700 1 -- 172.21.15.96:0/1120562959 <== osd.0 v2:172.21.15.96:6802/1816903726 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2dc8002d70 con 0x7f2dc40aa9b0 2023-05-08T03:41:13.383 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:13.379+0000 7f2de142b700 1 -- 172.21.15.96:0/1120562959 >> [v2:172.21.15.96:6802/1816903726,v1:172.21.15.96:6803/1816903726] conn(0x7f2dc40aa9b0 msgr2=0x7f2dc40acdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:13.383 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:13.379+0000 7f2de142b700 1 --2- 172.21.15.96:0/1120562959 >> [v2:172.21.15.96:6802/1816903726,v1:172.21.15.96:6803/1816903726] conn(0x7f2dc40aa9b0 0x7f2dc40acdc0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:13.383 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:13.379+0000 7f2de142b700 1 -- 172.21.15.96:0/1120562959 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f2dc40a11e0 msgr2=0x7f2dc40a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:13.383 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:13.379+0000 7f2de142b700 1 --2- 172.21.15.96:0/1120562959 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f2dc40a11e0 0x7f2dc40a3690 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2dd0005fd0 tx=0x7f2dd000a4c0 comp rx=0 tx=0).stop 2023-05-08T03:41:13.383 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:13.379+0000 7f2de142b700 1 -- 172.21.15.96:0/1120562959 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ddc104aa0 msgr2=0x7f2ddc199d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:13.383 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:13.379+0000 7f2de142b700 1 --2- 172.21.15.96:0/1120562959 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ddc104aa0 0x7f2ddc199d80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2dd4007ee0 tx=0x7f2dd400d3b0 comp rx=0 tx=0).stop 2023-05-08T03:41:13.383 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:13.379+0000 7f2ddb7fe700 1 -- 172.21.15.96:0/1120562959 reap_dead start 2023-05-08T03:41:13.384 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:13.379+0000 7f2de142b700 1 -- 172.21.15.96:0/1120562959 shutdown_connections 2023-05-08T03:41:13.384 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:13.379+0000 7f2de142b700 1 -- 172.21.15.96:0/1120562959 >> 172.21.15.96:0/1120562959 conn(0x7f2ddc0759a0 msgr2=0x7f2ddc102e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:13.384 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:13.380+0000 7f2de142b700 1 -- 172.21.15.96:0/1120562959 shutdown_connections 2023-05-08T03:41:13.384 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:13.380+0000 7f2de142b700 1 -- 172.21.15.96:0/1120562959 wait complete. 2023-05-08T03:41:14.593 INFO:teuthology.orchestra.run.smithi096.stdout:34359738433 2023-05-08T03:41:14.593 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- ceph osd last-stat-seq osd.0 2023-05-08T03:41:14.603 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.157+0000 7fa4aa965700 1 -- 172.21.15.96:0/4031251175 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4a41056e0 msgr2=0x7fa4a410d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:14.603 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.157+0000 7fa4aa965700 1 --2- 172.21.15.96:0/4031251175 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4a41056e0 0x7fa4a410d260 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa49c00b0d0 tx=0x7fa49c00b3e0 comp rx=0 tx=0).stop 2023-05-08T03:41:14.604 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.157+0000 7fa4aa965700 1 -- 172.21.15.96:0/4031251175 shutdown_connections 2023-05-08T03:41:14.604 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.157+0000 7fa4aa965700 1 --2- 172.21.15.96:0/4031251175 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4a41056e0 0x7fa4a410d260 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:14.604 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.157+0000 7fa4aa965700 1 --2- 172.21.15.96:0/4031251175 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4a4100640 0x7fa4a4100a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:14.604 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.157+0000 7fa4aa965700 1 --2- 172.21.15.96:0/4031251175 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa4a4100fe0 0x7fa4a4104fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:14.604 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.157+0000 7fa4aa965700 1 -- 172.21.15.96:0/4031251175 >> 172.21.15.96:0/4031251175 conn(0x7fa4a40fbec0 msgr2=0x7fa4a40fe2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:14.604 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.157+0000 7fa4aa965700 1 -- 172.21.15.96:0/4031251175 shutdown_connections 2023-05-08T03:41:14.604 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.157+0000 7fa4aa965700 1 -- 172.21.15.96:0/4031251175 wait complete. 2023-05-08T03:41:14.605 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.158+0000 7fa4aa965700 1 Processor -- start 2023-05-08T03:41:14.605 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.158+0000 7fa4aa965700 1 -- start start 2023-05-08T03:41:14.605 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.158+0000 7fa4aa965700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4a4100640 0x7fa4a41965e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:14.605 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.158+0000 7fa4aa965700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4a4100fe0 0x7fa4a4196b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:14.605 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.158+0000 7fa4aa965700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa4a41056e0 0x7fa4a419af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:14.605 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.158+0000 7fa4aa965700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a419b5a0 con 0x7fa4a4100fe0 2023-05-08T03:41:14.605 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.158+0000 7fa4aa965700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a419b710 con 0x7fa4a4100640 2023-05-08T03:41:14.606 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.158+0000 7fa4aa965700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a419b8d0 con 0x7fa4a41056e0 2023-05-08T03:41:14.606 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.159+0000 7fa4a37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4a4100fe0 0x7fa4a4196b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:14.606 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.159+0000 7fa4a37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4a4100fe0 0x7fa4a4196b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40710/0 (socket says 172.21.15.96:40710) 2023-05-08T03:41:14.606 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.159+0000 7fa4a37fe700 1 -- 172.21.15.96:0/3534208384 learned_addr learned my addr 172.21.15.96:0/3534208384 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:41:14.606 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.159+0000 7fa4a3fff700 1 --2- 172.21.15.96:0/3534208384 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4a4100640 0x7fa4a41965e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:14.606 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.159+0000 7fa4a8f02700 1 --2- 172.21.15.96:0/3534208384 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa4a41056e0 0x7fa4a419af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:14.606 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.159+0000 7fa4a37fe700 1 -- 172.21.15.96:0/3534208384 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa4a41056e0 msgr2=0x7fa4a419af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:14.606 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.159+0000 7fa4a37fe700 1 --2- 172.21.15.96:0/3534208384 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa4a41056e0 0x7fa4a419af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:14.607 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.159+0000 7fa4a37fe700 1 -- 172.21.15.96:0/3534208384 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4a4100640 msgr2=0x7fa4a41965e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:14.607 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.159+0000 7fa4a37fe700 1 --2- 172.21.15.96:0/3534208384 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4a4100640 0x7fa4a41965e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:14.607 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.159+0000 7fa4a37fe700 1 -- 172.21.15.96:0/3534208384 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa49c009d00 con 0x7fa4a4100fe0 2023-05-08T03:41:14.607 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.159+0000 7fa4a8f02700 1 --2- 172.21.15.96:0/3534208384 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa4a41056e0 0x7fa4a419af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-08T03:41:14.607 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.159+0000 7fa4a37fe700 1 --2- 172.21.15.96:0/3534208384 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4a4100fe0 0x7fa4a4196b20 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa49800b500 tx=0x7fa49800b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:14.607 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.159+0000 7fa4a17fa700 1 -- 172.21.15.96:0/3534208384 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa498011830 con 0x7fa4a4100fe0 2023-05-08T03:41:14.607 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.159+0000 7fa4a17fa700 1 -- 172.21.15.96:0/3534208384 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa498011e50 con 0x7fa4a4100fe0 2023-05-08T03:41:14.607 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.159+0000 7fa4aa965700 1 -- 172.21.15.96:0/3534208384 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4a41104b0 con 0x7fa4a4100fe0 2023-05-08T03:41:14.608 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.159+0000 7fa4a17fa700 1 -- 172.21.15.96:0/3534208384 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa49800f2e0 con 0x7fa4a4100fe0 2023-05-08T03:41:14.608 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.159+0000 7fa4aa965700 1 -- 172.21.15.96:0/3534208384 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4a4110320 con 0x7fa4a4100fe0 2023-05-08T03:41:14.608 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.160+0000 7fa4aa965700 1 -- 172.21.15.96:0/3534208384 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa4a40fd2b0 con 0x7fa4a4100fe0 2023-05-08T03:41:14.608 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.161+0000 7fa4a17fa700 1 -- 172.21.15.96:0/3534208384 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fa4980105a0 con 0x7fa4a4100fe0 2023-05-08T03:41:14.608 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.162+0000 7fa4a17fa700 1 --2- 172.21.15.96:0/3534208384 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fa48c0a1260 0x7fa48c0a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:14.608 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.162+0000 7fa4a3fff700 1 --2- 172.21.15.96:0/3534208384 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fa48c0a1260 0x7fa48c0a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:14.609 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.162+0000 7fa4a17fa700 1 -- 172.21.15.96:0/3534208384 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fa4980cc7c0 con 0x7fa4a4100fe0 2023-05-08T03:41:14.609 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.162+0000 7fa4a17fa700 1 --2- 172.21.15.96:0/3534208384 >> [v2:172.21.15.96:6810/3430402140,v1:172.21.15.96:6811/3430402140] conn(0x7fa48c0aaa30 0x7fa48c0ace40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:14.609 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.162+0000 7fa4a17fa700 1 -- 172.21.15.96:0/3534208384 --> [v2:172.21.15.96:6810/3430402140,v1:172.21.15.96:6811/3430402140] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa48c0ad4f0 con 0x7fa48c0aaa30 2023-05-08T03:41:14.609 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.162+0000 7fa4a17fa700 1 -- 172.21.15.96:0/3534208384 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa4980ccc60 con 0x7fa4a4100fe0 2023-05-08T03:41:14.610 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.162+0000 7fa4a8f02700 1 --2- 172.21.15.96:0/3534208384 >> [v2:172.21.15.96:6810/3430402140,v1:172.21.15.96:6811/3430402140] conn(0x7fa48c0aaa30 0x7fa48c0ace40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:14.610 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.162+0000 7fa4a3fff700 1 --2- 172.21.15.96:0/3534208384 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fa48c0a1260 0x7fa48c0a3710 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa494005950 tx=0x7fa49400a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:14.610 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.162+0000 7fa4a8f02700 1 --2- 172.21.15.96:0/3534208384 >> [v2:172.21.15.96:6810/3430402140,v1:172.21.15.96:6811/3430402140] conn(0x7fa48c0aaa30 0x7fa48c0ace40 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:14.610 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.163+0000 7fa4a17fa700 1 -- 172.21.15.96:0/3534208384 <== osd.3 v2:172.21.15.96:6810/3430402140 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fa48c0ad4f0 con 0x7fa48c0aaa30 2023-05-08T03:41:14.610 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.178+0000 7fa4aa965700 1 -- 172.21.15.96:0/3534208384 --> [v2:172.21.15.96:6810/3430402140,v1:172.21.15.96:6811/3430402140] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa4a4110640 con 0x7fa48c0aaa30 2023-05-08T03:41:14.610 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.179+0000 7fa4a17fa700 1 -- 172.21.15.96:0/3534208384 <== osd.3 v2:172.21.15.96:6810/3430402140 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fa4a4110640 con 0x7fa48c0aaa30 2023-05-08T03:41:14.610 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.179+0000 7fa4aa965700 1 -- 172.21.15.96:0/3534208384 >> [v2:172.21.15.96:6810/3430402140,v1:172.21.15.96:6811/3430402140] conn(0x7fa48c0aaa30 msgr2=0x7fa48c0ace40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:14.610 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.179+0000 7fa4aa965700 1 --2- 172.21.15.96:0/3534208384 >> [v2:172.21.15.96:6810/3430402140,v1:172.21.15.96:6811/3430402140] conn(0x7fa48c0aaa30 0x7fa48c0ace40 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:14.611 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.179+0000 7fa4aa965700 1 -- 172.21.15.96:0/3534208384 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fa48c0a1260 msgr2=0x7fa48c0a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:14.611 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.179+0000 7fa4aa965700 1 --2- 172.21.15.96:0/3534208384 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fa48c0a1260 0x7fa48c0a3710 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa494005950 tx=0x7fa49400a300 comp rx=0 tx=0).stop 2023-05-08T03:41:14.611 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.179+0000 7fa4aa965700 1 -- 172.21.15.96:0/3534208384 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4a4100fe0 msgr2=0x7fa4a4196b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:14.611 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.179+0000 7fa4aa965700 1 --2- 172.21.15.96:0/3534208384 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4a4100fe0 0x7fa4a4196b20 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa49800b500 tx=0x7fa49800b810 comp rx=0 tx=0).stop 2023-05-08T03:41:14.611 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.179+0000 7fa4a8f02700 1 -- 172.21.15.96:0/3534208384 reap_dead start 2023-05-08T03:41:14.611 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.179+0000 7fa4aa965700 1 -- 172.21.15.96:0/3534208384 shutdown_connections 2023-05-08T03:41:14.611 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.179+0000 7fa4aa965700 1 -- 172.21.15.96:0/3534208384 >> 172.21.15.96:0/3534208384 conn(0x7fa4a40fbec0 msgr2=0x7fa4a40fc860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:14.612 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.179+0000 7fa4aa965700 1 -- 172.21.15.96:0/3534208384 shutdown_connections 2023-05-08T03:41:14.612 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.179+0000 7fa4aa965700 1 -- 172.21.15.96:0/3534208384 wait complete. 2023-05-08T03:41:14.748 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:14 smithi096 ceph-mon[124666]: pgmap v270: 97 pgs: 97 active+clean; 631 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2023-05-08T03:41:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:14 smithi133 ceph-mon[125939]: pgmap v270: 97 pgs: 97 active+clean; 631 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2023-05-08T03:41:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:14 smithi186 ceph-mon[126480]: pgmap v270: 97 pgs: 97 active+clean; 631 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2023-05-08T03:41:15.210 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.140+0000 7f2eddb00700 1 -- 172.21.15.96:0/1486873877 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ed80fff00 msgr2=0x7f2ed8103ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:15.210 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.140+0000 7f2eddb00700 1 --2- 172.21.15.96:0/1486873877 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ed80fff00 0x7f2ed8103ed0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc0099c0 tx=0x7f2ecc009cd0 comp rx=0 tx=0).stop 2023-05-08T03:41:15.211 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.141+0000 7f2eddb00700 1 -- 172.21.15.96:0/1486873877 shutdown_connections 2023-05-08T03:41:15.211 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.141+0000 7f2eddb00700 1 --2- 172.21.15.96:0/1486873877 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2ed8104600 0x7f2ed810c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:15.211 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.141+0000 7f2eddb00700 1 --2- 172.21.15.96:0/1486873877 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ed80ff560 0x7f2ed80ff930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:15.211 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.141+0000 7f2eddb00700 1 --2- 172.21.15.96:0/1486873877 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ed80fff00 0x7f2ed8103ed0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:15.212 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.141+0000 7f2eddb00700 1 -- 172.21.15.96:0/1486873877 >> 172.21.15.96:0/1486873877 conn(0x7f2ed80771a0 msgr2=0x7f2ed80775a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:15.212 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.141+0000 7f2eddb00700 1 -- 172.21.15.96:0/1486873877 shutdown_connections 2023-05-08T03:41:15.212 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.141+0000 7f2eddb00700 1 -- 172.21.15.96:0/1486873877 wait complete. 2023-05-08T03:41:15.213 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.141+0000 7f2eddb00700 1 Processor -- start 2023-05-08T03:41:15.213 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.142+0000 7f2eddb00700 1 -- start start 2023-05-08T03:41:15.213 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.142+0000 7f2eddb00700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ed80ff560 0x7f2ed8197360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:15.213 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.142+0000 7f2eddb00700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ed80fff00 0x7f2ed81978a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:15.214 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.142+0000 7f2eddb00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2ed8104600 0x7f2ed81a23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:15.214 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.142+0000 7f2eddb00700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed81981e0 con 0x7f2ed80fff00 2023-05-08T03:41:15.214 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.142+0000 7f2eddb00700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed81a2920 con 0x7f2ed80ff560 2023-05-08T03:41:15.214 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.142+0000 7f2eddb00700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed81a2ae0 con 0x7f2ed8104600 2023-05-08T03:41:15.215 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.142+0000 7f2ed6ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ed80fff00 0x7f2ed81978a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:15.215 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.142+0000 7f2ed6ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ed80fff00 0x7f2ed81978a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40742/0 (socket says 172.21.15.96:40742) 2023-05-08T03:41:15.215 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.142+0000 7f2ed6ffd700 1 -- 172.21.15.96:0/3506858132 learned_addr learned my addr 172.21.15.96:0/3506858132 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:41:15.215 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.142+0000 7f2ed77fe700 1 --2- 172.21.15.96:0/3506858132 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ed80ff560 0x7f2ed8197360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:15.216 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.142+0000 7f2ed7fff700 1 --2- 172.21.15.96:0/3506858132 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2ed8104600 0x7f2ed81a23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:15.216 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.142+0000 7f2ed6ffd700 1 -- 172.21.15.96:0/3506858132 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2ed8104600 msgr2=0x7f2ed81a23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:15.216 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.142+0000 7f2ed6ffd700 1 --2- 172.21.15.96:0/3506858132 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2ed8104600 0x7f2ed81a23e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:15.216 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.142+0000 7f2ed6ffd700 1 -- 172.21.15.96:0/3506858132 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ed80ff560 msgr2=0x7f2ed8197360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:15.217 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.142+0000 7f2ed6ffd700 1 --2- 172.21.15.96:0/3506858132 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ed80ff560 0x7f2ed8197360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:15.217 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.142+0000 7f2ed6ffd700 1 -- 172.21.15.96:0/3506858132 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ecc0095f0 con 0x7f2ed80fff00 2023-05-08T03:41:15.217 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.142+0000 7f2ed77fe700 1 --2- 172.21.15.96:0/3506858132 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ed80ff560 0x7f2ed8197360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-08T03:41:15.217 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.142+0000 7f2ed6ffd700 1 --2- 172.21.15.96:0/3506858132 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ed80fff00 0x7f2ed81978a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc009990 tx=0x7f2ecc00f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:15.218 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.142+0000 7f2ed4ff9700 1 -- 172.21.15.96:0/3506858132 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ecc01d070 con 0x7f2ed80fff00 2023-05-08T03:41:15.218 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.143+0000 7f2eddb00700 1 -- 172.21.15.96:0/3506858132 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ed810f380 con 0x7f2ed80fff00 2023-05-08T03:41:15.218 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.143+0000 7f2ed4ff9700 1 -- 172.21.15.96:0/3506858132 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2ecc0054f0 con 0x7f2ed80fff00 2023-05-08T03:41:15.218 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.143+0000 7f2ed4ff9700 1 -- 172.21.15.96:0/3506858132 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ecc004bb0 con 0x7f2ed80fff00 2023-05-08T03:41:15.219 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.143+0000 7f2eddb00700 1 -- 172.21.15.96:0/3506858132 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ed810f1f0 con 0x7f2ed80fff00 2023-05-08T03:41:15.219 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.143+0000 7f2eddb00700 1 -- 172.21.15.96:0/3506858132 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2ed80fd840 con 0x7f2ed80fff00 2023-05-08T03:41:15.219 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.145+0000 7f2ed4ff9700 1 -- 172.21.15.96:0/3506858132 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f2ecc004d30 con 0x7f2ed80fff00 2023-05-08T03:41:15.219 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.145+0000 7f2ed4ff9700 1 --2- 172.21.15.96:0/3506858132 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f2ec00a11e0 0x7f2ec00a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:15.220 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.146+0000 7f2ed4ff9700 1 -- 172.21.15.96:0/3506858132 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f2ecc0ce120 con 0x7f2ed80fff00 2023-05-08T03:41:15.221 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.146+0000 7f2ed77fe700 1 --2- 172.21.15.96:0/3506858132 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f2ec00a11e0 0x7f2ec00a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:15.221 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.146+0000 7f2ed4ff9700 1 --2- 172.21.15.96:0/3506858132 >> [v2:172.21.15.133:6824/2323107912,v1:172.21.15.133:6825/2323107912] conn(0x7f2ec00aa9b0 0x7f2ec00acdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:15.221 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.146+0000 7f2ed4ff9700 1 -- 172.21.15.96:0/3506858132 --> [v2:172.21.15.133:6824/2323107912,v1:172.21.15.133:6825/2323107912] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2ec00ad470 con 0x7f2ec00aa9b0 2023-05-08T03:41:15.222 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.146+0000 7f2ed4ff9700 1 -- 172.21.15.96:0/3506858132 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2ecc0ce5c0 con 0x7f2ed80fff00 2023-05-08T03:41:15.222 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.146+0000 7f2ed77fe700 1 --2- 172.21.15.96:0/3506858132 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f2ec00a11e0 0x7f2ec00a3690 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2ec8009cb0 tx=0x7f2ec8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:15.222 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.146+0000 7f2ed7fff700 1 --2- 172.21.15.96:0/3506858132 >> [v2:172.21.15.133:6824/2323107912,v1:172.21.15.133:6825/2323107912] conn(0x7f2ec00aa9b0 0x7f2ec00acdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:15.222 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.146+0000 7f2ed7fff700 1 --2- 172.21.15.96:0/3506858132 >> [v2:172.21.15.133:6824/2323107912,v1:172.21.15.133:6825/2323107912] conn(0x7f2ec00aa9b0 0x7f2ec00acdc0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:15.223 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.147+0000 7f2ed4ff9700 1 -- 172.21.15.96:0/3506858132 <== osd.10 v2:172.21.15.133:6824/2323107912 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f2ec00ad470 con 0x7f2ec00aa9b0 2023-05-08T03:41:15.223 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.163+0000 7f2eddb00700 1 -- 172.21.15.96:0/3506858132 --> [v2:172.21.15.133:6824/2323107912,v1:172.21.15.133:6825/2323107912] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2ed810f510 con 0x7f2ec00aa9b0 2023-05-08T03:41:15.223 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.164+0000 7f2ed4ff9700 1 -- 172.21.15.96:0/3506858132 <== osd.10 v2:172.21.15.133:6824/2323107912 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f2ed810f510 con 0x7f2ec00aa9b0 2023-05-08T03:41:15.223 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.164+0000 7f2eddb00700 1 -- 172.21.15.96:0/3506858132 >> [v2:172.21.15.133:6824/2323107912,v1:172.21.15.133:6825/2323107912] conn(0x7f2ec00aa9b0 msgr2=0x7f2ec00acdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:15.224 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.164+0000 7f2eddb00700 1 --2- 172.21.15.96:0/3506858132 >> [v2:172.21.15.133:6824/2323107912,v1:172.21.15.133:6825/2323107912] conn(0x7f2ec00aa9b0 0x7f2ec00acdc0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:15.224 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.165+0000 7f2eddb00700 1 -- 172.21.15.96:0/3506858132 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f2ec00a11e0 msgr2=0x7f2ec00a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:15.224 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.165+0000 7f2eddb00700 1 --2- 172.21.15.96:0/3506858132 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f2ec00a11e0 0x7f2ec00a3690 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2ec8009cb0 tx=0x7f2ec8009260 comp rx=0 tx=0).stop 2023-05-08T03:41:15.225 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.165+0000 7f2eddb00700 1 -- 172.21.15.96:0/3506858132 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ed80fff00 msgr2=0x7f2ed81978a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:15.225 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.165+0000 7f2eddb00700 1 --2- 172.21.15.96:0/3506858132 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ed80fff00 0x7f2ed81978a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc009990 tx=0x7f2ecc00f740 comp rx=0 tx=0).stop 2023-05-08T03:41:15.226 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.165+0000 7f2ed7fff700 1 -- 172.21.15.96:0/3506858132 reap_dead start 2023-05-08T03:41:15.226 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.165+0000 7f2eddb00700 1 -- 172.21.15.96:0/3506858132 shutdown_connections 2023-05-08T03:41:15.226 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.165+0000 7f2eddb00700 1 -- 172.21.15.96:0/3506858132 >> 172.21.15.96:0/3506858132 conn(0x7f2ed80771a0 msgr2=0x7f2ed80fce30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:15.226 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.165+0000 7f2eddb00700 1 -- 172.21.15.96:0/3506858132 shutdown_connections 2023-05-08T03:41:15.227 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.165+0000 7f2eddb00700 1 -- 172.21.15.96:0/3506858132 wait complete. 2023-05-08T03:41:15.230 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.217+0000 7ff29ca6c700 1 -- 172.21.15.96:0/1398457639 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff298105390 msgr2=0x7ff298105760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:15.230 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.217+0000 7ff29ca6c700 1 --2- 172.21.15.96:0/1398457639 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff298105390 0x7ff298105760 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff288009990 tx=0x7ff288009ca0 comp rx=0 tx=0).stop 2023-05-08T03:41:15.230 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.218+0000 7ff29ca6c700 1 -- 172.21.15.96:0/1398457639 shutdown_connections 2023-05-08T03:41:15.231 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.218+0000 7ff29ca6c700 1 --2- 172.21.15.96:0/1398457639 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2980ff2e0 0x7ff29810d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:15.231 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.218+0000 7ff29ca6c700 1 --2- 172.21.15.96:0/1398457639 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff298105390 0x7ff298105760 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:15.231 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.218+0000 7ff29ca6c700 1 --2- 172.21.15.96:0/1398457639 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff2980fe930 0x7ff2980feda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:15.231 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.218+0000 7ff29ca6c700 1 -- 172.21.15.96:0/1398457639 >> 172.21.15.96:0/1398457639 conn(0x7ff2980759a0 msgr2=0x7ff298075da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:15.231 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.218+0000 7ff29ca6c700 1 -- 172.21.15.96:0/1398457639 shutdown_connections 2023-05-08T03:41:15.231 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.218+0000 7ff29ca6c700 1 -- 172.21.15.96:0/1398457639 wait complete. 2023-05-08T03:41:15.231 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.219+0000 7ff29ca6c700 1 Processor -- start 2023-05-08T03:41:15.232 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.219+0000 7ff29ca6c700 1 -- start start 2023-05-08T03:41:15.232 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.219+0000 7ff29ca6c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2980fe930 0x7ff298196540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:15.232 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.219+0000 7ff29ca6c700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff2980ff2e0 0x7ff298196a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:15.232 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.219+0000 7ff29ca6c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff298105390 0x7ff29819aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:15.232 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.219+0000 7ff29ca6c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff29819b500 con 0x7ff2980fe930 2023-05-08T03:41:15.232 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.219+0000 7ff29ca6c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff29819b670 con 0x7ff298105390 2023-05-08T03:41:15.232 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.219+0000 7ff29ca6c700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff29819b830 con 0x7ff2980ff2e0 2023-05-08T03:41:15.233 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.219+0000 7ff29659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2980fe930 0x7ff298196540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:15.233 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.219+0000 7ff29659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2980fe930 0x7ff298196540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40754/0 (socket says 172.21.15.96:40754) 2023-05-08T03:41:15.233 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.219+0000 7ff29659c700 1 -- 172.21.15.96:0/2966726800 learned_addr learned my addr 172.21.15.96:0/2966726800 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:41:15.233 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.219+0000 7ff295d9b700 1 --2- 172.21.15.96:0/2966726800 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff2980ff2e0 0x7ff298196a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:15.233 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.220+0000 7ff296d9d700 1 --2- 172.21.15.96:0/2966726800 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff298105390 0x7ff29819aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:15.233 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.220+0000 7ff29659c700 1 -- 172.21.15.96:0/2966726800 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff2980ff2e0 msgr2=0x7ff298196a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:15.233 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.220+0000 7ff29659c700 1 --2- 172.21.15.96:0/2966726800 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff2980ff2e0 0x7ff298196a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:15.233 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.220+0000 7ff29659c700 1 -- 172.21.15.96:0/2966726800 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff298105390 msgr2=0x7ff29819aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:15.234 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.220+0000 7ff29659c700 1 --2- 172.21.15.96:0/2966726800 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff298105390 0x7ff29819aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:15.234 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.220+0000 7ff29659c700 1 -- 172.21.15.96:0/2966726800 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2880095f0 con 0x7ff2980fe930 2023-05-08T03:41:15.234 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.220+0000 7ff29659c700 1 --2- 172.21.15.96:0/2966726800 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2980fe930 0x7ff298196540 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff2880095c0 tx=0x7ff28800f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:15.234 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.220+0000 7ff2877fe700 1 -- 172.21.15.96:0/2966726800 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff28801d070 con 0x7ff2980fe930 2023-05-08T03:41:15.234 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.220+0000 7ff29ca6c700 1 -- 172.21.15.96:0/2966726800 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff298110510 con 0x7ff2980fe930 2023-05-08T03:41:15.234 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.220+0000 7ff2877fe700 1 -- 172.21.15.96:0/2966726800 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff28800fb50 con 0x7ff2980fe930 2023-05-08T03:41:15.234 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.220+0000 7ff2877fe700 1 -- 172.21.15.96:0/2966726800 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2880173f0 con 0x7ff2980fe930 2023-05-08T03:41:15.234 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.221+0000 7ff29ca6c700 1 -- 172.21.15.96:0/2966726800 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff298110380 con 0x7ff2980fe930 2023-05-08T03:41:15.235 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.221+0000 7ff29ca6c700 1 -- 172.21.15.96:0/2966726800 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff2980fcdd0 con 0x7ff2980fe930 2023-05-08T03:41:15.235 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.223+0000 7ff2877fe700 1 -- 172.21.15.96:0/2966726800 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7ff28800fcc0 con 0x7ff2980fe930 2023-05-08T03:41:15.235 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.223+0000 7ff2877fe700 1 --2- 172.21.15.96:0/2966726800 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7ff2800a11e0 0x7ff2800a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:15.235 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.224+0000 7ff295d9b700 1 --2- 172.21.15.96:0/2966726800 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7ff2800a11e0 0x7ff2800a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:15.235 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.224+0000 7ff2877fe700 1 -- 172.21.15.96:0/2966726800 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7ff2880cdef0 con 0x7ff2980fe930 2023-05-08T03:41:15.235 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.224+0000 7ff2877fe700 1 --2- 172.21.15.96:0/2966726800 >> [v2:172.21.15.96:6818/386227948,v1:172.21.15.96:6819/386227948] conn(0x7ff2800aa9b0 0x7ff2800acdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:15.235 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.224+0000 7ff2877fe700 1 -- 172.21.15.96:0/2966726800 --> [v2:172.21.15.96:6818/386227948,v1:172.21.15.96:6819/386227948] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff2800ad470 con 0x7ff2800aa9b0 2023-05-08T03:41:15.236 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.224+0000 7ff2877fe700 1 -- 172.21.15.96:0/2966726800 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff2880ce260 con 0x7ff2980fe930 2023-05-08T03:41:15.236 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.224+0000 7ff296d9d700 1 --2- 172.21.15.96:0/2966726800 >> [v2:172.21.15.96:6818/386227948,v1:172.21.15.96:6819/386227948] conn(0x7ff2800aa9b0 0x7ff2800acdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:15.236 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.224+0000 7ff295d9b700 1 --2- 172.21.15.96:0/2966726800 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7ff2800a11e0 0x7ff2800a3690 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff298197b60 tx=0x7ff28c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:15.236 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.224+0000 7ff296d9d700 1 --2- 172.21.15.96:0/2966726800 >> [v2:172.21.15.96:6818/386227948,v1:172.21.15.96:6819/386227948] conn(0x7ff2800aa9b0 0x7ff2800acdc0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:15.236 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.225+0000 7ff2877fe700 1 -- 172.21.15.96:0/2966726800 <== osd.6 v2:172.21.15.96:6818/386227948 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7ff2800ad470 con 0x7ff2800aa9b0 2023-05-08T03:41:15.245 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.242+0000 7ff29ca6c700 1 -- 172.21.15.96:0/2966726800 --> [v2:172.21.15.96:6818/386227948,v1:172.21.15.96:6819/386227948] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff2981106a0 con 0x7ff2800aa9b0 2023-05-08T03:41:15.245 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.243+0000 7ff2877fe700 1 -- 172.21.15.96:0/2966726800 <== osd.6 v2:172.21.15.96:6818/386227948 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7ff2981106a0 con 0x7ff2800aa9b0 2023-05-08T03:41:15.246 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.243+0000 7ff29ca6c700 1 -- 172.21.15.96:0/2966726800 >> [v2:172.21.15.96:6818/386227948,v1:172.21.15.96:6819/386227948] conn(0x7ff2800aa9b0 msgr2=0x7ff2800acdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:15.246 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.243+0000 7ff29ca6c700 1 --2- 172.21.15.96:0/2966726800 >> [v2:172.21.15.96:6818/386227948,v1:172.21.15.96:6819/386227948] conn(0x7ff2800aa9b0 0x7ff2800acdc0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:15.246 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.243+0000 7ff29ca6c700 1 -- 172.21.15.96:0/2966726800 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7ff2800a11e0 msgr2=0x7ff2800a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:15.247 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.243+0000 7ff29ca6c700 1 --2- 172.21.15.96:0/2966726800 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7ff2800a11e0 0x7ff2800a3690 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff298197b60 tx=0x7ff28c00b410 comp rx=0 tx=0).stop 2023-05-08T03:41:15.247 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.243+0000 7ff29ca6c700 1 -- 172.21.15.96:0/2966726800 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2980fe930 msgr2=0x7ff298196540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:15.247 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.243+0000 7ff29ca6c700 1 --2- 172.21.15.96:0/2966726800 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2980fe930 0x7ff298196540 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff2880095c0 tx=0x7ff28800f710 comp rx=0 tx=0).stop 2023-05-08T03:41:15.247 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.243+0000 7ff296d9d700 1 -- 172.21.15.96:0/2966726800 reap_dead start 2023-05-08T03:41:15.247 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.243+0000 7ff29ca6c700 1 -- 172.21.15.96:0/2966726800 shutdown_connections 2023-05-08T03:41:15.248 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.243+0000 7ff29ca6c700 1 -- 172.21.15.96:0/2966726800 >> 172.21.15.96:0/2966726800 conn(0x7ff2980759a0 msgr2=0x7ff2980fc400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:15.248 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.243+0000 7ff29ca6c700 1 -- 172.21.15.96:0/2966726800 shutdown_connections 2023-05-08T03:41:15.248 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.243+0000 7ff29ca6c700 1 -- 172.21.15.96:0/2966726800 wait complete. 2023-05-08T03:41:15.276 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.274+0000 7efe8fa68700 1 -- 172.21.15.96:0/3748125890 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe880feaa0 msgr2=0x7efe880fef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:15.277 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.274+0000 7efe8fa68700 1 --2- 172.21.15.96:0/3748125890 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe880feaa0 0x7efe880fef10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7efe8000b0a0 tx=0x7efe8000b3b0 comp rx=0 tx=0).stop 2023-05-08T03:41:15.277 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.274+0000 7efe8fa68700 1 -- 172.21.15.96:0/3748125890 shutdown_connections 2023-05-08T03:41:15.277 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.274+0000 7efe8fa68700 1 --2- 172.21.15.96:0/3748125890 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe880feaa0 0x7efe880fef10 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:15.277 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.274+0000 7efe8fa68700 1 --2- 172.21.15.96:0/3748125890 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe88067e20 0x7efe88104aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:15.277 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.274+0000 7efe8fa68700 1 --2- 172.21.15.96:0/3748125890 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efe88068280 0x7efe88104fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:15.277 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.274+0000 7efe8fa68700 1 -- 172.21.15.96:0/3748125890 >> 172.21.15.96:0/3748125890 conn(0x7efe880759a0 msgr2=0x7efe88075da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:15.277 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.274+0000 7efe8fa68700 1 -- 172.21.15.96:0/3748125890 shutdown_connections 2023-05-08T03:41:15.278 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.274+0000 7efe8fa68700 1 -- 172.21.15.96:0/3748125890 wait complete. 2023-05-08T03:41:15.279 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.274+0000 7efe8fa68700 1 Processor -- start 2023-05-08T03:41:15.279 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.274+0000 7efe8fa68700 1 -- start start 2023-05-08T03:41:15.279 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.275+0000 7efe8fa68700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efe88067e20 0x7efe881986e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:15.279 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.275+0000 7efe8fa68700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe88068280 0x7efe88198c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:15.279 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.275+0000 7efe8fa68700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe880feaa0 0x7efe8819bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:15.280 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.275+0000 7efe8fa68700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe8819c5e0 con 0x7efe88068280 2023-05-08T03:41:15.280 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.275+0000 7efe8fa68700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe8819c750 con 0x7efe880feaa0 2023-05-08T03:41:15.280 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.275+0000 7efe8fa68700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe8819c910 con 0x7efe88067e20 2023-05-08T03:41:15.280 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.275+0000 7efe8d003700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe88068280 0x7efe88198c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:15.280 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.275+0000 7efe8d003700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe88068280 0x7efe88198c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40788/0 (socket says 172.21.15.96:40788) 2023-05-08T03:41:15.280 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.275+0000 7efe8d003700 1 -- 172.21.15.96:0/1379269301 learned_addr learned my addr 172.21.15.96:0/1379269301 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:41:15.280 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.275+0000 7efe8d804700 1 --2- 172.21.15.96:0/1379269301 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efe88067e20 0x7efe881986e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:15.281 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.275+0000 7efe8d003700 1 -- 172.21.15.96:0/1379269301 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efe88067e20 msgr2=0x7efe881986e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:15.281 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.275+0000 7efe8d003700 1 --2- 172.21.15.96:0/1379269301 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efe88067e20 0x7efe881986e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:15.281 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.275+0000 7efe8e005700 1 --2- 172.21.15.96:0/1379269301 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe880feaa0 0x7efe8819bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:15.281 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.275+0000 7efe8d003700 1 -- 172.21.15.96:0/1379269301 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe880feaa0 msgr2=0x7efe8819bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:15.281 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.275+0000 7efe8d003700 1 --2- 172.21.15.96:0/1379269301 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe880feaa0 0x7efe8819bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:15.281 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.275+0000 7efe8d003700 1 -- 172.21.15.96:0/1379269301 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe84009520 con 0x7efe88068280 2023-05-08T03:41:15.282 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.275+0000 7efe8d003700 1 --2- 172.21.15.96:0/1379269301 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe88068280 0x7efe88198c20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7efe7800e9a0 tx=0x7efe7800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:15.282 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.275+0000 7efe7effd700 1 -- 172.21.15.96:0/1379269301 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe78009790 con 0x7efe88068280 2023-05-08T03:41:15.282 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.276+0000 7efe8fa68700 1 -- 172.21.15.96:0/1379269301 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe80009d00 con 0x7efe88068280 2023-05-08T03:41:15.282 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.276+0000 7efe7effd700 1 -- 172.21.15.96:0/1379269301 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efe7800cbd0 con 0x7efe88068280 2023-05-08T03:41:15.282 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.276+0000 7efe7effd700 1 -- 172.21.15.96:0/1379269301 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe78018680 con 0x7efe88068280 2023-05-08T03:41:15.283 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.276+0000 7efe8fa68700 1 -- 172.21.15.96:0/1379269301 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe8810a280 con 0x7efe88068280 2023-05-08T03:41:15.283 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.276+0000 7efe8fa68700 1 -- 172.21.15.96:0/1379269301 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efe88061370 con 0x7efe88068280 2023-05-08T03:41:15.284 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.278+0000 7efe7effd700 1 -- 172.21.15.96:0/1379269301 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7efe7800cd40 con 0x7efe88068280 2023-05-08T03:41:15.284 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.278+0000 7efe7effd700 1 --2- 172.21.15.96:0/1379269301 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7efe740a11e0 0x7efe740a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:15.284 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.278+0000 7efe7effd700 1 -- 172.21.15.96:0/1379269301 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7efe78014070 con 0x7efe88068280 2023-05-08T03:41:15.284 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.278+0000 7efe8d804700 1 --2- 172.21.15.96:0/1379269301 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7efe740a11e0 0x7efe740a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:15.284 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.278+0000 7efe7effd700 1 --2- 172.21.15.96:0/1379269301 >> [v2:172.21.15.186:6824/3853499290,v1:172.21.15.186:6825/3853499290] conn(0x7efe740aa9b0 0x7efe740acdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:15.285 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.278+0000 7efe7effd700 1 -- 172.21.15.96:0/1379269301 --> [v2:172.21.15.186:6824/3853499290,v1:172.21.15.186:6825/3853499290] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efe740ad470 con 0x7efe740aa9b0 2023-05-08T03:41:15.285 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.278+0000 7efe7effd700 1 -- 172.21.15.96:0/1379269301 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) v2 ==== 24+0+0 (secure 0 0 0) 0x7efe780cda60 con 0x7efe88068280 2023-05-08T03:41:15.285 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.279+0000 7efe8d804700 1 --2- 172.21.15.96:0/1379269301 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7efe740a11e0 0x7efe740a3690 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7efe880ffbe0 tx=0x7efe84009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:15.285 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.279+0000 7efe8e005700 1 --2- 172.21.15.96:0/1379269301 >> [v2:172.21.15.186:6824/3853499290,v1:172.21.15.186:6825/3853499290] conn(0x7efe740aa9b0 0x7efe740acdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:15.285 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.279+0000 7efe8e005700 1 --2- 172.21.15.96:0/1379269301 >> [v2:172.21.15.186:6824/3853499290,v1:172.21.15.186:6825/3853499290] conn(0x7efe740aa9b0 0x7efe740acdc0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:15.285 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.280+0000 7efe7effd700 1 -- 172.21.15.96:0/1379269301 <== osd.11 v2:172.21.15.186:6824/3853499290 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7efe740ad470 con 0x7efe740aa9b0 2023-05-08T03:41:15.299 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.296+0000 7efe8fa68700 1 -- 172.21.15.96:0/1379269301 --> [v2:172.21.15.186:6824/3853499290,v1:172.21.15.186:6825/3853499290] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7efe8810a0f0 con 0x7efe740aa9b0 2023-05-08T03:41:15.299 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.297+0000 7efe7effd700 1 -- 172.21.15.96:0/1379269301 <== osd.11 v2:172.21.15.186:6824/3853499290 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7efe8810a0f0 con 0x7efe740aa9b0 2023-05-08T03:41:15.300 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.297+0000 7efe8fa68700 1 -- 172.21.15.96:0/1379269301 >> [v2:172.21.15.186:6824/3853499290,v1:172.21.15.186:6825/3853499290] conn(0x7efe740aa9b0 msgr2=0x7efe740acdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:15.300 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.297+0000 7efe8fa68700 1 --2- 172.21.15.96:0/1379269301 >> [v2:172.21.15.186:6824/3853499290,v1:172.21.15.186:6825/3853499290] conn(0x7efe740aa9b0 0x7efe740acdc0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:15.300 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.297+0000 7efe8fa68700 1 -- 172.21.15.96:0/1379269301 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7efe740a11e0 msgr2=0x7efe740a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:15.301 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.297+0000 7efe8fa68700 1 --2- 172.21.15.96:0/1379269301 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7efe740a11e0 0x7efe740a3690 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7efe880ffbe0 tx=0x7efe84009260 comp rx=0 tx=0).stop 2023-05-08T03:41:15.301 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.297+0000 7efe8fa68700 1 -- 172.21.15.96:0/1379269301 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe88068280 msgr2=0x7efe88198c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:15.301 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.297+0000 7efe8fa68700 1 --2- 172.21.15.96:0/1379269301 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe88068280 0x7efe88198c20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7efe7800e9a0 tx=0x7efe7800ed60 comp rx=0 tx=0).stop 2023-05-08T03:41:15.301 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.297+0000 7efe8e005700 1 -- 172.21.15.96:0/1379269301 reap_dead start 2023-05-08T03:41:15.301 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.297+0000 7efe8fa68700 1 -- 172.21.15.96:0/1379269301 shutdown_connections 2023-05-08T03:41:15.301 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.297+0000 7efe8fa68700 1 -- 172.21.15.96:0/1379269301 >> 172.21.15.96:0/1379269301 conn(0x7efe880759a0 msgr2=0x7efe880fde10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:15.301 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.297+0000 7efe8fa68700 1 -- 172.21.15.96:0/1379269301 shutdown_connections 2023-05-08T03:41:15.302 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.297+0000 7efe8fa68700 1 -- 172.21.15.96:0/1379269301 wait complete. 2023-05-08T03:41:15.668 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.951+0000 7fdc98f13700 1 -- 172.21.15.96:0/3762270196 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc94105390 msgr2=0x7fdc94105760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:15.669 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.951+0000 7fdc98f13700 1 --2- 172.21.15.96:0/3762270196 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc94105390 0x7fdc94105760 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fdc84009990 tx=0x7fdc84009ca0 comp rx=0 tx=0).stop 2023-05-08T03:41:15.669 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.951+0000 7fdc98f13700 1 -- 172.21.15.96:0/3762270196 shutdown_connections 2023-05-08T03:41:15.669 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.951+0000 7fdc98f13700 1 --2- 172.21.15.96:0/3762270196 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdc940ff2e0 0x7fdc9410d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:15.669 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.951+0000 7fdc98f13700 1 --2- 172.21.15.96:0/3762270196 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc94105390 0x7fdc94105760 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:15.669 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.951+0000 7fdc98f13700 1 --2- 172.21.15.96:0/3762270196 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc940fe930 0x7fdc940feda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:15.669 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.951+0000 7fdc98f13700 1 -- 172.21.15.96:0/3762270196 >> 172.21.15.96:0/3762270196 conn(0x7fdc940759a0 msgr2=0x7fdc94075da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:15.670 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.951+0000 7fdc98f13700 1 -- 172.21.15.96:0/3762270196 shutdown_connections 2023-05-08T03:41:15.670 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.951+0000 7fdc98f13700 1 -- 172.21.15.96:0/3762270196 wait complete. 2023-05-08T03:41:15.670 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.952+0000 7fdc98f13700 1 Processor -- start 2023-05-08T03:41:15.670 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.952+0000 7fdc98f13700 1 -- start start 2023-05-08T03:41:15.670 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.952+0000 7fdc98f13700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdc940fe930 0x7fdc94196510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:15.670 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.952+0000 7fdc98f13700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc940ff2e0 0x7fdc94196a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:15.670 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.952+0000 7fdc98f13700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc94105390 0x7fdc9419ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:15.671 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.952+0000 7fdc98f13700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc9419b480 con 0x7fdc94105390 2023-05-08T03:41:15.671 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.952+0000 7fdc98f13700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc9419b5f0 con 0x7fdc940ff2e0 2023-05-08T03:41:15.671 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.952+0000 7fdc98f13700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc9419b7b0 con 0x7fdc940fe930 2023-05-08T03:41:15.671 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.952+0000 7fdc92d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc94105390 0x7fdc9419ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:15.671 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.952+0000 7fdc92d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc94105390 0x7fdc9419ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40728/0 (socket says 172.21.15.96:40728) 2023-05-08T03:41:15.671 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.952+0000 7fdc92d9d700 1 -- 172.21.15.96:0/3314996762 learned_addr learned my addr 172.21.15.96:0/3314996762 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:41:15.671 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.952+0000 7fdc91d9b700 1 --2- 172.21.15.96:0/3314996762 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc940ff2e0 0x7fdc94196a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:15.671 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.952+0000 7fdc9259c700 1 --2- 172.21.15.96:0/3314996762 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdc940fe930 0x7fdc94196510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:15.672 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.952+0000 7fdc92d9d700 1 -- 172.21.15.96:0/3314996762 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdc940fe930 msgr2=0x7fdc94196510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:15.672 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.952+0000 7fdc92d9d700 1 --2- 172.21.15.96:0/3314996762 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdc940fe930 0x7fdc94196510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:15.672 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.952+0000 7fdc92d9d700 1 -- 172.21.15.96:0/3314996762 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc940ff2e0 msgr2=0x7fdc94196a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:15.672 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.952+0000 7fdc92d9d700 1 --2- 172.21.15.96:0/3314996762 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc940ff2e0 0x7fdc94196a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:15.672 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.952+0000 7fdc92d9d700 1 -- 172.21.15.96:0/3314996762 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc840095f0 con 0x7fdc94105390 2023-05-08T03:41:15.672 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.953+0000 7fdc92d9d700 1 --2- 172.21.15.96:0/3314996762 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc94105390 0x7fdc9419ae70 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c007ee0 tx=0x7fdc8c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:15.672 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.953+0000 7fdc837fe700 1 -- 172.21.15.96:0/3314996762 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c017070 con 0x7fdc94105390 2023-05-08T03:41:15.673 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.953+0000 7fdc98f13700 1 -- 172.21.15.96:0/3314996762 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc94110510 con 0x7fdc94105390 2023-05-08T03:41:15.673 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.953+0000 7fdc837fe700 1 -- 172.21.15.96:0/3314996762 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdc8c00f040 con 0x7fdc94105390 2023-05-08T03:41:15.673 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.953+0000 7fdc837fe700 1 -- 172.21.15.96:0/3314996762 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c005580 con 0x7fdc94105390 2023-05-08T03:41:15.673 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.953+0000 7fdc98f13700 1 -- 172.21.15.96:0/3314996762 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc94110380 con 0x7fdc94105390 2023-05-08T03:41:15.674 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.954+0000 7fdc98f13700 1 -- 172.21.15.96:0/3314996762 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdc940fcd50 con 0x7fdc94105390 2023-05-08T03:41:15.674 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.955+0000 7fdc837fe700 1 -- 172.21.15.96:0/3314996762 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fdc8c00db20 con 0x7fdc94105390 2023-05-08T03:41:15.674 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.956+0000 7fdc837fe700 1 --2- 172.21.15.96:0/3314996762 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fdc7c0a11e0 0x7fdc7c0a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:15.674 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.956+0000 7fdc9259c700 1 --2- 172.21.15.96:0/3314996762 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fdc7c0a11e0 0x7fdc7c0a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:15.674 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.956+0000 7fdc837fe700 1 -- 172.21.15.96:0/3314996762 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fdc8c0cc780 con 0x7fdc94105390 2023-05-08T03:41:15.674 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.956+0000 7fdc837fe700 1 --2- 172.21.15.96:0/3314996762 >> [v2:172.21.15.133:6800/206989126,v1:172.21.15.133:6801/206989126] conn(0x7fdc7c0aa9b0 0x7fdc7c0acdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:15.674 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.956+0000 7fdc837fe700 1 -- 172.21.15.96:0/3314996762 --> [v2:172.21.15.133:6800/206989126,v1:172.21.15.133:6801/206989126] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdc7c0ad470 con 0x7fdc7c0aa9b0 2023-05-08T03:41:15.675 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.956+0000 7fdc837fe700 1 -- 172.21.15.96:0/3314996762 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdc8c0ccc20 con 0x7fdc94105390 2023-05-08T03:41:15.675 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.956+0000 7fdc9259c700 1 --2- 172.21.15.96:0/3314996762 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fdc7c0a11e0 0x7fdc7c0a3690 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fdc8400b2e0 tx=0x7fdc84005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:15.675 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.956+0000 7fdc91d9b700 1 --2- 172.21.15.96:0/3314996762 >> [v2:172.21.15.133:6800/206989126,v1:172.21.15.133:6801/206989126] conn(0x7fdc7c0aa9b0 0x7fdc7c0acdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:15.676 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.957+0000 7fdc91d9b700 1 --2- 172.21.15.96:0/3314996762 >> [v2:172.21.15.133:6800/206989126,v1:172.21.15.133:6801/206989126] conn(0x7fdc7c0aa9b0 0x7fdc7c0acdc0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:15.676 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.957+0000 7fdc837fe700 1 -- 172.21.15.96:0/3314996762 <== osd.1 v2:172.21.15.133:6800/206989126 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fdc7c0ad470 con 0x7fdc7c0aa9b0 2023-05-08T03:41:15.676 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.973+0000 7fdc98f13700 1 -- 172.21.15.96:0/3314996762 --> [v2:172.21.15.133:6800/206989126,v1:172.21.15.133:6801/206989126] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdc941106a0 con 0x7fdc7c0aa9b0 2023-05-08T03:41:15.677 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.974+0000 7fdc837fe700 1 -- 172.21.15.96:0/3314996762 <== osd.1 v2:172.21.15.133:6800/206989126 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fdc941106a0 con 0x7fdc7c0aa9b0 2023-05-08T03:41:15.677 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.974+0000 7fdc98f13700 1 -- 172.21.15.96:0/3314996762 >> [v2:172.21.15.133:6800/206989126,v1:172.21.15.133:6801/206989126] conn(0x7fdc7c0aa9b0 msgr2=0x7fdc7c0acdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:15.677 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.974+0000 7fdc98f13700 1 --2- 172.21.15.96:0/3314996762 >> [v2:172.21.15.133:6800/206989126,v1:172.21.15.133:6801/206989126] conn(0x7fdc7c0aa9b0 0x7fdc7c0acdc0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:15.677 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.974+0000 7fdc98f13700 1 -- 172.21.15.96:0/3314996762 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fdc7c0a11e0 msgr2=0x7fdc7c0a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:15.677 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.974+0000 7fdc98f13700 1 --2- 172.21.15.96:0/3314996762 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fdc7c0a11e0 0x7fdc7c0a3690 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fdc8400b2e0 tx=0x7fdc84005fd0 comp rx=0 tx=0).stop 2023-05-08T03:41:15.677 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.974+0000 7fdc98f13700 1 -- 172.21.15.96:0/3314996762 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc94105390 msgr2=0x7fdc9419ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:15.677 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.974+0000 7fdc98f13700 1 --2- 172.21.15.96:0/3314996762 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc94105390 0x7fdc9419ae70 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c007ee0 tx=0x7fdc8c00d3b0 comp rx=0 tx=0).stop 2023-05-08T03:41:15.677 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.974+0000 7fdc92d9d700 1 -- 172.21.15.96:0/3314996762 reap_dead start 2023-05-08T03:41:15.678 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.974+0000 7fdc98f13700 1 -- 172.21.15.96:0/3314996762 shutdown_connections 2023-05-08T03:41:15.678 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.974+0000 7fdc98f13700 1 -- 172.21.15.96:0/3314996762 >> 172.21.15.96:0/3314996762 conn(0x7fdc940759a0 msgr2=0x7fdc940fc400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:15.678 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.974+0000 7fdc98f13700 1 -- 172.21.15.96:0/3314996762 shutdown_connections 2023-05-08T03:41:15.678 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:14.974+0000 7fdc98f13700 1 -- 172.21.15.96:0/3314996762 wait complete. 2023-05-08T03:41:15.877 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.871+0000 7fb228772700 1 -- 172.21.15.96:0/313557196 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2200ffee0 msgr2=0x7fb220103eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:15.877 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.871+0000 7fb228772700 1 --2- 172.21.15.96:0/313557196 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2200ffee0 0x7fb220103eb0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb2100099c0 tx=0x7fb210009cd0 comp rx=0 tx=0).stop 2023-05-08T03:41:15.877 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.872+0000 7fb228772700 1 -- 172.21.15.96:0/313557196 shutdown_connections 2023-05-08T03:41:15.877 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.872+0000 7fb228772700 1 --2- 172.21.15.96:0/313557196 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb2201045e0 0x7fb22010c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:15.877 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.872+0000 7fb228772700 1 --2- 172.21.15.96:0/313557196 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2200ff540 0x7fb2200ff910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:15.878 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.872+0000 7fb228772700 1 --2- 172.21.15.96:0/313557196 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2200ffee0 0x7fb220103eb0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:15.878 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.872+0000 7fb228772700 1 -- 172.21.15.96:0/313557196 >> 172.21.15.96:0/313557196 conn(0x7fb2200fadc0 msgr2=0x7fb2200fd1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:15.878 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.872+0000 7fb228772700 1 -- 172.21.15.96:0/313557196 shutdown_connections 2023-05-08T03:41:15.878 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.872+0000 7fb228772700 1 -- 172.21.15.96:0/313557196 wait complete. 2023-05-08T03:41:15.878 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.872+0000 7fb228772700 1 Processor -- start 2023-05-08T03:41:15.878 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.872+0000 7fb228772700 1 -- start start 2023-05-08T03:41:15.878 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.872+0000 7fb228772700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb2200ff540 0x7fb220195460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:15.878 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.872+0000 7fb228772700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2200ffee0 0x7fb2201959a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:15.879 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.872+0000 7fb228772700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2201045e0 0x7fb220199d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:15.879 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.872+0000 7fb228772700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb22019a380 con 0x7fb2200ffee0 2023-05-08T03:41:15.879 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.872+0000 7fb228772700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb22019a4f0 con 0x7fb2201045e0 2023-05-08T03:41:15.879 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.872+0000 7fb228772700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb22019a6b0 con 0x7fb2200ff540 2023-05-08T03:41:15.879 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.873+0000 7fb225d0d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2200ffee0 0x7fb2201959a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:15.879 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.873+0000 7fb225d0d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2200ffee0 0x7fb2201959a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40804/0 (socket says 172.21.15.96:40804) 2023-05-08T03:41:15.879 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.873+0000 7fb225d0d700 1 -- 172.21.15.96:0/2767002152 learned_addr learned my addr 172.21.15.96:0/2767002152 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:41:15.880 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.873+0000 7fb226d0f700 1 --2- 172.21.15.96:0/2767002152 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2201045e0 0x7fb220199d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:15.880 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.873+0000 7fb22650e700 1 --2- 172.21.15.96:0/2767002152 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb2200ff540 0x7fb220195460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:15.880 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.873+0000 7fb225d0d700 1 -- 172.21.15.96:0/2767002152 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb2200ff540 msgr2=0x7fb220195460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:15.880 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.873+0000 7fb225d0d700 1 --2- 172.21.15.96:0/2767002152 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb2200ff540 0x7fb220195460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:15.880 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.873+0000 7fb225d0d700 1 -- 172.21.15.96:0/2767002152 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2201045e0 msgr2=0x7fb220199d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:15.880 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.873+0000 7fb225d0d700 1 --2- 172.21.15.96:0/2767002152 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2201045e0 0x7fb220199d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:15.880 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.873+0000 7fb225d0d700 1 -- 172.21.15.96:0/2767002152 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2100095f0 con 0x7fb2200ffee0 2023-05-08T03:41:15.881 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.873+0000 7fb226d0f700 1 --2- 172.21.15.96:0/2767002152 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2201045e0 0x7fb220199d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-08T03:41:15.881 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.873+0000 7fb225d0d700 1 --2- 172.21.15.96:0/2767002152 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2200ffee0 0x7fb2201959a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb210009990 tx=0x7fb210005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:15.881 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.873+0000 7fb2177fe700 1 -- 172.21.15.96:0/2767002152 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21001d070 con 0x7fb2200ffee0 2023-05-08T03:41:15.881 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.873+0000 7fb2177fe700 1 -- 172.21.15.96:0/2767002152 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb210004090 con 0x7fb2200ffee0 2023-05-08T03:41:15.881 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.873+0000 7fb228772700 1 -- 172.21.15.96:0/2767002152 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb22010f310 con 0x7fb2200ffee0 2023-05-08T03:41:15.881 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.873+0000 7fb2177fe700 1 -- 172.21.15.96:0/2767002152 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb210022d20 con 0x7fb2200ffee0 2023-05-08T03:41:15.881 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.873+0000 7fb228772700 1 -- 172.21.15.96:0/2767002152 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb22010f180 con 0x7fb2200ffee0 2023-05-08T03:41:15.883 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.875+0000 7fb228772700 1 -- 172.21.15.96:0/2767002152 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb2200fc2c0 con 0x7fb2200ffee0 2023-05-08T03:41:15.883 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.876+0000 7fb2177fe700 1 -- 172.21.15.96:0/2767002152 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fb210022470 con 0x7fb2200ffee0 2023-05-08T03:41:15.883 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.876+0000 7fb2177fe700 1 --2- 172.21.15.96:0/2767002152 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fb20c0a11e0 0x7fb20c0a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:15.883 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.876+0000 7fb22650e700 1 --2- 172.21.15.96:0/2767002152 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fb20c0a11e0 0x7fb20c0a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:15.883 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.876+0000 7fb2177fe700 1 -- 172.21.15.96:0/2767002152 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fb2100cdc70 con 0x7fb2200ffee0 2023-05-08T03:41:15.883 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.876+0000 7fb2177fe700 1 --2- 172.21.15.96:0/2767002152 >> [v2:172.21.15.133:6816/218507954,v1:172.21.15.133:6817/218507954] conn(0x7fb20c0aa880 0x7fb20c0acc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:15.883 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.876+0000 7fb2177fe700 1 -- 172.21.15.96:0/2767002152 --> [v2:172.21.15.133:6816/218507954,v1:172.21.15.133:6817/218507954] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb20c0ad340 con 0x7fb20c0aa880 2023-05-08T03:41:15.884 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.876+0000 7fb2177fe700 1 -- 172.21.15.96:0/2767002152 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb2100d2030 con 0x7fb2200ffee0 2023-05-08T03:41:15.884 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.877+0000 7fb22650e700 1 --2- 172.21.15.96:0/2767002152 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fb20c0a11e0 0x7fb20c0a3690 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb21c005950 tx=0x7fb21c0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:15.884 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.877+0000 7fb226d0f700 1 --2- 172.21.15.96:0/2767002152 >> [v2:172.21.15.133:6816/218507954,v1:172.21.15.133:6817/218507954] conn(0x7fb20c0aa880 0x7fb20c0acc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:15.884 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.877+0000 7fb226d0f700 1 --2- 172.21.15.96:0/2767002152 >> [v2:172.21.15.133:6816/218507954,v1:172.21.15.133:6817/218507954] conn(0x7fb20c0aa880 0x7fb20c0acc90 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:15.884 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.878+0000 7fb2177fe700 1 -- 172.21.15.96:0/2767002152 <== osd.7 v2:172.21.15.133:6816/218507954 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fb20c0ad340 con 0x7fb20c0aa880 2023-05-08T03:41:15.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.893+0000 7fb228772700 1 -- 172.21.15.96:0/2767002152 --> [v2:172.21.15.133:6816/218507954,v1:172.21.15.133:6817/218507954] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb22010f4a0 con 0x7fb20c0aa880 2023-05-08T03:41:15.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.894+0000 7fb2177fe700 1 -- 172.21.15.96:0/2767002152 <== osd.7 v2:172.21.15.133:6816/218507954 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fb22010f4a0 con 0x7fb20c0aa880 2023-05-08T03:41:15.898 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.894+0000 7fb228772700 1 -- 172.21.15.96:0/2767002152 >> [v2:172.21.15.133:6816/218507954,v1:172.21.15.133:6817/218507954] conn(0x7fb20c0aa880 msgr2=0x7fb20c0acc90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:15.898 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.894+0000 7fb228772700 1 --2- 172.21.15.96:0/2767002152 >> [v2:172.21.15.133:6816/218507954,v1:172.21.15.133:6817/218507954] conn(0x7fb20c0aa880 0x7fb20c0acc90 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:15.898 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.894+0000 7fb228772700 1 -- 172.21.15.96:0/2767002152 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fb20c0a11e0 msgr2=0x7fb20c0a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:15.899 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.894+0000 7fb228772700 1 --2- 172.21.15.96:0/2767002152 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fb20c0a11e0 0x7fb20c0a3690 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb21c005950 tx=0x7fb21c0058e0 comp rx=0 tx=0).stop 2023-05-08T03:41:15.899 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.894+0000 7fb228772700 1 -- 172.21.15.96:0/2767002152 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2200ffee0 msgr2=0x7fb2201959a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:15.899 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.894+0000 7fb228772700 1 --2- 172.21.15.96:0/2767002152 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2200ffee0 0x7fb2201959a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb210009990 tx=0x7fb210005e80 comp rx=0 tx=0).stop 2023-05-08T03:41:15.899 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.894+0000 7fb226d0f700 1 -- 172.21.15.96:0/2767002152 reap_dead start 2023-05-08T03:41:15.899 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.894+0000 7fb228772700 1 -- 172.21.15.96:0/2767002152 shutdown_connections 2023-05-08T03:41:15.899 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.894+0000 7fb228772700 1 -- 172.21.15.96:0/2767002152 >> 172.21.15.96:0/2767002152 conn(0x7fb2200fadc0 msgr2=0x7fb2200fb870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:15.899 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.895+0000 7fb228772700 1 -- 172.21.15.96:0/2767002152 shutdown_connections 2023-05-08T03:41:15.899 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.895+0000 7fb228772700 1 -- 172.21.15.96:0/2767002152 wait complete. 2023-05-08T03:41:16.027 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.255+0000 7faec1801700 1 -- 172.21.15.96:0/2611466109 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faebc104440 msgr2=0x7faebc10bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:16.027 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.255+0000 7faec1801700 1 --2- 172.21.15.96:0/2611466109 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faebc104440 0x7faebc10bfc0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7faeb400b0d0 tx=0x7faeb400b3e0 comp rx=0 tx=0).stop 2023-05-08T03:41:16.027 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.256+0000 7faec1801700 1 -- 172.21.15.96:0/2611466109 shutdown_connections 2023-05-08T03:41:16.027 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.256+0000 7faec1801700 1 --2- 172.21.15.96:0/2611466109 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faebc104440 0x7faebc10bfc0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:16.028 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.256+0000 7faec1801700 1 --2- 172.21.15.96:0/2611466109 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faebc0ff3a0 0x7faebc0ff770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:16.028 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.256+0000 7faec1801700 1 --2- 172.21.15.96:0/2611466109 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faebc0ffd40 0x7faebc103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:16.028 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.256+0000 7faec1801700 1 -- 172.21.15.96:0/2611466109 >> 172.21.15.96:0/2611466109 conn(0x7faebc076280 msgr2=0x7faebc076680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:16.028 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.257+0000 7faec1801700 1 -- 172.21.15.96:0/2611466109 shutdown_connections 2023-05-08T03:41:16.028 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.257+0000 7faec1801700 1 -- 172.21.15.96:0/2611466109 wait complete. 2023-05-08T03:41:16.028 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.258+0000 7faec1801700 1 Processor -- start 2023-05-08T03:41:16.029 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.258+0000 7faec1801700 1 -- start start 2023-05-08T03:41:16.029 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.258+0000 7faec1801700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faebc0ff3a0 0x7faebc100db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:16.029 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.258+0000 7faec1801700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faebc0ffd40 0x7faebc1012f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:16.029 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.258+0000 7faec1801700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faebc104440 0x7faebc101870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:16.029 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.258+0000 7faec1801700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faebc1a4890 con 0x7faebc0ffd40 2023-05-08T03:41:16.029 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.258+0000 7faec1801700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faebc1a4a00 con 0x7faebc0ff3a0 2023-05-08T03:41:16.030 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.258+0000 7faec1801700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faebc1a4bc0 con 0x7faebc104440 2023-05-08T03:41:16.030 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.258+0000 7faeba7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faebc0ffd40 0x7faebc1012f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:16.030 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.258+0000 7faeba7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faebc0ffd40 0x7faebc1012f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40772/0 (socket says 172.21.15.96:40772) 2023-05-08T03:41:16.030 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.258+0000 7faeba7fc700 1 -- 172.21.15.96:0/3061321252 learned_addr learned my addr 172.21.15.96:0/3061321252 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:41:16.030 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.258+0000 7faebb7fe700 1 --2- 172.21.15.96:0/3061321252 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faebc104440 0x7faebc101870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:16.030 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.259+0000 7faeba7fc700 1 -- 172.21.15.96:0/3061321252 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faebc104440 msgr2=0x7faebc101870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:16.031 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.259+0000 7faeba7fc700 1 --2- 172.21.15.96:0/3061321252 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faebc104440 0x7faebc101870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:16.031 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.259+0000 7faeba7fc700 1 -- 172.21.15.96:0/3061321252 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faebc0ff3a0 msgr2=0x7faebc100db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:16.031 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.259+0000 7faeba7fc700 1 --2- 172.21.15.96:0/3061321252 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faebc0ff3a0 0x7faebc100db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:16.031 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.259+0000 7faeba7fc700 1 -- 172.21.15.96:0/3061321252 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb4009d00 con 0x7faebc0ffd40 2023-05-08T03:41:16.031 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.259+0000 7faeba7fc700 1 --2- 172.21.15.96:0/3061321252 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faebc0ffd40 0x7faebc1012f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7faeb000e970 tx=0x7faeb000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:16.031 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.259+0000 7faea3fff700 1 -- 172.21.15.96:0/3061321252 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb0009790 con 0x7faebc0ffd40 2023-05-08T03:41:16.032 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.259+0000 7faec1801700 1 -- 172.21.15.96:0/3061321252 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faebc10f180 con 0x7faebc0ffd40 2023-05-08T03:41:16.032 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.259+0000 7faec1801700 1 -- 172.21.15.96:0/3061321252 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faebc10eff0 con 0x7faebc0ffd40 2023-05-08T03:41:16.032 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.259+0000 7faea3fff700 1 -- 172.21.15.96:0/3061321252 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faeb000eec0 con 0x7faebc0ffd40 2023-05-08T03:41:16.032 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.259+0000 7faea3fff700 1 -- 172.21.15.96:0/3061321252 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb0005520 con 0x7faebc0ffd40 2023-05-08T03:41:16.032 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.260+0000 7faec1801700 1 -- 172.21.15.96:0/3061321252 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7faea8000ff0 con 0x7faebc0ffd40 2023-05-08T03:41:16.032 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.262+0000 7faea3fff700 1 -- 172.21.15.96:0/3061321252 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7faeb000cbd0 con 0x7faebc0ffd40 2023-05-08T03:41:16.033 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.262+0000 7faea3fff700 1 --2- 172.21.15.96:0/3061321252 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7faea40a1260 0x7faea40a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:16.033 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.262+0000 7faebaffd700 1 --2- 172.21.15.96:0/3061321252 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7faea40a1260 0x7faea40a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:16.033 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.262+0000 7faea3fff700 1 -- 172.21.15.96:0/3061321252 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7faeb0014070 con 0x7faebc0ffd40 2023-05-08T03:41:16.033 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.263+0000 7faea3fff700 1 --2- 172.21.15.96:0/3061321252 >> [v2:172.21.15.186:6800/1791188143,v1:172.21.15.186:6801/1791188143] conn(0x7faea40aaa30 0x7faea40ace40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:16.033 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.263+0000 7faea3fff700 1 -- 172.21.15.96:0/3061321252 --> [v2:172.21.15.186:6800/1791188143,v1:172.21.15.186:6801/1791188143] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faea40ad4f0 con 0x7faea40aaa30 2023-05-08T03:41:16.034 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.263+0000 7faea3fff700 1 -- 172.21.15.96:0/3061321252 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) v2 ==== 24+0+0 (secure 0 0 0) 0x7faeb00cd080 con 0x7faebc0ffd40 2023-05-08T03:41:16.034 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.263+0000 7faebaffd700 1 --2- 172.21.15.96:0/3061321252 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7faea40a1260 0x7faea40a3710 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7faeac005950 tx=0x7faeac0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:16.034 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.263+0000 7faebb7fe700 1 --2- 172.21.15.96:0/3061321252 >> [v2:172.21.15.186:6800/1791188143,v1:172.21.15.186:6801/1791188143] conn(0x7faea40aaa30 0x7faea40ace40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:16.034 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.263+0000 7faebb7fe700 1 --2- 172.21.15.96:0/3061321252 >> [v2:172.21.15.186:6800/1791188143,v1:172.21.15.186:6801/1791188143] conn(0x7faea40aaa30 0x7faea40ace40 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:16.034 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.264+0000 7faea3fff700 1 -- 172.21.15.96:0/3061321252 <== osd.2 v2:172.21.15.186:6800/1791188143 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7faea40ad4f0 con 0x7faea40aaa30 2023-05-08T03:41:16.035 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.282+0000 7faec1801700 1 -- 172.21.15.96:0/3061321252 --> [v2:172.21.15.186:6800/1791188143,v1:172.21.15.186:6801/1791188143] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7faea8002d70 con 0x7faea40aaa30 2023-05-08T03:41:16.035 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.283+0000 7faea3fff700 1 -- 172.21.15.96:0/3061321252 <== osd.2 v2:172.21.15.186:6800/1791188143 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7faea8002d70 con 0x7faea40aaa30 2023-05-08T03:41:16.035 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.283+0000 7faec1801700 1 -- 172.21.15.96:0/3061321252 >> [v2:172.21.15.186:6800/1791188143,v1:172.21.15.186:6801/1791188143] conn(0x7faea40aaa30 msgr2=0x7faea40ace40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:16.036 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.283+0000 7faec1801700 1 --2- 172.21.15.96:0/3061321252 >> [v2:172.21.15.186:6800/1791188143,v1:172.21.15.186:6801/1791188143] conn(0x7faea40aaa30 0x7faea40ace40 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:16.036 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.283+0000 7faec1801700 1 -- 172.21.15.96:0/3061321252 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7faea40a1260 msgr2=0x7faea40a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:16.036 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.284+0000 7faec1801700 1 --2- 172.21.15.96:0/3061321252 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7faea40a1260 0x7faea40a3710 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7faeac005950 tx=0x7faeac0058e0 comp rx=0 tx=0).stop 2023-05-08T03:41:16.036 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.284+0000 7faec1801700 1 -- 172.21.15.96:0/3061321252 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faebc0ffd40 msgr2=0x7faebc1012f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:16.036 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.284+0000 7faec1801700 1 --2- 172.21.15.96:0/3061321252 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faebc0ffd40 0x7faebc1012f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7faeb000e970 tx=0x7faeb000ec80 comp rx=0 tx=0).stop 2023-05-08T03:41:16.036 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.284+0000 7faebb7fe700 1 -- 172.21.15.96:0/3061321252 reap_dead start 2023-05-08T03:41:16.037 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.284+0000 7faec1801700 1 -- 172.21.15.96:0/3061321252 shutdown_connections 2023-05-08T03:41:16.037 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.284+0000 7faec1801700 1 -- 172.21.15.96:0/3061321252 >> 172.21.15.96:0/3061321252 conn(0x7faebc076280 msgr2=0x7faebc102ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:16.037 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.284+0000 7faec1801700 1 -- 172.21.15.96:0/3061321252 shutdown_connections 2023-05-08T03:41:16.037 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:15.284+0000 7faec1801700 1 -- 172.21.15.96:0/3061321252 wait complete. 2023-05-08T03:41:16.135 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:16.007+0000 7fe29a9fa700 1 -- 172.21.15.96:0/1993524137 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2940fff00 msgr2=0x7fe294103ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:16.135 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:16.007+0000 7fe29a9fa700 1 --2- 172.21.15.96:0/1993524137 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2940fff00 0x7fe294103ed0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe2880099c0 tx=0x7fe288009cd0 comp rx=0 tx=0).stop 2023-05-08T03:41:16.136 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:16.008+0000 7fe29a9fa700 1 -- 172.21.15.96:0/1993524137 shutdown_connections 2023-05-08T03:41:16.136 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:16.008+0000 7fe29a9fa700 1 --2- 172.21.15.96:0/1993524137 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe294104600 0x7fe29410c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:16.136 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:16.008+0000 7fe29a9fa700 1 --2- 172.21.15.96:0/1993524137 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe2940ff560 0x7fe2940ff930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:16.136 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:16.008+0000 7fe29a9fa700 1 --2- 172.21.15.96:0/1993524137 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2940fff00 0x7fe294103ed0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:16.136 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:16.008+0000 7fe29a9fa700 1 -- 172.21.15.96:0/1993524137 >> 172.21.15.96:0/1993524137 conn(0x7fe2940771a0 msgr2=0x7fe2940775a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:16.136 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:16.008+0000 7fe29a9fa700 1 -- 172.21.15.96:0/1993524137 shutdown_connections 2023-05-08T03:41:16.137 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:16.008+0000 7fe29a9fa700 1 -- 172.21.15.96:0/1993524137 wait complete. 2023-05-08T03:41:16.137 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:16.008+0000 7fe29a9fa700 1 Processor -- start 2023-05-08T03:41:16.137 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:16.008+0000 7fe29a9fa700 1 -- start start 2023-05-08T03:41:16.137 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:16.009+0000 7fe29a9fa700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe2940ff560 0x7fe2941986c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:16.137 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:16.009+0000 7fe29a9fa700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2940fff00 0x7fe294198c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:16.138 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:16.009+0000 7fe29a9fa700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe294104600 0x7fe29419bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:16.138 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:16.009+0000 7fe29a9fa700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe29419c5c0 con 0x7fe294104600 2023-05-08T03:41:16.138 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:16.009+0000 7fe29a9fa700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe29419c730 con 0x7fe2940fff00 2023-05-08T03:41:16.138 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:16.009+0000 7fe29a9fa700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe29419c8f0 con 0x7fe2940ff560 2023-05-08T03:41:16.138 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:16.009+0000 7fe298f97700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe294104600 0x7fe29419bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:16.139 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:16.009+0000 7fe298f97700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe294104600 0x7fe29419bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40822/0 (socket says 172.21.15.96:40822) 2023-05-08T03:41:16.139 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:16.009+0000 7fe298f97700 1 -- 172.21.15.96:0/1234039881 learned_addr learned my addr 172.21.15.96:0/1234039881 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:41:16.139 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:16.009+0000 7fe2937fe700 1 --2- 172.21.15.96:0/1234039881 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2940fff00 0x7fe294198c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:16.139 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:16.009+0000 7fe298f97700 1 -- 172.21.15.96:0/1234039881 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe2940ff560 msgr2=0x7fe2941986c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:16.139 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:16.009+0000 7fe298f97700 1 --2- 172.21.15.96:0/1234039881 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe2940ff560 0x7fe2941986c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:16.139 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:16.009+0000 7fe298f97700 1 -- 172.21.15.96:0/1234039881 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2940fff00 msgr2=0x7fe294198c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:16.139 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:16.009+0000 7fe298f97700 1 --2- 172.21.15.96:0/1234039881 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2940fff00 0x7fe294198c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:16.140 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:16.009+0000 7fe298f97700 1 -- 172.21.15.96:0/1234039881 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2880095f0 con 0x7fe294104600 2023-05-08T03:41:16.140 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:16.009+0000 7fe298f97700 1 --2- 172.21.15.96:0/1234039881 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe294104600 0x7fe29419bfc0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fe28c007ee0 tx=0x7fe28c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:16.140 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:16.009+0000 7fe2917fa700 1 -- 172.21.15.96:0/1234039881 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe28c00ddd0 con 0x7fe294104600 2023-05-08T03:41:16.140 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:16.009+0000 7fe2917fa700 1 -- 172.21.15.96:0/1234039881 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe28c00f040 con 0x7fe294104600 2023-05-08T03:41:16.140 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:16.009+0000 7fe2917fa700 1 -- 172.21.15.96:0/1234039881 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe28c015400 con 0x7fe294104600 2023-05-08T03:41:16.140 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:16.009+0000 7fe29a9fa700 1 -- 172.21.15.96:0/1234039881 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe29410f330 con 0x7fe294104600 2023-05-08T03:41:16.140 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:16.009+0000 7fe29a9fa700 1 -- 172.21.15.96:0/1234039881 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe29410f1a0 con 0x7fe294104600 2023-05-08T03:41:16.141 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:16.010+0000 7fe29a9fa700 1 -- 172.21.15.96:0/1234039881 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe29410be80 con 0x7fe294104600 2023-05-08T03:41:16.141 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:16.011+0000 7fe2917fa700 1 -- 172.21.15.96:0/1234039881 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fe28c004000 con 0x7fe294104600 2023-05-08T03:41:16.141 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:16.012+0000 7fe2917fa700 1 --2- 172.21.15.96:0/1234039881 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fe27c0a1260 0x7fe27c0a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:16.141 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:16.012+0000 7fe293fff700 1 --2- 172.21.15.96:0/1234039881 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fe27c0a1260 0x7fe27c0a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:16.141 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:16.012+0000 7fe2917fa700 1 -- 172.21.15.96:0/1234039881 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fe28c0cccc0 con 0x7fe294104600 2023-05-08T03:41:16.141 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:16.012+0000 7fe2917fa700 1 --2- 172.21.15.96:0/1234039881 >> [v2:172.21.15.186:6808/541111862,v1:172.21.15.186:6809/541111862] conn(0x7fe27c0aaa30 0x7fe27c0ace40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:16.141 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:16.012+0000 7fe2917fa700 1 -- 172.21.15.96:0/1234039881 --> [v2:172.21.15.186:6808/541111862,v1:172.21.15.186:6809/541111862] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe27c0ad4f0 con 0x7fe27c0aaa30 2023-05-08T03:41:16.142 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:16.012+0000 7fe2917fa700 1 -- 172.21.15.96:0/1234039881 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe28c0cd160 con 0x7fe294104600 2023-05-08T03:41:16.142 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:16.012+0000 7fe293fff700 1 --2- 172.21.15.96:0/1234039881 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fe27c0a1260 0x7fe27c0a3710 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe284005fd0 tx=0x7fe284005d00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:16.142 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:16.012+0000 7fe2937fe700 1 --2- 172.21.15.96:0/1234039881 >> [v2:172.21.15.186:6808/541111862,v1:172.21.15.186:6809/541111862] conn(0x7fe27c0aaa30 0x7fe27c0ace40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:16.143 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:16.013+0000 7fe2937fe700 1 --2- 172.21.15.96:0/1234039881 >> [v2:172.21.15.186:6808/541111862,v1:172.21.15.186:6809/541111862] conn(0x7fe27c0aaa30 0x7fe27c0ace40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:16.143 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:16.013+0000 7fe2917fa700 1 -- 172.21.15.96:0/1234039881 <== osd.5 v2:172.21.15.186:6808/541111862 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fe27c0ad4f0 con 0x7fe27c0aaa30 2023-05-08T03:41:16.143 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:16.030+0000 7fe29a9fa700 1 -- 172.21.15.96:0/1234039881 --> [v2:172.21.15.186:6808/541111862,v1:172.21.15.186:6809/541111862] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe29410f4c0 con 0x7fe27c0aaa30 2023-05-08T03:41:16.143 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:16.031+0000 7fe2917fa700 1 -- 172.21.15.96:0/1234039881 <== osd.5 v2:172.21.15.186:6808/541111862 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fe29410f4c0 con 0x7fe27c0aaa30 2023-05-08T03:41:16.143 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:16.031+0000 7fe29a9fa700 1 -- 172.21.15.96:0/1234039881 >> [v2:172.21.15.186:6808/541111862,v1:172.21.15.186:6809/541111862] conn(0x7fe27c0aaa30 msgr2=0x7fe27c0ace40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:16.143 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:16.031+0000 7fe29a9fa700 1 --2- 172.21.15.96:0/1234039881 >> [v2:172.21.15.186:6808/541111862,v1:172.21.15.186:6809/541111862] conn(0x7fe27c0aaa30 0x7fe27c0ace40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:16.144 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:16.031+0000 7fe29a9fa700 1 -- 172.21.15.96:0/1234039881 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fe27c0a1260 msgr2=0x7fe27c0a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:16.144 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:16.031+0000 7fe29a9fa700 1 --2- 172.21.15.96:0/1234039881 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fe27c0a1260 0x7fe27c0a3710 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe284005fd0 tx=0x7fe284005d00 comp rx=0 tx=0).stop 2023-05-08T03:41:16.144 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:16.031+0000 7fe29a9fa700 1 -- 172.21.15.96:0/1234039881 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe294104600 msgr2=0x7fe29419bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:16.144 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:16.031+0000 7fe29a9fa700 1 --2- 172.21.15.96:0/1234039881 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe294104600 0x7fe29419bfc0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fe28c007ee0 tx=0x7fe28c00d3b0 comp rx=0 tx=0).stop 2023-05-08T03:41:16.144 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:16.031+0000 7fe298f97700 1 -- 172.21.15.96:0/1234039881 reap_dead start 2023-05-08T03:41:16.145 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:16.031+0000 7fe29a9fa700 1 -- 172.21.15.96:0/1234039881 shutdown_connections 2023-05-08T03:41:16.145 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:16.031+0000 7fe29a9fa700 1 -- 172.21.15.96:0/1234039881 >> 172.21.15.96:0/1234039881 conn(0x7fe2940771a0 msgr2=0x7fe294068fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:16.145 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:16.031+0000 7fe29a9fa700 1 -- 172.21.15.96:0/1234039881 shutdown_connections 2023-05-08T03:41:16.145 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:16.031+0000 7fe29a9fa700 1 -- 172.21.15.96:0/1234039881 wait complete. 2023-05-08T03:41:16.840 INFO:teuthology.orchestra.run.smithi096.stdout:330712481808 2023-05-08T03:41:16.840 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- ceph osd last-stat-seq osd.11 2023-05-08T03:41:16.907 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:16 smithi096 ceph-mon[124666]: pgmap v271: 97 pgs: 97 active+clean; 634 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2023-05-08T03:41:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:16 smithi133 ceph-mon[125939]: pgmap v271: 97 pgs: 97 active+clean; 634 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2023-05-08T03:41:17.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:16 smithi186 ceph-mon[126480]: pgmap v271: 97 pgs: 97 active+clean; 634 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2023-05-08T03:41:17.146 INFO:teuthology.orchestra.run.smithi096.stdout:300647710741 2023-05-08T03:41:17.147 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- ceph osd last-stat-seq osd.10 2023-05-08T03:41:17.449 INFO:teuthology.orchestra.run.smithi096.stdout:193273528357 2023-05-08T03:41:17.449 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- ceph osd last-stat-seq osd.6 2023-05-08T03:41:17.559 INFO:teuthology.orchestra.run.smithi096.stdout:55834574909 2023-05-08T03:41:17.559 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- ceph osd last-stat-seq osd.1 2023-05-08T03:41:17.606 INFO:teuthology.orchestra.run.smithi096.stdout:214748364834 2023-05-08T03:41:17.607 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- ceph osd last-stat-seq osd.7 2023-05-08T03:41:17.812 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:17.809+0000 7efdf28e5700 1 -- 172.21.15.96:0/2648943242 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efdec104600 msgr2=0x7efdec10c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:17.813 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:17.809+0000 7efdf28e5700 1 --2- 172.21.15.96:0/2648943242 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efdec104600 0x7efdec10c180 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7efde400b0d0 tx=0x7efde400b3e0 comp rx=0 tx=0).stop 2023-05-08T03:41:17.813 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:17.809+0000 7efdf28e5700 1 -- 172.21.15.96:0/2648943242 shutdown_connections 2023-05-08T03:41:17.813 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:17.809+0000 7efdf28e5700 1 --2- 172.21.15.96:0/2648943242 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efdec104600 0x7efdec10c180 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:17.813 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:17.809+0000 7efdf28e5700 1 --2- 172.21.15.96:0/2648943242 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efdec0ff560 0x7efdec0ff930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:17.813 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:17.809+0000 7efdf28e5700 1 --2- 172.21.15.96:0/2648943242 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efdec0fff00 0x7efdec103ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:17.813 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:17.809+0000 7efdf28e5700 1 -- 172.21.15.96:0/2648943242 >> 172.21.15.96:0/2648943242 conn(0x7efdec0771a0 msgr2=0x7efdec0775a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:17.816 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:17.814+0000 7efdf28e5700 1 -- 172.21.15.96:0/2648943242 shutdown_connections 2023-05-08T03:41:17.816 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:17.814+0000 7efdf28e5700 1 -- 172.21.15.96:0/2648943242 wait complete. 2023-05-08T03:41:17.817 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:17.815+0000 7efdf28e5700 1 Processor -- start 2023-05-08T03:41:17.818 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:17.815+0000 7efdf28e5700 1 -- start start 2023-05-08T03:41:17.818 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:17.815+0000 7efdf28e5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efdec0ff560 0x7efdec197480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:17.818 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:17.815+0000 7efdf28e5700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efdec104600 0x7efdec1979c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:17.818 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:17.815+0000 7efdf28e5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efdec197fa0 0x7efdec1a2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:17.818 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:17.815+0000 7efdf28e5700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdec1a2c80 con 0x7efdec0ff560 2023-05-08T03:41:17.818 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:17.815+0000 7efdf28e5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdec1a2df0 con 0x7efdec197fa0 2023-05-08T03:41:17.819 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:17.815+0000 7efdf28e5700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdec1a2fb0 con 0x7efdec104600 2023-05-08T03:41:17.819 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:17.815+0000 7efdebfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efdec0ff560 0x7efdec197480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:17.820 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:17.815+0000 7efdebfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efdec0ff560 0x7efdec197480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40834/0 (socket says 172.21.15.96:40834) 2023-05-08T03:41:17.820 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:17.815+0000 7efdebfff700 1 -- 172.21.15.96:0/674597505 learned_addr learned my addr 172.21.15.96:0/674597505 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:41:17.820 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:17.815+0000 7efdeb7fe700 1 --2- 172.21.15.96:0/674597505 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efdec104600 0x7efdec1979c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:17.820 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:17.815+0000 7efdf0e82700 1 --2- 172.21.15.96:0/674597505 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efdec197fa0 0x7efdec1a2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:17.820 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:17.816+0000 7efdebfff700 1 -- 172.21.15.96:0/674597505 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efdec104600 msgr2=0x7efdec1979c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:17.821 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:17.816+0000 7efdebfff700 1 --2- 172.21.15.96:0/674597505 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efdec104600 0x7efdec1979c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:17.821 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:17.816+0000 7efdebfff700 1 -- 172.21.15.96:0/674597505 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efdec197fa0 msgr2=0x7efdec1a2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:17.821 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:17.816+0000 7efdebfff700 1 --2- 172.21.15.96:0/674597505 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efdec197fa0 0x7efdec1a2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:17.821 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:17.816+0000 7efdebfff700 1 -- 172.21.15.96:0/674597505 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde4009d00 con 0x7efdec0ff560 2023-05-08T03:41:17.821 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:17.816+0000 7efdebfff700 1 --2- 172.21.15.96:0/674597505 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efdec0ff560 0x7efdec197480 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7efddc00d950 tx=0x7efddc00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:17.821 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:17.816+0000 7efde97fa700 1 -- 172.21.15.96:0/674597505 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efddc00f890 con 0x7efdec0ff560 2023-05-08T03:41:17.822 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:17.816+0000 7efdf28e5700 1 -- 172.21.15.96:0/674597505 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdec10f3d0 con 0x7efdec0ff560 2023-05-08T03:41:17.822 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:17.816+0000 7efde97fa700 1 -- 172.21.15.96:0/674597505 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efddc010460 con 0x7efdec0ff560 2023-05-08T03:41:17.822 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:17.816+0000 7efde97fa700 1 -- 172.21.15.96:0/674597505 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efddc00e610 con 0x7efdec0ff560 2023-05-08T03:41:17.822 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:17.816+0000 7efdf28e5700 1 -- 172.21.15.96:0/674597505 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdec10f240 con 0x7efdec0ff560 2023-05-08T03:41:17.823 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:17.818+0000 7efde97fa700 1 -- 172.21.15.96:0/674597505 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7efddc0108d0 con 0x7efdec0ff560 2023-05-08T03:41:17.823 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:17.819+0000 7efde97fa700 1 --2- 172.21.15.96:0/674597505 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7efdd40a11e0 0x7efdd40a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:17.823 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:17.819+0000 7efdeb7fe700 1 --2- 172.21.15.96:0/674597505 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7efdd40a11e0 0x7efdd40a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:17.823 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:17.819+0000 7efde97fa700 1 -- 172.21.15.96:0/674597505 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7efddc0cc6d0 con 0x7efdec0ff560 2023-05-08T03:41:17.823 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:17.820+0000 7efdeb7fe700 1 --2- 172.21.15.96:0/674597505 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7efdd40a11e0 0x7efdd40a3690 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7efdec068f80 tx=0x7efde0009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:17.825 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:17.823+0000 7efdf28e5700 1 --2- 172.21.15.96:0/674597505 >> [v2:172.21.15.96:6826/543223824,v1:172.21.15.96:6827/543223824] conn(0x7efdec0fd8c0 0x7efdec061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:17.825 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:17.823+0000 7efdf28e5700 1 -- 172.21.15.96:0/674597505 --> [v2:172.21.15.96:6826/543223824,v1:172.21.15.96:6827/543223824] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efdec10f560 con 0x7efdec0fd8c0 2023-05-08T03:41:17.825 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:17.823+0000 7efdf0e82700 1 --2- 172.21.15.96:0/674597505 >> [v2:172.21.15.96:6826/543223824,v1:172.21.15.96:6827/543223824] conn(0x7efdec0fd8c0 0x7efdec061540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:17.826 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:17.823+0000 7efdf0e82700 1 --2- 172.21.15.96:0/674597505 >> [v2:172.21.15.96:6826/543223824,v1:172.21.15.96:6827/543223824] conn(0x7efdec0fd8c0 0x7efdec061540 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:17.826 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:17.824+0000 7efde97fa700 1 -- 172.21.15.96:0/674597505 <== osd.9 v2:172.21.15.96:6826/543223824 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7efdec10f560 con 0x7efdec0fd8c0 2023-05-08T03:41:17.847 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:17.844+0000 7efdf28e5700 1 -- 172.21.15.96:0/674597505 --> [v2:172.21.15.96:6826/543223824,v1:172.21.15.96:6827/543223824] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7efdec066fa0 con 0x7efdec0fd8c0 2023-05-08T03:41:17.848 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:17.845+0000 7efde97fa700 1 -- 172.21.15.96:0/674597505 <== osd.9 v2:172.21.15.96:6826/543223824 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7efdec066fa0 con 0x7efdec0fd8c0 2023-05-08T03:41:17.849 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:17.845+0000 7efdf28e5700 1 -- 172.21.15.96:0/674597505 >> [v2:172.21.15.96:6826/543223824,v1:172.21.15.96:6827/543223824] conn(0x7efdec0fd8c0 msgr2=0x7efdec061540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:17.849 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:17.845+0000 7efdf28e5700 1 --2- 172.21.15.96:0/674597505 >> [v2:172.21.15.96:6826/543223824,v1:172.21.15.96:6827/543223824] conn(0x7efdec0fd8c0 0x7efdec061540 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:17.849 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:17.845+0000 7efdf28e5700 1 -- 172.21.15.96:0/674597505 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7efdd40a11e0 msgr2=0x7efdd40a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:17.849 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:17.845+0000 7efdf28e5700 1 --2- 172.21.15.96:0/674597505 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7efdd40a11e0 0x7efdd40a3690 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7efdec068f80 tx=0x7efde0009190 comp rx=0 tx=0).stop 2023-05-08T03:41:17.849 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:17.845+0000 7efdf28e5700 1 -- 172.21.15.96:0/674597505 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efdec0ff560 msgr2=0x7efdec197480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:17.849 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:17.845+0000 7efdf28e5700 1 --2- 172.21.15.96:0/674597505 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efdec0ff560 0x7efdec197480 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7efddc00d950 tx=0x7efddc00dc60 comp rx=0 tx=0).stop 2023-05-08T03:41:17.850 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:17.845+0000 7efdf0e82700 1 -- 172.21.15.96:0/674597505 reap_dead start 2023-05-08T03:41:17.850 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:17.846+0000 7efdf28e5700 1 -- 172.21.15.96:0/674597505 shutdown_connections 2023-05-08T03:41:17.850 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:17.846+0000 7efdf28e5700 1 -- 172.21.15.96:0/674597505 >> 172.21.15.96:0/674597505 conn(0x7efdec0771a0 msgr2=0x7efdec0fcdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:17.850 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:17.846+0000 7efdf28e5700 1 -- 172.21.15.96:0/674597505 shutdown_connections 2023-05-08T03:41:17.850 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:17.846+0000 7efdf28e5700 1 -- 172.21.15.96:0/674597505 wait complete. 2023-05-08T03:41:18.333 INFO:teuthology.orchestra.run.smithi096.stdout:107374182451 2023-05-08T03:41:18.334 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- ceph osd last-stat-seq osd.3 2023-05-08T03:41:18.451 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:18 smithi096 ceph-mon[124666]: pgmap v272: 97 pgs: 97 active+clean; 634 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2023-05-08T03:41:18.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:18 smithi186 ceph-mon[126480]: pgmap v272: 97 pgs: 97 active+clean; 634 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2023-05-08T03:41:18.720 INFO:teuthology.orchestra.run.smithi096.stdout:163208757291 2023-05-08T03:41:18.721 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- ceph osd last-stat-seq osd.5 2023-05-08T03:41:18.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:18 smithi133 ceph-mon[125939]: pgmap v272: 97 pgs: 97 active+clean; 634 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2023-05-08T03:41:18.747 INFO:teuthology.orchestra.run.smithi096.stdout:279172874266 2023-05-08T03:41:18.747 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- ceph osd last-stat-seq osd.9 2023-05-08T03:41:18.887 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:18.884+0000 7f06932e7700 1 -- 172.21.15.96:0/395043846 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f068c0ff560 msgr2=0x7f068c0ff930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:18.887 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:18.884+0000 7f06932e7700 1 --2- 172.21.15.96:0/395043846 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f068c0ff560 0x7f068c0ff930 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f06880099c0 tx=0x7f0688009cd0 comp rx=0 tx=0).stop 2023-05-08T03:41:18.887 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:18.884+0000 7f06932e7700 1 -- 172.21.15.96:0/395043846 shutdown_connections 2023-05-08T03:41:18.888 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:18.884+0000 7f06932e7700 1 --2- 172.21.15.96:0/395043846 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f068c104600 0x7f068c10c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:18.888 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:18.884+0000 7f06932e7700 1 --2- 172.21.15.96:0/395043846 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f068c0ff560 0x7f068c0ff930 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:18.888 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:18.884+0000 7f06932e7700 1 --2- 172.21.15.96:0/395043846 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f068c0fff00 0x7f068c103ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:18.888 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:18.884+0000 7f06932e7700 1 -- 172.21.15.96:0/395043846 >> 172.21.15.96:0/395043846 conn(0x7f068c0771a0 msgr2=0x7f068c0775a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:18.888 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:18.884+0000 7f06932e7700 1 -- 172.21.15.96:0/395043846 shutdown_connections 2023-05-08T03:41:18.888 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:18.884+0000 7f06932e7700 1 -- 172.21.15.96:0/395043846 wait complete. 2023-05-08T03:41:18.890 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:18.885+0000 7f06932e7700 1 Processor -- start 2023-05-08T03:41:18.890 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:18.885+0000 7f06932e7700 1 -- start start 2023-05-08T03:41:18.890 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:18.885+0000 7f06932e7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f068c0ff560 0x7f068c197310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:18.890 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:18.885+0000 7f06932e7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f068c0fff00 0x7f068c197850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:18.890 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:18.885+0000 7f06932e7700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f068c104600 0x7f068c1a2390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:18.890 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:18.885+0000 7f06932e7700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f068c198190 con 0x7f068c0ff560 2023-05-08T03:41:18.890 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:18.885+0000 7f06932e7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f068c1a28d0 con 0x7f068c0fff00 2023-05-08T03:41:18.891 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:18.885+0000 7f06932e7700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f068c1a2a90 con 0x7f068c104600 2023-05-08T03:41:18.891 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:18.885+0000 7f0691083700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f068c0ff560 0x7f068c197310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:18.891 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:18.885+0000 7f0691083700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f068c0ff560 0x7f068c197310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40848/0 (socket says 172.21.15.96:40848) 2023-05-08T03:41:18.891 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:18.885+0000 7f0691083700 1 -- 172.21.15.96:0/3059227778 learned_addr learned my addr 172.21.15.96:0/3059227778 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:41:18.892 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:18.886+0000 7f0690882700 1 --2- 172.21.15.96:0/3059227778 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f068c0fff00 0x7f068c197850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:18.892 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:18.886+0000 7f0691884700 1 --2- 172.21.15.96:0/3059227778 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f068c104600 0x7f068c1a2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:18.892 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:18.886+0000 7f0691083700 1 -- 172.21.15.96:0/3059227778 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f068c104600 msgr2=0x7f068c1a2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:18.892 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:18.886+0000 7f0691083700 1 --2- 172.21.15.96:0/3059227778 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f068c104600 0x7f068c1a2390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:18.892 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:18.886+0000 7f0691083700 1 -- 172.21.15.96:0/3059227778 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f068c0fff00 msgr2=0x7f068c197850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:18.892 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:18.886+0000 7f0691083700 1 --2- 172.21.15.96:0/3059227778 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f068c0fff00 0x7f068c197850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:18.892 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:18.886+0000 7f0691083700 1 -- 172.21.15.96:0/3059227778 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0684009c40 con 0x7f068c0ff560 2023-05-08T03:41:18.893 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:18.886+0000 7f0691884700 1 --2- 172.21.15.96:0/3059227778 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f068c104600 0x7f068c1a2390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-08T03:41:18.893 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:18.886+0000 7f0690882700 1 --2- 172.21.15.96:0/3059227778 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f068c0fff00 0x7f068c197850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-08T03:41:18.893 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:18.886+0000 7f0691083700 1 --2- 172.21.15.96:0/3059227778 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f068c0ff560 0x7f068c197310 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f068800b580 tx=0x7f068800bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:18.893 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:18.886+0000 7f06827fc700 1 -- 172.21.15.96:0/3059227778 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f068801d070 con 0x7f068c0ff560 2023-05-08T03:41:18.893 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:18.886+0000 7f06932e7700 1 -- 172.21.15.96:0/3059227778 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06880095f0 con 0x7f068c0ff560 2023-05-08T03:41:18.893 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:18.886+0000 7f06827fc700 1 -- 172.21.15.96:0/3059227778 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f068800fbf0 con 0x7f068c0ff560 2023-05-08T03:41:18.893 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:18.886+0000 7f06827fc700 1 -- 172.21.15.96:0/3059227778 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06880173f0 con 0x7f068c0ff560 2023-05-08T03:41:18.893 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:18.886+0000 7f06932e7700 1 -- 172.21.15.96:0/3059227778 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f068c10f340 con 0x7f068c0ff560 2023-05-08T03:41:18.894 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:18.887+0000 7f06932e7700 1 -- 172.21.15.96:0/3059227778 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f068c0fd7f0 con 0x7f068c0ff560 2023-05-08T03:41:18.894 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:18.889+0000 7f06827fc700 1 -- 172.21.15.96:0/3059227778 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f0688022470 con 0x7f068c0ff560 2023-05-08T03:41:18.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:18.890+0000 7f06827fc700 1 --2- 172.21.15.96:0/3059227778 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f06780a11e0 0x7f06780a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:18.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:18.890+0000 7f0690882700 1 --2- 172.21.15.96:0/3059227778 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f06780a11e0 0x7f06780a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:18.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:18.890+0000 7f06827fc700 1 -- 172.21.15.96:0/3059227778 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f06880ce5e0 con 0x7f068c0ff560 2023-05-08T03:41:18.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:18.890+0000 7f06827fc700 1 --2- 172.21.15.96:0/3059227778 >> [v2:172.21.15.186:6816/1648475902,v1:172.21.15.186:6817/1648475902] conn(0x7f06780aa9b0 0x7f06780acdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:18.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:18.890+0000 7f06827fc700 1 -- 172.21.15.96:0/3059227778 --> [v2:172.21.15.186:6816/1648475902,v1:172.21.15.186:6817/1648475902] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f06780ad470 con 0x7f06780aa9b0 2023-05-08T03:41:18.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:18.890+0000 7f06827fc700 1 -- 172.21.15.96:0/3059227778 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) v2 ==== 24+0+0 (secure 0 0 0) 0x7f06880ce950 con 0x7f068c0ff560 2023-05-08T03:41:18.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:18.890+0000 7f0690882700 1 --2- 172.21.15.96:0/3059227778 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f06780a11e0 0x7f06780a3690 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f068c068f80 tx=0x7f067c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:18.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:18.890+0000 7f0691884700 1 --2- 172.21.15.96:0/3059227778 >> [v2:172.21.15.186:6816/1648475902,v1:172.21.15.186:6817/1648475902] conn(0x7f06780aa9b0 0x7f06780acdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:18.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:18.891+0000 7f0691884700 1 --2- 172.21.15.96:0/3059227778 >> [v2:172.21.15.186:6816/1648475902,v1:172.21.15.186:6817/1648475902] conn(0x7f06780aa9b0 0x7f06780acdc0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:18.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:18.892+0000 7f06827fc700 1 -- 172.21.15.96:0/3059227778 <== osd.8 v2:172.21.15.186:6816/1648475902 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f06780ad470 con 0x7f06780aa9b0 2023-05-08T03:41:18.927 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:18.924+0000 7f06932e7700 1 -- 172.21.15.96:0/3059227778 --> [v2:172.21.15.186:6816/1648475902,v1:172.21.15.186:6817/1648475902] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f068c10f1b0 con 0x7f06780aa9b0 2023-05-08T03:41:18.927 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:18.925+0000 7f06827fc700 1 -- 172.21.15.96:0/3059227778 <== osd.8 v2:172.21.15.186:6816/1648475902 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f068c10f1b0 con 0x7f06780aa9b0 2023-05-08T03:41:18.928 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:18.925+0000 7f06932e7700 1 -- 172.21.15.96:0/3059227778 >> [v2:172.21.15.186:6816/1648475902,v1:172.21.15.186:6817/1648475902] conn(0x7f06780aa9b0 msgr2=0x7f06780acdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:18.928 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:18.925+0000 7f06932e7700 1 --2- 172.21.15.96:0/3059227778 >> [v2:172.21.15.186:6816/1648475902,v1:172.21.15.186:6817/1648475902] conn(0x7f06780aa9b0 0x7f06780acdc0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:18.928 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:18.925+0000 7f06932e7700 1 -- 172.21.15.96:0/3059227778 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f06780a11e0 msgr2=0x7f06780a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:18.928 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:18.925+0000 7f06932e7700 1 --2- 172.21.15.96:0/3059227778 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f06780a11e0 0x7f06780a3690 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f068c068f80 tx=0x7f067c009260 comp rx=0 tx=0).stop 2023-05-08T03:41:18.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:18.925+0000 7f06932e7700 1 -- 172.21.15.96:0/3059227778 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f068c0ff560 msgr2=0x7f068c197310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:18.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:18.925+0000 7f06932e7700 1 --2- 172.21.15.96:0/3059227778 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f068c0ff560 0x7f068c197310 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f068800b580 tx=0x7f068800bfd0 comp rx=0 tx=0).stop 2023-05-08T03:41:18.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:18.925+0000 7f0691884700 1 -- 172.21.15.96:0/3059227778 reap_dead start 2023-05-08T03:41:18.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:18.925+0000 7f06932e7700 1 -- 172.21.15.96:0/3059227778 shutdown_connections 2023-05-08T03:41:18.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:18.925+0000 7f06932e7700 1 -- 172.21.15.96:0/3059227778 >> 172.21.15.96:0/3059227778 conn(0x7f068c0771a0 msgr2=0x7f068c0fcda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:18.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:18.925+0000 7f06932e7700 1 -- 172.21.15.96:0/3059227778 shutdown_connections 2023-05-08T03:41:18.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:18.925+0000 7f06932e7700 1 -- 172.21.15.96:0/3059227778 wait complete. 2023-05-08T03:41:19.124 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:19.122+0000 7fb78932b700 1 -- 172.21.15.96:0/2475169962 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7841007e0 msgr2=0x7fb784100bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:19.125 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:19.122+0000 7fb78932b700 1 --2- 172.21.15.96:0/2475169962 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7841007e0 0x7fb784100bb0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb7740099c0 tx=0x7fb774009cd0 comp rx=0 tx=0).stop 2023-05-08T03:41:19.125 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:19.122+0000 7fb78932b700 1 -- 172.21.15.96:0/2475169962 shutdown_connections 2023-05-08T03:41:19.125 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:19.122+0000 7fb78932b700 1 --2- 172.21.15.96:0/2475169962 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb784109d90 0x7fb78410c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:19.125 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:19.122+0000 7fb78932b700 1 --2- 172.21.15.96:0/2475169962 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7841007e0 0x7fb784100bb0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:19.125 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:19.122+0000 7fb78932b700 1 --2- 172.21.15.96:0/2475169962 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7841010f0 0x7fb784109850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:19.126 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:19.122+0000 7fb78932b700 1 -- 172.21.15.96:0/2475169962 >> 172.21.15.96:0/2475169962 conn(0x7fb784074c00 msgr2=0x7fb784075000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:19.126 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:19.122+0000 7fb78932b700 1 -- 172.21.15.96:0/2475169962 shutdown_connections 2023-05-08T03:41:19.126 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:19.122+0000 7fb78932b700 1 -- 172.21.15.96:0/2475169962 wait complete. 2023-05-08T03:41:19.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:19.123+0000 7fb78932b700 1 Processor -- start 2023-05-08T03:41:19.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:19.123+0000 7fb78932b700 1 -- start start 2023-05-08T03:41:19.128 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:19.123+0000 7fb78932b700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb7841007e0 0x7fb784195590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:19.128 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:19.123+0000 7fb78932b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7841010f0 0x7fb784195ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:19.128 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:19.123+0000 7fb78932b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb784109d90 0x7fb784199f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:19.128 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:19.123+0000 7fb78932b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb78419a550 con 0x7fb7841010f0 2023-05-08T03:41:19.128 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:19.123+0000 7fb78932b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb78419a6c0 con 0x7fb784109d90 2023-05-08T03:41:19.128 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:19.123+0000 7fb78932b700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb78419a880 con 0x7fb7841007e0 2023-05-08T03:41:19.128 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:19.123+0000 7fb7827fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7841010f0 0x7fb784195ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:19.129 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:19.123+0000 7fb7827fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7841010f0 0x7fb784195ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40864/0 (socket says 172.21.15.96:40864) 2023-05-08T03:41:19.129 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:19.123+0000 7fb7827fc700 1 -- 172.21.15.96:0/671775000 learned_addr learned my addr 172.21.15.96:0/671775000 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:41:19.129 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:19.123+0000 7fb7837fe700 1 --2- 172.21.15.96:0/671775000 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb784109d90 0x7fb784199f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:19.129 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:19.123+0000 7fb782ffd700 1 --2- 172.21.15.96:0/671775000 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb7841007e0 0x7fb784195590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:19.129 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:19.123+0000 7fb7827fc700 1 -- 172.21.15.96:0/671775000 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb7841007e0 msgr2=0x7fb784195590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:19.129 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:19.123+0000 7fb7827fc700 1 --2- 172.21.15.96:0/671775000 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb7841007e0 0x7fb784195590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:19.129 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:19.123+0000 7fb7827fc700 1 -- 172.21.15.96:0/671775000 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb784109d90 msgr2=0x7fb784199f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:19.130 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:19.123+0000 7fb7827fc700 1 --2- 172.21.15.96:0/671775000 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb784109d90 0x7fb784199f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:19.130 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:19.123+0000 7fb7827fc700 1 -- 172.21.15.96:0/671775000 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7740095f0 con 0x7fb7841010f0 2023-05-08T03:41:19.130 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:19.124+0000 7fb7827fc700 1 --2- 172.21.15.96:0/671775000 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7841010f0 0x7fb784195ad0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb77800b530 tx=0x7fb77800b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:19.130 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:19.124+0000 7fb76bfff700 1 -- 172.21.15.96:0/671775000 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb778011830 con 0x7fb7841010f0 2023-05-08T03:41:19.131 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:19.124+0000 7fb78932b700 1 -- 172.21.15.96:0/671775000 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb78410f550 con 0x7fb7841010f0 2023-05-08T03:41:19.131 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:19.124+0000 7fb76bfff700 1 -- 172.21.15.96:0/671775000 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb778011e50 con 0x7fb7841010f0 2023-05-08T03:41:19.131 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:19.124+0000 7fb76bfff700 1 -- 172.21.15.96:0/671775000 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77800f2e0 con 0x7fb7841010f0 2023-05-08T03:41:19.131 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:19.124+0000 7fb78932b700 1 -- 172.21.15.96:0/671775000 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb78410f3c0 con 0x7fb7841010f0 2023-05-08T03:41:19.131 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:19.125+0000 7fb78932b700 1 -- 172.21.15.96:0/671775000 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb7840fd100 con 0x7fb7841010f0 2023-05-08T03:41:19.132 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:19.126+0000 7fb76bfff700 1 -- 172.21.15.96:0/671775000 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fb778010380 con 0x7fb7841010f0 2023-05-08T03:41:19.132 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:19.126+0000 7fb76bfff700 1 --2- 172.21.15.96:0/671775000 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fb76c0a11e0 0x7fb76c0a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:19.132 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:19.126+0000 7fb782ffd700 1 --2- 172.21.15.96:0/671775000 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fb76c0a11e0 0x7fb76c0a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:19.133 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:19.126+0000 7fb76bfff700 1 -- 172.21.15.96:0/671775000 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fb7780cc990 con 0x7fb7841010f0 2023-05-08T03:41:19.133 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:19.126+0000 7fb76bfff700 1 --2- 172.21.15.96:0/671775000 >> [v2:172.21.15.133:6808/1237495996,v1:172.21.15.133:6809/1237495996] conn(0x7fb76c0aa9b0 0x7fb76c0acdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:19.133 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:19.126+0000 7fb76bfff700 1 -- 172.21.15.96:0/671775000 --> [v2:172.21.15.133:6808/1237495996,v1:172.21.15.133:6809/1237495996] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb76c0ad470 con 0x7fb76c0aa9b0 2023-05-08T03:41:19.133 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:19.126+0000 7fb76bfff700 1 -- 172.21.15.96:0/671775000 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb7780cce30 con 0x7fb7841010f0 2023-05-08T03:41:19.133 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:19.127+0000 7fb782ffd700 1 --2- 172.21.15.96:0/671775000 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fb76c0a11e0 0x7fb76c0a3690 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb774000c00 tx=0x7fb774005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:19.133 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:19.127+0000 7fb7837fe700 1 --2- 172.21.15.96:0/671775000 >> [v2:172.21.15.133:6808/1237495996,v1:172.21.15.133:6809/1237495996] conn(0x7fb76c0aa9b0 0x7fb76c0acdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:19.133 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:19.127+0000 7fb7837fe700 1 --2- 172.21.15.96:0/671775000 >> [v2:172.21.15.133:6808/1237495996,v1:172.21.15.133:6809/1237495996] conn(0x7fb76c0aa9b0 0x7fb76c0acdc0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:19.134 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:19.128+0000 7fb76bfff700 1 -- 172.21.15.96:0/671775000 <== osd.4 v2:172.21.15.133:6808/1237495996 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fb76c0ad470 con 0x7fb76c0aa9b0 2023-05-08T03:41:19.146 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:19.144+0000 7fb78932b700 1 -- 172.21.15.96:0/671775000 --> [v2:172.21.15.133:6808/1237495996,v1:172.21.15.133:6809/1237495996] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb78410f6e0 con 0x7fb76c0aa9b0 2023-05-08T03:41:19.146 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:19.144+0000 7fb76bfff700 1 -- 172.21.15.96:0/671775000 <== osd.4 v2:172.21.15.133:6808/1237495996 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fb78410f6e0 con 0x7fb76c0aa9b0 2023-05-08T03:41:19.147 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:19.144+0000 7fb78932b700 1 -- 172.21.15.96:0/671775000 >> [v2:172.21.15.133:6808/1237495996,v1:172.21.15.133:6809/1237495996] conn(0x7fb76c0aa9b0 msgr2=0x7fb76c0acdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:19.147 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:19.144+0000 7fb78932b700 1 --2- 172.21.15.96:0/671775000 >> [v2:172.21.15.133:6808/1237495996,v1:172.21.15.133:6809/1237495996] conn(0x7fb76c0aa9b0 0x7fb76c0acdc0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:19.147 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:19.145+0000 7fb78932b700 1 -- 172.21.15.96:0/671775000 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fb76c0a11e0 msgr2=0x7fb76c0a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:19.148 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:19.145+0000 7fb78932b700 1 --2- 172.21.15.96:0/671775000 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fb76c0a11e0 0x7fb76c0a3690 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb774000c00 tx=0x7fb774005fb0 comp rx=0 tx=0).stop 2023-05-08T03:41:19.148 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:19.145+0000 7fb78932b700 1 -- 172.21.15.96:0/671775000 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7841010f0 msgr2=0x7fb784195ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:19.148 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:19.145+0000 7fb78932b700 1 --2- 172.21.15.96:0/671775000 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7841010f0 0x7fb784195ad0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb77800b530 tx=0x7fb77800b840 comp rx=0 tx=0).stop 2023-05-08T03:41:19.148 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:19.145+0000 7fb7837fe700 1 -- 172.21.15.96:0/671775000 reap_dead start 2023-05-08T03:41:19.148 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:19.145+0000 7fb78932b700 1 -- 172.21.15.96:0/671775000 shutdown_connections 2023-05-08T03:41:19.148 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:19.145+0000 7fb78932b700 1 -- 172.21.15.96:0/671775000 >> 172.21.15.96:0/671775000 conn(0x7fb784074c00 msgr2=0x7fb7840fc6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:19.148 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:19.145+0000 7fb78932b700 1 -- 172.21.15.96:0/671775000 shutdown_connections 2023-05-08T03:41:19.149 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:19.145+0000 7fb78932b700 1 -- 172.21.15.96:0/671775000 wait complete. 2023-05-08T03:41:19.672 INFO:teuthology.orchestra.run.smithi096.stdout:249108103198 2023-05-08T03:41:19.672 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- ceph osd last-stat-seq osd.8 2023-05-08T03:41:19.752 INFO:teuthology.orchestra.run.smithi096.stdout:141733920816 2023-05-08T03:41:19.752 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- ceph osd last-stat-seq osd.4 2023-05-08T03:41:19.768 INFO:teuthology.orchestra.run.smithi096.stdout:77309411385 2023-05-08T03:41:19.769 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- ceph osd last-stat-seq osd.2 2023-05-08T03:41:20.369 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.a/config 2023-05-08T03:41:20.470 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.a/config 2023-05-08T03:41:20.471 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.a/config 2023-05-08T03:41:20.502 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.a/config 2023-05-08T03:41:20.657 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.a/config 2023-05-08T03:41:20.694 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.a/config 2023-05-08T03:41:20.948 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:20 smithi096 ceph-mon[124666]: pgmap v273: 97 pgs: 97 active+clean; 634 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 341 B/s wr, 5 op/s 2023-05-08T03:41:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:20 smithi133 ceph-mon[125939]: pgmap v273: 97 pgs: 97 active+clean; 634 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 341 B/s wr, 5 op/s 2023-05-08T03:41:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:20 smithi186 ceph-mon[126480]: pgmap v273: 97 pgs: 97 active+clean; 634 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 341 B/s wr, 5 op/s 2023-05-08T03:41:21.656 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.a/config 2023-05-08T03:41:21.933 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.a/config 2023-05-08T03:41:22.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:22 smithi096 ceph-mon[124666]: pgmap v274: 97 pgs: 97 active+clean; 634 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 341 B/s wr, 6 op/s 2023-05-08T03:41:22.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:22 smithi133 ceph-mon[125939]: pgmap v274: 97 pgs: 97 active+clean; 634 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 341 B/s wr, 6 op/s 2023-05-08T03:41:23.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:22 smithi186 ceph-mon[126480]: pgmap v274: 97 pgs: 97 active+clean; 634 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 341 B/s wr, 6 op/s 2023-05-08T03:41:23.158 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.064+0000 7fb9be85c700 1 -- 172.21.15.96:0/3305058737 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9b8100fe0 msgr2=0x7fb9b8104fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:23.158 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.064+0000 7fb9be85c700 1 --2- 172.21.15.96:0/3305058737 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9b8100fe0 0x7fb9b8104fb0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac0099c0 tx=0x7fb9ac009cd0 comp rx=0 tx=0).stop 2023-05-08T03:41:23.158 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.064+0000 7fb9be85c700 1 -- 172.21.15.96:0/3305058737 shutdown_connections 2023-05-08T03:41:23.159 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.064+0000 7fb9be85c700 1 --2- 172.21.15.96:0/3305058737 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb9b81056e0 0x7fb9b810d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:23.159 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.064+0000 7fb9be85c700 1 --2- 172.21.15.96:0/3305058737 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9b8100640 0x7fb9b8100a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:23.159 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.064+0000 7fb9be85c700 1 --2- 172.21.15.96:0/3305058737 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9b8100fe0 0x7fb9b8104fb0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:23.159 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.064+0000 7fb9be85c700 1 -- 172.21.15.96:0/3305058737 >> 172.21.15.96:0/3305058737 conn(0x7fb9b80fbec0 msgr2=0x7fb9b80fe2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:23.159 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.064+0000 7fb9be85c700 1 -- 172.21.15.96:0/3305058737 shutdown_connections 2023-05-08T03:41:23.159 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.064+0000 7fb9be85c700 1 -- 172.21.15.96:0/3305058737 wait complete. 2023-05-08T03:41:23.159 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.064+0000 7fb9be85c700 1 Processor -- start 2023-05-08T03:41:23.160 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.065+0000 7fb9be85c700 1 -- start start 2023-05-08T03:41:23.160 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.065+0000 7fb9be85c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9b8100640 0x7fb9b81966c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:23.160 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.065+0000 7fb9be85c700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb9b8100fe0 0x7fb9b8196c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:23.160 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.065+0000 7fb9be85c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9b81056e0 0x7fb9b8199fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:23.160 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.065+0000 7fb9be85c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b819a5c0 con 0x7fb9b8100640 2023-05-08T03:41:23.160 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.065+0000 7fb9be85c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b819a730 con 0x7fb9b81056e0 2023-05-08T03:41:23.160 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.065+0000 7fb9be85c700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b819a8f0 con 0x7fb9b8100fe0 2023-05-08T03:41:23.161 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.065+0000 7fb9b7fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9b8100640 0x7fb9b81966c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:23.161 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.065+0000 7fb9b7fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9b8100640 0x7fb9b81966c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40876/0 (socket says 172.21.15.96:40876) 2023-05-08T03:41:23.161 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.065+0000 7fb9b7fff700 1 -- 172.21.15.96:0/1144041952 learned_addr learned my addr 172.21.15.96:0/1144041952 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:41:23.161 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.065+0000 7fb9bcdf9700 1 --2- 172.21.15.96:0/1144041952 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9b81056e0 0x7fb9b8199fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:23.161 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.065+0000 7fb9b77fe700 1 --2- 172.21.15.96:0/1144041952 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb9b8100fe0 0x7fb9b8196c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:23.161 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.065+0000 7fb9b7fff700 1 -- 172.21.15.96:0/1144041952 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb9b8100fe0 msgr2=0x7fb9b8196c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:23.161 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.065+0000 7fb9b7fff700 1 --2- 172.21.15.96:0/1144041952 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb9b8100fe0 0x7fb9b8196c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:23.161 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.065+0000 7fb9b7fff700 1 -- 172.21.15.96:0/1144041952 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9b81056e0 msgr2=0x7fb9b8199fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:23.162 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.065+0000 7fb9b7fff700 1 --2- 172.21.15.96:0/1144041952 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9b81056e0 0x7fb9b8199fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:23.162 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.065+0000 7fb9b7fff700 1 -- 172.21.15.96:0/1144041952 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9ac0095f0 con 0x7fb9b8100640 2023-05-08T03:41:23.162 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.065+0000 7fb9bcdf9700 1 --2- 172.21.15.96:0/1144041952 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9b81056e0 0x7fb9b8199fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-08T03:41:23.162 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.065+0000 7fb9b7fff700 1 --2- 172.21.15.96:0/1144041952 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9b8100640 0x7fb9b81966c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb9a800b530 tx=0x7fb9a800b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:23.162 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.066+0000 7fb9b57fa700 1 -- 172.21.15.96:0/1144041952 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a8011830 con 0x7fb9b8100640 2023-05-08T03:41:23.162 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.066+0000 7fb9be85c700 1 -- 172.21.15.96:0/1144041952 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9b81104f0 con 0x7fb9b8100640 2023-05-08T03:41:23.162 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.066+0000 7fb9b57fa700 1 -- 172.21.15.96:0/1144041952 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb9a8011e50 con 0x7fb9b8100640 2023-05-08T03:41:23.162 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.066+0000 7fb9b57fa700 1 -- 172.21.15.96:0/1144041952 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a800f2e0 con 0x7fb9b8100640 2023-05-08T03:41:23.163 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.066+0000 7fb9be85c700 1 -- 172.21.15.96:0/1144041952 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9b8110360 con 0x7fb9b8100640 2023-05-08T03:41:23.163 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.067+0000 7fb9be85c700 1 -- 172.21.15.96:0/1144041952 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9b8110680 con 0x7fb9b8100640 2023-05-08T03:41:23.163 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.068+0000 7fb9b57fa700 1 -- 172.21.15.96:0/1144041952 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fb9a8010580 con 0x7fb9b8100640 2023-05-08T03:41:23.163 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.069+0000 7fb9b57fa700 1 --2- 172.21.15.96:0/1144041952 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fb9a00a11e0 0x7fb9a00a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:23.163 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.069+0000 7fb9b77fe700 1 --2- 172.21.15.96:0/1144041952 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fb9a00a11e0 0x7fb9a00a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:23.163 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.069+0000 7fb9b57fa700 1 -- 172.21.15.96:0/1144041952 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fb9a80cc8a0 con 0x7fb9b8100640 2023-05-08T03:41:23.163 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.069+0000 7fb9b77fe700 1 --2- 172.21.15.96:0/1144041952 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fb9a00a11e0 0x7fb9a00a3690 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac00b580 tx=0x7fb9ac000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:23.164 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.072+0000 7fb9b57fa700 1 -- 172.21.15.96:0/1144041952 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fb9a8096150 con 0x7fb9b8100640 2023-05-08T03:41:23.289 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.286+0000 7fb9be85c700 1 -- 172.21.15.96:0/1144041952 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) v1 -- 0x7fb9b8197af0 con 0x7fb9b8100640 2023-05-08T03:41:23.289 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.286+0000 7fb9b57fa700 1 -- 172.21.15.96:0/1144041952 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7fb9a8099770 con 0x7fb9b8100640 2023-05-08T03:41:23.289 INFO:teuthology.orchestra.run.smithi096.stdout:300647710743 2023-05-08T03:41:23.291 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.288+0000 7fb9be85c700 1 -- 172.21.15.96:0/1144041952 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fb9a00a11e0 msgr2=0x7fb9a00a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:23.291 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.289+0000 7fb9be85c700 1 --2- 172.21.15.96:0/1144041952 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fb9a00a11e0 0x7fb9a00a3690 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac00b580 tx=0x7fb9ac000bc0 comp rx=0 tx=0).stop 2023-05-08T03:41:23.291 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.289+0000 7fb9be85c700 1 -- 172.21.15.96:0/1144041952 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9b8100640 msgr2=0x7fb9b81966c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:23.291 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.289+0000 7fb9be85c700 1 --2- 172.21.15.96:0/1144041952 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9b8100640 0x7fb9b81966c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb9a800b530 tx=0x7fb9a800b8f0 comp rx=0 tx=0).stop 2023-05-08T03:41:23.292 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.289+0000 7fb9be85c700 1 -- 172.21.15.96:0/1144041952 shutdown_connections 2023-05-08T03:41:23.292 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.289+0000 7fb9be85c700 1 --2- 172.21.15.96:0/1144041952 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fb9a00a11e0 0x7fb9a00a3690 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:23.292 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.289+0000 7fb9be85c700 1 --2- 172.21.15.96:0/1144041952 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9b81056e0 0x7fb9b8199fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:23.292 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.289+0000 7fb9be85c700 1 --2- 172.21.15.96:0/1144041952 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9b8100640 0x7fb9b81966c0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:23.292 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.289+0000 7fb9be85c700 1 --2- 172.21.15.96:0/1144041952 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb9b8100fe0 0x7fb9b8196c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:23.292 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.289+0000 7fb9be85c700 1 -- 172.21.15.96:0/1144041952 >> 172.21.15.96:0/1144041952 conn(0x7fb9b80fbec0 msgr2=0x7fb9b80fc9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:23.293 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.289+0000 7fb9be85c700 1 -- 172.21.15.96:0/1144041952 shutdown_connections 2023-05-08T03:41:23.293 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.289+0000 7fb9be85c700 1 -- 172.21.15.96:0/1144041952 wait complete. 2023-05-08T03:41:23.785 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:23 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/1144041952' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-05-08T03:41:23.865 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.a/config 2023-05-08T03:41:23.880 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.878+0000 7f42eb6f9700 1 -- 172.21.15.96:0/1519197563 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42e4100470 msgr2=0x7f42e410c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:23.881 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.878+0000 7f42eb6f9700 1 --2- 172.21.15.96:0/1519197563 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42e4100470 0x7f42e410c100 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f42dc00b0d0 tx=0x7f42dc00b3e0 comp rx=0 tx=0).stop 2023-05-08T03:41:23.881 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.878+0000 7f42eb6f9700 1 -- 172.21.15.96:0/1519197563 shutdown_connections 2023-05-08T03:41:23.882 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.878+0000 7f42eb6f9700 1 --2- 172.21.15.96:0/1519197563 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42e4100470 0x7f42e410c100 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:23.882 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.878+0000 7f42eb6f9700 1 --2- 172.21.15.96:0/1519197563 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42e4104280 0x7f42e4104650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:23.882 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.878+0000 7f42eb6f9700 1 --2- 172.21.15.96:0/1519197563 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f42e40ffac0 0x7f42e40fff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:23.882 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.878+0000 7f42eb6f9700 1 -- 172.21.15.96:0/1519197563 >> 172.21.15.96:0/1519197563 conn(0x7f42e40759a0 msgr2=0x7f42e4075da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:23.885 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.878+0000 7f42eb6f9700 1 -- 172.21.15.96:0/1519197563 shutdown_connections 2023-05-08T03:41:23.886 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.878+0000 7f42eb6f9700 1 -- 172.21.15.96:0/1519197563 wait complete. 2023-05-08T03:41:23.886 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.879+0000 7f42eb6f9700 1 Processor -- start 2023-05-08T03:41:23.886 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.879+0000 7f42eb6f9700 1 -- start start 2023-05-08T03:41:23.887 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.879+0000 7f42eb6f9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42e40ffac0 0x7f42e4197460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:23.887 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.879+0000 7f42eb6f9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42e4100470 0x7f42e41979a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:23.887 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.879+0000 7f42eb6f9700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f42e4104280 0x7f42e41a24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:23.888 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.879+0000 7f42eb6f9700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e41a2a20 con 0x7f42e40ffac0 2023-05-08T03:41:23.888 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.879+0000 7f42eb6f9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e41a2b60 con 0x7f42e4100470 2023-05-08T03:41:23.888 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.879+0000 7f42eb6f9700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e41a2ca0 con 0x7f42e4104280 2023-05-08T03:41:23.888 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.880+0000 7f42e9495700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42e40ffac0 0x7f42e4197460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:23.889 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.880+0000 7f42e9495700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42e40ffac0 0x7f42e4197460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40890/0 (socket says 172.21.15.96:40890) 2023-05-08T03:41:23.889 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.880+0000 7f42e9495700 1 -- 172.21.15.96:0/1148672598 learned_addr learned my addr 172.21.15.96:0/1148672598 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:41:23.889 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.880+0000 7f42e8c94700 1 --2- 172.21.15.96:0/1148672598 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42e4100470 0x7f42e41979a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:23.890 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.880+0000 7f42e9c96700 1 --2- 172.21.15.96:0/1148672598 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f42e4104280 0x7f42e41a24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:23.890 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.880+0000 7f42e9495700 1 -- 172.21.15.96:0/1148672598 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f42e4104280 msgr2=0x7f42e41a24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:23.890 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.880+0000 7f42e9495700 1 --2- 172.21.15.96:0/1148672598 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f42e4104280 0x7f42e41a24e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:23.891 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.880+0000 7f42e9495700 1 -- 172.21.15.96:0/1148672598 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42e4100470 msgr2=0x7f42e41979a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:23.891 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.880+0000 7f42e9495700 1 --2- 172.21.15.96:0/1148672598 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42e4100470 0x7f42e41979a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:23.891 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.880+0000 7f42e9495700 1 -- 172.21.15.96:0/1148672598 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42dc009d00 con 0x7f42e40ffac0 2023-05-08T03:41:23.891 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.880+0000 7f42e9c96700 1 --2- 172.21.15.96:0/1148672598 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f42e4104280 0x7f42e41a24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-08T03:41:23.892 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.880+0000 7f42e9495700 1 --2- 172.21.15.96:0/1148672598 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42e40ffac0 0x7f42e4197460 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f42e000e9a0 tx=0x7f42e000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:23.892 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.880+0000 7f42da7fc700 1 -- 172.21.15.96:0/1148672598 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e0009790 con 0x7f42e40ffac0 2023-05-08T03:41:23.892 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.880+0000 7f42da7fc700 1 -- 172.21.15.96:0/1148672598 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f42e000cbd0 con 0x7f42e40ffac0 2023-05-08T03:41:23.892 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.880+0000 7f42da7fc700 1 -- 172.21.15.96:0/1148672598 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e0018680 con 0x7f42e40ffac0 2023-05-08T03:41:23.893 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.880+0000 7f42eb6f9700 1 -- 172.21.15.96:0/1148672598 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42e410f440 con 0x7f42e40ffac0 2023-05-08T03:41:23.893 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.880+0000 7f42eb6f9700 1 -- 172.21.15.96:0/1148672598 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42e410f2b0 con 0x7f42e40ffac0 2023-05-08T03:41:23.893 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.881+0000 7f42eb6f9700 1 -- 172.21.15.96:0/1148672598 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42e410f5d0 con 0x7f42e40ffac0 2023-05-08T03:41:23.893 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.883+0000 7f42da7fc700 1 -- 172.21.15.96:0/1148672598 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f42e000cd40 con 0x7f42e40ffac0 2023-05-08T03:41:23.894 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.883+0000 7f42da7fc700 1 --2- 172.21.15.96:0/1148672598 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f42d00a11e0 0x7f42d00a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:23.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.883+0000 7f42e8c94700 1 --2- 172.21.15.96:0/1148672598 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f42d00a11e0 0x7f42d00a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:23.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.883+0000 7f42da7fc700 1 -- 172.21.15.96:0/1148672598 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f42e0014070 con 0x7f42e40ffac0 2023-05-08T03:41:23.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.884+0000 7f42e8c94700 1 --2- 172.21.15.96:0/1148672598 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f42d00a11e0 0x7f42d00a3690 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f42e40ffa90 tx=0x7f42d4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:23.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:23.887+0000 7f42da7fc700 1 -- 172.21.15.96:0/1148672598 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f42e00967a0 con 0x7f42e40ffac0 2023-05-08T03:41:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:23 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/1144041952' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-05-08T03:41:24.064 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.a/config 2023-05-08T03:41:24.096 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:24.094+0000 7f42eb6f9700 1 -- 172.21.15.96:0/1148672598 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) v1 -- 0x7f42e4066fa0 con 0x7f42e40ffac0 2023-05-08T03:41:24.097 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:24.094+0000 7f42da7fc700 1 -- 172.21.15.96:0/1148672598 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f42e0099dc0 con 0x7f42e40ffac0 2023-05-08T03:41:24.098 INFO:teuthology.orchestra.run.smithi096.stdout:279172874267 2023-05-08T03:41:24.099 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:24.097+0000 7f42eb6f9700 1 -- 172.21.15.96:0/1148672598 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f42d00a11e0 msgr2=0x7f42d00a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:24.100 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:24.097+0000 7f42eb6f9700 1 --2- 172.21.15.96:0/1148672598 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f42d00a11e0 0x7f42d00a3690 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f42e40ffa90 tx=0x7f42d4009260 comp rx=0 tx=0).stop 2023-05-08T03:41:24.100 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:24.097+0000 7f42eb6f9700 1 -- 172.21.15.96:0/1148672598 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42e40ffac0 msgr2=0x7f42e4197460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:24.100 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:24.097+0000 7f42eb6f9700 1 --2- 172.21.15.96:0/1148672598 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42e40ffac0 0x7f42e4197460 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f42e000e9a0 tx=0x7f42e000ed60 comp rx=0 tx=0).stop 2023-05-08T03:41:24.100 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:24.097+0000 7f42eb6f9700 1 -- 172.21.15.96:0/1148672598 shutdown_connections 2023-05-08T03:41:24.100 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:24.097+0000 7f42eb6f9700 1 --2- 172.21.15.96:0/1148672598 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f42d00a11e0 0x7f42d00a3690 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:24.100 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:24.097+0000 7f42eb6f9700 1 --2- 172.21.15.96:0/1148672598 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f42e4104280 0x7f42e41a24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:24.101 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:24.097+0000 7f42eb6f9700 1 --2- 172.21.15.96:0/1148672598 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42e40ffac0 0x7f42e4197460 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:24.101 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:24.097+0000 7f42eb6f9700 1 --2- 172.21.15.96:0/1148672598 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42e4100470 0x7f42e41979a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:24.101 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:24.097+0000 7f42eb6f9700 1 -- 172.21.15.96:0/1148672598 >> 172.21.15.96:0/1148672598 conn(0x7f42e40759a0 msgr2=0x7f42e40fc400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:24.101 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:24.097+0000 7f42eb6f9700 1 -- 172.21.15.96:0/1148672598 shutdown_connections 2023-05-08T03:41:24.101 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:24.097+0000 7f42eb6f9700 1 -- 172.21.15.96:0/1148672598 wait complete. 2023-05-08T03:41:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:23 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/1144041952' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-05-08T03:41:24.442 INFO:tasks.cephadm.ceph_manager.ceph:need seq 300647710741 got 300647710743 for osd.10 2023-05-08T03:41:24.443 DEBUG:teuthology.parallel:result is None 2023-05-08T03:41:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:24 smithi096 ceph-mon[124666]: pgmap v275: 97 pgs: 97 active+clean; 634 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 341 B/s wr, 5 op/s 2023-05-08T03:41:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:24 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/1148672598' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-05-08T03:41:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:24 smithi133 ceph-mon[125939]: pgmap v275: 97 pgs: 97 active+clean; 634 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 341 B/s wr, 5 op/s 2023-05-08T03:41:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:24 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/1148672598' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-05-08T03:41:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:24 smithi186 ceph-mon[126480]: pgmap v275: 97 pgs: 97 active+clean; 634 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 341 B/s wr, 5 op/s 2023-05-08T03:41:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:24 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/1148672598' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-05-08T03:41:25.192 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:25.189+0000 7ff0f2738700 1 -- 172.21.15.96:0/448680062 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0ec1007e0 msgr2=0x7ff0ec100bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:25.193 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:25.189+0000 7ff0f2738700 1 --2- 172.21.15.96:0/448680062 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0ec1007e0 0x7ff0ec100bb0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc009990 tx=0x7ff0dc009ca0 comp rx=0 tx=0).stop 2023-05-08T03:41:25.193 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:25.189+0000 7ff0f2738700 1 -- 172.21.15.96:0/448680062 shutdown_connections 2023-05-08T03:41:25.193 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:25.189+0000 7ff0f2738700 1 --2- 172.21.15.96:0/448680062 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0ec109d90 0x7ff0ec10c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:25.193 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:25.189+0000 7ff0f2738700 1 --2- 172.21.15.96:0/448680062 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0ec1007e0 0x7ff0ec100bb0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:25.193 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:25.189+0000 7ff0f2738700 1 --2- 172.21.15.96:0/448680062 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff0ec1010f0 0x7ff0ec109850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:25.194 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:25.189+0000 7ff0f2738700 1 -- 172.21.15.96:0/448680062 >> 172.21.15.96:0/448680062 conn(0x7ff0ec074c00 msgr2=0x7ff0ec075000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:25.194 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:25.190+0000 7ff0f2738700 1 -- 172.21.15.96:0/448680062 shutdown_connections 2023-05-08T03:41:25.194 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:25.190+0000 7ff0f2738700 1 -- 172.21.15.96:0/448680062 wait complete. 2023-05-08T03:41:25.194 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:25.190+0000 7ff0f2738700 1 Processor -- start 2023-05-08T03:41:25.194 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:25.190+0000 7ff0f2738700 1 -- start start 2023-05-08T03:41:25.195 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:25.191+0000 7ff0f2738700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff0ec1007e0 0x7ff0ec1972f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:25.196 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:25.191+0000 7ff0f2738700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0ec1010f0 0x7ff0ec197830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:25.196 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:25.191+0000 7ff0f2738700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0ec109d90 0x7ff0ec1a2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:25.196 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:25.191+0000 7ff0f2738700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ec198170 con 0x7ff0ec1010f0 2023-05-08T03:41:25.196 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:25.191+0000 7ff0f2738700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ec1a28b0 con 0x7ff0ec109d90 2023-05-08T03:41:25.196 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:25.191+0000 7ff0f2738700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ec1a2a70 con 0x7ff0ec1007e0 2023-05-08T03:41:25.196 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:25.191+0000 7ff0eb7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0ec1010f0 0x7ff0ec197830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:25.196 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:25.191+0000 7ff0ebfff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff0ec1007e0 0x7ff0ec1972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:25.197 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:25.191+0000 7ff0eb7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0ec1010f0 0x7ff0ec197830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40902/0 (socket says 172.21.15.96:40902) 2023-05-08T03:41:25.197 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:25.191+0000 7ff0eb7fe700 1 -- 172.21.15.96:0/2789123511 learned_addr learned my addr 172.21.15.96:0/2789123511 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:41:25.197 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:25.191+0000 7ff0f0cd5700 1 --2- 172.21.15.96:0/2789123511 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0ec109d90 0x7ff0ec1a2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:25.197 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:25.191+0000 7ff0eb7fe700 1 -- 172.21.15.96:0/2789123511 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff0ec1007e0 msgr2=0x7ff0ec1972f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:25.197 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:25.191+0000 7ff0eb7fe700 1 --2- 172.21.15.96:0/2789123511 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff0ec1007e0 0x7ff0ec1972f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:25.197 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:25.191+0000 7ff0eb7fe700 1 -- 172.21.15.96:0/2789123511 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0ec109d90 msgr2=0x7ff0ec1a2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:25.198 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:25.191+0000 7ff0eb7fe700 1 --2- 172.21.15.96:0/2789123511 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0ec109d90 0x7ff0ec1a2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:25.198 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:25.191+0000 7ff0eb7fe700 1 -- 172.21.15.96:0/2789123511 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0dc0095f0 con 0x7ff0ec1010f0 2023-05-08T03:41:25.198 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:25.191+0000 7ff0f0cd5700 1 --2- 172.21.15.96:0/2789123511 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0ec109d90 0x7ff0ec1a2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-08T03:41:25.199 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:25.191+0000 7ff0eb7fe700 1 --2- 172.21.15.96:0/2789123511 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0ec1010f0 0x7ff0ec197830 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff0e000d950 tx=0x7ff0e000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:25.199 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:25.192+0000 7ff0e97fa700 1 -- 172.21.15.96:0/2789123511 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e0009940 con 0x7ff0ec1010f0 2023-05-08T03:41:25.199 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:25.192+0000 7ff0f2738700 1 -- 172.21.15.96:0/2789123511 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0ec10f3a0 con 0x7ff0ec1010f0 2023-05-08T03:41:25.199 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:25.192+0000 7ff0e97fa700 1 -- 172.21.15.96:0/2789123511 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff0e0010460 con 0x7ff0ec1010f0 2023-05-08T03:41:25.199 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:25.192+0000 7ff0e97fa700 1 -- 172.21.15.96:0/2789123511 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e000f620 con 0x7ff0ec1010f0 2023-05-08T03:41:25.199 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:25.192+0000 7ff0f2738700 1 -- 172.21.15.96:0/2789123511 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0ec10f210 con 0x7ff0ec1010f0 2023-05-08T03:41:25.199 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:25.193+0000 7ff0f2738700 1 -- 172.21.15.96:0/2789123511 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0ec10f530 con 0x7ff0ec1010f0 2023-05-08T03:41:25.200 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:25.194+0000 7ff0e97fa700 1 -- 172.21.15.96:0/2789123511 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7ff0e00108d0 con 0x7ff0ec1010f0 2023-05-08T03:41:25.200 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:25.194+0000 7ff0e97fa700 1 --2- 172.21.15.96:0/2789123511 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7ff0d40a11e0 0x7ff0d40a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:25.200 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:25.194+0000 7ff0ebfff700 1 --2- 172.21.15.96:0/2789123511 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7ff0d40a11e0 0x7ff0d40a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:25.200 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:25.194+0000 7ff0e97fa700 1 -- 172.21.15.96:0/2789123511 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7ff0e00cc710 con 0x7ff0ec1010f0 2023-05-08T03:41:25.201 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:25.195+0000 7ff0ebfff700 1 --2- 172.21.15.96:0/2789123511 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7ff0d40a11e0 0x7ff0d40a3690 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc00b5c0 tx=0x7ff0dc005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:25.201 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:25.198+0000 7ff0e97fa700 1 -- 172.21.15.96:0/2789123511 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7ff0e0095eb0 con 0x7ff0ec1010f0 2023-05-08T03:41:25.402 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:25.400+0000 7ff0f2738700 1 -- 172.21.15.96:0/2789123511 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) v1 -- 0x7ff0ec1046b0 con 0x7ff0ec1010f0 2023-05-08T03:41:25.403 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:25.400+0000 7ff0e97fa700 1 -- 172.21.15.96:0/2789123511 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7ff0e0016090 con 0x7ff0ec1010f0 2023-05-08T03:41:25.403 INFO:teuthology.orchestra.run.smithi096.stdout:330712481810 2023-05-08T03:41:25.405 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:25.402+0000 7ff0f2738700 1 -- 172.21.15.96:0/2789123511 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7ff0d40a11e0 msgr2=0x7ff0d40a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:25.405 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:25.402+0000 7ff0f2738700 1 --2- 172.21.15.96:0/2789123511 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7ff0d40a11e0 0x7ff0d40a3690 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc00b5c0 tx=0x7ff0dc005960 comp rx=0 tx=0).stop 2023-05-08T03:41:25.405 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:25.402+0000 7ff0f2738700 1 -- 172.21.15.96:0/2789123511 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0ec1010f0 msgr2=0x7ff0ec197830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:25.405 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:25.402+0000 7ff0f2738700 1 --2- 172.21.15.96:0/2789123511 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0ec1010f0 0x7ff0ec197830 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff0e000d950 tx=0x7ff0e000dc60 comp rx=0 tx=0).stop 2023-05-08T03:41:25.406 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:25.402+0000 7ff0f2738700 1 -- 172.21.15.96:0/2789123511 shutdown_connections 2023-05-08T03:41:25.406 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:25.402+0000 7ff0f2738700 1 --2- 172.21.15.96:0/2789123511 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7ff0d40a11e0 0x7ff0d40a3690 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:25.406 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:25.402+0000 7ff0f2738700 1 --2- 172.21.15.96:0/2789123511 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0ec109d90 0x7ff0ec1a2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:25.406 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:25.402+0000 7ff0f2738700 1 --2- 172.21.15.96:0/2789123511 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff0ec1007e0 0x7ff0ec1972f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:25.406 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:25.402+0000 7ff0f2738700 1 --2- 172.21.15.96:0/2789123511 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0ec1010f0 0x7ff0ec197830 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:25.406 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:25.402+0000 7ff0f2738700 1 -- 172.21.15.96:0/2789123511 >> 172.21.15.96:0/2789123511 conn(0x7ff0ec074c00 msgr2=0x7ff0ec1017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:25.406 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:25.402+0000 7ff0f2738700 1 -- 172.21.15.96:0/2789123511 shutdown_connections 2023-05-08T03:41:25.407 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:25.402+0000 7ff0f2738700 1 -- 172.21.15.96:0/2789123511 wait complete. 2023-05-08T03:41:25.887 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:25 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/2789123511' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-05-08T03:41:25.931 INFO:tasks.cephadm.ceph_manager.ceph:need seq 279172874266 got 279172874267 for osd.9 2023-05-08T03:41:25.931 DEBUG:teuthology.parallel:result is None 2023-05-08T03:41:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:25 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/2789123511' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-05-08T03:41:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:25 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/2789123511' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-05-08T03:41:26.448 INFO:tasks.cephadm.ceph_manager.ceph:need seq 330712481808 got 330712481810 for osd.11 2023-05-08T03:41:26.449 DEBUG:teuthology.parallel:result is None 2023-05-08T03:41:26.607 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.604+0000 7fa5e4998700 1 -- 172.21.15.96:0/3339584211 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5e0100fe0 msgr2=0x7fa5e0104fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:26.607 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.604+0000 7fa5e4998700 1 --2- 172.21.15.96:0/3339584211 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5e0100fe0 0x7fa5e0104fb0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa5d00099c0 tx=0x7fa5d0009cd0 comp rx=0 tx=0).stop 2023-05-08T03:41:26.607 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.604+0000 7fa5e4998700 1 -- 172.21.15.96:0/3339584211 shutdown_connections 2023-05-08T03:41:26.608 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.604+0000 7fa5e4998700 1 --2- 172.21.15.96:0/3339584211 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5e01056e0 0x7fa5e010d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:26.608 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.604+0000 7fa5e4998700 1 --2- 172.21.15.96:0/3339584211 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa5e0100640 0x7fa5e0100a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:26.608 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.604+0000 7fa5e4998700 1 --2- 172.21.15.96:0/3339584211 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5e0100fe0 0x7fa5e0104fb0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:26.608 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.604+0000 7fa5e4998700 1 -- 172.21.15.96:0/3339584211 >> 172.21.15.96:0/3339584211 conn(0x7fa5e00fbec0 msgr2=0x7fa5e00fe2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:26.608 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.604+0000 7fa5e4998700 1 -- 172.21.15.96:0/3339584211 shutdown_connections 2023-05-08T03:41:26.608 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.604+0000 7fa5e4998700 1 -- 172.21.15.96:0/3339584211 wait complete. 2023-05-08T03:41:26.610 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.605+0000 7fa5e4998700 1 Processor -- start 2023-05-08T03:41:26.610 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.605+0000 7fa5e4998700 1 -- start start 2023-05-08T03:41:26.610 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.606+0000 7fa5e4998700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa5e0100640 0x7fa5e01964a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:26.610 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.606+0000 7fa5e4998700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5e0100fe0 0x7fa5e01969e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:26.610 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.606+0000 7fa5e4998700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5e01056e0 0x7fa5e019ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:26.610 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.606+0000 7fa5e4998700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e019b460 con 0x7fa5e0100fe0 2023-05-08T03:41:26.611 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.606+0000 7fa5e4998700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e019b5d0 con 0x7fa5e01056e0 2023-05-08T03:41:26.611 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.606+0000 7fa5e4998700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e019b790 con 0x7fa5e0100640 2023-05-08T03:41:26.611 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.606+0000 7fa5ddd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5e0100fe0 0x7fa5e01969e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:26.611 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.606+0000 7fa5ddd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5e0100fe0 0x7fa5e01969e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40916/0 (socket says 172.21.15.96:40916) 2023-05-08T03:41:26.611 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.606+0000 7fa5ddd9b700 1 -- 172.21.15.96:0/3137180649 learned_addr learned my addr 172.21.15.96:0/3137180649 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:41:26.611 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.606+0000 7fa5de59c700 1 --2- 172.21.15.96:0/3137180649 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa5e0100640 0x7fa5e01964a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:26.611 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.606+0000 7fa5ded9d700 1 --2- 172.21.15.96:0/3137180649 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5e01056e0 0x7fa5e019ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:26.612 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.606+0000 7fa5ddd9b700 1 -- 172.21.15.96:0/3137180649 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa5e0100640 msgr2=0x7fa5e01964a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:26.612 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.606+0000 7fa5ddd9b700 1 --2- 172.21.15.96:0/3137180649 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa5e0100640 0x7fa5e01964a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:26.612 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.606+0000 7fa5ddd9b700 1 -- 172.21.15.96:0/3137180649 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5e01056e0 msgr2=0x7fa5e019ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:26.612 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.606+0000 7fa5ddd9b700 1 --2- 172.21.15.96:0/3137180649 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5e01056e0 0x7fa5e019ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:26.612 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.606+0000 7fa5ddd9b700 1 -- 172.21.15.96:0/3137180649 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5d00095f0 con 0x7fa5e0100fe0 2023-05-08T03:41:26.612 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.606+0000 7fa5ded9d700 1 --2- 172.21.15.96:0/3137180649 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5e01056e0 0x7fa5e019ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-08T03:41:26.612 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.606+0000 7fa5ddd9b700 1 --2- 172.21.15.96:0/3137180649 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5e0100fe0 0x7fa5e01969e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa5d000c010 tx=0x7fa5d0009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:26.613 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.606+0000 7fa5cf7fe700 1 -- 172.21.15.96:0/3137180649 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d001d070 con 0x7fa5e0100fe0 2023-05-08T03:41:26.613 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.607+0000 7fa5e4998700 1 -- 172.21.15.96:0/3137180649 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5e0110460 con 0x7fa5e0100fe0 2023-05-08T03:41:26.613 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.607+0000 7fa5e4998700 1 -- 172.21.15.96:0/3137180649 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5e01102d0 con 0x7fa5e0100fe0 2023-05-08T03:41:26.613 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.607+0000 7fa5cf7fe700 1 -- 172.21.15.96:0/3137180649 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa5d0004cd0 con 0x7fa5e0100fe0 2023-05-08T03:41:26.613 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.607+0000 7fa5cf7fe700 1 -- 172.21.15.96:0/3137180649 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d0005290 con 0x7fa5e0100fe0 2023-05-08T03:41:26.614 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.608+0000 7fa5e4998700 1 -- 172.21.15.96:0/3137180649 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5e01105f0 con 0x7fa5e0100fe0 2023-05-08T03:41:26.614 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.609+0000 7fa5cf7fe700 1 -- 172.21.15.96:0/3137180649 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fa5d0003b50 con 0x7fa5e0100fe0 2023-05-08T03:41:26.614 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.609+0000 7fa5cf7fe700 1 --2- 172.21.15.96:0/3137180649 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fa5c80a11e0 0x7fa5c80a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:26.614 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.610+0000 7fa5de59c700 1 --2- 172.21.15.96:0/3137180649 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fa5c80a11e0 0x7fa5c80a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:26.614 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.610+0000 7fa5cf7fe700 1 -- 172.21.15.96:0/3137180649 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fa5d00cd620 con 0x7fa5e0100fe0 2023-05-08T03:41:26.615 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.610+0000 7fa5de59c700 1 --2- 172.21.15.96:0/3137180649 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fa5c80a11e0 0x7fa5c80a3690 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa5d4005950 tx=0x7fa5d40058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:26.617 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.614+0000 7fa5cf7fe700 1 -- 172.21.15.96:0/3137180649 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fa5d0096e50 con 0x7fa5e0100fe0 2023-05-08T03:41:26.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:26 smithi096 ceph-mon[124666]: pgmap v276: 97 pgs: 97 active+clean; 634 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 341 B/s wr, 5 op/s 2023-05-08T03:41:26.760 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.757+0000 7fc4c1527700 1 -- 172.21.15.96:0/838689844 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4bc101f50 msgr2=0x7fc4bc10a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:26.760 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.757+0000 7fc4c1527700 1 --2- 172.21.15.96:0/838689844 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4bc101f50 0x7fc4bc10a450 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc4b0009990 tx=0x7fc4b0009ca0 comp rx=0 tx=0).stop 2023-05-08T03:41:26.760 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.757+0000 7fc4c1527700 1 -- 172.21.15.96:0/838689844 shutdown_connections 2023-05-08T03:41:26.760 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.757+0000 7fc4c1527700 1 --2- 172.21.15.96:0/838689844 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4bc10a990 0x7fc4bc10cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:26.761 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.757+0000 7fc4c1527700 1 --2- 172.21.15.96:0/838689844 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc4bc101640 0x7fc4bc101a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:26.761 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.757+0000 7fc4c1527700 1 --2- 172.21.15.96:0/838689844 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4bc101f50 0x7fc4bc10a450 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:26.761 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.757+0000 7fc4c1527700 1 -- 172.21.15.96:0/838689844 >> 172.21.15.96:0/838689844 conn(0x7fc4bc0771a0 msgr2=0x7fc4bc0775a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:26.761 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.757+0000 7fc4c1527700 1 -- 172.21.15.96:0/838689844 shutdown_connections 2023-05-08T03:41:26.761 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.757+0000 7fc4c1527700 1 -- 172.21.15.96:0/838689844 wait complete. 2023-05-08T03:41:26.762 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.758+0000 7fc4c1527700 1 Processor -- start 2023-05-08T03:41:26.763 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.758+0000 7fc4c1527700 1 -- start start 2023-05-08T03:41:26.764 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.758+0000 7fc4c1527700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc4bc101640 0x7fc4bc196560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:26.764 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.758+0000 7fc4c1527700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4bc101f50 0x7fc4bc196aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:26.764 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.758+0000 7fc4c1527700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4bc10a990 0x7fc4bc19af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:26.764 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.758+0000 7fc4c1527700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4bc19b520 con 0x7fc4bc101f50 2023-05-08T03:41:26.764 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.758+0000 7fc4c1527700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4bc19b690 con 0x7fc4bc10a990 2023-05-08T03:41:26.764 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.758+0000 7fc4c1527700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4bc19b850 con 0x7fc4bc101640 2023-05-08T03:41:26.765 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.758+0000 7fc4ba7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4bc101f50 0x7fc4bc196aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:26.765 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.758+0000 7fc4ba7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4bc101f50 0x7fc4bc196aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40930/0 (socket says 172.21.15.96:40930) 2023-05-08T03:41:26.765 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.758+0000 7fc4baffd700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc4bc101640 0x7fc4bc196560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:26.765 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.758+0000 7fc4ba7fc700 1 -- 172.21.15.96:0/3811314989 learned_addr learned my addr 172.21.15.96:0/3811314989 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:41:26.765 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.759+0000 7fc4bb7fe700 1 --2- 172.21.15.96:0/3811314989 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4bc10a990 0x7fc4bc19af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:26.765 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.759+0000 7fc4ba7fc700 1 -- 172.21.15.96:0/3811314989 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc4bc101640 msgr2=0x7fc4bc196560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:26.766 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.759+0000 7fc4ba7fc700 1 --2- 172.21.15.96:0/3811314989 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc4bc101640 0x7fc4bc196560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:26.766 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.759+0000 7fc4ba7fc700 1 -- 172.21.15.96:0/3811314989 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4bc10a990 msgr2=0x7fc4bc19af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:26.766 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.759+0000 7fc4ba7fc700 1 --2- 172.21.15.96:0/3811314989 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4bc10a990 0x7fc4bc19af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:26.766 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.759+0000 7fc4ba7fc700 1 -- 172.21.15.96:0/3811314989 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4b00095f0 con 0x7fc4bc101f50 2023-05-08T03:41:26.766 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.759+0000 7fc4bb7fe700 1 --2- 172.21.15.96:0/3811314989 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4bc10a990 0x7fc4bc19af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-08T03:41:26.767 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.759+0000 7fc4ba7fc700 1 --2- 172.21.15.96:0/3811314989 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4bc101f50 0x7fc4bc196aa0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc4b000f670 tx=0x7fc4b000f6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:26.767 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.759+0000 7fc4a3fff700 1 -- 172.21.15.96:0/3811314989 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b001d070 con 0x7fc4bc101f50 2023-05-08T03:41:26.767 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.759+0000 7fc4c1527700 1 -- 172.21.15.96:0/3811314989 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4bc110460 con 0x7fc4bc101f50 2023-05-08T03:41:26.767 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.759+0000 7fc4a3fff700 1 -- 172.21.15.96:0/3811314989 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc4b0003680 con 0x7fc4bc101f50 2023-05-08T03:41:26.767 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.759+0000 7fc4a3fff700 1 -- 172.21.15.96:0/3811314989 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b00056a0 con 0x7fc4bc101f50 2023-05-08T03:41:26.768 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.759+0000 7fc4c1527700 1 -- 172.21.15.96:0/3811314989 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4bc1102d0 con 0x7fc4bc101f50 2023-05-08T03:41:26.770 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.760+0000 7fc4c1527700 1 -- 172.21.15.96:0/3811314989 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4bc1105f0 con 0x7fc4bc101f50 2023-05-08T03:41:26.770 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.765+0000 7fc4a3fff700 1 -- 172.21.15.96:0/3811314989 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fc4b000fbc0 con 0x7fc4bc101f50 2023-05-08T03:41:26.770 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.766+0000 7fc4a3fff700 1 --2- 172.21.15.96:0/3811314989 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fc4a40a11e0 0x7fc4a40a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:26.770 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.766+0000 7fc4baffd700 1 --2- 172.21.15.96:0/3811314989 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fc4a40a11e0 0x7fc4a40a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:26.771 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.766+0000 7fc4a3fff700 1 -- 172.21.15.96:0/3811314989 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fc4b00cda40 con 0x7fc4bc101f50 2023-05-08T03:41:26.771 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.766+0000 7fc4baffd700 1 --2- 172.21.15.96:0/3811314989 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fc4a40a11e0 0x7fc4a40a3690 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac005950 tx=0x7fc4ac00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:26.771 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.769+0000 7fc4a3fff700 1 -- 172.21.15.96:0/3811314989 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fc4b0097270 con 0x7fc4bc101f50 2023-05-08T03:41:26.876 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.874+0000 7fa5e4998700 1 -- 172.21.15.96:0/3137180649 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa5e01a3520 con 0x7fa5e0100fe0 2023-05-08T03:41:26.877 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.874+0000 7fa5cf7fe700 1 -- 172.21.15.96:0/3137180649 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa5d009a470 con 0x7fa5e0100fe0 2023-05-08T03:41:26.877 INFO:teuthology.orchestra.run.smithi096.stdout:34359738436 2023-05-08T03:41:26.879 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.876+0000 7fa5e4998700 1 -- 172.21.15.96:0/3137180649 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fa5c80a11e0 msgr2=0x7fa5c80a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:26.879 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.876+0000 7fa5e4998700 1 --2- 172.21.15.96:0/3137180649 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fa5c80a11e0 0x7fa5c80a3690 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa5d4005950 tx=0x7fa5d40058e0 comp rx=0 tx=0).stop 2023-05-08T03:41:26.880 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.876+0000 7fa5e4998700 1 -- 172.21.15.96:0/3137180649 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5e0100fe0 msgr2=0x7fa5e01969e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:26.880 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.876+0000 7fa5e4998700 1 --2- 172.21.15.96:0/3137180649 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5e0100fe0 0x7fa5e01969e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa5d000c010 tx=0x7fa5d0009580 comp rx=0 tx=0).stop 2023-05-08T03:41:26.880 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.877+0000 7fa5e4998700 1 -- 172.21.15.96:0/3137180649 shutdown_connections 2023-05-08T03:41:26.880 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.877+0000 7fa5e4998700 1 --2- 172.21.15.96:0/3137180649 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fa5c80a11e0 0x7fa5c80a3690 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:26.880 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.877+0000 7fa5e4998700 1 --2- 172.21.15.96:0/3137180649 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5e01056e0 0x7fa5e019ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:26.880 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.877+0000 7fa5e4998700 1 --2- 172.21.15.96:0/3137180649 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa5e0100640 0x7fa5e01964a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:26.880 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.877+0000 7fa5e4998700 1 --2- 172.21.15.96:0/3137180649 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5e0100fe0 0x7fa5e01969e0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:26.881 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.877+0000 7fa5e4998700 1 -- 172.21.15.96:0/3137180649 >> 172.21.15.96:0/3137180649 conn(0x7fa5e00fbec0 msgr2=0x7fa5e00fc8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:26.881 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.877+0000 7fa5e4998700 1 -- 172.21.15.96:0/3137180649 shutdown_connections 2023-05-08T03:41:26.881 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:26.877+0000 7fa5e4998700 1 -- 172.21.15.96:0/3137180649 wait complete. 2023-05-08T03:41:26.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:26 smithi133 ceph-mon[125939]: pgmap v276: 97 pgs: 97 active+clean; 634 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 341 B/s wr, 5 op/s 2023-05-08T03:41:27.012 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.009+0000 7f09aeb98700 1 -- 172.21.15.96:0/2365430339 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09a8100640 msgr2=0x7f09a8103f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:27.012 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.009+0000 7f09aeb98700 1 --2- 172.21.15.96:0/2365430339 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09a8100640 0x7f09a8103f40 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f09940099c0 tx=0x7f0994009cd0 comp rx=0 tx=0).stop 2023-05-08T03:41:27.012 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.009+0000 7f09aeb98700 1 -- 172.21.15.96:0/2365430339 shutdown_connections 2023-05-08T03:41:27.013 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.009+0000 7f09aeb98700 1 --2- 172.21.15.96:0/2365430339 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f09a8104670 0x7f09a810c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:27.013 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.009+0000 7f09aeb98700 1 --2- 172.21.15.96:0/2365430339 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09a80ffca0 0x7f09a8100070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:27.013 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.009+0000 7f09aeb98700 1 --2- 172.21.15.96:0/2365430339 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09a8100640 0x7f09a8103f40 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:27.013 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.009+0000 7f09aeb98700 1 -- 172.21.15.96:0/2365430339 >> 172.21.15.96:0/2365430339 conn(0x7f09a80759a0 msgr2=0x7f09a8075da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:27.013 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.009+0000 7f09aeb98700 1 -- 172.21.15.96:0/2365430339 shutdown_connections 2023-05-08T03:41:27.013 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.009+0000 7f09aeb98700 1 -- 172.21.15.96:0/2365430339 wait complete. 2023-05-08T03:41:27.015 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.010+0000 7f09aeb98700 1 Processor -- start 2023-05-08T03:41:27.015 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.010+0000 7f09aeb98700 1 -- start start 2023-05-08T03:41:27.015 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.010+0000 7f09aeb98700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09a80ffca0 0x7f09a81953b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:27.015 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.010+0000 7f09aeb98700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f09a8100640 0x7f09a81958f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:27.015 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.010+0000 7f09aeb98700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09a8104670 0x7f09a8199d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:27.016 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.010+0000 7f09aeb98700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a819a370 con 0x7f09a8104670 2023-05-08T03:41:27.016 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.010+0000 7f09aeb98700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a819a4e0 con 0x7f09a80ffca0 2023-05-08T03:41:27.016 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.010+0000 7f09aeb98700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a819a6a0 con 0x7f09a8100640 2023-05-08T03:41:27.016 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.011+0000 7f09ad135700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09a8104670 0x7f09a8199d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:27.016 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.011+0000 7f09ad135700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09a8104670 0x7f09a8199d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40946/0 (socket says 172.21.15.96:40946) 2023-05-08T03:41:27.016 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.011+0000 7f09ad135700 1 -- 172.21.15.96:0/1443728678 learned_addr learned my addr 172.21.15.96:0/1443728678 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:41:27.016 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.011+0000 7f09ac934700 1 --2- 172.21.15.96:0/1443728678 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09a80ffca0 0x7f09a81953b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:27.017 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.011+0000 7f09a7fff700 1 --2- 172.21.15.96:0/1443728678 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f09a8100640 0x7f09a81958f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:27.017 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.011+0000 7f09ad135700 1 -- 172.21.15.96:0/1443728678 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f09a8100640 msgr2=0x7f09a81958f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:27.017 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.011+0000 7f09ad135700 1 --2- 172.21.15.96:0/1443728678 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f09a8100640 0x7f09a81958f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:27.017 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.011+0000 7f09ad135700 1 -- 172.21.15.96:0/1443728678 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09a80ffca0 msgr2=0x7f09a81953b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:27.017 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.011+0000 7f09ad135700 1 --2- 172.21.15.96:0/1443728678 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09a80ffca0 0x7f09a81953b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:27.017 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.011+0000 7f09ad135700 1 -- 172.21.15.96:0/1443728678 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09940095f0 con 0x7f09a8104670 2023-05-08T03:41:27.017 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.011+0000 7f09a7fff700 1 --2- 172.21.15.96:0/1443728678 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f09a8100640 0x7f09a81958f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-08T03:41:27.017 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.011+0000 7f09ad135700 1 --2- 172.21.15.96:0/1443728678 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09a8104670 0x7f09a8199d60 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f09a000cfb0 tx=0x7f09a000e330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:27.018 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.011+0000 7f09a5ffb700 1 -- 172.21.15.96:0/1443728678 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a0011070 con 0x7f09a8104670 2023-05-08T03:41:27.018 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.011+0000 7f09a5ffb700 1 -- 172.21.15.96:0/1443728678 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f09a0007b30 con 0x7f09a8104670 2023-05-08T03:41:27.018 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.011+0000 7f09aeb98700 1 -- 172.21.15.96:0/1443728678 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09a810f430 con 0x7f09a8104670 2023-05-08T03:41:27.018 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.011+0000 7f09a5ffb700 1 -- 172.21.15.96:0/1443728678 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a000adf0 con 0x7f09a8104670 2023-05-08T03:41:27.018 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.012+0000 7f09aeb98700 1 -- 172.21.15.96:0/1443728678 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09a810f2a0 con 0x7f09a8104670 2023-05-08T03:41:27.018 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.012+0000 7f09aeb98700 1 -- 172.21.15.96:0/1443728678 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09a810f5c0 con 0x7f09a8104670 2023-05-08T03:41:27.019 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.014+0000 7f09a5ffb700 1 -- 172.21.15.96:0/1443728678 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f09a000e980 con 0x7f09a8104670 2023-05-08T03:41:27.019 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.015+0000 7f09a5ffb700 1 --2- 172.21.15.96:0/1443728678 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f09980a11e0 0x7f09980a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:27.019 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.015+0000 7f09ac934700 1 --2- 172.21.15.96:0/1443728678 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f09980a11e0 0x7f09980a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:27.019 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.015+0000 7f09a5ffb700 1 -- 172.21.15.96:0/1443728678 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f09a00ce560 con 0x7f09a8104670 2023-05-08T03:41:27.020 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.015+0000 7f09ac934700 1 --2- 172.21.15.96:0/1443728678 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f09980a11e0 0x7f09980a3690 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f099c00ac50 tx=0x7f099c00a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:27.020 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.018+0000 7f09a5ffb700 1 -- 172.21.15.96:0/1443728678 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f09a0097c80 con 0x7f09a8104670 2023-05-08T03:41:27.028 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.025+0000 7fc4c1527700 1 -- 172.21.15.96:0/3811314989 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fc4bc0ff1d0 con 0x7fc4bc101f50 2023-05-08T03:41:27.029 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.026+0000 7fc4a3fff700 1 -- 172.21.15.96:0/3811314989 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc4b009a890 con 0x7fc4bc101f50 2023-05-08T03:41:27.029 INFO:teuthology.orchestra.run.smithi096.stdout:214748364836 2023-05-08T03:41:27.030 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.028+0000 7fc4c1527700 1 -- 172.21.15.96:0/3811314989 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fc4a40a11e0 msgr2=0x7fc4a40a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:27.031 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.028+0000 7fc4c1527700 1 --2- 172.21.15.96:0/3811314989 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fc4a40a11e0 0x7fc4a40a3690 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac005950 tx=0x7fc4ac00b410 comp rx=0 tx=0).stop 2023-05-08T03:41:27.031 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.028+0000 7fc4c1527700 1 -- 172.21.15.96:0/3811314989 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4bc101f50 msgr2=0x7fc4bc196aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:27.031 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.028+0000 7fc4c1527700 1 --2- 172.21.15.96:0/3811314989 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4bc101f50 0x7fc4bc196aa0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc4b000f670 tx=0x7fc4b000f6a0 comp rx=0 tx=0).stop 2023-05-08T03:41:27.031 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.a/config 2023-05-08T03:41:27.033 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.031+0000 7fc4c1527700 1 -- 172.21.15.96:0/3811314989 shutdown_connections 2023-05-08T03:41:27.034 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.031+0000 7fc4c1527700 1 --2- 172.21.15.96:0/3811314989 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fc4a40a11e0 0x7fc4a40a3690 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:27.034 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.031+0000 7fc4c1527700 1 --2- 172.21.15.96:0/3811314989 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4bc10a990 0x7fc4bc19af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:27.034 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.031+0000 7fc4c1527700 1 --2- 172.21.15.96:0/3811314989 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc4bc101640 0x7fc4bc196560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:27.035 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.031+0000 7fc4c1527700 1 --2- 172.21.15.96:0/3811314989 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4bc101f50 0x7fc4bc196aa0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:27.035 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.031+0000 7fc4c1527700 1 -- 172.21.15.96:0/3811314989 >> 172.21.15.96:0/3811314989 conn(0x7fc4bc0771a0 msgr2=0x7fc4bc0fbe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:27.035 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.031+0000 7fc4c1527700 1 -- 172.21.15.96:0/3811314989 shutdown_connections 2023-05-08T03:41:27.036 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.031+0000 7fc4c1527700 1 -- 172.21.15.96:0/3811314989 wait complete. 2023-05-08T03:41:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:26 smithi186 ceph-mon[126480]: pgmap v276: 97 pgs: 97 active+clean; 634 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 341 B/s wr, 5 op/s 2023-05-08T03:41:27.234 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.231+0000 7f09aeb98700 1 -- 172.21.15.96:0/1443728678 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f09a8196830 con 0x7f09a8104670 2023-05-08T03:41:27.234 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.231+0000 7f09a5ffb700 1 -- 172.21.15.96:0/1443728678 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f09a009b2a0 con 0x7f09a8104670 2023-05-08T03:41:27.235 INFO:teuthology.orchestra.run.smithi096.stdout:107374182454 2023-05-08T03:41:27.237 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.234+0000 7f09aeb98700 1 -- 172.21.15.96:0/1443728678 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f09980a11e0 msgr2=0x7f09980a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:27.237 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.234+0000 7f09aeb98700 1 --2- 172.21.15.96:0/1443728678 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f09980a11e0 0x7f09980a3690 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f099c00ac50 tx=0x7f099c00a380 comp rx=0 tx=0).stop 2023-05-08T03:41:27.237 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.234+0000 7f09aeb98700 1 -- 172.21.15.96:0/1443728678 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09a8104670 msgr2=0x7f09a8199d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:27.237 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.234+0000 7f09aeb98700 1 --2- 172.21.15.96:0/1443728678 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09a8104670 0x7f09a8199d60 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f09a000cfb0 tx=0x7f09a000e330 comp rx=0 tx=0).stop 2023-05-08T03:41:27.237 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.234+0000 7f09aeb98700 1 -- 172.21.15.96:0/1443728678 shutdown_connections 2023-05-08T03:41:27.237 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.234+0000 7f09aeb98700 1 --2- 172.21.15.96:0/1443728678 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f09980a11e0 0x7f09980a3690 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:27.238 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.234+0000 7f09aeb98700 1 --2- 172.21.15.96:0/1443728678 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09a8104670 0x7f09a8199d60 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:27.238 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.234+0000 7f09aeb98700 1 --2- 172.21.15.96:0/1443728678 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09a80ffca0 0x7f09a81953b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:27.238 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.234+0000 7f09aeb98700 1 --2- 172.21.15.96:0/1443728678 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f09a8100640 0x7f09a81958f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:27.238 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.234+0000 7f09aeb98700 1 -- 172.21.15.96:0/1443728678 >> 172.21.15.96:0/1443728678 conn(0x7f09a80759a0 msgr2=0x7f09a80fc4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:27.238 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.234+0000 7f09aeb98700 1 -- 172.21.15.96:0/1443728678 shutdown_connections 2023-05-08T03:41:27.238 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.234+0000 7f09aeb98700 1 -- 172.21.15.96:0/1443728678 wait complete. 2023-05-08T03:41:27.296 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.150+0000 7f4b85b79700 1 -- 172.21.15.96:0/700154250 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b8010a990 msgr2=0x7f4b8010cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:27.296 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.150+0000 7f4b85b79700 1 --2- 172.21.15.96:0/700154250 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b8010a990 0x7f4b8010cdd0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f4b7800b0a0 tx=0x7f4b7800b3b0 comp rx=0 tx=0).stop 2023-05-08T03:41:27.297 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.150+0000 7f4b85b79700 1 -- 172.21.15.96:0/700154250 shutdown_connections 2023-05-08T03:41:27.297 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.150+0000 7f4b85b79700 1 --2- 172.21.15.96:0/700154250 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b8010a990 0x7f4b8010cdd0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:27.297 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.150+0000 7f4b85b79700 1 --2- 172.21.15.96:0/700154250 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b80101640 0x7f4b80101a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:27.297 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.150+0000 7f4b85b79700 1 --2- 172.21.15.96:0/700154250 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4b80101f50 0x7f4b8010a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:27.298 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.150+0000 7f4b85b79700 1 -- 172.21.15.96:0/700154250 >> 172.21.15.96:0/700154250 conn(0x7f4b800771a0 msgr2=0x7f4b800775a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:27.298 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.150+0000 7f4b85b79700 1 -- 172.21.15.96:0/700154250 shutdown_connections 2023-05-08T03:41:27.298 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.150+0000 7f4b85b79700 1 -- 172.21.15.96:0/700154250 wait complete. 2023-05-08T03:41:27.298 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.150+0000 7f4b85b79700 1 Processor -- start 2023-05-08T03:41:27.299 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.151+0000 7f4b85b79700 1 -- start start 2023-05-08T03:41:27.299 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.151+0000 7f4b85b79700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b80101640 0x7f4b80196610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:27.299 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.151+0000 7f4b85b79700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4b80101f50 0x7f4b80196b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:27.299 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.151+0000 7f4b85b79700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b8010a990 0x7f4b8019afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:27.300 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.151+0000 7f4b85b79700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8019b5d0 con 0x7f4b8010a990 2023-05-08T03:41:27.300 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.151+0000 7f4b85b79700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8019b740 con 0x7f4b80101640 2023-05-08T03:41:27.300 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.151+0000 7f4b85b79700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8019b900 con 0x7f4b80101f50 2023-05-08T03:41:27.301 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.151+0000 7f4b7ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b8010a990 0x7f4b8019afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:27.301 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.151+0000 7f4b7ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b8010a990 0x7f4b8019afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40960/0 (socket says 172.21.15.96:40960) 2023-05-08T03:41:27.301 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.151+0000 7f4b7ffff700 1 -- 172.21.15.96:0/265944186 learned_addr learned my addr 172.21.15.96:0/265944186 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:41:27.301 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.151+0000 7f4b7f7fe700 1 --2- 172.21.15.96:0/265944186 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b80101640 0x7f4b80196610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:27.302 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.151+0000 7f4b7effd700 1 --2- 172.21.15.96:0/265944186 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4b80101f50 0x7f4b80196b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:27.302 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.151+0000 7f4b7ffff700 1 -- 172.21.15.96:0/265944186 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4b80101f50 msgr2=0x7f4b80196b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:27.302 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.151+0000 7f4b7ffff700 1 --2- 172.21.15.96:0/265944186 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4b80101f50 0x7f4b80196b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:27.302 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.151+0000 7f4b7ffff700 1 -- 172.21.15.96:0/265944186 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b80101640 msgr2=0x7f4b80196610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:27.303 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.151+0000 7f4b7ffff700 1 --2- 172.21.15.96:0/265944186 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b80101640 0x7f4b80196610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:27.303 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.151+0000 7f4b7ffff700 1 -- 172.21.15.96:0/265944186 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b78009d00 con 0x7f4b8010a990 2023-05-08T03:41:27.303 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.151+0000 7f4b7ffff700 1 --2- 172.21.15.96:0/265944186 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b8010a990 0x7f4b8019afc0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4b7800b780 tx=0x7f4b78007990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:27.303 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.152+0000 7f4b7cff9700 1 -- 172.21.15.96:0/265944186 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b7800e040 con 0x7f4b8010a990 2023-05-08T03:41:27.304 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.152+0000 7f4b7cff9700 1 -- 172.21.15.96:0/265944186 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4b7801d470 con 0x7f4b8010a990 2023-05-08T03:41:27.304 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.152+0000 7f4b85b79700 1 -- 172.21.15.96:0/265944186 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b80110400 con 0x7f4b8010a990 2023-05-08T03:41:27.304 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.152+0000 7f4b7cff9700 1 -- 172.21.15.96:0/265944186 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b780052a0 con 0x7f4b8010a990 2023-05-08T03:41:27.305 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.152+0000 7f4b85b79700 1 -- 172.21.15.96:0/265944186 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b80110270 con 0x7f4b8010a990 2023-05-08T03:41:27.305 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.153+0000 7f4b85b79700 1 -- 172.21.15.96:0/265944186 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b80110590 con 0x7f4b8010a990 2023-05-08T03:41:27.305 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.153+0000 7f4b7cff9700 1 -- 172.21.15.96:0/265944186 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f4b7801d5e0 con 0x7f4b8010a990 2023-05-08T03:41:27.305 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.154+0000 7f4b7cff9700 1 --2- 172.21.15.96:0/265944186 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f4b680a11e0 0x7f4b680a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:27.306 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.154+0000 7f4b7f7fe700 1 --2- 172.21.15.96:0/265944186 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f4b680a11e0 0x7f4b680a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:27.306 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.154+0000 7f4b7cff9700 1 -- 172.21.15.96:0/265944186 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f4b780cddf0 con 0x7f4b8010a990 2023-05-08T03:41:27.306 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.154+0000 7f4b7f7fe700 1 --2- 172.21.15.96:0/265944186 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f4b680a11e0 0x7f4b680a3690 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4b70009c60 tx=0x7f4b70009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:27.306 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.159+0000 7f4b7cff9700 1 -- 172.21.15.96:0/265944186 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f4b78097620 con 0x7f4b8010a990 2023-05-08T03:41:27.361 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.359+0000 7f4b85b79700 1 -- 172.21.15.96:0/265944186 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f4b80066fa0 con 0x7f4b8010a990 2023-05-08T03:41:27.361 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.359+0000 7f4b7cff9700 1 -- 172.21.15.96:0/265944186 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4b7809ac40 con 0x7f4b8010a990 2023-05-08T03:41:27.362 INFO:teuthology.orchestra.run.smithi096.stdout:193273528359 2023-05-08T03:41:27.363 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.361+0000 7f4b85b79700 1 -- 172.21.15.96:0/265944186 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f4b680a11e0 msgr2=0x7f4b680a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:27.364 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.361+0000 7f4b85b79700 1 --2- 172.21.15.96:0/265944186 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f4b680a11e0 0x7f4b680a3690 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4b70009c60 tx=0x7f4b70009260 comp rx=0 tx=0).stop 2023-05-08T03:41:27.364 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.361+0000 7f4b85b79700 1 -- 172.21.15.96:0/265944186 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b8010a990 msgr2=0x7f4b8019afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:27.364 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.361+0000 7f4b85b79700 1 --2- 172.21.15.96:0/265944186 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b8010a990 0x7f4b8019afc0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4b7800b780 tx=0x7f4b78007990 comp rx=0 tx=0).stop 2023-05-08T03:41:27.364 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.361+0000 7f4b85b79700 1 -- 172.21.15.96:0/265944186 shutdown_connections 2023-05-08T03:41:27.364 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.361+0000 7f4b85b79700 1 --2- 172.21.15.96:0/265944186 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f4b680a11e0 0x7f4b680a3690 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:27.364 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.361+0000 7f4b85b79700 1 --2- 172.21.15.96:0/265944186 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b8010a990 0x7f4b8019afc0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:27.364 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.361+0000 7f4b85b79700 1 --2- 172.21.15.96:0/265944186 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b80101640 0x7f4b80196610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:27.365 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.361+0000 7f4b85b79700 1 --2- 172.21.15.96:0/265944186 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4b80101f50 0x7f4b80196b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:27.365 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.361+0000 7f4b85b79700 1 -- 172.21.15.96:0/265944186 >> 172.21.15.96:0/265944186 conn(0x7f4b800771a0 msgr2=0x7f4b800fce90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:27.365 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.361+0000 7f4b85b79700 1 -- 172.21.15.96:0/265944186 shutdown_connections 2023-05-08T03:41:27.365 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.361+0000 7f4b85b79700 1 -- 172.21.15.96:0/265944186 wait complete. 2023-05-08T03:41:27.543 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738433 got 34359738436 for osd.0 2023-05-08T03:41:27.543 DEBUG:teuthology.parallel:result is None 2023-05-08T03:41:27.664 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:27 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/3137180649' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-05-08T03:41:27.664 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:27 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/3811314989' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-05-08T03:41:27.665 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:27 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/1443728678' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-05-08T03:41:27.665 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:27 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/265944186' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-05-08T03:41:27.980 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.977+0000 7fb0cdebf700 1 -- 172.21.15.96:0/1338576909 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0c810a990 msgr2=0x7fb0c810cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:27.980 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.977+0000 7fb0cdebf700 1 --2- 172.21.15.96:0/1338576909 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0c810a990 0x7fb0c810cdd0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb0b8009990 tx=0x7fb0b8009ca0 comp rx=0 tx=0).stop 2023-05-08T03:41:27.980 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.977+0000 7fb0cdebf700 1 -- 172.21.15.96:0/1338576909 shutdown_connections 2023-05-08T03:41:27.980 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.977+0000 7fb0cdebf700 1 --2- 172.21.15.96:0/1338576909 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0c810a990 0x7fb0c810cdd0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:27.981 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.977+0000 7fb0cdebf700 1 --2- 172.21.15.96:0/1338576909 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0c8101640 0x7fb0c8101a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:27.981 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.977+0000 7fb0cdebf700 1 --2- 172.21.15.96:0/1338576909 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb0c8101f50 0x7fb0c810a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:27.981 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.977+0000 7fb0cdebf700 1 -- 172.21.15.96:0/1338576909 >> 172.21.15.96:0/1338576909 conn(0x7fb0c80771a0 msgr2=0x7fb0c80775a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:27.981 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.977+0000 7fb0cdebf700 1 -- 172.21.15.96:0/1338576909 shutdown_connections 2023-05-08T03:41:27.981 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.977+0000 7fb0cdebf700 1 -- 172.21.15.96:0/1338576909 wait complete. 2023-05-08T03:41:27.984 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.978+0000 7fb0cdebf700 1 Processor -- start 2023-05-08T03:41:27.984 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.978+0000 7fb0cdebf700 1 -- start start 2023-05-08T03:41:27.984 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.979+0000 7fb0cdebf700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0c8101640 0x7fb0c8196480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:27.984 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.979+0000 7fb0cdebf700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0c8101f50 0x7fb0c81969c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:27.985 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.979+0000 7fb0cdebf700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb0c810a990 0x7fb0c819ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:27.985 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.979+0000 7fb0cdebf700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c819b440 con 0x7fb0c8101640 2023-05-08T03:41:27.985 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.979+0000 7fb0cdebf700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c819b5b0 con 0x7fb0c8101f50 2023-05-08T03:41:27.985 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.979+0000 7fb0cdebf700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c819b770 con 0x7fb0c810a990 2023-05-08T03:41:27.986 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.979+0000 7fb0c77fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0c8101640 0x7fb0c8196480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:27.986 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.979+0000 7fb0c77fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0c8101640 0x7fb0c8196480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40968/0 (socket says 172.21.15.96:40968) 2023-05-08T03:41:27.986 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.979+0000 7fb0c77fe700 1 -- 172.21.15.96:0/2879691190 learned_addr learned my addr 172.21.15.96:0/2879691190 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:41:27.986 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.979+0000 7fb0c6ffd700 1 --2- 172.21.15.96:0/2879691190 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0c8101f50 0x7fb0c81969c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:27.987 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.979+0000 7fb0c7fff700 1 --2- 172.21.15.96:0/2879691190 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb0c810a990 0x7fb0c819ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:27.987 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.979+0000 7fb0c77fe700 1 -- 172.21.15.96:0/2879691190 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb0c810a990 msgr2=0x7fb0c819ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:27.987 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.979+0000 7fb0c77fe700 1 --2- 172.21.15.96:0/2879691190 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb0c810a990 0x7fb0c819ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:27.987 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.979+0000 7fb0c77fe700 1 -- 172.21.15.96:0/2879691190 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0c8101f50 msgr2=0x7fb0c81969c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:27.988 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.979+0000 7fb0c77fe700 1 --2- 172.21.15.96:0/2879691190 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0c8101f50 0x7fb0c81969c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:27.988 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.979+0000 7fb0c77fe700 1 -- 172.21.15.96:0/2879691190 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0b80095f0 con 0x7fb0c8101640 2023-05-08T03:41:27.988 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.979+0000 7fb0c6ffd700 1 --2- 172.21.15.96:0/2879691190 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0c8101f50 0x7fb0c81969c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-08T03:41:27.989 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.979+0000 7fb0c77fe700 1 --2- 172.21.15.96:0/2879691190 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0c8101640 0x7fb0c8196480 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb0c0007f10 tx=0x7fb0c000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:27.989 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.979+0000 7fb0c4ff9700 1 -- 172.21.15.96:0/2879691190 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c000de90 con 0x7fb0c8101640 2023-05-08T03:41:27.989 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.979+0000 7fb0cdebf700 1 -- 172.21.15.96:0/2879691190 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0c8110400 con 0x7fb0c8101640 2023-05-08T03:41:27.990 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.980+0000 7fb0c4ff9700 1 -- 172.21.15.96:0/2879691190 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb0c000f040 con 0x7fb0c8101640 2023-05-08T03:41:27.990 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.980+0000 7fb0c4ff9700 1 -- 172.21.15.96:0/2879691190 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c0015400 con 0x7fb0c8101640 2023-05-08T03:41:27.990 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.980+0000 7fb0cdebf700 1 -- 172.21.15.96:0/2879691190 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0c8110270 con 0x7fb0c8101640 2023-05-08T03:41:27.990 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.981+0000 7fb0cdebf700 1 -- 172.21.15.96:0/2879691190 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0c8110590 con 0x7fb0c8101640 2023-05-08T03:41:27.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:27 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/3137180649' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-05-08T03:41:27.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:27 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/3811314989' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-05-08T03:41:27.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:27 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/1443728678' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-05-08T03:41:27.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:27 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/265944186' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-05-08T03:41:27.994 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.982+0000 7fb0c4ff9700 1 -- 172.21.15.96:0/2879691190 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fb0c0003a00 con 0x7fb0c8101640 2023-05-08T03:41:27.994 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.982+0000 7fb0c4ff9700 1 --2- 172.21.15.96:0/2879691190 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fb0b40a11e0 0x7fb0b40a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:27.994 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.982+0000 7fb0c6ffd700 1 --2- 172.21.15.96:0/2879691190 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fb0b40a11e0 0x7fb0b40a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:27.995 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.982+0000 7fb0c4ff9700 1 -- 172.21.15.96:0/2879691190 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fb0c00cc550 con 0x7fb0c8101640 2023-05-08T03:41:27.995 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.983+0000 7fb0c6ffd700 1 --2- 172.21.15.96:0/2879691190 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fb0b40a11e0 0x7fb0b40a3690 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0005e10 tx=0x7fb0b0005d60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:27.995 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:27.987+0000 7fb0c4ff9700 1 -- 172.21.15.96:0/2879691190 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fb0c0095cf0 con 0x7fb0c8101640 2023-05-08T03:41:27.996 INFO:tasks.cephadm.ceph_manager.ceph:need seq 193273528357 got 193273528359 for osd.6 2023-05-08T03:41:27.997 DEBUG:teuthology.parallel:result is None 2023-05-08T03:41:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:27 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/3137180649' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-05-08T03:41:28.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:27 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/3811314989' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-05-08T03:41:28.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:27 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/1443728678' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-05-08T03:41:28.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:27 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/265944186' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-05-08T03:41:28.183 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:28.180+0000 7fb0cdebf700 1 -- 172.21.15.96:0/2879691190 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fb0c8066fa0 con 0x7fb0c8101640 2023-05-08T03:41:28.183 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:28.180+0000 7fb0c4ff9700 1 -- 172.21.15.96:0/2879691190 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb0c0099310 con 0x7fb0c8101640 2023-05-08T03:41:28.183 INFO:teuthology.orchestra.run.smithi096.stdout:163208757293 2023-05-08T03:41:28.185 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:28.182+0000 7fb0cdebf700 1 -- 172.21.15.96:0/2879691190 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fb0b40a11e0 msgr2=0x7fb0b40a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:28.185 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:28.182+0000 7fb0cdebf700 1 --2- 172.21.15.96:0/2879691190 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fb0b40a11e0 0x7fb0b40a3690 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0005e10 tx=0x7fb0b0005d60 comp rx=0 tx=0).stop 2023-05-08T03:41:28.185 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:28.182+0000 7fb0cdebf700 1 -- 172.21.15.96:0/2879691190 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0c8101640 msgr2=0x7fb0c8196480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:28.185 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:28.182+0000 7fb0cdebf700 1 --2- 172.21.15.96:0/2879691190 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0c8101640 0x7fb0c8196480 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb0c0007f10 tx=0x7fb0c000d3b0 comp rx=0 tx=0).stop 2023-05-08T03:41:28.185 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:28.183+0000 7fb0cdebf700 1 -- 172.21.15.96:0/2879691190 shutdown_connections 2023-05-08T03:41:28.186 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:28.183+0000 7fb0cdebf700 1 --2- 172.21.15.96:0/2879691190 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fb0b40a11e0 0x7fb0b40a3690 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:28.186 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:28.183+0000 7fb0cdebf700 1 --2- 172.21.15.96:0/2879691190 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb0c810a990 0x7fb0c819ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:28.186 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:28.183+0000 7fb0cdebf700 1 --2- 172.21.15.96:0/2879691190 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0c8101640 0x7fb0c8196480 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:28.186 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:28.183+0000 7fb0cdebf700 1 --2- 172.21.15.96:0/2879691190 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0c8101f50 0x7fb0c81969c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:28.186 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:28.183+0000 7fb0cdebf700 1 -- 172.21.15.96:0/2879691190 >> 172.21.15.96:0/2879691190 conn(0x7fb0c80771a0 msgr2=0x7fb0c80fce90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:28.186 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:28.183+0000 7fb0cdebf700 1 -- 172.21.15.96:0/2879691190 shutdown_connections 2023-05-08T03:41:28.186 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:28.183+0000 7fb0cdebf700 1 -- 172.21.15.96:0/2879691190 wait complete. 2023-05-08T03:41:28.531 INFO:tasks.cephadm.ceph_manager.ceph:need seq 214748364834 got 214748364836 for osd.7 2023-05-08T03:41:28.532 DEBUG:teuthology.parallel:result is None 2023-05-08T03:41:28.533 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182451 got 107374182454 for osd.3 2023-05-08T03:41:28.533 DEBUG:teuthology.parallel:result is None 2023-05-08T03:41:28.634 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.a/config 2023-05-08T03:41:28.752 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:28.749+0000 7f3c0fb80700 1 -- 172.21.15.96:0/1912087578 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3c081056e0 msgr2=0x7f3c0810d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:28.752 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:28.749+0000 7f3c0fb80700 1 --2- 172.21.15.96:0/1912087578 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3c081056e0 0x7f3c0810d260 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f3c0000b0d0 tx=0x7f3c0000b3e0 comp rx=0 tx=0).stop 2023-05-08T03:41:28.752 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:28.749+0000 7f3c0fb80700 1 -- 172.21.15.96:0/1912087578 shutdown_connections 2023-05-08T03:41:28.752 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:28.749+0000 7f3c0fb80700 1 --2- 172.21.15.96:0/1912087578 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3c081056e0 0x7f3c0810d260 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:28.752 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:28.749+0000 7f3c0fb80700 1 --2- 172.21.15.96:0/1912087578 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3c08100640 0x7f3c08100a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:28.753 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:28.749+0000 7f3c0fb80700 1 --2- 172.21.15.96:0/1912087578 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c08100fe0 0x7f3c08104fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:28.753 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:28.749+0000 7f3c0fb80700 1 -- 172.21.15.96:0/1912087578 >> 172.21.15.96:0/1912087578 conn(0x7f3c080fbec0 msgr2=0x7f3c080fe2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:28.753 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:28.749+0000 7f3c0fb80700 1 -- 172.21.15.96:0/1912087578 shutdown_connections 2023-05-08T03:41:28.753 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:28.749+0000 7f3c0fb80700 1 -- 172.21.15.96:0/1912087578 wait complete. 2023-05-08T03:41:28.756 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:28.750+0000 7f3c0fb80700 1 Processor -- start 2023-05-08T03:41:28.756 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:28.750+0000 7f3c0fb80700 1 -- start start 2023-05-08T03:41:28.756 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:28.750+0000 7f3c0fb80700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c08100640 0x7f3c08196560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:28.756 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:28.750+0000 7f3c0fb80700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3c08100fe0 0x7f3c08196aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:28.757 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:28.750+0000 7f3c0fb80700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3c081056e0 0x7f3c0819af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:28.757 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:28.750+0000 7f3c0fb80700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0819b520 con 0x7f3c081056e0 2023-05-08T03:41:28.757 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:28.750+0000 7f3c0fb80700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0819b690 con 0x7f3c08100640 2023-05-08T03:41:28.757 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:28.750+0000 7f3c0fb80700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0819b850 con 0x7f3c08100fe0 2023-05-08T03:41:28.757 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:28.750+0000 7f3c0e11d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3c081056e0 0x7f3c0819af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:28.757 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:28.750+0000 7f3c0e11d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3c081056e0 0x7f3c0819af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40984/0 (socket says 172.21.15.96:40984) 2023-05-08T03:41:28.758 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:28.750+0000 7f3c0e11d700 1 -- 172.21.15.96:0/1897854796 learned_addr learned my addr 172.21.15.96:0/1897854796 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:41:28.758 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:28.750+0000 7f3c0d91c700 1 --2- 172.21.15.96:0/1897854796 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c08100640 0x7f3c08196560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:28.758 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:28.750+0000 7f3c0d11b700 1 --2- 172.21.15.96:0/1897854796 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3c08100fe0 0x7f3c08196aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:28.758 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:28.750+0000 7f3c0e11d700 1 -- 172.21.15.96:0/1897854796 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3c08100fe0 msgr2=0x7f3c08196aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:28.758 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:28.750+0000 7f3c0e11d700 1 --2- 172.21.15.96:0/1897854796 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3c08100fe0 0x7f3c08196aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:28.758 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:28.750+0000 7f3c0e11d700 1 -- 172.21.15.96:0/1897854796 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c08100640 msgr2=0x7f3c08196560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:28.759 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:28.750+0000 7f3c0e11d700 1 --2- 172.21.15.96:0/1897854796 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c08100640 0x7f3c08196560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:28.759 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:28.750+0000 7f3c0e11d700 1 -- 172.21.15.96:0/1897854796 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c00009d00 con 0x7f3c081056e0 2023-05-08T03:41:28.759 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:28.750+0000 7f3c0e11d700 1 --2- 172.21.15.96:0/1897854796 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3c081056e0 0x7f3c0819af10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3c00007940 tx=0x7f3c00007970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:28.759 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:28.751+0000 7f3bfeffd700 1 -- 172.21.15.96:0/1897854796 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c0000e040 con 0x7f3c081056e0 2023-05-08T03:41:28.759 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:28.751+0000 7f3bfeffd700 1 -- 172.21.15.96:0/1897854796 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3c00003e10 con 0x7f3c081056e0 2023-05-08T03:41:28.759 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:28.751+0000 7f3c0fb80700 1 -- 172.21.15.96:0/1897854796 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c081104a0 con 0x7f3c081056e0 2023-05-08T03:41:28.760 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:28.751+0000 7f3bfeffd700 1 -- 172.21.15.96:0/1897854796 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c00012a60 con 0x7f3c081056e0 2023-05-08T03:41:28.760 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:28.751+0000 7f3c0fb80700 1 -- 172.21.15.96:0/1897854796 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c08110310 con 0x7f3c081056e0 2023-05-08T03:41:28.760 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:28.751+0000 7f3c0fb80700 1 -- 172.21.15.96:0/1897854796 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c08110630 con 0x7f3c081056e0 2023-05-08T03:41:28.761 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:28.754+0000 7f3bfeffd700 1 -- 172.21.15.96:0/1897854796 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f3c00005730 con 0x7f3c081056e0 2023-05-08T03:41:28.761 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:28.754+0000 7f3bfeffd700 1 --2- 172.21.15.96:0/1897854796 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f3bf40a11e0 0x7f3bf40a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:28.761 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:28.754+0000 7f3c0d91c700 1 --2- 172.21.15.96:0/1897854796 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f3bf40a11e0 0x7f3bf40a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:28.761 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:28.754+0000 7f3bfeffd700 1 -- 172.21.15.96:0/1897854796 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f3c000ce810 con 0x7f3c081056e0 2023-05-08T03:41:28.761 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:28.755+0000 7f3c0d91c700 1 --2- 172.21.15.96:0/1897854796 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f3bf40a11e0 0x7f3bf40a3690 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3c04009a10 tx=0x7f3c04009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:28.762 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:28.758+0000 7f3bfeffd700 1 -- 172.21.15.96:0/1897854796 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f3c00098040 con 0x7f3c081056e0 2023-05-08T03:41:28.957 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:28.955+0000 7f3c0fb80700 1 -- 172.21.15.96:0/1897854796 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3c081a35e0 con 0x7f3c081056e0 2023-05-08T03:41:28.957 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:28.955+0000 7f3bfeffd700 1 -- 172.21.15.96:0/1897854796 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3c0009b660 con 0x7f3c081056e0 2023-05-08T03:41:28.958 INFO:teuthology.orchestra.run.smithi096.stdout:55834574912 2023-05-08T03:41:28.959 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:28.957+0000 7f3c0fb80700 1 -- 172.21.15.96:0/1897854796 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f3bf40a11e0 msgr2=0x7f3bf40a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:28.960 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:28.957+0000 7f3c0fb80700 1 --2- 172.21.15.96:0/1897854796 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f3bf40a11e0 0x7f3bf40a3690 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3c04009a10 tx=0x7f3c04009190 comp rx=0 tx=0).stop 2023-05-08T03:41:28.960 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:28.957+0000 7f3c0fb80700 1 -- 172.21.15.96:0/1897854796 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3c081056e0 msgr2=0x7f3c0819af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:28.960 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:28.957+0000 7f3c0fb80700 1 --2- 172.21.15.96:0/1897854796 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3c081056e0 0x7f3c0819af10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3c00007940 tx=0x7f3c00007970 comp rx=0 tx=0).stop 2023-05-08T03:41:28.960 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:28.957+0000 7f3c0fb80700 1 -- 172.21.15.96:0/1897854796 shutdown_connections 2023-05-08T03:41:28.960 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:28.957+0000 7f3c0fb80700 1 --2- 172.21.15.96:0/1897854796 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f3bf40a11e0 0x7f3bf40a3690 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:28.960 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:28.957+0000 7f3c0fb80700 1 --2- 172.21.15.96:0/1897854796 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3c081056e0 0x7f3c0819af10 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:28.961 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:28.957+0000 7f3c0fb80700 1 --2- 172.21.15.96:0/1897854796 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c08100640 0x7f3c08196560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:28.961 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:28.957+0000 7f3c0fb80700 1 --2- 172.21.15.96:0/1897854796 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3c08100fe0 0x7f3c08196aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:28.961 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:28.957+0000 7f3c0fb80700 1 -- 172.21.15.96:0/1897854796 >> 172.21.15.96:0/1897854796 conn(0x7f3c080fbec0 msgr2=0x7f3c080fc840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:28.961 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:28.957+0000 7f3c0fb80700 1 -- 172.21.15.96:0/1897854796 shutdown_connections 2023-05-08T03:41:28.961 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:28.957+0000 7f3c0fb80700 1 -- 172.21.15.96:0/1897854796 wait complete. 2023-05-08T03:41:28.986 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:28 smithi096 ceph-mon[124666]: pgmap v277: 97 pgs: 97 active+clean; 636 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 255 B/s wr, 6 op/s 2023-05-08T03:41:28.987 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:28 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/2879691190' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-05-08T03:41:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:28 smithi133 ceph-mon[125939]: pgmap v277: 97 pgs: 97 active+clean; 636 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 255 B/s wr, 6 op/s 2023-05-08T03:41:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:28 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/2879691190' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-05-08T03:41:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:28 smithi186 ceph-mon[126480]: pgmap v277: 97 pgs: 97 active+clean; 636 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 255 B/s wr, 6 op/s 2023-05-08T03:41:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:28 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/2879691190' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-05-08T03:41:29.162 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757291 got 163208757293 for osd.5 2023-05-08T03:41:29.162 DEBUG:teuthology.parallel:result is None 2023-05-08T03:41:29.424 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:29.421+0000 7f231e0c9700 1 -- 172.21.15.96:0/1094119426 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23180ff560 msgr2=0x7f23180ff930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:29.424 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:29.421+0000 7f231e0c9700 1 --2- 172.21.15.96:0/1094119426 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23180ff560 0x7f23180ff930 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f23080099c0 tx=0x7f2308009cd0 comp rx=0 tx=0).stop 2023-05-08T03:41:29.424 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:29.421+0000 7f231e0c9700 1 -- 172.21.15.96:0/1094119426 shutdown_connections 2023-05-08T03:41:29.425 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:29.421+0000 7f231e0c9700 1 --2- 172.21.15.96:0/1094119426 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2318104600 0x7f231810c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:29.425 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:29.421+0000 7f231e0c9700 1 --2- 172.21.15.96:0/1094119426 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23180ff560 0x7f23180ff930 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:29.425 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:29.421+0000 7f231e0c9700 1 --2- 172.21.15.96:0/1094119426 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f23180fff00 0x7f2318103ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:29.425 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:29.421+0000 7f231e0c9700 1 -- 172.21.15.96:0/1094119426 >> 172.21.15.96:0/1094119426 conn(0x7f23180771a0 msgr2=0x7f23180775a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:29.425 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:29.421+0000 7f231e0c9700 1 -- 172.21.15.96:0/1094119426 shutdown_connections 2023-05-08T03:41:29.425 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:29.421+0000 7f231e0c9700 1 -- 172.21.15.96:0/1094119426 wait complete. 2023-05-08T03:41:29.426 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:29.422+0000 7f231e0c9700 1 Processor -- start 2023-05-08T03:41:29.426 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:29.422+0000 7f231e0c9700 1 -- start start 2023-05-08T03:41:29.427 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:29.422+0000 7f231e0c9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23180ff560 0x7f23181964f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:29.427 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:29.422+0000 7f231e0c9700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f23180fff00 0x7f2318196a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:29.428 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:29.422+0000 7f231e0c9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2318104600 0x7f231819aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:29.428 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:29.422+0000 7f231e0c9700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f231819b4b0 con 0x7f23180ff560 2023-05-08T03:41:29.428 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:29.422+0000 7f231e0c9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f231819b620 con 0x7f2318104600 2023-05-08T03:41:29.428 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:29.422+0000 7f231e0c9700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f231819b7e0 con 0x7f23180fff00 2023-05-08T03:41:29.428 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:29.422+0000 7f2317fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2318104600 0x7f231819aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:29.428 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:29.422+0000 7f2317fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2318104600 0x7f231819aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.96:37460/0 (socket says 172.21.15.96:37460) 2023-05-08T03:41:29.429 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:29.422+0000 7f2317fff700 1 -- 172.21.15.96:0/4289598056 learned_addr learned my addr 172.21.15.96:0/4289598056 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:41:29.429 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:29.422+0000 7f230ffff700 1 --2- 172.21.15.96:0/4289598056 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f23180fff00 0x7f2318196a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:29.429 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:29.422+0000 7f23177fe700 1 --2- 172.21.15.96:0/4289598056 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23180ff560 0x7f23181964f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:29.429 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:29.422+0000 7f2317fff700 1 -- 172.21.15.96:0/4289598056 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f23180fff00 msgr2=0x7f2318196a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:29.429 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:29.422+0000 7f2317fff700 1 --2- 172.21.15.96:0/4289598056 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f23180fff00 0x7f2318196a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:29.429 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:29.422+0000 7f2317fff700 1 -- 172.21.15.96:0/4289598056 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23180ff560 msgr2=0x7f23181964f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:29.429 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:29.422+0000 7f2317fff700 1 --2- 172.21.15.96:0/4289598056 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23180ff560 0x7f23181964f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:29.430 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:29.422+0000 7f2317fff700 1 -- 172.21.15.96:0/4289598056 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23080095f0 con 0x7f2318104600 2023-05-08T03:41:29.430 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:29.422+0000 7f23177fe700 1 --2- 172.21.15.96:0/4289598056 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23180ff560 0x7f23181964f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-08T03:41:29.430 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:29.423+0000 7f2317fff700 1 --2- 172.21.15.96:0/4289598056 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2318104600 0x7f231819aea0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2310007ee0 tx=0x7f231000d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:29.430 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:29.423+0000 7f23157fa700 1 -- 172.21.15.96:0/4289598056 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2310017070 con 0x7f2318104600 2023-05-08T03:41:29.430 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:29.423+0000 7f231e0c9700 1 -- 172.21.15.96:0/4289598056 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f231810f340 con 0x7f2318104600 2023-05-08T03:41:29.430 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:29.423+0000 7f23157fa700 1 -- 172.21.15.96:0/4289598056 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f231000f040 con 0x7f2318104600 2023-05-08T03:41:29.430 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:29.423+0000 7f23157fa700 1 -- 172.21.15.96:0/4289598056 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2310005580 con 0x7f2318104600 2023-05-08T03:41:29.430 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:29.423+0000 7f231e0c9700 1 -- 172.21.15.96:0/4289598056 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f231810f1b0 con 0x7f2318104600 2023-05-08T03:41:29.431 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:29.424+0000 7f231e0c9700 1 -- 172.21.15.96:0/4289598056 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f231810f4d0 con 0x7f2318104600 2023-05-08T03:41:29.431 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:29.425+0000 7f23157fa700 1 -- 172.21.15.96:0/4289598056 <== mon.2 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f231000db20 con 0x7f2318104600 2023-05-08T03:41:29.432 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:29.426+0000 7f23157fa700 1 --2- 172.21.15.96:0/4289598056 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f23040a11e0 0x7f23040a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:29.432 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:29.426+0000 7f23177fe700 1 --2- 172.21.15.96:0/4289598056 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f23040a11e0 0x7f23040a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:29.432 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:29.426+0000 7f23157fa700 1 -- 172.21.15.96:0/4289598056 <== mon.2 v2:172.21.15.133:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f23100cc710 con 0x7f2318104600 2023-05-08T03:41:29.432 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:29.426+0000 7f23177fe700 1 --2- 172.21.15.96:0/4289598056 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f23040a11e0 0x7f23040a3690 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2308009990 tx=0x7f2308000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:29.433 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:29.430+0000 7f23157fa700 1 -- 172.21.15.96:0/4289598056 <== mon.2 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f2310095db0 con 0x7f2318104600 2023-05-08T03:41:29.631 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:29.628+0000 7f231e0c9700 1 -- 172.21.15.96:0/4289598056 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) v1 -- 0x7f2318066fa0 con 0x7f2318104600 2023-05-08T03:41:29.632 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:29.629+0000 7f23157fa700 1 -- 172.21.15.96:0/4289598056 <== mon.2 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f23100993d0 con 0x7f2318104600 2023-05-08T03:41:29.632 INFO:teuthology.orchestra.run.smithi096.stdout:249108103200 2023-05-08T03:41:29.634 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:29.631+0000 7f231e0c9700 1 -- 172.21.15.96:0/4289598056 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f23040a11e0 msgr2=0x7f23040a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:29.634 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:29.631+0000 7f231e0c9700 1 --2- 172.21.15.96:0/4289598056 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f23040a11e0 0x7f23040a3690 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2308009990 tx=0x7f2308000bc0 comp rx=0 tx=0).stop 2023-05-08T03:41:29.634 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:29.631+0000 7f231e0c9700 1 -- 172.21.15.96:0/4289598056 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2318104600 msgr2=0x7f231819aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:29.634 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:29.631+0000 7f231e0c9700 1 --2- 172.21.15.96:0/4289598056 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2318104600 0x7f231819aea0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2310007ee0 tx=0x7f231000d3b0 comp rx=0 tx=0).stop 2023-05-08T03:41:29.635 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:29.631+0000 7f231e0c9700 1 -- 172.21.15.96:0/4289598056 shutdown_connections 2023-05-08T03:41:29.635 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:29.631+0000 7f231e0c9700 1 --2- 172.21.15.96:0/4289598056 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f23040a11e0 0x7f23040a3690 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:29.635 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:29.631+0000 7f231e0c9700 1 --2- 172.21.15.96:0/4289598056 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2318104600 0x7f231819aea0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:29.635 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:29.631+0000 7f231e0c9700 1 --2- 172.21.15.96:0/4289598056 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23180ff560 0x7f23181964f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:29.635 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:29.631+0000 7f231e0c9700 1 --2- 172.21.15.96:0/4289598056 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f23180fff00 0x7f2318196a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:29.635 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:29.631+0000 7f231e0c9700 1 -- 172.21.15.96:0/4289598056 >> 172.21.15.96:0/4289598056 conn(0x7f23180771a0 msgr2=0x7f2318103150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:29.636 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:29.631+0000 7f231e0c9700 1 -- 172.21.15.96:0/4289598056 shutdown_connections 2023-05-08T03:41:29.636 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:29.631+0000 7f231e0c9700 1 -- 172.21.15.96:0/4289598056 wait complete. 2023-05-08T03:41:29.864 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:29 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/1897854796' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-05-08T03:41:29.865 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:29 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/4289598056' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-05-08T03:41:29.865 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574909 got 55834574912 for osd.1 2023-05-08T03:41:29.866 DEBUG:teuthology.parallel:result is None 2023-05-08T03:41:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:29 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/1897854796' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-05-08T03:41:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:29 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/4289598056' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-05-08T03:41:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:29 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/1897854796' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-05-08T03:41:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:29 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/4289598056' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-05-08T03:41:30.535 INFO:tasks.cephadm.ceph_manager.ceph:need seq 249108103198 got 249108103200 for osd.8 2023-05-08T03:41:30.535 DEBUG:teuthology.parallel:result is None 2023-05-08T03:41:30.686 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:30.644+0000 7f430071d700 1 -- 172.21.15.96:0/1475973961 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42f8101640 msgr2=0x7f42f8101a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:30.687 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:30.644+0000 7f430071d700 1 --2- 172.21.15.96:0/1475973961 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42f8101640 0x7f42f8101a10 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f42f4009990 tx=0x7f42f4009ca0 comp rx=0 tx=0).stop 2023-05-08T03:41:30.687 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:30.644+0000 7f430071d700 1 -- 172.21.15.96:0/1475973961 shutdown_connections 2023-05-08T03:41:30.687 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:30.644+0000 7f430071d700 1 --2- 172.21.15.96:0/1475973961 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f42f810a990 0x7f42f810cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:30.687 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:30.644+0000 7f430071d700 1 --2- 172.21.15.96:0/1475973961 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42f8101640 0x7f42f8101a10 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:30.688 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:30.644+0000 7f430071d700 1 --2- 172.21.15.96:0/1475973961 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42f8101f50 0x7f42f810a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:30.689 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:30.644+0000 7f430071d700 1 -- 172.21.15.96:0/1475973961 >> 172.21.15.96:0/1475973961 conn(0x7f42f80771a0 msgr2=0x7f42f80775a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:30.689 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:30.644+0000 7f430071d700 1 -- 172.21.15.96:0/1475973961 shutdown_connections 2023-05-08T03:41:30.689 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:30.644+0000 7f430071d700 1 -- 172.21.15.96:0/1475973961 wait complete. 2023-05-08T03:41:30.689 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:30.645+0000 7f430071d700 1 Processor -- start 2023-05-08T03:41:30.689 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:30.645+0000 7f430071d700 1 -- start start 2023-05-08T03:41:30.689 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:30.645+0000 7f430071d700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f42f8101640 0x7f42f80ff2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:30.689 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:30.645+0000 7f430071d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42f8101f50 0x7f42f80ff7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:30.690 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:30.645+0000 7f430071d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42f810a990 0x7f42f80ffd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:30.690 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:30.645+0000 7f430071d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f81a4960 con 0x7f42f8101f50 2023-05-08T03:41:30.690 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:30.645+0000 7f430071d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f81a4ad0 con 0x7f42f810a990 2023-05-08T03:41:30.690 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:30.645+0000 7f430071d700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f81a4c90 con 0x7f42f8101640 2023-05-08T03:41:30.690 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:30.645+0000 7f42fdcb8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42f8101f50 0x7f42f80ff7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:30.690 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:30.645+0000 7f42fdcb8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42f8101f50 0x7f42f80ff7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41008/0 (socket says 172.21.15.96:41008) 2023-05-08T03:41:30.690 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:30.645+0000 7f42fdcb8700 1 -- 172.21.15.96:0/1807480655 learned_addr learned my addr 172.21.15.96:0/1807480655 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:41:30.690 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:30.645+0000 7f42fe4b9700 1 --2- 172.21.15.96:0/1807480655 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f42f8101640 0x7f42f80ff2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:30.691 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:30.645+0000 7f42fecba700 1 --2- 172.21.15.96:0/1807480655 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42f810a990 0x7f42f80ffd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:30.691 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:30.646+0000 7f42fdcb8700 1 -- 172.21.15.96:0/1807480655 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f42f8101640 msgr2=0x7f42f80ff2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:30.691 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:30.646+0000 7f42fdcb8700 1 --2- 172.21.15.96:0/1807480655 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f42f8101640 0x7f42f80ff2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:30.691 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:30.646+0000 7f42fdcb8700 1 -- 172.21.15.96:0/1807480655 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42f810a990 msgr2=0x7f42f80ffd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:30.691 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:30.646+0000 7f42fdcb8700 1 --2- 172.21.15.96:0/1807480655 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42f810a990 0x7f42f80ffd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:30.691 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:30.646+0000 7f42fdcb8700 1 -- 172.21.15.96:0/1807480655 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42f40095f0 con 0x7f42f8101f50 2023-05-08T03:41:30.691 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:30.646+0000 7f42fecba700 1 --2- 172.21.15.96:0/1807480655 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42f810a990 0x7f42f80ffd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-08T03:41:30.692 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:30.646+0000 7f42fdcb8700 1 --2- 172.21.15.96:0/1807480655 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42f8101f50 0x7f42f80ff7e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f42e800d950 tx=0x7f42e800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:30.692 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:30.646+0000 7f42ef7fe700 1 -- 172.21.15.96:0/1807480655 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e8009940 con 0x7f42f8101f50 2023-05-08T03:41:30.692 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:30.646+0000 7f42ef7fe700 1 -- 172.21.15.96:0/1807480655 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f42e8010460 con 0x7f42f8101f50 2023-05-08T03:41:30.692 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:30.646+0000 7f430071d700 1 -- 172.21.15.96:0/1807480655 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42f8110410 con 0x7f42f8101f50 2023-05-08T03:41:30.692 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:30.646+0000 7f42ef7fe700 1 -- 172.21.15.96:0/1807480655 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e800f620 con 0x7f42f8101f50 2023-05-08T03:41:30.692 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:30.646+0000 7f430071d700 1 -- 172.21.15.96:0/1807480655 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42f8110280 con 0x7f42f8101f50 2023-05-08T03:41:30.692 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:30.647+0000 7f430071d700 1 -- 172.21.15.96:0/1807480655 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42f81105a0 con 0x7f42f8101f50 2023-05-08T03:41:30.693 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:30.648+0000 7f42ef7fe700 1 -- 172.21.15.96:0/1807480655 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f42e80108d0 con 0x7f42f8101f50 2023-05-08T03:41:30.693 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:30.648+0000 7f42ef7fe700 1 --2- 172.21.15.96:0/1807480655 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f42e40a1260 0x7f42e40a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:30.693 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:30.649+0000 7f42fe4b9700 1 --2- 172.21.15.96:0/1807480655 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f42e40a1260 0x7f42e40a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:30.693 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:30.649+0000 7f42ef7fe700 1 -- 172.21.15.96:0/1807480655 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f42e80cc9f0 con 0x7f42f8101f50 2023-05-08T03:41:30.693 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:30.649+0000 7f42fe4b9700 1 --2- 172.21.15.96:0/1807480655 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f42e40a1260 0x7f42e40a3710 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f42f400b5c0 tx=0x7f42f4005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:30.693 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:30.652+0000 7f42ef7fe700 1 -- 172.21.15.96:0/1807480655 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f42e8096190 con 0x7f42f8101f50 2023-05-08T03:41:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:30 smithi096 ceph-mon[124666]: pgmap v278: 97 pgs: 97 active+clean; 636 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2023-05-08T03:41:30.875 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:30.872+0000 7f430071d700 1 -- 172.21.15.96:0/1807480655 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f42f81007d0 con 0x7f42f8101f50 2023-05-08T03:41:30.875 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:30.873+0000 7f42ef7fe700 1 -- 172.21.15.96:0/1807480655 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f42e8016090 con 0x7f42f8101f50 2023-05-08T03:41:30.876 INFO:teuthology.orchestra.run.smithi096.stdout:141733920818 2023-05-08T03:41:30.878 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:30.876+0000 7f430071d700 1 -- 172.21.15.96:0/1807480655 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f42e40a1260 msgr2=0x7f42e40a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:30.878 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:30.876+0000 7f430071d700 1 --2- 172.21.15.96:0/1807480655 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f42e40a1260 0x7f42e40a3710 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f42f400b5c0 tx=0x7f42f4005fd0 comp rx=0 tx=0).stop 2023-05-08T03:41:30.879 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:30.876+0000 7f430071d700 1 -- 172.21.15.96:0/1807480655 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42f8101f50 msgr2=0x7f42f80ff7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:30.879 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:30.876+0000 7f430071d700 1 --2- 172.21.15.96:0/1807480655 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42f8101f50 0x7f42f80ff7e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f42e800d950 tx=0x7f42e800dc60 comp rx=0 tx=0).stop 2023-05-08T03:41:30.880 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:30.876+0000 7f430071d700 1 -- 172.21.15.96:0/1807480655 shutdown_connections 2023-05-08T03:41:30.880 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:30.876+0000 7f430071d700 1 --2- 172.21.15.96:0/1807480655 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f42e40a1260 0x7f42e40a3710 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:30.880 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:30.876+0000 7f430071d700 1 --2- 172.21.15.96:0/1807480655 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42f810a990 0x7f42f80ffd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:30.880 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:30.876+0000 7f430071d700 1 --2- 172.21.15.96:0/1807480655 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f42f8101640 0x7f42f80ff2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:30.880 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:30.876+0000 7f430071d700 1 --2- 172.21.15.96:0/1807480655 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42f8101f50 0x7f42f80ff7e0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:30.880 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:30.876+0000 7f430071d700 1 -- 172.21.15.96:0/1807480655 >> 172.21.15.96:0/1807480655 conn(0x7f42f80771a0 msgr2=0x7f42f80fbe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:30.881 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:30.876+0000 7f430071d700 1 -- 172.21.15.96:0/1807480655 shutdown_connections 2023-05-08T03:41:30.881 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:30.876+0000 7f430071d700 1 -- 172.21.15.96:0/1807480655 wait complete. 2023-05-08T03:41:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:30 smithi133 ceph-mon[125939]: pgmap v278: 97 pgs: 97 active+clean; 636 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2023-05-08T03:41:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:30 smithi186 ceph-mon[126480]: pgmap v278: 97 pgs: 97 active+clean; 636 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2023-05-08T03:41:31.396 INFO:tasks.cephadm.ceph_manager.ceph:need seq 141733920816 got 141733920818 for osd.4 2023-05-08T03:41:31.397 DEBUG:teuthology.parallel:result is None 2023-05-08T03:41:31.473 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:31.470+0000 7f6c030dc700 1 -- 172.21.15.96:0/1996296305 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bfc105390 msgr2=0x7f6bfc105760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:31.473 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:31.470+0000 7f6c030dc700 1 --2- 172.21.15.96:0/1996296305 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bfc105390 0x7f6bfc105760 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6bf0009990 tx=0x7f6bf0009ca0 comp rx=0 tx=0).stop 2023-05-08T03:41:31.474 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:31.470+0000 7f6c030dc700 1 -- 172.21.15.96:0/1996296305 shutdown_connections 2023-05-08T03:41:31.474 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:31.470+0000 7f6c030dc700 1 --2- 172.21.15.96:0/1996296305 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6bfc0ff2e0 0x7f6bfc10d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:31.474 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:31.470+0000 7f6c030dc700 1 --2- 172.21.15.96:0/1996296305 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bfc105390 0x7f6bfc105760 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:31.474 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:31.470+0000 7f6c030dc700 1 --2- 172.21.15.96:0/1996296305 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6bfc0fe930 0x7f6bfc0feda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:31.474 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:31.470+0000 7f6c030dc700 1 -- 172.21.15.96:0/1996296305 >> 172.21.15.96:0/1996296305 conn(0x7f6bfc0759a0 msgr2=0x7f6bfc075da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:31.474 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:31.470+0000 7f6c030dc700 1 -- 172.21.15.96:0/1996296305 shutdown_connections 2023-05-08T03:41:31.475 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:31.470+0000 7f6c030dc700 1 -- 172.21.15.96:0/1996296305 wait complete. 2023-05-08T03:41:31.476 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:31.471+0000 7f6c030dc700 1 Processor -- start 2023-05-08T03:41:31.477 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:31.471+0000 7f6c030dc700 1 -- start start 2023-05-08T03:41:31.477 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:31.471+0000 7f6c030dc700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6bfc0fe930 0x7f6bfc196590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:31.477 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:31.471+0000 7f6c030dc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bfc0ff2e0 0x7f6bfc196ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:31.477 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:31.471+0000 7f6c030dc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6bfc105390 0x7f6bfc19af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:31.477 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:31.471+0000 7f6c030dc700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bfc19b550 con 0x7f6bfc0ff2e0 2023-05-08T03:41:31.477 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:31.471+0000 7f6c030dc700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bfc19b6c0 con 0x7f6bfc105390 2023-05-08T03:41:31.477 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:31.471+0000 7f6c030dc700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bfc19b880 con 0x7f6bfc0fe930 2023-05-08T03:41:31.478 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:31.471+0000 7f6bfbfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bfc0ff2e0 0x7f6bfc196ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:31.478 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:31.471+0000 7f6bfbfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bfc0ff2e0 0x7f6bfc196ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41022/0 (socket says 172.21.15.96:41022) 2023-05-08T03:41:31.478 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:31.471+0000 7f6bfbfff700 1 -- 172.21.15.96:0/338883259 learned_addr learned my addr 172.21.15.96:0/338883259 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:41:31.478 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:31.471+0000 7f6c01679700 1 --2- 172.21.15.96:0/338883259 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6bfc105390 0x7f6bfc19af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:31.478 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:31.471+0000 7f6c00e78700 1 --2- 172.21.15.96:0/338883259 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6bfc0fe930 0x7f6bfc196590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:31.478 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:31.471+0000 7f6bfbfff700 1 -- 172.21.15.96:0/338883259 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6bfc0fe930 msgr2=0x7f6bfc196590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:31.478 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:31.471+0000 7f6bfbfff700 1 --2- 172.21.15.96:0/338883259 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6bfc0fe930 0x7f6bfc196590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:31.479 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:31.471+0000 7f6bfbfff700 1 -- 172.21.15.96:0/338883259 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6bfc105390 msgr2=0x7f6bfc19af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:31.479 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:31.471+0000 7f6bfbfff700 1 --2- 172.21.15.96:0/338883259 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6bfc105390 0x7f6bfc19af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:31.479 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:31.471+0000 7f6bfbfff700 1 -- 172.21.15.96:0/338883259 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bf00095f0 con 0x7f6bfc0ff2e0 2023-05-08T03:41:31.479 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:31.471+0000 7f6bfbfff700 1 --2- 172.21.15.96:0/338883259 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bfc0ff2e0 0x7f6bfc196ad0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6be800b530 tx=0x7f6be800b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:31.479 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:31.472+0000 7f6bf9ffb700 1 -- 172.21.15.96:0/338883259 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be8011830 con 0x7f6bfc0ff2e0 2023-05-08T03:41:31.479 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:31.472+0000 7f6bf9ffb700 1 -- 172.21.15.96:0/338883259 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6be8011e50 con 0x7f6bfc0ff2e0 2023-05-08T03:41:31.479 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:31.472+0000 7f6c030dc700 1 -- 172.21.15.96:0/338883259 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bfc110610 con 0x7f6bfc0ff2e0 2023-05-08T03:41:31.479 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:31.472+0000 7f6bf9ffb700 1 -- 172.21.15.96:0/338883259 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be800f2e0 con 0x7f6bfc0ff2e0 2023-05-08T03:41:31.480 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:31.472+0000 7f6c030dc700 1 -- 172.21.15.96:0/338883259 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bfc110480 con 0x7f6bfc0ff2e0 2023-05-08T03:41:31.480 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:31.473+0000 7f6c030dc700 1 -- 172.21.15.96:0/338883259 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bfc1107a0 con 0x7f6bfc0ff2e0 2023-05-08T03:41:31.480 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:31.473+0000 7f6bf9ffb700 1 -- 172.21.15.96:0/338883259 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f6be8010580 con 0x7f6bfc0ff2e0 2023-05-08T03:41:31.480 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:31.474+0000 7f6bf9ffb700 1 --2- 172.21.15.96:0/338883259 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f6bec0a11e0 0x7f6bec0a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:31.480 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:31.474+0000 7f6bf9ffb700 1 -- 172.21.15.96:0/338883259 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f6be80cc390 con 0x7f6bfc0ff2e0 2023-05-08T03:41:31.480 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:31.474+0000 7f6c00e78700 1 --2- 172.21.15.96:0/338883259 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f6bec0a11e0 0x7f6bec0a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:31.481 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:31.475+0000 7f6c00e78700 1 --2- 172.21.15.96:0/338883259 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f6bec0a11e0 0x7f6bec0a3690 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6bf0006010 tx=0x7f6bf000b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:31.481 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:31.479+0000 7f6bf9ffb700 1 -- 172.21.15.96:0/338883259 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f6be8095c40 con 0x7f6bfc0ff2e0 2023-05-08T03:41:31.671 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:31.669+0000 7f6c030dc700 1 -- 172.21.15.96:0/338883259 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6bfc066fa0 con 0x7f6bfc0ff2e0 2023-05-08T03:41:31.672 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:31.669+0000 7f6bf9ffb700 1 -- 172.21.15.96:0/338883259 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6be8099260 con 0x7f6bfc0ff2e0 2023-05-08T03:41:31.672 INFO:teuthology.orchestra.run.smithi096.stdout:77309411388 2023-05-08T03:41:31.674 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:31.671+0000 7f6c030dc700 1 -- 172.21.15.96:0/338883259 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f6bec0a11e0 msgr2=0x7f6bec0a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:31.674 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:31.671+0000 7f6c030dc700 1 --2- 172.21.15.96:0/338883259 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f6bec0a11e0 0x7f6bec0a3690 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6bf0006010 tx=0x7f6bf000b540 comp rx=0 tx=0).stop 2023-05-08T03:41:31.674 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:31.671+0000 7f6c030dc700 1 -- 172.21.15.96:0/338883259 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bfc0ff2e0 msgr2=0x7f6bfc196ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:31.675 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:31.671+0000 7f6c030dc700 1 --2- 172.21.15.96:0/338883259 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bfc0ff2e0 0x7f6bfc196ad0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6be800b530 tx=0x7f6be800b8f0 comp rx=0 tx=0).stop 2023-05-08T03:41:31.675 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:31.671+0000 7f6c030dc700 1 -- 172.21.15.96:0/338883259 shutdown_connections 2023-05-08T03:41:31.675 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:31.671+0000 7f6c030dc700 1 --2- 172.21.15.96:0/338883259 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f6bec0a11e0 0x7f6bec0a3690 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:31.675 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:31.671+0000 7f6c030dc700 1 --2- 172.21.15.96:0/338883259 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6bfc105390 0x7f6bfc19af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:31.675 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:31.671+0000 7f6c030dc700 1 --2- 172.21.15.96:0/338883259 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6bfc0fe930 0x7f6bfc196590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:31.675 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:31.671+0000 7f6c030dc700 1 --2- 172.21.15.96:0/338883259 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bfc0ff2e0 0x7f6bfc196ad0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:31.675 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:31.671+0000 7f6c030dc700 1 -- 172.21.15.96:0/338883259 >> 172.21.15.96:0/338883259 conn(0x7f6bfc0759a0 msgr2=0x7f6bfc0fc400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:31.676 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:31.671+0000 7f6c030dc700 1 -- 172.21.15.96:0/338883259 shutdown_connections 2023-05-08T03:41:31.676 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:31.671+0000 7f6c030dc700 1 -- 172.21.15.96:0/338883259 wait complete. 2023-05-08T03:41:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:31 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/1807480655' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-05-08T03:41:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:31 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/1807480655' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-05-08T03:41:32.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:31 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/1807480655' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-05-08T03:41:32.121 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411385 got 77309411388 for osd.2 2023-05-08T03:41:32.121 DEBUG:teuthology.parallel:result is None 2023-05-08T03:41:32.121 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2023-05-08T03:41:32.122 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- ceph pg dump --format=json 2023-05-08T03:41:32.763 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.a/config 2023-05-08T03:41:32.946 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:32 smithi096 ceph-mon[124666]: pgmap v279: 97 pgs: 97 active+clean; 636 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 6 op/s 2023-05-08T03:41:32.947 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:32 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/338883259' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-05-08T03:41:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:32 smithi133 ceph-mon[125939]: pgmap v279: 97 pgs: 97 active+clean; 636 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 6 op/s 2023-05-08T03:41:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:32 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/338883259' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-05-08T03:41:33.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:32 smithi186 ceph-mon[126480]: pgmap v279: 97 pgs: 97 active+clean; 636 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 6 op/s 2023-05-08T03:41:33.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:32 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/338883259' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-05-08T03:41:33.979 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:33.975+0000 7f7015df9700 1 -- 172.21.15.96:0/972853401 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70100692b0 msgr2=0x7f7010104f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:33.979 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:33.975+0000 7f7015df9700 1 --2- 172.21.15.96:0/972853401 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70100692b0 0x7f7010104f80 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f70000099c0 tx=0x7f7000009cd0 comp rx=0 tx=0).stop 2023-05-08T03:41:33.979 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:33.975+0000 7f7015df9700 1 -- 172.21.15.96:0/972853401 shutdown_connections 2023-05-08T03:41:33.979 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:33.975+0000 7f7015df9700 1 --2- 172.21.15.96:0/972853401 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f70101056b0 0x7f701010d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:33.979 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:33.975+0000 7f7015df9700 1 --2- 172.21.15.96:0/972853401 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7010068910 0x7f7010068ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:33.979 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:33.975+0000 7f7015df9700 1 --2- 172.21.15.96:0/972853401 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70100692b0 0x7f7010104f80 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:33.980 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:33.975+0000 7f7015df9700 1 -- 172.21.15.96:0/972853401 >> 172.21.15.96:0/972853401 conn(0x7f7010076470 msgr2=0x7f7010076870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:33.980 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:33.975+0000 7f7015df9700 1 -- 172.21.15.96:0/972853401 shutdown_connections 2023-05-08T03:41:33.980 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:33.975+0000 7f7015df9700 1 -- 172.21.15.96:0/972853401 wait complete. 2023-05-08T03:41:33.980 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:33.975+0000 7f7015df9700 1 Processor -- start 2023-05-08T03:41:33.980 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:33.976+0000 7f7015df9700 1 -- start start 2023-05-08T03:41:33.980 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:33.976+0000 7f7015df9700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7010068910 0x7f70100ffc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:33.980 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:33.976+0000 7f7015df9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70100692b0 0x7f70101001d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:33.981 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:33.976+0000 7f7015df9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70101056b0 0x7f7010100750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:33.981 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:33.976+0000 7f7015df9700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70101a4980 con 0x7f70101056b0 2023-05-08T03:41:33.981 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:33.976+0000 7f7015df9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70101a4af0 con 0x7f70100692b0 2023-05-08T03:41:33.981 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:33.976+0000 7f7015df9700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70101a4cb0 con 0x7f7010068910 2023-05-08T03:41:33.981 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:33.976+0000 7f700ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70101056b0 0x7f7010100750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:33.981 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:33.976+0000 7f700ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70101056b0 0x7f7010100750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41038/0 (socket says 172.21.15.96:41038) 2023-05-08T03:41:33.981 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:33.976+0000 7f700ffff700 1 -- 172.21.15.96:0/135072707 learned_addr learned my addr 172.21.15.96:0/135072707 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:41:33.981 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:33.976+0000 7f700f7fe700 1 --2- 172.21.15.96:0/135072707 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7010068910 0x7f70100ffc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:33.982 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:33.976+0000 7f700effd700 1 --2- 172.21.15.96:0/135072707 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70100692b0 0x7f70101001d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:33.982 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:33.976+0000 7f700ffff700 1 -- 172.21.15.96:0/135072707 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7010068910 msgr2=0x7f70100ffc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:33.982 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:33.976+0000 7f700ffff700 1 --2- 172.21.15.96:0/135072707 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7010068910 0x7f70100ffc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:33.982 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:33.976+0000 7f700ffff700 1 -- 172.21.15.96:0/135072707 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70100692b0 msgr2=0x7f70101001d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:33.982 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:33.976+0000 7f700ffff700 1 --2- 172.21.15.96:0/135072707 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70100692b0 0x7f70101001d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:33.982 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:33.976+0000 7f700ffff700 1 -- 172.21.15.96:0/135072707 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70000095f0 con 0x7f70101056b0 2023-05-08T03:41:33.982 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:33.976+0000 7f700f7fe700 1 --2- 172.21.15.96:0/135072707 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7010068910 0x7f70100ffc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-08T03:41:33.983 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:33.976+0000 7f700effd700 1 --2- 172.21.15.96:0/135072707 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70100692b0 0x7f70101001d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-08T03:41:33.983 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:33.976+0000 7f700ffff700 1 --2- 172.21.15.96:0/135072707 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70101056b0 0x7f7010100750 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f700800b970 tx=0x7f700800bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:33.983 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:33.976+0000 7f700cff9700 1 -- 172.21.15.96:0/135072707 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700800c9b0 con 0x7f70101056b0 2023-05-08T03:41:33.984 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:33.977+0000 7f7015df9700 1 -- 172.21.15.96:0/135072707 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7010110490 con 0x7f70101056b0 2023-05-08T03:41:33.984 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:33.977+0000 7f700cff9700 1 -- 172.21.15.96:0/135072707 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7008014440 con 0x7f70101056b0 2023-05-08T03:41:33.984 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:33.977+0000 7f700cff9700 1 -- 172.21.15.96:0/135072707 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70080075d0 con 0x7f70101056b0 2023-05-08T03:41:33.984 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:33.977+0000 7f7015df9700 1 -- 172.21.15.96:0/135072707 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7010110300 con 0x7f70101056b0 2023-05-08T03:41:33.984 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:33.978+0000 7f7015df9700 1 -- 172.21.15.96:0/135072707 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7010110620 con 0x7f70101056b0 2023-05-08T03:41:33.985 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:33.979+0000 7f700cff9700 1 -- 172.21.15.96:0/135072707 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f70080145b0 con 0x7f70101056b0 2023-05-08T03:41:33.985 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:33.979+0000 7f700cff9700 1 --2- 172.21.15.96:0/135072707 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f6ff80a11e0 0x7f6ff80a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:33.985 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:33.979+0000 7f700f7fe700 1 --2- 172.21.15.96:0/135072707 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f6ff80a11e0 0x7f6ff80a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:33.985 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:33.979+0000 7f700cff9700 1 -- 172.21.15.96:0/135072707 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f7008006e40 con 0x7f70101056b0 2023-05-08T03:41:33.985 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:33.980+0000 7f700f7fe700 1 --2- 172.21.15.96:0/135072707 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f6ff80a11e0 0x7f6ff80a3690 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f70040099d0 tx=0x7f7004008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:33.986 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:33.984+0000 7f700cff9700 1 -- 172.21.15.96:0/135072707 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f700804e730 con 0x7f70101056b0 2023-05-08T03:41:34.171 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:34.168+0000 7f7015df9700 1 -- 172.21.15.96:0/135072707 --> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f70100fe1b0 con 0x7f6ff80a11e0 2023-05-08T03:41:34.180 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:34.178+0000 7f700cff9700 1 -- 172.21.15.96:0/135072707 <== mgr.14152 v2:172.21.15.96:6800/2748629182 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+341153 (secure 0 0 0) 0x7f70100fe1b0 con 0x7f6ff80a11e0 2023-05-08T03:41:34.184 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:41:34.186 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:34.181+0000 7f7015df9700 1 -- 172.21.15.96:0/135072707 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f6ff80a11e0 msgr2=0x7f6ff80a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:34.187 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:34.181+0000 7f7015df9700 1 --2- 172.21.15.96:0/135072707 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f6ff80a11e0 0x7f6ff80a3690 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f70040099d0 tx=0x7f7004008040 comp rx=0 tx=0).stop 2023-05-08T03:41:34.187 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:34.181+0000 7f7015df9700 1 -- 172.21.15.96:0/135072707 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70101056b0 msgr2=0x7f7010100750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:34.187 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:34.181+0000 7f7015df9700 1 --2- 172.21.15.96:0/135072707 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70101056b0 0x7f7010100750 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f700800b970 tx=0x7f700800bd30 comp rx=0 tx=0).stop 2023-05-08T03:41:34.187 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:34.181+0000 7f7015df9700 1 -- 172.21.15.96:0/135072707 shutdown_connections 2023-05-08T03:41:34.187 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:34.181+0000 7f7015df9700 1 --2- 172.21.15.96:0/135072707 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f6ff80a11e0 0x7f6ff80a3690 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:34.187 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:34.181+0000 7f7015df9700 1 --2- 172.21.15.96:0/135072707 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70101056b0 0x7f7010100750 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:34.188 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:34.181+0000 7f7015df9700 1 --2- 172.21.15.96:0/135072707 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7010068910 0x7f70100ffc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:34.188 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:34.181+0000 7f7015df9700 1 --2- 172.21.15.96:0/135072707 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70100692b0 0x7f70101001d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:34.188 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:34.181+0000 7f7015df9700 1 -- 172.21.15.96:0/135072707 >> 172.21.15.96:0/135072707 conn(0x7f7010076470 msgr2=0x7f70100fdaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:34.188 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:34.181+0000 7f7015df9700 1 -- 172.21.15.96:0/135072707 shutdown_connections 2023-05-08T03:41:34.188 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:34.181+0000 7f7015df9700 1 -- 172.21.15.96:0/135072707 wait complete. 2023-05-08T03:41:34.188 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2023-05-08T03:41:34.507 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":280,"stamp":"2023-05-08T03:41:33.568979+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":651149,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":385,"num_read_kb":308,"num_write":334,"num_write_kb":3042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":272,"ondisk_log_size":272,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":79976,"kb_used_data":12424,"kb_used_omap":0,"kb_used_meta":67456,"kb_avail":1124861848,"statfs":{"total":1151940427776,"available":1151858532352,"internally_reserved":0,"allocated":12722176,"data_stored":7000621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":69074944},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1652,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":37,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003032"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.290515+0000","last_change":"2023-05-08T03:40:49.238180+0000","last_active":"2023-05-08T03:40:50.290515+0000","last_peered":"2023-05-08T03:40:50.290515+0000","last_clean":"2023-05-08T03:40:50.290515+0000","last_became_active":"2023-05-08T03:40:49.237400+0000","last_became_peered":"2023-05-08T03:40:49.237400+0000","last_unstale":"2023-05-08T03:40:50.290515+0000","last_undegraded":"2023-05-08T03:40:50.290515+0000","last_fullsized":"2023-05-08T03:40:50.290515+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T11:27:00.446105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991619+0000","last_change":"2023-05-08T03:40:49.232533+0000","last_active":"2023-05-08T03:40:51.991619+0000","last_peered":"2023-05-08T03:40:51.991619+0000","last_clean":"2023-05-08T03:40:51.991619+0000","last_became_active":"2023-05-08T03:40:49.232246+0000","last_became_peered":"2023-05-08T03:40:49.232246+0000","last_unstale":"2023-05-08T03:40:51.991619+0000","last_undegraded":"2023-05-08T03:40:51.991619+0000","last_fullsized":"2023-05-08T03:40:51.991619+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T06:19:28.497539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991622+0000","last_change":"2023-05-08T03:40:49.236848+0000","last_active":"2023-05-08T03:40:51.991622+0000","last_peered":"2023-05-08T03:40:51.991622+0000","last_clean":"2023-05-08T03:40:51.991622+0000","last_became_active":"2023-05-08T03:40:49.236506+0000","last_became_peered":"2023-05-08T03:40:49.236506+0000","last_unstale":"2023-05-08T03:40:51.991622+0000","last_undegraded":"2023-05-08T03:40:51.991622+0000","last_fullsized":"2023-05-08T03:40:51.991622+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T09:55:30.234804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.222849+0000","last_change":"2023-05-08T03:40:49.233941+0000","last_active":"2023-05-08T03:40:50.222849+0000","last_peered":"2023-05-08T03:40:50.222849+0000","last_clean":"2023-05-08T03:40:50.222849+0000","last_became_active":"2023-05-08T03:40:49.232969+0000","last_became_peered":"2023-05-08T03:40:49.232969+0000","last_unstale":"2023-05-08T03:40:50.222849+0000","last_undegraded":"2023-05-08T03:40:50.222849+0000","last_fullsized":"2023-05-08T03:40:50.222849+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T05:51:05.543005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.224768+0000","last_change":"2023-05-08T03:40:49.229455+0000","last_active":"2023-05-08T03:40:50.224768+0000","last_peered":"2023-05-08T03:40:50.224768+0000","last_clean":"2023-05-08T03:40:50.224768+0000","last_became_active":"2023-05-08T03:40:49.229118+0000","last_became_peered":"2023-05-08T03:40:49.229118+0000","last_unstale":"2023-05-08T03:40:50.224768+0000","last_undegraded":"2023-05-08T03:40:50.224768+0000","last_fullsized":"2023-05-08T03:40:50.224768+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T09:17:55.353149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.299436+0000","last_change":"2023-05-08T03:40:49.237344+0000","last_active":"2023-05-08T03:40:51.299436+0000","last_peered":"2023-05-08T03:40:51.299436+0000","last_clean":"2023-05-08T03:40:51.299436+0000","last_became_active":"2023-05-08T03:40:49.236775+0000","last_became_peered":"2023-05-08T03:40:49.236775+0000","last_unstale":"2023-05-08T03:40:51.299436+0000","last_undegraded":"2023-05-08T03:40:51.299436+0000","last_fullsized":"2023-05-08T03:40:51.299436+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T12:50:19.957755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991259+0000","last_change":"2023-05-08T03:40:49.235549+0000","last_active":"2023-05-08T03:40:51.991259+0000","last_peered":"2023-05-08T03:40:51.991259+0000","last_clean":"2023-05-08T03:40:51.991259+0000","last_became_active":"2023-05-08T03:40:49.235223+0000","last_became_peered":"2023-05-08T03:40:49.235223+0000","last_unstale":"2023-05-08T03:40:51.991259+0000","last_undegraded":"2023-05-08T03:40:51.991259+0000","last_fullsized":"2023-05-08T03:40:51.991259+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T09:45:50.518957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:52.175162+0000","last_change":"2023-05-08T03:40:49.234923+0000","last_active":"2023-05-08T03:40:52.175162+0000","last_peered":"2023-05-08T03:40:52.175162+0000","last_clean":"2023-05-08T03:40:52.175162+0000","last_became_active":"2023-05-08T03:40:49.234630+0000","last_became_peered":"2023-05-08T03:40:49.234630+0000","last_unstale":"2023-05-08T03:40:52.175162+0000","last_undegraded":"2023-05-08T03:40:52.175162+0000","last_fullsized":"2023-05-08T03:40:52.175162+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T10:54:09.908673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991956+0000","last_change":"2023-05-08T03:40:49.243476+0000","last_active":"2023-05-08T03:40:51.991956+0000","last_peered":"2023-05-08T03:40:51.991956+0000","last_clean":"2023-05-08T03:40:51.991956+0000","last_became_active":"2023-05-08T03:40:49.243134+0000","last_became_peered":"2023-05-08T03:40:49.243134+0000","last_unstale":"2023-05-08T03:40:51.991956+0000","last_undegraded":"2023-05-08T03:40:51.991956+0000","last_fullsized":"2023-05-08T03:40:51.991956+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T11:09:14.244948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.299799+0000","last_change":"2023-05-08T03:40:49.238538+0000","last_active":"2023-05-08T03:40:51.299799+0000","last_peered":"2023-05-08T03:40:51.299799+0000","last_clean":"2023-05-08T03:40:51.299799+0000","last_became_active":"2023-05-08T03:40:49.237867+0000","last_became_peered":"2023-05-08T03:40:49.237867+0000","last_unstale":"2023-05-08T03:40:51.299799+0000","last_undegraded":"2023-05-08T03:40:51.299799+0000","last_fullsized":"2023-05-08T03:40:51.299799+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T15:14:54.147583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991704+0000","last_change":"2023-05-08T03:40:49.242175+0000","last_active":"2023-05-08T03:40:51.991704+0000","last_peered":"2023-05-08T03:40:51.991704+0000","last_clean":"2023-05-08T03:40:51.991704+0000","last_became_active":"2023-05-08T03:40:49.241878+0000","last_became_peered":"2023-05-08T03:40:49.241878+0000","last_unstale":"2023-05-08T03:40:51.991704+0000","last_undegraded":"2023-05-08T03:40:51.991704+0000","last_fullsized":"2023-05-08T03:40:51.991704+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T09:51:42.194781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.222799+0000","last_change":"2023-05-08T03:40:49.234199+0000","last_active":"2023-05-08T03:40:50.222799+0000","last_peered":"2023-05-08T03:40:50.222799+0000","last_clean":"2023-05-08T03:40:50.222799+0000","last_became_active":"2023-05-08T03:40:49.233408+0000","last_became_peered":"2023-05-08T03:40:49.233408+0000","last_unstale":"2023-05-08T03:40:50.222799+0000","last_undegraded":"2023-05-08T03:40:50.222799+0000","last_fullsized":"2023-05-08T03:40:50.222799+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T13:32:03.844376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.222261+0000","last_change":"2023-05-08T03:40:49.235750+0000","last_active":"2023-05-08T03:40:50.222261+0000","last_peered":"2023-05-08T03:40:50.222261+0000","last_clean":"2023-05-08T03:40:50.222261+0000","last_became_active":"2023-05-08T03:40:49.235443+0000","last_became_peered":"2023-05-08T03:40:49.235443+0000","last_unstale":"2023-05-08T03:40:50.222261+0000","last_undegraded":"2023-05-08T03:40:50.222261+0000","last_fullsized":"2023-05-08T03:40:50.222261+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T08:33:00.870579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991226+0000","last_change":"2023-05-08T03:40:49.234269+0000","last_active":"2023-05-08T03:40:51.991226+0000","last_peered":"2023-05-08T03:40:51.991226+0000","last_clean":"2023-05-08T03:40:51.991226+0000","last_became_active":"2023-05-08T03:40:49.233794+0000","last_became_peered":"2023-05-08T03:40:49.233794+0000","last_unstale":"2023-05-08T03:40:51.991226+0000","last_undegraded":"2023-05-08T03:40:51.991226+0000","last_fullsized":"2023-05-08T03:40:51.991226+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T15:01:13.031055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991052+0000","last_change":"2023-05-08T03:40:49.236952+0000","last_active":"2023-05-08T03:40:51.991052+0000","last_peered":"2023-05-08T03:40:51.991052+0000","last_clean":"2023-05-08T03:40:51.991052+0000","last_became_active":"2023-05-08T03:40:49.236406+0000","last_became_peered":"2023-05-08T03:40:49.236406+0000","last_unstale":"2023-05-08T03:40:51.991052+0000","last_undegraded":"2023-05-08T03:40:51.991052+0000","last_fullsized":"2023-05-08T03:40:51.991052+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T11:19:43.015225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991152+0000","last_change":"2023-05-08T03:40:49.231719+0000","last_active":"2023-05-08T03:40:51.991152+0000","last_peered":"2023-05-08T03:40:51.991152+0000","last_clean":"2023-05-08T03:40:51.991152+0000","last_became_active":"2023-05-08T03:40:49.231397+0000","last_became_peered":"2023-05-08T03:40:49.231397+0000","last_unstale":"2023-05-08T03:40:51.991152+0000","last_undegraded":"2023-05-08T03:40:51.991152+0000","last_fullsized":"2023-05-08T03:40:51.991152+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T06:46:52.028194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.290675+0000","last_change":"2023-05-08T03:40:49.238441+0000","last_active":"2023-05-08T03:40:50.290675+0000","last_peered":"2023-05-08T03:40:50.290675+0000","last_clean":"2023-05-08T03:40:50.290675+0000","last_became_active":"2023-05-08T03:40:49.237893+0000","last_became_peered":"2023-05-08T03:40:49.237893+0000","last_unstale":"2023-05-08T03:40:50.290675+0000","last_undegraded":"2023-05-08T03:40:50.290675+0000","last_fullsized":"2023-05-08T03:40:50.290675+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T08:32:34.443745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991614+0000","last_change":"2023-05-08T03:40:49.233431+0000","last_active":"2023-05-08T03:40:51.991614+0000","last_peered":"2023-05-08T03:40:51.991614+0000","last_clean":"2023-05-08T03:40:51.991614+0000","last_became_active":"2023-05-08T03:40:49.233176+0000","last_became_peered":"2023-05-08T03:40:49.233176+0000","last_unstale":"2023-05-08T03:40:51.991614+0000","last_undegraded":"2023-05-08T03:40:51.991614+0000","last_fullsized":"2023-05-08T03:40:51.991614+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T05:33:31.755761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.273400+0000","last_change":"2023-05-08T03:40:49.233907+0000","last_active":"2023-05-08T03:40:51.273400+0000","last_peered":"2023-05-08T03:40:51.273400+0000","last_clean":"2023-05-08T03:40:51.273400+0000","last_became_active":"2023-05-08T03:40:49.233613+0000","last_became_peered":"2023-05-08T03:40:49.233613+0000","last_unstale":"2023-05-08T03:40:51.273400+0000","last_undegraded":"2023-05-08T03:40:51.273400+0000","last_fullsized":"2023-05-08T03:40:51.273400+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T13:34:47.424659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"82'9","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:53.358935+0000","last_change":"2023-05-08T03:40:48.803593+0000","last_active":"2023-05-08T03:40:53.358935+0000","last_peered":"2023-05-08T03:40:53.358935+0000","last_clean":"2023-05-08T03:40:53.358935+0000","last_became_active":"2023-05-08T03:40:48.803287+0000","last_became_peered":"2023-05-08T03:40:48.803287+0000","last_unstale":"2023-05-08T03:40:53.358935+0000","last_undegraded":"2023-05-08T03:40:53.358935+0000","last_fullsized":"2023-05-08T03:40:53.358935+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T14:21:33.903600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:52.175694+0000","last_change":"2023-05-08T03:40:49.238211+0000","last_active":"2023-05-08T03:40:52.175694+0000","last_peered":"2023-05-08T03:40:52.175694+0000","last_clean":"2023-05-08T03:40:52.175694+0000","last_became_active":"2023-05-08T03:40:49.237883+0000","last_became_peered":"2023-05-08T03:40:49.237883+0000","last_unstale":"2023-05-08T03:40:52.175694+0000","last_undegraded":"2023-05-08T03:40:52.175694+0000","last_fullsized":"2023-05-08T03:40:52.175694+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T11:47:15.524106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:52.175718+0000","last_change":"2023-05-08T03:40:48.799399+0000","last_active":"2023-05-08T03:40:52.175718+0000","last_peered":"2023-05-08T03:40:52.175718+0000","last_clean":"2023-05-08T03:40:52.175718+0000","last_became_active":"2023-05-08T03:40:48.798814+0000","last_became_peered":"2023-05-08T03:40:48.798814+0000","last_unstale":"2023-05-08T03:40:52.175718+0000","last_undegraded":"2023-05-08T03:40:52.175718+0000","last_fullsized":"2023-05-08T03:40:52.175718+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T06:10:49.650922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991705+0000","last_change":"2023-05-08T03:40:49.232111+0000","last_active":"2023-05-08T03:40:51.991705+0000","last_peered":"2023-05-08T03:40:51.991705+0000","last_clean":"2023-05-08T03:40:51.991705+0000","last_became_active":"2023-05-08T03:40:49.231440+0000","last_became_peered":"2023-05-08T03:40:49.231440+0000","last_unstale":"2023-05-08T03:40:51.991705+0000","last_undegraded":"2023-05-08T03:40:51.991705+0000","last_fullsized":"2023-05-08T03:40:51.991705+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T10:44:44.588384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"82'4","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:53.359273+0000","last_change":"2023-05-08T03:40:48.801407+0000","last_active":"2023-05-08T03:40:53.359273+0000","last_peered":"2023-05-08T03:40:53.359273+0000","last_clean":"2023-05-08T03:40:53.359273+0000","last_became_active":"2023-05-08T03:40:48.801023+0000","last_became_peered":"2023-05-08T03:40:48.801023+0000","last_unstale":"2023-05-08T03:40:53.359273+0000","last_undegraded":"2023-05-08T03:40:53.359273+0000","last_fullsized":"2023-05-08T03:40:53.359273+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T10:23:23.191427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991571+0000","last_change":"2023-05-08T03:40:49.240406+0000","last_active":"2023-05-08T03:40:51.991571+0000","last_peered":"2023-05-08T03:40:51.991571+0000","last_clean":"2023-05-08T03:40:51.991571+0000","last_became_active":"2023-05-08T03:40:49.240078+0000","last_became_peered":"2023-05-08T03:40:49.240078+0000","last_unstale":"2023-05-08T03:40:51.991571+0000","last_undegraded":"2023-05-08T03:40:51.991571+0000","last_fullsized":"2023-05-08T03:40:51.991571+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T12:24:12.858469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.224945+0000","last_change":"2023-05-08T03:40:48.804918+0000","last_active":"2023-05-08T03:40:50.224945+0000","last_peered":"2023-05-08T03:40:50.224945+0000","last_clean":"2023-05-08T03:40:50.224945+0000","last_became_active":"2023-05-08T03:40:48.804489+0000","last_became_peered":"2023-05-08T03:40:48.804489+0000","last_unstale":"2023-05-08T03:40:50.224945+0000","last_undegraded":"2023-05-08T03:40:50.224945+0000","last_fullsized":"2023-05-08T03:40:50.224945+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T15:23:01.925119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.268788+0000","last_change":"2023-05-08T03:40:49.235173+0000","last_active":"2023-05-08T03:40:51.268788+0000","last_peered":"2023-05-08T03:40:51.268788+0000","last_clean":"2023-05-08T03:40:51.268788+0000","last_became_active":"2023-05-08T03:40:49.234823+0000","last_became_peered":"2023-05-08T03:40:49.234823+0000","last_unstale":"2023-05-08T03:40:51.268788+0000","last_undegraded":"2023-05-08T03:40:51.268788+0000","last_fullsized":"2023-05-08T03:40:51.268788+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T08:27:47.581290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"82'6","reported_seq":60,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:41:29.421659+0000","last_change":"2023-05-08T03:40:48.803696+0000","last_active":"2023-05-08T03:41:29.421659+0000","last_peered":"2023-05-08T03:41:29.421659+0000","last_clean":"2023-05-08T03:41:29.421659+0000","last_became_active":"2023-05-08T03:40:48.803340+0000","last_became_peered":"2023-05-08T03:40:48.803340+0000","last_unstale":"2023-05-08T03:41:29.421659+0000","last_undegraded":"2023-05-08T03:41:29.421659+0000","last_fullsized":"2023-05-08T03:41:29.421659+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T09:28:08.077623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":964,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":40,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.224896+0000","last_change":"2023-05-08T03:40:49.226368+0000","last_active":"2023-05-08T03:40:50.224896+0000","last_peered":"2023-05-08T03:40:50.224896+0000","last_clean":"2023-05-08T03:40:50.224896+0000","last_became_active":"2023-05-08T03:40:49.226071+0000","last_became_peered":"2023-05-08T03:40:49.226071+0000","last_unstale":"2023-05-08T03:40:50.224896+0000","last_undegraded":"2023-05-08T03:40:50.224896+0000","last_fullsized":"2023-05-08T03:40:50.224896+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T13:09:03.133860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"82'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:53.360225+0000","last_change":"2023-05-08T03:40:48.801763+0000","last_active":"2023-05-08T03:40:53.360225+0000","last_peered":"2023-05-08T03:40:53.360225+0000","last_clean":"2023-05-08T03:40:53.360225+0000","last_became_active":"2023-05-08T03:40:48.801424+0000","last_became_peered":"2023-05-08T03:40:48.801424+0000","last_unstale":"2023-05-08T03:40:53.360225+0000","last_undegraded":"2023-05-08T03:40:53.360225+0000","last_fullsized":"2023-05-08T03:40:53.360225+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T06:59:02.055492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.268665+0000","last_change":"2023-05-08T03:40:49.228114+0000","last_active":"2023-05-08T03:40:51.268665+0000","last_peered":"2023-05-08T03:40:51.268665+0000","last_clean":"2023-05-08T03:40:51.268665+0000","last_became_active":"2023-05-08T03:40:49.227468+0000","last_became_peered":"2023-05-08T03:40:49.227468+0000","last_unstale":"2023-05-08T03:40:51.268665+0000","last_undegraded":"2023-05-08T03:40:51.268665+0000","last_fullsized":"2023-05-08T03:40:51.268665+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T14:43:43.602206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"82'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:53.359205+0000","last_change":"2023-05-08T03:40:48.799150+0000","last_active":"2023-05-08T03:40:53.359205+0000","last_peered":"2023-05-08T03:40:53.359205+0000","last_clean":"2023-05-08T03:40:53.359205+0000","last_became_active":"2023-05-08T03:40:48.798782+0000","last_became_peered":"2023-05-08T03:40:48.798782+0000","last_unstale":"2023-05-08T03:40:53.359205+0000","last_undegraded":"2023-05-08T03:40:53.359205+0000","last_fullsized":"2023-05-08T03:40:53.359205+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T14:47:45.547983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:52.175062+0000","last_change":"2023-05-08T03:40:49.233927+0000","last_active":"2023-05-08T03:40:52.175062+0000","last_peered":"2023-05-08T03:40:52.175062+0000","last_clean":"2023-05-08T03:40:52.175062+0000","last_became_active":"2023-05-08T03:40:49.232431+0000","last_became_peered":"2023-05-08T03:40:49.232431+0000","last_unstale":"2023-05-08T03:40:52.175062+0000","last_undegraded":"2023-05-08T03:40:52.175062+0000","last_fullsized":"2023-05-08T03:40:52.175062+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T07:21:25.886329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.323482+0000","last_change":"2023-05-08T03:40:48.801966+0000","last_active":"2023-05-08T03:40:51.323482+0000","last_peered":"2023-05-08T03:40:51.323482+0000","last_clean":"2023-05-08T03:40:51.323482+0000","last_became_active":"2023-05-08T03:40:48.801642+0000","last_became_peered":"2023-05-08T03:40:48.801642+0000","last_unstale":"2023-05-08T03:40:51.323482+0000","last_undegraded":"2023-05-08T03:40:51.323482+0000","last_fullsized":"2023-05-08T03:40:51.323482+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T15:03:06.750289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.990929+0000","last_change":"2023-05-08T03:40:49.229373+0000","last_active":"2023-05-08T03:40:51.990929+0000","last_peered":"2023-05-08T03:40:51.990929+0000","last_clean":"2023-05-08T03:40:51.990929+0000","last_became_active":"2023-05-08T03:40:49.229073+0000","last_became_peered":"2023-05-08T03:40:49.229073+0000","last_unstale":"2023-05-08T03:40:51.990929+0000","last_undegraded":"2023-05-08T03:40:51.990929+0000","last_fullsized":"2023-05-08T03:40:51.990929+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T03:46:49.952461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'3","reported_seq":54,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:41:29.421333+0000","last_change":"2023-05-08T03:40:48.798753+0000","last_active":"2023-05-08T03:41:29.421333+0000","last_peered":"2023-05-08T03:41:29.421333+0000","last_clean":"2023-05-08T03:41:29.421333+0000","last_became_active":"2023-05-08T03:40:48.798370+0000","last_became_peered":"2023-05-08T03:40:48.798370+0000","last_unstale":"2023-05-08T03:41:29.421333+0000","last_undegraded":"2023-05-08T03:41:29.421333+0000","last_fullsized":"2023-05-08T03:41:29.421333+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T10:12:02.944925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.992067+0000","last_change":"2023-05-08T03:40:49.239106+0000","last_active":"2023-05-08T03:40:51.992067+0000","last_peered":"2023-05-08T03:40:51.992067+0000","last_clean":"2023-05-08T03:40:51.992067+0000","last_became_active":"2023-05-08T03:40:49.238801+0000","last_became_peered":"2023-05-08T03:40:49.238801+0000","last_unstale":"2023-05-08T03:40:51.992067+0000","last_undegraded":"2023-05-08T03:40:51.992067+0000","last_fullsized":"2023-05-08T03:40:51.992067+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T15:10:32.817317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:52.351169+0000","last_change":"2023-05-08T03:40:48.800553+0000","last_active":"2023-05-08T03:40:52.351169+0000","last_peered":"2023-05-08T03:40:52.351169+0000","last_clean":"2023-05-08T03:40:52.351169+0000","last_became_active":"2023-05-08T03:40:48.800255+0000","last_became_peered":"2023-05-08T03:40:48.800255+0000","last_unstale":"2023-05-08T03:40:52.351169+0000","last_undegraded":"2023-05-08T03:40:52.351169+0000","last_fullsized":"2023-05-08T03:40:52.351169+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T14:34:04.395527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991717+0000","last_change":"2023-05-08T03:40:49.235832+0000","last_active":"2023-05-08T03:40:51.991717+0000","last_peered":"2023-05-08T03:40:51.991717+0000","last_clean":"2023-05-08T03:40:51.991717+0000","last_became_active":"2023-05-08T03:40:49.235545+0000","last_became_peered":"2023-05-08T03:40:49.235545+0000","last_unstale":"2023-05-08T03:40:51.991717+0000","last_undegraded":"2023-05-08T03:40:51.991717+0000","last_fullsized":"2023-05-08T03:40:51.991717+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T06:40:14.786756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'4","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:52.351116+0000","last_change":"2023-05-08T03:40:48.799767+0000","last_active":"2023-05-08T03:40:52.351116+0000","last_peered":"2023-05-08T03:40:52.351116+0000","last_clean":"2023-05-08T03:40:52.351116+0000","last_became_active":"2023-05-08T03:40:48.799336+0000","last_became_peered":"2023-05-08T03:40:48.799336+0000","last_unstale":"2023-05-08T03:40:52.351116+0000","last_undegraded":"2023-05-08T03:40:52.351116+0000","last_fullsized":"2023-05-08T03:40:52.351116+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T09:47:50.498971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991770+0000","last_change":"2023-05-08T03:40:49.228153+0000","last_active":"2023-05-08T03:40:51.991770+0000","last_peered":"2023-05-08T03:40:51.991770+0000","last_clean":"2023-05-08T03:40:51.991770+0000","last_became_active":"2023-05-08T03:40:49.227584+0000","last_became_peered":"2023-05-08T03:40:49.227584+0000","last_unstale":"2023-05-08T03:40:51.991770+0000","last_undegraded":"2023-05-08T03:40:51.991770+0000","last_fullsized":"2023-05-08T03:40:51.991770+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T04:34:49.590012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'28","reported_seq":124,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:41:30.422196+0000","last_change":"2023-05-08T03:40:48.799126+0000","last_active":"2023-05-08T03:41:30.422196+0000","last_peered":"2023-05-08T03:41:30.422196+0000","last_clean":"2023-05-08T03:41:30.422196+0000","last_became_active":"2023-05-08T03:40:48.798907+0000","last_became_peered":"2023-05-08T03:40:48.798907+0000","last_unstale":"2023-05-08T03:41:30.422196+0000","last_undegraded":"2023-05-08T03:41:30.422196+0000","last_fullsized":"2023-05-08T03:41:30.422196+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T11:24:58.026789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56241,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":82,"num_read_kb":94,"num_write":29,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.225118+0000","last_change":"2023-05-08T03:40:49.237489+0000","last_active":"2023-05-08T03:40:50.225118+0000","last_peered":"2023-05-08T03:40:50.225118+0000","last_clean":"2023-05-08T03:40:50.225118+0000","last_became_active":"2023-05-08T03:40:49.237207+0000","last_became_peered":"2023-05-08T03:40:49.237207+0000","last_unstale":"2023-05-08T03:40:50.225118+0000","last_undegraded":"2023-05-08T03:40:50.225118+0000","last_fullsized":"2023-05-08T03:40:50.225118+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T07:31:36.303437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'6","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:53.358760+0000","last_change":"2023-05-08T03:40:48.803375+0000","last_active":"2023-05-08T03:40:53.358760+0000","last_peered":"2023-05-08T03:40:53.358760+0000","last_clean":"2023-05-08T03:40:53.358760+0000","last_became_active":"2023-05-08T03:40:48.803082+0000","last_became_peered":"2023-05-08T03:40:48.803082+0000","last_unstale":"2023-05-08T03:40:53.358760+0000","last_undegraded":"2023-05-08T03:40:53.358760+0000","last_fullsized":"2023-05-08T03:40:53.358760+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T06:24:55.514429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.222036+0000","last_change":"2023-05-08T03:40:49.235859+0000","last_active":"2023-05-08T03:40:50.222036+0000","last_peered":"2023-05-08T03:40:50.222036+0000","last_clean":"2023-05-08T03:40:50.222036+0000","last_became_active":"2023-05-08T03:40:49.235545+0000","last_became_peered":"2023-05-08T03:40:49.235545+0000","last_unstale":"2023-05-08T03:40:50.222036+0000","last_undegraded":"2023-05-08T03:40:50.222036+0000","last_fullsized":"2023-05-08T03:40:50.222036+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T12:06:59.892758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:52.351208+0000","last_change":"2023-05-08T03:40:48.803838+0000","last_active":"2023-05-08T03:40:52.351208+0000","last_peered":"2023-05-08T03:40:52.351208+0000","last_clean":"2023-05-08T03:40:52.351208+0000","last_became_active":"2023-05-08T03:40:48.803389+0000","last_became_peered":"2023-05-08T03:40:48.803389+0000","last_unstale":"2023-05-08T03:40:52.351208+0000","last_undegraded":"2023-05-08T03:40:52.351208+0000","last_fullsized":"2023-05-08T03:40:52.351208+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T06:25:46.589570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991651+0000","last_change":"2023-05-08T03:40:49.242013+0000","last_active":"2023-05-08T03:40:51.991651+0000","last_peered":"2023-05-08T03:40:51.991651+0000","last_clean":"2023-05-08T03:40:51.991651+0000","last_became_active":"2023-05-08T03:40:49.241649+0000","last_became_peered":"2023-05-08T03:40:49.241649+0000","last_unstale":"2023-05-08T03:40:51.991651+0000","last_undegraded":"2023-05-08T03:40:51.991651+0000","last_fullsized":"2023-05-08T03:40:51.991651+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T11:20:08.806314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'4","reported_seq":56,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:41:27.418254+0000","last_change":"2023-05-08T03:40:48.798327+0000","last_active":"2023-05-08T03:41:27.418254+0000","last_peered":"2023-05-08T03:41:27.418254+0000","last_clean":"2023-05-08T03:41:27.418254+0000","last_became_active":"2023-05-08T03:40:48.797982+0000","last_became_peered":"2023-05-08T03:40:48.797982+0000","last_unstale":"2023-05-08T03:41:27.418254+0000","last_undegraded":"2023-05-08T03:41:27.418254+0000","last_fullsized":"2023-05-08T03:41:27.418254+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T06:11:20.786843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":930,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":39,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991343+0000","last_change":"2023-05-08T03:40:49.233294+0000","last_active":"2023-05-08T03:40:51.991343+0000","last_peered":"2023-05-08T03:40:51.991343+0000","last_clean":"2023-05-08T03:40:51.991343+0000","last_became_active":"2023-05-08T03:40:49.232967+0000","last_became_peered":"2023-05-08T03:40:49.232967+0000","last_unstale":"2023-05-08T03:40:51.991343+0000","last_undegraded":"2023-05-08T03:40:51.991343+0000","last_fullsized":"2023-05-08T03:40:51.991343+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T08:56:19.823724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'15","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:53.359963+0000","last_change":"2023-05-08T03:40:48.800734+0000","last_active":"2023-05-08T03:40:53.359963+0000","last_peered":"2023-05-08T03:40:53.359963+0000","last_clean":"2023-05-08T03:40:53.359963+0000","last_became_active":"2023-05-08T03:40:48.800155+0000","last_became_peered":"2023-05-08T03:40:48.800155+0000","last_unstale":"2023-05-08T03:40:53.359963+0000","last_undegraded":"2023-05-08T03:40:53.359963+0000","last_fullsized":"2023-05-08T03:40:53.359963+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T10:21:52.124912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.268462+0000","last_change":"2023-05-08T03:40:49.230119+0000","last_active":"2023-05-08T03:40:51.268462+0000","last_peered":"2023-05-08T03:40:51.268462+0000","last_clean":"2023-05-08T03:40:51.268462+0000","last_became_active":"2023-05-08T03:40:49.229832+0000","last_became_peered":"2023-05-08T03:40:49.229832+0000","last_unstale":"2023-05-08T03:40:51.268462+0000","last_undegraded":"2023-05-08T03:40:51.268462+0000","last_fullsized":"2023-05-08T03:40:51.268462+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T10:04:22.742738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"82'2","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:54.365041+0000","last_change":"2023-05-08T03:40:48.801423+0000","last_active":"2023-05-08T03:40:54.365041+0000","last_peered":"2023-05-08T03:40:54.365041+0000","last_clean":"2023-05-08T03:40:54.365041+0000","last_became_active":"2023-05-08T03:40:48.801027+0000","last_became_peered":"2023-05-08T03:40:48.801027+0000","last_unstale":"2023-05-08T03:40:54.365041+0000","last_undegraded":"2023-05-08T03:40:54.365041+0000","last_fullsized":"2023-05-08T03:40:54.365041+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T07:32:19.377168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.290441+0000","last_change":"2023-05-08T03:40:49.239315+0000","last_active":"2023-05-08T03:40:50.290441+0000","last_peered":"2023-05-08T03:40:50.290441+0000","last_clean":"2023-05-08T03:40:50.290441+0000","last_became_active":"2023-05-08T03:40:49.239040+0000","last_became_peered":"2023-05-08T03:40:49.239040+0000","last_unstale":"2023-05-08T03:40:50.290441+0000","last_undegraded":"2023-05-08T03:40:50.290441+0000","last_fullsized":"2023-05-08T03:40:50.290441+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T04:36:38.262164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991307+0000","last_change":"2023-05-08T03:40:48.802650+0000","last_active":"2023-05-08T03:40:51.991307+0000","last_peered":"2023-05-08T03:40:51.991307+0000","last_clean":"2023-05-08T03:40:51.991307+0000","last_became_active":"2023-05-08T03:40:48.802358+0000","last_became_peered":"2023-05-08T03:40:48.802358+0000","last_unstale":"2023-05-08T03:40:51.991307+0000","last_undegraded":"2023-05-08T03:40:51.991307+0000","last_fullsized":"2023-05-08T03:40:51.991307+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T05:13:14.266223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'1","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.341060+0000","last_change":"2023-05-08T03:40:49.242103+0000","last_active":"2023-05-08T03:40:51.341060+0000","last_peered":"2023-05-08T03:40:51.341060+0000","last_clean":"2023-05-08T03:40:51.341060+0000","last_became_active":"2023-05-08T03:40:49.241694+0000","last_became_peered":"2023-05-08T03:40:49.241694+0000","last_unstale":"2023-05-08T03:40:51.341060+0000","last_undegraded":"2023-05-08T03:40:51.341060+0000","last_fullsized":"2023-05-08T03:40:51.341060+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T05:51:53.203680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"82'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991825+0000","last_change":"2023-05-08T03:40:48.801754+0000","last_active":"2023-05-08T03:40:51.991825+0000","last_peered":"2023-05-08T03:40:51.991825+0000","last_clean":"2023-05-08T03:40:51.991825+0000","last_became_active":"2023-05-08T03:40:48.801474+0000","last_became_peered":"2023-05-08T03:40:48.801474+0000","last_unstale":"2023-05-08T03:40:51.991825+0000","last_undegraded":"2023-05-08T03:40:51.991825+0000","last_fullsized":"2023-05-08T03:40:51.991825+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T10:17:15.498068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.299563+0000","last_change":"2023-05-08T03:40:49.239292+0000","last_active":"2023-05-08T03:40:51.299563+0000","last_peered":"2023-05-08T03:40:51.299563+0000","last_clean":"2023-05-08T03:40:51.299563+0000","last_became_active":"2023-05-08T03:40:49.238993+0000","last_became_peered":"2023-05-08T03:40:49.238993+0000","last_unstale":"2023-05-08T03:40:51.299563+0000","last_undegraded":"2023-05-08T03:40:51.299563+0000","last_fullsized":"2023-05-08T03:40:51.299563+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T07:31:52.140647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.268485+0000","last_change":"2023-05-08T03:40:49.228268+0000","last_active":"2023-05-08T03:40:51.268485+0000","last_peered":"2023-05-08T03:40:51.268485+0000","last_clean":"2023-05-08T03:40:51.268485+0000","last_became_active":"2023-05-08T03:40:49.227346+0000","last_became_peered":"2023-05-08T03:40:49.227346+0000","last_unstale":"2023-05-08T03:40:51.268485+0000","last_undegraded":"2023-05-08T03:40:51.268485+0000","last_fullsized":"2023-05-08T03:40:51.268485+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T04:14:10.880456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"82'4","reported_seq":56,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:41:30.421648+0000","last_change":"2023-05-08T03:40:48.795133+0000","last_active":"2023-05-08T03:41:30.421648+0000","last_peered":"2023-05-08T03:41:30.421648+0000","last_clean":"2023-05-08T03:41:30.421648+0000","last_became_active":"2023-05-08T03:40:48.794720+0000","last_became_peered":"2023-05-08T03:40:48.794720+0000","last_unstale":"2023-05-08T03:41:30.421648+0000","last_undegraded":"2023-05-08T03:41:30.421648+0000","last_fullsized":"2023-05-08T03:41:30.421648+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T12:37:37.862608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:52.175426+0000","last_change":"2023-05-08T03:40:49.229331+0000","last_active":"2023-05-08T03:40:52.175426+0000","last_peered":"2023-05-08T03:40:52.175426+0000","last_clean":"2023-05-08T03:40:52.175426+0000","last_became_active":"2023-05-08T03:40:49.228878+0000","last_became_peered":"2023-05-08T03:40:49.228878+0000","last_unstale":"2023-05-08T03:40:52.175426+0000","last_undegraded":"2023-05-08T03:40:52.175426+0000","last_fullsized":"2023-05-08T03:40:52.175426+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T03:53:35.836359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"82'3","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:54.364855+0000","last_change":"2023-05-08T03:40:48.796217+0000","last_active":"2023-05-08T03:40:54.364855+0000","last_peered":"2023-05-08T03:40:54.364855+0000","last_clean":"2023-05-08T03:40:54.364855+0000","last_became_active":"2023-05-08T03:40:48.795887+0000","last_became_peered":"2023-05-08T03:40:48.795887+0000","last_unstale":"2023-05-08T03:40:54.364855+0000","last_undegraded":"2023-05-08T03:40:54.364855+0000","last_fullsized":"2023-05-08T03:40:54.364855+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T14:57:30.575267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":340,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991321+0000","last_change":"2023-05-08T03:39:49.036132+0000","last_active":"2023-05-08T03:40:51.991321+0000","last_peered":"2023-05-08T03:40:51.991321+0000","last_clean":"2023-05-08T03:40:51.991321+0000","last_became_active":"2023-05-08T03:39:49.035717+0000","last_became_peered":"2023-05-08T03:39:49.035717+0000","last_unstale":"2023-05-08T03:40:51.991321+0000","last_undegraded":"2023-05-08T03:40:51.991321+0000","last_fullsized":"2023-05-08T03:40:51.991321+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:36:48.527062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:36:48.527062+0000","last_clean_scrub_stamp":"2023-05-08T03:36:48.527062+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T07:02:26.379800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.221853+0000","last_change":"2023-05-08T03:40:49.227299+0000","last_active":"2023-05-08T03:40:50.221853+0000","last_peered":"2023-05-08T03:40:50.221853+0000","last_clean":"2023-05-08T03:40:50.221853+0000","last_became_active":"2023-05-08T03:40:49.226846+0000","last_became_peered":"2023-05-08T03:40:49.226846+0000","last_unstale":"2023-05-08T03:40:50.221853+0000","last_undegraded":"2023-05-08T03:40:50.221853+0000","last_fullsized":"2023-05-08T03:40:50.221853+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T10:55:57.218170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"82'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:53.358519+0000","last_change":"2023-05-08T03:40:48.803480+0000","last_active":"2023-05-08T03:40:53.358519+0000","last_peered":"2023-05-08T03:40:53.358519+0000","last_clean":"2023-05-08T03:40:53.358519+0000","last_became_active":"2023-05-08T03:40:48.803137+0000","last_became_peered":"2023-05-08T03:40:48.803137+0000","last_unstale":"2023-05-08T03:40:53.358519+0000","last_undegraded":"2023-05-08T03:40:53.358519+0000","last_fullsized":"2023-05-08T03:40:53.358519+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T11:08:55.229134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"82'1","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:52.349801+0000","last_change":"2023-05-08T03:40:48.802781+0000","last_active":"2023-05-08T03:40:52.349801+0000","last_peered":"2023-05-08T03:40:52.349801+0000","last_clean":"2023-05-08T03:40:52.349801+0000","last_became_active":"2023-05-08T03:40:48.802461+0000","last_became_peered":"2023-05-08T03:40:48.802461+0000","last_unstale":"2023-05-08T03:40:52.349801+0000","last_undegraded":"2023-05-08T03:40:52.349801+0000","last_fullsized":"2023-05-08T03:40:52.349801+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T11:07:12.386341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.222071+0000","last_change":"2023-05-08T03:40:49.227162+0000","last_active":"2023-05-08T03:40:50.222071+0000","last_peered":"2023-05-08T03:40:50.222071+0000","last_clean":"2023-05-08T03:40:50.222071+0000","last_became_active":"2023-05-08T03:40:49.226841+0000","last_became_peered":"2023-05-08T03:40:49.226841+0000","last_unstale":"2023-05-08T03:40:50.222071+0000","last_undegraded":"2023-05-08T03:40:50.222071+0000","last_fullsized":"2023-05-08T03:40:50.222071+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T05:42:31.361505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'5","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:59.647447+0000","last_change":"2023-05-08T03:40:48.800841+0000","last_active":"2023-05-08T03:40:59.647447+0000","last_peered":"2023-05-08T03:40:59.647447+0000","last_clean":"2023-05-08T03:40:59.647447+0000","last_became_active":"2023-05-08T03:40:48.800198+0000","last_became_peered":"2023-05-08T03:40:48.800198+0000","last_unstale":"2023-05-08T03:40:59.647447+0000","last_undegraded":"2023-05-08T03:40:59.647447+0000","last_fullsized":"2023-05-08T03:40:59.647447+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T07:43:49.169424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:52.175690+0000","last_change":"2023-05-08T03:40:49.234421+0000","last_active":"2023-05-08T03:40:52.175690+0000","last_peered":"2023-05-08T03:40:52.175690+0000","last_clean":"2023-05-08T03:40:52.175690+0000","last_became_active":"2023-05-08T03:40:49.234108+0000","last_became_peered":"2023-05-08T03:40:49.234108+0000","last_unstale":"2023-05-08T03:40:52.175690+0000","last_undegraded":"2023-05-08T03:40:52.175690+0000","last_fullsized":"2023-05-08T03:40:52.175690+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T07:08:12.366030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'4","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:52.350385+0000","last_change":"2023-05-08T03:40:48.792894+0000","last_active":"2023-05-08T03:40:52.350385+0000","last_peered":"2023-05-08T03:40:52.350385+0000","last_clean":"2023-05-08T03:40:52.350385+0000","last_became_active":"2023-05-08T03:40:48.792579+0000","last_became_peered":"2023-05-08T03:40:48.792579+0000","last_unstale":"2023-05-08T03:40:52.350385+0000","last_undegraded":"2023-05-08T03:40:52.350385+0000","last_fullsized":"2023-05-08T03:40:52.350385+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T12:10:35.808903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991740+0000","last_change":"2023-05-08T03:40:49.239032+0000","last_active":"2023-05-08T03:40:51.991740+0000","last_peered":"2023-05-08T03:40:51.991740+0000","last_clean":"2023-05-08T03:40:51.991740+0000","last_became_active":"2023-05-08T03:40:49.238714+0000","last_became_peered":"2023-05-08T03:40:49.238714+0000","last_unstale":"2023-05-08T03:40:51.991740+0000","last_undegraded":"2023-05-08T03:40:51.991740+0000","last_fullsized":"2023-05-08T03:40:51.991740+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T15:12:46.594644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:52.350633+0000","last_change":"2023-05-08T03:40:48.797158+0000","last_active":"2023-05-08T03:40:52.350633+0000","last_peered":"2023-05-08T03:40:52.350633+0000","last_clean":"2023-05-08T03:40:52.350633+0000","last_became_active":"2023-05-08T03:40:48.796851+0000","last_became_peered":"2023-05-08T03:40:48.796851+0000","last_unstale":"2023-05-08T03:40:52.350633+0000","last_undegraded":"2023-05-08T03:40:52.350633+0000","last_fullsized":"2023-05-08T03:40:52.350633+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T05:27:30.250114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.224714+0000","last_change":"2023-05-08T03:40:49.236833+0000","last_active":"2023-05-08T03:40:50.224714+0000","last_peered":"2023-05-08T03:40:50.224714+0000","last_clean":"2023-05-08T03:40:50.224714+0000","last_became_active":"2023-05-08T03:40:49.236520+0000","last_became_peered":"2023-05-08T03:40:49.236520+0000","last_unstale":"2023-05-08T03:40:50.224714+0000","last_undegraded":"2023-05-08T03:40:50.224714+0000","last_fullsized":"2023-05-08T03:40:50.224714+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T08:36:44.900323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:52.354358+0000","last_change":"2023-05-08T03:40:48.791795+0000","last_active":"2023-05-08T03:40:52.354358+0000","last_peered":"2023-05-08T03:40:52.354358+0000","last_clean":"2023-05-08T03:40:52.354358+0000","last_became_active":"2023-05-08T03:40:48.791489+0000","last_became_peered":"2023-05-08T03:40:48.791489+0000","last_unstale":"2023-05-08T03:40:52.354358+0000","last_undegraded":"2023-05-08T03:40:52.354358+0000","last_fullsized":"2023-05-08T03:40:52.354358+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T08:45:26.675522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.290230+0000","last_change":"2023-05-08T03:40:49.232245+0000","last_active":"2023-05-08T03:40:50.290230+0000","last_peered":"2023-05-08T03:40:50.290230+0000","last_clean":"2023-05-08T03:40:50.290230+0000","last_became_active":"2023-05-08T03:40:49.231934+0000","last_became_peered":"2023-05-08T03:40:49.231934+0000","last_unstale":"2023-05-08T03:40:50.290230+0000","last_undegraded":"2023-05-08T03:40:50.290230+0000","last_fullsized":"2023-05-08T03:40:50.290230+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T08:30:46.523751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.273156+0000","last_change":"2023-05-08T03:40:48.803996+0000","last_active":"2023-05-08T03:40:51.273156+0000","last_peered":"2023-05-08T03:40:51.273156+0000","last_clean":"2023-05-08T03:40:51.273156+0000","last_became_active":"2023-05-08T03:40:48.803684+0000","last_became_peered":"2023-05-08T03:40:48.803684+0000","last_unstale":"2023-05-08T03:40:51.273156+0000","last_undegraded":"2023-05-08T03:40:51.273156+0000","last_fullsized":"2023-05-08T03:40:51.273156+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T08:13:18.973444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:52.175439+0000","last_change":"2023-05-08T03:40:49.234152+0000","last_active":"2023-05-08T03:40:52.175439+0000","last_peered":"2023-05-08T03:40:52.175439+0000","last_clean":"2023-05-08T03:40:52.175439+0000","last_became_active":"2023-05-08T03:40:49.233675+0000","last_became_peered":"2023-05-08T03:40:49.233675+0000","last_unstale":"2023-05-08T03:40:52.175439+0000","last_undegraded":"2023-05-08T03:40:52.175439+0000","last_fullsized":"2023-05-08T03:40:52.175439+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T08:53:30.821743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:52.351249+0000","last_change":"2023-05-08T03:40:48.798736+0000","last_active":"2023-05-08T03:40:52.351249+0000","last_peered":"2023-05-08T03:40:52.351249+0000","last_clean":"2023-05-08T03:40:52.351249+0000","last_became_active":"2023-05-08T03:40:48.798418+0000","last_became_peered":"2023-05-08T03:40:48.798418+0000","last_unstale":"2023-05-08T03:40:52.351249+0000","last_undegraded":"2023-05-08T03:40:52.351249+0000","last_fullsized":"2023-05-08T03:40:52.351249+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T07:52:30.962269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991638+0000","last_change":"2023-05-08T03:40:49.235205+0000","last_active":"2023-05-08T03:40:51.991638+0000","last_peered":"2023-05-08T03:40:51.991638+0000","last_clean":"2023-05-08T03:40:51.991638+0000","last_became_active":"2023-05-08T03:40:49.234898+0000","last_became_peered":"2023-05-08T03:40:49.234898+0000","last_unstale":"2023-05-08T03:40:51.991638+0000","last_undegraded":"2023-05-08T03:40:51.991638+0000","last_fullsized":"2023-05-08T03:40:51.991638+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T09:51:49.501098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'3","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:53.359262+0000","last_change":"2023-05-08T03:40:48.802820+0000","last_active":"2023-05-08T03:40:53.359262+0000","last_peered":"2023-05-08T03:40:53.359262+0000","last_clean":"2023-05-08T03:40:53.359262+0000","last_became_active":"2023-05-08T03:40:48.802457+0000","last_became_peered":"2023-05-08T03:40:48.802457+0000","last_unstale":"2023-05-08T03:40:53.359262+0000","last_undegraded":"2023-05-08T03:40:53.359262+0000","last_fullsized":"2023-05-08T03:40:53.359262+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T05:22:19.608125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991798+0000","last_change":"2023-05-08T03:40:49.238318+0000","last_active":"2023-05-08T03:40:51.991798+0000","last_peered":"2023-05-08T03:40:51.991798+0000","last_clean":"2023-05-08T03:40:51.991798+0000","last_became_active":"2023-05-08T03:40:49.237994+0000","last_became_peered":"2023-05-08T03:40:49.237994+0000","last_unstale":"2023-05-08T03:40:51.991798+0000","last_undegraded":"2023-05-08T03:40:51.991798+0000","last_fullsized":"2023-05-08T03:40:51.991798+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T14:44:53.119130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.323617+0000","last_change":"2023-05-08T03:40:48.803795+0000","last_active":"2023-05-08T03:40:51.323617+0000","last_peered":"2023-05-08T03:40:51.323617+0000","last_clean":"2023-05-08T03:40:51.323617+0000","last_became_active":"2023-05-08T03:40:48.803001+0000","last_became_peered":"2023-05-08T03:40:48.803001+0000","last_unstale":"2023-05-08T03:40:51.323617+0000","last_undegraded":"2023-05-08T03:40:51.323617+0000","last_fullsized":"2023-05-08T03:40:51.323617+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T07:43:47.011238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'1","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991502+0000","last_change":"2023-05-08T03:40:49.237298+0000","last_active":"2023-05-08T03:40:51.991502+0000","last_peered":"2023-05-08T03:40:51.991502+0000","last_clean":"2023-05-08T03:40:51.991502+0000","last_became_active":"2023-05-08T03:40:49.236984+0000","last_became_peered":"2023-05-08T03:40:49.236984+0000","last_unstale":"2023-05-08T03:40:51.991502+0000","last_undegraded":"2023-05-08T03:40:51.991502+0000","last_fullsized":"2023-05-08T03:40:51.991502+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T14:05:30.754412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.222153+0000","last_change":"2023-05-08T03:40:48.801987+0000","last_active":"2023-05-08T03:40:50.222153+0000","last_peered":"2023-05-08T03:40:50.222153+0000","last_clean":"2023-05-08T03:40:50.222153+0000","last_became_active":"2023-05-08T03:40:48.801521+0000","last_became_peered":"2023-05-08T03:40:48.801521+0000","last_unstale":"2023-05-08T03:40:50.222153+0000","last_undegraded":"2023-05-08T03:40:50.222153+0000","last_fullsized":"2023-05-08T03:40:50.222153+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T03:49:08.381600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991668+0000","last_change":"2023-05-08T03:40:49.240916+0000","last_active":"2023-05-08T03:40:51.991668+0000","last_peered":"2023-05-08T03:40:51.991668+0000","last_clean":"2023-05-08T03:40:51.991668+0000","last_became_active":"2023-05-08T03:40:49.240626+0000","last_became_peered":"2023-05-08T03:40:49.240626+0000","last_unstale":"2023-05-08T03:40:51.991668+0000","last_undegraded":"2023-05-08T03:40:51.991668+0000","last_fullsized":"2023-05-08T03:40:51.991668+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T06:18:16.782559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.290263+0000","last_change":"2023-05-08T03:40:49.236506+0000","last_active":"2023-05-08T03:40:50.290263+0000","last_peered":"2023-05-08T03:40:50.290263+0000","last_clean":"2023-05-08T03:40:50.290263+0000","last_became_active":"2023-05-08T03:40:49.236065+0000","last_became_peered":"2023-05-08T03:40:49.236065+0000","last_unstale":"2023-05-08T03:40:50.290263+0000","last_undegraded":"2023-05-08T03:40:50.290263+0000","last_fullsized":"2023-05-08T03:40:50.290263+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T04:00:41.965873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.273160+0000","last_change":"2023-05-08T03:40:49.236262+0000","last_active":"2023-05-08T03:40:51.273160+0000","last_peered":"2023-05-08T03:40:51.273160+0000","last_clean":"2023-05-08T03:40:51.273160+0000","last_became_active":"2023-05-08T03:40:49.235892+0000","last_became_peered":"2023-05-08T03:40:49.235892+0000","last_unstale":"2023-05-08T03:40:51.273160+0000","last_undegraded":"2023-05-08T03:40:51.273160+0000","last_fullsized":"2023-05-08T03:40:51.273160+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T11:18:58.158779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.273174+0000","last_change":"2023-05-08T03:40:49.232946+0000","last_active":"2023-05-08T03:40:51.273174+0000","last_peered":"2023-05-08T03:40:51.273174+0000","last_clean":"2023-05-08T03:40:51.273174+0000","last_became_active":"2023-05-08T03:40:49.232642+0000","last_became_peered":"2023-05-08T03:40:49.232642+0000","last_unstale":"2023-05-08T03:40:51.273174+0000","last_undegraded":"2023-05-08T03:40:51.273174+0000","last_fullsized":"2023-05-08T03:40:51.273174+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T05:32:46.280731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991435+0000","last_change":"2023-05-08T03:40:49.238342+0000","last_active":"2023-05-08T03:40:51.991435+0000","last_peered":"2023-05-08T03:40:51.991435+0000","last_clean":"2023-05-08T03:40:51.991435+0000","last_became_active":"2023-05-08T03:40:49.237973+0000","last_became_peered":"2023-05-08T03:40:49.237973+0000","last_unstale":"2023-05-08T03:40:51.991435+0000","last_undegraded":"2023-05-08T03:40:51.991435+0000","last_fullsized":"2023-05-08T03:40:51.991435+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T13:53:38.093200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.222110+0000","last_change":"2023-05-08T03:40:49.226285+0000","last_active":"2023-05-08T03:40:50.222110+0000","last_peered":"2023-05-08T03:40:50.222110+0000","last_clean":"2023-05-08T03:40:50.222110+0000","last_became_active":"2023-05-08T03:40:49.225962+0000","last_became_peered":"2023-05-08T03:40:49.225962+0000","last_unstale":"2023-05-08T03:40:50.222110+0000","last_undegraded":"2023-05-08T03:40:50.222110+0000","last_fullsized":"2023-05-08T03:40:50.222110+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T11:58:59.434249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.290540+0000","last_change":"2023-05-08T03:40:49.238692+0000","last_active":"2023-05-08T03:40:50.290540+0000","last_peered":"2023-05-08T03:40:50.290540+0000","last_clean":"2023-05-08T03:40:50.290540+0000","last_became_active":"2023-05-08T03:40:49.238234+0000","last_became_peered":"2023-05-08T03:40:49.238234+0000","last_unstale":"2023-05-08T03:40:50.290540+0000","last_undegraded":"2023-05-08T03:40:50.290540+0000","last_fullsized":"2023-05-08T03:40:50.290540+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T13:25:41.710681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.273376+0000","last_change":"2023-05-08T03:40:49.227549+0000","last_active":"2023-05-08T03:40:51.273376+0000","last_peered":"2023-05-08T03:40:51.273376+0000","last_clean":"2023-05-08T03:40:51.273376+0000","last_became_active":"2023-05-08T03:40:49.227259+0000","last_became_peered":"2023-05-08T03:40:49.227259+0000","last_unstale":"2023-05-08T03:40:51.273376+0000","last_undegraded":"2023-05-08T03:40:51.273376+0000","last_fullsized":"2023-05-08T03:40:51.273376+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T03:50:25.923147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:52.175680+0000","last_change":"2023-05-08T03:40:49.238832+0000","last_active":"2023-05-08T03:40:52.175680+0000","last_peered":"2023-05-08T03:40:52.175680+0000","last_clean":"2023-05-08T03:40:52.175680+0000","last_became_active":"2023-05-08T03:40:49.238521+0000","last_became_peered":"2023-05-08T03:40:49.238521+0000","last_unstale":"2023-05-08T03:40:52.175680+0000","last_undegraded":"2023-05-08T03:40:52.175680+0000","last_fullsized":"2023-05-08T03:40:52.175680+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T06:59:10.616806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.268410+0000","last_change":"2023-05-08T03:40:49.228489+0000","last_active":"2023-05-08T03:40:51.268410+0000","last_peered":"2023-05-08T03:40:51.268410+0000","last_clean":"2023-05-08T03:40:51.268410+0000","last_became_active":"2023-05-08T03:40:49.228178+0000","last_became_peered":"2023-05-08T03:40:49.228178+0000","last_unstale":"2023-05-08T03:40:51.268410+0000","last_undegraded":"2023-05-08T03:40:51.268410+0000","last_fullsized":"2023-05-08T03:40:51.268410+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T05:47:36.620662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:52.175253+0000","last_change":"2023-05-08T03:40:49.243094+0000","last_active":"2023-05-08T03:40:52.175253+0000","last_peered":"2023-05-08T03:40:52.175253+0000","last_clean":"2023-05-08T03:40:52.175253+0000","last_became_active":"2023-05-08T03:40:49.242775+0000","last_became_peered":"2023-05-08T03:40:49.242775+0000","last_unstale":"2023-05-08T03:40:52.175253+0000","last_undegraded":"2023-05-08T03:40:52.175253+0000","last_fullsized":"2023-05-08T03:40:52.175253+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T12:58:00.099315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991361+0000","last_change":"2023-05-08T03:40:49.228943+0000","last_active":"2023-05-08T03:40:51.991361+0000","last_peered":"2023-05-08T03:40:51.991361+0000","last_clean":"2023-05-08T03:40:51.991361+0000","last_became_active":"2023-05-08T03:40:49.228657+0000","last_became_peered":"2023-05-08T03:40:49.228657+0000","last_unstale":"2023-05-08T03:40:51.991361+0000","last_undegraded":"2023-05-08T03:40:51.991361+0000","last_fullsized":"2023-05-08T03:40:51.991361+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T12:33:01.351116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.222327+0000","last_change":"2023-05-08T03:40:49.233736+0000","last_active":"2023-05-08T03:40:50.222327+0000","last_peered":"2023-05-08T03:40:50.222327+0000","last_clean":"2023-05-08T03:40:50.222327+0000","last_became_active":"2023-05-08T03:40:49.233418+0000","last_became_peered":"2023-05-08T03:40:49.233418+0000","last_unstale":"2023-05-08T03:40:50.222327+0000","last_undegraded":"2023-05-08T03:40:50.222327+0000","last_fullsized":"2023-05-08T03:40:50.222327+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T13:29:20.896557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.290361+0000","last_change":"2023-05-08T03:40:49.235658+0000","last_active":"2023-05-08T03:40:50.290361+0000","last_peered":"2023-05-08T03:40:50.290361+0000","last_clean":"2023-05-08T03:40:50.290361+0000","last_became_active":"2023-05-08T03:40:49.235289+0000","last_became_peered":"2023-05-08T03:40:49.235289+0000","last_unstale":"2023-05-08T03:40:50.290361+0000","last_undegraded":"2023-05-08T03:40:50.290361+0000","last_fullsized":"2023-05-08T03:40:50.290361+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T03:52:16.806774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":60535,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":249,"num_read_kb":189,"num_write":151,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":181605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":133,"ondisk_log_size":133,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":77,"seq":330712481812,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5924,"kb_used_data":860,"kb_used_omap":0,"kb_used_meta":5056,"kb_avail":93739228,"statfs":{"total":95995035648,"available":95988969472,"internally_reserved":0,"allocated":880640,"data_stored":421235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5177344},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 8 03:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.497}]},{"osd":1,"last update":"Mon May 8 03:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.64400000000000002}]},{"osd":2,"last update":"Mon May 8 03:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.56899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":4,"last update":"Mon May 8 03:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.75},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.71799999999999997}]},{"osd":5,"last update":"Mon May 8 03:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.79300000000000004}]},{"osd":6,"last update":"Mon May 8 03:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.872},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1,"5min":1,"15min":1},"last":0.73699999999999999}]},{"osd":7,"last update":"Mon May 8 03:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.80700000000000005}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]},{"osd":9,"last update":"Mon May 8 03:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.90500000000000003}]},{"osd":10,"last update":"Mon May 8 03:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.88600000000000001}]}]},{"osd":10,"up_from":70,"seq":300647710745,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6920,"kb_used_data":1536,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":93738232,"statfs":{"total":95995035648,"available":95987949568,"internally_reserved":0,"allocated":1572864,"data_stored":1069305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":1,"last update":"Mon May 8 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.443},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.46000000000000002}]},{"osd":2,"last update":"Mon May 8 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.60299999999999998}]},{"osd":3,"last update":"Mon May 8 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.48599999999999999}]},{"osd":4,"last update":"Mon May 8 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.42199999999999999}]},{"osd":5,"last update":"Mon May 8 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.57799999999999996}]},{"osd":6,"last update":"Mon May 8 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.51700000000000002}]},{"osd":7,"last update":"Mon May 8 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.68400000000000005}]},{"osd":8,"last update":"Mon May 8 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.52900000000000003}]},{"osd":9,"last update":"Mon May 8 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.61599999999999999}]},{"osd":11,"last update":"Mon May 8 03:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.64900000000000002}]}]},{"osd":9,"up_from":65,"seq":279172874269,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6068,"kb_used_data":876,"kb_used_omap":0,"kb_used_meta":5184,"kb_avail":93739084,"statfs":{"total":95995035648,"available":95988822016,"internally_reserved":0,"allocated":897024,"data_stored":421471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5308416},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 8 03:41:25 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.41699999999999998,"15min":0.41099999999999998},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":2.3570000000000002,"5min":2.3570000000000002,"15min":2.3570000000000002},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.41499999999999998,"15min":0.42499999999999999},"min":{"1min":0.26700000000000002,"5min":0.247,"15min":0.247},"max":{"1min":0.46100000000000002,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.32100000000000001}]},{"osd":1,"last update":"Mon May 8 03:41:25 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58899999999999997,"15min":0.59199999999999997},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.625,"15min":0.621},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":2.339,"5min":2.339,"15min":2.339},"last":0.58799999999999997}]},{"osd":2,"last update":"Mon May 8 03:41:25 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.65500000000000003,"15min":0.65600000000000003},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":2.306,"5min":2.306,"15min":2.306},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.56200000000000006,"15min":0.55200000000000005},"min":{"1min":0.42799999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":2.3839999999999999,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":0.57799999999999996}]},{"osd":3,"last update":"Mon May 8 03:41:25 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.495,"15min":0.503},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.375},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.52900000000000003,"15min":0.52500000000000002},"min":{"1min":0.34399999999999997,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":2.2629999999999999,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":0.36299999999999999}]},{"osd":4,"last update":"Mon May 8 03:41:25 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.57699999999999996,"15min":0.56799999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":2.1720000000000002,"5min":2.1720000000000002,"15min":2.1720000000000002},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.64200000000000002,"15min":0.64600000000000002},"min":{"1min":0.46200000000000002,"5min":0.442,"15min":0.442},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.70599999999999996}]},{"osd":5,"last update":"Mon May 8 03:41:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.63300000000000001,"15min":0.64300000000000002},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.67900000000000005,"15min":0.69399999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.81000000000000005,"5min":1.044,"15min":1.044},"last":0.67400000000000004}]},{"osd":6,"last update":"Mon May 8 03:41:25 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.66200000000000003,"15min":0.65400000000000003},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":4.7389999999999999,"5min":4.7389999999999999,"15min":4.7389999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.56599999999999995,"15min":0.56999999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":2.137,"5min":2.137,"15min":2.137},"last":0.39400000000000002}]},{"osd":7,"last update":"Mon May 8 03:41:25 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.70599999999999996,"15min":0.71599999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0169999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.73499999999999999,"15min":0.74299999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.69799999999999995}]},{"osd":8,"last update":"Mon May 8 03:41:25 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.45300000000000001,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":2.323,"5min":2.323,"15min":2.323},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.70899999999999996,"15min":0.71099999999999997},"min":{"1min":0.48799999999999999,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.591,"5min":1.591,"15min":1.591},"last":0.66400000000000003}]},{"osd":10,"last update":"Mon May 8 03:40:49 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.61199999999999999}]}]},{"osd":8,"up_from":58,"seq":249108103201,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6256,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":93738896,"statfs":{"total":95995035648,"available":95988629504,"internally_reserved":0,"allocated":892928,"data_stored":421060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 8 03:41:05 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54900000000000004,"15min":0.54700000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.73799999999999999,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.53800000000000003,"15min":0.54200000000000004},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.67800000000000005,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.39100000000000001}]},{"osd":1,"last update":"Mon May 8 03:41:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58299999999999996,"15min":0.58399999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.93200000000000005,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.53600000000000003,"15min":0.53400000000000003},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.48499999999999999}]},{"osd":2,"last update":"Mon May 8 03:41:05 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.47099999999999997,"15min":0.47299999999999998},"min":{"1min":0.28599999999999998,"5min":0.25,"15min":0.25},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46999999999999997,"15min":0.47199999999999998},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.50900000000000001}]},{"osd":3,"last update":"Mon May 8 03:41:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.61399999999999999,"15min":0.621},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.84799999999999998,"5min":1.036,"15min":1.036},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.62,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.65500000000000003}]},{"osd":4,"last update":"Mon May 8 03:41:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.61599999999999999,"15min":0.61199999999999999},"min":{"1min":0.40300000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.89200000000000002,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.624,"15min":0.626},"min":{"1min":0.41199999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.82799999999999996,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.68799999999999994}]},{"osd":5,"last update":"Mon May 8 03:41:05 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.314,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.879,"5min":1.087,"15min":1.087},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.57799999999999996,"15min":0.57699999999999996},"min":{"1min":0.33000000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.72399999999999998}]},{"osd":6,"last update":"Mon May 8 03:41:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.64700000000000002,"15min":0.65100000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.68200000000000005,"15min":0.68600000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.91500000000000004,"5min":1.196,"15min":1.196},"last":0.71399999999999997}]},{"osd":7,"last update":"Mon May 8 03:41:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.68400000000000005,"15min":0.68600000000000005},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.70999999999999996,"15min":0.70799999999999996},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.80000000000000004}]},{"osd":9,"last update":"Mon May 8 03:41:27 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.70799999999999996,"15min":0.69599999999999995},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.68899999999999995,"15min":0.68100000000000005},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.78000000000000003}]},{"osd":10,"last update":"Mon May 8 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.85699999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]}]},{"osd":7,"up_from":50,"seq":214748364837,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6904,"kb_used_data":1456,"kb_used_omap":0,"kb_used_meta":5440,"kb_avail":93738248,"statfs":{"total":95995035648,"available":95987965952,"internally_reserved":0,"allocated":1490944,"data_stored":1013620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5570560},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 8 03:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.52600000000000002,"15min":0.52000000000000002},"min":{"1min":0.36899999999999999,"5min":0.311,"15min":0.311},"max":{"1min":0.76300000000000001,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.434},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.57699999999999996,"15min":0.58099999999999996},"min":{"1min":0.42799999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.66400000000000003,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.45100000000000001}]},{"osd":1,"last update":"Mon May 8 03:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.40799999999999997,"15min":0.40200000000000002},"min":{"1min":0.29499999999999998,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.45800000000000002,"15min":0.45600000000000002},"min":{"1min":0.311,"5min":0.248,"15min":0.248},"max":{"1min":0.68700000000000006,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.502}]},{"osd":2,"last update":"Mon May 8 03:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.61699999999999999,"15min":0.61799999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.59099999999999997,"15min":0.58299999999999996},"min":{"1min":0.48499999999999999,"5min":0.378,"15min":0.378},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.53500000000000003}]},{"osd":3,"last update":"Mon May 8 03:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.54300000000000004,"15min":0.54500000000000004},"min":{"1min":0.38100000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.73399999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.58299999999999996,"15min":0.57699999999999996},"min":{"1min":0.39800000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.47999999999999998}]},{"osd":4,"last update":"Mon May 8 03:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.55600000000000005,"15min":0.56100000000000005},"min":{"1min":0.32300000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.76500000000000001,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.52700000000000002,"15min":0.52600000000000002},"min":{"1min":0.33500000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.73599999999999999,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.44500000000000001}]},{"osd":5,"last update":"Mon May 8 03:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.64200000000000002,"15min":0.63800000000000001},"min":{"1min":0.51300000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.80100000000000005,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.66500000000000004,"15min":0.66100000000000003},"min":{"1min":0.56699999999999995,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.79400000000000004,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.60999999999999999}]},{"osd":6,"last update":"Mon May 8 03:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.67100000000000004,"15min":0.66800000000000004},"min":{"1min":0.52000000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.90000000000000002,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":1.7370000000000001},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.66200000000000003,"15min":0.65700000000000003},"min":{"1min":0.46000000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.92100000000000004}]},{"osd":8,"last update":"Mon May 8 03:41:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.69399999999999995,"15min":0.70199999999999996},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.77900000000000003,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.70399999999999996,"15min":0.70299999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.65100000000000002}]},{"osd":9,"last update":"Mon May 8 03:41:28 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.74099999999999999,"15min":0.752},"min":{"1min":0.53800000000000003,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.80600000000000005,"5min":1.258,"15min":1.258},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.55400000000000005,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.77200000000000002}]},{"osd":10,"last update":"Mon May 8 03:40:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.72599999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]}]},{"osd":6,"up_from":45,"seq":193273528361,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6184,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":5312,"kb_avail":93738968,"statfs":{"total":95995035648,"available":95988703232,"internally_reserved":0,"allocated":884736,"data_stored":420866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5439488},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 8 03:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.38100000000000001,"15min":0.36799999999999999},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.34000000000000002}]},{"osd":1,"last update":"Mon May 8 03:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.53400000000000003,"15min":0.53500000000000003},"min":{"1min":0.35399999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.53500000000000003,"15min":0.53300000000000003},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.66000000000000003}]},{"osd":2,"last update":"Mon May 8 03:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.53700000000000003,"15min":0.53500000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.56000000000000005,"15min":0.55800000000000005},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.78500000000000003}]},{"osd":3,"last update":"Mon May 8 03:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.42999999999999999,"15min":0.42799999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.46300000000000002,"15min":0.45800000000000002},"min":{"1min":0.32000000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.623}]},{"osd":4,"last update":"Mon May 8 03:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.80800000000000005,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.58599999999999997,"15min":0.59099999999999997},"min":{"1min":0.39700000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.75600000000000001}]},{"osd":5,"last update":"Mon May 8 03:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.59599999999999997,"15min":0.59399999999999997},"min":{"1min":0.40899999999999997,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.70899999999999996,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.83299999999999996,"5min":0.878,"15min":0.878},"last":0.58499999999999996}]},{"osd":7,"last update":"Mon May 8 03:40:43 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.64200000000000002,"15min":0.64000000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.63800000000000001,"15min":0.63200000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.871}]},{"osd":8,"last update":"Mon May 8 03:41:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.67200000000000004,"15min":0.67700000000000005},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.66600000000000004,"15min":0.66800000000000004},"min":{"1min":0.51900000000000002,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.81000000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.60699999999999998}]},{"osd":9,"last update":"Mon May 8 03:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.65500000000000003,"15min":0.67100000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.64800000000000002,"15min":0.66500000000000004},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.69099999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.81499999999999995}]},{"osd":10,"last update":"Mon May 8 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.89400000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574913,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7264,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":6336,"kb_avail":93737888,"statfs":{"total":95995035648,"available":95987597312,"internally_reserved":0,"allocated":942080,"data_stored":476894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6488064},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 8 03:40:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.51200000000000001,"15min":0.496},"min":{"1min":0.372,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.81299999999999994,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.50900000000000001,"15min":0.47699999999999998},"min":{"1min":0.39200000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.68799999999999994}]},{"osd":2,"last update":"Mon May 8 03:40:53 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.54800000000000004,"15min":0.51400000000000001},"min":{"1min":0.46800000000000003,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.626,"5min":0.54200000000000004,"15min":0.504},"min":{"1min":0.497,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.58499999999999996}]},{"osd":3,"last update":"Mon May 8 03:41:16 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.56899999999999995,"15min":0.51900000000000002},"min":{"1min":0.41099999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.625,"5min":0.55500000000000005,"15min":0.52200000000000002},"min":{"1min":0.45200000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.56699999999999995}]},{"osd":4,"last update":"Mon May 8 03:40:38 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.42399999999999999,"15min":0.40600000000000003},"min":{"1min":0.30499999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.498,"15min":0.46800000000000003},"min":{"1min":0.373,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.38800000000000001}]},{"osd":5,"last update":"Mon May 8 03:41:03 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.56899999999999995,"15min":0.56299999999999994},"min":{"1min":0.51600000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.60199999999999998,"15min":0.57599999999999996},"min":{"1min":0.59799999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.67500000000000004}]},{"osd":6,"last update":"Mon May 8 03:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.629,"15min":0.60699999999999998},"min":{"1min":0.437,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.755,"5min":0.64700000000000002,"15min":0.61599999999999999},"min":{"1min":0.46800000000000003,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.5900000000000001,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.63700000000000001}]},{"osd":7,"last update":"Mon May 8 03:40:43 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.55000000000000004,"15min":0.53000000000000003},"min":{"1min":0.36799999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.58799999999999997,"15min":0.56699999999999995},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.45600000000000002}]},{"osd":8,"last update":"Mon May 8 03:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.70399999999999996,"15min":0.68999999999999995},"min":{"1min":0.54700000000000004,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.98599999999999999,"5min":1.03,"15min":1.03},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.64800000000000002,"15min":0.63500000000000001},"min":{"1min":0.55600000000000005,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.89000000000000001,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.70699999999999996}]},{"osd":9,"last update":"Mon May 8 03:41:28 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.78100000000000003,"15min":0.76900000000000002},"min":{"1min":0.57399999999999995,"5min":0.44,"15min":0.44},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.70899999999999996,"15min":0.69699999999999995},"min":{"1min":0.51100000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.66400000000000003}]},{"osd":10,"last update":"Mon May 8 03:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.505},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.62}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738437,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7164,"kb_used_data":884,"kb_used_omap":0,"kb_used_meta":6272,"kb_avail":93737988,"statfs":{"total":95995035648,"available":95987699712,"internally_reserved":0,"allocated":905216,"data_stored":422131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6422528},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon May 8 03:40:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.57699999999999996,"15min":0.59799999999999998},"min":{"1min":0.40899999999999997,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.0600000000000001,"5min":1.091,"15min":1.091},"last":0.435},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59299999999999997,"15min":0.60699999999999998},"min":{"1min":0.46300000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.54800000000000004}]},{"osd":2,"last update":"Mon May 8 03:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.53500000000000003,"15min":0.53100000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.69399999999999995,"5min":1.159,"15min":1.159},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.51800000000000002,"15min":0.505},"min":{"1min":0.35299999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.67800000000000005,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.46600000000000003}]},{"osd":3,"last update":"Mon May 8 03:39:17 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.34999999999999998,"15min":0.34300000000000003},"min":{"1min":0.26500000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.435,"5min":0.38800000000000001,"15min":0.38},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.39200000000000002}]},{"osd":4,"last update":"Mon May 8 03:40:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.54200000000000004,"15min":0.53500000000000003},"min":{"1min":0.42999999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.51700000000000002,"15min":0.51300000000000001},"min":{"1min":0.38,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.70299999999999996,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.52000000000000002}]},{"osd":5,"last update":"Mon May 8 03:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.55700000000000005,"15min":0.55300000000000005},"min":{"1min":0.47399999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.70699999999999996,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.497},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.67100000000000004,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.57799999999999996}]},{"osd":6,"last update":"Mon May 8 03:41:23 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.46999999999999997,"15min":0.46200000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.877,"5min":1.877,"15min":1.877},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54500000000000004,"15min":0.53500000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.8879999999999999,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":0.505}]},{"osd":7,"last update":"Mon May 8 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.61499999999999999,"15min":0.60899999999999999},"min":{"1min":0.48399999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.59499999999999997,"15min":0.59299999999999997},"min":{"1min":0.41999999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.47899999999999998}]},{"osd":8,"last update":"Mon May 8 03:41:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60199999999999998,"15min":0.60099999999999998},"min":{"1min":0.441,"5min":0.376,"15min":0.376},"max":{"1min":0.80200000000000005,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.624,"5min":0.65200000000000002,"15min":0.65700000000000003},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.82199999999999995,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.55900000000000005}]},{"osd":9,"last update":"Mon May 8 03:41:28 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.57399999999999995,"15min":0.59099999999999997},"min":{"1min":0.35699999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.65500000000000003,"5min":0.873,"15min":0.873},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.501,"5min":0.64500000000000002,"15min":0.66900000000000004},"min":{"1min":0.36899999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.79700000000000004,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.44600000000000001}]},{"osd":10,"last update":"Mon May 8 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.57299999999999995}]},{"osd":11,"last update":"Mon May 8 03:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.626},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.59299999999999997}]}]},{"osd":2,"up_from":18,"seq":77309411389,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7352,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":6400,"kb_avail":93737800,"statfs":{"total":95995035648,"available":95987507200,"internally_reserved":0,"allocated":966656,"data_stored":478586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6553600},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 8 03:40:57 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.51400000000000001,"15min":0.51800000000000002},"min":{"1min":0.315,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.72599999999999998,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.53900000000000003,"15min":0.51900000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.77000000000000002,"5min":2.044,"15min":2.044},"last":0.70299999999999996}]},{"osd":1,"last update":"Mon May 8 03:40:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.53500000000000003,"15min":0.51900000000000002},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.54100000000000004,"15min":0.53500000000000003},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.71699999999999997}]},{"osd":3,"last update":"Mon May 8 03:41:19 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.61399999999999999,"15min":0.55700000000000005},"min":{"1min":0.38100000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.927,"5min":4.8419999999999996,"15min":4.8419999999999996},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.64200000000000002,"15min":0.59199999999999997},"min":{"1min":0.45300000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.9410000000000001,"5min":4.8220000000000001,"15min":4.8220000000000001},"last":0.66500000000000004}]},{"osd":4,"last update":"Mon May 8 03:40:36 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.53100000000000003,"15min":0.51700000000000002},"min":{"1min":0.39900000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.55700000000000005,"15min":0.54800000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.65100000000000002}]},{"osd":5,"last update":"Mon May 8 03:40:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.46700000000000003,"15min":0.46200000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.52300000000000002,"15min":0.51800000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.68400000000000005}]},{"osd":6,"last update":"Mon May 8 03:41:25 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64500000000000002,"15min":0.64700000000000002},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.90400000000000003,"5min":1.887,"15min":1.887},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.61299999999999999,"15min":0.59099999999999997},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.626}]},{"osd":7,"last update":"Mon May 8 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.61399999999999999,"15min":0.60199999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.58299999999999996,"15min":0.56599999999999995},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.46200000000000002}]},{"osd":8,"last update":"Mon May 8 03:41:05 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.53600000000000003,"15min":0.52000000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.60499999999999998,"15min":0.58499999999999996},"min":{"1min":0.39200000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.79300000000000004}]},{"osd":9,"last update":"Mon May 8 03:41:25 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.73099999999999998,"15min":0.72299999999999998},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.716,"5min":1.716,"15min":1.716},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.753,"5min":0.69499999999999995,"15min":0.68500000000000005},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":0.77800000000000002}]},{"osd":10,"last update":"Mon May 8 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.83299999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]}]},{"osd":3,"up_from":25,"seq":107374182455,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6516,"kb_used_data":876,"kb_used_omap":0,"kb_used_meta":5632,"kb_avail":93738636,"statfs":{"total":95995035648,"available":95988363264,"internally_reserved":0,"allocated":897024,"data_stored":420852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5767168},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 8 03:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.36299999999999999,"15min":0.34699999999999998},"min":{"1min":0.27900000000000003,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.52000000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.39400000000000002,"15min":0.38300000000000001},"min":{"1min":0.29399999999999998,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.53100000000000003,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.30399999999999999}]},{"osd":1,"last update":"Mon May 8 03:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.51600000000000001,"15min":0.495},"min":{"1min":0.34300000000000003,"5min":0.309,"15min":0.309},"max":{"1min":0.68400000000000005,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.316},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.54200000000000004,"15min":0.51200000000000001},"min":{"1min":0.45000000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.68700000000000006,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.41299999999999998}]},{"osd":2,"last update":"Mon May 8 03:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.55700000000000005,"15min":0.53100000000000003},"min":{"1min":0.45000000000000001,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.745,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56499999999999995,"15min":0.53300000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73599999999999999,"5min":2.351,"15min":2.351},"last":0.42099999999999999}]},{"osd":4,"last update":"Mon May 8 03:40:38 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.54400000000000004,"15min":0.52100000000000002},"min":{"1min":0.47399999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.878,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.55700000000000005,"15min":0.53300000000000003},"min":{"1min":0.45100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.88400000000000001,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.33600000000000002}]},{"osd":5,"last update":"Mon May 8 03:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.57399999999999995,"15min":0.57699999999999996},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.66500000000000004,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.58999999999999997,"15min":0.58199999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.79500000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.499}]},{"osd":6,"last update":"Mon May 8 03:41:23 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47899999999999998,"15min":0.46000000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.69599999999999995,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.49399999999999999,"15min":0.47899999999999998},"min":{"1min":0.36099999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.71399999999999997,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.27500000000000002}]},{"osd":7,"last update":"Mon May 8 03:40:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.58899999999999997,"15min":0.57899999999999996},"min":{"1min":0.42999999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.373},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.71099999999999997,"15min":0.71199999999999997},"min":{"1min":0.44600000000000001,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.01,"5min":2.3740000000000001,"15min":2.3740000000000001},"last":0.59799999999999998}]},{"osd":8,"last update":"Mon May 8 03:40:03 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.46200000000000002}]},{"osd":9,"last update":"Mon May 8 03:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.65600000000000003,"15min":0.67200000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.75700000000000001,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.66400000000000003,"15min":0.68500000000000005},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.76100000000000001,"5min":1.089,"15min":1.089},"last":0.40100000000000002}]},{"osd":10,"last update":"Mon May 8 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.61699999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]}]},{"osd":4,"up_from":33,"seq":141733920818,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6380,"kb_used_data":868,"kb_used_omap":0,"kb_used_meta":5504,"kb_avail":93738772,"statfs":{"total":95995035648,"available":95988502528,"internally_reserved":0,"allocated":888832,"data_stored":421639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5636096},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 8 03:40:39 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.55400000000000005,"15min":0.55000000000000004},"min":{"1min":0.38500000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.80400000000000005,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.53300000000000003,"15min":0.51700000000000002},"min":{"1min":0.42799999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76300000000000001,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.57399999999999995}]},{"osd":1,"last update":"Mon May 8 03:40:39 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.36899999999999999,"15min":0.34000000000000002},"min":{"1min":0.27400000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.38900000000000001,"15min":0.35699999999999998},"min":{"1min":0.29099999999999998,"5min":0.254,"15min":0.254},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.42399999999999999}]},{"osd":2,"last update":"Mon May 8 03:40:39 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.54800000000000004,"15min":0.52800000000000002},"min":{"1min":0.38600000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.56699999999999995,"15min":0.54900000000000004},"min":{"1min":0.40200000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.73399999999999999}]},{"osd":3,"last update":"Mon May 8 03:40:39 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.54300000000000004,"15min":0.51800000000000002},"min":{"1min":0.41999999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.79800000000000004,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.54800000000000004,"15min":0.53300000000000003},"min":{"1min":0.40400000000000003,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.45000000000000001}]},{"osd":5,"last update":"Mon May 8 03:41:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.59299999999999997,"15min":0.57799999999999996},"min":{"1min":0.48199999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.88800000000000001,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.61199999999999999,"15min":0.59399999999999997},"min":{"1min":0.439,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.68899999999999995}]},{"osd":6,"last update":"Mon May 8 03:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.61599999999999999,"15min":0.61199999999999999},"min":{"1min":0.45500000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.93000000000000005,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.624,"15min":0.60999999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.97699999999999998,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.497}]},{"osd":7,"last update":"Mon May 8 03:40:39 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.57099999999999995,"15min":0.56000000000000005},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.751},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.56899999999999995,"15min":0.55700000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.54000000000000004}]},{"osd":8,"last update":"Mon May 8 03:41:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.65900000000000003,"15min":0.64700000000000002},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.98499999999999999,"5min":1.075,"15min":1.075},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.67900000000000005,"15min":0.66900000000000004},"min":{"1min":0.48899999999999999,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.82399999999999995}]},{"osd":9,"last update":"Mon May 8 03:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.73199999999999998,"15min":0.746},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.88500000000000001,"5min":1.125,"15min":1.125},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.73199999999999998,"15min":0.73999999999999999},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.94899999999999995,"5min":1.014,"15min":1.014},"last":0.60999999999999999}]},{"osd":10,"last update":"Mon May 8 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.81000000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]}]},{"osd":5,"up_from":38,"seq":163208757295,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7044,"kb_used_data":1468,"kb_used_omap":0,"kb_used_meta":5568,"kb_avail":93738108,"statfs":{"total":95995035648,"available":95987822592,"internally_reserved":0,"allocated":1503232,"data_stored":1012962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5701632},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 8 03:41:03 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.504,"15min":0.48799999999999999},"min":{"1min":0.35399999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.70399999999999996,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.51300000000000001,"15min":0.501},"min":{"1min":0.32500000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.69999999999999996,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.49199999999999999}]},{"osd":1,"last update":"Mon May 8 03:41:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.54100000000000004,"15min":0.53300000000000003},"min":{"1min":0.39700000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.71599999999999997,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.56000000000000005,"15min":0.55000000000000004},"min":{"1min":0.34200000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.79200000000000004,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.72699999999999998}]},{"osd":2,"last update":"Mon May 8 03:41:03 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.38900000000000001,"15min":0.376},"min":{"1min":0.32400000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.61199999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.40699999999999997,"15min":0.39600000000000002},"min":{"1min":0.30199999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.63900000000000001,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.65800000000000003}]},{"osd":3,"last update":"Mon May 8 03:41:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.52300000000000002,"15min":0.501},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.73099999999999998,"5min":1.083,"15min":1.083},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.53500000000000003,"15min":0.52300000000000002},"min":{"1min":0.33200000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.69699999999999995,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.623}]},{"osd":4,"last update":"Mon May 8 03:41:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.57999999999999996,"15min":0.56799999999999995},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.82099999999999995,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.57999999999999996,"15min":0.56699999999999995},"min":{"1min":0.42699999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.78200000000000003,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.69599999999999995}]},{"osd":6,"last update":"Mon May 8 03:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.57499999999999996,"15min":0.55100000000000005},"min":{"1min":0.39100000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.77700000000000002,"5min":1.175,"15min":1.175},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.56000000000000005,"15min":0.53400000000000003},"min":{"1min":0.45100000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.746,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.67400000000000004}]},{"osd":7,"last update":"Mon May 8 03:40:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.627,"15min":0.625},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.92300000000000004,"5min":1.018,"15min":1.018},"last":0.751},{"interface":"front","average":{"1min":0.62,"5min":0.63300000000000001,"15min":0.63500000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.82299999999999995,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.76700000000000002}]},{"osd":8,"last update":"Mon May 8 03:41:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.60799999999999998,"15min":0.61599999999999999},"min":{"1min":0.40999999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.75800000000000001,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.628,"15min":0.63},"min":{"1min":0.47499999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.81399999999999995,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.79700000000000004}]},{"osd":9,"last update":"Mon May 8 03:41:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.73599999999999999,"15min":0.749},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.81999999999999995,"5min":1.306,"15min":1.306},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.71899999999999997,"15min":0.72799999999999998},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.79600000000000004,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.82299999999999995}]},{"osd":10,"last update":"Mon May 8 03:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.86299999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":56241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":57933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":58161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-08T03:41:34.515 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- ceph pg dump --format=json 2023-05-08T03:41:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:34 smithi133 ceph-mon[125939]: pgmap v280: 97 pgs: 97 active+clean; 636 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 5 op/s 2023-05-08T03:41:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:34 smithi096 ceph-mon[124666]: pgmap v280: 97 pgs: 97 active+clean; 636 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 5 op/s 2023-05-08T03:41:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:34 smithi186 ceph-mon[126480]: pgmap v280: 97 pgs: 97 active+clean; 636 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 5 op/s 2023-05-08T03:41:35.162 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.a/config 2023-05-08T03:41:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:35 smithi133 ceph-mon[125939]: from='client.14949 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-05-08T03:41:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:35 smithi096 ceph-mon[124666]: from='client.14949 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-05-08T03:41:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:35 smithi186 ceph-mon[126480]: from='client.14949 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-05-08T03:41:36.363 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:36.359+0000 7fd0a7ccd700 1 -- 172.21.15.96:0/2394404469 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0a01056e0 msgr2=0x7fd0a010d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:36.364 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:36.359+0000 7fd0a7ccd700 1 --2- 172.21.15.96:0/2394404469 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0a01056e0 0x7fd0a010d260 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd09800b0d0 tx=0x7fd09800b3e0 comp rx=0 tx=0).stop 2023-05-08T03:41:36.364 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:36.359+0000 7fd0a7ccd700 1 -- 172.21.15.96:0/2394404469 shutdown_connections 2023-05-08T03:41:36.364 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:36.359+0000 7fd0a7ccd700 1 --2- 172.21.15.96:0/2394404469 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0a01056e0 0x7fd0a010d260 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:36.364 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:36.359+0000 7fd0a7ccd700 1 --2- 172.21.15.96:0/2394404469 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd0a0100640 0x7fd0a0100a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:36.364 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:36.359+0000 7fd0a7ccd700 1 --2- 172.21.15.96:0/2394404469 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0a0100fe0 0x7fd0a0104fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:36.365 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:36.359+0000 7fd0a7ccd700 1 -- 172.21.15.96:0/2394404469 >> 172.21.15.96:0/2394404469 conn(0x7fd0a00fbec0 msgr2=0x7fd0a00fe2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:36.365 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:36.359+0000 7fd0a7ccd700 1 -- 172.21.15.96:0/2394404469 shutdown_connections 2023-05-08T03:41:36.365 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:36.359+0000 7fd0a7ccd700 1 -- 172.21.15.96:0/2394404469 wait complete. 2023-05-08T03:41:36.365 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:36.360+0000 7fd0a7ccd700 1 Processor -- start 2023-05-08T03:41:36.365 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:36.360+0000 7fd0a7ccd700 1 -- start start 2023-05-08T03:41:36.365 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:36.360+0000 7fd0a7ccd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0a0100640 0x7fd0a019e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:36.365 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:36.360+0000 7fd0a7ccd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0a0100fe0 0x7fd0a019ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:36.366 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:36.360+0000 7fd0a7ccd700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd0a01056e0 0x7fd0a0198740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:36.366 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:36.360+0000 7fd0a7ccd700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a0198db0 con 0x7fd0a0100fe0 2023-05-08T03:41:36.366 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:36.360+0000 7fd0a7ccd700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a0198f20 con 0x7fd0a0100640 2023-05-08T03:41:36.366 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:36.360+0000 7fd0a7ccd700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a01990e0 con 0x7fd0a01056e0 2023-05-08T03:41:36.366 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:36.360+0000 7fd0a5268700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0a0100fe0 0x7fd0a019ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:36.366 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:36.360+0000 7fd0a5268700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0a0100fe0 0x7fd0a019ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41046/0 (socket says 172.21.15.96:41046) 2023-05-08T03:41:36.366 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:36.360+0000 7fd0a5268700 1 -- 172.21.15.96:0/1694073968 learned_addr learned my addr 172.21.15.96:0/1694073968 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:41:36.366 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:36.360+0000 7fd0a5a69700 1 --2- 172.21.15.96:0/1694073968 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0a0100640 0x7fd0a019e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:36.367 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:36.360+0000 7fd0a626a700 1 --2- 172.21.15.96:0/1694073968 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd0a01056e0 0x7fd0a0198740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:36.367 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:36.360+0000 7fd0a5268700 1 -- 172.21.15.96:0/1694073968 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd0a01056e0 msgr2=0x7fd0a0198740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:36.367 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:36.361+0000 7fd0a5268700 1 --2- 172.21.15.96:0/1694073968 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd0a01056e0 0x7fd0a0198740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:36.367 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:36.361+0000 7fd0a5268700 1 -- 172.21.15.96:0/1694073968 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0a0100640 msgr2=0x7fd0a019e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:36.367 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:36.361+0000 7fd0a5268700 1 --2- 172.21.15.96:0/1694073968 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0a0100640 0x7fd0a019e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:36.367 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:36.361+0000 7fd0a5268700 1 -- 172.21.15.96:0/1694073968 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd098009d00 con 0x7fd0a0100fe0 2023-05-08T03:41:36.367 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:36.361+0000 7fd0a5a69700 1 --2- 172.21.15.96:0/1694073968 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0a0100640 0x7fd0a019e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-08T03:41:36.368 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:36.361+0000 7fd0a626a700 1 --2- 172.21.15.96:0/1694073968 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd0a01056e0 0x7fd0a0198740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-08T03:41:36.368 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:36.361+0000 7fd0a5268700 1 --2- 172.21.15.96:0/1694073968 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0a0100fe0 0x7fd0a019ec00 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd09000b500 tx=0x7fd09000b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:36.368 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:36.361+0000 7fd096ffd700 1 -- 172.21.15.96:0/1694073968 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd090011830 con 0x7fd0a0100fe0 2023-05-08T03:41:36.368 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:36.361+0000 7fd0a7ccd700 1 -- 172.21.15.96:0/1694073968 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0a0110510 con 0x7fd0a0100fe0 2023-05-08T03:41:36.368 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:36.361+0000 7fd096ffd700 1 -- 172.21.15.96:0/1694073968 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd090011e50 con 0x7fd0a0100fe0 2023-05-08T03:41:36.368 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:36.361+0000 7fd096ffd700 1 -- 172.21.15.96:0/1694073968 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09000f2e0 con 0x7fd0a0100fe0 2023-05-08T03:41:36.368 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:36.361+0000 7fd0a7ccd700 1 -- 172.21.15.96:0/1694073968 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0a0110380 con 0x7fd0a0100fe0 2023-05-08T03:41:36.369 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:36.362+0000 7fd0a7ccd700 1 -- 172.21.15.96:0/1694073968 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0a01106a0 con 0x7fd0a0100fe0 2023-05-08T03:41:36.369 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:36.364+0000 7fd096ffd700 1 -- 172.21.15.96:0/1694073968 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fd0900105a0 con 0x7fd0a0100fe0 2023-05-08T03:41:36.370 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:36.364+0000 7fd096ffd700 1 --2- 172.21.15.96:0/1694073968 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fd08c0a11e0 0x7fd08c0a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:36.370 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:36.364+0000 7fd0a5a69700 1 --2- 172.21.15.96:0/1694073968 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fd08c0a11e0 0x7fd08c0a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:36.370 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:36.364+0000 7fd096ffd700 1 -- 172.21.15.96:0/1694073968 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fd0900cc880 con 0x7fd0a0100fe0 2023-05-08T03:41:36.370 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:36.365+0000 7fd0a5a69700 1 --2- 172.21.15.96:0/1694073968 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fd08c0a11e0 0x7fd08c0a3690 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd09c007900 tx=0x7fd09c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:36.371 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:36.368+0000 7fd096ffd700 1 -- 172.21.15.96:0/1694073968 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fd090096130 con 0x7fd0a0100fe0 2023-05-08T03:41:36.553 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:36.551+0000 7fd0a7ccd700 1 -- 172.21.15.96:0/1694073968 --> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd0a00fd080 con 0x7fd08c0a11e0 2023-05-08T03:41:36.563 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:36.560+0000 7fd096ffd700 1 -- 172.21.15.96:0/1694073968 <== mgr.14152 v2:172.21.15.96:6800/2748629182 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+341096 (secure 0 0 0) 0x7fd0a00fd080 con 0x7fd08c0a11e0 2023-05-08T03:41:36.566 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:41:36.568 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:36.563+0000 7fd0a7ccd700 1 -- 172.21.15.96:0/1694073968 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fd08c0a11e0 msgr2=0x7fd08c0a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:36.568 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:36.564+0000 7fd0a7ccd700 1 --2- 172.21.15.96:0/1694073968 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fd08c0a11e0 0x7fd08c0a3690 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd09c007900 tx=0x7fd09c008040 comp rx=0 tx=0).stop 2023-05-08T03:41:36.568 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:36.564+0000 7fd0a7ccd700 1 -- 172.21.15.96:0/1694073968 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0a0100fe0 msgr2=0x7fd0a019ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:36.569 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:36.564+0000 7fd0a7ccd700 1 --2- 172.21.15.96:0/1694073968 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0a0100fe0 0x7fd0a019ec00 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd09000b500 tx=0x7fd09000b8c0 comp rx=0 tx=0).stop 2023-05-08T03:41:36.569 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:36.564+0000 7fd0a7ccd700 1 -- 172.21.15.96:0/1694073968 shutdown_connections 2023-05-08T03:41:36.569 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:36.564+0000 7fd0a7ccd700 1 --2- 172.21.15.96:0/1694073968 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fd08c0a11e0 0x7fd08c0a3690 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:36.569 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:36.564+0000 7fd0a7ccd700 1 --2- 172.21.15.96:0/1694073968 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd0a01056e0 0x7fd0a0198740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:36.569 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:36.564+0000 7fd0a7ccd700 1 --2- 172.21.15.96:0/1694073968 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0a0100640 0x7fd0a019e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:36.569 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:36.564+0000 7fd0a7ccd700 1 --2- 172.21.15.96:0/1694073968 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0a0100fe0 0x7fd0a019ec00 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:36.570 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:36.564+0000 7fd0a7ccd700 1 -- 172.21.15.96:0/1694073968 >> 172.21.15.96:0/1694073968 conn(0x7fd0a00fbec0 msgr2=0x7fd0a00fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:36.570 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:36.564+0000 7fd0a7ccd700 1 -- 172.21.15.96:0/1694073968 shutdown_connections 2023-05-08T03:41:36.570 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:36.564+0000 7fd0a7ccd700 1 -- 172.21.15.96:0/1694073968 wait complete. 2023-05-08T03:41:36.570 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2023-05-08T03:41:36.913 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:36 smithi096 ceph-mon[124666]: pgmap v281: 97 pgs: 97 active+clean; 636 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2023-05-08T03:41:36.914 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":281,"stamp":"2023-05-08T03:41:35.569477+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":651149,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":390,"num_read_kb":308,"num_write":334,"num_write_kb":3042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":272,"ondisk_log_size":272,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":79976,"kb_used_data":12424,"kb_used_omap":0,"kb_used_meta":67456,"kb_avail":1124861848,"statfs":{"total":1151940427776,"available":1151858532352,"internally_reserved":0,"allocated":12722176,"data_stored":7000621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":69074944},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1652,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":32,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003048"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.290515+0000","last_change":"2023-05-08T03:40:49.238180+0000","last_active":"2023-05-08T03:40:50.290515+0000","last_peered":"2023-05-08T03:40:50.290515+0000","last_clean":"2023-05-08T03:40:50.290515+0000","last_became_active":"2023-05-08T03:40:49.237400+0000","last_became_peered":"2023-05-08T03:40:49.237400+0000","last_unstale":"2023-05-08T03:40:50.290515+0000","last_undegraded":"2023-05-08T03:40:50.290515+0000","last_fullsized":"2023-05-08T03:40:50.290515+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T11:27:00.446105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991619+0000","last_change":"2023-05-08T03:40:49.232533+0000","last_active":"2023-05-08T03:40:51.991619+0000","last_peered":"2023-05-08T03:40:51.991619+0000","last_clean":"2023-05-08T03:40:51.991619+0000","last_became_active":"2023-05-08T03:40:49.232246+0000","last_became_peered":"2023-05-08T03:40:49.232246+0000","last_unstale":"2023-05-08T03:40:51.991619+0000","last_undegraded":"2023-05-08T03:40:51.991619+0000","last_fullsized":"2023-05-08T03:40:51.991619+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T06:19:28.497539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991622+0000","last_change":"2023-05-08T03:40:49.236848+0000","last_active":"2023-05-08T03:40:51.991622+0000","last_peered":"2023-05-08T03:40:51.991622+0000","last_clean":"2023-05-08T03:40:51.991622+0000","last_became_active":"2023-05-08T03:40:49.236506+0000","last_became_peered":"2023-05-08T03:40:49.236506+0000","last_unstale":"2023-05-08T03:40:51.991622+0000","last_undegraded":"2023-05-08T03:40:51.991622+0000","last_fullsized":"2023-05-08T03:40:51.991622+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T09:55:30.234804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.222849+0000","last_change":"2023-05-08T03:40:49.233941+0000","last_active":"2023-05-08T03:40:50.222849+0000","last_peered":"2023-05-08T03:40:50.222849+0000","last_clean":"2023-05-08T03:40:50.222849+0000","last_became_active":"2023-05-08T03:40:49.232969+0000","last_became_peered":"2023-05-08T03:40:49.232969+0000","last_unstale":"2023-05-08T03:40:50.222849+0000","last_undegraded":"2023-05-08T03:40:50.222849+0000","last_fullsized":"2023-05-08T03:40:50.222849+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T05:51:05.543005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.224768+0000","last_change":"2023-05-08T03:40:49.229455+0000","last_active":"2023-05-08T03:40:50.224768+0000","last_peered":"2023-05-08T03:40:50.224768+0000","last_clean":"2023-05-08T03:40:50.224768+0000","last_became_active":"2023-05-08T03:40:49.229118+0000","last_became_peered":"2023-05-08T03:40:49.229118+0000","last_unstale":"2023-05-08T03:40:50.224768+0000","last_undegraded":"2023-05-08T03:40:50.224768+0000","last_fullsized":"2023-05-08T03:40:50.224768+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T09:17:55.353149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.299436+0000","last_change":"2023-05-08T03:40:49.237344+0000","last_active":"2023-05-08T03:40:51.299436+0000","last_peered":"2023-05-08T03:40:51.299436+0000","last_clean":"2023-05-08T03:40:51.299436+0000","last_became_active":"2023-05-08T03:40:49.236775+0000","last_became_peered":"2023-05-08T03:40:49.236775+0000","last_unstale":"2023-05-08T03:40:51.299436+0000","last_undegraded":"2023-05-08T03:40:51.299436+0000","last_fullsized":"2023-05-08T03:40:51.299436+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T12:50:19.957755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991259+0000","last_change":"2023-05-08T03:40:49.235549+0000","last_active":"2023-05-08T03:40:51.991259+0000","last_peered":"2023-05-08T03:40:51.991259+0000","last_clean":"2023-05-08T03:40:51.991259+0000","last_became_active":"2023-05-08T03:40:49.235223+0000","last_became_peered":"2023-05-08T03:40:49.235223+0000","last_unstale":"2023-05-08T03:40:51.991259+0000","last_undegraded":"2023-05-08T03:40:51.991259+0000","last_fullsized":"2023-05-08T03:40:51.991259+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T09:45:50.518957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:52.175162+0000","last_change":"2023-05-08T03:40:49.234923+0000","last_active":"2023-05-08T03:40:52.175162+0000","last_peered":"2023-05-08T03:40:52.175162+0000","last_clean":"2023-05-08T03:40:52.175162+0000","last_became_active":"2023-05-08T03:40:49.234630+0000","last_became_peered":"2023-05-08T03:40:49.234630+0000","last_unstale":"2023-05-08T03:40:52.175162+0000","last_undegraded":"2023-05-08T03:40:52.175162+0000","last_fullsized":"2023-05-08T03:40:52.175162+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T10:54:09.908673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991956+0000","last_change":"2023-05-08T03:40:49.243476+0000","last_active":"2023-05-08T03:40:51.991956+0000","last_peered":"2023-05-08T03:40:51.991956+0000","last_clean":"2023-05-08T03:40:51.991956+0000","last_became_active":"2023-05-08T03:40:49.243134+0000","last_became_peered":"2023-05-08T03:40:49.243134+0000","last_unstale":"2023-05-08T03:40:51.991956+0000","last_undegraded":"2023-05-08T03:40:51.991956+0000","last_fullsized":"2023-05-08T03:40:51.991956+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T11:09:14.244948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.299799+0000","last_change":"2023-05-08T03:40:49.238538+0000","last_active":"2023-05-08T03:40:51.299799+0000","last_peered":"2023-05-08T03:40:51.299799+0000","last_clean":"2023-05-08T03:40:51.299799+0000","last_became_active":"2023-05-08T03:40:49.237867+0000","last_became_peered":"2023-05-08T03:40:49.237867+0000","last_unstale":"2023-05-08T03:40:51.299799+0000","last_undegraded":"2023-05-08T03:40:51.299799+0000","last_fullsized":"2023-05-08T03:40:51.299799+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T15:14:54.147583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991704+0000","last_change":"2023-05-08T03:40:49.242175+0000","last_active":"2023-05-08T03:40:51.991704+0000","last_peered":"2023-05-08T03:40:51.991704+0000","last_clean":"2023-05-08T03:40:51.991704+0000","last_became_active":"2023-05-08T03:40:49.241878+0000","last_became_peered":"2023-05-08T03:40:49.241878+0000","last_unstale":"2023-05-08T03:40:51.991704+0000","last_undegraded":"2023-05-08T03:40:51.991704+0000","last_fullsized":"2023-05-08T03:40:51.991704+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T09:51:42.194781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.222799+0000","last_change":"2023-05-08T03:40:49.234199+0000","last_active":"2023-05-08T03:40:50.222799+0000","last_peered":"2023-05-08T03:40:50.222799+0000","last_clean":"2023-05-08T03:40:50.222799+0000","last_became_active":"2023-05-08T03:40:49.233408+0000","last_became_peered":"2023-05-08T03:40:49.233408+0000","last_unstale":"2023-05-08T03:40:50.222799+0000","last_undegraded":"2023-05-08T03:40:50.222799+0000","last_fullsized":"2023-05-08T03:40:50.222799+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T13:32:03.844376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.222261+0000","last_change":"2023-05-08T03:40:49.235750+0000","last_active":"2023-05-08T03:40:50.222261+0000","last_peered":"2023-05-08T03:40:50.222261+0000","last_clean":"2023-05-08T03:40:50.222261+0000","last_became_active":"2023-05-08T03:40:49.235443+0000","last_became_peered":"2023-05-08T03:40:49.235443+0000","last_unstale":"2023-05-08T03:40:50.222261+0000","last_undegraded":"2023-05-08T03:40:50.222261+0000","last_fullsized":"2023-05-08T03:40:50.222261+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T08:33:00.870579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991226+0000","last_change":"2023-05-08T03:40:49.234269+0000","last_active":"2023-05-08T03:40:51.991226+0000","last_peered":"2023-05-08T03:40:51.991226+0000","last_clean":"2023-05-08T03:40:51.991226+0000","last_became_active":"2023-05-08T03:40:49.233794+0000","last_became_peered":"2023-05-08T03:40:49.233794+0000","last_unstale":"2023-05-08T03:40:51.991226+0000","last_undegraded":"2023-05-08T03:40:51.991226+0000","last_fullsized":"2023-05-08T03:40:51.991226+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T15:01:13.031055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991052+0000","last_change":"2023-05-08T03:40:49.236952+0000","last_active":"2023-05-08T03:40:51.991052+0000","last_peered":"2023-05-08T03:40:51.991052+0000","last_clean":"2023-05-08T03:40:51.991052+0000","last_became_active":"2023-05-08T03:40:49.236406+0000","last_became_peered":"2023-05-08T03:40:49.236406+0000","last_unstale":"2023-05-08T03:40:51.991052+0000","last_undegraded":"2023-05-08T03:40:51.991052+0000","last_fullsized":"2023-05-08T03:40:51.991052+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T11:19:43.015225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991152+0000","last_change":"2023-05-08T03:40:49.231719+0000","last_active":"2023-05-08T03:40:51.991152+0000","last_peered":"2023-05-08T03:40:51.991152+0000","last_clean":"2023-05-08T03:40:51.991152+0000","last_became_active":"2023-05-08T03:40:49.231397+0000","last_became_peered":"2023-05-08T03:40:49.231397+0000","last_unstale":"2023-05-08T03:40:51.991152+0000","last_undegraded":"2023-05-08T03:40:51.991152+0000","last_fullsized":"2023-05-08T03:40:51.991152+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T06:46:52.028194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.290675+0000","last_change":"2023-05-08T03:40:49.238441+0000","last_active":"2023-05-08T03:40:50.290675+0000","last_peered":"2023-05-08T03:40:50.290675+0000","last_clean":"2023-05-08T03:40:50.290675+0000","last_became_active":"2023-05-08T03:40:49.237893+0000","last_became_peered":"2023-05-08T03:40:49.237893+0000","last_unstale":"2023-05-08T03:40:50.290675+0000","last_undegraded":"2023-05-08T03:40:50.290675+0000","last_fullsized":"2023-05-08T03:40:50.290675+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T08:32:34.443745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991614+0000","last_change":"2023-05-08T03:40:49.233431+0000","last_active":"2023-05-08T03:40:51.991614+0000","last_peered":"2023-05-08T03:40:51.991614+0000","last_clean":"2023-05-08T03:40:51.991614+0000","last_became_active":"2023-05-08T03:40:49.233176+0000","last_became_peered":"2023-05-08T03:40:49.233176+0000","last_unstale":"2023-05-08T03:40:51.991614+0000","last_undegraded":"2023-05-08T03:40:51.991614+0000","last_fullsized":"2023-05-08T03:40:51.991614+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T05:33:31.755761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.273400+0000","last_change":"2023-05-08T03:40:49.233907+0000","last_active":"2023-05-08T03:40:51.273400+0000","last_peered":"2023-05-08T03:40:51.273400+0000","last_clean":"2023-05-08T03:40:51.273400+0000","last_became_active":"2023-05-08T03:40:49.233613+0000","last_became_peered":"2023-05-08T03:40:49.233613+0000","last_unstale":"2023-05-08T03:40:51.273400+0000","last_undegraded":"2023-05-08T03:40:51.273400+0000","last_fullsized":"2023-05-08T03:40:51.273400+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T13:34:47.424659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"82'9","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:53.358935+0000","last_change":"2023-05-08T03:40:48.803593+0000","last_active":"2023-05-08T03:40:53.358935+0000","last_peered":"2023-05-08T03:40:53.358935+0000","last_clean":"2023-05-08T03:40:53.358935+0000","last_became_active":"2023-05-08T03:40:48.803287+0000","last_became_peered":"2023-05-08T03:40:48.803287+0000","last_unstale":"2023-05-08T03:40:53.358935+0000","last_undegraded":"2023-05-08T03:40:53.358935+0000","last_fullsized":"2023-05-08T03:40:53.358935+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T14:21:33.903600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:52.175694+0000","last_change":"2023-05-08T03:40:49.238211+0000","last_active":"2023-05-08T03:40:52.175694+0000","last_peered":"2023-05-08T03:40:52.175694+0000","last_clean":"2023-05-08T03:40:52.175694+0000","last_became_active":"2023-05-08T03:40:49.237883+0000","last_became_peered":"2023-05-08T03:40:49.237883+0000","last_unstale":"2023-05-08T03:40:52.175694+0000","last_undegraded":"2023-05-08T03:40:52.175694+0000","last_fullsized":"2023-05-08T03:40:52.175694+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T11:47:15.524106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:52.175718+0000","last_change":"2023-05-08T03:40:48.799399+0000","last_active":"2023-05-08T03:40:52.175718+0000","last_peered":"2023-05-08T03:40:52.175718+0000","last_clean":"2023-05-08T03:40:52.175718+0000","last_became_active":"2023-05-08T03:40:48.798814+0000","last_became_peered":"2023-05-08T03:40:48.798814+0000","last_unstale":"2023-05-08T03:40:52.175718+0000","last_undegraded":"2023-05-08T03:40:52.175718+0000","last_fullsized":"2023-05-08T03:40:52.175718+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T06:10:49.650922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991705+0000","last_change":"2023-05-08T03:40:49.232111+0000","last_active":"2023-05-08T03:40:51.991705+0000","last_peered":"2023-05-08T03:40:51.991705+0000","last_clean":"2023-05-08T03:40:51.991705+0000","last_became_active":"2023-05-08T03:40:49.231440+0000","last_became_peered":"2023-05-08T03:40:49.231440+0000","last_unstale":"2023-05-08T03:40:51.991705+0000","last_undegraded":"2023-05-08T03:40:51.991705+0000","last_fullsized":"2023-05-08T03:40:51.991705+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T10:44:44.588384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"82'4","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:53.359273+0000","last_change":"2023-05-08T03:40:48.801407+0000","last_active":"2023-05-08T03:40:53.359273+0000","last_peered":"2023-05-08T03:40:53.359273+0000","last_clean":"2023-05-08T03:40:53.359273+0000","last_became_active":"2023-05-08T03:40:48.801023+0000","last_became_peered":"2023-05-08T03:40:48.801023+0000","last_unstale":"2023-05-08T03:40:53.359273+0000","last_undegraded":"2023-05-08T03:40:53.359273+0000","last_fullsized":"2023-05-08T03:40:53.359273+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T10:23:23.191427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991571+0000","last_change":"2023-05-08T03:40:49.240406+0000","last_active":"2023-05-08T03:40:51.991571+0000","last_peered":"2023-05-08T03:40:51.991571+0000","last_clean":"2023-05-08T03:40:51.991571+0000","last_became_active":"2023-05-08T03:40:49.240078+0000","last_became_peered":"2023-05-08T03:40:49.240078+0000","last_unstale":"2023-05-08T03:40:51.991571+0000","last_undegraded":"2023-05-08T03:40:51.991571+0000","last_fullsized":"2023-05-08T03:40:51.991571+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T12:24:12.858469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.224945+0000","last_change":"2023-05-08T03:40:48.804918+0000","last_active":"2023-05-08T03:40:50.224945+0000","last_peered":"2023-05-08T03:40:50.224945+0000","last_clean":"2023-05-08T03:40:50.224945+0000","last_became_active":"2023-05-08T03:40:48.804489+0000","last_became_peered":"2023-05-08T03:40:48.804489+0000","last_unstale":"2023-05-08T03:40:50.224945+0000","last_undegraded":"2023-05-08T03:40:50.224945+0000","last_fullsized":"2023-05-08T03:40:50.224945+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T15:23:01.925119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.268788+0000","last_change":"2023-05-08T03:40:49.235173+0000","last_active":"2023-05-08T03:40:51.268788+0000","last_peered":"2023-05-08T03:40:51.268788+0000","last_clean":"2023-05-08T03:40:51.268788+0000","last_became_active":"2023-05-08T03:40:49.234823+0000","last_became_peered":"2023-05-08T03:40:49.234823+0000","last_unstale":"2023-05-08T03:40:51.268788+0000","last_undegraded":"2023-05-08T03:40:51.268788+0000","last_fullsized":"2023-05-08T03:40:51.268788+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T08:27:47.581290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"82'6","reported_seq":60,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:41:29.421659+0000","last_change":"2023-05-08T03:40:48.803696+0000","last_active":"2023-05-08T03:41:29.421659+0000","last_peered":"2023-05-08T03:41:29.421659+0000","last_clean":"2023-05-08T03:41:29.421659+0000","last_became_active":"2023-05-08T03:40:48.803340+0000","last_became_peered":"2023-05-08T03:40:48.803340+0000","last_unstale":"2023-05-08T03:41:29.421659+0000","last_undegraded":"2023-05-08T03:41:29.421659+0000","last_fullsized":"2023-05-08T03:41:29.421659+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T09:28:08.077623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":964,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":40,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.224896+0000","last_change":"2023-05-08T03:40:49.226368+0000","last_active":"2023-05-08T03:40:50.224896+0000","last_peered":"2023-05-08T03:40:50.224896+0000","last_clean":"2023-05-08T03:40:50.224896+0000","last_became_active":"2023-05-08T03:40:49.226071+0000","last_became_peered":"2023-05-08T03:40:49.226071+0000","last_unstale":"2023-05-08T03:40:50.224896+0000","last_undegraded":"2023-05-08T03:40:50.224896+0000","last_fullsized":"2023-05-08T03:40:50.224896+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T13:09:03.133860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"82'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:53.360225+0000","last_change":"2023-05-08T03:40:48.801763+0000","last_active":"2023-05-08T03:40:53.360225+0000","last_peered":"2023-05-08T03:40:53.360225+0000","last_clean":"2023-05-08T03:40:53.360225+0000","last_became_active":"2023-05-08T03:40:48.801424+0000","last_became_peered":"2023-05-08T03:40:48.801424+0000","last_unstale":"2023-05-08T03:40:53.360225+0000","last_undegraded":"2023-05-08T03:40:53.360225+0000","last_fullsized":"2023-05-08T03:40:53.360225+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T06:59:02.055492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.268665+0000","last_change":"2023-05-08T03:40:49.228114+0000","last_active":"2023-05-08T03:40:51.268665+0000","last_peered":"2023-05-08T03:40:51.268665+0000","last_clean":"2023-05-08T03:40:51.268665+0000","last_became_active":"2023-05-08T03:40:49.227468+0000","last_became_peered":"2023-05-08T03:40:49.227468+0000","last_unstale":"2023-05-08T03:40:51.268665+0000","last_undegraded":"2023-05-08T03:40:51.268665+0000","last_fullsized":"2023-05-08T03:40:51.268665+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T14:43:43.602206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"82'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:53.359205+0000","last_change":"2023-05-08T03:40:48.799150+0000","last_active":"2023-05-08T03:40:53.359205+0000","last_peered":"2023-05-08T03:40:53.359205+0000","last_clean":"2023-05-08T03:40:53.359205+0000","last_became_active":"2023-05-08T03:40:48.798782+0000","last_became_peered":"2023-05-08T03:40:48.798782+0000","last_unstale":"2023-05-08T03:40:53.359205+0000","last_undegraded":"2023-05-08T03:40:53.359205+0000","last_fullsized":"2023-05-08T03:40:53.359205+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T14:47:45.547983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:52.175062+0000","last_change":"2023-05-08T03:40:49.233927+0000","last_active":"2023-05-08T03:40:52.175062+0000","last_peered":"2023-05-08T03:40:52.175062+0000","last_clean":"2023-05-08T03:40:52.175062+0000","last_became_active":"2023-05-08T03:40:49.232431+0000","last_became_peered":"2023-05-08T03:40:49.232431+0000","last_unstale":"2023-05-08T03:40:52.175062+0000","last_undegraded":"2023-05-08T03:40:52.175062+0000","last_fullsized":"2023-05-08T03:40:52.175062+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T07:21:25.886329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.323482+0000","last_change":"2023-05-08T03:40:48.801966+0000","last_active":"2023-05-08T03:40:51.323482+0000","last_peered":"2023-05-08T03:40:51.323482+0000","last_clean":"2023-05-08T03:40:51.323482+0000","last_became_active":"2023-05-08T03:40:48.801642+0000","last_became_peered":"2023-05-08T03:40:48.801642+0000","last_unstale":"2023-05-08T03:40:51.323482+0000","last_undegraded":"2023-05-08T03:40:51.323482+0000","last_fullsized":"2023-05-08T03:40:51.323482+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T15:03:06.750289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.990929+0000","last_change":"2023-05-08T03:40:49.229373+0000","last_active":"2023-05-08T03:40:51.990929+0000","last_peered":"2023-05-08T03:40:51.990929+0000","last_clean":"2023-05-08T03:40:51.990929+0000","last_became_active":"2023-05-08T03:40:49.229073+0000","last_became_peered":"2023-05-08T03:40:49.229073+0000","last_unstale":"2023-05-08T03:40:51.990929+0000","last_undegraded":"2023-05-08T03:40:51.990929+0000","last_fullsized":"2023-05-08T03:40:51.990929+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T03:46:49.952461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'3","reported_seq":54,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:41:29.421333+0000","last_change":"2023-05-08T03:40:48.798753+0000","last_active":"2023-05-08T03:41:29.421333+0000","last_peered":"2023-05-08T03:41:29.421333+0000","last_clean":"2023-05-08T03:41:29.421333+0000","last_became_active":"2023-05-08T03:40:48.798370+0000","last_became_peered":"2023-05-08T03:40:48.798370+0000","last_unstale":"2023-05-08T03:41:29.421333+0000","last_undegraded":"2023-05-08T03:41:29.421333+0000","last_fullsized":"2023-05-08T03:41:29.421333+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T10:12:02.944925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.992067+0000","last_change":"2023-05-08T03:40:49.239106+0000","last_active":"2023-05-08T03:40:51.992067+0000","last_peered":"2023-05-08T03:40:51.992067+0000","last_clean":"2023-05-08T03:40:51.992067+0000","last_became_active":"2023-05-08T03:40:49.238801+0000","last_became_peered":"2023-05-08T03:40:49.238801+0000","last_unstale":"2023-05-08T03:40:51.992067+0000","last_undegraded":"2023-05-08T03:40:51.992067+0000","last_fullsized":"2023-05-08T03:40:51.992067+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T15:10:32.817317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:52.351169+0000","last_change":"2023-05-08T03:40:48.800553+0000","last_active":"2023-05-08T03:40:52.351169+0000","last_peered":"2023-05-08T03:40:52.351169+0000","last_clean":"2023-05-08T03:40:52.351169+0000","last_became_active":"2023-05-08T03:40:48.800255+0000","last_became_peered":"2023-05-08T03:40:48.800255+0000","last_unstale":"2023-05-08T03:40:52.351169+0000","last_undegraded":"2023-05-08T03:40:52.351169+0000","last_fullsized":"2023-05-08T03:40:52.351169+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T14:34:04.395527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991717+0000","last_change":"2023-05-08T03:40:49.235832+0000","last_active":"2023-05-08T03:40:51.991717+0000","last_peered":"2023-05-08T03:40:51.991717+0000","last_clean":"2023-05-08T03:40:51.991717+0000","last_became_active":"2023-05-08T03:40:49.235545+0000","last_became_peered":"2023-05-08T03:40:49.235545+0000","last_unstale":"2023-05-08T03:40:51.991717+0000","last_undegraded":"2023-05-08T03:40:51.991717+0000","last_fullsized":"2023-05-08T03:40:51.991717+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T06:40:14.786756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'4","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:52.351116+0000","last_change":"2023-05-08T03:40:48.799767+0000","last_active":"2023-05-08T03:40:52.351116+0000","last_peered":"2023-05-08T03:40:52.351116+0000","last_clean":"2023-05-08T03:40:52.351116+0000","last_became_active":"2023-05-08T03:40:48.799336+0000","last_became_peered":"2023-05-08T03:40:48.799336+0000","last_unstale":"2023-05-08T03:40:52.351116+0000","last_undegraded":"2023-05-08T03:40:52.351116+0000","last_fullsized":"2023-05-08T03:40:52.351116+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T09:47:50.498971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991770+0000","last_change":"2023-05-08T03:40:49.228153+0000","last_active":"2023-05-08T03:40:51.991770+0000","last_peered":"2023-05-08T03:40:51.991770+0000","last_clean":"2023-05-08T03:40:51.991770+0000","last_became_active":"2023-05-08T03:40:49.227584+0000","last_became_peered":"2023-05-08T03:40:49.227584+0000","last_unstale":"2023-05-08T03:40:51.991770+0000","last_undegraded":"2023-05-08T03:40:51.991770+0000","last_fullsized":"2023-05-08T03:40:51.991770+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T04:34:49.590012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'28","reported_seq":124,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:41:30.422196+0000","last_change":"2023-05-08T03:40:48.799126+0000","last_active":"2023-05-08T03:41:30.422196+0000","last_peered":"2023-05-08T03:41:30.422196+0000","last_clean":"2023-05-08T03:41:30.422196+0000","last_became_active":"2023-05-08T03:40:48.798907+0000","last_became_peered":"2023-05-08T03:40:48.798907+0000","last_unstale":"2023-05-08T03:41:30.422196+0000","last_undegraded":"2023-05-08T03:41:30.422196+0000","last_fullsized":"2023-05-08T03:41:30.422196+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T11:24:58.026789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56241,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":82,"num_read_kb":94,"num_write":29,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.225118+0000","last_change":"2023-05-08T03:40:49.237489+0000","last_active":"2023-05-08T03:40:50.225118+0000","last_peered":"2023-05-08T03:40:50.225118+0000","last_clean":"2023-05-08T03:40:50.225118+0000","last_became_active":"2023-05-08T03:40:49.237207+0000","last_became_peered":"2023-05-08T03:40:49.237207+0000","last_unstale":"2023-05-08T03:40:50.225118+0000","last_undegraded":"2023-05-08T03:40:50.225118+0000","last_fullsized":"2023-05-08T03:40:50.225118+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T07:31:36.303437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'6","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:53.358760+0000","last_change":"2023-05-08T03:40:48.803375+0000","last_active":"2023-05-08T03:40:53.358760+0000","last_peered":"2023-05-08T03:40:53.358760+0000","last_clean":"2023-05-08T03:40:53.358760+0000","last_became_active":"2023-05-08T03:40:48.803082+0000","last_became_peered":"2023-05-08T03:40:48.803082+0000","last_unstale":"2023-05-08T03:40:53.358760+0000","last_undegraded":"2023-05-08T03:40:53.358760+0000","last_fullsized":"2023-05-08T03:40:53.358760+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T06:24:55.514429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.222036+0000","last_change":"2023-05-08T03:40:49.235859+0000","last_active":"2023-05-08T03:40:50.222036+0000","last_peered":"2023-05-08T03:40:50.222036+0000","last_clean":"2023-05-08T03:40:50.222036+0000","last_became_active":"2023-05-08T03:40:49.235545+0000","last_became_peered":"2023-05-08T03:40:49.235545+0000","last_unstale":"2023-05-08T03:40:50.222036+0000","last_undegraded":"2023-05-08T03:40:50.222036+0000","last_fullsized":"2023-05-08T03:40:50.222036+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T12:06:59.892758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:52.351208+0000","last_change":"2023-05-08T03:40:48.803838+0000","last_active":"2023-05-08T03:40:52.351208+0000","last_peered":"2023-05-08T03:40:52.351208+0000","last_clean":"2023-05-08T03:40:52.351208+0000","last_became_active":"2023-05-08T03:40:48.803389+0000","last_became_peered":"2023-05-08T03:40:48.803389+0000","last_unstale":"2023-05-08T03:40:52.351208+0000","last_undegraded":"2023-05-08T03:40:52.351208+0000","last_fullsized":"2023-05-08T03:40:52.351208+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T06:25:46.589570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991651+0000","last_change":"2023-05-08T03:40:49.242013+0000","last_active":"2023-05-08T03:40:51.991651+0000","last_peered":"2023-05-08T03:40:51.991651+0000","last_clean":"2023-05-08T03:40:51.991651+0000","last_became_active":"2023-05-08T03:40:49.241649+0000","last_became_peered":"2023-05-08T03:40:49.241649+0000","last_unstale":"2023-05-08T03:40:51.991651+0000","last_undegraded":"2023-05-08T03:40:51.991651+0000","last_fullsized":"2023-05-08T03:40:51.991651+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T11:20:08.806314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'4","reported_seq":61,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:41:32.425431+0000","last_change":"2023-05-08T03:40:48.798327+0000","last_active":"2023-05-08T03:41:32.425431+0000","last_peered":"2023-05-08T03:41:32.425431+0000","last_clean":"2023-05-08T03:41:32.425431+0000","last_became_active":"2023-05-08T03:40:48.797982+0000","last_became_peered":"2023-05-08T03:40:48.797982+0000","last_unstale":"2023-05-08T03:41:32.425431+0000","last_undegraded":"2023-05-08T03:41:32.425431+0000","last_fullsized":"2023-05-08T03:41:32.425431+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T06:11:20.786843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":930,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":44,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991343+0000","last_change":"2023-05-08T03:40:49.233294+0000","last_active":"2023-05-08T03:40:51.991343+0000","last_peered":"2023-05-08T03:40:51.991343+0000","last_clean":"2023-05-08T03:40:51.991343+0000","last_became_active":"2023-05-08T03:40:49.232967+0000","last_became_peered":"2023-05-08T03:40:49.232967+0000","last_unstale":"2023-05-08T03:40:51.991343+0000","last_undegraded":"2023-05-08T03:40:51.991343+0000","last_fullsized":"2023-05-08T03:40:51.991343+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T08:56:19.823724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'15","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:53.359963+0000","last_change":"2023-05-08T03:40:48.800734+0000","last_active":"2023-05-08T03:40:53.359963+0000","last_peered":"2023-05-08T03:40:53.359963+0000","last_clean":"2023-05-08T03:40:53.359963+0000","last_became_active":"2023-05-08T03:40:48.800155+0000","last_became_peered":"2023-05-08T03:40:48.800155+0000","last_unstale":"2023-05-08T03:40:53.359963+0000","last_undegraded":"2023-05-08T03:40:53.359963+0000","last_fullsized":"2023-05-08T03:40:53.359963+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T10:21:52.124912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.268462+0000","last_change":"2023-05-08T03:40:49.230119+0000","last_active":"2023-05-08T03:40:51.268462+0000","last_peered":"2023-05-08T03:40:51.268462+0000","last_clean":"2023-05-08T03:40:51.268462+0000","last_became_active":"2023-05-08T03:40:49.229832+0000","last_became_peered":"2023-05-08T03:40:49.229832+0000","last_unstale":"2023-05-08T03:40:51.268462+0000","last_undegraded":"2023-05-08T03:40:51.268462+0000","last_fullsized":"2023-05-08T03:40:51.268462+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T10:04:22.742738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"82'2","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:54.365041+0000","last_change":"2023-05-08T03:40:48.801423+0000","last_active":"2023-05-08T03:40:54.365041+0000","last_peered":"2023-05-08T03:40:54.365041+0000","last_clean":"2023-05-08T03:40:54.365041+0000","last_became_active":"2023-05-08T03:40:48.801027+0000","last_became_peered":"2023-05-08T03:40:48.801027+0000","last_unstale":"2023-05-08T03:40:54.365041+0000","last_undegraded":"2023-05-08T03:40:54.365041+0000","last_fullsized":"2023-05-08T03:40:54.365041+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T07:32:19.377168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.290441+0000","last_change":"2023-05-08T03:40:49.239315+0000","last_active":"2023-05-08T03:40:50.290441+0000","last_peered":"2023-05-08T03:40:50.290441+0000","last_clean":"2023-05-08T03:40:50.290441+0000","last_became_active":"2023-05-08T03:40:49.239040+0000","last_became_peered":"2023-05-08T03:40:49.239040+0000","last_unstale":"2023-05-08T03:40:50.290441+0000","last_undegraded":"2023-05-08T03:40:50.290441+0000","last_fullsized":"2023-05-08T03:40:50.290441+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T04:36:38.262164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991307+0000","last_change":"2023-05-08T03:40:48.802650+0000","last_active":"2023-05-08T03:40:51.991307+0000","last_peered":"2023-05-08T03:40:51.991307+0000","last_clean":"2023-05-08T03:40:51.991307+0000","last_became_active":"2023-05-08T03:40:48.802358+0000","last_became_peered":"2023-05-08T03:40:48.802358+0000","last_unstale":"2023-05-08T03:40:51.991307+0000","last_undegraded":"2023-05-08T03:40:51.991307+0000","last_fullsized":"2023-05-08T03:40:51.991307+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T05:13:14.266223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'1","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.341060+0000","last_change":"2023-05-08T03:40:49.242103+0000","last_active":"2023-05-08T03:40:51.341060+0000","last_peered":"2023-05-08T03:40:51.341060+0000","last_clean":"2023-05-08T03:40:51.341060+0000","last_became_active":"2023-05-08T03:40:49.241694+0000","last_became_peered":"2023-05-08T03:40:49.241694+0000","last_unstale":"2023-05-08T03:40:51.341060+0000","last_undegraded":"2023-05-08T03:40:51.341060+0000","last_fullsized":"2023-05-08T03:40:51.341060+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T05:51:53.203680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"82'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991825+0000","last_change":"2023-05-08T03:40:48.801754+0000","last_active":"2023-05-08T03:40:51.991825+0000","last_peered":"2023-05-08T03:40:51.991825+0000","last_clean":"2023-05-08T03:40:51.991825+0000","last_became_active":"2023-05-08T03:40:48.801474+0000","last_became_peered":"2023-05-08T03:40:48.801474+0000","last_unstale":"2023-05-08T03:40:51.991825+0000","last_undegraded":"2023-05-08T03:40:51.991825+0000","last_fullsized":"2023-05-08T03:40:51.991825+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T10:17:15.498068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.299563+0000","last_change":"2023-05-08T03:40:49.239292+0000","last_active":"2023-05-08T03:40:51.299563+0000","last_peered":"2023-05-08T03:40:51.299563+0000","last_clean":"2023-05-08T03:40:51.299563+0000","last_became_active":"2023-05-08T03:40:49.238993+0000","last_became_peered":"2023-05-08T03:40:49.238993+0000","last_unstale":"2023-05-08T03:40:51.299563+0000","last_undegraded":"2023-05-08T03:40:51.299563+0000","last_fullsized":"2023-05-08T03:40:51.299563+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T07:31:52.140647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.268485+0000","last_change":"2023-05-08T03:40:49.228268+0000","last_active":"2023-05-08T03:40:51.268485+0000","last_peered":"2023-05-08T03:40:51.268485+0000","last_clean":"2023-05-08T03:40:51.268485+0000","last_became_active":"2023-05-08T03:40:49.227346+0000","last_became_peered":"2023-05-08T03:40:49.227346+0000","last_unstale":"2023-05-08T03:40:51.268485+0000","last_undegraded":"2023-05-08T03:40:51.268485+0000","last_fullsized":"2023-05-08T03:40:51.268485+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T04:14:10.880456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"82'4","reported_seq":56,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:41:30.421648+0000","last_change":"2023-05-08T03:40:48.795133+0000","last_active":"2023-05-08T03:41:30.421648+0000","last_peered":"2023-05-08T03:41:30.421648+0000","last_clean":"2023-05-08T03:41:30.421648+0000","last_became_active":"2023-05-08T03:40:48.794720+0000","last_became_peered":"2023-05-08T03:40:48.794720+0000","last_unstale":"2023-05-08T03:41:30.421648+0000","last_undegraded":"2023-05-08T03:41:30.421648+0000","last_fullsized":"2023-05-08T03:41:30.421648+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T12:37:37.862608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:52.175426+0000","last_change":"2023-05-08T03:40:49.229331+0000","last_active":"2023-05-08T03:40:52.175426+0000","last_peered":"2023-05-08T03:40:52.175426+0000","last_clean":"2023-05-08T03:40:52.175426+0000","last_became_active":"2023-05-08T03:40:49.228878+0000","last_became_peered":"2023-05-08T03:40:49.228878+0000","last_unstale":"2023-05-08T03:40:52.175426+0000","last_undegraded":"2023-05-08T03:40:52.175426+0000","last_fullsized":"2023-05-08T03:40:52.175426+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T03:53:35.836359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"82'3","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:54.364855+0000","last_change":"2023-05-08T03:40:48.796217+0000","last_active":"2023-05-08T03:40:54.364855+0000","last_peered":"2023-05-08T03:40:54.364855+0000","last_clean":"2023-05-08T03:40:54.364855+0000","last_became_active":"2023-05-08T03:40:48.795887+0000","last_became_peered":"2023-05-08T03:40:48.795887+0000","last_unstale":"2023-05-08T03:40:54.364855+0000","last_undegraded":"2023-05-08T03:40:54.364855+0000","last_fullsized":"2023-05-08T03:40:54.364855+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T14:57:30.575267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":340,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991321+0000","last_change":"2023-05-08T03:39:49.036132+0000","last_active":"2023-05-08T03:40:51.991321+0000","last_peered":"2023-05-08T03:40:51.991321+0000","last_clean":"2023-05-08T03:40:51.991321+0000","last_became_active":"2023-05-08T03:39:49.035717+0000","last_became_peered":"2023-05-08T03:39:49.035717+0000","last_unstale":"2023-05-08T03:40:51.991321+0000","last_undegraded":"2023-05-08T03:40:51.991321+0000","last_fullsized":"2023-05-08T03:40:51.991321+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:36:48.527062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:36:48.527062+0000","last_clean_scrub_stamp":"2023-05-08T03:36:48.527062+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T07:02:26.379800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.221853+0000","last_change":"2023-05-08T03:40:49.227299+0000","last_active":"2023-05-08T03:40:50.221853+0000","last_peered":"2023-05-08T03:40:50.221853+0000","last_clean":"2023-05-08T03:40:50.221853+0000","last_became_active":"2023-05-08T03:40:49.226846+0000","last_became_peered":"2023-05-08T03:40:49.226846+0000","last_unstale":"2023-05-08T03:40:50.221853+0000","last_undegraded":"2023-05-08T03:40:50.221853+0000","last_fullsized":"2023-05-08T03:40:50.221853+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T10:55:57.218170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"82'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:53.358519+0000","last_change":"2023-05-08T03:40:48.803480+0000","last_active":"2023-05-08T03:40:53.358519+0000","last_peered":"2023-05-08T03:40:53.358519+0000","last_clean":"2023-05-08T03:40:53.358519+0000","last_became_active":"2023-05-08T03:40:48.803137+0000","last_became_peered":"2023-05-08T03:40:48.803137+0000","last_unstale":"2023-05-08T03:40:53.358519+0000","last_undegraded":"2023-05-08T03:40:53.358519+0000","last_fullsized":"2023-05-08T03:40:53.358519+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T11:08:55.229134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"82'1","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:52.349801+0000","last_change":"2023-05-08T03:40:48.802781+0000","last_active":"2023-05-08T03:40:52.349801+0000","last_peered":"2023-05-08T03:40:52.349801+0000","last_clean":"2023-05-08T03:40:52.349801+0000","last_became_active":"2023-05-08T03:40:48.802461+0000","last_became_peered":"2023-05-08T03:40:48.802461+0000","last_unstale":"2023-05-08T03:40:52.349801+0000","last_undegraded":"2023-05-08T03:40:52.349801+0000","last_fullsized":"2023-05-08T03:40:52.349801+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T11:07:12.386341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.222071+0000","last_change":"2023-05-08T03:40:49.227162+0000","last_active":"2023-05-08T03:40:50.222071+0000","last_peered":"2023-05-08T03:40:50.222071+0000","last_clean":"2023-05-08T03:40:50.222071+0000","last_became_active":"2023-05-08T03:40:49.226841+0000","last_became_peered":"2023-05-08T03:40:49.226841+0000","last_unstale":"2023-05-08T03:40:50.222071+0000","last_undegraded":"2023-05-08T03:40:50.222071+0000","last_fullsized":"2023-05-08T03:40:50.222071+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T05:42:31.361505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'5","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:59.647447+0000","last_change":"2023-05-08T03:40:48.800841+0000","last_active":"2023-05-08T03:40:59.647447+0000","last_peered":"2023-05-08T03:40:59.647447+0000","last_clean":"2023-05-08T03:40:59.647447+0000","last_became_active":"2023-05-08T03:40:48.800198+0000","last_became_peered":"2023-05-08T03:40:48.800198+0000","last_unstale":"2023-05-08T03:40:59.647447+0000","last_undegraded":"2023-05-08T03:40:59.647447+0000","last_fullsized":"2023-05-08T03:40:59.647447+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T07:43:49.169424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:52.175690+0000","last_change":"2023-05-08T03:40:49.234421+0000","last_active":"2023-05-08T03:40:52.175690+0000","last_peered":"2023-05-08T03:40:52.175690+0000","last_clean":"2023-05-08T03:40:52.175690+0000","last_became_active":"2023-05-08T03:40:49.234108+0000","last_became_peered":"2023-05-08T03:40:49.234108+0000","last_unstale":"2023-05-08T03:40:52.175690+0000","last_undegraded":"2023-05-08T03:40:52.175690+0000","last_fullsized":"2023-05-08T03:40:52.175690+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T07:08:12.366030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'4","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:52.350385+0000","last_change":"2023-05-08T03:40:48.792894+0000","last_active":"2023-05-08T03:40:52.350385+0000","last_peered":"2023-05-08T03:40:52.350385+0000","last_clean":"2023-05-08T03:40:52.350385+0000","last_became_active":"2023-05-08T03:40:48.792579+0000","last_became_peered":"2023-05-08T03:40:48.792579+0000","last_unstale":"2023-05-08T03:40:52.350385+0000","last_undegraded":"2023-05-08T03:40:52.350385+0000","last_fullsized":"2023-05-08T03:40:52.350385+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T12:10:35.808903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991740+0000","last_change":"2023-05-08T03:40:49.239032+0000","last_active":"2023-05-08T03:40:51.991740+0000","last_peered":"2023-05-08T03:40:51.991740+0000","last_clean":"2023-05-08T03:40:51.991740+0000","last_became_active":"2023-05-08T03:40:49.238714+0000","last_became_peered":"2023-05-08T03:40:49.238714+0000","last_unstale":"2023-05-08T03:40:51.991740+0000","last_undegraded":"2023-05-08T03:40:51.991740+0000","last_fullsized":"2023-05-08T03:40:51.991740+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T15:12:46.594644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:52.350633+0000","last_change":"2023-05-08T03:40:48.797158+0000","last_active":"2023-05-08T03:40:52.350633+0000","last_peered":"2023-05-08T03:40:52.350633+0000","last_clean":"2023-05-08T03:40:52.350633+0000","last_became_active":"2023-05-08T03:40:48.796851+0000","last_became_peered":"2023-05-08T03:40:48.796851+0000","last_unstale":"2023-05-08T03:40:52.350633+0000","last_undegraded":"2023-05-08T03:40:52.350633+0000","last_fullsized":"2023-05-08T03:40:52.350633+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T05:27:30.250114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.224714+0000","last_change":"2023-05-08T03:40:49.236833+0000","last_active":"2023-05-08T03:40:50.224714+0000","last_peered":"2023-05-08T03:40:50.224714+0000","last_clean":"2023-05-08T03:40:50.224714+0000","last_became_active":"2023-05-08T03:40:49.236520+0000","last_became_peered":"2023-05-08T03:40:49.236520+0000","last_unstale":"2023-05-08T03:40:50.224714+0000","last_undegraded":"2023-05-08T03:40:50.224714+0000","last_fullsized":"2023-05-08T03:40:50.224714+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T08:36:44.900323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:52.354358+0000","last_change":"2023-05-08T03:40:48.791795+0000","last_active":"2023-05-08T03:40:52.354358+0000","last_peered":"2023-05-08T03:40:52.354358+0000","last_clean":"2023-05-08T03:40:52.354358+0000","last_became_active":"2023-05-08T03:40:48.791489+0000","last_became_peered":"2023-05-08T03:40:48.791489+0000","last_unstale":"2023-05-08T03:40:52.354358+0000","last_undegraded":"2023-05-08T03:40:52.354358+0000","last_fullsized":"2023-05-08T03:40:52.354358+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T08:45:26.675522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.290230+0000","last_change":"2023-05-08T03:40:49.232245+0000","last_active":"2023-05-08T03:40:50.290230+0000","last_peered":"2023-05-08T03:40:50.290230+0000","last_clean":"2023-05-08T03:40:50.290230+0000","last_became_active":"2023-05-08T03:40:49.231934+0000","last_became_peered":"2023-05-08T03:40:49.231934+0000","last_unstale":"2023-05-08T03:40:50.290230+0000","last_undegraded":"2023-05-08T03:40:50.290230+0000","last_fullsized":"2023-05-08T03:40:50.290230+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T08:30:46.523751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.273156+0000","last_change":"2023-05-08T03:40:48.803996+0000","last_active":"2023-05-08T03:40:51.273156+0000","last_peered":"2023-05-08T03:40:51.273156+0000","last_clean":"2023-05-08T03:40:51.273156+0000","last_became_active":"2023-05-08T03:40:48.803684+0000","last_became_peered":"2023-05-08T03:40:48.803684+0000","last_unstale":"2023-05-08T03:40:51.273156+0000","last_undegraded":"2023-05-08T03:40:51.273156+0000","last_fullsized":"2023-05-08T03:40:51.273156+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T08:13:18.973444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:52.175439+0000","last_change":"2023-05-08T03:40:49.234152+0000","last_active":"2023-05-08T03:40:52.175439+0000","last_peered":"2023-05-08T03:40:52.175439+0000","last_clean":"2023-05-08T03:40:52.175439+0000","last_became_active":"2023-05-08T03:40:49.233675+0000","last_became_peered":"2023-05-08T03:40:49.233675+0000","last_unstale":"2023-05-08T03:40:52.175439+0000","last_undegraded":"2023-05-08T03:40:52.175439+0000","last_fullsized":"2023-05-08T03:40:52.175439+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T08:53:30.821743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:52.351249+0000","last_change":"2023-05-08T03:40:48.798736+0000","last_active":"2023-05-08T03:40:52.351249+0000","last_peered":"2023-05-08T03:40:52.351249+0000","last_clean":"2023-05-08T03:40:52.351249+0000","last_became_active":"2023-05-08T03:40:48.798418+0000","last_became_peered":"2023-05-08T03:40:48.798418+0000","last_unstale":"2023-05-08T03:40:52.351249+0000","last_undegraded":"2023-05-08T03:40:52.351249+0000","last_fullsized":"2023-05-08T03:40:52.351249+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T07:52:30.962269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991638+0000","last_change":"2023-05-08T03:40:49.235205+0000","last_active":"2023-05-08T03:40:51.991638+0000","last_peered":"2023-05-08T03:40:51.991638+0000","last_clean":"2023-05-08T03:40:51.991638+0000","last_became_active":"2023-05-08T03:40:49.234898+0000","last_became_peered":"2023-05-08T03:40:49.234898+0000","last_unstale":"2023-05-08T03:40:51.991638+0000","last_undegraded":"2023-05-08T03:40:51.991638+0000","last_fullsized":"2023-05-08T03:40:51.991638+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T09:51:49.501098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'3","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:53.359262+0000","last_change":"2023-05-08T03:40:48.802820+0000","last_active":"2023-05-08T03:40:53.359262+0000","last_peered":"2023-05-08T03:40:53.359262+0000","last_clean":"2023-05-08T03:40:53.359262+0000","last_became_active":"2023-05-08T03:40:48.802457+0000","last_became_peered":"2023-05-08T03:40:48.802457+0000","last_unstale":"2023-05-08T03:40:53.359262+0000","last_undegraded":"2023-05-08T03:40:53.359262+0000","last_fullsized":"2023-05-08T03:40:53.359262+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T05:22:19.608125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991798+0000","last_change":"2023-05-08T03:40:49.238318+0000","last_active":"2023-05-08T03:40:51.991798+0000","last_peered":"2023-05-08T03:40:51.991798+0000","last_clean":"2023-05-08T03:40:51.991798+0000","last_became_active":"2023-05-08T03:40:49.237994+0000","last_became_peered":"2023-05-08T03:40:49.237994+0000","last_unstale":"2023-05-08T03:40:51.991798+0000","last_undegraded":"2023-05-08T03:40:51.991798+0000","last_fullsized":"2023-05-08T03:40:51.991798+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T14:44:53.119130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.323617+0000","last_change":"2023-05-08T03:40:48.803795+0000","last_active":"2023-05-08T03:40:51.323617+0000","last_peered":"2023-05-08T03:40:51.323617+0000","last_clean":"2023-05-08T03:40:51.323617+0000","last_became_active":"2023-05-08T03:40:48.803001+0000","last_became_peered":"2023-05-08T03:40:48.803001+0000","last_unstale":"2023-05-08T03:40:51.323617+0000","last_undegraded":"2023-05-08T03:40:51.323617+0000","last_fullsized":"2023-05-08T03:40:51.323617+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T07:43:47.011238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'1","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991502+0000","last_change":"2023-05-08T03:40:49.237298+0000","last_active":"2023-05-08T03:40:51.991502+0000","last_peered":"2023-05-08T03:40:51.991502+0000","last_clean":"2023-05-08T03:40:51.991502+0000","last_became_active":"2023-05-08T03:40:49.236984+0000","last_became_peered":"2023-05-08T03:40:49.236984+0000","last_unstale":"2023-05-08T03:40:51.991502+0000","last_undegraded":"2023-05-08T03:40:51.991502+0000","last_fullsized":"2023-05-08T03:40:51.991502+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T14:05:30.754412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.222153+0000","last_change":"2023-05-08T03:40:48.801987+0000","last_active":"2023-05-08T03:40:50.222153+0000","last_peered":"2023-05-08T03:40:50.222153+0000","last_clean":"2023-05-08T03:40:50.222153+0000","last_became_active":"2023-05-08T03:40:48.801521+0000","last_became_peered":"2023-05-08T03:40:48.801521+0000","last_unstale":"2023-05-08T03:40:50.222153+0000","last_undegraded":"2023-05-08T03:40:50.222153+0000","last_fullsized":"2023-05-08T03:40:50.222153+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:47.766673+0000","last_clean_scrub_stamp":"2023-05-08T03:40:47.766673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T03:49:08.381600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991668+0000","last_change":"2023-05-08T03:40:49.240916+0000","last_active":"2023-05-08T03:40:51.991668+0000","last_peered":"2023-05-08T03:40:51.991668+0000","last_clean":"2023-05-08T03:40:51.991668+0000","last_became_active":"2023-05-08T03:40:49.240626+0000","last_became_peered":"2023-05-08T03:40:49.240626+0000","last_unstale":"2023-05-08T03:40:51.991668+0000","last_undegraded":"2023-05-08T03:40:51.991668+0000","last_fullsized":"2023-05-08T03:40:51.991668+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T06:18:16.782559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.290263+0000","last_change":"2023-05-08T03:40:49.236506+0000","last_active":"2023-05-08T03:40:50.290263+0000","last_peered":"2023-05-08T03:40:50.290263+0000","last_clean":"2023-05-08T03:40:50.290263+0000","last_became_active":"2023-05-08T03:40:49.236065+0000","last_became_peered":"2023-05-08T03:40:49.236065+0000","last_unstale":"2023-05-08T03:40:50.290263+0000","last_undegraded":"2023-05-08T03:40:50.290263+0000","last_fullsized":"2023-05-08T03:40:50.290263+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T04:00:41.965873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.273160+0000","last_change":"2023-05-08T03:40:49.236262+0000","last_active":"2023-05-08T03:40:51.273160+0000","last_peered":"2023-05-08T03:40:51.273160+0000","last_clean":"2023-05-08T03:40:51.273160+0000","last_became_active":"2023-05-08T03:40:49.235892+0000","last_became_peered":"2023-05-08T03:40:49.235892+0000","last_unstale":"2023-05-08T03:40:51.273160+0000","last_undegraded":"2023-05-08T03:40:51.273160+0000","last_fullsized":"2023-05-08T03:40:51.273160+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T11:18:58.158779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.273174+0000","last_change":"2023-05-08T03:40:49.232946+0000","last_active":"2023-05-08T03:40:51.273174+0000","last_peered":"2023-05-08T03:40:51.273174+0000","last_clean":"2023-05-08T03:40:51.273174+0000","last_became_active":"2023-05-08T03:40:49.232642+0000","last_became_peered":"2023-05-08T03:40:49.232642+0000","last_unstale":"2023-05-08T03:40:51.273174+0000","last_undegraded":"2023-05-08T03:40:51.273174+0000","last_fullsized":"2023-05-08T03:40:51.273174+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T05:32:46.280731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991435+0000","last_change":"2023-05-08T03:40:49.238342+0000","last_active":"2023-05-08T03:40:51.991435+0000","last_peered":"2023-05-08T03:40:51.991435+0000","last_clean":"2023-05-08T03:40:51.991435+0000","last_became_active":"2023-05-08T03:40:49.237973+0000","last_became_peered":"2023-05-08T03:40:49.237973+0000","last_unstale":"2023-05-08T03:40:51.991435+0000","last_undegraded":"2023-05-08T03:40:51.991435+0000","last_fullsized":"2023-05-08T03:40:51.991435+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T13:53:38.093200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.222110+0000","last_change":"2023-05-08T03:40:49.226285+0000","last_active":"2023-05-08T03:40:50.222110+0000","last_peered":"2023-05-08T03:40:50.222110+0000","last_clean":"2023-05-08T03:40:50.222110+0000","last_became_active":"2023-05-08T03:40:49.225962+0000","last_became_peered":"2023-05-08T03:40:49.225962+0000","last_unstale":"2023-05-08T03:40:50.222110+0000","last_undegraded":"2023-05-08T03:40:50.222110+0000","last_fullsized":"2023-05-08T03:40:50.222110+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T11:58:59.434249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.290540+0000","last_change":"2023-05-08T03:40:49.238692+0000","last_active":"2023-05-08T03:40:50.290540+0000","last_peered":"2023-05-08T03:40:50.290540+0000","last_clean":"2023-05-08T03:40:50.290540+0000","last_became_active":"2023-05-08T03:40:49.238234+0000","last_became_peered":"2023-05-08T03:40:49.238234+0000","last_unstale":"2023-05-08T03:40:50.290540+0000","last_undegraded":"2023-05-08T03:40:50.290540+0000","last_fullsized":"2023-05-08T03:40:50.290540+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T13:25:41.710681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.273376+0000","last_change":"2023-05-08T03:40:49.227549+0000","last_active":"2023-05-08T03:40:51.273376+0000","last_peered":"2023-05-08T03:40:51.273376+0000","last_clean":"2023-05-08T03:40:51.273376+0000","last_became_active":"2023-05-08T03:40:49.227259+0000","last_became_peered":"2023-05-08T03:40:49.227259+0000","last_unstale":"2023-05-08T03:40:51.273376+0000","last_undegraded":"2023-05-08T03:40:51.273376+0000","last_fullsized":"2023-05-08T03:40:51.273376+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T03:50:25.923147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:52.175680+0000","last_change":"2023-05-08T03:40:49.238832+0000","last_active":"2023-05-08T03:40:52.175680+0000","last_peered":"2023-05-08T03:40:52.175680+0000","last_clean":"2023-05-08T03:40:52.175680+0000","last_became_active":"2023-05-08T03:40:49.238521+0000","last_became_peered":"2023-05-08T03:40:49.238521+0000","last_unstale":"2023-05-08T03:40:52.175680+0000","last_undegraded":"2023-05-08T03:40:52.175680+0000","last_fullsized":"2023-05-08T03:40:52.175680+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T06:59:10.616806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.268410+0000","last_change":"2023-05-08T03:40:49.228489+0000","last_active":"2023-05-08T03:40:51.268410+0000","last_peered":"2023-05-08T03:40:51.268410+0000","last_clean":"2023-05-08T03:40:51.268410+0000","last_became_active":"2023-05-08T03:40:49.228178+0000","last_became_peered":"2023-05-08T03:40:49.228178+0000","last_unstale":"2023-05-08T03:40:51.268410+0000","last_undegraded":"2023-05-08T03:40:51.268410+0000","last_fullsized":"2023-05-08T03:40:51.268410+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T05:47:36.620662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:52.175253+0000","last_change":"2023-05-08T03:40:49.243094+0000","last_active":"2023-05-08T03:40:52.175253+0000","last_peered":"2023-05-08T03:40:52.175253+0000","last_clean":"2023-05-08T03:40:52.175253+0000","last_became_active":"2023-05-08T03:40:49.242775+0000","last_became_peered":"2023-05-08T03:40:49.242775+0000","last_unstale":"2023-05-08T03:40:52.175253+0000","last_undegraded":"2023-05-08T03:40:52.175253+0000","last_fullsized":"2023-05-08T03:40:52.175253+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T12:58:00.099315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:51.991361+0000","last_change":"2023-05-08T03:40:49.228943+0000","last_active":"2023-05-08T03:40:51.991361+0000","last_peered":"2023-05-08T03:40:51.991361+0000","last_clean":"2023-05-08T03:40:51.991361+0000","last_became_active":"2023-05-08T03:40:49.228657+0000","last_became_peered":"2023-05-08T03:40:49.228657+0000","last_unstale":"2023-05-08T03:40:51.991361+0000","last_undegraded":"2023-05-08T03:40:51.991361+0000","last_fullsized":"2023-05-08T03:40:51.991361+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T12:33:01.351116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.222327+0000","last_change":"2023-05-08T03:40:49.233736+0000","last_active":"2023-05-08T03:40:50.222327+0000","last_peered":"2023-05-08T03:40:50.222327+0000","last_clean":"2023-05-08T03:40:50.222327+0000","last_became_active":"2023-05-08T03:40:49.233418+0000","last_became_peered":"2023-05-08T03:40:49.233418+0000","last_unstale":"2023-05-08T03:40:50.222327+0000","last_undegraded":"2023-05-08T03:40:50.222327+0000","last_fullsized":"2023-05-08T03:40:50.222327+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T13:29:20.896557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-05-08T03:40:50.290361+0000","last_change":"2023-05-08T03:40:49.235658+0000","last_active":"2023-05-08T03:40:50.290361+0000","last_peered":"2023-05-08T03:40:50.290361+0000","last_clean":"2023-05-08T03:40:50.290361+0000","last_became_active":"2023-05-08T03:40:49.235289+0000","last_became_peered":"2023-05-08T03:40:49.235289+0000","last_unstale":"2023-05-08T03:40:50.290361+0000","last_undegraded":"2023-05-08T03:40:50.290361+0000","last_fullsized":"2023-05-08T03:40:50.290361+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-08T03:40:48.775684+0000","last_clean_scrub_stamp":"2023-05-08T03:40:48.775684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-09T03:52:16.806774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":60535,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":254,"num_read_kb":189,"num_write":151,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":181605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":133,"ondisk_log_size":133,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":77,"seq":330712481812,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5924,"kb_used_data":860,"kb_used_omap":0,"kb_used_meta":5056,"kb_avail":93739228,"statfs":{"total":95995035648,"available":95988969472,"internally_reserved":0,"allocated":880640,"data_stored":421235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5177344},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 8 03:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.497}]},{"osd":1,"last update":"Mon May 8 03:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.64400000000000002}]},{"osd":2,"last update":"Mon May 8 03:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.56899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":4,"last update":"Mon May 8 03:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.75},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.71799999999999997}]},{"osd":5,"last update":"Mon May 8 03:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.79300000000000004}]},{"osd":6,"last update":"Mon May 8 03:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.872},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1,"5min":1,"15min":1},"last":0.73699999999999999}]},{"osd":7,"last update":"Mon May 8 03:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.80700000000000005}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]},{"osd":9,"last update":"Mon May 8 03:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.90500000000000003}]},{"osd":10,"last update":"Mon May 8 03:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.88600000000000001}]}]},{"osd":10,"up_from":70,"seq":300647710745,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6920,"kb_used_data":1536,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":93738232,"statfs":{"total":95995035648,"available":95987949568,"internally_reserved":0,"allocated":1572864,"data_stored":1069305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":1,"last update":"Mon May 8 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.443},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.46000000000000002}]},{"osd":2,"last update":"Mon May 8 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.60299999999999998}]},{"osd":3,"last update":"Mon May 8 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.48599999999999999}]},{"osd":4,"last update":"Mon May 8 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.42199999999999999}]},{"osd":5,"last update":"Mon May 8 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.57799999999999996}]},{"osd":6,"last update":"Mon May 8 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.51700000000000002}]},{"osd":7,"last update":"Mon May 8 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.68400000000000005}]},{"osd":8,"last update":"Mon May 8 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.52900000000000003}]},{"osd":9,"last update":"Mon May 8 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.61599999999999999}]},{"osd":11,"last update":"Mon May 8 03:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.64900000000000002}]}]},{"osd":9,"up_from":65,"seq":279172874270,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6068,"kb_used_data":876,"kb_used_omap":0,"kb_used_meta":5184,"kb_avail":93739084,"statfs":{"total":95995035648,"available":95988822016,"internally_reserved":0,"allocated":897024,"data_stored":421471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5308416},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 8 03:41:25 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.41699999999999998,"15min":0.41099999999999998},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":2.3570000000000002,"5min":2.3570000000000002,"15min":2.3570000000000002},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.41499999999999998,"15min":0.42499999999999999},"min":{"1min":0.26700000000000002,"5min":0.247,"15min":0.247},"max":{"1min":0.46100000000000002,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.33300000000000002}]},{"osd":1,"last update":"Mon May 8 03:41:25 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58899999999999997,"15min":0.59199999999999997},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.625,"15min":0.621},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":2.339,"5min":2.339,"15min":2.339},"last":0.54400000000000004}]},{"osd":2,"last update":"Mon May 8 03:41:25 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.65500000000000003,"15min":0.65600000000000003},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":2.306,"5min":2.306,"15min":2.306},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.56200000000000006,"15min":0.55200000000000005},"min":{"1min":0.42799999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":2.3839999999999999,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":0.51700000000000002}]},{"osd":3,"last update":"Mon May 8 03:41:25 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.495,"15min":0.503},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.52900000000000003,"15min":0.52500000000000002},"min":{"1min":0.34399999999999997,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":2.2629999999999999,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":0.35999999999999999}]},{"osd":4,"last update":"Mon May 8 03:41:25 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.57699999999999996,"15min":0.56799999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":2.1720000000000002,"5min":2.1720000000000002,"15min":2.1720000000000002},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.64200000000000002,"15min":0.64600000000000002},"min":{"1min":0.46200000000000002,"5min":0.442,"15min":0.442},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.52500000000000002}]},{"osd":5,"last update":"Mon May 8 03:41:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.63300000000000001,"15min":0.64300000000000002},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.67900000000000005,"15min":0.69399999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.81000000000000005,"5min":1.044,"15min":1.044},"last":0.61699999999999999}]},{"osd":6,"last update":"Mon May 8 03:41:25 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.66200000000000003,"15min":0.65400000000000003},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":4.7389999999999999,"5min":4.7389999999999999,"15min":4.7389999999999999},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.56599999999999995,"15min":0.56999999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":2.137,"5min":2.137,"15min":2.137},"last":0.42999999999999999}]},{"osd":7,"last update":"Mon May 8 03:41:25 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.70599999999999996,"15min":0.71599999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0169999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.73499999999999999,"15min":0.74299999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.66600000000000004}]},{"osd":8,"last update":"Mon May 8 03:41:25 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.45300000000000001,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":2.323,"5min":2.323,"15min":2.323},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.70899999999999996,"15min":0.71099999999999997},"min":{"1min":0.48799999999999999,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.591,"5min":1.591,"15min":1.591},"last":0.627}]},{"osd":10,"last update":"Mon May 8 03:40:49 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.65500000000000003}]}]},{"osd":8,"up_from":58,"seq":249108103201,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6256,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":93738896,"statfs":{"total":95995035648,"available":95988629504,"internally_reserved":0,"allocated":892928,"data_stored":421060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 8 03:41:05 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54900000000000004,"15min":0.54700000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.73799999999999999,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.53800000000000003,"15min":0.54200000000000004},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.67800000000000005,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.39100000000000001}]},{"osd":1,"last update":"Mon May 8 03:41:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58299999999999996,"15min":0.58399999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.93200000000000005,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.53600000000000003,"15min":0.53400000000000003},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.48499999999999999}]},{"osd":2,"last update":"Mon May 8 03:41:05 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.47099999999999997,"15min":0.47299999999999998},"min":{"1min":0.28599999999999998,"5min":0.25,"15min":0.25},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46999999999999997,"15min":0.47199999999999998},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.50900000000000001}]},{"osd":3,"last update":"Mon May 8 03:41:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.61399999999999999,"15min":0.621},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.84799999999999998,"5min":1.036,"15min":1.036},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.62,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.65500000000000003}]},{"osd":4,"last update":"Mon May 8 03:41:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.61599999999999999,"15min":0.61199999999999999},"min":{"1min":0.40300000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.89200000000000002,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.624,"15min":0.626},"min":{"1min":0.41199999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.82799999999999996,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.68799999999999994}]},{"osd":5,"last update":"Mon May 8 03:41:05 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.314,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.879,"5min":1.087,"15min":1.087},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.57799999999999996,"15min":0.57699999999999996},"min":{"1min":0.33000000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.72399999999999998}]},{"osd":6,"last update":"Mon May 8 03:41:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.64700000000000002,"15min":0.65100000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.68200000000000005,"15min":0.68600000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.91500000000000004,"5min":1.196,"15min":1.196},"last":0.71399999999999997}]},{"osd":7,"last update":"Mon May 8 03:41:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.68400000000000005,"15min":0.68600000000000005},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.70999999999999996,"15min":0.70799999999999996},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.80000000000000004}]},{"osd":9,"last update":"Mon May 8 03:41:27 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.70799999999999996,"15min":0.69599999999999995},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.68899999999999995,"15min":0.68100000000000005},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.78000000000000003}]},{"osd":10,"last update":"Mon May 8 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.85699999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]}]},{"osd":7,"up_from":50,"seq":214748364838,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6904,"kb_used_data":1456,"kb_used_omap":0,"kb_used_meta":5440,"kb_avail":93738248,"statfs":{"total":95995035648,"available":95987965952,"internally_reserved":0,"allocated":1490944,"data_stored":1013620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5570560},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 8 03:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.52600000000000002,"15min":0.52000000000000002},"min":{"1min":0.36899999999999999,"5min":0.311,"15min":0.311},"max":{"1min":0.76300000000000001,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.434},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.57699999999999996,"15min":0.58099999999999996},"min":{"1min":0.42799999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.66400000000000003,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.45100000000000001}]},{"osd":1,"last update":"Mon May 8 03:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.40799999999999997,"15min":0.40200000000000002},"min":{"1min":0.29499999999999998,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.45800000000000002,"15min":0.45600000000000002},"min":{"1min":0.311,"5min":0.248,"15min":0.248},"max":{"1min":0.68700000000000006,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.502}]},{"osd":2,"last update":"Mon May 8 03:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.61699999999999999,"15min":0.61799999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.59099999999999997,"15min":0.58299999999999996},"min":{"1min":0.48499999999999999,"5min":0.378,"15min":0.378},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.53500000000000003}]},{"osd":3,"last update":"Mon May 8 03:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.54300000000000004,"15min":0.54500000000000004},"min":{"1min":0.38100000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.73399999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.58299999999999996,"15min":0.57699999999999996},"min":{"1min":0.39800000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.47999999999999998}]},{"osd":4,"last update":"Mon May 8 03:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.55600000000000005,"15min":0.56100000000000005},"min":{"1min":0.32300000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.76500000000000001,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.52700000000000002,"15min":0.52600000000000002},"min":{"1min":0.33500000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.73599999999999999,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.44500000000000001}]},{"osd":5,"last update":"Mon May 8 03:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.64200000000000002,"15min":0.63800000000000001},"min":{"1min":0.51300000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.80100000000000005,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.66500000000000004,"15min":0.66100000000000003},"min":{"1min":0.56699999999999995,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.79400000000000004,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.60999999999999999}]},{"osd":6,"last update":"Mon May 8 03:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.67100000000000004,"15min":0.66800000000000004},"min":{"1min":0.52000000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.90000000000000002,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":1.7370000000000001},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.66200000000000003,"15min":0.65700000000000003},"min":{"1min":0.46000000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.92100000000000004}]},{"osd":8,"last update":"Mon May 8 03:41:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.69399999999999995,"15min":0.70199999999999996},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.77900000000000003,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.70399999999999996,"15min":0.70299999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.65100000000000002}]},{"osd":9,"last update":"Mon May 8 03:41:28 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.74099999999999999,"15min":0.752},"min":{"1min":0.53800000000000003,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.80600000000000005,"5min":1.258,"15min":1.258},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.55400000000000005,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.77200000000000002}]},{"osd":10,"last update":"Mon May 8 03:40:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.72599999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]}]},{"osd":6,"up_from":45,"seq":193273528361,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6184,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":5312,"kb_avail":93738968,"statfs":{"total":95995035648,"available":95988703232,"internally_reserved":0,"allocated":884736,"data_stored":420866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5439488},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 8 03:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.38100000000000001,"15min":0.36799999999999999},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.34000000000000002}]},{"osd":1,"last update":"Mon May 8 03:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.53400000000000003,"15min":0.53500000000000003},"min":{"1min":0.35399999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.53500000000000003,"15min":0.53300000000000003},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.66000000000000003}]},{"osd":2,"last update":"Mon May 8 03:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.53700000000000003,"15min":0.53500000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.56000000000000005,"15min":0.55800000000000005},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.78500000000000003}]},{"osd":3,"last update":"Mon May 8 03:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.42999999999999999,"15min":0.42799999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.46300000000000002,"15min":0.45800000000000002},"min":{"1min":0.32000000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.623}]},{"osd":4,"last update":"Mon May 8 03:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.80800000000000005,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.58599999999999997,"15min":0.59099999999999997},"min":{"1min":0.39700000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.75600000000000001}]},{"osd":5,"last update":"Mon May 8 03:41:21 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.59599999999999997,"15min":0.59399999999999997},"min":{"1min":0.40899999999999997,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.70899999999999996,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.83299999999999996,"5min":0.878,"15min":0.878},"last":0.58499999999999996}]},{"osd":7,"last update":"Mon May 8 03:40:43 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.64200000000000002,"15min":0.64000000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.63800000000000001,"15min":0.63200000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.871}]},{"osd":8,"last update":"Mon May 8 03:41:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.67200000000000004,"15min":0.67700000000000005},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.66600000000000004,"15min":0.66800000000000004},"min":{"1min":0.51900000000000002,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.81000000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.60699999999999998}]},{"osd":9,"last update":"Mon May 8 03:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.65500000000000003,"15min":0.67100000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.64800000000000002,"15min":0.66500000000000004},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.69099999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.81499999999999995}]},{"osd":10,"last update":"Mon May 8 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.89400000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574913,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7264,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":6336,"kb_avail":93737888,"statfs":{"total":95995035648,"available":95987597312,"internally_reserved":0,"allocated":942080,"data_stored":476894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6488064},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 8 03:40:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.51200000000000001,"15min":0.496},"min":{"1min":0.372,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.81299999999999994,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.50900000000000001,"15min":0.47699999999999998},"min":{"1min":0.39200000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.68799999999999994}]},{"osd":2,"last update":"Mon May 8 03:40:53 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.54800000000000004,"15min":0.51400000000000001},"min":{"1min":0.46800000000000003,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.626,"5min":0.54200000000000004,"15min":0.504},"min":{"1min":0.497,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.58499999999999996}]},{"osd":3,"last update":"Mon May 8 03:41:16 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.56899999999999995,"15min":0.51900000000000002},"min":{"1min":0.41099999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.625,"5min":0.55500000000000005,"15min":0.52200000000000002},"min":{"1min":0.45200000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.56699999999999995}]},{"osd":4,"last update":"Mon May 8 03:40:38 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.42399999999999999,"15min":0.40600000000000003},"min":{"1min":0.30499999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.498,"15min":0.46800000000000003},"min":{"1min":0.373,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.38800000000000001}]},{"osd":5,"last update":"Mon May 8 03:41:03 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.56899999999999995,"15min":0.56299999999999994},"min":{"1min":0.51600000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.60199999999999998,"15min":0.57599999999999996},"min":{"1min":0.59799999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.67500000000000004}]},{"osd":6,"last update":"Mon May 8 03:41:24 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.629,"15min":0.60699999999999998},"min":{"1min":0.437,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.755,"5min":0.64700000000000002,"15min":0.61599999999999999},"min":{"1min":0.46800000000000003,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.5900000000000001,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.63700000000000001}]},{"osd":7,"last update":"Mon May 8 03:40:43 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.55000000000000004,"15min":0.53000000000000003},"min":{"1min":0.36799999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.58799999999999997,"15min":0.56699999999999995},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.45600000000000002}]},{"osd":8,"last update":"Mon May 8 03:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.70399999999999996,"15min":0.68999999999999995},"min":{"1min":0.54700000000000004,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.98599999999999999,"5min":1.03,"15min":1.03},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.64800000000000002,"15min":0.63500000000000001},"min":{"1min":0.55600000000000005,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.89000000000000001,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.70699999999999996}]},{"osd":9,"last update":"Mon May 8 03:41:28 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.78100000000000003,"15min":0.76900000000000002},"min":{"1min":0.57399999999999995,"5min":0.44,"15min":0.44},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.70899999999999996,"15min":0.69699999999999995},"min":{"1min":0.51100000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.66400000000000003}]},{"osd":10,"last update":"Mon May 8 03:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.505},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.62}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738438,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7164,"kb_used_data":884,"kb_used_omap":0,"kb_used_meta":6272,"kb_avail":93737988,"statfs":{"total":95995035648,"available":95987699712,"internally_reserved":0,"allocated":905216,"data_stored":422131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6422528},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon May 8 03:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56799999999999995,"15min":0.59499999999999997},"min":{"1min":0.435,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.69699999999999995,"5min":1.091,"15min":1.091},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.58099999999999996,"15min":0.60299999999999998},"min":{"1min":0.436,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.69199999999999995,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.45200000000000001}]},{"osd":2,"last update":"Mon May 8 03:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.53500000000000003,"15min":0.53100000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.69399999999999995,"5min":1.159,"15min":1.159},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.51800000000000002,"15min":0.505},"min":{"1min":0.35299999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.67800000000000005,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.56999999999999995}]},{"osd":3,"last update":"Mon May 8 03:39:17 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.34999999999999998,"15min":0.34300000000000003},"min":{"1min":0.26500000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"last":0.313},{"interface":"front","average":{"1min":0.435,"5min":0.38800000000000001,"15min":0.38},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.35099999999999998}]},{"osd":4,"last update":"Mon May 8 03:40:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.54200000000000004,"15min":0.53500000000000003},"min":{"1min":0.42999999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.51700000000000002,"15min":0.51300000000000001},"min":{"1min":0.38,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.70299999999999996,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.40899999999999997}]},{"osd":5,"last update":"Mon May 8 03:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.55700000000000005,"15min":0.55300000000000005},"min":{"1min":0.47399999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.70699999999999996,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.67100000000000004,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.48599999999999999}]},{"osd":6,"last update":"Mon May 8 03:41:23 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.46999999999999997,"15min":0.46200000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.877,"5min":1.877,"15min":1.877},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54500000000000004,"15min":0.53500000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.8879999999999999,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":0.51400000000000001}]},{"osd":7,"last update":"Mon May 8 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.61499999999999999,"15min":0.60899999999999999},"min":{"1min":0.48399999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.59499999999999997,"15min":0.59299999999999997},"min":{"1min":0.41999999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.47899999999999998}]},{"osd":8,"last update":"Mon May 8 03:41:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60199999999999998,"15min":0.60099999999999998},"min":{"1min":0.441,"5min":0.376,"15min":0.376},"max":{"1min":0.80200000000000005,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.504},{"interface":"front","average":{"1min":0.624,"5min":0.65200000000000002,"15min":0.65700000000000003},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.82199999999999995,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.55400000000000005}]},{"osd":9,"last update":"Mon May 8 03:41:28 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.57399999999999995,"15min":0.59099999999999997},"min":{"1min":0.35699999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.65500000000000003,"5min":0.873,"15min":0.873},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.501,"5min":0.64500000000000002,"15min":0.66900000000000004},"min":{"1min":0.36899999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.79700000000000004,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.59099999999999997}]},{"osd":10,"last update":"Mon May 8 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.54600000000000004}]},{"osd":11,"last update":"Mon May 8 03:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.621},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.629}]}]},{"osd":2,"up_from":18,"seq":77309411389,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7352,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":6400,"kb_avail":93737800,"statfs":{"total":95995035648,"available":95987507200,"internally_reserved":0,"allocated":966656,"data_stored":478586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6553600},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 8 03:40:57 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.51400000000000001,"15min":0.51800000000000002},"min":{"1min":0.315,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.72599999999999998,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.53900000000000003,"15min":0.51900000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.77000000000000002,"5min":2.044,"15min":2.044},"last":0.70299999999999996}]},{"osd":1,"last update":"Mon May 8 03:40:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.53500000000000003,"15min":0.51900000000000002},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.54100000000000004,"15min":0.53500000000000003},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.71699999999999997}]},{"osd":3,"last update":"Mon May 8 03:41:19 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.61399999999999999,"15min":0.55700000000000005},"min":{"1min":0.38100000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.927,"5min":4.8419999999999996,"15min":4.8419999999999996},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.64200000000000002,"15min":0.59199999999999997},"min":{"1min":0.45300000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.9410000000000001,"5min":4.8220000000000001,"15min":4.8220000000000001},"last":0.66500000000000004}]},{"osd":4,"last update":"Mon May 8 03:40:36 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.53100000000000003,"15min":0.51700000000000002},"min":{"1min":0.39900000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.55700000000000005,"15min":0.54800000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.65100000000000002}]},{"osd":5,"last update":"Mon May 8 03:40:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.46700000000000003,"15min":0.46200000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.52300000000000002,"15min":0.51800000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.68400000000000005}]},{"osd":6,"last update":"Mon May 8 03:41:25 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64500000000000002,"15min":0.64700000000000002},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.90400000000000003,"5min":1.887,"15min":1.887},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.61299999999999999,"15min":0.59099999999999997},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.626}]},{"osd":7,"last update":"Mon May 8 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.61399999999999999,"15min":0.60199999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.58299999999999996,"15min":0.56599999999999995},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.46200000000000002}]},{"osd":8,"last update":"Mon May 8 03:41:05 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.53600000000000003,"15min":0.52000000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.60499999999999998,"15min":0.58499999999999996},"min":{"1min":0.39200000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.79300000000000004}]},{"osd":9,"last update":"Mon May 8 03:41:25 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.73099999999999998,"15min":0.72299999999999998},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.716,"5min":1.716,"15min":1.716},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.753,"5min":0.69499999999999995,"15min":0.68500000000000005},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":0.77800000000000002}]},{"osd":10,"last update":"Mon May 8 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.83299999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]}]},{"osd":3,"up_from":25,"seq":107374182456,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6516,"kb_used_data":876,"kb_used_omap":0,"kb_used_meta":5632,"kb_avail":93738636,"statfs":{"total":95995035648,"available":95988363264,"internally_reserved":0,"allocated":897024,"data_stored":420852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5767168},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 8 03:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.36299999999999999,"15min":0.34699999999999998},"min":{"1min":0.27900000000000003,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.52000000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.39400000000000002,"15min":0.38300000000000001},"min":{"1min":0.29399999999999998,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.53100000000000003,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.308}]},{"osd":1,"last update":"Mon May 8 03:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.51600000000000001,"15min":0.495},"min":{"1min":0.34300000000000003,"5min":0.309,"15min":0.309},"max":{"1min":0.68400000000000005,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.54200000000000004,"15min":0.51200000000000001},"min":{"1min":0.45000000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.68700000000000006,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.62}]},{"osd":2,"last update":"Mon May 8 03:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.55700000000000005,"15min":0.53100000000000003},"min":{"1min":0.45000000000000001,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.745,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56499999999999995,"15min":0.53300000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73599999999999999,"5min":2.351,"15min":2.351},"last":0.48699999999999999}]},{"osd":4,"last update":"Mon May 8 03:40:38 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.54400000000000004,"15min":0.52100000000000002},"min":{"1min":0.47399999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.878,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.55700000000000005,"15min":0.53300000000000003},"min":{"1min":0.45100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.88400000000000001,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.61099999999999999}]},{"osd":5,"last update":"Mon May 8 03:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.57399999999999995,"15min":0.57699999999999996},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.66500000000000004,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.58999999999999997,"15min":0.58199999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.79500000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.40699999999999997}]},{"osd":6,"last update":"Mon May 8 03:41:23 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47899999999999998,"15min":0.46000000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.69599999999999995,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.49399999999999999,"15min":0.47899999999999998},"min":{"1min":0.36099999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.71399999999999997,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.36399999999999999}]},{"osd":7,"last update":"Mon May 8 03:40:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.58899999999999997,"15min":0.57899999999999996},"min":{"1min":0.42999999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.63},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.71099999999999997,"15min":0.71199999999999997},"min":{"1min":0.44600000000000001,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.01,"5min":2.3740000000000001,"15min":2.3740000000000001},"last":0.57399999999999995}]},{"osd":8,"last update":"Mon May 8 03:40:03 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.46200000000000002}]},{"osd":9,"last update":"Mon May 8 03:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.65600000000000003,"15min":0.67200000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.75700000000000001,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.439},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.66400000000000003,"15min":0.68500000000000005},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.76100000000000001,"5min":1.089,"15min":1.089},"last":0.39000000000000001}]},{"osd":10,"last update":"Mon May 8 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.64200000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]}]},{"osd":4,"up_from":33,"seq":141733920819,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6380,"kb_used_data":868,"kb_used_omap":0,"kb_used_meta":5504,"kb_avail":93738772,"statfs":{"total":95995035648,"available":95988502528,"internally_reserved":0,"allocated":888832,"data_stored":421639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5636096},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 8 03:40:39 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.55400000000000005,"15min":0.55000000000000004},"min":{"1min":0.38500000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.80400000000000005,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.53300000000000003,"15min":0.51700000000000002},"min":{"1min":0.42799999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76300000000000001,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.57399999999999995}]},{"osd":1,"last update":"Mon May 8 03:40:39 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.36899999999999999,"15min":0.34000000000000002},"min":{"1min":0.27400000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.38900000000000001,"15min":0.35699999999999998},"min":{"1min":0.29099999999999998,"5min":0.254,"15min":0.254},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.443}]},{"osd":2,"last update":"Mon May 8 03:40:39 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.54800000000000004,"15min":0.52800000000000002},"min":{"1min":0.38600000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.56699999999999995,"15min":0.54900000000000004},"min":{"1min":0.40200000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.70999999999999996}]},{"osd":3,"last update":"Mon May 8 03:40:39 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.54300000000000004,"15min":0.51800000000000002},"min":{"1min":0.41999999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.79800000000000004,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.54800000000000004,"15min":0.53300000000000003},"min":{"1min":0.40400000000000003,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.85199999999999998}]},{"osd":5,"last update":"Mon May 8 03:41:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.59299999999999997,"15min":0.57799999999999996},"min":{"1min":0.48199999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.88800000000000001,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.61199999999999999,"15min":0.59399999999999997},"min":{"1min":0.439,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.78800000000000003}]},{"osd":6,"last update":"Mon May 8 03:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.61599999999999999,"15min":0.61199999999999999},"min":{"1min":0.45500000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.93000000000000005,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.624,"15min":0.60999999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.97699999999999998,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.74399999999999999}]},{"osd":7,"last update":"Mon May 8 03:40:39 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.57099999999999995,"15min":0.56000000000000005},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.56899999999999995,"15min":0.55700000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.48799999999999999}]},{"osd":8,"last update":"Mon May 8 03:41:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.65900000000000003,"15min":0.64700000000000002},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.98499999999999999,"5min":1.075,"15min":1.075},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.67900000000000005,"15min":0.66900000000000004},"min":{"1min":0.48899999999999999,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.77600000000000002}]},{"osd":9,"last update":"Mon May 8 03:41:26 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.73199999999999998,"15min":0.746},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.88500000000000001,"5min":1.125,"15min":1.125},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.73199999999999998,"15min":0.73999999999999999},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.94899999999999995,"5min":1.014,"15min":1.014},"last":0.83499999999999996}]},{"osd":10,"last update":"Mon May 8 03:40:48 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.60899999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]}]},{"osd":5,"up_from":38,"seq":163208757295,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7044,"kb_used_data":1468,"kb_used_omap":0,"kb_used_meta":5568,"kb_avail":93738108,"statfs":{"total":95995035648,"available":95987822592,"internally_reserved":0,"allocated":1503232,"data_stored":1012962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5701632},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon May 8 03:41:03 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.504,"15min":0.48799999999999999},"min":{"1min":0.35399999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.70399999999999996,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.51300000000000001,"15min":0.501},"min":{"1min":0.32500000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.69999999999999996,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.49199999999999999}]},{"osd":1,"last update":"Mon May 8 03:41:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.54100000000000004,"15min":0.53300000000000003},"min":{"1min":0.39700000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.71599999999999997,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.56000000000000005,"15min":0.55000000000000004},"min":{"1min":0.34200000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.79200000000000004,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.72699999999999998}]},{"osd":2,"last update":"Mon May 8 03:41:03 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.38900000000000001,"15min":0.376},"min":{"1min":0.32400000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.61199999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.40699999999999997,"15min":0.39600000000000002},"min":{"1min":0.30199999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.63900000000000001,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.65800000000000003}]},{"osd":3,"last update":"Mon May 8 03:41:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.52300000000000002,"15min":0.501},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.73099999999999998,"5min":1.083,"15min":1.083},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.53500000000000003,"15min":0.52300000000000002},"min":{"1min":0.33200000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.69699999999999995,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.623}]},{"osd":4,"last update":"Mon May 8 03:41:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.57999999999999996,"15min":0.56799999999999995},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.82099999999999995,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.57999999999999996,"15min":0.56699999999999995},"min":{"1min":0.42699999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.78200000000000003,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.69599999999999995}]},{"osd":6,"last update":"Mon May 8 03:41:22 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.57499999999999996,"15min":0.55100000000000005},"min":{"1min":0.39100000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.77700000000000002,"5min":1.175,"15min":1.175},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.56000000000000005,"15min":0.53400000000000003},"min":{"1min":0.45100000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.746,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.67400000000000004}]},{"osd":7,"last update":"Mon May 8 03:40:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.627,"15min":0.625},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.92300000000000004,"5min":1.018,"15min":1.018},"last":0.751},{"interface":"front","average":{"1min":0.62,"5min":0.63300000000000001,"15min":0.63500000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.82299999999999995,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.76700000000000002}]},{"osd":8,"last update":"Mon May 8 03:41:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.60799999999999998,"15min":0.61599999999999999},"min":{"1min":0.40999999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.75800000000000001,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.628,"15min":0.63},"min":{"1min":0.47499999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.81399999999999995,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.79700000000000004}]},{"osd":9,"last update":"Mon May 8 03:41:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.73599999999999999,"15min":0.749},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.81999999999999995,"5min":1.306,"15min":1.306},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.71899999999999997,"15min":0.72799999999999998},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.79600000000000004,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.82299999999999995}]},{"osd":10,"last update":"Mon May 8 03:40:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.86299999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":56241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":57933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":58161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-08T03:41:36.924 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2023-05-08T03:41:36.925 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-05-08T03:41:36.925 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2023-05-08T03:41:36.925 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- ceph health --format=json 2023-05-08T03:41:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:36 smithi133 ceph-mon[125939]: pgmap v281: 97 pgs: 97 active+clean; 636 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2023-05-08T03:41:37.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:36 smithi186 ceph-mon[126480]: pgmap v281: 97 pgs: 97 active+clean; 636 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2023-05-08T03:41:37.569 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.a/config 2023-05-08T03:41:37.940 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:37 smithi096 ceph-mon[124666]: from='client.14955 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-05-08T03:41:37.940 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:37 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2023-05-08T03:41:37.941 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:37 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]: dispatch 2023-05-08T03:41:37.941 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:37 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]: dispatch 2023-05-08T03:41:37.941 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:37 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]: dispatch 2023-05-08T03:41:37.941 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:37 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2023-05-08T03:41:37.941 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:37 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]: dispatch 2023-05-08T03:41:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:37 smithi133 ceph-mon[125939]: from='client.14955 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-05-08T03:41:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:37 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2023-05-08T03:41:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:37 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]: dispatch 2023-05-08T03:41:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:37 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]: dispatch 2023-05-08T03:41:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:37 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]: dispatch 2023-05-08T03:41:37.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:37 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2023-05-08T03:41:37.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:37 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]: dispatch 2023-05-08T03:41:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:37 smithi186 ceph-mon[126480]: from='client.14955 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-05-08T03:41:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:37 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2023-05-08T03:41:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:37 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]: dispatch 2023-05-08T03:41:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:37 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]: dispatch 2023-05-08T03:41:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:37 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]: dispatch 2023-05-08T03:41:38.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:37 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2023-05-08T03:41:38.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:37 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]: dispatch 2023-05-08T03:41:38.770 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:38.767+0000 7fca4f8ee700 1 -- 172.21.15.96:0/203292298 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca48101f50 msgr2=0x7fca4810a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:38.770 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:38.767+0000 7fca4f8ee700 1 --2- 172.21.15.96:0/203292298 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca48101f50 0x7fca4810a450 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fca38009990 tx=0x7fca38009ca0 comp rx=0 tx=0).stop 2023-05-08T03:41:38.771 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:38.767+0000 7fca4f8ee700 1 -- 172.21.15.96:0/203292298 shutdown_connections 2023-05-08T03:41:38.771 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:38.767+0000 7fca4f8ee700 1 --2- 172.21.15.96:0/203292298 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca4810a990 0x7fca4810cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:38.771 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:38.767+0000 7fca4f8ee700 1 --2- 172.21.15.96:0/203292298 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fca48101640 0x7fca48101a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:38.771 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:38.767+0000 7fca4f8ee700 1 --2- 172.21.15.96:0/203292298 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca48101f50 0x7fca4810a450 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:38.771 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:38.767+0000 7fca4f8ee700 1 -- 172.21.15.96:0/203292298 >> 172.21.15.96:0/203292298 conn(0x7fca480771a0 msgr2=0x7fca480775a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:38.771 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:38.767+0000 7fca4f8ee700 1 -- 172.21.15.96:0/203292298 shutdown_connections 2023-05-08T03:41:38.772 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:38.767+0000 7fca4f8ee700 1 -- 172.21.15.96:0/203292298 wait complete. 2023-05-08T03:41:38.772 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:38.767+0000 7fca4f8ee700 1 Processor -- start 2023-05-08T03:41:38.772 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:38.768+0000 7fca4f8ee700 1 -- start start 2023-05-08T03:41:38.774 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:38.768+0000 7fca4f8ee700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fca48101640 0x7fca481964f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:38.774 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:38.768+0000 7fca4f8ee700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca48101f50 0x7fca48196a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:38.775 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:38.768+0000 7fca4f8ee700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca4810a990 0x7fca4819aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:38.775 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:38.768+0000 7fca4f8ee700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca4819b4b0 con 0x7fca48101f50 2023-05-08T03:41:38.775 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:38.768+0000 7fca4f8ee700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca4819b620 con 0x7fca4810a990 2023-05-08T03:41:38.775 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:38.768+0000 7fca4f8ee700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca4819b7e0 con 0x7fca48101640 2023-05-08T03:41:38.775 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:38.768+0000 7fca4ce89700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca48101f50 0x7fca48196a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:38.775 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:38.768+0000 7fca4ce89700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca48101f50 0x7fca48196a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41058/0 (socket says 172.21.15.96:41058) 2023-05-08T03:41:38.775 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:38.768+0000 7fca4ce89700 1 -- 172.21.15.96:0/1614014785 learned_addr learned my addr 172.21.15.96:0/1614014785 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:41:38.776 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:38.768+0000 7fca4d68a700 1 --2- 172.21.15.96:0/1614014785 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fca48101640 0x7fca481964f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:38.776 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:38.768+0000 7fca4de8b700 1 --2- 172.21.15.96:0/1614014785 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca4810a990 0x7fca4819aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:38.777 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:38.768+0000 7fca4ce89700 1 -- 172.21.15.96:0/1614014785 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fca48101640 msgr2=0x7fca481964f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:38.777 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:38.768+0000 7fca4ce89700 1 --2- 172.21.15.96:0/1614014785 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fca48101640 0x7fca481964f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:38.777 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:38.768+0000 7fca4ce89700 1 -- 172.21.15.96:0/1614014785 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca4810a990 msgr2=0x7fca4819aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:38.777 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:38.768+0000 7fca4ce89700 1 --2- 172.21.15.96:0/1614014785 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca4810a990 0x7fca4819aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:38.777 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:38.768+0000 7fca4ce89700 1 -- 172.21.15.96:0/1614014785 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca380095f0 con 0x7fca48101f50 2023-05-08T03:41:38.778 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:38.768+0000 7fca4de8b700 1 --2- 172.21.15.96:0/1614014785 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca4810a990 0x7fca4819aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-08T03:41:38.778 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:38.768+0000 7fca4ce89700 1 --2- 172.21.15.96:0/1614014785 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca48101f50 0x7fca48196a30 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fca38000c00 tx=0x7fca3800f830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:38.778 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:38.769+0000 7fca3e7fc700 1 -- 172.21.15.96:0/1614014785 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3801d070 con 0x7fca48101f50 2023-05-08T03:41:38.778 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:38.769+0000 7fca3e7fc700 1 -- 172.21.15.96:0/1614014785 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fca3800fce0 con 0x7fca48101f50 2023-05-08T03:41:38.778 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:38.769+0000 7fca4f8ee700 1 -- 172.21.15.96:0/1614014785 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca48110410 con 0x7fca48101f50 2023-05-08T03:41:38.779 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:38.769+0000 7fca3e7fc700 1 -- 172.21.15.96:0/1614014785 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca38017770 con 0x7fca48101f50 2023-05-08T03:41:38.779 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:38.769+0000 7fca4f8ee700 1 -- 172.21.15.96:0/1614014785 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca48110280 con 0x7fca48101f50 2023-05-08T03:41:38.779 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:38.770+0000 7fca4f8ee700 1 -- 172.21.15.96:0/1614014785 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca481105a0 con 0x7fca48101f50 2023-05-08T03:41:38.779 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:38.771+0000 7fca3e7fc700 1 -- 172.21.15.96:0/1614014785 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fca380178d0 con 0x7fca48101f50 2023-05-08T03:41:38.779 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:38.771+0000 7fca3e7fc700 1 --2- 172.21.15.96:0/1614014785 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fca340a1260 0x7fca340a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:38.780 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:38.771+0000 7fca4d68a700 1 --2- 172.21.15.96:0/1614014785 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fca340a1260 0x7fca340a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:38.780 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:38.771+0000 7fca3e7fc700 1 -- 172.21.15.96:0/1614014785 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8153+0+0 (secure 0 0 0) 0x7fca380cdd90 con 0x7fca48101f50 2023-05-08T03:41:38.781 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:38.772+0000 7fca4d68a700 1 --2- 172.21.15.96:0/1614014785 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fca340a1260 0x7fca340a3710 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fca44005fd0 tx=0x7fca4400a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:38.781 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:38.776+0000 7fca3e7fc700 1 -- 172.21.15.96:0/1614014785 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fca3805c730 con 0x7fca48101f50 2023-05-08T03:41:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:38 smithi133 ceph-mon[125939]: pgmap v282: 97 pgs: 97 active+clean; 636 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 255 B/s wr, 7 op/s 2023-05-08T03:41:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:38 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2023-05-08T03:41:38.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:38 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2023-05-08T03:41:38.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:38 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]': finished 2023-05-08T03:41:38.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:38 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]': finished 2023-05-08T03:41:38.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:38 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2023-05-08T03:41:38.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:38 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2023-05-08T03:41:38.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:38 smithi133 ceph-mon[125939]: osdmap e83: 12 total, 12 up, 12 in 2023-05-08T03:41:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:38 smithi096 ceph-mon[124666]: pgmap v282: 97 pgs: 97 active+clean; 636 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 255 B/s wr, 7 op/s 2023-05-08T03:41:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:38 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2023-05-08T03:41:39.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:38 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2023-05-08T03:41:39.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:38 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]': finished 2023-05-08T03:41:39.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:38 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]': finished 2023-05-08T03:41:39.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:38 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2023-05-08T03:41:39.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:38 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2023-05-08T03:41:39.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:38 smithi096 ceph-mon[124666]: osdmap e83: 12 total, 12 up, 12 in 2023-05-08T03:41:39.010 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.007+0000 7fca4f8ee700 1 -- 172.21.15.96:0/1614014785 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fca481a3570 con 0x7fca48101f50 2023-05-08T03:41:39.010 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.007+0000 7fca3e7fc700 1 -- 172.21.15.96:0/1614014785 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fca38027080 con 0x7fca48101f50 2023-05-08T03:41:39.010 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:41:39.010 INFO:teuthology.orchestra.run.smithi096.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-05-08T03:41:39.012 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.009+0000 7fca4f8ee700 1 -- 172.21.15.96:0/1614014785 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fca340a1260 msgr2=0x7fca340a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:39.013 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.009+0000 7fca4f8ee700 1 --2- 172.21.15.96:0/1614014785 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fca340a1260 0x7fca340a3710 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fca44005fd0 tx=0x7fca4400a560 comp rx=0 tx=0).stop 2023-05-08T03:41:39.013 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.009+0000 7fca4f8ee700 1 -- 172.21.15.96:0/1614014785 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca48101f50 msgr2=0x7fca48196a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:39.013 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.009+0000 7fca4f8ee700 1 --2- 172.21.15.96:0/1614014785 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca48101f50 0x7fca48196a30 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fca38000c00 tx=0x7fca3800f830 comp rx=0 tx=0).stop 2023-05-08T03:41:39.013 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.010+0000 7fca4f8ee700 1 -- 172.21.15.96:0/1614014785 shutdown_connections 2023-05-08T03:41:39.013 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.010+0000 7fca4f8ee700 1 --2- 172.21.15.96:0/1614014785 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fca340a1260 0x7fca340a3710 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:39.013 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.010+0000 7fca4f8ee700 1 --2- 172.21.15.96:0/1614014785 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca4810a990 0x7fca4819aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:39.014 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.010+0000 7fca4f8ee700 1 --2- 172.21.15.96:0/1614014785 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fca48101640 0x7fca481964f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:39.014 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.010+0000 7fca4f8ee700 1 --2- 172.21.15.96:0/1614014785 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca48101f50 0x7fca48196a30 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:39.014 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.010+0000 7fca4f8ee700 1 -- 172.21.15.96:0/1614014785 >> 172.21.15.96:0/1614014785 conn(0x7fca480771a0 msgr2=0x7fca480fbe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:39.014 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.010+0000 7fca4f8ee700 1 -- 172.21.15.96:0/1614014785 shutdown_connections 2023-05-08T03:41:39.014 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.010+0000 7fca4f8ee700 1 -- 172.21.15.96:0/1614014785 wait complete. 2023-05-08T03:41:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:38 smithi186 ceph-mon[126480]: pgmap v282: 97 pgs: 97 active+clean; 636 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 255 B/s wr, 7 op/s 2023-05-08T03:41:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:38 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2023-05-08T03:41:39.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:38 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2023-05-08T03:41:39.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:38 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]': finished 2023-05-08T03:41:39.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:38 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]': finished 2023-05-08T03:41:39.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:38 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2023-05-08T03:41:39.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:38 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2023-05-08T03:41:39.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:38 smithi186 ceph-mon[126480]: osdmap e83: 12 total, 12 up, 12 in 2023-05-08T03:41:39.417 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2023-05-08T03:41:39.418 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-08T03:41:39.552 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.545+0000 7fd6c4e11700 1 -- 172.21.15.96:0/790498879 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6c0106060 msgr2=0x7fd6c0108460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:39.553 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.545+0000 7fd6c4e11700 1 --2- 172.21.15.96:0/790498879 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6c0106060 0x7fd6c0108460 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd6b800b0a0 tx=0x7fd6b800b3b0 comp rx=0 tx=0).stop 2023-05-08T03:41:39.553 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.545+0000 7fd6c4e11700 1 -- 172.21.15.96:0/790498879 shutdown_connections 2023-05-08T03:41:39.553 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.545+0000 7fd6c4e11700 1 --2- 172.21.15.96:0/790498879 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6c0106060 0x7fd6c0108460 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:39.554 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.545+0000 7fd6c4e11700 1 --2- 172.21.15.96:0/790498879 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd6c0100e20 0x7fd6c0103200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:39.554 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.545+0000 7fd6c4e11700 1 --2- 172.21.15.96:0/790498879 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6c0103740 0x7fd6c0105b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:39.554 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.545+0000 7fd6c4e11700 1 -- 172.21.15.96:0/790498879 >> 172.21.15.96:0/790498879 conn(0x7fd6c00fa820 msgr2=0x7fd6c00fcc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:39.555 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.545+0000 7fd6c4e11700 1 -- 172.21.15.96:0/790498879 shutdown_connections 2023-05-08T03:41:39.555 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.545+0000 7fd6c4e11700 1 -- 172.21.15.96:0/790498879 wait complete. 2023-05-08T03:41:39.555 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.546+0000 7fd6c4e11700 1 Processor -- start 2023-05-08T03:41:39.555 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.546+0000 7fd6c4e11700 1 -- start start 2023-05-08T03:41:39.556 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.546+0000 7fd6c4e11700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6c0100e20 0x7fd6c0196250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:39.557 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.546+0000 7fd6c4e11700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6c0103740 0x7fd6c0196790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:39.557 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.546+0000 7fd6c4e11700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd6c0106060 0x7fd6c019d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:39.557 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.546+0000 7fd6c4e11700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c019ddd0 con 0x7fd6c0100e20 2023-05-08T03:41:39.558 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.546+0000 7fd6c4e11700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c019df10 con 0x7fd6c0103740 2023-05-08T03:41:39.558 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.546+0000 7fd6c4e11700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c019e0a0 con 0x7fd6c0106060 2023-05-08T03:41:39.559 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.546+0000 7fd6be59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6c0100e20 0x7fd6c0196250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:39.559 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.546+0000 7fd6be59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6c0100e20 0x7fd6c0196250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41070/0 (socket says 172.21.15.96:41070) 2023-05-08T03:41:39.560 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.546+0000 7fd6be59c700 1 -- 172.21.15.96:0/775584520 learned_addr learned my addr 172.21.15.96:0/775584520 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:41:39.560 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.546+0000 7fd6bdd9b700 1 --2- 172.21.15.96:0/775584520 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6c0103740 0x7fd6c0196790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:39.560 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.546+0000 7fd6bed9d700 1 --2- 172.21.15.96:0/775584520 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd6c0106060 0x7fd6c019d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:39.560 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.546+0000 7fd6be59c700 1 -- 172.21.15.96:0/775584520 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd6c0106060 msgr2=0x7fd6c019d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:39.560 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.546+0000 7fd6be59c700 1 --2- 172.21.15.96:0/775584520 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd6c0106060 0x7fd6c019d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:39.561 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.546+0000 7fd6be59c700 1 -- 172.21.15.96:0/775584520 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6c0103740 msgr2=0x7fd6c0196790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:39.561 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.546+0000 7fd6be59c700 1 --2- 172.21.15.96:0/775584520 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6c0103740 0x7fd6c0196790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:39.561 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.546+0000 7fd6be59c700 1 -- 172.21.15.96:0/775584520 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b8009d00 con 0x7fd6c0100e20 2023-05-08T03:41:39.561 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.546+0000 7fd6be59c700 1 --2- 172.21.15.96:0/775584520 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6c0100e20 0x7fd6c0196250 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fd6b000e9c0 tx=0x7fd6b000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:39.562 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.547+0000 7fd6af7fe700 1 -- 172.21.15.96:0/775584520 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b00097b0 con 0x7fd6c0100e20 2023-05-08T03:41:39.563 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.547+0000 7fd6c4e11700 1 -- 172.21.15.96:0/775584520 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6c010bd20 con 0x7fd6c0100e20 2023-05-08T03:41:39.563 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.547+0000 7fd6af7fe700 1 -- 172.21.15.96:0/775584520 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd6b0004cf0 con 0x7fd6c0100e20 2023-05-08T03:41:39.563 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.547+0000 7fd6af7fe700 1 -- 172.21.15.96:0/775584520 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b0005600 con 0x7fd6c0100e20 2023-05-08T03:41:39.563 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.547+0000 7fd6c4e11700 1 -- 172.21.15.96:0/775584520 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6c010bb90 con 0x7fd6c0100e20 2023-05-08T03:41:39.563 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.548+0000 7fd6c4e11700 1 -- 172.21.15.96:0/775584520 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6c00fc390 con 0x7fd6c0100e20 2023-05-08T03:41:39.564 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.549+0000 7fd6af7fe700 1 -- 172.21.15.96:0/775584520 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fd6b000cc60 con 0x7fd6c0100e20 2023-05-08T03:41:39.565 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.549+0000 7fd6af7fe700 1 --2- 172.21.15.96:0/775584520 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fd6a80a11e0 0x7fd6a80a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:39.565 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.549+0000 7fd6bdd9b700 1 --2- 172.21.15.96:0/775584520 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fd6a80a11e0 0x7fd6a80a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:39.565 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.549+0000 7fd6af7fe700 1 -- 172.21.15.96:0/775584520 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7fd6b0014070 con 0x7fd6c0100e20 2023-05-08T03:41:39.565 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.550+0000 7fd6bdd9b700 1 --2- 172.21.15.96:0/775584520 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fd6a80a11e0 0x7fd6a80a3690 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd6b4009c60 tx=0x7fd6b4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:39.566 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.553+0000 7fd6af7fe700 1 -- 172.21.15.96:0/775584520 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fd6b0096530 con 0x7fd6c0100e20 2023-05-08T03:41:39.747 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.744+0000 7fd6c4e11700 1 -- 172.21.15.96:0/775584520 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd6c0061a20 con 0x7fd6c0100e20 2023-05-08T03:41:39.748 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.745+0000 7fd6af7fe700 1 -- 172.21.15.96:0/775584520 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+22437 (secure 0 0 0) 0x7fd6b0016330 con 0x7fd6c0100e20 2023-05-08T03:41:39.748 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:41:39.749 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":84,"fsid":"f7ffcfb0-ed50-11ed-9b01-001a4aab830c","created":"2023-05-08T03:33:42.765680+0000","modified":"2023-05-08T03:41:39.350582+0000","last_up_change":"2023-05-08T03:40:07.550882+0000","last_in_change":"2023-05-08T03:39:49.027947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-08T03:36:47.800739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-05-08T03:40:47.229693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-05-08T03:40:48.359294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2ee801e1-8eec-496d-a9ac-fc566b38bbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":1816903726},{"type":"v1","addr":"172.21.15.96:6803","nonce":1816903726}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":1816903726},{"type":"v1","addr":"172.21.15.96:6805","nonce":1816903726}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":1816903726},{"type":"v1","addr":"172.21.15.96:6809","nonce":1816903726}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":1816903726},{"type":"v1","addr":"172.21.15.96:6807","nonce":1816903726}]},"public_addr":"172.21.15.96:6803/1816903726","cluster_addr":"172.21.15.96:6805/1816903726","heartbeat_back_addr":"172.21.15.96:6809/1816903726","heartbeat_front_addr":"172.21.15.96:6807/1816903726","state":["exists","up"]},{"osd":1,"uuid":"eb73deea-fc7c-4f2f-8aef-2d71c598afda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":206989126},{"type":"v1","addr":"172.21.15.133:6801","nonce":206989126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":206989126},{"type":"v1","addr":"172.21.15.133:6803","nonce":206989126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":206989126},{"type":"v1","addr":"172.21.15.133:6807","nonce":206989126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":206989126},{"type":"v1","addr":"172.21.15.133:6805","nonce":206989126}]},"public_addr":"172.21.15.133:6801/206989126","cluster_addr":"172.21.15.133:6803/206989126","heartbeat_back_addr":"172.21.15.133:6807/206989126","heartbeat_front_addr":"172.21.15.133:6805/206989126","state":["exists","up"]},{"osd":2,"uuid":"74a2f239-e82d-4d87-9458-5373b6cbbffd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":1791188143},{"type":"v1","addr":"172.21.15.186:6801","nonce":1791188143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":1791188143},{"type":"v1","addr":"172.21.15.186:6803","nonce":1791188143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":1791188143},{"type":"v1","addr":"172.21.15.186:6807","nonce":1791188143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":1791188143},{"type":"v1","addr":"172.21.15.186:6805","nonce":1791188143}]},"public_addr":"172.21.15.186:6801/1791188143","cluster_addr":"172.21.15.186:6803/1791188143","heartbeat_back_addr":"172.21.15.186:6807/1791188143","heartbeat_front_addr":"172.21.15.186:6805/1791188143","state":["exists","up"]},{"osd":3,"uuid":"421eedf5-ba6e-484e-b715-78c1c10d684e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":3430402140},{"type":"v1","addr":"172.21.15.96:6811","nonce":3430402140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":3430402140},{"type":"v1","addr":"172.21.15.96:6813","nonce":3430402140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":3430402140},{"type":"v1","addr":"172.21.15.96:6817","nonce":3430402140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":3430402140},{"type":"v1","addr":"172.21.15.96:6815","nonce":3430402140}]},"public_addr":"172.21.15.96:6811/3430402140","cluster_addr":"172.21.15.96:6813/3430402140","heartbeat_back_addr":"172.21.15.96:6817/3430402140","heartbeat_front_addr":"172.21.15.96:6815/3430402140","state":["exists","up"]},{"osd":4,"uuid":"fb20100b-6a5a-462d-955d-1697a3861e96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":1237495996},{"type":"v1","addr":"172.21.15.133:6809","nonce":1237495996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":1237495996},{"type":"v1","addr":"172.21.15.133:6811","nonce":1237495996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":1237495996},{"type":"v1","addr":"172.21.15.133:6815","nonce":1237495996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":1237495996},{"type":"v1","addr":"172.21.15.133:6813","nonce":1237495996}]},"public_addr":"172.21.15.133:6809/1237495996","cluster_addr":"172.21.15.133:6811/1237495996","heartbeat_back_addr":"172.21.15.133:6815/1237495996","heartbeat_front_addr":"172.21.15.133:6813/1237495996","state":["exists","up"]},{"osd":5,"uuid":"00177913-8bd6-4391-83c3-08c2b1b8ef13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":541111862},{"type":"v1","addr":"172.21.15.186:6809","nonce":541111862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":541111862},{"type":"v1","addr":"172.21.15.186:6811","nonce":541111862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":541111862},{"type":"v1","addr":"172.21.15.186:6815","nonce":541111862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":541111862},{"type":"v1","addr":"172.21.15.186:6813","nonce":541111862}]},"public_addr":"172.21.15.186:6809/541111862","cluster_addr":"172.21.15.186:6811/541111862","heartbeat_back_addr":"172.21.15.186:6815/541111862","heartbeat_front_addr":"172.21.15.186:6813/541111862","state":["exists","up"]},{"osd":6,"uuid":"204baab6-ca6f-4eef-8b9c-91efc04cc30c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":386227948},{"type":"v1","addr":"172.21.15.96:6819","nonce":386227948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":386227948},{"type":"v1","addr":"172.21.15.96:6821","nonce":386227948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":386227948},{"type":"v1","addr":"172.21.15.96:6825","nonce":386227948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":386227948},{"type":"v1","addr":"172.21.15.96:6823","nonce":386227948}]},"public_addr":"172.21.15.96:6819/386227948","cluster_addr":"172.21.15.96:6821/386227948","heartbeat_back_addr":"172.21.15.96:6825/386227948","heartbeat_front_addr":"172.21.15.96:6823/386227948","state":["exists","up"]},{"osd":7,"uuid":"282db569-a76e-485b-a33d-f2579b956525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":218507954},{"type":"v1","addr":"172.21.15.133:6817","nonce":218507954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":218507954},{"type":"v1","addr":"172.21.15.133:6819","nonce":218507954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":218507954},{"type":"v1","addr":"172.21.15.133:6823","nonce":218507954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":218507954},{"type":"v1","addr":"172.21.15.133:6821","nonce":218507954}]},"public_addr":"172.21.15.133:6817/218507954","cluster_addr":"172.21.15.133:6819/218507954","heartbeat_back_addr":"172.21.15.133:6823/218507954","heartbeat_front_addr":"172.21.15.133:6821/218507954","state":["exists","up"]},{"osd":8,"uuid":"693e25b5-355d-4990-9467-0fac4c9133fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":1648475902},{"type":"v1","addr":"172.21.15.186:6817","nonce":1648475902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":1648475902},{"type":"v1","addr":"172.21.15.186:6819","nonce":1648475902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":1648475902},{"type":"v1","addr":"172.21.15.186:6823","nonce":1648475902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":1648475902},{"type":"v1","addr":"172.21.15.186:6821","nonce":1648475902}]},"public_addr":"172.21.15.186:6817/1648475902","cluster_addr":"172.21.15.186:6819/1648475902","heartbeat_back_addr":"172.21.15.186:6823/1648475902","heartbeat_front_addr":"172.21.15.186:6821/1648475902","state":["exists","up"]},{"osd":9,"uuid":"72fbff09-fe28-4014-86fc-c31f95cd19a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":543223824},{"type":"v1","addr":"172.21.15.96:6827","nonce":543223824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":543223824},{"type":"v1","addr":"172.21.15.96:6829","nonce":543223824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6832","nonce":543223824},{"type":"v1","addr":"172.21.15.96:6833","nonce":543223824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":543223824},{"type":"v1","addr":"172.21.15.96:6831","nonce":543223824}]},"public_addr":"172.21.15.96:6827/543223824","cluster_addr":"172.21.15.96:6829/543223824","heartbeat_back_addr":"172.21.15.96:6833/543223824","heartbeat_front_addr":"172.21.15.96:6831/543223824","state":["exists","up"]},{"osd":10,"uuid":"6c2b6757-60c2-4962-9409-6051dcb13273","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":2323107912},{"type":"v1","addr":"172.21.15.133:6825","nonce":2323107912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":2323107912},{"type":"v1","addr":"172.21.15.133:6827","nonce":2323107912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":2323107912},{"type":"v1","addr":"172.21.15.133:6831","nonce":2323107912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":2323107912},{"type":"v1","addr":"172.21.15.133:6829","nonce":2323107912}]},"public_addr":"172.21.15.133:6825/2323107912","cluster_addr":"172.21.15.133:6827/2323107912","heartbeat_back_addr":"172.21.15.133:6831/2323107912","heartbeat_front_addr":"172.21.15.133:6829/2323107912","state":["exists","up"]},{"osd":11,"uuid":"03c0bb25-2921-446b-960e-6a7a328d36a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":3853499290},{"type":"v1","addr":"172.21.15.186:6825","nonce":3853499290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":3853499290},{"type":"v1","addr":"172.21.15.186:6827","nonce":3853499290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":3853499290},{"type":"v1","addr":"172.21.15.186:6831","nonce":3853499290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":3853499290},{"type":"v1","addr":"172.21.15.186:6829","nonce":3853499290}]},"public_addr":"172.21.15.186:6825/3853499290","cluster_addr":"172.21.15.186:6827/3853499290","heartbeat_back_addr":"172.21.15.186:6831/3853499290","heartbeat_front_addr":"172.21.15.186:6829/3853499290","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:36:02.087281+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:36:24.328783+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:36:46.135576+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:37:08.524145+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:37:30.883871+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:37:53.344554+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:38:15.448162+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:38:37.414878+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:38:59.533953+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:39:21.392102+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:39:43.462696+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:40:05.561808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.96:0/1333468881":"2023-05-09T03:34:37.472043+0000","172.21.15.96:6800/1979917756":"2023-05-09T03:34:37.472043+0000","172.21.15.96:0/1332045367":"2023-05-09T03:34:37.472043+0000","172.21.15.96:0/520278090":"2023-05-09T03:34:14.800324+0000","172.21.15.96:0/1055409415":"2023-05-09T03:34:37.472043+0000","172.21.15.96:6801/1979917756":"2023-05-09T03:34:37.472043+0000","172.21.15.96:0/1541933328":"2023-05-09T03:34:14.800324+0000","172.21.15.96:6800/3944122753":"2023-05-09T03:34:14.800324+0000","172.21.15.96:0/2986058319":"2023-05-09T03:34:14.800324+0000","172.21.15.96:6801/3944122753":"2023-05-09T03:34:14.800324+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-08T03:41:39.750 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.748+0000 7fd6c4e11700 1 -- 172.21.15.96:0/775584520 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fd6a80a11e0 msgr2=0x7fd6a80a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:39.750 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.748+0000 7fd6c4e11700 1 --2- 172.21.15.96:0/775584520 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fd6a80a11e0 0x7fd6a80a3690 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd6b4009c60 tx=0x7fd6b4009260 comp rx=0 tx=0).stop 2023-05-08T03:41:39.750 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.748+0000 7fd6c4e11700 1 -- 172.21.15.96:0/775584520 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6c0100e20 msgr2=0x7fd6c0196250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:39.751 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.748+0000 7fd6c4e11700 1 --2- 172.21.15.96:0/775584520 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6c0100e20 0x7fd6c0196250 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fd6b000e9c0 tx=0x7fd6b000ecd0 comp rx=0 tx=0).stop 2023-05-08T03:41:39.751 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.748+0000 7fd6c4e11700 1 -- 172.21.15.96:0/775584520 shutdown_connections 2023-05-08T03:41:39.751 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.748+0000 7fd6c4e11700 1 --2- 172.21.15.96:0/775584520 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fd6a80a11e0 0x7fd6a80a3690 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:39.751 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.748+0000 7fd6c4e11700 1 --2- 172.21.15.96:0/775584520 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd6c0106060 0x7fd6c019d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:39.752 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.748+0000 7fd6c4e11700 1 --2- 172.21.15.96:0/775584520 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6c0100e20 0x7fd6c0196250 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:39.752 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.748+0000 7fd6c4e11700 1 --2- 172.21.15.96:0/775584520 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6c0103740 0x7fd6c0196790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:39.752 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.748+0000 7fd6c4e11700 1 -- 172.21.15.96:0/775584520 >> 172.21.15.96:0/775584520 conn(0x7fd6c00fa820 msgr2=0x7fd6c0101a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:39.752 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.748+0000 7fd6c4e11700 1 -- 172.21.15.96:0/775584520 shutdown_connections 2023-05-08T03:41:39.752 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.748+0000 7fd6c4e11700 1 -- 172.21.15.96:0/775584520 wait complete. 2023-05-08T03:41:39.763 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-08T03:36:47.800739+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-08T03:40:47.229693+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-05-08T03:40:48.359294+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-08T03:41:39.764 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-08T03:41:39.892 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.889+0000 7f8fef97a700 1 -- 172.21.15.96:0/363014882 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8fe81007f0 msgr2=0x7f8fe8100c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:39.892 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.889+0000 7f8fef97a700 1 --2- 172.21.15.96:0/363014882 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8fe81007f0 0x7f8fe8100c00 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8fd8009990 tx=0x7f8fd8009ca0 comp rx=0 tx=0).stop 2023-05-08T03:41:39.892 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.889+0000 7f8fef97a700 1 -- 172.21.15.96:0/363014882 shutdown_connections 2023-05-08T03:41:39.892 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.889+0000 7f8fef97a700 1 --2- 172.21.15.96:0/363014882 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8fe80ffe20 0x7f8fe81076f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:39.892 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.889+0000 7f8fef97a700 1 --2- 172.21.15.96:0/363014882 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8fe81007f0 0x7f8fe8100c00 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:39.893 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.889+0000 7f8fef97a700 1 --2- 172.21.15.96:0/363014882 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8fe80ff490 0x7f8fe80ff8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:39.893 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.889+0000 7f8fef97a700 1 -- 172.21.15.96:0/363014882 >> 172.21.15.96:0/363014882 conn(0x7f8fe80f9fd0 msgr2=0x7f8fe80fc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:39.893 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.889+0000 7f8fef97a700 1 -- 172.21.15.96:0/363014882 shutdown_connections 2023-05-08T03:41:39.893 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.889+0000 7f8fef97a700 1 -- 172.21.15.96:0/363014882 wait complete. 2023-05-08T03:41:39.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.890+0000 7f8fef97a700 1 Processor -- start 2023-05-08T03:41:39.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.890+0000 7f8fef97a700 1 -- start start 2023-05-08T03:41:39.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.890+0000 7f8fef97a700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8fe80ff490 0x7f8fe8194fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:39.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.890+0000 7f8fef97a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8fe80ffe20 0x7f8fe81954f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:39.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.890+0000 7f8fef97a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8fe81007f0 0x7f8fe819c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:39.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.890+0000 7f8fef97a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe819cb30 con 0x7f8fe80ffe20 2023-05-08T03:41:39.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.890+0000 7f8fef97a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe819cc70 con 0x7f8fe81007f0 2023-05-08T03:41:39.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.890+0000 7f8fef97a700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe819ce00 con 0x7f8fe80ff490 2023-05-08T03:41:39.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.890+0000 7f8fecf15700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8fe80ffe20 0x7f8fe81954f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:39.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.890+0000 7f8fecf15700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8fe80ffe20 0x7f8fe81954f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41086/0 (socket says 172.21.15.96:41086) 2023-05-08T03:41:39.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.890+0000 7f8fecf15700 1 -- 172.21.15.96:0/2356166147 learned_addr learned my addr 172.21.15.96:0/2356166147 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:41:39.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.890+0000 7f8fed716700 1 --2- 172.21.15.96:0/2356166147 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8fe80ff490 0x7f8fe8194fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:39.897 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.890+0000 7f8fedf17700 1 --2- 172.21.15.96:0/2356166147 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8fe81007f0 0x7f8fe819c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:39.897 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.890+0000 7f8fecf15700 1 -- 172.21.15.96:0/2356166147 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8fe80ff490 msgr2=0x7f8fe8194fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:39.897 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.890+0000 7f8fecf15700 1 --2- 172.21.15.96:0/2356166147 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8fe80ff490 0x7f8fe8194fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:39.897 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.890+0000 7f8fecf15700 1 -- 172.21.15.96:0/2356166147 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8fe81007f0 msgr2=0x7f8fe819c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:39.897 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.890+0000 7f8fecf15700 1 --2- 172.21.15.96:0/2356166147 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8fe81007f0 0x7f8fe819c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:39.897 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.890+0000 7f8fecf15700 1 -- 172.21.15.96:0/2356166147 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fd80095f0 con 0x7f8fe80ffe20 2023-05-08T03:41:39.897 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.890+0000 7f8fed716700 1 --2- 172.21.15.96:0/2356166147 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8fe80ff490 0x7f8fe8194fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-08T03:41:39.897 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.890+0000 7f8fedf17700 1 --2- 172.21.15.96:0/2356166147 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8fe81007f0 0x7f8fe819c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-08T03:41:39.898 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.890+0000 7f8fecf15700 1 --2- 172.21.15.96:0/2356166147 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8fe80ffe20 0x7f8fe81954f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f8fe400d950 tx=0x7f8fe400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:39.898 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.890+0000 7f8fde7fc700 1 -- 172.21.15.96:0/2356166147 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe4009b40 con 0x7f8fe80ffe20 2023-05-08T03:41:39.898 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.891+0000 7f8fde7fc700 1 -- 172.21.15.96:0/2356166147 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8fe4009ca0 con 0x7f8fe80ffe20 2023-05-08T03:41:39.898 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.891+0000 7f8fef97a700 1 -- 172.21.15.96:0/2356166147 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fe810ab80 con 0x7f8fe80ffe20 2023-05-08T03:41:39.898 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.891+0000 7f8fde7fc700 1 -- 172.21.15.96:0/2356166147 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe400f620 con 0x7f8fe80ffe20 2023-05-08T03:41:39.898 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.891+0000 7f8fef97a700 1 -- 172.21.15.96:0/2356166147 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fe810a9f0 con 0x7f8fe80ffe20 2023-05-08T03:41:39.898 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.892+0000 7f8fef97a700 1 -- 172.21.15.96:0/2356166147 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fe8106230 con 0x7f8fe80ffe20 2023-05-08T03:41:39.899 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.892+0000 7f8fde7fc700 1 -- 172.21.15.96:0/2356166147 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f8fe4010460 con 0x7f8fe80ffe20 2023-05-08T03:41:39.899 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.893+0000 7f8fde7fc700 1 --2- 172.21.15.96:0/2356166147 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f8fd40a11e0 0x7f8fd40a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:39.899 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.893+0000 7f8fed716700 1 --2- 172.21.15.96:0/2356166147 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f8fd40a11e0 0x7f8fd40a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:39.900 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.893+0000 7f8fde7fc700 1 -- 172.21.15.96:0/2356166147 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f8fe40ccd20 con 0x7f8fe80ffe20 2023-05-08T03:41:39.900 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.893+0000 7f8fed716700 1 --2- 172.21.15.96:0/2356166147 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f8fd40a11e0 0x7f8fd40a3690 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8fd8006010 tx=0x7f8fd800b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:39.900 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:39.898+0000 7f8fde7fc700 1 -- 172.21.15.96:0/2356166147 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f8fe4096410 con 0x7f8fe80ffe20 2023-05-08T03:41:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:39 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/1614014785' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-05-08T03:41:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:39 smithi133 ceph-mon[125939]: osdmap e84: 12 total, 12 up, 12 in 2023-05-08T03:41:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:39 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/1614014785' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-05-08T03:41:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:39 smithi096 ceph-mon[124666]: osdmap e84: 12 total, 12 up, 12 in 2023-05-08T03:41:40.090 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.088+0000 7f8fef97a700 1 -- 172.21.15.96:0/2356166147 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8fe8061800 con 0x7f8fe80ffe20 2023-05-08T03:41:40.091 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.088+0000 7f8fde7fc700 1 -- 172.21.15.96:0/2356166147 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8fe40200a0 con 0x7f8fe80ffe20 2023-05-08T03:41:40.091 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2023-05-08T03:41:40.093 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.090+0000 7f8fef97a700 1 -- 172.21.15.96:0/2356166147 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f8fd40a11e0 msgr2=0x7f8fd40a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:40.093 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.090+0000 7f8fef97a700 1 --2- 172.21.15.96:0/2356166147 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f8fd40a11e0 0x7f8fd40a3690 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8fd8006010 tx=0x7f8fd800b540 comp rx=0 tx=0).stop 2023-05-08T03:41:40.093 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.090+0000 7f8fef97a700 1 -- 172.21.15.96:0/2356166147 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8fe80ffe20 msgr2=0x7f8fe81954f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:40.093 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.090+0000 7f8fef97a700 1 --2- 172.21.15.96:0/2356166147 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8fe80ffe20 0x7f8fe81954f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f8fe400d950 tx=0x7f8fe400dd10 comp rx=0 tx=0).stop 2023-05-08T03:41:40.094 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.090+0000 7f8fef97a700 1 -- 172.21.15.96:0/2356166147 shutdown_connections 2023-05-08T03:41:40.094 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.090+0000 7f8fef97a700 1 --2- 172.21.15.96:0/2356166147 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f8fd40a11e0 0x7f8fd40a3690 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:40.094 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.090+0000 7f8fef97a700 1 --2- 172.21.15.96:0/2356166147 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8fe81007f0 0x7f8fe819c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:40.094 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.090+0000 7f8fef97a700 1 --2- 172.21.15.96:0/2356166147 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8fe80ff490 0x7f8fe8194fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:40.094 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.090+0000 7f8fef97a700 1 --2- 172.21.15.96:0/2356166147 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8fe80ffe20 0x7f8fe81954f0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:40.094 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.090+0000 7f8fef97a700 1 -- 172.21.15.96:0/2356166147 >> 172.21.15.96:0/2356166147 conn(0x7f8fe80f9fd0 msgr2=0x7f8fe80fc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:40.094 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.090+0000 7f8fef97a700 1 -- 172.21.15.96:0/2356166147 shutdown_connections 2023-05-08T03:41:40.095 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.090+0000 7f8fef97a700 1 -- 172.21.15.96:0/2356166147 wait complete. 2023-05-08T03:41:40.105 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-08T03:41:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:39 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/1614014785' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-05-08T03:41:40.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:39 smithi186 ceph-mon[126480]: osdmap e84: 12 total, 12 up, 12 in 2023-05-08T03:41:40.231 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.228+0000 7ff9de247700 1 -- 172.21.15.96:0/2141251189 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9d8100410 msgr2=0x7ff9d8100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:40.231 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.228+0000 7ff9de247700 1 --2- 172.21.15.96:0/2141251189 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9d8100410 0x7ff9d8100860 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8009990 tx=0x7ff9c8009ca0 comp rx=0 tx=0).stop 2023-05-08T03:41:40.231 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.228+0000 7ff9de247700 1 -- 172.21.15.96:0/2141251189 shutdown_connections 2023-05-08T03:41:40.231 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.228+0000 7ff9de247700 1 --2- 172.21.15.96:0/2141251189 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9d8100da0 0x7ff9d8107660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:40.232 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.228+0000 7ff9de247700 1 --2- 172.21.15.96:0/2141251189 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff9d80ff220 0x7ff9d80ff630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:40.232 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.228+0000 7ff9de247700 1 --2- 172.21.15.96:0/2141251189 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9d8100410 0x7ff9d8100860 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:40.232 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.228+0000 7ff9de247700 1 -- 172.21.15.96:0/2141251189 >> 172.21.15.96:0/2141251189 conn(0x7ff9d80fa840 msgr2=0x7ff9d80fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:40.232 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.228+0000 7ff9de247700 1 -- 172.21.15.96:0/2141251189 shutdown_connections 2023-05-08T03:41:40.232 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.228+0000 7ff9de247700 1 -- 172.21.15.96:0/2141251189 wait complete. 2023-05-08T03:41:40.233 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.229+0000 7ff9de247700 1 Processor -- start 2023-05-08T03:41:40.235 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.229+0000 7ff9de247700 1 -- start start 2023-05-08T03:41:40.235 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.229+0000 7ff9de247700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9d80ff220 0x7ff9d8196020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:40.235 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.229+0000 7ff9de247700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9d8100410 0x7ff9d8196560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:40.235 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.229+0000 7ff9de247700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff9d8100da0 0x7ff9d819d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:40.235 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.229+0000 7ff9de247700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d819dba0 con 0x7ff9d80ff220 2023-05-08T03:41:40.235 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.229+0000 7ff9de247700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d819dce0 con 0x7ff9d8100410 2023-05-08T03:41:40.236 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.229+0000 7ff9de247700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d819de70 con 0x7ff9d8100da0 2023-05-08T03:41:40.236 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.229+0000 7ff9d77fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9d80ff220 0x7ff9d8196020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:40.236 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.229+0000 7ff9d77fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9d80ff220 0x7ff9d8196020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41098/0 (socket says 172.21.15.96:41098) 2023-05-08T03:41:40.236 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.229+0000 7ff9d77fe700 1 -- 172.21.15.96:0/640008159 learned_addr learned my addr 172.21.15.96:0/640008159 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:41:40.236 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.229+0000 7ff9d6ffd700 1 --2- 172.21.15.96:0/640008159 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9d8100410 0x7ff9d8196560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:40.236 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.229+0000 7ff9d7fff700 1 --2- 172.21.15.96:0/640008159 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff9d8100da0 0x7ff9d819d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:40.236 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.229+0000 7ff9d77fe700 1 -- 172.21.15.96:0/640008159 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff9d8100da0 msgr2=0x7ff9d819d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:40.237 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.229+0000 7ff9d77fe700 1 --2- 172.21.15.96:0/640008159 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff9d8100da0 0x7ff9d819d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:40.237 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.229+0000 7ff9d77fe700 1 -- 172.21.15.96:0/640008159 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9d8100410 msgr2=0x7ff9d8196560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:40.237 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.229+0000 7ff9d77fe700 1 --2- 172.21.15.96:0/640008159 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9d8100410 0x7ff9d8196560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:40.237 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.229+0000 7ff9d77fe700 1 -- 172.21.15.96:0/640008159 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9c80095f0 con 0x7ff9d80ff220 2023-05-08T03:41:40.237 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.229+0000 7ff9d6ffd700 1 --2- 172.21.15.96:0/640008159 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9d8100410 0x7ff9d8196560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-08T03:41:40.237 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.230+0000 7ff9d77fe700 1 --2- 172.21.15.96:0/640008159 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9d80ff220 0x7ff9d8196020 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff9c000c990 tx=0x7ff9c000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:40.237 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.230+0000 7ff9d4ff9700 1 -- 172.21.15.96:0/640008159 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c0007b00 con 0x7ff9d80ff220 2023-05-08T03:41:40.237 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.230+0000 7ff9de247700 1 -- 172.21.15.96:0/640008159 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9d810bc80 con 0x7ff9d80ff220 2023-05-08T03:41:40.238 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.230+0000 7ff9d4ff9700 1 -- 172.21.15.96:0/640008159 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff9c0007c60 con 0x7ff9d80ff220 2023-05-08T03:41:40.238 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.230+0000 7ff9d4ff9700 1 -- 172.21.15.96:0/640008159 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c0018660 con 0x7ff9d80ff220 2023-05-08T03:41:40.238 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.230+0000 7ff9de247700 1 -- 172.21.15.96:0/640008159 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9d810baf0 con 0x7ff9d80ff220 2023-05-08T03:41:40.238 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.231+0000 7ff9de247700 1 -- 172.21.15.96:0/640008159 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9d819e5c0 con 0x7ff9d80ff220 2023-05-08T03:41:40.238 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.232+0000 7ff9d4ff9700 1 -- 172.21.15.96:0/640008159 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7ff9c000f450 con 0x7ff9d80ff220 2023-05-08T03:41:40.238 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.232+0000 7ff9d4ff9700 1 --2- 172.21.15.96:0/640008159 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7ff9c40a11e0 0x7ff9c40a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:40.238 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.233+0000 7ff9d4ff9700 1 -- 172.21.15.96:0/640008159 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7ff9c00ccb10 con 0x7ff9d80ff220 2023-05-08T03:41:40.239 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.233+0000 7ff9d6ffd700 1 --2- 172.21.15.96:0/640008159 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7ff9c40a11e0 0x7ff9c40a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:40.239 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.233+0000 7ff9d6ffd700 1 --2- 172.21.15.96:0/640008159 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7ff9c40a11e0 0x7ff9c40a3690 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8006010 tx=0x7ff9c800b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:40.239 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.236+0000 7ff9d4ff9700 1 -- 172.21.15.96:0/640008159 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7ff9c0096290 con 0x7ff9d80ff220 2023-05-08T03:41:40.430 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.427+0000 7ff9de247700 1 -- 172.21.15.96:0/640008159 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff9d81060a0 con 0x7ff9d80ff220 2023-05-08T03:41:40.430 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.427+0000 7ff9d4ff9700 1 -- 172.21.15.96:0/640008159 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v84) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff9c00998b0 con 0x7ff9d80ff220 2023-05-08T03:41:40.430 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2023-05-08T03:41:40.432 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.429+0000 7ff9de247700 1 -- 172.21.15.96:0/640008159 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7ff9c40a11e0 msgr2=0x7ff9c40a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:40.432 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.429+0000 7ff9de247700 1 --2- 172.21.15.96:0/640008159 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7ff9c40a11e0 0x7ff9c40a3690 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8006010 tx=0x7ff9c800b540 comp rx=0 tx=0).stop 2023-05-08T03:41:40.432 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.429+0000 7ff9de247700 1 -- 172.21.15.96:0/640008159 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9d80ff220 msgr2=0x7ff9d8196020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:40.432 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.429+0000 7ff9de247700 1 --2- 172.21.15.96:0/640008159 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9d80ff220 0x7ff9d8196020 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff9c000c990 tx=0x7ff9c000cd50 comp rx=0 tx=0).stop 2023-05-08T03:41:40.433 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.429+0000 7ff9de247700 1 -- 172.21.15.96:0/640008159 shutdown_connections 2023-05-08T03:41:40.433 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.429+0000 7ff9de247700 1 --2- 172.21.15.96:0/640008159 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7ff9c40a11e0 0x7ff9c40a3690 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:40.433 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.429+0000 7ff9de247700 1 --2- 172.21.15.96:0/640008159 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff9d8100da0 0x7ff9d819d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:40.433 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.429+0000 7ff9de247700 1 --2- 172.21.15.96:0/640008159 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9d80ff220 0x7ff9d8196020 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:40.433 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.429+0000 7ff9de247700 1 --2- 172.21.15.96:0/640008159 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9d8100410 0x7ff9d8196560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:40.433 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.429+0000 7ff9de247700 1 -- 172.21.15.96:0/640008159 >> 172.21.15.96:0/640008159 conn(0x7ff9d80fa840 msgr2=0x7ff9d80fca60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:40.433 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.430+0000 7ff9de247700 1 -- 172.21.15.96:0/640008159 shutdown_connections 2023-05-08T03:41:40.434 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.430+0000 7ff9de247700 1 -- 172.21.15.96:0/640008159 wait complete. 2023-05-08T03:41:40.444 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-08T03:41:40.568 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.565+0000 7f8236107700 1 -- 172.21.15.96:0/41977037 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8230100e40 msgr2=0x7f8230103220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:40.568 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.565+0000 7f8236107700 1 --2- 172.21.15.96:0/41977037 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8230100e40 0x7f8230103220 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8220009990 tx=0x7f8220009ca0 comp rx=0 tx=0).stop 2023-05-08T03:41:40.569 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.565+0000 7f8236107700 1 -- 172.21.15.96:0/41977037 shutdown_connections 2023-05-08T03:41:40.569 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.565+0000 7f8236107700 1 --2- 172.21.15.96:0/41977037 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8230106080 0x7f8230108460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:40.569 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.565+0000 7f8236107700 1 --2- 172.21.15.96:0/41977037 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8230100e40 0x7f8230103220 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:40.569 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.565+0000 7f8236107700 1 --2- 172.21.15.96:0/41977037 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8230103760 0x7f8230105b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:40.569 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.565+0000 7f8236107700 1 -- 172.21.15.96:0/41977037 >> 172.21.15.96:0/41977037 conn(0x7f82300fa840 msgr2=0x7f82300fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:40.569 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.565+0000 7f8236107700 1 -- 172.21.15.96:0/41977037 shutdown_connections 2023-05-08T03:41:40.569 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.565+0000 7f8236107700 1 -- 172.21.15.96:0/41977037 wait complete. 2023-05-08T03:41:40.570 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.566+0000 7f8236107700 1 Processor -- start 2023-05-08T03:41:40.571 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.566+0000 7f8236107700 1 -- start start 2023-05-08T03:41:40.572 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.566+0000 7f8236107700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8230100e40 0x7f8230196120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:40.572 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.566+0000 7f8236107700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8230103760 0x7f8230196660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:40.572 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.566+0000 7f8236107700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8230106080 0x7f823019d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:40.572 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.566+0000 7f8236107700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f823019dca0 con 0x7f8230103760 2023-05-08T03:41:40.573 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.566+0000 7f8236107700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f823019dde0 con 0x7f8230106080 2023-05-08T03:41:40.573 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.566+0000 7f8236107700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f823019df70 con 0x7f8230100e40 2023-05-08T03:41:40.573 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.566+0000 7f822effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8230103760 0x7f8230196660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:40.573 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.566+0000 7f822effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8230103760 0x7f8230196660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41114/0 (socket says 172.21.15.96:41114) 2023-05-08T03:41:40.573 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.566+0000 7f822effd700 1 -- 172.21.15.96:0/23889922 learned_addr learned my addr 172.21.15.96:0/23889922 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:41:40.573 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.566+0000 7f822ffff700 1 --2- 172.21.15.96:0/23889922 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8230106080 0x7f823019d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:40.574 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.566+0000 7f822f7fe700 1 --2- 172.21.15.96:0/23889922 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8230100e40 0x7f8230196120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:40.574 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.567+0000 7f822effd700 1 -- 172.21.15.96:0/23889922 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8230100e40 msgr2=0x7f8230196120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:40.574 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.567+0000 7f822effd700 1 --2- 172.21.15.96:0/23889922 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8230100e40 0x7f8230196120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:40.574 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.567+0000 7f822effd700 1 -- 172.21.15.96:0/23889922 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8230106080 msgr2=0x7f823019d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:40.574 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.567+0000 7f822effd700 1 --2- 172.21.15.96:0/23889922 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8230106080 0x7f823019d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:40.574 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.567+0000 7f822effd700 1 -- 172.21.15.96:0/23889922 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82200095f0 con 0x7f8230103760 2023-05-08T03:41:40.574 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.567+0000 7f822ffff700 1 --2- 172.21.15.96:0/23889922 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8230106080 0x7f823019d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-08T03:41:40.574 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.567+0000 7f822effd700 1 --2- 172.21.15.96:0/23889922 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8230103760 0x7f8230196660 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f822400c920 tx=0x7f822400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:40.575 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.567+0000 7f822cff9700 1 -- 172.21.15.96:0/23889922 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8224007b00 con 0x7f8230103760 2023-05-08T03:41:40.575 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.567+0000 7f822cff9700 1 -- 172.21.15.96:0/23889922 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8224004cf0 con 0x7f8230103760 2023-05-08T03:41:40.575 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.567+0000 7f8236107700 1 -- 172.21.15.96:0/23889922 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f823010bce0 con 0x7f8230103760 2023-05-08T03:41:40.575 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.567+0000 7f822cff9700 1 -- 172.21.15.96:0/23889922 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8224005610 con 0x7f8230103760 2023-05-08T03:41:40.575 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.567+0000 7f8236107700 1 -- 172.21.15.96:0/23889922 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f823010bb50 con 0x7f8230103760 2023-05-08T03:41:40.575 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.568+0000 7f8236107700 1 -- 172.21.15.96:0/23889922 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f823019e6c0 con 0x7f8230103760 2023-05-08T03:41:40.576 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.569+0000 7f822cff9700 1 -- 172.21.15.96:0/23889922 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f8224004750 con 0x7f8230103760 2023-05-08T03:41:40.576 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.570+0000 7f822cff9700 1 --2- 172.21.15.96:0/23889922 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f82180a11e0 0x7f82180a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:40.576 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.570+0000 7f822f7fe700 1 --2- 172.21.15.96:0/23889922 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f82180a11e0 0x7f82180a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:40.577 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.570+0000 7f822cff9700 1 -- 172.21.15.96:0/23889922 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f82240ccab0 con 0x7f8230103760 2023-05-08T03:41:40.577 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.570+0000 7f822f7fe700 1 --2- 172.21.15.96:0/23889922 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f82180a11e0 0x7f82180a3690 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8220006010 tx=0x7f822000b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:40.577 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.574+0000 7f822cff9700 1 -- 172.21.15.96:0/23889922 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f82240960a0 con 0x7f8230103760 2023-05-08T03:41:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:40 smithi096 ceph-mon[124666]: pgmap v285: 97 pgs: 5 peering, 92 active+clean; 636 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:41:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:40 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/775584520' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-05-08T03:41:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:40 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/2356166147' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-05-08T03:41:40.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:40 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/640008159' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-05-08T03:41:40.769 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.767+0000 7f8236107700 1 -- 172.21.15.96:0/23889922 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f823019ec70 con 0x7f8230103760 2023-05-08T03:41:40.770 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.767+0000 7f822cff9700 1 -- 172.21.15.96:0/23889922 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v84) v1 ==== 100+0+11 (secure 0 0 0) 0x7f822401d020 con 0x7f8230103760 2023-05-08T03:41:40.770 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 64 2023-05-08T03:41:40.772 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.769+0000 7f8236107700 1 -- 172.21.15.96:0/23889922 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f82180a11e0 msgr2=0x7f82180a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:40.772 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.769+0000 7f8236107700 1 --2- 172.21.15.96:0/23889922 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f82180a11e0 0x7f82180a3690 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8220006010 tx=0x7f822000b540 comp rx=0 tx=0).stop 2023-05-08T03:41:40.772 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.769+0000 7f8236107700 1 -- 172.21.15.96:0/23889922 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8230103760 msgr2=0x7f8230196660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:40.772 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.769+0000 7f8236107700 1 --2- 172.21.15.96:0/23889922 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8230103760 0x7f8230196660 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f822400c920 tx=0x7f822400cce0 comp rx=0 tx=0).stop 2023-05-08T03:41:40.773 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.769+0000 7f8236107700 1 -- 172.21.15.96:0/23889922 shutdown_connections 2023-05-08T03:41:40.773 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.769+0000 7f8236107700 1 --2- 172.21.15.96:0/23889922 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f82180a11e0 0x7f82180a3690 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:40.773 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.769+0000 7f8236107700 1 --2- 172.21.15.96:0/23889922 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8230106080 0x7f823019d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:40.773 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.769+0000 7f8236107700 1 --2- 172.21.15.96:0/23889922 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8230100e40 0x7f8230196120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:40.773 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.769+0000 7f8236107700 1 --2- 172.21.15.96:0/23889922 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8230103760 0x7f8230196660 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:40.773 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.769+0000 7f8236107700 1 -- 172.21.15.96:0/23889922 >> 172.21.15.96:0/23889922 conn(0x7f82300fa840 msgr2=0x7f82301022f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:40.774 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.769+0000 7f8236107700 1 -- 172.21.15.96:0/23889922 shutdown_connections 2023-05-08T03:41:40.774 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.769+0000 7f8236107700 1 -- 172.21.15.96:0/23889922 wait complete. 2023-05-08T03:41:40.784 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-08T03:41:40.905 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.902+0000 7f4a6c7a8700 1 -- 172.21.15.96:0/1643033934 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a64101530 msgr2=0x7f4a64101980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:40.906 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.902+0000 7f4a6c7a8700 1 --2- 172.21.15.96:0/1643033934 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a64101530 0x7f4a64101980 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f4a54009990 tx=0x7f4a54009ca0 comp rx=0 tx=0).stop 2023-05-08T03:41:40.906 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.902+0000 7f4a6c7a8700 1 -- 172.21.15.96:0/1643033934 shutdown_connections 2023-05-08T03:41:40.906 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.902+0000 7f4a6c7a8700 1 --2- 172.21.15.96:0/1643033934 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a64101ec0 0x7f4a64108780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:40.906 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.902+0000 7f4a6c7a8700 1 --2- 172.21.15.96:0/1643033934 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4a64100340 0x7f4a64100750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:40.906 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.902+0000 7f4a6c7a8700 1 --2- 172.21.15.96:0/1643033934 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a64101530 0x7f4a64101980 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:40.906 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.902+0000 7f4a6c7a8700 1 -- 172.21.15.96:0/1643033934 >> 172.21.15.96:0/1643033934 conn(0x7f4a640fb920 msgr2=0x7f4a640fdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:40.906 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.902+0000 7f4a6c7a8700 1 -- 172.21.15.96:0/1643033934 shutdown_connections 2023-05-08T03:41:40.907 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.902+0000 7f4a6c7a8700 1 -- 172.21.15.96:0/1643033934 wait complete. 2023-05-08T03:41:40.907 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.903+0000 7f4a6c7a8700 1 Processor -- start 2023-05-08T03:41:40.907 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.903+0000 7f4a6c7a8700 1 -- start start 2023-05-08T03:41:40.909 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.903+0000 7f4a6c7a8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a64100340 0x7f4a64196140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:40.909 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.903+0000 7f4a6c7a8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a64101530 0x7f4a64196680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:40.909 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.903+0000 7f4a6c7a8700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4a64101ec0 0x7f4a6419d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:40.910 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.903+0000 7f4a6c7a8700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6419dcc0 con 0x7f4a64101530 2023-05-08T03:41:40.910 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.903+0000 7f4a6c7a8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6419de00 con 0x7f4a64100340 2023-05-08T03:41:40.910 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.903+0000 7f4a6c7a8700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6419df90 con 0x7f4a64101ec0 2023-05-08T03:41:40.910 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.903+0000 7f4a69d43700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a64101530 0x7f4a64196680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:40.910 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.903+0000 7f4a69d43700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a64101530 0x7f4a64196680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41128/0 (socket says 172.21.15.96:41128) 2023-05-08T03:41:40.910 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.903+0000 7f4a69d43700 1 -- 172.21.15.96:0/3791993157 learned_addr learned my addr 172.21.15.96:0/3791993157 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:41:40.910 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.903+0000 7f4a6a544700 1 --2- 172.21.15.96:0/3791993157 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a64100340 0x7f4a64196140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:40.910 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.903+0000 7f4a6ad45700 1 --2- 172.21.15.96:0/3791993157 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4a64101ec0 0x7f4a6419d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:40.911 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.903+0000 7f4a69d43700 1 -- 172.21.15.96:0/3791993157 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4a64101ec0 msgr2=0x7f4a6419d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:40.911 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.903+0000 7f4a69d43700 1 --2- 172.21.15.96:0/3791993157 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4a64101ec0 0x7f4a6419d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:40.911 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.904+0000 7f4a69d43700 1 -- 172.21.15.96:0/3791993157 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a64100340 msgr2=0x7f4a64196140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:40.911 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.904+0000 7f4a69d43700 1 --2- 172.21.15.96:0/3791993157 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a64100340 0x7f4a64196140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:40.911 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.904+0000 7f4a69d43700 1 -- 172.21.15.96:0/3791993157 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a540095f0 con 0x7f4a64101530 2023-05-08T03:41:40.911 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.904+0000 7f4a6ad45700 1 --2- 172.21.15.96:0/3791993157 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4a64101ec0 0x7f4a6419d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-08T03:41:40.911 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.904+0000 7f4a6a544700 1 --2- 172.21.15.96:0/3791993157 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a64100340 0x7f4a64196140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-08T03:41:40.912 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.904+0000 7f4a69d43700 1 --2- 172.21.15.96:0/3791993157 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a64101530 0x7f4a64196680 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f4a54004760 tx=0x7f4a54003940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:40.912 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.904+0000 7f4a5b7fe700 1 -- 172.21.15.96:0/3791993157 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a5401d070 con 0x7f4a64101530 2023-05-08T03:41:40.912 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.904+0000 7f4a5b7fe700 1 -- 172.21.15.96:0/3791993157 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4a54005030 con 0x7f4a64101530 2023-05-08T03:41:40.912 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.904+0000 7f4a6c7a8700 1 -- 172.21.15.96:0/3791993157 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a6410bd40 con 0x7f4a64101530 2023-05-08T03:41:40.912 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.904+0000 7f4a5b7fe700 1 -- 172.21.15.96:0/3791993157 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a54004ad0 con 0x7f4a64101530 2023-05-08T03:41:40.912 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.904+0000 7f4a6c7a8700 1 -- 172.21.15.96:0/3791993157 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a6410bbb0 con 0x7f4a64101530 2023-05-08T03:41:40.912 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.905+0000 7f4a6c7a8700 1 -- 172.21.15.96:0/3791993157 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a6419e640 con 0x7f4a64101530 2023-05-08T03:41:40.912 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.906+0000 7f4a5b7fe700 1 -- 172.21.15.96:0/3791993157 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f4a54004c50 con 0x7f4a64101530 2023-05-08T03:41:40.913 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.906+0000 7f4a5b7fe700 1 --2- 172.21.15.96:0/3791993157 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f4a500a11e0 0x7f4a500a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:40.913 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.906+0000 7f4a6a544700 1 --2- 172.21.15.96:0/3791993157 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f4a500a11e0 0x7f4a500a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:40.913 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.906+0000 7f4a5b7fe700 1 -- 172.21.15.96:0/3791993157 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f4a540cdc20 con 0x7f4a64101530 2023-05-08T03:41:40.913 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.907+0000 7f4a6a544700 1 --2- 172.21.15.96:0/3791993157 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f4a500a11e0 0x7f4a500a3690 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4a64101390 tx=0x7f4a60008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:40.913 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:40.911+0000 7f4a5b7fe700 1 -- 172.21.15.96:0/3791993157 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f4a540972a0 con 0x7f4a64101530 2023-05-08T03:41:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:40 smithi133 ceph-mon[125939]: pgmap v285: 97 pgs: 5 peering, 92 active+clean; 636 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:41:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:40 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/775584520' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-05-08T03:41:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:40 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/2356166147' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-05-08T03:41:40.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:40 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/640008159' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-05-08T03:41:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:40 smithi186 ceph-mon[126480]: pgmap v285: 97 pgs: 5 peering, 92 active+clean; 636 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:41:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:40 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/775584520' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-05-08T03:41:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:40 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/2356166147' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-05-08T03:41:41.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:40 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/640008159' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-05-08T03:41:41.141 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.139+0000 7f4a6c7a8700 1 -- 172.21.15.96:0/3791993157 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4a64107270 con 0x7f4a64101530 2023-05-08T03:41:41.142 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.140+0000 7f4a5b7fe700 1 -- 172.21.15.96:0/3791993157 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+10813 (secure 0 0 0) 0x7f4a5409a8c0 con 0x7f4a64101530 2023-05-08T03:41:41.142 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:41:41.143 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6835/1518512221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":1518512221},{"type":"v1","addr":"172.21.15.96:6835","nonce":1518512221}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6837/305967678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6836","nonce":305967678},{"type":"v1","addr":"172.21.15.96:6837","nonce":305967678}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14622,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6839/2596991665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6838","nonce":2596991665},{"type":"v1","addr":"172.21.15.96:6839","nonce":2596991665}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6841/1786091200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6840","nonce":1786091200},{"type":"v1","addr":"172.21.15.96:6841","nonce":1786091200}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/2351258784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":2351258784},{"type":"v1","addr":"172.21.15.133:6833","nonce":2351258784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/2274306880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":2274306880},{"type":"v1","addr":"172.21.15.186:6833","nonce":2274306880}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-05-08T03:40:49.210143+0000","modified":"2023-05-08T03:40:54.356833+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24494,"mds_1":24487,"mds_2":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24437":{"gid":24437,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6835/1735118966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1735118966},{"type":"v1","addr":"172.21.15.133:6835","nonce":1735118966}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6835/3984391904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":3984391904},{"type":"v1","addr":"172.21.15.186:6835","nonce":3984391904}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24461":{"gid":24461,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6837/2218851414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":2218851414},{"type":"v1","addr":"172.21.15.133:6837","nonce":2218851414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24472":{"gid":24472,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.186:6837/1556405826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":1556405826},{"type":"v1","addr":"172.21.15.186:6837","nonce":1556405826}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":5,"addr":"172.21.15.186:6839/1267655485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":1267655485},{"type":"v1","addr":"172.21.15.186:6839","nonce":1267655485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6839/2246041493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6838","nonce":2246041493},{"type":"v1","addr":"172.21.15.133:6839","nonce":2246041493}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-08T03:41:41.144 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.142+0000 7f4a6c7a8700 1 -- 172.21.15.96:0/3791993157 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f4a500a11e0 msgr2=0x7f4a500a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:41.144 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.142+0000 7f4a6c7a8700 1 --2- 172.21.15.96:0/3791993157 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f4a500a11e0 0x7f4a500a3690 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4a64101390 tx=0x7f4a60008040 comp rx=0 tx=0).stop 2023-05-08T03:41:41.144 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.142+0000 7f4a6c7a8700 1 -- 172.21.15.96:0/3791993157 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a64101530 msgr2=0x7f4a64196680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:41.145 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.142+0000 7f4a6c7a8700 1 --2- 172.21.15.96:0/3791993157 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a64101530 0x7f4a64196680 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f4a54004760 tx=0x7f4a54003940 comp rx=0 tx=0).stop 2023-05-08T03:41:41.145 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.142+0000 7f4a6c7a8700 1 -- 172.21.15.96:0/3791993157 shutdown_connections 2023-05-08T03:41:41.145 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.142+0000 7f4a6c7a8700 1 --2- 172.21.15.96:0/3791993157 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f4a500a11e0 0x7f4a500a3690 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:41.145 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.142+0000 7f4a6c7a8700 1 --2- 172.21.15.96:0/3791993157 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4a64101ec0 0x7f4a6419d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:41.145 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.142+0000 7f4a6c7a8700 1 --2- 172.21.15.96:0/3791993157 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a64100340 0x7f4a64196140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:41.145 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.142+0000 7f4a6c7a8700 1 --2- 172.21.15.96:0/3791993157 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a64101530 0x7f4a64196680 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:41.145 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.142+0000 7f4a6c7a8700 1 -- 172.21.15.96:0/3791993157 >> 172.21.15.96:0/3791993157 conn(0x7f4a640fb920 msgr2=0x7f4a640fdbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:41.146 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.142+0000 7f4a6c7a8700 1 -- 172.21.15.96:0/3791993157 shutdown_connections 2023-05-08T03:41:41.146 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.142+0000 7f4a6c7a8700 1 -- 172.21.15.96:0/3791993157 wait complete. 2023-05-08T03:41:41.146 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 22 2023-05-08T03:41:41.157 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-08T03:41:41.278 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.275+0000 7fc2b0b01700 1 -- 172.21.15.96:0/3422034322 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2ac100da0 msgr2=0x7fc2ac107660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:41.278 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.275+0000 7fc2b0b01700 1 --2- 172.21.15.96:0/3422034322 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2ac100da0 0x7fc2ac107660 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fc2a400b0a0 tx=0x7fc2a400b3b0 comp rx=0 tx=0).stop 2023-05-08T03:41:41.279 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.275+0000 7fc2b0b01700 1 -- 172.21.15.96:0/3422034322 shutdown_connections 2023-05-08T03:41:41.279 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.275+0000 7fc2b0b01700 1 --2- 172.21.15.96:0/3422034322 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2ac100da0 0x7fc2ac107660 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:41.279 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.275+0000 7fc2b0b01700 1 --2- 172.21.15.96:0/3422034322 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2ac0ff220 0x7fc2ac0ff630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:41.279 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.275+0000 7fc2b0b01700 1 --2- 172.21.15.96:0/3422034322 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc2ac100410 0x7fc2ac100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:41.279 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.275+0000 7fc2b0b01700 1 -- 172.21.15.96:0/3422034322 >> 172.21.15.96:0/3422034322 conn(0x7fc2ac0fa800 msgr2=0x7fc2ac0fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:41.279 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.275+0000 7fc2b0b01700 1 -- 172.21.15.96:0/3422034322 shutdown_connections 2023-05-08T03:41:41.280 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.275+0000 7fc2b0b01700 1 -- 172.21.15.96:0/3422034322 wait complete. 2023-05-08T03:41:41.280 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.276+0000 7fc2b0b01700 1 Processor -- start 2023-05-08T03:41:41.280 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.276+0000 7fc2b0b01700 1 -- start start 2023-05-08T03:41:41.282 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.276+0000 7fc2b0b01700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2ac0ff220 0x7fc2ac069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:41.283 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.276+0000 7fc2b0b01700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc2ac100410 0x7fc2ac19ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:41.283 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.276+0000 7fc2b0b01700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2ac100da0 0x7fc2ac19d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:41.283 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.276+0000 7fc2b0b01700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ac19dcc0 con 0x7fc2ac0ff220 2023-05-08T03:41:41.283 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.276+0000 7fc2b0b01700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ac19de30 con 0x7fc2ac100da0 2023-05-08T03:41:41.283 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.276+0000 7fc2b0b01700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ac19dff0 con 0x7fc2ac100410 2023-05-08T03:41:41.283 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.276+0000 7fc2aa59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2ac0ff220 0x7fc2ac069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:41.283 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.276+0000 7fc2aa59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2ac0ff220 0x7fc2ac069b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41140/0 (socket says 172.21.15.96:41140) 2023-05-08T03:41:41.284 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.276+0000 7fc2aa59c700 1 -- 172.21.15.96:0/842735957 learned_addr learned my addr 172.21.15.96:0/842735957 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:41:41.284 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.276+0000 7fc2a9d9b700 1 --2- 172.21.15.96:0/842735957 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc2ac100410 0x7fc2ac19ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:41.284 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.276+0000 7fc2aad9d700 1 --2- 172.21.15.96:0/842735957 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2ac100da0 0x7fc2ac19d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:41.284 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.277+0000 7fc2aa59c700 1 -- 172.21.15.96:0/842735957 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc2ac100410 msgr2=0x7fc2ac19ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:41.284 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.277+0000 7fc2aa59c700 1 --2- 172.21.15.96:0/842735957 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc2ac100410 0x7fc2ac19ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:41.284 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.277+0000 7fc2aa59c700 1 -- 172.21.15.96:0/842735957 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2ac100da0 msgr2=0x7fc2ac19d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:41.284 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.277+0000 7fc2aa59c700 1 --2- 172.21.15.96:0/842735957 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2ac100da0 0x7fc2ac19d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:41.285 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.277+0000 7fc2aa59c700 1 -- 172.21.15.96:0/842735957 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a4009d00 con 0x7fc2ac0ff220 2023-05-08T03:41:41.285 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.277+0000 7fc2aa59c700 1 --2- 172.21.15.96:0/842735957 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2ac0ff220 0x7fc2ac069b20 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc29400d980 tx=0x7fc29400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:41.285 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.277+0000 7fc2a37fe700 1 -- 172.21.15.96:0/842735957 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29400de60 con 0x7fc2ac0ff220 2023-05-08T03:41:41.285 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.277+0000 7fc2a37fe700 1 -- 172.21.15.96:0/842735957 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc2940044e0 con 0x7fc2ac0ff220 2023-05-08T03:41:41.285 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.277+0000 7fc2a37fe700 1 -- 172.21.15.96:0/842735957 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc294003be0 con 0x7fc2ac0ff220 2023-05-08T03:41:41.285 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.277+0000 7fc2b0b01700 1 -- 172.21.15.96:0/842735957 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2ac10abb0 con 0x7fc2ac0ff220 2023-05-08T03:41:41.285 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.277+0000 7fc2b0b01700 1 -- 172.21.15.96:0/842735957 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2ac10aa20 con 0x7fc2ac0ff220 2023-05-08T03:41:41.286 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.278+0000 7fc2b0b01700 1 -- 172.21.15.96:0/842735957 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2ac19e6f0 con 0x7fc2ac0ff220 2023-05-08T03:41:41.286 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.279+0000 7fc2a37fe700 1 -- 172.21.15.96:0/842735957 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fc294009bb0 con 0x7fc2ac0ff220 2023-05-08T03:41:41.286 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.279+0000 7fc2a37fe700 1 --2- 172.21.15.96:0/842735957 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fc2980a11e0 0x7fc2980a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:41.286 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.280+0000 7fc2a9d9b700 1 --2- 172.21.15.96:0/842735957 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fc2980a11e0 0x7fc2980a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:41.286 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.280+0000 7fc2a37fe700 1 -- 172.21.15.96:0/842735957 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7fc2940cc850 con 0x7fc2ac0ff220 2023-05-08T03:41:41.286 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.280+0000 7fc2a9d9b700 1 --2- 172.21.15.96:0/842735957 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fc2980a11e0 0x7fc2980a3690 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc29c005950 tx=0x7fc29c0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:41.287 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.284+0000 7fc2a37fe700 1 -- 172.21.15.96:0/842735957 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fc294095e40 con 0x7fc2ac0ff220 2023-05-08T03:41:41.476 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.473+0000 7fc2b0b01700 1 -- 172.21.15.96:0/842735957 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc2ac106080 con 0x7fc2ac0ff220 2023-05-08T03:41:41.477 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.475+0000 7fc2a37fe700 1 -- 172.21.15.96:0/842735957 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+22437 (secure 0 0 0) 0x7fc294009940 con 0x7fc2ac0ff220 2023-05-08T03:41:41.478 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:41:41.478 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":84,"fsid":"f7ffcfb0-ed50-11ed-9b01-001a4aab830c","created":"2023-05-08T03:33:42.765680+0000","modified":"2023-05-08T03:41:39.350582+0000","last_up_change":"2023-05-08T03:40:07.550882+0000","last_in_change":"2023-05-08T03:39:49.027947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-08T03:36:47.800739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-05-08T03:40:47.229693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-05-08T03:40:48.359294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2ee801e1-8eec-496d-a9ac-fc566b38bbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":1816903726},{"type":"v1","addr":"172.21.15.96:6803","nonce":1816903726}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":1816903726},{"type":"v1","addr":"172.21.15.96:6805","nonce":1816903726}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":1816903726},{"type":"v1","addr":"172.21.15.96:6809","nonce":1816903726}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":1816903726},{"type":"v1","addr":"172.21.15.96:6807","nonce":1816903726}]},"public_addr":"172.21.15.96:6803/1816903726","cluster_addr":"172.21.15.96:6805/1816903726","heartbeat_back_addr":"172.21.15.96:6809/1816903726","heartbeat_front_addr":"172.21.15.96:6807/1816903726","state":["exists","up"]},{"osd":1,"uuid":"eb73deea-fc7c-4f2f-8aef-2d71c598afda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":206989126},{"type":"v1","addr":"172.21.15.133:6801","nonce":206989126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":206989126},{"type":"v1","addr":"172.21.15.133:6803","nonce":206989126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":206989126},{"type":"v1","addr":"172.21.15.133:6807","nonce":206989126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":206989126},{"type":"v1","addr":"172.21.15.133:6805","nonce":206989126}]},"public_addr":"172.21.15.133:6801/206989126","cluster_addr":"172.21.15.133:6803/206989126","heartbeat_back_addr":"172.21.15.133:6807/206989126","heartbeat_front_addr":"172.21.15.133:6805/206989126","state":["exists","up"]},{"osd":2,"uuid":"74a2f239-e82d-4d87-9458-5373b6cbbffd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":1791188143},{"type":"v1","addr":"172.21.15.186:6801","nonce":1791188143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":1791188143},{"type":"v1","addr":"172.21.15.186:6803","nonce":1791188143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":1791188143},{"type":"v1","addr":"172.21.15.186:6807","nonce":1791188143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":1791188143},{"type":"v1","addr":"172.21.15.186:6805","nonce":1791188143}]},"public_addr":"172.21.15.186:6801/1791188143","cluster_addr":"172.21.15.186:6803/1791188143","heartbeat_back_addr":"172.21.15.186:6807/1791188143","heartbeat_front_addr":"172.21.15.186:6805/1791188143","state":["exists","up"]},{"osd":3,"uuid":"421eedf5-ba6e-484e-b715-78c1c10d684e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":3430402140},{"type":"v1","addr":"172.21.15.96:6811","nonce":3430402140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":3430402140},{"type":"v1","addr":"172.21.15.96:6813","nonce":3430402140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":3430402140},{"type":"v1","addr":"172.21.15.96:6817","nonce":3430402140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":3430402140},{"type":"v1","addr":"172.21.15.96:6815","nonce":3430402140}]},"public_addr":"172.21.15.96:6811/3430402140","cluster_addr":"172.21.15.96:6813/3430402140","heartbeat_back_addr":"172.21.15.96:6817/3430402140","heartbeat_front_addr":"172.21.15.96:6815/3430402140","state":["exists","up"]},{"osd":4,"uuid":"fb20100b-6a5a-462d-955d-1697a3861e96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":1237495996},{"type":"v1","addr":"172.21.15.133:6809","nonce":1237495996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":1237495996},{"type":"v1","addr":"172.21.15.133:6811","nonce":1237495996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":1237495996},{"type":"v1","addr":"172.21.15.133:6815","nonce":1237495996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":1237495996},{"type":"v1","addr":"172.21.15.133:6813","nonce":1237495996}]},"public_addr":"172.21.15.133:6809/1237495996","cluster_addr":"172.21.15.133:6811/1237495996","heartbeat_back_addr":"172.21.15.133:6815/1237495996","heartbeat_front_addr":"172.21.15.133:6813/1237495996","state":["exists","up"]},{"osd":5,"uuid":"00177913-8bd6-4391-83c3-08c2b1b8ef13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":541111862},{"type":"v1","addr":"172.21.15.186:6809","nonce":541111862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":541111862},{"type":"v1","addr":"172.21.15.186:6811","nonce":541111862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":541111862},{"type":"v1","addr":"172.21.15.186:6815","nonce":541111862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":541111862},{"type":"v1","addr":"172.21.15.186:6813","nonce":541111862}]},"public_addr":"172.21.15.186:6809/541111862","cluster_addr":"172.21.15.186:6811/541111862","heartbeat_back_addr":"172.21.15.186:6815/541111862","heartbeat_front_addr":"172.21.15.186:6813/541111862","state":["exists","up"]},{"osd":6,"uuid":"204baab6-ca6f-4eef-8b9c-91efc04cc30c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":386227948},{"type":"v1","addr":"172.21.15.96:6819","nonce":386227948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":386227948},{"type":"v1","addr":"172.21.15.96:6821","nonce":386227948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":386227948},{"type":"v1","addr":"172.21.15.96:6825","nonce":386227948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":386227948},{"type":"v1","addr":"172.21.15.96:6823","nonce":386227948}]},"public_addr":"172.21.15.96:6819/386227948","cluster_addr":"172.21.15.96:6821/386227948","heartbeat_back_addr":"172.21.15.96:6825/386227948","heartbeat_front_addr":"172.21.15.96:6823/386227948","state":["exists","up"]},{"osd":7,"uuid":"282db569-a76e-485b-a33d-f2579b956525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":218507954},{"type":"v1","addr":"172.21.15.133:6817","nonce":218507954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":218507954},{"type":"v1","addr":"172.21.15.133:6819","nonce":218507954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":218507954},{"type":"v1","addr":"172.21.15.133:6823","nonce":218507954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":218507954},{"type":"v1","addr":"172.21.15.133:6821","nonce":218507954}]},"public_addr":"172.21.15.133:6817/218507954","cluster_addr":"172.21.15.133:6819/218507954","heartbeat_back_addr":"172.21.15.133:6823/218507954","heartbeat_front_addr":"172.21.15.133:6821/218507954","state":["exists","up"]},{"osd":8,"uuid":"693e25b5-355d-4990-9467-0fac4c9133fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":1648475902},{"type":"v1","addr":"172.21.15.186:6817","nonce":1648475902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":1648475902},{"type":"v1","addr":"172.21.15.186:6819","nonce":1648475902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":1648475902},{"type":"v1","addr":"172.21.15.186:6823","nonce":1648475902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":1648475902},{"type":"v1","addr":"172.21.15.186:6821","nonce":1648475902}]},"public_addr":"172.21.15.186:6817/1648475902","cluster_addr":"172.21.15.186:6819/1648475902","heartbeat_back_addr":"172.21.15.186:6823/1648475902","heartbeat_front_addr":"172.21.15.186:6821/1648475902","state":["exists","up"]},{"osd":9,"uuid":"72fbff09-fe28-4014-86fc-c31f95cd19a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":543223824},{"type":"v1","addr":"172.21.15.96:6827","nonce":543223824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":543223824},{"type":"v1","addr":"172.21.15.96:6829","nonce":543223824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6832","nonce":543223824},{"type":"v1","addr":"172.21.15.96:6833","nonce":543223824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":543223824},{"type":"v1","addr":"172.21.15.96:6831","nonce":543223824}]},"public_addr":"172.21.15.96:6827/543223824","cluster_addr":"172.21.15.96:6829/543223824","heartbeat_back_addr":"172.21.15.96:6833/543223824","heartbeat_front_addr":"172.21.15.96:6831/543223824","state":["exists","up"]},{"osd":10,"uuid":"6c2b6757-60c2-4962-9409-6051dcb13273","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":2323107912},{"type":"v1","addr":"172.21.15.133:6825","nonce":2323107912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":2323107912},{"type":"v1","addr":"172.21.15.133:6827","nonce":2323107912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":2323107912},{"type":"v1","addr":"172.21.15.133:6831","nonce":2323107912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":2323107912},{"type":"v1","addr":"172.21.15.133:6829","nonce":2323107912}]},"public_addr":"172.21.15.133:6825/2323107912","cluster_addr":"172.21.15.133:6827/2323107912","heartbeat_back_addr":"172.21.15.133:6831/2323107912","heartbeat_front_addr":"172.21.15.133:6829/2323107912","state":["exists","up"]},{"osd":11,"uuid":"03c0bb25-2921-446b-960e-6a7a328d36a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":3853499290},{"type":"v1","addr":"172.21.15.186:6825","nonce":3853499290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":3853499290},{"type":"v1","addr":"172.21.15.186:6827","nonce":3853499290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":3853499290},{"type":"v1","addr":"172.21.15.186:6831","nonce":3853499290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":3853499290},{"type":"v1","addr":"172.21.15.186:6829","nonce":3853499290}]},"public_addr":"172.21.15.186:6825/3853499290","cluster_addr":"172.21.15.186:6827/3853499290","heartbeat_back_addr":"172.21.15.186:6831/3853499290","heartbeat_front_addr":"172.21.15.186:6829/3853499290","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:36:02.087281+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:36:24.328783+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:36:46.135576+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:37:08.524145+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:37:30.883871+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:37:53.344554+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:38:15.448162+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:38:37.414878+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:38:59.533953+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:39:21.392102+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:39:43.462696+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:40:05.561808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.96:0/1333468881":"2023-05-09T03:34:37.472043+0000","172.21.15.96:6800/1979917756":"2023-05-09T03:34:37.472043+0000","172.21.15.96:0/1332045367":"2023-05-09T03:34:37.472043+0000","172.21.15.96:0/520278090":"2023-05-09T03:34:14.800324+0000","172.21.15.96:0/1055409415":"2023-05-09T03:34:37.472043+0000","172.21.15.96:6801/1979917756":"2023-05-09T03:34:37.472043+0000","172.21.15.96:0/1541933328":"2023-05-09T03:34:14.800324+0000","172.21.15.96:6800/3944122753":"2023-05-09T03:34:14.800324+0000","172.21.15.96:0/2986058319":"2023-05-09T03:34:14.800324+0000","172.21.15.96:6801/3944122753":"2023-05-09T03:34:14.800324+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-08T03:41:41.479 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.477+0000 7fc2b0b01700 1 -- 172.21.15.96:0/842735957 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fc2980a11e0 msgr2=0x7fc2980a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:41.480 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.477+0000 7fc2b0b01700 1 --2- 172.21.15.96:0/842735957 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fc2980a11e0 0x7fc2980a3690 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc29c005950 tx=0x7fc29c0058e0 comp rx=0 tx=0).stop 2023-05-08T03:41:41.480 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.477+0000 7fc2b0b01700 1 -- 172.21.15.96:0/842735957 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2ac0ff220 msgr2=0x7fc2ac069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:41.480 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.477+0000 7fc2b0b01700 1 --2- 172.21.15.96:0/842735957 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2ac0ff220 0x7fc2ac069b20 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc29400d980 tx=0x7fc29400dd40 comp rx=0 tx=0).stop 2023-05-08T03:41:41.480 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.477+0000 7fc2b0b01700 1 -- 172.21.15.96:0/842735957 shutdown_connections 2023-05-08T03:41:41.480 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.477+0000 7fc2b0b01700 1 --2- 172.21.15.96:0/842735957 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fc2980a11e0 0x7fc2980a3690 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:41.480 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.477+0000 7fc2b0b01700 1 --2- 172.21.15.96:0/842735957 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2ac100da0 0x7fc2ac19d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:41.480 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.477+0000 7fc2b0b01700 1 --2- 172.21.15.96:0/842735957 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2ac0ff220 0x7fc2ac069b20 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:41.481 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.477+0000 7fc2b0b01700 1 --2- 172.21.15.96:0/842735957 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc2ac100410 0x7fc2ac19ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:41.481 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.477+0000 7fc2b0b01700 1 -- 172.21.15.96:0/842735957 >> 172.21.15.96:0/842735957 conn(0x7fc2ac0fa800 msgr2=0x7fc2ac0fca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:41.481 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.477+0000 7fc2b0b01700 1 -- 172.21.15.96:0/842735957 shutdown_connections 2023-05-08T03:41:41.481 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.477+0000 7fc2b0b01700 1 -- 172.21.15.96:0/842735957 wait complete. 2023-05-08T03:41:41.492 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-08T03:36:47.800739+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-08T03:40:47.229693+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-05-08T03:40:48.359294+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-08T03:41:41.493 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-08T03:41:41.616 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.613+0000 7f9a9742a700 1 -- 172.21.15.96:0/2689928984 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a90100860 msgr2=0x7f9a90100c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:41.617 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.613+0000 7f9a9742a700 1 --2- 172.21.15.96:0/2689928984 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a90100860 0x7f9a90100c70 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f9a80009990 tx=0x7f9a80009ca0 comp rx=0 tx=0).stop 2023-05-08T03:41:41.617 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.613+0000 7f9a9742a700 1 -- 172.21.15.96:0/2689928984 shutdown_connections 2023-05-08T03:41:41.617 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.613+0000 7f9a9742a700 1 --2- 172.21.15.96:0/2689928984 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a900ffdd0 0x7f9a90107680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:41.617 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.613+0000 7f9a9742a700 1 --2- 172.21.15.96:0/2689928984 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a90100860 0x7f9a90100c70 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:41.617 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.613+0000 7f9a9742a700 1 --2- 172.21.15.96:0/2689928984 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9a900ff420 0x7f9a900ff890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:41.617 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.613+0000 7f9a9742a700 1 -- 172.21.15.96:0/2689928984 >> 172.21.15.96:0/2689928984 conn(0x7f9a900f9fa0 msgr2=0x7f9a900fc3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:41.617 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.613+0000 7f9a9742a700 1 -- 172.21.15.96:0/2689928984 shutdown_connections 2023-05-08T03:41:41.618 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.613+0000 7f9a9742a700 1 -- 172.21.15.96:0/2689928984 wait complete. 2023-05-08T03:41:41.618 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.614+0000 7f9a9742a700 1 Processor -- start 2023-05-08T03:41:41.618 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.614+0000 7f9a9742a700 1 -- start start 2023-05-08T03:41:41.620 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.614+0000 7f9a9742a700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9a900ff420 0x7f9a900feea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:41.620 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.614+0000 7f9a9742a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a900ffdd0 0x7f9a9019ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:41.620 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.614+0000 7f9a9742a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a90100860 0x7f9a9019d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:41.620 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.614+0000 7f9a9742a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a9019db70 con 0x7f9a90100860 2023-05-08T03:41:41.621 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.614+0000 7f9a9742a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a9019dce0 con 0x7f9a900ffdd0 2023-05-08T03:41:41.621 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.614+0000 7f9a9742a700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a9019dea0 con 0x7f9a900ff420 2023-05-08T03:41:41.621 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.614+0000 7f9a959c7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a90100860 0x7f9a9019d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:41.621 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.614+0000 7f9a959c7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a90100860 0x7f9a9019d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41158/0 (socket says 172.21.15.96:41158) 2023-05-08T03:41:41.621 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.614+0000 7f9a959c7700 1 -- 172.21.15.96:0/2894466785 learned_addr learned my addr 172.21.15.96:0/2894466785 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:41:41.621 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.614+0000 7f9a949c5700 1 --2- 172.21.15.96:0/2894466785 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a900ffdd0 0x7f9a9019ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:41.621 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.614+0000 7f9a951c6700 1 --2- 172.21.15.96:0/2894466785 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9a900ff420 0x7f9a900feea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:41.621 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.615+0000 7f9a959c7700 1 -- 172.21.15.96:0/2894466785 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9a900ff420 msgr2=0x7f9a900feea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:41.622 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.615+0000 7f9a959c7700 1 --2- 172.21.15.96:0/2894466785 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9a900ff420 0x7f9a900feea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:41.622 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.615+0000 7f9a959c7700 1 -- 172.21.15.96:0/2894466785 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a900ffdd0 msgr2=0x7f9a9019ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:41.622 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.615+0000 7f9a959c7700 1 --2- 172.21.15.96:0/2894466785 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a900ffdd0 0x7f9a9019ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:41.622 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.615+0000 7f9a959c7700 1 -- 172.21.15.96:0/2894466785 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a800095f0 con 0x7f9a90100860 2023-05-08T03:41:41.622 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.615+0000 7f9a949c5700 1 --2- 172.21.15.96:0/2894466785 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a900ffdd0 0x7f9a9019ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-08T03:41:41.622 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.615+0000 7f9a959c7700 1 --2- 172.21.15.96:0/2894466785 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a90100860 0x7f9a9019d3a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9a88007ee0 tx=0x7f9a8800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:41.622 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.615+0000 7f9a867fc700 1 -- 172.21.15.96:0/2894466785 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a88017070 con 0x7f9a90100860 2023-05-08T03:41:41.623 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.615+0000 7f9a9742a700 1 -- 172.21.15.96:0/2894466785 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a9010ab80 con 0x7f9a90100860 2023-05-08T03:41:41.623 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.615+0000 7f9a867fc700 1 -- 172.21.15.96:0/2894466785 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9a8800f040 con 0x7f9a90100860 2023-05-08T03:41:41.623 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.615+0000 7f9a867fc700 1 -- 172.21.15.96:0/2894466785 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a88005740 con 0x7f9a90100860 2023-05-08T03:41:41.623 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.615+0000 7f9a9742a700 1 -- 172.21.15.96:0/2894466785 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a9010a9f0 con 0x7f9a90100860 2023-05-08T03:41:41.623 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.616+0000 7f9a9742a700 1 -- 172.21.15.96:0/2894466785 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a90106170 con 0x7f9a90100860 2023-05-08T03:41:41.623 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.617+0000 7f9a867fc700 1 -- 172.21.15.96:0/2894466785 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f9a880058a0 con 0x7f9a90100860 2023-05-08T03:41:41.623 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.617+0000 7f9a867fc700 1 --2- 172.21.15.96:0/2894466785 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f9a7c0a11e0 0x7f9a7c0a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:41.623 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.618+0000 7f9a867fc700 1 -- 172.21.15.96:0/2894466785 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f9a880cc1c0 con 0x7f9a90100860 2023-05-08T03:41:41.624 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.618+0000 7f9a951c6700 1 --2- 172.21.15.96:0/2894466785 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f9a7c0a11e0 0x7f9a7c0a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:41.624 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.618+0000 7f9a951c6700 1 --2- 172.21.15.96:0/2894466785 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f9a7c0a11e0 0x7f9a7c0a3690 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9a80006010 tx=0x7f9a8000b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:41.624 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.622+0000 7f9a867fc700 1 -- 172.21.15.96:0/2894466785 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f9a880958b0 con 0x7f9a90100860 2023-05-08T03:41:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:41 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/23889922' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-05-08T03:41:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:41 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/3791993157' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-05-08T03:41:41.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:41 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/842735957' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-05-08T03:41:41.815 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.812+0000 7f9a9742a700 1 -- 172.21.15.96:0/2894466785 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9a90061800 con 0x7f9a90100860 2023-05-08T03:41:41.815 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.813+0000 7f9a867fc700 1 -- 172.21.15.96:0/2894466785 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9a88098ed0 con 0x7f9a90100860 2023-05-08T03:41:41.816 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2023-05-08T03:41:41.818 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.815+0000 7f9a9742a700 1 -- 172.21.15.96:0/2894466785 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f9a7c0a11e0 msgr2=0x7f9a7c0a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:41.818 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.815+0000 7f9a9742a700 1 --2- 172.21.15.96:0/2894466785 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f9a7c0a11e0 0x7f9a7c0a3690 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9a80006010 tx=0x7f9a8000b540 comp rx=0 tx=0).stop 2023-05-08T03:41:41.818 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.815+0000 7f9a9742a700 1 -- 172.21.15.96:0/2894466785 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a90100860 msgr2=0x7f9a9019d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:41.818 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.815+0000 7f9a9742a700 1 --2- 172.21.15.96:0/2894466785 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a90100860 0x7f9a9019d3a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9a88007ee0 tx=0x7f9a8800d3b0 comp rx=0 tx=0).stop 2023-05-08T03:41:41.818 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.815+0000 7f9a9742a700 1 -- 172.21.15.96:0/2894466785 shutdown_connections 2023-05-08T03:41:41.819 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.815+0000 7f9a9742a700 1 --2- 172.21.15.96:0/2894466785 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f9a7c0a11e0 0x7f9a7c0a3690 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:41.819 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.815+0000 7f9a9742a700 1 --2- 172.21.15.96:0/2894466785 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a90100860 0x7f9a9019d3a0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:41.819 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.815+0000 7f9a9742a700 1 --2- 172.21.15.96:0/2894466785 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9a900ff420 0x7f9a900feea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:41.819 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.815+0000 7f9a9742a700 1 --2- 172.21.15.96:0/2894466785 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a900ffdd0 0x7f9a9019ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:41.819 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.815+0000 7f9a9742a700 1 -- 172.21.15.96:0/2894466785 >> 172.21.15.96:0/2894466785 conn(0x7f9a900f9fa0 msgr2=0x7f9a900fc230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:41.819 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.815+0000 7f9a9742a700 1 -- 172.21.15.96:0/2894466785 shutdown_connections 2023-05-08T03:41:41.819 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.815+0000 7f9a9742a700 1 -- 172.21.15.96:0/2894466785 wait complete. 2023-05-08T03:41:41.830 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-08T03:41:41.954 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.951+0000 7f6bc8c42700 1 -- 172.21.15.96:0/2779013425 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bc4100510 msgr2=0x7f6bc4106dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:41.955 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.951+0000 7f6bc8c42700 1 --2- 172.21.15.96:0/2779013425 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bc4100510 0x7f6bc4106dd0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc00b0a0 tx=0x7f6bbc00b3b0 comp rx=0 tx=0).stop 2023-05-08T03:41:41.955 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.952+0000 7f6bc8c42700 1 -- 172.21.15.96:0/2779013425 shutdown_connections 2023-05-08T03:41:41.955 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.952+0000 7f6bc8c42700 1 --2- 172.21.15.96:0/2779013425 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bc4100510 0x7f6bc4106dd0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:41.955 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.952+0000 7f6bc8c42700 1 --2- 172.21.15.96:0/2779013425 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6bc40fe990 0x7f6bc40feda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:41.955 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.952+0000 7f6bc8c42700 1 --2- 172.21.15.96:0/2779013425 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6bc40ffb80 0x7f6bc40fffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:41.955 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.952+0000 7f6bc8c42700 1 -- 172.21.15.96:0/2779013425 >> 172.21.15.96:0/2779013425 conn(0x7f6bc40f9fd0 msgr2=0x7f6bc40fc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:41.955 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.952+0000 7f6bc8c42700 1 -- 172.21.15.96:0/2779013425 shutdown_connections 2023-05-08T03:41:41.956 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.952+0000 7f6bc8c42700 1 -- 172.21.15.96:0/2779013425 wait complete. 2023-05-08T03:41:41.957 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.952+0000 7f6bc8c42700 1 Processor -- start 2023-05-08T03:41:41.958 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.952+0000 7f6bc8c42700 1 -- start start 2023-05-08T03:41:41.958 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.952+0000 7f6bc8c42700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bc40fe990 0x7f6bc4195060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:41.958 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.952+0000 7f6bc8c42700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6bc40ffb80 0x7f6bc41955a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:41.958 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.952+0000 7f6bc8c42700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6bc4100510 0x7f6bc419c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:41.958 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.952+0000 7f6bc8c42700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc419cbe0 con 0x7f6bc40fe990 2023-05-08T03:41:41.958 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.952+0000 7f6bc8c42700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc419cd20 con 0x7f6bc4100510 2023-05-08T03:41:41.958 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.952+0000 7f6bc8c42700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc419ceb0 con 0x7f6bc40ffb80 2023-05-08T03:41:41.959 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.953+0000 7f6bc259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bc40fe990 0x7f6bc4195060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:41.959 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.953+0000 7f6bc259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bc40fe990 0x7f6bc4195060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41168/0 (socket says 172.21.15.96:41168) 2023-05-08T03:41:41.959 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.953+0000 7f6bc259c700 1 -- 172.21.15.96:0/2345504300 learned_addr learned my addr 172.21.15.96:0/2345504300 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:41:41.959 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.953+0000 7f6bc2d9d700 1 --2- 172.21.15.96:0/2345504300 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6bc4100510 0x7f6bc419c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:41.959 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.953+0000 7f6bc259c700 1 -- 172.21.15.96:0/2345504300 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6bc40ffb80 msgr2=0x7f6bc41955a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:41.959 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.953+0000 7f6bc1d9b700 1 --2- 172.21.15.96:0/2345504300 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6bc40ffb80 0x7f6bc41955a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:41.959 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.953+0000 7f6bc259c700 1 --2- 172.21.15.96:0/2345504300 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6bc40ffb80 0x7f6bc41955a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:41.959 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.953+0000 7f6bc259c700 1 -- 172.21.15.96:0/2345504300 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6bc4100510 msgr2=0x7f6bc419c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:41.960 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.953+0000 7f6bc259c700 1 --2- 172.21.15.96:0/2345504300 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6bc4100510 0x7f6bc419c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:41.960 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.953+0000 7f6bc259c700 1 -- 172.21.15.96:0/2345504300 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bbc009d00 con 0x7f6bc40fe990 2023-05-08T03:41:41.960 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.953+0000 7f6bc259c700 1 --2- 172.21.15.96:0/2345504300 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bc40fe990 0x7f6bc4195060 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6bb400e970 tx=0x7f6bb400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:41.960 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.953+0000 7f6bb37fe700 1 -- 172.21.15.96:0/2345504300 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb4009790 con 0x7f6bc40fe990 2023-05-08T03:41:41.960 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.953+0000 7f6bb37fe700 1 -- 172.21.15.96:0/2345504300 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6bb400eec0 con 0x7f6bc40fe990 2023-05-08T03:41:41.960 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.953+0000 7f6bc8c42700 1 -- 172.21.15.96:0/2345504300 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bc410a300 con 0x7f6bc40fe990 2023-05-08T03:41:41.960 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.953+0000 7f6bb37fe700 1 -- 172.21.15.96:0/2345504300 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb4003cf0 con 0x7f6bc40fe990 2023-05-08T03:41:41.961 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.953+0000 7f6bc8c42700 1 -- 172.21.15.96:0/2345504300 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bc410a170 con 0x7f6bc40fe990 2023-05-08T03:41:41.961 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.954+0000 7f6bc8c42700 1 -- 172.21.15.96:0/2345504300 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bc4105560 con 0x7f6bc40fe990 2023-05-08T03:41:41.961 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.955+0000 7f6bb37fe700 1 -- 172.21.15.96:0/2345504300 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f6bb400ccd0 con 0x7f6bc40fe990 2023-05-08T03:41:41.961 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.956+0000 7f6bb37fe700 1 --2- 172.21.15.96:0/2345504300 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f6bac0a1260 0x7f6bac0a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:41.962 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.956+0000 7f6bc1d9b700 1 --2- 172.21.15.96:0/2345504300 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f6bac0a1260 0x7f6bac0a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:41.962 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.956+0000 7f6bb37fe700 1 -- 172.21.15.96:0/2345504300 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f6bb4014070 con 0x7f6bc40fe990 2023-05-08T03:41:41.962 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.956+0000 7f6bc1d9b700 1 --2- 172.21.15.96:0/2345504300 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f6bac0a1260 0x7f6bac0a3710 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6bb8005950 tx=0x7f6bb80058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:41.962 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:41.960+0000 7f6bb37fe700 1 -- 172.21.15.96:0/2345504300 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f6bb4096400 con 0x7f6bc40fe990 2023-05-08T03:41:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:41 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/23889922' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-05-08T03:41:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:41 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/3791993157' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-05-08T03:41:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:41 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/842735957' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-05-08T03:41:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:41 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/23889922' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-05-08T03:41:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:41 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/3791993157' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-05-08T03:41:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:41 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/842735957' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-05-08T03:41:42.150 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.147+0000 7f6bc8c42700 1 -- 172.21.15.96:0/2345504300 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6bc4061800 con 0x7f6bc40fe990 2023-05-08T03:41:42.151 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.147+0000 7f6bb37fe700 1 -- 172.21.15.96:0/2345504300 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v84) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6bb4099a20 con 0x7f6bc40fe990 2023-05-08T03:41:42.151 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2023-05-08T03:41:42.152 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.150+0000 7f6bc8c42700 1 -- 172.21.15.96:0/2345504300 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f6bac0a1260 msgr2=0x7f6bac0a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:42.152 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.150+0000 7f6bc8c42700 1 --2- 172.21.15.96:0/2345504300 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f6bac0a1260 0x7f6bac0a3710 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6bb8005950 tx=0x7f6bb80058e0 comp rx=0 tx=0).stop 2023-05-08T03:41:42.153 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.150+0000 7f6bc8c42700 1 -- 172.21.15.96:0/2345504300 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bc40fe990 msgr2=0x7f6bc4195060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:42.153 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.150+0000 7f6bc8c42700 1 --2- 172.21.15.96:0/2345504300 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bc40fe990 0x7f6bc4195060 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6bb400e970 tx=0x7f6bb400ec80 comp rx=0 tx=0).stop 2023-05-08T03:41:42.153 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.150+0000 7f6bc8c42700 1 -- 172.21.15.96:0/2345504300 shutdown_connections 2023-05-08T03:41:42.153 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.150+0000 7f6bc8c42700 1 --2- 172.21.15.96:0/2345504300 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f6bac0a1260 0x7f6bac0a3710 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:42.153 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.150+0000 7f6bc8c42700 1 --2- 172.21.15.96:0/2345504300 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6bc4100510 0x7f6bc419c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:42.153 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.150+0000 7f6bc8c42700 1 --2- 172.21.15.96:0/2345504300 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bc40fe990 0x7f6bc4195060 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:42.153 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.150+0000 7f6bc8c42700 1 --2- 172.21.15.96:0/2345504300 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6bc40ffb80 0x7f6bc41955a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:42.153 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.150+0000 7f6bc8c42700 1 -- 172.21.15.96:0/2345504300 >> 172.21.15.96:0/2345504300 conn(0x7f6bc40f9fd0 msgr2=0x7f6bc40fb8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:42.154 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.150+0000 7f6bc8c42700 1 -- 172.21.15.96:0/2345504300 shutdown_connections 2023-05-08T03:41:42.154 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.150+0000 7f6bc8c42700 1 -- 172.21.15.96:0/2345504300 wait complete. 2023-05-08T03:41:42.165 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-08T03:41:42.290 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.286+0000 7fb797ef6700 1 -- 172.21.15.96:0/2703322132 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb790100410 msgr2=0x7fb790100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:42.290 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.286+0000 7fb797ef6700 1 --2- 172.21.15.96:0/2703322132 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb790100410 0x7fb790100860 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb780009990 tx=0x7fb780009ca0 comp rx=0 tx=0).stop 2023-05-08T03:41:42.291 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.286+0000 7fb797ef6700 1 -- 172.21.15.96:0/2703322132 shutdown_connections 2023-05-08T03:41:42.291 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.286+0000 7fb797ef6700 1 --2- 172.21.15.96:0/2703322132 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb790100da0 0x7fb790107660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:42.291 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.286+0000 7fb797ef6700 1 --2- 172.21.15.96:0/2703322132 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7900ff220 0x7fb7900ff630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:42.291 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.286+0000 7fb797ef6700 1 --2- 172.21.15.96:0/2703322132 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb790100410 0x7fb790100860 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:42.291 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.286+0000 7fb797ef6700 1 -- 172.21.15.96:0/2703322132 >> 172.21.15.96:0/2703322132 conn(0x7fb7900fa840 msgr2=0x7fb7900fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:42.291 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.286+0000 7fb797ef6700 1 -- 172.21.15.96:0/2703322132 shutdown_connections 2023-05-08T03:41:42.291 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.286+0000 7fb797ef6700 1 -- 172.21.15.96:0/2703322132 wait complete. 2023-05-08T03:41:42.292 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.287+0000 7fb797ef6700 1 Processor -- start 2023-05-08T03:41:42.292 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.287+0000 7fb797ef6700 1 -- start start 2023-05-08T03:41:42.292 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.287+0000 7fb797ef6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7900ff220 0x7fb790068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:42.292 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.287+0000 7fb797ef6700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb790100410 0x7fb79019ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:42.292 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.287+0000 7fb797ef6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb790100da0 0x7fb79019d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:42.292 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.287+0000 7fb797ef6700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb79019dbf0 con 0x7fb790100da0 2023-05-08T03:41:42.292 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.287+0000 7fb797ef6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb79019dd60 con 0x7fb7900ff220 2023-05-08T03:41:42.293 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.287+0000 7fb797ef6700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb79019df20 con 0x7fb790100410 2023-05-08T03:41:42.293 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.287+0000 7fb796493700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb790100da0 0x7fb79019d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:42.293 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.287+0000 7fb796493700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb790100da0 0x7fb79019d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41186/0 (socket says 172.21.15.96:41186) 2023-05-08T03:41:42.293 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.287+0000 7fb796493700 1 -- 172.21.15.96:0/135146645 learned_addr learned my addr 172.21.15.96:0/135146645 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:41:42.293 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.287+0000 7fb795c92700 1 --2- 172.21.15.96:0/135146645 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7900ff220 0x7fb790068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:42.293 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.287+0000 7fb795491700 1 --2- 172.21.15.96:0/135146645 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb790100410 0x7fb79019ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:42.293 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.287+0000 7fb796493700 1 -- 172.21.15.96:0/135146645 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb790100410 msgr2=0x7fb79019ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:42.293 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.287+0000 7fb796493700 1 --2- 172.21.15.96:0/135146645 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb790100410 0x7fb79019ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:42.294 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.287+0000 7fb796493700 1 -- 172.21.15.96:0/135146645 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7900ff220 msgr2=0x7fb790068a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:42.294 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.287+0000 7fb796493700 1 --2- 172.21.15.96:0/135146645 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7900ff220 0x7fb790068a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:42.294 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.287+0000 7fb796493700 1 -- 172.21.15.96:0/135146645 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7800095f0 con 0x7fb790100da0 2023-05-08T03:41:42.294 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.287+0000 7fb795c92700 1 --2- 172.21.15.96:0/135146645 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7900ff220 0x7fb790068a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-08T03:41:42.294 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.287+0000 7fb796493700 1 --2- 172.21.15.96:0/135146645 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb790100da0 0x7fb79019d450 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb78800ada0 tx=0x7fb78800c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:42.294 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.288+0000 7fb786ffd700 1 -- 172.21.15.96:0/135146645 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb78800f070 con 0x7fb790100da0 2023-05-08T03:41:42.294 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.288+0000 7fb786ffd700 1 -- 172.21.15.96:0/135146645 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb788007b30 con 0x7fb790100da0 2023-05-08T03:41:42.294 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.288+0000 7fb786ffd700 1 -- 172.21.15.96:0/135146645 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb788005440 con 0x7fb790100da0 2023-05-08T03:41:42.295 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.288+0000 7fb797ef6700 1 -- 172.21.15.96:0/135146645 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb79010ab80 con 0x7fb790100da0 2023-05-08T03:41:42.295 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.288+0000 7fb797ef6700 1 -- 172.21.15.96:0/135146645 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb79010a9f0 con 0x7fb790100da0 2023-05-08T03:41:42.296 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.289+0000 7fb797ef6700 1 -- 172.21.15.96:0/135146645 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb790106800 con 0x7fb790100da0 2023-05-08T03:41:42.296 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.290+0000 7fb786ffd700 1 -- 172.21.15.96:0/135146645 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fb788004ad0 con 0x7fb790100da0 2023-05-08T03:41:42.296 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.291+0000 7fb786ffd700 1 --2- 172.21.15.96:0/135146645 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fb77c0a11e0 0x7fb77c0a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:42.296 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.291+0000 7fb795c92700 1 --2- 172.21.15.96:0/135146645 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fb77c0a11e0 0x7fb77c0a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:42.296 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.291+0000 7fb786ffd700 1 -- 172.21.15.96:0/135146645 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7fb7880cc080 con 0x7fb790100da0 2023-05-08T03:41:42.296 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.291+0000 7fb795c92700 1 --2- 172.21.15.96:0/135146645 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fb77c0a11e0 0x7fb77c0a3690 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb790100270 tx=0x7fb78c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:42.297 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.295+0000 7fb786ffd700 1 -- 172.21.15.96:0/135146645 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fb788095800 con 0x7fb790100da0 2023-05-08T03:41:42.487 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.484+0000 7fb797ef6700 1 -- 172.21.15.96:0/135146645 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb790061ab0 con 0x7fb790100da0 2023-05-08T03:41:42.487 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.484+0000 7fb786ffd700 1 -- 172.21.15.96:0/135146645 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v84) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb788098e20 con 0x7fb790100da0 2023-05-08T03:41:42.487 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 64 2023-05-08T03:41:42.489 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.486+0000 7fb797ef6700 1 -- 172.21.15.96:0/135146645 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fb77c0a11e0 msgr2=0x7fb77c0a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:42.489 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.486+0000 7fb797ef6700 1 --2- 172.21.15.96:0/135146645 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fb77c0a11e0 0x7fb77c0a3690 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb790100270 tx=0x7fb78c005f90 comp rx=0 tx=0).stop 2023-05-08T03:41:42.489 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.486+0000 7fb797ef6700 1 -- 172.21.15.96:0/135146645 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb790100da0 msgr2=0x7fb79019d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:42.489 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.486+0000 7fb797ef6700 1 --2- 172.21.15.96:0/135146645 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb790100da0 0x7fb79019d450 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb78800ada0 tx=0x7fb78800c330 comp rx=0 tx=0).stop 2023-05-08T03:41:42.490 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.486+0000 7fb797ef6700 1 -- 172.21.15.96:0/135146645 shutdown_connections 2023-05-08T03:41:42.490 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.486+0000 7fb797ef6700 1 --2- 172.21.15.96:0/135146645 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fb77c0a11e0 0x7fb77c0a3690 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:42.490 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.486+0000 7fb797ef6700 1 --2- 172.21.15.96:0/135146645 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb790100da0 0x7fb79019d450 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:42.490 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.487+0000 7fb797ef6700 1 --2- 172.21.15.96:0/135146645 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7900ff220 0x7fb790068a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:42.490 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.487+0000 7fb797ef6700 1 --2- 172.21.15.96:0/135146645 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb790100410 0x7fb79019ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:42.490 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.487+0000 7fb797ef6700 1 -- 172.21.15.96:0/135146645 >> 172.21.15.96:0/135146645 conn(0x7fb7900fa840 msgr2=0x7fb790103940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:42.490 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.487+0000 7fb797ef6700 1 -- 172.21.15.96:0/135146645 shutdown_connections 2023-05-08T03:41:42.491 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.487+0000 7fb797ef6700 1 -- 172.21.15.96:0/135146645 wait complete. 2023-05-08T03:41:42.501 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-08T03:41:42.625 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.619+0000 7fee124be700 1 -- 172.21.15.96:0/2149720282 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee0c0ffdd0 msgr2=0x7fee0c107680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:42.625 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.619+0000 7fee124be700 1 --2- 172.21.15.96:0/2149720282 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee0c0ffdd0 0x7fee0c107680 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fee0400b0a0 tx=0x7fee0400b3b0 comp rx=0 tx=0).stop 2023-05-08T03:41:42.625 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.620+0000 7fee124be700 1 -- 172.21.15.96:0/2149720282 shutdown_connections 2023-05-08T03:41:42.626 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.620+0000 7fee124be700 1 --2- 172.21.15.96:0/2149720282 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee0c0ffdd0 0x7fee0c107680 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:42.626 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.620+0000 7fee124be700 1 --2- 172.21.15.96:0/2149720282 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee0c1007d0 0x7fee0c100be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:42.626 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.620+0000 7fee124be700 1 --2- 172.21.15.96:0/2149720282 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fee0c0ff420 0x7fee0c0ff890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:42.626 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.620+0000 7fee124be700 1 -- 172.21.15.96:0/2149720282 >> 172.21.15.96:0/2149720282 conn(0x7fee0c0f9f80 msgr2=0x7fee0c0fc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:42.626 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.620+0000 7fee124be700 1 -- 172.21.15.96:0/2149720282 shutdown_connections 2023-05-08T03:41:42.626 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.620+0000 7fee124be700 1 -- 172.21.15.96:0/2149720282 wait complete. 2023-05-08T03:41:42.626 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.620+0000 7fee124be700 1 Processor -- start 2023-05-08T03:41:42.627 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.620+0000 7fee124be700 1 -- start start 2023-05-08T03:41:42.627 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.620+0000 7fee124be700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee0c0ff420 0x7fee0c195070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:42.627 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.620+0000 7fee124be700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fee0c0ffdd0 0x7fee0c1955b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:42.627 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.620+0000 7fee124be700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee0c1007d0 0x7fee0c19c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:42.627 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.620+0000 7fee124be700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee0c19cbf0 con 0x7fee0c1007d0 2023-05-08T03:41:42.627 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.620+0000 7fee124be700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee0c19cd30 con 0x7fee0c0ff420 2023-05-08T03:41:42.627 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.620+0000 7fee124be700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee0c19cec0 con 0x7fee0c0ffdd0 2023-05-08T03:41:42.627 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.621+0000 7fee10a5b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee0c1007d0 0x7fee0c19c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:42.628 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.621+0000 7fee10a5b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee0c1007d0 0x7fee0c19c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41200/0 (socket says 172.21.15.96:41200) 2023-05-08T03:41:42.628 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.621+0000 7fee10a5b700 1 -- 172.21.15.96:0/757888194 learned_addr learned my addr 172.21.15.96:0/757888194 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:41:42.628 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.621+0000 7fee0bfff700 1 --2- 172.21.15.96:0/757888194 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee0c0ff420 0x7fee0c195070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:42.628 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.621+0000 7fee0b7fe700 1 --2- 172.21.15.96:0/757888194 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fee0c0ffdd0 0x7fee0c1955b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:42.628 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.621+0000 7fee10a5b700 1 -- 172.21.15.96:0/757888194 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fee0c0ffdd0 msgr2=0x7fee0c1955b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:42.628 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.621+0000 7fee10a5b700 1 --2- 172.21.15.96:0/757888194 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fee0c0ffdd0 0x7fee0c1955b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:42.628 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.621+0000 7fee10a5b700 1 -- 172.21.15.96:0/757888194 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee0c0ff420 msgr2=0x7fee0c195070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:42.629 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.621+0000 7fee10a5b700 1 --2- 172.21.15.96:0/757888194 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee0c0ff420 0x7fee0c195070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:42.629 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.621+0000 7fee10a5b700 1 -- 172.21.15.96:0/757888194 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee04009d00 con 0x7fee0c1007d0 2023-05-08T03:41:42.629 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.621+0000 7fee0bfff700 1 --2- 172.21.15.96:0/757888194 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee0c0ff420 0x7fee0c195070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-08T03:41:42.629 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.621+0000 7fee0b7fe700 1 --2- 172.21.15.96:0/757888194 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fee0c0ffdd0 0x7fee0c1955b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-08T03:41:42.629 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.621+0000 7fee10a5b700 1 --2- 172.21.15.96:0/757888194 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee0c1007d0 0x7fee0c19c620 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fee040062a0 tx=0x7fee04004db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:42.629 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.621+0000 7fee097fa700 1 -- 172.21.15.96:0/757888194 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee0400e040 con 0x7fee0c1007d0 2023-05-08T03:41:42.629 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.621+0000 7fee097fa700 1 -- 172.21.15.96:0/757888194 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fee0401db50 con 0x7fee0c1007d0 2023-05-08T03:41:42.629 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.621+0000 7fee097fa700 1 -- 172.21.15.96:0/757888194 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee0401bc40 con 0x7fee0c1007d0 2023-05-08T03:41:42.630 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.621+0000 7fee124be700 1 -- 172.21.15.96:0/757888194 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee0c10ab60 con 0x7fee0c1007d0 2023-05-08T03:41:42.630 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.621+0000 7fee124be700 1 -- 172.21.15.96:0/757888194 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee0c10a9d0 con 0x7fee0c1007d0 2023-05-08T03:41:42.630 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.622+0000 7fee124be700 1 -- 172.21.15.96:0/757888194 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee0c067260 con 0x7fee0c1007d0 2023-05-08T03:41:42.631 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.623+0000 7fee097fa700 1 -- 172.21.15.96:0/757888194 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fee0401d690 con 0x7fee0c1007d0 2023-05-08T03:41:42.631 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.624+0000 7fee097fa700 1 --2- 172.21.15.96:0/757888194 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fedf40a11e0 0x7fedf40a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:42.631 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.624+0000 7fee0bfff700 1 --2- 172.21.15.96:0/757888194 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fedf40a11e0 0x7fedf40a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:42.631 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.624+0000 7fee097fa700 1 -- 172.21.15.96:0/757888194 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7fee040cebb0 con 0x7fee0c1007d0 2023-05-08T03:41:42.631 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.624+0000 7fee0bfff700 1 --2- 172.21.15.96:0/757888194 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fedf40a11e0 0x7fedf40a3690 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fee00005950 tx=0x7fee00005f50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:42.632 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.628+0000 7fee097fa700 1 -- 172.21.15.96:0/757888194 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fee04098330 con 0x7fee0c1007d0 2023-05-08T03:41:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:42 smithi096 ceph-mon[124666]: pgmap v286: 97 pgs: 5 peering, 92 active+clean; 636 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2023-05-08T03:41:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:42 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/2894466785' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-05-08T03:41:42.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:42 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/2345504300' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-05-08T03:41:42.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:42 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/135146645' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-05-08T03:41:42.863 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.861+0000 7fee124be700 1 -- 172.21.15.96:0/757888194 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fee0c106190 con 0x7fee0c1007d0 2023-05-08T03:41:42.864 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.861+0000 7fee097fa700 1 -- 172.21.15.96:0/757888194 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+10813 (secure 0 0 0) 0x7fee0409b950 con 0x7fee0c1007d0 2023-05-08T03:41:42.864 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:41:42.865 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6835/1518512221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":1518512221},{"type":"v1","addr":"172.21.15.96:6835","nonce":1518512221}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6837/305967678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6836","nonce":305967678},{"type":"v1","addr":"172.21.15.96:6837","nonce":305967678}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14622,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6839/2596991665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6838","nonce":2596991665},{"type":"v1","addr":"172.21.15.96:6839","nonce":2596991665}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6841/1786091200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6840","nonce":1786091200},{"type":"v1","addr":"172.21.15.96:6841","nonce":1786091200}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/2351258784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":2351258784},{"type":"v1","addr":"172.21.15.133:6833","nonce":2351258784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/2274306880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":2274306880},{"type":"v1","addr":"172.21.15.186:6833","nonce":2274306880}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-05-08T03:40:49.210143+0000","modified":"2023-05-08T03:40:54.356833+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24494,"mds_1":24487,"mds_2":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24437":{"gid":24437,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6835/1735118966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1735118966},{"type":"v1","addr":"172.21.15.133:6835","nonce":1735118966}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6835/3984391904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":3984391904},{"type":"v1","addr":"172.21.15.186:6835","nonce":3984391904}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24461":{"gid":24461,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6837/2218851414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":2218851414},{"type":"v1","addr":"172.21.15.133:6837","nonce":2218851414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24472":{"gid":24472,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.186:6837/1556405826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":1556405826},{"type":"v1","addr":"172.21.15.186:6837","nonce":1556405826}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":5,"addr":"172.21.15.186:6839/1267655485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":1267655485},{"type":"v1","addr":"172.21.15.186:6839","nonce":1267655485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6839/2246041493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6838","nonce":2246041493},{"type":"v1","addr":"172.21.15.133:6839","nonce":2246041493}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-08T03:41:42.866 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.864+0000 7fee124be700 1 -- 172.21.15.96:0/757888194 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fedf40a11e0 msgr2=0x7fedf40a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:42.866 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.864+0000 7fee124be700 1 --2- 172.21.15.96:0/757888194 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fedf40a11e0 0x7fedf40a3690 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fee00005950 tx=0x7fee00005f50 comp rx=0 tx=0).stop 2023-05-08T03:41:42.867 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.864+0000 7fee124be700 1 -- 172.21.15.96:0/757888194 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee0c1007d0 msgr2=0x7fee0c19c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:42.867 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.864+0000 7fee124be700 1 --2- 172.21.15.96:0/757888194 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee0c1007d0 0x7fee0c19c620 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fee040062a0 tx=0x7fee04004db0 comp rx=0 tx=0).stop 2023-05-08T03:41:42.867 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.864+0000 7fee124be700 1 -- 172.21.15.96:0/757888194 shutdown_connections 2023-05-08T03:41:42.867 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.864+0000 7fee124be700 1 --2- 172.21.15.96:0/757888194 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fedf40a11e0 0x7fedf40a3690 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:42.867 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.864+0000 7fee124be700 1 --2- 172.21.15.96:0/757888194 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee0c1007d0 0x7fee0c19c620 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:42.867 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.864+0000 7fee124be700 1 --2- 172.21.15.96:0/757888194 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee0c0ff420 0x7fee0c195070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:42.867 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.864+0000 7fee124be700 1 --2- 172.21.15.96:0/757888194 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fee0c0ffdd0 0x7fee0c1955b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:42.868 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.864+0000 7fee124be700 1 -- 172.21.15.96:0/757888194 >> 172.21.15.96:0/757888194 conn(0x7fee0c0f9f80 msgr2=0x7fee0c0fc200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:42.868 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.864+0000 7fee124be700 1 -- 172.21.15.96:0/757888194 shutdown_connections 2023-05-08T03:41:42.868 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.864+0000 7fee124be700 1 -- 172.21.15.96:0/757888194 wait complete. 2023-05-08T03:41:42.868 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 22 2023-05-08T03:41:42.879 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-08T03:41:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:42 smithi133 ceph-mon[125939]: pgmap v286: 97 pgs: 5 peering, 92 active+clean; 636 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2023-05-08T03:41:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:42 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/2894466785' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-05-08T03:41:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:42 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/2345504300' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-05-08T03:41:42.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:42 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/135146645' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-05-08T03:41:43.001 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.997+0000 7f9b70087700 1 -- 172.21.15.96:0/399158610 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b68100d90 msgr2=0x7f9b68107650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:43.002 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.997+0000 7f9b70087700 1 --2- 172.21.15.96:0/399158610 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b68100d90 0x7f9b68107650 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9b60009f90 tx=0x7f9b6000b330 comp rx=0 tx=0).stop 2023-05-08T03:41:43.002 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.997+0000 7f9b70087700 1 -- 172.21.15.96:0/399158610 shutdown_connections 2023-05-08T03:41:43.002 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.997+0000 7f9b70087700 1 --2- 172.21.15.96:0/399158610 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b68100d90 0x7f9b68107650 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.002 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.997+0000 7f9b70087700 1 --2- 172.21.15.96:0/399158610 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b680ff210 0x7f9b680ff620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.002 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.997+0000 7f9b70087700 1 --2- 172.21.15.96:0/399158610 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9b68100400 0x7f9b68100850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.002 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.997+0000 7f9b70087700 1 -- 172.21.15.96:0/399158610 >> 172.21.15.96:0/399158610 conn(0x7f9b680fa7f0 msgr2=0x7f9b680fcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:43.002 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.997+0000 7f9b70087700 1 -- 172.21.15.96:0/399158610 shutdown_connections 2023-05-08T03:41:43.003 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.997+0000 7f9b70087700 1 -- 172.21.15.96:0/399158610 wait complete. 2023-05-08T03:41:43.003 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.998+0000 7f9b70087700 1 Processor -- start 2023-05-08T03:41:43.003 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.998+0000 7f9b70087700 1 -- start start 2023-05-08T03:41:43.003 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.998+0000 7f9b70087700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9b680ff210 0x7f9b68068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:43.003 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.998+0000 7f9b70087700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b68100400 0x7f9b6819aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:43.003 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.998+0000 7f9b70087700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b68100d90 0x7f9b6819d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:43.003 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.998+0000 7f9b70087700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6819dc90 con 0x7f9b68100d90 2023-05-08T03:41:43.004 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.998+0000 7f9b70087700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6819de00 con 0x7f9b68100400 2023-05-08T03:41:43.004 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.998+0000 7f9b70087700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6819dfc0 con 0x7f9b680ff210 2023-05-08T03:41:43.004 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.998+0000 7f9b6e624700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b68100d90 0x7f9b6819d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:43.004 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.998+0000 7f9b6e624700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b68100d90 0x7f9b6819d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41214/0 (socket says 172.21.15.96:41214) 2023-05-08T03:41:43.004 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.998+0000 7f9b6e624700 1 -- 172.21.15.96:0/4023196779 learned_addr learned my addr 172.21.15.96:0/4023196779 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:41:43.004 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.998+0000 7f9b6d622700 1 --2- 172.21.15.96:0/4023196779 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b68100400 0x7f9b6819aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:43.004 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.998+0000 7f9b6de23700 1 --2- 172.21.15.96:0/4023196779 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9b680ff210 0x7f9b68068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:43.005 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.998+0000 7f9b6e624700 1 -- 172.21.15.96:0/4023196779 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9b680ff210 msgr2=0x7f9b68068a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:43.005 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.998+0000 7f9b6e624700 1 --2- 172.21.15.96:0/4023196779 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9b680ff210 0x7f9b68068a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.005 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.998+0000 7f9b6e624700 1 -- 172.21.15.96:0/4023196779 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b68100400 msgr2=0x7f9b6819aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:43.005 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.998+0000 7f9b6e624700 1 --2- 172.21.15.96:0/4023196779 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b68100400 0x7f9b6819aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.005 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.998+0000 7f9b6e624700 1 -- 172.21.15.96:0/4023196779 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b580095f0 con 0x7f9b68100d90 2023-05-08T03:41:43.005 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.998+0000 7f9b6e624700 1 --2- 172.21.15.96:0/4023196779 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b68100d90 0x7f9b6819d4f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f9b60007930 tx=0x7f9b60004ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:43.005 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.999+0000 7f9b5effd700 1 -- 172.21.15.96:0/4023196779 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b6000e040 con 0x7f9b68100d90 2023-05-08T03:41:43.006 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.999+0000 7f9b70087700 1 -- 172.21.15.96:0/4023196779 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b60009c40 con 0x7f9b68100d90 2023-05-08T03:41:43.006 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.999+0000 7f9b5effd700 1 -- 172.21.15.96:0/4023196779 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9b6000bda0 con 0x7f9b68100d90 2023-05-08T03:41:43.006 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.999+0000 7f9b70087700 1 -- 172.21.15.96:0/4023196779 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b6810ab80 con 0x7f9b68100d90 2023-05-08T03:41:43.006 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:42.999+0000 7f9b5effd700 1 -- 172.21.15.96:0/4023196779 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b600052b0 con 0x7f9b68100d90 2023-05-08T03:41:43.007 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.000+0000 7f9b70087700 1 -- 172.21.15.96:0/4023196779 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b681060a0 con 0x7f9b68100d90 2023-05-08T03:41:43.007 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.001+0000 7f9b5effd700 1 -- 172.21.15.96:0/4023196779 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f9b6001d470 con 0x7f9b68100d90 2023-05-08T03:41:43.007 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.001+0000 7f9b5effd700 1 --2- 172.21.15.96:0/4023196779 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f9b540a11e0 0x7f9b540a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:43.007 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.001+0000 7f9b6de23700 1 --2- 172.21.15.96:0/4023196779 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f9b540a11e0 0x7f9b540a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:43.007 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.001+0000 7f9b5effd700 1 -- 172.21.15.96:0/4023196779 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f9b600ce370 con 0x7f9b68100d90 2023-05-08T03:41:43.008 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.001+0000 7f9b6de23700 1 --2- 172.21.15.96:0/4023196779 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f9b540a11e0 0x7f9b540a3690 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9b68100260 tx=0x7f9b58009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:43.008 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.005+0000 7f9b5effd700 1 -- 172.21.15.96:0/4023196779 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f9b60097af0 con 0x7f9b68100d90 2023-05-08T03:41:43.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:42 smithi186 ceph-mon[126480]: pgmap v286: 97 pgs: 5 peering, 92 active+clean; 636 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2023-05-08T03:41:43.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:42 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/2894466785' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-05-08T03:41:43.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:42 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/2345504300' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-05-08T03:41:43.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:42 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/135146645' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-05-08T03:41:43.197 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.195+0000 7f9b70087700 1 -- 172.21.15.96:0/4023196779 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9b6802d0e0 con 0x7f9b68100d90 2023-05-08T03:41:43.199 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.196+0000 7f9b5effd700 1 -- 172.21.15.96:0/4023196779 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+22437 (secure 0 0 0) 0x7f9b6009b110 con 0x7f9b68100d90 2023-05-08T03:41:43.199 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:41:43.199 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":84,"fsid":"f7ffcfb0-ed50-11ed-9b01-001a4aab830c","created":"2023-05-08T03:33:42.765680+0000","modified":"2023-05-08T03:41:39.350582+0000","last_up_change":"2023-05-08T03:40:07.550882+0000","last_in_change":"2023-05-08T03:39:49.027947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-08T03:36:47.800739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-05-08T03:40:47.229693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-05-08T03:40:48.359294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2ee801e1-8eec-496d-a9ac-fc566b38bbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":1816903726},{"type":"v1","addr":"172.21.15.96:6803","nonce":1816903726}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":1816903726},{"type":"v1","addr":"172.21.15.96:6805","nonce":1816903726}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":1816903726},{"type":"v1","addr":"172.21.15.96:6809","nonce":1816903726}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":1816903726},{"type":"v1","addr":"172.21.15.96:6807","nonce":1816903726}]},"public_addr":"172.21.15.96:6803/1816903726","cluster_addr":"172.21.15.96:6805/1816903726","heartbeat_back_addr":"172.21.15.96:6809/1816903726","heartbeat_front_addr":"172.21.15.96:6807/1816903726","state":["exists","up"]},{"osd":1,"uuid":"eb73deea-fc7c-4f2f-8aef-2d71c598afda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":206989126},{"type":"v1","addr":"172.21.15.133:6801","nonce":206989126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":206989126},{"type":"v1","addr":"172.21.15.133:6803","nonce":206989126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":206989126},{"type":"v1","addr":"172.21.15.133:6807","nonce":206989126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":206989126},{"type":"v1","addr":"172.21.15.133:6805","nonce":206989126}]},"public_addr":"172.21.15.133:6801/206989126","cluster_addr":"172.21.15.133:6803/206989126","heartbeat_back_addr":"172.21.15.133:6807/206989126","heartbeat_front_addr":"172.21.15.133:6805/206989126","state":["exists","up"]},{"osd":2,"uuid":"74a2f239-e82d-4d87-9458-5373b6cbbffd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":1791188143},{"type":"v1","addr":"172.21.15.186:6801","nonce":1791188143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":1791188143},{"type":"v1","addr":"172.21.15.186:6803","nonce":1791188143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":1791188143},{"type":"v1","addr":"172.21.15.186:6807","nonce":1791188143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":1791188143},{"type":"v1","addr":"172.21.15.186:6805","nonce":1791188143}]},"public_addr":"172.21.15.186:6801/1791188143","cluster_addr":"172.21.15.186:6803/1791188143","heartbeat_back_addr":"172.21.15.186:6807/1791188143","heartbeat_front_addr":"172.21.15.186:6805/1791188143","state":["exists","up"]},{"osd":3,"uuid":"421eedf5-ba6e-484e-b715-78c1c10d684e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":3430402140},{"type":"v1","addr":"172.21.15.96:6811","nonce":3430402140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":3430402140},{"type":"v1","addr":"172.21.15.96:6813","nonce":3430402140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":3430402140},{"type":"v1","addr":"172.21.15.96:6817","nonce":3430402140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":3430402140},{"type":"v1","addr":"172.21.15.96:6815","nonce":3430402140}]},"public_addr":"172.21.15.96:6811/3430402140","cluster_addr":"172.21.15.96:6813/3430402140","heartbeat_back_addr":"172.21.15.96:6817/3430402140","heartbeat_front_addr":"172.21.15.96:6815/3430402140","state":["exists","up"]},{"osd":4,"uuid":"fb20100b-6a5a-462d-955d-1697a3861e96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":1237495996},{"type":"v1","addr":"172.21.15.133:6809","nonce":1237495996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":1237495996},{"type":"v1","addr":"172.21.15.133:6811","nonce":1237495996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":1237495996},{"type":"v1","addr":"172.21.15.133:6815","nonce":1237495996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":1237495996},{"type":"v1","addr":"172.21.15.133:6813","nonce":1237495996}]},"public_addr":"172.21.15.133:6809/1237495996","cluster_addr":"172.21.15.133:6811/1237495996","heartbeat_back_addr":"172.21.15.133:6815/1237495996","heartbeat_front_addr":"172.21.15.133:6813/1237495996","state":["exists","up"]},{"osd":5,"uuid":"00177913-8bd6-4391-83c3-08c2b1b8ef13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":541111862},{"type":"v1","addr":"172.21.15.186:6809","nonce":541111862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":541111862},{"type":"v1","addr":"172.21.15.186:6811","nonce":541111862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":541111862},{"type":"v1","addr":"172.21.15.186:6815","nonce":541111862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":541111862},{"type":"v1","addr":"172.21.15.186:6813","nonce":541111862}]},"public_addr":"172.21.15.186:6809/541111862","cluster_addr":"172.21.15.186:6811/541111862","heartbeat_back_addr":"172.21.15.186:6815/541111862","heartbeat_front_addr":"172.21.15.186:6813/541111862","state":["exists","up"]},{"osd":6,"uuid":"204baab6-ca6f-4eef-8b9c-91efc04cc30c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":386227948},{"type":"v1","addr":"172.21.15.96:6819","nonce":386227948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":386227948},{"type":"v1","addr":"172.21.15.96:6821","nonce":386227948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":386227948},{"type":"v1","addr":"172.21.15.96:6825","nonce":386227948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":386227948},{"type":"v1","addr":"172.21.15.96:6823","nonce":386227948}]},"public_addr":"172.21.15.96:6819/386227948","cluster_addr":"172.21.15.96:6821/386227948","heartbeat_back_addr":"172.21.15.96:6825/386227948","heartbeat_front_addr":"172.21.15.96:6823/386227948","state":["exists","up"]},{"osd":7,"uuid":"282db569-a76e-485b-a33d-f2579b956525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":218507954},{"type":"v1","addr":"172.21.15.133:6817","nonce":218507954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":218507954},{"type":"v1","addr":"172.21.15.133:6819","nonce":218507954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":218507954},{"type":"v1","addr":"172.21.15.133:6823","nonce":218507954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":218507954},{"type":"v1","addr":"172.21.15.133:6821","nonce":218507954}]},"public_addr":"172.21.15.133:6817/218507954","cluster_addr":"172.21.15.133:6819/218507954","heartbeat_back_addr":"172.21.15.133:6823/218507954","heartbeat_front_addr":"172.21.15.133:6821/218507954","state":["exists","up"]},{"osd":8,"uuid":"693e25b5-355d-4990-9467-0fac4c9133fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":1648475902},{"type":"v1","addr":"172.21.15.186:6817","nonce":1648475902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":1648475902},{"type":"v1","addr":"172.21.15.186:6819","nonce":1648475902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":1648475902},{"type":"v1","addr":"172.21.15.186:6823","nonce":1648475902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":1648475902},{"type":"v1","addr":"172.21.15.186:6821","nonce":1648475902}]},"public_addr":"172.21.15.186:6817/1648475902","cluster_addr":"172.21.15.186:6819/1648475902","heartbeat_back_addr":"172.21.15.186:6823/1648475902","heartbeat_front_addr":"172.21.15.186:6821/1648475902","state":["exists","up"]},{"osd":9,"uuid":"72fbff09-fe28-4014-86fc-c31f95cd19a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":543223824},{"type":"v1","addr":"172.21.15.96:6827","nonce":543223824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":543223824},{"type":"v1","addr":"172.21.15.96:6829","nonce":543223824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6832","nonce":543223824},{"type":"v1","addr":"172.21.15.96:6833","nonce":543223824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":543223824},{"type":"v1","addr":"172.21.15.96:6831","nonce":543223824}]},"public_addr":"172.21.15.96:6827/543223824","cluster_addr":"172.21.15.96:6829/543223824","heartbeat_back_addr":"172.21.15.96:6833/543223824","heartbeat_front_addr":"172.21.15.96:6831/543223824","state":["exists","up"]},{"osd":10,"uuid":"6c2b6757-60c2-4962-9409-6051dcb13273","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":2323107912},{"type":"v1","addr":"172.21.15.133:6825","nonce":2323107912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":2323107912},{"type":"v1","addr":"172.21.15.133:6827","nonce":2323107912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":2323107912},{"type":"v1","addr":"172.21.15.133:6831","nonce":2323107912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":2323107912},{"type":"v1","addr":"172.21.15.133:6829","nonce":2323107912}]},"public_addr":"172.21.15.133:6825/2323107912","cluster_addr":"172.21.15.133:6827/2323107912","heartbeat_back_addr":"172.21.15.133:6831/2323107912","heartbeat_front_addr":"172.21.15.133:6829/2323107912","state":["exists","up"]},{"osd":11,"uuid":"03c0bb25-2921-446b-960e-6a7a328d36a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":3853499290},{"type":"v1","addr":"172.21.15.186:6825","nonce":3853499290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":3853499290},{"type":"v1","addr":"172.21.15.186:6827","nonce":3853499290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":3853499290},{"type":"v1","addr":"172.21.15.186:6831","nonce":3853499290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":3853499290},{"type":"v1","addr":"172.21.15.186:6829","nonce":3853499290}]},"public_addr":"172.21.15.186:6825/3853499290","cluster_addr":"172.21.15.186:6827/3853499290","heartbeat_back_addr":"172.21.15.186:6831/3853499290","heartbeat_front_addr":"172.21.15.186:6829/3853499290","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:36:02.087281+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:36:24.328783+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:36:46.135576+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:37:08.524145+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:37:30.883871+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:37:53.344554+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:38:15.448162+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:38:37.414878+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:38:59.533953+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:39:21.392102+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:39:43.462696+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:40:05.561808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.96:0/1333468881":"2023-05-09T03:34:37.472043+0000","172.21.15.96:6800/1979917756":"2023-05-09T03:34:37.472043+0000","172.21.15.96:0/1332045367":"2023-05-09T03:34:37.472043+0000","172.21.15.96:0/520278090":"2023-05-09T03:34:14.800324+0000","172.21.15.96:0/1055409415":"2023-05-09T03:34:37.472043+0000","172.21.15.96:6801/1979917756":"2023-05-09T03:34:37.472043+0000","172.21.15.96:0/1541933328":"2023-05-09T03:34:14.800324+0000","172.21.15.96:6800/3944122753":"2023-05-09T03:34:14.800324+0000","172.21.15.96:0/2986058319":"2023-05-09T03:34:14.800324+0000","172.21.15.96:6801/3944122753":"2023-05-09T03:34:14.800324+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-08T03:41:43.201 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.199+0000 7f9b70087700 1 -- 172.21.15.96:0/4023196779 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f9b540a11e0 msgr2=0x7f9b540a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:43.201 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.199+0000 7f9b70087700 1 --2- 172.21.15.96:0/4023196779 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f9b540a11e0 0x7f9b540a3690 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9b68100260 tx=0x7f9b58009310 comp rx=0 tx=0).stop 2023-05-08T03:41:43.201 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.199+0000 7f9b70087700 1 -- 172.21.15.96:0/4023196779 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b68100d90 msgr2=0x7f9b6819d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:43.202 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.199+0000 7f9b70087700 1 --2- 172.21.15.96:0/4023196779 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b68100d90 0x7f9b6819d4f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f9b60007930 tx=0x7f9b60004ce0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.202 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.199+0000 7f9b70087700 1 -- 172.21.15.96:0/4023196779 shutdown_connections 2023-05-08T03:41:43.202 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.199+0000 7f9b70087700 1 --2- 172.21.15.96:0/4023196779 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f9b540a11e0 0x7f9b540a3690 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.202 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.199+0000 7f9b70087700 1 --2- 172.21.15.96:0/4023196779 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b68100d90 0x7f9b6819d4f0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.202 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.199+0000 7f9b70087700 1 --2- 172.21.15.96:0/4023196779 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9b680ff210 0x7f9b68068a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.202 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.199+0000 7f9b70087700 1 --2- 172.21.15.96:0/4023196779 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b68100400 0x7f9b6819aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.202 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.199+0000 7f9b70087700 1 -- 172.21.15.96:0/4023196779 >> 172.21.15.96:0/4023196779 conn(0x7f9b680fa7f0 msgr2=0x7f9b680fca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:43.203 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.199+0000 7f9b70087700 1 -- 172.21.15.96:0/4023196779 shutdown_connections 2023-05-08T03:41:43.203 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.199+0000 7f9b70087700 1 -- 172.21.15.96:0/4023196779 wait complete. 2023-05-08T03:41:43.214 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-08T03:41:43.334 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.332+0000 7f1ea81d4700 1 -- 172.21.15.96:0/2849970812 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ea00ff220 msgr2=0x7f1ea00ff630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:43.334 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.332+0000 7f1ea81d4700 1 --2- 172.21.15.96:0/2849970812 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ea00ff220 0x7f1ea00ff630 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c009990 tx=0x7f1e9c009ca0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.335 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.332+0000 7f1ea81d4700 1 -- 172.21.15.96:0/2849970812 shutdown_connections 2023-05-08T03:41:43.335 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.332+0000 7f1ea81d4700 1 --2- 172.21.15.96:0/2849970812 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1ea0100da0 0x7f1ea0107660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.335 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.332+0000 7f1ea81d4700 1 --2- 172.21.15.96:0/2849970812 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ea00ff220 0x7f1ea00ff630 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.335 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.332+0000 7f1ea81d4700 1 --2- 172.21.15.96:0/2849970812 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ea0100410 0x7f1ea0100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.335 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.332+0000 7f1ea81d4700 1 -- 172.21.15.96:0/2849970812 >> 172.21.15.96:0/2849970812 conn(0x7f1ea00fa800 msgr2=0x7f1ea00fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:43.335 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.332+0000 7f1ea81d4700 1 -- 172.21.15.96:0/2849970812 shutdown_connections 2023-05-08T03:41:43.335 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.332+0000 7f1ea81d4700 1 -- 172.21.15.96:0/2849970812 wait complete. 2023-05-08T03:41:43.337 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.332+0000 7f1ea81d4700 1 Processor -- start 2023-05-08T03:41:43.337 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.332+0000 7f1ea81d4700 1 -- start start 2023-05-08T03:41:43.338 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.332+0000 7f1ea81d4700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1ea00ff220 0x7f1ea0069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:43.338 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.332+0000 7f1ea81d4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ea0100410 0x7f1ea019ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:43.338 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.332+0000 7f1ea81d4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ea0100da0 0x7f1ea019d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:43.338 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.332+0000 7f1ea81d4700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea019dbb0 con 0x7f1ea0100410 2023-05-08T03:41:43.338 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.332+0000 7f1ea81d4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea019dd20 con 0x7f1ea0100da0 2023-05-08T03:41:43.338 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.332+0000 7f1ea81d4700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea019dee0 con 0x7f1ea00ff220 2023-05-08T03:41:43.338 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.333+0000 7f1ea576f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ea0100410 0x7f1ea019ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:43.339 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.333+0000 7f1ea576f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ea0100410 0x7f1ea019ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41228/0 (socket says 172.21.15.96:41228) 2023-05-08T03:41:43.339 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.333+0000 7f1ea576f700 1 -- 172.21.15.96:0/1342776819 learned_addr learned my addr 172.21.15.96:0/1342776819 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:41:43.339 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.333+0000 7f1ea6771700 1 --2- 172.21.15.96:0/1342776819 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ea0100da0 0x7f1ea019d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:43.339 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.333+0000 7f1ea5f70700 1 --2- 172.21.15.96:0/1342776819 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1ea00ff220 0x7f1ea0069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:43.339 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.333+0000 7f1ea576f700 1 -- 172.21.15.96:0/1342776819 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1ea00ff220 msgr2=0x7f1ea0069b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:43.339 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.333+0000 7f1ea576f700 1 --2- 172.21.15.96:0/1342776819 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1ea00ff220 0x7f1ea0069b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.339 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.333+0000 7f1ea576f700 1 -- 172.21.15.96:0/1342776819 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ea0100da0 msgr2=0x7f1ea019d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:43.339 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.333+0000 7f1ea576f700 1 --2- 172.21.15.96:0/1342776819 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ea0100da0 0x7f1ea019d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.340 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.333+0000 7f1ea576f700 1 -- 172.21.15.96:0/1342776819 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e9c0095f0 con 0x7f1ea0100410 2023-05-08T03:41:43.340 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.333+0000 7f1ea576f700 1 --2- 172.21.15.96:0/1342776819 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ea0100410 0x7f1ea019ad80 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f1e9000e9a0 tx=0x7f1e9000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:43.340 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.333+0000 7f1e96ffd700 1 -- 172.21.15.96:0/1342776819 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e90009790 con 0x7f1ea0100410 2023-05-08T03:41:43.340 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.333+0000 7f1e96ffd700 1 -- 172.21.15.96:0/1342776819 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1e9000cbd0 con 0x7f1ea0100410 2023-05-08T03:41:43.340 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.333+0000 7f1ea81d4700 1 -- 172.21.15.96:0/1342776819 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ea010ab90 con 0x7f1ea0100410 2023-05-08T03:41:43.340 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.333+0000 7f1e96ffd700 1 -- 172.21.15.96:0/1342776819 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e90018680 con 0x7f1ea0100410 2023-05-08T03:41:43.340 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.333+0000 7f1ea81d4700 1 -- 172.21.15.96:0/1342776819 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ea010aa00 con 0x7f1ea0100410 2023-05-08T03:41:43.341 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.334+0000 7f1ea81d4700 1 -- 172.21.15.96:0/1342776819 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ea019e5d0 con 0x7f1ea0100410 2023-05-08T03:41:43.341 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.335+0000 7f1e96ffd700 1 -- 172.21.15.96:0/1342776819 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f1e9000cd40 con 0x7f1ea0100410 2023-05-08T03:41:43.341 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.336+0000 7f1e96ffd700 1 --2- 172.21.15.96:0/1342776819 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f1e8c0a1260 0x7f1e8c0a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:43.342 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.336+0000 7f1ea5f70700 1 --2- 172.21.15.96:0/1342776819 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f1e8c0a1260 0x7f1e8c0a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:43.342 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.336+0000 7f1e96ffd700 1 -- 172.21.15.96:0/1342776819 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f1e90014070 con 0x7f1ea0100410 2023-05-08T03:41:43.342 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.336+0000 7f1ea5f70700 1 --2- 172.21.15.96:0/1342776819 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f1e8c0a1260 0x7f1e8c0a3710 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c00b2e0 tx=0x7f1e9c005e80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:43.342 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.339+0000 7f1e96ffd700 1 -- 172.21.15.96:0/1342776819 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f1e900965c0 con 0x7f1ea0100410 2023-05-08T03:41:43.577 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.574+0000 7f1ea81d4700 1 -- 172.21.15.96:0/1342776819 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1ea0106150 con 0x7f1ea0100410 2023-05-08T03:41:43.577 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.575+0000 7f1e96ffd700 1 -- 172.21.15.96:0/1342776819 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+10813 (secure 0 0 0) 0x7f1e90099be0 con 0x7f1ea0100410 2023-05-08T03:41:43.578 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:41:43.578 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6835/1518512221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":1518512221},{"type":"v1","addr":"172.21.15.96:6835","nonce":1518512221}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6837/305967678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6836","nonce":305967678},{"type":"v1","addr":"172.21.15.96:6837","nonce":305967678}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14622,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6839/2596991665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6838","nonce":2596991665},{"type":"v1","addr":"172.21.15.96:6839","nonce":2596991665}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6841/1786091200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6840","nonce":1786091200},{"type":"v1","addr":"172.21.15.96:6841","nonce":1786091200}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/2351258784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":2351258784},{"type":"v1","addr":"172.21.15.133:6833","nonce":2351258784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/2274306880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":2274306880},{"type":"v1","addr":"172.21.15.186:6833","nonce":2274306880}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-05-08T03:40:49.210143+0000","modified":"2023-05-08T03:40:54.356833+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24494,"mds_1":24487,"mds_2":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24437":{"gid":24437,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6835/1735118966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1735118966},{"type":"v1","addr":"172.21.15.133:6835","nonce":1735118966}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6835/3984391904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":3984391904},{"type":"v1","addr":"172.21.15.186:6835","nonce":3984391904}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24461":{"gid":24461,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6837/2218851414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":2218851414},{"type":"v1","addr":"172.21.15.133:6837","nonce":2218851414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24472":{"gid":24472,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.186:6837/1556405826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":1556405826},{"type":"v1","addr":"172.21.15.186:6837","nonce":1556405826}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":5,"addr":"172.21.15.186:6839/1267655485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":1267655485},{"type":"v1","addr":"172.21.15.186:6839","nonce":1267655485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6839/2246041493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6838","nonce":2246041493},{"type":"v1","addr":"172.21.15.133:6839","nonce":2246041493}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-08T03:41:43.580 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.577+0000 7f1ea81d4700 1 -- 172.21.15.96:0/1342776819 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f1e8c0a1260 msgr2=0x7f1e8c0a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:43.580 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.577+0000 7f1ea81d4700 1 --2- 172.21.15.96:0/1342776819 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f1e8c0a1260 0x7f1e8c0a3710 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c00b2e0 tx=0x7f1e9c005e80 comp rx=0 tx=0).stop 2023-05-08T03:41:43.580 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.577+0000 7f1ea81d4700 1 -- 172.21.15.96:0/1342776819 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ea0100410 msgr2=0x7f1ea019ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:43.580 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.577+0000 7f1ea81d4700 1 --2- 172.21.15.96:0/1342776819 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ea0100410 0x7f1ea019ad80 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f1e9000e9a0 tx=0x7f1e9000ecb0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.580 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.577+0000 7f1ea81d4700 1 -- 172.21.15.96:0/1342776819 shutdown_connections 2023-05-08T03:41:43.580 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.577+0000 7f1ea81d4700 1 --2- 172.21.15.96:0/1342776819 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f1e8c0a1260 0x7f1e8c0a3710 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.580 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.577+0000 7f1ea81d4700 1 --2- 172.21.15.96:0/1342776819 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ea0100da0 0x7f1ea019d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.581 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.577+0000 7f1ea81d4700 1 --2- 172.21.15.96:0/1342776819 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1ea00ff220 0x7f1ea0069b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.581 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.577+0000 7f1ea81d4700 1 --2- 172.21.15.96:0/1342776819 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ea0100410 0x7f1ea019ad80 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.581 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.577+0000 7f1ea81d4700 1 -- 172.21.15.96:0/1342776819 >> 172.21.15.96:0/1342776819 conn(0x7f1ea00fa800 msgr2=0x7f1ea00fcac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:43.581 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.577+0000 7f1ea81d4700 1 -- 172.21.15.96:0/1342776819 shutdown_connections 2023-05-08T03:41:43.581 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.577+0000 7f1ea81d4700 1 -- 172.21.15.96:0/1342776819 wait complete. 2023-05-08T03:41:43.581 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 22 2023-05-08T03:41:43.592 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 22, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2023-05-08T03:40:49.210143+0000', 'modified': '2023-05-08T03:40:54.356833+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24494, 'mds_1': 24487, 'mds_2': 24472}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24437': {'gid': 24437, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.133:6835/1735118966', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6834', 'nonce': 1735118966}, {'type': 'v1', 'addr': '172.21.15.133:6835', 'nonce': 1735118966}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24460': {'gid': 24460, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.186:6835/3984391904', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.186:6834', 'nonce': 3984391904}, {'type': 'v1', 'addr': '172.21.15.186:6835', 'nonce': 3984391904}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24461': {'gid': 24461, 'name': 'h', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.133:6837/2218851414', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6836', 'nonce': 2218851414}, {'type': 'v1', 'addr': '172.21.15.133:6837', 'nonce': 2218851414}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24472': {'gid': 24472, 'name': 'c', 'rank': 2, 'incarnation': 20, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.186:6837/1556405826', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.186:6836', 'nonce': 1556405826}, {'type': 'v1', 'addr': '172.21.15.186:6837', 'nonce': 1556405826}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24487': {'gid': 24487, 'name': 'i', 'rank': 1, 'incarnation': 18, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.186:6839/1267655485', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.186:6838', 'nonce': 1267655485}, {'type': 'v1', 'addr': '172.21.15.186:6839', 'nonce': 1267655485}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24494': {'gid': 24494, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.133:6839/2246041493', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6838', 'nonce': 2246041493}, {'type': 'v1', 'addr': '172.21.15.133:6839', 'nonce': 2246041493}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-05-08T03:41:43.593 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2023-05-08T03:41:43.593 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-05-08T03:41:43.721 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.717+0000 7f3caadf7700 1 -- 172.21.15.96:0/499175213 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ca4100da0 msgr2=0x7f3ca4107660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:43.722 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.717+0000 7f3caadf7700 1 --2- 172.21.15.96:0/499175213 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ca4100da0 0x7f3ca4107660 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c00b0a0 tx=0x7f3c9c00b3b0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.722 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.717+0000 7f3caadf7700 1 -- 172.21.15.96:0/499175213 shutdown_connections 2023-05-08T03:41:43.722 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.717+0000 7f3caadf7700 1 --2- 172.21.15.96:0/499175213 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ca4100da0 0x7f3ca4107660 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.722 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.717+0000 7f3caadf7700 1 --2- 172.21.15.96:0/499175213 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3ca40ff220 0x7f3ca40ff630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.722 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.717+0000 7f3caadf7700 1 --2- 172.21.15.96:0/499175213 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ca4100410 0x7f3ca4100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.722 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.717+0000 7f3caadf7700 1 -- 172.21.15.96:0/499175213 >> 172.21.15.96:0/499175213 conn(0x7f3ca40fa840 msgr2=0x7f3ca40fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:43.722 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.717+0000 7f3caadf7700 1 -- 172.21.15.96:0/499175213 shutdown_connections 2023-05-08T03:41:43.723 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.717+0000 7f3caadf7700 1 -- 172.21.15.96:0/499175213 wait complete. 2023-05-08T03:41:43.723 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.718+0000 7f3caadf7700 1 Processor -- start 2023-05-08T03:41:43.723 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.718+0000 7f3caadf7700 1 -- start start 2023-05-08T03:41:43.723 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.718+0000 7f3caadf7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ca40ff220 0x7f3ca4068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:43.723 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.718+0000 7f3caadf7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ca4100410 0x7f3ca419d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:43.723 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.718+0000 7f3caadf7700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3ca4100da0 0x7f3ca419f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:43.723 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.718+0000 7f3caadf7700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca419ff10 con 0x7f3ca40ff220 2023-05-08T03:41:43.723 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.718+0000 7f3caadf7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca41a0080 con 0x7f3ca4100410 2023-05-08T03:41:43.724 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.718+0000 7f3caadf7700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca41a0240 con 0x7f3ca4100da0 2023-05-08T03:41:43.724 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.718+0000 7f3ca8b93700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ca40ff220 0x7f3ca4068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:43.724 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.718+0000 7f3ca8b93700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ca40ff220 0x7f3ca4068a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41238/0 (socket says 172.21.15.96:41238) 2023-05-08T03:41:43.724 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.718+0000 7f3ca8b93700 1 -- 172.21.15.96:0/2446904490 learned_addr learned my addr 172.21.15.96:0/2446904490 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:41:43.724 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.718+0000 7f3ca9394700 1 --2- 172.21.15.96:0/2446904490 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3ca4100da0 0x7f3ca419f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:43.724 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.719+0000 7f3ca3fff700 1 --2- 172.21.15.96:0/2446904490 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ca4100410 0x7f3ca419d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:43.724 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.719+0000 7f3ca8b93700 1 -- 172.21.15.96:0/2446904490 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3ca4100da0 msgr2=0x7f3ca419f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:43.725 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.719+0000 7f3ca8b93700 1 --2- 172.21.15.96:0/2446904490 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3ca4100da0 0x7f3ca419f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.725 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.719+0000 7f3ca8b93700 1 -- 172.21.15.96:0/2446904490 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ca4100410 msgr2=0x7f3ca419d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:43.725 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.719+0000 7f3ca8b93700 1 --2- 172.21.15.96:0/2446904490 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ca4100410 0x7f3ca419d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.725 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.719+0000 7f3ca8b93700 1 -- 172.21.15.96:0/2446904490 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c9c009d00 con 0x7f3ca40ff220 2023-05-08T03:41:43.725 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.719+0000 7f3ca8b93700 1 --2- 172.21.15.96:0/2446904490 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ca40ff220 0x7f3ca4068a40 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3c9800b500 tx=0x7f3c9800b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:43.725 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.719+0000 7f3ca1ffb700 1 -- 172.21.15.96:0/2446904490 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c98011830 con 0x7f3ca40ff220 2023-05-08T03:41:43.725 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.719+0000 7f3ca1ffb700 1 -- 172.21.15.96:0/2446904490 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3c98011e50 con 0x7f3ca40ff220 2023-05-08T03:41:43.725 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.719+0000 7f3caadf7700 1 -- 172.21.15.96:0/2446904490 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ca410ac70 con 0x7f3ca40ff220 2023-05-08T03:41:43.726 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.719+0000 7f3ca1ffb700 1 -- 172.21.15.96:0/2446904490 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c9800f2e0 con 0x7f3ca40ff220 2023-05-08T03:41:43.726 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.719+0000 7f3caadf7700 1 -- 172.21.15.96:0/2446904490 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ca410aae0 con 0x7f3ca40ff220 2023-05-08T03:41:43.731 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.722+0000 7f3ca1ffb700 1 -- 172.21.15.96:0/2446904490 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f3c98010580 con 0x7f3ca40ff220 2023-05-08T03:41:43.731 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.722+0000 7f3ca1ffb700 1 --2- 172.21.15.96:0/2446904490 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f3c940a11e0 0x7f3c940a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:43.731 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.722+0000 7f3ca3fff700 1 --2- 172.21.15.96:0/2446904490 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f3c940a11e0 0x7f3c940a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:43.732 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.722+0000 7f3ca1ffb700 1 -- 172.21.15.96:0/2446904490 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f3c980cc2f0 con 0x7f3ca40ff220 2023-05-08T03:41:43.732 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.723+0000 7f3ca3fff700 1 --2- 172.21.15.96:0/2446904490 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f3c940a11e0 0x7f3c940a3690 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3c9000ba60 tx=0x7f3c90005d50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:43.732 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.723+0000 7f3cb6f82b80 1 Processor -- start 2023-05-08T03:41:43.732 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.723+0000 7f3cb6f82b80 1 -- start start 2023-05-08T03:41:43.732 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.723+0000 7f3cb6f82b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ce60405340 0x55ce60405750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:43.732 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.723+0000 7f3cb6f82b80 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ce60405c90 0x55ce604040b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:43.733 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.723+0000 7f3cb6f82b80 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55ce60404640 0x55ce60404ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:43.733 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.723+0000 7f3cb6f82b80 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce6030a020 con 0x55ce60404640 2023-05-08T03:41:43.733 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.723+0000 7f3cb6f82b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce6035c960 con 0x55ce60405340 2023-05-08T03:41:43.733 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.723+0000 7f3cb6f82b80 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce60355df0 con 0x55ce60405c90 2023-05-08T03:41:43.733 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.723+0000 7f3ca9394700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55ce60404640 0x55ce60404ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:43.733 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.723+0000 7f3ca9394700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55ce60404640 0x55ce60404ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41250/0 (socket says 172.21.15.96:41250) 2023-05-08T03:41:43.733 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.723+0000 7f3ca9394700 1 -- 172.21.15.96:0/2525968334 learned_addr learned my addr 172.21.15.96:0/2525968334 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:41:43.734 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.723+0000 7f3ca8b93700 1 --2- 172.21.15.96:0/2525968334 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ce60405340 0x55ce60405750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:43.734 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.723+0000 7f3ca3fff700 1 --2- 172.21.15.96:0/2525968334 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ce60405c90 0x55ce604040b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:43.734 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.724+0000 7f3ca9394700 1 -- 172.21.15.96:0/2525968334 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ce60405c90 msgr2=0x55ce604040b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-08T03:41:43.734 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.724+0000 7f3ca9394700 1 --2- 172.21.15.96:0/2525968334 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ce60405c90 0x55ce604040b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.734 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.724+0000 7f3ca9394700 1 -- 172.21.15.96:0/2525968334 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ce60405340 msgr2=0x55ce60405750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-08T03:41:43.734 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.724+0000 7f3ca9394700 1 --2- 172.21.15.96:0/2525968334 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ce60405340 0x55ce60405750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.734 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.724+0000 7f3ca9394700 1 -- 172.21.15.96:0/2525968334 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ce601d75e0 con 0x55ce60404640 2023-05-08T03:41:43.734 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.724+0000 7f3ca8b93700 1 --2- 172.21.15.96:0/2525968334 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ce60405340 0x55ce60405750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-08T03:41:43.735 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.724+0000 7f3ca9394700 1 --2- 172.21.15.96:0/2525968334 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55ce60404640 0x55ce60404ac0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c007a60 tx=0x7f3c9c0074e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e40bf9bc0c452066 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:43.735 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.724+0000 7f3c8effd700 1 -- 172.21.15.96:0/2525968334 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c9c00e040 con 0x55ce60404640 2023-05-08T03:41:43.735 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.724+0000 7f3c8effd700 1 -- 172.21.15.96:0/2525968334 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3c9c003a00 con 0x55ce60404640 2023-05-08T03:41:43.735 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.724+0000 7f3c8effd700 1 -- 172.21.15.96:0/2525968334 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c9c01c9d0 con 0x55ce60404640 2023-05-08T03:41:43.735 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.725+0000 7f3cb6f82b80 1 -- 172.21.15.96:0/2525968334 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55ce60404640 msgr2=0x55ce60404ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:43.735 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.725+0000 7f3cb6f82b80 1 --2- 172.21.15.96:0/2525968334 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55ce60404640 0x55ce60404ac0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c007a60 tx=0x7f3c9c0074e0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.735 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.725+0000 7f3cb6f82b80 1 -- 172.21.15.96:0/2525968334 shutdown_connections 2023-05-08T03:41:43.735 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.725+0000 7f3cb6f82b80 1 --2- 172.21.15.96:0/2525968334 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55ce60404640 0x55ce60404ac0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.736 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.725+0000 7f3cb6f82b80 1 --2- 172.21.15.96:0/2525968334 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ce60405340 0x55ce60405750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.736 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.725+0000 7f3cb6f82b80 1 --2- 172.21.15.96:0/2525968334 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ce60405c90 0x55ce604040b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.736 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.725+0000 7f3cb6f82b80 1 -- 172.21.15.96:0/2525968334 >> 172.21.15.96:0/2525968334 conn(0x55ce604003e0 msgr2=0x55ce603fe7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:43.736 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.725+0000 7f3cb6f82b80 1 -- 172.21.15.96:0/2525968334 shutdown_connections 2023-05-08T03:41:43.736 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.725+0000 7f3cb6f82b80 1 -- 172.21.15.96:0/2525968334 wait complete. 2023-05-08T03:41:43.736 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.725+0000 7f3cb6f82b80 1 -- start start 2023-05-08T03:41:43.736 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.725+0000 7f3cb6f82b80 1 Processor -- start 2023-05-08T03:41:43.737 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.725+0000 7f3cb6f82b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ce60404640 0x55ce6040dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:43.737 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.725+0000 7f3cb6f82b80 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55ce60405340 0x55ce6040e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:43.737 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.725+0000 7f3cb6f82b80 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ce60405c90 0x55ce60415130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:43.737 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.725+0000 7f3cb6f82b80 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce601d98d0 con 0x55ce60405340 2023-05-08T03:41:43.737 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.725+0000 7f3cb6f82b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce60415670 con 0x55ce60404640 2023-05-08T03:41:43.737 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.725+0000 7f3cb6f82b80 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce60415800 con 0x55ce60405c90 2023-05-08T03:41:43.737 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.725+0000 7f3cb6f82b80 10 client.0 _ll_register_callbacks cb 0x55ce602fb4d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-08T03:41:43.737 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.726+0000 7f3ca3fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55ce60405340 0x55ce6040e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:43.738 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.726+0000 7f3ca3fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55ce60405340 0x55ce6040e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41254/0 (socket says 172.21.15.96:41254) 2023-05-08T03:41:43.738 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.726+0000 7f3ca3fff700 1 -- 172.21.15.96:0/2910507481 learned_addr learned my addr 172.21.15.96:0/2910507481 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:41:43.738 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.726+0000 7f3ca8b93700 1 --2- 172.21.15.96:0/2910507481 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ce60404640 0x55ce6040dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:43.738 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.726+0000 7f3ca9394700 1 --2- 172.21.15.96:0/2910507481 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ce60405c90 0x55ce60415130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:43.738 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.726+0000 7f3ca3fff700 1 -- 172.21.15.96:0/2910507481 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ce60405c90 msgr2=0x55ce60415130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-08T03:41:43.738 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.726+0000 7f3ca3fff700 1 --2- 172.21.15.96:0/2910507481 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ce60405c90 0x55ce60415130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.738 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.726+0000 7f3ca3fff700 1 -- 172.21.15.96:0/2910507481 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ce60404640 msgr2=0x55ce6040dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-08T03:41:43.738 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.726+0000 7f3ca3fff700 1 --2- 172.21.15.96:0/2910507481 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ce60404640 0x55ce6040dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.739 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.726+0000 7f3ca3fff700 1 -- 172.21.15.96:0/2910507481 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ca4107f90 con 0x55ce60405340 2023-05-08T03:41:43.739 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.726+0000 7f3ca9394700 1 --2- 172.21.15.96:0/2910507481 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ce60405c90 0x55ce60415130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-08T03:41:43.739 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.726+0000 7f3ca3fff700 1 --2- 172.21.15.96:0/2910507481 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55ce60405340 0x55ce6040e0f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f3c9000b840 tx=0x7f3c90004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4b1e683c464f4b2 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:43.739 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.726+0000 7f3c83fff700 10 client.0 ms_handle_connect on v2:172.21.15.96:3300/0 2023-05-08T03:41:43.739 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.726+0000 7f3c83fff700 1 -- 172.21.15.96:0/2910507481 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c9001d840 con 0x55ce60405340 2023-05-08T03:41:43.739 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.726+0000 7f3cb6f82b80 1 -- 172.21.15.96:0/2910507481 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ce603183a0 con 0x55ce60405340 2023-05-08T03:41:43.739 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.726+0000 7f3c83fff700 1 -- 172.21.15.96:0/2910507481 <== mon.0 v2:172.21.15.96:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f3c9000fe20 con 0x55ce60405340 2023-05-08T03:41:43.740 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.726+0000 7f3c83fff700 1 -- 172.21.15.96:0/2910507481 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3c9001d9a0 con 0x55ce60405340 2023-05-08T03:41:43.740 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.726+0000 7f3cb6f82b80 10 client.15045 fetch_fsmap learned FSMap version 22 2023-05-08T03:41:43.740 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.726+0000 7f3cb6f82b80 1 -- 172.21.15.96:0/2910507481 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x55ce60183d90 con 0x55ce60405340 2023-05-08T03:41:43.740 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.726+0000 7f3c83fff700 1 -- 172.21.15.96:0/2910507481 <== mon.0 v2:172.21.15.96:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ce603183a0 con 0x55ce60405340 2023-05-08T03:41:43.740 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.727+0000 7f3c83fff700 1 -- 172.21.15.96:0/2910507481 <== mon.0 v2:172.21.15.96:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f3c90023020 con 0x55ce60405340 2023-05-08T03:41:43.740 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.727+0000 7f3cb6f82b80 10 client.15045 fetch_fsmap finished waiting for FSMap version 22 2023-05-08T03:41:43.740 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.727+0000 7f3cb6f82b80 10 client.15045 resolve_mds: resolved name 'c' to daemon mds.c 2023-05-08T03:41:43.740 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.727+0000 7f3cb6f82b80 20 client.15045 populate_metadata read hostname 'smithi096' 2023-05-08T03:41:43.741 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.727+0000 7f3cb6f82b80 1 --2- 172.21.15.96:0/2910507481 >> [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] conn(0x55ce60419180 0x55ce60418560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:43.741 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.727+0000 7f3cb6f82b80 4 client.15045 mds_command: new command op to 24472 tid=0[{"prefix": "get_command_descriptions"}] 2023-05-08T03:41:43.741 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.727+0000 7f3cb6f82b80 1 -- 172.21.15.96:0/2910507481 --> [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ce60324610 con 0x55ce60419180 2023-05-08T03:41:43.741 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.727+0000 7f3ca8b93700 1 --2- 172.21.15.96:0/2910507481 >> [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] conn(0x55ce60419180 0x55ce60418560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:43.741 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.727+0000 7f3c83fff700 10 client.15045 ms_handle_connect on v2:172.21.15.186:6836/1556405826 2023-05-08T03:41:43.741 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.727+0000 7f3ca8b93700 1 --2- 172.21.15.96:0/2910507481 >> [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] conn(0x55ce60419180 0x55ce60418560 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c8f76f97b5a426ec server_cookie=1382f738285d73da in_seq=0 out_seq=0 2023-05-08T03:41:43.741 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.728+0000 7f3c83fff700 1 -- 172.21.15.96:0/2910507481 <== mds.2 v2:172.21.15.186:6836/1556405826 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55ce60324610 con 0x55ce60419180 2023-05-08T03:41:43.741 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.728+0000 7f3c83fff700 10 client.15045 handle_command_reply: tid=0 2023-05-08T03:41:43.742 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.728+0000 7f3cb6f82b80 1 client.15045 shutdown 2023-05-08T03:41:43.742 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.728+0000 7f3cb6f82b80 1 -- 172.21.15.96:0/2910507481 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55ce60405340 msgr2=0x55ce6040e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:43.742 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.728+0000 7f3cb6f82b80 1 --2- 172.21.15.96:0/2910507481 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55ce60405340 0x55ce6040e0f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f3c9000b840 tx=0x7f3c90004750 comp rx=0 tx=0).stop 2023-05-08T03:41:43.742 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.728+0000 7f3cb6f82b80 1 -- 172.21.15.96:0/2910507481 shutdown_connections 2023-05-08T03:41:43.742 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.728+0000 7f3cb6f82b80 1 --2- 172.21.15.96:0/2910507481 >> [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] conn(0x55ce60419180 0x55ce60418560 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.742 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.728+0000 7f3cb6f82b80 1 --2- 172.21.15.96:0/2910507481 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ce60405c90 0x55ce60415130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.742 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.728+0000 7f3cb6f82b80 1 --2- 172.21.15.96:0/2910507481 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ce60404640 0x55ce6040dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.743 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.728+0000 7f3c83fff700 0 client.15045 ms_handle_reset on v2:172.21.15.186:6836/1556405826 2023-05-08T03:41:43.743 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.728+0000 7f3cb6f82b80 1 --2- 172.21.15.96:0/2910507481 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55ce60405340 0x55ce6040e0f0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.743 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.728+0000 7f3cb6f82b80 1 -- 172.21.15.96:0/2910507481 >> 172.21.15.96:0/2910507481 conn(0x55ce604003e0 msgr2=0x55ce603fdf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:43.743 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.729+0000 7f3cb6f82b80 1 -- 172.21.15.96:0/2910507481 shutdown_connections 2023-05-08T03:41:43.743 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.729+0000 7f3cb6f82b80 1 -- 172.21.15.96:0/2910507481 wait complete. 2023-05-08T03:41:43.743 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.729+0000 7f3cb6f82b80 20 client.15045 trim_cache size 0 max 16384 2023-05-08T03:41:43.749 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.746+0000 7f3cb6f82b80 1 Processor -- start 2023-05-08T03:41:43.750 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.746+0000 7f3cb6f82b80 1 -- start start 2023-05-08T03:41:43.750 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.746+0000 7f3cb6f82b80 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ce60404640 0x55ce604040b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:43.750 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.746+0000 7f3cb6f82b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ce60405340 0x55ce604150f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:43.750 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.746+0000 7f3cb6f82b80 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55ce60405c90 0x55ce60418560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:43.750 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.746+0000 7f3cb6f82b80 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce60323e00 con 0x55ce60405c90 2023-05-08T03:41:43.750 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.746+0000 7f3cb6f82b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce60317b70 con 0x55ce60405340 2023-05-08T03:41:43.750 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.746+0000 7f3cb6f82b80 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce60261ed0 con 0x55ce60404640 2023-05-08T03:41:43.751 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.746+0000 7f3ca9394700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55ce60405c90 0x55ce60418560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:43.751 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.746+0000 7f3ca9394700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55ce60405c90 0x55ce60418560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41264/0 (socket says 172.21.15.96:41264) 2023-05-08T03:41:43.751 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.746+0000 7f3ca9394700 1 -- 172.21.15.96:0/1428599716 learned_addr learned my addr 172.21.15.96:0/1428599716 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:41:43.751 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.747+0000 7f3ca8b93700 1 --2- 172.21.15.96:0/1428599716 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ce60404640 0x55ce604040b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:43.751 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.747+0000 7f3ca3fff700 1 --2- 172.21.15.96:0/1428599716 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ce60405340 0x55ce604150f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:43.751 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.747+0000 7f3ca9394700 1 -- 172.21.15.96:0/1428599716 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ce60404640 msgr2=0x55ce604040b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-08T03:41:43.751 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.747+0000 7f3ca9394700 1 --2- 172.21.15.96:0/1428599716 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ce60404640 0x55ce604040b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.752 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.747+0000 7f3ca9394700 1 -- 172.21.15.96:0/1428599716 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ce60405340 msgr2=0x55ce604150f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-08T03:41:43.752 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.747+0000 7f3ca9394700 1 --2- 172.21.15.96:0/1428599716 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ce60405340 0x55ce604150f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.752 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.747+0000 7f3ca9394700 1 -- 172.21.15.96:0/1428599716 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ce6031c140 con 0x55ce60405c90 2023-05-08T03:41:43.752 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.747+0000 7f3ca3fff700 1 --2- 172.21.15.96:0/1428599716 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ce60405340 0x55ce604150f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-08T03:41:43.752 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.747+0000 7f3ca9394700 1 --2- 172.21.15.96:0/1428599716 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55ce60405c90 0x55ce60418560 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c009fd0 tx=0x7f3c9c00bd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1281bb263c452144 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:43.752 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.747+0000 7f3c8f7fe700 1 -- 172.21.15.96:0/1428599716 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c9c00e040 con 0x55ce60405c90 2023-05-08T03:41:43.752 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.747+0000 7f3c8f7fe700 1 -- 172.21.15.96:0/1428599716 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3c9c007840 con 0x55ce60405c90 2023-05-08T03:41:43.752 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.747+0000 7f3c8f7fe700 1 -- 172.21.15.96:0/1428599716 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c9c0057b0 con 0x55ce60405c90 2023-05-08T03:41:43.756 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.748+0000 7f3cb6f82b80 1 -- 172.21.15.96:0/1428599716 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55ce60405c90 msgr2=0x55ce60418560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:43.756 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.748+0000 7f3cb6f82b80 1 --2- 172.21.15.96:0/1428599716 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55ce60405c90 0x55ce60418560 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c009fd0 tx=0x7f3c9c00bd10 comp rx=0 tx=0).stop 2023-05-08T03:41:43.756 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.748+0000 7f3cb6f82b80 1 -- 172.21.15.96:0/1428599716 shutdown_connections 2023-05-08T03:41:43.756 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.748+0000 7f3cb6f82b80 1 --2- 172.21.15.96:0/1428599716 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55ce60405c90 0x55ce60418560 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.756 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.748+0000 7f3cb6f82b80 1 --2- 172.21.15.96:0/1428599716 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ce60404640 0x55ce604040b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.756 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.748+0000 7f3cb6f82b80 1 --2- 172.21.15.96:0/1428599716 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ce60405340 0x55ce604150f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.757 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.748+0000 7f3cb6f82b80 1 -- 172.21.15.96:0/1428599716 >> 172.21.15.96:0/1428599716 conn(0x55ce604003e0 msgr2=0x55ce603ff0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:43.757 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.748+0000 7f3cb6f82b80 1 -- 172.21.15.96:0/1428599716 shutdown_connections 2023-05-08T03:41:43.757 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.748+0000 7f3cb6f82b80 1 -- 172.21.15.96:0/1428599716 wait complete. 2023-05-08T03:41:43.757 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.748+0000 7f3cb6f82b80 1 -- start start 2023-05-08T03:41:43.757 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.748+0000 7f3cb6f82b80 1 Processor -- start 2023-05-08T03:41:43.757 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.748+0000 7f3cb6f82b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ce60404640 0x55ce60410080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:43.757 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.748+0000 7f3cb6f82b80 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ce60405340 0x55ce604105c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:43.757 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.749+0000 7f3cb6f82b80 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55ce60405c90 0x55ce6046d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:43.758 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.749+0000 7f3cb6f82b80 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce6046d580 con 0x55ce60405c90 2023-05-08T03:41:43.758 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.749+0000 7f3cb6f82b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce6046d6c0 con 0x55ce60404640 2023-05-08T03:41:43.758 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.749+0000 7f3cb6f82b80 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce6046d830 con 0x55ce60405340 2023-05-08T03:41:43.758 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.749+0000 7f3cb6f82b80 10 client.0 _ll_register_callbacks cb 0x55ce602fb4d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-08T03:41:43.758 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.749+0000 7f3ca9394700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55ce60405c90 0x55ce6046d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:43.759 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.749+0000 7f3ca9394700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55ce60405c90 0x55ce6046d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41270/0 (socket says 172.21.15.96:41270) 2023-05-08T03:41:43.759 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.749+0000 7f3ca9394700 1 -- 172.21.15.96:0/396645215 learned_addr learned my addr 172.21.15.96:0/396645215 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:41:43.759 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.749+0000 7f3ca8b93700 1 --2- 172.21.15.96:0/396645215 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ce60404640 0x55ce60410080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:43.759 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.749+0000 7f3ca3fff700 1 --2- 172.21.15.96:0/396645215 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ce60405340 0x55ce604105c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:43.759 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.749+0000 7f3ca9394700 1 -- 172.21.15.96:0/396645215 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ce60405340 msgr2=0x55ce604105c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-08T03:41:43.759 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.749+0000 7f3ca9394700 1 --2- 172.21.15.96:0/396645215 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ce60405340 0x55ce604105c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.759 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.749+0000 7f3ca9394700 1 -- 172.21.15.96:0/396645215 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ce60404640 msgr2=0x55ce60410080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-08T03:41:43.759 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.749+0000 7f3ca9394700 1 --2- 172.21.15.96:0/396645215 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ce60404640 0x55ce60410080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.760 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.749+0000 7f3ca9394700 1 -- 172.21.15.96:0/396645215 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ce601d75e0 con 0x55ce60405c90 2023-05-08T03:41:43.760 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.749+0000 7f3ca9394700 1 --2- 172.21.15.96:0/396645215 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55ce60405c90 0x55ce6046d040 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c00b010 tx=0x7f3c9c0094a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcbf56f578d19243 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:43.760 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.749+0000 7f3c83fff700 10 client.0 ms_handle_connect on v2:172.21.15.96:3300/0 2023-05-08T03:41:43.760 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.749+0000 7f3c83fff700 1 -- 172.21.15.96:0/396645215 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c9c034070 con 0x55ce60405c90 2023-05-08T03:41:43.760 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.749+0000 7f3c83fff700 1 -- 172.21.15.96:0/396645215 <== mon.0 v2:172.21.15.96:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f3c9c003c10 con 0x55ce60405c90 2023-05-08T03:41:43.760 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.749+0000 7f3cb6f82b80 1 -- 172.21.15.96:0/396645215 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ce603d3b70 con 0x55ce60405c90 2023-05-08T03:41:43.760 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.749+0000 7f3c83fff700 1 -- 172.21.15.96:0/396645215 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3c9c00e040 con 0x55ce60405c90 2023-05-08T03:41:43.761 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.749+0000 7f3cb6f82b80 10 client.15051 fetch_fsmap learned FSMap version 22 2023-05-08T03:41:43.761 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.749+0000 7f3cb6f82b80 1 -- 172.21.15.96:0/396645215 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x55ce601aa200 con 0x55ce60405c90 2023-05-08T03:41:43.761 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.750+0000 7f3c83fff700 1 -- 172.21.15.96:0/396645215 <== mon.0 v2:172.21.15.96:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3c9c03e020 con 0x55ce60405c90 2023-05-08T03:41:43.761 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.750+0000 7f3c83fff700 1 -- 172.21.15.96:0/396645215 <== mon.0 v2:172.21.15.96:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f3c9c037020 con 0x55ce60405c90 2023-05-08T03:41:43.761 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.750+0000 7f3cb6f82b80 10 client.15051 fetch_fsmap finished waiting for FSMap version 22 2023-05-08T03:41:43.761 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.750+0000 7f3cb6f82b80 10 client.15051 resolve_mds: resolved name 'c' to daemon mds.c 2023-05-08T03:41:43.761 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.750+0000 7f3cb6f82b80 20 client.15051 populate_metadata read hostname 'smithi096' 2023-05-08T03:41:43.761 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.750+0000 7f3cb6f82b80 1 --2- 172.21.15.96:0/396645215 >> [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] conn(0x55ce60471f70 0x55ce6046e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:43.762 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.750+0000 7f3cb6f82b80 4 client.15051 mds_command: new command op to 24472 tid=0[{"prefix": "status"}] 2023-05-08T03:41:43.762 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.750+0000 7f3cb6f82b80 1 -- 172.21.15.96:0/396645215 --> [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55ce601d9f10 con 0x55ce60471f70 2023-05-08T03:41:43.762 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.750+0000 7f3ca8b93700 1 --2- 172.21.15.96:0/396645215 >> [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] conn(0x55ce60471f70 0x55ce6046e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:43.762 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.750+0000 7f3c83fff700 10 client.15051 ms_handle_connect on v2:172.21.15.186:6836/1556405826 2023-05-08T03:41:43.762 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.750+0000 7f3ca8b93700 1 --2- 172.21.15.96:0/396645215 >> [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] conn(0x55ce60471f70 0x55ce6046e9d0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=13518064ca4321aa server_cookie=3a76b263a39b062 in_seq=0 out_seq=0 2023-05-08T03:41:43.762 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.751+0000 7f3c83fff700 1 -- 172.21.15.96:0/396645215 <== mds.2 v2:172.21.15.186:6836/1556405826 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55ce601d9f10 con 0x55ce60471f70 2023-05-08T03:41:43.762 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.751+0000 7f3c83fff700 10 client.15051 handle_command_reply: tid=0 2023-05-08T03:41:43.762 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.751+0000 7f3cb6f82b80 1 client.15051 shutdown 2023-05-08T03:41:43.763 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.751+0000 7f3cb6f82b80 1 -- 172.21.15.96:0/396645215 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55ce60405c90 msgr2=0x55ce6046d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:43.763 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.751+0000 7f3cb6f82b80 1 --2- 172.21.15.96:0/396645215 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55ce60405c90 0x55ce6046d040 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c00b010 tx=0x7f3c9c0094a0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.763 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.751+0000 7f3cb6f82b80 1 -- 172.21.15.96:0/396645215 shutdown_connections 2023-05-08T03:41:43.763 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.751+0000 7f3cb6f82b80 1 --2- 172.21.15.96:0/396645215 >> [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] conn(0x55ce60471f70 0x55ce6046e9d0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.763 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.751+0000 7f3cb6f82b80 1 --2- 172.21.15.96:0/396645215 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55ce60405c90 0x55ce6046d040 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.763 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.751+0000 7f3cb6f82b80 1 --2- 172.21.15.96:0/396645215 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ce60404640 0x55ce60410080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.763 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.751+0000 7f3cb6f82b80 1 --2- 172.21.15.96:0/396645215 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ce60405340 0x55ce604105c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.764 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.751+0000 7f3c83fff700 0 client.15051 ms_handle_reset on v2:172.21.15.186:6836/1556405826 2023-05-08T03:41:43.764 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.751+0000 7f3cb6f82b80 1 -- 172.21.15.96:0/396645215 >> 172.21.15.96:0/396645215 conn(0x55ce604003e0 msgr2=0x55ce60418560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:43.764 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.751+0000 7f3cb6f82b80 1 -- 172.21.15.96:0/396645215 shutdown_connections 2023-05-08T03:41:43.764 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.751+0000 7f3cb6f82b80 1 -- 172.21.15.96:0/396645215 wait complete. 2023-05-08T03:41:43.764 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.751+0000 7f3cb6f82b80 20 client.15051 trim_cache size 0 max 16384 2023-05-08T03:41:43.764 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2023-05-08T03:41:43.765 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_fsid": "f7ffcfb0-ed50-11ed-9b01-001a4aab830c", 2023-05-08T03:41:43.765 INFO:teuthology.orchestra.run.smithi096.stdout: "whoami": 2, 2023-05-08T03:41:43.765 INFO:teuthology.orchestra.run.smithi096.stdout: "id": 24472, 2023-05-08T03:41:43.765 INFO:teuthology.orchestra.run.smithi096.stdout: "want_state": "up:active", 2023-05-08T03:41:43.765 INFO:teuthology.orchestra.run.smithi096.stdout: "state": "up:active", 2023-05-08T03:41:43.765 INFO:teuthology.orchestra.run.smithi096.stdout: "fs_name": "cephfs", 2023-05-08T03:41:43.765 INFO:teuthology.orchestra.run.smithi096.stdout: "rank_uptime": 50.402779438000003, 2023-05-08T03:41:43.766 INFO:teuthology.orchestra.run.smithi096.stdout: "mdsmap_epoch": 22, 2023-05-08T03:41:43.766 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap_epoch": 84, 2023-05-08T03:41:43.766 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap_epoch_barrier": 82, 2023-05-08T03:41:43.766 INFO:teuthology.orchestra.run.smithi096.stdout: "uptime": 70.374644993999993 2023-05-08T03:41:43.766 INFO:teuthology.orchestra.run.smithi096.stdout:} 2023-05-08T03:41:43.767 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.752+0000 7f3caadf7700 1 -- 172.21.15.96:0/2446904490 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f3c940a11e0 msgr2=0x7f3c940a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:43.767 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.752+0000 7f3caadf7700 1 --2- 172.21.15.96:0/2446904490 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f3c940a11e0 0x7f3c940a3690 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3c9000ba60 tx=0x7f3c90005d50 comp rx=0 tx=0).stop 2023-05-08T03:41:43.767 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.752+0000 7f3caadf7700 1 -- 172.21.15.96:0/2446904490 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ca40ff220 msgr2=0x7f3ca4068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:43.768 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.752+0000 7f3caadf7700 1 --2- 172.21.15.96:0/2446904490 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ca40ff220 0x7f3ca4068a40 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3c9800b500 tx=0x7f3c9800b810 comp rx=0 tx=0).stop 2023-05-08T03:41:43.768 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.752+0000 7f3caadf7700 1 -- 172.21.15.96:0/2446904490 shutdown_connections 2023-05-08T03:41:43.768 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.752+0000 7f3caadf7700 1 --2- 172.21.15.96:0/2446904490 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f3c940a11e0 0x7f3c940a3690 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.768 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.752+0000 7f3caadf7700 1 --2- 172.21.15.96:0/2446904490 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3ca4100da0 0x7f3ca419f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.768 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.752+0000 7f3caadf7700 1 --2- 172.21.15.96:0/2446904490 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ca40ff220 0x7f3ca4068a40 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.768 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.752+0000 7f3caadf7700 1 --2- 172.21.15.96:0/2446904490 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ca4100410 0x7f3ca419d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.768 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.752+0000 7f3caadf7700 1 -- 172.21.15.96:0/2446904490 >> 172.21.15.96:0/2446904490 conn(0x7f3ca40fa840 msgr2=0x7f3ca40fc950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:43.769 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.752+0000 7f3caadf7700 1 -- 172.21.15.96:0/2446904490 shutdown_connections 2023-05-08T03:41:43.769 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.752+0000 7f3caadf7700 1 -- 172.21.15.96:0/2446904490 wait complete. 2023-05-08T03:41:43.769 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2023-05-08T03:41:43.891 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.888+0000 7ff8b0cea700 1 -- 172.21.15.96:0/2119659780 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8ac1005d0 msgr2=0x7ff8ac106e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:43.892 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.888+0000 7ff8b0cea700 1 --2- 172.21.15.96:0/2119659780 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8ac1005d0 0x7ff8ac106e90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ff8a400b0a0 tx=0x7ff8a400b3b0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.892 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.889+0000 7ff8b0cea700 1 -- 172.21.15.96:0/2119659780 shutdown_connections 2023-05-08T03:41:43.892 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.889+0000 7ff8b0cea700 1 --2- 172.21.15.96:0/2119659780 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8ac1005d0 0x7ff8ac106e90 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.892 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.889+0000 7ff8b0cea700 1 --2- 172.21.15.96:0/2119659780 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff8ac0fea50 0x7ff8ac0fee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.892 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.889+0000 7ff8b0cea700 1 --2- 172.21.15.96:0/2119659780 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8ac0ffc40 0x7ff8ac100090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.892 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.889+0000 7ff8b0cea700 1 -- 172.21.15.96:0/2119659780 >> 172.21.15.96:0/2119659780 conn(0x7ff8ac0fa050 msgr2=0x7ff8ac0fc4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:43.893 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.889+0000 7ff8b0cea700 1 -- 172.21.15.96:0/2119659780 shutdown_connections 2023-05-08T03:41:43.893 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.889+0000 7ff8b0cea700 1 -- 172.21.15.96:0/2119659780 wait complete. 2023-05-08T03:41:43.894 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.889+0000 7ff8b0cea700 1 Processor -- start 2023-05-08T03:41:43.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.889+0000 7ff8b0cea700 1 -- start start 2023-05-08T03:41:43.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.889+0000 7ff8b0cea700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8ac0fea50 0x7ff8ac108080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:43.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.890+0000 7ff8b0cea700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff8ac0ffc40 0x7ff8ac19d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:43.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.890+0000 7ff8b0cea700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8ac1005d0 0x7ff8ac19f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:43.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.890+0000 7ff8b0cea700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ac19feb0 con 0x7ff8ac1005d0 2023-05-08T03:41:43.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.890+0000 7ff8b0cea700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ac1a0020 con 0x7ff8ac0fea50 2023-05-08T03:41:43.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.890+0000 7ff8b0cea700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ac1a01e0 con 0x7ff8ac0ffc40 2023-05-08T03:41:43.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.890+0000 7ff8aad9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8ac1005d0 0x7ff8ac19f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:43.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.890+0000 7ff8aad9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8ac1005d0 0x7ff8ac19f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41284/0 (socket says 172.21.15.96:41284) 2023-05-08T03:41:43.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.890+0000 7ff8aad9d700 1 -- 172.21.15.96:0/3600628754 learned_addr learned my addr 172.21.15.96:0/3600628754 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:41:43.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.890+0000 7ff8aa59c700 1 --2- 172.21.15.96:0/3600628754 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8ac0fea50 0x7ff8ac108080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:43.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.890+0000 7ff8a9d9b700 1 --2- 172.21.15.96:0/3600628754 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff8ac0ffc40 0x7ff8ac19d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:43.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.890+0000 7ff8aad9d700 1 -- 172.21.15.96:0/3600628754 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff8ac0ffc40 msgr2=0x7ff8ac19d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:43.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.890+0000 7ff8aad9d700 1 --2- 172.21.15.96:0/3600628754 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff8ac0ffc40 0x7ff8ac19d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.890+0000 7ff8aad9d700 1 -- 172.21.15.96:0/3600628754 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8ac0fea50 msgr2=0x7ff8ac108080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:43.897 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.890+0000 7ff8aad9d700 1 --2- 172.21.15.96:0/3600628754 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8ac0fea50 0x7ff8ac108080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.897 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.890+0000 7ff8aad9d700 1 -- 172.21.15.96:0/3600628754 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a4009d00 con 0x7ff8ac1005d0 2023-05-08T03:41:43.897 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.890+0000 7ff8aad9d700 1 --2- 172.21.15.96:0/3600628754 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8ac1005d0 0x7ff8ac19f800 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff8a40062a0 tx=0x7ff8a4004d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:43.897 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.890+0000 7ff89b7fe700 1 -- 172.21.15.96:0/3600628754 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a400e040 con 0x7ff8ac1005d0 2023-05-08T03:41:43.897 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.890+0000 7ff8b0cea700 1 -- 172.21.15.96:0/3600628754 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8ac10ac40 con 0x7ff8ac1005d0 2023-05-08T03:41:43.897 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.890+0000 7ff89b7fe700 1 -- 172.21.15.96:0/3600628754 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff8a400cec0 con 0x7ff8ac1005d0 2023-05-08T03:41:43.897 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.890+0000 7ff89b7fe700 1 -- 172.21.15.96:0/3600628754 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a401baf0 con 0x7ff8ac1005d0 2023-05-08T03:41:43.898 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.890+0000 7ff8b0cea700 1 -- 172.21.15.96:0/3600628754 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8ac10aab0 con 0x7ff8ac1005d0 2023-05-08T03:41:43.898 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.892+0000 7ff89b7fe700 1 -- 172.21.15.96:0/3600628754 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7ff8a401bc50 con 0x7ff8ac1005d0 2023-05-08T03:41:43.902 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.893+0000 7ff89b7fe700 1 --2- 172.21.15.96:0/3600628754 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7ff8940a11e0 0x7ff8940a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:43.903 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.893+0000 7ff89b7fe700 1 -- 172.21.15.96:0/3600628754 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7ff8a40ce4b0 con 0x7ff8ac1005d0 2023-05-08T03:41:43.903 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.893+0000 7ff8aa59c700 1 --2- 172.21.15.96:0/3600628754 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7ff8940a11e0 0x7ff8940a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:43.903 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.893+0000 7ff8aa59c700 1 --2- 172.21.15.96:0/3600628754 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7ff8940a11e0 0x7ff8940a3690 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac0ffaa0 tx=0x7ff89c007400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:43.903 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.894+0000 7ff8bce75b80 1 Processor -- start 2023-05-08T03:41:43.903 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.894+0000 7ff8bce75b80 1 -- start start 2023-05-08T03:41:43.903 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.894+0000 7ff8bce75b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55673f297340 0x55673f297750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:43.904 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.894+0000 7ff8bce75b80 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55673f297c90 0x55673f2960b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:43.904 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.894+0000 7ff8bce75b80 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55673f296640 0x55673f296ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:43.904 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.894+0000 7ff8bce75b80 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x55673f19c020 con 0x55673f297c90 2023-05-08T03:41:43.904 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.894+0000 7ff8bce75b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55673f1ee960 con 0x55673f297340 2023-05-08T03:41:43.904 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.894+0000 7ff8bce75b80 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55673f1e7df0 con 0x55673f296640 2023-05-08T03:41:43.904 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.894+0000 7ff8a9d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55673f297c90 0x55673f2960b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:43.904 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.894+0000 7ff8a9d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55673f297c90 0x55673f2960b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41290/0 (socket says 172.21.15.96:41290) 2023-05-08T03:41:43.904 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.894+0000 7ff8a9d9b700 1 -- 172.21.15.96:0/3841144405 learned_addr learned my addr 172.21.15.96:0/3841144405 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:41:43.905 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.894+0000 7ff8aa59c700 1 --2- 172.21.15.96:0/3841144405 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55673f297340 0x55673f297750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:43.905 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.894+0000 7ff8aad9d700 1 --2- 172.21.15.96:0/3841144405 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55673f296640 0x55673f296ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:43.905 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.894+0000 7ff8a9d9b700 1 -- 172.21.15.96:0/3841144405 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55673f296640 msgr2=0x55673f296ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-08T03:41:43.905 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.894+0000 7ff8a9d9b700 1 --2- 172.21.15.96:0/3841144405 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55673f296640 0x55673f296ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.905 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.894+0000 7ff8a9d9b700 1 -- 172.21.15.96:0/3841144405 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55673f297340 msgr2=0x55673f297750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-08T03:41:43.905 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.894+0000 7ff8a9d9b700 1 --2- 172.21.15.96:0/3841144405 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55673f297340 0x55673f297750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.905 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.894+0000 7ff8a9d9b700 1 -- 172.21.15.96:0/3841144405 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55673f0695e0 con 0x55673f297c90 2023-05-08T03:41:43.906 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.894+0000 7ff8aad9d700 1 --2- 172.21.15.96:0/3841144405 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55673f296640 0x55673f296ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-08T03:41:43.906 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.895+0000 7ff8a9d9b700 1 --2- 172.21.15.96:0/3841144405 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55673f297c90 0x55673f2960b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff8a000bcf0 tx=0x7ff8a00103d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=475c8d147cf39539 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:43.906 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.895+0000 7ff898ff9700 1 -- 172.21.15.96:0/3841144405 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a0010c40 con 0x55673f297c90 2023-05-08T03:41:43.906 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.895+0000 7ff898ff9700 1 -- 172.21.15.96:0/3841144405 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff8a0015070 con 0x55673f297c90 2023-05-08T03:41:43.906 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.895+0000 7ff898ff9700 1 -- 172.21.15.96:0/3841144405 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a0005020 con 0x55673f297c90 2023-05-08T03:41:43.906 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.895+0000 7ff8bce75b80 1 -- 172.21.15.96:0/3841144405 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55673f297c90 msgr2=0x55673f2960b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:43.906 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.895+0000 7ff8bce75b80 1 --2- 172.21.15.96:0/3841144405 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55673f297c90 0x55673f2960b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff8a000bcf0 tx=0x7ff8a00103d0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.906 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.895+0000 7ff8bce75b80 1 -- 172.21.15.96:0/3841144405 shutdown_connections 2023-05-08T03:41:43.907 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.895+0000 7ff8bce75b80 1 --2- 172.21.15.96:0/3841144405 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55673f296640 0x55673f296ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.907 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.895+0000 7ff8bce75b80 1 --2- 172.21.15.96:0/3841144405 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55673f297340 0x55673f297750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.907 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.895+0000 7ff8bce75b80 1 --2- 172.21.15.96:0/3841144405 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55673f297c90 0x55673f2960b0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.907 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.895+0000 7ff8bce75b80 1 -- 172.21.15.96:0/3841144405 >> 172.21.15.96:0/3841144405 conn(0x55673f2923e0 msgr2=0x55673f2907b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:43.907 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.896+0000 7ff8bce75b80 1 -- 172.21.15.96:0/3841144405 shutdown_connections 2023-05-08T03:41:43.907 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.896+0000 7ff8bce75b80 1 -- 172.21.15.96:0/3841144405 wait complete. 2023-05-08T03:41:43.907 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.896+0000 7ff8bce75b80 1 -- start start 2023-05-08T03:41:43.908 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.896+0000 7ff8bce75b80 1 Processor -- start 2023-05-08T03:41:43.908 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.896+0000 7ff8bce75b80 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55673f296640 0x55673f29fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:43.908 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.896+0000 7ff8bce75b80 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55673f297340 0x55673f2a01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:43.908 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.896+0000 7ff8bce75b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55673f297c90 0x55673f2a7210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:43.908 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.896+0000 7ff8bce75b80 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x55673f06b8d0 con 0x55673f297340 2023-05-08T03:41:43.908 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.896+0000 7ff8bce75b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55673f2a7750 con 0x55673f297c90 2023-05-08T03:41:43.908 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.896+0000 7ff8bce75b80 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55673f2a78e0 con 0x55673f296640 2023-05-08T03:41:43.908 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.896+0000 7ff8bce75b80 10 client.0 _ll_register_callbacks cb 0x55673f18d4d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-08T03:41:43.909 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.896+0000 7ff8a9d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55673f297340 0x55673f2a01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:43.909 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.896+0000 7ff8a9d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55673f297340 0x55673f2a01d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41296/0 (socket says 172.21.15.96:41296) 2023-05-08T03:41:43.909 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.896+0000 7ff8a9d9b700 1 -- 172.21.15.96:0/3587178889 learned_addr learned my addr 172.21.15.96:0/3587178889 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:41:43.909 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.896+0000 7ff8aa59c700 1 --2- 172.21.15.96:0/3587178889 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55673f296640 0x55673f29fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:43.909 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.896+0000 7ff8aad9d700 1 --2- 172.21.15.96:0/3587178889 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55673f297c90 0x55673f2a7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:43.909 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.897+0000 7ff8a9d9b700 1 -- 172.21.15.96:0/3587178889 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55673f296640 msgr2=0x55673f29fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-08T03:41:43.909 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.897+0000 7ff8a9d9b700 1 --2- 172.21.15.96:0/3587178889 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55673f296640 0x55673f29fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.910 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.897+0000 7ff8a9d9b700 1 -- 172.21.15.96:0/3587178889 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55673f297c90 msgr2=0x55673f2a7210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-08T03:41:43.910 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.897+0000 7ff8a9d9b700 1 --2- 172.21.15.96:0/3587178889 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55673f297c90 0x55673f2a7210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.910 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.897+0000 7ff8a9d9b700 1 -- 172.21.15.96:0/3587178889 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8a000b920 con 0x55673f297340 2023-05-08T03:41:43.910 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.897+0000 7ff8a9d9b700 1 --2- 172.21.15.96:0/3587178889 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55673f297340 0x55673f2a01d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ff8a0010fd0 tx=0x7ff8a0010c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=249a73bf9de11cb3 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:43.910 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.897+0000 7ff891ffb700 10 client.0 ms_handle_connect on v2:172.21.15.96:3300/0 2023-05-08T03:41:43.910 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.897+0000 7ff891ffb700 1 -- 172.21.15.96:0/3587178889 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a0004450 con 0x55673f297340 2023-05-08T03:41:43.910 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.897+0000 7ff8bce75b80 1 -- 172.21.15.96:0/3587178889 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55673f1aa3a0 con 0x55673f297340 2023-05-08T03:41:43.910 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.897+0000 7ff891ffb700 1 -- 172.21.15.96:0/3587178889 <== mon.0 v2:172.21.15.96:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7ff8a0017070 con 0x55673f297340 2023-05-08T03:41:43.911 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.897+0000 7ff891ffb700 1 -- 172.21.15.96:0/3587178889 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff8a00045b0 con 0x55673f297340 2023-05-08T03:41:43.911 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.897+0000 7ff8bce75b80 10 client.15063 fetch_fsmap learned FSMap version 22 2023-05-08T03:41:43.911 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.897+0000 7ff8bce75b80 1 -- 172.21.15.96:0/3587178889 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x55673f015d90 con 0x55673f297340 2023-05-08T03:41:43.911 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.897+0000 7ff891ffb700 1 -- 172.21.15.96:0/3587178889 <== mon.0 v2:172.21.15.96:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55673f1aa3a0 con 0x55673f297340 2023-05-08T03:41:43.911 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.897+0000 7ff891ffb700 1 -- 172.21.15.96:0/3587178889 <== mon.0 v2:172.21.15.96:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7ff8a00117a0 con 0x55673f297340 2023-05-08T03:41:43.911 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.897+0000 7ff8bce75b80 10 client.15063 fetch_fsmap finished waiting for FSMap version 22 2023-05-08T03:41:43.911 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.897+0000 7ff8bce75b80 10 client.15063 resolve_mds: resolved name 'i' to daemon mds.i 2023-05-08T03:41:43.912 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.897+0000 7ff8bce75b80 20 client.15063 populate_metadata read hostname 'smithi096' 2023-05-08T03:41:43.912 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.897+0000 7ff8bce75b80 1 --2- 172.21.15.96:0/3587178889 >> [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] conn(0x55673f2ab030 0x55673f2aa4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:43.912 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.897+0000 7ff8bce75b80 4 client.15063 mds_command: new command op to 24487 tid=0[{"prefix": "get_command_descriptions"}] 2023-05-08T03:41:43.912 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.897+0000 7ff8bce75b80 1 -- 172.21.15.96:0/3587178889 --> [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55673f1b6610 con 0x55673f2ab030 2023-05-08T03:41:43.912 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.898+0000 7ff8aa59c700 1 --2- 172.21.15.96:0/3587178889 >> [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] conn(0x55673f2ab030 0x55673f2aa4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:43.912 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.898+0000 7ff891ffb700 10 client.15063 ms_handle_connect on v2:172.21.15.186:6838/1267655485 2023-05-08T03:41:43.912 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.898+0000 7ff8aa59c700 1 --2- 172.21.15.96:0/3587178889 >> [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] conn(0x55673f2ab030 0x55673f2aa4e0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e121b11ed1638761 server_cookie=869b00eb3a48da8b in_seq=0 out_seq=0 2023-05-08T03:41:43.912 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.899+0000 7ff891ffb700 1 -- 172.21.15.96:0/3587178889 <== mds.1 v2:172.21.15.186:6838/1267655485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55673f1b6610 con 0x55673f2ab030 2023-05-08T03:41:43.913 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.899+0000 7ff891ffb700 10 client.15063 handle_command_reply: tid=0 2023-05-08T03:41:43.913 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.899+0000 7ff8bce75b80 1 client.15063 shutdown 2023-05-08T03:41:43.913 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.899+0000 7ff8bce75b80 1 -- 172.21.15.96:0/3587178889 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55673f297340 msgr2=0x55673f2a01d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:43.913 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.899+0000 7ff8bce75b80 1 --2- 172.21.15.96:0/3587178889 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55673f297340 0x55673f2a01d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ff8a0010fd0 tx=0x7ff8a0010c70 comp rx=0 tx=0).stop 2023-05-08T03:41:43.913 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.899+0000 7ff8bce75b80 1 -- 172.21.15.96:0/3587178889 shutdown_connections 2023-05-08T03:41:43.913 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.899+0000 7ff8bce75b80 1 --2- 172.21.15.96:0/3587178889 >> [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] conn(0x55673f2ab030 0x55673f2aa4e0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.913 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.899+0000 7ff8bce75b80 1 --2- 172.21.15.96:0/3587178889 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55673f297c90 0x55673f2a7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.914 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.899+0000 7ff8bce75b80 1 --2- 172.21.15.96:0/3587178889 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55673f296640 0x55673f29fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.914 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.899+0000 7ff891ffb700 0 client.15063 ms_handle_reset on v2:172.21.15.186:6838/1267655485 2023-05-08T03:41:43.914 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.899+0000 7ff8bce75b80 1 --2- 172.21.15.96:0/3587178889 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55673f297340 0x55673f2a01d0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.914 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.899+0000 7ff8bce75b80 1 -- 172.21.15.96:0/3587178889 >> 172.21.15.96:0/3587178889 conn(0x55673f2923e0 msgr2=0x55673f28ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:43.914 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.899+0000 7ff8bce75b80 1 -- 172.21.15.96:0/3587178889 shutdown_connections 2023-05-08T03:41:43.914 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.899+0000 7ff8bce75b80 1 -- 172.21.15.96:0/3587178889 wait complete. 2023-05-08T03:41:43.914 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.899+0000 7ff8bce75b80 20 client.15063 trim_cache size 0 max 16384 2023-05-08T03:41:43.921 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.917+0000 7ff8bce75b80 1 Processor -- start 2023-05-08T03:41:43.921 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.917+0000 7ff8bce75b80 1 -- start start 2023-05-08T03:41:43.921 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.917+0000 7ff8bce75b80 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55673f296640 0x55673f29d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:43.922 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.917+0000 7ff8bce75b80 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55673f297c90 0x55673f29dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:43.922 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.917+0000 7ff8bce75b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55673f2a71d0 0x55673f29a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:43.922 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.917+0000 7ff8bce75b80 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x55673f296f30 con 0x55673f297c90 2023-05-08T03:41:43.922 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.917+0000 7ff8bce75b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55673f28b7d0 con 0x55673f2a71d0 2023-05-08T03:41:43.922 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.917+0000 7ff8bce75b80 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55673f291390 con 0x55673f296640 2023-05-08T03:41:43.922 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.917+0000 7ff8a9d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55673f297c90 0x55673f29dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:43.922 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.917+0000 7ff8a9d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55673f297c90 0x55673f29dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41304/0 (socket says 172.21.15.96:41304) 2023-05-08T03:41:43.922 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.917+0000 7ff8a9d9b700 1 -- 172.21.15.96:0/3994290600 learned_addr learned my addr 172.21.15.96:0/3994290600 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:41:43.923 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.917+0000 7ff8aad9d700 1 --2- 172.21.15.96:0/3994290600 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55673f2a71d0 0x55673f29a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:43.923 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.918+0000 7ff8a9d9b700 1 -- 172.21.15.96:0/3994290600 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55673f296640 msgr2=0x55673f29d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-08T03:41:43.923 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.918+0000 7ff8a9d9b700 1 --2- 172.21.15.96:0/3994290600 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55673f296640 0x55673f29d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.923 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.918+0000 7ff8a9d9b700 1 -- 172.21.15.96:0/3994290600 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55673f2a71d0 msgr2=0x55673f29a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-08T03:41:43.923 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.918+0000 7ff8a9d9b700 1 --2- 172.21.15.96:0/3994290600 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55673f2a71d0 0x55673f29a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.923 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.918+0000 7ff8a9d9b700 1 -- 172.21.15.96:0/3994290600 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55673f290a50 con 0x55673f297c90 2023-05-08T03:41:43.923 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.918+0000 7ff8aad9d700 1 --2- 172.21.15.96:0/3994290600 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55673f2a71d0 0x55673f29a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-08T03:41:43.924 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.918+0000 7ff8a9d9b700 1 --2- 172.21.15.96:0/3994290600 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55673f297c90 0x55673f29dee0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7ff8a0000c00 tx=0x7ff8a000b520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abc31a7e7cf72171 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:43.924 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.918+0000 7ff8997fa700 1 -- 172.21.15.96:0/3994290600 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a0004250 con 0x55673f297c90 2023-05-08T03:41:43.924 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.918+0000 7ff8997fa700 1 -- 172.21.15.96:0/3994290600 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff8a0015070 con 0x55673f297c90 2023-05-08T03:41:43.924 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.918+0000 7ff8997fa700 1 -- 172.21.15.96:0/3994290600 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a00039b0 con 0x55673f297c90 2023-05-08T03:41:43.924 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.918+0000 7ff8bce75b80 1 -- 172.21.15.96:0/3994290600 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55673f297c90 msgr2=0x55673f29dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:43.924 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.918+0000 7ff8bce75b80 1 --2- 172.21.15.96:0/3994290600 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55673f297c90 0x55673f29dee0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7ff8a0000c00 tx=0x7ff8a000b520 comp rx=0 tx=0).stop 2023-05-08T03:41:43.924 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.918+0000 7ff8bce75b80 1 -- 172.21.15.96:0/3994290600 shutdown_connections 2023-05-08T03:41:43.924 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.918+0000 7ff8bce75b80 1 --2- 172.21.15.96:0/3994290600 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55673f2a71d0 0x55673f29a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.925 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.918+0000 7ff8bce75b80 1 --2- 172.21.15.96:0/3994290600 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55673f296640 0x55673f29d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.925 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.918+0000 7ff8bce75b80 1 --2- 172.21.15.96:0/3994290600 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55673f297c90 0x55673f29dee0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.925 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.918+0000 7ff8bce75b80 1 -- 172.21.15.96:0/3994290600 >> 172.21.15.96:0/3994290600 conn(0x55673f2923e0 msgr2=0x55673f2aa4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:43.925 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.919+0000 7ff8bce75b80 1 -- 172.21.15.96:0/3994290600 shutdown_connections 2023-05-08T03:41:43.925 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.919+0000 7ff8bce75b80 1 -- 172.21.15.96:0/3994290600 wait complete. 2023-05-08T03:41:43.925 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.919+0000 7ff8bce75b80 1 -- start start 2023-05-08T03:41:43.925 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.919+0000 7ff8bce75b80 1 Processor -- start 2023-05-08T03:41:43.928 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.919+0000 7ff8bce75b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55673f296640 0x55673f29ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:43.928 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.919+0000 7ff8bce75b80 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55673f297c90 0x55673f29bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:43.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.919+0000 7ff8bce75b80 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55673f2a71d0 0x55673f29c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:43.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.919+0000 7ff8bce75b80 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x55673f2ff000 con 0x55673f2a71d0 2023-05-08T03:41:43.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.919+0000 7ff8bce75b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55673f2ff170 con 0x55673f296640 2023-05-08T03:41:43.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.919+0000 7ff8bce75b80 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55673f2ff330 con 0x55673f297c90 2023-05-08T03:41:43.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.919+0000 7ff8bce75b80 10 client.0 _ll_register_callbacks cb 0x55673f18d4d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-08T03:41:43.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.919+0000 7ff8aad9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55673f2a71d0 0x55673f29c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:43.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.919+0000 7ff8aad9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55673f2a71d0 0x55673f29c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41312/0 (socket says 172.21.15.96:41312) 2023-05-08T03:41:43.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.919+0000 7ff8aad9d700 1 -- 172.21.15.96:0/3144679133 learned_addr learned my addr 172.21.15.96:0/3144679133 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:41:43.930 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.919+0000 7ff8aa59c700 1 --2- 172.21.15.96:0/3144679133 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55673f296640 0x55673f29ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:43.930 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.920+0000 7ff8a9d9b700 1 --2- 172.21.15.96:0/3144679133 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55673f297c90 0x55673f29bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:43.930 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.920+0000 7ff8aad9d700 1 -- 172.21.15.96:0/3144679133 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55673f297c90 msgr2=0x55673f29bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-08T03:41:43.930 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.920+0000 7ff8aad9d700 1 --2- 172.21.15.96:0/3144679133 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55673f297c90 0x55673f29bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.930 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.920+0000 7ff8aad9d700 1 -- 172.21.15.96:0/3144679133 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55673f296640 msgr2=0x55673f29ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-08T03:41:43.930 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.920+0000 7ff8aad9d700 1 --2- 172.21.15.96:0/3144679133 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55673f296640 0x55673f29ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.930 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.920+0000 7ff8aad9d700 1 -- 172.21.15.96:0/3144679133 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55673f015d90 con 0x55673f2a71d0 2023-05-08T03:41:43.931 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.920+0000 7ff8aa59c700 1 --2- 172.21.15.96:0/3144679133 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55673f296640 0x55673f29ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-08T03:41:43.931 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.920+0000 7ff8aad9d700 1 --2- 172.21.15.96:0/3144679133 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55673f2a71d0 0x55673f29c510 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ff8a4009fd0 tx=0x7ff8a400b3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5e720a3ba86d7b8 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:43.931 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.920+0000 7ff891ffb700 10 client.0 ms_handle_connect on v2:172.21.15.96:3300/0 2023-05-08T03:41:43.931 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.920+0000 7ff891ffb700 1 -- 172.21.15.96:0/3144679133 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a409f920 con 0x55673f2a71d0 2023-05-08T03:41:43.931 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.920+0000 7ff891ffb700 1 -- 172.21.15.96:0/3144679133 <== mon.0 v2:172.21.15.96:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7ff8a40a3cb0 con 0x55673f2a71d0 2023-05-08T03:41:43.931 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.920+0000 7ff8bce75b80 1 -- 172.21.15.96:0/3144679133 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55673f265b70 con 0x55673f2a71d0 2023-05-08T03:41:43.931 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.920+0000 7ff891ffb700 1 -- 172.21.15.96:0/3144679133 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff8a409bb50 con 0x55673f2a71d0 2023-05-08T03:41:43.931 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.920+0000 7ff8bce75b80 10 client.15069 fetch_fsmap learned FSMap version 22 2023-05-08T03:41:43.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.920+0000 7ff8bce75b80 1 -- 172.21.15.96:0/3144679133 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x55673effec10 con 0x55673f2a71d0 2023-05-08T03:41:43.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.920+0000 7ff891ffb700 1 -- 172.21.15.96:0/3144679133 <== mon.0 v2:172.21.15.96:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55673f265b70 con 0x55673f2a71d0 2023-05-08T03:41:43.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.920+0000 7ff891ffb700 1 -- 172.21.15.96:0/3144679133 <== mon.0 v2:172.21.15.96:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7ff8a40a3820 con 0x55673f2a71d0 2023-05-08T03:41:43.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.920+0000 7ff8bce75b80 10 client.15069 fetch_fsmap finished waiting for FSMap version 22 2023-05-08T03:41:43.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.920+0000 7ff8bce75b80 10 client.15069 resolve_mds: resolved name 'i' to daemon mds.i 2023-05-08T03:41:43.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.920+0000 7ff8bce75b80 20 client.15069 populate_metadata read hostname 'smithi096' 2023-05-08T03:41:43.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.920+0000 7ff8bce75b80 1 --2- 172.21.15.96:0/3144679133 >> [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] conn(0x55673f303eb0 0x55673f300870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:43.933 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.920+0000 7ff8bce75b80 4 client.15069 mds_command: new command op to 24487 tid=0[{"prefix": "status"}] 2023-05-08T03:41:43.933 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.920+0000 7ff8bce75b80 1 -- 172.21.15.96:0/3144679133 --> [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55673f06bf10 con 0x55673f303eb0 2023-05-08T03:41:43.933 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.921+0000 7ff8aa59c700 1 --2- 172.21.15.96:0/3144679133 >> [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] conn(0x55673f303eb0 0x55673f300870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:43.933 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.921+0000 7ff891ffb700 10 client.15069 ms_handle_connect on v2:172.21.15.186:6838/1267655485 2023-05-08T03:41:43.933 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.921+0000 7ff8aa59c700 1 --2- 172.21.15.96:0/3144679133 >> [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] conn(0x55673f303eb0 0x55673f300870 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=36baa8e15663c35 server_cookie=7e36f03a18d12a1f in_seq=0 out_seq=0 2023-05-08T03:41:43.933 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.921+0000 7ff891ffb700 1 -- 172.21.15.96:0/3144679133 <== mds.1 v2:172.21.15.186:6838/1267655485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55673f06bf10 con 0x55673f303eb0 2023-05-08T03:41:43.933 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.921+0000 7ff891ffb700 10 client.15069 handle_command_reply: tid=0 2023-05-08T03:41:43.933 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.921+0000 7ff8bce75b80 1 client.15069 shutdown 2023-05-08T03:41:43.934 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.921+0000 7ff8bce75b80 1 -- 172.21.15.96:0/3144679133 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55673f2a71d0 msgr2=0x55673f29c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:43.934 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.921+0000 7ff8bce75b80 1 --2- 172.21.15.96:0/3144679133 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55673f2a71d0 0x55673f29c510 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ff8a4009fd0 tx=0x7ff8a400b3b0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.934 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.921+0000 7ff8bce75b80 1 -- 172.21.15.96:0/3144679133 shutdown_connections 2023-05-08T03:41:43.934 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.921+0000 7ff8bce75b80 1 --2- 172.21.15.96:0/3144679133 >> [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] conn(0x55673f303eb0 0x55673f300870 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.934 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.921+0000 7ff8bce75b80 1 --2- 172.21.15.96:0/3144679133 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55673f2a71d0 0x55673f29c510 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.934 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.921+0000 7ff8bce75b80 1 --2- 172.21.15.96:0/3144679133 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55673f296640 0x55673f29ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.934 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.921+0000 7ff8bce75b80 1 --2- 172.21.15.96:0/3144679133 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55673f297c90 0x55673f29bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.935 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.921+0000 7ff891ffb700 0 client.15069 ms_handle_reset on v2:172.21.15.186:6838/1267655485 2023-05-08T03:41:43.935 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.921+0000 7ff8bce75b80 1 -- 172.21.15.96:0/3144679133 >> 172.21.15.96:0/3144679133 conn(0x55673f2923e0 msgr2=0x55673f29d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:43.935 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.921+0000 7ff8bce75b80 1 -- 172.21.15.96:0/3144679133 shutdown_connections 2023-05-08T03:41:43.935 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.921+0000 7ff8bce75b80 1 -- 172.21.15.96:0/3144679133 wait complete. 2023-05-08T03:41:43.935 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.922+0000 7ff8bce75b80 20 client.15069 trim_cache size 0 max 16384 2023-05-08T03:41:43.935 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2023-05-08T03:41:43.936 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_fsid": "f7ffcfb0-ed50-11ed-9b01-001a4aab830c", 2023-05-08T03:41:43.936 INFO:teuthology.orchestra.run.smithi096.stdout: "whoami": 1, 2023-05-08T03:41:43.936 INFO:teuthology.orchestra.run.smithi096.stdout: "id": 24487, 2023-05-08T03:41:43.936 INFO:teuthology.orchestra.run.smithi096.stdout: "want_state": "up:active", 2023-05-08T03:41:43.936 INFO:teuthology.orchestra.run.smithi096.stdout: "state": "up:active", 2023-05-08T03:41:43.936 INFO:teuthology.orchestra.run.smithi096.stdout: "fs_name": "cephfs", 2023-05-08T03:41:43.937 INFO:teuthology.orchestra.run.smithi096.stdout: "rank_uptime": 51.582449087999997, 2023-05-08T03:41:43.937 INFO:teuthology.orchestra.run.smithi096.stdout: "mdsmap_epoch": 22, 2023-05-08T03:41:43.937 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap_epoch": 84, 2023-05-08T03:41:43.937 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap_epoch_barrier": 82, 2023-05-08T03:41:43.937 INFO:teuthology.orchestra.run.smithi096.stdout: "uptime": 66.109172028000003 2023-05-08T03:41:43.937 INFO:teuthology.orchestra.run.smithi096.stdout:} 2023-05-08T03:41:43.938 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.922+0000 7ff8b0cea700 1 -- 172.21.15.96:0/3600628754 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7ff8940a11e0 msgr2=0x7ff8940a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:43.938 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.922+0000 7ff8b0cea700 1 --2- 172.21.15.96:0/3600628754 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7ff8940a11e0 0x7ff8940a3690 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac0ffaa0 tx=0x7ff89c007400 comp rx=0 tx=0).stop 2023-05-08T03:41:43.938 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.922+0000 7ff8b0cea700 1 -- 172.21.15.96:0/3600628754 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8ac1005d0 msgr2=0x7ff8ac19f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:43.938 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.922+0000 7ff8b0cea700 1 --2- 172.21.15.96:0/3600628754 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8ac1005d0 0x7ff8ac19f800 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff8a40062a0 tx=0x7ff8a4004d00 comp rx=0 tx=0).stop 2023-05-08T03:41:43.939 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.922+0000 7ff8b0cea700 1 -- 172.21.15.96:0/3600628754 shutdown_connections 2023-05-08T03:41:43.939 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.922+0000 7ff8b0cea700 1 --2- 172.21.15.96:0/3600628754 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7ff8940a11e0 0x7ff8940a3690 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.939 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.922+0000 7ff8b0cea700 1 --2- 172.21.15.96:0/3600628754 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8ac1005d0 0x7ff8ac19f800 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.939 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.922+0000 7ff8b0cea700 1 --2- 172.21.15.96:0/3600628754 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8ac0fea50 0x7ff8ac108080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.939 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.922+0000 7ff8b0cea700 1 --2- 172.21.15.96:0/3600628754 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff8ac0ffc40 0x7ff8ac19d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:43.939 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.922+0000 7ff8b0cea700 1 -- 172.21.15.96:0/3600628754 >> 172.21.15.96:0/3600628754 conn(0x7ff8ac0fa050 msgr2=0x7ff8ac0fc220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:43.939 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.922+0000 7ff8b0cea700 1 -- 172.21.15.96:0/3600628754 shutdown_connections 2023-05-08T03:41:43.940 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:43.922+0000 7ff8b0cea700 1 -- 172.21.15.96:0/3600628754 wait complete. 2023-05-08T03:41:43.940 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:43 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/757888194' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-05-08T03:41:43.940 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:43 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/4023196779' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-05-08T03:41:43.940 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:43 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/1342776819' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-05-08T03:41:43.941 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-05-08T03:41:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:43 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/757888194' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-05-08T03:41:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:43 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/4023196779' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-05-08T03:41:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:43 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/1342776819' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-05-08T03:41:44.065 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.061+0000 7fe5881bf700 1 -- 172.21.15.96:0/1857928923 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe580101680 msgr2=0x7fe580101ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:44.066 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.061+0000 7fe5881bf700 1 --2- 172.21.15.96:0/1857928923 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe580101680 0x7fe580101ad0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe57c009990 tx=0x7fe57c009ca0 comp rx=0 tx=0).stop 2023-05-08T03:41:44.066 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.061+0000 7fe5881bf700 1 -- 172.21.15.96:0/1857928923 shutdown_connections 2023-05-08T03:41:44.066 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.061+0000 7fe5881bf700 1 --2- 172.21.15.96:0/1857928923 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe580102010 0x7fe5801088d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:44.066 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.061+0000 7fe5881bf700 1 --2- 172.21.15.96:0/1857928923 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe5800fe610 0x7fe5800fea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:44.066 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.061+0000 7fe5881bf700 1 --2- 172.21.15.96:0/1857928923 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe580101680 0x7fe580101ad0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:44.066 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.061+0000 7fe5881bf700 1 -- 172.21.15.96:0/1857928923 >> 172.21.15.96:0/1857928923 conn(0x7fe5800f9fb0 msgr2=0x7fe5800fc400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:44.067 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.061+0000 7fe5881bf700 1 -- 172.21.15.96:0/1857928923 shutdown_connections 2023-05-08T03:41:44.067 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.061+0000 7fe5881bf700 1 -- 172.21.15.96:0/1857928923 wait complete. 2023-05-08T03:41:44.067 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.062+0000 7fe5881bf700 1 Processor -- start 2023-05-08T03:41:44.067 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.062+0000 7fe5881bf700 1 -- start start 2023-05-08T03:41:44.067 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.062+0000 7fe5881bf700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5800fe610 0x7fe580100ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:44.067 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.062+0000 7fe5881bf700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe580101680 0x7fe5800ff630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:44.067 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.062+0000 7fe5881bf700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe580102010 0x7fe5800ffb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:44.068 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.062+0000 7fe5881bf700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe580100310 con 0x7fe5800fe610 2023-05-08T03:41:44.068 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.062+0000 7fe5881bf700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe580100480 con 0x7fe580102010 2023-05-08T03:41:44.068 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.062+0000 7fe5881bf700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5801a00f0 con 0x7fe580101680 2023-05-08T03:41:44.068 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.062+0000 7fe585f5b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5800fe610 0x7fe580100ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:44.068 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.062+0000 7fe585f5b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5800fe610 0x7fe580100ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41322/0 (socket says 172.21.15.96:41322) 2023-05-08T03:41:44.068 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.062+0000 7fe585f5b700 1 -- 172.21.15.96:0/359118408 learned_addr learned my addr 172.21.15.96:0/359118408 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:41:44.068 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.062+0000 7fe58675c700 1 --2- 172.21.15.96:0/359118408 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe580102010 0x7fe5800ffb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:44.068 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.062+0000 7fe58575a700 1 --2- 172.21.15.96:0/359118408 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe580101680 0x7fe5800ff630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:44.069 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.062+0000 7fe585f5b700 1 -- 172.21.15.96:0/359118408 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe580101680 msgr2=0x7fe5800ff630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:44.069 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.062+0000 7fe585f5b700 1 --2- 172.21.15.96:0/359118408 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe580101680 0x7fe5800ff630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:44.069 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.062+0000 7fe585f5b700 1 -- 172.21.15.96:0/359118408 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe580102010 msgr2=0x7fe5800ffb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:44.069 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.062+0000 7fe585f5b700 1 --2- 172.21.15.96:0/359118408 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe580102010 0x7fe5800ffb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:44.069 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.062+0000 7fe585f5b700 1 -- 172.21.15.96:0/359118408 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe57c0095f0 con 0x7fe5800fe610 2023-05-08T03:41:44.069 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.062+0000 7fe58675c700 1 --2- 172.21.15.96:0/359118408 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe580102010 0x7fe5800ffb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-08T03:41:44.069 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.063+0000 7fe585f5b700 1 --2- 172.21.15.96:0/359118408 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5800fe610 0x7fe580100ff0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe57000d980 tx=0x7fe57000dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:44.070 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.063+0000 7fe576ffd700 1 -- 172.21.15.96:0/359118408 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe57000de60 con 0x7fe5800fe610 2023-05-08T03:41:44.070 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.063+0000 7fe5881bf700 1 -- 172.21.15.96:0/359118408 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe58010bc80 con 0x7fe5800fe610 2023-05-08T03:41:44.070 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.063+0000 7fe576ffd700 1 -- 172.21.15.96:0/359118408 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe5700044e0 con 0x7fe5800fe610 2023-05-08T03:41:44.070 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.063+0000 7fe576ffd700 1 -- 172.21.15.96:0/359118408 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe570003be0 con 0x7fe5800fe610 2023-05-08T03:41:44.070 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.063+0000 7fe5881bf700 1 -- 172.21.15.96:0/359118408 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe58010baf0 con 0x7fe5800fe610 2023-05-08T03:41:44.075 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.065+0000 7fe576ffd700 1 -- 172.21.15.96:0/359118408 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fe570009bb0 con 0x7fe5800fe610 2023-05-08T03:41:44.075 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.065+0000 7fe576ffd700 1 --2- 172.21.15.96:0/359118408 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fe56c0a11e0 0x7fe56c0a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:44.076 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.066+0000 7fe58575a700 1 --2- 172.21.15.96:0/359118408 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fe56c0a11e0 0x7fe56c0a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:44.076 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.066+0000 7fe576ffd700 1 -- 172.21.15.96:0/359118408 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7fe5700cc730 con 0x7fe5800fe610 2023-05-08T03:41:44.076 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.066+0000 7fe58575a700 1 --2- 172.21.15.96:0/359118408 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fe56c0a11e0 0x7fe56c0a3690 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe57c006010 tx=0x7fe57c00b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:44.076 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.066+0000 7fe59434ab80 1 Processor -- start 2023-05-08T03:41:44.076 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.066+0000 7fe59434ab80 1 -- start start 2023-05-08T03:41:44.076 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.067+0000 7fe59434ab80 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55958ec57340 0x55958ec57750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:44.076 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.067+0000 7fe59434ab80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55958ec57c90 0x55958ec560b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:44.077 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.067+0000 7fe59434ab80 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55958ec56640 0x55958ec56ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:44.077 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.067+0000 7fe59434ab80 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x55958eb5c020 con 0x55958ec56640 2023-05-08T03:41:44.077 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.067+0000 7fe59434ab80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55958ebae960 con 0x55958ec57c90 2023-05-08T03:41:44.077 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.067+0000 7fe59434ab80 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55958eba7df0 con 0x55958ec57340 2023-05-08T03:41:44.077 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.067+0000 7fe58675c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55958ec56640 0x55958ec56ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:44.077 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.067+0000 7fe58675c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55958ec56640 0x55958ec56ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41334/0 (socket says 172.21.15.96:41334) 2023-05-08T03:41:44.077 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.067+0000 7fe58675c700 1 -- 172.21.15.96:0/3720058881 learned_addr learned my addr 172.21.15.96:0/3720058881 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:41:44.077 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.067+0000 7fe58575a700 1 --2- 172.21.15.96:0/3720058881 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55958ec57c90 0x55958ec560b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:44.078 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.067+0000 7fe58675c700 1 -- 172.21.15.96:0/3720058881 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55958ec57340 msgr2=0x55958ec57750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-08T03:41:44.078 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.067+0000 7fe58675c700 1 --2- 172.21.15.96:0/3720058881 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55958ec57340 0x55958ec57750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:44.078 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.067+0000 7fe58675c700 1 -- 172.21.15.96:0/3720058881 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55958ec57c90 msgr2=0x55958ec560b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-08T03:41:44.078 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.067+0000 7fe58675c700 1 --2- 172.21.15.96:0/3720058881 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55958ec57c90 0x55958ec560b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:44.078 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.067+0000 7fe58675c700 1 -- 172.21.15.96:0/3720058881 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55958ea295e0 con 0x55958ec56640 2023-05-08T03:41:44.078 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.067+0000 7fe58575a700 1 --2- 172.21.15.96:0/3720058881 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55958ec57c90 0x55958ec560b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-08T03:41:44.078 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.067+0000 7fe58675c700 1 --2- 172.21.15.96:0/3720058881 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55958ec56640 0x55958ec56ac0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe5780093f0 tx=0x7fe578009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bdf63019e3d654b server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:44.079 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.067+0000 7fe56bfff700 1 -- 172.21.15.96:0/3720058881 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe57800e030 con 0x55958ec56640 2023-05-08T03:41:44.079 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.067+0000 7fe56bfff700 1 -- 172.21.15.96:0/3720058881 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe57800f040 con 0x55958ec56640 2023-05-08T03:41:44.079 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.067+0000 7fe56bfff700 1 -- 172.21.15.96:0/3720058881 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe578015a90 con 0x55958ec56640 2023-05-08T03:41:44.079 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.068+0000 7fe59434ab80 1 -- 172.21.15.96:0/3720058881 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55958ec56640 msgr2=0x55958ec56ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:44.079 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.068+0000 7fe59434ab80 1 --2- 172.21.15.96:0/3720058881 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55958ec56640 0x55958ec56ac0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe5780093f0 tx=0x7fe578009920 comp rx=0 tx=0).stop 2023-05-08T03:41:44.079 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.068+0000 7fe59434ab80 1 -- 172.21.15.96:0/3720058881 shutdown_connections 2023-05-08T03:41:44.079 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.068+0000 7fe59434ab80 1 --2- 172.21.15.96:0/3720058881 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55958ec56640 0x55958ec56ac0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:44.079 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.068+0000 7fe59434ab80 1 --2- 172.21.15.96:0/3720058881 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55958ec57340 0x55958ec57750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:44.080 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.068+0000 7fe59434ab80 1 --2- 172.21.15.96:0/3720058881 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55958ec57c90 0x55958ec560b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:44.080 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.068+0000 7fe59434ab80 1 -- 172.21.15.96:0/3720058881 >> 172.21.15.96:0/3720058881 conn(0x55958ec523e0 msgr2=0x55958ec507b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:44.080 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.068+0000 7fe59434ab80 1 -- 172.21.15.96:0/3720058881 shutdown_connections 2023-05-08T03:41:44.080 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.068+0000 7fe59434ab80 1 -- 172.21.15.96:0/3720058881 wait complete. 2023-05-08T03:41:44.080 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.068+0000 7fe59434ab80 1 -- start start 2023-05-08T03:41:44.080 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.069+0000 7fe59434ab80 1 Processor -- start 2023-05-08T03:41:44.080 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.069+0000 7fe59434ab80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55958ec56640 0x55958ec5fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:44.081 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.069+0000 7fe59434ab80 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55958ec57340 0x55958ec60170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:44.081 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.069+0000 7fe59434ab80 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55958ec57c90 0x55958ec671b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:44.081 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.069+0000 7fe59434ab80 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x55958ea2b8d0 con 0x55958ec57340 2023-05-08T03:41:44.081 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.069+0000 7fe59434ab80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55958ec676f0 con 0x55958ec56640 2023-05-08T03:41:44.081 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.069+0000 7fe59434ab80 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55958ec67880 con 0x55958ec57c90 2023-05-08T03:41:44.081 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.069+0000 7fe59434ab80 10 client.0 _ll_register_callbacks cb 0x55958eb4d4d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-08T03:41:44.081 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.069+0000 7fe58575a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55958ec57340 0x55958ec60170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:44.081 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.069+0000 7fe58575a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55958ec57340 0x55958ec60170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41338/0 (socket says 172.21.15.96:41338) 2023-05-08T03:41:44.082 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.069+0000 7fe58575a700 1 -- 172.21.15.96:0/1109604312 learned_addr learned my addr 172.21.15.96:0/1109604312 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:41:44.082 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.069+0000 7fe585f5b700 1 --2- 172.21.15.96:0/1109604312 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55958ec56640 0x55958ec5fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:44.082 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.069+0000 7fe58675c700 1 --2- 172.21.15.96:0/1109604312 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55958ec57c90 0x55958ec671b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:44.082 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.069+0000 7fe58575a700 1 -- 172.21.15.96:0/1109604312 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55958ec57c90 msgr2=0x55958ec671b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-08T03:41:44.082 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.069+0000 7fe58575a700 1 --2- 172.21.15.96:0/1109604312 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55958ec57c90 0x55958ec671b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:44.082 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.069+0000 7fe58575a700 1 -- 172.21.15.96:0/1109604312 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55958ec56640 msgr2=0x55958ec5fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-08T03:41:44.082 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.069+0000 7fe58575a700 1 --2- 172.21.15.96:0/1109604312 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55958ec56640 0x55958ec5fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:44.083 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.069+0000 7fe58575a700 1 -- 172.21.15.96:0/1109604312 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5780090d0 con 0x55958ec57340 2023-05-08T03:41:44.083 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.069+0000 7fe58675c700 1 --2- 172.21.15.96:0/1109604312 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55958ec57c90 0x55958ec671b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-08T03:41:44.083 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.069+0000 7fe58575a700 1 --2- 172.21.15.96:0/1109604312 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55958ec57340 0x55958ec60170 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fe57c0098e0 tx=0x7fe57c009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33f7f81b69a4830e server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:44.083 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.070+0000 7fe5697fa700 10 client.0 ms_handle_connect on v2:172.21.15.96:3300/0 2023-05-08T03:41:44.083 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.070+0000 7fe5697fa700 1 -- 172.21.15.96:0/1109604312 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe57c004d70 con 0x55958ec57340 2023-05-08T03:41:44.083 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.070+0000 7fe5697fa700 1 -- 172.21.15.96:0/1109604312 <== mon.0 v2:172.21.15.96:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7fe57c00f460 con 0x55958ec57340 2023-05-08T03:41:44.083 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.070+0000 7fe59434ab80 1 -- 172.21.15.96:0/1109604312 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55958eb6a3a0 con 0x55958ec57340 2023-05-08T03:41:44.083 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.070+0000 7fe5697fa700 1 -- 172.21.15.96:0/1109604312 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe57c00f620 con 0x55958ec57340 2023-05-08T03:41:44.084 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.070+0000 7fe59434ab80 10 client.15081 fetch_fsmap learned FSMap version 22 2023-05-08T03:41:44.084 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.070+0000 7fe59434ab80 1 -- 172.21.15.96:0/1109604312 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x55958e9d5d90 con 0x55958ec57340 2023-05-08T03:41:44.084 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.070+0000 7fe5697fa700 1 -- 172.21.15.96:0/1109604312 <== mon.0 v2:172.21.15.96:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55958eb6a3a0 con 0x55958ec57340 2023-05-08T03:41:44.084 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.070+0000 7fe5697fa700 1 -- 172.21.15.96:0/1109604312 <== mon.0 v2:172.21.15.96:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fe57c030700 con 0x55958ec57340 2023-05-08T03:41:44.084 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.070+0000 7fe59434ab80 10 client.15081 fetch_fsmap finished waiting for FSMap version 22 2023-05-08T03:41:44.084 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.070+0000 7fe59434ab80 10 client.15081 resolve_mds: resolved name 'b' to daemon mds.b 2023-05-08T03:41:44.084 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.070+0000 7fe59434ab80 20 client.15081 populate_metadata read hostname 'smithi096' 2023-05-08T03:41:44.085 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.070+0000 7fe59434ab80 1 --2- 172.21.15.96:0/1109604312 >> [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] conn(0x55958ec6b120 0x55958ec6a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:44.085 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.070+0000 7fe59434ab80 4 client.15081 mds_command: new command op to 24494 tid=0[{"prefix": "get_command_descriptions"}] 2023-05-08T03:41:44.085 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.070+0000 7fe59434ab80 1 -- 172.21.15.96:0/1109604312 --> [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55958eb76610 con 0x55958ec6b120 2023-05-08T03:41:44.085 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.070+0000 7fe585f5b700 1 --2- 172.21.15.96:0/1109604312 >> [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] conn(0x55958ec6b120 0x55958ec6a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:44.085 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.071+0000 7fe585f5b700 1 --2- 172.21.15.96:0/1109604312 >> [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] conn(0x55958ec6b120 0x55958ec6a530 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0a4f702fa19b8d8 server_cookie=303b71eedc7cf0dc in_seq=0 out_seq=0 2023-05-08T03:41:44.085 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.071+0000 7fe5697fa700 10 client.15081 ms_handle_connect on v2:172.21.15.133:6838/2246041493 2023-05-08T03:41:44.085 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.072+0000 7fe5697fa700 1 -- 172.21.15.96:0/1109604312 <== mds.0 v2:172.21.15.133:6838/2246041493 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55958eb76610 con 0x55958ec6b120 2023-05-08T03:41:44.085 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.072+0000 7fe5697fa700 10 client.15081 handle_command_reply: tid=0 2023-05-08T03:41:44.086 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.072+0000 7fe59434ab80 1 client.15081 shutdown 2023-05-08T03:41:44.086 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.072+0000 7fe59434ab80 1 -- 172.21.15.96:0/1109604312 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55958ec57340 msgr2=0x55958ec60170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:44.086 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.072+0000 7fe59434ab80 1 --2- 172.21.15.96:0/1109604312 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55958ec57340 0x55958ec60170 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fe57c0098e0 tx=0x7fe57c009ca0 comp rx=0 tx=0).stop 2023-05-08T03:41:44.086 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.072+0000 7fe59434ab80 1 -- 172.21.15.96:0/1109604312 shutdown_connections 2023-05-08T03:41:44.086 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.072+0000 7fe59434ab80 1 --2- 172.21.15.96:0/1109604312 >> [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] conn(0x55958ec6b120 0x55958ec6a530 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:44.086 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.072+0000 7fe59434ab80 1 --2- 172.21.15.96:0/1109604312 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55958ec57c90 0x55958ec671b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:44.086 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.072+0000 7fe5697fa700 0 client.15081 ms_handle_reset on v2:172.21.15.133:6838/2246041493 2023-05-08T03:41:44.087 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.072+0000 7fe59434ab80 1 --2- 172.21.15.96:0/1109604312 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55958ec56640 0x55958ec5fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:44.087 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.072+0000 7fe59434ab80 1 --2- 172.21.15.96:0/1109604312 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55958ec57340 0x55958ec60170 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:44.087 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.072+0000 7fe59434ab80 1 -- 172.21.15.96:0/1109604312 >> 172.21.15.96:0/1109604312 conn(0x55958ec523e0 msgr2=0x55958ec4ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:44.087 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.072+0000 7fe59434ab80 1 -- 172.21.15.96:0/1109604312 shutdown_connections 2023-05-08T03:41:44.087 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.072+0000 7fe59434ab80 1 -- 172.21.15.96:0/1109604312 wait complete. 2023-05-08T03:41:44.087 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.072+0000 7fe59434ab80 20 client.15081 trim_cache size 0 max 16384 2023-05-08T03:41:44.093 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.089+0000 7fe59434ab80 1 Processor -- start 2023-05-08T03:41:44.093 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.089+0000 7fe59434ab80 1 -- start start 2023-05-08T03:41:44.094 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.089+0000 7fe59434ab80 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55958ec56640 0x55958ec560b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:44.094 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.089+0000 7fe59434ab80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55958ec57340 0x55958ec67140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:44.094 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.089+0000 7fe59434ab80 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55958ec57c90 0x55958ec5d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:44.094 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.089+0000 7fe59434ab80 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x55958eb76610 con 0x55958ec57c90 2023-05-08T03:41:44.094 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.089+0000 7fe59434ab80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55958eb6a3a0 con 0x55958ec57340 2023-05-08T03:41:44.094 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.090+0000 7fe59434ab80 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55958eb51730 con 0x55958ec56640 2023-05-08T03:41:44.094 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.090+0000 7fe58675c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55958ec57c90 0x55958ec5d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:44.094 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.090+0000 7fe58675c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55958ec57c90 0x55958ec5d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41348/0 (socket says 172.21.15.96:41348) 2023-05-08T03:41:44.095 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.090+0000 7fe58675c700 1 -- 172.21.15.96:0/261359404 learned_addr learned my addr 172.21.15.96:0/261359404 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:41:44.095 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.090+0000 7fe585f5b700 1 --2- 172.21.15.96:0/261359404 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55958ec56640 0x55958ec560b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:44.095 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.090+0000 7fe58575a700 1 --2- 172.21.15.96:0/261359404 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55958ec57340 0x55958ec67140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:44.095 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.090+0000 7fe58675c700 1 -- 172.21.15.96:0/261359404 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55958ec56640 msgr2=0x55958ec560b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-08T03:41:44.095 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.090+0000 7fe58675c700 1 --2- 172.21.15.96:0/261359404 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55958ec56640 0x55958ec560b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:44.095 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.090+0000 7fe58675c700 1 -- 172.21.15.96:0/261359404 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55958ec57340 msgr2=0x55958ec67140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-08T03:41:44.095 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.090+0000 7fe58675c700 1 --2- 172.21.15.96:0/261359404 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55958ec57340 0x55958ec67140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:44.096 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.090+0000 7fe58675c700 1 -- 172.21.15.96:0/261359404 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55958eb6e140 con 0x55958ec57c90 2023-05-08T03:41:44.096 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.090+0000 7fe58575a700 1 --2- 172.21.15.96:0/261359404 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55958ec57340 0x55958ec67140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-08T03:41:44.096 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.090+0000 7fe58675c700 1 --2- 172.21.15.96:0/261359404 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55958ec57c90 0x55958ec5d9b0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe5780093c0 tx=0x7fe5780095e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe7390cc308457c1 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:44.096 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.090+0000 7fe574ff9700 1 -- 172.21.15.96:0/261359404 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe57800e070 con 0x55958ec57c90 2023-05-08T03:41:44.096 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.090+0000 7fe574ff9700 1 -- 172.21.15.96:0/261359404 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe57800f040 con 0x55958ec57c90 2023-05-08T03:41:44.096 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.090+0000 7fe574ff9700 1 -- 172.21.15.96:0/261359404 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5780156c0 con 0x55958ec57c90 2023-05-08T03:41:44.096 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.091+0000 7fe59434ab80 1 -- 172.21.15.96:0/261359404 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55958ec57c90 msgr2=0x55958ec5d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:44.096 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.091+0000 7fe59434ab80 1 --2- 172.21.15.96:0/261359404 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55958ec57c90 0x55958ec5d9b0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe5780093c0 tx=0x7fe5780095e0 comp rx=0 tx=0).stop 2023-05-08T03:41:44.097 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.091+0000 7fe59434ab80 1 -- 172.21.15.96:0/261359404 shutdown_connections 2023-05-08T03:41:44.097 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.091+0000 7fe59434ab80 1 --2- 172.21.15.96:0/261359404 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55958ec57c90 0x55958ec5d9b0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:44.097 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.091+0000 7fe59434ab80 1 --2- 172.21.15.96:0/261359404 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55958ec56640 0x55958ec560b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:44.097 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.091+0000 7fe59434ab80 1 --2- 172.21.15.96:0/261359404 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55958ec57340 0x55958ec67140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:44.097 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.091+0000 7fe59434ab80 1 -- 172.21.15.96:0/261359404 >> 172.21.15.96:0/261359404 conn(0x55958ec523e0 msgr2=0x55958ec73eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:44.097 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.091+0000 7fe59434ab80 1 -- 172.21.15.96:0/261359404 shutdown_connections 2023-05-08T03:41:44.097 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.091+0000 7fe59434ab80 1 -- 172.21.15.96:0/261359404 wait complete. 2023-05-08T03:41:44.098 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.091+0000 7fe59434ab80 1 -- start start 2023-05-08T03:41:44.100 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.091+0000 7fe59434ab80 1 Processor -- start 2023-05-08T03:41:44.101 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.092+0000 7fe59434ab80 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55958ec56640 0x55958ec620d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:44.101 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.092+0000 7fe59434ab80 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55958ec57340 0x55958ec62610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:44.101 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.092+0000 7fe59434ab80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55958ec57c90 0x55958ecbefe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:44.101 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.092+0000 7fe59434ab80 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x55958ecbf520 con 0x55958ec56640 2023-05-08T03:41:44.101 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.092+0000 7fe59434ab80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55958ecbf660 con 0x55958ec57c90 2023-05-08T03:41:44.101 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.092+0000 7fe59434ab80 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55958ecbf7d0 con 0x55958ec57340 2023-05-08T03:41:44.102 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.092+0000 7fe59434ab80 10 client.0 _ll_register_callbacks cb 0x55958eb4d4d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-08T03:41:44.102 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.092+0000 7fe585f5b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55958ec56640 0x55958ec620d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:44.102 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.092+0000 7fe585f5b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55958ec56640 0x55958ec620d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41350/0 (socket says 172.21.15.96:41350) 2023-05-08T03:41:44.102 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.092+0000 7fe585f5b700 1 -- 172.21.15.96:0/2973793854 learned_addr learned my addr 172.21.15.96:0/2973793854 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:41:44.102 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.092+0000 7fe58675c700 1 --2- 172.21.15.96:0/2973793854 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55958ec57c90 0x55958ecbefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:44.102 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.092+0000 7fe58575a700 1 --2- 172.21.15.96:0/2973793854 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55958ec57340 0x55958ec62610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:44.102 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.092+0000 7fe585f5b700 1 -- 172.21.15.96:0/2973793854 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55958ec57340 msgr2=0x55958ec62610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-08T03:41:44.103 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.092+0000 7fe585f5b700 1 --2- 172.21.15.96:0/2973793854 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55958ec57340 0x55958ec62610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:44.103 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.092+0000 7fe585f5b700 1 -- 172.21.15.96:0/2973793854 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55958ec57c90 msgr2=0x55958ecbefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-08T03:41:44.103 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.092+0000 7fe585f5b700 1 --2- 172.21.15.96:0/2973793854 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55958ec57c90 0x55958ecbefe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:44.103 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.092+0000 7fe585f5b700 1 -- 172.21.15.96:0/2973793854 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55958ea295e0 con 0x55958ec56640 2023-05-08T03:41:44.103 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.092+0000 7fe58575a700 1 --2- 172.21.15.96:0/2973793854 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55958ec57340 0x55958ec62610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-08T03:41:44.103 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.092+0000 7fe585f5b700 1 --2- 172.21.15.96:0/2973793854 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55958ec56640 0x55958ec620d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe570009f60 tx=0x7fe570005da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10bebb9671566b server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:44.103 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.092+0000 7fe5697fa700 10 client.0 ms_handle_connect on v2:172.21.15.96:3300/0 2023-05-08T03:41:44.104 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.092+0000 7fe5697fa700 1 -- 172.21.15.96:0/2973793854 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe57009db10 con 0x55958ec56640 2023-05-08T03:41:44.104 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.092+0000 7fe5697fa700 1 -- 172.21.15.96:0/2973793854 <== mon.0 v2:172.21.15.96:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7fe5700a1f30 con 0x55958ec56640 2023-05-08T03:41:44.104 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.092+0000 7fe59434ab80 1 -- 172.21.15.96:0/2973793854 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55958ec25b70 con 0x55958ec56640 2023-05-08T03:41:44.104 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.092+0000 7fe5697fa700 1 -- 172.21.15.96:0/2973793854 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe570098fd0 con 0x55958ec56640 2023-05-08T03:41:44.104 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.092+0000 7fe59434ab80 10 client.15087 fetch_fsmap learned FSMap version 22 2023-05-08T03:41:44.104 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.092+0000 7fe59434ab80 1 -- 172.21.15.96:0/2973793854 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x55958e9fc200 con 0x55958ec56640 2023-05-08T03:41:44.104 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.093+0000 7fe5697fa700 1 -- 172.21.15.96:0/2973793854 <== mon.0 v2:172.21.15.96:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55958ec25b70 con 0x55958ec56640 2023-05-08T03:41:44.104 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.093+0000 7fe5697fa700 1 -- 172.21.15.96:0/2973793854 <== mon.0 v2:172.21.15.96:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fe570098a40 con 0x55958ec56640 2023-05-08T03:41:44.105 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.093+0000 7fe59434ab80 10 client.15087 fetch_fsmap finished waiting for FSMap version 22 2023-05-08T03:41:44.105 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.093+0000 7fe59434ab80 10 client.15087 resolve_mds: resolved name 'b' to daemon mds.b 2023-05-08T03:41:44.105 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.093+0000 7fe59434ab80 20 client.15087 populate_metadata read hostname 'smithi096' 2023-05-08T03:41:44.105 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.093+0000 7fe59434ab80 1 --2- 172.21.15.96:0/2973793854 >> [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] conn(0x55958ec6b120 0x55958ecc0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:44.105 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.093+0000 7fe59434ab80 4 client.15087 mds_command: new command op to 24494 tid=0[{"prefix": "status"}] 2023-05-08T03:41:44.105 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.093+0000 7fe59434ab80 1 -- 172.21.15.96:0/2973793854 --> [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55958ea2bf10 con 0x55958ec6b120 2023-05-08T03:41:44.105 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.093+0000 7fe58575a700 1 --2- 172.21.15.96:0/2973793854 >> [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] conn(0x55958ec6b120 0x55958ecc0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:44.106 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.093+0000 7fe5697fa700 10 client.15087 ms_handle_connect on v2:172.21.15.133:6838/2246041493 2023-05-08T03:41:44.106 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.093+0000 7fe58575a700 1 --2- 172.21.15.96:0/2973793854 >> [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] conn(0x55958ec6b120 0x55958ecc0d50 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b8882ed5076c5a4 server_cookie=a9f29ffdc803b34a in_seq=0 out_seq=0 2023-05-08T03:41:44.106 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.094+0000 7fe5697fa700 1 -- 172.21.15.96:0/2973793854 <== mds.0 v2:172.21.15.133:6838/2246041493 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x55958ea2bf10 con 0x55958ec6b120 2023-05-08T03:41:44.106 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.094+0000 7fe5697fa700 10 client.15087 handle_command_reply: tid=0 2023-05-08T03:41:44.106 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.094+0000 7fe59434ab80 1 client.15087 shutdown 2023-05-08T03:41:44.106 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.094+0000 7fe59434ab80 1 -- 172.21.15.96:0/2973793854 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55958ec56640 msgr2=0x55958ec620d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:44.106 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.094+0000 7fe59434ab80 1 --2- 172.21.15.96:0/2973793854 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55958ec56640 0x55958ec620d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe570009f60 tx=0x7fe570005da0 comp rx=0 tx=0).stop 2023-05-08T03:41:44.107 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.094+0000 7fe59434ab80 1 -- 172.21.15.96:0/2973793854 shutdown_connections 2023-05-08T03:41:44.107 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.094+0000 7fe59434ab80 1 --2- 172.21.15.96:0/2973793854 >> [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] conn(0x55958ec6b120 0x55958ecc0d50 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:44.107 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.094+0000 7fe59434ab80 1 --2- 172.21.15.96:0/2973793854 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55958ec57c90 0x55958ecbefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:44.107 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.094+0000 7fe59434ab80 1 --2- 172.21.15.96:0/2973793854 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55958ec56640 0x55958ec620d0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:44.107 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.094+0000 7fe5697fa700 0 client.15087 ms_handle_reset on v2:172.21.15.133:6838/2246041493 2023-05-08T03:41:44.107 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.094+0000 7fe59434ab80 1 --2- 172.21.15.96:0/2973793854 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55958ec57340 0x55958ec62610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:44.107 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.094+0000 7fe59434ab80 1 -- 172.21.15.96:0/2973793854 >> 172.21.15.96:0/2973793854 conn(0x55958ec523e0 msgr2=0x55958ec5d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:44.107 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.094+0000 7fe59434ab80 1 -- 172.21.15.96:0/2973793854 shutdown_connections 2023-05-08T03:41:44.108 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.094+0000 7fe59434ab80 1 -- 172.21.15.96:0/2973793854 wait complete. 2023-05-08T03:41:44.108 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.094+0000 7fe59434ab80 20 client.15087 trim_cache size 0 max 16384 2023-05-08T03:41:44.108 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2023-05-08T03:41:44.108 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_fsid": "f7ffcfb0-ed50-11ed-9b01-001a4aab830c", 2023-05-08T03:41:44.109 INFO:teuthology.orchestra.run.smithi096.stdout: "whoami": 0, 2023-05-08T03:41:44.109 INFO:teuthology.orchestra.run.smithi096.stdout: "id": 24494, 2023-05-08T03:41:44.109 INFO:teuthology.orchestra.run.smithi096.stdout: "want_state": "up:active", 2023-05-08T03:41:44.109 INFO:teuthology.orchestra.run.smithi096.stdout: "state": "up:active", 2023-05-08T03:41:44.109 INFO:teuthology.orchestra.run.smithi096.stdout: "fs_name": "cephfs", 2023-05-08T03:41:44.109 INFO:teuthology.orchestra.run.smithi096.stdout: "rank_uptime": 54.882160745, 2023-05-08T03:41:44.109 INFO:teuthology.orchestra.run.smithi096.stdout: "mdsmap_epoch": 22, 2023-05-08T03:41:44.110 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap_epoch": 84, 2023-05-08T03:41:44.110 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap_epoch_barrier": 82, 2023-05-08T03:41:44.110 INFO:teuthology.orchestra.run.smithi096.stdout: "uptime": 59.451165281000002 2023-05-08T03:41:44.110 INFO:teuthology.orchestra.run.smithi096.stdout:} 2023-05-08T03:41:44.111 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.094+0000 7fe5881bf700 1 -- 172.21.15.96:0/359118408 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fe56c0a11e0 msgr2=0x7fe56c0a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:44.111 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.094+0000 7fe5881bf700 1 --2- 172.21.15.96:0/359118408 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fe56c0a11e0 0x7fe56c0a3690 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe57c006010 tx=0x7fe57c00b260 comp rx=0 tx=0).stop 2023-05-08T03:41:44.111 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.094+0000 7fe5881bf700 1 -- 172.21.15.96:0/359118408 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5800fe610 msgr2=0x7fe580100ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:44.112 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.094+0000 7fe5881bf700 1 --2- 172.21.15.96:0/359118408 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5800fe610 0x7fe580100ff0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe57000d980 tx=0x7fe57000dd40 comp rx=0 tx=0).stop 2023-05-08T03:41:44.112 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.094+0000 7fe5881bf700 1 -- 172.21.15.96:0/359118408 shutdown_connections 2023-05-08T03:41:44.112 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.094+0000 7fe5881bf700 1 --2- 172.21.15.96:0/359118408 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fe56c0a11e0 0x7fe56c0a3690 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:44.112 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.094+0000 7fe5881bf700 1 --2- 172.21.15.96:0/359118408 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe580102010 0x7fe5800ffb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:44.112 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.094+0000 7fe5881bf700 1 --2- 172.21.15.96:0/359118408 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5800fe610 0x7fe580100ff0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:44.112 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.094+0000 7fe5881bf700 1 --2- 172.21.15.96:0/359118408 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe580101680 0x7fe5800ff630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:44.112 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.094+0000 7fe5881bf700 1 -- 172.21.15.96:0/359118408 >> 172.21.15.96:0/359118408 conn(0x7fe5800f9fb0 msgr2=0x7fe5800fc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:44.113 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.095+0000 7fe5881bf700 1 -- 172.21.15.96:0/359118408 shutdown_connections 2023-05-08T03:41:44.113 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:44.095+0000 7fe5881bf700 1 -- 172.21.15.96:0/359118408 wait complete. 2023-05-08T03:41:44.113 INFO:tasks.cephadm:Setup complete, yielding 2023-05-08T03:41:44.114 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-05-08T03:41:44.123 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi096.front.sepia.ceph.com 2023-05-08T03:41:44.124 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- bash -c 'ceph orch status' 2023-05-08T03:41:44.125 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:43 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/757888194' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-05-08T03:41:44.125 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:43 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/4023196779' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-05-08T03:41:44.125 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:43 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/1342776819' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-05-08T03:41:44.764 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.a/config 2023-05-08T03:41:44.972 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:44 smithi096 ceph-mon[124666]: pgmap v287: 97 pgs: 2 peering, 95 active+clean; 636 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s; 6 B/s, 1 keys/s, 0 objects/s recovering 2023-05-08T03:41:44.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:44 smithi133 ceph-mon[125939]: pgmap v287: 97 pgs: 2 peering, 95 active+clean; 636 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s; 6 B/s, 1 keys/s, 0 objects/s recovering 2023-05-08T03:41:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:44 smithi186 ceph-mon[126480]: pgmap v287: 97 pgs: 2 peering, 95 active+clean; 636 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s; 6 B/s, 1 keys/s, 0 objects/s recovering 2023-05-08T03:41:45.920 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:45.916+0000 7f65b4bfe700 1 -- 172.21.15.96:0/864351016 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65b0103790 msgr2=0x7f65b0105b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:45.921 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:45.916+0000 7f65b4bfe700 1 --2- 172.21.15.96:0/864351016 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65b0103790 0x7f65b0105b70 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f65a0009990 tx=0x7f65a0009ca0 comp rx=0 tx=0).stop 2023-05-08T03:41:45.921 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:45.916+0000 7f65b4bfe700 1 -- 172.21.15.96:0/864351016 shutdown_connections 2023-05-08T03:41:45.921 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:45.916+0000 7f65b4bfe700 1 --2- 172.21.15.96:0/864351016 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65b01060b0 0x7f65b0108510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:45.921 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:45.916+0000 7f65b4bfe700 1 --2- 172.21.15.96:0/864351016 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f65b0100e70 0x7f65b0103250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:45.921 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:45.916+0000 7f65b4bfe700 1 --2- 172.21.15.96:0/864351016 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65b0103790 0x7f65b0105b70 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:45.922 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:45.916+0000 7f65b4bfe700 1 -- 172.21.15.96:0/864351016 >> 172.21.15.96:0/864351016 conn(0x7f65b00fa8f0 msgr2=0x7f65b00fcd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:45.922 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:45.916+0000 7f65b4bfe700 1 -- 172.21.15.96:0/864351016 shutdown_connections 2023-05-08T03:41:45.922 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:45.916+0000 7f65b4bfe700 1 -- 172.21.15.96:0/864351016 wait complete. 2023-05-08T03:41:45.922 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:45.917+0000 7f65b4bfe700 1 Processor -- start 2023-05-08T03:41:45.922 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:45.917+0000 7f65b4bfe700 1 -- start start 2023-05-08T03:41:45.922 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:45.917+0000 7f65b4bfe700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f65b0100e70 0x7f65b01007d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:45.923 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:45.917+0000 7f65b4bfe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65b0103790 0x7f65b00fee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:45.923 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:45.917+0000 7f65b4bfe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65b01060b0 0x7f65b00ff360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:45.923 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:45.917+0000 7f65b4bfe700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65b00ffae0 con 0x7f65b0103790 2023-05-08T03:41:45.923 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:45.917+0000 7f65b4bfe700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65b00ffc50 con 0x7f65b01060b0 2023-05-08T03:41:45.923 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:45.917+0000 7f65b4bfe700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65b01a0150 con 0x7f65b0100e70 2023-05-08T03:41:45.923 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:45.917+0000 7f65add9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65b0103790 0x7f65b00fee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:45.924 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:45.918+0000 7f65add9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65b0103790 0x7f65b00fee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41364/0 (socket says 172.21.15.96:41364) 2023-05-08T03:41:45.924 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:45.918+0000 7f65add9b700 1 -- 172.21.15.96:0/2959728751 learned_addr learned my addr 172.21.15.96:0/2959728751 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:41:45.924 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:45.918+0000 7f65aed9d700 1 --2- 172.21.15.96:0/2959728751 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65b01060b0 0x7f65b00ff360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:45.924 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:45.918+0000 7f65ae59c700 1 --2- 172.21.15.96:0/2959728751 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f65b0100e70 0x7f65b01007d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:45.924 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:45.918+0000 7f65add9b700 1 -- 172.21.15.96:0/2959728751 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f65b0100e70 msgr2=0x7f65b01007d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:45.924 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:45.918+0000 7f65add9b700 1 --2- 172.21.15.96:0/2959728751 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f65b0100e70 0x7f65b01007d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:45.925 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:45.918+0000 7f65add9b700 1 -- 172.21.15.96:0/2959728751 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65b01060b0 msgr2=0x7f65b00ff360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:45.925 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:45.918+0000 7f65add9b700 1 --2- 172.21.15.96:0/2959728751 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65b01060b0 0x7f65b00ff360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:45.925 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:45.918+0000 7f65add9b700 1 -- 172.21.15.96:0/2959728751 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65a00095f0 con 0x7f65b0103790 2023-05-08T03:41:45.925 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:45.918+0000 7f65ae59c700 1 --2- 172.21.15.96:0/2959728751 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f65b0100e70 0x7f65b01007d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-08T03:41:45.925 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:45.918+0000 7f65add9b700 1 --2- 172.21.15.96:0/2959728751 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65b0103790 0x7f65b00fee20 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f65a0000c00 tx=0x7f65a000f780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:45.925 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:45.918+0000 7f659f7fe700 1 -- 172.21.15.96:0/2959728751 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a001d070 con 0x7f65b0103790 2023-05-08T03:41:45.925 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:45.918+0000 7f65b4bfe700 1 -- 172.21.15.96:0/2959728751 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65b010bdb0 con 0x7f65b0103790 2023-05-08T03:41:45.926 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:45.918+0000 7f659f7fe700 1 -- 172.21.15.96:0/2959728751 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f65a000fc30 con 0x7f65b0103790 2023-05-08T03:41:45.927 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:45.918+0000 7f659f7fe700 1 -- 172.21.15.96:0/2959728751 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a0017650 con 0x7f65b0103790 2023-05-08T03:41:45.927 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:45.918+0000 7f65b4bfe700 1 -- 172.21.15.96:0/2959728751 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65b010bc20 con 0x7f65b0103790 2023-05-08T03:41:45.927 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:45.919+0000 7f65b4bfe700 1 -- 172.21.15.96:0/2959728751 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65b00fc460 con 0x7f65b0103790 2023-05-08T03:41:45.927 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:45.920+0000 7f659f7fe700 1 -- 172.21.15.96:0/2959728751 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f65a0022470 con 0x7f65b0103790 2023-05-08T03:41:45.927 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:45.921+0000 7f659f7fe700 1 --2- 172.21.15.96:0/2959728751 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f65980a1260 0x7f65980a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:45.927 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:45.921+0000 7f65ae59c700 1 --2- 172.21.15.96:0/2959728751 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f65980a1260 0x7f65980a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:45.928 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:45.921+0000 7f659f7fe700 1 -- 172.21.15.96:0/2959728751 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f65a00cdda0 con 0x7f65b0103790 2023-05-08T03:41:45.928 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:45.921+0000 7f65ae59c700 1 --2- 172.21.15.96:0/2959728751 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f65980a1260 0x7f65980a3710 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f65a4005950 tx=0x7f65a4005f50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:45.928 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:45.925+0000 7f659f7fe700 1 -- 172.21.15.96:0/2959728751 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f65a005c730 con 0x7f65b0103790 2023-05-08T03:41:46.131 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:46.129+0000 7f65b4bfe700 1 -- 172.21.15.96:0/2959728751 --> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f65b0061cf0 con 0x7f65980a1260 2023-05-08T03:41:46.132 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:46.130+0000 7f659f7fe700 1 -- 172.21.15.96:0/2959728751 <== mgr.14152 v2:172.21.15.96:6800/2748629182 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f65b0061cf0 con 0x7f65980a1260 2023-05-08T03:41:46.133 INFO:teuthology.orchestra.run.smithi096.stdout:Backend: cephadm 2023-05-08T03:41:46.133 INFO:teuthology.orchestra.run.smithi096.stdout:Available: Yes 2023-05-08T03:41:46.133 INFO:teuthology.orchestra.run.smithi096.stdout:Paused: No 2023-05-08T03:41:46.134 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:46.132+0000 7f65b4bfe700 1 -- 172.21.15.96:0/2959728751 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f65980a1260 msgr2=0x7f65980a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:46.134 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:46.132+0000 7f65b4bfe700 1 --2- 172.21.15.96:0/2959728751 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f65980a1260 0x7f65980a3710 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f65a4005950 tx=0x7f65a4005f50 comp rx=0 tx=0).stop 2023-05-08T03:41:46.135 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:46.132+0000 7f65b4bfe700 1 -- 172.21.15.96:0/2959728751 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65b0103790 msgr2=0x7f65b00fee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:46.135 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:46.132+0000 7f65b4bfe700 1 --2- 172.21.15.96:0/2959728751 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65b0103790 0x7f65b00fee20 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f65a0000c00 tx=0x7f65a000f780 comp rx=0 tx=0).stop 2023-05-08T03:41:46.135 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:46.132+0000 7f65b4bfe700 1 -- 172.21.15.96:0/2959728751 shutdown_connections 2023-05-08T03:41:46.135 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:46.132+0000 7f65b4bfe700 1 --2- 172.21.15.96:0/2959728751 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f65980a1260 0x7f65980a3710 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:46.135 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:46.132+0000 7f65b4bfe700 1 --2- 172.21.15.96:0/2959728751 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65b01060b0 0x7f65b00ff360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:46.135 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:46.132+0000 7f65b4bfe700 1 --2- 172.21.15.96:0/2959728751 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f65b0100e70 0x7f65b01007d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:46.135 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:46.132+0000 7f65b4bfe700 1 --2- 172.21.15.96:0/2959728751 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65b0103790 0x7f65b00fee20 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:46.136 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:46.132+0000 7f65b4bfe700 1 -- 172.21.15.96:0/2959728751 >> 172.21.15.96:0/2959728751 conn(0x7f65b00fa8f0 msgr2=0x7f65b0101ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:46.136 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:46.132+0000 7f65b4bfe700 1 -- 172.21.15.96:0/2959728751 shutdown_connections 2023-05-08T03:41:46.136 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:46.132+0000 7f65b4bfe700 1 -- 172.21.15.96:0/2959728751 wait complete. 2023-05-08T03:41:46.507 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- bash -c 'ceph orch ps' 2023-05-08T03:41:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:46 smithi096 ceph-mon[124666]: pgmap v288: 97 pgs: 97 active+clean; 636 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s; 6 B/s, 1 keys/s, 0 objects/s recovering 2023-05-08T03:41:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:46 smithi133 ceph-mon[125939]: pgmap v288: 97 pgs: 97 active+clean; 636 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s; 6 B/s, 1 keys/s, 0 objects/s recovering 2023-05-08T03:41:47.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:46 smithi186 ceph-mon[126480]: pgmap v288: 97 pgs: 97 active+clean; 636 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s; 6 B/s, 1 keys/s, 0 objects/s recovering 2023-05-08T03:41:47.149 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.a/config 2023-05-08T03:41:47.973 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:47 smithi096 ceph-mon[124666]: from='client.15093 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:41:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:47 smithi133 ceph-mon[125939]: from='client.15093 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:41:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:47 smithi186 ceph-mon[126480]: from='client.15093 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:41:48.392 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:48.389+0000 7f735ca74700 1 -- 172.21.15.96:0/4141079185 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7358101610 msgr2=0x7f7358101a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:48.392 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:48.389+0000 7f735ca74700 1 --2- 172.21.15.96:0/4141079185 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7358101610 0x7f7358101a60 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f7348009990 tx=0x7f7348009ca0 comp rx=0 tx=0).stop 2023-05-08T03:41:48.392 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:48.389+0000 7f735ca74700 1 -- 172.21.15.96:0/4141079185 shutdown_connections 2023-05-08T03:41:48.392 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:48.389+0000 7f735ca74700 1 --2- 172.21.15.96:0/4141079185 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7358101fa0 0x7f7358108860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:48.393 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:48.389+0000 7f735ca74700 1 --2- 172.21.15.96:0/4141079185 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7358100410 0x7f7358100820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:48.393 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:48.389+0000 7f735ca74700 1 --2- 172.21.15.96:0/4141079185 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7358101610 0x7f7358101a60 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:48.393 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:48.389+0000 7f735ca74700 1 -- 172.21.15.96:0/4141079185 >> 172.21.15.96:0/4141079185 conn(0x7f73580fba60 msgr2=0x7f73580fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:48.393 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:48.389+0000 7f735ca74700 1 -- 172.21.15.96:0/4141079185 shutdown_connections 2023-05-08T03:41:48.393 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:48.389+0000 7f735ca74700 1 -- 172.21.15.96:0/4141079185 wait complete. 2023-05-08T03:41:48.395 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:48.390+0000 7f735ca74700 1 Processor -- start 2023-05-08T03:41:48.395 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:48.390+0000 7f735ca74700 1 -- start start 2023-05-08T03:41:48.395 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:48.390+0000 7f735ca74700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7358100410 0x7f7358196140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:48.395 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:48.390+0000 7f735ca74700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7358101610 0x7f7358196680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:48.395 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:48.390+0000 7f735ca74700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7358101fa0 0x7f735819d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:48.395 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:48.390+0000 7f735ca74700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f735819dcd0 con 0x7f7358100410 2023-05-08T03:41:48.396 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:48.390+0000 7f735ca74700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f735819de10 con 0x7f7358101fa0 2023-05-08T03:41:48.396 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:48.390+0000 7f735ca74700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f735819dfa0 con 0x7f7358101610 2023-05-08T03:41:48.396 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:48.390+0000 7f735659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7358100410 0x7f7358196140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:48.396 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:48.390+0000 7f735659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7358100410 0x7f7358196140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41374/0 (socket says 172.21.15.96:41374) 2023-05-08T03:41:48.396 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:48.390+0000 7f735659c700 1 -- 172.21.15.96:0/3329146505 learned_addr learned my addr 172.21.15.96:0/3329146505 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:41:48.396 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:48.390+0000 7f7356d9d700 1 --2- 172.21.15.96:0/3329146505 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7358101fa0 0x7f735819d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:48.396 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:48.390+0000 7f7355d9b700 1 --2- 172.21.15.96:0/3329146505 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7358101610 0x7f7358196680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:48.397 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:48.390+0000 7f735659c700 1 -- 172.21.15.96:0/3329146505 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7358101610 msgr2=0x7f7358196680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:48.397 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:48.390+0000 7f735659c700 1 --2- 172.21.15.96:0/3329146505 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7358101610 0x7f7358196680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:48.397 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:48.390+0000 7f735659c700 1 -- 172.21.15.96:0/3329146505 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7358101fa0 msgr2=0x7f735819d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:48.397 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:48.390+0000 7f735659c700 1 --2- 172.21.15.96:0/3329146505 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7358101fa0 0x7f735819d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:48.397 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:48.390+0000 7f735659c700 1 -- 172.21.15.96:0/3329146505 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73480095f0 con 0x7f7358100410 2023-05-08T03:41:48.397 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:48.390+0000 7f7355d9b700 1 --2- 172.21.15.96:0/3329146505 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7358101610 0x7f7358196680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-08T03:41:48.397 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:48.391+0000 7f735659c700 1 --2- 172.21.15.96:0/3329146505 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7358100410 0x7f7358196140 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f734c00d9b0 tx=0x7f734c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:48.397 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:48.391+0000 7f73477fe700 1 -- 172.21.15.96:0/3329146505 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f734c004020 con 0x7f7358100410 2023-05-08T03:41:48.398 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:48.391+0000 7f735ca74700 1 -- 172.21.15.96:0/3329146505 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f735810bde0 con 0x7f7358100410 2023-05-08T03:41:48.398 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:48.391+0000 7f73477fe700 1 -- 172.21.15.96:0/3329146505 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f734c009730 con 0x7f7358100410 2023-05-08T03:41:48.398 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:48.391+0000 7f73477fe700 1 -- 172.21.15.96:0/3329146505 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f734c003a40 con 0x7f7358100410 2023-05-08T03:41:48.398 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:48.391+0000 7f735ca74700 1 -- 172.21.15.96:0/3329146505 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f735810bc50 con 0x7f7358100410 2023-05-08T03:41:48.398 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:48.392+0000 7f735ca74700 1 -- 172.21.15.96:0/3329146505 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7358107960 con 0x7f7358100410 2023-05-08T03:41:48.399 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:48.393+0000 7f73477fe700 1 -- 172.21.15.96:0/3329146505 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f734c0098a0 con 0x7f7358100410 2023-05-08T03:41:48.399 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:48.393+0000 7f73477fe700 1 --2- 172.21.15.96:0/3329146505 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f73400a11e0 0x7f73400a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:48.399 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:48.393+0000 7f7355d9b700 1 --2- 172.21.15.96:0/3329146505 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f73400a11e0 0x7f73400a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:48.399 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:48.393+0000 7f73477fe700 1 -- 172.21.15.96:0/3329146505 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f734c0cc9d0 con 0x7f7358100410 2023-05-08T03:41:48.399 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:48.394+0000 7f7355d9b700 1 --2- 172.21.15.96:0/3329146505 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f73400a11e0 0x7f73400a3690 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7348006010 tx=0x7f734800b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:48.400 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:48.397+0000 7f73477fe700 1 -- 172.21.15.96:0/3329146505 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f734c0960c0 con 0x7f7358100410 2023-05-08T03:41:48.596 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:48.593+0000 7f735ca74700 1 -- 172.21.15.96:0/3329146505 --> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7358061ac0 con 0x7f73400a11e0 2023-05-08T03:41:48.609 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:48.606+0000 7f73477fe700 1 -- 172.21.15.96:0/3329146505 <== mgr.14152 v2:172.21.15.96:6800/2748629182 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+4185 (secure 0 0 0) 0x7f7358061ac0 con 0x7f73400a11e0 2023-05-08T03:41:48.610 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-05-08T03:41:48.610 INFO:teuthology.orchestra.run.smithi096.stdout:mds.a smithi096 running (66s) 57s ago 66s 14.1M - 18.0.0-3786-g4b086ba5 1e3affc0cf31 547b3816cace 2023-05-08T03:41:48.610 INFO:teuthology.orchestra.run.smithi096.stdout:mds.b smithi133 running (64s) 57s ago 63s 14.3M - 18.0.0-3786-g4b086ba5 1e3affc0cf31 501feffaa54f 2023-05-08T03:41:48.610 INFO:teuthology.orchestra.run.smithi096.stdout:mds.c smithi186 running (75s) 57s ago 75s 13.5M - 18.0.0-3786-g4b086ba5 1e3affc0cf31 82354bf1287f 2023-05-08T03:41:48.611 INFO:teuthology.orchestra.run.smithi096.stdout:mds.d smithi096 running (82s) 57s ago 81s 14.4M - 18.0.0-3786-g4b086ba5 1e3affc0cf31 f49b1cb1e8af 2023-05-08T03:41:48.611 INFO:teuthology.orchestra.run.smithi096.stdout:mds.e smithi133 running (79s) 57s ago 79s 13.3M - 18.0.0-3786-g4b086ba5 1e3affc0cf31 f9fb01908ffd 2023-05-08T03:41:48.611 INFO:teuthology.orchestra.run.smithi096.stdout:mds.f smithi186 running (77s) 57s ago 77s 16.6M - 18.0.0-3786-g4b086ba5 1e3affc0cf31 be2ffb8f0c1b 2023-05-08T03:41:48.611 INFO:teuthology.orchestra.run.smithi096.stdout:mds.g smithi096 running (68s) 57s ago 68s 15.7M - 18.0.0-3786-g4b086ba5 1e3affc0cf31 1f2146b28796 2023-05-08T03:41:48.611 INFO:teuthology.orchestra.run.smithi096.stdout:mds.h smithi133 running (73s) 57s ago 73s 15.8M - 18.0.0-3786-g4b086ba5 1e3affc0cf31 8e86612776f8 2023-05-08T03:41:48.611 INFO:teuthology.orchestra.run.smithi096.stdout:mds.i smithi186 running (71s) 57s ago 70s 14.3M - 18.0.0-3786-g4b086ba5 1e3affc0cf31 86fac25f3c2e 2023-05-08T03:41:48.611 INFO:teuthology.orchestra.run.smithi096.stdout:mds.j smithi096 running (84s) 57s ago 83s 16.5M - 18.0.0-3786-g4b086ba5 1e3affc0cf31 83972b89b2fd 2023-05-08T03:41:48.612 INFO:teuthology.orchestra.run.smithi096.stdout:mds.k smithi133 running (86s) 57s ago 86s 14.4M - 18.0.0-3786-g4b086ba5 1e3affc0cf31 cc953c2f5957 2023-05-08T03:41:48.612 INFO:teuthology.orchestra.run.smithi096.stdout:mds.l smithi186 running (88s) 57s ago 88s 14.4M - 18.0.0-3786-g4b086ba5 1e3affc0cf31 5e63bd912e19 2023-05-08T03:41:48.612 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.x smithi096 *:9283,8765 running (7m) 57s ago 7m 510M - 18.0.0-3786-g4b086ba5 1e3affc0cf31 4112088fd9c9 2023-05-08T03:41:48.612 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.y smithi133 *:8443,8765 running (6m) 57s ago 6m 446M - 18.0.0-3786-g4b086ba5 1e3affc0cf31 3f3bf16a2638 2023-05-08T03:41:48.612 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.z smithi186 *:8443,8765 running (6m) 57s ago 6m 444M - 18.0.0-3786-g4b086ba5 1e3affc0cf31 adce1a0a92ee 2023-05-08T03:41:48.612 INFO:teuthology.orchestra.run.smithi096.stdout:mon.a smithi096 running (8m) 57s ago 8m 86.1M 2048M 18.0.0-3786-g4b086ba5 1e3affc0cf31 73cca45fb926 2023-05-08T03:41:48.612 INFO:teuthology.orchestra.run.smithi096.stdout:mon.b smithi133 running (6m) 57s ago 6m 56.5M 2048M 18.0.0-3786-g4b086ba5 1e3affc0cf31 be402a26a63f 2023-05-08T03:41:48.612 INFO:teuthology.orchestra.run.smithi096.stdout:mon.c smithi186 running (6m) 57s ago 6m 61.7M 2048M 18.0.0-3786-g4b086ba5 1e3affc0cf31 b450874c0cef 2023-05-08T03:41:48.613 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (5m) 57s ago 5m 57.2M 4292M 18.0.0-3786-g4b086ba5 1e3affc0cf31 c687098aa8ef 2023-05-08T03:41:48.613 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi133 running (5m) 57s ago 5m 61.5M 4292M 18.0.0-3786-g4b086ba5 1e3affc0cf31 2eb80e4b96b7 2023-05-08T03:41:48.613 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi186 running (5m) 57s ago 5m 59.9M 4292M 18.0.0-3786-g4b086ba5 1e3affc0cf31 4af732f0e0b6 2023-05-08T03:41:48.613 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi096 running (4m) 57s ago 4m 53.9M 4292M 18.0.0-3786-g4b086ba5 1e3affc0cf31 3bf831a954cd 2023-05-08T03:41:48.613 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi133 running (4m) 57s ago 4m 50.6M 4292M 18.0.0-3786-g4b086ba5 1e3affc0cf31 5bcb4047e64b 2023-05-08T03:41:48.613 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi186 running (4m) 57s ago 4m 55.2M 4292M 18.0.0-3786-g4b086ba5 1e3affc0cf31 c4505ca88c74 2023-05-08T03:41:48.613 INFO:teuthology.orchestra.run.smithi096.stdout:osd.6 smithi096 running (3m) 57s ago 3m 49.8M 4292M 18.0.0-3786-g4b086ba5 1e3affc0cf31 e468dfdb8e32 2023-05-08T03:41:48.613 INFO:teuthology.orchestra.run.smithi096.stdout:osd.7 smithi133 running (3m) 57s ago 3m 59.7M 4292M 18.0.0-3786-g4b086ba5 1e3affc0cf31 87842c8f0245 2023-05-08T03:41:48.614 INFO:teuthology.orchestra.run.smithi096.stdout:osd.8 smithi186 running (2m) 57s ago 2m 54.8M 4292M 18.0.0-3786-g4b086ba5 1e3affc0cf31 204c4038438a 2023-05-08T03:41:48.614 INFO:teuthology.orchestra.run.smithi096.stdout:osd.9 smithi096 running (2m) 57s ago 2m 48.5M 4292M 18.0.0-3786-g4b086ba5 1e3affc0cf31 92f122cab245 2023-05-08T03:41:48.614 INFO:teuthology.orchestra.run.smithi096.stdout:osd.10 smithi133 running (2m) 57s ago 2m 51.0M 4292M 18.0.0-3786-g4b086ba5 1e3affc0cf31 86e1f78623e4 2023-05-08T03:41:48.614 INFO:teuthology.orchestra.run.smithi096.stdout:osd.11 smithi186 running (108s) 57s ago 108s 45.8M 4292M 18.0.0-3786-g4b086ba5 1e3affc0cf31 c86fc0e450e6 2023-05-08T03:41:48.615 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:48.608+0000 7f735ca74700 1 -- 172.21.15.96:0/3329146505 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f73400a11e0 msgr2=0x7f73400a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:48.615 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:48.608+0000 7f735ca74700 1 --2- 172.21.15.96:0/3329146505 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f73400a11e0 0x7f73400a3690 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7348006010 tx=0x7f734800b540 comp rx=0 tx=0).stop 2023-05-08T03:41:48.615 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:48.608+0000 7f735ca74700 1 -- 172.21.15.96:0/3329146505 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7358100410 msgr2=0x7f7358196140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:48.615 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:48.608+0000 7f735ca74700 1 --2- 172.21.15.96:0/3329146505 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7358100410 0x7f7358196140 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f734c00d9b0 tx=0x7f734c00dcc0 comp rx=0 tx=0).stop 2023-05-08T03:41:48.615 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:48.608+0000 7f735ca74700 1 -- 172.21.15.96:0/3329146505 shutdown_connections 2023-05-08T03:41:48.615 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:48.608+0000 7f735ca74700 1 --2- 172.21.15.96:0/3329146505 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f73400a11e0 0x7f73400a3690 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:48.616 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:48.608+0000 7f735ca74700 1 --2- 172.21.15.96:0/3329146505 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7358101fa0 0x7f735819d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:48.616 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:48.609+0000 7f735ca74700 1 --2- 172.21.15.96:0/3329146505 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7358100410 0x7f7358196140 secure :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f734c00d9b0 tx=0x7f734c00dcc0 comp rx=0 tx=0).stop 2023-05-08T03:41:48.616 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:48.609+0000 7f735ca74700 1 --2- 172.21.15.96:0/3329146505 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7358101610 0x7f7358196680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:48.616 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:48.609+0000 7f735ca74700 1 -- 172.21.15.96:0/3329146505 >> 172.21.15.96:0/3329146505 conn(0x7f73580fba60 msgr2=0x7f7358104aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:48.617 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:48.609+0000 7f735ca74700 1 -- 172.21.15.96:0/3329146505 shutdown_connections 2023-05-08T03:41:48.617 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:48.609+0000 7f735ca74700 1 -- 172.21.15.96:0/3329146505 wait complete. 2023-05-08T03:41:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:48 smithi133 ceph-mon[125939]: pgmap v289: 97 pgs: 97 active+clean; 636 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s; 6 B/s, 1 keys/s, 0 objects/s recovering 2023-05-08T03:41:48.990 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:48 smithi096 ceph-mon[124666]: pgmap v289: 97 pgs: 97 active+clean; 636 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s; 6 B/s, 1 keys/s, 0 objects/s recovering 2023-05-08T03:41:48.991 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- bash -c 'ceph orch ls' 2023-05-08T03:41:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:48 smithi186 ceph-mon[126480]: pgmap v289: 97 pgs: 97 active+clean; 636 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s; 6 B/s, 1 keys/s, 0 objects/s recovering 2023-05-08T03:41:49.638 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.a/config 2023-05-08T03:41:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:49 smithi133 ceph-mon[125939]: from='client.15099 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:41:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:49 smithi096 ceph-mon[124666]: from='client.15099 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:41:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:49 smithi186 ceph-mon[126480]: from='client.15099 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:41:50.850 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:50.846+0000 7f31e091c700 1 -- 172.21.15.96:0/1978638634 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f31dc101fa0 msgr2=0x7f31dc108860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:50.851 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:50.846+0000 7f31e091c700 1 --2- 172.21.15.96:0/1978638634 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f31dc101fa0 0x7f31dc108860 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f31d400b0a0 tx=0x7f31d400b3b0 comp rx=0 tx=0).stop 2023-05-08T03:41:50.851 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:50.846+0000 7f31e091c700 1 -- 172.21.15.96:0/1978638634 shutdown_connections 2023-05-08T03:41:50.851 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:50.846+0000 7f31e091c700 1 --2- 172.21.15.96:0/1978638634 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f31dc101fa0 0x7f31dc108860 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:50.851 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:50.846+0000 7f31e091c700 1 --2- 172.21.15.96:0/1978638634 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31dc100410 0x7f31dc100820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:50.851 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:50.846+0000 7f31e091c700 1 --2- 172.21.15.96:0/1978638634 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f31dc101610 0x7f31dc101a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:50.851 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:50.846+0000 7f31e091c700 1 -- 172.21.15.96:0/1978638634 >> 172.21.15.96:0/1978638634 conn(0x7f31dc0fba60 msgr2=0x7f31dc0fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:50.852 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:50.846+0000 7f31e091c700 1 -- 172.21.15.96:0/1978638634 shutdown_connections 2023-05-08T03:41:50.852 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:50.846+0000 7f31e091c700 1 -- 172.21.15.96:0/1978638634 wait complete. 2023-05-08T03:41:50.852 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:50.847+0000 7f31e091c700 1 Processor -- start 2023-05-08T03:41:50.852 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:50.847+0000 7f31e091c700 1 -- start start 2023-05-08T03:41:50.852 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:50.847+0000 7f31e091c700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f31dc100410 0x7f31dc196270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:50.852 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:50.847+0000 7f31e091c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f31dc101610 0x7f31dc1967b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:50.852 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:50.847+0000 7f31e091c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31dc101fa0 0x7f31dc19d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:50.853 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:50.847+0000 7f31e091c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31dc19de00 con 0x7f31dc101610 2023-05-08T03:41:50.853 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:50.847+0000 7f31e091c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31dc19df40 con 0x7f31dc101fa0 2023-05-08T03:41:50.853 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:50.847+0000 7f31e091c700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31dc19e0d0 con 0x7f31dc100410 2023-05-08T03:41:50.853 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:50.847+0000 7f31d9d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f31dc101610 0x7f31dc1967b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:50.853 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:50.847+0000 7f31d9d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f31dc101610 0x7f31dc1967b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41390/0 (socket says 172.21.15.96:41390) 2023-05-08T03:41:50.853 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:50.847+0000 7f31d9d9b700 1 -- 172.21.15.96:0/466069652 learned_addr learned my addr 172.21.15.96:0/466069652 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:41:50.853 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:50.847+0000 7f31dad9d700 1 --2- 172.21.15.96:0/466069652 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31dc101fa0 0x7f31dc19d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:50.854 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:50.847+0000 7f31da59c700 1 --2- 172.21.15.96:0/466069652 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f31dc100410 0x7f31dc196270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:50.854 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:50.848+0000 7f31d9d9b700 1 -- 172.21.15.96:0/466069652 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f31dc100410 msgr2=0x7f31dc196270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:50.854 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:50.848+0000 7f31d9d9b700 1 --2- 172.21.15.96:0/466069652 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f31dc100410 0x7f31dc196270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:50.854 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:50.848+0000 7f31d9d9b700 1 -- 172.21.15.96:0/466069652 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31dc101fa0 msgr2=0x7f31dc19d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:50.854 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:50.848+0000 7f31d9d9b700 1 --2- 172.21.15.96:0/466069652 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31dc101fa0 0x7f31dc19d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:50.854 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:50.848+0000 7f31d9d9b700 1 -- 172.21.15.96:0/466069652 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31d4009d00 con 0x7f31dc101610 2023-05-08T03:41:50.854 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:50.848+0000 7f31da59c700 1 --2- 172.21.15.96:0/466069652 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f31dc100410 0x7f31dc196270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-08T03:41:50.854 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:50.848+0000 7f31d9d9b700 1 --2- 172.21.15.96:0/466069652 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f31dc101610 0x7f31dc1967b0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f31c400b560 tx=0x7f31c400b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:50.855 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:50.848+0000 7f31d37fe700 1 -- 172.21.15.96:0/466069652 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c4011830 con 0x7f31dc101610 2023-05-08T03:41:50.855 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:50.848+0000 7f31e091c700 1 -- 172.21.15.96:0/466069652 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31dc10bde0 con 0x7f31dc101610 2023-05-08T03:41:50.855 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:50.848+0000 7f31d37fe700 1 -- 172.21.15.96:0/466069652 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f31c4011e50 con 0x7f31dc101610 2023-05-08T03:41:50.855 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:50.848+0000 7f31d37fe700 1 -- 172.21.15.96:0/466069652 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c400f2e0 con 0x7f31dc101610 2023-05-08T03:41:50.855 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:50.848+0000 7f31e091c700 1 -- 172.21.15.96:0/466069652 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31dc10bc50 con 0x7f31dc101610 2023-05-08T03:41:50.856 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:50.849+0000 7f31e091c700 1 -- 172.21.15.96:0/466069652 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31dc107910 con 0x7f31dc101610 2023-05-08T03:41:50.856 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:50.850+0000 7f31d37fe700 1 -- 172.21.15.96:0/466069652 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f31c4010580 con 0x7f31dc101610 2023-05-08T03:41:50.856 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:50.851+0000 7f31d37fe700 1 --2- 172.21.15.96:0/466069652 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f31c80a11e0 0x7f31c80a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:50.857 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:50.851+0000 7f31da59c700 1 --2- 172.21.15.96:0/466069652 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f31c80a11e0 0x7f31c80a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:50.857 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:50.851+0000 7f31d37fe700 1 -- 172.21.15.96:0/466069652 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f31c40cc310 con 0x7f31dc101610 2023-05-08T03:41:50.857 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:50.851+0000 7f31da59c700 1 --2- 172.21.15.96:0/466069652 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f31c80a11e0 0x7f31c80a3690 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f31cc005950 tx=0x7f31cc0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:50.858 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:50.856+0000 7f31d37fe700 1 -- 172.21.15.96:0/466069652 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f31c4095b10 con 0x7f31dc101610 2023-05-08T03:41:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:50 smithi133 ceph-mon[125939]: pgmap v290: 97 pgs: 97 active+clean; 636 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s; 5 B/s, 0 keys/s, 0 objects/s recovering 2023-05-08T03:41:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:50 smithi096 ceph-mon[124666]: pgmap v290: 97 pgs: 97 active+clean; 636 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s; 5 B/s, 0 keys/s, 0 objects/s recovering 2023-05-08T03:41:51.052 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:51.049+0000 7f31e091c700 1 -- 172.21.15.96:0/466069652 --> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f31dc061d10 con 0x7f31c80a11e0 2023-05-08T03:41:51.057 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:51.055+0000 7f31d37fe700 1 -- 172.21.15.96:0/466069652 <== mgr.14152 v2:172.21.15.96:6800/2748629182 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+980 (secure 0 0 0) 0x7f31dc061d10 con 0x7f31c80a11e0 2023-05-08T03:41:51.058 INFO:teuthology.orchestra.run.smithi096.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2023-05-08T03:41:51.058 INFO:teuthology.orchestra.run.smithi096.stdout:mds.all 12/12 59s ago 93s smithi096=a;smithi096=d;smithi096=g;smithi096=j;smithi133=b;smithi133=e;smithi133=h;smithi133=k;smithi186=c;smithi186=f;smithi186=i;smithi186=l;count:12 2023-05-08T03:41:51.058 INFO:teuthology.orchestra.run.smithi096.stdout:mgr 3/3 59s ago 6m smithi096=x;smithi133=y;smithi186=z;count:3 2023-05-08T03:41:51.058 INFO:teuthology.orchestra.run.smithi096.stdout:mon 3/3 59s ago 6m smithi096:172.21.15.96=a;smithi133:172.21.15.133=b;smithi186:172.21.15.186=c;count:3 2023-05-08T03:41:51.058 INFO:teuthology.orchestra.run.smithi096.stdout:osd 12 59s ago - 2023-05-08T03:41:51.059 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:51.057+0000 7f31e091c700 1 -- 172.21.15.96:0/466069652 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f31c80a11e0 msgr2=0x7f31c80a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:51.059 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:51.057+0000 7f31e091c700 1 --2- 172.21.15.96:0/466069652 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f31c80a11e0 0x7f31c80a3690 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f31cc005950 tx=0x7f31cc0058e0 comp rx=0 tx=0).stop 2023-05-08T03:41:51.059 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:51.057+0000 7f31e091c700 1 -- 172.21.15.96:0/466069652 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f31dc101610 msgr2=0x7f31dc1967b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:51.060 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:51.057+0000 7f31e091c700 1 --2- 172.21.15.96:0/466069652 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f31dc101610 0x7f31dc1967b0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f31c400b560 tx=0x7f31c400b870 comp rx=0 tx=0).stop 2023-05-08T03:41:51.060 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:51.057+0000 7f31e091c700 1 -- 172.21.15.96:0/466069652 shutdown_connections 2023-05-08T03:41:51.060 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:51.057+0000 7f31e091c700 1 --2- 172.21.15.96:0/466069652 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f31c80a11e0 0x7f31c80a3690 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:51.060 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:51.057+0000 7f31e091c700 1 --2- 172.21.15.96:0/466069652 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31dc101fa0 0x7f31dc19d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:51.060 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:51.057+0000 7f31e091c700 1 --2- 172.21.15.96:0/466069652 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f31dc100410 0x7f31dc196270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:51.060 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:51.057+0000 7f31e091c700 1 --2- 172.21.15.96:0/466069652 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f31dc101610 0x7f31dc1967b0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:51.060 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:51.057+0000 7f31e091c700 1 -- 172.21.15.96:0/466069652 >> 172.21.15.96:0/466069652 conn(0x7f31dc0fba60 msgr2=0x7f31dc104a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:51.060 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:51.057+0000 7f31e091c700 1 -- 172.21.15.96:0/466069652 shutdown_connections 2023-05-08T03:41:51.061 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:51.057+0000 7f31e091c700 1 -- 172.21.15.96:0/466069652 wait complete. 2023-05-08T03:41:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:50 smithi186 ceph-mon[126480]: pgmap v290: 97 pgs: 97 active+clean; 636 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s; 5 B/s, 0 keys/s, 0 objects/s recovering 2023-05-08T03:41:51.393 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- bash -c 'ceph orch host ls' 2023-05-08T03:41:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:51 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:41:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:51 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:41:52.043 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.a/config 2023-05-08T03:41:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:51 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:41:52.845 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:52 smithi096 ceph-mon[124666]: from='client.15105 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:41:52.845 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:52 smithi096 ceph-mon[124666]: pgmap v291: 97 pgs: 97 active+clean; 636 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s; 4 B/s, 0 keys/s, 0 objects/s recovering 2023-05-08T03:41:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:52 smithi133 ceph-mon[125939]: from='client.15105 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:41:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:52 smithi133 ceph-mon[125939]: pgmap v291: 97 pgs: 97 active+clean; 636 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s; 4 B/s, 0 keys/s, 0 objects/s recovering 2023-05-08T03:41:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:52 smithi186 ceph-mon[126480]: from='client.15105 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:41:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:52 smithi186 ceph-mon[126480]: pgmap v291: 97 pgs: 97 active+clean; 636 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s; 4 B/s, 0 keys/s, 0 objects/s recovering 2023-05-08T03:41:53.520 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:53.517+0000 7f50fa085700 1 -- 172.21.15.96:0/3829752447 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50f41004e0 msgr2=0x7f50f4100930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:53.521 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:53.517+0000 7f50fa085700 1 --2- 172.21.15.96:0/3829752447 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50f41004e0 0x7f50f4100930 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f50e4009990 tx=0x7f50e4009ca0 comp rx=0 tx=0).stop 2023-05-08T03:41:53.521 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:53.517+0000 7f50fa085700 1 -- 172.21.15.96:0/3829752447 shutdown_connections 2023-05-08T03:41:53.521 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:53.517+0000 7f50fa085700 1 --2- 172.21.15.96:0/3829752447 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f50f4100e70 0x7f50f4107730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:53.521 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:53.517+0000 7f50fa085700 1 --2- 172.21.15.96:0/3829752447 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50f40ff2e0 0x7f50f40ff6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:53.521 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:53.517+0000 7f50fa085700 1 --2- 172.21.15.96:0/3829752447 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50f41004e0 0x7f50f4100930 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:53.521 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:53.517+0000 7f50fa085700 1 -- 172.21.15.96:0/3829752447 >> 172.21.15.96:0/3829752447 conn(0x7f50f40fa8f0 msgr2=0x7f50f40fcd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:53.522 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:53.517+0000 7f50fa085700 1 -- 172.21.15.96:0/3829752447 shutdown_connections 2023-05-08T03:41:53.522 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:53.517+0000 7f50fa085700 1 -- 172.21.15.96:0/3829752447 wait complete. 2023-05-08T03:41:53.522 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:53.518+0000 7f50fa085700 1 Processor -- start 2023-05-08T03:41:53.522 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:53.518+0000 7f50fa085700 1 -- start start 2023-05-08T03:41:53.524 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:53.518+0000 7f50fa085700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50f40ff2e0 0x7f50f4069270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:53.524 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:53.518+0000 7f50fa085700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f50f41004e0 0x7f50f419aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:53.524 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:53.518+0000 7f50fa085700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50f4100e70 0x7f50f419d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:53.524 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:53.518+0000 7f50fa085700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50f419dd10 con 0x7f50f4100e70 2023-05-08T03:41:53.524 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:53.518+0000 7f50fa085700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50f419de80 con 0x7f50f40ff2e0 2023-05-08T03:41:53.524 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:53.518+0000 7f50fa085700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50f419e040 con 0x7f50f41004e0 2023-05-08T03:41:53.525 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:53.518+0000 7f50f3fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50f4100e70 0x7f50f419d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:53.525 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:53.518+0000 7f50f3fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50f4100e70 0x7f50f419d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41406/0 (socket says 172.21.15.96:41406) 2023-05-08T03:41:53.525 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:53.518+0000 7f50f3fff700 1 -- 172.21.15.96:0/1283785774 learned_addr learned my addr 172.21.15.96:0/1283785774 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:41:53.525 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:53.518+0000 7f50f2ffd700 1 --2- 172.21.15.96:0/1283785774 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f50f41004e0 0x7f50f419aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:53.525 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:53.518+0000 7f50f37fe700 1 --2- 172.21.15.96:0/1283785774 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50f40ff2e0 0x7f50f4069270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:53.525 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:53.519+0000 7f50f3fff700 1 -- 172.21.15.96:0/1283785774 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f50f41004e0 msgr2=0x7f50f419aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:53.525 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:53.519+0000 7f50f3fff700 1 --2- 172.21.15.96:0/1283785774 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f50f41004e0 0x7f50f419aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:53.526 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:53.519+0000 7f50f3fff700 1 -- 172.21.15.96:0/1283785774 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50f40ff2e0 msgr2=0x7f50f4069270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:53.526 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:53.519+0000 7f50f3fff700 1 --2- 172.21.15.96:0/1283785774 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50f40ff2e0 0x7f50f4069270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:53.526 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:53.519+0000 7f50f3fff700 1 -- 172.21.15.96:0/1283785774 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50e40095f0 con 0x7f50f4100e70 2023-05-08T03:41:53.526 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:53.519+0000 7f50f3fff700 1 --2- 172.21.15.96:0/1283785774 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50f4100e70 0x7f50f419d570 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f50ec007ee0 tx=0x7f50ec00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:53.526 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:53.519+0000 7f50f0ff9700 1 -- 172.21.15.96:0/1283785774 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50ec00dd20 con 0x7f50f4100e70 2023-05-08T03:41:53.526 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:53.519+0000 7f50f0ff9700 1 -- 172.21.15.96:0/1283785774 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f50ec00f040 con 0x7f50f4100e70 2023-05-08T03:41:53.527 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:53.519+0000 7f50fa085700 1 -- 172.21.15.96:0/1283785774 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50f410ac80 con 0x7f50f4100e70 2023-05-08T03:41:53.527 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:53.519+0000 7f50f0ff9700 1 -- 172.21.15.96:0/1283785774 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50ec0048a0 con 0x7f50f4100e70 2023-05-08T03:41:53.527 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:53.519+0000 7f50fa085700 1 -- 172.21.15.96:0/1283785774 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50f410aaf0 con 0x7f50f4100e70 2023-05-08T03:41:53.527 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:53.520+0000 7f50fa085700 1 -- 172.21.15.96:0/1283785774 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50f419e720 con 0x7f50f4100e70 2023-05-08T03:41:53.528 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:53.522+0000 7f50f0ff9700 1 -- 172.21.15.96:0/1283785774 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f50ec003a00 con 0x7f50f4100e70 2023-05-08T03:41:53.528 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:53.522+0000 7f50f0ff9700 1 --2- 172.21.15.96:0/1283785774 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f50e00a1260 0x7f50e00a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:53.528 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:53.523+0000 7f50f37fe700 1 --2- 172.21.15.96:0/1283785774 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f50e00a1260 0x7f50e00a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:53.528 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:53.523+0000 7f50f0ff9700 1 -- 172.21.15.96:0/1283785774 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f50ec0ccad0 con 0x7f50f4100e70 2023-05-08T03:41:53.528 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:53.523+0000 7f50f37fe700 1 --2- 172.21.15.96:0/1283785774 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f50e00a1260 0x7f50e00a3710 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f50f4100340 tx=0x7f50dc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:53.529 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:53.526+0000 7f50f0ff9700 1 -- 172.21.15.96:0/1283785774 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f50ec0960c0 con 0x7f50f4100e70 2023-05-08T03:41:53.733 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:53.731+0000 7f50fa085700 1 -- 172.21.15.96:0/1283785774 --> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f50f4061030 con 0x7f50e00a1260 2023-05-08T03:41:53.735 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:53.733+0000 7f50f0ff9700 1 -- 172.21.15.96:0/1283785774 <== mgr.14152 v2:172.21.15.96:6800/2748629182 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+191 (secure 0 0 0) 0x7f50f4061030 con 0x7f50e00a1260 2023-05-08T03:41:53.735 INFO:teuthology.orchestra.run.smithi096.stdout:HOST ADDR LABELS STATUS 2023-05-08T03:41:53.736 INFO:teuthology.orchestra.run.smithi096.stdout:smithi096 172.21.15.96 2023-05-08T03:41:53.736 INFO:teuthology.orchestra.run.smithi096.stdout:smithi133 172.21.15.133 2023-05-08T03:41:53.736 INFO:teuthology.orchestra.run.smithi096.stdout:smithi186 172.21.15.186 2023-05-08T03:41:53.736 INFO:teuthology.orchestra.run.smithi096.stdout:3 hosts in cluster 2023-05-08T03:41:53.737 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:53.735+0000 7f50fa085700 1 -- 172.21.15.96:0/1283785774 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f50e00a1260 msgr2=0x7f50e00a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:53.738 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:53.735+0000 7f50fa085700 1 --2- 172.21.15.96:0/1283785774 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f50e00a1260 0x7f50e00a3710 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f50f4100340 tx=0x7f50dc009260 comp rx=0 tx=0).stop 2023-05-08T03:41:53.738 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:53.735+0000 7f50fa085700 1 -- 172.21.15.96:0/1283785774 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50f4100e70 msgr2=0x7f50f419d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:53.738 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:53.735+0000 7f50fa085700 1 --2- 172.21.15.96:0/1283785774 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50f4100e70 0x7f50f419d570 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f50ec007ee0 tx=0x7f50ec00d3b0 comp rx=0 tx=0).stop 2023-05-08T03:41:53.738 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:53.735+0000 7f50fa085700 1 -- 172.21.15.96:0/1283785774 shutdown_connections 2023-05-08T03:41:53.738 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:53.735+0000 7f50fa085700 1 --2- 172.21.15.96:0/1283785774 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f50e00a1260 0x7f50e00a3710 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:53.738 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:53.735+0000 7f50fa085700 1 --2- 172.21.15.96:0/1283785774 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50f4100e70 0x7f50f419d570 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:53.738 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:53.735+0000 7f50fa085700 1 --2- 172.21.15.96:0/1283785774 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50f40ff2e0 0x7f50f4069270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:53.739 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:53.735+0000 7f50fa085700 1 --2- 172.21.15.96:0/1283785774 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f50f41004e0 0x7f50f419aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:53.739 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:53.735+0000 7f50fa085700 1 -- 172.21.15.96:0/1283785774 >> 172.21.15.96:0/1283785774 conn(0x7f50f40fa8f0 msgr2=0x7f50f40fcc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:53.739 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:53.735+0000 7f50fa085700 1 -- 172.21.15.96:0/1283785774 shutdown_connections 2023-05-08T03:41:53.739 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:53.735+0000 7f50fa085700 1 -- 172.21.15.96:0/1283785774 wait complete. 2023-05-08T03:41:54.254 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- bash -c 'ceph orch device ls' 2023-05-08T03:41:54.945 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.a/config 2023-05-08T03:41:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:54 smithi133 ceph-mon[125939]: pgmap v292: 97 pgs: 97 active+clean; 636 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s; 4 B/s, 0 keys/s, 0 objects/s recovering 2023-05-08T03:41:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:54 smithi133 ceph-mon[125939]: from='client.15111 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:41:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:54 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:41:54.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:54 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:41:54.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:54 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:41:54.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:54 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:41:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:54 smithi096 ceph-mon[124666]: pgmap v292: 97 pgs: 97 active+clean; 636 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s; 4 B/s, 0 keys/s, 0 objects/s recovering 2023-05-08T03:41:55.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:54 smithi096 ceph-mon[124666]: from='client.15111 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:41:55.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:54 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:41:55.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:54 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:41:55.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:54 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:41:55.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:54 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:41:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:54 smithi186 ceph-mon[126480]: pgmap v292: 97 pgs: 97 active+clean; 636 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s; 4 B/s, 0 keys/s, 0 objects/s recovering 2023-05-08T03:41:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:54 smithi186 ceph-mon[126480]: from='client.15111 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:41:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:54 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:41:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:54 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:41:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:54 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:41:55.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:54 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:41:56.106 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:56.103+0000 7ff9ba0bb700 1 -- 172.21.15.96:0/3374167250 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff9b40ffec0 msgr2=0x7ff9b4107770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:56.107 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:56.103+0000 7ff9ba0bb700 1 --2- 172.21.15.96:0/3374167250 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff9b40ffec0 0x7ff9b4107770 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac00b0a0 tx=0x7ff9ac00b3b0 comp rx=0 tx=0).stop 2023-05-08T03:41:56.107 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:56.103+0000 7ff9ba0bb700 1 -- 172.21.15.96:0/3374167250 shutdown_connections 2023-05-08T03:41:56.107 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:56.103+0000 7ff9ba0bb700 1 --2- 172.21.15.96:0/3374167250 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff9b40ffec0 0x7ff9b4107770 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:56.107 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:56.103+0000 7ff9ba0bb700 1 --2- 172.21.15.96:0/3374167250 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9b41008b0 0x7ff9b4100cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:56.107 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:56.103+0000 7ff9ba0bb700 1 --2- 172.21.15.96:0/3374167250 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9b40ff510 0x7ff9b40ff980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:56.108 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:56.103+0000 7ff9ba0bb700 1 -- 172.21.15.96:0/3374167250 >> 172.21.15.96:0/3374167250 conn(0x7ff9b40fa070 msgr2=0x7ff9b40fc4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:56.108 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:56.103+0000 7ff9ba0bb700 1 -- 172.21.15.96:0/3374167250 shutdown_connections 2023-05-08T03:41:56.108 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:56.103+0000 7ff9ba0bb700 1 -- 172.21.15.96:0/3374167250 wait complete. 2023-05-08T03:41:56.108 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:56.104+0000 7ff9ba0bb700 1 Processor -- start 2023-05-08T03:41:56.108 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:56.104+0000 7ff9ba0bb700 1 -- start start 2023-05-08T03:41:56.108 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:56.104+0000 7ff9ba0bb700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff9b40ff510 0x7ff9b40fef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:56.108 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:56.104+0000 7ff9ba0bb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9b40ffec0 0x7ff9b419af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:56.109 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:56.104+0000 7ff9ba0bb700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9b41008b0 0x7ff9b419d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:56.109 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:56.104+0000 7ff9ba0bb700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b419dd20 con 0x7ff9b41008b0 2023-05-08T03:41:56.109 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:56.104+0000 7ff9ba0bb700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b419de90 con 0x7ff9b40ffec0 2023-05-08T03:41:56.109 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:56.104+0000 7ff9ba0bb700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b419e050 con 0x7ff9b40ff510 2023-05-08T03:41:56.109 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:56.104+0000 7ff9b37fe700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff9b40ff510 0x7ff9b40fef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:56.109 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:56.104+0000 7ff9b37fe700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff9b40ff510 0x7ff9b40fef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.96:53460/0 (socket says 172.21.15.96:53460) 2023-05-08T03:41:56.109 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:56.104+0000 7ff9b37fe700 1 -- 172.21.15.96:0/1689945031 learned_addr learned my addr 172.21.15.96:0/1689945031 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:41:56.110 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:56.104+0000 7ff9b2ffd700 1 --2- 172.21.15.96:0/1689945031 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9b40ffec0 0x7ff9b419af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:56.110 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:56.104+0000 7ff9b3fff700 1 --2- 172.21.15.96:0/1689945031 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9b41008b0 0x7ff9b419d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:56.111 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:56.105+0000 7ff9b37fe700 1 -- 172.21.15.96:0/1689945031 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9b40ffec0 msgr2=0x7ff9b419af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:56.111 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:56.105+0000 7ff9b37fe700 1 --2- 172.21.15.96:0/1689945031 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9b40ffec0 0x7ff9b419af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:56.111 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:56.105+0000 7ff9b37fe700 1 -- 172.21.15.96:0/1689945031 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9b41008b0 msgr2=0x7ff9b419d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:56.111 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:56.105+0000 7ff9b37fe700 1 --2- 172.21.15.96:0/1689945031 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9b41008b0 0x7ff9b419d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:56.111 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:56.105+0000 7ff9b37fe700 1 -- 172.21.15.96:0/1689945031 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9ac009d00 con 0x7ff9b40ff510 2023-05-08T03:41:56.112 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:56.105+0000 7ff9b37fe700 1 --2- 172.21.15.96:0/1689945031 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff9b40ff510 0x7ff9b40fef80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff9a400e970 tx=0x7ff9a400ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:56.112 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:56.105+0000 7ff9b0ff9700 1 -- 172.21.15.96:0/1689945031 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a4009790 con 0x7ff9b40ff510 2023-05-08T03:41:56.112 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:56.105+0000 7ff9b0ff9700 1 -- 172.21.15.96:0/1689945031 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff9a400c7e0 con 0x7ff9b40ff510 2023-05-08T03:41:56.112 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:56.105+0000 7ff9ba0bb700 1 -- 172.21.15.96:0/1689945031 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9b410ac60 con 0x7ff9b40ff510 2023-05-08T03:41:56.112 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:56.105+0000 7ff9b0ff9700 1 -- 172.21.15.96:0/1689945031 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a4003c70 con 0x7ff9b40ff510 2023-05-08T03:41:56.112 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:56.105+0000 7ff9ba0bb700 1 -- 172.21.15.96:0/1689945031 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9b410aad0 con 0x7ff9b40ff510 2023-05-08T03:41:56.112 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:56.106+0000 7ff9ba0bb700 1 -- 172.21.15.96:0/1689945031 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9b4106170 con 0x7ff9b40ff510 2023-05-08T03:41:56.113 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:56.107+0000 7ff9b0ff9700 1 -- 172.21.15.96:0/1689945031 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7ff9a400cc50 con 0x7ff9b40ff510 2023-05-08T03:41:56.113 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:56.108+0000 7ff9b0ff9700 1 --2- 172.21.15.96:0/1689945031 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7ff99c0a11e0 0x7ff99c0a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:56.113 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:56.108+0000 7ff9b2ffd700 1 --2- 172.21.15.96:0/1689945031 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7ff99c0a11e0 0x7ff99c0a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:56.113 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:56.108+0000 7ff9b0ff9700 1 -- 172.21.15.96:0/1689945031 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7ff9a4014070 con 0x7ff9b40ff510 2023-05-08T03:41:56.113 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:56.108+0000 7ff9b2ffd700 1 --2- 172.21.15.96:0/1689945031 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7ff99c0a11e0 0x7ff99c0a3690 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff9b40ff4e0 tx=0x7ff9a8007400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:56.114 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:56.112+0000 7ff9b0ff9700 1 -- 172.21.15.96:0/1689945031 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7ff9a40967d0 con 0x7ff9b40ff510 2023-05-08T03:41:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:55 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:41:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:55 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:41:56.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:55 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:41:56.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:55 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:41:56.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:55 smithi133 ceph-mon[125939]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:41:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:55 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:41:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:55 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:41:56.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:55 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:41:56.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:55 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:41:56.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:55 smithi096 ceph-mon[124666]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:41:56.309 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:56.307+0000 7ff9ba0bb700 1 -- 172.21.15.96:0/1689945031 --> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7ff9b4061d10 con 0x7ff99c0a11e0 2023-05-08T03:41:56.311 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:56.309+0000 7ff9b0ff9700 1 -- 172.21.15.96:0/1689945031 <== mgr.14152 v2:172.21.15.96:6800/2748629182 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+492 (secure 0 0 0) 0x7ff9b4061d10 con 0x7ff99c0a11e0 2023-05-08T03:41:56.311 INFO:teuthology.orchestra.run.smithi096.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2023-05-08T03:41:56.311 INFO:teuthology.orchestra.run.smithi096.stdout:smithi096 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400NH400BGN 372G No 2m ago LVM detected, locked 2023-05-08T03:41:56.312 INFO:teuthology.orchestra.run.smithi096.stdout:smithi133 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620401AQ400BGN 372G No 2m ago LVM detected, locked 2023-05-08T03:41:56.312 INFO:teuthology.orchestra.run.smithi096.stdout:smithi186 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300CB400BGN 372G No 109s ago LVM detected, locked 2023-05-08T03:41:56.313 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:56.310+0000 7ff9ba0bb700 1 -- 172.21.15.96:0/1689945031 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7ff99c0a11e0 msgr2=0x7ff99c0a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:56.313 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:56.310+0000 7ff9ba0bb700 1 --2- 172.21.15.96:0/1689945031 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7ff99c0a11e0 0x7ff99c0a3690 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff9b40ff4e0 tx=0x7ff9a8007400 comp rx=0 tx=0).stop 2023-05-08T03:41:56.313 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:56.310+0000 7ff9ba0bb700 1 -- 172.21.15.96:0/1689945031 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff9b40ff510 msgr2=0x7ff9b40fef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:56.314 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:56.310+0000 7ff9ba0bb700 1 --2- 172.21.15.96:0/1689945031 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff9b40ff510 0x7ff9b40fef80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff9a400e970 tx=0x7ff9a400ec80 comp rx=0 tx=0).stop 2023-05-08T03:41:56.314 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:56.311+0000 7ff9ba0bb700 1 -- 172.21.15.96:0/1689945031 shutdown_connections 2023-05-08T03:41:56.314 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:56.311+0000 7ff9ba0bb700 1 --2- 172.21.15.96:0/1689945031 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7ff99c0a11e0 0x7ff99c0a3690 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:56.314 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:56.311+0000 7ff9ba0bb700 1 --2- 172.21.15.96:0/1689945031 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9b41008b0 0x7ff9b419d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:56.314 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:56.311+0000 7ff9ba0bb700 1 --2- 172.21.15.96:0/1689945031 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff9b40ff510 0x7ff9b40fef80 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:56.314 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:56.311+0000 7ff9ba0bb700 1 --2- 172.21.15.96:0/1689945031 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9b40ffec0 0x7ff9b419af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:56.314 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:56.311+0000 7ff9ba0bb700 1 -- 172.21.15.96:0/1689945031 >> 172.21.15.96:0/1689945031 conn(0x7ff9b40fa070 msgr2=0x7ff9b40fc240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:56.315 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:56.311+0000 7ff9ba0bb700 1 -- 172.21.15.96:0/1689945031 shutdown_connections 2023-05-08T03:41:56.315 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:56.311+0000 7ff9ba0bb700 1 -- 172.21.15.96:0/1689945031 wait complete. 2023-05-08T03:41:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:55 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:41:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:55 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:41:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:55 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:41:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:55 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:41:56.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:55 smithi186 ceph-mon[126480]: from='mgr.14152 172.21.15.96:0/3186883172' entity='mgr.x' 2023-05-08T03:41:56.693 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-05-08T03:41:56.703 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi096.front.sepia.ceph.com 2023-05-08T03:41:56.703 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- bash -c 'ceph fs dump' 2023-05-08T03:41:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:56 smithi133 ceph-mon[125939]: pgmap v293: 97 pgs: 97 active+clean; 636 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T03:41:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:56 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:41:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:56 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T03:41:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:56 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:41:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:56 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T03:41:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:56 smithi096 ceph-mon[124666]: pgmap v293: 97 pgs: 97 active+clean; 636 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T03:41:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:56 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:41:57.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:56 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T03:41:57.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:56 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:41:57.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:56 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T03:41:57.345 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.a/config 2023-05-08T03:41:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:56 smithi186 ceph-mon[126480]: pgmap v293: 97 pgs: 97 active+clean; 636 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T03:41:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:56 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:41:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:56 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T03:41:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:56 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:41:57.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:56 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T03:41:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:57 smithi133 ceph-mon[125939]: from='client.24799 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:41:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:57 smithi096 ceph-mon[124666]: from='client.24799 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:41:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:57 smithi186 ceph-mon[126480]: from='client.24799 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:41:58.557 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:58.554+0000 7f8313cb6700 1 -- 172.21.15.96:0/68154388 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f830c0ff2e0 msgr2=0x7f830c0ff6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:58.557 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:58.554+0000 7f8313cb6700 1 --2- 172.21.15.96:0/68154388 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f830c0ff2e0 0x7f830c0ff6f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f8308009990 tx=0x7f8308009ca0 comp rx=0 tx=0).stop 2023-05-08T03:41:58.557 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:58.554+0000 7f8313cb6700 1 -- 172.21.15.96:0/68154388 shutdown_connections 2023-05-08T03:41:58.557 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:58.554+0000 7f8313cb6700 1 --2- 172.21.15.96:0/68154388 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f830c100e70 0x7f830c107730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:58.557 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:58.554+0000 7f8313cb6700 1 --2- 172.21.15.96:0/68154388 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f830c0ff2e0 0x7f830c0ff6f0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:58.558 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:58.554+0000 7f8313cb6700 1 --2- 172.21.15.96:0/68154388 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f830c1004e0 0x7f830c100930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:58.558 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:58.554+0000 7f8313cb6700 1 -- 172.21.15.96:0/68154388 >> 172.21.15.96:0/68154388 conn(0x7f830c0fa8f0 msgr2=0x7f830c0fcd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:58.558 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:58.554+0000 7f8313cb6700 1 -- 172.21.15.96:0/68154388 shutdown_connections 2023-05-08T03:41:58.558 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:58.554+0000 7f8313cb6700 1 -- 172.21.15.96:0/68154388 wait complete. 2023-05-08T03:41:58.559 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:58.555+0000 7f8313cb6700 1 Processor -- start 2023-05-08T03:41:58.560 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:58.555+0000 7f8313cb6700 1 -- start start 2023-05-08T03:41:58.560 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:58.555+0000 7f8313cb6700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f830c0ff2e0 0x7f830c195060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:58.560 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:58.555+0000 7f8313cb6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f830c1004e0 0x7f830c1955a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:58.560 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:58.555+0000 7f8313cb6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f830c100e70 0x7f830c19c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:58.560 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:58.555+0000 7f8313cb6700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f830c19cbf0 con 0x7f830c1004e0 2023-05-08T03:41:58.560 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:58.555+0000 7f8313cb6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f830c19cd30 con 0x7f830c100e70 2023-05-08T03:41:58.560 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:58.555+0000 7f8313cb6700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f830c19cec0 con 0x7f830c0ff2e0 2023-05-08T03:41:58.561 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:58.555+0000 7f8311251700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f830c1004e0 0x7f830c1955a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:58.561 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:58.555+0000 7f8311251700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f830c1004e0 0x7f830c1955a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41432/0 (socket says 172.21.15.96:41432) 2023-05-08T03:41:58.561 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:58.555+0000 7f8311251700 1 -- 172.21.15.96:0/1128972307 learned_addr learned my addr 172.21.15.96:0/1128972307 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:41:58.561 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:58.555+0000 7f8311a52700 1 --2- 172.21.15.96:0/1128972307 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f830c0ff2e0 0x7f830c195060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:58.561 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:58.555+0000 7f8312253700 1 --2- 172.21.15.96:0/1128972307 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f830c100e70 0x7f830c19c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:58.561 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:58.555+0000 7f8311251700 1 -- 172.21.15.96:0/1128972307 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f830c0ff2e0 msgr2=0x7f830c195060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:58.561 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:58.555+0000 7f8311251700 1 --2- 172.21.15.96:0/1128972307 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f830c0ff2e0 0x7f830c195060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:58.562 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:58.555+0000 7f8311251700 1 -- 172.21.15.96:0/1128972307 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f830c100e70 msgr2=0x7f830c19c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:58.562 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:58.555+0000 7f8311251700 1 --2- 172.21.15.96:0/1128972307 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f830c100e70 0x7f830c19c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:58.562 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:58.555+0000 7f8311251700 1 -- 172.21.15.96:0/1128972307 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83080095f0 con 0x7f830c1004e0 2023-05-08T03:41:58.562 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:58.555+0000 7f8311251700 1 --2- 172.21.15.96:0/1128972307 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f830c1004e0 0x7f830c1955a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f82fc00d980 tx=0x7f82fc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:58.562 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:58.556+0000 7f8302ffd700 1 -- 172.21.15.96:0/1128972307 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82fc009b40 con 0x7f830c1004e0 2023-05-08T03:41:58.562 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:58.556+0000 7f8302ffd700 1 -- 172.21.15.96:0/1128972307 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f82fc00b6e0 con 0x7f830c1004e0 2023-05-08T03:41:58.562 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:58.556+0000 7f8302ffd700 1 -- 172.21.15.96:0/1128972307 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82fc00f620 con 0x7f830c1004e0 2023-05-08T03:41:58.562 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:58.556+0000 7f8313cb6700 1 -- 172.21.15.96:0/1128972307 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f830c10ac30 con 0x7f830c1004e0 2023-05-08T03:41:58.563 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:58.556+0000 7f8313cb6700 1 -- 172.21.15.96:0/1128972307 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f830c10aaa0 con 0x7f830c1004e0 2023-05-08T03:41:58.563 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:58.557+0000 7f8313cb6700 1 -- 172.21.15.96:0/1128972307 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f830c19d5a0 con 0x7f830c1004e0 2023-05-08T03:41:58.563 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:58.558+0000 7f8302ffd700 1 -- 172.21.15.96:0/1128972307 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f82fc010460 con 0x7f830c1004e0 2023-05-08T03:41:58.564 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:58.558+0000 7f8302ffd700 1 --2- 172.21.15.96:0/1128972307 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f82f80a1260 0x7f82f80a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:41:58.564 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:58.558+0000 7f8311a52700 1 --2- 172.21.15.96:0/1128972307 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f82f80a1260 0x7f82f80a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:41:58.564 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:58.558+0000 7f8302ffd700 1 -- 172.21.15.96:0/1128972307 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f82fc0ccbc0 con 0x7f830c1004e0 2023-05-08T03:41:58.564 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:58.559+0000 7f8311a52700 1 --2- 172.21.15.96:0/1128972307 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f82f80a1260 0x7f82f80a3710 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f830800b5c0 tx=0x7f8308005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:41:58.564 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:58.562+0000 7f8302ffd700 1 -- 172.21.15.96:0/1128972307 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f82fc0962b0 con 0x7f830c1004e0 2023-05-08T03:41:58.796 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:58.794+0000 7f8313cb6700 1 -- 172.21.15.96:0/1128972307 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f830c106270 con 0x7f830c1004e0 2023-05-08T03:41:58.797 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:58.794+0000 7f8302ffd700 1 -- 172.21.15.96:0/1128972307 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 22 v22) v1 ==== 76+0+2903 (secure 0 0 0) 0x7f82fc016020 con 0x7f830c1004e0 2023-05-08T03:41:58.797 INFO:teuthology.orchestra.run.smithi096.stdout:e22 2023-05-08T03:41:58.797 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-05-08T03:41:58.798 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-05-08T03:41:58.798 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2023-05-08T03:41:58.798 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:41:58.798 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2023-05-08T03:41:58.798 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2023-05-08T03:41:58.798 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 22 2023-05-08T03:41:58.798 INFO:teuthology.orchestra.run.smithi096.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2023-05-08T03:41:58.799 INFO:teuthology.orchestra.run.smithi096.stdout:created 2023-05-08T03:40:49.210143+0000 2023-05-08T03:41:58.799 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2023-05-08T03:40:54.356833+0000 2023-05-08T03:41:58.799 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2023-05-08T03:41:58.799 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2023-05-08T03:41:58.799 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 300 2023-05-08T03:41:58.799 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2023-05-08T03:41:58.799 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2023-05-08T03:41:58.800 INFO:teuthology.orchestra.run.smithi096.stdout:max_xattr_size 65536 2023-05-08T03:41:58.800 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2023-05-08T03:41:58.800 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2023-05-08T03:41:58.800 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2023-05-08T03:41:58.800 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-05-08T03:41:58.800 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 3 2023-05-08T03:41:58.800 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1,2 2023-05-08T03:41:58.800 INFO:teuthology.orchestra.run.smithi096.stdout:up {0=24494,1=24487,2=24472} 2023-05-08T03:41:58.801 INFO:teuthology.orchestra.run.smithi096.stdout:failed 2023-05-08T03:41:58.801 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2023-05-08T03:41:58.801 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2023-05-08T03:41:58.801 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2023-05-08T03:41:58.801 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2023-05-08T03:41:58.801 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2023-05-08T03:41:58.801 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2023-05-08T03:41:58.801 INFO:teuthology.orchestra.run.smithi096.stdout:bal_rank_mask -1 2023-05-08T03:41:58.802 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 0 2023-05-08T03:41:58.802 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.b{0:24494} state up:active seq 3 addr [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] compat {c=[1],r=[1],i=[7ff]}] 2023-05-08T03:41:58.802 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.h{0:24461} state up:standby-replay seq 1 addr [v2:172.21.15.133:6836/2218851414,v1:172.21.15.133:6837/2218851414] compat {c=[1],r=[1],i=[7ff]}] 2023-05-08T03:41:58.802 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.i{1:24487} state up:active seq 5 addr [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] compat {c=[1],r=[1],i=[7ff]}] 2023-05-08T03:41:58.802 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.f{1:24460} state up:standby-replay seq 1 addr [v2:172.21.15.186:6834/3984391904,v1:172.21.15.186:6835/3984391904] compat {c=[1],r=[1],i=[7ff]}] 2023-05-08T03:41:58.802 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.c{2:24472} state up:active seq 6 addr [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] compat {c=[1],r=[1],i=[7ff]}] 2023-05-08T03:41:58.802 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.e{2:24437} state up:standby-replay seq 1 addr [v2:172.21.15.133:6834/1735118966,v1:172.21.15.133:6835/1735118966] compat {c=[1],r=[1],i=[7ff]}] 2023-05-08T03:41:58.802 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:41:58.803 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:41:58.803 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2023-05-08T03:41:58.803 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:41:58.803 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.j{-1:14550} state up:standby seq 1 addr [v2:172.21.15.96:6834/1518512221,v1:172.21.15.96:6835/1518512221] compat {c=[1],r=[1],i=[7ff]}] 2023-05-08T03:41:58.803 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.d{-1:14562} state up:standby seq 1 addr [v2:172.21.15.96:6836/305967678,v1:172.21.15.96:6837/305967678] compat {c=[1],r=[1],i=[7ff]}] 2023-05-08T03:41:58.803 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.g{-1:14622} state up:standby seq 1 addr [v2:172.21.15.96:6838/2596991665,v1:172.21.15.96:6839/2596991665] compat {c=[1],r=[1],i=[7ff]}] 2023-05-08T03:41:58.804 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.a{-1:14634} state up:standby seq 1 addr [v2:172.21.15.96:6840/1786091200,v1:172.21.15.96:6841/1786091200] compat {c=[1],r=[1],i=[7ff]}] 2023-05-08T03:41:58.804 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.k{-1:24416} state up:standby seq 1 addr [v2:172.21.15.133:6832/2351258784,v1:172.21.15.133:6833/2351258784] compat {c=[1],r=[1],i=[7ff]}] 2023-05-08T03:41:58.804 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.l{-1:24427} state up:standby seq 1 addr [v2:172.21.15.186:6832/2274306880,v1:172.21.15.186:6833/2274306880] compat {c=[1],r=[1],i=[7ff]}] 2023-05-08T03:41:58.805 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:58.796+0000 7f8313cb6700 1 -- 172.21.15.96:0/1128972307 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f82f80a1260 msgr2=0x7f82f80a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:58.805 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:58.796+0000 7f8313cb6700 1 --2- 172.21.15.96:0/1128972307 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f82f80a1260 0x7f82f80a3710 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f830800b5c0 tx=0x7f8308005fb0 comp rx=0 tx=0).stop 2023-05-08T03:41:58.805 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:58.796+0000 7f8313cb6700 1 -- 172.21.15.96:0/1128972307 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f830c1004e0 msgr2=0x7f830c1955a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:41:58.805 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:58.796+0000 7f8313cb6700 1 --2- 172.21.15.96:0/1128972307 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f830c1004e0 0x7f830c1955a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f82fc00d980 tx=0x7f82fc00dc90 comp rx=0 tx=0).stop 2023-05-08T03:41:58.805 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:58.796+0000 7f8313cb6700 1 -- 172.21.15.96:0/1128972307 shutdown_connections 2023-05-08T03:41:58.806 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:58.796+0000 7f8313cb6700 1 --2- 172.21.15.96:0/1128972307 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f82f80a1260 0x7f82f80a3710 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:58.806 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:58.796+0000 7f8313cb6700 1 --2- 172.21.15.96:0/1128972307 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f830c100e70 0x7f830c19c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:58.806 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:58.796+0000 7f8313cb6700 1 --2- 172.21.15.96:0/1128972307 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f830c0ff2e0 0x7f830c195060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:58.806 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:58.796+0000 7f8313cb6700 1 --2- 172.21.15.96:0/1128972307 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f830c1004e0 0x7f830c1955a0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:41:58.806 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:58.796+0000 7f8313cb6700 1 -- 172.21.15.96:0/1128972307 >> 172.21.15.96:0/1128972307 conn(0x7f830c0fa8f0 msgr2=0x7f830c0fcc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:41:58.806 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:58.796+0000 7f8313cb6700 1 -- 172.21.15.96:0/1128972307 shutdown_connections 2023-05-08T03:41:58.807 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:41:58.796+0000 7f8313cb6700 1 -- 172.21.15.96:0/1128972307 wait complete. 2023-05-08T03:41:58.807 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 22 2023-05-08T03:41:59.161 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:58 smithi096 ceph-mon[124666]: pgmap v294: 97 pgs: 97 active+clean; 636 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T03:41:59.161 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:41:58 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/1128972307' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-05-08T03:41:59.203 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- bash -c 'ceph osd dump' 2023-05-08T03:41:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:58 smithi133 ceph-mon[125939]: pgmap v294: 97 pgs: 97 active+clean; 636 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T03:41:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:41:58 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/1128972307' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-05-08T03:41:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:58 smithi186 ceph-mon[126480]: pgmap v294: 97 pgs: 97 active+clean; 636 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T03:41:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:41:58 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/1128972307' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-05-08T03:41:59.843 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.a/config 2023-05-08T03:42:01.064 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.060+0000 7f2501f15700 1 -- 172.21.15.96:0/1121797209 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24fc1004e0 msgr2=0x7f24fc100930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:01.065 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.060+0000 7f2501f15700 1 --2- 172.21.15.96:0/1121797209 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24fc1004e0 0x7f24fc100930 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f24ec009990 tx=0x7f24ec009ca0 comp rx=0 tx=0).stop 2023-05-08T03:42:01.065 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.060+0000 7f2501f15700 1 -- 172.21.15.96:0/1121797209 shutdown_connections 2023-05-08T03:42:01.065 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.060+0000 7f2501f15700 1 --2- 172.21.15.96:0/1121797209 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24fc100e70 0x7f24fc107730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:01.065 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.060+0000 7f2501f15700 1 --2- 172.21.15.96:0/1121797209 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f24fc0ff2e0 0x7f24fc0ff6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:01.065 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.060+0000 7f2501f15700 1 --2- 172.21.15.96:0/1121797209 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24fc1004e0 0x7f24fc100930 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:01.065 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.060+0000 7f2501f15700 1 -- 172.21.15.96:0/1121797209 >> 172.21.15.96:0/1121797209 conn(0x7f24fc0fa8f0 msgr2=0x7f24fc0fcd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:42:01.066 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.060+0000 7f2501f15700 1 -- 172.21.15.96:0/1121797209 shutdown_connections 2023-05-08T03:42:01.066 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.060+0000 7f2501f15700 1 -- 172.21.15.96:0/1121797209 wait complete. 2023-05-08T03:42:01.066 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.061+0000 7f2501f15700 1 Processor -- start 2023-05-08T03:42:01.066 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.061+0000 7f2501f15700 1 -- start start 2023-05-08T03:42:01.066 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.061+0000 7f2501f15700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24fc0ff2e0 0x7f24fc195000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:01.066 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.061+0000 7f2501f15700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f24fc1004e0 0x7f24fc195540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:01.066 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.061+0000 7f2501f15700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24fc100e70 0x7f24fc19c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:01.066 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.061+0000 7f2501f15700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24fc19cb90 con 0x7f24fc0ff2e0 2023-05-08T03:42:01.067 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.061+0000 7f2501f15700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24fc19ccd0 con 0x7f24fc100e70 2023-05-08T03:42:01.067 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.061+0000 7f2501f15700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24fc19ce60 con 0x7f24fc1004e0 2023-05-08T03:42:01.067 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.061+0000 7f24fb7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24fc0ff2e0 0x7f24fc195000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:01.067 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.061+0000 7f24fb7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24fc0ff2e0 0x7f24fc195000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41444/0 (socket says 172.21.15.96:41444) 2023-05-08T03:42:01.067 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.061+0000 7f24fb7fe700 1 -- 172.21.15.96:0/4268941526 learned_addr learned my addr 172.21.15.96:0/4268941526 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:42:01.067 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.061+0000 7f24fbfff700 1 --2- 172.21.15.96:0/4268941526 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24fc100e70 0x7f24fc19c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:01.067 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.062+0000 7f24faffd700 1 --2- 172.21.15.96:0/4268941526 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f24fc1004e0 0x7f24fc195540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:01.067 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.062+0000 7f24fb7fe700 1 -- 172.21.15.96:0/4268941526 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f24fc1004e0 msgr2=0x7f24fc195540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:01.068 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.062+0000 7f24fb7fe700 1 --2- 172.21.15.96:0/4268941526 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f24fc1004e0 0x7f24fc195540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:01.068 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.062+0000 7f24fb7fe700 1 -- 172.21.15.96:0/4268941526 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24fc100e70 msgr2=0x7f24fc19c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:01.068 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.062+0000 7f24fb7fe700 1 --2- 172.21.15.96:0/4268941526 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24fc100e70 0x7f24fc19c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:01.068 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.062+0000 7f24fb7fe700 1 -- 172.21.15.96:0/4268941526 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24ec0095f0 con 0x7f24fc0ff2e0 2023-05-08T03:42:01.069 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.062+0000 7f24fbfff700 1 --2- 172.21.15.96:0/4268941526 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24fc100e70 0x7f24fc19c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-08T03:42:01.069 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.062+0000 7f24fb7fe700 1 --2- 172.21.15.96:0/4268941526 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24fc0ff2e0 0x7f24fc195000 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f24f000c9a0 tx=0x7f24f000cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:42:01.069 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.062+0000 7f24f8ff9700 1 -- 172.21.15.96:0/4268941526 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f0004220 con 0x7f24fc0ff2e0 2023-05-08T03:42:01.069 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.062+0000 7f2501f15700 1 -- 172.21.15.96:0/4268941526 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24fc10ac40 con 0x7f24fc0ff2e0 2023-05-08T03:42:01.069 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.062+0000 7f24f8ff9700 1 -- 172.21.15.96:0/4268941526 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f24f0007d20 con 0x7f24fc0ff2e0 2023-05-08T03:42:01.070 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.062+0000 7f24f8ff9700 1 -- 172.21.15.96:0/4268941526 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f0003d00 con 0x7f24fc0ff2e0 2023-05-08T03:42:01.071 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.062+0000 7f2501f15700 1 -- 172.21.15.96:0/4268941526 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24fc10aab0 con 0x7f24fc0ff2e0 2023-05-08T03:42:01.071 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.063+0000 7f2501f15700 1 -- 172.21.15.96:0/4268941526 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24fc1068e0 con 0x7f24fc0ff2e0 2023-05-08T03:42:01.071 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.064+0000 7f24f8ff9700 1 -- 172.21.15.96:0/4268941526 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f24f0004380 con 0x7f24fc0ff2e0 2023-05-08T03:42:01.071 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.065+0000 7f24f8ff9700 1 --2- 172.21.15.96:0/4268941526 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f24e40a11e0 0x7f24e40a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:01.072 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.065+0000 7f24faffd700 1 --2- 172.21.15.96:0/4268941526 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f24e40a11e0 0x7f24e40a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:01.072 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.065+0000 7f24f8ff9700 1 -- 172.21.15.96:0/4268941526 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f24f00cc9a0 con 0x7f24fc0ff2e0 2023-05-08T03:42:01.072 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.065+0000 7f24faffd700 1 --2- 172.21.15.96:0/4268941526 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f24e40a11e0 0x7f24e40a3690 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f24ec00b5c0 tx=0x7f24ec005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:42:01.072 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.068+0000 7f24f8ff9700 1 -- 172.21.15.96:0/4268941526 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f24f0096090 con 0x7f24fc0ff2e0 2023-05-08T03:42:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:00 smithi133 ceph-mon[125939]: pgmap v295: 97 pgs: 97 active+clean; 636 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T03:42:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:00 smithi096 ceph-mon[124666]: pgmap v295: 97 pgs: 97 active+clean; 636 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T03:42:01.262 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.259+0000 7f2501f15700 1 -- 172.21.15.96:0/4268941526 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump"} v 0) v1 -- 0x7f24fc066fa0 con 0x7f24fc0ff2e0 2023-05-08T03:42:01.263 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.260+0000 7f24f8ff9700 1 -- 172.21.15.96:0/4268941526 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v84) v1 ==== 56+0+5225 (secure 0 0 0) 0x7f24f00996b0 con 0x7f24fc0ff2e0 2023-05-08T03:42:01.263 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 84 2023-05-08T03:42:01.263 INFO:teuthology.orchestra.run.smithi096.stdout:fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c 2023-05-08T03:42:01.263 INFO:teuthology.orchestra.run.smithi096.stdout:created 2023-05-08T03:33:42.765680+0000 2023-05-08T03:42:01.264 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2023-05-08T03:41:39.350582+0000 2023-05-08T03:42:01.264 INFO:teuthology.orchestra.run.smithi096.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2023-05-08T03:42:01.264 INFO:teuthology.orchestra.run.smithi096.stdout:crush_version 26 2023-05-08T03:42:01.264 INFO:teuthology.orchestra.run.smithi096.stdout:full_ratio 0.95 2023-05-08T03:42:01.264 INFO:teuthology.orchestra.run.smithi096.stdout:backfillfull_ratio 0.9 2023-05-08T03:42:01.264 INFO:teuthology.orchestra.run.smithi096.stdout:nearfull_ratio 0.85 2023-05-08T03:42:01.264 INFO:teuthology.orchestra.run.smithi096.stdout:require_min_compat_client luminous 2023-05-08T03:42:01.264 INFO:teuthology.orchestra.run.smithi096.stdout:min_compat_client luminous 2023-05-08T03:42:01.265 INFO:teuthology.orchestra.run.smithi096.stdout:require_osd_release reef 2023-05-08T03:42:01.265 INFO:teuthology.orchestra.run.smithi096.stdout:stretch_mode_enabled false 2023-05-08T03:42:01.265 INFO:teuthology.orchestra.run.smithi096.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2023-05-08T03:42:01.265 INFO:teuthology.orchestra.run.smithi096.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 81 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2023-05-08T03:42:01.265 INFO:teuthology.orchestra.run.smithi096.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 82 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2023-05-08T03:42:01.265 INFO:teuthology.orchestra.run.smithi096.stdout:max_osd 12 2023-05-08T03:42:01.265 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 up in weight 1 up_from 8 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.96:6802/1816903726,v1:172.21.15.96:6803/1816903726] [v2:172.21.15.96:6804/1816903726,v1:172.21.15.96:6805/1816903726] exists,up 2ee801e1-8eec-496d-a9ac-fc566b38bbfa 2023-05-08T03:42:01.266 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 up in weight 1 up_from 13 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.133:6800/206989126,v1:172.21.15.133:6801/206989126] [v2:172.21.15.133:6802/206989126,v1:172.21.15.133:6803/206989126] exists,up eb73deea-fc7c-4f2f-8aef-2d71c598afda 2023-05-08T03:42:01.266 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 up in weight 1 up_from 18 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.186:6800/1791188143,v1:172.21.15.186:6801/1791188143] [v2:172.21.15.186:6802/1791188143,v1:172.21.15.186:6803/1791188143] exists,up 74a2f239-e82d-4d87-9458-5373b6cbbffd 2023-05-08T03:42:01.266 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 up in weight 1 up_from 25 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.96:6810/3430402140,v1:172.21.15.96:6811/3430402140] [v2:172.21.15.96:6812/3430402140,v1:172.21.15.96:6813/3430402140] exists,up 421eedf5-ba6e-484e-b715-78c1c10d684e 2023-05-08T03:42:01.266 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 up in weight 1 up_from 33 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.133:6808/1237495996,v1:172.21.15.133:6809/1237495996] [v2:172.21.15.133:6810/1237495996,v1:172.21.15.133:6811/1237495996] exists,up fb20100b-6a5a-462d-955d-1697a3861e96 2023-05-08T03:42:01.266 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 up in weight 1 up_from 38 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.186:6808/541111862,v1:172.21.15.186:6809/541111862] [v2:172.21.15.186:6810/541111862,v1:172.21.15.186:6811/541111862] exists,up 00177913-8bd6-4391-83c3-08c2b1b8ef13 2023-05-08T03:42:01.266 INFO:teuthology.orchestra.run.smithi096.stdout:osd.6 up in weight 1 up_from 45 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.96:6818/386227948,v1:172.21.15.96:6819/386227948] [v2:172.21.15.96:6820/386227948,v1:172.21.15.96:6821/386227948] exists,up 204baab6-ca6f-4eef-8b9c-91efc04cc30c 2023-05-08T03:42:01.266 INFO:teuthology.orchestra.run.smithi096.stdout:osd.7 up in weight 1 up_from 50 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.133:6816/218507954,v1:172.21.15.133:6817/218507954] [v2:172.21.15.133:6818/218507954,v1:172.21.15.133:6819/218507954] exists,up 282db569-a76e-485b-a33d-f2579b956525 2023-05-08T03:42:01.266 INFO:teuthology.orchestra.run.smithi096.stdout:osd.8 up in weight 1 up_from 58 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.186:6816/1648475902,v1:172.21.15.186:6817/1648475902] [v2:172.21.15.186:6818/1648475902,v1:172.21.15.186:6819/1648475902] exists,up 693e25b5-355d-4990-9467-0fac4c9133fc 2023-05-08T03:42:01.267 INFO:teuthology.orchestra.run.smithi096.stdout:osd.9 up in weight 1 up_from 65 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.96:6826/543223824,v1:172.21.15.96:6827/543223824] [v2:172.21.15.96:6828/543223824,v1:172.21.15.96:6829/543223824] exists,up 72fbff09-fe28-4014-86fc-c31f95cd19a9 2023-05-08T03:42:01.267 INFO:teuthology.orchestra.run.smithi096.stdout:osd.10 up in weight 1 up_from 70 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.133:6824/2323107912,v1:172.21.15.133:6825/2323107912] [v2:172.21.15.133:6826/2323107912,v1:172.21.15.133:6827/2323107912] exists,up 6c2b6757-60c2-4962-9409-6051dcb13273 2023-05-08T03:42:01.267 INFO:teuthology.orchestra.run.smithi096.stdout:osd.11 up in weight 1 up_from 77 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.186:6824/3853499290,v1:172.21.15.186:6825/3853499290] [v2:172.21.15.186:6826/3853499290,v1:172.21.15.186:6827/3853499290] exists,up 03c0bb25-2921-446b-960e-6a7a328d36a0 2023-05-08T03:42:01.267 INFO:teuthology.orchestra.run.smithi096.stdout:pg_upmap_items 2.f [8,11] 2023-05-08T03:42:01.267 INFO:teuthology.orchestra.run.smithi096.stdout:pg_upmap_items 2.13 [2,11] 2023-05-08T03:42:01.267 INFO:teuthology.orchestra.run.smithi096.stdout:pg_upmap_items 3.10 [5,9] 2023-05-08T03:42:01.267 INFO:teuthology.orchestra.run.smithi096.stdout:pg_upmap_items 3.17 [4,8] 2023-05-08T03:42:01.268 INFO:teuthology.orchestra.run.smithi096.stdout:pg_upmap_items 3.1e [3,9] 2023-05-08T03:42:01.268 INFO:teuthology.orchestra.run.smithi096.stdout:pg_upmap_items 3.2c [4,9] 2023-05-08T03:42:01.268 INFO:teuthology.orchestra.run.smithi096.stdout:blocklist 172.21.15.96:0/1333468881 expires 2023-05-09T03:34:37.472043+0000 2023-05-08T03:42:01.268 INFO:teuthology.orchestra.run.smithi096.stdout:blocklist 172.21.15.96:6800/1979917756 expires 2023-05-09T03:34:37.472043+0000 2023-05-08T03:42:01.268 INFO:teuthology.orchestra.run.smithi096.stdout:blocklist 172.21.15.96:0/1332045367 expires 2023-05-09T03:34:37.472043+0000 2023-05-08T03:42:01.268 INFO:teuthology.orchestra.run.smithi096.stdout:blocklist 172.21.15.96:0/520278090 expires 2023-05-09T03:34:14.800324+0000 2023-05-08T03:42:01.268 INFO:teuthology.orchestra.run.smithi096.stdout:blocklist 172.21.15.96:0/1055409415 expires 2023-05-09T03:34:37.472043+0000 2023-05-08T03:42:01.268 INFO:teuthology.orchestra.run.smithi096.stdout:blocklist 172.21.15.96:6801/1979917756 expires 2023-05-09T03:34:37.472043+0000 2023-05-08T03:42:01.269 INFO:teuthology.orchestra.run.smithi096.stdout:blocklist 172.21.15.96:0/1541933328 expires 2023-05-09T03:34:14.800324+0000 2023-05-08T03:42:01.269 INFO:teuthology.orchestra.run.smithi096.stdout:blocklist 172.21.15.96:6800/3944122753 expires 2023-05-09T03:34:14.800324+0000 2023-05-08T03:42:01.269 INFO:teuthology.orchestra.run.smithi096.stdout:blocklist 172.21.15.96:0/2986058319 expires 2023-05-09T03:34:14.800324+0000 2023-05-08T03:42:01.269 INFO:teuthology.orchestra.run.smithi096.stdout:blocklist 172.21.15.96:6801/3944122753 expires 2023-05-09T03:34:14.800324+0000 2023-05-08T03:42:01.270 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.262+0000 7f2501f15700 1 -- 172.21.15.96:0/4268941526 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f24e40a11e0 msgr2=0x7f24e40a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:01.270 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.262+0000 7f2501f15700 1 --2- 172.21.15.96:0/4268941526 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f24e40a11e0 0x7f24e40a3690 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f24ec00b5c0 tx=0x7f24ec005fb0 comp rx=0 tx=0).stop 2023-05-08T03:42:01.270 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.262+0000 7f2501f15700 1 -- 172.21.15.96:0/4268941526 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24fc0ff2e0 msgr2=0x7f24fc195000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:01.270 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.262+0000 7f2501f15700 1 --2- 172.21.15.96:0/4268941526 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24fc0ff2e0 0x7f24fc195000 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f24f000c9a0 tx=0x7f24f000cd60 comp rx=0 tx=0).stop 2023-05-08T03:42:01.270 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.262+0000 7f2501f15700 1 -- 172.21.15.96:0/4268941526 shutdown_connections 2023-05-08T03:42:01.270 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.262+0000 7f2501f15700 1 --2- 172.21.15.96:0/4268941526 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f24e40a11e0 0x7f24e40a3690 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:01.271 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.262+0000 7f2501f15700 1 --2- 172.21.15.96:0/4268941526 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24fc100e70 0x7f24fc19c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:01.271 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.262+0000 7f2501f15700 1 --2- 172.21.15.96:0/4268941526 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24fc0ff2e0 0x7f24fc195000 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:01.271 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.262+0000 7f2501f15700 1 --2- 172.21.15.96:0/4268941526 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f24fc1004e0 0x7f24fc195540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:01.271 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.262+0000 7f2501f15700 1 -- 172.21.15.96:0/4268941526 >> 172.21.15.96:0/4268941526 conn(0x7f24fc0fa8f0 msgr2=0x7f24fc103a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:42:01.271 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.262+0000 7f2501f15700 1 -- 172.21.15.96:0/4268941526 shutdown_connections 2023-05-08T03:42:01.271 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.262+0000 7f2501f15700 1 -- 172.21.15.96:0/4268941526 wait complete. 2023-05-08T03:42:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:00 smithi186 ceph-mon[126480]: pgmap v295: 97 pgs: 97 active+clean; 636 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T03:42:01.596 INFO:teuthology.run_tasks:Running task fs.ready... 2023-05-08T03:42:01.729 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-08T03:42:01.860 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.853+0000 7fa56d42c700 1 -- 172.21.15.96:0/3865595800 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa568100d90 msgr2=0x7fa568107650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:01.861 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.853+0000 7fa56d42c700 1 --2- 172.21.15.96:0/3865595800 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa568100d90 0x7fa568107650 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fa56000b0a0 tx=0x7fa56000b3b0 comp rx=0 tx=0).stop 2023-05-08T03:42:01.861 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.853+0000 7fa56d42c700 1 -- 172.21.15.96:0/3865595800 shutdown_connections 2023-05-08T03:42:01.861 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.853+0000 7fa56d42c700 1 --2- 172.21.15.96:0/3865595800 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa568100d90 0x7fa568107650 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:01.862 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.853+0000 7fa56d42c700 1 --2- 172.21.15.96:0/3865595800 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa5680ff210 0x7fa5680ff620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:01.862 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.853+0000 7fa56d42c700 1 --2- 172.21.15.96:0/3865595800 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa568100400 0x7fa568100850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:01.862 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.853+0000 7fa56d42c700 1 -- 172.21.15.96:0/3865595800 >> 172.21.15.96:0/3865595800 conn(0x7fa5680fa7f0 msgr2=0x7fa5680fcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:42:01.862 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.853+0000 7fa56d42c700 1 -- 172.21.15.96:0/3865595800 shutdown_connections 2023-05-08T03:42:01.862 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.853+0000 7fa56d42c700 1 -- 172.21.15.96:0/3865595800 wait complete. 2023-05-08T03:42:01.862 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.854+0000 7fa56d42c700 1 Processor -- start 2023-05-08T03:42:01.862 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.854+0000 7fa56d42c700 1 -- start start 2023-05-08T03:42:01.863 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.854+0000 7fa56d42c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5680ff210 0x7fa5681961c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:01.863 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.854+0000 7fa56d42c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa568100400 0x7fa568196700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:01.863 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.854+0000 7fa56d42c700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa568100d90 0x7fa56819d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:01.863 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.854+0000 7fa56d42c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa56819dd40 con 0x7fa5680ff210 2023-05-08T03:42:01.863 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.854+0000 7fa56d42c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa56819de80 con 0x7fa568100400 2023-05-08T03:42:01.863 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.854+0000 7fa56d42c700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa56819e010 con 0x7fa568100d90 2023-05-08T03:42:01.863 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.854+0000 7fa566ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5680ff210 0x7fa5681961c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:01.864 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.855+0000 7fa566ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5680ff210 0x7fa5681961c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41458/0 (socket says 172.21.15.96:41458) 2023-05-08T03:42:01.864 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.855+0000 7fa566ffd700 1 -- 172.21.15.96:0/1338115711 learned_addr learned my addr 172.21.15.96:0/1338115711 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:42:01.864 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.855+0000 7fa5667fc700 1 --2- 172.21.15.96:0/1338115711 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa568100400 0x7fa568196700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:01.864 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.855+0000 7fa5677fe700 1 --2- 172.21.15.96:0/1338115711 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa568100d90 0x7fa56819d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:01.864 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.855+0000 7fa566ffd700 1 -- 172.21.15.96:0/1338115711 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa568100d90 msgr2=0x7fa56819d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:01.864 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.855+0000 7fa566ffd700 1 --2- 172.21.15.96:0/1338115711 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa568100d90 0x7fa56819d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:01.865 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.855+0000 7fa566ffd700 1 -- 172.21.15.96:0/1338115711 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa568100400 msgr2=0x7fa568196700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:01.865 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.855+0000 7fa566ffd700 1 --2- 172.21.15.96:0/1338115711 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa568100400 0x7fa568196700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:01.865 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.855+0000 7fa566ffd700 1 -- 172.21.15.96:0/1338115711 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa560009d00 con 0x7fa5680ff210 2023-05-08T03:42:01.865 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.855+0000 7fa5667fc700 1 --2- 172.21.15.96:0/1338115711 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa568100400 0x7fa568196700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-08T03:42:01.865 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.855+0000 7fa566ffd700 1 --2- 172.21.15.96:0/1338115711 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5680ff210 0x7fa5681961c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa55c00d980 tx=0x7fa55c00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:42:01.866 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.855+0000 7fa54ffff700 1 -- 172.21.15.96:0/1338115711 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55c00de60 con 0x7fa5680ff210 2023-05-08T03:42:01.866 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.855+0000 7fa54ffff700 1 -- 172.21.15.96:0/1338115711 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa55c0044e0 con 0x7fa5680ff210 2023-05-08T03:42:01.866 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.855+0000 7fa56d42c700 1 -- 172.21.15.96:0/1338115711 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa56810abe0 con 0x7fa5680ff210 2023-05-08T03:42:01.866 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.855+0000 7fa54ffff700 1 -- 172.21.15.96:0/1338115711 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55c003be0 con 0x7fa5680ff210 2023-05-08T03:42:01.866 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.855+0000 7fa56d42c700 1 -- 172.21.15.96:0/1338115711 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa56810aa50 con 0x7fa5680ff210 2023-05-08T03:42:01.866 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.856+0000 7fa56d42c700 1 -- 172.21.15.96:0/1338115711 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa568067af0 con 0x7fa5680ff210 2023-05-08T03:42:01.866 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.857+0000 7fa54ffff700 1 -- 172.21.15.96:0/1338115711 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fa55c009bb0 con 0x7fa5680ff210 2023-05-08T03:42:01.867 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.858+0000 7fa54ffff700 1 --2- 172.21.15.96:0/1338115711 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fa5500a11e0 0x7fa5500a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:01.867 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.858+0000 7fa5667fc700 1 --2- 172.21.15.96:0/1338115711 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fa5500a11e0 0x7fa5500a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:01.868 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.858+0000 7fa54ffff700 1 -- 172.21.15.96:0/1338115711 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7fa55c0cc830 con 0x7fa5680ff210 2023-05-08T03:42:01.868 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.858+0000 7fa5667fc700 1 --2- 172.21.15.96:0/1338115711 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fa5500a11e0 0x7fa5500a3690 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa558009cb0 tx=0x7fa558009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:42:01.868 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:01.862+0000 7fa54ffff700 1 -- 172.21.15.96:0/1338115711 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fa55c095e20 con 0x7fa5680ff210 2023-05-08T03:42:02.053 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.051+0000 7fa56d42c700 1 -- 172.21.15.96:0/1338115711 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa56819ed10 con 0x7fa5680ff210 2023-05-08T03:42:02.055 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.052+0000 7fa54ffff700 1 -- 172.21.15.96:0/1338115711 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+22437 (secure 0 0 0) 0x7fa55c009940 con 0x7fa5680ff210 2023-05-08T03:42:02.055 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:42:02.056 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":84,"fsid":"f7ffcfb0-ed50-11ed-9b01-001a4aab830c","created":"2023-05-08T03:33:42.765680+0000","modified":"2023-05-08T03:41:39.350582+0000","last_up_change":"2023-05-08T03:40:07.550882+0000","last_in_change":"2023-05-08T03:39:49.027947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-08T03:36:47.800739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-05-08T03:40:47.229693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-05-08T03:40:48.359294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2ee801e1-8eec-496d-a9ac-fc566b38bbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":1816903726},{"type":"v1","addr":"172.21.15.96:6803","nonce":1816903726}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":1816903726},{"type":"v1","addr":"172.21.15.96:6805","nonce":1816903726}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":1816903726},{"type":"v1","addr":"172.21.15.96:6809","nonce":1816903726}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":1816903726},{"type":"v1","addr":"172.21.15.96:6807","nonce":1816903726}]},"public_addr":"172.21.15.96:6803/1816903726","cluster_addr":"172.21.15.96:6805/1816903726","heartbeat_back_addr":"172.21.15.96:6809/1816903726","heartbeat_front_addr":"172.21.15.96:6807/1816903726","state":["exists","up"]},{"osd":1,"uuid":"eb73deea-fc7c-4f2f-8aef-2d71c598afda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":206989126},{"type":"v1","addr":"172.21.15.133:6801","nonce":206989126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":206989126},{"type":"v1","addr":"172.21.15.133:6803","nonce":206989126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":206989126},{"type":"v1","addr":"172.21.15.133:6807","nonce":206989126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":206989126},{"type":"v1","addr":"172.21.15.133:6805","nonce":206989126}]},"public_addr":"172.21.15.133:6801/206989126","cluster_addr":"172.21.15.133:6803/206989126","heartbeat_back_addr":"172.21.15.133:6807/206989126","heartbeat_front_addr":"172.21.15.133:6805/206989126","state":["exists","up"]},{"osd":2,"uuid":"74a2f239-e82d-4d87-9458-5373b6cbbffd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":1791188143},{"type":"v1","addr":"172.21.15.186:6801","nonce":1791188143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":1791188143},{"type":"v1","addr":"172.21.15.186:6803","nonce":1791188143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":1791188143},{"type":"v1","addr":"172.21.15.186:6807","nonce":1791188143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":1791188143},{"type":"v1","addr":"172.21.15.186:6805","nonce":1791188143}]},"public_addr":"172.21.15.186:6801/1791188143","cluster_addr":"172.21.15.186:6803/1791188143","heartbeat_back_addr":"172.21.15.186:6807/1791188143","heartbeat_front_addr":"172.21.15.186:6805/1791188143","state":["exists","up"]},{"osd":3,"uuid":"421eedf5-ba6e-484e-b715-78c1c10d684e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":3430402140},{"type":"v1","addr":"172.21.15.96:6811","nonce":3430402140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":3430402140},{"type":"v1","addr":"172.21.15.96:6813","nonce":3430402140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":3430402140},{"type":"v1","addr":"172.21.15.96:6817","nonce":3430402140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":3430402140},{"type":"v1","addr":"172.21.15.96:6815","nonce":3430402140}]},"public_addr":"172.21.15.96:6811/3430402140","cluster_addr":"172.21.15.96:6813/3430402140","heartbeat_back_addr":"172.21.15.96:6817/3430402140","heartbeat_front_addr":"172.21.15.96:6815/3430402140","state":["exists","up"]},{"osd":4,"uuid":"fb20100b-6a5a-462d-955d-1697a3861e96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":1237495996},{"type":"v1","addr":"172.21.15.133:6809","nonce":1237495996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":1237495996},{"type":"v1","addr":"172.21.15.133:6811","nonce":1237495996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":1237495996},{"type":"v1","addr":"172.21.15.133:6815","nonce":1237495996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":1237495996},{"type":"v1","addr":"172.21.15.133:6813","nonce":1237495996}]},"public_addr":"172.21.15.133:6809/1237495996","cluster_addr":"172.21.15.133:6811/1237495996","heartbeat_back_addr":"172.21.15.133:6815/1237495996","heartbeat_front_addr":"172.21.15.133:6813/1237495996","state":["exists","up"]},{"osd":5,"uuid":"00177913-8bd6-4391-83c3-08c2b1b8ef13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":541111862},{"type":"v1","addr":"172.21.15.186:6809","nonce":541111862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":541111862},{"type":"v1","addr":"172.21.15.186:6811","nonce":541111862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":541111862},{"type":"v1","addr":"172.21.15.186:6815","nonce":541111862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":541111862},{"type":"v1","addr":"172.21.15.186:6813","nonce":541111862}]},"public_addr":"172.21.15.186:6809/541111862","cluster_addr":"172.21.15.186:6811/541111862","heartbeat_back_addr":"172.21.15.186:6815/541111862","heartbeat_front_addr":"172.21.15.186:6813/541111862","state":["exists","up"]},{"osd":6,"uuid":"204baab6-ca6f-4eef-8b9c-91efc04cc30c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":386227948},{"type":"v1","addr":"172.21.15.96:6819","nonce":386227948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":386227948},{"type":"v1","addr":"172.21.15.96:6821","nonce":386227948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":386227948},{"type":"v1","addr":"172.21.15.96:6825","nonce":386227948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":386227948},{"type":"v1","addr":"172.21.15.96:6823","nonce":386227948}]},"public_addr":"172.21.15.96:6819/386227948","cluster_addr":"172.21.15.96:6821/386227948","heartbeat_back_addr":"172.21.15.96:6825/386227948","heartbeat_front_addr":"172.21.15.96:6823/386227948","state":["exists","up"]},{"osd":7,"uuid":"282db569-a76e-485b-a33d-f2579b956525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":218507954},{"type":"v1","addr":"172.21.15.133:6817","nonce":218507954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":218507954},{"type":"v1","addr":"172.21.15.133:6819","nonce":218507954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":218507954},{"type":"v1","addr":"172.21.15.133:6823","nonce":218507954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":218507954},{"type":"v1","addr":"172.21.15.133:6821","nonce":218507954}]},"public_addr":"172.21.15.133:6817/218507954","cluster_addr":"172.21.15.133:6819/218507954","heartbeat_back_addr":"172.21.15.133:6823/218507954","heartbeat_front_addr":"172.21.15.133:6821/218507954","state":["exists","up"]},{"osd":8,"uuid":"693e25b5-355d-4990-9467-0fac4c9133fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":1648475902},{"type":"v1","addr":"172.21.15.186:6817","nonce":1648475902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":1648475902},{"type":"v1","addr":"172.21.15.186:6819","nonce":1648475902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":1648475902},{"type":"v1","addr":"172.21.15.186:6823","nonce":1648475902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":1648475902},{"type":"v1","addr":"172.21.15.186:6821","nonce":1648475902}]},"public_addr":"172.21.15.186:6817/1648475902","cluster_addr":"172.21.15.186:6819/1648475902","heartbeat_back_addr":"172.21.15.186:6823/1648475902","heartbeat_front_addr":"172.21.15.186:6821/1648475902","state":["exists","up"]},{"osd":9,"uuid":"72fbff09-fe28-4014-86fc-c31f95cd19a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":543223824},{"type":"v1","addr":"172.21.15.96:6827","nonce":543223824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":543223824},{"type":"v1","addr":"172.21.15.96:6829","nonce":543223824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6832","nonce":543223824},{"type":"v1","addr":"172.21.15.96:6833","nonce":543223824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":543223824},{"type":"v1","addr":"172.21.15.96:6831","nonce":543223824}]},"public_addr":"172.21.15.96:6827/543223824","cluster_addr":"172.21.15.96:6829/543223824","heartbeat_back_addr":"172.21.15.96:6833/543223824","heartbeat_front_addr":"172.21.15.96:6831/543223824","state":["exists","up"]},{"osd":10,"uuid":"6c2b6757-60c2-4962-9409-6051dcb13273","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":2323107912},{"type":"v1","addr":"172.21.15.133:6825","nonce":2323107912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":2323107912},{"type":"v1","addr":"172.21.15.133:6827","nonce":2323107912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":2323107912},{"type":"v1","addr":"172.21.15.133:6831","nonce":2323107912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":2323107912},{"type":"v1","addr":"172.21.15.133:6829","nonce":2323107912}]},"public_addr":"172.21.15.133:6825/2323107912","cluster_addr":"172.21.15.133:6827/2323107912","heartbeat_back_addr":"172.21.15.133:6831/2323107912","heartbeat_front_addr":"172.21.15.133:6829/2323107912","state":["exists","up"]},{"osd":11,"uuid":"03c0bb25-2921-446b-960e-6a7a328d36a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":3853499290},{"type":"v1","addr":"172.21.15.186:6825","nonce":3853499290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":3853499290},{"type":"v1","addr":"172.21.15.186:6827","nonce":3853499290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":3853499290},{"type":"v1","addr":"172.21.15.186:6831","nonce":3853499290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":3853499290},{"type":"v1","addr":"172.21.15.186:6829","nonce":3853499290}]},"public_addr":"172.21.15.186:6825/3853499290","cluster_addr":"172.21.15.186:6827/3853499290","heartbeat_back_addr":"172.21.15.186:6831/3853499290","heartbeat_front_addr":"172.21.15.186:6829/3853499290","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:36:02.087281+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:36:24.328783+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:36:46.135576+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:37:08.524145+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:37:30.883871+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:37:53.344554+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:38:15.448162+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:38:37.414878+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:38:59.533953+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:39:21.392102+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:39:43.462696+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:40:05.561808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.96:0/1333468881":"2023-05-09T03:34:37.472043+0000","172.21.15.96:6800/1979917756":"2023-05-09T03:34:37.472043+0000","172.21.15.96:0/1332045367":"2023-05-09T03:34:37.472043+0000","172.21.15.96:0/520278090":"2023-05-09T03:34:14.800324+0000","172.21.15.96:0/1055409415":"2023-05-09T03:34:37.472043+0000","172.21.15.96:6801/1979917756":"2023-05-09T03:34:37.472043+0000","172.21.15.96:0/1541933328":"2023-05-09T03:34:14.800324+0000","172.21.15.96:6800/3944122753":"2023-05-09T03:34:14.800324+0000","172.21.15.96:0/2986058319":"2023-05-09T03:34:14.800324+0000","172.21.15.96:6801/3944122753":"2023-05-09T03:34:14.800324+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-08T03:42:02.057 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.055+0000 7fa56d42c700 1 -- 172.21.15.96:0/1338115711 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fa5500a11e0 msgr2=0x7fa5500a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:02.057 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.055+0000 7fa56d42c700 1 --2- 172.21.15.96:0/1338115711 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fa5500a11e0 0x7fa5500a3690 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa558009cb0 tx=0x7fa558009260 comp rx=0 tx=0).stop 2023-05-08T03:42:02.057 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.055+0000 7fa56d42c700 1 -- 172.21.15.96:0/1338115711 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5680ff210 msgr2=0x7fa5681961c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:02.058 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.055+0000 7fa56d42c700 1 --2- 172.21.15.96:0/1338115711 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5680ff210 0x7fa5681961c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa55c00d980 tx=0x7fa55c00dd40 comp rx=0 tx=0).stop 2023-05-08T03:42:02.058 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.055+0000 7fa56d42c700 1 -- 172.21.15.96:0/1338115711 shutdown_connections 2023-05-08T03:42:02.058 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.055+0000 7fa56d42c700 1 --2- 172.21.15.96:0/1338115711 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fa5500a11e0 0x7fa5500a3690 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:02.058 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.055+0000 7fa56d42c700 1 --2- 172.21.15.96:0/1338115711 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa568100d90 0x7fa56819d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:02.058 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.055+0000 7fa56d42c700 1 --2- 172.21.15.96:0/1338115711 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5680ff210 0x7fa5681961c0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:02.058 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.055+0000 7fa56d42c700 1 --2- 172.21.15.96:0/1338115711 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa568100400 0x7fa568196700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:02.059 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.055+0000 7fa56d42c700 1 -- 172.21.15.96:0/1338115711 >> 172.21.15.96:0/1338115711 conn(0x7fa5680fa7f0 msgr2=0x7fa568067ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:42:02.059 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.055+0000 7fa56d42c700 1 -- 172.21.15.96:0/1338115711 shutdown_connections 2023-05-08T03:42:02.059 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.055+0000 7fa56d42c700 1 -- 172.21.15.96:0/1338115711 wait complete. 2023-05-08T03:42:02.070 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-08T03:36:47.800739+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-08T03:40:47.229693+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-05-08T03:40:48.359294+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-08T03:42:02.071 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-08T03:42:02.196 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.192+0000 7f956bef1700 1 -- 172.21.15.96:0/3218701423 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95641037a0 msgr2=0x7f9564105b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:02.197 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.192+0000 7f956bef1700 1 --2- 172.21.15.96:0/3218701423 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95641037a0 0x7f9564105b80 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f9560009990 tx=0x7f9560009ca0 comp rx=0 tx=0).stop 2023-05-08T03:42:02.197 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.192+0000 7f956bef1700 1 -- 172.21.15.96:0/3218701423 shutdown_connections 2023-05-08T03:42:02.197 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.192+0000 7f956bef1700 1 --2- 172.21.15.96:0/3218701423 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f95641060c0 0x7f95641084a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:02.197 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.192+0000 7f956bef1700 1 --2- 172.21.15.96:0/3218701423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9564100e80 0x7f9564103260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:02.197 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.192+0000 7f956bef1700 1 --2- 172.21.15.96:0/3218701423 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95641037a0 0x7f9564105b80 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:02.197 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.192+0000 7f956bef1700 1 -- 172.21.15.96:0/3218701423 >> 172.21.15.96:0/3218701423 conn(0x7f95640fa840 msgr2=0x7f95640fcc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:42:02.198 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.192+0000 7f956bef1700 1 -- 172.21.15.96:0/3218701423 shutdown_connections 2023-05-08T03:42:02.198 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.192+0000 7f956bef1700 1 -- 172.21.15.96:0/3218701423 wait complete. 2023-05-08T03:42:02.198 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.193+0000 7f956bef1700 1 Processor -- start 2023-05-08T03:42:02.198 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.193+0000 7f956bef1700 1 -- start start 2023-05-08T03:42:02.198 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.193+0000 7f956bef1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9564100e80 0x7f9564196010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:02.198 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.193+0000 7f956bef1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95641037a0 0x7f9564196550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:02.198 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.193+0000 7f956bef1700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f95641060c0 0x7f956419d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:02.199 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.193+0000 7f956bef1700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f956419db90 con 0x7f95641037a0 2023-05-08T03:42:02.199 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.193+0000 7f956bef1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f956419dcd0 con 0x7f9564100e80 2023-05-08T03:42:02.199 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.193+0000 7f956bef1700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f956419de60 con 0x7f95641060c0 2023-05-08T03:42:02.199 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.193+0000 7f956948c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95641037a0 0x7f9564196550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:02.199 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.193+0000 7f956948c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95641037a0 0x7f9564196550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41476/0 (socket says 172.21.15.96:41476) 2023-05-08T03:42:02.199 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.193+0000 7f956948c700 1 -- 172.21.15.96:0/981308214 learned_addr learned my addr 172.21.15.96:0/981308214 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:42:02.199 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.193+0000 7f956a48e700 1 --2- 172.21.15.96:0/981308214 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f95641060c0 0x7f956419d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:02.201 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.193+0000 7f9569c8d700 1 --2- 172.21.15.96:0/981308214 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9564100e80 0x7f9564196010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:02.201 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.194+0000 7f956948c700 1 -- 172.21.15.96:0/981308214 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f95641060c0 msgr2=0x7f956419d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:02.201 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.194+0000 7f956948c700 1 --2- 172.21.15.96:0/981308214 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f95641060c0 0x7f956419d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:02.201 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.194+0000 7f956948c700 1 -- 172.21.15.96:0/981308214 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9564100e80 msgr2=0x7f9564196010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:02.201 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.194+0000 7f956948c700 1 --2- 172.21.15.96:0/981308214 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9564100e80 0x7f9564196010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:02.201 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.194+0000 7f956948c700 1 -- 172.21.15.96:0/981308214 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95600095f0 con 0x7f95641037a0 2023-05-08T03:42:02.202 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.194+0000 7f956a48e700 1 --2- 172.21.15.96:0/981308214 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f95641060c0 0x7f956419d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-08T03:42:02.202 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.194+0000 7f956948c700 1 --2- 172.21.15.96:0/981308214 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95641037a0 0x7f9564196550 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f9560000c00 tx=0x7f956000f830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:42:02.202 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.194+0000 7f955affd700 1 -- 172.21.15.96:0/981308214 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f956001d070 con 0x7f95641037a0 2023-05-08T03:42:02.202 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.194+0000 7f955affd700 1 -- 172.21.15.96:0/981308214 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f956000fce0 con 0x7f95641037a0 2023-05-08T03:42:02.202 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.194+0000 7f956bef1700 1 -- 172.21.15.96:0/981308214 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f956410bd20 con 0x7f95641037a0 2023-05-08T03:42:02.203 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.194+0000 7f955affd700 1 -- 172.21.15.96:0/981308214 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95600176e0 con 0x7f95641037a0 2023-05-08T03:42:02.203 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.194+0000 7f956bef1700 1 -- 172.21.15.96:0/981308214 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f956410bb90 con 0x7f95641037a0 2023-05-08T03:42:02.204 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.195+0000 7f956bef1700 1 -- 172.21.15.96:0/981308214 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95640fc3b0 con 0x7f95641037a0 2023-05-08T03:42:02.204 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.196+0000 7f955affd700 1 -- 172.21.15.96:0/981308214 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f9560022470 con 0x7f95641037a0 2023-05-08T03:42:02.204 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.196+0000 7f955affd700 1 --2- 172.21.15.96:0/981308214 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f95500a11e0 0x7f95500a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:02.204 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.197+0000 7f9569c8d700 1 --2- 172.21.15.96:0/981308214 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f95500a11e0 0x7f95500a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:02.204 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.197+0000 7f955affd700 1 -- 172.21.15.96:0/981308214 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f95600cdee0 con 0x7f95641037a0 2023-05-08T03:42:02.204 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.197+0000 7f9569c8d700 1 --2- 172.21.15.96:0/981308214 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f95500a11e0 0x7f95500a3690 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f9554005ea0 tx=0x7f9554005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:42:02.205 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.201+0000 7f955affd700 1 -- 172.21.15.96:0/981308214 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f956005c730 con 0x7f95641037a0 2023-05-08T03:42:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:01 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/4268941526' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-05-08T03:42:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:01 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/4268941526' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-05-08T03:42:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:01 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/4268941526' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-05-08T03:42:02.394 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.392+0000 7f956bef1700 1 -- 172.21.15.96:0/981308214 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9564061800 con 0x7f95641037a0 2023-05-08T03:42:02.395 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.392+0000 7f955affd700 1 -- 172.21.15.96:0/981308214 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) v1 ==== 93+0+10 (secure 0 0 0) 0x7f95600270a0 con 0x7f95641037a0 2023-05-08T03:42:02.395 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2023-05-08T03:42:02.397 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.394+0000 7f956bef1700 1 -- 172.21.15.96:0/981308214 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f95500a11e0 msgr2=0x7f95500a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:02.397 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.394+0000 7f956bef1700 1 --2- 172.21.15.96:0/981308214 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f95500a11e0 0x7f95500a3690 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f9554005ea0 tx=0x7f9554005e30 comp rx=0 tx=0).stop 2023-05-08T03:42:02.397 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.394+0000 7f956bef1700 1 -- 172.21.15.96:0/981308214 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95641037a0 msgr2=0x7f9564196550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:02.397 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.394+0000 7f956bef1700 1 --2- 172.21.15.96:0/981308214 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95641037a0 0x7f9564196550 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f9560000c00 tx=0x7f956000f830 comp rx=0 tx=0).stop 2023-05-08T03:42:02.397 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.394+0000 7f956bef1700 1 -- 172.21.15.96:0/981308214 shutdown_connections 2023-05-08T03:42:02.397 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.394+0000 7f956bef1700 1 --2- 172.21.15.96:0/981308214 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f95500a11e0 0x7f95500a3690 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:02.397 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.394+0000 7f956bef1700 1 --2- 172.21.15.96:0/981308214 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f95641060c0 0x7f956419d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:02.398 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.394+0000 7f956bef1700 1 --2- 172.21.15.96:0/981308214 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9564100e80 0x7f9564196010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:02.398 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.394+0000 7f956bef1700 1 --2- 172.21.15.96:0/981308214 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95641037a0 0x7f9564196550 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:02.398 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.394+0000 7f956bef1700 1 -- 172.21.15.96:0/981308214 >> 172.21.15.96:0/981308214 conn(0x7f95640fa840 msgr2=0x7f9564101ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:42:02.398 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.394+0000 7f956bef1700 1 -- 172.21.15.96:0/981308214 shutdown_connections 2023-05-08T03:42:02.398 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.394+0000 7f956bef1700 1 -- 172.21.15.96:0/981308214 wait complete. 2023-05-08T03:42:02.409 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-08T03:42:02.535 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.530+0000 7f009316c700 1 -- 172.21.15.96:0/698406673 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f008c101eb0 msgr2=0x7f008c108770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:02.535 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.530+0000 7f009316c700 1 --2- 172.21.15.96:0/698406673 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f008c101eb0 0x7f008c108770 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f008400b0a0 tx=0x7f008400b3b0 comp rx=0 tx=0).stop 2023-05-08T03:42:02.535 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.530+0000 7f009316c700 1 -- 172.21.15.96:0/698406673 shutdown_connections 2023-05-08T03:42:02.535 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.531+0000 7f009316c700 1 --2- 172.21.15.96:0/698406673 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f008c101eb0 0x7f008c108770 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:02.535 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.531+0000 7f009316c700 1 --2- 172.21.15.96:0/698406673 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f008c100330 0x7f008c100740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:02.536 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.531+0000 7f009316c700 1 --2- 172.21.15.96:0/698406673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f008c101520 0x7f008c101970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:02.536 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.531+0000 7f009316c700 1 -- 172.21.15.96:0/698406673 >> 172.21.15.96:0/698406673 conn(0x7f008c0fb950 msgr2=0x7f008c0fdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:42:02.536 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.531+0000 7f009316c700 1 -- 172.21.15.96:0/698406673 shutdown_connections 2023-05-08T03:42:02.536 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.531+0000 7f009316c700 1 -- 172.21.15.96:0/698406673 wait complete. 2023-05-08T03:42:02.536 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.531+0000 7f009316c700 1 Processor -- start 2023-05-08T03:42:02.536 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.531+0000 7f009316c700 1 -- start start 2023-05-08T03:42:02.536 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.531+0000 7f009316c700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f008c100330 0x7f008c196160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:02.536 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.531+0000 7f009316c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f008c101520 0x7f008c1966a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:02.537 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.531+0000 7f009316c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f008c101eb0 0x7f008c19d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:02.537 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.531+0000 7f009316c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f008c19dce0 con 0x7f008c101520 2023-05-08T03:42:02.537 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.531+0000 7f009316c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f008c19de20 con 0x7f008c101eb0 2023-05-08T03:42:02.537 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.531+0000 7f009316c700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f008c19dfb0 con 0x7f008c100330 2023-05-08T03:42:02.537 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.531+0000 7f008bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f008c101520 0x7f008c1966a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:02.537 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.531+0000 7f008bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f008c101520 0x7f008c1966a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41490/0 (socket says 172.21.15.96:41490) 2023-05-08T03:42:02.537 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.531+0000 7f008bfff700 1 -- 172.21.15.96:0/1854712202 learned_addr learned my addr 172.21.15.96:0/1854712202 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:42:02.538 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.531+0000 7f0090f08700 1 --2- 172.21.15.96:0/1854712202 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f008c100330 0x7f008c196160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:02.538 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.532+0000 7f0091709700 1 --2- 172.21.15.96:0/1854712202 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f008c101eb0 0x7f008c19d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:02.538 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.532+0000 7f008bfff700 1 -- 172.21.15.96:0/1854712202 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f008c100330 msgr2=0x7f008c196160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:02.538 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.532+0000 7f008bfff700 1 --2- 172.21.15.96:0/1854712202 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f008c100330 0x7f008c196160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:02.538 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.532+0000 7f008bfff700 1 -- 172.21.15.96:0/1854712202 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f008c101eb0 msgr2=0x7f008c19d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:02.538 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.532+0000 7f008bfff700 1 --2- 172.21.15.96:0/1854712202 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f008c101eb0 0x7f008c19d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:02.538 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.532+0000 7f008bfff700 1 -- 172.21.15.96:0/1854712202 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0084009d00 con 0x7f008c101520 2023-05-08T03:42:02.538 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.532+0000 7f0091709700 1 --2- 172.21.15.96:0/1854712202 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f008c101eb0 0x7f008c19d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-08T03:42:02.539 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.532+0000 7f008bfff700 1 --2- 172.21.15.96:0/1854712202 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f008c101520 0x7f008c1966a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f007800d950 tx=0x7f007800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:42:02.539 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.532+0000 7f0089ffb700 1 -- 172.21.15.96:0/1854712202 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0078009940 con 0x7f008c101520 2023-05-08T03:42:02.539 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.532+0000 7f0089ffb700 1 -- 172.21.15.96:0/1854712202 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0078010460 con 0x7f008c101520 2023-05-08T03:42:02.539 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.532+0000 7f009316c700 1 -- 172.21.15.96:0/1854712202 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f008c10bcb0 con 0x7f008c101520 2023-05-08T03:42:02.539 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.532+0000 7f0089ffb700 1 -- 172.21.15.96:0/1854712202 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f007800f620 con 0x7f008c101520 2023-05-08T03:42:02.539 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.532+0000 7f009316c700 1 -- 172.21.15.96:0/1854712202 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f008c10bb20 con 0x7f008c101520 2023-05-08T03:42:02.541 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.533+0000 7f009316c700 1 -- 172.21.15.96:0/1854712202 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f008c107830 con 0x7f008c101520 2023-05-08T03:42:02.541 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.535+0000 7f0089ffb700 1 -- 172.21.15.96:0/1854712202 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f00780108d0 con 0x7f008c101520 2023-05-08T03:42:02.541 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.535+0000 7f0089ffb700 1 --2- 172.21.15.96:0/1854712202 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f007c0a11e0 0x7f007c0a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:02.541 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.535+0000 7f0090f08700 1 --2- 172.21.15.96:0/1854712202 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f007c0a11e0 0x7f007c0a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:02.542 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.535+0000 7f0089ffb700 1 -- 172.21.15.96:0/1854712202 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f00780cc830 con 0x7f008c101520 2023-05-08T03:42:02.542 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.536+0000 7f0090f08700 1 --2- 172.21.15.96:0/1854712202 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f007c0a11e0 0x7f007c0a3690 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f008c101380 tx=0x7f008000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:42:02.543 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.539+0000 7f0089ffb700 1 -- 172.21.15.96:0/1854712202 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f0078095f20 con 0x7f008c101520 2023-05-08T03:42:02.730 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.728+0000 7f009316c700 1 -- 172.21.15.96:0/1854712202 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f008c061c80 con 0x7f008c101520 2023-05-08T03:42:02.731 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.728+0000 7f0089ffb700 1 -- 172.21.15.96:0/1854712202 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v84) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0078099540 con 0x7f008c101520 2023-05-08T03:42:02.731 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2023-05-08T03:42:02.733 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.730+0000 7f009316c700 1 -- 172.21.15.96:0/1854712202 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f007c0a11e0 msgr2=0x7f007c0a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:02.733 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.730+0000 7f009316c700 1 --2- 172.21.15.96:0/1854712202 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f007c0a11e0 0x7f007c0a3690 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f008c101380 tx=0x7f008000b410 comp rx=0 tx=0).stop 2023-05-08T03:42:02.733 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.730+0000 7f009316c700 1 -- 172.21.15.96:0/1854712202 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f008c101520 msgr2=0x7f008c1966a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:02.733 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.730+0000 7f009316c700 1 --2- 172.21.15.96:0/1854712202 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f008c101520 0x7f008c1966a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f007800d950 tx=0x7f007800dc60 comp rx=0 tx=0).stop 2023-05-08T03:42:02.733 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.730+0000 7f009316c700 1 -- 172.21.15.96:0/1854712202 shutdown_connections 2023-05-08T03:42:02.734 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.731+0000 7f009316c700 1 --2- 172.21.15.96:0/1854712202 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f007c0a11e0 0x7f007c0a3690 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:02.734 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.731+0000 7f009316c700 1 --2- 172.21.15.96:0/1854712202 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f008c101eb0 0x7f008c19d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:02.734 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.731+0000 7f009316c700 1 --2- 172.21.15.96:0/1854712202 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f008c100330 0x7f008c196160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:02.734 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.731+0000 7f009316c700 1 --2- 172.21.15.96:0/1854712202 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f008c101520 0x7f008c1966a0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:02.734 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.731+0000 7f009316c700 1 -- 172.21.15.96:0/1854712202 >> 172.21.15.96:0/1854712202 conn(0x7f008c0fb950 msgr2=0x7f008c104970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:42:02.734 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.731+0000 7f009316c700 1 -- 172.21.15.96:0/1854712202 shutdown_connections 2023-05-08T03:42:02.734 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.731+0000 7f009316c700 1 -- 172.21.15.96:0/1854712202 wait complete. 2023-05-08T03:42:02.745 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-08T03:42:02.870 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.867+0000 7f248d057700 1 -- 172.21.15.96:0/2609142249 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2488100da0 msgr2=0x7f2488103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:02.870 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.867+0000 7f248d057700 1 --2- 172.21.15.96:0/2609142249 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2488100da0 0x7f2488103180 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f2478009990 tx=0x7f2478009ca0 comp rx=0 tx=0).stop 2023-05-08T03:42:02.871 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.867+0000 7f248d057700 1 -- 172.21.15.96:0/2609142249 shutdown_connections 2023-05-08T03:42:02.871 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.867+0000 7f248d057700 1 --2- 172.21.15.96:0/2609142249 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2488105fe0 0x7f2488108440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:02.871 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.867+0000 7f248d057700 1 --2- 172.21.15.96:0/2609142249 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2488100da0 0x7f2488103180 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:02.871 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.867+0000 7f248d057700 1 --2- 172.21.15.96:0/2609142249 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24881036c0 0x7f2488105aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:02.871 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.867+0000 7f248d057700 1 -- 172.21.15.96:0/2609142249 >> 172.21.15.96:0/2609142249 conn(0x7f24880fa840 msgr2=0x7f24880fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:42:02.871 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.867+0000 7f248d057700 1 -- 172.21.15.96:0/2609142249 shutdown_connections 2023-05-08T03:42:02.871 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.867+0000 7f248d057700 1 -- 172.21.15.96:0/2609142249 wait complete. 2023-05-08T03:42:02.871 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.868+0000 7f248d057700 1 Processor -- start 2023-05-08T03:42:02.874 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.868+0000 7f248d057700 1 -- start start 2023-05-08T03:42:02.874 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.868+0000 7f248d057700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2488100da0 0x7f2488100710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:02.875 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.868+0000 7f248d057700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24881036c0 0x7f24880fed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:02.875 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.868+0000 7f248d057700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2488105fe0 0x7f24880ff290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:02.875 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.868+0000 7f248d057700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24880ffa30 con 0x7f24881036c0 2023-05-08T03:42:02.876 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.868+0000 7f248d057700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24880ffba0 con 0x7f2488100da0 2023-05-08T03:42:02.876 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.868+0000 7f248d057700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24881a0080 con 0x7f2488105fe0 2023-05-08T03:42:02.876 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.868+0000 7f248659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24881036c0 0x7f24880fed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:02.876 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.868+0000 7f248659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24881036c0 0x7f24880fed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41502/0 (socket says 172.21.15.96:41502) 2023-05-08T03:42:02.876 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.868+0000 7f248659c700 1 -- 172.21.15.96:0/2039185331 learned_addr learned my addr 172.21.15.96:0/2039185331 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:42:02.876 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.868+0000 7f248759e700 1 --2- 172.21.15.96:0/2039185331 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2488105fe0 0x7f24880ff290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:02.876 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.869+0000 7f2486d9d700 1 --2- 172.21.15.96:0/2039185331 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2488100da0 0x7f2488100710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:02.876 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.869+0000 7f248659c700 1 -- 172.21.15.96:0/2039185331 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2488105fe0 msgr2=0x7f24880ff290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:02.877 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.869+0000 7f248659c700 1 --2- 172.21.15.96:0/2039185331 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2488105fe0 0x7f24880ff290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:02.877 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.869+0000 7f248659c700 1 -- 172.21.15.96:0/2039185331 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2488100da0 msgr2=0x7f2488100710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:02.877 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.869+0000 7f248659c700 1 --2- 172.21.15.96:0/2039185331 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2488100da0 0x7f2488100710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:02.877 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.869+0000 7f248659c700 1 -- 172.21.15.96:0/2039185331 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24780095f0 con 0x7f24881036c0 2023-05-08T03:42:02.877 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.869+0000 7f248659c700 1 --2- 172.21.15.96:0/2039185331 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24881036c0 0x7f24880fed50 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f247c00d980 tx=0x7f247c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:42:02.877 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.869+0000 7f246ffff700 1 -- 172.21.15.96:0/2039185331 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f247c004220 con 0x7f24881036c0 2023-05-08T03:42:02.877 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.869+0000 7f248d057700 1 -- 172.21.15.96:0/2039185331 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f248810bc80 con 0x7f24881036c0 2023-05-08T03:42:02.878 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.869+0000 7f246ffff700 1 -- 172.21.15.96:0/2039185331 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f247c007640 con 0x7f24881036c0 2023-05-08T03:42:02.878 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.869+0000 7f246ffff700 1 -- 172.21.15.96:0/2039185331 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f247c005690 con 0x7f24881036c0 2023-05-08T03:42:02.878 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.869+0000 7f248d057700 1 -- 172.21.15.96:0/2039185331 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f248810baf0 con 0x7f24881036c0 2023-05-08T03:42:02.878 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.870+0000 7f248d057700 1 -- 172.21.15.96:0/2039185331 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24880fc3b0 con 0x7f24881036c0 2023-05-08T03:42:02.878 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.871+0000 7f246ffff700 1 -- 172.21.15.96:0/2039185331 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f247c004750 con 0x7f24881036c0 2023-05-08T03:42:02.878 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.872+0000 7f246ffff700 1 --2- 172.21.15.96:0/2039185331 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f24700a1260 0x7f24700a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:02.879 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.872+0000 7f2486d9d700 1 --2- 172.21.15.96:0/2039185331 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f24700a1260 0x7f24700a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:02.879 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.872+0000 7f246ffff700 1 -- 172.21.15.96:0/2039185331 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f247c0cc8c0 con 0x7f24881036c0 2023-05-08T03:42:02.879 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.872+0000 7f2486d9d700 1 --2- 172.21.15.96:0/2039185331 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f24700a1260 0x7f24700a3710 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f247800b5c0 tx=0x7f2478005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:42:02.879 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:02.876+0000 7f246ffff700 1 -- 172.21.15.96:0/2039185331 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f247c095eb0 con 0x7f24881036c0 2023-05-08T03:42:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:02 smithi096 ceph-mon[124666]: pgmap v296: 97 pgs: 97 active+clean; 636 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-05-08T03:42:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:02 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/1338115711' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-05-08T03:42:03.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:02 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/981308214' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-05-08T03:42:03.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:02 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/1854712202' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-05-08T03:42:03.069 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.067+0000 7f248d057700 1 -- 172.21.15.96:0/2039185331 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2488061800 con 0x7f24881036c0 2023-05-08T03:42:03.070 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.067+0000 7f246ffff700 1 -- 172.21.15.96:0/2039185331 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v84) v1 ==== 100+0+11 (secure 0 0 0) 0x7f247c016020 con 0x7f24881036c0 2023-05-08T03:42:03.070 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 64 2023-05-08T03:42:03.072 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.069+0000 7f248d057700 1 -- 172.21.15.96:0/2039185331 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f24700a1260 msgr2=0x7f24700a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:03.072 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.069+0000 7f248d057700 1 --2- 172.21.15.96:0/2039185331 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f24700a1260 0x7f24700a3710 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f247800b5c0 tx=0x7f2478005960 comp rx=0 tx=0).stop 2023-05-08T03:42:03.072 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.069+0000 7f248d057700 1 -- 172.21.15.96:0/2039185331 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24881036c0 msgr2=0x7f24880fed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:03.072 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.069+0000 7f248d057700 1 --2- 172.21.15.96:0/2039185331 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24881036c0 0x7f24880fed50 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f247c00d980 tx=0x7f247c00dc90 comp rx=0 tx=0).stop 2023-05-08T03:42:03.072 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.069+0000 7f248d057700 1 -- 172.21.15.96:0/2039185331 shutdown_connections 2023-05-08T03:42:03.073 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.069+0000 7f248d057700 1 --2- 172.21.15.96:0/2039185331 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f24700a1260 0x7f24700a3710 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:03.073 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.069+0000 7f248d057700 1 --2- 172.21.15.96:0/2039185331 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2488105fe0 0x7f24880ff290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:03.073 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.069+0000 7f248d057700 1 --2- 172.21.15.96:0/2039185331 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2488100da0 0x7f2488100710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:03.073 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.069+0000 7f248d057700 1 --2- 172.21.15.96:0/2039185331 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24881036c0 0x7f24880fed50 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:03.074 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.069+0000 7f248d057700 1 -- 172.21.15.96:0/2039185331 >> 172.21.15.96:0/2039185331 conn(0x7f24880fa840 msgr2=0x7f2488101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:42:03.074 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.069+0000 7f248d057700 1 -- 172.21.15.96:0/2039185331 shutdown_connections 2023-05-08T03:42:03.074 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.069+0000 7f248d057700 1 -- 172.21.15.96:0/2039185331 wait complete. 2023-05-08T03:42:03.085 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-08T03:42:03.207 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.204+0000 7f4ae72a2700 1 -- 172.21.15.96:0/265445863 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ae01008a0 msgr2=0x7f4ae0100cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:03.207 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.204+0000 7f4ae72a2700 1 --2- 172.21.15.96:0/265445863 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ae01008a0 0x7f4ae0100cb0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f4ad0009990 tx=0x7f4ad0009ca0 comp rx=0 tx=0).stop 2023-05-08T03:42:03.207 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.204+0000 7f4ae72a2700 1 -- 172.21.15.96:0/265445863 shutdown_connections 2023-05-08T03:42:03.207 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.204+0000 7f4ae72a2700 1 --2- 172.21.15.96:0/265445863 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ae00ffe10 0x7f4ae01076c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:03.207 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.204+0000 7f4ae72a2700 1 --2- 172.21.15.96:0/265445863 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ae01008a0 0x7f4ae0100cb0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:03.207 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.204+0000 7f4ae72a2700 1 --2- 172.21.15.96:0/265445863 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4ae00ff460 0x7f4ae00ff8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:03.208 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.204+0000 7f4ae72a2700 1 -- 172.21.15.96:0/265445863 >> 172.21.15.96:0/265445863 conn(0x7f4ae00f9f80 msgr2=0x7f4ae00fc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:42:03.208 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.204+0000 7f4ae72a2700 1 -- 172.21.15.96:0/265445863 shutdown_connections 2023-05-08T03:42:03.208 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.204+0000 7f4ae72a2700 1 -- 172.21.15.96:0/265445863 wait complete. 2023-05-08T03:42:03.208 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.204+0000 7f4ae72a2700 1 Processor -- start 2023-05-08T03:42:03.208 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.204+0000 7f4ae72a2700 1 -- start start 2023-05-08T03:42:03.210 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.205+0000 7f4ae72a2700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4ae00ff460 0x7f4ae00feee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:03.210 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.205+0000 7f4ae72a2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ae00ffe10 0x7f4ae019ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:03.210 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.205+0000 7f4ae72a2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ae01008a0 0x7f4ae019d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:03.210 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.205+0000 7f4ae72a2700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae019dc20 con 0x7f4ae00ffe10 2023-05-08T03:42:03.210 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.205+0000 7f4ae72a2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae019dd90 con 0x7f4ae01008a0 2023-05-08T03:42:03.211 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.205+0000 7f4ae72a2700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae019df50 con 0x7f4ae00ff460 2023-05-08T03:42:03.211 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.205+0000 7f4ae483d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ae00ffe10 0x7f4ae019ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:03.211 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.205+0000 7f4ae483d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ae00ffe10 0x7f4ae019ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41516/0 (socket says 172.21.15.96:41516) 2023-05-08T03:42:03.211 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.205+0000 7f4ae483d700 1 -- 172.21.15.96:0/2703637123 learned_addr learned my addr 172.21.15.96:0/2703637123 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:42:03.211 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.205+0000 7f4ae503e700 1 --2- 172.21.15.96:0/2703637123 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4ae00ff460 0x7f4ae00feee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:03.211 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.205+0000 7f4ae583f700 1 --2- 172.21.15.96:0/2703637123 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ae01008a0 0x7f4ae019d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:03.211 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.205+0000 7f4ae483d700 1 -- 172.21.15.96:0/2703637123 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4ae00ff460 msgr2=0x7f4ae00feee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:03.212 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.205+0000 7f4ae483d700 1 --2- 172.21.15.96:0/2703637123 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4ae00ff460 0x7f4ae00feee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:03.212 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.205+0000 7f4ae483d700 1 -- 172.21.15.96:0/2703637123 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ae01008a0 msgr2=0x7f4ae019d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:03.212 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.205+0000 7f4ae483d700 1 --2- 172.21.15.96:0/2703637123 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ae01008a0 0x7f4ae019d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:03.212 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.205+0000 7f4ae483d700 1 -- 172.21.15.96:0/2703637123 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ad00095f0 con 0x7f4ae00ffe10 2023-05-08T03:42:03.212 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.205+0000 7f4ae583f700 1 --2- 172.21.15.96:0/2703637123 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ae01008a0 0x7f4ae019d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-08T03:42:03.212 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.205+0000 7f4ae483d700 1 --2- 172.21.15.96:0/2703637123 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ae00ffe10 0x7f4ae019ae00 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f4adc00d950 tx=0x7f4adc00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:42:03.212 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.205+0000 7f4ad67fc700 1 -- 172.21.15.96:0/2703637123 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4adc009940 con 0x7f4ae00ffe10 2023-05-08T03:42:03.213 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.205+0000 7f4ae72a2700 1 -- 172.21.15.96:0/2703637123 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ae010abc0 con 0x7f4ae00ffe10 2023-05-08T03:42:03.213 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.205+0000 7f4ad67fc700 1 -- 172.21.15.96:0/2703637123 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4adc010460 con 0x7f4ae00ffe10 2023-05-08T03:42:03.213 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.205+0000 7f4ad67fc700 1 -- 172.21.15.96:0/2703637123 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4adc00f620 con 0x7f4ae00ffe10 2023-05-08T03:42:03.213 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.205+0000 7f4ae72a2700 1 -- 172.21.15.96:0/2703637123 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ae010aa30 con 0x7f4ae00ffe10 2023-05-08T03:42:03.213 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.206+0000 7f4ae72a2700 1 -- 172.21.15.96:0/2703637123 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ae0106200 con 0x7f4ae00ffe10 2023-05-08T03:42:03.213 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.207+0000 7f4ad67fc700 1 -- 172.21.15.96:0/2703637123 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f4adc0108d0 con 0x7f4ae00ffe10 2023-05-08T03:42:03.214 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.208+0000 7f4ad67fc700 1 --2- 172.21.15.96:0/2703637123 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f4acc0a11e0 0x7f4acc0a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:03.214 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.208+0000 7f4ae503e700 1 --2- 172.21.15.96:0/2703637123 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f4acc0a11e0 0x7f4acc0a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:03.214 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.208+0000 7f4ad67fc700 1 -- 172.21.15.96:0/2703637123 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f4adc0cc800 con 0x7f4ae00ffe10 2023-05-08T03:42:03.214 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.209+0000 7f4ae503e700 1 --2- 172.21.15.96:0/2703637123 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f4acc0a11e0 0x7f4acc0a3690 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4ad000b5c0 tx=0x7f4ad0005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:42:03.215 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.212+0000 7f4ad67fc700 1 -- 172.21.15.96:0/2703637123 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f4adc095ef0 con 0x7f4ae00ffe10 2023-05-08T03:42:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:02 smithi133 ceph-mon[125939]: pgmap v296: 97 pgs: 97 active+clean; 636 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-05-08T03:42:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:02 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/1338115711' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-05-08T03:42:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:02 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/981308214' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-05-08T03:42:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:02 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/1854712202' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-05-08T03:42:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:02 smithi186 ceph-mon[126480]: pgmap v296: 97 pgs: 97 active+clean; 636 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-05-08T03:42:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:02 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/1338115711' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-05-08T03:42:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:02 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/981308214' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-05-08T03:42:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:02 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/1854712202' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-05-08T03:42:03.447 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.444+0000 7f4ae72a2700 1 -- 172.21.15.96:0/2703637123 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4ae002d0e0 con 0x7f4ae00ffe10 2023-05-08T03:42:03.448 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.445+0000 7f4ad67fc700 1 -- 172.21.15.96:0/2703637123 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+10813 (secure 0 0 0) 0x7f4adc016090 con 0x7f4ae00ffe10 2023-05-08T03:42:03.448 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:42:03.448 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6835/1518512221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":1518512221},{"type":"v1","addr":"172.21.15.96:6835","nonce":1518512221}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6837/305967678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6836","nonce":305967678},{"type":"v1","addr":"172.21.15.96:6837","nonce":305967678}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14622,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6839/2596991665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6838","nonce":2596991665},{"type":"v1","addr":"172.21.15.96:6839","nonce":2596991665}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6841/1786091200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6840","nonce":1786091200},{"type":"v1","addr":"172.21.15.96:6841","nonce":1786091200}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/2351258784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":2351258784},{"type":"v1","addr":"172.21.15.133:6833","nonce":2351258784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/2274306880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":2274306880},{"type":"v1","addr":"172.21.15.186:6833","nonce":2274306880}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-05-08T03:40:49.210143+0000","modified":"2023-05-08T03:40:54.356833+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24494,"mds_1":24487,"mds_2":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24437":{"gid":24437,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6835/1735118966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1735118966},{"type":"v1","addr":"172.21.15.133:6835","nonce":1735118966}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6835/3984391904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":3984391904},{"type":"v1","addr":"172.21.15.186:6835","nonce":3984391904}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24461":{"gid":24461,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6837/2218851414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":2218851414},{"type":"v1","addr":"172.21.15.133:6837","nonce":2218851414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24472":{"gid":24472,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.186:6837/1556405826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":1556405826},{"type":"v1","addr":"172.21.15.186:6837","nonce":1556405826}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":5,"addr":"172.21.15.186:6839/1267655485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":1267655485},{"type":"v1","addr":"172.21.15.186:6839","nonce":1267655485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6839/2246041493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6838","nonce":2246041493},{"type":"v1","addr":"172.21.15.133:6839","nonce":2246041493}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-08T03:42:03.450 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.447+0000 7f4ae72a2700 1 -- 172.21.15.96:0/2703637123 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f4acc0a11e0 msgr2=0x7f4acc0a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:03.450 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.447+0000 7f4ae72a2700 1 --2- 172.21.15.96:0/2703637123 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f4acc0a11e0 0x7f4acc0a3690 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4ad000b5c0 tx=0x7f4ad0005fd0 comp rx=0 tx=0).stop 2023-05-08T03:42:03.450 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.447+0000 7f4ae72a2700 1 -- 172.21.15.96:0/2703637123 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ae00ffe10 msgr2=0x7f4ae019ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:03.450 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.447+0000 7f4ae72a2700 1 --2- 172.21.15.96:0/2703637123 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ae00ffe10 0x7f4ae019ae00 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f4adc00d950 tx=0x7f4adc00dc60 comp rx=0 tx=0).stop 2023-05-08T03:42:03.451 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.447+0000 7f4ae72a2700 1 -- 172.21.15.96:0/2703637123 shutdown_connections 2023-05-08T03:42:03.451 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.447+0000 7f4ae72a2700 1 --2- 172.21.15.96:0/2703637123 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f4acc0a11e0 0x7f4acc0a3690 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:03.451 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.447+0000 7f4ae72a2700 1 --2- 172.21.15.96:0/2703637123 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ae01008a0 0x7f4ae019d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:03.451 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.447+0000 7f4ae72a2700 1 --2- 172.21.15.96:0/2703637123 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4ae00ff460 0x7f4ae00feee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:03.451 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.447+0000 7f4ae72a2700 1 --2- 172.21.15.96:0/2703637123 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ae00ffe10 0x7f4ae019ae00 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:03.451 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.447+0000 7f4ae72a2700 1 -- 172.21.15.96:0/2703637123 >> 172.21.15.96:0/2703637123 conn(0x7f4ae00f9f80 msgr2=0x7f4ae00fc2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:42:03.451 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.447+0000 7f4ae72a2700 1 -- 172.21.15.96:0/2703637123 shutdown_connections 2023-05-08T03:42:03.451 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.447+0000 7f4ae72a2700 1 -- 172.21.15.96:0/2703637123 wait complete. 2023-05-08T03:42:03.452 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 22 2023-05-08T03:42:03.462 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-08T03:42:03.585 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.581+0000 7ff7e65f5700 1 -- 172.21.15.96:0/2620622979 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7e0100800 msgr2=0x7ff7e0100c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:03.586 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.581+0000 7ff7e65f5700 1 --2- 172.21.15.96:0/2620622979 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7e0100800 0x7ff7e0100c10 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff7d0009990 tx=0x7ff7d0009ca0 comp rx=0 tx=0).stop 2023-05-08T03:42:03.586 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.581+0000 7ff7e65f5700 1 -- 172.21.15.96:0/2620622979 shutdown_connections 2023-05-08T03:42:03.586 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.581+0000 7ff7e65f5700 1 --2- 172.21.15.96:0/2620622979 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7e00ffe30 0x7ff7e0107700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:03.586 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.581+0000 7ff7e65f5700 1 --2- 172.21.15.96:0/2620622979 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7e0100800 0x7ff7e0100c10 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:03.586 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.581+0000 7ff7e65f5700 1 --2- 172.21.15.96:0/2620622979 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff7e00ff4a0 0x7ff7e00ff8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:03.587 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.581+0000 7ff7e65f5700 1 -- 172.21.15.96:0/2620622979 >> 172.21.15.96:0/2620622979 conn(0x7ff7e00f9f80 msgr2=0x7ff7e00fc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:42:03.587 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.581+0000 7ff7e65f5700 1 -- 172.21.15.96:0/2620622979 shutdown_connections 2023-05-08T03:42:03.587 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.581+0000 7ff7e65f5700 1 -- 172.21.15.96:0/2620622979 wait complete. 2023-05-08T03:42:03.587 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.581+0000 7ff7e65f5700 1 Processor -- start 2023-05-08T03:42:03.587 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.581+0000 7ff7e65f5700 1 -- start start 2023-05-08T03:42:03.587 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.582+0000 7ff7e65f5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7e00ff4a0 0x7ff7e00fef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:03.587 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.582+0000 7ff7e65f5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7e00ffe30 0x7ff7e019aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:03.588 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.582+0000 7ff7e65f5700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff7e0100800 0x7ff7e019d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:03.588 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.582+0000 7ff7e65f5700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e019dce0 con 0x7ff7e00ff4a0 2023-05-08T03:42:03.588 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.582+0000 7ff7e65f5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e019de50 con 0x7ff7e00ffe30 2023-05-08T03:42:03.588 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.582+0000 7ff7e65f5700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e019e010 con 0x7ff7e0100800 2023-05-08T03:42:03.588 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.582+0000 7ff7dffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7e00ff4a0 0x7ff7e00fef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:03.588 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.582+0000 7ff7dffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7e00ff4a0 0x7ff7e00fef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41528/0 (socket says 172.21.15.96:41528) 2023-05-08T03:42:03.588 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.582+0000 7ff7dffff700 1 -- 172.21.15.96:0/2383203354 learned_addr learned my addr 172.21.15.96:0/2383203354 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:42:03.589 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.582+0000 7ff7e4b92700 1 --2- 172.21.15.96:0/2383203354 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff7e0100800 0x7ff7e019d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:03.589 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.582+0000 7ff7dffff700 1 -- 172.21.15.96:0/2383203354 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff7e0100800 msgr2=0x7ff7e019d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:03.589 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.582+0000 7ff7dffff700 1 --2- 172.21.15.96:0/2383203354 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff7e0100800 0x7ff7e019d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:03.589 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.582+0000 7ff7dffff700 1 -- 172.21.15.96:0/2383203354 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7e00ffe30 msgr2=0x7ff7e019aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:03.589 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.582+0000 7ff7dffff700 1 --2- 172.21.15.96:0/2383203354 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7e00ffe30 0x7ff7e019aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:03.589 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.582+0000 7ff7dffff700 1 -- 172.21.15.96:0/2383203354 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7d00095f0 con 0x7ff7e00ff4a0 2023-05-08T03:42:03.589 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.582+0000 7ff7e4b92700 1 --2- 172.21.15.96:0/2383203354 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff7e0100800 0x7ff7e019d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-08T03:42:03.590 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.582+0000 7ff7dffff700 1 --2- 172.21.15.96:0/2383203354 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7e00ff4a0 0x7ff7e00fef60 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ff7d000f730 tx=0x7ff7d000f810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:42:03.590 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.582+0000 7ff7ddffb700 1 -- 172.21.15.96:0/2383203354 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d001d070 con 0x7ff7e00ff4a0 2023-05-08T03:42:03.590 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.582+0000 7ff7e65f5700 1 -- 172.21.15.96:0/2383203354 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7e010acd0 con 0x7ff7e00ff4a0 2023-05-08T03:42:03.590 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.582+0000 7ff7ddffb700 1 -- 172.21.15.96:0/2383203354 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff7d000fd30 con 0x7ff7e00ff4a0 2023-05-08T03:42:03.590 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.582+0000 7ff7ddffb700 1 -- 172.21.15.96:0/2383203354 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d0005710 con 0x7ff7e00ff4a0 2023-05-08T03:42:03.590 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.582+0000 7ff7e65f5700 1 -- 172.21.15.96:0/2383203354 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7e010ab40 con 0x7ff7e00ff4a0 2023-05-08T03:42:03.590 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.583+0000 7ff7e65f5700 1 -- 172.21.15.96:0/2383203354 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7e0106240 con 0x7ff7e00ff4a0 2023-05-08T03:42:03.592 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.584+0000 7ff7ddffb700 1 -- 172.21.15.96:0/2383203354 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7ff7d00047e0 con 0x7ff7e00ff4a0 2023-05-08T03:42:03.593 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.585+0000 7ff7ddffb700 1 --2- 172.21.15.96:0/2383203354 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7ff7cc0a11e0 0x7ff7cc0a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:03.593 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.585+0000 7ff7ddffb700 1 -- 172.21.15.96:0/2383203354 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7ff7d00ce0e0 con 0x7ff7e00ff4a0 2023-05-08T03:42:03.593 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.585+0000 7ff7d7fff700 1 --2- 172.21.15.96:0/2383203354 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7ff7cc0a11e0 0x7ff7cc0a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:03.593 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.585+0000 7ff7d7fff700 1 --2- 172.21.15.96:0/2383203354 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7ff7cc0a11e0 0x7ff7cc0a3690 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff7c80097b0 tx=0x7ff7c8006d20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:42:03.593 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.589+0000 7ff7ddffb700 1 -- 172.21.15.96:0/2383203354 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7ff7d0097860 con 0x7ff7e00ff4a0 2023-05-08T03:42:03.783 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.780+0000 7ff7e65f5700 1 -- 172.21.15.96:0/2383203354 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff7e0061800 con 0x7ff7e00ff4a0 2023-05-08T03:42:03.784 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.782+0000 7ff7ddffb700 1 -- 172.21.15.96:0/2383203354 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+22437 (secure 0 0 0) 0x7ff7d009ae80 con 0x7ff7e00ff4a0 2023-05-08T03:42:03.785 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:42:03.785 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":84,"fsid":"f7ffcfb0-ed50-11ed-9b01-001a4aab830c","created":"2023-05-08T03:33:42.765680+0000","modified":"2023-05-08T03:41:39.350582+0000","last_up_change":"2023-05-08T03:40:07.550882+0000","last_in_change":"2023-05-08T03:39:49.027947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-08T03:36:47.800739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-05-08T03:40:47.229693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-05-08T03:40:48.359294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2ee801e1-8eec-496d-a9ac-fc566b38bbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":1816903726},{"type":"v1","addr":"172.21.15.96:6803","nonce":1816903726}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":1816903726},{"type":"v1","addr":"172.21.15.96:6805","nonce":1816903726}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":1816903726},{"type":"v1","addr":"172.21.15.96:6809","nonce":1816903726}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":1816903726},{"type":"v1","addr":"172.21.15.96:6807","nonce":1816903726}]},"public_addr":"172.21.15.96:6803/1816903726","cluster_addr":"172.21.15.96:6805/1816903726","heartbeat_back_addr":"172.21.15.96:6809/1816903726","heartbeat_front_addr":"172.21.15.96:6807/1816903726","state":["exists","up"]},{"osd":1,"uuid":"eb73deea-fc7c-4f2f-8aef-2d71c598afda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":206989126},{"type":"v1","addr":"172.21.15.133:6801","nonce":206989126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":206989126},{"type":"v1","addr":"172.21.15.133:6803","nonce":206989126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":206989126},{"type":"v1","addr":"172.21.15.133:6807","nonce":206989126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":206989126},{"type":"v1","addr":"172.21.15.133:6805","nonce":206989126}]},"public_addr":"172.21.15.133:6801/206989126","cluster_addr":"172.21.15.133:6803/206989126","heartbeat_back_addr":"172.21.15.133:6807/206989126","heartbeat_front_addr":"172.21.15.133:6805/206989126","state":["exists","up"]},{"osd":2,"uuid":"74a2f239-e82d-4d87-9458-5373b6cbbffd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":1791188143},{"type":"v1","addr":"172.21.15.186:6801","nonce":1791188143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":1791188143},{"type":"v1","addr":"172.21.15.186:6803","nonce":1791188143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":1791188143},{"type":"v1","addr":"172.21.15.186:6807","nonce":1791188143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":1791188143},{"type":"v1","addr":"172.21.15.186:6805","nonce":1791188143}]},"public_addr":"172.21.15.186:6801/1791188143","cluster_addr":"172.21.15.186:6803/1791188143","heartbeat_back_addr":"172.21.15.186:6807/1791188143","heartbeat_front_addr":"172.21.15.186:6805/1791188143","state":["exists","up"]},{"osd":3,"uuid":"421eedf5-ba6e-484e-b715-78c1c10d684e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":3430402140},{"type":"v1","addr":"172.21.15.96:6811","nonce":3430402140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":3430402140},{"type":"v1","addr":"172.21.15.96:6813","nonce":3430402140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":3430402140},{"type":"v1","addr":"172.21.15.96:6817","nonce":3430402140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":3430402140},{"type":"v1","addr":"172.21.15.96:6815","nonce":3430402140}]},"public_addr":"172.21.15.96:6811/3430402140","cluster_addr":"172.21.15.96:6813/3430402140","heartbeat_back_addr":"172.21.15.96:6817/3430402140","heartbeat_front_addr":"172.21.15.96:6815/3430402140","state":["exists","up"]},{"osd":4,"uuid":"fb20100b-6a5a-462d-955d-1697a3861e96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":1237495996},{"type":"v1","addr":"172.21.15.133:6809","nonce":1237495996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":1237495996},{"type":"v1","addr":"172.21.15.133:6811","nonce":1237495996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":1237495996},{"type":"v1","addr":"172.21.15.133:6815","nonce":1237495996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":1237495996},{"type":"v1","addr":"172.21.15.133:6813","nonce":1237495996}]},"public_addr":"172.21.15.133:6809/1237495996","cluster_addr":"172.21.15.133:6811/1237495996","heartbeat_back_addr":"172.21.15.133:6815/1237495996","heartbeat_front_addr":"172.21.15.133:6813/1237495996","state":["exists","up"]},{"osd":5,"uuid":"00177913-8bd6-4391-83c3-08c2b1b8ef13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":541111862},{"type":"v1","addr":"172.21.15.186:6809","nonce":541111862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":541111862},{"type":"v1","addr":"172.21.15.186:6811","nonce":541111862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":541111862},{"type":"v1","addr":"172.21.15.186:6815","nonce":541111862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":541111862},{"type":"v1","addr":"172.21.15.186:6813","nonce":541111862}]},"public_addr":"172.21.15.186:6809/541111862","cluster_addr":"172.21.15.186:6811/541111862","heartbeat_back_addr":"172.21.15.186:6815/541111862","heartbeat_front_addr":"172.21.15.186:6813/541111862","state":["exists","up"]},{"osd":6,"uuid":"204baab6-ca6f-4eef-8b9c-91efc04cc30c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":386227948},{"type":"v1","addr":"172.21.15.96:6819","nonce":386227948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":386227948},{"type":"v1","addr":"172.21.15.96:6821","nonce":386227948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":386227948},{"type":"v1","addr":"172.21.15.96:6825","nonce":386227948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":386227948},{"type":"v1","addr":"172.21.15.96:6823","nonce":386227948}]},"public_addr":"172.21.15.96:6819/386227948","cluster_addr":"172.21.15.96:6821/386227948","heartbeat_back_addr":"172.21.15.96:6825/386227948","heartbeat_front_addr":"172.21.15.96:6823/386227948","state":["exists","up"]},{"osd":7,"uuid":"282db569-a76e-485b-a33d-f2579b956525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":218507954},{"type":"v1","addr":"172.21.15.133:6817","nonce":218507954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":218507954},{"type":"v1","addr":"172.21.15.133:6819","nonce":218507954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":218507954},{"type":"v1","addr":"172.21.15.133:6823","nonce":218507954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":218507954},{"type":"v1","addr":"172.21.15.133:6821","nonce":218507954}]},"public_addr":"172.21.15.133:6817/218507954","cluster_addr":"172.21.15.133:6819/218507954","heartbeat_back_addr":"172.21.15.133:6823/218507954","heartbeat_front_addr":"172.21.15.133:6821/218507954","state":["exists","up"]},{"osd":8,"uuid":"693e25b5-355d-4990-9467-0fac4c9133fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":1648475902},{"type":"v1","addr":"172.21.15.186:6817","nonce":1648475902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":1648475902},{"type":"v1","addr":"172.21.15.186:6819","nonce":1648475902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":1648475902},{"type":"v1","addr":"172.21.15.186:6823","nonce":1648475902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":1648475902},{"type":"v1","addr":"172.21.15.186:6821","nonce":1648475902}]},"public_addr":"172.21.15.186:6817/1648475902","cluster_addr":"172.21.15.186:6819/1648475902","heartbeat_back_addr":"172.21.15.186:6823/1648475902","heartbeat_front_addr":"172.21.15.186:6821/1648475902","state":["exists","up"]},{"osd":9,"uuid":"72fbff09-fe28-4014-86fc-c31f95cd19a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":543223824},{"type":"v1","addr":"172.21.15.96:6827","nonce":543223824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":543223824},{"type":"v1","addr":"172.21.15.96:6829","nonce":543223824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6832","nonce":543223824},{"type":"v1","addr":"172.21.15.96:6833","nonce":543223824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":543223824},{"type":"v1","addr":"172.21.15.96:6831","nonce":543223824}]},"public_addr":"172.21.15.96:6827/543223824","cluster_addr":"172.21.15.96:6829/543223824","heartbeat_back_addr":"172.21.15.96:6833/543223824","heartbeat_front_addr":"172.21.15.96:6831/543223824","state":["exists","up"]},{"osd":10,"uuid":"6c2b6757-60c2-4962-9409-6051dcb13273","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":2323107912},{"type":"v1","addr":"172.21.15.133:6825","nonce":2323107912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":2323107912},{"type":"v1","addr":"172.21.15.133:6827","nonce":2323107912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":2323107912},{"type":"v1","addr":"172.21.15.133:6831","nonce":2323107912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":2323107912},{"type":"v1","addr":"172.21.15.133:6829","nonce":2323107912}]},"public_addr":"172.21.15.133:6825/2323107912","cluster_addr":"172.21.15.133:6827/2323107912","heartbeat_back_addr":"172.21.15.133:6831/2323107912","heartbeat_front_addr":"172.21.15.133:6829/2323107912","state":["exists","up"]},{"osd":11,"uuid":"03c0bb25-2921-446b-960e-6a7a328d36a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":3853499290},{"type":"v1","addr":"172.21.15.186:6825","nonce":3853499290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":3853499290},{"type":"v1","addr":"172.21.15.186:6827","nonce":3853499290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":3853499290},{"type":"v1","addr":"172.21.15.186:6831","nonce":3853499290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":3853499290},{"type":"v1","addr":"172.21.15.186:6829","nonce":3853499290}]},"public_addr":"172.21.15.186:6825/3853499290","cluster_addr":"172.21.15.186:6827/3853499290","heartbeat_back_addr":"172.21.15.186:6831/3853499290","heartbeat_front_addr":"172.21.15.186:6829/3853499290","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:36:02.087281+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:36:24.328783+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:36:46.135576+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:37:08.524145+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:37:30.883871+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:37:53.344554+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:38:15.448162+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:38:37.414878+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:38:59.533953+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:39:21.392102+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:39:43.462696+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:40:05.561808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.96:0/1333468881":"2023-05-09T03:34:37.472043+0000","172.21.15.96:6800/1979917756":"2023-05-09T03:34:37.472043+0000","172.21.15.96:0/1332045367":"2023-05-09T03:34:37.472043+0000","172.21.15.96:0/520278090":"2023-05-09T03:34:14.800324+0000","172.21.15.96:0/1055409415":"2023-05-09T03:34:37.472043+0000","172.21.15.96:6801/1979917756":"2023-05-09T03:34:37.472043+0000","172.21.15.96:0/1541933328":"2023-05-09T03:34:14.800324+0000","172.21.15.96:6800/3944122753":"2023-05-09T03:34:14.800324+0000","172.21.15.96:0/2986058319":"2023-05-09T03:34:14.800324+0000","172.21.15.96:6801/3944122753":"2023-05-09T03:34:14.800324+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-08T03:42:03.786 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.784+0000 7ff7e65f5700 1 -- 172.21.15.96:0/2383203354 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7ff7cc0a11e0 msgr2=0x7ff7cc0a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:03.787 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.784+0000 7ff7e65f5700 1 --2- 172.21.15.96:0/2383203354 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7ff7cc0a11e0 0x7ff7cc0a3690 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff7c80097b0 tx=0x7ff7c8006d20 comp rx=0 tx=0).stop 2023-05-08T03:42:03.787 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.784+0000 7ff7e65f5700 1 -- 172.21.15.96:0/2383203354 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7e00ff4a0 msgr2=0x7ff7e00fef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:03.787 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.784+0000 7ff7e65f5700 1 --2- 172.21.15.96:0/2383203354 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7e00ff4a0 0x7ff7e00fef60 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ff7d000f730 tx=0x7ff7d000f810 comp rx=0 tx=0).stop 2023-05-08T03:42:03.787 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.784+0000 7ff7e65f5700 1 -- 172.21.15.96:0/2383203354 shutdown_connections 2023-05-08T03:42:03.787 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.784+0000 7ff7e65f5700 1 --2- 172.21.15.96:0/2383203354 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7ff7cc0a11e0 0x7ff7cc0a3690 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:03.787 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.784+0000 7ff7e65f5700 1 --2- 172.21.15.96:0/2383203354 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff7e0100800 0x7ff7e019d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:03.787 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.784+0000 7ff7e65f5700 1 --2- 172.21.15.96:0/2383203354 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7e00ff4a0 0x7ff7e00fef60 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:03.788 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.784+0000 7ff7e65f5700 1 --2- 172.21.15.96:0/2383203354 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7e00ffe30 0x7ff7e019aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:03.788 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.784+0000 7ff7e65f5700 1 -- 172.21.15.96:0/2383203354 >> 172.21.15.96:0/2383203354 conn(0x7ff7e00f9f80 msgr2=0x7ff7e00fc280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:42:03.788 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.784+0000 7ff7e65f5700 1 -- 172.21.15.96:0/2383203354 shutdown_connections 2023-05-08T03:42:03.788 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.784+0000 7ff7e65f5700 1 -- 172.21.15.96:0/2383203354 wait complete. 2023-05-08T03:42:03.799 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-08T03:36:47.800739+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-08T03:40:47.229693+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-05-08T03:40:48.359294+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-08T03:42:03.800 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-08T03:42:03.927 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.923+0000 7f6e156a9700 1 -- 172.21.15.96:0/4291407746 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e10100880 msgr2=0x7f6e10100c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:03.927 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.923+0000 7f6e156a9700 1 --2- 172.21.15.96:0/4291407746 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e10100880 0x7f6e10100c90 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f6e04009990 tx=0x7f6e04009ca0 comp rx=0 tx=0).stop 2023-05-08T03:42:03.928 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.923+0000 7f6e156a9700 1 -- 172.21.15.96:0/4291407746 shutdown_connections 2023-05-08T03:42:03.928 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.923+0000 7f6e156a9700 1 --2- 172.21.15.96:0/4291407746 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e100ffe80 0x7f6e10107730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:03.928 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.923+0000 7f6e156a9700 1 --2- 172.21.15.96:0/4291407746 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e10100880 0x7f6e10100c90 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:03.928 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.923+0000 7f6e156a9700 1 --2- 172.21.15.96:0/4291407746 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6e100ff4d0 0x7f6e100ff940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:03.928 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.923+0000 7f6e156a9700 1 -- 172.21.15.96:0/4291407746 >> 172.21.15.96:0/4291407746 conn(0x7f6e100fa050 msgr2=0x7f6e100fc4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:42:03.928 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.923+0000 7f6e156a9700 1 -- 172.21.15.96:0/4291407746 shutdown_connections 2023-05-08T03:42:03.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.923+0000 7f6e156a9700 1 -- 172.21.15.96:0/4291407746 wait complete. 2023-05-08T03:42:03.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.923+0000 7f6e156a9700 1 Processor -- start 2023-05-08T03:42:03.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.924+0000 7f6e156a9700 1 -- start start 2023-05-08T03:42:03.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.924+0000 7f6e156a9700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6e100ff4d0 0x7f6e101099e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:03.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.924+0000 7f6e156a9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e100ffe80 0x7f6e10108020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:03.930 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.924+0000 7f6e156a9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e10100880 0x7f6e10108560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:03.930 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.924+0000 7f6e156a9700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e10108d00 con 0x7f6e100ffe80 2023-05-08T03:42:03.930 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.924+0000 7f6e156a9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e10108e70 con 0x7f6e10100880 2023-05-08T03:42:03.930 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.924+0000 7f6e156a9700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e101a0120 con 0x7f6e100ff4d0 2023-05-08T03:42:03.930 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.924+0000 7f6e0e7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e100ffe80 0x7f6e10108020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:03.930 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.924+0000 7f6e0e7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e100ffe80 0x7f6e10108020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41544/0 (socket says 172.21.15.96:41544) 2023-05-08T03:42:03.931 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.924+0000 7f6e0e7fc700 1 -- 172.21.15.96:0/3262730851 learned_addr learned my addr 172.21.15.96:0/3262730851 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:42:03.931 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.924+0000 7f6e0effd700 1 --2- 172.21.15.96:0/3262730851 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6e100ff4d0 0x7f6e101099e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:03.931 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.924+0000 7f6e0f7fe700 1 --2- 172.21.15.96:0/3262730851 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e10100880 0x7f6e10108560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:03.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.924+0000 7f6e0e7fc700 1 -- 172.21.15.96:0/3262730851 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6e100ff4d0 msgr2=0x7f6e101099e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:03.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.924+0000 7f6e0e7fc700 1 --2- 172.21.15.96:0/3262730851 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6e100ff4d0 0x7f6e101099e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:03.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.924+0000 7f6e0e7fc700 1 -- 172.21.15.96:0/3262730851 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e10100880 msgr2=0x7f6e10108560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:03.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.924+0000 7f6e0e7fc700 1 --2- 172.21.15.96:0/3262730851 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e10100880 0x7f6e10108560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:03.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.924+0000 7f6e0e7fc700 1 -- 172.21.15.96:0/3262730851 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e040095f0 con 0x7f6e100ffe80 2023-05-08T03:42:03.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.924+0000 7f6e0e7fc700 1 --2- 172.21.15.96:0/3262730851 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e100ffe80 0x7f6e10108020 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6e0000d950 tx=0x7f6e0000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:42:03.934 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.926+0000 7f6df7fff700 1 -- 172.21.15.96:0/3262730851 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e0000f890 con 0x7f6e100ffe80 2023-05-08T03:42:03.934 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.926+0000 7f6e156a9700 1 -- 172.21.15.96:0/3262730851 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e1010bde0 con 0x7f6e100ffe80 2023-05-08T03:42:03.934 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.926+0000 7f6df7fff700 1 -- 172.21.15.96:0/3262730851 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6e00010460 con 0x7f6e100ffe80 2023-05-08T03:42:03.934 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.926+0000 7f6df7fff700 1 -- 172.21.15.96:0/3262730851 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e0000e610 con 0x7f6e100ffe80 2023-05-08T03:42:03.935 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.926+0000 7f6e156a9700 1 -- 172.21.15.96:0/3262730851 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e1010bc50 con 0x7f6e100ffe80 2023-05-08T03:42:03.935 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.927+0000 7f6e156a9700 1 -- 172.21.15.96:0/3262730851 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e101062a0 con 0x7f6e100ffe80 2023-05-08T03:42:03.935 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.928+0000 7f6df7fff700 1 -- 172.21.15.96:0/3262730851 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f6e000108d0 con 0x7f6e100ffe80 2023-05-08T03:42:03.935 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.928+0000 7f6df7fff700 1 --2- 172.21.15.96:0/3262730851 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f6df80a11e0 0x7f6df80a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:03.935 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.928+0000 7f6e0effd700 1 --2- 172.21.15.96:0/3262730851 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f6df80a11e0 0x7f6df80a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:03.935 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.928+0000 7f6df7fff700 1 -- 172.21.15.96:0/3262730851 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f6e000cc760 con 0x7f6e100ffe80 2023-05-08T03:42:03.935 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.929+0000 7f6e0effd700 1 --2- 172.21.15.96:0/3262730851 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f6df80a11e0 0x7f6df80a3690 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f6e0400b5c0 tx=0x7f6e04005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:42:03.936 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:03.934+0000 7f6df7fff700 1 -- 172.21.15.96:0/3262730851 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f6e00095e50 con 0x7f6e100ffe80 2023-05-08T03:42:04.124 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.121+0000 7f6e156a9700 1 -- 172.21.15.96:0/3262730851 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6e1002d0e0 con 0x7f6e100ffe80 2023-05-08T03:42:04.124 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.121+0000 7f6df7fff700 1 -- 172.21.15.96:0/3262730851 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6e000160a0 con 0x7f6e100ffe80 2023-05-08T03:42:04.124 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2023-05-08T03:42:04.126 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.123+0000 7f6e156a9700 1 -- 172.21.15.96:0/3262730851 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f6df80a11e0 msgr2=0x7f6df80a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:04.126 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.123+0000 7f6e156a9700 1 --2- 172.21.15.96:0/3262730851 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f6df80a11e0 0x7f6df80a3690 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f6e0400b5c0 tx=0x7f6e04005fb0 comp rx=0 tx=0).stop 2023-05-08T03:42:04.126 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.123+0000 7f6e156a9700 1 -- 172.21.15.96:0/3262730851 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e100ffe80 msgr2=0x7f6e10108020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:04.126 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.123+0000 7f6e156a9700 1 --2- 172.21.15.96:0/3262730851 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e100ffe80 0x7f6e10108020 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6e0000d950 tx=0x7f6e0000dc60 comp rx=0 tx=0).stop 2023-05-08T03:42:04.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.123+0000 7f6e156a9700 1 -- 172.21.15.96:0/3262730851 shutdown_connections 2023-05-08T03:42:04.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.123+0000 7f6e156a9700 1 --2- 172.21.15.96:0/3262730851 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f6df80a11e0 0x7f6df80a3690 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:04.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.123+0000 7f6e156a9700 1 --2- 172.21.15.96:0/3262730851 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e10100880 0x7f6e10108560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:04.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.123+0000 7f6e156a9700 1 --2- 172.21.15.96:0/3262730851 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6e100ff4d0 0x7f6e101099e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:04.128 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.123+0000 7f6e156a9700 1 --2- 172.21.15.96:0/3262730851 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e100ffe80 0x7f6e10108020 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:04.128 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.123+0000 7f6e156a9700 1 -- 172.21.15.96:0/3262730851 >> 172.21.15.96:0/3262730851 conn(0x7f6e100fa050 msgr2=0x7f6e100fc380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:42:04.128 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.124+0000 7f6e156a9700 1 -- 172.21.15.96:0/3262730851 shutdown_connections 2023-05-08T03:42:04.128 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.124+0000 7f6e156a9700 1 -- 172.21.15.96:0/3262730851 wait complete. 2023-05-08T03:42:04.137 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:03 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/2039185331' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-05-08T03:42:04.137 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:03 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/2703637123' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-05-08T03:42:04.137 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:03 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/2383203354' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-05-08T03:42:04.138 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-08T03:42:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:03 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/2039185331' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-05-08T03:42:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:03 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/2703637123' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-05-08T03:42:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:03 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/2383203354' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-05-08T03:42:04.263 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.261+0000 7efed2745700 1 -- 172.21.15.96:0/2306170868 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efecc101520 msgr2=0x7efecc101970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:04.264 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.261+0000 7efed2745700 1 --2- 172.21.15.96:0/2306170868 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efecc101520 0x7efecc101970 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7efebc009990 tx=0x7efebc009ca0 comp rx=0 tx=0).stop 2023-05-08T03:42:04.264 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.261+0000 7efed2745700 1 -- 172.21.15.96:0/2306170868 shutdown_connections 2023-05-08T03:42:04.265 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.261+0000 7efed2745700 1 --2- 172.21.15.96:0/2306170868 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efecc101eb0 0x7efecc108770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:04.265 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.261+0000 7efed2745700 1 --2- 172.21.15.96:0/2306170868 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efecc100330 0x7efecc100740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:04.265 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.261+0000 7efed2745700 1 --2- 172.21.15.96:0/2306170868 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efecc101520 0x7efecc101970 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:04.265 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.261+0000 7efed2745700 1 -- 172.21.15.96:0/2306170868 >> 172.21.15.96:0/2306170868 conn(0x7efecc0fb950 msgr2=0x7efecc0fdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:42:04.265 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.261+0000 7efed2745700 1 -- 172.21.15.96:0/2306170868 shutdown_connections 2023-05-08T03:42:04.265 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.261+0000 7efed2745700 1 -- 172.21.15.96:0/2306170868 wait complete. 2023-05-08T03:42:04.266 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.261+0000 7efed2745700 1 Processor -- start 2023-05-08T03:42:04.266 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.261+0000 7efed2745700 1 -- start start 2023-05-08T03:42:04.268 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.261+0000 7efed2745700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efecc100330 0x7efecc1960f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:04.268 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.262+0000 7efed2745700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efecc101520 0x7efecc196630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:04.268 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.262+0000 7efed2745700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efecc101eb0 0x7efecc19d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:04.268 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.262+0000 7efed2745700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efecc19dc70 con 0x7efecc101520 2023-05-08T03:42:04.268 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.262+0000 7efed2745700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efecc19ddb0 con 0x7efecc101eb0 2023-05-08T03:42:04.269 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.262+0000 7efed2745700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efecc19df40 con 0x7efecc100330 2023-05-08T03:42:04.269 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.262+0000 7efecb7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efecc101520 0x7efecc196630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:04.269 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.262+0000 7efecb7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efecc101520 0x7efecc196630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41558/0 (socket says 172.21.15.96:41558) 2023-05-08T03:42:04.269 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.262+0000 7efecb7fe700 1 -- 172.21.15.96:0/4050246593 learned_addr learned my addr 172.21.15.96:0/4050246593 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:42:04.269 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.262+0000 7efecbfff700 1 --2- 172.21.15.96:0/4050246593 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efecc100330 0x7efecc1960f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:04.269 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.262+0000 7efecb7fe700 1 -- 172.21.15.96:0/4050246593 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efecc100330 msgr2=0x7efecc1960f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:04.269 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.262+0000 7efecb7fe700 1 --2- 172.21.15.96:0/4050246593 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efecc100330 0x7efecc1960f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:04.270 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.262+0000 7efecb7fe700 1 -- 172.21.15.96:0/4050246593 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efecc101eb0 msgr2=0x7efecc19d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:04.270 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.262+0000 7efecb7fe700 1 --2- 172.21.15.96:0/4050246593 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efecc101eb0 0x7efecc19d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:04.270 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.262+0000 7efecb7fe700 1 -- 172.21.15.96:0/4050246593 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efebc0095f0 con 0x7efecc101520 2023-05-08T03:42:04.270 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.262+0000 7efecbfff700 1 --2- 172.21.15.96:0/4050246593 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efecc100330 0x7efecc1960f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-08T03:42:04.270 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.262+0000 7efecb7fe700 1 --2- 172.21.15.96:0/4050246593 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efecc101520 0x7efecc196630 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7efebc000c00 tx=0x7efebc00f510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:42:04.270 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.262+0000 7efec97fa700 1 -- 172.21.15.96:0/4050246593 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efebc01d070 con 0x7efecc101520 2023-05-08T03:42:04.270 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.262+0000 7efec97fa700 1 -- 172.21.15.96:0/4050246593 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efebc00fc60 con 0x7efecc101520 2023-05-08T03:42:04.270 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.262+0000 7efed2745700 1 -- 172.21.15.96:0/4050246593 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efecc10bc90 con 0x7efecc101520 2023-05-08T03:42:04.271 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.262+0000 7efec97fa700 1 -- 172.21.15.96:0/4050246593 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efebc017650 con 0x7efecc101520 2023-05-08T03:42:04.271 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.262+0000 7efed2745700 1 -- 172.21.15.96:0/4050246593 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efecc10bb00 con 0x7efecc101520 2023-05-08T03:42:04.271 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.263+0000 7efed2745700 1 -- 172.21.15.96:0/4050246593 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efecc1078c0 con 0x7efecc101520 2023-05-08T03:42:04.271 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.264+0000 7efec97fa700 1 -- 172.21.15.96:0/4050246593 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7efebc004830 con 0x7efecc101520 2023-05-08T03:42:04.271 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.265+0000 7efec97fa700 1 --2- 172.21.15.96:0/4050246593 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7efeb80a11e0 0x7efeb80a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:04.271 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.265+0000 7efecbfff700 1 --2- 172.21.15.96:0/4050246593 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7efeb80a11e0 0x7efeb80a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:04.271 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.265+0000 7efec97fa700 1 -- 172.21.15.96:0/4050246593 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7efebc0ce4a0 con 0x7efecc101520 2023-05-08T03:42:04.271 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.266+0000 7efecbfff700 1 --2- 172.21.15.96:0/4050246593 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7efeb80a11e0 0x7efeb80a3690 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7efecc101380 tx=0x7efeb4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:42:04.272 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.269+0000 7efec97fa700 1 -- 172.21.15.96:0/4050246593 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7efebc097c20 con 0x7efecc101520 2023-05-08T03:42:04.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:03 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/2039185331' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-05-08T03:42:04.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:03 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/2703637123' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-05-08T03:42:04.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:03 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/2383203354' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-05-08T03:42:04.461 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.458+0000 7efed2745700 1 -- 172.21.15.96:0/4050246593 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7efecc061a30 con 0x7efecc101520 2023-05-08T03:42:04.461 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.459+0000 7efec97fa700 1 -- 172.21.15.96:0/4050246593 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v84) v1 ==== 104+0+11 (secure 0 0 0) 0x7efebc09b240 con 0x7efecc101520 2023-05-08T03:42:04.461 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2023-05-08T03:42:04.463 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.461+0000 7efed2745700 1 -- 172.21.15.96:0/4050246593 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7efeb80a11e0 msgr2=0x7efeb80a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:04.464 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.461+0000 7efed2745700 1 --2- 172.21.15.96:0/4050246593 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7efeb80a11e0 0x7efeb80a3690 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7efecc101380 tx=0x7efeb4009260 comp rx=0 tx=0).stop 2023-05-08T03:42:04.464 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.461+0000 7efed2745700 1 -- 172.21.15.96:0/4050246593 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efecc101520 msgr2=0x7efecc196630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:04.464 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.461+0000 7efed2745700 1 --2- 172.21.15.96:0/4050246593 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efecc101520 0x7efecc196630 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7efebc000c00 tx=0x7efebc00f510 comp rx=0 tx=0).stop 2023-05-08T03:42:04.464 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.461+0000 7efed2745700 1 -- 172.21.15.96:0/4050246593 shutdown_connections 2023-05-08T03:42:04.464 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.461+0000 7efed2745700 1 --2- 172.21.15.96:0/4050246593 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7efeb80a11e0 0x7efeb80a3690 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:04.464 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.461+0000 7efed2745700 1 --2- 172.21.15.96:0/4050246593 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efecc101eb0 0x7efecc19d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:04.464 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.461+0000 7efed2745700 1 --2- 172.21.15.96:0/4050246593 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efecc100330 0x7efecc1960f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:04.465 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.461+0000 7efed2745700 1 --2- 172.21.15.96:0/4050246593 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efecc101520 0x7efecc196630 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:04.465 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.461+0000 7efed2745700 1 -- 172.21.15.96:0/4050246593 >> 172.21.15.96:0/4050246593 conn(0x7efecc0fb950 msgr2=0x7efecc104a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:42:04.465 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.461+0000 7efed2745700 1 -- 172.21.15.96:0/4050246593 shutdown_connections 2023-05-08T03:42:04.465 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.461+0000 7efed2745700 1 -- 172.21.15.96:0/4050246593 wait complete. 2023-05-08T03:42:04.476 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-08T03:42:04.601 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.597+0000 7fb4bf42a700 1 -- 172.21.15.96:0/3380559354 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4b80ff530 msgr2=0x7fb4b80ff9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:04.602 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.597+0000 7fb4bf42a700 1 --2- 172.21.15.96:0/3380559354 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4b80ff530 0x7fb4b80ff9a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fb4a8009990 tx=0x7fb4a8009ca0 comp rx=0 tx=0).stop 2023-05-08T03:42:04.603 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.597+0000 7fb4bf42a700 1 -- 172.21.15.96:0/3380559354 shutdown_connections 2023-05-08T03:42:04.603 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.597+0000 7fb4bf42a700 1 --2- 172.21.15.96:0/3380559354 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb4b80ffee0 0x7fb4b8107790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:04.603 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.597+0000 7fb4bf42a700 1 --2- 172.21.15.96:0/3380559354 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4b81008e0 0x7fb4b8100cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:04.603 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.597+0000 7fb4bf42a700 1 --2- 172.21.15.96:0/3380559354 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4b80ff530 0x7fb4b80ff9a0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:04.603 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.597+0000 7fb4bf42a700 1 -- 172.21.15.96:0/3380559354 >> 172.21.15.96:0/3380559354 conn(0x7fb4b80fa050 msgr2=0x7fb4b80fc4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:42:04.603 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.597+0000 7fb4bf42a700 1 -- 172.21.15.96:0/3380559354 shutdown_connections 2023-05-08T03:42:04.603 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.597+0000 7fb4bf42a700 1 -- 172.21.15.96:0/3380559354 wait complete. 2023-05-08T03:42:04.604 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.598+0000 7fb4bf42a700 1 Processor -- start 2023-05-08T03:42:04.604 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.598+0000 7fb4bf42a700 1 -- start start 2023-05-08T03:42:04.604 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.598+0000 7fb4bf42a700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb4b80ff530 0x7fb4b81960a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:04.604 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.598+0000 7fb4bf42a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4b80ffee0 0x7fb4b81965e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:04.604 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.598+0000 7fb4bf42a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4b81008e0 0x7fb4b819d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:04.604 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.598+0000 7fb4bf42a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b819dc20 con 0x7fb4b81008e0 2023-05-08T03:42:04.605 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.598+0000 7fb4bf42a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b819dd60 con 0x7fb4b80ffee0 2023-05-08T03:42:04.605 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.598+0000 7fb4bf42a700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b819def0 con 0x7fb4b80ff530 2023-05-08T03:42:04.605 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.598+0000 7fb4bd9c7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4b81008e0 0x7fb4b819d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:04.605 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.598+0000 7fb4bd9c7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4b81008e0 0x7fb4b819d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41574/0 (socket says 172.21.15.96:41574) 2023-05-08T03:42:04.605 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.598+0000 7fb4bd9c7700 1 -- 172.21.15.96:0/1790487718 learned_addr learned my addr 172.21.15.96:0/1790487718 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:42:04.605 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.598+0000 7fb4bc9c5700 1 --2- 172.21.15.96:0/1790487718 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4b80ffee0 0x7fb4b81965e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:04.605 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.598+0000 7fb4bd1c6700 1 --2- 172.21.15.96:0/1790487718 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb4b80ff530 0x7fb4b81960a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:04.606 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.598+0000 7fb4bd9c7700 1 -- 172.21.15.96:0/1790487718 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb4b80ff530 msgr2=0x7fb4b81960a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:04.606 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.598+0000 7fb4bd9c7700 1 --2- 172.21.15.96:0/1790487718 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb4b80ff530 0x7fb4b81960a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:04.606 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.598+0000 7fb4bd9c7700 1 -- 172.21.15.96:0/1790487718 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4b80ffee0 msgr2=0x7fb4b81965e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:04.606 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.598+0000 7fb4bd9c7700 1 --2- 172.21.15.96:0/1790487718 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4b80ffee0 0x7fb4b81965e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:04.606 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.598+0000 7fb4bd9c7700 1 -- 172.21.15.96:0/1790487718 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4a80095f0 con 0x7fb4b81008e0 2023-05-08T03:42:04.606 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.598+0000 7fb4bc9c5700 1 --2- 172.21.15.96:0/1790487718 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4b80ffee0 0x7fb4b81965e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-08T03:42:04.606 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.598+0000 7fb4bd1c6700 1 --2- 172.21.15.96:0/1790487718 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb4b80ff530 0x7fb4b81960a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-08T03:42:04.607 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.599+0000 7fb4bd9c7700 1 --2- 172.21.15.96:0/1790487718 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4b81008e0 0x7fb4b819d650 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fb4b000ada0 tx=0x7fb4b000c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:42:04.607 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.599+0000 7fb4ae7fc700 1 -- 172.21.15.96:0/1790487718 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b000f070 con 0x7fb4b81008e0 2023-05-08T03:42:04.607 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.599+0000 7fb4ae7fc700 1 -- 172.21.15.96:0/1790487718 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb4b0007b30 con 0x7fb4b81008e0 2023-05-08T03:42:04.607 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.599+0000 7fb4bf42a700 1 -- 172.21.15.96:0/1790487718 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4b810ac80 con 0x7fb4b81008e0 2023-05-08T03:42:04.607 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.599+0000 7fb4ae7fc700 1 -- 172.21.15.96:0/1790487718 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b0005440 con 0x7fb4b81008e0 2023-05-08T03:42:04.607 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.599+0000 7fb4bf42a700 1 -- 172.21.15.96:0/1790487718 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4b810aaf0 con 0x7fb4b81008e0 2023-05-08T03:42:04.608 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.600+0000 7fb4bf42a700 1 -- 172.21.15.96:0/1790487718 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4b8107420 con 0x7fb4b81008e0 2023-05-08T03:42:04.609 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.601+0000 7fb4ae7fc700 1 -- 172.21.15.96:0/1790487718 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fb4b0004ad0 con 0x7fb4b81008e0 2023-05-08T03:42:04.609 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.601+0000 7fb4ae7fc700 1 --2- 172.21.15.96:0/1790487718 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fb4a40a1260 0x7fb4a40a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:04.609 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.601+0000 7fb4bd1c6700 1 --2- 172.21.15.96:0/1790487718 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fb4a40a1260 0x7fb4a40a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:04.609 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.601+0000 7fb4ae7fc700 1 -- 172.21.15.96:0/1790487718 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7fb4b00cc5d0 con 0x7fb4b81008e0 2023-05-08T03:42:04.609 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.602+0000 7fb4bd1c6700 1 --2- 172.21.15.96:0/1790487718 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fb4a40a1260 0x7fb4a40a3710 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb4b4005d90 tx=0x7fb4b4005d00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:42:04.609 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.605+0000 7fb4ae7fc700 1 -- 172.21.15.96:0/1790487718 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fb4b0095d50 con 0x7fb4b81008e0 2023-05-08T03:42:04.796 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.794+0000 7fb4bf42a700 1 -- 172.21.15.96:0/1790487718 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb4b8061a80 con 0x7fb4b81008e0 2023-05-08T03:42:04.797 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.794+0000 7fb4ae7fc700 1 -- 172.21.15.96:0/1790487718 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v84) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb4b0099370 con 0x7fb4b81008e0 2023-05-08T03:42:04.797 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 64 2023-05-08T03:42:04.799 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.796+0000 7fb4bf42a700 1 -- 172.21.15.96:0/1790487718 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fb4a40a1260 msgr2=0x7fb4a40a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:04.799 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.796+0000 7fb4bf42a700 1 --2- 172.21.15.96:0/1790487718 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fb4a40a1260 0x7fb4a40a3710 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb4b4005d90 tx=0x7fb4b4005d00 comp rx=0 tx=0).stop 2023-05-08T03:42:04.799 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.796+0000 7fb4bf42a700 1 -- 172.21.15.96:0/1790487718 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4b81008e0 msgr2=0x7fb4b819d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:04.799 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.796+0000 7fb4bf42a700 1 --2- 172.21.15.96:0/1790487718 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4b81008e0 0x7fb4b819d650 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fb4b000ada0 tx=0x7fb4b000c330 comp rx=0 tx=0).stop 2023-05-08T03:42:04.799 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.796+0000 7fb4bf42a700 1 -- 172.21.15.96:0/1790487718 shutdown_connections 2023-05-08T03:42:04.799 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.796+0000 7fb4bf42a700 1 --2- 172.21.15.96:0/1790487718 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fb4a40a1260 0x7fb4a40a3710 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:04.800 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.796+0000 7fb4bf42a700 1 --2- 172.21.15.96:0/1790487718 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4b81008e0 0x7fb4b819d650 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:04.800 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.796+0000 7fb4bf42a700 1 --2- 172.21.15.96:0/1790487718 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb4b80ff530 0x7fb4b81960a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:04.800 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.796+0000 7fb4bf42a700 1 --2- 172.21.15.96:0/1790487718 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4b80ffee0 0x7fb4b81965e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:04.800 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.796+0000 7fb4bf42a700 1 -- 172.21.15.96:0/1790487718 >> 172.21.15.96:0/1790487718 conn(0x7fb4b80fa050 msgr2=0x7fb4b80fc2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:42:04.800 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.796+0000 7fb4bf42a700 1 -- 172.21.15.96:0/1790487718 shutdown_connections 2023-05-08T03:42:04.800 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.796+0000 7fb4bf42a700 1 -- 172.21.15.96:0/1790487718 wait complete. 2023-05-08T03:42:04.811 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-08T03:42:04.936 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.932+0000 7f1af962c700 1 -- 172.21.15.96:0/1255276376 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1af40ff210 msgr2=0x7f1af40ff620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:04.937 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.932+0000 7f1af962c700 1 --2- 172.21.15.96:0/1255276376 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1af40ff210 0x7f1af40ff620 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f1ae4009990 tx=0x7f1ae4009ca0 comp rx=0 tx=0).stop 2023-05-08T03:42:04.937 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.932+0000 7f1af962c700 1 -- 172.21.15.96:0/1255276376 shutdown_connections 2023-05-08T03:42:04.937 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.932+0000 7f1af962c700 1 --2- 172.21.15.96:0/1255276376 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1af4100d90 0x7f1af4107650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:04.938 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.932+0000 7f1af962c700 1 --2- 172.21.15.96:0/1255276376 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1af40ff210 0x7f1af40ff620 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:04.938 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.932+0000 7f1af962c700 1 --2- 172.21.15.96:0/1255276376 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1af4100400 0x7f1af4100850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:04.938 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.932+0000 7f1af962c700 1 -- 172.21.15.96:0/1255276376 >> 172.21.15.96:0/1255276376 conn(0x7f1af40fa7f0 msgr2=0x7f1af40fcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:42:04.938 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.932+0000 7f1af962c700 1 -- 172.21.15.96:0/1255276376 shutdown_connections 2023-05-08T03:42:04.938 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.932+0000 7f1af962c700 1 -- 172.21.15.96:0/1255276376 wait complete. 2023-05-08T03:42:04.938 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.932+0000 7f1af962c700 1 Processor -- start 2023-05-08T03:42:04.939 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.932+0000 7f1af962c700 1 -- start start 2023-05-08T03:42:04.939 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.933+0000 7f1af962c700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1af40ff210 0x7f1af41982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:04.939 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.933+0000 7f1af962c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1af4100400 0x7f1af4198810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:04.939 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.933+0000 7f1af962c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1af4100d90 0x7f1af419f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:04.939 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.933+0000 7f1af962c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1af419fe50 con 0x7f1af4100d90 2023-05-08T03:42:04.940 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.933+0000 7f1af962c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1af419ff90 con 0x7f1af4100400 2023-05-08T03:42:04.940 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.933+0000 7f1af962c700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1af41a0120 con 0x7f1af40ff210 2023-05-08T03:42:04.940 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.933+0000 7f1af37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1af4100d90 0x7f1af419f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:04.940 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.933+0000 7f1af37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1af4100d90 0x7f1af419f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41588/0 (socket says 172.21.15.96:41588) 2023-05-08T03:42:04.941 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.933+0000 7f1af37fe700 1 -- 172.21.15.96:0/567961568 learned_addr learned my addr 172.21.15.96:0/567961568 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:42:04.941 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.933+0000 7f1af2ffd700 1 --2- 172.21.15.96:0/567961568 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1af40ff210 0x7f1af41982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:04.941 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.933+0000 7f1af27fc700 1 --2- 172.21.15.96:0/567961568 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1af4100400 0x7f1af4198810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:04.941 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.933+0000 7f1af37fe700 1 -- 172.21.15.96:0/567961568 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1af40ff210 msgr2=0x7f1af41982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:04.941 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.933+0000 7f1af37fe700 1 --2- 172.21.15.96:0/567961568 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1af40ff210 0x7f1af41982d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:04.942 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.933+0000 7f1af37fe700 1 -- 172.21.15.96:0/567961568 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1af4100400 msgr2=0x7f1af4198810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:04.942 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.933+0000 7f1af37fe700 1 --2- 172.21.15.96:0/567961568 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1af4100400 0x7f1af4198810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:04.942 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.933+0000 7f1af37fe700 1 -- 172.21.15.96:0/567961568 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ae40095f0 con 0x7f1af4100d90 2023-05-08T03:42:04.942 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.933+0000 7f1af37fe700 1 --2- 172.21.15.96:0/567961568 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1af4100d90 0x7f1af419f880 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f1aec00ef30 tx=0x7f1aec00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:42:04.942 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.933+0000 7f1adbfff700 1 -- 172.21.15.96:0/567961568 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aec018070 con 0x7f1af4100d90 2023-05-08T03:42:04.943 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.933+0000 7f1adbfff700 1 -- 172.21.15.96:0/567961568 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1aec00f040 con 0x7f1af4100d90 2023-05-08T03:42:04.943 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.933+0000 7f1af962c700 1 -- 172.21.15.96:0/567961568 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1af410bce0 con 0x7f1af4100d90 2023-05-08T03:42:04.943 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.933+0000 7f1adbfff700 1 -- 172.21.15.96:0/567961568 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aec00cd00 con 0x7f1af4100d90 2023-05-08T03:42:04.944 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.933+0000 7f1af962c700 1 -- 172.21.15.96:0/567961568 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1af410bb50 con 0x7f1af4100d90 2023-05-08T03:42:04.944 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.934+0000 7f1af962c700 1 -- 172.21.15.96:0/567961568 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1af41929e0 con 0x7f1af4100d90 2023-05-08T03:42:04.945 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.936+0000 7f1adbfff700 1 -- 172.21.15.96:0/567961568 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f1aec003a00 con 0x7f1af4100d90 2023-05-08T03:42:04.946 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.937+0000 7f1adbfff700 1 --2- 172.21.15.96:0/567961568 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f1adc0a11e0 0x7f1adc0a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:04.946 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.937+0000 7f1af2ffd700 1 --2- 172.21.15.96:0/567961568 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f1adc0a11e0 0x7f1adc0a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:04.946 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.937+0000 7f1adbfff700 1 -- 172.21.15.96:0/567961568 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f1aec0ccea0 con 0x7f1af4100d90 2023-05-08T03:42:04.946 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.937+0000 7f1af2ffd700 1 --2- 172.21.15.96:0/567961568 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f1adc0a11e0 0x7f1adc0a3690 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1ae4006010 tx=0x7f1ae4005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:42:04.946 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:04.940+0000 7f1adbfff700 1 -- 172.21.15.96:0/567961568 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f1aec096620 con 0x7f1af4100d90 2023-05-08T03:42:05.173 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.171+0000 7f1af962c700 1 -- 172.21.15.96:0/567961568 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1af402d0e0 con 0x7f1af4100d90 2023-05-08T03:42:05.174 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.171+0000 7f1adbfff700 1 -- 172.21.15.96:0/567961568 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+10813 (secure 0 0 0) 0x7f1aec099c40 con 0x7f1af4100d90 2023-05-08T03:42:05.174 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:42:05.174 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6835/1518512221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":1518512221},{"type":"v1","addr":"172.21.15.96:6835","nonce":1518512221}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6837/305967678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6836","nonce":305967678},{"type":"v1","addr":"172.21.15.96:6837","nonce":305967678}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14622,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6839/2596991665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6838","nonce":2596991665},{"type":"v1","addr":"172.21.15.96:6839","nonce":2596991665}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6841/1786091200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6840","nonce":1786091200},{"type":"v1","addr":"172.21.15.96:6841","nonce":1786091200}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24416,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/2351258784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":2351258784},{"type":"v1","addr":"172.21.15.133:6833","nonce":2351258784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/2274306880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":2274306880},{"type":"v1","addr":"172.21.15.186:6833","nonce":2274306880}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-05-08T03:40:49.210143+0000","modified":"2023-05-08T03:40:54.356833+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24494,"mds_1":24487,"mds_2":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24437":{"gid":24437,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6835/1735118966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1735118966},{"type":"v1","addr":"172.21.15.133:6835","nonce":1735118966}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6835/3984391904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":3984391904},{"type":"v1","addr":"172.21.15.186:6835","nonce":3984391904}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24461":{"gid":24461,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6837/2218851414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":2218851414},{"type":"v1","addr":"172.21.15.133:6837","nonce":2218851414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24472":{"gid":24472,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.186:6837/1556405826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":1556405826},{"type":"v1","addr":"172.21.15.186:6837","nonce":1556405826}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":5,"addr":"172.21.15.186:6839/1267655485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":1267655485},{"type":"v1","addr":"172.21.15.186:6839","nonce":1267655485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6839/2246041493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6838","nonce":2246041493},{"type":"v1","addr":"172.21.15.133:6839","nonce":2246041493}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-08T03:42:05.177 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.174+0000 7f1af962c700 1 -- 172.21.15.96:0/567961568 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f1adc0a11e0 msgr2=0x7f1adc0a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:05.177 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.174+0000 7f1af962c700 1 --2- 172.21.15.96:0/567961568 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f1adc0a11e0 0x7f1adc0a3690 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1ae4006010 tx=0x7f1ae4005960 comp rx=0 tx=0).stop 2023-05-08T03:42:05.178 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.174+0000 7f1af962c700 1 -- 172.21.15.96:0/567961568 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1af4100d90 msgr2=0x7f1af419f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:05.178 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.174+0000 7f1af962c700 1 --2- 172.21.15.96:0/567961568 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1af4100d90 0x7f1af419f880 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f1aec00ef30 tx=0x7f1aec00c3a0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.179 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.174+0000 7f1af962c700 1 -- 172.21.15.96:0/567961568 shutdown_connections 2023-05-08T03:42:05.179 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.174+0000 7f1af962c700 1 --2- 172.21.15.96:0/567961568 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f1adc0a11e0 0x7f1adc0a3690 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.179 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.174+0000 7f1af962c700 1 --2- 172.21.15.96:0/567961568 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1af4100d90 0x7f1af419f880 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.179 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.174+0000 7f1af962c700 1 --2- 172.21.15.96:0/567961568 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1af40ff210 0x7f1af41982d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.179 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.174+0000 7f1af962c700 1 --2- 172.21.15.96:0/567961568 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1af4100400 0x7f1af4198810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.179 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.174+0000 7f1af962c700 1 -- 172.21.15.96:0/567961568 >> 172.21.15.96:0/567961568 conn(0x7f1af40fa7f0 msgr2=0x7f1af4105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:42:05.179 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.174+0000 7f1af962c700 1 -- 172.21.15.96:0/567961568 shutdown_connections 2023-05-08T03:42:05.180 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.174+0000 7f1af962c700 1 -- 172.21.15.96:0/567961568 wait complete. 2023-05-08T03:42:05.180 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 22 2023-05-08T03:42:05.188 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:04 smithi096 ceph-mon[124666]: pgmap v297: 97 pgs: 97 active+clean; 636 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-05-08T03:42:05.188 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:04 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/3262730851' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-05-08T03:42:05.188 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:04 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/4050246593' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-05-08T03:42:05.188 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:04 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/1790487718' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-05-08T03:42:05.189 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-08T03:42:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:04 smithi133 ceph-mon[125939]: pgmap v297: 97 pgs: 97 active+clean; 636 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-05-08T03:42:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:04 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/3262730851' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-05-08T03:42:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:04 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/4050246593' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-05-08T03:42:05.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:04 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/1790487718' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-05-08T03:42:05.317 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.312+0000 7f68abab3700 1 -- 172.21.15.96:0/1936820178 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68a4100450 msgr2=0x7f68a41008c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:05.317 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.312+0000 7f68abab3700 1 --2- 172.21.15.96:0/1936820178 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68a4100450 0x7f68a41008c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f68a0009990 tx=0x7f68a0009ca0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.317 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.312+0000 7f68abab3700 1 -- 172.21.15.96:0/1936820178 shutdown_connections 2023-05-08T03:42:05.318 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.312+0000 7f68abab3700 1 --2- 172.21.15.96:0/1936820178 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68a4100e00 0x7f68a41076a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.318 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.312+0000 7f68abab3700 1 --2- 172.21.15.96:0/1936820178 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f68a40ff740 0x7f68a40ffb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.318 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.312+0000 7f68abab3700 1 --2- 172.21.15.96:0/1936820178 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68a4100450 0x7f68a41008c0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.318 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.312+0000 7f68abab3700 1 -- 172.21.15.96:0/1936820178 >> 172.21.15.96:0/1936820178 conn(0x7f68a40f9f80 msgr2=0x7f68a40fc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:42:05.318 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.312+0000 7f68abab3700 1 -- 172.21.15.96:0/1936820178 shutdown_connections 2023-05-08T03:42:05.318 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.312+0000 7f68abab3700 1 -- 172.21.15.96:0/1936820178 wait complete. 2023-05-08T03:42:05.318 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.313+0000 7f68abab3700 1 Processor -- start 2023-05-08T03:42:05.319 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.313+0000 7f68abab3700 1 -- start start 2023-05-08T03:42:05.319 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.313+0000 7f68abab3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68a40ff740 0x7f68a40fee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:05.319 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.313+0000 7f68abab3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68a4100450 0x7f68a419ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:05.319 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.313+0000 7f68abab3700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f68a4100e00 0x7f68a419d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:05.319 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.313+0000 7f68abab3700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68a419dc20 con 0x7f68a4100450 2023-05-08T03:42:05.319 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.313+0000 7f68abab3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68a419dd90 con 0x7f68a40ff740 2023-05-08T03:42:05.319 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.313+0000 7f68abab3700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68a419df50 con 0x7f68a4100e00 2023-05-08T03:42:05.320 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.313+0000 7f68a904e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68a4100450 0x7f68a419ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:05.320 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.313+0000 7f68a904e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68a4100450 0x7f68a419ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41600/0 (socket says 172.21.15.96:41600) 2023-05-08T03:42:05.320 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.313+0000 7f68a904e700 1 -- 172.21.15.96:0/2786256475 learned_addr learned my addr 172.21.15.96:0/2786256475 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:42:05.320 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.313+0000 7f68a984f700 1 --2- 172.21.15.96:0/2786256475 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68a40ff740 0x7f68a40fee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:05.320 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.313+0000 7f68aa050700 1 --2- 172.21.15.96:0/2786256475 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f68a4100e00 0x7f68a419d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:05.320 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.313+0000 7f68a904e700 1 -- 172.21.15.96:0/2786256475 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f68a4100e00 msgr2=0x7f68a419d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:05.320 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.313+0000 7f68a904e700 1 --2- 172.21.15.96:0/2786256475 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f68a4100e00 0x7f68a419d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.321 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.313+0000 7f68a904e700 1 -- 172.21.15.96:0/2786256475 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68a40ff740 msgr2=0x7f68a40fee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:05.321 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.313+0000 7f68a904e700 1 --2- 172.21.15.96:0/2786256475 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68a40ff740 0x7f68a40fee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.321 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.313+0000 7f68a904e700 1 -- 172.21.15.96:0/2786256475 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68a00095f0 con 0x7f68a4100450 2023-05-08T03:42:05.321 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.314+0000 7f68a904e700 1 --2- 172.21.15.96:0/2786256475 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68a4100450 0x7f68a419ae00 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f68a000b680 tx=0x7f68a0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:42:05.321 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.314+0000 7f689affd700 1 -- 172.21.15.96:0/2786256475 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a001d070 con 0x7f68a4100450 2023-05-08T03:42:05.321 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.314+0000 7f689affd700 1 -- 172.21.15.96:0/2786256475 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f68a00054f0 con 0x7f68a4100450 2023-05-08T03:42:05.321 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.314+0000 7f68abab3700 1 -- 172.21.15.96:0/2786256475 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68a410ab90 con 0x7f68a4100450 2023-05-08T03:42:05.321 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.314+0000 7f689affd700 1 -- 172.21.15.96:0/2786256475 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a0004be0 con 0x7f68a4100450 2023-05-08T03:42:05.322 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.314+0000 7f68abab3700 1 -- 172.21.15.96:0/2786256475 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68a410aa00 con 0x7f68a4100450 2023-05-08T03:42:05.322 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.315+0000 7f68abab3700 1 -- 172.21.15.96:0/2786256475 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68a41061e0 con 0x7f68a4100450 2023-05-08T03:42:05.323 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.316+0000 7f689affd700 1 -- 172.21.15.96:0/2786256475 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f68a000fbc0 con 0x7f68a4100450 2023-05-08T03:42:05.323 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.316+0000 7f689affd700 1 --2- 172.21.15.96:0/2786256475 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f68900a11e0 0x7f68900a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:05.323 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.317+0000 7f68a984f700 1 --2- 172.21.15.96:0/2786256475 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f68900a11e0 0x7f68900a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:05.323 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.317+0000 7f689affd700 1 -- 172.21.15.96:0/2786256475 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f68a00ce440 con 0x7f68a4100450 2023-05-08T03:42:05.324 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.317+0000 7f68a984f700 1 --2- 172.21.15.96:0/2786256475 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f68900a11e0 0x7f68900a3690 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f68a4067a40 tx=0x7f6894007400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:42:05.324 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.320+0000 7f689affd700 1 -- 172.21.15.96:0/2786256475 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f68a0097bc0 con 0x7f68a4100450 2023-05-08T03:42:05.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:04 smithi186 ceph-mon[126480]: pgmap v297: 97 pgs: 97 active+clean; 636 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-05-08T03:42:05.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:04 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/3262730851' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-05-08T03:42:05.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:04 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/4050246593' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-05-08T03:42:05.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:04 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/1790487718' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-05-08T03:42:05.519 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.515+0000 7f68abab3700 1 -- 172.21.15.96:0/2786256475 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f68a402d0e0 con 0x7f68a4100450 2023-05-08T03:42:05.519 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.516+0000 7f689affd700 1 -- 172.21.15.96:0/2786256475 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+22437 (secure 0 0 0) 0x7f68a009b1e0 con 0x7f68a4100450 2023-05-08T03:42:05.520 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:42:05.521 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":84,"fsid":"f7ffcfb0-ed50-11ed-9b01-001a4aab830c","created":"2023-05-08T03:33:42.765680+0000","modified":"2023-05-08T03:41:39.350582+0000","last_up_change":"2023-05-08T03:40:07.550882+0000","last_in_change":"2023-05-08T03:39:49.027947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-08T03:36:47.800739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-05-08T03:40:47.229693+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-05-08T03:40:48.359294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2ee801e1-8eec-496d-a9ac-fc566b38bbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":1816903726},{"type":"v1","addr":"172.21.15.96:6803","nonce":1816903726}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":1816903726},{"type":"v1","addr":"172.21.15.96:6805","nonce":1816903726}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":1816903726},{"type":"v1","addr":"172.21.15.96:6809","nonce":1816903726}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":1816903726},{"type":"v1","addr":"172.21.15.96:6807","nonce":1816903726}]},"public_addr":"172.21.15.96:6803/1816903726","cluster_addr":"172.21.15.96:6805/1816903726","heartbeat_back_addr":"172.21.15.96:6809/1816903726","heartbeat_front_addr":"172.21.15.96:6807/1816903726","state":["exists","up"]},{"osd":1,"uuid":"eb73deea-fc7c-4f2f-8aef-2d71c598afda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":206989126},{"type":"v1","addr":"172.21.15.133:6801","nonce":206989126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":206989126},{"type":"v1","addr":"172.21.15.133:6803","nonce":206989126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":206989126},{"type":"v1","addr":"172.21.15.133:6807","nonce":206989126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":206989126},{"type":"v1","addr":"172.21.15.133:6805","nonce":206989126}]},"public_addr":"172.21.15.133:6801/206989126","cluster_addr":"172.21.15.133:6803/206989126","heartbeat_back_addr":"172.21.15.133:6807/206989126","heartbeat_front_addr":"172.21.15.133:6805/206989126","state":["exists","up"]},{"osd":2,"uuid":"74a2f239-e82d-4d87-9458-5373b6cbbffd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":1791188143},{"type":"v1","addr":"172.21.15.186:6801","nonce":1791188143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":1791188143},{"type":"v1","addr":"172.21.15.186:6803","nonce":1791188143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":1791188143},{"type":"v1","addr":"172.21.15.186:6807","nonce":1791188143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":1791188143},{"type":"v1","addr":"172.21.15.186:6805","nonce":1791188143}]},"public_addr":"172.21.15.186:6801/1791188143","cluster_addr":"172.21.15.186:6803/1791188143","heartbeat_back_addr":"172.21.15.186:6807/1791188143","heartbeat_front_addr":"172.21.15.186:6805/1791188143","state":["exists","up"]},{"osd":3,"uuid":"421eedf5-ba6e-484e-b715-78c1c10d684e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":3430402140},{"type":"v1","addr":"172.21.15.96:6811","nonce":3430402140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":3430402140},{"type":"v1","addr":"172.21.15.96:6813","nonce":3430402140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":3430402140},{"type":"v1","addr":"172.21.15.96:6817","nonce":3430402140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":3430402140},{"type":"v1","addr":"172.21.15.96:6815","nonce":3430402140}]},"public_addr":"172.21.15.96:6811/3430402140","cluster_addr":"172.21.15.96:6813/3430402140","heartbeat_back_addr":"172.21.15.96:6817/3430402140","heartbeat_front_addr":"172.21.15.96:6815/3430402140","state":["exists","up"]},{"osd":4,"uuid":"fb20100b-6a5a-462d-955d-1697a3861e96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":1237495996},{"type":"v1","addr":"172.21.15.133:6809","nonce":1237495996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":1237495996},{"type":"v1","addr":"172.21.15.133:6811","nonce":1237495996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":1237495996},{"type":"v1","addr":"172.21.15.133:6815","nonce":1237495996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":1237495996},{"type":"v1","addr":"172.21.15.133:6813","nonce":1237495996}]},"public_addr":"172.21.15.133:6809/1237495996","cluster_addr":"172.21.15.133:6811/1237495996","heartbeat_back_addr":"172.21.15.133:6815/1237495996","heartbeat_front_addr":"172.21.15.133:6813/1237495996","state":["exists","up"]},{"osd":5,"uuid":"00177913-8bd6-4391-83c3-08c2b1b8ef13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":541111862},{"type":"v1","addr":"172.21.15.186:6809","nonce":541111862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":541111862},{"type":"v1","addr":"172.21.15.186:6811","nonce":541111862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":541111862},{"type":"v1","addr":"172.21.15.186:6815","nonce":541111862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":541111862},{"type":"v1","addr":"172.21.15.186:6813","nonce":541111862}]},"public_addr":"172.21.15.186:6809/541111862","cluster_addr":"172.21.15.186:6811/541111862","heartbeat_back_addr":"172.21.15.186:6815/541111862","heartbeat_front_addr":"172.21.15.186:6813/541111862","state":["exists","up"]},{"osd":6,"uuid":"204baab6-ca6f-4eef-8b9c-91efc04cc30c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":386227948},{"type":"v1","addr":"172.21.15.96:6819","nonce":386227948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":386227948},{"type":"v1","addr":"172.21.15.96:6821","nonce":386227948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":386227948},{"type":"v1","addr":"172.21.15.96:6825","nonce":386227948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":386227948},{"type":"v1","addr":"172.21.15.96:6823","nonce":386227948}]},"public_addr":"172.21.15.96:6819/386227948","cluster_addr":"172.21.15.96:6821/386227948","heartbeat_back_addr":"172.21.15.96:6825/386227948","heartbeat_front_addr":"172.21.15.96:6823/386227948","state":["exists","up"]},{"osd":7,"uuid":"282db569-a76e-485b-a33d-f2579b956525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":218507954},{"type":"v1","addr":"172.21.15.133:6817","nonce":218507954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":218507954},{"type":"v1","addr":"172.21.15.133:6819","nonce":218507954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":218507954},{"type":"v1","addr":"172.21.15.133:6823","nonce":218507954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":218507954},{"type":"v1","addr":"172.21.15.133:6821","nonce":218507954}]},"public_addr":"172.21.15.133:6817/218507954","cluster_addr":"172.21.15.133:6819/218507954","heartbeat_back_addr":"172.21.15.133:6823/218507954","heartbeat_front_addr":"172.21.15.133:6821/218507954","state":["exists","up"]},{"osd":8,"uuid":"693e25b5-355d-4990-9467-0fac4c9133fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":1648475902},{"type":"v1","addr":"172.21.15.186:6817","nonce":1648475902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":1648475902},{"type":"v1","addr":"172.21.15.186:6819","nonce":1648475902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":1648475902},{"type":"v1","addr":"172.21.15.186:6823","nonce":1648475902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":1648475902},{"type":"v1","addr":"172.21.15.186:6821","nonce":1648475902}]},"public_addr":"172.21.15.186:6817/1648475902","cluster_addr":"172.21.15.186:6819/1648475902","heartbeat_back_addr":"172.21.15.186:6823/1648475902","heartbeat_front_addr":"172.21.15.186:6821/1648475902","state":["exists","up"]},{"osd":9,"uuid":"72fbff09-fe28-4014-86fc-c31f95cd19a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":543223824},{"type":"v1","addr":"172.21.15.96:6827","nonce":543223824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":543223824},{"type":"v1","addr":"172.21.15.96:6829","nonce":543223824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6832","nonce":543223824},{"type":"v1","addr":"172.21.15.96:6833","nonce":543223824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":543223824},{"type":"v1","addr":"172.21.15.96:6831","nonce":543223824}]},"public_addr":"172.21.15.96:6827/543223824","cluster_addr":"172.21.15.96:6829/543223824","heartbeat_back_addr":"172.21.15.96:6833/543223824","heartbeat_front_addr":"172.21.15.96:6831/543223824","state":["exists","up"]},{"osd":10,"uuid":"6c2b6757-60c2-4962-9409-6051dcb13273","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":2323107912},{"type":"v1","addr":"172.21.15.133:6825","nonce":2323107912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":2323107912},{"type":"v1","addr":"172.21.15.133:6827","nonce":2323107912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":2323107912},{"type":"v1","addr":"172.21.15.133:6831","nonce":2323107912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":2323107912},{"type":"v1","addr":"172.21.15.133:6829","nonce":2323107912}]},"public_addr":"172.21.15.133:6825/2323107912","cluster_addr":"172.21.15.133:6827/2323107912","heartbeat_back_addr":"172.21.15.133:6831/2323107912","heartbeat_front_addr":"172.21.15.133:6829/2323107912","state":["exists","up"]},{"osd":11,"uuid":"03c0bb25-2921-446b-960e-6a7a328d36a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":3853499290},{"type":"v1","addr":"172.21.15.186:6825","nonce":3853499290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":3853499290},{"type":"v1","addr":"172.21.15.186:6827","nonce":3853499290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":3853499290},{"type":"v1","addr":"172.21.15.186:6831","nonce":3853499290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":3853499290},{"type":"v1","addr":"172.21.15.186:6829","nonce":3853499290}]},"public_addr":"172.21.15.186:6825/3853499290","cluster_addr":"172.21.15.186:6827/3853499290","heartbeat_back_addr":"172.21.15.186:6831/3853499290","heartbeat_front_addr":"172.21.15.186:6829/3853499290","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:36:02.087281+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:36:24.328783+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:36:46.135576+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:37:08.524145+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:37:30.883871+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:37:53.344554+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:38:15.448162+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:38:37.414878+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:38:59.533953+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:39:21.392102+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:39:43.462696+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-08T03:40:05.561808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.96:0/1333468881":"2023-05-09T03:34:37.472043+0000","172.21.15.96:6800/1979917756":"2023-05-09T03:34:37.472043+0000","172.21.15.96:0/1332045367":"2023-05-09T03:34:37.472043+0000","172.21.15.96:0/520278090":"2023-05-09T03:34:14.800324+0000","172.21.15.96:0/1055409415":"2023-05-09T03:34:37.472043+0000","172.21.15.96:6801/1979917756":"2023-05-09T03:34:37.472043+0000","172.21.15.96:0/1541933328":"2023-05-09T03:34:14.800324+0000","172.21.15.96:6800/3944122753":"2023-05-09T03:34:14.800324+0000","172.21.15.96:0/2986058319":"2023-05-09T03:34:14.800324+0000","172.21.15.96:6801/3944122753":"2023-05-09T03:34:14.800324+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-08T03:42:05.522 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.518+0000 7f68abab3700 1 -- 172.21.15.96:0/2786256475 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f68900a11e0 msgr2=0x7f68900a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:05.523 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.518+0000 7f68abab3700 1 --2- 172.21.15.96:0/2786256475 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f68900a11e0 0x7f68900a3690 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f68a4067a40 tx=0x7f6894007400 comp rx=0 tx=0).stop 2023-05-08T03:42:05.523 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.518+0000 7f68abab3700 1 -- 172.21.15.96:0/2786256475 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68a4100450 msgr2=0x7f68a419ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:05.523 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.518+0000 7f68abab3700 1 --2- 172.21.15.96:0/2786256475 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68a4100450 0x7f68a419ae00 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f68a000b680 tx=0x7f68a0004730 comp rx=0 tx=0).stop 2023-05-08T03:42:05.524 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.519+0000 7f68abab3700 1 -- 172.21.15.96:0/2786256475 shutdown_connections 2023-05-08T03:42:05.524 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.519+0000 7f68abab3700 1 --2- 172.21.15.96:0/2786256475 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f68900a11e0 0x7f68900a3690 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.524 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.519+0000 7f68abab3700 1 --2- 172.21.15.96:0/2786256475 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f68a4100e00 0x7f68a419d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.525 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.519+0000 7f68abab3700 1 --2- 172.21.15.96:0/2786256475 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68a40ff740 0x7f68a40fee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.525 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.519+0000 7f68abab3700 1 --2- 172.21.15.96:0/2786256475 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68a4100450 0x7f68a419ae00 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.525 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.519+0000 7f68abab3700 1 -- 172.21.15.96:0/2786256475 >> 172.21.15.96:0/2786256475 conn(0x7f68a40f9f80 msgr2=0x7f68a40fc2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:42:05.525 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.519+0000 7f68abab3700 1 -- 172.21.15.96:0/2786256475 shutdown_connections 2023-05-08T03:42:05.525 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.519+0000 7f68abab3700 1 -- 172.21.15.96:0/2786256475 wait complete. 2023-05-08T03:42:05.535 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 22, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2023-05-08T03:40:49.210143+0000', 'modified': '2023-05-08T03:40:54.356833+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24494, 'mds_1': 24487, 'mds_2': 24472}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24437': {'gid': 24437, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.133:6835/1735118966', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6834', 'nonce': 1735118966}, {'type': 'v1', 'addr': '172.21.15.133:6835', 'nonce': 1735118966}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24460': {'gid': 24460, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.186:6835/3984391904', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.186:6834', 'nonce': 3984391904}, {'type': 'v1', 'addr': '172.21.15.186:6835', 'nonce': 3984391904}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24461': {'gid': 24461, 'name': 'h', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.133:6837/2218851414', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6836', 'nonce': 2218851414}, {'type': 'v1', 'addr': '172.21.15.133:6837', 'nonce': 2218851414}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24472': {'gid': 24472, 'name': 'c', 'rank': 2, 'incarnation': 20, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.186:6837/1556405826', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.186:6836', 'nonce': 1556405826}, {'type': 'v1', 'addr': '172.21.15.186:6837', 'nonce': 1556405826}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24487': {'gid': 24487, 'name': 'i', 'rank': 1, 'incarnation': 18, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.186:6839/1267655485', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.186:6838', 'nonce': 1267655485}, {'type': 'v1', 'addr': '172.21.15.186:6839', 'nonce': 1267655485}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24494': {'gid': 24494, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.133:6839/2246041493', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6838', 'nonce': 2246041493}, {'type': 'v1', 'addr': '172.21.15.133:6839', 'nonce': 2246041493}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-05-08T03:42:05.535 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2023-05-08T03:42:05.536 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-05-08T03:42:05.662 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.659+0000 7f10df90a700 1 -- 172.21.15.96:0/874483481 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10d8100410 msgr2=0x7f10d8100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:05.663 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.659+0000 7f10df90a700 1 --2- 172.21.15.96:0/874483481 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10d8100410 0x7f10d8100860 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f10c8009990 tx=0x7f10c8009ca0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.663 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.660+0000 7f10df90a700 1 -- 172.21.15.96:0/874483481 shutdown_connections 2023-05-08T03:42:05.663 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.660+0000 7f10df90a700 1 --2- 172.21.15.96:0/874483481 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f10d8100da0 0x7f10d8107660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.663 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.660+0000 7f10df90a700 1 --2- 172.21.15.96:0/874483481 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10d80ff220 0x7f10d80ff630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.663 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.660+0000 7f10df90a700 1 --2- 172.21.15.96:0/874483481 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10d8100410 0x7f10d8100860 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.663 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.660+0000 7f10df90a700 1 -- 172.21.15.96:0/874483481 >> 172.21.15.96:0/874483481 conn(0x7f10d80fa840 msgr2=0x7f10d80fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:42:05.664 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.660+0000 7f10df90a700 1 -- 172.21.15.96:0/874483481 shutdown_connections 2023-05-08T03:42:05.664 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.660+0000 7f10df90a700 1 -- 172.21.15.96:0/874483481 wait complete. 2023-05-08T03:42:05.664 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.660+0000 7f10df90a700 1 Processor -- start 2023-05-08T03:42:05.664 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.660+0000 7f10df90a700 1 -- start start 2023-05-08T03:42:05.666 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.660+0000 7f10df90a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10d80ff220 0x7f10d8196010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:05.666 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.660+0000 7f10df90a700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f10d8100410 0x7f10d8196550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:05.666 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.660+0000 7f10df90a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10d8100da0 0x7f10d819d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:05.666 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.660+0000 7f10df90a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d819db90 con 0x7f10d80ff220 2023-05-08T03:42:05.667 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.660+0000 7f10df90a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d819dcd0 con 0x7f10d8100da0 2023-05-08T03:42:05.667 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.660+0000 7f10df90a700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d819de60 con 0x7f10d8100410 2023-05-08T03:42:05.667 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.660+0000 7f10dd6a6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10d80ff220 0x7f10d8196010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:05.667 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.661+0000 7f10dd6a6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10d80ff220 0x7f10d8196010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41612/0 (socket says 172.21.15.96:41612) 2023-05-08T03:42:05.667 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.661+0000 7f10dd6a6700 1 -- 172.21.15.96:0/3419588604 learned_addr learned my addr 172.21.15.96:0/3419588604 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:42:05.667 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.661+0000 7f10dcea5700 1 --2- 172.21.15.96:0/3419588604 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f10d8100410 0x7f10d8196550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:05.667 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.661+0000 7f10dd6a6700 1 -- 172.21.15.96:0/3419588604 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f10d8100410 msgr2=0x7f10d8196550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:05.667 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.661+0000 7f10ddea7700 1 --2- 172.21.15.96:0/3419588604 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10d8100da0 0x7f10d819d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:05.668 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.661+0000 7f10dd6a6700 1 --2- 172.21.15.96:0/3419588604 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f10d8100410 0x7f10d8196550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.668 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.661+0000 7f10dd6a6700 1 -- 172.21.15.96:0/3419588604 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10d8100da0 msgr2=0x7f10d819d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:05.668 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.661+0000 7f10dd6a6700 1 --2- 172.21.15.96:0/3419588604 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10d8100da0 0x7f10d819d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.668 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.661+0000 7f10dd6a6700 1 -- 172.21.15.96:0/3419588604 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10c80095f0 con 0x7f10d80ff220 2023-05-08T03:42:05.668 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.661+0000 7f10dd6a6700 1 --2- 172.21.15.96:0/3419588604 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10d80ff220 0x7f10d8196010 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f10d400c990 tx=0x7f10d400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:42:05.668 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.661+0000 7f10ce7fc700 1 -- 172.21.15.96:0/3419588604 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d4007b00 con 0x7f10d80ff220 2023-05-08T03:42:05.668 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.661+0000 7f10ce7fc700 1 -- 172.21.15.96:0/3419588604 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f10d4007c60 con 0x7f10d80ff220 2023-05-08T03:42:05.669 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.661+0000 7f10df90a700 1 -- 172.21.15.96:0/3419588604 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10d810ab80 con 0x7f10d80ff220 2023-05-08T03:42:05.669 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.661+0000 7f10ce7fc700 1 -- 172.21.15.96:0/3419588604 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d4018660 con 0x7f10d80ff220 2023-05-08T03:42:05.669 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.661+0000 7f10df90a700 1 -- 172.21.15.96:0/3419588604 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10d810a9f0 con 0x7f10d80ff220 2023-05-08T03:42:05.669 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.663+0000 7f10ce7fc700 1 -- 172.21.15.96:0/3419588604 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f10d400f450 con 0x7f10d80ff220 2023-05-08T03:42:05.674 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.664+0000 7f10ce7fc700 1 --2- 172.21.15.96:0/3419588604 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f10c40a1260 0x7f10c40a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:05.674 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.664+0000 7f10dcea5700 1 --2- 172.21.15.96:0/3419588604 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f10c40a1260 0x7f10c40a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:05.674 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.664+0000 7f10ce7fc700 1 -- 172.21.15.96:0/3419588604 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f10d40cca60 con 0x7f10d80ff220 2023-05-08T03:42:05.674 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.664+0000 7f10dcea5700 1 --2- 172.21.15.96:0/3419588604 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f10c40a1260 0x7f10c40a3710 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f10c8006010 tx=0x7f10c800b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:42:05.675 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.665+0000 7f10eba95b80 1 Processor -- start 2023-05-08T03:42:05.675 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.665+0000 7f10eba95b80 1 -- start start 2023-05-08T03:42:05.675 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.665+0000 7f10eba95b80 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55c837d8f340 0x55c837d8f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:05.675 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.665+0000 7f10eba95b80 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c837d8fc90 0x55c837d8e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:05.675 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.665+0000 7f10eba95b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c837d8e640 0x55c837d8eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:05.675 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.665+0000 7f10eba95b80 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c837c94020 con 0x55c837d8f340 2023-05-08T03:42:05.675 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.665+0000 7f10eba95b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c837ce6960 con 0x55c837d8e640 2023-05-08T03:42:05.675 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.665+0000 7f10eba95b80 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c837cdfdf0 con 0x55c837d8fc90 2023-05-08T03:42:05.676 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.665+0000 7f10dd6a6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55c837d8f340 0x55c837d8f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:05.676 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.665+0000 7f10dd6a6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55c837d8f340 0x55c837d8f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41620/0 (socket says 172.21.15.96:41620) 2023-05-08T03:42:05.676 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.665+0000 7f10dd6a6700 1 -- 172.21.15.96:0/4096476540 learned_addr learned my addr 172.21.15.96:0/4096476540 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:42:05.676 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.665+0000 7f10ddea7700 1 --2- 172.21.15.96:0/4096476540 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c837d8e640 0x55c837d8eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:05.676 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.665+0000 7f10dd6a6700 1 -- 172.21.15.96:0/4096476540 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c837d8fc90 msgr2=0x55c837d8e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-08T03:42:05.677 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.665+0000 7f10dd6a6700 1 --2- 172.21.15.96:0/4096476540 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c837d8fc90 0x55c837d8e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.677 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.665+0000 7f10dd6a6700 1 -- 172.21.15.96:0/4096476540 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c837d8e640 msgr2=0x55c837d8eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-08T03:42:05.677 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.665+0000 7f10dd6a6700 1 --2- 172.21.15.96:0/4096476540 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c837d8e640 0x55c837d8eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.677 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.665+0000 7f10dd6a6700 1 -- 172.21.15.96:0/4096476540 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c837b615e0 con 0x55c837d8f340 2023-05-08T03:42:05.677 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.665+0000 7f10ddea7700 1 --2- 172.21.15.96:0/4096476540 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c837d8e640 0x55c837d8eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-08T03:42:05.677 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.665+0000 7f10dd6a6700 1 --2- 172.21.15.96:0/4096476540 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55c837d8f340 0x55c837d8f750 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f10d40962c0 tx=0x7f10d4099a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c68af5c27ff0edde server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:42:05.677 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.665+0000 7f10c37fe700 1 -- 172.21.15.96:0/4096476540 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d4097f00 con 0x55c837d8f340 2023-05-08T03:42:05.678 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.665+0000 7f10c37fe700 1 -- 172.21.15.96:0/4096476540 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f10d4098160 con 0x55c837d8f340 2023-05-08T03:42:05.678 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.665+0000 7f10c37fe700 1 -- 172.21.15.96:0/4096476540 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d409a020 con 0x55c837d8f340 2023-05-08T03:42:05.678 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.666+0000 7f10eba95b80 1 -- 172.21.15.96:0/4096476540 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55c837d8f340 msgr2=0x55c837d8f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:05.678 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.666+0000 7f10eba95b80 1 --2- 172.21.15.96:0/4096476540 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55c837d8f340 0x55c837d8f750 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f10d40962c0 tx=0x7f10d4099a30 comp rx=0 tx=0).stop 2023-05-08T03:42:05.678 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.666+0000 7f10eba95b80 1 -- 172.21.15.96:0/4096476540 shutdown_connections 2023-05-08T03:42:05.678 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.666+0000 7f10eba95b80 1 --2- 172.21.15.96:0/4096476540 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c837d8e640 0x55c837d8eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.678 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.666+0000 7f10eba95b80 1 --2- 172.21.15.96:0/4096476540 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55c837d8f340 0x55c837d8f750 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.678 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.666+0000 7f10eba95b80 1 --2- 172.21.15.96:0/4096476540 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c837d8fc90 0x55c837d8e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.679 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.666+0000 7f10eba95b80 1 -- 172.21.15.96:0/4096476540 >> 172.21.15.96:0/4096476540 conn(0x55c837d8a3e0 msgr2=0x55c837d887b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:42:05.679 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.666+0000 7f10eba95b80 1 -- 172.21.15.96:0/4096476540 shutdown_connections 2023-05-08T03:42:05.679 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.666+0000 7f10eba95b80 1 -- 172.21.15.96:0/4096476540 wait complete. 2023-05-08T03:42:05.679 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.666+0000 7f10eba95b80 1 -- start start 2023-05-08T03:42:05.679 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.667+0000 7f10eba95b80 1 Processor -- start 2023-05-08T03:42:05.679 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.667+0000 7f10eba95b80 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55c837d8e640 0x55c837d97d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:05.679 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.667+0000 7f10eba95b80 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c837d8f340 0x55c837d98280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:05.680 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.667+0000 7f10eba95b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c837d8fc90 0x55c837d9f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:05.680 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.667+0000 7f10eba95b80 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c837b638d0 con 0x55c837d8e640 2023-05-08T03:42:05.680 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.667+0000 7f10eba95b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c837d9f800 con 0x55c837d8fc90 2023-05-08T03:42:05.680 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.667+0000 7f10eba95b80 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c837d9f990 con 0x55c837d8f340 2023-05-08T03:42:05.680 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.667+0000 7f10dd6a6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55c837d8e640 0x55c837d97d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:05.680 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.667+0000 7f10eba95b80 10 client.0 _ll_register_callbacks cb 0x55c837c854d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-08T03:42:05.680 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.667+0000 7f10dd6a6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55c837d8e640 0x55c837d97d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41626/0 (socket says 172.21.15.96:41626) 2023-05-08T03:42:05.681 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.667+0000 7f10dd6a6700 1 -- 172.21.15.96:0/1297679176 learned_addr learned my addr 172.21.15.96:0/1297679176 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:42:05.681 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.667+0000 7f10dcea5700 1 --2- 172.21.15.96:0/1297679176 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c837d8f340 0x55c837d98280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:05.681 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.667+0000 7f10ddea7700 1 --2- 172.21.15.96:0/1297679176 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c837d8fc90 0x55c837d9f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:05.681 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.667+0000 7f10dd6a6700 1 -- 172.21.15.96:0/1297679176 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c837d8f340 msgr2=0x55c837d98280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-08T03:42:05.681 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.667+0000 7f10dd6a6700 1 --2- 172.21.15.96:0/1297679176 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c837d8f340 0x55c837d98280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.681 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.667+0000 7f10dd6a6700 1 -- 172.21.15.96:0/1297679176 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c837d8fc90 msgr2=0x55c837d9f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-08T03:42:05.681 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.667+0000 7f10dd6a6700 1 --2- 172.21.15.96:0/1297679176 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c837d8fc90 0x55c837d9f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.681 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.667+0000 7f10dd6a6700 1 -- 172.21.15.96:0/1297679176 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10d810a9f0 con 0x55c837d8e640 2023-05-08T03:42:05.682 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.667+0000 7f10ddea7700 1 --2- 172.21.15.96:0/1297679176 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c837d8fc90 0x55c837d9f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-08T03:42:05.682 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.667+0000 7f10dd6a6700 1 --2- 172.21.15.96:0/1297679176 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55c837d8e640 0x55c837d97d40 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f10d4096270 tx=0x7f10d40ca3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b201ee78f1999dc2 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:42:05.682 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.667+0000 7f10c0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.96:3300/0 2023-05-08T03:42:05.682 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.668+0000 7f10c0ff9700 1 -- 172.21.15.96:0/1297679176 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d40ca660 con 0x55c837d8e640 2023-05-08T03:42:05.682 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.668+0000 7f10c0ff9700 1 -- 172.21.15.96:0/1297679176 <== mon.0 v2:172.21.15.96:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f10d409a020 con 0x55c837d8e640 2023-05-08T03:42:05.682 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.668+0000 7f10eba95b80 1 -- 172.21.15.96:0/1297679176 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c837ca23a0 con 0x55c837d8e640 2023-05-08T03:42:05.682 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.668+0000 7f10c0ff9700 1 -- 172.21.15.96:0/1297679176 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f10d40ca7c0 con 0x55c837d8e640 2023-05-08T03:42:05.683 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.668+0000 7f10eba95b80 10 client.15207 fetch_fsmap learned FSMap version 22 2023-05-08T03:42:05.683 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.668+0000 7f10eba95b80 1 -- 172.21.15.96:0/1297679176 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x55c837b0dd90 con 0x55c837d8e640 2023-05-08T03:42:05.683 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.668+0000 7f10c0ff9700 1 -- 172.21.15.96:0/1297679176 <== mon.0 v2:172.21.15.96:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55c837ca23a0 con 0x55c837d8e640 2023-05-08T03:42:05.683 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.668+0000 7f10c0ff9700 1 -- 172.21.15.96:0/1297679176 <== mon.0 v2:172.21.15.96:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f10d400f700 con 0x55c837d8e640 2023-05-08T03:42:05.683 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.668+0000 7f10eba95b80 10 client.15207 fetch_fsmap finished waiting for FSMap version 22 2023-05-08T03:42:05.683 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.668+0000 7f10eba95b80 10 client.15207 resolve_mds: resolved name 'c' to daemon mds.c 2023-05-08T03:42:05.683 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.668+0000 7f10eba95b80 20 client.15207 populate_metadata read hostname 'smithi096' 2023-05-08T03:42:05.683 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.668+0000 7f10eba95b80 1 --2- 172.21.15.96:0/1297679176 >> [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] conn(0x55c837da31e0 0x55c837da23e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:05.684 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.668+0000 7f10eba95b80 4 client.15207 mds_command: new command op to 24472 tid=0[{"prefix": "get_command_descriptions"}] 2023-05-08T03:42:05.684 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.668+0000 7f10eba95b80 1 -- 172.21.15.96:0/1297679176 --> [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c837cae610 con 0x55c837da31e0 2023-05-08T03:42:05.684 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.668+0000 7f10dcea5700 1 --2- 172.21.15.96:0/1297679176 >> [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] conn(0x55c837da31e0 0x55c837da23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:05.684 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.669+0000 7f10c0ff9700 10 client.15207 ms_handle_connect on v2:172.21.15.186:6836/1556405826 2023-05-08T03:42:05.684 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.669+0000 7f10dcea5700 1 --2- 172.21.15.96:0/1297679176 >> [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] conn(0x55c837da31e0 0x55c837da23e0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c6e038ea39f38e20 server_cookie=60300046de05d2c9 in_seq=0 out_seq=0 2023-05-08T03:42:05.684 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.670+0000 7f10c0ff9700 1 -- 172.21.15.96:0/1297679176 <== mds.2 v2:172.21.15.186:6836/1556405826 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55c837cae610 con 0x55c837da31e0 2023-05-08T03:42:05.684 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.670+0000 7f10c0ff9700 10 client.15207 handle_command_reply: tid=0 2023-05-08T03:42:05.684 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.670+0000 7f10eba95b80 1 client.15207 shutdown 2023-05-08T03:42:05.685 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.670+0000 7f10eba95b80 1 -- 172.21.15.96:0/1297679176 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55c837d8e640 msgr2=0x55c837d97d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:05.685 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.670+0000 7f10eba95b80 1 --2- 172.21.15.96:0/1297679176 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55c837d8e640 0x55c837d97d40 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f10d4096270 tx=0x7f10d40ca3b0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.685 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.670+0000 7f10eba95b80 1 -- 172.21.15.96:0/1297679176 shutdown_connections 2023-05-08T03:42:05.685 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.670+0000 7f10eba95b80 1 --2- 172.21.15.96:0/1297679176 >> [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] conn(0x55c837da31e0 0x55c837da23e0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.685 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.670+0000 7f10eba95b80 1 --2- 172.21.15.96:0/1297679176 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c837d8fc90 0x55c837d9f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.685 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.670+0000 7f10eba95b80 1 --2- 172.21.15.96:0/1297679176 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55c837d8e640 0x55c837d97d40 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.685 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.670+0000 7f10c0ff9700 0 client.15207 ms_handle_reset on v2:172.21.15.186:6836/1556405826 2023-05-08T03:42:05.685 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.670+0000 7f10eba95b80 1 --2- 172.21.15.96:0/1297679176 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c837d8f340 0x55c837d98280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.686 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.670+0000 7f10eba95b80 1 -- 172.21.15.96:0/1297679176 >> 172.21.15.96:0/1297679176 conn(0x55c837d8a3e0 msgr2=0x55c837d87f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:42:05.686 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.670+0000 7f10eba95b80 1 -- 172.21.15.96:0/1297679176 shutdown_connections 2023-05-08T03:42:05.686 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.670+0000 7f10eba95b80 1 -- 172.21.15.96:0/1297679176 wait complete. 2023-05-08T03:42:05.686 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.670+0000 7f10eba95b80 20 client.15207 trim_cache size 0 max 16384 2023-05-08T03:42:05.690 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.687+0000 7f10eba95b80 1 Processor -- start 2023-05-08T03:42:05.690 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.687+0000 7f10eba95b80 1 -- start start 2023-05-08T03:42:05.690 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.687+0000 7f10eba95b80 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55c837d8e640 0x55c837dab920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:05.691 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.687+0000 7f10eba95b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c837d8f340 0x55c837d9f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:05.691 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.687+0000 7f10eba95b80 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c837d8fc90 0x55c837d95ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:05.691 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.687+0000 7f10eba95b80 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c837da4540 con 0x55c837d8e640 2023-05-08T03:42:05.691 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.687+0000 7f10eba95b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c837cae640 con 0x55c837d8f340 2023-05-08T03:42:05.691 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.687+0000 7f10eba95b80 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c837c89730 con 0x55c837d8fc90 2023-05-08T03:42:05.691 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.688+0000 7f10dd6a6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55c837d8e640 0x55c837dab920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:05.692 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.688+0000 7f10dd6a6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55c837d8e640 0x55c837dab920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41634/0 (socket says 172.21.15.96:41634) 2023-05-08T03:42:05.692 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.688+0000 7f10dd6a6700 1 -- 172.21.15.96:0/3110021689 learned_addr learned my addr 172.21.15.96:0/3110021689 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:42:05.692 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.688+0000 7f10dcea5700 1 --2- 172.21.15.96:0/3110021689 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c837d8f340 0x55c837d9f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:05.695 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.688+0000 7f10dd6a6700 1 -- 172.21.15.96:0/3110021689 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c837d8fc90 msgr2=0x55c837d95ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-08T03:42:05.696 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.688+0000 7f10dd6a6700 1 --2- 172.21.15.96:0/3110021689 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c837d8fc90 0x55c837d95ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.696 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.688+0000 7f10dd6a6700 1 -- 172.21.15.96:0/3110021689 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c837d8f340 msgr2=0x55c837d9f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-08T03:42:05.696 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.688+0000 7f10dd6a6700 1 --2- 172.21.15.96:0/3110021689 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c837d8f340 0x55c837d9f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.696 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.688+0000 7f10dd6a6700 1 -- 172.21.15.96:0/3110021689 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c837ca6140 con 0x55c837d8e640 2023-05-08T03:42:05.696 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.688+0000 7f10dd6a6700 1 --2- 172.21.15.96:0/3110021689 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55c837d8e640 0x55c837dab920 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f10d4099d50 tx=0x7f10d4099a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbf5d69721e25c49 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:42:05.696 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.688+0000 7f10c3fff700 1 -- 172.21.15.96:0/3110021689 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d4004870 con 0x55c837d8e640 2023-05-08T03:42:05.696 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.688+0000 7f10c3fff700 1 -- 172.21.15.96:0/3110021689 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f10d40c8e90 con 0x55c837d8e640 2023-05-08T03:42:05.697 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.688+0000 7f10c3fff700 1 -- 172.21.15.96:0/3110021689 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d409a020 con 0x55c837d8e640 2023-05-08T03:42:05.697 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.689+0000 7f10eba95b80 1 -- 172.21.15.96:0/3110021689 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55c837d8e640 msgr2=0x55c837dab920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:05.697 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.689+0000 7f10eba95b80 1 --2- 172.21.15.96:0/3110021689 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55c837d8e640 0x55c837dab920 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f10d4099d50 tx=0x7f10d4099a30 comp rx=0 tx=0).stop 2023-05-08T03:42:05.697 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.689+0000 7f10eba95b80 1 -- 172.21.15.96:0/3110021689 shutdown_connections 2023-05-08T03:42:05.697 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.689+0000 7f10eba95b80 1 --2- 172.21.15.96:0/3110021689 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c837d8fc90 0x55c837d95ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.697 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.689+0000 7f10eba95b80 1 --2- 172.21.15.96:0/3110021689 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55c837d8e640 0x55c837dab920 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.697 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.689+0000 7f10eba95b80 1 --2- 172.21.15.96:0/3110021689 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c837d8f340 0x55c837d9f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.698 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.689+0000 7f10eba95b80 1 -- 172.21.15.96:0/3110021689 >> 172.21.15.96:0/3110021689 conn(0x55c837d8a3e0 msgr2=0x55c837d851c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:42:05.698 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.689+0000 7f10eba95b80 1 -- 172.21.15.96:0/3110021689 shutdown_connections 2023-05-08T03:42:05.698 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.689+0000 7f10eba95b80 1 -- 172.21.15.96:0/3110021689 wait complete. 2023-05-08T03:42:05.698 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.689+0000 7f10eba95b80 1 -- start start 2023-05-08T03:42:05.698 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.689+0000 7f10eba95b80 1 Processor -- start 2023-05-08T03:42:05.698 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.689+0000 7f10eba95b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c837d8e640 0x55c837d9c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:05.699 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.689+0000 7f10eba95b80 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c837d8f340 0x55c837d9c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:05.699 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.689+0000 7f10eba95b80 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55c837d8fc90 0x55c837df6a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:05.699 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.689+0000 7f10eba95b80 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c837d9f650 con 0x55c837d8fc90 2023-05-08T03:42:05.699 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.689+0000 7f10eba95b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c837d9f7c0 con 0x55c837d8e640 2023-05-08T03:42:05.699 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.689+0000 7f10eba95b80 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c837d9f980 con 0x55c837d8f340 2023-05-08T03:42:05.699 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.689+0000 7f10eba95b80 10 client.0 _ll_register_callbacks cb 0x55c837c854d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-08T03:42:05.700 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.690+0000 7f10ddea7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55c837d8fc90 0x55c837df6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:05.700 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.690+0000 7f10ddea7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55c837d8fc90 0x55c837df6a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41644/0 (socket says 172.21.15.96:41644) 2023-05-08T03:42:05.700 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.690+0000 7f10ddea7700 1 -- 172.21.15.96:0/704299771 learned_addr learned my addr 172.21.15.96:0/704299771 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:42:05.700 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.690+0000 7f10dd6a6700 1 --2- 172.21.15.96:0/704299771 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c837d8e640 0x55c837d9c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:05.700 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.690+0000 7f10dcea5700 1 --2- 172.21.15.96:0/704299771 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c837d8f340 0x55c837d9c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:05.700 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.690+0000 7f10ddea7700 1 -- 172.21.15.96:0/704299771 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c837d8f340 msgr2=0x55c837d9c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-08T03:42:05.700 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.690+0000 7f10ddea7700 1 --2- 172.21.15.96:0/704299771 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c837d8f340 0x55c837d9c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.701 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.690+0000 7f10ddea7700 1 -- 172.21.15.96:0/704299771 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c837d8e640 msgr2=0x55c837d9c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-08T03:42:05.701 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.690+0000 7f10ddea7700 1 --2- 172.21.15.96:0/704299771 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c837d8e640 0x55c837d9c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.701 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.690+0000 7f10ddea7700 1 -- 172.21.15.96:0/704299771 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c837b0dd90 con 0x55c837d8fc90 2023-05-08T03:42:05.701 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.690+0000 7f10ddea7700 1 --2- 172.21.15.96:0/704299771 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55c837d8fc90 0x55c837df6a50 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f10d00076b0 tx=0x7f10d00079c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=895dfbb94cfcc6ec server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:42:05.701 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.690+0000 7f10c0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.96:3300/0 2023-05-08T03:42:05.701 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.690+0000 7f10c0ff9700 1 -- 172.21.15.96:0/704299771 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d0003c10 con 0x55c837d8fc90 2023-05-08T03:42:05.701 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.690+0000 7f10c0ff9700 1 -- 172.21.15.96:0/704299771 <== mon.0 v2:172.21.15.96:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f10d0003d70 con 0x55c837d8fc90 2023-05-08T03:42:05.701 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.690+0000 7f10eba95b80 1 -- 172.21.15.96:0/704299771 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c837d5db70 con 0x55c837d8fc90 2023-05-08T03:42:05.702 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.690+0000 7f10c0ff9700 1 -- 172.21.15.96:0/704299771 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f10d0004050 con 0x55c837d8fc90 2023-05-08T03:42:05.702 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.690+0000 7f10eba95b80 10 client.15213 fetch_fsmap learned FSMap version 22 2023-05-08T03:42:05.702 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.690+0000 7f10eba95b80 1 -- 172.21.15.96:0/704299771 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x55c837b34200 con 0x55c837d8fc90 2023-05-08T03:42:05.702 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.691+0000 7f10c0ff9700 1 -- 172.21.15.96:0/704299771 <== mon.0 v2:172.21.15.96:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f10d0024020 con 0x55c837d8fc90 2023-05-08T03:42:05.702 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.691+0000 7f10c0ff9700 1 -- 172.21.15.96:0/704299771 <== mon.0 v2:172.21.15.96:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f10d0014070 con 0x55c837d8fc90 2023-05-08T03:42:05.702 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.691+0000 7f10eba95b80 10 client.15213 fetch_fsmap finished waiting for FSMap version 22 2023-05-08T03:42:05.702 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.691+0000 7f10eba95b80 10 client.15213 resolve_mds: resolved name 'c' to daemon mds.c 2023-05-08T03:42:05.702 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.691+0000 7f10eba95b80 20 client.15213 populate_metadata read hostname 'smithi096' 2023-05-08T03:42:05.703 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.691+0000 7f10eba95b80 1 --2- 172.21.15.96:0/704299771 >> [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] conn(0x55c837dfbc70 0x55c837df8640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:05.703 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.691+0000 7f10eba95b80 4 client.15213 mds_command: new command op to 24472 tid=0[{"prefix": "status"}] 2023-05-08T03:42:05.703 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.691+0000 7f10eba95b80 1 -- 172.21.15.96:0/704299771 --> [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c837b63f10 con 0x55c837dfbc70 2023-05-08T03:42:05.703 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.691+0000 7f10dd6a6700 1 --2- 172.21.15.96:0/704299771 >> [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] conn(0x55c837dfbc70 0x55c837df8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:05.703 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.691+0000 7f10c0ff9700 10 client.15213 ms_handle_connect on v2:172.21.15.186:6836/1556405826 2023-05-08T03:42:05.703 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.691+0000 7f10dd6a6700 1 --2- 172.21.15.96:0/704299771 >> [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] conn(0x55c837dfbc70 0x55c837df8640 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=58296675ab676124 server_cookie=25be509b4c4347d1 in_seq=0 out_seq=0 2023-05-08T03:42:05.703 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.692+0000 7f10c0ff9700 1 -- 172.21.15.96:0/704299771 <== mds.2 v2:172.21.15.186:6836/1556405826 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55c837b63f10 con 0x55c837dfbc70 2023-05-08T03:42:05.704 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.692+0000 7f10c0ff9700 10 client.15213 handle_command_reply: tid=0 2023-05-08T03:42:05.704 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.692+0000 7f10eba95b80 1 client.15213 shutdown 2023-05-08T03:42:05.704 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.692+0000 7f10eba95b80 1 -- 172.21.15.96:0/704299771 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55c837d8fc90 msgr2=0x55c837df6a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:05.704 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.692+0000 7f10eba95b80 1 --2- 172.21.15.96:0/704299771 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55c837d8fc90 0x55c837df6a50 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f10d00076b0 tx=0x7f10d00079c0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.704 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.692+0000 7f10eba95b80 1 -- 172.21.15.96:0/704299771 shutdown_connections 2023-05-08T03:42:05.704 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.692+0000 7f10eba95b80 1 --2- 172.21.15.96:0/704299771 >> [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] conn(0x55c837dfbc70 0x55c837df8640 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.704 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.692+0000 7f10eba95b80 1 --2- 172.21.15.96:0/704299771 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55c837d8fc90 0x55c837df6a50 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.704 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.692+0000 7f10c0ff9700 0 client.15213 ms_handle_reset on v2:172.21.15.186:6836/1556405826 2023-05-08T03:42:05.705 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.692+0000 7f10eba95b80 1 --2- 172.21.15.96:0/704299771 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c837d8e640 0x55c837d9c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.705 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.692+0000 7f10eba95b80 1 --2- 172.21.15.96:0/704299771 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c837d8f340 0x55c837d9c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.705 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.692+0000 7f10eba95b80 1 -- 172.21.15.96:0/704299771 >> 172.21.15.96:0/704299771 conn(0x55c837d8a3e0 msgr2=0x55c837dab920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:42:05.705 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.692+0000 7f10eba95b80 1 -- 172.21.15.96:0/704299771 shutdown_connections 2023-05-08T03:42:05.705 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.692+0000 7f10eba95b80 1 -- 172.21.15.96:0/704299771 wait complete. 2023-05-08T03:42:05.705 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.692+0000 7f10eba95b80 20 client.15213 trim_cache size 0 max 16384 2023-05-08T03:42:05.706 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2023-05-08T03:42:05.706 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_fsid": "f7ffcfb0-ed50-11ed-9b01-001a4aab830c", 2023-05-08T03:42:05.706 INFO:teuthology.orchestra.run.smithi096.stdout: "whoami": 2, 2023-05-08T03:42:05.706 INFO:teuthology.orchestra.run.smithi096.stdout: "id": 24472, 2023-05-08T03:42:05.706 INFO:teuthology.orchestra.run.smithi096.stdout: "want_state": "up:active", 2023-05-08T03:42:05.707 INFO:teuthology.orchestra.run.smithi096.stdout: "state": "up:active", 2023-05-08T03:42:05.707 INFO:teuthology.orchestra.run.smithi096.stdout: "fs_name": "cephfs", 2023-05-08T03:42:05.707 INFO:teuthology.orchestra.run.smithi096.stdout: "rank_uptime": 72.343783146999996, 2023-05-08T03:42:05.707 INFO:teuthology.orchestra.run.smithi096.stdout: "mdsmap_epoch": 22, 2023-05-08T03:42:05.707 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap_epoch": 84, 2023-05-08T03:42:05.707 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap_epoch_barrier": 82, 2023-05-08T03:42:05.707 INFO:teuthology.orchestra.run.smithi096.stdout: "uptime": 92.315646470999994 2023-05-08T03:42:05.707 INFO:teuthology.orchestra.run.smithi096.stdout:} 2023-05-08T03:42:05.709 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.693+0000 7f10df90a700 1 -- 172.21.15.96:0/3419588604 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f10c40a1260 msgr2=0x7f10c40a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:05.709 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.693+0000 7f10df90a700 1 --2- 172.21.15.96:0/3419588604 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f10c40a1260 0x7f10c40a3710 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f10c8006010 tx=0x7f10c800b540 comp rx=0 tx=0).stop 2023-05-08T03:42:05.709 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.693+0000 7f10df90a700 1 -- 172.21.15.96:0/3419588604 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10d80ff220 msgr2=0x7f10d8196010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:05.709 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.693+0000 7f10df90a700 1 --2- 172.21.15.96:0/3419588604 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10d80ff220 0x7f10d8196010 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f10d400c990 tx=0x7f10d400cd50 comp rx=0 tx=0).stop 2023-05-08T03:42:05.709 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.693+0000 7f10df90a700 1 -- 172.21.15.96:0/3419588604 shutdown_connections 2023-05-08T03:42:05.709 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.693+0000 7f10df90a700 1 --2- 172.21.15.96:0/3419588604 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f10c40a1260 0x7f10c40a3710 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.710 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.693+0000 7f10df90a700 1 --2- 172.21.15.96:0/3419588604 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10d8100da0 0x7f10d819d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.710 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.693+0000 7f10df90a700 1 --2- 172.21.15.96:0/3419588604 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10d80ff220 0x7f10d8196010 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.710 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.693+0000 7f10df90a700 1 --2- 172.21.15.96:0/3419588604 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f10d8100410 0x7f10d8196550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.710 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.693+0000 7f10df90a700 1 -- 172.21.15.96:0/3419588604 >> 172.21.15.96:0/3419588604 conn(0x7f10d80fa840 msgr2=0x7f10d8069080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:42:05.710 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.693+0000 7f10df90a700 1 -- 172.21.15.96:0/3419588604 shutdown_connections 2023-05-08T03:42:05.710 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.693+0000 7f10df90a700 1 -- 172.21.15.96:0/3419588604 wait complete. 2023-05-08T03:42:05.711 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2023-05-08T03:42:05.840 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.835+0000 7fbd8a8a9700 1 -- 172.21.15.96:0/1359464820 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd84100dd0 msgr2=0x7fbd84107690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:05.840 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.835+0000 7fbd8a8a9700 1 --2- 172.21.15.96:0/1359464820 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd84100dd0 0x7fbd84107690 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c00b0a0 tx=0x7fbd7c00b3b0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.840 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.835+0000 7fbd8a8a9700 1 -- 172.21.15.96:0/1359464820 shutdown_connections 2023-05-08T03:42:05.840 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.835+0000 7fbd8a8a9700 1 --2- 172.21.15.96:0/1359464820 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd84100dd0 0x7fbd84107690 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.840 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.835+0000 7fbd8a8a9700 1 --2- 172.21.15.96:0/1359464820 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbd840ff250 0x7fbd840ff660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.841 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.835+0000 7fbd8a8a9700 1 --2- 172.21.15.96:0/1359464820 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd84100440 0x7fbd84100890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.841 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.835+0000 7fbd8a8a9700 1 -- 172.21.15.96:0/1359464820 >> 172.21.15.96:0/1359464820 conn(0x7fbd840fa850 msgr2=0x7fbd840fcca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:42:05.841 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.835+0000 7fbd8a8a9700 1 -- 172.21.15.96:0/1359464820 shutdown_connections 2023-05-08T03:42:05.841 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.835+0000 7fbd8a8a9700 1 -- 172.21.15.96:0/1359464820 wait complete. 2023-05-08T03:42:05.841 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.835+0000 7fbd8a8a9700 1 Processor -- start 2023-05-08T03:42:05.841 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.835+0000 7fbd8a8a9700 1 -- start start 2023-05-08T03:42:05.842 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.836+0000 7fbd8a8a9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd840ff250 0x7fbd84069c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:05.842 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.836+0000 7fbd8a8a9700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbd84100440 0x7fbd8419d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:05.842 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.836+0000 7fbd8a8a9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd84100dd0 0x7fbd8419f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:05.842 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.836+0000 7fbd8a8a9700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd8419fea0 con 0x7fbd84100dd0 2023-05-08T03:42:05.842 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.836+0000 7fbd8a8a9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd841a0010 con 0x7fbd840ff250 2023-05-08T03:42:05.842 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.836+0000 7fbd8a8a9700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd841a01d0 con 0x7fbd84100440 2023-05-08T03:42:05.843 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.836+0000 7fbd88e46700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd84100dd0 0x7fbd8419f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:05.843 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.836+0000 7fbd88e46700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd84100dd0 0x7fbd8419f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41658/0 (socket says 172.21.15.96:41658) 2023-05-08T03:42:05.843 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.836+0000 7fbd88e46700 1 -- 172.21.15.96:0/4106268314 learned_addr learned my addr 172.21.15.96:0/4106268314 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:42:05.843 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.836+0000 7fbd837fe700 1 --2- 172.21.15.96:0/4106268314 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbd84100440 0x7fbd8419d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:05.843 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.836+0000 7fbd83fff700 1 --2- 172.21.15.96:0/4106268314 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd840ff250 0x7fbd84069c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:05.843 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.836+0000 7fbd88e46700 1 -- 172.21.15.96:0/4106268314 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbd84100440 msgr2=0x7fbd8419d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:05.843 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.836+0000 7fbd88e46700 1 --2- 172.21.15.96:0/4106268314 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbd84100440 0x7fbd8419d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.843 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.836+0000 7fbd88e46700 1 -- 172.21.15.96:0/4106268314 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd840ff250 msgr2=0x7fbd84069c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:05.844 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.836+0000 7fbd88e46700 1 --2- 172.21.15.96:0/4106268314 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd840ff250 0x7fbd84069c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.844 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.836+0000 7fbd88e46700 1 -- 172.21.15.96:0/4106268314 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd7c009d00 con 0x7fbd84100dd0 2023-05-08T03:42:05.844 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.836+0000 7fbd837fe700 1 --2- 172.21.15.96:0/4106268314 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbd84100440 0x7fbd8419d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-08T03:42:05.844 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.836+0000 7fbd83fff700 1 --2- 172.21.15.96:0/4106268314 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd840ff250 0x7fbd84069c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-08T03:42:05.844 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.836+0000 7fbd88e46700 1 --2- 172.21.15.96:0/4106268314 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd84100dd0 0x7fbd8419f7f0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c00b780 tx=0x7fbd7c00bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:42:05.844 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.836+0000 7fbd817fa700 1 -- 172.21.15.96:0/4106268314 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd7c00e040 con 0x7fbd84100dd0 2023-05-08T03:42:05.844 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.836+0000 7fbd8a8a9700 1 -- 172.21.15.96:0/4106268314 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd8410abc0 con 0x7fbd84100dd0 2023-05-08T03:42:05.845 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.837+0000 7fbd817fa700 1 -- 172.21.15.96:0/4106268314 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbd7c004e60 con 0x7fbd84100dd0 2023-05-08T03:42:05.845 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.837+0000 7fbd817fa700 1 -- 172.21.15.96:0/4106268314 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd7c01b870 con 0x7fbd84100dd0 2023-05-08T03:42:05.845 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.837+0000 7fbd8a8a9700 1 -- 172.21.15.96:0/4106268314 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd8410aa30 con 0x7fbd84100dd0 2023-05-08T03:42:05.851 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.839+0000 7fbd817fa700 1 -- 172.21.15.96:0/4106268314 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fbd7c01b9d0 con 0x7fbd84100dd0 2023-05-08T03:42:05.851 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.839+0000 7fbd817fa700 1 --2- 172.21.15.96:0/4106268314 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fbd700a11e0 0x7fbd700a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:05.851 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.839+0000 7fbd83fff700 1 --2- 172.21.15.96:0/4106268314 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fbd700a11e0 0x7fbd700a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:05.852 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.839+0000 7fbd817fa700 1 -- 172.21.15.96:0/4106268314 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7fbd7c0ce3a0 con 0x7fbd84100dd0 2023-05-08T03:42:05.852 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.840+0000 7fbd83fff700 1 --2- 172.21.15.96:0/4106268314 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fbd700a11e0 0x7fbd700a3690 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fbd841002a0 tx=0x7fbd6c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:42:05.852 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.840+0000 7fbd96a34b80 1 Processor -- start 2023-05-08T03:42:05.852 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.840+0000 7fbd96a34b80 1 -- start start 2023-05-08T03:42:05.852 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.840+0000 7fbd96a34b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e5a7356340 0x55e5a7356750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:05.852 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.840+0000 7fbd96a34b80 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55e5a7356c90 0x55e5a73550b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:05.852 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.840+0000 7fbd96a34b80 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e5a7355640 0x55e5a7355ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:05.853 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.840+0000 7fbd96a34b80 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5a725b020 con 0x55e5a7356c90 2023-05-08T03:42:05.853 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.840+0000 7fbd96a34b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5a72ad960 con 0x55e5a7356340 2023-05-08T03:42:05.853 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.840+0000 7fbd96a34b80 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5a72a6df0 con 0x55e5a7355640 2023-05-08T03:42:05.853 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.840+0000 7fbd837fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55e5a7356c90 0x55e5a73550b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:05.853 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.840+0000 7fbd837fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55e5a7356c90 0x55e5a73550b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41664/0 (socket says 172.21.15.96:41664) 2023-05-08T03:42:05.853 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.840+0000 7fbd837fe700 1 -- 172.21.15.96:0/3779245534 learned_addr learned my addr 172.21.15.96:0/3779245534 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:42:05.853 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.840+0000 7fbd83fff700 1 --2- 172.21.15.96:0/3779245534 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e5a7356340 0x55e5a7356750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:05.854 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.840+0000 7fbd88e46700 1 --2- 172.21.15.96:0/3779245534 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e5a7355640 0x55e5a7355ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:05.854 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.840+0000 7fbd837fe700 1 -- 172.21.15.96:0/3779245534 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e5a7355640 msgr2=0x55e5a7355ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-08T03:42:05.854 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.840+0000 7fbd837fe700 1 --2- 172.21.15.96:0/3779245534 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e5a7355640 0x55e5a7355ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.854 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.840+0000 7fbd837fe700 1 -- 172.21.15.96:0/3779245534 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e5a7356340 msgr2=0x55e5a7356750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-08T03:42:05.854 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.840+0000 7fbd837fe700 1 --2- 172.21.15.96:0/3779245534 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e5a7356340 0x55e5a7356750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.854 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.840+0000 7fbd837fe700 1 -- 172.21.15.96:0/3779245534 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e5a71285e0 con 0x55e5a7356c90 2023-05-08T03:42:05.855 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.840+0000 7fbd88e46700 1 --2- 172.21.15.96:0/3779245534 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e5a7355640 0x55e5a7355ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-08T03:42:05.855 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.840+0000 7fbd83fff700 1 --2- 172.21.15.96:0/3779245534 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e5a7356340 0x55e5a7356750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-08T03:42:05.855 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.841+0000 7fbd837fe700 1 --2- 172.21.15.96:0/3779245534 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55e5a7356c90 0x55e5a73550b0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fbd74009cd0 tx=0x7fbd7400e2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4c3ae2142aef554 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:42:05.855 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.841+0000 7fbd7a7fc700 1 -- 172.21.15.96:0/3779245534 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd7400ec20 con 0x55e5a7356c90 2023-05-08T03:42:05.855 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.841+0000 7fbd7a7fc700 1 -- 172.21.15.96:0/3779245534 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbd7400ed80 con 0x55e5a7356c90 2023-05-08T03:42:05.855 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.841+0000 7fbd7a7fc700 1 -- 172.21.15.96:0/3779245534 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd74011470 con 0x55e5a7356c90 2023-05-08T03:42:05.855 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.841+0000 7fbd96a34b80 1 -- 172.21.15.96:0/3779245534 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55e5a7356c90 msgr2=0x55e5a73550b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:05.856 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.841+0000 7fbd96a34b80 1 --2- 172.21.15.96:0/3779245534 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55e5a7356c90 0x55e5a73550b0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fbd74009cd0 tx=0x7fbd7400e2f0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.856 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.841+0000 7fbd96a34b80 1 -- 172.21.15.96:0/3779245534 shutdown_connections 2023-05-08T03:42:05.856 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.841+0000 7fbd96a34b80 1 --2- 172.21.15.96:0/3779245534 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e5a7355640 0x55e5a7355ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.856 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.841+0000 7fbd96a34b80 1 --2- 172.21.15.96:0/3779245534 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e5a7356340 0x55e5a7356750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.856 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.841+0000 7fbd96a34b80 1 --2- 172.21.15.96:0/3779245534 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55e5a7356c90 0x55e5a73550b0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.856 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.841+0000 7fbd96a34b80 1 -- 172.21.15.96:0/3779245534 >> 172.21.15.96:0/3779245534 conn(0x55e5a73513e0 msgr2=0x55e5a734f7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:42:05.856 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.841+0000 7fbd96a34b80 1 -- 172.21.15.96:0/3779245534 shutdown_connections 2023-05-08T03:42:05.857 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.842+0000 7fbd96a34b80 1 -- 172.21.15.96:0/3779245534 wait complete. 2023-05-08T03:42:05.857 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.842+0000 7fbd96a34b80 1 -- start start 2023-05-08T03:42:05.857 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.842+0000 7fbd96a34b80 1 Processor -- start 2023-05-08T03:42:05.857 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.842+0000 7fbd96a34b80 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e5a7355640 0x55e5a735ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:05.857 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.842+0000 7fbd96a34b80 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55e5a7356340 0x55e5a735f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:05.857 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.842+0000 7fbd96a34b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e5a7356c90 0x55e5a73661a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:05.857 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.842+0000 7fbd96a34b80 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5a712a8d0 con 0x55e5a7356340 2023-05-08T03:42:05.857 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.842+0000 7fbd96a34b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5a73666e0 con 0x55e5a7356c90 2023-05-08T03:42:05.858 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.842+0000 7fbd96a34b80 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5a7366870 con 0x55e5a7355640 2023-05-08T03:42:05.858 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.842+0000 7fbd96a34b80 10 client.0 _ll_register_callbacks cb 0x55e5a724c4d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-08T03:42:05.858 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.842+0000 7fbd837fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55e5a7356340 0x55e5a735f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:05.858 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.842+0000 7fbd837fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55e5a7356340 0x55e5a735f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41670/0 (socket says 172.21.15.96:41670) 2023-05-08T03:42:05.858 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.842+0000 7fbd837fe700 1 -- 172.21.15.96:0/2373816481 learned_addr learned my addr 172.21.15.96:0/2373816481 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:42:05.858 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.843+0000 7fbd88e46700 1 --2- 172.21.15.96:0/2373816481 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e5a7356c90 0x55e5a73661a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:05.858 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.843+0000 7fbd83fff700 1 --2- 172.21.15.96:0/2373816481 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e5a7355640 0x55e5a735ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:05.859 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.843+0000 7fbd837fe700 1 -- 172.21.15.96:0/2373816481 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e5a7355640 msgr2=0x55e5a735ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-08T03:42:05.859 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.843+0000 7fbd837fe700 1 --2- 172.21.15.96:0/2373816481 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e5a7355640 0x55e5a735ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.859 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.843+0000 7fbd837fe700 1 -- 172.21.15.96:0/2373816481 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e5a7356c90 msgr2=0x55e5a73661a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-08T03:42:05.859 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.843+0000 7fbd837fe700 1 --2- 172.21.15.96:0/2373816481 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e5a7356c90 0x55e5a73661a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.859 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.843+0000 7fbd837fe700 1 -- 172.21.15.96:0/2373816481 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd74009900 con 0x55e5a7356340 2023-05-08T03:42:05.859 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.843+0000 7fbd88e46700 1 --2- 172.21.15.96:0/2373816481 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e5a7356c90 0x55e5a73661a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-08T03:42:05.859 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.843+0000 7fbd83fff700 1 --2- 172.21.15.96:0/2373816481 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e5a7355640 0x55e5a735ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-08T03:42:05.860 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.843+0000 7fbd837fe700 1 --2- 172.21.15.96:0/2373816481 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55e5a7356340 0x55e5a735f160 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fbd74000c00 tx=0x7fbd7400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=582ae558efc437c3 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:42:05.860 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.843+0000 7fbd637fe700 10 client.0 ms_handle_connect on v2:172.21.15.96:3300/0 2023-05-08T03:42:05.860 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.843+0000 7fbd637fe700 1 -- 172.21.15.96:0/2373816481 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd74021070 con 0x55e5a7356340 2023-05-08T03:42:05.860 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.843+0000 7fbd96a34b80 1 -- 172.21.15.96:0/2373816481 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e5a72693a0 con 0x55e5a7356340 2023-05-08T03:42:05.860 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.843+0000 7fbd637fe700 1 -- 172.21.15.96:0/2373816481 <== mon.0 v2:172.21.15.96:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7fbd74004960 con 0x55e5a7356340 2023-05-08T03:42:05.860 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.843+0000 7fbd637fe700 1 -- 172.21.15.96:0/2373816481 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbd7400eea0 con 0x55e5a7356340 2023-05-08T03:42:05.860 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.843+0000 7fbd96a34b80 10 client.15225 fetch_fsmap learned FSMap version 22 2023-05-08T03:42:05.861 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.843+0000 7fbd96a34b80 1 -- 172.21.15.96:0/2373816481 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x55e5a70d4d90 con 0x55e5a7356340 2023-05-08T03:42:05.861 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.843+0000 7fbd637fe700 1 -- 172.21.15.96:0/2373816481 <== mon.0 v2:172.21.15.96:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e5a72693a0 con 0x55e5a7356340 2023-05-08T03:42:05.861 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.843+0000 7fbd637fe700 1 -- 172.21.15.96:0/2373816481 <== mon.0 v2:172.21.15.96:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fbd7400c070 con 0x55e5a7356340 2023-05-08T03:42:05.861 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.843+0000 7fbd96a34b80 10 client.15225 fetch_fsmap finished waiting for FSMap version 22 2023-05-08T03:42:05.861 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.844+0000 7fbd96a34b80 10 client.15225 resolve_mds: resolved name 'i' to daemon mds.i 2023-05-08T03:42:05.861 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.844+0000 7fbd96a34b80 20 client.15225 populate_metadata read hostname 'smithi096' 2023-05-08T03:42:05.861 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.844+0000 7fbd96a34b80 1 --2- 172.21.15.96:0/2373816481 >> [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] conn(0x55e5a736a160 0x55e5a7369510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:05.861 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.844+0000 7fbd96a34b80 4 client.15225 mds_command: new command op to 24487 tid=0[{"prefix": "get_command_descriptions"}] 2023-05-08T03:42:05.862 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.844+0000 7fbd96a34b80 1 -- 172.21.15.96:0/2373816481 --> [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e5a7275610 con 0x55e5a736a160 2023-05-08T03:42:05.862 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.844+0000 7fbd83fff700 1 --2- 172.21.15.96:0/2373816481 >> [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] conn(0x55e5a736a160 0x55e5a7369510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:05.862 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.844+0000 7fbd637fe700 10 client.15225 ms_handle_connect on v2:172.21.15.186:6838/1267655485 2023-05-08T03:42:05.862 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.844+0000 7fbd83fff700 1 --2- 172.21.15.96:0/2373816481 >> [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] conn(0x55e5a736a160 0x55e5a7369510 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=25718baeed4d974b server_cookie=d08ccf8ed6ed92bf in_seq=0 out_seq=0 2023-05-08T03:42:05.862 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.845+0000 7fbd637fe700 1 -- 172.21.15.96:0/2373816481 <== mds.1 v2:172.21.15.186:6838/1267655485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55e5a7275610 con 0x55e5a736a160 2023-05-08T03:42:05.862 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.845+0000 7fbd637fe700 10 client.15225 handle_command_reply: tid=0 2023-05-08T03:42:05.862 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.845+0000 7fbd96a34b80 1 client.15225 shutdown 2023-05-08T03:42:05.863 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.845+0000 7fbd96a34b80 1 -- 172.21.15.96:0/2373816481 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55e5a7356340 msgr2=0x55e5a735f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:05.863 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.845+0000 7fbd96a34b80 1 --2- 172.21.15.96:0/2373816481 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55e5a7356340 0x55e5a735f160 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fbd74000c00 tx=0x7fbd7400ed00 comp rx=0 tx=0).stop 2023-05-08T03:42:05.863 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.845+0000 7fbd96a34b80 1 -- 172.21.15.96:0/2373816481 shutdown_connections 2023-05-08T03:42:05.863 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.845+0000 7fbd96a34b80 1 --2- 172.21.15.96:0/2373816481 >> [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] conn(0x55e5a736a160 0x55e5a7369510 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.863 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.845+0000 7fbd96a34b80 1 --2- 172.21.15.96:0/2373816481 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e5a7356c90 0x55e5a73661a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.863 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.845+0000 7fbd637fe700 0 client.15225 ms_handle_reset on v2:172.21.15.186:6838/1267655485 2023-05-08T03:42:05.863 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.845+0000 7fbd96a34b80 1 --2- 172.21.15.96:0/2373816481 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e5a7355640 0x55e5a735ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.863 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.845+0000 7fbd96a34b80 1 --2- 172.21.15.96:0/2373816481 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55e5a7356340 0x55e5a735f160 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.864 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.845+0000 7fbd96a34b80 1 -- 172.21.15.96:0/2373816481 >> 172.21.15.96:0/2373816481 conn(0x55e5a73513e0 msgr2=0x55e5a734ef40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:42:05.864 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.845+0000 7fbd96a34b80 1 -- 172.21.15.96:0/2373816481 shutdown_connections 2023-05-08T03:42:05.864 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.845+0000 7fbd96a34b80 1 -- 172.21.15.96:0/2373816481 wait complete. 2023-05-08T03:42:05.864 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.845+0000 7fbd96a34b80 20 client.15225 trim_cache size 0 max 16384 2023-05-08T03:42:05.865 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.863+0000 7fbd96a34b80 1 Processor -- start 2023-05-08T03:42:05.865 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.863+0000 7fbd96a34b80 1 -- start start 2023-05-08T03:42:05.869 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.863+0000 7fbd96a34b80 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55e5a7355640 0x55e5a73594b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:05.869 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.863+0000 7fbd96a34b80 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e5a7356340 0x55e5a7366160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:05.870 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.863+0000 7fbd96a34b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e5a7356c90 0x55e5a73599f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:05.870 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.863+0000 7fbd96a34b80 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5a7275610 con 0x55e5a7355640 2023-05-08T03:42:05.870 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.863+0000 7fbd96a34b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5a72693a0 con 0x55e5a7356c90 2023-05-08T03:42:05.870 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.863+0000 7fbd96a34b80 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5a735fe10 con 0x55e5a7356340 2023-05-08T03:42:05.870 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.863+0000 7fbd83fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55e5a7355640 0x55e5a73594b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:05.870 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.863+0000 7fbd83fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55e5a7355640 0x55e5a73594b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41676/0 (socket says 172.21.15.96:41676) 2023-05-08T03:42:05.871 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.863+0000 7fbd83fff700 1 -- 172.21.15.96:0/862927124 learned_addr learned my addr 172.21.15.96:0/862927124 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:42:05.871 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.863+0000 7fbd837fe700 1 --2- 172.21.15.96:0/862927124 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e5a7356340 0x55e5a7366160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:05.871 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.863+0000 7fbd83fff700 1 -- 172.21.15.96:0/862927124 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e5a7356340 msgr2=0x55e5a7366160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-08T03:42:05.871 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.863+0000 7fbd83fff700 1 --2- 172.21.15.96:0/862927124 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e5a7356340 0x55e5a7366160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.871 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.863+0000 7fbd83fff700 1 -- 172.21.15.96:0/862927124 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e5a7356c90 msgr2=0x55e5a73599f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-08T03:42:05.872 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.863+0000 7fbd83fff700 1 --2- 172.21.15.96:0/862927124 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e5a7356c90 0x55e5a73599f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.872 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.863+0000 7fbd83fff700 1 -- 172.21.15.96:0/862927124 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e5a726d140 con 0x55e5a7355640 2023-05-08T03:42:05.872 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.863+0000 7fbd83fff700 1 --2- 172.21.15.96:0/862927124 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55e5a7355640 0x55e5a73594b0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x55e5a72507c0 tx=0x7fbd6c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d26d128424044e7d server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:42:05.872 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.864+0000 7fbd7affd700 1 -- 172.21.15.96:0/862927124 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd6c026040 con 0x55e5a7355640 2023-05-08T03:42:05.872 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.864+0000 7fbd7affd700 1 -- 172.21.15.96:0/862927124 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbd6c0295f0 con 0x55e5a7355640 2023-05-08T03:42:05.872 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.864+0000 7fbd7affd700 1 -- 172.21.15.96:0/862927124 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd6c0124d0 con 0x55e5a7355640 2023-05-08T03:42:05.872 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.864+0000 7fbd96a34b80 1 -- 172.21.15.96:0/862927124 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55e5a7355640 msgr2=0x55e5a73594b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:05.873 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.864+0000 7fbd96a34b80 1 --2- 172.21.15.96:0/862927124 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55e5a7355640 0x55e5a73594b0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x55e5a72507c0 tx=0x7fbd6c009f90 comp rx=0 tx=0).stop 2023-05-08T03:42:05.873 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.864+0000 7fbd96a34b80 1 -- 172.21.15.96:0/862927124 shutdown_connections 2023-05-08T03:42:05.873 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.864+0000 7fbd96a34b80 1 --2- 172.21.15.96:0/862927124 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e5a7356c90 0x55e5a73599f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.873 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.864+0000 7fbd96a34b80 1 --2- 172.21.15.96:0/862927124 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55e5a7355640 0x55e5a73594b0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.873 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.864+0000 7fbd96a34b80 1 --2- 172.21.15.96:0/862927124 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e5a7356340 0x55e5a7366160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.873 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.864+0000 7fbd96a34b80 1 -- 172.21.15.96:0/862927124 >> 172.21.15.96:0/862927124 conn(0x55e5a73513e0 msgr2=0x55e5a735c980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:42:05.874 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.864+0000 7fbd96a34b80 1 -- 172.21.15.96:0/862927124 shutdown_connections 2023-05-08T03:42:05.874 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.864+0000 7fbd96a34b80 1 -- 172.21.15.96:0/862927124 wait complete. 2023-05-08T03:42:05.874 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.864+0000 7fbd96a34b80 1 -- start start 2023-05-08T03:42:05.874 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.865+0000 7fbd96a34b80 1 Processor -- start 2023-05-08T03:42:05.874 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.865+0000 7fbd96a34b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e5a7355640 0x55e5a7361b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:05.875 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.865+0000 7fbd96a34b80 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55e5a7356340 0x55e5a7362040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:05.875 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.865+0000 7fbd96a34b80 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e5a7356c90 0x55e5a7365060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:05.875 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.865+0000 7fbd96a34b80 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5a73655a0 con 0x55e5a7356340 2023-05-08T03:42:05.875 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.865+0000 7fbd96a34b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5a7365710 con 0x55e5a7355640 2023-05-08T03:42:05.875 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.865+0000 7fbd96a34b80 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5a73658d0 con 0x55e5a7356c90 2023-05-08T03:42:05.875 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.865+0000 7fbd96a34b80 10 client.0 _ll_register_callbacks cb 0x55e5a724c4d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-08T03:42:05.875 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.865+0000 7fbd837fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55e5a7356340 0x55e5a7362040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:05.876 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.865+0000 7fbd837fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55e5a7356340 0x55e5a7362040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41684/0 (socket says 172.21.15.96:41684) 2023-05-08T03:42:05.876 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.865+0000 7fbd837fe700 1 -- 172.21.15.96:0/4257126241 learned_addr learned my addr 172.21.15.96:0/4257126241 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:42:05.876 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.865+0000 7fbd83fff700 1 --2- 172.21.15.96:0/4257126241 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e5a7355640 0x55e5a7361b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:05.876 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.865+0000 7fbd88e46700 1 --2- 172.21.15.96:0/4257126241 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e5a7356c90 0x55e5a7365060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:05.876 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.865+0000 7fbd837fe700 1 -- 172.21.15.96:0/4257126241 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e5a7356c90 msgr2=0x55e5a7365060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-08T03:42:05.876 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.865+0000 7fbd837fe700 1 --2- 172.21.15.96:0/4257126241 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e5a7356c90 0x55e5a7365060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.876 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.865+0000 7fbd837fe700 1 -- 172.21.15.96:0/4257126241 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e5a7355640 msgr2=0x55e5a7361b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-08T03:42:05.877 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.865+0000 7fbd837fe700 1 --2- 172.21.15.96:0/4257126241 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e5a7355640 0x55e5a7361b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.877 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.865+0000 7fbd837fe700 1 -- 172.21.15.96:0/4257126241 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd6c010b90 con 0x55e5a7356340 2023-05-08T03:42:05.877 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.865+0000 7fbd83fff700 1 --2- 172.21.15.96:0/4257126241 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e5a7355640 0x55e5a7361b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-08T03:42:05.877 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.866+0000 7fbd837fe700 1 --2- 172.21.15.96:0/4257126241 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55e5a7356340 0x55e5a7362040 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fbd74009620 tx=0x7fbd74009c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d042c7f2dfa28b5b server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:42:05.877 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.866+0000 7fbd637fe700 10 client.0 ms_handle_connect on v2:172.21.15.96:3300/0 2023-05-08T03:42:05.877 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.866+0000 7fbd637fe700 1 -- 172.21.15.96:0/4257126241 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd74021070 con 0x55e5a7356340 2023-05-08T03:42:05.877 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.866+0000 7fbd637fe700 1 -- 172.21.15.96:0/4257126241 <== mon.0 v2:172.21.15.96:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7fbd74000e40 con 0x55e5a7356340 2023-05-08T03:42:05.878 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.866+0000 7fbd96a34b80 1 -- 172.21.15.96:0/4257126241 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e5a7324b70 con 0x55e5a7356340 2023-05-08T03:42:05.878 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.866+0000 7fbd637fe700 1 -- 172.21.15.96:0/4257126241 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbd74004b60 con 0x55e5a7356340 2023-05-08T03:42:05.878 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.866+0000 7fbd96a34b80 10 client.15231 fetch_fsmap learned FSMap version 22 2023-05-08T03:42:05.878 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.866+0000 7fbd96a34b80 1 -- 172.21.15.96:0/4257126241 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x55e5a70fb200 con 0x55e5a7356340 2023-05-08T03:42:05.878 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.866+0000 7fbd637fe700 1 -- 172.21.15.96:0/4257126241 <== mon.0 v2:172.21.15.96:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbd7403f020 con 0x55e5a7356340 2023-05-08T03:42:05.878 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.866+0000 7fbd637fe700 1 -- 172.21.15.96:0/4257126241 <== mon.0 v2:172.21.15.96:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fbd7400e410 con 0x55e5a7356340 2023-05-08T03:42:05.878 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.866+0000 7fbd96a34b80 10 client.15231 fetch_fsmap finished waiting for FSMap version 22 2023-05-08T03:42:05.878 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.866+0000 7fbd96a34b80 10 client.15231 resolve_mds: resolved name 'i' to daemon mds.i 2023-05-08T03:42:05.879 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.866+0000 7fbd96a34b80 20 client.15231 populate_metadata read hostname 'smithi096' 2023-05-08T03:42:05.879 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.866+0000 7fbd96a34b80 1 --2- 172.21.15.96:0/4257126241 >> [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] conn(0x55e5a73c3b30 0x55e5a73c0560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:05.879 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.866+0000 7fbd96a34b80 4 client.15231 mds_command: new command op to 24487 tid=0[{"prefix": "status"}] 2023-05-08T03:42:05.879 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.866+0000 7fbd96a34b80 1 -- 172.21.15.96:0/4257126241 --> [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e5a712af10 con 0x55e5a73c3b30 2023-05-08T03:42:05.879 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.866+0000 7fbd83fff700 1 --2- 172.21.15.96:0/4257126241 >> [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] conn(0x55e5a73c3b30 0x55e5a73c0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:05.879 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.867+0000 7fbd637fe700 10 client.15231 ms_handle_connect on v2:172.21.15.186:6838/1267655485 2023-05-08T03:42:05.879 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.867+0000 7fbd83fff700 1 --2- 172.21.15.96:0/4257126241 >> [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] conn(0x55e5a73c3b30 0x55e5a73c0560 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f3f805d2f0b07461 server_cookie=a334430eeb6e8249 in_seq=0 out_seq=0 2023-05-08T03:42:05.881 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.867+0000 7fbd637fe700 1 -- 172.21.15.96:0/4257126241 <== mds.1 v2:172.21.15.186:6838/1267655485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55e5a712af10 con 0x55e5a73c3b30 2023-05-08T03:42:05.881 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.867+0000 7fbd637fe700 10 client.15231 handle_command_reply: tid=0 2023-05-08T03:42:05.881 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.867+0000 7fbd96a34b80 1 client.15231 shutdown 2023-05-08T03:42:05.881 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.867+0000 7fbd96a34b80 1 -- 172.21.15.96:0/4257126241 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55e5a7356340 msgr2=0x55e5a7362040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:05.881 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.867+0000 7fbd96a34b80 1 --2- 172.21.15.96:0/4257126241 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55e5a7356340 0x55e5a7362040 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fbd74009620 tx=0x7fbd74009c80 comp rx=0 tx=0).stop 2023-05-08T03:42:05.881 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.867+0000 7fbd96a34b80 1 -- 172.21.15.96:0/4257126241 shutdown_connections 2023-05-08T03:42:05.882 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.867+0000 7fbd96a34b80 1 --2- 172.21.15.96:0/4257126241 >> [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] conn(0x55e5a73c3b30 0x55e5a73c0560 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.882 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.867+0000 7fbd96a34b80 1 --2- 172.21.15.96:0/4257126241 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e5a7356c90 0x55e5a7365060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.882 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.867+0000 7fbd96a34b80 1 --2- 172.21.15.96:0/4257126241 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e5a7355640 0x55e5a7361b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.882 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.867+0000 7fbd96a34b80 1 --2- 172.21.15.96:0/4257126241 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55e5a7356340 0x55e5a7362040 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.882 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.867+0000 7fbd637fe700 0 client.15231 ms_handle_reset on v2:172.21.15.186:6838/1267655485 2023-05-08T03:42:05.882 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.867+0000 7fbd96a34b80 1 -- 172.21.15.96:0/4257126241 >> 172.21.15.96:0/4257126241 conn(0x55e5a73513e0 msgr2=0x55e5a735c980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:42:05.882 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.867+0000 7fbd96a34b80 1 -- 172.21.15.96:0/4257126241 shutdown_connections 2023-05-08T03:42:05.883 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.867+0000 7fbd96a34b80 1 -- 172.21.15.96:0/4257126241 wait complete. 2023-05-08T03:42:05.883 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.867+0000 7fbd96a34b80 20 client.15231 trim_cache size 0 max 16384 2023-05-08T03:42:05.883 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2023-05-08T03:42:05.883 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_fsid": "f7ffcfb0-ed50-11ed-9b01-001a4aab830c", 2023-05-08T03:42:05.884 INFO:teuthology.orchestra.run.smithi096.stdout: "whoami": 1, 2023-05-08T03:42:05.884 INFO:teuthology.orchestra.run.smithi096.stdout: "id": 24487, 2023-05-08T03:42:05.884 INFO:teuthology.orchestra.run.smithi096.stdout: "want_state": "up:active", 2023-05-08T03:42:05.884 INFO:teuthology.orchestra.run.smithi096.stdout: "state": "up:active", 2023-05-08T03:42:05.884 INFO:teuthology.orchestra.run.smithi096.stdout: "fs_name": "cephfs", 2023-05-08T03:42:05.884 INFO:teuthology.orchestra.run.smithi096.stdout: "rank_uptime": 73.528277915000004, 2023-05-08T03:42:05.884 INFO:teuthology.orchestra.run.smithi096.stdout: "mdsmap_epoch": 22, 2023-05-08T03:42:05.885 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap_epoch": 84, 2023-05-08T03:42:05.885 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap_epoch_barrier": 82, 2023-05-08T03:42:05.885 INFO:teuthology.orchestra.run.smithi096.stdout: "uptime": 88.055000680000006 2023-05-08T03:42:05.885 INFO:teuthology.orchestra.run.smithi096.stdout:} 2023-05-08T03:42:05.886 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.868+0000 7fbd8a8a9700 1 -- 172.21.15.96:0/4106268314 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fbd700a11e0 msgr2=0x7fbd700a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:05.886 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.868+0000 7fbd8a8a9700 1 --2- 172.21.15.96:0/4106268314 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fbd700a11e0 0x7fbd700a3690 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fbd841002a0 tx=0x7fbd6c009260 comp rx=0 tx=0).stop 2023-05-08T03:42:05.887 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.868+0000 7fbd8a8a9700 1 -- 172.21.15.96:0/4106268314 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd84100dd0 msgr2=0x7fbd8419f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:05.887 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.868+0000 7fbd8a8a9700 1 --2- 172.21.15.96:0/4106268314 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd84100dd0 0x7fbd8419f7f0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c00b780 tx=0x7fbd7c00bdb0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.887 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.868+0000 7fbd8a8a9700 1 -- 172.21.15.96:0/4106268314 shutdown_connections 2023-05-08T03:42:05.887 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.868+0000 7fbd8a8a9700 1 --2- 172.21.15.96:0/4106268314 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7fbd700a11e0 0x7fbd700a3690 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.887 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.868+0000 7fbd8a8a9700 1 --2- 172.21.15.96:0/4106268314 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd84100dd0 0x7fbd8419f7f0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.888 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.868+0000 7fbd8a8a9700 1 --2- 172.21.15.96:0/4106268314 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd840ff250 0x7fbd84069c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.888 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.868+0000 7fbd8a8a9700 1 --2- 172.21.15.96:0/4106268314 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbd84100440 0x7fbd8419d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:05.888 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.868+0000 7fbd8a8a9700 1 -- 172.21.15.96:0/4106268314 >> 172.21.15.96:0/4106268314 conn(0x7fbd840fa850 msgr2=0x7fbd840fc9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:42:05.888 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.868+0000 7fbd8a8a9700 1 -- 172.21.15.96:0/4106268314 shutdown_connections 2023-05-08T03:42:05.888 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:05.868+0000 7fbd8a8a9700 1 -- 172.21.15.96:0/4106268314 wait complete. 2023-05-08T03:42:05.889 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-05-08T03:42:06.012 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.010+0000 7f36cb630700 1 -- 172.21.15.96:0/799358573 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36c4100340 msgr2=0x7f36c4100750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:06.013 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.010+0000 7f36cb630700 1 --2- 172.21.15.96:0/799358573 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36c4100340 0x7f36c4100750 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f36bc009990 tx=0x7f36bc009ca0 comp rx=0 tx=0).stop 2023-05-08T03:42:06.013 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.010+0000 7f36cb630700 1 -- 172.21.15.96:0/799358573 shutdown_connections 2023-05-08T03:42:06.013 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.010+0000 7f36cb630700 1 --2- 172.21.15.96:0/799358573 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36c4101ec0 0x7f36c4108780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:06.013 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.010+0000 7f36cb630700 1 --2- 172.21.15.96:0/799358573 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36c4100340 0x7f36c4100750 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:06.013 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.010+0000 7f36cb630700 1 --2- 172.21.15.96:0/799358573 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f36c4101530 0x7f36c4101980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:06.013 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.010+0000 7f36cb630700 1 -- 172.21.15.96:0/799358573 >> 172.21.15.96:0/799358573 conn(0x7f36c40fb940 msgr2=0x7f36c40fdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:42:06.014 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.010+0000 7f36cb630700 1 -- 172.21.15.96:0/799358573 shutdown_connections 2023-05-08T03:42:06.014 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.010+0000 7f36cb630700 1 -- 172.21.15.96:0/799358573 wait complete. 2023-05-08T03:42:06.015 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.010+0000 7f36cb630700 1 Processor -- start 2023-05-08T03:42:06.015 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.011+0000 7f36cb630700 1 -- start start 2023-05-08T03:42:06.016 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.011+0000 7f36cb630700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36c4100340 0x7f36c4196230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:06.016 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.011+0000 7f36cb630700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f36c4101530 0x7f36c4196770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:06.016 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.011+0000 7f36cb630700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36c4101ec0 0x7f36c419d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:06.016 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.011+0000 7f36cb630700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36c419ddb0 con 0x7f36c4100340 2023-05-08T03:42:06.016 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.011+0000 7f36cb630700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36c419def0 con 0x7f36c4101ec0 2023-05-08T03:42:06.017 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.011+0000 7f36cb630700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36c419e080 con 0x7f36c4101530 2023-05-08T03:42:06.017 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.011+0000 7f36c93cc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36c4100340 0x7f36c4196230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:06.017 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.011+0000 7f36c93cc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36c4100340 0x7f36c4196230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41696/0 (socket says 172.21.15.96:41696) 2023-05-08T03:42:06.017 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.011+0000 7f36c93cc700 1 -- 172.21.15.96:0/3414104616 learned_addr learned my addr 172.21.15.96:0/3414104616 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:42:06.018 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.011+0000 7f36c93cc700 1 -- 172.21.15.96:0/3414104616 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f36c4101530 msgr2=0x7f36c4196770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:06.018 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.011+0000 7f36c93cc700 1 --2- 172.21.15.96:0/3414104616 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f36c4101530 0x7f36c4196770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:06.019 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.011+0000 7f36c93cc700 1 -- 172.21.15.96:0/3414104616 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36c4101ec0 msgr2=0x7f36c419d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:06.019 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.011+0000 7f36c93cc700 1 --2- 172.21.15.96:0/3414104616 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36c4101ec0 0x7f36c419d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:06.020 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.011+0000 7f36c93cc700 1 -- 172.21.15.96:0/3414104616 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36bc0095f0 con 0x7f36c4100340 2023-05-08T03:42:06.020 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.011+0000 7f36c93cc700 1 --2- 172.21.15.96:0/3414104616 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36c4100340 0x7f36c4196230 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f36bc000c00 tx=0x7f36bc003940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:42:06.020 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.011+0000 7f36c27fc700 1 -- 172.21.15.96:0/3414104616 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36bc01d070 con 0x7f36c4100340 2023-05-08T03:42:06.021 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.011+0000 7f36c27fc700 1 -- 172.21.15.96:0/3414104616 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f36bc022470 con 0x7f36c4100340 2023-05-08T03:42:06.021 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.011+0000 7f36cb630700 1 -- 172.21.15.96:0/3414104616 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36c410bda0 con 0x7f36c4100340 2023-05-08T03:42:06.021 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.011+0000 7f36c27fc700 1 -- 172.21.15.96:0/3414104616 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36bc00f6c0 con 0x7f36c4100340 2023-05-08T03:42:06.021 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.012+0000 7f36cb630700 1 -- 172.21.15.96:0/3414104616 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36c410bc10 con 0x7f36c4100340 2023-05-08T03:42:06.030 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.013+0000 7f36c27fc700 1 -- 172.21.15.96:0/3414104616 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f36bc0225e0 con 0x7f36c4100340 2023-05-08T03:42:06.031 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.014+0000 7f36c27fc700 1 --2- 172.21.15.96:0/3414104616 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f36ac0a11e0 0x7f36ac0a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:06.031 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.014+0000 7f36c27fc700 1 -- 172.21.15.96:0/3414104616 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f36bc0cdec0 con 0x7f36c4100340 2023-05-08T03:42:06.031 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.014+0000 7f36c8bcb700 1 --2- 172.21.15.96:0/3414104616 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f36ac0a11e0 0x7f36ac0a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:06.031 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.014+0000 7f36c8bcb700 1 --2- 172.21.15.96:0/3414104616 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f36ac0a11e0 0x7f36ac0a3690 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f36b80097b0 tx=0x7f36b8006d20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:42:06.032 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.015+0000 7f36d77bbb80 1 Processor -- start 2023-05-08T03:42:06.032 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.015+0000 7f36d77bbb80 1 -- start start 2023-05-08T03:42:06.032 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.015+0000 7f36d77bbb80 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5575d8687340 0x5575d8687750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:06.032 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.015+0000 7f36d77bbb80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5575d8687c90 0x5575d86860b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:06.032 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.015+0000 7f36d77bbb80 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5575d8686640 0x5575d8686ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:06.032 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.015+0000 7f36d77bbb80 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575d858c020 con 0x5575d8686640 2023-05-08T03:42:06.033 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.015+0000 7f36d77bbb80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575d85de960 con 0x5575d8687c90 2023-05-08T03:42:06.033 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.015+0000 7f36d77bbb80 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575d85d7df0 con 0x5575d8687340 2023-05-08T03:42:06.033 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.016+0000 7f36c9bcd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5575d8686640 0x5575d8686ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:06.034 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.016+0000 7f36c9bcd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5575d8686640 0x5575d8686ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41708/0 (socket says 172.21.15.96:41708) 2023-05-08T03:42:06.034 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.016+0000 7f36c9bcd700 1 -- 172.21.15.96:0/1132920090 learned_addr learned my addr 172.21.15.96:0/1132920090 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:42:06.034 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.016+0000 7f36c8bcb700 1 --2- 172.21.15.96:0/1132920090 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5575d8687c90 0x5575d86860b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:06.034 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.016+0000 7f36c93cc700 1 --2- 172.21.15.96:0/1132920090 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5575d8687340 0x5575d8687750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:06.035 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.016+0000 7f36c9bcd700 1 -- 172.21.15.96:0/1132920090 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5575d8687340 msgr2=0x5575d8687750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-08T03:42:06.035 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.016+0000 7f36c9bcd700 1 --2- 172.21.15.96:0/1132920090 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5575d8687340 0x5575d8687750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:06.035 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.016+0000 7f36c9bcd700 1 -- 172.21.15.96:0/1132920090 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5575d8687c90 msgr2=0x5575d86860b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-08T03:42:06.035 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.016+0000 7f36c9bcd700 1 --2- 172.21.15.96:0/1132920090 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5575d8687c90 0x5575d86860b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:06.036 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.016+0000 7f36c9bcd700 1 -- 172.21.15.96:0/1132920090 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5575d84595e0 con 0x5575d8686640 2023-05-08T03:42:06.036 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.016+0000 7f36c9bcd700 1 --2- 172.21.15.96:0/1132920090 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5575d8686640 0x5575d8686ac0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f36b4009d00 tx=0x7f36b400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7edab798172de5f3 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:42:06.036 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.016+0000 7f36ab7fe700 1 -- 172.21.15.96:0/1132920090 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b400e070 con 0x5575d8686640 2023-05-08T03:42:06.036 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.016+0000 7f36ab7fe700 1 -- 172.21.15.96:0/1132920090 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f36b4009830 con 0x5575d8686640 2023-05-08T03:42:06.037 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.016+0000 7f36ab7fe700 1 -- 172.21.15.96:0/1132920090 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b4011390 con 0x5575d8686640 2023-05-08T03:42:06.037 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.017+0000 7f36d77bbb80 1 -- 172.21.15.96:0/1132920090 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5575d8686640 msgr2=0x5575d8686ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:06.037 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.017+0000 7f36d77bbb80 1 --2- 172.21.15.96:0/1132920090 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5575d8686640 0x5575d8686ac0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f36b4009d00 tx=0x7f36b400b330 comp rx=0 tx=0).stop 2023-05-08T03:42:06.037 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.017+0000 7f36d77bbb80 1 -- 172.21.15.96:0/1132920090 shutdown_connections 2023-05-08T03:42:06.038 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.017+0000 7f36d77bbb80 1 --2- 172.21.15.96:0/1132920090 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5575d8686640 0x5575d8686ac0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:06.038 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.017+0000 7f36d77bbb80 1 --2- 172.21.15.96:0/1132920090 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5575d8687340 0x5575d8687750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:06.038 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.017+0000 7f36d77bbb80 1 --2- 172.21.15.96:0/1132920090 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5575d8687c90 0x5575d86860b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:06.038 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.017+0000 7f36d77bbb80 1 -- 172.21.15.96:0/1132920090 >> 172.21.15.96:0/1132920090 conn(0x5575d86823e0 msgr2=0x5575d86807b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:42:06.039 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.017+0000 7f36d77bbb80 1 -- 172.21.15.96:0/1132920090 shutdown_connections 2023-05-08T03:42:06.039 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.017+0000 7f36d77bbb80 1 -- 172.21.15.96:0/1132920090 wait complete. 2023-05-08T03:42:06.039 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.017+0000 7f36d77bbb80 1 -- start start 2023-05-08T03:42:06.040 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.017+0000 7f36d77bbb80 1 Processor -- start 2023-05-08T03:42:06.040 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.018+0000 7f36d77bbb80 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5575d8686640 0x5575d868fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:06.040 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.018+0000 7f36d77bbb80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5575d8687340 0x5575d8690170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:06.041 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.018+0000 7f36d77bbb80 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5575d8687c90 0x5575d86971b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:06.041 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.018+0000 7f36d77bbb80 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575d845b8d0 con 0x5575d8687c90 2023-05-08T03:42:06.041 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.018+0000 7f36d77bbb80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575d86976f0 con 0x5575d8687340 2023-05-08T03:42:06.041 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.018+0000 7f36d77bbb80 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575d8697880 con 0x5575d8686640 2023-05-08T03:42:06.041 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.018+0000 7f36d77bbb80 10 client.0 _ll_register_callbacks cb 0x5575d857d4d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-08T03:42:06.042 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.018+0000 7f36c9bcd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5575d8687c90 0x5575d86971b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:06.042 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.018+0000 7f36c9bcd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5575d8687c90 0x5575d86971b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41714/0 (socket says 172.21.15.96:41714) 2023-05-08T03:42:06.042 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.018+0000 7f36c9bcd700 1 -- 172.21.15.96:0/674347442 learned_addr learned my addr 172.21.15.96:0/674347442 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:42:06.042 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.018+0000 7f36c8bcb700 1 --2- 172.21.15.96:0/674347442 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5575d8687340 0x5575d8690170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:06.042 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.018+0000 7f36c9bcd700 1 -- 172.21.15.96:0/674347442 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5575d8686640 msgr2=0x5575d868fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-08T03:42:06.042 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.018+0000 7f36c9bcd700 1 --2- 172.21.15.96:0/674347442 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5575d8686640 0x5575d868fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:06.042 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.018+0000 7f36c9bcd700 1 -- 172.21.15.96:0/674347442 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5575d8687340 msgr2=0x5575d8690170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-08T03:42:06.043 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.018+0000 7f36c9bcd700 1 --2- 172.21.15.96:0/674347442 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5575d8687340 0x5575d8690170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:06.043 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.018+0000 7f36c9bcd700 1 -- 172.21.15.96:0/674347442 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36b40099b0 con 0x5575d8687c90 2023-05-08T03:42:06.043 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.018+0000 7f36c9bcd700 1 --2- 172.21.15.96:0/674347442 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5575d8687c90 0x5575d86971b0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f36b4007070 tx=0x7f36b4012430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c76c162474967119 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:42:06.043 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.018+0000 7f36a8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.96:3300/0 2023-05-08T03:42:06.043 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.018+0000 7f36a8ff9700 1 -- 172.21.15.96:0/674347442 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b400e040 con 0x5575d8687c90 2023-05-08T03:42:06.043 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.018+0000 7f36a8ff9700 1 -- 172.21.15.96:0/674347442 <== mon.0 v2:172.21.15.96:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f36b401b620 con 0x5575d8687c90 2023-05-08T03:42:06.044 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.018+0000 7f36d77bbb80 1 -- 172.21.15.96:0/674347442 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5575d859a3a0 con 0x5575d8687c90 2023-05-08T03:42:06.044 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.018+0000 7f36a8ff9700 1 -- 172.21.15.96:0/674347442 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f36b401b7e0 con 0x5575d8687c90 2023-05-08T03:42:06.044 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.019+0000 7f36d77bbb80 10 client.15243 fetch_fsmap learned FSMap version 22 2023-05-08T03:42:06.044 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.019+0000 7f36d77bbb80 1 -- 172.21.15.96:0/674347442 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x5575d8405d90 con 0x5575d8687c90 2023-05-08T03:42:06.044 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.019+0000 7f36a8ff9700 1 -- 172.21.15.96:0/674347442 <== mon.0 v2:172.21.15.96:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5575d859a3a0 con 0x5575d8687c90 2023-05-08T03:42:06.045 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.019+0000 7f36a8ff9700 1 -- 172.21.15.96:0/674347442 <== mon.0 v2:172.21.15.96:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f36b4026ce0 con 0x5575d8687c90 2023-05-08T03:42:06.045 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.019+0000 7f36d77bbb80 10 client.15243 fetch_fsmap finished waiting for FSMap version 22 2023-05-08T03:42:06.045 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.019+0000 7f36d77bbb80 10 client.15243 resolve_mds: resolved name 'b' to daemon mds.b 2023-05-08T03:42:06.045 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.019+0000 7f36d77bbb80 20 client.15243 populate_metadata read hostname 'smithi096' 2023-05-08T03:42:06.045 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.019+0000 7f36d77bbb80 1 --2- 172.21.15.96:0/674347442 >> [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] conn(0x5575d869b0a0 0x5575d869a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:06.046 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.019+0000 7f36d77bbb80 4 client.15243 mds_command: new command op to 24494 tid=0[{"prefix": "get_command_descriptions"}] 2023-05-08T03:42:06.046 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.019+0000 7f36d77bbb80 1 -- 172.21.15.96:0/674347442 --> [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5575d85a6610 con 0x5575d869b0a0 2023-05-08T03:42:06.046 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.019+0000 7f36c93cc700 1 --2- 172.21.15.96:0/674347442 >> [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] conn(0x5575d869b0a0 0x5575d869a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:06.046 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.020+0000 7f36a8ff9700 10 client.15243 ms_handle_connect on v2:172.21.15.133:6838/2246041493 2023-05-08T03:42:06.046 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.020+0000 7f36c93cc700 1 --2- 172.21.15.96:0/674347442 >> [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] conn(0x5575d869b0a0 0x5575d869a480 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f7a9bd5173010a1 server_cookie=83a6f9a20004616a in_seq=0 out_seq=0 2023-05-08T03:42:06.046 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.020+0000 7f36a8ff9700 1 -- 172.21.15.96:0/674347442 <== mds.0 v2:172.21.15.133:6838/2246041493 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5575d85a6610 con 0x5575d869b0a0 2023-05-08T03:42:06.047 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.020+0000 7f36a8ff9700 10 client.15243 handle_command_reply: tid=0 2023-05-08T03:42:06.047 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.020+0000 7f36d77bbb80 1 client.15243 shutdown 2023-05-08T03:42:06.047 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.020+0000 7f36d77bbb80 1 -- 172.21.15.96:0/674347442 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5575d8687c90 msgr2=0x5575d86971b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:06.047 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.020+0000 7f36d77bbb80 1 --2- 172.21.15.96:0/674347442 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5575d8687c90 0x5575d86971b0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f36b4007070 tx=0x7f36b4012430 comp rx=0 tx=0).stop 2023-05-08T03:42:06.047 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.020+0000 7f36d77bbb80 1 -- 172.21.15.96:0/674347442 shutdown_connections 2023-05-08T03:42:06.048 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.020+0000 7f36d77bbb80 1 --2- 172.21.15.96:0/674347442 >> [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] conn(0x5575d869b0a0 0x5575d869a480 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:06.048 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.020+0000 7f36d77bbb80 1 --2- 172.21.15.96:0/674347442 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5575d8687c90 0x5575d86971b0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:06.048 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.020+0000 7f36d77bbb80 1 --2- 172.21.15.96:0/674347442 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5575d8686640 0x5575d868fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:06.048 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.020+0000 7f36a8ff9700 0 client.15243 ms_handle_reset on v2:172.21.15.133:6838/2246041493 2023-05-08T03:42:06.049 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.020+0000 7f36d77bbb80 1 --2- 172.21.15.96:0/674347442 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5575d8687340 0x5575d8690170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:06.049 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.020+0000 7f36d77bbb80 1 -- 172.21.15.96:0/674347442 >> 172.21.15.96:0/674347442 conn(0x5575d86823e0 msgr2=0x5575d867ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:42:06.050 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.020+0000 7f36d77bbb80 1 -- 172.21.15.96:0/674347442 shutdown_connections 2023-05-08T03:42:06.050 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.020+0000 7f36d77bbb80 1 -- 172.21.15.96:0/674347442 wait complete. 2023-05-08T03:42:06.051 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.021+0000 7f36d77bbb80 20 client.15243 trim_cache size 0 max 16384 2023-05-08T03:42:06.057 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.038+0000 7f36d77bbb80 1 Processor -- start 2023-05-08T03:42:06.058 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.038+0000 7f36d77bbb80 1 -- start start 2023-05-08T03:42:06.058 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.038+0000 7f36d77bbb80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5575d8686640 0x5575d868d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:06.058 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.038+0000 7f36d77bbb80 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5575d8687340 0x5575d8697170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:06.058 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.038+0000 7f36d77bbb80 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5575d8687c90 0x5575d868dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:06.059 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.038+0000 7f36d77bbb80 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575d8686eb0 con 0x5575d8687c90 2023-05-08T03:42:06.059 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.038+0000 7f36d77bbb80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575d85a6610 con 0x5575d8686640 2023-05-08T03:42:06.059 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.038+0000 7f36d77bbb80 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575d85a5e00 con 0x5575d8687340 2023-05-08T03:42:06.059 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.038+0000 7f36c9bcd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5575d8687c90 0x5575d868dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:06.059 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.038+0000 7f36c9bcd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5575d8687c90 0x5575d868dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41722/0 (socket says 172.21.15.96:41722) 2023-05-08T03:42:06.060 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.038+0000 7f36c9bcd700 1 -- 172.21.15.96:0/3591872220 learned_addr learned my addr 172.21.15.96:0/3591872220 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:42:06.061 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.039+0000 7f36c8bcb700 1 --2- 172.21.15.96:0/3591872220 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5575d8687340 0x5575d8697170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:06.061 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.039+0000 7f36c93cc700 1 --2- 172.21.15.96:0/3591872220 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5575d8686640 0x5575d868d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:06.061 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.039+0000 7f36c9bcd700 1 -- 172.21.15.96:0/3591872220 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5575d8687340 msgr2=0x5575d8697170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-08T03:42:06.062 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.039+0000 7f36c9bcd700 1 --2- 172.21.15.96:0/3591872220 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5575d8687340 0x5575d8697170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:06.062 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.039+0000 7f36c9bcd700 1 -- 172.21.15.96:0/3591872220 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5575d8686640 msgr2=0x5575d868d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-08T03:42:06.062 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.039+0000 7f36c9bcd700 1 --2- 172.21.15.96:0/3591872220 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5575d8686640 0x5575d868d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:06.062 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.039+0000 7f36c9bcd700 1 -- 172.21.15.96:0/3591872220 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5575d859e140 con 0x5575d8687c90 2023-05-08T03:42:06.062 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.039+0000 7f36c8bcb700 1 --2- 172.21.15.96:0/3591872220 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5575d8687340 0x5575d8697170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-08T03:42:06.062 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.039+0000 7f36c9bcd700 1 --2- 172.21.15.96:0/3591872220 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5575d8687c90 0x5575d868dec0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f36b400b370 tx=0x7f36b400b7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f586687b4055342f server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:42:06.063 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.039+0000 7f36abfff700 1 -- 172.21.15.96:0/3591872220 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b402b070 con 0x5575d8687c90 2023-05-08T03:42:06.063 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.039+0000 7f36abfff700 1 -- 172.21.15.96:0/3591872220 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f36b401a520 con 0x5575d8687c90 2023-05-08T03:42:06.063 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.039+0000 7f36abfff700 1 -- 172.21.15.96:0/3591872220 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b400e040 con 0x5575d8687c90 2023-05-08T03:42:06.063 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.040+0000 7f36d77bbb80 1 -- 172.21.15.96:0/3591872220 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5575d8687c90 msgr2=0x5575d868dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:06.063 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.040+0000 7f36d77bbb80 1 --2- 172.21.15.96:0/3591872220 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5575d8687c90 0x5575d868dec0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f36b400b370 tx=0x7f36b400b7d0 comp rx=0 tx=0).stop 2023-05-08T03:42:06.064 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.040+0000 7f36d77bbb80 1 -- 172.21.15.96:0/3591872220 shutdown_connections 2023-05-08T03:42:06.064 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.040+0000 7f36d77bbb80 1 --2- 172.21.15.96:0/3591872220 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5575d8687c90 0x5575d868dec0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:06.064 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.040+0000 7f36d77bbb80 1 --2- 172.21.15.96:0/3591872220 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5575d8686640 0x5575d868d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:06.064 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.040+0000 7f36d77bbb80 1 --2- 172.21.15.96:0/3591872220 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5575d8687340 0x5575d8697170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:06.064 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.040+0000 7f36d77bbb80 1 -- 172.21.15.96:0/3591872220 >> 172.21.15.96:0/3591872220 conn(0x5575d86823e0 msgr2=0x5575d868a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:42:06.065 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.040+0000 7f36d77bbb80 1 -- 172.21.15.96:0/3591872220 shutdown_connections 2023-05-08T03:42:06.065 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.040+0000 7f36d77bbb80 1 -- 172.21.15.96:0/3591872220 wait complete. 2023-05-08T03:42:06.065 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.040+0000 7f36d77bbb80 1 -- start start 2023-05-08T03:42:06.066 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.040+0000 7f36d77bbb80 1 Processor -- start 2023-05-08T03:42:06.066 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.040+0000 7f36d77bbb80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5575d8686640 0x5575d8692300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:06.066 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.040+0000 7f36d77bbb80 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5575d8687340 0x5575d8692840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:06.067 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.040+0000 7f36d77bbb80 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5575d8687c90 0x5575d8695860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:06.067 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.040+0000 7f36d77bbb80 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575d8695da0 con 0x5575d8687c90 2023-05-08T03:42:06.067 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.040+0000 7f36d77bbb80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575d8695f10 con 0x5575d8686640 2023-05-08T03:42:06.067 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.040+0000 7f36d77bbb80 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575d86960d0 con 0x5575d8687340 2023-05-08T03:42:06.068 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.040+0000 7f36d77bbb80 10 client.0 _ll_register_callbacks cb 0x5575d857d4d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-08T03:42:06.068 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.040+0000 7f36c9bcd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5575d8687c90 0x5575d8695860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:06.068 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.040+0000 7f36c9bcd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5575d8687c90 0x5575d8695860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41728/0 (socket says 172.21.15.96:41728) 2023-05-08T03:42:06.069 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.041+0000 7f36c9bcd700 1 -- 172.21.15.96:0/1210930608 learned_addr learned my addr 172.21.15.96:0/1210930608 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:42:06.069 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.041+0000 7f36c8bcb700 1 --2- 172.21.15.96:0/1210930608 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5575d8687340 0x5575d8692840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:06.069 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.041+0000 7f36c93cc700 1 --2- 172.21.15.96:0/1210930608 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5575d8686640 0x5575d8692300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:06.069 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.041+0000 7f36c9bcd700 1 -- 172.21.15.96:0/1210930608 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5575d8687340 msgr2=0x5575d8692840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-08T03:42:06.070 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.041+0000 7f36c9bcd700 1 --2- 172.21.15.96:0/1210930608 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5575d8687340 0x5575d8692840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:06.070 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.041+0000 7f36c9bcd700 1 -- 172.21.15.96:0/1210930608 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5575d8686640 msgr2=0x5575d8692300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-08T03:42:06.071 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.041+0000 7f36c9bcd700 1 --2- 172.21.15.96:0/1210930608 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5575d8686640 0x5575d8692300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:06.072 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.041+0000 7f36c9bcd700 1 -- 172.21.15.96:0/1210930608 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5575d8405d90 con 0x5575d8687c90 2023-05-08T03:42:06.072 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.041+0000 7f36c8bcb700 1 --2- 172.21.15.96:0/1210930608 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5575d8687340 0x5575d8692840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-08T03:42:06.072 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.041+0000 7f36c9bcd700 1 --2- 172.21.15.96:0/1210930608 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5575d8687c90 0x5575d8695860 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f36b4000f80 tx=0x7f36b4012600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac80b997bc33395 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:42:06.073 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.041+0000 7f36a8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.96:3300/0 2023-05-08T03:42:06.073 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.041+0000 7f36a8ff9700 1 -- 172.21.15.96:0/1210930608 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b402b040 con 0x5575d8687c90 2023-05-08T03:42:06.073 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.041+0000 7f36a8ff9700 1 -- 172.21.15.96:0/1210930608 <== mon.0 v2:172.21.15.96:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f36b4005e40 con 0x5575d8687c90 2023-05-08T03:42:06.073 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.041+0000 7f36d77bbb80 1 -- 172.21.15.96:0/1210930608 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5575d8655b70 con 0x5575d8687c90 2023-05-08T03:42:06.073 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.041+0000 7f36a8ff9700 1 -- 172.21.15.96:0/1210930608 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f36b401a9d0 con 0x5575d8687c90 2023-05-08T03:42:06.074 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.041+0000 7f36d77bbb80 10 client.15249 fetch_fsmap learned FSMap version 22 2023-05-08T03:42:06.074 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.041+0000 7f36d77bbb80 1 -- 172.21.15.96:0/1210930608 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x5575d842c200 con 0x5575d8687c90 2023-05-08T03:42:06.074 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.041+0000 7f36a8ff9700 1 -- 172.21.15.96:0/1210930608 <== mon.0 v2:172.21.15.96:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5575d8655b70 con 0x5575d8687c90 2023-05-08T03:42:06.074 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.041+0000 7f36a8ff9700 1 -- 172.21.15.96:0/1210930608 <== mon.0 v2:172.21.15.96:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f36b4033ba0 con 0x5575d8687c90 2023-05-08T03:42:06.075 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.042+0000 7f36d77bbb80 10 client.15249 fetch_fsmap finished waiting for FSMap version 22 2023-05-08T03:42:06.075 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.042+0000 7f36d77bbb80 10 client.15249 resolve_mds: resolved name 'b' to daemon mds.b 2023-05-08T03:42:06.075 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.042+0000 7f36d77bbb80 20 client.15249 populate_metadata read hostname 'smithi096' 2023-05-08T03:42:06.075 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.042+0000 7f36d77bbb80 1 --2- 172.21.15.96:0/1210930608 >> [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] conn(0x5575d86f41d0 0x5575d86f0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:06.075 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.042+0000 7f36d77bbb80 4 client.15249 mds_command: new command op to 24494 tid=0[{"prefix": "status"}] 2023-05-08T03:42:06.076 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.042+0000 7f36d77bbb80 1 -- 172.21.15.96:0/1210930608 --> [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5575d845bf10 con 0x5575d86f41d0 2023-05-08T03:42:06.076 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.042+0000 7f36c93cc700 1 --2- 172.21.15.96:0/1210930608 >> [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] conn(0x5575d86f41d0 0x5575d86f0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:06.076 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.042+0000 7f36a8ff9700 10 client.15249 ms_handle_connect on v2:172.21.15.133:6838/2246041493 2023-05-08T03:42:06.076 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.042+0000 7f36c93cc700 1 --2- 172.21.15.96:0/1210930608 >> [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] conn(0x5575d86f41d0 0x5575d86f0f70 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5189c32610b03538 server_cookie=b10d750190c659bc in_seq=0 out_seq=0 2023-05-08T03:42:06.076 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.042+0000 7f36a8ff9700 1 -- 172.21.15.96:0/1210930608 <== mds.0 v2:172.21.15.133:6838/2246041493 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x5575d845bf10 con 0x5575d86f41d0 2023-05-08T03:42:06.077 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.042+0000 7f36a8ff9700 10 client.15249 handle_command_reply: tid=0 2023-05-08T03:42:06.077 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.042+0000 7f36d77bbb80 1 client.15249 shutdown 2023-05-08T03:42:06.077 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.043+0000 7f36d77bbb80 1 -- 172.21.15.96:0/1210930608 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5575d8687c90 msgr2=0x5575d8695860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:06.077 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.043+0000 7f36d77bbb80 1 --2- 172.21.15.96:0/1210930608 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5575d8687c90 0x5575d8695860 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f36b4000f80 tx=0x7f36b4012600 comp rx=0 tx=0).stop 2023-05-08T03:42:06.077 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.043+0000 7f36d77bbb80 1 -- 172.21.15.96:0/1210930608 shutdown_connections 2023-05-08T03:42:06.077 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.043+0000 7f36d77bbb80 1 --2- 172.21.15.96:0/1210930608 >> [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] conn(0x5575d86f41d0 0x5575d86f0f70 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:06.078 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.043+0000 7f36d77bbb80 1 --2- 172.21.15.96:0/1210930608 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5575d8687c90 0x5575d8695860 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:06.078 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.043+0000 7f36d77bbb80 1 --2- 172.21.15.96:0/1210930608 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5575d8686640 0x5575d8692300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:06.078 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.043+0000 7f36d77bbb80 1 --2- 172.21.15.96:0/1210930608 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5575d8687340 0x5575d8692840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:06.078 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.043+0000 7f36a8ff9700 0 client.15249 ms_handle_reset on v2:172.21.15.133:6838/2246041493 2023-05-08T03:42:06.078 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.043+0000 7f36d77bbb80 1 -- 172.21.15.96:0/1210930608 >> 172.21.15.96:0/1210930608 conn(0x5575d86823e0 msgr2=0x5575d868a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:42:06.078 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.043+0000 7f36d77bbb80 1 -- 172.21.15.96:0/1210930608 shutdown_connections 2023-05-08T03:42:06.078 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.043+0000 7f36d77bbb80 1 -- 172.21.15.96:0/1210930608 wait complete. 2023-05-08T03:42:06.079 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.043+0000 7f36d77bbb80 20 client.15249 trim_cache size 0 max 16384 2023-05-08T03:42:06.079 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2023-05-08T03:42:06.079 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_fsid": "f7ffcfb0-ed50-11ed-9b01-001a4aab830c", 2023-05-08T03:42:06.080 INFO:teuthology.orchestra.run.smithi096.stdout: "whoami": 0, 2023-05-08T03:42:06.080 INFO:teuthology.orchestra.run.smithi096.stdout: "id": 24494, 2023-05-08T03:42:06.080 INFO:teuthology.orchestra.run.smithi096.stdout: "want_state": "up:active", 2023-05-08T03:42:06.080 INFO:teuthology.orchestra.run.smithi096.stdout: "state": "up:active", 2023-05-08T03:42:06.081 INFO:teuthology.orchestra.run.smithi096.stdout: "fs_name": "cephfs", 2023-05-08T03:42:06.082 INFO:teuthology.orchestra.run.smithi096.stdout: "rank_uptime": 76.830989231999993, 2023-05-08T03:42:06.082 INFO:teuthology.orchestra.run.smithi096.stdout: "mdsmap_epoch": 22, 2023-05-08T03:42:06.082 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap_epoch": 84, 2023-05-08T03:42:06.083 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap_epoch_barrier": 82, 2023-05-08T03:42:06.083 INFO:teuthology.orchestra.run.smithi096.stdout: "uptime": 81.399995693999998 2023-05-08T03:42:06.083 INFO:teuthology.orchestra.run.smithi096.stdout:} 2023-05-08T03:42:06.085 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.043+0000 7f36cb630700 1 -- 172.21.15.96:0/3414104616 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f36ac0a11e0 msgr2=0x7f36ac0a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:06.086 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.043+0000 7f36cb630700 1 --2- 172.21.15.96:0/3414104616 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f36ac0a11e0 0x7f36ac0a3690 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f36b80097b0 tx=0x7f36b8006d20 comp rx=0 tx=0).stop 2023-05-08T03:42:06.087 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.043+0000 7f36cb630700 1 -- 172.21.15.96:0/3414104616 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36c4100340 msgr2=0x7f36c4196230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:06.087 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.043+0000 7f36cb630700 1 --2- 172.21.15.96:0/3414104616 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36c4100340 0x7f36c4196230 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f36bc000c00 tx=0x7f36bc003940 comp rx=0 tx=0).stop 2023-05-08T03:42:06.087 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.043+0000 7f36cb630700 1 -- 172.21.15.96:0/3414104616 shutdown_connections 2023-05-08T03:42:06.089 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.043+0000 7f36cb630700 1 --2- 172.21.15.96:0/3414104616 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f36ac0a11e0 0x7f36ac0a3690 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:06.089 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.043+0000 7f36cb630700 1 --2- 172.21.15.96:0/3414104616 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36c4101ec0 0x7f36c419d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:06.089 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.043+0000 7f36cb630700 1 --2- 172.21.15.96:0/3414104616 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36c4100340 0x7f36c4196230 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:06.089 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.043+0000 7f36cb630700 1 --2- 172.21.15.96:0/3414104616 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f36c4101530 0x7f36c4196770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:06.089 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.043+0000 7f36cb630700 1 -- 172.21.15.96:0/3414104616 >> 172.21.15.96:0/3414104616 conn(0x7f36c40fb940 msgr2=0x7f36c40fdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:42:06.089 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.043+0000 7f36cb630700 1 -- 172.21.15.96:0/3414104616 shutdown_connections 2023-05-08T03:42:06.089 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:06.043+0000 7f36cb630700 1 -- 172.21.15.96:0/3414104616 wait complete. 2023-05-08T03:42:06.090 INFO:teuthology.run_tasks:Running task kclient... 2023-05-08T03:42:06.115 INFO:tasks.kclient:Mounting kernel clients... 2023-05-08T03:42:06.115 INFO:tasks.kclient:config is {'client.0': {}} 2023-05-08T03:42:06.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-08T03:42:06.116 DEBUG:teuthology.orchestra.run.smithi096:> ip netns list 2023-05-08T03:42:06.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-08T03:42:06.135 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link delete ceph-brx 2023-05-08T03:42:06.198 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:05 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/567961568' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-05-08T03:42:06.199 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:05 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/2786256475' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-05-08T03:42:06.204 INFO:teuthology.orchestra.run.smithi096.stderr:Cannot find device "ceph-brx" 2023-05-08T03:42:06.205 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-08T03:42:06.205 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=secure', 'nowsync', 'context=system_u:object_r:postgresql_db_t:s0'], 'syntax': 'v2', 'mount_subvol_num': 1, 'mountpoint': '/tmp/cephfs'} 2023-05-08T03:42:06.206 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-05-08T03:42:06.206 INFO:tasks.cephfs.mount:using client_config["hostfs_mntpt"] = /tmp/cephfs 2023-05-08T03:42:06.206 INFO:tasks.cephfs.mount:hostfs_mntpt = /tmp/cephfs 2023-05-08T03:42:06.207 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4b086ba51b906a75bac7252b2239e8f120a38c8c shell --fsid f7ffcfb0-ed50-11ed-9b01-001a4aab830c -- ceph fs ls 2023-05-08T03:42:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:05 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/567961568' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-05-08T03:42:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:05 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/2786256475' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-05-08T03:42:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:05 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/567961568' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-05-08T03:42:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:05 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/2786256475' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-05-08T03:42:06.882 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/mon.a/config 2023-05-08T03:42:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:06 smithi133 ceph-mon[125939]: pgmap v298: 97 pgs: 97 active+clean; 636 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T03:42:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:06 smithi096 ceph-mon[124666]: pgmap v298: 97 pgs: 97 active+clean; 636 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T03:42:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:06 smithi186 ceph-mon[126480]: pgmap v298: 97 pgs: 97 active+clean; 636 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T03:42:08.057 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:08.052+0000 7f50e29cb700 1 -- 172.21.15.96:0/506818147 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50dc076130 msgr2=0x7f50dc0ff6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:08.057 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:08.052+0000 7f50e29cb700 1 --2- 172.21.15.96:0/506818147 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50dc076130 0x7f50dc0ff6d0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f50cc009990 tx=0x7f50cc009ca0 comp rx=0 tx=0).stop 2023-05-08T03:42:08.058 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:08.053+0000 7f50e29cb700 1 -- 172.21.15.96:0/506818147 shutdown_connections 2023-05-08T03:42:08.058 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:08.053+0000 7f50e29cb700 1 --2- 172.21.15.96:0/506818147 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f50dc10aa50 0x7f50dc10ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:08.058 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:08.053+0000 7f50e29cb700 1 --2- 172.21.15.96:0/506818147 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50dc076130 0x7f50dc0ff6d0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:08.058 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:08.053+0000 7f50e29cb700 1 --2- 172.21.15.96:0/506818147 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50dc0ffc10 0x7f50dc100060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:08.058 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:08.053+0000 7f50e29cb700 1 -- 172.21.15.96:0/506818147 >> 172.21.15.96:0/506818147 conn(0x7f50dc074c00 msgr2=0x7f50dc075000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:42:08.059 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:08.053+0000 7f50e29cb700 1 -- 172.21.15.96:0/506818147 shutdown_connections 2023-05-08T03:42:08.059 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:08.053+0000 7f50e29cb700 1 -- 172.21.15.96:0/506818147 wait complete. 2023-05-08T03:42:08.059 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:08.053+0000 7f50e29cb700 1 Processor -- start 2023-05-08T03:42:08.059 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:08.053+0000 7f50e29cb700 1 -- start start 2023-05-08T03:42:08.059 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:08.054+0000 7f50e29cb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50dc076130 0x7f50dc1008b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:08.059 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:08.054+0000 7f50e29cb700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50dc0ffc10 0x7f50dc100df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:08.059 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:08.054+0000 7f50e29cb700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f50dc10aa50 0x7f50dc101370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:08.060 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:08.054+0000 7f50e29cb700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50dc1a4980 con 0x7f50dc0ffc10 2023-05-08T03:42:08.060 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:08.054+0000 7f50e29cb700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50dc1a4af0 con 0x7f50dc076130 2023-05-08T03:42:08.060 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:08.054+0000 7f50e29cb700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50dc1a4cb0 con 0x7f50dc10aa50 2023-05-08T03:42:08.060 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:08.054+0000 7f50db7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50dc0ffc10 0x7f50dc100df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:08.060 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:08.054+0000 7f50db7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50dc0ffc10 0x7f50dc100df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41738/0 (socket says 172.21.15.96:41738) 2023-05-08T03:42:08.060 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:08.054+0000 7f50db7fe700 1 -- 172.21.15.96:0/1459752450 learned_addr learned my addr 172.21.15.96:0/1459752450 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:42:08.061 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:08.054+0000 7f50dbfff700 1 --2- 172.21.15.96:0/1459752450 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50dc076130 0x7f50dc1008b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:08.061 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:08.054+0000 7f50e0f68700 1 --2- 172.21.15.96:0/1459752450 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f50dc10aa50 0x7f50dc101370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:08.061 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:08.054+0000 7f50db7fe700 1 -- 172.21.15.96:0/1459752450 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f50dc10aa50 msgr2=0x7f50dc101370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:08.061 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:08.054+0000 7f50db7fe700 1 --2- 172.21.15.96:0/1459752450 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f50dc10aa50 0x7f50dc101370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:08.061 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:08.054+0000 7f50db7fe700 1 -- 172.21.15.96:0/1459752450 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50dc076130 msgr2=0x7f50dc1008b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:08.062 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:08.054+0000 7f50db7fe700 1 --2- 172.21.15.96:0/1459752450 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50dc076130 0x7f50dc1008b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:08.062 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:08.054+0000 7f50db7fe700 1 -- 172.21.15.96:0/1459752450 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50cc0095f0 con 0x7f50dc0ffc10 2023-05-08T03:42:08.062 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:08.054+0000 7f50db7fe700 1 --2- 172.21.15.96:0/1459752450 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50dc0ffc10 0x7f50dc100df0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f50d000c9b0 tx=0x7f50d000ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:42:08.062 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:08.054+0000 7f50d97fa700 1 -- 172.21.15.96:0/1459752450 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d0007b00 con 0x7f50dc0ffc10 2023-05-08T03:42:08.062 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:08.054+0000 7f50d97fa700 1 -- 172.21.15.96:0/1459752450 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f50d0007c60 con 0x7f50dc0ffc10 2023-05-08T03:42:08.062 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:08.054+0000 7f50e29cb700 1 -- 172.21.15.96:0/1459752450 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50dc110420 con 0x7f50dc0ffc10 2023-05-08T03:42:08.062 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:08.054+0000 7f50d97fa700 1 -- 172.21.15.96:0/1459752450 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d0018660 con 0x7f50dc0ffc10 2023-05-08T03:42:08.063 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:08.055+0000 7f50e29cb700 1 -- 172.21.15.96:0/1459752450 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50dc110290 con 0x7f50dc0ffc10 2023-05-08T03:42:08.064 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:08.055+0000 7f50e29cb700 1 -- 172.21.15.96:0/1459752450 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50dc1105b0 con 0x7f50dc0ffc10 2023-05-08T03:42:08.064 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:08.056+0000 7f50d97fa700 1 -- 172.21.15.96:0/1459752450 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f50d000f450 con 0x7f50dc0ffc10 2023-05-08T03:42:08.064 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:08.057+0000 7f50d97fa700 1 --2- 172.21.15.96:0/1459752450 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f50c40a11e0 0x7f50c40a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:08.064 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:08.057+0000 7f50dbfff700 1 --2- 172.21.15.96:0/1459752450 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f50c40a11e0 0x7f50c40a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:08.064 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:08.057+0000 7f50d97fa700 1 -- 172.21.15.96:0/1459752450 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f50d00cc980 con 0x7f50dc0ffc10 2023-05-08T03:42:08.064 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:08.057+0000 7f50dbfff700 1 --2- 172.21.15.96:0/1459752450 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f50c40a11e0 0x7f50c40a3690 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f50cc00b5c0 tx=0x7f50cc005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:42:08.065 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:08.061+0000 7f50d97fa700 1 -- 172.21.15.96:0/1459752450 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f50d0096070 con 0x7f50dc0ffc10 2023-05-08T03:42:08.293 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:08.290+0000 7f50e29cb700 1 -- 172.21.15.96:0/1459752450 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f50dc1058b0 con 0x7f50dc0ffc10 2023-05-08T03:42:08.293 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:08.290+0000 7f50d97fa700 1 -- 172.21.15.96:0/1459752450 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v22) v1 ==== 53+0+73 (secure 0 0 0) 0x7f50d0099690 con 0x7f50dc0ffc10 2023-05-08T03:42:08.294 INFO:teuthology.orchestra.run.smithi096.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-05-08T03:42:08.294 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:08.292+0000 7f50e29cb700 1 -- 172.21.15.96:0/1459752450 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f50c40a11e0 msgr2=0x7f50c40a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:08.295 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:08.292+0000 7f50e29cb700 1 --2- 172.21.15.96:0/1459752450 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f50c40a11e0 0x7f50c40a3690 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f50cc00b5c0 tx=0x7f50cc005fb0 comp rx=0 tx=0).stop 2023-05-08T03:42:08.295 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:08.292+0000 7f50e29cb700 1 -- 172.21.15.96:0/1459752450 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50dc0ffc10 msgr2=0x7f50dc100df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:08.295 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:08.292+0000 7f50e29cb700 1 --2- 172.21.15.96:0/1459752450 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50dc0ffc10 0x7f50dc100df0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f50d000c9b0 tx=0x7f50d000ccc0 comp rx=0 tx=0).stop 2023-05-08T03:42:08.295 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:08.292+0000 7f50e29cb700 1 -- 172.21.15.96:0/1459752450 shutdown_connections 2023-05-08T03:42:08.295 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:08.292+0000 7f50e29cb700 1 --2- 172.21.15.96:0/1459752450 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f50c40a11e0 0x7f50c40a3690 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:08.295 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:08.292+0000 7f50e29cb700 1 --2- 172.21.15.96:0/1459752450 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f50dc10aa50 0x7f50dc101370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:08.296 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:08.292+0000 7f50e29cb700 1 --2- 172.21.15.96:0/1459752450 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50dc076130 0x7f50dc1008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:08.296 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:08.292+0000 7f50e29cb700 1 --2- 172.21.15.96:0/1459752450 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50dc0ffc10 0x7f50dc100df0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:08.296 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:08.292+0000 7f50e29cb700 1 -- 172.21.15.96:0/1459752450 >> 172.21.15.96:0/1459752450 conn(0x7f50dc074c00 msgr2=0x7f50dc1029f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:42:08.296 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:08.292+0000 7f50e29cb700 1 -- 172.21.15.96:0/1459752450 shutdown_connections 2023-05-08T03:42:08.296 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:08.292+0000 7f50e29cb700 1 -- 172.21.15.96:0/1459752450 wait complete. 2023-05-08T03:42:08.635 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:08 smithi096 ceph-mon[124666]: pgmap v299: 97 pgs: 97 active+clean; 636 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T03:42:08.635 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:08 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/1459752450' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-05-08T03:42:08.639 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-05-08T03:42:08.639 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-08T03:42:08.640 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi096.front.sepia.ceph.com 2023-05-08T03:42:08.640 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-05-08T03:42:08.640 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /tmp/cephfs 2023-05-08T03:42:08.641 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-05-08T03:42:08.641 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-05-08T03:42:08.641 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-08T03:42:08.641 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/tmp/cephfs' 2023-05-08T03:42:08.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-08T03:42:08.642 DEBUG:teuthology.orchestra.run.smithi096:> ip addr 2023-05-08T03:42:08.661 INFO:teuthology.orchestra.run.smithi096.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-08T03:42:08.662 INFO:teuthology.orchestra.run.smithi096.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-08T03:42:08.662 INFO:teuthology.orchestra.run.smithi096.stdout: inet 127.0.0.1/8 scope host lo 2023-05-08T03:42:08.662 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2023-05-08T03:42:08.662 INFO:teuthology.orchestra.run.smithi096.stdout: inet6 ::1/128 scope host 2023-05-08T03:42:08.662 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2023-05-08T03:42:08.663 INFO:teuthology.orchestra.run.smithi096.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-08T03:42:08.663 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 0c:c4:7a:d8:d9:bc brd ff:ff:ff:ff:ff:ff 2023-05-08T03:42:08.663 INFO:teuthology.orchestra.run.smithi096.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-08T03:42:08.664 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 0c:c4:7a:d8:d9:bd brd ff:ff:ff:ff:ff:ff 2023-05-08T03:42:08.664 INFO:teuthology.orchestra.run.smithi096.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-08T03:42:08.664 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 0c:c4:7a:8f:cc:0c brd ff:ff:ff:ff:ff:ff 2023-05-08T03:42:08.664 INFO:teuthology.orchestra.run.smithi096.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-08T03:42:08.664 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 0c:c4:7a:8f:cc:0d brd ff:ff:ff:ff:ff:ff 2023-05-08T03:42:08.664 INFO:teuthology.orchestra.run.smithi096.stdout: inet 172.21.15.96/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-05-08T03:42:08.664 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft 41146sec preferred_lft 41146sec 2023-05-08T03:42:08.665 INFO:teuthology.orchestra.run.smithi096.stdout: inet6 fe80::fa9a:6e2c:c102:867a/64 scope link noprefixroute 2023-05-08T03:42:08.665 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2023-05-08T03:42:08.665 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-05-08T03:42:08.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-08T03:42:08.666 DEBUG:teuthology.orchestra.run.smithi096:> (cd / && exec bash -c ' 2023-05-08T03:42:08.666 DEBUG:teuthology.orchestra.run.smithi096:> set -e 2023-05-08T03:42:08.666 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link add name ceph-brx type bridge 2023-05-08T03:42:08.666 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip addr flush dev ceph-brx 2023-05-08T03:42:08.667 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link set ceph-brx up 2023-05-08T03:42:08.667 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-05-08T03:42:08.667 DEBUG:teuthology.orchestra.run.smithi096:> ') 2023-05-08T03:42:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:08 smithi133 ceph-mon[125939]: pgmap v299: 97 pgs: 97 active+clean; 636 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T03:42:08.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:08 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/1459752450' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-05-08T03:42:08.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-08T03:42:08.832 DEBUG:teuthology.orchestra.run.smithi096:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-08T03:42:08.860 INFO:teuthology.orchestra.run.smithi096.stdout:1 2023-05-08T03:42:08.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-08T03:42:08.862 DEBUG:teuthology.orchestra.run.smithi096:> route 2023-05-08T03:42:08.877 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:08 smithi186 ceph-mon[126480]: pgmap v299: 97 pgs: 97 active+clean; 636 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T03:42:08.877 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:08 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/1459752450' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-05-08T03:42:08.940 INFO:teuthology.orchestra.run.smithi096.stdout:Kernel IP routing table 2023-05-08T03:42:08.941 INFO:teuthology.orchestra.run.smithi096.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-08T03:42:08.941 INFO:teuthology.orchestra.run.smithi096.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-05-08T03:42:08.941 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-05-08T03:42:08.941 INFO:teuthology.orchestra.run.smithi096.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-08T03:42:08.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-08T03:42:08.942 DEBUG:teuthology.orchestra.run.smithi096:> (cd / && exec bash -c ' 2023-05-08T03:42:08.942 DEBUG:teuthology.orchestra.run.smithi096:> set -e 2023-05-08T03:42:08.943 DEBUG:teuthology.orchestra.run.smithi096:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-05-08T03:42:08.943 DEBUG:teuthology.orchestra.run.smithi096:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-05-08T03:42:08.943 DEBUG:teuthology.orchestra.run.smithi096:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-05-08T03:42:08.944 DEBUG:teuthology.orchestra.run.smithi096:> ') 2023-05-08T03:42:09.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-08T03:42:09.211 DEBUG:teuthology.orchestra.run.smithi096:> ip netns list 2023-05-08T03:42:09.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-08T03:42:09.229 DEBUG:teuthology.orchestra.run.smithi096:> ip netns list-id 2023-05-08T03:42:09.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-08T03:42:09.286 DEBUG:teuthology.orchestra.run.smithi096:> (cd / && exec bash -c ' 2023-05-08T03:42:09.286 DEBUG:teuthology.orchestra.run.smithi096:> set -e 2023-05-08T03:42:09.286 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns add ceph-ns--tmp-cephfs 2023-05-08T03:42:09.287 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns set ceph-ns--tmp-cephfs 0 2023-05-08T03:42:09.287 DEBUG:teuthology.orchestra.run.smithi096:> ') 2023-05-08T03:42:09.381 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--tmp-cephfs' with 192.168.0.1/16 2023-05-08T03:42:09.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-08T03:42:09.382 DEBUG:teuthology.orchestra.run.smithi096:> (cd / && exec bash -c ' 2023-05-08T03:42:09.383 DEBUG:teuthology.orchestra.run.smithi096:> set -e 2023-05-08T03:42:09.383 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link add veth0 netns ceph-ns--tmp-cephfs type veth peer name brx.0 2023-05-08T03:42:09.384 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns exec ceph-ns--tmp-cephfs ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-05-08T03:42:09.384 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns exec ceph-ns--tmp-cephfs ip link set veth0 up 2023-05-08T03:42:09.385 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns exec ceph-ns--tmp-cephfs ip link set lo up 2023-05-08T03:42:09.386 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns exec ceph-ns--tmp-cephfs ip route add default via 192.168.255.254 2023-05-08T03:42:09.386 DEBUG:teuthology.orchestra.run.smithi096:> ') 2023-05-08T03:42:09.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-08T03:42:09.608 DEBUG:teuthology.orchestra.run.smithi096:> (cd / && exec bash -c ' 2023-05-08T03:42:09.608 DEBUG:teuthology.orchestra.run.smithi096:> set -e 2023-05-08T03:42:09.609 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link set brx.0 up 2023-05-08T03:42:09.609 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link set dev brx.0 master ceph-brx 2023-05-08T03:42:09.609 DEBUG:teuthology.orchestra.run.smithi096:> ') 2023-05-08T03:42:09.647 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:09 smithi096 ceph-mon[124666]: mgrmap e18: x(active, since 7m), standbys: z, y 2023-05-08T03:42:09.708 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-08T03:42:09.708 DEBUG:teuthology.orchestra.run.smithi096:> mkdir -p -v /tmp/cephfs 2023-05-08T03:42:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:09 smithi133 ceph-mon[125939]: mgrmap e18: x(active, since 7m), standbys: z, y 2023-05-08T03:42:09.765 INFO:teuthology.orchestra.run.smithi096.stdout:mkdir: created directory '/tmp/cephfs' 2023-05-08T03:42:09.766 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-08T03:42:09.767 DEBUG:teuthology.orchestra.run.smithi096:> chmod 0000 /tmp/cephfs 2023-05-08T03:42:09.822 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2023-05-08T03:42:09.823 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2023-05-08T03:42:09.823 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/volumes/_nogroup/sv_1/7dade95a-6e77-415d-96f3-d57b5eaa857b 2023-05-08T03:42:09.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-08T03:42:09.823 DEBUG:teuthology.orchestra.run.smithi096:> sudo nsenter --net=/var/run/netns/ceph-ns--tmp-cephfs adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/volumes/_nogroup/sv_1/7dade95a-6e77-415d-96f3-d57b5eaa857b /tmp/cephfs -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,nowsync,context=system_u:object_r:postgresql_db_t:s0,nofallback 2023-05-08T03:42:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:09 smithi186 ceph-mon[126480]: mgrmap e18: x(active, since 7m), standbys: z, y 2023-05-08T03:42:09.918 INFO:teuthology.orchestra.run.smithi096.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,nowsync,context="system_u:object_r:postgresql_db_t:s0",nofallback 2023-05-08T03:42:09.918 INFO:teuthology.orchestra.run.smithi096.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,nowsync,context="system_u:object_r:postgresql_db_t:s0"". 2023-05-08T03:42:10.062 INFO:teuthology.orchestra.run.smithi096.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,nowsync,context="system_u:object_r:postgresql_db_t:s0",nofallback 2023-05-08T03:42:10.063 INFO:teuthology.orchestra.run.smithi096.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,nowsync,context="system_u:object_r:postgresql_db_t:s0"". 2023-05-08T03:42:10.063 INFO:teuthology.orchestra.run.smithi096.stdout:mount.ceph: resolved to: "172.21.15.96:3300,172.21.15.133:3300,172.21.15.186:3300" 2023-05-08T03:42:10.063 INFO:teuthology.orchestra.run.smithi096.stdout:mount.ceph: trying mount with new device syntax: 0@f7ffcfb0-ed50-11ed-9b01-001a4aab830c.cephfs=/volumes/_nogroup/sv_1/7dade95a-6e77-415d-96f3-d57b5eaa857b 2023-05-08T03:42:10.063 INFO:teuthology.orchestra.run.smithi096.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,nowsync,context="system_u:object_r:postgresql_db_t:s0",name=0,key=0,mon_addr=172.21.15.96:3300/172.21.15.133:3300/172.21.15.186:3300" will pass to kernel 2023-05-08T03:42:10.063 INFO:teuthology.orchestra.run.smithi096.stdout:mount.ceph: v2 mount support check returned 2 2023-05-08T03:42:10.063 INFO:teuthology.orchestra.run.smithi096.stdout:mount.ceph: kernel does not support v2 syntax 2023-05-08T03:42:10.064 INFO:teuthology.orchestra.run.smithi096.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.96:3300,172.21.15.133:3300,172.21.15.186:3300:/volumes/_nogroup/sv_1/7dade95a-6e77-415d-96f3-d57b5eaa857b 2023-05-08T03:42:10.064 INFO:teuthology.orchestra.run.smithi096.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,nowsync,context="system_u:object_r:postgresql_db_t:s0",name=0,key=0,mds_namespace=cephfs,fsid=f7ffcfb0-ed50-11ed-9b01-001a4aab830c" will pass to kernel 2023-05-08T03:42:10.080 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-05-08T03:42:10.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-08T03:42:10.081 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 1777 /tmp/cephfs 2023-05-08T03:42:10.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-08T03:42:10.109 DEBUG:teuthology.orchestra.run.smithi096:> (cd /tmp/cephfs && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-05-08T03:42:10.182 INFO:teuthology.orchestra.run.smithi096.stdout:client15258 2023-05-08T03:42:10.182 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-05-08T03:42:10.183 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-08T03:42:10.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-08T03:42:10.242 DEBUG:teuthology.orchestra.run.smithi096:> (cd /tmp/cephfs && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-05-08T03:42:10.312 INFO:teuthology.orchestra.run.smithi096.stdout:client15258 2023-05-08T03:42:10.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-08T03:42:10.313 DEBUG:teuthology.orchestra.run.smithi096:> (cd /tmp/cephfs && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-05-08T03:42:10.385 INFO:teuthology.orchestra.run.smithi096.stdout:client15258 2023-05-08T03:42:10.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-08T03:42:10.385 DEBUG:teuthology.orchestra.run.smithi096:> (cd /tmp/cephfs && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c.client15258/status') 2023-05-08T03:42:10.465 INFO:teuthology.orchestra.run.smithi096.stdout:instance: client.15258 (3)192.168.0.1:0/758358061 2023-05-08T03:42:10.465 INFO:teuthology.orchestra.run.smithi096.stdout:blocklisted: false 2023-05-08T03:42:10.466 INFO:teuthology.orchestra.run.smithi096.stderr:0+1 records in 2023-05-08T03:42:10.466 INFO:teuthology.orchestra.run.smithi096.stderr:0+1 records out 2023-05-08T03:42:10.466 INFO:teuthology.orchestra.run.smithi096.stderr:69 bytes copied, 2.4175e-05 s, 2.9 MB/s 2023-05-08T03:42:10.467 INFO:teuthology.run_tasks:Running task check-counter... 2023-05-08T03:42:10.479 INFO:teuthology.run_tasks:Running task exec... 2023-05-08T03:42:10.521 INFO:teuthology.task.exec:Executing custom commands... 2023-05-08T03:42:10.522 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi096.front.sepia.ceph.com 2023-05-08T03:42:10.522 DEBUG:teuthology.orchestra.run.smithi096:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mgr module enable snap_schedule' 2023-05-08T03:42:10.646 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:10.642+0000 7ff38f978700 1 -- 172.21.15.96:0/753267089 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff388100600 msgr2=0x7ff388106ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:10.647 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:10.642+0000 7ff38f978700 1 --2- 172.21.15.96:0/753267089 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff388100600 0x7ff388106ea0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7ff38000b0a0 tx=0x7ff38000b3b0 comp rx=0 tx=0).stop 2023-05-08T03:42:10.647 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:10.642+0000 7ff38f978700 1 -- 172.21.15.96:0/753267089 shutdown_connections 2023-05-08T03:42:10.647 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:10.642+0000 7ff38f978700 1 --2- 172.21.15.96:0/753267089 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff388100600 0x7ff388106ea0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:10.647 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:10.642+0000 7ff38f978700 1 --2- 172.21.15.96:0/753267089 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff3880fe9c0 0x7ff3880fedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:10.647 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:10.642+0000 7ff38f978700 1 --2- 172.21.15.96:0/753267089 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3880ffc50 0x7ff3881000c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:10.647 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:10.642+0000 7ff38f978700 1 -- 172.21.15.96:0/753267089 >> 172.21.15.96:0/753267089 conn(0x7ff3880fa000 msgr2=0x7ff3880fc410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:42:10.647 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:10.642+0000 7ff38f978700 1 -- 172.21.15.96:0/753267089 shutdown_connections 2023-05-08T03:42:10.648 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:10.642+0000 7ff38f978700 1 -- 172.21.15.96:0/753267089 wait complete. 2023-05-08T03:42:10.648 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:10.643+0000 7ff38f978700 1 Processor -- start 2023-05-08T03:42:10.648 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:10.643+0000 7ff38f978700 1 -- start start 2023-05-08T03:42:10.648 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:10.643+0000 7ff38f978700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3880fe9c0 0x7ff388195010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:10.648 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:10.643+0000 7ff38f978700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff3880ffc50 0x7ff388195550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:10.648 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:10.643+0000 7ff38f978700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff388100600 0x7ff38819c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:10.648 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:10.643+0000 7ff38f978700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff38819cb90 con 0x7ff388100600 2023-05-08T03:42:10.648 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:10.643+0000 7ff38f978700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff38819ccd0 con 0x7ff3880fe9c0 2023-05-08T03:42:10.649 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:10.643+0000 7ff38f978700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff38819ce60 con 0x7ff3880ffc50 2023-05-08T03:42:10.649 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:10.643+0000 7ff38df15700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff388100600 0x7ff38819c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:10.649 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:10.643+0000 7ff38df15700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff388100600 0x7ff38819c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41772/0 (socket says 172.21.15.96:41772) 2023-05-08T03:42:10.649 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:10.643+0000 7ff38df15700 1 -- 172.21.15.96:0/3564587888 learned_addr learned my addr 172.21.15.96:0/3564587888 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:42:10.649 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:10.643+0000 7ff38d714700 1 --2- 172.21.15.96:0/3564587888 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3880fe9c0 0x7ff388195010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:10.649 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:10.643+0000 7ff38df15700 1 -- 172.21.15.96:0/3564587888 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff3880ffc50 msgr2=0x7ff388195550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:10.649 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:10.643+0000 7ff38df15700 1 --2- 172.21.15.96:0/3564587888 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff3880ffc50 0x7ff388195550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:10.650 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:10.643+0000 7ff38df15700 1 -- 172.21.15.96:0/3564587888 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3880fe9c0 msgr2=0x7ff388195010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:10.650 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:10.643+0000 7ff38df15700 1 --2- 172.21.15.96:0/3564587888 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3880fe9c0 0x7ff388195010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:10.650 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:10.643+0000 7ff38df15700 1 -- 172.21.15.96:0/3564587888 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff380009d00 con 0x7ff388100600 2023-05-08T03:42:10.650 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:10.643+0000 7ff38d714700 1 --2- 172.21.15.96:0/3564587888 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3880fe9c0 0x7ff388195010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-08T03:42:10.650 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:10.643+0000 7ff38df15700 1 --2- 172.21.15.96:0/3564587888 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff388100600 0x7ff38819c5c0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7ff3800062a0 tx=0x7ff380004db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:42:10.650 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:10.643+0000 7ff37e7fc700 1 -- 172.21.15.96:0/3564587888 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38000e040 con 0x7ff388100600 2023-05-08T03:42:10.650 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:10.644+0000 7ff38f978700 1 -- 172.21.15.96:0/3564587888 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff38810a320 con 0x7ff388100600 2023-05-08T03:42:10.650 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:10.644+0000 7ff37e7fc700 1 -- 172.21.15.96:0/3564587888 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff38001db50 con 0x7ff388100600 2023-05-08T03:42:10.651 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:10.644+0000 7ff37e7fc700 1 -- 172.21.15.96:0/3564587888 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38001bc40 con 0x7ff388100600 2023-05-08T03:42:10.651 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:10.644+0000 7ff38f978700 1 -- 172.21.15.96:0/3564587888 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff38810a190 con 0x7ff388100600 2023-05-08T03:42:10.651 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:10.644+0000 7ff38f978700 1 -- 172.21.15.96:0/3564587888 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3880fc3a0 con 0x7ff388100600 2023-05-08T03:42:10.652 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:10.645+0000 7ff37e7fc700 1 -- 172.21.15.96:0/3564587888 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7ff38001d690 con 0x7ff388100600 2023-05-08T03:42:10.652 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:10.646+0000 7ff37e7fc700 1 --2- 172.21.15.96:0/3564587888 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7ff3740a1150 0x7ff3740a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:10.652 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:10.646+0000 7ff38d714700 1 --2- 172.21.15.96:0/3564587888 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7ff3740a1150 0x7ff3740a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:10.652 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:10.646+0000 7ff37e7fc700 1 -- 172.21.15.96:0/3564587888 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7ff3800cebb0 con 0x7ff388100600 2023-05-08T03:42:10.652 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:10.646+0000 7ff38d714700 1 --2- 172.21.15.96:0/3564587888 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7ff3740a1150 0x7ff3740a3600 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff384005950 tx=0x7ff3840058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:42:10.653 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:10.650+0000 7ff37e7fc700 1 -- 172.21.15.96:0/3564587888 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7ff380098430 con 0x7ff388100600 2023-05-08T03:42:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:10 smithi133 ceph-mon[125939]: pgmap v300: 97 pgs: 97 active+clean; 636 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T03:42:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:10 smithi096 ceph-mon[124666]: pgmap v300: 97 pgs: 97 active+clean; 636 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T03:42:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:10 smithi186 ceph-mon[126480]: pgmap v300: 97 pgs: 97 active+clean; 636 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T03:42:10.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:10.894+0000 7ff38f978700 1 -- 172.21.15.96:0/3564587888 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7ff3881064b0 con 0x7ff388100600 2023-05-08T03:42:11.393 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.390+0000 7ff37e7fc700 1 -- 172.21.15.96:0/3564587888 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mgrmap(e 19) v1 ==== 135732+0+0 (secure 0 0 0) 0x7ff38001bda0 con 0x7ff388100600 2023-05-08T03:42:11.394 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.391+0000 7ff37e7fc700 1 -- 172.21.15.96:0/3564587888 <== mon.0 v2:172.21.15.96:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v19) v1 ==== 92+0+0 (secure 0 0 0) 0x7ff380092f20 con 0x7ff388100600 2023-05-08T03:42:11.396 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.393+0000 7ff38f978700 1 -- 172.21.15.96:0/3564587888 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7ff3740a1150 msgr2=0x7ff3740a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:11.397 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.394+0000 7ff38f978700 1 --2- 172.21.15.96:0/3564587888 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7ff3740a1150 0x7ff3740a3600 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff384005950 tx=0x7ff3840058e0 comp rx=0 tx=0).stop 2023-05-08T03:42:11.397 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.394+0000 7ff38f978700 1 -- 172.21.15.96:0/3564587888 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff388100600 msgr2=0x7ff38819c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:11.397 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.394+0000 7ff38f978700 1 --2- 172.21.15.96:0/3564587888 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff388100600 0x7ff38819c5c0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7ff3800062a0 tx=0x7ff380004db0 comp rx=0 tx=0).stop 2023-05-08T03:42:11.398 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.394+0000 7ff38f978700 1 -- 172.21.15.96:0/3564587888 shutdown_connections 2023-05-08T03:42:11.398 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.394+0000 7ff38f978700 1 --2- 172.21.15.96:0/3564587888 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7ff3740a1150 0x7ff3740a3600 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:11.398 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.394+0000 7ff38f978700 1 --2- 172.21.15.96:0/3564587888 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff388100600 0x7ff38819c5c0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:11.398 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.394+0000 7ff38f978700 1 --2- 172.21.15.96:0/3564587888 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3880fe9c0 0x7ff388195010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:11.398 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.394+0000 7ff38f978700 1 --2- 172.21.15.96:0/3564587888 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff3880ffc50 0x7ff388195550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:11.398 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.394+0000 7ff38f978700 1 -- 172.21.15.96:0/3564587888 >> 172.21.15.96:0/3564587888 conn(0x7ff3880fa000 msgr2=0x7ff388103710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:42:11.398 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.394+0000 7ff38f978700 1 -- 172.21.15.96:0/3564587888 shutdown_connections 2023-05-08T03:42:11.399 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.394+0000 7ff38f978700 1 -- 172.21.15.96:0/3564587888 wait complete. 2023-05-08T03:42:11.410 DEBUG:teuthology.orchestra.run.smithi096:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/allow_m_granularity true' 2023-05-08T03:42:11.542 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.539+0000 7f65c2c8b700 1 -- 172.21.15.96:0/1479629939 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65bc105f00 msgr2=0x7f65bc1083b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:11.542 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.539+0000 7f65c2c8b700 1 --2- 172.21.15.96:0/1479629939 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65bc105f00 0x7f65bc1083b0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f65b400b0a0 tx=0x7f65b400b3b0 comp rx=0 tx=0).stop 2023-05-08T03:42:11.542 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.539+0000 7f65c2c8b700 1 -- 172.21.15.96:0/1479629939 shutdown_connections 2023-05-08T03:42:11.542 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.539+0000 7f65c2c8b700 1 --2- 172.21.15.96:0/1479629939 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65bc105f00 0x7f65bc1083b0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:11.543 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.539+0000 7f65c2c8b700 1 --2- 172.21.15.96:0/1479629939 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65bc06a020 0x7f65bc102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:11.543 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.539+0000 7f65c2c8b700 1 --2- 172.21.15.96:0/1479629939 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f65bc1033f0 0x7f65bc105870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:11.543 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.539+0000 7f65c2c8b700 1 -- 172.21.15.96:0/1479629939 >> 172.21.15.96:0/1479629939 conn(0x7f65bc0fa820 msgr2=0x7f65bc0fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:42:11.543 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.539+0000 7f65c2c8b700 1 -- 172.21.15.96:0/1479629939 shutdown_connections 2023-05-08T03:42:11.543 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.539+0000 7f65c2c8b700 1 -- 172.21.15.96:0/1479629939 wait complete. 2023-05-08T03:42:11.545 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.540+0000 7f65c2c8b700 1 Processor -- start 2023-05-08T03:42:11.545 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.540+0000 7f65c2c8b700 1 -- start start 2023-05-08T03:42:11.545 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.540+0000 7f65c2c8b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65bc06a020 0x7f65bc1961c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:11.546 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.540+0000 7f65c2c8b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65bc1033f0 0x7f65bc196700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:11.546 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.540+0000 7f65c2c8b700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f65bc105f00 0x7f65bc19d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:11.546 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.540+0000 7f65c2c8b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65bc19dd40 con 0x7f65bc06a020 2023-05-08T03:42:11.546 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.540+0000 7f65c2c8b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65bc19de80 con 0x7f65bc1033f0 2023-05-08T03:42:11.546 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.540+0000 7f65c2c8b700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65bc19e010 con 0x7f65bc105f00 2023-05-08T03:42:11.546 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.540+0000 7f65c0a27700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65bc06a020 0x7f65bc1961c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:11.546 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.540+0000 7f65c0a27700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65bc06a020 0x7f65bc1961c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41808/0 (socket says 172.21.15.96:41808) 2023-05-08T03:42:11.547 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.540+0000 7f65c0a27700 1 -- 172.21.15.96:0/2740837071 learned_addr learned my addr 172.21.15.96:0/2740837071 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:42:11.547 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.540+0000 7f65bbfff700 1 --2- 172.21.15.96:0/2740837071 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65bc1033f0 0x7f65bc196700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:11.547 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.540+0000 7f65c1228700 1 --2- 172.21.15.96:0/2740837071 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f65bc105f00 0x7f65bc19d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:11.547 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.541+0000 7f65c0a27700 1 -- 172.21.15.96:0/2740837071 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f65bc105f00 msgr2=0x7f65bc19d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:11.547 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.541+0000 7f65c0a27700 1 --2- 172.21.15.96:0/2740837071 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f65bc105f00 0x7f65bc19d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:11.547 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.541+0000 7f65c0a27700 1 -- 172.21.15.96:0/2740837071 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65bc1033f0 msgr2=0x7f65bc196700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:11.547 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.541+0000 7f65c0a27700 1 --2- 172.21.15.96:0/2740837071 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65bc1033f0 0x7f65bc196700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:11.548 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.541+0000 7f65c0a27700 1 -- 172.21.15.96:0/2740837071 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65b4009d00 con 0x7f65bc06a020 2023-05-08T03:42:11.548 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.541+0000 7f65c0a27700 1 --2- 172.21.15.96:0/2740837071 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65bc06a020 0x7f65bc1961c0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f65b000d980 tx=0x7f65b000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:42:11.548 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.541+0000 7f65b9ffb700 1 -- 172.21.15.96:0/2740837071 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b000f890 con 0x7f65bc06a020 2023-05-08T03:42:11.548 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.541+0000 7f65b9ffb700 1 -- 172.21.15.96:0/2740837071 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f65b0010460 con 0x7f65bc06a020 2023-05-08T03:42:11.548 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.541+0000 7f65c2c8b700 1 -- 172.21.15.96:0/2740837071 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65bc10bca0 con 0x7f65bc06a020 2023-05-08T03:42:11.548 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.541+0000 7f65b9ffb700 1 -- 172.21.15.96:0/2740837071 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b000e610 con 0x7f65bc06a020 2023-05-08T03:42:11.548 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.541+0000 7f65c2c8b700 1 -- 172.21.15.96:0/2740837071 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65bc10bb10 con 0x7f65bc06a020 2023-05-08T03:42:11.548 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.542+0000 7f65c2c8b700 1 -- 172.21.15.96:0/2740837071 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65bc0fc390 con 0x7f65bc06a020 2023-05-08T03:42:11.549 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.543+0000 7f65b9ffb700 1 -- 172.21.15.96:0/2740837071 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 19) v1 ==== 135732+0+0 (secure 0 0 0) 0x7f65b00105d0 con 0x7f65bc06a020 2023-05-08T03:42:11.549 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.543+0000 7f65b9ffb700 1 --2- 172.21.15.96:0/2740837071 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f65ac0a1220 0x7f65ac0a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:11.550 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.544+0000 7f65bbfff700 1 -- 172.21.15.96:0/2740837071 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f65ac0a1220 msgr2=0x7f65ac0a36d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:6800/2748629182 2023-05-08T03:42:11.550 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.544+0000 7f65b9ffb700 1 -- 172.21.15.96:0/2740837071 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f65b00cc360 con 0x7f65bc06a020 2023-05-08T03:42:11.550 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.544+0000 7f65bbfff700 1 --2- 172.21.15.96:0/2740837071 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f65ac0a1220 0x7f65ac0a36d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-05-08T03:42:11.550 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.548+0000 7f65b9ffb700 1 -- 172.21.15.96:0/2740837071 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f65b0095ab0 con 0x7f65bc06a020 2023-05-08T03:42:11.638 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:11 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/3564587888' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2023-05-08T03:42:11.639 INFO:journalctl@ceph.mgr.z.smithi186.stdout:May 08 03:42:11 smithi186 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-z[128521]: ignoring --setuser ceph since I am not root 2023-05-08T03:42:11.639 INFO:journalctl@ceph.mgr.z.smithi186.stdout:May 08 03:42:11 smithi186 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-z[128521]: ignoring --setgroup ceph since I am not root 2023-05-08T03:42:11.639 INFO:journalctl@ceph.mgr.z.smithi186.stdout:May 08 03:42:11 smithi186 ceph-mgr[128607]: -- 172.21.15.186:0/88867554 <== mon.1 v2:172.21.15.186:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55a8c063cb60 con 0x55a8c0613000 2023-05-08T03:42:11.639 INFO:journalctl@ceph.mgr.z.smithi186.stdout:May 08 03:42:11 smithi186 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-z[128521]: 2023-05-08T03:42:11.556+0000 7f45dffc4200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-05-08T03:42:11.639 INFO:journalctl@ceph.mgr.z.smithi186.stdout:May 08 03:42:11 smithi186 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-z[128521]: 2023-05-08T03:42:11.635+0000 7f45dffc4200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-08T03:42:11.640 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:11 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/3564587888' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2023-05-08T03:42:11.640 INFO:journalctl@ceph.mgr.y.smithi133.stdout:May 08 03:42:11 smithi133 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-y[127385]: ignoring --setuser ceph since I am not root 2023-05-08T03:42:11.640 INFO:journalctl@ceph.mgr.y.smithi133.stdout:May 08 03:42:11 smithi133 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-y[127385]: ignoring --setgroup ceph since I am not root 2023-05-08T03:42:11.640 INFO:journalctl@ceph.mgr.y.smithi133.stdout:May 08 03:42:11 smithi133 ceph-mgr[127409]: -- 172.21.15.133:0/4090086070 <== mon.2 v2:172.21.15.133:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5559d469eb60 con 0x5559d4675000 2023-05-08T03:42:11.641 INFO:journalctl@ceph.mgr.y.smithi133.stdout:May 08 03:42:11 smithi133 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-y[127385]: 2023-05-08T03:42:11.557+0000 7f69965ec200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-05-08T03:42:11.645 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:11 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/3564587888' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2023-05-08T03:42:11.645 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:42:11 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: ignoring --setuser ceph since I am not root 2023-05-08T03:42:11.646 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:42:11 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: ignoring --setgroup ceph since I am not root 2023-05-08T03:42:11.646 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:42:11 smithi096 ceph-mgr[124935]: -- 172.21.15.96:0/3115106932 <== mon.0 v2:172.21.15.96:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x560af0e7eb60 con 0x560af0e54800 2023-05-08T03:42:11.646 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:42:11 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:42:11.560+0000 7f1460830200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-05-08T03:42:11.646 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:42:11 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:42:11.642+0000 7f1460830200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-08T03:42:11.746 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.744+0000 7f65c2c8b700 1 -- 172.21.15.96:0/2740837071 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f65bc02d0e0 con 0x7f65bc06a020 2023-05-08T03:42:11.747 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.745+0000 7f65bbfff700 1 -- 172.21.15.96:0/2740837071 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f65ac0a1220 msgr2=0x7f65ac0a36d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:6800/2748629182 2023-05-08T03:42:11.747 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.745+0000 7f65bbfff700 1 --2- 172.21.15.96:0/2740837071 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f65ac0a1220 0x7f65ac0a36d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-05-08T03:42:11.752 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.750+0000 7f65b9ffb700 1 -- 172.21.15.96:0/2740837071 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v23)=0 v23) v1 ==== 138+0+0 (secure 0 0 0) 0x7f65b00990d0 con 0x7f65bc06a020 2023-05-08T03:42:11.755 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.752+0000 7f65c2c8b700 1 -- 172.21.15.96:0/2740837071 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f65ac0a1220 msgr2=0x7f65ac0a36d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-08T03:42:11.755 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.752+0000 7f65c2c8b700 1 --2- 172.21.15.96:0/2740837071 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f65ac0a1220 0x7f65ac0a36d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:11.755 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.752+0000 7f65c2c8b700 1 -- 172.21.15.96:0/2740837071 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65bc06a020 msgr2=0x7f65bc1961c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:11.755 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.752+0000 7f65c2c8b700 1 --2- 172.21.15.96:0/2740837071 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65bc06a020 0x7f65bc1961c0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f65b000d980 tx=0x7f65b000dc90 comp rx=0 tx=0).stop 2023-05-08T03:42:11.756 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.752+0000 7f65c2c8b700 1 -- 172.21.15.96:0/2740837071 shutdown_connections 2023-05-08T03:42:11.756 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.752+0000 7f65c2c8b700 1 --2- 172.21.15.96:0/2740837071 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f65ac0a1220 0x7f65ac0a36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:11.756 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.752+0000 7f65c2c8b700 1 --2- 172.21.15.96:0/2740837071 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f65bc105f00 0x7f65bc19d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:11.756 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.752+0000 7f65c2c8b700 1 --2- 172.21.15.96:0/2740837071 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65bc06a020 0x7f65bc1961c0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:11.756 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.752+0000 7f65c2c8b700 1 --2- 172.21.15.96:0/2740837071 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65bc1033f0 0x7f65bc196700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:11.756 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.753+0000 7f65c2c8b700 1 -- 172.21.15.96:0/2740837071 >> 172.21.15.96:0/2740837071 conn(0x7f65bc0fa820 msgr2=0x7f65bc1017b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:42:11.756 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.753+0000 7f65c2c8b700 1 -- 172.21.15.96:0/2740837071 shutdown_connections 2023-05-08T03:42:11.757 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.753+0000 7f65c2c8b700 1 -- 172.21.15.96:0/2740837071 wait complete. 2023-05-08T03:42:11.768 DEBUG:teuthology.orchestra.run.smithi096:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/dump_on_update true' 2023-05-08T03:42:11.897 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.891+0000 7f529cf00700 1 -- 172.21.15.96:0/3167977266 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5298100e40 msgr2=0x7f5298103220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:11.898 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.891+0000 7f529cf00700 1 --2- 172.21.15.96:0/3167977266 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5298100e40 0x7f5298103220 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f5288009990 tx=0x7f5288009ca0 comp rx=0 tx=0).stop 2023-05-08T03:42:11.898 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.891+0000 7f529cf00700 1 -- 172.21.15.96:0/3167977266 shutdown_connections 2023-05-08T03:42:11.898 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.891+0000 7f529cf00700 1 --2- 172.21.15.96:0/3167977266 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5298106080 0x7f5298108460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:11.898 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.891+0000 7f529cf00700 1 --2- 172.21.15.96:0/3167977266 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5298100e40 0x7f5298103220 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:11.899 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.891+0000 7f529cf00700 1 --2- 172.21.15.96:0/3167977266 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5298103760 0x7f5298105b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:11.899 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.891+0000 7f529cf00700 1 -- 172.21.15.96:0/3167977266 >> 172.21.15.96:0/3167977266 conn(0x7f52980fa820 msgr2=0x7f52980fcc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:42:11.899 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.891+0000 7f529cf00700 1 -- 172.21.15.96:0/3167977266 shutdown_connections 2023-05-08T03:42:11.899 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.891+0000 7f529cf00700 1 -- 172.21.15.96:0/3167977266 wait complete. 2023-05-08T03:42:11.899 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.892+0000 7f529cf00700 1 Processor -- start 2023-05-08T03:42:11.899 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.892+0000 7f529cf00700 1 -- start start 2023-05-08T03:42:11.899 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.892+0000 7f529cf00700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5298100e40 0x7f52981960c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:11.900 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.892+0000 7f529cf00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5298103760 0x7f5298196600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:11.900 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.892+0000 7f529cf00700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5298106080 0x7f529819d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:11.900 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.892+0000 7f529cf00700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f529819dc40 con 0x7f5298100e40 2023-05-08T03:42:11.900 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.892+0000 7f529cf00700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f529819dd80 con 0x7f5298106080 2023-05-08T03:42:11.900 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.892+0000 7f529cf00700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f529819df10 con 0x7f5298103760 2023-05-08T03:42:11.901 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.892+0000 7f529659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5298100e40 0x7f52981960c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:11.901 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.892+0000 7f529659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5298100e40 0x7f52981960c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41848/0 (socket says 172.21.15.96:41848) 2023-05-08T03:42:11.901 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.892+0000 7f529659c700 1 -- 172.21.15.96:0/2746266732 learned_addr learned my addr 172.21.15.96:0/2746266732 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:42:11.901 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.893+0000 7f5295d9b700 1 --2- 172.21.15.96:0/2746266732 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5298103760 0x7f5298196600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:11.901 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.893+0000 7f5296d9d700 1 --2- 172.21.15.96:0/2746266732 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5298106080 0x7f529819d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:11.901 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.893+0000 7f5295d9b700 1 -- 172.21.15.96:0/2746266732 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5298106080 msgr2=0x7f529819d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:11.901 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.893+0000 7f5295d9b700 1 --2- 172.21.15.96:0/2746266732 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5298106080 0x7f529819d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:11.902 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.893+0000 7f5295d9b700 1 -- 172.21.15.96:0/2746266732 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5298100e40 msgr2=0x7f52981960c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:11.902 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.893+0000 7f5295d9b700 1 --2- 172.21.15.96:0/2746266732 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5298100e40 0x7f52981960c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:11.902 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.893+0000 7f5295d9b700 1 -- 172.21.15.96:0/2746266732 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52880095f0 con 0x7f5298103760 2023-05-08T03:42:11.902 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.893+0000 7f5295d9b700 1 --2- 172.21.15.96:0/2746266732 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5298103760 0x7f5298196600 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f528c00d750 tx=0x7f528c00da60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:42:11.902 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.893+0000 7f52877fe700 1 -- 172.21.15.96:0/2746266732 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f528c004020 con 0x7f5298103760 2023-05-08T03:42:11.902 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.893+0000 7f52877fe700 1 -- 172.21.15.96:0/2746266732 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f528c004830 con 0x7f5298103760 2023-05-08T03:42:11.902 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.893+0000 7f529cf00700 1 -- 172.21.15.96:0/2746266732 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f529810bcf0 con 0x7f5298103760 2023-05-08T03:42:11.903 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.893+0000 7f52877fe700 1 -- 172.21.15.96:0/2746266732 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f528c0054c0 con 0x7f5298103760 2023-05-08T03:42:11.903 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.893+0000 7f529cf00700 1 -- 172.21.15.96:0/2746266732 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f529810bb60 con 0x7f5298103760 2023-05-08T03:42:11.903 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.894+0000 7f529cf00700 1 -- 172.21.15.96:0/2746266732 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52980fc390 con 0x7f5298103760 2023-05-08T03:42:11.904 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.895+0000 7f52877fe700 1 -- 172.21.15.96:0/2746266732 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 19) v1 ==== 135732+0+0 (secure 0 0 0) 0x7f528c0049a0 con 0x7f5298103760 2023-05-08T03:42:11.904 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.896+0000 7f52877fe700 1 --2- 172.21.15.96:0/2746266732 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f52800a1220 0x7f52800a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:11.904 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.896+0000 7f529659c700 1 -- 172.21.15.96:0/2746266732 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f52800a1220 msgr2=0x7f52800a36d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:6800/2748629182 2023-05-08T03:42:11.904 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.896+0000 7f52877fe700 1 -- 172.21.15.96:0/2746266732 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f528c0cc2c0 con 0x7f5298103760 2023-05-08T03:42:11.905 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.896+0000 7f529659c700 1 --2- 172.21.15.96:0/2746266732 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f52800a1220 0x7f52800a36d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-05-08T03:42:11.905 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:11.899+0000 7f52877fe700 1 -- 172.21.15.96:0/2746266732 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f528c095a10 con 0x7f5298103760 2023-05-08T03:42:11.989 INFO:journalctl@ceph.mgr.z.smithi186.stdout:May 08 03:42:11 smithi186 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-z[128521]: 2023-05-08T03:42:11.723+0000 7f45dffc4200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-08T03:42:11.989 INFO:journalctl@ceph.mgr.z.smithi186.stdout:May 08 03:42:11 smithi186 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-z[128521]: 2023-05-08T03:42:11.817+0000 7f45dffc4200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-08T03:42:11.990 INFO:journalctl@ceph.mgr.y.smithi133.stdout:May 08 03:42:11 smithi133 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-y[127385]: 2023-05-08T03:42:11.636+0000 7f69965ec200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-08T03:42:11.990 INFO:journalctl@ceph.mgr.y.smithi133.stdout:May 08 03:42:11 smithi133 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-y[127385]: 2023-05-08T03:42:11.724+0000 7f69965ec200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-08T03:42:11.990 INFO:journalctl@ceph.mgr.y.smithi133.stdout:May 08 03:42:11 smithi133 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-y[127385]: 2023-05-08T03:42:11.818+0000 7f69965ec200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-08T03:42:12.005 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:42:11 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:42:11.733+0000 7f1460830200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-08T03:42:12.005 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:42:11 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:42:11.833+0000 7f1460830200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-08T03:42:12.100 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:12.097+0000 7f529cf00700 1 -- 172.21.15.96:0/2746266732 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f5298061800 con 0x7f5298103760 2023-05-08T03:42:12.100 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:12.097+0000 7f529659c700 1 -- 172.21.15.96:0/2746266732 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f52800a1220 msgr2=0x7f52800a36d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:6800/2748629182 2023-05-08T03:42:12.100 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:12.097+0000 7f529659c700 1 --2- 172.21.15.96:0/2746266732 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f52800a1220 0x7f52800a36d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-05-08T03:42:12.106 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:12.104+0000 7f52877fe700 1 -- 172.21.15.96:0/2746266732 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v24)=0 v24) v1 ==== 133+0+0 (secure 0 0 0) 0x7f528c099030 con 0x7f5298103760 2023-05-08T03:42:12.109 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:12.106+0000 7f529cf00700 1 -- 172.21.15.96:0/2746266732 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f52800a1220 msgr2=0x7f52800a36d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-08T03:42:12.110 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:12.106+0000 7f529cf00700 1 --2- 172.21.15.96:0/2746266732 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f52800a1220 0x7f52800a36d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:12.110 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:12.106+0000 7f529cf00700 1 -- 172.21.15.96:0/2746266732 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5298103760 msgr2=0x7f5298196600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:12.110 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:12.106+0000 7f529cf00700 1 --2- 172.21.15.96:0/2746266732 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5298103760 0x7f5298196600 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f528c00d750 tx=0x7f528c00da60 comp rx=0 tx=0).stop 2023-05-08T03:42:12.110 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:12.106+0000 7f529cf00700 1 -- 172.21.15.96:0/2746266732 shutdown_connections 2023-05-08T03:42:12.110 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:12.106+0000 7f529cf00700 1 --2- 172.21.15.96:0/2746266732 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f52800a1220 0x7f52800a36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:12.110 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:12.106+0000 7f529cf00700 1 --2- 172.21.15.96:0/2746266732 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5298106080 0x7f529819d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:12.110 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:12.106+0000 7f529cf00700 1 --2- 172.21.15.96:0/2746266732 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5298100e40 0x7f52981960c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:12.111 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:12.106+0000 7f529cf00700 1 --2- 172.21.15.96:0/2746266732 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5298103760 0x7f5298196600 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:12.111 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:12.106+0000 7f529cf00700 1 -- 172.21.15.96:0/2746266732 >> 172.21.15.96:0/2746266732 conn(0x7f52980fa820 msgr2=0x7f5298101aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:42:12.111 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:12.106+0000 7f529cf00700 1 -- 172.21.15.96:0/2746266732 shutdown_connections 2023-05-08T03:42:12.111 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:12.106+0000 7f529cf00700 1 -- 172.21.15.96:0/2746266732 wait complete. 2023-05-08T03:42:12.121 DEBUG:teuthology.orchestra.run.smithi096:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1M' 2023-05-08T03:42:12.240 INFO:journalctl@ceph.mgr.y.smithi133.stdout:May 08 03:42:11 smithi133 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-y[127385]: 2023-05-08T03:42:11.987+0000 7f69965ec200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-08T03:42:12.247 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:12.243+0000 7f5d6791b700 1 -- 172.21.15.96:0/1337314539 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d60106060 msgr2=0x7f5d60108460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:12.247 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:12.243+0000 7f5d6791b700 1 --2- 172.21.15.96:0/1337314539 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d60106060 0x7f5d60108460 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f5d5800b0a0 tx=0x7f5d5800b3b0 comp rx=0 tx=0).stop 2023-05-08T03:42:12.247 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:12.243+0000 7f5d6791b700 1 -- 172.21.15.96:0/1337314539 shutdown_connections 2023-05-08T03:42:12.248 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:12.243+0000 7f5d6791b700 1 --2- 172.21.15.96:0/1337314539 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d60106060 0x7f5d60108460 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:12.248 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:12.243+0000 7f5d6791b700 1 --2- 172.21.15.96:0/1337314539 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d60100e20 0x7f5d60103200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:12.248 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:12.243+0000 7f5d6791b700 1 --2- 172.21.15.96:0/1337314539 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5d60103740 0x7f5d60105b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:12.248 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:12.243+0000 7f5d6791b700 1 -- 172.21.15.96:0/1337314539 >> 172.21.15.96:0/1337314539 conn(0x7f5d600fa820 msgr2=0x7f5d600fcc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:42:12.248 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:12.243+0000 7f5d6791b700 1 -- 172.21.15.96:0/1337314539 shutdown_connections 2023-05-08T03:42:12.248 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:12.243+0000 7f5d6791b700 1 -- 172.21.15.96:0/1337314539 wait complete. 2023-05-08T03:42:12.249 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:12.243+0000 7f5d6791b700 1 Processor -- start 2023-05-08T03:42:12.249 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:12.244+0000 7f5d6791b700 1 -- start start 2023-05-08T03:42:12.249 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:12.244+0000 7f5d6791b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d60100e20 0x7f5d60100790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:12.249 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:12.244+0000 7f5d6791b700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5d60103740 0x7f5d600fedd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:12.249 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:12.244+0000 7f5d6791b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d60106060 0x7f5d600ff310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:12.249 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:12.244+0000 7f5d6791b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d600ffab0 con 0x7f5d60106060 2023-05-08T03:42:12.249 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:12.244+0000 7f5d6791b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d600ffc20 con 0x7f5d60100e20 2023-05-08T03:42:12.249 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:12.244+0000 7f5d6791b700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d601a0250 con 0x7f5d60103740 2023-05-08T03:42:12.250 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:12.244+0000 7f5d65eb8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d60106060 0x7f5d600ff310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:12.250 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:12.244+0000 7f5d65eb8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d60106060 0x7f5d600ff310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:41906/0 (socket says 172.21.15.96:41906) 2023-05-08T03:42:12.250 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:12.244+0000 7f5d65eb8700 1 -- 172.21.15.96:0/3973663730 learned_addr learned my addr 172.21.15.96:0/3973663730 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:42:12.250 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:12.244+0000 7f5d656b7700 1 --2- 172.21.15.96:0/3973663730 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d60100e20 0x7f5d60100790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:12.250 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:12.244+0000 7f5d64eb6700 1 --2- 172.21.15.96:0/3973663730 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5d60103740 0x7f5d600fedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:12.250 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:12.244+0000 7f5d65eb8700 1 -- 172.21.15.96:0/3973663730 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5d60103740 msgr2=0x7f5d600fedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:12.250 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:12.244+0000 7f5d65eb8700 1 --2- 172.21.15.96:0/3973663730 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5d60103740 0x7f5d600fedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:12.251 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:12.244+0000 7f5d65eb8700 1 -- 172.21.15.96:0/3973663730 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d60100e20 msgr2=0x7f5d60100790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:12.251 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:12.244+0000 7f5d65eb8700 1 --2- 172.21.15.96:0/3973663730 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d60100e20 0x7f5d60100790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:12.251 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:12.244+0000 7f5d65eb8700 1 -- 172.21.15.96:0/3973663730 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d58009d00 con 0x7f5d60106060 2023-05-08T03:42:12.251 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:12.244+0000 7f5d656b7700 1 --2- 172.21.15.96:0/3973663730 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d60100e20 0x7f5d60100790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-08T03:42:12.251 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:12.244+0000 7f5d65eb8700 1 --2- 172.21.15.96:0/3973663730 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d60106060 0x7f5d600ff310 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f5d5800b070 tx=0x7f5d580075c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:42:12.251 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:12.244+0000 7f5d567fc700 1 -- 172.21.15.96:0/3973663730 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5800e040 con 0x7f5d60106060 2023-05-08T03:42:12.251 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:12.245+0000 7f5d567fc700 1 -- 172.21.15.96:0/3973663730 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5d5800bcc0 con 0x7f5d60106060 2023-05-08T03:42:12.251 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:12.245+0000 7f5d6791b700 1 -- 172.21.15.96:0/3973663730 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d6010bd00 con 0x7f5d60106060 2023-05-08T03:42:12.252 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:12.245+0000 7f5d567fc700 1 -- 172.21.15.96:0/3973663730 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5801ddb0 con 0x7f5d60106060 2023-05-08T03:42:12.252 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:12.245+0000 7f5d6791b700 1 -- 172.21.15.96:0/3973663730 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d6010bb70 con 0x7f5d60106060 2023-05-08T03:42:12.253 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:12.245+0000 7f5d6791b700 1 -- 172.21.15.96:0/3973663730 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d600fc390 con 0x7f5d60106060 2023-05-08T03:42:12.253 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:12.247+0000 7f5d567fc700 1 -- 172.21.15.96:0/3973663730 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 19) v1 ==== 135732+0+0 (secure 0 0 0) 0x7f5d58004aa0 con 0x7f5d60106060 2023-05-08T03:42:12.253 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:12.247+0000 7f5d567fc700 1 --2- 172.21.15.96:0/3973663730 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f5d4c0a11a0 0x7f5d4c0a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:12.253 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:12.247+0000 7f5d656b7700 1 -- 172.21.15.96:0/3973663730 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f5d4c0a11a0 msgr2=0x7f5d4c0a3650 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:6800/2748629182 2023-05-08T03:42:12.253 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:12.247+0000 7f5d567fc700 1 -- 172.21.15.96:0/3973663730 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f5d580cdcb0 con 0x7f5d60106060 2023-05-08T03:42:12.253 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:12.247+0000 7f5d656b7700 1 --2- 172.21.15.96:0/3973663730 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f5d4c0a11a0 0x7f5d4c0a3650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-05-08T03:42:12.257 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:12.255+0000 7f5d567fc700 1 -- 172.21.15.96:0/3973663730 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f5d58097530 con 0x7f5d60106060 2023-05-08T03:42:12.296 INFO:journalctl@ceph.mgr.z.smithi186.stdout:May 08 03:42:11 smithi186 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-z[128521]: 2023-05-08T03:42:11.985+0000 7f45dffc4200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-08T03:42:12.337 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:42:12 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:42:12.011+0000 7f1460830200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-08T03:42:12.450 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:12.448+0000 7f5d656b7700 1 -- 172.21.15.96:0/3973663730 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f5d4c0a11a0 msgr2=0x7f5d4c0a3650 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:6800/2748629182 2023-05-08T03:42:12.451 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:12.448+0000 7f5d656b7700 1 --2- 172.21.15.96:0/3973663730 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f5d4c0a11a0 0x7f5d4c0a3650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-05-08T03:42:12.479 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:12.477+0000 7f5d6791b700 1 -- 172.21.15.96:0/3973663730 --> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f5d60061be0 con 0x7f5d4c0a11a0 2023-05-08T03:42:12.609 INFO:journalctl@ceph.mgr.z.smithi186.stdout:May 08 03:42:12 smithi186 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-z[128521]: 2023-05-08T03:42:12.293+0000 7f45dffc4200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-08T03:42:12.609 INFO:journalctl@ceph.mgr.z.smithi186.stdout:May 08 03:42:12 smithi186 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-z[128521]: 2023-05-08T03:42:12.382+0000 7f45dffc4200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-08T03:42:12.609 INFO:journalctl@ceph.mgr.z.smithi186.stdout:May 08 03:42:12 smithi186 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-z[128521]: 2023-05-08T03:42:12.512+0000 7f45dffc4200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-08T03:42:12.609 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:12 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/3564587888' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2023-05-08T03:42:12.610 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:12 smithi186 ceph-mon[126480]: mgrmap e19: x(active, since 7m), standbys: z, y 2023-05-08T03:42:12.610 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:12 smithi186 ceph-mon[126480]: from='client.? 172.21.15.96:0/2740837071' entity='client.admin' 2023-05-08T03:42:12.610 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:12 smithi186 ceph-mon[126480]: from='client.? ' entity='client.admin' 2023-05-08T03:42:12.611 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:12 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/3564587888' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2023-05-08T03:42:12.612 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:12 smithi133 ceph-mon[125939]: mgrmap e19: x(active, since 7m), standbys: z, y 2023-05-08T03:42:12.612 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:12 smithi133 ceph-mon[125939]: from='client.? 172.21.15.96:0/2740837071' entity='client.admin' 2023-05-08T03:42:12.612 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:12 smithi133 ceph-mon[125939]: from='client.? ' entity='client.admin' 2023-05-08T03:42:12.612 INFO:journalctl@ceph.mgr.y.smithi133.stdout:May 08 03:42:12 smithi133 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-y[127385]: 2023-05-08T03:42:12.294+0000 7f69965ec200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-08T03:42:12.612 INFO:journalctl@ceph.mgr.y.smithi133.stdout:May 08 03:42:12 smithi133 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-y[127385]: 2023-05-08T03:42:12.383+0000 7f69965ec200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-08T03:42:12.612 INFO:journalctl@ceph.mgr.y.smithi133.stdout:May 08 03:42:12 smithi133 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-y[127385]: 2023-05-08T03:42:12.515+0000 7f69965ec200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-08T03:42:12.657 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:42:12 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:42:12.335+0000 7f1460830200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-08T03:42:12.658 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:42:12 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:42:12.428+0000 7f1460830200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-08T03:42:12.658 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:42:12 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:42:12.560+0000 7f1460830200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-08T03:42:12.658 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:12 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/3564587888' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2023-05-08T03:42:12.658 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:12 smithi096 ceph-mon[124666]: mgrmap e19: x(active, since 7m), standbys: z, y 2023-05-08T03:42:12.658 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:12 smithi096 ceph-mon[124666]: from='client.? 172.21.15.96:0/2740837071' entity='client.admin' 2023-05-08T03:42:12.659 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:12 smithi096 ceph-mon[124666]: from='client.? ' entity='client.admin' 2023-05-08T03:42:12.851 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:12.849+0000 7f5d656b7700 1 -- 172.21.15.96:0/3973663730 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f5d4c0a11a0 msgr2=0x7f5d4c0a3650 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:6800/2748629182 2023-05-08T03:42:12.851 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:12.849+0000 7f5d656b7700 1 --2- 172.21.15.96:0/3973663730 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f5d4c0a11a0 0x7f5d4c0a3650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-05-08T03:42:12.869 INFO:journalctl@ceph.mgr.z.smithi186.stdout:May 08 03:42:12 smithi186 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-z[128521]: 2023-05-08T03:42:12.605+0000 7f45dffc4200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-08T03:42:13.005 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:42:12 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:42:12.654+0000 7f1460830200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-08T03:42:13.369 INFO:journalctl@ceph.mgr.z.smithi186.stdout:May 08 03:42:13 smithi186 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-z[128521]: 2023-05-08T03:42:13.024+0000 7f45dffc4200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-08T03:42:13.490 INFO:journalctl@ceph.mgr.y.smithi133.stdout:May 08 03:42:12 smithi133 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-y[127385]: 2023-05-08T03:42:12.609+0000 7f69965ec200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-08T03:42:13.490 INFO:journalctl@ceph.mgr.y.smithi133.stdout:May 08 03:42:13 smithi133 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-y[127385]: 2023-05-08T03:42:13.030+0000 7f69965ec200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-08T03:42:13.505 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:42:13 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:42:13.078+0000 7f1460830200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-08T03:42:13.652 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:13.650+0000 7f5d656b7700 1 -- 172.21.15.96:0/3973663730 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f5d4c0a11a0 msgr2=0x7f5d4c0a3650 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:6800/2748629182 2023-05-08T03:42:13.653 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:13.650+0000 7f5d656b7700 1 --2- 172.21.15.96:0/3973663730 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f5d4c0a11a0 0x7f5d4c0a3650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-05-08T03:42:13.869 INFO:journalctl@ceph.mgr.z.smithi186.stdout:May 08 03:42:13 smithi186 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-z[128521]: 2023-05-08T03:42:13.584+0000 7f45dffc4200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-08T03:42:13.869 INFO:journalctl@ceph.mgr.z.smithi186.stdout:May 08 03:42:13 smithi186 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-z[128521]: 2023-05-08T03:42:13.754+0000 7f45dffc4200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-08T03:42:13.993 INFO:journalctl@ceph.mgr.y.smithi133.stdout:May 08 03:42:13 smithi133 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-y[127385]: 2023-05-08T03:42:13.592+0000 7f69965ec200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-08T03:42:13.993 INFO:journalctl@ceph.mgr.y.smithi133.stdout:May 08 03:42:13 smithi133 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-y[127385]: 2023-05-08T03:42:13.763+0000 7f69965ec200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-08T03:42:14.005 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:42:13 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:42:13.638+0000 7f1460830200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-08T03:42:14.005 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:42:13 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:42:13.808+0000 7f1460830200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-08T03:42:14.778 INFO:journalctl@ceph.mgr.z.smithi186.stdout:May 08 03:42:14 smithi186 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-z[128521]: 2023-05-08T03:42:14.513+0000 7f45dffc4200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-08T03:42:14.779 INFO:journalctl@ceph.mgr.z.smithi186.stdout:May 08 03:42:14 smithi186 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-z[128521]: 2023-05-08T03:42:14.604+0000 7f45dffc4200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-05-08T03:42:14.787 INFO:journalctl@ceph.mgr.y.smithi133.stdout:May 08 03:42:14 smithi133 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-y[127385]: 2023-05-08T03:42:14.523+0000 7f69965ec200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-08T03:42:14.787 INFO:journalctl@ceph.mgr.y.smithi133.stdout:May 08 03:42:14 smithi133 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-y[127385]: 2023-05-08T03:42:14.614+0000 7f69965ec200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-05-08T03:42:14.837 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:42:14 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:42:14.569+0000 7f1460830200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-08T03:42:14.837 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:42:14 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:42:14.662+0000 7f1460830200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-05-08T03:42:15.054 INFO:journalctl@ceph.mgr.z.smithi186.stdout:May 08 03:42:14 smithi186 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-z[128521]: 2023-05-08T03:42:14.775+0000 7f45dffc4200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-08T03:42:15.061 INFO:journalctl@ceph.mgr.y.smithi133.stdout:May 08 03:42:14 smithi133 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-y[127385]: 2023-05-08T03:42:14.785+0000 7f69965ec200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-08T03:42:15.254 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:15.251+0000 7f5d656b7700 1 -- 172.21.15.96:0/3973663730 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f5d4c0a11a0 msgr2=0x7f5d4c0a3650 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:6800/2748629182 2023-05-08T03:42:15.254 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:15.251+0000 7f5d656b7700 1 --2- 172.21.15.96:0/3973663730 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f5d4c0a11a0 0x7f5d4c0a3650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-05-08T03:42:15.369 INFO:journalctl@ceph.mgr.z.smithi186.stdout:May 08 03:42:15 smithi186 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-z[128521]: 2023-05-08T03:42:15.051+0000 7f45dffc4200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-05-08T03:42:15.369 INFO:journalctl@ceph.mgr.z.smithi186.stdout:May 08 03:42:15 smithi186 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-z[128521]: 2023-05-08T03:42:15.278+0000 7f45dffc4200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-08T03:42:15.438 INFO:journalctl@ceph.mgr.y.smithi133.stdout:May 08 03:42:15 smithi133 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-y[127385]: 2023-05-08T03:42:15.059+0000 7f69965ec200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-05-08T03:42:15.438 INFO:journalctl@ceph.mgr.y.smithi133.stdout:May 08 03:42:15 smithi133 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-y[127385]: 2023-05-08T03:42:15.287+0000 7f69965ec200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-08T03:42:15.492 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:42:14 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:42:14.834+0000 7f1460830200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-08T03:42:15.492 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:42:15 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:42:15.115+0000 7f1460830200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-05-08T03:42:15.492 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:42:15 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:42:15.341+0000 7f1460830200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-08T03:42:15.686 INFO:journalctl@ceph.mgr.z.smithi186.stdout:May 08 03:42:15 smithi186 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-z[128521]: 2023-05-08T03:42:15.425+0000 7f45dffc4200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-08T03:42:15.697 INFO:journalctl@ceph.mgr.y.smithi133.stdout:May 08 03:42:15 smithi133 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-y[127385]: 2023-05-08T03:42:15.434+0000 7f69965ec200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-08T03:42:15.990 INFO:journalctl@ceph.mgr.y.smithi133.stdout:May 08 03:42:15 smithi133 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-y[127385]: 2023-05-08T03:42:15.695+0000 7f69965ec200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-08T03:42:16.118 INFO:journalctl@ceph.mgr.z.smithi186.stdout:May 08 03:42:15 smithi186 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-z[128521]: 2023-05-08T03:42:15.684+0000 7f45dffc4200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-08T03:42:16.255 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:42:15 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:42:15.489+0000 7f1460830200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-08T03:42:16.255 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:42:15 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:42:15.755+0000 7f1460830200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-08T03:42:16.704 INFO:journalctl@ceph.mgr.z.smithi186.stdout:May 08 03:42:16 smithi186 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-z[128521]: 2023-05-08T03:42:16.383+0000 7f45dffc4200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-08T03:42:16.705 INFO:journalctl@ceph.mgr.z.smithi186.stdout:May 08 03:42:16 smithi186 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-z[128521]: 2023-05-08T03:42:16.513+0000 7f45dffc4200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-08T03:42:16.718 INFO:journalctl@ceph.mgr.y.smithi133.stdout:May 08 03:42:16 smithi133 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-y[127385]: 2023-05-08T03:42:16.395+0000 7f69965ec200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-08T03:42:16.718 INFO:journalctl@ceph.mgr.y.smithi133.stdout:May 08 03:42:16 smithi133 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-y[127385]: 2023-05-08T03:42:16.526+0000 7f69965ec200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-08T03:42:16.755 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:42:16 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:42:16.457+0000 7f1460830200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-08T03:42:16.755 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:42:16 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:42:16.590+0000 7f1460830200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-08T03:42:16.990 INFO:journalctl@ceph.mgr.y.smithi133.stdout:May 08 03:42:16 smithi133 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-y[127385]: 2023-05-08T03:42:16.715+0000 7f69965ec200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-08T03:42:16.990 INFO:journalctl@ceph.mgr.y.smithi133.stdout:May 08 03:42:16 smithi133 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-y[127385]: 2023-05-08T03:42:16.829+0000 7f69965ec200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-08T03:42:17.032 INFO:journalctl@ceph.mgr.z.smithi186.stdout:May 08 03:42:16 smithi186 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-z[128521]: 2023-05-08T03:42:16.702+0000 7f45dffc4200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-08T03:42:17.032 INFO:journalctl@ceph.mgr.z.smithi186.stdout:May 08 03:42:16 smithi186 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-z[128521]: 2023-05-08T03:42:16.816+0000 7f45dffc4200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-08T03:42:17.122 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:42:16 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:42:16.784+0000 7f1460830200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-08T03:42:17.123 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:42:16 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:42:16.902+0000 7f1460830200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-08T03:42:17.369 INFO:journalctl@ceph.mgr.z.smithi186.stdout:May 08 03:42:17 smithi186 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-z[128521]: 2023-05-08T03:42:17.030+0000 7f45dffc4200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-08T03:42:17.490 INFO:journalctl@ceph.mgr.y.smithi133.stdout:May 08 03:42:17 smithi133 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-y[127385]: 2023-05-08T03:42:17.044+0000 7f69965ec200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-08T03:42:17.505 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:42:17 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:42:17.120+0000 7f1460830200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-08T03:42:18.007 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:18.005+0000 7f5d567fc700 1 -- 172.21.15.96:0/3973663730 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mgrmap(e 20) v1 ==== 135400+0+0 (secure 0 0 0) 0x7f5d58004d50 con 0x7f5d60106060 2023-05-08T03:42:18.008 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:18.005+0000 7f5d567fc700 1 -- 172.21.15.96:0/3973663730 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f5d4c0a11a0 msgr2=0x7f5d4c0a3650 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-08T03:42:18.008 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:18.005+0000 7f5d567fc700 1 --2- 172.21.15.96:0/3973663730 >> [v2:172.21.15.96:6800/2748629182,v1:172.21.15.96:6801/2748629182] conn(0x7f5d4c0a11a0 0x7f5d4c0a3650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:18.146 INFO:journalctl@ceph.mgr.z.smithi186.stdout:May 08 03:42:17 smithi186 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-z[128521]: 2023-05-08T03:42:17.886+0000 7f45dffc4200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-08T03:42:18.240 INFO:journalctl@ceph.mgr.y.smithi133.stdout:May 08 03:42:17 smithi133 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-y[127385]: 2023-05-08T03:42:17.899+0000 7f69965ec200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-08T03:42:18.240 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:42:17 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:42:17.981+0000 7f1460830200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-08T03:42:18.241 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:42:18 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:42:18.236+0000 7f13bfccf700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-08T03:42:18.241 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:42:18 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:42:18.236+0000 7f13bfccf700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-08T03:42:18.241 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:42:18 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:42:18.236+0000 7f13bfccf700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-08T03:42:18.241 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:42:18 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:42:18.236+0000 7f13bfccf700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-08T03:42:18.241 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:42:18 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:42:18.236+0000 7f13bfccf700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-08T03:42:18.241 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:42:18 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:42:18.236+0000 7f13bd4ca700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-08T03:42:18.241 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:42:18 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:42:18.236+0000 7f13bd4ca700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-08T03:42:18.242 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:42:18 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:42:18.236+0000 7f13bd4ca700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-08T03:42:18.242 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:42:18 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:42:18.236+0000 7f13bd4ca700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-08T03:42:18.242 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:42:18 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:42:18.236+0000 7f13bd4ca700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-08T03:42:18.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:18 smithi096 ceph-mon[124666]: Standby manager daemon z restarted 2023-05-08T03:42:18.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:18 smithi096 ceph-mon[124666]: Standby manager daemon z started 2023-05-08T03:42:18.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:18 smithi096 ceph-mon[124666]: from='mgr.? 172.21.15.186:0/4187561605' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-05-08T03:42:18.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:18 smithi096 ceph-mon[124666]: from='mgr.? 172.21.15.186:0/4187561605' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-05-08T03:42:18.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:18 smithi096 ceph-mon[124666]: from='mgr.? 172.21.15.186:0/4187561605' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-05-08T03:42:18.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:18 smithi096 ceph-mon[124666]: from='mgr.? 172.21.15.186:0/4187561605' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-05-08T03:42:18.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:18 smithi096 ceph-mon[124666]: Standby manager daemon y restarted 2023-05-08T03:42:18.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:18 smithi096 ceph-mon[124666]: Standby manager daemon y started 2023-05-08T03:42:18.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:18 smithi096 ceph-mon[124666]: from='mgr.? 172.21.15.133:0/2487471789' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-05-08T03:42:18.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:18 smithi096 ceph-mon[124666]: from='mgr.? 172.21.15.133:0/2487471789' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-05-08T03:42:18.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:18 smithi096 ceph-mon[124666]: from='mgr.? 172.21.15.133:0/2487471789' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-05-08T03:42:18.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:18 smithi096 ceph-mon[124666]: from='mgr.? 172.21.15.133:0/2487471789' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-05-08T03:42:18.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:18 smithi096 ceph-mon[124666]: Active manager daemon x restarted 2023-05-08T03:42:18.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:18 smithi096 ceph-mon[124666]: Activating manager daemon x 2023-05-08T03:42:18.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:18 smithi096 ceph-mon[124666]: osdmap e85: 12 total, 12 up, 12 in 2023-05-08T03:42:18.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:18 smithi096 ceph-mon[124666]: mgrmap e20: x(active, starting, since 0.0124488s), standbys: z, y 2023-05-08T03:42:18.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-05-08T03:42:18.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-05-08T03:42:18.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-05-08T03:42:18.509 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-05-08T03:42:18.509 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-05-08T03:42:18.509 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-05-08T03:42:18.509 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-05-08T03:42:18.509 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-05-08T03:42:18.509 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-05-08T03:42:18.509 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-05-08T03:42:18.509 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-05-08T03:42:18.510 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-05-08T03:42:18.510 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-05-08T03:42:18.510 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-05-08T03:42:18.510 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-05-08T03:42:18.510 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-05-08T03:42:18.510 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-05-08T03:42:18.510 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-05-08T03:42:18.510 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-05-08T03:42:18.511 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-05-08T03:42:18.511 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-05-08T03:42:18.511 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-05-08T03:42:18.511 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-05-08T03:42:18.511 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-05-08T03:42:18.512 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-05-08T03:42:18.512 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-05-08T03:42:18.512 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-05-08T03:42:18.512 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-05-08T03:42:18.512 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-05-08T03:42:18.512 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-05-08T03:42:18.512 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-05-08T03:42:18.513 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-05-08T03:42:18.513 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-05-08T03:42:18.513 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:18 smithi096 ceph-mon[124666]: Manager daemon x is now available 2023-05-08T03:42:18.513 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:42:18.513 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:42:18.513 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-05-08T03:42:18.513 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-05-08T03:42:18.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:18 smithi186 ceph-mon[126480]: Standby manager daemon z restarted 2023-05-08T03:42:18.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:18 smithi186 ceph-mon[126480]: Standby manager daemon z started 2023-05-08T03:42:18.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:18 smithi186 ceph-mon[126480]: from='mgr.? 172.21.15.186:0/4187561605' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-05-08T03:42:18.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:18 smithi186 ceph-mon[126480]: from='mgr.? 172.21.15.186:0/4187561605' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-05-08T03:42:18.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:18 smithi186 ceph-mon[126480]: from='mgr.? 172.21.15.186:0/4187561605' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-05-08T03:42:18.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:18 smithi186 ceph-mon[126480]: from='mgr.? 172.21.15.186:0/4187561605' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-05-08T03:42:18.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:18 smithi186 ceph-mon[126480]: Standby manager daemon y restarted 2023-05-08T03:42:18.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:18 smithi186 ceph-mon[126480]: Standby manager daemon y started 2023-05-08T03:42:18.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:18 smithi186 ceph-mon[126480]: from='mgr.? 172.21.15.133:0/2487471789' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-05-08T03:42:18.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:18 smithi186 ceph-mon[126480]: from='mgr.? 172.21.15.133:0/2487471789' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-05-08T03:42:18.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:18 smithi186 ceph-mon[126480]: from='mgr.? 172.21.15.133:0/2487471789' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-05-08T03:42:18.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:18 smithi186 ceph-mon[126480]: from='mgr.? 172.21.15.133:0/2487471789' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-05-08T03:42:18.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:18 smithi186 ceph-mon[126480]: Active manager daemon x restarted 2023-05-08T03:42:18.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:18 smithi186 ceph-mon[126480]: Activating manager daemon x 2023-05-08T03:42:18.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:18 smithi186 ceph-mon[126480]: osdmap e85: 12 total, 12 up, 12 in 2023-05-08T03:42:18.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:18 smithi186 ceph-mon[126480]: mgrmap e20: x(active, starting, since 0.0124488s), standbys: z, y 2023-05-08T03:42:18.623 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-05-08T03:42:18.623 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-05-08T03:42:18.623 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-05-08T03:42:18.623 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-05-08T03:42:18.623 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-05-08T03:42:18.623 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-05-08T03:42:18.623 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-05-08T03:42:18.623 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-05-08T03:42:18.624 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-05-08T03:42:18.624 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-05-08T03:42:18.624 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-05-08T03:42:18.624 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-05-08T03:42:18.624 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-05-08T03:42:18.624 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-05-08T03:42:18.624 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-05-08T03:42:18.625 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-05-08T03:42:18.625 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-05-08T03:42:18.625 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-05-08T03:42:18.625 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-05-08T03:42:18.625 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-05-08T03:42:18.625 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-05-08T03:42:18.626 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-05-08T03:42:18.626 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-05-08T03:42:18.626 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-05-08T03:42:18.626 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-05-08T03:42:18.626 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-05-08T03:42:18.626 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-05-08T03:42:18.626 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-05-08T03:42:18.626 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-05-08T03:42:18.627 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-05-08T03:42:18.627 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-05-08T03:42:18.627 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-05-08T03:42:18.627 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-05-08T03:42:18.627 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:18 smithi186 ceph-mon[126480]: Manager daemon x is now available 2023-05-08T03:42:18.627 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:42:18.627 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:42:18.628 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-05-08T03:42:18.628 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-05-08T03:42:18.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:18 smithi133 ceph-mon[125939]: Standby manager daemon z restarted 2023-05-08T03:42:18.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:18 smithi133 ceph-mon[125939]: Standby manager daemon z started 2023-05-08T03:42:18.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:18 smithi133 ceph-mon[125939]: from='mgr.? 172.21.15.186:0/4187561605' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-05-08T03:42:18.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:18 smithi133 ceph-mon[125939]: from='mgr.? 172.21.15.186:0/4187561605' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-05-08T03:42:18.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:18 smithi133 ceph-mon[125939]: from='mgr.? 172.21.15.186:0/4187561605' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-05-08T03:42:18.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:18 smithi133 ceph-mon[125939]: from='mgr.? 172.21.15.186:0/4187561605' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-05-08T03:42:18.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:18 smithi133 ceph-mon[125939]: Standby manager daemon y restarted 2023-05-08T03:42:18.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:18 smithi133 ceph-mon[125939]: Standby manager daemon y started 2023-05-08T03:42:18.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:18 smithi133 ceph-mon[125939]: from='mgr.? 172.21.15.133:0/2487471789' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-05-08T03:42:18.744 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:18 smithi133 ceph-mon[125939]: from='mgr.? 172.21.15.133:0/2487471789' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-05-08T03:42:18.744 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:18 smithi133 ceph-mon[125939]: from='mgr.? 172.21.15.133:0/2487471789' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-05-08T03:42:18.744 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:18 smithi133 ceph-mon[125939]: from='mgr.? 172.21.15.133:0/2487471789' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-05-08T03:42:18.744 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:18 smithi133 ceph-mon[125939]: Active manager daemon x restarted 2023-05-08T03:42:18.745 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:18 smithi133 ceph-mon[125939]: Activating manager daemon x 2023-05-08T03:42:18.745 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:18 smithi133 ceph-mon[125939]: osdmap e85: 12 total, 12 up, 12 in 2023-05-08T03:42:18.745 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:18 smithi133 ceph-mon[125939]: mgrmap e20: x(active, starting, since 0.0124488s), standbys: z, y 2023-05-08T03:42:18.745 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-05-08T03:42:18.746 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-05-08T03:42:18.746 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-05-08T03:42:18.746 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-05-08T03:42:18.746 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-05-08T03:42:18.747 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-05-08T03:42:18.747 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-05-08T03:42:18.747 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-05-08T03:42:18.747 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-05-08T03:42:18.748 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-05-08T03:42:18.748 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-05-08T03:42:18.748 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-05-08T03:42:18.749 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-05-08T03:42:18.749 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-05-08T03:42:18.749 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-05-08T03:42:18.750 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-05-08T03:42:18.750 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-05-08T03:42:18.750 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-05-08T03:42:18.751 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-05-08T03:42:18.751 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-05-08T03:42:18.752 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-05-08T03:42:18.752 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-05-08T03:42:18.752 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-05-08T03:42:18.752 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-05-08T03:42:18.753 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-05-08T03:42:18.753 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-05-08T03:42:18.753 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-05-08T03:42:18.753 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-05-08T03:42:18.754 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-05-08T03:42:18.754 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-05-08T03:42:18.754 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-05-08T03:42:18.754 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-05-08T03:42:18.754 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-05-08T03:42:18.754 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:18 smithi133 ceph-mon[125939]: Manager daemon x is now available 2023-05-08T03:42:18.755 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:42:18.755 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:42:18.755 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-05-08T03:42:18.755 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-05-08T03:42:19.013 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.011+0000 7f5d567fc700 1 -- 172.21.15.96:0/3973663730 <== mon.0 v2:172.21.15.96:3300/0 8 ==== mgrmap(e 21) v1 ==== 135527+0+0 (secure 0 0 0) 0x7f5d580cb8a0 con 0x7f5d60106060 2023-05-08T03:42:19.014 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.011+0000 7f5d567fc700 1 --2- 172.21.15.96:0/3973663730 >> [v2:172.21.15.96:6800/28033835,v1:172.21.15.96:6801/28033835] conn(0x7f5d4c069260 0x7f5d4c069630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:19.014 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.011+0000 7f5d567fc700 1 -- 172.21.15.96:0/3973663730 --> [v2:172.21.15.96:6800/28033835,v1:172.21.15.96:6801/28033835] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f5d60061be0 con 0x7f5d4c069260 2023-05-08T03:42:19.016 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.013+0000 7f5d656b7700 1 --2- 172.21.15.96:0/3973663730 >> [v2:172.21.15.96:6800/28033835,v1:172.21.15.96:6801/28033835] conn(0x7f5d4c069260 0x7f5d4c069630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:19.017 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.015+0000 7f5d656b7700 1 --2- 172.21.15.96:0/3973663730 >> [v2:172.21.15.96:6800/28033835,v1:172.21.15.96:6801/28033835] conn(0x7f5d4c069260 0x7f5d4c069630 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c009c30 tx=0x7f5d5c009260 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:42:19.081 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.078+0000 7f5d567fc700 1 -- 172.21.15.96:0/3973663730 <== mgr.15273 v2:172.21.15.96:6800/28033835 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f5d60061be0 con 0x7f5d4c069260 2023-05-08T03:42:19.081 INFO:teuthology.orchestra.run.smithi096.stdout:Schedule set for path / 2023-05-08T03:42:19.083 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.081+0000 7f5d6791b700 1 -- 172.21.15.96:0/3973663730 >> [v2:172.21.15.96:6800/28033835,v1:172.21.15.96:6801/28033835] conn(0x7f5d4c069260 msgr2=0x7f5d4c069630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:19.084 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.081+0000 7f5d6791b700 1 --2- 172.21.15.96:0/3973663730 >> [v2:172.21.15.96:6800/28033835,v1:172.21.15.96:6801/28033835] conn(0x7f5d4c069260 0x7f5d4c069630 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c009c30 tx=0x7f5d5c009260 comp rx=0 tx=0).stop 2023-05-08T03:42:19.084 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.081+0000 7f5d6791b700 1 -- 172.21.15.96:0/3973663730 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d60106060 msgr2=0x7f5d600ff310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:19.084 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.081+0000 7f5d6791b700 1 --2- 172.21.15.96:0/3973663730 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d60106060 0x7f5d600ff310 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f5d5800b070 tx=0x7f5d580075c0 comp rx=0 tx=0).stop 2023-05-08T03:42:19.084 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.081+0000 7f5d65eb8700 1 -- 172.21.15.96:0/3973663730 reap_dead start 2023-05-08T03:42:19.084 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.081+0000 7f5d6791b700 1 -- 172.21.15.96:0/3973663730 shutdown_connections 2023-05-08T03:42:19.085 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.081+0000 7f5d6791b700 1 -- 172.21.15.96:0/3973663730 >> 172.21.15.96:0/3973663730 conn(0x7f5d600fa820 msgr2=0x7f5d60101a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:42:19.085 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.081+0000 7f5d6791b700 1 -- 172.21.15.96:0/3973663730 shutdown_connections 2023-05-08T03:42:19.085 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.081+0000 7f5d6791b700 1 -- 172.21.15.96:0/3973663730 wait complete. 2023-05-08T03:42:19.098 DEBUG:teuthology.orchestra.run.smithi096:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6M3h' 2023-05-08T03:42:19.242 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.237+0000 7fede7195700 1 -- 172.21.15.96:0/1530589965 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fede00ff240 msgr2=0x7fede00ff650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:19.242 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.237+0000 7fede7195700 1 --2- 172.21.15.96:0/1530589965 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fede00ff240 0x7fede00ff650 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fedd4009990 tx=0x7fedd4009ca0 comp rx=0 tx=0).stop 2023-05-08T03:42:19.242 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.237+0000 7fede7195700 1 -- 172.21.15.96:0/1530589965 shutdown_connections 2023-05-08T03:42:19.242 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.237+0000 7fede7195700 1 --2- 172.21.15.96:0/1530589965 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fede0100dc0 0x7fede0107680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:19.243 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.237+0000 7fede7195700 1 --2- 172.21.15.96:0/1530589965 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fede00ff240 0x7fede00ff650 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:19.243 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.237+0000 7fede7195700 1 --2- 172.21.15.96:0/1530589965 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fede0100430 0x7fede0100880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:19.243 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.237+0000 7fede7195700 1 -- 172.21.15.96:0/1530589965 >> 172.21.15.96:0/1530589965 conn(0x7fede00fa840 msgr2=0x7fede00fcc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:42:19.243 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.237+0000 7fede7195700 1 -- 172.21.15.96:0/1530589965 shutdown_connections 2023-05-08T03:42:19.243 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.237+0000 7fede7195700 1 -- 172.21.15.96:0/1530589965 wait complete. 2023-05-08T03:42:19.243 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.238+0000 7fede7195700 1 Processor -- start 2023-05-08T03:42:19.243 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.238+0000 7fede7195700 1 -- start start 2023-05-08T03:42:19.244 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.238+0000 7fede7195700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fede00ff240 0x7fede00698a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:19.244 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.238+0000 7fede7195700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fede0100430 0x7fede019ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:19.244 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.238+0000 7fede7195700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fede0100dc0 0x7fede019d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:19.244 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.238+0000 7fede7195700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede019db60 con 0x7fede00ff240 2023-05-08T03:42:19.244 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.238+0000 7fede7195700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede019dcd0 con 0x7fede0100430 2023-05-08T03:42:19.244 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.238+0000 7fede7195700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede019de90 con 0x7fede0100dc0 2023-05-08T03:42:19.245 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.238+0000 7fede4f31700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fede00ff240 0x7fede00698a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:19.245 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.238+0000 7fede4f31700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fede00ff240 0x7fede00698a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42186/0 (socket says 172.21.15.96:42186) 2023-05-08T03:42:19.245 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.238+0000 7fede4f31700 1 -- 172.21.15.96:0/2450491415 learned_addr learned my addr 172.21.15.96:0/2450491415 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:42:19.245 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.238+0000 7feddffff700 1 --2- 172.21.15.96:0/2450491415 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fede0100430 0x7fede019ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:19.245 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.238+0000 7fede5732700 1 --2- 172.21.15.96:0/2450491415 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fede0100dc0 0x7fede019d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:19.245 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.239+0000 7fede4f31700 1 -- 172.21.15.96:0/2450491415 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fede0100dc0 msgr2=0x7fede019d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:19.245 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.239+0000 7fede4f31700 1 --2- 172.21.15.96:0/2450491415 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fede0100dc0 0x7fede019d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:19.246 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.239+0000 7fede4f31700 1 -- 172.21.15.96:0/2450491415 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fede0100430 msgr2=0x7fede019ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:19.246 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.239+0000 7fede4f31700 1 --2- 172.21.15.96:0/2450491415 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fede0100430 0x7fede019ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:19.246 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.239+0000 7fede4f31700 1 -- 172.21.15.96:0/2450491415 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedd40095f0 con 0x7fede00ff240 2023-05-08T03:42:19.246 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.239+0000 7fede4f31700 1 --2- 172.21.15.96:0/2450491415 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fede00ff240 0x7fede00698a0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fedd4000c00 tx=0x7fedd40057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:42:19.246 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.239+0000 7fedddffb700 1 -- 172.21.15.96:0/2450491415 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd401d070 con 0x7fede00ff240 2023-05-08T03:42:19.246 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.239+0000 7fede7195700 1 -- 172.21.15.96:0/2450491415 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fede010abb0 con 0x7fede00ff240 2023-05-08T03:42:19.246 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.239+0000 7fedddffb700 1 -- 172.21.15.96:0/2450491415 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fedd400fb90 con 0x7fede00ff240 2023-05-08T03:42:19.246 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.239+0000 7fedddffb700 1 -- 172.21.15.96:0/2450491415 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd40173f0 con 0x7fede00ff240 2023-05-08T03:42:19.247 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.239+0000 7fede7195700 1 -- 172.21.15.96:0/2450491415 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fede010aa20 con 0x7fede00ff240 2023-05-08T03:42:19.247 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.240+0000 7fede7195700 1 -- 172.21.15.96:0/2450491415 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fede0106780 con 0x7fede00ff240 2023-05-08T03:42:19.248 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.241+0000 7fedddffb700 1 -- 172.21.15.96:0/2450491415 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 21) v1 ==== 135527+0+0 (secure 0 0 0) 0x7fedd400fd00 con 0x7fede00ff240 2023-05-08T03:42:19.248 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.242+0000 7fedddffb700 1 --2- 172.21.15.96:0/2450491415 >> [v2:172.21.15.96:6800/28033835,v1:172.21.15.96:6801/28033835] conn(0x7fedd00a0f50 0x7fedd00a3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:19.248 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.242+0000 7feddffff700 1 --2- 172.21.15.96:0/2450491415 >> [v2:172.21.15.96:6800/28033835,v1:172.21.15.96:6801/28033835] conn(0x7fedd00a0f50 0x7fedd00a3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:19.248 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.242+0000 7fedddffb700 1 -- 172.21.15.96:0/2450491415 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8411+0+0 (secure 0 0 0) 0x7fedd40cd7b0 con 0x7fede00ff240 2023-05-08T03:42:19.248 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.242+0000 7feddffff700 1 --2- 172.21.15.96:0/2450491415 >> [v2:172.21.15.96:6800/28033835,v1:172.21.15.96:6801/28033835] conn(0x7fedd00a0f50 0x7fedd00a3400 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fedcc00ac50 tx=0x7fedcc00a380 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:42:19.249 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.247+0000 7fedddffb700 1 -- 172.21.15.96:0/2450491415 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fedd40972f0 con 0x7fede00ff240 2023-05-08T03:42:19.492 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.490+0000 7fede7195700 1 -- 172.21.15.96:0/2450491415 --> [v2:172.21.15.96:6800/28033835,v1:172.21.15.96:6801/28033835] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6M3h", "target": ["mon-mgr", ""]}) v1 -- 0x7fede0061bd0 con 0x7fedd00a0f50 2023-05-08T03:42:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:19 smithi096 ceph-mon[124666]: [08/May/2023:03:42:18] ENGINE Bus STARTING 2023-05-08T03:42:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:19 smithi096 ceph-mon[124666]: mgrmap e21: x(active, since 1.0187s), standbys: z, y 2023-05-08T03:42:19.544 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.541+0000 7fedddffb700 1 -- 172.21.15.96:0/2450491415 <== mgr.15273 v2:172.21.15.96:6800/28033835 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7fede0061bd0 con 0x7fedd00a0f50 2023-05-08T03:42:19.545 INFO:teuthology.orchestra.run.smithi096.stdout:Retention added to path / 2023-05-08T03:42:19.547 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.544+0000 7fede7195700 1 -- 172.21.15.96:0/2450491415 >> [v2:172.21.15.96:6800/28033835,v1:172.21.15.96:6801/28033835] conn(0x7fedd00a0f50 msgr2=0x7fedd00a3400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:19.547 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.544+0000 7fede7195700 1 --2- 172.21.15.96:0/2450491415 >> [v2:172.21.15.96:6800/28033835,v1:172.21.15.96:6801/28033835] conn(0x7fedd00a0f50 0x7fedd00a3400 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fedcc00ac50 tx=0x7fedcc00a380 comp rx=0 tx=0).stop 2023-05-08T03:42:19.547 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.544+0000 7fede7195700 1 -- 172.21.15.96:0/2450491415 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fede00ff240 msgr2=0x7fede00698a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:19.547 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.544+0000 7fede7195700 1 --2- 172.21.15.96:0/2450491415 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fede00ff240 0x7fede00698a0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fedd4000c00 tx=0x7fedd40057c0 comp rx=0 tx=0).stop 2023-05-08T03:42:19.548 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.544+0000 7fede7195700 1 -- 172.21.15.96:0/2450491415 shutdown_connections 2023-05-08T03:42:19.548 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.544+0000 7fede7195700 1 --2- 172.21.15.96:0/2450491415 >> [v2:172.21.15.96:6800/28033835,v1:172.21.15.96:6801/28033835] conn(0x7fedd00a0f50 0x7fedd00a3400 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:19.548 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.544+0000 7fede7195700 1 --2- 172.21.15.96:0/2450491415 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fede0100dc0 0x7fede019d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:19.548 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.544+0000 7fede7195700 1 --2- 172.21.15.96:0/2450491415 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fede00ff240 0x7fede00698a0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:19.548 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.544+0000 7fede7195700 1 --2- 172.21.15.96:0/2450491415 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fede0100430 0x7fede019ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:19.548 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.544+0000 7fede7195700 1 -- 172.21.15.96:0/2450491415 >> 172.21.15.96:0/2450491415 conn(0x7fede00fa840 msgr2=0x7fede01038c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:42:19.548 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.544+0000 7fede7195700 1 -- 172.21.15.96:0/2450491415 shutdown_connections 2023-05-08T03:42:19.548 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.544+0000 7fede7195700 1 -- 172.21.15.96:0/2450491415 wait complete. 2023-05-08T03:42:19.558 DEBUG:teuthology.orchestra.run.smithi096:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2023-05-08T03:42:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:19 smithi186 ceph-mon[126480]: [08/May/2023:03:42:18] ENGINE Bus STARTING 2023-05-08T03:42:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:19 smithi186 ceph-mon[126480]: mgrmap e21: x(active, since 1.0187s), standbys: z, y 2023-05-08T03:42:19.687 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.684+0000 7fc2ab189700 1 -- 172.21.15.96:0/1882610559 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc2a4103770 msgr2=0x7fc2a4103bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:19.687 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.684+0000 7fc2ab189700 1 --2- 172.21.15.96:0/1882610559 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc2a4103770 0x7fc2a4103bc0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc2900098f0 tx=0x7fc290009c00 comp rx=0 tx=0).stop 2023-05-08T03:42:19.687 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.684+0000 7fc2ab189700 1 -- 172.21.15.96:0/1882610559 shutdown_connections 2023-05-08T03:42:19.687 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.684+0000 7fc2ab189700 1 --2- 172.21.15.96:0/1882610559 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2a4104100 0x7fc2a410a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:19.687 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.684+0000 7fc2ab189700 1 --2- 172.21.15.96:0/1882610559 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2a4102580 0x7fc2a4102990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:19.687 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.684+0000 7fc2ab189700 1 --2- 172.21.15.96:0/1882610559 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc2a4103770 0x7fc2a4103bc0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:19.688 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.684+0000 7fc2ab189700 1 -- 172.21.15.96:0/1882610559 >> 172.21.15.96:0/1882610559 conn(0x7fc2a40fdbc0 msgr2=0x7fc2a40fffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:42:19.688 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.684+0000 7fc2ab189700 1 -- 172.21.15.96:0/1882610559 shutdown_connections 2023-05-08T03:42:19.688 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.684+0000 7fc2ab189700 1 -- 172.21.15.96:0/1882610559 wait complete. 2023-05-08T03:42:19.688 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.684+0000 7fc2ab189700 1 Processor -- start 2023-05-08T03:42:19.688 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.684+0000 7fc2ab189700 1 -- start start 2023-05-08T03:42:19.690 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.685+0000 7fc2ab189700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2a4102580 0x7fc2a41982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:19.690 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.685+0000 7fc2ab189700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2a4103770 0x7fc2a4198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:19.690 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.685+0000 7fc2ab189700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc2a4104100 0x7fc2a419f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:19.690 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.685+0000 7fc2ab189700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a419fe70 con 0x7fc2a4102580 2023-05-08T03:42:19.690 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.685+0000 7fc2ab189700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a419ffb0 con 0x7fc2a4103770 2023-05-08T03:42:19.690 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.685+0000 7fc2ab189700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a41a0140 con 0x7fc2a4104100 2023-05-08T03:42:19.691 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.685+0000 7fc2a8f25700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2a4102580 0x7fc2a41982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:19.691 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.685+0000 7fc2a8f25700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2a4102580 0x7fc2a41982f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42200/0 (socket says 172.21.15.96:42200) 2023-05-08T03:42:19.691 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.685+0000 7fc2a8f25700 1 -- 172.21.15.96:0/3724060161 learned_addr learned my addr 172.21.15.96:0/3724060161 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:42:19.691 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.685+0000 7fc2a3fff700 1 --2- 172.21.15.96:0/3724060161 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2a4103770 0x7fc2a4198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:19.691 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.685+0000 7fc2a9726700 1 --2- 172.21.15.96:0/3724060161 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc2a4104100 0x7fc2a419f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:19.691 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.685+0000 7fc2a8f25700 1 -- 172.21.15.96:0/3724060161 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc2a4104100 msgr2=0x7fc2a419f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:19.691 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.685+0000 7fc2a8f25700 1 --2- 172.21.15.96:0/3724060161 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc2a4104100 0x7fc2a419f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:19.691 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.685+0000 7fc2a8f25700 1 -- 172.21.15.96:0/3724060161 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2a4103770 msgr2=0x7fc2a4198830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:19.692 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.685+0000 7fc2a8f25700 1 --2- 172.21.15.96:0/3724060161 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2a4103770 0x7fc2a4198830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:19.692 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.685+0000 7fc2a8f25700 1 -- 172.21.15.96:0/3724060161 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc29c009d00 con 0x7fc2a4102580 2023-05-08T03:42:19.692 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.685+0000 7fc2a3fff700 1 --2- 172.21.15.96:0/3724060161 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2a4103770 0x7fc2a4198830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-08T03:42:19.692 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.685+0000 7fc2a8f25700 1 --2- 172.21.15.96:0/3724060161 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2a4102580 0x7fc2a41982f0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fc29800e970 tx=0x7fc29800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:42:19.692 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.685+0000 7fc2a1ffb700 1 -- 172.21.15.96:0/3724060161 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc298009790 con 0x7fc2a4102580 2023-05-08T03:42:19.692 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.686+0000 7fc2ab189700 1 -- 172.21.15.96:0/3724060161 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc290009520 con 0x7fc2a4102580 2023-05-08T03:42:19.692 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.686+0000 7fc2a1ffb700 1 -- 172.21.15.96:0/3724060161 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc29800eec0 con 0x7fc2a4102580 2023-05-08T03:42:19.693 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.686+0000 7fc2a1ffb700 1 -- 172.21.15.96:0/3724060161 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc298003cf0 con 0x7fc2a4102580 2023-05-08T03:42:19.693 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.686+0000 7fc2ab189700 1 -- 172.21.15.96:0/3724060161 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2a410dee0 con 0x7fc2a4102580 2023-05-08T03:42:19.693 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.687+0000 7fc2ab189700 1 -- 172.21.15.96:0/3724060161 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2a410e070 con 0x7fc2a4102580 2023-05-08T03:42:19.693 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.688+0000 7fc2a1ffb700 1 -- 172.21.15.96:0/3724060161 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 21) v1 ==== 135527+0+0 (secure 0 0 0) 0x7fc29800ccd0 con 0x7fc2a4102580 2023-05-08T03:42:19.694 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.689+0000 7fc2a1ffb700 1 --2- 172.21.15.96:0/3724060161 >> [v2:172.21.15.96:6800/28033835,v1:172.21.15.96:6801/28033835] conn(0x7fc2940a0f50 0x7fc2940a3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:19.694 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.689+0000 7fc2a1ffb700 1 -- 172.21.15.96:0/3724060161 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8411+0+0 (secure 0 0 0) 0x7fc298014070 con 0x7fc2a4102580 2023-05-08T03:42:19.694 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.689+0000 7fc2a3fff700 1 --2- 172.21.15.96:0/3724060161 >> [v2:172.21.15.96:6800/28033835,v1:172.21.15.96:6801/28033835] conn(0x7fc2940a0f50 0x7fc2940a3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:19.694 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.689+0000 7fc2a3fff700 1 --2- 172.21.15.96:0/3724060161 >> [v2:172.21.15.96:6800/28033835,v1:172.21.15.96:6801/28033835] conn(0x7fc2940a0f50 0x7fc2940a3400 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc290005e90 tx=0x7fc290019040 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:42:19.696 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.694+0000 7fc2a1ffb700 1 -- 172.21.15.96:0/3724060161 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7fc2980961a0 con 0x7fc2a4102580 2023-05-08T03:42:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:19 smithi133 ceph-mon[125939]: [08/May/2023:03:42:18] ENGINE Bus STARTING 2023-05-08T03:42:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:19 smithi133 ceph-mon[125939]: mgrmap e21: x(active, since 1.0187s), standbys: z, y 2023-05-08T03:42:19.921 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.918+0000 7fc2ab189700 1 -- 172.21.15.96:0/3724060161 --> [v2:172.21.15.96:6800/28033835,v1:172.21.15.96:6801/28033835] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) v1 -- 0x7fc2a4061030 con 0x7fc2940a0f50 2023-05-08T03:42:19.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.927+0000 7fc2a1ffb700 1 -- 172.21.15.96:0/3724060161 <== mgr.15273 v2:172.21.15.96:6800/28033835 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+283 (secure 0 0 0) 0x7fc2a4061030 con 0x7fc2940a0f50 2023-05-08T03:42:19.929 INFO:teuthology.orchestra.run.smithi096.stdout:{"fs": "cephfs", "subvol": null, "path": "/", "rel_path": "/", "schedule": "1M", "retention": {"h": 3, "M": 6}, "start": "2023-05-08T00:00:00", "created": "2023-05-08T03:42:19", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2023-05-08T03:42:19.931 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.929+0000 7fc2ab189700 1 -- 172.21.15.96:0/3724060161 >> [v2:172.21.15.96:6800/28033835,v1:172.21.15.96:6801/28033835] conn(0x7fc2940a0f50 msgr2=0x7fc2940a3400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:19.931 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.929+0000 7fc2ab189700 1 --2- 172.21.15.96:0/3724060161 >> [v2:172.21.15.96:6800/28033835,v1:172.21.15.96:6801/28033835] conn(0x7fc2940a0f50 0x7fc2940a3400 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc290005e90 tx=0x7fc290019040 comp rx=0 tx=0).stop 2023-05-08T03:42:19.931 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.929+0000 7fc2ab189700 1 -- 172.21.15.96:0/3724060161 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2a4102580 msgr2=0x7fc2a41982f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:19.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.929+0000 7fc2ab189700 1 --2- 172.21.15.96:0/3724060161 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2a4102580 0x7fc2a41982f0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fc29800e970 tx=0x7fc29800ec80 comp rx=0 tx=0).stop 2023-05-08T03:42:19.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.929+0000 7fc2ab189700 1 -- 172.21.15.96:0/3724060161 shutdown_connections 2023-05-08T03:42:19.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.929+0000 7fc2ab189700 1 --2- 172.21.15.96:0/3724060161 >> [v2:172.21.15.96:6800/28033835,v1:172.21.15.96:6801/28033835] conn(0x7fc2940a0f50 0x7fc2940a3400 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:19.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.929+0000 7fc2ab189700 1 --2- 172.21.15.96:0/3724060161 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc2a4104100 0x7fc2a419f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:19.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.929+0000 7fc2ab189700 1 --2- 172.21.15.96:0/3724060161 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2a4102580 0x7fc2a41982f0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:19.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.929+0000 7fc2ab189700 1 --2- 172.21.15.96:0/3724060161 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2a4103770 0x7fc2a4198830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:19.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.929+0000 7fc2ab189700 1 -- 172.21.15.96:0/3724060161 >> 172.21.15.96:0/3724060161 conn(0x7fc2a40fdbc0 msgr2=0x7fc2a4106ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:42:19.933 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.929+0000 7fc2ab189700 1 -- 172.21.15.96:0/3724060161 shutdown_connections 2023-05-08T03:42:19.933 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:19.929+0000 7fc2ab189700 1 -- 172.21.15.96:0/3724060161 wait complete. 2023-05-08T03:42:19.943 DEBUG:teuthology.orchestra.run.smithi096:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2023-05-08T03:42:20.087 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:20.082+0000 7f2d329c4700 1 -- 172.21.15.96:0/2477401053 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d2c101f60 msgr2=0x7f2d2c108820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:20.087 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:20.082+0000 7f2d329c4700 1 --2- 172.21.15.96:0/2477401053 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d2c101f60 0x7f2d2c108820 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f2d2400b0a0 tx=0x7f2d2400b3b0 comp rx=0 tx=0).stop 2023-05-08T03:42:20.088 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:20.082+0000 7f2d329c4700 1 -- 172.21.15.96:0/2477401053 shutdown_connections 2023-05-08T03:42:20.088 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:20.082+0000 7f2d329c4700 1 --2- 172.21.15.96:0/2477401053 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d2c101f60 0x7f2d2c108820 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:20.089 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:20.082+0000 7f2d329c4700 1 --2- 172.21.15.96:0/2477401053 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2d2c0fe600 0x7f2d2c0fea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:20.089 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:20.082+0000 7f2d329c4700 1 --2- 172.21.15.96:0/2477401053 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d2c1015d0 0x7f2d2c101a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:20.089 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:20.082+0000 7f2d329c4700 1 -- 172.21.15.96:0/2477401053 >> 172.21.15.96:0/2477401053 conn(0x7f2d2c0f9fa0 msgr2=0x7f2d2c0fc410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:42:20.089 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:20.082+0000 7f2d329c4700 1 -- 172.21.15.96:0/2477401053 shutdown_connections 2023-05-08T03:42:20.089 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:20.082+0000 7f2d329c4700 1 -- 172.21.15.96:0/2477401053 wait complete. 2023-05-08T03:42:20.089 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:20.082+0000 7f2d329c4700 1 Processor -- start 2023-05-08T03:42:20.089 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:20.082+0000 7f2d329c4700 1 -- start start 2023-05-08T03:42:20.090 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:20.083+0000 7f2d329c4700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2d2c0fe600 0x7f2d2c100f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:20.090 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:20.083+0000 7f2d329c4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d2c1015d0 0x7f2d2c0ff580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:20.090 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:20.083+0000 7f2d329c4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d2c101f60 0x7f2d2c0ffac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:20.090 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:20.083+0000 7f2d329c4700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2c100260 con 0x7f2d2c1015d0 2023-05-08T03:42:20.090 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:20.083+0000 7f2d329c4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2c1003d0 con 0x7f2d2c101f60 2023-05-08T03:42:20.090 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:20.083+0000 7f2d329c4700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2c1a01f0 con 0x7f2d2c0fe600 2023-05-08T03:42:20.090 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:20.083+0000 7f2d2b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d2c1015d0 0x7f2d2c0ff580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:20.090 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:20.083+0000 7f2d2bfff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2d2c0fe600 0x7f2d2c100f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:20.091 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:20.083+0000 7f2d2bfff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2d2c0fe600 0x7f2d2c100f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.96:54258/0 (socket says 172.21.15.96:54258) 2023-05-08T03:42:20.091 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:20.083+0000 7f2d2b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d2c1015d0 0x7f2d2c0ff580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42216/0 (socket says 172.21.15.96:42216) 2023-05-08T03:42:20.091 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:20.083+0000 7f2d2bfff700 1 -- 172.21.15.96:0/2893023283 learned_addr learned my addr 172.21.15.96:0/2893023283 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-05-08T03:42:20.091 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:20.083+0000 7f2d30f61700 1 --2- 172.21.15.96:0/2893023283 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d2c101f60 0x7f2d2c0ffac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:20.091 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:20.083+0000 7f2d2b7fe700 1 -- 172.21.15.96:0/2893023283 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2d2c0fe600 msgr2=0x7f2d2c100f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:20.091 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:20.083+0000 7f2d2b7fe700 1 --2- 172.21.15.96:0/2893023283 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2d2c0fe600 0x7f2d2c100f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:20.091 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:20.083+0000 7f2d2b7fe700 1 -- 172.21.15.96:0/2893023283 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d2c101f60 msgr2=0x7f2d2c0ffac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:20.092 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:20.083+0000 7f2d2b7fe700 1 --2- 172.21.15.96:0/2893023283 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d2c101f60 0x7f2d2c0ffac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:20.092 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:20.083+0000 7f2d2b7fe700 1 -- 172.21.15.96:0/2893023283 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d24009d00 con 0x7f2d2c1015d0 2023-05-08T03:42:20.092 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:20.083+0000 7f2d2b7fe700 1 --2- 172.21.15.96:0/2893023283 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d2c1015d0 0x7f2d2c0ff580 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f2d2000d950 tx=0x7f2d2000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:42:20.092 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:20.083+0000 7f2d297fa700 1 -- 172.21.15.96:0/2893023283 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2000f890 con 0x7f2d2c1015d0 2023-05-08T03:42:20.092 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:20.083+0000 7f2d297fa700 1 -- 172.21.15.96:0/2893023283 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2d20010460 con 0x7f2d2c1015d0 2023-05-08T03:42:20.092 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:20.083+0000 7f2d329c4700 1 -- 172.21.15.96:0/2893023283 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d2c10bcc0 con 0x7f2d2c1015d0 2023-05-08T03:42:20.092 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:20.083+0000 7f2d297fa700 1 -- 172.21.15.96:0/2893023283 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2000e610 con 0x7f2d2c1015d0 2023-05-08T03:42:20.092 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:20.084+0000 7f2d329c4700 1 -- 172.21.15.96:0/2893023283 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d2c10bb30 con 0x7f2d2c1015d0 2023-05-08T03:42:20.093 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:20.084+0000 7f2d329c4700 1 -- 172.21.15.96:0/2893023283 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d2c107920 con 0x7f2d2c1015d0 2023-05-08T03:42:20.093 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:20.085+0000 7f2d297fa700 1 -- 172.21.15.96:0/2893023283 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 21) v1 ==== 135527+0+0 (secure 0 0 0) 0x7f2d200108d0 con 0x7f2d2c1015d0 2023-05-08T03:42:20.094 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:20.086+0000 7f2d297fa700 1 --2- 172.21.15.96:0/2893023283 >> [v2:172.21.15.96:6800/28033835,v1:172.21.15.96:6801/28033835] conn(0x7f2d140a0f50 0x7f2d140a3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-08T03:42:20.094 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:20.086+0000 7f2d2bfff700 1 --2- 172.21.15.96:0/2893023283 >> [v2:172.21.15.96:6800/28033835,v1:172.21.15.96:6801/28033835] conn(0x7f2d140a0f50 0x7f2d140a3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-08T03:42:20.094 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:20.086+0000 7f2d297fa700 1 -- 172.21.15.96:0/2893023283 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f2d200cc740 con 0x7f2d2c1015d0 2023-05-08T03:42:20.094 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:20.086+0000 7f2d2bfff700 1 --2- 172.21.15.96:0/2893023283 >> [v2:172.21.15.96:6800/28033835,v1:172.21.15.96:6801/28033835] conn(0x7f2d140a0f50 0x7f2d140a3400 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c005950 tx=0x7f2d1c009260 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-08T03:42:20.094 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:20.090+0000 7f2d297fa700 1 -- 172.21.15.96:0/2893023283 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177948 (secure 0 0 0) 0x7f2d200960d0 con 0x7f2d2c1015d0 2023-05-08T03:42:20.324 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:20.321+0000 7f2d329c4700 1 -- 172.21.15.96:0/2893023283 --> [v2:172.21.15.96:6800/28033835,v1:172.21.15.96:6801/28033835] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f2d2c061d80 con 0x7f2d140a0f50 2023-05-08T03:42:20.331 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:20.329+0000 7f2d297fa700 1 -- 172.21.15.96:0/2893023283 <== mgr.15273 v2:172.21.15.96:6800/28033835 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+10 (secure 0 0 0) 0x7f2d2c061d80 con 0x7f2d140a0f50 2023-05-08T03:42:20.331 INFO:teuthology.orchestra.run.smithi096.stdout:/ 1M 6M3h 2023-05-08T03:42:20.334 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:20.332+0000 7f2d329c4700 1 -- 172.21.15.96:0/2893023283 >> [v2:172.21.15.96:6800/28033835,v1:172.21.15.96:6801/28033835] conn(0x7f2d140a0f50 msgr2=0x7f2d140a3400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:20.335 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:20.332+0000 7f2d329c4700 1 --2- 172.21.15.96:0/2893023283 >> [v2:172.21.15.96:6800/28033835,v1:172.21.15.96:6801/28033835] conn(0x7f2d140a0f50 0x7f2d140a3400 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c005950 tx=0x7f2d1c009260 comp rx=0 tx=0).stop 2023-05-08T03:42:20.335 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:20.332+0000 7f2d329c4700 1 -- 172.21.15.96:0/2893023283 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d2c1015d0 msgr2=0x7f2d2c0ff580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-08T03:42:20.335 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:20.332+0000 7f2d329c4700 1 --2- 172.21.15.96:0/2893023283 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d2c1015d0 0x7f2d2c0ff580 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f2d2000d950 tx=0x7f2d2000dc60 comp rx=0 tx=0).stop 2023-05-08T03:42:20.335 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:20.332+0000 7f2d329c4700 1 -- 172.21.15.96:0/2893023283 shutdown_connections 2023-05-08T03:42:20.335 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:20.332+0000 7f2d329c4700 1 --2- 172.21.15.96:0/2893023283 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d2c101f60 0x7f2d2c0ffac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:20.335 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:20.332+0000 7f2d329c4700 1 --2- 172.21.15.96:0/2893023283 >> [v2:172.21.15.96:6800/28033835,v1:172.21.15.96:6801/28033835] conn(0x7f2d140a0f50 0x7f2d140a3400 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:20.336 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:20.332+0000 7f2d329c4700 1 --2- 172.21.15.96:0/2893023283 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2d2c0fe600 0x7f2d2c100f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:20.336 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:20.332+0000 7f2d329c4700 1 --2- 172.21.15.96:0/2893023283 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d2c1015d0 0x7f2d2c0ff580 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-08T03:42:20.336 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:20.332+0000 7f2d329c4700 1 -- 172.21.15.96:0/2893023283 >> 172.21.15.96:0/2893023283 conn(0x7f2d2c0f9fa0 msgr2=0x7f2d2c104a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-08T03:42:20.336 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:20.332+0000 7f2d329c4700 1 -- 172.21.15.96:0/2893023283 shutdown_connections 2023-05-08T03:42:20.336 INFO:teuthology.orchestra.run.smithi096.stderr:2023-05-08T03:42:20.332+0000 7f2d329c4700 1 -- 172.21.15.96:0/2893023283 wait complete. 2023-05-08T03:42:20.347 DEBUG:teuthology.orchestra.run.smithi096:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2023-05-08T03:42:20.375 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2023-05-08T03:42:20.386 INFO:teuthology.run_tasks:Running task exec... 2023-05-08T03:42:20.426 INFO:teuthology.task.exec:Executing custom commands... 2023-05-08T03:42:20.426 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi096.front.sepia.ceph.com 2023-05-08T03:42:20.427 DEBUG:teuthology.orchestra.run.smithi096:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -l /tmp/cephfs/ && sudo df -h /tmp/cephfs/' 2023-05-08T03:42:20.465 INFO:teuthology.orchestra.run.smithi096.stdout:total 0 2023-05-08T03:42:20.502 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem Size Used Avail Use% Mounted on 2023-05-08T03:42:20.503 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96:3300,172.21.15.133:3300,172.21.15.186:3300:/volumes/_nogroup/sv_1/7dade95a-6e77-415d-96f3-d57b5eaa857b 340G 0 340G 0% /tmp/cephfs 2023-05-08T03:42:20.504 DEBUG:teuthology.orchestra.run.smithi096:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mkdir -m 755 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres && sudo chown postgres:postgres /tmp/cephfs/postgres' 2023-05-08T03:42:20.597 DEBUG:teuthology.orchestra.run.smithi096:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- mkdir -m 700 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres/data' 2023-05-08T03:42:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:20 smithi186 ceph-mon[126480]: [08/May/2023:03:42:18] ENGINE Serving on https://172.21.15.96:7150 2023-05-08T03:42:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:20 smithi186 ceph-mon[126480]: [08/May/2023:03:42:18] ENGINE Serving on http://172.21.15.96:8765 2023-05-08T03:42:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:20 smithi186 ceph-mon[126480]: [08/May/2023:03:42:18] ENGINE Bus STARTED 2023-05-08T03:42:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:20 smithi186 ceph-mon[126480]: from='client.15297 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1M", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:42:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:20 smithi186 ceph-mon[126480]: pgmap v3: 97 pgs: 97 active+clean; 1.0 MiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail 2023-05-08T03:42:20.620 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:20 smithi096 ceph-mon[124666]: [08/May/2023:03:42:18] ENGINE Serving on https://172.21.15.96:7150 2023-05-08T03:42:20.620 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:20 smithi096 ceph-mon[124666]: [08/May/2023:03:42:18] ENGINE Serving on http://172.21.15.96:8765 2023-05-08T03:42:20.620 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:20 smithi096 ceph-mon[124666]: [08/May/2023:03:42:18] ENGINE Bus STARTED 2023-05-08T03:42:20.621 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:20 smithi096 ceph-mon[124666]: from='client.15297 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1M", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:42:20.621 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:20 smithi096 ceph-mon[124666]: pgmap v3: 97 pgs: 97 active+clean; 1.0 MiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail 2023-05-08T03:42:20.640 DEBUG:teuthology.orchestra.run.smithi096:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo semanage fcontext -a -t postgresql_db_t "/tmp/cephfs/postgres(/.*)?"' 2023-05-08T03:42:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:20 smithi133 ceph-mon[125939]: [08/May/2023:03:42:18] ENGINE Serving on https://172.21.15.96:7150 2023-05-08T03:42:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:20 smithi133 ceph-mon[125939]: [08/May/2023:03:42:18] ENGINE Serving on http://172.21.15.96:8765 2023-05-08T03:42:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:20 smithi133 ceph-mon[125939]: [08/May/2023:03:42:18] ENGINE Bus STARTED 2023-05-08T03:42:20.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:20 smithi133 ceph-mon[125939]: from='client.15297 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1M", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:42:20.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:20 smithi133 ceph-mon[125939]: pgmap v3: 97 pgs: 97 active+clean; 1.0 MiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail 2023-05-08T03:42:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:21 smithi186 ceph-mon[126480]: from='client.15342 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6M3h", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:42:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:21 smithi186 ceph-mon[126480]: from='client.15348 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:42:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:21 smithi186 ceph-mon[126480]: pgmap v4: 97 pgs: 97 active+clean; 1.0 MiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail 2023-05-08T03:42:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:21 smithi186 ceph-mon[126480]: from='client.15354 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:42:21.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:21 smithi186 ceph-mon[126480]: mgrmap e22: x(active, since 3s), standbys: z, y 2023-05-08T03:42:21.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:42:21.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:42:21.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:42:21.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:42:21.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:42:21.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:42:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:21 smithi133 ceph-mon[125939]: from='client.15342 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6M3h", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:42:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:21 smithi133 ceph-mon[125939]: from='client.15348 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:42:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:21 smithi133 ceph-mon[125939]: pgmap v4: 97 pgs: 97 active+clean; 1.0 MiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail 2023-05-08T03:42:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:21 smithi133 ceph-mon[125939]: from='client.15354 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:42:21.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:21 smithi133 ceph-mon[125939]: mgrmap e22: x(active, since 3s), standbys: z, y 2023-05-08T03:42:21.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:42:21.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:42:21.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:42:21.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:42:21.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:42:21.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:42:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:21 smithi096 ceph-mon[124666]: from='client.15342 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6M3h", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:42:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:21 smithi096 ceph-mon[124666]: from='client.15348 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:42:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:21 smithi096 ceph-mon[124666]: pgmap v4: 97 pgs: 97 active+clean; 1.0 MiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail 2023-05-08T03:42:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:21 smithi096 ceph-mon[124666]: from='client.15354 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-05-08T03:42:21.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:21 smithi096 ceph-mon[124666]: mgrmap e22: x(active, since 3s), standbys: z, y 2023-05-08T03:42:21.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:42:21.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:42:21.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:42:21.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:42:21.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:42:21.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:42:23.229 DEBUG:teuthology.orchestra.run.smithi096:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo grep -i postgresql /etc/selinux/targeted/contexts/files/file_contexts.local' 2023-05-08T03:42:23.271 INFO:teuthology.orchestra.run.smithi096.stdout:/tmp/cephfs/postgres(/.*)? system_u:object_r:postgresql_db_t:s0 2023-05-08T03:42:23.274 DEBUG:teuthology.orchestra.run.smithi096:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo restorecon -R -v /tmp/cephfs/postgres' 2023-05-08T03:42:23.340 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:23 smithi096 ceph-mon[124666]: pgmap v5: 97 pgs: 97 active+clean; 1.0 MiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail 2023-05-08T03:42:23.340 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:42:23.340 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:42:23.341 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:42:23.341 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:42:23.341 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:42:23.341 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:42:23.341 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:42:23.341 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:42:23.341 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:42:23.342 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:42:23.342 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:23 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T03:42:23.342 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:42:23.342 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:23 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T03:42:23.342 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:42:23.342 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:23 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T03:42:23.342 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:23 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T03:42:23.343 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:42:23.343 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:42:23.343 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:42:23.343 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:42:23.343 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:42:23.343 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:42:23.343 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:23 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi096 to 196.2M 2023-05-08T03:42:23.343 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:23 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi096 to 205766758: error parsing value: Value '205766758' is below minimum 939524096 2023-05-08T03:42:23.344 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:42:23.344 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:42:23.344 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:23 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:42:23.344 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:23 smithi096 ceph-mon[124666]: Updating smithi096:/etc/ceph/ceph.conf 2023-05-08T03:42:23.344 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:23 smithi096 ceph-mon[124666]: Updating smithi133:/etc/ceph/ceph.conf 2023-05-08T03:42:23.344 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:23 smithi096 ceph-mon[124666]: Updating smithi186:/etc/ceph/ceph.conf 2023-05-08T03:42:23.356 DEBUG:teuthology.orchestra.run.smithi096:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2023-05-08T03:42:23.436 INFO:teuthology.orchestra.run.smithi096.stdout:/tmp/cephfs/postgres/: 2023-05-08T03:42:23.436 INFO:teuthology.orchestra.run.smithi096.stdout:total 0 2023-05-08T03:42:23.436 INFO:teuthology.orchestra.run.smithi096.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 May 8 03:42 . 2023-05-08T03:42:23.436 INFO:teuthology.orchestra.run.smithi096.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 1 May 8 03:42 .. 2023-05-08T03:42:23.437 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 data 2023-05-08T03:42:23.437 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:42:23.437 INFO:teuthology.orchestra.run.smithi096.stdout:/tmp/cephfs/postgres/data: 2023-05-08T03:42:23.437 INFO:teuthology.orchestra.run.smithi096.stdout:total 0 2023-05-08T03:42:23.437 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 . 2023-05-08T03:42:23.437 INFO:teuthology.orchestra.run.smithi096.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 May 8 03:42 .. 2023-05-08T03:42:23.438 DEBUG:teuthology.orchestra.run.smithi096:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mkdir -p /etc/systemd/system/postgresql.service.d/ && printf '"'"'[Service]\nEnvironment=PGDATA=/tmp/cephfs/postgres/data\nEnvironment=PGLOG=/tmp/cephfs/postgres/pgstartup.log\n'"'"' | sudo tee /etc/systemd/system/postgresql.service.d/env.conf' 2023-05-08T03:42:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:23 smithi133 ceph-mon[125939]: pgmap v5: 97 pgs: 97 active+clean; 1.0 MiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail 2023-05-08T03:42:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:42:23.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:42:23.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:42:23.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:42:23.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:42:23.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:42:23.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:42:23.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:42:23.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:42:23.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:42:23.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:23 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T03:42:23.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:42:23.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:23 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T03:42:23.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:42:23.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:23 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T03:42:23.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:23 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T03:42:23.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:42:23.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:42:23.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:42:23.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:42:23.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:42:23.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:42:23.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:23 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi096 to 196.2M 2023-05-08T03:42:23.494 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:23 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi096 to 205766758: error parsing value: Value '205766758' is below minimum 939524096 2023-05-08T03:42:23.494 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:42:23.494 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:42:23.494 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:23 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:42:23.494 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:23 smithi133 ceph-mon[125939]: Updating smithi096:/etc/ceph/ceph.conf 2023-05-08T03:42:23.494 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:23 smithi133 ceph-mon[125939]: Updating smithi133:/etc/ceph/ceph.conf 2023-05-08T03:42:23.494 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:23 smithi133 ceph-mon[125939]: Updating smithi186:/etc/ceph/ceph.conf 2023-05-08T03:42:23.529 INFO:teuthology.orchestra.run.smithi096.stdout:[Service] 2023-05-08T03:42:23.530 INFO:teuthology.orchestra.run.smithi096.stdout:Environment=PGDATA=/tmp/cephfs/postgres/data 2023-05-08T03:42:23.530 INFO:teuthology.orchestra.run.smithi096.stdout:Environment=PGLOG=/tmp/cephfs/postgres/pgstartup.log 2023-05-08T03:42:23.532 DEBUG:teuthology.orchestra.run.smithi096:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- postgresql-setup --initdb' 2023-05-08T03:42:23.614 INFO:teuthology.orchestra.run.smithi096.stderr: * Initializing database in '/tmp/cephfs/postgres/data' 2023-05-08T03:42:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:23 smithi186 ceph-mon[126480]: pgmap v5: 97 pgs: 97 active+clean; 1.0 MiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail 2023-05-08T03:42:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:42:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:42:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:42:23.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:42:23.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:42:23.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:42:23.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:42:23.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:42:23.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:42:23.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:42:23.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:23 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T03:42:23.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:42:23.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:23 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T03:42:23.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:42:23.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:23 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T03:42:23.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:23 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T03:42:23.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:42:23.623 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:42:23.623 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:42:23.623 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:42:23.623 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:42:23.623 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:42:23.623 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:23 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi096 to 196.2M 2023-05-08T03:42:23.623 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:23 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi096 to 205766758: error parsing value: Value '205766758' is below minimum 939524096 2023-05-08T03:42:23.624 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:42:23.624 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:42:23.624 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:23 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:42:23.624 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:23 smithi186 ceph-mon[126480]: Updating smithi096:/etc/ceph/ceph.conf 2023-05-08T03:42:23.624 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:23 smithi186 ceph-mon[126480]: Updating smithi133:/etc/ceph/ceph.conf 2023-05-08T03:42:23.624 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:23 smithi186 ceph-mon[126480]: Updating smithi186:/etc/ceph/ceph.conf 2023-05-08T03:42:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:24 smithi186 ceph-mon[126480]: Updating smithi096:/var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/config/ceph.conf 2023-05-08T03:42:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:24 smithi186 ceph-mon[126480]: Updating smithi133:/var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/config/ceph.conf 2023-05-08T03:42:24.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:24 smithi186 ceph-mon[126480]: Updating smithi186:/var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/config/ceph.conf 2023-05-08T03:42:24.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:24 smithi186 ceph-mon[126480]: Updating smithi096:/etc/ceph/ceph.client.admin.keyring 2023-05-08T03:42:24.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:24 smithi186 ceph-mon[126480]: Updating smithi133:/etc/ceph/ceph.client.admin.keyring 2023-05-08T03:42:24.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:24 smithi186 ceph-mon[126480]: Updating smithi186:/etc/ceph/ceph.client.admin.keyring 2023-05-08T03:42:24.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:24 smithi186 ceph-mon[126480]: Updating smithi096:/var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/config/ceph.client.admin.keyring 2023-05-08T03:42:24.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:24 smithi186 ceph-mon[126480]: Updating smithi133:/var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/config/ceph.client.admin.keyring 2023-05-08T03:42:24.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:24 smithi186 ceph-mon[126480]: Updating smithi186:/var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/config/ceph.client.admin.keyring 2023-05-08T03:42:24.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:42:24.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:42:24.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:42:24.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:42:24.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:42:24.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:42:24.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:42:24.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:24 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T03:42:24.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:24 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T03:42:24.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:24 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:42:24.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:42:24.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:42:24.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:42:24.623 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:42:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:24 smithi133 ceph-mon[125939]: Updating smithi096:/var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/config/ceph.conf 2023-05-08T03:42:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:24 smithi133 ceph-mon[125939]: Updating smithi133:/var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/config/ceph.conf 2023-05-08T03:42:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:24 smithi133 ceph-mon[125939]: Updating smithi186:/var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/config/ceph.conf 2023-05-08T03:42:24.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:24 smithi133 ceph-mon[125939]: Updating smithi096:/etc/ceph/ceph.client.admin.keyring 2023-05-08T03:42:24.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:24 smithi133 ceph-mon[125939]: Updating smithi133:/etc/ceph/ceph.client.admin.keyring 2023-05-08T03:42:24.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:24 smithi133 ceph-mon[125939]: Updating smithi186:/etc/ceph/ceph.client.admin.keyring 2023-05-08T03:42:24.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:24 smithi133 ceph-mon[125939]: Updating smithi096:/var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/config/ceph.client.admin.keyring 2023-05-08T03:42:24.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:24 smithi133 ceph-mon[125939]: Updating smithi133:/var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/config/ceph.client.admin.keyring 2023-05-08T03:42:24.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:24 smithi133 ceph-mon[125939]: Updating smithi186:/var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/config/ceph.client.admin.keyring 2023-05-08T03:42:24.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:42:24.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:42:24.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:42:24.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:42:24.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:42:24.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:42:24.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:42:24.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:24 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T03:42:24.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:24 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T03:42:24.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:24 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:42:24.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:42:24.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:42:24.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:42:24.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:42:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:24 smithi096 ceph-mon[124666]: Updating smithi096:/var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/config/ceph.conf 2023-05-08T03:42:24.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:24 smithi096 ceph-mon[124666]: Updating smithi133:/var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/config/ceph.conf 2023-05-08T03:42:24.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:24 smithi096 ceph-mon[124666]: Updating smithi186:/var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/config/ceph.conf 2023-05-08T03:42:24.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:24 smithi096 ceph-mon[124666]: Updating smithi096:/etc/ceph/ceph.client.admin.keyring 2023-05-08T03:42:24.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:24 smithi096 ceph-mon[124666]: Updating smithi133:/etc/ceph/ceph.client.admin.keyring 2023-05-08T03:42:24.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:24 smithi096 ceph-mon[124666]: Updating smithi186:/etc/ceph/ceph.client.admin.keyring 2023-05-08T03:42:24.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:24 smithi096 ceph-mon[124666]: Updating smithi096:/var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/config/ceph.client.admin.keyring 2023-05-08T03:42:24.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:24 smithi096 ceph-mon[124666]: Updating smithi133:/var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/config/ceph.client.admin.keyring 2023-05-08T03:42:24.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:24 smithi096 ceph-mon[124666]: Updating smithi186:/var/lib/ceph/f7ffcfb0-ed50-11ed-9b01-001a4aab830c/config/ceph.client.admin.keyring 2023-05-08T03:42:24.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:42:24.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:42:24.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:42:24.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:42:24.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:42:24.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:42:24.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:42:24.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:24 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T03:42:24.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:24 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T03:42:24.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:24 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:42:24.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:42:24.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:42:24.759 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:42:24.759 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:42:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:25 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:42:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:25 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T03:42:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:25 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T03:42:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:25 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:42:25.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:25 smithi186 ceph-mon[126480]: pgmap v6: 97 pgs: 97 active+clean; 1.0 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s rd, 410 B/s wr, 1 op/s 2023-05-08T03:42:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:25 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:42:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:25 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T03:42:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:25 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T03:42:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:25 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:42:25.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:25 smithi133 ceph-mon[125939]: pgmap v6: 97 pgs: 97 active+clean; 1.0 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s rd, 410 B/s wr, 1 op/s 2023-05-08T03:42:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:25 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:42:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:25 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T03:42:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:25 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T03:42:25.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:25 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:42:25.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:25 smithi096 ceph-mon[124666]: pgmap v6: 97 pgs: 97 active+clean; 1.0 MiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s rd, 410 B/s wr, 1 op/s 2023-05-08T03:42:26.035 INFO:teuthology.orchestra.run.smithi096.stderr: * Initialized, logs are in /var/lib/pgsql/initdb_postgresql.log 2023-05-08T03:42:26.038 DEBUG:teuthology.orchestra.run.smithi096:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2023-05-08T03:42:26.081 INFO:teuthology.orchestra.run.smithi096.stdout:/tmp/cephfs/postgres/: 2023-05-08T03:42:26.081 INFO:teuthology.orchestra.run.smithi096.stdout:total 0 2023-05-08T03:42:26.081 INFO:teuthology.orchestra.run.smithi096.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 May 8 03:42 . 2023-05-08T03:42:26.082 INFO:teuthology.orchestra.run.smithi096.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 1 May 8 03:42 .. 2023-05-08T03:42:26.082 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 May 8 03:42 data 2023-05-08T03:42:26.082 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:42:26.082 INFO:teuthology.orchestra.run.smithi096.stdout:/tmp/cephfs/postgres/data: 2023-05-08T03:42:26.082 INFO:teuthology.orchestra.run.smithi096.stdout:total 30 2023-05-08T03:42:26.082 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 May 8 03:42 . 2023-05-08T03:42:26.082 INFO:teuthology.orchestra.run.smithi096.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 May 8 03:42 .. 2023-05-08T03:42:26.083 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 May 8 03:42 base 2023-05-08T03:42:26.083 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 58 May 8 03:42 global 2023-05-08T03:42:26.083 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 log 2023-05-08T03:42:26.083 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 pg_commit_ts 2023-05-08T03:42:26.083 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 pg_dynshmem 2023-05-08T03:42:26.083 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 4269 May 8 03:42 pg_hba.conf 2023-05-08T03:42:26.083 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1636 May 8 03:42 pg_ident.conf 2023-05-08T03:42:26.083 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 May 8 03:42 pg_logical 2023-05-08T03:42:26.084 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 May 8 03:42 pg_multixact 2023-05-08T03:42:26.084 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 May 8 03:42 pg_notify 2023-05-08T03:42:26.084 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 pg_replslot 2023-05-08T03:42:26.084 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 pg_serial 2023-05-08T03:42:26.084 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 pg_snapshots 2023-05-08T03:42:26.084 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 pg_stat 2023-05-08T03:42:26.085 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 pg_stat_tmp 2023-05-08T03:42:26.085 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 May 8 03:42 pg_subtrans 2023-05-08T03:42:26.085 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 pg_tblspc 2023-05-08T03:42:26.085 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 pg_twophase 2023-05-08T03:42:26.085 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 May 8 03:42 PG_VERSION 2023-05-08T03:42:26.085 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 2 May 8 03:42 pg_wal 2023-05-08T03:42:26.085 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 May 8 03:42 pg_xact 2023-05-08T03:42:26.086 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 88 May 8 03:42 postgresql.auto.conf 2023-05-08T03:42:26.086 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 22989 May 8 03:42 postgresql.conf 2023-05-08T03:42:26.086 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:42:26.086 INFO:teuthology.orchestra.run.smithi096.stdout:/tmp/cephfs/postgres/data/base: 2023-05-08T03:42:26.086 INFO:teuthology.orchestra.run.smithi096.stdout:total 0 2023-05-08T03:42:26.086 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 May 8 03:42 . 2023-05-08T03:42:26.086 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 May 8 03:42 .. 2023-05-08T03:42:26.086 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 293 May 8 03:42 1 2023-05-08T03:42:26.087 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 293 May 8 03:42 12346 2023-05-08T03:42:26.087 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 293 May 8 03:42 12347 2023-05-08T03:42:26.087 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:42:26.087 INFO:teuthology.orchestra.run.smithi096.stdout:/tmp/cephfs/postgres/data/base/1: 2023-05-08T03:42:26.087 INFO:teuthology.orchestra.run.smithi096.stdout:total 7209 2023-05-08T03:42:26.087 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 293 May 8 03:42 . 2023-05-08T03:42:26.088 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 May 8 03:42 .. 2023-05-08T03:42:26.088 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 112 2023-05-08T03:42:26.089 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 113 2023-05-08T03:42:26.089 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 May 8 03:42 12182 2023-05-08T03:42:26.089 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 12182_fsm 2023-05-08T03:42:26.089 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 12182_vm 2023-05-08T03:42:26.089 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 12184 2023-05-08T03:42:26.089 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 12186 2023-05-08T03:42:26.089 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 12187 2023-05-08T03:42:26.090 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 12187_fsm 2023-05-08T03:42:26.090 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 12187_vm 2023-05-08T03:42:26.090 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 12189 2023-05-08T03:42:26.090 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 12191 2023-05-08T03:42:26.090 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 12192 2023-05-08T03:42:26.090 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 12192_fsm 2023-05-08T03:42:26.090 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 12192_vm 2023-05-08T03:42:26.090 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 12194 2023-05-08T03:42:26.091 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 12196 2023-05-08T03:42:26.091 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 12197 2023-05-08T03:42:26.091 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 12197_fsm 2023-05-08T03:42:26.091 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 12197_vm 2023-05-08T03:42:26.091 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 12199 2023-05-08T03:42:26.091 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 12201 2023-05-08T03:42:26.091 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 12202 2023-05-08T03:42:26.091 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 12202_fsm 2023-05-08T03:42:26.092 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 12202_vm 2023-05-08T03:42:26.092 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 12204 2023-05-08T03:42:26.092 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 12206 2023-05-08T03:42:26.092 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 12207 2023-05-08T03:42:26.092 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 12207_fsm 2023-05-08T03:42:26.092 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 12207_vm 2023-05-08T03:42:26.092 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 12209 2023-05-08T03:42:26.092 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 12211 2023-05-08T03:42:26.093 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 12212 2023-05-08T03:42:26.093 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 12214 2023-05-08T03:42:26.093 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 12216 2023-05-08T03:42:26.093 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 May 8 03:42 1247 2023-05-08T03:42:26.093 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 1247_fsm 2023-05-08T03:42:26.093 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 1247_vm 2023-05-08T03:42:26.093 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 May 8 03:42 1249 2023-05-08T03:42:26.093 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 1249_fsm 2023-05-08T03:42:26.094 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 1249_vm 2023-05-08T03:42:26.094 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 May 8 03:42 1255 2023-05-08T03:42:26.094 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 1255_fsm 2023-05-08T03:42:26.094 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 1255_vm 2023-05-08T03:42:26.094 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 May 8 03:42 1259 2023-05-08T03:42:26.094 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 1259_fsm 2023-05-08T03:42:26.094 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 1259_vm 2023-05-08T03:42:26.095 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 1417 2023-05-08T03:42:26.095 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 1417_vm 2023-05-08T03:42:26.095 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 1418 2023-05-08T03:42:26.095 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 1418_vm 2023-05-08T03:42:26.095 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 174 2023-05-08T03:42:26.095 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 175 2023-05-08T03:42:26.095 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2187 2023-05-08T03:42:26.095 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 2224 2023-05-08T03:42:26.096 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 2224_vm 2023-05-08T03:42:26.096 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 2328 2023-05-08T03:42:26.096 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 2328_vm 2023-05-08T03:42:26.096 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 2336 2023-05-08T03:42:26.096 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 2336_vm 2023-05-08T03:42:26.096 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2337 2023-05-08T03:42:26.096 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2600 2023-05-08T03:42:26.097 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 2600_fsm 2023-05-08T03:42:26.097 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2600_vm 2023-05-08T03:42:26.097 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2601 2023-05-08T03:42:26.097 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 2601_fsm 2023-05-08T03:42:26.097 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2601_vm 2023-05-08T03:42:26.097 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 8 03:42 2602 2023-05-08T03:42:26.097 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 2602_fsm 2023-05-08T03:42:26.097 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2602_vm 2023-05-08T03:42:26.098 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 8 03:42 2603 2023-05-08T03:42:26.098 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 2603_fsm 2023-05-08T03:42:26.098 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2603_vm 2023-05-08T03:42:26.098 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 2604 2023-05-08T03:42:26.098 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 2604_vm 2023-05-08T03:42:26.098 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2605 2023-05-08T03:42:26.098 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 2605_fsm 2023-05-08T03:42:26.098 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2605_vm 2023-05-08T03:42:26.099 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2606 2023-05-08T03:42:26.099 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 2606_fsm 2023-05-08T03:42:26.099 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2606_vm 2023-05-08T03:42:26.099 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 2607 2023-05-08T03:42:26.099 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 2607_fsm 2023-05-08T03:42:26.099 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2607_vm 2023-05-08T03:42:26.099 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 442368 May 8 03:42 2608 2023-05-08T03:42:26.099 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 2608_fsm 2023-05-08T03:42:26.100 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2608_vm 2023-05-08T03:42:26.100 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 May 8 03:42 2609 2023-05-08T03:42:26.100 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 2609_fsm 2023-05-08T03:42:26.100 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2609_vm 2023-05-08T03:42:26.100 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 2610 2023-05-08T03:42:26.100 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 2610_fsm 2023-05-08T03:42:26.100 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2610_vm 2023-05-08T03:42:26.100 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 2611 2023-05-08T03:42:26.101 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 2611_vm 2023-05-08T03:42:26.101 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2612 2023-05-08T03:42:26.101 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 2612_fsm 2023-05-08T03:42:26.101 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2612_vm 2023-05-08T03:42:26.101 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 2613 2023-05-08T03:42:26.101 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 2613_vm 2023-05-08T03:42:26.101 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2615 2023-05-08T03:42:26.101 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 2615_fsm 2023-05-08T03:42:26.102 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2615_vm 2023-05-08T03:42:26.102 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 2616 2023-05-08T03:42:26.102 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 2616_fsm 2023-05-08T03:42:26.102 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2616_vm 2023-05-08T03:42:26.102 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 May 8 03:42 2617 2023-05-08T03:42:26.102 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 2617_fsm 2023-05-08T03:42:26.102 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2617_vm 2023-05-08T03:42:26.102 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 May 8 03:42 2618 2023-05-08T03:42:26.103 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 2618_fsm 2023-05-08T03:42:26.103 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2618_vm 2023-05-08T03:42:26.103 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 May 8 03:42 2619 2023-05-08T03:42:26.103 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 2619_fsm 2023-05-08T03:42:26.104 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2619_vm 2023-05-08T03:42:26.104 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 2620 2023-05-08T03:42:26.104 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 2620_vm 2023-05-08T03:42:26.104 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2650 2023-05-08T03:42:26.104 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2651 2023-05-08T03:42:26.104 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2652 2023-05-08T03:42:26.104 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 8 03:42 2653 2023-05-08T03:42:26.105 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 8 03:42 2654 2023-05-08T03:42:26.105 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 8 03:42 2655 2023-05-08T03:42:26.105 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2656 2023-05-08T03:42:26.105 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2657 2023-05-08T03:42:26.105 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 May 8 03:42 2658 2023-05-08T03:42:26.105 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 May 8 03:42 2659 2023-05-08T03:42:26.105 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2660 2023-05-08T03:42:26.105 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2661 2023-05-08T03:42:26.106 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 8 03:42 2662 2023-05-08T03:42:26.106 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 8 03:42 2663 2023-05-08T03:42:26.106 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2664 2023-05-08T03:42:26.106 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2665 2023-05-08T03:42:26.106 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2666 2023-05-08T03:42:26.106 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2667 2023-05-08T03:42:26.106 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2668 2023-05-08T03:42:26.107 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2669 2023-05-08T03:42:26.107 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2670 2023-05-08T03:42:26.107 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 327680 May 8 03:42 2673 2023-05-08T03:42:26.107 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 385024 May 8 03:42 2674 2023-05-08T03:42:26.107 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 May 8 03:42 2675 2023-05-08T03:42:26.107 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2678 2023-05-08T03:42:26.107 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2679 2023-05-08T03:42:26.108 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2680 2023-05-08T03:42:26.108 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2681 2023-05-08T03:42:26.108 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2682 2023-05-08T03:42:26.108 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2683 2023-05-08T03:42:26.108 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2684 2023-05-08T03:42:26.108 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2685 2023-05-08T03:42:26.108 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2686 2023-05-08T03:42:26.109 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2687 2023-05-08T03:42:26.109 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 8 03:42 2688 2023-05-08T03:42:26.109 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 8 03:42 2689 2023-05-08T03:42:26.109 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 May 8 03:42 2690 2023-05-08T03:42:26.109 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 May 8 03:42 2691 2023-05-08T03:42:26.109 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2692 2023-05-08T03:42:26.109 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2693 2023-05-08T03:42:26.109 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2696 2023-05-08T03:42:26.110 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2699 2023-05-08T03:42:26.110 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2701 2023-05-08T03:42:26.110 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2702 2023-05-08T03:42:26.110 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2703 2023-05-08T03:42:26.110 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 8 03:42 2704 2023-05-08T03:42:26.110 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2753 2023-05-08T03:42:26.110 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 2753_fsm 2023-05-08T03:42:26.110 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2753_vm 2023-05-08T03:42:26.111 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2754 2023-05-08T03:42:26.111 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2755 2023-05-08T03:42:26.111 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 8 03:42 2756 2023-05-08T03:42:26.111 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 8 03:42 2757 2023-05-08T03:42:26.111 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 2830 2023-05-08T03:42:26.111 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 2830_vm 2023-05-08T03:42:26.111 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2831 2023-05-08T03:42:26.112 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 2832 2023-05-08T03:42:26.112 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 2832_vm 2023-05-08T03:42:26.112 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2833 2023-05-08T03:42:26.112 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 2834 2023-05-08T03:42:26.112 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 2834_vm 2023-05-08T03:42:26.112 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2835 2023-05-08T03:42:26.112 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 2836 2023-05-08T03:42:26.112 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 2836_vm 2023-05-08T03:42:26.113 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2837 2023-05-08T03:42:26.113 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 May 8 03:42 2838 2023-05-08T03:42:26.113 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 2838_fsm 2023-05-08T03:42:26.113 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2838_vm 2023-05-08T03:42:26.113 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2839 2023-05-08T03:42:26.113 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 2840 2023-05-08T03:42:26.113 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 2840_fsm 2023-05-08T03:42:26.113 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2840_vm 2023-05-08T03:42:26.114 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2841 2023-05-08T03:42:26.114 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 2995 2023-05-08T03:42:26.114 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 2995_vm 2023-05-08T03:42:26.114 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2996 2023-05-08T03:42:26.114 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3079 2023-05-08T03:42:26.114 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 3079_fsm 2023-05-08T03:42:26.114 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3079_vm 2023-05-08T03:42:26.114 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 3080 2023-05-08T03:42:26.115 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 3081 2023-05-08T03:42:26.115 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 3085 2023-05-08T03:42:26.115 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 3118 2023-05-08T03:42:26.115 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 3118_vm 2023-05-08T03:42:26.115 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3119 2023-05-08T03:42:26.115 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 3164 2023-05-08T03:42:26.115 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 3256 2023-05-08T03:42:26.115 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 3256_vm 2023-05-08T03:42:26.116 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3257 2023-05-08T03:42:26.116 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3258 2023-05-08T03:42:26.116 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 3350 2023-05-08T03:42:26.116 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 3350_vm 2023-05-08T03:42:26.116 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3351 2023-05-08T03:42:26.116 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3379 2023-05-08T03:42:26.116 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3380 2023-05-08T03:42:26.117 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 3381 2023-05-08T03:42:26.117 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 3381_vm 2023-05-08T03:42:26.117 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 3394 2023-05-08T03:42:26.117 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 3394_fsm 2023-05-08T03:42:26.117 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3394_vm 2023-05-08T03:42:26.117 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 3395 2023-05-08T03:42:26.117 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 3439 2023-05-08T03:42:26.117 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 3439_vm 2023-05-08T03:42:26.118 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3440 2023-05-08T03:42:26.118 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 8 03:42 3455 2023-05-08T03:42:26.118 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 3456 2023-05-08T03:42:26.118 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 3456_fsm 2023-05-08T03:42:26.118 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3456_vm 2023-05-08T03:42:26.118 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 3466 2023-05-08T03:42:26.118 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 3466_vm 2023-05-08T03:42:26.119 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3467 2023-05-08T03:42:26.119 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3468 2023-05-08T03:42:26.119 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 3501 2023-05-08T03:42:26.119 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 3501_vm 2023-05-08T03:42:26.119 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3502 2023-05-08T03:42:26.119 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3503 2023-05-08T03:42:26.119 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3534 2023-05-08T03:42:26.119 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3541 2023-05-08T03:42:26.120 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 3541_fsm 2023-05-08T03:42:26.120 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3541_vm 2023-05-08T03:42:26.120 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 3542 2023-05-08T03:42:26.120 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3574 2023-05-08T03:42:26.120 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3575 2023-05-08T03:42:26.120 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 3576 2023-05-08T03:42:26.120 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 3576_vm 2023-05-08T03:42:26.120 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 3596 2023-05-08T03:42:26.121 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 3596_vm 2023-05-08T03:42:26.121 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3597 2023-05-08T03:42:26.121 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 3598 2023-05-08T03:42:26.121 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 3598_vm 2023-05-08T03:42:26.121 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3599 2023-05-08T03:42:26.121 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3600 2023-05-08T03:42:26.121 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 3600_fsm 2023-05-08T03:42:26.122 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3600_vm 2023-05-08T03:42:26.122 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3601 2023-05-08T03:42:26.122 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 3601_fsm 2023-05-08T03:42:26.122 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3601_vm 2023-05-08T03:42:26.122 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3602 2023-05-08T03:42:26.122 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 3602_fsm 2023-05-08T03:42:26.122 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3602_vm 2023-05-08T03:42:26.123 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 3603 2023-05-08T03:42:26.123 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 3603_fsm 2023-05-08T03:42:26.123 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3603_vm 2023-05-08T03:42:26.123 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 3604 2023-05-08T03:42:26.123 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 3605 2023-05-08T03:42:26.123 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 3606 2023-05-08T03:42:26.126 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 3607 2023-05-08T03:42:26.126 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 3608 2023-05-08T03:42:26.126 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 8 03:42 3609 2023-05-08T03:42:26.126 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 3712 2023-05-08T03:42:26.127 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3764 2023-05-08T03:42:26.127 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 3764_fsm 2023-05-08T03:42:26.127 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3764_vm 2023-05-08T03:42:26.127 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 3766 2023-05-08T03:42:26.127 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 3767 2023-05-08T03:42:26.127 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3997 2023-05-08T03:42:26.127 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 5002 2023-05-08T03:42:26.128 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 548 2023-05-08T03:42:26.128 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 549 2023-05-08T03:42:26.128 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 6102 2023-05-08T03:42:26.128 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 6102_vm 2023-05-08T03:42:26.128 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 6104 2023-05-08T03:42:26.128 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 6104_vm 2023-05-08T03:42:26.128 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 6106 2023-05-08T03:42:26.129 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 6106_vm 2023-05-08T03:42:26.129 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 6110 2023-05-08T03:42:26.129 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 6111 2023-05-08T03:42:26.129 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 6112 2023-05-08T03:42:26.129 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 6113 2023-05-08T03:42:26.129 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 6117 2023-05-08T03:42:26.129 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 826 2023-05-08T03:42:26.130 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 826_vm 2023-05-08T03:42:26.130 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 827 2023-05-08T03:42:26.130 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 828 2023-05-08T03:42:26.130 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 May 8 03:42 pg_filenode.map 2023-05-08T03:42:26.130 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 May 8 03:42 PG_VERSION 2023-05-08T03:42:26.130 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:42:26.130 INFO:teuthology.orchestra.run.smithi096.stdout:/tmp/cephfs/postgres/data/base/12346: 2023-05-08T03:42:26.131 INFO:teuthology.orchestra.run.smithi096.stdout:total 7209 2023-05-08T03:42:26.131 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 293 May 8 03:42 . 2023-05-08T03:42:26.131 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 May 8 03:42 .. 2023-05-08T03:42:26.131 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 112 2023-05-08T03:42:26.131 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 113 2023-05-08T03:42:26.131 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 May 8 03:42 12182 2023-05-08T03:42:26.132 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 12182_fsm 2023-05-08T03:42:26.132 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 12182_vm 2023-05-08T03:42:26.132 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 12184 2023-05-08T03:42:26.132 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 12186 2023-05-08T03:42:26.132 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 12187 2023-05-08T03:42:26.132 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 12187_fsm 2023-05-08T03:42:26.133 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 12187_vm 2023-05-08T03:42:26.133 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 12189 2023-05-08T03:42:26.133 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 12191 2023-05-08T03:42:26.133 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 12192 2023-05-08T03:42:26.133 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 12192_fsm 2023-05-08T03:42:26.133 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 12192_vm 2023-05-08T03:42:26.133 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 12194 2023-05-08T03:42:26.134 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 12196 2023-05-08T03:42:26.134 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 12197 2023-05-08T03:42:26.134 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 12197_fsm 2023-05-08T03:42:26.134 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 12197_vm 2023-05-08T03:42:26.134 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 12199 2023-05-08T03:42:26.134 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 12201 2023-05-08T03:42:26.135 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 12202 2023-05-08T03:42:26.135 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 12202_fsm 2023-05-08T03:42:26.135 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 12202_vm 2023-05-08T03:42:26.135 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 12204 2023-05-08T03:42:26.135 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 12206 2023-05-08T03:42:26.135 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 12207 2023-05-08T03:42:26.135 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 12207_fsm 2023-05-08T03:42:26.135 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 12207_vm 2023-05-08T03:42:26.136 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 12209 2023-05-08T03:42:26.136 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 12211 2023-05-08T03:42:26.136 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 12212 2023-05-08T03:42:26.136 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 12214 2023-05-08T03:42:26.136 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 12216 2023-05-08T03:42:26.136 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 May 8 03:42 1247 2023-05-08T03:42:26.136 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 1247_fsm 2023-05-08T03:42:26.137 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 1247_vm 2023-05-08T03:42:26.137 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 May 8 03:42 1249 2023-05-08T03:42:26.137 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 1249_fsm 2023-05-08T03:42:26.137 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 1249_vm 2023-05-08T03:42:26.137 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 May 8 03:42 1255 2023-05-08T03:42:26.137 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 1255_fsm 2023-05-08T03:42:26.137 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 1255_vm 2023-05-08T03:42:26.137 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 May 8 03:42 1259 2023-05-08T03:42:26.138 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 1259_fsm 2023-05-08T03:42:26.138 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 1259_vm 2023-05-08T03:42:26.138 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 1417 2023-05-08T03:42:26.138 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 1417_vm 2023-05-08T03:42:26.138 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 1418 2023-05-08T03:42:26.138 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 1418_vm 2023-05-08T03:42:26.138 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 174 2023-05-08T03:42:26.138 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 175 2023-05-08T03:42:26.139 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2187 2023-05-08T03:42:26.139 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 2224 2023-05-08T03:42:26.139 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 2224_vm 2023-05-08T03:42:26.139 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 2328 2023-05-08T03:42:26.139 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 2328_vm 2023-05-08T03:42:26.139 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 2336 2023-05-08T03:42:26.139 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 2336_vm 2023-05-08T03:42:26.140 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2337 2023-05-08T03:42:26.140 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2600 2023-05-08T03:42:26.140 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 2600_fsm 2023-05-08T03:42:26.140 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2600_vm 2023-05-08T03:42:26.140 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2601 2023-05-08T03:42:26.141 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 2601_fsm 2023-05-08T03:42:26.141 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2601_vm 2023-05-08T03:42:26.141 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 8 03:42 2602 2023-05-08T03:42:26.141 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 2602_fsm 2023-05-08T03:42:26.141 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2602_vm 2023-05-08T03:42:26.141 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 8 03:42 2603 2023-05-08T03:42:26.141 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 2603_fsm 2023-05-08T03:42:26.142 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2603_vm 2023-05-08T03:42:26.142 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 2604 2023-05-08T03:42:26.142 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 2604_vm 2023-05-08T03:42:26.142 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2605 2023-05-08T03:42:26.142 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 2605_fsm 2023-05-08T03:42:26.142 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2605_vm 2023-05-08T03:42:26.142 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2606 2023-05-08T03:42:26.142 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 2606_fsm 2023-05-08T03:42:26.143 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2606_vm 2023-05-08T03:42:26.143 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 2607 2023-05-08T03:42:26.143 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 2607_fsm 2023-05-08T03:42:26.143 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2607_vm 2023-05-08T03:42:26.143 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 442368 May 8 03:42 2608 2023-05-08T03:42:26.143 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 2608_fsm 2023-05-08T03:42:26.143 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2608_vm 2023-05-08T03:42:26.144 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 May 8 03:42 2609 2023-05-08T03:42:26.144 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 2609_fsm 2023-05-08T03:42:26.144 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2609_vm 2023-05-08T03:42:26.144 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 2610 2023-05-08T03:42:26.144 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 2610_fsm 2023-05-08T03:42:26.144 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2610_vm 2023-05-08T03:42:26.144 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 2611 2023-05-08T03:42:26.144 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 2611_vm 2023-05-08T03:42:26.145 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2612 2023-05-08T03:42:26.145 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 2612_fsm 2023-05-08T03:42:26.145 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2612_vm 2023-05-08T03:42:26.145 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 2613 2023-05-08T03:42:26.145 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 2613_vm 2023-05-08T03:42:26.145 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2615 2023-05-08T03:42:26.145 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 2615_fsm 2023-05-08T03:42:26.145 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2615_vm 2023-05-08T03:42:26.146 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 2616 2023-05-08T03:42:26.146 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 2616_fsm 2023-05-08T03:42:26.146 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2616_vm 2023-05-08T03:42:26.146 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 May 8 03:42 2617 2023-05-08T03:42:26.146 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 2617_fsm 2023-05-08T03:42:26.146 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2617_vm 2023-05-08T03:42:26.146 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 May 8 03:42 2618 2023-05-08T03:42:26.146 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 2618_fsm 2023-05-08T03:42:26.147 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2618_vm 2023-05-08T03:42:26.147 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 May 8 03:42 2619 2023-05-08T03:42:26.147 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 2619_fsm 2023-05-08T03:42:26.147 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2619_vm 2023-05-08T03:42:26.147 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 2620 2023-05-08T03:42:26.147 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 2620_vm 2023-05-08T03:42:26.147 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2650 2023-05-08T03:42:26.147 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2651 2023-05-08T03:42:26.148 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2652 2023-05-08T03:42:26.148 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 8 03:42 2653 2023-05-08T03:42:26.148 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 8 03:42 2654 2023-05-08T03:42:26.148 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 8 03:42 2655 2023-05-08T03:42:26.148 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2656 2023-05-08T03:42:26.148 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2657 2023-05-08T03:42:26.148 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 May 8 03:42 2658 2023-05-08T03:42:26.149 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 May 8 03:42 2659 2023-05-08T03:42:26.149 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2660 2023-05-08T03:42:26.149 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2661 2023-05-08T03:42:26.149 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 8 03:42 2662 2023-05-08T03:42:26.149 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 8 03:42 2663 2023-05-08T03:42:26.149 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2664 2023-05-08T03:42:26.149 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2665 2023-05-08T03:42:26.149 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2666 2023-05-08T03:42:26.150 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2667 2023-05-08T03:42:26.150 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2668 2023-05-08T03:42:26.150 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2669 2023-05-08T03:42:26.150 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2670 2023-05-08T03:42:26.150 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 327680 May 8 03:42 2673 2023-05-08T03:42:26.150 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 385024 May 8 03:42 2674 2023-05-08T03:42:26.150 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 May 8 03:42 2675 2023-05-08T03:42:26.150 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2678 2023-05-08T03:42:26.151 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2679 2023-05-08T03:42:26.151 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2680 2023-05-08T03:42:26.151 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2681 2023-05-08T03:42:26.151 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2682 2023-05-08T03:42:26.151 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2683 2023-05-08T03:42:26.151 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2684 2023-05-08T03:42:26.151 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2685 2023-05-08T03:42:26.152 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2686 2023-05-08T03:42:26.152 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2687 2023-05-08T03:42:26.152 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 8 03:42 2688 2023-05-08T03:42:26.152 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 8 03:42 2689 2023-05-08T03:42:26.152 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 May 8 03:42 2690 2023-05-08T03:42:26.152 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 May 8 03:42 2691 2023-05-08T03:42:26.152 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2692 2023-05-08T03:42:26.152 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2693 2023-05-08T03:42:26.153 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2696 2023-05-08T03:42:26.153 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2699 2023-05-08T03:42:26.153 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2701 2023-05-08T03:42:26.153 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2702 2023-05-08T03:42:26.153 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2703 2023-05-08T03:42:26.153 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 8 03:42 2704 2023-05-08T03:42:26.153 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2753 2023-05-08T03:42:26.153 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 2753_fsm 2023-05-08T03:42:26.154 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2753_vm 2023-05-08T03:42:26.154 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2754 2023-05-08T03:42:26.154 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2755 2023-05-08T03:42:26.154 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 8 03:42 2756 2023-05-08T03:42:26.154 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 8 03:42 2757 2023-05-08T03:42:26.154 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 2830 2023-05-08T03:42:26.154 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 2830_vm 2023-05-08T03:42:26.154 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2831 2023-05-08T03:42:26.155 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 2832 2023-05-08T03:42:26.155 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 2832_vm 2023-05-08T03:42:26.155 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2833 2023-05-08T03:42:26.155 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 2834 2023-05-08T03:42:26.155 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 2834_vm 2023-05-08T03:42:26.155 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2835 2023-05-08T03:42:26.155 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 2836 2023-05-08T03:42:26.156 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 2836_vm 2023-05-08T03:42:26.156 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2837 2023-05-08T03:42:26.156 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 May 8 03:42 2838 2023-05-08T03:42:26.156 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 2838_fsm 2023-05-08T03:42:26.156 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2838_vm 2023-05-08T03:42:26.156 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2839 2023-05-08T03:42:26.157 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 2840 2023-05-08T03:42:26.157 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 2840_fsm 2023-05-08T03:42:26.157 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2840_vm 2023-05-08T03:42:26.157 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2841 2023-05-08T03:42:26.157 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 2995 2023-05-08T03:42:26.157 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 2995_vm 2023-05-08T03:42:26.157 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2996 2023-05-08T03:42:26.158 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3079 2023-05-08T03:42:26.158 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 3079_fsm 2023-05-08T03:42:26.158 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3079_vm 2023-05-08T03:42:26.158 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 3080 2023-05-08T03:42:26.158 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 3081 2023-05-08T03:42:26.158 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 3085 2023-05-08T03:42:26.159 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 3118 2023-05-08T03:42:26.159 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 3118_vm 2023-05-08T03:42:26.159 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3119 2023-05-08T03:42:26.159 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 3164 2023-05-08T03:42:26.159 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 3256 2023-05-08T03:42:26.159 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 3256_vm 2023-05-08T03:42:26.160 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3257 2023-05-08T03:42:26.160 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3258 2023-05-08T03:42:26.160 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 3350 2023-05-08T03:42:26.160 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 3350_vm 2023-05-08T03:42:26.160 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3351 2023-05-08T03:42:26.160 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3379 2023-05-08T03:42:26.160 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3380 2023-05-08T03:42:26.160 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 3381 2023-05-08T03:42:26.161 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 3381_vm 2023-05-08T03:42:26.161 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 3394 2023-05-08T03:42:26.161 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 3394_fsm 2023-05-08T03:42:26.161 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3394_vm 2023-05-08T03:42:26.161 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 3395 2023-05-08T03:42:26.161 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 3439 2023-05-08T03:42:26.161 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 3439_vm 2023-05-08T03:42:26.162 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3440 2023-05-08T03:42:26.162 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 8 03:42 3455 2023-05-08T03:42:26.162 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 3456 2023-05-08T03:42:26.162 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 3456_fsm 2023-05-08T03:42:26.162 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3456_vm 2023-05-08T03:42:26.162 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 3466 2023-05-08T03:42:26.162 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 3466_vm 2023-05-08T03:42:26.162 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3467 2023-05-08T03:42:26.163 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3468 2023-05-08T03:42:26.163 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 3501 2023-05-08T03:42:26.163 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 3501_vm 2023-05-08T03:42:26.163 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3502 2023-05-08T03:42:26.163 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3503 2023-05-08T03:42:26.163 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3534 2023-05-08T03:42:26.163 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3541 2023-05-08T03:42:26.163 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 3541_fsm 2023-05-08T03:42:26.164 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3541_vm 2023-05-08T03:42:26.164 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 3542 2023-05-08T03:42:26.164 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3574 2023-05-08T03:42:26.164 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3575 2023-05-08T03:42:26.164 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 3576 2023-05-08T03:42:26.164 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 3576_vm 2023-05-08T03:42:26.164 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 3596 2023-05-08T03:42:26.165 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 3596_vm 2023-05-08T03:42:26.165 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3597 2023-05-08T03:42:26.165 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 3598 2023-05-08T03:42:26.165 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 3598_vm 2023-05-08T03:42:26.165 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3599 2023-05-08T03:42:26.165 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3600 2023-05-08T03:42:26.165 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 3600_fsm 2023-05-08T03:42:26.165 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3600_vm 2023-05-08T03:42:26.166 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3601 2023-05-08T03:42:26.166 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 3601_fsm 2023-05-08T03:42:26.166 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3601_vm 2023-05-08T03:42:26.166 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3602 2023-05-08T03:42:26.166 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 3602_fsm 2023-05-08T03:42:26.166 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3602_vm 2023-05-08T03:42:26.166 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 3603 2023-05-08T03:42:26.166 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 3603_fsm 2023-05-08T03:42:26.167 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3603_vm 2023-05-08T03:42:26.167 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 3604 2023-05-08T03:42:26.167 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 3605 2023-05-08T03:42:26.167 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 3606 2023-05-08T03:42:26.167 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 3607 2023-05-08T03:42:26.167 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 3608 2023-05-08T03:42:26.167 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 8 03:42 3609 2023-05-08T03:42:26.167 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 3712 2023-05-08T03:42:26.168 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3764 2023-05-08T03:42:26.168 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 3764_fsm 2023-05-08T03:42:26.168 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3764_vm 2023-05-08T03:42:26.168 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 3766 2023-05-08T03:42:26.168 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 3767 2023-05-08T03:42:26.168 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3997 2023-05-08T03:42:26.168 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 5002 2023-05-08T03:42:26.169 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 548 2023-05-08T03:42:26.169 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 549 2023-05-08T03:42:26.169 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 6102 2023-05-08T03:42:26.169 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 6102_vm 2023-05-08T03:42:26.169 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 6104 2023-05-08T03:42:26.169 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 6104_vm 2023-05-08T03:42:26.169 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 6106 2023-05-08T03:42:26.169 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 6106_vm 2023-05-08T03:42:26.170 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 6110 2023-05-08T03:42:26.170 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 6111 2023-05-08T03:42:26.170 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 6112 2023-05-08T03:42:26.170 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 6113 2023-05-08T03:42:26.170 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 6117 2023-05-08T03:42:26.170 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 826 2023-05-08T03:42:26.170 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 826_vm 2023-05-08T03:42:26.170 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 827 2023-05-08T03:42:26.171 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 828 2023-05-08T03:42:26.171 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 May 8 03:42 pg_filenode.map 2023-05-08T03:42:26.171 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 May 8 03:42 PG_VERSION 2023-05-08T03:42:26.171 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:42:26.171 INFO:teuthology.orchestra.run.smithi096.stdout:/tmp/cephfs/postgres/data/base/12347: 2023-05-08T03:42:26.171 INFO:teuthology.orchestra.run.smithi096.stdout:total 7209 2023-05-08T03:42:26.171 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 293 May 8 03:42 . 2023-05-08T03:42:26.171 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 May 8 03:42 .. 2023-05-08T03:42:26.172 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 112 2023-05-08T03:42:26.172 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 113 2023-05-08T03:42:26.172 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 May 8 03:42 12182 2023-05-08T03:42:26.172 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 12182_fsm 2023-05-08T03:42:26.172 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 12182_vm 2023-05-08T03:42:26.172 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 12184 2023-05-08T03:42:26.172 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 12186 2023-05-08T03:42:26.172 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 12187 2023-05-08T03:42:26.173 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 12187_fsm 2023-05-08T03:42:26.173 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 12187_vm 2023-05-08T03:42:26.173 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 12189 2023-05-08T03:42:26.173 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 12191 2023-05-08T03:42:26.173 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 12192 2023-05-08T03:42:26.173 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 12192_fsm 2023-05-08T03:42:26.173 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 12192_vm 2023-05-08T03:42:26.173 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 12194 2023-05-08T03:42:26.174 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 12196 2023-05-08T03:42:26.174 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 12197 2023-05-08T03:42:26.174 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 12197_fsm 2023-05-08T03:42:26.174 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 12197_vm 2023-05-08T03:42:26.174 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 12199 2023-05-08T03:42:26.174 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 12201 2023-05-08T03:42:26.174 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 12202 2023-05-08T03:42:26.175 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 12202_fsm 2023-05-08T03:42:26.175 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 12202_vm 2023-05-08T03:42:26.175 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 12204 2023-05-08T03:42:26.175 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 12206 2023-05-08T03:42:26.175 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 12207 2023-05-08T03:42:26.175 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 12207_fsm 2023-05-08T03:42:26.175 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 12207_vm 2023-05-08T03:42:26.176 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 12209 2023-05-08T03:42:26.176 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 12211 2023-05-08T03:42:26.176 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 12212 2023-05-08T03:42:26.176 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 12214 2023-05-08T03:42:26.176 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 12216 2023-05-08T03:42:26.176 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 May 8 03:42 1247 2023-05-08T03:42:26.176 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 1247_fsm 2023-05-08T03:42:26.177 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 1247_vm 2023-05-08T03:42:26.177 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 May 8 03:42 1249 2023-05-08T03:42:26.177 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 1249_fsm 2023-05-08T03:42:26.177 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 1249_vm 2023-05-08T03:42:26.177 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 May 8 03:42 1255 2023-05-08T03:42:26.177 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 1255_fsm 2023-05-08T03:42:26.177 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 1255_vm 2023-05-08T03:42:26.177 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 May 8 03:42 1259 2023-05-08T03:42:26.178 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 1259_fsm 2023-05-08T03:42:26.178 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 1259_vm 2023-05-08T03:42:26.178 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 1417 2023-05-08T03:42:26.178 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 1417_vm 2023-05-08T03:42:26.178 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 1418 2023-05-08T03:42:26.178 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 1418_vm 2023-05-08T03:42:26.178 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 174 2023-05-08T03:42:26.178 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 175 2023-05-08T03:42:26.179 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2187 2023-05-08T03:42:26.179 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 2224 2023-05-08T03:42:26.179 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 2224_vm 2023-05-08T03:42:26.179 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 2328 2023-05-08T03:42:26.179 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 2328_vm 2023-05-08T03:42:26.179 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 2336 2023-05-08T03:42:26.179 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 2336_vm 2023-05-08T03:42:26.179 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2337 2023-05-08T03:42:26.180 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2600 2023-05-08T03:42:26.180 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 2600_fsm 2023-05-08T03:42:26.180 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2600_vm 2023-05-08T03:42:26.180 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2601 2023-05-08T03:42:26.180 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 2601_fsm 2023-05-08T03:42:26.180 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2601_vm 2023-05-08T03:42:26.180 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 8 03:42 2602 2023-05-08T03:42:26.180 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 2602_fsm 2023-05-08T03:42:26.181 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2602_vm 2023-05-08T03:42:26.181 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 8 03:42 2603 2023-05-08T03:42:26.181 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 2603_fsm 2023-05-08T03:42:26.181 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2603_vm 2023-05-08T03:42:26.181 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 2604 2023-05-08T03:42:26.181 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 2604_vm 2023-05-08T03:42:26.181 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2605 2023-05-08T03:42:26.181 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 2605_fsm 2023-05-08T03:42:26.182 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2605_vm 2023-05-08T03:42:26.182 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2606 2023-05-08T03:42:26.182 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 2606_fsm 2023-05-08T03:42:26.182 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2606_vm 2023-05-08T03:42:26.182 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 2607 2023-05-08T03:42:26.182 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 2607_fsm 2023-05-08T03:42:26.182 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2607_vm 2023-05-08T03:42:26.182 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 442368 May 8 03:42 2608 2023-05-08T03:42:26.183 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 2608_fsm 2023-05-08T03:42:26.183 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2608_vm 2023-05-08T03:42:26.183 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 May 8 03:42 2609 2023-05-08T03:42:26.183 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 2609_fsm 2023-05-08T03:42:26.183 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2609_vm 2023-05-08T03:42:26.183 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 2610 2023-05-08T03:42:26.183 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 2610_fsm 2023-05-08T03:42:26.183 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2610_vm 2023-05-08T03:42:26.184 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 2611 2023-05-08T03:42:26.184 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 2611_vm 2023-05-08T03:42:26.184 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2612 2023-05-08T03:42:26.184 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 2612_fsm 2023-05-08T03:42:26.184 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2612_vm 2023-05-08T03:42:26.184 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 2613 2023-05-08T03:42:26.184 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 2613_vm 2023-05-08T03:42:26.185 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2615 2023-05-08T03:42:26.185 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 2615_fsm 2023-05-08T03:42:26.185 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2615_vm 2023-05-08T03:42:26.185 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 2616 2023-05-08T03:42:26.185 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 2616_fsm 2023-05-08T03:42:26.185 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2616_vm 2023-05-08T03:42:26.185 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 May 8 03:42 2617 2023-05-08T03:42:26.185 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 2617_fsm 2023-05-08T03:42:26.186 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2617_vm 2023-05-08T03:42:26.186 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 May 8 03:42 2618 2023-05-08T03:42:26.186 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 2618_fsm 2023-05-08T03:42:26.186 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2618_vm 2023-05-08T03:42:26.186 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 May 8 03:42 2619 2023-05-08T03:42:26.186 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 2619_fsm 2023-05-08T03:42:26.186 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2619_vm 2023-05-08T03:42:26.187 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 2620 2023-05-08T03:42:26.187 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 2620_vm 2023-05-08T03:42:26.187 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2650 2023-05-08T03:42:26.187 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2651 2023-05-08T03:42:26.187 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2652 2023-05-08T03:42:26.187 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 8 03:42 2653 2023-05-08T03:42:26.187 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 8 03:42 2654 2023-05-08T03:42:26.187 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 8 03:42 2655 2023-05-08T03:42:26.188 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2656 2023-05-08T03:42:26.188 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2657 2023-05-08T03:42:26.188 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 May 8 03:42 2658 2023-05-08T03:42:26.188 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 May 8 03:42 2659 2023-05-08T03:42:26.188 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2660 2023-05-08T03:42:26.188 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2661 2023-05-08T03:42:26.188 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 8 03:42 2662 2023-05-08T03:42:26.188 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 8 03:42 2663 2023-05-08T03:42:26.189 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2664 2023-05-08T03:42:26.189 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2665 2023-05-08T03:42:26.189 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2666 2023-05-08T03:42:26.189 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2667 2023-05-08T03:42:26.189 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2668 2023-05-08T03:42:26.189 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2669 2023-05-08T03:42:26.189 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2670 2023-05-08T03:42:26.190 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 327680 May 8 03:42 2673 2023-05-08T03:42:26.190 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 385024 May 8 03:42 2674 2023-05-08T03:42:26.190 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 May 8 03:42 2675 2023-05-08T03:42:26.190 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2678 2023-05-08T03:42:26.190 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2679 2023-05-08T03:42:26.190 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2680 2023-05-08T03:42:26.190 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2681 2023-05-08T03:42:26.190 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2682 2023-05-08T03:42:26.191 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2683 2023-05-08T03:42:26.191 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2684 2023-05-08T03:42:26.191 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2685 2023-05-08T03:42:26.191 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2686 2023-05-08T03:42:26.191 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2687 2023-05-08T03:42:26.191 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 8 03:42 2688 2023-05-08T03:42:26.191 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 8 03:42 2689 2023-05-08T03:42:26.192 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 May 8 03:42 2690 2023-05-08T03:42:26.192 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 May 8 03:42 2691 2023-05-08T03:42:26.192 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2692 2023-05-08T03:42:26.192 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2693 2023-05-08T03:42:26.192 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2696 2023-05-08T03:42:26.192 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2699 2023-05-08T03:42:26.192 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2701 2023-05-08T03:42:26.192 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2702 2023-05-08T03:42:26.193 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2703 2023-05-08T03:42:26.193 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 8 03:42 2704 2023-05-08T03:42:26.193 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2753 2023-05-08T03:42:26.193 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 2753_fsm 2023-05-08T03:42:26.193 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2753_vm 2023-05-08T03:42:26.193 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2754 2023-05-08T03:42:26.193 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2755 2023-05-08T03:42:26.193 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 8 03:42 2756 2023-05-08T03:42:26.194 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 8 03:42 2757 2023-05-08T03:42:26.194 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 2830 2023-05-08T03:42:26.194 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 2830_vm 2023-05-08T03:42:26.194 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2831 2023-05-08T03:42:26.194 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 2832 2023-05-08T03:42:26.194 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 2832_vm 2023-05-08T03:42:26.194 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2833 2023-05-08T03:42:26.194 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 2834 2023-05-08T03:42:26.195 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 2834_vm 2023-05-08T03:42:26.195 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2835 2023-05-08T03:42:26.195 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 2836 2023-05-08T03:42:26.195 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 2836_vm 2023-05-08T03:42:26.195 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2837 2023-05-08T03:42:26.195 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 May 8 03:42 2838 2023-05-08T03:42:26.195 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 2838_fsm 2023-05-08T03:42:26.196 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2838_vm 2023-05-08T03:42:26.196 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2839 2023-05-08T03:42:26.196 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 2840 2023-05-08T03:42:26.196 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 2840_fsm 2023-05-08T03:42:26.196 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2840_vm 2023-05-08T03:42:26.196 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2841 2023-05-08T03:42:26.196 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 2995 2023-05-08T03:42:26.196 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 2995_vm 2023-05-08T03:42:26.197 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2996 2023-05-08T03:42:26.197 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3079 2023-05-08T03:42:26.197 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 3079_fsm 2023-05-08T03:42:26.197 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3079_vm 2023-05-08T03:42:26.197 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 3080 2023-05-08T03:42:26.197 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 3081 2023-05-08T03:42:26.197 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 3085 2023-05-08T03:42:26.198 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 3118 2023-05-08T03:42:26.198 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 3118_vm 2023-05-08T03:42:26.198 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3119 2023-05-08T03:42:26.198 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 3164 2023-05-08T03:42:26.198 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 3256 2023-05-08T03:42:26.198 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 3256_vm 2023-05-08T03:42:26.198 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3257 2023-05-08T03:42:26.198 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3258 2023-05-08T03:42:26.199 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 3350 2023-05-08T03:42:26.199 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 3350_vm 2023-05-08T03:42:26.199 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3351 2023-05-08T03:42:26.199 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3379 2023-05-08T03:42:26.199 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3380 2023-05-08T03:42:26.199 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 3381 2023-05-08T03:42:26.199 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 3381_vm 2023-05-08T03:42:26.199 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 3394 2023-05-08T03:42:26.200 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 3394_fsm 2023-05-08T03:42:26.200 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3394_vm 2023-05-08T03:42:26.200 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 3395 2023-05-08T03:42:26.200 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 3439 2023-05-08T03:42:26.200 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 3439_vm 2023-05-08T03:42:26.200 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3440 2023-05-08T03:42:26.200 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 8 03:42 3455 2023-05-08T03:42:26.200 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 3456 2023-05-08T03:42:26.201 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 3456_fsm 2023-05-08T03:42:26.201 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3456_vm 2023-05-08T03:42:26.201 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 3466 2023-05-08T03:42:26.201 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 3466_vm 2023-05-08T03:42:26.201 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3467 2023-05-08T03:42:26.201 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3468 2023-05-08T03:42:26.201 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 3501 2023-05-08T03:42:26.201 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 3501_vm 2023-05-08T03:42:26.202 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3502 2023-05-08T03:42:26.202 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3503 2023-05-08T03:42:26.202 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3534 2023-05-08T03:42:26.202 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3541 2023-05-08T03:42:26.202 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 3541_fsm 2023-05-08T03:42:26.202 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3541_vm 2023-05-08T03:42:26.202 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 3542 2023-05-08T03:42:26.202 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3574 2023-05-08T03:42:26.203 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3575 2023-05-08T03:42:26.203 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 3576 2023-05-08T03:42:26.203 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 3576_vm 2023-05-08T03:42:26.203 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 3596 2023-05-08T03:42:26.203 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 3596_vm 2023-05-08T03:42:26.203 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3597 2023-05-08T03:42:26.204 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 3598 2023-05-08T03:42:26.204 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 3598_vm 2023-05-08T03:42:26.204 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3599 2023-05-08T03:42:26.204 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3600 2023-05-08T03:42:26.204 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 3600_fsm 2023-05-08T03:42:26.204 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3600_vm 2023-05-08T03:42:26.204 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3601 2023-05-08T03:42:26.205 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 3601_fsm 2023-05-08T03:42:26.205 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3601_vm 2023-05-08T03:42:26.205 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3602 2023-05-08T03:42:26.205 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 3602_fsm 2023-05-08T03:42:26.205 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3602_vm 2023-05-08T03:42:26.205 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 3603 2023-05-08T03:42:26.205 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 3603_fsm 2023-05-08T03:42:26.205 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3603_vm 2023-05-08T03:42:26.206 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 3604 2023-05-08T03:42:26.206 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 3605 2023-05-08T03:42:26.206 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 3606 2023-05-08T03:42:26.206 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 3607 2023-05-08T03:42:26.206 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 3608 2023-05-08T03:42:26.206 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 8 03:42 3609 2023-05-08T03:42:26.206 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 3712 2023-05-08T03:42:26.207 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3764 2023-05-08T03:42:26.207 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 3764_fsm 2023-05-08T03:42:26.207 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3764_vm 2023-05-08T03:42:26.207 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 3766 2023-05-08T03:42:26.207 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 3767 2023-05-08T03:42:26.207 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3997 2023-05-08T03:42:26.207 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 5002 2023-05-08T03:42:26.207 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 548 2023-05-08T03:42:26.208 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 549 2023-05-08T03:42:26.208 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 6102 2023-05-08T03:42:26.208 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 6102_vm 2023-05-08T03:42:26.208 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 6104 2023-05-08T03:42:26.208 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 6104_vm 2023-05-08T03:42:26.208 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 6106 2023-05-08T03:42:26.208 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 6106_vm 2023-05-08T03:42:26.209 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 6110 2023-05-08T03:42:26.209 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 6111 2023-05-08T03:42:26.209 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 6112 2023-05-08T03:42:26.209 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 6113 2023-05-08T03:42:26.209 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 6117 2023-05-08T03:42:26.209 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 826 2023-05-08T03:42:26.209 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 826_vm 2023-05-08T03:42:26.209 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 827 2023-05-08T03:42:26.210 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 828 2023-05-08T03:42:26.210 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 May 8 03:42 pg_filenode.map 2023-05-08T03:42:26.210 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 May 8 03:42 PG_VERSION 2023-05-08T03:42:26.210 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:42:26.210 INFO:teuthology.orchestra.run.smithi096.stdout:/tmp/cephfs/postgres/data/global: 2023-05-08T03:42:26.210 INFO:teuthology.orchestra.run.smithi096.stdout:total 553 2023-05-08T03:42:26.210 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 58 May 8 03:42 . 2023-05-08T03:42:26.210 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 May 8 03:42 .. 2023-05-08T03:42:26.211 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 1136 2023-05-08T03:42:26.211 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 1136_fsm 2023-05-08T03:42:26.211 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 1136_vm 2023-05-08T03:42:26.211 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 1137 2023-05-08T03:42:26.211 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 1213 2023-05-08T03:42:26.211 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 1213_fsm 2023-05-08T03:42:26.211 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 1213_vm 2023-05-08T03:42:26.211 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 1214 2023-05-08T03:42:26.212 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 1214_fsm 2023-05-08T03:42:26.212 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 1214_vm 2023-05-08T03:42:26.212 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 1232 2023-05-08T03:42:26.212 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 1233 2023-05-08T03:42:26.212 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 1260 2023-05-08T03:42:26.212 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 1260_fsm 2023-05-08T03:42:26.212 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 1260_vm 2023-05-08T03:42:26.212 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 1261 2023-05-08T03:42:26.213 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 1261_fsm 2023-05-08T03:42:26.213 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 1261_vm 2023-05-08T03:42:26.213 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 1262 2023-05-08T03:42:26.213 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 1262_fsm 2023-05-08T03:42:26.213 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 1262_vm 2023-05-08T03:42:26.213 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2396 2023-05-08T03:42:26.213 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 03:42 2396_fsm 2023-05-08T03:42:26.213 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2396_vm 2023-05-08T03:42:26.214 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2397 2023-05-08T03:42:26.214 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2671 2023-05-08T03:42:26.214 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2672 2023-05-08T03:42:26.214 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2676 2023-05-08T03:42:26.214 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2677 2023-05-08T03:42:26.214 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2694 2023-05-08T03:42:26.214 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2695 2023-05-08T03:42:26.214 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2697 2023-05-08T03:42:26.215 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 03:42 2698 2023-05-08T03:42:26.215 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 2846 2023-05-08T03:42:26.215 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 2846_vm 2023-05-08T03:42:26.215 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2847 2023-05-08T03:42:26.215 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 2964 2023-05-08T03:42:26.215 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 2964_vm 2023-05-08T03:42:26.215 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2965 2023-05-08T03:42:26.215 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 2966 2023-05-08T03:42:26.216 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 2966_vm 2023-05-08T03:42:26.216 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 2967 2023-05-08T03:42:26.216 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 3592 2023-05-08T03:42:26.216 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 3592_vm 2023-05-08T03:42:26.216 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 3593 2023-05-08T03:42:26.216 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 4060 2023-05-08T03:42:26.216 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 4060_vm 2023-05-08T03:42:26.216 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 4061 2023-05-08T03:42:26.217 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 6000 2023-05-08T03:42:26.217 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 6000_vm 2023-05-08T03:42:26.217 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 6001 2023-05-08T03:42:26.217 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 6002 2023-05-08T03:42:26.217 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 6100 2023-05-08T03:42:26.217 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 6100_vm 2023-05-08T03:42:26.217 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 6114 2023-05-08T03:42:26.217 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 6115 2023-05-08T03:42:26.218 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 pg_control 2023-05-08T03:42:26.218 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 May 8 03:42 pg_filenode.map 2023-05-08T03:42:26.218 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:42:26.218 INFO:teuthology.orchestra.run.smithi096.stdout:/tmp/cephfs/postgres/data/log: 2023-05-08T03:42:26.218 INFO:teuthology.orchestra.run.smithi096.stdout:total 0 2023-05-08T03:42:26.218 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 . 2023-05-08T03:42:26.218 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 May 8 03:42 .. 2023-05-08T03:42:26.219 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:42:26.219 INFO:teuthology.orchestra.run.smithi096.stdout:/tmp/cephfs/postgres/data/pg_commit_ts: 2023-05-08T03:42:26.219 INFO:teuthology.orchestra.run.smithi096.stdout:total 0 2023-05-08T03:42:26.219 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 . 2023-05-08T03:42:26.219 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 May 8 03:42 .. 2023-05-08T03:42:26.219 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:42:26.219 INFO:teuthology.orchestra.run.smithi096.stdout:/tmp/cephfs/postgres/data/pg_dynshmem: 2023-05-08T03:42:26.219 INFO:teuthology.orchestra.run.smithi096.stdout:total 0 2023-05-08T03:42:26.220 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 . 2023-05-08T03:42:26.220 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 May 8 03:42 .. 2023-05-08T03:42:26.220 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:42:26.220 INFO:teuthology.orchestra.run.smithi096.stdout:/tmp/cephfs/postgres/data/pg_logical: 2023-05-08T03:42:26.220 INFO:teuthology.orchestra.run.smithi096.stdout:total 1 2023-05-08T03:42:26.220 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 May 8 03:42 . 2023-05-08T03:42:26.220 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 May 8 03:42 .. 2023-05-08T03:42:26.220 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 mappings 2023-05-08T03:42:26.221 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8 May 8 03:42 replorigin_checkpoint 2023-05-08T03:42:26.221 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 snapshots 2023-05-08T03:42:26.221 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:42:26.221 INFO:teuthology.orchestra.run.smithi096.stdout:/tmp/cephfs/postgres/data/pg_logical/mappings: 2023-05-08T03:42:26.221 INFO:teuthology.orchestra.run.smithi096.stdout:total 0 2023-05-08T03:42:26.221 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 . 2023-05-08T03:42:26.221 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 May 8 03:42 .. 2023-05-08T03:42:26.221 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:42:26.222 INFO:teuthology.orchestra.run.smithi096.stdout:/tmp/cephfs/postgres/data/pg_logical/snapshots: 2023-05-08T03:42:26.222 INFO:teuthology.orchestra.run.smithi096.stdout:total 0 2023-05-08T03:42:26.222 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 . 2023-05-08T03:42:26.222 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 May 8 03:42 .. 2023-05-08T03:42:26.222 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:42:26.222 INFO:teuthology.orchestra.run.smithi096.stdout:/tmp/cephfs/postgres/data/pg_multixact: 2023-05-08T03:42:26.222 INFO:teuthology.orchestra.run.smithi096.stdout:total 0 2023-05-08T03:42:26.222 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 May 8 03:42 . 2023-05-08T03:42:26.223 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 May 8 03:42 .. 2023-05-08T03:42:26.223 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 May 8 03:42 members 2023-05-08T03:42:26.223 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 May 8 03:42 offsets 2023-05-08T03:42:26.223 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:42:26.223 INFO:teuthology.orchestra.run.smithi096.stdout:/tmp/cephfs/postgres/data/pg_multixact/members: 2023-05-08T03:42:26.223 INFO:teuthology.orchestra.run.smithi096.stdout:total 8 2023-05-08T03:42:26.223 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 May 8 03:42 . 2023-05-08T03:42:26.224 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 May 8 03:42 .. 2023-05-08T03:42:26.224 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 0000 2023-05-08T03:42:26.224 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:42:26.224 INFO:teuthology.orchestra.run.smithi096.stdout:/tmp/cephfs/postgres/data/pg_multixact/offsets: 2023-05-08T03:42:26.224 INFO:teuthology.orchestra.run.smithi096.stdout:total 8 2023-05-08T03:42:26.224 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 May 8 03:42 . 2023-05-08T03:42:26.224 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 May 8 03:42 .. 2023-05-08T03:42:26.224 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 0000 2023-05-08T03:42:26.225 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:42:26.225 INFO:teuthology.orchestra.run.smithi096.stdout:/tmp/cephfs/postgres/data/pg_notify: 2023-05-08T03:42:26.225 INFO:teuthology.orchestra.run.smithi096.stdout:total 8 2023-05-08T03:42:26.225 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 May 8 03:42 . 2023-05-08T03:42:26.225 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 May 8 03:42 .. 2023-05-08T03:42:26.225 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 0000 2023-05-08T03:42:26.225 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:42:26.225 INFO:teuthology.orchestra.run.smithi096.stdout:/tmp/cephfs/postgres/data/pg_replslot: 2023-05-08T03:42:26.226 INFO:teuthology.orchestra.run.smithi096.stdout:total 0 2023-05-08T03:42:26.226 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 . 2023-05-08T03:42:26.226 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 May 8 03:42 .. 2023-05-08T03:42:26.226 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:42:26.226 INFO:teuthology.orchestra.run.smithi096.stdout:/tmp/cephfs/postgres/data/pg_serial: 2023-05-08T03:42:26.226 INFO:teuthology.orchestra.run.smithi096.stdout:total 0 2023-05-08T03:42:26.226 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 . 2023-05-08T03:42:26.227 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 May 8 03:42 .. 2023-05-08T03:42:26.227 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:42:26.227 INFO:teuthology.orchestra.run.smithi096.stdout:/tmp/cephfs/postgres/data/pg_snapshots: 2023-05-08T03:42:26.227 INFO:teuthology.orchestra.run.smithi096.stdout:total 0 2023-05-08T03:42:26.227 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 . 2023-05-08T03:42:26.227 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 May 8 03:42 .. 2023-05-08T03:42:26.227 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:42:26.227 INFO:teuthology.orchestra.run.smithi096.stdout:/tmp/cephfs/postgres/data/pg_stat: 2023-05-08T03:42:26.228 INFO:teuthology.orchestra.run.smithi096.stdout:total 0 2023-05-08T03:42:26.228 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 . 2023-05-08T03:42:26.228 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 May 8 03:42 .. 2023-05-08T03:42:26.228 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:42:26.228 INFO:teuthology.orchestra.run.smithi096.stdout:/tmp/cephfs/postgres/data/pg_stat_tmp: 2023-05-08T03:42:26.228 INFO:teuthology.orchestra.run.smithi096.stdout:total 0 2023-05-08T03:42:26.228 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 . 2023-05-08T03:42:26.228 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 May 8 03:42 .. 2023-05-08T03:42:26.229 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:42:26.229 INFO:teuthology.orchestra.run.smithi096.stdout:/tmp/cephfs/postgres/data/pg_subtrans: 2023-05-08T03:42:26.229 INFO:teuthology.orchestra.run.smithi096.stdout:total 8 2023-05-08T03:42:26.229 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 May 8 03:42 . 2023-05-08T03:42:26.229 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 May 8 03:42 .. 2023-05-08T03:42:26.229 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 0000 2023-05-08T03:42:26.229 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:42:26.229 INFO:teuthology.orchestra.run.smithi096.stdout:/tmp/cephfs/postgres/data/pg_tblspc: 2023-05-08T03:42:26.230 INFO:teuthology.orchestra.run.smithi096.stdout:total 0 2023-05-08T03:42:26.230 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 . 2023-05-08T03:42:26.230 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 May 8 03:42 .. 2023-05-08T03:42:26.230 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:42:26.230 INFO:teuthology.orchestra.run.smithi096.stdout:/tmp/cephfs/postgres/data/pg_twophase: 2023-05-08T03:42:26.230 INFO:teuthology.orchestra.run.smithi096.stdout:total 0 2023-05-08T03:42:26.230 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 . 2023-05-08T03:42:26.230 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 May 8 03:42 .. 2023-05-08T03:42:26.231 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:42:26.231 INFO:teuthology.orchestra.run.smithi096.stdout:/tmp/cephfs/postgres/data/pg_wal: 2023-05-08T03:42:26.231 INFO:teuthology.orchestra.run.smithi096.stdout:total 16384 2023-05-08T03:42:26.231 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 2 May 8 03:42 . 2023-05-08T03:42:26.231 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 May 8 03:42 .. 2023-05-08T03:42:26.231 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 8 03:42 000000010000000000000001 2023-05-08T03:42:26.231 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 archive_status 2023-05-08T03:42:26.231 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:42:26.232 INFO:teuthology.orchestra.run.smithi096.stdout:/tmp/cephfs/postgres/data/pg_wal/archive_status: 2023-05-08T03:42:26.232 INFO:teuthology.orchestra.run.smithi096.stdout:total 0 2023-05-08T03:42:26.232 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 03:42 . 2023-05-08T03:42:26.232 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 2 May 8 03:42 .. 2023-05-08T03:42:26.232 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-05-08T03:42:26.232 INFO:teuthology.orchestra.run.smithi096.stdout:/tmp/cephfs/postgres/data/pg_xact: 2023-05-08T03:42:26.232 INFO:teuthology.orchestra.run.smithi096.stdout:total 8 2023-05-08T03:42:26.233 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 May 8 03:42 . 2023-05-08T03:42:26.233 INFO:teuthology.orchestra.run.smithi096.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 May 8 03:42 .. 2023-05-08T03:42:26.233 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 03:42 0000 2023-05-08T03:42:26.233 DEBUG:teuthology.orchestra.run.smithi096:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo systemctl start postgresql' 2023-05-08T03:42:26.347 DEBUG:teuthology.orchestra.run.smithi096:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- pgbench -s 500 -i' 2023-05-08T03:42:26.393 INFO:teuthology.orchestra.run.smithi096.stderr:NOTICE: table "pgbench_history" does not exist, skipping 2023-05-08T03:42:26.397 INFO:teuthology.orchestra.run.smithi096.stderr:NOTICE: table "pgbench_tellers" does not exist, skipping 2023-05-08T03:42:26.400 INFO:teuthology.orchestra.run.smithi096.stderr:NOTICE: table "pgbench_accounts" does not exist, skipping 2023-05-08T03:42:26.403 INFO:teuthology.orchestra.run.smithi096.stderr:NOTICE: table "pgbench_branches" does not exist, skipping 2023-05-08T03:42:26.570 INFO:teuthology.orchestra.run.smithi096.stderr:creating tables... 2023-05-08T03:42:26.629 INFO:teuthology.orchestra.run.smithi096.stderr:100000 of 50000000 tuples (0%) done (elapsed 0.06 s, remaining 28.69 s) 2023-05-08T03:42:26.833 INFO:teuthology.orchestra.run.smithi096.stderr:200000 of 50000000 tuples (0%) done (elapsed 0.26 s, remaining 65.12 s) 2023-05-08T03:42:26.928 INFO:teuthology.orchestra.run.smithi096.stderr:300000 of 50000000 tuples (0%) done (elapsed 0.36 s, remaining 59.01 s) 2023-05-08T03:42:27.102 INFO:teuthology.orchestra.run.smithi096.stderr:400000 of 50000000 tuples (0%) done (elapsed 0.53 s, remaining 65.87 s) 2023-05-08T03:42:27.288 INFO:teuthology.orchestra.run.smithi096.stderr:500000 of 50000000 tuples (1%) done (elapsed 0.72 s, remaining 71.02 s) 2023-05-08T03:42:27.387 INFO:teuthology.orchestra.run.smithi096.stderr:600000 of 50000000 tuples (1%) done (elapsed 0.82 s, remaining 67.19 s) 2023-05-08T03:42:27.580 INFO:teuthology.orchestra.run.smithi096.stderr:700000 of 50000000 tuples (1%) done (elapsed 1.01 s, remaining 71.03 s) 2023-05-08T03:42:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:27 smithi186 ceph-mon[126480]: pgmap v7: 97 pgs: 97 active+clean; 1.8 MiB data, 83 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 218 KiB/s wr, 53 op/s 2023-05-08T03:42:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:27 smithi133 ceph-mon[125939]: pgmap v7: 97 pgs: 97 active+clean; 1.8 MiB data, 83 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 218 KiB/s wr, 53 op/s 2023-05-08T03:42:27.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:27 smithi096 ceph-mon[124666]: pgmap v7: 97 pgs: 97 active+clean; 1.8 MiB data, 83 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 218 KiB/s wr, 53 op/s 2023-05-08T03:42:27.765 INFO:teuthology.orchestra.run.smithi096.stderr:800000 of 50000000 tuples (1%) done (elapsed 1.19 s, remaining 73.43 s) 2023-05-08T03:42:27.863 INFO:teuthology.orchestra.run.smithi096.stderr:900000 of 50000000 tuples (1%) done (elapsed 1.29 s, remaining 70.49 s) 2023-05-08T03:42:28.032 INFO:teuthology.orchestra.run.smithi096.stderr:1000000 of 50000000 tuples (2%) done (elapsed 1.46 s, remaining 71.59 s) 2023-05-08T03:42:28.209 INFO:teuthology.orchestra.run.smithi096.stderr:1100000 of 50000000 tuples (2%) done (elapsed 1.64 s, remaining 72.80 s) 2023-05-08T03:42:28.308 INFO:teuthology.orchestra.run.smithi096.stderr:1200000 of 50000000 tuples (2%) done (elapsed 1.74 s, remaining 70.63 s) 2023-05-08T03:42:28.469 INFO:teuthology.orchestra.run.smithi096.stderr:1300000 of 50000000 tuples (2%) done (elapsed 1.90 s, remaining 71.12 s) 2023-05-08T03:42:28.662 INFO:teuthology.orchestra.run.smithi096.stderr:1400000 of 50000000 tuples (2%) done (elapsed 2.09 s, remaining 72.58 s) 2023-05-08T03:42:28.765 INFO:teuthology.orchestra.run.smithi096.stderr:1500000 of 50000000 tuples (3%) done (elapsed 2.19 s, remaining 70.93 s) 2023-05-08T03:42:28.931 INFO:teuthology.orchestra.run.smithi096.stderr:1600000 of 50000000 tuples (3%) done (elapsed 2.36 s, remaining 71.38 s) 2023-05-08T03:42:29.111 INFO:teuthology.orchestra.run.smithi096.stderr:1700000 of 50000000 tuples (3%) done (elapsed 2.54 s, remaining 72.16 s) 2023-05-08T03:42:29.173 INFO:teuthology.orchestra.run.smithi096.stderr:1800000 of 50000000 tuples (3%) done (elapsed 2.60 s, remaining 69.67 s) 2023-05-08T03:42:29.379 INFO:teuthology.orchestra.run.smithi096.stderr:1900000 of 50000000 tuples (3%) done (elapsed 2.81 s, remaining 71.09 s) 2023-05-08T03:42:29.565 INFO:teuthology.orchestra.run.smithi096.stderr:2000000 of 50000000 tuples (4%) done (elapsed 2.99 s, remaining 71.85 s) 2023-05-08T03:42:29.632 INFO:teuthology.orchestra.run.smithi096.stderr:2100000 of 50000000 tuples (4%) done (elapsed 3.06 s, remaining 69.83 s) 2023-05-08T03:42:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:29 smithi133 ceph-mon[125939]: pgmap v8: 97 pgs: 97 active+clean; 1.8 MiB data, 83 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 169 KiB/s wr, 41 op/s 2023-05-08T03:42:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:29 smithi096 ceph-mon[124666]: pgmap v8: 97 pgs: 97 active+clean; 1.8 MiB data, 83 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 169 KiB/s wr, 41 op/s 2023-05-08T03:42:29.832 INFO:teuthology.orchestra.run.smithi096.stderr:2200000 of 50000000 tuples (4%) done (elapsed 3.26 s, remaining 70.85 s) 2023-05-08T03:42:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:29 smithi186 ceph-mon[126480]: pgmap v8: 97 pgs: 97 active+clean; 1.8 MiB data, 83 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 169 KiB/s wr, 41 op/s 2023-05-08T03:42:29.895 INFO:teuthology.orchestra.run.smithi096.stderr:2300000 of 50000000 tuples (4%) done (elapsed 3.32 s, remaining 68.93 s) 2023-05-08T03:42:30.085 INFO:teuthology.orchestra.run.smithi096.stderr:2400000 of 50000000 tuples (4%) done (elapsed 3.51 s, remaining 69.69 s) 2023-05-08T03:42:30.285 INFO:teuthology.orchestra.run.smithi096.stderr:2500000 of 50000000 tuples (5%) done (elapsed 3.71 s, remaining 70.57 s) 2023-05-08T03:42:30.348 INFO:teuthology.orchestra.run.smithi096.stderr:2600000 of 50000000 tuples (5%) done (elapsed 3.78 s, remaining 68.86 s) 2023-05-08T03:42:30.529 INFO:teuthology.orchestra.run.smithi096.stderr:2700000 of 50000000 tuples (5%) done (elapsed 3.96 s, remaining 69.35 s) 2023-05-08T03:42:30.707 INFO:teuthology.orchestra.run.smithi096.stderr:2800000 of 50000000 tuples (5%) done (elapsed 4.14 s, remaining 69.72 s) 2023-05-08T03:42:30.770 INFO:teuthology.orchestra.run.smithi096.stderr:2900000 of 50000000 tuples (5%) done (elapsed 4.20 s, remaining 68.19 s) 2023-05-08T03:42:30.971 INFO:teuthology.orchestra.run.smithi096.stderr:3000000 of 50000000 tuples (6%) done (elapsed 4.40 s, remaining 68.94 s) 2023-05-08T03:42:31.132 INFO:teuthology.orchestra.run.smithi096.stderr:3100000 of 50000000 tuples (6%) done (elapsed 4.56 s, remaining 69.01 s) 2023-05-08T03:42:31.212 INFO:teuthology.orchestra.run.smithi096.stderr:3200000 of 50000000 tuples (6%) done (elapsed 4.64 s, remaining 67.87 s) 2023-05-08T03:42:31.399 INFO:teuthology.orchestra.run.smithi096.stderr:3300000 of 50000000 tuples (6%) done (elapsed 4.83 s, remaining 68.32 s) 2023-05-08T03:42:31.578 INFO:teuthology.orchestra.run.smithi096.stderr:3400000 of 50000000 tuples (6%) done (elapsed 5.01 s, remaining 68.63 s) 2023-05-08T03:42:31.646 INFO:teuthology.orchestra.run.smithi096.stderr:3500000 of 50000000 tuples (7%) done (elapsed 5.08 s, remaining 67.43 s) 2023-05-08T03:42:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:31 smithi133 ceph-mon[125939]: pgmap v9: 97 pgs: 97 active+clean; 203 MiB data, 648 MiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 34 MiB/s wr, 198 op/s 2023-05-08T03:42:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:31 smithi096 ceph-mon[124666]: pgmap v9: 97 pgs: 97 active+clean; 203 MiB data, 648 MiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 34 MiB/s wr, 198 op/s 2023-05-08T03:42:31.855 INFO:teuthology.orchestra.run.smithi096.stderr:3600000 of 50000000 tuples (7%) done (elapsed 5.28 s, remaining 68.09 s) 2023-05-08T03:42:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:31 smithi186 ceph-mon[126480]: pgmap v9: 97 pgs: 97 active+clean; 203 MiB data, 648 MiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 34 MiB/s wr, 198 op/s 2023-05-08T03:42:32.049 INFO:teuthology.orchestra.run.smithi096.stderr:3700000 of 50000000 tuples (7%) done (elapsed 5.47 s, remaining 68.51 s) 2023-05-08T03:42:32.109 INFO:teuthology.orchestra.run.smithi096.stderr:3800000 of 50000000 tuples (7%) done (elapsed 5.54 s, remaining 67.33 s) 2023-05-08T03:42:32.312 INFO:teuthology.orchestra.run.smithi096.stderr:3900000 of 50000000 tuples (7%) done (elapsed 5.74 s, remaining 67.85 s) 2023-05-08T03:42:32.380 INFO:teuthology.orchestra.run.smithi096.stderr:4000000 of 50000000 tuples (8%) done (elapsed 5.81 s, remaining 66.80 s) 2023-05-08T03:42:32.756 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 2023-05-08T03:42:32.388+0000 7f4a58832700 -1 osd.3 pg_epoch: 85 pg[3.18( v 85'25 (0'0,85'25] local-lis/les=80/81 n=14 ec=80/80 lis/c=80/80 les/c/f=81/81/0 sis=80) [3,11,6] r=0 lpr=80 luod=85'24 crt=85'25 lcod 85'23 mlcod 85'23 active+clean] bad op order, already applied 1030 > this 1029 2023-05-08T03:42:32.757 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-3786-g4b086ba5/rpm/el8/BUILD/ceph-18.0.0-3786-g4b086ba5/src/osd/PrimaryLogPG.cc: In function 'void PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)' thread 7f4a58832700 time 2023-05-08T03:42:32.389475+0000 2023-05-08T03:42:32.757 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-3786-g4b086ba5/rpm/el8/BUILD/ceph-18.0.0-3786-g4b086ba5/src/osd/PrimaryLogPG.cc: 4284: ceph_abort_msg("out of order op") 2023-05-08T03:42:32.757 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: ceph version 18.0.0-3786-g4b086ba5 (4b086ba51b906a75bac7252b2239e8f120a38c8c) reef (dev) 2023-05-08T03:42:32.757 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x56290467bdd9] 2023-05-08T03:42:32.757 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 2: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x13d4) [0x562904935614] 2023-05-08T03:42:32.758 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 3: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x282a) [0x56290493bc9a] 2023-05-08T03:42:32.758 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 4: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x1c6) [0x56290478b0e6] 2023-05-08T03:42:32.758 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 5: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x69) [0x562904aa2829] 2023-05-08T03:42:32.758 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 6: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x115d) [0x5629047a017d] 2023-05-08T03:42:32.758 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 7: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x43b) [0x562904e56d1b] 2023-05-08T03:42:32.758 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 8: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x562904e59f44] 2023-05-08T03:42:32.758 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 9: /lib64/libpthread.so.0(+0x81ca) [0x7f4a7b6a61ca] 2023-05-08T03:42:32.759 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 10: clone() 2023-05-08T03:42:32.759 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 2023-05-08T03:42:32.392+0000 7f4a58832700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-3786-g4b086ba5/rpm/el8/BUILD/ceph-18.0.0-3786-g4b086ba5/src/osd/PrimaryLogPG.cc: In function 'void PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)' thread 7f4a58832700 time 2023-05-08T03:42:32.389475+0000 2023-05-08T03:42:32.759 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-3786-g4b086ba5/rpm/el8/BUILD/ceph-18.0.0-3786-g4b086ba5/src/osd/PrimaryLogPG.cc: 4284: ceph_abort_msg("out of order op") 2023-05-08T03:42:32.759 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 2023-05-08T03:42:32.759 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: ceph version 18.0.0-3786-g4b086ba5 (4b086ba51b906a75bac7252b2239e8f120a38c8c) reef (dev) 2023-05-08T03:42:32.759 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x56290467bdd9] 2023-05-08T03:42:32.759 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 2: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x13d4) [0x562904935614] 2023-05-08T03:42:32.759 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 3: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x282a) [0x56290493bc9a] 2023-05-08T03:42:32.760 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 4: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x1c6) [0x56290478b0e6] 2023-05-08T03:42:32.760 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 5: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x69) [0x562904aa2829] 2023-05-08T03:42:32.760 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 6: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x115d) [0x5629047a017d] 2023-05-08T03:42:32.760 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 7: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x43b) [0x562904e56d1b] 2023-05-08T03:42:32.760 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 8: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x562904e59f44] 2023-05-08T03:42:32.760 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 9: /lib64/libpthread.so.0(+0x81ca) [0x7f4a7b6a61ca] 2023-05-08T03:42:32.760 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 10: clone() 2023-05-08T03:42:32.761 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 2023-05-08T03:42:32.761 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: *** Caught signal (Aborted) ** 2023-05-08T03:42:32.761 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: in thread 7f4a58832700 thread_name:tp_osd_tp 2023-05-08T03:42:32.762 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: ceph version 18.0.0-3786-g4b086ba5 (4b086ba51b906a75bac7252b2239e8f120a38c8c) reef (dev) 2023-05-08T03:42:32.762 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f4a7b6b0cf0] 2023-05-08T03:42:32.763 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 2: gsignal() 2023-05-08T03:42:32.763 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 3: abort() 2023-05-08T03:42:32.763 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x197) [0x56290467be99] 2023-05-08T03:42:32.763 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 5: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x13d4) [0x562904935614] 2023-05-08T03:42:32.763 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 6: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x282a) [0x56290493bc9a] 2023-05-08T03:42:32.763 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 7: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x1c6) [0x56290478b0e6] 2023-05-08T03:42:32.763 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 8: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x69) [0x562904aa2829] 2023-05-08T03:42:32.764 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 9: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x115d) [0x5629047a017d] 2023-05-08T03:42:32.764 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 10: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x43b) [0x562904e56d1b] 2023-05-08T03:42:32.764 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 11: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x562904e59f44] 2023-05-08T03:42:32.764 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f4a7b6a61ca] 2023-05-08T03:42:32.764 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 13: clone() 2023-05-08T03:42:32.764 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 2023-05-08T03:42:32.396+0000 7f4a58832700 -1 *** Caught signal (Aborted) ** 2023-05-08T03:42:32.764 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: in thread 7f4a58832700 thread_name:tp_osd_tp 2023-05-08T03:42:32.765 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 2023-05-08T03:42:32.765 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: ceph version 18.0.0-3786-g4b086ba5 (4b086ba51b906a75bac7252b2239e8f120a38c8c) reef (dev) 2023-05-08T03:42:32.765 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f4a7b6b0cf0] 2023-05-08T03:42:32.765 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 2: gsignal() 2023-05-08T03:42:32.765 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 3: abort() 2023-05-08T03:42:32.766 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x197) [0x56290467be99] 2023-05-08T03:42:32.766 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 5: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x13d4) [0x562904935614] 2023-05-08T03:42:32.766 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 6: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x282a) [0x56290493bc9a] 2023-05-08T03:42:32.766 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 7: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x1c6) [0x56290478b0e6] 2023-05-08T03:42:32.766 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 8: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x69) [0x562904aa2829] 2023-05-08T03:42:32.766 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 9: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x115d) [0x5629047a017d] 2023-05-08T03:42:32.766 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 10: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x43b) [0x562904e56d1b] 2023-05-08T03:42:32.766 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 11: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x562904e59f44] 2023-05-08T03:42:32.767 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f4a7b6a61ca] 2023-05-08T03:42:32.767 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 13: clone() 2023-05-08T03:42:32.767 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-05-08T03:42:32.767 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 2023-05-08T03:42:32.767 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: -872> 2023-05-08T03:42:32.388+0000 7f4a58832700 -1 osd.3 pg_epoch: 85 pg[3.18( v 85'25 (0'0,85'25] local-lis/les=80/81 n=14 ec=80/80 lis/c=80/80 les/c/f=81/81/0 sis=80) [3,11,6] r=0 lpr=80 luod=85'24 crt=85'25 lcod 85'23 mlcod 85'23 active+clean] bad op order, already applied 1030 > this 1029 2023-05-08T03:42:32.768 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: -139> 2023-05-08T03:42:32.392+0000 7f4a58832700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-3786-g4b086ba5/rpm/el8/BUILD/ceph-18.0.0-3786-g4b086ba5/src/osd/PrimaryLogPG.cc: In function 'void PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)' thread 7f4a58832700 time 2023-05-08T03:42:32.389475+0000 2023-05-08T03:42:32.768 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-3786-g4b086ba5/rpm/el8/BUILD/ceph-18.0.0-3786-g4b086ba5/src/osd/PrimaryLogPG.cc: 4284: ceph_abort_msg("out of order op") 2023-05-08T03:42:32.768 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 2023-05-08T03:42:32.768 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: ceph version 18.0.0-3786-g4b086ba5 (4b086ba51b906a75bac7252b2239e8f120a38c8c) reef (dev) 2023-05-08T03:42:32.769 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x56290467bdd9] 2023-05-08T03:42:32.769 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 2: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x13d4) [0x562904935614] 2023-05-08T03:42:32.769 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 3: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x282a) [0x56290493bc9a] 2023-05-08T03:42:32.769 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 4: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x1c6) [0x56290478b0e6] 2023-05-08T03:42:32.769 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 5: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x69) [0x562904aa2829] 2023-05-08T03:42:32.769 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 6: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x115d) [0x5629047a017d] 2023-05-08T03:42:32.769 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 7: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x43b) [0x562904e56d1b] 2023-05-08T03:42:32.770 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 8: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x562904e59f44] 2023-05-08T03:42:32.770 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 9: /lib64/libpthread.so.0(+0x81ca) [0x7f4a7b6a61ca] 2023-05-08T03:42:32.770 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 10: clone() 2023-05-08T03:42:32.770 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 2023-05-08T03:42:32.770 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 0> 2023-05-08T03:42:32.396+0000 7f4a58832700 -1 *** Caught signal (Aborted) ** 2023-05-08T03:42:32.770 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: in thread 7f4a58832700 thread_name:tp_osd_tp 2023-05-08T03:42:32.770 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 2023-05-08T03:42:32.770 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: ceph version 18.0.0-3786-g4b086ba5 (4b086ba51b906a75bac7252b2239e8f120a38c8c) reef (dev) 2023-05-08T03:42:32.771 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f4a7b6b0cf0] 2023-05-08T03:42:32.771 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 2: gsignal() 2023-05-08T03:42:32.771 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 3: abort() 2023-05-08T03:42:32.771 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x197) [0x56290467be99] 2023-05-08T03:42:32.771 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 5: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x13d4) [0x562904935614] 2023-05-08T03:42:32.771 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 6: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x282a) [0x56290493bc9a] 2023-05-08T03:42:32.772 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 7: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x1c6) [0x56290478b0e6] 2023-05-08T03:42:32.772 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 8: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x69) [0x562904aa2829] 2023-05-08T03:42:32.772 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 9: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x115d) [0x5629047a017d] 2023-05-08T03:42:32.772 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 10: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x43b) [0x562904e56d1b] 2023-05-08T03:42:32.772 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 11: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x562904e59f44] 2023-05-08T03:42:32.772 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f4a7b6a61ca] 2023-05-08T03:42:32.772 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 13: clone() 2023-05-08T03:42:32.773 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-05-08T03:42:32.773 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 2023-05-08T03:42:32.773 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: -880> 2023-05-08T03:42:32.388+0000 7f4a58832700 -1 osd.3 pg_epoch: 85 pg[3.18( v 85'25 (0'0,85'25] local-lis/les=80/81 n=14 ec=80/80 lis/c=80/80 les/c/f=81/81/0 sis=80) [3,11,6] r=0 lpr=80 luod=85'24 crt=85'25 lcod 85'23 mlcod 85'23 active+clean] bad op order, already applied 1030 > this 1029 2023-05-08T03:42:32.773 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: -147> 2023-05-08T03:42:32.392+0000 7f4a58832700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-3786-g4b086ba5/rpm/el8/BUILD/ceph-18.0.0-3786-g4b086ba5/src/osd/PrimaryLogPG.cc: In function 'void PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)' thread 7f4a58832700 time 2023-05-08T03:42:32.389475+0000 2023-05-08T03:42:32.773 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-3786-g4b086ba5/rpm/el8/BUILD/ceph-18.0.0-3786-g4b086ba5/src/osd/PrimaryLogPG.cc: 4284: ceph_abort_msg("out of order op") 2023-05-08T03:42:32.773 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 2023-05-08T03:42:32.773 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: ceph version 18.0.0-3786-g4b086ba5 (4b086ba51b906a75bac7252b2239e8f120a38c8c) reef (dev) 2023-05-08T03:42:32.774 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x56290467bdd9] 2023-05-08T03:42:32.774 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 2: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x13d4) [0x562904935614] 2023-05-08T03:42:32.774 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 3: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x282a) [0x56290493bc9a] 2023-05-08T03:42:32.774 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 4: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x1c6) [0x56290478b0e6] 2023-05-08T03:42:32.774 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 5: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x69) [0x562904aa2829] 2023-05-08T03:42:32.774 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 6: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x115d) [0x5629047a017d] 2023-05-08T03:42:32.774 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 7: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x43b) [0x562904e56d1b] 2023-05-08T03:42:32.774 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 8: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x562904e59f44] 2023-05-08T03:42:32.775 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 9: /lib64/libpthread.so.0(+0x81ca) [0x7f4a7b6a61ca] 2023-05-08T03:42:32.775 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 10: clone() 2023-05-08T03:42:32.775 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 2023-05-08T03:42:32.775 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: -8> 2023-05-08T03:42:32.396+0000 7f4a58832700 -1 *** Caught signal (Aborted) ** 2023-05-08T03:42:32.775 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: in thread 7f4a58832700 thread_name:tp_osd_tp 2023-05-08T03:42:32.775 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 2023-05-08T03:42:32.776 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: ceph version 18.0.0-3786-g4b086ba5 (4b086ba51b906a75bac7252b2239e8f120a38c8c) reef (dev) 2023-05-08T03:42:32.776 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f4a7b6b0cf0] 2023-05-08T03:42:32.776 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 2: gsignal() 2023-05-08T03:42:32.776 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 3: abort() 2023-05-08T03:42:32.776 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x197) [0x56290467be99] 2023-05-08T03:42:32.776 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 5: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x13d4) [0x562904935614] 2023-05-08T03:42:32.776 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 6: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x282a) [0x56290493bc9a] 2023-05-08T03:42:32.776 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 7: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x1c6) [0x56290478b0e6] 2023-05-08T03:42:32.777 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 8: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x69) [0x562904aa2829] 2023-05-08T03:42:32.777 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 9: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x115d) [0x5629047a017d] 2023-05-08T03:42:32.777 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 10: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x43b) [0x562904e56d1b] 2023-05-08T03:42:32.777 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 11: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x562904e59f44] 2023-05-08T03:42:32.777 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f4a7b6a61ca] 2023-05-08T03:42:32.777 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 13: clone() 2023-05-08T03:42:32.777 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-05-08T03:42:32.778 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[143232]: 2023-05-08T03:42:33.255 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:32 smithi096 systemd[1]: ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c@osd.3.service: Main process exited, code=exited, status=134/n/a 2023-05-08T03:42:33.525 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:33 smithi096 ceph-mon[124666]: pgmap v10: 97 pgs: 97 active+clean; 203 MiB data, 648 MiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 31 MiB/s wr, 181 op/s 2023-05-08T03:42:33.525 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:33 smithi096 ceph-mon[124666]: osd.3 reported immediately failed by osd.7 2023-05-08T03:42:33.526 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:33 smithi096 ceph-mon[124666]: osd.3 failed (root=default,host=smithi096) (connection refused reported by osd.7) 2023-05-08T03:42:33.526 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:33 smithi096 ceph-mon[124666]: osd.3 reported immediately failed by osd.7 2023-05-08T03:42:33.526 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:33 smithi096 ceph-mon[124666]: osd.3 reported immediately failed by osd.4 2023-05-08T03:42:33.526 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:33 smithi096 ceph-mon[124666]: osd.3 reported immediately failed by osd.2 2023-05-08T03:42:33.526 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:33 smithi096 ceph-mon[124666]: osd.3 reported immediately failed by osd.4 2023-05-08T03:42:33.526 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:33 smithi096 ceph-mon[124666]: osd.3 reported immediately failed by osd.0 2023-05-08T03:42:33.526 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:33 smithi096 ceph-mon[124666]: osd.3 reported immediately failed by osd.6 2023-05-08T03:42:33.526 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:33 smithi096 ceph-mon[124666]: osd.3 reported immediately failed by osd.9 2023-05-08T03:42:33.527 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:33 smithi096 ceph-mon[124666]: osd.3 reported immediately failed by osd.5 2023-05-08T03:42:33.527 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:33 smithi096 ceph-mon[124666]: osd.3 reported immediately failed by osd.0 2023-05-08T03:42:33.527 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:33 smithi096 ceph-mon[124666]: osd.3 reported immediately failed by osd.6 2023-05-08T03:42:33.527 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:33 smithi096 ceph-mon[124666]: osd.3 reported immediately failed by osd.9 2023-05-08T03:42:33.527 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:33 smithi096 ceph-mon[124666]: osd.3 reported immediately failed by osd.8 2023-05-08T03:42:33.527 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:33 smithi096 ceph-mon[124666]: osd.3 reported immediately failed by osd.10 2023-05-08T03:42:33.527 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:33 smithi096 ceph-mon[124666]: osd.3 reported immediately failed by osd.11 2023-05-08T03:42:33.527 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:33 smithi096 ceph-mon[124666]: osd.3 reported immediately failed by osd.1 2023-05-08T03:42:33.528 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:33 smithi096 ceph-mon[124666]: osd.3 reported immediately failed by osd.2 2023-05-08T03:42:33.528 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:33 smithi096 ceph-mon[124666]: osd.3 reported immediately failed by osd.5 2023-05-08T03:42:33.528 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:33 smithi096 ceph-mon[124666]: osd.3 reported immediately failed by osd.8 2023-05-08T03:42:33.528 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:33 smithi096 ceph-mon[124666]: osd.3 reported immediately failed by osd.10 2023-05-08T03:42:33.528 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:33 smithi096 ceph-mon[124666]: osd.3 reported immediately failed by osd.11 2023-05-08T03:42:33.528 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:33 smithi096 ceph-mon[124666]: osd.3 reported immediately failed by osd.1 2023-05-08T03:42:33.528 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:33 smithi096 ceph-mon[124666]: osd.3 reported immediately failed by osd.6 2023-05-08T03:42:33.529 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:33 smithi096 ceph-mon[124666]: osd.3 reported immediately failed by osd.9 2023-05-08T03:42:33.529 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:33 smithi096 ceph-mon[124666]: osd.3 reported immediately failed by osd.5 2023-05-08T03:42:33.529 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:33 smithi096 ceph-mon[124666]: osd.3 reported immediately failed by osd.2 2023-05-08T03:42:33.529 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:33 smithi096 ceph-mon[124666]: osd.3 reported immediately failed by osd.9 2023-05-08T03:42:33.529 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:33 smithi096 ceph-mon[124666]: osd.3 reported immediately failed by osd.5 2023-05-08T03:42:33.529 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:33 smithi096 ceph-mon[124666]: osd.3 reported immediately failed by osd.2 2023-05-08T03:42:33.529 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:33 smithi096 ceph-mon[124666]: osd.3 reported immediately failed by osd.7 2023-05-08T03:42:33.529 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:33 smithi096 ceph-mon[124666]: osd.3 reported immediately failed by osd.7 2023-05-08T03:42:33.530 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:33 smithi096 ceph-mon[124666]: osd.3 reported immediately failed by osd.4 2023-05-08T03:42:33.530 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:33 smithi096 ceph-mon[124666]: osd.3 reported immediately failed by osd.4 2023-05-08T03:42:33.530 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:33 smithi096 ceph-mon[124666]: osd.3 reported immediately failed by osd.1 2023-05-08T03:42:33.530 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:33 smithi096 ceph-mon[124666]: osd.3 reported immediately failed by osd.1 2023-05-08T03:42:33.530 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:33 smithi096 ceph-mon[124666]: osd.3 reported immediately failed by osd.10 2023-05-08T03:42:33.530 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:33 smithi096 ceph-mon[124666]: osd.3 reported immediately failed by osd.10 2023-05-08T03:42:33.530 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:33 smithi096 ceph-mon[124666]: osd.3 reported immediately failed by osd.0 2023-05-08T03:42:33.530 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:33 smithi096 ceph-mon[124666]: osd.3 reported immediately failed by osd.6 2023-05-08T03:42:33.531 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:33 smithi096 ceph-mon[124666]: osd.3 reported immediately failed by osd.2 2023-05-08T03:42:33.531 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:33 smithi096 ceph-mon[124666]: osd.3 reported immediately failed by osd.0 2023-05-08T03:42:33.531 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:33 smithi096 ceph-mon[124666]: osd.3 reported immediately failed by osd.6 2023-05-08T03:42:33.531 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:33 smithi096 ceph-mon[124666]: osd.3 reported immediately failed by osd.9 2023-05-08T03:42:33.531 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:33 smithi096 ceph-mon[124666]: osd.3 reported immediately failed by osd.8 2023-05-08T03:42:33.531 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:33 smithi096 ceph-mon[124666]: osd.3 reported immediately failed by osd.9 2023-05-08T03:42:33.531 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:33 smithi096 ceph-mon[124666]: osd.3 reported immediately failed by osd.11 2023-05-08T03:42:33.531 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:33 smithi096 ceph-mon[124666]: osd.3 reported immediately failed by osd.2 2023-05-08T03:42:33.532 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:33 smithi096 ceph-mon[124666]: osd.3 reported immediately failed by osd.5 2023-05-08T03:42:33.532 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:33 smithi096 ceph-mon[124666]: osd.3 reported immediately failed by osd.8 2023-05-08T03:42:33.532 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:33 smithi096 ceph-mon[124666]: osd.3 reported immediately failed by osd.11 2023-05-08T03:42:33.532 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:33 smithi096 ceph-mon[124666]: osd.3 reported immediately failed by osd.5 2023-05-08T03:42:33.532 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:33 smithi096 ceph-mon[124666]: osd.3 reported immediately failed by osd.1 2023-05-08T03:42:33.532 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:33 smithi096 ceph-mon[124666]: osd.3 reported immediately failed by osd.8 2023-05-08T03:42:33.532 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:33 smithi096 ceph-mon[124666]: osd.3 reported immediately failed by osd.7 2023-05-08T03:42:33.533 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:33 smithi096 ceph-mon[124666]: osd.3 reported immediately failed by osd.0 2023-05-08T03:42:33.533 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:33 smithi096 ceph-mon[124666]: osd.3 reported immediately failed by osd.10 2023-05-08T03:42:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:33 smithi133 ceph-mon[125939]: pgmap v10: 97 pgs: 97 active+clean; 203 MiB data, 648 MiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 31 MiB/s wr, 181 op/s 2023-05-08T03:42:33.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:33 smithi133 ceph-mon[125939]: osd.3 reported immediately failed by osd.7 2023-05-08T03:42:33.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:33 smithi133 ceph-mon[125939]: osd.3 failed (root=default,host=smithi096) (connection refused reported by osd.7) 2023-05-08T03:42:33.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:33 smithi133 ceph-mon[125939]: osd.3 reported immediately failed by osd.7 2023-05-08T03:42:33.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:33 smithi133 ceph-mon[125939]: osd.3 reported immediately failed by osd.4 2023-05-08T03:42:33.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:33 smithi133 ceph-mon[125939]: osd.3 reported immediately failed by osd.2 2023-05-08T03:42:33.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:33 smithi133 ceph-mon[125939]: osd.3 reported immediately failed by osd.4 2023-05-08T03:42:33.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:33 smithi133 ceph-mon[125939]: osd.3 reported immediately failed by osd.0 2023-05-08T03:42:33.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:33 smithi133 ceph-mon[125939]: osd.3 reported immediately failed by osd.6 2023-05-08T03:42:33.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:33 smithi133 ceph-mon[125939]: osd.3 reported immediately failed by osd.9 2023-05-08T03:42:33.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:33 smithi133 ceph-mon[125939]: osd.3 reported immediately failed by osd.5 2023-05-08T03:42:33.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:33 smithi133 ceph-mon[125939]: osd.3 reported immediately failed by osd.0 2023-05-08T03:42:33.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:33 smithi133 ceph-mon[125939]: osd.3 reported immediately failed by osd.6 2023-05-08T03:42:33.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:33 smithi133 ceph-mon[125939]: osd.3 reported immediately failed by osd.9 2023-05-08T03:42:33.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:33 smithi133 ceph-mon[125939]: osd.3 reported immediately failed by osd.8 2023-05-08T03:42:33.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:33 smithi133 ceph-mon[125939]: osd.3 reported immediately failed by osd.10 2023-05-08T03:42:33.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:33 smithi133 ceph-mon[125939]: osd.3 reported immediately failed by osd.11 2023-05-08T03:42:33.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:33 smithi133 ceph-mon[125939]: osd.3 reported immediately failed by osd.1 2023-05-08T03:42:33.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:33 smithi133 ceph-mon[125939]: osd.3 reported immediately failed by osd.2 2023-05-08T03:42:33.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:33 smithi133 ceph-mon[125939]: osd.3 reported immediately failed by osd.5 2023-05-08T03:42:33.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:33 smithi133 ceph-mon[125939]: osd.3 reported immediately failed by osd.8 2023-05-08T03:42:33.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:33 smithi133 ceph-mon[125939]: osd.3 reported immediately failed by osd.10 2023-05-08T03:42:33.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:33 smithi133 ceph-mon[125939]: osd.3 reported immediately failed by osd.11 2023-05-08T03:42:33.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:33 smithi133 ceph-mon[125939]: osd.3 reported immediately failed by osd.1 2023-05-08T03:42:33.744 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:33 smithi133 ceph-mon[125939]: osd.3 reported immediately failed by osd.6 2023-05-08T03:42:33.744 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:33 smithi133 ceph-mon[125939]: osd.3 reported immediately failed by osd.9 2023-05-08T03:42:33.744 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:33 smithi133 ceph-mon[125939]: osd.3 reported immediately failed by osd.5 2023-05-08T03:42:33.744 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:33 smithi133 ceph-mon[125939]: osd.3 reported immediately failed by osd.2 2023-05-08T03:42:33.744 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:33 smithi133 ceph-mon[125939]: osd.3 reported immediately failed by osd.9 2023-05-08T03:42:33.744 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:33 smithi133 ceph-mon[125939]: osd.3 reported immediately failed by osd.5 2023-05-08T03:42:33.744 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:33 smithi133 ceph-mon[125939]: osd.3 reported immediately failed by osd.2 2023-05-08T03:42:33.744 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:33 smithi133 ceph-mon[125939]: osd.3 reported immediately failed by osd.7 2023-05-08T03:42:33.745 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:33 smithi133 ceph-mon[125939]: osd.3 reported immediately failed by osd.7 2023-05-08T03:42:33.745 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:33 smithi133 ceph-mon[125939]: osd.3 reported immediately failed by osd.4 2023-05-08T03:42:33.745 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:33 smithi133 ceph-mon[125939]: osd.3 reported immediately failed by osd.4 2023-05-08T03:42:33.745 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:33 smithi133 ceph-mon[125939]: osd.3 reported immediately failed by osd.1 2023-05-08T03:42:33.745 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:33 smithi133 ceph-mon[125939]: osd.3 reported immediately failed by osd.1 2023-05-08T03:42:33.745 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:33 smithi133 ceph-mon[125939]: osd.3 reported immediately failed by osd.10 2023-05-08T03:42:33.745 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:33 smithi133 ceph-mon[125939]: osd.3 reported immediately failed by osd.10 2023-05-08T03:42:33.745 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:33 smithi133 ceph-mon[125939]: osd.3 reported immediately failed by osd.0 2023-05-08T03:42:33.746 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:33 smithi133 ceph-mon[125939]: osd.3 reported immediately failed by osd.6 2023-05-08T03:42:33.746 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:33 smithi133 ceph-mon[125939]: osd.3 reported immediately failed by osd.2 2023-05-08T03:42:33.746 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:33 smithi133 ceph-mon[125939]: osd.3 reported immediately failed by osd.0 2023-05-08T03:42:33.746 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:33 smithi133 ceph-mon[125939]: osd.3 reported immediately failed by osd.6 2023-05-08T03:42:33.746 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:33 smithi133 ceph-mon[125939]: osd.3 reported immediately failed by osd.9 2023-05-08T03:42:33.746 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:33 smithi133 ceph-mon[125939]: osd.3 reported immediately failed by osd.8 2023-05-08T03:42:33.746 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:33 smithi133 ceph-mon[125939]: osd.3 reported immediately failed by osd.9 2023-05-08T03:42:33.746 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:33 smithi133 ceph-mon[125939]: osd.3 reported immediately failed by osd.11 2023-05-08T03:42:33.747 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:33 smithi133 ceph-mon[125939]: osd.3 reported immediately failed by osd.2 2023-05-08T03:42:33.747 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:33 smithi133 ceph-mon[125939]: osd.3 reported immediately failed by osd.5 2023-05-08T03:42:33.747 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:33 smithi133 ceph-mon[125939]: osd.3 reported immediately failed by osd.8 2023-05-08T03:42:33.747 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:33 smithi133 ceph-mon[125939]: osd.3 reported immediately failed by osd.11 2023-05-08T03:42:33.748 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:33 smithi133 ceph-mon[125939]: osd.3 reported immediately failed by osd.5 2023-05-08T03:42:33.748 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:33 smithi133 ceph-mon[125939]: osd.3 reported immediately failed by osd.1 2023-05-08T03:42:33.749 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:33 smithi133 ceph-mon[125939]: osd.3 reported immediately failed by osd.8 2023-05-08T03:42:33.749 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:33 smithi133 ceph-mon[125939]: osd.3 reported immediately failed by osd.7 2023-05-08T03:42:33.749 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:33 smithi133 ceph-mon[125939]: osd.3 reported immediately failed by osd.0 2023-05-08T03:42:33.749 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:33 smithi133 ceph-mon[125939]: osd.3 reported immediately failed by osd.10 2023-05-08T03:42:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:33 smithi186 ceph-mon[126480]: pgmap v10: 97 pgs: 97 active+clean; 203 MiB data, 648 MiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 31 MiB/s wr, 181 op/s 2023-05-08T03:42:33.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:33 smithi186 ceph-mon[126480]: osd.3 reported immediately failed by osd.7 2023-05-08T03:42:33.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:33 smithi186 ceph-mon[126480]: osd.3 failed (root=default,host=smithi096) (connection refused reported by osd.7) 2023-05-08T03:42:33.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:33 smithi186 ceph-mon[126480]: osd.3 reported immediately failed by osd.7 2023-05-08T03:42:33.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:33 smithi186 ceph-mon[126480]: osd.3 reported immediately failed by osd.4 2023-05-08T03:42:33.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:33 smithi186 ceph-mon[126480]: osd.3 reported immediately failed by osd.2 2023-05-08T03:42:33.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:33 smithi186 ceph-mon[126480]: osd.3 reported immediately failed by osd.4 2023-05-08T03:42:33.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:33 smithi186 ceph-mon[126480]: osd.3 reported immediately failed by osd.0 2023-05-08T03:42:33.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:33 smithi186 ceph-mon[126480]: osd.3 reported immediately failed by osd.6 2023-05-08T03:42:33.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:33 smithi186 ceph-mon[126480]: osd.3 reported immediately failed by osd.9 2023-05-08T03:42:33.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:33 smithi186 ceph-mon[126480]: osd.3 reported immediately failed by osd.5 2023-05-08T03:42:33.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:33 smithi186 ceph-mon[126480]: osd.3 reported immediately failed by osd.0 2023-05-08T03:42:33.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:33 smithi186 ceph-mon[126480]: osd.3 reported immediately failed by osd.6 2023-05-08T03:42:33.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:33 smithi186 ceph-mon[126480]: osd.3 reported immediately failed by osd.9 2023-05-08T03:42:33.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:33 smithi186 ceph-mon[126480]: osd.3 reported immediately failed by osd.8 2023-05-08T03:42:33.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:33 smithi186 ceph-mon[126480]: osd.3 reported immediately failed by osd.10 2023-05-08T03:42:33.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:33 smithi186 ceph-mon[126480]: osd.3 reported immediately failed by osd.11 2023-05-08T03:42:33.873 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:33 smithi186 ceph-mon[126480]: osd.3 reported immediately failed by osd.1 2023-05-08T03:42:33.873 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:33 smithi186 ceph-mon[126480]: osd.3 reported immediately failed by osd.2 2023-05-08T03:42:33.873 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:33 smithi186 ceph-mon[126480]: osd.3 reported immediately failed by osd.5 2023-05-08T03:42:33.873 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:33 smithi186 ceph-mon[126480]: osd.3 reported immediately failed by osd.8 2023-05-08T03:42:33.873 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:33 smithi186 ceph-mon[126480]: osd.3 reported immediately failed by osd.10 2023-05-08T03:42:33.873 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:33 smithi186 ceph-mon[126480]: osd.3 reported immediately failed by osd.11 2023-05-08T03:42:33.873 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:33 smithi186 ceph-mon[126480]: osd.3 reported immediately failed by osd.1 2023-05-08T03:42:33.873 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:33 smithi186 ceph-mon[126480]: osd.3 reported immediately failed by osd.6 2023-05-08T03:42:33.874 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:33 smithi186 ceph-mon[126480]: osd.3 reported immediately failed by osd.9 2023-05-08T03:42:33.874 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:33 smithi186 ceph-mon[126480]: osd.3 reported immediately failed by osd.5 2023-05-08T03:42:33.874 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:33 smithi186 ceph-mon[126480]: osd.3 reported immediately failed by osd.2 2023-05-08T03:42:33.874 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:33 smithi186 ceph-mon[126480]: osd.3 reported immediately failed by osd.9 2023-05-08T03:42:33.874 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:33 smithi186 ceph-mon[126480]: osd.3 reported immediately failed by osd.5 2023-05-08T03:42:33.874 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:33 smithi186 ceph-mon[126480]: osd.3 reported immediately failed by osd.2 2023-05-08T03:42:33.874 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:33 smithi186 ceph-mon[126480]: osd.3 reported immediately failed by osd.7 2023-05-08T03:42:33.875 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:33 smithi186 ceph-mon[126480]: osd.3 reported immediately failed by osd.7 2023-05-08T03:42:33.875 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:33 smithi186 ceph-mon[126480]: osd.3 reported immediately failed by osd.4 2023-05-08T03:42:33.875 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:33 smithi186 ceph-mon[126480]: osd.3 reported immediately failed by osd.4 2023-05-08T03:42:33.875 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:33 smithi186 ceph-mon[126480]: osd.3 reported immediately failed by osd.1 2023-05-08T03:42:33.876 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:33 smithi186 ceph-mon[126480]: osd.3 reported immediately failed by osd.1 2023-05-08T03:42:33.876 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:33 smithi186 ceph-mon[126480]: osd.3 reported immediately failed by osd.10 2023-05-08T03:42:33.876 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:33 smithi186 ceph-mon[126480]: osd.3 reported immediately failed by osd.10 2023-05-08T03:42:33.876 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:33 smithi186 ceph-mon[126480]: osd.3 reported immediately failed by osd.0 2023-05-08T03:42:33.877 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:33 smithi186 ceph-mon[126480]: osd.3 reported immediately failed by osd.6 2023-05-08T03:42:33.877 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:33 smithi186 ceph-mon[126480]: osd.3 reported immediately failed by osd.2 2023-05-08T03:42:33.877 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:33 smithi186 ceph-mon[126480]: osd.3 reported immediately failed by osd.0 2023-05-08T03:42:33.877 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:33 smithi186 ceph-mon[126480]: osd.3 reported immediately failed by osd.6 2023-05-08T03:42:33.877 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:33 smithi186 ceph-mon[126480]: osd.3 reported immediately failed by osd.9 2023-05-08T03:42:33.877 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:33 smithi186 ceph-mon[126480]: osd.3 reported immediately failed by osd.8 2023-05-08T03:42:33.877 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:33 smithi186 ceph-mon[126480]: osd.3 reported immediately failed by osd.9 2023-05-08T03:42:33.877 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:33 smithi186 ceph-mon[126480]: osd.3 reported immediately failed by osd.11 2023-05-08T03:42:33.878 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:33 smithi186 ceph-mon[126480]: osd.3 reported immediately failed by osd.2 2023-05-08T03:42:33.878 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:33 smithi186 ceph-mon[126480]: osd.3 reported immediately failed by osd.5 2023-05-08T03:42:33.878 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:33 smithi186 ceph-mon[126480]: osd.3 reported immediately failed by osd.8 2023-05-08T03:42:33.878 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:33 smithi186 ceph-mon[126480]: osd.3 reported immediately failed by osd.11 2023-05-08T03:42:33.878 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:33 smithi186 ceph-mon[126480]: osd.3 reported immediately failed by osd.5 2023-05-08T03:42:33.878 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:33 smithi186 ceph-mon[126480]: osd.3 reported immediately failed by osd.1 2023-05-08T03:42:33.878 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:33 smithi186 ceph-mon[126480]: osd.3 reported immediately failed by osd.8 2023-05-08T03:42:33.878 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:33 smithi186 ceph-mon[126480]: osd.3 reported immediately failed by osd.7 2023-05-08T03:42:33.879 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:33 smithi186 ceph-mon[126480]: osd.3 reported immediately failed by osd.0 2023-05-08T03:42:33.879 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:33 smithi186 ceph-mon[126480]: osd.3 reported immediately failed by osd.10 2023-05-08T03:42:34.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:34 smithi096 ceph-mon[124666]: Health check failed: 1 osds down (OSD_DOWN) 2023-05-08T03:42:34.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:34 smithi096 ceph-mon[124666]: osdmap e86: 12 total, 11 up, 12 in 2023-05-08T03:42:34.506 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:34 smithi096 systemd[1]: ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c@osd.3.service: Failed with result 'exit-code'. 2023-05-08T03:42:34.544 INFO:teuthology.orchestra.run.smithi096.stderr:4100000 of 50000000 tuples (8%) done (elapsed 7.97 s, remaining 89.26 s) 2023-05-08T03:42:34.647 INFO:teuthology.orchestra.run.smithi096.stderr:4200000 of 50000000 tuples (8%) done (elapsed 8.08 s, remaining 88.07 s) 2023-05-08T03:42:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:34 smithi133 ceph-mon[125939]: Health check failed: 1 osds down (OSD_DOWN) 2023-05-08T03:42:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:34 smithi133 ceph-mon[125939]: osdmap e86: 12 total, 11 up, 12 in 2023-05-08T03:42:34.828 INFO:teuthology.orchestra.run.smithi096.stderr:4300000 of 50000000 tuples (8%) done (elapsed 8.26 s, remaining 87.75 s) 2023-05-08T03:42:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:34 smithi186 ceph-mon[126480]: Health check failed: 1 osds down (OSD_DOWN) 2023-05-08T03:42:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:34 smithi186 ceph-mon[126480]: osdmap e86: 12 total, 11 up, 12 in 2023-05-08T03:42:35.007 INFO:teuthology.orchestra.run.smithi096.stderr:4400000 of 50000000 tuples (8%) done (elapsed 8.44 s, remaining 87.43 s) 2023-05-08T03:42:35.111 INFO:teuthology.orchestra.run.smithi096.stderr:4500000 of 50000000 tuples (9%) done (elapsed 8.54 s, remaining 86.34 s) 2023-05-08T03:42:35.278 INFO:teuthology.orchestra.run.smithi096.stderr:4600000 of 50000000 tuples (9%) done (elapsed 8.71 s, remaining 85.93 s) 2023-05-08T03:42:35.455 INFO:teuthology.orchestra.run.smithi096.stderr:4700000 of 50000000 tuples (9%) done (elapsed 8.88 s, remaining 85.63 s) 2023-05-08T03:42:35.552 INFO:teuthology.orchestra.run.smithi096.stderr:4800000 of 50000000 tuples (9%) done (elapsed 8.98 s, remaining 84.57 s) 2023-05-08T03:42:35.721 INFO:teuthology.orchestra.run.smithi096.stderr:4900000 of 50000000 tuples (9%) done (elapsed 9.15 s, remaining 84.21 s) 2023-05-08T03:42:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:35 smithi133 ceph-mon[125939]: pgmap v12: 97 pgs: 26 peering, 71 active+clean; 427 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 468 KiB/s rd, 82 MiB/s wr, 248 op/s 2023-05-08T03:42:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:35 smithi133 ceph-mon[125939]: osdmap e87: 12 total, 11 up, 12 in 2023-05-08T03:42:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:35 smithi096 ceph-mon[124666]: pgmap v12: 97 pgs: 26 peering, 71 active+clean; 427 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 468 KiB/s rd, 82 MiB/s wr, 248 op/s 2023-05-08T03:42:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:35 smithi096 ceph-mon[124666]: osdmap e87: 12 total, 11 up, 12 in 2023-05-08T03:42:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:35 smithi186 ceph-mon[126480]: pgmap v12: 97 pgs: 26 peering, 71 active+clean; 427 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 468 KiB/s rd, 82 MiB/s wr, 248 op/s 2023-05-08T03:42:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:35 smithi186 ceph-mon[126480]: osdmap e87: 12 total, 11 up, 12 in 2023-05-08T03:42:35.896 INFO:teuthology.orchestra.run.smithi096.stderr:5000000 of 50000000 tuples (10%) done (elapsed 9.32 s, remaining 83.92 s) 2023-05-08T03:42:36.005 INFO:teuthology.orchestra.run.smithi096.stderr:5100000 of 50000000 tuples (10%) done (elapsed 9.43 s, remaining 83.06 s) 2023-05-08T03:42:36.184 INFO:teuthology.orchestra.run.smithi096.stderr:5200000 of 50000000 tuples (10%) done (elapsed 9.61 s, remaining 82.81 s) 2023-05-08T03:42:36.366 INFO:teuthology.orchestra.run.smithi096.stderr:5300000 of 50000000 tuples (10%) done (elapsed 9.80 s, remaining 82.61 s) 2023-05-08T03:42:36.475 INFO:teuthology.orchestra.run.smithi096.stderr:5400000 of 50000000 tuples (10%) done (elapsed 9.90 s, remaining 81.79 s) 2023-05-08T03:42:36.643 INFO:teuthology.orchestra.run.smithi096.stderr:5500000 of 50000000 tuples (11%) done (elapsed 10.07 s, remaining 81.49 s) 2023-05-08T03:42:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:36 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:42:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:36 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:42:36.819 INFO:teuthology.orchestra.run.smithi096.stderr:5600000 of 50000000 tuples (11%) done (elapsed 10.25 s, remaining 81.24 s) 2023-05-08T03:42:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:36 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:42:36.886 INFO:teuthology.orchestra.run.smithi096.stderr:5700000 of 50000000 tuples (11%) done (elapsed 10.31 s, remaining 80.16 s) 2023-05-08T03:42:37.084 INFO:teuthology.orchestra.run.smithi096.stderr:5800000 of 50000000 tuples (11%) done (elapsed 10.51 s, remaining 80.11 s) 2023-05-08T03:42:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:37 smithi096 ceph-mon[124666]: pgmap v14: 97 pgs: 27 peering, 70 active+clean; 443 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 559 KiB/s rd, 107 MiB/s wr, 268 op/s 2023-05-08T03:42:37.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:37 smithi186 ceph-mon[126480]: pgmap v14: 97 pgs: 27 peering, 70 active+clean; 443 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 559 KiB/s rd, 107 MiB/s wr, 268 op/s 2023-05-08T03:42:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:37 smithi133 ceph-mon[125939]: pgmap v14: 97 pgs: 27 peering, 70 active+clean; 443 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 559 KiB/s rd, 107 MiB/s wr, 268 op/s 2023-05-08T03:42:38.154 INFO:teuthology.orchestra.run.smithi096.stderr:5900000 of 50000000 tuples (11%) done (elapsed 11.58 s, remaining 86.58 s) 2023-05-08T03:42:38.235 INFO:teuthology.orchestra.run.smithi096.stderr:6000000 of 50000000 tuples (12%) done (elapsed 11.66 s, remaining 85.54 s) 2023-05-08T03:42:38.408 INFO:teuthology.orchestra.run.smithi096.stderr:6100000 of 50000000 tuples (12%) done (elapsed 11.84 s, remaining 85.18 s) 2023-05-08T03:42:38.510 INFO:teuthology.orchestra.run.smithi096.stderr:6200000 of 50000000 tuples (12%) done (elapsed 11.94 s, remaining 84.35 s) 2023-05-08T03:42:38.669 INFO:teuthology.orchestra.run.smithi096.stderr:6300000 of 50000000 tuples (12%) done (elapsed 12.10 s, remaining 83.92 s) 2023-05-08T03:42:38.850 INFO:teuthology.orchestra.run.smithi096.stderr:6400000 of 50000000 tuples (12%) done (elapsed 12.28 s, remaining 83.65 s) 2023-05-08T03:42:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:38 smithi186 ceph-mon[126480]: pgmap v15: 97 pgs: 27 peering, 70 active+clean; 443 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 61 MiB/s wr, 42 op/s 2023-05-08T03:42:38.952 INFO:teuthology.orchestra.run.smithi096.stderr:6500000 of 50000000 tuples (13%) done (elapsed 12.38 s, remaining 82.86 s) 2023-05-08T03:42:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:38 smithi133 ceph-mon[125939]: pgmap v15: 97 pgs: 27 peering, 70 active+clean; 443 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 61 MiB/s wr, 42 op/s 2023-05-08T03:42:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:38 smithi096 ceph-mon[124666]: pgmap v15: 97 pgs: 27 peering, 70 active+clean; 443 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 61 MiB/s wr, 42 op/s 2023-05-08T03:42:39.117 INFO:teuthology.orchestra.run.smithi096.stderr:6600000 of 50000000 tuples (13%) done (elapsed 12.55 s, remaining 82.50 s) 2023-05-08T03:42:39.292 INFO:teuthology.orchestra.run.smithi096.stderr:6700000 of 50000000 tuples (13%) done (elapsed 12.72 s, remaining 82.21 s) 2023-05-08T03:42:39.358 INFO:teuthology.orchestra.run.smithi096.stderr:6800000 of 50000000 tuples (13%) done (elapsed 12.79 s, remaining 81.23 s) 2023-05-08T03:42:39.555 INFO:teuthology.orchestra.run.smithi096.stderr:6900000 of 50000000 tuples (13%) done (elapsed 12.98 s, remaining 81.10 s) 2023-05-08T03:42:39.747 INFO:teuthology.orchestra.run.smithi096.stderr:7000000 of 50000000 tuples (14%) done (elapsed 13.18 s, remaining 80.94 s) 2023-05-08T03:42:39.812 INFO:teuthology.orchestra.run.smithi096.stderr:7100000 of 50000000 tuples (14%) done (elapsed 13.24 s, remaining 80.01 s) 2023-05-08T03:42:40.023 INFO:teuthology.orchestra.run.smithi096.stderr:7200000 of 50000000 tuples (14%) done (elapsed 13.45 s, remaining 79.97 s) 2023-05-08T03:42:40.192 INFO:teuthology.orchestra.run.smithi096.stderr:7300000 of 50000000 tuples (14%) done (elapsed 13.62 s, remaining 79.67 s) 2023-05-08T03:42:40.262 INFO:teuthology.orchestra.run.smithi096.stderr:7400000 of 50000000 tuples (14%) done (elapsed 13.69 s, remaining 78.81 s) 2023-05-08T03:42:40.453 INFO:teuthology.orchestra.run.smithi096.stderr:7500000 of 50000000 tuples (15%) done (elapsed 13.88 s, remaining 78.67 s) 2023-05-08T03:42:40.520 INFO:teuthology.orchestra.run.smithi096.stderr:7600000 of 50000000 tuples (15%) done (elapsed 13.95 s, remaining 77.82 s) 2023-05-08T03:42:40.694 INFO:teuthology.orchestra.run.smithi096.stderr:7700000 of 50000000 tuples (15%) done (elapsed 14.12 s, remaining 77.58 s) 2023-05-08T03:42:40.891 INFO:teuthology.orchestra.run.smithi096.stderr:7800000 of 50000000 tuples (15%) done (elapsed 14.32 s, remaining 77.47 s) 2023-05-08T03:42:40.952 INFO:teuthology.orchestra.run.smithi096.stderr:7900000 of 50000000 tuples (15%) done (elapsed 14.38 s, remaining 76.64 s) 2023-05-08T03:42:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:40 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:42:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:40 smithi133 ceph-mon[125939]: pgmap v16: 97 pgs: 27 active+undersized+degraded, 70 active+clean; 1.4 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 219 MiB/s wr, 115 op/s; 335/3597 objects degraded (9.313%) 2023-05-08T03:42:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:40 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:42:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:40 smithi096 ceph-mon[124666]: pgmap v16: 97 pgs: 27 active+undersized+degraded, 70 active+clean; 1.4 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 219 MiB/s wr, 115 op/s; 335/3597 objects degraded (9.313%) 2023-05-08T03:42:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:40 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:42:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:40 smithi186 ceph-mon[126480]: pgmap v16: 97 pgs: 27 active+undersized+degraded, 70 active+clean; 1.4 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 219 MiB/s wr, 115 op/s; 335/3597 objects degraded (9.313%) 2023-05-08T03:42:41.134 INFO:teuthology.orchestra.run.smithi096.stderr:8000000 of 50000000 tuples (16%) done (elapsed 14.56 s, remaining 76.46 s) 2023-05-08T03:42:41.234 INFO:teuthology.orchestra.run.smithi096.stderr:8100000 of 50000000 tuples (16%) done (elapsed 14.66 s, remaining 75.85 s) 2023-05-08T03:42:41.399 INFO:teuthology.orchestra.run.smithi096.stderr:8200000 of 50000000 tuples (16%) done (elapsed 14.83 s, remaining 75.59 s) 2023-05-08T03:42:41.554 INFO:teuthology.orchestra.run.smithi096.stderr:8300000 of 50000000 tuples (16%) done (elapsed 14.98 s, remaining 75.28 s) 2023-05-08T03:42:41.644 INFO:teuthology.orchestra.run.smithi096.stderr:8400000 of 50000000 tuples (16%) done (elapsed 15.07 s, remaining 74.65 s) 2023-05-08T03:42:41.845 INFO:teuthology.orchestra.run.smithi096.stderr:8500000 of 50000000 tuples (17%) done (elapsed 15.27 s, remaining 74.57 s) 2023-05-08T03:42:41.987 INFO:teuthology.orchestra.run.smithi096.stderr:8600000 of 50000000 tuples (17%) done (elapsed 15.42 s, remaining 74.21 s) 2023-05-08T03:42:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:41 smithi133 ceph-mon[125939]: Health check failed: Degraded data redundancy: 335/3597 objects degraded (9.313%), 27 pgs degraded (PG_DEGRADED) 2023-05-08T03:42:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:41 smithi096 ceph-mon[124666]: Health check failed: Degraded data redundancy: 335/3597 objects degraded (9.313%), 27 pgs degraded (PG_DEGRADED) 2023-05-08T03:42:42.091 INFO:teuthology.orchestra.run.smithi096.stderr:8700000 of 50000000 tuples (17%) done (elapsed 15.52 s, remaining 73.67 s) 2023-05-08T03:42:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:41 smithi186 ceph-mon[126480]: Health check failed: Degraded data redundancy: 335/3597 objects degraded (9.313%), 27 pgs degraded (PG_DEGRADED) 2023-05-08T03:42:42.236 INFO:teuthology.orchestra.run.smithi096.stderr:8800000 of 50000000 tuples (17%) done (elapsed 15.67 s, remaining 73.34 s) 2023-05-08T03:42:42.413 INFO:teuthology.orchestra.run.smithi096.stderr:8900000 of 50000000 tuples (17%) done (elapsed 15.84 s, remaining 73.16 s) 2023-05-08T03:42:42.519 INFO:teuthology.orchestra.run.smithi096.stderr:9000000 of 50000000 tuples (18%) done (elapsed 15.95 s, remaining 72.65 s) 2023-05-08T03:42:42.671 INFO:teuthology.orchestra.run.smithi096.stderr:9100000 of 50000000 tuples (18%) done (elapsed 16.10 s, remaining 72.36 s) 2023-05-08T03:42:42.770 INFO:teuthology.orchestra.run.smithi096.stderr:9200000 of 50000000 tuples (18%) done (elapsed 16.20 s, remaining 71.84 s) 2023-05-08T03:42:42.943 INFO:teuthology.orchestra.run.smithi096.stderr:9300000 of 50000000 tuples (18%) done (elapsed 16.37 s, remaining 71.65 s) 2023-05-08T03:42:43.083 INFO:teuthology.orchestra.run.smithi096.stderr:9400000 of 50000000 tuples (18%) done (elapsed 16.51 s, remaining 71.32 s) 2023-05-08T03:42:43.187 INFO:teuthology.orchestra.run.smithi096.stderr:9500000 of 50000000 tuples (19%) done (elapsed 16.62 s, remaining 70.84 s) 2023-05-08T03:42:43.332 INFO:teuthology.orchestra.run.smithi096.stderr:9600000 of 50000000 tuples (19%) done (elapsed 16.76 s, remaining 70.54 s) 2023-05-08T03:42:43.520 INFO:teuthology.orchestra.run.smithi096.stderr:9700000 of 50000000 tuples (19%) done (elapsed 16.95 s, remaining 70.42 s) 2023-05-08T03:42:43.721 INFO:teuthology.orchestra.run.smithi096.stderr:9800000 of 50000000 tuples (19%) done (elapsed 17.15 s, remaining 70.35 s) 2023-05-08T03:42:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:43 smithi133 ceph-mon[125939]: pgmap v17: 97 pgs: 27 active+undersized+degraded, 70 active+clean; 1.4 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 203 MiB/s wr, 107 op/s; 335/3597 objects degraded (9.313%) 2023-05-08T03:42:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:43 smithi096 ceph-mon[124666]: pgmap v17: 97 pgs: 27 active+undersized+degraded, 70 active+clean; 1.4 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 203 MiB/s wr, 107 op/s; 335/3597 objects degraded (9.313%) 2023-05-08T03:42:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:43 smithi186 ceph-mon[126480]: pgmap v17: 97 pgs: 27 active+undersized+degraded, 70 active+clean; 1.4 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 203 MiB/s wr, 107 op/s; 335/3597 objects degraded (9.313%) 2023-05-08T03:42:44.392 INFO:teuthology.orchestra.run.smithi096.stderr:9900000 of 50000000 tuples (19%) done (elapsed 17.82 s, remaining 72.18 s) 2023-05-08T03:42:44.570 INFO:teuthology.orchestra.run.smithi096.stderr:10000000 of 50000000 tuples (20%) done (elapsed 18.00 s, remaining 72.00 s) 2023-05-08T03:42:44.632 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:44 smithi096 systemd[1]: ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c@osd.3.service: Service RestartSec=10s expired, scheduling restart. 2023-05-08T03:42:44.632 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:44 smithi096 systemd[1]: ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c@osd.3.service: Scheduled restart job, restart counter is at 1. 2023-05-08T03:42:44.633 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:44 smithi096 systemd[1]: Stopped Ceph osd.3 for f7ffcfb0-ed50-11ed-9b01-001a4aab830c. 2023-05-08T03:42:44.633 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:44 smithi096 systemd[1]: Starting Ceph osd.3 for f7ffcfb0-ed50-11ed-9b01-001a4aab830c... 2023-05-08T03:42:44.682 INFO:teuthology.orchestra.run.smithi096.stderr:10100000 of 50000000 tuples (20%) done (elapsed 18.11 s, remaining 71.55 s) 2023-05-08T03:42:44.985 INFO:teuthology.orchestra.run.smithi096.stderr:10200000 of 50000000 tuples (20%) done (elapsed 18.41 s, remaining 71.85 s) 2023-05-08T03:42:45.435 INFO:teuthology.orchestra.run.smithi096.stderr:10300000 of 50000000 tuples (20%) done (elapsed 18.86 s, remaining 72.71 s) 2023-05-08T03:42:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:45 smithi096 ceph-mon[124666]: pgmap v18: 97 pgs: 27 active+undersized+degraded, 70 active+clean; 1.9 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 206 MiB/s wr, 104 op/s; 375/3954 objects degraded (9.484%) 2023-05-08T03:42:45.506 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:45 smithi096 bash[175151]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-05-08T03:42:45.506 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:45 smithi096 bash[175151]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2023-05-08T03:42:45.507 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:45 smithi096 bash[175151]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2023-05-08T03:42:45.507 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:45 smithi096 bash[175151]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2023-05-08T03:42:45.507 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:45 smithi096 bash[175151]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-3/block 2023-05-08T03:42:45.507 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:45 smithi096 bash[175151]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-05-08T03:42:45.507 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:45 smithi096 bash[175151]: --> ceph-volume raw activate successful for osd ID: 3 2023-05-08T03:42:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:45 smithi133 ceph-mon[125939]: pgmap v18: 97 pgs: 27 active+undersized+degraded, 70 active+clean; 1.9 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 206 MiB/s wr, 104 op/s; 375/3954 objects degraded (9.484%) 2023-05-08T03:42:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:45 smithi186 ceph-mon[126480]: pgmap v18: 97 pgs: 27 active+undersized+degraded, 70 active+clean; 1.9 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 206 MiB/s wr, 104 op/s; 375/3954 objects degraded (9.484%) 2023-05-08T03:42:46.074 INFO:teuthology.orchestra.run.smithi096.stderr:10400000 of 50000000 tuples (20%) done (elapsed 19.50 s, remaining 74.26 s) 2023-05-08T03:42:46.255 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:45 smithi096 podman[175439]: 2023-05-08T03:42:46.255 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:46 smithi096 bash[175439]: 457712a9eca7b97fcd2fa419384d77f8b008c21186f8ad1c69094390eeca5002 2023-05-08T03:42:46.255 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:46 smithi096 ceph-osd[175479]: -- 172.21.15.96:0/4127409082 <== mon.0 v2:172.21.15.96:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x562495aeb6c0 con 0x562495abb400 2023-05-08T03:42:46.256 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:46 smithi096 systemd[1]: Started Ceph osd.3 for f7ffcfb0-ed50-11ed-9b01-001a4aab830c. 2023-05-08T03:42:46.332 INFO:teuthology.orchestra.run.smithi096.stderr:10500000 of 50000000 tuples (21%) done (elapsed 19.76 s, remaining 74.34 s) 2023-05-08T03:42:46.438 INFO:teuthology.orchestra.run.smithi096.stderr:10600000 of 50000000 tuples (21%) done (elapsed 19.87 s, remaining 73.84 s) 2023-05-08T03:42:46.543 INFO:teuthology.orchestra.run.smithi096.stderr:10700000 of 50000000 tuples (21%) done (elapsed 19.97 s, remaining 73.35 s) 2023-05-08T03:42:46.734 INFO:teuthology.orchestra.run.smithi096.stderr:10800000 of 50000000 tuples (21%) done (elapsed 20.16 s, remaining 73.18 s) 2023-05-08T03:42:46.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:46 smithi133 ceph-mon[125939]: pgmap v19: 97 pgs: 27 active+undersized+degraded, 70 active+clean; 2.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 192 MiB/s wr, 94 op/s; 379/4050 objects degraded (9.358%) 2023-05-08T03:42:46.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:46 smithi133 ceph-mon[125939]: Health check update: Degraded data redundancy: 379/4050 objects degraded (9.358%), 27 pgs degraded (PG_DEGRADED) 2023-05-08T03:42:46.755 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:46 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[175455]: 2023-05-08T03:42:46.565+0000 7f9adf0f3640 -1 Falling back to public interface 2023-05-08T03:42:46.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:46 smithi096 ceph-mon[124666]: pgmap v19: 97 pgs: 27 active+undersized+degraded, 70 active+clean; 2.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 192 MiB/s wr, 94 op/s; 379/4050 objects degraded (9.358%) 2023-05-08T03:42:46.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:46 smithi096 ceph-mon[124666]: Health check update: Degraded data redundancy: 379/4050 objects degraded (9.358%), 27 pgs degraded (PG_DEGRADED) 2023-05-08T03:42:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:46 smithi186 ceph-mon[126480]: pgmap v19: 97 pgs: 27 active+undersized+degraded, 70 active+clean; 2.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 192 MiB/s wr, 94 op/s; 379/4050 objects degraded (9.358%) 2023-05-08T03:42:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:46 smithi186 ceph-mon[126480]: Health check update: Degraded data redundancy: 379/4050 objects degraded (9.358%), 27 pgs degraded (PG_DEGRADED) 2023-05-08T03:42:47.369 INFO:teuthology.orchestra.run.smithi096.stderr:10900000 of 50000000 tuples (21%) done (elapsed 20.80 s, remaining 74.61 s) 2023-05-08T03:42:47.445 INFO:teuthology.orchestra.run.smithi096.stderr:11000000 of 50000000 tuples (22%) done (elapsed 20.87 s, remaining 74.01 s) 2023-05-08T03:42:47.564 INFO:teuthology.orchestra.run.smithi096.stderr:11100000 of 50000000 tuples (22%) done (elapsed 20.99 s, remaining 73.57 s) 2023-05-08T03:42:47.648 INFO:teuthology.orchestra.run.smithi096.stderr:11200000 of 50000000 tuples (22%) done (elapsed 21.08 s, remaining 73.02 s) 2023-05-08T03:42:47.760 INFO:teuthology.orchestra.run.smithi096.stderr:11300000 of 50000000 tuples (22%) done (elapsed 21.19 s, remaining 72.56 s) 2023-05-08T03:42:47.882 INFO:teuthology.orchestra.run.smithi096.stderr:11400000 of 50000000 tuples (22%) done (elapsed 21.31 s, remaining 72.16 s) 2023-05-08T03:42:47.985 INFO:teuthology.orchestra.run.smithi096.stderr:11500000 of 50000000 tuples (23%) done (elapsed 21.41 s, remaining 71.69 s) 2023-05-08T03:42:48.074 INFO:teuthology.orchestra.run.smithi096.stderr:11600000 of 50000000 tuples (23%) done (elapsed 21.50 s, remaining 71.18 s) 2023-05-08T03:42:48.184 INFO:teuthology.orchestra.run.smithi096.stderr:11700000 of 50000000 tuples (23%) done (elapsed 21.61 s, remaining 70.75 s) 2023-05-08T03:42:48.339 INFO:teuthology.orchestra.run.smithi096.stderr:11800000 of 50000000 tuples (23%) done (elapsed 21.77 s, remaining 70.47 s) 2023-05-08T03:42:48.443 INFO:teuthology.orchestra.run.smithi096.stderr:11900000 of 50000000 tuples (23%) done (elapsed 21.87 s, remaining 70.03 s) 2023-05-08T03:42:48.545 INFO:teuthology.orchestra.run.smithi096.stderr:12000000 of 50000000 tuples (24%) done (elapsed 21.97 s, remaining 69.59 s) 2023-05-08T03:42:48.671 INFO:teuthology.orchestra.run.smithi096.stderr:12100000 of 50000000 tuples (24%) done (elapsed 22.10 s, remaining 69.22 s) 2023-05-08T03:42:48.772 INFO:teuthology.orchestra.run.smithi096.stderr:12200000 of 50000000 tuples (24%) done (elapsed 22.20 s, remaining 68.78 s) 2023-05-08T03:42:48.878 INFO:teuthology.orchestra.run.smithi096.stderr:12300000 of 50000000 tuples (24%) done (elapsed 22.31 s, remaining 68.37 s) 2023-05-08T03:42:49.200 INFO:teuthology.orchestra.run.smithi096.stderr:12400000 of 50000000 tuples (24%) done (elapsed 22.63 s, remaining 68.61 s) 2023-05-08T03:42:49.648 INFO:teuthology.orchestra.run.smithi096.stderr:12500000 of 50000000 tuples (25%) done (elapsed 23.08 s, remaining 69.23 s) 2023-05-08T03:42:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:49 smithi133 ceph-mon[125939]: pgmap v20: 97 pgs: 27 active+undersized+degraded, 70 active+clean; 2.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 185 MiB/s wr, 91 op/s; 379/4050 objects degraded (9.358%) 2023-05-08T03:42:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:42:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:49 smithi096 ceph-mon[124666]: pgmap v20: 97 pgs: 27 active+undersized+degraded, 70 active+clean; 2.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 185 MiB/s wr, 91 op/s; 379/4050 objects degraded (9.358%) 2023-05-08T03:42:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:42:49.756 INFO:teuthology.orchestra.run.smithi096.stderr:12600000 of 50000000 tuples (25%) done (elapsed 23.18 s, remaining 68.82 s) 2023-05-08T03:42:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:49 smithi186 ceph-mon[126480]: pgmap v20: 97 pgs: 27 active+undersized+degraded, 70 active+clean; 2.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 185 MiB/s wr, 91 op/s; 379/4050 objects degraded (9.358%) 2023-05-08T03:42:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:42:50.056 INFO:teuthology.orchestra.run.smithi096.stderr:12700000 of 50000000 tuples (25%) done (elapsed 23.49 s, remaining 68.98 s) 2023-05-08T03:42:50.428 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:50 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[175455]: 2023-05-08T03:42:50.143+0000 7f9adf0f3640 -1 osd.3 85 log_to_monitors true 2023-05-08T03:42:50.505 INFO:teuthology.orchestra.run.smithi096.stderr:12800000 of 50000000 tuples (25%) done (elapsed 23.93 s, remaining 69.56 s) 2023-05-08T03:42:50.609 INFO:teuthology.orchestra.run.smithi096.stderr:12900000 of 50000000 tuples (25%) done (elapsed 24.04 s, remaining 69.13 s) 2023-05-08T03:42:50.715 INFO:teuthology.orchestra.run.smithi096.stderr:13000000 of 50000000 tuples (26%) done (elapsed 24.14 s, remaining 68.72 s) 2023-05-08T03:42:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:50 smithi133 ceph-mon[125939]: from='osd.3 [v2:172.21.15.96:6810/4131023617,v1:172.21.15.96:6811/4131023617]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-05-08T03:42:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:50 smithi133 ceph-mon[125939]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-05-08T03:42:50.757 INFO:journalctl@ceph.osd.3.smithi096.stdout:May 08 03:42:50 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-osd-3[175455]: 2023-05-08T03:42:50.454+0000 7f9ad055f700 -1 osd.3 85 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-08T03:42:50.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:50 smithi096 ceph-mon[124666]: from='osd.3 [v2:172.21.15.96:6810/4131023617,v1:172.21.15.96:6811/4131023617]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-05-08T03:42:50.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:50 smithi096 ceph-mon[124666]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-05-08T03:42:50.821 INFO:teuthology.orchestra.run.smithi096.stderr:13100000 of 50000000 tuples (26%) done (elapsed 24.25 s, remaining 68.31 s) 2023-05-08T03:42:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:50 smithi186 ceph-mon[126480]: from='osd.3 [v2:172.21.15.96:6810/4131023617,v1:172.21.15.96:6811/4131023617]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-05-08T03:42:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:50 smithi186 ceph-mon[126480]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-05-08T03:42:50.929 INFO:teuthology.orchestra.run.smithi096.stderr:13200000 of 50000000 tuples (26%) done (elapsed 24.36 s, remaining 67.91 s) 2023-05-08T03:42:51.005 INFO:teuthology.orchestra.run.smithi096.stderr:13300000 of 50000000 tuples (26%) done (elapsed 24.43 s, remaining 67.42 s) 2023-05-08T03:42:51.113 INFO:teuthology.orchestra.run.smithi096.stderr:13400000 of 50000000 tuples (26%) done (elapsed 24.54 s, remaining 67.03 s) 2023-05-08T03:42:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:51 smithi133 ceph-mon[125939]: pgmap v21: 97 pgs: 27 active+undersized+degraded, 70 active+clean; 2.3 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 229 MiB/s wr, 231 op/s; 398/4239 objects degraded (9.389%) 2023-05-08T03:42:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:51 smithi133 ceph-mon[125939]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-05-08T03:42:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:51 smithi133 ceph-mon[125939]: osdmap e88: 12 total, 11 up, 12 in 2023-05-08T03:42:51.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:51 smithi133 ceph-mon[125939]: from='osd.3 [v2:172.21.15.96:6810/4131023617,v1:172.21.15.96:6811/4131023617]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2023-05-08T03:42:51.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:51 smithi133 ceph-mon[125939]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2023-05-08T03:42:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:51 smithi096 ceph-mon[124666]: pgmap v21: 97 pgs: 27 active+undersized+degraded, 70 active+clean; 2.3 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 229 MiB/s wr, 231 op/s; 398/4239 objects degraded (9.389%) 2023-05-08T03:42:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:51 smithi096 ceph-mon[124666]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-05-08T03:42:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:51 smithi096 ceph-mon[124666]: osdmap e88: 12 total, 11 up, 12 in 2023-05-08T03:42:51.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:51 smithi096 ceph-mon[124666]: from='osd.3 [v2:172.21.15.96:6810/4131023617,v1:172.21.15.96:6811/4131023617]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2023-05-08T03:42:51.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:51 smithi096 ceph-mon[124666]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2023-05-08T03:42:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:51 smithi186 ceph-mon[126480]: pgmap v21: 97 pgs: 27 active+undersized+degraded, 70 active+clean; 2.3 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 229 MiB/s wr, 231 op/s; 398/4239 objects degraded (9.389%) 2023-05-08T03:42:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:51 smithi186 ceph-mon[126480]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-05-08T03:42:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:51 smithi186 ceph-mon[126480]: osdmap e88: 12 total, 11 up, 12 in 2023-05-08T03:42:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:51 smithi186 ceph-mon[126480]: from='osd.3 [v2:172.21.15.96:6810/4131023617,v1:172.21.15.96:6811/4131023617]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2023-05-08T03:42:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:51 smithi186 ceph-mon[126480]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2023-05-08T03:42:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:52 smithi133 ceph-mon[125939]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-05-08T03:42:52.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:52 smithi133 ceph-mon[125939]: osd.3 [v2:172.21.15.96:6810/4131023617,v1:172.21.15.96:6811/4131023617] boot 2023-05-08T03:42:52.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:52 smithi133 ceph-mon[125939]: osdmap e89: 12 total, 12 up, 12 in 2023-05-08T03:42:52.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-05-08T03:42:52.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:52 smithi133 ceph-mon[125939]: pgmap v24: 97 pgs: 27 active+undersized+degraded, 70 active+clean; 2.3 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 90 MiB/s wr, 219 op/s; 398/4239 objects degraded (9.389%) 2023-05-08T03:42:52.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:52 smithi133 ceph-mon[125939]: Health check update: Degraded data redundancy: 398/4239 objects degraded (9.389%), 27 pgs degraded (PG_DEGRADED) 2023-05-08T03:42:52.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:52 smithi133 ceph-mon[125939]: osdmap e90: 12 total, 12 up, 12 in 2023-05-08T03:42:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:52 smithi096 ceph-mon[124666]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-05-08T03:42:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:52 smithi096 ceph-mon[124666]: osd.3 [v2:172.21.15.96:6810/4131023617,v1:172.21.15.96:6811/4131023617] boot 2023-05-08T03:42:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:52 smithi096 ceph-mon[124666]: osdmap e89: 12 total, 12 up, 12 in 2023-05-08T03:42:52.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-05-08T03:42:52.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:52 smithi096 ceph-mon[124666]: pgmap v24: 97 pgs: 27 active+undersized+degraded, 70 active+clean; 2.3 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 90 MiB/s wr, 219 op/s; 398/4239 objects degraded (9.389%) 2023-05-08T03:42:52.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:52 smithi096 ceph-mon[124666]: Health check update: Degraded data redundancy: 398/4239 objects degraded (9.389%), 27 pgs degraded (PG_DEGRADED) 2023-05-08T03:42:52.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:52 smithi096 ceph-mon[124666]: osdmap e90: 12 total, 12 up, 12 in 2023-05-08T03:42:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:52 smithi186 ceph-mon[126480]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-05-08T03:42:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:52 smithi186 ceph-mon[126480]: osd.3 [v2:172.21.15.96:6810/4131023617,v1:172.21.15.96:6811/4131023617] boot 2023-05-08T03:42:52.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:52 smithi186 ceph-mon[126480]: osdmap e89: 12 total, 12 up, 12 in 2023-05-08T03:42:52.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-05-08T03:42:52.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:52 smithi186 ceph-mon[126480]: pgmap v24: 97 pgs: 27 active+undersized+degraded, 70 active+clean; 2.3 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 90 MiB/s wr, 219 op/s; 398/4239 objects degraded (9.389%) 2023-05-08T03:42:52.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:52 smithi186 ceph-mon[126480]: Health check update: Degraded data redundancy: 398/4239 objects degraded (9.389%), 27 pgs degraded (PG_DEGRADED) 2023-05-08T03:42:52.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:52 smithi186 ceph-mon[126480]: osdmap e90: 12 total, 12 up, 12 in 2023-05-08T03:42:53.475 INFO:teuthology.orchestra.run.smithi096.stderr:13500000 of 50000000 tuples (27%) done (elapsed 26.90 s, remaining 72.74 s) 2023-05-08T03:42:53.737 INFO:teuthology.orchestra.run.smithi096.stderr:13600000 of 50000000 tuples (27%) done (elapsed 27.17 s, remaining 72.71 s) 2023-05-08T03:42:54.549 INFO:teuthology.orchestra.run.smithi096.stderr:13700000 of 50000000 tuples (27%) done (elapsed 27.98 s, remaining 74.13 s) 2023-05-08T03:42:54.646 INFO:teuthology.orchestra.run.smithi096.stderr:13800000 of 50000000 tuples (27%) done (elapsed 28.08 s, remaining 73.65 s) 2023-05-08T03:42:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:54 smithi096 ceph-mon[124666]: osdmap e91: 12 total, 12 up, 12 in 2023-05-08T03:42:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:54 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:42:54.808 INFO:teuthology.orchestra.run.smithi096.stderr:13900000 of 50000000 tuples (27%) done (elapsed 28.24 s, remaining 73.33 s) 2023-05-08T03:42:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:54 smithi186 ceph-mon[126480]: osdmap e91: 12 total, 12 up, 12 in 2023-05-08T03:42:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:54 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:42:54.883 INFO:teuthology.orchestra.run.smithi096.stderr:14000000 of 50000000 tuples (28%) done (elapsed 28.31 s, remaining 72.80 s) 2023-05-08T03:42:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:54 smithi133 ceph-mon[125939]: osdmap e91: 12 total, 12 up, 12 in 2023-05-08T03:42:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:54 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:42:55.027 INFO:teuthology.orchestra.run.smithi096.stderr:14100000 of 50000000 tuples (28%) done (elapsed 28.46 s, remaining 72.45 s) 2023-05-08T03:42:55.128 INFO:teuthology.orchestra.run.smithi096.stderr:14200000 of 50000000 tuples (28%) done (elapsed 28.56 s, remaining 71.99 s) 2023-05-08T03:42:55.229 INFO:teuthology.orchestra.run.smithi096.stderr:14300000 of 50000000 tuples (28%) done (elapsed 28.66 s, remaining 71.54 s) 2023-05-08T03:42:55.308 INFO:teuthology.orchestra.run.smithi096.stderr:14400000 of 50000000 tuples (28%) done (elapsed 28.74 s, remaining 71.04 s) 2023-05-08T03:42:55.414 INFO:teuthology.orchestra.run.smithi096.stderr:14500000 of 50000000 tuples (29%) done (elapsed 28.84 s, remaining 70.62 s) 2023-05-08T03:42:55.523 INFO:teuthology.orchestra.run.smithi096.stderr:14600000 of 50000000 tuples (29%) done (elapsed 28.95 s, remaining 70.20 s) 2023-05-08T03:42:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:55 smithi096 ceph-mon[124666]: pgmap v27: 97 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 21 active+undersized+degraded, 74 active+clean; 2.3 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 12 MiB/s wr, 95 op/s; 312/4242 objects degraded (7.355%); 25 MiB/s, 48 keys/s, 6 objects/s recovering 2023-05-08T03:42:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:55 smithi186 ceph-mon[126480]: pgmap v27: 97 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 21 active+undersized+degraded, 74 active+clean; 2.3 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 12 MiB/s wr, 95 op/s; 312/4242 objects degraded (7.355%); 25 MiB/s, 48 keys/s, 6 objects/s recovering 2023-05-08T03:42:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:55 smithi133 ceph-mon[125939]: pgmap v27: 97 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 21 active+undersized+degraded, 74 active+clean; 2.3 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 12 MiB/s wr, 95 op/s; 312/4242 objects degraded (7.355%); 25 MiB/s, 48 keys/s, 6 objects/s recovering 2023-05-08T03:42:56.615 INFO:teuthology.orchestra.run.smithi096.stderr:14700000 of 50000000 tuples (29%) done (elapsed 30.04 s, remaining 72.15 s) 2023-05-08T03:42:56.719 INFO:teuthology.orchestra.run.smithi096.stderr:14800000 of 50000000 tuples (29%) done (elapsed 30.15 s, remaining 71.70 s) 2023-05-08T03:42:56.827 INFO:teuthology.orchestra.run.smithi096.stderr:14900000 of 50000000 tuples (29%) done (elapsed 30.26 s, remaining 71.27 s) 2023-05-08T03:42:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:56 smithi186 ceph-mon[126480]: osdmap e92: 12 total, 12 up, 12 in 2023-05-08T03:42:56.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:56 smithi186 ceph-mon[126480]: pgmap v29: 97 pgs: 4 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 92 active+clean; 2.4 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 68 MiB/s wr, 247 op/s; 50/4350 objects degraded (1.149%); 99 MiB/s, 196 keys/s, 26 objects/s recovering 2023-05-08T03:42:56.932 INFO:teuthology.orchestra.run.smithi096.stderr:15000000 of 50000000 tuples (30%) done (elapsed 30.36 s, remaining 70.84 s) 2023-05-08T03:42:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:56 smithi133 ceph-mon[125939]: osdmap e92: 12 total, 12 up, 12 in 2023-05-08T03:42:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:56 smithi133 ceph-mon[125939]: pgmap v29: 97 pgs: 4 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 92 active+clean; 2.4 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 68 MiB/s wr, 247 op/s; 50/4350 objects degraded (1.149%); 99 MiB/s, 196 keys/s, 26 objects/s recovering 2023-05-08T03:42:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:56 smithi096 ceph-mon[124666]: osdmap e92: 12 total, 12 up, 12 in 2023-05-08T03:42:57.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:56 smithi096 ceph-mon[124666]: pgmap v29: 97 pgs: 4 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 92 active+clean; 2.4 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 68 MiB/s wr, 247 op/s; 50/4350 objects degraded (1.149%); 99 MiB/s, 196 keys/s, 26 objects/s recovering 2023-05-08T03:42:57.043 INFO:teuthology.orchestra.run.smithi096.stderr:15100000 of 50000000 tuples (30%) done (elapsed 30.47 s, remaining 70.43 s) 2023-05-08T03:42:57.127 INFO:teuthology.orchestra.run.smithi096.stderr:15200000 of 50000000 tuples (30%) done (elapsed 30.56 s, remaining 69.96 s) 2023-05-08T03:42:57.267 INFO:teuthology.orchestra.run.smithi096.stderr:15300000 of 50000000 tuples (30%) done (elapsed 30.70 s, remaining 69.62 s) 2023-05-08T03:42:57.343 INFO:teuthology.orchestra.run.smithi096.stderr:15400000 of 50000000 tuples (30%) done (elapsed 30.77 s, remaining 69.14 s) 2023-05-08T03:42:57.491 INFO:teuthology.orchestra.run.smithi096.stderr:15500000 of 50000000 tuples (31%) done (elapsed 30.92 s, remaining 68.82 s) 2023-05-08T03:42:57.558 INFO:teuthology.orchestra.run.smithi096.stderr:15600000 of 50000000 tuples (31%) done (elapsed 30.99 s, remaining 68.33 s) 2023-05-08T03:42:57.711 INFO:teuthology.orchestra.run.smithi096.stderr:15700000 of 50000000 tuples (31%) done (elapsed 31.14 s, remaining 68.03 s) 2023-05-08T03:42:57.793 INFO:teuthology.orchestra.run.smithi096.stderr:15800000 of 50000000 tuples (31%) done (elapsed 31.22 s, remaining 67.58 s) 2023-05-08T03:42:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:57 smithi186 ceph-mon[126480]: osdmap e93: 12 total, 12 up, 12 in 2023-05-08T03:42:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:57 smithi186 ceph-mon[126480]: Health check update: Degraded data redundancy: 50/4350 objects degraded (1.149%), 5 pgs degraded (PG_DEGRADED) 2023-05-08T03:42:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:57 smithi186 ceph-mon[126480]: osdmap e94: 12 total, 12 up, 12 in 2023-05-08T03:42:57.927 INFO:teuthology.orchestra.run.smithi096.stderr:15900000 of 50000000 tuples (31%) done (elapsed 31.36 s, remaining 67.25 s) 2023-05-08T03:42:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:57 smithi133 ceph-mon[125939]: osdmap e93: 12 total, 12 up, 12 in 2023-05-08T03:42:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:57 smithi133 ceph-mon[125939]: Health check update: Degraded data redundancy: 50/4350 objects degraded (1.149%), 5 pgs degraded (PG_DEGRADED) 2023-05-08T03:42:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:57 smithi133 ceph-mon[125939]: osdmap e94: 12 total, 12 up, 12 in 2023-05-08T03:42:57.994 INFO:teuthology.orchestra.run.smithi096.stderr:16000000 of 50000000 tuples (32%) done (elapsed 31.42 s, remaining 66.77 s) 2023-05-08T03:42:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:57 smithi096 ceph-mon[124666]: osdmap e93: 12 total, 12 up, 12 in 2023-05-08T03:42:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:57 smithi096 ceph-mon[124666]: Health check update: Degraded data redundancy: 50/4350 objects degraded (1.149%), 5 pgs degraded (PG_DEGRADED) 2023-05-08T03:42:58.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:57 smithi096 ceph-mon[124666]: osdmap e94: 12 total, 12 up, 12 in 2023-05-08T03:42:58.154 INFO:teuthology.orchestra.run.smithi096.stderr:16100000 of 50000000 tuples (32%) done (elapsed 31.58 s, remaining 66.50 s) 2023-05-08T03:42:58.272 INFO:teuthology.orchestra.run.smithi096.stderr:16200000 of 50000000 tuples (32%) done (elapsed 31.70 s, remaining 66.14 s) 2023-05-08T03:42:58.341 INFO:teuthology.orchestra.run.smithi096.stderr:16300000 of 50000000 tuples (32%) done (elapsed 31.77 s, remaining 65.68 s) 2023-05-08T03:42:58.473 INFO:teuthology.orchestra.run.smithi096.stderr:16400000 of 50000000 tuples (32%) done (elapsed 31.90 s, remaining 65.36 s) 2023-05-08T03:42:58.585 INFO:teuthology.orchestra.run.smithi096.stderr:16500000 of 50000000 tuples (33%) done (elapsed 32.01 s, remaining 65.00 s) 2023-05-08T03:42:58.665 INFO:teuthology.orchestra.run.smithi096.stderr:16600000 of 50000000 tuples (33%) done (elapsed 32.09 s, remaining 64.58 s) 2023-05-08T03:42:58.761 INFO:teuthology.orchestra.run.smithi096.stderr:16700000 of 50000000 tuples (33%) done (elapsed 32.19 s, remaining 64.19 s) 2023-05-08T03:42:58.877 INFO:teuthology.orchestra.run.smithi096.stderr:16800000 of 50000000 tuples (33%) done (elapsed 32.31 s, remaining 63.84 s) 2023-05-08T03:42:58.975 INFO:teuthology.orchestra.run.smithi096.stderr:16900000 of 50000000 tuples (33%) done (elapsed 32.40 s, remaining 63.47 s) 2023-05-08T03:42:59.089 INFO:teuthology.orchestra.run.smithi096.stderr:17000000 of 50000000 tuples (34%) done (elapsed 32.52 s, remaining 63.12 s) 2023-05-08T03:42:59.218 INFO:teuthology.orchestra.run.smithi096.stderr:17100000 of 50000000 tuples (34%) done (elapsed 32.65 s, remaining 62.81 s) 2023-05-08T03:42:59.299 INFO:teuthology.orchestra.run.smithi096.stderr:17200000 of 50000000 tuples (34%) done (elapsed 32.73 s, remaining 62.41 s) 2023-05-08T03:42:59.407 INFO:teuthology.orchestra.run.smithi096.stderr:17300000 of 50000000 tuples (34%) done (elapsed 32.84 s, remaining 62.07 s) 2023-05-08T03:42:59.528 INFO:teuthology.orchestra.run.smithi096.stderr:17400000 of 50000000 tuples (34%) done (elapsed 32.96 s, remaining 61.75 s) 2023-05-08T03:42:59.645 INFO:teuthology.orchestra.run.smithi096.stderr:17500000 of 50000000 tuples (35%) done (elapsed 33.07 s, remaining 61.42 s) 2023-05-08T03:42:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:59 smithi133 ceph-mon[125939]: pgmap v32: 97 pgs: 4 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 92 active+clean; 2.4 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 68 MiB/s wr, 246 op/s; 50/4350 objects degraded (1.149%); 99 MiB/s, 195 keys/s, 26 objects/s recovering 2023-05-08T03:42:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:42:59 smithi133 ceph-mon[125939]: osdmap e95: 12 total, 12 up, 12 in 2023-05-08T03:42:59.764 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:59 smithi096 ceph-mon[124666]: pgmap v32: 97 pgs: 4 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 92 active+clean; 2.4 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 68 MiB/s wr, 246 op/s; 50/4350 objects degraded (1.149%); 99 MiB/s, 195 keys/s, 26 objects/s recovering 2023-05-08T03:42:59.764 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:42:59 smithi096 ceph-mon[124666]: osdmap e95: 12 total, 12 up, 12 in 2023-05-08T03:42:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:59 smithi186 ceph-mon[126480]: pgmap v32: 97 pgs: 4 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 92 active+clean; 2.4 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 68 MiB/s wr, 246 op/s; 50/4350 objects degraded (1.149%); 99 MiB/s, 195 keys/s, 26 objects/s recovering 2023-05-08T03:42:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:42:59 smithi186 ceph-mon[126480]: osdmap e95: 12 total, 12 up, 12 in 2023-05-08T03:42:59.873 INFO:teuthology.orchestra.run.smithi096.stderr:17600000 of 50000000 tuples (35%) done (elapsed 33.30 s, remaining 61.31 s) 2023-05-08T03:43:00.483 INFO:teuthology.orchestra.run.smithi096.stderr:17700000 of 50000000 tuples (35%) done (elapsed 33.91 s, remaining 61.88 s) 2023-05-08T03:43:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:43:00 smithi133 ceph-mon[125939]: pgmap v34: 97 pgs: 97 active+clean; 2.7 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 141 MiB/s wr, 83 op/s; 45 MiB/s, 11 objects/s recovering 2023-05-08T03:43:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:43:00 smithi133 ceph-mon[125939]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 50/4350 objects degraded (1.149%), 5 pgs degraded) 2023-05-08T03:43:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:43:00 smithi133 ceph-mon[125939]: Cluster is now healthy 2023-05-08T03:43:00.755 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:43:00 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:43:00.554+0000 7f139e14c700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-08T03:43:00.755 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:43:00 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:43:00.554+0000 7f139e14c700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-08T03:43:00.756 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:43:00 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:43:00.554+0000 7f139e14c700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-08T03:43:00.756 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:43:00 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:43:00.554+0000 7f139e14c700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-08T03:43:00.756 INFO:journalctl@ceph.mgr.x.smithi096.stdout:May 08 03:43:00 smithi096 ceph-f7ffcfb0-ed50-11ed-9b01-001a4aab830c-mgr-x[124911]: 2023-05-08T03:43:00.554+0000 7f139e14c700 -1 client.0 error registering admin socket command: (17) File exists 2023-05-08T03:43:00.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:43:00 smithi096 ceph-mon[124666]: pgmap v34: 97 pgs: 97 active+clean; 2.7 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 141 MiB/s wr, 83 op/s; 45 MiB/s, 11 objects/s recovering 2023-05-08T03:43:00.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:43:00 smithi096 ceph-mon[124666]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 50/4350 objects degraded (1.149%), 5 pgs degraded) 2023-05-08T03:43:00.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:43:00 smithi096 ceph-mon[124666]: Cluster is now healthy 2023-05-08T03:43:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:43:00 smithi186 ceph-mon[126480]: pgmap v34: 97 pgs: 97 active+clean; 2.7 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 141 MiB/s wr, 83 op/s; 45 MiB/s, 11 objects/s recovering 2023-05-08T03:43:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:43:00 smithi186 ceph-mon[126480]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 50/4350 objects degraded (1.149%), 5 pgs degraded) 2023-05-08T03:43:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:43:00 smithi186 ceph-mon[126480]: Cluster is now healthy 2023-05-08T03:43:01.471 INFO:teuthology.orchestra.run.smithi096.stderr:17800000 of 50000000 tuples (35%) done (elapsed 34.90 s, remaining 63.13 s) 2023-05-08T03:43:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:43:03 smithi133 ceph-mon[125939]: pgmap v35: 97 pgs: 97 active+clean; 2.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 121 MiB/s wr, 67 op/s; 33 MiB/s, 8 objects/s recovering 2023-05-08T03:43:03.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:43:03 smithi133 ceph-mon[125939]: mgrmap e23: x(active, since 45s), standbys: z, y 2023-05-08T03:43:03.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:43:03 smithi096 ceph-mon[124666]: pgmap v35: 97 pgs: 97 active+clean; 2.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 121 MiB/s wr, 67 op/s; 33 MiB/s, 8 objects/s recovering 2023-05-08T03:43:03.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:43:03 smithi096 ceph-mon[124666]: mgrmap e23: x(active, since 45s), standbys: z, y 2023-05-08T03:43:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:43:03 smithi186 ceph-mon[126480]: pgmap v35: 97 pgs: 97 active+clean; 2.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 121 MiB/s wr, 67 op/s; 33 MiB/s, 8 objects/s recovering 2023-05-08T03:43:03.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:43:03 smithi186 ceph-mon[126480]: mgrmap e23: x(active, since 45s), standbys: z, y 2023-05-08T03:43:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:43:05 smithi133 ceph-mon[125939]: pgmap v36: 97 pgs: 97 active+clean; 3.1 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 146 MiB/s wr, 314 op/s; 27 MiB/s, 6 objects/s recovering 2023-05-08T03:43:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:43:05 smithi096 ceph-mon[124666]: pgmap v36: 97 pgs: 97 active+clean; 3.1 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 146 MiB/s wr, 314 op/s; 27 MiB/s, 6 objects/s recovering 2023-05-08T03:43:05.843 INFO:teuthology.orchestra.run.smithi096.stderr:17900000 of 50000000 tuples (35%) done (elapsed 39.27 s, remaining 70.43 s) 2023-05-08T03:43:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:43:05 smithi186 ceph-mon[126480]: pgmap v36: 97 pgs: 97 active+clean; 3.1 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 146 MiB/s wr, 314 op/s; 27 MiB/s, 6 objects/s recovering 2023-05-08T03:43:06.335 INFO:teuthology.orchestra.run.smithi096.stderr:18000000 of 50000000 tuples (36%) done (elapsed 39.76 s, remaining 70.69 s) 2023-05-08T03:43:06.439 INFO:teuthology.orchestra.run.smithi096.stderr:18100000 of 50000000 tuples (36%) done (elapsed 39.87 s, remaining 70.26 s) 2023-05-08T03:43:06.548 INFO:teuthology.orchestra.run.smithi096.stderr:18200000 of 50000000 tuples (36%) done (elapsed 39.98 s, remaining 69.85 s) 2023-05-08T03:43:06.670 INFO:teuthology.orchestra.run.smithi096.stderr:18300000 of 50000000 tuples (36%) done (elapsed 40.10 s, remaining 69.46 s) 2023-05-08T03:43:06.774 INFO:teuthology.orchestra.run.smithi096.stderr:18400000 of 50000000 tuples (36%) done (elapsed 40.20 s, remaining 69.04 s) 2023-05-08T03:43:06.866 INFO:teuthology.orchestra.run.smithi096.stderr:18500000 of 50000000 tuples (37%) done (elapsed 40.30 s, remaining 68.61 s) 2023-05-08T03:43:06.992 INFO:teuthology.orchestra.run.smithi096.stderr:18600000 of 50000000 tuples (37%) done (elapsed 40.42 s, remaining 68.24 s) 2023-05-08T03:43:07.098 INFO:teuthology.orchestra.run.smithi096.stderr:18700000 of 50000000 tuples (37%) done (elapsed 40.53 s, remaining 67.83 s) 2023-05-08T03:43:07.203 INFO:teuthology.orchestra.run.smithi096.stderr:18800000 of 50000000 tuples (37%) done (elapsed 40.63 s, remaining 67.43 s) 2023-05-08T03:43:07.394 INFO:teuthology.orchestra.run.smithi096.stderr:18900000 of 50000000 tuples (37%) done (elapsed 40.82 s, remaining 67.17 s) 2023-05-08T03:43:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:43:07 smithi133 ceph-mon[125939]: pgmap v37: 97 pgs: 97 active+clean; 3.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 151 MiB/s wr, 405 op/s; 23 MiB/s, 5 objects/s recovering 2023-05-08T03:43:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:43:07 smithi096 ceph-mon[124666]: pgmap v37: 97 pgs: 97 active+clean; 3.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 151 MiB/s wr, 405 op/s; 23 MiB/s, 5 objects/s recovering 2023-05-08T03:43:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:43:07 smithi186 ceph-mon[126480]: pgmap v37: 97 pgs: 97 active+clean; 3.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 151 MiB/s wr, 405 op/s; 23 MiB/s, 5 objects/s recovering 2023-05-08T03:43:07.884 INFO:teuthology.orchestra.run.smithi096.stderr:19000000 of 50000000 tuples (38%) done (elapsed 41.31 s, remaining 67.41 s) 2023-05-08T03:43:08.475 INFO:teuthology.orchestra.run.smithi096.stderr:19100000 of 50000000 tuples (38%) done (elapsed 41.90 s, remaining 67.79 s) 2023-05-08T03:43:08.923 INFO:teuthology.orchestra.run.smithi096.stderr:19200000 of 50000000 tuples (38%) done (elapsed 42.35 s, remaining 67.94 s) 2023-05-08T03:43:09.030 INFO:teuthology.orchestra.run.smithi096.stderr:19300000 of 50000000 tuples (38%) done (elapsed 42.46 s, remaining 67.54 s) 2023-05-08T03:43:09.137 INFO:teuthology.orchestra.run.smithi096.stderr:19400000 of 50000000 tuples (38%) done (elapsed 42.57 s, remaining 67.14 s) 2023-05-08T03:43:09.260 INFO:teuthology.orchestra.run.smithi096.stderr:19500000 of 50000000 tuples (39%) done (elapsed 42.69 s, remaining 66.77 s) 2023-05-08T03:43:09.367 INFO:teuthology.orchestra.run.smithi096.stderr:19600000 of 50000000 tuples (39%) done (elapsed 42.80 s, remaining 66.38 s) 2023-05-08T03:43:09.453 INFO:teuthology.orchestra.run.smithi096.stderr:19700000 of 50000000 tuples (39%) done (elapsed 42.88 s, remaining 65.96 s) 2023-05-08T03:43:09.560 INFO:teuthology.orchestra.run.smithi096.stderr:19800000 of 50000000 tuples (39%) done (elapsed 42.99 s, remaining 65.57 s) 2023-05-08T03:43:09.653 INFO:teuthology.orchestra.run.smithi096.stderr:19900000 of 50000000 tuples (39%) done (elapsed 43.08 s, remaining 65.16 s) 2023-05-08T03:43:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:43:09 smithi133 ceph-mon[125939]: pgmap v38: 97 pgs: 97 active+clean; 3.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 130 MiB/s wr, 348 op/s; 20 MiB/s, 5 objects/s recovering 2023-05-08T03:43:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:43:09 smithi096 ceph-mon[124666]: pgmap v38: 97 pgs: 97 active+clean; 3.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 130 MiB/s wr, 348 op/s; 20 MiB/s, 5 objects/s recovering 2023-05-08T03:43:09.770 INFO:teuthology.orchestra.run.smithi096.stderr:20000000 of 50000000 tuples (40%) done (elapsed 43.20 s, remaining 64.80 s) 2023-05-08T03:43:09.868 INFO:teuthology.orchestra.run.smithi096.stderr:20100000 of 50000000 tuples (40%) done (elapsed 43.30 s, remaining 64.41 s) 2023-05-08T03:43:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:43:09 smithi186 ceph-mon[126480]: pgmap v38: 97 pgs: 97 active+clean; 3.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 130 MiB/s wr, 348 op/s; 20 MiB/s, 5 objects/s recovering 2023-05-08T03:43:09.967 INFO:teuthology.orchestra.run.smithi096.stderr:20200000 of 50000000 tuples (40%) done (elapsed 43.40 s, remaining 64.02 s) 2023-05-08T03:43:10.104 INFO:teuthology.orchestra.run.smithi096.stderr:20300000 of 50000000 tuples (40%) done (elapsed 43.53 s, remaining 63.69 s) 2023-05-08T03:43:10.213 INFO:teuthology.orchestra.run.smithi096.stderr:20400000 of 50000000 tuples (40%) done (elapsed 43.64 s, remaining 63.32 s) 2023-05-08T03:43:10.295 INFO:teuthology.orchestra.run.smithi096.stderr:20500000 of 50000000 tuples (41%) done (elapsed 43.72 s, remaining 62.92 s) 2023-05-08T03:43:10.402 INFO:teuthology.orchestra.run.smithi096.stderr:20600000 of 50000000 tuples (41%) done (elapsed 43.83 s, remaining 62.55 s) 2023-05-08T03:43:10.531 INFO:teuthology.orchestra.run.smithi096.stderr:20700000 of 50000000 tuples (41%) done (elapsed 43.96 s, remaining 62.22 s) 2023-05-08T03:43:10.645 INFO:teuthology.orchestra.run.smithi096.stderr:20800000 of 50000000 tuples (41%) done (elapsed 44.07 s, remaining 61.87 s) 2023-05-08T03:43:10.749 INFO:teuthology.orchestra.run.smithi096.stderr:20900000 of 50000000 tuples (41%) done (elapsed 44.18 s, remaining 61.51 s) 2023-05-08T03:43:10.843 INFO:teuthology.orchestra.run.smithi096.stderr:21000000 of 50000000 tuples (42%) done (elapsed 44.27 s, remaining 61.14 s) 2023-05-08T03:43:10.960 INFO:teuthology.orchestra.run.smithi096.stderr:21100000 of 50000000 tuples (42%) done (elapsed 44.39 s, remaining 60.80 s) 2023-05-08T03:43:11.073 INFO:teuthology.orchestra.run.smithi096.stderr:21200000 of 50000000 tuples (42%) done (elapsed 44.50 s, remaining 60.46 s) 2023-05-08T03:43:11.177 INFO:teuthology.orchestra.run.smithi096.stderr:21300000 of 50000000 tuples (42%) done (elapsed 44.61 s, remaining 60.10 s) 2023-05-08T03:43:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:43:11 smithi133 ceph-mon[125939]: pgmap v39: 97 pgs: 97 active+clean; 3.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 128 MiB/s wr, 511 op/s; 17 MiB/s, 4 objects/s recovering 2023-05-08T03:43:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:43:11 smithi096 ceph-mon[124666]: pgmap v39: 97 pgs: 97 active+clean; 3.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 128 MiB/s wr, 511 op/s; 17 MiB/s, 4 objects/s recovering 2023-05-08T03:43:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:43:11 smithi186 ceph-mon[126480]: pgmap v39: 97 pgs: 97 active+clean; 3.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 128 MiB/s wr, 511 op/s; 17 MiB/s, 4 objects/s recovering 2023-05-08T03:43:12.061 INFO:teuthology.orchestra.run.smithi096.stderr:21400000 of 50000000 tuples (42%) done (elapsed 45.49 s, remaining 60.79 s) 2023-05-08T03:43:13.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:43:13 smithi133 ceph-mon[125939]: pgmap v40: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 74 MiB/s wr, 476 op/s 2023-05-08T03:43:13.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:43:13 smithi096 ceph-mon[124666]: pgmap v40: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 74 MiB/s wr, 476 op/s 2023-05-08T03:43:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:43:13 smithi186 ceph-mon[126480]: pgmap v40: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 74 MiB/s wr, 476 op/s 2023-05-08T03:43:14.184 INFO:teuthology.orchestra.run.smithi096.stderr:21500000 of 50000000 tuples (43%) done (elapsed 47.61 s, remaining 63.12 s) 2023-05-08T03:43:14.345 INFO:teuthology.orchestra.run.smithi096.stderr:21600000 of 50000000 tuples (43%) done (elapsed 47.77 s, remaining 62.81 s) 2023-05-08T03:43:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:43:15 smithi133 ceph-mon[125939]: pgmap v41: 97 pgs: 97 active+clean; 3.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 90 MiB/s wr, 530 op/s 2023-05-08T03:43:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:43:15 smithi096 ceph-mon[124666]: pgmap v41: 97 pgs: 97 active+clean; 3.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 90 MiB/s wr, 530 op/s 2023-05-08T03:43:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:43:15 smithi186 ceph-mon[126480]: pgmap v41: 97 pgs: 97 active+clean; 3.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 90 MiB/s wr, 530 op/s 2023-05-08T03:43:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:43:17 smithi133 ceph-mon[125939]: pgmap v42: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 79 MiB/s wr, 457 op/s 2023-05-08T03:43:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:43:17 smithi096 ceph-mon[124666]: pgmap v42: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 79 MiB/s wr, 457 op/s 2023-05-08T03:43:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:43:17 smithi186 ceph-mon[126480]: pgmap v42: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 79 MiB/s wr, 457 op/s 2023-05-08T03:43:18.528 INFO:teuthology.orchestra.run.smithi096.stderr:21700000 of 50000000 tuples (43%) done (elapsed 51.96 s, remaining 67.76 s) 2023-05-08T03:43:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:43:19 smithi133 ceph-mon[125939]: pgmap v43: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 61 MiB/s wr, 363 op/s 2023-05-08T03:43:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:43:19 smithi096 ceph-mon[124666]: pgmap v43: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 61 MiB/s wr, 363 op/s 2023-05-08T03:43:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:43:19 smithi186 ceph-mon[126480]: pgmap v43: 97 pgs: 97 active+clean; 3.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 61 MiB/s wr, 363 op/s 2023-05-08T03:43:21.355 INFO:teuthology.orchestra.run.smithi096.stderr:21800000 of 50000000 tuples (43%) done (elapsed 54.78 s, remaining 70.87 s) 2023-05-08T03:43:21.441 INFO:teuthology.orchestra.run.smithi096.stderr:21900000 of 50000000 tuples (43%) done (elapsed 54.87 s, remaining 70.40 s) 2023-05-08T03:43:21.566 INFO:teuthology.orchestra.run.smithi096.stderr:22000000 of 50000000 tuples (44%) done (elapsed 55.00 s, remaining 69.99 s) 2023-05-08T03:43:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:43:21 smithi133 ceph-mon[125939]: pgmap v44: 97 pgs: 97 active+clean; 4.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 79 MiB/s wr, 634 op/s 2023-05-08T03:43:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:43:21 smithi096 ceph-mon[124666]: pgmap v44: 97 pgs: 97 active+clean; 4.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 79 MiB/s wr, 634 op/s 2023-05-08T03:43:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:43:21 smithi186 ceph-mon[126480]: pgmap v44: 97 pgs: 97 active+clean; 4.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 79 MiB/s wr, 634 op/s 2023-05-08T03:43:22.224 INFO:teuthology.orchestra.run.smithi096.stderr:22100000 of 50000000 tuples (44%) done (elapsed 55.65 s, remaining 70.26 s) 2023-05-08T03:43:22.481 INFO:teuthology.orchestra.run.smithi096.stderr:22200000 of 50000000 tuples (44%) done (elapsed 55.91 s, remaining 70.01 s) 2023-05-08T03:43:22.601 INFO:teuthology.orchestra.run.smithi096.stderr:22300000 of 50000000 tuples (44%) done (elapsed 56.03 s, remaining 69.60 s) 2023-05-08T03:43:22.713 INFO:teuthology.orchestra.run.smithi096.stderr:22400000 of 50000000 tuples (44%) done (elapsed 56.14 s, remaining 69.18 s) 2023-05-08T03:43:22.824 INFO:teuthology.orchestra.run.smithi096.stderr:22500000 of 50000000 tuples (45%) done (elapsed 56.25 s, remaining 68.75 s) 2023-05-08T03:43:22.928 INFO:teuthology.orchestra.run.smithi096.stderr:22600000 of 50000000 tuples (45%) done (elapsed 56.36 s, remaining 68.33 s) 2023-05-08T03:43:23.019 INFO:teuthology.orchestra.run.smithi096.stderr:22700000 of 50000000 tuples (45%) done (elapsed 56.45 s, remaining 67.89 s) 2023-05-08T03:43:23.143 INFO:teuthology.orchestra.run.smithi096.stderr:22800000 of 50000000 tuples (45%) done (elapsed 56.57 s, remaining 67.49 s) 2023-05-08T03:43:23.258 INFO:teuthology.orchestra.run.smithi096.stderr:22900000 of 50000000 tuples (45%) done (elapsed 56.69 s, remaining 67.08 s) 2023-05-08T03:43:23.366 INFO:teuthology.orchestra.run.smithi096.stderr:23000000 of 50000000 tuples (46%) done (elapsed 56.79 s, remaining 66.67 s) 2023-05-08T03:43:23.487 INFO:teuthology.orchestra.run.smithi096.stderr:23100000 of 50000000 tuples (46%) done (elapsed 56.92 s, remaining 66.28 s) 2023-05-08T03:43:23.594 INFO:teuthology.orchestra.run.smithi096.stderr:23200000 of 50000000 tuples (46%) done (elapsed 57.02 s, remaining 65.87 s) 2023-05-08T03:43:23.687 INFO:teuthology.orchestra.run.smithi096.stderr:23300000 of 50000000 tuples (46%) done (elapsed 57.12 s, remaining 65.45 s) 2023-05-08T03:43:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:43:23 smithi133 ceph-mon[125939]: pgmap v45: 97 pgs: 97 active+clean; 4.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 64 MiB/s wr, 431 op/s 2023-05-08T03:43:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:43:23 smithi096 ceph-mon[124666]: pgmap v45: 97 pgs: 97 active+clean; 4.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 64 MiB/s wr, 431 op/s 2023-05-08T03:43:23.815 INFO:teuthology.orchestra.run.smithi096.stderr:23400000 of 50000000 tuples (46%) done (elapsed 57.24 s, remaining 65.07 s) 2023-05-08T03:43:23.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:43:23 smithi186 ceph-mon[126480]: pgmap v45: 97 pgs: 97 active+clean; 4.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 64 MiB/s wr, 431 op/s 2023-05-08T03:43:24.336 INFO:teuthology.orchestra.run.smithi096.stderr:23500000 of 50000000 tuples (47%) done (elapsed 57.77 s, remaining 65.14 s) 2023-05-08T03:43:24.708 INFO:teuthology.orchestra.run.smithi096.stderr:23600000 of 50000000 tuples (47%) done (elapsed 58.14 s, remaining 65.03 s) 2023-05-08T03:43:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:43:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:43:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:43:24 smithi133 ceph-mon[125939]: pgmap v46: 97 pgs: 97 active+clean; 4.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 71 MiB/s wr, 564 op/s 2023-05-08T03:43:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:43:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:43:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:43:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:43:24.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:43:24 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:43:24.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:43:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:43:24.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:43:24 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T03:43:24.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:43:24 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T03:43:24.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:43:24 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:43:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:43:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:43:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:43:24 smithi096 ceph-mon[124666]: pgmap v46: 97 pgs: 97 active+clean; 4.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 71 MiB/s wr, 564 op/s 2023-05-08T03:43:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:43:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:43:24.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:43:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:43:24.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:43:24 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:43:24.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:43:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:43:24.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:43:24 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T03:43:24.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:43:24 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T03:43:24.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:43:24 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:43:24.825 INFO:teuthology.orchestra.run.smithi096.stderr:23700000 of 50000000 tuples (47%) done (elapsed 58.25 s, remaining 64.65 s) 2023-05-08T03:43:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:43:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:43:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:43:24 smithi186 ceph-mon[126480]: pgmap v46: 97 pgs: 97 active+clean; 4.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 71 MiB/s wr, 564 op/s 2023-05-08T03:43:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:43:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:43:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:43:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:43:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:43:24 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:43:24.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:43:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:43:24.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:43:24 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T03:43:24.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:43:24 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T03:43:24.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:43:24 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:43:24.933 INFO:teuthology.orchestra.run.smithi096.stderr:23800000 of 50000000 tuples (47%) done (elapsed 58.36 s, remaining 64.25 s) 2023-05-08T03:43:25.043 INFO:teuthology.orchestra.run.smithi096.stderr:23900000 of 50000000 tuples (47%) done (elapsed 58.47 s, remaining 63.85 s) 2023-05-08T03:43:25.152 INFO:teuthology.orchestra.run.smithi096.stderr:24000000 of 50000000 tuples (48%) done (elapsed 58.58 s, remaining 63.46 s) 2023-05-08T03:43:25.237 INFO:teuthology.orchestra.run.smithi096.stderr:24100000 of 50000000 tuples (48%) done (elapsed 58.67 s, remaining 63.05 s) 2023-05-08T03:43:25.480 INFO:teuthology.orchestra.run.smithi096.stderr:24200000 of 50000000 tuples (48%) done (elapsed 58.91 s, remaining 62.80 s) 2023-05-08T03:43:26.021 INFO:teuthology.orchestra.run.smithi096.stderr:24300000 of 50000000 tuples (48%) done (elapsed 59.45 s, remaining 62.88 s) 2023-05-08T03:43:26.285 INFO:teuthology.orchestra.run.smithi096.stderr:24400000 of 50000000 tuples (48%) done (elapsed 59.71 s, remaining 62.65 s) 2023-05-08T03:43:26.405 INFO:teuthology.orchestra.run.smithi096.stderr:24500000 of 50000000 tuples (49%) done (elapsed 59.83 s, remaining 62.28 s) 2023-05-08T03:43:26.512 INFO:teuthology.orchestra.run.smithi096.stderr:24600000 of 50000000 tuples (49%) done (elapsed 59.94 s, remaining 61.89 s) 2023-05-08T03:43:26.619 INFO:teuthology.orchestra.run.smithi096.stderr:24700000 of 50000000 tuples (49%) done (elapsed 60.05 s, remaining 61.51 s) 2023-05-08T03:43:26.726 INFO:teuthology.orchestra.run.smithi096.stderr:24800000 of 50000000 tuples (49%) done (elapsed 60.16 s, remaining 61.13 s) 2023-05-08T03:43:26.820 INFO:teuthology.orchestra.run.smithi096.stderr:24900000 of 50000000 tuples (49%) done (elapsed 60.25 s, remaining 60.73 s) 2023-05-08T03:43:26.940 INFO:teuthology.orchestra.run.smithi096.stderr:25000000 of 50000000 tuples (50%) done (elapsed 60.37 s, remaining 60.37 s) 2023-05-08T03:43:27.047 INFO:teuthology.orchestra.run.smithi096.stderr:25100000 of 50000000 tuples (50%) done (elapsed 60.48 s, remaining 59.99 s) 2023-05-08T03:43:27.163 INFO:teuthology.orchestra.run.smithi096.stderr:25200000 of 50000000 tuples (50%) done (elapsed 60.59 s, remaining 59.63 s) 2023-05-08T03:43:27.272 INFO:teuthology.orchestra.run.smithi096.stderr:25300000 of 50000000 tuples (50%) done (elapsed 60.70 s, remaining 59.26 s) 2023-05-08T03:43:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:43:27 smithi186 ceph-mon[126480]: pgmap v47: 97 pgs: 97 active+clean; 4.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 52 MiB/s wr, 529 op/s 2023-05-08T03:43:27.378 INFO:teuthology.orchestra.run.smithi096.stderr:25400000 of 50000000 tuples (50%) done (elapsed 60.81 s, remaining 58.89 s) 2023-05-08T03:43:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:43:27 smithi133 ceph-mon[125939]: pgmap v47: 97 pgs: 97 active+clean; 4.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 52 MiB/s wr, 529 op/s 2023-05-08T03:43:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:43:27 smithi096 ceph-mon[124666]: pgmap v47: 97 pgs: 97 active+clean; 4.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 52 MiB/s wr, 529 op/s 2023-05-08T03:43:28.516 INFO:teuthology.orchestra.run.smithi096.stderr:25500000 of 50000000 tuples (51%) done (elapsed 61.95 s, remaining 59.52 s) 2023-05-08T03:43:28.609 INFO:teuthology.orchestra.run.smithi096.stderr:25600000 of 50000000 tuples (51%) done (elapsed 62.04 s, remaining 59.13 s) 2023-05-08T03:43:28.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:43:28 smithi186 ceph-mon[126480]: pgmap v48: 97 pgs: 97 active+clean; 4.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 33 MiB/s wr, 440 op/s 2023-05-08T03:43:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:43:28 smithi133 ceph-mon[125939]: pgmap v48: 97 pgs: 97 active+clean; 4.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 33 MiB/s wr, 440 op/s 2023-05-08T03:43:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:43:28 smithi096 ceph-mon[124666]: pgmap v48: 97 pgs: 97 active+clean; 4.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 33 MiB/s wr, 440 op/s 2023-05-08T03:43:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:43:31 smithi186 ceph-mon[126480]: pgmap v49: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 91 MiB/s wr, 574 op/s 2023-05-08T03:43:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:43:31 smithi133 ceph-mon[125939]: pgmap v49: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 91 MiB/s wr, 574 op/s 2023-05-08T03:43:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:43:31 smithi096 ceph-mon[124666]: pgmap v49: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 91 MiB/s wr, 574 op/s 2023-05-08T03:43:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:43:33 smithi133 ceph-mon[125939]: pgmap v50: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 78 MiB/s wr, 304 op/s 2023-05-08T03:43:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:43:33 smithi096 ceph-mon[124666]: pgmap v50: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 78 MiB/s wr, 304 op/s 2023-05-08T03:43:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:43:33 smithi186 ceph-mon[126480]: pgmap v50: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 78 MiB/s wr, 304 op/s 2023-05-08T03:43:34.177 INFO:teuthology.orchestra.run.smithi096.stderr:25700000 of 50000000 tuples (51%) done (elapsed 67.61 s, remaining 63.92 s) 2023-05-08T03:43:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:43:35 smithi133 ceph-mon[125939]: pgmap v51: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 79 MiB/s wr, 510 op/s 2023-05-08T03:43:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:43:35 smithi096 ceph-mon[124666]: pgmap v51: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 79 MiB/s wr, 510 op/s 2023-05-08T03:43:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:43:35 smithi186 ceph-mon[126480]: pgmap v51: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 79 MiB/s wr, 510 op/s 2023-05-08T03:43:36.215 INFO:teuthology.orchestra.run.smithi096.stderr:25800000 of 50000000 tuples (51%) done (elapsed 69.64 s, remaining 65.33 s) 2023-05-08T03:43:36.331 INFO:teuthology.orchestra.run.smithi096.stderr:25900000 of 50000000 tuples (51%) done (elapsed 69.76 s, remaining 64.91 s) 2023-05-08T03:43:36.988 INFO:teuthology.orchestra.run.smithi096.stderr:26000000 of 50000000 tuples (52%) done (elapsed 70.42 s, remaining 65.00 s) 2023-05-08T03:43:37.271 INFO:teuthology.orchestra.run.smithi096.stderr:26100000 of 50000000 tuples (52%) done (elapsed 70.70 s, remaining 64.74 s) 2023-05-08T03:43:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:43:37 smithi133 ceph-mon[125939]: pgmap v52: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 70 MiB/s wr, 407 op/s 2023-05-08T03:43:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:43:37 smithi096 ceph-mon[124666]: pgmap v52: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 70 MiB/s wr, 407 op/s 2023-05-08T03:43:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:43:37 smithi186 ceph-mon[126480]: pgmap v52: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 70 MiB/s wr, 407 op/s 2023-05-08T03:43:37.911 INFO:teuthology.orchestra.run.smithi096.stderr:26200000 of 50000000 tuples (52%) done (elapsed 71.34 s, remaining 64.80 s) 2023-05-08T03:43:37.980 INFO:teuthology.orchestra.run.smithi096.stderr:26300000 of 50000000 tuples (52%) done (elapsed 71.41 s, remaining 64.35 s) 2023-05-08T03:43:38.099 INFO:teuthology.orchestra.run.smithi096.stderr:26400000 of 50000000 tuples (52%) done (elapsed 71.53 s, remaining 63.94 s) 2023-05-08T03:43:38.192 INFO:teuthology.orchestra.run.smithi096.stderr:26500000 of 50000000 tuples (53%) done (elapsed 71.62 s, remaining 63.51 s) 2023-05-08T03:43:38.305 INFO:teuthology.orchestra.run.smithi096.stderr:26600000 of 50000000 tuples (53%) done (elapsed 71.73 s, remaining 63.10 s) 2023-05-08T03:43:38.418 INFO:teuthology.orchestra.run.smithi096.stderr:26700000 of 50000000 tuples (53%) done (elapsed 71.85 s, remaining 62.70 s) 2023-05-08T03:43:38.530 INFO:teuthology.orchestra.run.smithi096.stderr:26800000 of 50000000 tuples (53%) done (elapsed 71.96 s, remaining 62.29 s) 2023-05-08T03:43:38.613 INFO:teuthology.orchestra.run.smithi096.stderr:26900000 of 50000000 tuples (53%) done (elapsed 72.04 s, remaining 61.86 s) 2023-05-08T03:43:38.717 INFO:teuthology.orchestra.run.smithi096.stderr:27000000 of 50000000 tuples (54%) done (elapsed 72.15 s, remaining 61.46 s) 2023-05-08T03:43:38.826 INFO:teuthology.orchestra.run.smithi096.stderr:27100000 of 50000000 tuples (54%) done (elapsed 72.25 s, remaining 61.06 s) 2023-05-08T03:43:38.931 INFO:teuthology.orchestra.run.smithi096.stderr:27200000 of 50000000 tuples (54%) done (elapsed 72.36 s, remaining 60.65 s) 2023-05-08T03:43:39.046 INFO:teuthology.orchestra.run.smithi096.stderr:27300000 of 50000000 tuples (54%) done (elapsed 72.48 s, remaining 60.26 s) 2023-05-08T03:43:39.140 INFO:teuthology.orchestra.run.smithi096.stderr:27400000 of 50000000 tuples (54%) done (elapsed 72.57 s, remaining 59.86 s) 2023-05-08T03:43:39.265 INFO:teuthology.orchestra.run.smithi096.stderr:27500000 of 50000000 tuples (55%) done (elapsed 72.69 s, remaining 59.48 s) 2023-05-08T03:43:39.381 INFO:teuthology.orchestra.run.smithi096.stderr:27600000 of 50000000 tuples (55%) done (elapsed 72.81 s, remaining 59.09 s) 2023-05-08T03:43:39.490 INFO:teuthology.orchestra.run.smithi096.stderr:27700000 of 50000000 tuples (55%) done (elapsed 72.92 s, remaining 58.70 s) 2023-05-08T03:43:39.614 INFO:teuthology.orchestra.run.smithi096.stderr:27800000 of 50000000 tuples (55%) done (elapsed 73.04 s, remaining 58.33 s) 2023-05-08T03:43:39.721 INFO:teuthology.orchestra.run.smithi096.stderr:27900000 of 50000000 tuples (55%) done (elapsed 73.15 s, remaining 57.94 s) 2023-05-08T03:43:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:43:39 smithi133 ceph-mon[125939]: pgmap v53: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 65 MiB/s wr, 386 op/s 2023-05-08T03:43:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:43:39 smithi096 ceph-mon[124666]: pgmap v53: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 65 MiB/s wr, 386 op/s 2023-05-08T03:43:39.806 INFO:teuthology.orchestra.run.smithi096.stderr:28000000 of 50000000 tuples (56%) done (elapsed 73.23 s, remaining 57.54 s) 2023-05-08T03:43:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:43:39 smithi186 ceph-mon[126480]: pgmap v53: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 65 MiB/s wr, 386 op/s 2023-05-08T03:43:39.925 INFO:teuthology.orchestra.run.smithi096.stderr:28100000 of 50000000 tuples (56%) done (elapsed 73.35 s, remaining 57.17 s) 2023-05-08T03:43:40.033 INFO:teuthology.orchestra.run.smithi096.stderr:28200000 of 50000000 tuples (56%) done (elapsed 73.46 s, remaining 56.79 s) 2023-05-08T03:43:40.116 INFO:teuthology.orchestra.run.smithi096.stderr:28300000 of 50000000 tuples (56%) done (elapsed 73.54 s, remaining 56.39 s) 2023-05-08T03:43:40.215 INFO:teuthology.orchestra.run.smithi096.stderr:28400000 of 50000000 tuples (56%) done (elapsed 73.64 s, remaining 56.01 s) 2023-05-08T03:43:40.310 INFO:teuthology.orchestra.run.smithi096.stderr:28500000 of 50000000 tuples (57%) done (elapsed 73.74 s, remaining 55.63 s) 2023-05-08T03:43:40.423 INFO:teuthology.orchestra.run.smithi096.stderr:28600000 of 50000000 tuples (57%) done (elapsed 73.85 s, remaining 55.26 s) 2023-05-08T03:43:40.543 INFO:teuthology.orchestra.run.smithi096.stderr:28700000 of 50000000 tuples (57%) done (elapsed 73.97 s, remaining 54.90 s) 2023-05-08T03:43:40.842 INFO:teuthology.orchestra.run.smithi096.stderr:28800000 of 50000000 tuples (57%) done (elapsed 74.27 s, remaining 54.67 s) 2023-05-08T03:43:41.294 INFO:teuthology.orchestra.run.smithi096.stderr:28900000 of 50000000 tuples (57%) done (elapsed 74.72 s, remaining 54.56 s) 2023-05-08T03:43:41.410 INFO:teuthology.orchestra.run.smithi096.stderr:29000000 of 50000000 tuples (58%) done (elapsed 74.84 s, remaining 54.19 s) 2023-05-08T03:43:41.514 INFO:teuthology.orchestra.run.smithi096.stderr:29100000 of 50000000 tuples (58%) done (elapsed 74.94 s, remaining 53.82 s) 2023-05-08T03:43:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:43:41 smithi133 ceph-mon[125939]: pgmap v54: 97 pgs: 97 active+clean; 5.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 76 MiB/s wr, 560 op/s 2023-05-08T03:43:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:43:41 smithi096 ceph-mon[124666]: pgmap v54: 97 pgs: 97 active+clean; 5.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 76 MiB/s wr, 560 op/s 2023-05-08T03:43:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:43:41 smithi186 ceph-mon[126480]: pgmap v54: 97 pgs: 97 active+clean; 5.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 76 MiB/s wr, 560 op/s 2023-05-08T03:43:43.559 INFO:teuthology.orchestra.run.smithi096.stderr:29200000 of 50000000 tuples (58%) done (elapsed 76.99 s, remaining 54.84 s) 2023-05-08T03:43:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:43:43 smithi133 ceph-mon[125939]: pgmap v55: 97 pgs: 97 active+clean; 5.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 23 MiB/s wr, 436 op/s 2023-05-08T03:43:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:43:43 smithi096 ceph-mon[124666]: pgmap v55: 97 pgs: 97 active+clean; 5.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 23 MiB/s wr, 436 op/s 2023-05-08T03:43:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:43:43 smithi186 ceph-mon[126480]: pgmap v55: 97 pgs: 97 active+clean; 5.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 23 MiB/s wr, 436 op/s 2023-05-08T03:43:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:43:45 smithi133 ceph-mon[125939]: pgmap v56: 97 pgs: 97 active+clean; 5.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 27 MiB/s wr, 510 op/s 2023-05-08T03:43:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:43:45 smithi096 ceph-mon[124666]: pgmap v56: 97 pgs: 97 active+clean; 5.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 27 MiB/s wr, 510 op/s 2023-05-08T03:43:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:43:45 smithi186 ceph-mon[126480]: pgmap v56: 97 pgs: 97 active+clean; 5.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 27 MiB/s wr, 510 op/s 2023-05-08T03:43:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:43:47 smithi133 ceph-mon[125939]: pgmap v57: 97 pgs: 97 active+clean; 5.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 32 MiB/s wr, 392 op/s 2023-05-08T03:43:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:43:47 smithi096 ceph-mon[124666]: pgmap v57: 97 pgs: 97 active+clean; 5.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 32 MiB/s wr, 392 op/s 2023-05-08T03:43:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:43:47 smithi186 ceph-mon[126480]: pgmap v57: 97 pgs: 97 active+clean; 5.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 32 MiB/s wr, 392 op/s 2023-05-08T03:43:48.336 INFO:teuthology.orchestra.run.smithi096.stderr:29300000 of 50000000 tuples (58%) done (elapsed 81.76 s, remaining 57.77 s) 2023-05-08T03:43:48.606 INFO:teuthology.orchestra.run.smithi096.stderr:29400000 of 50000000 tuples (58%) done (elapsed 82.03 s, remaining 57.48 s) 2023-05-08T03:43:48.675 INFO:teuthology.orchestra.run.smithi096.stderr:29500000 of 50000000 tuples (59%) done (elapsed 82.10 s, remaining 57.06 s) 2023-05-08T03:43:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:43:48 smithi186 ceph-mon[126480]: pgmap v58: 97 pgs: 97 active+clean; 5.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 31 MiB/s wr, 348 op/s 2023-05-08T03:43:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:43:48 smithi133 ceph-mon[125939]: pgmap v58: 97 pgs: 97 active+clean; 5.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 31 MiB/s wr, 348 op/s 2023-05-08T03:43:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:43:48 smithi096 ceph-mon[124666]: pgmap v58: 97 pgs: 97 active+clean; 5.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 31 MiB/s wr, 348 op/s 2023-05-08T03:43:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:43:50 smithi186 ceph-mon[126480]: mgrmap e24: x(active, since 91s), standbys: z, y 2023-05-08T03:43:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:43:50 smithi186 ceph-mon[126480]: pgmap v59: 97 pgs: 97 active+clean; 5.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 73 MiB/s wr, 573 op/s 2023-05-08T03:43:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:43:50 smithi133 ceph-mon[125939]: mgrmap e24: x(active, since 91s), standbys: z, y 2023-05-08T03:43:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:43:50 smithi133 ceph-mon[125939]: pgmap v59: 97 pgs: 97 active+clean; 5.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 73 MiB/s wr, 573 op/s 2023-05-08T03:43:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:43:50 smithi096 ceph-mon[124666]: mgrmap e24: x(active, since 91s), standbys: z, y 2023-05-08T03:43:51.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:43:50 smithi096 ceph-mon[124666]: pgmap v59: 97 pgs: 97 active+clean; 5.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 73 MiB/s wr, 573 op/s 2023-05-08T03:43:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:43:53 smithi133 ceph-mon[125939]: pgmap v60: 97 pgs: 97 active+clean; 5.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 65 MiB/s wr, 401 op/s 2023-05-08T03:43:53.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:43:53 smithi096 ceph-mon[124666]: pgmap v60: 97 pgs: 97 active+clean; 5.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 65 MiB/s wr, 401 op/s 2023-05-08T03:43:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:43:53 smithi186 ceph-mon[126480]: pgmap v60: 97 pgs: 97 active+clean; 5.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 65 MiB/s wr, 401 op/s 2023-05-08T03:43:54.581 INFO:teuthology.orchestra.run.smithi096.stderr:29600000 of 50000000 tuples (59%) done (elapsed 88.01 s, remaining 60.66 s) 2023-05-08T03:43:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:43:55 smithi133 ceph-mon[125939]: pgmap v61: 97 pgs: 97 active+clean; 5.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 63 MiB/s wr, 646 op/s 2023-05-08T03:43:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:43:55 smithi096 ceph-mon[124666]: pgmap v61: 97 pgs: 97 active+clean; 5.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 63 MiB/s wr, 646 op/s 2023-05-08T03:43:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:43:55 smithi186 ceph-mon[126480]: pgmap v61: 97 pgs: 97 active+clean; 5.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 63 MiB/s wr, 646 op/s 2023-05-08T03:43:55.993 INFO:teuthology.orchestra.run.smithi096.stderr:29700000 of 50000000 tuples (59%) done (elapsed 89.42 s, remaining 61.12 s) 2023-05-08T03:43:56.104 INFO:teuthology.orchestra.run.smithi096.stderr:29800000 of 50000000 tuples (59%) done (elapsed 89.53 s, remaining 60.69 s) 2023-05-08T03:43:56.389 INFO:teuthology.orchestra.run.smithi096.stderr:29900000 of 50000000 tuples (59%) done (elapsed 89.82 s, remaining 60.38 s) 2023-05-08T03:43:56.850 INFO:teuthology.orchestra.run.smithi096.stderr:30000000 of 50000000 tuples (60%) done (elapsed 90.28 s, remaining 60.19 s) 2023-05-08T03:43:56.956 INFO:teuthology.orchestra.run.smithi096.stderr:30100000 of 50000000 tuples (60%) done (elapsed 90.39 s, remaining 59.76 s) 2023-05-08T03:43:57.066 INFO:teuthology.orchestra.run.smithi096.stderr:30200000 of 50000000 tuples (60%) done (elapsed 90.50 s, remaining 59.33 s) 2023-05-08T03:43:57.178 INFO:teuthology.orchestra.run.smithi096.stderr:30300000 of 50000000 tuples (60%) done (elapsed 90.61 s, remaining 58.91 s) 2023-05-08T03:43:57.284 INFO:teuthology.orchestra.run.smithi096.stderr:30400000 of 50000000 tuples (60%) done (elapsed 90.71 s, remaining 58.49 s) 2023-05-08T03:43:57.375 INFO:teuthology.orchestra.run.smithi096.stderr:30500000 of 50000000 tuples (61%) done (elapsed 90.80 s, remaining 58.05 s) 2023-05-08T03:43:57.498 INFO:teuthology.orchestra.run.smithi096.stderr:30600000 of 50000000 tuples (61%) done (elapsed 90.93 s, remaining 57.65 s) 2023-05-08T03:43:57.605 INFO:teuthology.orchestra.run.smithi096.stderr:30700000 of 50000000 tuples (61%) done (elapsed 91.03 s, remaining 57.23 s) 2023-05-08T03:43:57.712 INFO:teuthology.orchestra.run.smithi096.stderr:30800000 of 50000000 tuples (61%) done (elapsed 91.14 s, remaining 56.81 s) 2023-05-08T03:43:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:43:57 smithi133 ceph-mon[125939]: pgmap v62: 97 pgs: 97 active+clean; 5.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 53 MiB/s wr, 570 op/s 2023-05-08T03:43:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:43:57 smithi096 ceph-mon[124666]: pgmap v62: 97 pgs: 97 active+clean; 5.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 53 MiB/s wr, 570 op/s 2023-05-08T03:43:57.827 INFO:teuthology.orchestra.run.smithi096.stderr:30900000 of 50000000 tuples (61%) done (elapsed 91.26 s, remaining 56.41 s) 2023-05-08T03:43:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:43:57 smithi186 ceph-mon[126480]: pgmap v62: 97 pgs: 97 active+clean; 5.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 53 MiB/s wr, 570 op/s 2023-05-08T03:43:57.918 INFO:teuthology.orchestra.run.smithi096.stderr:31000000 of 50000000 tuples (62%) done (elapsed 91.35 s, remaining 55.99 s) 2023-05-08T03:43:58.028 INFO:teuthology.orchestra.run.smithi096.stderr:31100000 of 50000000 tuples (62%) done (elapsed 91.46 s, remaining 55.58 s) 2023-05-08T03:43:58.131 INFO:teuthology.orchestra.run.smithi096.stderr:31200000 of 50000000 tuples (62%) done (elapsed 91.56 s, remaining 55.17 s) 2023-05-08T03:43:58.210 INFO:teuthology.orchestra.run.smithi096.stderr:31300000 of 50000000 tuples (62%) done (elapsed 91.64 s, remaining 54.75 s) 2023-05-08T03:43:58.373 INFO:teuthology.orchestra.run.smithi096.stderr:31400000 of 50000000 tuples (62%) done (elapsed 91.80 s, remaining 54.38 s) 2023-05-08T03:43:58.439 INFO:teuthology.orchestra.run.smithi096.stderr:31500000 of 50000000 tuples (63%) done (elapsed 91.87 s, remaining 53.95 s) 2023-05-08T03:43:58.547 INFO:teuthology.orchestra.run.smithi096.stderr:31600000 of 50000000 tuples (63%) done (elapsed 91.98 s, remaining 53.56 s) 2023-05-08T03:43:58.676 INFO:teuthology.orchestra.run.smithi096.stderr:31700000 of 50000000 tuples (63%) done (elapsed 92.10 s, remaining 53.17 s) 2023-05-08T03:43:58.779 INFO:teuthology.orchestra.run.smithi096.stderr:31800000 of 50000000 tuples (63%) done (elapsed 92.21 s, remaining 52.77 s) 2023-05-08T03:43:58.865 INFO:teuthology.orchestra.run.smithi096.stderr:31900000 of 50000000 tuples (63%) done (elapsed 92.29 s, remaining 52.37 s) 2023-05-08T03:43:58.971 INFO:teuthology.orchestra.run.smithi096.stderr:32000000 of 50000000 tuples (64%) done (elapsed 92.40 s, remaining 51.97 s) 2023-05-08T03:43:59.072 INFO:teuthology.orchestra.run.smithi096.stderr:32100000 of 50000000 tuples (64%) done (elapsed 92.50 s, remaining 51.58 s) 2023-05-08T03:43:59.182 INFO:teuthology.orchestra.run.smithi096.stderr:32200000 of 50000000 tuples (64%) done (elapsed 92.61 s, remaining 51.20 s) 2023-05-08T03:43:59.290 INFO:teuthology.orchestra.run.smithi096.stderr:32300000 of 50000000 tuples (64%) done (elapsed 92.72 s, remaining 50.81 s) 2023-05-08T03:43:59.368 INFO:teuthology.orchestra.run.smithi096.stderr:32400000 of 50000000 tuples (64%) done (elapsed 92.80 s, remaining 50.41 s) 2023-05-08T03:43:59.516 INFO:teuthology.orchestra.run.smithi096.stderr:32500000 of 50000000 tuples (65%) done (elapsed 92.94 s, remaining 50.05 s) 2023-05-08T03:43:59.637 INFO:teuthology.orchestra.run.smithi096.stderr:32600000 of 50000000 tuples (65%) done (elapsed 93.06 s, remaining 49.67 s) 2023-05-08T03:43:59.700 INFO:teuthology.orchestra.run.smithi096.stderr:32700000 of 50000000 tuples (65%) done (elapsed 93.13 s, remaining 49.27 s) 2023-05-08T03:43:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:43:59 smithi133 ceph-mon[125939]: pgmap v63: 97 pgs: 97 active+clean; 5.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 48 MiB/s wr, 481 op/s 2023-05-08T03:43:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:43:59 smithi096 ceph-mon[124666]: pgmap v63: 97 pgs: 97 active+clean; 5.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 48 MiB/s wr, 481 op/s 2023-05-08T03:43:59.827 INFO:teuthology.orchestra.run.smithi096.stderr:32800000 of 50000000 tuples (65%) done (elapsed 93.26 s, remaining 48.90 s) 2023-05-08T03:43:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:43:59 smithi186 ceph-mon[126480]: pgmap v63: 97 pgs: 97 active+clean; 5.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 48 MiB/s wr, 481 op/s 2023-05-08T03:43:59.938 INFO:teuthology.orchestra.run.smithi096.stderr:32900000 of 50000000 tuples (65%) done (elapsed 93.37 s, remaining 48.53 s) 2023-05-08T03:44:00.017 INFO:teuthology.orchestra.run.smithi096.stderr:33000000 of 50000000 tuples (66%) done (elapsed 93.45 s, remaining 48.14 s) 2023-05-08T03:44:00.172 INFO:teuthology.orchestra.run.smithi096.stderr:33100000 of 50000000 tuples (66%) done (elapsed 93.60 s, remaining 47.79 s) 2023-05-08T03:44:00.235 INFO:teuthology.orchestra.run.smithi096.stderr:33200000 of 50000000 tuples (66%) done (elapsed 93.66 s, remaining 47.40 s) 2023-05-08T03:44:00.350 INFO:teuthology.orchestra.run.smithi096.stderr:33300000 of 50000000 tuples (66%) done (elapsed 93.78 s, remaining 47.03 s) 2023-05-08T03:44:00.551 INFO:teuthology.orchestra.run.smithi096.stderr:33400000 of 50000000 tuples (66%) done (elapsed 93.98 s, remaining 46.71 s) 2023-05-08T03:44:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:44:00 smithi186 ceph-mon[126480]: pgmap v64: 97 pgs: 97 active+clean; 5.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 67 MiB/s wr, 619 op/s 2023-05-08T03:44:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:44:00 smithi133 ceph-mon[125939]: pgmap v64: 97 pgs: 97 active+clean; 5.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 67 MiB/s wr, 619 op/s 2023-05-08T03:44:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:44:00 smithi096 ceph-mon[124666]: pgmap v64: 97 pgs: 97 active+clean; 5.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 67 MiB/s wr, 619 op/s 2023-05-08T03:44:01.250 INFO:teuthology.orchestra.run.smithi096.stderr:33500000 of 50000000 tuples (67%) done (elapsed 94.68 s, remaining 46.63 s) 2023-05-08T03:44:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:44:03 smithi133 ceph-mon[125939]: pgmap v65: 97 pgs: 97 active+clean; 5.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 29 MiB/s wr, 395 op/s 2023-05-08T03:44:03.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:44:03 smithi096 ceph-mon[124666]: pgmap v65: 97 pgs: 97 active+clean; 5.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 29 MiB/s wr, 395 op/s 2023-05-08T03:44:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:44:03 smithi186 ceph-mon[126480]: pgmap v65: 97 pgs: 97 active+clean; 5.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 29 MiB/s wr, 395 op/s 2023-05-08T03:44:04.384 INFO:teuthology.orchestra.run.smithi096.stderr:33600000 of 50000000 tuples (67%) done (elapsed 97.81 s, remaining 47.74 s) 2023-05-08T03:44:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:44:05 smithi133 ceph-mon[125939]: pgmap v66: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 76 MiB/s wr, 506 op/s 2023-05-08T03:44:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:44:05 smithi096 ceph-mon[124666]: pgmap v66: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 76 MiB/s wr, 506 op/s 2023-05-08T03:44:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:44:05 smithi186 ceph-mon[126480]: pgmap v66: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 76 MiB/s wr, 506 op/s 2023-05-08T03:44:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:44:07 smithi133 ceph-mon[125939]: pgmap v67: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 81 MiB/s wr, 338 op/s 2023-05-08T03:44:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:44:07 smithi096 ceph-mon[124666]: pgmap v67: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 81 MiB/s wr, 338 op/s 2023-05-08T03:44:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:44:07 smithi186 ceph-mon[126480]: pgmap v67: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 81 MiB/s wr, 338 op/s 2023-05-08T03:44:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:44:09 smithi133 ceph-mon[125939]: pgmap v68: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 81 MiB/s wr, 338 op/s 2023-05-08T03:44:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:44:09 smithi096 ceph-mon[124666]: pgmap v68: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 81 MiB/s wr, 338 op/s 2023-05-08T03:44:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:44:09 smithi186 ceph-mon[126480]: pgmap v68: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 81 MiB/s wr, 338 op/s 2023-05-08T03:44:09.903 INFO:teuthology.orchestra.run.smithi096.stderr:33700000 of 50000000 tuples (67%) done (elapsed 103.33 s, remaining 49.98 s) 2023-05-08T03:44:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:44:11 smithi133 ceph-mon[125939]: pgmap v69: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 83 MiB/s wr, 607 op/s 2023-05-08T03:44:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:44:11 smithi096 ceph-mon[124666]: pgmap v69: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 83 MiB/s wr, 607 op/s 2023-05-08T03:44:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:44:11 smithi186 ceph-mon[126480]: pgmap v69: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 83 MiB/s wr, 607 op/s 2023-05-08T03:44:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:44:13 smithi133 ceph-mon[125939]: pgmap v70: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 63 MiB/s wr, 469 op/s 2023-05-08T03:44:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:44:13 smithi096 ceph-mon[124666]: pgmap v70: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 63 MiB/s wr, 469 op/s 2023-05-08T03:44:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:44:13 smithi186 ceph-mon[126480]: pgmap v70: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 63 MiB/s wr, 469 op/s 2023-05-08T03:44:14.601 INFO:teuthology.orchestra.run.smithi096.stderr:33800000 of 50000000 tuples (67%) done (elapsed 108.03 s, remaining 51.78 s) 2023-05-08T03:44:14.927 INFO:teuthology.orchestra.run.smithi096.stderr:33900000 of 50000000 tuples (67%) done (elapsed 108.36 s, remaining 51.46 s) 2023-05-08T03:44:15.045 INFO:teuthology.orchestra.run.smithi096.stderr:34000000 of 50000000 tuples (68%) done (elapsed 108.47 s, remaining 51.05 s) 2023-05-08T03:44:15.158 INFO:teuthology.orchestra.run.smithi096.stderr:34100000 of 50000000 tuples (68%) done (elapsed 108.59 s, remaining 50.63 s) 2023-05-08T03:44:15.269 INFO:teuthology.orchestra.run.smithi096.stderr:34200000 of 50000000 tuples (68%) done (elapsed 108.70 s, remaining 50.22 s) 2023-05-08T03:44:15.363 INFO:teuthology.orchestra.run.smithi096.stderr:34300000 of 50000000 tuples (68%) done (elapsed 108.79 s, remaining 49.80 s) 2023-05-08T03:44:15.468 INFO:teuthology.orchestra.run.smithi096.stderr:34400000 of 50000000 tuples (68%) done (elapsed 108.90 s, remaining 49.38 s) 2023-05-08T03:44:15.579 INFO:teuthology.orchestra.run.smithi096.stderr:34500000 of 50000000 tuples (69%) done (elapsed 109.01 s, remaining 48.97 s) 2023-05-08T03:44:15.695 INFO:teuthology.orchestra.run.smithi096.stderr:34600000 of 50000000 tuples (69%) done (elapsed 109.12 s, remaining 48.57 s) 2023-05-08T03:44:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:44:15 smithi133 ceph-mon[125939]: pgmap v71: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 61 MiB/s wr, 749 op/s 2023-05-08T03:44:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:44:15 smithi096 ceph-mon[124666]: pgmap v71: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 61 MiB/s wr, 749 op/s 2023-05-08T03:44:15.803 INFO:teuthology.orchestra.run.smithi096.stderr:34700000 of 50000000 tuples (69%) done (elapsed 109.23 s, remaining 48.16 s) 2023-05-08T03:44:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:44:15 smithi186 ceph-mon[126480]: pgmap v71: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 61 MiB/s wr, 749 op/s 2023-05-08T03:44:15.921 INFO:teuthology.orchestra.run.smithi096.stderr:34800000 of 50000000 tuples (69%) done (elapsed 109.35 s, remaining 47.76 s) 2023-05-08T03:44:16.028 INFO:teuthology.orchestra.run.smithi096.stderr:34900000 of 50000000 tuples (69%) done (elapsed 109.46 s, remaining 47.36 s) 2023-05-08T03:44:16.114 INFO:teuthology.orchestra.run.smithi096.stderr:35000000 of 50000000 tuples (70%) done (elapsed 109.54 s, remaining 46.95 s) 2023-05-08T03:44:16.224 INFO:teuthology.orchestra.run.smithi096.stderr:35100000 of 50000000 tuples (70%) done (elapsed 109.65 s, remaining 46.55 s) 2023-05-08T03:44:16.699 INFO:teuthology.orchestra.run.smithi096.stderr:35200000 of 50000000 tuples (70%) done (elapsed 110.13 s, remaining 46.30 s) 2023-05-08T03:44:17.152 INFO:teuthology.orchestra.run.smithi096.stderr:35300000 of 50000000 tuples (70%) done (elapsed 110.58 s, remaining 46.05 s) 2023-05-08T03:44:17.256 INFO:teuthology.orchestra.run.smithi096.stderr:35400000 of 50000000 tuples (70%) done (elapsed 110.69 s, remaining 45.65 s) 2023-05-08T03:44:17.371 INFO:teuthology.orchestra.run.smithi096.stderr:35500000 of 50000000 tuples (71%) done (elapsed 110.80 s, remaining 45.26 s) 2023-05-08T03:44:17.485 INFO:teuthology.orchestra.run.smithi096.stderr:35600000 of 50000000 tuples (71%) done (elapsed 110.91 s, remaining 44.86 s) 2023-05-08T03:44:17.590 INFO:teuthology.orchestra.run.smithi096.stderr:35700000 of 50000000 tuples (71%) done (elapsed 111.02 s, remaining 44.47 s) 2023-05-08T03:44:17.688 INFO:teuthology.orchestra.run.smithi096.stderr:35800000 of 50000000 tuples (71%) done (elapsed 111.12 s, remaining 44.07 s) 2023-05-08T03:44:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:44:17 smithi133 ceph-mon[125939]: pgmap v72: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 10 MiB/s wr, 637 op/s 2023-05-08T03:44:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:44:17 smithi096 ceph-mon[124666]: pgmap v72: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 10 MiB/s wr, 637 op/s 2023-05-08T03:44:17.813 INFO:teuthology.orchestra.run.smithi096.stderr:35900000 of 50000000 tuples (71%) done (elapsed 111.24 s, remaining 43.69 s) 2023-05-08T03:44:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:44:17 smithi186 ceph-mon[126480]: pgmap v72: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 10 MiB/s wr, 637 op/s 2023-05-08T03:44:17.927 INFO:teuthology.orchestra.run.smithi096.stderr:36000000 of 50000000 tuples (72%) done (elapsed 111.36 s, remaining 43.31 s) 2023-05-08T03:44:18.036 INFO:teuthology.orchestra.run.smithi096.stderr:36100000 of 50000000 tuples (72%) done (elapsed 111.46 s, remaining 42.92 s) 2023-05-08T03:44:18.128 INFO:teuthology.orchestra.run.smithi096.stderr:36200000 of 50000000 tuples (72%) done (elapsed 111.56 s, remaining 42.53 s) 2023-05-08T03:44:18.219 INFO:teuthology.orchestra.run.smithi096.stderr:36300000 of 50000000 tuples (72%) done (elapsed 111.65 s, remaining 42.14 s) 2023-05-08T03:44:18.345 INFO:teuthology.orchestra.run.smithi096.stderr:36400000 of 50000000 tuples (72%) done (elapsed 111.77 s, remaining 41.76 s) 2023-05-08T03:44:18.447 INFO:teuthology.orchestra.run.smithi096.stderr:36500000 of 50000000 tuples (73%) done (elapsed 111.88 s, remaining 41.38 s) 2023-05-08T03:44:18.559 INFO:teuthology.orchestra.run.smithi096.stderr:36600000 of 50000000 tuples (73%) done (elapsed 111.99 s, remaining 41.00 s) 2023-05-08T03:44:18.664 INFO:teuthology.orchestra.run.smithi096.stderr:36700000 of 50000000 tuples (73%) done (elapsed 112.09 s, remaining 40.62 s) 2023-05-08T03:44:18.765 INFO:teuthology.orchestra.run.smithi096.stderr:36800000 of 50000000 tuples (73%) done (elapsed 112.19 s, remaining 40.24 s) 2023-05-08T03:44:18.842 INFO:teuthology.orchestra.run.smithi096.stderr:36900000 of 50000000 tuples (73%) done (elapsed 112.27 s, remaining 39.86 s) 2023-05-08T03:44:18.942 INFO:teuthology.orchestra.run.smithi096.stderr:37000000 of 50000000 tuples (74%) done (elapsed 112.37 s, remaining 39.48 s) 2023-05-08T03:44:19.060 INFO:teuthology.orchestra.run.smithi096.stderr:37100000 of 50000000 tuples (74%) done (elapsed 112.49 s, remaining 39.11 s) 2023-05-08T03:44:19.209 INFO:teuthology.orchestra.run.smithi096.stderr:37200000 of 50000000 tuples (74%) done (elapsed 112.64 s, remaining 38.76 s) 2023-05-08T03:44:19.413 INFO:teuthology.orchestra.run.smithi096.stderr:37300000 of 50000000 tuples (74%) done (elapsed 112.84 s, remaining 38.42 s) 2023-05-08T03:44:19.535 INFO:teuthology.orchestra.run.smithi096.stderr:37400000 of 50000000 tuples (74%) done (elapsed 112.96 s, remaining 38.06 s) 2023-05-08T03:44:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:44:19 smithi133 ceph-mon[125939]: pgmap v73: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.8 MiB/s wr, 550 op/s 2023-05-08T03:44:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:44:19 smithi096 ceph-mon[124666]: pgmap v73: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.8 MiB/s wr, 550 op/s 2023-05-08T03:44:19.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:44:19 smithi186 ceph-mon[126480]: pgmap v73: 97 pgs: 97 active+clean; 6.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.8 MiB/s wr, 550 op/s 2023-05-08T03:44:20.278 INFO:teuthology.orchestra.run.smithi096.stderr:37500000 of 50000000 tuples (75%) done (elapsed 113.71 s, remaining 37.90 s) 2023-05-08T03:44:20.385 INFO:teuthology.orchestra.run.smithi096.stderr:37600000 of 50000000 tuples (75%) done (elapsed 113.81 s, remaining 37.53 s) 2023-05-08T03:44:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:44:21 smithi133 ceph-mon[125939]: pgmap v74: 97 pgs: 97 active+clean; 6.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 29 MiB/s wr, 640 op/s 2023-05-08T03:44:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:44:21 smithi096 ceph-mon[124666]: pgmap v74: 97 pgs: 97 active+clean; 6.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 29 MiB/s wr, 640 op/s 2023-05-08T03:44:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:44:21 smithi186 ceph-mon[126480]: pgmap v74: 97 pgs: 97 active+clean; 6.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 29 MiB/s wr, 640 op/s 2023-05-08T03:44:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:44:23 smithi133 ceph-mon[125939]: pgmap v75: 97 pgs: 97 active+clean; 6.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 37 MiB/s wr, 374 op/s 2023-05-08T03:44:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:44:23 smithi096 ceph-mon[124666]: pgmap v75: 97 pgs: 97 active+clean; 6.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 37 MiB/s wr, 374 op/s 2023-05-08T03:44:23.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:44:23 smithi186 ceph-mon[126480]: pgmap v75: 97 pgs: 97 active+clean; 6.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 37 MiB/s wr, 374 op/s 2023-05-08T03:44:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:44:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:44:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:44:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:44:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:44:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:44:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:44:25 smithi133 ceph-mon[125939]: pgmap v76: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 81 MiB/s wr, 394 op/s 2023-05-08T03:44:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:44:25 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:44:25.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:44:25 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:44:25.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:44:25 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:44:25.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:44:25 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:44:25.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:44:25 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T03:44:25.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:44:25 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T03:44:25.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:44:25 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:44:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:44:25 smithi096 ceph-mon[124666]: pgmap v76: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 81 MiB/s wr, 394 op/s 2023-05-08T03:44:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:44:25 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:44:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:44:25 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:44:25.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:44:25 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:44:25.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:44:25 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:44:25.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:44:25 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T03:44:25.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:44:25 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T03:44:25.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:44:25 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:44:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:44:25 smithi186 ceph-mon[126480]: pgmap v76: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 81 MiB/s wr, 394 op/s 2023-05-08T03:44:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:44:25 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:44:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:44:25 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:44:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:44:25 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:44:25.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:44:25 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:44:25.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:44:25 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T03:44:25.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:44:25 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T03:44:25.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:44:25 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:44:26.744 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:44:26 smithi133 ceph-mon[125939]: pgmap v77: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 79 MiB/s wr, 113 op/s 2023-05-08T03:44:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:44:26 smithi096 ceph-mon[124666]: pgmap v77: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 79 MiB/s wr, 113 op/s 2023-05-08T03:44:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:44:26 smithi186 ceph-mon[126480]: pgmap v77: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 79 MiB/s wr, 113 op/s 2023-05-08T03:44:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:44:29 smithi133 ceph-mon[125939]: pgmap v78: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 79 MiB/s wr, 113 op/s 2023-05-08T03:44:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:44:29 smithi096 ceph-mon[124666]: pgmap v78: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 79 MiB/s wr, 113 op/s 2023-05-08T03:44:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:44:29 smithi186 ceph-mon[126480]: pgmap v78: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 79 MiB/s wr, 113 op/s 2023-05-08T03:44:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:44:31 smithi133 ceph-mon[125939]: pgmap v79: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 79 MiB/s wr, 118 op/s 2023-05-08T03:44:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:44:31 smithi096 ceph-mon[124666]: pgmap v79: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 79 MiB/s wr, 118 op/s 2023-05-08T03:44:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:44:31 smithi186 ceph-mon[126480]: pgmap v79: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 79 MiB/s wr, 118 op/s 2023-05-08T03:44:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:44:33 smithi133 ceph-mon[125939]: pgmap v80: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 53 MiB/s wr, 27 op/s 2023-05-08T03:44:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:44:33 smithi096 ceph-mon[124666]: pgmap v80: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 53 MiB/s wr, 27 op/s 2023-05-08T03:44:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:44:33 smithi186 ceph-mon[126480]: pgmap v80: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 53 MiB/s wr, 27 op/s 2023-05-08T03:44:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:44:35 smithi133 ceph-mon[125939]: pgmap v81: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 47 MiB/s wr, 30 op/s 2023-05-08T03:44:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:44:35 smithi096 ceph-mon[124666]: pgmap v81: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 47 MiB/s wr, 30 op/s 2023-05-08T03:44:35.878 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:44:35 smithi186 ceph-mon[126480]: pgmap v81: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 47 MiB/s wr, 30 op/s 2023-05-08T03:44:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:44:37 smithi133 ceph-mon[125939]: pgmap v82: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 3.6 MiB/s wr, 9 op/s 2023-05-08T03:44:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:44:37 smithi096 ceph-mon[124666]: pgmap v82: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 3.6 MiB/s wr, 9 op/s 2023-05-08T03:44:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:44:37 smithi186 ceph-mon[126480]: pgmap v82: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 3.6 MiB/s wr, 9 op/s 2023-05-08T03:44:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:44:39 smithi133 ceph-mon[125939]: pgmap v83: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 3.6 MiB/s wr, 9 op/s 2023-05-08T03:44:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:44:39 smithi096 ceph-mon[124666]: pgmap v83: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 3.6 MiB/s wr, 9 op/s 2023-05-08T03:44:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:44:39 smithi186 ceph-mon[126480]: pgmap v83: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 3.6 MiB/s wr, 9 op/s 2023-05-08T03:44:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:44:40 smithi133 ceph-mon[125939]: pgmap v84: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2023-05-08T03:44:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:44:40 smithi096 ceph-mon[124666]: pgmap v84: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2023-05-08T03:44:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:44:40 smithi186 ceph-mon[126480]: pgmap v84: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 3.7 MiB/s wr, 13 op/s 2023-05-08T03:44:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:44:43 smithi133 ceph-mon[125939]: pgmap v85: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 3.6 MiB/s wr, 9 op/s 2023-05-08T03:44:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:44:43 smithi096 ceph-mon[124666]: pgmap v85: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 3.6 MiB/s wr, 9 op/s 2023-05-08T03:44:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:44:43 smithi186 ceph-mon[126480]: pgmap v85: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 3.6 MiB/s wr, 9 op/s 2023-05-08T03:44:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:44:45 smithi133 ceph-mon[125939]: pgmap v86: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.6 MiB/s wr, 12 op/s 2023-05-08T03:44:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:44:45 smithi096 ceph-mon[124666]: pgmap v86: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.6 MiB/s wr, 12 op/s 2023-05-08T03:44:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:44:45 smithi186 ceph-mon[126480]: pgmap v86: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.6 MiB/s wr, 12 op/s 2023-05-08T03:44:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:44:47 smithi133 ceph-mon[125939]: pgmap v87: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 350 KiB/s wr, 7 op/s 2023-05-08T03:44:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:44:47 smithi096 ceph-mon[124666]: pgmap v87: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 350 KiB/s wr, 7 op/s 2023-05-08T03:44:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:44:47 smithi186 ceph-mon[126480]: pgmap v87: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 350 KiB/s wr, 7 op/s 2023-05-08T03:44:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:44:49 smithi133 ceph-mon[125939]: pgmap v88: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.3 KiB/s wr, 7 op/s 2023-05-08T03:44:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:44:49 smithi096 ceph-mon[124666]: pgmap v88: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.3 KiB/s wr, 7 op/s 2023-05-08T03:44:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:44:49 smithi186 ceph-mon[126480]: pgmap v88: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.3 KiB/s wr, 7 op/s 2023-05-08T03:44:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:44:51 smithi133 ceph-mon[125939]: pgmap v89: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 KiB/s wr, 11 op/s 2023-05-08T03:44:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:44:51 smithi096 ceph-mon[124666]: pgmap v89: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 KiB/s wr, 11 op/s 2023-05-08T03:44:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:44:51 smithi186 ceph-mon[126480]: pgmap v89: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 KiB/s wr, 11 op/s 2023-05-08T03:44:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:44:53 smithi133 ceph-mon[125939]: pgmap v90: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 7.1 KiB/s wr, 7 op/s 2023-05-08T03:44:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:44:53 smithi096 ceph-mon[124666]: pgmap v90: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 7.1 KiB/s wr, 7 op/s 2023-05-08T03:44:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:44:53 smithi186 ceph-mon[126480]: pgmap v90: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 7.1 KiB/s wr, 7 op/s 2023-05-08T03:44:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:44:54 smithi186 ceph-mon[126480]: pgmap v91: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.9 KiB/s wr, 10 op/s 2023-05-08T03:44:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:44:54 smithi133 ceph-mon[125939]: pgmap v91: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.9 KiB/s wr, 10 op/s 2023-05-08T03:44:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:44:54 smithi096 ceph-mon[124666]: pgmap v91: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.9 KiB/s wr, 10 op/s 2023-05-08T03:44:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:44:57 smithi186 ceph-mon[126480]: pgmap v92: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 4.7 KiB/s wr, 7 op/s 2023-05-08T03:44:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:44:57 smithi133 ceph-mon[125939]: pgmap v92: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 4.7 KiB/s wr, 7 op/s 2023-05-08T03:44:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:44:57 smithi096 ceph-mon[124666]: pgmap v92: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 4.7 KiB/s wr, 7 op/s 2023-05-08T03:44:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:44:59 smithi133 ceph-mon[125939]: pgmap v93: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 4.7 KiB/s wr, 7 op/s 2023-05-08T03:44:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:44:59 smithi096 ceph-mon[124666]: pgmap v93: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 4.7 KiB/s wr, 7 op/s 2023-05-08T03:44:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:44:59 smithi186 ceph-mon[126480]: pgmap v93: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 4.7 KiB/s wr, 7 op/s 2023-05-08T03:45:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:45:01 smithi133 ceph-mon[125939]: pgmap v94: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 10 op/s 2023-05-08T03:45:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:45:01 smithi096 ceph-mon[124666]: pgmap v94: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 10 op/s 2023-05-08T03:45:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:45:01 smithi186 ceph-mon[126480]: pgmap v94: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 10 op/s 2023-05-08T03:45:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:45:03 smithi133 ceph-mon[125939]: pgmap v95: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 8.4 KiB/s wr, 7 op/s 2023-05-08T03:45:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:45:03 smithi096 ceph-mon[124666]: pgmap v95: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 8.4 KiB/s wr, 7 op/s 2023-05-08T03:45:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:45:03 smithi186 ceph-mon[126480]: pgmap v95: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 8.4 KiB/s wr, 7 op/s 2023-05-08T03:45:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:45:05 smithi133 ceph-mon[125939]: pgmap v96: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 34 KiB/s wr, 24 op/s 2023-05-08T03:45:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:45:05 smithi096 ceph-mon[124666]: pgmap v96: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 34 KiB/s wr, 24 op/s 2023-05-08T03:45:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:45:05 smithi186 ceph-mon[126480]: pgmap v96: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 34 KiB/s wr, 24 op/s 2023-05-08T03:45:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:45:07 smithi133 ceph-mon[125939]: pgmap v97: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 32 KiB/s wr, 21 op/s 2023-05-08T03:45:07.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:45:07 smithi096 ceph-mon[124666]: pgmap v97: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 32 KiB/s wr, 21 op/s 2023-05-08T03:45:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:45:07 smithi186 ceph-mon[126480]: pgmap v97: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 32 KiB/s wr, 21 op/s 2023-05-08T03:45:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:45:09 smithi133 ceph-mon[125939]: pgmap v98: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 32 KiB/s wr, 21 op/s 2023-05-08T03:45:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:45:09 smithi096 ceph-mon[124666]: pgmap v98: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 32 KiB/s wr, 21 op/s 2023-05-08T03:45:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:45:09 smithi186 ceph-mon[126480]: pgmap v98: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 32 KiB/s wr, 21 op/s 2023-05-08T03:45:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:45:10 smithi133 ceph-mon[125939]: pgmap v99: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 39 KiB/s wr, 24 op/s 2023-05-08T03:45:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:45:10 smithi096 ceph-mon[124666]: pgmap v99: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 39 KiB/s wr, 24 op/s 2023-05-08T03:45:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:45:10 smithi186 ceph-mon[126480]: pgmap v99: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 39 KiB/s wr, 24 op/s 2023-05-08T03:45:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:45:13 smithi133 ceph-mon[125939]: pgmap v100: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 32 KiB/s wr, 20 op/s 2023-05-08T03:45:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:45:13 smithi096 ceph-mon[124666]: pgmap v100: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 32 KiB/s wr, 20 op/s 2023-05-08T03:45:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:45:13 smithi186 ceph-mon[126480]: pgmap v100: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 32 KiB/s wr, 20 op/s 2023-05-08T03:45:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:45:15 smithi133 ceph-mon[125939]: pgmap v101: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 32 KiB/s wr, 23 op/s 2023-05-08T03:45:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:45:15 smithi096 ceph-mon[124666]: pgmap v101: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 32 KiB/s wr, 23 op/s 2023-05-08T03:45:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:45:15 smithi186 ceph-mon[126480]: pgmap v101: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 32 KiB/s wr, 23 op/s 2023-05-08T03:45:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:45:17 smithi133 ceph-mon[125939]: pgmap v102: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 6.6 KiB/s wr, 6 op/s 2023-05-08T03:45:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:45:17 smithi096 ceph-mon[124666]: pgmap v102: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 6.6 KiB/s wr, 6 op/s 2023-05-08T03:45:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:45:17 smithi186 ceph-mon[126480]: pgmap v102: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 6.6 KiB/s wr, 6 op/s 2023-05-08T03:45:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:45:19 smithi133 ceph-mon[125939]: pgmap v103: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 6.6 KiB/s wr, 6 op/s 2023-05-08T03:45:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:45:19 smithi096 ceph-mon[124666]: pgmap v103: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 6.6 KiB/s wr, 6 op/s 2023-05-08T03:45:19.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:45:19 smithi186 ceph-mon[126480]: pgmap v103: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 6.6 KiB/s wr, 6 op/s 2023-05-08T03:45:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:45:21 smithi133 ceph-mon[125939]: pgmap v104: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.3 KiB/s wr, 8 op/s 2023-05-08T03:45:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:45:21 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:45:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:45:21 smithi096 ceph-mon[124666]: pgmap v104: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.3 KiB/s wr, 8 op/s 2023-05-08T03:45:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:45:21 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:45:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:45:21 smithi186 ceph-mon[126480]: pgmap v104: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.3 KiB/s wr, 8 op/s 2023-05-08T03:45:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:45:21 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:45:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:45:23 smithi133 ceph-mon[125939]: pgmap v105: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.9 KiB/s wr, 5 op/s 2023-05-08T03:45:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:45:23 smithi096 ceph-mon[124666]: pgmap v105: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.9 KiB/s wr, 5 op/s 2023-05-08T03:45:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:45:23 smithi186 ceph-mon[126480]: pgmap v105: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.9 KiB/s wr, 5 op/s 2023-05-08T03:45:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:45:25 smithi133 ceph-mon[125939]: pgmap v106: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.9 KiB/s wr, 8 op/s 2023-05-08T03:45:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:45:25 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:45:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:45:25 smithi096 ceph-mon[124666]: pgmap v106: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.9 KiB/s wr, 8 op/s 2023-05-08T03:45:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:45:25 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:45:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:45:25 smithi186 ceph-mon[126480]: pgmap v106: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.9 KiB/s wr, 8 op/s 2023-05-08T03:45:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:45:25 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:45:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:45:26 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:45:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:45:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:45:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:45:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:45:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:45:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:45:26.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:45:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:45:26.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:45:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:45:26.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:45:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:45:26.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:45:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:45:26.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:45:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:45:26.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:45:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:45:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:45:26 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:45:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:45:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:45:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:45:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:45:26.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:45:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:45:26.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:45:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:45:26.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:45:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:45:26.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:45:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:45:26.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:45:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:45:26.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:45:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:45:26.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:45:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:45:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:45:26 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:45:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:45:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:45:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:45:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:45:26.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:45:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:45:26.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:45:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:45:26.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:45:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:45:26.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:45:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:45:26.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:45:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:45:26.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:45:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:45:26.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:45:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:45:27.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:45:27 smithi133 ceph-mon[125939]: pgmap v107: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.7 KiB/s wr, 5 op/s 2023-05-08T03:45:27.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:45:27 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:45:27.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:45:27 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T03:45:27.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:45:27 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T03:45:27.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:45:27 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:45:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:45:27 smithi096 ceph-mon[124666]: pgmap v107: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.7 KiB/s wr, 5 op/s 2023-05-08T03:45:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:45:27 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:45:27.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:45:27 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T03:45:27.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:45:27 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T03:45:27.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:45:27 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:45:27.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:45:27 smithi186 ceph-mon[126480]: pgmap v107: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.7 KiB/s wr, 5 op/s 2023-05-08T03:45:27.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:45:27 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:45:27.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:45:27 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T03:45:27.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:45:27 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T03:45:27.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:45:27 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:45:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:45:28 smithi186 ceph-mon[126480]: pgmap v108: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.7 KiB/s wr, 5 op/s 2023-05-08T03:45:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:45:28 smithi133 ceph-mon[125939]: pgmap v108: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.7 KiB/s wr, 5 op/s 2023-05-08T03:45:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:45:28 smithi096 ceph-mon[124666]: pgmap v108: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.7 KiB/s wr, 5 op/s 2023-05-08T03:45:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:45:31 smithi133 ceph-mon[125939]: pgmap v109: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 13 KiB/s wr, 10 op/s 2023-05-08T03:45:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:45:31 smithi096 ceph-mon[124666]: pgmap v109: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 13 KiB/s wr, 10 op/s 2023-05-08T03:45:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:45:31 smithi186 ceph-mon[126480]: pgmap v109: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 13 KiB/s wr, 10 op/s 2023-05-08T03:45:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:45:33 smithi133 ceph-mon[125939]: pgmap v110: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 11 KiB/s wr, 7 op/s 2023-05-08T03:45:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:45:33 smithi096 ceph-mon[124666]: pgmap v110: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 11 KiB/s wr, 7 op/s 2023-05-08T03:45:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:45:33 smithi186 ceph-mon[126480]: pgmap v110: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 11 KiB/s wr, 7 op/s 2023-05-08T03:45:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:45:35 smithi133 ceph-mon[125939]: pgmap v111: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 26 KiB/s wr, 12 op/s 2023-05-08T03:45:35.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:45:35 smithi096 ceph-mon[124666]: pgmap v111: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 26 KiB/s wr, 12 op/s 2023-05-08T03:45:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:45:35 smithi186 ceph-mon[126480]: pgmap v111: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 26 KiB/s wr, 12 op/s 2023-05-08T03:45:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:45:37 smithi133 ceph-mon[125939]: pgmap v112: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 26 KiB/s wr, 10 op/s 2023-05-08T03:45:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:45:37 smithi096 ceph-mon[124666]: pgmap v112: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 26 KiB/s wr, 10 op/s 2023-05-08T03:45:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:45:37 smithi186 ceph-mon[126480]: pgmap v112: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 26 KiB/s wr, 10 op/s 2023-05-08T03:45:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:45:39 smithi133 ceph-mon[125939]: pgmap v113: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 26 KiB/s wr, 10 op/s 2023-05-08T03:45:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:45:39 smithi096 ceph-mon[124666]: pgmap v113: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 26 KiB/s wr, 10 op/s 2023-05-08T03:45:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:45:39 smithi186 ceph-mon[126480]: pgmap v113: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 26 KiB/s wr, 10 op/s 2023-05-08T03:45:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:45:41 smithi133 ceph-mon[125939]: pgmap v114: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 28 KiB/s wr, 13 op/s 2023-05-08T03:45:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:45:41 smithi096 ceph-mon[124666]: pgmap v114: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 28 KiB/s wr, 13 op/s 2023-05-08T03:45:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:45:41 smithi186 ceph-mon[126480]: pgmap v114: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 28 KiB/s wr, 13 op/s 2023-05-08T03:45:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:45:43 smithi133 ceph-mon[125939]: pgmap v115: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 8 op/s 2023-05-08T03:45:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:45:43 smithi096 ceph-mon[124666]: pgmap v115: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 8 op/s 2023-05-08T03:45:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:45:43 smithi186 ceph-mon[126480]: pgmap v115: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 8 op/s 2023-05-08T03:45:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:45:44 smithi133 ceph-mon[125939]: pgmap v116: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 11 op/s 2023-05-08T03:45:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:45:44 smithi096 ceph-mon[124666]: pgmap v116: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 11 op/s 2023-05-08T03:45:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:45:44 smithi186 ceph-mon[126480]: pgmap v116: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 11 op/s 2023-05-08T03:45:47.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:45:47 smithi133 ceph-mon[125939]: pgmap v117: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.2 KiB/s wr, 5 op/s 2023-05-08T03:45:47.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:45:47 smithi096 ceph-mon[124666]: pgmap v117: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.2 KiB/s wr, 5 op/s 2023-05-08T03:45:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:45:47 smithi186 ceph-mon[126480]: pgmap v117: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.2 KiB/s wr, 5 op/s 2023-05-08T03:45:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:45:49 smithi133 ceph-mon[125939]: pgmap v118: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.2 KiB/s wr, 5 op/s 2023-05-08T03:45:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:45:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:45:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:45:49 smithi096 ceph-mon[124666]: pgmap v118: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.2 KiB/s wr, 5 op/s 2023-05-08T03:45:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:45:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:45:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:45:49 smithi186 ceph-mon[126480]: pgmap v118: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.2 KiB/s wr, 5 op/s 2023-05-08T03:45:49.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:45:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:45:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:45:50 smithi133 ceph-mon[125939]: pgmap v119: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 3.9 KiB/s wr, 8 op/s 2023-05-08T03:45:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:45:50 smithi096 ceph-mon[124666]: pgmap v119: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 3.9 KiB/s wr, 8 op/s 2023-05-08T03:45:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:45:50 smithi186 ceph-mon[126480]: pgmap v119: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 3.9 KiB/s wr, 8 op/s 2023-05-08T03:45:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:45:53 smithi133 ceph-mon[125939]: pgmap v120: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.7 KiB/s wr, 5 op/s 2023-05-08T03:45:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:45:53 smithi096 ceph-mon[124666]: pgmap v120: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.7 KiB/s wr, 5 op/s 2023-05-08T03:45:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:45:53 smithi186 ceph-mon[126480]: pgmap v120: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.7 KiB/s wr, 5 op/s 2023-05-08T03:45:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:45:54 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:45:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:45:54 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:45:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:45:54 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:45:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:45:55 smithi133 ceph-mon[125939]: pgmap v121: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2023-05-08T03:45:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:45:55 smithi096 ceph-mon[124666]: pgmap v121: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2023-05-08T03:45:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:45:55 smithi186 ceph-mon[126480]: pgmap v121: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2023-05-08T03:45:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:45:56 smithi133 ceph-mon[125939]: pgmap v122: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.7 KiB/s wr, 5 op/s 2023-05-08T03:45:56.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:45:56 smithi096 ceph-mon[124666]: pgmap v122: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.7 KiB/s wr, 5 op/s 2023-05-08T03:45:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:45:56 smithi186 ceph-mon[126480]: pgmap v122: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.7 KiB/s wr, 5 op/s 2023-05-08T03:45:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:45:59 smithi133 ceph-mon[125939]: pgmap v123: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.7 KiB/s wr, 5 op/s 2023-05-08T03:45:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:45:59 smithi096 ceph-mon[124666]: pgmap v123: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.7 KiB/s wr, 5 op/s 2023-05-08T03:45:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:45:59 smithi186 ceph-mon[126480]: pgmap v123: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.7 KiB/s wr, 5 op/s 2023-05-08T03:46:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:46:01 smithi133 ceph-mon[125939]: pgmap v124: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2023-05-08T03:46:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:46:01 smithi096 ceph-mon[124666]: pgmap v124: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2023-05-08T03:46:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:46:01 smithi186 ceph-mon[126480]: pgmap v124: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2023-05-08T03:46:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:46:03 smithi133 ceph-mon[125939]: pgmap v125: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:46:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:46:03 smithi096 ceph-mon[124666]: pgmap v125: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:46:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:46:03 smithi186 ceph-mon[126480]: pgmap v125: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:46:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:46:04 smithi133 ceph-mon[125939]: pgmap v126: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 19 op/s 2023-05-08T03:46:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:46:04 smithi096 ceph-mon[124666]: pgmap v126: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 19 op/s 2023-05-08T03:46:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:46:04 smithi186 ceph-mon[126480]: pgmap v126: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 19 op/s 2023-05-08T03:46:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:46:07 smithi133 ceph-mon[125939]: pgmap v127: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2023-05-08T03:46:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:46:07 smithi096 ceph-mon[124666]: pgmap v127: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2023-05-08T03:46:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:46:07 smithi186 ceph-mon[126480]: pgmap v127: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2023-05-08T03:46:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:46:09 smithi133 ceph-mon[125939]: pgmap v128: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2023-05-08T03:46:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:46:09 smithi096 ceph-mon[124666]: pgmap v128: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2023-05-08T03:46:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:46:09 smithi186 ceph-mon[126480]: pgmap v128: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2023-05-08T03:46:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:46:11 smithi133 ceph-mon[125939]: pgmap v129: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-05-08T03:46:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:46:11 smithi096 ceph-mon[124666]: pgmap v129: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-05-08T03:46:11.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:46:11 smithi186 ceph-mon[126480]: pgmap v129: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-05-08T03:46:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:46:13 smithi133 ceph-mon[125939]: pgmap v130: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2023-05-08T03:46:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:46:13 smithi096 ceph-mon[124666]: pgmap v130: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2023-05-08T03:46:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:46:13 smithi186 ceph-mon[126480]: pgmap v130: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2023-05-08T03:46:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:46:14 smithi186 ceph-mon[126480]: pgmap v131: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-05-08T03:46:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:46:14 smithi133 ceph-mon[125939]: pgmap v131: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-05-08T03:46:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:46:14 smithi096 ceph-mon[124666]: pgmap v131: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-05-08T03:46:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:46:17 smithi133 ceph-mon[125939]: pgmap v132: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2023-05-08T03:46:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:46:17 smithi096 ceph-mon[124666]: pgmap v132: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2023-05-08T03:46:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:46:17 smithi186 ceph-mon[126480]: pgmap v132: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2023-05-08T03:46:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:46:19 smithi133 ceph-mon[125939]: pgmap v133: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2023-05-08T03:46:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:46:19 smithi096 ceph-mon[124666]: pgmap v133: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2023-05-08T03:46:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:46:19 smithi186 ceph-mon[126480]: pgmap v133: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2023-05-08T03:46:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:46:20 smithi186 ceph-mon[126480]: pgmap v134: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 8 op/s 2023-05-08T03:46:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:46:20 smithi133 ceph-mon[125939]: pgmap v134: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 8 op/s 2023-05-08T03:46:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:46:20 smithi096 ceph-mon[124666]: pgmap v134: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 8 op/s 2023-05-08T03:46:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:46:23 smithi133 ceph-mon[125939]: pgmap v135: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T03:46:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:46:23 smithi096 ceph-mon[124666]: pgmap v135: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T03:46:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:46:23 smithi186 ceph-mon[126480]: pgmap v135: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T03:46:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:46:25 smithi133 ceph-mon[125939]: pgmap v136: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T03:46:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:46:25 smithi096 ceph-mon[124666]: pgmap v136: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T03:46:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:46:25 smithi186 ceph-mon[126480]: pgmap v136: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T03:46:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:46:26 smithi133 ceph-mon[125939]: pgmap v137: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T03:46:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:46:26 smithi096 ceph-mon[124666]: pgmap v137: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T03:46:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:46:26 smithi186 ceph-mon[126480]: pgmap v137: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T03:46:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:46:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:46:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:46:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:46:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:46:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:46:27.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:46:27 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:46:27.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:46:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:46:27.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:46:27 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T03:46:27.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:46:27 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T03:46:27.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:46:27 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:46:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:46:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:46:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:46:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:46:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:46:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:46:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:46:27 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:46:27.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:46:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:46:27.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:46:27 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T03:46:27.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:46:27 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T03:46:27.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:46:27 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:46:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:46:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:46:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:46:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:46:27.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:46:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:46:27.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:46:27 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:46:27.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:46:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:46:27.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:46:27 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T03:46:27.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:46:27 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T03:46:27.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:46:27 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:46:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:46:28 smithi096 ceph-mon[124666]: pgmap v138: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T03:46:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:46:28 smithi186 ceph-mon[126480]: pgmap v138: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T03:46:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:46:28 smithi133 ceph-mon[125939]: pgmap v138: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T03:46:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:46:31 smithi133 ceph-mon[125939]: pgmap v139: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.6 KiB/s wr, 9 op/s 2023-05-08T03:46:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:46:31 smithi096 ceph-mon[124666]: pgmap v139: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.6 KiB/s wr, 9 op/s 2023-05-08T03:46:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:46:31 smithi186 ceph-mon[126480]: pgmap v139: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.6 KiB/s wr, 9 op/s 2023-05-08T03:46:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:46:33 smithi133 ceph-mon[125939]: pgmap v140: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.6 KiB/s wr, 6 op/s 2023-05-08T03:46:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:46:33 smithi096 ceph-mon[124666]: pgmap v140: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.6 KiB/s wr, 6 op/s 2023-05-08T03:46:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:46:33 smithi186 ceph-mon[126480]: pgmap v140: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.6 KiB/s wr, 6 op/s 2023-05-08T03:46:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:46:35 smithi133 ceph-mon[125939]: pgmap v141: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 17 KiB/s wr, 10 op/s 2023-05-08T03:46:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:46:35 smithi096 ceph-mon[124666]: pgmap v141: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 17 KiB/s wr, 10 op/s 2023-05-08T03:46:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:46:35 smithi186 ceph-mon[126480]: pgmap v141: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 17 KiB/s wr, 10 op/s 2023-05-08T03:46:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:46:36 smithi186 ceph-mon[126480]: pgmap v142: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 17 KiB/s wr, 8 op/s 2023-05-08T03:46:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:46:36 smithi133 ceph-mon[125939]: pgmap v142: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 17 KiB/s wr, 8 op/s 2023-05-08T03:46:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:46:36 smithi096 ceph-mon[124666]: pgmap v142: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 17 KiB/s wr, 8 op/s 2023-05-08T03:46:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:46:39 smithi133 ceph-mon[125939]: pgmap v143: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 17 KiB/s wr, 8 op/s 2023-05-08T03:46:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:46:39 smithi096 ceph-mon[124666]: pgmap v143: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 17 KiB/s wr, 8 op/s 2023-05-08T03:46:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:46:39 smithi186 ceph-mon[126480]: pgmap v143: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 17 KiB/s wr, 8 op/s 2023-05-08T03:46:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:46:41 smithi133 ceph-mon[125939]: pgmap v144: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 20 KiB/s wr, 11 op/s 2023-05-08T03:46:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:46:41 smithi096 ceph-mon[124666]: pgmap v144: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 20 KiB/s wr, 11 op/s 2023-05-08T03:46:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:46:41 smithi186 ceph-mon[126480]: pgmap v144: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 20 KiB/s wr, 11 op/s 2023-05-08T03:46:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:46:43 smithi133 ceph-mon[125939]: pgmap v145: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 7 op/s 2023-05-08T03:46:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:46:43 smithi096 ceph-mon[124666]: pgmap v145: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 7 op/s 2023-05-08T03:46:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:46:43 smithi186 ceph-mon[126480]: pgmap v145: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 7 op/s 2023-05-08T03:46:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:46:45 smithi133 ceph-mon[125939]: pgmap v146: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 10 op/s 2023-05-08T03:46:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:46:45 smithi096 ceph-mon[124666]: pgmap v146: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 10 op/s 2023-05-08T03:46:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:46:45 smithi186 ceph-mon[126480]: pgmap v146: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 10 op/s 2023-05-08T03:46:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:46:46 smithi186 ceph-mon[126480]: pgmap v147: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 2.5 KiB/s wr, 6 op/s 2023-05-08T03:46:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:46:46 smithi133 ceph-mon[125939]: pgmap v147: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 2.5 KiB/s wr, 6 op/s 2023-05-08T03:46:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:46:46 smithi096 ceph-mon[124666]: pgmap v147: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 2.5 KiB/s wr, 6 op/s 2023-05-08T03:46:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:46:49 smithi133 ceph-mon[125939]: pgmap v148: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 2.4 KiB/s wr, 5 op/s 2023-05-08T03:46:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:46:49 smithi096 ceph-mon[124666]: pgmap v148: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 2.4 KiB/s wr, 5 op/s 2023-05-08T03:46:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:46:49 smithi186 ceph-mon[126480]: pgmap v148: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 2.4 KiB/s wr, 5 op/s 2023-05-08T03:46:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:46:51 smithi133 ceph-mon[125939]: pgmap v149: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 2.4 KiB/s wr, 8 op/s 2023-05-08T03:46:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:46:51 smithi096 ceph-mon[124666]: pgmap v149: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 2.4 KiB/s wr, 8 op/s 2023-05-08T03:46:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:46:51 smithi186 ceph-mon[126480]: pgmap v149: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 2.4 KiB/s wr, 8 op/s 2023-05-08T03:46:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:46:53 smithi133 ceph-mon[125939]: pgmap v150: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:46:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:46:53 smithi096 ceph-mon[124666]: pgmap v150: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:46:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:46:53 smithi186 ceph-mon[126480]: pgmap v150: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:46:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:46:54 smithi186 ceph-mon[126480]: pgmap v151: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T03:46:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:46:54 smithi133 ceph-mon[125939]: pgmap v151: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T03:46:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:46:54 smithi096 ceph-mon[124666]: pgmap v151: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T03:46:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:46:57 smithi133 ceph-mon[125939]: pgmap v152: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:46:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:46:57 smithi096 ceph-mon[124666]: pgmap v152: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:46:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:46:57 smithi186 ceph-mon[126480]: pgmap v152: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:46:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:46:59 smithi133 ceph-mon[125939]: pgmap v153: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:46:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:46:59 smithi096 ceph-mon[124666]: pgmap v153: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:46:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:46:59 smithi186 ceph-mon[126480]: pgmap v153: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:47:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:47:00 smithi186 ceph-mon[126480]: pgmap v154: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T03:47:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:47:00 smithi133 ceph-mon[125939]: pgmap v154: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T03:47:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:47:00 smithi096 ceph-mon[124666]: pgmap v154: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T03:47:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:47:03 smithi133 ceph-mon[125939]: pgmap v155: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:47:03.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:47:03 smithi096 ceph-mon[124666]: pgmap v155: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:47:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:47:03 smithi186 ceph-mon[126480]: pgmap v155: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:47:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:47:04 smithi186 ceph-mon[126480]: pgmap v156: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2023-05-08T03:47:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:47:04 smithi133 ceph-mon[125939]: pgmap v156: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2023-05-08T03:47:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:47:04 smithi096 ceph-mon[124666]: pgmap v156: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2023-05-08T03:47:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:47:07 smithi133 ceph-mon[125939]: pgmap v157: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2023-05-08T03:47:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:47:07 smithi096 ceph-mon[124666]: pgmap v157: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2023-05-08T03:47:07.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:47:07 smithi186 ceph-mon[126480]: pgmap v157: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2023-05-08T03:47:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:47:09 smithi133 ceph-mon[125939]: pgmap v158: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2023-05-08T03:47:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:47:09 smithi096 ceph-mon[124666]: pgmap v158: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2023-05-08T03:47:09.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:47:09 smithi186 ceph-mon[126480]: pgmap v158: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2023-05-08T03:47:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:47:10 smithi186 ceph-mon[126480]: pgmap v159: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-05-08T03:47:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:47:10 smithi133 ceph-mon[125939]: pgmap v159: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-05-08T03:47:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:47:10 smithi096 ceph-mon[124666]: pgmap v159: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-05-08T03:47:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:47:13 smithi133 ceph-mon[125939]: pgmap v160: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2023-05-08T03:47:13.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:47:13 smithi096 ceph-mon[124666]: pgmap v160: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2023-05-08T03:47:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:47:13 smithi186 ceph-mon[126480]: pgmap v160: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2023-05-08T03:47:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:47:14 smithi186 ceph-mon[126480]: pgmap v161: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-05-08T03:47:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:47:14 smithi133 ceph-mon[125939]: pgmap v161: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-05-08T03:47:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:47:14 smithi096 ceph-mon[124666]: pgmap v161: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-05-08T03:47:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:47:17 smithi133 ceph-mon[125939]: pgmap v162: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2023-05-08T03:47:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:47:17 smithi096 ceph-mon[124666]: pgmap v162: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2023-05-08T03:47:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:47:17 smithi186 ceph-mon[126480]: pgmap v162: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2023-05-08T03:47:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:47:18 smithi186 ceph-mon[126480]: pgmap v163: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2023-05-08T03:47:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:47:18 smithi133 ceph-mon[125939]: pgmap v163: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2023-05-08T03:47:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:47:18 smithi096 ceph-mon[124666]: pgmap v163: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2023-05-08T03:47:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:47:21 smithi133 ceph-mon[125939]: pgmap v164: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 8 op/s 2023-05-08T03:47:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:47:21 smithi096 ceph-mon[124666]: pgmap v164: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 8 op/s 2023-05-08T03:47:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:47:21 smithi186 ceph-mon[126480]: pgmap v164: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 8 op/s 2023-05-08T03:47:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:47:23 smithi133 ceph-mon[125939]: pgmap v165: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T03:47:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:47:23 smithi133 ceph-mon[125939]: 1 slow requests, 1 included below; oldest blocked for > 182.562848 secs 2023-05-08T03:47:23.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:47:23 smithi133 ceph-mon[125939]: slow request 182.562848 seconds old, received at 2023-05-08T03:44:20.260233+0000: client_request(client.15258:3163 link #0x10000000007/0000000100000000000000F2 #0x10000000007/0000000100000000000000C5 2023-05-08T03:44:20.259302+0000 caller_uid=26, caller_gid=26{26,}) currently acquired locks 2023-05-08T03:47:23.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:47:23 smithi096 ceph-mon[124666]: pgmap v165: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T03:47:23.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:47:23 smithi096 ceph-mon[124666]: 1 slow requests, 1 included below; oldest blocked for > 182.562848 secs 2023-05-08T03:47:23.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:47:23 smithi096 ceph-mon[124666]: slow request 182.562848 seconds old, received at 2023-05-08T03:44:20.260233+0000: client_request(client.15258:3163 link #0x10000000007/0000000100000000000000F2 #0x10000000007/0000000100000000000000C5 2023-05-08T03:44:20.259302+0000 caller_uid=26, caller_gid=26{26,}) currently acquired locks 2023-05-08T03:47:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:47:23 smithi186 ceph-mon[126480]: pgmap v165: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T03:47:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:47:23 smithi186 ceph-mon[126480]: 1 slow requests, 1 included below; oldest blocked for > 182.562848 secs 2023-05-08T03:47:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:47:23 smithi186 ceph-mon[126480]: slow request 182.562848 seconds old, received at 2023-05-08T03:44:20.260233+0000: client_request(client.15258:3163 link #0x10000000007/0000000100000000000000F2 #0x10000000007/0000000100000000000000C5 2023-05-08T03:44:20.259302+0000 caller_uid=26, caller_gid=26{26,}) currently acquired locks 2023-05-08T03:47:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:47:24 smithi133 ceph-mon[125939]: 1 slow requests, 1 included below; oldest blocked for > 183.115388 secs 2023-05-08T03:47:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:47:24 smithi133 ceph-mon[125939]: slow request 183.115387 seconds old, received at 2023-05-08T03:44:20.272100+0000: peer_request:client.15258:3163 currently acquired locks 2023-05-08T03:47:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:47:24 smithi096 ceph-mon[124666]: 1 slow requests, 1 included below; oldest blocked for > 183.115388 secs 2023-05-08T03:47:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:47:24 smithi096 ceph-mon[124666]: slow request 183.115387 seconds old, received at 2023-05-08T03:44:20.272100+0000: peer_request:client.15258:3163 currently acquired locks 2023-05-08T03:47:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:47:24 smithi186 ceph-mon[126480]: 1 slow requests, 1 included below; oldest blocked for > 183.115388 secs 2023-05-08T03:47:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:47:24 smithi186 ceph-mon[126480]: slow request 183.115387 seconds old, received at 2023-05-08T03:44:20.272100+0000: peer_request:client.15258:3163 currently acquired locks 2023-05-08T03:47:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:47:25 smithi133 ceph-mon[125939]: pgmap v166: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T03:47:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:47:25 smithi133 ceph-mon[125939]: 1 slow requests, 1 included below; oldest blocked for > 184.391889 secs 2023-05-08T03:47:25.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:47:25 smithi133 ceph-mon[125939]: slow request 184.391888 seconds old, received at 2023-05-08T03:44:20.261840+0000: peer_request:client.15258:3163 currently dispatched 2023-05-08T03:47:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:47:25 smithi096 ceph-mon[124666]: pgmap v166: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T03:47:25.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:47:25 smithi096 ceph-mon[124666]: 1 slow requests, 1 included below; oldest blocked for > 184.391889 secs 2023-05-08T03:47:25.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:47:25 smithi096 ceph-mon[124666]: slow request 184.391888 seconds old, received at 2023-05-08T03:44:20.261840+0000: peer_request:client.15258:3163 currently dispatched 2023-05-08T03:47:25.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:47:25 smithi186 ceph-mon[126480]: pgmap v166: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T03:47:25.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:47:25 smithi186 ceph-mon[126480]: 1 slow requests, 1 included below; oldest blocked for > 184.391889 secs 2023-05-08T03:47:25.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:47:25 smithi186 ceph-mon[126480]: slow request 184.391888 seconds old, received at 2023-05-08T03:44:20.261840+0000: peer_request:client.15258:3163 currently dispatched 2023-05-08T03:47:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:47:26 smithi133 ceph-mon[125939]: Health check failed: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T03:47:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:47:26 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T03:47:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:47:26 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:47:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:47:26 smithi096 ceph-mon[124666]: Health check failed: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T03:47:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:47:26 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T03:47:26.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:47:26 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:47:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:47:26 smithi186 ceph-mon[126480]: Health check failed: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T03:47:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:47:26 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T03:47:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:47:26 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:47:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:47:27 smithi133 ceph-mon[125939]: pgmap v167: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:47:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:47:27 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T03:47:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:47:27 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T03:47:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:47:27 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:47:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:47:27 smithi096 ceph-mon[124666]: pgmap v167: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:47:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:47:27 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T03:47:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:47:27 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T03:47:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:47:27 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:47:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:47:27 smithi186 ceph-mon[126480]: pgmap v167: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:47:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:47:27 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T03:47:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:47:27 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T03:47:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:47:27 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:47:28.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:47:28 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:47:28.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:47:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 187.562993 secs 2023-05-08T03:47:28.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:47:28 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:47:28.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:47:28 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:47:28.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:47:28 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:47:28.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:47:28 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:47:28.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:47:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 187.562993 secs 2023-05-08T03:47:28.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:47:28 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:47:28.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:47:28 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:47:28.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:47:28 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:47:28.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:47:28 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:47:28.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:47:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 187.562993 secs 2023-05-08T03:47:28.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:47:28 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:47:28.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:47:28 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:47:28.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:47:28 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:47:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:47:29 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:47:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:47:29 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T03:47:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:47:29 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T03:47:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:47:29 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:47:29.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:47:29 smithi133 ceph-mon[125939]: pgmap v168: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:47:29.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:47:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 188.115504 secs 2023-05-08T03:47:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:47:29 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:47:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:47:29 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T03:47:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:47:29 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T03:47:29.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:47:29 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:47:29.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:47:29 smithi096 ceph-mon[124666]: pgmap v168: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:47:29.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:47:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 188.115504 secs 2023-05-08T03:47:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:47:29 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:47:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:47:29 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T03:47:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:47:29 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T03:47:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:47:29 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:47:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:47:29 smithi186 ceph-mon[126480]: pgmap v168: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:47:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:47:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 188.115504 secs 2023-05-08T03:47:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:47:31 smithi133 ceph-mon[125939]: pgmap v169: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.1 KiB/s wr, 8 op/s 2023-05-08T03:47:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:47:31 smithi096 ceph-mon[124666]: pgmap v169: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.1 KiB/s wr, 8 op/s 2023-05-08T03:47:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:47:31 smithi186 ceph-mon[126480]: pgmap v169: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.1 KiB/s wr, 8 op/s 2023-05-08T03:47:33.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:47:33 smithi133 ceph-mon[125939]: pgmap v170: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.1 KiB/s wr, 6 op/s 2023-05-08T03:47:33.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:47:33 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T03:47:33.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:47:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 192.563108 secs 2023-05-08T03:47:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:47:33 smithi096 ceph-mon[124666]: pgmap v170: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.1 KiB/s wr, 6 op/s 2023-05-08T03:47:33.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:47:33 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T03:47:33.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:47:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 192.563108 secs 2023-05-08T03:47:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:47:33 smithi186 ceph-mon[126480]: pgmap v170: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.1 KiB/s wr, 6 op/s 2023-05-08T03:47:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:47:33 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T03:47:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:47:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 192.563108 secs 2023-05-08T03:47:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:47:34 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T03:47:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:47:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 193.115603 secs 2023-05-08T03:47:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:47:34 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T03:47:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:47:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 193.115603 secs 2023-05-08T03:47:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:47:34 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T03:47:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:47:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 193.115603 secs 2023-05-08T03:47:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:47:35 smithi133 ceph-mon[125939]: pgmap v171: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 16 KiB/s wr, 10 op/s 2023-05-08T03:47:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:47:35 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T03:47:35.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:47:35 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:47:35.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:47:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 194.392118 secs 2023-05-08T03:47:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:47:35 smithi096 ceph-mon[124666]: pgmap v171: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 16 KiB/s wr, 10 op/s 2023-05-08T03:47:35.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:47:35 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T03:47:35.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:47:35 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:47:35.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:47:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 194.392118 secs 2023-05-08T03:47:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:47:35 smithi186 ceph-mon[126480]: pgmap v171: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 16 KiB/s wr, 10 op/s 2023-05-08T03:47:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:47:35 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T03:47:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:47:35 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:47:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:47:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 194.392118 secs 2023-05-08T03:47:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:47:37 smithi133 ceph-mon[125939]: pgmap v172: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 16 KiB/s wr, 7 op/s 2023-05-08T03:47:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:47:37 smithi096 ceph-mon[124666]: pgmap v172: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 16 KiB/s wr, 7 op/s 2023-05-08T03:47:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:47:37 smithi186 ceph-mon[126480]: pgmap v172: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 16 KiB/s wr, 7 op/s 2023-05-08T03:47:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:47:38 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T03:47:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:47:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 197.563220 secs 2023-05-08T03:47:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:47:38 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T03:47:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:47:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 197.563220 secs 2023-05-08T03:47:38.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:47:38 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T03:47:38.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:47:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 197.563220 secs 2023-05-08T03:47:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:47:39 smithi133 ceph-mon[125939]: pgmap v173: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 16 KiB/s wr, 7 op/s 2023-05-08T03:47:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:47:39 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T03:47:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:47:39 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:47:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:47:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 198.115729 secs 2023-05-08T03:47:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:47:39 smithi096 ceph-mon[124666]: pgmap v173: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 16 KiB/s wr, 7 op/s 2023-05-08T03:47:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:47:39 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T03:47:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:47:39 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:47:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:47:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 198.115729 secs 2023-05-08T03:47:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:47:39 smithi186 ceph-mon[126480]: pgmap v173: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 16 KiB/s wr, 7 op/s 2023-05-08T03:47:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:47:39 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T03:47:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:47:39 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:47:39.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:47:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 198.115729 secs 2023-05-08T03:47:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:47:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 199.392213 secs 2023-05-08T03:47:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:47:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 199.392213 secs 2023-05-08T03:47:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:47:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 199.392213 secs 2023-05-08T03:47:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:47:41 smithi133 ceph-mon[125939]: pgmap v174: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 19 KiB/s wr, 11 op/s 2023-05-08T03:47:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:47:41 smithi096 ceph-mon[124666]: pgmap v174: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 19 KiB/s wr, 11 op/s 2023-05-08T03:47:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:47:41 smithi186 ceph-mon[126480]: pgmap v174: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 19 KiB/s wr, 11 op/s 2023-05-08T03:47:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:47:43 smithi133 ceph-mon[125939]: pgmap v175: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 7 op/s 2023-05-08T03:47:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:47:43 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T03:47:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:47:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 202.563362 secs 2023-05-08T03:47:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:47:43 smithi096 ceph-mon[124666]: pgmap v175: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 7 op/s 2023-05-08T03:47:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:47:43 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T03:47:43.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:47:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 202.563362 secs 2023-05-08T03:47:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:47:43 smithi186 ceph-mon[126480]: pgmap v175: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 7 op/s 2023-05-08T03:47:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:47:43 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T03:47:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:47:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 202.563362 secs 2023-05-08T03:47:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:47:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 203.115844 secs 2023-05-08T03:47:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:47:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 203.115844 secs 2023-05-08T03:47:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:47:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 203.115844 secs 2023-05-08T03:47:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:47:45 smithi133 ceph-mon[125939]: pgmap v176: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 9 op/s 2023-05-08T03:47:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:47:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 204.392347 secs 2023-05-08T03:47:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:47:45 smithi096 ceph-mon[124666]: pgmap v176: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 9 op/s 2023-05-08T03:47:45.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:47:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 204.392347 secs 2023-05-08T03:47:45.624 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:47:45 smithi186 ceph-mon[126480]: pgmap v176: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 9 op/s 2023-05-08T03:47:45.625 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:47:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 204.392347 secs 2023-05-08T03:47:47.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:47:47 smithi133 ceph-mon[125939]: pgmap v177: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 3.2 KiB/s wr, 6 op/s 2023-05-08T03:47:47.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:47:47 smithi096 ceph-mon[124666]: pgmap v177: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 3.2 KiB/s wr, 6 op/s 2023-05-08T03:47:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:47:47 smithi186 ceph-mon[126480]: pgmap v177: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 3.2 KiB/s wr, 6 op/s 2023-05-08T03:47:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:47:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 207.563486 secs 2023-05-08T03:47:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:47:48 smithi096 ceph-mon[124666]: pgmap v178: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 3.1 KiB/s wr, 5 op/s 2023-05-08T03:47:48.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:47:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 208.115949 secs 2023-05-08T03:47:48.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:47:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 207.563486 secs 2023-05-08T03:47:48.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:47:48 smithi186 ceph-mon[126480]: pgmap v178: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 3.1 KiB/s wr, 5 op/s 2023-05-08T03:47:48.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:47:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 208.115949 secs 2023-05-08T03:47:48.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:47:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 207.563486 secs 2023-05-08T03:47:48.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:47:48 smithi133 ceph-mon[125939]: pgmap v178: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 3.1 KiB/s wr, 5 op/s 2023-05-08T03:47:48.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:47:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 208.115949 secs 2023-05-08T03:47:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:47:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 209.392442 secs 2023-05-08T03:47:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:47:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 209.392442 secs 2023-05-08T03:47:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:47:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 209.392442 secs 2023-05-08T03:47:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:47:50 smithi186 ceph-mon[126480]: pgmap v179: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 3.1 KiB/s wr, 8 op/s 2023-05-08T03:47:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:47:50 smithi133 ceph-mon[125939]: pgmap v179: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 3.1 KiB/s wr, 8 op/s 2023-05-08T03:47:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:47:50 smithi096 ceph-mon[124666]: pgmap v179: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 3.1 KiB/s wr, 8 op/s 2023-05-08T03:47:53.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:47:53 smithi133 ceph-mon[125939]: pgmap v180: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T03:47:53.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:47:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 212.563623 secs 2023-05-08T03:47:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:47:53 smithi096 ceph-mon[124666]: pgmap v180: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T03:47:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:47:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 212.563623 secs 2023-05-08T03:47:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:47:53 smithi186 ceph-mon[126480]: pgmap v180: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T03:47:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:47:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 212.563623 secs 2023-05-08T03:47:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:47:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 213.116069 secs 2023-05-08T03:47:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:47:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 213.116069 secs 2023-05-08T03:47:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:47:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 213.116069 secs 2023-05-08T03:47:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:47:55 smithi133 ceph-mon[125939]: pgmap v181: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T03:47:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:47:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 214.392580 secs 2023-05-08T03:47:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:47:55 smithi096 ceph-mon[124666]: pgmap v181: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T03:47:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:47:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 214.392580 secs 2023-05-08T03:47:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:47:55 smithi186 ceph-mon[126480]: pgmap v181: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T03:47:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:47:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 214.392580 secs 2023-05-08T03:47:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:47:57 smithi133 ceph-mon[125939]: pgmap v182: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:47:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:47:57 smithi096 ceph-mon[124666]: pgmap v182: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:47:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:47:57 smithi186 ceph-mon[126480]: pgmap v182: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:47:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:47:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 217.563759 secs 2023-05-08T03:47:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:47:58 smithi186 ceph-mon[126480]: pgmap v183: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:47:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:47:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 218.116191 secs 2023-05-08T03:47:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:47:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 217.563759 secs 2023-05-08T03:47:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:47:58 smithi133 ceph-mon[125939]: pgmap v183: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:47:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:47:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 218.116191 secs 2023-05-08T03:47:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:47:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 217.563759 secs 2023-05-08T03:47:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:47:58 smithi096 ceph-mon[124666]: pgmap v183: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:47:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:47:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 218.116191 secs 2023-05-08T03:48:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:47:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 219.392697 secs 2023-05-08T03:48:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:47:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 219.392697 secs 2023-05-08T03:48:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:47:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 219.392697 secs 2023-05-08T03:48:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:00 smithi186 ceph-mon[126480]: pgmap v184: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T03:48:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:00 smithi133 ceph-mon[125939]: pgmap v184: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T03:48:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:00 smithi096 ceph-mon[124666]: pgmap v184: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T03:48:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:03 smithi133 ceph-mon[125939]: pgmap v185: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:48:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 222.563872 secs 2023-05-08T03:48:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:03 smithi096 ceph-mon[124666]: pgmap v185: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:48:03.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 222.563872 secs 2023-05-08T03:48:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:03 smithi186 ceph-mon[126480]: pgmap v185: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:48:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 222.563872 secs 2023-05-08T03:48:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 223.116305 secs 2023-05-08T03:48:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 223.116305 secs 2023-05-08T03:48:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 223.116305 secs 2023-05-08T03:48:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:05 smithi133 ceph-mon[125939]: pgmap v186: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2023-05-08T03:48:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 224.392851 secs 2023-05-08T03:48:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:05 smithi096 ceph-mon[124666]: pgmap v186: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2023-05-08T03:48:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 224.392851 secs 2023-05-08T03:48:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:05 smithi186 ceph-mon[126480]: pgmap v186: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2023-05-08T03:48:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 224.392851 secs 2023-05-08T03:48:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:07 smithi133 ceph-mon[125939]: pgmap v187: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2023-05-08T03:48:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:07 smithi096 ceph-mon[124666]: pgmap v187: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2023-05-08T03:48:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:07 smithi186 ceph-mon[126480]: pgmap v187: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2023-05-08T03:48:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 227.563988 secs 2023-05-08T03:48:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:08 smithi186 ceph-mon[126480]: pgmap v188: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2023-05-08T03:48:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 228.116368 secs 2023-05-08T03:48:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 227.563988 secs 2023-05-08T03:48:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:08 smithi133 ceph-mon[125939]: pgmap v188: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2023-05-08T03:48:08.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 228.116368 secs 2023-05-08T03:48:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 227.563988 secs 2023-05-08T03:48:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:08 smithi096 ceph-mon[124666]: pgmap v188: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2023-05-08T03:48:09.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 228.116368 secs 2023-05-08T03:48:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 229.392962 secs 2023-05-08T03:48:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 229.392962 secs 2023-05-08T03:48:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 229.392962 secs 2023-05-08T03:48:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:10 smithi186 ceph-mon[126480]: pgmap v189: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-05-08T03:48:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:10 smithi133 ceph-mon[125939]: pgmap v189: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-05-08T03:48:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:10 smithi096 ceph-mon[124666]: pgmap v189: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-05-08T03:48:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:13 smithi133 ceph-mon[125939]: pgmap v190: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2023-05-08T03:48:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 232.564068 secs 2023-05-08T03:48:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:13 smithi096 ceph-mon[124666]: pgmap v190: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2023-05-08T03:48:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 232.564068 secs 2023-05-08T03:48:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:13 smithi186 ceph-mon[126480]: pgmap v190: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2023-05-08T03:48:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 232.564068 secs 2023-05-08T03:48:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 233.116488 secs 2023-05-08T03:48:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 233.116488 secs 2023-05-08T03:48:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 233.116488 secs 2023-05-08T03:48:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:15 smithi133 ceph-mon[125939]: pgmap v191: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-05-08T03:48:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 234.393072 secs 2023-05-08T03:48:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:15 smithi096 ceph-mon[124666]: pgmap v191: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-05-08T03:48:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 234.393072 secs 2023-05-08T03:48:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:15 smithi186 ceph-mon[126480]: pgmap v191: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-05-08T03:48:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 234.393072 secs 2023-05-08T03:48:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:17 smithi133 ceph-mon[125939]: pgmap v192: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2023-05-08T03:48:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:17 smithi096 ceph-mon[124666]: pgmap v192: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2023-05-08T03:48:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:17 smithi186 ceph-mon[126480]: pgmap v192: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2023-05-08T03:48:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 237.564208 secs 2023-05-08T03:48:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:18 smithi186 ceph-mon[126480]: pgmap v193: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2023-05-08T03:48:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 238.116525 secs 2023-05-08T03:48:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 237.564208 secs 2023-05-08T03:48:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:18 smithi133 ceph-mon[125939]: pgmap v193: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2023-05-08T03:48:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 238.116525 secs 2023-05-08T03:48:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 237.564208 secs 2023-05-08T03:48:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:18 smithi096 ceph-mon[124666]: pgmap v193: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2023-05-08T03:48:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 238.116525 secs 2023-05-08T03:48:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 239.393190 secs 2023-05-08T03:48:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 239.393190 secs 2023-05-08T03:48:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 239.393190 secs 2023-05-08T03:48:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:20 smithi186 ceph-mon[126480]: pgmap v194: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 170 B/s wr, 7 op/s 2023-05-08T03:48:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:20 smithi133 ceph-mon[125939]: pgmap v194: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 170 B/s wr, 7 op/s 2023-05-08T03:48:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:20 smithi096 ceph-mon[124666]: pgmap v194: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 170 B/s wr, 7 op/s 2023-05-08T03:48:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:23 smithi133 ceph-mon[125939]: pgmap v195: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T03:48:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 242.564357 secs 2023-05-08T03:48:23.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:23 smithi096 ceph-mon[124666]: pgmap v195: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T03:48:23.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 242.564357 secs 2023-05-08T03:48:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:23 smithi186 ceph-mon[126480]: pgmap v195: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T03:48:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 242.564357 secs 2023-05-08T03:48:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 243.116604 secs 2023-05-08T03:48:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 243.116604 secs 2023-05-08T03:48:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 243.116604 secs 2023-05-08T03:48:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:25 smithi133 ceph-mon[125939]: pgmap v196: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T03:48:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 244.393269 secs 2023-05-08T03:48:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:25 smithi096 ceph-mon[124666]: pgmap v196: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T03:48:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 244.393269 secs 2023-05-08T03:48:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:25 smithi186 ceph-mon[126480]: pgmap v196: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T03:48:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 244.393269 secs 2023-05-08T03:48:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:27 smithi133 ceph-mon[125939]: pgmap v197: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T03:48:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:27 smithi096 ceph-mon[124666]: pgmap v197: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T03:48:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:27 smithi186 ceph-mon[126480]: pgmap v197: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T03:48:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 247.564438 secs 2023-05-08T03:48:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:28 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:48:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:28 smithi186 ceph-mon[126480]: pgmap v198: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T03:48:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 248.116665 secs 2023-05-08T03:48:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 247.564438 secs 2023-05-08T03:48:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:28 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:48:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:28 smithi133 ceph-mon[125939]: pgmap v198: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T03:48:28.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 248.116665 secs 2023-05-08T03:48:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 247.564438 secs 2023-05-08T03:48:29.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:28 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:48:29.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:28 smithi096 ceph-mon[124666]: pgmap v198: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T03:48:29.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 248.116665 secs 2023-05-08T03:48:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:29 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:48:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:29 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:48:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:29 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:48:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:29 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:48:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:29 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T03:48:29.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:29 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T03:48:29.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:29 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:48:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:29 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:48:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:29 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:48:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:29 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:48:29.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:29 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:48:29.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:29 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T03:48:29.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:29 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T03:48:29.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:29 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:48:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:29 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:48:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:29 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:48:30.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:29 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:48:30.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:29 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:48:30.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:29 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T03:48:30.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:29 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T03:48:30.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:29 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:48:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:30 smithi186 ceph-mon[126480]: pgmap v199: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.8 KiB/s wr, 8 op/s 2023-05-08T03:48:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:30 smithi133 ceph-mon[125939]: pgmap v199: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.8 KiB/s wr, 8 op/s 2023-05-08T03:48:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:30 smithi096 ceph-mon[124666]: pgmap v199: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.8 KiB/s wr, 8 op/s 2023-05-08T03:48:33.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:33 smithi133 ceph-mon[125939]: pgmap v200: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.8 KiB/s wr, 6 op/s 2023-05-08T03:48:33.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 252.564556 secs 2023-05-08T03:48:33.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:33 smithi096 ceph-mon[124666]: pgmap v200: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.8 KiB/s wr, 6 op/s 2023-05-08T03:48:33.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 252.564556 secs 2023-05-08T03:48:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:33 smithi186 ceph-mon[126480]: pgmap v200: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.8 KiB/s wr, 6 op/s 2023-05-08T03:48:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 252.564556 secs 2023-05-08T03:48:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:34 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T03:48:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 253.116729 secs 2023-05-08T03:48:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:34 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T03:48:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 253.116729 secs 2023-05-08T03:48:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:34 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T03:48:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 253.116729 secs 2023-05-08T03:48:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:35 smithi133 ceph-mon[125939]: pgmap v201: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 18 KiB/s wr, 10 op/s 2023-05-08T03:48:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:35 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T03:48:35.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:35 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T03:48:35.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:35 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:48:35.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 254.393519 secs 2023-05-08T03:48:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:35 smithi096 ceph-mon[124666]: pgmap v201: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 18 KiB/s wr, 10 op/s 2023-05-08T03:48:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:35 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T03:48:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:35 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T03:48:35.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:35 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:48:35.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 254.393519 secs 2023-05-08T03:48:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:35 smithi186 ceph-mon[126480]: pgmap v201: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 18 KiB/s wr, 10 op/s 2023-05-08T03:48:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:35 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T03:48:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:35 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T03:48:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:35 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:48:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 254.393519 secs 2023-05-08T03:48:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:37 smithi133 ceph-mon[125939]: pgmap v202: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 19 KiB/s wr, 7 op/s 2023-05-08T03:48:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:37 smithi096 ceph-mon[124666]: pgmap v202: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 19 KiB/s wr, 7 op/s 2023-05-08T03:48:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:37 smithi186 ceph-mon[126480]: pgmap v202: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 19 KiB/s wr, 7 op/s 2023-05-08T03:48:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 257.564637 secs 2023-05-08T03:48:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:38 smithi186 ceph-mon[126480]: pgmap v203: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 19 KiB/s wr, 7 op/s 2023-05-08T03:48:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:38 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T03:48:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:38 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:48:38.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 258.116850 secs 2023-05-08T03:48:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 257.564637 secs 2023-05-08T03:48:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:38 smithi133 ceph-mon[125939]: pgmap v203: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 19 KiB/s wr, 7 op/s 2023-05-08T03:48:38.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:38 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T03:48:38.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:38 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:48:38.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 258.116850 secs 2023-05-08T03:48:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 257.564637 secs 2023-05-08T03:48:39.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:38 smithi096 ceph-mon[124666]: pgmap v203: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 19 KiB/s wr, 7 op/s 2023-05-08T03:48:39.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:38 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T03:48:39.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:38 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:48:39.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 258.116850 secs 2023-05-08T03:48:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 259.393651 secs 2023-05-08T03:48:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 259.393651 secs 2023-05-08T03:48:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 259.393651 secs 2023-05-08T03:48:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:40 smithi186 ceph-mon[126480]: pgmap v204: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 22 KiB/s wr, 11 op/s 2023-05-08T03:48:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:40 smithi133 ceph-mon[125939]: pgmap v204: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 22 KiB/s wr, 11 op/s 2023-05-08T03:48:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:40 smithi096 ceph-mon[124666]: pgmap v204: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 22 KiB/s wr, 11 op/s 2023-05-08T03:48:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:43 smithi133 ceph-mon[125939]: pgmap v205: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 7 op/s 2023-05-08T03:48:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:43 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T03:48:43.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 262.564729 secs 2023-05-08T03:48:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:43 smithi096 ceph-mon[124666]: pgmap v205: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 7 op/s 2023-05-08T03:48:43.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:43 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T03:48:43.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 262.564729 secs 2023-05-08T03:48:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:43 smithi186 ceph-mon[126480]: pgmap v205: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 7 op/s 2023-05-08T03:48:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:43 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T03:48:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 262.564729 secs 2023-05-08T03:48:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 263.116975 secs 2023-05-08T03:48:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 263.116975 secs 2023-05-08T03:48:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 263.116975 secs 2023-05-08T03:48:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:45 smithi133 ceph-mon[125939]: pgmap v206: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 9 op/s 2023-05-08T03:48:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 264.393769 secs 2023-05-08T03:48:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:45 smithi096 ceph-mon[124666]: pgmap v206: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 9 op/s 2023-05-08T03:48:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 264.393769 secs 2023-05-08T03:48:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:45 smithi186 ceph-mon[126480]: pgmap v206: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 9 op/s 2023-05-08T03:48:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 264.393769 secs 2023-05-08T03:48:47.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:47 smithi133 ceph-mon[125939]: pgmap v207: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.4 KiB/s wr, 6 op/s 2023-05-08T03:48:47.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:47 smithi096 ceph-mon[124666]: pgmap v207: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.4 KiB/s wr, 6 op/s 2023-05-08T03:48:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:47 smithi186 ceph-mon[126480]: pgmap v207: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.4 KiB/s wr, 6 op/s 2023-05-08T03:48:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 267.564854 secs 2023-05-08T03:48:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:48 smithi186 ceph-mon[126480]: pgmap v208: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.3 KiB/s wr, 5 op/s 2023-05-08T03:48:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 268.117093 secs 2023-05-08T03:48:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 267.564854 secs 2023-05-08T03:48:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:48 smithi133 ceph-mon[125939]: pgmap v208: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.3 KiB/s wr, 5 op/s 2023-05-08T03:48:48.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 268.117093 secs 2023-05-08T03:48:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 267.564854 secs 2023-05-08T03:48:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:48 smithi096 ceph-mon[124666]: pgmap v208: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.3 KiB/s wr, 5 op/s 2023-05-08T03:48:49.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 268.117093 secs 2023-05-08T03:48:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 269.393883 secs 2023-05-08T03:48:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 269.393883 secs 2023-05-08T03:48:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 269.393883 secs 2023-05-08T03:48:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:50 smithi186 ceph-mon[126480]: pgmap v209: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 3.3 KiB/s wr, 8 op/s 2023-05-08T03:48:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:50 smithi133 ceph-mon[125939]: pgmap v209: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 3.3 KiB/s wr, 8 op/s 2023-05-08T03:48:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:50 smithi096 ceph-mon[124666]: pgmap v209: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 3.3 KiB/s wr, 8 op/s 2023-05-08T03:48:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:53 smithi133 ceph-mon[125939]: pgmap v210: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T03:48:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 272.564947 secs 2023-05-08T03:48:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:53 smithi096 ceph-mon[124666]: pgmap v210: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T03:48:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 272.564947 secs 2023-05-08T03:48:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:53 smithi186 ceph-mon[126480]: pgmap v210: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T03:48:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 272.564947 secs 2023-05-08T03:48:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 273.117173 secs 2023-05-08T03:48:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 273.117173 secs 2023-05-08T03:48:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 273.117173 secs 2023-05-08T03:48:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:55 smithi133 ceph-mon[125939]: pgmap v211: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T03:48:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 274.393962 secs 2023-05-08T03:48:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:55 smithi096 ceph-mon[124666]: pgmap v211: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T03:48:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 274.393962 secs 2023-05-08T03:48:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:55 smithi186 ceph-mon[126480]: pgmap v211: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T03:48:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 274.393962 secs 2023-05-08T03:48:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:57 smithi133 ceph-mon[125939]: pgmap v212: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:48:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:57 smithi096 ceph-mon[124666]: pgmap v212: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:48:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:57 smithi186 ceph-mon[126480]: pgmap v212: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:48:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 277.565067 secs 2023-05-08T03:48:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:58 smithi186 ceph-mon[126480]: pgmap v213: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:48:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 278.117249 secs 2023-05-08T03:48:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 277.565067 secs 2023-05-08T03:48:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:58 smithi133 ceph-mon[125939]: pgmap v213: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:48:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 278.117249 secs 2023-05-08T03:48:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 277.565067 secs 2023-05-08T03:48:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:58 smithi096 ceph-mon[124666]: pgmap v213: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:48:59.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 278.117249 secs 2023-05-08T03:49:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:48:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 279.394024 secs 2023-05-08T03:49:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:48:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 279.394024 secs 2023-05-08T03:49:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:48:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 279.394024 secs 2023-05-08T03:49:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:00 smithi186 ceph-mon[126480]: pgmap v214: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T03:49:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:00 smithi133 ceph-mon[125939]: pgmap v214: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T03:49:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:00 smithi096 ceph-mon[124666]: pgmap v214: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T03:49:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:03 smithi133 ceph-mon[125939]: pgmap v215: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:49:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 282.565201 secs 2023-05-08T03:49:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:03 smithi096 ceph-mon[124666]: pgmap v215: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:49:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 282.565201 secs 2023-05-08T03:49:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:03 smithi186 ceph-mon[126480]: pgmap v215: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:49:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 282.565201 secs 2023-05-08T03:49:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 283.117366 secs 2023-05-08T03:49:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 283.117366 secs 2023-05-08T03:49:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 283.117366 secs 2023-05-08T03:49:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:05 smithi133 ceph-mon[125939]: pgmap v216: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T03:49:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 284.394100 secs 2023-05-08T03:49:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:05 smithi096 ceph-mon[124666]: pgmap v216: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T03:49:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 284.394100 secs 2023-05-08T03:49:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:05 smithi186 ceph-mon[126480]: pgmap v216: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T03:49:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 284.394100 secs 2023-05-08T03:49:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:07 smithi133 ceph-mon[125939]: pgmap v217: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T03:49:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:07 smithi096 ceph-mon[124666]: pgmap v217: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T03:49:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:07 smithi186 ceph-mon[126480]: pgmap v217: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T03:49:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 287.565323 secs 2023-05-08T03:49:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:08 smithi186 ceph-mon[126480]: pgmap v218: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T03:49:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 288.117495 secs 2023-05-08T03:49:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 287.565323 secs 2023-05-08T03:49:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:08 smithi133 ceph-mon[125939]: pgmap v218: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T03:49:08.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 288.117495 secs 2023-05-08T03:49:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 287.565323 secs 2023-05-08T03:49:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:08 smithi096 ceph-mon[124666]: pgmap v218: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T03:49:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 288.117495 secs 2023-05-08T03:49:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 289.394235 secs 2023-05-08T03:49:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:10 smithi133 ceph-mon[125939]: osdmap e96: 12 total, 12 up, 12 in 2023-05-08T03:49:10.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:10 smithi133 ceph-mon[125939]: pgmap v220: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T03:49:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 289.394235 secs 2023-05-08T03:49:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:10 smithi096 ceph-mon[124666]: osdmap e96: 12 total, 12 up, 12 in 2023-05-08T03:49:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:10 smithi096 ceph-mon[124666]: pgmap v220: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T03:49:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 289.394235 secs 2023-05-08T03:49:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:10 smithi186 ceph-mon[126480]: osdmap e96: 12 total, 12 up, 12 in 2023-05-08T03:49:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:10 smithi186 ceph-mon[126480]: pgmap v220: 97 pgs: 97 active+clean; 7.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T03:49:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:13 smithi133 ceph-mon[125939]: pgmap v221: 97 pgs: 97 active+clean; 7.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T03:49:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 292.565441 secs 2023-05-08T03:49:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:13 smithi096 ceph-mon[124666]: pgmap v221: 97 pgs: 97 active+clean; 7.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T03:49:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 292.565441 secs 2023-05-08T03:49:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:13 smithi186 ceph-mon[126480]: pgmap v221: 97 pgs: 97 active+clean; 7.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T03:49:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 292.565441 secs 2023-05-08T03:49:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 293.117611 secs 2023-05-08T03:49:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 293.117611 secs 2023-05-08T03:49:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 293.117611 secs 2023-05-08T03:49:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:15 smithi133 ceph-mon[125939]: pgmap v222: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:49:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 294.394374 secs 2023-05-08T03:49:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:15 smithi096 ceph-mon[124666]: pgmap v222: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:49:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 294.394374 secs 2023-05-08T03:49:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:15 smithi186 ceph-mon[126480]: pgmap v222: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:49:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 294.394374 secs 2023-05-08T03:49:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:17 smithi133 ceph-mon[125939]: pgmap v223: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:49:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:17 smithi096 ceph-mon[124666]: pgmap v223: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:49:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:17 smithi186 ceph-mon[126480]: pgmap v223: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:49:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:18 smithi186 ceph-mon[126480]: osdmap e97: 12 total, 12 up, 12 in 2023-05-08T03:49:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 297.565597 secs 2023-05-08T03:49:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:18 smithi186 ceph-mon[126480]: pgmap v225: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 121 B/s wr, 4 op/s 2023-05-08T03:49:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 298.117729 secs 2023-05-08T03:49:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:18 smithi133 ceph-mon[125939]: osdmap e97: 12 total, 12 up, 12 in 2023-05-08T03:49:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 297.565597 secs 2023-05-08T03:49:18.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:18 smithi133 ceph-mon[125939]: pgmap v225: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 121 B/s wr, 4 op/s 2023-05-08T03:49:18.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 298.117729 secs 2023-05-08T03:49:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:18 smithi096 ceph-mon[124666]: osdmap e97: 12 total, 12 up, 12 in 2023-05-08T03:49:19.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 297.565597 secs 2023-05-08T03:49:19.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:18 smithi096 ceph-mon[124666]: pgmap v225: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 121 B/s wr, 4 op/s 2023-05-08T03:49:19.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 298.117729 secs 2023-05-08T03:49:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 299.394489 secs 2023-05-08T03:49:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 299.394489 secs 2023-05-08T03:49:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 299.394489 secs 2023-05-08T03:49:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:20 smithi186 ceph-mon[126480]: pgmap v226: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:49:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:20 smithi133 ceph-mon[125939]: pgmap v226: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:49:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:20 smithi096 ceph-mon[124666]: pgmap v226: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:49:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:23 smithi133 ceph-mon[125939]: pgmap v227: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:49:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 302.565708 secs 2023-05-08T03:49:23.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:23 smithi096 ceph-mon[124666]: pgmap v227: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:49:23.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 302.565708 secs 2023-05-08T03:49:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:23 smithi186 ceph-mon[126480]: pgmap v227: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:49:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 302.565708 secs 2023-05-08T03:49:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 303.117831 secs 2023-05-08T03:49:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 303.117831 secs 2023-05-08T03:49:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 303.117831 secs 2023-05-08T03:49:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:25 smithi133 ceph-mon[125939]: pgmap v228: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T03:49:25.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 304.394594 secs 2023-05-08T03:49:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:25 smithi096 ceph-mon[124666]: pgmap v228: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T03:49:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 304.394594 secs 2023-05-08T03:49:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:25 smithi186 ceph-mon[126480]: pgmap v228: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T03:49:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 304.394594 secs 2023-05-08T03:49:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:27 smithi133 ceph-mon[125939]: pgmap v229: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T03:49:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:27 smithi096 ceph-mon[124666]: pgmap v229: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T03:49:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:27 smithi186 ceph-mon[126480]: pgmap v229: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T03:49:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 307.565818 secs 2023-05-08T03:49:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:28 smithi186 ceph-mon[126480]: pgmap v230: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T03:49:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 308.117970 secs 2023-05-08T03:49:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 307.565818 secs 2023-05-08T03:49:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:28 smithi133 ceph-mon[125939]: pgmap v230: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T03:49:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 308.117970 secs 2023-05-08T03:49:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 307.565818 secs 2023-05-08T03:49:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:28 smithi096 ceph-mon[124666]: pgmap v230: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T03:49:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 308.117970 secs 2023-05-08T03:49:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:29 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:49:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:29 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:49:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:29 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:49:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:29 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:49:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:29 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:49:29.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:29 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T03:49:29.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:29 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T03:49:29.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:29 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:49:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:29 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:49:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:29 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:49:29.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:29 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:49:29.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:29 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:49:29.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:29 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:49:29.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:29 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T03:49:29.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:29 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T03:49:29.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:29 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:49:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:29 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:49:30.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:29 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:49:30.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:29 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:49:30.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:29 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:49:30.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:29 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:49:30.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:29 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T03:49:30.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:29 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T03:49:30.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:29 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:49:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:30 smithi186 ceph-mon[126480]: pgmap v231: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 7.3 KiB/s wr, 8 op/s 2023-05-08T03:49:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:30 smithi133 ceph-mon[125939]: pgmap v231: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 7.3 KiB/s wr, 8 op/s 2023-05-08T03:49:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:30 smithi096 ceph-mon[124666]: pgmap v231: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 7.3 KiB/s wr, 8 op/s 2023-05-08T03:49:33.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:33 smithi133 ceph-mon[125939]: pgmap v232: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.2 KiB/s wr, 5 op/s 2023-05-08T03:49:33.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 312.565900 secs 2023-05-08T03:49:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:33 smithi096 ceph-mon[124666]: pgmap v232: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.2 KiB/s wr, 5 op/s 2023-05-08T03:49:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 312.565900 secs 2023-05-08T03:49:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:33 smithi186 ceph-mon[126480]: pgmap v232: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.2 KiB/s wr, 5 op/s 2023-05-08T03:49:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 312.565900 secs 2023-05-08T03:49:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:34 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T03:49:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 313.118086 secs 2023-05-08T03:49:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:34 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T03:49:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 313.118086 secs 2023-05-08T03:49:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:34 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T03:49:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 313.118086 secs 2023-05-08T03:49:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:35 smithi133 ceph-mon[125939]: pgmap v233: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 21 KiB/s wr, 10 op/s 2023-05-08T03:49:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:35 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T03:49:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:35 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T03:49:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:35 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:49:35.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 314.394819 secs 2023-05-08T03:49:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:35 smithi096 ceph-mon[124666]: pgmap v233: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 21 KiB/s wr, 10 op/s 2023-05-08T03:49:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:35 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T03:49:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:35 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T03:49:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:35 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:49:35.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 314.394819 secs 2023-05-08T03:49:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:35 smithi186 ceph-mon[126480]: pgmap v233: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 21 KiB/s wr, 10 op/s 2023-05-08T03:49:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:35 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T03:49:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:35 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T03:49:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:35 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:49:35.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 314.394819 secs 2023-05-08T03:49:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:37 smithi133 ceph-mon[125939]: pgmap v234: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 21 KiB/s wr, 7 op/s 2023-05-08T03:49:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:37 smithi096 ceph-mon[124666]: pgmap v234: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 21 KiB/s wr, 7 op/s 2023-05-08T03:49:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:37 smithi186 ceph-mon[126480]: pgmap v234: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 21 KiB/s wr, 7 op/s 2023-05-08T03:49:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 317.566041 secs 2023-05-08T03:49:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:38 smithi186 ceph-mon[126480]: pgmap v235: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 21 KiB/s wr, 7 op/s 2023-05-08T03:49:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:38 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T03:49:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:38 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:49:38.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 318.118139 secs 2023-05-08T03:49:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 317.566041 secs 2023-05-08T03:49:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:38 smithi133 ceph-mon[125939]: pgmap v235: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 21 KiB/s wr, 7 op/s 2023-05-08T03:49:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:38 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T03:49:38.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:38 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:49:38.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 318.118139 secs 2023-05-08T03:49:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 317.566041 secs 2023-05-08T03:49:39.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:38 smithi096 ceph-mon[124666]: pgmap v235: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 21 KiB/s wr, 7 op/s 2023-05-08T03:49:39.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:38 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T03:49:39.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:38 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:49:39.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 318.118139 secs 2023-05-08T03:49:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 319.394929 secs 2023-05-08T03:49:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 319.394929 secs 2023-05-08T03:49:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 319.394929 secs 2023-05-08T03:49:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:40 smithi186 ceph-mon[126480]: pgmap v236: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 24 KiB/s wr, 11 op/s 2023-05-08T03:49:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:40 smithi133 ceph-mon[125939]: pgmap v236: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 24 KiB/s wr, 11 op/s 2023-05-08T03:49:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:40 smithi096 ceph-mon[124666]: pgmap v236: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 24 KiB/s wr, 11 op/s 2023-05-08T03:49:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:43 smithi133 ceph-mon[125939]: pgmap v237: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 17 KiB/s wr, 7 op/s 2023-05-08T03:49:43.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:43 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T03:49:43.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 322.566164 secs 2023-05-08T03:49:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:43 smithi096 ceph-mon[124666]: pgmap v237: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 17 KiB/s wr, 7 op/s 2023-05-08T03:49:43.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:43 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T03:49:43.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 322.566164 secs 2023-05-08T03:49:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:43 smithi186 ceph-mon[126480]: pgmap v237: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 17 KiB/s wr, 7 op/s 2023-05-08T03:49:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:43 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T03:49:43.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 322.566164 secs 2023-05-08T03:49:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 323.118287 secs 2023-05-08T03:49:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 323.118287 secs 2023-05-08T03:49:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 323.118287 secs 2023-05-08T03:49:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:45 smithi133 ceph-mon[125939]: pgmap v238: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 10 op/s 2023-05-08T03:49:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 324.395072 secs 2023-05-08T03:49:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:45 smithi096 ceph-mon[124666]: pgmap v238: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 10 op/s 2023-05-08T03:49:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 324.395072 secs 2023-05-08T03:49:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:45 smithi186 ceph-mon[126480]: pgmap v238: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 10 op/s 2023-05-08T03:49:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 324.395072 secs 2023-05-08T03:49:47.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:47 smithi133 ceph-mon[125939]: pgmap v239: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 3.2 KiB/s wr, 5 op/s 2023-05-08T03:49:47.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:47 smithi096 ceph-mon[124666]: pgmap v239: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 3.2 KiB/s wr, 5 op/s 2023-05-08T03:49:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:47 smithi186 ceph-mon[126480]: pgmap v239: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 3.2 KiB/s wr, 5 op/s 2023-05-08T03:49:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 327.566302 secs 2023-05-08T03:49:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:48 smithi186 ceph-mon[126480]: pgmap v240: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 3.2 KiB/s wr, 5 op/s 2023-05-08T03:49:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 328.118410 secs 2023-05-08T03:49:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 327.566302 secs 2023-05-08T03:49:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:48 smithi133 ceph-mon[125939]: pgmap v240: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 3.2 KiB/s wr, 5 op/s 2023-05-08T03:49:48.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 328.118410 secs 2023-05-08T03:49:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 327.566302 secs 2023-05-08T03:49:49.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:48 smithi096 ceph-mon[124666]: pgmap v240: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 3.2 KiB/s wr, 5 op/s 2023-05-08T03:49:49.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 328.118410 secs 2023-05-08T03:49:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 329.395185 secs 2023-05-08T03:49:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 329.395185 secs 2023-05-08T03:49:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 329.395185 secs 2023-05-08T03:49:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:50 smithi186 ceph-mon[126480]: pgmap v241: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.2 KiB/s wr, 8 op/s 2023-05-08T03:49:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:50 smithi133 ceph-mon[125939]: pgmap v241: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.2 KiB/s wr, 8 op/s 2023-05-08T03:49:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:50 smithi096 ceph-mon[124666]: pgmap v241: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.2 KiB/s wr, 8 op/s 2023-05-08T03:49:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:53 smithi133 ceph-mon[125939]: pgmap v242: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:49:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 332.566421 secs 2023-05-08T03:49:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:53 smithi096 ceph-mon[124666]: pgmap v242: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:49:53.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 332.566421 secs 2023-05-08T03:49:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:53 smithi186 ceph-mon[126480]: pgmap v242: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:49:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 332.566421 secs 2023-05-08T03:49:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 333.118547 secs 2023-05-08T03:49:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 333.118547 secs 2023-05-08T03:49:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 333.118547 secs 2023-05-08T03:49:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:55 smithi133 ceph-mon[125939]: pgmap v243: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T03:49:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 334.395320 secs 2023-05-08T03:49:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:55 smithi096 ceph-mon[124666]: pgmap v243: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T03:49:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 334.395320 secs 2023-05-08T03:49:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:55 smithi186 ceph-mon[126480]: pgmap v243: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T03:49:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 334.395320 secs 2023-05-08T03:49:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:57 smithi133 ceph-mon[125939]: pgmap v244: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:49:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:57 smithi096 ceph-mon[124666]: pgmap v244: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:49:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:57 smithi186 ceph-mon[126480]: pgmap v244: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:49:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 337.566538 secs 2023-05-08T03:49:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:58 smithi186 ceph-mon[126480]: pgmap v245: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:49:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 338.118667 secs 2023-05-08T03:49:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 337.566538 secs 2023-05-08T03:49:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:58 smithi133 ceph-mon[125939]: pgmap v245: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:49:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 338.118667 secs 2023-05-08T03:49:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 337.566538 secs 2023-05-08T03:49:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:58 smithi096 ceph-mon[124666]: pgmap v245: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:49:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 338.118667 secs 2023-05-08T03:50:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:49:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 339.395442 secs 2023-05-08T03:50:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:49:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 339.395442 secs 2023-05-08T03:50:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:49:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 339.395442 secs 2023-05-08T03:50:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:00 smithi186 ceph-mon[126480]: Health detail: HEALTH_WARN 3 MDSs report slow requests 2023-05-08T03:50:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:00 smithi186 ceph-mon[126480]: [WRN] MDS_SLOW_REQUEST: 3 MDSs report slow requests 2023-05-08T03:50:01.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:00 smithi186 ceph-mon[126480]: mds.c(mds.2): 1 slow requests are blocked > 180 secs 2023-05-08T03:50:01.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:00 smithi186 ceph-mon[126480]: mds.i(mds.1): 1 slow requests are blocked > 180 secs 2023-05-08T03:50:01.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:00 smithi186 ceph-mon[126480]: mds.b(mds.0): 1 slow requests are blocked > 180 secs 2023-05-08T03:50:01.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:00 smithi186 ceph-mon[126480]: pgmap v246: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T03:50:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:00 smithi133 ceph-mon[125939]: Health detail: HEALTH_WARN 3 MDSs report slow requests 2023-05-08T03:50:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:00 smithi133 ceph-mon[125939]: [WRN] MDS_SLOW_REQUEST: 3 MDSs report slow requests 2023-05-08T03:50:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:00 smithi133 ceph-mon[125939]: mds.c(mds.2): 1 slow requests are blocked > 180 secs 2023-05-08T03:50:01.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:00 smithi133 ceph-mon[125939]: mds.i(mds.1): 1 slow requests are blocked > 180 secs 2023-05-08T03:50:01.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:00 smithi133 ceph-mon[125939]: mds.b(mds.0): 1 slow requests are blocked > 180 secs 2023-05-08T03:50:01.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:00 smithi133 ceph-mon[125939]: pgmap v246: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T03:50:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:00 smithi096 ceph-mon[124666]: Health detail: HEALTH_WARN 3 MDSs report slow requests 2023-05-08T03:50:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:00 smithi096 ceph-mon[124666]: [WRN] MDS_SLOW_REQUEST: 3 MDSs report slow requests 2023-05-08T03:50:01.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:00 smithi096 ceph-mon[124666]: mds.c(mds.2): 1 slow requests are blocked > 180 secs 2023-05-08T03:50:01.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:00 smithi096 ceph-mon[124666]: mds.i(mds.1): 1 slow requests are blocked > 180 secs 2023-05-08T03:50:01.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:00 smithi096 ceph-mon[124666]: mds.b(mds.0): 1 slow requests are blocked > 180 secs 2023-05-08T03:50:01.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:00 smithi096 ceph-mon[124666]: pgmap v246: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T03:50:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:03 smithi133 ceph-mon[125939]: pgmap v247: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:50:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 342.566655 secs 2023-05-08T03:50:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:03 smithi096 ceph-mon[124666]: pgmap v247: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:50:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 342.566655 secs 2023-05-08T03:50:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:03 smithi186 ceph-mon[126480]: pgmap v247: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:50:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 342.566655 secs 2023-05-08T03:50:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 343.118778 secs 2023-05-08T03:50:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 343.118778 secs 2023-05-08T03:50:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 343.118778 secs 2023-05-08T03:50:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:05 smithi133 ceph-mon[125939]: pgmap v248: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T03:50:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 344.395578 secs 2023-05-08T03:50:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:05 smithi096 ceph-mon[124666]: pgmap v248: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T03:50:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 344.395578 secs 2023-05-08T03:50:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:05 smithi186 ceph-mon[126480]: pgmap v248: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T03:50:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 344.395578 secs 2023-05-08T03:50:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:07 smithi133 ceph-mon[125939]: pgmap v249: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T03:50:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:07 smithi096 ceph-mon[124666]: pgmap v249: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T03:50:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:07 smithi186 ceph-mon[126480]: pgmap v249: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T03:50:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 347.566769 secs 2023-05-08T03:50:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:08 smithi186 ceph-mon[126480]: pgmap v250: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T03:50:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 348.118892 secs 2023-05-08T03:50:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 347.566769 secs 2023-05-08T03:50:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:08 smithi133 ceph-mon[125939]: pgmap v250: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T03:50:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 348.118892 secs 2023-05-08T03:50:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 347.566769 secs 2023-05-08T03:50:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:08 smithi096 ceph-mon[124666]: pgmap v250: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T03:50:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 348.118892 secs 2023-05-08T03:50:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 349.395707 secs 2023-05-08T03:50:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:10 smithi133 ceph-mon[125939]: osdmap e98: 12 total, 12 up, 12 in 2023-05-08T03:50:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:10 smithi133 ceph-mon[125939]: pgmap v252: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T03:50:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 349.395707 secs 2023-05-08T03:50:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:10 smithi096 ceph-mon[124666]: osdmap e98: 12 total, 12 up, 12 in 2023-05-08T03:50:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:10 smithi096 ceph-mon[124666]: pgmap v252: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T03:50:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 349.395707 secs 2023-05-08T03:50:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:10 smithi186 ceph-mon[126480]: osdmap e98: 12 total, 12 up, 12 in 2023-05-08T03:50:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:10 smithi186 ceph-mon[126480]: pgmap v252: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T03:50:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:13 smithi133 ceph-mon[125939]: pgmap v253: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T03:50:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 352.566890 secs 2023-05-08T03:50:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:13 smithi096 ceph-mon[124666]: pgmap v253: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T03:50:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 352.566890 secs 2023-05-08T03:50:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:13 smithi186 ceph-mon[126480]: pgmap v253: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T03:50:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 352.566890 secs 2023-05-08T03:50:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 353.119008 secs 2023-05-08T03:50:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 353.119008 secs 2023-05-08T03:50:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 353.119008 secs 2023-05-08T03:50:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:15 smithi133 ceph-mon[125939]: pgmap v254: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:50:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 354.395824 secs 2023-05-08T03:50:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:15 smithi096 ceph-mon[124666]: pgmap v254: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:50:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 354.395824 secs 2023-05-08T03:50:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:15 smithi186 ceph-mon[126480]: pgmap v254: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:50:15.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 354.395824 secs 2023-05-08T03:50:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:17 smithi133 ceph-mon[125939]: pgmap v255: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:50:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:17 smithi096 ceph-mon[124666]: pgmap v255: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:50:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:17 smithi186 ceph-mon[126480]: pgmap v255: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:50:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:18 smithi186 ceph-mon[126480]: osdmap e99: 12 total, 12 up, 12 in 2023-05-08T03:50:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 357.566991 secs 2023-05-08T03:50:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:18 smithi186 ceph-mon[126480]: pgmap v257: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 121 B/s wr, 4 op/s 2023-05-08T03:50:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 358.119144 secs 2023-05-08T03:50:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:18 smithi133 ceph-mon[125939]: osdmap e99: 12 total, 12 up, 12 in 2023-05-08T03:50:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 357.566991 secs 2023-05-08T03:50:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:18 smithi133 ceph-mon[125939]: pgmap v257: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 121 B/s wr, 4 op/s 2023-05-08T03:50:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 358.119144 secs 2023-05-08T03:50:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:18 smithi096 ceph-mon[124666]: osdmap e99: 12 total, 12 up, 12 in 2023-05-08T03:50:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 357.566991 secs 2023-05-08T03:50:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:18 smithi096 ceph-mon[124666]: pgmap v257: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 121 B/s wr, 4 op/s 2023-05-08T03:50:19.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 358.119144 secs 2023-05-08T03:50:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 359.395944 secs 2023-05-08T03:50:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 359.395944 secs 2023-05-08T03:50:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 359.395944 secs 2023-05-08T03:50:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:20 smithi186 ceph-mon[126480]: pgmap v258: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:50:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:20 smithi133 ceph-mon[125939]: pgmap v258: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:50:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:20 smithi096 ceph-mon[124666]: pgmap v258: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:50:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:23 smithi133 ceph-mon[125939]: pgmap v259: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:50:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:23 smithi133 ceph-mon[125939]: 1 slow requests, 1 included below; oldest blocked for > 362.567115 secs 2023-05-08T03:50:23.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:23 smithi133 ceph-mon[125939]: slow request 362.567115 seconds old, received at 2023-05-08T03:44:20.260233+0000: client_request(client.15258:3163 link #0x10000000007/0000000100000000000000F2 #0x10000000007/0000000100000000000000C5 2023-05-08T03:44:20.259302+0000 caller_uid=26, caller_gid=26{26,}) currently acquired locks 2023-05-08T03:50:23.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:23 smithi096 ceph-mon[124666]: pgmap v259: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:50:23.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:23 smithi096 ceph-mon[124666]: 1 slow requests, 1 included below; oldest blocked for > 362.567115 secs 2023-05-08T03:50:23.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:23 smithi096 ceph-mon[124666]: slow request 362.567115 seconds old, received at 2023-05-08T03:44:20.260233+0000: client_request(client.15258:3163 link #0x10000000007/0000000100000000000000F2 #0x10000000007/0000000100000000000000C5 2023-05-08T03:44:20.259302+0000 caller_uid=26, caller_gid=26{26,}) currently acquired locks 2023-05-08T03:50:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:23 smithi186 ceph-mon[126480]: pgmap v259: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:50:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:23 smithi186 ceph-mon[126480]: 1 slow requests, 1 included below; oldest blocked for > 362.567115 secs 2023-05-08T03:50:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:23 smithi186 ceph-mon[126480]: slow request 362.567115 seconds old, received at 2023-05-08T03:44:20.260233+0000: client_request(client.15258:3163 link #0x10000000007/0000000100000000000000F2 #0x10000000007/0000000100000000000000C5 2023-05-08T03:44:20.259302+0000 caller_uid=26, caller_gid=26{26,}) currently acquired locks 2023-05-08T03:50:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:24 smithi133 ceph-mon[125939]: 1 slow requests, 1 included below; oldest blocked for > 363.119263 secs 2023-05-08T03:50:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:24 smithi133 ceph-mon[125939]: slow request 363.119262 seconds old, received at 2023-05-08T03:44:20.272100+0000: peer_request:client.15258:3163 currently acquired locks 2023-05-08T03:50:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:24 smithi096 ceph-mon[124666]: 1 slow requests, 1 included below; oldest blocked for > 363.119263 secs 2023-05-08T03:50:24.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:24 smithi096 ceph-mon[124666]: slow request 363.119262 seconds old, received at 2023-05-08T03:44:20.272100+0000: peer_request:client.15258:3163 currently acquired locks 2023-05-08T03:50:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:24 smithi186 ceph-mon[126480]: 1 slow requests, 1 included below; oldest blocked for > 363.119263 secs 2023-05-08T03:50:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:24 smithi186 ceph-mon[126480]: slow request 363.119262 seconds old, received at 2023-05-08T03:44:20.272100+0000: peer_request:client.15258:3163 currently acquired locks 2023-05-08T03:50:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:25 smithi133 ceph-mon[125939]: pgmap v260: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T03:50:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:25 smithi133 ceph-mon[125939]: 1 slow requests, 1 included below; oldest blocked for > 364.396042 secs 2023-05-08T03:50:25.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:25 smithi133 ceph-mon[125939]: slow request 364.396041 seconds old, received at 2023-05-08T03:44:20.261840+0000: peer_request:client.15258:3163 currently dispatched 2023-05-08T03:50:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:25 smithi096 ceph-mon[124666]: pgmap v260: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T03:50:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:25 smithi096 ceph-mon[124666]: 1 slow requests, 1 included below; oldest blocked for > 364.396042 secs 2023-05-08T03:50:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:25 smithi096 ceph-mon[124666]: slow request 364.396041 seconds old, received at 2023-05-08T03:44:20.261840+0000: peer_request:client.15258:3163 currently dispatched 2023-05-08T03:50:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:25 smithi186 ceph-mon[126480]: pgmap v260: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T03:50:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:25 smithi186 ceph-mon[126480]: 1 slow requests, 1 included below; oldest blocked for > 364.396042 secs 2023-05-08T03:50:25.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:25 smithi186 ceph-mon[126480]: slow request 364.396041 seconds old, received at 2023-05-08T03:44:20.261840+0000: peer_request:client.15258:3163 currently dispatched 2023-05-08T03:50:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:27 smithi133 ceph-mon[125939]: pgmap v261: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T03:50:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:27 smithi096 ceph-mon[124666]: pgmap v261: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T03:50:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:27 smithi186 ceph-mon[126480]: pgmap v261: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T03:50:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 367.567180 secs 2023-05-08T03:50:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:28 smithi186 ceph-mon[126480]: pgmap v262: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T03:50:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 368.119379 secs 2023-05-08T03:50:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 367.567180 secs 2023-05-08T03:50:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:28 smithi133 ceph-mon[125939]: pgmap v262: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T03:50:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 368.119379 secs 2023-05-08T03:50:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 367.567180 secs 2023-05-08T03:50:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:28 smithi096 ceph-mon[124666]: pgmap v262: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T03:50:29.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 368.119379 secs 2023-05-08T03:50:29.914 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:29 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:50:29.916 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:29 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:50:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:29 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:50:30.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:30 smithi133 ceph-mon[125939]: pgmap v263: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.9 KiB/s wr, 8 op/s 2023-05-08T03:50:30.994 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:50:30.994 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:50:30.994 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:30 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:50:30.994 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:50:30.994 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:30 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T03:50:30.994 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:30 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T03:50:30.994 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:30 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:50:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:30 smithi096 ceph-mon[124666]: pgmap v263: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.9 KiB/s wr, 8 op/s 2023-05-08T03:50:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:50:31.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:50:31.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:30 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:50:31.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:50:31.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:30 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T03:50:31.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:30 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T03:50:31.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:30 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:50:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:30 smithi186 ceph-mon[126480]: pgmap v263: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.9 KiB/s wr, 8 op/s 2023-05-08T03:50:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:50:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:50:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:30 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:50:31.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:50:31.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:30 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T03:50:31.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:30 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T03:50:31.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:30 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:50:33.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:33 smithi133 ceph-mon[125939]: pgmap v264: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 7.8 KiB/s wr, 5 op/s 2023-05-08T03:50:33.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 372.567293 secs 2023-05-08T03:50:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:33 smithi096 ceph-mon[124666]: pgmap v264: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 7.8 KiB/s wr, 5 op/s 2023-05-08T03:50:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 372.567293 secs 2023-05-08T03:50:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:33 smithi186 ceph-mon[126480]: pgmap v264: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 7.8 KiB/s wr, 5 op/s 2023-05-08T03:50:33.623 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 372.567293 secs 2023-05-08T03:50:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:34 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T03:50:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 373.119492 secs 2023-05-08T03:50:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:34 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T03:50:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 373.119492 secs 2023-05-08T03:50:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:34 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T03:50:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 373.119492 secs 2023-05-08T03:50:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:35 smithi133 ceph-mon[125939]: pgmap v265: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 22 KiB/s wr, 10 op/s 2023-05-08T03:50:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:35 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T03:50:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:35 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T03:50:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:35 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:50:35.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 374.396227 secs 2023-05-08T03:50:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:35 smithi096 ceph-mon[124666]: pgmap v265: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 22 KiB/s wr, 10 op/s 2023-05-08T03:50:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:35 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T03:50:35.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:35 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T03:50:35.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:35 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:50:35.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 374.396227 secs 2023-05-08T03:50:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:35 smithi186 ceph-mon[126480]: pgmap v265: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 22 KiB/s wr, 10 op/s 2023-05-08T03:50:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:35 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T03:50:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:35 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T03:50:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:35 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:50:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 374.396227 secs 2023-05-08T03:50:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:37 smithi133 ceph-mon[125939]: pgmap v266: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 22 KiB/s wr, 7 op/s 2023-05-08T03:50:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:37 smithi096 ceph-mon[124666]: pgmap v266: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 22 KiB/s wr, 7 op/s 2023-05-08T03:50:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:37 smithi186 ceph-mon[126480]: pgmap v266: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 22 KiB/s wr, 7 op/s 2023-05-08T03:50:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 377.567410 secs 2023-05-08T03:50:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:38 smithi186 ceph-mon[126480]: pgmap v267: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 22 KiB/s wr, 7 op/s 2023-05-08T03:50:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:38 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T03:50:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:38 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:50:38.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 378.119607 secs 2023-05-08T03:50:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 377.567410 secs 2023-05-08T03:50:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:38 smithi133 ceph-mon[125939]: pgmap v267: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 22 KiB/s wr, 7 op/s 2023-05-08T03:50:38.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:38 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T03:50:38.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:38 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:50:38.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 378.119607 secs 2023-05-08T03:50:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 377.567410 secs 2023-05-08T03:50:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:38 smithi096 ceph-mon[124666]: pgmap v267: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 22 KiB/s wr, 7 op/s 2023-05-08T03:50:39.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:38 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T03:50:39.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:38 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:50:39.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 378.119607 secs 2023-05-08T03:50:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 379.396344 secs 2023-05-08T03:50:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 379.396344 secs 2023-05-08T03:50:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 379.396344 secs 2023-05-08T03:50:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:40 smithi186 ceph-mon[126480]: pgmap v268: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 26 KiB/s wr, 11 op/s 2023-05-08T03:50:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:40 smithi133 ceph-mon[125939]: pgmap v268: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 26 KiB/s wr, 11 op/s 2023-05-08T03:50:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:40 smithi096 ceph-mon[124666]: pgmap v268: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 26 KiB/s wr, 11 op/s 2023-05-08T03:50:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:43 smithi133 ceph-mon[125939]: pgmap v269: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 8 op/s 2023-05-08T03:50:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:43 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T03:50:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 382.567527 secs 2023-05-08T03:50:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:43 smithi096 ceph-mon[124666]: pgmap v269: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 8 op/s 2023-05-08T03:50:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:43 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T03:50:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 382.567527 secs 2023-05-08T03:50:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:43 smithi186 ceph-mon[126480]: pgmap v269: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 8 op/s 2023-05-08T03:50:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:43 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T03:50:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 382.567527 secs 2023-05-08T03:50:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 383.119724 secs 2023-05-08T03:50:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 383.119724 secs 2023-05-08T03:50:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 383.119724 secs 2023-05-08T03:50:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:45 smithi133 ceph-mon[125939]: pgmap v270: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 10 op/s 2023-05-08T03:50:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 384.396460 secs 2023-05-08T03:50:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:45 smithi096 ceph-mon[124666]: pgmap v270: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 10 op/s 2023-05-08T03:50:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 384.396460 secs 2023-05-08T03:50:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:45 smithi186 ceph-mon[126480]: pgmap v270: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 10 op/s 2023-05-08T03:50:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 384.396460 secs 2023-05-08T03:50:47.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:47 smithi133 ceph-mon[125939]: pgmap v271: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.1 KiB/s wr, 6 op/s 2023-05-08T03:50:47.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:47 smithi096 ceph-mon[124666]: pgmap v271: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.1 KiB/s wr, 6 op/s 2023-05-08T03:50:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:47 smithi186 ceph-mon[126480]: pgmap v271: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.1 KiB/s wr, 6 op/s 2023-05-08T03:50:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 387.567644 secs 2023-05-08T03:50:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:48 smithi186 ceph-mon[126480]: pgmap v272: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.1 KiB/s wr, 6 op/s 2023-05-08T03:50:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 388.119834 secs 2023-05-08T03:50:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 387.567644 secs 2023-05-08T03:50:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:48 smithi133 ceph-mon[125939]: pgmap v272: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.1 KiB/s wr, 6 op/s 2023-05-08T03:50:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 388.119834 secs 2023-05-08T03:50:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 387.567644 secs 2023-05-08T03:50:49.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:48 smithi096 ceph-mon[124666]: pgmap v272: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.1 KiB/s wr, 6 op/s 2023-05-08T03:50:49.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 388.119834 secs 2023-05-08T03:50:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 389.396576 secs 2023-05-08T03:50:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 389.396576 secs 2023-05-08T03:50:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 389.396576 secs 2023-05-08T03:50:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:50 smithi186 ceph-mon[126480]: pgmap v273: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.1 KiB/s wr, 8 op/s 2023-05-08T03:50:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:50 smithi133 ceph-mon[125939]: pgmap v273: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.1 KiB/s wr, 8 op/s 2023-05-08T03:50:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:50 smithi096 ceph-mon[124666]: pgmap v273: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.1 KiB/s wr, 8 op/s 2023-05-08T03:50:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:53 smithi133 ceph-mon[125939]: pgmap v274: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T03:50:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 392.567766 secs 2023-05-08T03:50:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:53 smithi096 ceph-mon[124666]: pgmap v274: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T03:50:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 392.567766 secs 2023-05-08T03:50:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:53 smithi186 ceph-mon[126480]: pgmap v274: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T03:50:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 392.567766 secs 2023-05-08T03:50:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 393.119943 secs 2023-05-08T03:50:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 393.119943 secs 2023-05-08T03:50:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 393.119943 secs 2023-05-08T03:50:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:55 smithi133 ceph-mon[125939]: pgmap v275: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T03:50:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 394.396715 secs 2023-05-08T03:50:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:55 smithi096 ceph-mon[124666]: pgmap v275: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T03:50:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 394.396715 secs 2023-05-08T03:50:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:55 smithi186 ceph-mon[126480]: pgmap v275: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T03:50:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 394.396715 secs 2023-05-08T03:50:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:57 smithi133 ceph-mon[125939]: pgmap v276: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:50:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:57 smithi096 ceph-mon[124666]: pgmap v276: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:50:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:57 smithi186 ceph-mon[126480]: pgmap v276: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:50:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 397.567882 secs 2023-05-08T03:50:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:58 smithi186 ceph-mon[126480]: pgmap v277: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:50:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 398.120060 secs 2023-05-08T03:50:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 397.567882 secs 2023-05-08T03:50:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:58 smithi133 ceph-mon[125939]: pgmap v277: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:50:58.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 398.120060 secs 2023-05-08T03:50:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 397.567882 secs 2023-05-08T03:50:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:58 smithi096 ceph-mon[124666]: pgmap v277: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:50:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 398.120060 secs 2023-05-08T03:51:00.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:50:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 399.396831 secs 2023-05-08T03:51:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:50:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 399.396831 secs 2023-05-08T03:51:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:50:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 399.396831 secs 2023-05-08T03:51:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:00 smithi186 ceph-mon[126480]: pgmap v278: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T03:51:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:00 smithi133 ceph-mon[125939]: pgmap v278: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T03:51:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:00 smithi096 ceph-mon[124666]: pgmap v278: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T03:51:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:03 smithi133 ceph-mon[125939]: pgmap v279: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:51:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 402.568020 secs 2023-05-08T03:51:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:03 smithi096 ceph-mon[124666]: pgmap v279: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:51:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 402.568020 secs 2023-05-08T03:51:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:03 smithi186 ceph-mon[126480]: pgmap v279: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:51:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 402.568020 secs 2023-05-08T03:51:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 403.120122 secs 2023-05-08T03:51:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 403.120122 secs 2023-05-08T03:51:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 403.120122 secs 2023-05-08T03:51:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:05 smithi133 ceph-mon[125939]: pgmap v280: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T03:51:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 404.396948 secs 2023-05-08T03:51:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:05 smithi096 ceph-mon[124666]: pgmap v280: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T03:51:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 404.396948 secs 2023-05-08T03:51:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:05 smithi186 ceph-mon[126480]: pgmap v280: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T03:51:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 404.396948 secs 2023-05-08T03:51:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:07 smithi133 ceph-mon[125939]: pgmap v281: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T03:51:07.512 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:07 smithi096 ceph-mon[124666]: pgmap v281: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T03:51:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:07 smithi186 ceph-mon[126480]: pgmap v281: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T03:51:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 407.568154 secs 2023-05-08T03:51:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:08 smithi186 ceph-mon[126480]: pgmap v282: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T03:51:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 408.120186 secs 2023-05-08T03:51:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 407.568154 secs 2023-05-08T03:51:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:08 smithi133 ceph-mon[125939]: pgmap v282: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T03:51:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 408.120186 secs 2023-05-08T03:51:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 407.568154 secs 2023-05-08T03:51:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:08 smithi096 ceph-mon[124666]: pgmap v282: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T03:51:09.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 408.120186 secs 2023-05-08T03:51:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 409.397069 secs 2023-05-08T03:51:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:10 smithi133 ceph-mon[125939]: osdmap e100: 12 total, 12 up, 12 in 2023-05-08T03:51:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:10 smithi133 ceph-mon[125939]: pgmap v284: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T03:51:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 409.397069 secs 2023-05-08T03:51:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:10 smithi096 ceph-mon[124666]: osdmap e100: 12 total, 12 up, 12 in 2023-05-08T03:51:11.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:10 smithi096 ceph-mon[124666]: pgmap v284: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T03:51:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 409.397069 secs 2023-05-08T03:51:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:10 smithi186 ceph-mon[126480]: osdmap e100: 12 total, 12 up, 12 in 2023-05-08T03:51:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:10 smithi186 ceph-mon[126480]: pgmap v284: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T03:51:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:13 smithi133 ceph-mon[125939]: pgmap v285: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T03:51:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 412.568272 secs 2023-05-08T03:51:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:13 smithi096 ceph-mon[124666]: pgmap v285: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T03:51:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 412.568272 secs 2023-05-08T03:51:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:13 smithi186 ceph-mon[126480]: pgmap v285: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T03:51:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 412.568272 secs 2023-05-08T03:51:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 413.120277 secs 2023-05-08T03:51:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 413.120277 secs 2023-05-08T03:51:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 413.120277 secs 2023-05-08T03:51:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:15 smithi133 ceph-mon[125939]: pgmap v286: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:51:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 414.397186 secs 2023-05-08T03:51:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:15 smithi096 ceph-mon[124666]: pgmap v286: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:51:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 414.397186 secs 2023-05-08T03:51:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:15 smithi186 ceph-mon[126480]: pgmap v286: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:51:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 414.397186 secs 2023-05-08T03:51:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:17 smithi133 ceph-mon[125939]: pgmap v287: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:51:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:17 smithi096 ceph-mon[124666]: pgmap v287: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:51:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:17 smithi186 ceph-mon[126480]: pgmap v287: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:51:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:18 smithi186 ceph-mon[126480]: osdmap e101: 12 total, 12 up, 12 in 2023-05-08T03:51:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 417.568399 secs 2023-05-08T03:51:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:18 smithi186 ceph-mon[126480]: pgmap v289: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 121 B/s wr, 4 op/s 2023-05-08T03:51:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 418.120399 secs 2023-05-08T03:51:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:18 smithi133 ceph-mon[125939]: osdmap e101: 12 total, 12 up, 12 in 2023-05-08T03:51:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 417.568399 secs 2023-05-08T03:51:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:18 smithi133 ceph-mon[125939]: pgmap v289: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 121 B/s wr, 4 op/s 2023-05-08T03:51:18.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 418.120399 secs 2023-05-08T03:51:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:18 smithi096 ceph-mon[124666]: osdmap e101: 12 total, 12 up, 12 in 2023-05-08T03:51:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 417.568399 secs 2023-05-08T03:51:19.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:18 smithi096 ceph-mon[124666]: pgmap v289: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 121 B/s wr, 4 op/s 2023-05-08T03:51:19.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 418.120399 secs 2023-05-08T03:51:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 419.397305 secs 2023-05-08T03:51:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 419.397305 secs 2023-05-08T03:51:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 419.397305 secs 2023-05-08T03:51:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:20 smithi186 ceph-mon[126480]: pgmap v290: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:51:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:20 smithi133 ceph-mon[125939]: pgmap v290: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:51:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:20 smithi096 ceph-mon[124666]: pgmap v290: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:51:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:23 smithi133 ceph-mon[125939]: pgmap v291: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:51:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 422.568516 secs 2023-05-08T03:51:23.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:23 smithi096 ceph-mon[124666]: pgmap v291: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:51:23.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 422.568516 secs 2023-05-08T03:51:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:23 smithi186 ceph-mon[126480]: pgmap v291: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:51:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 422.568516 secs 2023-05-08T03:51:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 423.120538 secs 2023-05-08T03:51:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 423.120538 secs 2023-05-08T03:51:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 423.120538 secs 2023-05-08T03:51:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:25 smithi133 ceph-mon[125939]: pgmap v292: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T03:51:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 424.397430 secs 2023-05-08T03:51:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:25 smithi096 ceph-mon[124666]: pgmap v292: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T03:51:25.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 424.397430 secs 2023-05-08T03:51:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:25 smithi186 ceph-mon[126480]: pgmap v292: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T03:51:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 424.397430 secs 2023-05-08T03:51:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:27 smithi133 ceph-mon[125939]: pgmap v293: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T03:51:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:27 smithi096 ceph-mon[124666]: pgmap v293: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T03:51:27.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:27 smithi186 ceph-mon[126480]: pgmap v293: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T03:51:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 427.568631 secs 2023-05-08T03:51:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:28 smithi186 ceph-mon[126480]: pgmap v294: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T03:51:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 428.120655 secs 2023-05-08T03:51:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 427.568631 secs 2023-05-08T03:51:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:28 smithi133 ceph-mon[125939]: pgmap v294: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T03:51:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 428.120655 secs 2023-05-08T03:51:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 427.568631 secs 2023-05-08T03:51:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:28 smithi096 ceph-mon[124666]: pgmap v294: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T03:51:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 428.120655 secs 2023-05-08T03:51:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:31 smithi133 ceph-mon[125939]: pgmap v295: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.7 KiB/s wr, 8 op/s 2023-05-08T03:51:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:31 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:51:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:31 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:51:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:31 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:51:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:31 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:51:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:31 smithi096 ceph-mon[124666]: pgmap v295: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.7 KiB/s wr, 8 op/s 2023-05-08T03:51:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:31 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:51:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:31 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:51:31.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:31 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:51:31.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:31 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:51:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:31 smithi186 ceph-mon[126480]: pgmap v295: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.7 KiB/s wr, 8 op/s 2023-05-08T03:51:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:31 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:51:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:31 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:51:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:31 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:51:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:31 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:51:32.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:32 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:51:32.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:32 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T03:51:32.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:32 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T03:51:32.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:32 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:51:32.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:32 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:51:32.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:32 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T03:51:32.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:32 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T03:51:32.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:32 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:51:32.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:32 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:51:32.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:32 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T03:51:32.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:32 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T03:51:32.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:32 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:51:33.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:33 smithi133 ceph-mon[125939]: pgmap v296: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 8.7 KiB/s wr, 5 op/s 2023-05-08T03:51:33.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 432.568786 secs 2023-05-08T03:51:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:33 smithi096 ceph-mon[124666]: pgmap v296: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 8.7 KiB/s wr, 5 op/s 2023-05-08T03:51:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 432.568786 secs 2023-05-08T03:51:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:33 smithi186 ceph-mon[126480]: pgmap v296: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 8.7 KiB/s wr, 5 op/s 2023-05-08T03:51:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 432.568786 secs 2023-05-08T03:51:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:34 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T03:51:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 433.120726 secs 2023-05-08T03:51:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:34 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T03:51:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 433.120726 secs 2023-05-08T03:51:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:34 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T03:51:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 433.120726 secs 2023-05-08T03:51:35.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:35 smithi096 ceph-mon[124666]: pgmap v297: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 24 KiB/s wr, 10 op/s 2023-05-08T03:51:35.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:35 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T03:51:35.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:35 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T03:51:35.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:35 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:51:35.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 434.397661 secs 2023-05-08T03:51:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:35 smithi186 ceph-mon[126480]: pgmap v297: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 24 KiB/s wr, 10 op/s 2023-05-08T03:51:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:35 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T03:51:35.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:35 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T03:51:35.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:35 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:51:35.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 434.397661 secs 2023-05-08T03:51:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:35 smithi133 ceph-mon[125939]: pgmap v297: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 24 KiB/s wr, 10 op/s 2023-05-08T03:51:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:35 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T03:51:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:35 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T03:51:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:35 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:51:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 434.397661 secs 2023-05-08T03:51:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:37 smithi096 ceph-mon[124666]: pgmap v298: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 24 KiB/s wr, 7 op/s 2023-05-08T03:51:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:37 smithi186 ceph-mon[126480]: pgmap v298: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 24 KiB/s wr, 7 op/s 2023-05-08T03:51:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:37 smithi133 ceph-mon[125939]: pgmap v298: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 24 KiB/s wr, 7 op/s 2023-05-08T03:51:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 437.568909 secs 2023-05-08T03:51:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:38 smithi186 ceph-mon[126480]: pgmap v299: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 24 KiB/s wr, 7 op/s 2023-05-08T03:51:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:38 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T03:51:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:38 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:51:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 438.120842 secs 2023-05-08T03:51:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 437.568909 secs 2023-05-08T03:51:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:38 smithi133 ceph-mon[125939]: pgmap v299: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 24 KiB/s wr, 7 op/s 2023-05-08T03:51:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:38 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T03:51:38.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:38 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:51:38.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 438.120842 secs 2023-05-08T03:51:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 437.568909 secs 2023-05-08T03:51:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:38 smithi096 ceph-mon[124666]: pgmap v299: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 24 KiB/s wr, 7 op/s 2023-05-08T03:51:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:38 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T03:51:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:38 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:51:39.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 438.120842 secs 2023-05-08T03:51:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 439.397757 secs 2023-05-08T03:51:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 439.397757 secs 2023-05-08T03:51:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 439.397757 secs 2023-05-08T03:51:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:40 smithi186 ceph-mon[126480]: pgmap v300: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 28 KiB/s wr, 10 op/s 2023-05-08T03:51:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:40 smithi133 ceph-mon[125939]: pgmap v300: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 28 KiB/s wr, 10 op/s 2023-05-08T03:51:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:40 smithi096 ceph-mon[124666]: pgmap v300: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 28 KiB/s wr, 10 op/s 2023-05-08T03:51:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:43 smithi133 ceph-mon[125939]: pgmap v301: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 7 op/s 2023-05-08T03:51:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:43 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T03:51:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 442.569018 secs 2023-05-08T03:51:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:43 smithi096 ceph-mon[124666]: pgmap v301: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 7 op/s 2023-05-08T03:51:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:43 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T03:51:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 442.569018 secs 2023-05-08T03:51:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:43 smithi186 ceph-mon[126480]: pgmap v301: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 7 op/s 2023-05-08T03:51:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:43 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T03:51:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 442.569018 secs 2023-05-08T03:51:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 443.120904 secs 2023-05-08T03:51:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 443.120904 secs 2023-05-08T03:51:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 443.120904 secs 2023-05-08T03:51:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:45 smithi133 ceph-mon[125939]: pgmap v302: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 10 op/s 2023-05-08T03:51:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 444.397882 secs 2023-05-08T03:51:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:45 smithi096 ceph-mon[124666]: pgmap v302: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 10 op/s 2023-05-08T03:51:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 444.397882 secs 2023-05-08T03:51:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:45 smithi186 ceph-mon[126480]: pgmap v302: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 10 op/s 2023-05-08T03:51:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 444.397882 secs 2023-05-08T03:51:47.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:47 smithi096 ceph-mon[124666]: pgmap v303: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 3.7 KiB/s wr, 5 op/s 2023-05-08T03:51:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:47 smithi186 ceph-mon[126480]: pgmap v303: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 3.7 KiB/s wr, 5 op/s 2023-05-08T03:51:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:47 smithi133 ceph-mon[125939]: pgmap v303: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 3.7 KiB/s wr, 5 op/s 2023-05-08T03:51:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 447.569121 secs 2023-05-08T03:51:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:48 smithi186 ceph-mon[126480]: pgmap v304: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 3.7 KiB/s wr, 5 op/s 2023-05-08T03:51:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 448.121039 secs 2023-05-08T03:51:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 447.569121 secs 2023-05-08T03:51:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:48 smithi133 ceph-mon[125939]: pgmap v304: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 3.7 KiB/s wr, 5 op/s 2023-05-08T03:51:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 448.121039 secs 2023-05-08T03:51:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 447.569121 secs 2023-05-08T03:51:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:48 smithi096 ceph-mon[124666]: pgmap v304: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 3.7 KiB/s wr, 5 op/s 2023-05-08T03:51:49.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 448.121039 secs 2023-05-08T03:51:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 449.398018 secs 2023-05-08T03:51:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 449.398018 secs 2023-05-08T03:51:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 449.398018 secs 2023-05-08T03:51:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:50 smithi186 ceph-mon[126480]: pgmap v305: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 3.7 KiB/s wr, 7 op/s 2023-05-08T03:51:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:50 smithi133 ceph-mon[125939]: pgmap v305: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 3.7 KiB/s wr, 7 op/s 2023-05-08T03:51:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:50 smithi096 ceph-mon[124666]: pgmap v305: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 3.7 KiB/s wr, 7 op/s 2023-05-08T03:51:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:53 smithi133 ceph-mon[125939]: pgmap v306: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:51:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 452.569233 secs 2023-05-08T03:51:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:53 smithi096 ceph-mon[124666]: pgmap v306: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:51:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 452.569233 secs 2023-05-08T03:51:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:53 smithi186 ceph-mon[126480]: pgmap v306: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:51:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 452.569233 secs 2023-05-08T03:51:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 453.121120 secs 2023-05-08T03:51:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 453.121120 secs 2023-05-08T03:51:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 453.121120 secs 2023-05-08T03:51:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:55 smithi096 ceph-mon[124666]: pgmap v307: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T03:51:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 454.398135 secs 2023-05-08T03:51:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:55 smithi186 ceph-mon[126480]: pgmap v307: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T03:51:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 454.398135 secs 2023-05-08T03:51:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:55 smithi133 ceph-mon[125939]: pgmap v307: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T03:51:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 454.398135 secs 2023-05-08T03:51:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:57 smithi096 ceph-mon[124666]: pgmap v308: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:51:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:57 smithi186 ceph-mon[126480]: pgmap v308: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:51:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:57 smithi133 ceph-mon[125939]: pgmap v308: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:51:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 457.569373 secs 2023-05-08T03:51:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:58 smithi186 ceph-mon[126480]: pgmap v309: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:51:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 458.121238 secs 2023-05-08T03:51:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 457.569373 secs 2023-05-08T03:51:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:58 smithi133 ceph-mon[125939]: pgmap v309: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:51:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 458.121238 secs 2023-05-08T03:51:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 457.569373 secs 2023-05-08T03:51:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:58 smithi096 ceph-mon[124666]: pgmap v309: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:51:59.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 458.121238 secs 2023-05-08T03:52:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:51:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 459.398255 secs 2023-05-08T03:52:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:51:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 459.398255 secs 2023-05-08T03:52:00.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:51:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 459.398255 secs 2023-05-08T03:52:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:00 smithi186 ceph-mon[126480]: pgmap v310: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T03:52:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:00 smithi133 ceph-mon[125939]: pgmap v310: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T03:52:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:00 smithi096 ceph-mon[124666]: pgmap v310: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T03:52:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:03 smithi133 ceph-mon[125939]: pgmap v311: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:52:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 462.569455 secs 2023-05-08T03:52:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:03 smithi096 ceph-mon[124666]: pgmap v311: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:52:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 462.569455 secs 2023-05-08T03:52:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:03 smithi186 ceph-mon[126480]: pgmap v311: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:52:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 462.569455 secs 2023-05-08T03:52:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 463.121354 secs 2023-05-08T03:52:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 463.121354 secs 2023-05-08T03:52:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 463.121354 secs 2023-05-08T03:52:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:05 smithi096 ceph-mon[124666]: pgmap v312: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T03:52:05.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 464.398394 secs 2023-05-08T03:52:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:05 smithi186 ceph-mon[126480]: pgmap v312: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T03:52:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 464.398394 secs 2023-05-08T03:52:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:05 smithi133 ceph-mon[125939]: pgmap v312: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T03:52:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 464.398394 secs 2023-05-08T03:52:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:07 smithi096 ceph-mon[124666]: pgmap v313: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T03:52:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:07 smithi186 ceph-mon[126480]: pgmap v313: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T03:52:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:07 smithi133 ceph-mon[125939]: pgmap v313: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T03:52:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 467.569573 secs 2023-05-08T03:52:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:08 smithi186 ceph-mon[126480]: pgmap v314: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T03:52:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 468.121498 secs 2023-05-08T03:52:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 467.569573 secs 2023-05-08T03:52:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:08 smithi133 ceph-mon[125939]: pgmap v314: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T03:52:08.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 468.121498 secs 2023-05-08T03:52:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 467.569573 secs 2023-05-08T03:52:09.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:08 smithi096 ceph-mon[124666]: pgmap v314: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T03:52:09.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 468.121498 secs 2023-05-08T03:52:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 469.398527 secs 2023-05-08T03:52:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:10 smithi133 ceph-mon[125939]: osdmap e102: 12 total, 12 up, 12 in 2023-05-08T03:52:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:10 smithi133 ceph-mon[125939]: pgmap v316: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T03:52:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 469.398527 secs 2023-05-08T03:52:11.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:10 smithi096 ceph-mon[124666]: osdmap e102: 12 total, 12 up, 12 in 2023-05-08T03:52:11.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:10 smithi096 ceph-mon[124666]: pgmap v316: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T03:52:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 469.398527 secs 2023-05-08T03:52:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:10 smithi186 ceph-mon[126480]: osdmap e102: 12 total, 12 up, 12 in 2023-05-08T03:52:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:10 smithi186 ceph-mon[126480]: pgmap v316: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T03:52:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:13 smithi133 ceph-mon[125939]: pgmap v317: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T03:52:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 472.569634 secs 2023-05-08T03:52:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:13 smithi096 ceph-mon[124666]: pgmap v317: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T03:52:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 472.569634 secs 2023-05-08T03:52:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:13 smithi186 ceph-mon[126480]: pgmap v317: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T03:52:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 472.569634 secs 2023-05-08T03:52:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 473.121578 secs 2023-05-08T03:52:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 473.121578 secs 2023-05-08T03:52:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 473.121578 secs 2023-05-08T03:52:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:15 smithi096 ceph-mon[124666]: pgmap v318: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:52:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 474.398674 secs 2023-05-08T03:52:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:15 smithi186 ceph-mon[126480]: pgmap v318: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:52:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 474.398674 secs 2023-05-08T03:52:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:15 smithi133 ceph-mon[125939]: pgmap v318: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:52:15.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 474.398674 secs 2023-05-08T03:52:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:17 smithi096 ceph-mon[124666]: pgmap v319: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:52:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:17 smithi186 ceph-mon[126480]: pgmap v319: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:52:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:17 smithi133 ceph-mon[125939]: pgmap v319: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:52:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:18 smithi186 ceph-mon[126480]: osdmap e103: 12 total, 12 up, 12 in 2023-05-08T03:52:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 477.569700 secs 2023-05-08T03:52:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:18 smithi186 ceph-mon[126480]: pgmap v321: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 120 B/s wr, 4 op/s 2023-05-08T03:52:18.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 478.121665 secs 2023-05-08T03:52:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:18 smithi133 ceph-mon[125939]: osdmap e103: 12 total, 12 up, 12 in 2023-05-08T03:52:18.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 477.569700 secs 2023-05-08T03:52:18.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:18 smithi133 ceph-mon[125939]: pgmap v321: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 120 B/s wr, 4 op/s 2023-05-08T03:52:18.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 478.121665 secs 2023-05-08T03:52:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:18 smithi096 ceph-mon[124666]: osdmap e103: 12 total, 12 up, 12 in 2023-05-08T03:52:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 477.569700 secs 2023-05-08T03:52:19.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:18 smithi096 ceph-mon[124666]: pgmap v321: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 120 B/s wr, 4 op/s 2023-05-08T03:52:19.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 478.121665 secs 2023-05-08T03:52:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 479.398828 secs 2023-05-08T03:52:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 479.398828 secs 2023-05-08T03:52:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 479.398828 secs 2023-05-08T03:52:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:20 smithi186 ceph-mon[126480]: pgmap v322: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:52:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:20 smithi133 ceph-mon[125939]: pgmap v322: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:52:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:20 smithi096 ceph-mon[124666]: pgmap v322: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:52:23.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:23 smithi096 ceph-mon[124666]: pgmap v323: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:52:23.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 482.569839 secs 2023-05-08T03:52:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:23 smithi186 ceph-mon[126480]: pgmap v323: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:52:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 482.569839 secs 2023-05-08T03:52:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:23 smithi133 ceph-mon[125939]: pgmap v323: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:52:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 482.569839 secs 2023-05-08T03:52:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 483.121777 secs 2023-05-08T03:52:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 483.121777 secs 2023-05-08T03:52:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 483.121777 secs 2023-05-08T03:52:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:25 smithi096 ceph-mon[124666]: pgmap v324: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T03:52:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 484.398901 secs 2023-05-08T03:52:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:25 smithi186 ceph-mon[126480]: pgmap v324: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T03:52:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 484.398901 secs 2023-05-08T03:52:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:25 smithi133 ceph-mon[125939]: pgmap v324: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T03:52:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 484.398901 secs 2023-05-08T03:52:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:27 smithi096 ceph-mon[124666]: pgmap v325: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T03:52:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:27 smithi186 ceph-mon[126480]: pgmap v325: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T03:52:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:27 smithi133 ceph-mon[125939]: pgmap v325: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T03:52:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 487.569961 secs 2023-05-08T03:52:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:28 smithi186 ceph-mon[126480]: pgmap v326: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T03:52:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 488.121911 secs 2023-05-08T03:52:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 487.569961 secs 2023-05-08T03:52:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:28 smithi133 ceph-mon[125939]: pgmap v326: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T03:52:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 488.121911 secs 2023-05-08T03:52:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 487.569961 secs 2023-05-08T03:52:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:28 smithi096 ceph-mon[124666]: pgmap v326: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T03:52:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 488.121911 secs 2023-05-08T03:52:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:31 smithi096 ceph-mon[124666]: pgmap v327: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 9.4 KiB/s wr, 8 op/s 2023-05-08T03:52:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:31 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:52:31.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:31 smithi186 ceph-mon[126480]: pgmap v327: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 9.4 KiB/s wr, 8 op/s 2023-05-08T03:52:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:31 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:52:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:31 smithi133 ceph-mon[125939]: pgmap v327: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 9.4 KiB/s wr, 8 op/s 2023-05-08T03:52:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:31 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:52:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:33 smithi096 ceph-mon[124666]: pgmap v328: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 9.3 KiB/s wr, 5 op/s 2023-05-08T03:52:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 492.570084 secs 2023-05-08T03:52:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:33 smithi186 ceph-mon[126480]: pgmap v328: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 9.3 KiB/s wr, 5 op/s 2023-05-08T03:52:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 492.570084 secs 2023-05-08T03:52:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:33 smithi133 ceph-mon[125939]: pgmap v328: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 9.3 KiB/s wr, 5 op/s 2023-05-08T03:52:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 492.570084 secs 2023-05-08T03:52:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:34 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T03:52:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 493.122061 secs 2023-05-08T03:52:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:34 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:52:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:34 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:52:34.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:34 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:52:34.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:34 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:52:34.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:34 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:52:34.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:34 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:52:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:34 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T03:52:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 493.122061 secs 2023-05-08T03:52:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:34 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:52:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:34 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:52:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:34 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:52:34.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:34 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:52:34.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:34 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:52:34.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:34 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:52:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:34 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T03:52:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 493.122061 secs 2023-05-08T03:52:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:34 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:52:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:34 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:52:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:34 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:52:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:34 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:52:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:34 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:52:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:34 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:52:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:35 smithi096 ceph-mon[124666]: pgmap v329: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 27 KiB/s wr, 10 op/s 2023-05-08T03:52:35.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:35 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T03:52:35.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:35 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T03:52:35.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:35 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:52:35.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:52:35.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:52:35.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:52:35.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:52:35.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:35 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi096 to 196.2M 2023-05-08T03:52:35.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:35 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi096 to 205766758: error parsing value: Value '205766758' is below minimum 939524096 2023-05-08T03:52:35.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:52:35.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:52:35.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:52:35.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:52:35.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:52:35.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:52:35.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:52:35.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:52:35.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:52:35.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:52:35.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:52:35.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 494.399103 secs 2023-05-08T03:52:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:35 smithi186 ceph-mon[126480]: pgmap v329: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 27 KiB/s wr, 10 op/s 2023-05-08T03:52:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:35 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T03:52:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:35 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T03:52:35.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:35 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:52:35.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:52:35.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:52:35.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:52:35.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:52:35.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:35 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi096 to 196.2M 2023-05-08T03:52:35.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:35 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi096 to 205766758: error parsing value: Value '205766758' is below minimum 939524096 2023-05-08T03:52:35.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:52:35.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:52:35.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:52:35.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:52:35.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:52:35.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:52:35.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:52:35.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:52:35.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:52:35.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:52:35.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:52:35.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 494.399103 secs 2023-05-08T03:52:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:35 smithi133 ceph-mon[125939]: pgmap v329: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 27 KiB/s wr, 10 op/s 2023-05-08T03:52:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:35 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T03:52:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:35 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T03:52:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:35 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:52:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:52:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:52:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:52:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:52:35.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:35 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi096 to 196.2M 2023-05-08T03:52:35.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:35 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi096 to 205766758: error parsing value: Value '205766758' is below minimum 939524096 2023-05-08T03:52:35.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:52:35.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:52:35.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:52:35.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:52:35.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:52:35.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:52:35.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:52:35.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T03:52:35.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:52:35.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:52:35.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:52:35.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 494.399103 secs 2023-05-08T03:52:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:36 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T03:52:36.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:36 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T03:52:36.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:36 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T03:52:36.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:36 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T03:52:36.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:36 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:52:36.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:36 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T03:52:36.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:36 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T03:52:36.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:36 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:52:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:36 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T03:52:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:36 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T03:52:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:36 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T03:52:36.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:36 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T03:52:36.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:36 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:52:36.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:36 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T03:52:36.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:36 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T03:52:36.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:36 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:52:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:36 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T03:52:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:36 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T03:52:36.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:36 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T03:52:36.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:36 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T03:52:36.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:36 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:52:36.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:36 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T03:52:36.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:36 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T03:52:36.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:36 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:52:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:37 smithi186 ceph-mon[126480]: pgmap v330: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 27 KiB/s wr, 7 op/s 2023-05-08T03:52:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:37 smithi133 ceph-mon[125939]: pgmap v330: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 27 KiB/s wr, 7 op/s 2023-05-08T03:52:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:37 smithi096 ceph-mon[124666]: pgmap v330: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 27 KiB/s wr, 7 op/s 2023-05-08T03:52:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 497.570199 secs 2023-05-08T03:52:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:38 smithi186 ceph-mon[126480]: pgmap v331: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 27 KiB/s wr, 7 op/s 2023-05-08T03:52:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:38 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T03:52:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:38 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:52:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 498.122177 secs 2023-05-08T03:52:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 497.570199 secs 2023-05-08T03:52:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:38 smithi133 ceph-mon[125939]: pgmap v331: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 27 KiB/s wr, 7 op/s 2023-05-08T03:52:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:38 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T03:52:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:38 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:52:38.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 498.122177 secs 2023-05-08T03:52:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 497.570199 secs 2023-05-08T03:52:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:38 smithi096 ceph-mon[124666]: pgmap v331: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 27 KiB/s wr, 7 op/s 2023-05-08T03:52:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:38 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T03:52:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:38 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:52:39.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 498.122177 secs 2023-05-08T03:52:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 499.399184 secs 2023-05-08T03:52:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 499.399184 secs 2023-05-08T03:52:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 499.399184 secs 2023-05-08T03:52:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:40 smithi186 ceph-mon[126480]: pgmap v332: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 31 KiB/s wr, 10 op/s 2023-05-08T03:52:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:40 smithi133 ceph-mon[125939]: pgmap v332: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 31 KiB/s wr, 10 op/s 2023-05-08T03:52:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:40 smithi096 ceph-mon[124666]: pgmap v332: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 31 KiB/s wr, 10 op/s 2023-05-08T03:52:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:43 smithi096 ceph-mon[124666]: pgmap v333: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 7 op/s 2023-05-08T03:52:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:43 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T03:52:43.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 502.570331 secs 2023-05-08T03:52:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:43 smithi186 ceph-mon[126480]: pgmap v333: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 7 op/s 2023-05-08T03:52:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:43 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T03:52:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 502.570331 secs 2023-05-08T03:52:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:43 smithi133 ceph-mon[125939]: pgmap v333: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 7 op/s 2023-05-08T03:52:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:43 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T03:52:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 502.570331 secs 2023-05-08T03:52:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 503.122291 secs 2023-05-08T03:52:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 503.122291 secs 2023-05-08T03:52:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 503.122291 secs 2023-05-08T03:52:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:45 smithi096 ceph-mon[124666]: pgmap v334: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 21 KiB/s wr, 10 op/s 2023-05-08T03:52:45.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 504.399296 secs 2023-05-08T03:52:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:45 smithi186 ceph-mon[126480]: pgmap v334: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 21 KiB/s wr, 10 op/s 2023-05-08T03:52:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 504.399296 secs 2023-05-08T03:52:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:45 smithi133 ceph-mon[125939]: pgmap v334: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 21 KiB/s wr, 10 op/s 2023-05-08T03:52:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 504.399296 secs 2023-05-08T03:52:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:47 smithi186 ceph-mon[126480]: pgmap v335: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.0 KiB/s wr, 5 op/s 2023-05-08T03:52:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:47 smithi133 ceph-mon[125939]: pgmap v335: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.0 KiB/s wr, 5 op/s 2023-05-08T03:52:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:47 smithi096 ceph-mon[124666]: pgmap v335: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.0 KiB/s wr, 5 op/s 2023-05-08T03:52:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 507.570414 secs 2023-05-08T03:52:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:48 smithi186 ceph-mon[126480]: pgmap v336: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 3.9 KiB/s wr, 5 op/s 2023-05-08T03:52:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 508.122411 secs 2023-05-08T03:52:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 507.570414 secs 2023-05-08T03:52:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:48 smithi133 ceph-mon[125939]: pgmap v336: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 3.9 KiB/s wr, 5 op/s 2023-05-08T03:52:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 508.122411 secs 2023-05-08T03:52:49.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 507.570414 secs 2023-05-08T03:52:49.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:48 smithi096 ceph-mon[124666]: pgmap v336: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 3.9 KiB/s wr, 5 op/s 2023-05-08T03:52:49.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 508.122411 secs 2023-05-08T03:52:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 509.399413 secs 2023-05-08T03:52:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 509.399413 secs 2023-05-08T03:52:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 509.399413 secs 2023-05-08T03:52:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:50 smithi186 ceph-mon[126480]: pgmap v337: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 3.9 KiB/s wr, 7 op/s 2023-05-08T03:52:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:50 smithi133 ceph-mon[125939]: pgmap v337: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 3.9 KiB/s wr, 7 op/s 2023-05-08T03:52:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:50 smithi096 ceph-mon[124666]: pgmap v337: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 3.9 KiB/s wr, 7 op/s 2023-05-08T03:52:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:53 smithi096 ceph-mon[124666]: pgmap v338: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:52:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 512.570524 secs 2023-05-08T03:52:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:53 smithi186 ceph-mon[126480]: pgmap v338: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:52:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 512.570524 secs 2023-05-08T03:52:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:53 smithi133 ceph-mon[125939]: pgmap v338: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:52:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 512.570524 secs 2023-05-08T03:52:54.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 513.122553 secs 2023-05-08T03:52:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 513.122553 secs 2023-05-08T03:52:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 513.122553 secs 2023-05-08T03:52:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:55 smithi186 ceph-mon[126480]: pgmap v339: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T03:52:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 514.399535 secs 2023-05-08T03:52:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:55 smithi133 ceph-mon[125939]: pgmap v339: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T03:52:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 514.399535 secs 2023-05-08T03:52:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:55 smithi096 ceph-mon[124666]: pgmap v339: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T03:52:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 514.399535 secs 2023-05-08T03:52:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:57 smithi186 ceph-mon[126480]: pgmap v340: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:52:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:57 smithi133 ceph-mon[125939]: pgmap v340: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:52:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:57 smithi096 ceph-mon[124666]: pgmap v340: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:52:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 517.570646 secs 2023-05-08T03:52:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:58 smithi186 ceph-mon[126480]: pgmap v341: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:52:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 518.122671 secs 2023-05-08T03:52:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 517.570646 secs 2023-05-08T03:52:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:58 smithi133 ceph-mon[125939]: pgmap v341: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:52:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 518.122671 secs 2023-05-08T03:52:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 517.570646 secs 2023-05-08T03:52:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:58 smithi096 ceph-mon[124666]: pgmap v341: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:52:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 518.122671 secs 2023-05-08T03:53:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:52:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 519.399654 secs 2023-05-08T03:53:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:52:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 519.399654 secs 2023-05-08T03:53:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:52:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 519.399654 secs 2023-05-08T03:53:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:53:00 smithi186 ceph-mon[126480]: pgmap v342: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T03:53:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:53:00 smithi133 ceph-mon[125939]: pgmap v342: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T03:53:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:53:00 smithi096 ceph-mon[124666]: pgmap v342: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T03:53:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:53:03 smithi096 ceph-mon[124666]: pgmap v343: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:53:03.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:53:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 522.570788 secs 2023-05-08T03:53:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:53:03 smithi186 ceph-mon[126480]: pgmap v343: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:53:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:53:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 522.570788 secs 2023-05-08T03:53:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:53:03 smithi133 ceph-mon[125939]: pgmap v343: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:53:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:53:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 522.570788 secs 2023-05-08T03:53:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:53:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 523.122745 secs 2023-05-08T03:53:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:53:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 523.122745 secs 2023-05-08T03:53:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:53:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 523.122745 secs 2023-05-08T03:53:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:53:05 smithi186 ceph-mon[126480]: pgmap v344: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T03:53:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:53:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 524.399770 secs 2023-05-08T03:53:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:53:05 smithi133 ceph-mon[125939]: pgmap v344: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T03:53:05.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:53:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 524.399770 secs 2023-05-08T03:53:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:53:05 smithi096 ceph-mon[124666]: pgmap v344: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T03:53:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:53:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 524.399770 secs 2023-05-08T03:53:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:53:07 smithi186 ceph-mon[126480]: pgmap v345: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T03:53:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:53:07 smithi133 ceph-mon[125939]: pgmap v345: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T03:53:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:53:07 smithi096 ceph-mon[124666]: pgmap v345: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T03:53:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:53:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 527.570938 secs 2023-05-08T03:53:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:53:08 smithi186 ceph-mon[126480]: pgmap v346: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T03:53:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:53:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 528.122857 secs 2023-05-08T03:53:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:53:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 527.570938 secs 2023-05-08T03:53:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:53:08 smithi133 ceph-mon[125939]: pgmap v346: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T03:53:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:53:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 528.122857 secs 2023-05-08T03:53:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:53:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 527.570938 secs 2023-05-08T03:53:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:53:08 smithi096 ceph-mon[124666]: pgmap v346: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T03:53:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:53:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 528.122857 secs 2023-05-08T03:53:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:53:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 529.399882 secs 2023-05-08T03:53:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:53:10 smithi133 ceph-mon[125939]: osdmap e104: 12 total, 12 up, 12 in 2023-05-08T03:53:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:53:10 smithi133 ceph-mon[125939]: pgmap v348: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T03:53:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:53:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 529.399882 secs 2023-05-08T03:53:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:53:10 smithi096 ceph-mon[124666]: osdmap e104: 12 total, 12 up, 12 in 2023-05-08T03:53:11.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:53:10 smithi096 ceph-mon[124666]: pgmap v348: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T03:53:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:53:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 529.399882 secs 2023-05-08T03:53:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:53:10 smithi186 ceph-mon[126480]: osdmap e104: 12 total, 12 up, 12 in 2023-05-08T03:53:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:53:10 smithi186 ceph-mon[126480]: pgmap v348: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T03:53:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:53:13 smithi186 ceph-mon[126480]: pgmap v349: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T03:53:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:53:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 532.571056 secs 2023-05-08T03:53:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:53:13 smithi133 ceph-mon[125939]: pgmap v349: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T03:53:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:53:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 532.571056 secs 2023-05-08T03:53:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:53:13 smithi096 ceph-mon[124666]: pgmap v349: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T03:53:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:53:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 532.571056 secs 2023-05-08T03:53:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:53:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 533.122994 secs 2023-05-08T03:53:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:53:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 533.122994 secs 2023-05-08T03:53:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:53:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 533.122994 secs 2023-05-08T03:53:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:53:15 smithi186 ceph-mon[126480]: pgmap v350: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:53:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:53:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 534.399967 secs 2023-05-08T03:53:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:53:15 smithi133 ceph-mon[125939]: pgmap v350: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:53:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:53:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 534.399967 secs 2023-05-08T03:53:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:53:15 smithi096 ceph-mon[124666]: pgmap v350: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:53:15.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:53:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 534.399967 secs 2023-05-08T03:53:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:53:17 smithi186 ceph-mon[126480]: pgmap v351: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:53:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:53:17 smithi133 ceph-mon[125939]: pgmap v351: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:53:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:53:17 smithi096 ceph-mon[124666]: pgmap v351: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:53:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:53:18 smithi186 ceph-mon[126480]: osdmap e105: 12 total, 12 up, 12 in 2023-05-08T03:53:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:53:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 537.571180 secs 2023-05-08T03:53:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:53:18 smithi186 ceph-mon[126480]: pgmap v353: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 120 B/s wr, 3 op/s 2023-05-08T03:53:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:53:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 538.123131 secs 2023-05-08T03:53:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:53:18 smithi133 ceph-mon[125939]: osdmap e105: 12 total, 12 up, 12 in 2023-05-08T03:53:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:53:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 537.571180 secs 2023-05-08T03:53:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:53:18 smithi133 ceph-mon[125939]: pgmap v353: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 120 B/s wr, 3 op/s 2023-05-08T03:53:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:53:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 538.123131 secs 2023-05-08T03:53:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:53:18 smithi096 ceph-mon[124666]: osdmap e105: 12 total, 12 up, 12 in 2023-05-08T03:53:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:53:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 537.571180 secs 2023-05-08T03:53:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:53:18 smithi096 ceph-mon[124666]: pgmap v353: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 120 B/s wr, 3 op/s 2023-05-08T03:53:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:53:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 538.123131 secs 2023-05-08T03:53:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:53:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 539.400077 secs 2023-05-08T03:53:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:53:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 539.400077 secs 2023-05-08T03:53:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:53:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 539.400077 secs 2023-05-08T03:53:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:53:20 smithi186 ceph-mon[126480]: pgmap v354: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:53:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:53:20 smithi133 ceph-mon[125939]: pgmap v354: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:53:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:53:20 smithi096 ceph-mon[124666]: pgmap v354: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:53:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:53:23 smithi186 ceph-mon[126480]: pgmap v355: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:53:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:53:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 542.571271 secs 2023-05-08T03:53:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:53:23 smithi133 ceph-mon[125939]: pgmap v355: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:53:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:53:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 542.571271 secs 2023-05-08T03:53:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:53:23 smithi096 ceph-mon[124666]: pgmap v355: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:53:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:53:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 542.571271 secs 2023-05-08T03:53:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:53:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 543.123268 secs 2023-05-08T03:53:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:53:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 543.123268 secs 2023-05-08T03:53:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:53:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 543.123268 secs 2023-05-08T03:53:25.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:53:25 smithi186 ceph-mon[126480]: pgmap v356: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T03:53:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:53:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 544.400203 secs 2023-05-08T03:53:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:53:25 smithi133 ceph-mon[125939]: pgmap v356: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T03:53:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:53:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 544.400203 secs 2023-05-08T03:53:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:53:25 smithi096 ceph-mon[124666]: pgmap v356: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T03:53:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:53:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 544.400203 secs 2023-05-08T03:53:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:53:27 smithi186 ceph-mon[126480]: pgmap v357: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T03:53:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:53:27 smithi133 ceph-mon[125939]: pgmap v357: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T03:53:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:53:27 smithi096 ceph-mon[124666]: pgmap v357: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T03:53:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:53:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 547.571389 secs 2023-05-08T03:53:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:53:28 smithi186 ceph-mon[126480]: pgmap v358: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T03:53:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:53:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 548.123402 secs 2023-05-08T03:53:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:53:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 547.571389 secs 2023-05-08T03:53:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:53:28 smithi133 ceph-mon[125939]: pgmap v358: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T03:53:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:53:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 548.123402 secs 2023-05-08T03:53:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:53:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 547.571389 secs 2023-05-08T03:53:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:53:28 smithi096 ceph-mon[124666]: pgmap v358: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T03:53:29.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:53:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 548.123402 secs 2023-05-08T03:53:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:53:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 549.400318 secs 2023-05-08T03:53:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:53:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 549.400318 secs 2023-05-08T03:53:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:53:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 549.400318 secs 2023-05-08T03:53:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:53:30 smithi186 ceph-mon[126480]: pgmap v359: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 10 KiB/s wr, 8 op/s 2023-05-08T03:53:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:53:30 smithi133 ceph-mon[125939]: pgmap v359: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 10 KiB/s wr, 8 op/s 2023-05-08T03:53:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:53:30 smithi096 ceph-mon[124666]: pgmap v359: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 10 KiB/s wr, 8 op/s 2023-05-08T03:53:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:53:33 smithi186 ceph-mon[126480]: pgmap v360: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 10 KiB/s wr, 5 op/s 2023-05-08T03:53:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:53:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 552.571444 secs 2023-05-08T03:53:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:53:33 smithi133 ceph-mon[125939]: pgmap v360: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 10 KiB/s wr, 5 op/s 2023-05-08T03:53:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:53:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 552.571444 secs 2023-05-08T03:53:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:53:33 smithi096 ceph-mon[124666]: pgmap v360: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 10 KiB/s wr, 5 op/s 2023-05-08T03:53:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:53:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 552.571444 secs 2023-05-08T03:53:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:53:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 553.123544 secs 2023-05-08T03:53:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:53:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 553.123544 secs 2023-05-08T03:53:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:53:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 553.123544 secs 2023-05-08T03:53:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:53:35 smithi186 ceph-mon[126480]: pgmap v361: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 28 KiB/s wr, 9 op/s 2023-05-08T03:53:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:53:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 554.400454 secs 2023-05-08T03:53:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:53:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:53:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:53:35 smithi133 ceph-mon[125939]: pgmap v361: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 28 KiB/s wr, 9 op/s 2023-05-08T03:53:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:53:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 554.400454 secs 2023-05-08T03:53:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:53:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:53:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:53:35 smithi096 ceph-mon[124666]: pgmap v361: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 28 KiB/s wr, 9 op/s 2023-05-08T03:53:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:53:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 554.400454 secs 2023-05-08T03:53:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:53:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:53:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:53:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:53:36.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:53:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:53:36.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:53:36 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:53:36.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:53:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:53:36.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:53:36 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T03:53:36.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:53:36 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T03:53:36.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:53:36 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:53:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:53:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:53:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:53:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:53:36.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:53:36 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:53:36.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:53:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:53:36.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:53:36 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T03:53:36.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:53:36 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T03:53:36.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:53:36 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:53:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:53:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:53:36.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:53:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:53:36.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:53:36 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:53:36.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:53:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:53:36.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:53:36 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T03:53:36.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:53:36 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T03:53:36.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:53:36 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:53:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:53:37 smithi133 ceph-mon[125939]: pgmap v362: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 28 KiB/s wr, 7 op/s 2023-05-08T03:53:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:53:37 smithi096 ceph-mon[124666]: pgmap v362: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 28 KiB/s wr, 7 op/s 2023-05-08T03:53:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:53:37 smithi186 ceph-mon[126480]: pgmap v362: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 28 KiB/s wr, 7 op/s 2023-05-08T03:53:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:53:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 557.571518 secs 2023-05-08T03:53:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:53:38 smithi186 ceph-mon[126480]: pgmap v363: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 28 KiB/s wr, 7 op/s 2023-05-08T03:53:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:53:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 558.123681 secs 2023-05-08T03:53:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:53:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 557.571518 secs 2023-05-08T03:53:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:53:38 smithi133 ceph-mon[125939]: pgmap v363: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 28 KiB/s wr, 7 op/s 2023-05-08T03:53:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:53:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 558.123681 secs 2023-05-08T03:53:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:53:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 557.571518 secs 2023-05-08T03:53:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:53:38 smithi096 ceph-mon[124666]: pgmap v363: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 28 KiB/s wr, 7 op/s 2023-05-08T03:53:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:53:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 558.123681 secs 2023-05-08T03:53:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:53:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 559.400579 secs 2023-05-08T03:53:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:53:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 559.400579 secs 2023-05-08T03:53:40.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:53:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 559.400579 secs 2023-05-08T03:53:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:53:40 smithi186 ceph-mon[126480]: pgmap v364: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 33 KiB/s wr, 10 op/s 2023-05-08T03:53:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:53:40 smithi133 ceph-mon[125939]: pgmap v364: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 33 KiB/s wr, 10 op/s 2023-05-08T03:53:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:53:40 smithi096 ceph-mon[124666]: pgmap v364: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 33 KiB/s wr, 10 op/s 2023-05-08T03:53:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:53:43 smithi186 ceph-mon[126480]: pgmap v365: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 23 KiB/s wr, 7 op/s 2023-05-08T03:53:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:53:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 562.571578 secs 2023-05-08T03:53:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:53:43 smithi133 ceph-mon[125939]: pgmap v365: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 23 KiB/s wr, 7 op/s 2023-05-08T03:53:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:53:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 562.571578 secs 2023-05-08T03:53:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:53:43 smithi096 ceph-mon[124666]: pgmap v365: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 23 KiB/s wr, 7 op/s 2023-05-08T03:53:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:53:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 562.571578 secs 2023-05-08T03:53:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:53:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 563.123822 secs 2023-05-08T03:53:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:53:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 563.123822 secs 2023-05-08T03:53:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:53:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 563.123822 secs 2023-05-08T03:53:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:53:45 smithi186 ceph-mon[126480]: pgmap v366: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 23 KiB/s wr, 10 op/s 2023-05-08T03:53:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:53:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 564.400724 secs 2023-05-08T03:53:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:53:45 smithi133 ceph-mon[125939]: pgmap v366: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 23 KiB/s wr, 10 op/s 2023-05-08T03:53:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:53:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 564.400724 secs 2023-05-08T03:53:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:53:45 smithi096 ceph-mon[124666]: pgmap v366: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 23 KiB/s wr, 10 op/s 2023-05-08T03:53:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:53:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 564.400724 secs 2023-05-08T03:53:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:53:47 smithi186 ceph-mon[126480]: pgmap v367: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.1 KiB/s wr, 6 op/s 2023-05-08T03:53:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:53:47 smithi133 ceph-mon[125939]: pgmap v367: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.1 KiB/s wr, 6 op/s 2023-05-08T03:53:47.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:53:47 smithi096 ceph-mon[124666]: pgmap v367: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.1 KiB/s wr, 6 op/s 2023-05-08T03:53:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:53:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 567.571658 secs 2023-05-08T03:53:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:53:48 smithi186 ceph-mon[126480]: pgmap v368: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.0 KiB/s wr, 5 op/s 2023-05-08T03:53:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:53:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 568.123973 secs 2023-05-08T03:53:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:53:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 567.571658 secs 2023-05-08T03:53:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:53:48 smithi133 ceph-mon[125939]: pgmap v368: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.0 KiB/s wr, 5 op/s 2023-05-08T03:53:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:53:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 568.123973 secs 2023-05-08T03:53:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:53:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 567.571658 secs 2023-05-08T03:53:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:53:48 smithi096 ceph-mon[124666]: pgmap v368: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.0 KiB/s wr, 5 op/s 2023-05-08T03:53:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:53:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 568.123973 secs 2023-05-08T03:53:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:53:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 569.400849 secs 2023-05-08T03:53:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:53:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 569.400849 secs 2023-05-08T03:53:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:53:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 569.400849 secs 2023-05-08T03:53:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:53:50 smithi186 ceph-mon[126480]: pgmap v369: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 5.0 KiB/s wr, 8 op/s 2023-05-08T03:53:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:53:50 smithi133 ceph-mon[125939]: pgmap v369: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 5.0 KiB/s wr, 8 op/s 2023-05-08T03:53:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:53:50 smithi096 ceph-mon[124666]: pgmap v369: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 5.0 KiB/s wr, 8 op/s 2023-05-08T03:53:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:53:53 smithi186 ceph-mon[126480]: pgmap v370: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T03:53:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:53:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 572.571720 secs 2023-05-08T03:53:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:53:53 smithi133 ceph-mon[125939]: pgmap v370: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T03:53:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:53:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 572.571720 secs 2023-05-08T03:53:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:53:53 smithi096 ceph-mon[124666]: pgmap v370: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T03:53:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:53:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 572.571720 secs 2023-05-08T03:53:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:53:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 573.124091 secs 2023-05-08T03:53:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:53:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 573.124091 secs 2023-05-08T03:53:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:53:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 573.124091 secs 2023-05-08T03:53:55.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:53:55 smithi186 ceph-mon[126480]: pgmap v371: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T03:53:55.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:53:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 574.401000 secs 2023-05-08T03:53:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:53:55 smithi133 ceph-mon[125939]: pgmap v371: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T03:53:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:53:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 574.401000 secs 2023-05-08T03:53:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:53:55 smithi096 ceph-mon[124666]: pgmap v371: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T03:53:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:53:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 574.401000 secs 2023-05-08T03:53:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:53:57 smithi186 ceph-mon[126480]: pgmap v372: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:53:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:53:57 smithi133 ceph-mon[125939]: pgmap v372: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:53:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:53:57 smithi096 ceph-mon[124666]: pgmap v372: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:53:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:53:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 577.571816 secs 2023-05-08T03:53:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:53:58 smithi186 ceph-mon[126480]: pgmap v373: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:53:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:53:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 578.124244 secs 2023-05-08T03:53:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:53:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 577.571816 secs 2023-05-08T03:53:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:53:58 smithi133 ceph-mon[125939]: pgmap v373: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:53:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:53:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 578.124244 secs 2023-05-08T03:53:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:53:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 577.571816 secs 2023-05-08T03:53:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:53:58 smithi096 ceph-mon[124666]: pgmap v373: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:53:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:53:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 578.124244 secs 2023-05-08T03:54:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:53:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 579.401125 secs 2023-05-08T03:54:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:53:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 579.401125 secs 2023-05-08T03:54:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:53:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 579.401125 secs 2023-05-08T03:54:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:00 smithi186 ceph-mon[126480]: pgmap v374: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T03:54:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:00 smithi133 ceph-mon[125939]: pgmap v374: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T03:54:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:00 smithi096 ceph-mon[124666]: pgmap v374: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T03:54:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:03 smithi186 ceph-mon[126480]: pgmap v375: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:54:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 582.571932 secs 2023-05-08T03:54:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:03 smithi133 ceph-mon[125939]: pgmap v375: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:54:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 582.571932 secs 2023-05-08T03:54:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:03 smithi096 ceph-mon[124666]: pgmap v375: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:54:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 582.571932 secs 2023-05-08T03:54:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 583.124338 secs 2023-05-08T03:54:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 583.124338 secs 2023-05-08T03:54:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 583.124338 secs 2023-05-08T03:54:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:05 smithi186 ceph-mon[126480]: pgmap v376: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T03:54:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 584.401261 secs 2023-05-08T03:54:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:05 smithi133 ceph-mon[125939]: pgmap v376: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T03:54:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 584.401261 secs 2023-05-08T03:54:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:05 smithi096 ceph-mon[124666]: pgmap v376: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T03:54:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 584.401261 secs 2023-05-08T03:54:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:07 smithi186 ceph-mon[126480]: pgmap v377: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T03:54:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:07 smithi133 ceph-mon[125939]: pgmap v377: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T03:54:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:07 smithi096 ceph-mon[124666]: pgmap v377: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T03:54:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 587.572069 secs 2023-05-08T03:54:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:08 smithi186 ceph-mon[126480]: pgmap v378: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T03:54:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 588.124434 secs 2023-05-08T03:54:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 587.572069 secs 2023-05-08T03:54:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:08 smithi133 ceph-mon[125939]: pgmap v378: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T03:54:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 588.124434 secs 2023-05-08T03:54:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 587.572069 secs 2023-05-08T03:54:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:08 smithi096 ceph-mon[124666]: pgmap v378: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T03:54:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 588.124434 secs 2023-05-08T03:54:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 589.401384 secs 2023-05-08T03:54:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:10 smithi133 ceph-mon[125939]: osdmap e106: 12 total, 12 up, 12 in 2023-05-08T03:54:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:10 smithi133 ceph-mon[125939]: pgmap v380: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T03:54:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 589.401384 secs 2023-05-08T03:54:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:10 smithi096 ceph-mon[124666]: osdmap e106: 12 total, 12 up, 12 in 2023-05-08T03:54:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:10 smithi096 ceph-mon[124666]: pgmap v380: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T03:54:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 589.401384 secs 2023-05-08T03:54:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:10 smithi186 ceph-mon[126480]: osdmap e106: 12 total, 12 up, 12 in 2023-05-08T03:54:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:10 smithi186 ceph-mon[126480]: pgmap v380: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T03:54:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:13 smithi186 ceph-mon[126480]: pgmap v381: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T03:54:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 592.572193 secs 2023-05-08T03:54:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:13 smithi133 ceph-mon[125939]: pgmap v381: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T03:54:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 592.572193 secs 2023-05-08T03:54:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:13 smithi096 ceph-mon[124666]: pgmap v381: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T03:54:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 592.572193 secs 2023-05-08T03:54:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 593.124557 secs 2023-05-08T03:54:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 593.124557 secs 2023-05-08T03:54:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 593.124557 secs 2023-05-08T03:54:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:15 smithi186 ceph-mon[126480]: pgmap v382: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:54:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 594.401448 secs 2023-05-08T03:54:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:15 smithi133 ceph-mon[125939]: pgmap v382: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:54:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 594.401448 secs 2023-05-08T03:54:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:15 smithi096 ceph-mon[124666]: pgmap v382: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:54:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 594.401448 secs 2023-05-08T03:54:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:17 smithi186 ceph-mon[126480]: pgmap v383: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:54:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:17 smithi133 ceph-mon[125939]: pgmap v383: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:54:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:17 smithi096 ceph-mon[124666]: pgmap v383: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:54:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:18 smithi186 ceph-mon[126480]: osdmap e107: 12 total, 12 up, 12 in 2023-05-08T03:54:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 597.572256 secs 2023-05-08T03:54:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:18 smithi186 ceph-mon[126480]: pgmap v385: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 120 B/s wr, 3 op/s 2023-05-08T03:54:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 598.124704 secs 2023-05-08T03:54:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:18 smithi133 ceph-mon[125939]: osdmap e107: 12 total, 12 up, 12 in 2023-05-08T03:54:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 597.572256 secs 2023-05-08T03:54:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:18 smithi133 ceph-mon[125939]: pgmap v385: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 120 B/s wr, 3 op/s 2023-05-08T03:54:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 598.124704 secs 2023-05-08T03:54:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:18 smithi096 ceph-mon[124666]: osdmap e107: 12 total, 12 up, 12 in 2023-05-08T03:54:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 597.572256 secs 2023-05-08T03:54:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:18 smithi096 ceph-mon[124666]: pgmap v385: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 120 B/s wr, 3 op/s 2023-05-08T03:54:19.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 598.124704 secs 2023-05-08T03:54:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 599.401552 secs 2023-05-08T03:54:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 599.401552 secs 2023-05-08T03:54:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 599.401552 secs 2023-05-08T03:54:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:20 smithi186 ceph-mon[126480]: pgmap v386: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:54:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:20 smithi133 ceph-mon[125939]: pgmap v386: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:54:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:20 smithi096 ceph-mon[124666]: pgmap v386: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:54:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:23 smithi186 ceph-mon[126480]: pgmap v387: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:54:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 602.572376 secs 2023-05-08T03:54:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:23 smithi133 ceph-mon[125939]: pgmap v387: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:54:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 602.572376 secs 2023-05-08T03:54:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:23 smithi096 ceph-mon[124666]: pgmap v387: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:54:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 602.572376 secs 2023-05-08T03:54:24.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 603.124809 secs 2023-05-08T03:54:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 603.124809 secs 2023-05-08T03:54:24.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 603.124809 secs 2023-05-08T03:54:25.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:25 smithi186 ceph-mon[126480]: pgmap v388: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T03:54:25.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 604.401644 secs 2023-05-08T03:54:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:25 smithi133 ceph-mon[125939]: pgmap v388: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T03:54:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 604.401644 secs 2023-05-08T03:54:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:25 smithi096 ceph-mon[124666]: pgmap v388: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T03:54:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 604.401644 secs 2023-05-08T03:54:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:27 smithi186 ceph-mon[126480]: pgmap v389: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T03:54:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:27 smithi133 ceph-mon[125939]: pgmap v389: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T03:54:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:27 smithi096 ceph-mon[124666]: pgmap v389: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T03:54:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 607.572506 secs 2023-05-08T03:54:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:28 smithi186 ceph-mon[126480]: pgmap v390: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T03:54:28.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 608.124930 secs 2023-05-08T03:54:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 607.572506 secs 2023-05-08T03:54:28.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:28 smithi133 ceph-mon[125939]: pgmap v390: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T03:54:28.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 608.124930 secs 2023-05-08T03:54:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 607.572506 secs 2023-05-08T03:54:29.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:28 smithi096 ceph-mon[124666]: pgmap v390: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T03:54:29.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 608.124930 secs 2023-05-08T03:54:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:31 smithi186 ceph-mon[126480]: pgmap v391: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 11 KiB/s wr, 8 op/s 2023-05-08T03:54:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:31 smithi133 ceph-mon[125939]: pgmap v391: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 11 KiB/s wr, 8 op/s 2023-05-08T03:54:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:31 smithi096 ceph-mon[124666]: pgmap v391: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 11 KiB/s wr, 8 op/s 2023-05-08T03:54:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:33 smithi186 ceph-mon[126480]: pgmap v392: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 11 KiB/s wr, 5 op/s 2023-05-08T03:54:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 612.572634 secs 2023-05-08T03:54:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:33 smithi133 ceph-mon[125939]: pgmap v392: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 11 KiB/s wr, 5 op/s 2023-05-08T03:54:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 612.572634 secs 2023-05-08T03:54:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:33 smithi096 ceph-mon[124666]: pgmap v392: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 11 KiB/s wr, 5 op/s 2023-05-08T03:54:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 612.572634 secs 2023-05-08T03:54:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:34 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T03:54:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 613.125069 secs 2023-05-08T03:54:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:34 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T03:54:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 613.125069 secs 2023-05-08T03:54:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:34 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T03:54:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 613.125069 secs 2023-05-08T03:54:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:35 smithi186 ceph-mon[126480]: pgmap v393: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 31 KiB/s wr, 10 op/s 2023-05-08T03:54:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:35 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T03:54:35.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:35 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T03:54:35.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:35 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:54:35.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 614.401892 secs 2023-05-08T03:54:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:35 smithi133 ceph-mon[125939]: pgmap v393: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 31 KiB/s wr, 10 op/s 2023-05-08T03:54:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:35 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T03:54:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:35 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T03:54:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:35 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:54:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 614.401892 secs 2023-05-08T03:54:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:35 smithi096 ceph-mon[124666]: pgmap v393: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 31 KiB/s wr, 10 op/s 2023-05-08T03:54:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:35 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T03:54:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:35 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T03:54:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:35 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:54:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 614.401892 secs 2023-05-08T03:54:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:54:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:54:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:54:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:54:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:54:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:54:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:54:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:54:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:54:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:54:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:54:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:54:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:37 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:54:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:37 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T03:54:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:37 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T03:54:37.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:37 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:54:37.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:37 smithi186 ceph-mon[126480]: pgmap v394: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 31 KiB/s wr, 7 op/s 2023-05-08T03:54:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:37 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:54:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:37 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T03:54:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:37 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T03:54:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:37 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:54:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:37 smithi133 ceph-mon[125939]: pgmap v394: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 31 KiB/s wr, 7 op/s 2023-05-08T03:54:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:37 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:54:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:37 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T03:54:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:37 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T03:54:37.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:37 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:54:37.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:37 smithi096 ceph-mon[124666]: pgmap v394: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 31 KiB/s wr, 7 op/s 2023-05-08T03:54:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 617.572774 secs 2023-05-08T03:54:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:38 smithi186 ceph-mon[126480]: pgmap v395: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 31 KiB/s wr, 7 op/s 2023-05-08T03:54:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:38 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T03:54:38.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:38 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:54:38.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 618.125205 secs 2023-05-08T03:54:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 617.572774 secs 2023-05-08T03:54:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:38 smithi133 ceph-mon[125939]: pgmap v395: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 31 KiB/s wr, 7 op/s 2023-05-08T03:54:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:38 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T03:54:38.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:38 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:54:38.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 618.125205 secs 2023-05-08T03:54:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 617.572774 secs 2023-05-08T03:54:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:38 smithi096 ceph-mon[124666]: pgmap v395: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 31 KiB/s wr, 7 op/s 2023-05-08T03:54:39.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:38 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T03:54:39.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:38 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:54:39.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 618.125205 secs 2023-05-08T03:54:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 619.401983 secs 2023-05-08T03:54:40.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 619.401983 secs 2023-05-08T03:54:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 619.401983 secs 2023-05-08T03:54:41.078 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:40 smithi096 ceph-mon[124666]: pgmap v396: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 35 KiB/s wr, 10 op/s 2023-05-08T03:54:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:40 smithi186 ceph-mon[126480]: pgmap v396: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 35 KiB/s wr, 10 op/s 2023-05-08T03:54:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:40 smithi133 ceph-mon[125939]: pgmap v396: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 35 KiB/s wr, 10 op/s 2023-05-08T03:54:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:43 smithi186 ceph-mon[126480]: pgmap v397: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 7 op/s 2023-05-08T03:54:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:43 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T03:54:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 622.572918 secs 2023-05-08T03:54:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:43 smithi133 ceph-mon[125939]: pgmap v397: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 7 op/s 2023-05-08T03:54:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:43 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T03:54:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 622.572918 secs 2023-05-08T03:54:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:43 smithi096 ceph-mon[124666]: pgmap v397: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 7 op/s 2023-05-08T03:54:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:43 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T03:54:43.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 622.572918 secs 2023-05-08T03:54:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 623.125272 secs 2023-05-08T03:54:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 623.125272 secs 2023-05-08T03:54:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 623.125272 secs 2023-05-08T03:54:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:45 smithi186 ceph-mon[126480]: pgmap v398: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 10 op/s 2023-05-08T03:54:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 624.402107 secs 2023-05-08T03:54:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:45 smithi133 ceph-mon[125939]: pgmap v398: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 10 op/s 2023-05-08T03:54:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 624.402107 secs 2023-05-08T03:54:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:45 smithi096 ceph-mon[124666]: pgmap v398: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 10 op/s 2023-05-08T03:54:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 624.402107 secs 2023-05-08T03:54:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:47 smithi186 ceph-mon[126480]: pgmap v399: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.5 KiB/s wr, 5 op/s 2023-05-08T03:54:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:47 smithi133 ceph-mon[125939]: pgmap v399: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.5 KiB/s wr, 5 op/s 2023-05-08T03:54:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:47 smithi096 ceph-mon[124666]: pgmap v399: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.5 KiB/s wr, 5 op/s 2023-05-08T03:54:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 627.573034 secs 2023-05-08T03:54:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:48 smithi186 ceph-mon[126480]: pgmap v400: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.5 KiB/s wr, 5 op/s 2023-05-08T03:54:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 628.125385 secs 2023-05-08T03:54:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 627.573034 secs 2023-05-08T03:54:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:48 smithi133 ceph-mon[125939]: pgmap v400: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.5 KiB/s wr, 5 op/s 2023-05-08T03:54:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 628.125385 secs 2023-05-08T03:54:49.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 627.573034 secs 2023-05-08T03:54:49.009 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:48 smithi096 ceph-mon[124666]: pgmap v400: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.5 KiB/s wr, 5 op/s 2023-05-08T03:54:49.009 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 628.125385 secs 2023-05-08T03:54:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 629.402221 secs 2023-05-08T03:54:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 629.402221 secs 2023-05-08T03:54:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 629.402221 secs 2023-05-08T03:54:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:50 smithi186 ceph-mon[126480]: pgmap v401: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.5 KiB/s wr, 7 op/s 2023-05-08T03:54:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:50 smithi133 ceph-mon[125939]: pgmap v401: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.5 KiB/s wr, 7 op/s 2023-05-08T03:54:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:50 smithi096 ceph-mon[124666]: pgmap v401: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.5 KiB/s wr, 7 op/s 2023-05-08T03:54:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:53 smithi186 ceph-mon[126480]: pgmap v402: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:54:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 632.573125 secs 2023-05-08T03:54:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:53 smithi133 ceph-mon[125939]: pgmap v402: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:54:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 632.573125 secs 2023-05-08T03:54:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:53 smithi096 ceph-mon[124666]: pgmap v402: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:54:53.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 632.573125 secs 2023-05-08T03:54:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 633.125506 secs 2023-05-08T03:54:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 633.125506 secs 2023-05-08T03:54:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 633.125506 secs 2023-05-08T03:54:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:55 smithi186 ceph-mon[126480]: pgmap v403: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T03:54:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 634.402337 secs 2023-05-08T03:54:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:55 smithi133 ceph-mon[125939]: pgmap v403: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T03:54:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 634.402337 secs 2023-05-08T03:54:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:55 smithi096 ceph-mon[124666]: pgmap v403: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T03:54:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 634.402337 secs 2023-05-08T03:54:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:57 smithi186 ceph-mon[126480]: pgmap v404: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:54:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:57 smithi133 ceph-mon[125939]: pgmap v404: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:54:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:57 smithi096 ceph-mon[124666]: pgmap v404: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:54:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 637.573191 secs 2023-05-08T03:54:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:58 smithi186 ceph-mon[126480]: pgmap v405: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:54:58.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 638.125647 secs 2023-05-08T03:54:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 637.573191 secs 2023-05-08T03:54:58.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:58 smithi133 ceph-mon[125939]: pgmap v405: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:54:58.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 638.125647 secs 2023-05-08T03:54:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 637.573191 secs 2023-05-08T03:54:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:58 smithi096 ceph-mon[124666]: pgmap v405: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:54:59.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 638.125647 secs 2023-05-08T03:55:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:54:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 639.402468 secs 2023-05-08T03:55:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:54:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 639.402468 secs 2023-05-08T03:55:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:54:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 639.402468 secs 2023-05-08T03:55:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:00 smithi186 ceph-mon[126480]: pgmap v406: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T03:55:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:00 smithi133 ceph-mon[125939]: pgmap v406: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T03:55:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:00 smithi096 ceph-mon[124666]: pgmap v406: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T03:55:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:03 smithi186 ceph-mon[126480]: pgmap v407: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:55:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 642.573328 secs 2023-05-08T03:55:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:03 smithi133 ceph-mon[125939]: pgmap v407: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:55:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 642.573328 secs 2023-05-08T03:55:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:03 smithi096 ceph-mon[124666]: pgmap v407: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:55:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 642.573328 secs 2023-05-08T03:55:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 643.125724 secs 2023-05-08T03:55:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 643.125724 secs 2023-05-08T03:55:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 643.125724 secs 2023-05-08T03:55:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:05 smithi186 ceph-mon[126480]: pgmap v408: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T03:55:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 644.402614 secs 2023-05-08T03:55:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:05 smithi133 ceph-mon[125939]: pgmap v408: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T03:55:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 644.402614 secs 2023-05-08T03:55:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:05 smithi096 ceph-mon[124666]: pgmap v408: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T03:55:05.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 644.402614 secs 2023-05-08T03:55:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:07 smithi186 ceph-mon[126480]: pgmap v409: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T03:55:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:07 smithi133 ceph-mon[125939]: pgmap v409: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T03:55:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:07 smithi096 ceph-mon[124666]: pgmap v409: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T03:55:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 647.573450 secs 2023-05-08T03:55:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:08 smithi133 ceph-mon[125939]: pgmap v410: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T03:55:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 648.125860 secs 2023-05-08T03:55:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 647.573450 secs 2023-05-08T03:55:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:08 smithi096 ceph-mon[124666]: pgmap v410: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T03:55:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 648.125860 secs 2023-05-08T03:55:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 647.573450 secs 2023-05-08T03:55:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:08 smithi186 ceph-mon[126480]: pgmap v410: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T03:55:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 648.125860 secs 2023-05-08T03:55:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 649.402730 secs 2023-05-08T03:55:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:10 smithi133 ceph-mon[125939]: osdmap e108: 12 total, 12 up, 12 in 2023-05-08T03:55:10.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:10 smithi133 ceph-mon[125939]: pgmap v412: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T03:55:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 649.402730 secs 2023-05-08T03:55:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:10 smithi096 ceph-mon[124666]: osdmap e108: 12 total, 12 up, 12 in 2023-05-08T03:55:11.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:10 smithi096 ceph-mon[124666]: pgmap v412: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T03:55:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 649.402730 secs 2023-05-08T03:55:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:10 smithi186 ceph-mon[126480]: osdmap e108: 12 total, 12 up, 12 in 2023-05-08T03:55:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:10 smithi186 ceph-mon[126480]: pgmap v412: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T03:55:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:13 smithi186 ceph-mon[126480]: pgmap v413: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T03:55:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 652.573532 secs 2023-05-08T03:55:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:13 smithi133 ceph-mon[125939]: pgmap v413: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T03:55:13.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 652.573532 secs 2023-05-08T03:55:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:13 smithi096 ceph-mon[124666]: pgmap v413: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T03:55:13.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 652.573532 secs 2023-05-08T03:55:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 653.126009 secs 2023-05-08T03:55:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 653.126009 secs 2023-05-08T03:55:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 653.126009 secs 2023-05-08T03:55:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:15 smithi186 ceph-mon[126480]: pgmap v414: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:55:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 654.402856 secs 2023-05-08T03:55:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:15 smithi133 ceph-mon[125939]: pgmap v414: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:55:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 654.402856 secs 2023-05-08T03:55:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:15 smithi096 ceph-mon[124666]: pgmap v414: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:55:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 654.402856 secs 2023-05-08T03:55:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:17 smithi186 ceph-mon[126480]: pgmap v415: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:55:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:17 smithi133 ceph-mon[125939]: pgmap v415: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:55:17.773 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:17 smithi096 ceph-mon[124666]: pgmap v415: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:55:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:18 smithi186 ceph-mon[126480]: osdmap e109: 12 total, 12 up, 12 in 2023-05-08T03:55:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 657.573606 secs 2023-05-08T03:55:18.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:18 smithi186 ceph-mon[126480]: pgmap v417: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 120 B/s wr, 3 op/s 2023-05-08T03:55:18.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 658.126105 secs 2023-05-08T03:55:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:18 smithi133 ceph-mon[125939]: osdmap e109: 12 total, 12 up, 12 in 2023-05-08T03:55:18.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 657.573606 secs 2023-05-08T03:55:18.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:18 smithi133 ceph-mon[125939]: pgmap v417: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 120 B/s wr, 3 op/s 2023-05-08T03:55:18.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 658.126105 secs 2023-05-08T03:55:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:18 smithi096 ceph-mon[124666]: osdmap e109: 12 total, 12 up, 12 in 2023-05-08T03:55:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 657.573606 secs 2023-05-08T03:55:19.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:18 smithi096 ceph-mon[124666]: pgmap v417: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 120 B/s wr, 3 op/s 2023-05-08T03:55:19.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 658.126105 secs 2023-05-08T03:55:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 659.403001 secs 2023-05-08T03:55:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 659.403001 secs 2023-05-08T03:55:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 659.403001 secs 2023-05-08T03:55:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:20 smithi186 ceph-mon[126480]: pgmap v418: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:55:21.246 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:20 smithi133 ceph-mon[125939]: pgmap v418: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:55:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:20 smithi096 ceph-mon[124666]: pgmap v418: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:55:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:23 smithi186 ceph-mon[126480]: pgmap v419: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:55:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 662.573743 secs 2023-05-08T03:55:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:23 smithi133 ceph-mon[125939]: pgmap v419: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:55:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 662.573743 secs 2023-05-08T03:55:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:23 smithi096 ceph-mon[124666]: pgmap v419: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:55:23.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 662.573743 secs 2023-05-08T03:55:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 663.126201 secs 2023-05-08T03:55:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 663.126201 secs 2023-05-08T03:55:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 663.126201 secs 2023-05-08T03:55:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:25 smithi186 ceph-mon[126480]: pgmap v420: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T03:55:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 664.403143 secs 2023-05-08T03:55:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:25 smithi133 ceph-mon[125939]: pgmap v420: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T03:55:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 664.403143 secs 2023-05-08T03:55:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:25 smithi096 ceph-mon[124666]: pgmap v420: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T03:55:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 664.403143 secs 2023-05-08T03:55:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:27 smithi186 ceph-mon[126480]: pgmap v421: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T03:55:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:27 smithi133 ceph-mon[125939]: pgmap v421: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T03:55:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:27 smithi096 ceph-mon[124666]: pgmap v421: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T03:55:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 667.573845 secs 2023-05-08T03:55:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:28 smithi133 ceph-mon[125939]: pgmap v422: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T03:55:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 668.126340 secs 2023-05-08T03:55:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 667.573845 secs 2023-05-08T03:55:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:28 smithi096 ceph-mon[124666]: pgmap v422: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T03:55:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 668.126340 secs 2023-05-08T03:55:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 667.573845 secs 2023-05-08T03:55:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:28 smithi186 ceph-mon[126480]: pgmap v422: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T03:55:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 668.126340 secs 2023-05-08T03:55:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:31 smithi186 ceph-mon[126480]: pgmap v423: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 12 KiB/s wr, 8 op/s 2023-05-08T03:55:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:31 smithi133 ceph-mon[125939]: pgmap v423: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 12 KiB/s wr, 8 op/s 2023-05-08T03:55:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:31 smithi096 ceph-mon[124666]: pgmap v423: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 12 KiB/s wr, 8 op/s 2023-05-08T03:55:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:33 smithi186 ceph-mon[126480]: pgmap v424: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 11 KiB/s wr, 6 op/s 2023-05-08T03:55:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 672.573992 secs 2023-05-08T03:55:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:33 smithi133 ceph-mon[125939]: pgmap v424: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 11 KiB/s wr, 6 op/s 2023-05-08T03:55:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 672.573992 secs 2023-05-08T03:55:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:33 smithi096 ceph-mon[124666]: pgmap v424: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 11 KiB/s wr, 6 op/s 2023-05-08T03:55:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 672.573992 secs 2023-05-08T03:55:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:34 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T03:55:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 673.126490 secs 2023-05-08T03:55:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:34 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T03:55:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 673.126490 secs 2023-05-08T03:55:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:34 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T03:55:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 673.126490 secs 2023-05-08T03:55:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:35 smithi186 ceph-mon[126480]: pgmap v425: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 37 KiB/s wr, 11 op/s 2023-05-08T03:55:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:35 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T03:55:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:35 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T03:55:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:35 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:55:35.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 674.403409 secs 2023-05-08T03:55:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:35 smithi133 ceph-mon[125939]: pgmap v425: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 37 KiB/s wr, 11 op/s 2023-05-08T03:55:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:35 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T03:55:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:35 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T03:55:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:35 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:55:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 674.403409 secs 2023-05-08T03:55:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:35 smithi096 ceph-mon[124666]: pgmap v425: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 37 KiB/s wr, 11 op/s 2023-05-08T03:55:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:35 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T03:55:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:35 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T03:55:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:35 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:55:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 674.403409 secs 2023-05-08T03:55:36.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:55:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:55:36.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:55:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:37 smithi186 ceph-mon[126480]: pgmap v426: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 37 KiB/s wr, 8 op/s 2023-05-08T03:55:37.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:37 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:55:37.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:37 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:55:37.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:37 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:55:37.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:37 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:55:37.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:37 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:55:37.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:37 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:55:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:37 smithi133 ceph-mon[125939]: pgmap v426: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 37 KiB/s wr, 8 op/s 2023-05-08T03:55:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:37 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:55:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:37 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:55:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:37 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:55:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:37 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:55:37.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:37 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:55:37.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:37 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:55:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:37 smithi096 ceph-mon[124666]: pgmap v426: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 37 KiB/s wr, 8 op/s 2023-05-08T03:55:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:37 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:55:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:37 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:55:37.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:37 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:55:37.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:37 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:55:37.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:37 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:55:37.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:37 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:55:38.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:55:38.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:55:38.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:38 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:55:38.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:55:38.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:38 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T03:55:38.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:38 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T03:55:38.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:38 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:55:38.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 677.574138 secs 2023-05-08T03:55:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:55:38.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:55:38.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:38 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:55:38.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:55:38.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:38 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T03:55:38.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:38 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T03:55:38.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:38 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:55:38.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 677.574138 secs 2023-05-08T03:55:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:55:38.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:55:38.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:38 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:55:38.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:55:38.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:38 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T03:55:38.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:38 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T03:55:38.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:38 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:55:38.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 677.574138 secs 2023-05-08T03:55:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:39 smithi186 ceph-mon[126480]: pgmap v427: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 37 KiB/s wr, 8 op/s 2023-05-08T03:55:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:39 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T03:55:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:39 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:55:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 678.126581 secs 2023-05-08T03:55:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:39 smithi133 ceph-mon[125939]: pgmap v427: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 37 KiB/s wr, 8 op/s 2023-05-08T03:55:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:39 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T03:55:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:39 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:55:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 678.126581 secs 2023-05-08T03:55:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:39 smithi096 ceph-mon[124666]: pgmap v427: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 37 KiB/s wr, 8 op/s 2023-05-08T03:55:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:39 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T03:55:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:39 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:55:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 678.126581 secs 2023-05-08T03:55:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 679.403526 secs 2023-05-08T03:55:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 679.403526 secs 2023-05-08T03:55:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 679.403526 secs 2023-05-08T03:55:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:41 smithi186 ceph-mon[126480]: pgmap v428: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 41 KiB/s wr, 12 op/s 2023-05-08T03:55:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:41 smithi133 ceph-mon[125939]: pgmap v428: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 41 KiB/s wr, 12 op/s 2023-05-08T03:55:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:41 smithi096 ceph-mon[124666]: pgmap v428: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 41 KiB/s wr, 12 op/s 2023-05-08T03:55:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:43 smithi186 ceph-mon[126480]: pgmap v429: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 30 KiB/s wr, 8 op/s 2023-05-08T03:55:43.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:43 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T03:55:43.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 682.574276 secs 2023-05-08T03:55:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:43 smithi133 ceph-mon[125939]: pgmap v429: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 30 KiB/s wr, 8 op/s 2023-05-08T03:55:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:43 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T03:55:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 682.574276 secs 2023-05-08T03:55:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:43 smithi096 ceph-mon[124666]: pgmap v429: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 30 KiB/s wr, 8 op/s 2023-05-08T03:55:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:43 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T03:55:43.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 682.574276 secs 2023-05-08T03:55:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 683.126725 secs 2023-05-08T03:55:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 683.126725 secs 2023-05-08T03:55:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 683.126725 secs 2023-05-08T03:55:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:45 smithi186 ceph-mon[126480]: pgmap v430: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 11 op/s 2023-05-08T03:55:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 684.403670 secs 2023-05-08T03:55:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:45 smithi133 ceph-mon[125939]: pgmap v430: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 11 op/s 2023-05-08T03:55:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 684.403670 secs 2023-05-08T03:55:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:45 smithi096 ceph-mon[124666]: pgmap v430: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 11 op/s 2023-05-08T03:55:45.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 684.403670 secs 2023-05-08T03:55:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:47 smithi186 ceph-mon[126480]: pgmap v431: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.8 KiB/s wr, 6 op/s 2023-05-08T03:55:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:47 smithi133 ceph-mon[125939]: pgmap v431: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.8 KiB/s wr, 6 op/s 2023-05-08T03:55:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:47 smithi096 ceph-mon[124666]: pgmap v431: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.8 KiB/s wr, 6 op/s 2023-05-08T03:55:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 687.574413 secs 2023-05-08T03:55:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:48 smithi133 ceph-mon[125939]: pgmap v432: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.8 KiB/s wr, 6 op/s 2023-05-08T03:55:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 688.126847 secs 2023-05-08T03:55:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 687.574413 secs 2023-05-08T03:55:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:48 smithi096 ceph-mon[124666]: pgmap v432: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.8 KiB/s wr, 6 op/s 2023-05-08T03:55:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 688.126847 secs 2023-05-08T03:55:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 687.574413 secs 2023-05-08T03:55:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:48 smithi186 ceph-mon[126480]: pgmap v432: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.8 KiB/s wr, 6 op/s 2023-05-08T03:55:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 688.126847 secs 2023-05-08T03:55:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 689.403804 secs 2023-05-08T03:55:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 689.403804 secs 2023-05-08T03:55:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 689.403804 secs 2023-05-08T03:55:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:50 smithi186 ceph-mon[126480]: pgmap v433: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-05-08T03:55:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:50 smithi133 ceph-mon[125939]: pgmap v433: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-05-08T03:55:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:50 smithi096 ceph-mon[124666]: pgmap v433: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-05-08T03:55:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:53 smithi186 ceph-mon[126480]: pgmap v434: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T03:55:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 692.574493 secs 2023-05-08T03:55:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:53 smithi133 ceph-mon[125939]: pgmap v434: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T03:55:53.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 692.574493 secs 2023-05-08T03:55:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:53 smithi096 ceph-mon[124666]: pgmap v434: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T03:55:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 692.574493 secs 2023-05-08T03:55:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 693.126967 secs 2023-05-08T03:55:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 693.126967 secs 2023-05-08T03:55:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 693.126967 secs 2023-05-08T03:55:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:55 smithi186 ceph-mon[126480]: pgmap v435: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T03:55:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 694.403941 secs 2023-05-08T03:55:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:55 smithi133 ceph-mon[125939]: pgmap v435: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T03:55:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 694.403941 secs 2023-05-08T03:55:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:55 smithi096 ceph-mon[124666]: pgmap v435: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T03:55:55.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 694.403941 secs 2023-05-08T03:55:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:57 smithi186 ceph-mon[126480]: pgmap v436: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T03:55:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:57 smithi133 ceph-mon[125939]: pgmap v436: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T03:55:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:57 smithi096 ceph-mon[124666]: pgmap v436: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T03:55:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 697.574576 secs 2023-05-08T03:55:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:58 smithi133 ceph-mon[125939]: pgmap v437: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T03:55:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 698.127105 secs 2023-05-08T03:55:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 697.574576 secs 2023-05-08T03:55:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:58 smithi096 ceph-mon[124666]: pgmap v437: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T03:55:59.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 698.127105 secs 2023-05-08T03:55:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 697.574576 secs 2023-05-08T03:55:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:58 smithi186 ceph-mon[126480]: pgmap v437: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T03:55:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 698.127105 secs 2023-05-08T03:56:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:55:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 699.404032 secs 2023-05-08T03:56:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:55:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 699.404032 secs 2023-05-08T03:56:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:55:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 699.404032 secs 2023-05-08T03:56:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:00 smithi186 ceph-mon[126480]: pgmap v438: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T03:56:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:00 smithi133 ceph-mon[125939]: pgmap v438: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T03:56:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:00 smithi096 ceph-mon[124666]: pgmap v438: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T03:56:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:03 smithi186 ceph-mon[126480]: pgmap v439: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T03:56:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 702.574641 secs 2023-05-08T03:56:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:03 smithi133 ceph-mon[125939]: pgmap v439: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T03:56:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 702.574641 secs 2023-05-08T03:56:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:03 smithi096 ceph-mon[124666]: pgmap v439: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T03:56:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 702.574641 secs 2023-05-08T03:56:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 703.127171 secs 2023-05-08T03:56:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 703.127171 secs 2023-05-08T03:56:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 703.127171 secs 2023-05-08T03:56:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:05 smithi186 ceph-mon[126480]: pgmap v440: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-05-08T03:56:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 704.404113 secs 2023-05-08T03:56:05.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:05 smithi133 ceph-mon[125939]: pgmap v440: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-05-08T03:56:05.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 704.404113 secs 2023-05-08T03:56:05.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:05 smithi096 ceph-mon[124666]: pgmap v440: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-05-08T03:56:05.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 704.404113 secs 2023-05-08T03:56:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:07 smithi186 ceph-mon[126480]: pgmap v441: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 20 op/s 2023-05-08T03:56:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:07 smithi133 ceph-mon[125939]: pgmap v441: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 20 op/s 2023-05-08T03:56:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:07 smithi096 ceph-mon[124666]: pgmap v441: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 20 op/s 2023-05-08T03:56:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 707.574754 secs 2023-05-08T03:56:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:08 smithi133 ceph-mon[125939]: pgmap v442: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 20 op/s 2023-05-08T03:56:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 708.127283 secs 2023-05-08T03:56:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 707.574754 secs 2023-05-08T03:56:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:08 smithi096 ceph-mon[124666]: pgmap v442: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 20 op/s 2023-05-08T03:56:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 708.127283 secs 2023-05-08T03:56:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 707.574754 secs 2023-05-08T03:56:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:08 smithi186 ceph-mon[126480]: pgmap v442: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 20 op/s 2023-05-08T03:56:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 708.127283 secs 2023-05-08T03:56:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 709.404230 secs 2023-05-08T03:56:10.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:10 smithi133 ceph-mon[125939]: osdmap e110: 12 total, 12 up, 12 in 2023-05-08T03:56:10.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:10 smithi133 ceph-mon[125939]: pgmap v444: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T03:56:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 709.404230 secs 2023-05-08T03:56:11.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:10 smithi096 ceph-mon[124666]: osdmap e110: 12 total, 12 up, 12 in 2023-05-08T03:56:11.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:10 smithi096 ceph-mon[124666]: pgmap v444: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T03:56:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 709.404230 secs 2023-05-08T03:56:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:10 smithi186 ceph-mon[126480]: osdmap e110: 12 total, 12 up, 12 in 2023-05-08T03:56:11.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:10 smithi186 ceph-mon[126480]: pgmap v444: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T03:56:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:13 smithi186 ceph-mon[126480]: pgmap v445: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T03:56:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 712.574882 secs 2023-05-08T03:56:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:13 smithi133 ceph-mon[125939]: pgmap v445: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T03:56:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 712.574882 secs 2023-05-08T03:56:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:13 smithi096 ceph-mon[124666]: pgmap v445: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T03:56:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 712.574882 secs 2023-05-08T03:56:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 713.127406 secs 2023-05-08T03:56:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 713.127406 secs 2023-05-08T03:56:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 713.127406 secs 2023-05-08T03:56:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:15 smithi186 ceph-mon[126480]: pgmap v446: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:56:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 714.404364 secs 2023-05-08T03:56:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:15 smithi133 ceph-mon[125939]: pgmap v446: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:56:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 714.404364 secs 2023-05-08T03:56:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:15 smithi096 ceph-mon[124666]: pgmap v446: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:56:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 714.404364 secs 2023-05-08T03:56:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:17 smithi186 ceph-mon[126480]: pgmap v447: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:56:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:17 smithi133 ceph-mon[125939]: pgmap v447: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:56:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:17 smithi096 ceph-mon[124666]: pgmap v447: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:56:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:18 smithi133 ceph-mon[125939]: osdmap e111: 12 total, 12 up, 12 in 2023-05-08T03:56:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 717.574953 secs 2023-05-08T03:56:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:18 smithi133 ceph-mon[125939]: pgmap v449: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 119 B/s wr, 3 op/s 2023-05-08T03:56:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 718.127533 secs 2023-05-08T03:56:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:18 smithi096 ceph-mon[124666]: osdmap e111: 12 total, 12 up, 12 in 2023-05-08T03:56:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 717.574953 secs 2023-05-08T03:56:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:18 smithi096 ceph-mon[124666]: pgmap v449: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 119 B/s wr, 3 op/s 2023-05-08T03:56:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 718.127533 secs 2023-05-08T03:56:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:18 smithi186 ceph-mon[126480]: osdmap e111: 12 total, 12 up, 12 in 2023-05-08T03:56:19.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 717.574953 secs 2023-05-08T03:56:19.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:18 smithi186 ceph-mon[126480]: pgmap v449: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 119 B/s wr, 3 op/s 2023-05-08T03:56:19.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 718.127533 secs 2023-05-08T03:56:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 719.404501 secs 2023-05-08T03:56:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 719.404501 secs 2023-05-08T03:56:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 719.404501 secs 2023-05-08T03:56:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:20 smithi186 ceph-mon[126480]: pgmap v450: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:56:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:20 smithi133 ceph-mon[125939]: pgmap v450: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:56:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:20 smithi096 ceph-mon[124666]: pgmap v450: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:56:23.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:23 smithi186 ceph-mon[126480]: pgmap v451: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:56:23.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:23 smithi186 ceph-mon[126480]: 1 slow requests, 1 included below; oldest blocked for > 722.575063 secs 2023-05-08T03:56:23.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:23 smithi186 ceph-mon[126480]: slow request 722.575062 seconds old, received at 2023-05-08T03:44:20.260233+0000: client_request(client.15258:3163 link #0x10000000007/0000000100000000000000F2 #0x10000000007/0000000100000000000000C5 2023-05-08T03:44:20.259302+0000 caller_uid=26, caller_gid=26{26,}) currently acquired locks 2023-05-08T03:56:23.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:23 smithi133 ceph-mon[125939]: pgmap v451: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:56:23.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:23 smithi133 ceph-mon[125939]: 1 slow requests, 1 included below; oldest blocked for > 722.575063 secs 2023-05-08T03:56:23.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:23 smithi133 ceph-mon[125939]: slow request 722.575062 seconds old, received at 2023-05-08T03:44:20.260233+0000: client_request(client.15258:3163 link #0x10000000007/0000000100000000000000F2 #0x10000000007/0000000100000000000000C5 2023-05-08T03:44:20.259302+0000 caller_uid=26, caller_gid=26{26,}) currently acquired locks 2023-05-08T03:56:23.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:23 smithi096 ceph-mon[124666]: pgmap v451: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:56:23.759 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:23 smithi096 ceph-mon[124666]: 1 slow requests, 1 included below; oldest blocked for > 722.575063 secs 2023-05-08T03:56:23.759 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:23 smithi096 ceph-mon[124666]: slow request 722.575062 seconds old, received at 2023-05-08T03:44:20.260233+0000: client_request(client.15258:3163 link #0x10000000007/0000000100000000000000F2 #0x10000000007/0000000100000000000000C5 2023-05-08T03:44:20.259302+0000 caller_uid=26, caller_gid=26{26,}) currently acquired locks 2023-05-08T03:56:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:24 smithi186 ceph-mon[126480]: 1 slow requests, 1 included below; oldest blocked for > 723.127676 secs 2023-05-08T03:56:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:24 smithi186 ceph-mon[126480]: slow request 723.127676 seconds old, received at 2023-05-08T03:44:20.272100+0000: peer_request:client.15258:3163 currently acquired locks 2023-05-08T03:56:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:24 smithi133 ceph-mon[125939]: 1 slow requests, 1 included below; oldest blocked for > 723.127676 secs 2023-05-08T03:56:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:24 smithi133 ceph-mon[125939]: slow request 723.127676 seconds old, received at 2023-05-08T03:44:20.272100+0000: peer_request:client.15258:3163 currently acquired locks 2023-05-08T03:56:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:24 smithi096 ceph-mon[124666]: 1 slow requests, 1 included below; oldest blocked for > 723.127676 secs 2023-05-08T03:56:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:24 smithi096 ceph-mon[124666]: slow request 723.127676 seconds old, received at 2023-05-08T03:44:20.272100+0000: peer_request:client.15258:3163 currently acquired locks 2023-05-08T03:56:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:25 smithi186 ceph-mon[126480]: pgmap v452: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2023-05-08T03:56:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:25 smithi186 ceph-mon[126480]: 1 slow requests, 1 included below; oldest blocked for > 724.404637 secs 2023-05-08T03:56:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:25 smithi186 ceph-mon[126480]: slow request 724.404636 seconds old, received at 2023-05-08T03:44:20.261840+0000: peer_request:client.15258:3163 currently dispatched 2023-05-08T03:56:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:25 smithi133 ceph-mon[125939]: pgmap v452: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2023-05-08T03:56:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:25 smithi133 ceph-mon[125939]: 1 slow requests, 1 included below; oldest blocked for > 724.404637 secs 2023-05-08T03:56:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:25 smithi133 ceph-mon[125939]: slow request 724.404636 seconds old, received at 2023-05-08T03:44:20.261840+0000: peer_request:client.15258:3163 currently dispatched 2023-05-08T03:56:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:25 smithi096 ceph-mon[124666]: pgmap v452: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2023-05-08T03:56:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:25 smithi096 ceph-mon[124666]: 1 slow requests, 1 included below; oldest blocked for > 724.404637 secs 2023-05-08T03:56:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:25 smithi096 ceph-mon[124666]: slow request 724.404636 seconds old, received at 2023-05-08T03:44:20.261840+0000: peer_request:client.15258:3163 currently dispatched 2023-05-08T03:56:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:27 smithi186 ceph-mon[126480]: pgmap v453: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2023-05-08T03:56:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:27 smithi133 ceph-mon[125939]: pgmap v453: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2023-05-08T03:56:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:27 smithi096 ceph-mon[124666]: pgmap v453: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2023-05-08T03:56:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 727.575170 secs 2023-05-08T03:56:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:28 smithi133 ceph-mon[125939]: pgmap v454: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T03:56:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 728.127793 secs 2023-05-08T03:56:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 727.575170 secs 2023-05-08T03:56:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:28 smithi096 ceph-mon[124666]: pgmap v454: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T03:56:29.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 728.127793 secs 2023-05-08T03:56:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 727.575170 secs 2023-05-08T03:56:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:28 smithi186 ceph-mon[126480]: pgmap v454: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T03:56:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 728.127793 secs 2023-05-08T03:56:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:31 smithi186 ceph-mon[126480]: pgmap v455: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 12 KiB/s wr, 8 op/s 2023-05-08T03:56:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:31 smithi133 ceph-mon[125939]: pgmap v455: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 12 KiB/s wr, 8 op/s 2023-05-08T03:56:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:31 smithi096 ceph-mon[124666]: pgmap v455: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 12 KiB/s wr, 8 op/s 2023-05-08T03:56:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:33 smithi186 ceph-mon[126480]: pgmap v456: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 11 KiB/s wr, 5 op/s 2023-05-08T03:56:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 732.575284 secs 2023-05-08T03:56:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:33 smithi133 ceph-mon[125939]: pgmap v456: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 11 KiB/s wr, 5 op/s 2023-05-08T03:56:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 732.575284 secs 2023-05-08T03:56:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:33 smithi096 ceph-mon[124666]: pgmap v456: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 11 KiB/s wr, 5 op/s 2023-05-08T03:56:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 732.575284 secs 2023-05-08T03:56:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:34 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T03:56:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 733.127899 secs 2023-05-08T03:56:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:34 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T03:56:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 733.127899 secs 2023-05-08T03:56:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:34 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T03:56:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 733.127899 secs 2023-05-08T03:56:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:35 smithi186 ceph-mon[126480]: pgmap v457: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 30 KiB/s wr, 10 op/s 2023-05-08T03:56:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:35 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T03:56:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:35 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T03:56:35.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:35 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:56:35.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 734.404808 secs 2023-05-08T03:56:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:35 smithi133 ceph-mon[125939]: pgmap v457: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 30 KiB/s wr, 10 op/s 2023-05-08T03:56:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:35 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T03:56:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:35 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T03:56:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:35 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:56:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 734.404808 secs 2023-05-08T03:56:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:35 smithi096 ceph-mon[124666]: pgmap v457: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 30 KiB/s wr, 10 op/s 2023-05-08T03:56:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:35 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T03:56:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:35 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T03:56:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:35 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:56:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 734.404808 secs 2023-05-08T03:56:37.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:37 smithi186 ceph-mon[126480]: pgmap v458: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 30 KiB/s wr, 7 op/s 2023-05-08T03:56:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:37 smithi133 ceph-mon[125939]: pgmap v458: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 30 KiB/s wr, 7 op/s 2023-05-08T03:56:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:37 smithi096 ceph-mon[124666]: pgmap v458: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 30 KiB/s wr, 7 op/s 2023-05-08T03:56:38.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:38 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T03:56:38.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:38 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:56:38.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:56:38.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 737.575394 secs 2023-05-08T03:56:38.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:56:38.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:56:38.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:56:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:38 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T03:56:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:38 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:56:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:56:38.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 737.575394 secs 2023-05-08T03:56:38.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:56:38.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:56:38.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:56:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:38 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T03:56:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:38 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:56:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:56:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 737.575394 secs 2023-05-08T03:56:38.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:56:38.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:56:38.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:56:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:39 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:56:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:39 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T03:56:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:39 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T03:56:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:39 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:56:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:39 smithi186 ceph-mon[126480]: pgmap v459: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 30 KiB/s wr, 7 op/s 2023-05-08T03:56:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 738.128039 secs 2023-05-08T03:56:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:39 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:56:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:39 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T03:56:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:39 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T03:56:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:39 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:56:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:39 smithi133 ceph-mon[125939]: pgmap v459: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 30 KiB/s wr, 7 op/s 2023-05-08T03:56:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 738.128039 secs 2023-05-08T03:56:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:39 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:56:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:39 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T03:56:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:39 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T03:56:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:39 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:56:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:39 smithi096 ceph-mon[124666]: pgmap v459: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 30 KiB/s wr, 7 op/s 2023-05-08T03:56:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 738.128039 secs 2023-05-08T03:56:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 739.404875 secs 2023-05-08T03:56:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 739.404875 secs 2023-05-08T03:56:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 739.404875 secs 2023-05-08T03:56:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:41 smithi186 ceph-mon[126480]: pgmap v460: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 35 KiB/s wr, 11 op/s 2023-05-08T03:56:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:41 smithi133 ceph-mon[125939]: pgmap v460: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 35 KiB/s wr, 11 op/s 2023-05-08T03:56:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:41 smithi096 ceph-mon[124666]: pgmap v460: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 35 KiB/s wr, 11 op/s 2023-05-08T03:56:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:43 smithi186 ceph-mon[126480]: pgmap v461: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 24 KiB/s wr, 7 op/s 2023-05-08T03:56:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:43 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T03:56:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 742.575484 secs 2023-05-08T03:56:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:43 smithi133 ceph-mon[125939]: pgmap v461: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 24 KiB/s wr, 7 op/s 2023-05-08T03:56:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:43 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T03:56:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 742.575484 secs 2023-05-08T03:56:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:43 smithi096 ceph-mon[124666]: pgmap v461: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 24 KiB/s wr, 7 op/s 2023-05-08T03:56:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:43 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T03:56:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 742.575484 secs 2023-05-08T03:56:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 743.128130 secs 2023-05-08T03:56:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 743.128130 secs 2023-05-08T03:56:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 743.128130 secs 2023-05-08T03:56:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:45 smithi186 ceph-mon[126480]: pgmap v462: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 10 op/s 2023-05-08T03:56:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 744.404954 secs 2023-05-08T03:56:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:45 smithi133 ceph-mon[125939]: pgmap v462: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 10 op/s 2023-05-08T03:56:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 744.404954 secs 2023-05-08T03:56:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:45 smithi096 ceph-mon[124666]: pgmap v462: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 10 op/s 2023-05-08T03:56:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 744.404954 secs 2023-05-08T03:56:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:47 smithi186 ceph-mon[126480]: pgmap v463: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.6 KiB/s wr, 6 op/s 2023-05-08T03:56:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:47 smithi133 ceph-mon[125939]: pgmap v463: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.6 KiB/s wr, 6 op/s 2023-05-08T03:56:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:47 smithi096 ceph-mon[124666]: pgmap v463: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.6 KiB/s wr, 6 op/s 2023-05-08T03:56:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 747.575578 secs 2023-05-08T03:56:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:48 smithi133 ceph-mon[125939]: pgmap v464: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.5 KiB/s wr, 5 op/s 2023-05-08T03:56:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 748.128250 secs 2023-05-08T03:56:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 747.575578 secs 2023-05-08T03:56:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:48 smithi096 ceph-mon[124666]: pgmap v464: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.5 KiB/s wr, 5 op/s 2023-05-08T03:56:49.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 748.128250 secs 2023-05-08T03:56:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 747.575578 secs 2023-05-08T03:56:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:48 smithi186 ceph-mon[126480]: pgmap v464: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.5 KiB/s wr, 5 op/s 2023-05-08T03:56:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 748.128250 secs 2023-05-08T03:56:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 749.405050 secs 2023-05-08T03:56:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 749.405050 secs 2023-05-08T03:56:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 749.405050 secs 2023-05-08T03:56:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:50 smithi186 ceph-mon[126480]: pgmap v465: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 5.5 KiB/s wr, 8 op/s 2023-05-08T03:56:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:50 smithi133 ceph-mon[125939]: pgmap v465: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 5.5 KiB/s wr, 8 op/s 2023-05-08T03:56:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:50 smithi096 ceph-mon[124666]: pgmap v465: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 5.5 KiB/s wr, 8 op/s 2023-05-08T03:56:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:53 smithi186 ceph-mon[126480]: pgmap v466: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T03:56:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 752.575703 secs 2023-05-08T03:56:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:53 smithi133 ceph-mon[125939]: pgmap v466: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T03:56:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 752.575703 secs 2023-05-08T03:56:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:53 smithi096 ceph-mon[124666]: pgmap v466: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T03:56:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 752.575703 secs 2023-05-08T03:56:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 753.128387 secs 2023-05-08T03:56:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 753.128387 secs 2023-05-08T03:56:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 753.128387 secs 2023-05-08T03:56:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:55 smithi186 ceph-mon[126480]: pgmap v467: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T03:56:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 754.405167 secs 2023-05-08T03:56:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:55 smithi133 ceph-mon[125939]: pgmap v467: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T03:56:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 754.405167 secs 2023-05-08T03:56:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:55 smithi096 ceph-mon[124666]: pgmap v467: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T03:56:55.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 754.405167 secs 2023-05-08T03:56:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:57 smithi186 ceph-mon[126480]: pgmap v468: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:56:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:57 smithi133 ceph-mon[125939]: pgmap v468: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:56:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:57 smithi096 ceph-mon[124666]: pgmap v468: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:56:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 757.575811 secs 2023-05-08T03:56:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:58 smithi133 ceph-mon[125939]: pgmap v469: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:56:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 758.128537 secs 2023-05-08T03:56:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 757.575811 secs 2023-05-08T03:56:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:58 smithi096 ceph-mon[124666]: pgmap v469: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:56:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 758.128537 secs 2023-05-08T03:56:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 757.575811 secs 2023-05-08T03:56:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:58 smithi186 ceph-mon[126480]: pgmap v469: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:56:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 758.128537 secs 2023-05-08T03:57:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:56:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 759.405315 secs 2023-05-08T03:57:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:56:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 759.405315 secs 2023-05-08T03:57:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:56:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 759.405315 secs 2023-05-08T03:57:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:00 smithi186 ceph-mon[126480]: pgmap v470: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T03:57:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:00 smithi133 ceph-mon[125939]: pgmap v470: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T03:57:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:00 smithi096 ceph-mon[124666]: pgmap v470: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T03:57:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:03 smithi186 ceph-mon[126480]: pgmap v471: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:57:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 762.575923 secs 2023-05-08T03:57:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:03 smithi133 ceph-mon[125939]: pgmap v471: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:57:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 762.575923 secs 2023-05-08T03:57:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:03 smithi096 ceph-mon[124666]: pgmap v471: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:57:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 762.575923 secs 2023-05-08T03:57:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 763.128657 secs 2023-05-08T03:57:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 763.128657 secs 2023-05-08T03:57:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 763.128657 secs 2023-05-08T03:57:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:05 smithi186 ceph-mon[126480]: pgmap v472: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T03:57:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 764.405455 secs 2023-05-08T03:57:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:05 smithi133 ceph-mon[125939]: pgmap v472: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T03:57:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 764.405455 secs 2023-05-08T03:57:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:05 smithi096 ceph-mon[124666]: pgmap v472: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T03:57:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 764.405455 secs 2023-05-08T03:57:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:07 smithi186 ceph-mon[126480]: pgmap v473: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T03:57:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:07 smithi133 ceph-mon[125939]: pgmap v473: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T03:57:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:07 smithi096 ceph-mon[124666]: pgmap v473: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T03:57:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 767.576015 secs 2023-05-08T03:57:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:08 smithi133 ceph-mon[125939]: pgmap v474: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T03:57:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 768.128731 secs 2023-05-08T03:57:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 767.576015 secs 2023-05-08T03:57:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:08 smithi096 ceph-mon[124666]: pgmap v474: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T03:57:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 768.128731 secs 2023-05-08T03:57:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 767.576015 secs 2023-05-08T03:57:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:08 smithi186 ceph-mon[126480]: pgmap v474: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T03:57:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 768.128731 secs 2023-05-08T03:57:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 769.405591 secs 2023-05-08T03:57:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:10 smithi133 ceph-mon[125939]: osdmap e112: 12 total, 12 up, 12 in 2023-05-08T03:57:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:10 smithi133 ceph-mon[125939]: pgmap v476: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T03:57:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 769.405591 secs 2023-05-08T03:57:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:10 smithi096 ceph-mon[124666]: osdmap e112: 12 total, 12 up, 12 in 2023-05-08T03:57:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:10 smithi096 ceph-mon[124666]: pgmap v476: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T03:57:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 769.405591 secs 2023-05-08T03:57:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:10 smithi186 ceph-mon[126480]: osdmap e112: 12 total, 12 up, 12 in 2023-05-08T03:57:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:10 smithi186 ceph-mon[126480]: pgmap v476: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T03:57:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:13 smithi186 ceph-mon[126480]: pgmap v477: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T03:57:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 772.576079 secs 2023-05-08T03:57:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:13 smithi133 ceph-mon[125939]: pgmap v477: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T03:57:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 772.576079 secs 2023-05-08T03:57:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:13 smithi096 ceph-mon[124666]: pgmap v477: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T03:57:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 772.576079 secs 2023-05-08T03:57:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 773.128874 secs 2023-05-08T03:57:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 773.128874 secs 2023-05-08T03:57:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 773.128874 secs 2023-05-08T03:57:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:15 smithi186 ceph-mon[126480]: pgmap v478: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:57:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 774.405729 secs 2023-05-08T03:57:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:15 smithi133 ceph-mon[125939]: pgmap v478: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:57:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 774.405729 secs 2023-05-08T03:57:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:15 smithi096 ceph-mon[124666]: pgmap v478: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:57:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 774.405729 secs 2023-05-08T03:57:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:17 smithi186 ceph-mon[126480]: pgmap v479: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:57:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:17 smithi133 ceph-mon[125939]: pgmap v479: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:57:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:17 smithi096 ceph-mon[124666]: pgmap v479: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:57:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:18 smithi133 ceph-mon[125939]: osdmap e113: 12 total, 12 up, 12 in 2023-05-08T03:57:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 777.576174 secs 2023-05-08T03:57:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:18 smithi133 ceph-mon[125939]: pgmap v481: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 119 B/s wr, 3 op/s 2023-05-08T03:57:18.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 778.128937 secs 2023-05-08T03:57:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:18 smithi096 ceph-mon[124666]: osdmap e113: 12 total, 12 up, 12 in 2023-05-08T03:57:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 777.576174 secs 2023-05-08T03:57:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:18 smithi096 ceph-mon[124666]: pgmap v481: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 119 B/s wr, 3 op/s 2023-05-08T03:57:19.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 778.128937 secs 2023-05-08T03:57:19.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:18 smithi186 ceph-mon[126480]: osdmap e113: 12 total, 12 up, 12 in 2023-05-08T03:57:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 777.576174 secs 2023-05-08T03:57:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:18 smithi186 ceph-mon[126480]: pgmap v481: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 119 B/s wr, 3 op/s 2023-05-08T03:57:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 778.128937 secs 2023-05-08T03:57:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 779.405864 secs 2023-05-08T03:57:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 779.405864 secs 2023-05-08T03:57:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 779.405864 secs 2023-05-08T03:57:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:20 smithi186 ceph-mon[126480]: pgmap v482: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:57:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:20 smithi133 ceph-mon[125939]: pgmap v482: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:57:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:20 smithi096 ceph-mon[124666]: pgmap v482: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:57:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:23 smithi186 ceph-mon[126480]: pgmap v483: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:57:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 782.576286 secs 2023-05-08T03:57:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:23 smithi133 ceph-mon[125939]: pgmap v483: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:57:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 782.576286 secs 2023-05-08T03:57:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:23 smithi096 ceph-mon[124666]: pgmap v483: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:57:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 782.576286 secs 2023-05-08T03:57:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 783.129050 secs 2023-05-08T03:57:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 783.129050 secs 2023-05-08T03:57:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 783.129050 secs 2023-05-08T03:57:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:25 smithi186 ceph-mon[126480]: pgmap v484: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T03:57:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 784.406001 secs 2023-05-08T03:57:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:25 smithi133 ceph-mon[125939]: pgmap v484: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T03:57:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 784.406001 secs 2023-05-08T03:57:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:25 smithi096 ceph-mon[124666]: pgmap v484: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T03:57:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 784.406001 secs 2023-05-08T03:57:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:27 smithi186 ceph-mon[126480]: pgmap v485: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T03:57:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:27 smithi133 ceph-mon[125939]: pgmap v485: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T03:57:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:27 smithi096 ceph-mon[124666]: pgmap v485: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T03:57:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 787.576398 secs 2023-05-08T03:57:28.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:28 smithi133 ceph-mon[125939]: pgmap v486: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T03:57:28.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 788.129187 secs 2023-05-08T03:57:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 787.576398 secs 2023-05-08T03:57:29.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:28 smithi096 ceph-mon[124666]: pgmap v486: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T03:57:29.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 788.129187 secs 2023-05-08T03:57:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 787.576398 secs 2023-05-08T03:57:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:28 smithi186 ceph-mon[126480]: pgmap v486: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T03:57:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 788.129187 secs 2023-05-08T03:57:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:31 smithi186 ceph-mon[126480]: pgmap v487: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 12 KiB/s wr, 8 op/s 2023-05-08T03:57:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:31 smithi133 ceph-mon[125939]: pgmap v487: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 12 KiB/s wr, 8 op/s 2023-05-08T03:57:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:31 smithi096 ceph-mon[124666]: pgmap v487: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 12 KiB/s wr, 8 op/s 2023-05-08T03:57:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:33 smithi186 ceph-mon[126480]: pgmap v488: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 12 KiB/s wr, 5 op/s 2023-05-08T03:57:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 792.576488 secs 2023-05-08T03:57:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:33 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T03:57:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:33 smithi133 ceph-mon[125939]: pgmap v488: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 12 KiB/s wr, 5 op/s 2023-05-08T03:57:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 792.576488 secs 2023-05-08T03:57:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:33 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T03:57:33.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:33 smithi096 ceph-mon[124666]: pgmap v488: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 12 KiB/s wr, 5 op/s 2023-05-08T03:57:33.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 792.576488 secs 2023-05-08T03:57:33.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:33 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T03:57:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 793.129283 secs 2023-05-08T03:57:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:34 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T03:57:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:34 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T03:57:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:34 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:57:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 793.129283 secs 2023-05-08T03:57:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:34 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T03:57:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:34 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T03:57:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:34 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:57:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 793.129283 secs 2023-05-08T03:57:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:34 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T03:57:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:34 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T03:57:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:34 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:57:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:35 smithi186 ceph-mon[126480]: pgmap v489: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 33 KiB/s wr, 10 op/s 2023-05-08T03:57:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 794.406277 secs 2023-05-08T03:57:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:35 smithi133 ceph-mon[125939]: pgmap v489: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 33 KiB/s wr, 10 op/s 2023-05-08T03:57:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 794.406277 secs 2023-05-08T03:57:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:35 smithi096 ceph-mon[124666]: pgmap v489: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 33 KiB/s wr, 10 op/s 2023-05-08T03:57:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 794.406277 secs 2023-05-08T03:57:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:37 smithi186 ceph-mon[126480]: pgmap v490: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 33 KiB/s wr, 7 op/s 2023-05-08T03:57:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:37 smithi133 ceph-mon[125939]: pgmap v490: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 33 KiB/s wr, 7 op/s 2023-05-08T03:57:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:37 smithi096 ceph-mon[124666]: pgmap v490: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 33 KiB/s wr, 7 op/s 2023-05-08T03:57:38.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:38 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T03:57:38.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:38 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:57:38.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 797.576615 secs 2023-05-08T03:57:38.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:57:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:38 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T03:57:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:38 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:57:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 797.576615 secs 2023-05-08T03:57:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:57:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:38 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T03:57:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:38 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:57:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 797.576615 secs 2023-05-08T03:57:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:57:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:39 smithi186 ceph-mon[126480]: pgmap v491: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 33 KiB/s wr, 7 op/s 2023-05-08T03:57:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 798.129375 secs 2023-05-08T03:57:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:57:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:57:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:57:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:39 smithi133 ceph-mon[125939]: pgmap v491: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 33 KiB/s wr, 7 op/s 2023-05-08T03:57:39.744 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 798.129375 secs 2023-05-08T03:57:39.744 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:57:39.745 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:57:39.745 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:57:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:39 smithi096 ceph-mon[124666]: pgmap v491: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 33 KiB/s wr, 7 op/s 2023-05-08T03:57:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 798.129375 secs 2023-05-08T03:57:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:57:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:57:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:57:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:40 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:57:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:40 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T03:57:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:40 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T03:57:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:40 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:57:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 799.406410 secs 2023-05-08T03:57:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:40 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:57:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:40 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T03:57:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:40 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T03:57:40.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:40 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:57:40.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 799.406410 secs 2023-05-08T03:57:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:40 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:57:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:40 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T03:57:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:40 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T03:57:40.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:40 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:57:40.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 799.406410 secs 2023-05-08T03:57:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:41 smithi186 ceph-mon[126480]: pgmap v492: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 38 KiB/s wr, 10 op/s 2023-05-08T03:57:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:41 smithi133 ceph-mon[125939]: pgmap v492: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 38 KiB/s wr, 10 op/s 2023-05-08T03:57:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:41 smithi096 ceph-mon[124666]: pgmap v492: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 38 KiB/s wr, 10 op/s 2023-05-08T03:57:43.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:43 smithi186 ceph-mon[126480]: pgmap v493: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 7 op/s 2023-05-08T03:57:43.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:43 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T03:57:43.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 802.576719 secs 2023-05-08T03:57:43.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:43 smithi133 ceph-mon[125939]: pgmap v493: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 7 op/s 2023-05-08T03:57:43.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:43 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T03:57:43.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 802.576719 secs 2023-05-08T03:57:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:43 smithi096 ceph-mon[124666]: pgmap v493: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 7 op/s 2023-05-08T03:57:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:43 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T03:57:43.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 802.576719 secs 2023-05-08T03:57:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 803.129530 secs 2023-05-08T03:57:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 803.129530 secs 2023-05-08T03:57:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 803.129530 secs 2023-05-08T03:57:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:45 smithi186 ceph-mon[126480]: pgmap v494: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 10 op/s 2023-05-08T03:57:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 804.406492 secs 2023-05-08T03:57:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:45 smithi133 ceph-mon[125939]: pgmap v494: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 10 op/s 2023-05-08T03:57:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 804.406492 secs 2023-05-08T03:57:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:45 smithi096 ceph-mon[124666]: pgmap v494: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 10 op/s 2023-05-08T03:57:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 804.406492 secs 2023-05-08T03:57:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:47 smithi133 ceph-mon[125939]: pgmap v495: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.4 KiB/s wr, 5 op/s 2023-05-08T03:57:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:47 smithi096 ceph-mon[124666]: pgmap v495: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.4 KiB/s wr, 5 op/s 2023-05-08T03:57:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:47 smithi186 ceph-mon[126480]: pgmap v495: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.4 KiB/s wr, 5 op/s 2023-05-08T03:57:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 807.576837 secs 2023-05-08T03:57:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:48 smithi133 ceph-mon[125939]: pgmap v496: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.3 KiB/s wr, 5 op/s 2023-05-08T03:57:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 808.129696 secs 2023-05-08T03:57:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 807.576837 secs 2023-05-08T03:57:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:48 smithi096 ceph-mon[124666]: pgmap v496: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.3 KiB/s wr, 5 op/s 2023-05-08T03:57:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 808.129696 secs 2023-05-08T03:57:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 807.576837 secs 2023-05-08T03:57:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:48 smithi186 ceph-mon[126480]: pgmap v496: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.3 KiB/s wr, 5 op/s 2023-05-08T03:57:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 808.129696 secs 2023-05-08T03:57:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 809.406626 secs 2023-05-08T03:57:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 809.406626 secs 2023-05-08T03:57:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 809.406626 secs 2023-05-08T03:57:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:50 smithi186 ceph-mon[126480]: pgmap v497: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 5.3 KiB/s wr, 7 op/s 2023-05-08T03:57:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:50 smithi133 ceph-mon[125939]: pgmap v497: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 5.3 KiB/s wr, 7 op/s 2023-05-08T03:57:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:50 smithi096 ceph-mon[124666]: pgmap v497: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 5.3 KiB/s wr, 7 op/s 2023-05-08T03:57:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:53 smithi186 ceph-mon[126480]: pgmap v498: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:57:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 812.576900 secs 2023-05-08T03:57:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:53 smithi133 ceph-mon[125939]: pgmap v498: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:57:53.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 812.576900 secs 2023-05-08T03:57:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:53 smithi096 ceph-mon[124666]: pgmap v498: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:57:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 812.576900 secs 2023-05-08T03:57:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 813.129841 secs 2023-05-08T03:57:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 813.129841 secs 2023-05-08T03:57:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 813.129841 secs 2023-05-08T03:57:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:55 smithi186 ceph-mon[126480]: pgmap v499: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T03:57:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 814.406761 secs 2023-05-08T03:57:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:55 smithi133 ceph-mon[125939]: pgmap v499: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T03:57:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 814.406761 secs 2023-05-08T03:57:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:55 smithi096 ceph-mon[124666]: pgmap v499: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T03:57:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 814.406761 secs 2023-05-08T03:57:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:57 smithi186 ceph-mon[126480]: pgmap v500: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:57:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:57 smithi133 ceph-mon[125939]: pgmap v500: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:57:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:57 smithi096 ceph-mon[124666]: pgmap v500: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:57:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 817.577018 secs 2023-05-08T03:57:58.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:58 smithi133 ceph-mon[125939]: pgmap v501: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:57:58.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 818.129955 secs 2023-05-08T03:57:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 817.577018 secs 2023-05-08T03:57:59.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:58 smithi096 ceph-mon[124666]: pgmap v501: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:57:59.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 818.129955 secs 2023-05-08T03:57:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 817.577018 secs 2023-05-08T03:57:59.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:58 smithi186 ceph-mon[126480]: pgmap v501: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:57:59.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 818.129955 secs 2023-05-08T03:58:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:57:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 819.406899 secs 2023-05-08T03:58:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:57:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 819.406899 secs 2023-05-08T03:58:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:57:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 819.406899 secs 2023-05-08T03:58:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:00 smithi186 ceph-mon[126480]: pgmap v502: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T03:58:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:00 smithi133 ceph-mon[125939]: pgmap v502: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T03:58:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:00 smithi096 ceph-mon[124666]: pgmap v502: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T03:58:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:03 smithi186 ceph-mon[126480]: pgmap v503: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:58:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 822.577136 secs 2023-05-08T03:58:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:03 smithi133 ceph-mon[125939]: pgmap v503: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:58:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 822.577136 secs 2023-05-08T03:58:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:03 smithi096 ceph-mon[124666]: pgmap v503: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:58:03.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 822.577136 secs 2023-05-08T03:58:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 823.130088 secs 2023-05-08T03:58:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 823.130088 secs 2023-05-08T03:58:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 823.130088 secs 2023-05-08T03:58:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:05 smithi186 ceph-mon[126480]: pgmap v504: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T03:58:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 824.407013 secs 2023-05-08T03:58:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:05 smithi133 ceph-mon[125939]: pgmap v504: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T03:58:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 824.407013 secs 2023-05-08T03:58:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:05 smithi096 ceph-mon[124666]: pgmap v504: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T03:58:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 824.407013 secs 2023-05-08T03:58:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:07 smithi186 ceph-mon[126480]: pgmap v505: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T03:58:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:07 smithi133 ceph-mon[125939]: pgmap v505: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T03:58:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:07 smithi096 ceph-mon[124666]: pgmap v505: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T03:58:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 827.577253 secs 2023-05-08T03:58:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:08 smithi133 ceph-mon[125939]: pgmap v506: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T03:58:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 828.130231 secs 2023-05-08T03:58:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 827.577253 secs 2023-05-08T03:58:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:08 smithi096 ceph-mon[124666]: pgmap v506: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T03:58:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 828.130231 secs 2023-05-08T03:58:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 827.577253 secs 2023-05-08T03:58:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:08 smithi186 ceph-mon[126480]: pgmap v506: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T03:58:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 828.130231 secs 2023-05-08T03:58:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 829.407150 secs 2023-05-08T03:58:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:10 smithi133 ceph-mon[125939]: osdmap e114: 12 total, 12 up, 12 in 2023-05-08T03:58:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:10 smithi133 ceph-mon[125939]: pgmap v508: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T03:58:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 829.407150 secs 2023-05-08T03:58:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:10 smithi096 ceph-mon[124666]: osdmap e114: 12 total, 12 up, 12 in 2023-05-08T03:58:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:10 smithi096 ceph-mon[124666]: pgmap v508: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T03:58:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 829.407150 secs 2023-05-08T03:58:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:10 smithi186 ceph-mon[126480]: osdmap e114: 12 total, 12 up, 12 in 2023-05-08T03:58:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:10 smithi186 ceph-mon[126480]: pgmap v508: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T03:58:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:13 smithi186 ceph-mon[126480]: pgmap v509: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T03:58:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 832.577369 secs 2023-05-08T03:58:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:13 smithi133 ceph-mon[125939]: pgmap v509: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T03:58:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 832.577369 secs 2023-05-08T03:58:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:13 smithi096 ceph-mon[124666]: pgmap v509: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T03:58:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 832.577369 secs 2023-05-08T03:58:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 833.130370 secs 2023-05-08T03:58:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 833.130370 secs 2023-05-08T03:58:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 833.130370 secs 2023-05-08T03:58:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:15 smithi186 ceph-mon[126480]: pgmap v510: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:58:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 834.407264 secs 2023-05-08T03:58:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:15 smithi133 ceph-mon[125939]: pgmap v510: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:58:15.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 834.407264 secs 2023-05-08T03:58:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:15 smithi096 ceph-mon[124666]: pgmap v510: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:58:15.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 834.407264 secs 2023-05-08T03:58:17.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:17 smithi186 ceph-mon[126480]: pgmap v511: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:58:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:17 smithi133 ceph-mon[125939]: pgmap v511: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:58:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:17 smithi096 ceph-mon[124666]: pgmap v511: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:58:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:18 smithi133 ceph-mon[125939]: osdmap e115: 12 total, 12 up, 12 in 2023-05-08T03:58:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 837.577452 secs 2023-05-08T03:58:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:18 smithi133 ceph-mon[125939]: pgmap v513: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 119 B/s wr, 3 op/s 2023-05-08T03:58:18.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 838.130508 secs 2023-05-08T03:58:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:18 smithi096 ceph-mon[124666]: osdmap e115: 12 total, 12 up, 12 in 2023-05-08T03:58:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 837.577452 secs 2023-05-08T03:58:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:18 smithi096 ceph-mon[124666]: pgmap v513: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 119 B/s wr, 3 op/s 2023-05-08T03:58:19.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 838.130508 secs 2023-05-08T03:58:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:18 smithi186 ceph-mon[126480]: osdmap e115: 12 total, 12 up, 12 in 2023-05-08T03:58:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 837.577452 secs 2023-05-08T03:58:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:18 smithi186 ceph-mon[126480]: pgmap v513: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 119 B/s wr, 3 op/s 2023-05-08T03:58:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 838.130508 secs 2023-05-08T03:58:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 839.407402 secs 2023-05-08T03:58:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 839.407402 secs 2023-05-08T03:58:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 839.407402 secs 2023-05-08T03:58:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:20 smithi186 ceph-mon[126480]: pgmap v514: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:58:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:20 smithi133 ceph-mon[125939]: pgmap v514: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:58:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:20 smithi096 ceph-mon[124666]: pgmap v514: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:58:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:23 smithi186 ceph-mon[126480]: pgmap v515: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:58:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 842.577532 secs 2023-05-08T03:58:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:23 smithi133 ceph-mon[125939]: pgmap v515: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:58:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 842.577532 secs 2023-05-08T03:58:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:23 smithi096 ceph-mon[124666]: pgmap v515: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:58:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 842.577532 secs 2023-05-08T03:58:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 843.130648 secs 2023-05-08T03:58:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 843.130648 secs 2023-05-08T03:58:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 843.130648 secs 2023-05-08T03:58:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:25 smithi186 ceph-mon[126480]: pgmap v516: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T03:58:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 844.407538 secs 2023-05-08T03:58:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:25 smithi133 ceph-mon[125939]: pgmap v516: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T03:58:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 844.407538 secs 2023-05-08T03:58:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:25 smithi096 ceph-mon[124666]: pgmap v516: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T03:58:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 844.407538 secs 2023-05-08T03:58:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:27 smithi186 ceph-mon[126480]: pgmap v517: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T03:58:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:27 smithi133 ceph-mon[125939]: pgmap v517: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T03:58:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:27 smithi096 ceph-mon[124666]: pgmap v517: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T03:58:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 847.577609 secs 2023-05-08T03:58:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:28 smithi133 ceph-mon[125939]: pgmap v518: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T03:58:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 848.130786 secs 2023-05-08T03:58:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 847.577609 secs 2023-05-08T03:58:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:28 smithi096 ceph-mon[124666]: pgmap v518: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T03:58:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 848.130786 secs 2023-05-08T03:58:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 847.577609 secs 2023-05-08T03:58:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:28 smithi186 ceph-mon[126480]: pgmap v518: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T03:58:29.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 848.130786 secs 2023-05-08T03:58:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:31 smithi186 ceph-mon[126480]: pgmap v519: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 13 KiB/s wr, 8 op/s 2023-05-08T03:58:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:31 smithi133 ceph-mon[125939]: pgmap v519: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 13 KiB/s wr, 8 op/s 2023-05-08T03:58:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:31 smithi096 ceph-mon[124666]: pgmap v519: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 13 KiB/s wr, 8 op/s 2023-05-08T03:58:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:33 smithi186 ceph-mon[126480]: pgmap v520: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 13 KiB/s wr, 5 op/s 2023-05-08T03:58:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 852.577671 secs 2023-05-08T03:58:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:33 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T03:58:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:33 smithi133 ceph-mon[125939]: pgmap v520: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 13 KiB/s wr, 5 op/s 2023-05-08T03:58:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 852.577671 secs 2023-05-08T03:58:33.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:33 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T03:58:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:33 smithi096 ceph-mon[124666]: pgmap v520: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 13 KiB/s wr, 5 op/s 2023-05-08T03:58:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 852.577671 secs 2023-05-08T03:58:33.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:33 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T03:58:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 853.130926 secs 2023-05-08T03:58:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:34 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T03:58:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:34 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T03:58:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:34 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:58:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 853.130926 secs 2023-05-08T03:58:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:34 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T03:58:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:34 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T03:58:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:34 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:58:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 853.130926 secs 2023-05-08T03:58:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:34 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T03:58:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:34 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T03:58:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:34 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:58:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:35 smithi186 ceph-mon[126480]: pgmap v521: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 33 KiB/s wr, 9 op/s 2023-05-08T03:58:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 854.407825 secs 2023-05-08T03:58:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:35 smithi133 ceph-mon[125939]: pgmap v521: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 33 KiB/s wr, 9 op/s 2023-05-08T03:58:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 854.407825 secs 2023-05-08T03:58:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:35 smithi096 ceph-mon[124666]: pgmap v521: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 33 KiB/s wr, 9 op/s 2023-05-08T03:58:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 854.407825 secs 2023-05-08T03:58:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:37 smithi186 ceph-mon[126480]: pgmap v522: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 34 KiB/s wr, 7 op/s 2023-05-08T03:58:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:37 smithi133 ceph-mon[125939]: pgmap v522: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 34 KiB/s wr, 7 op/s 2023-05-08T03:58:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:37 smithi096 ceph-mon[124666]: pgmap v522: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 34 KiB/s wr, 7 op/s 2023-05-08T03:58:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:38 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T03:58:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:38 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:58:38.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 857.577785 secs 2023-05-08T03:58:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:38 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T03:58:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:38 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:58:38.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 857.577785 secs 2023-05-08T03:58:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:38 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T03:58:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:38 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:58:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 857.577785 secs 2023-05-08T03:58:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:39 smithi133 ceph-mon[125939]: pgmap v523: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 34 KiB/s wr, 7 op/s 2023-05-08T03:58:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 858.131059 secs 2023-05-08T03:58:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:58:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:39 smithi096 ceph-mon[124666]: pgmap v523: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 34 KiB/s wr, 7 op/s 2023-05-08T03:58:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 858.131059 secs 2023-05-08T03:58:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:58:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:39 smithi186 ceph-mon[126480]: pgmap v523: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 34 KiB/s wr, 7 op/s 2023-05-08T03:58:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 858.131059 secs 2023-05-08T03:58:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:58:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 859.407902 secs 2023-05-08T03:58:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:40 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:58:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:40 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:58:40.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:40 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:58:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 859.407902 secs 2023-05-08T03:58:40.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:40 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:58:40.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:40 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:58:40.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:40 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:58:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 859.407902 secs 2023-05-08T03:58:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:40 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:58:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:40 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:58:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:40 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:58:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:41 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:58:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:41 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T03:58:41.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:41 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T03:58:41.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:41 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:58:41.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:41 smithi133 ceph-mon[125939]: pgmap v524: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 39 KiB/s wr, 10 op/s 2023-05-08T03:58:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:41 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:58:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:41 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T03:58:41.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:41 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T03:58:41.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:41 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:58:41.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:41 smithi096 ceph-mon[124666]: pgmap v524: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 39 KiB/s wr, 10 op/s 2023-05-08T03:58:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:41 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:58:41.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:41 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T03:58:41.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:41 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T03:58:41.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:41 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:58:41.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:41 smithi186 ceph-mon[126480]: pgmap v524: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 39 KiB/s wr, 10 op/s 2023-05-08T03:58:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:43 smithi133 ceph-mon[125939]: pgmap v525: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 7 op/s 2023-05-08T03:58:43.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:43 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T03:58:43.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 862.577901 secs 2023-05-08T03:58:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:43 smithi096 ceph-mon[124666]: pgmap v525: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 7 op/s 2023-05-08T03:58:43.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:43 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T03:58:43.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 862.577901 secs 2023-05-08T03:58:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:43 smithi186 ceph-mon[126480]: pgmap v525: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 7 op/s 2023-05-08T03:58:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:43 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T03:58:43.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 862.577901 secs 2023-05-08T03:58:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 863.131196 secs 2023-05-08T03:58:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 863.131196 secs 2023-05-08T03:58:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 863.131196 secs 2023-05-08T03:58:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:45 smithi133 ceph-mon[125939]: pgmap v526: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 9 op/s 2023-05-08T03:58:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 864.407979 secs 2023-05-08T03:58:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:45 smithi096 ceph-mon[124666]: pgmap v526: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 9 op/s 2023-05-08T03:58:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 864.407979 secs 2023-05-08T03:58:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:45 smithi186 ceph-mon[126480]: pgmap v526: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 9 op/s 2023-05-08T03:58:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 864.407979 secs 2023-05-08T03:58:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:47 smithi133 ceph-mon[125939]: pgmap v527: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.8 KiB/s wr, 5 op/s 2023-05-08T03:58:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:47 smithi096 ceph-mon[124666]: pgmap v527: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.8 KiB/s wr, 5 op/s 2023-05-08T03:58:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:47 smithi186 ceph-mon[126480]: pgmap v527: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.8 KiB/s wr, 5 op/s 2023-05-08T03:58:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 867.578013 secs 2023-05-08T03:58:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:48 smithi133 ceph-mon[125939]: pgmap v528: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.7 KiB/s wr, 5 op/s 2023-05-08T03:58:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 868.131336 secs 2023-05-08T03:58:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 867.578013 secs 2023-05-08T03:58:49.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:48 smithi096 ceph-mon[124666]: pgmap v528: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.7 KiB/s wr, 5 op/s 2023-05-08T03:58:49.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 868.131336 secs 2023-05-08T03:58:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 867.578013 secs 2023-05-08T03:58:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:48 smithi186 ceph-mon[126480]: pgmap v528: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.7 KiB/s wr, 5 op/s 2023-05-08T03:58:49.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 868.131336 secs 2023-05-08T03:58:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 869.408059 secs 2023-05-08T03:58:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 869.408059 secs 2023-05-08T03:58:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 869.408059 secs 2023-05-08T03:58:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:50 smithi186 ceph-mon[126480]: pgmap v529: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 5.7 KiB/s wr, 7 op/s 2023-05-08T03:58:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:50 smithi133 ceph-mon[125939]: pgmap v529: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 5.7 KiB/s wr, 7 op/s 2023-05-08T03:58:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:50 smithi096 ceph-mon[124666]: pgmap v529: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 5.7 KiB/s wr, 7 op/s 2023-05-08T03:58:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:53 smithi186 ceph-mon[126480]: pgmap v530: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:58:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 872.578132 secs 2023-05-08T03:58:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:53 smithi133 ceph-mon[125939]: pgmap v530: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:58:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 872.578132 secs 2023-05-08T03:58:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:53 smithi096 ceph-mon[124666]: pgmap v530: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:58:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 872.578132 secs 2023-05-08T03:58:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 873.131494 secs 2023-05-08T03:58:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 873.131494 secs 2023-05-08T03:58:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 873.131494 secs 2023-05-08T03:58:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:55 smithi186 ceph-mon[126480]: pgmap v531: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T03:58:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 874.408173 secs 2023-05-08T03:58:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:55 smithi133 ceph-mon[125939]: pgmap v531: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T03:58:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 874.408173 secs 2023-05-08T03:58:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:55 smithi096 ceph-mon[124666]: pgmap v531: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T03:58:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 874.408173 secs 2023-05-08T03:58:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:57 smithi133 ceph-mon[125939]: pgmap v532: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:58:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:57 smithi096 ceph-mon[124666]: pgmap v532: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:58:57.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:57 smithi186 ceph-mon[126480]: pgmap v532: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:58:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 877.578257 secs 2023-05-08T03:58:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:58 smithi133 ceph-mon[125939]: pgmap v533: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:58:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 878.131619 secs 2023-05-08T03:58:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 877.578257 secs 2023-05-08T03:58:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:58 smithi096 ceph-mon[124666]: pgmap v533: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:58:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 878.131619 secs 2023-05-08T03:58:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 877.578257 secs 2023-05-08T03:58:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:58 smithi186 ceph-mon[126480]: pgmap v533: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:58:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 878.131619 secs 2023-05-08T03:59:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:58:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 879.408317 secs 2023-05-08T03:59:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:58:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 879.408317 secs 2023-05-08T03:59:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:58:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 879.408317 secs 2023-05-08T03:59:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:00 smithi186 ceph-mon[126480]: pgmap v534: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T03:59:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:00 smithi133 ceph-mon[125939]: pgmap v534: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T03:59:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:00 smithi096 ceph-mon[124666]: pgmap v534: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T03:59:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:03 smithi186 ceph-mon[126480]: pgmap v535: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:59:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 882.578373 secs 2023-05-08T03:59:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:03 smithi133 ceph-mon[125939]: pgmap v535: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:59:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 882.578373 secs 2023-05-08T03:59:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:03 smithi096 ceph-mon[124666]: pgmap v535: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:59:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 882.578373 secs 2023-05-08T03:59:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 883.131683 secs 2023-05-08T03:59:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 883.131683 secs 2023-05-08T03:59:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 883.131683 secs 2023-05-08T03:59:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:05 smithi133 ceph-mon[125939]: pgmap v536: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T03:59:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 884.408378 secs 2023-05-08T03:59:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:05 smithi096 ceph-mon[124666]: pgmap v536: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T03:59:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 884.408378 secs 2023-05-08T03:59:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:05 smithi186 ceph-mon[126480]: pgmap v536: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T03:59:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 884.408378 secs 2023-05-08T03:59:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:07 smithi133 ceph-mon[125939]: pgmap v537: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T03:59:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:07 smithi096 ceph-mon[124666]: pgmap v537: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T03:59:07.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:07 smithi186 ceph-mon[126480]: pgmap v537: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T03:59:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 887.578496 secs 2023-05-08T03:59:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:08 smithi133 ceph-mon[125939]: pgmap v538: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T03:59:08.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 888.131802 secs 2023-05-08T03:59:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 887.578496 secs 2023-05-08T03:59:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:08 smithi096 ceph-mon[124666]: pgmap v538: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T03:59:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 888.131802 secs 2023-05-08T03:59:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 887.578496 secs 2023-05-08T03:59:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:08 smithi186 ceph-mon[126480]: pgmap v538: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T03:59:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 888.131802 secs 2023-05-08T03:59:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 889.408490 secs 2023-05-08T03:59:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:10 smithi133 ceph-mon[125939]: osdmap e116: 12 total, 12 up, 12 in 2023-05-08T03:59:10.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:10 smithi133 ceph-mon[125939]: pgmap v540: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T03:59:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 889.408490 secs 2023-05-08T03:59:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:10 smithi096 ceph-mon[124666]: osdmap e116: 12 total, 12 up, 12 in 2023-05-08T03:59:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:10 smithi096 ceph-mon[124666]: pgmap v540: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T03:59:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 889.408490 secs 2023-05-08T03:59:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:10 smithi186 ceph-mon[126480]: osdmap e116: 12 total, 12 up, 12 in 2023-05-08T03:59:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:10 smithi186 ceph-mon[126480]: pgmap v540: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T03:59:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:13 smithi186 ceph-mon[126480]: pgmap v541: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T03:59:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 892.578569 secs 2023-05-08T03:59:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:13 smithi133 ceph-mon[125939]: pgmap v541: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T03:59:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 892.578569 secs 2023-05-08T03:59:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:13 smithi096 ceph-mon[124666]: pgmap v541: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T03:59:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 892.578569 secs 2023-05-08T03:59:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 893.131944 secs 2023-05-08T03:59:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 893.131944 secs 2023-05-08T03:59:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 893.131944 secs 2023-05-08T03:59:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:15 smithi133 ceph-mon[125939]: pgmap v542: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:59:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 894.408573 secs 2023-05-08T03:59:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:15 smithi096 ceph-mon[124666]: pgmap v542: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:59:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 894.408573 secs 2023-05-08T03:59:15.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:15 smithi186 ceph-mon[126480]: pgmap v542: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:59:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 894.408573 secs 2023-05-08T03:59:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:17 smithi133 ceph-mon[125939]: pgmap v543: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:59:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:17 smithi096 ceph-mon[124666]: pgmap v543: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:59:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:17 smithi186 ceph-mon[126480]: pgmap v543: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:59:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:18 smithi133 ceph-mon[125939]: osdmap e117: 12 total, 12 up, 12 in 2023-05-08T03:59:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 897.578653 secs 2023-05-08T03:59:18.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:18 smithi133 ceph-mon[125939]: pgmap v545: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T03:59:18.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 898.132084 secs 2023-05-08T03:59:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:18 smithi096 ceph-mon[124666]: osdmap e117: 12 total, 12 up, 12 in 2023-05-08T03:59:19.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 897.578653 secs 2023-05-08T03:59:19.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:18 smithi096 ceph-mon[124666]: pgmap v545: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T03:59:19.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 898.132084 secs 2023-05-08T03:59:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:18 smithi186 ceph-mon[126480]: osdmap e117: 12 total, 12 up, 12 in 2023-05-08T03:59:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 897.578653 secs 2023-05-08T03:59:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:18 smithi186 ceph-mon[126480]: pgmap v545: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T03:59:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 898.132084 secs 2023-05-08T03:59:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 899.408685 secs 2023-05-08T03:59:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 899.408685 secs 2023-05-08T03:59:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 899.408685 secs 2023-05-08T03:59:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:20 smithi186 ceph-mon[126480]: pgmap v546: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:59:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:20 smithi133 ceph-mon[125939]: pgmap v546: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:59:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:20 smithi096 ceph-mon[124666]: pgmap v546: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:59:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:23 smithi186 ceph-mon[126480]: pgmap v547: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:59:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 902.578768 secs 2023-05-08T03:59:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:23 smithi133 ceph-mon[125939]: pgmap v547: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:59:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 902.578768 secs 2023-05-08T03:59:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:23 smithi096 ceph-mon[124666]: pgmap v547: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T03:59:23.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 902.578768 secs 2023-05-08T03:59:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 903.132199 secs 2023-05-08T03:59:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 903.132199 secs 2023-05-08T03:59:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 903.132199 secs 2023-05-08T03:59:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:25 smithi133 ceph-mon[125939]: pgmap v548: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T03:59:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 904.408788 secs 2023-05-08T03:59:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:25 smithi096 ceph-mon[124666]: pgmap v548: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T03:59:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 904.408788 secs 2023-05-08T03:59:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:25 smithi186 ceph-mon[126480]: pgmap v548: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T03:59:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 904.408788 secs 2023-05-08T03:59:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:27 smithi133 ceph-mon[125939]: pgmap v549: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T03:59:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:27 smithi096 ceph-mon[124666]: pgmap v549: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T03:59:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:27 smithi186 ceph-mon[126480]: pgmap v549: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T03:59:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 907.578903 secs 2023-05-08T03:59:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:28 smithi133 ceph-mon[125939]: pgmap v550: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T03:59:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 908.132333 secs 2023-05-08T03:59:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 907.578903 secs 2023-05-08T03:59:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:28 smithi096 ceph-mon[124666]: pgmap v550: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T03:59:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 908.132333 secs 2023-05-08T03:59:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 907.578903 secs 2023-05-08T03:59:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:28 smithi186 ceph-mon[126480]: pgmap v550: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T03:59:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 908.132333 secs 2023-05-08T03:59:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:31 smithi186 ceph-mon[126480]: pgmap v551: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 13 KiB/s wr, 8 op/s 2023-05-08T03:59:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:31 smithi133 ceph-mon[125939]: pgmap v551: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 13 KiB/s wr, 8 op/s 2023-05-08T03:59:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:31 smithi096 ceph-mon[124666]: pgmap v551: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 13 KiB/s wr, 8 op/s 2023-05-08T03:59:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:33 smithi133 ceph-mon[125939]: pgmap v552: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 13 KiB/s wr, 5 op/s 2023-05-08T03:59:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 912.579023 secs 2023-05-08T03:59:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:33 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T03:59:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:33 smithi096 ceph-mon[124666]: pgmap v552: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 13 KiB/s wr, 5 op/s 2023-05-08T03:59:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 912.579023 secs 2023-05-08T03:59:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:33 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T03:59:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:33 smithi186 ceph-mon[126480]: pgmap v552: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 13 KiB/s wr, 5 op/s 2023-05-08T03:59:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 912.579023 secs 2023-05-08T03:59:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:33 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T03:59:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 913.132500 secs 2023-05-08T03:59:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:34 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T03:59:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:34 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T03:59:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:34 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:59:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 913.132500 secs 2023-05-08T03:59:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:34 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T03:59:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:34 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T03:59:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:34 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:59:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 913.132500 secs 2023-05-08T03:59:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:34 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T03:59:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:34 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T03:59:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:34 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:59:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:35 smithi133 ceph-mon[125939]: pgmap v553: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 35 KiB/s wr, 9 op/s 2023-05-08T03:59:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 914.408931 secs 2023-05-08T03:59:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:35 smithi096 ceph-mon[124666]: pgmap v553: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 35 KiB/s wr, 9 op/s 2023-05-08T03:59:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 914.408931 secs 2023-05-08T03:59:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:35 smithi186 ceph-mon[126480]: pgmap v553: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 35 KiB/s wr, 9 op/s 2023-05-08T03:59:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 914.408931 secs 2023-05-08T03:59:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:37 smithi133 ceph-mon[125939]: pgmap v554: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 35 KiB/s wr, 7 op/s 2023-05-08T03:59:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:37 smithi096 ceph-mon[124666]: pgmap v554: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 35 KiB/s wr, 7 op/s 2023-05-08T03:59:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:37 smithi186 ceph-mon[126480]: pgmap v554: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 35 KiB/s wr, 7 op/s 2023-05-08T03:59:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:38 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T03:59:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:38 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:59:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 917.579098 secs 2023-05-08T03:59:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:38 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T03:59:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:38 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:59:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 917.579098 secs 2023-05-08T03:59:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:38 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T03:59:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:38 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T03:59:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 917.579098 secs 2023-05-08T03:59:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:39 smithi133 ceph-mon[125939]: pgmap v555: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 35 KiB/s wr, 7 op/s 2023-05-08T03:59:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 918.132638 secs 2023-05-08T03:59:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:39 smithi096 ceph-mon[124666]: pgmap v555: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 35 KiB/s wr, 7 op/s 2023-05-08T03:59:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 918.132638 secs 2023-05-08T03:59:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:39 smithi186 ceph-mon[126480]: pgmap v555: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 35 KiB/s wr, 7 op/s 2023-05-08T03:59:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 918.132638 secs 2023-05-08T03:59:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 919.409027 secs 2023-05-08T03:59:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:40 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:59:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 919.409027 secs 2023-05-08T03:59:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:40 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:59:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 919.409027 secs 2023-05-08T03:59:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:40 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T03:59:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:41 smithi133 ceph-mon[125939]: pgmap v556: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 41 KiB/s wr, 10 op/s 2023-05-08T03:59:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:59:41.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:59:41.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:41 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:59:41.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:59:41.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:41 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T03:59:41.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:41 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T03:59:41.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:41 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T03:59:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:41 smithi096 ceph-mon[124666]: pgmap v556: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 41 KiB/s wr, 10 op/s 2023-05-08T03:59:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:59:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:59:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:41 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:59:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:59:41.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:41 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T03:59:41.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:41 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T03:59:41.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:41 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T03:59:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:41 smithi186 ceph-mon[126480]: pgmap v556: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 41 KiB/s wr, 10 op/s 2023-05-08T03:59:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T03:59:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T03:59:41.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:41 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:59:41.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T03:59:41.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:41 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T03:59:41.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:41 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T03:59:41.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:41 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T03:59:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:43 smithi133 ceph-mon[125939]: pgmap v557: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 28 KiB/s wr, 7 op/s 2023-05-08T03:59:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:43 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T03:59:43.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 922.579189 secs 2023-05-08T03:59:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:43 smithi096 ceph-mon[124666]: pgmap v557: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 28 KiB/s wr, 7 op/s 2023-05-08T03:59:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:43 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T03:59:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 922.579189 secs 2023-05-08T03:59:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:43 smithi186 ceph-mon[126480]: pgmap v557: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 28 KiB/s wr, 7 op/s 2023-05-08T03:59:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:43 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T03:59:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 922.579189 secs 2023-05-08T03:59:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 923.132751 secs 2023-05-08T03:59:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 923.132751 secs 2023-05-08T03:59:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 923.132751 secs 2023-05-08T03:59:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:45 smithi133 ceph-mon[125939]: pgmap v558: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 9 op/s 2023-05-08T03:59:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 924.409107 secs 2023-05-08T03:59:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:45 smithi096 ceph-mon[124666]: pgmap v558: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 9 op/s 2023-05-08T03:59:45.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 924.409107 secs 2023-05-08T03:59:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:45 smithi186 ceph-mon[126480]: pgmap v558: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 9 op/s 2023-05-08T03:59:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 924.409107 secs 2023-05-08T03:59:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:47 smithi133 ceph-mon[125939]: pgmap v559: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 5.9 KiB/s wr, 5 op/s 2023-05-08T03:59:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:47 smithi096 ceph-mon[124666]: pgmap v559: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 5.9 KiB/s wr, 5 op/s 2023-05-08T03:59:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:47 smithi186 ceph-mon[126480]: pgmap v559: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 5.9 KiB/s wr, 5 op/s 2023-05-08T03:59:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 927.579311 secs 2023-05-08T03:59:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:48 smithi133 ceph-mon[125939]: pgmap v560: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 5.9 KiB/s wr, 5 op/s 2023-05-08T03:59:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 928.132815 secs 2023-05-08T03:59:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 927.579311 secs 2023-05-08T03:59:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:48 smithi096 ceph-mon[124666]: pgmap v560: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 5.9 KiB/s wr, 5 op/s 2023-05-08T03:59:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 928.132815 secs 2023-05-08T03:59:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 927.579311 secs 2023-05-08T03:59:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:48 smithi186 ceph-mon[126480]: pgmap v560: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 5.9 KiB/s wr, 5 op/s 2023-05-08T03:59:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 928.132815 secs 2023-05-08T03:59:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 929.409180 secs 2023-05-08T03:59:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 929.409180 secs 2023-05-08T03:59:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 929.409180 secs 2023-05-08T03:59:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:50 smithi133 ceph-mon[125939]: pgmap v561: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 5.9 KiB/s wr, 7 op/s 2023-05-08T03:59:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:50 smithi096 ceph-mon[124666]: pgmap v561: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 5.9 KiB/s wr, 7 op/s 2023-05-08T03:59:51.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:50 smithi186 ceph-mon[126480]: pgmap v561: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 5.9 KiB/s wr, 7 op/s 2023-05-08T03:59:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:53 smithi133 ceph-mon[125939]: pgmap v562: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:59:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 932.579389 secs 2023-05-08T03:59:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:53 smithi096 ceph-mon[124666]: pgmap v562: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:59:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 932.579389 secs 2023-05-08T03:59:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:53 smithi186 ceph-mon[126480]: pgmap v562: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:59:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 932.579389 secs 2023-05-08T03:59:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 933.132937 secs 2023-05-08T03:59:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 933.132937 secs 2023-05-08T03:59:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 933.132937 secs 2023-05-08T03:59:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:55 smithi133 ceph-mon[125939]: pgmap v563: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T03:59:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 934.409274 secs 2023-05-08T03:59:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:55 smithi096 ceph-mon[124666]: pgmap v563: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T03:59:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 934.409274 secs 2023-05-08T03:59:55.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:55 smithi186 ceph-mon[126480]: pgmap v563: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T03:59:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 934.409274 secs 2023-05-08T03:59:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:57 smithi133 ceph-mon[125939]: pgmap v564: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:59:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:57 smithi096 ceph-mon[124666]: pgmap v564: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:59:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:57 smithi186 ceph-mon[126480]: pgmap v564: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:59:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 937.579534 secs 2023-05-08T03:59:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:58 smithi133 ceph-mon[125939]: pgmap v565: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:59:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 938.133061 secs 2023-05-08T03:59:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 937.579534 secs 2023-05-08T03:59:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:58 smithi096 ceph-mon[124666]: pgmap v565: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:59:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 938.133061 secs 2023-05-08T03:59:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 937.579534 secs 2023-05-08T03:59:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:58 smithi186 ceph-mon[126480]: pgmap v565: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T03:59:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 938.133061 secs 2023-05-08T04:00:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 03:59:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 939.409384 secs 2023-05-08T04:00:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 03:59:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 939.409384 secs 2023-05-08T04:00:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 03:59:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 939.409384 secs 2023-05-08T04:00:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:00:00 smithi133 ceph-mon[125939]: overall HEALTH_WARN 3 MDSs report slow requests 2023-05-08T04:00:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:00:00 smithi133 ceph-mon[125939]: pgmap v566: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:00:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:00:00 smithi096 ceph-mon[124666]: overall HEALTH_WARN 3 MDSs report slow requests 2023-05-08T04:00:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:00:00 smithi096 ceph-mon[124666]: pgmap v566: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:00:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:00:00 smithi186 ceph-mon[126480]: overall HEALTH_WARN 3 MDSs report slow requests 2023-05-08T04:00:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:00:00 smithi186 ceph-mon[126480]: pgmap v566: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:00:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:00:03 smithi133 ceph-mon[125939]: pgmap v567: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:00:03.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:00:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 942.579626 secs 2023-05-08T04:00:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:00:03 smithi096 ceph-mon[124666]: pgmap v567: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:00:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:00:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 942.579626 secs 2023-05-08T04:00:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:00:03 smithi186 ceph-mon[126480]: pgmap v567: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:00:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:00:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 942.579626 secs 2023-05-08T04:00:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:00:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 943.133159 secs 2023-05-08T04:00:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:00:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 943.133159 secs 2023-05-08T04:00:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:00:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 943.133159 secs 2023-05-08T04:00:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:00:05 smithi133 ceph-mon[125939]: pgmap v568: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:00:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:00:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 944.409521 secs 2023-05-08T04:00:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:00:05 smithi096 ceph-mon[124666]: pgmap v568: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:00:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:00:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 944.409521 secs 2023-05-08T04:00:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:00:05 smithi186 ceph-mon[126480]: pgmap v568: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:00:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:00:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 944.409521 secs 2023-05-08T04:00:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:00:07 smithi133 ceph-mon[125939]: pgmap v569: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:00:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:00:07 smithi096 ceph-mon[124666]: pgmap v569: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:00:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:00:07 smithi186 ceph-mon[126480]: pgmap v569: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:00:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:00:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 947.579731 secs 2023-05-08T04:00:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:00:08 smithi133 ceph-mon[125939]: pgmap v570: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:00:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:00:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 948.133270 secs 2023-05-08T04:00:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:00:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 947.579731 secs 2023-05-08T04:00:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:00:08 smithi096 ceph-mon[124666]: pgmap v570: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:00:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:00:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 948.133270 secs 2023-05-08T04:00:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:00:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 947.579731 secs 2023-05-08T04:00:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:00:08 smithi186 ceph-mon[126480]: pgmap v570: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:00:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:00:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 948.133270 secs 2023-05-08T04:00:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:00:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 949.409640 secs 2023-05-08T04:00:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:00:10 smithi133 ceph-mon[125939]: osdmap e118: 12 total, 12 up, 12 in 2023-05-08T04:00:10.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:00:10 smithi133 ceph-mon[125939]: pgmap v572: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T04:00:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:00:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 949.409640 secs 2023-05-08T04:00:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:00:10 smithi096 ceph-mon[124666]: osdmap e118: 12 total, 12 up, 12 in 2023-05-08T04:00:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:00:10 smithi096 ceph-mon[124666]: pgmap v572: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T04:00:11.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:00:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 949.409640 secs 2023-05-08T04:00:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:00:10 smithi186 ceph-mon[126480]: osdmap e118: 12 total, 12 up, 12 in 2023-05-08T04:00:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:00:10 smithi186 ceph-mon[126480]: pgmap v572: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T04:00:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:00:13 smithi133 ceph-mon[125939]: pgmap v573: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T04:00:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:00:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 952.579864 secs 2023-05-08T04:00:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:00:13 smithi096 ceph-mon[124666]: pgmap v573: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T04:00:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:00:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 952.579864 secs 2023-05-08T04:00:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:00:13 smithi186 ceph-mon[126480]: pgmap v573: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T04:00:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:00:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 952.579864 secs 2023-05-08T04:00:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:00:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 953.133381 secs 2023-05-08T04:00:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:00:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 953.133381 secs 2023-05-08T04:00:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:00:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 953.133381 secs 2023-05-08T04:00:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:00:15 smithi133 ceph-mon[125939]: pgmap v574: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:00:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:00:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 954.409714 secs 2023-05-08T04:00:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:00:15 smithi096 ceph-mon[124666]: pgmap v574: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:00:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:00:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 954.409714 secs 2023-05-08T04:00:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:00:15 smithi186 ceph-mon[126480]: pgmap v574: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:00:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:00:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 954.409714 secs 2023-05-08T04:00:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:00:17 smithi133 ceph-mon[125939]: pgmap v575: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:00:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:00:17 smithi096 ceph-mon[124666]: pgmap v575: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:00:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:00:17 smithi186 ceph-mon[126480]: pgmap v575: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:00:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:00:18 smithi133 ceph-mon[125939]: osdmap e119: 12 total, 12 up, 12 in 2023-05-08T04:00:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:00:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 957.579997 secs 2023-05-08T04:00:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:00:18 smithi133 ceph-mon[125939]: pgmap v577: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:00:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:00:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 958.133501 secs 2023-05-08T04:00:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:00:18 smithi096 ceph-mon[124666]: osdmap e119: 12 total, 12 up, 12 in 2023-05-08T04:00:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:00:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 957.579997 secs 2023-05-08T04:00:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:00:18 smithi096 ceph-mon[124666]: pgmap v577: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:00:19.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:00:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 958.133501 secs 2023-05-08T04:00:19.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:00:18 smithi186 ceph-mon[126480]: osdmap e119: 12 total, 12 up, 12 in 2023-05-08T04:00:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:00:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 957.579997 secs 2023-05-08T04:00:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:00:18 smithi186 ceph-mon[126480]: pgmap v577: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:00:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:00:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 958.133501 secs 2023-05-08T04:00:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:00:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 959.409857 secs 2023-05-08T04:00:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:00:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 959.409857 secs 2023-05-08T04:00:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:00:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 959.409857 secs 2023-05-08T04:00:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:00:20 smithi133 ceph-mon[125939]: pgmap v578: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:00:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:00:20 smithi096 ceph-mon[124666]: pgmap v578: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:00:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:00:20 smithi186 ceph-mon[126480]: pgmap v578: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:00:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:00:23 smithi133 ceph-mon[125939]: pgmap v579: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:00:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:00:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 962.580117 secs 2023-05-08T04:00:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:00:23 smithi096 ceph-mon[124666]: pgmap v579: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:00:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:00:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 962.580117 secs 2023-05-08T04:00:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:00:23 smithi186 ceph-mon[126480]: pgmap v579: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:00:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:00:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 962.580117 secs 2023-05-08T04:00:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:00:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 963.133573 secs 2023-05-08T04:00:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:00:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 963.133573 secs 2023-05-08T04:00:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:00:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 963.133573 secs 2023-05-08T04:00:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:00:25 smithi133 ceph-mon[125939]: pgmap v580: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:00:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:00:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 964.409974 secs 2023-05-08T04:00:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:00:25 smithi096 ceph-mon[124666]: pgmap v580: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:00:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:00:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 964.409974 secs 2023-05-08T04:00:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:00:25 smithi186 ceph-mon[126480]: pgmap v580: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:00:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:00:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 964.409974 secs 2023-05-08T04:00:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:00:27 smithi133 ceph-mon[125939]: pgmap v581: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:00:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:00:27 smithi096 ceph-mon[124666]: pgmap v581: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:00:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:00:27 smithi186 ceph-mon[126480]: pgmap v581: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:00:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:00:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 967.580254 secs 2023-05-08T04:00:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:00:28 smithi133 ceph-mon[125939]: pgmap v582: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T04:00:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:00:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 968.133640 secs 2023-05-08T04:00:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:00:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 967.580254 secs 2023-05-08T04:00:29.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:00:28 smithi096 ceph-mon[124666]: pgmap v582: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T04:00:29.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:00:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 968.133640 secs 2023-05-08T04:00:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:00:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 967.580254 secs 2023-05-08T04:00:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:00:28 smithi186 ceph-mon[126480]: pgmap v582: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T04:00:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:00:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 968.133640 secs 2023-05-08T04:00:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:00:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 969.410096 secs 2023-05-08T04:00:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:00:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 969.410096 secs 2023-05-08T04:00:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:00:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 969.410096 secs 2023-05-08T04:00:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:00:30 smithi133 ceph-mon[125939]: pgmap v583: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 14 KiB/s wr, 8 op/s 2023-05-08T04:00:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:00:30 smithi096 ceph-mon[124666]: pgmap v583: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 14 KiB/s wr, 8 op/s 2023-05-08T04:00:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:00:30 smithi186 ceph-mon[126480]: pgmap v583: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 14 KiB/s wr, 8 op/s 2023-05-08T04:00:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:00:33 smithi133 ceph-mon[125939]: pgmap v584: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 14 KiB/s wr, 5 op/s 2023-05-08T04:00:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:00:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 972.580332 secs 2023-05-08T04:00:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:00:33 smithi096 ceph-mon[124666]: pgmap v584: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 14 KiB/s wr, 5 op/s 2023-05-08T04:00:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:00:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 972.580332 secs 2023-05-08T04:00:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:00:33 smithi186 ceph-mon[126480]: pgmap v584: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 14 KiB/s wr, 5 op/s 2023-05-08T04:00:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:00:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 972.580332 secs 2023-05-08T04:00:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:00:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 973.133761 secs 2023-05-08T04:00:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:00:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 973.133761 secs 2023-05-08T04:00:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:00:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 973.133761 secs 2023-05-08T04:00:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:00:35 smithi133 ceph-mon[125939]: pgmap v585: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 39 KiB/s wr, 10 op/s 2023-05-08T04:00:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:00:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 974.410197 secs 2023-05-08T04:00:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:00:35 smithi096 ceph-mon[124666]: pgmap v585: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 39 KiB/s wr, 10 op/s 2023-05-08T04:00:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:00:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 974.410197 secs 2023-05-08T04:00:35.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:00:35 smithi186 ceph-mon[126480]: pgmap v585: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 39 KiB/s wr, 10 op/s 2023-05-08T04:00:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:00:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 974.410197 secs 2023-05-08T04:00:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:00:37 smithi133 ceph-mon[125939]: pgmap v586: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 39 KiB/s wr, 7 op/s 2023-05-08T04:00:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:00:37 smithi096 ceph-mon[124666]: pgmap v586: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 39 KiB/s wr, 7 op/s 2023-05-08T04:00:37.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:00:37 smithi186 ceph-mon[126480]: pgmap v586: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 39 KiB/s wr, 7 op/s 2023-05-08T04:00:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:00:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 977.580474 secs 2023-05-08T04:00:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:00:38 smithi133 ceph-mon[125939]: pgmap v587: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 39 KiB/s wr, 7 op/s 2023-05-08T04:00:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:00:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 978.133874 secs 2023-05-08T04:00:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:00:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 977.580474 secs 2023-05-08T04:00:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:00:38 smithi096 ceph-mon[124666]: pgmap v587: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 39 KiB/s wr, 7 op/s 2023-05-08T04:00:39.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:00:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 978.133874 secs 2023-05-08T04:00:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:00:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 977.580474 secs 2023-05-08T04:00:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:00:38 smithi186 ceph-mon[126480]: pgmap v587: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 39 KiB/s wr, 7 op/s 2023-05-08T04:00:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:00:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 978.133874 secs 2023-05-08T04:00:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:00:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 979.410306 secs 2023-05-08T04:00:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:00:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 979.410306 secs 2023-05-08T04:00:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:00:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 979.410306 secs 2023-05-08T04:00:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:00:40 smithi133 ceph-mon[125939]: pgmap v588: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 45 KiB/s wr, 10 op/s 2023-05-08T04:00:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:00:40 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:00:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:00:40 smithi096 ceph-mon[124666]: pgmap v588: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 45 KiB/s wr, 10 op/s 2023-05-08T04:00:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:00:40 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:00:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:00:40 smithi186 ceph-mon[126480]: pgmap v588: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 45 KiB/s wr, 10 op/s 2023-05-08T04:00:41.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:00:40 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:00:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:00:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:00:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:00:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:00:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:00:41 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:00:42.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:00:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:00:42.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:00:41 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T04:00:42.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:00:41 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T04:00:42.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:00:41 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:00:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:00:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:00:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:00:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:00:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:00:41 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:00:42.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:00:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:00:42.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:00:41 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T04:00:42.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:00:41 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T04:00:42.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:00:41 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:00:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:00:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:00:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:00:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:00:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:00:41 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:00:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:00:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:00:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:00:41 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T04:00:42.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:00:41 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T04:00:42.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:00:41 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:00:43.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:00:42 smithi133 ceph-mon[125939]: pgmap v589: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 31 KiB/s wr, 7 op/s 2023-05-08T04:00:43.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:00:42 smithi096 ceph-mon[124666]: pgmap v589: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 31 KiB/s wr, 7 op/s 2023-05-08T04:00:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:00:42 smithi186 ceph-mon[126480]: pgmap v589: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 31 KiB/s wr, 7 op/s 2023-05-08T04:00:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:00:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 982.580594 secs 2023-05-08T04:00:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:00:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 983.133957 secs 2023-05-08T04:00:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:00:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 982.580594 secs 2023-05-08T04:00:44.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:00:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 983.133957 secs 2023-05-08T04:00:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:00:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 982.580594 secs 2023-05-08T04:00:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:00:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 983.133957 secs 2023-05-08T04:00:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:00:44 smithi133 ceph-mon[125939]: pgmap v590: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 10 op/s 2023-05-08T04:00:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:00:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 984.410427 secs 2023-05-08T04:00:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:00:44 smithi096 ceph-mon[124666]: pgmap v590: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 10 op/s 2023-05-08T04:00:45.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:00:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 984.410427 secs 2023-05-08T04:00:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:00:44 smithi186 ceph-mon[126480]: pgmap v590: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 10 op/s 2023-05-08T04:00:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:00:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 984.410427 secs 2023-05-08T04:00:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:00:47 smithi133 ceph-mon[125939]: pgmap v591: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 6.2 KiB/s wr, 5 op/s 2023-05-08T04:00:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:00:47 smithi096 ceph-mon[124666]: pgmap v591: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 6.2 KiB/s wr, 5 op/s 2023-05-08T04:00:47.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:00:47 smithi186 ceph-mon[126480]: pgmap v591: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 6.2 KiB/s wr, 5 op/s 2023-05-08T04:00:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:00:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 987.580690 secs 2023-05-08T04:00:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:00:48 smithi133 ceph-mon[125939]: pgmap v592: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 6.2 KiB/s wr, 5 op/s 2023-05-08T04:00:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:00:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 988.134048 secs 2023-05-08T04:00:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:00:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 987.580690 secs 2023-05-08T04:00:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:00:48 smithi096 ceph-mon[124666]: pgmap v592: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 6.2 KiB/s wr, 5 op/s 2023-05-08T04:00:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:00:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 988.134048 secs 2023-05-08T04:00:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:00:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 987.580690 secs 2023-05-08T04:00:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:00:48 smithi186 ceph-mon[126480]: pgmap v592: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 6.2 KiB/s wr, 5 op/s 2023-05-08T04:00:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:00:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 988.134048 secs 2023-05-08T04:00:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:00:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 989.410544 secs 2023-05-08T04:00:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:00:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 989.410544 secs 2023-05-08T04:00:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:00:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 989.410544 secs 2023-05-08T04:00:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:00:50 smithi133 ceph-mon[125939]: pgmap v593: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 6.2 KiB/s wr, 7 op/s 2023-05-08T04:00:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:00:50 smithi096 ceph-mon[124666]: pgmap v593: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 6.2 KiB/s wr, 7 op/s 2023-05-08T04:00:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:00:50 smithi186 ceph-mon[126480]: pgmap v593: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 6.2 KiB/s wr, 7 op/s 2023-05-08T04:00:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:00:53 smithi133 ceph-mon[125939]: pgmap v594: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:00:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:00:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 992.580816 secs 2023-05-08T04:00:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:00:53 smithi096 ceph-mon[124666]: pgmap v594: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:00:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:00:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 992.580816 secs 2023-05-08T04:00:53.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:00:53 smithi186 ceph-mon[126480]: pgmap v594: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:00:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:00:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 992.580816 secs 2023-05-08T04:00:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:00:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 993.134166 secs 2023-05-08T04:00:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:00:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 993.134166 secs 2023-05-08T04:00:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:00:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 993.134166 secs 2023-05-08T04:00:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:00:55 smithi133 ceph-mon[125939]: pgmap v595: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:00:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:00:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 994.410698 secs 2023-05-08T04:00:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:00:55 smithi096 ceph-mon[124666]: pgmap v595: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:00:55.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:00:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 994.410698 secs 2023-05-08T04:00:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:00:55 smithi186 ceph-mon[126480]: pgmap v595: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:00:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:00:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 994.410698 secs 2023-05-08T04:00:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:00:57 smithi133 ceph-mon[125939]: pgmap v596: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:00:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:00:57 smithi096 ceph-mon[124666]: pgmap v596: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:00:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:00:57 smithi186 ceph-mon[126480]: pgmap v596: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:00:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:00:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 997.580936 secs 2023-05-08T04:00:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:00:58 smithi133 ceph-mon[125939]: pgmap v597: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:00:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:00:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 998.134280 secs 2023-05-08T04:00:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:00:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 997.580936 secs 2023-05-08T04:00:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:00:58 smithi096 ceph-mon[124666]: pgmap v597: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:00:59.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:00:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 998.134280 secs 2023-05-08T04:00:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:00:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 997.580936 secs 2023-05-08T04:00:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:00:58 smithi186 ceph-mon[126480]: pgmap v597: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:00:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:00:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 998.134280 secs 2023-05-08T04:01:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:00:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 999.410813 secs 2023-05-08T04:01:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:00:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 999.410813 secs 2023-05-08T04:01:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:00:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 999.410813 secs 2023-05-08T04:01:01.144 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:00 smithi186 ceph-mon[126480]: pgmap v598: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:01:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:00 smithi133 ceph-mon[125939]: pgmap v598: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:01:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:00 smithi096 ceph-mon[124666]: pgmap v598: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:01:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:03 smithi133 ceph-mon[125939]: pgmap v599: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:01:03.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1002.581066 secs 2023-05-08T04:01:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:03 smithi096 ceph-mon[124666]: pgmap v599: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:01:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1002.581066 secs 2023-05-08T04:01:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:03 smithi186 ceph-mon[126480]: pgmap v599: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:01:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1002.581066 secs 2023-05-08T04:01:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1003.134395 secs 2023-05-08T04:01:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1003.134395 secs 2023-05-08T04:01:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1003.134395 secs 2023-05-08T04:01:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:05 smithi133 ceph-mon[125939]: pgmap v600: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:01:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1004.410876 secs 2023-05-08T04:01:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:05 smithi096 ceph-mon[124666]: pgmap v600: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:01:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1004.410876 secs 2023-05-08T04:01:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:05 smithi186 ceph-mon[126480]: pgmap v600: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:01:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1004.410876 secs 2023-05-08T04:01:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:07 smithi133 ceph-mon[125939]: pgmap v601: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:01:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:07 smithi096 ceph-mon[124666]: pgmap v601: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:01:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:07 smithi186 ceph-mon[126480]: pgmap v601: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:01:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1007.581187 secs 2023-05-08T04:01:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:08 smithi133 ceph-mon[125939]: pgmap v602: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:01:08.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1008.134493 secs 2023-05-08T04:01:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1007.581187 secs 2023-05-08T04:01:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:08 smithi096 ceph-mon[124666]: pgmap v602: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:01:09.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1008.134493 secs 2023-05-08T04:01:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1007.581187 secs 2023-05-08T04:01:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:08 smithi186 ceph-mon[126480]: pgmap v602: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:01:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1008.134493 secs 2023-05-08T04:01:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1009.410975 secs 2023-05-08T04:01:10.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:10 smithi133 ceph-mon[125939]: osdmap e120: 12 total, 12 up, 12 in 2023-05-08T04:01:10.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:10 smithi133 ceph-mon[125939]: pgmap v604: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:01:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1009.410975 secs 2023-05-08T04:01:11.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:10 smithi096 ceph-mon[124666]: osdmap e120: 12 total, 12 up, 12 in 2023-05-08T04:01:11.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:10 smithi096 ceph-mon[124666]: pgmap v604: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:01:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1009.410975 secs 2023-05-08T04:01:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:10 smithi186 ceph-mon[126480]: osdmap e120: 12 total, 12 up, 12 in 2023-05-08T04:01:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:10 smithi186 ceph-mon[126480]: pgmap v604: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:01:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:13 smithi133 ceph-mon[125939]: pgmap v605: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:01:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1012.581282 secs 2023-05-08T04:01:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:13 smithi096 ceph-mon[124666]: pgmap v605: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:01:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1012.581282 secs 2023-05-08T04:01:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:13 smithi186 ceph-mon[126480]: pgmap v605: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:01:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1012.581282 secs 2023-05-08T04:01:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1013.134598 secs 2023-05-08T04:01:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1013.134598 secs 2023-05-08T04:01:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1013.134598 secs 2023-05-08T04:01:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:15 smithi133 ceph-mon[125939]: pgmap v606: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:01:15.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1014.411101 secs 2023-05-08T04:01:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:15 smithi096 ceph-mon[124666]: pgmap v606: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:01:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1014.411101 secs 2023-05-08T04:01:15.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:15 smithi186 ceph-mon[126480]: pgmap v606: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:01:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1014.411101 secs 2023-05-08T04:01:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:17 smithi133 ceph-mon[125939]: pgmap v607: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:01:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:17 smithi096 ceph-mon[124666]: pgmap v607: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:01:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:17 smithi186 ceph-mon[126480]: pgmap v607: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:01:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:18 smithi133 ceph-mon[125939]: osdmap e121: 12 total, 12 up, 12 in 2023-05-08T04:01:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1017.581393 secs 2023-05-08T04:01:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:18 smithi133 ceph-mon[125939]: pgmap v609: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:01:18.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1018.134727 secs 2023-05-08T04:01:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:18 smithi096 ceph-mon[124666]: osdmap e121: 12 total, 12 up, 12 in 2023-05-08T04:01:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1017.581393 secs 2023-05-08T04:01:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:18 smithi096 ceph-mon[124666]: pgmap v609: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:01:19.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1018.134727 secs 2023-05-08T04:01:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:18 smithi186 ceph-mon[126480]: osdmap e121: 12 total, 12 up, 12 in 2023-05-08T04:01:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1017.581393 secs 2023-05-08T04:01:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:18 smithi186 ceph-mon[126480]: pgmap v609: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:01:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1018.134727 secs 2023-05-08T04:01:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1019.411211 secs 2023-05-08T04:01:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1019.411211 secs 2023-05-08T04:01:20.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1019.411211 secs 2023-05-08T04:01:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:20 smithi133 ceph-mon[125939]: pgmap v610: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:01:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:20 smithi096 ceph-mon[124666]: pgmap v610: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:01:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:20 smithi186 ceph-mon[126480]: pgmap v610: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:01:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:23 smithi133 ceph-mon[125939]: pgmap v611: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:01:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1022.581461 secs 2023-05-08T04:01:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:23 smithi096 ceph-mon[124666]: pgmap v611: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:01:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1022.581461 secs 2023-05-08T04:01:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:23 smithi186 ceph-mon[126480]: pgmap v611: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:01:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1022.581461 secs 2023-05-08T04:01:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1023.134815 secs 2023-05-08T04:01:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1023.134815 secs 2023-05-08T04:01:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1023.134815 secs 2023-05-08T04:01:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:25 smithi133 ceph-mon[125939]: pgmap v612: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:01:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1024.411332 secs 2023-05-08T04:01:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:25 smithi096 ceph-mon[124666]: pgmap v612: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:01:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1024.411332 secs 2023-05-08T04:01:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:25 smithi186 ceph-mon[126480]: pgmap v612: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:01:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1024.411332 secs 2023-05-08T04:01:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:27 smithi133 ceph-mon[125939]: pgmap v613: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:01:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:27 smithi096 ceph-mon[124666]: pgmap v613: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:01:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:27 smithi186 ceph-mon[126480]: pgmap v613: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:01:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1027.581587 secs 2023-05-08T04:01:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:28 smithi133 ceph-mon[125939]: pgmap v614: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T04:01:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1028.134942 secs 2023-05-08T04:01:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1027.581587 secs 2023-05-08T04:01:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:28 smithi096 ceph-mon[124666]: pgmap v614: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T04:01:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1028.134942 secs 2023-05-08T04:01:29.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1027.581587 secs 2023-05-08T04:01:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:28 smithi186 ceph-mon[126480]: pgmap v614: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T04:01:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1028.134942 secs 2023-05-08T04:01:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:31 smithi133 ceph-mon[125939]: pgmap v615: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 15 KiB/s wr, 9 op/s 2023-05-08T04:01:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:31 smithi096 ceph-mon[124666]: pgmap v615: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 15 KiB/s wr, 9 op/s 2023-05-08T04:01:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:31 smithi186 ceph-mon[126480]: pgmap v615: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 15 KiB/s wr, 9 op/s 2023-05-08T04:01:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:33 smithi133 ceph-mon[125939]: pgmap v616: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 15 KiB/s wr, 6 op/s 2023-05-08T04:01:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1032.581730 secs 2023-05-08T04:01:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:33 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:01:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:33 smithi096 ceph-mon[124666]: pgmap v616: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 15 KiB/s wr, 6 op/s 2023-05-08T04:01:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1032.581730 secs 2023-05-08T04:01:33.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:33 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:01:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:33 smithi186 ceph-mon[126480]: pgmap v616: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 15 KiB/s wr, 6 op/s 2023-05-08T04:01:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1032.581730 secs 2023-05-08T04:01:33.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:33 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:01:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1033.135037 secs 2023-05-08T04:01:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:34 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:01:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:34 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:01:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:34 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:01:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1033.135037 secs 2023-05-08T04:01:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:34 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:01:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:34 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:01:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:34 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:01:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1033.135037 secs 2023-05-08T04:01:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:34 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:01:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:34 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:01:34.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:34 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:01:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:35 smithi133 ceph-mon[125939]: pgmap v617: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 40 KiB/s wr, 10 op/s 2023-05-08T04:01:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1034.411589 secs 2023-05-08T04:01:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:35 smithi096 ceph-mon[124666]: pgmap v617: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 40 KiB/s wr, 10 op/s 2023-05-08T04:01:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1034.411589 secs 2023-05-08T04:01:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:35 smithi186 ceph-mon[126480]: pgmap v617: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 40 KiB/s wr, 10 op/s 2023-05-08T04:01:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1034.411589 secs 2023-05-08T04:01:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:37 smithi133 ceph-mon[125939]: pgmap v618: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 40 KiB/s wr, 7 op/s 2023-05-08T04:01:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:37 smithi096 ceph-mon[124666]: pgmap v618: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 40 KiB/s wr, 7 op/s 2023-05-08T04:01:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:37 smithi186 ceph-mon[126480]: pgmap v618: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 40 KiB/s wr, 7 op/s 2023-05-08T04:01:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:38 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:01:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:38 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:01:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1037.581847 secs 2023-05-08T04:01:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:38 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:01:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:38 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:01:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1037.581847 secs 2023-05-08T04:01:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:38 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:01:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:38 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:01:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1037.581847 secs 2023-05-08T04:01:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:39 smithi133 ceph-mon[125939]: pgmap v619: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 40 KiB/s wr, 7 op/s 2023-05-08T04:01:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1038.135147 secs 2023-05-08T04:01:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:39 smithi096 ceph-mon[124666]: pgmap v619: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 40 KiB/s wr, 7 op/s 2023-05-08T04:01:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1038.135147 secs 2023-05-08T04:01:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:39 smithi186 ceph-mon[126480]: pgmap v619: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 40 KiB/s wr, 7 op/s 2023-05-08T04:01:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1038.135147 secs 2023-05-08T04:01:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1039.411669 secs 2023-05-08T04:01:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1039.411669 secs 2023-05-08T04:01:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1039.411669 secs 2023-05-08T04:01:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:41 smithi133 ceph-mon[125939]: pgmap v620: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 46 KiB/s wr, 10 op/s 2023-05-08T04:01:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:01:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:41 smithi096 ceph-mon[124666]: pgmap v620: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 46 KiB/s wr, 10 op/s 2023-05-08T04:01:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:01:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:41 smithi186 ceph-mon[126480]: pgmap v620: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 46 KiB/s wr, 10 op/s 2023-05-08T04:01:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:01:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:01:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:01:42.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:01:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:01:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:01:42.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:01:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:01:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:01:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:01:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:43 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:01:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:43 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T04:01:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:43 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T04:01:43.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:43 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:01:43.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:43 smithi133 ceph-mon[125939]: pgmap v621: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 7 op/s 2023-05-08T04:01:43.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:43 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:01:43.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1042.581939 secs 2023-05-08T04:01:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:43 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:01:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:43 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T04:01:43.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:43 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T04:01:43.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:43 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:01:43.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:43 smithi096 ceph-mon[124666]: pgmap v621: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 7 op/s 2023-05-08T04:01:43.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:43 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:01:43.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1042.581939 secs 2023-05-08T04:01:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:43 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:01:43.973 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:43 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T04:01:43.973 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:43 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T04:01:43.973 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:43 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:01:43.973 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:43 smithi186 ceph-mon[126480]: pgmap v621: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 7 op/s 2023-05-08T04:01:43.973 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:43 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:01:43.974 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1042.581939 secs 2023-05-08T04:01:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1043.135291 secs 2023-05-08T04:01:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1043.135291 secs 2023-05-08T04:01:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1043.135291 secs 2023-05-08T04:01:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:45 smithi133 ceph-mon[125939]: pgmap v622: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 9 op/s 2023-05-08T04:01:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1044.411807 secs 2023-05-08T04:01:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:45 smithi096 ceph-mon[124666]: pgmap v622: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 9 op/s 2023-05-08T04:01:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1044.411807 secs 2023-05-08T04:01:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:45 smithi186 ceph-mon[126480]: pgmap v622: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 9 op/s 2023-05-08T04:01:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1044.411807 secs 2023-05-08T04:01:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:47 smithi133 ceph-mon[125939]: pgmap v623: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 6.4 KiB/s wr, 5 op/s 2023-05-08T04:01:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:47 smithi096 ceph-mon[124666]: pgmap v623: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 6.4 KiB/s wr, 5 op/s 2023-05-08T04:01:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:47 smithi186 ceph-mon[126480]: pgmap v623: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 6.4 KiB/s wr, 5 op/s 2023-05-08T04:01:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1047.582075 secs 2023-05-08T04:01:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:48 smithi133 ceph-mon[125939]: pgmap v624: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 6.4 KiB/s wr, 5 op/s 2023-05-08T04:01:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1048.135432 secs 2023-05-08T04:01:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1047.582075 secs 2023-05-08T04:01:49.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:48 smithi096 ceph-mon[124666]: pgmap v624: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 6.4 KiB/s wr, 5 op/s 2023-05-08T04:01:49.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1048.135432 secs 2023-05-08T04:01:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1047.582075 secs 2023-05-08T04:01:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:48 smithi186 ceph-mon[126480]: pgmap v624: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 6.4 KiB/s wr, 5 op/s 2023-05-08T04:01:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1048.135432 secs 2023-05-08T04:01:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1049.411872 secs 2023-05-08T04:01:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1049.411872 secs 2023-05-08T04:01:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1049.411872 secs 2023-05-08T04:01:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:50 smithi133 ceph-mon[125939]: pgmap v625: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.4 KiB/s wr, 7 op/s 2023-05-08T04:01:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:50 smithi096 ceph-mon[124666]: pgmap v625: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.4 KiB/s wr, 7 op/s 2023-05-08T04:01:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:50 smithi186 ceph-mon[126480]: pgmap v625: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.4 KiB/s wr, 7 op/s 2023-05-08T04:01:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:53 smithi133 ceph-mon[125939]: pgmap v626: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:01:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1052.582199 secs 2023-05-08T04:01:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:53 smithi096 ceph-mon[124666]: pgmap v626: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:01:53.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1052.582199 secs 2023-05-08T04:01:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:53 smithi186 ceph-mon[126480]: pgmap v626: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:01:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1052.582199 secs 2023-05-08T04:01:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1053.135557 secs 2023-05-08T04:01:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1053.135557 secs 2023-05-08T04:01:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1053.135557 secs 2023-05-08T04:01:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:55 smithi133 ceph-mon[125939]: pgmap v627: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:01:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1054.411992 secs 2023-05-08T04:01:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:55 smithi096 ceph-mon[124666]: pgmap v627: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:01:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1054.411992 secs 2023-05-08T04:01:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:55 smithi186 ceph-mon[126480]: pgmap v627: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:01:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1054.411992 secs 2023-05-08T04:01:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:57 smithi133 ceph-mon[125939]: pgmap v628: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:01:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:57 smithi096 ceph-mon[124666]: pgmap v628: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:01:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:57 smithi186 ceph-mon[126480]: pgmap v628: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:01:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1057.582320 secs 2023-05-08T04:01:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:58 smithi133 ceph-mon[125939]: pgmap v629: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:01:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1058.135688 secs 2023-05-08T04:01:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1057.582320 secs 2023-05-08T04:01:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:58 smithi096 ceph-mon[124666]: pgmap v629: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:01:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1058.135688 secs 2023-05-08T04:01:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1057.582320 secs 2023-05-08T04:01:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:58 smithi186 ceph-mon[126480]: pgmap v629: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:01:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1058.135688 secs 2023-05-08T04:02:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:01:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1059.412127 secs 2023-05-08T04:02:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:01:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1059.412127 secs 2023-05-08T04:02:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:01:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1059.412127 secs 2023-05-08T04:02:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:00 smithi133 ceph-mon[125939]: pgmap v630: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:02:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:00 smithi096 ceph-mon[124666]: pgmap v630: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:02:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:00 smithi186 ceph-mon[126480]: pgmap v630: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:02:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:03 smithi133 ceph-mon[125939]: pgmap v631: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:02:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1062.582424 secs 2023-05-08T04:02:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:03 smithi096 ceph-mon[124666]: pgmap v631: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:02:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1062.582424 secs 2023-05-08T04:02:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:03 smithi186 ceph-mon[126480]: pgmap v631: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:02:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1062.582424 secs 2023-05-08T04:02:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1063.135822 secs 2023-05-08T04:02:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1063.135822 secs 2023-05-08T04:02:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1063.135822 secs 2023-05-08T04:02:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:05 smithi133 ceph-mon[125939]: pgmap v632: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:02:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1064.412272 secs 2023-05-08T04:02:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:05 smithi096 ceph-mon[124666]: pgmap v632: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:02:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1064.412272 secs 2023-05-08T04:02:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:05 smithi186 ceph-mon[126480]: pgmap v632: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:02:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1064.412272 secs 2023-05-08T04:02:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:07 smithi133 ceph-mon[125939]: pgmap v633: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:02:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:07 smithi096 ceph-mon[124666]: pgmap v633: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:02:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:07 smithi186 ceph-mon[126480]: pgmap v633: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:02:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1067.582541 secs 2023-05-08T04:02:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:08 smithi133 ceph-mon[125939]: pgmap v634: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:02:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1068.135973 secs 2023-05-08T04:02:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1067.582541 secs 2023-05-08T04:02:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:08 smithi096 ceph-mon[124666]: pgmap v634: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:02:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1068.135973 secs 2023-05-08T04:02:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1067.582541 secs 2023-05-08T04:02:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:08 smithi186 ceph-mon[126480]: pgmap v634: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:02:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1068.135973 secs 2023-05-08T04:02:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1069.412396 secs 2023-05-08T04:02:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:10 smithi096 ceph-mon[124666]: osdmap e122: 12 total, 12 up, 12 in 2023-05-08T04:02:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:10 smithi096 ceph-mon[124666]: pgmap v636: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:02:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1069.412396 secs 2023-05-08T04:02:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:10 smithi186 ceph-mon[126480]: osdmap e122: 12 total, 12 up, 12 in 2023-05-08T04:02:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:10 smithi186 ceph-mon[126480]: pgmap v636: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:02:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1069.412396 secs 2023-05-08T04:02:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:10 smithi133 ceph-mon[125939]: osdmap e122: 12 total, 12 up, 12 in 2023-05-08T04:02:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:10 smithi133 ceph-mon[125939]: pgmap v636: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:02:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:13 smithi133 ceph-mon[125939]: pgmap v637: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:02:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1072.582663 secs 2023-05-08T04:02:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:13 smithi096 ceph-mon[124666]: pgmap v637: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:02:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1072.582663 secs 2023-05-08T04:02:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:13 smithi186 ceph-mon[126480]: pgmap v637: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:02:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1072.582663 secs 2023-05-08T04:02:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1073.136124 secs 2023-05-08T04:02:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1073.136124 secs 2023-05-08T04:02:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1073.136124 secs 2023-05-08T04:02:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:15 smithi133 ceph-mon[125939]: pgmap v638: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:02:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1074.412537 secs 2023-05-08T04:02:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:15 smithi096 ceph-mon[124666]: pgmap v638: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:02:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1074.412537 secs 2023-05-08T04:02:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:15 smithi186 ceph-mon[126480]: pgmap v638: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:02:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1074.412537 secs 2023-05-08T04:02:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:17 smithi133 ceph-mon[125939]: pgmap v639: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:02:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:17 smithi096 ceph-mon[124666]: pgmap v639: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:02:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:17 smithi186 ceph-mon[126480]: pgmap v639: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:02:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:18 smithi133 ceph-mon[125939]: osdmap e123: 12 total, 12 up, 12 in 2023-05-08T04:02:18.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1077.582727 secs 2023-05-08T04:02:18.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:18 smithi133 ceph-mon[125939]: pgmap v641: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:02:18.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1078.136262 secs 2023-05-08T04:02:19.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:18 smithi096 ceph-mon[124666]: osdmap e123: 12 total, 12 up, 12 in 2023-05-08T04:02:19.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1077.582727 secs 2023-05-08T04:02:19.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:18 smithi096 ceph-mon[124666]: pgmap v641: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:02:19.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1078.136262 secs 2023-05-08T04:02:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:18 smithi186 ceph-mon[126480]: osdmap e123: 12 total, 12 up, 12 in 2023-05-08T04:02:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1077.582727 secs 2023-05-08T04:02:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:18 smithi186 ceph-mon[126480]: pgmap v641: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:02:19.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1078.136262 secs 2023-05-08T04:02:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1079.412670 secs 2023-05-08T04:02:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1079.412670 secs 2023-05-08T04:02:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1079.412670 secs 2023-05-08T04:02:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:20 smithi133 ceph-mon[125939]: pgmap v642: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:02:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:20 smithi096 ceph-mon[124666]: pgmap v642: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:02:21.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:20 smithi186 ceph-mon[126480]: pgmap v642: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:02:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:23 smithi133 ceph-mon[125939]: pgmap v643: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:02:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1082.582850 secs 2023-05-08T04:02:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:23 smithi096 ceph-mon[124666]: pgmap v643: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:02:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1082.582850 secs 2023-05-08T04:02:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:23 smithi186 ceph-mon[126480]: pgmap v643: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:02:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1082.582850 secs 2023-05-08T04:02:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1083.136398 secs 2023-05-08T04:02:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1083.136398 secs 2023-05-08T04:02:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1083.136398 secs 2023-05-08T04:02:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:25 smithi133 ceph-mon[125939]: pgmap v644: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:02:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1084.412767 secs 2023-05-08T04:02:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:25 smithi096 ceph-mon[124666]: pgmap v644: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:02:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1084.412767 secs 2023-05-08T04:02:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:25 smithi186 ceph-mon[126480]: pgmap v644: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:02:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1084.412767 secs 2023-05-08T04:02:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:27 smithi133 ceph-mon[125939]: pgmap v645: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:02:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:27 smithi096 ceph-mon[124666]: pgmap v645: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:02:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:27 smithi186 ceph-mon[126480]: pgmap v645: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:02:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1087.582931 secs 2023-05-08T04:02:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:28 smithi096 ceph-mon[124666]: pgmap v646: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T04:02:29.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1088.136556 secs 2023-05-08T04:02:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1087.582931 secs 2023-05-08T04:02:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:28 smithi186 ceph-mon[126480]: pgmap v646: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T04:02:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1088.136556 secs 2023-05-08T04:02:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1087.582931 secs 2023-05-08T04:02:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:28 smithi133 ceph-mon[125939]: pgmap v646: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T04:02:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1088.136556 secs 2023-05-08T04:02:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:31 smithi133 ceph-mon[125939]: pgmap v647: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 17 KiB/s wr, 9 op/s 2023-05-08T04:02:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:31 smithi096 ceph-mon[124666]: pgmap v647: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 17 KiB/s wr, 9 op/s 2023-05-08T04:02:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:31 smithi186 ceph-mon[126480]: pgmap v647: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 17 KiB/s wr, 9 op/s 2023-05-08T04:02:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:33 smithi133 ceph-mon[125939]: pgmap v648: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 17 KiB/s wr, 6 op/s 2023-05-08T04:02:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1092.583042 secs 2023-05-08T04:02:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:33 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:02:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:33 smithi096 ceph-mon[124666]: pgmap v648: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 17 KiB/s wr, 6 op/s 2023-05-08T04:02:33.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1092.583042 secs 2023-05-08T04:02:33.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:33 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:02:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:33 smithi186 ceph-mon[126480]: pgmap v648: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 17 KiB/s wr, 6 op/s 2023-05-08T04:02:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1092.583042 secs 2023-05-08T04:02:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:33 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:02:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1093.136714 secs 2023-05-08T04:02:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:34 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:02:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:34 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:02:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:34 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:02:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1093.136714 secs 2023-05-08T04:02:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:34 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:02:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:34 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:02:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:34 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:02:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1093.136714 secs 2023-05-08T04:02:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:34 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:02:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:34 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:02:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:34 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:02:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:35 smithi133 ceph-mon[125939]: pgmap v649: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 42 KiB/s wr, 10 op/s 2023-05-08T04:02:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1094.413004 secs 2023-05-08T04:02:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:35 smithi096 ceph-mon[124666]: pgmap v649: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 42 KiB/s wr, 10 op/s 2023-05-08T04:02:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1094.413004 secs 2023-05-08T04:02:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:35 smithi186 ceph-mon[126480]: pgmap v649: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 42 KiB/s wr, 10 op/s 2023-05-08T04:02:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1094.413004 secs 2023-05-08T04:02:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:37 smithi133 ceph-mon[125939]: pgmap v650: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 42 KiB/s wr, 7 op/s 2023-05-08T04:02:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:37 smithi096 ceph-mon[124666]: pgmap v650: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 42 KiB/s wr, 7 op/s 2023-05-08T04:02:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:37 smithi186 ceph-mon[126480]: pgmap v650: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 42 KiB/s wr, 7 op/s 2023-05-08T04:02:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:38 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:02:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:38 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:02:38.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1097.583187 secs 2023-05-08T04:02:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:38 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:02:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:38 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:02:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1097.583187 secs 2023-05-08T04:02:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:38 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:02:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:38 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:02:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1097.583187 secs 2023-05-08T04:02:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:39 smithi133 ceph-mon[125939]: pgmap v651: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 42 KiB/s wr, 7 op/s 2023-05-08T04:02:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1098.136846 secs 2023-05-08T04:02:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:39 smithi096 ceph-mon[124666]: pgmap v651: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 42 KiB/s wr, 7 op/s 2023-05-08T04:02:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1098.136846 secs 2023-05-08T04:02:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:39 smithi186 ceph-mon[126480]: pgmap v651: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 42 KiB/s wr, 7 op/s 2023-05-08T04:02:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1098.136846 secs 2023-05-08T04:02:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1099.413104 secs 2023-05-08T04:02:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1099.413104 secs 2023-05-08T04:02:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1099.413104 secs 2023-05-08T04:02:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:41 smithi133 ceph-mon[125939]: pgmap v652: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 50 KiB/s wr, 11 op/s 2023-05-08T04:02:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:41 smithi096 ceph-mon[124666]: pgmap v652: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 50 KiB/s wr, 11 op/s 2023-05-08T04:02:41.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:41 smithi186 ceph-mon[126480]: pgmap v652: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 50 KiB/s wr, 11 op/s 2023-05-08T04:02:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:02:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:02:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:02:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:43 smithi133 ceph-mon[125939]: pgmap v653: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 7 op/s 2023-05-08T04:02:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:43 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:02:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1102.583249 secs 2023-05-08T04:02:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:43 smithi096 ceph-mon[124666]: pgmap v653: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 7 op/s 2023-05-08T04:02:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:43 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:02:43.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1102.583249 secs 2023-05-08T04:02:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:43 smithi186 ceph-mon[126480]: pgmap v653: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 7 op/s 2023-05-08T04:02:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:43 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:02:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1102.583249 secs 2023-05-08T04:02:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1103.136949 secs 2023-05-08T04:02:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1103.136949 secs 2023-05-08T04:02:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1103.136949 secs 2023-05-08T04:02:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:45 smithi133 ceph-mon[125939]: pgmap v654: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 33 KiB/s wr, 9 op/s 2023-05-08T04:02:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1104.413177 secs 2023-05-08T04:02:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:02:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:02:45.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:02:45.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:02:45.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:02:45.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:02:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:45 smithi096 ceph-mon[124666]: pgmap v654: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 33 KiB/s wr, 9 op/s 2023-05-08T04:02:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1104.413177 secs 2023-05-08T04:02:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:02:45.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:02:45.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:02:45.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:02:45.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:02:45.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:02:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:45 smithi186 ceph-mon[126480]: pgmap v654: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 33 KiB/s wr, 9 op/s 2023-05-08T04:02:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1104.413177 secs 2023-05-08T04:02:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:02:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:02:45.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:02:45.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:02:45.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:02:45.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:02:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:46 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:02:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:46 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:02:46.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:46 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:02:46.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:46 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:02:46.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:46 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi096 to 196.2M 2023-05-08T04:02:46.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:46 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi096 to 205766758: error parsing value: Value '205766758' is below minimum 939524096 2023-05-08T04:02:46.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:46 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:02:46.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:46 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:02:46.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:46 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:02:46.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:46 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:02:46.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:46 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T04:02:46.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:46 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T04:02:46.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:46 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:02:46.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:46 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:02:46.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:46 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:02:46.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:46 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:02:46.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:46 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T04:02:46.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:46 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T04:02:46.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:46 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:02:46.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:46 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:02:46.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:46 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:02:46.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:46 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:02:46.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:46 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T04:02:46.744 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:46 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T04:02:46.744 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:46 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:02:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:46 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:02:46.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:46 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:02:46.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:46 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:02:46.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:46 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:02:46.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:46 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi096 to 196.2M 2023-05-08T04:02:46.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:46 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi096 to 205766758: error parsing value: Value '205766758' is below minimum 939524096 2023-05-08T04:02:46.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:46 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:02:46.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:46 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:02:46.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:46 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:02:46.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:46 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:02:46.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:46 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T04:02:46.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:46 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T04:02:46.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:46 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:02:46.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:46 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:02:46.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:46 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:02:46.759 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:46 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:02:46.759 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:46 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T04:02:46.759 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:46 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T04:02:46.759 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:46 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:02:46.759 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:46 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:02:46.759 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:46 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:02:46.759 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:46 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:02:46.759 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:46 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T04:02:46.760 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:46 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T04:02:46.760 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:46 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:02:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:46 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:02:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:46 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:02:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:46 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:02:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:46 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:02:46.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:46 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi096 to 196.2M 2023-05-08T04:02:46.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:46 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi096 to 205766758: error parsing value: Value '205766758' is below minimum 939524096 2023-05-08T04:02:46.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:46 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:02:46.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:46 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:02:46.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:46 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:02:46.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:46 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:02:46.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:46 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T04:02:46.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:46 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T04:02:46.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:46 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:02:46.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:46 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:02:46.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:46 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:02:46.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:46 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:02:46.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:46 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T04:02:46.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:46 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T04:02:46.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:46 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:02:46.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:46 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:02:46.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:46 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:02:46.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:46 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:02:46.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:46 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T04:02:46.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:46 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T04:02:46.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:46 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:02:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:47 smithi133 ceph-mon[125939]: pgmap v655: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.0 KiB/s wr, 5 op/s 2023-05-08T04:02:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:47 smithi096 ceph-mon[124666]: pgmap v655: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.0 KiB/s wr, 5 op/s 2023-05-08T04:02:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:47 smithi186 ceph-mon[126480]: pgmap v655: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.0 KiB/s wr, 5 op/s 2023-05-08T04:02:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1107.583372 secs 2023-05-08T04:02:49.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:48 smithi096 ceph-mon[124666]: pgmap v656: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.7 KiB/s wr, 5 op/s 2023-05-08T04:02:49.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1108.137088 secs 2023-05-08T04:02:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1107.583372 secs 2023-05-08T04:02:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:48 smithi186 ceph-mon[126480]: pgmap v656: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.7 KiB/s wr, 5 op/s 2023-05-08T04:02:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1108.137088 secs 2023-05-08T04:02:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1107.583372 secs 2023-05-08T04:02:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:48 smithi133 ceph-mon[125939]: pgmap v656: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.7 KiB/s wr, 5 op/s 2023-05-08T04:02:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1108.137088 secs 2023-05-08T04:02:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1109.413317 secs 2023-05-08T04:02:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1109.413317 secs 2023-05-08T04:02:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1109.413317 secs 2023-05-08T04:02:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:50 smithi133 ceph-mon[125939]: pgmap v657: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.7 KiB/s wr, 8 op/s 2023-05-08T04:02:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:50 smithi096 ceph-mon[124666]: pgmap v657: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.7 KiB/s wr, 8 op/s 2023-05-08T04:02:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:50 smithi186 ceph-mon[126480]: pgmap v657: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.7 KiB/s wr, 8 op/s 2023-05-08T04:02:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:53 smithi133 ceph-mon[125939]: pgmap v658: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:02:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1112.583525 secs 2023-05-08T04:02:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:53 smithi096 ceph-mon[124666]: pgmap v658: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:02:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1112.583525 secs 2023-05-08T04:02:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:53 smithi186 ceph-mon[126480]: pgmap v658: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:02:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1112.583525 secs 2023-05-08T04:02:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1113.137221 secs 2023-05-08T04:02:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1113.137221 secs 2023-05-08T04:02:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1113.137221 secs 2023-05-08T04:02:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:55 smithi133 ceph-mon[125939]: pgmap v659: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:02:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1114.413453 secs 2023-05-08T04:02:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:55 smithi096 ceph-mon[124666]: pgmap v659: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:02:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1114.413453 secs 2023-05-08T04:02:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:55 smithi186 ceph-mon[126480]: pgmap v659: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:02:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1114.413453 secs 2023-05-08T04:02:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:57 smithi133 ceph-mon[125939]: pgmap v660: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:02:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:57 smithi096 ceph-mon[124666]: pgmap v660: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:02:57.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:57 smithi186 ceph-mon[126480]: pgmap v660: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:02:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1117.583666 secs 2023-05-08T04:02:59.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:58 smithi096 ceph-mon[124666]: pgmap v661: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:02:59.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1118.137374 secs 2023-05-08T04:02:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1117.583666 secs 2023-05-08T04:02:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:58 smithi186 ceph-mon[126480]: pgmap v661: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:02:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1118.137374 secs 2023-05-08T04:02:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1117.583666 secs 2023-05-08T04:02:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:58 smithi133 ceph-mon[125939]: pgmap v661: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:02:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1118.137374 secs 2023-05-08T04:03:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:02:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1119.413594 secs 2023-05-08T04:03:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:02:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1119.413594 secs 2023-05-08T04:03:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:02:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1119.413594 secs 2023-05-08T04:03:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:00 smithi133 ceph-mon[125939]: pgmap v662: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:03:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:00 smithi096 ceph-mon[124666]: pgmap v662: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:03:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:00 smithi186 ceph-mon[126480]: pgmap v662: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:03:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:03 smithi133 ceph-mon[125939]: pgmap v663: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:03:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1122.583758 secs 2023-05-08T04:03:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:03 smithi096 ceph-mon[124666]: pgmap v663: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:03:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1122.583758 secs 2023-05-08T04:03:03.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:03 smithi186 ceph-mon[126480]: pgmap v663: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:03:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1122.583758 secs 2023-05-08T04:03:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1123.137529 secs 2023-05-08T04:03:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1123.137529 secs 2023-05-08T04:03:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1123.137529 secs 2023-05-08T04:03:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:05 smithi133 ceph-mon[125939]: pgmap v664: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:03:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1124.413713 secs 2023-05-08T04:03:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:05 smithi096 ceph-mon[124666]: pgmap v664: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:03:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1124.413713 secs 2023-05-08T04:03:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:05 smithi186 ceph-mon[126480]: pgmap v664: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:03:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1124.413713 secs 2023-05-08T04:03:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:07 smithi133 ceph-mon[125939]: pgmap v665: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:03:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:07 smithi096 ceph-mon[124666]: pgmap v665: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:03:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:07 smithi186 ceph-mon[126480]: pgmap v665: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:03:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1127.583824 secs 2023-05-08T04:03:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:08 smithi096 ceph-mon[124666]: pgmap v666: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:03:09.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1128.137596 secs 2023-05-08T04:03:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1127.583824 secs 2023-05-08T04:03:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:08 smithi186 ceph-mon[126480]: pgmap v666: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:03:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1128.137596 secs 2023-05-08T04:03:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1127.583824 secs 2023-05-08T04:03:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:08 smithi133 ceph-mon[125939]: pgmap v666: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:03:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1128.137596 secs 2023-05-08T04:03:11.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1129.413852 secs 2023-05-08T04:03:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:10 smithi186 ceph-mon[126480]: osdmap e124: 12 total, 12 up, 12 in 2023-05-08T04:03:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:10 smithi186 ceph-mon[126480]: pgmap v668: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:03:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1129.413852 secs 2023-05-08T04:03:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:10 smithi133 ceph-mon[125939]: osdmap e124: 12 total, 12 up, 12 in 2023-05-08T04:03:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:10 smithi133 ceph-mon[125939]: pgmap v668: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:03:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1129.413852 secs 2023-05-08T04:03:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:10 smithi096 ceph-mon[124666]: osdmap e124: 12 total, 12 up, 12 in 2023-05-08T04:03:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:10 smithi096 ceph-mon[124666]: pgmap v668: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:03:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:13 smithi133 ceph-mon[125939]: pgmap v669: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:03:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1132.583947 secs 2023-05-08T04:03:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:13 smithi096 ceph-mon[124666]: pgmap v669: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:03:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1132.583947 secs 2023-05-08T04:03:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:13 smithi186 ceph-mon[126480]: pgmap v669: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:03:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1132.583947 secs 2023-05-08T04:03:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1133.137739 secs 2023-05-08T04:03:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1133.137739 secs 2023-05-08T04:03:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1133.137739 secs 2023-05-08T04:03:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:15 smithi133 ceph-mon[125939]: pgmap v670: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:03:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1134.413965 secs 2023-05-08T04:03:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:15 smithi096 ceph-mon[124666]: pgmap v670: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:03:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1134.413965 secs 2023-05-08T04:03:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:15 smithi186 ceph-mon[126480]: pgmap v670: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:03:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1134.413965 secs 2023-05-08T04:03:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:17 smithi133 ceph-mon[125939]: pgmap v671: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:03:17.905 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:17 smithi186 ceph-mon[126480]: pgmap v671: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:03:17.906 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:17 smithi096 ceph-mon[124666]: pgmap v671: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:03:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:18 smithi096 ceph-mon[124666]: osdmap e125: 12 total, 12 up, 12 in 2023-05-08T04:03:19.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1137.584075 secs 2023-05-08T04:03:19.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:18 smithi096 ceph-mon[124666]: pgmap v673: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:03:19.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1138.137843 secs 2023-05-08T04:03:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:18 smithi186 ceph-mon[126480]: osdmap e125: 12 total, 12 up, 12 in 2023-05-08T04:03:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1137.584075 secs 2023-05-08T04:03:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:18 smithi186 ceph-mon[126480]: pgmap v673: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:03:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1138.137843 secs 2023-05-08T04:03:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:18 smithi133 ceph-mon[125939]: osdmap e125: 12 total, 12 up, 12 in 2023-05-08T04:03:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1137.584075 secs 2023-05-08T04:03:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:18 smithi133 ceph-mon[125939]: pgmap v673: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:03:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1138.137843 secs 2023-05-08T04:03:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1139.414086 secs 2023-05-08T04:03:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1139.414086 secs 2023-05-08T04:03:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1139.414086 secs 2023-05-08T04:03:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:20 smithi133 ceph-mon[125939]: pgmap v674: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:03:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:20 smithi096 ceph-mon[124666]: pgmap v674: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:03:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:20 smithi186 ceph-mon[126480]: pgmap v674: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:03:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:23 smithi133 ceph-mon[125939]: pgmap v675: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:03:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1142.584197 secs 2023-05-08T04:03:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:23 smithi096 ceph-mon[124666]: pgmap v675: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:03:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1142.584197 secs 2023-05-08T04:03:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:23 smithi186 ceph-mon[126480]: pgmap v675: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:03:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1142.584197 secs 2023-05-08T04:03:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1143.138010 secs 2023-05-08T04:03:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1143.138010 secs 2023-05-08T04:03:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1143.138010 secs 2023-05-08T04:03:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:25 smithi133 ceph-mon[125939]: pgmap v676: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:03:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1144.414208 secs 2023-05-08T04:03:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:25 smithi096 ceph-mon[124666]: pgmap v676: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:03:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1144.414208 secs 2023-05-08T04:03:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:25 smithi186 ceph-mon[126480]: pgmap v676: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:03:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1144.414208 secs 2023-05-08T04:03:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:27 smithi133 ceph-mon[125939]: pgmap v677: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:03:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:27 smithi096 ceph-mon[124666]: pgmap v677: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:03:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:27 smithi186 ceph-mon[126480]: pgmap v677: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:03:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1147.584320 secs 2023-05-08T04:03:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:28 smithi186 ceph-mon[126480]: pgmap v678: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T04:03:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1148.138141 secs 2023-05-08T04:03:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1147.584320 secs 2023-05-08T04:03:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:28 smithi133 ceph-mon[125939]: pgmap v678: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T04:03:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1148.138141 secs 2023-05-08T04:03:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1147.584320 secs 2023-05-08T04:03:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:28 smithi096 ceph-mon[124666]: pgmap v678: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T04:03:29.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1148.138141 secs 2023-05-08T04:03:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:31 smithi133 ceph-mon[125939]: pgmap v679: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 22 KiB/s wr, 8 op/s 2023-05-08T04:03:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:31 smithi096 ceph-mon[124666]: pgmap v679: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 22 KiB/s wr, 8 op/s 2023-05-08T04:03:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:31 smithi186 ceph-mon[126480]: pgmap v679: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 22 KiB/s wr, 8 op/s 2023-05-08T04:03:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:33 smithi133 ceph-mon[125939]: pgmap v680: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 22 KiB/s wr, 5 op/s 2023-05-08T04:03:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1152.584435 secs 2023-05-08T04:03:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:33 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:03:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:33 smithi096 ceph-mon[124666]: pgmap v680: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 22 KiB/s wr, 5 op/s 2023-05-08T04:03:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1152.584435 secs 2023-05-08T04:03:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:33 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:03:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:33 smithi186 ceph-mon[126480]: pgmap v680: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 22 KiB/s wr, 5 op/s 2023-05-08T04:03:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1152.584435 secs 2023-05-08T04:03:33.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:33 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:03:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1153.138300 secs 2023-05-08T04:03:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:34 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:03:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:34 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:03:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:34 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:03:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1153.138300 secs 2023-05-08T04:03:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:34 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:03:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:34 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:03:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:34 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:03:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1153.138300 secs 2023-05-08T04:03:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:34 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:03:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:34 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:03:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:34 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:03:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:35 smithi133 ceph-mon[125939]: pgmap v681: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 50 KiB/s wr, 10 op/s 2023-05-08T04:03:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1154.414464 secs 2023-05-08T04:03:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:35 smithi096 ceph-mon[124666]: pgmap v681: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 50 KiB/s wr, 10 op/s 2023-05-08T04:03:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1154.414464 secs 2023-05-08T04:03:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:35 smithi186 ceph-mon[126480]: pgmap v681: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 50 KiB/s wr, 10 op/s 2023-05-08T04:03:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1154.414464 secs 2023-05-08T04:03:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:37 smithi133 ceph-mon[125939]: pgmap v682: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 50 KiB/s wr, 7 op/s 2023-05-08T04:03:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:37 smithi096 ceph-mon[124666]: pgmap v682: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 50 KiB/s wr, 7 op/s 2023-05-08T04:03:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:37 smithi186 ceph-mon[126480]: pgmap v682: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 50 KiB/s wr, 7 op/s 2023-05-08T04:03:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:38 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:03:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:38 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:03:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1157.584531 secs 2023-05-08T04:03:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:38 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:03:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:38 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:03:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1157.584531 secs 2023-05-08T04:03:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:38 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:03:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:38 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:03:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1157.584531 secs 2023-05-08T04:03:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:39 smithi133 ceph-mon[125939]: pgmap v683: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 50 KiB/s wr, 7 op/s 2023-05-08T04:03:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1158.138436 secs 2023-05-08T04:03:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:39 smithi096 ceph-mon[124666]: pgmap v683: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 50 KiB/s wr, 7 op/s 2023-05-08T04:03:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1158.138436 secs 2023-05-08T04:03:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:39 smithi186 ceph-mon[126480]: pgmap v683: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 50 KiB/s wr, 7 op/s 2023-05-08T04:03:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1158.138436 secs 2023-05-08T04:03:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1159.414567 secs 2023-05-08T04:03:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1159.414567 secs 2023-05-08T04:03:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1159.414567 secs 2023-05-08T04:03:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:41 smithi133 ceph-mon[125939]: pgmap v684: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 59 KiB/s wr, 11 op/s 2023-05-08T04:03:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:41 smithi096 ceph-mon[124666]: pgmap v684: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 59 KiB/s wr, 11 op/s 2023-05-08T04:03:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:41 smithi186 ceph-mon[126480]: pgmap v684: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 59 KiB/s wr, 11 op/s 2023-05-08T04:03:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:43 smithi133 ceph-mon[125939]: pgmap v685: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 37 KiB/s wr, 8 op/s 2023-05-08T04:03:43.787 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:43 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:03:43.788 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1162.584643 secs 2023-05-08T04:03:43.788 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:43 smithi096 ceph-mon[124666]: pgmap v685: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 37 KiB/s wr, 8 op/s 2023-05-08T04:03:43.789 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:43 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:03:43.789 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1162.584643 secs 2023-05-08T04:03:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:43 smithi186 ceph-mon[126480]: pgmap v685: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 37 KiB/s wr, 8 op/s 2023-05-08T04:03:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:43 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:03:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1162.584643 secs 2023-05-08T04:03:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1163.138588 secs 2023-05-08T04:03:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1163.138588 secs 2023-05-08T04:03:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1163.138588 secs 2023-05-08T04:03:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:45 smithi133 ceph-mon[125939]: pgmap v686: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 37 KiB/s wr, 11 op/s 2023-05-08T04:03:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1164.414668 secs 2023-05-08T04:03:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:45 smithi096 ceph-mon[124666]: pgmap v686: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 37 KiB/s wr, 11 op/s 2023-05-08T04:03:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1164.414668 secs 2023-05-08T04:03:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:45 smithi186 ceph-mon[126480]: pgmap v686: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 37 KiB/s wr, 11 op/s 2023-05-08T04:03:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1164.414668 secs 2023-05-08T04:03:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:46 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:03:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:46 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:03:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:46 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:03:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:46 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:03:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:46 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:03:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:46 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:03:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:46 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:03:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:46 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:03:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:46 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:03:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:46 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:03:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:46 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:03:46.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:46 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:03:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:47 smithi133 ceph-mon[125939]: pgmap v687: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.3 KiB/s wr, 7 op/s 2023-05-08T04:03:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:47 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:03:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:47 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T04:03:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:47 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T04:03:47.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:47 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:03:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:47 smithi096 ceph-mon[124666]: pgmap v687: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.3 KiB/s wr, 7 op/s 2023-05-08T04:03:47.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:47 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:03:47.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:47 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T04:03:47.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:47 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T04:03:47.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:47 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:03:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:47 smithi186 ceph-mon[126480]: pgmap v687: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.3 KiB/s wr, 7 op/s 2023-05-08T04:03:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:47 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:03:47.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:47 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T04:03:47.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:47 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T04:03:47.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:47 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:03:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1167.584769 secs 2023-05-08T04:03:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:48 smithi186 ceph-mon[126480]: pgmap v688: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.3 KiB/s wr, 7 op/s 2023-05-08T04:03:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1168.138718 secs 2023-05-08T04:03:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1167.584769 secs 2023-05-08T04:03:49.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:48 smithi133 ceph-mon[125939]: pgmap v688: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.3 KiB/s wr, 7 op/s 2023-05-08T04:03:49.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1168.138718 secs 2023-05-08T04:03:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1167.584769 secs 2023-05-08T04:03:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:48 smithi096 ceph-mon[124666]: pgmap v688: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.3 KiB/s wr, 7 op/s 2023-05-08T04:03:49.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1168.138718 secs 2023-05-08T04:03:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1169.414802 secs 2023-05-08T04:03:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1169.414802 secs 2023-05-08T04:03:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1169.414802 secs 2023-05-08T04:03:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:50 smithi133 ceph-mon[125939]: pgmap v689: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.3 KiB/s wr, 10 op/s 2023-05-08T04:03:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:50 smithi096 ceph-mon[124666]: pgmap v689: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.3 KiB/s wr, 10 op/s 2023-05-08T04:03:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:50 smithi186 ceph-mon[126480]: pgmap v689: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.3 KiB/s wr, 10 op/s 2023-05-08T04:03:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:53 smithi133 ceph-mon[125939]: pgmap v690: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 6 op/s 2023-05-08T04:03:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1172.584895 secs 2023-05-08T04:03:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:53 smithi096 ceph-mon[124666]: pgmap v690: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 6 op/s 2023-05-08T04:03:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1172.584895 secs 2023-05-08T04:03:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:53 smithi186 ceph-mon[126480]: pgmap v690: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 6 op/s 2023-05-08T04:03:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1172.584895 secs 2023-05-08T04:03:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1173.138821 secs 2023-05-08T04:03:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1173.138821 secs 2023-05-08T04:03:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1173.138821 secs 2023-05-08T04:03:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:55 smithi133 ceph-mon[125939]: pgmap v691: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 9 op/s 2023-05-08T04:03:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1174.414831 secs 2023-05-08T04:03:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:55 smithi096 ceph-mon[124666]: pgmap v691: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 9 op/s 2023-05-08T04:03:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1174.414831 secs 2023-05-08T04:03:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:55 smithi186 ceph-mon[126480]: pgmap v691: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 9 op/s 2023-05-08T04:03:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1174.414831 secs 2023-05-08T04:03:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:57 smithi133 ceph-mon[125939]: pgmap v692: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:03:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:57 smithi096 ceph-mon[124666]: pgmap v692: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:03:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:57 smithi186 ceph-mon[126480]: pgmap v692: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:03:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1177.585014 secs 2023-05-08T04:03:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:58 smithi186 ceph-mon[126480]: pgmap v693: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:03:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1178.138957 secs 2023-05-08T04:03:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1177.585014 secs 2023-05-08T04:03:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:58 smithi133 ceph-mon[125939]: pgmap v693: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:03:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1178.138957 secs 2023-05-08T04:03:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1177.585014 secs 2023-05-08T04:03:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:58 smithi096 ceph-mon[124666]: pgmap v693: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:03:59.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1178.138957 secs 2023-05-08T04:04:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:03:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1179.414920 secs 2023-05-08T04:04:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:03:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1179.414920 secs 2023-05-08T04:04:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:03:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1179.414920 secs 2023-05-08T04:04:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:00 smithi133 ceph-mon[125939]: pgmap v694: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T04:04:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:00 smithi096 ceph-mon[124666]: pgmap v694: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T04:04:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:00 smithi186 ceph-mon[126480]: pgmap v694: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T04:04:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:03 smithi133 ceph-mon[125939]: pgmap v695: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:04:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1182.585106 secs 2023-05-08T04:04:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:03 smithi096 ceph-mon[124666]: pgmap v695: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:04:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1182.585106 secs 2023-05-08T04:04:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:03 smithi186 ceph-mon[126480]: pgmap v695: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:04:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1182.585106 secs 2023-05-08T04:04:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1183.139079 secs 2023-05-08T04:04:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1183.139079 secs 2023-05-08T04:04:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1183.139079 secs 2023-05-08T04:04:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:05 smithi133 ceph-mon[125939]: pgmap v696: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-05-08T04:04:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1184.415041 secs 2023-05-08T04:04:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:05 smithi096 ceph-mon[124666]: pgmap v696: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-05-08T04:04:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1184.415041 secs 2023-05-08T04:04:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:05 smithi186 ceph-mon[126480]: pgmap v696: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-05-08T04:04:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1184.415041 secs 2023-05-08T04:04:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:07 smithi133 ceph-mon[125939]: pgmap v697: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 20 op/s 2023-05-08T04:04:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:07 smithi096 ceph-mon[124666]: pgmap v697: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 20 op/s 2023-05-08T04:04:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:07 smithi186 ceph-mon[126480]: pgmap v697: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 20 op/s 2023-05-08T04:04:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1187.585204 secs 2023-05-08T04:04:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:08 smithi186 ceph-mon[126480]: pgmap v698: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 20 op/s 2023-05-08T04:04:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1188.139218 secs 2023-05-08T04:04:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1187.585204 secs 2023-05-08T04:04:09.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:08 smithi133 ceph-mon[125939]: pgmap v698: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 20 op/s 2023-05-08T04:04:09.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1188.139218 secs 2023-05-08T04:04:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1187.585204 secs 2023-05-08T04:04:09.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:08 smithi096 ceph-mon[124666]: pgmap v698: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 20 op/s 2023-05-08T04:04:09.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1188.139218 secs 2023-05-08T04:04:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1189.415162 secs 2023-05-08T04:04:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:10 smithi186 ceph-mon[126480]: osdmap e126: 12 total, 12 up, 12 in 2023-05-08T04:04:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:10 smithi186 ceph-mon[126480]: pgmap v700: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T04:04:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1189.415162 secs 2023-05-08T04:04:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:10 smithi133 ceph-mon[125939]: osdmap e126: 12 total, 12 up, 12 in 2023-05-08T04:04:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:10 smithi133 ceph-mon[125939]: pgmap v700: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T04:04:11.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1189.415162 secs 2023-05-08T04:04:11.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:10 smithi096 ceph-mon[124666]: osdmap e126: 12 total, 12 up, 12 in 2023-05-08T04:04:11.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:10 smithi096 ceph-mon[124666]: pgmap v700: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T04:04:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:13 smithi133 ceph-mon[125939]: pgmap v701: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T04:04:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1192.585304 secs 2023-05-08T04:04:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:13 smithi096 ceph-mon[124666]: pgmap v701: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T04:04:13.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1192.585304 secs 2023-05-08T04:04:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:13 smithi186 ceph-mon[126480]: pgmap v701: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T04:04:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1192.585304 secs 2023-05-08T04:04:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1193.139372 secs 2023-05-08T04:04:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1193.139372 secs 2023-05-08T04:04:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1193.139372 secs 2023-05-08T04:04:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:15 smithi133 ceph-mon[125939]: pgmap v702: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:04:15.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1194.415280 secs 2023-05-08T04:04:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:15 smithi096 ceph-mon[124666]: pgmap v702: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:04:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1194.415280 secs 2023-05-08T04:04:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:15 smithi186 ceph-mon[126480]: pgmap v702: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:04:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1194.415280 secs 2023-05-08T04:04:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:17 smithi133 ceph-mon[125939]: pgmap v703: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:04:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:17 smithi096 ceph-mon[124666]: pgmap v703: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:04:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:17 smithi186 ceph-mon[126480]: pgmap v703: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:04:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:18 smithi186 ceph-mon[126480]: osdmap e127: 12 total, 12 up, 12 in 2023-05-08T04:04:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1197.585429 secs 2023-05-08T04:04:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:18 smithi186 ceph-mon[126480]: pgmap v705: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:04:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1198.139540 secs 2023-05-08T04:04:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:18 smithi133 ceph-mon[125939]: osdmap e127: 12 total, 12 up, 12 in 2023-05-08T04:04:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1197.585429 secs 2023-05-08T04:04:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:18 smithi133 ceph-mon[125939]: pgmap v705: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:04:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1198.139540 secs 2023-05-08T04:04:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:18 smithi096 ceph-mon[124666]: osdmap e127: 12 total, 12 up, 12 in 2023-05-08T04:04:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1197.585429 secs 2023-05-08T04:04:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:18 smithi096 ceph-mon[124666]: pgmap v705: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:04:19.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1198.139540 secs 2023-05-08T04:04:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1199.415400 secs 2023-05-08T04:04:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1199.415400 secs 2023-05-08T04:04:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1199.415400 secs 2023-05-08T04:04:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:20 smithi133 ceph-mon[125939]: pgmap v706: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:04:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:20 smithi096 ceph-mon[124666]: pgmap v706: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:04:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:20 smithi186 ceph-mon[126480]: pgmap v706: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:04:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:23 smithi133 ceph-mon[125939]: pgmap v707: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:04:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1202.585548 secs 2023-05-08T04:04:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:23 smithi096 ceph-mon[124666]: pgmap v707: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:04:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1202.585548 secs 2023-05-08T04:04:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:23 smithi186 ceph-mon[126480]: pgmap v707: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:04:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1202.585548 secs 2023-05-08T04:04:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1203.139668 secs 2023-05-08T04:04:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1203.139668 secs 2023-05-08T04:04:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1203.139668 secs 2023-05-08T04:04:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:25 smithi133 ceph-mon[125939]: pgmap v708: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:04:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1204.415522 secs 2023-05-08T04:04:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:25 smithi096 ceph-mon[124666]: pgmap v708: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:04:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1204.415522 secs 2023-05-08T04:04:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:25 smithi186 ceph-mon[126480]: pgmap v708: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:04:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1204.415522 secs 2023-05-08T04:04:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:27 smithi133 ceph-mon[125939]: pgmap v709: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:04:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:27 smithi096 ceph-mon[124666]: pgmap v709: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:04:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:27 smithi186 ceph-mon[126480]: pgmap v709: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:04:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1207.585620 secs 2023-05-08T04:04:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:28 smithi186 ceph-mon[126480]: pgmap v710: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T04:04:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1208.139802 secs 2023-05-08T04:04:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1207.585620 secs 2023-05-08T04:04:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:28 smithi133 ceph-mon[125939]: pgmap v710: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T04:04:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1208.139802 secs 2023-05-08T04:04:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1207.585620 secs 2023-05-08T04:04:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:28 smithi096 ceph-mon[124666]: pgmap v710: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T04:04:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1208.139802 secs 2023-05-08T04:04:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:31 smithi133 ceph-mon[125939]: pgmap v711: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 18 KiB/s wr, 9 op/s 2023-05-08T04:04:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:31 smithi096 ceph-mon[124666]: pgmap v711: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 18 KiB/s wr, 9 op/s 2023-05-08T04:04:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:31 smithi186 ceph-mon[126480]: pgmap v711: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 18 KiB/s wr, 9 op/s 2023-05-08T04:04:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:33 smithi133 ceph-mon[125939]: pgmap v712: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 18 KiB/s wr, 6 op/s 2023-05-08T04:04:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1212.585691 secs 2023-05-08T04:04:33.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:33 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:04:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:33 smithi096 ceph-mon[124666]: pgmap v712: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 18 KiB/s wr, 6 op/s 2023-05-08T04:04:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1212.585691 secs 2023-05-08T04:04:33.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:33 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:04:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:33 smithi186 ceph-mon[126480]: pgmap v712: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 18 KiB/s wr, 6 op/s 2023-05-08T04:04:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1212.585691 secs 2023-05-08T04:04:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:33 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:04:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1213.139907 secs 2023-05-08T04:04:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:34 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:04:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:34 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:04:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:34 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:04:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1213.139907 secs 2023-05-08T04:04:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:34 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:04:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:34 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:04:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:34 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:04:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1213.139907 secs 2023-05-08T04:04:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:34 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:04:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:34 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:04:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:34 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:04:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:35 smithi133 ceph-mon[125939]: pgmap v713: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 44 KiB/s wr, 10 op/s 2023-05-08T04:04:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1214.415758 secs 2023-05-08T04:04:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:35 smithi096 ceph-mon[124666]: pgmap v713: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 44 KiB/s wr, 10 op/s 2023-05-08T04:04:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1214.415758 secs 2023-05-08T04:04:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:35 smithi186 ceph-mon[126480]: pgmap v713: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 44 KiB/s wr, 10 op/s 2023-05-08T04:04:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1214.415758 secs 2023-05-08T04:04:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:37 smithi133 ceph-mon[125939]: pgmap v714: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 44 KiB/s wr, 7 op/s 2023-05-08T04:04:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:37 smithi096 ceph-mon[124666]: pgmap v714: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 44 KiB/s wr, 7 op/s 2023-05-08T04:04:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:37 smithi186 ceph-mon[126480]: pgmap v714: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 44 KiB/s wr, 7 op/s 2023-05-08T04:04:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:38 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:04:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:38 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:04:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1217.585787 secs 2023-05-08T04:04:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:38 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:04:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:38 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:04:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1217.585787 secs 2023-05-08T04:04:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:38 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:04:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:38 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:04:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1217.585787 secs 2023-05-08T04:04:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:39 smithi133 ceph-mon[125939]: pgmap v715: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 44 KiB/s wr, 7 op/s 2023-05-08T04:04:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1218.140052 secs 2023-05-08T04:04:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:39 smithi096 ceph-mon[124666]: pgmap v715: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 44 KiB/s wr, 7 op/s 2023-05-08T04:04:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1218.140052 secs 2023-05-08T04:04:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:39 smithi186 ceph-mon[126480]: pgmap v715: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 44 KiB/s wr, 7 op/s 2023-05-08T04:04:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1218.140052 secs 2023-05-08T04:04:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1219.415863 secs 2023-05-08T04:04:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1219.415863 secs 2023-05-08T04:04:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1219.415863 secs 2023-05-08T04:04:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:41 smithi133 ceph-mon[125939]: pgmap v716: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 53 KiB/s wr, 11 op/s 2023-05-08T04:04:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:41 smithi096 ceph-mon[124666]: pgmap v716: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 53 KiB/s wr, 11 op/s 2023-05-08T04:04:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:41 smithi186 ceph-mon[126480]: pgmap v716: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 53 KiB/s wr, 11 op/s 2023-05-08T04:04:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:43 smithi133 ceph-mon[125939]: pgmap v717: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 35 KiB/s wr, 7 op/s 2023-05-08T04:04:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:43 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:04:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1222.585904 secs 2023-05-08T04:04:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:43 smithi096 ceph-mon[124666]: pgmap v717: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 35 KiB/s wr, 7 op/s 2023-05-08T04:04:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:43 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:04:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1222.585904 secs 2023-05-08T04:04:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:43 smithi186 ceph-mon[126480]: pgmap v717: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 35 KiB/s wr, 7 op/s 2023-05-08T04:04:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:43 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:04:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1222.585904 secs 2023-05-08T04:04:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1223.140192 secs 2023-05-08T04:04:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1223.140192 secs 2023-05-08T04:04:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1223.140192 secs 2023-05-08T04:04:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:45 smithi096 ceph-mon[124666]: pgmap v718: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 KiB/s wr, 9 op/s 2023-05-08T04:04:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1224.415981 secs 2023-05-08T04:04:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:45 smithi186 ceph-mon[126480]: pgmap v718: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 KiB/s wr, 9 op/s 2023-05-08T04:04:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1224.415981 secs 2023-05-08T04:04:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:45 smithi133 ceph-mon[125939]: pgmap v718: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 KiB/s wr, 9 op/s 2023-05-08T04:04:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1224.415981 secs 2023-05-08T04:04:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:47 smithi096 ceph-mon[124666]: pgmap v719: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.4 KiB/s wr, 5 op/s 2023-05-08T04:04:47.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:47 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:04:47.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:47 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:04:47.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:47 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:04:47.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:47 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:04:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:47 smithi186 ceph-mon[126480]: pgmap v719: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.4 KiB/s wr, 5 op/s 2023-05-08T04:04:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:47 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:04:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:47 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:04:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:47 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:04:47.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:47 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:04:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:47 smithi133 ceph-mon[125939]: pgmap v719: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.4 KiB/s wr, 5 op/s 2023-05-08T04:04:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:47 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:04:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:47 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:04:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:47 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:04:47.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:47 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:04:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:48 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:04:48.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:48 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T04:04:48.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:48 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T04:04:48.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:48 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:04:48.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1227.586021 secs 2023-05-08T04:04:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:48 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:04:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:48 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T04:04:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:48 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T04:04:48.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:48 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:04:48.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1227.586021 secs 2023-05-08T04:04:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:48 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:04:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:48 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T04:04:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:48 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T04:04:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:48 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:04:48.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1227.586021 secs 2023-05-08T04:04:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:49 smithi096 ceph-mon[124666]: pgmap v720: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.3 KiB/s wr, 5 op/s 2023-05-08T04:04:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1228.140316 secs 2023-05-08T04:04:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:49 smithi186 ceph-mon[126480]: pgmap v720: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.3 KiB/s wr, 5 op/s 2023-05-08T04:04:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1228.140316 secs 2023-05-08T04:04:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:49 smithi133 ceph-mon[125939]: pgmap v720: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.3 KiB/s wr, 5 op/s 2023-05-08T04:04:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1228.140316 secs 2023-05-08T04:04:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1229.416099 secs 2023-05-08T04:04:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1229.416099 secs 2023-05-08T04:04:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1229.416099 secs 2023-05-08T04:04:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:51 smithi186 ceph-mon[126480]: pgmap v721: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.3 KiB/s wr, 8 op/s 2023-05-08T04:04:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:51 smithi133 ceph-mon[125939]: pgmap v721: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.3 KiB/s wr, 8 op/s 2023-05-08T04:04:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:51 smithi096 ceph-mon[124666]: pgmap v721: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.3 KiB/s wr, 8 op/s 2023-05-08T04:04:53.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:53 smithi186 ceph-mon[126480]: pgmap v722: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:04:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1232.586139 secs 2023-05-08T04:04:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:53 smithi133 ceph-mon[125939]: pgmap v722: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:04:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1232.586139 secs 2023-05-08T04:04:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:53 smithi096 ceph-mon[124666]: pgmap v722: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:04:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1232.586139 secs 2023-05-08T04:04:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1233.140416 secs 2023-05-08T04:04:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1233.140416 secs 2023-05-08T04:04:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1233.140416 secs 2023-05-08T04:04:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:55 smithi096 ceph-mon[124666]: pgmap v723: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:04:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1234.416217 secs 2023-05-08T04:04:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:55 smithi186 ceph-mon[126480]: pgmap v723: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:04:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1234.416217 secs 2023-05-08T04:04:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:55 smithi133 ceph-mon[125939]: pgmap v723: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:04:55.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1234.416217 secs 2023-05-08T04:04:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:57 smithi186 ceph-mon[126480]: pgmap v724: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:04:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:57 smithi133 ceph-mon[125939]: pgmap v724: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:04:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:57 smithi096 ceph-mon[124666]: pgmap v724: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:04:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1237.586267 secs 2023-05-08T04:04:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:58 smithi186 ceph-mon[126480]: pgmap v725: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:04:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1238.140535 secs 2023-05-08T04:04:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1237.586267 secs 2023-05-08T04:04:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:58 smithi133 ceph-mon[125939]: pgmap v725: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:04:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1238.140535 secs 2023-05-08T04:04:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1237.586267 secs 2023-05-08T04:04:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:58 smithi096 ceph-mon[124666]: pgmap v725: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:04:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1238.140535 secs 2023-05-08T04:05:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:04:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1239.416334 secs 2023-05-08T04:05:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:04:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1239.416334 secs 2023-05-08T04:05:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:04:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1239.416334 secs 2023-05-08T04:05:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:00 smithi133 ceph-mon[125939]: pgmap v726: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:05:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:00 smithi096 ceph-mon[124666]: pgmap v726: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:05:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:00 smithi186 ceph-mon[126480]: pgmap v726: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:05:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:03 smithi133 ceph-mon[125939]: pgmap v727: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:05:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1242.586390 secs 2023-05-08T04:05:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:03 smithi096 ceph-mon[124666]: pgmap v727: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:05:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1242.586390 secs 2023-05-08T04:05:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:03 smithi186 ceph-mon[126480]: pgmap v727: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:05:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1242.586390 secs 2023-05-08T04:05:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1243.140603 secs 2023-05-08T04:05:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1243.140603 secs 2023-05-08T04:05:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1243.140603 secs 2023-05-08T04:05:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:05 smithi133 ceph-mon[125939]: pgmap v728: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2023-05-08T04:05:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1244.416452 secs 2023-05-08T04:05:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:05 smithi096 ceph-mon[124666]: pgmap v728: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2023-05-08T04:05:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1244.416452 secs 2023-05-08T04:05:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:05 smithi186 ceph-mon[126480]: pgmap v728: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2023-05-08T04:05:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1244.416452 secs 2023-05-08T04:05:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:07 smithi133 ceph-mon[125939]: pgmap v729: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2023-05-08T04:05:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:07 smithi096 ceph-mon[124666]: pgmap v729: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2023-05-08T04:05:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:07 smithi186 ceph-mon[126480]: pgmap v729: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2023-05-08T04:05:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1247.586475 secs 2023-05-08T04:05:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:08 smithi186 ceph-mon[126480]: pgmap v730: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2023-05-08T04:05:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1248.140718 secs 2023-05-08T04:05:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1247.586475 secs 2023-05-08T04:05:09.334 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:08 smithi133 ceph-mon[125939]: pgmap v730: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2023-05-08T04:05:09.335 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1248.140718 secs 2023-05-08T04:05:09.335 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1247.586475 secs 2023-05-08T04:05:09.336 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:08 smithi096 ceph-mon[124666]: pgmap v730: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2023-05-08T04:05:09.336 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1248.140718 secs 2023-05-08T04:05:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1249.416560 secs 2023-05-08T04:05:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1249.416560 secs 2023-05-08T04:05:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1249.416560 secs 2023-05-08T04:05:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:10 smithi133 ceph-mon[125939]: pgmap v731: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-05-08T04:05:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:10 smithi096 ceph-mon[124666]: pgmap v731: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-05-08T04:05:11.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:10 smithi186 ceph-mon[126480]: pgmap v731: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-05-08T04:05:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:13 smithi133 ceph-mon[125939]: pgmap v732: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2023-05-08T04:05:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1252.586553 secs 2023-05-08T04:05:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:13 smithi096 ceph-mon[124666]: pgmap v732: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2023-05-08T04:05:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1252.586553 secs 2023-05-08T04:05:13.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:13 smithi186 ceph-mon[126480]: pgmap v732: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 17 op/s 2023-05-08T04:05:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1252.586553 secs 2023-05-08T04:05:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1253.140800 secs 2023-05-08T04:05:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1253.140800 secs 2023-05-08T04:05:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1253.140800 secs 2023-05-08T04:05:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:15 smithi133 ceph-mon[125939]: pgmap v733: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 20 op/s 2023-05-08T04:05:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1254.416702 secs 2023-05-08T04:05:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:15 smithi096 ceph-mon[124666]: pgmap v733: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 20 op/s 2023-05-08T04:05:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1254.416702 secs 2023-05-08T04:05:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:15 smithi186 ceph-mon[126480]: pgmap v733: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 20 op/s 2023-05-08T04:05:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1254.416702 secs 2023-05-08T04:05:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:17 smithi133 ceph-mon[125939]: pgmap v734: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2023-05-08T04:05:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:17 smithi096 ceph-mon[124666]: pgmap v734: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2023-05-08T04:05:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:17 smithi186 ceph-mon[126480]: pgmap v734: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2023-05-08T04:05:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1257.586686 secs 2023-05-08T04:05:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1258.140908 secs 2023-05-08T04:05:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:18 smithi186 ceph-mon[126480]: pgmap v735: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2023-05-08T04:05:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1257.586686 secs 2023-05-08T04:05:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1258.140908 secs 2023-05-08T04:05:19.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:18 smithi133 ceph-mon[125939]: pgmap v735: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2023-05-08T04:05:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1257.586686 secs 2023-05-08T04:05:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1258.140908 secs 2023-05-08T04:05:19.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:18 smithi096 ceph-mon[124666]: pgmap v735: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2023-05-08T04:05:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1259.416870 secs 2023-05-08T04:05:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1259.416870 secs 2023-05-08T04:05:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1259.416870 secs 2023-05-08T04:05:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:20 smithi133 ceph-mon[125939]: pgmap v736: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 8 op/s 2023-05-08T04:05:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:20 smithi096 ceph-mon[124666]: pgmap v736: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 8 op/s 2023-05-08T04:05:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:20 smithi186 ceph-mon[126480]: pgmap v736: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 8 op/s 2023-05-08T04:05:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:23 smithi133 ceph-mon[125939]: pgmap v737: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T04:05:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1262.586808 secs 2023-05-08T04:05:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:23 smithi096 ceph-mon[124666]: pgmap v737: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T04:05:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1262.586808 secs 2023-05-08T04:05:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:23 smithi186 ceph-mon[126480]: pgmap v737: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T04:05:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1262.586808 secs 2023-05-08T04:05:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1263.141011 secs 2023-05-08T04:05:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1263.141011 secs 2023-05-08T04:05:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1263.141011 secs 2023-05-08T04:05:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:25 smithi133 ceph-mon[125939]: pgmap v738: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T04:05:25.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1264.416922 secs 2023-05-08T04:05:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:25 smithi096 ceph-mon[124666]: pgmap v738: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T04:05:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1264.416922 secs 2023-05-08T04:05:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:25 smithi186 ceph-mon[126480]: pgmap v738: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T04:05:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1264.416922 secs 2023-05-08T04:05:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:27 smithi133 ceph-mon[125939]: pgmap v739: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:05:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:27 smithi096 ceph-mon[124666]: pgmap v739: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:05:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:27 smithi186 ceph-mon[126480]: pgmap v739: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:05:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1267.586956 secs 2023-05-08T04:05:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1268.141130 secs 2023-05-08T04:05:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:28 smithi186 ceph-mon[126480]: pgmap v740: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:05:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1267.586956 secs 2023-05-08T04:05:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1268.141130 secs 2023-05-08T04:05:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:28 smithi133 ceph-mon[125939]: pgmap v740: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:05:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1267.586956 secs 2023-05-08T04:05:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1268.141130 secs 2023-05-08T04:05:29.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:28 smithi096 ceph-mon[124666]: pgmap v740: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:05:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1269.417042 secs 2023-05-08T04:05:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1269.417042 secs 2023-05-08T04:05:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1269.417042 secs 2023-05-08T04:05:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:30 smithi133 ceph-mon[125939]: pgmap v741: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 17 KiB/s wr, 8 op/s 2023-05-08T04:05:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:30 smithi096 ceph-mon[124666]: pgmap v741: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 17 KiB/s wr, 8 op/s 2023-05-08T04:05:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:30 smithi186 ceph-mon[126480]: pgmap v741: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 17 KiB/s wr, 8 op/s 2023-05-08T04:05:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:33 smithi133 ceph-mon[125939]: pgmap v742: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 17 KiB/s wr, 6 op/s 2023-05-08T04:05:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1272.587084 secs 2023-05-08T04:05:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:33 smithi096 ceph-mon[124666]: pgmap v742: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 17 KiB/s wr, 6 op/s 2023-05-08T04:05:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1272.587084 secs 2023-05-08T04:05:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:33 smithi186 ceph-mon[126480]: pgmap v742: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 17 KiB/s wr, 6 op/s 2023-05-08T04:05:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1272.587084 secs 2023-05-08T04:05:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1273.141265 secs 2023-05-08T04:05:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1273.141265 secs 2023-05-08T04:05:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1273.141265 secs 2023-05-08T04:05:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:35 smithi133 ceph-mon[125939]: pgmap v743: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 44 KiB/s wr, 10 op/s 2023-05-08T04:05:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1274.417176 secs 2023-05-08T04:05:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:35 smithi096 ceph-mon[124666]: pgmap v743: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 44 KiB/s wr, 10 op/s 2023-05-08T04:05:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1274.417176 secs 2023-05-08T04:05:35.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:35 smithi186 ceph-mon[126480]: pgmap v743: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 44 KiB/s wr, 10 op/s 2023-05-08T04:05:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1274.417176 secs 2023-05-08T04:05:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:37 smithi133 ceph-mon[125939]: pgmap v744: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 44 KiB/s wr, 7 op/s 2023-05-08T04:05:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:37 smithi096 ceph-mon[124666]: pgmap v744: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 44 KiB/s wr, 7 op/s 2023-05-08T04:05:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:37 smithi186 ceph-mon[126480]: pgmap v744: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 44 KiB/s wr, 7 op/s 2023-05-08T04:05:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1277.587209 secs 2023-05-08T04:05:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1278.141358 secs 2023-05-08T04:05:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:38 smithi186 ceph-mon[126480]: pgmap v745: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 44 KiB/s wr, 7 op/s 2023-05-08T04:05:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1277.587209 secs 2023-05-08T04:05:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1278.141358 secs 2023-05-08T04:05:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:38 smithi133 ceph-mon[125939]: pgmap v745: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 44 KiB/s wr, 7 op/s 2023-05-08T04:05:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1277.587209 secs 2023-05-08T04:05:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1278.141358 secs 2023-05-08T04:05:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:38 smithi096 ceph-mon[124666]: pgmap v745: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 44 KiB/s wr, 7 op/s 2023-05-08T04:05:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1279.417236 secs 2023-05-08T04:05:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1279.417236 secs 2023-05-08T04:05:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1279.417236 secs 2023-05-08T04:05:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:40 smithi133 ceph-mon[125939]: pgmap v746: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 52 KiB/s wr, 10 op/s 2023-05-08T04:05:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:40 smithi096 ceph-mon[124666]: pgmap v746: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 52 KiB/s wr, 10 op/s 2023-05-08T04:05:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:40 smithi186 ceph-mon[126480]: pgmap v746: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 52 KiB/s wr, 10 op/s 2023-05-08T04:05:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:43 smithi133 ceph-mon[125939]: pgmap v747: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 7 op/s 2023-05-08T04:05:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1282.587325 secs 2023-05-08T04:05:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:43 smithi096 ceph-mon[124666]: pgmap v747: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 7 op/s 2023-05-08T04:05:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1282.587325 secs 2023-05-08T04:05:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:43 smithi186 ceph-mon[126480]: pgmap v747: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 7 op/s 2023-05-08T04:05:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1282.587325 secs 2023-05-08T04:05:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1283.141490 secs 2023-05-08T04:05:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1283.141490 secs 2023-05-08T04:05:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1283.141490 secs 2023-05-08T04:05:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:45 smithi133 ceph-mon[125939]: pgmap v748: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 34 KiB/s wr, 9 op/s 2023-05-08T04:05:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1284.417383 secs 2023-05-08T04:05:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:45 smithi096 ceph-mon[124666]: pgmap v748: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 34 KiB/s wr, 9 op/s 2023-05-08T04:05:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1284.417383 secs 2023-05-08T04:05:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:45 smithi186 ceph-mon[126480]: pgmap v748: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 34 KiB/s wr, 9 op/s 2023-05-08T04:05:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1284.417383 secs 2023-05-08T04:05:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:47 smithi133 ceph-mon[125939]: pgmap v749: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.6 KiB/s wr, 5 op/s 2023-05-08T04:05:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:47 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:05:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:47 smithi096 ceph-mon[124666]: pgmap v749: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.6 KiB/s wr, 5 op/s 2023-05-08T04:05:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:47 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:05:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:47 smithi186 ceph-mon[126480]: pgmap v749: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.6 KiB/s wr, 5 op/s 2023-05-08T04:05:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:47 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:05:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:48 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:05:49.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:48 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:05:49.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:48 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:05:49.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:48 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:05:49.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:48 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:05:49.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1287.587358 secs 2023-05-08T04:05:49.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:48 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:05:49.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1288.141579 secs 2023-05-08T04:05:49.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:48 smithi186 ceph-mon[126480]: pgmap v750: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.6 KiB/s wr, 5 op/s 2023-05-08T04:05:49.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:48 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:05:49.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:48 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:05:49.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:48 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:05:49.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:48 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:05:49.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:48 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T04:05:49.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:48 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T04:05:49.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:48 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:05:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:48 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:05:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:48 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:05:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:48 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:05:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:48 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:05:49.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:48 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:05:49.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1287.587358 secs 2023-05-08T04:05:49.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:48 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:05:49.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1288.141579 secs 2023-05-08T04:05:49.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:48 smithi133 ceph-mon[125939]: pgmap v750: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.6 KiB/s wr, 5 op/s 2023-05-08T04:05:49.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:48 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:05:49.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:48 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:05:49.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:48 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:05:49.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:48 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:05:49.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:48 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T04:05:49.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:48 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T04:05:49.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:48 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:05:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:48 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:05:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:48 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:05:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:48 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:05:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:48 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:05:49.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:48 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:05:49.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1287.587358 secs 2023-05-08T04:05:49.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:48 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:05:49.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1288.141579 secs 2023-05-08T04:05:49.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:48 smithi096 ceph-mon[124666]: pgmap v750: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.6 KiB/s wr, 5 op/s 2023-05-08T04:05:49.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:48 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:05:49.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:48 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:05:49.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:48 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:05:49.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:48 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:05:49.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:48 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T04:05:49.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:48 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T04:05:49.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:48 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:05:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1289.417523 secs 2023-05-08T04:05:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1289.417523 secs 2023-05-08T04:05:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1289.417523 secs 2023-05-08T04:05:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:50 smithi133 ceph-mon[125939]: pgmap v751: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.6 KiB/s wr, 7 op/s 2023-05-08T04:05:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:50 smithi096 ceph-mon[124666]: pgmap v751: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.6 KiB/s wr, 7 op/s 2023-05-08T04:05:51.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:50 smithi186 ceph-mon[126480]: pgmap v751: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.6 KiB/s wr, 7 op/s 2023-05-08T04:05:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:53 smithi133 ceph-mon[125939]: pgmap v752: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:05:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1292.587502 secs 2023-05-08T04:05:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:53 smithi096 ceph-mon[124666]: pgmap v752: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:05:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1292.587502 secs 2023-05-08T04:05:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:53 smithi186 ceph-mon[126480]: pgmap v752: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:05:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1292.587502 secs 2023-05-08T04:05:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1293.141705 secs 2023-05-08T04:05:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1293.141705 secs 2023-05-08T04:05:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1293.141705 secs 2023-05-08T04:05:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:55 smithi133 ceph-mon[125939]: pgmap v753: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:05:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1294.417666 secs 2023-05-08T04:05:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:55 smithi096 ceph-mon[124666]: pgmap v753: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:05:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1294.417666 secs 2023-05-08T04:05:55.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:55 smithi186 ceph-mon[126480]: pgmap v753: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:05:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1294.417666 secs 2023-05-08T04:05:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:57 smithi133 ceph-mon[125939]: pgmap v754: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:05:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:57 smithi096 ceph-mon[124666]: pgmap v754: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:05:57.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:57 smithi186 ceph-mon[126480]: pgmap v754: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:05:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1297.587603 secs 2023-05-08T04:05:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1298.141836 secs 2023-05-08T04:05:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:58 smithi186 ceph-mon[126480]: pgmap v755: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:05:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1297.587603 secs 2023-05-08T04:05:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1298.141836 secs 2023-05-08T04:05:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:58 smithi133 ceph-mon[125939]: pgmap v755: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:05:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1297.587603 secs 2023-05-08T04:05:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1298.141836 secs 2023-05-08T04:05:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:58 smithi096 ceph-mon[124666]: pgmap v755: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:06:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:05:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1299.417804 secs 2023-05-08T04:06:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:05:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1299.417804 secs 2023-05-08T04:06:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:05:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1299.417804 secs 2023-05-08T04:06:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:06:00 smithi133 ceph-mon[125939]: pgmap v756: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:06:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:06:00 smithi096 ceph-mon[124666]: pgmap v756: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:06:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:06:00 smithi186 ceph-mon[126480]: pgmap v756: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:06:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:06:03 smithi133 ceph-mon[125939]: pgmap v757: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:06:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:06:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1302.587676 secs 2023-05-08T04:06:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:06:03 smithi096 ceph-mon[124666]: pgmap v757: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:06:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:06:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1302.587676 secs 2023-05-08T04:06:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:06:03 smithi186 ceph-mon[126480]: pgmap v757: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:06:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:06:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1302.587676 secs 2023-05-08T04:06:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:06:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1303.141961 secs 2023-05-08T04:06:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:06:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1303.141961 secs 2023-05-08T04:06:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:06:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1303.141961 secs 2023-05-08T04:06:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:06:05 smithi133 ceph-mon[125939]: pgmap v758: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:06:05.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:06:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1304.417938 secs 2023-05-08T04:06:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:06:05 smithi096 ceph-mon[124666]: pgmap v758: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:06:05.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:06:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1304.417938 secs 2023-05-08T04:06:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:06:05 smithi186 ceph-mon[126480]: pgmap v758: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:06:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:06:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1304.417938 secs 2023-05-08T04:06:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:06:07 smithi096 ceph-mon[124666]: pgmap v759: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:06:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:06:07 smithi186 ceph-mon[126480]: pgmap v759: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:06:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:06:07 smithi133 ceph-mon[125939]: pgmap v759: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:06:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:06:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1307.587780 secs 2023-05-08T04:06:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:06:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1308.142098 secs 2023-05-08T04:06:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:06:08 smithi186 ceph-mon[126480]: pgmap v760: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:06:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:06:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1307.587780 secs 2023-05-08T04:06:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:06:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1308.142098 secs 2023-05-08T04:06:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:06:08 smithi133 ceph-mon[125939]: pgmap v760: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:06:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:06:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1307.587780 secs 2023-05-08T04:06:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:06:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1308.142098 secs 2023-05-08T04:06:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:06:08 smithi096 ceph-mon[124666]: pgmap v760: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:06:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:06:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1309.418085 secs 2023-05-08T04:06:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:06:10 smithi186 ceph-mon[126480]: osdmap e128: 12 total, 12 up, 12 in 2023-05-08T04:06:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:06:10 smithi186 ceph-mon[126480]: pgmap v762: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:06:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:06:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1309.418085 secs 2023-05-08T04:06:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:06:10 smithi133 ceph-mon[125939]: osdmap e128: 12 total, 12 up, 12 in 2023-05-08T04:06:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:06:10 smithi133 ceph-mon[125939]: pgmap v762: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:06:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:06:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1309.418085 secs 2023-05-08T04:06:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:06:10 smithi096 ceph-mon[124666]: osdmap e128: 12 total, 12 up, 12 in 2023-05-08T04:06:11.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:06:10 smithi096 ceph-mon[124666]: pgmap v762: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:06:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:06:13 smithi133 ceph-mon[125939]: pgmap v763: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:06:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:06:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1312.587903 secs 2023-05-08T04:06:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:06:13 smithi096 ceph-mon[124666]: pgmap v763: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:06:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:06:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1312.587903 secs 2023-05-08T04:06:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:06:13 smithi186 ceph-mon[126480]: pgmap v763: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:06:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:06:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1312.587903 secs 2023-05-08T04:06:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:06:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1313.142236 secs 2023-05-08T04:06:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:06:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1313.142236 secs 2023-05-08T04:06:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:06:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1313.142236 secs 2023-05-08T04:06:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:06:15 smithi096 ceph-mon[124666]: pgmap v764: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:06:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:06:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1314.418232 secs 2023-05-08T04:06:15.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:06:15 smithi186 ceph-mon[126480]: pgmap v764: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:06:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:06:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1314.418232 secs 2023-05-08T04:06:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:06:15 smithi133 ceph-mon[125939]: pgmap v764: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:06:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:06:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1314.418232 secs 2023-05-08T04:06:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:06:17 smithi096 ceph-mon[124666]: pgmap v765: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:06:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:06:17 smithi186 ceph-mon[126480]: pgmap v765: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:06:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:06:17 smithi133 ceph-mon[125939]: pgmap v765: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:06:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:06:18 smithi186 ceph-mon[126480]: osdmap e129: 12 total, 12 up, 12 in 2023-05-08T04:06:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:06:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1317.587979 secs 2023-05-08T04:06:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:06:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1318.142348 secs 2023-05-08T04:06:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:06:18 smithi186 ceph-mon[126480]: pgmap v767: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:06:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:06:18 smithi133 ceph-mon[125939]: osdmap e129: 12 total, 12 up, 12 in 2023-05-08T04:06:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:06:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1317.587979 secs 2023-05-08T04:06:19.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:06:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1318.142348 secs 2023-05-08T04:06:19.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:06:18 smithi133 ceph-mon[125939]: pgmap v767: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:06:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:06:18 smithi096 ceph-mon[124666]: osdmap e129: 12 total, 12 up, 12 in 2023-05-08T04:06:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:06:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1317.587979 secs 2023-05-08T04:06:19.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:06:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1318.142348 secs 2023-05-08T04:06:19.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:06:18 smithi096 ceph-mon[124666]: pgmap v767: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:06:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:06:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1319.418356 secs 2023-05-08T04:06:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:06:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1319.418356 secs 2023-05-08T04:06:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:06:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1319.418356 secs 2023-05-08T04:06:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:06:20 smithi133 ceph-mon[125939]: pgmap v768: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:06:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:06:20 smithi096 ceph-mon[124666]: pgmap v768: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:06:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:06:20 smithi186 ceph-mon[126480]: pgmap v768: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:06:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:06:23 smithi133 ceph-mon[125939]: pgmap v769: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:06:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:06:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1322.588110 secs 2023-05-08T04:06:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:06:23 smithi096 ceph-mon[124666]: pgmap v769: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:06:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:06:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1322.588110 secs 2023-05-08T04:06:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:06:23 smithi186 ceph-mon[126480]: pgmap v769: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:06:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:06:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1322.588110 secs 2023-05-08T04:06:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:06:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1323.142485 secs 2023-05-08T04:06:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:06:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1323.142485 secs 2023-05-08T04:06:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:06:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1323.142485 secs 2023-05-08T04:06:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:06:25 smithi096 ceph-mon[124666]: pgmap v770: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:06:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:06:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1324.418482 secs 2023-05-08T04:06:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:06:25 smithi186 ceph-mon[126480]: pgmap v770: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:06:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:06:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1324.418482 secs 2023-05-08T04:06:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:06:25 smithi133 ceph-mon[125939]: pgmap v770: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:06:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:06:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1324.418482 secs 2023-05-08T04:06:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:06:27 smithi096 ceph-mon[124666]: pgmap v771: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:06:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:06:27 smithi186 ceph-mon[126480]: pgmap v771: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:06:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:06:27 smithi133 ceph-mon[125939]: pgmap v771: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:06:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:06:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1327.588250 secs 2023-05-08T04:06:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:06:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1328.142587 secs 2023-05-08T04:06:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:06:28 smithi186 ceph-mon[126480]: pgmap v772: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T04:06:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:06:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1327.588250 secs 2023-05-08T04:06:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:06:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1328.142587 secs 2023-05-08T04:06:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:06:28 smithi133 ceph-mon[125939]: pgmap v772: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T04:06:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:06:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1327.588250 secs 2023-05-08T04:06:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:06:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1328.142587 secs 2023-05-08T04:06:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:06:28 smithi096 ceph-mon[124666]: pgmap v772: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T04:06:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:06:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1329.418581 secs 2023-05-08T04:06:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:06:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1329.418581 secs 2023-05-08T04:06:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:06:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1329.418581 secs 2023-05-08T04:06:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:06:30 smithi133 ceph-mon[125939]: pgmap v773: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 18 KiB/s wr, 9 op/s 2023-05-08T04:06:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:06:30 smithi096 ceph-mon[124666]: pgmap v773: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 18 KiB/s wr, 9 op/s 2023-05-08T04:06:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:06:30 smithi186 ceph-mon[126480]: pgmap v773: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 18 KiB/s wr, 9 op/s 2023-05-08T04:06:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:06:33 smithi096 ceph-mon[124666]: pgmap v774: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 18 KiB/s wr, 6 op/s 2023-05-08T04:06:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:06:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1332.588361 secs 2023-05-08T04:06:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:06:33 smithi186 ceph-mon[126480]: pgmap v774: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 18 KiB/s wr, 6 op/s 2023-05-08T04:06:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:06:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1332.588361 secs 2023-05-08T04:06:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:06:33 smithi133 ceph-mon[125939]: pgmap v774: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 18 KiB/s wr, 6 op/s 2023-05-08T04:06:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:06:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1332.588361 secs 2023-05-08T04:06:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:06:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1333.142663 secs 2023-05-08T04:06:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:06:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1333.142663 secs 2023-05-08T04:06:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:06:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1333.142663 secs 2023-05-08T04:06:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:06:35 smithi096 ceph-mon[124666]: pgmap v775: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 46 KiB/s wr, 10 op/s 2023-05-08T04:06:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:06:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1334.418689 secs 2023-05-08T04:06:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:06:35 smithi186 ceph-mon[126480]: pgmap v775: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 46 KiB/s wr, 10 op/s 2023-05-08T04:06:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:06:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1334.418689 secs 2023-05-08T04:06:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:06:35 smithi133 ceph-mon[125939]: pgmap v775: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 46 KiB/s wr, 10 op/s 2023-05-08T04:06:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:06:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1334.418689 secs 2023-05-08T04:06:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:06:37 smithi096 ceph-mon[124666]: pgmap v776: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 46 KiB/s wr, 7 op/s 2023-05-08T04:06:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:06:37 smithi186 ceph-mon[126480]: pgmap v776: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 46 KiB/s wr, 7 op/s 2023-05-08T04:06:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:06:37 smithi133 ceph-mon[125939]: pgmap v776: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 46 KiB/s wr, 7 op/s 2023-05-08T04:06:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:06:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1337.588480 secs 2023-05-08T04:06:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:06:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1338.142762 secs 2023-05-08T04:06:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:06:38 smithi186 ceph-mon[126480]: pgmap v777: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 46 KiB/s wr, 7 op/s 2023-05-08T04:06:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:06:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1337.588480 secs 2023-05-08T04:06:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:06:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1338.142762 secs 2023-05-08T04:06:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:06:38 smithi133 ceph-mon[125939]: pgmap v777: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 46 KiB/s wr, 7 op/s 2023-05-08T04:06:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:06:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1337.588480 secs 2023-05-08T04:06:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:06:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1338.142762 secs 2023-05-08T04:06:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:06:38 smithi096 ceph-mon[124666]: pgmap v777: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 46 KiB/s wr, 7 op/s 2023-05-08T04:06:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:06:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1339.418810 secs 2023-05-08T04:06:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:06:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1339.418810 secs 2023-05-08T04:06:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:06:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1339.418810 secs 2023-05-08T04:06:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:06:40 smithi133 ceph-mon[125939]: pgmap v778: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 55 KiB/s wr, 11 op/s 2023-05-08T04:06:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:06:40 smithi096 ceph-mon[124666]: pgmap v778: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 55 KiB/s wr, 11 op/s 2023-05-08T04:06:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:06:40 smithi186 ceph-mon[126480]: pgmap v778: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 55 KiB/s wr, 11 op/s 2023-05-08T04:06:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:06:43 smithi096 ceph-mon[124666]: pgmap v779: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 37 KiB/s wr, 7 op/s 2023-05-08T04:06:43.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:06:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1342.588550 secs 2023-05-08T04:06:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:06:43 smithi186 ceph-mon[126480]: pgmap v779: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 37 KiB/s wr, 7 op/s 2023-05-08T04:06:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:06:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1342.588550 secs 2023-05-08T04:06:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:06:43 smithi133 ceph-mon[125939]: pgmap v779: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 37 KiB/s wr, 7 op/s 2023-05-08T04:06:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:06:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1342.588550 secs 2023-05-08T04:06:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:06:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1343.142883 secs 2023-05-08T04:06:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:06:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1343.142883 secs 2023-05-08T04:06:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:06:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1343.142883 secs 2023-05-08T04:06:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:06:45 smithi096 ceph-mon[124666]: pgmap v780: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 10 op/s 2023-05-08T04:06:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:06:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1344.418878 secs 2023-05-08T04:06:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:06:45 smithi186 ceph-mon[126480]: pgmap v780: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 10 op/s 2023-05-08T04:06:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:06:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1344.418878 secs 2023-05-08T04:06:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:06:45 smithi133 ceph-mon[125939]: pgmap v780: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 10 op/s 2023-05-08T04:06:45.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:06:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1344.418878 secs 2023-05-08T04:06:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:06:47 smithi186 ceph-mon[126480]: pgmap v781: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.7 KiB/s wr, 6 op/s 2023-05-08T04:06:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:06:47 smithi133 ceph-mon[125939]: pgmap v781: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.7 KiB/s wr, 6 op/s 2023-05-08T04:06:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:06:47 smithi096 ceph-mon[124666]: pgmap v781: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.7 KiB/s wr, 6 op/s 2023-05-08T04:06:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:06:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1347.588645 secs 2023-05-08T04:06:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:06:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1348.143008 secs 2023-05-08T04:06:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:06:48 smithi186 ceph-mon[126480]: pgmap v782: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.6 KiB/s wr, 6 op/s 2023-05-08T04:06:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:06:48 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:06:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:06:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1347.588645 secs 2023-05-08T04:06:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:06:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1348.143008 secs 2023-05-08T04:06:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:06:48 smithi133 ceph-mon[125939]: pgmap v782: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.6 KiB/s wr, 6 op/s 2023-05-08T04:06:49.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:06:48 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:06:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:06:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1347.588645 secs 2023-05-08T04:06:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:06:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1348.143008 secs 2023-05-08T04:06:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:06:48 smithi096 ceph-mon[124666]: pgmap v782: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.6 KiB/s wr, 6 op/s 2023-05-08T04:06:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:06:48 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:06:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:06:49 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:06:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:06:49 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:06:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:06:49 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:06:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:06:49 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:06:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:06:49 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T04:06:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:06:49 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T04:06:50.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:06:49 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:06:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:06:49 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:06:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:06:49 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:06:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:06:49 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:06:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:06:49 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:06:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:06:49 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T04:06:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:06:49 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T04:06:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:06:49 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:06:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:06:49 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:06:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:06:49 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:06:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:06:49 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:06:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:06:49 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:06:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:06:49 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T04:06:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:06:49 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T04:06:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:06:49 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:06:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:06:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1349.418958 secs 2023-05-08T04:06:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:06:50 smithi186 ceph-mon[126480]: pgmap v783: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.6 KiB/s wr, 8 op/s 2023-05-08T04:06:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:06:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1349.418958 secs 2023-05-08T04:06:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:06:50 smithi133 ceph-mon[125939]: pgmap v783: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.6 KiB/s wr, 8 op/s 2023-05-08T04:06:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:06:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1349.418958 secs 2023-05-08T04:06:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:06:50 smithi096 ceph-mon[124666]: pgmap v783: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.6 KiB/s wr, 8 op/s 2023-05-08T04:06:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:06:53 smithi096 ceph-mon[124666]: pgmap v784: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T04:06:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:06:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1352.588767 secs 2023-05-08T04:06:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:06:53 smithi186 ceph-mon[126480]: pgmap v784: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T04:06:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:06:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1352.588767 secs 2023-05-08T04:06:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:06:53 smithi133 ceph-mon[125939]: pgmap v784: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T04:06:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:06:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1352.588767 secs 2023-05-08T04:06:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:06:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1353.143148 secs 2023-05-08T04:06:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:06:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1353.143148 secs 2023-05-08T04:06:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:06:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1353.143148 secs 2023-05-08T04:06:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:06:55 smithi186 ceph-mon[126480]: pgmap v785: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T04:06:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:06:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1354.419085 secs 2023-05-08T04:06:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:06:55 smithi133 ceph-mon[125939]: pgmap v785: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T04:06:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:06:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1354.419085 secs 2023-05-08T04:06:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:06:55 smithi096 ceph-mon[124666]: pgmap v785: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T04:06:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:06:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1354.419085 secs 2023-05-08T04:06:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:06:57 smithi186 ceph-mon[126480]: pgmap v786: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:06:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:06:57 smithi133 ceph-mon[125939]: pgmap v786: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:06:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:06:57 smithi096 ceph-mon[124666]: pgmap v786: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:06:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:06:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1357.588880 secs 2023-05-08T04:06:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:06:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1358.143262 secs 2023-05-08T04:06:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:06:58 smithi186 ceph-mon[126480]: pgmap v787: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:06:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:06:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1357.588880 secs 2023-05-08T04:06:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:06:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1358.143262 secs 2023-05-08T04:06:59.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:06:58 smithi133 ceph-mon[125939]: pgmap v787: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:06:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:06:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1357.588880 secs 2023-05-08T04:06:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:06:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1358.143262 secs 2023-05-08T04:06:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:06:58 smithi096 ceph-mon[124666]: pgmap v787: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:07:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:06:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1359.419205 secs 2023-05-08T04:07:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:06:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1359.419205 secs 2023-05-08T04:07:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:06:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1359.419205 secs 2023-05-08T04:07:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:00 smithi133 ceph-mon[125939]: pgmap v788: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:07:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:00 smithi096 ceph-mon[124666]: pgmap v788: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:07:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:00 smithi186 ceph-mon[126480]: pgmap v788: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:07:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:03 smithi096 ceph-mon[124666]: pgmap v789: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:07:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1362.588999 secs 2023-05-08T04:07:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:03 smithi186 ceph-mon[126480]: pgmap v789: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:07:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1362.588999 secs 2023-05-08T04:07:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:03 smithi133 ceph-mon[125939]: pgmap v789: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:07:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1362.588999 secs 2023-05-08T04:07:04.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1363.143402 secs 2023-05-08T04:07:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1363.143402 secs 2023-05-08T04:07:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1363.143402 secs 2023-05-08T04:07:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:05 smithi186 ceph-mon[126480]: pgmap v790: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:07:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1364.419335 secs 2023-05-08T04:07:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:05 smithi133 ceph-mon[125939]: pgmap v790: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:07:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1364.419335 secs 2023-05-08T04:07:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:05 smithi096 ceph-mon[124666]: pgmap v790: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:07:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1364.419335 secs 2023-05-08T04:07:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:07 smithi186 ceph-mon[126480]: pgmap v791: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:07:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:07 smithi133 ceph-mon[125939]: pgmap v791: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:07:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:07 smithi096 ceph-mon[124666]: pgmap v791: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:07:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1367.589110 secs 2023-05-08T04:07:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1368.143541 secs 2023-05-08T04:07:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:08 smithi186 ceph-mon[126480]: pgmap v792: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:07:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1367.589110 secs 2023-05-08T04:07:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1368.143541 secs 2023-05-08T04:07:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:08 smithi133 ceph-mon[125939]: pgmap v792: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:07:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1367.589110 secs 2023-05-08T04:07:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1368.143541 secs 2023-05-08T04:07:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:08 smithi096 ceph-mon[124666]: pgmap v792: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:07:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1369.419474 secs 2023-05-08T04:07:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:10 smithi186 ceph-mon[126480]: osdmap e130: 12 total, 12 up, 12 in 2023-05-08T04:07:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:10 smithi186 ceph-mon[126480]: pgmap v794: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:07:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1369.419474 secs 2023-05-08T04:07:11.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:10 smithi133 ceph-mon[125939]: osdmap e130: 12 total, 12 up, 12 in 2023-05-08T04:07:11.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:10 smithi133 ceph-mon[125939]: pgmap v794: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:07:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1369.419474 secs 2023-05-08T04:07:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:10 smithi096 ceph-mon[124666]: osdmap e130: 12 total, 12 up, 12 in 2023-05-08T04:07:11.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:10 smithi096 ceph-mon[124666]: pgmap v794: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:07:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:13 smithi096 ceph-mon[124666]: pgmap v795: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:07:13.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1372.589234 secs 2023-05-08T04:07:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:13 smithi186 ceph-mon[126480]: pgmap v795: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:07:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1372.589234 secs 2023-05-08T04:07:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:13 smithi133 ceph-mon[125939]: pgmap v795: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:07:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1372.589234 secs 2023-05-08T04:07:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1373.143603 secs 2023-05-08T04:07:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1373.143603 secs 2023-05-08T04:07:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1373.143603 secs 2023-05-08T04:07:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:15 smithi186 ceph-mon[126480]: pgmap v796: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:07:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1374.419607 secs 2023-05-08T04:07:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:15 smithi133 ceph-mon[125939]: pgmap v796: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:07:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1374.419607 secs 2023-05-08T04:07:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:15 smithi096 ceph-mon[124666]: pgmap v796: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:07:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1374.419607 secs 2023-05-08T04:07:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:17 smithi186 ceph-mon[126480]: pgmap v797: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:07:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:17 smithi133 ceph-mon[125939]: pgmap v797: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:07:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:17 smithi096 ceph-mon[124666]: pgmap v797: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:07:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:18 smithi186 ceph-mon[126480]: osdmap e131: 12 total, 12 up, 12 in 2023-05-08T04:07:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1377.589364 secs 2023-05-08T04:07:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1378.143705 secs 2023-05-08T04:07:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:18 smithi186 ceph-mon[126480]: pgmap v799: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:07:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:18 smithi133 ceph-mon[125939]: osdmap e131: 12 total, 12 up, 12 in 2023-05-08T04:07:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1377.589364 secs 2023-05-08T04:07:19.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1378.143705 secs 2023-05-08T04:07:19.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:18 smithi133 ceph-mon[125939]: pgmap v799: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:07:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:18 smithi096 ceph-mon[124666]: osdmap e131: 12 total, 12 up, 12 in 2023-05-08T04:07:19.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1377.589364 secs 2023-05-08T04:07:19.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1378.143705 secs 2023-05-08T04:07:19.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:18 smithi096 ceph-mon[124666]: pgmap v799: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:07:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1379.419706 secs 2023-05-08T04:07:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1379.419706 secs 2023-05-08T04:07:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1379.419706 secs 2023-05-08T04:07:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:20 smithi133 ceph-mon[125939]: pgmap v800: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:07:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:20 smithi096 ceph-mon[124666]: pgmap v800: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:07:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:20 smithi186 ceph-mon[126480]: pgmap v800: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:07:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:23 smithi186 ceph-mon[126480]: pgmap v801: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:07:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1382.589476 secs 2023-05-08T04:07:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:23 smithi133 ceph-mon[125939]: pgmap v801: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:07:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1382.589476 secs 2023-05-08T04:07:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:23 smithi096 ceph-mon[124666]: pgmap v801: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:07:24.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1382.589476 secs 2023-05-08T04:07:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1383.143857 secs 2023-05-08T04:07:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1383.143857 secs 2023-05-08T04:07:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1383.143857 secs 2023-05-08T04:07:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:25 smithi186 ceph-mon[126480]: pgmap v802: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:07:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1384.419837 secs 2023-05-08T04:07:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:25 smithi133 ceph-mon[125939]: pgmap v802: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:07:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1384.419837 secs 2023-05-08T04:07:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:25 smithi096 ceph-mon[124666]: pgmap v802: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:07:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1384.419837 secs 2023-05-08T04:07:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:27 smithi186 ceph-mon[126480]: pgmap v803: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:07:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:27 smithi133 ceph-mon[125939]: pgmap v803: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:07:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:27 smithi096 ceph-mon[124666]: pgmap v803: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:07:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1387.589558 secs 2023-05-08T04:07:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1388.143988 secs 2023-05-08T04:07:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:28 smithi186 ceph-mon[126480]: pgmap v804: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T04:07:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1387.589558 secs 2023-05-08T04:07:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1388.143988 secs 2023-05-08T04:07:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:28 smithi133 ceph-mon[125939]: pgmap v804: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T04:07:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1387.589558 secs 2023-05-08T04:07:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1388.143988 secs 2023-05-08T04:07:29.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:28 smithi096 ceph-mon[124666]: pgmap v804: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T04:07:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:31 smithi186 ceph-mon[126480]: pgmap v805: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 19 KiB/s wr, 8 op/s 2023-05-08T04:07:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:31 smithi133 ceph-mon[125939]: pgmap v805: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 19 KiB/s wr, 8 op/s 2023-05-08T04:07:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:31 smithi096 ceph-mon[124666]: pgmap v805: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 19 KiB/s wr, 8 op/s 2023-05-08T04:07:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:33 smithi186 ceph-mon[126480]: pgmap v806: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 19 KiB/s wr, 6 op/s 2023-05-08T04:07:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1392.589670 secs 2023-05-08T04:07:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:33 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:07:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:33 smithi133 ceph-mon[125939]: pgmap v806: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 19 KiB/s wr, 6 op/s 2023-05-08T04:07:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1392.589670 secs 2023-05-08T04:07:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:33 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:07:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:33 smithi096 ceph-mon[124666]: pgmap v806: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 19 KiB/s wr, 6 op/s 2023-05-08T04:07:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1392.589670 secs 2023-05-08T04:07:34.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:33 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:07:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1393.144115 secs 2023-05-08T04:07:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:34 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:07:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:34 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:07:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:34 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:07:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1393.144115 secs 2023-05-08T04:07:34.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:34 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:07:34.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:34 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:07:34.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:34 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:07:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1393.144115 secs 2023-05-08T04:07:35.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:34 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:07:35.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:34 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:07:35.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:34 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:07:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:35 smithi186 ceph-mon[126480]: pgmap v807: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 49 KiB/s wr, 10 op/s 2023-05-08T04:07:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1394.420049 secs 2023-05-08T04:07:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:35 smithi133 ceph-mon[125939]: pgmap v807: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 49 KiB/s wr, 10 op/s 2023-05-08T04:07:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1394.420049 secs 2023-05-08T04:07:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:35 smithi096 ceph-mon[124666]: pgmap v807: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 49 KiB/s wr, 10 op/s 2023-05-08T04:07:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1394.420049 secs 2023-05-08T04:07:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:37 smithi186 ceph-mon[126480]: pgmap v808: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 50 KiB/s wr, 8 op/s 2023-05-08T04:07:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:37 smithi133 ceph-mon[125939]: pgmap v808: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 50 KiB/s wr, 8 op/s 2023-05-08T04:07:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:37 smithi096 ceph-mon[124666]: pgmap v808: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 50 KiB/s wr, 8 op/s 2023-05-08T04:07:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:38 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:07:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:38 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:07:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1397.589822 secs 2023-05-08T04:07:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:38 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:07:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:38 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:07:38.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1397.589822 secs 2023-05-08T04:07:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:38 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:07:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:38 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:07:39.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1397.589822 secs 2023-05-08T04:07:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1398.144242 secs 2023-05-08T04:07:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:39 smithi186 ceph-mon[126480]: pgmap v809: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 50 KiB/s wr, 8 op/s 2023-05-08T04:07:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1398.144242 secs 2023-05-08T04:07:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:39 smithi133 ceph-mon[125939]: pgmap v809: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 50 KiB/s wr, 8 op/s 2023-05-08T04:07:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1398.144242 secs 2023-05-08T04:07:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:39 smithi096 ceph-mon[124666]: pgmap v809: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 50 KiB/s wr, 8 op/s 2023-05-08T04:07:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1399.420183 secs 2023-05-08T04:07:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1399.420183 secs 2023-05-08T04:07:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1399.420183 secs 2023-05-08T04:07:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:41 smithi186 ceph-mon[126480]: pgmap v810: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 58 KiB/s wr, 11 op/s 2023-05-08T04:07:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:41 smithi133 ceph-mon[125939]: pgmap v810: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 58 KiB/s wr, 11 op/s 2023-05-08T04:07:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:41 smithi096 ceph-mon[124666]: pgmap v810: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 58 KiB/s wr, 11 op/s 2023-05-08T04:07:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:43 smithi186 ceph-mon[126480]: pgmap v811: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 39 KiB/s wr, 7 op/s 2023-05-08T04:07:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:43 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:07:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1402.589965 secs 2023-05-08T04:07:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:43 smithi133 ceph-mon[125939]: pgmap v811: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 39 KiB/s wr, 7 op/s 2023-05-08T04:07:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:43 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:07:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1402.589965 secs 2023-05-08T04:07:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:43 smithi096 ceph-mon[124666]: pgmap v811: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 39 KiB/s wr, 7 op/s 2023-05-08T04:07:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:43 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:07:44.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1402.589965 secs 2023-05-08T04:07:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1403.144386 secs 2023-05-08T04:07:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1403.144386 secs 2023-05-08T04:07:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1403.144386 secs 2023-05-08T04:07:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:45 smithi186 ceph-mon[126480]: pgmap v812: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 39 KiB/s wr, 9 op/s 2023-05-08T04:07:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1404.420311 secs 2023-05-08T04:07:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:45 smithi133 ceph-mon[125939]: pgmap v812: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 39 KiB/s wr, 9 op/s 2023-05-08T04:07:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1404.420311 secs 2023-05-08T04:07:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:45 smithi096 ceph-mon[124666]: pgmap v812: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 39 KiB/s wr, 9 op/s 2023-05-08T04:07:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1404.420311 secs 2023-05-08T04:07:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:47 smithi186 ceph-mon[126480]: pgmap v813: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.3 KiB/s wr, 5 op/s 2023-05-08T04:07:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:47 smithi133 ceph-mon[125939]: pgmap v813: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.3 KiB/s wr, 5 op/s 2023-05-08T04:07:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:47 smithi096 ceph-mon[124666]: pgmap v813: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.3 KiB/s wr, 5 op/s 2023-05-08T04:07:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1407.590068 secs 2023-05-08T04:07:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1408.144522 secs 2023-05-08T04:07:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:48 smithi186 ceph-mon[126480]: pgmap v814: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.2 KiB/s wr, 5 op/s 2023-05-08T04:07:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1407.590068 secs 2023-05-08T04:07:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1408.144522 secs 2023-05-08T04:07:49.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:48 smithi133 ceph-mon[125939]: pgmap v814: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.2 KiB/s wr, 5 op/s 2023-05-08T04:07:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1407.590068 secs 2023-05-08T04:07:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1408.144522 secs 2023-05-08T04:07:49.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:48 smithi096 ceph-mon[124666]: pgmap v814: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.2 KiB/s wr, 5 op/s 2023-05-08T04:07:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:49 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:07:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:49 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:07:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:49 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:07:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1409.420405 secs 2023-05-08T04:07:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:07:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:07:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:50 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:07:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:07:51.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:50 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T04:07:51.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:50 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T04:07:51.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:50 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:07:51.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:50 smithi186 ceph-mon[126480]: pgmap v815: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.2 KiB/s wr, 8 op/s 2023-05-08T04:07:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1409.420405 secs 2023-05-08T04:07:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:07:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:07:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:50 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:07:51.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:07:51.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:50 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T04:07:51.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:50 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T04:07:51.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:50 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:07:51.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:50 smithi133 ceph-mon[125939]: pgmap v815: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.2 KiB/s wr, 8 op/s 2023-05-08T04:07:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1409.420405 secs 2023-05-08T04:07:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:07:51.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:07:51.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:50 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:07:51.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:07:51.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:50 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T04:07:51.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:50 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T04:07:51.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:50 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:07:51.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:50 smithi096 ceph-mon[124666]: pgmap v815: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.2 KiB/s wr, 8 op/s 2023-05-08T04:07:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:53 smithi186 ceph-mon[126480]: pgmap v816: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2023-05-08T04:07:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1412.590122 secs 2023-05-08T04:07:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:53 smithi133 ceph-mon[125939]: pgmap v816: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2023-05-08T04:07:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1412.590122 secs 2023-05-08T04:07:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:53 smithi096 ceph-mon[124666]: pgmap v816: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2023-05-08T04:07:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1412.590122 secs 2023-05-08T04:07:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1413.144653 secs 2023-05-08T04:07:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1413.144653 secs 2023-05-08T04:07:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1413.144653 secs 2023-05-08T04:07:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:55 smithi186 ceph-mon[126480]: pgmap v817: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 7 op/s 2023-05-08T04:07:55.873 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1414.420534 secs 2023-05-08T04:07:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:55 smithi133 ceph-mon[125939]: pgmap v817: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 7 op/s 2023-05-08T04:07:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1414.420534 secs 2023-05-08T04:07:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:55 smithi096 ceph-mon[124666]: pgmap v817: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 7 op/s 2023-05-08T04:07:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1414.420534 secs 2023-05-08T04:07:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:57 smithi186 ceph-mon[126480]: pgmap v818: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:07:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:57 smithi133 ceph-mon[125939]: pgmap v818: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:07:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:57 smithi096 ceph-mon[124666]: pgmap v818: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:07:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1417.590240 secs 2023-05-08T04:07:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1418.144781 secs 2023-05-08T04:07:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:58 smithi186 ceph-mon[126480]: pgmap v819: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:07:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1417.590240 secs 2023-05-08T04:07:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1418.144781 secs 2023-05-08T04:07:59.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:58 smithi133 ceph-mon[125939]: pgmap v819: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:07:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1417.590240 secs 2023-05-08T04:07:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1418.144781 secs 2023-05-08T04:07:59.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:58 smithi096 ceph-mon[124666]: pgmap v819: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:08:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:07:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1419.420660 secs 2023-05-08T04:08:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:07:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1419.420660 secs 2023-05-08T04:08:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:07:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1419.420660 secs 2023-05-08T04:08:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:00 smithi133 ceph-mon[125939]: pgmap v820: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:08:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:00 smithi096 ceph-mon[124666]: pgmap v820: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:08:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:00 smithi186 ceph-mon[126480]: pgmap v820: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:08:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:03 smithi186 ceph-mon[126480]: pgmap v821: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:08:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1422.590376 secs 2023-05-08T04:08:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:03 smithi133 ceph-mon[125939]: pgmap v821: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:08:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1422.590376 secs 2023-05-08T04:08:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:03 smithi096 ceph-mon[124666]: pgmap v821: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:08:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1422.590376 secs 2023-05-08T04:08:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1423.144896 secs 2023-05-08T04:08:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1423.144896 secs 2023-05-08T04:08:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1423.144896 secs 2023-05-08T04:08:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:05 smithi186 ceph-mon[126480]: pgmap v822: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:08:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1424.420764 secs 2023-05-08T04:08:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:05 smithi133 ceph-mon[125939]: pgmap v822: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:08:05.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1424.420764 secs 2023-05-08T04:08:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:05 smithi096 ceph-mon[124666]: pgmap v822: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:08:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1424.420764 secs 2023-05-08T04:08:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:07 smithi186 ceph-mon[126480]: pgmap v823: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:08:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:07 smithi133 ceph-mon[125939]: pgmap v823: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:08:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:07 smithi096 ceph-mon[124666]: pgmap v823: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:08:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1427.590526 secs 2023-05-08T04:08:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1428.145036 secs 2023-05-08T04:08:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:08 smithi186 ceph-mon[126480]: pgmap v824: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:08:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1427.590526 secs 2023-05-08T04:08:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1428.145036 secs 2023-05-08T04:08:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:08 smithi133 ceph-mon[125939]: pgmap v824: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:08:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1427.590526 secs 2023-05-08T04:08:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1428.145036 secs 2023-05-08T04:08:09.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:08 smithi096 ceph-mon[124666]: pgmap v824: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:08:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1429.420886 secs 2023-05-08T04:08:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:10 smithi186 ceph-mon[126480]: osdmap e132: 12 total, 12 up, 12 in 2023-05-08T04:08:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:10 smithi186 ceph-mon[126480]: pgmap v826: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:08:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1429.420886 secs 2023-05-08T04:08:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:10 smithi133 ceph-mon[125939]: osdmap e132: 12 total, 12 up, 12 in 2023-05-08T04:08:11.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:10 smithi133 ceph-mon[125939]: pgmap v826: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:08:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1429.420886 secs 2023-05-08T04:08:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:10 smithi096 ceph-mon[124666]: osdmap e132: 12 total, 12 up, 12 in 2023-05-08T04:08:11.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:10 smithi096 ceph-mon[124666]: pgmap v826: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:08:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:13 smithi186 ceph-mon[126480]: pgmap v827: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:08:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1432.590665 secs 2023-05-08T04:08:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:13 smithi133 ceph-mon[125939]: pgmap v827: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:08:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1432.590665 secs 2023-05-08T04:08:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:13 smithi096 ceph-mon[124666]: pgmap v827: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:08:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1432.590665 secs 2023-05-08T04:08:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1433.145135 secs 2023-05-08T04:08:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1433.145135 secs 2023-05-08T04:08:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1433.145135 secs 2023-05-08T04:08:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:15 smithi186 ceph-mon[126480]: pgmap v828: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:08:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1434.420995 secs 2023-05-08T04:08:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:15 smithi133 ceph-mon[125939]: pgmap v828: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:08:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1434.420995 secs 2023-05-08T04:08:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:15 smithi096 ceph-mon[124666]: pgmap v828: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:08:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1434.420995 secs 2023-05-08T04:08:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:17 smithi186 ceph-mon[126480]: pgmap v829: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:08:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:17 smithi133 ceph-mon[125939]: pgmap v829: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:08:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:17 smithi096 ceph-mon[124666]: pgmap v829: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:08:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:18 smithi186 ceph-mon[126480]: osdmap e133: 12 total, 12 up, 12 in 2023-05-08T04:08:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1437.590801 secs 2023-05-08T04:08:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1438.145246 secs 2023-05-08T04:08:19.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:18 smithi186 ceph-mon[126480]: pgmap v831: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:08:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:18 smithi133 ceph-mon[125939]: osdmap e133: 12 total, 12 up, 12 in 2023-05-08T04:08:19.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1437.590801 secs 2023-05-08T04:08:19.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1438.145246 secs 2023-05-08T04:08:19.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:18 smithi133 ceph-mon[125939]: pgmap v831: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:08:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:18 smithi096 ceph-mon[124666]: osdmap e133: 12 total, 12 up, 12 in 2023-05-08T04:08:19.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1437.590801 secs 2023-05-08T04:08:19.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1438.145246 secs 2023-05-08T04:08:19.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:18 smithi096 ceph-mon[124666]: pgmap v831: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:08:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1439.421136 secs 2023-05-08T04:08:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1439.421136 secs 2023-05-08T04:08:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1439.421136 secs 2023-05-08T04:08:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:20 smithi133 ceph-mon[125939]: pgmap v832: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:08:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:20 smithi096 ceph-mon[124666]: pgmap v832: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:08:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:20 smithi186 ceph-mon[126480]: pgmap v832: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:08:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:23 smithi186 ceph-mon[126480]: pgmap v833: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:08:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:23 smithi186 ceph-mon[126480]: 1 slow requests, 1 included below; oldest blocked for > 1442.590929 secs 2023-05-08T04:08:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:23 smithi186 ceph-mon[126480]: slow request 1442.590928 seconds old, received at 2023-05-08T03:44:20.260233+0000: client_request(client.15258:3163 link #0x10000000007/0000000100000000000000F2 #0x10000000007/0000000100000000000000C5 2023-05-08T03:44:20.259302+0000 caller_uid=26, caller_gid=26{26,}) currently acquired locks 2023-05-08T04:08:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:23 smithi133 ceph-mon[125939]: pgmap v833: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:08:23.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:23 smithi133 ceph-mon[125939]: 1 slow requests, 1 included below; oldest blocked for > 1442.590929 secs 2023-05-08T04:08:23.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:23 smithi133 ceph-mon[125939]: slow request 1442.590928 seconds old, received at 2023-05-08T03:44:20.260233+0000: client_request(client.15258:3163 link #0x10000000007/0000000100000000000000F2 #0x10000000007/0000000100000000000000C5 2023-05-08T03:44:20.259302+0000 caller_uid=26, caller_gid=26{26,}) currently acquired locks 2023-05-08T04:08:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:23 smithi096 ceph-mon[124666]: pgmap v833: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:08:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:23 smithi096 ceph-mon[124666]: 1 slow requests, 1 included below; oldest blocked for > 1442.590929 secs 2023-05-08T04:08:24.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:23 smithi096 ceph-mon[124666]: slow request 1442.590928 seconds old, received at 2023-05-08T03:44:20.260233+0000: client_request(client.15258:3163 link #0x10000000007/0000000100000000000000F2 #0x10000000007/0000000100000000000000C5 2023-05-08T03:44:20.259302+0000 caller_uid=26, caller_gid=26{26,}) currently acquired locks 2023-05-08T04:08:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:24 smithi186 ceph-mon[126480]: 1 slow requests, 1 included below; oldest blocked for > 1443.145370 secs 2023-05-08T04:08:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:24 smithi186 ceph-mon[126480]: slow request 1443.145370 seconds old, received at 2023-05-08T03:44:20.272100+0000: peer_request:client.15258:3163 currently acquired locks 2023-05-08T04:08:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:24 smithi133 ceph-mon[125939]: 1 slow requests, 1 included below; oldest blocked for > 1443.145370 secs 2023-05-08T04:08:24.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:24 smithi133 ceph-mon[125939]: slow request 1443.145370 seconds old, received at 2023-05-08T03:44:20.272100+0000: peer_request:client.15258:3163 currently acquired locks 2023-05-08T04:08:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:24 smithi096 ceph-mon[124666]: 1 slow requests, 1 included below; oldest blocked for > 1443.145370 secs 2023-05-08T04:08:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:24 smithi096 ceph-mon[124666]: slow request 1443.145370 seconds old, received at 2023-05-08T03:44:20.272100+0000: peer_request:client.15258:3163 currently acquired locks 2023-05-08T04:08:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:25 smithi186 ceph-mon[126480]: pgmap v834: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:08:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:25 smithi186 ceph-mon[126480]: 1 slow requests, 1 included below; oldest blocked for > 1444.421240 secs 2023-05-08T04:08:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:25 smithi186 ceph-mon[126480]: slow request 1444.421239 seconds old, received at 2023-05-08T03:44:20.261840+0000: peer_request:client.15258:3163 currently dispatched 2023-05-08T04:08:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:25 smithi133 ceph-mon[125939]: pgmap v834: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:08:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:25 smithi133 ceph-mon[125939]: 1 slow requests, 1 included below; oldest blocked for > 1444.421240 secs 2023-05-08T04:08:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:25 smithi133 ceph-mon[125939]: slow request 1444.421239 seconds old, received at 2023-05-08T03:44:20.261840+0000: peer_request:client.15258:3163 currently dispatched 2023-05-08T04:08:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:25 smithi096 ceph-mon[124666]: pgmap v834: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:08:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:25 smithi096 ceph-mon[124666]: 1 slow requests, 1 included below; oldest blocked for > 1444.421240 secs 2023-05-08T04:08:26.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:25 smithi096 ceph-mon[124666]: slow request 1444.421239 seconds old, received at 2023-05-08T03:44:20.261840+0000: peer_request:client.15258:3163 currently dispatched 2023-05-08T04:08:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:27 smithi186 ceph-mon[126480]: pgmap v835: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:08:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:27 smithi133 ceph-mon[125939]: pgmap v835: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:08:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:27 smithi096 ceph-mon[124666]: pgmap v835: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:08:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1447.591050 secs 2023-05-08T04:08:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1448.145521 secs 2023-05-08T04:08:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:28 smithi186 ceph-mon[126480]: pgmap v836: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T04:08:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1447.591050 secs 2023-05-08T04:08:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1448.145521 secs 2023-05-08T04:08:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:28 smithi133 ceph-mon[125939]: pgmap v836: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T04:08:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1447.591050 secs 2023-05-08T04:08:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1448.145521 secs 2023-05-08T04:08:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:28 smithi096 ceph-mon[124666]: pgmap v836: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T04:08:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:31 smithi186 ceph-mon[126480]: pgmap v837: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 19 KiB/s wr, 8 op/s 2023-05-08T04:08:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:31 smithi133 ceph-mon[125939]: pgmap v837: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 19 KiB/s wr, 8 op/s 2023-05-08T04:08:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:31 smithi096 ceph-mon[124666]: pgmap v837: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 19 KiB/s wr, 8 op/s 2023-05-08T04:08:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:33 smithi186 ceph-mon[126480]: pgmap v838: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 19 KiB/s wr, 5 op/s 2023-05-08T04:08:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1452.591170 secs 2023-05-08T04:08:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:33 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:08:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:33 smithi133 ceph-mon[125939]: pgmap v838: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 19 KiB/s wr, 5 op/s 2023-05-08T04:08:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1452.591170 secs 2023-05-08T04:08:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:33 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:08:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:33 smithi096 ceph-mon[124666]: pgmap v838: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 19 KiB/s wr, 5 op/s 2023-05-08T04:08:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1452.591170 secs 2023-05-08T04:08:34.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:33 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:08:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1453.145599 secs 2023-05-08T04:08:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:34 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:08:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:34 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:08:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:34 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:08:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1453.145599 secs 2023-05-08T04:08:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:34 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:08:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:34 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:08:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:34 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:08:35.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1453.145599 secs 2023-05-08T04:08:35.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:34 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:08:35.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:34 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:08:35.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:34 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:08:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:35 smithi186 ceph-mon[126480]: pgmap v839: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 51 KiB/s wr, 10 op/s 2023-05-08T04:08:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1454.421512 secs 2023-05-08T04:08:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:35 smithi133 ceph-mon[125939]: pgmap v839: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 51 KiB/s wr, 10 op/s 2023-05-08T04:08:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1454.421512 secs 2023-05-08T04:08:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:35 smithi096 ceph-mon[124666]: pgmap v839: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 51 KiB/s wr, 10 op/s 2023-05-08T04:08:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1454.421512 secs 2023-05-08T04:08:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:37 smithi186 ceph-mon[126480]: pgmap v840: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 51 KiB/s wr, 7 op/s 2023-05-08T04:08:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:37 smithi133 ceph-mon[125939]: pgmap v840: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 51 KiB/s wr, 7 op/s 2023-05-08T04:08:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:37 smithi096 ceph-mon[124666]: pgmap v840: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 51 KiB/s wr, 7 op/s 2023-05-08T04:08:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:38 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:08:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:38 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:08:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1457.591310 secs 2023-05-08T04:08:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:38 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:08:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:38 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:08:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1457.591310 secs 2023-05-08T04:08:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:38 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:08:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:38 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:08:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1457.591310 secs 2023-05-08T04:08:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1458.145712 secs 2023-05-08T04:08:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:39 smithi186 ceph-mon[126480]: pgmap v841: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 51 KiB/s wr, 7 op/s 2023-05-08T04:08:39.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1458.145712 secs 2023-05-08T04:08:39.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:39 smithi133 ceph-mon[125939]: pgmap v841: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 51 KiB/s wr, 7 op/s 2023-05-08T04:08:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1458.145712 secs 2023-05-08T04:08:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:39 smithi096 ceph-mon[124666]: pgmap v841: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 51 KiB/s wr, 7 op/s 2023-05-08T04:08:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1459.421653 secs 2023-05-08T04:08:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1459.421653 secs 2023-05-08T04:08:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1459.421653 secs 2023-05-08T04:08:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:41 smithi186 ceph-mon[126480]: pgmap v842: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 60 KiB/s wr, 11 op/s 2023-05-08T04:08:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:41 smithi133 ceph-mon[125939]: pgmap v842: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 60 KiB/s wr, 11 op/s 2023-05-08T04:08:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:41 smithi096 ceph-mon[124666]: pgmap v842: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 60 KiB/s wr, 11 op/s 2023-05-08T04:08:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:43 smithi186 ceph-mon[126480]: pgmap v843: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 41 KiB/s wr, 7 op/s 2023-05-08T04:08:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:43 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:08:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1462.591432 secs 2023-05-08T04:08:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:43 smithi133 ceph-mon[125939]: pgmap v843: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 41 KiB/s wr, 7 op/s 2023-05-08T04:08:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:43 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:08:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1462.591432 secs 2023-05-08T04:08:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:43 smithi096 ceph-mon[124666]: pgmap v843: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 41 KiB/s wr, 7 op/s 2023-05-08T04:08:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:43 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:08:44.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1462.591432 secs 2023-05-08T04:08:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1463.145838 secs 2023-05-08T04:08:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1463.145838 secs 2023-05-08T04:08:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1463.145838 secs 2023-05-08T04:08:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:45 smithi186 ceph-mon[126480]: pgmap v844: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 41 KiB/s wr, 10 op/s 2023-05-08T04:08:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1464.421794 secs 2023-05-08T04:08:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:45 smithi133 ceph-mon[125939]: pgmap v844: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 41 KiB/s wr, 10 op/s 2023-05-08T04:08:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1464.421794 secs 2023-05-08T04:08:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:45 smithi096 ceph-mon[124666]: pgmap v844: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 41 KiB/s wr, 10 op/s 2023-05-08T04:08:46.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1464.421794 secs 2023-05-08T04:08:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:47 smithi186 ceph-mon[126480]: pgmap v845: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.2 KiB/s wr, 6 op/s 2023-05-08T04:08:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:47 smithi133 ceph-mon[125939]: pgmap v845: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.2 KiB/s wr, 6 op/s 2023-05-08T04:08:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:47 smithi096 ceph-mon[124666]: pgmap v845: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.2 KiB/s wr, 6 op/s 2023-05-08T04:08:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1467.591550 secs 2023-05-08T04:08:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1468.145986 secs 2023-05-08T04:08:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:48 smithi186 ceph-mon[126480]: pgmap v846: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.1 KiB/s wr, 5 op/s 2023-05-08T04:08:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1467.591550 secs 2023-05-08T04:08:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1468.145986 secs 2023-05-08T04:08:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:48 smithi133 ceph-mon[125939]: pgmap v846: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.1 KiB/s wr, 5 op/s 2023-05-08T04:08:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1467.591550 secs 2023-05-08T04:08:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1468.145986 secs 2023-05-08T04:08:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:48 smithi096 ceph-mon[124666]: pgmap v846: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.1 KiB/s wr, 5 op/s 2023-05-08T04:08:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1469.421935 secs 2023-05-08T04:08:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1469.421935 secs 2023-05-08T04:08:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1469.421935 secs 2023-05-08T04:08:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:08:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:50 smithi133 ceph-mon[125939]: pgmap v847: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.1 KiB/s wr, 8 op/s 2023-05-08T04:08:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:08:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:08:51.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:08:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:08:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:50 smithi096 ceph-mon[124666]: pgmap v847: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.1 KiB/s wr, 8 op/s 2023-05-08T04:08:51.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:08:51.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:08:51.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:08:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:08:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:50 smithi186 ceph-mon[126480]: pgmap v847: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.1 KiB/s wr, 8 op/s 2023-05-08T04:08:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:08:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:08:51.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:08:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:51 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:08:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:51 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T04:08:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:51 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T04:08:52.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:51 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:08:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:51 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:08:52.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:51 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T04:08:52.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:51 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T04:08:52.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:51 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:08:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:51 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:08:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:51 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T04:08:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:51 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T04:08:52.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:51 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:08:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:52 smithi133 ceph-mon[125939]: pgmap v848: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T04:08:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:52 smithi096 ceph-mon[124666]: pgmap v848: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T04:08:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:52 smithi186 ceph-mon[126480]: pgmap v848: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T04:08:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1472.591670 secs 2023-05-08T04:08:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1473.146080 secs 2023-05-08T04:08:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1472.591670 secs 2023-05-08T04:08:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1473.146080 secs 2023-05-08T04:08:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1472.591670 secs 2023-05-08T04:08:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1473.146080 secs 2023-05-08T04:08:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:54 smithi133 ceph-mon[125939]: pgmap v849: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T04:08:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1474.422038 secs 2023-05-08T04:08:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:54 smithi096 ceph-mon[124666]: pgmap v849: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T04:08:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1474.422038 secs 2023-05-08T04:08:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:54 smithi186 ceph-mon[126480]: pgmap v849: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T04:08:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1474.422038 secs 2023-05-08T04:08:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:57 smithi186 ceph-mon[126480]: pgmap v850: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T04:08:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:57 smithi133 ceph-mon[125939]: pgmap v850: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T04:08:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:57 smithi096 ceph-mon[124666]: pgmap v850: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T04:08:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1477.591792 secs 2023-05-08T04:08:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1478.146186 secs 2023-05-08T04:08:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:58 smithi186 ceph-mon[126480]: pgmap v851: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T04:08:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1477.591792 secs 2023-05-08T04:08:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1478.146186 secs 2023-05-08T04:08:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:58 smithi133 ceph-mon[125939]: pgmap v851: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T04:08:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1477.591792 secs 2023-05-08T04:08:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1478.146186 secs 2023-05-08T04:08:59.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:58 smithi096 ceph-mon[124666]: pgmap v851: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T04:09:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:08:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1479.422112 secs 2023-05-08T04:09:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:08:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1479.422112 secs 2023-05-08T04:09:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:08:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1479.422112 secs 2023-05-08T04:09:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:00 smithi133 ceph-mon[125939]: pgmap v852: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:09:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:00 smithi096 ceph-mon[124666]: pgmap v852: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:09:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:00 smithi186 ceph-mon[126480]: pgmap v852: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:09:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:03 smithi186 ceph-mon[126480]: pgmap v853: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T04:09:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1482.591889 secs 2023-05-08T04:09:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:03 smithi133 ceph-mon[125939]: pgmap v853: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T04:09:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1482.591889 secs 2023-05-08T04:09:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:03 smithi096 ceph-mon[124666]: pgmap v853: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T04:09:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1482.591889 secs 2023-05-08T04:09:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1483.146304 secs 2023-05-08T04:09:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1483.146304 secs 2023-05-08T04:09:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1483.146304 secs 2023-05-08T04:09:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:05 smithi186 ceph-mon[126480]: pgmap v854: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 21 op/s 2023-05-08T04:09:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1484.422239 secs 2023-05-08T04:09:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:05 smithi133 ceph-mon[125939]: pgmap v854: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 21 op/s 2023-05-08T04:09:05.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1484.422239 secs 2023-05-08T04:09:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:05 smithi096 ceph-mon[124666]: pgmap v854: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 21 op/s 2023-05-08T04:09:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1484.422239 secs 2023-05-08T04:09:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:07 smithi186 ceph-mon[126480]: pgmap v855: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:09:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:07 smithi133 ceph-mon[125939]: pgmap v855: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:09:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:07 smithi096 ceph-mon[124666]: pgmap v855: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:09:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1487.592031 secs 2023-05-08T04:09:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1488.146430 secs 2023-05-08T04:09:09.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:08 smithi186 ceph-mon[126480]: pgmap v856: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:09:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1487.592031 secs 2023-05-08T04:09:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1488.146430 secs 2023-05-08T04:09:09.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:08 smithi133 ceph-mon[125939]: pgmap v856: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:09:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1487.592031 secs 2023-05-08T04:09:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1488.146430 secs 2023-05-08T04:09:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:08 smithi096 ceph-mon[124666]: pgmap v856: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:09:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1489.422344 secs 2023-05-08T04:09:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:10 smithi186 ceph-mon[126480]: osdmap e134: 12 total, 12 up, 12 in 2023-05-08T04:09:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:10 smithi186 ceph-mon[126480]: pgmap v858: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:09:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1489.422344 secs 2023-05-08T04:09:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:10 smithi133 ceph-mon[125939]: osdmap e134: 12 total, 12 up, 12 in 2023-05-08T04:09:11.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:10 smithi133 ceph-mon[125939]: pgmap v858: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:09:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1489.422344 secs 2023-05-08T04:09:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:10 smithi096 ceph-mon[124666]: osdmap e134: 12 total, 12 up, 12 in 2023-05-08T04:09:11.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:10 smithi096 ceph-mon[124666]: pgmap v858: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:09:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:13 smithi186 ceph-mon[126480]: pgmap v859: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:09:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1492.592178 secs 2023-05-08T04:09:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:13 smithi133 ceph-mon[125939]: pgmap v859: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:09:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1492.592178 secs 2023-05-08T04:09:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:13 smithi096 ceph-mon[124666]: pgmap v859: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:09:14.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1492.592178 secs 2023-05-08T04:09:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1493.146544 secs 2023-05-08T04:09:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1493.146544 secs 2023-05-08T04:09:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1493.146544 secs 2023-05-08T04:09:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:15 smithi186 ceph-mon[126480]: pgmap v860: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:09:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1494.422454 secs 2023-05-08T04:09:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:15 smithi133 ceph-mon[125939]: pgmap v860: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:09:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1494.422454 secs 2023-05-08T04:09:16.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:15 smithi096 ceph-mon[124666]: pgmap v860: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:09:16.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1494.422454 secs 2023-05-08T04:09:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:17 smithi186 ceph-mon[126480]: pgmap v861: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:09:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:17 smithi133 ceph-mon[125939]: pgmap v861: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:09:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:17 smithi096 ceph-mon[124666]: pgmap v861: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:09:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:18 smithi186 ceph-mon[126480]: osdmap e135: 12 total, 12 up, 12 in 2023-05-08T04:09:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1497.592320 secs 2023-05-08T04:09:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1498.146625 secs 2023-05-08T04:09:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:18 smithi186 ceph-mon[126480]: pgmap v863: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:09:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:18 smithi133 ceph-mon[125939]: osdmap e135: 12 total, 12 up, 12 in 2023-05-08T04:09:19.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1497.592320 secs 2023-05-08T04:09:19.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1498.146625 secs 2023-05-08T04:09:19.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:18 smithi133 ceph-mon[125939]: pgmap v863: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:09:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:18 smithi096 ceph-mon[124666]: osdmap e135: 12 total, 12 up, 12 in 2023-05-08T04:09:19.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1497.592320 secs 2023-05-08T04:09:19.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1498.146625 secs 2023-05-08T04:09:19.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:18 smithi096 ceph-mon[124666]: pgmap v863: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:09:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1499.422601 secs 2023-05-08T04:09:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1499.422601 secs 2023-05-08T04:09:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1499.422601 secs 2023-05-08T04:09:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:20 smithi133 ceph-mon[125939]: pgmap v864: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:09:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:20 smithi096 ceph-mon[124666]: pgmap v864: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:09:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:20 smithi186 ceph-mon[126480]: pgmap v864: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:09:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:23 smithi186 ceph-mon[126480]: pgmap v865: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:09:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1502.592381 secs 2023-05-08T04:09:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:23 smithi133 ceph-mon[125939]: pgmap v865: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:09:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1502.592381 secs 2023-05-08T04:09:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:23 smithi096 ceph-mon[124666]: pgmap v865: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:09:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1502.592381 secs 2023-05-08T04:09:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1503.146742 secs 2023-05-08T04:09:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1503.146742 secs 2023-05-08T04:09:25.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1503.146742 secs 2023-05-08T04:09:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:25 smithi186 ceph-mon[126480]: pgmap v866: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:09:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1504.422738 secs 2023-05-08T04:09:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:25 smithi133 ceph-mon[125939]: pgmap v866: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:09:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1504.422738 secs 2023-05-08T04:09:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:25 smithi096 ceph-mon[124666]: pgmap v866: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:09:26.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1504.422738 secs 2023-05-08T04:09:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:27 smithi186 ceph-mon[126480]: pgmap v867: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:09:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:27 smithi133 ceph-mon[125939]: pgmap v867: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:09:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:27 smithi096 ceph-mon[124666]: pgmap v867: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:09:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1507.592471 secs 2023-05-08T04:09:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1508.146883 secs 2023-05-08T04:09:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:28 smithi186 ceph-mon[126480]: pgmap v868: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T04:09:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1507.592471 secs 2023-05-08T04:09:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1508.146883 secs 2023-05-08T04:09:29.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:28 smithi133 ceph-mon[125939]: pgmap v868: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T04:09:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1507.592471 secs 2023-05-08T04:09:29.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1508.146883 secs 2023-05-08T04:09:29.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:28 smithi096 ceph-mon[124666]: pgmap v868: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T04:09:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:31 smithi186 ceph-mon[126480]: pgmap v869: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 33 KiB/s wr, 8 op/s 2023-05-08T04:09:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:31 smithi133 ceph-mon[125939]: pgmap v869: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 33 KiB/s wr, 8 op/s 2023-05-08T04:09:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:31 smithi096 ceph-mon[124666]: pgmap v869: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 33 KiB/s wr, 8 op/s 2023-05-08T04:09:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:33 smithi186 ceph-mon[126480]: pgmap v870: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 47 KiB/s wr, 6 op/s 2023-05-08T04:09:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1512.592573 secs 2023-05-08T04:09:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:33 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:09:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:33 smithi133 ceph-mon[125939]: pgmap v870: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 47 KiB/s wr, 6 op/s 2023-05-08T04:09:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1512.592573 secs 2023-05-08T04:09:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:33 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:09:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:33 smithi096 ceph-mon[124666]: pgmap v870: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 47 KiB/s wr, 6 op/s 2023-05-08T04:09:34.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1512.592573 secs 2023-05-08T04:09:34.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:33 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:09:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1513.146958 secs 2023-05-08T04:09:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:34 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:09:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:34 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:09:34.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:34 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:09:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1513.146958 secs 2023-05-08T04:09:34.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:34 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:09:34.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:34 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:09:34.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:34 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:09:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1513.146958 secs 2023-05-08T04:09:35.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:34 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:09:35.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:34 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:09:35.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:34 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:09:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:35 smithi186 ceph-mon[126480]: pgmap v871: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 48 KiB/s wr, 10 op/s 2023-05-08T04:09:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1514.423011 secs 2023-05-08T04:09:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:35 smithi133 ceph-mon[125939]: pgmap v871: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 48 KiB/s wr, 10 op/s 2023-05-08T04:09:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1514.423011 secs 2023-05-08T04:09:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:35 smithi096 ceph-mon[124666]: pgmap v871: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 48 KiB/s wr, 10 op/s 2023-05-08T04:09:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1514.423011 secs 2023-05-08T04:09:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:37 smithi186 ceph-mon[126480]: pgmap v872: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 71 KiB/s wr, 8 op/s 2023-05-08T04:09:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:37 smithi133 ceph-mon[125939]: pgmap v872: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 71 KiB/s wr, 8 op/s 2023-05-08T04:09:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:37 smithi096 ceph-mon[124666]: pgmap v872: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 71 KiB/s wr, 8 op/s 2023-05-08T04:09:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:38 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:09:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:38 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:09:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1517.592639 secs 2023-05-08T04:09:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:38 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:09:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:38 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:09:38.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1517.592639 secs 2023-05-08T04:09:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:38 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:09:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:38 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:09:39.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1517.592639 secs 2023-05-08T04:09:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1518.147074 secs 2023-05-08T04:09:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:39 smithi186 ceph-mon[126480]: pgmap v873: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 71 KiB/s wr, 8 op/s 2023-05-08T04:09:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1518.147074 secs 2023-05-08T04:09:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:39 smithi133 ceph-mon[125939]: pgmap v873: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 71 KiB/s wr, 8 op/s 2023-05-08T04:09:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1518.147074 secs 2023-05-08T04:09:40.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:39 smithi096 ceph-mon[124666]: pgmap v873: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 71 KiB/s wr, 8 op/s 2023-05-08T04:09:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1519.423142 secs 2023-05-08T04:09:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1519.423142 secs 2023-05-08T04:09:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1519.423142 secs 2023-05-08T04:09:41.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:41 smithi186 ceph-mon[126480]: pgmap v874: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 71 KiB/s wr, 11 op/s 2023-05-08T04:09:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:41 smithi133 ceph-mon[125939]: pgmap v874: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 71 KiB/s wr, 11 op/s 2023-05-08T04:09:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:41 smithi096 ceph-mon[124666]: pgmap v874: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 71 KiB/s wr, 11 op/s 2023-05-08T04:09:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:43 smithi186 ceph-mon[126480]: pgmap v875: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 KiB/s wr, 8 op/s 2023-05-08T04:09:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:43 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:09:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1522.592763 secs 2023-05-08T04:09:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:43 smithi133 ceph-mon[125939]: pgmap v875: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 KiB/s wr, 8 op/s 2023-05-08T04:09:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:43 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:09:43.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1522.592763 secs 2023-05-08T04:09:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:43 smithi096 ceph-mon[124666]: pgmap v875: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 KiB/s wr, 8 op/s 2023-05-08T04:09:44.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:43 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:09:44.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1522.592763 secs 2023-05-08T04:09:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1523.147173 secs 2023-05-08T04:09:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1523.147173 secs 2023-05-08T04:09:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1523.147173 secs 2023-05-08T04:09:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:45 smithi186 ceph-mon[126480]: pgmap v876: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 10 op/s 2023-05-08T04:09:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1524.423270 secs 2023-05-08T04:09:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:45 smithi133 ceph-mon[125939]: pgmap v876: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 10 op/s 2023-05-08T04:09:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1524.423270 secs 2023-05-08T04:09:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:45 smithi096 ceph-mon[124666]: pgmap v876: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 10 op/s 2023-05-08T04:09:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1524.423270 secs 2023-05-08T04:09:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:47 smithi186 ceph-mon[126480]: pgmap v877: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 7 op/s 2023-05-08T04:09:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:47 smithi133 ceph-mon[125939]: pgmap v877: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 7 op/s 2023-05-08T04:09:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:47 smithi096 ceph-mon[124666]: pgmap v877: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 7 op/s 2023-05-08T04:09:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1527.592856 secs 2023-05-08T04:09:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1528.147297 secs 2023-05-08T04:09:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:48 smithi186 ceph-mon[126480]: pgmap v878: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2023-05-08T04:09:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1527.592856 secs 2023-05-08T04:09:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1528.147297 secs 2023-05-08T04:09:49.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:48 smithi133 ceph-mon[125939]: pgmap v878: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2023-05-08T04:09:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1527.592856 secs 2023-05-08T04:09:49.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1528.147297 secs 2023-05-08T04:09:49.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:48 smithi096 ceph-mon[124666]: pgmap v878: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2023-05-08T04:09:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1529.423339 secs 2023-05-08T04:09:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1529.423339 secs 2023-05-08T04:09:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1529.423339 secs 2023-05-08T04:09:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:50 smithi133 ceph-mon[125939]: pgmap v879: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 8 op/s 2023-05-08T04:09:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:09:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:50 smithi096 ceph-mon[124666]: pgmap v879: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 8 op/s 2023-05-08T04:09:51.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:09:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:50 smithi186 ceph-mon[126480]: pgmap v879: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 8 op/s 2023-05-08T04:09:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:09:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:53 smithi133 ceph-mon[125939]: pgmap v880: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2023-05-08T04:09:53.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1532.592980 secs 2023-05-08T04:09:53.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:53 smithi096 ceph-mon[124666]: pgmap v880: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2023-05-08T04:09:53.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1532.592980 secs 2023-05-08T04:09:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:53 smithi186 ceph-mon[126480]: pgmap v880: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2023-05-08T04:09:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1532.592980 secs 2023-05-08T04:09:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1533.147447 secs 2023-05-08T04:09:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:09:54.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:09:54.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:09:54.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:09:54.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:09:54.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:09:54.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:09:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1533.147447 secs 2023-05-08T04:09:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:09:54.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:09:54.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:09:54.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:09:54.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:09:54.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:09:54.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:09:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1533.147447 secs 2023-05-08T04:09:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:09:55.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:09:55.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:09:55.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:09:55.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:09:55.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:09:55.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:09:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:55 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:09:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:55 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T04:09:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:55 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T04:09:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:55 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:09:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:55 smithi186 ceph-mon[126480]: pgmap v881: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T04:09:55.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1534.423456 secs 2023-05-08T04:09:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:55 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:09:55.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:55 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T04:09:55.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:55 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T04:09:55.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:55 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:09:55.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:55 smithi133 ceph-mon[125939]: pgmap v881: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T04:09:55.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1534.423456 secs 2023-05-08T04:09:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:55 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:09:56.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:55 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T04:09:56.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:55 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T04:09:56.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:55 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:09:56.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:55 smithi096 ceph-mon[124666]: pgmap v881: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T04:09:56.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1534.423456 secs 2023-05-08T04:09:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:57 smithi186 ceph-mon[126480]: pgmap v882: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2023-05-08T04:09:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:57 smithi133 ceph-mon[125939]: pgmap v882: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2023-05-08T04:09:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:57 smithi096 ceph-mon[124666]: pgmap v882: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2023-05-08T04:09:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1537.593108 secs 2023-05-08T04:09:59.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1538.147542 secs 2023-05-08T04:09:59.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:58 smithi186 ceph-mon[126480]: pgmap v883: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:09:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1537.593108 secs 2023-05-08T04:09:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1538.147542 secs 2023-05-08T04:09:59.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:58 smithi133 ceph-mon[125939]: pgmap v883: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:09:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1537.593108 secs 2023-05-08T04:09:59.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1538.147542 secs 2023-05-08T04:09:59.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:58 smithi096 ceph-mon[124666]: pgmap v883: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:10:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:09:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1539.423577 secs 2023-05-08T04:10:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:09:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1539.423577 secs 2023-05-08T04:10:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:09:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1539.423577 secs 2023-05-08T04:10:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:00 smithi133 ceph-mon[125939]: overall HEALTH_WARN 3 MDSs report slow requests 2023-05-08T04:10:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:00 smithi133 ceph-mon[125939]: pgmap v884: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T04:10:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:00 smithi096 ceph-mon[124666]: overall HEALTH_WARN 3 MDSs report slow requests 2023-05-08T04:10:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:00 smithi096 ceph-mon[124666]: pgmap v884: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T04:10:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:00 smithi186 ceph-mon[126480]: overall HEALTH_WARN 3 MDSs report slow requests 2023-05-08T04:10:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:00 smithi186 ceph-mon[126480]: pgmap v884: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T04:10:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:03 smithi186 ceph-mon[126480]: pgmap v885: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1023 B/s wr, 6 op/s 2023-05-08T04:10:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1542.593211 secs 2023-05-08T04:10:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:03 smithi133 ceph-mon[125939]: pgmap v885: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1023 B/s wr, 6 op/s 2023-05-08T04:10:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1542.593211 secs 2023-05-08T04:10:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:03 smithi096 ceph-mon[124666]: pgmap v885: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1023 B/s wr, 6 op/s 2023-05-08T04:10:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1542.593211 secs 2023-05-08T04:10:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1543.147625 secs 2023-05-08T04:10:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1543.147625 secs 2023-05-08T04:10:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1543.147625 secs 2023-05-08T04:10:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:05 smithi186 ceph-mon[126480]: pgmap v886: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:10:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1544.423724 secs 2023-05-08T04:10:05.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:05 smithi133 ceph-mon[125939]: pgmap v886: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:10:05.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1544.423724 secs 2023-05-08T04:10:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:05 smithi096 ceph-mon[124666]: pgmap v886: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:10:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1544.423724 secs 2023-05-08T04:10:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:07 smithi186 ceph-mon[126480]: pgmap v887: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 20 op/s 2023-05-08T04:10:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:07 smithi133 ceph-mon[125939]: pgmap v887: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 20 op/s 2023-05-08T04:10:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:07 smithi096 ceph-mon[124666]: pgmap v887: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 20 op/s 2023-05-08T04:10:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1547.593349 secs 2023-05-08T04:10:09.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1548.147762 secs 2023-05-08T04:10:09.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:08 smithi186 ceph-mon[126480]: pgmap v888: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 20 op/s 2023-05-08T04:10:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1547.593349 secs 2023-05-08T04:10:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1548.147762 secs 2023-05-08T04:10:09.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:08 smithi133 ceph-mon[125939]: pgmap v888: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 20 op/s 2023-05-08T04:10:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1547.593349 secs 2023-05-08T04:10:09.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1548.147762 secs 2023-05-08T04:10:09.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:08 smithi096 ceph-mon[124666]: pgmap v888: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 20 op/s 2023-05-08T04:10:11.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1549.423855 secs 2023-05-08T04:10:11.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:10 smithi133 ceph-mon[125939]: osdmap e136: 12 total, 12 up, 12 in 2023-05-08T04:10:11.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:10 smithi133 ceph-mon[125939]: pgmap v890: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T04:10:11.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1549.423855 secs 2023-05-08T04:10:11.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:10 smithi096 ceph-mon[124666]: osdmap e136: 12 total, 12 up, 12 in 2023-05-08T04:10:11.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:10 smithi096 ceph-mon[124666]: pgmap v890: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T04:10:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1549.423855 secs 2023-05-08T04:10:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:10 smithi186 ceph-mon[126480]: osdmap e136: 12 total, 12 up, 12 in 2023-05-08T04:10:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:10 smithi186 ceph-mon[126480]: pgmap v890: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T04:10:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:13 smithi186 ceph-mon[126480]: pgmap v891: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 24 op/s 2023-05-08T04:10:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1552.593454 secs 2023-05-08T04:10:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:13 smithi133 ceph-mon[125939]: pgmap v891: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 24 op/s 2023-05-08T04:10:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1552.593454 secs 2023-05-08T04:10:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:13 smithi096 ceph-mon[124666]: pgmap v891: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 24 op/s 2023-05-08T04:10:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1552.593454 secs 2023-05-08T04:10:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1553.147875 secs 2023-05-08T04:10:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1553.147875 secs 2023-05-08T04:10:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1553.147875 secs 2023-05-08T04:10:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:15 smithi186 ceph-mon[126480]: pgmap v892: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:10:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1554.423991 secs 2023-05-08T04:10:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:15 smithi133 ceph-mon[125939]: pgmap v892: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:10:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1554.423991 secs 2023-05-08T04:10:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:15 smithi096 ceph-mon[124666]: pgmap v892: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:10:16.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1554.423991 secs 2023-05-08T04:10:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:17 smithi186 ceph-mon[126480]: pgmap v893: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:10:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:17 smithi133 ceph-mon[125939]: pgmap v893: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:10:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:17 smithi096 ceph-mon[124666]: pgmap v893: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:10:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1557.593532 secs 2023-05-08T04:10:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:18 smithi186 ceph-mon[126480]: osdmap e137: 12 total, 12 up, 12 in 2023-05-08T04:10:19.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1558.147996 secs 2023-05-08T04:10:19.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:18 smithi186 ceph-mon[126480]: pgmap v895: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 237 B/s wr, 4 op/s 2023-05-08T04:10:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1557.593532 secs 2023-05-08T04:10:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:18 smithi133 ceph-mon[125939]: osdmap e137: 12 total, 12 up, 12 in 2023-05-08T04:10:19.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1558.147996 secs 2023-05-08T04:10:19.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:18 smithi133 ceph-mon[125939]: pgmap v895: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 237 B/s wr, 4 op/s 2023-05-08T04:10:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1557.593532 secs 2023-05-08T04:10:19.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:18 smithi096 ceph-mon[124666]: osdmap e137: 12 total, 12 up, 12 in 2023-05-08T04:10:19.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1558.147996 secs 2023-05-08T04:10:19.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:18 smithi096 ceph-mon[124666]: pgmap v895: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 237 B/s wr, 4 op/s 2023-05-08T04:10:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1559.424107 secs 2023-05-08T04:10:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1559.424107 secs 2023-05-08T04:10:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1559.424107 secs 2023-05-08T04:10:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:20 smithi133 ceph-mon[125939]: pgmap v896: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:10:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:20 smithi096 ceph-mon[124666]: pgmap v896: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:10:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:20 smithi186 ceph-mon[126480]: pgmap v896: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:10:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:23 smithi186 ceph-mon[126480]: pgmap v897: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:10:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1562.593633 secs 2023-05-08T04:10:23.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:23 smithi133 ceph-mon[125939]: pgmap v897: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:10:23.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1562.593633 secs 2023-05-08T04:10:24.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:23 smithi096 ceph-mon[124666]: pgmap v897: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:10:24.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1562.593633 secs 2023-05-08T04:10:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1563.148135 secs 2023-05-08T04:10:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1563.148135 secs 2023-05-08T04:10:25.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1563.148135 secs 2023-05-08T04:10:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:25 smithi186 ceph-mon[126480]: pgmap v898: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:10:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1564.424222 secs 2023-05-08T04:10:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:25 smithi133 ceph-mon[125939]: pgmap v898: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:10:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1564.424222 secs 2023-05-08T04:10:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:25 smithi096 ceph-mon[124666]: pgmap v898: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:10:26.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1564.424222 secs 2023-05-08T04:10:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:27 smithi186 ceph-mon[126480]: pgmap v899: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T04:10:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:27 smithi133 ceph-mon[125939]: pgmap v899: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T04:10:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:27 smithi096 ceph-mon[124666]: pgmap v899: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T04:10:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1567.593762 secs 2023-05-08T04:10:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1568.148273 secs 2023-05-08T04:10:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:28 smithi133 ceph-mon[125939]: pgmap v900: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-05-08T04:10:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1567.593762 secs 2023-05-08T04:10:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1568.148273 secs 2023-05-08T04:10:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:28 smithi096 ceph-mon[124666]: pgmap v900: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-05-08T04:10:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1567.593762 secs 2023-05-08T04:10:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1568.148273 secs 2023-05-08T04:10:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:28 smithi186 ceph-mon[126480]: pgmap v900: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-05-08T04:10:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:31 smithi186 ceph-mon[126480]: pgmap v901: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 170 B/s wr, 7 op/s 2023-05-08T04:10:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:31 smithi133 ceph-mon[125939]: pgmap v901: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 170 B/s wr, 7 op/s 2023-05-08T04:10:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:31 smithi096 ceph-mon[124666]: pgmap v901: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 170 B/s wr, 7 op/s 2023-05-08T04:10:33.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:33 smithi186 ceph-mon[126480]: pgmap v902: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 37 KiB/s wr, 6 op/s 2023-05-08T04:10:33.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1572.593886 secs 2023-05-08T04:10:33.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:33 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:10:33.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:33 smithi133 ceph-mon[125939]: pgmap v902: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 37 KiB/s wr, 6 op/s 2023-05-08T04:10:33.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1572.593886 secs 2023-05-08T04:10:33.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:33 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:10:34.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:33 smithi096 ceph-mon[124666]: pgmap v902: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 37 KiB/s wr, 6 op/s 2023-05-08T04:10:34.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1572.593886 secs 2023-05-08T04:10:34.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:33 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:10:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1573.148363 secs 2023-05-08T04:10:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:34 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:10:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:34 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:10:34.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:34 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:10:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1573.148363 secs 2023-05-08T04:10:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:34 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:10:34.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:34 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:10:34.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:34 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:10:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1573.148363 secs 2023-05-08T04:10:35.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:34 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:10:35.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:34 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:10:35.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:34 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:10:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:35 smithi186 ceph-mon[126480]: pgmap v903: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 38 KiB/s wr, 9 op/s 2023-05-08T04:10:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1574.424478 secs 2023-05-08T04:10:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:35 smithi133 ceph-mon[125939]: pgmap v903: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 38 KiB/s wr, 9 op/s 2023-05-08T04:10:35.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1574.424478 secs 2023-05-08T04:10:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:35 smithi096 ceph-mon[124666]: pgmap v903: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 38 KiB/s wr, 9 op/s 2023-05-08T04:10:36.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1574.424478 secs 2023-05-08T04:10:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:37 smithi186 ceph-mon[126480]: pgmap v904: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 62 KiB/s wr, 8 op/s 2023-05-08T04:10:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:37 smithi133 ceph-mon[125939]: pgmap v904: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 62 KiB/s wr, 8 op/s 2023-05-08T04:10:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:37 smithi096 ceph-mon[124666]: pgmap v904: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 62 KiB/s wr, 8 op/s 2023-05-08T04:10:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:38 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:10:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:38 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:10:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1577.594001 secs 2023-05-08T04:10:38.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:38 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:10:38.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:38 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:10:38.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1577.594001 secs 2023-05-08T04:10:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:38 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:10:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:38 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:10:39.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1577.594001 secs 2023-05-08T04:10:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1578.148505 secs 2023-05-08T04:10:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:39 smithi186 ceph-mon[126480]: pgmap v905: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 62 KiB/s wr, 8 op/s 2023-05-08T04:10:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1578.148505 secs 2023-05-08T04:10:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:39 smithi133 ceph-mon[125939]: pgmap v905: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 62 KiB/s wr, 8 op/s 2023-05-08T04:10:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1578.148505 secs 2023-05-08T04:10:40.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:39 smithi096 ceph-mon[124666]: pgmap v905: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 62 KiB/s wr, 8 op/s 2023-05-08T04:10:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1579.424616 secs 2023-05-08T04:10:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1579.424616 secs 2023-05-08T04:10:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1579.424616 secs 2023-05-08T04:10:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:41 smithi186 ceph-mon[126480]: pgmap v906: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 62 KiB/s wr, 10 op/s 2023-05-08T04:10:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:41 smithi133 ceph-mon[125939]: pgmap v906: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 62 KiB/s wr, 10 op/s 2023-05-08T04:10:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:41 smithi096 ceph-mon[124666]: pgmap v906: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 62 KiB/s wr, 10 op/s 2023-05-08T04:10:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:43 smithi186 ceph-mon[126480]: pgmap v907: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 62 KiB/s wr, 8 op/s 2023-05-08T04:10:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1582.594130 secs 2023-05-08T04:10:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:43 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:10:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:43 smithi133 ceph-mon[125939]: pgmap v907: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 62 KiB/s wr, 8 op/s 2023-05-08T04:10:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1582.594130 secs 2023-05-08T04:10:43.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:43 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:10:44.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:43 smithi096 ceph-mon[124666]: pgmap v907: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 62 KiB/s wr, 8 op/s 2023-05-08T04:10:44.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1582.594130 secs 2023-05-08T04:10:44.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:43 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:10:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1583.148620 secs 2023-05-08T04:10:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1583.148620 secs 2023-05-08T04:10:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1583.148620 secs 2023-05-08T04:10:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:45 smithi186 ceph-mon[126480]: pgmap v908: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 9 op/s 2023-05-08T04:10:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1584.424745 secs 2023-05-08T04:10:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:45 smithi133 ceph-mon[125939]: pgmap v908: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 9 op/s 2023-05-08T04:10:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1584.424745 secs 2023-05-08T04:10:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:45 smithi096 ceph-mon[124666]: pgmap v908: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 9 op/s 2023-05-08T04:10:46.094 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1584.424745 secs 2023-05-08T04:10:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:47 smithi186 ceph-mon[126480]: pgmap v909: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 6 op/s 2023-05-08T04:10:47.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:47 smithi133 ceph-mon[125939]: pgmap v909: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 6 op/s 2023-05-08T04:10:48.018 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:47 smithi096 ceph-mon[124666]: pgmap v909: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 6 op/s 2023-05-08T04:10:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1587.594249 secs 2023-05-08T04:10:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1588.148744 secs 2023-05-08T04:10:49.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:48 smithi133 ceph-mon[125939]: pgmap v910: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2023-05-08T04:10:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1587.594249 secs 2023-05-08T04:10:49.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1588.148744 secs 2023-05-08T04:10:49.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:48 smithi096 ceph-mon[124666]: pgmap v910: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2023-05-08T04:10:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1587.594249 secs 2023-05-08T04:10:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1588.148744 secs 2023-05-08T04:10:49.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:48 smithi186 ceph-mon[126480]: pgmap v910: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2023-05-08T04:10:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1589.424861 secs 2023-05-08T04:10:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1589.424861 secs 2023-05-08T04:10:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1589.424861 secs 2023-05-08T04:10:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:50 smithi133 ceph-mon[125939]: pgmap v911: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 7 op/s 2023-05-08T04:10:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:50 smithi096 ceph-mon[124666]: pgmap v911: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 7 op/s 2023-05-08T04:10:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:50 smithi186 ceph-mon[126480]: pgmap v911: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 7 op/s 2023-05-08T04:10:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:53 smithi186 ceph-mon[126480]: pgmap v912: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:10:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1592.594387 secs 2023-05-08T04:10:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:53 smithi133 ceph-mon[125939]: pgmap v912: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:10:53.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1592.594387 secs 2023-05-08T04:10:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:53 smithi096 ceph-mon[124666]: pgmap v912: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:10:54.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1592.594387 secs 2023-05-08T04:10:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1593.148861 secs 2023-05-08T04:10:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:10:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1593.148861 secs 2023-05-08T04:10:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:10:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1593.148861 secs 2023-05-08T04:10:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:10:55.873 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:55 smithi186 ceph-mon[126480]: pgmap v913: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:10:55.873 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1594.424931 secs 2023-05-08T04:10:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:55 smithi133 ceph-mon[125939]: pgmap v913: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:10:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1594.424931 secs 2023-05-08T04:10:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:55 smithi096 ceph-mon[124666]: pgmap v913: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:10:56.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1594.424931 secs 2023-05-08T04:10:57.737 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:57 smithi186 ceph-mon[126480]: pgmap v914: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:10:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:57 smithi133 ceph-mon[125939]: pgmap v914: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:10:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:57 smithi096 ceph-mon[124666]: pgmap v914: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:10:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1597.594505 secs 2023-05-08T04:10:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:10:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:10:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:10:59.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:10:59.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:58 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:10:59.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:10:59.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:58 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T04:10:59.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:58 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T04:10:59.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:58 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:10:59.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1598.148975 secs 2023-05-08T04:10:59.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:58 smithi186 ceph-mon[126480]: pgmap v915: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:10:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1597.594505 secs 2023-05-08T04:10:59.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:10:59.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:10:59.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:10:59.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:10:59.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:58 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:10:59.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:10:59.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:58 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T04:10:59.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:58 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T04:10:59.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:58 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:10:59.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1598.148975 secs 2023-05-08T04:10:59.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:58 smithi133 ceph-mon[125939]: pgmap v915: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:10:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1597.594505 secs 2023-05-08T04:10:59.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:10:59.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:10:59.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:10:59.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:10:59.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:58 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:10:59.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:10:59.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:58 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T04:10:59.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:58 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T04:10:59.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:58 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:10:59.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1598.148975 secs 2023-05-08T04:10:59.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:58 smithi096 ceph-mon[124666]: pgmap v915: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:11:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:10:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1599.425060 secs 2023-05-08T04:11:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:10:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1599.425060 secs 2023-05-08T04:11:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:10:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1599.425060 secs 2023-05-08T04:11:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:00 smithi133 ceph-mon[125939]: pgmap v916: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:11:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:00 smithi096 ceph-mon[124666]: pgmap v916: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:11:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:00 smithi186 ceph-mon[126480]: pgmap v916: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:11:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:03 smithi186 ceph-mon[126480]: pgmap v917: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1023 B/s wr, 5 op/s 2023-05-08T04:11:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1602.594584 secs 2023-05-08T04:11:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:03 smithi133 ceph-mon[125939]: pgmap v917: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1023 B/s wr, 5 op/s 2023-05-08T04:11:03.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1602.594584 secs 2023-05-08T04:11:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:03 smithi096 ceph-mon[124666]: pgmap v917: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1023 B/s wr, 5 op/s 2023-05-08T04:11:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1602.594584 secs 2023-05-08T04:11:04.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1603.149115 secs 2023-05-08T04:11:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1603.149115 secs 2023-05-08T04:11:05.011 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1603.149115 secs 2023-05-08T04:11:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:05 smithi186 ceph-mon[126480]: pgmap v918: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 21 op/s 2023-05-08T04:11:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1604.425175 secs 2023-05-08T04:11:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:05 smithi133 ceph-mon[125939]: pgmap v918: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 21 op/s 2023-05-08T04:11:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1604.425175 secs 2023-05-08T04:11:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:05 smithi096 ceph-mon[124666]: pgmap v918: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 21 op/s 2023-05-08T04:11:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1604.425175 secs 2023-05-08T04:11:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:07 smithi186 ceph-mon[126480]: pgmap v919: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 20 op/s 2023-05-08T04:11:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:07 smithi133 ceph-mon[125939]: pgmap v919: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 20 op/s 2023-05-08T04:11:08.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:07 smithi096 ceph-mon[124666]: pgmap v919: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 20 op/s 2023-05-08T04:11:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1607.594665 secs 2023-05-08T04:11:09.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1608.149192 secs 2023-05-08T04:11:09.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:08 smithi133 ceph-mon[125939]: pgmap v920: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:11:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1607.594665 secs 2023-05-08T04:11:09.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1608.149192 secs 2023-05-08T04:11:09.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:08 smithi096 ceph-mon[124666]: pgmap v920: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:11:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1607.594665 secs 2023-05-08T04:11:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1608.149192 secs 2023-05-08T04:11:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:08 smithi186 ceph-mon[126480]: pgmap v920: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:11:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1609.425292 secs 2023-05-08T04:11:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:10 smithi133 ceph-mon[125939]: osdmap e138: 12 total, 12 up, 12 in 2023-05-08T04:11:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:10 smithi133 ceph-mon[125939]: pgmap v922: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T04:11:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1609.425292 secs 2023-05-08T04:11:11.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:10 smithi096 ceph-mon[124666]: osdmap e138: 12 total, 12 up, 12 in 2023-05-08T04:11:11.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:10 smithi096 ceph-mon[124666]: pgmap v922: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T04:11:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1609.425292 secs 2023-05-08T04:11:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:10 smithi186 ceph-mon[126480]: osdmap e138: 12 total, 12 up, 12 in 2023-05-08T04:11:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:10 smithi186 ceph-mon[126480]: pgmap v922: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T04:11:13.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:13 smithi186 ceph-mon[126480]: pgmap v923: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 23 op/s 2023-05-08T04:11:13.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1612.594787 secs 2023-05-08T04:11:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:13 smithi133 ceph-mon[125939]: pgmap v923: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 23 op/s 2023-05-08T04:11:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1612.594787 secs 2023-05-08T04:11:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:13 smithi096 ceph-mon[124666]: pgmap v923: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 23 op/s 2023-05-08T04:11:14.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1612.594787 secs 2023-05-08T04:11:14.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1613.149307 secs 2023-05-08T04:11:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1613.149307 secs 2023-05-08T04:11:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1613.149307 secs 2023-05-08T04:11:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:15 smithi186 ceph-mon[126480]: pgmap v924: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:11:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1614.425361 secs 2023-05-08T04:11:15.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:15 smithi133 ceph-mon[125939]: pgmap v924: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:11:15.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1614.425361 secs 2023-05-08T04:11:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:15 smithi096 ceph-mon[124666]: pgmap v924: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:11:16.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1614.425361 secs 2023-05-08T04:11:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:17 smithi186 ceph-mon[126480]: pgmap v925: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:11:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:17 smithi133 ceph-mon[125939]: pgmap v925: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:11:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:17 smithi096 ceph-mon[124666]: pgmap v925: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:11:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1617.594886 secs 2023-05-08T04:11:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:18 smithi133 ceph-mon[125939]: osdmap e139: 12 total, 12 up, 12 in 2023-05-08T04:11:19.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1618.149442 secs 2023-05-08T04:11:19.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:18 smithi133 ceph-mon[125939]: pgmap v927: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 237 B/s wr, 4 op/s 2023-05-08T04:11:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1617.594886 secs 2023-05-08T04:11:19.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:18 smithi096 ceph-mon[124666]: osdmap e139: 12 total, 12 up, 12 in 2023-05-08T04:11:19.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1618.149442 secs 2023-05-08T04:11:19.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:18 smithi096 ceph-mon[124666]: pgmap v927: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 237 B/s wr, 4 op/s 2023-05-08T04:11:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1617.594886 secs 2023-05-08T04:11:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:18 smithi186 ceph-mon[126480]: osdmap e139: 12 total, 12 up, 12 in 2023-05-08T04:11:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1618.149442 secs 2023-05-08T04:11:19.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:18 smithi186 ceph-mon[126480]: pgmap v927: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 237 B/s wr, 4 op/s 2023-05-08T04:11:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1619.425479 secs 2023-05-08T04:11:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1619.425479 secs 2023-05-08T04:11:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1619.425479 secs 2023-05-08T04:11:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:20 smithi133 ceph-mon[125939]: pgmap v928: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:11:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:20 smithi096 ceph-mon[124666]: pgmap v928: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:11:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:20 smithi186 ceph-mon[126480]: pgmap v928: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:11:23.581 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:23 smithi186 ceph-mon[126480]: pgmap v929: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:11:23.581 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1622.594987 secs 2023-05-08T04:11:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:23 smithi133 ceph-mon[125939]: pgmap v929: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:11:23.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1622.594987 secs 2023-05-08T04:11:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:23 smithi096 ceph-mon[124666]: pgmap v929: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:11:24.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1622.594987 secs 2023-05-08T04:11:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1623.149535 secs 2023-05-08T04:11:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1623.149535 secs 2023-05-08T04:11:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1623.149535 secs 2023-05-08T04:11:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:25 smithi186 ceph-mon[126480]: pgmap v930: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:11:25.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1624.425602 secs 2023-05-08T04:11:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:25 smithi133 ceph-mon[125939]: pgmap v930: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:11:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1624.425602 secs 2023-05-08T04:11:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:25 smithi096 ceph-mon[124666]: pgmap v930: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:11:26.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1624.425602 secs 2023-05-08T04:11:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:27 smithi186 ceph-mon[126480]: pgmap v931: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T04:11:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:27 smithi133 ceph-mon[125939]: pgmap v931: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T04:11:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:27 smithi096 ceph-mon[124666]: pgmap v931: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T04:11:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1627.595090 secs 2023-05-08T04:11:29.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1628.149656 secs 2023-05-08T04:11:29.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:28 smithi133 ceph-mon[125939]: pgmap v932: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-05-08T04:11:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1627.595090 secs 2023-05-08T04:11:29.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1628.149656 secs 2023-05-08T04:11:29.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:28 smithi096 ceph-mon[124666]: pgmap v932: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-05-08T04:11:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1627.595090 secs 2023-05-08T04:11:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1628.149656 secs 2023-05-08T04:11:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:28 smithi186 ceph-mon[126480]: pgmap v932: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-05-08T04:11:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:31 smithi186 ceph-mon[126480]: pgmap v933: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 170 B/s wr, 7 op/s 2023-05-08T04:11:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:31 smithi133 ceph-mon[125939]: pgmap v933: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 170 B/s wr, 7 op/s 2023-05-08T04:11:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:31 smithi096 ceph-mon[124666]: pgmap v933: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 170 B/s wr, 7 op/s 2023-05-08T04:11:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:33 smithi186 ceph-mon[126480]: pgmap v934: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 38 KiB/s wr, 6 op/s 2023-05-08T04:11:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1632.595213 secs 2023-05-08T04:11:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:33 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:11:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:33 smithi133 ceph-mon[125939]: pgmap v934: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 38 KiB/s wr, 6 op/s 2023-05-08T04:11:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1632.595213 secs 2023-05-08T04:11:33.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:33 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:11:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:33 smithi096 ceph-mon[124666]: pgmap v934: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 38 KiB/s wr, 6 op/s 2023-05-08T04:11:34.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1632.595213 secs 2023-05-08T04:11:34.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:33 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:11:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1633.149752 secs 2023-05-08T04:11:34.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:34 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:11:34.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:34 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:11:34.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:34 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:11:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1633.149752 secs 2023-05-08T04:11:34.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:34 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:11:34.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:34 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:11:34.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:34 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:11:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1633.149752 secs 2023-05-08T04:11:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:34 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:11:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:34 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:11:35.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:34 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:11:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:35 smithi186 ceph-mon[126480]: pgmap v935: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 39 KiB/s wr, 9 op/s 2023-05-08T04:11:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1634.425845 secs 2023-05-08T04:11:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:35 smithi133 ceph-mon[125939]: pgmap v935: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 39 KiB/s wr, 9 op/s 2023-05-08T04:11:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1634.425845 secs 2023-05-08T04:11:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:35 smithi096 ceph-mon[124666]: pgmap v935: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 39 KiB/s wr, 9 op/s 2023-05-08T04:11:36.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1634.425845 secs 2023-05-08T04:11:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:37 smithi186 ceph-mon[126480]: pgmap v936: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 64 KiB/s wr, 8 op/s 2023-05-08T04:11:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:37 smithi133 ceph-mon[125939]: pgmap v936: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 64 KiB/s wr, 8 op/s 2023-05-08T04:11:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:37 smithi096 ceph-mon[124666]: pgmap v936: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 64 KiB/s wr, 8 op/s 2023-05-08T04:11:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:38 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:11:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:38 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:11:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1637.595368 secs 2023-05-08T04:11:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:38 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:11:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:38 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:11:38.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1637.595368 secs 2023-05-08T04:11:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:38 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:11:39.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:38 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:11:39.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1637.595368 secs 2023-05-08T04:11:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1638.149888 secs 2023-05-08T04:11:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:39 smithi186 ceph-mon[126480]: pgmap v937: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 64 KiB/s wr, 8 op/s 2023-05-08T04:11:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1638.149888 secs 2023-05-08T04:11:39.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:39 smithi133 ceph-mon[125939]: pgmap v937: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 64 KiB/s wr, 8 op/s 2023-05-08T04:11:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1638.149888 secs 2023-05-08T04:11:40.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:39 smithi096 ceph-mon[124666]: pgmap v937: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 64 KiB/s wr, 8 op/s 2023-05-08T04:11:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1639.425965 secs 2023-05-08T04:11:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1639.425965 secs 2023-05-08T04:11:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1639.425965 secs 2023-05-08T04:11:41.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:41 smithi186 ceph-mon[126480]: pgmap v938: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 64 KiB/s wr, 10 op/s 2023-05-08T04:11:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:41 smithi133 ceph-mon[125939]: pgmap v938: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 64 KiB/s wr, 10 op/s 2023-05-08T04:11:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:41 smithi096 ceph-mon[124666]: pgmap v938: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 64 KiB/s wr, 10 op/s 2023-05-08T04:11:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:43 smithi186 ceph-mon[126480]: pgmap v939: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 64 KiB/s wr, 8 op/s 2023-05-08T04:11:43.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1642.595499 secs 2023-05-08T04:11:43.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:43 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:11:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:43 smithi133 ceph-mon[125939]: pgmap v939: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 64 KiB/s wr, 8 op/s 2023-05-08T04:11:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1642.595499 secs 2023-05-08T04:11:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:43 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:11:44.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:43 smithi096 ceph-mon[124666]: pgmap v939: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 64 KiB/s wr, 8 op/s 2023-05-08T04:11:44.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1642.595499 secs 2023-05-08T04:11:44.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:43 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:11:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1643.150018 secs 2023-05-08T04:11:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1643.150018 secs 2023-05-08T04:11:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1643.150018 secs 2023-05-08T04:11:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:45 smithi133 ceph-mon[125939]: pgmap v940: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 9 op/s 2023-05-08T04:11:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1644.426093 secs 2023-05-08T04:11:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:45 smithi096 ceph-mon[124666]: pgmap v940: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 9 op/s 2023-05-08T04:11:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1644.426093 secs 2023-05-08T04:11:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:45 smithi186 ceph-mon[126480]: pgmap v940: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 9 op/s 2023-05-08T04:11:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1644.426093 secs 2023-05-08T04:11:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:47 smithi133 ceph-mon[125939]: pgmap v941: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 6 op/s 2023-05-08T04:11:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:47 smithi096 ceph-mon[124666]: pgmap v941: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 6 op/s 2023-05-08T04:11:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:47 smithi186 ceph-mon[126480]: pgmap v941: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 6 op/s 2023-05-08T04:11:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1647.595659 secs 2023-05-08T04:11:49.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1648.150138 secs 2023-05-08T04:11:49.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:48 smithi133 ceph-mon[125939]: pgmap v942: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2023-05-08T04:11:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1647.595659 secs 2023-05-08T04:11:49.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1648.150138 secs 2023-05-08T04:11:49.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:48 smithi096 ceph-mon[124666]: pgmap v942: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2023-05-08T04:11:49.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1647.595659 secs 2023-05-08T04:11:49.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1648.150138 secs 2023-05-08T04:11:49.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:48 smithi186 ceph-mon[126480]: pgmap v942: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2023-05-08T04:11:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1649.426190 secs 2023-05-08T04:11:50.259 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1649.426190 secs 2023-05-08T04:11:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1649.426190 secs 2023-05-08T04:11:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:50 smithi133 ceph-mon[125939]: pgmap v943: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 255 B/s wr, 7 op/s 2023-05-08T04:11:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:50 smithi096 ceph-mon[124666]: pgmap v943: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 255 B/s wr, 7 op/s 2023-05-08T04:11:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:50 smithi186 ceph-mon[126480]: pgmap v943: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 255 B/s wr, 7 op/s 2023-05-08T04:11:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:53 smithi186 ceph-mon[126480]: pgmap v944: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T04:11:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1652.595787 secs 2023-05-08T04:11:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:53 smithi133 ceph-mon[125939]: pgmap v944: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T04:11:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1652.595787 secs 2023-05-08T04:11:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:53 smithi096 ceph-mon[124666]: pgmap v944: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T04:11:54.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1652.595787 secs 2023-05-08T04:11:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1653.150260 secs 2023-05-08T04:11:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1653.150260 secs 2023-05-08T04:11:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1653.150260 secs 2023-05-08T04:11:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:55 smithi186 ceph-mon[126480]: pgmap v945: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:11:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1654.426293 secs 2023-05-08T04:11:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:55 smithi133 ceph-mon[125939]: pgmap v945: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:11:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1654.426293 secs 2023-05-08T04:11:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:55 smithi096 ceph-mon[124666]: pgmap v945: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:11:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1654.426293 secs 2023-05-08T04:11:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:57 smithi186 ceph-mon[126480]: pgmap v946: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:11:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:57 smithi133 ceph-mon[125939]: pgmap v946: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:11:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:57 smithi096 ceph-mon[124666]: pgmap v946: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:11:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1657.595931 secs 2023-05-08T04:11:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:11:59.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1658.150379 secs 2023-05-08T04:11:59.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:58 smithi133 ceph-mon[125939]: pgmap v947: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:11:59.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:11:59.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:11:59.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:11:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1657.595931 secs 2023-05-08T04:11:59.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:11:59.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1658.150379 secs 2023-05-08T04:11:59.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:58 smithi096 ceph-mon[124666]: pgmap v947: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:11:59.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:11:59.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:11:59.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:11:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1657.595931 secs 2023-05-08T04:11:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:11:59.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1658.150379 secs 2023-05-08T04:11:59.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:58 smithi186 ceph-mon[126480]: pgmap v947: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:11:59.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:11:59.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:11:59.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:12:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:59 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:12:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:59 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T04:12:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:59 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T04:12:00.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:11:59 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:12:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:59 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:12:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:59 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T04:12:00.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:59 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T04:12:00.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:11:59 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:12:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:59 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:12:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:59 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T04:12:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:59 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T04:12:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:11:59 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:12:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:12:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1659.426411 secs 2023-05-08T04:12:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:12:00 smithi133 ceph-mon[125939]: pgmap v948: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:12:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:12:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1659.426411 secs 2023-05-08T04:12:01.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:12:00 smithi096 ceph-mon[124666]: pgmap v948: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:12:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:12:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1659.426411 secs 2023-05-08T04:12:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:12:00 smithi186 ceph-mon[126480]: pgmap v948: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:12:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:12:03 smithi186 ceph-mon[126480]: pgmap v949: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1023 B/s wr, 5 op/s 2023-05-08T04:12:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:12:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1662.596056 secs 2023-05-08T04:12:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:12:03 smithi133 ceph-mon[125939]: pgmap v949: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1023 B/s wr, 5 op/s 2023-05-08T04:12:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:12:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1662.596056 secs 2023-05-08T04:12:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:12:03 smithi096 ceph-mon[124666]: pgmap v949: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1023 B/s wr, 5 op/s 2023-05-08T04:12:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:12:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1662.596056 secs 2023-05-08T04:12:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:12:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1663.150502 secs 2023-05-08T04:12:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:12:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1663.150502 secs 2023-05-08T04:12:05.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:12:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1663.150502 secs 2023-05-08T04:12:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:12:05 smithi186 ceph-mon[126480]: pgmap v950: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 21 op/s 2023-05-08T04:12:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:12:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1664.426461 secs 2023-05-08T04:12:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:12:05 smithi133 ceph-mon[125939]: pgmap v950: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 21 op/s 2023-05-08T04:12:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:12:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1664.426461 secs 2023-05-08T04:12:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:12:05 smithi096 ceph-mon[124666]: pgmap v950: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 21 op/s 2023-05-08T04:12:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:12:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1664.426461 secs 2023-05-08T04:12:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:12:07 smithi186 ceph-mon[126480]: pgmap v951: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 20 op/s 2023-05-08T04:12:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:12:07 smithi133 ceph-mon[125939]: pgmap v951: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 20 op/s 2023-05-08T04:12:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:12:07 smithi096 ceph-mon[124666]: pgmap v951: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 20 op/s 2023-05-08T04:12:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:12:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1667.596180 secs 2023-05-08T04:12:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:12:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1668.150644 secs 2023-05-08T04:12:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:12:08 smithi133 ceph-mon[125939]: pgmap v952: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:12:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:12:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1667.596180 secs 2023-05-08T04:12:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:12:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1668.150644 secs 2023-05-08T04:12:09.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:12:08 smithi096 ceph-mon[124666]: pgmap v952: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:12:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:12:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1667.596180 secs 2023-05-08T04:12:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:12:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1668.150644 secs 2023-05-08T04:12:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:12:08 smithi186 ceph-mon[126480]: pgmap v952: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:12:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:12:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1669.426583 secs 2023-05-08T04:12:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:12:10 smithi133 ceph-mon[125939]: osdmap e140: 12 total, 12 up, 12 in 2023-05-08T04:12:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:12:10 smithi133 ceph-mon[125939]: pgmap v954: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:12:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:12:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1669.426583 secs 2023-05-08T04:12:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:12:10 smithi096 ceph-mon[124666]: osdmap e140: 12 total, 12 up, 12 in 2023-05-08T04:12:11.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:12:10 smithi096 ceph-mon[124666]: pgmap v954: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:12:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:12:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1669.426583 secs 2023-05-08T04:12:11.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:12:10 smithi186 ceph-mon[126480]: osdmap e140: 12 total, 12 up, 12 in 2023-05-08T04:12:11.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:12:10 smithi186 ceph-mon[126480]: pgmap v954: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:12:13.873 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:12:13 smithi186 ceph-mon[126480]: pgmap v955: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 23 op/s 2023-05-08T04:12:13.873 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:12:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1672.596322 secs 2023-05-08T04:12:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:12:13 smithi133 ceph-mon[125939]: pgmap v955: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 23 op/s 2023-05-08T04:12:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:12:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1672.596322 secs 2023-05-08T04:12:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:12:13 smithi096 ceph-mon[124666]: pgmap v955: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 23 op/s 2023-05-08T04:12:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:12:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1672.596322 secs 2023-05-08T04:12:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:12:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1673.150766 secs 2023-05-08T04:12:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:12:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1673.150766 secs 2023-05-08T04:12:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:12:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1673.150766 secs 2023-05-08T04:12:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:12:15 smithi186 ceph-mon[126480]: pgmap v956: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:12:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:12:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1674.426723 secs 2023-05-08T04:12:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:12:15 smithi133 ceph-mon[125939]: pgmap v956: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:12:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:12:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1674.426723 secs 2023-05-08T04:12:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:12:15 smithi096 ceph-mon[124666]: pgmap v956: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:12:16.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:12:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1674.426723 secs 2023-05-08T04:12:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:12:17 smithi186 ceph-mon[126480]: pgmap v957: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:12:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:12:17 smithi133 ceph-mon[125939]: pgmap v957: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:12:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:12:17 smithi096 ceph-mon[124666]: pgmap v957: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:12:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:12:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1677.596423 secs 2023-05-08T04:12:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:12:18 smithi133 ceph-mon[125939]: osdmap e141: 12 total, 12 up, 12 in 2023-05-08T04:12:19.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:12:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1678.150896 secs 2023-05-08T04:12:19.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:12:18 smithi133 ceph-mon[125939]: pgmap v959: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 237 B/s wr, 4 op/s 2023-05-08T04:12:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:12:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1677.596423 secs 2023-05-08T04:12:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:12:18 smithi096 ceph-mon[124666]: osdmap e141: 12 total, 12 up, 12 in 2023-05-08T04:12:19.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:12:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1678.150896 secs 2023-05-08T04:12:19.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:12:18 smithi096 ceph-mon[124666]: pgmap v959: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 237 B/s wr, 4 op/s 2023-05-08T04:12:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:12:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1677.596423 secs 2023-05-08T04:12:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:12:18 smithi186 ceph-mon[126480]: osdmap e141: 12 total, 12 up, 12 in 2023-05-08T04:12:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:12:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1678.150896 secs 2023-05-08T04:12:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:12:18 smithi186 ceph-mon[126480]: pgmap v959: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 237 B/s wr, 4 op/s 2023-05-08T04:12:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:12:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1679.426868 secs 2023-05-08T04:12:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:12:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1679.426868 secs 2023-05-08T04:12:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:12:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1679.426868 secs 2023-05-08T04:12:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:12:20 smithi096 ceph-mon[124666]: pgmap v960: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:12:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:12:20 smithi186 ceph-mon[126480]: pgmap v960: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:12:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:12:20 smithi133 ceph-mon[125939]: pgmap v960: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:12:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:12:23 smithi186 ceph-mon[126480]: pgmap v961: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:12:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:12:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1682.596529 secs 2023-05-08T04:12:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:12:23 smithi133 ceph-mon[125939]: pgmap v961: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:12:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:12:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1682.596529 secs 2023-05-08T04:12:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:12:23 smithi096 ceph-mon[124666]: pgmap v961: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:12:24.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:12:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1682.596529 secs 2023-05-08T04:12:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:12:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1683.150992 secs 2023-05-08T04:12:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:12:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1683.150992 secs 2023-05-08T04:12:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:12:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1683.150992 secs 2023-05-08T04:12:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:12:25 smithi186 ceph-mon[126480]: pgmap v962: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:12:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:12:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1684.426939 secs 2023-05-08T04:12:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:12:25 smithi133 ceph-mon[125939]: pgmap v962: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:12:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:12:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1684.426939 secs 2023-05-08T04:12:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:12:25 smithi096 ceph-mon[124666]: pgmap v962: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:12:26.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:12:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1684.426939 secs 2023-05-08T04:12:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:12:27 smithi186 ceph-mon[126480]: pgmap v963: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-05-08T04:12:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:12:27 smithi133 ceph-mon[125939]: pgmap v963: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-05-08T04:12:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:12:27 smithi096 ceph-mon[124666]: pgmap v963: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-05-08T04:12:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:12:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1687.596638 secs 2023-05-08T04:12:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:12:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1688.151108 secs 2023-05-08T04:12:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:12:28 smithi133 ceph-mon[125939]: pgmap v964: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-05-08T04:12:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:12:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1687.596638 secs 2023-05-08T04:12:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:12:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1688.151108 secs 2023-05-08T04:12:29.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:12:28 smithi096 ceph-mon[124666]: pgmap v964: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-05-08T04:12:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:12:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1687.596638 secs 2023-05-08T04:12:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:12:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1688.151108 secs 2023-05-08T04:12:29.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:12:28 smithi186 ceph-mon[126480]: pgmap v964: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-05-08T04:12:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:12:31 smithi186 ceph-mon[126480]: pgmap v965: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 170 B/s wr, 7 op/s 2023-05-08T04:12:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:12:31 smithi133 ceph-mon[125939]: pgmap v965: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 170 B/s wr, 7 op/s 2023-05-08T04:12:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:12:31 smithi096 ceph-mon[124666]: pgmap v965: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 170 B/s wr, 7 op/s 2023-05-08T04:12:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:12:33 smithi186 ceph-mon[126480]: pgmap v966: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 39 KiB/s wr, 6 op/s 2023-05-08T04:12:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:12:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1692.596762 secs 2023-05-08T04:12:33.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:12:33 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:12:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:12:33 smithi133 ceph-mon[125939]: pgmap v966: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 39 KiB/s wr, 6 op/s 2023-05-08T04:12:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:12:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1692.596762 secs 2023-05-08T04:12:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:12:33 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:12:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:12:33 smithi096 ceph-mon[124666]: pgmap v966: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 39 KiB/s wr, 6 op/s 2023-05-08T04:12:34.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:12:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1692.596762 secs 2023-05-08T04:12:34.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:12:33 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:12:34.606 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:12:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1693.151224 secs 2023-05-08T04:12:34.606 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:12:34 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:12:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:12:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1693.151224 secs 2023-05-08T04:12:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:12:34 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:12:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:12:34 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:12:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:12:34 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:12:34.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:12:34 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:12:34.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:12:34 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:12:35.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:12:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1693.151224 secs 2023-05-08T04:12:35.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:12:34 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:12:35.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:12:34 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:12:35.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:12:34 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:12:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:12:35 smithi186 ceph-mon[126480]: pgmap v967: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 40 KiB/s wr, 9 op/s 2023-05-08T04:12:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:12:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1694.427174 secs 2023-05-08T04:12:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:12:35 smithi133 ceph-mon[125939]: pgmap v967: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 40 KiB/s wr, 9 op/s 2023-05-08T04:12:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:12:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1694.427174 secs 2023-05-08T04:12:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:12:35 smithi096 ceph-mon[124666]: pgmap v967: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 40 KiB/s wr, 9 op/s 2023-05-08T04:12:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:12:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1694.427174 secs 2023-05-08T04:12:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:12:37 smithi186 ceph-mon[126480]: pgmap v968: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 65 KiB/s wr, 8 op/s 2023-05-08T04:12:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:12:37 smithi133 ceph-mon[125939]: pgmap v968: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 65 KiB/s wr, 8 op/s 2023-05-08T04:12:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:12:37 smithi096 ceph-mon[124666]: pgmap v968: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 65 KiB/s wr, 8 op/s 2023-05-08T04:12:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:12:38 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:12:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:12:38 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:12:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:12:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1697.596887 secs 2023-05-08T04:12:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:12:38 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:12:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:12:38 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:12:38.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:12:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1697.596887 secs 2023-05-08T04:12:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:12:38 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:12:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:12:38 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:12:39.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:12:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1697.596887 secs 2023-05-08T04:12:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:12:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1698.151366 secs 2023-05-08T04:12:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:12:39 smithi186 ceph-mon[126480]: pgmap v969: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 65 KiB/s wr, 7 op/s 2023-05-08T04:12:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:12:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1698.151366 secs 2023-05-08T04:12:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:12:39 smithi133 ceph-mon[125939]: pgmap v969: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 65 KiB/s wr, 7 op/s 2023-05-08T04:12:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:12:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1698.151366 secs 2023-05-08T04:12:40.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:12:39 smithi096 ceph-mon[124666]: pgmap v969: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 65 KiB/s wr, 7 op/s 2023-05-08T04:12:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:12:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1699.427257 secs 2023-05-08T04:12:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:12:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1699.427257 secs 2023-05-08T04:12:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:12:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1699.427257 secs 2023-05-08T04:12:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:12:41 smithi133 ceph-mon[125939]: pgmap v970: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 65 KiB/s wr, 10 op/s 2023-05-08T04:12:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:12:41 smithi096 ceph-mon[124666]: pgmap v970: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 65 KiB/s wr, 10 op/s 2023-05-08T04:12:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:12:41 smithi186 ceph-mon[126480]: pgmap v970: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 65 KiB/s wr, 10 op/s 2023-05-08T04:12:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:12:43 smithi133 ceph-mon[125939]: pgmap v971: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 65 KiB/s wr, 8 op/s 2023-05-08T04:12:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:12:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1702.596988 secs 2023-05-08T04:12:43.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:12:43 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:12:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:12:43 smithi096 ceph-mon[124666]: pgmap v971: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 65 KiB/s wr, 8 op/s 2023-05-08T04:12:44.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:12:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1702.596988 secs 2023-05-08T04:12:44.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:12:43 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:12:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:12:43 smithi186 ceph-mon[126480]: pgmap v971: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 65 KiB/s wr, 8 op/s 2023-05-08T04:12:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:12:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1702.596988 secs 2023-05-08T04:12:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:12:43 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:12:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:12:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1703.151485 secs 2023-05-08T04:12:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:12:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1703.151485 secs 2023-05-08T04:12:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:12:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1703.151485 secs 2023-05-08T04:12:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:12:45 smithi133 ceph-mon[125939]: pgmap v972: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 9 op/s 2023-05-08T04:12:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:12:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1704.427385 secs 2023-05-08T04:12:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:12:45 smithi096 ceph-mon[124666]: pgmap v972: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 9 op/s 2023-05-08T04:12:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:12:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1704.427385 secs 2023-05-08T04:12:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:12:45 smithi186 ceph-mon[126480]: pgmap v972: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 9 op/s 2023-05-08T04:12:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:12:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1704.427385 secs 2023-05-08T04:12:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:12:47 smithi133 ceph-mon[125939]: pgmap v973: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 7 op/s 2023-05-08T04:12:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:12:47 smithi096 ceph-mon[124666]: pgmap v973: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 7 op/s 2023-05-08T04:12:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:12:47 smithi186 ceph-mon[126480]: pgmap v973: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 7 op/s 2023-05-08T04:12:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:12:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1707.597113 secs 2023-05-08T04:12:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:12:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1708.151611 secs 2023-05-08T04:12:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:12:48 smithi133 ceph-mon[125939]: pgmap v974: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T04:12:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:12:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1707.597113 secs 2023-05-08T04:12:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:12:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1708.151611 secs 2023-05-08T04:12:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:12:48 smithi096 ceph-mon[124666]: pgmap v974: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T04:12:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:12:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1707.597113 secs 2023-05-08T04:12:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:12:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1708.151611 secs 2023-05-08T04:12:49.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:12:48 smithi186 ceph-mon[126480]: pgmap v974: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T04:12:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:12:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1709.427522 secs 2023-05-08T04:12:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:12:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1709.427522 secs 2023-05-08T04:12:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:12:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1709.427522 secs 2023-05-08T04:12:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:12:50 smithi096 ceph-mon[124666]: pgmap v975: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 426 B/s wr, 8 op/s 2023-05-08T04:12:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:12:50 smithi186 ceph-mon[126480]: pgmap v975: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 426 B/s wr, 8 op/s 2023-05-08T04:12:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:12:50 smithi133 ceph-mon[125939]: pgmap v975: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 426 B/s wr, 8 op/s 2023-05-08T04:12:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:12:53 smithi186 ceph-mon[126480]: pgmap v976: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2023-05-08T04:12:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:12:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1712.597234 secs 2023-05-08T04:12:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:12:53 smithi133 ceph-mon[125939]: pgmap v976: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2023-05-08T04:12:53.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:12:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1712.597234 secs 2023-05-08T04:12:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:12:53 smithi096 ceph-mon[124666]: pgmap v976: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2023-05-08T04:12:54.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:12:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1712.597234 secs 2023-05-08T04:12:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:12:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1713.151710 secs 2023-05-08T04:12:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:12:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1713.151710 secs 2023-05-08T04:12:55.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:12:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1713.151710 secs 2023-05-08T04:12:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:12:55 smithi186 ceph-mon[126480]: pgmap v977: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 7 op/s 2023-05-08T04:12:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:12:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1714.427626 secs 2023-05-08T04:12:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:12:55 smithi133 ceph-mon[125939]: pgmap v977: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 7 op/s 2023-05-08T04:12:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:12:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1714.427626 secs 2023-05-08T04:12:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:12:55 smithi096 ceph-mon[124666]: pgmap v977: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 7 op/s 2023-05-08T04:12:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:12:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1714.427626 secs 2023-05-08T04:12:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:12:57 smithi133 ceph-mon[125939]: pgmap v978: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:12:58.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:12:57 smithi096 ceph-mon[124666]: pgmap v978: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:12:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:12:57 smithi186 ceph-mon[126480]: pgmap v978: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:12:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:12:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1717.597327 secs 2023-05-08T04:12:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:12:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1718.151808 secs 2023-05-08T04:12:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:12:58 smithi133 ceph-mon[125939]: pgmap v979: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:12:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:12:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:12:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:12:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1717.597327 secs 2023-05-08T04:12:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:12:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1718.151808 secs 2023-05-08T04:12:59.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:12:58 smithi096 ceph-mon[124666]: pgmap v979: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:12:59.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:12:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:12:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:12:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1717.597327 secs 2023-05-08T04:12:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:12:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1718.151808 secs 2023-05-08T04:12:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:12:58 smithi186 ceph-mon[126480]: pgmap v979: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:12:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:12:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:13:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:12:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1719.427772 secs 2023-05-08T04:13:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:12:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1719.427772 secs 2023-05-08T04:13:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:12:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1719.427772 secs 2023-05-08T04:13:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:00 smithi096 ceph-mon[124666]: pgmap v980: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1023 B/s wr, 7 op/s 2023-05-08T04:13:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:00 smithi186 ceph-mon[126480]: pgmap v980: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1023 B/s wr, 7 op/s 2023-05-08T04:13:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:00 smithi133 ceph-mon[125939]: pgmap v980: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1023 B/s wr, 7 op/s 2023-05-08T04:13:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:02 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:13:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:02 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:13:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:02 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:13:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:02 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:13:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:02 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:13:02.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:02 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:13:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:02 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:13:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:02 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:13:02.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:02 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:13:02.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:02 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:13:02.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:02 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:13:02.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:02 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:13:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:02 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:13:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:02 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:13:03.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:02 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:13:03.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:02 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:13:03.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:02 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:13:03.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:02 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:13:03.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:03 smithi133 ceph-mon[125939]: pgmap v981: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1023 B/s wr, 5 op/s 2023-05-08T04:13:03.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:13:03.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:13:03.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:13:03.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:13:03.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:13:03.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:13:03.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:13:03.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:13:03.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:13:03.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:13:03.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:13:03.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:03 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T04:13:03.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:13:03.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:03 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T04:13:03.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:03 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi096 to 196.2M 2023-05-08T04:13:03.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:03 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi096 to 205766758: error parsing value: Value '205766758' is below minimum 939524096 2023-05-08T04:13:03.994 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1722.597452 secs 2023-05-08T04:13:03.994 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:13:03.994 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:13:03.994 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:13:03.994 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:13:03.995 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:13:03.995 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:13:03.995 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:13:03.995 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:13:03.995 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:13:03.995 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1723.151919 secs 2023-05-08T04:13:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:03 smithi096 ceph-mon[124666]: pgmap v981: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1023 B/s wr, 5 op/s 2023-05-08T04:13:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:13:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:13:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:13:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:13:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:13:04.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:13:04.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:13:04.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:13:04.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:13:04.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:13:04.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:13:04.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:03 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T04:13:04.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:13:04.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:03 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T04:13:04.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:03 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi096 to 196.2M 2023-05-08T04:13:04.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:03 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi096 to 205766758: error parsing value: Value '205766758' is below minimum 939524096 2023-05-08T04:13:04.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1722.597452 secs 2023-05-08T04:13:04.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:13:04.009 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:13:04.009 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:13:04.009 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:13:04.009 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:13:04.009 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:13:04.009 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:13:04.009 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:13:04.009 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:13:04.010 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1723.151919 secs 2023-05-08T04:13:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:03 smithi186 ceph-mon[126480]: pgmap v981: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1023 B/s wr, 5 op/s 2023-05-08T04:13:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:13:04.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:13:04.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:13:04.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:13:04.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:13:04.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:13:04.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:13:04.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:13:04.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:13:04.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:13:04.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:13:04.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:03 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T04:13:04.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:13:04.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:03 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T04:13:04.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:03 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi096 to 196.2M 2023-05-08T04:13:04.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:03 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi096 to 205766758: error parsing value: Value '205766758' is below minimum 939524096 2023-05-08T04:13:04.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1722.597452 secs 2023-05-08T04:13:04.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:13:04.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:13:04.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:13:04.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:13:04.123 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:13:04.123 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:13:04.123 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:13:04.123 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:13:04.123 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:13:04.123 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1723.151919 secs 2023-05-08T04:13:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:04 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T04:13:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:04 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T04:13:04.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:04 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:13:04.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:04 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T04:13:04.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:04 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T04:13:04.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:04 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:13:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:04 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T04:13:05.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:04 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T04:13:05.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:04 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:13:05.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:04 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T04:13:05.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:04 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T04:13:05.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:04 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:13:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:04 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T04:13:05.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:04 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T04:13:05.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:04 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:13:05.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:04 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T04:13:05.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:04 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T04:13:05.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:04 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:13:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:05 smithi133 ceph-mon[125939]: pgmap v982: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 21 op/s 2023-05-08T04:13:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1724.427889 secs 2023-05-08T04:13:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:05 smithi096 ceph-mon[124666]: pgmap v982: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 21 op/s 2023-05-08T04:13:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1724.427889 secs 2023-05-08T04:13:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:05 smithi186 ceph-mon[126480]: pgmap v982: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 21 op/s 2023-05-08T04:13:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1724.427889 secs 2023-05-08T04:13:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:07 smithi133 ceph-mon[125939]: pgmap v983: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 20 op/s 2023-05-08T04:13:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:07 smithi096 ceph-mon[124666]: pgmap v983: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 20 op/s 2023-05-08T04:13:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:07 smithi186 ceph-mon[126480]: pgmap v983: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 20 op/s 2023-05-08T04:13:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1727.597580 secs 2023-05-08T04:13:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1728.152046 secs 2023-05-08T04:13:09.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:08 smithi133 ceph-mon[125939]: pgmap v984: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:13:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1727.597580 secs 2023-05-08T04:13:09.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1728.152046 secs 2023-05-08T04:13:09.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:08 smithi096 ceph-mon[124666]: pgmap v984: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:13:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1727.597580 secs 2023-05-08T04:13:09.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1728.152046 secs 2023-05-08T04:13:09.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:08 smithi186 ceph-mon[126480]: pgmap v984: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:13:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1729.427970 secs 2023-05-08T04:13:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:10 smithi133 ceph-mon[125939]: osdmap e142: 12 total, 12 up, 12 in 2023-05-08T04:13:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:10 smithi133 ceph-mon[125939]: pgmap v986: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 23 op/s 2023-05-08T04:13:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1729.427970 secs 2023-05-08T04:13:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:10 smithi096 ceph-mon[124666]: osdmap e142: 12 total, 12 up, 12 in 2023-05-08T04:13:11.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:10 smithi096 ceph-mon[124666]: pgmap v986: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 23 op/s 2023-05-08T04:13:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1729.427970 secs 2023-05-08T04:13:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:10 smithi186 ceph-mon[126480]: osdmap e142: 12 total, 12 up, 12 in 2023-05-08T04:13:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:10 smithi186 ceph-mon[126480]: pgmap v986: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 23 op/s 2023-05-08T04:13:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:13 smithi186 ceph-mon[126480]: pgmap v987: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 23 op/s 2023-05-08T04:13:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1732.597653 secs 2023-05-08T04:13:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:13 smithi133 ceph-mon[125939]: pgmap v987: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 23 op/s 2023-05-08T04:13:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1732.597653 secs 2023-05-08T04:13:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:13 smithi096 ceph-mon[124666]: pgmap v987: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 23 op/s 2023-05-08T04:13:14.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1732.597653 secs 2023-05-08T04:13:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1733.152165 secs 2023-05-08T04:13:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1733.152165 secs 2023-05-08T04:13:15.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1733.152165 secs 2023-05-08T04:13:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:15 smithi133 ceph-mon[125939]: pgmap v988: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:13:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1734.428098 secs 2023-05-08T04:13:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:15 smithi096 ceph-mon[124666]: pgmap v988: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:13:16.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1734.428098 secs 2023-05-08T04:13:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:15 smithi186 ceph-mon[126480]: pgmap v988: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:13:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1734.428098 secs 2023-05-08T04:13:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:17 smithi133 ceph-mon[125939]: pgmap v989: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:13:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:17 smithi096 ceph-mon[124666]: pgmap v989: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:13:18.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:17 smithi186 ceph-mon[126480]: pgmap v989: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:13:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1737.597780 secs 2023-05-08T04:13:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:18 smithi133 ceph-mon[125939]: osdmap e143: 12 total, 12 up, 12 in 2023-05-08T04:13:19.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1738.152293 secs 2023-05-08T04:13:19.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:18 smithi133 ceph-mon[125939]: pgmap v991: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 236 B/s wr, 4 op/s 2023-05-08T04:13:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1737.597780 secs 2023-05-08T04:13:19.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:18 smithi096 ceph-mon[124666]: osdmap e143: 12 total, 12 up, 12 in 2023-05-08T04:13:19.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1738.152293 secs 2023-05-08T04:13:19.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:18 smithi096 ceph-mon[124666]: pgmap v991: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 236 B/s wr, 4 op/s 2023-05-08T04:13:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1737.597780 secs 2023-05-08T04:13:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:18 smithi186 ceph-mon[126480]: osdmap e143: 12 total, 12 up, 12 in 2023-05-08T04:13:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1738.152293 secs 2023-05-08T04:13:19.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:18 smithi186 ceph-mon[126480]: pgmap v991: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 236 B/s wr, 4 op/s 2023-05-08T04:13:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1739.428195 secs 2023-05-08T04:13:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1739.428195 secs 2023-05-08T04:13:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1739.428195 secs 2023-05-08T04:13:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:21 smithi096 ceph-mon[124666]: pgmap v992: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:13:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:21 smithi186 ceph-mon[126480]: pgmap v992: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:13:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:21 smithi133 ceph-mon[125939]: pgmap v992: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:13:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:23 smithi186 ceph-mon[126480]: pgmap v993: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:13:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1742.597900 secs 2023-05-08T04:13:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:23 smithi133 ceph-mon[125939]: pgmap v993: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:13:23.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1742.597900 secs 2023-05-08T04:13:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:23 smithi096 ceph-mon[124666]: pgmap v993: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:13:24.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1742.597900 secs 2023-05-08T04:13:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1743.152419 secs 2023-05-08T04:13:25.016 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1743.152419 secs 2023-05-08T04:13:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1743.152419 secs 2023-05-08T04:13:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:25 smithi133 ceph-mon[125939]: pgmap v994: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:13:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1744.428304 secs 2023-05-08T04:13:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:25 smithi096 ceph-mon[124666]: pgmap v994: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:13:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1744.428304 secs 2023-05-08T04:13:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:25 smithi186 ceph-mon[126480]: pgmap v994: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:13:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1744.428304 secs 2023-05-08T04:13:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:27 smithi133 ceph-mon[125939]: pgmap v995: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T04:13:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:27 smithi096 ceph-mon[124666]: pgmap v995: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T04:13:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:27 smithi186 ceph-mon[126480]: pgmap v995: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T04:13:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1747.598007 secs 2023-05-08T04:13:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1748.152546 secs 2023-05-08T04:13:29.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:28 smithi133 ceph-mon[125939]: pgmap v996: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-05-08T04:13:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1747.598007 secs 2023-05-08T04:13:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1748.152546 secs 2023-05-08T04:13:29.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:28 smithi096 ceph-mon[124666]: pgmap v996: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-05-08T04:13:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1747.598007 secs 2023-05-08T04:13:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1748.152546 secs 2023-05-08T04:13:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:28 smithi186 ceph-mon[126480]: pgmap v996: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-05-08T04:13:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:31 smithi186 ceph-mon[126480]: pgmap v997: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 41 KiB/s wr, 8 op/s 2023-05-08T04:13:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:31 smithi133 ceph-mon[125939]: pgmap v997: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 41 KiB/s wr, 8 op/s 2023-05-08T04:13:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:31 smithi096 ceph-mon[124666]: pgmap v997: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 41 KiB/s wr, 8 op/s 2023-05-08T04:13:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:33 smithi133 ceph-mon[125939]: pgmap v998: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 41 KiB/s wr, 5 op/s 2023-05-08T04:13:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1752.598127 secs 2023-05-08T04:13:33.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:33 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:13:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:33 smithi096 ceph-mon[124666]: pgmap v998: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 41 KiB/s wr, 5 op/s 2023-05-08T04:13:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1752.598127 secs 2023-05-08T04:13:34.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:33 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:13:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:33 smithi186 ceph-mon[126480]: pgmap v998: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 41 KiB/s wr, 5 op/s 2023-05-08T04:13:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1752.598127 secs 2023-05-08T04:13:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:33 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:13:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1753.152665 secs 2023-05-08T04:13:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:34 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:13:34.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:34 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:13:34.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:34 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:13:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1753.152665 secs 2023-05-08T04:13:35.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:34 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:13:35.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:34 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:13:35.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:34 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:13:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1753.152665 secs 2023-05-08T04:13:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:34 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:13:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:34 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:13:35.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:34 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:13:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:35 smithi133 ceph-mon[125939]: pgmap v999: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 42 KiB/s wr, 8 op/s 2023-05-08T04:13:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1754.428583 secs 2023-05-08T04:13:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:35 smithi096 ceph-mon[124666]: pgmap v999: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 42 KiB/s wr, 8 op/s 2023-05-08T04:13:36.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1754.428583 secs 2023-05-08T04:13:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:35 smithi186 ceph-mon[126480]: pgmap v999: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 42 KiB/s wr, 8 op/s 2023-05-08T04:13:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1754.428583 secs 2023-05-08T04:13:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:37 smithi133 ceph-mon[125939]: pgmap v1000: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 66 KiB/s wr, 7 op/s 2023-05-08T04:13:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:37 smithi096 ceph-mon[124666]: pgmap v1000: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 66 KiB/s wr, 7 op/s 2023-05-08T04:13:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:37 smithi186 ceph-mon[126480]: pgmap v1000: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 66 KiB/s wr, 7 op/s 2023-05-08T04:13:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:38 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:13:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:38 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:13:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1757.598251 secs 2023-05-08T04:13:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:38 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:13:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:38 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:13:39.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1757.598251 secs 2023-05-08T04:13:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:38 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:13:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:38 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:13:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1757.598251 secs 2023-05-08T04:13:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1758.152779 secs 2023-05-08T04:13:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:39 smithi133 ceph-mon[125939]: pgmap v1001: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 66 KiB/s wr, 6 op/s 2023-05-08T04:13:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1758.152779 secs 2023-05-08T04:13:40.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:39 smithi096 ceph-mon[124666]: pgmap v1001: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 66 KiB/s wr, 6 op/s 2023-05-08T04:13:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1758.152779 secs 2023-05-08T04:13:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:39 smithi186 ceph-mon[126480]: pgmap v1001: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 66 KiB/s wr, 6 op/s 2023-05-08T04:13:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1759.428702 secs 2023-05-08T04:13:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1759.428702 secs 2023-05-08T04:13:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1759.428702 secs 2023-05-08T04:13:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:41 smithi133 ceph-mon[125939]: pgmap v1002: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 67 KiB/s wr, 10 op/s 2023-05-08T04:13:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:41 smithi096 ceph-mon[124666]: pgmap v1002: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 67 KiB/s wr, 10 op/s 2023-05-08T04:13:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:41 smithi186 ceph-mon[126480]: pgmap v1002: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 67 KiB/s wr, 10 op/s 2023-05-08T04:13:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:43 smithi133 ceph-mon[125939]: pgmap v1003: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 26 KiB/s wr, 7 op/s 2023-05-08T04:13:43.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1762.598365 secs 2023-05-08T04:13:43.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:43 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:13:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:43 smithi096 ceph-mon[124666]: pgmap v1003: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 26 KiB/s wr, 7 op/s 2023-05-08T04:13:44.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1762.598365 secs 2023-05-08T04:13:44.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:43 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:13:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:43 smithi186 ceph-mon[126480]: pgmap v1003: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 26 KiB/s wr, 7 op/s 2023-05-08T04:13:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1762.598365 secs 2023-05-08T04:13:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:43 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:13:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1763.152858 secs 2023-05-08T04:13:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1763.152858 secs 2023-05-08T04:13:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1763.152858 secs 2023-05-08T04:13:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:45 smithi133 ceph-mon[125939]: pgmap v1004: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 9 op/s 2023-05-08T04:13:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1764.428824 secs 2023-05-08T04:13:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:45 smithi096 ceph-mon[124666]: pgmap v1004: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 9 op/s 2023-05-08T04:13:46.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1764.428824 secs 2023-05-08T04:13:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:45 smithi186 ceph-mon[126480]: pgmap v1004: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 9 op/s 2023-05-08T04:13:46.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1764.428824 secs 2023-05-08T04:13:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:47 smithi133 ceph-mon[125939]: pgmap v1005: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 6 op/s 2023-05-08T04:13:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:47 smithi096 ceph-mon[124666]: pgmap v1005: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 6 op/s 2023-05-08T04:13:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:47 smithi186 ceph-mon[126480]: pgmap v1005: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 6 op/s 2023-05-08T04:13:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1767.598491 secs 2023-05-08T04:13:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1768.152941 secs 2023-05-08T04:13:49.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:48 smithi133 ceph-mon[125939]: pgmap v1006: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 6 op/s 2023-05-08T04:13:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1767.598491 secs 2023-05-08T04:13:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1768.152941 secs 2023-05-08T04:13:49.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:48 smithi096 ceph-mon[124666]: pgmap v1006: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 6 op/s 2023-05-08T04:13:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1767.598491 secs 2023-05-08T04:13:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1768.152941 secs 2023-05-08T04:13:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:48 smithi186 ceph-mon[126480]: pgmap v1006: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 6 op/s 2023-05-08T04:13:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1769.428939 secs 2023-05-08T04:13:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1769.428939 secs 2023-05-08T04:13:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1769.428939 secs 2023-05-08T04:13:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:51 smithi186 ceph-mon[126480]: pgmap v1007: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 341 B/s wr, 8 op/s 2023-05-08T04:13:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:51 smithi133 ceph-mon[125939]: pgmap v1007: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 341 B/s wr, 8 op/s 2023-05-08T04:13:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:51 smithi096 ceph-mon[124666]: pgmap v1007: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 341 B/s wr, 8 op/s 2023-05-08T04:13:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:53 smithi133 ceph-mon[125939]: pgmap v1008: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:13:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1772.598615 secs 2023-05-08T04:13:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:53 smithi096 ceph-mon[124666]: pgmap v1008: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:13:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1772.598615 secs 2023-05-08T04:13:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:53 smithi186 ceph-mon[126480]: pgmap v1008: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:13:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1772.598615 secs 2023-05-08T04:13:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1773.153081 secs 2023-05-08T04:13:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1773.153081 secs 2023-05-08T04:13:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1773.153081 secs 2023-05-08T04:13:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:55 smithi133 ceph-mon[125939]: pgmap v1009: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:13:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1774.429080 secs 2023-05-08T04:13:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:55 smithi096 ceph-mon[124666]: pgmap v1009: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:13:56.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1774.429080 secs 2023-05-08T04:13:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:55 smithi186 ceph-mon[126480]: pgmap v1009: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:13:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1774.429080 secs 2023-05-08T04:13:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:57 smithi133 ceph-mon[125939]: pgmap v1010: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:13:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:57 smithi096 ceph-mon[124666]: pgmap v1010: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:13:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:57 smithi186 ceph-mon[126480]: pgmap v1010: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:13:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1777.598680 secs 2023-05-08T04:13:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1778.153196 secs 2023-05-08T04:13:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:13:58 smithi133 ceph-mon[125939]: pgmap v1011: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:13:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1777.598680 secs 2023-05-08T04:13:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1778.153196 secs 2023-05-08T04:13:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:13:58 smithi096 ceph-mon[124666]: pgmap v1011: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:13:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1777.598680 secs 2023-05-08T04:13:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1778.153196 secs 2023-05-08T04:13:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:13:58 smithi186 ceph-mon[126480]: pgmap v1011: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:14:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:14:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1779.429215 secs 2023-05-08T04:14:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:14:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1779.429215 secs 2023-05-08T04:14:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:14:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1779.429215 secs 2023-05-08T04:14:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:14:01 smithi186 ceph-mon[126480]: pgmap v1012: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1023 B/s wr, 7 op/s 2023-05-08T04:14:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:14:01 smithi133 ceph-mon[125939]: pgmap v1012: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1023 B/s wr, 7 op/s 2023-05-08T04:14:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:14:01 smithi096 ceph-mon[124666]: pgmap v1012: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1023 B/s wr, 7 op/s 2023-05-08T04:14:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:14:03 smithi133 ceph-mon[125939]: pgmap v1013: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1023 B/s wr, 5 op/s 2023-05-08T04:14:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:14:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1782.598804 secs 2023-05-08T04:14:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:14:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:14:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:14:03 smithi096 ceph-mon[124666]: pgmap v1013: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1023 B/s wr, 5 op/s 2023-05-08T04:14:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:14:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1782.598804 secs 2023-05-08T04:14:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:14:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:14:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:14:03 smithi186 ceph-mon[126480]: pgmap v1013: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1023 B/s wr, 5 op/s 2023-05-08T04:14:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:14:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1782.598804 secs 2023-05-08T04:14:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:14:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:14:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:14:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1783.153290 secs 2023-05-08T04:14:04.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:14:04 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:14:04.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:14:04 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:14:04.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:14:04 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:14:04.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:14:04 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:14:04.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:14:04 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T04:14:04.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:14:04 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T04:14:04.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:14:04 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:14:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:14:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1783.153290 secs 2023-05-08T04:14:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:14:04 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:14:05.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:14:04 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:14:05.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:14:04 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:14:05.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:14:04 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:14:05.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:14:04 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T04:14:05.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:14:04 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T04:14:05.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:14:04 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:14:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:14:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1783.153290 secs 2023-05-08T04:14:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:14:04 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:14:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:14:04 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:14:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:14:04 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:14:05.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:14:04 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:14:05.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:14:04 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T04:14:05.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:14:04 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T04:14:05.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:14:04 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:14:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:14:05 smithi096 ceph-mon[124666]: pgmap v1014: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 21 op/s 2023-05-08T04:14:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:14:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1784.429328 secs 2023-05-08T04:14:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:14:05 smithi186 ceph-mon[126480]: pgmap v1014: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 21 op/s 2023-05-08T04:14:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:14:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1784.429328 secs 2023-05-08T04:14:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:14:05 smithi133 ceph-mon[125939]: pgmap v1014: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 21 op/s 2023-05-08T04:14:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:14:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1784.429328 secs 2023-05-08T04:14:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:14:07 smithi096 ceph-mon[124666]: pgmap v1015: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 20 op/s 2023-05-08T04:14:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:14:07 smithi186 ceph-mon[126480]: pgmap v1015: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 20 op/s 2023-05-08T04:14:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:14:07 smithi133 ceph-mon[125939]: pgmap v1015: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 20 op/s 2023-05-08T04:14:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:14:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1787.598956 secs 2023-05-08T04:14:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:14:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1788.153409 secs 2023-05-08T04:14:09.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:14:08 smithi133 ceph-mon[125939]: pgmap v1016: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:14:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:14:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1787.598956 secs 2023-05-08T04:14:09.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:14:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1788.153409 secs 2023-05-08T04:14:09.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:14:08 smithi096 ceph-mon[124666]: pgmap v1016: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:14:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:14:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1787.598956 secs 2023-05-08T04:14:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:14:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1788.153409 secs 2023-05-08T04:14:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:14:08 smithi186 ceph-mon[126480]: pgmap v1016: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:14:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:14:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1789.429465 secs 2023-05-08T04:14:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:14:10 smithi133 ceph-mon[125939]: osdmap e144: 12 total, 12 up, 12 in 2023-05-08T04:14:11.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:14:10 smithi133 ceph-mon[125939]: pgmap v1018: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 23 op/s 2023-05-08T04:14:11.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:14:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1789.429465 secs 2023-05-08T04:14:11.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:14:10 smithi096 ceph-mon[124666]: osdmap e144: 12 total, 12 up, 12 in 2023-05-08T04:14:11.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:14:10 smithi096 ceph-mon[124666]: pgmap v1018: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 23 op/s 2023-05-08T04:14:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:14:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1789.429465 secs 2023-05-08T04:14:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:14:10 smithi186 ceph-mon[126480]: osdmap e144: 12 total, 12 up, 12 in 2023-05-08T04:14:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:14:10 smithi186 ceph-mon[126480]: pgmap v1018: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 23 op/s 2023-05-08T04:14:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:14:13 smithi133 ceph-mon[125939]: pgmap v1019: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 23 op/s 2023-05-08T04:14:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:14:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1792.599094 secs 2023-05-08T04:14:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:14:13 smithi096 ceph-mon[124666]: pgmap v1019: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 23 op/s 2023-05-08T04:14:14.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:14:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1792.599094 secs 2023-05-08T04:14:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:14:13 smithi186 ceph-mon[126480]: pgmap v1019: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 23 op/s 2023-05-08T04:14:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:14:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1792.599094 secs 2023-05-08T04:14:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:14:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1793.153570 secs 2023-05-08T04:14:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:14:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1793.153570 secs 2023-05-08T04:14:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:14:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1793.153570 secs 2023-05-08T04:14:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:14:15 smithi133 ceph-mon[125939]: pgmap v1020: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:14:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:14:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1794.429608 secs 2023-05-08T04:14:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:14:15 smithi096 ceph-mon[124666]: pgmap v1020: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:14:16.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:14:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1794.429608 secs 2023-05-08T04:14:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:14:15 smithi186 ceph-mon[126480]: pgmap v1020: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:14:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:14:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1794.429608 secs 2023-05-08T04:14:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:14:17 smithi133 ceph-mon[125939]: pgmap v1021: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:14:18.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:14:17 smithi096 ceph-mon[124666]: pgmap v1021: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:14:18.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:14:17 smithi186 ceph-mon[126480]: pgmap v1021: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:14:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:14:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1797.599240 secs 2023-05-08T04:14:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:14:18 smithi133 ceph-mon[125939]: osdmap e145: 12 total, 12 up, 12 in 2023-05-08T04:14:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:14:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1798.153688 secs 2023-05-08T04:14:19.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:14:18 smithi133 ceph-mon[125939]: pgmap v1023: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 237 B/s wr, 4 op/s 2023-05-08T04:14:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:14:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1797.599240 secs 2023-05-08T04:14:19.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:14:18 smithi096 ceph-mon[124666]: osdmap e145: 12 total, 12 up, 12 in 2023-05-08T04:14:19.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:14:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1798.153688 secs 2023-05-08T04:14:19.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:14:18 smithi096 ceph-mon[124666]: pgmap v1023: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 237 B/s wr, 4 op/s 2023-05-08T04:14:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:14:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1797.599240 secs 2023-05-08T04:14:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:14:18 smithi186 ceph-mon[126480]: osdmap e145: 12 total, 12 up, 12 in 2023-05-08T04:14:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:14:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1798.153688 secs 2023-05-08T04:14:19.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:14:18 smithi186 ceph-mon[126480]: pgmap v1023: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 237 B/s wr, 4 op/s 2023-05-08T04:14:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:14:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1799.429724 secs 2023-05-08T04:14:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:14:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1799.429724 secs 2023-05-08T04:14:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:14:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1799.429724 secs 2023-05-08T04:14:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:14:21 smithi186 ceph-mon[126480]: pgmap v1024: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:14:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:14:21 smithi133 ceph-mon[125939]: pgmap v1024: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:14:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:14:21 smithi096 ceph-mon[124666]: pgmap v1024: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:14:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:14:23 smithi133 ceph-mon[125939]: pgmap v1025: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:14:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:14:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1802.599375 secs 2023-05-08T04:14:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:14:23 smithi096 ceph-mon[124666]: pgmap v1025: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:14:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:14:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1802.599375 secs 2023-05-08T04:14:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:14:23 smithi186 ceph-mon[126480]: pgmap v1025: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:14:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:14:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1802.599375 secs 2023-05-08T04:14:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:14:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1803.153825 secs 2023-05-08T04:14:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:14:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1803.153825 secs 2023-05-08T04:14:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:14:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1803.153825 secs 2023-05-08T04:14:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:14:25 smithi133 ceph-mon[125939]: pgmap v1026: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:14:25.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:14:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1804.429845 secs 2023-05-08T04:14:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:14:25 smithi096 ceph-mon[124666]: pgmap v1026: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:14:26.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:14:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1804.429845 secs 2023-05-08T04:14:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:14:25 smithi186 ceph-mon[126480]: pgmap v1026: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:14:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:14:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1804.429845 secs 2023-05-08T04:14:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:14:27 smithi133 ceph-mon[125939]: pgmap v1027: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T04:14:28.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:14:27 smithi096 ceph-mon[124666]: pgmap v1027: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T04:14:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:14:27 smithi186 ceph-mon[126480]: pgmap v1027: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T04:14:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:14:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1807.599475 secs 2023-05-08T04:14:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:14:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1808.153938 secs 2023-05-08T04:14:29.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:14:28 smithi133 ceph-mon[125939]: pgmap v1028: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-05-08T04:14:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:14:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1807.599475 secs 2023-05-08T04:14:29.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:14:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1808.153938 secs 2023-05-08T04:14:29.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:14:28 smithi096 ceph-mon[124666]: pgmap v1028: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-05-08T04:14:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:14:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1807.599475 secs 2023-05-08T04:14:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:14:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1808.153938 secs 2023-05-08T04:14:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:14:28 smithi186 ceph-mon[126480]: pgmap v1028: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-05-08T04:14:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:14:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1809.429992 secs 2023-05-08T04:14:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:14:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1809.429992 secs 2023-05-08T04:14:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:14:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1809.429992 secs 2023-05-08T04:14:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:14:31 smithi186 ceph-mon[126480]: pgmap v1029: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 42 KiB/s wr, 8 op/s 2023-05-08T04:14:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:14:31 smithi133 ceph-mon[125939]: pgmap v1029: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 42 KiB/s wr, 8 op/s 2023-05-08T04:14:31.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:14:31 smithi096 ceph-mon[124666]: pgmap v1029: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 42 KiB/s wr, 8 op/s 2023-05-08T04:14:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:14:33 smithi133 ceph-mon[125939]: pgmap v1030: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 42 KiB/s wr, 5 op/s 2023-05-08T04:14:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:14:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1812.599534 secs 2023-05-08T04:14:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:14:33 smithi096 ceph-mon[124666]: pgmap v1030: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 42 KiB/s wr, 5 op/s 2023-05-08T04:14:34.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:14:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1812.599534 secs 2023-05-08T04:14:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:14:33 smithi186 ceph-mon[126480]: pgmap v1030: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 42 KiB/s wr, 5 op/s 2023-05-08T04:14:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:14:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1812.599534 secs 2023-05-08T04:14:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:14:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1813.154067 secs 2023-05-08T04:14:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:14:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1813.154067 secs 2023-05-08T04:14:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:14:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1813.154067 secs 2023-05-08T04:14:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:14:35 smithi133 ceph-mon[125939]: pgmap v1031: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 62 KiB/s wr, 8 op/s 2023-05-08T04:14:35.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:14:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1814.430118 secs 2023-05-08T04:14:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:14:35 smithi096 ceph-mon[124666]: pgmap v1031: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 62 KiB/s wr, 8 op/s 2023-05-08T04:14:36.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:14:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1814.430118 secs 2023-05-08T04:14:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:14:35 smithi186 ceph-mon[126480]: pgmap v1031: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 62 KiB/s wr, 8 op/s 2023-05-08T04:14:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:14:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1814.430118 secs 2023-05-08T04:14:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:14:37 smithi133 ceph-mon[125939]: pgmap v1032: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 69 KiB/s wr, 7 op/s 2023-05-08T04:14:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:14:37 smithi096 ceph-mon[124666]: pgmap v1032: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 69 KiB/s wr, 7 op/s 2023-05-08T04:14:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:14:37 smithi186 ceph-mon[126480]: pgmap v1032: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 69 KiB/s wr, 7 op/s 2023-05-08T04:14:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:14:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1817.599667 secs 2023-05-08T04:14:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:14:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1818.154159 secs 2023-05-08T04:14:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:14:38 smithi133 ceph-mon[125939]: pgmap v1033: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 69 KiB/s wr, 6 op/s 2023-05-08T04:14:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:14:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1817.599667 secs 2023-05-08T04:14:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:14:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1818.154159 secs 2023-05-08T04:14:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:14:38 smithi096 ceph-mon[124666]: pgmap v1033: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 69 KiB/s wr, 6 op/s 2023-05-08T04:14:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:14:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1817.599667 secs 2023-05-08T04:14:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:14:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1818.154159 secs 2023-05-08T04:14:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:14:38 smithi186 ceph-mon[126480]: pgmap v1033: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 69 KiB/s wr, 6 op/s 2023-05-08T04:14:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:14:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1819.430216 secs 2023-05-08T04:14:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:14:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1819.430216 secs 2023-05-08T04:14:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:14:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1819.430216 secs 2023-05-08T04:14:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:14:41 smithi186 ceph-mon[126480]: pgmap v1034: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 79 KiB/s wr, 11 op/s 2023-05-08T04:14:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:14:41 smithi133 ceph-mon[125939]: pgmap v1034: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 79 KiB/s wr, 11 op/s 2023-05-08T04:14:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:14:41 smithi096 ceph-mon[124666]: pgmap v1034: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 79 KiB/s wr, 11 op/s 2023-05-08T04:14:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:14:43 smithi133 ceph-mon[125939]: pgmap v1035: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 7 op/s 2023-05-08T04:14:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:14:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1822.599792 secs 2023-05-08T04:14:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:14:43 smithi096 ceph-mon[124666]: pgmap v1035: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 7 op/s 2023-05-08T04:14:44.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:14:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1822.599792 secs 2023-05-08T04:14:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:14:43 smithi186 ceph-mon[126480]: pgmap v1035: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 7 op/s 2023-05-08T04:14:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:14:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1822.599792 secs 2023-05-08T04:14:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:14:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1823.154278 secs 2023-05-08T04:14:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:14:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1823.154278 secs 2023-05-08T04:14:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:14:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1823.154278 secs 2023-05-08T04:14:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:14:45 smithi133 ceph-mon[125939]: pgmap v1036: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 37 KiB/s wr, 10 op/s 2023-05-08T04:14:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:14:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1824.430318 secs 2023-05-08T04:14:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:14:45 smithi096 ceph-mon[124666]: pgmap v1036: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 37 KiB/s wr, 10 op/s 2023-05-08T04:14:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:14:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1824.430318 secs 2023-05-08T04:14:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:14:45 smithi186 ceph-mon[126480]: pgmap v1036: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 37 KiB/s wr, 10 op/s 2023-05-08T04:14:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:14:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1824.430318 secs 2023-05-08T04:14:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:14:47 smithi133 ceph-mon[125939]: pgmap v1037: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 17 KiB/s wr, 7 op/s 2023-05-08T04:14:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:14:47 smithi096 ceph-mon[124666]: pgmap v1037: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 17 KiB/s wr, 7 op/s 2023-05-08T04:14:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:14:47 smithi186 ceph-mon[126480]: pgmap v1037: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 17 KiB/s wr, 7 op/s 2023-05-08T04:14:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:14:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1827.599938 secs 2023-05-08T04:14:49.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:14:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1828.154397 secs 2023-05-08T04:14:49.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:14:48 smithi133 ceph-mon[125939]: pgmap v1038: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 10 KiB/s wr, 7 op/s 2023-05-08T04:14:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:14:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1827.599938 secs 2023-05-08T04:14:49.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:14:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1828.154397 secs 2023-05-08T04:14:49.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:14:48 smithi096 ceph-mon[124666]: pgmap v1038: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 10 KiB/s wr, 7 op/s 2023-05-08T04:14:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:14:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1827.599938 secs 2023-05-08T04:14:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:14:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1828.154397 secs 2023-05-08T04:14:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:14:48 smithi186 ceph-mon[126480]: pgmap v1038: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 10 KiB/s wr, 7 op/s 2023-05-08T04:14:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:14:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1829.430444 secs 2023-05-08T04:14:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:14:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1829.430444 secs 2023-05-08T04:14:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:14:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1829.430444 secs 2023-05-08T04:14:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:14:51 smithi186 ceph-mon[126480]: pgmap v1039: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 10 KiB/s wr, 10 op/s 2023-05-08T04:14:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:14:51 smithi133 ceph-mon[125939]: pgmap v1039: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 10 KiB/s wr, 10 op/s 2023-05-08T04:14:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:14:51 smithi096 ceph-mon[124666]: pgmap v1039: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 10 KiB/s wr, 10 op/s 2023-05-08T04:14:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:14:53 smithi133 ceph-mon[125939]: pgmap v1040: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:14:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:14:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1832.600059 secs 2023-05-08T04:14:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:14:53 smithi096 ceph-mon[124666]: pgmap v1040: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:14:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:14:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1832.600059 secs 2023-05-08T04:14:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:14:53 smithi186 ceph-mon[126480]: pgmap v1040: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:14:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:14:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1832.600059 secs 2023-05-08T04:14:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:14:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1833.154527 secs 2023-05-08T04:14:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:14:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1833.154527 secs 2023-05-08T04:14:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:14:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1833.154527 secs 2023-05-08T04:14:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:14:55 smithi133 ceph-mon[125939]: pgmap v1041: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T04:14:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:14:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1834.430581 secs 2023-05-08T04:14:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:14:55 smithi096 ceph-mon[124666]: pgmap v1041: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T04:14:56.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:14:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1834.430581 secs 2023-05-08T04:14:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:14:55 smithi186 ceph-mon[126480]: pgmap v1041: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T04:14:56.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:14:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1834.430581 secs 2023-05-08T04:14:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:14:57 smithi133 ceph-mon[125939]: pgmap v1042: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2023-05-08T04:14:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:14:57 smithi096 ceph-mon[124666]: pgmap v1042: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2023-05-08T04:14:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:14:57 smithi186 ceph-mon[126480]: pgmap v1042: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2023-05-08T04:14:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:14:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1837.600178 secs 2023-05-08T04:14:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:14:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1838.154652 secs 2023-05-08T04:14:59.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:14:58 smithi133 ceph-mon[125939]: pgmap v1043: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:14:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:14:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1837.600178 secs 2023-05-08T04:14:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:14:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1838.154652 secs 2023-05-08T04:14:59.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:14:58 smithi096 ceph-mon[124666]: pgmap v1043: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:14:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:14:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1837.600178 secs 2023-05-08T04:14:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:14:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1838.154652 secs 2023-05-08T04:14:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:14:58 smithi186 ceph-mon[126480]: pgmap v1043: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:15:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1839.430695 secs 2023-05-08T04:15:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1839.430695 secs 2023-05-08T04:15:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1839.430695 secs 2023-05-08T04:15:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:01 smithi186 ceph-mon[126480]: pgmap v1044: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T04:15:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:01 smithi133 ceph-mon[125939]: pgmap v1044: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T04:15:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:01 smithi096 ceph-mon[124666]: pgmap v1044: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T04:15:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:03 smithi133 ceph-mon[125939]: pgmap v1045: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:15:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1842.600269 secs 2023-05-08T04:15:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:03 smithi096 ceph-mon[124666]: pgmap v1045: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:15:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1842.600269 secs 2023-05-08T04:15:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:03 smithi186 ceph-mon[126480]: pgmap v1045: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:15:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1842.600269 secs 2023-05-08T04:15:04.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1843.154717 secs 2023-05-08T04:15:04.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:04 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:15:04.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:04 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:15:04.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:04 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:15:04.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:04 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:15:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1843.154717 secs 2023-05-08T04:15:05.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:04 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:15:05.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:04 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:15:05.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:04 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:15:05.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:04 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:15:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1843.154717 secs 2023-05-08T04:15:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:04 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:15:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:04 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:15:05.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:04 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:15:05.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:04 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:15:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:05 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:15:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:05 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T04:15:05.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:05 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T04:15:05.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:05 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:15:05.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:05 smithi133 ceph-mon[125939]: pgmap v1046: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:15:05.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1844.430814 secs 2023-05-08T04:15:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:05 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:15:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:05 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T04:15:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:05 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T04:15:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:05 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:15:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:05 smithi096 ceph-mon[124666]: pgmap v1046: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:15:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1844.430814 secs 2023-05-08T04:15:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:05 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:15:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:05 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T04:15:06.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:05 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T04:15:06.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:05 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:15:06.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:05 smithi186 ceph-mon[126480]: pgmap v1046: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:15:06.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1844.430814 secs 2023-05-08T04:15:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:07 smithi133 ceph-mon[125939]: pgmap v1047: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 20 op/s 2023-05-08T04:15:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:07 smithi096 ceph-mon[124666]: pgmap v1047: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 20 op/s 2023-05-08T04:15:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:07 smithi186 ceph-mon[126480]: pgmap v1047: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 20 op/s 2023-05-08T04:15:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1847.600397 secs 2023-05-08T04:15:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1848.154782 secs 2023-05-08T04:15:09.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:08 smithi133 ceph-mon[125939]: pgmap v1048: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 20 op/s 2023-05-08T04:15:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1847.600397 secs 2023-05-08T04:15:09.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1848.154782 secs 2023-05-08T04:15:09.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:08 smithi096 ceph-mon[124666]: pgmap v1048: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 20 op/s 2023-05-08T04:15:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1847.600397 secs 2023-05-08T04:15:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1848.154782 secs 2023-05-08T04:15:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:08 smithi186 ceph-mon[126480]: pgmap v1048: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 20 op/s 2023-05-08T04:15:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1849.430869 secs 2023-05-08T04:15:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:10 smithi133 ceph-mon[125939]: osdmap e146: 12 total, 12 up, 12 in 2023-05-08T04:15:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:10 smithi133 ceph-mon[125939]: pgmap v1050: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:15:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1849.430869 secs 2023-05-08T04:15:11.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:10 smithi096 ceph-mon[124666]: osdmap e146: 12 total, 12 up, 12 in 2023-05-08T04:15:11.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:10 smithi096 ceph-mon[124666]: pgmap v1050: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:15:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1849.430869 secs 2023-05-08T04:15:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:10 smithi186 ceph-mon[126480]: osdmap e146: 12 total, 12 up, 12 in 2023-05-08T04:15:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:10 smithi186 ceph-mon[126480]: pgmap v1050: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:15:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:13 smithi133 ceph-mon[125939]: pgmap v1051: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:15:13.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1852.600513 secs 2023-05-08T04:15:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:13 smithi096 ceph-mon[124666]: pgmap v1051: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:15:14.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1852.600513 secs 2023-05-08T04:15:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:13 smithi186 ceph-mon[126480]: pgmap v1051: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:15:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1852.600513 secs 2023-05-08T04:15:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1853.154903 secs 2023-05-08T04:15:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1853.154903 secs 2023-05-08T04:15:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1853.154903 secs 2023-05-08T04:15:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:15 smithi133 ceph-mon[125939]: pgmap v1052: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:15:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1854.430957 secs 2023-05-08T04:15:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:15 smithi096 ceph-mon[124666]: pgmap v1052: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:15:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1854.430957 secs 2023-05-08T04:15:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:15 smithi186 ceph-mon[126480]: pgmap v1052: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:15:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1854.430957 secs 2023-05-08T04:15:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:17 smithi133 ceph-mon[125939]: pgmap v1053: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:15:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:17 smithi096 ceph-mon[124666]: pgmap v1053: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:15:18.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:17 smithi186 ceph-mon[126480]: pgmap v1053: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:15:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1857.600638 secs 2023-05-08T04:15:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:18 smithi133 ceph-mon[125939]: osdmap e147: 12 total, 12 up, 12 in 2023-05-08T04:15:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1858.154996 secs 2023-05-08T04:15:19.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:18 smithi133 ceph-mon[125939]: pgmap v1055: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:15:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1857.600638 secs 2023-05-08T04:15:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:18 smithi096 ceph-mon[124666]: osdmap e147: 12 total, 12 up, 12 in 2023-05-08T04:15:19.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1858.154996 secs 2023-05-08T04:15:19.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:18 smithi096 ceph-mon[124666]: pgmap v1055: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:15:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1857.600638 secs 2023-05-08T04:15:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:18 smithi186 ceph-mon[126480]: osdmap e147: 12 total, 12 up, 12 in 2023-05-08T04:15:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1858.154996 secs 2023-05-08T04:15:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:18 smithi186 ceph-mon[126480]: pgmap v1055: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:15:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1859.431018 secs 2023-05-08T04:15:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1859.431018 secs 2023-05-08T04:15:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1859.431018 secs 2023-05-08T04:15:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:21 smithi186 ceph-mon[126480]: pgmap v1056: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:15:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:21 smithi133 ceph-mon[125939]: pgmap v1056: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:15:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:21 smithi096 ceph-mon[124666]: pgmap v1056: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:15:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:23 smithi133 ceph-mon[125939]: pgmap v1057: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:15:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1862.600760 secs 2023-05-08T04:15:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:23 smithi096 ceph-mon[124666]: pgmap v1057: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:15:24.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1862.600760 secs 2023-05-08T04:15:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:23 smithi186 ceph-mon[126480]: pgmap v1057: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:15:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1862.600760 secs 2023-05-08T04:15:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1863.155133 secs 2023-05-08T04:15:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1863.155133 secs 2023-05-08T04:15:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1863.155133 secs 2023-05-08T04:15:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:25 smithi133 ceph-mon[125939]: pgmap v1058: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:15:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1864.431101 secs 2023-05-08T04:15:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:25 smithi096 ceph-mon[124666]: pgmap v1058: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:15:26.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1864.431101 secs 2023-05-08T04:15:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:25 smithi186 ceph-mon[126480]: pgmap v1058: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:15:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1864.431101 secs 2023-05-08T04:15:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:27 smithi133 ceph-mon[125939]: pgmap v1059: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:15:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:27 smithi096 ceph-mon[124666]: pgmap v1059: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:15:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:27 smithi186 ceph-mon[126480]: pgmap v1059: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:15:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1867.600874 secs 2023-05-08T04:15:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1868.155197 secs 2023-05-08T04:15:29.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:28 smithi133 ceph-mon[125939]: pgmap v1060: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T04:15:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1867.600874 secs 2023-05-08T04:15:29.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1868.155197 secs 2023-05-08T04:15:29.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:28 smithi096 ceph-mon[124666]: pgmap v1060: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T04:15:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1867.600874 secs 2023-05-08T04:15:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1868.155197 secs 2023-05-08T04:15:29.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:28 smithi186 ceph-mon[126480]: pgmap v1060: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T04:15:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:31 smithi133 ceph-mon[125939]: pgmap v1061: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 23 KiB/s wr, 8 op/s 2023-05-08T04:15:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:31 smithi096 ceph-mon[124666]: pgmap v1061: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 23 KiB/s wr, 8 op/s 2023-05-08T04:15:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:31 smithi186 ceph-mon[126480]: pgmap v1061: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 23 KiB/s wr, 8 op/s 2023-05-08T04:15:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:33 smithi133 ceph-mon[125939]: pgmap v1062: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 23 KiB/s wr, 5 op/s 2023-05-08T04:15:33.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1872.601013 secs 2023-05-08T04:15:33.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:33 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:15:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:33 smithi096 ceph-mon[124666]: pgmap v1062: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 23 KiB/s wr, 5 op/s 2023-05-08T04:15:34.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1872.601013 secs 2023-05-08T04:15:34.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:33 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:15:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:33 smithi186 ceph-mon[126480]: pgmap v1062: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 23 KiB/s wr, 5 op/s 2023-05-08T04:15:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1872.601013 secs 2023-05-08T04:15:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:33 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:15:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1873.155336 secs 2023-05-08T04:15:34.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:34 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:15:34.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:34 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:15:34.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:34 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:15:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1873.155336 secs 2023-05-08T04:15:35.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:34 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:15:35.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:34 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:15:35.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:34 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:15:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1873.155336 secs 2023-05-08T04:15:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:34 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:15:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:34 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:15:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:34 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:15:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:35 smithi133 ceph-mon[125939]: pgmap v1063: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 71 KiB/s wr, 11 op/s 2023-05-08T04:15:35.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1874.431336 secs 2023-05-08T04:15:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:35 smithi096 ceph-mon[124666]: pgmap v1063: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 71 KiB/s wr, 11 op/s 2023-05-08T04:15:36.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1874.431336 secs 2023-05-08T04:15:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:35 smithi186 ceph-mon[126480]: pgmap v1063: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 71 KiB/s wr, 11 op/s 2023-05-08T04:15:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1874.431336 secs 2023-05-08T04:15:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:37 smithi133 ceph-mon[125939]: pgmap v1064: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 71 KiB/s wr, 8 op/s 2023-05-08T04:15:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:37 smithi096 ceph-mon[124666]: pgmap v1064: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 71 KiB/s wr, 8 op/s 2023-05-08T04:15:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:37 smithi186 ceph-mon[126480]: pgmap v1064: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 71 KiB/s wr, 8 op/s 2023-05-08T04:15:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:38 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:15:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:38 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:15:38.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1877.601114 secs 2023-05-08T04:15:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:38 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:15:39.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:38 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:15:39.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1877.601114 secs 2023-05-08T04:15:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:38 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:15:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:38 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:15:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1877.601114 secs 2023-05-08T04:15:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1878.155445 secs 2023-05-08T04:15:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:39 smithi133 ceph-mon[125939]: pgmap v1065: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 71 KiB/s wr, 8 op/s 2023-05-08T04:15:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1878.155445 secs 2023-05-08T04:15:40.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:39 smithi096 ceph-mon[124666]: pgmap v1065: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 71 KiB/s wr, 8 op/s 2023-05-08T04:15:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1878.155445 secs 2023-05-08T04:15:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:39 smithi186 ceph-mon[126480]: pgmap v1065: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 71 KiB/s wr, 8 op/s 2023-05-08T04:15:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1879.431476 secs 2023-05-08T04:15:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1879.431476 secs 2023-05-08T04:15:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1879.431476 secs 2023-05-08T04:15:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:41 smithi133 ceph-mon[125939]: pgmap v1066: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 95 KiB/s wr, 12 op/s 2023-05-08T04:15:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:41 smithi096 ceph-mon[124666]: pgmap v1066: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 95 KiB/s wr, 12 op/s 2023-05-08T04:15:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:41 smithi186 ceph-mon[126480]: pgmap v1066: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 95 KiB/s wr, 12 op/s 2023-05-08T04:15:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:43 smithi133 ceph-mon[125939]: pgmap v1067: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 72 KiB/s wr, 9 op/s 2023-05-08T04:15:43.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1882.601244 secs 2023-05-08T04:15:43.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:43 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:15:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:43 smithi096 ceph-mon[124666]: pgmap v1067: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 72 KiB/s wr, 9 op/s 2023-05-08T04:15:44.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1882.601244 secs 2023-05-08T04:15:44.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:43 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:15:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:43 smithi186 ceph-mon[126480]: pgmap v1067: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 72 KiB/s wr, 9 op/s 2023-05-08T04:15:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1882.601244 secs 2023-05-08T04:15:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:43 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:15:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1883.155565 secs 2023-05-08T04:15:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1883.155565 secs 2023-05-08T04:15:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1883.155565 secs 2023-05-08T04:15:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:45 smithi133 ceph-mon[125939]: pgmap v1068: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 72 KiB/s wr, 12 op/s 2023-05-08T04:15:45.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1884.431543 secs 2023-05-08T04:15:46.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:45 smithi096 ceph-mon[124666]: pgmap v1068: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 72 KiB/s wr, 12 op/s 2023-05-08T04:15:46.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1884.431543 secs 2023-05-08T04:15:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:45 smithi186 ceph-mon[126480]: pgmap v1068: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 72 KiB/s wr, 12 op/s 2023-05-08T04:15:46.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1884.431543 secs 2023-05-08T04:15:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:47 smithi133 ceph-mon[125939]: pgmap v1069: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 7 op/s 2023-05-08T04:15:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:47 smithi096 ceph-mon[124666]: pgmap v1069: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 7 op/s 2023-05-08T04:15:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:47 smithi186 ceph-mon[126480]: pgmap v1069: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 7 op/s 2023-05-08T04:15:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1887.601391 secs 2023-05-08T04:15:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1888.155701 secs 2023-05-08T04:15:49.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:48 smithi133 ceph-mon[125939]: pgmap v1070: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 7 op/s 2023-05-08T04:15:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1887.601391 secs 2023-05-08T04:15:49.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1888.155701 secs 2023-05-08T04:15:49.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:48 smithi096 ceph-mon[124666]: pgmap v1070: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 7 op/s 2023-05-08T04:15:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1887.601391 secs 2023-05-08T04:15:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1888.155701 secs 2023-05-08T04:15:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:48 smithi186 ceph-mon[126480]: pgmap v1070: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 7 op/s 2023-05-08T04:15:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1889.431661 secs 2023-05-08T04:15:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1889.431661 secs 2023-05-08T04:15:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1889.431661 secs 2023-05-08T04:15:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:51 smithi186 ceph-mon[126480]: pgmap v1071: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 9 op/s 2023-05-08T04:15:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:51 smithi133 ceph-mon[125939]: pgmap v1071: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 9 op/s 2023-05-08T04:15:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:51 smithi096 ceph-mon[124666]: pgmap v1071: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 9 op/s 2023-05-08T04:15:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:53 smithi133 ceph-mon[125939]: pgmap v1072: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 7.6 KiB/s wr, 5 op/s 2023-05-08T04:15:53.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1892.601508 secs 2023-05-08T04:15:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:53 smithi096 ceph-mon[124666]: pgmap v1072: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 7.6 KiB/s wr, 5 op/s 2023-05-08T04:15:54.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1892.601508 secs 2023-05-08T04:15:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:53 smithi186 ceph-mon[126480]: pgmap v1072: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 7.6 KiB/s wr, 5 op/s 2023-05-08T04:15:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1892.601508 secs 2023-05-08T04:15:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1893.155818 secs 2023-05-08T04:15:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1893.155818 secs 2023-05-08T04:15:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1893.155818 secs 2023-05-08T04:15:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:55 smithi133 ceph-mon[125939]: pgmap v1073: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.6 KiB/s wr, 8 op/s 2023-05-08T04:15:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1894.431797 secs 2023-05-08T04:15:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:55 smithi096 ceph-mon[124666]: pgmap v1073: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.6 KiB/s wr, 8 op/s 2023-05-08T04:15:56.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1894.431797 secs 2023-05-08T04:15:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:55 smithi186 ceph-mon[126480]: pgmap v1073: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.6 KiB/s wr, 8 op/s 2023-05-08T04:15:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1894.431797 secs 2023-05-08T04:15:57.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:57 smithi133 ceph-mon[125939]: pgmap v1074: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 7.5 KiB/s wr, 5 op/s 2023-05-08T04:15:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:57 smithi096 ceph-mon[124666]: pgmap v1074: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 7.5 KiB/s wr, 5 op/s 2023-05-08T04:15:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:57 smithi186 ceph-mon[126480]: pgmap v1074: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 7.5 KiB/s wr, 5 op/s 2023-05-08T04:15:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1897.601589 secs 2023-05-08T04:15:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1898.155956 secs 2023-05-08T04:15:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:15:58 smithi133 ceph-mon[125939]: pgmap v1075: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 7.5 KiB/s wr, 5 op/s 2023-05-08T04:15:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1897.601589 secs 2023-05-08T04:15:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1898.155956 secs 2023-05-08T04:15:59.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:15:58 smithi096 ceph-mon[124666]: pgmap v1075: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 7.5 KiB/s wr, 5 op/s 2023-05-08T04:15:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1897.601589 secs 2023-05-08T04:15:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1898.155956 secs 2023-05-08T04:15:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:15:58 smithi186 ceph-mon[126480]: pgmap v1075: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 7.5 KiB/s wr, 5 op/s 2023-05-08T04:16:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1899.431911 secs 2023-05-08T04:16:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1899.431911 secs 2023-05-08T04:16:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1899.431911 secs 2023-05-08T04:16:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:01 smithi186 ceph-mon[126480]: pgmap v1076: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.5 KiB/s wr, 7 op/s 2023-05-08T04:16:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:01 smithi133 ceph-mon[125939]: pgmap v1076: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.5 KiB/s wr, 7 op/s 2023-05-08T04:16:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:01 smithi096 ceph-mon[124666]: pgmap v1076: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.5 KiB/s wr, 7 op/s 2023-05-08T04:16:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:03 smithi133 ceph-mon[125939]: pgmap v1077: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:16:03.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1902.601658 secs 2023-05-08T04:16:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:03 smithi096 ceph-mon[124666]: pgmap v1077: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:16:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1902.601658 secs 2023-05-08T04:16:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:03 smithi186 ceph-mon[126480]: pgmap v1077: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:16:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1902.601658 secs 2023-05-08T04:16:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1903.156063 secs 2023-05-08T04:16:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:04 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:16:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1903.156063 secs 2023-05-08T04:16:05.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:04 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:16:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1903.156063 secs 2023-05-08T04:16:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:04 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:16:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:05 smithi133 ceph-mon[125939]: pgmap v1078: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:16:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1904.431983 secs 2023-05-08T04:16:05.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:05 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:16:05.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:05 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:16:05.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:05 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:16:05.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:05 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:16:05.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:05 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:16:05.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:05 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:16:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:05 smithi096 ceph-mon[124666]: pgmap v1078: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:16:06.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1904.431983 secs 2023-05-08T04:16:06.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:05 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:16:06.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:05 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:16:06.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:05 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:16:06.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:05 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:16:06.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:05 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:16:06.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:05 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:16:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:05 smithi186 ceph-mon[126480]: pgmap v1078: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:16:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1904.431983 secs 2023-05-08T04:16:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:05 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:16:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:05 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:16:06.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:05 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:16:06.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:05 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:16:06.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:05 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:16:06.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:05 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:16:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:06 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:16:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:06 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:16:06.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:06 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:16:06.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:06 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:16:06.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:06 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T04:16:06.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:06 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T04:16:06.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:06 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:16:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:06 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:16:07.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:06 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:16:07.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:06 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:16:07.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:06 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:16:07.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:06 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T04:16:07.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:06 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T04:16:07.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:06 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:16:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:06 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:16:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:06 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:16:07.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:06 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:16:07.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:06 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:16:07.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:06 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T04:16:07.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:06 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T04:16:07.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:06 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:16:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:07 smithi186 ceph-mon[126480]: pgmap v1079: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:16:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:07 smithi133 ceph-mon[125939]: pgmap v1079: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:16:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:07 smithi096 ceph-mon[124666]: pgmap v1079: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:16:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1907.601782 secs 2023-05-08T04:16:09.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1908.156182 secs 2023-05-08T04:16:09.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:08 smithi133 ceph-mon[125939]: pgmap v1080: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:16:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1907.601782 secs 2023-05-08T04:16:09.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1908.156182 secs 2023-05-08T04:16:09.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:08 smithi096 ceph-mon[124666]: pgmap v1080: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:16:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1907.601782 secs 2023-05-08T04:16:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1908.156182 secs 2023-05-08T04:16:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:08 smithi186 ceph-mon[126480]: pgmap v1080: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:16:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1909.432100 secs 2023-05-08T04:16:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:10 smithi133 ceph-mon[125939]: osdmap e148: 12 total, 12 up, 12 in 2023-05-08T04:16:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:10 smithi133 ceph-mon[125939]: pgmap v1082: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T04:16:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1909.432100 secs 2023-05-08T04:16:11.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:10 smithi096 ceph-mon[124666]: osdmap e148: 12 total, 12 up, 12 in 2023-05-08T04:16:11.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:10 smithi096 ceph-mon[124666]: pgmap v1082: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T04:16:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1909.432100 secs 2023-05-08T04:16:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:10 smithi186 ceph-mon[126480]: osdmap e148: 12 total, 12 up, 12 in 2023-05-08T04:16:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:10 smithi186 ceph-mon[126480]: pgmap v1082: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T04:16:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:13 smithi133 ceph-mon[125939]: pgmap v1083: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T04:16:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1912.601906 secs 2023-05-08T04:16:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:13 smithi096 ceph-mon[124666]: pgmap v1083: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T04:16:14.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1912.601906 secs 2023-05-08T04:16:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:13 smithi186 ceph-mon[126480]: pgmap v1083: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T04:16:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1912.601906 secs 2023-05-08T04:16:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1913.156316 secs 2023-05-08T04:16:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1913.156316 secs 2023-05-08T04:16:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1913.156316 secs 2023-05-08T04:16:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:15 smithi133 ceph-mon[125939]: pgmap v1084: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:16:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1914.432237 secs 2023-05-08T04:16:16.009 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:15 smithi096 ceph-mon[124666]: pgmap v1084: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:16:16.010 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1914.432237 secs 2023-05-08T04:16:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:15 smithi186 ceph-mon[126480]: pgmap v1084: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:16:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1914.432237 secs 2023-05-08T04:16:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:17 smithi133 ceph-mon[125939]: pgmap v1085: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:16:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:17 smithi096 ceph-mon[124666]: pgmap v1085: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:16:18.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:17 smithi186 ceph-mon[126480]: pgmap v1085: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:16:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1917.602051 secs 2023-05-08T04:16:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:18 smithi133 ceph-mon[125939]: osdmap e149: 12 total, 12 up, 12 in 2023-05-08T04:16:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1918.156437 secs 2023-05-08T04:16:19.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:18 smithi133 ceph-mon[125939]: pgmap v1087: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:16:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1917.602051 secs 2023-05-08T04:16:19.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:18 smithi096 ceph-mon[124666]: osdmap e149: 12 total, 12 up, 12 in 2023-05-08T04:16:19.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1918.156437 secs 2023-05-08T04:16:19.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:18 smithi096 ceph-mon[124666]: pgmap v1087: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:16:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1917.602051 secs 2023-05-08T04:16:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:18 smithi186 ceph-mon[126480]: osdmap e149: 12 total, 12 up, 12 in 2023-05-08T04:16:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1918.156437 secs 2023-05-08T04:16:19.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:18 smithi186 ceph-mon[126480]: pgmap v1087: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:16:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1919.432371 secs 2023-05-08T04:16:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1919.432371 secs 2023-05-08T04:16:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1919.432371 secs 2023-05-08T04:16:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:21 smithi186 ceph-mon[126480]: pgmap v1088: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:16:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:21 smithi133 ceph-mon[125939]: pgmap v1088: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:16:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:21 smithi096 ceph-mon[124666]: pgmap v1088: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:16:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:23 smithi133 ceph-mon[125939]: pgmap v1089: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:16:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1922.602175 secs 2023-05-08T04:16:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:23 smithi096 ceph-mon[124666]: pgmap v1089: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:16:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1922.602175 secs 2023-05-08T04:16:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:23 smithi186 ceph-mon[126480]: pgmap v1089: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:16:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1922.602175 secs 2023-05-08T04:16:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1923.156557 secs 2023-05-08T04:16:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1923.156557 secs 2023-05-08T04:16:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1923.156557 secs 2023-05-08T04:16:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:25 smithi133 ceph-mon[125939]: pgmap v1090: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:16:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1924.432492 secs 2023-05-08T04:16:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:25 smithi096 ceph-mon[124666]: pgmap v1090: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:16:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1924.432492 secs 2023-05-08T04:16:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:25 smithi186 ceph-mon[126480]: pgmap v1090: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:16:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1924.432492 secs 2023-05-08T04:16:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:27 smithi133 ceph-mon[125939]: pgmap v1091: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:16:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:27 smithi096 ceph-mon[124666]: pgmap v1091: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:16:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:27 smithi186 ceph-mon[126480]: pgmap v1091: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:16:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1927.602294 secs 2023-05-08T04:16:29.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1928.156673 secs 2023-05-08T04:16:29.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:28 smithi133 ceph-mon[125939]: pgmap v1092: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T04:16:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1927.602294 secs 2023-05-08T04:16:29.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1928.156673 secs 2023-05-08T04:16:29.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:28 smithi096 ceph-mon[124666]: pgmap v1092: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T04:16:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1927.602294 secs 2023-05-08T04:16:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1928.156673 secs 2023-05-08T04:16:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:28 smithi186 ceph-mon[126480]: pgmap v1092: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T04:16:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:31 smithi133 ceph-mon[125939]: pgmap v1093: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 24 KiB/s wr, 8 op/s 2023-05-08T04:16:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:31 smithi096 ceph-mon[124666]: pgmap v1093: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 24 KiB/s wr, 8 op/s 2023-05-08T04:16:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:31 smithi186 ceph-mon[126480]: pgmap v1093: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 24 KiB/s wr, 8 op/s 2023-05-08T04:16:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:33 smithi133 ceph-mon[125939]: pgmap v1094: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 24 KiB/s wr, 5 op/s 2023-05-08T04:16:33.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1932.602372 secs 2023-05-08T04:16:33.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:33 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:16:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:33 smithi096 ceph-mon[124666]: pgmap v1094: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 24 KiB/s wr, 5 op/s 2023-05-08T04:16:34.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1932.602372 secs 2023-05-08T04:16:34.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:33 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:16:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:33 smithi186 ceph-mon[126480]: pgmap v1094: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 24 KiB/s wr, 5 op/s 2023-05-08T04:16:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1932.602372 secs 2023-05-08T04:16:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:33 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:16:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1933.156792 secs 2023-05-08T04:16:34.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:34 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:16:34.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:34 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:16:34.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:34 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:16:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1933.156792 secs 2023-05-08T04:16:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:34 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:16:35.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:34 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:16:35.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:34 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:16:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1933.156792 secs 2023-05-08T04:16:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:34 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:16:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:34 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:16:35.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:34 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:16:35.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:35 smithi133 ceph-mon[125939]: pgmap v1095: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 63 KiB/s wr, 9 op/s 2023-05-08T04:16:35.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1934.432736 secs 2023-05-08T04:16:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:35 smithi096 ceph-mon[124666]: pgmap v1095: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 63 KiB/s wr, 9 op/s 2023-05-08T04:16:36.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1934.432736 secs 2023-05-08T04:16:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:35 smithi186 ceph-mon[126480]: pgmap v1095: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 63 KiB/s wr, 9 op/s 2023-05-08T04:16:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1934.432736 secs 2023-05-08T04:16:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:37 smithi133 ceph-mon[125939]: pgmap v1096: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 63 KiB/s wr, 7 op/s 2023-05-08T04:16:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:37 smithi096 ceph-mon[124666]: pgmap v1096: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 63 KiB/s wr, 7 op/s 2023-05-08T04:16:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:37 smithi186 ceph-mon[126480]: pgmap v1096: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 63 KiB/s wr, 7 op/s 2023-05-08T04:16:38.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:38 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:16:38.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:38 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:16:38.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1937.602493 secs 2023-05-08T04:16:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:38 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:16:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:38 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:16:39.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1937.602493 secs 2023-05-08T04:16:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:38 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:16:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:38 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:16:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1937.602493 secs 2023-05-08T04:16:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1938.156930 secs 2023-05-08T04:16:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:39 smithi133 ceph-mon[125939]: pgmap v1097: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 63 KiB/s wr, 7 op/s 2023-05-08T04:16:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1938.156930 secs 2023-05-08T04:16:40.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:39 smithi096 ceph-mon[124666]: pgmap v1097: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 63 KiB/s wr, 7 op/s 2023-05-08T04:16:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1938.156930 secs 2023-05-08T04:16:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:39 smithi186 ceph-mon[126480]: pgmap v1097: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 63 KiB/s wr, 7 op/s 2023-05-08T04:16:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1939.432804 secs 2023-05-08T04:16:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1939.432804 secs 2023-05-08T04:16:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1939.432804 secs 2023-05-08T04:16:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:41 smithi133 ceph-mon[125939]: pgmap v1098: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 74 KiB/s wr, 11 op/s 2023-05-08T04:16:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:41 smithi096 ceph-mon[124666]: pgmap v1098: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 74 KiB/s wr, 11 op/s 2023-05-08T04:16:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:41 smithi186 ceph-mon[126480]: pgmap v1098: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 74 KiB/s wr, 11 op/s 2023-05-08T04:16:43.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:43 smithi133 ceph-mon[125939]: pgmap v1099: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 50 KiB/s wr, 7 op/s 2023-05-08T04:16:43.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1942.602618 secs 2023-05-08T04:16:43.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:43 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:16:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:43 smithi096 ceph-mon[124666]: pgmap v1099: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 50 KiB/s wr, 7 op/s 2023-05-08T04:16:44.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1942.602618 secs 2023-05-08T04:16:44.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:43 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:16:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:43 smithi186 ceph-mon[126480]: pgmap v1099: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 50 KiB/s wr, 7 op/s 2023-05-08T04:16:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1942.602618 secs 2023-05-08T04:16:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:43 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:16:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1943.157061 secs 2023-05-08T04:16:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1943.157061 secs 2023-05-08T04:16:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1943.157061 secs 2023-05-08T04:16:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:45 smithi133 ceph-mon[125939]: pgmap v1100: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 50 KiB/s wr, 10 op/s 2023-05-08T04:16:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1944.432926 secs 2023-05-08T04:16:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:45 smithi096 ceph-mon[124666]: pgmap v1100: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 50 KiB/s wr, 10 op/s 2023-05-08T04:16:46.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1944.432926 secs 2023-05-08T04:16:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:45 smithi186 ceph-mon[126480]: pgmap v1100: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 50 KiB/s wr, 10 op/s 2023-05-08T04:16:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1944.432926 secs 2023-05-08T04:16:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:47 smithi133 ceph-mon[125939]: pgmap v1101: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 6 op/s 2023-05-08T04:16:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:47 smithi096 ceph-mon[124666]: pgmap v1101: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 6 op/s 2023-05-08T04:16:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:47 smithi186 ceph-mon[126480]: pgmap v1101: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 6 op/s 2023-05-08T04:16:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1947.602736 secs 2023-05-08T04:16:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1948.157203 secs 2023-05-08T04:16:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:48 smithi133 ceph-mon[125939]: pgmap v1102: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 6 op/s 2023-05-08T04:16:49.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1947.602736 secs 2023-05-08T04:16:49.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1948.157203 secs 2023-05-08T04:16:49.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:48 smithi096 ceph-mon[124666]: pgmap v1102: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 6 op/s 2023-05-08T04:16:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1947.602736 secs 2023-05-08T04:16:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1948.157203 secs 2023-05-08T04:16:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:48 smithi186 ceph-mon[126480]: pgmap v1102: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 6 op/s 2023-05-08T04:16:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1949.432986 secs 2023-05-08T04:16:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1949.432986 secs 2023-05-08T04:16:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1949.432986 secs 2023-05-08T04:16:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:50 smithi133 ceph-mon[125939]: pgmap v1103: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 8 op/s 2023-05-08T04:16:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:50 smithi096 ceph-mon[124666]: pgmap v1103: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 8 op/s 2023-05-08T04:16:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:50 smithi186 ceph-mon[126480]: pgmap v1103: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 8 op/s 2023-05-08T04:16:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:53 smithi133 ceph-mon[125939]: pgmap v1104: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:16:53.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1952.602875 secs 2023-05-08T04:16:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:53 smithi096 ceph-mon[124666]: pgmap v1104: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:16:54.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1952.602875 secs 2023-05-08T04:16:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:53 smithi186 ceph-mon[126480]: pgmap v1104: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:16:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1952.602875 secs 2023-05-08T04:16:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1953.157320 secs 2023-05-08T04:16:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1953.157320 secs 2023-05-08T04:16:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1953.157320 secs 2023-05-08T04:16:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:55 smithi133 ceph-mon[125939]: pgmap v1105: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:16:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1954.433069 secs 2023-05-08T04:16:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:55 smithi096 ceph-mon[124666]: pgmap v1105: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:16:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1954.433069 secs 2023-05-08T04:16:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:55 smithi186 ceph-mon[126480]: pgmap v1105: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:16:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1954.433069 secs 2023-05-08T04:16:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:57 smithi133 ceph-mon[125939]: pgmap v1106: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:16:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:57 smithi096 ceph-mon[124666]: pgmap v1106: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:16:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:57 smithi186 ceph-mon[126480]: pgmap v1106: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:16:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1957.602993 secs 2023-05-08T04:16:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1958.157433 secs 2023-05-08T04:16:59.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:16:58 smithi133 ceph-mon[125939]: pgmap v1107: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:16:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1957.602993 secs 2023-05-08T04:16:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1958.157433 secs 2023-05-08T04:16:59.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:16:58 smithi096 ceph-mon[124666]: pgmap v1107: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:16:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1957.602993 secs 2023-05-08T04:16:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1958.157433 secs 2023-05-08T04:16:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:16:58 smithi186 ceph-mon[126480]: pgmap v1107: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:17:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1959.433166 secs 2023-05-08T04:17:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1959.433166 secs 2023-05-08T04:17:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1959.433166 secs 2023-05-08T04:17:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:01 smithi186 ceph-mon[126480]: pgmap v1108: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:17:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:01 smithi133 ceph-mon[125939]: pgmap v1108: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:17:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:01 smithi096 ceph-mon[124666]: pgmap v1108: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:17:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:03 smithi133 ceph-mon[125939]: pgmap v1109: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T04:17:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1962.603115 secs 2023-05-08T04:17:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:03 smithi096 ceph-mon[124666]: pgmap v1109: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T04:17:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1962.603115 secs 2023-05-08T04:17:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:03 smithi186 ceph-mon[126480]: pgmap v1109: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T04:17:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1962.603115 secs 2023-05-08T04:17:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1963.157498 secs 2023-05-08T04:17:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1963.157498 secs 2023-05-08T04:17:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1963.157498 secs 2023-05-08T04:17:05.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:05 smithi133 ceph-mon[125939]: pgmap v1110: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:17:05.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1964.433252 secs 2023-05-08T04:17:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:05 smithi096 ceph-mon[124666]: pgmap v1110: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:17:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1964.433252 secs 2023-05-08T04:17:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:05 smithi186 ceph-mon[126480]: pgmap v1110: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:17:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1964.433252 secs 2023-05-08T04:17:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:06 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:17:06.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:06 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:17:06.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:06 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:17:06.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:06 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:17:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:06 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:17:07.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:06 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:17:07.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:06 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:17:07.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:06 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:17:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:06 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:17:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:06 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:17:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:06 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:17:07.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:06 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:17:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:07 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:17:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:07 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T04:17:07.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:07 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T04:17:07.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:07 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:17:07.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:07 smithi133 ceph-mon[125939]: pgmap v1111: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:17:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:07 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:17:08.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:07 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T04:17:08.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:07 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T04:17:08.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:07 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:17:08.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:07 smithi096 ceph-mon[124666]: pgmap v1111: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:17:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:07 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:17:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:07 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T04:17:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:07 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T04:17:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:07 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:17:08.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:07 smithi186 ceph-mon[126480]: pgmap v1111: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:17:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1967.603242 secs 2023-05-08T04:17:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1968.157615 secs 2023-05-08T04:17:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:08 smithi133 ceph-mon[125939]: pgmap v1112: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:17:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1967.603242 secs 2023-05-08T04:17:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1968.157615 secs 2023-05-08T04:17:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:08 smithi096 ceph-mon[124666]: pgmap v1112: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:17:09.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1967.603242 secs 2023-05-08T04:17:09.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1968.157615 secs 2023-05-08T04:17:09.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:08 smithi186 ceph-mon[126480]: pgmap v1112: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:17:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1969.433349 secs 2023-05-08T04:17:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1969.433349 secs 2023-05-08T04:17:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1969.433349 secs 2023-05-08T04:17:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:10 smithi133 ceph-mon[125939]: osdmap e150: 12 total, 12 up, 12 in 2023-05-08T04:17:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:10 smithi133 ceph-mon[125939]: pgmap v1114: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:17:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:10 smithi096 ceph-mon[124666]: osdmap e150: 12 total, 12 up, 12 in 2023-05-08T04:17:11.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:10 smithi096 ceph-mon[124666]: pgmap v1114: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:17:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:10 smithi186 ceph-mon[126480]: osdmap e150: 12 total, 12 up, 12 in 2023-05-08T04:17:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:10 smithi186 ceph-mon[126480]: pgmap v1114: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:17:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:13 smithi133 ceph-mon[125939]: pgmap v1115: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:17:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1972.603370 secs 2023-05-08T04:17:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:13 smithi096 ceph-mon[124666]: pgmap v1115: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:17:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1972.603370 secs 2023-05-08T04:17:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:13 smithi186 ceph-mon[126480]: pgmap v1115: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:17:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1972.603370 secs 2023-05-08T04:17:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1973.157707 secs 2023-05-08T04:17:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1973.157707 secs 2023-05-08T04:17:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1973.157707 secs 2023-05-08T04:17:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:15 smithi133 ceph-mon[125939]: pgmap v1116: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:17:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1974.433443 secs 2023-05-08T04:17:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:15 smithi096 ceph-mon[124666]: pgmap v1116: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:17:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1974.433443 secs 2023-05-08T04:17:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:15 smithi186 ceph-mon[126480]: pgmap v1116: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:17:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1974.433443 secs 2023-05-08T04:17:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:17 smithi133 ceph-mon[125939]: pgmap v1117: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:17:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:17 smithi096 ceph-mon[124666]: pgmap v1117: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:17:18.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:17 smithi186 ceph-mon[126480]: pgmap v1117: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:17:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1977.603458 secs 2023-05-08T04:17:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:18 smithi133 ceph-mon[125939]: osdmap e151: 12 total, 12 up, 12 in 2023-05-08T04:17:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1978.157773 secs 2023-05-08T04:17:19.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:18 smithi133 ceph-mon[125939]: pgmap v1119: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 118 B/s wr, 4 op/s 2023-05-08T04:17:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1977.603458 secs 2023-05-08T04:17:19.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:18 smithi096 ceph-mon[124666]: osdmap e151: 12 total, 12 up, 12 in 2023-05-08T04:17:19.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1978.157773 secs 2023-05-08T04:17:19.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:18 smithi096 ceph-mon[124666]: pgmap v1119: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 118 B/s wr, 4 op/s 2023-05-08T04:17:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1977.603458 secs 2023-05-08T04:17:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:18 smithi186 ceph-mon[126480]: osdmap e151: 12 total, 12 up, 12 in 2023-05-08T04:17:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1978.157773 secs 2023-05-08T04:17:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:18 smithi186 ceph-mon[126480]: pgmap v1119: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 118 B/s wr, 4 op/s 2023-05-08T04:17:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1979.433580 secs 2023-05-08T04:17:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1979.433580 secs 2023-05-08T04:17:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1979.433580 secs 2023-05-08T04:17:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:21 smithi186 ceph-mon[126480]: pgmap v1120: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:17:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:21 smithi133 ceph-mon[125939]: pgmap v1120: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:17:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:21 smithi096 ceph-mon[124666]: pgmap v1120: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:17:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:23 smithi133 ceph-mon[125939]: pgmap v1121: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:17:23.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1982.603575 secs 2023-05-08T04:17:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:23 smithi096 ceph-mon[124666]: pgmap v1121: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:17:24.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1982.603575 secs 2023-05-08T04:17:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:23 smithi186 ceph-mon[126480]: pgmap v1121: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:17:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1982.603575 secs 2023-05-08T04:17:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1983.157891 secs 2023-05-08T04:17:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1983.157891 secs 2023-05-08T04:17:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1983.157891 secs 2023-05-08T04:17:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:25 smithi133 ceph-mon[125939]: pgmap v1122: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:17:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1984.433721 secs 2023-05-08T04:17:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:25 smithi096 ceph-mon[124666]: pgmap v1122: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:17:26.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1984.433721 secs 2023-05-08T04:17:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:25 smithi186 ceph-mon[126480]: pgmap v1122: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:17:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1984.433721 secs 2023-05-08T04:17:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:27 smithi133 ceph-mon[125939]: pgmap v1123: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:17:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:27 smithi096 ceph-mon[124666]: pgmap v1123: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:17:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:27 smithi186 ceph-mon[126480]: pgmap v1123: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:17:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1987.603707 secs 2023-05-08T04:17:29.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1988.158028 secs 2023-05-08T04:17:29.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:28 smithi133 ceph-mon[125939]: pgmap v1124: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T04:17:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1987.603707 secs 2023-05-08T04:17:29.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1988.158028 secs 2023-05-08T04:17:29.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:28 smithi096 ceph-mon[124666]: pgmap v1124: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T04:17:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1987.603707 secs 2023-05-08T04:17:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1988.158028 secs 2023-05-08T04:17:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:28 smithi186 ceph-mon[126480]: pgmap v1124: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T04:17:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:31 smithi133 ceph-mon[125939]: pgmap v1125: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 25 KiB/s wr, 8 op/s 2023-05-08T04:17:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:31 smithi096 ceph-mon[124666]: pgmap v1125: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 25 KiB/s wr, 8 op/s 2023-05-08T04:17:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:31 smithi186 ceph-mon[126480]: pgmap v1125: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 25 KiB/s wr, 8 op/s 2023-05-08T04:17:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:33 smithi133 ceph-mon[125939]: pgmap v1126: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 25 KiB/s wr, 5 op/s 2023-05-08T04:17:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1992.603824 secs 2023-05-08T04:17:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:33 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:17:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:33 smithi096 ceph-mon[124666]: pgmap v1126: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 25 KiB/s wr, 5 op/s 2023-05-08T04:17:34.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1992.603824 secs 2023-05-08T04:17:34.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:33 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:17:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:33 smithi186 ceph-mon[126480]: pgmap v1126: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 25 KiB/s wr, 5 op/s 2023-05-08T04:17:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1992.603824 secs 2023-05-08T04:17:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:33 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:17:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1993.158154 secs 2023-05-08T04:17:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:34 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:17:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:34 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:17:34.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:34 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:17:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1993.158154 secs 2023-05-08T04:17:35.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:34 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:17:35.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:34 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:17:35.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:34 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:17:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1993.158154 secs 2023-05-08T04:17:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:34 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:17:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:34 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:17:35.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:34 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:17:35.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:35 smithi133 ceph-mon[125939]: pgmap v1127: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 64 KiB/s wr, 9 op/s 2023-05-08T04:17:35.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1994.433921 secs 2023-05-08T04:17:36.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:35 smithi096 ceph-mon[124666]: pgmap v1127: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 64 KiB/s wr, 9 op/s 2023-05-08T04:17:36.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1994.433921 secs 2023-05-08T04:17:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:35 smithi186 ceph-mon[126480]: pgmap v1127: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 64 KiB/s wr, 9 op/s 2023-05-08T04:17:36.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1994.433921 secs 2023-05-08T04:17:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:37 smithi133 ceph-mon[125939]: pgmap v1128: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 65 KiB/s wr, 7 op/s 2023-05-08T04:17:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:37 smithi096 ceph-mon[124666]: pgmap v1128: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 65 KiB/s wr, 7 op/s 2023-05-08T04:17:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:37 smithi186 ceph-mon[126480]: pgmap v1128: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 65 KiB/s wr, 7 op/s 2023-05-08T04:17:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:38 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:17:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:38 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:17:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1997.603981 secs 2023-05-08T04:17:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:38 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:17:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:38 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:17:39.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1997.603981 secs 2023-05-08T04:17:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:38 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:17:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:38 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:17:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1997.603981 secs 2023-05-08T04:17:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1998.158274 secs 2023-05-08T04:17:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:39 smithi133 ceph-mon[125939]: pgmap v1129: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 65 KiB/s wr, 7 op/s 2023-05-08T04:17:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1998.158274 secs 2023-05-08T04:17:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:39 smithi096 ceph-mon[124666]: pgmap v1129: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 65 KiB/s wr, 7 op/s 2023-05-08T04:17:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1998.158274 secs 2023-05-08T04:17:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:39 smithi186 ceph-mon[126480]: pgmap v1129: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 65 KiB/s wr, 7 op/s 2023-05-08T04:17:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 1999.434029 secs 2023-05-08T04:17:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 1999.434029 secs 2023-05-08T04:17:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 1999.434029 secs 2023-05-08T04:17:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:41 smithi133 ceph-mon[125939]: pgmap v1130: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 76 KiB/s wr, 11 op/s 2023-05-08T04:17:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:41 smithi096 ceph-mon[124666]: pgmap v1130: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 76 KiB/s wr, 11 op/s 2023-05-08T04:17:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:41 smithi186 ceph-mon[126480]: pgmap v1130: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 76 KiB/s wr, 11 op/s 2023-05-08T04:17:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:43 smithi133 ceph-mon[125939]: pgmap v1131: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 51 KiB/s wr, 7 op/s 2023-05-08T04:17:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2002.604055 secs 2023-05-08T04:17:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:43 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:17:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:43 smithi096 ceph-mon[124666]: pgmap v1131: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 51 KiB/s wr, 7 op/s 2023-05-08T04:17:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2002.604055 secs 2023-05-08T04:17:44.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:43 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:17:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:43 smithi186 ceph-mon[126480]: pgmap v1131: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 51 KiB/s wr, 7 op/s 2023-05-08T04:17:44.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2002.604055 secs 2023-05-08T04:17:44.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:43 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:17:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2003.158403 secs 2023-05-08T04:17:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2003.158403 secs 2023-05-08T04:17:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2003.158403 secs 2023-05-08T04:17:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:45 smithi133 ceph-mon[125939]: pgmap v1132: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 10 op/s 2023-05-08T04:17:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2004.434149 secs 2023-05-08T04:17:46.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:45 smithi096 ceph-mon[124666]: pgmap v1132: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 10 op/s 2023-05-08T04:17:46.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2004.434149 secs 2023-05-08T04:17:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:45 smithi186 ceph-mon[126480]: pgmap v1132: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 10 op/s 2023-05-08T04:17:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2004.434149 secs 2023-05-08T04:17:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:47 smithi133 ceph-mon[125939]: pgmap v1133: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 6 op/s 2023-05-08T04:17:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:47 smithi096 ceph-mon[124666]: pgmap v1133: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 6 op/s 2023-05-08T04:17:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:47 smithi186 ceph-mon[126480]: pgmap v1133: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 6 op/s 2023-05-08T04:17:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2007.604181 secs 2023-05-08T04:17:49.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2008.158509 secs 2023-05-08T04:17:49.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:48 smithi096 ceph-mon[124666]: pgmap v1134: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 6 op/s 2023-05-08T04:17:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2007.604181 secs 2023-05-08T04:17:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2008.158509 secs 2023-05-08T04:17:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:48 smithi186 ceph-mon[126480]: pgmap v1134: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 6 op/s 2023-05-08T04:17:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2007.604181 secs 2023-05-08T04:17:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2008.158509 secs 2023-05-08T04:17:49.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:48 smithi133 ceph-mon[125939]: pgmap v1134: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 6 op/s 2023-05-08T04:17:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2009.434282 secs 2023-05-08T04:17:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2009.434282 secs 2023-05-08T04:17:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2009.434282 secs 2023-05-08T04:17:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:51 smithi096 ceph-mon[124666]: pgmap v1135: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 8 op/s 2023-05-08T04:17:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:51 smithi186 ceph-mon[126480]: pgmap v1135: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 8 op/s 2023-05-08T04:17:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:51 smithi133 ceph-mon[125939]: pgmap v1135: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 8 op/s 2023-05-08T04:17:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:53 smithi133 ceph-mon[125939]: pgmap v1136: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:17:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2012.604305 secs 2023-05-08T04:17:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:53 smithi096 ceph-mon[124666]: pgmap v1136: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:17:54.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2012.604305 secs 2023-05-08T04:17:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:53 smithi186 ceph-mon[126480]: pgmap v1136: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:17:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2012.604305 secs 2023-05-08T04:17:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2013.158629 secs 2023-05-08T04:17:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2013.158629 secs 2023-05-08T04:17:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2013.158629 secs 2023-05-08T04:17:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:55 smithi133 ceph-mon[125939]: pgmap v1137: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:17:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2014.434373 secs 2023-05-08T04:17:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:55 smithi096 ceph-mon[124666]: pgmap v1137: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:17:56.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2014.434373 secs 2023-05-08T04:17:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:55 smithi186 ceph-mon[126480]: pgmap v1137: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:17:56.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2014.434373 secs 2023-05-08T04:17:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:57 smithi133 ceph-mon[125939]: pgmap v1138: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:17:58.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:57 smithi096 ceph-mon[124666]: pgmap v1138: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:17:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:57 smithi186 ceph-mon[126480]: pgmap v1138: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:17:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2017.604433 secs 2023-05-08T04:17:59.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2018.158747 secs 2023-05-08T04:17:59.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:58 smithi096 ceph-mon[124666]: pgmap v1139: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:17:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2017.604433 secs 2023-05-08T04:17:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2018.158747 secs 2023-05-08T04:17:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:58 smithi186 ceph-mon[126480]: pgmap v1139: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:17:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2017.604433 secs 2023-05-08T04:17:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2018.158747 secs 2023-05-08T04:17:59.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:58 smithi133 ceph-mon[125939]: pgmap v1139: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:18:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:17:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2019.434508 secs 2023-05-08T04:18:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:17:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2019.434508 secs 2023-05-08T04:18:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:17:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2019.434508 secs 2023-05-08T04:18:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:01 smithi096 ceph-mon[124666]: pgmap v1140: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:18:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:01 smithi186 ceph-mon[126480]: pgmap v1140: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:18:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:01 smithi133 ceph-mon[125939]: pgmap v1140: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:18:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:03 smithi133 ceph-mon[125939]: pgmap v1141: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:18:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2022.604572 secs 2023-05-08T04:18:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:03 smithi096 ceph-mon[124666]: pgmap v1141: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:18:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2022.604572 secs 2023-05-08T04:18:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:03 smithi186 ceph-mon[126480]: pgmap v1141: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:18:04.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2022.604572 secs 2023-05-08T04:18:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2023.158855 secs 2023-05-08T04:18:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2023.158855 secs 2023-05-08T04:18:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2023.158855 secs 2023-05-08T04:18:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:05 smithi133 ceph-mon[125939]: pgmap v1142: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:18:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2024.434605 secs 2023-05-08T04:18:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:05 smithi096 ceph-mon[124666]: pgmap v1142: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:18:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2024.434605 secs 2023-05-08T04:18:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:05 smithi186 ceph-mon[126480]: pgmap v1142: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:18:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2024.434605 secs 2023-05-08T04:18:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:06 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:18:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:06 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:18:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:06 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:18:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:07 smithi133 ceph-mon[125939]: pgmap v1143: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:18:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:07 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:18:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:07 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:18:07.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:07 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:18:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:07 smithi096 ceph-mon[124666]: pgmap v1143: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:18:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:07 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:18:08.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:07 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:18:08.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:07 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:18:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:07 smithi186 ceph-mon[126480]: pgmap v1143: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:18:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:07 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:18:08.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:07 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:18:08.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:07 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:18:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:08 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:18:08.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:08 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T04:18:08.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:08 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T04:18:08.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:08 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:18:08.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2027.604702 secs 2023-05-08T04:18:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:08 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:18:09.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:08 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T04:18:09.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:08 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T04:18:09.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:08 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:18:09.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2027.604702 secs 2023-05-08T04:18:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:08 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:18:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:08 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T04:18:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:08 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T04:18:09.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:08 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:18:09.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2027.604702 secs 2023-05-08T04:18:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2028.158953 secs 2023-05-08T04:18:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:09 smithi133 ceph-mon[125939]: pgmap v1144: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:18:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2028.158953 secs 2023-05-08T04:18:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:09 smithi096 ceph-mon[124666]: pgmap v1144: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:18:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2028.158953 secs 2023-05-08T04:18:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:09 smithi186 ceph-mon[126480]: pgmap v1144: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:18:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2029.434723 secs 2023-05-08T04:18:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:10 smithi133 ceph-mon[125939]: osdmap e152: 12 total, 12 up, 12 in 2023-05-08T04:18:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2029.434723 secs 2023-05-08T04:18:11.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:10 smithi096 ceph-mon[124666]: osdmap e152: 12 total, 12 up, 12 in 2023-05-08T04:18:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2029.434723 secs 2023-05-08T04:18:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:10 smithi186 ceph-mon[126480]: osdmap e152: 12 total, 12 up, 12 in 2023-05-08T04:18:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:11 smithi133 ceph-mon[125939]: pgmap v1146: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:18:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:11 smithi096 ceph-mon[124666]: pgmap v1146: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:18:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:11 smithi186 ceph-mon[126480]: pgmap v1146: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:18:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:13 smithi133 ceph-mon[125939]: pgmap v1147: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:18:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2032.604828 secs 2023-05-08T04:18:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:13 smithi096 ceph-mon[124666]: pgmap v1147: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:18:14.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2032.604828 secs 2023-05-08T04:18:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:13 smithi186 ceph-mon[126480]: pgmap v1147: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:18:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2032.604828 secs 2023-05-08T04:18:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2033.159091 secs 2023-05-08T04:18:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2033.159091 secs 2023-05-08T04:18:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2033.159091 secs 2023-05-08T04:18:15.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:15 smithi133 ceph-mon[125939]: pgmap v1148: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:18:15.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2034.434827 secs 2023-05-08T04:18:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:15 smithi096 ceph-mon[124666]: pgmap v1148: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:18:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2034.434827 secs 2023-05-08T04:18:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:15 smithi186 ceph-mon[126480]: pgmap v1148: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:18:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2034.434827 secs 2023-05-08T04:18:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:17 smithi133 ceph-mon[125939]: pgmap v1149: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:18:18.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:17 smithi096 ceph-mon[124666]: pgmap v1149: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:18:18.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:17 smithi186 ceph-mon[126480]: pgmap v1149: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:18:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2037.604977 secs 2023-05-08T04:18:19.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:18 smithi096 ceph-mon[124666]: osdmap e153: 12 total, 12 up, 12 in 2023-05-08T04:18:19.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2038.159233 secs 2023-05-08T04:18:19.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:18 smithi096 ceph-mon[124666]: pgmap v1151: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 118 B/s wr, 4 op/s 2023-05-08T04:18:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2037.604977 secs 2023-05-08T04:18:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:18 smithi186 ceph-mon[126480]: osdmap e153: 12 total, 12 up, 12 in 2023-05-08T04:18:19.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2038.159233 secs 2023-05-08T04:18:19.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:18 smithi186 ceph-mon[126480]: pgmap v1151: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 118 B/s wr, 4 op/s 2023-05-08T04:18:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2037.604977 secs 2023-05-08T04:18:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:18 smithi133 ceph-mon[125939]: osdmap e153: 12 total, 12 up, 12 in 2023-05-08T04:18:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2038.159233 secs 2023-05-08T04:18:19.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:18 smithi133 ceph-mon[125939]: pgmap v1151: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 118 B/s wr, 4 op/s 2023-05-08T04:18:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2039.434965 secs 2023-05-08T04:18:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2039.434965 secs 2023-05-08T04:18:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2039.434965 secs 2023-05-08T04:18:21.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:21 smithi186 ceph-mon[126480]: pgmap v1152: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:18:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:21 smithi133 ceph-mon[125939]: pgmap v1152: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:18:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:21 smithi096 ceph-mon[124666]: pgmap v1152: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:18:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:23 smithi133 ceph-mon[125939]: pgmap v1153: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:18:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2042.605116 secs 2023-05-08T04:18:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:23 smithi096 ceph-mon[124666]: pgmap v1153: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:18:24.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2042.605116 secs 2023-05-08T04:18:24.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:23 smithi186 ceph-mon[126480]: pgmap v1153: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:18:24.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2042.605116 secs 2023-05-08T04:18:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2043.159366 secs 2023-05-08T04:18:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2043.159366 secs 2023-05-08T04:18:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2043.159366 secs 2023-05-08T04:18:25.713 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:25 smithi096 ceph-mon[124666]: pgmap v1154: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:18:25.713 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2044.435118 secs 2023-05-08T04:18:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:25 smithi133 ceph-mon[125939]: pgmap v1154: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:18:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2044.435118 secs 2023-05-08T04:18:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:25 smithi186 ceph-mon[126480]: pgmap v1154: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:18:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2044.435118 secs 2023-05-08T04:18:27.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:27 smithi133 ceph-mon[125939]: pgmap v1155: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:18:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:27 smithi096 ceph-mon[124666]: pgmap v1155: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:18:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:27 smithi186 ceph-mon[126480]: pgmap v1155: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:18:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2047.605239 secs 2023-05-08T04:18:29.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2048.159501 secs 2023-05-08T04:18:29.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:29 smithi096 ceph-mon[124666]: pgmap v1156: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T04:18:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2047.605239 secs 2023-05-08T04:18:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2048.159501 secs 2023-05-08T04:18:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:29 smithi186 ceph-mon[126480]: pgmap v1156: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T04:18:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2047.605239 secs 2023-05-08T04:18:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2048.159501 secs 2023-05-08T04:18:29.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:29 smithi133 ceph-mon[125939]: pgmap v1156: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T04:18:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:31 smithi133 ceph-mon[125939]: pgmap v1157: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 25 KiB/s wr, 8 op/s 2023-05-08T04:18:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:31 smithi096 ceph-mon[124666]: pgmap v1157: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 25 KiB/s wr, 8 op/s 2023-05-08T04:18:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:31 smithi186 ceph-mon[126480]: pgmap v1157: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 25 KiB/s wr, 8 op/s 2023-05-08T04:18:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:33 smithi133 ceph-mon[125939]: pgmap v1158: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 25 KiB/s wr, 5 op/s 2023-05-08T04:18:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2052.605380 secs 2023-05-08T04:18:33.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:33 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:18:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:33 smithi096 ceph-mon[124666]: pgmap v1158: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 25 KiB/s wr, 5 op/s 2023-05-08T04:18:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2052.605380 secs 2023-05-08T04:18:34.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:33 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:18:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:33 smithi186 ceph-mon[126480]: pgmap v1158: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 25 KiB/s wr, 5 op/s 2023-05-08T04:18:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2052.605380 secs 2023-05-08T04:18:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:33 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:18:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2053.159614 secs 2023-05-08T04:18:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:34 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:18:34.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:34 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:18:34.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:34 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:18:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2053.159614 secs 2023-05-08T04:18:35.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:34 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:18:35.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:34 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:18:35.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:34 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:18:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2053.159614 secs 2023-05-08T04:18:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:34 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:18:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:34 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:18:35.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:34 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:18:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:35 smithi133 ceph-mon[125939]: pgmap v1159: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 65 KiB/s wr, 9 op/s 2023-05-08T04:18:35.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2054.435315 secs 2023-05-08T04:18:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:35 smithi096 ceph-mon[124666]: pgmap v1159: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 65 KiB/s wr, 9 op/s 2023-05-08T04:18:36.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2054.435315 secs 2023-05-08T04:18:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:35 smithi186 ceph-mon[126480]: pgmap v1159: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 65 KiB/s wr, 9 op/s 2023-05-08T04:18:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2054.435315 secs 2023-05-08T04:18:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:37 smithi133 ceph-mon[125939]: pgmap v1160: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 65 KiB/s wr, 7 op/s 2023-05-08T04:18:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:37 smithi096 ceph-mon[124666]: pgmap v1160: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 65 KiB/s wr, 7 op/s 2023-05-08T04:18:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:37 smithi186 ceph-mon[126480]: pgmap v1160: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 65 KiB/s wr, 7 op/s 2023-05-08T04:18:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:38 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:18:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:38 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:18:38.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2057.605502 secs 2023-05-08T04:18:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:38 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:18:39.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:38 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:18:39.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2057.605502 secs 2023-05-08T04:18:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:38 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:18:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:38 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:18:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2057.605502 secs 2023-05-08T04:18:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2058.159737 secs 2023-05-08T04:18:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:39 smithi133 ceph-mon[125939]: pgmap v1161: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 65 KiB/s wr, 7 op/s 2023-05-08T04:18:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2058.159737 secs 2023-05-08T04:18:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:39 smithi096 ceph-mon[124666]: pgmap v1161: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 65 KiB/s wr, 7 op/s 2023-05-08T04:18:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2058.159737 secs 2023-05-08T04:18:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:39 smithi186 ceph-mon[126480]: pgmap v1161: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 65 KiB/s wr, 7 op/s 2023-05-08T04:18:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2059.435430 secs 2023-05-08T04:18:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2059.435430 secs 2023-05-08T04:18:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2059.435430 secs 2023-05-08T04:18:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:41 smithi133 ceph-mon[125939]: pgmap v1162: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 88 KiB/s wr, 11 op/s 2023-05-08T04:18:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:41 smithi096 ceph-mon[124666]: pgmap v1162: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 88 KiB/s wr, 11 op/s 2023-05-08T04:18:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:41 smithi186 ceph-mon[126480]: pgmap v1162: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 88 KiB/s wr, 11 op/s 2023-05-08T04:18:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:43 smithi133 ceph-mon[125939]: pgmap v1163: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 63 KiB/s wr, 8 op/s 2023-05-08T04:18:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2062.605614 secs 2023-05-08T04:18:43.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:43 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:18:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:43 smithi096 ceph-mon[124666]: pgmap v1163: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 63 KiB/s wr, 8 op/s 2023-05-08T04:18:44.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2062.605614 secs 2023-05-08T04:18:44.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:43 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:18:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:43 smithi186 ceph-mon[126480]: pgmap v1163: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 63 KiB/s wr, 8 op/s 2023-05-08T04:18:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2062.605614 secs 2023-05-08T04:18:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:43 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:18:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2063.159890 secs 2023-05-08T04:18:45.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2063.159890 secs 2023-05-08T04:18:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2063.159890 secs 2023-05-08T04:18:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:45 smithi133 ceph-mon[125939]: pgmap v1164: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 63 KiB/s wr, 11 op/s 2023-05-08T04:18:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2064.435555 secs 2023-05-08T04:18:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:45 smithi096 ceph-mon[124666]: pgmap v1164: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 63 KiB/s wr, 11 op/s 2023-05-08T04:18:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2064.435555 secs 2023-05-08T04:18:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:45 smithi186 ceph-mon[126480]: pgmap v1164: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 63 KiB/s wr, 11 op/s 2023-05-08T04:18:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2064.435555 secs 2023-05-08T04:18:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:47 smithi133 ceph-mon[125939]: pgmap v1165: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 7 op/s 2023-05-08T04:18:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:47 smithi096 ceph-mon[124666]: pgmap v1165: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 7 op/s 2023-05-08T04:18:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:47 smithi186 ceph-mon[126480]: pgmap v1165: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 7 op/s 2023-05-08T04:18:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2067.605742 secs 2023-05-08T04:18:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2068.159986 secs 2023-05-08T04:18:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:49 smithi186 ceph-mon[126480]: pgmap v1166: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 23 KiB/s wr, 7 op/s 2023-05-08T04:18:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2067.605742 secs 2023-05-08T04:18:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2068.159986 secs 2023-05-08T04:18:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:49 smithi133 ceph-mon[125939]: pgmap v1166: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 23 KiB/s wr, 7 op/s 2023-05-08T04:18:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2067.605742 secs 2023-05-08T04:18:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2068.159986 secs 2023-05-08T04:18:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:49 smithi096 ceph-mon[124666]: pgmap v1166: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 23 KiB/s wr, 7 op/s 2023-05-08T04:18:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2069.435653 secs 2023-05-08T04:18:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2069.435653 secs 2023-05-08T04:18:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2069.435653 secs 2023-05-08T04:18:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:51 smithi186 ceph-mon[126480]: pgmap v1167: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 23 KiB/s wr, 10 op/s 2023-05-08T04:18:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:51 smithi133 ceph-mon[125939]: pgmap v1167: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 23 KiB/s wr, 10 op/s 2023-05-08T04:18:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:51 smithi096 ceph-mon[124666]: pgmap v1167: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 23 KiB/s wr, 10 op/s 2023-05-08T04:18:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:53 smithi133 ceph-mon[125939]: pgmap v1168: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2023-05-08T04:18:53.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2072.605821 secs 2023-05-08T04:18:54.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:53 smithi096 ceph-mon[124666]: pgmap v1168: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2023-05-08T04:18:54.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2072.605821 secs 2023-05-08T04:18:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:53 smithi186 ceph-mon[126480]: pgmap v1168: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2023-05-08T04:18:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2072.605821 secs 2023-05-08T04:18:54.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2073.160116 secs 2023-05-08T04:18:55.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2073.160116 secs 2023-05-08T04:18:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2073.160116 secs 2023-05-08T04:18:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:55 smithi133 ceph-mon[125939]: pgmap v1169: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 8 op/s 2023-05-08T04:18:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2074.435791 secs 2023-05-08T04:18:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:55 smithi096 ceph-mon[124666]: pgmap v1169: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 8 op/s 2023-05-08T04:18:56.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2074.435791 secs 2023-05-08T04:18:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:55 smithi186 ceph-mon[126480]: pgmap v1169: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 8 op/s 2023-05-08T04:18:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2074.435791 secs 2023-05-08T04:18:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:57 smithi133 ceph-mon[125939]: pgmap v1170: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:18:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:57 smithi096 ceph-mon[124666]: pgmap v1170: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:18:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:57 smithi186 ceph-mon[126480]: pgmap v1170: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:18:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2077.605883 secs 2023-05-08T04:18:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2078.160197 secs 2023-05-08T04:18:59.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:18:59 smithi186 ceph-mon[126480]: pgmap v1171: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:18:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2077.605883 secs 2023-05-08T04:18:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2078.160197 secs 2023-05-08T04:18:59.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:18:59 smithi133 ceph-mon[125939]: pgmap v1171: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:18:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2077.605883 secs 2023-05-08T04:18:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2078.160197 secs 2023-05-08T04:18:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:18:59 smithi096 ceph-mon[124666]: pgmap v1171: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:19:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2079.435889 secs 2023-05-08T04:19:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2079.435889 secs 2023-05-08T04:19:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2079.435889 secs 2023-05-08T04:19:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:01 smithi186 ceph-mon[126480]: pgmap v1172: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T04:19:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:01 smithi133 ceph-mon[125939]: pgmap v1172: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T04:19:01.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:01 smithi096 ceph-mon[124666]: pgmap v1172: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T04:19:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:03 smithi133 ceph-mon[125939]: pgmap v1173: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:19:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2082.606016 secs 2023-05-08T04:19:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:03 smithi096 ceph-mon[124666]: pgmap v1173: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:19:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2082.606016 secs 2023-05-08T04:19:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:03 smithi186 ceph-mon[126480]: pgmap v1173: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:19:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2082.606016 secs 2023-05-08T04:19:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2083.160327 secs 2023-05-08T04:19:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2083.160327 secs 2023-05-08T04:19:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2083.160327 secs 2023-05-08T04:19:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:05 smithi133 ceph-mon[125939]: pgmap v1174: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-05-08T04:19:05.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2084.435997 secs 2023-05-08T04:19:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:05 smithi096 ceph-mon[124666]: pgmap v1174: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-05-08T04:19:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2084.435997 secs 2023-05-08T04:19:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:05 smithi186 ceph-mon[126480]: pgmap v1174: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-05-08T04:19:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2084.435997 secs 2023-05-08T04:19:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:07 smithi133 ceph-mon[125939]: pgmap v1175: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 20 op/s 2023-05-08T04:19:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:07 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:19:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:07 smithi096 ceph-mon[124666]: pgmap v1175: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 20 op/s 2023-05-08T04:19:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:07 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:19:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:07 smithi186 ceph-mon[126480]: pgmap v1175: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 20 op/s 2023-05-08T04:19:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:07 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:19:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2087.606129 secs 2023-05-08T04:19:09.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:09 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:19:09.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:09 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:19:09.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:09 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:19:09.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:09 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:19:09.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:09 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T04:19:09.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:09 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T04:19:09.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:09 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:19:09.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2088.160486 secs 2023-05-08T04:19:09.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:09 smithi186 ceph-mon[126480]: pgmap v1176: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 20 op/s 2023-05-08T04:19:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2087.606129 secs 2023-05-08T04:19:09.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:09 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:19:09.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:09 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:19:09.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:09 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:19:09.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:09 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:19:09.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:09 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T04:19:09.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:09 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T04:19:09.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:09 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:19:09.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2088.160486 secs 2023-05-08T04:19:09.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:09 smithi133 ceph-mon[125939]: pgmap v1176: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 20 op/s 2023-05-08T04:19:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2087.606129 secs 2023-05-08T04:19:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:09 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:19:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:09 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:19:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:09 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:19:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:09 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:19:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:09 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T04:19:09.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:09 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T04:19:09.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:09 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:19:09.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2088.160486 secs 2023-05-08T04:19:09.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:09 smithi096 ceph-mon[124666]: pgmap v1176: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 20 op/s 2023-05-08T04:19:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2089.436116 secs 2023-05-08T04:19:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2089.436116 secs 2023-05-08T04:19:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2089.436116 secs 2023-05-08T04:19:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:11 smithi133 ceph-mon[125939]: osdmap e154: 12 total, 12 up, 12 in 2023-05-08T04:19:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:11 smithi133 ceph-mon[125939]: pgmap v1178: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T04:19:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:11 smithi096 ceph-mon[124666]: osdmap e154: 12 total, 12 up, 12 in 2023-05-08T04:19:11.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:11 smithi096 ceph-mon[124666]: pgmap v1178: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T04:19:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:11 smithi186 ceph-mon[126480]: osdmap e154: 12 total, 12 up, 12 in 2023-05-08T04:19:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:11 smithi186 ceph-mon[126480]: pgmap v1178: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T04:19:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:13 smithi133 ceph-mon[125939]: pgmap v1179: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T04:19:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2092.606277 secs 2023-05-08T04:19:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:13 smithi096 ceph-mon[124666]: pgmap v1179: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T04:19:14.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2092.606277 secs 2023-05-08T04:19:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:13 smithi186 ceph-mon[126480]: pgmap v1179: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T04:19:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2092.606277 secs 2023-05-08T04:19:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2093.160603 secs 2023-05-08T04:19:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2093.160603 secs 2023-05-08T04:19:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2093.160603 secs 2023-05-08T04:19:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:15 smithi133 ceph-mon[125939]: pgmap v1180: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:19:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2094.436249 secs 2023-05-08T04:19:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:15 smithi096 ceph-mon[124666]: pgmap v1180: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:19:16.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2094.436249 secs 2023-05-08T04:19:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:15 smithi186 ceph-mon[126480]: pgmap v1180: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:19:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2094.436249 secs 2023-05-08T04:19:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:17 smithi133 ceph-mon[125939]: pgmap v1181: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:19:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:17 smithi096 ceph-mon[124666]: pgmap v1181: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:19:18.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:17 smithi186 ceph-mon[126480]: pgmap v1181: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:19:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2097.606404 secs 2023-05-08T04:19:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:19 smithi186 ceph-mon[126480]: osdmap e155: 12 total, 12 up, 12 in 2023-05-08T04:19:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2098.160760 secs 2023-05-08T04:19:19.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:19 smithi186 ceph-mon[126480]: pgmap v1183: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 119 B/s wr, 3 op/s 2023-05-08T04:19:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2097.606404 secs 2023-05-08T04:19:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:19 smithi133 ceph-mon[125939]: osdmap e155: 12 total, 12 up, 12 in 2023-05-08T04:19:19.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2098.160760 secs 2023-05-08T04:19:19.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:19 smithi133 ceph-mon[125939]: pgmap v1183: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 119 B/s wr, 3 op/s 2023-05-08T04:19:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2097.606404 secs 2023-05-08T04:19:19.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:19 smithi096 ceph-mon[124666]: osdmap e155: 12 total, 12 up, 12 in 2023-05-08T04:19:19.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2098.160760 secs 2023-05-08T04:19:19.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:19 smithi096 ceph-mon[124666]: pgmap v1183: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 119 B/s wr, 3 op/s 2023-05-08T04:19:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2099.436370 secs 2023-05-08T04:19:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2099.436370 secs 2023-05-08T04:19:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2099.436370 secs 2023-05-08T04:19:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:21 smithi186 ceph-mon[126480]: pgmap v1184: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:19:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:21 smithi133 ceph-mon[125939]: pgmap v1184: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:19:21.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:21 smithi096 ceph-mon[124666]: pgmap v1184: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:19:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:23 smithi133 ceph-mon[125939]: pgmap v1185: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:19:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2102.606503 secs 2023-05-08T04:19:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:23 smithi096 ceph-mon[124666]: pgmap v1185: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:19:24.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2102.606503 secs 2023-05-08T04:19:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:23 smithi186 ceph-mon[126480]: pgmap v1185: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:19:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2102.606503 secs 2023-05-08T04:19:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2103.160879 secs 2023-05-08T04:19:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2103.160879 secs 2023-05-08T04:19:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2103.160879 secs 2023-05-08T04:19:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:25 smithi133 ceph-mon[125939]: pgmap v1186: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:19:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2104.436467 secs 2023-05-08T04:19:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:25 smithi096 ceph-mon[124666]: pgmap v1186: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:19:26.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2104.436467 secs 2023-05-08T04:19:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:25 smithi186 ceph-mon[126480]: pgmap v1186: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:19:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2104.436467 secs 2023-05-08T04:19:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:27 smithi133 ceph-mon[125939]: pgmap v1187: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:19:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:27 smithi096 ceph-mon[124666]: pgmap v1187: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:19:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:27 smithi186 ceph-mon[126480]: pgmap v1187: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:19:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2107.606626 secs 2023-05-08T04:19:29.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2108.160988 secs 2023-05-08T04:19:29.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:29 smithi186 ceph-mon[126480]: pgmap v1188: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T04:19:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2107.606626 secs 2023-05-08T04:19:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2108.160988 secs 2023-05-08T04:19:29.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:29 smithi133 ceph-mon[125939]: pgmap v1188: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T04:19:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2107.606626 secs 2023-05-08T04:19:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2108.160988 secs 2023-05-08T04:19:29.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:29 smithi096 ceph-mon[124666]: pgmap v1188: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T04:19:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:31 smithi133 ceph-mon[125939]: pgmap v1189: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 28 KiB/s wr, 8 op/s 2023-05-08T04:19:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:31 smithi096 ceph-mon[124666]: pgmap v1189: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 28 KiB/s wr, 8 op/s 2023-05-08T04:19:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:31 smithi186 ceph-mon[126480]: pgmap v1189: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 28 KiB/s wr, 8 op/s 2023-05-08T04:19:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:33 smithi133 ceph-mon[125939]: pgmap v1190: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 28 KiB/s wr, 5 op/s 2023-05-08T04:19:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2112.606745 secs 2023-05-08T04:19:33.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:33 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:19:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:33 smithi096 ceph-mon[124666]: pgmap v1190: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 28 KiB/s wr, 5 op/s 2023-05-08T04:19:34.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2112.606745 secs 2023-05-08T04:19:34.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:33 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:19:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:33 smithi186 ceph-mon[126480]: pgmap v1190: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 28 KiB/s wr, 5 op/s 2023-05-08T04:19:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2112.606745 secs 2023-05-08T04:19:34.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:33 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:19:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2113.161125 secs 2023-05-08T04:19:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:34 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:19:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:34 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:19:34.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:34 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:19:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2113.161125 secs 2023-05-08T04:19:35.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:34 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:19:35.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:34 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:19:35.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:34 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:19:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2113.161125 secs 2023-05-08T04:19:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:34 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:19:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:34 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:19:35.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:34 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:19:35.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:35 smithi133 ceph-mon[125939]: pgmap v1191: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 67 KiB/s wr, 9 op/s 2023-05-08T04:19:35.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2114.436688 secs 2023-05-08T04:19:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:35 smithi096 ceph-mon[124666]: pgmap v1191: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 67 KiB/s wr, 9 op/s 2023-05-08T04:19:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2114.436688 secs 2023-05-08T04:19:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:35 smithi186 ceph-mon[126480]: pgmap v1191: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 67 KiB/s wr, 9 op/s 2023-05-08T04:19:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2114.436688 secs 2023-05-08T04:19:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:37 smithi096 ceph-mon[124666]: pgmap v1192: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 67 KiB/s wr, 7 op/s 2023-05-08T04:19:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:37 smithi186 ceph-mon[126480]: pgmap v1192: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 67 KiB/s wr, 7 op/s 2023-05-08T04:19:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:37 smithi133 ceph-mon[125939]: pgmap v1192: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 67 KiB/s wr, 7 op/s 2023-05-08T04:19:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:38 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:19:39.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:38 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:19:39.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2117.606874 secs 2023-05-08T04:19:39.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2118.161292 secs 2023-05-08T04:19:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:38 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:19:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:38 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:19:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2117.606874 secs 2023-05-08T04:19:39.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2118.161292 secs 2023-05-08T04:19:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:38 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:19:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:38 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:19:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2117.606874 secs 2023-05-08T04:19:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2118.161292 secs 2023-05-08T04:19:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:39 smithi096 ceph-mon[124666]: pgmap v1193: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 67 KiB/s wr, 7 op/s 2023-05-08T04:19:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:39 smithi186 ceph-mon[126480]: pgmap v1193: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 67 KiB/s wr, 7 op/s 2023-05-08T04:19:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:39 smithi133 ceph-mon[125939]: pgmap v1193: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 67 KiB/s wr, 7 op/s 2023-05-08T04:19:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2119.436835 secs 2023-05-08T04:19:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2119.436835 secs 2023-05-08T04:19:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2119.436835 secs 2023-05-08T04:19:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:41 smithi096 ceph-mon[124666]: pgmap v1194: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 81 KiB/s wr, 11 op/s 2023-05-08T04:19:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:41 smithi186 ceph-mon[126480]: pgmap v1194: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 81 KiB/s wr, 11 op/s 2023-05-08T04:19:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:41 smithi133 ceph-mon[125939]: pgmap v1194: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 81 KiB/s wr, 11 op/s 2023-05-08T04:19:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:43 smithi096 ceph-mon[124666]: pgmap v1195: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 53 KiB/s wr, 7 op/s 2023-05-08T04:19:44.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2122.606976 secs 2023-05-08T04:19:44.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:43 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:19:44.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2123.161431 secs 2023-05-08T04:19:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:43 smithi186 ceph-mon[126480]: pgmap v1195: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 53 KiB/s wr, 7 op/s 2023-05-08T04:19:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2122.606976 secs 2023-05-08T04:19:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:43 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:19:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2123.161431 secs 2023-05-08T04:19:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:43 smithi133 ceph-mon[125939]: pgmap v1195: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 53 KiB/s wr, 7 op/s 2023-05-08T04:19:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2122.606976 secs 2023-05-08T04:19:44.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:43 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:19:44.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2123.161431 secs 2023-05-08T04:19:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:45 smithi186 ceph-mon[126480]: pgmap v1196: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 53 KiB/s wr, 10 op/s 2023-05-08T04:19:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2124.436951 secs 2023-05-08T04:19:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:45 smithi133 ceph-mon[125939]: pgmap v1196: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 53 KiB/s wr, 10 op/s 2023-05-08T04:19:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2124.436951 secs 2023-05-08T04:19:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:45 smithi096 ceph-mon[124666]: pgmap v1196: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 53 KiB/s wr, 10 op/s 2023-05-08T04:19:46.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2124.436951 secs 2023-05-08T04:19:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:47 smithi186 ceph-mon[126480]: pgmap v1197: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 6 op/s 2023-05-08T04:19:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:47 smithi133 ceph-mon[125939]: pgmap v1197: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 6 op/s 2023-05-08T04:19:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:47 smithi096 ceph-mon[124666]: pgmap v1197: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 6 op/s 2023-05-08T04:19:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2127.607087 secs 2023-05-08T04:19:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2128.161532 secs 2023-05-08T04:19:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:49 smithi186 ceph-mon[126480]: pgmap v1198: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 6 op/s 2023-05-08T04:19:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2127.607087 secs 2023-05-08T04:19:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2128.161532 secs 2023-05-08T04:19:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:49 smithi133 ceph-mon[125939]: pgmap v1198: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 6 op/s 2023-05-08T04:19:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2127.607087 secs 2023-05-08T04:19:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2128.161532 secs 2023-05-08T04:19:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:49 smithi096 ceph-mon[124666]: pgmap v1198: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 6 op/s 2023-05-08T04:19:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2129.437088 secs 2023-05-08T04:19:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2129.437088 secs 2023-05-08T04:19:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2129.437088 secs 2023-05-08T04:19:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:51 smithi186 ceph-mon[126480]: pgmap v1199: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 8 op/s 2023-05-08T04:19:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:51 smithi133 ceph-mon[125939]: pgmap v1199: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 8 op/s 2023-05-08T04:19:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:51 smithi096 ceph-mon[124666]: pgmap v1199: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 8 op/s 2023-05-08T04:19:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:53 smithi133 ceph-mon[125939]: pgmap v1200: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2023-05-08T04:19:53.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2132.607211 secs 2023-05-08T04:19:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:53 smithi096 ceph-mon[124666]: pgmap v1200: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2023-05-08T04:19:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2132.607211 secs 2023-05-08T04:19:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:53 smithi186 ceph-mon[126480]: pgmap v1200: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2023-05-08T04:19:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2132.607211 secs 2023-05-08T04:19:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2133.161653 secs 2023-05-08T04:19:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2133.161653 secs 2023-05-08T04:19:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2133.161653 secs 2023-05-08T04:19:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:55 smithi096 ceph-mon[124666]: pgmap v1201: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 7 op/s 2023-05-08T04:19:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2134.437186 secs 2023-05-08T04:19:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:55 smithi186 ceph-mon[126480]: pgmap v1201: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 7 op/s 2023-05-08T04:19:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2134.437186 secs 2023-05-08T04:19:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:55 smithi133 ceph-mon[125939]: pgmap v1201: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 7 op/s 2023-05-08T04:19:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2134.437186 secs 2023-05-08T04:19:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:57 smithi096 ceph-mon[124666]: pgmap v1202: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:19:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:57 smithi186 ceph-mon[126480]: pgmap v1202: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:19:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:57 smithi133 ceph-mon[125939]: pgmap v1202: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:19:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2137.607348 secs 2023-05-08T04:19:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2138.161769 secs 2023-05-08T04:19:59.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:19:59 smithi186 ceph-mon[126480]: pgmap v1203: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:19:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2137.607348 secs 2023-05-08T04:19:59.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2138.161769 secs 2023-05-08T04:19:59.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:19:59 smithi133 ceph-mon[125939]: pgmap v1203: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:19:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2137.607348 secs 2023-05-08T04:19:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2138.161769 secs 2023-05-08T04:19:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:19:59 smithi096 ceph-mon[124666]: pgmap v1203: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:20:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2139.437301 secs 2023-05-08T04:20:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:00 smithi186 ceph-mon[126480]: overall HEALTH_WARN 3 MDSs report slow requests 2023-05-08T04:20:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2139.437301 secs 2023-05-08T04:20:00.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:00 smithi133 ceph-mon[125939]: overall HEALTH_WARN 3 MDSs report slow requests 2023-05-08T04:20:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2139.437301 secs 2023-05-08T04:20:00.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:00 smithi096 ceph-mon[124666]: overall HEALTH_WARN 3 MDSs report slow requests 2023-05-08T04:20:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:01 smithi186 ceph-mon[126480]: pgmap v1204: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:20:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:01 smithi133 ceph-mon[125939]: pgmap v1204: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:20:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:01 smithi096 ceph-mon[124666]: pgmap v1204: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:20:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:03 smithi133 ceph-mon[125939]: pgmap v1205: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:20:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2142.607449 secs 2023-05-08T04:20:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:03 smithi096 ceph-mon[124666]: pgmap v1205: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:20:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2142.607449 secs 2023-05-08T04:20:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:03 smithi186 ceph-mon[126480]: pgmap v1205: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:20:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2142.607449 secs 2023-05-08T04:20:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2143.161920 secs 2023-05-08T04:20:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2143.161920 secs 2023-05-08T04:20:05.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2143.161920 secs 2023-05-08T04:20:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:05 smithi096 ceph-mon[124666]: pgmap v1206: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:20:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2144.437366 secs 2023-05-08T04:20:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:05 smithi186 ceph-mon[126480]: pgmap v1206: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:20:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2144.437366 secs 2023-05-08T04:20:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:05 smithi133 ceph-mon[125939]: pgmap v1206: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:20:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2144.437366 secs 2023-05-08T04:20:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:07 smithi096 ceph-mon[124666]: pgmap v1207: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:20:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:07 smithi186 ceph-mon[126480]: pgmap v1207: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:20:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:07 smithi133 ceph-mon[125939]: pgmap v1207: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:20:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2147.607502 secs 2023-05-08T04:20:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:09 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:20:09.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2148.161984 secs 2023-05-08T04:20:09.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:09 smithi186 ceph-mon[126480]: pgmap v1208: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:20:09.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:09 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:20:09.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:09 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:20:09.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:09 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:20:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2147.607502 secs 2023-05-08T04:20:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:09 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:20:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2148.161984 secs 2023-05-08T04:20:09.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:09 smithi133 ceph-mon[125939]: pgmap v1208: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:20:09.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:09 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:20:09.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:09 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:20:09.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:09 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:20:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2147.607502 secs 2023-05-08T04:20:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:09 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:20:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2148.161984 secs 2023-05-08T04:20:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:09 smithi096 ceph-mon[124666]: pgmap v1208: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:20:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:09 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:20:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:09 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:20:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:09 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:20:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:10 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:20:10.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:10 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T04:20:10.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:10 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T04:20:10.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:10 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:20:10.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2149.437512 secs 2023-05-08T04:20:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:10 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:20:10.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:10 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T04:20:10.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:10 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T04:20:10.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:10 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:20:10.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2149.437512 secs 2023-05-08T04:20:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:10 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:20:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:10 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T04:20:10.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:10 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T04:20:10.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:10 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:20:10.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2149.437512 secs 2023-05-08T04:20:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:11 smithi186 ceph-mon[126480]: osdmap e156: 12 total, 12 up, 12 in 2023-05-08T04:20:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:11 smithi186 ceph-mon[126480]: pgmap v1210: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:20:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:11 smithi133 ceph-mon[125939]: osdmap e156: 12 total, 12 up, 12 in 2023-05-08T04:20:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:11 smithi133 ceph-mon[125939]: pgmap v1210: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:20:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:11 smithi096 ceph-mon[124666]: osdmap e156: 12 total, 12 up, 12 in 2023-05-08T04:20:11.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:11 smithi096 ceph-mon[124666]: pgmap v1210: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:20:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:13 smithi133 ceph-mon[125939]: pgmap v1211: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:20:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2152.607624 secs 2023-05-08T04:20:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:13 smithi096 ceph-mon[124666]: pgmap v1211: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:20:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2152.607624 secs 2023-05-08T04:20:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:13 smithi186 ceph-mon[126480]: pgmap v1211: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:20:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2152.607624 secs 2023-05-08T04:20:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2153.162108 secs 2023-05-08T04:20:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2153.162108 secs 2023-05-08T04:20:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2153.162108 secs 2023-05-08T04:20:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:15 smithi096 ceph-mon[124666]: pgmap v1212: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:20:16.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2154.437651 secs 2023-05-08T04:20:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:15 smithi186 ceph-mon[126480]: pgmap v1212: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:20:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2154.437651 secs 2023-05-08T04:20:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:15 smithi133 ceph-mon[125939]: pgmap v1212: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:20:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2154.437651 secs 2023-05-08T04:20:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:17 smithi096 ceph-mon[124666]: pgmap v1213: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:20:18.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:17 smithi186 ceph-mon[126480]: pgmap v1213: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:20:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:17 smithi133 ceph-mon[125939]: pgmap v1213: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:20:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2157.607750 secs 2023-05-08T04:20:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:19 smithi186 ceph-mon[126480]: osdmap e157: 12 total, 12 up, 12 in 2023-05-08T04:20:19.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2158.162217 secs 2023-05-08T04:20:19.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:19 smithi186 ceph-mon[126480]: pgmap v1215: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:20:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2157.607750 secs 2023-05-08T04:20:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:19 smithi133 ceph-mon[125939]: osdmap e157: 12 total, 12 up, 12 in 2023-05-08T04:20:19.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2158.162217 secs 2023-05-08T04:20:19.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:19 smithi133 ceph-mon[125939]: pgmap v1215: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:20:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2157.607750 secs 2023-05-08T04:20:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:19 smithi096 ceph-mon[124666]: osdmap e157: 12 total, 12 up, 12 in 2023-05-08T04:20:19.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2158.162217 secs 2023-05-08T04:20:19.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:19 smithi096 ceph-mon[124666]: pgmap v1215: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:20:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2159.437768 secs 2023-05-08T04:20:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2159.437768 secs 2023-05-08T04:20:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2159.437768 secs 2023-05-08T04:20:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:21 smithi186 ceph-mon[126480]: pgmap v1216: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:20:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:21 smithi133 ceph-mon[125939]: pgmap v1216: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:20:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:21 smithi096 ceph-mon[124666]: pgmap v1216: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:20:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:23 smithi133 ceph-mon[125939]: pgmap v1217: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:20:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2162.607885 secs 2023-05-08T04:20:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:23 smithi096 ceph-mon[124666]: pgmap v1217: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:20:24.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2162.607885 secs 2023-05-08T04:20:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:23 smithi186 ceph-mon[126480]: pgmap v1217: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:20:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2162.607885 secs 2023-05-08T04:20:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2163.162335 secs 2023-05-08T04:20:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2163.162335 secs 2023-05-08T04:20:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2163.162335 secs 2023-05-08T04:20:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:25 smithi096 ceph-mon[124666]: pgmap v1218: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:20:26.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2164.437883 secs 2023-05-08T04:20:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:25 smithi186 ceph-mon[126480]: pgmap v1218: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:20:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2164.437883 secs 2023-05-08T04:20:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:25 smithi133 ceph-mon[125939]: pgmap v1218: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:20:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2164.437883 secs 2023-05-08T04:20:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:27 smithi096 ceph-mon[124666]: pgmap v1219: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:20:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:27 smithi186 ceph-mon[126480]: pgmap v1219: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:20:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:27 smithi133 ceph-mon[125939]: pgmap v1219: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:20:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2167.608018 secs 2023-05-08T04:20:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2168.162508 secs 2023-05-08T04:20:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:29 smithi186 ceph-mon[126480]: pgmap v1220: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T04:20:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2167.608018 secs 2023-05-08T04:20:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2168.162508 secs 2023-05-08T04:20:29.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:29 smithi133 ceph-mon[125939]: pgmap v1220: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T04:20:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2167.608018 secs 2023-05-08T04:20:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2168.162508 secs 2023-05-08T04:20:29.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:29 smithi096 ceph-mon[124666]: pgmap v1220: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T04:20:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:31 smithi096 ceph-mon[124666]: pgmap v1221: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 27 KiB/s wr, 8 op/s 2023-05-08T04:20:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:31 smithi186 ceph-mon[126480]: pgmap v1221: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 27 KiB/s wr, 8 op/s 2023-05-08T04:20:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:31 smithi133 ceph-mon[125939]: pgmap v1221: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 27 KiB/s wr, 8 op/s 2023-05-08T04:20:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:33 smithi096 ceph-mon[124666]: pgmap v1222: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 26 KiB/s wr, 5 op/s 2023-05-08T04:20:34.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2172.608163 secs 2023-05-08T04:20:34.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:33 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:20:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:33 smithi186 ceph-mon[126480]: pgmap v1222: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 26 KiB/s wr, 5 op/s 2023-05-08T04:20:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2172.608163 secs 2023-05-08T04:20:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:33 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:20:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:33 smithi133 ceph-mon[125939]: pgmap v1222: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 26 KiB/s wr, 5 op/s 2023-05-08T04:20:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2172.608163 secs 2023-05-08T04:20:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:33 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:20:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2173.162576 secs 2023-05-08T04:20:35.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:34 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:20:35.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:34 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:20:35.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:34 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:20:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2173.162576 secs 2023-05-08T04:20:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:34 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:20:35.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:34 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:20:35.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:34 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:20:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2173.162576 secs 2023-05-08T04:20:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:34 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:20:35.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:34 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:20:35.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:34 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:20:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:35 smithi096 ceph-mon[124666]: pgmap v1223: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 67 KiB/s wr, 9 op/s 2023-05-08T04:20:36.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2174.438090 secs 2023-05-08T04:20:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:35 smithi186 ceph-mon[126480]: pgmap v1223: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 67 KiB/s wr, 9 op/s 2023-05-08T04:20:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2174.438090 secs 2023-05-08T04:20:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:35 smithi133 ceph-mon[125939]: pgmap v1223: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 67 KiB/s wr, 9 op/s 2023-05-08T04:20:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2174.438090 secs 2023-05-08T04:20:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:37 smithi096 ceph-mon[124666]: pgmap v1224: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 67 KiB/s wr, 7 op/s 2023-05-08T04:20:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:37 smithi186 ceph-mon[126480]: pgmap v1224: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 67 KiB/s wr, 7 op/s 2023-05-08T04:20:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:37 smithi133 ceph-mon[125939]: pgmap v1224: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 67 KiB/s wr, 7 op/s 2023-05-08T04:20:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:38 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:20:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:38 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:20:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2177.608287 secs 2023-05-08T04:20:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2178.162716 secs 2023-05-08T04:20:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:38 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:20:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:38 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:20:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2177.608287 secs 2023-05-08T04:20:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2178.162716 secs 2023-05-08T04:20:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:38 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:20:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:38 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:20:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2177.608287 secs 2023-05-08T04:20:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2178.162716 secs 2023-05-08T04:20:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:39 smithi186 ceph-mon[126480]: pgmap v1225: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 67 KiB/s wr, 7 op/s 2023-05-08T04:20:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:39 smithi133 ceph-mon[125939]: pgmap v1225: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 67 KiB/s wr, 7 op/s 2023-05-08T04:20:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:39 smithi096 ceph-mon[124666]: pgmap v1225: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 67 KiB/s wr, 7 op/s 2023-05-08T04:20:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2179.438205 secs 2023-05-08T04:20:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2179.438205 secs 2023-05-08T04:20:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2179.438205 secs 2023-05-08T04:20:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:41 smithi186 ceph-mon[126480]: pgmap v1226: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 81 KiB/s wr, 11 op/s 2023-05-08T04:20:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:41 smithi133 ceph-mon[125939]: pgmap v1226: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 81 KiB/s wr, 11 op/s 2023-05-08T04:20:42.267 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:41 smithi096 ceph-mon[124666]: pgmap v1226: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 81 KiB/s wr, 11 op/s 2023-05-08T04:20:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:43 smithi186 ceph-mon[126480]: pgmap v1227: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 55 KiB/s wr, 7 op/s 2023-05-08T04:20:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2182.608404 secs 2023-05-08T04:20:44.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:43 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:20:44.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2183.162843 secs 2023-05-08T04:20:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:43 smithi133 ceph-mon[125939]: pgmap v1227: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 55 KiB/s wr, 7 op/s 2023-05-08T04:20:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2182.608404 secs 2023-05-08T04:20:44.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:43 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:20:44.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2183.162843 secs 2023-05-08T04:20:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:43 smithi096 ceph-mon[124666]: pgmap v1227: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 55 KiB/s wr, 7 op/s 2023-05-08T04:20:44.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2182.608404 secs 2023-05-08T04:20:44.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:43 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:20:44.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2183.162843 secs 2023-05-08T04:20:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:45 smithi186 ceph-mon[126480]: pgmap v1228: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 55 KiB/s wr, 10 op/s 2023-05-08T04:20:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2184.438318 secs 2023-05-08T04:20:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:45 smithi133 ceph-mon[125939]: pgmap v1228: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 55 KiB/s wr, 10 op/s 2023-05-08T04:20:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2184.438318 secs 2023-05-08T04:20:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:45 smithi096 ceph-mon[124666]: pgmap v1228: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 55 KiB/s wr, 10 op/s 2023-05-08T04:20:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2184.438318 secs 2023-05-08T04:20:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:47 smithi186 ceph-mon[126480]: pgmap v1229: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 6 op/s 2023-05-08T04:20:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:47 smithi133 ceph-mon[125939]: pgmap v1229: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 6 op/s 2023-05-08T04:20:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:47 smithi096 ceph-mon[124666]: pgmap v1229: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 6 op/s 2023-05-08T04:20:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2187.608527 secs 2023-05-08T04:20:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2188.162958 secs 2023-05-08T04:20:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:49 smithi186 ceph-mon[126480]: pgmap v1230: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 6 op/s 2023-05-08T04:20:49.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2187.608527 secs 2023-05-08T04:20:49.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2188.162958 secs 2023-05-08T04:20:49.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:49 smithi133 ceph-mon[125939]: pgmap v1230: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 6 op/s 2023-05-08T04:20:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2187.608527 secs 2023-05-08T04:20:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2188.162958 secs 2023-05-08T04:20:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:49 smithi096 ceph-mon[124666]: pgmap v1230: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 6 op/s 2023-05-08T04:20:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2189.438454 secs 2023-05-08T04:20:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2189.438454 secs 2023-05-08T04:20:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2189.438454 secs 2023-05-08T04:20:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:51 smithi186 ceph-mon[126480]: pgmap v1231: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 KiB/s wr, 8 op/s 2023-05-08T04:20:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:51 smithi133 ceph-mon[125939]: pgmap v1231: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 KiB/s wr, 8 op/s 2023-05-08T04:20:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:51 smithi096 ceph-mon[124666]: pgmap v1231: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 KiB/s wr, 8 op/s 2023-05-08T04:20:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:53 smithi096 ceph-mon[124666]: pgmap v1232: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2023-05-08T04:20:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2192.608672 secs 2023-05-08T04:20:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:53 smithi186 ceph-mon[126480]: pgmap v1232: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2023-05-08T04:20:54.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2192.608672 secs 2023-05-08T04:20:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:53 smithi133 ceph-mon[125939]: pgmap v1232: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2023-05-08T04:20:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2192.608672 secs 2023-05-08T04:20:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2193.163080 secs 2023-05-08T04:20:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2193.163080 secs 2023-05-08T04:20:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2193.163080 secs 2023-05-08T04:20:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:55 smithi096 ceph-mon[124666]: pgmap v1233: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 7 op/s 2023-05-08T04:20:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2194.438572 secs 2023-05-08T04:20:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:55 smithi186 ceph-mon[126480]: pgmap v1233: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 7 op/s 2023-05-08T04:20:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2194.438572 secs 2023-05-08T04:20:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:55 smithi133 ceph-mon[125939]: pgmap v1233: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 7 op/s 2023-05-08T04:20:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2194.438572 secs 2023-05-08T04:20:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:57 smithi186 ceph-mon[126480]: pgmap v1234: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:20:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:57 smithi133 ceph-mon[125939]: pgmap v1234: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:20:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:57 smithi096 ceph-mon[124666]: pgmap v1234: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:20:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2197.608798 secs 2023-05-08T04:20:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2198.163220 secs 2023-05-08T04:20:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:20:59 smithi186 ceph-mon[126480]: pgmap v1235: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:20:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2197.608798 secs 2023-05-08T04:20:59.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2198.163220 secs 2023-05-08T04:20:59.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:20:59 smithi133 ceph-mon[125939]: pgmap v1235: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:20:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2197.608798 secs 2023-05-08T04:20:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2198.163220 secs 2023-05-08T04:20:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:20:59 smithi096 ceph-mon[124666]: pgmap v1235: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:21:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2199.438685 secs 2023-05-08T04:21:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2199.438685 secs 2023-05-08T04:21:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2199.438685 secs 2023-05-08T04:21:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:01 smithi186 ceph-mon[126480]: pgmap v1236: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:21:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:01 smithi133 ceph-mon[125939]: pgmap v1236: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:21:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:01 smithi096 ceph-mon[124666]: pgmap v1236: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:21:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:03 smithi096 ceph-mon[124666]: pgmap v1237: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:21:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2202.608888 secs 2023-05-08T04:21:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2203.163359 secs 2023-05-08T04:21:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:03 smithi186 ceph-mon[126480]: pgmap v1237: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:21:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2202.608888 secs 2023-05-08T04:21:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2203.163359 secs 2023-05-08T04:21:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:03 smithi133 ceph-mon[125939]: pgmap v1237: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:21:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2202.608888 secs 2023-05-08T04:21:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2203.163359 secs 2023-05-08T04:21:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:05 smithi096 ceph-mon[124666]: pgmap v1238: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:21:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2204.438832 secs 2023-05-08T04:21:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:05 smithi186 ceph-mon[126480]: pgmap v1238: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:21:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2204.438832 secs 2023-05-08T04:21:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:05 smithi133 ceph-mon[125939]: pgmap v1238: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:21:06.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2204.438832 secs 2023-05-08T04:21:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:07 smithi186 ceph-mon[126480]: pgmap v1239: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:21:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:07 smithi133 ceph-mon[125939]: pgmap v1239: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:21:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:07 smithi096 ceph-mon[124666]: pgmap v1239: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:21:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2207.609013 secs 2023-05-08T04:21:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2208.163424 secs 2023-05-08T04:21:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:09 smithi186 ceph-mon[126480]: pgmap v1240: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:21:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:09 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:21:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2207.609013 secs 2023-05-08T04:21:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2208.163424 secs 2023-05-08T04:21:09.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:09 smithi133 ceph-mon[125939]: pgmap v1240: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:21:09.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:09 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:21:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2207.609013 secs 2023-05-08T04:21:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2208.163424 secs 2023-05-08T04:21:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:09 smithi096 ceph-mon[124666]: pgmap v1240: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:21:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:09 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:21:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:10 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:21:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:10 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:21:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:10 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:21:10.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:10 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:21:10.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:10 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T04:21:10.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:10 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T04:21:10.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:10 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:21:10.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2209.438955 secs 2023-05-08T04:21:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:10 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:21:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:10 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:21:10.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:10 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:21:10.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:10 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:21:10.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:10 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T04:21:10.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:10 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T04:21:10.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:10 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:21:10.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2209.438955 secs 2023-05-08T04:21:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:10 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:21:10.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:10 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:21:10.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:10 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:21:10.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:10 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:21:10.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:10 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T04:21:10.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:10 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T04:21:10.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:10 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:21:10.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2209.438955 secs 2023-05-08T04:21:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:11 smithi133 ceph-mon[125939]: osdmap e158: 12 total, 12 up, 12 in 2023-05-08T04:21:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:11 smithi133 ceph-mon[125939]: pgmap v1242: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:21:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:11 smithi096 ceph-mon[124666]: osdmap e158: 12 total, 12 up, 12 in 2023-05-08T04:21:12.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:11 smithi096 ceph-mon[124666]: pgmap v1242: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:21:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:11 smithi186 ceph-mon[126480]: osdmap e158: 12 total, 12 up, 12 in 2023-05-08T04:21:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:11 smithi186 ceph-mon[126480]: pgmap v1242: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:21:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:13 smithi096 ceph-mon[124666]: pgmap v1243: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:21:14.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2212.609134 secs 2023-05-08T04:21:14.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2213.163542 secs 2023-05-08T04:21:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:13 smithi186 ceph-mon[126480]: pgmap v1243: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:21:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2212.609134 secs 2023-05-08T04:21:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2213.163542 secs 2023-05-08T04:21:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:13 smithi133 ceph-mon[125939]: pgmap v1243: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:21:14.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2212.609134 secs 2023-05-08T04:21:14.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2213.163542 secs 2023-05-08T04:21:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:15 smithi186 ceph-mon[126480]: pgmap v1244: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:21:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2214.439074 secs 2023-05-08T04:21:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:15 smithi133 ceph-mon[125939]: pgmap v1244: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:21:16.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2214.439074 secs 2023-05-08T04:21:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:15 smithi096 ceph-mon[124666]: pgmap v1244: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:21:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2214.439074 secs 2023-05-08T04:21:18.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:17 smithi186 ceph-mon[126480]: pgmap v1245: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:21:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:17 smithi133 ceph-mon[125939]: pgmap v1245: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:21:18.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:17 smithi096 ceph-mon[124666]: pgmap v1245: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:21:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2217.609260 secs 2023-05-08T04:21:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:19 smithi186 ceph-mon[126480]: osdmap e159: 12 total, 12 up, 12 in 2023-05-08T04:21:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2218.163664 secs 2023-05-08T04:21:19.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:19 smithi186 ceph-mon[126480]: pgmap v1247: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2023-05-08T04:21:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2217.609260 secs 2023-05-08T04:21:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:19 smithi133 ceph-mon[125939]: osdmap e159: 12 total, 12 up, 12 in 2023-05-08T04:21:19.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2218.163664 secs 2023-05-08T04:21:19.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:19 smithi133 ceph-mon[125939]: pgmap v1247: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2023-05-08T04:21:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2217.609260 secs 2023-05-08T04:21:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:19 smithi096 ceph-mon[124666]: osdmap e159: 12 total, 12 up, 12 in 2023-05-08T04:21:19.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2218.163664 secs 2023-05-08T04:21:19.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:19 smithi096 ceph-mon[124666]: pgmap v1247: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2023-05-08T04:21:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2219.439188 secs 2023-05-08T04:21:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2219.439188 secs 2023-05-08T04:21:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2219.439188 secs 2023-05-08T04:21:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:21 smithi186 ceph-mon[126480]: pgmap v1248: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:21:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:21 smithi133 ceph-mon[125939]: pgmap v1248: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:21:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:21 smithi096 ceph-mon[124666]: pgmap v1248: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:21:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:23 smithi186 ceph-mon[126480]: pgmap v1249: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:21:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2222.609390 secs 2023-05-08T04:21:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2223.163787 secs 2023-05-08T04:21:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:23 smithi133 ceph-mon[125939]: pgmap v1249: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:21:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2222.609390 secs 2023-05-08T04:21:24.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2223.163787 secs 2023-05-08T04:21:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:23 smithi096 ceph-mon[124666]: pgmap v1249: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:21:24.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2222.609390 secs 2023-05-08T04:21:24.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2223.163787 secs 2023-05-08T04:21:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2224.439308 secs 2023-05-08T04:21:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:25 smithi186 ceph-mon[126480]: pgmap v1250: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:21:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2224.439308 secs 2023-05-08T04:21:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:25 smithi133 ceph-mon[125939]: pgmap v1250: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:21:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2224.439308 secs 2023-05-08T04:21:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:25 smithi096 ceph-mon[124666]: pgmap v1250: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:21:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:27 smithi186 ceph-mon[126480]: pgmap v1251: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:21:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:27 smithi133 ceph-mon[125939]: pgmap v1251: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:21:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:27 smithi096 ceph-mon[124666]: pgmap v1251: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:21:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2227.609496 secs 2023-05-08T04:21:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2228.163851 secs 2023-05-08T04:21:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:29 smithi186 ceph-mon[126480]: pgmap v1252: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T04:21:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2227.609496 secs 2023-05-08T04:21:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2228.163851 secs 2023-05-08T04:21:29.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:29 smithi133 ceph-mon[125939]: pgmap v1252: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T04:21:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2227.609496 secs 2023-05-08T04:21:29.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2228.163851 secs 2023-05-08T04:21:29.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:29 smithi096 ceph-mon[124666]: pgmap v1252: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T04:21:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:31 smithi186 ceph-mon[126480]: pgmap v1253: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 27 KiB/s wr, 8 op/s 2023-05-08T04:21:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:31 smithi133 ceph-mon[125939]: pgmap v1253: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 27 KiB/s wr, 8 op/s 2023-05-08T04:21:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:31 smithi096 ceph-mon[124666]: pgmap v1253: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 27 KiB/s wr, 8 op/s 2023-05-08T04:21:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:33 smithi186 ceph-mon[126480]: pgmap v1254: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 27 KiB/s wr, 5 op/s 2023-05-08T04:21:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2232.609613 secs 2023-05-08T04:21:34.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2233.163976 secs 2023-05-08T04:21:34.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:33 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:21:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:33 smithi133 ceph-mon[125939]: pgmap v1254: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 27 KiB/s wr, 5 op/s 2023-05-08T04:21:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2232.609613 secs 2023-05-08T04:21:34.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2233.163976 secs 2023-05-08T04:21:34.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:33 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:21:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:33 smithi096 ceph-mon[124666]: pgmap v1254: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 27 KiB/s wr, 5 op/s 2023-05-08T04:21:34.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2232.609613 secs 2023-05-08T04:21:34.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2233.163976 secs 2023-05-08T04:21:34.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:33 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:21:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:34 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:21:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:34 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:21:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:34 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:21:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:34 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:21:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:34 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:21:35.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:34 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:21:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:34 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:21:35.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:34 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:21:35.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:34 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:21:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2234.439555 secs 2023-05-08T04:21:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:35 smithi186 ceph-mon[126480]: pgmap v1255: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 71 KiB/s wr, 9 op/s 2023-05-08T04:21:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2234.439555 secs 2023-05-08T04:21:36.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:35 smithi133 ceph-mon[125939]: pgmap v1255: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 71 KiB/s wr, 9 op/s 2023-05-08T04:21:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2234.439555 secs 2023-05-08T04:21:36.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:35 smithi096 ceph-mon[124666]: pgmap v1255: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 71 KiB/s wr, 9 op/s 2023-05-08T04:21:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:37 smithi186 ceph-mon[126480]: pgmap v1256: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 71 KiB/s wr, 7 op/s 2023-05-08T04:21:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:37 smithi133 ceph-mon[125939]: pgmap v1256: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 71 KiB/s wr, 7 op/s 2023-05-08T04:21:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:37 smithi096 ceph-mon[124666]: pgmap v1256: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 71 KiB/s wr, 7 op/s 2023-05-08T04:21:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:38 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:21:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:38 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:21:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2237.609742 secs 2023-05-08T04:21:39.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2238.164121 secs 2023-05-08T04:21:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:38 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:21:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:38 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:21:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2237.609742 secs 2023-05-08T04:21:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2238.164121 secs 2023-05-08T04:21:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:38 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:21:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:38 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:21:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2237.609742 secs 2023-05-08T04:21:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2238.164121 secs 2023-05-08T04:21:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:39 smithi186 ceph-mon[126480]: pgmap v1257: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 71 KiB/s wr, 7 op/s 2023-05-08T04:21:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:39 smithi133 ceph-mon[125939]: pgmap v1257: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 71 KiB/s wr, 7 op/s 2023-05-08T04:21:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:39 smithi096 ceph-mon[124666]: pgmap v1257: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 71 KiB/s wr, 7 op/s 2023-05-08T04:21:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2239.439662 secs 2023-05-08T04:21:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2239.439662 secs 2023-05-08T04:21:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2239.439662 secs 2023-05-08T04:21:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:41 smithi186 ceph-mon[126480]: pgmap v1258: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 77 KiB/s wr, 11 op/s 2023-05-08T04:21:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:41 smithi133 ceph-mon[125939]: pgmap v1258: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 77 KiB/s wr, 11 op/s 2023-05-08T04:21:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:41 smithi096 ceph-mon[124666]: pgmap v1258: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 77 KiB/s wr, 11 op/s 2023-05-08T04:21:44.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:43 smithi186 ceph-mon[126480]: pgmap v1259: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 50 KiB/s wr, 7 op/s 2023-05-08T04:21:44.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2242.609864 secs 2023-05-08T04:21:44.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:43 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:21:44.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2243.164224 secs 2023-05-08T04:21:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:43 smithi133 ceph-mon[125939]: pgmap v1259: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 50 KiB/s wr, 7 op/s 2023-05-08T04:21:44.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2242.609864 secs 2023-05-08T04:21:44.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:43 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:21:44.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2243.164224 secs 2023-05-08T04:21:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:43 smithi096 ceph-mon[124666]: pgmap v1259: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 50 KiB/s wr, 7 op/s 2023-05-08T04:21:44.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2242.609864 secs 2023-05-08T04:21:44.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:43 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:21:44.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2243.164224 secs 2023-05-08T04:21:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2244.439795 secs 2023-05-08T04:21:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:45 smithi186 ceph-mon[126480]: pgmap v1260: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 50 KiB/s wr, 10 op/s 2023-05-08T04:21:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2244.439795 secs 2023-05-08T04:21:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:45 smithi133 ceph-mon[125939]: pgmap v1260: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 50 KiB/s wr, 10 op/s 2023-05-08T04:21:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2244.439795 secs 2023-05-08T04:21:46.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:45 smithi096 ceph-mon[124666]: pgmap v1260: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 50 KiB/s wr, 10 op/s 2023-05-08T04:21:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:47 smithi186 ceph-mon[126480]: pgmap v1261: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.8 KiB/s wr, 6 op/s 2023-05-08T04:21:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:47 smithi133 ceph-mon[125939]: pgmap v1261: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.8 KiB/s wr, 6 op/s 2023-05-08T04:21:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:47 smithi096 ceph-mon[124666]: pgmap v1261: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.8 KiB/s wr, 6 op/s 2023-05-08T04:21:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2247.609963 secs 2023-05-08T04:21:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2248.164299 secs 2023-05-08T04:21:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:49 smithi186 ceph-mon[126480]: pgmap v1262: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.8 KiB/s wr, 6 op/s 2023-05-08T04:21:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2247.609963 secs 2023-05-08T04:21:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2248.164299 secs 2023-05-08T04:21:49.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:49 smithi133 ceph-mon[125939]: pgmap v1262: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.8 KiB/s wr, 6 op/s 2023-05-08T04:21:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2247.609963 secs 2023-05-08T04:21:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2248.164299 secs 2023-05-08T04:21:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:49 smithi096 ceph-mon[124666]: pgmap v1262: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.8 KiB/s wr, 6 op/s 2023-05-08T04:21:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2249.439887 secs 2023-05-08T04:21:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2249.439887 secs 2023-05-08T04:21:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2249.439887 secs 2023-05-08T04:21:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:51 smithi186 ceph-mon[126480]: pgmap v1263: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 13 KiB/s wr, 8 op/s 2023-05-08T04:21:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:51 smithi133 ceph-mon[125939]: pgmap v1263: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 13 KiB/s wr, 8 op/s 2023-05-08T04:21:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:51 smithi096 ceph-mon[124666]: pgmap v1263: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 13 KiB/s wr, 8 op/s 2023-05-08T04:21:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:53 smithi186 ceph-mon[126480]: pgmap v1264: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 6.8 KiB/s wr, 5 op/s 2023-05-08T04:21:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2252.610103 secs 2023-05-08T04:21:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2253.164443 secs 2023-05-08T04:21:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:53 smithi133 ceph-mon[125939]: pgmap v1264: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 6.8 KiB/s wr, 5 op/s 2023-05-08T04:21:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2252.610103 secs 2023-05-08T04:21:54.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2253.164443 secs 2023-05-08T04:21:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:53 smithi096 ceph-mon[124666]: pgmap v1264: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 6.8 KiB/s wr, 5 op/s 2023-05-08T04:21:54.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2252.610103 secs 2023-05-08T04:21:54.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2253.164443 secs 2023-05-08T04:21:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2254.440002 secs 2023-05-08T04:21:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:55 smithi186 ceph-mon[126480]: pgmap v1265: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.8 KiB/s wr, 7 op/s 2023-05-08T04:21:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2254.440002 secs 2023-05-08T04:21:56.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:55 smithi133 ceph-mon[125939]: pgmap v1265: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.8 KiB/s wr, 7 op/s 2023-05-08T04:21:56.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2254.440002 secs 2023-05-08T04:21:56.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:55 smithi096 ceph-mon[124666]: pgmap v1265: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.8 KiB/s wr, 7 op/s 2023-05-08T04:21:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:57 smithi186 ceph-mon[126480]: pgmap v1266: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 6.8 KiB/s wr, 5 op/s 2023-05-08T04:21:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:57 smithi133 ceph-mon[125939]: pgmap v1266: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 6.8 KiB/s wr, 5 op/s 2023-05-08T04:21:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:57 smithi096 ceph-mon[124666]: pgmap v1266: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 6.8 KiB/s wr, 5 op/s 2023-05-08T04:21:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2257.610249 secs 2023-05-08T04:21:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2258.164582 secs 2023-05-08T04:21:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:21:59 smithi186 ceph-mon[126480]: pgmap v1267: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 6.8 KiB/s wr, 5 op/s 2023-05-08T04:21:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2257.610249 secs 2023-05-08T04:21:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2258.164582 secs 2023-05-08T04:21:59.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:21:59 smithi133 ceph-mon[125939]: pgmap v1267: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 6.8 KiB/s wr, 5 op/s 2023-05-08T04:21:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2257.610249 secs 2023-05-08T04:21:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2258.164582 secs 2023-05-08T04:21:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:21:59 smithi096 ceph-mon[124666]: pgmap v1267: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 6.8 KiB/s wr, 5 op/s 2023-05-08T04:22:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2259.440117 secs 2023-05-08T04:22:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2259.440117 secs 2023-05-08T04:22:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2259.440117 secs 2023-05-08T04:22:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:01 smithi186 ceph-mon[126480]: pgmap v1268: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.8 KiB/s wr, 7 op/s 2023-05-08T04:22:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:01 smithi133 ceph-mon[125939]: pgmap v1268: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.8 KiB/s wr, 7 op/s 2023-05-08T04:22:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:01 smithi096 ceph-mon[124666]: pgmap v1268: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.8 KiB/s wr, 7 op/s 2023-05-08T04:22:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:03 smithi186 ceph-mon[126480]: pgmap v1269: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:22:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2262.610386 secs 2023-05-08T04:22:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2263.164698 secs 2023-05-08T04:22:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:03 smithi133 ceph-mon[125939]: pgmap v1269: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:22:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2262.610386 secs 2023-05-08T04:22:04.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2263.164698 secs 2023-05-08T04:22:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:03 smithi096 ceph-mon[124666]: pgmap v1269: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:22:04.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2262.610386 secs 2023-05-08T04:22:04.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2263.164698 secs 2023-05-08T04:22:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2264.440239 secs 2023-05-08T04:22:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:05 smithi186 ceph-mon[126480]: pgmap v1270: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:22:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2264.440239 secs 2023-05-08T04:22:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:05 smithi133 ceph-mon[125939]: pgmap v1270: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:22:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2264.440239 secs 2023-05-08T04:22:06.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:05 smithi096 ceph-mon[124666]: pgmap v1270: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:22:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:07 smithi186 ceph-mon[126480]: pgmap v1271: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:22:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:07 smithi133 ceph-mon[125939]: pgmap v1271: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:22:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:07 smithi096 ceph-mon[124666]: pgmap v1271: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:22:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2267.610538 secs 2023-05-08T04:22:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2268.164821 secs 2023-05-08T04:22:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:09 smithi186 ceph-mon[126480]: pgmap v1272: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:22:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2267.610538 secs 2023-05-08T04:22:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2268.164821 secs 2023-05-08T04:22:09.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:09 smithi133 ceph-mon[125939]: pgmap v1272: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:22:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2267.610538 secs 2023-05-08T04:22:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2268.164821 secs 2023-05-08T04:22:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:09 smithi096 ceph-mon[124666]: pgmap v1272: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:22:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2269.440355 secs 2023-05-08T04:22:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:10 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:22:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2269.440355 secs 2023-05-08T04:22:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:10 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:22:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2269.440355 secs 2023-05-08T04:22:10.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:10 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:22:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:11 smithi186 ceph-mon[126480]: osdmap e160: 12 total, 12 up, 12 in 2023-05-08T04:22:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:11 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:22:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:11 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:22:11.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:11 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:22:11.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:11 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:22:11.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:11 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T04:22:11.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:11 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T04:22:11.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:11 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:22:11.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:11 smithi186 ceph-mon[126480]: pgmap v1274: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:22:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:11 smithi133 ceph-mon[125939]: osdmap e160: 12 total, 12 up, 12 in 2023-05-08T04:22:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:11 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:22:11.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:11 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:22:11.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:11 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:22:11.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:11 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:22:11.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:11 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T04:22:11.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:11 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T04:22:11.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:11 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:22:11.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:11 smithi133 ceph-mon[125939]: pgmap v1274: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:22:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:11 smithi096 ceph-mon[124666]: osdmap e160: 12 total, 12 up, 12 in 2023-05-08T04:22:11.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:11 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:22:11.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:11 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:22:11.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:11 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:22:11.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:11 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:22:11.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:11 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T04:22:11.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:11 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T04:22:11.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:11 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:22:11.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:11 smithi096 ceph-mon[124666]: pgmap v1274: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:22:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:13 smithi186 ceph-mon[126480]: pgmap v1275: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:22:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2272.610658 secs 2023-05-08T04:22:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2273.164942 secs 2023-05-08T04:22:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:13 smithi133 ceph-mon[125939]: pgmap v1275: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:22:14.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2272.610658 secs 2023-05-08T04:22:14.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2273.164942 secs 2023-05-08T04:22:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:13 smithi096 ceph-mon[124666]: pgmap v1275: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:22:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2272.610658 secs 2023-05-08T04:22:14.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2273.164942 secs 2023-05-08T04:22:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2274.440490 secs 2023-05-08T04:22:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:15 smithi186 ceph-mon[126480]: pgmap v1276: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:22:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2274.440490 secs 2023-05-08T04:22:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:15 smithi133 ceph-mon[125939]: pgmap v1276: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:22:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2274.440490 secs 2023-05-08T04:22:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:15 smithi096 ceph-mon[124666]: pgmap v1276: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:22:18.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:17 smithi186 ceph-mon[126480]: pgmap v1277: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:22:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:17 smithi133 ceph-mon[125939]: pgmap v1277: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:22:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:17 smithi096 ceph-mon[124666]: pgmap v1277: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:22:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2277.610779 secs 2023-05-08T04:22:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:19 smithi186 ceph-mon[126480]: osdmap e161: 12 total, 12 up, 12 in 2023-05-08T04:22:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2278.165065 secs 2023-05-08T04:22:19.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:19 smithi186 ceph-mon[126480]: pgmap v1279: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:22:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2277.610779 secs 2023-05-08T04:22:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:19 smithi133 ceph-mon[125939]: osdmap e161: 12 total, 12 up, 12 in 2023-05-08T04:22:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2278.165065 secs 2023-05-08T04:22:19.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:19 smithi133 ceph-mon[125939]: pgmap v1279: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:22:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2277.610779 secs 2023-05-08T04:22:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:19 smithi096 ceph-mon[124666]: osdmap e161: 12 total, 12 up, 12 in 2023-05-08T04:22:19.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2278.165065 secs 2023-05-08T04:22:19.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:19 smithi096 ceph-mon[124666]: pgmap v1279: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:22:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2279.440630 secs 2023-05-08T04:22:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2279.440630 secs 2023-05-08T04:22:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2279.440630 secs 2023-05-08T04:22:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:21 smithi186 ceph-mon[126480]: pgmap v1280: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:22:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:21 smithi133 ceph-mon[125939]: pgmap v1280: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:22:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:21 smithi096 ceph-mon[124666]: pgmap v1280: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:22:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:23 smithi186 ceph-mon[126480]: pgmap v1281: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:22:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2282.610905 secs 2023-05-08T04:22:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2283.165215 secs 2023-05-08T04:22:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:23 smithi133 ceph-mon[125939]: pgmap v1281: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:22:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2282.610905 secs 2023-05-08T04:22:24.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2283.165215 secs 2023-05-08T04:22:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:23 smithi096 ceph-mon[124666]: pgmap v1281: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:22:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2282.610905 secs 2023-05-08T04:22:24.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2283.165215 secs 2023-05-08T04:22:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2284.440749 secs 2023-05-08T04:22:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:25 smithi186 ceph-mon[126480]: pgmap v1282: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:22:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2284.440749 secs 2023-05-08T04:22:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:25 smithi133 ceph-mon[125939]: pgmap v1282: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:22:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2284.440749 secs 2023-05-08T04:22:26.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:25 smithi096 ceph-mon[124666]: pgmap v1282: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:22:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:27 smithi186 ceph-mon[126480]: pgmap v1283: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:22:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:27 smithi133 ceph-mon[125939]: pgmap v1283: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:22:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:27 smithi096 ceph-mon[124666]: pgmap v1283: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:22:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2287.611031 secs 2023-05-08T04:22:29.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2288.165312 secs 2023-05-08T04:22:29.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:29 smithi186 ceph-mon[126480]: pgmap v1284: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T04:22:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2287.611031 secs 2023-05-08T04:22:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2288.165312 secs 2023-05-08T04:22:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:29 smithi133 ceph-mon[125939]: pgmap v1284: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T04:22:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2287.611031 secs 2023-05-08T04:22:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2288.165312 secs 2023-05-08T04:22:29.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:29 smithi096 ceph-mon[124666]: pgmap v1284: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T04:22:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:31 smithi186 ceph-mon[126480]: pgmap v1285: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 28 KiB/s wr, 8 op/s 2023-05-08T04:22:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:31 smithi133 ceph-mon[125939]: pgmap v1285: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 28 KiB/s wr, 8 op/s 2023-05-08T04:22:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:31 smithi096 ceph-mon[124666]: pgmap v1285: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 28 KiB/s wr, 8 op/s 2023-05-08T04:22:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:33 smithi186 ceph-mon[126480]: pgmap v1286: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 28 KiB/s wr, 5 op/s 2023-05-08T04:22:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2292.611147 secs 2023-05-08T04:22:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2293.165436 secs 2023-05-08T04:22:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:33 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:22:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:33 smithi133 ceph-mon[125939]: pgmap v1286: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 28 KiB/s wr, 5 op/s 2023-05-08T04:22:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2292.611147 secs 2023-05-08T04:22:34.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2293.165436 secs 2023-05-08T04:22:34.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:33 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:22:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:33 smithi096 ceph-mon[124666]: pgmap v1286: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 28 KiB/s wr, 5 op/s 2023-05-08T04:22:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2292.611147 secs 2023-05-08T04:22:34.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2293.165436 secs 2023-05-08T04:22:34.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:33 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:22:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:34 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:22:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:34 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:22:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:34 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:22:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:34 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:22:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:34 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:22:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:34 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:22:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:34 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:22:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:34 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:22:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:34 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:22:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2294.441007 secs 2023-05-08T04:22:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:35 smithi186 ceph-mon[126480]: pgmap v1287: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 73 KiB/s wr, 9 op/s 2023-05-08T04:22:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2294.441007 secs 2023-05-08T04:22:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:35 smithi133 ceph-mon[125939]: pgmap v1287: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 73 KiB/s wr, 9 op/s 2023-05-08T04:22:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2294.441007 secs 2023-05-08T04:22:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:35 smithi096 ceph-mon[124666]: pgmap v1287: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 73 KiB/s wr, 9 op/s 2023-05-08T04:22:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:37 smithi186 ceph-mon[126480]: pgmap v1288: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 73 KiB/s wr, 7 op/s 2023-05-08T04:22:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:37 smithi133 ceph-mon[125939]: pgmap v1288: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 73 KiB/s wr, 7 op/s 2023-05-08T04:22:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:37 smithi096 ceph-mon[124666]: pgmap v1288: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 73 KiB/s wr, 7 op/s 2023-05-08T04:22:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:38 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:22:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:38 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:22:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2297.611264 secs 2023-05-08T04:22:39.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2298.165560 secs 2023-05-08T04:22:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:38 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:22:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:38 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:22:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2297.611264 secs 2023-05-08T04:22:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2298.165560 secs 2023-05-08T04:22:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:38 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:22:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:38 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:22:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2297.611264 secs 2023-05-08T04:22:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2298.165560 secs 2023-05-08T04:22:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:39 smithi186 ceph-mon[126480]: pgmap v1289: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 73 KiB/s wr, 7 op/s 2023-05-08T04:22:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:39 smithi133 ceph-mon[125939]: pgmap v1289: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 73 KiB/s wr, 7 op/s 2023-05-08T04:22:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:39 smithi096 ceph-mon[124666]: pgmap v1289: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 73 KiB/s wr, 7 op/s 2023-05-08T04:22:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2299.441114 secs 2023-05-08T04:22:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2299.441114 secs 2023-05-08T04:22:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2299.441114 secs 2023-05-08T04:22:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:41 smithi186 ceph-mon[126480]: pgmap v1290: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 99 KiB/s wr, 11 op/s 2023-05-08T04:22:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:41 smithi133 ceph-mon[125939]: pgmap v1290: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 99 KiB/s wr, 11 op/s 2023-05-08T04:22:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:41 smithi096 ceph-mon[124666]: pgmap v1290: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 99 KiB/s wr, 11 op/s 2023-05-08T04:22:44.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:43 smithi186 ceph-mon[126480]: pgmap v1291: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 71 KiB/s wr, 8 op/s 2023-05-08T04:22:44.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2302.611384 secs 2023-05-08T04:22:44.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:43 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:22:44.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2303.165679 secs 2023-05-08T04:22:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:43 smithi133 ceph-mon[125939]: pgmap v1291: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 71 KiB/s wr, 8 op/s 2023-05-08T04:22:44.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2302.611384 secs 2023-05-08T04:22:44.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:43 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:22:44.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2303.165679 secs 2023-05-08T04:22:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:43 smithi096 ceph-mon[124666]: pgmap v1291: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 71 KiB/s wr, 8 op/s 2023-05-08T04:22:44.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2302.611384 secs 2023-05-08T04:22:44.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:43 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:22:44.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2303.165679 secs 2023-05-08T04:22:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2304.441212 secs 2023-05-08T04:22:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:45 smithi186 ceph-mon[126480]: pgmap v1292: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 71 KiB/s wr, 11 op/s 2023-05-08T04:22:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2304.441212 secs 2023-05-08T04:22:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:45 smithi133 ceph-mon[125939]: pgmap v1292: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 71 KiB/s wr, 11 op/s 2023-05-08T04:22:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2304.441212 secs 2023-05-08T04:22:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:45 smithi096 ceph-mon[124666]: pgmap v1292: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 71 KiB/s wr, 11 op/s 2023-05-08T04:22:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:47 smithi186 ceph-mon[126480]: pgmap v1293: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 25 KiB/s wr, 7 op/s 2023-05-08T04:22:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:47 smithi133 ceph-mon[125939]: pgmap v1293: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 25 KiB/s wr, 7 op/s 2023-05-08T04:22:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:47 smithi096 ceph-mon[124666]: pgmap v1293: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 25 KiB/s wr, 7 op/s 2023-05-08T04:22:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2307.611474 secs 2023-05-08T04:22:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2308.165768 secs 2023-05-08T04:22:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:49 smithi186 ceph-mon[126480]: pgmap v1294: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 25 KiB/s wr, 7 op/s 2023-05-08T04:22:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2307.611474 secs 2023-05-08T04:22:49.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2308.165768 secs 2023-05-08T04:22:49.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:49 smithi133 ceph-mon[125939]: pgmap v1294: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 25 KiB/s wr, 7 op/s 2023-05-08T04:22:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2307.611474 secs 2023-05-08T04:22:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2308.165768 secs 2023-05-08T04:22:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:49 smithi096 ceph-mon[124666]: pgmap v1294: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 25 KiB/s wr, 7 op/s 2023-05-08T04:22:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2309.441333 secs 2023-05-08T04:22:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2309.441333 secs 2023-05-08T04:22:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2309.441333 secs 2023-05-08T04:22:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:51 smithi186 ceph-mon[126480]: pgmap v1295: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 25 KiB/s wr, 10 op/s 2023-05-08T04:22:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:51 smithi133 ceph-mon[125939]: pgmap v1295: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 25 KiB/s wr, 10 op/s 2023-05-08T04:22:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:51 smithi096 ceph-mon[124666]: pgmap v1295: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 25 KiB/s wr, 10 op/s 2023-05-08T04:22:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:53 smithi186 ceph-mon[126480]: pgmap v1296: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2023-05-08T04:22:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2312.611576 secs 2023-05-08T04:22:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2313.165888 secs 2023-05-08T04:22:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:53 smithi133 ceph-mon[125939]: pgmap v1296: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2023-05-08T04:22:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2312.611576 secs 2023-05-08T04:22:54.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2313.165888 secs 2023-05-08T04:22:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:53 smithi096 ceph-mon[124666]: pgmap v1296: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2023-05-08T04:22:54.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2312.611576 secs 2023-05-08T04:22:54.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2313.165888 secs 2023-05-08T04:22:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2314.441449 secs 2023-05-08T04:22:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:55 smithi186 ceph-mon[126480]: pgmap v1297: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 8 op/s 2023-05-08T04:22:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2314.441449 secs 2023-05-08T04:22:56.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:55 smithi133 ceph-mon[125939]: pgmap v1297: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 8 op/s 2023-05-08T04:22:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2314.441449 secs 2023-05-08T04:22:56.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:55 smithi096 ceph-mon[124666]: pgmap v1297: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 8 op/s 2023-05-08T04:22:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:57 smithi186 ceph-mon[126480]: pgmap v1298: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:22:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:57 smithi133 ceph-mon[125939]: pgmap v1298: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:22:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:57 smithi096 ceph-mon[124666]: pgmap v1298: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:22:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2317.611703 secs 2023-05-08T04:22:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2318.166024 secs 2023-05-08T04:22:59.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:22:59 smithi186 ceph-mon[126480]: pgmap v1299: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:22:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2317.611703 secs 2023-05-08T04:22:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2318.166024 secs 2023-05-08T04:22:59.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:22:59 smithi133 ceph-mon[125939]: pgmap v1299: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:22:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2317.611703 secs 2023-05-08T04:22:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2318.166024 secs 2023-05-08T04:22:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:22:59 smithi096 ceph-mon[124666]: pgmap v1299: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:23:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2319.441564 secs 2023-05-08T04:23:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2319.441564 secs 2023-05-08T04:23:00.509 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2319.441564 secs 2023-05-08T04:23:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:01 smithi186 ceph-mon[126480]: pgmap v1300: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T04:23:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:01 smithi133 ceph-mon[125939]: pgmap v1300: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T04:23:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:01 smithi096 ceph-mon[124666]: pgmap v1300: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T04:23:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:03 smithi186 ceph-mon[126480]: pgmap v1301: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:23:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2322.611818 secs 2023-05-08T04:23:04.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2323.166161 secs 2023-05-08T04:23:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:03 smithi133 ceph-mon[125939]: pgmap v1301: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:23:04.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2322.611818 secs 2023-05-08T04:23:04.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2323.166161 secs 2023-05-08T04:23:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:03 smithi096 ceph-mon[124666]: pgmap v1301: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:23:04.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2322.611818 secs 2023-05-08T04:23:04.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2323.166161 secs 2023-05-08T04:23:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2324.441716 secs 2023-05-08T04:23:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:05 smithi186 ceph-mon[126480]: pgmap v1302: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-05-08T04:23:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2324.441716 secs 2023-05-08T04:23:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:05 smithi133 ceph-mon[125939]: pgmap v1302: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-05-08T04:23:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2324.441716 secs 2023-05-08T04:23:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:05 smithi096 ceph-mon[124666]: pgmap v1302: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-05-08T04:23:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:07 smithi186 ceph-mon[126480]: pgmap v1303: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 20 op/s 2023-05-08T04:23:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:07 smithi133 ceph-mon[125939]: pgmap v1303: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 20 op/s 2023-05-08T04:23:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:07 smithi096 ceph-mon[124666]: pgmap v1303: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 20 op/s 2023-05-08T04:23:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2327.611950 secs 2023-05-08T04:23:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2328.166283 secs 2023-05-08T04:23:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:09 smithi186 ceph-mon[126480]: pgmap v1304: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 20 op/s 2023-05-08T04:23:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2327.611950 secs 2023-05-08T04:23:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2328.166283 secs 2023-05-08T04:23:09.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:09 smithi133 ceph-mon[125939]: pgmap v1304: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 20 op/s 2023-05-08T04:23:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2327.611950 secs 2023-05-08T04:23:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2328.166283 secs 2023-05-08T04:23:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:09 smithi096 ceph-mon[124666]: pgmap v1304: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 20 op/s 2023-05-08T04:23:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2329.441835 secs 2023-05-08T04:23:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2329.441835 secs 2023-05-08T04:23:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2329.441835 secs 2023-05-08T04:23:11.093 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:11 smithi096 ceph-mon[124666]: osdmap e162: 12 total, 12 up, 12 in 2023-05-08T04:23:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:11 smithi186 ceph-mon[126480]: osdmap e162: 12 total, 12 up, 12 in 2023-05-08T04:23:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:11 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:23:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:11 smithi186 ceph-mon[126480]: pgmap v1306: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T04:23:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:11 smithi133 ceph-mon[125939]: osdmap e162: 12 total, 12 up, 12 in 2023-05-08T04:23:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:11 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:23:11.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:11 smithi133 ceph-mon[125939]: pgmap v1306: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T04:23:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:11 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:23:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:11 smithi096 ceph-mon[124666]: pgmap v1306: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T04:23:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:13 smithi186 ceph-mon[126480]: pgmap v1307: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T04:23:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2332.612032 secs 2023-05-08T04:23:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:13 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:23:14.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:13 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:23:14.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:13 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:23:14.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:13 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:23:14.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:13 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:23:14.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:13 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:23:14.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2333.166348 secs 2023-05-08T04:23:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:13 smithi133 ceph-mon[125939]: pgmap v1307: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T04:23:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2332.612032 secs 2023-05-08T04:23:14.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:13 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:23:14.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:13 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:23:14.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:13 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:23:14.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:13 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:23:14.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:13 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:23:14.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:13 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:23:14.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2333.166348 secs 2023-05-08T04:23:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:13 smithi096 ceph-mon[124666]: pgmap v1307: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T04:23:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2332.612032 secs 2023-05-08T04:23:14.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:13 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:23:14.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:13 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:23:14.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:13 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:23:14.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:13 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:23:14.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:13 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:23:14.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:13 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:23:14.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2333.166348 secs 2023-05-08T04:23:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:23:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:23:15.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:23:15.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:23:15.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:23:15.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:23:15.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:23:15.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:23:15.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:23:15.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:23:15.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:23:15.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:23:15.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:23:15.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:23:15.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:23:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:23:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:23:15.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:23:15.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:23:15.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:23:15.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:23:15.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:23:15.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:23:15.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:23:15.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:23:15.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:23:15.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:23:15.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:23:15.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:23:15.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:23:15.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:23:15.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:23:15.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:23:15.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:23:15.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:23:15.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:23:15.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:23:15.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:23:15.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:23:15.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:23:15.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:23:15.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:23:15.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:23:15.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:23:15.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:23:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:15 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi096 to 196.2M 2023-05-08T04:23:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:15 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T04:23:16.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:15 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi096 to 205766758: error parsing value: Value '205766758' is below minimum 939524096 2023-05-08T04:23:16.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:15 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T04:23:16.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:15 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T04:23:16.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:15 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T04:23:16.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:15 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:23:16.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:15 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T04:23:16.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:15 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T04:23:16.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:15 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:23:16.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2334.441901 secs 2023-05-08T04:23:16.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:15 smithi186 ceph-mon[126480]: pgmap v1308: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:23:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:15 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi096 to 196.2M 2023-05-08T04:23:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:15 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T04:23:16.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:15 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi096 to 205766758: error parsing value: Value '205766758' is below minimum 939524096 2023-05-08T04:23:16.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:15 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T04:23:16.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:15 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T04:23:16.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:15 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T04:23:16.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:15 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:23:16.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:15 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T04:23:16.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:15 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T04:23:16.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:15 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:23:16.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2334.441901 secs 2023-05-08T04:23:16.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:15 smithi133 ceph-mon[125939]: pgmap v1308: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:23:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:15 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi096 to 196.2M 2023-05-08T04:23:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:15 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T04:23:16.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:15 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi096 to 205766758: error parsing value: Value '205766758' is below minimum 939524096 2023-05-08T04:23:16.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:15 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T04:23:16.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:15 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T04:23:16.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:15 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T04:23:16.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:15 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:23:16.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:15 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T04:23:16.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:15 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T04:23:16.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:15 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:23:16.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2334.441901 secs 2023-05-08T04:23:16.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:15 smithi096 ceph-mon[124666]: pgmap v1308: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:23:18.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:17 smithi186 ceph-mon[126480]: pgmap v1309: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:23:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:17 smithi133 ceph-mon[125939]: pgmap v1309: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:23:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:17 smithi096 ceph-mon[124666]: pgmap v1309: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:23:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2337.612143 secs 2023-05-08T04:23:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:19 smithi186 ceph-mon[126480]: osdmap e163: 12 total, 12 up, 12 in 2023-05-08T04:23:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2338.166490 secs 2023-05-08T04:23:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:19 smithi186 ceph-mon[126480]: pgmap v1311: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:23:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2337.612143 secs 2023-05-08T04:23:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:19 smithi133 ceph-mon[125939]: osdmap e163: 12 total, 12 up, 12 in 2023-05-08T04:23:19.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2338.166490 secs 2023-05-08T04:23:19.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:19 smithi133 ceph-mon[125939]: pgmap v1311: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:23:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2337.612143 secs 2023-05-08T04:23:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:19 smithi096 ceph-mon[124666]: osdmap e163: 12 total, 12 up, 12 in 2023-05-08T04:23:19.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2338.166490 secs 2023-05-08T04:23:19.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:19 smithi096 ceph-mon[124666]: pgmap v1311: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:23:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2339.442022 secs 2023-05-08T04:23:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2339.442022 secs 2023-05-08T04:23:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2339.442022 secs 2023-05-08T04:23:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:21 smithi186 ceph-mon[126480]: pgmap v1312: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:23:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:21 smithi133 ceph-mon[125939]: pgmap v1312: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:23:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:21 smithi096 ceph-mon[124666]: pgmap v1312: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:23:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:23 smithi186 ceph-mon[126480]: pgmap v1313: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:23:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2342.612239 secs 2023-05-08T04:23:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2343.166558 secs 2023-05-08T04:23:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:23 smithi133 ceph-mon[125939]: pgmap v1313: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:23:24.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2342.612239 secs 2023-05-08T04:23:24.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2343.166558 secs 2023-05-08T04:23:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:23 smithi096 ceph-mon[124666]: pgmap v1313: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:23:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2342.612239 secs 2023-05-08T04:23:24.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2343.166558 secs 2023-05-08T04:23:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2344.442144 secs 2023-05-08T04:23:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:25 smithi186 ceph-mon[126480]: pgmap v1314: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:23:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2344.442144 secs 2023-05-08T04:23:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:25 smithi133 ceph-mon[125939]: pgmap v1314: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:23:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2344.442144 secs 2023-05-08T04:23:26.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:25 smithi096 ceph-mon[124666]: pgmap v1314: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:23:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:27 smithi186 ceph-mon[126480]: pgmap v1315: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:23:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:27 smithi133 ceph-mon[125939]: pgmap v1315: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:23:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:27 smithi096 ceph-mon[124666]: pgmap v1315: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:23:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2347.612352 secs 2023-05-08T04:23:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2348.166674 secs 2023-05-08T04:23:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:29 smithi186 ceph-mon[126480]: pgmap v1316: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T04:23:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2347.612352 secs 2023-05-08T04:23:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2348.166674 secs 2023-05-08T04:23:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:29 smithi133 ceph-mon[125939]: pgmap v1316: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T04:23:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2347.612352 secs 2023-05-08T04:23:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2348.166674 secs 2023-05-08T04:23:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:29 smithi096 ceph-mon[124666]: pgmap v1316: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T04:23:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2349.442260 secs 2023-05-08T04:23:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2349.442260 secs 2023-05-08T04:23:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2349.442260 secs 2023-05-08T04:23:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:31 smithi186 ceph-mon[126480]: pgmap v1317: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 30 KiB/s wr, 8 op/s 2023-05-08T04:23:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:31 smithi133 ceph-mon[125939]: pgmap v1317: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 30 KiB/s wr, 8 op/s 2023-05-08T04:23:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:31 smithi096 ceph-mon[124666]: pgmap v1317: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 30 KiB/s wr, 8 op/s 2023-05-08T04:23:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:33 smithi186 ceph-mon[126480]: pgmap v1318: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 30 KiB/s wr, 5 op/s 2023-05-08T04:23:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2352.612460 secs 2023-05-08T04:23:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2353.166815 secs 2023-05-08T04:23:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:33 smithi133 ceph-mon[125939]: pgmap v1318: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 30 KiB/s wr, 5 op/s 2023-05-08T04:23:34.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2352.612460 secs 2023-05-08T04:23:34.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2353.166815 secs 2023-05-08T04:23:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:33 smithi096 ceph-mon[124666]: pgmap v1318: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 30 KiB/s wr, 5 op/s 2023-05-08T04:23:34.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2352.612460 secs 2023-05-08T04:23:34.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2353.166815 secs 2023-05-08T04:23:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2354.442379 secs 2023-05-08T04:23:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:35 smithi186 ceph-mon[126480]: pgmap v1319: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 75 KiB/s wr, 9 op/s 2023-05-08T04:23:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2354.442379 secs 2023-05-08T04:23:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:35 smithi133 ceph-mon[125939]: pgmap v1319: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 75 KiB/s wr, 9 op/s 2023-05-08T04:23:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2354.442379 secs 2023-05-08T04:23:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:35 smithi096 ceph-mon[124666]: pgmap v1319: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 75 KiB/s wr, 9 op/s 2023-05-08T04:23:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:37 smithi186 ceph-mon[126480]: pgmap v1320: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 75 KiB/s wr, 7 op/s 2023-05-08T04:23:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:37 smithi133 ceph-mon[125939]: pgmap v1320: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 75 KiB/s wr, 7 op/s 2023-05-08T04:23:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:37 smithi096 ceph-mon[124666]: pgmap v1320: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 75 KiB/s wr, 7 op/s 2023-05-08T04:23:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2357.612579 secs 2023-05-08T04:23:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2358.166938 secs 2023-05-08T04:23:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:39 smithi186 ceph-mon[126480]: pgmap v1321: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 75 KiB/s wr, 7 op/s 2023-05-08T04:23:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2357.612579 secs 2023-05-08T04:23:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2358.166938 secs 2023-05-08T04:23:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:39 smithi133 ceph-mon[125939]: pgmap v1321: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 75 KiB/s wr, 7 op/s 2023-05-08T04:23:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2357.612579 secs 2023-05-08T04:23:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2358.166938 secs 2023-05-08T04:23:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:39 smithi096 ceph-mon[124666]: pgmap v1321: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 75 KiB/s wr, 7 op/s 2023-05-08T04:23:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2359.442477 secs 2023-05-08T04:23:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2359.442477 secs 2023-05-08T04:23:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2359.442477 secs 2023-05-08T04:23:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:41 smithi186 ceph-mon[126480]: pgmap v1322: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 89 KiB/s wr, 11 op/s 2023-05-08T04:23:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:41 smithi133 ceph-mon[125939]: pgmap v1322: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 89 KiB/s wr, 11 op/s 2023-05-08T04:23:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:41 smithi096 ceph-mon[124666]: pgmap v1322: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 89 KiB/s wr, 11 op/s 2023-05-08T04:23:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:43 smithi186 ceph-mon[126480]: pgmap v1323: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 58 KiB/s wr, 8 op/s 2023-05-08T04:23:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2362.612703 secs 2023-05-08T04:23:44.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2363.167063 secs 2023-05-08T04:23:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:43 smithi133 ceph-mon[125939]: pgmap v1323: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 58 KiB/s wr, 8 op/s 2023-05-08T04:23:44.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2362.612703 secs 2023-05-08T04:23:44.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2363.167063 secs 2023-05-08T04:23:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:43 smithi096 ceph-mon[124666]: pgmap v1323: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 58 KiB/s wr, 8 op/s 2023-05-08T04:23:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2362.612703 secs 2023-05-08T04:23:44.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2363.167063 secs 2023-05-08T04:23:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2364.442568 secs 2023-05-08T04:23:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:45 smithi186 ceph-mon[126480]: pgmap v1324: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 58 KiB/s wr, 10 op/s 2023-05-08T04:23:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2364.442568 secs 2023-05-08T04:23:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:45 smithi133 ceph-mon[125939]: pgmap v1324: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 58 KiB/s wr, 10 op/s 2023-05-08T04:23:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2364.442568 secs 2023-05-08T04:23:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:45 smithi096 ceph-mon[124666]: pgmap v1324: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 58 KiB/s wr, 10 op/s 2023-05-08T04:23:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:47 smithi186 ceph-mon[126480]: pgmap v1325: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 13 KiB/s wr, 6 op/s 2023-05-08T04:23:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:47 smithi133 ceph-mon[125939]: pgmap v1325: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 13 KiB/s wr, 6 op/s 2023-05-08T04:23:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:47 smithi096 ceph-mon[124666]: pgmap v1325: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 13 KiB/s wr, 6 op/s 2023-05-08T04:23:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2367.612844 secs 2023-05-08T04:23:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2368.167189 secs 2023-05-08T04:23:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:49 smithi186 ceph-mon[126480]: pgmap v1326: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 13 KiB/s wr, 6 op/s 2023-05-08T04:23:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2367.612844 secs 2023-05-08T04:23:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2368.167189 secs 2023-05-08T04:23:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:49 smithi133 ceph-mon[125939]: pgmap v1326: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 13 KiB/s wr, 6 op/s 2023-05-08T04:23:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2367.612844 secs 2023-05-08T04:23:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2368.167189 secs 2023-05-08T04:23:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:49 smithi096 ceph-mon[124666]: pgmap v1326: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 13 KiB/s wr, 6 op/s 2023-05-08T04:23:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2369.442702 secs 2023-05-08T04:23:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2369.442702 secs 2023-05-08T04:23:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2369.442702 secs 2023-05-08T04:23:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:51 smithi186 ceph-mon[126480]: pgmap v1327: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 13 KiB/s wr, 8 op/s 2023-05-08T04:23:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:51 smithi133 ceph-mon[125939]: pgmap v1327: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 13 KiB/s wr, 8 op/s 2023-05-08T04:23:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:51 smithi096 ceph-mon[124666]: pgmap v1327: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 13 KiB/s wr, 8 op/s 2023-05-08T04:23:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:53 smithi186 ceph-mon[126480]: pgmap v1328: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 4 op/s 2023-05-08T04:23:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2372.612963 secs 2023-05-08T04:23:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2373.167326 secs 2023-05-08T04:23:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:53 smithi133 ceph-mon[125939]: pgmap v1328: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 4 op/s 2023-05-08T04:23:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2372.612963 secs 2023-05-08T04:23:54.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2373.167326 secs 2023-05-08T04:23:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:53 smithi096 ceph-mon[124666]: pgmap v1328: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 4 op/s 2023-05-08T04:23:54.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2372.612963 secs 2023-05-08T04:23:54.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2373.167326 secs 2023-05-08T04:23:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2374.442846 secs 2023-05-08T04:23:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:55 smithi186 ceph-mon[126480]: pgmap v1329: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T04:23:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2374.442846 secs 2023-05-08T04:23:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:55 smithi133 ceph-mon[125939]: pgmap v1329: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T04:23:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2374.442846 secs 2023-05-08T04:23:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:55 smithi096 ceph-mon[124666]: pgmap v1329: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T04:23:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:57 smithi186 ceph-mon[126480]: pgmap v1330: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T04:23:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:57 smithi133 ceph-mon[125939]: pgmap v1330: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T04:23:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:57 smithi096 ceph-mon[124666]: pgmap v1330: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T04:23:59.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2377.613100 secs 2023-05-08T04:23:59.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2378.167463 secs 2023-05-08T04:23:59.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:23:59 smithi186 ceph-mon[126480]: pgmap v1331: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T04:23:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2377.613100 secs 2023-05-08T04:23:59.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2378.167463 secs 2023-05-08T04:23:59.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:23:59 smithi133 ceph-mon[125939]: pgmap v1331: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T04:23:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2377.613100 secs 2023-05-08T04:23:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2378.167463 secs 2023-05-08T04:23:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:23:59 smithi096 ceph-mon[124666]: pgmap v1331: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T04:24:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:24:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2379.442965 secs 2023-05-08T04:24:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:24:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2379.442965 secs 2023-05-08T04:24:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:24:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2379.442965 secs 2023-05-08T04:24:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:24:01 smithi186 ceph-mon[126480]: pgmap v1332: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:24:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:24:01 smithi133 ceph-mon[125939]: pgmap v1332: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:24:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:24:01 smithi096 ceph-mon[124666]: pgmap v1332: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:24:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:24:03 smithi186 ceph-mon[126480]: pgmap v1333: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:24:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:24:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2382.613246 secs 2023-05-08T04:24:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:24:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2383.167590 secs 2023-05-08T04:24:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:24:03 smithi133 ceph-mon[125939]: pgmap v1333: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:24:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:24:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2382.613246 secs 2023-05-08T04:24:04.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:24:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2383.167590 secs 2023-05-08T04:24:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:24:03 smithi096 ceph-mon[124666]: pgmap v1333: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:24:04.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:24:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2382.613246 secs 2023-05-08T04:24:04.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:24:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2383.167590 secs 2023-05-08T04:24:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:24:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2384.443107 secs 2023-05-08T04:24:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:24:05 smithi186 ceph-mon[126480]: pgmap v1334: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:24:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:24:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2384.443107 secs 2023-05-08T04:24:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:24:05 smithi133 ceph-mon[125939]: pgmap v1334: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:24:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:24:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2384.443107 secs 2023-05-08T04:24:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:24:05 smithi096 ceph-mon[124666]: pgmap v1334: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:24:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:24:07 smithi186 ceph-mon[126480]: pgmap v1335: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:24:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:24:07 smithi133 ceph-mon[125939]: pgmap v1335: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:24:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:24:07 smithi096 ceph-mon[124666]: pgmap v1335: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:24:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:24:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2387.613362 secs 2023-05-08T04:24:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:24:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2388.167710 secs 2023-05-08T04:24:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:24:09 smithi186 ceph-mon[126480]: pgmap v1336: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:24:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:24:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2387.613362 secs 2023-05-08T04:24:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:24:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2388.167710 secs 2023-05-08T04:24:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:24:09 smithi133 ceph-mon[125939]: pgmap v1336: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:24:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:24:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2387.613362 secs 2023-05-08T04:24:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:24:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2388.167710 secs 2023-05-08T04:24:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:24:09 smithi096 ceph-mon[124666]: pgmap v1336: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:24:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:24:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2389.443230 secs 2023-05-08T04:24:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:24:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2389.443230 secs 2023-05-08T04:24:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:24:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2389.443230 secs 2023-05-08T04:24:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:24:11 smithi186 ceph-mon[126480]: osdmap e164: 12 total, 12 up, 12 in 2023-05-08T04:24:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:24:11 smithi186 ceph-mon[126480]: pgmap v1338: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:24:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:24:11 smithi133 ceph-mon[125939]: osdmap e164: 12 total, 12 up, 12 in 2023-05-08T04:24:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:24:11 smithi133 ceph-mon[125939]: pgmap v1338: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:24:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:24:11 smithi096 ceph-mon[124666]: osdmap e164: 12 total, 12 up, 12 in 2023-05-08T04:24:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:24:11 smithi096 ceph-mon[124666]: pgmap v1338: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:24:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:24:13 smithi186 ceph-mon[126480]: pgmap v1339: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:24:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:24:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2392.613422 secs 2023-05-08T04:24:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:24:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2393.167861 secs 2023-05-08T04:24:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:24:13 smithi133 ceph-mon[125939]: pgmap v1339: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:24:14.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:24:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2392.613422 secs 2023-05-08T04:24:14.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:24:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2393.167861 secs 2023-05-08T04:24:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:24:13 smithi096 ceph-mon[124666]: pgmap v1339: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:24:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:24:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2392.613422 secs 2023-05-08T04:24:14.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:24:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2393.167861 secs 2023-05-08T04:24:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:24:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:24:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:24:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:24:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:24:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:24:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:24:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:24:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:24:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:24:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:24:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:24:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:24:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:24:15.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:24:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:24:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:24:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:24:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:24:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:24:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:24:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:24:15.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:24:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:24:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:24:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2394.443356 secs 2023-05-08T04:24:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:24:15 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:24:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:24:15 smithi186 ceph-mon[126480]: pgmap v1340: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:24:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:24:15 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T04:24:16.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:24:15 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T04:24:16.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:24:15 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:24:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:24:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2394.443356 secs 2023-05-08T04:24:16.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:24:15 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:24:16.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:24:15 smithi133 ceph-mon[125939]: pgmap v1340: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:24:16.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:24:15 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T04:24:16.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:24:15 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T04:24:16.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:24:15 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:24:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:24:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2394.443356 secs 2023-05-08T04:24:16.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:24:15 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:24:16.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:24:15 smithi096 ceph-mon[124666]: pgmap v1340: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:24:16.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:24:15 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T04:24:16.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:24:15 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T04:24:16.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:24:15 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:24:18.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:24:17 smithi186 ceph-mon[126480]: pgmap v1341: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:24:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:24:17 smithi133 ceph-mon[125939]: pgmap v1341: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:24:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:24:17 smithi096 ceph-mon[124666]: pgmap v1341: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:24:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:24:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2397.613544 secs 2023-05-08T04:24:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:24:19 smithi186 ceph-mon[126480]: osdmap e165: 12 total, 12 up, 12 in 2023-05-08T04:24:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:24:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2398.167956 secs 2023-05-08T04:24:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:24:19 smithi186 ceph-mon[126480]: pgmap v1343: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:24:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:24:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2397.613544 secs 2023-05-08T04:24:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:24:19 smithi133 ceph-mon[125939]: osdmap e165: 12 total, 12 up, 12 in 2023-05-08T04:24:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:24:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2398.167956 secs 2023-05-08T04:24:19.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:24:19 smithi133 ceph-mon[125939]: pgmap v1343: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:24:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:24:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2397.613544 secs 2023-05-08T04:24:19.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:24:19 smithi096 ceph-mon[124666]: osdmap e165: 12 total, 12 up, 12 in 2023-05-08T04:24:19.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:24:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2398.167956 secs 2023-05-08T04:24:19.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:24:19 smithi096 ceph-mon[124666]: pgmap v1343: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:24:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:24:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2399.443474 secs 2023-05-08T04:24:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:24:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2399.443474 secs 2023-05-08T04:24:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:24:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2399.443474 secs 2023-05-08T04:24:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:24:21 smithi186 ceph-mon[126480]: pgmap v1344: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:24:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:24:21 smithi133 ceph-mon[125939]: pgmap v1344: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:24:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:24:21 smithi096 ceph-mon[124666]: pgmap v1344: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:24:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:24:23 smithi186 ceph-mon[126480]: pgmap v1345: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:24:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:24:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2402.613661 secs 2023-05-08T04:24:24.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:24:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2403.168070 secs 2023-05-08T04:24:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:24:23 smithi133 ceph-mon[125939]: pgmap v1345: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:24:24.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:24:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2402.613661 secs 2023-05-08T04:24:24.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:24:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2403.168070 secs 2023-05-08T04:24:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:24:23 smithi096 ceph-mon[124666]: pgmap v1345: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:24:24.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:24:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2402.613661 secs 2023-05-08T04:24:24.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:24:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2403.168070 secs 2023-05-08T04:24:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:24:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2404.443606 secs 2023-05-08T04:24:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:24:25 smithi186 ceph-mon[126480]: pgmap v1346: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:24:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:24:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2404.443606 secs 2023-05-08T04:24:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:24:25 smithi133 ceph-mon[125939]: pgmap v1346: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:24:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:24:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2404.443606 secs 2023-05-08T04:24:26.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:24:25 smithi096 ceph-mon[124666]: pgmap v1346: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:24:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:24:27 smithi186 ceph-mon[126480]: pgmap v1347: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:24:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:24:27 smithi133 ceph-mon[125939]: pgmap v1347: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:24:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:24:27 smithi096 ceph-mon[124666]: pgmap v1347: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:24:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:24:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2407.613796 secs 2023-05-08T04:24:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:24:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2408.168191 secs 2023-05-08T04:24:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:24:29 smithi186 ceph-mon[126480]: pgmap v1348: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T04:24:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:24:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2407.613796 secs 2023-05-08T04:24:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:24:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2408.168191 secs 2023-05-08T04:24:29.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:24:29 smithi133 ceph-mon[125939]: pgmap v1348: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T04:24:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:24:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2407.613796 secs 2023-05-08T04:24:29.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:24:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2408.168191 secs 2023-05-08T04:24:29.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:24:29 smithi096 ceph-mon[124666]: pgmap v1348: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T04:24:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:24:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2409.443708 secs 2023-05-08T04:24:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:24:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2409.443708 secs 2023-05-08T04:24:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:24:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2409.443708 secs 2023-05-08T04:24:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:24:31 smithi186 ceph-mon[126480]: pgmap v1349: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 29 KiB/s wr, 8 op/s 2023-05-08T04:24:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:24:31 smithi133 ceph-mon[125939]: pgmap v1349: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 29 KiB/s wr, 8 op/s 2023-05-08T04:24:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:24:31 smithi096 ceph-mon[124666]: pgmap v1349: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 29 KiB/s wr, 8 op/s 2023-05-08T04:24:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:24:33 smithi186 ceph-mon[126480]: pgmap v1350: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 29 KiB/s wr, 5 op/s 2023-05-08T04:24:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:24:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2412.613933 secs 2023-05-08T04:24:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:24:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2413.168305 secs 2023-05-08T04:24:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:24:33 smithi133 ceph-mon[125939]: pgmap v1350: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 29 KiB/s wr, 5 op/s 2023-05-08T04:24:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:24:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2412.613933 secs 2023-05-08T04:24:34.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:24:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2413.168305 secs 2023-05-08T04:24:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:24:33 smithi096 ceph-mon[124666]: pgmap v1350: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 29 KiB/s wr, 5 op/s 2023-05-08T04:24:34.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:24:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2412.613933 secs 2023-05-08T04:24:34.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:24:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2413.168305 secs 2023-05-08T04:24:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:24:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2414.443834 secs 2023-05-08T04:24:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:24:35 smithi186 ceph-mon[126480]: pgmap v1351: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 73 KiB/s wr, 8 op/s 2023-05-08T04:24:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:24:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2414.443834 secs 2023-05-08T04:24:36.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:24:35 smithi133 ceph-mon[125939]: pgmap v1351: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 73 KiB/s wr, 8 op/s 2023-05-08T04:24:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:24:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2414.443834 secs 2023-05-08T04:24:36.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:24:35 smithi096 ceph-mon[124666]: pgmap v1351: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 73 KiB/s wr, 8 op/s 2023-05-08T04:24:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:24:37 smithi186 ceph-mon[126480]: pgmap v1352: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 73 KiB/s wr, 6 op/s 2023-05-08T04:24:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:24:37 smithi133 ceph-mon[125939]: pgmap v1352: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 73 KiB/s wr, 6 op/s 2023-05-08T04:24:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:24:37 smithi096 ceph-mon[124666]: pgmap v1352: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 73 KiB/s wr, 6 op/s 2023-05-08T04:24:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:24:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2417.614072 secs 2023-05-08T04:24:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:24:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2418.168462 secs 2023-05-08T04:24:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:24:39 smithi186 ceph-mon[126480]: pgmap v1353: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 73 KiB/s wr, 6 op/s 2023-05-08T04:24:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:24:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2417.614072 secs 2023-05-08T04:24:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:24:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2418.168462 secs 2023-05-08T04:24:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:24:39 smithi133 ceph-mon[125939]: pgmap v1353: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 73 KiB/s wr, 6 op/s 2023-05-08T04:24:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:24:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2417.614072 secs 2023-05-08T04:24:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:24:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2418.168462 secs 2023-05-08T04:24:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:24:39 smithi096 ceph-mon[124666]: pgmap v1353: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 73 KiB/s wr, 6 op/s 2023-05-08T04:24:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:24:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2419.443973 secs 2023-05-08T04:24:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:24:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2419.443973 secs 2023-05-08T04:24:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:24:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2419.443973 secs 2023-05-08T04:24:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:24:41 smithi186 ceph-mon[126480]: pgmap v1354: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 79 KiB/s wr, 10 op/s 2023-05-08T04:24:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:24:41 smithi133 ceph-mon[125939]: pgmap v1354: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 79 KiB/s wr, 10 op/s 2023-05-08T04:24:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:24:41 smithi096 ceph-mon[124666]: pgmap v1354: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 79 KiB/s wr, 10 op/s 2023-05-08T04:24:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:24:43 smithi186 ceph-mon[126480]: pgmap v1355: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 50 KiB/s wr, 7 op/s 2023-05-08T04:24:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:24:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2422.614189 secs 2023-05-08T04:24:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:24:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2423.168573 secs 2023-05-08T04:24:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:24:43 smithi133 ceph-mon[125939]: pgmap v1355: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 50 KiB/s wr, 7 op/s 2023-05-08T04:24:44.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:24:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2422.614189 secs 2023-05-08T04:24:44.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:24:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2423.168573 secs 2023-05-08T04:24:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:24:43 smithi096 ceph-mon[124666]: pgmap v1355: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 50 KiB/s wr, 7 op/s 2023-05-08T04:24:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:24:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2422.614189 secs 2023-05-08T04:24:44.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:24:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2423.168573 secs 2023-05-08T04:24:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:24:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2424.444096 secs 2023-05-08T04:24:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:24:45 smithi186 ceph-mon[126480]: pgmap v1356: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 50 KiB/s wr, 10 op/s 2023-05-08T04:24:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:24:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2424.444096 secs 2023-05-08T04:24:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:24:45 smithi133 ceph-mon[125939]: pgmap v1356: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 50 KiB/s wr, 10 op/s 2023-05-08T04:24:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:24:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2424.444096 secs 2023-05-08T04:24:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:24:45 smithi096 ceph-mon[124666]: pgmap v1356: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 50 KiB/s wr, 10 op/s 2023-05-08T04:24:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:24:47 smithi186 ceph-mon[126480]: pgmap v1357: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.6 KiB/s wr, 6 op/s 2023-05-08T04:24:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:24:47 smithi133 ceph-mon[125939]: pgmap v1357: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.6 KiB/s wr, 6 op/s 2023-05-08T04:24:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:24:47 smithi096 ceph-mon[124666]: pgmap v1357: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.6 KiB/s wr, 6 op/s 2023-05-08T04:24:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:24:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2427.614307 secs 2023-05-08T04:24:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:24:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2428.168692 secs 2023-05-08T04:24:49.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:24:49 smithi186 ceph-mon[126480]: pgmap v1358: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.3 KiB/s wr, 6 op/s 2023-05-08T04:24:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:24:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2427.614307 secs 2023-05-08T04:24:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:24:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2428.168692 secs 2023-05-08T04:24:49.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:24:49 smithi133 ceph-mon[125939]: pgmap v1358: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.3 KiB/s wr, 6 op/s 2023-05-08T04:24:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:24:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2427.614307 secs 2023-05-08T04:24:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:24:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2428.168692 secs 2023-05-08T04:24:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:24:49 smithi096 ceph-mon[124666]: pgmap v1358: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.3 KiB/s wr, 6 op/s 2023-05-08T04:24:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:24:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2429.444214 secs 2023-05-08T04:24:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:24:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2429.444214 secs 2023-05-08T04:24:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:24:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2429.444214 secs 2023-05-08T04:24:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:24:51 smithi186 ceph-mon[126480]: pgmap v1359: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 14 KiB/s wr, 9 op/s 2023-05-08T04:24:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:24:51 smithi133 ceph-mon[125939]: pgmap v1359: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 14 KiB/s wr, 9 op/s 2023-05-08T04:24:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:24:51 smithi096 ceph-mon[124666]: pgmap v1359: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 14 KiB/s wr, 9 op/s 2023-05-08T04:24:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:24:53 smithi186 ceph-mon[126480]: pgmap v1360: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 7.2 KiB/s wr, 5 op/s 2023-05-08T04:24:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:24:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2432.614423 secs 2023-05-08T04:24:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:24:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2433.168808 secs 2023-05-08T04:24:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:24:53 smithi133 ceph-mon[125939]: pgmap v1360: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 7.2 KiB/s wr, 5 op/s 2023-05-08T04:24:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:24:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2432.614423 secs 2023-05-08T04:24:54.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:24:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2433.168808 secs 2023-05-08T04:24:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:24:53 smithi096 ceph-mon[124666]: pgmap v1360: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 7.2 KiB/s wr, 5 op/s 2023-05-08T04:24:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:24:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2432.614423 secs 2023-05-08T04:24:54.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:24:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2433.168808 secs 2023-05-08T04:24:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:24:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2434.444354 secs 2023-05-08T04:24:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:24:55 smithi186 ceph-mon[126480]: pgmap v1361: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.2 KiB/s wr, 7 op/s 2023-05-08T04:24:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:24:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2434.444354 secs 2023-05-08T04:24:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:24:55 smithi133 ceph-mon[125939]: pgmap v1361: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.2 KiB/s wr, 7 op/s 2023-05-08T04:24:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:24:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2434.444354 secs 2023-05-08T04:24:56.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:24:55 smithi096 ceph-mon[124666]: pgmap v1361: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.2 KiB/s wr, 7 op/s 2023-05-08T04:24:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:24:57 smithi186 ceph-mon[126480]: pgmap v1362: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 7.2 KiB/s wr, 5 op/s 2023-05-08T04:24:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:24:57 smithi133 ceph-mon[125939]: pgmap v1362: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 7.2 KiB/s wr, 5 op/s 2023-05-08T04:24:58.269 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:24:57 smithi096 ceph-mon[124666]: pgmap v1362: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 7.2 KiB/s wr, 5 op/s 2023-05-08T04:24:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:24:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2437.614545 secs 2023-05-08T04:24:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:24:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2438.168920 secs 2023-05-08T04:24:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:24:59 smithi186 ceph-mon[126480]: pgmap v1363: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 7.2 KiB/s wr, 5 op/s 2023-05-08T04:24:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:24:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2437.614545 secs 2023-05-08T04:24:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:24:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2438.168920 secs 2023-05-08T04:24:59.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:24:59 smithi133 ceph-mon[125939]: pgmap v1363: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 7.2 KiB/s wr, 5 op/s 2023-05-08T04:24:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:24:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2437.614545 secs 2023-05-08T04:24:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:24:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2438.168920 secs 2023-05-08T04:24:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:24:59 smithi096 ceph-mon[124666]: pgmap v1363: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 7.2 KiB/s wr, 5 op/s 2023-05-08T04:25:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2439.444475 secs 2023-05-08T04:25:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2439.444475 secs 2023-05-08T04:25:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2439.444475 secs 2023-05-08T04:25:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:01 smithi186 ceph-mon[126480]: pgmap v1364: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.2 KiB/s wr, 7 op/s 2023-05-08T04:25:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:01 smithi133 ceph-mon[125939]: pgmap v1364: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.2 KiB/s wr, 7 op/s 2023-05-08T04:25:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:01 smithi096 ceph-mon[124666]: pgmap v1364: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.2 KiB/s wr, 7 op/s 2023-05-08T04:25:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:03 smithi186 ceph-mon[126480]: pgmap v1365: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:25:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2442.614663 secs 2023-05-08T04:25:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2443.169012 secs 2023-05-08T04:25:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:03 smithi133 ceph-mon[125939]: pgmap v1365: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:25:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2442.614663 secs 2023-05-08T04:25:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2443.169012 secs 2023-05-08T04:25:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:03 smithi096 ceph-mon[124666]: pgmap v1365: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:25:04.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2442.614663 secs 2023-05-08T04:25:04.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2443.169012 secs 2023-05-08T04:25:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2444.444609 secs 2023-05-08T04:25:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:05 smithi186 ceph-mon[126480]: pgmap v1366: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:25:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2444.444609 secs 2023-05-08T04:25:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:05 smithi133 ceph-mon[125939]: pgmap v1366: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:25:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2444.444609 secs 2023-05-08T04:25:06.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:05 smithi096 ceph-mon[124666]: pgmap v1366: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:25:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:07 smithi186 ceph-mon[126480]: pgmap v1367: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:25:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:07 smithi133 ceph-mon[125939]: pgmap v1367: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:25:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:07 smithi096 ceph-mon[124666]: pgmap v1367: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:25:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2447.614789 secs 2023-05-08T04:25:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2448.169124 secs 2023-05-08T04:25:09.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:09 smithi186 ceph-mon[126480]: pgmap v1368: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:25:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2447.614789 secs 2023-05-08T04:25:09.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2448.169124 secs 2023-05-08T04:25:09.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:09 smithi133 ceph-mon[125939]: pgmap v1368: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:25:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2447.614789 secs 2023-05-08T04:25:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2448.169124 secs 2023-05-08T04:25:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:09 smithi096 ceph-mon[124666]: pgmap v1368: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:25:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2449.444730 secs 2023-05-08T04:25:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2449.444730 secs 2023-05-08T04:25:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2449.444730 secs 2023-05-08T04:25:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:11 smithi133 ceph-mon[125939]: osdmap e166: 12 total, 12 up, 12 in 2023-05-08T04:25:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:11 smithi133 ceph-mon[125939]: pgmap v1370: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:25:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:11 smithi096 ceph-mon[124666]: osdmap e166: 12 total, 12 up, 12 in 2023-05-08T04:25:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:11 smithi096 ceph-mon[124666]: pgmap v1370: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:25:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:11 smithi186 ceph-mon[126480]: osdmap e166: 12 total, 12 up, 12 in 2023-05-08T04:25:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:11 smithi186 ceph-mon[126480]: pgmap v1370: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:25:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:13 smithi186 ceph-mon[126480]: pgmap v1371: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:25:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2452.614910 secs 2023-05-08T04:25:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2453.169243 secs 2023-05-08T04:25:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:13 smithi133 ceph-mon[125939]: pgmap v1371: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:25:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2452.614910 secs 2023-05-08T04:25:14.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2453.169243 secs 2023-05-08T04:25:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:13 smithi096 ceph-mon[124666]: pgmap v1371: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:25:14.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2452.614910 secs 2023-05-08T04:25:14.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2453.169243 secs 2023-05-08T04:25:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2454.444845 secs 2023-05-08T04:25:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:15 smithi186 ceph-mon[126480]: pgmap v1372: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:25:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:15 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:25:16.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:15 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:25:16.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:15 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:25:16.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:15 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:25:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2454.444845 secs 2023-05-08T04:25:16.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:15 smithi133 ceph-mon[125939]: pgmap v1372: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:25:16.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:15 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:25:16.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:15 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:25:16.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:15 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:25:16.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:15 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:25:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2454.444845 secs 2023-05-08T04:25:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:15 smithi096 ceph-mon[124666]: pgmap v1372: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:25:16.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:15 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:25:16.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:15 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:25:16.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:15 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:25:16.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:15 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:25:17.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:16 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:25:17.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:16 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T04:25:17.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:16 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T04:25:17.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:16 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:25:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:16 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:25:17.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:16 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T04:25:17.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:16 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T04:25:17.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:16 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:25:17.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:16 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:25:17.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:16 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T04:25:17.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:16 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T04:25:17.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:16 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:25:18.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:17 smithi186 ceph-mon[126480]: pgmap v1373: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:25:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:17 smithi133 ceph-mon[125939]: pgmap v1373: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:25:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:17 smithi096 ceph-mon[124666]: pgmap v1373: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:25:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2457.615025 secs 2023-05-08T04:25:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:19 smithi186 ceph-mon[126480]: osdmap e167: 12 total, 12 up, 12 in 2023-05-08T04:25:19.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2458.169387 secs 2023-05-08T04:25:19.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:19 smithi186 ceph-mon[126480]: pgmap v1375: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:25:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2457.615025 secs 2023-05-08T04:25:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:19 smithi133 ceph-mon[125939]: osdmap e167: 12 total, 12 up, 12 in 2023-05-08T04:25:19.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2458.169387 secs 2023-05-08T04:25:19.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:19 smithi133 ceph-mon[125939]: pgmap v1375: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:25:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2457.615025 secs 2023-05-08T04:25:19.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:19 smithi096 ceph-mon[124666]: osdmap e167: 12 total, 12 up, 12 in 2023-05-08T04:25:19.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2458.169387 secs 2023-05-08T04:25:19.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:19 smithi096 ceph-mon[124666]: pgmap v1375: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:25:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2459.444918 secs 2023-05-08T04:25:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2459.444918 secs 2023-05-08T04:25:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2459.444918 secs 2023-05-08T04:25:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:21 smithi133 ceph-mon[125939]: pgmap v1376: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:25:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:21 smithi096 ceph-mon[124666]: pgmap v1376: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:25:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:21 smithi186 ceph-mon[126480]: pgmap v1376: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:25:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:23 smithi186 ceph-mon[126480]: pgmap v1377: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:25:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2462.615185 secs 2023-05-08T04:25:24.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2463.169519 secs 2023-05-08T04:25:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:23 smithi133 ceph-mon[125939]: pgmap v1377: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:25:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2462.615185 secs 2023-05-08T04:25:24.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2463.169519 secs 2023-05-08T04:25:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:23 smithi096 ceph-mon[124666]: pgmap v1377: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:25:24.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2462.615185 secs 2023-05-08T04:25:24.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2463.169519 secs 2023-05-08T04:25:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2464.445012 secs 2023-05-08T04:25:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:25 smithi186 ceph-mon[126480]: pgmap v1378: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:25:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2464.445012 secs 2023-05-08T04:25:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:25 smithi133 ceph-mon[125939]: pgmap v1378: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:25:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2464.445012 secs 2023-05-08T04:25:26.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:25 smithi096 ceph-mon[124666]: pgmap v1378: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:25:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:27 smithi186 ceph-mon[126480]: pgmap v1379: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:25:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:27 smithi133 ceph-mon[125939]: pgmap v1379: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:25:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:27 smithi096 ceph-mon[124666]: pgmap v1379: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:25:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2467.615305 secs 2023-05-08T04:25:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2468.169669 secs 2023-05-08T04:25:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:29 smithi186 ceph-mon[126480]: pgmap v1380: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T04:25:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2467.615305 secs 2023-05-08T04:25:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2468.169669 secs 2023-05-08T04:25:29.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:29 smithi133 ceph-mon[125939]: pgmap v1380: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T04:25:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2467.615305 secs 2023-05-08T04:25:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2468.169669 secs 2023-05-08T04:25:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:29 smithi096 ceph-mon[124666]: pgmap v1380: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T04:25:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:31 smithi186 ceph-mon[126480]: pgmap v1381: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 30 KiB/s wr, 8 op/s 2023-05-08T04:25:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:31 smithi133 ceph-mon[125939]: pgmap v1381: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 30 KiB/s wr, 8 op/s 2023-05-08T04:25:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:31 smithi096 ceph-mon[124666]: pgmap v1381: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 30 KiB/s wr, 8 op/s 2023-05-08T04:25:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:33 smithi186 ceph-mon[126480]: pgmap v1382: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 30 KiB/s wr, 5 op/s 2023-05-08T04:25:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2472.615409 secs 2023-05-08T04:25:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2473.169786 secs 2023-05-08T04:25:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:33 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:25:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:33 smithi133 ceph-mon[125939]: pgmap v1382: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 30 KiB/s wr, 5 op/s 2023-05-08T04:25:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2472.615409 secs 2023-05-08T04:25:34.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2473.169786 secs 2023-05-08T04:25:34.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:33 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:25:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:33 smithi096 ceph-mon[124666]: pgmap v1382: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 30 KiB/s wr, 5 op/s 2023-05-08T04:25:34.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2472.615409 secs 2023-05-08T04:25:34.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2473.169786 secs 2023-05-08T04:25:34.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:33 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:25:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:34 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:25:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:34 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:25:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:34 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:25:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:34 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:25:35.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:34 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:25:35.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:34 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:25:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:34 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:25:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:34 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:25:35.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:34 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:25:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2474.445222 secs 2023-05-08T04:25:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:35 smithi186 ceph-mon[126480]: pgmap v1383: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 75 KiB/s wr, 9 op/s 2023-05-08T04:25:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2474.445222 secs 2023-05-08T04:25:36.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:35 smithi133 ceph-mon[125939]: pgmap v1383: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 75 KiB/s wr, 9 op/s 2023-05-08T04:25:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2474.445222 secs 2023-05-08T04:25:36.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:35 smithi096 ceph-mon[124666]: pgmap v1383: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 75 KiB/s wr, 9 op/s 2023-05-08T04:25:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:37 smithi186 ceph-mon[126480]: pgmap v1384: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 75 KiB/s wr, 6 op/s 2023-05-08T04:25:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:37 smithi133 ceph-mon[125939]: pgmap v1384: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 75 KiB/s wr, 6 op/s 2023-05-08T04:25:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:37 smithi096 ceph-mon[124666]: pgmap v1384: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 75 KiB/s wr, 6 op/s 2023-05-08T04:25:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:38 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:25:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:38 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:25:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2477.615521 secs 2023-05-08T04:25:39.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2478.169916 secs 2023-05-08T04:25:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:38 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:25:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:38 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:25:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2477.615521 secs 2023-05-08T04:25:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2478.169916 secs 2023-05-08T04:25:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:38 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:25:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:38 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:25:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2477.615521 secs 2023-05-08T04:25:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2478.169916 secs 2023-05-08T04:25:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:39 smithi186 ceph-mon[126480]: pgmap v1385: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 75 KiB/s wr, 6 op/s 2023-05-08T04:25:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:39 smithi133 ceph-mon[125939]: pgmap v1385: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 75 KiB/s wr, 6 op/s 2023-05-08T04:25:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:39 smithi096 ceph-mon[124666]: pgmap v1385: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 75 KiB/s wr, 6 op/s 2023-05-08T04:25:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2479.445344 secs 2023-05-08T04:25:41.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2479.445344 secs 2023-05-08T04:25:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2479.445344 secs 2023-05-08T04:25:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:41 smithi186 ceph-mon[126480]: pgmap v1386: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 82 KiB/s wr, 10 op/s 2023-05-08T04:25:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:41 smithi133 ceph-mon[125939]: pgmap v1386: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 82 KiB/s wr, 10 op/s 2023-05-08T04:25:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:41 smithi096 ceph-mon[124666]: pgmap v1386: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 82 KiB/s wr, 10 op/s 2023-05-08T04:25:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:43 smithi186 ceph-mon[126480]: pgmap v1387: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 52 KiB/s wr, 7 op/s 2023-05-08T04:25:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2482.615637 secs 2023-05-08T04:25:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:43 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:25:44.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2483.170057 secs 2023-05-08T04:25:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:43 smithi133 ceph-mon[125939]: pgmap v1387: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 52 KiB/s wr, 7 op/s 2023-05-08T04:25:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2482.615637 secs 2023-05-08T04:25:44.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:43 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:25:44.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2483.170057 secs 2023-05-08T04:25:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:43 smithi096 ceph-mon[124666]: pgmap v1387: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 52 KiB/s wr, 7 op/s 2023-05-08T04:25:44.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2482.615637 secs 2023-05-08T04:25:44.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:43 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:25:44.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2483.170057 secs 2023-05-08T04:25:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2484.445467 secs 2023-05-08T04:25:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:45 smithi186 ceph-mon[126480]: pgmap v1388: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 52 KiB/s wr, 10 op/s 2023-05-08T04:25:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2484.445467 secs 2023-05-08T04:25:46.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:45 smithi133 ceph-mon[125939]: pgmap v1388: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 52 KiB/s wr, 10 op/s 2023-05-08T04:25:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2484.445467 secs 2023-05-08T04:25:46.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:45 smithi096 ceph-mon[124666]: pgmap v1388: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 52 KiB/s wr, 10 op/s 2023-05-08T04:25:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:47 smithi186 ceph-mon[126480]: pgmap v1389: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.4 KiB/s wr, 6 op/s 2023-05-08T04:25:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:47 smithi133 ceph-mon[125939]: pgmap v1389: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.4 KiB/s wr, 6 op/s 2023-05-08T04:25:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:47 smithi096 ceph-mon[124666]: pgmap v1389: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.4 KiB/s wr, 6 op/s 2023-05-08T04:25:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2487.615757 secs 2023-05-08T04:25:49.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2488.170186 secs 2023-05-08T04:25:49.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:49 smithi133 ceph-mon[125939]: pgmap v1390: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.4 KiB/s wr, 6 op/s 2023-05-08T04:25:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2487.615757 secs 2023-05-08T04:25:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2488.170186 secs 2023-05-08T04:25:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:49 smithi096 ceph-mon[124666]: pgmap v1390: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.4 KiB/s wr, 6 op/s 2023-05-08T04:25:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2487.615757 secs 2023-05-08T04:25:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2488.170186 secs 2023-05-08T04:25:49.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:49 smithi186 ceph-mon[126480]: pgmap v1390: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.4 KiB/s wr, 6 op/s 2023-05-08T04:25:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2489.445603 secs 2023-05-08T04:25:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2489.445603 secs 2023-05-08T04:25:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2489.445603 secs 2023-05-08T04:25:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:51 smithi133 ceph-mon[125939]: pgmap v1391: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 14 KiB/s wr, 9 op/s 2023-05-08T04:25:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:51 smithi096 ceph-mon[124666]: pgmap v1391: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 14 KiB/s wr, 9 op/s 2023-05-08T04:25:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:51 smithi186 ceph-mon[126480]: pgmap v1391: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 14 KiB/s wr, 9 op/s 2023-05-08T04:25:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:53 smithi186 ceph-mon[126480]: pgmap v1392: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 7.4 KiB/s wr, 5 op/s 2023-05-08T04:25:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2492.615875 secs 2023-05-08T04:25:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2493.170306 secs 2023-05-08T04:25:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:53 smithi133 ceph-mon[125939]: pgmap v1392: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 7.4 KiB/s wr, 5 op/s 2023-05-08T04:25:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2492.615875 secs 2023-05-08T04:25:54.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2493.170306 secs 2023-05-08T04:25:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:53 smithi096 ceph-mon[124666]: pgmap v1392: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 7.4 KiB/s wr, 5 op/s 2023-05-08T04:25:54.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2492.615875 secs 2023-05-08T04:25:54.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2493.170306 secs 2023-05-08T04:25:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2494.445748 secs 2023-05-08T04:25:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:55 smithi186 ceph-mon[126480]: pgmap v1393: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.4 KiB/s wr, 7 op/s 2023-05-08T04:25:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2494.445748 secs 2023-05-08T04:25:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:55 smithi133 ceph-mon[125939]: pgmap v1393: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.4 KiB/s wr, 7 op/s 2023-05-08T04:25:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2494.445748 secs 2023-05-08T04:25:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:55 smithi096 ceph-mon[124666]: pgmap v1393: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.4 KiB/s wr, 7 op/s 2023-05-08T04:25:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:57 smithi186 ceph-mon[126480]: pgmap v1394: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 7.4 KiB/s wr, 5 op/s 2023-05-08T04:25:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:57 smithi133 ceph-mon[125939]: pgmap v1394: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 7.4 KiB/s wr, 5 op/s 2023-05-08T04:25:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:57 smithi096 ceph-mon[124666]: pgmap v1394: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 7.4 KiB/s wr, 5 op/s 2023-05-08T04:25:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2497.616010 secs 2023-05-08T04:25:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2498.170426 secs 2023-05-08T04:25:59.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:25:59 smithi133 ceph-mon[125939]: pgmap v1395: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 7.4 KiB/s wr, 5 op/s 2023-05-08T04:25:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2497.616010 secs 2023-05-08T04:25:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2498.170426 secs 2023-05-08T04:25:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:25:59 smithi096 ceph-mon[124666]: pgmap v1395: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 7.4 KiB/s wr, 5 op/s 2023-05-08T04:25:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2497.616010 secs 2023-05-08T04:25:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2498.170426 secs 2023-05-08T04:25:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:25:59 smithi186 ceph-mon[126480]: pgmap v1395: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 7.4 KiB/s wr, 5 op/s 2023-05-08T04:26:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2499.445846 secs 2023-05-08T04:26:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2499.445846 secs 2023-05-08T04:26:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2499.445846 secs 2023-05-08T04:26:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:01 smithi133 ceph-mon[125939]: pgmap v1396: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.4 KiB/s wr, 7 op/s 2023-05-08T04:26:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:01 smithi096 ceph-mon[124666]: pgmap v1396: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.4 KiB/s wr, 7 op/s 2023-05-08T04:26:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:01 smithi186 ceph-mon[126480]: pgmap v1396: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.4 KiB/s wr, 7 op/s 2023-05-08T04:26:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:03 smithi186 ceph-mon[126480]: pgmap v1397: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:26:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2502.616111 secs 2023-05-08T04:26:04.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2503.170547 secs 2023-05-08T04:26:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:03 smithi133 ceph-mon[125939]: pgmap v1397: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:26:04.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2502.616111 secs 2023-05-08T04:26:04.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2503.170547 secs 2023-05-08T04:26:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:03 smithi096 ceph-mon[124666]: pgmap v1397: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:26:04.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2502.616111 secs 2023-05-08T04:26:04.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2503.170547 secs 2023-05-08T04:26:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2504.445926 secs 2023-05-08T04:26:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:05 smithi186 ceph-mon[126480]: pgmap v1398: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:26:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2504.445926 secs 2023-05-08T04:26:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:05 smithi133 ceph-mon[125939]: pgmap v1398: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:26:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2504.445926 secs 2023-05-08T04:26:06.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:05 smithi096 ceph-mon[124666]: pgmap v1398: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:26:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:07 smithi186 ceph-mon[126480]: pgmap v1399: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:26:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:07 smithi133 ceph-mon[125939]: pgmap v1399: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:26:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:07 smithi096 ceph-mon[124666]: pgmap v1399: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:26:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2507.616238 secs 2023-05-08T04:26:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2508.170662 secs 2023-05-08T04:26:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:09 smithi133 ceph-mon[125939]: pgmap v1400: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:26:09.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2507.616238 secs 2023-05-08T04:26:09.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2508.170662 secs 2023-05-08T04:26:09.509 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:09 smithi096 ceph-mon[124666]: pgmap v1400: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:26:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2507.616238 secs 2023-05-08T04:26:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2508.170662 secs 2023-05-08T04:26:09.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:09 smithi186 ceph-mon[126480]: pgmap v1400: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:26:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2509.445997 secs 2023-05-08T04:26:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2509.445997 secs 2023-05-08T04:26:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2509.445997 secs 2023-05-08T04:26:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:11 smithi133 ceph-mon[125939]: osdmap e168: 12 total, 12 up, 12 in 2023-05-08T04:26:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:11 smithi133 ceph-mon[125939]: pgmap v1402: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:26:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:11 smithi096 ceph-mon[124666]: osdmap e168: 12 total, 12 up, 12 in 2023-05-08T04:26:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:11 smithi096 ceph-mon[124666]: pgmap v1402: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:26:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:11 smithi186 ceph-mon[126480]: osdmap e168: 12 total, 12 up, 12 in 2023-05-08T04:26:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:11 smithi186 ceph-mon[126480]: pgmap v1402: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:26:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:13 smithi186 ceph-mon[126480]: pgmap v1403: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:26:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2512.616371 secs 2023-05-08T04:26:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2513.170783 secs 2023-05-08T04:26:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:13 smithi133 ceph-mon[125939]: pgmap v1403: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:26:14.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2512.616371 secs 2023-05-08T04:26:14.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2513.170783 secs 2023-05-08T04:26:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:13 smithi096 ceph-mon[124666]: pgmap v1403: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:26:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2512.616371 secs 2023-05-08T04:26:14.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2513.170783 secs 2023-05-08T04:26:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2514.446108 secs 2023-05-08T04:26:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:15 smithi186 ceph-mon[126480]: pgmap v1404: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:26:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:15 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:26:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2514.446108 secs 2023-05-08T04:26:16.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:15 smithi133 ceph-mon[125939]: pgmap v1404: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:26:16.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:15 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:26:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2514.446108 secs 2023-05-08T04:26:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:15 smithi096 ceph-mon[124666]: pgmap v1404: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:26:16.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:15 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:26:17.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:17 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:26:17.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:17 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:26:17.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:17 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:26:17.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:17 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:26:17.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:17 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:26:17.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:17 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:26:17.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:17 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:26:17.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:17 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:26:17.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:17 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:26:17.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:17 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:26:17.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:17 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T04:26:17.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:17 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T04:26:17.373 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:17 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:26:17.373 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:17 smithi186 ceph-mon[126480]: pgmap v1405: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:26:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:17 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:26:17.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:17 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:26:17.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:17 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:26:17.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:17 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:26:17.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:17 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:26:17.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:17 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:26:17.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:17 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:26:17.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:17 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:26:17.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:17 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:26:17.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:17 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:26:17.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:17 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T04:26:17.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:17 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T04:26:17.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:17 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:26:17.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:17 smithi133 ceph-mon[125939]: pgmap v1405: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:26:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:17 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:26:17.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:17 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:26:17.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:17 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:26:17.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:17 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:26:17.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:17 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:26:17.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:17 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:26:17.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:17 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:26:17.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:17 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:26:17.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:17 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:26:17.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:17 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:26:17.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:17 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T04:26:17.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:17 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T04:26:17.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:17 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:26:17.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:17 smithi096 ceph-mon[124666]: pgmap v1405: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:26:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2517.616486 secs 2023-05-08T04:26:19.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:19 smithi133 ceph-mon[125939]: osdmap e169: 12 total, 12 up, 12 in 2023-05-08T04:26:19.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2518.170905 secs 2023-05-08T04:26:19.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:19 smithi133 ceph-mon[125939]: pgmap v1407: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:26:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2517.616486 secs 2023-05-08T04:26:19.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:19 smithi096 ceph-mon[124666]: osdmap e169: 12 total, 12 up, 12 in 2023-05-08T04:26:19.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2518.170905 secs 2023-05-08T04:26:19.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:19 smithi096 ceph-mon[124666]: pgmap v1407: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:26:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2517.616486 secs 2023-05-08T04:26:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:19 smithi186 ceph-mon[126480]: osdmap e169: 12 total, 12 up, 12 in 2023-05-08T04:26:19.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2518.170905 secs 2023-05-08T04:26:19.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:19 smithi186 ceph-mon[126480]: pgmap v1407: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:26:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2519.446223 secs 2023-05-08T04:26:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2519.446223 secs 2023-05-08T04:26:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2519.446223 secs 2023-05-08T04:26:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:21 smithi133 ceph-mon[125939]: pgmap v1408: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:26:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:21 smithi096 ceph-mon[124666]: pgmap v1408: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:26:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:21 smithi186 ceph-mon[126480]: pgmap v1408: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:26:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:23 smithi186 ceph-mon[126480]: pgmap v1409: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:26:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2522.616565 secs 2023-05-08T04:26:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2523.171032 secs 2023-05-08T04:26:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:23 smithi133 ceph-mon[125939]: pgmap v1409: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:26:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2522.616565 secs 2023-05-08T04:26:24.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2523.171032 secs 2023-05-08T04:26:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:23 smithi096 ceph-mon[124666]: pgmap v1409: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:26:24.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2522.616565 secs 2023-05-08T04:26:24.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2523.171032 secs 2023-05-08T04:26:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2524.446347 secs 2023-05-08T04:26:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:25 smithi186 ceph-mon[126480]: pgmap v1410: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:26:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2524.446347 secs 2023-05-08T04:26:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:25 smithi133 ceph-mon[125939]: pgmap v1410: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:26:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2524.446347 secs 2023-05-08T04:26:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:25 smithi096 ceph-mon[124666]: pgmap v1410: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:26:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:27 smithi186 ceph-mon[126480]: pgmap v1411: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:26:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:27 smithi133 ceph-mon[125939]: pgmap v1411: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:26:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:27 smithi096 ceph-mon[124666]: pgmap v1411: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:26:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2527.616685 secs 2023-05-08T04:26:29.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2528.171153 secs 2023-05-08T04:26:29.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:29 smithi133 ceph-mon[125939]: pgmap v1412: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T04:26:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2527.616685 secs 2023-05-08T04:26:29.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2528.171153 secs 2023-05-08T04:26:29.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:29 smithi096 ceph-mon[124666]: pgmap v1412: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T04:26:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2527.616685 secs 2023-05-08T04:26:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2528.171153 secs 2023-05-08T04:26:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:29 smithi186 ceph-mon[126480]: pgmap v1412: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T04:26:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:31 smithi186 ceph-mon[126480]: pgmap v1413: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 32 KiB/s wr, 8 op/s 2023-05-08T04:26:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:31 smithi133 ceph-mon[125939]: pgmap v1413: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 32 KiB/s wr, 8 op/s 2023-05-08T04:26:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:31 smithi096 ceph-mon[124666]: pgmap v1413: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 32 KiB/s wr, 8 op/s 2023-05-08T04:26:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:33 smithi186 ceph-mon[126480]: pgmap v1414: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 32 KiB/s wr, 5 op/s 2023-05-08T04:26:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2532.616779 secs 2023-05-08T04:26:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2533.171294 secs 2023-05-08T04:26:34.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:33 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:26:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:33 smithi133 ceph-mon[125939]: pgmap v1414: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 32 KiB/s wr, 5 op/s 2023-05-08T04:26:34.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2532.616779 secs 2023-05-08T04:26:34.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2533.171294 secs 2023-05-08T04:26:34.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:33 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:26:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:33 smithi096 ceph-mon[124666]: pgmap v1414: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 32 KiB/s wr, 5 op/s 2023-05-08T04:26:34.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2532.616779 secs 2023-05-08T04:26:34.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2533.171294 secs 2023-05-08T04:26:34.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:33 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:26:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:34 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:26:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:34 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:26:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:34 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:26:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:34 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:26:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:34 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:26:35.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:34 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:26:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:34 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:26:35.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:34 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:26:35.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:34 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:26:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2534.446584 secs 2023-05-08T04:26:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:35 smithi186 ceph-mon[126480]: pgmap v1415: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 94 KiB/s wr, 9 op/s 2023-05-08T04:26:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2534.446584 secs 2023-05-08T04:26:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:35 smithi133 ceph-mon[125939]: pgmap v1415: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 94 KiB/s wr, 9 op/s 2023-05-08T04:26:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2534.446584 secs 2023-05-08T04:26:36.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:35 smithi096 ceph-mon[124666]: pgmap v1415: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 94 KiB/s wr, 9 op/s 2023-05-08T04:26:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:37 smithi186 ceph-mon[126480]: pgmap v1416: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 94 KiB/s wr, 7 op/s 2023-05-08T04:26:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:37 smithi133 ceph-mon[125939]: pgmap v1416: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 94 KiB/s wr, 7 op/s 2023-05-08T04:26:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:37 smithi096 ceph-mon[124666]: pgmap v1416: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 94 KiB/s wr, 7 op/s 2023-05-08T04:26:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:38 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:26:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:38 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:26:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2537.616844 secs 2023-05-08T04:26:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2538.171414 secs 2023-05-08T04:26:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:38 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:26:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:38 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:26:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2537.616844 secs 2023-05-08T04:26:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2538.171414 secs 2023-05-08T04:26:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:38 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:26:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:38 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:26:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2537.616844 secs 2023-05-08T04:26:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2538.171414 secs 2023-05-08T04:26:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:39 smithi186 ceph-mon[126480]: pgmap v1417: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 94 KiB/s wr, 7 op/s 2023-05-08T04:26:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:39 smithi133 ceph-mon[125939]: pgmap v1417: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 94 KiB/s wr, 7 op/s 2023-05-08T04:26:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:39 smithi096 ceph-mon[124666]: pgmap v1417: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 94 KiB/s wr, 7 op/s 2023-05-08T04:26:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2539.446700 secs 2023-05-08T04:26:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2539.446700 secs 2023-05-08T04:26:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2539.446700 secs 2023-05-08T04:26:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:41 smithi133 ceph-mon[125939]: pgmap v1418: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 104 KiB/s wr, 11 op/s 2023-05-08T04:26:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:41 smithi096 ceph-mon[124666]: pgmap v1418: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 104 KiB/s wr, 11 op/s 2023-05-08T04:26:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:41 smithi186 ceph-mon[126480]: pgmap v1418: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 104 KiB/s wr, 11 op/s 2023-05-08T04:26:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:43 smithi133 ceph-mon[125939]: pgmap v1419: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 72 KiB/s wr, 8 op/s 2023-05-08T04:26:44.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2542.616907 secs 2023-05-08T04:26:44.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:43 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:26:44.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2543.171531 secs 2023-05-08T04:26:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:43 smithi096 ceph-mon[124666]: pgmap v1419: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 72 KiB/s wr, 8 op/s 2023-05-08T04:26:44.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2542.616907 secs 2023-05-08T04:26:44.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:43 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:26:44.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2543.171531 secs 2023-05-08T04:26:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:43 smithi186 ceph-mon[126480]: pgmap v1419: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 72 KiB/s wr, 8 op/s 2023-05-08T04:26:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2542.616907 secs 2023-05-08T04:26:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:43 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:26:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2543.171531 secs 2023-05-08T04:26:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2544.446817 secs 2023-05-08T04:26:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:45 smithi133 ceph-mon[125939]: pgmap v1420: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 72 KiB/s wr, 11 op/s 2023-05-08T04:26:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2544.446817 secs 2023-05-08T04:26:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:45 smithi096 ceph-mon[124666]: pgmap v1420: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 72 KiB/s wr, 11 op/s 2023-05-08T04:26:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2544.446817 secs 2023-05-08T04:26:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:45 smithi186 ceph-mon[126480]: pgmap v1420: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 72 KiB/s wr, 11 op/s 2023-05-08T04:26:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:47 smithi133 ceph-mon[125939]: pgmap v1421: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 10 KiB/s wr, 7 op/s 2023-05-08T04:26:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:47 smithi096 ceph-mon[124666]: pgmap v1421: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 10 KiB/s wr, 7 op/s 2023-05-08T04:26:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:47 smithi186 ceph-mon[126480]: pgmap v1421: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 10 KiB/s wr, 7 op/s 2023-05-08T04:26:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2547.617002 secs 2023-05-08T04:26:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2548.171597 secs 2023-05-08T04:26:49.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:49 smithi133 ceph-mon[125939]: pgmap v1422: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 10 KiB/s wr, 7 op/s 2023-05-08T04:26:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2547.617002 secs 2023-05-08T04:26:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2548.171597 secs 2023-05-08T04:26:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:49 smithi096 ceph-mon[124666]: pgmap v1422: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 10 KiB/s wr, 7 op/s 2023-05-08T04:26:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2547.617002 secs 2023-05-08T04:26:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2548.171597 secs 2023-05-08T04:26:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:49 smithi186 ceph-mon[126480]: pgmap v1422: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 10 KiB/s wr, 7 op/s 2023-05-08T04:26:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2549.446953 secs 2023-05-08T04:26:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2549.446953 secs 2023-05-08T04:26:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2549.446953 secs 2023-05-08T04:26:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:51 smithi133 ceph-mon[125939]: pgmap v1423: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 16 KiB/s wr, 10 op/s 2023-05-08T04:26:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:51 smithi096 ceph-mon[124666]: pgmap v1423: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 16 KiB/s wr, 10 op/s 2023-05-08T04:26:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:51 smithi186 ceph-mon[126480]: pgmap v1423: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 16 KiB/s wr, 10 op/s 2023-05-08T04:26:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:53 smithi186 ceph-mon[126480]: pgmap v1424: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.8 KiB/s wr, 5 op/s 2023-05-08T04:26:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2552.617102 secs 2023-05-08T04:26:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2553.171668 secs 2023-05-08T04:26:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:53 smithi133 ceph-mon[125939]: pgmap v1424: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.8 KiB/s wr, 5 op/s 2023-05-08T04:26:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2552.617102 secs 2023-05-08T04:26:54.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2553.171668 secs 2023-05-08T04:26:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:53 smithi096 ceph-mon[124666]: pgmap v1424: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.8 KiB/s wr, 5 op/s 2023-05-08T04:26:54.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2552.617102 secs 2023-05-08T04:26:54.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2553.171668 secs 2023-05-08T04:26:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2554.447027 secs 2023-05-08T04:26:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:55 smithi186 ceph-mon[126480]: pgmap v1425: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 5.8 KiB/s wr, 8 op/s 2023-05-08T04:26:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2554.447027 secs 2023-05-08T04:26:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:55 smithi133 ceph-mon[125939]: pgmap v1425: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 5.8 KiB/s wr, 8 op/s 2023-05-08T04:26:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2554.447027 secs 2023-05-08T04:26:56.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:55 smithi096 ceph-mon[124666]: pgmap v1425: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 5.8 KiB/s wr, 8 op/s 2023-05-08T04:26:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:57 smithi186 ceph-mon[126480]: pgmap v1426: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.8 KiB/s wr, 5 op/s 2023-05-08T04:26:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:57 smithi133 ceph-mon[125939]: pgmap v1426: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.8 KiB/s wr, 5 op/s 2023-05-08T04:26:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:57 smithi096 ceph-mon[124666]: pgmap v1426: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.8 KiB/s wr, 5 op/s 2023-05-08T04:26:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2557.617244 secs 2023-05-08T04:26:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2558.171791 secs 2023-05-08T04:26:59.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:26:59 smithi133 ceph-mon[125939]: pgmap v1427: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.8 KiB/s wr, 5 op/s 2023-05-08T04:26:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2557.617244 secs 2023-05-08T04:26:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2558.171791 secs 2023-05-08T04:26:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:26:59 smithi096 ceph-mon[124666]: pgmap v1427: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.8 KiB/s wr, 5 op/s 2023-05-08T04:26:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2557.617244 secs 2023-05-08T04:26:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2558.171791 secs 2023-05-08T04:26:59.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:26:59 smithi186 ceph-mon[126480]: pgmap v1427: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.8 KiB/s wr, 5 op/s 2023-05-08T04:27:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2559.447143 secs 2023-05-08T04:27:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2559.447143 secs 2023-05-08T04:27:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2559.447143 secs 2023-05-08T04:27:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:01 smithi133 ceph-mon[125939]: pgmap v1428: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 5.8 KiB/s wr, 7 op/s 2023-05-08T04:27:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:01 smithi096 ceph-mon[124666]: pgmap v1428: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 5.8 KiB/s wr, 7 op/s 2023-05-08T04:27:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:01 smithi186 ceph-mon[126480]: pgmap v1428: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 5.8 KiB/s wr, 7 op/s 2023-05-08T04:27:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:03 smithi186 ceph-mon[126480]: pgmap v1429: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:27:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2562.617319 secs 2023-05-08T04:27:04.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2563.171910 secs 2023-05-08T04:27:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:03 smithi133 ceph-mon[125939]: pgmap v1429: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:27:04.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2562.617319 secs 2023-05-08T04:27:04.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2563.171910 secs 2023-05-08T04:27:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:03 smithi096 ceph-mon[124666]: pgmap v1429: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:27:04.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2562.617319 secs 2023-05-08T04:27:04.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2563.171910 secs 2023-05-08T04:27:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2564.447264 secs 2023-05-08T04:27:05.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:05 smithi133 ceph-mon[125939]: pgmap v1430: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:27:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2564.447264 secs 2023-05-08T04:27:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:05 smithi186 ceph-mon[126480]: pgmap v1430: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:27:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2564.447264 secs 2023-05-08T04:27:06.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:05 smithi096 ceph-mon[124666]: pgmap v1430: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:27:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:07 smithi186 ceph-mon[126480]: pgmap v1431: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:27:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:07 smithi133 ceph-mon[125939]: pgmap v1431: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:27:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:07 smithi096 ceph-mon[124666]: pgmap v1431: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:27:09.419 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2567.617439 secs 2023-05-08T04:27:09.420 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2568.172038 secs 2023-05-08T04:27:09.420 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:09 smithi133 ceph-mon[125939]: pgmap v1432: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:27:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2567.617439 secs 2023-05-08T04:27:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2568.172038 secs 2023-05-08T04:27:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:09 smithi096 ceph-mon[124666]: pgmap v1432: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:27:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2567.617439 secs 2023-05-08T04:27:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2568.172038 secs 2023-05-08T04:27:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:09 smithi186 ceph-mon[126480]: pgmap v1432: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:27:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2569.447404 secs 2023-05-08T04:27:10.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2569.447404 secs 2023-05-08T04:27:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2569.447404 secs 2023-05-08T04:27:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:11 smithi133 ceph-mon[125939]: osdmap e170: 12 total, 12 up, 12 in 2023-05-08T04:27:11.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:11 smithi133 ceph-mon[125939]: pgmap v1434: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:27:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:11 smithi096 ceph-mon[124666]: osdmap e170: 12 total, 12 up, 12 in 2023-05-08T04:27:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:11 smithi096 ceph-mon[124666]: pgmap v1434: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:27:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:11 smithi186 ceph-mon[126480]: osdmap e170: 12 total, 12 up, 12 in 2023-05-08T04:27:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:11 smithi186 ceph-mon[126480]: pgmap v1434: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:27:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:13 smithi186 ceph-mon[126480]: pgmap v1435: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:27:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2572.617517 secs 2023-05-08T04:27:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2573.172185 secs 2023-05-08T04:27:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:13 smithi133 ceph-mon[125939]: pgmap v1435: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:27:14.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2572.617517 secs 2023-05-08T04:27:14.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2573.172185 secs 2023-05-08T04:27:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:13 smithi096 ceph-mon[124666]: pgmap v1435: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:27:14.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2572.617517 secs 2023-05-08T04:27:14.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2573.172185 secs 2023-05-08T04:27:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2574.447537 secs 2023-05-08T04:27:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:15 smithi186 ceph-mon[126480]: pgmap v1436: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:27:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2574.447537 secs 2023-05-08T04:27:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:15 smithi133 ceph-mon[125939]: pgmap v1436: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:27:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2574.447537 secs 2023-05-08T04:27:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:15 smithi096 ceph-mon[124666]: pgmap v1436: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:27:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:16 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:27:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:16 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:27:17.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:16 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:27:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:17 smithi133 ceph-mon[125939]: pgmap v1437: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:27:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:17 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:27:18.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:17 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:27:18.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:17 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:27:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:17 smithi096 ceph-mon[124666]: pgmap v1437: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:27:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:17 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:27:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:17 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:27:18.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:17 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:27:18.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:17 smithi186 ceph-mon[126480]: pgmap v1437: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:27:18.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:17 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:27:18.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:17 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:27:18.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:17 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:27:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:18 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:27:19.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:18 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T04:27:19.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:18 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T04:27:19.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:18 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:27:19.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2577.617579 secs 2023-05-08T04:27:19.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:18 smithi133 ceph-mon[125939]: osdmap e171: 12 total, 12 up, 12 in 2023-05-08T04:27:19.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2578.172320 secs 2023-05-08T04:27:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:18 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:27:19.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:18 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T04:27:19.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:18 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T04:27:19.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:18 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:27:19.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2577.617579 secs 2023-05-08T04:27:19.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:18 smithi096 ceph-mon[124666]: osdmap e171: 12 total, 12 up, 12 in 2023-05-08T04:27:19.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2578.172320 secs 2023-05-08T04:27:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:18 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:27:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:18 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T04:27:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:18 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T04:27:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:18 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:27:19.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2577.617579 secs 2023-05-08T04:27:19.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:18 smithi186 ceph-mon[126480]: osdmap e171: 12 total, 12 up, 12 in 2023-05-08T04:27:19.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2578.172320 secs 2023-05-08T04:27:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:19 smithi133 ceph-mon[125939]: pgmap v1439: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:27:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:19 smithi096 ceph-mon[124666]: pgmap v1439: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:27:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:19 smithi186 ceph-mon[126480]: pgmap v1439: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:27:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2579.447652 secs 2023-05-08T04:27:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2579.447652 secs 2023-05-08T04:27:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2579.447652 secs 2023-05-08T04:27:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:21 smithi133 ceph-mon[125939]: pgmap v1440: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:27:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:21 smithi096 ceph-mon[124666]: pgmap v1440: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:27:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:21 smithi186 ceph-mon[126480]: pgmap v1440: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:27:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:23 smithi133 ceph-mon[125939]: pgmap v1441: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:27:24.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2582.617691 secs 2023-05-08T04:27:24.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2583.172454 secs 2023-05-08T04:27:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:23 smithi096 ceph-mon[124666]: pgmap v1441: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:27:24.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2582.617691 secs 2023-05-08T04:27:24.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2583.172454 secs 2023-05-08T04:27:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:23 smithi186 ceph-mon[126480]: pgmap v1441: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:27:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2582.617691 secs 2023-05-08T04:27:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2583.172454 secs 2023-05-08T04:27:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2584.447770 secs 2023-05-08T04:27:26.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:25 smithi133 ceph-mon[125939]: pgmap v1442: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:27:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2584.447770 secs 2023-05-08T04:27:26.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:25 smithi096 ceph-mon[124666]: pgmap v1442: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:27:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2584.447770 secs 2023-05-08T04:27:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:25 smithi186 ceph-mon[126480]: pgmap v1442: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:27:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:27 smithi133 ceph-mon[125939]: pgmap v1443: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:27:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:27 smithi096 ceph-mon[124666]: pgmap v1443: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:27:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:27 smithi186 ceph-mon[126480]: pgmap v1443: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:27:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2587.617803 secs 2023-05-08T04:27:29.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2588.172576 secs 2023-05-08T04:27:29.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:29 smithi133 ceph-mon[125939]: pgmap v1444: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T04:27:29.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2587.617803 secs 2023-05-08T04:27:29.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2588.172576 secs 2023-05-08T04:27:29.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:29 smithi096 ceph-mon[124666]: pgmap v1444: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T04:27:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2587.617803 secs 2023-05-08T04:27:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2588.172576 secs 2023-05-08T04:27:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:29 smithi186 ceph-mon[126480]: pgmap v1444: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T04:27:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:31 smithi186 ceph-mon[126480]: pgmap v1445: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 33 KiB/s wr, 8 op/s 2023-05-08T04:27:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:31 smithi133 ceph-mon[125939]: pgmap v1445: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 33 KiB/s wr, 8 op/s 2023-05-08T04:27:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:31 smithi096 ceph-mon[124666]: pgmap v1445: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 33 KiB/s wr, 8 op/s 2023-05-08T04:27:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:33 smithi186 ceph-mon[126480]: pgmap v1446: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 33 KiB/s wr, 5 op/s 2023-05-08T04:27:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2592.617941 secs 2023-05-08T04:27:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2593.172661 secs 2023-05-08T04:27:34.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:33 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:27:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:33 smithi133 ceph-mon[125939]: pgmap v1446: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 33 KiB/s wr, 5 op/s 2023-05-08T04:27:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2592.617941 secs 2023-05-08T04:27:34.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2593.172661 secs 2023-05-08T04:27:34.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:33 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:27:34.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:33 smithi096 ceph-mon[124666]: pgmap v1446: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 33 KiB/s wr, 5 op/s 2023-05-08T04:27:34.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2592.617941 secs 2023-05-08T04:27:34.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2593.172661 secs 2023-05-08T04:27:34.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:33 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:27:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:34 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:27:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:34 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:27:35.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:34 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:27:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:34 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:27:35.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:34 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:27:35.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:34 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:27:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:34 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:27:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:34 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:27:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:34 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:27:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2594.448009 secs 2023-05-08T04:27:36.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:35 smithi133 ceph-mon[125939]: pgmap v1447: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 81 KiB/s wr, 9 op/s 2023-05-08T04:27:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2594.448009 secs 2023-05-08T04:27:36.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:35 smithi096 ceph-mon[124666]: pgmap v1447: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 81 KiB/s wr, 9 op/s 2023-05-08T04:27:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2594.448009 secs 2023-05-08T04:27:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:35 smithi186 ceph-mon[126480]: pgmap v1447: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 81 KiB/s wr, 9 op/s 2023-05-08T04:27:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:37 smithi133 ceph-mon[125939]: pgmap v1448: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 81 KiB/s wr, 6 op/s 2023-05-08T04:27:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:37 smithi096 ceph-mon[124666]: pgmap v1448: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 81 KiB/s wr, 6 op/s 2023-05-08T04:27:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:37 smithi186 ceph-mon[126480]: pgmap v1448: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 81 KiB/s wr, 6 op/s 2023-05-08T04:27:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2597.618031 secs 2023-05-08T04:27:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:38 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:27:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:38 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:27:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2598.172803 secs 2023-05-08T04:27:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2597.618031 secs 2023-05-08T04:27:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:38 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:27:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:38 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:27:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2598.172803 secs 2023-05-08T04:27:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2597.618031 secs 2023-05-08T04:27:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:38 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:27:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:38 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:27:39.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2598.172803 secs 2023-05-08T04:27:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:39 smithi133 ceph-mon[125939]: pgmap v1449: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 81 KiB/s wr, 6 op/s 2023-05-08T04:27:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:39 smithi096 ceph-mon[124666]: pgmap v1449: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 81 KiB/s wr, 6 op/s 2023-05-08T04:27:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:39 smithi186 ceph-mon[126480]: pgmap v1449: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 81 KiB/s wr, 6 op/s 2023-05-08T04:27:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2599.448125 secs 2023-05-08T04:27:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2599.448125 secs 2023-05-08T04:27:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2599.448125 secs 2023-05-08T04:27:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:41 smithi133 ceph-mon[125939]: pgmap v1450: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 93 KiB/s wr, 10 op/s 2023-05-08T04:27:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:41 smithi096 ceph-mon[124666]: pgmap v1450: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 93 KiB/s wr, 10 op/s 2023-05-08T04:27:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:41 smithi186 ceph-mon[126480]: pgmap v1450: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 93 KiB/s wr, 10 op/s 2023-05-08T04:27:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:43 smithi133 ceph-mon[125939]: pgmap v1451: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 60 KiB/s wr, 7 op/s 2023-05-08T04:27:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2602.618149 secs 2023-05-08T04:27:44.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:43 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:27:44.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2603.172921 secs 2023-05-08T04:27:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:43 smithi096 ceph-mon[124666]: pgmap v1451: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 60 KiB/s wr, 7 op/s 2023-05-08T04:27:44.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2602.618149 secs 2023-05-08T04:27:44.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:43 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:27:44.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2603.172921 secs 2023-05-08T04:27:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:43 smithi186 ceph-mon[126480]: pgmap v1451: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 60 KiB/s wr, 7 op/s 2023-05-08T04:27:44.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2602.618149 secs 2023-05-08T04:27:44.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:43 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:27:44.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2603.172921 secs 2023-05-08T04:27:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2604.448215 secs 2023-05-08T04:27:46.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:45 smithi133 ceph-mon[125939]: pgmap v1452: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 60 KiB/s wr, 10 op/s 2023-05-08T04:27:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2604.448215 secs 2023-05-08T04:27:46.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:45 smithi096 ceph-mon[124666]: pgmap v1452: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 60 KiB/s wr, 10 op/s 2023-05-08T04:27:46.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2604.448215 secs 2023-05-08T04:27:46.373 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:45 smithi186 ceph-mon[126480]: pgmap v1452: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 60 KiB/s wr, 10 op/s 2023-05-08T04:27:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:47 smithi133 ceph-mon[125939]: pgmap v1453: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 6 op/s 2023-05-08T04:27:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:47 smithi096 ceph-mon[124666]: pgmap v1453: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 6 op/s 2023-05-08T04:27:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:47 smithi186 ceph-mon[126480]: pgmap v1453: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 6 op/s 2023-05-08T04:27:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2607.618300 secs 2023-05-08T04:27:49.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2608.173048 secs 2023-05-08T04:27:49.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:49 smithi133 ceph-mon[125939]: pgmap v1454: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 6 op/s 2023-05-08T04:27:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2607.618300 secs 2023-05-08T04:27:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2608.173048 secs 2023-05-08T04:27:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:49 smithi096 ceph-mon[124666]: pgmap v1454: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 6 op/s 2023-05-08T04:27:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2607.618300 secs 2023-05-08T04:27:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2608.173048 secs 2023-05-08T04:27:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:49 smithi186 ceph-mon[126480]: pgmap v1454: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 6 op/s 2023-05-08T04:27:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2609.448312 secs 2023-05-08T04:27:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2609.448312 secs 2023-05-08T04:27:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2609.448312 secs 2023-05-08T04:27:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:51 smithi133 ceph-mon[125939]: pgmap v1455: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 9 op/s 2023-05-08T04:27:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:51 smithi096 ceph-mon[124666]: pgmap v1455: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 9 op/s 2023-05-08T04:27:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:51 smithi186 ceph-mon[126480]: pgmap v1455: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 9 op/s 2023-05-08T04:27:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:53 smithi133 ceph-mon[125939]: pgmap v1456: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 5.9 KiB/s wr, 5 op/s 2023-05-08T04:27:54.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2612.618402 secs 2023-05-08T04:27:54.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2613.173146 secs 2023-05-08T04:27:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:53 smithi096 ceph-mon[124666]: pgmap v1456: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 5.9 KiB/s wr, 5 op/s 2023-05-08T04:27:54.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2612.618402 secs 2023-05-08T04:27:54.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2613.173146 secs 2023-05-08T04:27:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:53 smithi186 ceph-mon[126480]: pgmap v1456: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 5.9 KiB/s wr, 5 op/s 2023-05-08T04:27:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2612.618402 secs 2023-05-08T04:27:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2613.173146 secs 2023-05-08T04:27:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2614.448430 secs 2023-05-08T04:27:56.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:55 smithi133 ceph-mon[125939]: pgmap v1457: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 5.9 KiB/s wr, 7 op/s 2023-05-08T04:27:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2614.448430 secs 2023-05-08T04:27:56.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:55 smithi096 ceph-mon[124666]: pgmap v1457: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 5.9 KiB/s wr, 7 op/s 2023-05-08T04:27:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2614.448430 secs 2023-05-08T04:27:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:55 smithi186 ceph-mon[126480]: pgmap v1457: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 5.9 KiB/s wr, 7 op/s 2023-05-08T04:27:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:57 smithi133 ceph-mon[125939]: pgmap v1458: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 5.9 KiB/s wr, 5 op/s 2023-05-08T04:27:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:57 smithi096 ceph-mon[124666]: pgmap v1458: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 5.9 KiB/s wr, 5 op/s 2023-05-08T04:27:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:57 smithi186 ceph-mon[126480]: pgmap v1458: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 5.9 KiB/s wr, 5 op/s 2023-05-08T04:27:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2617.618471 secs 2023-05-08T04:27:59.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2618.173260 secs 2023-05-08T04:27:59.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:27:59 smithi133 ceph-mon[125939]: pgmap v1459: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 5.9 KiB/s wr, 5 op/s 2023-05-08T04:27:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2617.618471 secs 2023-05-08T04:27:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2618.173260 secs 2023-05-08T04:27:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:27:59 smithi096 ceph-mon[124666]: pgmap v1459: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 5.9 KiB/s wr, 5 op/s 2023-05-08T04:27:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2617.618471 secs 2023-05-08T04:27:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2618.173260 secs 2023-05-08T04:27:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:27:59 smithi186 ceph-mon[126480]: pgmap v1459: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 5.9 KiB/s wr, 5 op/s 2023-05-08T04:28:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2619.448527 secs 2023-05-08T04:28:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2619.448527 secs 2023-05-08T04:28:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2619.448527 secs 2023-05-08T04:28:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:01 smithi133 ceph-mon[125939]: pgmap v1460: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 5.9 KiB/s wr, 7 op/s 2023-05-08T04:28:01.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:01 smithi096 ceph-mon[124666]: pgmap v1460: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 5.9 KiB/s wr, 7 op/s 2023-05-08T04:28:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:01 smithi186 ceph-mon[126480]: pgmap v1460: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 5.9 KiB/s wr, 7 op/s 2023-05-08T04:28:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:03 smithi133 ceph-mon[125939]: pgmap v1461: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:28:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2622.618534 secs 2023-05-08T04:28:04.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2623.173383 secs 2023-05-08T04:28:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:03 smithi096 ceph-mon[124666]: pgmap v1461: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:28:04.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2622.618534 secs 2023-05-08T04:28:04.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2623.173383 secs 2023-05-08T04:28:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:03 smithi186 ceph-mon[126480]: pgmap v1461: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:28:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2622.618534 secs 2023-05-08T04:28:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2623.173383 secs 2023-05-08T04:28:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2624.448647 secs 2023-05-08T04:28:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:05 smithi133 ceph-mon[125939]: pgmap v1462: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:28:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2624.448647 secs 2023-05-08T04:28:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:05 smithi096 ceph-mon[124666]: pgmap v1462: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:28:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2624.448647 secs 2023-05-08T04:28:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:05 smithi186 ceph-mon[126480]: pgmap v1462: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:28:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:07 smithi133 ceph-mon[125939]: pgmap v1463: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:28:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:07 smithi096 ceph-mon[124666]: pgmap v1463: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:28:08.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:07 smithi186 ceph-mon[126480]: pgmap v1463: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:28:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2627.618601 secs 2023-05-08T04:28:09.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2628.173514 secs 2023-05-08T04:28:09.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:09 smithi133 ceph-mon[125939]: pgmap v1464: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:28:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2627.618601 secs 2023-05-08T04:28:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2628.173514 secs 2023-05-08T04:28:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:09 smithi096 ceph-mon[124666]: pgmap v1464: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:28:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2627.618601 secs 2023-05-08T04:28:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2628.173514 secs 2023-05-08T04:28:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:09 smithi186 ceph-mon[126480]: pgmap v1464: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:28:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2629.448767 secs 2023-05-08T04:28:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2629.448767 secs 2023-05-08T04:28:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2629.448767 secs 2023-05-08T04:28:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:11 smithi133 ceph-mon[125939]: osdmap e172: 12 total, 12 up, 12 in 2023-05-08T04:28:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:11 smithi133 ceph-mon[125939]: pgmap v1466: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:28:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:11 smithi096 ceph-mon[124666]: osdmap e172: 12 total, 12 up, 12 in 2023-05-08T04:28:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:11 smithi096 ceph-mon[124666]: pgmap v1466: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:28:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:11 smithi186 ceph-mon[126480]: osdmap e172: 12 total, 12 up, 12 in 2023-05-08T04:28:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:11 smithi186 ceph-mon[126480]: pgmap v1466: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:28:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:13 smithi133 ceph-mon[125939]: pgmap v1467: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:28:14.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2632.618664 secs 2023-05-08T04:28:14.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2633.173650 secs 2023-05-08T04:28:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:13 smithi096 ceph-mon[124666]: pgmap v1467: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:28:14.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2632.618664 secs 2023-05-08T04:28:14.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2633.173650 secs 2023-05-08T04:28:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:13 smithi186 ceph-mon[126480]: pgmap v1467: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:28:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2632.618664 secs 2023-05-08T04:28:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2633.173650 secs 2023-05-08T04:28:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2634.448884 secs 2023-05-08T04:28:16.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:15 smithi133 ceph-mon[125939]: pgmap v1468: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:28:16.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2634.448884 secs 2023-05-08T04:28:16.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:15 smithi096 ceph-mon[124666]: pgmap v1468: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:28:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2634.448884 secs 2023-05-08T04:28:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:15 smithi186 ceph-mon[126480]: pgmap v1468: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:28:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:17 smithi133 ceph-mon[125939]: pgmap v1469: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:28:18.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:17 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:28:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:17 smithi096 ceph-mon[124666]: pgmap v1469: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:28:18.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:17 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:28:18.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:17 smithi186 ceph-mon[126480]: pgmap v1469: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:28:18.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:17 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:28:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2637.618731 secs 2023-05-08T04:28:19.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:19 smithi133 ceph-mon[125939]: osdmap e173: 12 total, 12 up, 12 in 2023-05-08T04:28:19.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:19 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:28:19.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:19 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:28:19.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:19 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:28:19.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:19 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:28:19.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:19 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T04:28:19.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:19 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T04:28:19.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:19 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:28:19.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2638.173744 secs 2023-05-08T04:28:19.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:19 smithi133 ceph-mon[125939]: pgmap v1471: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:28:19.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2637.618731 secs 2023-05-08T04:28:19.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:19 smithi096 ceph-mon[124666]: osdmap e173: 12 total, 12 up, 12 in 2023-05-08T04:28:19.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:19 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:28:19.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:19 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:28:19.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:19 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:28:19.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:19 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:28:19.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:19 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T04:28:19.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:19 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T04:28:19.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:19 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:28:19.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2638.173744 secs 2023-05-08T04:28:19.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:19 smithi096 ceph-mon[124666]: pgmap v1471: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:28:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2637.618731 secs 2023-05-08T04:28:19.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:19 smithi186 ceph-mon[126480]: osdmap e173: 12 total, 12 up, 12 in 2023-05-08T04:28:19.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:19 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:28:19.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:19 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:28:19.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:19 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:28:19.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:19 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:28:19.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:19 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T04:28:19.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:19 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T04:28:19.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:19 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:28:19.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2638.173744 secs 2023-05-08T04:28:19.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:19 smithi186 ceph-mon[126480]: pgmap v1471: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:28:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2639.448997 secs 2023-05-08T04:28:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2639.448997 secs 2023-05-08T04:28:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2639.448997 secs 2023-05-08T04:28:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:21 smithi186 ceph-mon[126480]: pgmap v1472: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:28:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:21 smithi133 ceph-mon[125939]: pgmap v1472: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:28:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:21 smithi096 ceph-mon[124666]: pgmap v1472: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:28:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:23 smithi133 ceph-mon[125939]: pgmap v1473: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:28:24.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2642.618801 secs 2023-05-08T04:28:24.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2643.173809 secs 2023-05-08T04:28:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:23 smithi096 ceph-mon[124666]: pgmap v1473: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:28:24.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2642.618801 secs 2023-05-08T04:28:24.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2643.173809 secs 2023-05-08T04:28:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:23 smithi186 ceph-mon[126480]: pgmap v1473: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:28:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2642.618801 secs 2023-05-08T04:28:24.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2643.173809 secs 2023-05-08T04:28:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2644.449055 secs 2023-05-08T04:28:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:25 smithi133 ceph-mon[125939]: pgmap v1474: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:28:26.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2644.449055 secs 2023-05-08T04:28:26.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:25 smithi096 ceph-mon[124666]: pgmap v1474: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:28:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2644.449055 secs 2023-05-08T04:28:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:25 smithi186 ceph-mon[126480]: pgmap v1474: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:28:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:27 smithi133 ceph-mon[125939]: pgmap v1475: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:28:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:27 smithi096 ceph-mon[124666]: pgmap v1475: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:28:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:27 smithi186 ceph-mon[126480]: pgmap v1475: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:28:29.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2647.618937 secs 2023-05-08T04:28:29.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2648.173885 secs 2023-05-08T04:28:29.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:29 smithi133 ceph-mon[125939]: pgmap v1476: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T04:28:29.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2647.618937 secs 2023-05-08T04:28:29.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2648.173885 secs 2023-05-08T04:28:29.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:29 smithi096 ceph-mon[124666]: pgmap v1476: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T04:28:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2647.618937 secs 2023-05-08T04:28:29.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2648.173885 secs 2023-05-08T04:28:29.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:29 smithi186 ceph-mon[126480]: pgmap v1476: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T04:28:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:31 smithi133 ceph-mon[125939]: pgmap v1477: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 32 KiB/s wr, 8 op/s 2023-05-08T04:28:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:31 smithi096 ceph-mon[124666]: pgmap v1477: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 32 KiB/s wr, 8 op/s 2023-05-08T04:28:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:31 smithi186 ceph-mon[126480]: pgmap v1477: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 32 KiB/s wr, 8 op/s 2023-05-08T04:28:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:33 smithi133 ceph-mon[125939]: pgmap v1478: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 32 KiB/s wr, 5 op/s 2023-05-08T04:28:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2652.619027 secs 2023-05-08T04:28:34.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2653.174029 secs 2023-05-08T04:28:34.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:33 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:28:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:33 smithi096 ceph-mon[124666]: pgmap v1478: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 32 KiB/s wr, 5 op/s 2023-05-08T04:28:34.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2652.619027 secs 2023-05-08T04:28:34.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2653.174029 secs 2023-05-08T04:28:34.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:33 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:28:34.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:33 smithi186 ceph-mon[126480]: pgmap v1478: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 32 KiB/s wr, 5 op/s 2023-05-08T04:28:34.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2652.619027 secs 2023-05-08T04:28:34.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2653.174029 secs 2023-05-08T04:28:34.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:33 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:28:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:34 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:28:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:34 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:28:35.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:34 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:28:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:34 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:28:35.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:34 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:28:35.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:34 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:28:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:34 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:28:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:34 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:28:35.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:34 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:28:36.244 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2654.449213 secs 2023-05-08T04:28:36.244 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:35 smithi133 ceph-mon[125939]: pgmap v1479: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 59 KiB/s wr, 9 op/s 2023-05-08T04:28:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2654.449213 secs 2023-05-08T04:28:36.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:35 smithi096 ceph-mon[124666]: pgmap v1479: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 59 KiB/s wr, 9 op/s 2023-05-08T04:28:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2654.449213 secs 2023-05-08T04:28:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:35 smithi186 ceph-mon[126480]: pgmap v1479: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 59 KiB/s wr, 9 op/s 2023-05-08T04:28:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:37 smithi133 ceph-mon[125939]: pgmap v1480: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 59 KiB/s wr, 7 op/s 2023-05-08T04:28:38.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:37 smithi096 ceph-mon[124666]: pgmap v1480: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 59 KiB/s wr, 7 op/s 2023-05-08T04:28:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:37 smithi186 ceph-mon[126480]: pgmap v1480: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 59 KiB/s wr, 7 op/s 2023-05-08T04:28:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2657.619148 secs 2023-05-08T04:28:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:38 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:28:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:38 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:28:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2658.174150 secs 2023-05-08T04:28:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2657.619148 secs 2023-05-08T04:28:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:38 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:28:39.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:38 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:28:39.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2658.174150 secs 2023-05-08T04:28:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2657.619148 secs 2023-05-08T04:28:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:38 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:28:39.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:38 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:28:39.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2658.174150 secs 2023-05-08T04:28:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:39 smithi133 ceph-mon[125939]: pgmap v1481: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 59 KiB/s wr, 7 op/s 2023-05-08T04:28:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:39 smithi096 ceph-mon[124666]: pgmap v1481: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 59 KiB/s wr, 7 op/s 2023-05-08T04:28:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:39 smithi186 ceph-mon[126480]: pgmap v1481: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 59 KiB/s wr, 7 op/s 2023-05-08T04:28:41.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2659.449329 secs 2023-05-08T04:28:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2659.449329 secs 2023-05-08T04:28:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2659.449329 secs 2023-05-08T04:28:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:41 smithi133 ceph-mon[125939]: pgmap v1482: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 87 KiB/s wr, 11 op/s 2023-05-08T04:28:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:41 smithi096 ceph-mon[124666]: pgmap v1482: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 87 KiB/s wr, 11 op/s 2023-05-08T04:28:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:41 smithi186 ceph-mon[126480]: pgmap v1482: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 87 KiB/s wr, 11 op/s 2023-05-08T04:28:44.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:43 smithi133 ceph-mon[125939]: pgmap v1483: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 55 KiB/s wr, 7 op/s 2023-05-08T04:28:44.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2662.619266 secs 2023-05-08T04:28:44.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:43 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:28:44.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2663.174287 secs 2023-05-08T04:28:44.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:43 smithi096 ceph-mon[124666]: pgmap v1483: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 55 KiB/s wr, 7 op/s 2023-05-08T04:28:44.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2662.619266 secs 2023-05-08T04:28:44.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:43 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:28:44.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2663.174287 secs 2023-05-08T04:28:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:43 smithi186 ceph-mon[126480]: pgmap v1483: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 55 KiB/s wr, 7 op/s 2023-05-08T04:28:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2662.619266 secs 2023-05-08T04:28:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:43 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:28:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2663.174287 secs 2023-05-08T04:28:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2664.449463 secs 2023-05-08T04:28:46.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:45 smithi133 ceph-mon[125939]: pgmap v1484: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 55 KiB/s wr, 10 op/s 2023-05-08T04:28:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2664.449463 secs 2023-05-08T04:28:46.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:45 smithi096 ceph-mon[124666]: pgmap v1484: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 55 KiB/s wr, 10 op/s 2023-05-08T04:28:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2664.449463 secs 2023-05-08T04:28:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:45 smithi186 ceph-mon[126480]: pgmap v1484: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 55 KiB/s wr, 10 op/s 2023-05-08T04:28:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:47 smithi133 ceph-mon[125939]: pgmap v1485: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 28 KiB/s wr, 6 op/s 2023-05-08T04:28:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:47 smithi096 ceph-mon[124666]: pgmap v1485: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 28 KiB/s wr, 6 op/s 2023-05-08T04:28:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:47 smithi186 ceph-mon[126480]: pgmap v1485: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 28 KiB/s wr, 6 op/s 2023-05-08T04:28:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2667.619390 secs 2023-05-08T04:28:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2668.174412 secs 2023-05-08T04:28:49.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:49 smithi133 ceph-mon[125939]: pgmap v1486: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 28 KiB/s wr, 6 op/s 2023-05-08T04:28:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2667.619390 secs 2023-05-08T04:28:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2668.174412 secs 2023-05-08T04:28:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:49 smithi096 ceph-mon[124666]: pgmap v1486: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 28 KiB/s wr, 6 op/s 2023-05-08T04:28:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2667.619390 secs 2023-05-08T04:28:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2668.174412 secs 2023-05-08T04:28:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:49 smithi186 ceph-mon[126480]: pgmap v1486: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 28 KiB/s wr, 6 op/s 2023-05-08T04:28:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2669.449598 secs 2023-05-08T04:28:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2669.449598 secs 2023-05-08T04:28:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2669.449598 secs 2023-05-08T04:28:51.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:51 smithi133 ceph-mon[125939]: pgmap v1487: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 9 op/s 2023-05-08T04:28:51.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:51 smithi096 ceph-mon[124666]: pgmap v1487: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 9 op/s 2023-05-08T04:28:51.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:51 smithi186 ceph-mon[126480]: pgmap v1487: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 9 op/s 2023-05-08T04:28:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:53 smithi133 ceph-mon[125939]: pgmap v1488: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.9 KiB/s wr, 5 op/s 2023-05-08T04:28:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2672.619498 secs 2023-05-08T04:28:54.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2673.174539 secs 2023-05-08T04:28:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:53 smithi096 ceph-mon[124666]: pgmap v1488: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.9 KiB/s wr, 5 op/s 2023-05-08T04:28:54.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2672.619498 secs 2023-05-08T04:28:54.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2673.174539 secs 2023-05-08T04:28:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:53 smithi186 ceph-mon[126480]: pgmap v1488: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.9 KiB/s wr, 5 op/s 2023-05-08T04:28:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2672.619498 secs 2023-05-08T04:28:54.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2673.174539 secs 2023-05-08T04:28:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2674.449727 secs 2023-05-08T04:28:56.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:55 smithi133 ceph-mon[125939]: pgmap v1489: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.9 KiB/s wr, 7 op/s 2023-05-08T04:28:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2674.449727 secs 2023-05-08T04:28:56.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:55 smithi096 ceph-mon[124666]: pgmap v1489: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.9 KiB/s wr, 7 op/s 2023-05-08T04:28:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2674.449727 secs 2023-05-08T04:28:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:55 smithi186 ceph-mon[126480]: pgmap v1489: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.9 KiB/s wr, 7 op/s 2023-05-08T04:28:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:57 smithi133 ceph-mon[125939]: pgmap v1490: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.9 KiB/s wr, 5 op/s 2023-05-08T04:28:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:57 smithi096 ceph-mon[124666]: pgmap v1490: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.9 KiB/s wr, 5 op/s 2023-05-08T04:28:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:57 smithi186 ceph-mon[126480]: pgmap v1490: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.9 KiB/s wr, 5 op/s 2023-05-08T04:28:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2677.619617 secs 2023-05-08T04:28:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2678.174657 secs 2023-05-08T04:28:59.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:28:59 smithi133 ceph-mon[125939]: pgmap v1491: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.9 KiB/s wr, 5 op/s 2023-05-08T04:28:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2677.619617 secs 2023-05-08T04:28:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2678.174657 secs 2023-05-08T04:28:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:28:59 smithi096 ceph-mon[124666]: pgmap v1491: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.9 KiB/s wr, 5 op/s 2023-05-08T04:28:59.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2677.619617 secs 2023-05-08T04:28:59.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2678.174657 secs 2023-05-08T04:28:59.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:28:59 smithi186 ceph-mon[126480]: pgmap v1491: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.9 KiB/s wr, 5 op/s 2023-05-08T04:29:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2679.449852 secs 2023-05-08T04:29:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2679.449852 secs 2023-05-08T04:29:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2679.449852 secs 2023-05-08T04:29:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:01 smithi133 ceph-mon[125939]: pgmap v1492: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.9 KiB/s wr, 7 op/s 2023-05-08T04:29:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:01 smithi096 ceph-mon[124666]: pgmap v1492: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.9 KiB/s wr, 7 op/s 2023-05-08T04:29:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:01 smithi186 ceph-mon[126480]: pgmap v1492: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.9 KiB/s wr, 7 op/s 2023-05-08T04:29:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:03 smithi133 ceph-mon[125939]: pgmap v1493: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:29:04.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2682.619691 secs 2023-05-08T04:29:04.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2683.174813 secs 2023-05-08T04:29:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:03 smithi096 ceph-mon[124666]: pgmap v1493: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:29:04.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2682.619691 secs 2023-05-08T04:29:04.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2683.174813 secs 2023-05-08T04:29:04.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:03 smithi186 ceph-mon[126480]: pgmap v1493: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:29:04.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2682.619691 secs 2023-05-08T04:29:04.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2683.174813 secs 2023-05-08T04:29:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2684.449932 secs 2023-05-08T04:29:06.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:05 smithi133 ceph-mon[125939]: pgmap v1494: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:29:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2684.449932 secs 2023-05-08T04:29:06.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:05 smithi096 ceph-mon[124666]: pgmap v1494: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:29:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2684.449932 secs 2023-05-08T04:29:06.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:05 smithi186 ceph-mon[126480]: pgmap v1494: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:29:08.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:07 smithi133 ceph-mon[125939]: pgmap v1495: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:29:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:07 smithi096 ceph-mon[124666]: pgmap v1495: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:29:08.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:07 smithi186 ceph-mon[126480]: pgmap v1495: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:29:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2687.619770 secs 2023-05-08T04:29:09.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2688.174925 secs 2023-05-08T04:29:09.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:09 smithi133 ceph-mon[125939]: pgmap v1496: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:29:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2687.619770 secs 2023-05-08T04:29:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2688.174925 secs 2023-05-08T04:29:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:09 smithi096 ceph-mon[124666]: pgmap v1496: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:29:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2687.619770 secs 2023-05-08T04:29:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2688.174925 secs 2023-05-08T04:29:09.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:09 smithi186 ceph-mon[126480]: pgmap v1496: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:29:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2689.450014 secs 2023-05-08T04:29:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2689.450014 secs 2023-05-08T04:29:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2689.450014 secs 2023-05-08T04:29:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:11 smithi133 ceph-mon[125939]: osdmap e174: 12 total, 12 up, 12 in 2023-05-08T04:29:11.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:11 smithi133 ceph-mon[125939]: pgmap v1498: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:29:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:11 smithi096 ceph-mon[124666]: osdmap e174: 12 total, 12 up, 12 in 2023-05-08T04:29:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:11 smithi096 ceph-mon[124666]: pgmap v1498: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:29:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:11 smithi186 ceph-mon[126480]: osdmap e174: 12 total, 12 up, 12 in 2023-05-08T04:29:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:11 smithi186 ceph-mon[126480]: pgmap v1498: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:29:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:13 smithi133 ceph-mon[125939]: pgmap v1499: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:29:14.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2692.619893 secs 2023-05-08T04:29:14.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2693.175075 secs 2023-05-08T04:29:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:13 smithi096 ceph-mon[124666]: pgmap v1499: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:29:14.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2692.619893 secs 2023-05-08T04:29:14.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2693.175075 secs 2023-05-08T04:29:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:13 smithi186 ceph-mon[126480]: pgmap v1499: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:29:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2692.619893 secs 2023-05-08T04:29:14.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2693.175075 secs 2023-05-08T04:29:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2694.450104 secs 2023-05-08T04:29:16.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:15 smithi133 ceph-mon[125939]: pgmap v1500: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:29:16.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2694.450104 secs 2023-05-08T04:29:16.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:15 smithi096 ceph-mon[124666]: pgmap v1500: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:29:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2694.450104 secs 2023-05-08T04:29:16.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:15 smithi186 ceph-mon[126480]: pgmap v1500: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:29:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:17 smithi133 ceph-mon[125939]: pgmap v1501: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:29:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:17 smithi096 ceph-mon[124666]: pgmap v1501: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:29:18.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:17 smithi186 ceph-mon[126480]: pgmap v1501: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:29:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2697.620043 secs 2023-05-08T04:29:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:19 smithi133 ceph-mon[125939]: osdmap e175: 12 total, 12 up, 12 in 2023-05-08T04:29:19.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:19 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:29:19.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2698.175177 secs 2023-05-08T04:29:19.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:19 smithi133 ceph-mon[125939]: pgmap v1503: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:29:19.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:19 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:29:19.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:19 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:29:19.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:19 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:29:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2697.620043 secs 2023-05-08T04:29:19.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:19 smithi096 ceph-mon[124666]: osdmap e175: 12 total, 12 up, 12 in 2023-05-08T04:29:19.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:19 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:29:19.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2698.175177 secs 2023-05-08T04:29:19.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:19 smithi096 ceph-mon[124666]: pgmap v1503: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:29:19.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:19 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:29:19.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:19 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:29:19.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:19 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:29:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2697.620043 secs 2023-05-08T04:29:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:19 smithi186 ceph-mon[126480]: osdmap e175: 12 total, 12 up, 12 in 2023-05-08T04:29:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:19 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:29:19.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2698.175177 secs 2023-05-08T04:29:19.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:19 smithi186 ceph-mon[126480]: pgmap v1503: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:29:19.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:19 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:29:19.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:19 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:29:19.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:19 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:29:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:20 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:29:20.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:20 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T04:29:20.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:20 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T04:29:20.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:20 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:29:20.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2699.450246 secs 2023-05-08T04:29:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:20 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:29:20.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:20 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T04:29:20.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:20 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T04:29:20.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:20 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:29:20.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2699.450246 secs 2023-05-08T04:29:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:20 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:29:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:20 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T04:29:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:20 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T04:29:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:20 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:29:20.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2699.450246 secs 2023-05-08T04:29:21.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:21 smithi133 ceph-mon[125939]: pgmap v1504: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:29:21.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:21 smithi096 ceph-mon[124666]: pgmap v1504: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:29:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:21 smithi186 ceph-mon[126480]: pgmap v1504: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:29:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:23 smithi133 ceph-mon[125939]: pgmap v1505: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:29:24.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2702.620179 secs 2023-05-08T04:29:24.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2703.175290 secs 2023-05-08T04:29:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:23 smithi096 ceph-mon[124666]: pgmap v1505: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:29:24.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2702.620179 secs 2023-05-08T04:29:24.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2703.175290 secs 2023-05-08T04:29:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:23 smithi186 ceph-mon[126480]: pgmap v1505: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:29:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2702.620179 secs 2023-05-08T04:29:24.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2703.175290 secs 2023-05-08T04:29:26.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2704.450340 secs 2023-05-08T04:29:26.244 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:25 smithi133 ceph-mon[125939]: pgmap v1506: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:29:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2704.450340 secs 2023-05-08T04:29:26.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:25 smithi096 ceph-mon[124666]: pgmap v1506: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:29:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2704.450340 secs 2023-05-08T04:29:26.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:25 smithi186 ceph-mon[126480]: pgmap v1506: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:29:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:27 smithi133 ceph-mon[125939]: pgmap v1507: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:29:28.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:27 smithi096 ceph-mon[124666]: pgmap v1507: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:29:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:27 smithi186 ceph-mon[126480]: pgmap v1507: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:29:29.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2707.620278 secs 2023-05-08T04:29:29.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2708.175416 secs 2023-05-08T04:29:29.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:29 smithi133 ceph-mon[125939]: pgmap v1508: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T04:29:29.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2707.620278 secs 2023-05-08T04:29:29.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2708.175416 secs 2023-05-08T04:29:29.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:29 smithi096 ceph-mon[124666]: pgmap v1508: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T04:29:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2707.620278 secs 2023-05-08T04:29:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2708.175416 secs 2023-05-08T04:29:29.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:29 smithi186 ceph-mon[126480]: pgmap v1508: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 96 B/s wr, 5 op/s 2023-05-08T04:29:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:31 smithi133 ceph-mon[125939]: pgmap v1509: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 32 KiB/s wr, 8 op/s 2023-05-08T04:29:32.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:31 smithi096 ceph-mon[124666]: pgmap v1509: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 32 KiB/s wr, 8 op/s 2023-05-08T04:29:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:31 smithi186 ceph-mon[126480]: pgmap v1509: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 32 KiB/s wr, 8 op/s 2023-05-08T04:29:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:33 smithi133 ceph-mon[125939]: pgmap v1510: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 32 KiB/s wr, 5 op/s 2023-05-08T04:29:34.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2712.620430 secs 2023-05-08T04:29:34.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2713.175506 secs 2023-05-08T04:29:34.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:33 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:29:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:33 smithi096 ceph-mon[124666]: pgmap v1510: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 32 KiB/s wr, 5 op/s 2023-05-08T04:29:34.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2712.620430 secs 2023-05-08T04:29:34.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2713.175506 secs 2023-05-08T04:29:34.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:33 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:29:34.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:33 smithi186 ceph-mon[126480]: pgmap v1510: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 32 KiB/s wr, 5 op/s 2023-05-08T04:29:34.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2712.620430 secs 2023-05-08T04:29:34.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2713.175506 secs 2023-05-08T04:29:34.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:33 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:29:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:34 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:29:35.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:34 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:29:35.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:34 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:29:35.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:34 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:29:35.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:34 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:29:35.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:34 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:29:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:34 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:29:35.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:34 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:29:35.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:34 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:29:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2714.450588 secs 2023-05-08T04:29:36.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:35 smithi133 ceph-mon[125939]: pgmap v1511: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 60 KiB/s wr, 9 op/s 2023-05-08T04:29:36.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2714.450588 secs 2023-05-08T04:29:36.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:35 smithi096 ceph-mon[124666]: pgmap v1511: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 60 KiB/s wr, 9 op/s 2023-05-08T04:29:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2714.450588 secs 2023-05-08T04:29:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:35 smithi186 ceph-mon[126480]: pgmap v1511: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 60 KiB/s wr, 9 op/s 2023-05-08T04:29:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:37 smithi133 ceph-mon[125939]: pgmap v1512: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 60 KiB/s wr, 6 op/s 2023-05-08T04:29:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:37 smithi096 ceph-mon[124666]: pgmap v1512: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 60 KiB/s wr, 6 op/s 2023-05-08T04:29:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:37 smithi186 ceph-mon[126480]: pgmap v1512: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 60 KiB/s wr, 6 op/s 2023-05-08T04:29:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2717.620550 secs 2023-05-08T04:29:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:38 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:29:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:38 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:29:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2718.175633 secs 2023-05-08T04:29:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2717.620550 secs 2023-05-08T04:29:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:38 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:29:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:38 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:29:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2718.175633 secs 2023-05-08T04:29:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2717.620550 secs 2023-05-08T04:29:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:38 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:29:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:38 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:29:39.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2718.175633 secs 2023-05-08T04:29:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:39 smithi133 ceph-mon[125939]: pgmap v1513: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 60 KiB/s wr, 6 op/s 2023-05-08T04:29:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:39 smithi096 ceph-mon[124666]: pgmap v1513: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 60 KiB/s wr, 6 op/s 2023-05-08T04:29:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:39 smithi186 ceph-mon[126480]: pgmap v1513: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 60 KiB/s wr, 6 op/s 2023-05-08T04:29:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2719.450724 secs 2023-05-08T04:29:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2719.450724 secs 2023-05-08T04:29:41.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2719.450724 secs 2023-05-08T04:29:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:41 smithi133 ceph-mon[125939]: pgmap v1514: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 91 KiB/s wr, 10 op/s 2023-05-08T04:29:42.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:41 smithi096 ceph-mon[124666]: pgmap v1514: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 91 KiB/s wr, 10 op/s 2023-05-08T04:29:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:41 smithi186 ceph-mon[126480]: pgmap v1514: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 91 KiB/s wr, 10 op/s 2023-05-08T04:29:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:43 smithi133 ceph-mon[125939]: pgmap v1515: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 7 op/s 2023-05-08T04:29:44.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2722.620664 secs 2023-05-08T04:29:44.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:43 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:29:44.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2723.175726 secs 2023-05-08T04:29:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:43 smithi096 ceph-mon[124666]: pgmap v1515: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 7 op/s 2023-05-08T04:29:44.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2722.620664 secs 2023-05-08T04:29:44.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:43 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:29:44.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2723.175726 secs 2023-05-08T04:29:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:43 smithi186 ceph-mon[126480]: pgmap v1515: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 7 op/s 2023-05-08T04:29:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2722.620664 secs 2023-05-08T04:29:44.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:43 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:29:44.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2723.175726 secs 2023-05-08T04:29:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2724.450847 secs 2023-05-08T04:29:46.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:45 smithi133 ceph-mon[125939]: pgmap v1516: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 58 KiB/s wr, 10 op/s 2023-05-08T04:29:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2724.450847 secs 2023-05-08T04:29:46.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:45 smithi096 ceph-mon[124666]: pgmap v1516: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 58 KiB/s wr, 10 op/s 2023-05-08T04:29:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2724.450847 secs 2023-05-08T04:29:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:45 smithi186 ceph-mon[126480]: pgmap v1516: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 58 KiB/s wr, 10 op/s 2023-05-08T04:29:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:46 smithi133 ceph-mon[125939]: pgmap v1517: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 6 op/s 2023-05-08T04:29:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:46 smithi096 ceph-mon[124666]: pgmap v1517: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 6 op/s 2023-05-08T04:29:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:46 smithi186 ceph-mon[126480]: pgmap v1517: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 6 op/s 2023-05-08T04:29:49.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2727.620782 secs 2023-05-08T04:29:49.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2728.175826 secs 2023-05-08T04:29:49.494 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:49 smithi133 ceph-mon[125939]: pgmap v1518: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 6 op/s 2023-05-08T04:29:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2727.620782 secs 2023-05-08T04:29:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2728.175826 secs 2023-05-08T04:29:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:49 smithi096 ceph-mon[124666]: pgmap v1518: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 6 op/s 2023-05-08T04:29:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2727.620782 secs 2023-05-08T04:29:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2728.175826 secs 2023-05-08T04:29:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:49 smithi186 ceph-mon[126480]: pgmap v1518: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 6 op/s 2023-05-08T04:29:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2729.450969 secs 2023-05-08T04:29:50.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2729.450969 secs 2023-05-08T04:29:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2729.450969 secs 2023-05-08T04:29:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:51 smithi133 ceph-mon[125939]: pgmap v1519: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 39 KiB/s wr, 9 op/s 2023-05-08T04:29:51.509 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:51 smithi096 ceph-mon[124666]: pgmap v1519: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 39 KiB/s wr, 9 op/s 2023-05-08T04:29:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:51 smithi186 ceph-mon[126480]: pgmap v1519: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 39 KiB/s wr, 9 op/s 2023-05-08T04:29:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:53 smithi133 ceph-mon[125939]: pgmap v1520: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.1 KiB/s wr, 5 op/s 2023-05-08T04:29:54.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2732.620922 secs 2023-05-08T04:29:54.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2733.175974 secs 2023-05-08T04:29:54.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:53 smithi096 ceph-mon[124666]: pgmap v1520: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.1 KiB/s wr, 5 op/s 2023-05-08T04:29:54.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2732.620922 secs 2023-05-08T04:29:54.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2733.175974 secs 2023-05-08T04:29:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:53 smithi186 ceph-mon[126480]: pgmap v1520: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.1 KiB/s wr, 5 op/s 2023-05-08T04:29:54.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2732.620922 secs 2023-05-08T04:29:54.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2733.175974 secs 2023-05-08T04:29:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2734.451038 secs 2023-05-08T04:29:56.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:55 smithi133 ceph-mon[125939]: pgmap v1521: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.1 KiB/s wr, 7 op/s 2023-05-08T04:29:56.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2734.451038 secs 2023-05-08T04:29:56.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:55 smithi096 ceph-mon[124666]: pgmap v1521: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.1 KiB/s wr, 7 op/s 2023-05-08T04:29:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2734.451038 secs 2023-05-08T04:29:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:55 smithi186 ceph-mon[126480]: pgmap v1521: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.1 KiB/s wr, 7 op/s 2023-05-08T04:29:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:57 smithi133 ceph-mon[125939]: pgmap v1522: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.1 KiB/s wr, 5 op/s 2023-05-08T04:29:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:57 smithi096 ceph-mon[124666]: pgmap v1522: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.1 KiB/s wr, 5 op/s 2023-05-08T04:29:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:57 smithi186 ceph-mon[126480]: pgmap v1522: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.1 KiB/s wr, 5 op/s 2023-05-08T04:29:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2737.621040 secs 2023-05-08T04:29:59.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2738.176098 secs 2023-05-08T04:29:59.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:29:59 smithi133 ceph-mon[125939]: pgmap v1523: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.1 KiB/s wr, 5 op/s 2023-05-08T04:29:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2737.621040 secs 2023-05-08T04:29:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2738.176098 secs 2023-05-08T04:29:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:29:59 smithi096 ceph-mon[124666]: pgmap v1523: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.1 KiB/s wr, 5 op/s 2023-05-08T04:29:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2737.621040 secs 2023-05-08T04:29:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2738.176098 secs 2023-05-08T04:29:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:29:59 smithi186 ceph-mon[126480]: pgmap v1523: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.1 KiB/s wr, 5 op/s 2023-05-08T04:30:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2739.451156 secs 2023-05-08T04:30:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:00 smithi133 ceph-mon[125939]: overall HEALTH_WARN 3 MDSs report slow requests 2023-05-08T04:30:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2739.451156 secs 2023-05-08T04:30:00.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:00 smithi096 ceph-mon[124666]: overall HEALTH_WARN 3 MDSs report slow requests 2023-05-08T04:30:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2739.451156 secs 2023-05-08T04:30:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:00 smithi186 ceph-mon[126480]: overall HEALTH_WARN 3 MDSs report slow requests 2023-05-08T04:30:01.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:01 smithi133 ceph-mon[125939]: pgmap v1524: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.1 KiB/s wr, 7 op/s 2023-05-08T04:30:01.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:01 smithi096 ceph-mon[124666]: pgmap v1524: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.1 KiB/s wr, 7 op/s 2023-05-08T04:30:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:01 smithi186 ceph-mon[126480]: pgmap v1524: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.1 KiB/s wr, 7 op/s 2023-05-08T04:30:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:03 smithi133 ceph-mon[125939]: pgmap v1525: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:30:04.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2742.621117 secs 2023-05-08T04:30:04.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2743.176208 secs 2023-05-08T04:30:04.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:03 smithi096 ceph-mon[124666]: pgmap v1525: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:30:04.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2742.621117 secs 2023-05-08T04:30:04.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2743.176208 secs 2023-05-08T04:30:04.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:03 smithi186 ceph-mon[126480]: pgmap v1525: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:30:04.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2742.621117 secs 2023-05-08T04:30:04.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2743.176208 secs 2023-05-08T04:30:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2744.451277 secs 2023-05-08T04:30:06.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:05 smithi133 ceph-mon[125939]: pgmap v1526: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:30:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2744.451277 secs 2023-05-08T04:30:06.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:05 smithi096 ceph-mon[124666]: pgmap v1526: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:30:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2744.451277 secs 2023-05-08T04:30:06.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:05 smithi186 ceph-mon[126480]: pgmap v1526: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:30:08.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:07 smithi133 ceph-mon[125939]: pgmap v1527: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:30:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:07 smithi096 ceph-mon[124666]: pgmap v1527: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:30:08.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:07 smithi186 ceph-mon[126480]: pgmap v1527: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:30:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2747.621203 secs 2023-05-08T04:30:09.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2748.176329 secs 2023-05-08T04:30:09.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:09 smithi133 ceph-mon[125939]: pgmap v1528: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:30:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2747.621203 secs 2023-05-08T04:30:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2748.176329 secs 2023-05-08T04:30:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:09 smithi096 ceph-mon[124666]: pgmap v1528: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:30:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2747.621203 secs 2023-05-08T04:30:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2748.176329 secs 2023-05-08T04:30:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:09 smithi186 ceph-mon[126480]: pgmap v1528: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:30:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2749.451394 secs 2023-05-08T04:30:10.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2749.451394 secs 2023-05-08T04:30:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2749.451394 secs 2023-05-08T04:30:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:11 smithi133 ceph-mon[125939]: osdmap e176: 12 total, 12 up, 12 in 2023-05-08T04:30:11.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:11 smithi133 ceph-mon[125939]: pgmap v1530: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:30:11.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:11 smithi096 ceph-mon[124666]: osdmap e176: 12 total, 12 up, 12 in 2023-05-08T04:30:11.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:11 smithi096 ceph-mon[124666]: pgmap v1530: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:30:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:11 smithi186 ceph-mon[126480]: osdmap e176: 12 total, 12 up, 12 in 2023-05-08T04:30:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:11 smithi186 ceph-mon[126480]: pgmap v1530: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:30:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:13 smithi133 ceph-mon[125939]: pgmap v1531: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:30:14.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2752.621313 secs 2023-05-08T04:30:14.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2753.176457 secs 2023-05-08T04:30:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:13 smithi096 ceph-mon[124666]: pgmap v1531: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:30:14.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2752.621313 secs 2023-05-08T04:30:14.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2753.176457 secs 2023-05-08T04:30:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:13 smithi186 ceph-mon[126480]: pgmap v1531: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:30:14.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2752.621313 secs 2023-05-08T04:30:14.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2753.176457 secs 2023-05-08T04:30:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2754.451515 secs 2023-05-08T04:30:16.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:15 smithi133 ceph-mon[125939]: pgmap v1532: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:30:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2754.451515 secs 2023-05-08T04:30:16.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:15 smithi096 ceph-mon[124666]: pgmap v1532: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:30:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2754.451515 secs 2023-05-08T04:30:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:15 smithi186 ceph-mon[126480]: pgmap v1532: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:30:18.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:17 smithi133 ceph-mon[125939]: pgmap v1533: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:30:18.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:17 smithi096 ceph-mon[124666]: pgmap v1533: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:30:18.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:17 smithi186 ceph-mon[126480]: pgmap v1533: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:30:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2757.621425 secs 2023-05-08T04:30:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:19 smithi133 ceph-mon[125939]: osdmap e177: 12 total, 12 up, 12 in 2023-05-08T04:30:19.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2758.176555 secs 2023-05-08T04:30:19.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:19 smithi133 ceph-mon[125939]: pgmap v1535: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:30:19.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2757.621425 secs 2023-05-08T04:30:19.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:19 smithi096 ceph-mon[124666]: osdmap e177: 12 total, 12 up, 12 in 2023-05-08T04:30:19.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2758.176555 secs 2023-05-08T04:30:19.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:19 smithi096 ceph-mon[124666]: pgmap v1535: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:30:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2757.621425 secs 2023-05-08T04:30:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:19 smithi186 ceph-mon[126480]: osdmap e177: 12 total, 12 up, 12 in 2023-05-08T04:30:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2758.176555 secs 2023-05-08T04:30:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:19 smithi186 ceph-mon[126480]: pgmap v1535: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:30:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:20 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:30:20.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2759.451582 secs 2023-05-08T04:30:20.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:20 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:30:20.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:20 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:30:20.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:20 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:30:20.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:20 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:30:20.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:20 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T04:30:20.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:20 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T04:30:20.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:20 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:30:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:20 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:30:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2759.451582 secs 2023-05-08T04:30:20.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:20 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:30:20.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:20 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:30:20.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:20 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:30:20.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:20 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:30:20.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:20 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T04:30:20.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:20 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T04:30:20.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:20 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:30:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:20 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:30:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2759.451582 secs 2023-05-08T04:30:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:20 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:30:20.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:20 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:30:20.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:20 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:30:20.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:20 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:30:20.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:20 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T04:30:20.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:20 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T04:30:20.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:20 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:30:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:21 smithi133 ceph-mon[125939]: pgmap v1536: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:30:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:21 smithi096 ceph-mon[124666]: pgmap v1536: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:30:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:21 smithi186 ceph-mon[126480]: pgmap v1536: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:30:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:23 smithi133 ceph-mon[125939]: pgmap v1537: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:30:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2762.621524 secs 2023-05-08T04:30:24.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2763.176680 secs 2023-05-08T04:30:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:23 smithi096 ceph-mon[124666]: pgmap v1537: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:30:24.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2762.621524 secs 2023-05-08T04:30:24.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2763.176680 secs 2023-05-08T04:30:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:23 smithi186 ceph-mon[126480]: pgmap v1537: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:30:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2762.621524 secs 2023-05-08T04:30:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2763.176680 secs 2023-05-08T04:30:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2764.451698 secs 2023-05-08T04:30:26.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:25 smithi133 ceph-mon[125939]: pgmap v1538: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:30:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2764.451698 secs 2023-05-08T04:30:26.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:25 smithi096 ceph-mon[124666]: pgmap v1538: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:30:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2764.451698 secs 2023-05-08T04:30:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:25 smithi186 ceph-mon[126480]: pgmap v1538: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:30:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:27 smithi133 ceph-mon[125939]: pgmap v1539: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:30:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:27 smithi096 ceph-mon[124666]: pgmap v1539: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:30:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:27 smithi186 ceph-mon[126480]: pgmap v1539: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:30:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2767.621649 secs 2023-05-08T04:30:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2768.176803 secs 2023-05-08T04:30:29.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:29 smithi133 ceph-mon[125939]: pgmap v1540: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2023-05-08T04:30:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2767.621649 secs 2023-05-08T04:30:29.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2768.176803 secs 2023-05-08T04:30:29.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:29 smithi096 ceph-mon[124666]: pgmap v1540: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2023-05-08T04:30:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2767.621649 secs 2023-05-08T04:30:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2768.176803 secs 2023-05-08T04:30:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:29 smithi186 ceph-mon[126480]: pgmap v1540: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2023-05-08T04:30:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:31 smithi133 ceph-mon[125939]: pgmap v1541: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 50 KiB/s wr, 8 op/s 2023-05-08T04:30:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:31 smithi096 ceph-mon[124666]: pgmap v1541: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 50 KiB/s wr, 8 op/s 2023-05-08T04:30:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:31 smithi186 ceph-mon[126480]: pgmap v1541: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 50 KiB/s wr, 8 op/s 2023-05-08T04:30:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:33 smithi133 ceph-mon[125939]: pgmap v1542: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 50 KiB/s wr, 5 op/s 2023-05-08T04:30:34.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2772.621781 secs 2023-05-08T04:30:34.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2773.176904 secs 2023-05-08T04:30:34.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:33 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:30:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:33 smithi096 ceph-mon[124666]: pgmap v1542: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 50 KiB/s wr, 5 op/s 2023-05-08T04:30:34.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2772.621781 secs 2023-05-08T04:30:34.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2773.176904 secs 2023-05-08T04:30:34.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:33 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:30:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:33 smithi186 ceph-mon[126480]: pgmap v1542: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 50 KiB/s wr, 5 op/s 2023-05-08T04:30:34.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2772.621781 secs 2023-05-08T04:30:34.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2773.176904 secs 2023-05-08T04:30:34.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:33 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:30:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:34 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:30:35.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:34 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:30:35.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:34 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:30:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:34 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:30:35.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:34 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:30:35.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:34 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:30:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:34 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:30:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:34 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:30:35.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:34 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:30:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2774.451867 secs 2023-05-08T04:30:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:35 smithi133 ceph-mon[125939]: pgmap v1543: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 102 KiB/s wr, 10 op/s 2023-05-08T04:30:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2774.451867 secs 2023-05-08T04:30:36.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:35 smithi096 ceph-mon[124666]: pgmap v1543: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 102 KiB/s wr, 10 op/s 2023-05-08T04:30:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2774.451867 secs 2023-05-08T04:30:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:35 smithi186 ceph-mon[126480]: pgmap v1543: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 102 KiB/s wr, 10 op/s 2023-05-08T04:30:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:37 smithi133 ceph-mon[125939]: pgmap v1544: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 102 KiB/s wr, 7 op/s 2023-05-08T04:30:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:37 smithi096 ceph-mon[124666]: pgmap v1544: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 102 KiB/s wr, 7 op/s 2023-05-08T04:30:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:37 smithi186 ceph-mon[126480]: pgmap v1544: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 102 KiB/s wr, 7 op/s 2023-05-08T04:30:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2777.621902 secs 2023-05-08T04:30:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:38 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:30:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:38 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:30:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2778.177025 secs 2023-05-08T04:30:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2777.621902 secs 2023-05-08T04:30:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:38 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:30:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:38 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:30:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2778.177025 secs 2023-05-08T04:30:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2777.621902 secs 2023-05-08T04:30:39.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:38 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:30:39.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:38 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:30:39.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2778.177025 secs 2023-05-08T04:30:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:39 smithi133 ceph-mon[125939]: pgmap v1545: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 102 KiB/s wr, 7 op/s 2023-05-08T04:30:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:39 smithi096 ceph-mon[124666]: pgmap v1545: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 102 KiB/s wr, 7 op/s 2023-05-08T04:30:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:39 smithi186 ceph-mon[126480]: pgmap v1545: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 102 KiB/s wr, 7 op/s 2023-05-08T04:30:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2779.451975 secs 2023-05-08T04:30:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2779.451975 secs 2023-05-08T04:30:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2779.451975 secs 2023-05-08T04:30:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:41 smithi133 ceph-mon[125939]: pgmap v1546: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 109 KiB/s wr, 12 op/s 2023-05-08T04:30:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:41 smithi096 ceph-mon[124666]: pgmap v1546: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 109 KiB/s wr, 12 op/s 2023-05-08T04:30:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:41 smithi186 ceph-mon[126480]: pgmap v1546: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 109 KiB/s wr, 12 op/s 2023-05-08T04:30:43.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:42 smithi133 ceph-mon[125939]: pgmap v1547: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 59 KiB/s wr, 9 op/s 2023-05-08T04:30:43.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:42 smithi096 ceph-mon[124666]: pgmap v1547: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 59 KiB/s wr, 9 op/s 2023-05-08T04:30:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:42 smithi186 ceph-mon[126480]: pgmap v1547: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 59 KiB/s wr, 9 op/s 2023-05-08T04:30:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2782.622052 secs 2023-05-08T04:30:44.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:43 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:30:44.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2783.177126 secs 2023-05-08T04:30:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2782.622052 secs 2023-05-08T04:30:44.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:43 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:30:44.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2783.177126 secs 2023-05-08T04:30:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2782.622052 secs 2023-05-08T04:30:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:43 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:30:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2783.177126 secs 2023-05-08T04:30:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:44 smithi133 ceph-mon[125939]: pgmap v1548: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 59 KiB/s wr, 12 op/s 2023-05-08T04:30:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:44 smithi096 ceph-mon[124666]: pgmap v1548: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 59 KiB/s wr, 12 op/s 2023-05-08T04:30:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:44 smithi186 ceph-mon[126480]: pgmap v1548: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 59 KiB/s wr, 12 op/s 2023-05-08T04:30:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2784.452093 secs 2023-05-08T04:30:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2784.452093 secs 2023-05-08T04:30:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2784.452093 secs 2023-05-08T04:30:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:46 smithi133 ceph-mon[125939]: pgmap v1549: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 7.2 KiB/s wr, 7 op/s 2023-05-08T04:30:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:46 smithi096 ceph-mon[124666]: pgmap v1549: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 7.2 KiB/s wr, 7 op/s 2023-05-08T04:30:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:46 smithi186 ceph-mon[126480]: pgmap v1549: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 7.2 KiB/s wr, 7 op/s 2023-05-08T04:30:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2787.622110 secs 2023-05-08T04:30:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2788.177247 secs 2023-05-08T04:30:49.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:49 smithi133 ceph-mon[125939]: pgmap v1550: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 7.2 KiB/s wr, 7 op/s 2023-05-08T04:30:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2787.622110 secs 2023-05-08T04:30:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2788.177247 secs 2023-05-08T04:30:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:49 smithi096 ceph-mon[124666]: pgmap v1550: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 7.2 KiB/s wr, 7 op/s 2023-05-08T04:30:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2787.622110 secs 2023-05-08T04:30:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2788.177247 secs 2023-05-08T04:30:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:49 smithi186 ceph-mon[126480]: pgmap v1550: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 7.2 KiB/s wr, 7 op/s 2023-05-08T04:30:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2789.452218 secs 2023-05-08T04:30:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2789.452218 secs 2023-05-08T04:30:50.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2789.452218 secs 2023-05-08T04:30:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:51 smithi133 ceph-mon[125939]: pgmap v1551: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 15 KiB/s wr, 10 op/s 2023-05-08T04:30:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:51 smithi096 ceph-mon[124666]: pgmap v1551: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 15 KiB/s wr, 10 op/s 2023-05-08T04:30:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:51 smithi186 ceph-mon[126480]: pgmap v1551: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 15 KiB/s wr, 10 op/s 2023-05-08T04:30:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:53 smithi133 ceph-mon[125939]: pgmap v1552: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.3 KiB/s wr, 5 op/s 2023-05-08T04:30:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2792.622186 secs 2023-05-08T04:30:54.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2793.177387 secs 2023-05-08T04:30:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:53 smithi096 ceph-mon[124666]: pgmap v1552: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.3 KiB/s wr, 5 op/s 2023-05-08T04:30:54.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2792.622186 secs 2023-05-08T04:30:54.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2793.177387 secs 2023-05-08T04:30:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:53 smithi186 ceph-mon[126480]: pgmap v1552: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.3 KiB/s wr, 5 op/s 2023-05-08T04:30:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2792.622186 secs 2023-05-08T04:30:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2793.177387 secs 2023-05-08T04:30:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2794.452340 secs 2023-05-08T04:30:56.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:55 smithi133 ceph-mon[125939]: pgmap v1553: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.3 KiB/s wr, 8 op/s 2023-05-08T04:30:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2794.452340 secs 2023-05-08T04:30:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:55 smithi096 ceph-mon[124666]: pgmap v1553: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.3 KiB/s wr, 8 op/s 2023-05-08T04:30:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2794.452340 secs 2023-05-08T04:30:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:55 smithi186 ceph-mon[126480]: pgmap v1553: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.3 KiB/s wr, 8 op/s 2023-05-08T04:30:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:57 smithi133 ceph-mon[125939]: pgmap v1554: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.2 KiB/s wr, 5 op/s 2023-05-08T04:30:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:57 smithi096 ceph-mon[124666]: pgmap v1554: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.2 KiB/s wr, 5 op/s 2023-05-08T04:30:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:57 smithi186 ceph-mon[126480]: pgmap v1554: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.2 KiB/s wr, 5 op/s 2023-05-08T04:30:59.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2797.622327 secs 2023-05-08T04:30:59.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2798.177536 secs 2023-05-08T04:30:59.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:30:59 smithi133 ceph-mon[125939]: pgmap v1555: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.2 KiB/s wr, 5 op/s 2023-05-08T04:30:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2797.622327 secs 2023-05-08T04:30:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2798.177536 secs 2023-05-08T04:30:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:30:59 smithi096 ceph-mon[124666]: pgmap v1555: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.2 KiB/s wr, 5 op/s 2023-05-08T04:30:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2797.622327 secs 2023-05-08T04:30:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2798.177536 secs 2023-05-08T04:30:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:30:59 smithi186 ceph-mon[126480]: pgmap v1555: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.2 KiB/s wr, 5 op/s 2023-05-08T04:31:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2799.452439 secs 2023-05-08T04:31:00.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2799.452439 secs 2023-05-08T04:31:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2799.452439 secs 2023-05-08T04:31:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:01 smithi133 ceph-mon[125939]: pgmap v1556: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.2 KiB/s wr, 7 op/s 2023-05-08T04:31:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:01 smithi096 ceph-mon[124666]: pgmap v1556: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.2 KiB/s wr, 7 op/s 2023-05-08T04:31:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:01 smithi186 ceph-mon[126480]: pgmap v1556: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.2 KiB/s wr, 7 op/s 2023-05-08T04:31:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:03 smithi133 ceph-mon[125939]: pgmap v1557: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:31:04.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2802.622371 secs 2023-05-08T04:31:04.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2803.177649 secs 2023-05-08T04:31:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:03 smithi096 ceph-mon[124666]: pgmap v1557: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:31:04.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2802.622371 secs 2023-05-08T04:31:04.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2803.177649 secs 2023-05-08T04:31:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:03 smithi186 ceph-mon[126480]: pgmap v1557: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:31:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2802.622371 secs 2023-05-08T04:31:04.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2803.177649 secs 2023-05-08T04:31:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2804.452583 secs 2023-05-08T04:31:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:05 smithi133 ceph-mon[125939]: pgmap v1558: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:31:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2804.452583 secs 2023-05-08T04:31:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:05 smithi096 ceph-mon[124666]: pgmap v1558: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:31:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2804.452583 secs 2023-05-08T04:31:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:05 smithi186 ceph-mon[126480]: pgmap v1558: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:31:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:07 smithi133 ceph-mon[125939]: pgmap v1559: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:31:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:07 smithi096 ceph-mon[124666]: pgmap v1559: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:31:08.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:07 smithi186 ceph-mon[126480]: pgmap v1559: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:31:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2807.622418 secs 2023-05-08T04:31:09.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2808.177762 secs 2023-05-08T04:31:09.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:09 smithi133 ceph-mon[125939]: pgmap v1560: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:31:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2807.622418 secs 2023-05-08T04:31:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2808.177762 secs 2023-05-08T04:31:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:09 smithi096 ceph-mon[124666]: pgmap v1560: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:31:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2807.622418 secs 2023-05-08T04:31:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2808.177762 secs 2023-05-08T04:31:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:09 smithi186 ceph-mon[126480]: pgmap v1560: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:31:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2809.452692 secs 2023-05-08T04:31:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2809.452692 secs 2023-05-08T04:31:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2809.452692 secs 2023-05-08T04:31:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:11 smithi133 ceph-mon[125939]: osdmap e178: 12 total, 12 up, 12 in 2023-05-08T04:31:11.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:11 smithi133 ceph-mon[125939]: pgmap v1562: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:31:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:11 smithi096 ceph-mon[124666]: osdmap e178: 12 total, 12 up, 12 in 2023-05-08T04:31:11.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:11 smithi096 ceph-mon[124666]: pgmap v1562: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:31:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:11 smithi186 ceph-mon[126480]: osdmap e178: 12 total, 12 up, 12 in 2023-05-08T04:31:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:11 smithi186 ceph-mon[126480]: pgmap v1562: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:31:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:13 smithi133 ceph-mon[125939]: pgmap v1563: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:31:14.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2812.622534 secs 2023-05-08T04:31:14.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2813.177881 secs 2023-05-08T04:31:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:13 smithi096 ceph-mon[124666]: pgmap v1563: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:31:14.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2812.622534 secs 2023-05-08T04:31:14.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2813.177881 secs 2023-05-08T04:31:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:13 smithi186 ceph-mon[126480]: pgmap v1563: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:31:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2812.622534 secs 2023-05-08T04:31:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2813.177881 secs 2023-05-08T04:31:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2814.452830 secs 2023-05-08T04:31:16.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:15 smithi133 ceph-mon[125939]: pgmap v1564: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:31:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2814.452830 secs 2023-05-08T04:31:16.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:15 smithi096 ceph-mon[124666]: pgmap v1564: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:31:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2814.452830 secs 2023-05-08T04:31:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:15 smithi186 ceph-mon[126480]: pgmap v1564: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:31:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:17 smithi133 ceph-mon[125939]: pgmap v1565: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:31:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:17 smithi096 ceph-mon[124666]: pgmap v1565: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:31:18.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:17 smithi186 ceph-mon[126480]: pgmap v1565: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:31:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2817.622610 secs 2023-05-08T04:31:19.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:19 smithi133 ceph-mon[125939]: osdmap e179: 12 total, 12 up, 12 in 2023-05-08T04:31:19.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2818.177990 secs 2023-05-08T04:31:19.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:19 smithi133 ceph-mon[125939]: pgmap v1567: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:31:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2817.622610 secs 2023-05-08T04:31:19.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:19 smithi096 ceph-mon[124666]: osdmap e179: 12 total, 12 up, 12 in 2023-05-08T04:31:19.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2818.177990 secs 2023-05-08T04:31:19.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:19 smithi096 ceph-mon[124666]: pgmap v1567: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:31:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2817.622610 secs 2023-05-08T04:31:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:19 smithi186 ceph-mon[126480]: osdmap e179: 12 total, 12 up, 12 in 2023-05-08T04:31:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2818.177990 secs 2023-05-08T04:31:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:19 smithi186 ceph-mon[126480]: pgmap v1567: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:31:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2819.452969 secs 2023-05-08T04:31:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:20 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:31:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2819.452969 secs 2023-05-08T04:31:20.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:20 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:31:20.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2819.452969 secs 2023-05-08T04:31:20.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:20 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:31:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:31:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:31:21.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:21 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:31:21.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:31:21.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:21 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T04:31:21.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:21 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T04:31:21.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:21 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:31:21.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:21 smithi133 ceph-mon[125939]: pgmap v1568: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:31:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:31:21.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:31:21.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:21 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:31:21.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:31:21.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:21 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T04:31:21.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:21 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T04:31:21.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:21 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:31:21.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:21 smithi096 ceph-mon[124666]: pgmap v1568: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:31:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:31:21.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:31:21.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:21 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:31:21.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:31:21.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:21 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T04:31:21.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:21 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T04:31:21.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:21 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:31:21.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:21 smithi186 ceph-mon[126480]: pgmap v1568: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:31:24.245 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:23 smithi133 ceph-mon[125939]: pgmap v1569: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:31:24.246 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2822.622685 secs 2023-05-08T04:31:24.246 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2823.178154 secs 2023-05-08T04:31:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:23 smithi096 ceph-mon[124666]: pgmap v1569: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:31:24.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2822.622685 secs 2023-05-08T04:31:24.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2823.178154 secs 2023-05-08T04:31:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:23 smithi186 ceph-mon[126480]: pgmap v1569: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:31:24.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2822.622685 secs 2023-05-08T04:31:24.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2823.178154 secs 2023-05-08T04:31:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2824.453095 secs 2023-05-08T04:31:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:25 smithi133 ceph-mon[125939]: pgmap v1570: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:31:26.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2824.453095 secs 2023-05-08T04:31:26.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:25 smithi096 ceph-mon[124666]: pgmap v1570: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:31:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2824.453095 secs 2023-05-08T04:31:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:25 smithi186 ceph-mon[126480]: pgmap v1570: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:31:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:27 smithi133 ceph-mon[125939]: pgmap v1571: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:31:28.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:27 smithi096 ceph-mon[124666]: pgmap v1571: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:31:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:27 smithi186 ceph-mon[126480]: pgmap v1571: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:31:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2827.622822 secs 2023-05-08T04:31:29.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2828.178275 secs 2023-05-08T04:31:29.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:29 smithi133 ceph-mon[125939]: pgmap v1572: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2023-05-08T04:31:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2827.622822 secs 2023-05-08T04:31:29.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2828.178275 secs 2023-05-08T04:31:29.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:29 smithi096 ceph-mon[124666]: pgmap v1572: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2023-05-08T04:31:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2827.622822 secs 2023-05-08T04:31:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2828.178275 secs 2023-05-08T04:31:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:29 smithi186 ceph-mon[126480]: pgmap v1572: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2023-05-08T04:31:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:31 smithi133 ceph-mon[125939]: pgmap v1573: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 34 KiB/s wr, 8 op/s 2023-05-08T04:31:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:31 smithi096 ceph-mon[124666]: pgmap v1573: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 34 KiB/s wr, 8 op/s 2023-05-08T04:31:32.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:31 smithi186 ceph-mon[126480]: pgmap v1573: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 34 KiB/s wr, 8 op/s 2023-05-08T04:31:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:33 smithi133 ceph-mon[125939]: pgmap v1574: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 34 KiB/s wr, 5 op/s 2023-05-08T04:31:34.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2832.622938 secs 2023-05-08T04:31:34.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2833.178398 secs 2023-05-08T04:31:34.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:33 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:31:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:33 smithi096 ceph-mon[124666]: pgmap v1574: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 34 KiB/s wr, 5 op/s 2023-05-08T04:31:34.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2832.622938 secs 2023-05-08T04:31:34.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2833.178398 secs 2023-05-08T04:31:34.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:33 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:31:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:33 smithi186 ceph-mon[126480]: pgmap v1574: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 34 KiB/s wr, 5 op/s 2023-05-08T04:31:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2832.622938 secs 2023-05-08T04:31:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2833.178398 secs 2023-05-08T04:31:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:33 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:31:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:34 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:31:35.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:34 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:31:35.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:34 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:31:35.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:34 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:31:35.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:34 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:31:35.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:34 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:31:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:34 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:31:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:34 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:31:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:34 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:31:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2834.453337 secs 2023-05-08T04:31:36.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:35 smithi133 ceph-mon[125939]: pgmap v1575: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 62 KiB/s wr, 9 op/s 2023-05-08T04:31:36.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2834.453337 secs 2023-05-08T04:31:36.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:35 smithi096 ceph-mon[124666]: pgmap v1575: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 62 KiB/s wr, 9 op/s 2023-05-08T04:31:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2834.453337 secs 2023-05-08T04:31:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:35 smithi186 ceph-mon[126480]: pgmap v1575: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 62 KiB/s wr, 9 op/s 2023-05-08T04:31:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:37 smithi133 ceph-mon[125939]: pgmap v1576: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T04:31:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:37 smithi096 ceph-mon[124666]: pgmap v1576: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T04:31:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:37 smithi186 ceph-mon[126480]: pgmap v1576: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T04:31:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2837.623054 secs 2023-05-08T04:31:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:38 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:31:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:38 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:31:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2838.178542 secs 2023-05-08T04:31:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2837.623054 secs 2023-05-08T04:31:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:38 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:31:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:38 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:31:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2838.178542 secs 2023-05-08T04:31:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2837.623054 secs 2023-05-08T04:31:39.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:38 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:31:39.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:38 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:31:39.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2838.178542 secs 2023-05-08T04:31:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:39 smithi133 ceph-mon[125939]: pgmap v1577: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T04:31:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:39 smithi096 ceph-mon[124666]: pgmap v1577: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T04:31:40.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:39 smithi186 ceph-mon[126480]: pgmap v1577: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T04:31:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2839.453454 secs 2023-05-08T04:31:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:40 smithi133 ceph-mon[125939]: pgmap v1578: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 92 KiB/s wr, 11 op/s 2023-05-08T04:31:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2839.453454 secs 2023-05-08T04:31:41.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:40 smithi096 ceph-mon[124666]: pgmap v1578: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 92 KiB/s wr, 11 op/s 2023-05-08T04:31:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2839.453454 secs 2023-05-08T04:31:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:40 smithi186 ceph-mon[126480]: pgmap v1578: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 92 KiB/s wr, 11 op/s 2023-05-08T04:31:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2842.623168 secs 2023-05-08T04:31:44.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:43 smithi133 ceph-mon[125939]: pgmap v1579: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 58 KiB/s wr, 8 op/s 2023-05-08T04:31:44.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:43 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:31:44.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2843.178685 secs 2023-05-08T04:31:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2842.623168 secs 2023-05-08T04:31:44.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:43 smithi096 ceph-mon[124666]: pgmap v1579: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 58 KiB/s wr, 8 op/s 2023-05-08T04:31:44.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:43 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:31:44.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2843.178685 secs 2023-05-08T04:31:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2842.623168 secs 2023-05-08T04:31:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:43 smithi186 ceph-mon[126480]: pgmap v1579: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 58 KiB/s wr, 8 op/s 2023-05-08T04:31:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:43 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:31:44.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2843.178685 secs 2023-05-08T04:31:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2844.453571 secs 2023-05-08T04:31:46.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:45 smithi133 ceph-mon[125939]: pgmap v1580: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 58 KiB/s wr, 10 op/s 2023-05-08T04:31:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2844.453571 secs 2023-05-08T04:31:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:45 smithi096 ceph-mon[124666]: pgmap v1580: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 58 KiB/s wr, 10 op/s 2023-05-08T04:31:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2844.453571 secs 2023-05-08T04:31:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:45 smithi186 ceph-mon[126480]: pgmap v1580: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 58 KiB/s wr, 10 op/s 2023-05-08T04:31:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:47 smithi133 ceph-mon[125939]: pgmap v1581: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 30 KiB/s wr, 6 op/s 2023-05-08T04:31:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:47 smithi096 ceph-mon[124666]: pgmap v1581: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 30 KiB/s wr, 6 op/s 2023-05-08T04:31:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:47 smithi186 ceph-mon[126480]: pgmap v1581: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 30 KiB/s wr, 6 op/s 2023-05-08T04:31:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2847.623298 secs 2023-05-08T04:31:49.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2848.178805 secs 2023-05-08T04:31:49.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:49 smithi133 ceph-mon[125939]: pgmap v1582: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 30 KiB/s wr, 6 op/s 2023-05-08T04:31:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2847.623298 secs 2023-05-08T04:31:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2848.178805 secs 2023-05-08T04:31:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:49 smithi096 ceph-mon[124666]: pgmap v1582: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 30 KiB/s wr, 6 op/s 2023-05-08T04:31:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2847.623298 secs 2023-05-08T04:31:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2848.178805 secs 2023-05-08T04:31:49.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:49 smithi186 ceph-mon[126480]: pgmap v1582: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 30 KiB/s wr, 6 op/s 2023-05-08T04:31:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2849.453708 secs 2023-05-08T04:31:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2849.453708 secs 2023-05-08T04:31:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2849.453708 secs 2023-05-08T04:31:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:51 smithi133 ceph-mon[125939]: pgmap v1583: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 38 KiB/s wr, 9 op/s 2023-05-08T04:31:51.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:51 smithi096 ceph-mon[124666]: pgmap v1583: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 38 KiB/s wr, 9 op/s 2023-05-08T04:31:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:51 smithi186 ceph-mon[126480]: pgmap v1583: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 38 KiB/s wr, 9 op/s 2023-05-08T04:31:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2852.623409 secs 2023-05-08T04:31:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:53 smithi133 ceph-mon[125939]: pgmap v1584: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.4 KiB/s wr, 5 op/s 2023-05-08T04:31:54.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2853.178927 secs 2023-05-08T04:31:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2852.623409 secs 2023-05-08T04:31:54.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:53 smithi096 ceph-mon[124666]: pgmap v1584: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.4 KiB/s wr, 5 op/s 2023-05-08T04:31:54.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2853.178927 secs 2023-05-08T04:31:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2852.623409 secs 2023-05-08T04:31:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:53 smithi186 ceph-mon[126480]: pgmap v1584: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.4 KiB/s wr, 5 op/s 2023-05-08T04:31:54.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2853.178927 secs 2023-05-08T04:31:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2854.453805 secs 2023-05-08T04:31:56.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:55 smithi133 ceph-mon[125939]: pgmap v1585: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.4 KiB/s wr, 7 op/s 2023-05-08T04:31:56.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2854.453805 secs 2023-05-08T04:31:56.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:55 smithi096 ceph-mon[124666]: pgmap v1585: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.4 KiB/s wr, 7 op/s 2023-05-08T04:31:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2854.453805 secs 2023-05-08T04:31:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:55 smithi186 ceph-mon[126480]: pgmap v1585: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.4 KiB/s wr, 7 op/s 2023-05-08T04:31:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:57 smithi133 ceph-mon[125939]: pgmap v1586: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.3 KiB/s wr, 5 op/s 2023-05-08T04:31:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:57 smithi096 ceph-mon[124666]: pgmap v1586: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.3 KiB/s wr, 5 op/s 2023-05-08T04:31:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:57 smithi186 ceph-mon[126480]: pgmap v1586: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.3 KiB/s wr, 5 op/s 2023-05-08T04:31:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2857.623547 secs 2023-05-08T04:31:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2858.179048 secs 2023-05-08T04:31:59.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:31:59 smithi133 ceph-mon[125939]: pgmap v1587: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.3 KiB/s wr, 5 op/s 2023-05-08T04:31:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2857.623547 secs 2023-05-08T04:31:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2858.179048 secs 2023-05-08T04:31:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:31:59 smithi096 ceph-mon[124666]: pgmap v1587: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.3 KiB/s wr, 5 op/s 2023-05-08T04:31:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2857.623547 secs 2023-05-08T04:31:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2858.179048 secs 2023-05-08T04:31:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:31:59 smithi186 ceph-mon[126480]: pgmap v1587: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.3 KiB/s wr, 5 op/s 2023-05-08T04:32:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:32:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2859.453871 secs 2023-05-08T04:32:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:32:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2859.453871 secs 2023-05-08T04:32:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:32:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2859.453871 secs 2023-05-08T04:32:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:32:01 smithi133 ceph-mon[125939]: pgmap v1588: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.3 KiB/s wr, 7 op/s 2023-05-08T04:32:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:32:01 smithi096 ceph-mon[124666]: pgmap v1588: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.3 KiB/s wr, 7 op/s 2023-05-08T04:32:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:32:01 smithi186 ceph-mon[126480]: pgmap v1588: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.3 KiB/s wr, 7 op/s 2023-05-08T04:32:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:32:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2862.623661 secs 2023-05-08T04:32:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:32:03 smithi133 ceph-mon[125939]: pgmap v1589: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:32:04.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:32:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2863.179169 secs 2023-05-08T04:32:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:32:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2862.623661 secs 2023-05-08T04:32:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:32:03 smithi096 ceph-mon[124666]: pgmap v1589: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:32:04.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:32:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2863.179169 secs 2023-05-08T04:32:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:32:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2862.623661 secs 2023-05-08T04:32:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:32:03 smithi186 ceph-mon[126480]: pgmap v1589: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:32:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:32:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2863.179169 secs 2023-05-08T04:32:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:32:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2864.453963 secs 2023-05-08T04:32:06.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:32:05 smithi133 ceph-mon[125939]: pgmap v1590: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:32:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:32:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2864.453963 secs 2023-05-08T04:32:06.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:32:05 smithi096 ceph-mon[124666]: pgmap v1590: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:32:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:32:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2864.453963 secs 2023-05-08T04:32:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:32:05 smithi186 ceph-mon[126480]: pgmap v1590: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:32:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:32:07 smithi133 ceph-mon[125939]: pgmap v1591: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:32:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:32:07 smithi096 ceph-mon[124666]: pgmap v1591: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:32:08.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:32:07 smithi186 ceph-mon[126480]: pgmap v1591: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:32:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:32:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2867.623789 secs 2023-05-08T04:32:09.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:32:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2868.179288 secs 2023-05-08T04:32:09.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:32:09 smithi133 ceph-mon[125939]: pgmap v1592: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:32:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:32:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2867.623789 secs 2023-05-08T04:32:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:32:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2868.179288 secs 2023-05-08T04:32:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:32:09 smithi096 ceph-mon[124666]: pgmap v1592: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:32:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:32:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2867.623789 secs 2023-05-08T04:32:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:32:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2868.179288 secs 2023-05-08T04:32:09.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:32:09 smithi186 ceph-mon[126480]: pgmap v1592: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:32:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:32:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2869.454083 secs 2023-05-08T04:32:10.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:32:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2869.454083 secs 2023-05-08T04:32:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:32:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2869.454083 secs 2023-05-08T04:32:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:32:11 smithi096 ceph-mon[124666]: osdmap e180: 12 total, 12 up, 12 in 2023-05-08T04:32:11.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:32:11 smithi096 ceph-mon[124666]: pgmap v1594: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:32:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:32:11 smithi186 ceph-mon[126480]: osdmap e180: 12 total, 12 up, 12 in 2023-05-08T04:32:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:32:11 smithi186 ceph-mon[126480]: pgmap v1594: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:32:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:32:11 smithi133 ceph-mon[125939]: osdmap e180: 12 total, 12 up, 12 in 2023-05-08T04:32:11.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:32:11 smithi133 ceph-mon[125939]: pgmap v1594: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:32:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:32:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2872.623899 secs 2023-05-08T04:32:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:32:13 smithi133 ceph-mon[125939]: pgmap v1595: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:32:14.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:32:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2873.179386 secs 2023-05-08T04:32:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:32:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2872.623899 secs 2023-05-08T04:32:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:32:13 smithi096 ceph-mon[124666]: pgmap v1595: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:32:14.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:32:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2873.179386 secs 2023-05-08T04:32:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:32:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2872.623899 secs 2023-05-08T04:32:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:32:13 smithi186 ceph-mon[126480]: pgmap v1595: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:32:14.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:32:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2873.179386 secs 2023-05-08T04:32:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:32:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2874.454227 secs 2023-05-08T04:32:16.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:32:15 smithi133 ceph-mon[125939]: pgmap v1596: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:32:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:32:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2874.454227 secs 2023-05-08T04:32:16.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:32:15 smithi096 ceph-mon[124666]: pgmap v1596: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:32:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:32:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2874.454227 secs 2023-05-08T04:32:16.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:32:15 smithi186 ceph-mon[126480]: pgmap v1596: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:32:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:32:17 smithi133 ceph-mon[125939]: pgmap v1597: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:32:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:32:17 smithi096 ceph-mon[124666]: pgmap v1597: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:32:18.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:32:17 smithi186 ceph-mon[126480]: pgmap v1597: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:32:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:32:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2877.624017 secs 2023-05-08T04:32:19.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:32:19 smithi133 ceph-mon[125939]: osdmap e181: 12 total, 12 up, 12 in 2023-05-08T04:32:19.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:32:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2878.179545 secs 2023-05-08T04:32:19.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:32:19 smithi133 ceph-mon[125939]: pgmap v1599: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 118 B/s wr, 4 op/s 2023-05-08T04:32:19.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:32:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2877.624017 secs 2023-05-08T04:32:19.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:32:19 smithi096 ceph-mon[124666]: osdmap e181: 12 total, 12 up, 12 in 2023-05-08T04:32:19.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:32:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2878.179545 secs 2023-05-08T04:32:19.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:32:19 smithi096 ceph-mon[124666]: pgmap v1599: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 118 B/s wr, 4 op/s 2023-05-08T04:32:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:32:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2877.624017 secs 2023-05-08T04:32:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:32:19 smithi186 ceph-mon[126480]: osdmap e181: 12 total, 12 up, 12 in 2023-05-08T04:32:19.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:32:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2878.179545 secs 2023-05-08T04:32:19.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:32:19 smithi186 ceph-mon[126480]: pgmap v1599: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 118 B/s wr, 4 op/s 2023-05-08T04:32:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:32:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2879.454338 secs 2023-05-08T04:32:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:32:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2879.454338 secs 2023-05-08T04:32:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:32:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2879.454338 secs 2023-05-08T04:32:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:32:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:32:21.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:32:21 smithi096 ceph-mon[124666]: pgmap v1600: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:32:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:32:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:32:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:32:21 smithi186 ceph-mon[126480]: pgmap v1600: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:32:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:32:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:32:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:32:21 smithi133 ceph-mon[125939]: pgmap v1600: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:32:22.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:32:22 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:32:22.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:32:22 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:32:22.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:32:22 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:32:22.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:32:22 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:32:22.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:32:22 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T04:32:22.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:32:22 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T04:32:22.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:32:22 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:32:22.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:32:22 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:32:22.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:32:22 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:32:22.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:32:22 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:32:22.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:32:22 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:32:22.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:32:22 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T04:32:22.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:32:22 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T04:32:22.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:32:22 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:32:22.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:32:22 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:32:22.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:32:22 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:32:22.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:32:22 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:32:22.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:32:22 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:32:22.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:32:22 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T04:32:22.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:32:22 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T04:32:22.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:32:22 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:32:23.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:32:23 smithi096 ceph-mon[124666]: pgmap v1601: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:32:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:32:23 smithi186 ceph-mon[126480]: pgmap v1601: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:32:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:32:23 smithi133 ceph-mon[125939]: pgmap v1601: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:32:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:32:24 smithi096 ceph-mon[124666]: 1 slow requests, 1 included below; oldest blocked for > 2882.624130 secs 2023-05-08T04:32:24.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:32:24 smithi096 ceph-mon[124666]: slow request 2882.624130 seconds old, received at 2023-05-08T03:44:20.260233+0000: client_request(client.15258:3163 link #0x10000000007/0000000100000000000000F2 #0x10000000007/0000000100000000000000C5 2023-05-08T03:44:20.259302+0000 caller_uid=26, caller_gid=26{26,}) currently acquired locks 2023-05-08T04:32:24.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:32:24 smithi096 ceph-mon[124666]: 1 slow requests, 1 included below; oldest blocked for > 2883.179669 secs 2023-05-08T04:32:24.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:32:24 smithi096 ceph-mon[124666]: slow request 2883.179668 seconds old, received at 2023-05-08T03:44:20.272100+0000: peer_request:client.15258:3163 currently acquired locks 2023-05-08T04:32:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:32:24 smithi186 ceph-mon[126480]: 1 slow requests, 1 included below; oldest blocked for > 2882.624130 secs 2023-05-08T04:32:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:32:24 smithi186 ceph-mon[126480]: slow request 2882.624130 seconds old, received at 2023-05-08T03:44:20.260233+0000: client_request(client.15258:3163 link #0x10000000007/0000000100000000000000F2 #0x10000000007/0000000100000000000000C5 2023-05-08T03:44:20.259302+0000 caller_uid=26, caller_gid=26{26,}) currently acquired locks 2023-05-08T04:32:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:32:24 smithi186 ceph-mon[126480]: 1 slow requests, 1 included below; oldest blocked for > 2883.179669 secs 2023-05-08T04:32:24.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:32:24 smithi186 ceph-mon[126480]: slow request 2883.179668 seconds old, received at 2023-05-08T03:44:20.272100+0000: peer_request:client.15258:3163 currently acquired locks 2023-05-08T04:32:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:32:24 smithi133 ceph-mon[125939]: 1 slow requests, 1 included below; oldest blocked for > 2882.624130 secs 2023-05-08T04:32:24.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:32:24 smithi133 ceph-mon[125939]: slow request 2882.624130 seconds old, received at 2023-05-08T03:44:20.260233+0000: client_request(client.15258:3163 link #0x10000000007/0000000100000000000000F2 #0x10000000007/0000000100000000000000C5 2023-05-08T03:44:20.259302+0000 caller_uid=26, caller_gid=26{26,}) currently acquired locks 2023-05-08T04:32:24.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:32:24 smithi133 ceph-mon[125939]: 1 slow requests, 1 included below; oldest blocked for > 2883.179669 secs 2023-05-08T04:32:24.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:32:24 smithi133 ceph-mon[125939]: slow request 2883.179668 seconds old, received at 2023-05-08T03:44:20.272100+0000: peer_request:client.15258:3163 currently acquired locks 2023-05-08T04:32:25.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:32:25 smithi096 ceph-mon[124666]: 1 slow requests, 1 included below; oldest blocked for > 2884.454468 secs 2023-05-08T04:32:25.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:32:25 smithi096 ceph-mon[124666]: slow request 2884.454468 seconds old, received at 2023-05-08T03:44:20.261840+0000: peer_request:client.15258:3163 currently dispatched 2023-05-08T04:32:25.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:32:25 smithi096 ceph-mon[124666]: pgmap v1602: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:32:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:32:25 smithi186 ceph-mon[126480]: 1 slow requests, 1 included below; oldest blocked for > 2884.454468 secs 2023-05-08T04:32:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:32:25 smithi186 ceph-mon[126480]: slow request 2884.454468 seconds old, received at 2023-05-08T03:44:20.261840+0000: peer_request:client.15258:3163 currently dispatched 2023-05-08T04:32:25.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:32:25 smithi186 ceph-mon[126480]: pgmap v1602: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:32:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:32:25 smithi133 ceph-mon[125939]: 1 slow requests, 1 included below; oldest blocked for > 2884.454468 secs 2023-05-08T04:32:25.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:32:25 smithi133 ceph-mon[125939]: slow request 2884.454468 seconds old, received at 2023-05-08T03:44:20.261840+0000: peer_request:client.15258:3163 currently dispatched 2023-05-08T04:32:25.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:32:25 smithi133 ceph-mon[125939]: pgmap v1602: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:32:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:32:27 smithi133 ceph-mon[125939]: pgmap v1603: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:32:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:32:27 smithi096 ceph-mon[124666]: pgmap v1603: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:32:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:32:27 smithi186 ceph-mon[126480]: pgmap v1603: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:32:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:32:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2887.624248 secs 2023-05-08T04:32:29.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:32:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2888.179789 secs 2023-05-08T04:32:29.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:32:29 smithi133 ceph-mon[125939]: pgmap v1604: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2023-05-08T04:32:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:32:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2887.624248 secs 2023-05-08T04:32:29.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:32:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2888.179789 secs 2023-05-08T04:32:29.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:32:29 smithi096 ceph-mon[124666]: pgmap v1604: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2023-05-08T04:32:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:32:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2887.624248 secs 2023-05-08T04:32:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:32:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2888.179789 secs 2023-05-08T04:32:29.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:32:29 smithi186 ceph-mon[126480]: pgmap v1604: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2023-05-08T04:32:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:32:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2889.454606 secs 2023-05-08T04:32:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:32:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2889.454606 secs 2023-05-08T04:32:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:32:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2889.454606 secs 2023-05-08T04:32:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:32:31 smithi096 ceph-mon[124666]: pgmap v1605: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 34 KiB/s wr, 8 op/s 2023-05-08T04:32:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:32:31 smithi186 ceph-mon[126480]: pgmap v1605: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 34 KiB/s wr, 8 op/s 2023-05-08T04:32:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:32:31 smithi133 ceph-mon[125939]: pgmap v1605: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 34 KiB/s wr, 8 op/s 2023-05-08T04:32:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:32:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2892.624359 secs 2023-05-08T04:32:34.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:32:33 smithi133 ceph-mon[125939]: pgmap v1606: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 34 KiB/s wr, 5 op/s 2023-05-08T04:32:34.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:32:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2893.179886 secs 2023-05-08T04:32:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:32:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2892.624359 secs 2023-05-08T04:32:34.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:32:33 smithi096 ceph-mon[124666]: pgmap v1606: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 34 KiB/s wr, 5 op/s 2023-05-08T04:32:34.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:32:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2893.179886 secs 2023-05-08T04:32:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:32:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2892.624359 secs 2023-05-08T04:32:34.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:32:33 smithi186 ceph-mon[126480]: pgmap v1606: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 34 KiB/s wr, 5 op/s 2023-05-08T04:32:34.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:32:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2893.179886 secs 2023-05-08T04:32:36.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:32:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2894.454700 secs 2023-05-08T04:32:36.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:32:35 smithi133 ceph-mon[125939]: pgmap v1607: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 63 KiB/s wr, 9 op/s 2023-05-08T04:32:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:32:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2894.454700 secs 2023-05-08T04:32:36.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:32:35 smithi096 ceph-mon[124666]: pgmap v1607: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 63 KiB/s wr, 9 op/s 2023-05-08T04:32:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:32:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2894.454700 secs 2023-05-08T04:32:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:32:35 smithi186 ceph-mon[126480]: pgmap v1607: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 63 KiB/s wr, 9 op/s 2023-05-08T04:32:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:32:37 smithi133 ceph-mon[125939]: pgmap v1608: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 63 KiB/s wr, 6 op/s 2023-05-08T04:32:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:32:37 smithi096 ceph-mon[124666]: pgmap v1608: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 63 KiB/s wr, 6 op/s 2023-05-08T04:32:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:32:37 smithi186 ceph-mon[126480]: pgmap v1608: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 63 KiB/s wr, 6 op/s 2023-05-08T04:32:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:32:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2897.624411 secs 2023-05-08T04:32:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:32:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2898.179987 secs 2023-05-08T04:32:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:32:39 smithi133 ceph-mon[125939]: pgmap v1609: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 63 KiB/s wr, 6 op/s 2023-05-08T04:32:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:32:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2897.624411 secs 2023-05-08T04:32:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:32:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2898.179987 secs 2023-05-08T04:32:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:32:39 smithi096 ceph-mon[124666]: pgmap v1609: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 63 KiB/s wr, 6 op/s 2023-05-08T04:32:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:32:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2897.624411 secs 2023-05-08T04:32:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:32:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2898.179987 secs 2023-05-08T04:32:39.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:32:39 smithi186 ceph-mon[126480]: pgmap v1609: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 63 KiB/s wr, 6 op/s 2023-05-08T04:32:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:32:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2899.454839 secs 2023-05-08T04:32:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:32:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2899.454839 secs 2023-05-08T04:32:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:32:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2899.454839 secs 2023-05-08T04:32:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:32:41 smithi096 ceph-mon[124666]: pgmap v1610: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 96 KiB/s wr, 11 op/s 2023-05-08T04:32:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:32:41 smithi186 ceph-mon[126480]: pgmap v1610: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 96 KiB/s wr, 11 op/s 2023-05-08T04:32:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:32:41 smithi133 ceph-mon[125939]: pgmap v1610: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 96 KiB/s wr, 11 op/s 2023-05-08T04:32:44.244 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:32:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2902.624521 secs 2023-05-08T04:32:44.244 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:32:43 smithi133 ceph-mon[125939]: pgmap v1611: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 62 KiB/s wr, 8 op/s 2023-05-08T04:32:44.244 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:32:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2903.180068 secs 2023-05-08T04:32:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:32:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2902.624521 secs 2023-05-08T04:32:44.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:32:43 smithi096 ceph-mon[124666]: pgmap v1611: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 62 KiB/s wr, 8 op/s 2023-05-08T04:32:44.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:32:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2903.180068 secs 2023-05-08T04:32:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:32:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2902.624521 secs 2023-05-08T04:32:44.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:32:43 smithi186 ceph-mon[126480]: pgmap v1611: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 62 KiB/s wr, 8 op/s 2023-05-08T04:32:44.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:32:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2903.180068 secs 2023-05-08T04:32:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:32:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2904.454904 secs 2023-05-08T04:32:46.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:32:45 smithi133 ceph-mon[125939]: pgmap v1612: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 62 KiB/s wr, 10 op/s 2023-05-08T04:32:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:32:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2904.454904 secs 2023-05-08T04:32:46.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:32:45 smithi096 ceph-mon[124666]: pgmap v1612: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 62 KiB/s wr, 10 op/s 2023-05-08T04:32:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:32:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2904.454904 secs 2023-05-08T04:32:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:32:45 smithi186 ceph-mon[126480]: pgmap v1612: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 62 KiB/s wr, 10 op/s 2023-05-08T04:32:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:32:47 smithi186 ceph-mon[126480]: pgmap v1613: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T04:32:47.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:32:47 smithi133 ceph-mon[125939]: pgmap v1613: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T04:32:47.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:32:47 smithi096 ceph-mon[124666]: pgmap v1613: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T04:32:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:32:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2907.624648 secs 2023-05-08T04:32:49.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:32:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2908.180168 secs 2023-05-08T04:32:49.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:32:49 smithi133 ceph-mon[125939]: pgmap v1614: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T04:32:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:32:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2907.624648 secs 2023-05-08T04:32:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:32:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2908.180168 secs 2023-05-08T04:32:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:32:49 smithi096 ceph-mon[124666]: pgmap v1614: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T04:32:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:32:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2907.624648 secs 2023-05-08T04:32:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:32:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2908.180168 secs 2023-05-08T04:32:49.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:32:49 smithi186 ceph-mon[126480]: pgmap v1614: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T04:32:50.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:32:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2909.455021 secs 2023-05-08T04:32:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:32:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2909.455021 secs 2023-05-08T04:32:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:32:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2909.455021 secs 2023-05-08T04:32:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:32:51 smithi096 ceph-mon[124666]: pgmap v1615: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 42 KiB/s wr, 9 op/s 2023-05-08T04:32:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:32:51 smithi186 ceph-mon[126480]: pgmap v1615: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 42 KiB/s wr, 9 op/s 2023-05-08T04:32:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:32:51 smithi133 ceph-mon[125939]: pgmap v1615: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 42 KiB/s wr, 9 op/s 2023-05-08T04:32:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:32:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2912.624759 secs 2023-05-08T04:32:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:32:53 smithi133 ceph-mon[125939]: pgmap v1616: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.6 KiB/s wr, 5 op/s 2023-05-08T04:32:54.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:32:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2913.180296 secs 2023-05-08T04:32:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:32:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2912.624759 secs 2023-05-08T04:32:54.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:32:53 smithi096 ceph-mon[124666]: pgmap v1616: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.6 KiB/s wr, 5 op/s 2023-05-08T04:32:54.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:32:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2913.180296 secs 2023-05-08T04:32:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:32:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2912.624759 secs 2023-05-08T04:32:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:32:53 smithi186 ceph-mon[126480]: pgmap v1616: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.6 KiB/s wr, 5 op/s 2023-05-08T04:32:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:32:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2913.180296 secs 2023-05-08T04:32:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:32:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2914.455133 secs 2023-05-08T04:32:56.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:32:55 smithi133 ceph-mon[125939]: pgmap v1617: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.6 KiB/s wr, 7 op/s 2023-05-08T04:32:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:32:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2914.455133 secs 2023-05-08T04:32:56.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:32:55 smithi096 ceph-mon[124666]: pgmap v1617: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.6 KiB/s wr, 7 op/s 2023-05-08T04:32:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:32:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2914.455133 secs 2023-05-08T04:32:56.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:32:55 smithi186 ceph-mon[126480]: pgmap v1617: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.6 KiB/s wr, 7 op/s 2023-05-08T04:32:57.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:32:56 smithi133 ceph-mon[125939]: pgmap v1618: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.5 KiB/s wr, 5 op/s 2023-05-08T04:32:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:32:56 smithi096 ceph-mon[124666]: pgmap v1618: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.5 KiB/s wr, 5 op/s 2023-05-08T04:32:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:32:56 smithi186 ceph-mon[126480]: pgmap v1618: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.5 KiB/s wr, 5 op/s 2023-05-08T04:32:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:32:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2917.624874 secs 2023-05-08T04:32:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:32:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2918.180420 secs 2023-05-08T04:32:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:32:59 smithi096 ceph-mon[124666]: pgmap v1619: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.5 KiB/s wr, 5 op/s 2023-05-08T04:32:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:32:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2917.624874 secs 2023-05-08T04:32:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:32:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2918.180420 secs 2023-05-08T04:32:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:32:59 smithi186 ceph-mon[126480]: pgmap v1619: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.5 KiB/s wr, 5 op/s 2023-05-08T04:32:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:32:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2917.624874 secs 2023-05-08T04:32:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:32:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2918.180420 secs 2023-05-08T04:32:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:32:59 smithi133 ceph-mon[125939]: pgmap v1619: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.5 KiB/s wr, 5 op/s 2023-05-08T04:33:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2919.455220 secs 2023-05-08T04:33:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2919.455220 secs 2023-05-08T04:33:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2919.455220 secs 2023-05-08T04:33:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:01 smithi096 ceph-mon[124666]: pgmap v1620: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.5 KiB/s wr, 7 op/s 2023-05-08T04:33:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:01 smithi186 ceph-mon[126480]: pgmap v1620: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.5 KiB/s wr, 7 op/s 2023-05-08T04:33:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:01 smithi133 ceph-mon[125939]: pgmap v1620: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.5 KiB/s wr, 7 op/s 2023-05-08T04:33:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2922.624933 secs 2023-05-08T04:33:04.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:03 smithi133 ceph-mon[125939]: pgmap v1621: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:33:04.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2923.180541 secs 2023-05-08T04:33:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2922.624933 secs 2023-05-08T04:33:04.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:03 smithi096 ceph-mon[124666]: pgmap v1621: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:33:04.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2923.180541 secs 2023-05-08T04:33:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2922.624933 secs 2023-05-08T04:33:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:03 smithi186 ceph-mon[126480]: pgmap v1621: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:33:04.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2923.180541 secs 2023-05-08T04:33:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:05 smithi186 ceph-mon[126480]: pgmap v1622: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:33:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:05 smithi133 ceph-mon[125939]: pgmap v1622: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:33:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:05 smithi096 ceph-mon[124666]: pgmap v1622: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:33:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2924.455340 secs 2023-05-08T04:33:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2924.455340 secs 2023-05-08T04:33:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2924.455340 secs 2023-05-08T04:33:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:07 smithi186 ceph-mon[126480]: pgmap v1623: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:33:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:07 smithi133 ceph-mon[125939]: pgmap v1623: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:33:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:07 smithi096 ceph-mon[124666]: pgmap v1623: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:33:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2927.625052 secs 2023-05-08T04:33:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2928.180674 secs 2023-05-08T04:33:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:09 smithi096 ceph-mon[124666]: pgmap v1624: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:33:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2927.625052 secs 2023-05-08T04:33:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2928.180674 secs 2023-05-08T04:33:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:09 smithi186 ceph-mon[126480]: pgmap v1624: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:33:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2927.625052 secs 2023-05-08T04:33:09.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2928.180674 secs 2023-05-08T04:33:09.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:09 smithi133 ceph-mon[125939]: pgmap v1624: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:33:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2929.455476 secs 2023-05-08T04:33:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2929.455476 secs 2023-05-08T04:33:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2929.455476 secs 2023-05-08T04:33:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:11 smithi186 ceph-mon[126480]: osdmap e182: 12 total, 12 up, 12 in 2023-05-08T04:33:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:11 smithi186 ceph-mon[126480]: pgmap v1626: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:33:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:11 smithi133 ceph-mon[125939]: osdmap e182: 12 total, 12 up, 12 in 2023-05-08T04:33:11.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:11 smithi133 ceph-mon[125939]: pgmap v1626: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:33:11.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:11 smithi096 ceph-mon[124666]: osdmap e182: 12 total, 12 up, 12 in 2023-05-08T04:33:11.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:11 smithi096 ceph-mon[124666]: pgmap v1626: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:33:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2932.625144 secs 2023-05-08T04:33:14.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:13 smithi133 ceph-mon[125939]: pgmap v1627: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:33:14.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2933.180797 secs 2023-05-08T04:33:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2932.625144 secs 2023-05-08T04:33:14.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:13 smithi096 ceph-mon[124666]: pgmap v1627: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:33:14.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2933.180797 secs 2023-05-08T04:33:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2932.625144 secs 2023-05-08T04:33:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:13 smithi186 ceph-mon[126480]: pgmap v1627: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:33:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2933.180797 secs 2023-05-08T04:33:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:14 smithi133 ceph-mon[125939]: pgmap v1628: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:33:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:14 smithi096 ceph-mon[124666]: pgmap v1628: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:33:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:14 smithi186 ceph-mon[126480]: pgmap v1628: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:33:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2934.455601 secs 2023-05-08T04:33:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2934.455601 secs 2023-05-08T04:33:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2934.455601 secs 2023-05-08T04:33:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:16 smithi133 ceph-mon[125939]: pgmap v1629: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:33:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:16 smithi096 ceph-mon[124666]: pgmap v1629: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:33:17.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:16 smithi186 ceph-mon[126480]: pgmap v1629: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:33:19.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2937.625262 secs 2023-05-08T04:33:19.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:19 smithi096 ceph-mon[124666]: osdmap e183: 12 total, 12 up, 12 in 2023-05-08T04:33:19.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2938.180923 secs 2023-05-08T04:33:19.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:19 smithi096 ceph-mon[124666]: pgmap v1631: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 118 B/s wr, 4 op/s 2023-05-08T04:33:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2937.625262 secs 2023-05-08T04:33:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:19 smithi186 ceph-mon[126480]: osdmap e183: 12 total, 12 up, 12 in 2023-05-08T04:33:19.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2938.180923 secs 2023-05-08T04:33:19.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:19 smithi186 ceph-mon[126480]: pgmap v1631: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 118 B/s wr, 4 op/s 2023-05-08T04:33:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2937.625262 secs 2023-05-08T04:33:19.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:19 smithi133 ceph-mon[125939]: osdmap e183: 12 total, 12 up, 12 in 2023-05-08T04:33:19.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2938.180923 secs 2023-05-08T04:33:19.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:19 smithi133 ceph-mon[125939]: pgmap v1631: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 118 B/s wr, 4 op/s 2023-05-08T04:33:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2939.455710 secs 2023-05-08T04:33:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2939.455710 secs 2023-05-08T04:33:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2939.455710 secs 2023-05-08T04:33:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:21 smithi186 ceph-mon[126480]: pgmap v1632: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:33:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:21 smithi133 ceph-mon[125939]: pgmap v1632: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:33:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:21 smithi096 ceph-mon[124666]: pgmap v1632: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:33:22.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:22 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:33:22.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:22 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:33:22.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:22 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:33:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:23 smithi186 ceph-mon[126480]: pgmap v1633: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:33:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:23 smithi133 ceph-mon[125939]: pgmap v1633: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:33:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:23 smithi096 ceph-mon[124666]: pgmap v1633: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:33:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2942.625374 secs 2023-05-08T04:33:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2943.180989 secs 2023-05-08T04:33:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:33:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:33:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2942.625374 secs 2023-05-08T04:33:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2943.180989 secs 2023-05-08T04:33:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:33:24.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:33:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2942.625374 secs 2023-05-08T04:33:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2943.180989 secs 2023-05-08T04:33:24.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:33:24.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:33:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:25 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:33:25.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:25 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:33:25.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:25 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:33:25.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:25 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:33:25.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2944.455836 secs 2023-05-08T04:33:25.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:25 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:33:25.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:25 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:33:25.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:25 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:33:25.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:25 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:33:25.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:25 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi096 to 196.2M 2023-05-08T04:33:25.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:25 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi096 to 205766758: error parsing value: Value '205766758' is below minimum 939524096 2023-05-08T04:33:25.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:25 smithi133 ceph-mon[125939]: pgmap v1634: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:33:25.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:25 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:33:25.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:25 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:33:25.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:25 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:33:25.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:25 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:33:25.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:25 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:33:25.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:25 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:33:25.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:25 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:33:25.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:25 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:33:25.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:25 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:33:25.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:25 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:33:25.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:25 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:33:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:25 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:33:25.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:25 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:33:25.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:25 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:33:25.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:25 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:33:25.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2944.455836 secs 2023-05-08T04:33:25.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:25 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:33:25.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:25 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:33:25.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:25 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:33:25.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:25 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:33:25.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:25 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi096 to 196.2M 2023-05-08T04:33:25.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:25 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi096 to 205766758: error parsing value: Value '205766758' is below minimum 939524096 2023-05-08T04:33:25.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:25 smithi096 ceph-mon[124666]: pgmap v1634: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:33:25.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:25 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:33:25.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:25 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:33:25.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:25 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:33:25.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:25 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:33:25.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:25 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:33:25.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:25 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:33:25.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:25 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:33:25.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:25 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:33:25.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:25 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:33:25.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:25 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:33:25.759 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:25 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:33:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:25 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:33:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:25 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:33:25.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:25 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:33:25.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:25 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:33:25.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2944.455836 secs 2023-05-08T04:33:25.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:25 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:33:25.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:25 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:33:25.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:25 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:33:25.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:25 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:33:25.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:25 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi096 to 196.2M 2023-05-08T04:33:25.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:25 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi096 to 205766758: error parsing value: Value '205766758' is below minimum 939524096 2023-05-08T04:33:25.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:25 smithi186 ceph-mon[126480]: pgmap v1634: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:33:25.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:25 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:33:25.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:25 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:33:25.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:25 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:33:25.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:25 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:33:25.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:25 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:33:25.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:25 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:33:25.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:25 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:33:25.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:25 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:33:25.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:25 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:33:25.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:25 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:33:25.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:25 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:33:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:26 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T04:33:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:26 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T04:33:26.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:26 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T04:33:26.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:26 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T04:33:26.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:26 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:33:26.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:26 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T04:33:26.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:26 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T04:33:26.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:26 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:33:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:26 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T04:33:26.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:26 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T04:33:26.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:26 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T04:33:26.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:26 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T04:33:26.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:26 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:33:26.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:26 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T04:33:26.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:26 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T04:33:26.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:26 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:33:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:26 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T04:33:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:26 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T04:33:26.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:26 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T04:33:26.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:26 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T04:33:26.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:26 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:33:26.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:26 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T04:33:26.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:26 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T04:33:26.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:26 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:33:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:27 smithi133 ceph-mon[125939]: pgmap v1635: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:33:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:27 smithi096 ceph-mon[124666]: pgmap v1635: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:33:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:27 smithi186 ceph-mon[126480]: pgmap v1635: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:33:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2947.625445 secs 2023-05-08T04:33:29.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2948.181111 secs 2023-05-08T04:33:29.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:29 smithi096 ceph-mon[124666]: pgmap v1636: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2023-05-08T04:33:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2947.625445 secs 2023-05-08T04:33:29.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2948.181111 secs 2023-05-08T04:33:29.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:29 smithi186 ceph-mon[126480]: pgmap v1636: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2023-05-08T04:33:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2947.625445 secs 2023-05-08T04:33:29.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2948.181111 secs 2023-05-08T04:33:29.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:29 smithi133 ceph-mon[125939]: pgmap v1636: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2023-05-08T04:33:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2949.455951 secs 2023-05-08T04:33:30.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2949.455951 secs 2023-05-08T04:33:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2949.455951 secs 2023-05-08T04:33:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:31 smithi186 ceph-mon[126480]: pgmap v1637: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 35 KiB/s wr, 8 op/s 2023-05-08T04:33:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:31 smithi133 ceph-mon[125939]: pgmap v1637: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 35 KiB/s wr, 8 op/s 2023-05-08T04:33:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:31 smithi096 ceph-mon[124666]: pgmap v1637: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 35 KiB/s wr, 8 op/s 2023-05-08T04:33:33.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:33 smithi186 ceph-mon[126480]: pgmap v1638: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 35 KiB/s wr, 5 op/s 2023-05-08T04:33:33.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:33 smithi133 ceph-mon[125939]: pgmap v1638: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 35 KiB/s wr, 5 op/s 2023-05-08T04:33:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:33 smithi096 ceph-mon[124666]: pgmap v1638: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 35 KiB/s wr, 5 op/s 2023-05-08T04:33:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2952.625556 secs 2023-05-08T04:33:34.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2953.181260 secs 2023-05-08T04:33:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2952.625556 secs 2023-05-08T04:33:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2953.181260 secs 2023-05-08T04:33:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2952.625556 secs 2023-05-08T04:33:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2953.181260 secs 2023-05-08T04:33:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2954.456020 secs 2023-05-08T04:33:35.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:35 smithi096 ceph-mon[124666]: pgmap v1639: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 101 KiB/s wr, 10 op/s 2023-05-08T04:33:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2954.456020 secs 2023-05-08T04:33:35.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:35 smithi186 ceph-mon[126480]: pgmap v1639: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 101 KiB/s wr, 10 op/s 2023-05-08T04:33:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2954.456020 secs 2023-05-08T04:33:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:35 smithi133 ceph-mon[125939]: pgmap v1639: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 101 KiB/s wr, 10 op/s 2023-05-08T04:33:37.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:37 smithi186 ceph-mon[126480]: pgmap v1640: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 102 KiB/s wr, 8 op/s 2023-05-08T04:33:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:37 smithi133 ceph-mon[125939]: pgmap v1640: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 102 KiB/s wr, 8 op/s 2023-05-08T04:33:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:37 smithi096 ceph-mon[124666]: pgmap v1640: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 102 KiB/s wr, 8 op/s 2023-05-08T04:33:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2957.625691 secs 2023-05-08T04:33:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2958.181380 secs 2023-05-08T04:33:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:39 smithi096 ceph-mon[124666]: pgmap v1641: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 102 KiB/s wr, 8 op/s 2023-05-08T04:33:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2957.625691 secs 2023-05-08T04:33:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2958.181380 secs 2023-05-08T04:33:39.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:39 smithi186 ceph-mon[126480]: pgmap v1641: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 102 KiB/s wr, 8 op/s 2023-05-08T04:33:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2957.625691 secs 2023-05-08T04:33:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2958.181380 secs 2023-05-08T04:33:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:39 smithi133 ceph-mon[125939]: pgmap v1641: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 102 KiB/s wr, 8 op/s 2023-05-08T04:33:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2959.456147 secs 2023-05-08T04:33:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2959.456147 secs 2023-05-08T04:33:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2959.456147 secs 2023-05-08T04:33:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:41 smithi186 ceph-mon[126480]: pgmap v1642: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 134 KiB/s wr, 13 op/s 2023-05-08T04:33:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:41 smithi133 ceph-mon[125939]: pgmap v1642: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 134 KiB/s wr, 13 op/s 2023-05-08T04:33:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:41 smithi096 ceph-mon[124666]: pgmap v1642: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 134 KiB/s wr, 13 op/s 2023-05-08T04:33:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:43 smithi186 ceph-mon[126480]: pgmap v1643: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 100 KiB/s wr, 10 op/s 2023-05-08T04:33:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:43 smithi133 ceph-mon[125939]: pgmap v1643: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 100 KiB/s wr, 10 op/s 2023-05-08T04:33:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:43 smithi096 ceph-mon[124666]: pgmap v1643: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 100 KiB/s wr, 10 op/s 2023-05-08T04:33:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2962.625808 secs 2023-05-08T04:33:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2963.181527 secs 2023-05-08T04:33:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2962.625808 secs 2023-05-08T04:33:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2963.181527 secs 2023-05-08T04:33:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2962.625808 secs 2023-05-08T04:33:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2963.181527 secs 2023-05-08T04:33:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2964.456266 secs 2023-05-08T04:33:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:45 smithi186 ceph-mon[126480]: pgmap v1644: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 100 KiB/s wr, 13 op/s 2023-05-08T04:33:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2964.456266 secs 2023-05-08T04:33:45.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:45 smithi133 ceph-mon[125939]: pgmap v1644: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 100 KiB/s wr, 13 op/s 2023-05-08T04:33:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2964.456266 secs 2023-05-08T04:33:45.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:45 smithi096 ceph-mon[124666]: pgmap v1644: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 100 KiB/s wr, 13 op/s 2023-05-08T04:33:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:47 smithi186 ceph-mon[126480]: pgmap v1645: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 33 KiB/s wr, 8 op/s 2023-05-08T04:33:47.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:47 smithi133 ceph-mon[125939]: pgmap v1645: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 33 KiB/s wr, 8 op/s 2023-05-08T04:33:47.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:47 smithi096 ceph-mon[124666]: pgmap v1645: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 33 KiB/s wr, 8 op/s 2023-05-08T04:33:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2967.625924 secs 2023-05-08T04:33:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2968.181650 secs 2023-05-08T04:33:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:49 smithi186 ceph-mon[126480]: pgmap v1646: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 33 KiB/s wr, 8 op/s 2023-05-08T04:33:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2967.625924 secs 2023-05-08T04:33:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2968.181650 secs 2023-05-08T04:33:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:49 smithi133 ceph-mon[125939]: pgmap v1646: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 33 KiB/s wr, 8 op/s 2023-05-08T04:33:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2967.625924 secs 2023-05-08T04:33:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2968.181650 secs 2023-05-08T04:33:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:49 smithi096 ceph-mon[124666]: pgmap v1646: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 33 KiB/s wr, 8 op/s 2023-05-08T04:33:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2969.456382 secs 2023-05-08T04:33:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2969.456382 secs 2023-05-08T04:33:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2969.456382 secs 2023-05-08T04:33:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:51 smithi186 ceph-mon[126480]: pgmap v1647: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 42 KiB/s wr, 11 op/s 2023-05-08T04:33:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:51 smithi133 ceph-mon[125939]: pgmap v1647: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 42 KiB/s wr, 11 op/s 2023-05-08T04:33:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:51 smithi096 ceph-mon[124666]: pgmap v1647: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 42 KiB/s wr, 11 op/s 2023-05-08T04:33:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:53 smithi186 ceph-mon[126480]: pgmap v1648: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 8.8 KiB/s wr, 6 op/s 2023-05-08T04:33:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:53 smithi133 ceph-mon[125939]: pgmap v1648: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 8.8 KiB/s wr, 6 op/s 2023-05-08T04:33:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:53 smithi096 ceph-mon[124666]: pgmap v1648: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 8.8 KiB/s wr, 6 op/s 2023-05-08T04:33:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2972.626062 secs 2023-05-08T04:33:54.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2973.181769 secs 2023-05-08T04:33:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2972.626062 secs 2023-05-08T04:33:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2973.181769 secs 2023-05-08T04:33:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2972.626062 secs 2023-05-08T04:33:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2973.181769 secs 2023-05-08T04:33:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2974.456519 secs 2023-05-08T04:33:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:55 smithi186 ceph-mon[126480]: pgmap v1649: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 8.8 KiB/s wr, 8 op/s 2023-05-08T04:33:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2974.456519 secs 2023-05-08T04:33:55.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:55 smithi133 ceph-mon[125939]: pgmap v1649: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 8.8 KiB/s wr, 8 op/s 2023-05-08T04:33:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2974.456519 secs 2023-05-08T04:33:55.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:55 smithi096 ceph-mon[124666]: pgmap v1649: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 8.8 KiB/s wr, 8 op/s 2023-05-08T04:33:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:57 smithi186 ceph-mon[126480]: pgmap v1650: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.7 KiB/s wr, 5 op/s 2023-05-08T04:33:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:57 smithi133 ceph-mon[125939]: pgmap v1650: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.7 KiB/s wr, 5 op/s 2023-05-08T04:33:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:57 smithi096 ceph-mon[124666]: pgmap v1650: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.7 KiB/s wr, 5 op/s 2023-05-08T04:33:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2977.626182 secs 2023-05-08T04:33:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2978.181911 secs 2023-05-08T04:33:59.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:33:59 smithi186 ceph-mon[126480]: pgmap v1651: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.7 KiB/s wr, 5 op/s 2023-05-08T04:33:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2977.626182 secs 2023-05-08T04:33:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2978.181911 secs 2023-05-08T04:33:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:33:59 smithi133 ceph-mon[125939]: pgmap v1651: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.7 KiB/s wr, 5 op/s 2023-05-08T04:33:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2977.626182 secs 2023-05-08T04:33:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2978.181911 secs 2023-05-08T04:33:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:33:59 smithi096 ceph-mon[124666]: pgmap v1651: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.7 KiB/s wr, 5 op/s 2023-05-08T04:34:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:34:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2979.456637 secs 2023-05-08T04:34:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:34:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2979.456637 secs 2023-05-08T04:34:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:34:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2979.456637 secs 2023-05-08T04:34:01.554 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:34:01 smithi096 ceph-mon[124666]: pgmap v1652: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.7 KiB/s wr, 7 op/s 2023-05-08T04:34:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:34:01 smithi186 ceph-mon[126480]: pgmap v1652: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.7 KiB/s wr, 7 op/s 2023-05-08T04:34:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:34:01 smithi133 ceph-mon[125939]: pgmap v1652: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.7 KiB/s wr, 7 op/s 2023-05-08T04:34:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:34:03 smithi186 ceph-mon[126480]: pgmap v1653: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:34:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:34:03 smithi133 ceph-mon[125939]: pgmap v1653: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:34:03.509 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:34:03 smithi096 ceph-mon[124666]: pgmap v1653: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:34:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:34:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2982.626250 secs 2023-05-08T04:34:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:34:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2983.182032 secs 2023-05-08T04:34:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:34:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2982.626250 secs 2023-05-08T04:34:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:34:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2983.182032 secs 2023-05-08T04:34:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:34:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2982.626250 secs 2023-05-08T04:34:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:34:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2983.182032 secs 2023-05-08T04:34:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:34:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2984.456801 secs 2023-05-08T04:34:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:34:05 smithi186 ceph-mon[126480]: pgmap v1654: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:34:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:34:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2984.456801 secs 2023-05-08T04:34:05.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:34:05 smithi133 ceph-mon[125939]: pgmap v1654: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:34:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:34:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2984.456801 secs 2023-05-08T04:34:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:34:05 smithi096 ceph-mon[124666]: pgmap v1654: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:34:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:34:07 smithi186 ceph-mon[126480]: pgmap v1655: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:34:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:34:07 smithi133 ceph-mon[125939]: pgmap v1655: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:34:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:34:07 smithi096 ceph-mon[124666]: pgmap v1655: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:34:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:34:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2987.626368 secs 2023-05-08T04:34:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:34:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2988.182153 secs 2023-05-08T04:34:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:34:09 smithi096 ceph-mon[124666]: pgmap v1656: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:34:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:34:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2987.626368 secs 2023-05-08T04:34:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:34:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2988.182153 secs 2023-05-08T04:34:09.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:34:09 smithi186 ceph-mon[126480]: pgmap v1656: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:34:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:34:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2987.626368 secs 2023-05-08T04:34:09.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:34:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2988.182153 secs 2023-05-08T04:34:09.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:34:09 smithi133 ceph-mon[125939]: pgmap v1656: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:34:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:34:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2989.456871 secs 2023-05-08T04:34:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:34:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2989.456871 secs 2023-05-08T04:34:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:34:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2989.456871 secs 2023-05-08T04:34:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:34:11 smithi186 ceph-mon[126480]: osdmap e184: 12 total, 12 up, 12 in 2023-05-08T04:34:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:34:11 smithi186 ceph-mon[126480]: pgmap v1658: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:34:11.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:34:11 smithi133 ceph-mon[125939]: osdmap e184: 12 total, 12 up, 12 in 2023-05-08T04:34:11.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:34:11 smithi133 ceph-mon[125939]: pgmap v1658: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:34:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:34:11 smithi096 ceph-mon[124666]: osdmap e184: 12 total, 12 up, 12 in 2023-05-08T04:34:11.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:34:11 smithi096 ceph-mon[124666]: pgmap v1658: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:34:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:34:13 smithi186 ceph-mon[126480]: pgmap v1659: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:34:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:34:13 smithi133 ceph-mon[125939]: pgmap v1659: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:34:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:34:13 smithi096 ceph-mon[124666]: pgmap v1659: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:34:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:34:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2992.626481 secs 2023-05-08T04:34:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:34:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2993.182275 secs 2023-05-08T04:34:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:34:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2992.626481 secs 2023-05-08T04:34:14.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:34:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2993.182275 secs 2023-05-08T04:34:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:34:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2992.626481 secs 2023-05-08T04:34:14.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:34:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2993.182275 secs 2023-05-08T04:34:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:34:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2994.456991 secs 2023-05-08T04:34:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:34:15 smithi186 ceph-mon[126480]: pgmap v1660: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:34:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:34:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2994.456991 secs 2023-05-08T04:34:15.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:34:15 smithi133 ceph-mon[125939]: pgmap v1660: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:34:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:34:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2994.456991 secs 2023-05-08T04:34:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:34:15 smithi096 ceph-mon[124666]: pgmap v1660: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:34:17.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:34:17 smithi186 ceph-mon[126480]: pgmap v1661: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:34:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:34:17 smithi133 ceph-mon[125939]: pgmap v1661: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:34:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:34:17 smithi096 ceph-mon[124666]: pgmap v1661: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:34:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:34:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2997.626553 secs 2023-05-08T04:34:19.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:34:19 smithi186 ceph-mon[126480]: osdmap e185: 12 total, 12 up, 12 in 2023-05-08T04:34:19.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:34:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2998.182348 secs 2023-05-08T04:34:19.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:34:19 smithi186 ceph-mon[126480]: pgmap v1663: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 118 B/s wr, 4 op/s 2023-05-08T04:34:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:34:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2997.626553 secs 2023-05-08T04:34:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:34:19 smithi133 ceph-mon[125939]: osdmap e185: 12 total, 12 up, 12 in 2023-05-08T04:34:19.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:34:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2998.182348 secs 2023-05-08T04:34:19.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:34:19 smithi133 ceph-mon[125939]: pgmap v1663: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 118 B/s wr, 4 op/s 2023-05-08T04:34:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:34:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2997.626553 secs 2023-05-08T04:34:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:34:19 smithi096 ceph-mon[124666]: osdmap e185: 12 total, 12 up, 12 in 2023-05-08T04:34:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:34:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2998.182348 secs 2023-05-08T04:34:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:34:19 smithi096 ceph-mon[124666]: pgmap v1663: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 118 B/s wr, 4 op/s 2023-05-08T04:34:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:34:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 2999.457101 secs 2023-05-08T04:34:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:34:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 2999.457101 secs 2023-05-08T04:34:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:34:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 2999.457101 secs 2023-05-08T04:34:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:34:21 smithi186 ceph-mon[126480]: pgmap v1664: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:34:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:34:21 smithi133 ceph-mon[125939]: pgmap v1664: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:34:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:34:21 smithi096 ceph-mon[124666]: pgmap v1664: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:34:23.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:34:23 smithi186 ceph-mon[126480]: pgmap v1665: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:34:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:34:23 smithi133 ceph-mon[125939]: pgmap v1665: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:34:23.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:34:23 smithi096 ceph-mon[124666]: pgmap v1665: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:34:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:34:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3002.626666 secs 2023-05-08T04:34:24.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:34:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3003.182504 secs 2023-05-08T04:34:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:34:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3002.626666 secs 2023-05-08T04:34:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:34:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3003.182504 secs 2023-05-08T04:34:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:34:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3002.626666 secs 2023-05-08T04:34:24.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:34:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3003.182504 secs 2023-05-08T04:34:25.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:34:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3004.457225 secs 2023-05-08T04:34:25.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:34:25 smithi096 ceph-mon[124666]: pgmap v1666: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:34:25.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:34:25 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:34:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:34:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3004.457225 secs 2023-05-08T04:34:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:34:25 smithi186 ceph-mon[126480]: pgmap v1666: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:34:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:34:25 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:34:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:34:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3004.457225 secs 2023-05-08T04:34:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:34:25 smithi133 ceph-mon[125939]: pgmap v1666: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:34:25.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:34:25 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:34:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:34:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:34:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:34:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:34:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:34:26 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:34:26.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:34:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:34:26.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:34:26 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T04:34:26.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:34:26 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T04:34:26.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:34:26 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:34:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:34:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:34:26.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:34:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:34:26.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:34:26 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:34:26.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:34:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:34:26.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:34:26 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T04:34:26.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:34:26 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T04:34:26.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:34:26 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:34:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:34:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:34:26.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:34:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:34:26.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:34:26 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:34:26.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:34:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:34:26.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:34:26 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T04:34:26.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:34:26 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T04:34:26.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:34:26 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:34:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:34:27 smithi186 ceph-mon[126480]: pgmap v1667: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:34:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:34:27 smithi133 ceph-mon[125939]: pgmap v1667: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:34:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:34:27 smithi096 ceph-mon[124666]: pgmap v1667: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:34:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:34:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3007.626787 secs 2023-05-08T04:34:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:34:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3008.182597 secs 2023-05-08T04:34:29.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:34:29 smithi186 ceph-mon[126480]: pgmap v1668: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2023-05-08T04:34:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:34:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3007.626787 secs 2023-05-08T04:34:29.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:34:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3008.182597 secs 2023-05-08T04:34:29.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:34:29 smithi133 ceph-mon[125939]: pgmap v1668: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2023-05-08T04:34:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:34:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3007.626787 secs 2023-05-08T04:34:29.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:34:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3008.182597 secs 2023-05-08T04:34:29.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:34:29 smithi096 ceph-mon[124666]: pgmap v1668: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2023-05-08T04:34:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:34:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3009.457366 secs 2023-05-08T04:34:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:34:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3009.457366 secs 2023-05-08T04:34:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:34:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3009.457366 secs 2023-05-08T04:34:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:34:31 smithi186 ceph-mon[126480]: pgmap v1669: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 170 B/s wr, 7 op/s 2023-05-08T04:34:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:34:31 smithi133 ceph-mon[125939]: pgmap v1669: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 170 B/s wr, 7 op/s 2023-05-08T04:34:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:34:31 smithi096 ceph-mon[124666]: pgmap v1669: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 170 B/s wr, 7 op/s 2023-05-08T04:34:33.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:34:33 smithi186 ceph-mon[126480]: pgmap v1670: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T04:34:33.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:34:33 smithi133 ceph-mon[125939]: pgmap v1670: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T04:34:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:34:33 smithi096 ceph-mon[124666]: pgmap v1670: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T04:34:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:34:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3012.626906 secs 2023-05-08T04:34:34.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:34:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3013.182682 secs 2023-05-08T04:34:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:34:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3012.626906 secs 2023-05-08T04:34:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:34:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3013.182682 secs 2023-05-08T04:34:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:34:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3012.626906 secs 2023-05-08T04:34:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:34:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3013.182682 secs 2023-05-08T04:34:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:34:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3014.457512 secs 2023-05-08T04:34:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:34:35 smithi186 ceph-mon[126480]: pgmap v1671: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 66 KiB/s wr, 9 op/s 2023-05-08T04:34:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:34:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3014.457512 secs 2023-05-08T04:34:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:34:35 smithi133 ceph-mon[125939]: pgmap v1671: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 66 KiB/s wr, 9 op/s 2023-05-08T04:34:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:34:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3014.457512 secs 2023-05-08T04:34:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:34:35 smithi096 ceph-mon[124666]: pgmap v1671: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 66 KiB/s wr, 9 op/s 2023-05-08T04:34:37.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:34:37 smithi186 ceph-mon[126480]: pgmap v1672: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 66 KiB/s wr, 6 op/s 2023-05-08T04:34:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:34:37 smithi133 ceph-mon[125939]: pgmap v1672: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 66 KiB/s wr, 6 op/s 2023-05-08T04:34:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:34:37 smithi096 ceph-mon[124666]: pgmap v1672: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 66 KiB/s wr, 6 op/s 2023-05-08T04:34:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:34:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3017.627021 secs 2023-05-08T04:34:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:34:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3018.182808 secs 2023-05-08T04:34:39.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:34:39 smithi186 ceph-mon[126480]: pgmap v1673: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 66 KiB/s wr, 6 op/s 2023-05-08T04:34:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:34:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3017.627021 secs 2023-05-08T04:34:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:34:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3018.182808 secs 2023-05-08T04:34:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:34:39 smithi133 ceph-mon[125939]: pgmap v1673: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 66 KiB/s wr, 6 op/s 2023-05-08T04:34:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:34:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3017.627021 secs 2023-05-08T04:34:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:34:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3018.182808 secs 2023-05-08T04:34:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:34:39 smithi096 ceph-mon[124666]: pgmap v1673: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 66 KiB/s wr, 6 op/s 2023-05-08T04:34:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:34:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3019.457608 secs 2023-05-08T04:34:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:34:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3019.457608 secs 2023-05-08T04:34:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:34:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3019.457608 secs 2023-05-08T04:34:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:34:41 smithi186 ceph-mon[126480]: pgmap v1674: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 97 KiB/s wr, 11 op/s 2023-05-08T04:34:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:34:41 smithi133 ceph-mon[125939]: pgmap v1674: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 97 KiB/s wr, 11 op/s 2023-05-08T04:34:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:34:41 smithi096 ceph-mon[124666]: pgmap v1674: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 97 KiB/s wr, 11 op/s 2023-05-08T04:34:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:34:43 smithi186 ceph-mon[126480]: pgmap v1675: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 97 KiB/s wr, 8 op/s 2023-05-08T04:34:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:34:43 smithi133 ceph-mon[125939]: pgmap v1675: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 97 KiB/s wr, 8 op/s 2023-05-08T04:34:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:34:43 smithi096 ceph-mon[124666]: pgmap v1675: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 97 KiB/s wr, 8 op/s 2023-05-08T04:34:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:34:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3022.627156 secs 2023-05-08T04:34:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:34:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3023.182926 secs 2023-05-08T04:34:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:34:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3022.627156 secs 2023-05-08T04:34:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:34:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3023.182926 secs 2023-05-08T04:34:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:34:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3022.627156 secs 2023-05-08T04:34:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:34:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3023.182926 secs 2023-05-08T04:34:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:34:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3024.457749 secs 2023-05-08T04:34:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:34:45 smithi186 ceph-mon[126480]: pgmap v1676: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 97 KiB/s wr, 11 op/s 2023-05-08T04:34:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:34:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3024.457749 secs 2023-05-08T04:34:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:34:45 smithi133 ceph-mon[125939]: pgmap v1676: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 97 KiB/s wr, 11 op/s 2023-05-08T04:34:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:34:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3024.457749 secs 2023-05-08T04:34:45.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:34:45 smithi096 ceph-mon[124666]: pgmap v1676: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 97 KiB/s wr, 11 op/s 2023-05-08T04:34:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:34:47 smithi186 ceph-mon[126480]: pgmap v1677: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 6 op/s 2023-05-08T04:34:47.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:34:47 smithi133 ceph-mon[125939]: pgmap v1677: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 6 op/s 2023-05-08T04:34:47.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:34:47 smithi096 ceph-mon[124666]: pgmap v1677: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 6 op/s 2023-05-08T04:34:49.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:34:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3027.627295 secs 2023-05-08T04:34:49.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:34:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3028.183023 secs 2023-05-08T04:34:49.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:34:49 smithi186 ceph-mon[126480]: pgmap v1678: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 6 op/s 2023-05-08T04:34:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:34:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3027.627295 secs 2023-05-08T04:34:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:34:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3028.183023 secs 2023-05-08T04:34:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:34:49 smithi133 ceph-mon[125939]: pgmap v1678: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 6 op/s 2023-05-08T04:34:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:34:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3027.627295 secs 2023-05-08T04:34:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:34:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3028.183023 secs 2023-05-08T04:34:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:34:49 smithi096 ceph-mon[124666]: pgmap v1678: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 6 op/s 2023-05-08T04:34:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:34:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3029.457866 secs 2023-05-08T04:34:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:34:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3029.457866 secs 2023-05-08T04:34:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:34:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3029.457866 secs 2023-05-08T04:34:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:34:51 smithi186 ceph-mon[126480]: pgmap v1679: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 40 KiB/s wr, 9 op/s 2023-05-08T04:34:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:34:51 smithi133 ceph-mon[125939]: pgmap v1679: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 40 KiB/s wr, 9 op/s 2023-05-08T04:34:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:34:51 smithi096 ceph-mon[124666]: pgmap v1679: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 40 KiB/s wr, 9 op/s 2023-05-08T04:34:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:34:53 smithi186 ceph-mon[126480]: pgmap v1680: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.0 KiB/s wr, 5 op/s 2023-05-08T04:34:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:34:53 smithi133 ceph-mon[125939]: pgmap v1680: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.0 KiB/s wr, 5 op/s 2023-05-08T04:34:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:34:53 smithi096 ceph-mon[124666]: pgmap v1680: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.0 KiB/s wr, 5 op/s 2023-05-08T04:34:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:34:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3032.627387 secs 2023-05-08T04:34:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:34:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3033.183105 secs 2023-05-08T04:34:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:34:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3032.627387 secs 2023-05-08T04:34:54.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:34:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3033.183105 secs 2023-05-08T04:34:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:34:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3032.627387 secs 2023-05-08T04:34:54.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:34:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3033.183105 secs 2023-05-08T04:34:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:34:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3034.458003 secs 2023-05-08T04:34:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:34:55 smithi186 ceph-mon[126480]: pgmap v1681: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.0 KiB/s wr, 7 op/s 2023-05-08T04:34:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:34:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3034.458003 secs 2023-05-08T04:34:55.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:34:55 smithi133 ceph-mon[125939]: pgmap v1681: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.0 KiB/s wr, 7 op/s 2023-05-08T04:34:55.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:34:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3034.458003 secs 2023-05-08T04:34:55.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:34:55 smithi096 ceph-mon[124666]: pgmap v1681: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.0 KiB/s wr, 7 op/s 2023-05-08T04:34:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:34:57 smithi186 ceph-mon[126480]: pgmap v1682: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.8 KiB/s wr, 5 op/s 2023-05-08T04:34:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:34:57 smithi133 ceph-mon[125939]: pgmap v1682: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.8 KiB/s wr, 5 op/s 2023-05-08T04:34:57.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:34:57 smithi096 ceph-mon[124666]: pgmap v1682: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.8 KiB/s wr, 5 op/s 2023-05-08T04:34:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:34:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3037.627512 secs 2023-05-08T04:34:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:34:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3038.183198 secs 2023-05-08T04:34:59.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:34:59 smithi186 ceph-mon[126480]: pgmap v1683: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.8 KiB/s wr, 5 op/s 2023-05-08T04:34:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:34:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3037.627512 secs 2023-05-08T04:34:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:34:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3038.183198 secs 2023-05-08T04:34:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:34:59 smithi133 ceph-mon[125939]: pgmap v1683: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.8 KiB/s wr, 5 op/s 2023-05-08T04:34:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:34:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3037.627512 secs 2023-05-08T04:34:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:34:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3038.183198 secs 2023-05-08T04:34:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:34:59 smithi096 ceph-mon[124666]: pgmap v1683: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.8 KiB/s wr, 5 op/s 2023-05-08T04:35:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3039.458143 secs 2023-05-08T04:35:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3039.458143 secs 2023-05-08T04:35:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3039.458143 secs 2023-05-08T04:35:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:01 smithi186 ceph-mon[126480]: pgmap v1684: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.8 KiB/s wr, 7 op/s 2023-05-08T04:35:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:01 smithi133 ceph-mon[125939]: pgmap v1684: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.8 KiB/s wr, 7 op/s 2023-05-08T04:35:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:01 smithi096 ceph-mon[124666]: pgmap v1684: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.8 KiB/s wr, 7 op/s 2023-05-08T04:35:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:03 smithi186 ceph-mon[126480]: pgmap v1685: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:35:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:03 smithi133 ceph-mon[125939]: pgmap v1685: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:35:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:03 smithi096 ceph-mon[124666]: pgmap v1685: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:35:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3042.627587 secs 2023-05-08T04:35:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3043.183344 secs 2023-05-08T04:35:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3042.627587 secs 2023-05-08T04:35:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3043.183344 secs 2023-05-08T04:35:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3042.627587 secs 2023-05-08T04:35:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3043.183344 secs 2023-05-08T04:35:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3044.458237 secs 2023-05-08T04:35:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:05 smithi186 ceph-mon[126480]: pgmap v1686: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:35:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3044.458237 secs 2023-05-08T04:35:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:05 smithi133 ceph-mon[125939]: pgmap v1686: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:35:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3044.458237 secs 2023-05-08T04:35:05.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:05 smithi096 ceph-mon[124666]: pgmap v1686: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:35:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:07 smithi186 ceph-mon[126480]: pgmap v1687: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:35:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:07 smithi133 ceph-mon[125939]: pgmap v1687: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:35:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:07 smithi096 ceph-mon[124666]: pgmap v1687: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:35:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3047.627662 secs 2023-05-08T04:35:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3048.183497 secs 2023-05-08T04:35:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:09 smithi186 ceph-mon[126480]: pgmap v1688: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:35:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3047.627662 secs 2023-05-08T04:35:09.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3048.183497 secs 2023-05-08T04:35:09.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:09 smithi133 ceph-mon[125939]: pgmap v1688: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:35:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3047.627662 secs 2023-05-08T04:35:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3048.183497 secs 2023-05-08T04:35:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:09 smithi096 ceph-mon[124666]: pgmap v1688: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:35:10.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3049.458356 secs 2023-05-08T04:35:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3049.458356 secs 2023-05-08T04:35:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3049.458356 secs 2023-05-08T04:35:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:11 smithi186 ceph-mon[126480]: osdmap e186: 12 total, 12 up, 12 in 2023-05-08T04:35:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:11 smithi186 ceph-mon[126480]: pgmap v1690: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:35:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:11 smithi133 ceph-mon[125939]: osdmap e186: 12 total, 12 up, 12 in 2023-05-08T04:35:11.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:11 smithi133 ceph-mon[125939]: pgmap v1690: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:35:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:11 smithi096 ceph-mon[124666]: osdmap e186: 12 total, 12 up, 12 in 2023-05-08T04:35:11.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:11 smithi096 ceph-mon[124666]: pgmap v1690: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:35:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:13 smithi186 ceph-mon[126480]: pgmap v1691: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:35:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:13 smithi133 ceph-mon[125939]: pgmap v1691: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:35:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:13 smithi096 ceph-mon[124666]: pgmap v1691: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:35:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3052.627778 secs 2023-05-08T04:35:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3053.183610 secs 2023-05-08T04:35:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3052.627778 secs 2023-05-08T04:35:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3053.183610 secs 2023-05-08T04:35:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3052.627778 secs 2023-05-08T04:35:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3053.183610 secs 2023-05-08T04:35:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3054.458472 secs 2023-05-08T04:35:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:15 smithi186 ceph-mon[126480]: pgmap v1692: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:35:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3054.458472 secs 2023-05-08T04:35:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:15 smithi133 ceph-mon[125939]: pgmap v1692: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:35:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3054.458472 secs 2023-05-08T04:35:15.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:15 smithi096 ceph-mon[124666]: pgmap v1692: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:35:17.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:17 smithi186 ceph-mon[126480]: pgmap v1693: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:35:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:17 smithi133 ceph-mon[125939]: pgmap v1693: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:35:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:17 smithi096 ceph-mon[124666]: pgmap v1693: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:35:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3057.627895 secs 2023-05-08T04:35:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:19 smithi186 ceph-mon[126480]: osdmap e187: 12 total, 12 up, 12 in 2023-05-08T04:35:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3058.183708 secs 2023-05-08T04:35:19.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:19 smithi186 ceph-mon[126480]: pgmap v1695: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:35:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3057.627895 secs 2023-05-08T04:35:19.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:19 smithi133 ceph-mon[125939]: osdmap e187: 12 total, 12 up, 12 in 2023-05-08T04:35:19.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3058.183708 secs 2023-05-08T04:35:19.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:19 smithi133 ceph-mon[125939]: pgmap v1695: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:35:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3057.627895 secs 2023-05-08T04:35:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:19 smithi096 ceph-mon[124666]: osdmap e187: 12 total, 12 up, 12 in 2023-05-08T04:35:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3058.183708 secs 2023-05-08T04:35:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:19 smithi096 ceph-mon[124666]: pgmap v1695: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:35:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3059.458605 secs 2023-05-08T04:35:20.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3059.458605 secs 2023-05-08T04:35:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3059.458605 secs 2023-05-08T04:35:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:21 smithi186 ceph-mon[126480]: pgmap v1696: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:35:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:21 smithi133 ceph-mon[125939]: pgmap v1696: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:35:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:21 smithi096 ceph-mon[124666]: pgmap v1696: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:35:23.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:23 smithi186 ceph-mon[126480]: pgmap v1697: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:35:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:23 smithi133 ceph-mon[125939]: pgmap v1697: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:35:23.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:23 smithi096 ceph-mon[124666]: pgmap v1697: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:35:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3062.627989 secs 2023-05-08T04:35:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3063.183786 secs 2023-05-08T04:35:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3062.627989 secs 2023-05-08T04:35:24.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3063.183786 secs 2023-05-08T04:35:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3062.627989 secs 2023-05-08T04:35:24.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3063.183786 secs 2023-05-08T04:35:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3064.458696 secs 2023-05-08T04:35:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:25 smithi186 ceph-mon[126480]: pgmap v1698: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:35:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3064.458696 secs 2023-05-08T04:35:25.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:25 smithi133 ceph-mon[125939]: pgmap v1698: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:35:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3064.458696 secs 2023-05-08T04:35:25.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:25 smithi096 ceph-mon[124666]: pgmap v1698: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:35:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:35:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:35:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:35:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:35:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:35:27.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:27 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:35:27.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:35:27.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:27 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T04:35:27.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:27 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T04:35:27.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:27 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:35:27.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:27 smithi186 ceph-mon[126480]: pgmap v1699: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:35:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:35:27.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:35:27.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:27 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:35:27.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:35:27.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:27 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T04:35:27.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:27 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T04:35:27.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:27 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:35:27.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:27 smithi133 ceph-mon[125939]: pgmap v1699: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:35:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:35:27.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:35:27.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:27 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:35:27.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:35:27.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:27 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T04:35:27.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:27 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T04:35:27.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:27 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:35:27.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:27 smithi096 ceph-mon[124666]: pgmap v1699: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:35:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3067.628109 secs 2023-05-08T04:35:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3068.183898 secs 2023-05-08T04:35:29.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:29 smithi186 ceph-mon[126480]: pgmap v1700: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2023-05-08T04:35:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3067.628109 secs 2023-05-08T04:35:29.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3068.183898 secs 2023-05-08T04:35:29.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:29 smithi133 ceph-mon[125939]: pgmap v1700: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2023-05-08T04:35:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3067.628109 secs 2023-05-08T04:35:29.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3068.183898 secs 2023-05-08T04:35:29.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:29 smithi096 ceph-mon[124666]: pgmap v1700: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2023-05-08T04:35:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:31 smithi186 ceph-mon[126480]: pgmap v1701: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 170 B/s wr, 7 op/s 2023-05-08T04:35:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:31 smithi133 ceph-mon[125939]: pgmap v1701: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 170 B/s wr, 7 op/s 2023-05-08T04:35:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:31 smithi096 ceph-mon[124666]: pgmap v1701: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 170 B/s wr, 7 op/s 2023-05-08T04:35:33.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:33 smithi186 ceph-mon[126480]: pgmap v1702: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T04:35:33.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:33 smithi133 ceph-mon[125939]: pgmap v1702: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T04:35:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:33 smithi096 ceph-mon[124666]: pgmap v1702: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T04:35:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3072.628215 secs 2023-05-08T04:35:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3073.184024 secs 2023-05-08T04:35:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:34 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:35:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3072.628215 secs 2023-05-08T04:35:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3073.184024 secs 2023-05-08T04:35:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:34 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:35:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3072.628215 secs 2023-05-08T04:35:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3073.184024 secs 2023-05-08T04:35:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:34 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:35:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:35 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:35:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:35 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:35:35.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:35 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:35:35.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3074.458931 secs 2023-05-08T04:35:35.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:35 smithi186 ceph-mon[126480]: pgmap v1703: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 67 KiB/s wr, 9 op/s 2023-05-08T04:35:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:35 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:35:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:35 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:35:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:35 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:35:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3074.458931 secs 2023-05-08T04:35:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:35 smithi133 ceph-mon[125939]: pgmap v1703: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 67 KiB/s wr, 9 op/s 2023-05-08T04:35:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:35 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:35:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:35 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:35:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:35 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:35:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3074.458931 secs 2023-05-08T04:35:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:35 smithi096 ceph-mon[124666]: pgmap v1703: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 67 KiB/s wr, 9 op/s 2023-05-08T04:35:37.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:37 smithi186 ceph-mon[126480]: pgmap v1704: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 67 KiB/s wr, 6 op/s 2023-05-08T04:35:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:37 smithi133 ceph-mon[125939]: pgmap v1704: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 67 KiB/s wr, 6 op/s 2023-05-08T04:35:37.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:37 smithi096 ceph-mon[124666]: pgmap v1704: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 67 KiB/s wr, 6 op/s 2023-05-08T04:35:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3077.628321 secs 2023-05-08T04:35:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:39 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:35:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:39 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:35:39.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3078.184140 secs 2023-05-08T04:35:39.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:39 smithi186 ceph-mon[126480]: pgmap v1705: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 67 KiB/s wr, 6 op/s 2023-05-08T04:35:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3077.628321 secs 2023-05-08T04:35:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:39 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:35:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:39 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:35:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3078.184140 secs 2023-05-08T04:35:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:39 smithi133 ceph-mon[125939]: pgmap v1705: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 67 KiB/s wr, 6 op/s 2023-05-08T04:35:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3077.628321 secs 2023-05-08T04:35:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:39 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:35:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:39 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:35:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3078.184140 secs 2023-05-08T04:35:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:39 smithi096 ceph-mon[124666]: pgmap v1705: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 67 KiB/s wr, 6 op/s 2023-05-08T04:35:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3079.459040 secs 2023-05-08T04:35:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3079.459040 secs 2023-05-08T04:35:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3079.459040 secs 2023-05-08T04:35:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:41 smithi186 ceph-mon[126480]: pgmap v1706: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 99 KiB/s wr, 10 op/s 2023-05-08T04:35:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:41 smithi133 ceph-mon[125939]: pgmap v1706: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 99 KiB/s wr, 10 op/s 2023-05-08T04:35:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:41 smithi096 ceph-mon[124666]: pgmap v1706: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 99 KiB/s wr, 10 op/s 2023-05-08T04:35:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:43 smithi186 ceph-mon[126480]: pgmap v1707: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 99 KiB/s wr, 8 op/s 2023-05-08T04:35:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:43 smithi133 ceph-mon[125939]: pgmap v1707: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 99 KiB/s wr, 8 op/s 2023-05-08T04:35:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:43 smithi096 ceph-mon[124666]: pgmap v1707: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 99 KiB/s wr, 8 op/s 2023-05-08T04:35:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3082.628439 secs 2023-05-08T04:35:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:44 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:35:44.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3083.184263 secs 2023-05-08T04:35:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3082.628439 secs 2023-05-08T04:35:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:44 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:35:44.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3083.184263 secs 2023-05-08T04:35:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3082.628439 secs 2023-05-08T04:35:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:44 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:35:44.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3083.184263 secs 2023-05-08T04:35:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:45 smithi186 ceph-mon[126480]: pgmap v1708: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 99 KiB/s wr, 11 op/s 2023-05-08T04:35:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:45 smithi133 ceph-mon[125939]: pgmap v1708: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 99 KiB/s wr, 11 op/s 2023-05-08T04:35:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:45 smithi096 ceph-mon[124666]: pgmap v1708: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 99 KiB/s wr, 11 op/s 2023-05-08T04:35:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3084.459136 secs 2023-05-08T04:35:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3084.459136 secs 2023-05-08T04:35:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3084.459136 secs 2023-05-08T04:35:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:47 smithi186 ceph-mon[126480]: pgmap v1709: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T04:35:47.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:47 smithi133 ceph-mon[125939]: pgmap v1709: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T04:35:47.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:47 smithi096 ceph-mon[124666]: pgmap v1709: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T04:35:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3087.628556 secs 2023-05-08T04:35:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3088.184376 secs 2023-05-08T04:35:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:49 smithi186 ceph-mon[126480]: pgmap v1710: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T04:35:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3087.628556 secs 2023-05-08T04:35:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3088.184376 secs 2023-05-08T04:35:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:49 smithi133 ceph-mon[125939]: pgmap v1710: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T04:35:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3087.628556 secs 2023-05-08T04:35:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3088.184376 secs 2023-05-08T04:35:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:49 smithi096 ceph-mon[124666]: pgmap v1710: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T04:35:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3089.459272 secs 2023-05-08T04:35:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3089.459272 secs 2023-05-08T04:35:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3089.459272 secs 2023-05-08T04:35:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:51 smithi186 ceph-mon[126480]: pgmap v1711: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 KiB/s wr, 9 op/s 2023-05-08T04:35:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:51 smithi133 ceph-mon[125939]: pgmap v1711: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 KiB/s wr, 9 op/s 2023-05-08T04:35:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:51 smithi096 ceph-mon[124666]: pgmap v1711: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 KiB/s wr, 9 op/s 2023-05-08T04:35:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:53 smithi186 ceph-mon[126480]: pgmap v1712: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.2 KiB/s wr, 5 op/s 2023-05-08T04:35:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:53 smithi133 ceph-mon[125939]: pgmap v1712: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.2 KiB/s wr, 5 op/s 2023-05-08T04:35:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:53 smithi096 ceph-mon[124666]: pgmap v1712: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.2 KiB/s wr, 5 op/s 2023-05-08T04:35:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3092.628671 secs 2023-05-08T04:35:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3093.184531 secs 2023-05-08T04:35:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3092.628671 secs 2023-05-08T04:35:54.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3093.184531 secs 2023-05-08T04:35:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3092.628671 secs 2023-05-08T04:35:54.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3093.184531 secs 2023-05-08T04:35:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3094.459409 secs 2023-05-08T04:35:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:55 smithi186 ceph-mon[126480]: pgmap v1713: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.2 KiB/s wr, 7 op/s 2023-05-08T04:35:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3094.459409 secs 2023-05-08T04:35:55.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:55 smithi133 ceph-mon[125939]: pgmap v1713: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.2 KiB/s wr, 7 op/s 2023-05-08T04:35:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3094.459409 secs 2023-05-08T04:35:55.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:55 smithi096 ceph-mon[124666]: pgmap v1713: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.2 KiB/s wr, 7 op/s 2023-05-08T04:35:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:57 smithi186 ceph-mon[126480]: pgmap v1714: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.0 KiB/s wr, 5 op/s 2023-05-08T04:35:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:57 smithi133 ceph-mon[125939]: pgmap v1714: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.0 KiB/s wr, 5 op/s 2023-05-08T04:35:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:57 smithi096 ceph-mon[124666]: pgmap v1714: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.0 KiB/s wr, 5 op/s 2023-05-08T04:35:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3097.628757 secs 2023-05-08T04:35:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3098.184637 secs 2023-05-08T04:35:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:35:59 smithi186 ceph-mon[126480]: pgmap v1715: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.0 KiB/s wr, 5 op/s 2023-05-08T04:35:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3097.628757 secs 2023-05-08T04:35:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3098.184637 secs 2023-05-08T04:35:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:35:59 smithi133 ceph-mon[125939]: pgmap v1715: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.0 KiB/s wr, 5 op/s 2023-05-08T04:35:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3097.628757 secs 2023-05-08T04:35:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3098.184637 secs 2023-05-08T04:35:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:35:59 smithi096 ceph-mon[124666]: pgmap v1715: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.0 KiB/s wr, 5 op/s 2023-05-08T04:36:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3099.459536 secs 2023-05-08T04:36:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3099.459536 secs 2023-05-08T04:36:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3099.459536 secs 2023-05-08T04:36:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:01 smithi186 ceph-mon[126480]: pgmap v1716: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.0 KiB/s wr, 7 op/s 2023-05-08T04:36:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:01 smithi133 ceph-mon[125939]: pgmap v1716: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.0 KiB/s wr, 7 op/s 2023-05-08T04:36:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:01 smithi096 ceph-mon[124666]: pgmap v1716: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.0 KiB/s wr, 7 op/s 2023-05-08T04:36:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:03 smithi186 ceph-mon[126480]: pgmap v1717: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:36:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:03 smithi133 ceph-mon[125939]: pgmap v1717: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:36:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:03 smithi096 ceph-mon[124666]: pgmap v1717: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:36:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3102.628896 secs 2023-05-08T04:36:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3103.184750 secs 2023-05-08T04:36:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3102.628896 secs 2023-05-08T04:36:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3103.184750 secs 2023-05-08T04:36:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3102.628896 secs 2023-05-08T04:36:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3103.184750 secs 2023-05-08T04:36:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3104.459697 secs 2023-05-08T04:36:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:05 smithi186 ceph-mon[126480]: pgmap v1718: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:36:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3104.459697 secs 2023-05-08T04:36:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:05 smithi133 ceph-mon[125939]: pgmap v1718: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:36:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3104.459697 secs 2023-05-08T04:36:05.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:05 smithi096 ceph-mon[124666]: pgmap v1718: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:36:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:07 smithi186 ceph-mon[126480]: pgmap v1719: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:36:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:07 smithi133 ceph-mon[125939]: pgmap v1719: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:36:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:07 smithi096 ceph-mon[124666]: pgmap v1719: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:36:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3107.628994 secs 2023-05-08T04:36:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3108.184868 secs 2023-05-08T04:36:09.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:09 smithi186 ceph-mon[126480]: pgmap v1720: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:36:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3107.628994 secs 2023-05-08T04:36:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3108.184868 secs 2023-05-08T04:36:09.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:09 smithi133 ceph-mon[125939]: pgmap v1720: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:36:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3107.628994 secs 2023-05-08T04:36:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3108.184868 secs 2023-05-08T04:36:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:09 smithi096 ceph-mon[124666]: pgmap v1720: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:36:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3109.459847 secs 2023-05-08T04:36:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3109.459847 secs 2023-05-08T04:36:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3109.459847 secs 2023-05-08T04:36:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:11 smithi186 ceph-mon[126480]: osdmap e188: 12 total, 12 up, 12 in 2023-05-08T04:36:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:11 smithi186 ceph-mon[126480]: pgmap v1722: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T04:36:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:11 smithi133 ceph-mon[125939]: osdmap e188: 12 total, 12 up, 12 in 2023-05-08T04:36:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:11 smithi133 ceph-mon[125939]: pgmap v1722: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T04:36:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:11 smithi096 ceph-mon[124666]: osdmap e188: 12 total, 12 up, 12 in 2023-05-08T04:36:11.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:11 smithi096 ceph-mon[124666]: pgmap v1722: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T04:36:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:13 smithi186 ceph-mon[126480]: pgmap v1723: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T04:36:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:13 smithi133 ceph-mon[125939]: pgmap v1723: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T04:36:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:13 smithi096 ceph-mon[124666]: pgmap v1723: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T04:36:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3112.629128 secs 2023-05-08T04:36:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3113.185027 secs 2023-05-08T04:36:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3112.629128 secs 2023-05-08T04:36:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3113.185027 secs 2023-05-08T04:36:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3112.629128 secs 2023-05-08T04:36:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3113.185027 secs 2023-05-08T04:36:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3114.459972 secs 2023-05-08T04:36:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:15 smithi186 ceph-mon[126480]: pgmap v1724: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:36:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3114.459972 secs 2023-05-08T04:36:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:15 smithi133 ceph-mon[125939]: pgmap v1724: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:36:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3114.459972 secs 2023-05-08T04:36:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:15 smithi096 ceph-mon[124666]: pgmap v1724: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:36:17.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:17 smithi186 ceph-mon[126480]: pgmap v1725: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:36:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:17 smithi133 ceph-mon[125939]: pgmap v1725: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:36:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:17 smithi096 ceph-mon[124666]: pgmap v1725: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:36:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3117.629220 secs 2023-05-08T04:36:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:19 smithi186 ceph-mon[126480]: osdmap e189: 12 total, 12 up, 12 in 2023-05-08T04:36:19.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3118.185155 secs 2023-05-08T04:36:19.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:19 smithi186 ceph-mon[126480]: pgmap v1727: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:36:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3117.629220 secs 2023-05-08T04:36:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:19 smithi133 ceph-mon[125939]: osdmap e189: 12 total, 12 up, 12 in 2023-05-08T04:36:19.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3118.185155 secs 2023-05-08T04:36:19.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:19 smithi133 ceph-mon[125939]: pgmap v1727: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:36:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3117.629220 secs 2023-05-08T04:36:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:19 smithi096 ceph-mon[124666]: osdmap e189: 12 total, 12 up, 12 in 2023-05-08T04:36:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3118.185155 secs 2023-05-08T04:36:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:19 smithi096 ceph-mon[124666]: pgmap v1727: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:36:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3119.460101 secs 2023-05-08T04:36:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3119.460101 secs 2023-05-08T04:36:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3119.460101 secs 2023-05-08T04:36:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:21 smithi186 ceph-mon[126480]: pgmap v1728: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:36:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:21 smithi133 ceph-mon[125939]: pgmap v1728: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:36:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:21 smithi096 ceph-mon[124666]: pgmap v1728: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:36:23.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:23 smithi186 ceph-mon[126480]: pgmap v1729: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:36:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:23 smithi133 ceph-mon[125939]: pgmap v1729: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:36:23.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:23 smithi096 ceph-mon[124666]: pgmap v1729: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:36:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3122.629367 secs 2023-05-08T04:36:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3123.185290 secs 2023-05-08T04:36:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3122.629367 secs 2023-05-08T04:36:24.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3123.185290 secs 2023-05-08T04:36:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3122.629367 secs 2023-05-08T04:36:24.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3123.185290 secs 2023-05-08T04:36:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3124.460230 secs 2023-05-08T04:36:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:25 smithi186 ceph-mon[126480]: pgmap v1730: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:36:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3124.460230 secs 2023-05-08T04:36:25.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:25 smithi133 ceph-mon[125939]: pgmap v1730: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:36:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3124.460230 secs 2023-05-08T04:36:25.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:25 smithi096 ceph-mon[124666]: pgmap v1730: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:36:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:36:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:36:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:36:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:27 smithi133 ceph-mon[125939]: pgmap v1731: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:36:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:36:27.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:36:27.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:36:27.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:36:27.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:36:27.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:36:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:27 smithi096 ceph-mon[124666]: pgmap v1731: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:36:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:36:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:36:28.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:36:28.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:36:28.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:36:28.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:36:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:27 smithi186 ceph-mon[126480]: pgmap v1731: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:36:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:36:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:36:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:36:28.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:36:28.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:36:28.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:36:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:28 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:36:28.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:28 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:36:28.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:28 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:36:28.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:28 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:36:28.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:28 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T04:36:28.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:28 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T04:36:28.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:28 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:36:28.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3127.629438 secs 2023-05-08T04:36:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:28 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:36:29.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:28 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:36:29.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:28 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:36:29.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:28 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:36:29.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:28 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T04:36:29.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:28 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T04:36:29.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:28 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:36:29.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3127.629438 secs 2023-05-08T04:36:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:28 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:36:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:28 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:36:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:28 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:36:29.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:28 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:36:29.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:28 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T04:36:29.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:28 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T04:36:29.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:28 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:36:29.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3127.629438 secs 2023-05-08T04:36:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3128.185410 secs 2023-05-08T04:36:29.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:29 smithi133 ceph-mon[125939]: pgmap v1732: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2023-05-08T04:36:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3128.185410 secs 2023-05-08T04:36:30.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:29 smithi096 ceph-mon[124666]: pgmap v1732: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2023-05-08T04:36:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3128.185410 secs 2023-05-08T04:36:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:29 smithi186 ceph-mon[126480]: pgmap v1732: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2023-05-08T04:36:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:31 smithi186 ceph-mon[126480]: pgmap v1733: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T04:36:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:31 smithi133 ceph-mon[125939]: pgmap v1733: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T04:36:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:31 smithi096 ceph-mon[124666]: pgmap v1733: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T04:36:33.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:33 smithi186 ceph-mon[126480]: pgmap v1734: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T04:36:33.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:33 smithi133 ceph-mon[125939]: pgmap v1734: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T04:36:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:33 smithi096 ceph-mon[124666]: pgmap v1734: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T04:36:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3132.629517 secs 2023-05-08T04:36:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3133.185541 secs 2023-05-08T04:36:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:34 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:36:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3132.629517 secs 2023-05-08T04:36:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3133.185541 secs 2023-05-08T04:36:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:34 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:36:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3132.629517 secs 2023-05-08T04:36:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3133.185541 secs 2023-05-08T04:36:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:34 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:36:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:35 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:36:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:35 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:36:35.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:35 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:36:35.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3134.460492 secs 2023-05-08T04:36:35.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:35 smithi186 ceph-mon[126480]: pgmap v1735: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 86 KiB/s wr, 9 op/s 2023-05-08T04:36:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:35 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:36:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:35 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:36:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:35 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:36:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3134.460492 secs 2023-05-08T04:36:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:35 smithi133 ceph-mon[125939]: pgmap v1735: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 86 KiB/s wr, 9 op/s 2023-05-08T04:36:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:35 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:36:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:35 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:36:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:35 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:36:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3134.460492 secs 2023-05-08T04:36:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:35 smithi096 ceph-mon[124666]: pgmap v1735: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 86 KiB/s wr, 9 op/s 2023-05-08T04:36:37.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:37 smithi186 ceph-mon[126480]: pgmap v1736: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 86 KiB/s wr, 7 op/s 2023-05-08T04:36:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:37 smithi133 ceph-mon[125939]: pgmap v1736: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 86 KiB/s wr, 7 op/s 2023-05-08T04:36:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:37 smithi096 ceph-mon[124666]: pgmap v1736: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 86 KiB/s wr, 7 op/s 2023-05-08T04:36:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3137.629584 secs 2023-05-08T04:36:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:39 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:36:39.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:39 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:36:39.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3138.185680 secs 2023-05-08T04:36:39.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:39 smithi186 ceph-mon[126480]: pgmap v1737: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 86 KiB/s wr, 7 op/s 2023-05-08T04:36:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3137.629584 secs 2023-05-08T04:36:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:39 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:36:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:39 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:36:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3138.185680 secs 2023-05-08T04:36:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:39 smithi133 ceph-mon[125939]: pgmap v1737: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 86 KiB/s wr, 7 op/s 2023-05-08T04:36:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3137.629584 secs 2023-05-08T04:36:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:39 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:36:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:39 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:36:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3138.185680 secs 2023-05-08T04:36:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:39 smithi096 ceph-mon[124666]: pgmap v1737: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 86 KiB/s wr, 7 op/s 2023-05-08T04:36:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3139.460618 secs 2023-05-08T04:36:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3139.460618 secs 2023-05-08T04:36:40.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3139.460618 secs 2023-05-08T04:36:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:41 smithi186 ceph-mon[126480]: pgmap v1738: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 120 KiB/s wr, 11 op/s 2023-05-08T04:36:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:41 smithi133 ceph-mon[125939]: pgmap v1738: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 120 KiB/s wr, 11 op/s 2023-05-08T04:36:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:41 smithi096 ceph-mon[124666]: pgmap v1738: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 120 KiB/s wr, 11 op/s 2023-05-08T04:36:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:43 smithi186 ceph-mon[126480]: pgmap v1739: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 120 KiB/s wr, 9 op/s 2023-05-08T04:36:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:43 smithi133 ceph-mon[125939]: pgmap v1739: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 120 KiB/s wr, 9 op/s 2023-05-08T04:36:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:43 smithi096 ceph-mon[124666]: pgmap v1739: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 120 KiB/s wr, 9 op/s 2023-05-08T04:36:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3142.629664 secs 2023-05-08T04:36:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:44 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:36:44.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3143.185811 secs 2023-05-08T04:36:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3142.629664 secs 2023-05-08T04:36:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:44 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:36:44.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3143.185811 secs 2023-05-08T04:36:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3142.629664 secs 2023-05-08T04:36:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:44 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:36:44.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3143.185811 secs 2023-05-08T04:36:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:45 smithi186 ceph-mon[126480]: pgmap v1740: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 120 KiB/s wr, 12 op/s 2023-05-08T04:36:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:45 smithi133 ceph-mon[125939]: pgmap v1740: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 120 KiB/s wr, 12 op/s 2023-05-08T04:36:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:45 smithi096 ceph-mon[124666]: pgmap v1740: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 120 KiB/s wr, 12 op/s 2023-05-08T04:36:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3144.460682 secs 2023-05-08T04:36:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3144.460682 secs 2023-05-08T04:36:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3144.460682 secs 2023-05-08T04:36:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:47 smithi186 ceph-mon[126480]: pgmap v1741: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 7 op/s 2023-05-08T04:36:47.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:47 smithi133 ceph-mon[125939]: pgmap v1741: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 7 op/s 2023-05-08T04:36:47.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:47 smithi096 ceph-mon[124666]: pgmap v1741: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 7 op/s 2023-05-08T04:36:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3147.629723 secs 2023-05-08T04:36:49.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3148.185937 secs 2023-05-08T04:36:49.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:49 smithi186 ceph-mon[126480]: pgmap v1742: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 7 op/s 2023-05-08T04:36:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3147.629723 secs 2023-05-08T04:36:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3148.185937 secs 2023-05-08T04:36:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:49 smithi133 ceph-mon[125939]: pgmap v1742: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 7 op/s 2023-05-08T04:36:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3147.629723 secs 2023-05-08T04:36:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3148.185937 secs 2023-05-08T04:36:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:49 smithi096 ceph-mon[124666]: pgmap v1742: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 7 op/s 2023-05-08T04:36:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3149.460803 secs 2023-05-08T04:36:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3149.460803 secs 2023-05-08T04:36:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3149.460803 secs 2023-05-08T04:36:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:51 smithi186 ceph-mon[126480]: pgmap v1743: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 43 KiB/s wr, 10 op/s 2023-05-08T04:36:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:51 smithi133 ceph-mon[125939]: pgmap v1743: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 43 KiB/s wr, 10 op/s 2023-05-08T04:36:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:51 smithi096 ceph-mon[124666]: pgmap v1743: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 43 KiB/s wr, 10 op/s 2023-05-08T04:36:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:53 smithi186 ceph-mon[126480]: pgmap v1744: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.3 KiB/s wr, 5 op/s 2023-05-08T04:36:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:53 smithi133 ceph-mon[125939]: pgmap v1744: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.3 KiB/s wr, 5 op/s 2023-05-08T04:36:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:53 smithi096 ceph-mon[124666]: pgmap v1744: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.3 KiB/s wr, 5 op/s 2023-05-08T04:36:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3152.629839 secs 2023-05-08T04:36:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3153.186082 secs 2023-05-08T04:36:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3152.629839 secs 2023-05-08T04:36:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3153.186082 secs 2023-05-08T04:36:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3152.629839 secs 2023-05-08T04:36:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3153.186082 secs 2023-05-08T04:36:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3154.460873 secs 2023-05-08T04:36:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:55 smithi186 ceph-mon[126480]: pgmap v1745: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.3 KiB/s wr, 8 op/s 2023-05-08T04:36:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3154.460873 secs 2023-05-08T04:36:55.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:55 smithi133 ceph-mon[125939]: pgmap v1745: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.3 KiB/s wr, 8 op/s 2023-05-08T04:36:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3154.460873 secs 2023-05-08T04:36:55.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:55 smithi096 ceph-mon[124666]: pgmap v1745: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.3 KiB/s wr, 8 op/s 2023-05-08T04:36:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:57 smithi186 ceph-mon[126480]: pgmap v1746: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.2 KiB/s wr, 5 op/s 2023-05-08T04:36:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:57 smithi133 ceph-mon[125939]: pgmap v1746: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.2 KiB/s wr, 5 op/s 2023-05-08T04:36:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:57 smithi096 ceph-mon[124666]: pgmap v1746: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.2 KiB/s wr, 5 op/s 2023-05-08T04:36:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3157.629953 secs 2023-05-08T04:36:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3158.186209 secs 2023-05-08T04:36:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:36:59 smithi186 ceph-mon[126480]: pgmap v1747: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.2 KiB/s wr, 5 op/s 2023-05-08T04:36:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3157.629953 secs 2023-05-08T04:36:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3158.186209 secs 2023-05-08T04:36:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:36:59 smithi133 ceph-mon[125939]: pgmap v1747: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.2 KiB/s wr, 5 op/s 2023-05-08T04:36:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3157.629953 secs 2023-05-08T04:36:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3158.186209 secs 2023-05-08T04:36:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:36:59 smithi096 ceph-mon[124666]: pgmap v1747: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.2 KiB/s wr, 5 op/s 2023-05-08T04:37:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3159.460995 secs 2023-05-08T04:37:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3159.460995 secs 2023-05-08T04:37:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3159.460995 secs 2023-05-08T04:37:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:01 smithi186 ceph-mon[126480]: pgmap v1748: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.2 KiB/s wr, 7 op/s 2023-05-08T04:37:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:01 smithi133 ceph-mon[125939]: pgmap v1748: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.2 KiB/s wr, 7 op/s 2023-05-08T04:37:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:01 smithi096 ceph-mon[124666]: pgmap v1748: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.2 KiB/s wr, 7 op/s 2023-05-08T04:37:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:03 smithi186 ceph-mon[126480]: pgmap v1749: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:37:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:03 smithi133 ceph-mon[125939]: pgmap v1749: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:37:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:03 smithi096 ceph-mon[124666]: pgmap v1749: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:37:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3162.630070 secs 2023-05-08T04:37:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3163.186312 secs 2023-05-08T04:37:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3162.630070 secs 2023-05-08T04:37:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3163.186312 secs 2023-05-08T04:37:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3162.630070 secs 2023-05-08T04:37:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3163.186312 secs 2023-05-08T04:37:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3164.461101 secs 2023-05-08T04:37:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:05 smithi186 ceph-mon[126480]: pgmap v1750: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:37:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3164.461101 secs 2023-05-08T04:37:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:05 smithi133 ceph-mon[125939]: pgmap v1750: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:37:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3164.461101 secs 2023-05-08T04:37:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:05 smithi096 ceph-mon[124666]: pgmap v1750: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:37:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:07 smithi186 ceph-mon[126480]: pgmap v1751: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:37:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:07 smithi133 ceph-mon[125939]: pgmap v1751: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:37:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:07 smithi096 ceph-mon[124666]: pgmap v1751: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:37:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3167.630208 secs 2023-05-08T04:37:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3168.186461 secs 2023-05-08T04:37:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:09 smithi186 ceph-mon[126480]: pgmap v1752: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:37:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3167.630208 secs 2023-05-08T04:37:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3168.186461 secs 2023-05-08T04:37:09.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:09 smithi133 ceph-mon[125939]: pgmap v1752: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:37:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3167.630208 secs 2023-05-08T04:37:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3168.186461 secs 2023-05-08T04:37:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:09 smithi096 ceph-mon[124666]: pgmap v1752: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:37:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3169.461217 secs 2023-05-08T04:37:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3169.461217 secs 2023-05-08T04:37:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3169.461217 secs 2023-05-08T04:37:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:11 smithi186 ceph-mon[126480]: osdmap e190: 12 total, 12 up, 12 in 2023-05-08T04:37:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:11 smithi186 ceph-mon[126480]: pgmap v1754: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T04:37:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:11 smithi133 ceph-mon[125939]: osdmap e190: 12 total, 12 up, 12 in 2023-05-08T04:37:11.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:11 smithi133 ceph-mon[125939]: pgmap v1754: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T04:37:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:11 smithi096 ceph-mon[124666]: osdmap e190: 12 total, 12 up, 12 in 2023-05-08T04:37:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:11 smithi096 ceph-mon[124666]: pgmap v1754: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T04:37:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:13 smithi186 ceph-mon[126480]: pgmap v1755: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T04:37:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:13 smithi133 ceph-mon[125939]: pgmap v1755: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T04:37:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:13 smithi096 ceph-mon[124666]: pgmap v1755: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T04:37:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3172.630305 secs 2023-05-08T04:37:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3173.186581 secs 2023-05-08T04:37:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3172.630305 secs 2023-05-08T04:37:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3173.186581 secs 2023-05-08T04:37:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3172.630305 secs 2023-05-08T04:37:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3173.186581 secs 2023-05-08T04:37:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3174.461329 secs 2023-05-08T04:37:15.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:15 smithi186 ceph-mon[126480]: pgmap v1756: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:37:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3174.461329 secs 2023-05-08T04:37:15.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:15 smithi133 ceph-mon[125939]: pgmap v1756: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:37:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3174.461329 secs 2023-05-08T04:37:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:15 smithi096 ceph-mon[124666]: pgmap v1756: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:37:17.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:17 smithi186 ceph-mon[126480]: pgmap v1757: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:37:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:17 smithi133 ceph-mon[125939]: pgmap v1757: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:37:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:17 smithi096 ceph-mon[124666]: pgmap v1757: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:37:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3177.630429 secs 2023-05-08T04:37:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:19 smithi186 ceph-mon[126480]: osdmap e191: 12 total, 12 up, 12 in 2023-05-08T04:37:19.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3178.186677 secs 2023-05-08T04:37:19.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:19 smithi186 ceph-mon[126480]: pgmap v1759: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:37:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3177.630429 secs 2023-05-08T04:37:19.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:19 smithi133 ceph-mon[125939]: osdmap e191: 12 total, 12 up, 12 in 2023-05-08T04:37:19.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3178.186677 secs 2023-05-08T04:37:19.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:19 smithi133 ceph-mon[125939]: pgmap v1759: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:37:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3177.630429 secs 2023-05-08T04:37:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:19 smithi096 ceph-mon[124666]: osdmap e191: 12 total, 12 up, 12 in 2023-05-08T04:37:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3178.186677 secs 2023-05-08T04:37:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:19 smithi096 ceph-mon[124666]: pgmap v1759: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:37:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3179.461463 secs 2023-05-08T04:37:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3179.461463 secs 2023-05-08T04:37:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3179.461463 secs 2023-05-08T04:37:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:21 smithi186 ceph-mon[126480]: pgmap v1760: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:37:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:21 smithi133 ceph-mon[125939]: pgmap v1760: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:37:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:21 smithi096 ceph-mon[124666]: pgmap v1760: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:37:23.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:23 smithi186 ceph-mon[126480]: pgmap v1761: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:37:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:23 smithi133 ceph-mon[125939]: pgmap v1761: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:37:23.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:23 smithi096 ceph-mon[124666]: pgmap v1761: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:37:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3182.630546 secs 2023-05-08T04:37:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3183.186797 secs 2023-05-08T04:37:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3182.630546 secs 2023-05-08T04:37:24.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3183.186797 secs 2023-05-08T04:37:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3182.630546 secs 2023-05-08T04:37:24.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3183.186797 secs 2023-05-08T04:37:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3184.461609 secs 2023-05-08T04:37:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:25 smithi186 ceph-mon[126480]: pgmap v1762: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:37:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3184.461609 secs 2023-05-08T04:37:25.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:25 smithi133 ceph-mon[125939]: pgmap v1762: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:37:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3184.461609 secs 2023-05-08T04:37:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:25 smithi096 ceph-mon[124666]: pgmap v1762: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:37:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:27 smithi186 ceph-mon[126480]: pgmap v1763: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:37:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:27 smithi133 ceph-mon[125939]: pgmap v1763: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:37:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:27 smithi096 ceph-mon[124666]: pgmap v1763: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:37:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:28 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:37:28.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:28 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:37:28.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:28 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:37:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3187.630611 secs 2023-05-08T04:37:29.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3188.186895 secs 2023-05-08T04:37:29.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:29 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:37:29.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:29 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:37:29.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:29 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:37:29.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:29 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:37:29.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:29 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T04:37:29.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:29 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T04:37:29.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:29 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:37:29.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:29 smithi186 ceph-mon[126480]: pgmap v1764: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2023-05-08T04:37:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3187.630611 secs 2023-05-08T04:37:29.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3188.186895 secs 2023-05-08T04:37:29.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:29 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:37:29.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:29 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:37:29.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:29 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:37:29.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:29 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:37:29.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:29 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T04:37:29.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:29 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T04:37:29.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:29 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:37:29.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:29 smithi133 ceph-mon[125939]: pgmap v1764: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2023-05-08T04:37:29.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3187.630611 secs 2023-05-08T04:37:29.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3188.186895 secs 2023-05-08T04:37:29.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:29 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:37:29.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:29 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:37:29.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:29 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:37:29.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:29 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:37:29.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:29 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T04:37:29.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:29 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T04:37:29.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:29 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:37:29.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:29 smithi096 ceph-mon[124666]: pgmap v1764: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2023-05-08T04:37:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:31 smithi186 ceph-mon[126480]: pgmap v1765: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T04:37:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:31 smithi133 ceph-mon[125939]: pgmap v1765: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T04:37:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:31 smithi096 ceph-mon[124666]: pgmap v1765: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T04:37:33.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:33 smithi186 ceph-mon[126480]: pgmap v1766: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:37:33.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:33 smithi133 ceph-mon[125939]: pgmap v1766: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:37:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:33 smithi096 ceph-mon[124666]: pgmap v1766: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:37:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3192.630723 secs 2023-05-08T04:37:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3193.187022 secs 2023-05-08T04:37:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:34 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:37:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3192.630723 secs 2023-05-08T04:37:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3193.187022 secs 2023-05-08T04:37:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:34 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:37:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3192.630723 secs 2023-05-08T04:37:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3193.187022 secs 2023-05-08T04:37:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:34 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:37:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:35 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:37:35.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:35 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:37:35.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:35 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:37:35.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3194.461824 secs 2023-05-08T04:37:35.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:35 smithi186 ceph-mon[126480]: pgmap v1767: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 71 KiB/s wr, 9 op/s 2023-05-08T04:37:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:35 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:37:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:35 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:37:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:35 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:37:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3194.461824 secs 2023-05-08T04:37:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:35 smithi133 ceph-mon[125939]: pgmap v1767: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 71 KiB/s wr, 9 op/s 2023-05-08T04:37:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:35 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:37:35.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:35 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:37:35.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:35 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:37:35.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3194.461824 secs 2023-05-08T04:37:35.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:35 smithi096 ceph-mon[124666]: pgmap v1767: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 71 KiB/s wr, 9 op/s 2023-05-08T04:37:37.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:37 smithi186 ceph-mon[126480]: pgmap v1768: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 71 KiB/s wr, 6 op/s 2023-05-08T04:37:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:37 smithi133 ceph-mon[125939]: pgmap v1768: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 71 KiB/s wr, 6 op/s 2023-05-08T04:37:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:37 smithi096 ceph-mon[124666]: pgmap v1768: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 71 KiB/s wr, 6 op/s 2023-05-08T04:37:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3197.630864 secs 2023-05-08T04:37:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:39 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:37:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:39 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:37:39.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3198.187148 secs 2023-05-08T04:37:39.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:39 smithi186 ceph-mon[126480]: pgmap v1769: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 71 KiB/s wr, 6 op/s 2023-05-08T04:37:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3197.630864 secs 2023-05-08T04:37:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:39 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:37:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:39 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:37:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3198.187148 secs 2023-05-08T04:37:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:39 smithi133 ceph-mon[125939]: pgmap v1769: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 71 KiB/s wr, 6 op/s 2023-05-08T04:37:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3197.630864 secs 2023-05-08T04:37:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:39 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:37:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:39 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:37:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3198.187148 secs 2023-05-08T04:37:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:39 smithi096 ceph-mon[124666]: pgmap v1769: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 71 KiB/s wr, 6 op/s 2023-05-08T04:37:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3199.461964 secs 2023-05-08T04:37:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3199.461964 secs 2023-05-08T04:37:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3199.461964 secs 2023-05-08T04:37:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:41 smithi186 ceph-mon[126480]: pgmap v1770: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 108 KiB/s wr, 10 op/s 2023-05-08T04:37:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:41 smithi133 ceph-mon[125939]: pgmap v1770: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 108 KiB/s wr, 10 op/s 2023-05-08T04:37:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:41 smithi096 ceph-mon[124666]: pgmap v1770: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 108 KiB/s wr, 10 op/s 2023-05-08T04:37:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:43 smithi186 ceph-mon[126480]: pgmap v1771: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 108 KiB/s wr, 8 op/s 2023-05-08T04:37:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:43 smithi133 ceph-mon[125939]: pgmap v1771: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 108 KiB/s wr, 8 op/s 2023-05-08T04:37:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:43 smithi096 ceph-mon[124666]: pgmap v1771: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 108 KiB/s wr, 8 op/s 2023-05-08T04:37:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3202.630996 secs 2023-05-08T04:37:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:44 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:37:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3203.187292 secs 2023-05-08T04:37:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3202.630996 secs 2023-05-08T04:37:44.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:44 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:37:44.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3203.187292 secs 2023-05-08T04:37:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3202.630996 secs 2023-05-08T04:37:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:44 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:37:44.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3203.187292 secs 2023-05-08T04:37:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:45 smithi186 ceph-mon[126480]: pgmap v1772: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 108 KiB/s wr, 11 op/s 2023-05-08T04:37:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:45 smithi133 ceph-mon[125939]: pgmap v1772: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 108 KiB/s wr, 11 op/s 2023-05-08T04:37:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:45 smithi096 ceph-mon[124666]: pgmap v1772: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 108 KiB/s wr, 11 op/s 2023-05-08T04:37:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3204.462100 secs 2023-05-08T04:37:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3204.462100 secs 2023-05-08T04:37:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3204.462100 secs 2023-05-08T04:37:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:47 smithi186 ceph-mon[126480]: pgmap v1773: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 6 op/s 2023-05-08T04:37:47.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:47 smithi133 ceph-mon[125939]: pgmap v1773: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 6 op/s 2023-05-08T04:37:47.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:47 smithi096 ceph-mon[124666]: pgmap v1773: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 6 op/s 2023-05-08T04:37:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3207.631115 secs 2023-05-08T04:37:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3208.187408 secs 2023-05-08T04:37:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:49 smithi186 ceph-mon[126480]: pgmap v1774: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 6 op/s 2023-05-08T04:37:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3207.631115 secs 2023-05-08T04:37:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3208.187408 secs 2023-05-08T04:37:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:49 smithi133 ceph-mon[125939]: pgmap v1774: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 6 op/s 2023-05-08T04:37:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3207.631115 secs 2023-05-08T04:37:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3208.187408 secs 2023-05-08T04:37:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:49 smithi096 ceph-mon[124666]: pgmap v1774: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 6 op/s 2023-05-08T04:37:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3209.462190 secs 2023-05-08T04:37:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3209.462190 secs 2023-05-08T04:37:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3209.462190 secs 2023-05-08T04:37:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:51 smithi186 ceph-mon[126480]: pgmap v1775: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 46 KiB/s wr, 9 op/s 2023-05-08T04:37:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:51 smithi133 ceph-mon[125939]: pgmap v1775: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 46 KiB/s wr, 9 op/s 2023-05-08T04:37:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:51 smithi096 ceph-mon[124666]: pgmap v1775: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 46 KiB/s wr, 9 op/s 2023-05-08T04:37:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:53 smithi186 ceph-mon[126480]: pgmap v1776: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.4 KiB/s wr, 5 op/s 2023-05-08T04:37:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:53 smithi133 ceph-mon[125939]: pgmap v1776: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.4 KiB/s wr, 5 op/s 2023-05-08T04:37:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:53 smithi096 ceph-mon[124666]: pgmap v1776: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.4 KiB/s wr, 5 op/s 2023-05-08T04:37:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3212.631231 secs 2023-05-08T04:37:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3213.187545 secs 2023-05-08T04:37:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3212.631231 secs 2023-05-08T04:37:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3213.187545 secs 2023-05-08T04:37:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3212.631231 secs 2023-05-08T04:37:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3213.187545 secs 2023-05-08T04:37:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3214.462314 secs 2023-05-08T04:37:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:55 smithi186 ceph-mon[126480]: pgmap v1777: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.4 KiB/s wr, 8 op/s 2023-05-08T04:37:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3214.462314 secs 2023-05-08T04:37:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:55 smithi133 ceph-mon[125939]: pgmap v1777: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.4 KiB/s wr, 8 op/s 2023-05-08T04:37:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3214.462314 secs 2023-05-08T04:37:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:55 smithi096 ceph-mon[124666]: pgmap v1777: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.4 KiB/s wr, 8 op/s 2023-05-08T04:37:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:57 smithi186 ceph-mon[126480]: pgmap v1778: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.2 KiB/s wr, 5 op/s 2023-05-08T04:37:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:57 smithi133 ceph-mon[125939]: pgmap v1778: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.2 KiB/s wr, 5 op/s 2023-05-08T04:37:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:57 smithi096 ceph-mon[124666]: pgmap v1778: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.2 KiB/s wr, 5 op/s 2023-05-08T04:37:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3217.631365 secs 2023-05-08T04:37:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3218.187667 secs 2023-05-08T04:37:59.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:37:59 smithi186 ceph-mon[126480]: pgmap v1779: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.2 KiB/s wr, 5 op/s 2023-05-08T04:37:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3217.631365 secs 2023-05-08T04:37:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3218.187667 secs 2023-05-08T04:37:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:37:59 smithi133 ceph-mon[125939]: pgmap v1779: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.2 KiB/s wr, 5 op/s 2023-05-08T04:37:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3217.631365 secs 2023-05-08T04:37:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3218.187667 secs 2023-05-08T04:37:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:37:59 smithi096 ceph-mon[124666]: pgmap v1779: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.2 KiB/s wr, 5 op/s 2023-05-08T04:38:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3219.462393 secs 2023-05-08T04:38:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3219.462393 secs 2023-05-08T04:38:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3219.462393 secs 2023-05-08T04:38:01.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:01 smithi186 ceph-mon[126480]: pgmap v1780: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.2 KiB/s wr, 7 op/s 2023-05-08T04:38:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:01 smithi133 ceph-mon[125939]: pgmap v1780: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.2 KiB/s wr, 7 op/s 2023-05-08T04:38:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:01 smithi096 ceph-mon[124666]: pgmap v1780: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.2 KiB/s wr, 7 op/s 2023-05-08T04:38:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:03 smithi186 ceph-mon[126480]: pgmap v1781: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:38:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:03 smithi133 ceph-mon[125939]: pgmap v1781: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:38:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:03 smithi096 ceph-mon[124666]: pgmap v1781: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:38:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3222.631479 secs 2023-05-08T04:38:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3223.187740 secs 2023-05-08T04:38:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3222.631479 secs 2023-05-08T04:38:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3223.187740 secs 2023-05-08T04:38:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3222.631479 secs 2023-05-08T04:38:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3223.187740 secs 2023-05-08T04:38:05.536 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3224.462531 secs 2023-05-08T04:38:05.536 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:05 smithi186 ceph-mon[126480]: pgmap v1782: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:38:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3224.462531 secs 2023-05-08T04:38:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:05 smithi133 ceph-mon[125939]: pgmap v1782: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:38:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3224.462531 secs 2023-05-08T04:38:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:05 smithi096 ceph-mon[124666]: pgmap v1782: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:38:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:07 smithi186 ceph-mon[126480]: pgmap v1783: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:38:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:07 smithi133 ceph-mon[125939]: pgmap v1783: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:38:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:07 smithi096 ceph-mon[124666]: pgmap v1783: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:38:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3227.631595 secs 2023-05-08T04:38:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3228.187888 secs 2023-05-08T04:38:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:09 smithi186 ceph-mon[126480]: pgmap v1784: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:38:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3227.631595 secs 2023-05-08T04:38:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3228.187888 secs 2023-05-08T04:38:09.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:09 smithi133 ceph-mon[125939]: pgmap v1784: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:38:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3227.631595 secs 2023-05-08T04:38:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3228.187888 secs 2023-05-08T04:38:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:09 smithi096 ceph-mon[124666]: pgmap v1784: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:38:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3229.462645 secs 2023-05-08T04:38:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3229.462645 secs 2023-05-08T04:38:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3229.462645 secs 2023-05-08T04:38:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:11 smithi186 ceph-mon[126480]: osdmap e192: 12 total, 12 up, 12 in 2023-05-08T04:38:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:11 smithi186 ceph-mon[126480]: pgmap v1786: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:38:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:11 smithi133 ceph-mon[125939]: osdmap e192: 12 total, 12 up, 12 in 2023-05-08T04:38:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:11 smithi133 ceph-mon[125939]: pgmap v1786: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:38:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:11 smithi096 ceph-mon[124666]: osdmap e192: 12 total, 12 up, 12 in 2023-05-08T04:38:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:11 smithi096 ceph-mon[124666]: pgmap v1786: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:38:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:13 smithi186 ceph-mon[126480]: pgmap v1787: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:38:13.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:13 smithi133 ceph-mon[125939]: pgmap v1787: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:38:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:13 smithi096 ceph-mon[124666]: pgmap v1787: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:38:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3232.631706 secs 2023-05-08T04:38:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3233.188030 secs 2023-05-08T04:38:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3232.631706 secs 2023-05-08T04:38:14.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3233.188030 secs 2023-05-08T04:38:14.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3232.631706 secs 2023-05-08T04:38:14.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3233.188030 secs 2023-05-08T04:38:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3234.462771 secs 2023-05-08T04:38:15.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:15 smithi186 ceph-mon[126480]: pgmap v1788: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:38:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3234.462771 secs 2023-05-08T04:38:15.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:15 smithi133 ceph-mon[125939]: pgmap v1788: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:38:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3234.462771 secs 2023-05-08T04:38:15.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:15 smithi096 ceph-mon[124666]: pgmap v1788: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:38:17.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:17 smithi186 ceph-mon[126480]: pgmap v1789: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:38:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:17 smithi133 ceph-mon[125939]: pgmap v1789: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:38:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:17 smithi096 ceph-mon[124666]: pgmap v1789: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:38:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3237.631823 secs 2023-05-08T04:38:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:19 smithi186 ceph-mon[126480]: osdmap e193: 12 total, 12 up, 12 in 2023-05-08T04:38:19.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3238.188178 secs 2023-05-08T04:38:19.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:19 smithi186 ceph-mon[126480]: pgmap v1791: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:38:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3237.631823 secs 2023-05-08T04:38:19.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:19 smithi133 ceph-mon[125939]: osdmap e193: 12 total, 12 up, 12 in 2023-05-08T04:38:19.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3238.188178 secs 2023-05-08T04:38:19.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:19 smithi133 ceph-mon[125939]: pgmap v1791: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:38:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3237.631823 secs 2023-05-08T04:38:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:19 smithi096 ceph-mon[124666]: osdmap e193: 12 total, 12 up, 12 in 2023-05-08T04:38:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3238.188178 secs 2023-05-08T04:38:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:19 smithi096 ceph-mon[124666]: pgmap v1791: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:38:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3239.462847 secs 2023-05-08T04:38:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3239.462847 secs 2023-05-08T04:38:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3239.462847 secs 2023-05-08T04:38:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:21 smithi186 ceph-mon[126480]: pgmap v1792: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:38:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:21 smithi133 ceph-mon[125939]: pgmap v1792: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:38:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:21 smithi096 ceph-mon[124666]: pgmap v1792: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:38:23.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:23 smithi186 ceph-mon[126480]: pgmap v1793: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:38:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:23 smithi133 ceph-mon[125939]: pgmap v1793: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:38:23.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:23 smithi096 ceph-mon[124666]: pgmap v1793: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:38:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3242.631944 secs 2023-05-08T04:38:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3243.188301 secs 2023-05-08T04:38:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3242.631944 secs 2023-05-08T04:38:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3243.188301 secs 2023-05-08T04:38:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3242.631944 secs 2023-05-08T04:38:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3243.188301 secs 2023-05-08T04:38:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3244.462966 secs 2023-05-08T04:38:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:25 smithi186 ceph-mon[126480]: pgmap v1794: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:38:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3244.462966 secs 2023-05-08T04:38:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:25 smithi133 ceph-mon[125939]: pgmap v1794: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:38:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3244.462966 secs 2023-05-08T04:38:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:25 smithi096 ceph-mon[124666]: pgmap v1794: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:38:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:27 smithi186 ceph-mon[126480]: pgmap v1795: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:38:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:27 smithi133 ceph-mon[125939]: pgmap v1795: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:38:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:27 smithi096 ceph-mon[124666]: pgmap v1795: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:38:29.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3247.632042 secs 2023-05-08T04:38:29.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3248.188404 secs 2023-05-08T04:38:29.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:29 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:38:29.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:29 smithi186 ceph-mon[126480]: pgmap v1796: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2023-05-08T04:38:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3247.632042 secs 2023-05-08T04:38:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3248.188404 secs 2023-05-08T04:38:29.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:29 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:38:29.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:29 smithi133 ceph-mon[125939]: pgmap v1796: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2023-05-08T04:38:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3247.632042 secs 2023-05-08T04:38:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3248.188404 secs 2023-05-08T04:38:29.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:29 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:38:29.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:29 smithi096 ceph-mon[124666]: pgmap v1796: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2023-05-08T04:38:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:38:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:38:30.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:30 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:38:30.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:38:30.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:30 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T04:38:30.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:30 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T04:38:30.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:30 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:38:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:38:30.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:38:30.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:30 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:38:30.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:38:30.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:30 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T04:38:30.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:30 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T04:38:30.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:30 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:38:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:38:30.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:38:30.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:30 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:38:30.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:38:30.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:30 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T04:38:30.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:30 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T04:38:30.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:30 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:38:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:31 smithi186 ceph-mon[126480]: pgmap v1797: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T04:38:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:31 smithi133 ceph-mon[125939]: pgmap v1797: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T04:38:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:31 smithi096 ceph-mon[124666]: pgmap v1797: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T04:38:33.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:33 smithi186 ceph-mon[126480]: pgmap v1798: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:38:33.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:33 smithi133 ceph-mon[125939]: pgmap v1798: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:38:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:33 smithi096 ceph-mon[124666]: pgmap v1798: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:38:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3252.632128 secs 2023-05-08T04:38:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3253.188532 secs 2023-05-08T04:38:34.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:34 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:38:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3252.632128 secs 2023-05-08T04:38:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3253.188532 secs 2023-05-08T04:38:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:34 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:38:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3252.632128 secs 2023-05-08T04:38:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3253.188532 secs 2023-05-08T04:38:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:34 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:38:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:35 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:38:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:35 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:38:35.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:35 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:38:35.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3254.466801 secs 2023-05-08T04:38:35.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:35 smithi186 ceph-mon[126480]: pgmap v1799: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 73 KiB/s wr, 9 op/s 2023-05-08T04:38:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:35 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:38:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:35 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:38:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:35 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:38:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3254.466801 secs 2023-05-08T04:38:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:35 smithi133 ceph-mon[125939]: pgmap v1799: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 73 KiB/s wr, 9 op/s 2023-05-08T04:38:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:35 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:38:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:35 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:38:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:35 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:38:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3254.466801 secs 2023-05-08T04:38:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:35 smithi096 ceph-mon[124666]: pgmap v1799: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 73 KiB/s wr, 9 op/s 2023-05-08T04:38:37.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:37 smithi186 ceph-mon[126480]: pgmap v1800: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 73 KiB/s wr, 6 op/s 2023-05-08T04:38:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:37 smithi133 ceph-mon[125939]: pgmap v1800: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 73 KiB/s wr, 6 op/s 2023-05-08T04:38:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:37 smithi096 ceph-mon[124666]: pgmap v1800: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 73 KiB/s wr, 6 op/s 2023-05-08T04:38:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3257.632268 secs 2023-05-08T04:38:39.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:39 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:38:39.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:39 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:38:39.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3258.188657 secs 2023-05-08T04:38:39.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:39 smithi186 ceph-mon[126480]: pgmap v1801: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 73 KiB/s wr, 6 op/s 2023-05-08T04:38:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3257.632268 secs 2023-05-08T04:38:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:39 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:38:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:39 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:38:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3258.188657 secs 2023-05-08T04:38:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:39 smithi133 ceph-mon[125939]: pgmap v1801: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 73 KiB/s wr, 6 op/s 2023-05-08T04:38:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3257.632268 secs 2023-05-08T04:38:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:39 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:38:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:39 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:38:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3258.188657 secs 2023-05-08T04:38:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:39 smithi096 ceph-mon[124666]: pgmap v1801: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 73 KiB/s wr, 6 op/s 2023-05-08T04:38:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3259.466899 secs 2023-05-08T04:38:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3259.466899 secs 2023-05-08T04:38:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3259.466899 secs 2023-05-08T04:38:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:41 smithi186 ceph-mon[126480]: pgmap v1802: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 108 KiB/s wr, 10 op/s 2023-05-08T04:38:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:41 smithi133 ceph-mon[125939]: pgmap v1802: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 108 KiB/s wr, 10 op/s 2023-05-08T04:38:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:41 smithi096 ceph-mon[124666]: pgmap v1802: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 108 KiB/s wr, 10 op/s 2023-05-08T04:38:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:43 smithi186 ceph-mon[126480]: pgmap v1803: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 108 KiB/s wr, 8 op/s 2023-05-08T04:38:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:43 smithi133 ceph-mon[125939]: pgmap v1803: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 108 KiB/s wr, 8 op/s 2023-05-08T04:38:43.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:43 smithi096 ceph-mon[124666]: pgmap v1803: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 108 KiB/s wr, 8 op/s 2023-05-08T04:38:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3262.632404 secs 2023-05-08T04:38:44.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:44 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:38:44.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3263.188756 secs 2023-05-08T04:38:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3262.632404 secs 2023-05-08T04:38:44.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:44 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:38:44.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3263.188756 secs 2023-05-08T04:38:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3262.632404 secs 2023-05-08T04:38:44.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:44 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:38:44.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3263.188756 secs 2023-05-08T04:38:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:45 smithi186 ceph-mon[126480]: pgmap v1804: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 108 KiB/s wr, 11 op/s 2023-05-08T04:38:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:45 smithi133 ceph-mon[125939]: pgmap v1804: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 108 KiB/s wr, 11 op/s 2023-05-08T04:38:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:45 smithi096 ceph-mon[124666]: pgmap v1804: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 108 KiB/s wr, 11 op/s 2023-05-08T04:38:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3264.466964 secs 2023-05-08T04:38:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3264.466964 secs 2023-05-08T04:38:46.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3264.466964 secs 2023-05-08T04:38:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:47 smithi186 ceph-mon[126480]: pgmap v1805: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 7 op/s 2023-05-08T04:38:47.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:47 smithi133 ceph-mon[125939]: pgmap v1805: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 7 op/s 2023-05-08T04:38:47.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:47 smithi096 ceph-mon[124666]: pgmap v1805: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 7 op/s 2023-05-08T04:38:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3267.632553 secs 2023-05-08T04:38:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3268.188880 secs 2023-05-08T04:38:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:49 smithi186 ceph-mon[126480]: pgmap v1806: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 6 op/s 2023-05-08T04:38:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3267.632553 secs 2023-05-08T04:38:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3268.188880 secs 2023-05-08T04:38:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:49 smithi133 ceph-mon[125939]: pgmap v1806: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 6 op/s 2023-05-08T04:38:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3267.632553 secs 2023-05-08T04:38:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3268.188880 secs 2023-05-08T04:38:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:49 smithi096 ceph-mon[124666]: pgmap v1806: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 6 op/s 2023-05-08T04:38:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3269.467030 secs 2023-05-08T04:38:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3269.467030 secs 2023-05-08T04:38:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3269.467030 secs 2023-05-08T04:38:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:51 smithi186 ceph-mon[126480]: pgmap v1807: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 52 KiB/s wr, 10 op/s 2023-05-08T04:38:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:51 smithi133 ceph-mon[125939]: pgmap v1807: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 52 KiB/s wr, 10 op/s 2023-05-08T04:38:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:51 smithi096 ceph-mon[124666]: pgmap v1807: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 52 KiB/s wr, 10 op/s 2023-05-08T04:38:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:53 smithi186 ceph-mon[126480]: pgmap v1808: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 6 op/s 2023-05-08T04:38:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:53 smithi133 ceph-mon[125939]: pgmap v1808: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 6 op/s 2023-05-08T04:38:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:53 smithi096 ceph-mon[124666]: pgmap v1808: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 6 op/s 2023-05-08T04:38:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3272.632679 secs 2023-05-08T04:38:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3273.188960 secs 2023-05-08T04:38:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3272.632679 secs 2023-05-08T04:38:54.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3273.188960 secs 2023-05-08T04:38:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3272.632679 secs 2023-05-08T04:38:54.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3273.188960 secs 2023-05-08T04:38:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3274.467098 secs 2023-05-08T04:38:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:55 smithi186 ceph-mon[126480]: pgmap v1809: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 17 KiB/s wr, 9 op/s 2023-05-08T04:38:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3274.467098 secs 2023-05-08T04:38:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:55 smithi133 ceph-mon[125939]: pgmap v1809: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 17 KiB/s wr, 9 op/s 2023-05-08T04:38:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3274.467098 secs 2023-05-08T04:38:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:55 smithi096 ceph-mon[124666]: pgmap v1809: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 17 KiB/s wr, 9 op/s 2023-05-08T04:38:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:57 smithi186 ceph-mon[126480]: pgmap v1810: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 6 op/s 2023-05-08T04:38:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:57 smithi133 ceph-mon[125939]: pgmap v1810: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 6 op/s 2023-05-08T04:38:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:57 smithi096 ceph-mon[124666]: pgmap v1810: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 6 op/s 2023-05-08T04:38:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3277.632797 secs 2023-05-08T04:38:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3278.189083 secs 2023-05-08T04:38:59.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:38:59 smithi186 ceph-mon[126480]: pgmap v1811: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 6 op/s 2023-05-08T04:38:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3277.632797 secs 2023-05-08T04:38:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3278.189083 secs 2023-05-08T04:38:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:38:59 smithi133 ceph-mon[125939]: pgmap v1811: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 6 op/s 2023-05-08T04:38:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3277.632797 secs 2023-05-08T04:38:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3278.189083 secs 2023-05-08T04:38:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:38:59 smithi096 ceph-mon[124666]: pgmap v1811: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 6 op/s 2023-05-08T04:39:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3279.467216 secs 2023-05-08T04:39:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3279.467216 secs 2023-05-08T04:39:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3279.467216 secs 2023-05-08T04:39:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:01 smithi186 ceph-mon[126480]: pgmap v1812: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 46 KiB/s wr, 9 op/s 2023-05-08T04:39:01.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:01 smithi133 ceph-mon[125939]: pgmap v1812: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 46 KiB/s wr, 9 op/s 2023-05-08T04:39:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:01 smithi096 ceph-mon[124666]: pgmap v1812: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 46 KiB/s wr, 9 op/s 2023-05-08T04:39:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:03 smithi186 ceph-mon[126480]: pgmap v1813: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 5 op/s 2023-05-08T04:39:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:03 smithi133 ceph-mon[125939]: pgmap v1813: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 5 op/s 2023-05-08T04:39:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:03 smithi096 ceph-mon[124666]: pgmap v1813: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 5 op/s 2023-05-08T04:39:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3282.632931 secs 2023-05-08T04:39:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3283.189207 secs 2023-05-08T04:39:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3282.632931 secs 2023-05-08T04:39:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3283.189207 secs 2023-05-08T04:39:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3282.632931 secs 2023-05-08T04:39:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3283.189207 secs 2023-05-08T04:39:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3284.467333 secs 2023-05-08T04:39:05.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:05 smithi186 ceph-mon[126480]: pgmap v1814: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 73 KiB/s wr, 23 op/s 2023-05-08T04:39:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3284.467333 secs 2023-05-08T04:39:05.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:05 smithi133 ceph-mon[125939]: pgmap v1814: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 73 KiB/s wr, 23 op/s 2023-05-08T04:39:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3284.467333 secs 2023-05-08T04:39:05.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:05 smithi096 ceph-mon[124666]: pgmap v1814: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 73 KiB/s wr, 23 op/s 2023-05-08T04:39:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:07 smithi186 ceph-mon[126480]: pgmap v1815: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 73 KiB/s wr, 20 op/s 2023-05-08T04:39:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:07 smithi133 ceph-mon[125939]: pgmap v1815: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 73 KiB/s wr, 20 op/s 2023-05-08T04:39:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:07 smithi096 ceph-mon[124666]: pgmap v1815: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 73 KiB/s wr, 20 op/s 2023-05-08T04:39:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3287.633051 secs 2023-05-08T04:39:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3288.189284 secs 2023-05-08T04:39:09.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:09 smithi186 ceph-mon[126480]: pgmap v1816: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 73 KiB/s wr, 20 op/s 2023-05-08T04:39:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3287.633051 secs 2023-05-08T04:39:09.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3288.189284 secs 2023-05-08T04:39:09.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:09 smithi133 ceph-mon[125939]: pgmap v1816: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 73 KiB/s wr, 20 op/s 2023-05-08T04:39:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3287.633051 secs 2023-05-08T04:39:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3288.189284 secs 2023-05-08T04:39:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:09 smithi096 ceph-mon[124666]: pgmap v1816: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 73 KiB/s wr, 20 op/s 2023-05-08T04:39:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3289.467450 secs 2023-05-08T04:39:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3289.467450 secs 2023-05-08T04:39:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3289.467450 secs 2023-05-08T04:39:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:11 smithi186 ceph-mon[126480]: osdmap e194: 12 total, 12 up, 12 in 2023-05-08T04:39:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:11 smithi186 ceph-mon[126480]: pgmap v1818: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T04:39:11.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:11 smithi133 ceph-mon[125939]: osdmap e194: 12 total, 12 up, 12 in 2023-05-08T04:39:11.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:11 smithi133 ceph-mon[125939]: pgmap v1818: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T04:39:11.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:11 smithi096 ceph-mon[124666]: osdmap e194: 12 total, 12 up, 12 in 2023-05-08T04:39:11.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:11 smithi096 ceph-mon[124666]: pgmap v1818: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T04:39:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:13 smithi186 ceph-mon[126480]: pgmap v1819: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T04:39:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:13 smithi133 ceph-mon[125939]: pgmap v1819: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T04:39:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:13 smithi096 ceph-mon[124666]: pgmap v1819: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T04:39:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3292.633169 secs 2023-05-08T04:39:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3293.189431 secs 2023-05-08T04:39:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3292.633169 secs 2023-05-08T04:39:14.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3293.189431 secs 2023-05-08T04:39:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3292.633169 secs 2023-05-08T04:39:14.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3293.189431 secs 2023-05-08T04:39:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3294.467587 secs 2023-05-08T04:39:15.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:15 smithi186 ceph-mon[126480]: pgmap v1820: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:39:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3294.467587 secs 2023-05-08T04:39:15.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:15 smithi133 ceph-mon[125939]: pgmap v1820: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:39:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3294.467587 secs 2023-05-08T04:39:15.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:15 smithi096 ceph-mon[124666]: pgmap v1820: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:39:17.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:17 smithi186 ceph-mon[126480]: pgmap v1821: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:39:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:17 smithi133 ceph-mon[125939]: pgmap v1821: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:39:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:17 smithi096 ceph-mon[124666]: pgmap v1821: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:39:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3297.633266 secs 2023-05-08T04:39:19.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:19 smithi186 ceph-mon[126480]: osdmap e195: 12 total, 12 up, 12 in 2023-05-08T04:39:19.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3298.189543 secs 2023-05-08T04:39:19.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:19 smithi186 ceph-mon[126480]: pgmap v1823: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:39:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3297.633266 secs 2023-05-08T04:39:19.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:19 smithi133 ceph-mon[125939]: osdmap e195: 12 total, 12 up, 12 in 2023-05-08T04:39:19.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3298.189543 secs 2023-05-08T04:39:19.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:19 smithi133 ceph-mon[125939]: pgmap v1823: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:39:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3297.633266 secs 2023-05-08T04:39:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:19 smithi096 ceph-mon[124666]: osdmap e195: 12 total, 12 up, 12 in 2023-05-08T04:39:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3298.189543 secs 2023-05-08T04:39:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:19 smithi096 ceph-mon[124666]: pgmap v1823: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:39:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3299.467706 secs 2023-05-08T04:39:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3299.467706 secs 2023-05-08T04:39:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3299.467706 secs 2023-05-08T04:39:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:21 smithi186 ceph-mon[126480]: pgmap v1824: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:39:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:21 smithi133 ceph-mon[125939]: pgmap v1824: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:39:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:21 smithi096 ceph-mon[124666]: pgmap v1824: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:39:23.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:23 smithi186 ceph-mon[126480]: pgmap v1825: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:39:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:23 smithi133 ceph-mon[125939]: pgmap v1825: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:39:23.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:23 smithi096 ceph-mon[124666]: pgmap v1825: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:39:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3302.633383 secs 2023-05-08T04:39:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3303.189631 secs 2023-05-08T04:39:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3302.633383 secs 2023-05-08T04:39:24.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3303.189631 secs 2023-05-08T04:39:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3302.633383 secs 2023-05-08T04:39:24.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3303.189631 secs 2023-05-08T04:39:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3304.467863 secs 2023-05-08T04:39:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:25 smithi186 ceph-mon[126480]: pgmap v1826: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:39:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3304.467863 secs 2023-05-08T04:39:25.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:25 smithi133 ceph-mon[125939]: pgmap v1826: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:39:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3304.467863 secs 2023-05-08T04:39:25.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:25 smithi096 ceph-mon[124666]: pgmap v1826: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:39:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:27 smithi186 ceph-mon[126480]: pgmap v1827: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:39:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:27 smithi133 ceph-mon[125939]: pgmap v1827: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:39:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:27 smithi096 ceph-mon[124666]: pgmap v1827: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:39:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3307.633500 secs 2023-05-08T04:39:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3308.189758 secs 2023-05-08T04:39:29.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:29 smithi186 ceph-mon[126480]: pgmap v1828: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2023-05-08T04:39:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3307.633500 secs 2023-05-08T04:39:29.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3308.189758 secs 2023-05-08T04:39:29.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:29 smithi133 ceph-mon[125939]: pgmap v1828: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2023-05-08T04:39:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3307.633500 secs 2023-05-08T04:39:29.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3308.189758 secs 2023-05-08T04:39:29.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:29 smithi096 ceph-mon[124666]: pgmap v1828: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2023-05-08T04:39:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:39:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:39:30.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:39:30.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:39:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:39:30.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:39:30.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:39:30.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:39:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:39:30.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:39:30.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:39:30.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:39:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:31 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:39:31.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:31 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T04:39:31.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:31 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T04:39:31.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:31 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:39:31.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:31 smithi186 ceph-mon[126480]: pgmap v1829: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T04:39:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:31 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:39:31.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:31 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T04:39:31.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:31 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T04:39:31.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:31 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:39:31.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:31 smithi133 ceph-mon[125939]: pgmap v1829: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T04:39:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:31 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:39:31.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:31 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T04:39:31.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:31 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T04:39:31.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:31 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:39:31.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:31 smithi096 ceph-mon[124666]: pgmap v1829: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T04:39:33.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:33 smithi186 ceph-mon[126480]: pgmap v1830: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:39:33.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:33 smithi133 ceph-mon[125939]: pgmap v1830: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:39:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:33 smithi096 ceph-mon[124666]: pgmap v1830: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:39:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3312.633616 secs 2023-05-08T04:39:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3313.189878 secs 2023-05-08T04:39:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:34 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:39:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3312.633616 secs 2023-05-08T04:39:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3313.189878 secs 2023-05-08T04:39:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:34 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:39:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3312.633616 secs 2023-05-08T04:39:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3313.189878 secs 2023-05-08T04:39:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:34 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:39:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:35 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:39:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:35 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:39:35.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:35 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:39:35.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3314.468035 secs 2023-05-08T04:39:35.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:35 smithi186 ceph-mon[126480]: pgmap v1831: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 76 KiB/s wr, 9 op/s 2023-05-08T04:39:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:35 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:39:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:35 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:39:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:35 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:39:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3314.468035 secs 2023-05-08T04:39:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:35 smithi133 ceph-mon[125939]: pgmap v1831: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 76 KiB/s wr, 9 op/s 2023-05-08T04:39:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:35 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:39:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:35 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:39:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:35 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:39:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3314.468035 secs 2023-05-08T04:39:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:35 smithi096 ceph-mon[124666]: pgmap v1831: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 76 KiB/s wr, 9 op/s 2023-05-08T04:39:37.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:37 smithi186 ceph-mon[126480]: pgmap v1832: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 76 KiB/s wr, 6 op/s 2023-05-08T04:39:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:37 smithi133 ceph-mon[125939]: pgmap v1832: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 76 KiB/s wr, 6 op/s 2023-05-08T04:39:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:37 smithi096 ceph-mon[124666]: pgmap v1832: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 76 KiB/s wr, 6 op/s 2023-05-08T04:39:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3317.633732 secs 2023-05-08T04:39:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:39 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:39:39.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:39 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:39:39.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3318.190014 secs 2023-05-08T04:39:39.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:39 smithi186 ceph-mon[126480]: pgmap v1833: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 76 KiB/s wr, 6 op/s 2023-05-08T04:39:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3317.633732 secs 2023-05-08T04:39:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:39 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:39:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:39 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:39:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3318.190014 secs 2023-05-08T04:39:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:39 smithi133 ceph-mon[125939]: pgmap v1833: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 76 KiB/s wr, 6 op/s 2023-05-08T04:39:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3317.633732 secs 2023-05-08T04:39:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:39 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:39:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:39 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:39:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3318.190014 secs 2023-05-08T04:39:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:39 smithi096 ceph-mon[124666]: pgmap v1833: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 76 KiB/s wr, 6 op/s 2023-05-08T04:39:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3319.468154 secs 2023-05-08T04:39:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3319.468154 secs 2023-05-08T04:39:40.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3319.468154 secs 2023-05-08T04:39:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:41 smithi186 ceph-mon[126480]: pgmap v1834: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 110 KiB/s wr, 10 op/s 2023-05-08T04:39:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:41 smithi133 ceph-mon[125939]: pgmap v1834: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 110 KiB/s wr, 10 op/s 2023-05-08T04:39:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:41 smithi096 ceph-mon[124666]: pgmap v1834: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 110 KiB/s wr, 10 op/s 2023-05-08T04:39:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:43 smithi186 ceph-mon[126480]: pgmap v1835: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 110 KiB/s wr, 8 op/s 2023-05-08T04:39:43.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:43 smithi133 ceph-mon[125939]: pgmap v1835: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 110 KiB/s wr, 8 op/s 2023-05-08T04:39:43.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:43 smithi096 ceph-mon[124666]: pgmap v1835: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 110 KiB/s wr, 8 op/s 2023-05-08T04:39:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3322.633853 secs 2023-05-08T04:39:44.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:44 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:39:44.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3323.190162 secs 2023-05-08T04:39:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3322.633853 secs 2023-05-08T04:39:44.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:44 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:39:44.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3323.190162 secs 2023-05-08T04:39:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3322.633853 secs 2023-05-08T04:39:44.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:44 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:39:44.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3323.190162 secs 2023-05-08T04:39:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:45 smithi186 ceph-mon[126480]: pgmap v1836: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 111 KiB/s wr, 10 op/s 2023-05-08T04:39:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:45 smithi133 ceph-mon[125939]: pgmap v1836: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 111 KiB/s wr, 10 op/s 2023-05-08T04:39:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:45 smithi096 ceph-mon[124666]: pgmap v1836: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 111 KiB/s wr, 10 op/s 2023-05-08T04:39:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3324.468263 secs 2023-05-08T04:39:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3324.468263 secs 2023-05-08T04:39:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3324.468263 secs 2023-05-08T04:39:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:47 smithi186 ceph-mon[126480]: pgmap v1837: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T04:39:47.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:47 smithi133 ceph-mon[125939]: pgmap v1837: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T04:39:47.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:47 smithi096 ceph-mon[124666]: pgmap v1837: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T04:39:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3327.633970 secs 2023-05-08T04:39:49.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3328.190302 secs 2023-05-08T04:39:49.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:49 smithi186 ceph-mon[126480]: pgmap v1838: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T04:39:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3327.633970 secs 2023-05-08T04:39:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3328.190302 secs 2023-05-08T04:39:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:49 smithi133 ceph-mon[125939]: pgmap v1838: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T04:39:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3327.633970 secs 2023-05-08T04:39:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3328.190302 secs 2023-05-08T04:39:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:49 smithi096 ceph-mon[124666]: pgmap v1838: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T04:39:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3329.468326 secs 2023-05-08T04:39:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3329.468326 secs 2023-05-08T04:39:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3329.468326 secs 2023-05-08T04:39:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:51 smithi133 ceph-mon[125939]: pgmap v1839: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 44 KiB/s wr, 9 op/s 2023-05-08T04:39:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:51 smithi096 ceph-mon[124666]: pgmap v1839: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 44 KiB/s wr, 9 op/s 2023-05-08T04:39:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:51 smithi186 ceph-mon[126480]: pgmap v1839: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 44 KiB/s wr, 9 op/s 2023-05-08T04:39:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:53 smithi186 ceph-mon[126480]: pgmap v1840: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.7 KiB/s wr, 5 op/s 2023-05-08T04:39:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:53 smithi133 ceph-mon[125939]: pgmap v1840: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.7 KiB/s wr, 5 op/s 2023-05-08T04:39:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:53 smithi096 ceph-mon[124666]: pgmap v1840: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.7 KiB/s wr, 5 op/s 2023-05-08T04:39:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3332.634101 secs 2023-05-08T04:39:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3333.190427 secs 2023-05-08T04:39:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3332.634101 secs 2023-05-08T04:39:54.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3333.190427 secs 2023-05-08T04:39:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3332.634101 secs 2023-05-08T04:39:54.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3333.190427 secs 2023-05-08T04:39:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3334.468465 secs 2023-05-08T04:39:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:55 smithi186 ceph-mon[126480]: pgmap v1841: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.7 KiB/s wr, 7 op/s 2023-05-08T04:39:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3334.468465 secs 2023-05-08T04:39:55.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:55 smithi133 ceph-mon[125939]: pgmap v1841: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.7 KiB/s wr, 7 op/s 2023-05-08T04:39:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3334.468465 secs 2023-05-08T04:39:55.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:55 smithi096 ceph-mon[124666]: pgmap v1841: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.7 KiB/s wr, 7 op/s 2023-05-08T04:39:57.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:57 smithi186 ceph-mon[126480]: pgmap v1842: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.6 KiB/s wr, 5 op/s 2023-05-08T04:39:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:57 smithi133 ceph-mon[125939]: pgmap v1842: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.6 KiB/s wr, 5 op/s 2023-05-08T04:39:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:57 smithi096 ceph-mon[124666]: pgmap v1842: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.6 KiB/s wr, 5 op/s 2023-05-08T04:39:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3337.634218 secs 2023-05-08T04:39:59.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:39:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3338.190514 secs 2023-05-08T04:39:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3337.634218 secs 2023-05-08T04:39:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:39:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3338.190514 secs 2023-05-08T04:39:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3337.634218 secs 2023-05-08T04:39:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:39:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3338.190514 secs 2023-05-08T04:40:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:00 smithi186 ceph-mon[126480]: pgmap v1843: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.6 KiB/s wr, 5 op/s 2023-05-08T04:40:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3339.468589 secs 2023-05-08T04:40:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:00 smithi186 ceph-mon[126480]: overall HEALTH_WARN 3 MDSs report slow requests 2023-05-08T04:40:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:00 smithi133 ceph-mon[125939]: pgmap v1843: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.6 KiB/s wr, 5 op/s 2023-05-08T04:40:00.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3339.468589 secs 2023-05-08T04:40:00.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:00 smithi133 ceph-mon[125939]: overall HEALTH_WARN 3 MDSs report slow requests 2023-05-08T04:40:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:00 smithi096 ceph-mon[124666]: pgmap v1843: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.6 KiB/s wr, 5 op/s 2023-05-08T04:40:00.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3339.468589 secs 2023-05-08T04:40:00.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:00 smithi096 ceph-mon[124666]: overall HEALTH_WARN 3 MDSs report slow requests 2023-05-08T04:40:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:02 smithi186 ceph-mon[126480]: pgmap v1844: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.6 KiB/s wr, 7 op/s 2023-05-08T04:40:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:02 smithi133 ceph-mon[125939]: pgmap v1844: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.6 KiB/s wr, 7 op/s 2023-05-08T04:40:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:02 smithi096 ceph-mon[124666]: pgmap v1844: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.6 KiB/s wr, 7 op/s 2023-05-08T04:40:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3342.634333 secs 2023-05-08T04:40:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:04 smithi186 ceph-mon[126480]: pgmap v1845: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:40:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3343.190602 secs 2023-05-08T04:40:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3342.634333 secs 2023-05-08T04:40:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:04 smithi133 ceph-mon[125939]: pgmap v1845: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:40:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3343.190602 secs 2023-05-08T04:40:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3342.634333 secs 2023-05-08T04:40:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:04 smithi096 ceph-mon[124666]: pgmap v1845: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:40:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3343.190602 secs 2023-05-08T04:40:05.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3344.468710 secs 2023-05-08T04:40:05.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3344.468710 secs 2023-05-08T04:40:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3344.468710 secs 2023-05-08T04:40:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:06 smithi133 ceph-mon[125939]: pgmap v1846: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:40:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:06 smithi096 ceph-mon[124666]: pgmap v1846: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:40:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:06 smithi186 ceph-mon[126480]: pgmap v1846: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:40:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:08 smithi133 ceph-mon[125939]: pgmap v1847: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:40:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:08 smithi096 ceph-mon[124666]: pgmap v1847: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:40:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:08 smithi186 ceph-mon[126480]: pgmap v1847: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:40:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3347.634456 secs 2023-05-08T04:40:09.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3348.190725 secs 2023-05-08T04:40:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3347.634456 secs 2023-05-08T04:40:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3348.190725 secs 2023-05-08T04:40:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3347.634456 secs 2023-05-08T04:40:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3348.190725 secs 2023-05-08T04:40:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:10 smithi133 ceph-mon[125939]: pgmap v1848: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:40:10.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3349.468828 secs 2023-05-08T04:40:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:10 smithi096 ceph-mon[124666]: pgmap v1848: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:40:10.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3349.468828 secs 2023-05-08T04:40:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:10 smithi186 ceph-mon[126480]: pgmap v1848: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:40:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3349.468828 secs 2023-05-08T04:40:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:11 smithi133 ceph-mon[125939]: osdmap e196: 12 total, 12 up, 12 in 2023-05-08T04:40:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:11 smithi096 ceph-mon[124666]: osdmap e196: 12 total, 12 up, 12 in 2023-05-08T04:40:11.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:11 smithi186 ceph-mon[126480]: osdmap e196: 12 total, 12 up, 12 in 2023-05-08T04:40:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:12 smithi133 ceph-mon[125939]: pgmap v1850: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:40:12.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:12 smithi096 ceph-mon[124666]: pgmap v1850: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:40:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:12 smithi186 ceph-mon[126480]: pgmap v1850: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:40:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3352.634568 secs 2023-05-08T04:40:14.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:14 smithi133 ceph-mon[125939]: pgmap v1851: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:40:14.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3353.190844 secs 2023-05-08T04:40:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3352.634568 secs 2023-05-08T04:40:14.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:14 smithi096 ceph-mon[124666]: pgmap v1851: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:40:14.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3353.190844 secs 2023-05-08T04:40:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3352.634568 secs 2023-05-08T04:40:14.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:14 smithi186 ceph-mon[126480]: pgmap v1851: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:40:14.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3353.190844 secs 2023-05-08T04:40:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3354.468967 secs 2023-05-08T04:40:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3354.468967 secs 2023-05-08T04:40:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3354.468967 secs 2023-05-08T04:40:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:16 smithi133 ceph-mon[125939]: pgmap v1852: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:40:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:16 smithi096 ceph-mon[124666]: pgmap v1852: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:40:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:16 smithi186 ceph-mon[126480]: pgmap v1852: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:40:18.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:18 smithi133 ceph-mon[125939]: pgmap v1853: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:40:18.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:18 smithi133 ceph-mon[125939]: osdmap e197: 12 total, 12 up, 12 in 2023-05-08T04:40:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:18 smithi096 ceph-mon[124666]: pgmap v1853: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:40:18.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:18 smithi096 ceph-mon[124666]: osdmap e197: 12 total, 12 up, 12 in 2023-05-08T04:40:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:18 smithi186 ceph-mon[126480]: pgmap v1853: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:40:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:18 smithi186 ceph-mon[126480]: osdmap e197: 12 total, 12 up, 12 in 2023-05-08T04:40:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3357.634669 secs 2023-05-08T04:40:19.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3358.190917 secs 2023-05-08T04:40:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3357.634669 secs 2023-05-08T04:40:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3358.190917 secs 2023-05-08T04:40:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3357.634669 secs 2023-05-08T04:40:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3358.190917 secs 2023-05-08T04:40:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:20 smithi133 ceph-mon[125939]: pgmap v1855: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:40:20.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3359.469100 secs 2023-05-08T04:40:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:20 smithi096 ceph-mon[124666]: pgmap v1855: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:40:20.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3359.469100 secs 2023-05-08T04:40:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:20 smithi186 ceph-mon[126480]: pgmap v1855: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:40:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3359.469100 secs 2023-05-08T04:40:22.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:22 smithi133 ceph-mon[125939]: pgmap v1856: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:40:22.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:22 smithi096 ceph-mon[124666]: pgmap v1856: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:40:22.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:22 smithi186 ceph-mon[126480]: pgmap v1856: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:40:24.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3362.634814 secs 2023-05-08T04:40:24.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:24 smithi186 ceph-mon[126480]: pgmap v1857: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:40:24.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3363.191043 secs 2023-05-08T04:40:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3362.634814 secs 2023-05-08T04:40:24.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:24 smithi133 ceph-mon[125939]: pgmap v1857: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:40:24.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3363.191043 secs 2023-05-08T04:40:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3362.634814 secs 2023-05-08T04:40:24.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:24 smithi096 ceph-mon[124666]: pgmap v1857: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:40:24.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3363.191043 secs 2023-05-08T04:40:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3364.469215 secs 2023-05-08T04:40:25.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3364.469215 secs 2023-05-08T04:40:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3364.469215 secs 2023-05-08T04:40:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:26 smithi186 ceph-mon[126480]: pgmap v1858: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:40:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:26 smithi133 ceph-mon[125939]: pgmap v1858: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:40:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:26 smithi096 ceph-mon[124666]: pgmap v1858: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:40:28.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:28 smithi133 ceph-mon[125939]: pgmap v1859: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:40:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:28 smithi096 ceph-mon[124666]: pgmap v1859: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:40:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:28 smithi186 ceph-mon[126480]: pgmap v1859: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:40:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3367.634948 secs 2023-05-08T04:40:29.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3368.191168 secs 2023-05-08T04:40:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3367.634948 secs 2023-05-08T04:40:29.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3368.191168 secs 2023-05-08T04:40:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3367.634948 secs 2023-05-08T04:40:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3368.191168 secs 2023-05-08T04:40:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:30 smithi133 ceph-mon[125939]: pgmap v1860: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2023-05-08T04:40:30.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:40:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:30 smithi096 ceph-mon[124666]: pgmap v1860: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2023-05-08T04:40:30.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:40:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:30 smithi186 ceph-mon[126480]: pgmap v1860: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2023-05-08T04:40:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:40:32.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:32 smithi133 ceph-mon[125939]: pgmap v1861: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T04:40:32.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:32 smithi096 ceph-mon[124666]: pgmap v1861: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T04:40:32.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:32 smithi186 ceph-mon[126480]: pgmap v1861: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T04:40:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3372.635062 secs 2023-05-08T04:40:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:34 smithi133 ceph-mon[125939]: pgmap v1862: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:40:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:34 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:40:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:34 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:40:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3373.191306 secs 2023-05-08T04:40:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:34 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:40:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:34 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:40:34.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:34 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:40:34.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:34 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:40:34.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:34 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:40:34.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:34 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:40:34.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:34 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T04:40:34.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:34 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T04:40:34.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:34 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:40:34.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:34 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:40:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3372.635062 secs 2023-05-08T04:40:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:34 smithi096 ceph-mon[124666]: pgmap v1862: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:40:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:34 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:40:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:34 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:40:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3373.191306 secs 2023-05-08T04:40:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:34 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:40:34.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:34 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:40:34.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:34 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:40:34.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:34 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:40:34.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:34 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:40:34.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:34 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:40:34.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:34 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T04:40:34.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:34 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T04:40:34.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:34 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:40:34.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:34 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:40:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3372.635062 secs 2023-05-08T04:40:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:34 smithi186 ceph-mon[126480]: pgmap v1862: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:40:34.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:34 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:40:34.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:34 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:40:34.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3373.191306 secs 2023-05-08T04:40:34.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:34 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:40:34.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:34 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:40:34.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:34 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:40:34.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:34 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:40:34.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:34 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:40:34.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:34 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:40:34.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:34 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T04:40:34.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:34 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T04:40:34.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:34 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:40:34.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:34 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:40:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:35 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:40:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:35 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:40:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:35 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:40:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3374.469449 secs 2023-05-08T04:40:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:35 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:40:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:35 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:40:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:35 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:40:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3374.469449 secs 2023-05-08T04:40:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:35 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:40:35.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:35 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:40:35.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:35 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:40:35.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3374.469449 secs 2023-05-08T04:40:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:36 smithi186 ceph-mon[126480]: pgmap v1863: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 74 KiB/s wr, 9 op/s 2023-05-08T04:40:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:36 smithi133 ceph-mon[125939]: pgmap v1863: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 74 KiB/s wr, 9 op/s 2023-05-08T04:40:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:36 smithi096 ceph-mon[124666]: pgmap v1863: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 74 KiB/s wr, 9 op/s 2023-05-08T04:40:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:38 smithi186 ceph-mon[126480]: pgmap v1864: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 74 KiB/s wr, 6 op/s 2023-05-08T04:40:38.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3377.635155 secs 2023-05-08T04:40:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:38 smithi133 ceph-mon[125939]: pgmap v1864: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 74 KiB/s wr, 6 op/s 2023-05-08T04:40:38.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3377.635155 secs 2023-05-08T04:40:39.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:38 smithi096 ceph-mon[124666]: pgmap v1864: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 74 KiB/s wr, 6 op/s 2023-05-08T04:40:39.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3377.635155 secs 2023-05-08T04:40:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3378.191441 secs 2023-05-08T04:40:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:39 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:40:39.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:39 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:40:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3378.191441 secs 2023-05-08T04:40:39.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:39 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:40:39.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:39 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:40:40.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3378.191441 secs 2023-05-08T04:40:40.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:39 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:40:40.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:39 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:40:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:40 smithi186 ceph-mon[126480]: pgmap v1865: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 74 KiB/s wr, 6 op/s 2023-05-08T04:40:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3379.469566 secs 2023-05-08T04:40:40.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:40 smithi133 ceph-mon[125939]: pgmap v1865: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 74 KiB/s wr, 6 op/s 2023-05-08T04:40:40.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3379.469566 secs 2023-05-08T04:40:41.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:40 smithi096 ceph-mon[124666]: pgmap v1865: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 74 KiB/s wr, 6 op/s 2023-05-08T04:40:41.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3379.469566 secs 2023-05-08T04:40:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:42 smithi186 ceph-mon[126480]: pgmap v1866: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 109 KiB/s wr, 10 op/s 2023-05-08T04:40:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:42 smithi133 ceph-mon[125939]: pgmap v1866: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 109 KiB/s wr, 10 op/s 2023-05-08T04:40:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:42 smithi096 ceph-mon[124666]: pgmap v1866: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 109 KiB/s wr, 10 op/s 2023-05-08T04:40:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3382.635275 secs 2023-05-08T04:40:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:43 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:40:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3382.635275 secs 2023-05-08T04:40:43.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:43 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:40:44.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3382.635275 secs 2023-05-08T04:40:44.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:43 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:40:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:44 smithi186 ceph-mon[126480]: pgmap v1867: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 109 KiB/s wr, 8 op/s 2023-05-08T04:40:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3383.191534 secs 2023-05-08T04:40:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:44 smithi133 ceph-mon[125939]: pgmap v1867: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 109 KiB/s wr, 8 op/s 2023-05-08T04:40:44.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3383.191534 secs 2023-05-08T04:40:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:44 smithi096 ceph-mon[124666]: pgmap v1867: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 109 KiB/s wr, 8 op/s 2023-05-08T04:40:45.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3383.191534 secs 2023-05-08T04:40:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3384.469685 secs 2023-05-08T04:40:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3384.469685 secs 2023-05-08T04:40:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3384.469685 secs 2023-05-08T04:40:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:46 smithi186 ceph-mon[126480]: pgmap v1868: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 109 KiB/s wr, 10 op/s 2023-05-08T04:40:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:46 smithi133 ceph-mon[125939]: pgmap v1868: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 109 KiB/s wr, 10 op/s 2023-05-08T04:40:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:46 smithi096 ceph-mon[124666]: pgmap v1868: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 109 KiB/s wr, 10 op/s 2023-05-08T04:40:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:48 smithi186 ceph-mon[126480]: pgmap v1869: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 6 op/s 2023-05-08T04:40:48.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3387.635394 secs 2023-05-08T04:40:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:48 smithi133 ceph-mon[125939]: pgmap v1869: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 6 op/s 2023-05-08T04:40:48.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3387.635394 secs 2023-05-08T04:40:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:48 smithi096 ceph-mon[124666]: pgmap v1869: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 6 op/s 2023-05-08T04:40:49.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3387.635394 secs 2023-05-08T04:40:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3388.191650 secs 2023-05-08T04:40:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3388.191650 secs 2023-05-08T04:40:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3388.191650 secs 2023-05-08T04:40:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:50 smithi186 ceph-mon[126480]: pgmap v1870: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 6 op/s 2023-05-08T04:40:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3389.469837 secs 2023-05-08T04:40:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:50 smithi133 ceph-mon[125939]: pgmap v1870: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 6 op/s 2023-05-08T04:40:50.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3389.469837 secs 2023-05-08T04:40:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:50 smithi096 ceph-mon[124666]: pgmap v1870: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 6 op/s 2023-05-08T04:40:51.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3389.469837 secs 2023-05-08T04:40:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:52 smithi186 ceph-mon[126480]: pgmap v1871: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 45 KiB/s wr, 9 op/s 2023-05-08T04:40:52.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:52 smithi133 ceph-mon[125939]: pgmap v1871: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 45 KiB/s wr, 9 op/s 2023-05-08T04:40:53.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:52 smithi096 ceph-mon[124666]: pgmap v1871: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 45 KiB/s wr, 9 op/s 2023-05-08T04:40:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3392.635508 secs 2023-05-08T04:40:54.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:54 smithi186 ceph-mon[126480]: pgmap v1872: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.9 KiB/s wr, 5 op/s 2023-05-08T04:40:54.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3393.191771 secs 2023-05-08T04:40:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3392.635508 secs 2023-05-08T04:40:54.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:54 smithi133 ceph-mon[125939]: pgmap v1872: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.9 KiB/s wr, 5 op/s 2023-05-08T04:40:54.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3393.191771 secs 2023-05-08T04:40:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3392.635508 secs 2023-05-08T04:40:54.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:54 smithi096 ceph-mon[124666]: pgmap v1872: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.9 KiB/s wr, 5 op/s 2023-05-08T04:40:54.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3393.191771 secs 2023-05-08T04:40:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3394.469953 secs 2023-05-08T04:40:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3394.469953 secs 2023-05-08T04:40:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3394.469953 secs 2023-05-08T04:40:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:56 smithi133 ceph-mon[125939]: pgmap v1873: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.9 KiB/s wr, 7 op/s 2023-05-08T04:40:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:56 smithi096 ceph-mon[124666]: pgmap v1873: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.9 KiB/s wr, 7 op/s 2023-05-08T04:40:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:56 smithi186 ceph-mon[126480]: pgmap v1873: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.9 KiB/s wr, 7 op/s 2023-05-08T04:40:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:58 smithi133 ceph-mon[125939]: pgmap v1874: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.7 KiB/s wr, 5 op/s 2023-05-08T04:40:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:58 smithi096 ceph-mon[124666]: pgmap v1874: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.7 KiB/s wr, 5 op/s 2023-05-08T04:40:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:58 smithi186 ceph-mon[126480]: pgmap v1874: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.7 KiB/s wr, 5 op/s 2023-05-08T04:40:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3397.635632 secs 2023-05-08T04:40:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:40:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3398.191889 secs 2023-05-08T04:40:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3397.635632 secs 2023-05-08T04:40:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:40:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3398.191889 secs 2023-05-08T04:40:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3397.635632 secs 2023-05-08T04:40:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:40:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3398.191889 secs 2023-05-08T04:41:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:00 smithi133 ceph-mon[125939]: pgmap v1875: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.7 KiB/s wr, 5 op/s 2023-05-08T04:41:00.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3399.470020 secs 2023-05-08T04:41:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:00 smithi096 ceph-mon[124666]: pgmap v1875: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.7 KiB/s wr, 5 op/s 2023-05-08T04:41:00.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3399.470020 secs 2023-05-08T04:41:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:00 smithi186 ceph-mon[126480]: pgmap v1875: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.7 KiB/s wr, 5 op/s 2023-05-08T04:41:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3399.470020 secs 2023-05-08T04:41:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:02 smithi133 ceph-mon[125939]: pgmap v1876: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.7 KiB/s wr, 7 op/s 2023-05-08T04:41:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:02 smithi096 ceph-mon[124666]: pgmap v1876: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.7 KiB/s wr, 7 op/s 2023-05-08T04:41:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:02 smithi186 ceph-mon[126480]: pgmap v1876: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.7 KiB/s wr, 7 op/s 2023-05-08T04:41:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3402.635745 secs 2023-05-08T04:41:04.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:04 smithi133 ceph-mon[125939]: pgmap v1877: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:41:04.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3403.191983 secs 2023-05-08T04:41:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3402.635745 secs 2023-05-08T04:41:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:04 smithi096 ceph-mon[124666]: pgmap v1877: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:41:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3403.191983 secs 2023-05-08T04:41:04.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3402.635745 secs 2023-05-08T04:41:04.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:04 smithi186 ceph-mon[126480]: pgmap v1877: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:41:04.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3403.191983 secs 2023-05-08T04:41:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3404.470130 secs 2023-05-08T04:41:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3404.470130 secs 2023-05-08T04:41:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3404.470130 secs 2023-05-08T04:41:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:06 smithi133 ceph-mon[125939]: pgmap v1878: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:41:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:06 smithi096 ceph-mon[124666]: pgmap v1878: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:41:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:06 smithi186 ceph-mon[126480]: pgmap v1878: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:41:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:08 smithi133 ceph-mon[125939]: pgmap v1879: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:41:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:08 smithi096 ceph-mon[124666]: pgmap v1879: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:41:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:08 smithi186 ceph-mon[126480]: pgmap v1879: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:41:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3407.635879 secs 2023-05-08T04:41:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3408.192108 secs 2023-05-08T04:41:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3407.635879 secs 2023-05-08T04:41:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3408.192108 secs 2023-05-08T04:41:09.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3407.635879 secs 2023-05-08T04:41:09.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3408.192108 secs 2023-05-08T04:41:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:10 smithi133 ceph-mon[125939]: pgmap v1880: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:41:10.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3409.470246 secs 2023-05-08T04:41:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:10 smithi096 ceph-mon[124666]: pgmap v1880: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:41:10.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3409.470246 secs 2023-05-08T04:41:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:10 smithi186 ceph-mon[126480]: pgmap v1880: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:41:10.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3409.470246 secs 2023-05-08T04:41:11.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:11 smithi133 ceph-mon[125939]: osdmap e198: 12 total, 12 up, 12 in 2023-05-08T04:41:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:11 smithi096 ceph-mon[124666]: osdmap e198: 12 total, 12 up, 12 in 2023-05-08T04:41:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:11 smithi186 ceph-mon[126480]: osdmap e198: 12 total, 12 up, 12 in 2023-05-08T04:41:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:12 smithi133 ceph-mon[125939]: pgmap v1882: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:41:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:12 smithi096 ceph-mon[124666]: pgmap v1882: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:41:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:12 smithi186 ceph-mon[126480]: pgmap v1882: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:41:14.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3412.635992 secs 2023-05-08T04:41:14.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:14 smithi133 ceph-mon[125939]: pgmap v1883: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:41:14.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3413.192212 secs 2023-05-08T04:41:14.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3412.635992 secs 2023-05-08T04:41:14.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:14 smithi096 ceph-mon[124666]: pgmap v1883: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:41:14.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3413.192212 secs 2023-05-08T04:41:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3412.635992 secs 2023-05-08T04:41:14.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:14 smithi186 ceph-mon[126480]: pgmap v1883: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:41:14.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3413.192212 secs 2023-05-08T04:41:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3414.470370 secs 2023-05-08T04:41:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3414.470370 secs 2023-05-08T04:41:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3414.470370 secs 2023-05-08T04:41:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:16 smithi133 ceph-mon[125939]: pgmap v1884: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:41:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:16 smithi096 ceph-mon[124666]: pgmap v1884: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:41:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:16 smithi186 ceph-mon[126480]: pgmap v1884: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:41:18.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:18 smithi133 ceph-mon[125939]: pgmap v1885: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:41:18.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:18 smithi133 ceph-mon[125939]: osdmap e199: 12 total, 12 up, 12 in 2023-05-08T04:41:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:18 smithi096 ceph-mon[124666]: pgmap v1885: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:41:18.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:18 smithi096 ceph-mon[124666]: osdmap e199: 12 total, 12 up, 12 in 2023-05-08T04:41:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:18 smithi186 ceph-mon[126480]: pgmap v1885: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:41:18.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:18 smithi186 ceph-mon[126480]: osdmap e199: 12 total, 12 up, 12 in 2023-05-08T04:41:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3417.636110 secs 2023-05-08T04:41:19.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3418.192329 secs 2023-05-08T04:41:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3417.636110 secs 2023-05-08T04:41:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3418.192329 secs 2023-05-08T04:41:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3417.636110 secs 2023-05-08T04:41:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3418.192329 secs 2023-05-08T04:41:20.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:20 smithi133 ceph-mon[125939]: pgmap v1887: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:41:20.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3419.470505 secs 2023-05-08T04:41:20.760 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:20 smithi096 ceph-mon[124666]: pgmap v1887: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:41:20.760 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3419.470505 secs 2023-05-08T04:41:20.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:20 smithi186 ceph-mon[126480]: pgmap v1887: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 118 B/s wr, 3 op/s 2023-05-08T04:41:20.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3419.470505 secs 2023-05-08T04:41:22.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:22 smithi133 ceph-mon[125939]: pgmap v1888: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:41:22.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:22 smithi096 ceph-mon[124666]: pgmap v1888: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:41:22.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:22 smithi186 ceph-mon[126480]: pgmap v1888: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:41:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3422.636255 secs 2023-05-08T04:41:24.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:24 smithi133 ceph-mon[125939]: pgmap v1889: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:41:24.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3423.192451 secs 2023-05-08T04:41:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3422.636255 secs 2023-05-08T04:41:24.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:24 smithi096 ceph-mon[124666]: pgmap v1889: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:41:24.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3423.192451 secs 2023-05-08T04:41:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3422.636255 secs 2023-05-08T04:41:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:24 smithi186 ceph-mon[126480]: pgmap v1889: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:41:24.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3423.192451 secs 2023-05-08T04:41:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3424.470639 secs 2023-05-08T04:41:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3424.470639 secs 2023-05-08T04:41:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3424.470639 secs 2023-05-08T04:41:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:26 smithi133 ceph-mon[125939]: pgmap v1890: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:41:26.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:26 smithi096 ceph-mon[124666]: pgmap v1890: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:41:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:26 smithi186 ceph-mon[126480]: pgmap v1890: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:41:28.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:28 smithi133 ceph-mon[125939]: pgmap v1891: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:41:28.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:28 smithi096 ceph-mon[124666]: pgmap v1891: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:41:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:28 smithi186 ceph-mon[126480]: pgmap v1891: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:41:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3427.636365 secs 2023-05-08T04:41:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3428.192574 secs 2023-05-08T04:41:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3427.636365 secs 2023-05-08T04:41:29.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3428.192574 secs 2023-05-08T04:41:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3427.636365 secs 2023-05-08T04:41:29.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3428.192574 secs 2023-05-08T04:41:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:30 smithi133 ceph-mon[125939]: pgmap v1892: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2023-05-08T04:41:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:30 smithi096 ceph-mon[124666]: pgmap v1892: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2023-05-08T04:41:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:30 smithi186 ceph-mon[126480]: pgmap v1892: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 95 B/s wr, 5 op/s 2023-05-08T04:41:32.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:32 smithi133 ceph-mon[125939]: pgmap v1893: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T04:41:32.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:32 smithi096 ceph-mon[124666]: pgmap v1893: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T04:41:32.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:32 smithi186 ceph-mon[126480]: pgmap v1893: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T04:41:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3432.636498 secs 2023-05-08T04:41:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:34 smithi133 ceph-mon[125939]: pgmap v1894: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:41:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3433.192675 secs 2023-05-08T04:41:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:34 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:41:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:34 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:41:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3432.636498 secs 2023-05-08T04:41:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:34 smithi096 ceph-mon[124666]: pgmap v1894: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:41:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3433.192675 secs 2023-05-08T04:41:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:34 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:41:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:34 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:41:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3432.636498 secs 2023-05-08T04:41:34.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:34 smithi186 ceph-mon[126480]: pgmap v1894: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:41:34.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3433.192675 secs 2023-05-08T04:41:34.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:34 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:41:34.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:34 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:41:35.563 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:35 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:41:35.563 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:35 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:41:35.563 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:35 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:41:35.563 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3434.470842 secs 2023-05-08T04:41:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:35 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:41:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:35 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:41:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:35 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:41:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3434.470842 secs 2023-05-08T04:41:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:35 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:41:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:35 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:41:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:35 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:41:35.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3434.470842 secs 2023-05-08T04:41:36.696 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:36 smithi186 ceph-mon[126480]: pgmap v1895: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 93 KiB/s wr, 9 op/s 2023-05-08T04:41:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:36 smithi133 ceph-mon[125939]: pgmap v1895: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 93 KiB/s wr, 9 op/s 2023-05-08T04:41:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:36 smithi096 ceph-mon[124666]: pgmap v1895: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 93 KiB/s wr, 9 op/s 2023-05-08T04:41:38.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:37 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:41:38.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:37 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:41:38.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:37 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:41:38.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:37 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:41:38.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:37 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:41:38.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:37 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:41:38.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:37 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T04:41:38.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:37 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T04:41:38.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:37 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:41:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:37 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:41:38.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:37 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:41:38.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:37 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:41:38.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:37 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:41:38.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:37 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:41:38.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:37 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:41:38.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:37 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T04:41:38.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:37 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T04:41:38.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:37 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:41:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:37 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:41:38.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:37 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:41:38.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:37 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:41:38.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:37 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:41:38.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:37 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:41:38.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:37 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:41:38.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:37 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T04:41:38.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:37 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T04:41:38.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:37 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:41:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:39 smithi186 ceph-mon[126480]: pgmap v1896: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 93 KiB/s wr, 7 op/s 2023-05-08T04:41:39.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3437.636618 secs 2023-05-08T04:41:39.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:39 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:41:39.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:39 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:41:39.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3438.192796 secs 2023-05-08T04:41:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:39 smithi133 ceph-mon[125939]: pgmap v1896: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 93 KiB/s wr, 7 op/s 2023-05-08T04:41:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3437.636618 secs 2023-05-08T04:41:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:39 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:41:39.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:39 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:41:39.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3438.192796 secs 2023-05-08T04:41:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:39 smithi096 ceph-mon[124666]: pgmap v1896: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 93 KiB/s wr, 7 op/s 2023-05-08T04:41:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3437.636618 secs 2023-05-08T04:41:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:39 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:41:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:39 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:41:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3438.192796 secs 2023-05-08T04:41:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:41 smithi186 ceph-mon[126480]: pgmap v1897: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 93 KiB/s wr, 7 op/s 2023-05-08T04:41:41.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3439.470958 secs 2023-05-08T04:41:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:41 smithi133 ceph-mon[125939]: pgmap v1897: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 93 KiB/s wr, 7 op/s 2023-05-08T04:41:41.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3439.470958 secs 2023-05-08T04:41:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:41 smithi096 ceph-mon[124666]: pgmap v1897: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 93 KiB/s wr, 7 op/s 2023-05-08T04:41:41.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3439.470958 secs 2023-05-08T04:41:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:43 smithi186 ceph-mon[126480]: pgmap v1898: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 130 KiB/s wr, 11 op/s 2023-05-08T04:41:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:43 smithi133 ceph-mon[125939]: pgmap v1898: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 130 KiB/s wr, 11 op/s 2023-05-08T04:41:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:43 smithi096 ceph-mon[124666]: pgmap v1898: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 130 KiB/s wr, 11 op/s 2023-05-08T04:41:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3442.636729 secs 2023-05-08T04:41:44.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:44 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:41:44.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3443.192933 secs 2023-05-08T04:41:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3442.636729 secs 2023-05-08T04:41:44.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:44 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:41:44.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3443.192933 secs 2023-05-08T04:41:44.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3442.636729 secs 2023-05-08T04:41:44.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:44 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:41:44.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3443.192933 secs 2023-05-08T04:41:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:45 smithi186 ceph-mon[126480]: pgmap v1899: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 130 KiB/s wr, 9 op/s 2023-05-08T04:41:45.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:45 smithi133 ceph-mon[125939]: pgmap v1899: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 130 KiB/s wr, 9 op/s 2023-05-08T04:41:45.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:45 smithi096 ceph-mon[124666]: pgmap v1899: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 130 KiB/s wr, 9 op/s 2023-05-08T04:41:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3444.471079 secs 2023-05-08T04:41:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3444.471079 secs 2023-05-08T04:41:46.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3444.471079 secs 2023-05-08T04:41:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:47 smithi186 ceph-mon[126480]: pgmap v1900: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 130 KiB/s wr, 12 op/s 2023-05-08T04:41:47.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:47 smithi133 ceph-mon[125939]: pgmap v1900: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 130 KiB/s wr, 12 op/s 2023-05-08T04:41:47.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:47 smithi096 ceph-mon[124666]: pgmap v1900: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 130 KiB/s wr, 12 op/s 2023-05-08T04:41:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:49 smithi186 ceph-mon[126480]: pgmap v1901: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 7 op/s 2023-05-08T04:41:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3447.636832 secs 2023-05-08T04:41:49.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3448.193055 secs 2023-05-08T04:41:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:49 smithi133 ceph-mon[125939]: pgmap v1901: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 7 op/s 2023-05-08T04:41:49.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3447.636832 secs 2023-05-08T04:41:49.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3448.193055 secs 2023-05-08T04:41:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:49 smithi096 ceph-mon[124666]: pgmap v1901: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 7 op/s 2023-05-08T04:41:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3447.636832 secs 2023-05-08T04:41:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3448.193055 secs 2023-05-08T04:41:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:51 smithi186 ceph-mon[126480]: pgmap v1902: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 7 op/s 2023-05-08T04:41:51.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3449.471188 secs 2023-05-08T04:41:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:51 smithi133 ceph-mon[125939]: pgmap v1902: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 7 op/s 2023-05-08T04:41:51.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3449.471188 secs 2023-05-08T04:41:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:51 smithi096 ceph-mon[124666]: pgmap v1902: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 7 op/s 2023-05-08T04:41:51.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3449.471188 secs 2023-05-08T04:41:53.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:53 smithi186 ceph-mon[126480]: pgmap v1903: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 46 KiB/s wr, 10 op/s 2023-05-08T04:41:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:53 smithi133 ceph-mon[125939]: pgmap v1903: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 46 KiB/s wr, 10 op/s 2023-05-08T04:41:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:53 smithi096 ceph-mon[124666]: pgmap v1903: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 46 KiB/s wr, 10 op/s 2023-05-08T04:41:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3452.636949 secs 2023-05-08T04:41:54.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:54 smithi133 ceph-mon[125939]: pgmap v1904: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 KiB/s wr, 5 op/s 2023-05-08T04:41:54.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3453.193178 secs 2023-05-08T04:41:54.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3452.636949 secs 2023-05-08T04:41:54.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:54 smithi096 ceph-mon[124666]: pgmap v1904: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 KiB/s wr, 5 op/s 2023-05-08T04:41:54.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3453.193178 secs 2023-05-08T04:41:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3452.636949 secs 2023-05-08T04:41:54.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:54 smithi186 ceph-mon[126480]: pgmap v1904: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 KiB/s wr, 5 op/s 2023-05-08T04:41:54.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3453.193178 secs 2023-05-08T04:41:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3454.471305 secs 2023-05-08T04:41:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3454.471305 secs 2023-05-08T04:41:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3454.471305 secs 2023-05-08T04:41:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:56 smithi133 ceph-mon[125939]: pgmap v1905: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 10 KiB/s wr, 8 op/s 2023-05-08T04:41:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:56 smithi096 ceph-mon[124666]: pgmap v1905: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 10 KiB/s wr, 8 op/s 2023-05-08T04:41:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:56 smithi186 ceph-mon[126480]: pgmap v1905: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 10 KiB/s wr, 8 op/s 2023-05-08T04:41:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:58 smithi133 ceph-mon[125939]: pgmap v1906: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.9 KiB/s wr, 5 op/s 2023-05-08T04:41:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:58 smithi096 ceph-mon[124666]: pgmap v1906: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.9 KiB/s wr, 5 op/s 2023-05-08T04:41:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:58 smithi186 ceph-mon[126480]: pgmap v1906: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.9 KiB/s wr, 5 op/s 2023-05-08T04:41:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3457.637022 secs 2023-05-08T04:41:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:41:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3458.193324 secs 2023-05-08T04:41:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3457.637022 secs 2023-05-08T04:41:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:41:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3458.193324 secs 2023-05-08T04:41:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3457.637022 secs 2023-05-08T04:41:59.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:41:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3458.193324 secs 2023-05-08T04:42:00.745 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:00 smithi133 ceph-mon[125939]: pgmap v1907: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.9 KiB/s wr, 5 op/s 2023-05-08T04:42:00.745 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3459.471421 secs 2023-05-08T04:42:00.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:00 smithi096 ceph-mon[124666]: pgmap v1907: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.9 KiB/s wr, 5 op/s 2023-05-08T04:42:00.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3459.471421 secs 2023-05-08T04:42:00.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:00 smithi186 ceph-mon[126480]: pgmap v1907: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.9 KiB/s wr, 5 op/s 2023-05-08T04:42:00.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3459.471421 secs 2023-05-08T04:42:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:02 smithi133 ceph-mon[125939]: pgmap v1908: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.9 KiB/s wr, 7 op/s 2023-05-08T04:42:02.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:02 smithi096 ceph-mon[124666]: pgmap v1908: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.9 KiB/s wr, 7 op/s 2023-05-08T04:42:02.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:02 smithi186 ceph-mon[126480]: pgmap v1908: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.9 KiB/s wr, 7 op/s 2023-05-08T04:42:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3462.637135 secs 2023-05-08T04:42:04.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:04 smithi133 ceph-mon[125939]: pgmap v1909: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:42:04.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3463.193449 secs 2023-05-08T04:42:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3462.637135 secs 2023-05-08T04:42:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:04 smithi096 ceph-mon[124666]: pgmap v1909: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:42:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3463.193449 secs 2023-05-08T04:42:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3462.637135 secs 2023-05-08T04:42:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:04 smithi186 ceph-mon[126480]: pgmap v1909: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:42:04.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3463.193449 secs 2023-05-08T04:42:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3464.471540 secs 2023-05-08T04:42:05.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3464.471540 secs 2023-05-08T04:42:05.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3464.471540 secs 2023-05-08T04:42:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:06 smithi133 ceph-mon[125939]: pgmap v1910: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:42:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:06 smithi096 ceph-mon[124666]: pgmap v1910: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:42:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:06 smithi186 ceph-mon[126480]: pgmap v1910: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:42:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:08 smithi133 ceph-mon[125939]: pgmap v1911: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:42:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:08 smithi096 ceph-mon[124666]: pgmap v1911: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:42:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:08 smithi186 ceph-mon[126480]: pgmap v1911: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:42:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3467.637231 secs 2023-05-08T04:42:09.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3468.193562 secs 2023-05-08T04:42:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3467.637231 secs 2023-05-08T04:42:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3468.193562 secs 2023-05-08T04:42:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3467.637231 secs 2023-05-08T04:42:09.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3468.193562 secs 2023-05-08T04:42:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:10 smithi133 ceph-mon[125939]: pgmap v1912: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:42:10.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3469.471658 secs 2023-05-08T04:42:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:10 smithi096 ceph-mon[124666]: pgmap v1912: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:42:10.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3469.471658 secs 2023-05-08T04:42:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:10 smithi186 ceph-mon[126480]: pgmap v1912: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:42:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3469.471658 secs 2023-05-08T04:42:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:11 smithi133 ceph-mon[125939]: osdmap e200: 12 total, 12 up, 12 in 2023-05-08T04:42:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:11 smithi096 ceph-mon[124666]: osdmap e200: 12 total, 12 up, 12 in 2023-05-08T04:42:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:11 smithi186 ceph-mon[126480]: osdmap e200: 12 total, 12 up, 12 in 2023-05-08T04:42:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:12 smithi133 ceph-mon[125939]: pgmap v1914: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:42:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:12 smithi096 ceph-mon[124666]: pgmap v1914: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:42:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:12 smithi186 ceph-mon[126480]: pgmap v1914: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:42:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3472.637373 secs 2023-05-08T04:42:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:14 smithi133 ceph-mon[125939]: pgmap v1915: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:42:14.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3473.193654 secs 2023-05-08T04:42:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3472.637373 secs 2023-05-08T04:42:14.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:14 smithi096 ceph-mon[124666]: pgmap v1915: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:42:14.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3473.193654 secs 2023-05-08T04:42:14.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3472.637373 secs 2023-05-08T04:42:14.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:14 smithi186 ceph-mon[126480]: pgmap v1915: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:42:14.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3473.193654 secs 2023-05-08T04:42:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3474.471791 secs 2023-05-08T04:42:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3474.471791 secs 2023-05-08T04:42:15.873 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3474.471791 secs 2023-05-08T04:42:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:16 smithi133 ceph-mon[125939]: pgmap v1916: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:42:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:16 smithi096 ceph-mon[124666]: pgmap v1916: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:42:16.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:16 smithi186 ceph-mon[126480]: pgmap v1916: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:42:18.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:18 smithi133 ceph-mon[125939]: pgmap v1917: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:42:18.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:18 smithi133 ceph-mon[125939]: osdmap e201: 12 total, 12 up, 12 in 2023-05-08T04:42:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:18 smithi096 ceph-mon[124666]: pgmap v1917: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:42:18.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:18 smithi096 ceph-mon[124666]: osdmap e201: 12 total, 12 up, 12 in 2023-05-08T04:42:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:18 smithi186 ceph-mon[126480]: pgmap v1917: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:42:18.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:18 smithi186 ceph-mon[126480]: osdmap e201: 12 total, 12 up, 12 in 2023-05-08T04:42:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3477.637470 secs 2023-05-08T04:42:19.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3478.193757 secs 2023-05-08T04:42:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3477.637470 secs 2023-05-08T04:42:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3478.193757 secs 2023-05-08T04:42:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3477.637470 secs 2023-05-08T04:42:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3478.193757 secs 2023-05-08T04:42:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:20 smithi133 ceph-mon[125939]: pgmap v1919: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 118 B/s wr, 6 op/s 2023-05-08T04:42:20.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3479.471868 secs 2023-05-08T04:42:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:20 smithi096 ceph-mon[124666]: pgmap v1919: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 118 B/s wr, 6 op/s 2023-05-08T04:42:20.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3479.471868 secs 2023-05-08T04:42:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:20 smithi186 ceph-mon[126480]: pgmap v1919: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 118 B/s wr, 6 op/s 2023-05-08T04:42:20.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3479.471868 secs 2023-05-08T04:42:22.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:22 smithi133 ceph-mon[125939]: pgmap v1920: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:42:22.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:22 smithi096 ceph-mon[124666]: pgmap v1920: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:42:22.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:22 smithi186 ceph-mon[126480]: pgmap v1920: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:42:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3482.637592 secs 2023-05-08T04:42:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:24 smithi133 ceph-mon[125939]: pgmap v1921: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:42:24.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3483.193886 secs 2023-05-08T04:42:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3482.637592 secs 2023-05-08T04:42:24.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:24 smithi096 ceph-mon[124666]: pgmap v1921: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:42:24.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3483.193886 secs 2023-05-08T04:42:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3482.637592 secs 2023-05-08T04:42:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:24 smithi186 ceph-mon[126480]: pgmap v1921: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:42:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3483.193886 secs 2023-05-08T04:42:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3484.471983 secs 2023-05-08T04:42:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3484.471983 secs 2023-05-08T04:42:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3484.471983 secs 2023-05-08T04:42:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:26 smithi133 ceph-mon[125939]: pgmap v1922: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:42:26.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:26 smithi096 ceph-mon[124666]: pgmap v1922: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:42:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:26 smithi186 ceph-mon[126480]: pgmap v1922: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:42:28.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:28 smithi133 ceph-mon[125939]: pgmap v1923: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:42:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:28 smithi096 ceph-mon[124666]: pgmap v1923: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:42:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:28 smithi186 ceph-mon[126480]: pgmap v1923: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:42:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3487.637733 secs 2023-05-08T04:42:29.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3488.194015 secs 2023-05-08T04:42:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3487.637733 secs 2023-05-08T04:42:29.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3488.194015 secs 2023-05-08T04:42:29.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3487.637733 secs 2023-05-08T04:42:29.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3488.194015 secs 2023-05-08T04:42:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:30 smithi133 ceph-mon[125939]: pgmap v1924: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 95 B/s wr, 7 op/s 2023-05-08T04:42:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:30 smithi096 ceph-mon[124666]: pgmap v1924: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 95 B/s wr, 7 op/s 2023-05-08T04:42:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:30 smithi186 ceph-mon[126480]: pgmap v1924: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 95 B/s wr, 7 op/s 2023-05-08T04:42:32.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:32 smithi133 ceph-mon[125939]: pgmap v1925: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T04:42:32.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:32 smithi096 ceph-mon[124666]: pgmap v1925: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T04:42:32.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:32 smithi186 ceph-mon[126480]: pgmap v1925: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T04:42:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3492.637839 secs 2023-05-08T04:42:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:34 smithi133 ceph-mon[125939]: pgmap v1926: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:42:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3493.194115 secs 2023-05-08T04:42:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:34 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:42:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3492.637839 secs 2023-05-08T04:42:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:34 smithi096 ceph-mon[124666]: pgmap v1926: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:42:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3493.194115 secs 2023-05-08T04:42:34.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:34 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:42:34.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3492.637839 secs 2023-05-08T04:42:34.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:34 smithi186 ceph-mon[126480]: pgmap v1926: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:42:34.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3493.194115 secs 2023-05-08T04:42:34.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:34 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:42:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:35 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:42:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:35 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:42:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:35 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:42:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3494.472193 secs 2023-05-08T04:42:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:35 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:42:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:35 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:42:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:35 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:42:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3494.472193 secs 2023-05-08T04:42:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:35 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:42:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:35 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:42:35.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:35 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:42:35.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3494.472193 secs 2023-05-08T04:42:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:36 smithi133 ceph-mon[125939]: pgmap v1927: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 76 KiB/s wr, 9 op/s 2023-05-08T04:42:36.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:36 smithi096 ceph-mon[124666]: pgmap v1927: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 76 KiB/s wr, 9 op/s 2023-05-08T04:42:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:36 smithi186 ceph-mon[126480]: pgmap v1927: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 76 KiB/s wr, 9 op/s 2023-05-08T04:42:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:37 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:42:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:37 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:42:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:37 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:42:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:38 smithi133 ceph-mon[125939]: pgmap v1928: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 76 KiB/s wr, 6 op/s 2023-05-08T04:42:38.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:42:38.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:42:38.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:38 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:42:38.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:42:38.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:38 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T04:42:38.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:38 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T04:42:38.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:38 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:42:38.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3497.637991 secs 2023-05-08T04:42:38.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:38 smithi096 ceph-mon[124666]: pgmap v1928: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 76 KiB/s wr, 6 op/s 2023-05-08T04:42:38.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:42:38.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:42:38.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:38 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:42:38.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:42:38.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:38 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T04:42:38.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:38 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T04:42:38.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:38 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:42:38.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3497.637991 secs 2023-05-08T04:42:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:38 smithi186 ceph-mon[126480]: pgmap v1928: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 76 KiB/s wr, 6 op/s 2023-05-08T04:42:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:42:38.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:42:38.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:38 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:42:38.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:42:38.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:38 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T04:42:38.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:38 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T04:42:38.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:38 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:42:38.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3497.637991 secs 2023-05-08T04:42:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3498.194181 secs 2023-05-08T04:42:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:39 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:42:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:39 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:42:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3498.194181 secs 2023-05-08T04:42:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:39 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:42:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:39 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:42:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3498.194181 secs 2023-05-08T04:42:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:39 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:42:39.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:39 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:42:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:40 smithi133 ceph-mon[125939]: pgmap v1929: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 77 KiB/s wr, 9 op/s 2023-05-08T04:42:40.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3499.472337 secs 2023-05-08T04:42:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:40 smithi096 ceph-mon[124666]: pgmap v1929: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 77 KiB/s wr, 9 op/s 2023-05-08T04:42:40.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3499.472337 secs 2023-05-08T04:42:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:40 smithi186 ceph-mon[126480]: pgmap v1929: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 77 KiB/s wr, 9 op/s 2023-05-08T04:42:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3499.472337 secs 2023-05-08T04:42:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:42 smithi096 ceph-mon[124666]: pgmap v1930: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 109 KiB/s wr, 9 op/s 2023-05-08T04:42:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:42 smithi186 ceph-mon[126480]: pgmap v1930: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 109 KiB/s wr, 9 op/s 2023-05-08T04:42:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:42 smithi133 ceph-mon[125939]: pgmap v1930: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 109 KiB/s wr, 9 op/s 2023-05-08T04:42:43.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3502.638139 secs 2023-05-08T04:42:43.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:43 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:42:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3502.638139 secs 2023-05-08T04:42:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:43 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:42:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3502.638139 secs 2023-05-08T04:42:43.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:43 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:42:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:44 smithi096 ceph-mon[124666]: pgmap v1931: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 109 KiB/s wr, 8 op/s 2023-05-08T04:42:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3503.194259 secs 2023-05-08T04:42:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:44 smithi186 ceph-mon[126480]: pgmap v1931: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 109 KiB/s wr, 8 op/s 2023-05-08T04:42:44.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3503.194259 secs 2023-05-08T04:42:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:44 smithi133 ceph-mon[125939]: pgmap v1931: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 109 KiB/s wr, 8 op/s 2023-05-08T04:42:44.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3503.194259 secs 2023-05-08T04:42:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3504.472413 secs 2023-05-08T04:42:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3504.472413 secs 2023-05-08T04:42:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3504.472413 secs 2023-05-08T04:42:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:46 smithi186 ceph-mon[126480]: pgmap v1932: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 109 KiB/s wr, 11 op/s 2023-05-08T04:42:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:46 smithi133 ceph-mon[125939]: pgmap v1932: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 109 KiB/s wr, 11 op/s 2023-05-08T04:42:47.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:46 smithi096 ceph-mon[124666]: pgmap v1932: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 109 KiB/s wr, 11 op/s 2023-05-08T04:42:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:48 smithi186 ceph-mon[126480]: pgmap v1933: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T04:42:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3507.638238 secs 2023-05-08T04:42:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:48 smithi133 ceph-mon[125939]: pgmap v1933: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T04:42:48.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3507.638238 secs 2023-05-08T04:42:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:48 smithi096 ceph-mon[124666]: pgmap v1933: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T04:42:49.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3507.638238 secs 2023-05-08T04:42:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3508.194376 secs 2023-05-08T04:42:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3508.194376 secs 2023-05-08T04:42:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3508.194376 secs 2023-05-08T04:42:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:50 smithi186 ceph-mon[126480]: pgmap v1934: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 33 KiB/s wr, 8 op/s 2023-05-08T04:42:50.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3509.472550 secs 2023-05-08T04:42:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:50 smithi133 ceph-mon[125939]: pgmap v1934: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 33 KiB/s wr, 8 op/s 2023-05-08T04:42:50.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3509.472550 secs 2023-05-08T04:42:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:50 smithi096 ceph-mon[124666]: pgmap v1934: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 33 KiB/s wr, 8 op/s 2023-05-08T04:42:51.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3509.472550 secs 2023-05-08T04:42:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:52 smithi186 ceph-mon[126480]: pgmap v1935: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 51 KiB/s wr, 7 op/s 2023-05-08T04:42:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:52 smithi133 ceph-mon[125939]: pgmap v1935: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 51 KiB/s wr, 7 op/s 2023-05-08T04:42:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:52 smithi096 ceph-mon[124666]: pgmap v1935: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 51 KiB/s wr, 7 op/s 2023-05-08T04:42:54.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3512.638358 secs 2023-05-08T04:42:54.744 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:54 smithi133 ceph-mon[125939]: pgmap v1936: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 5 op/s 2023-05-08T04:42:54.744 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3513.194500 secs 2023-05-08T04:42:54.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3512.638358 secs 2023-05-08T04:42:54.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:54 smithi096 ceph-mon[124666]: pgmap v1936: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 5 op/s 2023-05-08T04:42:54.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3513.194500 secs 2023-05-08T04:42:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3512.638358 secs 2023-05-08T04:42:54.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:54 smithi186 ceph-mon[126480]: pgmap v1936: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 5 op/s 2023-05-08T04:42:54.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3513.194500 secs 2023-05-08T04:42:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3514.472671 secs 2023-05-08T04:42:55.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3514.472671 secs 2023-05-08T04:42:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3514.472671 secs 2023-05-08T04:42:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:56 smithi133 ceph-mon[125939]: pgmap v1937: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 8 op/s 2023-05-08T04:42:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:56 smithi096 ceph-mon[124666]: pgmap v1937: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 8 op/s 2023-05-08T04:42:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:56 smithi186 ceph-mon[126480]: pgmap v1937: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 8 op/s 2023-05-08T04:42:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:58 smithi133 ceph-mon[125939]: pgmap v1938: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 5 op/s 2023-05-08T04:42:58.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:58 smithi096 ceph-mon[124666]: pgmap v1938: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 5 op/s 2023-05-08T04:42:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:58 smithi186 ceph-mon[126480]: pgmap v1938: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 5 op/s 2023-05-08T04:42:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3517.638470 secs 2023-05-08T04:42:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:42:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3518.194618 secs 2023-05-08T04:42:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3517.638470 secs 2023-05-08T04:42:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:42:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3518.194618 secs 2023-05-08T04:42:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3517.638470 secs 2023-05-08T04:42:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:42:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3518.194618 secs 2023-05-08T04:43:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:00 smithi133 ceph-mon[125939]: pgmap v1939: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 7 op/s 2023-05-08T04:43:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3519.472803 secs 2023-05-08T04:43:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:00 smithi096 ceph-mon[124666]: pgmap v1939: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 7 op/s 2023-05-08T04:43:00.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3519.472803 secs 2023-05-08T04:43:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:00 smithi186 ceph-mon[126480]: pgmap v1939: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 7 op/s 2023-05-08T04:43:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3519.472803 secs 2023-05-08T04:43:02.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:02 smithi133 ceph-mon[125939]: pgmap v1940: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T04:43:02.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:02 smithi096 ceph-mon[124666]: pgmap v1940: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T04:43:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:02 smithi186 ceph-mon[126480]: pgmap v1940: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T04:43:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3522.638587 secs 2023-05-08T04:43:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:04 smithi133 ceph-mon[125939]: pgmap v1941: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 5 op/s 2023-05-08T04:43:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3523.194738 secs 2023-05-08T04:43:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3522.638587 secs 2023-05-08T04:43:04.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:04 smithi096 ceph-mon[124666]: pgmap v1941: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 5 op/s 2023-05-08T04:43:04.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3523.194738 secs 2023-05-08T04:43:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3522.638587 secs 2023-05-08T04:43:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:04 smithi186 ceph-mon[126480]: pgmap v1941: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 5 op/s 2023-05-08T04:43:04.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3523.194738 secs 2023-05-08T04:43:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3524.472921 secs 2023-05-08T04:43:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3524.472921 secs 2023-05-08T04:43:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3524.472921 secs 2023-05-08T04:43:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:06 smithi133 ceph-mon[125939]: pgmap v1942: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 60 KiB/s wr, 22 op/s 2023-05-08T04:43:06.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:06 smithi096 ceph-mon[124666]: pgmap v1942: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 60 KiB/s wr, 22 op/s 2023-05-08T04:43:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:06 smithi186 ceph-mon[126480]: pgmap v1942: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 60 KiB/s wr, 22 op/s 2023-05-08T04:43:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:08 smithi133 ceph-mon[125939]: pgmap v1943: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 60 KiB/s wr, 19 op/s 2023-05-08T04:43:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:08 smithi096 ceph-mon[124666]: pgmap v1943: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 60 KiB/s wr, 19 op/s 2023-05-08T04:43:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:08 smithi186 ceph-mon[126480]: pgmap v1943: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 60 KiB/s wr, 19 op/s 2023-05-08T04:43:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3527.638705 secs 2023-05-08T04:43:09.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3528.194861 secs 2023-05-08T04:43:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3527.638705 secs 2023-05-08T04:43:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3528.194861 secs 2023-05-08T04:43:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3527.638705 secs 2023-05-08T04:43:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3528.194861 secs 2023-05-08T04:43:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:10 smithi133 ceph-mon[125939]: pgmap v1944: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 60 KiB/s wr, 21 op/s 2023-05-08T04:43:10.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3529.472984 secs 2023-05-08T04:43:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:10 smithi096 ceph-mon[124666]: pgmap v1944: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 60 KiB/s wr, 21 op/s 2023-05-08T04:43:10.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3529.472984 secs 2023-05-08T04:43:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:10 smithi186 ceph-mon[126480]: pgmap v1944: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 60 KiB/s wr, 21 op/s 2023-05-08T04:43:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3529.472984 secs 2023-05-08T04:43:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:11 smithi133 ceph-mon[125939]: osdmap e202: 12 total, 12 up, 12 in 2023-05-08T04:43:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:11 smithi096 ceph-mon[124666]: osdmap e202: 12 total, 12 up, 12 in 2023-05-08T04:43:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:11 smithi186 ceph-mon[126480]: osdmap e202: 12 total, 12 up, 12 in 2023-05-08T04:43:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:12 smithi133 ceph-mon[125939]: pgmap v1946: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:43:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:12 smithi096 ceph-mon[124666]: pgmap v1946: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:43:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:12 smithi186 ceph-mon[126480]: pgmap v1946: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:43:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3532.638819 secs 2023-05-08T04:43:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:14 smithi133 ceph-mon[125939]: pgmap v1947: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:43:14.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3533.194999 secs 2023-05-08T04:43:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3532.638819 secs 2023-05-08T04:43:14.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:14 smithi096 ceph-mon[124666]: pgmap v1947: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:43:14.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3533.194999 secs 2023-05-08T04:43:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3532.638819 secs 2023-05-08T04:43:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:14 smithi186 ceph-mon[126480]: pgmap v1947: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:43:14.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3533.194999 secs 2023-05-08T04:43:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3534.473108 secs 2023-05-08T04:43:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3534.473108 secs 2023-05-08T04:43:15.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3534.473108 secs 2023-05-08T04:43:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:16 smithi133 ceph-mon[125939]: pgmap v1948: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:43:16.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:16 smithi096 ceph-mon[124666]: pgmap v1948: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:43:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:16 smithi186 ceph-mon[126480]: pgmap v1948: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:43:18.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:18 smithi133 ceph-mon[125939]: pgmap v1949: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:43:18.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:18 smithi133 ceph-mon[125939]: osdmap e203: 12 total, 12 up, 12 in 2023-05-08T04:43:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:18 smithi096 ceph-mon[124666]: pgmap v1949: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:43:18.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:18 smithi096 ceph-mon[124666]: osdmap e203: 12 total, 12 up, 12 in 2023-05-08T04:43:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:18 smithi186 ceph-mon[126480]: pgmap v1949: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:43:18.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:18 smithi186 ceph-mon[126480]: osdmap e203: 12 total, 12 up, 12 in 2023-05-08T04:43:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3537.638969 secs 2023-05-08T04:43:19.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3538.195137 secs 2023-05-08T04:43:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3537.638969 secs 2023-05-08T04:43:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3538.195137 secs 2023-05-08T04:43:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3537.638969 secs 2023-05-08T04:43:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3538.195137 secs 2023-05-08T04:43:20.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:20 smithi133 ceph-mon[125939]: pgmap v1951: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 118 B/s wr, 6 op/s 2023-05-08T04:43:20.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3539.473247 secs 2023-05-08T04:43:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:20 smithi096 ceph-mon[124666]: pgmap v1951: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 118 B/s wr, 6 op/s 2023-05-08T04:43:20.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3539.473247 secs 2023-05-08T04:43:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:20 smithi186 ceph-mon[126480]: pgmap v1951: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 118 B/s wr, 6 op/s 2023-05-08T04:43:20.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3539.473247 secs 2023-05-08T04:43:22.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:22 smithi133 ceph-mon[125939]: pgmap v1952: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:43:22.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:22 smithi096 ceph-mon[124666]: pgmap v1952: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:43:22.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:22 smithi186 ceph-mon[126480]: pgmap v1952: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:43:24.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3542.639058 secs 2023-05-08T04:43:24.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:24 smithi133 ceph-mon[125939]: pgmap v1953: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:43:24.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3543.195263 secs 2023-05-08T04:43:24.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3542.639058 secs 2023-05-08T04:43:24.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:24 smithi096 ceph-mon[124666]: pgmap v1953: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:43:24.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3543.195263 secs 2023-05-08T04:43:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3542.639058 secs 2023-05-08T04:43:24.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:24 smithi186 ceph-mon[126480]: pgmap v1953: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:43:24.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3543.195263 secs 2023-05-08T04:43:25.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3544.473366 secs 2023-05-08T04:43:25.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3544.473366 secs 2023-05-08T04:43:25.873 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3544.473366 secs 2023-05-08T04:43:26.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:26 smithi133 ceph-mon[125939]: pgmap v1954: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:43:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:26 smithi096 ceph-mon[124666]: pgmap v1954: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:43:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:26 smithi186 ceph-mon[126480]: pgmap v1954: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:43:28.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:28 smithi133 ceph-mon[125939]: pgmap v1955: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:43:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:28 smithi096 ceph-mon[124666]: pgmap v1955: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:43:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:28 smithi186 ceph-mon[126480]: pgmap v1955: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:43:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3547.639170 secs 2023-05-08T04:43:29.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3548.195401 secs 2023-05-08T04:43:29.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3547.639170 secs 2023-05-08T04:43:29.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3548.195401 secs 2023-05-08T04:43:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3547.639170 secs 2023-05-08T04:43:29.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3548.195401 secs 2023-05-08T04:43:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:30 smithi133 ceph-mon[125939]: pgmap v1956: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 95 B/s wr, 7 op/s 2023-05-08T04:43:30.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3549.473505 secs 2023-05-08T04:43:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:30 smithi096 ceph-mon[124666]: pgmap v1956: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 95 B/s wr, 7 op/s 2023-05-08T04:43:30.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3549.473505 secs 2023-05-08T04:43:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:30 smithi186 ceph-mon[126480]: pgmap v1956: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 95 B/s wr, 7 op/s 2023-05-08T04:43:30.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3549.473505 secs 2023-05-08T04:43:32.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:32 smithi133 ceph-mon[125939]: pgmap v1957: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T04:43:32.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:32 smithi096 ceph-mon[124666]: pgmap v1957: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T04:43:32.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:32 smithi186 ceph-mon[126480]: pgmap v1957: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T04:43:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3552.639304 secs 2023-05-08T04:43:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:34 smithi133 ceph-mon[125939]: pgmap v1958: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:43:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3553.195518 secs 2023-05-08T04:43:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3552.639304 secs 2023-05-08T04:43:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:34 smithi096 ceph-mon[124666]: pgmap v1958: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:43:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3553.195518 secs 2023-05-08T04:43:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3552.639304 secs 2023-05-08T04:43:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:34 smithi186 ceph-mon[126480]: pgmap v1958: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:43:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3553.195518 secs 2023-05-08T04:43:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3554.473621 secs 2023-05-08T04:43:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3554.473621 secs 2023-05-08T04:43:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3554.473621 secs 2023-05-08T04:43:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:36 smithi133 ceph-mon[125939]: pgmap v1959: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 77 KiB/s wr, 8 op/s 2023-05-08T04:43:36.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:36 smithi096 ceph-mon[124666]: pgmap v1959: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 77 KiB/s wr, 8 op/s 2023-05-08T04:43:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:36 smithi186 ceph-mon[126480]: pgmap v1959: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 77 KiB/s wr, 8 op/s 2023-05-08T04:43:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:38 smithi133 ceph-mon[125939]: pgmap v1960: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 77 KiB/s wr, 6 op/s 2023-05-08T04:43:38.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:43:38.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:38 smithi096 ceph-mon[124666]: pgmap v1960: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 77 KiB/s wr, 6 op/s 2023-05-08T04:43:38.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:43:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:38 smithi186 ceph-mon[126480]: pgmap v1960: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 77 KiB/s wr, 6 op/s 2023-05-08T04:43:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:43:39.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3557.639426 secs 2023-05-08T04:43:39.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3558.195602 secs 2023-05-08T04:43:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3557.639426 secs 2023-05-08T04:43:39.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3558.195602 secs 2023-05-08T04:43:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3557.639426 secs 2023-05-08T04:43:39.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3558.195602 secs 2023-05-08T04:43:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:40 smithi133 ceph-mon[125939]: pgmap v1961: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 78 KiB/s wr, 9 op/s 2023-05-08T04:43:40.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3559.473713 secs 2023-05-08T04:43:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:40 smithi096 ceph-mon[124666]: pgmap v1961: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 78 KiB/s wr, 9 op/s 2023-05-08T04:43:40.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3559.473713 secs 2023-05-08T04:43:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:40 smithi186 ceph-mon[126480]: pgmap v1961: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 78 KiB/s wr, 9 op/s 2023-05-08T04:43:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3559.473713 secs 2023-05-08T04:43:41.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:43:41.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:43:41.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:43:41.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:43:41.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:43:41.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:43:42.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:43:42.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:43:42.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:43:42.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:43:42.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:43:42.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:43:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:43:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:43:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:43:42.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:43:42.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:43:42.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:43:43.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:42 smithi186 ceph-mon[126480]: pgmap v1962: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 110 KiB/s wr, 8 op/s 2023-05-08T04:43:43.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:43:43.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:43:43.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:43:43.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:43:43.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:43:43.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:43:43.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:43:43.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:43:43.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:43:43.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:43:43.123 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:43:43.123 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:42 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi096 to 196.2M 2023-05-08T04:43:43.123 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:43:43.123 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:42 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi096 to 205766758: error parsing value: Value '205766758' is below minimum 939524096 2023-05-08T04:43:43.124 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:42 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T04:43:43.124 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:42 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T04:43:43.124 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:43:43.125 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:43:43.125 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:43:43.125 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:43:43.125 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:43:43.126 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:43:43.126 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:42 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T04:43:43.126 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:42 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T04:43:43.127 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:43:43.127 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:43:43.127 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:42 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:43:43.128 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:43:43.128 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:42 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T04:43:43.128 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:42 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T04:43:43.129 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:42 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:43:43.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:42 smithi133 ceph-mon[125939]: pgmap v1962: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 110 KiB/s wr, 8 op/s 2023-05-08T04:43:43.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:43:43.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:43:43.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:43:43.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:43:43.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:43:43.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:43:43.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:43:43.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:43:43.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:43:43.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:43:43.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:43:43.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:42 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi096 to 196.2M 2023-05-08T04:43:43.244 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:43:43.244 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:42 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi096 to 205766758: error parsing value: Value '205766758' is below minimum 939524096 2023-05-08T04:43:43.245 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:42 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T04:43:43.245 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:42 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T04:43:43.245 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:43:43.245 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:43:43.245 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:43:43.245 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:43:43.245 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:43:43.246 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:43:43.246 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:42 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T04:43:43.246 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:42 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T04:43:43.246 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:43:43.246 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:43:43.246 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:42 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:43:43.246 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:43:43.247 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:42 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T04:43:43.247 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:42 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T04:43:43.247 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:42 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:43:43.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:42 smithi096 ceph-mon[124666]: pgmap v1962: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 110 KiB/s wr, 8 op/s 2023-05-08T04:43:43.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:43:43.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:43:43.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:43:43.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:43:43.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:43:43.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:43:43.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:43:43.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:43:43.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:43:43.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:43:43.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:43:43.259 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:42 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi096 to 196.2M 2023-05-08T04:43:43.259 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:43:43.259 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:42 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi096 to 205766758: error parsing value: Value '205766758' is below minimum 939524096 2023-05-08T04:43:43.260 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:42 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T04:43:43.260 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:42 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T04:43:43.260 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:43:43.260 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:43:43.260 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:43:43.261 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:43:43.261 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:43:43.261 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:43:43.262 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:42 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T04:43:43.262 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:42 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T04:43:43.262 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:43:43.262 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:43:43.263 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:42 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:43:43.263 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:43:43.263 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:42 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T04:43:43.263 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:42 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T04:43:43.263 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:42 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:43:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3562.639533 secs 2023-05-08T04:43:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:44 smithi133 ceph-mon[125939]: pgmap v1963: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 110 KiB/s wr, 8 op/s 2023-05-08T04:43:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3563.195747 secs 2023-05-08T04:43:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3562.639533 secs 2023-05-08T04:43:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:44 smithi096 ceph-mon[124666]: pgmap v1963: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 110 KiB/s wr, 8 op/s 2023-05-08T04:43:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3563.195747 secs 2023-05-08T04:43:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3562.639533 secs 2023-05-08T04:43:44.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:44 smithi186 ceph-mon[126480]: pgmap v1963: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 110 KiB/s wr, 8 op/s 2023-05-08T04:43:44.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3563.195747 secs 2023-05-08T04:43:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3564.473862 secs 2023-05-08T04:43:45.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3564.473862 secs 2023-05-08T04:43:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3564.473862 secs 2023-05-08T04:43:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:46 smithi133 ceph-mon[125939]: pgmap v1964: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 111 KiB/s wr, 11 op/s 2023-05-08T04:43:46.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:46 smithi096 ceph-mon[124666]: pgmap v1964: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 111 KiB/s wr, 11 op/s 2023-05-08T04:43:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:46 smithi186 ceph-mon[126480]: pgmap v1964: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 111 KiB/s wr, 11 op/s 2023-05-08T04:43:48.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:48 smithi133 ceph-mon[125939]: pgmap v1965: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 7 op/s 2023-05-08T04:43:48.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:48 smithi096 ceph-mon[124666]: pgmap v1965: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 7 op/s 2023-05-08T04:43:48.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:48 smithi186 ceph-mon[126480]: pgmap v1965: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 7 op/s 2023-05-08T04:43:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3567.639602 secs 2023-05-08T04:43:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3568.195868 secs 2023-05-08T04:43:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3567.639602 secs 2023-05-08T04:43:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3568.195868 secs 2023-05-08T04:43:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3567.639602 secs 2023-05-08T04:43:49.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3568.195868 secs 2023-05-08T04:43:50.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:50 smithi133 ceph-mon[125939]: pgmap v1966: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 34 KiB/s wr, 8 op/s 2023-05-08T04:43:50.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3569.473936 secs 2023-05-08T04:43:50.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:50 smithi096 ceph-mon[124666]: pgmap v1966: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 34 KiB/s wr, 8 op/s 2023-05-08T04:43:50.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3569.473936 secs 2023-05-08T04:43:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:50 smithi186 ceph-mon[126480]: pgmap v1966: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 34 KiB/s wr, 8 op/s 2023-05-08T04:43:50.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3569.473936 secs 2023-05-08T04:43:52.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:52 smithi133 ceph-mon[125939]: pgmap v1967: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 52 KiB/s wr, 7 op/s 2023-05-08T04:43:52.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:52 smithi096 ceph-mon[124666]: pgmap v1967: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 52 KiB/s wr, 7 op/s 2023-05-08T04:43:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:52 smithi186 ceph-mon[126480]: pgmap v1967: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 52 KiB/s wr, 7 op/s 2023-05-08T04:43:54.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3572.639715 secs 2023-05-08T04:43:54.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:54 smithi133 ceph-mon[125939]: pgmap v1968: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 6 op/s 2023-05-08T04:43:54.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3573.195994 secs 2023-05-08T04:43:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3572.639715 secs 2023-05-08T04:43:54.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:54 smithi096 ceph-mon[124666]: pgmap v1968: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 6 op/s 2023-05-08T04:43:54.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3573.195994 secs 2023-05-08T04:43:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3572.639715 secs 2023-05-08T04:43:54.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:54 smithi186 ceph-mon[126480]: pgmap v1968: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 6 op/s 2023-05-08T04:43:54.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3573.195994 secs 2023-05-08T04:43:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3574.474048 secs 2023-05-08T04:43:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3574.474048 secs 2023-05-08T04:43:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3574.474048 secs 2023-05-08T04:43:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:56 smithi133 ceph-mon[125939]: pgmap v1969: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 8 op/s 2023-05-08T04:43:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:56 smithi096 ceph-mon[124666]: pgmap v1969: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 8 op/s 2023-05-08T04:43:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:56 smithi186 ceph-mon[126480]: pgmap v1969: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 8 op/s 2023-05-08T04:43:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:58 smithi133 ceph-mon[125939]: pgmap v1970: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 5 op/s 2023-05-08T04:43:58.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:58 smithi096 ceph-mon[124666]: pgmap v1970: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 5 op/s 2023-05-08T04:43:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:58 smithi186 ceph-mon[126480]: pgmap v1970: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 5 op/s 2023-05-08T04:43:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3577.639841 secs 2023-05-08T04:43:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:43:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3578.196133 secs 2023-05-08T04:43:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3577.639841 secs 2023-05-08T04:43:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:43:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3578.196133 secs 2023-05-08T04:43:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3577.639841 secs 2023-05-08T04:43:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:43:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3578.196133 secs 2023-05-08T04:44:00.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:44:00 smithi133 ceph-mon[125939]: pgmap v1971: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 7 op/s 2023-05-08T04:44:00.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:44:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3579.474157 secs 2023-05-08T04:44:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:44:00 smithi096 ceph-mon[124666]: pgmap v1971: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 7 op/s 2023-05-08T04:44:00.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:44:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3579.474157 secs 2023-05-08T04:44:00.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:44:00 smithi186 ceph-mon[126480]: pgmap v1971: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 7 op/s 2023-05-08T04:44:00.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:44:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3579.474157 secs 2023-05-08T04:44:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:44:02 smithi133 ceph-mon[125939]: pgmap v1972: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T04:44:02.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:44:02 smithi096 ceph-mon[124666]: pgmap v1972: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T04:44:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:44:02 smithi186 ceph-mon[126480]: pgmap v1972: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T04:44:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:44:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3582.639954 secs 2023-05-08T04:44:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:44:04 smithi133 ceph-mon[125939]: pgmap v1973: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 KiB/s wr, 5 op/s 2023-05-08T04:44:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:44:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3583.196200 secs 2023-05-08T04:44:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:44:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3582.639954 secs 2023-05-08T04:44:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:44:04 smithi096 ceph-mon[124666]: pgmap v1973: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 KiB/s wr, 5 op/s 2023-05-08T04:44:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:44:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3583.196200 secs 2023-05-08T04:44:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:44:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3582.639954 secs 2023-05-08T04:44:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:44:04 smithi186 ceph-mon[126480]: pgmap v1973: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 KiB/s wr, 5 op/s 2023-05-08T04:44:04.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:44:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3583.196200 secs 2023-05-08T04:44:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:44:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3584.474275 secs 2023-05-08T04:44:05.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:44:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3584.474275 secs 2023-05-08T04:44:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:44:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3584.474275 secs 2023-05-08T04:44:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:44:06 smithi133 ceph-mon[125939]: pgmap v1974: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 78 KiB/s wr, 22 op/s 2023-05-08T04:44:06.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:44:06 smithi096 ceph-mon[124666]: pgmap v1974: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 78 KiB/s wr, 22 op/s 2023-05-08T04:44:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:44:06 smithi186 ceph-mon[126480]: pgmap v1974: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 78 KiB/s wr, 22 op/s 2023-05-08T04:44:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:44:08 smithi133 ceph-mon[125939]: pgmap v1975: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 78 KiB/s wr, 20 op/s 2023-05-08T04:44:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:44:08 smithi096 ceph-mon[124666]: pgmap v1975: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 78 KiB/s wr, 20 op/s 2023-05-08T04:44:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:44:08 smithi186 ceph-mon[126480]: pgmap v1975: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 78 KiB/s wr, 20 op/s 2023-05-08T04:44:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:44:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3587.640094 secs 2023-05-08T04:44:09.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:44:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3588.196329 secs 2023-05-08T04:44:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:44:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3587.640094 secs 2023-05-08T04:44:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:44:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3588.196329 secs 2023-05-08T04:44:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:44:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3587.640094 secs 2023-05-08T04:44:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:44:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3588.196329 secs 2023-05-08T04:44:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:44:10 smithi133 ceph-mon[125939]: pgmap v1976: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 78 KiB/s wr, 22 op/s 2023-05-08T04:44:10.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:44:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3589.474412 secs 2023-05-08T04:44:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:44:10 smithi096 ceph-mon[124666]: pgmap v1976: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 78 KiB/s wr, 22 op/s 2023-05-08T04:44:10.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:44:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3589.474412 secs 2023-05-08T04:44:10.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:44:10 smithi186 ceph-mon[126480]: pgmap v1976: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 78 KiB/s wr, 22 op/s 2023-05-08T04:44:10.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:44:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3589.474412 secs 2023-05-08T04:44:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:44:11 smithi133 ceph-mon[125939]: osdmap e204: 12 total, 12 up, 12 in 2023-05-08T04:44:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:44:11 smithi096 ceph-mon[124666]: osdmap e204: 12 total, 12 up, 12 in 2023-05-08T04:44:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:44:11 smithi186 ceph-mon[126480]: osdmap e204: 12 total, 12 up, 12 in 2023-05-08T04:44:12.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:44:12 smithi133 ceph-mon[125939]: pgmap v1978: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 75 KiB/s wr, 24 op/s 2023-05-08T04:44:12.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:44:12 smithi096 ceph-mon[124666]: pgmap v1978: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 75 KiB/s wr, 24 op/s 2023-05-08T04:44:12.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:44:12 smithi186 ceph-mon[126480]: pgmap v1978: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 75 KiB/s wr, 24 op/s 2023-05-08T04:44:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:44:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3592.640215 secs 2023-05-08T04:44:14.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:44:14 smithi133 ceph-mon[125939]: pgmap v1979: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 75 KiB/s wr, 24 op/s 2023-05-08T04:44:14.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:44:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3593.196446 secs 2023-05-08T04:44:14.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:44:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3592.640215 secs 2023-05-08T04:44:14.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:44:14 smithi096 ceph-mon[124666]: pgmap v1979: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 75 KiB/s wr, 24 op/s 2023-05-08T04:44:14.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:44:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3593.196446 secs 2023-05-08T04:44:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:44:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3592.640215 secs 2023-05-08T04:44:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:44:14 smithi186 ceph-mon[126480]: pgmap v1979: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 75 KiB/s wr, 24 op/s 2023-05-08T04:44:14.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:44:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3593.196446 secs 2023-05-08T04:44:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:44:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3594.474552 secs 2023-05-08T04:44:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:44:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3594.474552 secs 2023-05-08T04:44:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:44:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3594.474552 secs 2023-05-08T04:44:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:44:16 smithi133 ceph-mon[125939]: pgmap v1980: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:44:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:44:16 smithi096 ceph-mon[124666]: pgmap v1980: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:44:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:44:16 smithi186 ceph-mon[126480]: pgmap v1980: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:44:18.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:44:18 smithi133 ceph-mon[125939]: pgmap v1981: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:44:18.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:44:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3597.640329 secs 2023-05-08T04:44:18.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:44:18 smithi133 ceph-mon[125939]: osdmap e205: 12 total, 12 up, 12 in 2023-05-08T04:44:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:44:18 smithi096 ceph-mon[124666]: pgmap v1981: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:44:18.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:44:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3597.640329 secs 2023-05-08T04:44:18.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:44:18 smithi096 ceph-mon[124666]: osdmap e205: 12 total, 12 up, 12 in 2023-05-08T04:44:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:44:18 smithi186 ceph-mon[126480]: pgmap v1981: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:44:18.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:44:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3597.640329 secs 2023-05-08T04:44:18.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:44:18 smithi186 ceph-mon[126480]: osdmap e205: 12 total, 12 up, 12 in 2023-05-08T04:44:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:44:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3598.196581 secs 2023-05-08T04:44:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:44:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3598.196581 secs 2023-05-08T04:44:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:44:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3598.196581 secs 2023-05-08T04:44:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:44:20 smithi133 ceph-mon[125939]: pgmap v1983: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 118 B/s wr, 6 op/s 2023-05-08T04:44:20.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:44:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3599.474693 secs 2023-05-08T04:44:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:44:20 smithi096 ceph-mon[124666]: pgmap v1983: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 118 B/s wr, 6 op/s 2023-05-08T04:44:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:44:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3599.474693 secs 2023-05-08T04:44:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:44:20 smithi186 ceph-mon[126480]: pgmap v1983: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 118 B/s wr, 6 op/s 2023-05-08T04:44:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:44:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3599.474693 secs 2023-05-08T04:44:22.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:44:22 smithi133 ceph-mon[125939]: pgmap v1984: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:44:22.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:44:22 smithi096 ceph-mon[124666]: pgmap v1984: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:44:22.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:44:22 smithi186 ceph-mon[126480]: pgmap v1984: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:44:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:44:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3602.640443 secs 2023-05-08T04:44:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:44:24 smithi133 ceph-mon[125939]: pgmap v1985: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:44:24.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:44:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3603.196661 secs 2023-05-08T04:44:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:44:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3602.640443 secs 2023-05-08T04:44:24.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:44:24 smithi096 ceph-mon[124666]: pgmap v1985: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:44:24.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:44:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3603.196661 secs 2023-05-08T04:44:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:44:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3602.640443 secs 2023-05-08T04:44:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:44:24 smithi186 ceph-mon[126480]: pgmap v1985: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:44:24.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:44:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3603.196661 secs 2023-05-08T04:44:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:44:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3604.474809 secs 2023-05-08T04:44:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:44:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3604.474809 secs 2023-05-08T04:44:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:44:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3604.474809 secs 2023-05-08T04:44:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:44:26 smithi133 ceph-mon[125939]: pgmap v1986: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:44:26.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:44:26 smithi096 ceph-mon[124666]: pgmap v1986: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:44:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:44:26 smithi186 ceph-mon[126480]: pgmap v1986: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:44:28.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:44:28 smithi133 ceph-mon[125939]: pgmap v1987: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:44:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:44:28 smithi096 ceph-mon[124666]: pgmap v1987: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:44:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:44:28 smithi186 ceph-mon[126480]: pgmap v1987: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:44:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:44:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3607.640509 secs 2023-05-08T04:44:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:44:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3608.196744 secs 2023-05-08T04:44:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:44:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3607.640509 secs 2023-05-08T04:44:29.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:44:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3608.196744 secs 2023-05-08T04:44:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:44:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3607.640509 secs 2023-05-08T04:44:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:44:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3608.196744 secs 2023-05-08T04:44:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:44:30 smithi133 ceph-mon[125939]: pgmap v1988: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 95 B/s wr, 7 op/s 2023-05-08T04:44:30.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:44:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3609.474929 secs 2023-05-08T04:44:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:44:30 smithi096 ceph-mon[124666]: pgmap v1988: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 95 B/s wr, 7 op/s 2023-05-08T04:44:30.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:44:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3609.474929 secs 2023-05-08T04:44:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:44:30 smithi186 ceph-mon[126480]: pgmap v1988: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 95 B/s wr, 7 op/s 2023-05-08T04:44:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:44:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3609.474929 secs 2023-05-08T04:44:32.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:44:32 smithi133 ceph-mon[125939]: pgmap v1989: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T04:44:32.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:44:32 smithi096 ceph-mon[124666]: pgmap v1989: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T04:44:32.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:44:32 smithi186 ceph-mon[126480]: pgmap v1989: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T04:44:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:44:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3612.640628 secs 2023-05-08T04:44:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:44:34 smithi133 ceph-mon[125939]: pgmap v1990: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:44:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:44:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3613.196811 secs 2023-05-08T04:44:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:44:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3612.640628 secs 2023-05-08T04:44:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:44:34 smithi096 ceph-mon[124666]: pgmap v1990: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:44:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:44:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3613.196811 secs 2023-05-08T04:44:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:44:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3612.640628 secs 2023-05-08T04:44:34.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:44:34 smithi186 ceph-mon[126480]: pgmap v1990: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:44:34.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:44:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3613.196811 secs 2023-05-08T04:44:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:44:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3614.475045 secs 2023-05-08T04:44:35.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:44:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3614.475045 secs 2023-05-08T04:44:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:44:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3614.475045 secs 2023-05-08T04:44:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:44:36 smithi133 ceph-mon[125939]: pgmap v1991: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 84 KiB/s wr, 8 op/s 2023-05-08T04:44:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:44:36 smithi096 ceph-mon[124666]: pgmap v1991: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 84 KiB/s wr, 8 op/s 2023-05-08T04:44:36.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:44:36 smithi186 ceph-mon[126480]: pgmap v1991: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 84 KiB/s wr, 8 op/s 2023-05-08T04:44:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:44:38 smithi133 ceph-mon[125939]: pgmap v1992: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 84 KiB/s wr, 6 op/s 2023-05-08T04:44:38.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:44:38 smithi096 ceph-mon[124666]: pgmap v1992: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 84 KiB/s wr, 6 op/s 2023-05-08T04:44:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:44:38 smithi186 ceph-mon[126480]: pgmap v1992: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 84 KiB/s wr, 6 op/s 2023-05-08T04:44:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:44:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3617.640744 secs 2023-05-08T04:44:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:44:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3618.196897 secs 2023-05-08T04:44:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:44:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3617.640744 secs 2023-05-08T04:44:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:44:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3618.196897 secs 2023-05-08T04:44:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:44:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3617.640744 secs 2023-05-08T04:44:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:44:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3618.196897 secs 2023-05-08T04:44:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:44:40 smithi133 ceph-mon[125939]: pgmap v1993: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 84 KiB/s wr, 8 op/s 2023-05-08T04:44:40.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:44:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3619.475180 secs 2023-05-08T04:44:40.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:44:40 smithi096 ceph-mon[124666]: pgmap v1993: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 84 KiB/s wr, 8 op/s 2023-05-08T04:44:40.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:44:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3619.475180 secs 2023-05-08T04:44:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:44:40 smithi186 ceph-mon[126480]: pgmap v1993: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 84 KiB/s wr, 8 op/s 2023-05-08T04:44:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:44:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3619.475180 secs 2023-05-08T04:44:42.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:44:42 smithi133 ceph-mon[125939]: pgmap v1994: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 126 KiB/s wr, 8 op/s 2023-05-08T04:44:42.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:44:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:44:42.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:44:42 smithi096 ceph-mon[124666]: pgmap v1994: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 126 KiB/s wr, 8 op/s 2023-05-08T04:44:42.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:44:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:44:42.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:44:42 smithi186 ceph-mon[126480]: pgmap v1994: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 126 KiB/s wr, 8 op/s 2023-05-08T04:44:42.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:44:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:44:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:44:43 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:44:43.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:44:43 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:44:43.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:44:43 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:44:43.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:44:43 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:44:43.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:44:43 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T04:44:43.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:44:43 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T04:44:43.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:44:43 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:44:43.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:44:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3622.640898 secs 2023-05-08T04:44:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:44:43 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:44:43.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:44:43 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:44:43.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:44:43 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:44:43.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:44:43 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:44:43.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:44:43 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T04:44:43.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:44:43 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T04:44:43.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:44:43 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:44:43.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:44:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3622.640898 secs 2023-05-08T04:44:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:44:43 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:44:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:44:43 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:44:43.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:44:43 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:44:43.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:44:43 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:44:43.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:44:43 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T04:44:43.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:44:43 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T04:44:43.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:44:43 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:44:43.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:44:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3622.640898 secs 2023-05-08T04:44:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:44:44 smithi133 ceph-mon[125939]: pgmap v1995: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 126 KiB/s wr, 8 op/s 2023-05-08T04:44:44.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:44:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3623.197016 secs 2023-05-08T04:44:45.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:44:44 smithi096 ceph-mon[124666]: pgmap v1995: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 126 KiB/s wr, 8 op/s 2023-05-08T04:44:45.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:44:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3623.197016 secs 2023-05-08T04:44:45.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:44:44 smithi186 ceph-mon[126480]: pgmap v1995: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 126 KiB/s wr, 8 op/s 2023-05-08T04:44:45.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:44:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3623.197016 secs 2023-05-08T04:44:45.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:44:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3624.475297 secs 2023-05-08T04:44:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:44:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3624.475297 secs 2023-05-08T04:44:46.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:44:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3624.475297 secs 2023-05-08T04:44:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:44:46 smithi133 ceph-mon[125939]: pgmap v1996: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 127 KiB/s wr, 10 op/s 2023-05-08T04:44:47.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:44:46 smithi096 ceph-mon[124666]: pgmap v1996: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 127 KiB/s wr, 10 op/s 2023-05-08T04:44:47.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:44:46 smithi186 ceph-mon[126480]: pgmap v1996: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 127 KiB/s wr, 10 op/s 2023-05-08T04:44:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:44:48 smithi133 ceph-mon[125939]: pgmap v1997: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 43 KiB/s wr, 7 op/s 2023-05-08T04:44:48.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:44:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3627.641035 secs 2023-05-08T04:44:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:44:48 smithi096 ceph-mon[124666]: pgmap v1997: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 43 KiB/s wr, 7 op/s 2023-05-08T04:44:49.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:44:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3627.641035 secs 2023-05-08T04:44:49.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:44:48 smithi186 ceph-mon[126480]: pgmap v1997: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 43 KiB/s wr, 7 op/s 2023-05-08T04:44:49.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:44:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3627.641035 secs 2023-05-08T04:44:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:44:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3628.197132 secs 2023-05-08T04:44:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:44:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3628.197132 secs 2023-05-08T04:44:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:44:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3628.197132 secs 2023-05-08T04:44:50.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:44:50 smithi133 ceph-mon[125939]: pgmap v1998: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 43 KiB/s wr, 8 op/s 2023-05-08T04:44:50.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:44:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3629.475440 secs 2023-05-08T04:44:51.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:44:50 smithi096 ceph-mon[124666]: pgmap v1998: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 43 KiB/s wr, 8 op/s 2023-05-08T04:44:51.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:44:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3629.475440 secs 2023-05-08T04:44:51.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:44:50 smithi186 ceph-mon[126480]: pgmap v1998: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 43 KiB/s wr, 8 op/s 2023-05-08T04:44:51.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:44:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3629.475440 secs 2023-05-08T04:44:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:44:52 smithi133 ceph-mon[125939]: pgmap v1999: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 50 KiB/s wr, 7 op/s 2023-05-08T04:44:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:44:52 smithi096 ceph-mon[124666]: pgmap v1999: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 50 KiB/s wr, 7 op/s 2023-05-08T04:44:53.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:44:52 smithi186 ceph-mon[126480]: pgmap v1999: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 50 KiB/s wr, 7 op/s 2023-05-08T04:44:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:44:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3632.641168 secs 2023-05-08T04:44:54.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:44:54 smithi133 ceph-mon[125939]: pgmap v2000: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.2 KiB/s wr, 5 op/s 2023-05-08T04:44:54.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:44:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3633.197272 secs 2023-05-08T04:44:54.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:44:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3632.641168 secs 2023-05-08T04:44:54.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:44:54 smithi096 ceph-mon[124666]: pgmap v2000: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.2 KiB/s wr, 5 op/s 2023-05-08T04:44:54.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:44:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3633.197272 secs 2023-05-08T04:44:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:44:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3632.641168 secs 2023-05-08T04:44:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:44:54 smithi186 ceph-mon[126480]: pgmap v2000: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.2 KiB/s wr, 5 op/s 2023-05-08T04:44:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:44:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3633.197272 secs 2023-05-08T04:44:55.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:44:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3634.475581 secs 2023-05-08T04:44:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:44:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3634.475581 secs 2023-05-08T04:44:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:44:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3634.475581 secs 2023-05-08T04:44:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:44:56 smithi133 ceph-mon[125939]: pgmap v2001: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.2 KiB/s wr, 7 op/s 2023-05-08T04:44:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:44:56 smithi096 ceph-mon[124666]: pgmap v2001: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.2 KiB/s wr, 7 op/s 2023-05-08T04:44:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:44:56 smithi186 ceph-mon[126480]: pgmap v2001: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.2 KiB/s wr, 7 op/s 2023-05-08T04:44:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:44:58 smithi133 ceph-mon[125939]: pgmap v2002: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.9 KiB/s wr, 5 op/s 2023-05-08T04:44:58.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:44:58 smithi096 ceph-mon[124666]: pgmap v2002: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.9 KiB/s wr, 5 op/s 2023-05-08T04:44:58.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:44:58 smithi186 ceph-mon[126480]: pgmap v2002: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.9 KiB/s wr, 5 op/s 2023-05-08T04:44:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:44:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3637.641218 secs 2023-05-08T04:44:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:44:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3638.197391 secs 2023-05-08T04:44:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:44:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3637.641218 secs 2023-05-08T04:44:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:44:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3638.197391 secs 2023-05-08T04:44:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:44:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3637.641218 secs 2023-05-08T04:44:59.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:44:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3638.197391 secs 2023-05-08T04:45:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:00 smithi133 ceph-mon[125939]: pgmap v2003: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.9 KiB/s wr, 6 op/s 2023-05-08T04:45:00.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3639.475671 secs 2023-05-08T04:45:00.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:00 smithi096 ceph-mon[124666]: pgmap v2003: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.9 KiB/s wr, 6 op/s 2023-05-08T04:45:00.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3639.475671 secs 2023-05-08T04:45:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:00 smithi186 ceph-mon[126480]: pgmap v2003: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.9 KiB/s wr, 6 op/s 2023-05-08T04:45:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3639.475671 secs 2023-05-08T04:45:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:02 smithi133 ceph-mon[125939]: pgmap v2004: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.8 KiB/s wr, 5 op/s 2023-05-08T04:45:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:02 smithi096 ceph-mon[124666]: pgmap v2004: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.8 KiB/s wr, 5 op/s 2023-05-08T04:45:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:02 smithi186 ceph-mon[126480]: pgmap v2004: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.8 KiB/s wr, 5 op/s 2023-05-08T04:45:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3642.641351 secs 2023-05-08T04:45:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:04 smithi133 ceph-mon[125939]: pgmap v2005: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:45:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3643.197457 secs 2023-05-08T04:45:04.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3642.641351 secs 2023-05-08T04:45:04.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:04 smithi096 ceph-mon[124666]: pgmap v2005: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:45:04.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3643.197457 secs 2023-05-08T04:45:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3642.641351 secs 2023-05-08T04:45:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:04 smithi186 ceph-mon[126480]: pgmap v2005: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:45:04.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3643.197457 secs 2023-05-08T04:45:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3644.475806 secs 2023-05-08T04:45:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3644.475806 secs 2023-05-08T04:45:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3644.475806 secs 2023-05-08T04:45:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:06 smithi133 ceph-mon[125939]: pgmap v2006: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:45:06.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:06 smithi096 ceph-mon[124666]: pgmap v2006: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:45:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:06 smithi186 ceph-mon[126480]: pgmap v2006: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:45:08.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:08 smithi133 ceph-mon[125939]: pgmap v2007: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:45:08.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3647.641463 secs 2023-05-08T04:45:08.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:08 smithi096 ceph-mon[124666]: pgmap v2007: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:45:08.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3647.641463 secs 2023-05-08T04:45:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:08 smithi186 ceph-mon[126480]: pgmap v2007: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:45:08.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3647.641463 secs 2023-05-08T04:45:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3648.197547 secs 2023-05-08T04:45:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3648.197547 secs 2023-05-08T04:45:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3648.197547 secs 2023-05-08T04:45:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:10 smithi133 ceph-mon[125939]: pgmap v2008: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 21 op/s 2023-05-08T04:45:10.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3649.475917 secs 2023-05-08T04:45:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:10 smithi096 ceph-mon[124666]: pgmap v2008: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 21 op/s 2023-05-08T04:45:10.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3649.475917 secs 2023-05-08T04:45:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:10 smithi186 ceph-mon[126480]: pgmap v2008: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 21 op/s 2023-05-08T04:45:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3649.475917 secs 2023-05-08T04:45:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:11 smithi133 ceph-mon[125939]: osdmap e206: 12 total, 12 up, 12 in 2023-05-08T04:45:11.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:11 smithi096 ceph-mon[124666]: osdmap e206: 12 total, 12 up, 12 in 2023-05-08T04:45:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:11 smithi186 ceph-mon[126480]: osdmap e206: 12 total, 12 up, 12 in 2023-05-08T04:45:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:12 smithi096 ceph-mon[124666]: pgmap v2010: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:45:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:12 smithi186 ceph-mon[126480]: pgmap v2010: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:45:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:12 smithi133 ceph-mon[125939]: pgmap v2010: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:45:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3652.641570 secs 2023-05-08T04:45:14.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:14 smithi133 ceph-mon[125939]: pgmap v2011: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:45:14.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3653.197665 secs 2023-05-08T04:45:14.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3652.641570 secs 2023-05-08T04:45:14.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:14 smithi096 ceph-mon[124666]: pgmap v2011: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:45:14.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3653.197665 secs 2023-05-08T04:45:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3652.641570 secs 2023-05-08T04:45:14.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:14 smithi186 ceph-mon[126480]: pgmap v2011: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:45:14.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3653.197665 secs 2023-05-08T04:45:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3654.476055 secs 2023-05-08T04:45:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3654.476055 secs 2023-05-08T04:45:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3654.476055 secs 2023-05-08T04:45:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:16 smithi133 ceph-mon[125939]: pgmap v2012: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:45:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:16 smithi096 ceph-mon[124666]: pgmap v2012: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:45:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:16 smithi186 ceph-mon[126480]: pgmap v2012: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:45:18.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:18 smithi133 ceph-mon[125939]: pgmap v2013: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:45:18.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:18 smithi133 ceph-mon[125939]: osdmap e207: 12 total, 12 up, 12 in 2023-05-08T04:45:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:18 smithi096 ceph-mon[124666]: pgmap v2013: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:45:18.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:18 smithi096 ceph-mon[124666]: osdmap e207: 12 total, 12 up, 12 in 2023-05-08T04:45:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:18 smithi186 ceph-mon[126480]: pgmap v2013: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:45:18.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:18 smithi186 ceph-mon[126480]: osdmap e207: 12 total, 12 up, 12 in 2023-05-08T04:45:19.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3657.641693 secs 2023-05-08T04:45:19.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3658.197776 secs 2023-05-08T04:45:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3657.641693 secs 2023-05-08T04:45:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3658.197776 secs 2023-05-08T04:45:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3657.641693 secs 2023-05-08T04:45:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3658.197776 secs 2023-05-08T04:45:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:20 smithi133 ceph-mon[125939]: pgmap v2015: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 118 B/s wr, 6 op/s 2023-05-08T04:45:20.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3659.476174 secs 2023-05-08T04:45:20.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:20 smithi096 ceph-mon[124666]: pgmap v2015: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 118 B/s wr, 6 op/s 2023-05-08T04:45:20.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3659.476174 secs 2023-05-08T04:45:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:20 smithi186 ceph-mon[126480]: pgmap v2015: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 118 B/s wr, 6 op/s 2023-05-08T04:45:20.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3659.476174 secs 2023-05-08T04:45:22.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:22 smithi133 ceph-mon[125939]: pgmap v2016: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:45:22.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:22 smithi096 ceph-mon[124666]: pgmap v2016: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:45:22.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:22 smithi186 ceph-mon[126480]: pgmap v2016: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:45:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3662.641816 secs 2023-05-08T04:45:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:24 smithi133 ceph-mon[125939]: pgmap v2017: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:45:24.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3663.197840 secs 2023-05-08T04:45:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3662.641816 secs 2023-05-08T04:45:24.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:24 smithi096 ceph-mon[124666]: pgmap v2017: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:45:24.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3663.197840 secs 2023-05-08T04:45:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3662.641816 secs 2023-05-08T04:45:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:24 smithi186 ceph-mon[126480]: pgmap v2017: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:45:24.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3663.197840 secs 2023-05-08T04:45:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3664.476295 secs 2023-05-08T04:45:25.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3664.476295 secs 2023-05-08T04:45:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3664.476295 secs 2023-05-08T04:45:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:26 smithi133 ceph-mon[125939]: pgmap v2018: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:45:26.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:26 smithi096 ceph-mon[124666]: pgmap v2018: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:45:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:26 smithi186 ceph-mon[126480]: pgmap v2018: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:45:28.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:28 smithi133 ceph-mon[125939]: pgmap v2019: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:45:28.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3667.641907 secs 2023-05-08T04:45:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:28 smithi096 ceph-mon[124666]: pgmap v2019: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:45:28.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3667.641907 secs 2023-05-08T04:45:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:28 smithi186 ceph-mon[126480]: pgmap v2019: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:45:28.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3667.641907 secs 2023-05-08T04:45:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3668.197972 secs 2023-05-08T04:45:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3668.197972 secs 2023-05-08T04:45:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3668.197972 secs 2023-05-08T04:45:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:30 smithi096 ceph-mon[124666]: pgmap v2020: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 95 B/s wr, 7 op/s 2023-05-08T04:45:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:30 smithi186 ceph-mon[126480]: pgmap v2020: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 95 B/s wr, 7 op/s 2023-05-08T04:45:30.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:30 smithi133 ceph-mon[125939]: pgmap v2020: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 95 B/s wr, 7 op/s 2023-05-08T04:45:32.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:32 smithi096 ceph-mon[124666]: pgmap v2021: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T04:45:32.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:32 smithi186 ceph-mon[126480]: pgmap v2021: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T04:45:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:32 smithi133 ceph-mon[125939]: pgmap v2021: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T04:45:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3672.642024 secs 2023-05-08T04:45:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:34 smithi133 ceph-mon[125939]: pgmap v2022: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:45:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3673.198089 secs 2023-05-08T04:45:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:34 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:45:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3672.642024 secs 2023-05-08T04:45:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:34 smithi096 ceph-mon[124666]: pgmap v2022: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:45:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3673.198089 secs 2023-05-08T04:45:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:34 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:45:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3672.642024 secs 2023-05-08T04:45:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:34 smithi186 ceph-mon[126480]: pgmap v2022: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:45:34.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3673.198089 secs 2023-05-08T04:45:34.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:34 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:45:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:35 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:45:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:35 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:45:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:35 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:45:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3674.476533 secs 2023-05-08T04:45:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:35 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:45:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:35 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:45:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:35 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:45:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3674.476533 secs 2023-05-08T04:45:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:35 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:45:35.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:35 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:45:35.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:35 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:45:35.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3674.476533 secs 2023-05-08T04:45:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:36 smithi096 ceph-mon[124666]: pgmap v2023: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 79 KiB/s wr, 9 op/s 2023-05-08T04:45:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:36 smithi186 ceph-mon[126480]: pgmap v2023: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 79 KiB/s wr, 9 op/s 2023-05-08T04:45:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:36 smithi133 ceph-mon[125939]: pgmap v2023: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 79 KiB/s wr, 9 op/s 2023-05-08T04:45:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:38 smithi186 ceph-mon[126480]: pgmap v2024: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 79 KiB/s wr, 6 op/s 2023-05-08T04:45:38.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3677.642128 secs 2023-05-08T04:45:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:38 smithi133 ceph-mon[125939]: pgmap v2024: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 79 KiB/s wr, 6 op/s 2023-05-08T04:45:38.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3677.642128 secs 2023-05-08T04:45:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:38 smithi096 ceph-mon[124666]: pgmap v2024: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 79 KiB/s wr, 6 op/s 2023-05-08T04:45:39.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3677.642128 secs 2023-05-08T04:45:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3678.198238 secs 2023-05-08T04:45:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:39 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:45:39.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:39 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:45:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3678.198238 secs 2023-05-08T04:45:39.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:39 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:45:39.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:39 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:45:40.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3678.198238 secs 2023-05-08T04:45:40.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:39 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:45:40.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:39 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:45:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:40 smithi186 ceph-mon[126480]: pgmap v2025: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 80 KiB/s wr, 9 op/s 2023-05-08T04:45:40.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3679.476671 secs 2023-05-08T04:45:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:40 smithi133 ceph-mon[125939]: pgmap v2025: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 80 KiB/s wr, 9 op/s 2023-05-08T04:45:40.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3679.476671 secs 2023-05-08T04:45:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:40 smithi096 ceph-mon[124666]: pgmap v2025: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 80 KiB/s wr, 9 op/s 2023-05-08T04:45:41.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3679.476671 secs 2023-05-08T04:45:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:42 smithi186 ceph-mon[126480]: pgmap v2026: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 113 KiB/s wr, 8 op/s 2023-05-08T04:45:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:42 smithi133 ceph-mon[125939]: pgmap v2026: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 113 KiB/s wr, 8 op/s 2023-05-08T04:45:43.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:42 smithi096 ceph-mon[124666]: pgmap v2026: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 113 KiB/s wr, 8 op/s 2023-05-08T04:45:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:43 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:45:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3682.642225 secs 2023-05-08T04:45:43.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:43 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:45:43.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:43 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:45:43.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:43 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:45:43.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:43 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:45:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:43 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:45:43.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3682.642225 secs 2023-05-08T04:45:43.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:43 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:45:43.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:43 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:45:43.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:43 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:45:43.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:43 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:45:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:43 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:45:44.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3682.642225 secs 2023-05-08T04:45:44.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:43 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:45:44.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:43 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:45:44.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:43 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:45:44.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:43 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:45:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:44 smithi186 ceph-mon[126480]: pgmap v2027: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 113 KiB/s wr, 8 op/s 2023-05-08T04:45:44.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:44 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:45:44.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:44 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T04:45:44.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:44 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T04:45:44.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:44 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:45:44.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3683.198354 secs 2023-05-08T04:45:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:44 smithi133 ceph-mon[125939]: pgmap v2027: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 113 KiB/s wr, 8 op/s 2023-05-08T04:45:44.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:44 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:45:44.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:44 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T04:45:44.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:44 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T04:45:44.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:44 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:45:44.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3683.198354 secs 2023-05-08T04:45:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:44 smithi096 ceph-mon[124666]: pgmap v2027: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 113 KiB/s wr, 8 op/s 2023-05-08T04:45:45.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:44 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:45:45.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:44 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T04:45:45.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:44 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T04:45:45.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:44 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:45:45.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3683.198354 secs 2023-05-08T04:45:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3684.476768 secs 2023-05-08T04:45:45.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3684.476768 secs 2023-05-08T04:45:46.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3684.476768 secs 2023-05-08T04:45:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:46 smithi186 ceph-mon[126480]: pgmap v2028: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 114 KiB/s wr, 11 op/s 2023-05-08T04:45:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:46 smithi133 ceph-mon[125939]: pgmap v2028: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 114 KiB/s wr, 11 op/s 2023-05-08T04:45:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:46 smithi096 ceph-mon[124666]: pgmap v2028: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 114 KiB/s wr, 11 op/s 2023-05-08T04:45:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:48 smithi186 ceph-mon[126480]: pgmap v2029: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 35 KiB/s wr, 6 op/s 2023-05-08T04:45:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3687.642357 secs 2023-05-08T04:45:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:48 smithi133 ceph-mon[125939]: pgmap v2029: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 35 KiB/s wr, 6 op/s 2023-05-08T04:45:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3687.642357 secs 2023-05-08T04:45:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:48 smithi096 ceph-mon[124666]: pgmap v2029: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 35 KiB/s wr, 6 op/s 2023-05-08T04:45:49.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3687.642357 secs 2023-05-08T04:45:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3688.198446 secs 2023-05-08T04:45:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3688.198446 secs 2023-05-08T04:45:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3688.198446 secs 2023-05-08T04:45:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:50 smithi186 ceph-mon[126480]: pgmap v2030: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 8 op/s 2023-05-08T04:45:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3689.476852 secs 2023-05-08T04:45:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:50 smithi133 ceph-mon[125939]: pgmap v2030: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 8 op/s 2023-05-08T04:45:50.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3689.476852 secs 2023-05-08T04:45:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:50 smithi096 ceph-mon[124666]: pgmap v2030: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 8 op/s 2023-05-08T04:45:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3689.476852 secs 2023-05-08T04:45:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:52 smithi186 ceph-mon[126480]: pgmap v2031: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 53 KiB/s wr, 7 op/s 2023-05-08T04:45:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:52 smithi133 ceph-mon[125939]: pgmap v2031: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 53 KiB/s wr, 7 op/s 2023-05-08T04:45:53.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:52 smithi096 ceph-mon[124666]: pgmap v2031: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 53 KiB/s wr, 7 op/s 2023-05-08T04:45:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3692.642436 secs 2023-05-08T04:45:54.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:54 smithi133 ceph-mon[125939]: pgmap v2032: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 6 op/s 2023-05-08T04:45:54.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3693.198577 secs 2023-05-08T04:45:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3692.642436 secs 2023-05-08T04:45:54.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:54 smithi096 ceph-mon[124666]: pgmap v2032: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 6 op/s 2023-05-08T04:45:54.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3693.198577 secs 2023-05-08T04:45:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3692.642436 secs 2023-05-08T04:45:54.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:54 smithi186 ceph-mon[126480]: pgmap v2032: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 6 op/s 2023-05-08T04:45:54.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3693.198577 secs 2023-05-08T04:45:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3694.476970 secs 2023-05-08T04:45:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3694.476970 secs 2023-05-08T04:45:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3694.476970 secs 2023-05-08T04:45:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:56 smithi133 ceph-mon[125939]: pgmap v2033: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 8 op/s 2023-05-08T04:45:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:56 smithi096 ceph-mon[124666]: pgmap v2033: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 8 op/s 2023-05-08T04:45:56.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:56 smithi186 ceph-mon[126480]: pgmap v2033: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 8 op/s 2023-05-08T04:45:58.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:58 smithi133 ceph-mon[125939]: pgmap v2034: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 5 op/s 2023-05-08T04:45:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:58 smithi096 ceph-mon[124666]: pgmap v2034: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 5 op/s 2023-05-08T04:45:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:58 smithi186 ceph-mon[126480]: pgmap v2034: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 5 op/s 2023-05-08T04:45:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3697.642538 secs 2023-05-08T04:45:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:45:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3698.198643 secs 2023-05-08T04:45:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3697.642538 secs 2023-05-08T04:45:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:45:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3698.198643 secs 2023-05-08T04:45:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3697.642538 secs 2023-05-08T04:45:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:45:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3698.198643 secs 2023-05-08T04:46:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:00 smithi133 ceph-mon[125939]: pgmap v2035: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 7 op/s 2023-05-08T04:46:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3699.477168 secs 2023-05-08T04:46:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:00 smithi096 ceph-mon[124666]: pgmap v2035: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 7 op/s 2023-05-08T04:46:00.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3699.477168 secs 2023-05-08T04:46:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:00 smithi186 ceph-mon[126480]: pgmap v2035: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 7 op/s 2023-05-08T04:46:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3699.477168 secs 2023-05-08T04:46:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:02 smithi133 ceph-mon[125939]: pgmap v2036: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 6 op/s 2023-05-08T04:46:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:02 smithi096 ceph-mon[124666]: pgmap v2036: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 6 op/s 2023-05-08T04:46:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:02 smithi186 ceph-mon[126480]: pgmap v2036: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 6 op/s 2023-05-08T04:46:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3702.642632 secs 2023-05-08T04:46:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:04 smithi133 ceph-mon[125939]: pgmap v2037: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 KiB/s wr, 5 op/s 2023-05-08T04:46:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3703.198753 secs 2023-05-08T04:46:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3702.642632 secs 2023-05-08T04:46:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:04 smithi096 ceph-mon[124666]: pgmap v2037: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 KiB/s wr, 5 op/s 2023-05-08T04:46:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3703.198753 secs 2023-05-08T04:46:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3702.642632 secs 2023-05-08T04:46:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:04 smithi186 ceph-mon[126480]: pgmap v2037: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 KiB/s wr, 5 op/s 2023-05-08T04:46:04.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3703.198753 secs 2023-05-08T04:46:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3704.477233 secs 2023-05-08T04:46:05.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3704.477233 secs 2023-05-08T04:46:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3704.477233 secs 2023-05-08T04:46:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:06 smithi133 ceph-mon[125939]: pgmap v2038: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 61 KiB/s wr, 22 op/s 2023-05-08T04:46:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:06 smithi096 ceph-mon[124666]: pgmap v2038: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 61 KiB/s wr, 22 op/s 2023-05-08T04:46:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:06 smithi186 ceph-mon[126480]: pgmap v2038: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 61 KiB/s wr, 22 op/s 2023-05-08T04:46:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:08 smithi133 ceph-mon[125939]: pgmap v2039: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 61 KiB/s wr, 19 op/s 2023-05-08T04:46:08.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3707.642742 secs 2023-05-08T04:46:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:08 smithi096 ceph-mon[124666]: pgmap v2039: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 61 KiB/s wr, 19 op/s 2023-05-08T04:46:08.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3707.642742 secs 2023-05-08T04:46:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:08 smithi186 ceph-mon[126480]: pgmap v2039: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 61 KiB/s wr, 19 op/s 2023-05-08T04:46:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3707.642742 secs 2023-05-08T04:46:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3708.198864 secs 2023-05-08T04:46:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3708.198864 secs 2023-05-08T04:46:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3708.198864 secs 2023-05-08T04:46:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:10 smithi096 ceph-mon[124666]: pgmap v2040: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 61 KiB/s wr, 21 op/s 2023-05-08T04:46:10.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3709.477339 secs 2023-05-08T04:46:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:10 smithi186 ceph-mon[126480]: pgmap v2040: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 61 KiB/s wr, 21 op/s 2023-05-08T04:46:10.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3709.477339 secs 2023-05-08T04:46:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:10 smithi133 ceph-mon[125939]: pgmap v2040: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 61 KiB/s wr, 21 op/s 2023-05-08T04:46:10.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3709.477339 secs 2023-05-08T04:46:11.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:11 smithi096 ceph-mon[124666]: osdmap e208: 12 total, 12 up, 12 in 2023-05-08T04:46:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:11 smithi186 ceph-mon[126480]: osdmap e208: 12 total, 12 up, 12 in 2023-05-08T04:46:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:11 smithi133 ceph-mon[125939]: osdmap e208: 12 total, 12 up, 12 in 2023-05-08T04:46:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:12 smithi186 ceph-mon[126480]: pgmap v2042: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:46:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:12 smithi133 ceph-mon[125939]: pgmap v2042: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:46:13.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:12 smithi096 ceph-mon[124666]: pgmap v2042: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:46:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3712.642875 secs 2023-05-08T04:46:14.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:14 smithi133 ceph-mon[125939]: pgmap v2043: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:46:14.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3713.199017 secs 2023-05-08T04:46:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3712.642875 secs 2023-05-08T04:46:14.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:14 smithi096 ceph-mon[124666]: pgmap v2043: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:46:14.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3713.199017 secs 2023-05-08T04:46:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3712.642875 secs 2023-05-08T04:46:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:14 smithi186 ceph-mon[126480]: pgmap v2043: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:46:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3713.199017 secs 2023-05-08T04:46:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3714.477430 secs 2023-05-08T04:46:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3714.477430 secs 2023-05-08T04:46:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3714.477430 secs 2023-05-08T04:46:16.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:16 smithi133 ceph-mon[125939]: pgmap v2044: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:46:16.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:16 smithi096 ceph-mon[124666]: pgmap v2044: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:46:16.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:16 smithi186 ceph-mon[126480]: pgmap v2044: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:46:18.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:18 smithi133 ceph-mon[125939]: pgmap v2045: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:46:18.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:18 smithi133 ceph-mon[125939]: osdmap e209: 12 total, 12 up, 12 in 2023-05-08T04:46:18.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:18 smithi096 ceph-mon[124666]: pgmap v2045: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:46:18.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:18 smithi096 ceph-mon[124666]: osdmap e209: 12 total, 12 up, 12 in 2023-05-08T04:46:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:18 smithi186 ceph-mon[126480]: pgmap v2045: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:46:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:18 smithi186 ceph-mon[126480]: osdmap e209: 12 total, 12 up, 12 in 2023-05-08T04:46:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3717.643007 secs 2023-05-08T04:46:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3718.199103 secs 2023-05-08T04:46:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3717.643007 secs 2023-05-08T04:46:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3718.199103 secs 2023-05-08T04:46:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3717.643007 secs 2023-05-08T04:46:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3718.199103 secs 2023-05-08T04:46:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:20 smithi133 ceph-mon[125939]: pgmap v2047: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 118 B/s wr, 6 op/s 2023-05-08T04:46:20.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3719.477508 secs 2023-05-08T04:46:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:20 smithi096 ceph-mon[124666]: pgmap v2047: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 118 B/s wr, 6 op/s 2023-05-08T04:46:20.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3719.477508 secs 2023-05-08T04:46:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:20 smithi186 ceph-mon[126480]: pgmap v2047: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 118 B/s wr, 6 op/s 2023-05-08T04:46:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3719.477508 secs 2023-05-08T04:46:22.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:22 smithi133 ceph-mon[125939]: pgmap v2048: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:46:22.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:22 smithi096 ceph-mon[124666]: pgmap v2048: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:46:22.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:22 smithi186 ceph-mon[126480]: pgmap v2048: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:46:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3722.643146 secs 2023-05-08T04:46:24.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:24 smithi133 ceph-mon[125939]: pgmap v2049: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:46:24.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3723.199242 secs 2023-05-08T04:46:24.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3722.643146 secs 2023-05-08T04:46:24.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:24 smithi096 ceph-mon[124666]: pgmap v2049: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:46:24.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3723.199242 secs 2023-05-08T04:46:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3722.643146 secs 2023-05-08T04:46:24.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:24 smithi186 ceph-mon[126480]: pgmap v2049: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:46:24.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3723.199242 secs 2023-05-08T04:46:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3724.477605 secs 2023-05-08T04:46:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3724.477605 secs 2023-05-08T04:46:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3724.477605 secs 2023-05-08T04:46:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:26 smithi096 ceph-mon[124666]: pgmap v2050: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:46:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:26 smithi186 ceph-mon[126480]: pgmap v2050: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:46:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:26 smithi133 ceph-mon[125939]: pgmap v2050: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:46:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:28 smithi096 ceph-mon[124666]: pgmap v2051: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:46:28.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3727.643264 secs 2023-05-08T04:46:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:28 smithi186 ceph-mon[126480]: pgmap v2051: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:46:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3727.643264 secs 2023-05-08T04:46:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:28 smithi133 ceph-mon[125939]: pgmap v2051: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:46:28.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3727.643264 secs 2023-05-08T04:46:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3728.199363 secs 2023-05-08T04:46:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3728.199363 secs 2023-05-08T04:46:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3728.199363 secs 2023-05-08T04:46:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:30 smithi096 ceph-mon[124666]: pgmap v2052: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 95 B/s wr, 7 op/s 2023-05-08T04:46:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:30 smithi186 ceph-mon[126480]: pgmap v2052: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 95 B/s wr, 7 op/s 2023-05-08T04:46:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:30 smithi133 ceph-mon[125939]: pgmap v2052: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 95 B/s wr, 7 op/s 2023-05-08T04:46:32.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:32 smithi096 ceph-mon[124666]: pgmap v2053: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T04:46:32.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:32 smithi186 ceph-mon[126480]: pgmap v2053: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T04:46:32.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:32 smithi133 ceph-mon[125939]: pgmap v2053: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T04:46:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3732.643404 secs 2023-05-08T04:46:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:34 smithi133 ceph-mon[125939]: pgmap v2054: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:46:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3733.199501 secs 2023-05-08T04:46:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:34 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:46:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3732.643404 secs 2023-05-08T04:46:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:34 smithi096 ceph-mon[124666]: pgmap v2054: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:46:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3733.199501 secs 2023-05-08T04:46:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:34 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:46:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3732.643404 secs 2023-05-08T04:46:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:34 smithi186 ceph-mon[126480]: pgmap v2054: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:46:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3733.199501 secs 2023-05-08T04:46:34.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:34 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:46:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:35 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:46:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:35 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:46:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:35 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:46:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3734.477862 secs 2023-05-08T04:46:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:35 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:46:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:35 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:46:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:35 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:46:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3734.477862 secs 2023-05-08T04:46:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:35 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:46:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:35 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:46:35.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:35 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:46:35.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3734.477862 secs 2023-05-08T04:46:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:36 smithi186 ceph-mon[126480]: pgmap v2055: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 99 KiB/s wr, 9 op/s 2023-05-08T04:46:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:36 smithi133 ceph-mon[125939]: pgmap v2055: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 99 KiB/s wr, 9 op/s 2023-05-08T04:46:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:36 smithi096 ceph-mon[124666]: pgmap v2055: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 99 KiB/s wr, 9 op/s 2023-05-08T04:46:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:38 smithi186 ceph-mon[126480]: pgmap v2056: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 99 KiB/s wr, 7 op/s 2023-05-08T04:46:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3737.643527 secs 2023-05-08T04:46:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:38 smithi133 ceph-mon[125939]: pgmap v2056: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 99 KiB/s wr, 7 op/s 2023-05-08T04:46:38.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3737.643527 secs 2023-05-08T04:46:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:38 smithi096 ceph-mon[124666]: pgmap v2056: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 99 KiB/s wr, 7 op/s 2023-05-08T04:46:39.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3737.643527 secs 2023-05-08T04:46:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3738.199568 secs 2023-05-08T04:46:39.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:39 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:46:39.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:39 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:46:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3738.199568 secs 2023-05-08T04:46:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:39 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:46:39.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:39 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:46:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3738.199568 secs 2023-05-08T04:46:40.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:39 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:46:40.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:39 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:46:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:40 smithi186 ceph-mon[126480]: pgmap v2057: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 134 KiB/s wr, 10 op/s 2023-05-08T04:46:40.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3739.478005 secs 2023-05-08T04:46:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:40 smithi133 ceph-mon[125939]: pgmap v2057: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 134 KiB/s wr, 10 op/s 2023-05-08T04:46:40.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3739.478005 secs 2023-05-08T04:46:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:40 smithi096 ceph-mon[124666]: pgmap v2057: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 134 KiB/s wr, 10 op/s 2023-05-08T04:46:41.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3739.478005 secs 2023-05-08T04:46:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:42 smithi186 ceph-mon[126480]: pgmap v2058: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 135 KiB/s wr, 10 op/s 2023-05-08T04:46:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:42 smithi133 ceph-mon[125939]: pgmap v2058: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 135 KiB/s wr, 10 op/s 2023-05-08T04:46:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:42 smithi096 ceph-mon[124666]: pgmap v2058: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 135 KiB/s wr, 10 op/s 2023-05-08T04:46:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3742.643648 secs 2023-05-08T04:46:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:43 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:46:43.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:43 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:46:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3742.643648 secs 2023-05-08T04:46:43.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:43 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:46:43.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:43 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:46:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3742.643648 secs 2023-05-08T04:46:44.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:43 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:46:44.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:43 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:46:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:44 smithi186 ceph-mon[126480]: pgmap v2059: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 135 KiB/s wr, 9 op/s 2023-05-08T04:46:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3743.199683 secs 2023-05-08T04:46:44.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:44 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:46:44.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:44 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:46:44.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:44 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:46:44.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:44 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:46:44.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:44 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:46:44.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:44 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:46:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:44 smithi133 ceph-mon[125939]: pgmap v2059: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 135 KiB/s wr, 9 op/s 2023-05-08T04:46:44.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3743.199683 secs 2023-05-08T04:46:44.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:44 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:46:44.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:44 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:46:44.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:44 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:46:44.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:44 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:46:44.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:44 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:46:44.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:44 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:46:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:44 smithi096 ceph-mon[124666]: pgmap v2059: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 135 KiB/s wr, 9 op/s 2023-05-08T04:46:45.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3743.199683 secs 2023-05-08T04:46:45.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:44 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:46:45.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:44 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:46:45.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:44 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:46:45.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:44 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:46:45.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:44 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:46:45.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:44 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:46:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:46:45.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:46:45.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:45 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:46:45.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:46:45.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:45 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T04:46:45.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:45 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T04:46:45.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:45 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:46:45.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3744.478111 secs 2023-05-08T04:46:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:46:45.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:46:45.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:45 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:46:45.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:46:45.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:45 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T04:46:45.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:45 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T04:46:45.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:45 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:46:45.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3744.478111 secs 2023-05-08T04:46:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:46:46.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:46:46.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:45 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:46:46.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:46:46.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:45 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T04:46:46.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:45 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T04:46:46.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:45 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:46:46.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3744.478111 secs 2023-05-08T04:46:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:46 smithi133 ceph-mon[125939]: pgmap v2060: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 135 KiB/s wr, 12 op/s 2023-05-08T04:46:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:46 smithi096 ceph-mon[124666]: pgmap v2060: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 135 KiB/s wr, 12 op/s 2023-05-08T04:46:47.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:46 smithi186 ceph-mon[126480]: pgmap v2060: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 135 KiB/s wr, 12 op/s 2023-05-08T04:46:48.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:48 smithi133 ceph-mon[125939]: pgmap v2061: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 7 op/s 2023-05-08T04:46:48.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3747.643769 secs 2023-05-08T04:46:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:48 smithi096 ceph-mon[124666]: pgmap v2061: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 7 op/s 2023-05-08T04:46:49.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3747.643769 secs 2023-05-08T04:46:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:48 smithi186 ceph-mon[126480]: pgmap v2061: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 7 op/s 2023-05-08T04:46:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3747.643769 secs 2023-05-08T04:46:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3748.199798 secs 2023-05-08T04:46:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3748.199798 secs 2023-05-08T04:46:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3748.199798 secs 2023-05-08T04:46:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:50 smithi133 ceph-mon[125939]: pgmap v2062: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 55 KiB/s wr, 10 op/s 2023-05-08T04:46:50.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3749.478228 secs 2023-05-08T04:46:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:50 smithi096 ceph-mon[124666]: pgmap v2062: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 55 KiB/s wr, 10 op/s 2023-05-08T04:46:51.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3749.478228 secs 2023-05-08T04:46:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:50 smithi186 ceph-mon[126480]: pgmap v2062: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 55 KiB/s wr, 10 op/s 2023-05-08T04:46:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3749.478228 secs 2023-05-08T04:46:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:52 smithi133 ceph-mon[125939]: pgmap v2063: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 7 op/s 2023-05-08T04:46:53.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:52 smithi096 ceph-mon[124666]: pgmap v2063: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 7 op/s 2023-05-08T04:46:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:52 smithi186 ceph-mon[126480]: pgmap v2063: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 7 op/s 2023-05-08T04:46:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3752.643884 secs 2023-05-08T04:46:54.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:54 smithi133 ceph-mon[125939]: pgmap v2064: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 6 op/s 2023-05-08T04:46:54.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3753.199942 secs 2023-05-08T04:46:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3752.643884 secs 2023-05-08T04:46:54.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:54 smithi096 ceph-mon[124666]: pgmap v2064: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 6 op/s 2023-05-08T04:46:54.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3753.199942 secs 2023-05-08T04:46:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3752.643884 secs 2023-05-08T04:46:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:54 smithi186 ceph-mon[126480]: pgmap v2064: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 6 op/s 2023-05-08T04:46:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3753.199942 secs 2023-05-08T04:46:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3754.478308 secs 2023-05-08T04:46:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3754.478308 secs 2023-05-08T04:46:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3754.478308 secs 2023-05-08T04:46:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:56 smithi133 ceph-mon[125939]: pgmap v2065: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 19 KiB/s wr, 8 op/s 2023-05-08T04:46:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:56 smithi096 ceph-mon[124666]: pgmap v2065: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 19 KiB/s wr, 8 op/s 2023-05-08T04:46:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:56 smithi186 ceph-mon[126480]: pgmap v2065: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 19 KiB/s wr, 8 op/s 2023-05-08T04:46:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:58 smithi133 ceph-mon[125939]: pgmap v2066: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 5 op/s 2023-05-08T04:46:58.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:58 smithi096 ceph-mon[124666]: pgmap v2066: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 5 op/s 2023-05-08T04:46:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:58 smithi186 ceph-mon[126480]: pgmap v2066: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 5 op/s 2023-05-08T04:46:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3757.644001 secs 2023-05-08T04:46:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:46:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3758.200030 secs 2023-05-08T04:46:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3757.644001 secs 2023-05-08T04:46:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:46:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3758.200030 secs 2023-05-08T04:46:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3757.644001 secs 2023-05-08T04:46:59.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:46:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3758.200030 secs 2023-05-08T04:47:00.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:00 smithi096 ceph-mon[124666]: pgmap v2067: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 35 KiB/s wr, 7 op/s 2023-05-08T04:47:00.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3759.478428 secs 2023-05-08T04:47:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:00 smithi186 ceph-mon[126480]: pgmap v2067: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 35 KiB/s wr, 7 op/s 2023-05-08T04:47:00.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3759.478428 secs 2023-05-08T04:47:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:00 smithi133 ceph-mon[125939]: pgmap v2067: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 35 KiB/s wr, 7 op/s 2023-05-08T04:47:00.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3759.478428 secs 2023-05-08T04:47:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:02 smithi096 ceph-mon[124666]: pgmap v2068: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 16 KiB/s wr, 5 op/s 2023-05-08T04:47:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:02 smithi186 ceph-mon[126480]: pgmap v2068: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 16 KiB/s wr, 5 op/s 2023-05-08T04:47:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:02 smithi133 ceph-mon[125939]: pgmap v2068: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 16 KiB/s wr, 5 op/s 2023-05-08T04:47:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3762.644129 secs 2023-05-08T04:47:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:04 smithi133 ceph-mon[125939]: pgmap v2069: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 16 KiB/s wr, 5 op/s 2023-05-08T04:47:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3763.200116 secs 2023-05-08T04:47:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3762.644129 secs 2023-05-08T04:47:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:04 smithi096 ceph-mon[124666]: pgmap v2069: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 16 KiB/s wr, 5 op/s 2023-05-08T04:47:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3763.200116 secs 2023-05-08T04:47:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3762.644129 secs 2023-05-08T04:47:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:04 smithi186 ceph-mon[126480]: pgmap v2069: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 16 KiB/s wr, 5 op/s 2023-05-08T04:47:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3763.200116 secs 2023-05-08T04:47:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3764.478565 secs 2023-05-08T04:47:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3764.478565 secs 2023-05-08T04:47:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3764.478565 secs 2023-05-08T04:47:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:06 smithi133 ceph-mon[125939]: pgmap v2070: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 61 KiB/s wr, 22 op/s 2023-05-08T04:47:06.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:06 smithi096 ceph-mon[124666]: pgmap v2070: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 61 KiB/s wr, 22 op/s 2023-05-08T04:47:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:06 smithi186 ceph-mon[126480]: pgmap v2070: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 61 KiB/s wr, 22 op/s 2023-05-08T04:47:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:08 smithi133 ceph-mon[125939]: pgmap v2071: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 61 KiB/s wr, 19 op/s 2023-05-08T04:47:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:08 smithi096 ceph-mon[124666]: pgmap v2071: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 61 KiB/s wr, 19 op/s 2023-05-08T04:47:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:08 smithi186 ceph-mon[126480]: pgmap v2071: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 61 KiB/s wr, 19 op/s 2023-05-08T04:47:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3767.644242 secs 2023-05-08T04:47:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3768.200207 secs 2023-05-08T04:47:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3767.644242 secs 2023-05-08T04:47:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3768.200207 secs 2023-05-08T04:47:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3767.644242 secs 2023-05-08T04:47:09.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3768.200207 secs 2023-05-08T04:47:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:10 smithi096 ceph-mon[124666]: pgmap v2072: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 61 KiB/s wr, 22 op/s 2023-05-08T04:47:10.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3769.478706 secs 2023-05-08T04:47:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:10 smithi186 ceph-mon[126480]: pgmap v2072: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 61 KiB/s wr, 22 op/s 2023-05-08T04:47:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3769.478706 secs 2023-05-08T04:47:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:10 smithi133 ceph-mon[125939]: pgmap v2072: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 61 KiB/s wr, 22 op/s 2023-05-08T04:47:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3769.478706 secs 2023-05-08T04:47:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:11 smithi096 ceph-mon[124666]: osdmap e210: 12 total, 12 up, 12 in 2023-05-08T04:47:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:11 smithi186 ceph-mon[126480]: osdmap e210: 12 total, 12 up, 12 in 2023-05-08T04:47:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:11 smithi133 ceph-mon[125939]: osdmap e210: 12 total, 12 up, 12 in 2023-05-08T04:47:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:12 smithi096 ceph-mon[124666]: pgmap v2074: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:47:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:12 smithi186 ceph-mon[126480]: pgmap v2074: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:47:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:12 smithi133 ceph-mon[125939]: pgmap v2074: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:47:14.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3772.644385 secs 2023-05-08T04:47:14.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:14 smithi133 ceph-mon[125939]: pgmap v2075: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:47:14.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3773.200300 secs 2023-05-08T04:47:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3772.644385 secs 2023-05-08T04:47:14.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:14 smithi096 ceph-mon[124666]: pgmap v2075: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:47:14.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3773.200300 secs 2023-05-08T04:47:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3772.644385 secs 2023-05-08T04:47:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:14 smithi186 ceph-mon[126480]: pgmap v2075: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:47:14.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3773.200300 secs 2023-05-08T04:47:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3774.478840 secs 2023-05-08T04:47:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3774.478840 secs 2023-05-08T04:47:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3774.478840 secs 2023-05-08T04:47:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:16 smithi133 ceph-mon[125939]: pgmap v2076: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:47:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:16 smithi096 ceph-mon[124666]: pgmap v2076: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:47:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:16 smithi186 ceph-mon[126480]: pgmap v2076: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:47:18.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:18 smithi133 ceph-mon[125939]: pgmap v2077: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:47:18.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:18 smithi133 ceph-mon[125939]: osdmap e211: 12 total, 12 up, 12 in 2023-05-08T04:47:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:18 smithi096 ceph-mon[124666]: pgmap v2077: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:47:18.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:18 smithi096 ceph-mon[124666]: osdmap e211: 12 total, 12 up, 12 in 2023-05-08T04:47:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:18 smithi186 ceph-mon[126480]: pgmap v2077: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:47:18.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:18 smithi186 ceph-mon[126480]: osdmap e211: 12 total, 12 up, 12 in 2023-05-08T04:47:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3777.644510 secs 2023-05-08T04:47:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3778.200424 secs 2023-05-08T04:47:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3777.644510 secs 2023-05-08T04:47:19.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3778.200424 secs 2023-05-08T04:47:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3777.644510 secs 2023-05-08T04:47:19.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3778.200424 secs 2023-05-08T04:47:20.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:20 smithi096 ceph-mon[124666]: pgmap v2079: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 236 B/s wr, 7 op/s 2023-05-08T04:47:20.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3779.478987 secs 2023-05-08T04:47:20.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:20 smithi186 ceph-mon[126480]: pgmap v2079: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 236 B/s wr, 7 op/s 2023-05-08T04:47:20.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3779.478987 secs 2023-05-08T04:47:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:20 smithi133 ceph-mon[125939]: pgmap v2079: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 236 B/s wr, 7 op/s 2023-05-08T04:47:20.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3779.478987 secs 2023-05-08T04:47:22.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:22 smithi096 ceph-mon[124666]: pgmap v2080: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:47:22.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:22 smithi186 ceph-mon[126480]: pgmap v2080: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:47:22.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:22 smithi133 ceph-mon[125939]: pgmap v2080: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:47:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3782.644638 secs 2023-05-08T04:47:24.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:24 smithi133 ceph-mon[125939]: pgmap v2081: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:47:24.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3783.200544 secs 2023-05-08T04:47:24.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3782.644638 secs 2023-05-08T04:47:24.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:24 smithi096 ceph-mon[124666]: pgmap v2081: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:47:24.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3783.200544 secs 2023-05-08T04:47:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3782.644638 secs 2023-05-08T04:47:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:24 smithi186 ceph-mon[126480]: pgmap v2081: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:47:24.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3783.200544 secs 2023-05-08T04:47:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3784.479068 secs 2023-05-08T04:47:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3784.479068 secs 2023-05-08T04:47:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3784.479068 secs 2023-05-08T04:47:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:26 smithi096 ceph-mon[124666]: pgmap v2082: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:47:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:26 smithi186 ceph-mon[126480]: pgmap v2082: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:47:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:26 smithi133 ceph-mon[125939]: pgmap v2082: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:47:28.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:28 smithi096 ceph-mon[124666]: pgmap v2083: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:47:28.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3787.644751 secs 2023-05-08T04:47:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:28 smithi186 ceph-mon[126480]: pgmap v2083: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:47:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3787.644751 secs 2023-05-08T04:47:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:28 smithi133 ceph-mon[125939]: pgmap v2083: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:47:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3787.644751 secs 2023-05-08T04:47:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3788.200681 secs 2023-05-08T04:47:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3788.200681 secs 2023-05-08T04:47:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3788.200681 secs 2023-05-08T04:47:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:30 smithi096 ceph-mon[124666]: pgmap v2084: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 95 B/s wr, 8 op/s 2023-05-08T04:47:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:30 smithi186 ceph-mon[126480]: pgmap v2084: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 95 B/s wr, 8 op/s 2023-05-08T04:47:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:30 smithi133 ceph-mon[125939]: pgmap v2084: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 95 B/s wr, 8 op/s 2023-05-08T04:47:32.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:32 smithi186 ceph-mon[126480]: pgmap v2085: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2023-05-08T04:47:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:32 smithi133 ceph-mon[125939]: pgmap v2085: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2023-05-08T04:47:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:32 smithi096 ceph-mon[124666]: pgmap v2085: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2023-05-08T04:47:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3792.644882 secs 2023-05-08T04:47:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:34 smithi133 ceph-mon[125939]: pgmap v2086: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2023-05-08T04:47:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3793.200819 secs 2023-05-08T04:47:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:34 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:47:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3792.644882 secs 2023-05-08T04:47:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:34 smithi096 ceph-mon[124666]: pgmap v2086: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2023-05-08T04:47:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3793.200819 secs 2023-05-08T04:47:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:34 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:47:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3792.644882 secs 2023-05-08T04:47:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:34 smithi186 ceph-mon[126480]: pgmap v2086: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2023-05-08T04:47:34.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3793.200819 secs 2023-05-08T04:47:34.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:34 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:47:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:35 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:47:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:35 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:47:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:35 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:47:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3794.479213 secs 2023-05-08T04:47:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:35 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:47:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:35 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:47:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:35 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:47:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3794.479213 secs 2023-05-08T04:47:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:35 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:47:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:35 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:47:35.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:35 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:47:35.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3794.479213 secs 2023-05-08T04:47:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:36 smithi186 ceph-mon[126480]: pgmap v2087: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 81 KiB/s wr, 9 op/s 2023-05-08T04:47:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:36 smithi133 ceph-mon[125939]: pgmap v2087: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 81 KiB/s wr, 9 op/s 2023-05-08T04:47:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:36 smithi096 ceph-mon[124666]: pgmap v2087: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 81 KiB/s wr, 9 op/s 2023-05-08T04:47:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:38 smithi186 ceph-mon[126480]: pgmap v2088: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 81 KiB/s wr, 6 op/s 2023-05-08T04:47:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3797.644999 secs 2023-05-08T04:47:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:38 smithi133 ceph-mon[125939]: pgmap v2088: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 81 KiB/s wr, 6 op/s 2023-05-08T04:47:38.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3797.644999 secs 2023-05-08T04:47:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:38 smithi096 ceph-mon[124666]: pgmap v2088: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 81 KiB/s wr, 6 op/s 2023-05-08T04:47:39.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3797.644999 secs 2023-05-08T04:47:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3798.200973 secs 2023-05-08T04:47:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:39 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:47:39.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:39 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:47:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3798.200973 secs 2023-05-08T04:47:39.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:39 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:47:39.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:39 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:47:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3798.200973 secs 2023-05-08T04:47:40.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:39 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:47:40.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:39 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:47:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:40 smithi186 ceph-mon[126480]: pgmap v2089: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 117 KiB/s wr, 10 op/s 2023-05-08T04:47:40.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3799.479367 secs 2023-05-08T04:47:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:40 smithi133 ceph-mon[125939]: pgmap v2089: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 117 KiB/s wr, 10 op/s 2023-05-08T04:47:40.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3799.479367 secs 2023-05-08T04:47:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:40 smithi096 ceph-mon[124666]: pgmap v2089: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 117 KiB/s wr, 10 op/s 2023-05-08T04:47:41.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3799.479367 secs 2023-05-08T04:47:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:42 smithi186 ceph-mon[126480]: pgmap v2090: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 117 KiB/s wr, 8 op/s 2023-05-08T04:47:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:42 smithi133 ceph-mon[125939]: pgmap v2090: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 117 KiB/s wr, 8 op/s 2023-05-08T04:47:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:42 smithi096 ceph-mon[124666]: pgmap v2090: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 117 KiB/s wr, 8 op/s 2023-05-08T04:47:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3802.645090 secs 2023-05-08T04:47:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:43 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:47:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3802.645090 secs 2023-05-08T04:47:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:43 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:47:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3802.645090 secs 2023-05-08T04:47:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:43 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:47:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:44 smithi186 ceph-mon[126480]: pgmap v2091: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 117 KiB/s wr, 8 op/s 2023-05-08T04:47:44.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3803.201096 secs 2023-05-08T04:47:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:44 smithi133 ceph-mon[125939]: pgmap v2091: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 117 KiB/s wr, 8 op/s 2023-05-08T04:47:44.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3803.201096 secs 2023-05-08T04:47:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:44 smithi096 ceph-mon[124666]: pgmap v2091: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 117 KiB/s wr, 8 op/s 2023-05-08T04:47:45.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3803.201096 secs 2023-05-08T04:47:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:47:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3804.479503 secs 2023-05-08T04:47:45.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:47:45.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:47:45.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:47:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:47:45.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3804.479503 secs 2023-05-08T04:47:45.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:47:45.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:47:45.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:47:46.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:47:46.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3804.479503 secs 2023-05-08T04:47:46.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:47:46.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:47:46.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:47:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:46 smithi186 ceph-mon[126480]: pgmap v2092: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 117 KiB/s wr, 11 op/s 2023-05-08T04:47:46.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:46 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:47:46.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:46 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T04:47:46.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:46 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T04:47:46.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:46 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:47:46.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:46 smithi133 ceph-mon[125939]: pgmap v2092: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 117 KiB/s wr, 11 op/s 2023-05-08T04:47:46.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:46 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:47:46.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:46 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T04:47:46.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:46 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T04:47:46.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:46 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:47:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:46 smithi096 ceph-mon[124666]: pgmap v2092: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 117 KiB/s wr, 11 op/s 2023-05-08T04:47:47.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:46 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:47:47.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:46 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T04:47:47.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:46 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T04:47:47.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:46 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:47:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:48 smithi186 ceph-mon[126480]: pgmap v2093: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 36 KiB/s wr, 7 op/s 2023-05-08T04:47:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3807.645194 secs 2023-05-08T04:47:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:48 smithi133 ceph-mon[125939]: pgmap v2093: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 36 KiB/s wr, 7 op/s 2023-05-08T04:47:48.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3807.645194 secs 2023-05-08T04:47:49.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:48 smithi096 ceph-mon[124666]: pgmap v2093: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 36 KiB/s wr, 7 op/s 2023-05-08T04:47:49.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3807.645194 secs 2023-05-08T04:47:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3808.201207 secs 2023-05-08T04:47:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3808.201207 secs 2023-05-08T04:47:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3808.201207 secs 2023-05-08T04:47:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:50 smithi186 ceph-mon[126480]: pgmap v2094: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 55 KiB/s wr, 9 op/s 2023-05-08T04:47:50.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3809.479641 secs 2023-05-08T04:47:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:50 smithi133 ceph-mon[125939]: pgmap v2094: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 55 KiB/s wr, 9 op/s 2023-05-08T04:47:50.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3809.479641 secs 2023-05-08T04:47:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:50 smithi096 ceph-mon[124666]: pgmap v2094: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 55 KiB/s wr, 9 op/s 2023-05-08T04:47:51.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3809.479641 secs 2023-05-08T04:47:52.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:52 smithi186 ceph-mon[126480]: pgmap v2095: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 6 op/s 2023-05-08T04:47:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:52 smithi133 ceph-mon[125939]: pgmap v2095: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 6 op/s 2023-05-08T04:47:53.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:52 smithi096 ceph-mon[124666]: pgmap v2095: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 6 op/s 2023-05-08T04:47:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3812.645291 secs 2023-05-08T04:47:54.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:54 smithi133 ceph-mon[125939]: pgmap v2096: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 5 op/s 2023-05-08T04:47:54.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3813.201324 secs 2023-05-08T04:47:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3812.645291 secs 2023-05-08T04:47:54.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:54 smithi096 ceph-mon[124666]: pgmap v2096: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 5 op/s 2023-05-08T04:47:54.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3813.201324 secs 2023-05-08T04:47:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3812.645291 secs 2023-05-08T04:47:54.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:54 smithi186 ceph-mon[126480]: pgmap v2096: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 5 op/s 2023-05-08T04:47:54.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3813.201324 secs 2023-05-08T04:47:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3814.479788 secs 2023-05-08T04:47:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3814.479788 secs 2023-05-08T04:47:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3814.479788 secs 2023-05-08T04:47:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:56 smithi096 ceph-mon[124666]: pgmap v2097: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 8 op/s 2023-05-08T04:47:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:56 smithi186 ceph-mon[126480]: pgmap v2097: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 8 op/s 2023-05-08T04:47:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:56 smithi133 ceph-mon[125939]: pgmap v2097: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 8 op/s 2023-05-08T04:47:58.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:58 smithi096 ceph-mon[124666]: pgmap v2098: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 5 op/s 2023-05-08T04:47:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:58 smithi186 ceph-mon[126480]: pgmap v2098: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 5 op/s 2023-05-08T04:47:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:58 smithi133 ceph-mon[125939]: pgmap v2098: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 5 op/s 2023-05-08T04:47:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3817.645452 secs 2023-05-08T04:47:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:47:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3818.201436 secs 2023-05-08T04:47:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3817.645452 secs 2023-05-08T04:47:59.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:47:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3818.201436 secs 2023-05-08T04:48:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3817.645452 secs 2023-05-08T04:48:00.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:47:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3818.201436 secs 2023-05-08T04:48:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:00 smithi186 ceph-mon[126480]: pgmap v2099: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 8 op/s 2023-05-08T04:48:00.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3819.479917 secs 2023-05-08T04:48:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:00 smithi133 ceph-mon[125939]: pgmap v2099: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 8 op/s 2023-05-08T04:48:00.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3819.479917 secs 2023-05-08T04:48:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:00 smithi096 ceph-mon[124666]: pgmap v2099: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 8 op/s 2023-05-08T04:48:01.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3819.479917 secs 2023-05-08T04:48:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:02 smithi186 ceph-mon[126480]: pgmap v2100: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 16 KiB/s wr, 5 op/s 2023-05-08T04:48:02.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:02 smithi133 ceph-mon[125939]: pgmap v2100: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 16 KiB/s wr, 5 op/s 2023-05-08T04:48:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:02 smithi096 ceph-mon[124666]: pgmap v2100: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 16 KiB/s wr, 5 op/s 2023-05-08T04:48:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3822.645576 secs 2023-05-08T04:48:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:04 smithi133 ceph-mon[125939]: pgmap v2101: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 16 KiB/s wr, 5 op/s 2023-05-08T04:48:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3823.201575 secs 2023-05-08T04:48:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3822.645576 secs 2023-05-08T04:48:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:04 smithi096 ceph-mon[124666]: pgmap v2101: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 16 KiB/s wr, 5 op/s 2023-05-08T04:48:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3823.201575 secs 2023-05-08T04:48:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3822.645576 secs 2023-05-08T04:48:04.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:04 smithi186 ceph-mon[126480]: pgmap v2101: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 16 KiB/s wr, 5 op/s 2023-05-08T04:48:04.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3823.201575 secs 2023-05-08T04:48:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3824.479984 secs 2023-05-08T04:48:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3824.479984 secs 2023-05-08T04:48:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3824.479984 secs 2023-05-08T04:48:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:06 smithi096 ceph-mon[124666]: pgmap v2102: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 61 KiB/s wr, 22 op/s 2023-05-08T04:48:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:06 smithi186 ceph-mon[126480]: pgmap v2102: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 61 KiB/s wr, 22 op/s 2023-05-08T04:48:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:06 smithi133 ceph-mon[125939]: pgmap v2102: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 61 KiB/s wr, 22 op/s 2023-05-08T04:48:08.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:08 smithi096 ceph-mon[124666]: pgmap v2103: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 61 KiB/s wr, 19 op/s 2023-05-08T04:48:08.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3827.645701 secs 2023-05-08T04:48:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:08 smithi186 ceph-mon[126480]: pgmap v2103: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 61 KiB/s wr, 19 op/s 2023-05-08T04:48:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3827.645701 secs 2023-05-08T04:48:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:08 smithi133 ceph-mon[125939]: pgmap v2103: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 61 KiB/s wr, 19 op/s 2023-05-08T04:48:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3827.645701 secs 2023-05-08T04:48:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3828.201712 secs 2023-05-08T04:48:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3828.201712 secs 2023-05-08T04:48:10.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3828.201712 secs 2023-05-08T04:48:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:10 smithi186 ceph-mon[126480]: pgmap v2104: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 61 KiB/s wr, 22 op/s 2023-05-08T04:48:10.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3829.480106 secs 2023-05-08T04:48:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:10 smithi133 ceph-mon[125939]: pgmap v2104: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 61 KiB/s wr, 22 op/s 2023-05-08T04:48:10.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3829.480106 secs 2023-05-08T04:48:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:10 smithi096 ceph-mon[124666]: pgmap v2104: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 61 KiB/s wr, 22 op/s 2023-05-08T04:48:11.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3829.480106 secs 2023-05-08T04:48:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:11 smithi186 ceph-mon[126480]: osdmap e212: 12 total, 12 up, 12 in 2023-05-08T04:48:11.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:11 smithi133 ceph-mon[125939]: osdmap e212: 12 total, 12 up, 12 in 2023-05-08T04:48:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:11 smithi096 ceph-mon[124666]: osdmap e212: 12 total, 12 up, 12 in 2023-05-08T04:48:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:12 smithi186 ceph-mon[126480]: pgmap v2106: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:48:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:12 smithi133 ceph-mon[125939]: pgmap v2106: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:48:13.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:12 smithi096 ceph-mon[124666]: pgmap v2106: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:48:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3832.645822 secs 2023-05-08T04:48:14.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:14 smithi096 ceph-mon[124666]: pgmap v2107: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:48:14.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3833.201777 secs 2023-05-08T04:48:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3832.645822 secs 2023-05-08T04:48:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:14 smithi186 ceph-mon[126480]: pgmap v2107: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:48:14.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3833.201777 secs 2023-05-08T04:48:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3832.645822 secs 2023-05-08T04:48:14.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:14 smithi133 ceph-mon[125939]: pgmap v2107: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:48:14.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3833.201777 secs 2023-05-08T04:48:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3834.480228 secs 2023-05-08T04:48:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3834.480228 secs 2023-05-08T04:48:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3834.480228 secs 2023-05-08T04:48:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:16 smithi096 ceph-mon[124666]: pgmap v2108: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:48:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:16 smithi186 ceph-mon[126480]: pgmap v2108: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:48:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:16 smithi133 ceph-mon[125939]: pgmap v2108: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:48:18.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:18 smithi096 ceph-mon[124666]: pgmap v2109: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:48:18.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:18 smithi096 ceph-mon[124666]: osdmap e213: 12 total, 12 up, 12 in 2023-05-08T04:48:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:18 smithi186 ceph-mon[126480]: pgmap v2109: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:48:18.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:18 smithi186 ceph-mon[126480]: osdmap e213: 12 total, 12 up, 12 in 2023-05-08T04:48:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:18 smithi133 ceph-mon[125939]: pgmap v2109: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:48:18.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:18 smithi133 ceph-mon[125939]: osdmap e213: 12 total, 12 up, 12 in 2023-05-08T04:48:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3837.645953 secs 2023-05-08T04:48:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3838.201896 secs 2023-05-08T04:48:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3837.645953 secs 2023-05-08T04:48:19.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3838.201896 secs 2023-05-08T04:48:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3837.645953 secs 2023-05-08T04:48:20.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3838.201896 secs 2023-05-08T04:48:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:20 smithi186 ceph-mon[126480]: pgmap v2111: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 236 B/s wr, 7 op/s 2023-05-08T04:48:20.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3839.480365 secs 2023-05-08T04:48:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:20 smithi133 ceph-mon[125939]: pgmap v2111: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 236 B/s wr, 7 op/s 2023-05-08T04:48:20.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3839.480365 secs 2023-05-08T04:48:21.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:20 smithi096 ceph-mon[124666]: pgmap v2111: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 236 B/s wr, 7 op/s 2023-05-08T04:48:21.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3839.480365 secs 2023-05-08T04:48:22.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:22 smithi186 ceph-mon[126480]: pgmap v2112: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:48:22.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:22 smithi133 ceph-mon[125939]: pgmap v2112: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:48:23.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:22 smithi096 ceph-mon[124666]: pgmap v2112: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:48:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3842.646092 secs 2023-05-08T04:48:24.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:24 smithi096 ceph-mon[124666]: pgmap v2113: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:48:24.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3843.202010 secs 2023-05-08T04:48:24.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3842.646092 secs 2023-05-08T04:48:24.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:24 smithi186 ceph-mon[126480]: pgmap v2113: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:48:24.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3843.202010 secs 2023-05-08T04:48:24.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3842.646092 secs 2023-05-08T04:48:24.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:24 smithi133 ceph-mon[125939]: pgmap v2113: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:48:24.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3843.202010 secs 2023-05-08T04:48:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3844.480463 secs 2023-05-08T04:48:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3844.480463 secs 2023-05-08T04:48:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3844.480463 secs 2023-05-08T04:48:26.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:26 smithi096 ceph-mon[124666]: pgmap v2114: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:48:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:26 smithi186 ceph-mon[126480]: pgmap v2114: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:48:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:26 smithi133 ceph-mon[125939]: pgmap v2114: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:48:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:28 smithi096 ceph-mon[124666]: pgmap v2115: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:48:28.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3847.646241 secs 2023-05-08T04:48:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:28 smithi186 ceph-mon[126480]: pgmap v2115: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:48:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3847.646241 secs 2023-05-08T04:48:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:28 smithi133 ceph-mon[125939]: pgmap v2115: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:48:28.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3847.646241 secs 2023-05-08T04:48:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3848.202132 secs 2023-05-08T04:48:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3848.202132 secs 2023-05-08T04:48:30.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3848.202132 secs 2023-05-08T04:48:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:30 smithi186 ceph-mon[126480]: pgmap v2116: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 95 B/s wr, 8 op/s 2023-05-08T04:48:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:30 smithi133 ceph-mon[125939]: pgmap v2116: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 95 B/s wr, 8 op/s 2023-05-08T04:48:31.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:30 smithi096 ceph-mon[124666]: pgmap v2116: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 95 B/s wr, 8 op/s 2023-05-08T04:48:32.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:32 smithi186 ceph-mon[126480]: pgmap v2117: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:48:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:32 smithi133 ceph-mon[125939]: pgmap v2117: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:48:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:32 smithi096 ceph-mon[124666]: pgmap v2117: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:48:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3852.646368 secs 2023-05-08T04:48:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:34 smithi096 ceph-mon[124666]: pgmap v2118: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:48:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3853.202225 secs 2023-05-08T04:48:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:34 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:48:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3852.646368 secs 2023-05-08T04:48:34.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:34 smithi186 ceph-mon[126480]: pgmap v2118: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:48:34.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3853.202225 secs 2023-05-08T04:48:34.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:34 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:48:34.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3852.646368 secs 2023-05-08T04:48:34.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:34 smithi133 ceph-mon[125939]: pgmap v2118: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:48:34.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3853.202225 secs 2023-05-08T04:48:34.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:34 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:48:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:35 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:48:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:35 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:48:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:35 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:48:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3854.480655 secs 2023-05-08T04:48:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:35 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:48:35.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:35 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:48:35.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:35 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:48:35.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3854.480655 secs 2023-05-08T04:48:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:35 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:48:35.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:35 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:48:35.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:35 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:48:35.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3854.480655 secs 2023-05-08T04:48:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:36 smithi186 ceph-mon[126480]: pgmap v2119: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 104 KiB/s wr, 9 op/s 2023-05-08T04:48:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:36 smithi133 ceph-mon[125939]: pgmap v2119: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 104 KiB/s wr, 9 op/s 2023-05-08T04:48:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:36 smithi096 ceph-mon[124666]: pgmap v2119: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 104 KiB/s wr, 9 op/s 2023-05-08T04:48:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:38 smithi186 ceph-mon[126480]: pgmap v2120: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 104 KiB/s wr, 7 op/s 2023-05-08T04:48:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3857.646468 secs 2023-05-08T04:48:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:38 smithi133 ceph-mon[125939]: pgmap v2120: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 104 KiB/s wr, 7 op/s 2023-05-08T04:48:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3857.646468 secs 2023-05-08T04:48:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:38 smithi096 ceph-mon[124666]: pgmap v2120: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 104 KiB/s wr, 7 op/s 2023-05-08T04:48:39.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3857.646468 secs 2023-05-08T04:48:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3858.202358 secs 2023-05-08T04:48:39.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:39 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:48:39.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:39 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:48:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3858.202358 secs 2023-05-08T04:48:39.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:39 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:48:39.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:39 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:48:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3858.202358 secs 2023-05-08T04:48:40.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:39 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:48:40.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:39 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:48:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:40 smithi186 ceph-mon[126480]: pgmap v2121: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 144 KiB/s wr, 11 op/s 2023-05-08T04:48:40.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3859.480807 secs 2023-05-08T04:48:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:40 smithi133 ceph-mon[125939]: pgmap v2121: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 144 KiB/s wr, 11 op/s 2023-05-08T04:48:40.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3859.480807 secs 2023-05-08T04:48:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:40 smithi096 ceph-mon[124666]: pgmap v2121: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 144 KiB/s wr, 11 op/s 2023-05-08T04:48:41.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3859.480807 secs 2023-05-08T04:48:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:42 smithi186 ceph-mon[126480]: pgmap v2122: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 144 KiB/s wr, 9 op/s 2023-05-08T04:48:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:42 smithi133 ceph-mon[125939]: pgmap v2122: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 144 KiB/s wr, 9 op/s 2023-05-08T04:48:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:42 smithi096 ceph-mon[124666]: pgmap v2122: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 144 KiB/s wr, 9 op/s 2023-05-08T04:48:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3862.646532 secs 2023-05-08T04:48:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:43 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:48:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3862.646532 secs 2023-05-08T04:48:43.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:43 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:48:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3862.646532 secs 2023-05-08T04:48:44.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:43 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:48:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:44 smithi186 ceph-mon[126480]: pgmap v2123: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 144 KiB/s wr, 9 op/s 2023-05-08T04:48:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3863.202499 secs 2023-05-08T04:48:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:44 smithi133 ceph-mon[125939]: pgmap v2123: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 144 KiB/s wr, 9 op/s 2023-05-08T04:48:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3863.202499 secs 2023-05-08T04:48:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:44 smithi096 ceph-mon[124666]: pgmap v2123: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 144 KiB/s wr, 9 op/s 2023-05-08T04:48:45.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3863.202499 secs 2023-05-08T04:48:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3864.480905 secs 2023-05-08T04:48:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:48:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3864.480905 secs 2023-05-08T04:48:45.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:48:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3864.480905 secs 2023-05-08T04:48:46.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:48:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:46 smithi186 ceph-mon[126480]: pgmap v2124: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 144 KiB/s wr, 12 op/s 2023-05-08T04:48:46.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:46 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:48:46.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:46 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:48:46.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:46 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:48:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:46 smithi133 ceph-mon[125939]: pgmap v2124: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 144 KiB/s wr, 12 op/s 2023-05-08T04:48:46.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:46 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:48:46.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:46 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:48:46.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:46 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:48:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:46 smithi096 ceph-mon[124666]: pgmap v2124: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 144 KiB/s wr, 12 op/s 2023-05-08T04:48:47.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:46 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:48:47.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:46 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:48:47.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:46 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:48:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:47 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:48:47.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:47 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T04:48:47.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:47 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T04:48:47.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:47 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:48:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:47 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:48:47.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:47 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T04:48:47.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:47 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T04:48:47.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:47 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:48:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:47 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:48:48.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:47 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T04:48:48.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:47 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T04:48:48.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:47 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:48:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:48 smithi186 ceph-mon[126480]: pgmap v2125: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 40 KiB/s wr, 7 op/s 2023-05-08T04:48:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3867.646643 secs 2023-05-08T04:48:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:48 smithi133 ceph-mon[125939]: pgmap v2125: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 40 KiB/s wr, 7 op/s 2023-05-08T04:48:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3867.646643 secs 2023-05-08T04:48:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:48 smithi096 ceph-mon[124666]: pgmap v2125: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 40 KiB/s wr, 7 op/s 2023-05-08T04:48:49.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3867.646643 secs 2023-05-08T04:48:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3868.202618 secs 2023-05-08T04:48:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3868.202618 secs 2023-05-08T04:48:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3868.202618 secs 2023-05-08T04:48:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:50 smithi186 ceph-mon[126480]: pgmap v2126: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 59 KiB/s wr, 10 op/s 2023-05-08T04:48:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3869.480971 secs 2023-05-08T04:48:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:50 smithi133 ceph-mon[125939]: pgmap v2126: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 59 KiB/s wr, 10 op/s 2023-05-08T04:48:50.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3869.480971 secs 2023-05-08T04:48:51.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:50 smithi096 ceph-mon[124666]: pgmap v2126: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 59 KiB/s wr, 10 op/s 2023-05-08T04:48:51.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3869.480971 secs 2023-05-08T04:48:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:52 smithi186 ceph-mon[126480]: pgmap v2127: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 6 op/s 2023-05-08T04:48:52.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:52 smithi133 ceph-mon[125939]: pgmap v2127: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 6 op/s 2023-05-08T04:48:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:52 smithi096 ceph-mon[124666]: pgmap v2127: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 6 op/s 2023-05-08T04:48:54.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3872.646763 secs 2023-05-08T04:48:54.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:54 smithi096 ceph-mon[124666]: pgmap v2128: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 6 op/s 2023-05-08T04:48:54.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3873.202687 secs 2023-05-08T04:48:54.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3872.646763 secs 2023-05-08T04:48:54.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:54 smithi186 ceph-mon[126480]: pgmap v2128: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 6 op/s 2023-05-08T04:48:54.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3873.202687 secs 2023-05-08T04:48:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3872.646763 secs 2023-05-08T04:48:54.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:54 smithi133 ceph-mon[125939]: pgmap v2128: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 6 op/s 2023-05-08T04:48:54.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3873.202687 secs 2023-05-08T04:48:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3874.481088 secs 2023-05-08T04:48:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3874.481088 secs 2023-05-08T04:48:56.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3874.481088 secs 2023-05-08T04:48:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:56 smithi186 ceph-mon[126480]: pgmap v2129: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 8 op/s 2023-05-08T04:48:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:56 smithi133 ceph-mon[125939]: pgmap v2129: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 8 op/s 2023-05-08T04:48:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:56 smithi096 ceph-mon[124666]: pgmap v2129: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 8 op/s 2023-05-08T04:48:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:58 smithi186 ceph-mon[126480]: pgmap v2130: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 5 op/s 2023-05-08T04:48:58.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3877.646903 secs 2023-05-08T04:48:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:58 smithi133 ceph-mon[125939]: pgmap v2130: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 5 op/s 2023-05-08T04:48:58.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3877.646903 secs 2023-05-08T04:48:59.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:58 smithi096 ceph-mon[124666]: pgmap v2130: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 5 op/s 2023-05-08T04:48:59.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3877.646903 secs 2023-05-08T04:48:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:48:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3878.202796 secs 2023-05-08T04:48:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:48:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3878.202796 secs 2023-05-08T04:49:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:48:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3878.202796 secs 2023-05-08T04:49:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:00 smithi186 ceph-mon[126480]: pgmap v2131: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 36 KiB/s wr, 8 op/s 2023-05-08T04:49:00.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3879.481228 secs 2023-05-08T04:49:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:00 smithi133 ceph-mon[125939]: pgmap v2131: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 36 KiB/s wr, 8 op/s 2023-05-08T04:49:00.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3879.481228 secs 2023-05-08T04:49:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:00 smithi096 ceph-mon[124666]: pgmap v2131: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 36 KiB/s wr, 8 op/s 2023-05-08T04:49:01.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3879.481228 secs 2023-05-08T04:49:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:02 smithi186 ceph-mon[126480]: pgmap v2132: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 5 op/s 2023-05-08T04:49:02.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:02 smithi133 ceph-mon[125939]: pgmap v2132: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 5 op/s 2023-05-08T04:49:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:02 smithi096 ceph-mon[124666]: pgmap v2132: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 5 op/s 2023-05-08T04:49:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3882.647050 secs 2023-05-08T04:49:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:04 smithi096 ceph-mon[124666]: pgmap v2133: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 5 op/s 2023-05-08T04:49:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3883.202904 secs 2023-05-08T04:49:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3882.647050 secs 2023-05-08T04:49:04.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:04 smithi186 ceph-mon[126480]: pgmap v2133: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 5 op/s 2023-05-08T04:49:04.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3883.202904 secs 2023-05-08T04:49:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3882.647050 secs 2023-05-08T04:49:04.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:04 smithi133 ceph-mon[125939]: pgmap v2133: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 5 op/s 2023-05-08T04:49:04.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3883.202904 secs 2023-05-08T04:49:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3884.481336 secs 2023-05-08T04:49:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3884.481336 secs 2023-05-08T04:49:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3884.481336 secs 2023-05-08T04:49:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:06 smithi186 ceph-mon[126480]: pgmap v2134: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 61 KiB/s wr, 22 op/s 2023-05-08T04:49:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:06 smithi133 ceph-mon[125939]: pgmap v2134: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 61 KiB/s wr, 22 op/s 2023-05-08T04:49:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:06 smithi096 ceph-mon[124666]: pgmap v2134: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 61 KiB/s wr, 22 op/s 2023-05-08T04:49:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:08 smithi186 ceph-mon[126480]: pgmap v2135: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 61 KiB/s wr, 19 op/s 2023-05-08T04:49:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3887.647197 secs 2023-05-08T04:49:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:08 smithi133 ceph-mon[125939]: pgmap v2135: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 61 KiB/s wr, 19 op/s 2023-05-08T04:49:08.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3887.647197 secs 2023-05-08T04:49:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:08 smithi096 ceph-mon[124666]: pgmap v2135: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 61 KiB/s wr, 19 op/s 2023-05-08T04:49:09.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3887.647197 secs 2023-05-08T04:49:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3888.203013 secs 2023-05-08T04:49:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3888.203013 secs 2023-05-08T04:49:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3888.203013 secs 2023-05-08T04:49:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:10 smithi186 ceph-mon[126480]: pgmap v2136: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 62 KiB/s wr, 22 op/s 2023-05-08T04:49:10.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3889.481436 secs 2023-05-08T04:49:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:10 smithi133 ceph-mon[125939]: pgmap v2136: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 62 KiB/s wr, 22 op/s 2023-05-08T04:49:10.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3889.481436 secs 2023-05-08T04:49:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:10 smithi096 ceph-mon[124666]: pgmap v2136: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 62 KiB/s wr, 22 op/s 2023-05-08T04:49:11.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3889.481436 secs 2023-05-08T04:49:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:11 smithi186 ceph-mon[126480]: osdmap e214: 12 total, 12 up, 12 in 2023-05-08T04:49:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:11 smithi133 ceph-mon[125939]: osdmap e214: 12 total, 12 up, 12 in 2023-05-08T04:49:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:11 smithi096 ceph-mon[124666]: osdmap e214: 12 total, 12 up, 12 in 2023-05-08T04:49:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:12 smithi186 ceph-mon[126480]: pgmap v2138: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:49:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:12 smithi133 ceph-mon[125939]: pgmap v2138: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:49:13.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:12 smithi096 ceph-mon[124666]: pgmap v2138: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:49:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3892.647362 secs 2023-05-08T04:49:14.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:14 smithi186 ceph-mon[126480]: pgmap v2139: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:49:14.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3893.203129 secs 2023-05-08T04:49:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3892.647362 secs 2023-05-08T04:49:14.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:14 smithi133 ceph-mon[125939]: pgmap v2139: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:49:14.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3893.203129 secs 2023-05-08T04:49:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3892.647362 secs 2023-05-08T04:49:15.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:14 smithi096 ceph-mon[124666]: pgmap v2139: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:49:15.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3893.203129 secs 2023-05-08T04:49:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3894.481516 secs 2023-05-08T04:49:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3894.481516 secs 2023-05-08T04:49:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3894.481516 secs 2023-05-08T04:49:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:16 smithi186 ceph-mon[126480]: pgmap v2140: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:49:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:16 smithi133 ceph-mon[125939]: pgmap v2140: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:49:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:16 smithi096 ceph-mon[124666]: pgmap v2140: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:49:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:18 smithi186 ceph-mon[126480]: pgmap v2141: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:49:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:18 smithi186 ceph-mon[126480]: osdmap e215: 12 total, 12 up, 12 in 2023-05-08T04:49:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:18 smithi133 ceph-mon[125939]: pgmap v2141: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:49:18.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:18 smithi133 ceph-mon[125939]: osdmap e215: 12 total, 12 up, 12 in 2023-05-08T04:49:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:18 smithi096 ceph-mon[124666]: pgmap v2141: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:49:19.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:18 smithi096 ceph-mon[124666]: osdmap e215: 12 total, 12 up, 12 in 2023-05-08T04:49:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3897.647414 secs 2023-05-08T04:49:19.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3898.203266 secs 2023-05-08T04:49:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3897.647414 secs 2023-05-08T04:49:19.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3898.203266 secs 2023-05-08T04:49:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3897.647414 secs 2023-05-08T04:49:20.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3898.203266 secs 2023-05-08T04:49:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:20 smithi186 ceph-mon[126480]: pgmap v2143: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 236 B/s wr, 7 op/s 2023-05-08T04:49:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3899.481627 secs 2023-05-08T04:49:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:20 smithi133 ceph-mon[125939]: pgmap v2143: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 236 B/s wr, 7 op/s 2023-05-08T04:49:20.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3899.481627 secs 2023-05-08T04:49:21.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:20 smithi096 ceph-mon[124666]: pgmap v2143: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 236 B/s wr, 7 op/s 2023-05-08T04:49:21.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3899.481627 secs 2023-05-08T04:49:22.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:22 smithi186 ceph-mon[126480]: pgmap v2144: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:49:22.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:22 smithi133 ceph-mon[125939]: pgmap v2144: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:49:23.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:22 smithi096 ceph-mon[124666]: pgmap v2144: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:49:24.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3902.647475 secs 2023-05-08T04:49:24.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:24 smithi186 ceph-mon[126480]: pgmap v2145: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:49:24.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3903.203349 secs 2023-05-08T04:49:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3902.647475 secs 2023-05-08T04:49:24.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:24 smithi133 ceph-mon[125939]: pgmap v2145: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:49:24.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3903.203349 secs 2023-05-08T04:49:25.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3902.647475 secs 2023-05-08T04:49:25.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:24 smithi096 ceph-mon[124666]: pgmap v2145: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:49:25.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3903.203349 secs 2023-05-08T04:49:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3904.481770 secs 2023-05-08T04:49:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3904.481770 secs 2023-05-08T04:49:26.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3904.481770 secs 2023-05-08T04:49:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:26 smithi186 ceph-mon[126480]: pgmap v2146: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:49:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:26 smithi133 ceph-mon[125939]: pgmap v2146: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:49:27.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:26 smithi096 ceph-mon[124666]: pgmap v2146: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:49:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:28 smithi186 ceph-mon[126480]: pgmap v2147: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:49:28.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3907.647561 secs 2023-05-08T04:49:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:28 smithi133 ceph-mon[125939]: pgmap v2147: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:49:28.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3907.647561 secs 2023-05-08T04:49:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:28 smithi096 ceph-mon[124666]: pgmap v2147: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:49:29.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3907.647561 secs 2023-05-08T04:49:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3908.203498 secs 2023-05-08T04:49:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3908.203498 secs 2023-05-08T04:49:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3908.203498 secs 2023-05-08T04:49:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:30 smithi186 ceph-mon[126480]: pgmap v2148: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 95 B/s wr, 8 op/s 2023-05-08T04:49:30.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3909.484900 secs 2023-05-08T04:49:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:30 smithi133 ceph-mon[125939]: pgmap v2148: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 95 B/s wr, 8 op/s 2023-05-08T04:49:30.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3909.484900 secs 2023-05-08T04:49:31.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:30 smithi096 ceph-mon[124666]: pgmap v2148: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 95 B/s wr, 8 op/s 2023-05-08T04:49:31.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3909.484900 secs 2023-05-08T04:49:32.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:32 smithi186 ceph-mon[126480]: pgmap v2149: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T04:49:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:32 smithi133 ceph-mon[125939]: pgmap v2149: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T04:49:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:32 smithi096 ceph-mon[124666]: pgmap v2149: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T04:49:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3912.647685 secs 2023-05-08T04:49:34.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:34 smithi186 ceph-mon[126480]: pgmap v2150: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T04:49:34.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3913.203618 secs 2023-05-08T04:49:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3912.647685 secs 2023-05-08T04:49:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:34 smithi133 ceph-mon[125939]: pgmap v2150: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T04:49:34.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3913.203618 secs 2023-05-08T04:49:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3912.647685 secs 2023-05-08T04:49:35.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:34 smithi096 ceph-mon[124666]: pgmap v2150: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T04:49:35.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3913.203618 secs 2023-05-08T04:49:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:36 smithi186 ceph-mon[126480]: pgmap v2151: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 46 KiB/s wr, 9 op/s 2023-05-08T04:49:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:36 smithi133 ceph-mon[125939]: pgmap v2151: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 46 KiB/s wr, 9 op/s 2023-05-08T04:49:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:36 smithi096 ceph-mon[124666]: pgmap v2151: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 46 KiB/s wr, 9 op/s 2023-05-08T04:49:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:38 smithi186 ceph-mon[126480]: pgmap v2152: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 46 KiB/s wr, 6 op/s 2023-05-08T04:49:38.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:38 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:49:38.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3917.647796 secs 2023-05-08T04:49:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:38 smithi133 ceph-mon[125939]: pgmap v2152: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 46 KiB/s wr, 6 op/s 2023-05-08T04:49:38.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:38 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:49:38.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3917.647796 secs 2023-05-08T04:49:39.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:38 smithi096 ceph-mon[124666]: pgmap v2152: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 46 KiB/s wr, 6 op/s 2023-05-08T04:49:39.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:38 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:49:39.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3917.647796 secs 2023-05-08T04:49:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3918.203743 secs 2023-05-08T04:49:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:39 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:49:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:39 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:49:39.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:39 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:49:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3918.203743 secs 2023-05-08T04:49:39.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:39 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:49:39.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:39 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:49:39.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:39 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:49:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3918.203743 secs 2023-05-08T04:49:40.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:39 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:49:40.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:39 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:49:40.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:39 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:49:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:40 smithi186 ceph-mon[126480]: pgmap v2153: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 118 KiB/s wr, 10 op/s 2023-05-08T04:49:40.873 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3919.485107 secs 2023-05-08T04:49:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:40 smithi133 ceph-mon[125939]: pgmap v2153: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 118 KiB/s wr, 10 op/s 2023-05-08T04:49:40.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3919.485107 secs 2023-05-08T04:49:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:40 smithi096 ceph-mon[124666]: pgmap v2153: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 118 KiB/s wr, 10 op/s 2023-05-08T04:49:41.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3919.485107 secs 2023-05-08T04:49:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:42 smithi186 ceph-mon[126480]: pgmap v2154: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 118 KiB/s wr, 8 op/s 2023-05-08T04:49:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:42 smithi133 ceph-mon[125939]: pgmap v2154: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 118 KiB/s wr, 8 op/s 2023-05-08T04:49:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:42 smithi096 ceph-mon[124666]: pgmap v2154: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 118 KiB/s wr, 8 op/s 2023-05-08T04:49:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:49:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:49:43.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3922.647940 secs 2023-05-08T04:49:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:49:43.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:49:43.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3922.647940 secs 2023-05-08T04:49:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:49:44.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:49:44.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3922.647940 secs 2023-05-08T04:49:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:44 smithi186 ceph-mon[126480]: pgmap v2155: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 118 KiB/s wr, 8 op/s 2023-05-08T04:49:44.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3923.203864 secs 2023-05-08T04:49:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:44 smithi133 ceph-mon[125939]: pgmap v2155: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 118 KiB/s wr, 8 op/s 2023-05-08T04:49:44.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3923.203864 secs 2023-05-08T04:49:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:44 smithi096 ceph-mon[124666]: pgmap v2155: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 118 KiB/s wr, 8 op/s 2023-05-08T04:49:45.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3923.203864 secs 2023-05-08T04:49:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3924.485228 secs 2023-05-08T04:49:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3924.485228 secs 2023-05-08T04:49:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3924.485228 secs 2023-05-08T04:49:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:46 smithi186 ceph-mon[126480]: pgmap v2156: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 121 KiB/s wr, 11 op/s 2023-05-08T04:49:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:46 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:49:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:46 smithi133 ceph-mon[125939]: pgmap v2156: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 121 KiB/s wr, 11 op/s 2023-05-08T04:49:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:46 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:49:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:46 smithi096 ceph-mon[124666]: pgmap v2156: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 121 KiB/s wr, 11 op/s 2023-05-08T04:49:47.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:46 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:49:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:47 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:49:47.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:47 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:49:47.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:47 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:49:47.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:47 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:49:47.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:47 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T04:49:47.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:47 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T04:49:47.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:47 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:49:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:47 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:49:47.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:47 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:49:47.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:47 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:49:47.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:47 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:49:47.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:47 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T04:49:47.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:47 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T04:49:47.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:47 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:49:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:47 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:49:48.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:47 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:49:48.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:47 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:49:48.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:47 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:49:48.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:47 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T04:49:48.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:47 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T04:49:48.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:47 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:49:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:48 smithi133 ceph-mon[125939]: pgmap v2157: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 75 KiB/s wr, 7 op/s 2023-05-08T04:49:49.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3927.648075 secs 2023-05-08T04:49:49.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:48 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:49:49.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:48 smithi096 ceph-mon[124666]: pgmap v2157: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 75 KiB/s wr, 7 op/s 2023-05-08T04:49:49.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3927.648075 secs 2023-05-08T04:49:49.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:48 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:49:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:48 smithi186 ceph-mon[126480]: pgmap v2157: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 75 KiB/s wr, 7 op/s 2023-05-08T04:49:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3927.648075 secs 2023-05-08T04:49:49.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:48 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:49:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3928.203974 secs 2023-05-08T04:49:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3928.203974 secs 2023-05-08T04:49:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3928.203974 secs 2023-05-08T04:49:51.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:50 smithi096 ceph-mon[124666]: pgmap v2158: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 92 KiB/s wr, 10 op/s 2023-05-08T04:49:51.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3929.485356 secs 2023-05-08T04:49:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:50 smithi186 ceph-mon[126480]: pgmap v2158: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 92 KiB/s wr, 10 op/s 2023-05-08T04:49:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3929.485356 secs 2023-05-08T04:49:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:50 smithi133 ceph-mon[125939]: pgmap v2158: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 92 KiB/s wr, 10 op/s 2023-05-08T04:49:51.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3929.485356 secs 2023-05-08T04:49:53.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:52 smithi096 ceph-mon[124666]: pgmap v2159: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 5 op/s 2023-05-08T04:49:53.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:52 smithi186 ceph-mon[126480]: pgmap v2159: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 5 op/s 2023-05-08T04:49:53.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:52 smithi133 ceph-mon[125939]: pgmap v2159: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 5 op/s 2023-05-08T04:49:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3932.648193 secs 2023-05-08T04:49:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3932.648193 secs 2023-05-08T04:49:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3932.648193 secs 2023-05-08T04:49:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:55 smithi186 ceph-mon[126480]: pgmap v2160: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 5 op/s 2023-05-08T04:49:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3933.204116 secs 2023-05-08T04:49:55.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:55 smithi133 ceph-mon[125939]: pgmap v2160: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 5 op/s 2023-05-08T04:49:55.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3933.204116 secs 2023-05-08T04:49:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:55 smithi096 ceph-mon[124666]: pgmap v2160: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 5 op/s 2023-05-08T04:49:55.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3933.204116 secs 2023-05-08T04:49:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3934.485436 secs 2023-05-08T04:49:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3934.485436 secs 2023-05-08T04:49:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3934.485436 secs 2023-05-08T04:49:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:57 smithi186 ceph-mon[126480]: pgmap v2161: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 20 KiB/s wr, 8 op/s 2023-05-08T04:49:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:57 smithi133 ceph-mon[125939]: pgmap v2161: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 20 KiB/s wr, 8 op/s 2023-05-08T04:49:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:57 smithi096 ceph-mon[124666]: pgmap v2161: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 20 KiB/s wr, 8 op/s 2023-05-08T04:49:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:59 smithi186 ceph-mon[126480]: pgmap v2162: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 5 op/s 2023-05-08T04:49:59.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:49:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3937.648309 secs 2023-05-08T04:49:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:59 smithi133 ceph-mon[125939]: pgmap v2162: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 5 op/s 2023-05-08T04:49:59.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:49:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3937.648309 secs 2023-05-08T04:49:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:59 smithi096 ceph-mon[124666]: pgmap v2162: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 5 op/s 2023-05-08T04:49:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:49:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3937.648309 secs 2023-05-08T04:50:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3938.204235 secs 2023-05-08T04:50:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:00 smithi186 ceph-mon[126480]: overall HEALTH_WARN 3 MDSs report slow requests 2023-05-08T04:50:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3938.204235 secs 2023-05-08T04:50:00.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:00 smithi133 ceph-mon[125939]: overall HEALTH_WARN 3 MDSs report slow requests 2023-05-08T04:50:00.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3938.204235 secs 2023-05-08T04:50:00.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:00 smithi096 ceph-mon[124666]: overall HEALTH_WARN 3 MDSs report slow requests 2023-05-08T04:50:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:01 smithi186 ceph-mon[126480]: pgmap v2163: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 34 KiB/s wr, 7 op/s 2023-05-08T04:50:01.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3939.485550 secs 2023-05-08T04:50:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:01 smithi133 ceph-mon[125939]: pgmap v2163: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 34 KiB/s wr, 7 op/s 2023-05-08T04:50:01.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3939.485550 secs 2023-05-08T04:50:01.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:01 smithi096 ceph-mon[124666]: pgmap v2163: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 34 KiB/s wr, 7 op/s 2023-05-08T04:50:01.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3939.485550 secs 2023-05-08T04:50:03.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:03 smithi186 ceph-mon[126480]: pgmap v2164: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 5 op/s 2023-05-08T04:50:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:03 smithi133 ceph-mon[125939]: pgmap v2164: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 5 op/s 2023-05-08T04:50:03.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:03 smithi096 ceph-mon[124666]: pgmap v2164: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 5 op/s 2023-05-08T04:50:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3942.648414 secs 2023-05-08T04:50:04.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3943.204321 secs 2023-05-08T04:50:04.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3942.648414 secs 2023-05-08T04:50:04.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3943.204321 secs 2023-05-08T04:50:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3942.648414 secs 2023-05-08T04:50:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3943.204321 secs 2023-05-08T04:50:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:05 smithi186 ceph-mon[126480]: pgmap v2165: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 5 op/s 2023-05-08T04:50:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:05 smithi133 ceph-mon[125939]: pgmap v2165: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 5 op/s 2023-05-08T04:50:05.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:05 smithi096 ceph-mon[124666]: pgmap v2165: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 5 op/s 2023-05-08T04:50:06.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3944.485672 secs 2023-05-08T04:50:06.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3944.485672 secs 2023-05-08T04:50:06.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3944.485672 secs 2023-05-08T04:50:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:07 smithi186 ceph-mon[126480]: pgmap v2166: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 62 KiB/s wr, 22 op/s 2023-05-08T04:50:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:07 smithi133 ceph-mon[125939]: pgmap v2166: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 62 KiB/s wr, 22 op/s 2023-05-08T04:50:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:07 smithi096 ceph-mon[124666]: pgmap v2166: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 62 KiB/s wr, 22 op/s 2023-05-08T04:50:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:09 smithi186 ceph-mon[126480]: pgmap v2167: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 62 KiB/s wr, 19 op/s 2023-05-08T04:50:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3947.648517 secs 2023-05-08T04:50:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3948.204455 secs 2023-05-08T04:50:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:09 smithi133 ceph-mon[125939]: pgmap v2167: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 62 KiB/s wr, 19 op/s 2023-05-08T04:50:09.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3947.648517 secs 2023-05-08T04:50:09.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3948.204455 secs 2023-05-08T04:50:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:09 smithi096 ceph-mon[124666]: pgmap v2167: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 62 KiB/s wr, 19 op/s 2023-05-08T04:50:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3947.648517 secs 2023-05-08T04:50:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3948.204455 secs 2023-05-08T04:50:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:11 smithi186 ceph-mon[126480]: pgmap v2168: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 62 KiB/s wr, 22 op/s 2023-05-08T04:50:11.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3949.485821 secs 2023-05-08T04:50:11.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:11 smithi186 ceph-mon[126480]: osdmap e216: 12 total, 12 up, 12 in 2023-05-08T04:50:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:11 smithi133 ceph-mon[125939]: pgmap v2168: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 62 KiB/s wr, 22 op/s 2023-05-08T04:50:11.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3949.485821 secs 2023-05-08T04:50:11.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:11 smithi133 ceph-mon[125939]: osdmap e216: 12 total, 12 up, 12 in 2023-05-08T04:50:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:11 smithi096 ceph-mon[124666]: pgmap v2168: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 62 KiB/s wr, 22 op/s 2023-05-08T04:50:11.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3949.485821 secs 2023-05-08T04:50:11.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:11 smithi096 ceph-mon[124666]: osdmap e216: 12 total, 12 up, 12 in 2023-05-08T04:50:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:13 smithi186 ceph-mon[126480]: pgmap v2170: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:50:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:13 smithi133 ceph-mon[125939]: pgmap v2170: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:50:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:13 smithi096 ceph-mon[124666]: pgmap v2170: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:50:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3952.648580 secs 2023-05-08T04:50:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3953.204578 secs 2023-05-08T04:50:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3952.648580 secs 2023-05-08T04:50:14.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3953.204578 secs 2023-05-08T04:50:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3952.648580 secs 2023-05-08T04:50:14.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3953.204578 secs 2023-05-08T04:50:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:15 smithi186 ceph-mon[126480]: pgmap v2171: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:50:15.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:15 smithi133 ceph-mon[125939]: pgmap v2171: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:50:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:15 smithi096 ceph-mon[124666]: pgmap v2171: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:50:16.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3954.485890 secs 2023-05-08T04:50:16.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3954.485890 secs 2023-05-08T04:50:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3954.485890 secs 2023-05-08T04:50:17.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:17 smithi186 ceph-mon[126480]: pgmap v2172: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:50:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:17 smithi133 ceph-mon[125939]: pgmap v2172: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:50:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:17 smithi096 ceph-mon[124666]: pgmap v2172: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:50:19.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:19 smithi186 ceph-mon[126480]: pgmap v2173: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:50:19.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3957.648672 secs 2023-05-08T04:50:19.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3958.204698 secs 2023-05-08T04:50:19.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:19 smithi186 ceph-mon[126480]: osdmap e217: 12 total, 12 up, 12 in 2023-05-08T04:50:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:19 smithi133 ceph-mon[125939]: pgmap v2173: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:50:19.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3957.648672 secs 2023-05-08T04:50:19.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3958.204698 secs 2023-05-08T04:50:19.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:19 smithi133 ceph-mon[125939]: osdmap e217: 12 total, 12 up, 12 in 2023-05-08T04:50:19.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:19 smithi096 ceph-mon[124666]: pgmap v2173: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:50:19.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3957.648672 secs 2023-05-08T04:50:19.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3958.204698 secs 2023-05-08T04:50:19.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:19 smithi096 ceph-mon[124666]: osdmap e217: 12 total, 12 up, 12 in 2023-05-08T04:50:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:21 smithi186 ceph-mon[126480]: pgmap v2175: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 223 B/s wr, 7 op/s 2023-05-08T04:50:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3959.485990 secs 2023-05-08T04:50:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:21 smithi133 ceph-mon[125939]: pgmap v2175: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 223 B/s wr, 7 op/s 2023-05-08T04:50:21.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3959.485990 secs 2023-05-08T04:50:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:21 smithi096 ceph-mon[124666]: pgmap v2175: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 223 B/s wr, 7 op/s 2023-05-08T04:50:21.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3959.485990 secs 2023-05-08T04:50:23.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:23 smithi186 ceph-mon[126480]: pgmap v2176: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:50:23.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:23 smithi133 ceph-mon[125939]: pgmap v2176: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:50:23.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:23 smithi096 ceph-mon[124666]: pgmap v2176: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:50:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3962.648791 secs 2023-05-08T04:50:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3963.204807 secs 2023-05-08T04:50:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3962.648791 secs 2023-05-08T04:50:24.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3963.204807 secs 2023-05-08T04:50:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3962.648791 secs 2023-05-08T04:50:24.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3963.204807 secs 2023-05-08T04:50:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:25 smithi186 ceph-mon[126480]: pgmap v2177: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:50:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:25 smithi133 ceph-mon[125939]: pgmap v2177: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:50:25.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:25 smithi096 ceph-mon[124666]: pgmap v2177: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:50:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3964.486111 secs 2023-05-08T04:50:26.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3964.486111 secs 2023-05-08T04:50:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3964.486111 secs 2023-05-08T04:50:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:27 smithi186 ceph-mon[126480]: pgmap v2178: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:50:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:27 smithi133 ceph-mon[125939]: pgmap v2178: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:50:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:27 smithi096 ceph-mon[124666]: pgmap v2178: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:50:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:29 smithi186 ceph-mon[126480]: pgmap v2179: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:50:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3967.648909 secs 2023-05-08T04:50:29.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3968.204947 secs 2023-05-08T04:50:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:29 smithi133 ceph-mon[125939]: pgmap v2179: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:50:29.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3967.648909 secs 2023-05-08T04:50:29.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3968.204947 secs 2023-05-08T04:50:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:29 smithi096 ceph-mon[124666]: pgmap v2179: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:50:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3967.648909 secs 2023-05-08T04:50:29.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3968.204947 secs 2023-05-08T04:50:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:31 smithi186 ceph-mon[126480]: pgmap v2180: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 95 B/s wr, 8 op/s 2023-05-08T04:50:31.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3969.486216 secs 2023-05-08T04:50:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:31 smithi133 ceph-mon[125939]: pgmap v2180: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 95 B/s wr, 8 op/s 2023-05-08T04:50:31.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3969.486216 secs 2023-05-08T04:50:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:31 smithi096 ceph-mon[124666]: pgmap v2180: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 95 B/s wr, 8 op/s 2023-05-08T04:50:31.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3969.486216 secs 2023-05-08T04:50:33.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:33 smithi186 ceph-mon[126480]: pgmap v2181: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:50:33.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:33 smithi133 ceph-mon[125939]: pgmap v2181: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:50:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:33 smithi096 ceph-mon[124666]: pgmap v2181: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:50:34.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3972.649023 secs 2023-05-08T04:50:34.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3973.205066 secs 2023-05-08T04:50:34.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3972.649023 secs 2023-05-08T04:50:34.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3973.205066 secs 2023-05-08T04:50:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3972.649023 secs 2023-05-08T04:50:34.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3973.205066 secs 2023-05-08T04:50:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:35 smithi186 ceph-mon[126480]: pgmap v2182: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:50:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:35 smithi133 ceph-mon[125939]: pgmap v2182: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:50:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:35 smithi096 ceph-mon[124666]: pgmap v2182: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:50:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:37 smithi133 ceph-mon[125939]: pgmap v2183: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 56 KiB/s wr, 9 op/s 2023-05-08T04:50:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:37 smithi096 ceph-mon[124666]: pgmap v2183: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 56 KiB/s wr, 9 op/s 2023-05-08T04:50:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:37 smithi186 ceph-mon[126480]: pgmap v2183: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 56 KiB/s wr, 9 op/s 2023-05-08T04:50:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:38 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:50:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:38 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:50:38.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:38 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:50:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:39 smithi133 ceph-mon[125939]: pgmap v2184: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 56 KiB/s wr, 6 op/s 2023-05-08T04:50:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3977.649161 secs 2023-05-08T04:50:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:39 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:50:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:39 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:50:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:39 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:50:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3978.205200 secs 2023-05-08T04:50:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:39 smithi096 ceph-mon[124666]: pgmap v2184: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 56 KiB/s wr, 6 op/s 2023-05-08T04:50:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3977.649161 secs 2023-05-08T04:50:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:39 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:50:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:39 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:50:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:39 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:50:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3978.205200 secs 2023-05-08T04:50:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:39 smithi186 ceph-mon[126480]: pgmap v2184: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 56 KiB/s wr, 6 op/s 2023-05-08T04:50:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3977.649161 secs 2023-05-08T04:50:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:39 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:50:39.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:39 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:50:39.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:39 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:50:39.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3978.205200 secs 2023-05-08T04:50:41.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:41 smithi133 ceph-mon[125939]: pgmap v2185: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 175 KiB/s wr, 12 op/s 2023-05-08T04:50:41.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3979.486477 secs 2023-05-08T04:50:41.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:41 smithi096 ceph-mon[124666]: pgmap v2185: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 175 KiB/s wr, 12 op/s 2023-05-08T04:50:41.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3979.486477 secs 2023-05-08T04:50:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:41 smithi186 ceph-mon[126480]: pgmap v2185: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 175 KiB/s wr, 12 op/s 2023-05-08T04:50:41.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3979.486477 secs 2023-05-08T04:50:43.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:43 smithi133 ceph-mon[125939]: pgmap v2186: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 175 KiB/s wr, 9 op/s 2023-05-08T04:50:43.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:50:43.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:50:43.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:43 smithi096 ceph-mon[124666]: pgmap v2186: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 175 KiB/s wr, 9 op/s 2023-05-08T04:50:43.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:50:43.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:50:43.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:43 smithi186 ceph-mon[126480]: pgmap v2186: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 175 KiB/s wr, 9 op/s 2023-05-08T04:50:43.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:50:43.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:50:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3982.649272 secs 2023-05-08T04:50:44.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3983.205320 secs 2023-05-08T04:50:44.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:44 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:50:44.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3982.649272 secs 2023-05-08T04:50:44.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3983.205320 secs 2023-05-08T04:50:44.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:44 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:50:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3982.649272 secs 2023-05-08T04:50:44.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3983.205320 secs 2023-05-08T04:50:44.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:44 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:50:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:45 smithi133 ceph-mon[125939]: pgmap v2187: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 175 KiB/s wr, 9 op/s 2023-05-08T04:50:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:45 smithi096 ceph-mon[124666]: pgmap v2187: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 175 KiB/s wr, 9 op/s 2023-05-08T04:50:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:45 smithi186 ceph-mon[126480]: pgmap v2187: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 175 KiB/s wr, 9 op/s 2023-05-08T04:50:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3984.486594 secs 2023-05-08T04:50:46.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:46 smithi133 ceph-mon[125939]: pgmap v2188: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 196 KiB/s wr, 13 op/s 2023-05-08T04:50:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3984.486594 secs 2023-05-08T04:50:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:46 smithi096 ceph-mon[124666]: pgmap v2188: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 196 KiB/s wr, 13 op/s 2023-05-08T04:50:46.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3984.486594 secs 2023-05-08T04:50:46.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:46 smithi186 ceph-mon[126480]: pgmap v2188: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 196 KiB/s wr, 13 op/s 2023-05-08T04:50:47.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:47 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:50:47.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:47 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:50:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:47 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:50:48.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:48 smithi133 ceph-mon[125939]: pgmap v2189: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 139 KiB/s wr, 8 op/s 2023-05-08T04:50:48.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:48 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:50:48.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:48 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:50:48.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:48 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:50:48.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:48 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:50:48.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:48 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T04:50:48.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:48 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T04:50:48.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:48 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:50:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:48 smithi096 ceph-mon[124666]: pgmap v2189: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 139 KiB/s wr, 8 op/s 2023-05-08T04:50:48.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:48 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:50:48.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:48 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:50:48.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:48 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:50:48.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:48 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:50:48.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:48 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T04:50:48.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:48 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T04:50:48.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:48 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:50:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:48 smithi186 ceph-mon[126480]: pgmap v2189: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 139 KiB/s wr, 8 op/s 2023-05-08T04:50:48.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:48 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:50:48.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:48 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:50:48.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:48 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:50:48.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:48 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:50:48.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:48 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T04:50:48.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:48 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T04:50:48.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:48 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:50:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3987.649369 secs 2023-05-08T04:50:49.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3988.205427 secs 2023-05-08T04:50:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3987.649369 secs 2023-05-08T04:50:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3988.205427 secs 2023-05-08T04:50:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3987.649369 secs 2023-05-08T04:50:49.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3988.205427 secs 2023-05-08T04:50:50.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:50 smithi133 ceph-mon[125939]: pgmap v2190: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 139 KiB/s wr, 11 op/s 2023-05-08T04:50:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:50 smithi096 ceph-mon[124666]: pgmap v2190: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 139 KiB/s wr, 11 op/s 2023-05-08T04:50:50.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:50 smithi186 ceph-mon[126480]: pgmap v2190: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 139 KiB/s wr, 11 op/s 2023-05-08T04:50:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3989.486728 secs 2023-05-08T04:50:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3989.486728 secs 2023-05-08T04:50:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3989.486728 secs 2023-05-08T04:50:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:52 smithi133 ceph-mon[125939]: pgmap v2191: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 20 KiB/s wr, 6 op/s 2023-05-08T04:50:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:52 smithi096 ceph-mon[124666]: pgmap v2191: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 20 KiB/s wr, 6 op/s 2023-05-08T04:50:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:52 smithi186 ceph-mon[126480]: pgmap v2191: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 20 KiB/s wr, 6 op/s 2023-05-08T04:50:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3992.649507 secs 2023-05-08T04:50:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:54 smithi186 ceph-mon[126480]: pgmap v2192: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 20 KiB/s wr, 6 op/s 2023-05-08T04:50:54.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3993.205545 secs 2023-05-08T04:50:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3992.649507 secs 2023-05-08T04:50:54.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:54 smithi133 ceph-mon[125939]: pgmap v2192: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 20 KiB/s wr, 6 op/s 2023-05-08T04:50:54.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3993.205545 secs 2023-05-08T04:50:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3992.649507 secs 2023-05-08T04:50:54.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:54 smithi096 ceph-mon[124666]: pgmap v2192: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 20 KiB/s wr, 6 op/s 2023-05-08T04:50:54.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3993.205545 secs 2023-05-08T04:50:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3994.486867 secs 2023-05-08T04:50:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:56 smithi186 ceph-mon[126480]: pgmap v2193: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 20 KiB/s wr, 9 op/s 2023-05-08T04:50:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3994.486867 secs 2023-05-08T04:50:56.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:56 smithi133 ceph-mon[125939]: pgmap v2193: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 20 KiB/s wr, 9 op/s 2023-05-08T04:50:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3994.486867 secs 2023-05-08T04:50:56.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:56 smithi096 ceph-mon[124666]: pgmap v2193: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 20 KiB/s wr, 9 op/s 2023-05-08T04:50:58.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:58 smithi186 ceph-mon[126480]: pgmap v2194: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:50:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:58 smithi133 ceph-mon[125939]: pgmap v2194: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:50:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:58 smithi096 ceph-mon[124666]: pgmap v2194: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:50:59.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3997.649581 secs 2023-05-08T04:50:59.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:50:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3998.205655 secs 2023-05-08T04:50:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3997.649581 secs 2023-05-08T04:50:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:50:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3998.205655 secs 2023-05-08T04:50:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3997.649581 secs 2023-05-08T04:50:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:50:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3998.205655 secs 2023-05-08T04:51:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:51:00 smithi186 ceph-mon[126480]: pgmap v2195: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T04:51:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:51:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 3999.486946 secs 2023-05-08T04:51:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:51:00 smithi133 ceph-mon[125939]: pgmap v2195: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T04:51:00.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:51:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 3999.486946 secs 2023-05-08T04:51:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:51:00 smithi096 ceph-mon[124666]: pgmap v2195: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T04:51:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:51:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 3999.486946 secs 2023-05-08T04:51:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:51:02 smithi186 ceph-mon[126480]: pgmap v2196: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:51:02.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:51:02 smithi133 ceph-mon[125939]: pgmap v2196: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:51:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:51:02 smithi096 ceph-mon[124666]: pgmap v2196: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:51:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:51:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4002.649674 secs 2023-05-08T04:51:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:51:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4002.649674 secs 2023-05-08T04:51:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:51:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4002.649674 secs 2023-05-08T04:51:04.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:51:04 smithi186 ceph-mon[126480]: pgmap v2197: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:51:04.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:51:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4003.205764 secs 2023-05-08T04:51:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:51:04 smithi133 ceph-mon[125939]: pgmap v2197: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:51:04.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:51:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4003.205764 secs 2023-05-08T04:51:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:51:04 smithi096 ceph-mon[124666]: pgmap v2197: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:51:05.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:51:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4003.205764 secs 2023-05-08T04:51:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:51:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4004.487088 secs 2023-05-08T04:51:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:51:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4004.487088 secs 2023-05-08T04:51:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:51:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4004.487088 secs 2023-05-08T04:51:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:51:06 smithi186 ceph-mon[126480]: pgmap v2198: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-05-08T04:51:06.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:51:06 smithi133 ceph-mon[125939]: pgmap v2198: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-05-08T04:51:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:51:06 smithi096 ceph-mon[124666]: pgmap v2198: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-05-08T04:51:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:51:08 smithi186 ceph-mon[126480]: pgmap v2199: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 20 op/s 2023-05-08T04:51:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:51:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4007.649793 secs 2023-05-08T04:51:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:51:08 smithi133 ceph-mon[125939]: pgmap v2199: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 20 op/s 2023-05-08T04:51:08.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:51:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4007.649793 secs 2023-05-08T04:51:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:51:08 smithi096 ceph-mon[124666]: pgmap v2199: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 20 op/s 2023-05-08T04:51:09.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:51:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4007.649793 secs 2023-05-08T04:51:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:51:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4008.205884 secs 2023-05-08T04:51:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:51:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4008.205884 secs 2023-05-08T04:51:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:51:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4008.205884 secs 2023-05-08T04:51:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:51:10 smithi186 ceph-mon[126480]: pgmap v2200: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:51:10.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:51:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4009.487204 secs 2023-05-08T04:51:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:51:10 smithi133 ceph-mon[125939]: pgmap v2200: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:51:10.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:51:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4009.487204 secs 2023-05-08T04:51:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:51:10 smithi096 ceph-mon[124666]: pgmap v2200: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:51:11.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:51:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4009.487204 secs 2023-05-08T04:51:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:51:11 smithi186 ceph-mon[126480]: osdmap e218: 12 total, 12 up, 12 in 2023-05-08T04:51:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:51:11 smithi133 ceph-mon[125939]: osdmap e218: 12 total, 12 up, 12 in 2023-05-08T04:51:12.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:51:11 smithi096 ceph-mon[124666]: osdmap e218: 12 total, 12 up, 12 in 2023-05-08T04:51:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:51:12 smithi186 ceph-mon[126480]: pgmap v2202: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:51:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:51:12 smithi133 ceph-mon[125939]: pgmap v2202: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:51:13.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:51:12 smithi096 ceph-mon[124666]: pgmap v2202: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:51:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:51:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4012.649904 secs 2023-05-08T04:51:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:51:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4012.649904 secs 2023-05-08T04:51:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:51:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4012.649904 secs 2023-05-08T04:51:14.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:51:14 smithi186 ceph-mon[126480]: pgmap v2203: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:51:14.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:51:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4013.206003 secs 2023-05-08T04:51:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:51:14 smithi133 ceph-mon[125939]: pgmap v2203: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:51:14.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:51:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4013.206003 secs 2023-05-08T04:51:15.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:51:14 smithi096 ceph-mon[124666]: pgmap v2203: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:51:15.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:51:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4013.206003 secs 2023-05-08T04:51:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:51:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4014.487331 secs 2023-05-08T04:51:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:51:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4014.487331 secs 2023-05-08T04:51:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:51:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4014.487331 secs 2023-05-08T04:51:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:51:16 smithi186 ceph-mon[126480]: pgmap v2204: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:51:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:51:16 smithi133 ceph-mon[125939]: pgmap v2204: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:51:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:51:16 smithi096 ceph-mon[124666]: pgmap v2204: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:51:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:51:18 smithi186 ceph-mon[126480]: pgmap v2205: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:51:18.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:51:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4017.650037 secs 2023-05-08T04:51:18.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:51:18 smithi186 ceph-mon[126480]: osdmap e219: 12 total, 12 up, 12 in 2023-05-08T04:51:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:51:18 smithi133 ceph-mon[125939]: pgmap v2205: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:51:18.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:51:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4017.650037 secs 2023-05-08T04:51:18.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:51:18 smithi133 ceph-mon[125939]: osdmap e219: 12 total, 12 up, 12 in 2023-05-08T04:51:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:51:18 smithi096 ceph-mon[124666]: pgmap v2205: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:51:19.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:51:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4017.650037 secs 2023-05-08T04:51:19.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:51:18 smithi096 ceph-mon[124666]: osdmap e219: 12 total, 12 up, 12 in 2023-05-08T04:51:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:51:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4018.206120 secs 2023-05-08T04:51:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:51:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4018.206120 secs 2023-05-08T04:51:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:51:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4018.206120 secs 2023-05-08T04:51:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:51:20 smithi186 ceph-mon[126480]: pgmap v2207: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 236 B/s wr, 7 op/s 2023-05-08T04:51:20.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:51:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4019.487452 secs 2023-05-08T04:51:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:51:20 smithi133 ceph-mon[125939]: pgmap v2207: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 236 B/s wr, 7 op/s 2023-05-08T04:51:20.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:51:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4019.487452 secs 2023-05-08T04:51:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:51:20 smithi096 ceph-mon[124666]: pgmap v2207: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 236 B/s wr, 7 op/s 2023-05-08T04:51:21.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:51:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4019.487452 secs 2023-05-08T04:51:22.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:51:22 smithi186 ceph-mon[126480]: pgmap v2208: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:51:22.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:51:22 smithi133 ceph-mon[125939]: pgmap v2208: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:51:23.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:51:22 smithi096 ceph-mon[124666]: pgmap v2208: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:51:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:51:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4022.650147 secs 2023-05-08T04:51:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:51:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4022.650147 secs 2023-05-08T04:51:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:51:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4022.650147 secs 2023-05-08T04:51:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:51:24 smithi133 ceph-mon[125939]: pgmap v2209: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:51:24.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:51:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4023.206255 secs 2023-05-08T04:51:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:51:24 smithi096 ceph-mon[124666]: pgmap v2209: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:51:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:51:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4023.206255 secs 2023-05-08T04:51:25.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:51:24 smithi186 ceph-mon[126480]: pgmap v2209: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:51:25.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:51:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4023.206255 secs 2023-05-08T04:51:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:51:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4024.487586 secs 2023-05-08T04:51:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:51:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4024.487586 secs 2023-05-08T04:51:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:51:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4024.487586 secs 2023-05-08T04:51:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:51:26 smithi133 ceph-mon[125939]: pgmap v2210: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:51:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:51:26 smithi096 ceph-mon[124666]: pgmap v2210: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:51:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:51:26 smithi186 ceph-mon[126480]: pgmap v2210: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:51:28.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:51:28 smithi133 ceph-mon[125939]: pgmap v2211: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:51:28.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:51:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4027.650281 secs 2023-05-08T04:51:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:51:28 smithi096 ceph-mon[124666]: pgmap v2211: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:51:29.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:51:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4027.650281 secs 2023-05-08T04:51:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:51:28 smithi186 ceph-mon[126480]: pgmap v2211: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:51:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:51:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4027.650281 secs 2023-05-08T04:51:29.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:51:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4028.206393 secs 2023-05-08T04:51:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:51:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4028.206393 secs 2023-05-08T04:51:30.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:51:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4028.206393 secs 2023-05-08T04:51:30.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:51:30 smithi133 ceph-mon[125939]: pgmap v2212: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 95 B/s wr, 8 op/s 2023-05-08T04:51:30.994 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:51:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4029.487705 secs 2023-05-08T04:51:31.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:51:30 smithi096 ceph-mon[124666]: pgmap v2212: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 95 B/s wr, 8 op/s 2023-05-08T04:51:31.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:51:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4029.487705 secs 2023-05-08T04:51:31.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:51:30 smithi186 ceph-mon[126480]: pgmap v2212: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 95 B/s wr, 8 op/s 2023-05-08T04:51:31.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:51:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4029.487705 secs 2023-05-08T04:51:32.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:51:32 smithi133 ceph-mon[125939]: pgmap v2213: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:51:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:51:32 smithi096 ceph-mon[124666]: pgmap v2213: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:51:33.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:51:32 smithi186 ceph-mon[126480]: pgmap v2213: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:51:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:51:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4032.650396 secs 2023-05-08T04:51:34.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:51:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4032.650396 secs 2023-05-08T04:51:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:51:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4032.650396 secs 2023-05-08T04:51:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:51:34 smithi133 ceph-mon[125939]: pgmap v2214: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:51:34.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:51:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4033.206515 secs 2023-05-08T04:51:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:51:34 smithi096 ceph-mon[124666]: pgmap v2214: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:51:35.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:51:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4033.206515 secs 2023-05-08T04:51:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:51:34 smithi186 ceph-mon[126480]: pgmap v2214: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:51:35.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:51:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4033.206515 secs 2023-05-08T04:51:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:51:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4034.487805 secs 2023-05-08T04:51:36.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:51:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4034.487805 secs 2023-05-08T04:51:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:51:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4034.487805 secs 2023-05-08T04:51:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:51:36 smithi133 ceph-mon[125939]: pgmap v2215: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 47 KiB/s wr, 8 op/s 2023-05-08T04:51:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:51:36 smithi096 ceph-mon[124666]: pgmap v2215: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 47 KiB/s wr, 8 op/s 2023-05-08T04:51:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:51:36 smithi186 ceph-mon[126480]: pgmap v2215: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 47 KiB/s wr, 8 op/s 2023-05-08T04:51:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:51:38 smithi133 ceph-mon[125939]: pgmap v2216: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 47 KiB/s wr, 6 op/s 2023-05-08T04:51:38.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:51:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4037.650522 secs 2023-05-08T04:51:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:51:38 smithi096 ceph-mon[124666]: pgmap v2216: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 47 KiB/s wr, 6 op/s 2023-05-08T04:51:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:51:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4037.650522 secs 2023-05-08T04:51:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:51:38 smithi186 ceph-mon[126480]: pgmap v2216: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 47 KiB/s wr, 6 op/s 2023-05-08T04:51:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:51:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4037.650522 secs 2023-05-08T04:51:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:51:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4038.206655 secs 2023-05-08T04:51:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:51:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4038.206655 secs 2023-05-08T04:51:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:51:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4038.206655 secs 2023-05-08T04:51:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:51:40 smithi133 ceph-mon[125939]: pgmap v2217: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 117 KiB/s wr, 10 op/s 2023-05-08T04:51:40.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:51:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4039.487937 secs 2023-05-08T04:51:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:51:40 smithi096 ceph-mon[124666]: pgmap v2217: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 117 KiB/s wr, 10 op/s 2023-05-08T04:51:41.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:51:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4039.487937 secs 2023-05-08T04:51:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:51:40 smithi186 ceph-mon[126480]: pgmap v2217: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 117 KiB/s wr, 10 op/s 2023-05-08T04:51:41.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:51:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4039.487937 secs 2023-05-08T04:51:42.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:51:42 smithi133 ceph-mon[125939]: pgmap v2218: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 117 KiB/s wr, 7 op/s 2023-05-08T04:51:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:51:42 smithi096 ceph-mon[124666]: pgmap v2218: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 117 KiB/s wr, 7 op/s 2023-05-08T04:51:43.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:51:42 smithi186 ceph-mon[126480]: pgmap v2218: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 117 KiB/s wr, 7 op/s 2023-05-08T04:51:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:51:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4042.650640 secs 2023-05-08T04:51:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:51:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4042.650640 secs 2023-05-08T04:51:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:51:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4042.650640 secs 2023-05-08T04:51:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:51:44 smithi133 ceph-mon[125939]: pgmap v2219: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 117 KiB/s wr, 7 op/s 2023-05-08T04:51:44.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:51:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4043.206793 secs 2023-05-08T04:51:45.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:51:44 smithi096 ceph-mon[124666]: pgmap v2219: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 117 KiB/s wr, 7 op/s 2023-05-08T04:51:45.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:51:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4043.206793 secs 2023-05-08T04:51:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:51:44 smithi186 ceph-mon[126480]: pgmap v2219: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 117 KiB/s wr, 7 op/s 2023-05-08T04:51:45.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:51:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4043.206793 secs 2023-05-08T04:51:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:51:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4044.488058 secs 2023-05-08T04:51:46.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:51:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4044.488058 secs 2023-05-08T04:51:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:51:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4044.488058 secs 2023-05-08T04:51:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:51:46 smithi133 ceph-mon[125939]: pgmap v2220: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 138 KiB/s wr, 10 op/s 2023-05-08T04:51:47.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:51:46 smithi096 ceph-mon[124666]: pgmap v2220: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 138 KiB/s wr, 10 op/s 2023-05-08T04:51:47.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:51:46 smithi186 ceph-mon[126480]: pgmap v2220: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 138 KiB/s wr, 10 op/s 2023-05-08T04:51:48.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:51:48 smithi133 ceph-mon[125939]: pgmap v2221: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 91 KiB/s wr, 7 op/s 2023-05-08T04:51:48.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:51:48 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:51:48.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:51:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4047.650746 secs 2023-05-08T04:51:48.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:51:48 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:51:48.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:51:48 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:51:48.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:51:48 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:51:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:51:48 smithi096 ceph-mon[124666]: pgmap v2221: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 91 KiB/s wr, 7 op/s 2023-05-08T04:51:49.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:51:48 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:51:49.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:51:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4047.650746 secs 2023-05-08T04:51:49.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:51:48 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:51:49.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:51:48 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:51:49.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:51:48 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:51:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:51:48 smithi186 ceph-mon[126480]: pgmap v2221: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 91 KiB/s wr, 7 op/s 2023-05-08T04:51:49.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:51:48 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:51:49.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:51:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4047.650746 secs 2023-05-08T04:51:49.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:51:48 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:51:49.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:51:48 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:51:49.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:51:48 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:51:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:51:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4048.206905 secs 2023-05-08T04:51:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:51:49 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:51:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:51:49 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T04:51:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:51:49 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T04:51:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:51:49 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:51:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:51:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4048.206905 secs 2023-05-08T04:51:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:51:49 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:51:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:51:49 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T04:51:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:51:49 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T04:51:50.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:51:49 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:51:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:51:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4048.206905 secs 2023-05-08T04:51:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:51:49 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:51:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:51:49 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T04:51:50.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:51:49 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T04:51:50.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:51:49 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:51:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:51:50 smithi133 ceph-mon[125939]: pgmap v2222: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 91 KiB/s wr, 9 op/s 2023-05-08T04:51:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:51:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4049.488176 secs 2023-05-08T04:51:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:51:50 smithi096 ceph-mon[124666]: pgmap v2222: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 91 KiB/s wr, 9 op/s 2023-05-08T04:51:51.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:51:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4049.488176 secs 2023-05-08T04:51:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:51:50 smithi186 ceph-mon[126480]: pgmap v2222: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 91 KiB/s wr, 9 op/s 2023-05-08T04:51:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:51:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4049.488176 secs 2023-05-08T04:51:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:51:52 smithi133 ceph-mon[125939]: pgmap v2223: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 5 op/s 2023-05-08T04:51:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:51:52 smithi096 ceph-mon[124666]: pgmap v2223: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 5 op/s 2023-05-08T04:51:53.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:51:52 smithi186 ceph-mon[126480]: pgmap v2223: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 5 op/s 2023-05-08T04:51:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:51:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4052.650905 secs 2023-05-08T04:51:54.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:51:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4052.650905 secs 2023-05-08T04:51:54.125 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:51:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4052.650905 secs 2023-05-08T04:51:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:51:54 smithi133 ceph-mon[125939]: pgmap v2224: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 5 op/s 2023-05-08T04:51:54.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:51:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4053.207038 secs 2023-05-08T04:51:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:51:54 smithi096 ceph-mon[124666]: pgmap v2224: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 5 op/s 2023-05-08T04:51:55.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:51:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4053.207038 secs 2023-05-08T04:51:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:51:54 smithi186 ceph-mon[126480]: pgmap v2224: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 5 op/s 2023-05-08T04:51:55.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:51:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4053.207038 secs 2023-05-08T04:51:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:51:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4054.488267 secs 2023-05-08T04:51:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:51:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4054.488267 secs 2023-05-08T04:51:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:51:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4054.488267 secs 2023-05-08T04:51:56.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:51:56 smithi133 ceph-mon[125939]: pgmap v2225: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 20 KiB/s wr, 8 op/s 2023-05-08T04:51:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:51:56 smithi096 ceph-mon[124666]: pgmap v2225: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 20 KiB/s wr, 8 op/s 2023-05-08T04:51:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:51:56 smithi186 ceph-mon[126480]: pgmap v2225: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 20 KiB/s wr, 8 op/s 2023-05-08T04:51:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:51:58 smithi133 ceph-mon[125939]: pgmap v2226: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2023-05-08T04:51:58.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:51:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4057.651041 secs 2023-05-08T04:51:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:51:58 smithi096 ceph-mon[124666]: pgmap v2226: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2023-05-08T04:51:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:51:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4057.651041 secs 2023-05-08T04:51:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:51:58 smithi186 ceph-mon[126480]: pgmap v2226: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2023-05-08T04:51:59.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:51:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4057.651041 secs 2023-05-08T04:51:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:51:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4058.207199 secs 2023-05-08T04:52:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:51:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4058.207199 secs 2023-05-08T04:52:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:51:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4058.207199 secs 2023-05-08T04:52:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:52:00 smithi133 ceph-mon[125939]: pgmap v2227: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 7 op/s 2023-05-08T04:52:00.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:52:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4059.488422 secs 2023-05-08T04:52:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:52:00 smithi096 ceph-mon[124666]: pgmap v2227: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 7 op/s 2023-05-08T04:52:01.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:52:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4059.488422 secs 2023-05-08T04:52:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:52:00 smithi186 ceph-mon[126480]: pgmap v2227: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 7 op/s 2023-05-08T04:52:01.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:52:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4059.488422 secs 2023-05-08T04:52:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:52:02 smithi133 ceph-mon[125939]: pgmap v2228: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:52:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:52:02 smithi096 ceph-mon[124666]: pgmap v2228: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:52:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:52:02 smithi186 ceph-mon[126480]: pgmap v2228: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:52:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:52:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4062.651139 secs 2023-05-08T04:52:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:52:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4062.651139 secs 2023-05-08T04:52:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:52:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4062.651139 secs 2023-05-08T04:52:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:52:04 smithi096 ceph-mon[124666]: pgmap v2229: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:52:05.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:52:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4063.207355 secs 2023-05-08T04:52:05.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:52:04 smithi186 ceph-mon[126480]: pgmap v2229: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:52:05.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:52:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4063.207355 secs 2023-05-08T04:52:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:52:04 smithi133 ceph-mon[125939]: pgmap v2229: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:52:05.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:52:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4063.207355 secs 2023-05-08T04:52:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:52:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4064.488558 secs 2023-05-08T04:52:06.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:52:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4064.488558 secs 2023-05-08T04:52:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:52:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4064.488558 secs 2023-05-08T04:52:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:52:06 smithi096 ceph-mon[124666]: pgmap v2230: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:52:07.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:52:06 smithi186 ceph-mon[126480]: pgmap v2230: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:52:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:52:06 smithi133 ceph-mon[125939]: pgmap v2230: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:52:09.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:52:08 smithi096 ceph-mon[124666]: pgmap v2231: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:52:09.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:52:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4067.651278 secs 2023-05-08T04:52:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:52:08 smithi186 ceph-mon[126480]: pgmap v2231: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:52:09.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:52:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4067.651278 secs 2023-05-08T04:52:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:52:08 smithi133 ceph-mon[125939]: pgmap v2231: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:52:09.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:52:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4067.651278 secs 2023-05-08T04:52:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:52:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4068.207514 secs 2023-05-08T04:52:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:52:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4068.207514 secs 2023-05-08T04:52:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:52:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4068.207514 secs 2023-05-08T04:52:11.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:52:10 smithi186 ceph-mon[126480]: pgmap v2232: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:52:11.123 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:52:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4069.488679 secs 2023-05-08T04:52:11.124 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:52:10 smithi186 ceph-mon[126480]: osdmap e220: 12 total, 12 up, 12 in 2023-05-08T04:52:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:52:10 smithi133 ceph-mon[125939]: pgmap v2232: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:52:11.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:52:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4069.488679 secs 2023-05-08T04:52:11.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:52:10 smithi133 ceph-mon[125939]: osdmap e220: 12 total, 12 up, 12 in 2023-05-08T04:52:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:52:10 smithi096 ceph-mon[124666]: pgmap v2232: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:52:11.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:52:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4069.488679 secs 2023-05-08T04:52:11.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:52:10 smithi096 ceph-mon[124666]: osdmap e220: 12 total, 12 up, 12 in 2023-05-08T04:52:13.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:52:12 smithi186 ceph-mon[126480]: pgmap v2234: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:52:13.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:52:12 smithi133 ceph-mon[125939]: pgmap v2234: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:52:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:52:12 smithi096 ceph-mon[124666]: pgmap v2234: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:52:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:52:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4072.651381 secs 2023-05-08T04:52:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:52:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4072.651381 secs 2023-05-08T04:52:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:52:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4072.651381 secs 2023-05-08T04:52:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:52:14 smithi186 ceph-mon[126480]: pgmap v2235: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:52:15.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:52:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4073.207646 secs 2023-05-08T04:52:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:52:14 smithi133 ceph-mon[125939]: pgmap v2235: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:52:15.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:52:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4073.207646 secs 2023-05-08T04:52:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:52:14 smithi096 ceph-mon[124666]: pgmap v2235: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:52:15.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:52:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4073.207646 secs 2023-05-08T04:52:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:52:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4074.488840 secs 2023-05-08T04:52:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:52:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4074.488840 secs 2023-05-08T04:52:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:52:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4074.488840 secs 2023-05-08T04:52:17.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:52:16 smithi186 ceph-mon[126480]: pgmap v2236: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:52:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:52:16 smithi133 ceph-mon[125939]: pgmap v2236: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:52:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:52:16 smithi096 ceph-mon[124666]: pgmap v2236: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:52:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:52:18 smithi186 ceph-mon[126480]: pgmap v2237: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:52:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:52:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4077.651459 secs 2023-05-08T04:52:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:52:18 smithi186 ceph-mon[126480]: osdmap e221: 12 total, 12 up, 12 in 2023-05-08T04:52:19.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:52:18 smithi133 ceph-mon[125939]: pgmap v2237: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:52:19.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:52:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4077.651459 secs 2023-05-08T04:52:19.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:52:18 smithi133 ceph-mon[125939]: osdmap e221: 12 total, 12 up, 12 in 2023-05-08T04:52:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:52:18 smithi096 ceph-mon[124666]: pgmap v2237: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:52:19.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:52:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4077.651459 secs 2023-05-08T04:52:19.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:52:18 smithi096 ceph-mon[124666]: osdmap e221: 12 total, 12 up, 12 in 2023-05-08T04:52:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:52:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4078.207776 secs 2023-05-08T04:52:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:52:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4078.207776 secs 2023-05-08T04:52:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:52:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4078.207776 secs 2023-05-08T04:52:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:52:20 smithi186 ceph-mon[126480]: pgmap v2239: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 215 B/s wr, 7 op/s 2023-05-08T04:52:21.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:52:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4079.488949 secs 2023-05-08T04:52:21.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:52:20 smithi133 ceph-mon[125939]: pgmap v2239: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 215 B/s wr, 7 op/s 2023-05-08T04:52:21.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:52:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4079.488949 secs 2023-05-08T04:52:21.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:52:20 smithi096 ceph-mon[124666]: pgmap v2239: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 215 B/s wr, 7 op/s 2023-05-08T04:52:21.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:52:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4079.488949 secs 2023-05-08T04:52:23.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:52:22 smithi186 ceph-mon[126480]: pgmap v2240: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:52:23.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:52:22 smithi133 ceph-mon[125939]: pgmap v2240: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:52:23.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:52:22 smithi096 ceph-mon[124666]: pgmap v2240: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:52:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:52:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4082.651603 secs 2023-05-08T04:52:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:52:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4082.651603 secs 2023-05-08T04:52:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:52:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4082.651603 secs 2023-05-08T04:52:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:52:24 smithi186 ceph-mon[126480]: pgmap v2241: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:52:25.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:52:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4083.207894 secs 2023-05-08T04:52:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:52:24 smithi133 ceph-mon[125939]: pgmap v2241: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:52:25.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:52:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4083.207894 secs 2023-05-08T04:52:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:52:24 smithi096 ceph-mon[124666]: pgmap v2241: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:52:25.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:52:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4083.207894 secs 2023-05-08T04:52:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:52:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4084.489089 secs 2023-05-08T04:52:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:52:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4084.489089 secs 2023-05-08T04:52:26.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:52:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4084.489089 secs 2023-05-08T04:52:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:52:26 smithi186 ceph-mon[126480]: pgmap v2242: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:52:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:52:26 smithi133 ceph-mon[125939]: pgmap v2242: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:52:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:52:26 smithi096 ceph-mon[124666]: pgmap v2242: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:52:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:52:28 smithi186 ceph-mon[126480]: pgmap v2243: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:52:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:52:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4087.651713 secs 2023-05-08T04:52:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:52:28 smithi133 ceph-mon[125939]: pgmap v2243: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:52:29.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:52:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4087.651713 secs 2023-05-08T04:52:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:52:28 smithi096 ceph-mon[124666]: pgmap v2243: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:52:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:52:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4087.651713 secs 2023-05-08T04:52:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:52:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4088.208044 secs 2023-05-08T04:52:30.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:52:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4088.208044 secs 2023-05-08T04:52:30.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:52:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4088.208044 secs 2023-05-08T04:52:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:52:30 smithi186 ceph-mon[126480]: pgmap v2244: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 95 B/s wr, 8 op/s 2023-05-08T04:52:31.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:52:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4089.489217 secs 2023-05-08T04:52:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:52:30 smithi133 ceph-mon[125939]: pgmap v2244: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 95 B/s wr, 8 op/s 2023-05-08T04:52:31.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:52:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4089.489217 secs 2023-05-08T04:52:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:52:30 smithi096 ceph-mon[124666]: pgmap v2244: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 95 B/s wr, 8 op/s 2023-05-08T04:52:31.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:52:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4089.489217 secs 2023-05-08T04:52:33.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:52:32 smithi186 ceph-mon[126480]: pgmap v2245: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:52:33.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:52:32 smithi133 ceph-mon[125939]: pgmap v2245: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:52:33.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:52:32 smithi096 ceph-mon[124666]: pgmap v2245: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:52:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:52:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4092.651835 secs 2023-05-08T04:52:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:52:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4092.651835 secs 2023-05-08T04:52:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:52:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4092.651835 secs 2023-05-08T04:52:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:52:34 smithi186 ceph-mon[126480]: pgmap v2246: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:52:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:52:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4093.208207 secs 2023-05-08T04:52:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:52:34 smithi133 ceph-mon[125939]: pgmap v2246: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:52:35.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:52:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4093.208207 secs 2023-05-08T04:52:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:52:34 smithi096 ceph-mon[124666]: pgmap v2246: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:52:35.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:52:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4093.208207 secs 2023-05-08T04:52:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:52:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4094.489336 secs 2023-05-08T04:52:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:52:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4094.489336 secs 2023-05-08T04:52:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:52:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4094.489336 secs 2023-05-08T04:52:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:52:36 smithi186 ceph-mon[126480]: pgmap v2247: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 67 KiB/s wr, 9 op/s 2023-05-08T04:52:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:52:36 smithi133 ceph-mon[125939]: pgmap v2247: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 67 KiB/s wr, 9 op/s 2023-05-08T04:52:37.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:52:36 smithi096 ceph-mon[124666]: pgmap v2247: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 67 KiB/s wr, 9 op/s 2023-05-08T04:52:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:52:38 smithi186 ceph-mon[126480]: pgmap v2248: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 67 KiB/s wr, 7 op/s 2023-05-08T04:52:39.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:52:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4097.651933 secs 2023-05-08T04:52:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:52:38 smithi133 ceph-mon[125939]: pgmap v2248: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 67 KiB/s wr, 7 op/s 2023-05-08T04:52:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:52:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4097.651933 secs 2023-05-08T04:52:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:52:38 smithi096 ceph-mon[124666]: pgmap v2248: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 67 KiB/s wr, 7 op/s 2023-05-08T04:52:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:52:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4097.651933 secs 2023-05-08T04:52:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:52:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4098.208333 secs 2023-05-08T04:52:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:52:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4098.208333 secs 2023-05-08T04:52:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:52:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4098.208333 secs 2023-05-08T04:52:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:52:40 smithi186 ceph-mon[126480]: pgmap v2249: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 160 KiB/s wr, 11 op/s 2023-05-08T04:52:41.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:52:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4099.489453 secs 2023-05-08T04:52:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:52:40 smithi133 ceph-mon[125939]: pgmap v2249: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 160 KiB/s wr, 11 op/s 2023-05-08T04:52:41.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:52:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4099.489453 secs 2023-05-08T04:52:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:52:40 smithi096 ceph-mon[124666]: pgmap v2249: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 160 KiB/s wr, 11 op/s 2023-05-08T04:52:41.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:52:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4099.489453 secs 2023-05-08T04:52:43.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:52:42 smithi186 ceph-mon[126480]: pgmap v2250: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 160 KiB/s wr, 9 op/s 2023-05-08T04:52:43.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:52:42 smithi133 ceph-mon[125939]: pgmap v2250: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 160 KiB/s wr, 9 op/s 2023-05-08T04:52:43.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:52:42 smithi096 ceph-mon[124666]: pgmap v2250: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 160 KiB/s wr, 9 op/s 2023-05-08T04:52:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:52:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4102.652052 secs 2023-05-08T04:52:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:52:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4102.652052 secs 2023-05-08T04:52:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:52:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4102.652052 secs 2023-05-08T04:52:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:52:44 smithi133 ceph-mon[125939]: pgmap v2251: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 160 KiB/s wr, 9 op/s 2023-05-08T04:52:45.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:52:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4103.208465 secs 2023-05-08T04:52:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:52:44 smithi096 ceph-mon[124666]: pgmap v2251: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 160 KiB/s wr, 9 op/s 2023-05-08T04:52:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:52:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4103.208465 secs 2023-05-08T04:52:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:52:44 smithi186 ceph-mon[126480]: pgmap v2251: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 160 KiB/s wr, 9 op/s 2023-05-08T04:52:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:52:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4103.208465 secs 2023-05-08T04:52:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:52:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4104.489593 secs 2023-05-08T04:52:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:52:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4104.489593 secs 2023-05-08T04:52:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:52:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4104.489593 secs 2023-05-08T04:52:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:52:46 smithi133 ceph-mon[125939]: pgmap v2252: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 181 KiB/s wr, 13 op/s 2023-05-08T04:52:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:52:46 smithi096 ceph-mon[124666]: pgmap v2252: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 181 KiB/s wr, 13 op/s 2023-05-08T04:52:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:52:46 smithi186 ceph-mon[126480]: pgmap v2252: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 181 KiB/s wr, 13 op/s 2023-05-08T04:52:49.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:52:48 smithi133 ceph-mon[125939]: pgmap v2253: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 114 KiB/s wr, 8 op/s 2023-05-08T04:52:49.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:52:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4107.652169 secs 2023-05-08T04:52:49.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:52:48 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:52:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:52:48 smithi096 ceph-mon[124666]: pgmap v2253: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 114 KiB/s wr, 8 op/s 2023-05-08T04:52:49.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:52:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4107.652169 secs 2023-05-08T04:52:49.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:52:48 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:52:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:52:48 smithi186 ceph-mon[126480]: pgmap v2253: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 114 KiB/s wr, 8 op/s 2023-05-08T04:52:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:52:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4107.652169 secs 2023-05-08T04:52:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:52:48 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:52:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:52:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4108.208571 secs 2023-05-08T04:52:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:52:49 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:52:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:52:49 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:52:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:52:49 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:52:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:52:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4108.208571 secs 2023-05-08T04:52:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:52:49 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:52:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:52:49 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:52:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:52:49 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:52:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:52:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4108.208571 secs 2023-05-08T04:52:50.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:52:49 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:52:50.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:52:49 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:52:50.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:52:49 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:52:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:52:50 smithi133 ceph-mon[125939]: pgmap v2254: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 114 KiB/s wr, 11 op/s 2023-05-08T04:52:51.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:52:50 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:52:51.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:52:50 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T04:52:51.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:52:50 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T04:52:51.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:52:50 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:52:51.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:52:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4109.489735 secs 2023-05-08T04:52:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:52:50 smithi096 ceph-mon[124666]: pgmap v2254: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 114 KiB/s wr, 11 op/s 2023-05-08T04:52:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:52:50 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:52:51.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:52:50 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T04:52:51.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:52:50 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T04:52:51.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:52:50 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:52:51.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:52:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4109.489735 secs 2023-05-08T04:52:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:52:50 smithi186 ceph-mon[126480]: pgmap v2254: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 114 KiB/s wr, 11 op/s 2023-05-08T04:52:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:52:50 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:52:51.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:52:50 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T04:52:51.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:52:50 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T04:52:51.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:52:50 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:52:51.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:52:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4109.489735 secs 2023-05-08T04:52:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:52:52 smithi133 ceph-mon[125939]: pgmap v2255: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 21 KiB/s wr, 6 op/s 2023-05-08T04:52:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:52:52 smithi096 ceph-mon[124666]: pgmap v2255: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 21 KiB/s wr, 6 op/s 2023-05-08T04:52:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:52:52 smithi186 ceph-mon[126480]: pgmap v2255: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 21 KiB/s wr, 6 op/s 2023-05-08T04:52:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:52:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4112.652286 secs 2023-05-08T04:52:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:52:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4112.652286 secs 2023-05-08T04:52:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:52:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4112.652286 secs 2023-05-08T04:52:55.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:52:54 smithi133 ceph-mon[125939]: pgmap v2256: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 21 KiB/s wr, 6 op/s 2023-05-08T04:52:55.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:52:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4113.208696 secs 2023-05-08T04:52:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:52:54 smithi096 ceph-mon[124666]: pgmap v2256: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 21 KiB/s wr, 6 op/s 2023-05-08T04:52:55.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:52:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4113.208696 secs 2023-05-08T04:52:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:52:54 smithi186 ceph-mon[126480]: pgmap v2256: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 21 KiB/s wr, 6 op/s 2023-05-08T04:52:55.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:52:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4113.208696 secs 2023-05-08T04:52:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:52:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4114.489854 secs 2023-05-08T04:52:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:52:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4114.489854 secs 2023-05-08T04:52:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:52:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4114.489854 secs 2023-05-08T04:52:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:52:56 smithi133 ceph-mon[125939]: pgmap v2257: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 21 KiB/s wr, 9 op/s 2023-05-08T04:52:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:52:56 smithi096 ceph-mon[124666]: pgmap v2257: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 21 KiB/s wr, 9 op/s 2023-05-08T04:52:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:52:56 smithi186 ceph-mon[126480]: pgmap v2257: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 21 KiB/s wr, 9 op/s 2023-05-08T04:52:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:52:58 smithi133 ceph-mon[125939]: pgmap v2258: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:52:59.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:52:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4117.652406 secs 2023-05-08T04:52:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:52:58 smithi096 ceph-mon[124666]: pgmap v2258: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:52:59.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:52:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4117.652406 secs 2023-05-08T04:52:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:52:58 smithi186 ceph-mon[126480]: pgmap v2258: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:52:59.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:52:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4117.652406 secs 2023-05-08T04:53:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:52:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4118.208784 secs 2023-05-08T04:53:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:52:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4118.208784 secs 2023-05-08T04:53:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:52:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4118.208784 secs 2023-05-08T04:53:01.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:00 smithi133 ceph-mon[125939]: pgmap v2259: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T04:53:01.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4119.489970 secs 2023-05-08T04:53:01.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:00 smithi096 ceph-mon[124666]: pgmap v2259: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T04:53:01.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4119.489970 secs 2023-05-08T04:53:01.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:00 smithi186 ceph-mon[126480]: pgmap v2259: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T04:53:01.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4119.489970 secs 2023-05-08T04:53:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:02 smithi133 ceph-mon[125939]: pgmap v2260: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:53:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:02 smithi096 ceph-mon[124666]: pgmap v2260: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:53:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:02 smithi186 ceph-mon[126480]: pgmap v2260: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:53:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4122.652555 secs 2023-05-08T04:53:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4122.652555 secs 2023-05-08T04:53:04.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4122.652555 secs 2023-05-08T04:53:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:04 smithi133 ceph-mon[125939]: pgmap v2261: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:53:05.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4123.208908 secs 2023-05-08T04:53:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:04 smithi096 ceph-mon[124666]: pgmap v2261: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:53:05.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4123.208908 secs 2023-05-08T04:53:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:04 smithi186 ceph-mon[126480]: pgmap v2261: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:53:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4123.208908 secs 2023-05-08T04:53:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4124.490048 secs 2023-05-08T04:53:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4124.490048 secs 2023-05-08T04:53:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4124.490048 secs 2023-05-08T04:53:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:06 smithi133 ceph-mon[125939]: pgmap v2262: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-05-08T04:53:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:06 smithi096 ceph-mon[124666]: pgmap v2262: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-05-08T04:53:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:06 smithi186 ceph-mon[126480]: pgmap v2262: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-05-08T04:53:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:08 smithi133 ceph-mon[125939]: pgmap v2263: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 20 op/s 2023-05-08T04:53:09.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4127.652664 secs 2023-05-08T04:53:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:08 smithi096 ceph-mon[124666]: pgmap v2263: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 20 op/s 2023-05-08T04:53:09.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4127.652664 secs 2023-05-08T04:53:09.376 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:08 smithi186 ceph-mon[126480]: pgmap v2263: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 20 op/s 2023-05-08T04:53:09.376 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4127.652664 secs 2023-05-08T04:53:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4128.209057 secs 2023-05-08T04:53:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4128.209057 secs 2023-05-08T04:53:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4128.209057 secs 2023-05-08T04:53:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:10 smithi133 ceph-mon[125939]: pgmap v2264: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:53:11.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4129.490147 secs 2023-05-08T04:53:11.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:10 smithi133 ceph-mon[125939]: osdmap e222: 12 total, 12 up, 12 in 2023-05-08T04:53:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:10 smithi096 ceph-mon[124666]: pgmap v2264: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:53:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4129.490147 secs 2023-05-08T04:53:11.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:10 smithi096 ceph-mon[124666]: osdmap e222: 12 total, 12 up, 12 in 2023-05-08T04:53:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:10 smithi186 ceph-mon[126480]: pgmap v2264: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:53:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4129.490147 secs 2023-05-08T04:53:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:10 smithi186 ceph-mon[126480]: osdmap e222: 12 total, 12 up, 12 in 2023-05-08T04:53:13.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:12 smithi133 ceph-mon[125939]: pgmap v2266: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:53:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:12 smithi096 ceph-mon[124666]: pgmap v2266: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:53:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:12 smithi186 ceph-mon[126480]: pgmap v2266: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:53:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4132.652752 secs 2023-05-08T04:53:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4132.652752 secs 2023-05-08T04:53:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4132.652752 secs 2023-05-08T04:53:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:14 smithi133 ceph-mon[125939]: pgmap v2267: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:53:15.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4133.209181 secs 2023-05-08T04:53:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:14 smithi096 ceph-mon[124666]: pgmap v2267: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:53:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4133.209181 secs 2023-05-08T04:53:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:14 smithi186 ceph-mon[126480]: pgmap v2267: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:53:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4133.209181 secs 2023-05-08T04:53:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4134.490247 secs 2023-05-08T04:53:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4134.490247 secs 2023-05-08T04:53:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4134.490247 secs 2023-05-08T04:53:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:16 smithi133 ceph-mon[125939]: pgmap v2268: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:53:17.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:16 smithi096 ceph-mon[124666]: pgmap v2268: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:53:17.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:16 smithi186 ceph-mon[126480]: pgmap v2268: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:53:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:18 smithi133 ceph-mon[125939]: pgmap v2269: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:53:19.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4137.652861 secs 2023-05-08T04:53:19.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:18 smithi133 ceph-mon[125939]: osdmap e223: 12 total, 12 up, 12 in 2023-05-08T04:53:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:18 smithi096 ceph-mon[124666]: pgmap v2269: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:53:19.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4137.652861 secs 2023-05-08T04:53:19.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:18 smithi096 ceph-mon[124666]: osdmap e223: 12 total, 12 up, 12 in 2023-05-08T04:53:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:18 smithi186 ceph-mon[126480]: pgmap v2269: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:53:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4137.652861 secs 2023-05-08T04:53:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:18 smithi186 ceph-mon[126480]: osdmap e223: 12 total, 12 up, 12 in 2023-05-08T04:53:20.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4138.209281 secs 2023-05-08T04:53:20.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4138.209281 secs 2023-05-08T04:53:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4138.209281 secs 2023-05-08T04:53:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:20 smithi133 ceph-mon[125939]: pgmap v2271: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 219 B/s wr, 7 op/s 2023-05-08T04:53:21.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4139.490364 secs 2023-05-08T04:53:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:20 smithi096 ceph-mon[124666]: pgmap v2271: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 219 B/s wr, 7 op/s 2023-05-08T04:53:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4139.490364 secs 2023-05-08T04:53:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:20 smithi186 ceph-mon[126480]: pgmap v2271: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 219 B/s wr, 7 op/s 2023-05-08T04:53:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4139.490364 secs 2023-05-08T04:53:23.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:22 smithi133 ceph-mon[125939]: pgmap v2272: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:53:23.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:22 smithi096 ceph-mon[124666]: pgmap v2272: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:53:23.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:22 smithi186 ceph-mon[126480]: pgmap v2272: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:53:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4142.652964 secs 2023-05-08T04:53:24.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4142.652964 secs 2023-05-08T04:53:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4142.652964 secs 2023-05-08T04:53:25.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:24 smithi133 ceph-mon[125939]: pgmap v2273: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:53:25.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4143.209381 secs 2023-05-08T04:53:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:24 smithi096 ceph-mon[124666]: pgmap v2273: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:53:25.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4143.209381 secs 2023-05-08T04:53:25.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:24 smithi186 ceph-mon[126480]: pgmap v2273: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:53:25.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4143.209381 secs 2023-05-08T04:53:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4144.490487 secs 2023-05-08T04:53:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4144.490487 secs 2023-05-08T04:53:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4144.490487 secs 2023-05-08T04:53:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:26 smithi096 ceph-mon[124666]: pgmap v2274: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:53:27.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:26 smithi186 ceph-mon[126480]: pgmap v2274: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:53:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:26 smithi133 ceph-mon[125939]: pgmap v2274: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:53:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:28 smithi096 ceph-mon[124666]: pgmap v2275: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:53:29.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4147.653045 secs 2023-05-08T04:53:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:28 smithi186 ceph-mon[126480]: pgmap v2275: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:53:29.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4147.653045 secs 2023-05-08T04:53:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:28 smithi133 ceph-mon[125939]: pgmap v2275: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:53:29.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4147.653045 secs 2023-05-08T04:53:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4148.209501 secs 2023-05-08T04:53:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4148.209501 secs 2023-05-08T04:53:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4148.209501 secs 2023-05-08T04:53:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:31 smithi096 ceph-mon[124666]: pgmap v2276: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 95 B/s wr, 8 op/s 2023-05-08T04:53:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4149.490603 secs 2023-05-08T04:53:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:31 smithi186 ceph-mon[126480]: pgmap v2276: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 95 B/s wr, 8 op/s 2023-05-08T04:53:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4149.490603 secs 2023-05-08T04:53:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:31 smithi133 ceph-mon[125939]: pgmap v2276: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 95 B/s wr, 8 op/s 2023-05-08T04:53:31.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4149.490603 secs 2023-05-08T04:53:33.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:33 smithi186 ceph-mon[126480]: pgmap v2277: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:53:33.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:33 smithi133 ceph-mon[125939]: pgmap v2277: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:53:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:33 smithi096 ceph-mon[124666]: pgmap v2277: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:53:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4152.653162 secs 2023-05-08T04:53:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4152.653162 secs 2023-05-08T04:53:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4152.653162 secs 2023-05-08T04:53:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:35 smithi186 ceph-mon[126480]: pgmap v2278: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:53:35.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4153.209627 secs 2023-05-08T04:53:35.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:35 smithi133 ceph-mon[125939]: pgmap v2278: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:53:35.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4153.209627 secs 2023-05-08T04:53:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:35 smithi096 ceph-mon[124666]: pgmap v2278: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:53:35.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4153.209627 secs 2023-05-08T04:53:37.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:37 smithi186 ceph-mon[126480]: pgmap v2279: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 48 KiB/s wr, 8 op/s 2023-05-08T04:53:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:37 smithi133 ceph-mon[125939]: pgmap v2279: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 48 KiB/s wr, 8 op/s 2023-05-08T04:53:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:37 smithi096 ceph-mon[124666]: pgmap v2279: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 48 KiB/s wr, 8 op/s 2023-05-08T04:53:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:38 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:53:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:38 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:53:38.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:38 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:53:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:39 smithi186 ceph-mon[126480]: pgmap v2280: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 48 KiB/s wr, 6 op/s 2023-05-08T04:53:39.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4157.653282 secs 2023-05-08T04:53:39.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:39 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:53:39.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:39 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:53:39.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:39 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:53:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:39 smithi133 ceph-mon[125939]: pgmap v2280: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 48 KiB/s wr, 6 op/s 2023-05-08T04:53:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4157.653282 secs 2023-05-08T04:53:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:39 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:53:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:39 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:53:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:39 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:53:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:39 smithi096 ceph-mon[124666]: pgmap v2280: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 48 KiB/s wr, 6 op/s 2023-05-08T04:53:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4157.653282 secs 2023-05-08T04:53:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:39 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:53:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:39 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:53:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:39 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:53:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4158.209720 secs 2023-05-08T04:53:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4158.209720 secs 2023-05-08T04:53:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4158.209720 secs 2023-05-08T04:53:41.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:41 smithi186 ceph-mon[126480]: pgmap v2281: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 120 KiB/s wr, 10 op/s 2023-05-08T04:53:41.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4159.490813 secs 2023-05-08T04:53:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:41 smithi133 ceph-mon[125939]: pgmap v2281: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 120 KiB/s wr, 10 op/s 2023-05-08T04:53:41.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4159.490813 secs 2023-05-08T04:53:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:41 smithi096 ceph-mon[124666]: pgmap v2281: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 120 KiB/s wr, 10 op/s 2023-05-08T04:53:41.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4159.490813 secs 2023-05-08T04:53:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:43 smithi186 ceph-mon[126480]: pgmap v2282: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 120 KiB/s wr, 7 op/s 2023-05-08T04:53:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:53:43.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:53:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:43 smithi133 ceph-mon[125939]: pgmap v2282: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 120 KiB/s wr, 7 op/s 2023-05-08T04:53:43.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:53:43.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:53:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:43 smithi096 ceph-mon[124666]: pgmap v2282: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 120 KiB/s wr, 7 op/s 2023-05-08T04:53:43.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:53:43.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:53:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4162.653417 secs 2023-05-08T04:53:44.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:44 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:53:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4162.653417 secs 2023-05-08T04:53:44.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:44 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:53:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4162.653417 secs 2023-05-08T04:53:44.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:44 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:53:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:45 smithi186 ceph-mon[126480]: pgmap v2283: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 120 KiB/s wr, 7 op/s 2023-05-08T04:53:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4163.209850 secs 2023-05-08T04:53:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:45 smithi133 ceph-mon[125939]: pgmap v2283: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 120 KiB/s wr, 7 op/s 2023-05-08T04:53:45.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4163.209850 secs 2023-05-08T04:53:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:45 smithi096 ceph-mon[124666]: pgmap v2283: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 120 KiB/s wr, 7 op/s 2023-05-08T04:53:45.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4163.209850 secs 2023-05-08T04:53:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4164.490930 secs 2023-05-08T04:53:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4164.490930 secs 2023-05-08T04:53:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4164.490930 secs 2023-05-08T04:53:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:47 smithi186 ceph-mon[126480]: pgmap v2284: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 141 KiB/s wr, 10 op/s 2023-05-08T04:53:47.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:47 smithi133 ceph-mon[125939]: pgmap v2284: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 141 KiB/s wr, 10 op/s 2023-05-08T04:53:47.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:47 smithi096 ceph-mon[124666]: pgmap v2284: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 141 KiB/s wr, 10 op/s 2023-05-08T04:53:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:49 smithi186 ceph-mon[126480]: pgmap v2285: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 93 KiB/s wr, 7 op/s 2023-05-08T04:53:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4167.653536 secs 2023-05-08T04:53:49.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4168.209953 secs 2023-05-08T04:53:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:49 smithi133 ceph-mon[125939]: pgmap v2285: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 93 KiB/s wr, 7 op/s 2023-05-08T04:53:49.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4167.653536 secs 2023-05-08T04:53:49.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4168.209953 secs 2023-05-08T04:53:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:49 smithi096 ceph-mon[124666]: pgmap v2285: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 93 KiB/s wr, 7 op/s 2023-05-08T04:53:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4167.653536 secs 2023-05-08T04:53:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4168.209953 secs 2023-05-08T04:53:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:53:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:53:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:53:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:51 smithi186 ceph-mon[126480]: pgmap v2286: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 93 KiB/s wr, 9 op/s 2023-05-08T04:53:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4169.490992 secs 2023-05-08T04:53:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:51 smithi133 ceph-mon[125939]: pgmap v2286: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 93 KiB/s wr, 9 op/s 2023-05-08T04:53:51.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4169.490992 secs 2023-05-08T04:53:51.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:51 smithi096 ceph-mon[124666]: pgmap v2286: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 93 KiB/s wr, 9 op/s 2023-05-08T04:53:51.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4169.490992 secs 2023-05-08T04:53:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:53 smithi133 ceph-mon[125939]: pgmap v2287: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 5 op/s 2023-05-08T04:53:53.538 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:53 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:53:53.539 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:53 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:53:53.539 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:53 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:53:53.539 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:53 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:53:53.539 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:53 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:53:53.540 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:53 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:53:53.540 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:53 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:53:53.541 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:53 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:53:53.541 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:53 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:53:53.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:53 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:53:53.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:53 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:53:53.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:53 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:53:53.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:53 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:53:53.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:53 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:53:53.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:53 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:53:53.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:53 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:53:53.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:53 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:53:53.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:53 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:53:53.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:53 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:53:53.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:53 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:53:53.544 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:53 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:53:53.545 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:53 smithi096 ceph-mon[124666]: pgmap v2287: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 5 op/s 2023-05-08T04:53:53.545 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:53 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:53:53.546 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:53 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:53:53.546 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:53 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:53:53.546 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:53 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:53:53.546 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:53 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:53:53.547 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:53 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:53:53.547 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:53 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:53:53.547 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:53 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:53:53.547 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:53 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:53:53.547 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:53 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:53:53.548 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:53 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:53:53.548 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:53 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:53:53.548 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:53 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:53:53.548 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:53 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:53:53.548 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:53 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:53:53.549 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:53 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:53:53.549 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:53 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:53:53.549 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:53 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:53:53.549 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:53 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:53:53.549 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:53 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:53:53.549 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:53 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:53:53.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:53 smithi186 ceph-mon[126480]: pgmap v2287: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 5 op/s 2023-05-08T04:53:53.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:53 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:53:53.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:53 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:53:53.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:53 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:53:53.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:53 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:53:53.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:53 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:53:53.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:53 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:53:53.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:53 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:53:53.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:53 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:53:53.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:53 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:53:53.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:53 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:53:53.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:53 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:53:53.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:53 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:53:53.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:53 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:53:53.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:53 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:53:53.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:53 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:53:53.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:53 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:53:53.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:53 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:53:53.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:53 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T04:53:53.623 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:53 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:53:53.623 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:53 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:53:53.623 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:53 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:53:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:54 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T04:53:54.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:54 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T04:53:54.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:54 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi096 to 196.2M 2023-05-08T04:53:54.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:54 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi096 to 205766758: error parsing value: Value '205766758' is below minimum 939524096 2023-05-08T04:53:54.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4172.653657 secs 2023-05-08T04:53:54.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:54 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T04:53:54.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:54 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T04:53:54.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:54 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:53:54.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:54 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T04:53:54.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:54 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T04:53:54.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:54 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:53:54.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4173.210119 secs 2023-05-08T04:53:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:54 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T04:53:54.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:54 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T04:53:54.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:54 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi096 to 196.2M 2023-05-08T04:53:54.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:54 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi096 to 205766758: error parsing value: Value '205766758' is below minimum 939524096 2023-05-08T04:53:54.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4172.653657 secs 2023-05-08T04:53:54.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:54 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T04:53:54.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:54 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T04:53:54.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:54 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:53:54.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:54 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T04:53:54.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:54 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T04:53:54.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:54 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:53:54.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4173.210119 secs 2023-05-08T04:53:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:54 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T04:53:54.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:54 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T04:53:54.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:54 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi096 to 196.2M 2023-05-08T04:53:54.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:54 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi096 to 205766758: error parsing value: Value '205766758' is below minimum 939524096 2023-05-08T04:53:54.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4172.653657 secs 2023-05-08T04:53:54.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:54 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T04:53:54.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:54 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T04:53:54.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:54 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:53:54.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:54 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T04:53:54.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:54 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T04:53:54.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:54 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:53:54.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4173.210119 secs 2023-05-08T04:53:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:55 smithi133 ceph-mon[125939]: pgmap v2288: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 5 op/s 2023-05-08T04:53:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:55 smithi096 ceph-mon[124666]: pgmap v2288: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 5 op/s 2023-05-08T04:53:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:55 smithi186 ceph-mon[126480]: pgmap v2288: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 5 op/s 2023-05-08T04:53:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4174.491092 secs 2023-05-08T04:53:56.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4174.491092 secs 2023-05-08T04:53:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4174.491092 secs 2023-05-08T04:53:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:57 smithi133 ceph-mon[125939]: pgmap v2289: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 21 KiB/s wr, 8 op/s 2023-05-08T04:53:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:57 smithi096 ceph-mon[124666]: pgmap v2289: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 21 KiB/s wr, 8 op/s 2023-05-08T04:53:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:57 smithi186 ceph-mon[126480]: pgmap v2289: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 21 KiB/s wr, 8 op/s 2023-05-08T04:53:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:59 smithi133 ceph-mon[125939]: pgmap v2290: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2023-05-08T04:53:59.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4177.653754 secs 2023-05-08T04:53:59.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:53:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4178.210243 secs 2023-05-08T04:53:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:59 smithi096 ceph-mon[124666]: pgmap v2290: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2023-05-08T04:53:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4177.653754 secs 2023-05-08T04:53:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:53:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4178.210243 secs 2023-05-08T04:53:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:59 smithi186 ceph-mon[126480]: pgmap v2290: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2023-05-08T04:53:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4177.653754 secs 2023-05-08T04:53:59.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:53:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4178.210243 secs 2023-05-08T04:54:01.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:54:01 smithi133 ceph-mon[125939]: pgmap v2291: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 7 op/s 2023-05-08T04:54:01.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:54:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4179.491175 secs 2023-05-08T04:54:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:54:01 smithi096 ceph-mon[124666]: pgmap v2291: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 7 op/s 2023-05-08T04:54:01.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:54:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4179.491175 secs 2023-05-08T04:54:01.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:54:01 smithi186 ceph-mon[126480]: pgmap v2291: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 7 op/s 2023-05-08T04:54:01.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:54:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4179.491175 secs 2023-05-08T04:54:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:54:03 smithi133 ceph-mon[125939]: pgmap v2292: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:54:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:54:03 smithi096 ceph-mon[124666]: pgmap v2292: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:54:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:54:03 smithi186 ceph-mon[126480]: pgmap v2292: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:54:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:54:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4182.653888 secs 2023-05-08T04:54:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:54:04 smithi133 ceph-mon[125939]: pgmap v2293: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:54:04.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:54:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4183.210376 secs 2023-05-08T04:54:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:54:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4182.653888 secs 2023-05-08T04:54:04.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:54:04 smithi096 ceph-mon[124666]: pgmap v2293: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:54:04.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:54:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4183.210376 secs 2023-05-08T04:54:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:54:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4182.653888 secs 2023-05-08T04:54:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:54:04 smithi186 ceph-mon[126480]: pgmap v2293: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:54:04.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:54:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4183.210376 secs 2023-05-08T04:54:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:54:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4184.491249 secs 2023-05-08T04:54:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:54:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4184.491249 secs 2023-05-08T04:54:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:54:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4184.491249 secs 2023-05-08T04:54:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:54:06 smithi133 ceph-mon[125939]: pgmap v2294: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:54:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:54:06 smithi096 ceph-mon[124666]: pgmap v2294: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:54:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:54:06 smithi186 ceph-mon[126480]: pgmap v2294: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:54:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:54:08 smithi133 ceph-mon[125939]: pgmap v2295: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:54:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:54:08 smithi096 ceph-mon[124666]: pgmap v2295: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:54:08.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:54:08 smithi186 ceph-mon[126480]: pgmap v2295: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:54:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:54:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4187.654018 secs 2023-05-08T04:54:09.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:54:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4188.210499 secs 2023-05-08T04:54:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:54:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4187.654018 secs 2023-05-08T04:54:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:54:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4188.210499 secs 2023-05-08T04:54:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:54:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4187.654018 secs 2023-05-08T04:54:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:54:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4188.210499 secs 2023-05-08T04:54:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:54:10 smithi186 ceph-mon[126480]: pgmap v2296: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:54:10.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:54:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4189.491384 secs 2023-05-08T04:54:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:54:10 smithi133 ceph-mon[125939]: pgmap v2296: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:54:10.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:54:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4189.491384 secs 2023-05-08T04:54:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:54:10 smithi096 ceph-mon[124666]: pgmap v2296: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:54:11.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:54:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4189.491384 secs 2023-05-08T04:54:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:54:11 smithi186 ceph-mon[126480]: osdmap e224: 12 total, 12 up, 12 in 2023-05-08T04:54:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:54:11 smithi133 ceph-mon[125939]: osdmap e224: 12 total, 12 up, 12 in 2023-05-08T04:54:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:54:11 smithi096 ceph-mon[124666]: osdmap e224: 12 total, 12 up, 12 in 2023-05-08T04:54:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:54:12 smithi186 ceph-mon[126480]: pgmap v2298: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:54:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:54:12 smithi133 ceph-mon[125939]: pgmap v2298: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:54:13.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:54:12 smithi096 ceph-mon[124666]: pgmap v2298: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:54:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:54:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4192.654150 secs 2023-05-08T04:54:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:54:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4192.654150 secs 2023-05-08T04:54:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:54:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4192.654150 secs 2023-05-08T04:54:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:54:14 smithi186 ceph-mon[126480]: pgmap v2299: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:54:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:54:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4193.210635 secs 2023-05-08T04:54:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:54:14 smithi133 ceph-mon[125939]: pgmap v2299: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:54:14.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:54:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4193.210635 secs 2023-05-08T04:54:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:54:14 smithi096 ceph-mon[124666]: pgmap v2299: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:54:15.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:54:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4193.210635 secs 2023-05-08T04:54:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:54:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4194.491517 secs 2023-05-08T04:54:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:54:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4194.491517 secs 2023-05-08T04:54:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:54:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4194.491517 secs 2023-05-08T04:54:16.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:54:16 smithi133 ceph-mon[125939]: pgmap v2300: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:54:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:54:16 smithi096 ceph-mon[124666]: pgmap v2300: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:54:17.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:54:16 smithi186 ceph-mon[126480]: pgmap v2300: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:54:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:54:18 smithi133 ceph-mon[125939]: pgmap v2301: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:54:18.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:54:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4197.654254 secs 2023-05-08T04:54:18.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:54:18 smithi133 ceph-mon[125939]: osdmap e225: 12 total, 12 up, 12 in 2023-05-08T04:54:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:54:18 smithi096 ceph-mon[124666]: pgmap v2301: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:54:19.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:54:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4197.654254 secs 2023-05-08T04:54:19.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:54:18 smithi096 ceph-mon[124666]: osdmap e225: 12 total, 12 up, 12 in 2023-05-08T04:54:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:54:18 smithi186 ceph-mon[126480]: pgmap v2301: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:54:19.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:54:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4197.654254 secs 2023-05-08T04:54:19.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:54:18 smithi186 ceph-mon[126480]: osdmap e225: 12 total, 12 up, 12 in 2023-05-08T04:54:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:54:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4198.210743 secs 2023-05-08T04:54:20.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:54:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4198.210743 secs 2023-05-08T04:54:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:54:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4198.210743 secs 2023-05-08T04:54:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:54:20 smithi133 ceph-mon[125939]: pgmap v2303: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 235 B/s wr, 7 op/s 2023-05-08T04:54:20.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:54:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4199.491629 secs 2023-05-08T04:54:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:54:20 smithi096 ceph-mon[124666]: pgmap v2303: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 235 B/s wr, 7 op/s 2023-05-08T04:54:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:54:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4199.491629 secs 2023-05-08T04:54:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:54:20 smithi186 ceph-mon[126480]: pgmap v2303: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 235 B/s wr, 7 op/s 2023-05-08T04:54:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:54:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4199.491629 secs 2023-05-08T04:54:22.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:54:22 smithi133 ceph-mon[125939]: pgmap v2304: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:54:23.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:54:22 smithi096 ceph-mon[124666]: pgmap v2304: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:54:23.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:54:22 smithi186 ceph-mon[126480]: pgmap v2304: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:54:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:54:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4202.654356 secs 2023-05-08T04:54:24.015 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:54:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4202.654356 secs 2023-05-08T04:54:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:54:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4202.654356 secs 2023-05-08T04:54:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:54:24 smithi133 ceph-mon[125939]: pgmap v2305: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:54:24.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:54:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4203.210860 secs 2023-05-08T04:54:25.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:54:24 smithi096 ceph-mon[124666]: pgmap v2305: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:54:25.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:54:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4203.210860 secs 2023-05-08T04:54:25.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:54:24 smithi186 ceph-mon[126480]: pgmap v2305: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:54:25.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:54:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4203.210860 secs 2023-05-08T04:54:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:54:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4204.491695 secs 2023-05-08T04:54:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:54:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4204.491695 secs 2023-05-08T04:54:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:54:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4204.491695 secs 2023-05-08T04:54:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:54:26 smithi133 ceph-mon[125939]: pgmap v2306: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:54:27.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:54:26 smithi096 ceph-mon[124666]: pgmap v2306: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:54:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:54:26 smithi186 ceph-mon[126480]: pgmap v2306: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:54:28.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:54:28 smithi133 ceph-mon[125939]: pgmap v2307: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:54:28.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:54:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4207.654469 secs 2023-05-08T04:54:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:54:28 smithi096 ceph-mon[124666]: pgmap v2307: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:54:29.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:54:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4207.654469 secs 2023-05-08T04:54:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:54:28 smithi186 ceph-mon[126480]: pgmap v2307: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:54:29.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:54:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4207.654469 secs 2023-05-08T04:54:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:54:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4208.211007 secs 2023-05-08T04:54:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:54:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4208.211007 secs 2023-05-08T04:54:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:54:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4208.211007 secs 2023-05-08T04:54:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:54:30 smithi133 ceph-mon[125939]: pgmap v2308: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 95 B/s wr, 8 op/s 2023-05-08T04:54:30.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:54:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4209.491817 secs 2023-05-08T04:54:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:54:30 smithi096 ceph-mon[124666]: pgmap v2308: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 95 B/s wr, 8 op/s 2023-05-08T04:54:31.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:54:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4209.491817 secs 2023-05-08T04:54:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:54:30 smithi186 ceph-mon[126480]: pgmap v2308: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 95 B/s wr, 8 op/s 2023-05-08T04:54:31.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:54:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4209.491817 secs 2023-05-08T04:54:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:54:32 smithi133 ceph-mon[125939]: pgmap v2309: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:54:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:54:32 smithi096 ceph-mon[124666]: pgmap v2309: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:54:33.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:54:32 smithi186 ceph-mon[126480]: pgmap v2309: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:54:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:54:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4212.654586 secs 2023-05-08T04:54:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:54:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4212.654586 secs 2023-05-08T04:54:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:54:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4212.654586 secs 2023-05-08T04:54:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:54:34 smithi133 ceph-mon[125939]: pgmap v2310: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:54:34.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:54:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4213.211148 secs 2023-05-08T04:54:35.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:54:34 smithi096 ceph-mon[124666]: pgmap v2310: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:54:35.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:54:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4213.211148 secs 2023-05-08T04:54:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:54:34 smithi186 ceph-mon[126480]: pgmap v2310: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:54:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:54:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4213.211148 secs 2023-05-08T04:54:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:54:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4214.491883 secs 2023-05-08T04:54:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:54:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4214.491883 secs 2023-05-08T04:54:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:54:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4214.491883 secs 2023-05-08T04:54:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:54:36 smithi133 ceph-mon[125939]: pgmap v2311: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 89 KiB/s wr, 9 op/s 2023-05-08T04:54:37.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:54:36 smithi096 ceph-mon[124666]: pgmap v2311: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 89 KiB/s wr, 9 op/s 2023-05-08T04:54:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:54:36 smithi186 ceph-mon[126480]: pgmap v2311: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 89 KiB/s wr, 9 op/s 2023-05-08T04:54:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:54:38 smithi133 ceph-mon[125939]: pgmap v2312: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 89 KiB/s wr, 6 op/s 2023-05-08T04:54:38.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:54:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4217.654720 secs 2023-05-08T04:54:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:54:38 smithi096 ceph-mon[124666]: pgmap v2312: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 89 KiB/s wr, 6 op/s 2023-05-08T04:54:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:54:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4217.654720 secs 2023-05-08T04:54:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:54:38 smithi186 ceph-mon[126480]: pgmap v2312: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 89 KiB/s wr, 6 op/s 2023-05-08T04:54:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:54:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4217.654720 secs 2023-05-08T04:54:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:54:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4218.211246 secs 2023-05-08T04:54:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:54:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4218.211246 secs 2023-05-08T04:54:40.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:54:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4218.211246 secs 2023-05-08T04:54:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:54:40 smithi133 ceph-mon[125939]: pgmap v2313: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 142 KiB/s wr, 10 op/s 2023-05-08T04:54:40.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:54:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4219.491976 secs 2023-05-08T04:54:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:54:40 smithi096 ceph-mon[124666]: pgmap v2313: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 142 KiB/s wr, 10 op/s 2023-05-08T04:54:41.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:54:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4219.491976 secs 2023-05-08T04:54:41.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:54:40 smithi186 ceph-mon[126480]: pgmap v2313: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 142 KiB/s wr, 10 op/s 2023-05-08T04:54:41.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:54:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4219.491976 secs 2023-05-08T04:54:42.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:54:42 smithi133 ceph-mon[125939]: pgmap v2314: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 142 KiB/s wr, 8 op/s 2023-05-08T04:54:43.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:54:42 smithi096 ceph-mon[124666]: pgmap v2314: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 142 KiB/s wr, 8 op/s 2023-05-08T04:54:43.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:54:42 smithi186 ceph-mon[126480]: pgmap v2314: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 142 KiB/s wr, 8 op/s 2023-05-08T04:54:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:54:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4222.654834 secs 2023-05-08T04:54:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:54:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4222.654834 secs 2023-05-08T04:54:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:54:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4222.654834 secs 2023-05-08T04:54:44.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:54:44 smithi133 ceph-mon[125939]: pgmap v2315: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 142 KiB/s wr, 8 op/s 2023-05-08T04:54:44.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:54:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4223.211361 secs 2023-05-08T04:54:45.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:54:44 smithi096 ceph-mon[124666]: pgmap v2315: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 142 KiB/s wr, 8 op/s 2023-05-08T04:54:45.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:54:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4223.211361 secs 2023-05-08T04:54:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:54:44 smithi186 ceph-mon[126480]: pgmap v2315: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 142 KiB/s wr, 8 op/s 2023-05-08T04:54:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:54:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4223.211361 secs 2023-05-08T04:54:45.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:54:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4224.492099 secs 2023-05-08T04:54:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:54:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4224.492099 secs 2023-05-08T04:54:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:54:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4224.492099 secs 2023-05-08T04:54:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:54:46 smithi133 ceph-mon[125939]: pgmap v2316: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 167 KiB/s wr, 12 op/s 2023-05-08T04:54:47.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:54:46 smithi096 ceph-mon[124666]: pgmap v2316: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 167 KiB/s wr, 12 op/s 2023-05-08T04:54:47.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:54:46 smithi186 ceph-mon[126480]: pgmap v2316: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 167 KiB/s wr, 12 op/s 2023-05-08T04:54:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:54:48 smithi133 ceph-mon[125939]: pgmap v2317: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 78 KiB/s wr, 7 op/s 2023-05-08T04:54:48.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:54:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4227.654990 secs 2023-05-08T04:54:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:54:48 smithi096 ceph-mon[124666]: pgmap v2317: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 78 KiB/s wr, 7 op/s 2023-05-08T04:54:49.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:54:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4227.654990 secs 2023-05-08T04:54:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:54:48 smithi186 ceph-mon[126480]: pgmap v2317: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 78 KiB/s wr, 7 op/s 2023-05-08T04:54:49.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:54:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4227.654990 secs 2023-05-08T04:54:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:54:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4228.211494 secs 2023-05-08T04:54:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:54:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4228.211494 secs 2023-05-08T04:54:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:54:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4228.211494 secs 2023-05-08T04:54:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:54:50 smithi133 ceph-mon[125939]: pgmap v2318: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 78 KiB/s wr, 10 op/s 2023-05-08T04:54:50.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:54:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4229.492213 secs 2023-05-08T04:54:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:54:50 smithi096 ceph-mon[124666]: pgmap v2318: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 78 KiB/s wr, 10 op/s 2023-05-08T04:54:51.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:54:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4229.492213 secs 2023-05-08T04:54:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:54:50 smithi186 ceph-mon[126480]: pgmap v2318: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 78 KiB/s wr, 10 op/s 2023-05-08T04:54:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:54:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4229.492213 secs 2023-05-08T04:54:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:54:52 smithi133 ceph-mon[125939]: pgmap v2319: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 7 op/s 2023-05-08T04:54:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:54:52 smithi096 ceph-mon[124666]: pgmap v2319: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 7 op/s 2023-05-08T04:54:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:54:52 smithi186 ceph-mon[126480]: pgmap v2319: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 7 op/s 2023-05-08T04:54:53.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:54:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4232.655108 secs 2023-05-08T04:54:53.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:54:53 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:54:53.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:54:53 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:54:53.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:54:53 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:54:53.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:54:53 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:54:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:54:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4232.655108 secs 2023-05-08T04:54:54.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:54:53 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:54:54.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:54:53 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:54:54.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:54:53 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:54:54.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:54:53 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:54:54.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:54:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4232.655108 secs 2023-05-08T04:54:54.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:54:53 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:54:54.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:54:53 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:54:54.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:54:53 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:54:54.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:54:53 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:54:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:54:54 smithi133 ceph-mon[125939]: pgmap v2320: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 7 op/s 2023-05-08T04:54:54.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:54:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4233.211563 secs 2023-05-08T04:54:54.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:54:54 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:54:54.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:54:54 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T04:54:54.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:54:54 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T04:54:54.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:54:54 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:54:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:54:54 smithi096 ceph-mon[124666]: pgmap v2320: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 7 op/s 2023-05-08T04:54:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:54:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4233.211563 secs 2023-05-08T04:54:55.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:54:54 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:54:55.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:54:54 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T04:54:55.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:54:54 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T04:54:55.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:54:54 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:54:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:54:54 smithi186 ceph-mon[126480]: pgmap v2320: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 7 op/s 2023-05-08T04:54:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:54:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4233.211563 secs 2023-05-08T04:54:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:54:54 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:54:55.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:54:54 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T04:54:55.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:54:54 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T04:54:55.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:54:54 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:54:56.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:54:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4234.492332 secs 2023-05-08T04:54:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:54:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4234.492332 secs 2023-05-08T04:54:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:54:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4234.492332 secs 2023-05-08T04:54:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:54:56 smithi096 ceph-mon[124666]: pgmap v2321: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 25 KiB/s wr, 10 op/s 2023-05-08T04:54:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:54:56 smithi186 ceph-mon[126480]: pgmap v2321: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 25 KiB/s wr, 10 op/s 2023-05-08T04:54:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:54:56 smithi133 ceph-mon[125939]: pgmap v2321: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 25 KiB/s wr, 10 op/s 2023-05-08T04:54:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:54:58 smithi096 ceph-mon[124666]: pgmap v2322: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2023-05-08T04:54:59.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:54:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4237.655244 secs 2023-05-08T04:54:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:54:58 smithi186 ceph-mon[126480]: pgmap v2322: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2023-05-08T04:54:59.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:54:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4237.655244 secs 2023-05-08T04:54:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:54:58 smithi133 ceph-mon[125939]: pgmap v2322: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2023-05-08T04:54:59.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:54:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4237.655244 secs 2023-05-08T04:55:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:54:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4238.211679 secs 2023-05-08T04:55:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:54:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4238.211679 secs 2023-05-08T04:55:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:54:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4238.211679 secs 2023-05-08T04:55:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:00 smithi096 ceph-mon[124666]: pgmap v2323: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 8 op/s 2023-05-08T04:55:01.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4239.492429 secs 2023-05-08T04:55:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:00 smithi186 ceph-mon[126480]: pgmap v2323: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 8 op/s 2023-05-08T04:55:01.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4239.492429 secs 2023-05-08T04:55:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:00 smithi133 ceph-mon[125939]: pgmap v2323: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 8 op/s 2023-05-08T04:55:01.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4239.492429 secs 2023-05-08T04:55:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:02 smithi186 ceph-mon[126480]: pgmap v2324: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:55:03.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:02 smithi133 ceph-mon[125939]: pgmap v2324: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:55:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:02 smithi096 ceph-mon[124666]: pgmap v2324: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:55:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4242.655366 secs 2023-05-08T04:55:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4242.655366 secs 2023-05-08T04:55:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4242.655366 secs 2023-05-08T04:55:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:04 smithi186 ceph-mon[126480]: pgmap v2325: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:55:05.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4243.211771 secs 2023-05-08T04:55:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:04 smithi133 ceph-mon[125939]: pgmap v2325: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:55:05.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4243.211771 secs 2023-05-08T04:55:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:04 smithi096 ceph-mon[124666]: pgmap v2325: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:55:05.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4243.211771 secs 2023-05-08T04:55:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4244.492575 secs 2023-05-08T04:55:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4244.492575 secs 2023-05-08T04:55:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4244.492575 secs 2023-05-08T04:55:07.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:06 smithi186 ceph-mon[126480]: pgmap v2326: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-05-08T04:55:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:06 smithi133 ceph-mon[125939]: pgmap v2326: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-05-08T04:55:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:06 smithi096 ceph-mon[124666]: pgmap v2326: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-05-08T04:55:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:08 smithi186 ceph-mon[126480]: pgmap v2327: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 20 op/s 2023-05-08T04:55:09.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4247.655406 secs 2023-05-08T04:55:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:08 smithi133 ceph-mon[125939]: pgmap v2327: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 20 op/s 2023-05-08T04:55:09.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4247.655406 secs 2023-05-08T04:55:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:08 smithi096 ceph-mon[124666]: pgmap v2327: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 20 op/s 2023-05-08T04:55:09.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4247.655406 secs 2023-05-08T04:55:10.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4248.211889 secs 2023-05-08T04:55:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4248.211889 secs 2023-05-08T04:55:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4248.211889 secs 2023-05-08T04:55:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:10 smithi186 ceph-mon[126480]: pgmap v2328: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:55:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4249.492665 secs 2023-05-08T04:55:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:10 smithi186 ceph-mon[126480]: osdmap e226: 12 total, 12 up, 12 in 2023-05-08T04:55:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:10 smithi133 ceph-mon[125939]: pgmap v2328: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:55:11.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4249.492665 secs 2023-05-08T04:55:11.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:10 smithi133 ceph-mon[125939]: osdmap e226: 12 total, 12 up, 12 in 2023-05-08T04:55:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:10 smithi096 ceph-mon[124666]: pgmap v2328: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:55:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4249.492665 secs 2023-05-08T04:55:11.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:10 smithi096 ceph-mon[124666]: osdmap e226: 12 total, 12 up, 12 in 2023-05-08T04:55:13.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:12 smithi186 ceph-mon[126480]: pgmap v2330: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:55:13.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:12 smithi133 ceph-mon[125939]: pgmap v2330: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:55:13.314 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:12 smithi096 ceph-mon[124666]: pgmap v2330: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:55:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4252.655516 secs 2023-05-08T04:55:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4252.655516 secs 2023-05-08T04:55:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4252.655516 secs 2023-05-08T04:55:15.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:14 smithi186 ceph-mon[126480]: pgmap v2331: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:55:15.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4253.212006 secs 2023-05-08T04:55:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:14 smithi133 ceph-mon[125939]: pgmap v2331: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:55:15.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4253.212006 secs 2023-05-08T04:55:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:14 smithi096 ceph-mon[124666]: pgmap v2331: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:55:15.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4253.212006 secs 2023-05-08T04:55:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4254.492801 secs 2023-05-08T04:55:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4254.492801 secs 2023-05-08T04:55:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4254.492801 secs 2023-05-08T04:55:17.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:16 smithi186 ceph-mon[126480]: pgmap v2332: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:55:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:16 smithi133 ceph-mon[125939]: pgmap v2332: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:55:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:16 smithi096 ceph-mon[124666]: pgmap v2332: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:55:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:18 smithi186 ceph-mon[126480]: pgmap v2333: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:55:19.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4257.655626 secs 2023-05-08T04:55:19.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:18 smithi186 ceph-mon[126480]: osdmap e227: 12 total, 12 up, 12 in 2023-05-08T04:55:19.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:18 smithi133 ceph-mon[125939]: pgmap v2333: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:55:19.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4257.655626 secs 2023-05-08T04:55:19.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:18 smithi133 ceph-mon[125939]: osdmap e227: 12 total, 12 up, 12 in 2023-05-08T04:55:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:18 smithi096 ceph-mon[124666]: pgmap v2333: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:55:19.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4257.655626 secs 2023-05-08T04:55:19.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:18 smithi096 ceph-mon[124666]: osdmap e227: 12 total, 12 up, 12 in 2023-05-08T04:55:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4258.212126 secs 2023-05-08T04:55:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4258.212126 secs 2023-05-08T04:55:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4258.212126 secs 2023-05-08T04:55:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:20 smithi186 ceph-mon[126480]: pgmap v2335: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 215 B/s wr, 7 op/s 2023-05-08T04:55:21.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4259.492911 secs 2023-05-08T04:55:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:20 smithi133 ceph-mon[125939]: pgmap v2335: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 215 B/s wr, 7 op/s 2023-05-08T04:55:21.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4259.492911 secs 2023-05-08T04:55:21.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:20 smithi096 ceph-mon[124666]: pgmap v2335: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 215 B/s wr, 7 op/s 2023-05-08T04:55:21.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4259.492911 secs 2023-05-08T04:55:23.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:22 smithi186 ceph-mon[126480]: pgmap v2336: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:55:23.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:22 smithi133 ceph-mon[125939]: pgmap v2336: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:55:23.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:22 smithi096 ceph-mon[124666]: pgmap v2336: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:55:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4262.655716 secs 2023-05-08T04:55:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4262.655716 secs 2023-05-08T04:55:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4262.655716 secs 2023-05-08T04:55:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:24 smithi186 ceph-mon[126480]: pgmap v2337: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:55:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4263.212192 secs 2023-05-08T04:55:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:24 smithi133 ceph-mon[125939]: pgmap v2337: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:55:25.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4263.212192 secs 2023-05-08T04:55:25.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:24 smithi096 ceph-mon[124666]: pgmap v2337: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:55:25.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4263.212192 secs 2023-05-08T04:55:26.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4264.493031 secs 2023-05-08T04:55:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4264.493031 secs 2023-05-08T04:55:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4264.493031 secs 2023-05-08T04:55:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:26 smithi186 ceph-mon[126480]: pgmap v2338: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:55:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:26 smithi133 ceph-mon[125939]: pgmap v2338: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:55:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:26 smithi096 ceph-mon[124666]: pgmap v2338: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:55:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:28 smithi186 ceph-mon[126480]: pgmap v2339: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:55:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4267.655764 secs 2023-05-08T04:55:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:28 smithi133 ceph-mon[125939]: pgmap v2339: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:55:29.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4267.655764 secs 2023-05-08T04:55:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:28 smithi096 ceph-mon[124666]: pgmap v2339: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:55:29.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4267.655764 secs 2023-05-08T04:55:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4268.212313 secs 2023-05-08T04:55:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4268.212313 secs 2023-05-08T04:55:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4268.212313 secs 2023-05-08T04:55:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:30 smithi186 ceph-mon[126480]: pgmap v2340: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 95 B/s wr, 8 op/s 2023-05-08T04:55:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4269.493150 secs 2023-05-08T04:55:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:30 smithi133 ceph-mon[125939]: pgmap v2340: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 95 B/s wr, 8 op/s 2023-05-08T04:55:31.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4269.493150 secs 2023-05-08T04:55:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:30 smithi096 ceph-mon[124666]: pgmap v2340: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 95 B/s wr, 8 op/s 2023-05-08T04:55:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4269.493150 secs 2023-05-08T04:55:33.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:32 smithi186 ceph-mon[126480]: pgmap v2341: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:55:33.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:32 smithi133 ceph-mon[125939]: pgmap v2341: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:55:33.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:32 smithi096 ceph-mon[124666]: pgmap v2341: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:55:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4272.655881 secs 2023-05-08T04:55:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4272.655881 secs 2023-05-08T04:55:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4272.655881 secs 2023-05-08T04:55:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:34 smithi186 ceph-mon[126480]: pgmap v2342: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:55:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4273.212430 secs 2023-05-08T04:55:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:34 smithi133 ceph-mon[125939]: pgmap v2342: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:55:35.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4273.212430 secs 2023-05-08T04:55:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:34 smithi096 ceph-mon[124666]: pgmap v2342: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:55:35.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4273.212430 secs 2023-05-08T04:55:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:36 smithi186 ceph-mon[126480]: pgmap v2343: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 49 KiB/s wr, 8 op/s 2023-05-08T04:55:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:36 smithi133 ceph-mon[125939]: pgmap v2343: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 49 KiB/s wr, 8 op/s 2023-05-08T04:55:37.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:36 smithi096 ceph-mon[124666]: pgmap v2343: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 49 KiB/s wr, 8 op/s 2023-05-08T04:55:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:37 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:55:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:37 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:55:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:37 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:55:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:38 smithi186 ceph-mon[126480]: pgmap v2344: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 49 KiB/s wr, 6 op/s 2023-05-08T04:55:39.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:38 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:55:39.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:38 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:55:39.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:38 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:55:39.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4277.655917 secs 2023-05-08T04:55:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:38 smithi133 ceph-mon[125939]: pgmap v2344: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 49 KiB/s wr, 6 op/s 2023-05-08T04:55:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:38 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:55:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:38 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:55:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:38 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:55:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4277.655917 secs 2023-05-08T04:55:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:38 smithi096 ceph-mon[124666]: pgmap v2344: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 49 KiB/s wr, 6 op/s 2023-05-08T04:55:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:38 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:55:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:38 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:55:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:38 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:55:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4277.655917 secs 2023-05-08T04:55:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4278.212547 secs 2023-05-08T04:55:40.261 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4278.212547 secs 2023-05-08T04:55:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4278.212547 secs 2023-05-08T04:55:41.244 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:40 smithi133 ceph-mon[125939]: pgmap v2345: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 124 KiB/s wr, 10 op/s 2023-05-08T04:55:41.245 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4279.493406 secs 2023-05-08T04:55:41.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:40 smithi096 ceph-mon[124666]: pgmap v2345: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 124 KiB/s wr, 10 op/s 2023-05-08T04:55:41.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4279.493406 secs 2023-05-08T04:55:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:40 smithi186 ceph-mon[126480]: pgmap v2345: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 124 KiB/s wr, 10 op/s 2023-05-08T04:55:41.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4279.493406 secs 2023-05-08T04:55:43.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:42 smithi133 ceph-mon[125939]: pgmap v2346: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 124 KiB/s wr, 7 op/s 2023-05-08T04:55:43.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:42 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:55:43.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:42 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:55:43.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:42 smithi096 ceph-mon[124666]: pgmap v2346: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 124 KiB/s wr, 7 op/s 2023-05-08T04:55:43.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:42 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:55:43.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:42 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:55:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:42 smithi186 ceph-mon[126480]: pgmap v2346: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 124 KiB/s wr, 7 op/s 2023-05-08T04:55:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:42 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:55:43.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:42 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:55:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4282.655979 secs 2023-05-08T04:55:44.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:43 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:55:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4282.655979 secs 2023-05-08T04:55:44.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:43 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:55:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4282.655979 secs 2023-05-08T04:55:44.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:43 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:55:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:44 smithi133 ceph-mon[125939]: pgmap v2347: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 124 KiB/s wr, 7 op/s 2023-05-08T04:55:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4283.212623 secs 2023-05-08T04:55:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:44 smithi096 ceph-mon[124666]: pgmap v2347: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 124 KiB/s wr, 7 op/s 2023-05-08T04:55:45.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4283.212623 secs 2023-05-08T04:55:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:44 smithi186 ceph-mon[126480]: pgmap v2347: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 124 KiB/s wr, 7 op/s 2023-05-08T04:55:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4283.212623 secs 2023-05-08T04:55:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4284.493524 secs 2023-05-08T04:55:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4284.493524 secs 2023-05-08T04:55:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4284.493524 secs 2023-05-08T04:55:47.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:46 smithi133 ceph-mon[125939]: pgmap v2348: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 145 KiB/s wr, 11 op/s 2023-05-08T04:55:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:46 smithi096 ceph-mon[124666]: pgmap v2348: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 145 KiB/s wr, 11 op/s 2023-05-08T04:55:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:46 smithi186 ceph-mon[126480]: pgmap v2348: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 145 KiB/s wr, 11 op/s 2023-05-08T04:55:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:48 smithi133 ceph-mon[125939]: pgmap v2349: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 96 KiB/s wr, 7 op/s 2023-05-08T04:55:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4287.656069 secs 2023-05-08T04:55:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:48 smithi096 ceph-mon[124666]: pgmap v2349: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 96 KiB/s wr, 7 op/s 2023-05-08T04:55:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4287.656069 secs 2023-05-08T04:55:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:48 smithi186 ceph-mon[126480]: pgmap v2349: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 96 KiB/s wr, 7 op/s 2023-05-08T04:55:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4287.656069 secs 2023-05-08T04:55:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4288.212737 secs 2023-05-08T04:55:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4288.212737 secs 2023-05-08T04:55:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4288.212737 secs 2023-05-08T04:55:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:50 smithi133 ceph-mon[125939]: pgmap v2350: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 96 KiB/s wr, 9 op/s 2023-05-08T04:55:51.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4289.493659 secs 2023-05-08T04:55:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:50 smithi096 ceph-mon[124666]: pgmap v2350: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 96 KiB/s wr, 9 op/s 2023-05-08T04:55:51.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4289.493659 secs 2023-05-08T04:55:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:50 smithi186 ceph-mon[126480]: pgmap v2350: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 96 KiB/s wr, 9 op/s 2023-05-08T04:55:51.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4289.493659 secs 2023-05-08T04:55:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:52 smithi133 ceph-mon[125939]: pgmap v2351: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 5 op/s 2023-05-08T04:55:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:52 smithi096 ceph-mon[124666]: pgmap v2351: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 5 op/s 2023-05-08T04:55:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:52 smithi186 ceph-mon[126480]: pgmap v2351: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 5 op/s 2023-05-08T04:55:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4292.656159 secs 2023-05-08T04:55:54.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:53 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:55:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4292.656159 secs 2023-05-08T04:55:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:53 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:55:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4292.656159 secs 2023-05-08T04:55:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:53 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:55:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:54 smithi133 ceph-mon[125939]: pgmap v2352: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 5 op/s 2023-05-08T04:55:55.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4293.212856 secs 2023-05-08T04:55:55.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:55:55.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:55:55.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:55:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:54 smithi096 ceph-mon[124666]: pgmap v2352: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 5 op/s 2023-05-08T04:55:55.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4293.212856 secs 2023-05-08T04:55:55.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:55:55.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:55:55.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:55:55.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:54 smithi186 ceph-mon[126480]: pgmap v2352: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 5 op/s 2023-05-08T04:55:55.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4293.212856 secs 2023-05-08T04:55:55.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:55:55.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:55:55.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:55:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:55 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:55:56.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:55 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T04:55:56.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:55 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T04:55:56.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:55 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:55:56.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4294.493787 secs 2023-05-08T04:55:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:55 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:55:56.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:55 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T04:55:56.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:55 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T04:55:56.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:55 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:55:56.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4294.493787 secs 2023-05-08T04:55:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:55 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:55:56.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:55 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T04:55:56.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:55 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T04:55:56.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:55 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:55:56.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4294.493787 secs 2023-05-08T04:55:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:56 smithi133 ceph-mon[125939]: pgmap v2353: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 22 KiB/s wr, 8 op/s 2023-05-08T04:55:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:56 smithi096 ceph-mon[124666]: pgmap v2353: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 22 KiB/s wr, 8 op/s 2023-05-08T04:55:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:56 smithi186 ceph-mon[126480]: pgmap v2353: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 22 KiB/s wr, 8 op/s 2023-05-08T04:55:59.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:58 smithi133 ceph-mon[125939]: pgmap v2354: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:55:59.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4297.656276 secs 2023-05-08T04:55:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:58 smithi096 ceph-mon[124666]: pgmap v2354: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:55:59.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4297.656276 secs 2023-05-08T04:55:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:58 smithi186 ceph-mon[126480]: pgmap v2354: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:55:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4297.656276 secs 2023-05-08T04:56:00.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:55:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4298.212998 secs 2023-05-08T04:56:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:55:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4298.212998 secs 2023-05-08T04:56:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:55:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4298.212998 secs 2023-05-08T04:56:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:00 smithi133 ceph-mon[125939]: pgmap v2355: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:56:01.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4299.493882 secs 2023-05-08T04:56:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:00 smithi096 ceph-mon[124666]: pgmap v2355: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:56:01.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4299.493882 secs 2023-05-08T04:56:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:00 smithi186 ceph-mon[126480]: pgmap v2355: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:56:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4299.493882 secs 2023-05-08T04:56:03.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:02 smithi133 ceph-mon[125939]: pgmap v2356: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:56:03.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:02 smithi096 ceph-mon[124666]: pgmap v2356: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:56:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:02 smithi186 ceph-mon[126480]: pgmap v2356: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:56:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4302.656385 secs 2023-05-08T04:56:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4302.656385 secs 2023-05-08T04:56:04.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4302.656385 secs 2023-05-08T04:56:05.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:04 smithi133 ceph-mon[125939]: pgmap v2357: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:56:05.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4303.213122 secs 2023-05-08T04:56:05.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:04 smithi096 ceph-mon[124666]: pgmap v2357: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:56:05.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4303.213122 secs 2023-05-08T04:56:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:04 smithi186 ceph-mon[126480]: pgmap v2357: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:56:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4303.213122 secs 2023-05-08T04:56:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4304.493991 secs 2023-05-08T04:56:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4304.493991 secs 2023-05-08T04:56:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4304.493991 secs 2023-05-08T04:56:07.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:06 smithi133 ceph-mon[125939]: pgmap v2358: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 21 op/s 2023-05-08T04:56:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:06 smithi096 ceph-mon[124666]: pgmap v2358: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 21 op/s 2023-05-08T04:56:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:06 smithi186 ceph-mon[126480]: pgmap v2358: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 21 op/s 2023-05-08T04:56:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:08 smithi133 ceph-mon[125939]: pgmap v2359: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:56:09.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4307.656501 secs 2023-05-08T04:56:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:08 smithi096 ceph-mon[124666]: pgmap v2359: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:56:09.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4307.656501 secs 2023-05-08T04:56:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:08 smithi186 ceph-mon[126480]: pgmap v2359: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:56:09.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4307.656501 secs 2023-05-08T04:56:10.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4308.213262 secs 2023-05-08T04:56:10.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4308.213262 secs 2023-05-08T04:56:10.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4308.213262 secs 2023-05-08T04:56:11.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:10 smithi133 ceph-mon[125939]: pgmap v2360: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:56:11.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4309.494127 secs 2023-05-08T04:56:11.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:10 smithi133 ceph-mon[125939]: osdmap e228: 12 total, 12 up, 12 in 2023-05-08T04:56:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:10 smithi096 ceph-mon[124666]: pgmap v2360: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:56:11.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4309.494127 secs 2023-05-08T04:56:11.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:10 smithi096 ceph-mon[124666]: osdmap e228: 12 total, 12 up, 12 in 2023-05-08T04:56:11.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:10 smithi186 ceph-mon[126480]: pgmap v2360: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:56:11.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4309.494127 secs 2023-05-08T04:56:11.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:10 smithi186 ceph-mon[126480]: osdmap e228: 12 total, 12 up, 12 in 2023-05-08T04:56:13.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:12 smithi133 ceph-mon[125939]: pgmap v2362: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:56:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:12 smithi096 ceph-mon[124666]: pgmap v2362: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:56:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:12 smithi186 ceph-mon[126480]: pgmap v2362: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:56:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4312.656596 secs 2023-05-08T04:56:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4312.656596 secs 2023-05-08T04:56:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4312.656596 secs 2023-05-08T04:56:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:14 smithi133 ceph-mon[125939]: pgmap v2363: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:56:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4313.213357 secs 2023-05-08T04:56:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:14 smithi096 ceph-mon[124666]: pgmap v2363: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:56:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4313.213357 secs 2023-05-08T04:56:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:14 smithi186 ceph-mon[126480]: pgmap v2363: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:56:15.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4313.213357 secs 2023-05-08T04:56:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4314.494247 secs 2023-05-08T04:56:16.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4314.494247 secs 2023-05-08T04:56:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4314.494247 secs 2023-05-08T04:56:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:16 smithi133 ceph-mon[125939]: pgmap v2364: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:56:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:16 smithi096 ceph-mon[124666]: pgmap v2364: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:56:17.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:16 smithi186 ceph-mon[126480]: pgmap v2364: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:56:19.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:18 smithi096 ceph-mon[124666]: pgmap v2365: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:56:19.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4317.656713 secs 2023-05-08T04:56:19.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:18 smithi096 ceph-mon[124666]: osdmap e229: 12 total, 12 up, 12 in 2023-05-08T04:56:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:18 smithi186 ceph-mon[126480]: pgmap v2365: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:56:19.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4317.656713 secs 2023-05-08T04:56:19.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:18 smithi186 ceph-mon[126480]: osdmap e229: 12 total, 12 up, 12 in 2023-05-08T04:56:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:18 smithi133 ceph-mon[125939]: pgmap v2365: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:56:19.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4317.656713 secs 2023-05-08T04:56:19.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:18 smithi133 ceph-mon[125939]: osdmap e229: 12 total, 12 up, 12 in 2023-05-08T04:56:20.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4318.213497 secs 2023-05-08T04:56:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4318.213497 secs 2023-05-08T04:56:20.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4318.213497 secs 2023-05-08T04:56:21.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:20 smithi096 ceph-mon[124666]: pgmap v2367: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 218 B/s wr, 7 op/s 2023-05-08T04:56:21.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4319.494379 secs 2023-05-08T04:56:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:20 smithi186 ceph-mon[126480]: pgmap v2367: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 218 B/s wr, 7 op/s 2023-05-08T04:56:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4319.494379 secs 2023-05-08T04:56:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:20 smithi133 ceph-mon[125939]: pgmap v2367: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 218 B/s wr, 7 op/s 2023-05-08T04:56:21.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4319.494379 secs 2023-05-08T04:56:23.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:23 smithi096 ceph-mon[124666]: pgmap v2368: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:56:23.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:23 smithi186 ceph-mon[126480]: pgmap v2368: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:56:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:23 smithi133 ceph-mon[125939]: pgmap v2368: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:56:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4322.656849 secs 2023-05-08T04:56:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4322.656849 secs 2023-05-08T04:56:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4322.656849 secs 2023-05-08T04:56:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:25 smithi186 ceph-mon[126480]: pgmap v2369: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:56:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4323.213630 secs 2023-05-08T04:56:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:25 smithi133 ceph-mon[125939]: pgmap v2369: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:56:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4323.213630 secs 2023-05-08T04:56:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:25 smithi096 ceph-mon[124666]: pgmap v2369: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:56:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4323.213630 secs 2023-05-08T04:56:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4324.494467 secs 2023-05-08T04:56:26.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4324.494467 secs 2023-05-08T04:56:26.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4324.494467 secs 2023-05-08T04:56:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:27 smithi186 ceph-mon[126480]: pgmap v2370: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:56:27.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:27 smithi133 ceph-mon[125939]: pgmap v2370: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:56:27.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:27 smithi096 ceph-mon[124666]: pgmap v2370: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:56:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:29 smithi186 ceph-mon[126480]: pgmap v2371: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:56:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4327.656965 secs 2023-05-08T04:56:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:29 smithi133 ceph-mon[125939]: pgmap v2371: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:56:29.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4327.656965 secs 2023-05-08T04:56:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:29 smithi096 ceph-mon[124666]: pgmap v2371: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:56:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4327.656965 secs 2023-05-08T04:56:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4328.213696 secs 2023-05-08T04:56:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4328.213696 secs 2023-05-08T04:56:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4328.213696 secs 2023-05-08T04:56:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:31 smithi186 ceph-mon[126480]: pgmap v2372: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 95 B/s wr, 8 op/s 2023-05-08T04:56:31.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4329.494599 secs 2023-05-08T04:56:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:31 smithi133 ceph-mon[125939]: pgmap v2372: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 95 B/s wr, 8 op/s 2023-05-08T04:56:31.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4329.494599 secs 2023-05-08T04:56:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:31 smithi096 ceph-mon[124666]: pgmap v2372: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 95 B/s wr, 8 op/s 2023-05-08T04:56:31.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4329.494599 secs 2023-05-08T04:56:33.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:33 smithi186 ceph-mon[126480]: pgmap v2373: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:56:33.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:33 smithi133 ceph-mon[125939]: pgmap v2373: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:56:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:33 smithi096 ceph-mon[124666]: pgmap v2373: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:56:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4332.657083 secs 2023-05-08T04:56:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4332.657083 secs 2023-05-08T04:56:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4332.657083 secs 2023-05-08T04:56:35.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:35 smithi186 ceph-mon[126480]: pgmap v2374: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:56:35.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4333.213793 secs 2023-05-08T04:56:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:35 smithi133 ceph-mon[125939]: pgmap v2374: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:56:35.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4333.213793 secs 2023-05-08T04:56:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:35 smithi096 ceph-mon[124666]: pgmap v2374: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:56:35.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4333.213793 secs 2023-05-08T04:56:37.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:37 smithi186 ceph-mon[126480]: pgmap v2375: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 49 KiB/s wr, 8 op/s 2023-05-08T04:56:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:37 smithi133 ceph-mon[125939]: pgmap v2375: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 49 KiB/s wr, 8 op/s 2023-05-08T04:56:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:37 smithi096 ceph-mon[124666]: pgmap v2375: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 49 KiB/s wr, 8 op/s 2023-05-08T04:56:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:38 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:56:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:38 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:56:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:38 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:56:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:39 smithi186 ceph-mon[126480]: pgmap v2376: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 49 KiB/s wr, 5 op/s 2023-05-08T04:56:39.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4337.657198 secs 2023-05-08T04:56:39.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:39 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:56:39.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:39 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:56:39.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:39 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:56:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:39 smithi133 ceph-mon[125939]: pgmap v2376: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 49 KiB/s wr, 5 op/s 2023-05-08T04:56:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4337.657198 secs 2023-05-08T04:56:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:39 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:56:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:39 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:56:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:39 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:56:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:39 smithi096 ceph-mon[124666]: pgmap v2376: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 49 KiB/s wr, 5 op/s 2023-05-08T04:56:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4337.657198 secs 2023-05-08T04:56:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:39 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:56:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:39 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:56:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:39 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:56:40.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4338.213892 secs 2023-05-08T04:56:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4338.213892 secs 2023-05-08T04:56:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4338.213892 secs 2023-05-08T04:56:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:41 smithi186 ceph-mon[126480]: pgmap v2377: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 149 KiB/s wr, 10 op/s 2023-05-08T04:56:41.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4339.494817 secs 2023-05-08T04:56:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:41 smithi133 ceph-mon[125939]: pgmap v2377: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 149 KiB/s wr, 10 op/s 2023-05-08T04:56:41.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4339.494817 secs 2023-05-08T04:56:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:41 smithi096 ceph-mon[124666]: pgmap v2377: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 149 KiB/s wr, 10 op/s 2023-05-08T04:56:41.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4339.494817 secs 2023-05-08T04:56:43.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:43 smithi186 ceph-mon[126480]: pgmap v2378: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 149 KiB/s wr, 8 op/s 2023-05-08T04:56:43.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:56:43.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:56:43.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:43 smithi133 ceph-mon[125939]: pgmap v2378: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 149 KiB/s wr, 8 op/s 2023-05-08T04:56:43.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:56:43.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:56:43.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:43 smithi096 ceph-mon[124666]: pgmap v2378: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 149 KiB/s wr, 8 op/s 2023-05-08T04:56:43.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:56:43.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:56:44.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4342.657315 secs 2023-05-08T04:56:44.373 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:44 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:56:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4342.657315 secs 2023-05-08T04:56:44.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:44 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:56:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4342.657315 secs 2023-05-08T04:56:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:44 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:56:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:45 smithi186 ceph-mon[126480]: pgmap v2379: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 149 KiB/s wr, 8 op/s 2023-05-08T04:56:45.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4343.214029 secs 2023-05-08T04:56:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:45 smithi133 ceph-mon[125939]: pgmap v2379: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 149 KiB/s wr, 8 op/s 2023-05-08T04:56:45.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4343.214029 secs 2023-05-08T04:56:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:45 smithi096 ceph-mon[124666]: pgmap v2379: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 149 KiB/s wr, 8 op/s 2023-05-08T04:56:45.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4343.214029 secs 2023-05-08T04:56:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4344.494933 secs 2023-05-08T04:56:46.495 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4344.494933 secs 2023-05-08T04:56:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4344.494933 secs 2023-05-08T04:56:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:47 smithi186 ceph-mon[126480]: pgmap v2380: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 172 KiB/s wr, 12 op/s 2023-05-08T04:56:47.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:47 smithi133 ceph-mon[125939]: pgmap v2380: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 172 KiB/s wr, 12 op/s 2023-05-08T04:56:47.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:47 smithi096 ceph-mon[124666]: pgmap v2380: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 172 KiB/s wr, 12 op/s 2023-05-08T04:56:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:49 smithi186 ceph-mon[126480]: pgmap v2381: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 123 KiB/s wr, 8 op/s 2023-05-08T04:56:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4347.657432 secs 2023-05-08T04:56:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:49 smithi133 ceph-mon[125939]: pgmap v2381: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 123 KiB/s wr, 8 op/s 2023-05-08T04:56:49.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4347.657432 secs 2023-05-08T04:56:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:49 smithi096 ceph-mon[124666]: pgmap v2381: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 123 KiB/s wr, 8 op/s 2023-05-08T04:56:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4347.657432 secs 2023-05-08T04:56:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4348.214166 secs 2023-05-08T04:56:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4348.214166 secs 2023-05-08T04:56:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4348.214166 secs 2023-05-08T04:56:51.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:51 smithi186 ceph-mon[126480]: pgmap v2382: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 123 KiB/s wr, 12 op/s 2023-05-08T04:56:51.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4349.495022 secs 2023-05-08T04:56:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:51 smithi133 ceph-mon[125939]: pgmap v2382: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 123 KiB/s wr, 12 op/s 2023-05-08T04:56:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4349.495022 secs 2023-05-08T04:56:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:51 smithi096 ceph-mon[124666]: pgmap v2382: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 123 KiB/s wr, 12 op/s 2023-05-08T04:56:51.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4349.495022 secs 2023-05-08T04:56:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:53 smithi186 ceph-mon[126480]: pgmap v2383: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 6 op/s 2023-05-08T04:56:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:53 smithi133 ceph-mon[125939]: pgmap v2383: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 6 op/s 2023-05-08T04:56:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:53 smithi096 ceph-mon[124666]: pgmap v2383: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 6 op/s 2023-05-08T04:56:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4352.657566 secs 2023-05-08T04:56:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4353.214310 secs 2023-05-08T04:56:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4352.657566 secs 2023-05-08T04:56:54.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4353.214310 secs 2023-05-08T04:56:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4352.657566 secs 2023-05-08T04:56:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4353.214310 secs 2023-05-08T04:56:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:55 smithi186 ceph-mon[126480]: pgmap v2384: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 6 op/s 2023-05-08T04:56:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:55 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:56:55.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:55 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:56:55.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:55 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:56:55.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:55 smithi133 ceph-mon[125939]: pgmap v2384: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 6 op/s 2023-05-08T04:56:55.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:55 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:56:55.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:55 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:56:55.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:55 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:56:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:55 smithi096 ceph-mon[124666]: pgmap v2384: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 6 op/s 2023-05-08T04:56:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:55 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:56:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:55 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:56:55.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:55 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:56:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4354.495097 secs 2023-05-08T04:56:56.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:56:56.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:56:56.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:56:56.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:56:56.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:56:56.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:56:56.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:56:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4354.495097 secs 2023-05-08T04:56:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:56:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:56:56.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:56:56.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:56:56.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:56:56.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:56:56.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:56:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4354.495097 secs 2023-05-08T04:56:56.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:56:56.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:56:56.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:56:56.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:56:56.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:56:56.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:56:56.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:56:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:57 smithi133 ceph-mon[125939]: pgmap v2385: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 23 KiB/s wr, 9 op/s 2023-05-08T04:56:57.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:57 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:56:57.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:57 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T04:56:57.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:57 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T04:56:57.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:57 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:56:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:57 smithi096 ceph-mon[124666]: pgmap v2385: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 23 KiB/s wr, 9 op/s 2023-05-08T04:56:57.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:57 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:56:57.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:57 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T04:56:57.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:57 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T04:56:57.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:57 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:56:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:57 smithi186 ceph-mon[126480]: pgmap v2385: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 23 KiB/s wr, 9 op/s 2023-05-08T04:56:57.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:57 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:56:57.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:57 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T04:56:57.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:57 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T04:56:57.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:57 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:56:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:59 smithi133 ceph-mon[125939]: pgmap v2386: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T04:56:59.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4357.657655 secs 2023-05-08T04:56:59.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:56:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4358.214431 secs 2023-05-08T04:56:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:59 smithi096 ceph-mon[124666]: pgmap v2386: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T04:56:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4357.657655 secs 2023-05-08T04:56:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:56:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4358.214431 secs 2023-05-08T04:56:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:59 smithi186 ceph-mon[126480]: pgmap v2386: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T04:56:59.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4357.657655 secs 2023-05-08T04:56:59.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:56:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4358.214431 secs 2023-05-08T04:57:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:01 smithi133 ceph-mon[125939]: pgmap v2387: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 8 op/s 2023-05-08T04:57:01.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4359.495174 secs 2023-05-08T04:57:01.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:01 smithi096 ceph-mon[124666]: pgmap v2387: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 8 op/s 2023-05-08T04:57:01.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4359.495174 secs 2023-05-08T04:57:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:01 smithi186 ceph-mon[126480]: pgmap v2387: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 8 op/s 2023-05-08T04:57:01.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4359.495174 secs 2023-05-08T04:57:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:03 smithi133 ceph-mon[125939]: pgmap v2388: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:57:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:03 smithi096 ceph-mon[124666]: pgmap v2388: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:57:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:03 smithi186 ceph-mon[126480]: pgmap v2388: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:57:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4362.657786 secs 2023-05-08T04:57:04.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4363.214567 secs 2023-05-08T04:57:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4362.657786 secs 2023-05-08T04:57:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4363.214567 secs 2023-05-08T04:57:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4362.657786 secs 2023-05-08T04:57:04.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4363.214567 secs 2023-05-08T04:57:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:05 smithi133 ceph-mon[125939]: pgmap v2389: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:57:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:05 smithi096 ceph-mon[124666]: pgmap v2389: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:57:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:05 smithi186 ceph-mon[126480]: pgmap v2389: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:57:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4364.495324 secs 2023-05-08T04:57:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4364.495324 secs 2023-05-08T04:57:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4364.495324 secs 2023-05-08T04:57:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:07 smithi133 ceph-mon[125939]: pgmap v2390: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-05-08T04:57:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:07 smithi096 ceph-mon[124666]: pgmap v2390: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-05-08T04:57:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:07 smithi186 ceph-mon[126480]: pgmap v2390: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-05-08T04:57:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:09 smithi133 ceph-mon[125939]: pgmap v2391: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 20 op/s 2023-05-08T04:57:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4367.657903 secs 2023-05-08T04:57:09.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4368.214688 secs 2023-05-08T04:57:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:09 smithi096 ceph-mon[124666]: pgmap v2391: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 20 op/s 2023-05-08T04:57:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4367.657903 secs 2023-05-08T04:57:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4368.214688 secs 2023-05-08T04:57:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:09 smithi186 ceph-mon[126480]: pgmap v2391: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 20 op/s 2023-05-08T04:57:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4367.657903 secs 2023-05-08T04:57:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4368.214688 secs 2023-05-08T04:57:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:11 smithi133 ceph-mon[125939]: pgmap v2392: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:57:11.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4369.495438 secs 2023-05-08T04:57:11.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:11 smithi133 ceph-mon[125939]: osdmap e230: 12 total, 12 up, 12 in 2023-05-08T04:57:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:11 smithi096 ceph-mon[124666]: pgmap v2392: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:57:11.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4369.495438 secs 2023-05-08T04:57:11.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:11 smithi096 ceph-mon[124666]: osdmap e230: 12 total, 12 up, 12 in 2023-05-08T04:57:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:11 smithi186 ceph-mon[126480]: pgmap v2392: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:57:11.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4369.495438 secs 2023-05-08T04:57:11.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:11 smithi186 ceph-mon[126480]: osdmap e230: 12 total, 12 up, 12 in 2023-05-08T04:57:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:13 smithi133 ceph-mon[125939]: pgmap v2394: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T04:57:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:13 smithi096 ceph-mon[124666]: pgmap v2394: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T04:57:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:13 smithi186 ceph-mon[126480]: pgmap v2394: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T04:57:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4372.658041 secs 2023-05-08T04:57:14.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4373.214767 secs 2023-05-08T04:57:14.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4372.658041 secs 2023-05-08T04:57:14.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4373.214767 secs 2023-05-08T04:57:14.628 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4372.658041 secs 2023-05-08T04:57:14.629 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4373.214767 secs 2023-05-08T04:57:15.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:15 smithi133 ceph-mon[125939]: pgmap v2395: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T04:57:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:15 smithi096 ceph-mon[124666]: pgmap v2395: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T04:57:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:15 smithi186 ceph-mon[126480]: pgmap v2395: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-05-08T04:57:16.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4374.495506 secs 2023-05-08T04:57:16.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4374.495506 secs 2023-05-08T04:57:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4374.495506 secs 2023-05-08T04:57:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:17 smithi133 ceph-mon[125939]: pgmap v2396: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:57:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:17 smithi096 ceph-mon[124666]: pgmap v2396: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:57:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:17 smithi186 ceph-mon[126480]: pgmap v2396: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:57:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:19 smithi133 ceph-mon[125939]: pgmap v2397: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:57:19.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4377.658161 secs 2023-05-08T04:57:19.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4378.214887 secs 2023-05-08T04:57:19.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:19 smithi133 ceph-mon[125939]: osdmap e231: 12 total, 12 up, 12 in 2023-05-08T04:57:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:19 smithi096 ceph-mon[124666]: pgmap v2397: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:57:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4377.658161 secs 2023-05-08T04:57:19.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4378.214887 secs 2023-05-08T04:57:19.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:19 smithi096 ceph-mon[124666]: osdmap e231: 12 total, 12 up, 12 in 2023-05-08T04:57:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:19 smithi186 ceph-mon[126480]: pgmap v2397: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:57:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4377.658161 secs 2023-05-08T04:57:19.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4378.214887 secs 2023-05-08T04:57:19.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:19 smithi186 ceph-mon[126480]: osdmap e231: 12 total, 12 up, 12 in 2023-05-08T04:57:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:21 smithi133 ceph-mon[125939]: pgmap v2399: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 223 B/s wr, 7 op/s 2023-05-08T04:57:21.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4379.495649 secs 2023-05-08T04:57:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:21 smithi096 ceph-mon[124666]: pgmap v2399: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 223 B/s wr, 7 op/s 2023-05-08T04:57:21.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4379.495649 secs 2023-05-08T04:57:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:21 smithi186 ceph-mon[126480]: pgmap v2399: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 223 B/s wr, 7 op/s 2023-05-08T04:57:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4379.495649 secs 2023-05-08T04:57:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:23 smithi133 ceph-mon[125939]: pgmap v2400: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:57:23.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:23 smithi096 ceph-mon[124666]: pgmap v2400: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:57:23.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:23 smithi186 ceph-mon[126480]: pgmap v2400: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:57:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4382.658287 secs 2023-05-08T04:57:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4383.214963 secs 2023-05-08T04:57:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4382.658287 secs 2023-05-08T04:57:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4383.214963 secs 2023-05-08T04:57:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4382.658287 secs 2023-05-08T04:57:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4383.214963 secs 2023-05-08T04:57:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:25 smithi133 ceph-mon[125939]: pgmap v2401: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:57:25.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:25 smithi096 ceph-mon[124666]: pgmap v2401: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:57:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:25 smithi186 ceph-mon[126480]: pgmap v2401: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:57:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4384.495767 secs 2023-05-08T04:57:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:26 smithi133 ceph-mon[125939]: pgmap v2402: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:57:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4384.495767 secs 2023-05-08T04:57:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:26 smithi096 ceph-mon[124666]: pgmap v2402: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:57:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4384.495767 secs 2023-05-08T04:57:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:26 smithi186 ceph-mon[126480]: pgmap v2402: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:57:28.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:28 smithi133 ceph-mon[125939]: pgmap v2403: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:57:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:28 smithi096 ceph-mon[124666]: pgmap v2403: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:57:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:28 smithi186 ceph-mon[126480]: pgmap v2403: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:57:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4387.658402 secs 2023-05-08T04:57:29.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4388.215054 secs 2023-05-08T04:57:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4387.658402 secs 2023-05-08T04:57:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4388.215054 secs 2023-05-08T04:57:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4387.658402 secs 2023-05-08T04:57:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4388.215054 secs 2023-05-08T04:57:30.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:30 smithi133 ceph-mon[125939]: pgmap v2404: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 95 B/s wr, 8 op/s 2023-05-08T04:57:30.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4389.495876 secs 2023-05-08T04:57:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:30 smithi096 ceph-mon[124666]: pgmap v2404: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 95 B/s wr, 8 op/s 2023-05-08T04:57:31.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4389.495876 secs 2023-05-08T04:57:31.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:30 smithi186 ceph-mon[126480]: pgmap v2404: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 95 B/s wr, 8 op/s 2023-05-08T04:57:31.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4389.495876 secs 2023-05-08T04:57:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:32 smithi133 ceph-mon[125939]: pgmap v2405: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:57:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:32 smithi096 ceph-mon[124666]: pgmap v2405: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:57:33.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:32 smithi186 ceph-mon[126480]: pgmap v2405: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:57:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4392.658524 secs 2023-05-08T04:57:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4392.658524 secs 2023-05-08T04:57:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4392.658524 secs 2023-05-08T04:57:34.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:34 smithi133 ceph-mon[125939]: pgmap v2406: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:57:34.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4393.215190 secs 2023-05-08T04:57:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:34 smithi096 ceph-mon[124666]: pgmap v2406: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:57:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4393.215190 secs 2023-05-08T04:57:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:34 smithi186 ceph-mon[126480]: pgmap v2406: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:57:35.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4393.215190 secs 2023-05-08T04:57:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:36 smithi133 ceph-mon[125939]: pgmap v2407: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 51 KiB/s wr, 8 op/s 2023-05-08T04:57:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:36 smithi096 ceph-mon[124666]: pgmap v2407: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 51 KiB/s wr, 8 op/s 2023-05-08T04:57:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:36 smithi186 ceph-mon[126480]: pgmap v2407: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 51 KiB/s wr, 8 op/s 2023-05-08T04:57:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:38 smithi133 ceph-mon[125939]: pgmap v2408: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 51 KiB/s wr, 5 op/s 2023-05-08T04:57:38.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:38 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:57:38.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4397.658631 secs 2023-05-08T04:57:39.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:38 smithi096 ceph-mon[124666]: pgmap v2408: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 51 KiB/s wr, 5 op/s 2023-05-08T04:57:39.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:38 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:57:39.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4397.658631 secs 2023-05-08T04:57:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:38 smithi186 ceph-mon[126480]: pgmap v2408: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 51 KiB/s wr, 5 op/s 2023-05-08T04:57:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:38 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:57:39.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4397.658631 secs 2023-05-08T04:57:39.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4398.215311 secs 2023-05-08T04:57:39.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:39 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:57:39.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:39 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:57:39.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:39 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:57:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4398.215311 secs 2023-05-08T04:57:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:39 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:57:40.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:39 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:57:40.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:39 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:57:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4398.215311 secs 2023-05-08T04:57:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:39 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:57:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:39 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:57:40.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:39 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:57:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:40 smithi133 ceph-mon[125939]: pgmap v2409: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 127 KiB/s wr, 10 op/s 2023-05-08T04:57:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4399.496068 secs 2023-05-08T04:57:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:40 smithi096 ceph-mon[124666]: pgmap v2409: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 127 KiB/s wr, 10 op/s 2023-05-08T04:57:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4399.496068 secs 2023-05-08T04:57:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:40 smithi186 ceph-mon[126480]: pgmap v2409: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 127 KiB/s wr, 10 op/s 2023-05-08T04:57:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4399.496068 secs 2023-05-08T04:57:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:42 smithi133 ceph-mon[125939]: pgmap v2410: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 127 KiB/s wr, 7 op/s 2023-05-08T04:57:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:42 smithi096 ceph-mon[124666]: pgmap v2410: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 127 KiB/s wr, 7 op/s 2023-05-08T04:57:43.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:42 smithi186 ceph-mon[126480]: pgmap v2410: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 127 KiB/s wr, 7 op/s 2023-05-08T04:57:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:57:43.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:57:43.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4402.658730 secs 2023-05-08T04:57:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:57:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:57:44.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4402.658730 secs 2023-05-08T04:57:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:57:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:57:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4402.658730 secs 2023-05-08T04:57:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:44 smithi133 ceph-mon[125939]: pgmap v2411: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 127 KiB/s wr, 7 op/s 2023-05-08T04:57:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4403.215406 secs 2023-05-08T04:57:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:44 smithi096 ceph-mon[124666]: pgmap v2411: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 127 KiB/s wr, 7 op/s 2023-05-08T04:57:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4403.215406 secs 2023-05-08T04:57:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:44 smithi186 ceph-mon[126480]: pgmap v2411: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 127 KiB/s wr, 7 op/s 2023-05-08T04:57:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4403.215406 secs 2023-05-08T04:57:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4404.496195 secs 2023-05-08T04:57:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4404.496195 secs 2023-05-08T04:57:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4404.496195 secs 2023-05-08T04:57:46.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:46 smithi133 ceph-mon[125939]: pgmap v2412: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 149 KiB/s wr, 10 op/s 2023-05-08T04:57:47.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:46 smithi096 ceph-mon[124666]: pgmap v2412: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 149 KiB/s wr, 10 op/s 2023-05-08T04:57:47.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:46 smithi186 ceph-mon[126480]: pgmap v2412: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 149 KiB/s wr, 10 op/s 2023-05-08T04:57:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:48 smithi133 ceph-mon[125939]: pgmap v2413: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 99 KiB/s wr, 7 op/s 2023-05-08T04:57:48.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4407.658824 secs 2023-05-08T04:57:48.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:48 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:57:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:48 smithi096 ceph-mon[124666]: pgmap v2413: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 99 KiB/s wr, 7 op/s 2023-05-08T04:57:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4407.658824 secs 2023-05-08T04:57:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:48 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:57:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:48 smithi186 ceph-mon[126480]: pgmap v2413: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 99 KiB/s wr, 7 op/s 2023-05-08T04:57:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4407.658824 secs 2023-05-08T04:57:49.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:48 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:57:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4408.215559 secs 2023-05-08T04:57:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4408.215559 secs 2023-05-08T04:57:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4408.215559 secs 2023-05-08T04:57:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:50 smithi133 ceph-mon[125939]: pgmap v2414: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 99 KiB/s wr, 10 op/s 2023-05-08T04:57:50.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4409.496333 secs 2023-05-08T04:57:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:50 smithi096 ceph-mon[124666]: pgmap v2414: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 99 KiB/s wr, 10 op/s 2023-05-08T04:57:51.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4409.496333 secs 2023-05-08T04:57:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:50 smithi186 ceph-mon[126480]: pgmap v2414: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 99 KiB/s wr, 10 op/s 2023-05-08T04:57:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4409.496333 secs 2023-05-08T04:57:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:52 smithi133 ceph-mon[125939]: pgmap v2415: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 22 KiB/s wr, 5 op/s 2023-05-08T04:57:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:52 smithi096 ceph-mon[124666]: pgmap v2415: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 22 KiB/s wr, 5 op/s 2023-05-08T04:57:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:52 smithi186 ceph-mon[126480]: pgmap v2415: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 22 KiB/s wr, 5 op/s 2023-05-08T04:57:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4412.658947 secs 2023-05-08T04:57:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4412.658947 secs 2023-05-08T04:57:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4412.658947 secs 2023-05-08T04:57:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:54 smithi133 ceph-mon[125939]: pgmap v2416: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 22 KiB/s wr, 5 op/s 2023-05-08T04:57:54.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4413.215696 secs 2023-05-08T04:57:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:54 smithi096 ceph-mon[124666]: pgmap v2416: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 22 KiB/s wr, 5 op/s 2023-05-08T04:57:55.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4413.215696 secs 2023-05-08T04:57:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:54 smithi186 ceph-mon[126480]: pgmap v2416: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 22 KiB/s wr, 5 op/s 2023-05-08T04:57:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4413.215696 secs 2023-05-08T04:57:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4414.496459 secs 2023-05-08T04:57:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4414.496459 secs 2023-05-08T04:57:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4414.496459 secs 2023-05-08T04:57:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:56 smithi133 ceph-mon[125939]: pgmap v2417: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 22 KiB/s wr, 8 op/s 2023-05-08T04:57:56.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:57:56.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:57:56.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:57:56.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:57:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:56 smithi096 ceph-mon[124666]: pgmap v2417: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 22 KiB/s wr, 8 op/s 2023-05-08T04:57:57.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:57:57.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:57:57.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:57:57.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:57:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:56 smithi186 ceph-mon[126480]: pgmap v2417: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 22 KiB/s wr, 8 op/s 2023-05-08T04:57:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:57:57.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:57:57.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:57:57.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:57:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:57 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:57:57.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:57 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T04:57:57.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:57 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T04:57:57.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:57 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:57:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:57 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:57:58.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:57 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T04:57:58.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:57 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T04:57:58.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:57 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:57:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:57 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:57:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:57 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T04:57:58.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:57 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T04:57:58.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:57 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:57:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:58 smithi133 ceph-mon[125939]: pgmap v2418: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:57:58.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4417.659102 secs 2023-05-08T04:57:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:58 smithi096 ceph-mon[124666]: pgmap v2418: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:57:59.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4417.659102 secs 2023-05-08T04:57:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:58 smithi186 ceph-mon[126480]: pgmap v2418: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:57:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4417.659102 secs 2023-05-08T04:58:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:57:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4418.215794 secs 2023-05-08T04:58:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:57:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4418.215794 secs 2023-05-08T04:58:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:57:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4418.215794 secs 2023-05-08T04:58:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:00 smithi096 ceph-mon[124666]: pgmap v2419: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:58:01.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4419.496576 secs 2023-05-08T04:58:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:00 smithi186 ceph-mon[126480]: pgmap v2419: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:58:01.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4419.496576 secs 2023-05-08T04:58:01.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:00 smithi133 ceph-mon[125939]: pgmap v2419: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:58:01.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4419.496576 secs 2023-05-08T04:58:03.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:02 smithi096 ceph-mon[124666]: pgmap v2420: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:58:03.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:02 smithi186 ceph-mon[126480]: pgmap v2420: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:58:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:02 smithi133 ceph-mon[125939]: pgmap v2420: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:58:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4422.659238 secs 2023-05-08T04:58:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4422.659238 secs 2023-05-08T04:58:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4422.659238 secs 2023-05-08T04:58:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:04 smithi096 ceph-mon[124666]: pgmap v2421: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:58:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4423.215914 secs 2023-05-08T04:58:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:04 smithi186 ceph-mon[126480]: pgmap v2421: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:58:05.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4423.215914 secs 2023-05-08T04:58:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:04 smithi133 ceph-mon[125939]: pgmap v2421: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:58:05.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4423.215914 secs 2023-05-08T04:58:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4424.496691 secs 2023-05-08T04:58:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4424.496691 secs 2023-05-08T04:58:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4424.496691 secs 2023-05-08T04:58:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:06 smithi186 ceph-mon[126480]: pgmap v2422: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:58:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:06 smithi133 ceph-mon[125939]: pgmap v2422: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:58:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:06 smithi096 ceph-mon[124666]: pgmap v2422: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:58:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:08 smithi186 ceph-mon[126480]: pgmap v2423: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:58:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4427.659377 secs 2023-05-08T04:58:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:08 smithi133 ceph-mon[125939]: pgmap v2423: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:58:09.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4427.659377 secs 2023-05-08T04:58:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:08 smithi096 ceph-mon[124666]: pgmap v2423: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-05-08T04:58:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4427.659377 secs 2023-05-08T04:58:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4428.216037 secs 2023-05-08T04:58:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4428.216037 secs 2023-05-08T04:58:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4428.216037 secs 2023-05-08T04:58:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:10 smithi186 ceph-mon[126480]: pgmap v2424: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:58:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4429.496830 secs 2023-05-08T04:58:11.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:10 smithi186 ceph-mon[126480]: osdmap e232: 12 total, 12 up, 12 in 2023-05-08T04:58:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:10 smithi133 ceph-mon[125939]: pgmap v2424: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:58:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4429.496830 secs 2023-05-08T04:58:11.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:10 smithi133 ceph-mon[125939]: osdmap e232: 12 total, 12 up, 12 in 2023-05-08T04:58:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:10 smithi096 ceph-mon[124666]: pgmap v2424: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-05-08T04:58:11.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4429.496830 secs 2023-05-08T04:58:11.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:10 smithi096 ceph-mon[124666]: osdmap e232: 12 total, 12 up, 12 in 2023-05-08T04:58:13.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:12 smithi186 ceph-mon[126480]: pgmap v2426: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:58:13.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:12 smithi133 ceph-mon[125939]: pgmap v2426: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:58:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:12 smithi096 ceph-mon[124666]: pgmap v2426: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:58:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4432.659493 secs 2023-05-08T04:58:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4432.659493 secs 2023-05-08T04:58:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4432.659493 secs 2023-05-08T04:58:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:14 smithi186 ceph-mon[126480]: pgmap v2427: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:58:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4433.216133 secs 2023-05-08T04:58:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:14 smithi133 ceph-mon[125939]: pgmap v2427: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:58:15.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4433.216133 secs 2023-05-08T04:58:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:14 smithi096 ceph-mon[124666]: pgmap v2427: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-05-08T04:58:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4433.216133 secs 2023-05-08T04:58:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4434.496869 secs 2023-05-08T04:58:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4434.496869 secs 2023-05-08T04:58:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4434.496869 secs 2023-05-08T04:58:17.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:16 smithi186 ceph-mon[126480]: pgmap v2428: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:58:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:16 smithi133 ceph-mon[125939]: pgmap v2428: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:58:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:16 smithi096 ceph-mon[124666]: pgmap v2428: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:58:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:18 smithi186 ceph-mon[126480]: pgmap v2429: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:58:19.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4437.659607 secs 2023-05-08T04:58:19.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:18 smithi186 ceph-mon[126480]: osdmap e233: 12 total, 12 up, 12 in 2023-05-08T04:58:19.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:18 smithi133 ceph-mon[125939]: pgmap v2429: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:58:19.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4437.659607 secs 2023-05-08T04:58:19.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:18 smithi133 ceph-mon[125939]: osdmap e233: 12 total, 12 up, 12 in 2023-05-08T04:58:19.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:18 smithi096 ceph-mon[124666]: pgmap v2429: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:58:19.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4437.659607 secs 2023-05-08T04:58:19.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:18 smithi096 ceph-mon[124666]: osdmap e233: 12 total, 12 up, 12 in 2023-05-08T04:58:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4438.216228 secs 2023-05-08T04:58:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4438.216228 secs 2023-05-08T04:58:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4438.216228 secs 2023-05-08T04:58:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:20 smithi186 ceph-mon[126480]: pgmap v2431: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 213 B/s wr, 6 op/s 2023-05-08T04:58:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4439.496976 secs 2023-05-08T04:58:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:20 smithi133 ceph-mon[125939]: pgmap v2431: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 213 B/s wr, 6 op/s 2023-05-08T04:58:21.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4439.496976 secs 2023-05-08T04:58:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:20 smithi096 ceph-mon[124666]: pgmap v2431: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 213 B/s wr, 6 op/s 2023-05-08T04:58:21.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4439.496976 secs 2023-05-08T04:58:23.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:22 smithi186 ceph-mon[126480]: pgmap v2432: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:58:23.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:22 smithi133 ceph-mon[125939]: pgmap v2432: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:58:23.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:22 smithi096 ceph-mon[124666]: pgmap v2432: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:58:24.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4442.659710 secs 2023-05-08T04:58:24.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4442.659710 secs 2023-05-08T04:58:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4442.659710 secs 2023-05-08T04:58:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:24 smithi186 ceph-mon[126480]: pgmap v2433: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:58:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4443.216346 secs 2023-05-08T04:58:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:24 smithi133 ceph-mon[125939]: pgmap v2433: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:58:25.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4443.216346 secs 2023-05-08T04:58:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:24 smithi096 ceph-mon[124666]: pgmap v2433: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T04:58:25.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4443.216346 secs 2023-05-08T04:58:26.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4444.497052 secs 2023-05-08T04:58:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4444.497052 secs 2023-05-08T04:58:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4444.497052 secs 2023-05-08T04:58:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:26 smithi186 ceph-mon[126480]: pgmap v2434: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:58:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:26 smithi133 ceph-mon[125939]: pgmap v2434: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:58:27.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:26 smithi096 ceph-mon[124666]: pgmap v2434: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:58:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:28 smithi186 ceph-mon[126480]: pgmap v2435: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:58:29.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4447.659809 secs 2023-05-08T04:58:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:28 smithi133 ceph-mon[125939]: pgmap v2435: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:58:29.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4447.659809 secs 2023-05-08T04:58:29.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:28 smithi096 ceph-mon[124666]: pgmap v2435: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T04:58:29.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4447.659809 secs 2023-05-08T04:58:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4448.216494 secs 2023-05-08T04:58:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4448.216494 secs 2023-05-08T04:58:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4448.216494 secs 2023-05-08T04:58:31.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:30 smithi186 ceph-mon[126480]: pgmap v2436: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 95 B/s wr, 8 op/s 2023-05-08T04:58:31.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4449.497167 secs 2023-05-08T04:58:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:30 smithi133 ceph-mon[125939]: pgmap v2436: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 95 B/s wr, 8 op/s 2023-05-08T04:58:31.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4449.497167 secs 2023-05-08T04:58:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:30 smithi096 ceph-mon[124666]: pgmap v2436: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 95 B/s wr, 8 op/s 2023-05-08T04:58:31.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4449.497167 secs 2023-05-08T04:58:33.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:32 smithi186 ceph-mon[126480]: pgmap v2437: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T04:58:33.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:32 smithi133 ceph-mon[125939]: pgmap v2437: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T04:58:33.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:32 smithi096 ceph-mon[124666]: pgmap v2437: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T04:58:34.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4452.659874 secs 2023-05-08T04:58:34.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4452.659874 secs 2023-05-08T04:58:34.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4452.659874 secs 2023-05-08T04:58:35.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:34 smithi186 ceph-mon[126480]: pgmap v2438: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T04:58:35.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4453.216622 secs 2023-05-08T04:58:35.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:34 smithi133 ceph-mon[125939]: pgmap v2438: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T04:58:35.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4453.216622 secs 2023-05-08T04:58:35.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:34 smithi096 ceph-mon[124666]: pgmap v2438: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T04:58:35.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4453.216622 secs 2023-05-08T04:58:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:36 smithi186 ceph-mon[126480]: pgmap v2439: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 51 KiB/s wr, 8 op/s 2023-05-08T04:58:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:36 smithi133 ceph-mon[125939]: pgmap v2439: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 51 KiB/s wr, 8 op/s 2023-05-08T04:58:37.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:36 smithi096 ceph-mon[124666]: pgmap v2439: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 51 KiB/s wr, 8 op/s 2023-05-08T04:58:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:37 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:58:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:37 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:58:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:37 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T04:58:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:38 smithi186 ceph-mon[126480]: pgmap v2440: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 51 KiB/s wr, 5 op/s 2023-05-08T04:58:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:38 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:58:39.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:38 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:58:39.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:38 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:58:39.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4457.660022 secs 2023-05-08T04:58:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:38 smithi133 ceph-mon[125939]: pgmap v2440: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 51 KiB/s wr, 5 op/s 2023-05-08T04:58:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:38 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:58:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:38 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:58:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:38 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:58:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4457.660022 secs 2023-05-08T04:58:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:38 smithi096 ceph-mon[124666]: pgmap v2440: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 51 KiB/s wr, 5 op/s 2023-05-08T04:58:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:38 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:58:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:38 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:58:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:38 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:58:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4457.660022 secs 2023-05-08T04:58:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4458.216761 secs 2023-05-08T04:58:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4458.216761 secs 2023-05-08T04:58:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4458.216761 secs 2023-05-08T04:58:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:40 smithi186 ceph-mon[126480]: pgmap v2441: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 98 KiB/s wr, 9 op/s 2023-05-08T04:58:41.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4459.497421 secs 2023-05-08T04:58:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:40 smithi133 ceph-mon[125939]: pgmap v2441: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 98 KiB/s wr, 9 op/s 2023-05-08T04:58:41.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4459.497421 secs 2023-05-08T04:58:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:40 smithi096 ceph-mon[124666]: pgmap v2441: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 98 KiB/s wr, 9 op/s 2023-05-08T04:58:41.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4459.497421 secs 2023-05-08T04:58:43.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:42 smithi186 ceph-mon[126480]: pgmap v2442: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 98 KiB/s wr, 6 op/s 2023-05-08T04:58:43.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:42 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:58:43.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:42 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:58:43.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:42 smithi133 ceph-mon[125939]: pgmap v2442: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 98 KiB/s wr, 6 op/s 2023-05-08T04:58:43.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:42 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:58:43.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:42 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:58:43.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:42 smithi096 ceph-mon[124666]: pgmap v2442: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 98 KiB/s wr, 6 op/s 2023-05-08T04:58:43.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:42 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T04:58:43.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:42 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T04:58:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4462.660107 secs 2023-05-08T04:58:44.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:43 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:58:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4462.660107 secs 2023-05-08T04:58:44.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:43 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:58:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4462.660107 secs 2023-05-08T04:58:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:43 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T04:58:45.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:44 smithi133 ceph-mon[125939]: pgmap v2443: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 98 KiB/s wr, 6 op/s 2023-05-08T04:58:45.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4463.216851 secs 2023-05-08T04:58:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:44 smithi096 ceph-mon[124666]: pgmap v2443: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 98 KiB/s wr, 6 op/s 2023-05-08T04:58:45.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4463.216851 secs 2023-05-08T04:58:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:44 smithi186 ceph-mon[126480]: pgmap v2443: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 98 KiB/s wr, 6 op/s 2023-05-08T04:58:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4463.216851 secs 2023-05-08T04:58:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4464.497545 secs 2023-05-08T04:58:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4464.497545 secs 2023-05-08T04:58:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4464.497545 secs 2023-05-08T04:58:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:46 smithi133 ceph-mon[125939]: pgmap v2444: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 120 KiB/s wr, 10 op/s 2023-05-08T04:58:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:46 smithi096 ceph-mon[124666]: pgmap v2444: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 120 KiB/s wr, 10 op/s 2023-05-08T04:58:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:46 smithi186 ceph-mon[126480]: pgmap v2444: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 120 KiB/s wr, 10 op/s 2023-05-08T04:58:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:48 smithi133 ceph-mon[125939]: pgmap v2445: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 70 KiB/s wr, 6 op/s 2023-05-08T04:58:49.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4467.660249 secs 2023-05-08T04:58:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:48 smithi096 ceph-mon[124666]: pgmap v2445: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 70 KiB/s wr, 6 op/s 2023-05-08T04:58:49.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4467.660249 secs 2023-05-08T04:58:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:48 smithi186 ceph-mon[126480]: pgmap v2445: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 70 KiB/s wr, 6 op/s 2023-05-08T04:58:49.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4467.660249 secs 2023-05-08T04:58:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4468.216975 secs 2023-05-08T04:58:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4468.216975 secs 2023-05-08T04:58:50.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4468.216975 secs 2023-05-08T04:58:51.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:50 smithi133 ceph-mon[125939]: pgmap v2446: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 70 KiB/s wr, 9 op/s 2023-05-08T04:58:51.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4469.497677 secs 2023-05-08T04:58:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:50 smithi096 ceph-mon[124666]: pgmap v2446: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 70 KiB/s wr, 9 op/s 2023-05-08T04:58:51.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4469.497677 secs 2023-05-08T04:58:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:50 smithi186 ceph-mon[126480]: pgmap v2446: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 70 KiB/s wr, 9 op/s 2023-05-08T04:58:51.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4469.497677 secs 2023-05-08T04:58:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:52 smithi133 ceph-mon[125939]: pgmap v2447: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 5 op/s 2023-05-08T04:58:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:52 smithi096 ceph-mon[124666]: pgmap v2447: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 5 op/s 2023-05-08T04:58:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:52 smithi186 ceph-mon[126480]: pgmap v2447: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 5 op/s 2023-05-08T04:58:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4472.660374 secs 2023-05-08T04:58:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4472.660374 secs 2023-05-08T04:58:54.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4472.660374 secs 2023-05-08T04:58:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:54 smithi133 ceph-mon[125939]: pgmap v2448: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 5 op/s 2023-05-08T04:58:55.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4473.217093 secs 2023-05-08T04:58:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:54 smithi096 ceph-mon[124666]: pgmap v2448: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 5 op/s 2023-05-08T04:58:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4473.217093 secs 2023-05-08T04:58:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:54 smithi186 ceph-mon[126480]: pgmap v2448: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 5 op/s 2023-05-08T04:58:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4473.217093 secs 2023-05-08T04:58:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4474.497748 secs 2023-05-08T04:58:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4474.497748 secs 2023-05-08T04:58:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4474.497748 secs 2023-05-08T04:58:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:56 smithi133 ceph-mon[125939]: pgmap v2449: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 23 KiB/s wr, 8 op/s 2023-05-08T04:58:57.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:58:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:56 smithi096 ceph-mon[124666]: pgmap v2449: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 23 KiB/s wr, 8 op/s 2023-05-08T04:58:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:58:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:56 smithi186 ceph-mon[126480]: pgmap v2449: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 23 KiB/s wr, 8 op/s 2023-05-08T04:58:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:58:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:58:58.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:58:58.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:58:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:58:58.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:58:58.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:58:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:58:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:58:58.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:58:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:58 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:58:59.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:58 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T04:58:59.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:58 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T04:58:59.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:58 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:58:59.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:58 smithi133 ceph-mon[125939]: pgmap v2450: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:58:59.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4477.660439 secs 2023-05-08T04:58:59.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:58 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:58:59.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:58 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T04:58:59.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:58 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T04:58:59.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:58 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:58:59.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:58 smithi096 ceph-mon[124666]: pgmap v2450: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:58:59.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4477.660439 secs 2023-05-08T04:58:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:58 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:58:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:58 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T04:58:59.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:58 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T04:58:59.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:58 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:58:59.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:58 smithi186 ceph-mon[126480]: pgmap v2450: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:58:59.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4477.660439 secs 2023-05-08T04:59:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:58:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4478.217214 secs 2023-05-08T04:59:00.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:58:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4478.217214 secs 2023-05-08T04:59:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:58:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4478.217214 secs 2023-05-08T04:59:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:59:00 smithi133 ceph-mon[125939]: pgmap v2451: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:59:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:59:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4479.497865 secs 2023-05-08T04:59:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:59:00 smithi096 ceph-mon[124666]: pgmap v2451: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:59:01.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:59:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4479.497865 secs 2023-05-08T04:59:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:59:00 smithi186 ceph-mon[126480]: pgmap v2451: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T04:59:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:59:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4479.497865 secs 2023-05-08T04:59:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:59:02 smithi133 ceph-mon[125939]: pgmap v2452: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:59:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:59:02 smithi096 ceph-mon[124666]: pgmap v2452: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:59:03.373 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:59:02 smithi186 ceph-mon[126480]: pgmap v2452: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:59:04.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:59:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4482.660511 secs 2023-05-08T04:59:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:59:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4482.660511 secs 2023-05-08T04:59:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:59:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4482.660511 secs 2023-05-08T04:59:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:59:04 smithi133 ceph-mon[125939]: pgmap v2453: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:59:05.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:59:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4483.217351 secs 2023-05-08T04:59:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:59:04 smithi096 ceph-mon[124666]: pgmap v2453: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:59:05.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:59:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4483.217351 secs 2023-05-08T04:59:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:59:04 smithi186 ceph-mon[126480]: pgmap v2453: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T04:59:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:59:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4483.217351 secs 2023-05-08T04:59:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:59:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4484.497984 secs 2023-05-08T04:59:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:59:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4484.497984 secs 2023-05-08T04:59:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:59:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4484.497984 secs 2023-05-08T04:59:07.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:59:06 smithi133 ceph-mon[125939]: pgmap v2454: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 112 KiB/s wr, 23 op/s 2023-05-08T04:59:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:59:06 smithi096 ceph-mon[124666]: pgmap v2454: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 112 KiB/s wr, 23 op/s 2023-05-08T04:59:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:59:06 smithi186 ceph-mon[126480]: pgmap v2454: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 112 KiB/s wr, 23 op/s 2023-05-08T04:59:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:59:08 smithi133 ceph-mon[125939]: pgmap v2455: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 112 KiB/s wr, 21 op/s 2023-05-08T04:59:09.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:59:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4487.660587 secs 2023-05-08T04:59:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:59:08 smithi096 ceph-mon[124666]: pgmap v2455: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 112 KiB/s wr, 21 op/s 2023-05-08T04:59:09.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:59:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4487.660587 secs 2023-05-08T04:59:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:59:08 smithi186 ceph-mon[126480]: pgmap v2455: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 112 KiB/s wr, 21 op/s 2023-05-08T04:59:09.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:59:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4487.660587 secs 2023-05-08T04:59:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:59:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4488.217495 secs 2023-05-08T04:59:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:59:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4488.217495 secs 2023-05-08T04:59:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:59:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4488.217495 secs 2023-05-08T04:59:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:59:10 smithi133 ceph-mon[125939]: pgmap v2456: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 113 KiB/s wr, 24 op/s 2023-05-08T04:59:11.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:59:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4489.498098 secs 2023-05-08T04:59:11.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:59:10 smithi133 ceph-mon[125939]: osdmap e234: 12 total, 12 up, 12 in 2023-05-08T04:59:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:59:10 smithi096 ceph-mon[124666]: pgmap v2456: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 113 KiB/s wr, 24 op/s 2023-05-08T04:59:11.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:59:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4489.498098 secs 2023-05-08T04:59:11.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:59:10 smithi096 ceph-mon[124666]: osdmap e234: 12 total, 12 up, 12 in 2023-05-08T04:59:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:59:10 smithi186 ceph-mon[126480]: pgmap v2456: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 113 KiB/s wr, 24 op/s 2023-05-08T04:59:11.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:59:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4489.498098 secs 2023-05-08T04:59:11.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:59:10 smithi186 ceph-mon[126480]: osdmap e234: 12 total, 12 up, 12 in 2023-05-08T04:59:13.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:59:12 smithi133 ceph-mon[125939]: pgmap v2458: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 135 KiB/s wr, 26 op/s 2023-05-08T04:59:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:59:12 smithi096 ceph-mon[124666]: pgmap v2458: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 135 KiB/s wr, 26 op/s 2023-05-08T04:59:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:59:12 smithi186 ceph-mon[126480]: pgmap v2458: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 135 KiB/s wr, 26 op/s 2023-05-08T04:59:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:59:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4492.660722 secs 2023-05-08T04:59:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:59:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4492.660722 secs 2023-05-08T04:59:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:59:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4492.660722 secs 2023-05-08T04:59:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:59:14 smithi133 ceph-mon[125939]: pgmap v2459: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 135 KiB/s wr, 26 op/s 2023-05-08T04:59:15.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:59:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4493.217565 secs 2023-05-08T04:59:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:59:14 smithi096 ceph-mon[124666]: pgmap v2459: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 135 KiB/s wr, 26 op/s 2023-05-08T04:59:15.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:59:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4493.217565 secs 2023-05-08T04:59:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:59:14 smithi186 ceph-mon[126480]: pgmap v2459: 97 pgs: 97 active+clean; 5.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 135 KiB/s wr, 26 op/s 2023-05-08T04:59:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:59:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4493.217565 secs 2023-05-08T04:59:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:59:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4494.498215 secs 2023-05-08T04:59:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:59:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4494.498215 secs 2023-05-08T04:59:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:59:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4494.498215 secs 2023-05-08T04:59:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:59:16 smithi133 ceph-mon[125939]: pgmap v2460: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 8 op/s 2023-05-08T04:59:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:59:16 smithi096 ceph-mon[124666]: pgmap v2460: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 8 op/s 2023-05-08T04:59:17.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:59:16 smithi186 ceph-mon[126480]: pgmap v2460: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 8 op/s 2023-05-08T04:59:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:59:18 smithi133 ceph-mon[125939]: pgmap v2461: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 7 op/s 2023-05-08T04:59:19.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:59:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4497.660809 secs 2023-05-08T04:59:19.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:59:18 smithi133 ceph-mon[125939]: osdmap e235: 12 total, 12 up, 12 in 2023-05-08T04:59:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:59:18 smithi096 ceph-mon[124666]: pgmap v2461: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 7 op/s 2023-05-08T04:59:19.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:59:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4497.660809 secs 2023-05-08T04:59:19.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:59:18 smithi096 ceph-mon[124666]: osdmap e235: 12 total, 12 up, 12 in 2023-05-08T04:59:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:59:18 smithi186 ceph-mon[126480]: pgmap v2461: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 7 op/s 2023-05-08T04:59:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:59:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4497.660809 secs 2023-05-08T04:59:19.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:59:18 smithi186 ceph-mon[126480]: osdmap e235: 12 total, 12 up, 12 in 2023-05-08T04:59:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:59:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4498.217684 secs 2023-05-08T04:59:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:59:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4498.217684 secs 2023-05-08T04:59:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:59:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4498.217684 secs 2023-05-08T04:59:21.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:59:20 smithi133 ceph-mon[125939]: pgmap v2463: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 8 op/s 2023-05-08T04:59:21.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:59:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4499.498331 secs 2023-05-08T04:59:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:59:20 smithi096 ceph-mon[124666]: pgmap v2463: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 8 op/s 2023-05-08T04:59:21.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:59:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4499.498331 secs 2023-05-08T04:59:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:59:20 smithi186 ceph-mon[126480]: pgmap v2463: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 8 op/s 2023-05-08T04:59:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:59:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4499.498331 secs 2023-05-08T04:59:23.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:59:22 smithi133 ceph-mon[125939]: pgmap v2464: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 28 KiB/s wr, 7 op/s 2023-05-08T04:59:23.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:59:22 smithi096 ceph-mon[124666]: pgmap v2464: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 28 KiB/s wr, 7 op/s 2023-05-08T04:59:23.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:59:22 smithi186 ceph-mon[126480]: pgmap v2464: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 28 KiB/s wr, 7 op/s 2023-05-08T04:59:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:59:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4502.660939 secs 2023-05-08T04:59:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:59:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4502.660939 secs 2023-05-08T04:59:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:59:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4502.660939 secs 2023-05-08T04:59:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:59:24 smithi096 ceph-mon[124666]: pgmap v2465: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 28 KiB/s wr, 7 op/s 2023-05-08T04:59:25.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:59:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4503.217779 secs 2023-05-08T04:59:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:59:24 smithi186 ceph-mon[126480]: pgmap v2465: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 28 KiB/s wr, 7 op/s 2023-05-08T04:59:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:59:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4503.217779 secs 2023-05-08T04:59:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:59:24 smithi133 ceph-mon[125939]: pgmap v2465: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 28 KiB/s wr, 7 op/s 2023-05-08T04:59:25.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:59:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4503.217779 secs 2023-05-08T04:59:26.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:59:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4504.498454 secs 2023-05-08T04:59:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:59:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4504.498454 secs 2023-05-08T04:59:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:59:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4504.498454 secs 2023-05-08T04:59:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:59:27 smithi096 ceph-mon[124666]: pgmap v2466: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 7 op/s 2023-05-08T04:59:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:59:27 smithi186 ceph-mon[126480]: pgmap v2466: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 7 op/s 2023-05-08T04:59:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:59:27 smithi133 ceph-mon[125939]: pgmap v2466: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 7 op/s 2023-05-08T04:59:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:59:29 smithi186 ceph-mon[126480]: pgmap v2467: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 7 op/s 2023-05-08T04:59:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:59:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4507.661031 secs 2023-05-08T04:59:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:59:29 smithi133 ceph-mon[125939]: pgmap v2467: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 7 op/s 2023-05-08T04:59:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:59:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4507.661031 secs 2023-05-08T04:59:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:59:29 smithi096 ceph-mon[124666]: pgmap v2467: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 7 op/s 2023-05-08T04:59:29.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:59:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4507.661031 secs 2023-05-08T04:59:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:59:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4508.217899 secs 2023-05-08T04:59:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:59:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4508.217899 secs 2023-05-08T04:59:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:59:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4508.217899 secs 2023-05-08T04:59:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:59:31 smithi186 ceph-mon[126480]: pgmap v2468: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 95 B/s wr, 9 op/s 2023-05-08T04:59:31.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:59:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4509.498591 secs 2023-05-08T04:59:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:59:31 smithi133 ceph-mon[125939]: pgmap v2468: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 95 B/s wr, 9 op/s 2023-05-08T04:59:31.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:59:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4509.498591 secs 2023-05-08T04:59:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:59:31 smithi096 ceph-mon[124666]: pgmap v2468: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 95 B/s wr, 9 op/s 2023-05-08T04:59:31.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:59:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4509.498591 secs 2023-05-08T04:59:33.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:59:33 smithi186 ceph-mon[126480]: pgmap v2469: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:59:33.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:59:33 smithi133 ceph-mon[125939]: pgmap v2469: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:59:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:59:33 smithi096 ceph-mon[124666]: pgmap v2469: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:59:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:59:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4512.661145 secs 2023-05-08T04:59:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:59:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4512.661145 secs 2023-05-08T04:59:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:59:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4512.661145 secs 2023-05-08T04:59:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:59:35 smithi186 ceph-mon[126480]: pgmap v2470: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:59:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:59:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4513.218018 secs 2023-05-08T04:59:35.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:59:35 smithi133 ceph-mon[125939]: pgmap v2470: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:59:35.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:59:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4513.218018 secs 2023-05-08T04:59:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:59:35 smithi096 ceph-mon[124666]: pgmap v2470: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T04:59:35.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:59:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4513.218018 secs 2023-05-08T04:59:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:59:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4514.498708 secs 2023-05-08T04:59:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:59:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4514.498708 secs 2023-05-08T04:59:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:59:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4514.498708 secs 2023-05-08T04:59:37.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:59:37 smithi186 ceph-mon[126480]: pgmap v2471: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 53 KiB/s wr, 9 op/s 2023-05-08T04:59:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:59:37 smithi133 ceph-mon[125939]: pgmap v2471: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 53 KiB/s wr, 9 op/s 2023-05-08T04:59:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:59:37 smithi096 ceph-mon[124666]: pgmap v2471: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 53 KiB/s wr, 9 op/s 2023-05-08T04:59:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:59:39 smithi186 ceph-mon[126480]: pgmap v2472: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 53 KiB/s wr, 6 op/s 2023-05-08T04:59:39.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:59:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4517.661261 secs 2023-05-08T04:59:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:59:39 smithi133 ceph-mon[125939]: pgmap v2472: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 53 KiB/s wr, 6 op/s 2023-05-08T04:59:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:59:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4517.661261 secs 2023-05-08T04:59:39.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:59:39 smithi096 ceph-mon[124666]: pgmap v2472: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 53 KiB/s wr, 6 op/s 2023-05-08T04:59:39.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:59:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4517.661261 secs 2023-05-08T04:59:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:59:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4518.218139 secs 2023-05-08T04:59:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:59:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4518.218139 secs 2023-05-08T04:59:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:59:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4518.218139 secs 2023-05-08T04:59:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:59:41 smithi186 ceph-mon[126480]: pgmap v2473: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 99 KiB/s wr, 9 op/s 2023-05-08T04:59:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:59:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4519.498851 secs 2023-05-08T04:59:41.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:59:41 smithi133 ceph-mon[125939]: pgmap v2473: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 99 KiB/s wr, 9 op/s 2023-05-08T04:59:41.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:59:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4519.498851 secs 2023-05-08T04:59:41.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:59:41 smithi096 ceph-mon[124666]: pgmap v2473: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 99 KiB/s wr, 9 op/s 2023-05-08T04:59:41.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:59:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4519.498851 secs 2023-05-08T04:59:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:59:43 smithi186 ceph-mon[126480]: pgmap v2474: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 99 KiB/s wr, 6 op/s 2023-05-08T04:59:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:59:43 smithi133 ceph-mon[125939]: pgmap v2474: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 99 KiB/s wr, 6 op/s 2023-05-08T04:59:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:59:43 smithi096 ceph-mon[124666]: pgmap v2474: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 99 KiB/s wr, 6 op/s 2023-05-08T04:59:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:59:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4522.661374 secs 2023-05-08T04:59:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:59:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4522.661374 secs 2023-05-08T04:59:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:59:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4522.661374 secs 2023-05-08T04:59:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:59:45 smithi186 ceph-mon[126480]: pgmap v2475: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 99 KiB/s wr, 6 op/s 2023-05-08T04:59:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:59:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4523.218255 secs 2023-05-08T04:59:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:59:45 smithi133 ceph-mon[125939]: pgmap v2475: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 99 KiB/s wr, 6 op/s 2023-05-08T04:59:45.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:59:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4523.218255 secs 2023-05-08T04:59:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:59:45 smithi096 ceph-mon[124666]: pgmap v2475: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 99 KiB/s wr, 6 op/s 2023-05-08T04:59:45.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:59:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4523.218255 secs 2023-05-08T04:59:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:59:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4524.498929 secs 2023-05-08T04:59:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:59:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4524.498929 secs 2023-05-08T04:59:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:59:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4524.498929 secs 2023-05-08T04:59:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:59:47 smithi186 ceph-mon[126480]: pgmap v2476: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 122 KiB/s wr, 10 op/s 2023-05-08T04:59:47.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:59:47 smithi133 ceph-mon[125939]: pgmap v2476: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 122 KiB/s wr, 10 op/s 2023-05-08T04:59:47.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:59:47 smithi096 ceph-mon[124666]: pgmap v2476: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 122 KiB/s wr, 10 op/s 2023-05-08T04:59:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:59:49 smithi186 ceph-mon[126480]: pgmap v2477: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 69 KiB/s wr, 6 op/s 2023-05-08T04:59:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:59:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4527.661465 secs 2023-05-08T04:59:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:59:49 smithi133 ceph-mon[125939]: pgmap v2477: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 69 KiB/s wr, 6 op/s 2023-05-08T04:59:49.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:59:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4527.661465 secs 2023-05-08T04:59:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:59:49 smithi096 ceph-mon[124666]: pgmap v2477: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 69 KiB/s wr, 6 op/s 2023-05-08T04:59:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:59:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4527.661465 secs 2023-05-08T04:59:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:59:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4528.218393 secs 2023-05-08T04:59:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:59:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4528.218393 secs 2023-05-08T04:59:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:59:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4528.218393 secs 2023-05-08T04:59:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:59:51 smithi186 ceph-mon[126480]: pgmap v2478: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 69 KiB/s wr, 9 op/s 2023-05-08T04:59:51.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:59:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4529.499046 secs 2023-05-08T04:59:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:59:51 smithi133 ceph-mon[125939]: pgmap v2478: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 69 KiB/s wr, 9 op/s 2023-05-08T04:59:51.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:59:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4529.499046 secs 2023-05-08T04:59:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:59:51 smithi096 ceph-mon[124666]: pgmap v2478: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 69 KiB/s wr, 9 op/s 2023-05-08T04:59:51.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:59:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4529.499046 secs 2023-05-08T04:59:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:59:53 smithi186 ceph-mon[126480]: pgmap v2479: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 5 op/s 2023-05-08T04:59:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:59:53 smithi133 ceph-mon[125939]: pgmap v2479: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 5 op/s 2023-05-08T04:59:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:59:53 smithi096 ceph-mon[124666]: pgmap v2479: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 5 op/s 2023-05-08T04:59:54.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:59:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4532.661582 secs 2023-05-08T04:59:54.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:59:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4532.661582 secs 2023-05-08T04:59:54.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:59:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4532.661582 secs 2023-05-08T04:59:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:59:55 smithi186 ceph-mon[126480]: pgmap v2480: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 5 op/s 2023-05-08T04:59:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:59:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4533.218513 secs 2023-05-08T04:59:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:59:55 smithi133 ceph-mon[125939]: pgmap v2480: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 5 op/s 2023-05-08T04:59:55.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:59:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4533.218513 secs 2023-05-08T04:59:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:59:55 smithi096 ceph-mon[124666]: pgmap v2480: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 5 op/s 2023-05-08T04:59:55.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:59:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4533.218513 secs 2023-05-08T04:59:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:59:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4534.499164 secs 2023-05-08T04:59:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:59:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4534.499164 secs 2023-05-08T04:59:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:59:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4534.499164 secs 2023-05-08T04:59:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:59:57 smithi186 ceph-mon[126480]: pgmap v2481: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 23 KiB/s wr, 8 op/s 2023-05-08T04:59:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:59:57 smithi133 ceph-mon[125939]: pgmap v2481: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 23 KiB/s wr, 8 op/s 2023-05-08T04:59:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:59:57 smithi096 ceph-mon[124666]: pgmap v2481: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 23 KiB/s wr, 8 op/s 2023-05-08T04:59:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:59:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:59:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:59:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:59:58.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:59:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:59:58.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:59:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:59:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:59:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:59:58.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:59:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:59:58.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:59:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:59:58.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:59:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:59:58.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:59:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T04:59:58.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:59:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T04:59:58.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:59:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T04:59:58.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:59:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T04:59:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:59:59 smithi186 ceph-mon[126480]: pgmap v2482: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T04:59:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:59:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4537.661691 secs 2023-05-08T04:59:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:59:59 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:59:59.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:59:59 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T04:59:59.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:59:59 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T04:59:59.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 04:59:59 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T04:59:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:59:59 smithi133 ceph-mon[125939]: pgmap v2482: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T04:59:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:59:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4537.661691 secs 2023-05-08T04:59:59.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:59:59 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:59:59.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:59:59 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T04:59:59.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:59:59 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T04:59:59.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 04:59:59 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T04:59:59.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:59:59 smithi096 ceph-mon[124666]: pgmap v2482: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T04:59:59.509 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:59:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4537.661691 secs 2023-05-08T04:59:59.509 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:59:59 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T04:59:59.509 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:59:59 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T04:59:59.509 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:59:59 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T04:59:59.509 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 04:59:59 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:00:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:00:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4538.218580 secs 2023-05-08T05:00:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:00:00 smithi186 ceph-mon[126480]: overall HEALTH_WARN 3 MDSs report slow requests 2023-05-08T05:00:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:00:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4538.218580 secs 2023-05-08T05:00:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:00:00 smithi133 ceph-mon[125939]: overall HEALTH_WARN 3 MDSs report slow requests 2023-05-08T05:00:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:00:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4538.218580 secs 2023-05-08T05:00:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:00:00 smithi096 ceph-mon[124666]: overall HEALTH_WARN 3 MDSs report slow requests 2023-05-08T05:00:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:00:01 smithi186 ceph-mon[126480]: pgmap v2483: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T05:00:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:00:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4539.499300 secs 2023-05-08T05:00:01.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:00:01 smithi133 ceph-mon[125939]: pgmap v2483: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T05:00:01.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:00:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4539.499300 secs 2023-05-08T05:00:01.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:00:01 smithi096 ceph-mon[124666]: pgmap v2483: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T05:00:01.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:00:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4539.499300 secs 2023-05-08T05:00:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:00:03 smithi133 ceph-mon[125939]: pgmap v2484: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:00:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:00:03 smithi096 ceph-mon[124666]: pgmap v2484: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:00:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:00:03 smithi186 ceph-mon[126480]: pgmap v2484: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:00:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:00:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4542.661812 secs 2023-05-08T05:00:04.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:00:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4543.218704 secs 2023-05-08T05:00:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:00:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4542.661812 secs 2023-05-08T05:00:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:00:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4543.218704 secs 2023-05-08T05:00:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:00:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4542.661812 secs 2023-05-08T05:00:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:00:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4543.218704 secs 2023-05-08T05:00:05.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:00:05 smithi133 ceph-mon[125939]: pgmap v2485: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:00:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:00:05 smithi096 ceph-mon[124666]: pgmap v2485: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:00:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:00:05 smithi186 ceph-mon[126480]: pgmap v2485: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:00:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:00:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4544.499455 secs 2023-05-08T05:00:06.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:00:06 smithi133 ceph-mon[125939]: osdmap e236: 12 total, 12 up, 12 in 2023-05-08T05:00:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:00:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4544.499455 secs 2023-05-08T05:00:06.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:00:06 smithi096 ceph-mon[124666]: osdmap e236: 12 total, 12 up, 12 in 2023-05-08T05:00:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:00:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4544.499455 secs 2023-05-08T05:00:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:00:06 smithi186 ceph-mon[126480]: osdmap e236: 12 total, 12 up, 12 in 2023-05-08T05:00:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:00:07 smithi133 ceph-mon[125939]: pgmap v2487: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 111 KiB/s wr, 25 op/s 2023-05-08T05:00:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:00:07 smithi096 ceph-mon[124666]: pgmap v2487: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 111 KiB/s wr, 25 op/s 2023-05-08T05:00:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:00:07 smithi186 ceph-mon[126480]: pgmap v2487: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 111 KiB/s wr, 25 op/s 2023-05-08T05:00:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:00:09 smithi133 ceph-mon[125939]: pgmap v2488: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 111 KiB/s wr, 25 op/s 2023-05-08T05:00:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:00:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4547.661918 secs 2023-05-08T05:00:09.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:00:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4548.218831 secs 2023-05-08T05:00:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:00:09 smithi096 ceph-mon[124666]: pgmap v2488: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 111 KiB/s wr, 25 op/s 2023-05-08T05:00:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:00:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4547.661918 secs 2023-05-08T05:00:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:00:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4548.218831 secs 2023-05-08T05:00:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:00:09 smithi186 ceph-mon[126480]: pgmap v2488: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 111 KiB/s wr, 25 op/s 2023-05-08T05:00:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:00:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4547.661918 secs 2023-05-08T05:00:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:00:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4548.218831 secs 2023-05-08T05:00:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:00:11 smithi133 ceph-mon[125939]: pgmap v2489: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 111 KiB/s wr, 25 op/s 2023-05-08T05:00:11.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:00:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4549.499592 secs 2023-05-08T05:00:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:00:11 smithi096 ceph-mon[124666]: pgmap v2489: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 111 KiB/s wr, 25 op/s 2023-05-08T05:00:11.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:00:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4549.499592 secs 2023-05-08T05:00:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:00:11 smithi186 ceph-mon[126480]: pgmap v2489: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 111 KiB/s wr, 25 op/s 2023-05-08T05:00:11.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:00:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4549.499592 secs 2023-05-08T05:00:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:00:13 smithi133 ceph-mon[125939]: pgmap v2490: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 111 KiB/s wr, 25 op/s 2023-05-08T05:00:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:00:13 smithi096 ceph-mon[124666]: pgmap v2490: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 111 KiB/s wr, 25 op/s 2023-05-08T05:00:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:00:13 smithi186 ceph-mon[126480]: pgmap v2490: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 111 KiB/s wr, 25 op/s 2023-05-08T05:00:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:00:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4552.662031 secs 2023-05-08T05:00:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:00:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4553.218960 secs 2023-05-08T05:00:14.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:00:14 smithi133 ceph-mon[125939]: osdmap e237: 12 total, 12 up, 12 in 2023-05-08T05:00:14.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:00:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4552.662031 secs 2023-05-08T05:00:14.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:00:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4553.218960 secs 2023-05-08T05:00:14.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:00:14 smithi096 ceph-mon[124666]: osdmap e237: 12 total, 12 up, 12 in 2023-05-08T05:00:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:00:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4552.662031 secs 2023-05-08T05:00:14.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:00:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4553.218960 secs 2023-05-08T05:00:14.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:00:14 smithi186 ceph-mon[126480]: osdmap e237: 12 total, 12 up, 12 in 2023-05-08T05:00:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:00:15 smithi133 ceph-mon[125939]: pgmap v2491: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 111 KiB/s wr, 25 op/s 2023-05-08T05:00:15.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:00:15 smithi096 ceph-mon[124666]: pgmap v2491: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 111 KiB/s wr, 25 op/s 2023-05-08T05:00:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:00:15 smithi186 ceph-mon[126480]: pgmap v2491: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 111 KiB/s wr, 25 op/s 2023-05-08T05:00:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:00:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4554.499719 secs 2023-05-08T05:00:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:00:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4554.499719 secs 2023-05-08T05:00:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:00:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4554.499719 secs 2023-05-08T05:00:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:00:17 smithi133 ceph-mon[125939]: pgmap v2493: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 7 op/s 2023-05-08T05:00:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:00:17 smithi096 ceph-mon[124666]: pgmap v2493: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 7 op/s 2023-05-08T05:00:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:00:17 smithi186 ceph-mon[126480]: pgmap v2493: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 7 op/s 2023-05-08T05:00:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:00:19 smithi133 ceph-mon[125939]: pgmap v2494: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 7 op/s 2023-05-08T05:00:19.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:00:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4557.662173 secs 2023-05-08T05:00:19.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:00:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4558.219057 secs 2023-05-08T05:00:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:00:19 smithi096 ceph-mon[124666]: pgmap v2494: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 7 op/s 2023-05-08T05:00:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:00:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4557.662173 secs 2023-05-08T05:00:19.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:00:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4558.219057 secs 2023-05-08T05:00:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:00:19 smithi186 ceph-mon[126480]: pgmap v2494: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 7 op/s 2023-05-08T05:00:19.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:00:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4557.662173 secs 2023-05-08T05:00:19.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:00:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4558.219057 secs 2023-05-08T05:00:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:00:21 smithi133 ceph-mon[125939]: pgmap v2495: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 6 op/s 2023-05-08T05:00:21.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:00:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4559.499814 secs 2023-05-08T05:00:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:00:21 smithi096 ceph-mon[124666]: pgmap v2495: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 6 op/s 2023-05-08T05:00:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:00:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4559.499814 secs 2023-05-08T05:00:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:00:21 smithi186 ceph-mon[126480]: pgmap v2495: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 6 op/s 2023-05-08T05:00:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:00:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4559.499814 secs 2023-05-08T05:00:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:00:23 smithi133 ceph-mon[125939]: pgmap v2496: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 6 op/s 2023-05-08T05:00:23.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:00:23 smithi096 ceph-mon[124666]: pgmap v2496: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 6 op/s 2023-05-08T05:00:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:00:23 smithi186 ceph-mon[126480]: pgmap v2496: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 6 op/s 2023-05-08T05:00:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:00:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4562.662304 secs 2023-05-08T05:00:24.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:00:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4563.219194 secs 2023-05-08T05:00:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:00:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4562.662304 secs 2023-05-08T05:00:24.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:00:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4563.219194 secs 2023-05-08T05:00:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:00:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4562.662304 secs 2023-05-08T05:00:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:00:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4563.219194 secs 2023-05-08T05:00:25.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:00:25 smithi133 ceph-mon[125939]: pgmap v2497: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 6 op/s 2023-05-08T05:00:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:00:25 smithi096 ceph-mon[124666]: pgmap v2497: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 6 op/s 2023-05-08T05:00:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:00:25 smithi186 ceph-mon[126480]: pgmap v2497: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 6 op/s 2023-05-08T05:00:26.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:00:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4564.499933 secs 2023-05-08T05:00:26.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:00:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4564.499933 secs 2023-05-08T05:00:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:00:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4564.499933 secs 2023-05-08T05:00:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:00:27 smithi133 ceph-mon[125939]: pgmap v2498: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 8 op/s 2023-05-08T05:00:27.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:00:27 smithi096 ceph-mon[124666]: pgmap v2498: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 8 op/s 2023-05-08T05:00:27.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:00:27 smithi186 ceph-mon[126480]: pgmap v2498: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 8 op/s 2023-05-08T05:00:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:00:29 smithi133 ceph-mon[125939]: pgmap v2499: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:00:29.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:00:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4567.662441 secs 2023-05-08T05:00:29.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:00:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4568.219312 secs 2023-05-08T05:00:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:00:29 smithi096 ceph-mon[124666]: pgmap v2499: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:00:29.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:00:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4567.662441 secs 2023-05-08T05:00:29.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:00:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4568.219312 secs 2023-05-08T05:00:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:00:29 smithi186 ceph-mon[126480]: pgmap v2499: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:00:29.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:00:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4567.662441 secs 2023-05-08T05:00:29.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:00:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4568.219312 secs 2023-05-08T05:00:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:00:31 smithi133 ceph-mon[125939]: pgmap v2500: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T05:00:31.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:00:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4569.500069 secs 2023-05-08T05:00:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:00:31 smithi096 ceph-mon[124666]: pgmap v2500: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T05:00:31.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:00:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4569.500069 secs 2023-05-08T05:00:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:00:31 smithi186 ceph-mon[126480]: pgmap v2500: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T05:00:31.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:00:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4569.500069 secs 2023-05-08T05:00:33.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:00:33 smithi133 ceph-mon[125939]: pgmap v2501: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:00:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:00:33 smithi096 ceph-mon[124666]: pgmap v2501: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:00:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:00:33 smithi186 ceph-mon[126480]: pgmap v2501: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:00:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:00:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4572.662559 secs 2023-05-08T05:00:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:00:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4573.219452 secs 2023-05-08T05:00:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:00:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4572.662559 secs 2023-05-08T05:00:34.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:00:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4573.219452 secs 2023-05-08T05:00:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:00:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4572.662559 secs 2023-05-08T05:00:34.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:00:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4573.219452 secs 2023-05-08T05:00:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:00:35 smithi133 ceph-mon[125939]: pgmap v2502: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:00:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:00:35 smithi096 ceph-mon[124666]: pgmap v2502: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:00:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:00:35 smithi186 ceph-mon[126480]: pgmap v2502: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:00:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:00:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4574.500149 secs 2023-05-08T05:00:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:00:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4574.500149 secs 2023-05-08T05:00:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:00:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4574.500149 secs 2023-05-08T05:00:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:00:37 smithi133 ceph-mon[125939]: pgmap v2503: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 80 KiB/s wr, 8 op/s 2023-05-08T05:00:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:00:37 smithi096 ceph-mon[124666]: pgmap v2503: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 80 KiB/s wr, 8 op/s 2023-05-08T05:00:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:00:37 smithi186 ceph-mon[126480]: pgmap v2503: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 80 KiB/s wr, 8 op/s 2023-05-08T05:00:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:00:39 smithi133 ceph-mon[125939]: pgmap v2504: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 80 KiB/s wr, 6 op/s 2023-05-08T05:00:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:00:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4577.662653 secs 2023-05-08T05:00:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:00:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4578.219572 secs 2023-05-08T05:00:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:00:39 smithi096 ceph-mon[124666]: pgmap v2504: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 80 KiB/s wr, 6 op/s 2023-05-08T05:00:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:00:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4577.662653 secs 2023-05-08T05:00:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:00:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4578.219572 secs 2023-05-08T05:00:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:00:39 smithi186 ceph-mon[126480]: pgmap v2504: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 80 KiB/s wr, 6 op/s 2023-05-08T05:00:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:00:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4577.662653 secs 2023-05-08T05:00:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:00:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4578.219572 secs 2023-05-08T05:00:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:00:41 smithi133 ceph-mon[125939]: pgmap v2505: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 122 KiB/s wr, 10 op/s 2023-05-08T05:00:41.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:00:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4579.500269 secs 2023-05-08T05:00:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:00:41 smithi096 ceph-mon[124666]: pgmap v2505: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 122 KiB/s wr, 10 op/s 2023-05-08T05:00:41.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:00:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4579.500269 secs 2023-05-08T05:00:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:00:41 smithi186 ceph-mon[126480]: pgmap v2505: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 122 KiB/s wr, 10 op/s 2023-05-08T05:00:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:00:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4579.500269 secs 2023-05-08T05:00:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:00:43 smithi133 ceph-mon[125939]: pgmap v2506: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 122 KiB/s wr, 7 op/s 2023-05-08T05:00:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:00:43 smithi096 ceph-mon[124666]: pgmap v2506: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 122 KiB/s wr, 7 op/s 2023-05-08T05:00:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:00:43 smithi186 ceph-mon[126480]: pgmap v2506: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 122 KiB/s wr, 7 op/s 2023-05-08T05:00:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:00:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4582.662812 secs 2023-05-08T05:00:44.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:00:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4583.219700 secs 2023-05-08T05:00:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:00:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4582.662812 secs 2023-05-08T05:00:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:00:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4583.219700 secs 2023-05-08T05:00:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:00:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4582.662812 secs 2023-05-08T05:00:44.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:00:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4583.219700 secs 2023-05-08T05:00:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:00:45 smithi133 ceph-mon[125939]: pgmap v2507: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 122 KiB/s wr, 7 op/s 2023-05-08T05:00:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:00:45 smithi096 ceph-mon[124666]: pgmap v2507: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 122 KiB/s wr, 7 op/s 2023-05-08T05:00:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:00:45 smithi186 ceph-mon[126480]: pgmap v2507: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 122 KiB/s wr, 7 op/s 2023-05-08T05:00:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:00:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4584.500419 secs 2023-05-08T05:00:46.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:00:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4584.500419 secs 2023-05-08T05:00:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:00:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4584.500419 secs 2023-05-08T05:00:47.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:00:47 smithi096 ceph-mon[124666]: pgmap v2508: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 146 KiB/s wr, 10 op/s 2023-05-08T05:00:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:00:47 smithi186 ceph-mon[126480]: pgmap v2508: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 146 KiB/s wr, 10 op/s 2023-05-08T05:00:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:00:47 smithi133 ceph-mon[125939]: pgmap v2508: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 146 KiB/s wr, 10 op/s 2023-05-08T05:00:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:00:49 smithi096 ceph-mon[124666]: pgmap v2509: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 66 KiB/s wr, 7 op/s 2023-05-08T05:00:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:00:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4587.662906 secs 2023-05-08T05:00:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:00:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4588.219772 secs 2023-05-08T05:00:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:00:49 smithi186 ceph-mon[126480]: pgmap v2509: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 66 KiB/s wr, 7 op/s 2023-05-08T05:00:49.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:00:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4587.662906 secs 2023-05-08T05:00:49.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:00:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4588.219772 secs 2023-05-08T05:00:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:00:49 smithi133 ceph-mon[125939]: pgmap v2509: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 66 KiB/s wr, 7 op/s 2023-05-08T05:00:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:00:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4587.662906 secs 2023-05-08T05:00:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:00:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4588.219772 secs 2023-05-08T05:00:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:00:50 smithi096 ceph-mon[124666]: pgmap v2510: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 66 KiB/s wr, 10 op/s 2023-05-08T05:00:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:00:50 smithi186 ceph-mon[126480]: pgmap v2510: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 66 KiB/s wr, 10 op/s 2023-05-08T05:00:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:00:50 smithi133 ceph-mon[125939]: pgmap v2510: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 66 KiB/s wr, 10 op/s 2023-05-08T05:00:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:00:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4589.500534 secs 2023-05-08T05:00:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:00:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4589.500534 secs 2023-05-08T05:00:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:00:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4589.500534 secs 2023-05-08T05:00:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:00:52 smithi186 ceph-mon[126480]: pgmap v2511: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 23 KiB/s wr, 6 op/s 2023-05-08T05:00:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:00:52 smithi133 ceph-mon[125939]: pgmap v2511: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 23 KiB/s wr, 6 op/s 2023-05-08T05:00:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:00:52 smithi096 ceph-mon[124666]: pgmap v2511: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 23 KiB/s wr, 6 op/s 2023-05-08T05:00:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:00:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4592.662977 secs 2023-05-08T05:00:54.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:00:54 smithi133 ceph-mon[125939]: pgmap v2512: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 23 KiB/s wr, 6 op/s 2023-05-08T05:00:54.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:00:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4593.219903 secs 2023-05-08T05:00:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:00:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4592.662977 secs 2023-05-08T05:00:54.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:00:54 smithi096 ceph-mon[124666]: pgmap v2512: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 23 KiB/s wr, 6 op/s 2023-05-08T05:00:54.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:00:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4593.219903 secs 2023-05-08T05:00:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:00:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4592.662977 secs 2023-05-08T05:00:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:00:54 smithi186 ceph-mon[126480]: pgmap v2512: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 23 KiB/s wr, 6 op/s 2023-05-08T05:00:54.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:00:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4593.219903 secs 2023-05-08T05:00:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:00:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4594.500656 secs 2023-05-08T05:00:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:00:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4594.500656 secs 2023-05-08T05:00:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:00:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4594.500656 secs 2023-05-08T05:00:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:00:56 smithi133 ceph-mon[125939]: pgmap v2513: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 23 KiB/s wr, 9 op/s 2023-05-08T05:00:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:00:56 smithi096 ceph-mon[124666]: pgmap v2513: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 23 KiB/s wr, 9 op/s 2023-05-08T05:00:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:00:56 smithi186 ceph-mon[126480]: pgmap v2513: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 23 KiB/s wr, 9 op/s 2023-05-08T05:00:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:00:58 smithi133 ceph-mon[125939]: pgmap v2514: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:00:58.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:00:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:00:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:00:58 smithi096 ceph-mon[124666]: pgmap v2514: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:00:58.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:00:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:00:58.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:00:58 smithi186 ceph-mon[126480]: pgmap v2514: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:00:58.873 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:00:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:00:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:00:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4597.663113 secs 2023-05-08T05:00:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:00:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4598.219986 secs 2023-05-08T05:00:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:00:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:00:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:00:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:00:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:00:59 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:00:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:00:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:00:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:00:59 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T05:00:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:00:59 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T05:00:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:00:59 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:00:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:00:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4597.663113 secs 2023-05-08T05:00:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:00:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4598.219986 secs 2023-05-08T05:00:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:00:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:00:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:00:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:00:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:00:59 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:00:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:00:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:00:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:00:59 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T05:00:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:00:59 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T05:00:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:00:59 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:00:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:00:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4597.663113 secs 2023-05-08T05:00:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:00:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4598.219986 secs 2023-05-08T05:00:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:00:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:00:59.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:00:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:00:59.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:00:59 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:00:59.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:00:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:00:59.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:00:59 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T05:00:59.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:00:59 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T05:00:59.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:00:59 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:01:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:01:00 smithi186 ceph-mon[126480]: pgmap v2515: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T05:01:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:01:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4599.500790 secs 2023-05-08T05:01:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:01:00 smithi133 ceph-mon[125939]: pgmap v2515: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T05:01:01.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:01:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4599.500790 secs 2023-05-08T05:01:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:01:00 smithi096 ceph-mon[124666]: pgmap v2515: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T05:01:01.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:01:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4599.500790 secs 2023-05-08T05:01:03.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:01:02 smithi186 ceph-mon[126480]: pgmap v2516: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:01:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:01:02 smithi133 ceph-mon[125939]: pgmap v2516: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:01:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:01:02 smithi096 ceph-mon[124666]: pgmap v2516: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:01:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:01:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4602.663235 secs 2023-05-08T05:01:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:01:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4602.663235 secs 2023-05-08T05:01:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:01:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4602.663235 secs 2023-05-08T05:01:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:01:04 smithi186 ceph-mon[126480]: pgmap v2517: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:01:05.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:01:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4603.220110 secs 2023-05-08T05:01:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:01:04 smithi133 ceph-mon[125939]: pgmap v2517: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:01:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:01:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4603.220110 secs 2023-05-08T05:01:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:01:04 smithi096 ceph-mon[124666]: pgmap v2517: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:01:05.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:01:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4603.220110 secs 2023-05-08T05:01:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:01:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4604.500872 secs 2023-05-08T05:01:06.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:01:05 smithi133 ceph-mon[125939]: osdmap e238: 12 total, 12 up, 12 in 2023-05-08T05:01:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:01:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4604.500872 secs 2023-05-08T05:01:06.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:01:05 smithi096 ceph-mon[124666]: osdmap e238: 12 total, 12 up, 12 in 2023-05-08T05:01:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:01:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4604.500872 secs 2023-05-08T05:01:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:01:05 smithi186 ceph-mon[126480]: osdmap e238: 12 total, 12 up, 12 in 2023-05-08T05:01:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:01:06 smithi133 ceph-mon[125939]: pgmap v2519: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 111 KiB/s wr, 25 op/s 2023-05-08T05:01:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:01:06 smithi096 ceph-mon[124666]: pgmap v2519: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 111 KiB/s wr, 25 op/s 2023-05-08T05:01:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:01:06 smithi186 ceph-mon[126480]: pgmap v2519: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 111 KiB/s wr, 25 op/s 2023-05-08T05:01:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:01:08 smithi133 ceph-mon[125939]: pgmap v2520: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 111 KiB/s wr, 25 op/s 2023-05-08T05:01:09.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:01:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4607.663369 secs 2023-05-08T05:01:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:01:08 smithi096 ceph-mon[124666]: pgmap v2520: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 111 KiB/s wr, 25 op/s 2023-05-08T05:01:09.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:01:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4607.663369 secs 2023-05-08T05:01:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:01:08 smithi186 ceph-mon[126480]: pgmap v2520: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 111 KiB/s wr, 25 op/s 2023-05-08T05:01:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:01:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4607.663369 secs 2023-05-08T05:01:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:01:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4608.220219 secs 2023-05-08T05:01:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:01:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4608.220219 secs 2023-05-08T05:01:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:01:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4608.220219 secs 2023-05-08T05:01:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:01:10 smithi133 ceph-mon[125939]: pgmap v2521: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 111 KiB/s wr, 25 op/s 2023-05-08T05:01:11.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:01:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4609.500987 secs 2023-05-08T05:01:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:01:10 smithi096 ceph-mon[124666]: pgmap v2521: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 111 KiB/s wr, 25 op/s 2023-05-08T05:01:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:01:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4609.500987 secs 2023-05-08T05:01:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:01:10 smithi186 ceph-mon[126480]: pgmap v2521: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 111 KiB/s wr, 25 op/s 2023-05-08T05:01:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:01:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4609.500987 secs 2023-05-08T05:01:13.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:01:12 smithi133 ceph-mon[125939]: pgmap v2522: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 111 KiB/s wr, 25 op/s 2023-05-08T05:01:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:01:12 smithi096 ceph-mon[124666]: pgmap v2522: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 111 KiB/s wr, 25 op/s 2023-05-08T05:01:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:01:12 smithi186 ceph-mon[126480]: pgmap v2522: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 111 KiB/s wr, 25 op/s 2023-05-08T05:01:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:01:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4612.663486 secs 2023-05-08T05:01:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:01:13 smithi133 ceph-mon[125939]: osdmap e239: 12 total, 12 up, 12 in 2023-05-08T05:01:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:01:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4612.663486 secs 2023-05-08T05:01:14.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:01:13 smithi096 ceph-mon[124666]: osdmap e239: 12 total, 12 up, 12 in 2023-05-08T05:01:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:01:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4612.663486 secs 2023-05-08T05:01:14.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:01:13 smithi186 ceph-mon[126480]: osdmap e239: 12 total, 12 up, 12 in 2023-05-08T05:01:15.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:01:14 smithi133 ceph-mon[125939]: pgmap v2523: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 111 KiB/s wr, 25 op/s 2023-05-08T05:01:15.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:01:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4613.220377 secs 2023-05-08T05:01:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:01:14 smithi096 ceph-mon[124666]: pgmap v2523: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 111 KiB/s wr, 25 op/s 2023-05-08T05:01:15.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:01:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4613.220377 secs 2023-05-08T05:01:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:01:14 smithi186 ceph-mon[126480]: pgmap v2523: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 111 KiB/s wr, 25 op/s 2023-05-08T05:01:15.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:01:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4613.220377 secs 2023-05-08T05:01:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:01:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4614.501068 secs 2023-05-08T05:01:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:01:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4614.501068 secs 2023-05-08T05:01:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:01:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4614.501068 secs 2023-05-08T05:01:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:01:16 smithi133 ceph-mon[125939]: pgmap v2525: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 7 op/s 2023-05-08T05:01:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:01:16 smithi096 ceph-mon[124666]: pgmap v2525: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 7 op/s 2023-05-08T05:01:17.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:01:16 smithi186 ceph-mon[126480]: pgmap v2525: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 7 op/s 2023-05-08T05:01:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:01:18 smithi133 ceph-mon[125939]: pgmap v2526: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 7 op/s 2023-05-08T05:01:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:01:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4617.663603 secs 2023-05-08T05:01:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:01:18 smithi096 ceph-mon[124666]: pgmap v2526: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 7 op/s 2023-05-08T05:01:19.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:01:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4617.663603 secs 2023-05-08T05:01:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:01:18 smithi186 ceph-mon[126480]: pgmap v2526: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 7 op/s 2023-05-08T05:01:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:01:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4617.663603 secs 2023-05-08T05:01:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:01:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4618.220479 secs 2023-05-08T05:01:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:01:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4618.220479 secs 2023-05-08T05:01:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:01:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4618.220479 secs 2023-05-08T05:01:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:01:20 smithi133 ceph-mon[125939]: pgmap v2527: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 6 op/s 2023-05-08T05:01:21.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:01:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4619.501162 secs 2023-05-08T05:01:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:01:20 smithi096 ceph-mon[124666]: pgmap v2527: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 6 op/s 2023-05-08T05:01:21.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:01:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4619.501162 secs 2023-05-08T05:01:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:01:20 smithi186 ceph-mon[126480]: pgmap v2527: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 6 op/s 2023-05-08T05:01:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:01:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4619.501162 secs 2023-05-08T05:01:23.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:01:22 smithi133 ceph-mon[125939]: pgmap v2528: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 6 op/s 2023-05-08T05:01:23.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:01:22 smithi096 ceph-mon[124666]: pgmap v2528: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 6 op/s 2023-05-08T05:01:23.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:01:22 smithi186 ceph-mon[126480]: pgmap v2528: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 6 op/s 2023-05-08T05:01:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:01:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4622.663724 secs 2023-05-08T05:01:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:01:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4622.663724 secs 2023-05-08T05:01:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:01:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4622.663724 secs 2023-05-08T05:01:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:01:24 smithi133 ceph-mon[125939]: pgmap v2529: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 6 op/s 2023-05-08T05:01:25.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:01:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4623.220579 secs 2023-05-08T05:01:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:01:24 smithi096 ceph-mon[124666]: pgmap v2529: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 6 op/s 2023-05-08T05:01:25.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:01:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4623.220579 secs 2023-05-08T05:01:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:01:24 smithi186 ceph-mon[126480]: pgmap v2529: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 6 op/s 2023-05-08T05:01:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:01:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4623.220579 secs 2023-05-08T05:01:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:01:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4624.501282 secs 2023-05-08T05:01:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:01:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4624.501282 secs 2023-05-08T05:01:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:01:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4624.501282 secs 2023-05-08T05:01:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:01:26 smithi133 ceph-mon[125939]: pgmap v2530: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 24 KiB/s wr, 8 op/s 2023-05-08T05:01:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:01:26 smithi096 ceph-mon[124666]: pgmap v2530: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 24 KiB/s wr, 8 op/s 2023-05-08T05:01:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:01:26 smithi186 ceph-mon[126480]: pgmap v2530: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 24 KiB/s wr, 8 op/s 2023-05-08T05:01:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:01:28 smithi133 ceph-mon[125939]: pgmap v2531: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:01:29.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:01:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4627.663875 secs 2023-05-08T05:01:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:01:28 smithi096 ceph-mon[124666]: pgmap v2531: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:01:29.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:01:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4627.663875 secs 2023-05-08T05:01:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:01:28 smithi186 ceph-mon[126480]: pgmap v2531: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:01:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:01:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4627.663875 secs 2023-05-08T05:01:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:01:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4628.220699 secs 2023-05-08T05:01:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:01:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4628.220699 secs 2023-05-08T05:01:30.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:01:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4628.220699 secs 2023-05-08T05:01:31.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:01:30 smithi133 ceph-mon[125939]: pgmap v2532: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T05:01:31.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:01:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4629.501392 secs 2023-05-08T05:01:31.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:01:30 smithi096 ceph-mon[124666]: pgmap v2532: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T05:01:31.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:01:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4629.501392 secs 2023-05-08T05:01:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:01:30 smithi186 ceph-mon[126480]: pgmap v2532: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T05:01:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:01:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4629.501392 secs 2023-05-08T05:01:33.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:01:32 smithi133 ceph-mon[125939]: pgmap v2533: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:01:33.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:01:32 smithi096 ceph-mon[124666]: pgmap v2533: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:01:33.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:01:32 smithi186 ceph-mon[126480]: pgmap v2533: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:01:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:01:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4632.663936 secs 2023-05-08T05:01:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:01:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4632.663936 secs 2023-05-08T05:01:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:01:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4632.663936 secs 2023-05-08T05:01:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:01:34 smithi133 ceph-mon[125939]: pgmap v2534: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:01:35.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:01:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4633.220783 secs 2023-05-08T05:01:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:01:34 smithi096 ceph-mon[124666]: pgmap v2534: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:01:35.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:01:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4633.220783 secs 2023-05-08T05:01:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:01:34 smithi186 ceph-mon[126480]: pgmap v2534: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:01:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:01:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4633.220783 secs 2023-05-08T05:01:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:01:36 smithi133 ceph-mon[125939]: pgmap v2535: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 54 KiB/s wr, 8 op/s 2023-05-08T05:01:37.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:01:36 smithi096 ceph-mon[124666]: pgmap v2535: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 54 KiB/s wr, 8 op/s 2023-05-08T05:01:37.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:01:36 smithi186 ceph-mon[126480]: pgmap v2535: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 54 KiB/s wr, 8 op/s 2023-05-08T05:01:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:01:37 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:01:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:01:37 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:01:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:01:37 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:01:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:01:38 smithi133 ceph-mon[125939]: pgmap v2536: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 54 KiB/s wr, 5 op/s 2023-05-08T05:01:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:01:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4637.664030 secs 2023-05-08T05:01:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:01:38 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:01:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:01:38 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:01:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:01:38 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:01:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:01:38 smithi096 ceph-mon[124666]: pgmap v2536: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 54 KiB/s wr, 5 op/s 2023-05-08T05:01:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:01:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4637.664030 secs 2023-05-08T05:01:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:01:38 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:01:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:01:38 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:01:39.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:01:38 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:01:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:01:38 smithi186 ceph-mon[126480]: pgmap v2536: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 54 KiB/s wr, 5 op/s 2023-05-08T05:01:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:01:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4637.664030 secs 2023-05-08T05:01:39.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:01:38 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:01:39.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:01:38 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:01:39.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:01:38 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:01:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:01:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4638.220857 secs 2023-05-08T05:01:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:01:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4638.220857 secs 2023-05-08T05:01:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:01:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4638.220857 secs 2023-05-08T05:01:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:01:40 smithi133 ceph-mon[125939]: pgmap v2537: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 101 KiB/s wr, 9 op/s 2023-05-08T05:01:41.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:01:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4639.501631 secs 2023-05-08T05:01:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:01:40 smithi096 ceph-mon[124666]: pgmap v2537: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 101 KiB/s wr, 9 op/s 2023-05-08T05:01:41.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:01:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4639.501631 secs 2023-05-08T05:01:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:01:40 smithi186 ceph-mon[126480]: pgmap v2537: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 101 KiB/s wr, 9 op/s 2023-05-08T05:01:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:01:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4639.501631 secs 2023-05-08T05:01:43.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:01:42 smithi133 ceph-mon[125939]: pgmap v2538: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 101 KiB/s wr, 6 op/s 2023-05-08T05:01:43.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:01:42 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:01:43.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:01:42 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:01:43.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:01:42 smithi096 ceph-mon[124666]: pgmap v2538: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 101 KiB/s wr, 6 op/s 2023-05-08T05:01:43.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:01:42 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:01:43.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:01:42 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:01:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:01:42 smithi186 ceph-mon[126480]: pgmap v2538: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 101 KiB/s wr, 6 op/s 2023-05-08T05:01:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:01:42 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:01:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:01:42 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:01:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:01:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4642.664144 secs 2023-05-08T05:01:44.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:01:43 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:01:44.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:01:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4642.664144 secs 2023-05-08T05:01:44.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:01:43 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:01:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:01:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4642.664144 secs 2023-05-08T05:01:44.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:01:43 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:01:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:01:44 smithi096 ceph-mon[124666]: pgmap v2539: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 101 KiB/s wr, 6 op/s 2023-05-08T05:01:45.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:01:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4643.220976 secs 2023-05-08T05:01:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:01:44 smithi186 ceph-mon[126480]: pgmap v2539: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 101 KiB/s wr, 6 op/s 2023-05-08T05:01:45.827 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:01:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4643.220976 secs 2023-05-08T05:01:45.828 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:01:44 smithi133 ceph-mon[125939]: pgmap v2539: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 101 KiB/s wr, 6 op/s 2023-05-08T05:01:45.828 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:01:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4643.220976 secs 2023-05-08T05:01:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:01:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4644.501766 secs 2023-05-08T05:01:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:01:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4644.501766 secs 2023-05-08T05:01:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:01:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4644.501766 secs 2023-05-08T05:01:47.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:01:47 smithi096 ceph-mon[124666]: pgmap v2540: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 124 KiB/s wr, 9 op/s 2023-05-08T05:01:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:01:47 smithi186 ceph-mon[126480]: pgmap v2540: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 124 KiB/s wr, 9 op/s 2023-05-08T05:01:47.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:01:47 smithi133 ceph-mon[125939]: pgmap v2540: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 124 KiB/s wr, 9 op/s 2023-05-08T05:01:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:01:49 smithi186 ceph-mon[126480]: pgmap v2541: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 70 KiB/s wr, 6 op/s 2023-05-08T05:01:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:01:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4647.664276 secs 2023-05-08T05:01:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:01:49 smithi133 ceph-mon[125939]: pgmap v2541: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 70 KiB/s wr, 6 op/s 2023-05-08T05:01:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:01:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4647.664276 secs 2023-05-08T05:01:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:01:49 smithi096 ceph-mon[124666]: pgmap v2541: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 70 KiB/s wr, 6 op/s 2023-05-08T05:01:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:01:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4647.664276 secs 2023-05-08T05:01:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:01:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4648.221096 secs 2023-05-08T05:01:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:01:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4648.221096 secs 2023-05-08T05:01:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:01:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4648.221096 secs 2023-05-08T05:01:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:01:51 smithi186 ceph-mon[126480]: pgmap v2542: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 70 KiB/s wr, 9 op/s 2023-05-08T05:01:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:01:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4649.501882 secs 2023-05-08T05:01:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:01:51 smithi133 ceph-mon[125939]: pgmap v2542: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 70 KiB/s wr, 9 op/s 2023-05-08T05:01:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:01:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4649.501882 secs 2023-05-08T05:01:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:01:51 smithi096 ceph-mon[124666]: pgmap v2542: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 70 KiB/s wr, 9 op/s 2023-05-08T05:01:51.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:01:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4649.501882 secs 2023-05-08T05:01:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:01:53 smithi186 ceph-mon[126480]: pgmap v2543: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 5 op/s 2023-05-08T05:01:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:01:53 smithi133 ceph-mon[125939]: pgmap v2543: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 5 op/s 2023-05-08T05:01:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:01:53 smithi096 ceph-mon[124666]: pgmap v2543: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 5 op/s 2023-05-08T05:01:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:01:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4652.664367 secs 2023-05-08T05:01:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:01:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4652.664367 secs 2023-05-08T05:01:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:01:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4652.664367 secs 2023-05-08T05:01:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:01:55 smithi186 ceph-mon[126480]: pgmap v2544: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 5 op/s 2023-05-08T05:01:55.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:01:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4653.221210 secs 2023-05-08T05:01:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:01:55 smithi133 ceph-mon[125939]: pgmap v2544: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 5 op/s 2023-05-08T05:01:55.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:01:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4653.221210 secs 2023-05-08T05:01:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:01:55 smithi096 ceph-mon[124666]: pgmap v2544: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 5 op/s 2023-05-08T05:01:55.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:01:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4653.221210 secs 2023-05-08T05:01:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:01:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4654.501998 secs 2023-05-08T05:01:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:01:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4654.501998 secs 2023-05-08T05:01:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:01:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4654.501998 secs 2023-05-08T05:01:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:01:57 smithi186 ceph-mon[126480]: pgmap v2545: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 8 op/s 2023-05-08T05:01:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:01:57 smithi133 ceph-mon[125939]: pgmap v2545: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 8 op/s 2023-05-08T05:01:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:01:57 smithi096 ceph-mon[124666]: pgmap v2545: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 8 op/s 2023-05-08T05:01:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:01:59 smithi186 ceph-mon[126480]: pgmap v2546: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:01:59.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:01:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4657.664543 secs 2023-05-08T05:01:59.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:01:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:01:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:01:59 smithi133 ceph-mon[125939]: pgmap v2546: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:01:59.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:01:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4657.664543 secs 2023-05-08T05:01:59.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:01:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:01:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:01:59 smithi096 ceph-mon[124666]: pgmap v2546: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:01:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:01:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4657.664543 secs 2023-05-08T05:01:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:01:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:02:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4658.221330 secs 2023-05-08T05:02:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:02:00.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:02:00.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:02:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4658.221330 secs 2023-05-08T05:02:00.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:02:00.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:02:00.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:02:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4658.221330 secs 2023-05-08T05:02:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:02:00.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:02:00.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:02:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:01 smithi186 ceph-mon[126480]: pgmap v2547: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T05:02:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:01 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:02:01.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:01 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T05:02:01.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:01 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T05:02:01.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:01 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:02:01.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4659.502106 secs 2023-05-08T05:02:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:01 smithi133 ceph-mon[125939]: pgmap v2547: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T05:02:01.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:01 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:02:01.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:01 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T05:02:01.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:01 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T05:02:01.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:01 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:02:01.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4659.502106 secs 2023-05-08T05:02:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:01 smithi096 ceph-mon[124666]: pgmap v2547: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T05:02:01.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:01 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:02:01.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:01 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T05:02:01.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:01 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T05:02:01.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:01 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:02:01.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4659.502106 secs 2023-05-08T05:02:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:03 smithi186 ceph-mon[126480]: pgmap v2548: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:02:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:03 smithi133 ceph-mon[125939]: pgmap v2548: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:02:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:03 smithi096 ceph-mon[124666]: pgmap v2548: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:02:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4662.664615 secs 2023-05-08T05:02:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4662.664615 secs 2023-05-08T05:02:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4662.664615 secs 2023-05-08T05:02:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:05 smithi186 ceph-mon[126480]: pgmap v2549: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:02:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4663.221442 secs 2023-05-08T05:02:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:05 smithi133 ceph-mon[125939]: pgmap v2549: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:02:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4663.221442 secs 2023-05-08T05:02:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:05 smithi096 ceph-mon[124666]: pgmap v2549: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:02:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4663.221442 secs 2023-05-08T05:02:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4664.502222 secs 2023-05-08T05:02:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:06 smithi186 ceph-mon[126480]: osdmap e240: 12 total, 12 up, 12 in 2023-05-08T05:02:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4664.502222 secs 2023-05-08T05:02:06.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:06 smithi133 ceph-mon[125939]: osdmap e240: 12 total, 12 up, 12 in 2023-05-08T05:02:06.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4664.502222 secs 2023-05-08T05:02:06.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:06 smithi096 ceph-mon[124666]: osdmap e240: 12 total, 12 up, 12 in 2023-05-08T05:02:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:07 smithi186 ceph-mon[126480]: pgmap v2551: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 111 KiB/s wr, 24 op/s 2023-05-08T05:02:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:07 smithi133 ceph-mon[125939]: pgmap v2551: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 111 KiB/s wr, 24 op/s 2023-05-08T05:02:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:07 smithi096 ceph-mon[124666]: pgmap v2551: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 111 KiB/s wr, 24 op/s 2023-05-08T05:02:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:09 smithi186 ceph-mon[126480]: pgmap v2552: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 111 KiB/s wr, 25 op/s 2023-05-08T05:02:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4667.664742 secs 2023-05-08T05:02:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:09 smithi133 ceph-mon[125939]: pgmap v2552: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 111 KiB/s wr, 25 op/s 2023-05-08T05:02:09.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4667.664742 secs 2023-05-08T05:02:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:09 smithi096 ceph-mon[124666]: pgmap v2552: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 111 KiB/s wr, 25 op/s 2023-05-08T05:02:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4667.664742 secs 2023-05-08T05:02:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4668.221566 secs 2023-05-08T05:02:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4668.221566 secs 2023-05-08T05:02:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4668.221566 secs 2023-05-08T05:02:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:11 smithi186 ceph-mon[126480]: pgmap v2553: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 112 KiB/s wr, 25 op/s 2023-05-08T05:02:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4669.502360 secs 2023-05-08T05:02:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:11 smithi133 ceph-mon[125939]: pgmap v2553: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 112 KiB/s wr, 25 op/s 2023-05-08T05:02:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4669.502360 secs 2023-05-08T05:02:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:11 smithi096 ceph-mon[124666]: pgmap v2553: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 112 KiB/s wr, 25 op/s 2023-05-08T05:02:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4669.502360 secs 2023-05-08T05:02:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:13 smithi186 ceph-mon[126480]: pgmap v2554: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 112 KiB/s wr, 25 op/s 2023-05-08T05:02:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:13 smithi133 ceph-mon[125939]: pgmap v2554: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 112 KiB/s wr, 25 op/s 2023-05-08T05:02:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:13 smithi096 ceph-mon[124666]: pgmap v2554: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 112 KiB/s wr, 25 op/s 2023-05-08T05:02:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4672.664855 secs 2023-05-08T05:02:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:14 smithi186 ceph-mon[126480]: osdmap e241: 12 total, 12 up, 12 in 2023-05-08T05:02:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4672.664855 secs 2023-05-08T05:02:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:14 smithi133 ceph-mon[125939]: osdmap e241: 12 total, 12 up, 12 in 2023-05-08T05:02:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4672.664855 secs 2023-05-08T05:02:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:14 smithi096 ceph-mon[124666]: osdmap e241: 12 total, 12 up, 12 in 2023-05-08T05:02:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:15 smithi186 ceph-mon[126480]: pgmap v2555: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 112 KiB/s wr, 25 op/s 2023-05-08T05:02:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4673.221689 secs 2023-05-08T05:02:15.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:15 smithi133 ceph-mon[125939]: pgmap v2555: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 112 KiB/s wr, 25 op/s 2023-05-08T05:02:15.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4673.221689 secs 2023-05-08T05:02:15.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:15 smithi096 ceph-mon[124666]: pgmap v2555: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 112 KiB/s wr, 25 op/s 2023-05-08T05:02:15.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4673.221689 secs 2023-05-08T05:02:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4674.502494 secs 2023-05-08T05:02:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4674.502494 secs 2023-05-08T05:02:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4674.502494 secs 2023-05-08T05:02:17.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:17 smithi186 ceph-mon[126480]: pgmap v2557: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 7 op/s 2023-05-08T05:02:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:17 smithi133 ceph-mon[125939]: pgmap v2557: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 7 op/s 2023-05-08T05:02:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:17 smithi096 ceph-mon[124666]: pgmap v2557: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 7 op/s 2023-05-08T05:02:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:19 smithi186 ceph-mon[126480]: pgmap v2558: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 7 op/s 2023-05-08T05:02:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4677.664977 secs 2023-05-08T05:02:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:19 smithi133 ceph-mon[125939]: pgmap v2558: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 7 op/s 2023-05-08T05:02:19.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4677.664977 secs 2023-05-08T05:02:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:19 smithi096 ceph-mon[124666]: pgmap v2558: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 7 op/s 2023-05-08T05:02:19.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4677.664977 secs 2023-05-08T05:02:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4678.221814 secs 2023-05-08T05:02:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4678.221814 secs 2023-05-08T05:02:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4678.221814 secs 2023-05-08T05:02:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:21 smithi186 ceph-mon[126480]: pgmap v2559: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 6 op/s 2023-05-08T05:02:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4679.502556 secs 2023-05-08T05:02:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:21 smithi133 ceph-mon[125939]: pgmap v2559: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 6 op/s 2023-05-08T05:02:21.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4679.502556 secs 2023-05-08T05:02:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:21 smithi096 ceph-mon[124666]: pgmap v2559: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 6 op/s 2023-05-08T05:02:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4679.502556 secs 2023-05-08T05:02:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:23 smithi133 ceph-mon[125939]: pgmap v2560: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 6 op/s 2023-05-08T05:02:23.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:23 smithi096 ceph-mon[124666]: pgmap v2560: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 6 op/s 2023-05-08T05:02:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:23 smithi186 ceph-mon[126480]: pgmap v2560: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 6 op/s 2023-05-08T05:02:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4682.665087 secs 2023-05-08T05:02:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4682.665087 secs 2023-05-08T05:02:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4682.665087 secs 2023-05-08T05:02:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:25 smithi133 ceph-mon[125939]: pgmap v2561: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 6 op/s 2023-05-08T05:02:25.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4683.221952 secs 2023-05-08T05:02:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:25 smithi096 ceph-mon[124666]: pgmap v2561: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 6 op/s 2023-05-08T05:02:25.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4683.221952 secs 2023-05-08T05:02:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:25 smithi186 ceph-mon[126480]: pgmap v2561: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 6 op/s 2023-05-08T05:02:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4683.221952 secs 2023-05-08T05:02:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4684.502694 secs 2023-05-08T05:02:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4684.502694 secs 2023-05-08T05:02:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4684.502694 secs 2023-05-08T05:02:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:27 smithi133 ceph-mon[125939]: pgmap v2562: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 24 KiB/s wr, 8 op/s 2023-05-08T05:02:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:27 smithi096 ceph-mon[124666]: pgmap v2562: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 24 KiB/s wr, 8 op/s 2023-05-08T05:02:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:27 smithi186 ceph-mon[126480]: pgmap v2562: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 24 KiB/s wr, 8 op/s 2023-05-08T05:02:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:29 smithi133 ceph-mon[125939]: pgmap v2563: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:02:29.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4687.665197 secs 2023-05-08T05:02:29.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4688.222028 secs 2023-05-08T05:02:29.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:29 smithi096 ceph-mon[124666]: pgmap v2563: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:02:29.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4687.665197 secs 2023-05-08T05:02:29.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4688.222028 secs 2023-05-08T05:02:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:29 smithi186 ceph-mon[126480]: pgmap v2563: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:02:29.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4687.665197 secs 2023-05-08T05:02:29.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4688.222028 secs 2023-05-08T05:02:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:31 smithi133 ceph-mon[125939]: pgmap v2564: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T05:02:31.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4689.502840 secs 2023-05-08T05:02:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:31 smithi096 ceph-mon[124666]: pgmap v2564: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T05:02:31.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4689.502840 secs 2023-05-08T05:02:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:31 smithi186 ceph-mon[126480]: pgmap v2564: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T05:02:31.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4689.502840 secs 2023-05-08T05:02:33.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:33 smithi133 ceph-mon[125939]: pgmap v2565: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:02:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:33 smithi096 ceph-mon[124666]: pgmap v2565: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:02:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:33 smithi186 ceph-mon[126480]: pgmap v2565: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:02:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4692.665311 secs 2023-05-08T05:02:34.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4693.222149 secs 2023-05-08T05:02:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4692.665311 secs 2023-05-08T05:02:34.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4693.222149 secs 2023-05-08T05:02:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4692.665311 secs 2023-05-08T05:02:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4693.222149 secs 2023-05-08T05:02:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:35 smithi133 ceph-mon[125939]: pgmap v2566: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:02:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:35 smithi096 ceph-mon[124666]: pgmap v2566: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:02:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:35 smithi186 ceph-mon[126480]: pgmap v2566: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:02:37.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:37 smithi133 ceph-mon[125939]: pgmap v2567: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 81 KiB/s wr, 8 op/s 2023-05-08T05:02:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:37 smithi096 ceph-mon[124666]: pgmap v2567: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 81 KiB/s wr, 8 op/s 2023-05-08T05:02:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:37 smithi186 ceph-mon[126480]: pgmap v2567: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 81 KiB/s wr, 8 op/s 2023-05-08T05:02:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:38 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:02:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:38 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:02:38.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:38 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:02:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:39 smithi133 ceph-mon[125939]: pgmap v2568: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 81 KiB/s wr, 6 op/s 2023-05-08T05:02:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4697.665422 secs 2023-05-08T05:02:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:39 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:02:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:39 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:02:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:39 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:02:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4698.222293 secs 2023-05-08T05:02:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:39 smithi096 ceph-mon[124666]: pgmap v2568: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 81 KiB/s wr, 6 op/s 2023-05-08T05:02:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4697.665422 secs 2023-05-08T05:02:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:39 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:02:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:39 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:02:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:39 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:02:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4698.222293 secs 2023-05-08T05:02:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:39 smithi186 ceph-mon[126480]: pgmap v2568: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 81 KiB/s wr, 6 op/s 2023-05-08T05:02:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4697.665422 secs 2023-05-08T05:02:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:39 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:02:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:39 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:02:39.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:39 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:02:39.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4698.222293 secs 2023-05-08T05:02:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:41 smithi133 ceph-mon[125939]: pgmap v2569: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 127 KiB/s wr, 10 op/s 2023-05-08T05:02:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4699.503062 secs 2023-05-08T05:02:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:41 smithi096 ceph-mon[124666]: pgmap v2569: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 127 KiB/s wr, 10 op/s 2023-05-08T05:02:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4699.503062 secs 2023-05-08T05:02:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:41 smithi186 ceph-mon[126480]: pgmap v2569: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 127 KiB/s wr, 10 op/s 2023-05-08T05:02:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4699.503062 secs 2023-05-08T05:02:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:43 smithi133 ceph-mon[125939]: pgmap v2570: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 127 KiB/s wr, 7 op/s 2023-05-08T05:02:43.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:02:43.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:02:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:43 smithi096 ceph-mon[124666]: pgmap v2570: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 127 KiB/s wr, 7 op/s 2023-05-08T05:02:43.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:02:43.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:02:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:43 smithi186 ceph-mon[126480]: pgmap v2570: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 127 KiB/s wr, 7 op/s 2023-05-08T05:02:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:02:43.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:02:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4702.665541 secs 2023-05-08T05:02:44.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4703.222416 secs 2023-05-08T05:02:44.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:44 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:02:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4702.665541 secs 2023-05-08T05:02:44.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4703.222416 secs 2023-05-08T05:02:44.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:44 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:02:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4702.665541 secs 2023-05-08T05:02:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4703.222416 secs 2023-05-08T05:02:44.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:44 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:02:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:45 smithi133 ceph-mon[125939]: pgmap v2571: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 127 KiB/s wr, 7 op/s 2023-05-08T05:02:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:45 smithi096 ceph-mon[124666]: pgmap v2571: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 127 KiB/s wr, 7 op/s 2023-05-08T05:02:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:45 smithi186 ceph-mon[126480]: pgmap v2571: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 127 KiB/s wr, 7 op/s 2023-05-08T05:02:46.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4704.503204 secs 2023-05-08T05:02:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4704.503204 secs 2023-05-08T05:02:46.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4704.503204 secs 2023-05-08T05:02:47.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:47 smithi133 ceph-mon[125939]: pgmap v2572: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 175 KiB/s wr, 11 op/s 2023-05-08T05:02:47.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:47 smithi096 ceph-mon[124666]: pgmap v2572: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 175 KiB/s wr, 11 op/s 2023-05-08T05:02:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:47 smithi186 ceph-mon[126480]: pgmap v2572: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 175 KiB/s wr, 11 op/s 2023-05-08T05:02:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:49 smithi133 ceph-mon[125939]: pgmap v2573: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 94 KiB/s wr, 7 op/s 2023-05-08T05:02:49.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4707.665651 secs 2023-05-08T05:02:49.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4708.222538 secs 2023-05-08T05:02:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:49 smithi096 ceph-mon[124666]: pgmap v2573: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 94 KiB/s wr, 7 op/s 2023-05-08T05:02:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4707.665651 secs 2023-05-08T05:02:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4708.222538 secs 2023-05-08T05:02:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:49 smithi186 ceph-mon[126480]: pgmap v2573: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 94 KiB/s wr, 7 op/s 2023-05-08T05:02:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4707.665651 secs 2023-05-08T05:02:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4708.222538 secs 2023-05-08T05:02:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:51 smithi133 ceph-mon[125939]: pgmap v2574: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 94 KiB/s wr, 10 op/s 2023-05-08T05:02:51.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4709.503344 secs 2023-05-08T05:02:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:51 smithi096 ceph-mon[124666]: pgmap v2574: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 94 KiB/s wr, 10 op/s 2023-05-08T05:02:51.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4709.503344 secs 2023-05-08T05:02:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:51 smithi186 ceph-mon[126480]: pgmap v2574: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 94 KiB/s wr, 10 op/s 2023-05-08T05:02:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4709.503344 secs 2023-05-08T05:02:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:53 smithi133 ceph-mon[125939]: pgmap v2575: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 49 KiB/s wr, 6 op/s 2023-05-08T05:02:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:53 smithi096 ceph-mon[124666]: pgmap v2575: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 49 KiB/s wr, 6 op/s 2023-05-08T05:02:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:53 smithi186 ceph-mon[126480]: pgmap v2575: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 49 KiB/s wr, 6 op/s 2023-05-08T05:02:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4712.665755 secs 2023-05-08T05:02:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4713.222603 secs 2023-05-08T05:02:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4712.665755 secs 2023-05-08T05:02:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4713.222603 secs 2023-05-08T05:02:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4712.665755 secs 2023-05-08T05:02:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4713.222603 secs 2023-05-08T05:02:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:55 smithi133 ceph-mon[125939]: pgmap v2576: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 49 KiB/s wr, 6 op/s 2023-05-08T05:02:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:55 smithi096 ceph-mon[124666]: pgmap v2576: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 49 KiB/s wr, 6 op/s 2023-05-08T05:02:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:55 smithi186 ceph-mon[126480]: pgmap v2576: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 49 KiB/s wr, 6 op/s 2023-05-08T05:02:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4714.503490 secs 2023-05-08T05:02:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4714.503490 secs 2023-05-08T05:02:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4714.503490 secs 2023-05-08T05:02:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:57 smithi133 ceph-mon[125939]: pgmap v2577: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 49 KiB/s wr, 9 op/s 2023-05-08T05:02:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:57 smithi096 ceph-mon[124666]: pgmap v2577: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 49 KiB/s wr, 9 op/s 2023-05-08T05:02:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:57 smithi186 ceph-mon[126480]: pgmap v2577: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 49 KiB/s wr, 9 op/s 2023-05-08T05:02:59.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:59 smithi133 ceph-mon[125939]: pgmap v2578: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:02:59.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4717.665876 secs 2023-05-08T05:02:59.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:02:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4718.222653 secs 2023-05-08T05:02:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:59 smithi096 ceph-mon[124666]: pgmap v2578: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:02:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4717.665876 secs 2023-05-08T05:02:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:02:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4718.222653 secs 2023-05-08T05:02:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:59 smithi186 ceph-mon[126480]: pgmap v2578: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:02:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4717.665876 secs 2023-05-08T05:02:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:02:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4718.222653 secs 2023-05-08T05:03:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:03:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:03:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:03:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:01 smithi133 ceph-mon[125939]: pgmap v2579: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T05:03:01.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4719.503597 secs 2023-05-08T05:03:01.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:01 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:03:01.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:01 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:03:01.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:01 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:03:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:01 smithi096 ceph-mon[124666]: pgmap v2579: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T05:03:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4719.503597 secs 2023-05-08T05:03:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:01 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:03:01.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:01 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:03:01.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:01 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:03:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:01 smithi186 ceph-mon[126480]: pgmap v2579: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T05:03:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4719.503597 secs 2023-05-08T05:03:01.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:01 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:03:01.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:01 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:03:01.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:01 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:03:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:02 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:03:02.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:02 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T05:03:02.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:02 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T05:03:02.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:02 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:03:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:02 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:03:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:02 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T05:03:02.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:02 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T05:03:02.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:02 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:03:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:02 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:03:02.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:02 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T05:03:02.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:02 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T05:03:02.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:02 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:03:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:03 smithi096 ceph-mon[124666]: pgmap v2580: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:03:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:03 smithi186 ceph-mon[126480]: pgmap v2580: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:03:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:03 smithi133 ceph-mon[125939]: pgmap v2580: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:03:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4722.665991 secs 2023-05-08T05:03:04.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4723.222767 secs 2023-05-08T05:03:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4722.665991 secs 2023-05-08T05:03:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4723.222767 secs 2023-05-08T05:03:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4722.665991 secs 2023-05-08T05:03:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4723.222767 secs 2023-05-08T05:03:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:05 smithi096 ceph-mon[124666]: pgmap v2581: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:03:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:05 smithi186 ceph-mon[126480]: pgmap v2581: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:03:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:05 smithi133 ceph-mon[125939]: pgmap v2581: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:03:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4724.503747 secs 2023-05-08T05:03:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:06 smithi186 ceph-mon[126480]: osdmap e242: 12 total, 12 up, 12 in 2023-05-08T05:03:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4724.503747 secs 2023-05-08T05:03:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:06 smithi133 ceph-mon[125939]: osdmap e242: 12 total, 12 up, 12 in 2023-05-08T05:03:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4724.503747 secs 2023-05-08T05:03:06.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:06 smithi096 ceph-mon[124666]: osdmap e242: 12 total, 12 up, 12 in 2023-05-08T05:03:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:07 smithi186 ceph-mon[126480]: pgmap v2583: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 111 KiB/s wr, 25 op/s 2023-05-08T05:03:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:07 smithi133 ceph-mon[125939]: pgmap v2583: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 111 KiB/s wr, 25 op/s 2023-05-08T05:03:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:07 smithi096 ceph-mon[124666]: pgmap v2583: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 111 KiB/s wr, 25 op/s 2023-05-08T05:03:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:08 smithi186 ceph-mon[126480]: pgmap v2584: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 111 KiB/s wr, 25 op/s 2023-05-08T05:03:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:08 smithi133 ceph-mon[125939]: pgmap v2584: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 111 KiB/s wr, 25 op/s 2023-05-08T05:03:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:08 smithi096 ceph-mon[124666]: pgmap v2584: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 111 KiB/s wr, 25 op/s 2023-05-08T05:03:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4727.666137 secs 2023-05-08T05:03:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4728.222891 secs 2023-05-08T05:03:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4727.666137 secs 2023-05-08T05:03:09.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4728.222891 secs 2023-05-08T05:03:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4727.666137 secs 2023-05-08T05:03:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4728.222891 secs 2023-05-08T05:03:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:10 smithi186 ceph-mon[126480]: pgmap v2585: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 112 KiB/s wr, 25 op/s 2023-05-08T05:03:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:10 smithi133 ceph-mon[125939]: pgmap v2585: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 112 KiB/s wr, 25 op/s 2023-05-08T05:03:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:10 smithi096 ceph-mon[124666]: pgmap v2585: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 112 KiB/s wr, 25 op/s 2023-05-08T05:03:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4729.503867 secs 2023-05-08T05:03:11.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4729.503867 secs 2023-05-08T05:03:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4729.503867 secs 2023-05-08T05:03:12.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:12 smithi186 ceph-mon[126480]: pgmap v2586: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 112 KiB/s wr, 25 op/s 2023-05-08T05:03:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:12 smithi133 ceph-mon[125939]: pgmap v2586: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 112 KiB/s wr, 25 op/s 2023-05-08T05:03:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:12 smithi096 ceph-mon[124666]: pgmap v2586: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 112 KiB/s wr, 25 op/s 2023-05-08T05:03:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4732.666251 secs 2023-05-08T05:03:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:14 smithi096 ceph-mon[124666]: pgmap v2587: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 112 KiB/s wr, 25 op/s 2023-05-08T05:03:14.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4733.222968 secs 2023-05-08T05:03:14.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:14 smithi096 ceph-mon[124666]: osdmap e243: 12 total, 12 up, 12 in 2023-05-08T05:03:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4732.666251 secs 2023-05-08T05:03:14.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:14 smithi186 ceph-mon[126480]: pgmap v2587: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 112 KiB/s wr, 25 op/s 2023-05-08T05:03:14.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4733.222968 secs 2023-05-08T05:03:14.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:14 smithi186 ceph-mon[126480]: osdmap e243: 12 total, 12 up, 12 in 2023-05-08T05:03:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4732.666251 secs 2023-05-08T05:03:14.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:14 smithi133 ceph-mon[125939]: pgmap v2587: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 112 KiB/s wr, 25 op/s 2023-05-08T05:03:14.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4733.222968 secs 2023-05-08T05:03:14.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:14 smithi133 ceph-mon[125939]: osdmap e243: 12 total, 12 up, 12 in 2023-05-08T05:03:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4734.503947 secs 2023-05-08T05:03:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4734.503947 secs 2023-05-08T05:03:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4734.503947 secs 2023-05-08T05:03:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:16 smithi186 ceph-mon[126480]: pgmap v2589: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 7 op/s 2023-05-08T05:03:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:16 smithi133 ceph-mon[125939]: pgmap v2589: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 7 op/s 2023-05-08T05:03:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:16 smithi096 ceph-mon[124666]: pgmap v2589: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 7 op/s 2023-05-08T05:03:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:18 smithi186 ceph-mon[126480]: pgmap v2590: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 7 op/s 2023-05-08T05:03:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:18 smithi133 ceph-mon[125939]: pgmap v2590: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 7 op/s 2023-05-08T05:03:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:18 smithi096 ceph-mon[124666]: pgmap v2590: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 7 op/s 2023-05-08T05:03:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4737.666389 secs 2023-05-08T05:03:19.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4738.223109 secs 2023-05-08T05:03:19.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4737.666389 secs 2023-05-08T05:03:19.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4738.223109 secs 2023-05-08T05:03:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4737.666389 secs 2023-05-08T05:03:20.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4738.223109 secs 2023-05-08T05:03:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:20 smithi096 ceph-mon[124666]: pgmap v2591: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 6 op/s 2023-05-08T05:03:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4739.504065 secs 2023-05-08T05:03:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:20 smithi186 ceph-mon[126480]: pgmap v2591: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 6 op/s 2023-05-08T05:03:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4739.504065 secs 2023-05-08T05:03:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:20 smithi133 ceph-mon[125939]: pgmap v2591: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 6 op/s 2023-05-08T05:03:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4739.504065 secs 2023-05-08T05:03:23.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:22 smithi096 ceph-mon[124666]: pgmap v2592: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 6 op/s 2023-05-08T05:03:23.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:22 smithi186 ceph-mon[126480]: pgmap v2592: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 6 op/s 2023-05-08T05:03:23.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:22 smithi133 ceph-mon[125939]: pgmap v2592: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 6 op/s 2023-05-08T05:03:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4742.666468 secs 2023-05-08T05:03:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4742.666468 secs 2023-05-08T05:03:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4742.666468 secs 2023-05-08T05:03:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:24 smithi096 ceph-mon[124666]: pgmap v2593: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 6 op/s 2023-05-08T05:03:25.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4743.223228 secs 2023-05-08T05:03:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:24 smithi186 ceph-mon[126480]: pgmap v2593: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 6 op/s 2023-05-08T05:03:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4743.223228 secs 2023-05-08T05:03:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:24 smithi133 ceph-mon[125939]: pgmap v2593: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 6 op/s 2023-05-08T05:03:25.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4743.223228 secs 2023-05-08T05:03:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4744.504145 secs 2023-05-08T05:03:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4744.504145 secs 2023-05-08T05:03:26.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4744.504145 secs 2023-05-08T05:03:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:26 smithi186 ceph-mon[126480]: pgmap v2594: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 8 op/s 2023-05-08T05:03:27.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:26 smithi133 ceph-mon[125939]: pgmap v2594: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 8 op/s 2023-05-08T05:03:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:26 smithi096 ceph-mon[124666]: pgmap v2594: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 8 op/s 2023-05-08T05:03:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:28 smithi186 ceph-mon[126480]: pgmap v2595: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:03:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4747.666580 secs 2023-05-08T05:03:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:28 smithi133 ceph-mon[125939]: pgmap v2595: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:03:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4747.666580 secs 2023-05-08T05:03:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:28 smithi096 ceph-mon[124666]: pgmap v2595: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:03:29.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4747.666580 secs 2023-05-08T05:03:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4748.223356 secs 2023-05-08T05:03:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4748.223356 secs 2023-05-08T05:03:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4748.223356 secs 2023-05-08T05:03:31.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:30 smithi186 ceph-mon[126480]: pgmap v2596: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T05:03:31.170 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4749.504226 secs 2023-05-08T05:03:31.247 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:30 smithi133 ceph-mon[125939]: pgmap v2596: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T05:03:31.247 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4749.504226 secs 2023-05-08T05:03:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:30 smithi096 ceph-mon[124666]: pgmap v2596: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T05:03:31.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4749.504226 secs 2023-05-08T05:03:33.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:32 smithi186 ceph-mon[126480]: pgmap v2597: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:03:33.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:32 smithi133 ceph-mon[125939]: pgmap v2597: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:03:33.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:32 smithi096 ceph-mon[124666]: pgmap v2597: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:03:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4752.666700 secs 2023-05-08T05:03:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4752.666700 secs 2023-05-08T05:03:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4752.666700 secs 2023-05-08T05:03:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:34 smithi186 ceph-mon[126480]: pgmap v2598: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:03:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4753.223509 secs 2023-05-08T05:03:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:34 smithi133 ceph-mon[125939]: pgmap v2598: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:03:35.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4753.223509 secs 2023-05-08T05:03:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:34 smithi096 ceph-mon[124666]: pgmap v2598: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:03:35.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4753.223509 secs 2023-05-08T05:03:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:36 smithi186 ceph-mon[126480]: pgmap v2599: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 105 KiB/s wr, 8 op/s 2023-05-08T05:03:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:36 smithi133 ceph-mon[125939]: pgmap v2599: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 105 KiB/s wr, 8 op/s 2023-05-08T05:03:37.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:36 smithi096 ceph-mon[124666]: pgmap v2599: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 105 KiB/s wr, 8 op/s 2023-05-08T05:03:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:37 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:03:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:37 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:03:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:37 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:03:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:38 smithi186 ceph-mon[126480]: pgmap v2600: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 105 KiB/s wr, 6 op/s 2023-05-08T05:03:39.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:38 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:03:39.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:38 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:03:39.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:38 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:03:39.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4757.666823 secs 2023-05-08T05:03:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:38 smithi133 ceph-mon[125939]: pgmap v2600: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 105 KiB/s wr, 6 op/s 2023-05-08T05:03:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:38 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:03:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:38 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:03:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:38 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:03:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4757.666823 secs 2023-05-08T05:03:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:38 smithi096 ceph-mon[124666]: pgmap v2600: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 105 KiB/s wr, 6 op/s 2023-05-08T05:03:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:38 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:03:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:38 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:03:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:38 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:03:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4757.666823 secs 2023-05-08T05:03:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4758.223572 secs 2023-05-08T05:03:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4758.223572 secs 2023-05-08T05:03:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4758.223572 secs 2023-05-08T05:03:41.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:40 smithi186 ceph-mon[126480]: pgmap v2601: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 106 KiB/s wr, 10 op/s 2023-05-08T05:03:41.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4759.504498 secs 2023-05-08T05:03:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:40 smithi133 ceph-mon[125939]: pgmap v2601: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 106 KiB/s wr, 10 op/s 2023-05-08T05:03:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4759.504498 secs 2023-05-08T05:03:41.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:40 smithi096 ceph-mon[124666]: pgmap v2601: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 106 KiB/s wr, 10 op/s 2023-05-08T05:03:41.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4759.504498 secs 2023-05-08T05:03:43.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:42 smithi186 ceph-mon[126480]: pgmap v2602: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 106 KiB/s wr, 7 op/s 2023-05-08T05:03:43.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:42 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:03:43.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:42 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:03:43.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:42 smithi133 ceph-mon[125939]: pgmap v2602: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 106 KiB/s wr, 7 op/s 2023-05-08T05:03:43.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:42 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:03:43.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:42 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:03:43.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:42 smithi096 ceph-mon[124666]: pgmap v2602: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 106 KiB/s wr, 7 op/s 2023-05-08T05:03:43.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:42 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:03:43.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:42 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:03:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4762.666953 secs 2023-05-08T05:03:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:43 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:03:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4762.666953 secs 2023-05-08T05:03:44.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:43 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:03:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4762.666953 secs 2023-05-08T05:03:44.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:43 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:03:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:44 smithi186 ceph-mon[126480]: pgmap v2603: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 106 KiB/s wr, 7 op/s 2023-05-08T05:03:45.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4763.223737 secs 2023-05-08T05:03:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:44 smithi133 ceph-mon[125939]: pgmap v2603: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 106 KiB/s wr, 7 op/s 2023-05-08T05:03:45.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4763.223737 secs 2023-05-08T05:03:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:44 smithi096 ceph-mon[124666]: pgmap v2603: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 106 KiB/s wr, 7 op/s 2023-05-08T05:03:45.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4763.223737 secs 2023-05-08T05:03:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4764.504633 secs 2023-05-08T05:03:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4764.504633 secs 2023-05-08T05:03:46.294 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4764.504633 secs 2023-05-08T05:03:47.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:46 smithi186 ceph-mon[126480]: pgmap v2604: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 161 KiB/s wr, 11 op/s 2023-05-08T05:03:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:46 smithi133 ceph-mon[125939]: pgmap v2604: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 161 KiB/s wr, 11 op/s 2023-05-08T05:03:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:46 smithi096 ceph-mon[124666]: pgmap v2604: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 161 KiB/s wr, 11 op/s 2023-05-08T05:03:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:48 smithi186 ceph-mon[126480]: pgmap v2605: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 56 KiB/s wr, 7 op/s 2023-05-08T05:03:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4767.667093 secs 2023-05-08T05:03:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:48 smithi133 ceph-mon[125939]: pgmap v2605: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 56 KiB/s wr, 7 op/s 2023-05-08T05:03:49.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4767.667093 secs 2023-05-08T05:03:49.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:48 smithi096 ceph-mon[124666]: pgmap v2605: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 56 KiB/s wr, 7 op/s 2023-05-08T05:03:49.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4767.667093 secs 2023-05-08T05:03:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4768.223856 secs 2023-05-08T05:03:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4768.223856 secs 2023-05-08T05:03:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4768.223856 secs 2023-05-08T05:03:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:50 smithi186 ceph-mon[126480]: pgmap v2606: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 56 KiB/s wr, 10 op/s 2023-05-08T05:03:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4769.504768 secs 2023-05-08T05:03:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:50 smithi133 ceph-mon[125939]: pgmap v2606: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 56 KiB/s wr, 10 op/s 2023-05-08T05:03:51.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4769.504768 secs 2023-05-08T05:03:51.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:50 smithi096 ceph-mon[124666]: pgmap v2606: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 56 KiB/s wr, 10 op/s 2023-05-08T05:03:51.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4769.504768 secs 2023-05-08T05:03:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:52 smithi186 ceph-mon[126480]: pgmap v2607: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 55 KiB/s wr, 6 op/s 2023-05-08T05:03:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:52 smithi133 ceph-mon[125939]: pgmap v2607: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 55 KiB/s wr, 6 op/s 2023-05-08T05:03:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:52 smithi096 ceph-mon[124666]: pgmap v2607: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 55 KiB/s wr, 6 op/s 2023-05-08T05:03:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4772.667233 secs 2023-05-08T05:03:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4772.667233 secs 2023-05-08T05:03:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4772.667233 secs 2023-05-08T05:03:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:54 smithi186 ceph-mon[126480]: pgmap v2608: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 55 KiB/s wr, 6 op/s 2023-05-08T05:03:55.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4773.223979 secs 2023-05-08T05:03:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:54 smithi133 ceph-mon[125939]: pgmap v2608: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 55 KiB/s wr, 6 op/s 2023-05-08T05:03:55.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4773.223979 secs 2023-05-08T05:03:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:54 smithi096 ceph-mon[124666]: pgmap v2608: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 55 KiB/s wr, 6 op/s 2023-05-08T05:03:55.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4773.223979 secs 2023-05-08T05:03:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4774.504852 secs 2023-05-08T05:03:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4774.504852 secs 2023-05-08T05:03:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4774.504852 secs 2023-05-08T05:03:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:56 smithi186 ceph-mon[126480]: pgmap v2609: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 55 KiB/s wr, 9 op/s 2023-05-08T05:03:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:56 smithi133 ceph-mon[125939]: pgmap v2609: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 55 KiB/s wr, 9 op/s 2023-05-08T05:03:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:56 smithi096 ceph-mon[124666]: pgmap v2609: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 55 KiB/s wr, 9 op/s 2023-05-08T05:03:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:58 smithi186 ceph-mon[126480]: pgmap v2610: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:03:59.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4777.667366 secs 2023-05-08T05:03:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:58 smithi133 ceph-mon[125939]: pgmap v2610: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:03:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4777.667366 secs 2023-05-08T05:03:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:58 smithi096 ceph-mon[124666]: pgmap v2610: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:03:59.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4777.667366 secs 2023-05-08T05:04:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:03:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4778.224071 secs 2023-05-08T05:04:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:03:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4778.224071 secs 2023-05-08T05:04:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:03:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4778.224071 secs 2023-05-08T05:04:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:00 smithi133 ceph-mon[125939]: pgmap v2611: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T05:04:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4779.504974 secs 2023-05-08T05:04:01.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:04:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:00 smithi096 ceph-mon[124666]: pgmap v2611: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T05:04:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4779.504974 secs 2023-05-08T05:04:01.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:04:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:00 smithi186 ceph-mon[126480]: pgmap v2611: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T05:04:01.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4779.504974 secs 2023-05-08T05:04:01.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:04:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:02 smithi133 ceph-mon[125939]: pgmap v2612: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:04:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:02 smithi096 ceph-mon[124666]: pgmap v2612: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:04:03.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:02 smithi186 ceph-mon[126480]: pgmap v2612: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:04:04.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4782.667459 secs 2023-05-08T05:04:04.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:04 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:04:04.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:04 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:04:04.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:04 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:04:04.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:04 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:04:04.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:04 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:04:04.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:04 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:04:04.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:04 smithi186 ceph-mon[126480]: pgmap v2613: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:04:04.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4783.224170 secs 2023-05-08T05:04:04.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:04 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:04:04.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:04 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:04:04.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:04 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:04:04.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:04 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:04:04.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:04 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T05:04:04.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:04 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T05:04:04.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:04 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:04:04.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:04 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:04:04.623 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:04 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:04:04.623 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:04 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:04:04.623 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:04 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:04:04.623 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:04 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:04:04.623 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:04 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:04:04.623 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:04 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:04:04.623 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:04 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi096 to 196.2M 2023-05-08T05:04:04.624 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:04 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T05:04:04.624 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:04 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi096 to 205766758: error parsing value: Value '205766758' is below minimum 939524096 2023-05-08T05:04:04.624 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:04 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T05:04:04.624 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:04 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:04:04.624 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:04 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:04:04.624 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:04 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:04:04.625 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:04 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:04:04.625 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:04 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T05:04:04.625 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:04 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T05:04:04.625 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:04 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:04:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4782.667459 secs 2023-05-08T05:04:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:04 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:04:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:04 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:04:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:04 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:04:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:04 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:04:04.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:04 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:04:04.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:04 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:04:04.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:04 smithi133 ceph-mon[125939]: pgmap v2613: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:04:04.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4783.224170 secs 2023-05-08T05:04:04.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:04 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:04:04.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:04 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:04:04.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:04 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:04:04.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:04 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:04:04.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:04 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T05:04:04.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:04 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T05:04:04.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:04 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:04:04.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:04 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:04:04.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:04 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:04:04.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:04 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:04:04.744 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:04 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:04:04.744 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:04 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:04:04.744 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:04 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:04:04.744 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:04 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:04:04.744 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:04 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi096 to 196.2M 2023-05-08T05:04:04.744 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:04 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T05:04:04.744 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:04 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi096 to 205766758: error parsing value: Value '205766758' is below minimum 939524096 2023-05-08T05:04:04.745 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:04 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T05:04:04.745 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:04 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:04:04.745 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:04 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:04:04.745 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:04 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:04:04.745 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:04 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:04:04.745 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:04 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T05:04:04.745 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:04 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T05:04:04.745 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:04 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:04:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4782.667459 secs 2023-05-08T05:04:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:04 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:04:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:04 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:04:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:04 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:04:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:04 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:04:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:04 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:04:04.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:04 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:04:04.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:04 smithi096 ceph-mon[124666]: pgmap v2613: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:04:04.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4783.224170 secs 2023-05-08T05:04:04.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:04 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:04:04.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:04 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:04:04.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:04 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:04:04.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:04 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:04:04.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:04 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T05:04:04.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:04 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T05:04:04.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:04 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:04:04.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:04 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:04:04.759 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:04 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:04:04.759 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:04 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:04:04.759 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:04 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:04:04.759 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:04 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:04:04.759 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:04 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:04:04.759 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:04 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:04:04.759 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:04 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi096 to 196.2M 2023-05-08T05:04:04.759 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:04 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T05:04:04.760 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:04 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi096 to 205766758: error parsing value: Value '205766758' is below minimum 939524096 2023-05-08T05:04:04.760 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:04 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T05:04:04.760 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:04 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:04:04.760 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:04 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:04:04.760 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:04 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:04:04.760 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:04 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:04:04.760 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:04 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T05:04:04.761 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:04 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T05:04:04.761 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:04 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:04:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4784.505122 secs 2023-05-08T05:04:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:06 smithi133 ceph-mon[125939]: osdmap e244: 12 total, 12 up, 12 in 2023-05-08T05:04:06.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:06 smithi133 ceph-mon[125939]: pgmap v2615: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 112 KiB/s wr, 25 op/s 2023-05-08T05:04:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4784.505122 secs 2023-05-08T05:04:06.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:06 smithi096 ceph-mon[124666]: osdmap e244: 12 total, 12 up, 12 in 2023-05-08T05:04:06.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:06 smithi096 ceph-mon[124666]: pgmap v2615: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 112 KiB/s wr, 25 op/s 2023-05-08T05:04:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4784.505122 secs 2023-05-08T05:04:06.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:06 smithi186 ceph-mon[126480]: osdmap e244: 12 total, 12 up, 12 in 2023-05-08T05:04:06.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:06 smithi186 ceph-mon[126480]: pgmap v2615: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 112 KiB/s wr, 25 op/s 2023-05-08T05:04:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:08 smithi186 ceph-mon[126480]: pgmap v2616: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 112 KiB/s wr, 25 op/s 2023-05-08T05:04:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:08 smithi133 ceph-mon[125939]: pgmap v2616: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 112 KiB/s wr, 25 op/s 2023-05-08T05:04:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:08 smithi096 ceph-mon[124666]: pgmap v2616: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 112 KiB/s wr, 25 op/s 2023-05-08T05:04:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4787.667597 secs 2023-05-08T05:04:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4788.224302 secs 2023-05-08T05:04:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4787.667597 secs 2023-05-08T05:04:09.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4788.224302 secs 2023-05-08T05:04:10.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4787.667597 secs 2023-05-08T05:04:10.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4788.224302 secs 2023-05-08T05:04:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:10 smithi186 ceph-mon[126480]: pgmap v2617: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 113 KiB/s wr, 25 op/s 2023-05-08T05:04:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4789.505234 secs 2023-05-08T05:04:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:10 smithi133 ceph-mon[125939]: pgmap v2617: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 113 KiB/s wr, 25 op/s 2023-05-08T05:04:11.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4789.505234 secs 2023-05-08T05:04:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:10 smithi096 ceph-mon[124666]: pgmap v2617: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 113 KiB/s wr, 25 op/s 2023-05-08T05:04:11.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4789.505234 secs 2023-05-08T05:04:13.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:12 smithi186 ceph-mon[126480]: pgmap v2618: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 113 KiB/s wr, 25 op/s 2023-05-08T05:04:13.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:12 smithi133 ceph-mon[125939]: pgmap v2618: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 113 KiB/s wr, 25 op/s 2023-05-08T05:04:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:12 smithi096 ceph-mon[124666]: pgmap v2618: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 113 KiB/s wr, 25 op/s 2023-05-08T05:04:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4792.667708 secs 2023-05-08T05:04:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:13 smithi186 ceph-mon[126480]: osdmap e245: 12 total, 12 up, 12 in 2023-05-08T05:04:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4792.667708 secs 2023-05-08T05:04:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:13 smithi133 ceph-mon[125939]: osdmap e245: 12 total, 12 up, 12 in 2023-05-08T05:04:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4792.667708 secs 2023-05-08T05:04:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:13 smithi096 ceph-mon[124666]: osdmap e245: 12 total, 12 up, 12 in 2023-05-08T05:04:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:14 smithi186 ceph-mon[126480]: pgmap v2619: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 113 KiB/s wr, 25 op/s 2023-05-08T05:04:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4793.224408 secs 2023-05-08T05:04:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:14 smithi133 ceph-mon[125939]: pgmap v2619: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 113 KiB/s wr, 25 op/s 2023-05-08T05:04:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4793.224408 secs 2023-05-08T05:04:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:14 smithi096 ceph-mon[124666]: pgmap v2619: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 113 KiB/s wr, 25 op/s 2023-05-08T05:04:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4793.224408 secs 2023-05-08T05:04:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4794.505352 secs 2023-05-08T05:04:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4794.505352 secs 2023-05-08T05:04:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4794.505352 secs 2023-05-08T05:04:17.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:16 smithi186 ceph-mon[126480]: pgmap v2621: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 7 op/s 2023-05-08T05:04:17.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:16 smithi133 ceph-mon[125939]: pgmap v2621: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 7 op/s 2023-05-08T05:04:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:16 smithi096 ceph-mon[124666]: pgmap v2621: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 7 op/s 2023-05-08T05:04:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:18 smithi186 ceph-mon[126480]: pgmap v2622: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 7 op/s 2023-05-08T05:04:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4797.667823 secs 2023-05-08T05:04:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:18 smithi133 ceph-mon[125939]: pgmap v2622: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 7 op/s 2023-05-08T05:04:19.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4797.667823 secs 2023-05-08T05:04:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:18 smithi096 ceph-mon[124666]: pgmap v2622: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 7 op/s 2023-05-08T05:04:19.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4797.667823 secs 2023-05-08T05:04:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4798.224537 secs 2023-05-08T05:04:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4798.224537 secs 2023-05-08T05:04:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4798.224537 secs 2023-05-08T05:04:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:20 smithi186 ceph-mon[126480]: pgmap v2623: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 6 op/s 2023-05-08T05:04:21.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4799.505468 secs 2023-05-08T05:04:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:20 smithi133 ceph-mon[125939]: pgmap v2623: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 6 op/s 2023-05-08T05:04:21.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4799.505468 secs 2023-05-08T05:04:21.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:20 smithi096 ceph-mon[124666]: pgmap v2623: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 6 op/s 2023-05-08T05:04:21.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4799.505468 secs 2023-05-08T05:04:23.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:22 smithi186 ceph-mon[126480]: pgmap v2624: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 6 op/s 2023-05-08T05:04:23.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:22 smithi133 ceph-mon[125939]: pgmap v2624: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 6 op/s 2023-05-08T05:04:23.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:22 smithi096 ceph-mon[124666]: pgmap v2624: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 6 op/s 2023-05-08T05:04:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4802.667949 secs 2023-05-08T05:04:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4802.667949 secs 2023-05-08T05:04:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4802.667949 secs 2023-05-08T05:04:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:24 smithi186 ceph-mon[126480]: pgmap v2625: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 6 op/s 2023-05-08T05:04:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4803.224671 secs 2023-05-08T05:04:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:24 smithi133 ceph-mon[125939]: pgmap v2625: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 6 op/s 2023-05-08T05:04:25.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4803.224671 secs 2023-05-08T05:04:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:24 smithi096 ceph-mon[124666]: pgmap v2625: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 6 op/s 2023-05-08T05:04:25.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4803.224671 secs 2023-05-08T05:04:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4804.505614 secs 2023-05-08T05:04:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4804.505614 secs 2023-05-08T05:04:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4804.505614 secs 2023-05-08T05:04:27.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:26 smithi186 ceph-mon[126480]: pgmap v2626: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 25 KiB/s wr, 8 op/s 2023-05-08T05:04:27.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:26 smithi133 ceph-mon[125939]: pgmap v2626: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 25 KiB/s wr, 8 op/s 2023-05-08T05:04:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:26 smithi096 ceph-mon[124666]: pgmap v2626: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 25 KiB/s wr, 8 op/s 2023-05-08T05:04:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:28 smithi186 ceph-mon[126480]: pgmap v2627: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:04:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4807.668084 secs 2023-05-08T05:04:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:28 smithi133 ceph-mon[125939]: pgmap v2627: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:04:29.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4807.668084 secs 2023-05-08T05:04:29.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:28 smithi096 ceph-mon[124666]: pgmap v2627: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:04:29.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4807.668084 secs 2023-05-08T05:04:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4808.224751 secs 2023-05-08T05:04:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4808.224751 secs 2023-05-08T05:04:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4808.224751 secs 2023-05-08T05:04:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:30 smithi186 ceph-mon[126480]: pgmap v2628: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T05:04:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4809.505751 secs 2023-05-08T05:04:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:30 smithi133 ceph-mon[125939]: pgmap v2628: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T05:04:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4809.505751 secs 2023-05-08T05:04:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:30 smithi096 ceph-mon[124666]: pgmap v2628: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T05:04:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4809.505751 secs 2023-05-08T05:04:33.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:32 smithi186 ceph-mon[126480]: pgmap v2629: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:04:33.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:32 smithi133 ceph-mon[125939]: pgmap v2629: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:04:33.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:32 smithi096 ceph-mon[124666]: pgmap v2629: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:04:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4812.668201 secs 2023-05-08T05:04:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4812.668201 secs 2023-05-08T05:04:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4812.668201 secs 2023-05-08T05:04:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:34 smithi186 ceph-mon[126480]: pgmap v2630: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:04:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4813.224903 secs 2023-05-08T05:04:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:34 smithi133 ceph-mon[125939]: pgmap v2630: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:04:35.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4813.224903 secs 2023-05-08T05:04:35.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:34 smithi096 ceph-mon[124666]: pgmap v2630: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:04:35.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4813.224903 secs 2023-05-08T05:04:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:36 smithi186 ceph-mon[126480]: pgmap v2631: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 56 KiB/s wr, 8 op/s 2023-05-08T05:04:37.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:36 smithi133 ceph-mon[125939]: pgmap v2631: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 56 KiB/s wr, 8 op/s 2023-05-08T05:04:37.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:36 smithi096 ceph-mon[124666]: pgmap v2631: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 56 KiB/s wr, 8 op/s 2023-05-08T05:04:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:37 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:04:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:37 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:04:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:37 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:04:39.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:38 smithi186 ceph-mon[126480]: pgmap v2632: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 56 KiB/s wr, 6 op/s 2023-05-08T05:04:39.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:38 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:04:39.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:38 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:04:39.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:38 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:04:39.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4817.668317 secs 2023-05-08T05:04:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:38 smithi133 ceph-mon[125939]: pgmap v2632: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 56 KiB/s wr, 6 op/s 2023-05-08T05:04:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:38 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:04:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:38 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:04:39.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:38 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:04:39.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4817.668317 secs 2023-05-08T05:04:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:38 smithi096 ceph-mon[124666]: pgmap v2632: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 56 KiB/s wr, 6 op/s 2023-05-08T05:04:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:38 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:04:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:38 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:04:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:38 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:04:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4817.668317 secs 2023-05-08T05:04:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4818.225045 secs 2023-05-08T05:04:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4818.225045 secs 2023-05-08T05:04:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4818.225045 secs 2023-05-08T05:04:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:40 smithi186 ceph-mon[126480]: pgmap v2633: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 104 KiB/s wr, 9 op/s 2023-05-08T05:04:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4819.505965 secs 2023-05-08T05:04:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:40 smithi133 ceph-mon[125939]: pgmap v2633: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 104 KiB/s wr, 9 op/s 2023-05-08T05:04:41.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4819.505965 secs 2023-05-08T05:04:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:40 smithi096 ceph-mon[124666]: pgmap v2633: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 104 KiB/s wr, 9 op/s 2023-05-08T05:04:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4819.505965 secs 2023-05-08T05:04:43.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:42 smithi186 ceph-mon[126480]: pgmap v2634: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 104 KiB/s wr, 7 op/s 2023-05-08T05:04:43.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:42 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:04:43.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:42 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:04:43.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:42 smithi133 ceph-mon[125939]: pgmap v2634: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 104 KiB/s wr, 7 op/s 2023-05-08T05:04:43.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:42 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:04:43.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:42 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:04:43.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:42 smithi096 ceph-mon[124666]: pgmap v2634: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 104 KiB/s wr, 7 op/s 2023-05-08T05:04:43.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:42 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:04:43.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:42 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:04:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4822.668433 secs 2023-05-08T05:04:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:43 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:04:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4822.668433 secs 2023-05-08T05:04:44.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:43 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:04:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4822.668433 secs 2023-05-08T05:04:44.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:43 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:04:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:44 smithi186 ceph-mon[126480]: pgmap v2635: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 104 KiB/s wr, 7 op/s 2023-05-08T05:04:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4823.225167 secs 2023-05-08T05:04:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:44 smithi133 ceph-mon[125939]: pgmap v2635: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 104 KiB/s wr, 7 op/s 2023-05-08T05:04:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4823.225167 secs 2023-05-08T05:04:45.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:44 smithi096 ceph-mon[124666]: pgmap v2635: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 104 KiB/s wr, 7 op/s 2023-05-08T05:04:45.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4823.225167 secs 2023-05-08T05:04:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4824.506081 secs 2023-05-08T05:04:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4824.506081 secs 2023-05-08T05:04:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4824.506081 secs 2023-05-08T05:04:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:46 smithi133 ceph-mon[125939]: pgmap v2636: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 128 KiB/s wr, 10 op/s 2023-05-08T05:04:47.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:46 smithi096 ceph-mon[124666]: pgmap v2636: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 128 KiB/s wr, 10 op/s 2023-05-08T05:04:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:46 smithi186 ceph-mon[126480]: pgmap v2636: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 128 KiB/s wr, 10 op/s 2023-05-08T05:04:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:48 smithi133 ceph-mon[125939]: pgmap v2637: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 72 KiB/s wr, 6 op/s 2023-05-08T05:04:49.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4827.668575 secs 2023-05-08T05:04:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:48 smithi096 ceph-mon[124666]: pgmap v2637: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 72 KiB/s wr, 6 op/s 2023-05-08T05:04:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4827.668575 secs 2023-05-08T05:04:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:48 smithi186 ceph-mon[126480]: pgmap v2637: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 72 KiB/s wr, 6 op/s 2023-05-08T05:04:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4827.668575 secs 2023-05-08T05:04:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4828.225294 secs 2023-05-08T05:04:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4828.225294 secs 2023-05-08T05:04:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4828.225294 secs 2023-05-08T05:04:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:50 smithi133 ceph-mon[125939]: pgmap v2638: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 72 KiB/s wr, 8 op/s 2023-05-08T05:04:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4829.506205 secs 2023-05-08T05:04:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:50 smithi096 ceph-mon[124666]: pgmap v2638: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 72 KiB/s wr, 8 op/s 2023-05-08T05:04:51.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4829.506205 secs 2023-05-08T05:04:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:50 smithi186 ceph-mon[126480]: pgmap v2638: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 72 KiB/s wr, 8 op/s 2023-05-08T05:04:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4829.506205 secs 2023-05-08T05:04:53.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:52 smithi133 ceph-mon[125939]: pgmap v2639: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 5 op/s 2023-05-08T05:04:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:52 smithi096 ceph-mon[124666]: pgmap v2639: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 5 op/s 2023-05-08T05:04:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:52 smithi186 ceph-mon[126480]: pgmap v2639: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 5 op/s 2023-05-08T05:04:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4832.668711 secs 2023-05-08T05:04:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4832.668711 secs 2023-05-08T05:04:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4832.668711 secs 2023-05-08T05:04:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:54 smithi133 ceph-mon[125939]: pgmap v2640: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 5 op/s 2023-05-08T05:04:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4833.225417 secs 2023-05-08T05:04:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:54 smithi096 ceph-mon[124666]: pgmap v2640: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 5 op/s 2023-05-08T05:04:55.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4833.225417 secs 2023-05-08T05:04:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:54 smithi186 ceph-mon[126480]: pgmap v2640: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 5 op/s 2023-05-08T05:04:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4833.225417 secs 2023-05-08T05:04:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4834.506305 secs 2023-05-08T05:04:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4834.506305 secs 2023-05-08T05:04:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4834.506305 secs 2023-05-08T05:04:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:56 smithi133 ceph-mon[125939]: pgmap v2641: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 24 KiB/s wr, 7 op/s 2023-05-08T05:04:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:56 smithi096 ceph-mon[124666]: pgmap v2641: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 24 KiB/s wr, 7 op/s 2023-05-08T05:04:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:56 smithi186 ceph-mon[126480]: pgmap v2641: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 24 KiB/s wr, 7 op/s 2023-05-08T05:04:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:58 smithi133 ceph-mon[125939]: pgmap v2642: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:04:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4837.668803 secs 2023-05-08T05:04:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:58 smithi096 ceph-mon[124666]: pgmap v2642: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:04:59.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4837.668803 secs 2023-05-08T05:04:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:58 smithi186 ceph-mon[126480]: pgmap v2642: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:04:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4837.668803 secs 2023-05-08T05:05:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:04:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4838.225536 secs 2023-05-08T05:05:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:04:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4838.225536 secs 2023-05-08T05:05:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:04:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4838.225536 secs 2023-05-08T05:05:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:05:00 smithi133 ceph-mon[125939]: pgmap v2643: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T05:05:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:05:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4839.506421 secs 2023-05-08T05:05:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:05:00 smithi096 ceph-mon[124666]: pgmap v2643: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T05:05:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:05:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4839.506421 secs 2023-05-08T05:05:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:05:00 smithi186 ceph-mon[126480]: pgmap v2643: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T05:05:01.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:05:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4839.506421 secs 2023-05-08T05:05:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:05:02 smithi133 ceph-mon[125939]: pgmap v2644: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:05:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:05:02 smithi096 ceph-mon[124666]: pgmap v2644: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:05:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:05:02 smithi186 ceph-mon[126480]: pgmap v2644: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:05:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:05:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4842.668934 secs 2023-05-08T05:05:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:05:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4842.668934 secs 2023-05-08T05:05:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:05:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4842.668934 secs 2023-05-08T05:05:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:05:04 smithi133 ceph-mon[125939]: pgmap v2645: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:05:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:05:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4843.225655 secs 2023-05-08T05:05:05.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:05:04 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:05:05.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:05:04 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:05:05.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:05:04 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:05:05.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:05:04 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:05:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:05:04 smithi096 ceph-mon[124666]: pgmap v2645: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:05:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:05:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4843.225655 secs 2023-05-08T05:05:05.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:05:04 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:05:05.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:05:04 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:05:05.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:05:04 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:05:05.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:05:04 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:05:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:05:04 smithi186 ceph-mon[126480]: pgmap v2645: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:05:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:05:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4843.225655 secs 2023-05-08T05:05:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:05:04 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:05:05.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:05:04 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:05:05.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:05:04 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:05:05.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:05:04 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:05:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:05:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4844.506563 secs 2023-05-08T05:05:06.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:05:05 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:05:06.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:05:05 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T05:05:06.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:05:05 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T05:05:06.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:05:05 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:05:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:05:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4844.506563 secs 2023-05-08T05:05:06.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:05:05 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:05:06.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:05:05 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T05:05:06.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:05:05 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T05:05:06.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:05:05 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:05:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:05:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4844.506563 secs 2023-05-08T05:05:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:05:05 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:05:06.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:05:05 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T05:05:06.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:05:05 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T05:05:06.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:05:05 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:05:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:05:06 smithi133 ceph-mon[125939]: pgmap v2646: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 72 KiB/s wr, 20 op/s 2023-05-08T05:05:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:05:06 smithi096 ceph-mon[124666]: pgmap v2646: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 72 KiB/s wr, 20 op/s 2023-05-08T05:05:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:05:06 smithi186 ceph-mon[126480]: pgmap v2646: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 72 KiB/s wr, 20 op/s 2023-05-08T05:05:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:05:08 smithi133 ceph-mon[125939]: pgmap v2647: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 72 KiB/s wr, 18 op/s 2023-05-08T05:05:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:05:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4847.669052 secs 2023-05-08T05:05:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:05:08 smithi096 ceph-mon[124666]: pgmap v2647: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 72 KiB/s wr, 18 op/s 2023-05-08T05:05:09.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:05:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4847.669052 secs 2023-05-08T05:05:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:05:08 smithi186 ceph-mon[126480]: pgmap v2647: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 72 KiB/s wr, 18 op/s 2023-05-08T05:05:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:05:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4847.669052 secs 2023-05-08T05:05:10.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:05:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4848.225790 secs 2023-05-08T05:05:10.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:05:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4848.225790 secs 2023-05-08T05:05:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:05:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4848.225790 secs 2023-05-08T05:05:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:05:10 smithi133 ceph-mon[125939]: pgmap v2648: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 72 KiB/s wr, 21 op/s 2023-05-08T05:05:11.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:05:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4849.506678 secs 2023-05-08T05:05:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:05:10 smithi096 ceph-mon[124666]: pgmap v2648: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 72 KiB/s wr, 21 op/s 2023-05-08T05:05:11.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:05:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4849.506678 secs 2023-05-08T05:05:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:05:10 smithi186 ceph-mon[126480]: pgmap v2648: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 72 KiB/s wr, 21 op/s 2023-05-08T05:05:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:05:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4849.506678 secs 2023-05-08T05:05:13.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:05:12 smithi133 ceph-mon[125939]: pgmap v2649: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 72 KiB/s wr, 18 op/s 2023-05-08T05:05:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:05:12 smithi096 ceph-mon[124666]: pgmap v2649: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 72 KiB/s wr, 18 op/s 2023-05-08T05:05:13.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:05:12 smithi186 ceph-mon[126480]: pgmap v2649: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 72 KiB/s wr, 18 op/s 2023-05-08T05:05:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:05:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4852.669143 secs 2023-05-08T05:05:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:05:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4852.669143 secs 2023-05-08T05:05:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:05:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4852.669143 secs 2023-05-08T05:05:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:05:14 smithi133 ceph-mon[125939]: pgmap v2650: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 72 KiB/s wr, 18 op/s 2023-05-08T05:05:15.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:05:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4853.225926 secs 2023-05-08T05:05:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:05:14 smithi096 ceph-mon[124666]: pgmap v2650: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 72 KiB/s wr, 18 op/s 2023-05-08T05:05:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:05:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4853.225926 secs 2023-05-08T05:05:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:05:14 smithi186 ceph-mon[126480]: pgmap v2650: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 72 KiB/s wr, 18 op/s 2023-05-08T05:05:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:05:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4853.225926 secs 2023-05-08T05:05:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:05:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4854.506810 secs 2023-05-08T05:05:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:05:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4854.506810 secs 2023-05-08T05:05:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:05:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4854.506810 secs 2023-05-08T05:05:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:05:16 smithi133 ceph-mon[125939]: pgmap v2651: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 96 KiB/s wr, 22 op/s 2023-05-08T05:05:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:05:16 smithi096 ceph-mon[124666]: pgmap v2651: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 96 KiB/s wr, 22 op/s 2023-05-08T05:05:17.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:05:16 smithi186 ceph-mon[126480]: pgmap v2651: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 96 KiB/s wr, 22 op/s 2023-05-08T05:05:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:05:18 smithi133 ceph-mon[125939]: pgmap v2652: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 6 op/s 2023-05-08T05:05:19.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:05:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4857.669259 secs 2023-05-08T05:05:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:05:18 smithi096 ceph-mon[124666]: pgmap v2652: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 6 op/s 2023-05-08T05:05:19.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:05:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4857.669259 secs 2023-05-08T05:05:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:05:18 smithi186 ceph-mon[126480]: pgmap v2652: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 6 op/s 2023-05-08T05:05:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:05:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4857.669259 secs 2023-05-08T05:05:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:05:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4858.226044 secs 2023-05-08T05:05:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:05:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4858.226044 secs 2023-05-08T05:05:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:05:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4858.226044 secs 2023-05-08T05:05:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:05:20 smithi133 ceph-mon[125939]: pgmap v2653: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 8 op/s 2023-05-08T05:05:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:05:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4859.506925 secs 2023-05-08T05:05:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:05:20 smithi096 ceph-mon[124666]: pgmap v2653: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 8 op/s 2023-05-08T05:05:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:05:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4859.506925 secs 2023-05-08T05:05:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:05:20 smithi186 ceph-mon[126480]: pgmap v2653: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 8 op/s 2023-05-08T05:05:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:05:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4859.506925 secs 2023-05-08T05:05:23.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:05:22 smithi133 ceph-mon[125939]: pgmap v2654: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 5 op/s 2023-05-08T05:05:23.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:05:22 smithi096 ceph-mon[124666]: pgmap v2654: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 5 op/s 2023-05-08T05:05:23.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:05:22 smithi186 ceph-mon[126480]: pgmap v2654: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 5 op/s 2023-05-08T05:05:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:05:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4862.669371 secs 2023-05-08T05:05:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:05:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4862.669371 secs 2023-05-08T05:05:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:05:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4862.669371 secs 2023-05-08T05:05:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:05:24 smithi096 ceph-mon[124666]: pgmap v2655: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 5 op/s 2023-05-08T05:05:25.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:05:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4863.226196 secs 2023-05-08T05:05:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:05:24 smithi186 ceph-mon[126480]: pgmap v2655: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 5 op/s 2023-05-08T05:05:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:05:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4863.226196 secs 2023-05-08T05:05:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:05:24 smithi133 ceph-mon[125939]: pgmap v2655: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 5 op/s 2023-05-08T05:05:25.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:05:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4863.226196 secs 2023-05-08T05:05:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:05:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4864.507041 secs 2023-05-08T05:05:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:05:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4864.507041 secs 2023-05-08T05:05:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:05:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4864.507041 secs 2023-05-08T05:05:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:05:26 smithi096 ceph-mon[124666]: pgmap v2656: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 24 KiB/s wr, 8 op/s 2023-05-08T05:05:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:05:27 smithi186 ceph-mon[126480]: pgmap v2656: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 24 KiB/s wr, 8 op/s 2023-05-08T05:05:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:05:27 smithi133 ceph-mon[125939]: pgmap v2656: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 24 KiB/s wr, 8 op/s 2023-05-08T05:05:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:05:29 smithi186 ceph-mon[126480]: pgmap v2657: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:05:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:05:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4867.669484 secs 2023-05-08T05:05:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:05:29 smithi133 ceph-mon[125939]: pgmap v2657: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:05:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:05:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4867.669484 secs 2023-05-08T05:05:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:05:29 smithi096 ceph-mon[124666]: pgmap v2657: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:05:29.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:05:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4867.669484 secs 2023-05-08T05:05:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:05:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4868.226312 secs 2023-05-08T05:05:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:05:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4868.226312 secs 2023-05-08T05:05:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:05:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4868.226312 secs 2023-05-08T05:05:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:05:31 smithi186 ceph-mon[126480]: pgmap v2658: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T05:05:31.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:05:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4869.507156 secs 2023-05-08T05:05:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:05:31 smithi133 ceph-mon[125939]: pgmap v2658: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T05:05:31.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:05:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4869.507156 secs 2023-05-08T05:05:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:05:31 smithi096 ceph-mon[124666]: pgmap v2658: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T05:05:31.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:05:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4869.507156 secs 2023-05-08T05:05:33.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:05:33 smithi186 ceph-mon[126480]: pgmap v2659: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:05:33.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:05:33 smithi133 ceph-mon[125939]: pgmap v2659: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:05:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:05:33 smithi096 ceph-mon[124666]: pgmap v2659: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:05:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:05:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4872.669590 secs 2023-05-08T05:05:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:05:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4872.669590 secs 2023-05-08T05:05:34.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:05:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4872.669590 secs 2023-05-08T05:05:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:05:35 smithi186 ceph-mon[126480]: pgmap v2660: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:05:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:05:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4873.226438 secs 2023-05-08T05:05:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:05:35 smithi133 ceph-mon[125939]: pgmap v2660: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:05:35.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:05:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4873.226438 secs 2023-05-08T05:05:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:05:35 smithi096 ceph-mon[124666]: pgmap v2660: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:05:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:05:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4873.226438 secs 2023-05-08T05:05:37.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:05:37 smithi186 ceph-mon[126480]: pgmap v2661: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 84 KiB/s wr, 8 op/s 2023-05-08T05:05:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:05:37 smithi133 ceph-mon[125939]: pgmap v2661: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 84 KiB/s wr, 8 op/s 2023-05-08T05:05:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:05:37 smithi096 ceph-mon[124666]: pgmap v2661: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 84 KiB/s wr, 8 op/s 2023-05-08T05:05:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:05:38 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:05:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:05:38 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:05:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:05:38 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:05:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:05:39 smithi186 ceph-mon[126480]: pgmap v2662: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 84 KiB/s wr, 6 op/s 2023-05-08T05:05:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:05:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4877.669666 secs 2023-05-08T05:05:39.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:05:39 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:05:39.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:05:39 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:05:39.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:05:39 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:05:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:05:39 smithi133 ceph-mon[125939]: pgmap v2662: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 84 KiB/s wr, 6 op/s 2023-05-08T05:05:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:05:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4877.669666 secs 2023-05-08T05:05:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:05:39 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:05:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:05:39 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:05:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:05:39 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:05:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:05:39 smithi096 ceph-mon[124666]: pgmap v2662: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 84 KiB/s wr, 6 op/s 2023-05-08T05:05:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:05:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4877.669666 secs 2023-05-08T05:05:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:05:39 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:05:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:05:39 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:05:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:05:39 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:05:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:05:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4878.226546 secs 2023-05-08T05:05:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:05:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4878.226546 secs 2023-05-08T05:05:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:05:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4878.226546 secs 2023-05-08T05:05:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:05:41 smithi186 ceph-mon[126480]: pgmap v2663: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 157 KiB/s wr, 10 op/s 2023-05-08T05:05:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:05:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4879.507426 secs 2023-05-08T05:05:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:05:41 smithi133 ceph-mon[125939]: pgmap v2663: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 157 KiB/s wr, 10 op/s 2023-05-08T05:05:41.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:05:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4879.507426 secs 2023-05-08T05:05:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:05:41 smithi096 ceph-mon[124666]: pgmap v2663: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 157 KiB/s wr, 10 op/s 2023-05-08T05:05:41.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:05:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4879.507426 secs 2023-05-08T05:05:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:05:43 smithi186 ceph-mon[126480]: pgmap v2664: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 157 KiB/s wr, 8 op/s 2023-05-08T05:05:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:05:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:05:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:05:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:05:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:05:43 smithi133 ceph-mon[125939]: pgmap v2664: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 157 KiB/s wr, 8 op/s 2023-05-08T05:05:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:05:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:05:43.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:05:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:05:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:05:43 smithi096 ceph-mon[124666]: pgmap v2664: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 157 KiB/s wr, 8 op/s 2023-05-08T05:05:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:05:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:05:43.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:05:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:05:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:05:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4882.669782 secs 2023-05-08T05:05:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:05:44 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:05:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:05:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4882.669782 secs 2023-05-08T05:05:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:05:44 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:05:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:05:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4882.669782 secs 2023-05-08T05:05:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:05:44 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:05:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:05:45 smithi186 ceph-mon[126480]: pgmap v2665: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 157 KiB/s wr, 8 op/s 2023-05-08T05:05:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:05:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4883.226701 secs 2023-05-08T05:05:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:05:45 smithi133 ceph-mon[125939]: pgmap v2665: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 157 KiB/s wr, 8 op/s 2023-05-08T05:05:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:05:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4883.226701 secs 2023-05-08T05:05:45.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:05:45 smithi096 ceph-mon[124666]: pgmap v2665: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 157 KiB/s wr, 8 op/s 2023-05-08T05:05:45.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:05:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4883.226701 secs 2023-05-08T05:05:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:05:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4884.507561 secs 2023-05-08T05:05:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:05:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4884.507561 secs 2023-05-08T05:05:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:05:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4884.507561 secs 2023-05-08T05:05:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:05:47 smithi186 ceph-mon[126480]: pgmap v2666: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 182 KiB/s wr, 11 op/s 2023-05-08T05:05:47.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:05:47 smithi133 ceph-mon[125939]: pgmap v2666: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 182 KiB/s wr, 11 op/s 2023-05-08T05:05:47.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:05:47 smithi096 ceph-mon[124666]: pgmap v2666: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 182 KiB/s wr, 11 op/s 2023-05-08T05:05:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:05:49 smithi186 ceph-mon[126480]: pgmap v2667: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 98 KiB/s wr, 7 op/s 2023-05-08T05:05:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:05:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4887.669898 secs 2023-05-08T05:05:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:05:49 smithi133 ceph-mon[125939]: pgmap v2667: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 98 KiB/s wr, 7 op/s 2023-05-08T05:05:49.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:05:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4887.669898 secs 2023-05-08T05:05:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:05:49 smithi096 ceph-mon[124666]: pgmap v2667: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 98 KiB/s wr, 7 op/s 2023-05-08T05:05:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:05:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4887.669898 secs 2023-05-08T05:05:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:05:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4888.226819 secs 2023-05-08T05:05:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:05:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4888.226819 secs 2023-05-08T05:05:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:05:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4888.226819 secs 2023-05-08T05:05:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:05:51 smithi186 ceph-mon[126480]: pgmap v2668: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 98 KiB/s wr, 10 op/s 2023-05-08T05:05:51.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:05:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4889.507677 secs 2023-05-08T05:05:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:05:51 smithi133 ceph-mon[125939]: pgmap v2668: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 98 KiB/s wr, 10 op/s 2023-05-08T05:05:51.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:05:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4889.507677 secs 2023-05-08T05:05:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:05:51 smithi096 ceph-mon[124666]: pgmap v2668: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 98 KiB/s wr, 10 op/s 2023-05-08T05:05:51.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:05:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4889.507677 secs 2023-05-08T05:05:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:05:53 smithi186 ceph-mon[126480]: pgmap v2669: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 6 op/s 2023-05-08T05:05:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:05:53 smithi133 ceph-mon[125939]: pgmap v2669: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 6 op/s 2023-05-08T05:05:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:05:53 smithi096 ceph-mon[124666]: pgmap v2669: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 6 op/s 2023-05-08T05:05:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:05:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4892.670007 secs 2023-05-08T05:05:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:05:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4892.670007 secs 2023-05-08T05:05:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:05:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4892.670007 secs 2023-05-08T05:05:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:05:55 smithi186 ceph-mon[126480]: pgmap v2670: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 6 op/s 2023-05-08T05:05:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:05:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4893.226939 secs 2023-05-08T05:05:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:05:55 smithi133 ceph-mon[125939]: pgmap v2670: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 6 op/s 2023-05-08T05:05:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:05:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4893.226939 secs 2023-05-08T05:05:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:05:55 smithi096 ceph-mon[124666]: pgmap v2670: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 6 op/s 2023-05-08T05:05:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:05:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4893.226939 secs 2023-05-08T05:05:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:05:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4894.507803 secs 2023-05-08T05:05:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:05:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4894.507803 secs 2023-05-08T05:05:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:05:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4894.507803 secs 2023-05-08T05:05:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:05:57 smithi186 ceph-mon[126480]: pgmap v2671: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 9 op/s 2023-05-08T05:05:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:05:57 smithi133 ceph-mon[125939]: pgmap v2671: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 9 op/s 2023-05-08T05:05:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:05:57 smithi096 ceph-mon[124666]: pgmap v2671: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 9 op/s 2023-05-08T05:05:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:05:59 smithi186 ceph-mon[126480]: pgmap v2672: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:05:59.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:05:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4897.670078 secs 2023-05-08T05:05:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:05:59 smithi133 ceph-mon[125939]: pgmap v2672: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:05:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:05:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4897.670078 secs 2023-05-08T05:05:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:05:59 smithi096 ceph-mon[124666]: pgmap v2672: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:05:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:05:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4897.670078 secs 2023-05-08T05:06:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4898.227058 secs 2023-05-08T05:06:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4898.227058 secs 2023-05-08T05:06:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4898.227058 secs 2023-05-08T05:06:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:01 smithi186 ceph-mon[126480]: pgmap v2673: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T05:06:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4899.507941 secs 2023-05-08T05:06:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:01 smithi133 ceph-mon[125939]: pgmap v2673: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T05:06:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4899.507941 secs 2023-05-08T05:06:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:01 smithi096 ceph-mon[124666]: pgmap v2673: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T05:06:01.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4899.507941 secs 2023-05-08T05:06:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:03 smithi133 ceph-mon[125939]: pgmap v2674: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:06:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:03 smithi096 ceph-mon[124666]: pgmap v2674: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:06:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:03 smithi186 ceph-mon[126480]: pgmap v2674: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:06:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4902.670201 secs 2023-05-08T05:06:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4902.670201 secs 2023-05-08T05:06:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4902.670201 secs 2023-05-08T05:06:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4903.227171 secs 2023-05-08T05:06:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:05 smithi133 ceph-mon[125939]: pgmap v2675: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:06:05.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:05 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:06:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4903.227171 secs 2023-05-08T05:06:05.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:05 smithi096 ceph-mon[124666]: pgmap v2675: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:06:05.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:05 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:06:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4903.227171 secs 2023-05-08T05:06:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:05 smithi186 ceph-mon[126480]: pgmap v2675: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:06:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:05 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:06:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4904.508059 secs 2023-05-08T05:06:06.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:06 smithi133 ceph-mon[125939]: osdmap e246: 12 total, 12 up, 12 in 2023-05-08T05:06:06.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:06 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:06:06.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:06 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:06:06.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:06 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:06:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4904.508059 secs 2023-05-08T05:06:06.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:06 smithi096 ceph-mon[124666]: osdmap e246: 12 total, 12 up, 12 in 2023-05-08T05:06:06.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:06 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:06:06.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:06 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:06:06.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:06 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:06:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4904.508059 secs 2023-05-08T05:06:06.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:06 smithi186 ceph-mon[126480]: osdmap e246: 12 total, 12 up, 12 in 2023-05-08T05:06:06.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:06 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:06:06.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:06 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:06:06.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:06 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:06:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:07 smithi133 ceph-mon[125939]: pgmap v2677: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 114 KiB/s wr, 25 op/s 2023-05-08T05:06:07.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:07 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:06:07.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:07 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T05:06:07.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:07 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T05:06:07.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:07 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:06:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:07 smithi096 ceph-mon[124666]: pgmap v2677: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 114 KiB/s wr, 25 op/s 2023-05-08T05:06:07.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:07 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:06:07.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:07 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T05:06:07.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:07 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T05:06:07.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:07 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:06:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:07 smithi186 ceph-mon[126480]: pgmap v2677: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 114 KiB/s wr, 25 op/s 2023-05-08T05:06:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:07 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:06:07.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:07 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T05:06:07.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:07 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T05:06:07.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:07 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:06:09.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:09 smithi133 ceph-mon[125939]: pgmap v2678: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 114 KiB/s wr, 25 op/s 2023-05-08T05:06:09.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4907.670311 secs 2023-05-08T05:06:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:09 smithi096 ceph-mon[124666]: pgmap v2678: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 114 KiB/s wr, 25 op/s 2023-05-08T05:06:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4907.670311 secs 2023-05-08T05:06:09.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:09 smithi186 ceph-mon[126480]: pgmap v2678: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 114 KiB/s wr, 25 op/s 2023-05-08T05:06:09.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4907.670311 secs 2023-05-08T05:06:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4908.227292 secs 2023-05-08T05:06:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4908.227292 secs 2023-05-08T05:06:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4908.227292 secs 2023-05-08T05:06:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:11 smithi133 ceph-mon[125939]: pgmap v2679: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 114 KiB/s wr, 25 op/s 2023-05-08T05:06:11.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4909.508174 secs 2023-05-08T05:06:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:11 smithi096 ceph-mon[124666]: pgmap v2679: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 114 KiB/s wr, 25 op/s 2023-05-08T05:06:11.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4909.508174 secs 2023-05-08T05:06:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:11 smithi186 ceph-mon[126480]: pgmap v2679: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 114 KiB/s wr, 25 op/s 2023-05-08T05:06:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4909.508174 secs 2023-05-08T05:06:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:13 smithi133 ceph-mon[125939]: pgmap v2680: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 114 KiB/s wr, 25 op/s 2023-05-08T05:06:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:13 smithi096 ceph-mon[124666]: pgmap v2680: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 114 KiB/s wr, 25 op/s 2023-05-08T05:06:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:13 smithi186 ceph-mon[126480]: pgmap v2680: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 114 KiB/s wr, 25 op/s 2023-05-08T05:06:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4912.670407 secs 2023-05-08T05:06:14.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:14 smithi133 ceph-mon[125939]: osdmap e247: 12 total, 12 up, 12 in 2023-05-08T05:06:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4912.670407 secs 2023-05-08T05:06:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:14 smithi096 ceph-mon[124666]: osdmap e247: 12 total, 12 up, 12 in 2023-05-08T05:06:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4912.670407 secs 2023-05-08T05:06:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:14 smithi186 ceph-mon[126480]: osdmap e247: 12 total, 12 up, 12 in 2023-05-08T05:06:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4913.227413 secs 2023-05-08T05:06:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:15 smithi133 ceph-mon[125939]: pgmap v2681: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 114 KiB/s wr, 25 op/s 2023-05-08T05:06:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4913.227413 secs 2023-05-08T05:06:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:15 smithi096 ceph-mon[124666]: pgmap v2681: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 114 KiB/s wr, 25 op/s 2023-05-08T05:06:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4913.227413 secs 2023-05-08T05:06:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:15 smithi186 ceph-mon[126480]: pgmap v2681: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 114 KiB/s wr, 25 op/s 2023-05-08T05:06:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4914.508310 secs 2023-05-08T05:06:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4914.508310 secs 2023-05-08T05:06:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4914.508310 secs 2023-05-08T05:06:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:17 smithi133 ceph-mon[125939]: pgmap v2683: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 7 op/s 2023-05-08T05:06:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:17 smithi096 ceph-mon[124666]: pgmap v2683: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 7 op/s 2023-05-08T05:06:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:17 smithi186 ceph-mon[126480]: pgmap v2683: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 7 op/s 2023-05-08T05:06:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:19 smithi133 ceph-mon[125939]: pgmap v2684: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 7 op/s 2023-05-08T05:06:19.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4917.670543 secs 2023-05-08T05:06:19.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4918.227530 secs 2023-05-08T05:06:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:19 smithi096 ceph-mon[124666]: pgmap v2684: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 7 op/s 2023-05-08T05:06:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4917.670543 secs 2023-05-08T05:06:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4918.227530 secs 2023-05-08T05:06:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:19 smithi186 ceph-mon[126480]: pgmap v2684: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 7 op/s 2023-05-08T05:06:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4917.670543 secs 2023-05-08T05:06:19.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4918.227530 secs 2023-05-08T05:06:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:21 smithi133 ceph-mon[125939]: pgmap v2685: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 6 op/s 2023-05-08T05:06:21.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4919.508426 secs 2023-05-08T05:06:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:21 smithi096 ceph-mon[124666]: pgmap v2685: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 6 op/s 2023-05-08T05:06:21.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4919.508426 secs 2023-05-08T05:06:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:21 smithi186 ceph-mon[126480]: pgmap v2685: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 6 op/s 2023-05-08T05:06:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4919.508426 secs 2023-05-08T05:06:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:23 smithi133 ceph-mon[125939]: pgmap v2686: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 6 op/s 2023-05-08T05:06:23.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:23 smithi096 ceph-mon[124666]: pgmap v2686: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 6 op/s 2023-05-08T05:06:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:23 smithi186 ceph-mon[126480]: pgmap v2686: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 6 op/s 2023-05-08T05:06:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4922.670658 secs 2023-05-08T05:06:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4923.227645 secs 2023-05-08T05:06:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4922.670658 secs 2023-05-08T05:06:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4923.227645 secs 2023-05-08T05:06:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4922.670658 secs 2023-05-08T05:06:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4923.227645 secs 2023-05-08T05:06:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:25 smithi133 ceph-mon[125939]: pgmap v2687: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 6 op/s 2023-05-08T05:06:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:25 smithi096 ceph-mon[124666]: pgmap v2687: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 6 op/s 2023-05-08T05:06:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:25 smithi186 ceph-mon[126480]: pgmap v2687: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 6 op/s 2023-05-08T05:06:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4924.508538 secs 2023-05-08T05:06:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4924.508538 secs 2023-05-08T05:06:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4924.508538 secs 2023-05-08T05:06:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:27 smithi133 ceph-mon[125939]: pgmap v2688: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 8 op/s 2023-05-08T05:06:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:27 smithi096 ceph-mon[124666]: pgmap v2688: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 8 op/s 2023-05-08T05:06:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:27 smithi186 ceph-mon[126480]: pgmap v2688: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 8 op/s 2023-05-08T05:06:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:29 smithi133 ceph-mon[125939]: pgmap v2689: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T05:06:29.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4927.670774 secs 2023-05-08T05:06:29.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4928.227763 secs 2023-05-08T05:06:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:29 smithi096 ceph-mon[124666]: pgmap v2689: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T05:06:29.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4927.670774 secs 2023-05-08T05:06:29.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4928.227763 secs 2023-05-08T05:06:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:29 smithi186 ceph-mon[126480]: pgmap v2689: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T05:06:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4927.670774 secs 2023-05-08T05:06:29.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4928.227763 secs 2023-05-08T05:06:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:31 smithi133 ceph-mon[125939]: pgmap v2690: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T05:06:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4929.508633 secs 2023-05-08T05:06:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:31 smithi096 ceph-mon[124666]: pgmap v2690: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T05:06:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4929.508633 secs 2023-05-08T05:06:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:31 smithi186 ceph-mon[126480]: pgmap v2690: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T05:06:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4929.508633 secs 2023-05-08T05:06:33.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:33 smithi133 ceph-mon[125939]: pgmap v2691: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:06:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:33 smithi096 ceph-mon[124666]: pgmap v2691: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:06:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:33 smithi186 ceph-mon[126480]: pgmap v2691: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:06:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4932.670891 secs 2023-05-08T05:06:34.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4933.227888 secs 2023-05-08T05:06:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4932.670891 secs 2023-05-08T05:06:34.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4933.227888 secs 2023-05-08T05:06:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4932.670891 secs 2023-05-08T05:06:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4933.227888 secs 2023-05-08T05:06:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:35 smithi133 ceph-mon[125939]: pgmap v2692: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:06:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:35 smithi096 ceph-mon[124666]: pgmap v2692: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:06:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:35 smithi186 ceph-mon[126480]: pgmap v2692: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:06:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:37 smithi133 ceph-mon[125939]: pgmap v2693: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 98 KiB/s wr, 9 op/s 2023-05-08T05:06:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:37 smithi096 ceph-mon[124666]: pgmap v2693: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 98 KiB/s wr, 9 op/s 2023-05-08T05:06:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:37 smithi186 ceph-mon[126480]: pgmap v2693: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 98 KiB/s wr, 9 op/s 2023-05-08T05:06:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:38 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:06:38.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:38 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:06:38.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:38 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:06:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:39 smithi133 ceph-mon[125939]: pgmap v2694: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 98 KiB/s wr, 6 op/s 2023-05-08T05:06:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4937.671023 secs 2023-05-08T05:06:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:39 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:06:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:39 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:06:39.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:39 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:06:39.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4938.227989 secs 2023-05-08T05:06:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:39 smithi096 ceph-mon[124666]: pgmap v2694: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 98 KiB/s wr, 6 op/s 2023-05-08T05:06:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4937.671023 secs 2023-05-08T05:06:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:39 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:06:39.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:39 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:06:39.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:39 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:06:39.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4938.227989 secs 2023-05-08T05:06:39.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:39 smithi186 ceph-mon[126480]: pgmap v2694: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 98 KiB/s wr, 6 op/s 2023-05-08T05:06:39.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4937.671023 secs 2023-05-08T05:06:39.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:39 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:06:39.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:39 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:06:39.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:39 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:06:39.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4938.227989 secs 2023-05-08T05:06:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:41 smithi096 ceph-mon[124666]: pgmap v2695: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 130 KiB/s wr, 10 op/s 2023-05-08T05:06:41.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4939.508867 secs 2023-05-08T05:06:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:41 smithi186 ceph-mon[126480]: pgmap v2695: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 130 KiB/s wr, 10 op/s 2023-05-08T05:06:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4939.508867 secs 2023-05-08T05:06:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:41 smithi133 ceph-mon[125939]: pgmap v2695: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 130 KiB/s wr, 10 op/s 2023-05-08T05:06:41.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4939.508867 secs 2023-05-08T05:06:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:43 smithi096 ceph-mon[124666]: pgmap v2696: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 130 KiB/s wr, 7 op/s 2023-05-08T05:06:43.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:06:43.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:06:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:43 smithi186 ceph-mon[126480]: pgmap v2696: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 130 KiB/s wr, 7 op/s 2023-05-08T05:06:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:06:43.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:06:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:43 smithi133 ceph-mon[125939]: pgmap v2696: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 130 KiB/s wr, 7 op/s 2023-05-08T05:06:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:06:43.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:06:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4942.671133 secs 2023-05-08T05:06:44.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4943.228109 secs 2023-05-08T05:06:44.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:44 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:06:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4942.671133 secs 2023-05-08T05:06:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4943.228109 secs 2023-05-08T05:06:44.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:44 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:06:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4942.671133 secs 2023-05-08T05:06:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4943.228109 secs 2023-05-08T05:06:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:44 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:06:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:45 smithi186 ceph-mon[126480]: pgmap v2697: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 130 KiB/s wr, 7 op/s 2023-05-08T05:06:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:45 smithi133 ceph-mon[125939]: pgmap v2697: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 130 KiB/s wr, 7 op/s 2023-05-08T05:06:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:45 smithi096 ceph-mon[124666]: pgmap v2697: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 130 KiB/s wr, 7 op/s 2023-05-08T05:06:46.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4944.508932 secs 2023-05-08T05:06:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4944.508932 secs 2023-05-08T05:06:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4944.508932 secs 2023-05-08T05:06:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:47 smithi186 ceph-mon[126480]: pgmap v2698: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 155 KiB/s wr, 10 op/s 2023-05-08T05:06:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:47 smithi133 ceph-mon[125939]: pgmap v2698: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 155 KiB/s wr, 10 op/s 2023-05-08T05:06:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:47 smithi096 ceph-mon[124666]: pgmap v2698: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 155 KiB/s wr, 10 op/s 2023-05-08T05:06:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:49 smithi186 ceph-mon[126480]: pgmap v2699: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 56 KiB/s wr, 6 op/s 2023-05-08T05:06:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4947.671244 secs 2023-05-08T05:06:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4948.228238 secs 2023-05-08T05:06:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:49 smithi133 ceph-mon[125939]: pgmap v2699: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 56 KiB/s wr, 6 op/s 2023-05-08T05:06:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4947.671244 secs 2023-05-08T05:06:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4948.228238 secs 2023-05-08T05:06:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:49 smithi096 ceph-mon[124666]: pgmap v2699: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 56 KiB/s wr, 6 op/s 2023-05-08T05:06:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4947.671244 secs 2023-05-08T05:06:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4948.228238 secs 2023-05-08T05:06:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:51 smithi186 ceph-mon[126480]: pgmap v2700: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 56 KiB/s wr, 9 op/s 2023-05-08T05:06:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4949.509041 secs 2023-05-08T05:06:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:51 smithi133 ceph-mon[125939]: pgmap v2700: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 56 KiB/s wr, 9 op/s 2023-05-08T05:06:51.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4949.509041 secs 2023-05-08T05:06:51.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:51 smithi096 ceph-mon[124666]: pgmap v2700: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 56 KiB/s wr, 9 op/s 2023-05-08T05:06:51.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4949.509041 secs 2023-05-08T05:06:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:53 smithi186 ceph-mon[126480]: pgmap v2701: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 6 op/s 2023-05-08T05:06:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:53 smithi133 ceph-mon[125939]: pgmap v2701: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 6 op/s 2023-05-08T05:06:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:53 smithi096 ceph-mon[124666]: pgmap v2701: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 6 op/s 2023-05-08T05:06:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4952.671358 secs 2023-05-08T05:06:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4953.228359 secs 2023-05-08T05:06:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4952.671358 secs 2023-05-08T05:06:54.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4953.228359 secs 2023-05-08T05:06:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4952.671358 secs 2023-05-08T05:06:54.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4953.228359 secs 2023-05-08T05:06:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:55 smithi186 ceph-mon[126480]: pgmap v2702: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 6 op/s 2023-05-08T05:06:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:55 smithi133 ceph-mon[125939]: pgmap v2702: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 6 op/s 2023-05-08T05:06:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:55 smithi096 ceph-mon[124666]: pgmap v2702: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 6 op/s 2023-05-08T05:06:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4954.509114 secs 2023-05-08T05:06:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4954.509114 secs 2023-05-08T05:06:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4954.509114 secs 2023-05-08T05:06:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:57 smithi186 ceph-mon[126480]: pgmap v2703: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 9 op/s 2023-05-08T05:06:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:57 smithi133 ceph-mon[125939]: pgmap v2703: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 9 op/s 2023-05-08T05:06:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:57 smithi096 ceph-mon[124666]: pgmap v2703: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 9 op/s 2023-05-08T05:06:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:59 smithi186 ceph-mon[126480]: pgmap v2704: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:06:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4957.671475 secs 2023-05-08T05:06:59.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:06:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4958.228497 secs 2023-05-08T05:06:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:59 smithi133 ceph-mon[125939]: pgmap v2704: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:06:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4957.671475 secs 2023-05-08T05:06:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:06:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4958.228497 secs 2023-05-08T05:06:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:59 smithi096 ceph-mon[124666]: pgmap v2704: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:06:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4957.671475 secs 2023-05-08T05:06:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:06:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4958.228497 secs 2023-05-08T05:07:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:01 smithi186 ceph-mon[126480]: pgmap v2705: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T05:07:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4959.509236 secs 2023-05-08T05:07:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:01 smithi133 ceph-mon[125939]: pgmap v2705: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T05:07:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4959.509236 secs 2023-05-08T05:07:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:01 smithi096 ceph-mon[124666]: pgmap v2705: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T05:07:01.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4959.509236 secs 2023-05-08T05:07:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:03 smithi186 ceph-mon[126480]: pgmap v2706: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:07:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:03 smithi133 ceph-mon[125939]: pgmap v2706: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:07:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:03 smithi096 ceph-mon[124666]: pgmap v2706: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:07:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4962.671570 secs 2023-05-08T05:07:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4963.228615 secs 2023-05-08T05:07:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4962.671570 secs 2023-05-08T05:07:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4963.228615 secs 2023-05-08T05:07:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4962.671570 secs 2023-05-08T05:07:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4963.228615 secs 2023-05-08T05:07:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:05 smithi186 ceph-mon[126480]: pgmap v2707: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:07:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:05 smithi133 ceph-mon[125939]: pgmap v2707: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:07:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:05 smithi096 ceph-mon[124666]: pgmap v2707: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:07:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4964.509328 secs 2023-05-08T05:07:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:06 smithi186 ceph-mon[126480]: osdmap e248: 12 total, 12 up, 12 in 2023-05-08T05:07:06.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:06 smithi186 ceph-mon[126480]: pgmap v2709: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 114 KiB/s wr, 25 op/s 2023-05-08T05:07:06.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:06 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:07:06.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:06 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:07:06.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:06 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:07:06.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:06 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:07:06.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:06 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:07:06.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:06 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:07:06.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:06 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:07:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4964.509328 secs 2023-05-08T05:07:06.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:06 smithi133 ceph-mon[125939]: osdmap e248: 12 total, 12 up, 12 in 2023-05-08T05:07:06.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:06 smithi133 ceph-mon[125939]: pgmap v2709: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 114 KiB/s wr, 25 op/s 2023-05-08T05:07:06.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:06 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:07:06.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:06 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:07:06.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:06 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:07:06.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:06 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:07:06.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:06 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:07:06.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:06 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:07:06.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:06 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:07:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4964.509328 secs 2023-05-08T05:07:06.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:06 smithi096 ceph-mon[124666]: osdmap e248: 12 total, 12 up, 12 in 2023-05-08T05:07:06.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:06 smithi096 ceph-mon[124666]: pgmap v2709: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 114 KiB/s wr, 25 op/s 2023-05-08T05:07:06.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:06 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:07:06.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:06 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:07:06.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:06 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:07:06.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:06 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:07:06.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:06 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:07:06.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:06 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:07:06.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:06 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:07:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:07 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:07:07.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:07 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:07:07.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:07 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:07:07.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:07 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:07:07.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:07 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T05:07:07.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:07 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T05:07:07.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:07 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:07:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:07 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:07:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:07 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:07:07.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:07 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:07:07.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:07 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:07:07.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:07 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T05:07:07.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:07 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T05:07:07.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:07 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:07:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:07 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:07:07.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:07 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:07:07.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:07 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:07:07.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:07 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:07:07.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:07 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T05:07:07.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:07 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T05:07:07.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:07 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:07:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:08 smithi186 ceph-mon[126480]: pgmap v2710: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 114 KiB/s wr, 25 op/s 2023-05-08T05:07:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:08 smithi133 ceph-mon[125939]: pgmap v2710: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 114 KiB/s wr, 25 op/s 2023-05-08T05:07:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:08 smithi096 ceph-mon[124666]: pgmap v2710: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 114 KiB/s wr, 25 op/s 2023-05-08T05:07:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4967.671684 secs 2023-05-08T05:07:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4968.228730 secs 2023-05-08T05:07:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4967.671684 secs 2023-05-08T05:07:09.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4968.228730 secs 2023-05-08T05:07:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4967.671684 secs 2023-05-08T05:07:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4968.228730 secs 2023-05-08T05:07:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:10 smithi186 ceph-mon[126480]: pgmap v2711: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 115 KiB/s wr, 25 op/s 2023-05-08T05:07:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:10 smithi133 ceph-mon[125939]: pgmap v2711: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 115 KiB/s wr, 25 op/s 2023-05-08T05:07:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:10 smithi096 ceph-mon[124666]: pgmap v2711: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 115 KiB/s wr, 25 op/s 2023-05-08T05:07:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4969.509450 secs 2023-05-08T05:07:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4969.509450 secs 2023-05-08T05:07:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4969.509450 secs 2023-05-08T05:07:12.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:12 smithi186 ceph-mon[126480]: pgmap v2712: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 115 KiB/s wr, 25 op/s 2023-05-08T05:07:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:12 smithi133 ceph-mon[125939]: pgmap v2712: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 115 KiB/s wr, 25 op/s 2023-05-08T05:07:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:12 smithi096 ceph-mon[124666]: pgmap v2712: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 115 KiB/s wr, 25 op/s 2023-05-08T05:07:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4972.671803 secs 2023-05-08T05:07:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4973.228850 secs 2023-05-08T05:07:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:14 smithi186 ceph-mon[126480]: pgmap v2713: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 115 KiB/s wr, 25 op/s 2023-05-08T05:07:14.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:14 smithi186 ceph-mon[126480]: osdmap e249: 12 total, 12 up, 12 in 2023-05-08T05:07:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4972.671803 secs 2023-05-08T05:07:14.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4973.228850 secs 2023-05-08T05:07:14.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:14 smithi133 ceph-mon[125939]: pgmap v2713: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 115 KiB/s wr, 25 op/s 2023-05-08T05:07:14.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:14 smithi133 ceph-mon[125939]: osdmap e249: 12 total, 12 up, 12 in 2023-05-08T05:07:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4972.671803 secs 2023-05-08T05:07:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4973.228850 secs 2023-05-08T05:07:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:14 smithi096 ceph-mon[124666]: pgmap v2713: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 115 KiB/s wr, 25 op/s 2023-05-08T05:07:15.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:14 smithi096 ceph-mon[124666]: osdmap e249: 12 total, 12 up, 12 in 2023-05-08T05:07:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4974.509572 secs 2023-05-08T05:07:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4974.509572 secs 2023-05-08T05:07:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4974.509572 secs 2023-05-08T05:07:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:16 smithi186 ceph-mon[126480]: pgmap v2715: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 6 op/s 2023-05-08T05:07:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:16 smithi133 ceph-mon[125939]: pgmap v2715: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 6 op/s 2023-05-08T05:07:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:16 smithi096 ceph-mon[124666]: pgmap v2715: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 6 op/s 2023-05-08T05:07:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:18 smithi186 ceph-mon[126480]: pgmap v2716: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 6 op/s 2023-05-08T05:07:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:18 smithi133 ceph-mon[125939]: pgmap v2716: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 6 op/s 2023-05-08T05:07:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:18 smithi096 ceph-mon[124666]: pgmap v2716: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 6 op/s 2023-05-08T05:07:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4977.671920 secs 2023-05-08T05:07:19.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4978.228934 secs 2023-05-08T05:07:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4977.671920 secs 2023-05-08T05:07:19.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4978.228934 secs 2023-05-08T05:07:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4977.671920 secs 2023-05-08T05:07:20.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4978.228934 secs 2023-05-08T05:07:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:20 smithi186 ceph-mon[126480]: pgmap v2717: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 6 op/s 2023-05-08T05:07:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4979.509683 secs 2023-05-08T05:07:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:20 smithi133 ceph-mon[125939]: pgmap v2717: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 6 op/s 2023-05-08T05:07:21.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4979.509683 secs 2023-05-08T05:07:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:20 smithi096 ceph-mon[124666]: pgmap v2717: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 6 op/s 2023-05-08T05:07:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4979.509683 secs 2023-05-08T05:07:23.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:22 smithi186 ceph-mon[126480]: pgmap v2718: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 6 op/s 2023-05-08T05:07:23.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:22 smithi133 ceph-mon[125939]: pgmap v2718: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 6 op/s 2023-05-08T05:07:23.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:22 smithi096 ceph-mon[124666]: pgmap v2718: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 6 op/s 2023-05-08T05:07:24.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4982.672003 secs 2023-05-08T05:07:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4982.672003 secs 2023-05-08T05:07:24.259 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4982.672003 secs 2023-05-08T05:07:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4983.229051 secs 2023-05-08T05:07:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:24 smithi186 ceph-mon[126480]: pgmap v2719: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 6 op/s 2023-05-08T05:07:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4983.229051 secs 2023-05-08T05:07:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:24 smithi133 ceph-mon[125939]: pgmap v2719: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 6 op/s 2023-05-08T05:07:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4983.229051 secs 2023-05-08T05:07:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:24 smithi096 ceph-mon[124666]: pgmap v2719: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 6 op/s 2023-05-08T05:07:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4984.509835 secs 2023-05-08T05:07:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4984.509835 secs 2023-05-08T05:07:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4984.509835 secs 2023-05-08T05:07:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:26 smithi186 ceph-mon[126480]: pgmap v2720: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 26 KiB/s wr, 8 op/s 2023-05-08T05:07:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:26 smithi133 ceph-mon[125939]: pgmap v2720: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 26 KiB/s wr, 8 op/s 2023-05-08T05:07:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:26 smithi096 ceph-mon[124666]: pgmap v2720: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 26 KiB/s wr, 8 op/s 2023-05-08T05:07:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:28 smithi186 ceph-mon[126480]: pgmap v2721: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2023-05-08T05:07:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4987.672123 secs 2023-05-08T05:07:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:28 smithi133 ceph-mon[125939]: pgmap v2721: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2023-05-08T05:07:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4987.672123 secs 2023-05-08T05:07:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:28 smithi096 ceph-mon[124666]: pgmap v2721: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2023-05-08T05:07:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4987.672123 secs 2023-05-08T05:07:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4988.229163 secs 2023-05-08T05:07:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4988.229163 secs 2023-05-08T05:07:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4988.229163 secs 2023-05-08T05:07:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:30 smithi186 ceph-mon[126480]: pgmap v2722: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 7 op/s 2023-05-08T05:07:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4989.509946 secs 2023-05-08T05:07:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:30 smithi133 ceph-mon[125939]: pgmap v2722: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 7 op/s 2023-05-08T05:07:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4989.509946 secs 2023-05-08T05:07:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:30 smithi096 ceph-mon[124666]: pgmap v2722: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 7 op/s 2023-05-08T05:07:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4989.509946 secs 2023-05-08T05:07:33.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:32 smithi186 ceph-mon[126480]: pgmap v2723: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:07:33.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:32 smithi133 ceph-mon[125939]: pgmap v2723: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:07:33.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:32 smithi096 ceph-mon[124666]: pgmap v2723: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:07:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4992.672244 secs 2023-05-08T05:07:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4992.672244 secs 2023-05-08T05:07:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4992.672244 secs 2023-05-08T05:07:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4993.229279 secs 2023-05-08T05:07:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:34 smithi186 ceph-mon[126480]: pgmap v2724: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:07:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4993.229279 secs 2023-05-08T05:07:35.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:34 smithi133 ceph-mon[125939]: pgmap v2724: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:07:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4993.229279 secs 2023-05-08T05:07:35.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:34 smithi096 ceph-mon[124666]: pgmap v2724: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:07:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4994.510012 secs 2023-05-08T05:07:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4994.510012 secs 2023-05-08T05:07:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4994.510012 secs 2023-05-08T05:07:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:36 smithi186 ceph-mon[126480]: pgmap v2725: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 58 KiB/s wr, 8 op/s 2023-05-08T05:07:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:36 smithi133 ceph-mon[125939]: pgmap v2725: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 58 KiB/s wr, 8 op/s 2023-05-08T05:07:37.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:36 smithi096 ceph-mon[124666]: pgmap v2725: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 58 KiB/s wr, 8 op/s 2023-05-08T05:07:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:38 smithi186 ceph-mon[126480]: pgmap v2726: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 58 KiB/s wr, 6 op/s 2023-05-08T05:07:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4997.672356 secs 2023-05-08T05:07:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:38 smithi133 ceph-mon[125939]: pgmap v2726: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 58 KiB/s wr, 6 op/s 2023-05-08T05:07:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4997.672356 secs 2023-05-08T05:07:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:38 smithi096 ceph-mon[124666]: pgmap v2726: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 58 KiB/s wr, 6 op/s 2023-05-08T05:07:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4997.672356 secs 2023-05-08T05:07:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4998.229398 secs 2023-05-08T05:07:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4998.229398 secs 2023-05-08T05:07:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4998.229398 secs 2023-05-08T05:07:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:40 smithi186 ceph-mon[126480]: pgmap v2727: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 110 KiB/s wr, 9 op/s 2023-05-08T05:07:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 4999.510110 secs 2023-05-08T05:07:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:40 smithi133 ceph-mon[125939]: pgmap v2727: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 110 KiB/s wr, 9 op/s 2023-05-08T05:07:41.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 4999.510110 secs 2023-05-08T05:07:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:40 smithi096 ceph-mon[124666]: pgmap v2727: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 110 KiB/s wr, 9 op/s 2023-05-08T05:07:41.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 4999.510110 secs 2023-05-08T05:07:43.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:42 smithi133 ceph-mon[125939]: pgmap v2728: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 110 KiB/s wr, 6 op/s 2023-05-08T05:07:43.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:42 smithi096 ceph-mon[124666]: pgmap v2728: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 110 KiB/s wr, 6 op/s 2023-05-08T05:07:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:42 smithi186 ceph-mon[126480]: pgmap v2728: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 110 KiB/s wr, 6 op/s 2023-05-08T05:07:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5002.672460 secs 2023-05-08T05:07:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5002.672460 secs 2023-05-08T05:07:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5002.672460 secs 2023-05-08T05:07:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5003.229521 secs 2023-05-08T05:07:45.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:44 smithi133 ceph-mon[125939]: pgmap v2729: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 110 KiB/s wr, 6 op/s 2023-05-08T05:07:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5003.229521 secs 2023-05-08T05:07:45.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:44 smithi096 ceph-mon[124666]: pgmap v2729: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 110 KiB/s wr, 6 op/s 2023-05-08T05:07:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5003.229521 secs 2023-05-08T05:07:45.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:44 smithi186 ceph-mon[126480]: pgmap v2729: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 110 KiB/s wr, 6 op/s 2023-05-08T05:07:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5004.510174 secs 2023-05-08T05:07:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5004.510174 secs 2023-05-08T05:07:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5004.510174 secs 2023-05-08T05:07:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:46 smithi133 ceph-mon[125939]: pgmap v2730: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 136 KiB/s wr, 9 op/s 2023-05-08T05:07:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:46 smithi096 ceph-mon[124666]: pgmap v2730: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 136 KiB/s wr, 9 op/s 2023-05-08T05:07:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:46 smithi186 ceph-mon[126480]: pgmap v2730: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 136 KiB/s wr, 9 op/s 2023-05-08T05:07:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:48 smithi133 ceph-mon[125939]: pgmap v2731: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 78 KiB/s wr, 5 op/s 2023-05-08T05:07:49.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5007.672542 secs 2023-05-08T05:07:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:48 smithi096 ceph-mon[124666]: pgmap v2731: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 78 KiB/s wr, 5 op/s 2023-05-08T05:07:49.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5007.672542 secs 2023-05-08T05:07:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:48 smithi186 ceph-mon[126480]: pgmap v2731: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 78 KiB/s wr, 5 op/s 2023-05-08T05:07:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5007.672542 secs 2023-05-08T05:07:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5008.229651 secs 2023-05-08T05:07:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5008.229651 secs 2023-05-08T05:07:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5008.229651 secs 2023-05-08T05:07:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:50 smithi133 ceph-mon[125939]: pgmap v2732: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 78 KiB/s wr, 8 op/s 2023-05-08T05:07:51.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5009.510272 secs 2023-05-08T05:07:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:50 smithi096 ceph-mon[124666]: pgmap v2732: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 78 KiB/s wr, 8 op/s 2023-05-08T05:07:51.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5009.510272 secs 2023-05-08T05:07:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:50 smithi186 ceph-mon[126480]: pgmap v2732: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 78 KiB/s wr, 8 op/s 2023-05-08T05:07:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5009.510272 secs 2023-05-08T05:07:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:52 smithi133 ceph-mon[125939]: pgmap v2733: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 5 op/s 2023-05-08T05:07:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:52 smithi096 ceph-mon[124666]: pgmap v2733: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 5 op/s 2023-05-08T05:07:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:52 smithi186 ceph-mon[126480]: pgmap v2733: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 5 op/s 2023-05-08T05:07:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5012.672662 secs 2023-05-08T05:07:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5012.672662 secs 2023-05-08T05:07:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5012.672662 secs 2023-05-08T05:07:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5013.229795 secs 2023-05-08T05:07:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:54 smithi133 ceph-mon[125939]: pgmap v2734: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 5 op/s 2023-05-08T05:07:55.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5013.229795 secs 2023-05-08T05:07:55.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:54 smithi096 ceph-mon[124666]: pgmap v2734: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 5 op/s 2023-05-08T05:07:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5013.229795 secs 2023-05-08T05:07:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:54 smithi186 ceph-mon[126480]: pgmap v2734: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 5 op/s 2023-05-08T05:07:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5014.510338 secs 2023-05-08T05:07:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5014.510338 secs 2023-05-08T05:07:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5014.510338 secs 2023-05-08T05:07:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:56 smithi133 ceph-mon[125939]: pgmap v2735: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 25 KiB/s wr, 7 op/s 2023-05-08T05:07:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:56 smithi096 ceph-mon[124666]: pgmap v2735: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 25 KiB/s wr, 7 op/s 2023-05-08T05:07:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:56 smithi186 ceph-mon[126480]: pgmap v2735: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 25 KiB/s wr, 7 op/s 2023-05-08T05:07:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:58 smithi133 ceph-mon[125939]: pgmap v2736: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:07:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5017.672775 secs 2023-05-08T05:07:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:58 smithi096 ceph-mon[124666]: pgmap v2736: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:07:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5017.672775 secs 2023-05-08T05:07:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:58 smithi186 ceph-mon[126480]: pgmap v2736: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:07:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5017.672775 secs 2023-05-08T05:08:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:07:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5018.229909 secs 2023-05-08T05:08:00.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:07:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5018.229909 secs 2023-05-08T05:08:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:07:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5018.229909 secs 2023-05-08T05:08:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:00 smithi133 ceph-mon[125939]: pgmap v2737: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T05:08:01.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5019.510461 secs 2023-05-08T05:08:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:00 smithi096 ceph-mon[124666]: pgmap v2737: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T05:08:01.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5019.510461 secs 2023-05-08T05:08:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:00 smithi186 ceph-mon[126480]: pgmap v2737: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T05:08:01.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5019.510461 secs 2023-05-08T05:08:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:02 smithi133 ceph-mon[125939]: pgmap v2738: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:08:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:02 smithi096 ceph-mon[124666]: pgmap v2738: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:08:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:02 smithi186 ceph-mon[126480]: pgmap v2738: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:08:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5022.672892 secs 2023-05-08T05:08:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5022.672892 secs 2023-05-08T05:08:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5022.672892 secs 2023-05-08T05:08:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5023.230024 secs 2023-05-08T05:08:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:04 smithi133 ceph-mon[125939]: pgmap v2739: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:08:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5023.230024 secs 2023-05-08T05:08:05.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:04 smithi096 ceph-mon[124666]: pgmap v2739: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:08:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5023.230024 secs 2023-05-08T05:08:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:04 smithi186 ceph-mon[126480]: pgmap v2739: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:08:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5024.510584 secs 2023-05-08T05:08:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:05 smithi133 ceph-mon[125939]: osdmap e250: 12 total, 12 up, 12 in 2023-05-08T05:08:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5024.510584 secs 2023-05-08T05:08:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:05 smithi096 ceph-mon[124666]: osdmap e250: 12 total, 12 up, 12 in 2023-05-08T05:08:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5024.510584 secs 2023-05-08T05:08:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:05 smithi186 ceph-mon[126480]: osdmap e250: 12 total, 12 up, 12 in 2023-05-08T05:08:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:06 smithi133 ceph-mon[125939]: pgmap v2741: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 115 KiB/s wr, 24 op/s 2023-05-08T05:08:07.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:06 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:08:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:06 smithi096 ceph-mon[124666]: pgmap v2741: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 115 KiB/s wr, 24 op/s 2023-05-08T05:08:07.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:06 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:08:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:06 smithi186 ceph-mon[126480]: pgmap v2741: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 115 KiB/s wr, 24 op/s 2023-05-08T05:08:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:06 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:08:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:07 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:08:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:07 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:08:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:07 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:08:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:07 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:08:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:07 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:08:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:07 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:08:08.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:07 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:08:08.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:07 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:08:08.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:07 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:08:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:08 smithi133 ceph-mon[125939]: pgmap v2742: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 115 KiB/s wr, 25 op/s 2023-05-08T05:08:09.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:08 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:08:09.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:08 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T05:08:09.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:08 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T05:08:09.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:08 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:08:09.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5027.673045 secs 2023-05-08T05:08:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:08 smithi096 ceph-mon[124666]: pgmap v2742: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 115 KiB/s wr, 25 op/s 2023-05-08T05:08:09.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:08 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:08:09.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:08 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T05:08:09.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:08 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T05:08:09.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:08 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:08:09.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5027.673045 secs 2023-05-08T05:08:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:08 smithi186 ceph-mon[126480]: pgmap v2742: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 115 KiB/s wr, 25 op/s 2023-05-08T05:08:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:08 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:08:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:08 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T05:08:09.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:08 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T05:08:09.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:08 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:08:09.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5027.673045 secs 2023-05-08T05:08:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5028.230148 secs 2023-05-08T05:08:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5028.230148 secs 2023-05-08T05:08:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5028.230148 secs 2023-05-08T05:08:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:10 smithi133 ceph-mon[125939]: pgmap v2743: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 115 KiB/s wr, 25 op/s 2023-05-08T05:08:11.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5029.510679 secs 2023-05-08T05:08:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:10 smithi096 ceph-mon[124666]: pgmap v2743: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 115 KiB/s wr, 25 op/s 2023-05-08T05:08:11.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5029.510679 secs 2023-05-08T05:08:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:10 smithi186 ceph-mon[126480]: pgmap v2743: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 115 KiB/s wr, 25 op/s 2023-05-08T05:08:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5029.510679 secs 2023-05-08T05:08:13.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:12 smithi133 ceph-mon[125939]: pgmap v2744: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 115 KiB/s wr, 25 op/s 2023-05-08T05:08:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:12 smithi096 ceph-mon[124666]: pgmap v2744: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 115 KiB/s wr, 25 op/s 2023-05-08T05:08:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:12 smithi186 ceph-mon[126480]: pgmap v2744: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 115 KiB/s wr, 25 op/s 2023-05-08T05:08:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5032.673175 secs 2023-05-08T05:08:14.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:13 smithi133 ceph-mon[125939]: osdmap e251: 12 total, 12 up, 12 in 2023-05-08T05:08:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5032.673175 secs 2023-05-08T05:08:14.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:13 smithi096 ceph-mon[124666]: osdmap e251: 12 total, 12 up, 12 in 2023-05-08T05:08:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5032.673175 secs 2023-05-08T05:08:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:13 smithi186 ceph-mon[126480]: osdmap e251: 12 total, 12 up, 12 in 2023-05-08T05:08:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5033.230280 secs 2023-05-08T05:08:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:14 smithi133 ceph-mon[125939]: pgmap v2745: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 115 KiB/s wr, 25 op/s 2023-05-08T05:08:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5033.230280 secs 2023-05-08T05:08:15.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:14 smithi096 ceph-mon[124666]: pgmap v2745: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 115 KiB/s wr, 25 op/s 2023-05-08T05:08:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5033.230280 secs 2023-05-08T05:08:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:14 smithi186 ceph-mon[126480]: pgmap v2745: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 115 KiB/s wr, 25 op/s 2023-05-08T05:08:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5034.510817 secs 2023-05-08T05:08:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5034.510817 secs 2023-05-08T05:08:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5034.510817 secs 2023-05-08T05:08:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:16 smithi133 ceph-mon[125939]: pgmap v2747: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 7 op/s 2023-05-08T05:08:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:16 smithi096 ceph-mon[124666]: pgmap v2747: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 7 op/s 2023-05-08T05:08:17.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:16 smithi186 ceph-mon[126480]: pgmap v2747: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 7 op/s 2023-05-08T05:08:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:18 smithi133 ceph-mon[125939]: pgmap v2748: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 7 op/s 2023-05-08T05:08:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5037.673290 secs 2023-05-08T05:08:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:18 smithi096 ceph-mon[124666]: pgmap v2748: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 7 op/s 2023-05-08T05:08:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5037.673290 secs 2023-05-08T05:08:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:18 smithi186 ceph-mon[126480]: pgmap v2748: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 7 op/s 2023-05-08T05:08:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5037.673290 secs 2023-05-08T05:08:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5038.230416 secs 2023-05-08T05:08:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5038.230416 secs 2023-05-08T05:08:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5038.230416 secs 2023-05-08T05:08:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:20 smithi096 ceph-mon[124666]: pgmap v2749: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 7 op/s 2023-05-08T05:08:21.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5039.510915 secs 2023-05-08T05:08:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:20 smithi186 ceph-mon[126480]: pgmap v2749: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 7 op/s 2023-05-08T05:08:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5039.510915 secs 2023-05-08T05:08:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:20 smithi133 ceph-mon[125939]: pgmap v2749: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 7 op/s 2023-05-08T05:08:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5039.510915 secs 2023-05-08T05:08:23.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:22 smithi096 ceph-mon[124666]: pgmap v2750: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 7 op/s 2023-05-08T05:08:23.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:22 smithi186 ceph-mon[126480]: pgmap v2750: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 7 op/s 2023-05-08T05:08:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:22 smithi133 ceph-mon[125939]: pgmap v2750: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 7 op/s 2023-05-08T05:08:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5042.673410 secs 2023-05-08T05:08:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5042.673410 secs 2023-05-08T05:08:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5042.673410 secs 2023-05-08T05:08:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5043.230528 secs 2023-05-08T05:08:25.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:25 smithi096 ceph-mon[124666]: pgmap v2751: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 7 op/s 2023-05-08T05:08:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5043.230528 secs 2023-05-08T05:08:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:25 smithi186 ceph-mon[126480]: pgmap v2751: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 7 op/s 2023-05-08T05:08:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5043.230528 secs 2023-05-08T05:08:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:25 smithi133 ceph-mon[125939]: pgmap v2751: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 7 op/s 2023-05-08T05:08:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5044.510981 secs 2023-05-08T05:08:26.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5044.510981 secs 2023-05-08T05:08:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5044.510981 secs 2023-05-08T05:08:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:27 smithi186 ceph-mon[126480]: pgmap v2752: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 26 KiB/s wr, 9 op/s 2023-05-08T05:08:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:27 smithi133 ceph-mon[125939]: pgmap v2752: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 26 KiB/s wr, 9 op/s 2023-05-08T05:08:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:27 smithi096 ceph-mon[124666]: pgmap v2752: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 26 KiB/s wr, 9 op/s 2023-05-08T05:08:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:29 smithi186 ceph-mon[126480]: pgmap v2753: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2023-05-08T05:08:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5047.673563 secs 2023-05-08T05:08:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:29 smithi133 ceph-mon[125939]: pgmap v2753: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2023-05-08T05:08:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5047.673563 secs 2023-05-08T05:08:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:29 smithi096 ceph-mon[124666]: pgmap v2753: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2023-05-08T05:08:29.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5047.673563 secs 2023-05-08T05:08:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5048.230618 secs 2023-05-08T05:08:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5048.230618 secs 2023-05-08T05:08:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5048.230618 secs 2023-05-08T05:08:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:31 smithi186 ceph-mon[126480]: pgmap v2754: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 8 op/s 2023-05-08T05:08:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5049.511095 secs 2023-05-08T05:08:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:31 smithi133 ceph-mon[125939]: pgmap v2754: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 8 op/s 2023-05-08T05:08:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5049.511095 secs 2023-05-08T05:08:31.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:31 smithi096 ceph-mon[124666]: pgmap v2754: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 8 op/s 2023-05-08T05:08:31.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5049.511095 secs 2023-05-08T05:08:33.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:33 smithi186 ceph-mon[126480]: pgmap v2755: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:08:33.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:33 smithi133 ceph-mon[125939]: pgmap v2755: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:08:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:33 smithi096 ceph-mon[124666]: pgmap v2755: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:08:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5052.673670 secs 2023-05-08T05:08:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5052.673670 secs 2023-05-08T05:08:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5052.673670 secs 2023-05-08T05:08:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5053.230732 secs 2023-05-08T05:08:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:35 smithi186 ceph-mon[126480]: pgmap v2756: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:08:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5053.230732 secs 2023-05-08T05:08:35.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:35 smithi133 ceph-mon[125939]: pgmap v2756: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:08:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5053.230732 secs 2023-05-08T05:08:35.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:35 smithi096 ceph-mon[124666]: pgmap v2756: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:08:37.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:37 smithi186 ceph-mon[126480]: pgmap v2757: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 83 KiB/s wr, 9 op/s 2023-05-08T05:08:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:37 smithi133 ceph-mon[125939]: pgmap v2757: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 83 KiB/s wr, 9 op/s 2023-05-08T05:08:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:37 smithi096 ceph-mon[124666]: pgmap v2757: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 83 KiB/s wr, 9 op/s 2023-05-08T05:08:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:38 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:08:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:38 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:08:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:38 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:08:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:39 smithi186 ceph-mon[126480]: pgmap v2758: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 83 KiB/s wr, 6 op/s 2023-05-08T05:08:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5057.673758 secs 2023-05-08T05:08:39.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:39 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:08:39.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:39 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:08:39.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:39 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:08:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:39 smithi133 ceph-mon[125939]: pgmap v2758: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 83 KiB/s wr, 6 op/s 2023-05-08T05:08:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5057.673758 secs 2023-05-08T05:08:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:39 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:08:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:39 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:08:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:39 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:08:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:39 smithi096 ceph-mon[124666]: pgmap v2758: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 83 KiB/s wr, 6 op/s 2023-05-08T05:08:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5057.673758 secs 2023-05-08T05:08:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:39 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:08:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:39 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:08:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:39 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:08:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5058.230843 secs 2023-05-08T05:08:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5058.230843 secs 2023-05-08T05:08:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5058.230843 secs 2023-05-08T05:08:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:41 smithi186 ceph-mon[126480]: pgmap v2759: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 131 KiB/s wr, 10 op/s 2023-05-08T05:08:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5059.511341 secs 2023-05-08T05:08:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:41 smithi133 ceph-mon[125939]: pgmap v2759: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 131 KiB/s wr, 10 op/s 2023-05-08T05:08:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5059.511341 secs 2023-05-08T05:08:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:41 smithi096 ceph-mon[124666]: pgmap v2759: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 131 KiB/s wr, 10 op/s 2023-05-08T05:08:41.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5059.511341 secs 2023-05-08T05:08:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:43 smithi186 ceph-mon[126480]: pgmap v2760: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 131 KiB/s wr, 7 op/s 2023-05-08T05:08:43.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:08:43.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:08:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:43 smithi133 ceph-mon[125939]: pgmap v2760: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 131 KiB/s wr, 7 op/s 2023-05-08T05:08:43.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:08:43.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:08:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:43 smithi096 ceph-mon[124666]: pgmap v2760: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 131 KiB/s wr, 7 op/s 2023-05-08T05:08:43.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:08:43.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:08:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5062.673877 secs 2023-05-08T05:08:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:44 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:08:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5062.673877 secs 2023-05-08T05:08:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:44 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:08:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5062.673877 secs 2023-05-08T05:08:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:44 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:08:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5063.230942 secs 2023-05-08T05:08:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:45 smithi186 ceph-mon[126480]: pgmap v2761: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 131 KiB/s wr, 7 op/s 2023-05-08T05:08:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5063.230942 secs 2023-05-08T05:08:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:45 smithi133 ceph-mon[125939]: pgmap v2761: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 131 KiB/s wr, 7 op/s 2023-05-08T05:08:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5063.230942 secs 2023-05-08T05:08:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:45 smithi096 ceph-mon[124666]: pgmap v2761: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 131 KiB/s wr, 7 op/s 2023-05-08T05:08:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5064.511453 secs 2023-05-08T05:08:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5064.511453 secs 2023-05-08T05:08:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5064.511453 secs 2023-05-08T05:08:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:47 smithi186 ceph-mon[126480]: pgmap v2762: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 183 KiB/s wr, 10 op/s 2023-05-08T05:08:47.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:47 smithi133 ceph-mon[125939]: pgmap v2762: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 183 KiB/s wr, 10 op/s 2023-05-08T05:08:47.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:47 smithi096 ceph-mon[124666]: pgmap v2762: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 183 KiB/s wr, 10 op/s 2023-05-08T05:08:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:49 smithi186 ceph-mon[126480]: pgmap v2763: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 100 KiB/s wr, 6 op/s 2023-05-08T05:08:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5067.673993 secs 2023-05-08T05:08:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:49 smithi133 ceph-mon[125939]: pgmap v2763: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 100 KiB/s wr, 6 op/s 2023-05-08T05:08:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5067.673993 secs 2023-05-08T05:08:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:49 smithi096 ceph-mon[124666]: pgmap v2763: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 100 KiB/s wr, 6 op/s 2023-05-08T05:08:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5067.673993 secs 2023-05-08T05:08:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5068.231059 secs 2023-05-08T05:08:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5068.231059 secs 2023-05-08T05:08:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5068.231059 secs 2023-05-08T05:08:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:51 smithi186 ceph-mon[126480]: pgmap v2764: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 100 KiB/s wr, 8 op/s 2023-05-08T05:08:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5069.511585 secs 2023-05-08T05:08:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:51 smithi133 ceph-mon[125939]: pgmap v2764: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 100 KiB/s wr, 8 op/s 2023-05-08T05:08:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5069.511585 secs 2023-05-08T05:08:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:51 smithi096 ceph-mon[124666]: pgmap v2764: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 100 KiB/s wr, 8 op/s 2023-05-08T05:08:51.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5069.511585 secs 2023-05-08T05:08:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:53 smithi186 ceph-mon[126480]: pgmap v2765: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 KiB/s wr, 5 op/s 2023-05-08T05:08:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:53 smithi133 ceph-mon[125939]: pgmap v2765: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 KiB/s wr, 5 op/s 2023-05-08T05:08:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:53 smithi096 ceph-mon[124666]: pgmap v2765: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 KiB/s wr, 5 op/s 2023-05-08T05:08:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5072.674103 secs 2023-05-08T05:08:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5072.674103 secs 2023-05-08T05:08:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5072.674103 secs 2023-05-08T05:08:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5073.231167 secs 2023-05-08T05:08:55.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:55 smithi186 ceph-mon[126480]: pgmap v2766: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 KiB/s wr, 5 op/s 2023-05-08T05:08:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5073.231167 secs 2023-05-08T05:08:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:55 smithi133 ceph-mon[125939]: pgmap v2766: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 KiB/s wr, 5 op/s 2023-05-08T05:08:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5073.231167 secs 2023-05-08T05:08:55.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:55 smithi096 ceph-mon[124666]: pgmap v2766: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 KiB/s wr, 5 op/s 2023-05-08T05:08:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5074.511725 secs 2023-05-08T05:08:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5074.511725 secs 2023-05-08T05:08:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5074.511725 secs 2023-05-08T05:08:57.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:57 smithi186 ceph-mon[126480]: pgmap v2767: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 52 KiB/s wr, 8 op/s 2023-05-08T05:08:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:57 smithi133 ceph-mon[125939]: pgmap v2767: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 52 KiB/s wr, 8 op/s 2023-05-08T05:08:57.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:57 smithi096 ceph-mon[124666]: pgmap v2767: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 52 KiB/s wr, 8 op/s 2023-05-08T05:08:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:59 smithi186 ceph-mon[126480]: pgmap v2768: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:08:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:08:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5077.674198 secs 2023-05-08T05:08:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:59 smithi133 ceph-mon[125939]: pgmap v2768: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:08:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:08:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5077.674198 secs 2023-05-08T05:08:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:59 smithi096 ceph-mon[124666]: pgmap v2768: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:08:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:08:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5077.674198 secs 2023-05-08T05:09:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5078.231300 secs 2023-05-08T05:09:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5078.231300 secs 2023-05-08T05:09:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5078.231300 secs 2023-05-08T05:09:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:01 smithi133 ceph-mon[125939]: pgmap v2769: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T05:09:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5079.511845 secs 2023-05-08T05:09:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:01 smithi096 ceph-mon[124666]: pgmap v2769: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T05:09:01.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5079.511845 secs 2023-05-08T05:09:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:01 smithi186 ceph-mon[126480]: pgmap v2769: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T05:09:01.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5079.511845 secs 2023-05-08T05:09:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:03 smithi133 ceph-mon[125939]: pgmap v2770: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:09:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:03 smithi096 ceph-mon[124666]: pgmap v2770: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:09:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:03 smithi186 ceph-mon[126480]: pgmap v2770: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:09:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5082.674299 secs 2023-05-08T05:09:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5082.674299 secs 2023-05-08T05:09:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5082.674299 secs 2023-05-08T05:09:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5083.231392 secs 2023-05-08T05:09:05.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:05 smithi133 ceph-mon[125939]: pgmap v2771: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:09:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5083.231392 secs 2023-05-08T05:09:05.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:05 smithi096 ceph-mon[124666]: pgmap v2771: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:09:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5083.231392 secs 2023-05-08T05:09:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:05 smithi186 ceph-mon[126480]: pgmap v2771: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:09:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5084.511947 secs 2023-05-08T05:09:06.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:06 smithi133 ceph-mon[125939]: osdmap e252: 12 total, 12 up, 12 in 2023-05-08T05:09:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5084.511947 secs 2023-05-08T05:09:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:06 smithi096 ceph-mon[124666]: osdmap e252: 12 total, 12 up, 12 in 2023-05-08T05:09:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5084.511947 secs 2023-05-08T05:09:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:06 smithi186 ceph-mon[126480]: osdmap e252: 12 total, 12 up, 12 in 2023-05-08T05:09:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:07 smithi133 ceph-mon[125939]: pgmap v2773: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 115 KiB/s wr, 24 op/s 2023-05-08T05:09:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:07 smithi096 ceph-mon[124666]: pgmap v2773: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 115 KiB/s wr, 24 op/s 2023-05-08T05:09:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:07 smithi186 ceph-mon[126480]: pgmap v2773: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 115 KiB/s wr, 24 op/s 2023-05-08T05:09:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:08 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:09:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:08 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:09:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:08 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:09:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:09 smithi133 ceph-mon[125939]: pgmap v2774: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 115 KiB/s wr, 24 op/s 2023-05-08T05:09:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5087.674397 secs 2023-05-08T05:09:09.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:09 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:09:09.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:09 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:09:09.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:09 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:09:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:09 smithi096 ceph-mon[124666]: pgmap v2774: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 115 KiB/s wr, 24 op/s 2023-05-08T05:09:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5087.674397 secs 2023-05-08T05:09:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:09 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:09:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:09 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:09:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:09 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:09:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:09 smithi186 ceph-mon[126480]: pgmap v2774: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 115 KiB/s wr, 24 op/s 2023-05-08T05:09:09.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5087.674397 secs 2023-05-08T05:09:09.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:09 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:09:09.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:09 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:09:09.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:09 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:09:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:10 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:09:10.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:10 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T05:09:10.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:10 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T05:09:10.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:10 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:09:10.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5088.231546 secs 2023-05-08T05:09:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:10 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:09:10.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:10 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T05:09:10.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:10 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T05:09:10.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:10 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:09:10.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5088.231546 secs 2023-05-08T05:09:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:10 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:09:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:10 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T05:09:10.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:10 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T05:09:10.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:10 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:09:10.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5088.231546 secs 2023-05-08T05:09:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:11 smithi133 ceph-mon[125939]: pgmap v2775: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 116 KiB/s wr, 25 op/s 2023-05-08T05:09:11.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5089.512063 secs 2023-05-08T05:09:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:11 smithi096 ceph-mon[124666]: pgmap v2775: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 116 KiB/s wr, 25 op/s 2023-05-08T05:09:11.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5089.512063 secs 2023-05-08T05:09:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:11 smithi186 ceph-mon[126480]: pgmap v2775: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 116 KiB/s wr, 25 op/s 2023-05-08T05:09:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5089.512063 secs 2023-05-08T05:09:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:13 smithi133 ceph-mon[125939]: pgmap v2776: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 116 KiB/s wr, 25 op/s 2023-05-08T05:09:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:13 smithi096 ceph-mon[124666]: pgmap v2776: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 116 KiB/s wr, 25 op/s 2023-05-08T05:09:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:13 smithi186 ceph-mon[126480]: pgmap v2776: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 116 KiB/s wr, 25 op/s 2023-05-08T05:09:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5092.674502 secs 2023-05-08T05:09:14.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:14 smithi133 ceph-mon[125939]: osdmap e253: 12 total, 12 up, 12 in 2023-05-08T05:09:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5092.674502 secs 2023-05-08T05:09:14.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:14 smithi096 ceph-mon[124666]: osdmap e253: 12 total, 12 up, 12 in 2023-05-08T05:09:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5092.674502 secs 2023-05-08T05:09:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:14 smithi186 ceph-mon[126480]: osdmap e253: 12 total, 12 up, 12 in 2023-05-08T05:09:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5093.231671 secs 2023-05-08T05:09:15.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:15 smithi133 ceph-mon[125939]: pgmap v2777: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 116 KiB/s wr, 25 op/s 2023-05-08T05:09:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5093.231671 secs 2023-05-08T05:09:15.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:15 smithi096 ceph-mon[124666]: pgmap v2777: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 116 KiB/s wr, 25 op/s 2023-05-08T05:09:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5093.231671 secs 2023-05-08T05:09:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:15 smithi186 ceph-mon[126480]: pgmap v2777: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 116 KiB/s wr, 25 op/s 2023-05-08T05:09:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5094.512159 secs 2023-05-08T05:09:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5094.512159 secs 2023-05-08T05:09:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5094.512159 secs 2023-05-08T05:09:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:17 smithi133 ceph-mon[125939]: pgmap v2779: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 7 op/s 2023-05-08T05:09:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:17 smithi096 ceph-mon[124666]: pgmap v2779: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 7 op/s 2023-05-08T05:09:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:17 smithi186 ceph-mon[126480]: pgmap v2779: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 7 op/s 2023-05-08T05:09:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:19 smithi133 ceph-mon[125939]: pgmap v2780: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 7 op/s 2023-05-08T05:09:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5097.674599 secs 2023-05-08T05:09:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:19 smithi096 ceph-mon[124666]: pgmap v2780: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 7 op/s 2023-05-08T05:09:19.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5097.674599 secs 2023-05-08T05:09:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:19 smithi186 ceph-mon[126480]: pgmap v2780: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 7 op/s 2023-05-08T05:09:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5097.674599 secs 2023-05-08T05:09:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5098.231787 secs 2023-05-08T05:09:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5098.231787 secs 2023-05-08T05:09:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5098.231787 secs 2023-05-08T05:09:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:21 smithi133 ceph-mon[125939]: pgmap v2781: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 6 op/s 2023-05-08T05:09:21.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5099.512252 secs 2023-05-08T05:09:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:21 smithi096 ceph-mon[124666]: pgmap v2781: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 6 op/s 2023-05-08T05:09:21.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5099.512252 secs 2023-05-08T05:09:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:21 smithi186 ceph-mon[126480]: pgmap v2781: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 6 op/s 2023-05-08T05:09:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5099.512252 secs 2023-05-08T05:09:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:23 smithi133 ceph-mon[125939]: pgmap v2782: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 6 op/s 2023-05-08T05:09:23.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:23 smithi096 ceph-mon[124666]: pgmap v2782: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 6 op/s 2023-05-08T05:09:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:23 smithi186 ceph-mon[126480]: pgmap v2782: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 6 op/s 2023-05-08T05:09:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5102.674712 secs 2023-05-08T05:09:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5103.231929 secs 2023-05-08T05:09:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5102.674712 secs 2023-05-08T05:09:24.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5103.231929 secs 2023-05-08T05:09:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5102.674712 secs 2023-05-08T05:09:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5103.231929 secs 2023-05-08T05:09:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:25 smithi133 ceph-mon[125939]: pgmap v2783: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 6 op/s 2023-05-08T05:09:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:25 smithi096 ceph-mon[124666]: pgmap v2783: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 6 op/s 2023-05-08T05:09:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:25 smithi186 ceph-mon[126480]: pgmap v2783: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 6 op/s 2023-05-08T05:09:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5104.512372 secs 2023-05-08T05:09:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5104.512372 secs 2023-05-08T05:09:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5104.512372 secs 2023-05-08T05:09:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:27 smithi133 ceph-mon[125939]: pgmap v2784: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 26 KiB/s wr, 8 op/s 2023-05-08T05:09:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:27 smithi096 ceph-mon[124666]: pgmap v2784: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 26 KiB/s wr, 8 op/s 2023-05-08T05:09:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:27 smithi186 ceph-mon[126480]: pgmap v2784: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 26 KiB/s wr, 8 op/s 2023-05-08T05:09:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:29 smithi133 ceph-mon[125939]: pgmap v2785: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:09:29.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5107.674825 secs 2023-05-08T05:09:29.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5108.232041 secs 2023-05-08T05:09:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:29 smithi096 ceph-mon[124666]: pgmap v2785: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:09:29.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5107.674825 secs 2023-05-08T05:09:29.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5108.232041 secs 2023-05-08T05:09:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:29 smithi186 ceph-mon[126480]: pgmap v2785: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:09:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5107.674825 secs 2023-05-08T05:09:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5108.232041 secs 2023-05-08T05:09:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:31 smithi133 ceph-mon[125939]: pgmap v2786: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T05:09:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5109.512507 secs 2023-05-08T05:09:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:31 smithi096 ceph-mon[124666]: pgmap v2786: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T05:09:31.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5109.512507 secs 2023-05-08T05:09:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:31 smithi186 ceph-mon[126480]: pgmap v2786: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T05:09:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5109.512507 secs 2023-05-08T05:09:33.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:33 smithi133 ceph-mon[125939]: pgmap v2787: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:09:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:33 smithi096 ceph-mon[124666]: pgmap v2787: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:09:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:33 smithi186 ceph-mon[126480]: pgmap v2787: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:09:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5112.674944 secs 2023-05-08T05:09:34.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5113.232157 secs 2023-05-08T05:09:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5112.674944 secs 2023-05-08T05:09:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5113.232157 secs 2023-05-08T05:09:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5112.674944 secs 2023-05-08T05:09:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5113.232157 secs 2023-05-08T05:09:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:35 smithi096 ceph-mon[124666]: pgmap v2788: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:09:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:35 smithi186 ceph-mon[126480]: pgmap v2788: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:09:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:35 smithi133 ceph-mon[125939]: pgmap v2788: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:09:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:37 smithi096 ceph-mon[124666]: pgmap v2789: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 81 KiB/s wr, 8 op/s 2023-05-08T05:09:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:37 smithi186 ceph-mon[126480]: pgmap v2789: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 81 KiB/s wr, 8 op/s 2023-05-08T05:09:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:37 smithi133 ceph-mon[125939]: pgmap v2789: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 81 KiB/s wr, 8 op/s 2023-05-08T05:09:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:38 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:09:38.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:38 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:09:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:38 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:09:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:39 smithi186 ceph-mon[126480]: pgmap v2790: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 81 KiB/s wr, 6 op/s 2023-05-08T05:09:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5117.675063 secs 2023-05-08T05:09:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:39 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:09:39.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:39 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:09:39.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:39 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:09:39.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5118.232273 secs 2023-05-08T05:09:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:39 smithi133 ceph-mon[125939]: pgmap v2790: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 81 KiB/s wr, 6 op/s 2023-05-08T05:09:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5117.675063 secs 2023-05-08T05:09:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:39 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:09:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:39 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:09:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:39 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:09:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5118.232273 secs 2023-05-08T05:09:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:39 smithi096 ceph-mon[124666]: pgmap v2790: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 81 KiB/s wr, 6 op/s 2023-05-08T05:09:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5117.675063 secs 2023-05-08T05:09:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:39 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:09:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:39 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:09:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:39 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:09:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5118.232273 secs 2023-05-08T05:09:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:41 smithi186 ceph-mon[126480]: pgmap v2791: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 143 KiB/s wr, 10 op/s 2023-05-08T05:09:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5119.512760 secs 2023-05-08T05:09:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:41 smithi133 ceph-mon[125939]: pgmap v2791: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 143 KiB/s wr, 10 op/s 2023-05-08T05:09:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5119.512760 secs 2023-05-08T05:09:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:41 smithi096 ceph-mon[124666]: pgmap v2791: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 143 KiB/s wr, 10 op/s 2023-05-08T05:09:41.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5119.512760 secs 2023-05-08T05:09:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:43 smithi186 ceph-mon[126480]: pgmap v2792: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 143 KiB/s wr, 7 op/s 2023-05-08T05:09:43.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:09:43.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:09:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:43 smithi133 ceph-mon[125939]: pgmap v2792: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 143 KiB/s wr, 7 op/s 2023-05-08T05:09:43.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:09:43.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:09:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:43 smithi096 ceph-mon[124666]: pgmap v2792: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 143 KiB/s wr, 7 op/s 2023-05-08T05:09:43.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:09:43.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:09:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5122.675177 secs 2023-05-08T05:09:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5123.232349 secs 2023-05-08T05:09:44.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:44 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:09:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5122.675177 secs 2023-05-08T05:09:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5123.232349 secs 2023-05-08T05:09:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:44 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:09:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5122.675177 secs 2023-05-08T05:09:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5123.232349 secs 2023-05-08T05:09:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:44 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:09:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:45 smithi186 ceph-mon[126480]: pgmap v2793: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 143 KiB/s wr, 7 op/s 2023-05-08T05:09:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:45 smithi133 ceph-mon[125939]: pgmap v2793: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 143 KiB/s wr, 7 op/s 2023-05-08T05:09:45.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:45 smithi096 ceph-mon[124666]: pgmap v2793: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 143 KiB/s wr, 7 op/s 2023-05-08T05:09:46.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5124.512860 secs 2023-05-08T05:09:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5124.512860 secs 2023-05-08T05:09:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5124.512860 secs 2023-05-08T05:09:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:47 smithi186 ceph-mon[126480]: pgmap v2794: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 173 KiB/s wr, 11 op/s 2023-05-08T05:09:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:47 smithi133 ceph-mon[125939]: pgmap v2794: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 173 KiB/s wr, 11 op/s 2023-05-08T05:09:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:47 smithi096 ceph-mon[124666]: pgmap v2794: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 173 KiB/s wr, 11 op/s 2023-05-08T05:09:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:49 smithi186 ceph-mon[126480]: pgmap v2795: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 91 KiB/s wr, 7 op/s 2023-05-08T05:09:49.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5127.675312 secs 2023-05-08T05:09:49.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5128.232489 secs 2023-05-08T05:09:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:49 smithi133 ceph-mon[125939]: pgmap v2795: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 91 KiB/s wr, 7 op/s 2023-05-08T05:09:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5127.675312 secs 2023-05-08T05:09:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5128.232489 secs 2023-05-08T05:09:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:49 smithi096 ceph-mon[124666]: pgmap v2795: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 91 KiB/s wr, 7 op/s 2023-05-08T05:09:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5127.675312 secs 2023-05-08T05:09:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5128.232489 secs 2023-05-08T05:09:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:51 smithi186 ceph-mon[126480]: pgmap v2796: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 91 KiB/s wr, 10 op/s 2023-05-08T05:09:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5129.512976 secs 2023-05-08T05:09:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:51 smithi133 ceph-mon[125939]: pgmap v2796: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 91 KiB/s wr, 10 op/s 2023-05-08T05:09:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5129.512976 secs 2023-05-08T05:09:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:51 smithi096 ceph-mon[124666]: pgmap v2796: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 91 KiB/s wr, 10 op/s 2023-05-08T05:09:51.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5129.512976 secs 2023-05-08T05:09:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:53 smithi186 ceph-mon[126480]: pgmap v2797: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 6 op/s 2023-05-08T05:09:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:53 smithi133 ceph-mon[125939]: pgmap v2797: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 6 op/s 2023-05-08T05:09:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:53 smithi096 ceph-mon[124666]: pgmap v2797: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 6 op/s 2023-05-08T05:09:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5132.675426 secs 2023-05-08T05:09:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5133.232611 secs 2023-05-08T05:09:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5132.675426 secs 2023-05-08T05:09:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5133.232611 secs 2023-05-08T05:09:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5132.675426 secs 2023-05-08T05:09:54.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5133.232611 secs 2023-05-08T05:09:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:55 smithi186 ceph-mon[126480]: pgmap v2798: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 6 op/s 2023-05-08T05:09:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:55 smithi133 ceph-mon[125939]: pgmap v2798: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 6 op/s 2023-05-08T05:09:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:55 smithi096 ceph-mon[124666]: pgmap v2798: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 6 op/s 2023-05-08T05:09:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5134.513094 secs 2023-05-08T05:09:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5134.513094 secs 2023-05-08T05:09:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5134.513094 secs 2023-05-08T05:09:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:57 smithi186 ceph-mon[126480]: pgmap v2799: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 9 op/s 2023-05-08T05:09:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:57 smithi133 ceph-mon[125939]: pgmap v2799: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 9 op/s 2023-05-08T05:09:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:57 smithi096 ceph-mon[124666]: pgmap v2799: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 9 op/s 2023-05-08T05:09:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:59 smithi186 ceph-mon[126480]: pgmap v2800: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:09:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5137.675543 secs 2023-05-08T05:09:59.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:09:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5138.232735 secs 2023-05-08T05:09:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:59 smithi133 ceph-mon[125939]: pgmap v2800: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:09:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5137.675543 secs 2023-05-08T05:09:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:09:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5138.232735 secs 2023-05-08T05:09:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:59 smithi096 ceph-mon[124666]: pgmap v2800: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:09:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5137.675543 secs 2023-05-08T05:09:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:09:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5138.232735 secs 2023-05-08T05:10:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:00 smithi186 ceph-mon[126480]: overall HEALTH_WARN 3 MDSs report slow requests 2023-05-08T05:10:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:00 smithi133 ceph-mon[125939]: overall HEALTH_WARN 3 MDSs report slow requests 2023-05-08T05:10:00.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:00 smithi096 ceph-mon[124666]: overall HEALTH_WARN 3 MDSs report slow requests 2023-05-08T05:10:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:01 smithi186 ceph-mon[126480]: pgmap v2801: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T05:10:01.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5139.513208 secs 2023-05-08T05:10:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:01 smithi133 ceph-mon[125939]: pgmap v2801: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T05:10:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5139.513208 secs 2023-05-08T05:10:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:01 smithi096 ceph-mon[124666]: pgmap v2801: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T05:10:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5139.513208 secs 2023-05-08T05:10:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:03 smithi186 ceph-mon[126480]: pgmap v2802: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:10:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:03 smithi133 ceph-mon[125939]: pgmap v2802: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:10:03.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:03 smithi096 ceph-mon[124666]: pgmap v2802: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:10:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5142.675658 secs 2023-05-08T05:10:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5143.232826 secs 2023-05-08T05:10:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5142.675658 secs 2023-05-08T05:10:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5143.232826 secs 2023-05-08T05:10:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5142.675658 secs 2023-05-08T05:10:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5143.232826 secs 2023-05-08T05:10:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:05 smithi186 ceph-mon[126480]: pgmap v2803: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:10:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:05 smithi133 ceph-mon[125939]: pgmap v2803: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:10:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:05 smithi096 ceph-mon[124666]: pgmap v2803: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:10:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5144.513316 secs 2023-05-08T05:10:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:06 smithi186 ceph-mon[126480]: osdmap e254: 12 total, 12 up, 12 in 2023-05-08T05:10:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:06 smithi186 ceph-mon[126480]: pgmap v2805: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 111 KiB/s wr, 25 op/s 2023-05-08T05:10:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5144.513316 secs 2023-05-08T05:10:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:06 smithi133 ceph-mon[125939]: osdmap e254: 12 total, 12 up, 12 in 2023-05-08T05:10:06.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:06 smithi133 ceph-mon[125939]: pgmap v2805: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 111 KiB/s wr, 25 op/s 2023-05-08T05:10:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5144.513316 secs 2023-05-08T05:10:06.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:06 smithi096 ceph-mon[124666]: osdmap e254: 12 total, 12 up, 12 in 2023-05-08T05:10:06.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:06 smithi096 ceph-mon[124666]: pgmap v2805: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 111 KiB/s wr, 25 op/s 2023-05-08T05:10:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:08 smithi133 ceph-mon[125939]: pgmap v2806: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 111 KiB/s wr, 25 op/s 2023-05-08T05:10:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:08 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:10:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:08 smithi096 ceph-mon[124666]: pgmap v2806: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 111 KiB/s wr, 25 op/s 2023-05-08T05:10:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:08 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:10:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:08 smithi186 ceph-mon[126480]: pgmap v2806: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 111 KiB/s wr, 25 op/s 2023-05-08T05:10:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:08 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:10:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5147.675780 secs 2023-05-08T05:10:09.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5148.232872 secs 2023-05-08T05:10:09.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:09 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:10:09.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:09 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:10:09.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:09 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:10:09.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:09 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:10:09.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:09 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T05:10:09.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:09 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T05:10:09.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:09 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:10:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5147.675780 secs 2023-05-08T05:10:10.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5148.232872 secs 2023-05-08T05:10:10.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:09 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:10:10.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:09 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:10:10.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:09 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:10:10.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:09 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:10:10.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:09 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T05:10:10.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:09 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T05:10:10.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:09 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:10:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5147.675780 secs 2023-05-08T05:10:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5148.232872 secs 2023-05-08T05:10:10.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:09 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:10:10.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:09 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:10:10.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:09 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:10:10.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:09 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:10:10.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:09 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T05:10:10.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:09 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T05:10:10.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:09 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:10:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:11 smithi133 ceph-mon[125939]: pgmap v2807: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 112 KiB/s wr, 25 op/s 2023-05-08T05:10:11.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5149.513435 secs 2023-05-08T05:10:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:11 smithi096 ceph-mon[124666]: pgmap v2807: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 112 KiB/s wr, 25 op/s 2023-05-08T05:10:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5149.513435 secs 2023-05-08T05:10:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:11 smithi186 ceph-mon[126480]: pgmap v2807: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 112 KiB/s wr, 25 op/s 2023-05-08T05:10:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5149.513435 secs 2023-05-08T05:10:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:13 smithi133 ceph-mon[125939]: pgmap v2808: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 112 KiB/s wr, 25 op/s 2023-05-08T05:10:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:13 smithi096 ceph-mon[124666]: pgmap v2808: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 112 KiB/s wr, 25 op/s 2023-05-08T05:10:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:13 smithi186 ceph-mon[126480]: pgmap v2808: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 112 KiB/s wr, 25 op/s 2023-05-08T05:10:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5152.675913 secs 2023-05-08T05:10:14.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:14 smithi133 ceph-mon[125939]: osdmap e255: 12 total, 12 up, 12 in 2023-05-08T05:10:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5152.675913 secs 2023-05-08T05:10:14.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:14 smithi096 ceph-mon[124666]: osdmap e255: 12 total, 12 up, 12 in 2023-05-08T05:10:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5152.675913 secs 2023-05-08T05:10:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:14 smithi186 ceph-mon[126480]: osdmap e255: 12 total, 12 up, 12 in 2023-05-08T05:10:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5153.232997 secs 2023-05-08T05:10:15.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:15 smithi133 ceph-mon[125939]: pgmap v2809: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 112 KiB/s wr, 25 op/s 2023-05-08T05:10:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5153.232997 secs 2023-05-08T05:10:15.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:15 smithi096 ceph-mon[124666]: pgmap v2809: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 112 KiB/s wr, 25 op/s 2023-05-08T05:10:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5153.232997 secs 2023-05-08T05:10:15.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:15 smithi186 ceph-mon[126480]: pgmap v2809: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 112 KiB/s wr, 25 op/s 2023-05-08T05:10:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5154.513549 secs 2023-05-08T05:10:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5154.513549 secs 2023-05-08T05:10:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5154.513549 secs 2023-05-08T05:10:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:17 smithi133 ceph-mon[125939]: pgmap v2811: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 6 op/s 2023-05-08T05:10:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:17 smithi096 ceph-mon[124666]: pgmap v2811: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 6 op/s 2023-05-08T05:10:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:17 smithi186 ceph-mon[126480]: pgmap v2811: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 6 op/s 2023-05-08T05:10:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:19 smithi133 ceph-mon[125939]: pgmap v2812: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 6 op/s 2023-05-08T05:10:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5157.676041 secs 2023-05-08T05:10:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:19 smithi096 ceph-mon[124666]: pgmap v2812: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 6 op/s 2023-05-08T05:10:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5157.676041 secs 2023-05-08T05:10:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:19 smithi186 ceph-mon[126480]: pgmap v2812: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 6 op/s 2023-05-08T05:10:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5157.676041 secs 2023-05-08T05:10:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5158.233113 secs 2023-05-08T05:10:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5158.233113 secs 2023-05-08T05:10:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5158.233113 secs 2023-05-08T05:10:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:21 smithi133 ceph-mon[125939]: pgmap v2813: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 6 op/s 2023-05-08T05:10:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5159.513670 secs 2023-05-08T05:10:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:21 smithi096 ceph-mon[124666]: pgmap v2813: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 6 op/s 2023-05-08T05:10:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5159.513670 secs 2023-05-08T05:10:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:21 smithi186 ceph-mon[126480]: pgmap v2813: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 6 op/s 2023-05-08T05:10:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5159.513670 secs 2023-05-08T05:10:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:23 smithi133 ceph-mon[125939]: pgmap v2814: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 6 op/s 2023-05-08T05:10:23.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:23 smithi096 ceph-mon[124666]: pgmap v2814: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 6 op/s 2023-05-08T05:10:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:23 smithi186 ceph-mon[126480]: pgmap v2814: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 6 op/s 2023-05-08T05:10:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5162.676154 secs 2023-05-08T05:10:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5163.233232 secs 2023-05-08T05:10:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5162.676154 secs 2023-05-08T05:10:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5163.233232 secs 2023-05-08T05:10:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5162.676154 secs 2023-05-08T05:10:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5163.233232 secs 2023-05-08T05:10:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:25 smithi133 ceph-mon[125939]: pgmap v2815: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 6 op/s 2023-05-08T05:10:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:25 smithi096 ceph-mon[124666]: pgmap v2815: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 6 op/s 2023-05-08T05:10:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:25 smithi186 ceph-mon[126480]: pgmap v2815: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 6 op/s 2023-05-08T05:10:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5164.513700 secs 2023-05-08T05:10:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5164.513700 secs 2023-05-08T05:10:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5164.513700 secs 2023-05-08T05:10:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:27 smithi133 ceph-mon[125939]: pgmap v2816: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 KiB/s wr, 8 op/s 2023-05-08T05:10:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:27 smithi096 ceph-mon[124666]: pgmap v2816: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 KiB/s wr, 8 op/s 2023-05-08T05:10:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:27 smithi186 ceph-mon[126480]: pgmap v2816: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 KiB/s wr, 8 op/s 2023-05-08T05:10:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:29 smithi133 ceph-mon[125939]: pgmap v2817: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 0 B/s wr, 5 op/s 2023-05-08T05:10:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5167.676270 secs 2023-05-08T05:10:29.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5168.233371 secs 2023-05-08T05:10:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:29 smithi096 ceph-mon[124666]: pgmap v2817: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 0 B/s wr, 5 op/s 2023-05-08T05:10:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5167.676270 secs 2023-05-08T05:10:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5168.233371 secs 2023-05-08T05:10:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:29 smithi186 ceph-mon[126480]: pgmap v2817: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 0 B/s wr, 5 op/s 2023-05-08T05:10:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5167.676270 secs 2023-05-08T05:10:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5168.233371 secs 2023-05-08T05:10:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:31 smithi096 ceph-mon[124666]: pgmap v2818: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 7 op/s 2023-05-08T05:10:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5169.513804 secs 2023-05-08T05:10:31.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:31 smithi186 ceph-mon[126480]: pgmap v2818: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 7 op/s 2023-05-08T05:10:31.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5169.513804 secs 2023-05-08T05:10:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:31 smithi133 ceph-mon[125939]: pgmap v2818: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 7 op/s 2023-05-08T05:10:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5169.513804 secs 2023-05-08T05:10:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:33 smithi096 ceph-mon[124666]: pgmap v2819: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T05:10:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:33 smithi186 ceph-mon[126480]: pgmap v2819: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T05:10:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:33 smithi133 ceph-mon[125939]: pgmap v2819: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T05:10:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5172.676394 secs 2023-05-08T05:10:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5173.233510 secs 2023-05-08T05:10:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5172.676394 secs 2023-05-08T05:10:34.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5173.233510 secs 2023-05-08T05:10:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5172.676394 secs 2023-05-08T05:10:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5173.233510 secs 2023-05-08T05:10:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:35 smithi096 ceph-mon[124666]: pgmap v2820: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T05:10:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:35 smithi186 ceph-mon[126480]: pgmap v2820: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T05:10:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:35 smithi133 ceph-mon[125939]: pgmap v2820: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T05:10:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:37 smithi186 ceph-mon[126480]: pgmap v2821: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 59 KiB/s wr, 8 op/s 2023-05-08T05:10:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:37 smithi133 ceph-mon[125939]: pgmap v2821: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 59 KiB/s wr, 8 op/s 2023-05-08T05:10:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:37 smithi096 ceph-mon[124666]: pgmap v2821: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 59 KiB/s wr, 8 op/s 2023-05-08T05:10:38.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:38 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:10:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:38 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:10:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:38 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:10:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:39 smithi186 ceph-mon[126480]: pgmap v2822: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 59 KiB/s wr, 6 op/s 2023-05-08T05:10:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5177.676488 secs 2023-05-08T05:10:39.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:39 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:10:39.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:39 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:10:39.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:39 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:10:39.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5178.233633 secs 2023-05-08T05:10:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:39 smithi133 ceph-mon[125939]: pgmap v2822: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 59 KiB/s wr, 6 op/s 2023-05-08T05:10:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5177.676488 secs 2023-05-08T05:10:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:39 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:10:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:39 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:10:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:39 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:10:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5178.233633 secs 2023-05-08T05:10:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:39 smithi096 ceph-mon[124666]: pgmap v2822: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 59 KiB/s wr, 6 op/s 2023-05-08T05:10:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5177.676488 secs 2023-05-08T05:10:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:39 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:10:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:39 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:10:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:39 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:10:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5178.233633 secs 2023-05-08T05:10:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:41 smithi186 ceph-mon[126480]: pgmap v2823: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 114 KiB/s wr, 9 op/s 2023-05-08T05:10:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5179.514038 secs 2023-05-08T05:10:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:41 smithi133 ceph-mon[125939]: pgmap v2823: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 114 KiB/s wr, 9 op/s 2023-05-08T05:10:41.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5179.514038 secs 2023-05-08T05:10:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:41 smithi096 ceph-mon[124666]: pgmap v2823: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 114 KiB/s wr, 9 op/s 2023-05-08T05:10:41.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5179.514038 secs 2023-05-08T05:10:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:43 smithi186 ceph-mon[126480]: pgmap v2824: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 114 KiB/s wr, 7 op/s 2023-05-08T05:10:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:10:43.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:10:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:43 smithi133 ceph-mon[125939]: pgmap v2824: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 114 KiB/s wr, 7 op/s 2023-05-08T05:10:43.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:10:43.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:10:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:43 smithi096 ceph-mon[124666]: pgmap v2824: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 114 KiB/s wr, 7 op/s 2023-05-08T05:10:43.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:10:43.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:10:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5182.676599 secs 2023-05-08T05:10:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5183.233737 secs 2023-05-08T05:10:44.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:44 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:10:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5182.676599 secs 2023-05-08T05:10:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5183.233737 secs 2023-05-08T05:10:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:44 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:10:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5182.676599 secs 2023-05-08T05:10:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5183.233737 secs 2023-05-08T05:10:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:44 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:10:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:45 smithi186 ceph-mon[126480]: pgmap v2825: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 114 KiB/s wr, 7 op/s 2023-05-08T05:10:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:45 smithi133 ceph-mon[125939]: pgmap v2825: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 114 KiB/s wr, 7 op/s 2023-05-08T05:10:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:45 smithi096 ceph-mon[124666]: pgmap v2825: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 114 KiB/s wr, 7 op/s 2023-05-08T05:10:46.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5184.514170 secs 2023-05-08T05:10:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5184.514170 secs 2023-05-08T05:10:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5184.514170 secs 2023-05-08T05:10:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:47 smithi186 ceph-mon[126480]: pgmap v2826: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 140 KiB/s wr, 10 op/s 2023-05-08T05:10:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:47 smithi133 ceph-mon[125939]: pgmap v2826: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 140 KiB/s wr, 10 op/s 2023-05-08T05:10:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:47 smithi096 ceph-mon[124666]: pgmap v2826: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 140 KiB/s wr, 10 op/s 2023-05-08T05:10:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:49 smithi186 ceph-mon[126480]: pgmap v2827: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 80 KiB/s wr, 6 op/s 2023-05-08T05:10:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5187.676712 secs 2023-05-08T05:10:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5188.233819 secs 2023-05-08T05:10:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:49 smithi133 ceph-mon[125939]: pgmap v2827: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 80 KiB/s wr, 6 op/s 2023-05-08T05:10:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5187.676712 secs 2023-05-08T05:10:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5188.233819 secs 2023-05-08T05:10:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:49 smithi096 ceph-mon[124666]: pgmap v2827: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 80 KiB/s wr, 6 op/s 2023-05-08T05:10:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5187.676712 secs 2023-05-08T05:10:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5188.233819 secs 2023-05-08T05:10:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:51 smithi186 ceph-mon[126480]: pgmap v2828: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 80 KiB/s wr, 8 op/s 2023-05-08T05:10:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5189.514234 secs 2023-05-08T05:10:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:51 smithi133 ceph-mon[125939]: pgmap v2828: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 80 KiB/s wr, 8 op/s 2023-05-08T05:10:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5189.514234 secs 2023-05-08T05:10:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:51 smithi096 ceph-mon[124666]: pgmap v2828: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 80 KiB/s wr, 8 op/s 2023-05-08T05:10:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5189.514234 secs 2023-05-08T05:10:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:53 smithi186 ceph-mon[126480]: pgmap v2829: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 5 op/s 2023-05-08T05:10:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:53 smithi133 ceph-mon[125939]: pgmap v2829: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 5 op/s 2023-05-08T05:10:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:53 smithi096 ceph-mon[124666]: pgmap v2829: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 5 op/s 2023-05-08T05:10:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5192.676823 secs 2023-05-08T05:10:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5193.233923 secs 2023-05-08T05:10:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5192.676823 secs 2023-05-08T05:10:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5193.233923 secs 2023-05-08T05:10:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5192.676823 secs 2023-05-08T05:10:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5193.233923 secs 2023-05-08T05:10:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:55 smithi186 ceph-mon[126480]: pgmap v2830: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 5 op/s 2023-05-08T05:10:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:55 smithi133 ceph-mon[125939]: pgmap v2830: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 5 op/s 2023-05-08T05:10:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:55 smithi096 ceph-mon[124666]: pgmap v2830: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 5 op/s 2023-05-08T05:10:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5194.514354 secs 2023-05-08T05:10:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5194.514354 secs 2023-05-08T05:10:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5194.514354 secs 2023-05-08T05:10:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:57 smithi186 ceph-mon[126480]: pgmap v2831: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 26 KiB/s wr, 7 op/s 2023-05-08T05:10:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:57 smithi133 ceph-mon[125939]: pgmap v2831: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 26 KiB/s wr, 7 op/s 2023-05-08T05:10:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:57 smithi096 ceph-mon[124666]: pgmap v2831: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 26 KiB/s wr, 7 op/s 2023-05-08T05:10:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:59 smithi186 ceph-mon[126480]: pgmap v2832: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:10:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5197.676934 secs 2023-05-08T05:10:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:10:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5198.234011 secs 2023-05-08T05:10:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:59 smithi133 ceph-mon[125939]: pgmap v2832: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:10:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5197.676934 secs 2023-05-08T05:10:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:10:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5198.234011 secs 2023-05-08T05:10:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:59 smithi096 ceph-mon[124666]: pgmap v2832: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:10:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5197.676934 secs 2023-05-08T05:10:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:10:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5198.234011 secs 2023-05-08T05:11:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:01 smithi186 ceph-mon[126480]: pgmap v2833: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T05:11:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5199.514492 secs 2023-05-08T05:11:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:01 smithi133 ceph-mon[125939]: pgmap v2833: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T05:11:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5199.514492 secs 2023-05-08T05:11:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:01 smithi096 ceph-mon[124666]: pgmap v2833: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T05:11:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5199.514492 secs 2023-05-08T05:11:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:03 smithi186 ceph-mon[126480]: pgmap v2834: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:11:03.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:03 smithi133 ceph-mon[125939]: pgmap v2834: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:11:03.759 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:03 smithi096 ceph-mon[124666]: pgmap v2834: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:11:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5202.677060 secs 2023-05-08T05:11:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5203.234154 secs 2023-05-08T05:11:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5202.677060 secs 2023-05-08T05:11:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5203.234154 secs 2023-05-08T05:11:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5202.677060 secs 2023-05-08T05:11:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5203.234154 secs 2023-05-08T05:11:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:05 smithi186 ceph-mon[126480]: pgmap v2835: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:11:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:05 smithi133 ceph-mon[125939]: pgmap v2835: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:11:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:05 smithi096 ceph-mon[124666]: pgmap v2835: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:11:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5204.514609 secs 2023-05-08T05:11:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:06 smithi186 ceph-mon[126480]: osdmap e256: 12 total, 12 up, 12 in 2023-05-08T05:11:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:06 smithi186 ceph-mon[126480]: pgmap v2837: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 147 KiB/s wr, 25 op/s 2023-05-08T05:11:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5204.514609 secs 2023-05-08T05:11:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:06 smithi133 ceph-mon[125939]: osdmap e256: 12 total, 12 up, 12 in 2023-05-08T05:11:06.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:06 smithi133 ceph-mon[125939]: pgmap v2837: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 147 KiB/s wr, 25 op/s 2023-05-08T05:11:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5204.514609 secs 2023-05-08T05:11:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:06 smithi096 ceph-mon[124666]: osdmap e256: 12 total, 12 up, 12 in 2023-05-08T05:11:06.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:06 smithi096 ceph-mon[124666]: pgmap v2837: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 147 KiB/s wr, 25 op/s 2023-05-08T05:11:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:08 smithi133 ceph-mon[125939]: pgmap v2838: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 147 KiB/s wr, 25 op/s 2023-05-08T05:11:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:08 smithi096 ceph-mon[124666]: pgmap v2838: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 147 KiB/s wr, 25 op/s 2023-05-08T05:11:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:08 smithi186 ceph-mon[126480]: pgmap v2838: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 147 KiB/s wr, 25 op/s 2023-05-08T05:11:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5207.677169 secs 2023-05-08T05:11:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5208.234291 secs 2023-05-08T05:11:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:09 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:11:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5207.677169 secs 2023-05-08T05:11:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5208.234291 secs 2023-05-08T05:11:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:09 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:11:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5207.677169 secs 2023-05-08T05:11:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5208.234291 secs 2023-05-08T05:11:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:09 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:11:11.099 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:10 smithi096 ceph-mon[124666]: pgmap v2839: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 148 KiB/s wr, 26 op/s 2023-05-08T05:11:11.100 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5209.514670 secs 2023-05-08T05:11:11.104 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:10 smithi133 ceph-mon[125939]: pgmap v2839: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 148 KiB/s wr, 26 op/s 2023-05-08T05:11:11.104 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5209.514670 secs 2023-05-08T05:11:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:10 smithi186 ceph-mon[126480]: pgmap v2839: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 148 KiB/s wr, 26 op/s 2023-05-08T05:11:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5209.514670 secs 2023-05-08T05:11:13.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:12 smithi133 ceph-mon[125939]: pgmap v2840: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 148 KiB/s wr, 26 op/s 2023-05-08T05:11:13.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:12 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:11:13.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:12 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:11:13.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:12 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:11:13.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:12 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:11:13.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:12 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:11:13.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:12 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:11:13.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:12 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:11:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:12 smithi096 ceph-mon[124666]: pgmap v2840: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 148 KiB/s wr, 26 op/s 2023-05-08T05:11:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:12 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:11:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:12 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:11:13.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:12 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:11:13.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:12 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:11:13.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:12 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:11:13.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:12 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:11:13.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:12 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:11:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:12 smithi186 ceph-mon[126480]: pgmap v2840: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 148 KiB/s wr, 26 op/s 2023-05-08T05:11:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:12 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:11:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:12 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:11:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:12 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:11:13.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:12 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:11:13.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:12 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:11:13.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:12 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:11:13.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:12 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:11:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:13 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:11:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:13 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T05:11:14.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:13 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T05:11:14.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:13 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:11:14.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5212.677287 secs 2023-05-08T05:11:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:13 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:11:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:13 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T05:11:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:13 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T05:11:14.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:13 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:11:14.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5212.677287 secs 2023-05-08T05:11:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:13 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:11:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:13 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T05:11:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:13 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T05:11:14.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:13 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:11:14.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5212.677287 secs 2023-05-08T05:11:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5213.234416 secs 2023-05-08T05:11:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:14 smithi133 ceph-mon[125939]: pgmap v2841: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 148 KiB/s wr, 26 op/s 2023-05-08T05:11:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:14 smithi133 ceph-mon[125939]: osdmap e257: 12 total, 12 up, 12 in 2023-05-08T05:11:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5213.234416 secs 2023-05-08T05:11:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:14 smithi096 ceph-mon[124666]: pgmap v2841: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 148 KiB/s wr, 26 op/s 2023-05-08T05:11:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:14 smithi096 ceph-mon[124666]: osdmap e257: 12 total, 12 up, 12 in 2023-05-08T05:11:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5213.234416 secs 2023-05-08T05:11:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:14 smithi186 ceph-mon[126480]: pgmap v2841: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 148 KiB/s wr, 26 op/s 2023-05-08T05:11:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:14 smithi186 ceph-mon[126480]: osdmap e257: 12 total, 12 up, 12 in 2023-05-08T05:11:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5214.514814 secs 2023-05-08T05:11:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5214.514814 secs 2023-05-08T05:11:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5214.514814 secs 2023-05-08T05:11:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:16 smithi133 ceph-mon[125939]: pgmap v2843: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 8 op/s 2023-05-08T05:11:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:16 smithi096 ceph-mon[124666]: pgmap v2843: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 8 op/s 2023-05-08T05:11:17.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:16 smithi186 ceph-mon[126480]: pgmap v2843: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 8 op/s 2023-05-08T05:11:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:18 smithi133 ceph-mon[125939]: pgmap v2844: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 7 op/s 2023-05-08T05:11:19.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5217.677404 secs 2023-05-08T05:11:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:18 smithi096 ceph-mon[124666]: pgmap v2844: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 7 op/s 2023-05-08T05:11:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5217.677404 secs 2023-05-08T05:11:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:18 smithi186 ceph-mon[126480]: pgmap v2844: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 7 op/s 2023-05-08T05:11:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5217.677404 secs 2023-05-08T05:11:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5218.234530 secs 2023-05-08T05:11:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5218.234530 secs 2023-05-08T05:11:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5218.234530 secs 2023-05-08T05:11:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:20 smithi133 ceph-mon[125939]: pgmap v2845: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 7 op/s 2023-05-08T05:11:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5219.514863 secs 2023-05-08T05:11:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:20 smithi096 ceph-mon[124666]: pgmap v2845: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 7 op/s 2023-05-08T05:11:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5219.514863 secs 2023-05-08T05:11:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:20 smithi186 ceph-mon[126480]: pgmap v2845: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 7 op/s 2023-05-08T05:11:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5219.514863 secs 2023-05-08T05:11:23.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:22 smithi133 ceph-mon[125939]: pgmap v2846: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 7 op/s 2023-05-08T05:11:23.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:22 smithi096 ceph-mon[124666]: pgmap v2846: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 7 op/s 2023-05-08T05:11:23.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:22 smithi186 ceph-mon[126480]: pgmap v2846: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 7 op/s 2023-05-08T05:11:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5222.677487 secs 2023-05-08T05:11:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5222.677487 secs 2023-05-08T05:11:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5222.677487 secs 2023-05-08T05:11:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5223.234595 secs 2023-05-08T05:11:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:24 smithi133 ceph-mon[125939]: pgmap v2847: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 7 op/s 2023-05-08T05:11:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5223.234595 secs 2023-05-08T05:11:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:24 smithi096 ceph-mon[124666]: pgmap v2847: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 7 op/s 2023-05-08T05:11:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5223.234595 secs 2023-05-08T05:11:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:24 smithi186 ceph-mon[126480]: pgmap v2847: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 7 op/s 2023-05-08T05:11:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5224.514939 secs 2023-05-08T05:11:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5224.514939 secs 2023-05-08T05:11:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5224.514939 secs 2023-05-08T05:11:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:26 smithi133 ceph-mon[125939]: pgmap v2848: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 KiB/s wr, 9 op/s 2023-05-08T05:11:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:26 smithi096 ceph-mon[124666]: pgmap v2848: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 KiB/s wr, 9 op/s 2023-05-08T05:11:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:26 smithi186 ceph-mon[126480]: pgmap v2848: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 KiB/s wr, 9 op/s 2023-05-08T05:11:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:28 smithi133 ceph-mon[125939]: pgmap v2849: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2023-05-08T05:11:29.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5227.677599 secs 2023-05-08T05:11:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:28 smithi096 ceph-mon[124666]: pgmap v2849: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2023-05-08T05:11:29.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5227.677599 secs 2023-05-08T05:11:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:28 smithi186 ceph-mon[126480]: pgmap v2849: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2023-05-08T05:11:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5227.677599 secs 2023-05-08T05:11:30.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5228.234716 secs 2023-05-08T05:11:30.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5228.234716 secs 2023-05-08T05:11:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5228.234716 secs 2023-05-08T05:11:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:30 smithi133 ceph-mon[125939]: pgmap v2850: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 8 op/s 2023-05-08T05:11:31.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5229.514997 secs 2023-05-08T05:11:31.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:30 smithi096 ceph-mon[124666]: pgmap v2850: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 8 op/s 2023-05-08T05:11:31.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5229.514997 secs 2023-05-08T05:11:31.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:30 smithi186 ceph-mon[126480]: pgmap v2850: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 8 op/s 2023-05-08T05:11:31.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5229.514997 secs 2023-05-08T05:11:33.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:32 smithi133 ceph-mon[125939]: pgmap v2851: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:11:33.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:32 smithi096 ceph-mon[124666]: pgmap v2851: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:11:33.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:32 smithi186 ceph-mon[126480]: pgmap v2851: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:11:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5232.677678 secs 2023-05-08T05:11:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5232.677678 secs 2023-05-08T05:11:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5232.677678 secs 2023-05-08T05:11:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5233.234834 secs 2023-05-08T05:11:35.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:34 smithi133 ceph-mon[125939]: pgmap v2852: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:11:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5233.234834 secs 2023-05-08T05:11:35.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:34 smithi096 ceph-mon[124666]: pgmap v2852: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:11:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5233.234834 secs 2023-05-08T05:11:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:34 smithi186 ceph-mon[126480]: pgmap v2852: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:11:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:36 smithi133 ceph-mon[125939]: pgmap v2853: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 60 KiB/s wr, 9 op/s 2023-05-08T05:11:37.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:36 smithi096 ceph-mon[124666]: pgmap v2853: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 60 KiB/s wr, 9 op/s 2023-05-08T05:11:37.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:36 smithi186 ceph-mon[126480]: pgmap v2853: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 60 KiB/s wr, 9 op/s 2023-05-08T05:11:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:37 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:11:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:37 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:11:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:37 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:11:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:38 smithi133 ceph-mon[125939]: pgmap v2854: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 60 KiB/s wr, 6 op/s 2023-05-08T05:11:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5237.677814 secs 2023-05-08T05:11:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:38 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:11:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:38 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:11:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:38 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:11:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:38 smithi096 ceph-mon[124666]: pgmap v2854: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 60 KiB/s wr, 6 op/s 2023-05-08T05:11:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5237.677814 secs 2023-05-08T05:11:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:38 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:11:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:38 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:11:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:38 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:11:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:38 smithi186 ceph-mon[126480]: pgmap v2854: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 60 KiB/s wr, 6 op/s 2023-05-08T05:11:39.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5237.677814 secs 2023-05-08T05:11:39.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:38 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:11:39.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:38 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:11:39.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:38 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:11:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5238.234970 secs 2023-05-08T05:11:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5238.234970 secs 2023-05-08T05:11:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5238.234970 secs 2023-05-08T05:11:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:40 smithi133 ceph-mon[125939]: pgmap v2855: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 111 KiB/s wr, 10 op/s 2023-05-08T05:11:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5239.515242 secs 2023-05-08T05:11:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:40 smithi096 ceph-mon[124666]: pgmap v2855: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 111 KiB/s wr, 10 op/s 2023-05-08T05:11:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5239.515242 secs 2023-05-08T05:11:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:40 smithi186 ceph-mon[126480]: pgmap v2855: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 111 KiB/s wr, 10 op/s 2023-05-08T05:11:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5239.515242 secs 2023-05-08T05:11:43.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:42 smithi133 ceph-mon[125939]: pgmap v2856: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 111 KiB/s wr, 7 op/s 2023-05-08T05:11:43.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:42 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:11:43.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:42 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:11:43.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:42 smithi096 ceph-mon[124666]: pgmap v2856: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 111 KiB/s wr, 7 op/s 2023-05-08T05:11:43.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:42 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:11:43.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:42 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:11:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:42 smithi186 ceph-mon[126480]: pgmap v2856: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 111 KiB/s wr, 7 op/s 2023-05-08T05:11:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:42 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:11:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:42 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:11:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5242.677877 secs 2023-05-08T05:11:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:43 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:11:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5242.677877 secs 2023-05-08T05:11:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:43 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:11:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5242.677877 secs 2023-05-08T05:11:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:43 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:11:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5243.235086 secs 2023-05-08T05:11:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:44 smithi133 ceph-mon[125939]: pgmap v2857: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 111 KiB/s wr, 7 op/s 2023-05-08T05:11:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5243.235086 secs 2023-05-08T05:11:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:44 smithi096 ceph-mon[124666]: pgmap v2857: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 111 KiB/s wr, 7 op/s 2023-05-08T05:11:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5243.235086 secs 2023-05-08T05:11:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:44 smithi186 ceph-mon[126480]: pgmap v2857: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 111 KiB/s wr, 7 op/s 2023-05-08T05:11:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5244.515350 secs 2023-05-08T05:11:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5244.515350 secs 2023-05-08T05:11:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5244.515350 secs 2023-05-08T05:11:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:46 smithi133 ceph-mon[125939]: pgmap v2858: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 137 KiB/s wr, 10 op/s 2023-05-08T05:11:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:46 smithi096 ceph-mon[124666]: pgmap v2858: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 137 KiB/s wr, 10 op/s 2023-05-08T05:11:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:46 smithi186 ceph-mon[126480]: pgmap v2858: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 137 KiB/s wr, 10 op/s 2023-05-08T05:11:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:48 smithi096 ceph-mon[124666]: pgmap v2859: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 77 KiB/s wr, 6 op/s 2023-05-08T05:11:49.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5247.678015 secs 2023-05-08T05:11:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:48 smithi186 ceph-mon[126480]: pgmap v2859: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 77 KiB/s wr, 6 op/s 2023-05-08T05:11:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5247.678015 secs 2023-05-08T05:11:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:48 smithi133 ceph-mon[125939]: pgmap v2859: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 77 KiB/s wr, 6 op/s 2023-05-08T05:11:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5247.678015 secs 2023-05-08T05:11:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5248.235185 secs 2023-05-08T05:11:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5248.235185 secs 2023-05-08T05:11:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5248.235185 secs 2023-05-08T05:11:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:50 smithi096 ceph-mon[124666]: pgmap v2860: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 77 KiB/s wr, 8 op/s 2023-05-08T05:11:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5249.515466 secs 2023-05-08T05:11:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:50 smithi186 ceph-mon[126480]: pgmap v2860: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 77 KiB/s wr, 8 op/s 2023-05-08T05:11:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5249.515466 secs 2023-05-08T05:11:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:50 smithi133 ceph-mon[125939]: pgmap v2860: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 77 KiB/s wr, 8 op/s 2023-05-08T05:11:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5249.515466 secs 2023-05-08T05:11:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:52 smithi096 ceph-mon[124666]: pgmap v2861: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 5 op/s 2023-05-08T05:11:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:52 smithi186 ceph-mon[126480]: pgmap v2861: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 5 op/s 2023-05-08T05:11:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:52 smithi133 ceph-mon[125939]: pgmap v2861: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 5 op/s 2023-05-08T05:11:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5252.678151 secs 2023-05-08T05:11:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5252.678151 secs 2023-05-08T05:11:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5252.678151 secs 2023-05-08T05:11:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5253.235305 secs 2023-05-08T05:11:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:55 smithi186 ceph-mon[126480]: pgmap v2862: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 5 op/s 2023-05-08T05:11:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5253.235305 secs 2023-05-08T05:11:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:55 smithi133 ceph-mon[125939]: pgmap v2862: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 5 op/s 2023-05-08T05:11:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5253.235305 secs 2023-05-08T05:11:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:55 smithi096 ceph-mon[124666]: pgmap v2862: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 5 op/s 2023-05-08T05:11:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5254.515587 secs 2023-05-08T05:11:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5254.515587 secs 2023-05-08T05:11:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5254.515587 secs 2023-05-08T05:11:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:57 smithi186 ceph-mon[126480]: pgmap v2863: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 26 KiB/s wr, 7 op/s 2023-05-08T05:11:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:57 smithi133 ceph-mon[125939]: pgmap v2863: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 26 KiB/s wr, 7 op/s 2023-05-08T05:11:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:57 smithi096 ceph-mon[124666]: pgmap v2863: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 26 KiB/s wr, 7 op/s 2023-05-08T05:11:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:59 smithi186 ceph-mon[126480]: pgmap v2864: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:11:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:11:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5257.678249 secs 2023-05-08T05:11:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:59 smithi133 ceph-mon[125939]: pgmap v2864: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:11:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:11:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5257.678249 secs 2023-05-08T05:11:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:59 smithi096 ceph-mon[124666]: pgmap v2864: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:11:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:11:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5257.678249 secs 2023-05-08T05:12:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5258.235425 secs 2023-05-08T05:12:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5258.235425 secs 2023-05-08T05:12:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5258.235425 secs 2023-05-08T05:12:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:01 smithi186 ceph-mon[126480]: pgmap v2865: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T05:12:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5259.515701 secs 2023-05-08T05:12:01.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:01 smithi133 ceph-mon[125939]: pgmap v2865: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T05:12:01.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5259.515701 secs 2023-05-08T05:12:01.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:01 smithi096 ceph-mon[124666]: pgmap v2865: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T05:12:01.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5259.515701 secs 2023-05-08T05:12:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:03 smithi186 ceph-mon[126480]: pgmap v2866: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:12:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:03 smithi133 ceph-mon[125939]: pgmap v2866: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:12:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:03 smithi096 ceph-mon[124666]: pgmap v2866: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:12:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5262.678364 secs 2023-05-08T05:12:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5262.678364 secs 2023-05-08T05:12:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5262.678364 secs 2023-05-08T05:12:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5263.235551 secs 2023-05-08T05:12:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:05 smithi186 ceph-mon[126480]: pgmap v2867: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:12:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5263.235551 secs 2023-05-08T05:12:05.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:05 smithi133 ceph-mon[125939]: pgmap v2867: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:12:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5263.235551 secs 2023-05-08T05:12:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:05 smithi096 ceph-mon[124666]: pgmap v2867: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:12:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5264.515824 secs 2023-05-08T05:12:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:06 smithi186 ceph-mon[126480]: osdmap e258: 12 total, 12 up, 12 in 2023-05-08T05:12:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5264.515824 secs 2023-05-08T05:12:06.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:06 smithi133 ceph-mon[125939]: osdmap e258: 12 total, 12 up, 12 in 2023-05-08T05:12:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5264.515824 secs 2023-05-08T05:12:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:06 smithi096 ceph-mon[124666]: osdmap e258: 12 total, 12 up, 12 in 2023-05-08T05:12:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:07 smithi186 ceph-mon[126480]: pgmap v2869: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 117 KiB/s wr, 24 op/s 2023-05-08T05:12:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:07 smithi133 ceph-mon[125939]: pgmap v2869: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 117 KiB/s wr, 24 op/s 2023-05-08T05:12:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:07 smithi096 ceph-mon[124666]: pgmap v2869: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 117 KiB/s wr, 24 op/s 2023-05-08T05:12:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:09 smithi186 ceph-mon[126480]: pgmap v2870: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 117 KiB/s wr, 24 op/s 2023-05-08T05:12:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5267.678473 secs 2023-05-08T05:12:09.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:09 smithi133 ceph-mon[125939]: pgmap v2870: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 117 KiB/s wr, 24 op/s 2023-05-08T05:12:09.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5267.678473 secs 2023-05-08T05:12:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:09 smithi096 ceph-mon[124666]: pgmap v2870: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 117 KiB/s wr, 24 op/s 2023-05-08T05:12:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5267.678473 secs 2023-05-08T05:12:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5268.235635 secs 2023-05-08T05:12:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5268.235635 secs 2023-05-08T05:12:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5268.235635 secs 2023-05-08T05:12:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:11 smithi186 ceph-mon[126480]: pgmap v2871: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 118 KiB/s wr, 25 op/s 2023-05-08T05:12:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5269.515935 secs 2023-05-08T05:12:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:11 smithi133 ceph-mon[125939]: pgmap v2871: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 118 KiB/s wr, 25 op/s 2023-05-08T05:12:11.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5269.515935 secs 2023-05-08T05:12:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:11 smithi096 ceph-mon[124666]: pgmap v2871: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 118 KiB/s wr, 25 op/s 2023-05-08T05:12:11.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5269.515935 secs 2023-05-08T05:12:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:13 smithi186 ceph-mon[126480]: pgmap v2872: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 118 KiB/s wr, 25 op/s 2023-05-08T05:12:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:13 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:12:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:13 smithi133 ceph-mon[125939]: pgmap v2872: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 118 KiB/s wr, 25 op/s 2023-05-08T05:12:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:13 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:12:13.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:13 smithi096 ceph-mon[124666]: pgmap v2872: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 118 KiB/s wr, 25 op/s 2023-05-08T05:12:13.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:13 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:12:14.334 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5272.678541 secs 2023-05-08T05:12:14.334 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:14 smithi186 ceph-mon[126480]: osdmap e259: 12 total, 12 up, 12 in 2023-05-08T05:12:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5272.678541 secs 2023-05-08T05:12:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:14 smithi133 ceph-mon[125939]: osdmap e259: 12 total, 12 up, 12 in 2023-05-08T05:12:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5272.678541 secs 2023-05-08T05:12:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:14 smithi096 ceph-mon[124666]: osdmap e259: 12 total, 12 up, 12 in 2023-05-08T05:12:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5273.235709 secs 2023-05-08T05:12:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:15 smithi186 ceph-mon[126480]: pgmap v2873: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 118 KiB/s wr, 25 op/s 2023-05-08T05:12:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5273.235709 secs 2023-05-08T05:12:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:15 smithi133 ceph-mon[125939]: pgmap v2873: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 118 KiB/s wr, 25 op/s 2023-05-08T05:12:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5273.235709 secs 2023-05-08T05:12:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:15 smithi096 ceph-mon[124666]: pgmap v2873: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 118 KiB/s wr, 25 op/s 2023-05-08T05:12:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5274.516033 secs 2023-05-08T05:12:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5274.516033 secs 2023-05-08T05:12:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5274.516033 secs 2023-05-08T05:12:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:17 smithi133 ceph-mon[125939]: pgmap v2875: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 33 KiB/s wr, 7 op/s 2023-05-08T05:12:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:17 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:12:17.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:17 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:12:17.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:17 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:12:17.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:17 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:12:17.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:17 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:12:17.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:17 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:12:17.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:17 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T05:12:17.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:17 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T05:12:17.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:17 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:12:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:17 smithi096 ceph-mon[124666]: pgmap v2875: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 33 KiB/s wr, 7 op/s 2023-05-08T05:12:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:17 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:12:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:17 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:12:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:17 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:12:17.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:17 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:12:17.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:17 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:12:17.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:17 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:12:17.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:17 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T05:12:17.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:17 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T05:12:17.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:17 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:12:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:17 smithi186 ceph-mon[126480]: pgmap v2875: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 33 KiB/s wr, 7 op/s 2023-05-08T05:12:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:17 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:12:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:17 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:12:17.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:17 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:12:17.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:17 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:12:17.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:17 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:12:17.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:17 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:12:17.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:17 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T05:12:17.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:17 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T05:12:17.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:17 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:12:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:19 smithi133 ceph-mon[125939]: pgmap v2876: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 33 KiB/s wr, 7 op/s 2023-05-08T05:12:19.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5277.678661 secs 2023-05-08T05:12:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:19 smithi096 ceph-mon[124666]: pgmap v2876: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 33 KiB/s wr, 7 op/s 2023-05-08T05:12:19.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5277.678661 secs 2023-05-08T05:12:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:19 smithi186 ceph-mon[126480]: pgmap v2876: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 33 KiB/s wr, 7 op/s 2023-05-08T05:12:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5277.678661 secs 2023-05-08T05:12:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5278.235812 secs 2023-05-08T05:12:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5278.235812 secs 2023-05-08T05:12:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5278.235812 secs 2023-05-08T05:12:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:21 smithi133 ceph-mon[125939]: pgmap v2877: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T05:12:21.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5279.516155 secs 2023-05-08T05:12:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:21 smithi096 ceph-mon[124666]: pgmap v2877: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T05:12:21.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5279.516155 secs 2023-05-08T05:12:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:21 smithi186 ceph-mon[126480]: pgmap v2877: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T05:12:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5279.516155 secs 2023-05-08T05:12:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:23 smithi133 ceph-mon[125939]: pgmap v2878: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T05:12:23.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:23 smithi096 ceph-mon[124666]: pgmap v2878: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T05:12:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:23 smithi186 ceph-mon[126480]: pgmap v2878: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T05:12:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5282.678796 secs 2023-05-08T05:12:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5282.678796 secs 2023-05-08T05:12:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5282.678796 secs 2023-05-08T05:12:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5283.235931 secs 2023-05-08T05:12:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:25 smithi133 ceph-mon[125939]: pgmap v2879: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T05:12:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5283.235931 secs 2023-05-08T05:12:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:25 smithi096 ceph-mon[124666]: pgmap v2879: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T05:12:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5283.235931 secs 2023-05-08T05:12:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:25 smithi186 ceph-mon[126480]: pgmap v2879: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T05:12:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5284.516284 secs 2023-05-08T05:12:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5284.516284 secs 2023-05-08T05:12:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5284.516284 secs 2023-05-08T05:12:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:27 smithi133 ceph-mon[125939]: pgmap v2880: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 KiB/s wr, 8 op/s 2023-05-08T05:12:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:27 smithi096 ceph-mon[124666]: pgmap v2880: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 KiB/s wr, 8 op/s 2023-05-08T05:12:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:27 smithi186 ceph-mon[126480]: pgmap v2880: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 KiB/s wr, 8 op/s 2023-05-08T05:12:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:29 smithi133 ceph-mon[125939]: pgmap v2881: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2023-05-08T05:12:29.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5287.678912 secs 2023-05-08T05:12:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:29 smithi096 ceph-mon[124666]: pgmap v2881: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2023-05-08T05:12:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5287.678912 secs 2023-05-08T05:12:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:29 smithi186 ceph-mon[126480]: pgmap v2881: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2023-05-08T05:12:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5287.678912 secs 2023-05-08T05:12:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5288.236052 secs 2023-05-08T05:12:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5288.236052 secs 2023-05-08T05:12:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5288.236052 secs 2023-05-08T05:12:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:31 smithi133 ceph-mon[125939]: pgmap v2882: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 7 op/s 2023-05-08T05:12:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5289.516403 secs 2023-05-08T05:12:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:31 smithi096 ceph-mon[124666]: pgmap v2882: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 7 op/s 2023-05-08T05:12:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5289.516403 secs 2023-05-08T05:12:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:31 smithi186 ceph-mon[126480]: pgmap v2882: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 7 op/s 2023-05-08T05:12:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5289.516403 secs 2023-05-08T05:12:33.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:33 smithi133 ceph-mon[125939]: pgmap v2883: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:12:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:33 smithi096 ceph-mon[124666]: pgmap v2883: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:12:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:33 smithi186 ceph-mon[126480]: pgmap v2883: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:12:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5292.679027 secs 2023-05-08T05:12:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5292.679027 secs 2023-05-08T05:12:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5292.679027 secs 2023-05-08T05:12:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5293.236190 secs 2023-05-08T05:12:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:35 smithi133 ceph-mon[125939]: pgmap v2884: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:12:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5293.236190 secs 2023-05-08T05:12:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:35 smithi096 ceph-mon[124666]: pgmap v2884: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:12:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5293.236190 secs 2023-05-08T05:12:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:35 smithi186 ceph-mon[126480]: pgmap v2884: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:12:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:37 smithi133 ceph-mon[125939]: pgmap v2885: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 61 KiB/s wr, 9 op/s 2023-05-08T05:12:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:37 smithi096 ceph-mon[124666]: pgmap v2885: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 61 KiB/s wr, 9 op/s 2023-05-08T05:12:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:37 smithi186 ceph-mon[126480]: pgmap v2885: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 61 KiB/s wr, 9 op/s 2023-05-08T05:12:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:38 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:12:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:38 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:12:38.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:38 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:12:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:39 smithi133 ceph-mon[125939]: pgmap v2886: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 61 KiB/s wr, 6 op/s 2023-05-08T05:12:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5297.679148 secs 2023-05-08T05:12:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:39 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:12:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:39 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:12:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:39 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:12:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:39 smithi096 ceph-mon[124666]: pgmap v2886: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 61 KiB/s wr, 6 op/s 2023-05-08T05:12:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5297.679148 secs 2023-05-08T05:12:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:39 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:12:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:39 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:12:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:39 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:12:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:39 smithi186 ceph-mon[126480]: pgmap v2886: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 61 KiB/s wr, 6 op/s 2023-05-08T05:12:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5297.679148 secs 2023-05-08T05:12:39.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:39 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:12:39.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:39 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:12:39.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:39 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:12:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5298.236276 secs 2023-05-08T05:12:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5298.236276 secs 2023-05-08T05:12:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5298.236276 secs 2023-05-08T05:12:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:41 smithi133 ceph-mon[125939]: pgmap v2887: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 143 KiB/s wr, 10 op/s 2023-05-08T05:12:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5299.516630 secs 2023-05-08T05:12:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:41 smithi096 ceph-mon[124666]: pgmap v2887: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 143 KiB/s wr, 10 op/s 2023-05-08T05:12:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5299.516630 secs 2023-05-08T05:12:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:41 smithi186 ceph-mon[126480]: pgmap v2887: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 143 KiB/s wr, 10 op/s 2023-05-08T05:12:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5299.516630 secs 2023-05-08T05:12:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:43 smithi133 ceph-mon[125939]: pgmap v2888: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 143 KiB/s wr, 7 op/s 2023-05-08T05:12:43.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:12:43.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:12:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:43 smithi096 ceph-mon[124666]: pgmap v2888: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 143 KiB/s wr, 7 op/s 2023-05-08T05:12:43.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:12:43.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:12:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:43 smithi186 ceph-mon[126480]: pgmap v2888: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 143 KiB/s wr, 7 op/s 2023-05-08T05:12:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:12:43.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:12:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5302.679255 secs 2023-05-08T05:12:44.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:44 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:12:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5302.679255 secs 2023-05-08T05:12:44.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:44 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:12:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5302.679255 secs 2023-05-08T05:12:44.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:44 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:12:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5303.236375 secs 2023-05-08T05:12:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:45 smithi133 ceph-mon[125939]: pgmap v2889: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 143 KiB/s wr, 7 op/s 2023-05-08T05:12:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5303.236375 secs 2023-05-08T05:12:45.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:45 smithi096 ceph-mon[124666]: pgmap v2889: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 143 KiB/s wr, 7 op/s 2023-05-08T05:12:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5303.236375 secs 2023-05-08T05:12:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:45 smithi186 ceph-mon[126480]: pgmap v2889: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 143 KiB/s wr, 7 op/s 2023-05-08T05:12:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5304.516726 secs 2023-05-08T05:12:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5304.516726 secs 2023-05-08T05:12:46.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5304.516726 secs 2023-05-08T05:12:47.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:47 smithi133 ceph-mon[125939]: pgmap v2890: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 169 KiB/s wr, 11 op/s 2023-05-08T05:12:47.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:47 smithi096 ceph-mon[124666]: pgmap v2890: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 169 KiB/s wr, 11 op/s 2023-05-08T05:12:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:47 smithi186 ceph-mon[126480]: pgmap v2890: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 169 KiB/s wr, 11 op/s 2023-05-08T05:12:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:49 smithi133 ceph-mon[125939]: pgmap v2891: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 109 KiB/s wr, 6 op/s 2023-05-08T05:12:49.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5307.679372 secs 2023-05-08T05:12:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:49 smithi096 ceph-mon[124666]: pgmap v2891: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 109 KiB/s wr, 6 op/s 2023-05-08T05:12:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5307.679372 secs 2023-05-08T05:12:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:49 smithi186 ceph-mon[126480]: pgmap v2891: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 109 KiB/s wr, 6 op/s 2023-05-08T05:12:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5307.679372 secs 2023-05-08T05:12:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5308.236510 secs 2023-05-08T05:12:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5308.236510 secs 2023-05-08T05:12:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5308.236510 secs 2023-05-08T05:12:51.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:51 smithi133 ceph-mon[125939]: pgmap v2892: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 109 KiB/s wr, 9 op/s 2023-05-08T05:12:51.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5309.516814 secs 2023-05-08T05:12:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:51 smithi096 ceph-mon[124666]: pgmap v2892: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 109 KiB/s wr, 9 op/s 2023-05-08T05:12:51.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5309.516814 secs 2023-05-08T05:12:51.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:51 smithi186 ceph-mon[126480]: pgmap v2892: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 109 KiB/s wr, 9 op/s 2023-05-08T05:12:51.639 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5309.516814 secs 2023-05-08T05:12:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:53 smithi133 ceph-mon[125939]: pgmap v2893: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 6 op/s 2023-05-08T05:12:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:53 smithi096 ceph-mon[124666]: pgmap v2893: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 6 op/s 2023-05-08T05:12:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:53 smithi186 ceph-mon[126480]: pgmap v2893: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 6 op/s 2023-05-08T05:12:54.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5312.679481 secs 2023-05-08T05:12:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5312.679481 secs 2023-05-08T05:12:54.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5312.679481 secs 2023-05-08T05:12:55.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5313.236632 secs 2023-05-08T05:12:55.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:55 smithi096 ceph-mon[124666]: pgmap v2894: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 6 op/s 2023-05-08T05:12:55.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5313.236632 secs 2023-05-08T05:12:55.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:55 smithi186 ceph-mon[126480]: pgmap v2894: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 6 op/s 2023-05-08T05:12:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5313.236632 secs 2023-05-08T05:12:55.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:55 smithi133 ceph-mon[125939]: pgmap v2894: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 6 op/s 2023-05-08T05:12:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5314.516866 secs 2023-05-08T05:12:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5314.516866 secs 2023-05-08T05:12:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5314.516866 secs 2023-05-08T05:12:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:57 smithi096 ceph-mon[124666]: pgmap v2895: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 KiB/s wr, 9 op/s 2023-05-08T05:12:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:57 smithi186 ceph-mon[126480]: pgmap v2895: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 KiB/s wr, 9 op/s 2023-05-08T05:12:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:57 smithi133 ceph-mon[125939]: pgmap v2895: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 KiB/s wr, 9 op/s 2023-05-08T05:12:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:59 smithi096 ceph-mon[124666]: pgmap v2896: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:12:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5317.679599 secs 2023-05-08T05:12:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:12:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5318.236753 secs 2023-05-08T05:12:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:59 smithi186 ceph-mon[126480]: pgmap v2896: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:12:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5317.679599 secs 2023-05-08T05:12:59.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:12:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5318.236753 secs 2023-05-08T05:12:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:59 smithi133 ceph-mon[125939]: pgmap v2896: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:12:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5317.679599 secs 2023-05-08T05:12:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:12:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5318.236753 secs 2023-05-08T05:13:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:01 smithi186 ceph-mon[126480]: pgmap v2897: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T05:13:01.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5319.516929 secs 2023-05-08T05:13:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:01 smithi133 ceph-mon[125939]: pgmap v2897: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T05:13:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5319.516929 secs 2023-05-08T05:13:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:01 smithi096 ceph-mon[124666]: pgmap v2897: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T05:13:01.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5319.516929 secs 2023-05-08T05:13:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:03 smithi186 ceph-mon[126480]: pgmap v2898: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:13:03.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:03 smithi133 ceph-mon[125939]: pgmap v2898: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:13:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:03 smithi096 ceph-mon[124666]: pgmap v2898: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:13:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5322.679713 secs 2023-05-08T05:13:04.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5323.236825 secs 2023-05-08T05:13:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5322.679713 secs 2023-05-08T05:13:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5323.236825 secs 2023-05-08T05:13:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5322.679713 secs 2023-05-08T05:13:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5323.236825 secs 2023-05-08T05:13:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:05 smithi186 ceph-mon[126480]: pgmap v2899: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:13:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:05 smithi133 ceph-mon[125939]: pgmap v2899: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:13:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:05 smithi096 ceph-mon[124666]: pgmap v2899: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:13:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5324.517015 secs 2023-05-08T05:13:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:06 smithi186 ceph-mon[126480]: osdmap e260: 12 total, 12 up, 12 in 2023-05-08T05:13:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5324.517015 secs 2023-05-08T05:13:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:06 smithi133 ceph-mon[125939]: osdmap e260: 12 total, 12 up, 12 in 2023-05-08T05:13:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5324.517015 secs 2023-05-08T05:13:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:06 smithi096 ceph-mon[124666]: osdmap e260: 12 total, 12 up, 12 in 2023-05-08T05:13:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:07 smithi186 ceph-mon[126480]: pgmap v2901: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 118 KiB/s wr, 25 op/s 2023-05-08T05:13:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:07 smithi133 ceph-mon[125939]: pgmap v2901: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 118 KiB/s wr, 25 op/s 2023-05-08T05:13:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:07 smithi096 ceph-mon[124666]: pgmap v2901: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 118 KiB/s wr, 25 op/s 2023-05-08T05:13:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:09 smithi186 ceph-mon[126480]: pgmap v2902: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 118 KiB/s wr, 25 op/s 2023-05-08T05:13:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5327.679828 secs 2023-05-08T05:13:09.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5328.236944 secs 2023-05-08T05:13:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:09 smithi133 ceph-mon[125939]: pgmap v2902: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 118 KiB/s wr, 25 op/s 2023-05-08T05:13:09.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5327.679828 secs 2023-05-08T05:13:09.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5328.236944 secs 2023-05-08T05:13:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:09 smithi096 ceph-mon[124666]: pgmap v2902: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 118 KiB/s wr, 25 op/s 2023-05-08T05:13:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5327.679828 secs 2023-05-08T05:13:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5328.236944 secs 2023-05-08T05:13:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:11 smithi186 ceph-mon[126480]: pgmap v2903: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 119 KiB/s wr, 25 op/s 2023-05-08T05:13:11.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5329.517090 secs 2023-05-08T05:13:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:11 smithi133 ceph-mon[125939]: pgmap v2903: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 119 KiB/s wr, 25 op/s 2023-05-08T05:13:11.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5329.517090 secs 2023-05-08T05:13:11.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:11 smithi096 ceph-mon[124666]: pgmap v2903: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 119 KiB/s wr, 25 op/s 2023-05-08T05:13:11.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5329.517090 secs 2023-05-08T05:13:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:13 smithi186 ceph-mon[126480]: pgmap v2904: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 119 KiB/s wr, 25 op/s 2023-05-08T05:13:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:13 smithi133 ceph-mon[125939]: pgmap v2904: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 119 KiB/s wr, 25 op/s 2023-05-08T05:13:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:13 smithi096 ceph-mon[124666]: pgmap v2904: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 119 KiB/s wr, 25 op/s 2023-05-08T05:13:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5332.679922 secs 2023-05-08T05:13:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5333.237073 secs 2023-05-08T05:13:14.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:14 smithi186 ceph-mon[126480]: osdmap e261: 12 total, 12 up, 12 in 2023-05-08T05:13:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5332.679922 secs 2023-05-08T05:13:14.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5333.237073 secs 2023-05-08T05:13:14.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:14 smithi133 ceph-mon[125939]: osdmap e261: 12 total, 12 up, 12 in 2023-05-08T05:13:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5332.679922 secs 2023-05-08T05:13:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5333.237073 secs 2023-05-08T05:13:14.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:14 smithi096 ceph-mon[124666]: osdmap e261: 12 total, 12 up, 12 in 2023-05-08T05:13:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:15 smithi186 ceph-mon[126480]: pgmap v2905: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 119 KiB/s wr, 25 op/s 2023-05-08T05:13:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:15 smithi133 ceph-mon[125939]: pgmap v2905: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 119 KiB/s wr, 25 op/s 2023-05-08T05:13:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:15 smithi096 ceph-mon[124666]: pgmap v2905: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 119 KiB/s wr, 25 op/s 2023-05-08T05:13:16.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5334.517166 secs 2023-05-08T05:13:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5334.517166 secs 2023-05-08T05:13:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5334.517166 secs 2023-05-08T05:13:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:17 smithi186 ceph-mon[126480]: pgmap v2907: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T05:13:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:17 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:13:17.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:17 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:13:17.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:17 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:13:17.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:17 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:13:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:17 smithi133 ceph-mon[125939]: pgmap v2907: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T05:13:17.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:17 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:13:17.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:17 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:13:17.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:17 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:13:17.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:17 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:13:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:17 smithi096 ceph-mon[124666]: pgmap v2907: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T05:13:17.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:17 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:13:17.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:17 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:13:17.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:17 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:13:17.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:17 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:13:18.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:18 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:13:18.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:18 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T05:13:18.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:18 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T05:13:18.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:18 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:13:18.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:18 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:13:18.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:18 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T05:13:18.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:18 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T05:13:18.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:18 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:13:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:18 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:13:18.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:18 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T05:13:18.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:18 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T05:13:18.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:18 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:13:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:19 smithi186 ceph-mon[126480]: pgmap v2908: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T05:13:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5337.680066 secs 2023-05-08T05:13:19.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5338.237186 secs 2023-05-08T05:13:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:19 smithi133 ceph-mon[125939]: pgmap v2908: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T05:13:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5337.680066 secs 2023-05-08T05:13:19.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5338.237186 secs 2023-05-08T05:13:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:19 smithi096 ceph-mon[124666]: pgmap v2908: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T05:13:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5337.680066 secs 2023-05-08T05:13:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5338.237186 secs 2023-05-08T05:13:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:21 smithi186 ceph-mon[126480]: pgmap v2909: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T05:13:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5339.517284 secs 2023-05-08T05:13:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:21 smithi133 ceph-mon[125939]: pgmap v2909: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T05:13:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5339.517284 secs 2023-05-08T05:13:21.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:21 smithi096 ceph-mon[124666]: pgmap v2909: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T05:13:21.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5339.517284 secs 2023-05-08T05:13:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:23 smithi186 ceph-mon[126480]: pgmap v2910: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T05:13:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:23 smithi133 ceph-mon[125939]: pgmap v2910: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T05:13:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:23 smithi096 ceph-mon[124666]: pgmap v2910: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T05:13:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5342.680178 secs 2023-05-08T05:13:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5343.237304 secs 2023-05-08T05:13:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5342.680178 secs 2023-05-08T05:13:24.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5343.237304 secs 2023-05-08T05:13:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5342.680178 secs 2023-05-08T05:13:24.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5343.237304 secs 2023-05-08T05:13:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:25 smithi186 ceph-mon[126480]: pgmap v2911: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T05:13:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:25 smithi133 ceph-mon[125939]: pgmap v2911: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T05:13:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:25 smithi096 ceph-mon[124666]: pgmap v2911: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T05:13:26.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5344.517403 secs 2023-05-08T05:13:26.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5344.517403 secs 2023-05-08T05:13:26.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5344.517403 secs 2023-05-08T05:13:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:27 smithi186 ceph-mon[126480]: pgmap v2912: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 KiB/s wr, 8 op/s 2023-05-08T05:13:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:27 smithi133 ceph-mon[125939]: pgmap v2912: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 KiB/s wr, 8 op/s 2023-05-08T05:13:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:27 smithi096 ceph-mon[124666]: pgmap v2912: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 KiB/s wr, 8 op/s 2023-05-08T05:13:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:29 smithi186 ceph-mon[126480]: pgmap v2913: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2023-05-08T05:13:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5347.680327 secs 2023-05-08T05:13:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5348.237439 secs 2023-05-08T05:13:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:29 smithi133 ceph-mon[125939]: pgmap v2913: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2023-05-08T05:13:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5347.680327 secs 2023-05-08T05:13:29.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5348.237439 secs 2023-05-08T05:13:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:29 smithi096 ceph-mon[124666]: pgmap v2913: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2023-05-08T05:13:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5347.680327 secs 2023-05-08T05:13:29.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5348.237439 secs 2023-05-08T05:13:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:31 smithi186 ceph-mon[126480]: pgmap v2914: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 7 op/s 2023-05-08T05:13:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5349.517535 secs 2023-05-08T05:13:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:31 smithi133 ceph-mon[125939]: pgmap v2914: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 7 op/s 2023-05-08T05:13:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5349.517535 secs 2023-05-08T05:13:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:31 smithi096 ceph-mon[124666]: pgmap v2914: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 7 op/s 2023-05-08T05:13:31.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5349.517535 secs 2023-05-08T05:13:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:33 smithi186 ceph-mon[126480]: pgmap v2915: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:13:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:33 smithi133 ceph-mon[125939]: pgmap v2915: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:13:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:33 smithi096 ceph-mon[124666]: pgmap v2915: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:13:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5352.680428 secs 2023-05-08T05:13:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5353.237555 secs 2023-05-08T05:13:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5352.680428 secs 2023-05-08T05:13:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5353.237555 secs 2023-05-08T05:13:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5352.680428 secs 2023-05-08T05:13:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5353.237555 secs 2023-05-08T05:13:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:35 smithi186 ceph-mon[126480]: pgmap v2916: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:13:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:35 smithi133 ceph-mon[125939]: pgmap v2916: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:13:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:35 smithi096 ceph-mon[124666]: pgmap v2916: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:13:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:37 smithi186 ceph-mon[126480]: pgmap v2917: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 61 KiB/s wr, 8 op/s 2023-05-08T05:13:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:37 smithi133 ceph-mon[125939]: pgmap v2917: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 61 KiB/s wr, 8 op/s 2023-05-08T05:13:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:37 smithi096 ceph-mon[124666]: pgmap v2917: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 61 KiB/s wr, 8 op/s 2023-05-08T05:13:38.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:38 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:13:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:38 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:13:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:38 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:13:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:39 smithi133 ceph-mon[125939]: pgmap v2918: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 61 KiB/s wr, 5 op/s 2023-05-08T05:13:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5357.680493 secs 2023-05-08T05:13:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:39 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:13:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:39 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:13:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:39 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:13:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5358.237676 secs 2023-05-08T05:13:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:39 smithi096 ceph-mon[124666]: pgmap v2918: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 61 KiB/s wr, 5 op/s 2023-05-08T05:13:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5357.680493 secs 2023-05-08T05:13:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:39 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:13:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:39 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:13:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:39 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:13:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5358.237676 secs 2023-05-08T05:13:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:39 smithi186 ceph-mon[126480]: pgmap v2918: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 61 KiB/s wr, 5 op/s 2023-05-08T05:13:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5357.680493 secs 2023-05-08T05:13:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:39 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:13:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:39 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:13:39.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:39 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:13:39.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5358.237676 secs 2023-05-08T05:13:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:41 smithi133 ceph-mon[125939]: pgmap v2919: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 118 KiB/s wr, 9 op/s 2023-05-08T05:13:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5359.517768 secs 2023-05-08T05:13:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:41 smithi096 ceph-mon[124666]: pgmap v2919: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 118 KiB/s wr, 9 op/s 2023-05-08T05:13:41.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5359.517768 secs 2023-05-08T05:13:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:41 smithi186 ceph-mon[126480]: pgmap v2919: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 118 KiB/s wr, 9 op/s 2023-05-08T05:13:41.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5359.517768 secs 2023-05-08T05:13:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:43 smithi133 ceph-mon[125939]: pgmap v2920: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 118 KiB/s wr, 6 op/s 2023-05-08T05:13:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:13:43.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:13:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:43 smithi096 ceph-mon[124666]: pgmap v2920: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 118 KiB/s wr, 6 op/s 2023-05-08T05:13:43.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:13:43.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:13:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:43 smithi186 ceph-mon[126480]: pgmap v2920: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 118 KiB/s wr, 6 op/s 2023-05-08T05:13:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:13:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:13:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5362.680609 secs 2023-05-08T05:13:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5363.237775 secs 2023-05-08T05:13:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:44 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:13:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5362.680609 secs 2023-05-08T05:13:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5363.237775 secs 2023-05-08T05:13:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:44 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:13:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5362.680609 secs 2023-05-08T05:13:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5363.237775 secs 2023-05-08T05:13:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:44 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:13:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:45 smithi133 ceph-mon[125939]: pgmap v2921: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 118 KiB/s wr, 6 op/s 2023-05-08T05:13:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:45 smithi096 ceph-mon[124666]: pgmap v2921: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 118 KiB/s wr, 6 op/s 2023-05-08T05:13:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:45 smithi186 ceph-mon[126480]: pgmap v2921: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 118 KiB/s wr, 6 op/s 2023-05-08T05:13:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5364.517874 secs 2023-05-08T05:13:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:46 smithi133 ceph-mon[125939]: pgmap v2922: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 145 KiB/s wr, 10 op/s 2023-05-08T05:13:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5364.517874 secs 2023-05-08T05:13:46.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:46 smithi096 ceph-mon[124666]: pgmap v2922: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 145 KiB/s wr, 10 op/s 2023-05-08T05:13:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5364.517874 secs 2023-05-08T05:13:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:46 smithi186 ceph-mon[126480]: pgmap v2922: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 145 KiB/s wr, 10 op/s 2023-05-08T05:13:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:48 smithi133 ceph-mon[125939]: pgmap v2923: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 84 KiB/s wr, 6 op/s 2023-05-08T05:13:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:48 smithi096 ceph-mon[124666]: pgmap v2923: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 84 KiB/s wr, 6 op/s 2023-05-08T05:13:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:48 smithi186 ceph-mon[126480]: pgmap v2923: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 84 KiB/s wr, 6 op/s 2023-05-08T05:13:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5367.680673 secs 2023-05-08T05:13:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5368.237888 secs 2023-05-08T05:13:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5367.680673 secs 2023-05-08T05:13:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5368.237888 secs 2023-05-08T05:13:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5367.680673 secs 2023-05-08T05:13:50.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5368.237888 secs 2023-05-08T05:13:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:50 smithi133 ceph-mon[125939]: pgmap v2924: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 84 KiB/s wr, 9 op/s 2023-05-08T05:13:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5369.517950 secs 2023-05-08T05:13:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:50 smithi096 ceph-mon[124666]: pgmap v2924: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 84 KiB/s wr, 9 op/s 2023-05-08T05:13:51.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5369.517950 secs 2023-05-08T05:13:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:50 smithi186 ceph-mon[126480]: pgmap v2924: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 84 KiB/s wr, 9 op/s 2023-05-08T05:13:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5369.517950 secs 2023-05-08T05:13:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:52 smithi133 ceph-mon[125939]: pgmap v2925: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 5 op/s 2023-05-08T05:13:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:52 smithi096 ceph-mon[124666]: pgmap v2925: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 5 op/s 2023-05-08T05:13:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:52 smithi186 ceph-mon[126480]: pgmap v2925: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 5 op/s 2023-05-08T05:13:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5372.680792 secs 2023-05-08T05:13:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5372.680792 secs 2023-05-08T05:13:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5372.680792 secs 2023-05-08T05:13:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5373.238005 secs 2023-05-08T05:13:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:54 smithi133 ceph-mon[125939]: pgmap v2926: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 5 op/s 2023-05-08T05:13:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5373.238005 secs 2023-05-08T05:13:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:54 smithi096 ceph-mon[124666]: pgmap v2926: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 5 op/s 2023-05-08T05:13:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5373.238005 secs 2023-05-08T05:13:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:54 smithi186 ceph-mon[126480]: pgmap v2926: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 5 op/s 2023-05-08T05:13:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5374.518029 secs 2023-05-08T05:13:56.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5374.518029 secs 2023-05-08T05:13:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5374.518029 secs 2023-05-08T05:13:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:56 smithi133 ceph-mon[125939]: pgmap v2927: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 KiB/s wr, 8 op/s 2023-05-08T05:13:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:56 smithi096 ceph-mon[124666]: pgmap v2927: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 KiB/s wr, 8 op/s 2023-05-08T05:13:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:56 smithi186 ceph-mon[126480]: pgmap v2927: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 KiB/s wr, 8 op/s 2023-05-08T05:13:59.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:58 smithi133 ceph-mon[125939]: pgmap v2928: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T05:13:59.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5377.680909 secs 2023-05-08T05:13:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:58 smithi096 ceph-mon[124666]: pgmap v2928: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T05:13:59.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5377.680909 secs 2023-05-08T05:13:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:58 smithi186 ceph-mon[126480]: pgmap v2928: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T05:13:59.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5377.680909 secs 2023-05-08T05:14:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:13:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5378.238141 secs 2023-05-08T05:14:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:13:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5378.238141 secs 2023-05-08T05:14:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:13:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5378.238141 secs 2023-05-08T05:14:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:00 smithi133 ceph-mon[125939]: pgmap v2929: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T05:14:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5379.518099 secs 2023-05-08T05:14:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:00 smithi096 ceph-mon[124666]: pgmap v2929: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T05:14:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5379.518099 secs 2023-05-08T05:14:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:00 smithi186 ceph-mon[126480]: pgmap v2929: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T05:14:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5379.518099 secs 2023-05-08T05:14:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:02 smithi133 ceph-mon[125939]: pgmap v2930: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:14:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:02 smithi096 ceph-mon[124666]: pgmap v2930: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:14:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:02 smithi186 ceph-mon[126480]: pgmap v2930: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:14:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5382.681035 secs 2023-05-08T05:14:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5382.681035 secs 2023-05-08T05:14:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5382.681035 secs 2023-05-08T05:14:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5383.238263 secs 2023-05-08T05:14:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:04 smithi133 ceph-mon[125939]: pgmap v2931: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:14:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5383.238263 secs 2023-05-08T05:14:05.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:04 smithi096 ceph-mon[124666]: pgmap v2931: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:14:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5383.238263 secs 2023-05-08T05:14:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:04 smithi186 ceph-mon[126480]: pgmap v2931: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:14:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5384.518244 secs 2023-05-08T05:14:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:05 smithi133 ceph-mon[125939]: osdmap e262: 12 total, 12 up, 12 in 2023-05-08T05:14:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5384.518244 secs 2023-05-08T05:14:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:05 smithi096 ceph-mon[124666]: osdmap e262: 12 total, 12 up, 12 in 2023-05-08T05:14:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5384.518244 secs 2023-05-08T05:14:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:05 smithi186 ceph-mon[126480]: osdmap e262: 12 total, 12 up, 12 in 2023-05-08T05:14:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:06 smithi133 ceph-mon[125939]: pgmap v2933: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 150 KiB/s wr, 25 op/s 2023-05-08T05:14:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:06 smithi096 ceph-mon[124666]: pgmap v2933: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 150 KiB/s wr, 25 op/s 2023-05-08T05:14:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:06 smithi186 ceph-mon[126480]: pgmap v2933: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 150 KiB/s wr, 25 op/s 2023-05-08T05:14:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:08 smithi133 ceph-mon[125939]: pgmap v2934: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 150 KiB/s wr, 25 op/s 2023-05-08T05:14:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5387.681153 secs 2023-05-08T05:14:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:08 smithi096 ceph-mon[124666]: pgmap v2934: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 150 KiB/s wr, 25 op/s 2023-05-08T05:14:09.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5387.681153 secs 2023-05-08T05:14:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:08 smithi186 ceph-mon[126480]: pgmap v2934: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 150 KiB/s wr, 25 op/s 2023-05-08T05:14:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5387.681153 secs 2023-05-08T05:14:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5388.238380 secs 2023-05-08T05:14:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5388.238380 secs 2023-05-08T05:14:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5388.238380 secs 2023-05-08T05:14:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:10 smithi096 ceph-mon[124666]: pgmap v2935: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 151 KiB/s wr, 26 op/s 2023-05-08T05:14:11.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5389.518377 secs 2023-05-08T05:14:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:10 smithi186 ceph-mon[126480]: pgmap v2935: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 151 KiB/s wr, 26 op/s 2023-05-08T05:14:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5389.518377 secs 2023-05-08T05:14:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:10 smithi133 ceph-mon[125939]: pgmap v2935: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 151 KiB/s wr, 26 op/s 2023-05-08T05:14:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5389.518377 secs 2023-05-08T05:14:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:12 smithi096 ceph-mon[124666]: pgmap v2936: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 151 KiB/s wr, 26 op/s 2023-05-08T05:14:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:13 smithi186 ceph-mon[126480]: pgmap v2936: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 151 KiB/s wr, 26 op/s 2023-05-08T05:14:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:13 smithi133 ceph-mon[125939]: pgmap v2936: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 151 KiB/s wr, 26 op/s 2023-05-08T05:14:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5392.681274 secs 2023-05-08T05:14:14.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:14 smithi186 ceph-mon[126480]: osdmap e263: 12 total, 12 up, 12 in 2023-05-08T05:14:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5392.681274 secs 2023-05-08T05:14:14.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:14 smithi133 ceph-mon[125939]: osdmap e263: 12 total, 12 up, 12 in 2023-05-08T05:14:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5392.681274 secs 2023-05-08T05:14:14.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:14 smithi096 ceph-mon[124666]: osdmap e263: 12 total, 12 up, 12 in 2023-05-08T05:14:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5393.238503 secs 2023-05-08T05:14:15.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:15 smithi186 ceph-mon[126480]: pgmap v2937: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 151 KiB/s wr, 26 op/s 2023-05-08T05:14:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5393.238503 secs 2023-05-08T05:14:15.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:15 smithi133 ceph-mon[125939]: pgmap v2937: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 151 KiB/s wr, 26 op/s 2023-05-08T05:14:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5393.238503 secs 2023-05-08T05:14:15.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:15 smithi096 ceph-mon[124666]: pgmap v2937: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 151 KiB/s wr, 26 op/s 2023-05-08T05:14:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5394.518511 secs 2023-05-08T05:14:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5394.518511 secs 2023-05-08T05:14:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5394.518511 secs 2023-05-08T05:14:17.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:17 smithi186 ceph-mon[126480]: pgmap v2939: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 8 op/s 2023-05-08T05:14:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:17 smithi133 ceph-mon[125939]: pgmap v2939: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 8 op/s 2023-05-08T05:14:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:17 smithi096 ceph-mon[124666]: pgmap v2939: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 8 op/s 2023-05-08T05:14:18.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:14:18.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:14:18.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:14:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:19 smithi186 ceph-mon[126480]: pgmap v2940: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 8 op/s 2023-05-08T05:14:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5397.681393 secs 2023-05-08T05:14:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:19 smithi133 ceph-mon[125939]: pgmap v2940: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 8 op/s 2023-05-08T05:14:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5397.681393 secs 2023-05-08T05:14:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:19 smithi096 ceph-mon[124666]: pgmap v2940: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 8 op/s 2023-05-08T05:14:19.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5397.681393 secs 2023-05-08T05:14:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5398.238542 secs 2023-05-08T05:14:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:20 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:14:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:20 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:14:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:20 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:14:20.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:20 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:14:20.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:20 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:14:20.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:20 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:14:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5398.238542 secs 2023-05-08T05:14:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:20 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:14:20.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:20 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:14:20.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:20 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:14:20.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:20 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:14:20.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:20 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:14:20.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:20 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:14:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5398.238542 secs 2023-05-08T05:14:20.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:20 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:14:20.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:20 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:14:20.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:20 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:14:20.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:20 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:14:20.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:20 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:14:20.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:20 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:14:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:21 smithi186 ceph-mon[126480]: pgmap v2941: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 7 op/s 2023-05-08T05:14:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5399.518602 secs 2023-05-08T05:14:21.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:14:21.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:14:21.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:14:21.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:14:21.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:14:21.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:14:21.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:14:21.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:14:21.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:14:21.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:14:21.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:14:21.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:14:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:21 smithi133 ceph-mon[125939]: pgmap v2941: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 7 op/s 2023-05-08T05:14:21.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5399.518602 secs 2023-05-08T05:14:21.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:14:21.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:14:21.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:14:21.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:14:21.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:14:21.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:14:21.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:14:21.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:14:21.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:14:21.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:14:21.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:14:21.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:14:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:21 smithi096 ceph-mon[124666]: pgmap v2941: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 7 op/s 2023-05-08T05:14:21.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5399.518602 secs 2023-05-08T05:14:21.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:14:21.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:14:21.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:14:21.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:14:21.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:14:21.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:14:21.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:14:21.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:14:21.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:14:21.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:14:21.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:14:21.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:14:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:22 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T05:14:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:22 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T05:14:22.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:22 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T05:14:22.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:22 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T05:14:22.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:22 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:14:22.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:22 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:14:22.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:22 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:14:22.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:22 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:14:22.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:22 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:14:22.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:22 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:14:22.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:22 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi096 to 196.2M 2023-05-08T05:14:22.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:22 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi096 to 205766758: error parsing value: Value '205766758' is below minimum 939524096 2023-05-08T05:14:22.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:22 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:14:22.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:22 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:14:22.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:22 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:14:22.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:22 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:14:22.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:22 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T05:14:22.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:22 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T05:14:22.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:22 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:14:22.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:22 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T05:14:22.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:22 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T05:14:22.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:22 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T05:14:22.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:22 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T05:14:22.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:22 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:14:22.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:22 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:14:22.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:22 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:14:22.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:22 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:14:22.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:22 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:14:22.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:22 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:14:22.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:22 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi096 to 196.2M 2023-05-08T05:14:22.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:22 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi096 to 205766758: error parsing value: Value '205766758' is below minimum 939524096 2023-05-08T05:14:22.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:22 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:14:22.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:22 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:14:22.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:22 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:14:22.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:22 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:14:22.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:22 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T05:14:22.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:22 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T05:14:22.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:22 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:14:22.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:22 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T05:14:22.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:22 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T05:14:22.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:22 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T05:14:22.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:22 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T05:14:22.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:22 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:14:22.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:22 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:14:22.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:22 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:14:22.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:22 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:14:22.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:22 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:14:22.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:22 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:14:22.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:22 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi096 to 196.2M 2023-05-08T05:14:22.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:22 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi096 to 205766758: error parsing value: Value '205766758' is below minimum 939524096 2023-05-08T05:14:22.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:22 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:14:22.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:22 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:14:22.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:22 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:14:22.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:22 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:14:22.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:22 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T05:14:22.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:22 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T05:14:22.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:22 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:14:23.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:23 smithi186 ceph-mon[126480]: pgmap v2942: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 7 op/s 2023-05-08T05:14:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:23 smithi133 ceph-mon[125939]: pgmap v2942: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 7 op/s 2023-05-08T05:14:23.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:23 smithi096 ceph-mon[124666]: pgmap v2942: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 7 op/s 2023-05-08T05:14:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5402.681512 secs 2023-05-08T05:14:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5402.681512 secs 2023-05-08T05:14:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5402.681512 secs 2023-05-08T05:14:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5403.238660 secs 2023-05-08T05:14:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:25 smithi186 ceph-mon[126480]: pgmap v2943: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 7 op/s 2023-05-08T05:14:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5403.238660 secs 2023-05-08T05:14:25.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:25 smithi133 ceph-mon[125939]: pgmap v2943: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 7 op/s 2023-05-08T05:14:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5403.238660 secs 2023-05-08T05:14:25.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:25 smithi096 ceph-mon[124666]: pgmap v2943: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 7 op/s 2023-05-08T05:14:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5404.518691 secs 2023-05-08T05:14:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5404.518691 secs 2023-05-08T05:14:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5404.518691 secs 2023-05-08T05:14:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:27 smithi186 ceph-mon[126480]: pgmap v2944: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 28 KiB/s wr, 9 op/s 2023-05-08T05:14:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:27 smithi133 ceph-mon[125939]: pgmap v2944: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 28 KiB/s wr, 9 op/s 2023-05-08T05:14:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:27 smithi096 ceph-mon[124666]: pgmap v2944: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 28 KiB/s wr, 9 op/s 2023-05-08T05:14:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:29 smithi186 ceph-mon[126480]: pgmap v2945: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:14:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5407.681626 secs 2023-05-08T05:14:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:29 smithi133 ceph-mon[125939]: pgmap v2945: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:14:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5407.681626 secs 2023-05-08T05:14:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:29 smithi096 ceph-mon[124666]: pgmap v2945: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:14:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5407.681626 secs 2023-05-08T05:14:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5408.238799 secs 2023-05-08T05:14:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5408.238799 secs 2023-05-08T05:14:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5408.238799 secs 2023-05-08T05:14:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:31 smithi186 ceph-mon[126480]: pgmap v2946: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T05:14:31.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5409.518827 secs 2023-05-08T05:14:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:31 smithi133 ceph-mon[125939]: pgmap v2946: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T05:14:31.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5409.518827 secs 2023-05-08T05:14:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:31 smithi096 ceph-mon[124666]: pgmap v2946: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T05:14:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5409.518827 secs 2023-05-08T05:14:33.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:33 smithi186 ceph-mon[126480]: pgmap v2947: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:14:33.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:33 smithi133 ceph-mon[125939]: pgmap v2947: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:14:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:33 smithi096 ceph-mon[124666]: pgmap v2947: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:14:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5412.681733 secs 2023-05-08T05:14:34.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5412.681733 secs 2023-05-08T05:14:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5412.681733 secs 2023-05-08T05:14:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5413.238900 secs 2023-05-08T05:14:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:35 smithi186 ceph-mon[126480]: pgmap v2948: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:14:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5413.238900 secs 2023-05-08T05:14:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:35 smithi133 ceph-mon[125939]: pgmap v2948: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:14:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5413.238900 secs 2023-05-08T05:14:35.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:35 smithi096 ceph-mon[124666]: pgmap v2948: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:14:37.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:37 smithi186 ceph-mon[126480]: pgmap v2949: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 63 KiB/s wr, 9 op/s 2023-05-08T05:14:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:37 smithi133 ceph-mon[125939]: pgmap v2949: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 63 KiB/s wr, 9 op/s 2023-05-08T05:14:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:37 smithi096 ceph-mon[124666]: pgmap v2949: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 63 KiB/s wr, 9 op/s 2023-05-08T05:14:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:38 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:14:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:38 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:14:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:38 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:14:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:39 smithi186 ceph-mon[126480]: pgmap v2950: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 63 KiB/s wr, 6 op/s 2023-05-08T05:14:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5417.681851 secs 2023-05-08T05:14:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:39 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:14:39.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:39 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:14:39.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:39 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:14:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:39 smithi133 ceph-mon[125939]: pgmap v2950: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 63 KiB/s wr, 6 op/s 2023-05-08T05:14:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5417.681851 secs 2023-05-08T05:14:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:39 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:14:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:39 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:14:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:39 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:14:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:39 smithi096 ceph-mon[124666]: pgmap v2950: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 63 KiB/s wr, 6 op/s 2023-05-08T05:14:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5417.681851 secs 2023-05-08T05:14:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:39 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:14:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:39 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:14:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:39 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:14:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5418.239036 secs 2023-05-08T05:14:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5418.239036 secs 2023-05-08T05:14:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5418.239036 secs 2023-05-08T05:14:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:41 smithi186 ceph-mon[126480]: pgmap v2951: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 122 KiB/s wr, 9 op/s 2023-05-08T05:14:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5419.518973 secs 2023-05-08T05:14:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:41 smithi133 ceph-mon[125939]: pgmap v2951: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 122 KiB/s wr, 9 op/s 2023-05-08T05:14:41.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5419.518973 secs 2023-05-08T05:14:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:41 smithi096 ceph-mon[124666]: pgmap v2951: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 122 KiB/s wr, 9 op/s 2023-05-08T05:14:41.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5419.518973 secs 2023-05-08T05:14:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:43 smithi186 ceph-mon[126480]: pgmap v2952: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 122 KiB/s wr, 6 op/s 2023-05-08T05:14:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:14:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:14:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:43 smithi133 ceph-mon[125939]: pgmap v2952: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 122 KiB/s wr, 6 op/s 2023-05-08T05:14:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:14:43.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:14:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:43 smithi096 ceph-mon[124666]: pgmap v2952: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 122 KiB/s wr, 6 op/s 2023-05-08T05:14:43.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:14:43.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:14:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5422.681967 secs 2023-05-08T05:14:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:44 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:14:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5422.681967 secs 2023-05-08T05:14:44.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:44 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:14:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5422.681967 secs 2023-05-08T05:14:44.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:44 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:14:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5423.239159 secs 2023-05-08T05:14:45.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:45 smithi133 ceph-mon[125939]: pgmap v2953: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 122 KiB/s wr, 6 op/s 2023-05-08T05:14:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5423.239159 secs 2023-05-08T05:14:45.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:45 smithi096 ceph-mon[124666]: pgmap v2953: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 122 KiB/s wr, 6 op/s 2023-05-08T05:14:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5423.239159 secs 2023-05-08T05:14:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:45 smithi186 ceph-mon[126480]: pgmap v2953: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 122 KiB/s wr, 6 op/s 2023-05-08T05:14:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5424.519110 secs 2023-05-08T05:14:46.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5424.519110 secs 2023-05-08T05:14:46.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5424.519110 secs 2023-05-08T05:14:47.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:47 smithi133 ceph-mon[125939]: pgmap v2954: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 158 KiB/s wr, 10 op/s 2023-05-08T05:14:47.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:47 smithi096 ceph-mon[124666]: pgmap v2954: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 158 KiB/s wr, 10 op/s 2023-05-08T05:14:47.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:47 smithi186 ceph-mon[126480]: pgmap v2954: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 158 KiB/s wr, 10 op/s 2023-05-08T05:14:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:49 smithi133 ceph-mon[125939]: pgmap v2955: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 94 KiB/s wr, 6 op/s 2023-05-08T05:14:49.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5427.682101 secs 2023-05-08T05:14:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:49 smithi096 ceph-mon[124666]: pgmap v2955: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 94 KiB/s wr, 6 op/s 2023-05-08T05:14:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5427.682101 secs 2023-05-08T05:14:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:49 smithi186 ceph-mon[126480]: pgmap v2955: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 94 KiB/s wr, 6 op/s 2023-05-08T05:14:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5427.682101 secs 2023-05-08T05:14:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5428.239278 secs 2023-05-08T05:14:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5428.239278 secs 2023-05-08T05:14:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5428.239278 secs 2023-05-08T05:14:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:51 smithi133 ceph-mon[125939]: pgmap v2956: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 94 KiB/s wr, 8 op/s 2023-05-08T05:14:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5429.519239 secs 2023-05-08T05:14:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:51 smithi096 ceph-mon[124666]: pgmap v2956: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 94 KiB/s wr, 8 op/s 2023-05-08T05:14:51.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5429.519239 secs 2023-05-08T05:14:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:51 smithi186 ceph-mon[126480]: pgmap v2956: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 94 KiB/s wr, 8 op/s 2023-05-08T05:14:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5429.519239 secs 2023-05-08T05:14:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:53 smithi133 ceph-mon[125939]: pgmap v2957: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 6 op/s 2023-05-08T05:14:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:53 smithi096 ceph-mon[124666]: pgmap v2957: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 6 op/s 2023-05-08T05:14:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:53 smithi186 ceph-mon[126480]: pgmap v2957: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 6 op/s 2023-05-08T05:14:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5432.682237 secs 2023-05-08T05:14:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5432.682237 secs 2023-05-08T05:14:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5432.682237 secs 2023-05-08T05:14:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5433.239378 secs 2023-05-08T05:14:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:55 smithi133 ceph-mon[125939]: pgmap v2958: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 6 op/s 2023-05-08T05:14:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5433.239378 secs 2023-05-08T05:14:55.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:55 smithi096 ceph-mon[124666]: pgmap v2958: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 6 op/s 2023-05-08T05:14:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5433.239378 secs 2023-05-08T05:14:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:55 smithi186 ceph-mon[126480]: pgmap v2958: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 6 op/s 2023-05-08T05:14:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5434.519374 secs 2023-05-08T05:14:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5434.519374 secs 2023-05-08T05:14:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5434.519374 secs 2023-05-08T05:14:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:57 smithi133 ceph-mon[125939]: pgmap v2959: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 8 op/s 2023-05-08T05:14:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:57 smithi096 ceph-mon[124666]: pgmap v2959: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 8 op/s 2023-05-08T05:14:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:57 smithi186 ceph-mon[126480]: pgmap v2959: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 8 op/s 2023-05-08T05:14:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:59 smithi133 ceph-mon[125939]: pgmap v2960: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 5 op/s 2023-05-08T05:14:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:14:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5437.682364 secs 2023-05-08T05:14:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:59 smithi096 ceph-mon[124666]: pgmap v2960: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 5 op/s 2023-05-08T05:14:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:14:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5437.682364 secs 2023-05-08T05:14:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:59 smithi186 ceph-mon[126480]: pgmap v2960: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 5 op/s 2023-05-08T05:14:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:14:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5437.682364 secs 2023-05-08T05:15:00.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:15:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5438.239521 secs 2023-05-08T05:15:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:15:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5438.239521 secs 2023-05-08T05:15:00.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:15:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5438.239521 secs 2023-05-08T05:15:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:15:01 smithi133 ceph-mon[125939]: pgmap v2961: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 15 KiB/s wr, 7 op/s 2023-05-08T05:15:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:15:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5439.519506 secs 2023-05-08T05:15:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:15:01 smithi096 ceph-mon[124666]: pgmap v2961: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 15 KiB/s wr, 7 op/s 2023-05-08T05:15:01.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:15:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5439.519506 secs 2023-05-08T05:15:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:15:01 smithi186 ceph-mon[126480]: pgmap v2961: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 15 KiB/s wr, 7 op/s 2023-05-08T05:15:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:15:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5439.519506 secs 2023-05-08T05:15:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:15:03 smithi133 ceph-mon[125939]: pgmap v2962: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 5 op/s 2023-05-08T05:15:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:15:03 smithi096 ceph-mon[124666]: pgmap v2962: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 5 op/s 2023-05-08T05:15:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:15:03 smithi186 ceph-mon[126480]: pgmap v2962: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 5 op/s 2023-05-08T05:15:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:15:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5442.682455 secs 2023-05-08T05:15:04.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:15:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5442.682455 secs 2023-05-08T05:15:04.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:15:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5442.682455 secs 2023-05-08T05:15:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:15:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5443.239646 secs 2023-05-08T05:15:05.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:15:05 smithi133 ceph-mon[125939]: pgmap v2963: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 5 op/s 2023-05-08T05:15:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:15:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5443.239646 secs 2023-05-08T05:15:05.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:15:05 smithi096 ceph-mon[124666]: pgmap v2963: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 5 op/s 2023-05-08T05:15:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:15:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5443.239646 secs 2023-05-08T05:15:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:15:05 smithi186 ceph-mon[126480]: pgmap v2963: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 5 op/s 2023-05-08T05:15:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:15:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5444.519642 secs 2023-05-08T05:15:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:15:06 smithi133 ceph-mon[125939]: osdmap e264: 12 total, 12 up, 12 in 2023-05-08T05:15:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:15:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5444.519642 secs 2023-05-08T05:15:06.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:15:06 smithi096 ceph-mon[124666]: osdmap e264: 12 total, 12 up, 12 in 2023-05-08T05:15:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:15:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5444.519642 secs 2023-05-08T05:15:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:15:06 smithi186 ceph-mon[126480]: osdmap e264: 12 total, 12 up, 12 in 2023-05-08T05:15:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:15:07 smithi133 ceph-mon[125939]: pgmap v2965: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 113 KiB/s wr, 24 op/s 2023-05-08T05:15:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:15:07 smithi096 ceph-mon[124666]: pgmap v2965: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 113 KiB/s wr, 24 op/s 2023-05-08T05:15:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:15:07 smithi186 ceph-mon[126480]: pgmap v2965: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 113 KiB/s wr, 24 op/s 2023-05-08T05:15:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:15:09 smithi133 ceph-mon[125939]: pgmap v2966: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 113 KiB/s wr, 24 op/s 2023-05-08T05:15:09.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:15:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5447.682579 secs 2023-05-08T05:15:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:15:09 smithi096 ceph-mon[124666]: pgmap v2966: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 113 KiB/s wr, 24 op/s 2023-05-08T05:15:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:15:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5447.682579 secs 2023-05-08T05:15:09.623 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:15:09 smithi186 ceph-mon[126480]: pgmap v2966: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 113 KiB/s wr, 24 op/s 2023-05-08T05:15:09.625 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:15:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5447.682579 secs 2023-05-08T05:15:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:15:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5448.239766 secs 2023-05-08T05:15:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:15:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5448.239766 secs 2023-05-08T05:15:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:15:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5448.239766 secs 2023-05-08T05:15:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:15:11 smithi133 ceph-mon[125939]: pgmap v2967: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 121 KiB/s wr, 25 op/s 2023-05-08T05:15:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:15:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5449.519782 secs 2023-05-08T05:15:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:15:11 smithi096 ceph-mon[124666]: pgmap v2967: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 121 KiB/s wr, 25 op/s 2023-05-08T05:15:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:15:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5449.519782 secs 2023-05-08T05:15:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:15:11 smithi186 ceph-mon[126480]: pgmap v2967: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 121 KiB/s wr, 25 op/s 2023-05-08T05:15:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:15:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5449.519782 secs 2023-05-08T05:15:13.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:15:13 smithi133 ceph-mon[125939]: pgmap v2968: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 121 KiB/s wr, 25 op/s 2023-05-08T05:15:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:15:13 smithi096 ceph-mon[124666]: pgmap v2968: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 121 KiB/s wr, 25 op/s 2023-05-08T05:15:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:15:13 smithi186 ceph-mon[126480]: pgmap v2968: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 121 KiB/s wr, 25 op/s 2023-05-08T05:15:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:15:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5452.682678 secs 2023-05-08T05:15:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:15:14 smithi133 ceph-mon[125939]: osdmap e265: 12 total, 12 up, 12 in 2023-05-08T05:15:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:15:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5452.682678 secs 2023-05-08T05:15:14.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:15:14 smithi096 ceph-mon[124666]: osdmap e265: 12 total, 12 up, 12 in 2023-05-08T05:15:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:15:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5452.682678 secs 2023-05-08T05:15:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:15:14 smithi186 ceph-mon[126480]: osdmap e265: 12 total, 12 up, 12 in 2023-05-08T05:15:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:15:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5453.239833 secs 2023-05-08T05:15:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:15:15 smithi133 ceph-mon[125939]: pgmap v2969: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 121 KiB/s wr, 25 op/s 2023-05-08T05:15:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:15:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5453.239833 secs 2023-05-08T05:15:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:15:15 smithi096 ceph-mon[124666]: pgmap v2969: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 121 KiB/s wr, 25 op/s 2023-05-08T05:15:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:15:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5453.239833 secs 2023-05-08T05:15:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:15:15 smithi186 ceph-mon[126480]: pgmap v2969: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 121 KiB/s wr, 25 op/s 2023-05-08T05:15:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:15:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5454.519924 secs 2023-05-08T05:15:16.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:15:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5454.519924 secs 2023-05-08T05:15:16.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:15:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5454.519924 secs 2023-05-08T05:15:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:15:17 smithi133 ceph-mon[125939]: pgmap v2971: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 72 KiB/s wr, 8 op/s 2023-05-08T05:15:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:15:17 smithi096 ceph-mon[124666]: pgmap v2971: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 72 KiB/s wr, 8 op/s 2023-05-08T05:15:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:15:17 smithi186 ceph-mon[126480]: pgmap v2971: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 72 KiB/s wr, 8 op/s 2023-05-08T05:15:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:15:19 smithi133 ceph-mon[125939]: pgmap v2972: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 72 KiB/s wr, 8 op/s 2023-05-08T05:15:19.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:15:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5457.682780 secs 2023-05-08T05:15:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:15:19 smithi096 ceph-mon[124666]: pgmap v2972: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 72 KiB/s wr, 8 op/s 2023-05-08T05:15:19.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:15:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5457.682780 secs 2023-05-08T05:15:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:15:19 smithi186 ceph-mon[126480]: pgmap v2972: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 72 KiB/s wr, 8 op/s 2023-05-08T05:15:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:15:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5457.682780 secs 2023-05-08T05:15:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:15:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5458.239964 secs 2023-05-08T05:15:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:15:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5458.239964 secs 2023-05-08T05:15:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:15:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5458.239964 secs 2023-05-08T05:15:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:15:21 smithi133 ceph-mon[125939]: pgmap v2973: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 65 KiB/s wr, 7 op/s 2023-05-08T05:15:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:15:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5459.520057 secs 2023-05-08T05:15:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:15:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:15:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:15:21 smithi096 ceph-mon[124666]: pgmap v2973: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 65 KiB/s wr, 7 op/s 2023-05-08T05:15:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:15:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5459.520057 secs 2023-05-08T05:15:21.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:15:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:15:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:15:21 smithi186 ceph-mon[126480]: pgmap v2973: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 65 KiB/s wr, 7 op/s 2023-05-08T05:15:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:15:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5459.520057 secs 2023-05-08T05:15:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:15:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:15:22.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:15:22 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:15:22.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:15:22 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:15:22.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:15:22 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:15:22.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:15:22 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:15:22.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:15:22 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:15:22.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:15:22 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:15:22.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:15:22 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:15:22.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:15:22 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:15:22.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:15:22 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:15:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:15:23 smithi133 ceph-mon[125939]: pgmap v2974: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 65 KiB/s wr, 7 op/s 2023-05-08T05:15:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:15:23 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:15:23.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:15:23 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T05:15:23.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:15:23 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T05:15:23.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:15:23 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:15:23.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:15:23 smithi096 ceph-mon[124666]: pgmap v2974: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 65 KiB/s wr, 7 op/s 2023-05-08T05:15:23.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:15:23 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:15:23.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:15:23 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T05:15:23.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:15:23 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T05:15:23.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:15:23 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:15:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:15:23 smithi186 ceph-mon[126480]: pgmap v2974: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 65 KiB/s wr, 7 op/s 2023-05-08T05:15:23.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:15:23 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:15:23.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:15:23 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T05:15:23.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:15:23 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T05:15:23.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:15:23 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:15:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:15:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5462.682915 secs 2023-05-08T05:15:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:15:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5462.682915 secs 2023-05-08T05:15:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:15:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5462.682915 secs 2023-05-08T05:15:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:15:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5463.240078 secs 2023-05-08T05:15:25.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:15:25 smithi096 ceph-mon[124666]: pgmap v2975: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 65 KiB/s wr, 7 op/s 2023-05-08T05:15:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:15:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5463.240078 secs 2023-05-08T05:15:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:15:25 smithi186 ceph-mon[126480]: pgmap v2975: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 65 KiB/s wr, 7 op/s 2023-05-08T05:15:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:15:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5463.240078 secs 2023-05-08T05:15:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:15:25 smithi133 ceph-mon[125939]: pgmap v2975: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 65 KiB/s wr, 7 op/s 2023-05-08T05:15:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:15:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5464.520207 secs 2023-05-08T05:15:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:15:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5464.520207 secs 2023-05-08T05:15:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:15:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5464.520207 secs 2023-05-08T05:15:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:15:27 smithi096 ceph-mon[124666]: pgmap v2976: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 55 KiB/s wr, 9 op/s 2023-05-08T05:15:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:15:27 smithi186 ceph-mon[126480]: pgmap v2976: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 55 KiB/s wr, 9 op/s 2023-05-08T05:15:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:15:27 smithi133 ceph-mon[125939]: pgmap v2976: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 55 KiB/s wr, 9 op/s 2023-05-08T05:15:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:15:29 smithi186 ceph-mon[126480]: pgmap v2977: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2023-05-08T05:15:29.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:15:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5467.683011 secs 2023-05-08T05:15:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:15:29 smithi133 ceph-mon[125939]: pgmap v2977: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2023-05-08T05:15:29.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:15:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5467.683011 secs 2023-05-08T05:15:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:15:29 smithi096 ceph-mon[124666]: pgmap v2977: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2023-05-08T05:15:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:15:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5467.683011 secs 2023-05-08T05:15:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:15:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5468.240225 secs 2023-05-08T05:15:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:15:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5468.240225 secs 2023-05-08T05:15:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:15:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5468.240225 secs 2023-05-08T05:15:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:15:31 smithi186 ceph-mon[126480]: pgmap v2978: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 8 op/s 2023-05-08T05:15:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:15:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5469.520343 secs 2023-05-08T05:15:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:15:31 smithi133 ceph-mon[125939]: pgmap v2978: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 8 op/s 2023-05-08T05:15:31.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:15:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5469.520343 secs 2023-05-08T05:15:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:15:31 smithi096 ceph-mon[124666]: pgmap v2978: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 8 op/s 2023-05-08T05:15:31.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:15:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5469.520343 secs 2023-05-08T05:15:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:15:33 smithi186 ceph-mon[126480]: pgmap v2979: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:15:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:15:33 smithi133 ceph-mon[125939]: pgmap v2979: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:15:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:15:33 smithi096 ceph-mon[124666]: pgmap v2979: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:15:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:15:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5472.683150 secs 2023-05-08T05:15:34.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:15:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5473.240322 secs 2023-05-08T05:15:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:15:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5472.683150 secs 2023-05-08T05:15:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:15:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5473.240322 secs 2023-05-08T05:15:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:15:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5472.683150 secs 2023-05-08T05:15:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:15:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5473.240322 secs 2023-05-08T05:15:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:15:35 smithi186 ceph-mon[126480]: pgmap v2980: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:15:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:15:35 smithi133 ceph-mon[125939]: pgmap v2980: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:15:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:15:35 smithi096 ceph-mon[124666]: pgmap v2980: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:15:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:15:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5474.520482 secs 2023-05-08T05:15:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:15:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5474.520482 secs 2023-05-08T05:15:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:15:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5474.520482 secs 2023-05-08T05:15:37.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:15:37 smithi186 ceph-mon[126480]: pgmap v2981: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 73 KiB/s wr, 9 op/s 2023-05-08T05:15:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:15:37 smithi133 ceph-mon[125939]: pgmap v2981: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 73 KiB/s wr, 9 op/s 2023-05-08T05:15:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:15:37 smithi096 ceph-mon[124666]: pgmap v2981: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 73 KiB/s wr, 9 op/s 2023-05-08T05:15:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:15:39 smithi186 ceph-mon[126480]: pgmap v2982: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 73 KiB/s wr, 7 op/s 2023-05-08T05:15:39.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:15:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5477.683267 secs 2023-05-08T05:15:39.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:15:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5478.240458 secs 2023-05-08T05:15:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:15:39 smithi133 ceph-mon[125939]: pgmap v2982: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 73 KiB/s wr, 7 op/s 2023-05-08T05:15:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:15:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5477.683267 secs 2023-05-08T05:15:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:15:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5478.240458 secs 2023-05-08T05:15:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:15:39 smithi096 ceph-mon[124666]: pgmap v2982: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 73 KiB/s wr, 7 op/s 2023-05-08T05:15:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:15:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5477.683267 secs 2023-05-08T05:15:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:15:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5478.240458 secs 2023-05-08T05:15:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:15:41 smithi186 ceph-mon[126480]: pgmap v2983: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 131 KiB/s wr, 9 op/s 2023-05-08T05:15:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:15:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5479.520629 secs 2023-05-08T05:15:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:15:41 smithi133 ceph-mon[125939]: pgmap v2983: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 131 KiB/s wr, 9 op/s 2023-05-08T05:15:41.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:15:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5479.520629 secs 2023-05-08T05:15:41.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:15:41 smithi096 ceph-mon[124666]: pgmap v2983: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 131 KiB/s wr, 9 op/s 2023-05-08T05:15:41.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:15:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5479.520629 secs 2023-05-08T05:15:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:15:43 smithi186 ceph-mon[126480]: pgmap v2984: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 131 KiB/s wr, 6 op/s 2023-05-08T05:15:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:15:43 smithi133 ceph-mon[125939]: pgmap v2984: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 131 KiB/s wr, 6 op/s 2023-05-08T05:15:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:15:43 smithi096 ceph-mon[124666]: pgmap v2984: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 131 KiB/s wr, 6 op/s 2023-05-08T05:15:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:15:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5482.683403 secs 2023-05-08T05:15:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:15:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5483.240552 secs 2023-05-08T05:15:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:15:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5482.683403 secs 2023-05-08T05:15:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:15:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5483.240552 secs 2023-05-08T05:15:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:15:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5482.683403 secs 2023-05-08T05:15:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:15:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5483.240552 secs 2023-05-08T05:15:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:15:45 smithi186 ceph-mon[126480]: pgmap v2985: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 131 KiB/s wr, 6 op/s 2023-05-08T05:15:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:15:45 smithi133 ceph-mon[125939]: pgmap v2985: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 131 KiB/s wr, 6 op/s 2023-05-08T05:15:45.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:15:45 smithi096 ceph-mon[124666]: pgmap v2985: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 131 KiB/s wr, 6 op/s 2023-05-08T05:15:46.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:15:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5484.520764 secs 2023-05-08T05:15:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:15:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5484.520764 secs 2023-05-08T05:15:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:15:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5484.520764 secs 2023-05-08T05:15:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:15:47 smithi186 ceph-mon[126480]: pgmap v2986: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 163 KiB/s wr, 10 op/s 2023-05-08T05:15:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:15:47 smithi133 ceph-mon[125939]: pgmap v2986: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 163 KiB/s wr, 10 op/s 2023-05-08T05:15:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:15:47 smithi096 ceph-mon[124666]: pgmap v2986: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 163 KiB/s wr, 10 op/s 2023-05-08T05:15:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:15:49 smithi186 ceph-mon[126480]: pgmap v2987: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 90 KiB/s wr, 6 op/s 2023-05-08T05:15:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:15:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5487.683517 secs 2023-05-08T05:15:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:15:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5488.240651 secs 2023-05-08T05:15:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:15:49 smithi133 ceph-mon[125939]: pgmap v2987: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 90 KiB/s wr, 6 op/s 2023-05-08T05:15:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:15:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5487.683517 secs 2023-05-08T05:15:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:15:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5488.240651 secs 2023-05-08T05:15:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:15:49 smithi096 ceph-mon[124666]: pgmap v2987: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 90 KiB/s wr, 6 op/s 2023-05-08T05:15:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:15:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5487.683517 secs 2023-05-08T05:15:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:15:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5488.240651 secs 2023-05-08T05:15:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:15:51 smithi186 ceph-mon[126480]: pgmap v2988: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 90 KiB/s wr, 8 op/s 2023-05-08T05:15:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:15:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5489.520899 secs 2023-05-08T05:15:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:15:51 smithi133 ceph-mon[125939]: pgmap v2988: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 90 KiB/s wr, 8 op/s 2023-05-08T05:15:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:15:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5489.520899 secs 2023-05-08T05:15:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:15:51 smithi096 ceph-mon[124666]: pgmap v2988: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 90 KiB/s wr, 8 op/s 2023-05-08T05:15:51.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:15:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5489.520899 secs 2023-05-08T05:15:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:15:53 smithi186 ceph-mon[126480]: pgmap v2989: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 KiB/s wr, 5 op/s 2023-05-08T05:15:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:15:53 smithi133 ceph-mon[125939]: pgmap v2989: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 KiB/s wr, 5 op/s 2023-05-08T05:15:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:15:53 smithi096 ceph-mon[124666]: pgmap v2989: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 KiB/s wr, 5 op/s 2023-05-08T05:15:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:15:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5492.683586 secs 2023-05-08T05:15:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:15:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5493.240721 secs 2023-05-08T05:15:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:15:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5492.683586 secs 2023-05-08T05:15:54.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:15:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5493.240721 secs 2023-05-08T05:15:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:15:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5492.683586 secs 2023-05-08T05:15:54.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:15:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5493.240721 secs 2023-05-08T05:15:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:15:55 smithi186 ceph-mon[126480]: pgmap v2990: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 KiB/s wr, 5 op/s 2023-05-08T05:15:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:15:55 smithi133 ceph-mon[125939]: pgmap v2990: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 KiB/s wr, 5 op/s 2023-05-08T05:15:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:15:55 smithi096 ceph-mon[124666]: pgmap v2990: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 KiB/s wr, 5 op/s 2023-05-08T05:15:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:15:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5494.521012 secs 2023-05-08T05:15:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:15:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5494.521012 secs 2023-05-08T05:15:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:15:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5494.521012 secs 2023-05-08T05:15:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:15:57 smithi186 ceph-mon[126480]: pgmap v2991: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 8 op/s 2023-05-08T05:15:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:15:57 smithi133 ceph-mon[125939]: pgmap v2991: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 8 op/s 2023-05-08T05:15:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:15:57 smithi096 ceph-mon[124666]: pgmap v2991: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 8 op/s 2023-05-08T05:15:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:15:59 smithi186 ceph-mon[126480]: pgmap v2992: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T05:15:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:15:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5497.683697 secs 2023-05-08T05:15:59.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:15:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5498.240831 secs 2023-05-08T05:15:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:15:59 smithi133 ceph-mon[125939]: pgmap v2992: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T05:15:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:15:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5497.683697 secs 2023-05-08T05:15:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:15:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5498.240831 secs 2023-05-08T05:15:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:15:59 smithi096 ceph-mon[124666]: pgmap v2992: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T05:15:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:15:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5497.683697 secs 2023-05-08T05:15:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:15:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5498.240831 secs 2023-05-08T05:16:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:16:01 smithi186 ceph-mon[126480]: pgmap v2993: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T05:16:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:16:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5499.521095 secs 2023-05-08T05:16:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:16:01 smithi133 ceph-mon[125939]: pgmap v2993: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T05:16:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:16:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5499.521095 secs 2023-05-08T05:16:01.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:16:01 smithi096 ceph-mon[124666]: pgmap v2993: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T05:16:01.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:16:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5499.521095 secs 2023-05-08T05:16:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:16:03 smithi186 ceph-mon[126480]: pgmap v2994: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:16:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:16:03 smithi133 ceph-mon[125939]: pgmap v2994: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:16:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:16:03 smithi096 ceph-mon[124666]: pgmap v2994: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:16:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:16:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5502.683790 secs 2023-05-08T05:16:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:16:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5503.240950 secs 2023-05-08T05:16:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:16:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5502.683790 secs 2023-05-08T05:16:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:16:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5503.240950 secs 2023-05-08T05:16:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:16:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5502.683790 secs 2023-05-08T05:16:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:16:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5503.240950 secs 2023-05-08T05:16:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:16:05 smithi133 ceph-mon[125939]: pgmap v2995: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:16:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:16:05 smithi096 ceph-mon[124666]: pgmap v2995: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:16:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:16:05 smithi186 ceph-mon[126480]: pgmap v2995: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:16:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:16:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5504.521187 secs 2023-05-08T05:16:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:16:06 smithi133 ceph-mon[125939]: osdmap e266: 12 total, 12 up, 12 in 2023-05-08T05:16:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:16:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5504.521187 secs 2023-05-08T05:16:06.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:16:06 smithi096 ceph-mon[124666]: osdmap e266: 12 total, 12 up, 12 in 2023-05-08T05:16:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:16:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5504.521187 secs 2023-05-08T05:16:06.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:16:06 smithi186 ceph-mon[126480]: osdmap e266: 12 total, 12 up, 12 in 2023-05-08T05:16:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:16:07 smithi133 ceph-mon[125939]: pgmap v2997: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 121 KiB/s wr, 25 op/s 2023-05-08T05:16:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:16:07 smithi096 ceph-mon[124666]: pgmap v2997: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 121 KiB/s wr, 25 op/s 2023-05-08T05:16:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:16:07 smithi186 ceph-mon[126480]: pgmap v2997: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 121 KiB/s wr, 25 op/s 2023-05-08T05:16:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:16:09 smithi133 ceph-mon[125939]: pgmap v2998: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 121 KiB/s wr, 25 op/s 2023-05-08T05:16:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:16:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5507.683927 secs 2023-05-08T05:16:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:16:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5508.241074 secs 2023-05-08T05:16:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:16:09 smithi096 ceph-mon[124666]: pgmap v2998: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 121 KiB/s wr, 25 op/s 2023-05-08T05:16:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:16:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5507.683927 secs 2023-05-08T05:16:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:16:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5508.241074 secs 2023-05-08T05:16:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:16:09 smithi186 ceph-mon[126480]: pgmap v2998: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 121 KiB/s wr, 25 op/s 2023-05-08T05:16:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:16:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5507.683927 secs 2023-05-08T05:16:09.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:16:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5508.241074 secs 2023-05-08T05:16:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:16:11 smithi133 ceph-mon[125939]: pgmap v2999: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 121 KiB/s wr, 25 op/s 2023-05-08T05:16:11.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:16:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5509.521325 secs 2023-05-08T05:16:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:16:11 smithi096 ceph-mon[124666]: pgmap v2999: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 121 KiB/s wr, 25 op/s 2023-05-08T05:16:11.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:16:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5509.521325 secs 2023-05-08T05:16:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:16:11 smithi186 ceph-mon[126480]: pgmap v2999: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 121 KiB/s wr, 25 op/s 2023-05-08T05:16:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:16:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5509.521325 secs 2023-05-08T05:16:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:16:13 smithi133 ceph-mon[125939]: pgmap v3000: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 121 KiB/s wr, 25 op/s 2023-05-08T05:16:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:16:13 smithi096 ceph-mon[124666]: pgmap v3000: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 121 KiB/s wr, 25 op/s 2023-05-08T05:16:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:16:13 smithi186 ceph-mon[126480]: pgmap v3000: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 121 KiB/s wr, 25 op/s 2023-05-08T05:16:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:16:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5512.684060 secs 2023-05-08T05:16:14.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:16:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5513.241194 secs 2023-05-08T05:16:14.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:16:14 smithi133 ceph-mon[125939]: osdmap e267: 12 total, 12 up, 12 in 2023-05-08T05:16:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:16:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5512.684060 secs 2023-05-08T05:16:14.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:16:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5513.241194 secs 2023-05-08T05:16:14.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:16:14 smithi096 ceph-mon[124666]: osdmap e267: 12 total, 12 up, 12 in 2023-05-08T05:16:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:16:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5512.684060 secs 2023-05-08T05:16:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:16:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5513.241194 secs 2023-05-08T05:16:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:16:14 smithi186 ceph-mon[126480]: osdmap e267: 12 total, 12 up, 12 in 2023-05-08T05:16:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:16:15 smithi133 ceph-mon[125939]: pgmap v3001: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 121 KiB/s wr, 25 op/s 2023-05-08T05:16:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:16:15 smithi096 ceph-mon[124666]: pgmap v3001: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 121 KiB/s wr, 25 op/s 2023-05-08T05:16:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:16:15 smithi186 ceph-mon[126480]: pgmap v3001: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 121 KiB/s wr, 25 op/s 2023-05-08T05:16:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:16:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5514.521444 secs 2023-05-08T05:16:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:16:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5514.521444 secs 2023-05-08T05:16:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:16:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5514.521444 secs 2023-05-08T05:16:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:16:17 smithi133 ceph-mon[125939]: pgmap v3003: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T05:16:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:16:17 smithi096 ceph-mon[124666]: pgmap v3003: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T05:16:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:16:17 smithi186 ceph-mon[126480]: pgmap v3003: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T05:16:18.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:16:18 smithi133 ceph-mon[125939]: pgmap v3004: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T05:16:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:16:18 smithi096 ceph-mon[124666]: pgmap v3004: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T05:16:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:16:18 smithi186 ceph-mon[126480]: pgmap v3004: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T05:16:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:16:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5517.684189 secs 2023-05-08T05:16:19.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:16:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5518.241357 secs 2023-05-08T05:16:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:16:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5517.684189 secs 2023-05-08T05:16:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:16:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5518.241357 secs 2023-05-08T05:16:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:16:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5517.684189 secs 2023-05-08T05:16:19.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:16:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5518.241357 secs 2023-05-08T05:16:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:16:20 smithi133 ceph-mon[125939]: pgmap v3005: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T05:16:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:16:20 smithi096 ceph-mon[124666]: pgmap v3005: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T05:16:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:16:20 smithi186 ceph-mon[126480]: pgmap v3005: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T05:16:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:16:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5519.521541 secs 2023-05-08T05:16:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:16:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5519.521541 secs 2023-05-08T05:16:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:16:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5519.521541 secs 2023-05-08T05:16:22.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:16:22 smithi133 ceph-mon[125939]: pgmap v3006: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T05:16:22.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:16:22 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:16:22.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:16:22 smithi096 ceph-mon[124666]: pgmap v3006: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T05:16:22.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:16:22 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:16:22.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:16:22 smithi186 ceph-mon[126480]: pgmap v3006: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T05:16:22.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:16:22 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:16:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:16:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:16:23.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:16:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:16:23.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:16:23 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:16:23.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:16:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:16:23.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:16:23 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T05:16:23.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:16:23 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T05:16:23.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:16:23 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:16:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:16:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:16:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:16:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:16:23.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:16:23 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:16:23.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:16:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:16:23.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:16:23 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T05:16:23.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:16:23 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T05:16:23.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:16:23 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:16:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:16:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:16:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:16:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:16:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:16:23 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:16:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:16:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:16:23.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:16:23 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T05:16:23.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:16:23 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T05:16:23.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:16:23 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:16:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:16:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5522.684318 secs 2023-05-08T05:16:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:16:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5523.241462 secs 2023-05-08T05:16:24.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:16:24 smithi133 ceph-mon[125939]: pgmap v3007: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T05:16:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:16:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5522.684318 secs 2023-05-08T05:16:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:16:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5523.241462 secs 2023-05-08T05:16:24.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:16:24 smithi096 ceph-mon[124666]: pgmap v3007: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T05:16:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:16:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5522.684318 secs 2023-05-08T05:16:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:16:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5523.241462 secs 2023-05-08T05:16:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:16:24 smithi186 ceph-mon[126480]: pgmap v3007: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T05:16:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:16:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5524.521658 secs 2023-05-08T05:16:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:16:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5524.521658 secs 2023-05-08T05:16:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:16:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5524.521658 secs 2023-05-08T05:16:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:16:26 smithi186 ceph-mon[126480]: pgmap v3008: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 28 KiB/s wr, 8 op/s 2023-05-08T05:16:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:16:26 smithi133 ceph-mon[125939]: pgmap v3008: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 28 KiB/s wr, 8 op/s 2023-05-08T05:16:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:16:26 smithi096 ceph-mon[124666]: pgmap v3008: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 28 KiB/s wr, 8 op/s 2023-05-08T05:16:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:16:28 smithi096 ceph-mon[124666]: pgmap v3009: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:16:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:16:28 smithi186 ceph-mon[126480]: pgmap v3009: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:16:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:16:28 smithi133 ceph-mon[125939]: pgmap v3009: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:16:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:16:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5527.684427 secs 2023-05-08T05:16:30.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:16:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5528.241558 secs 2023-05-08T05:16:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:16:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5527.684427 secs 2023-05-08T05:16:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:16:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5528.241558 secs 2023-05-08T05:16:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:16:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5527.684427 secs 2023-05-08T05:16:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:16:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5528.241558 secs 2023-05-08T05:16:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:16:30 smithi133 ceph-mon[125939]: pgmap v3010: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T05:16:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:16:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5529.521811 secs 2023-05-08T05:16:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:16:30 smithi096 ceph-mon[124666]: pgmap v3010: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T05:16:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:16:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5529.521811 secs 2023-05-08T05:16:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:16:30 smithi186 ceph-mon[126480]: pgmap v3010: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T05:16:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:16:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5529.521811 secs 2023-05-08T05:16:33.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:16:32 smithi133 ceph-mon[125939]: pgmap v3011: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:16:33.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:16:32 smithi096 ceph-mon[124666]: pgmap v3011: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:16:33.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:16:32 smithi186 ceph-mon[126480]: pgmap v3011: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:16:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:16:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5532.684499 secs 2023-05-08T05:16:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:16:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5532.684499 secs 2023-05-08T05:16:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:16:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5532.684499 secs 2023-05-08T05:16:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:16:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5533.241640 secs 2023-05-08T05:16:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:16:34 smithi133 ceph-mon[125939]: pgmap v3012: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:16:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:16:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5533.241640 secs 2023-05-08T05:16:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:16:34 smithi096 ceph-mon[124666]: pgmap v3012: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:16:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:16:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5533.241640 secs 2023-05-08T05:16:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:16:34 smithi186 ceph-mon[126480]: pgmap v3012: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:16:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:16:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5534.521946 secs 2023-05-08T05:16:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:16:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5534.521946 secs 2023-05-08T05:16:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:16:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5534.521946 secs 2023-05-08T05:16:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:16:36 smithi133 ceph-mon[125939]: pgmap v3013: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 148 KiB/s wr, 8 op/s 2023-05-08T05:16:37.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:16:36 smithi096 ceph-mon[124666]: pgmap v3013: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 148 KiB/s wr, 8 op/s 2023-05-08T05:16:37.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:16:36 smithi186 ceph-mon[126480]: pgmap v3013: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 148 KiB/s wr, 8 op/s 2023-05-08T05:16:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:16:38 smithi133 ceph-mon[125939]: pgmap v3014: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 148 KiB/s wr, 6 op/s 2023-05-08T05:16:39.295 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:16:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5537.684611 secs 2023-05-08T05:16:39.296 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:16:38 smithi096 ceph-mon[124666]: pgmap v3014: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 148 KiB/s wr, 6 op/s 2023-05-08T05:16:39.296 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:16:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5537.684611 secs 2023-05-08T05:16:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:16:38 smithi186 ceph-mon[126480]: pgmap v3014: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 148 KiB/s wr, 6 op/s 2023-05-08T05:16:39.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:16:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5537.684611 secs 2023-05-08T05:16:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:16:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5538.241765 secs 2023-05-08T05:16:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:16:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5538.241765 secs 2023-05-08T05:16:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:16:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5538.241765 secs 2023-05-08T05:16:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:16:40 smithi096 ceph-mon[124666]: pgmap v3015: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 149 KiB/s wr, 9 op/s 2023-05-08T05:16:41.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:16:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5539.522079 secs 2023-05-08T05:16:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:16:40 smithi186 ceph-mon[126480]: pgmap v3015: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 149 KiB/s wr, 9 op/s 2023-05-08T05:16:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:16:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5539.522079 secs 2023-05-08T05:16:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:16:40 smithi133 ceph-mon[125939]: pgmap v3015: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 149 KiB/s wr, 9 op/s 2023-05-08T05:16:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:16:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5539.522079 secs 2023-05-08T05:16:43.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:16:42 smithi096 ceph-mon[124666]: pgmap v3016: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 177 KiB/s wr, 8 op/s 2023-05-08T05:16:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:16:42 smithi186 ceph-mon[126480]: pgmap v3016: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 177 KiB/s wr, 8 op/s 2023-05-08T05:16:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:16:42 smithi133 ceph-mon[125939]: pgmap v3016: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 177 KiB/s wr, 8 op/s 2023-05-08T05:16:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:16:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5542.684727 secs 2023-05-08T05:16:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:16:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5542.684727 secs 2023-05-08T05:16:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:16:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5542.684727 secs 2023-05-08T05:16:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:16:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5543.241888 secs 2023-05-08T05:16:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:16:45 smithi186 ceph-mon[126480]: pgmap v3017: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 177 KiB/s wr, 8 op/s 2023-05-08T05:16:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:16:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5543.241888 secs 2023-05-08T05:16:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:16:45 smithi133 ceph-mon[125939]: pgmap v3017: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 177 KiB/s wr, 8 op/s 2023-05-08T05:16:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:16:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5543.241888 secs 2023-05-08T05:16:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:16:45 smithi096 ceph-mon[124666]: pgmap v3017: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 177 KiB/s wr, 8 op/s 2023-05-08T05:16:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:16:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5544.522216 secs 2023-05-08T05:16:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:16:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5544.522216 secs 2023-05-08T05:16:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:16:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5544.522216 secs 2023-05-08T05:16:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:16:47 smithi186 ceph-mon[126480]: pgmap v3018: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 178 KiB/s wr, 11 op/s 2023-05-08T05:16:47.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:16:47 smithi133 ceph-mon[125939]: pgmap v3018: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 178 KiB/s wr, 11 op/s 2023-05-08T05:16:47.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:16:47 smithi096 ceph-mon[124666]: pgmap v3018: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 178 KiB/s wr, 11 op/s 2023-05-08T05:16:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:16:49 smithi186 ceph-mon[126480]: pgmap v3019: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 7 op/s 2023-05-08T05:16:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:16:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5547.684851 secs 2023-05-08T05:16:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:16:49 smithi133 ceph-mon[125939]: pgmap v3019: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 7 op/s 2023-05-08T05:16:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:16:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5547.684851 secs 2023-05-08T05:16:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:16:49 smithi096 ceph-mon[124666]: pgmap v3019: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 7 op/s 2023-05-08T05:16:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:16:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5547.684851 secs 2023-05-08T05:16:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:16:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5548.242022 secs 2023-05-08T05:16:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:16:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5548.242022 secs 2023-05-08T05:16:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:16:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5548.242022 secs 2023-05-08T05:16:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:16:51 smithi186 ceph-mon[126480]: pgmap v3020: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 10 op/s 2023-05-08T05:16:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:16:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5549.522353 secs 2023-05-08T05:16:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:16:51 smithi133 ceph-mon[125939]: pgmap v3020: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 10 op/s 2023-05-08T05:16:51.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:16:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5549.522353 secs 2023-05-08T05:16:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:16:51 smithi096 ceph-mon[124666]: pgmap v3020: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 10 op/s 2023-05-08T05:16:51.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:16:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5549.522353 secs 2023-05-08T05:16:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:16:53 smithi186 ceph-mon[126480]: pgmap v3021: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 7 op/s 2023-05-08T05:16:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:16:53 smithi133 ceph-mon[125939]: pgmap v3021: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 7 op/s 2023-05-08T05:16:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:16:53 smithi096 ceph-mon[124666]: pgmap v3021: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 7 op/s 2023-05-08T05:16:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:16:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5552.684923 secs 2023-05-08T05:16:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:16:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5552.684923 secs 2023-05-08T05:16:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:16:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5552.684923 secs 2023-05-08T05:16:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:16:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5553.242138 secs 2023-05-08T05:16:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:16:55 smithi186 ceph-mon[126480]: pgmap v3022: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 6 op/s 2023-05-08T05:16:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:16:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5553.242138 secs 2023-05-08T05:16:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:16:55 smithi133 ceph-mon[125939]: pgmap v3022: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 6 op/s 2023-05-08T05:16:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:16:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5553.242138 secs 2023-05-08T05:16:55.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:16:55 smithi096 ceph-mon[124666]: pgmap v3022: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 6 op/s 2023-05-08T05:16:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:16:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5554.522490 secs 2023-05-08T05:16:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:16:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5554.522490 secs 2023-05-08T05:16:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:16:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5554.522490 secs 2023-05-08T05:16:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:16:57 smithi186 ceph-mon[126480]: pgmap v3023: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 341 B/s wr, 9 op/s 2023-05-08T05:16:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:16:57 smithi133 ceph-mon[125939]: pgmap v3023: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 341 B/s wr, 9 op/s 2023-05-08T05:16:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:16:57 smithi096 ceph-mon[124666]: pgmap v3023: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 341 B/s wr, 9 op/s 2023-05-08T05:16:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:16:59 smithi186 ceph-mon[126480]: pgmap v3024: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:16:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:16:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5557.685058 secs 2023-05-08T05:16:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:16:59 smithi133 ceph-mon[125939]: pgmap v3024: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:16:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:16:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5557.685058 secs 2023-05-08T05:16:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:16:59 smithi096 ceph-mon[124666]: pgmap v3024: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:16:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:16:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5557.685058 secs 2023-05-08T05:17:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5558.242270 secs 2023-05-08T05:17:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5558.242270 secs 2023-05-08T05:17:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5558.242270 secs 2023-05-08T05:17:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:01 smithi186 ceph-mon[126480]: pgmap v3025: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T05:17:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5559.522615 secs 2023-05-08T05:17:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:01 smithi133 ceph-mon[125939]: pgmap v3025: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T05:17:01.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5559.522615 secs 2023-05-08T05:17:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:01 smithi096 ceph-mon[124666]: pgmap v3025: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T05:17:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5559.522615 secs 2023-05-08T05:17:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:03 smithi186 ceph-mon[126480]: pgmap v3026: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2023-05-08T05:17:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:03 smithi133 ceph-mon[125939]: pgmap v3026: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2023-05-08T05:17:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:03 smithi096 ceph-mon[124666]: pgmap v3026: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2023-05-08T05:17:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5562.685191 secs 2023-05-08T05:17:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5562.685191 secs 2023-05-08T05:17:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5562.685191 secs 2023-05-08T05:17:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5563.242377 secs 2023-05-08T05:17:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:05 smithi186 ceph-mon[126480]: pgmap v3027: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:17:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5563.242377 secs 2023-05-08T05:17:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:05 smithi133 ceph-mon[125939]: pgmap v3027: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:17:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5563.242377 secs 2023-05-08T05:17:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:05 smithi096 ceph-mon[124666]: pgmap v3027: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:17:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5564.522729 secs 2023-05-08T05:17:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:06 smithi186 ceph-mon[126480]: osdmap e268: 12 total, 12 up, 12 in 2023-05-08T05:17:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5564.522729 secs 2023-05-08T05:17:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:06 smithi133 ceph-mon[125939]: osdmap e268: 12 total, 12 up, 12 in 2023-05-08T05:17:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5564.522729 secs 2023-05-08T05:17:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:06 smithi096 ceph-mon[124666]: osdmap e268: 12 total, 12 up, 12 in 2023-05-08T05:17:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:07 smithi186 ceph-mon[126480]: pgmap v3029: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 121 KiB/s wr, 25 op/s 2023-05-08T05:17:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:07 smithi133 ceph-mon[125939]: pgmap v3029: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 121 KiB/s wr, 25 op/s 2023-05-08T05:17:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:07 smithi096 ceph-mon[124666]: pgmap v3029: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 121 KiB/s wr, 25 op/s 2023-05-08T05:17:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:09 smithi186 ceph-mon[126480]: pgmap v3030: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 121 KiB/s wr, 25 op/s 2023-05-08T05:17:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5567.685330 secs 2023-05-08T05:17:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:09 smithi133 ceph-mon[125939]: pgmap v3030: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 121 KiB/s wr, 25 op/s 2023-05-08T05:17:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5567.685330 secs 2023-05-08T05:17:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:09 smithi096 ceph-mon[124666]: pgmap v3030: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 121 KiB/s wr, 25 op/s 2023-05-08T05:17:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5567.685330 secs 2023-05-08T05:17:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5568.242492 secs 2023-05-08T05:17:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5568.242492 secs 2023-05-08T05:17:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5568.242492 secs 2023-05-08T05:17:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:11 smithi186 ceph-mon[126480]: pgmap v3031: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 121 KiB/s wr, 25 op/s 2023-05-08T05:17:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5569.522868 secs 2023-05-08T05:17:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:11 smithi133 ceph-mon[125939]: pgmap v3031: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 121 KiB/s wr, 25 op/s 2023-05-08T05:17:11.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5569.522868 secs 2023-05-08T05:17:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:11 smithi096 ceph-mon[124666]: pgmap v3031: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 121 KiB/s wr, 25 op/s 2023-05-08T05:17:11.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5569.522868 secs 2023-05-08T05:17:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:13 smithi186 ceph-mon[126480]: pgmap v3032: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 155 KiB/s wr, 26 op/s 2023-05-08T05:17:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:13 smithi133 ceph-mon[125939]: pgmap v3032: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 155 KiB/s wr, 26 op/s 2023-05-08T05:17:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:13 smithi096 ceph-mon[124666]: pgmap v3032: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 155 KiB/s wr, 26 op/s 2023-05-08T05:17:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5572.685422 secs 2023-05-08T05:17:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:14 smithi186 ceph-mon[126480]: osdmap e269: 12 total, 12 up, 12 in 2023-05-08T05:17:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5572.685422 secs 2023-05-08T05:17:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:14 smithi133 ceph-mon[125939]: osdmap e269: 12 total, 12 up, 12 in 2023-05-08T05:17:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5572.685422 secs 2023-05-08T05:17:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:14 smithi096 ceph-mon[124666]: osdmap e269: 12 total, 12 up, 12 in 2023-05-08T05:17:15.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5573.242583 secs 2023-05-08T05:17:15.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:15 smithi186 ceph-mon[126480]: pgmap v3033: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 155 KiB/s wr, 26 op/s 2023-05-08T05:17:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5573.242583 secs 2023-05-08T05:17:15.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:15 smithi133 ceph-mon[125939]: pgmap v3033: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 155 KiB/s wr, 26 op/s 2023-05-08T05:17:15.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5573.242583 secs 2023-05-08T05:17:15.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:15 smithi096 ceph-mon[124666]: pgmap v3033: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 155 KiB/s wr, 26 op/s 2023-05-08T05:17:16.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5574.522990 secs 2023-05-08T05:17:16.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5574.522990 secs 2023-05-08T05:17:16.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5574.522990 secs 2023-05-08T05:17:17.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:17 smithi186 ceph-mon[126480]: pgmap v3035: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 34 KiB/s wr, 7 op/s 2023-05-08T05:17:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:17 smithi133 ceph-mon[125939]: pgmap v3035: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 34 KiB/s wr, 7 op/s 2023-05-08T05:17:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:17 smithi096 ceph-mon[124666]: pgmap v3035: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 34 KiB/s wr, 7 op/s 2023-05-08T05:17:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:19 smithi186 ceph-mon[126480]: pgmap v3036: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 34 KiB/s wr, 7 op/s 2023-05-08T05:17:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5577.685532 secs 2023-05-08T05:17:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:19 smithi133 ceph-mon[125939]: pgmap v3036: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 34 KiB/s wr, 7 op/s 2023-05-08T05:17:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5577.685532 secs 2023-05-08T05:17:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:19 smithi096 ceph-mon[124666]: pgmap v3036: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 34 KiB/s wr, 7 op/s 2023-05-08T05:17:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5577.685532 secs 2023-05-08T05:17:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5578.242706 secs 2023-05-08T05:17:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5578.242706 secs 2023-05-08T05:17:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5578.242706 secs 2023-05-08T05:17:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:21 smithi133 ceph-mon[125939]: pgmap v3037: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T05:17:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5579.523122 secs 2023-05-08T05:17:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:21 smithi096 ceph-mon[124666]: pgmap v3037: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T05:17:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5579.523122 secs 2023-05-08T05:17:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:21 smithi186 ceph-mon[126480]: pgmap v3037: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T05:17:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5579.523122 secs 2023-05-08T05:17:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:23 smithi133 ceph-mon[125939]: pgmap v3038: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T05:17:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:17:23.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:23 smithi096 ceph-mon[124666]: pgmap v3038: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T05:17:23.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:17:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:23 smithi186 ceph-mon[126480]: pgmap v3038: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T05:17:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:17:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5582.685643 secs 2023-05-08T05:17:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:17:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:17:24.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:17:24.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:17:24.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:17:24.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:17:24.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:17:24.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:17:24.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:17:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5582.685643 secs 2023-05-08T05:17:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:17:24.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:17:24.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:17:24.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:17:24.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:17:24.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:17:24.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:17:24.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:17:24.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:17:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5582.685643 secs 2023-05-08T05:17:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:17:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:17:24.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:17:24.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:17:24.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:17:24.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:17:24.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:17:24.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:17:24.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:17:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5583.242785 secs 2023-05-08T05:17:25.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:25 smithi096 ceph-mon[124666]: pgmap v3039: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T05:17:25.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:25 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:17:25.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:25 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T05:17:25.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:25 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T05:17:25.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:25 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:17:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5583.242785 secs 2023-05-08T05:17:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:25 smithi186 ceph-mon[126480]: pgmap v3039: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T05:17:25.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:25 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:17:25.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:25 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T05:17:25.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:25 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T05:17:25.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:25 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:17:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5583.242785 secs 2023-05-08T05:17:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:25 smithi133 ceph-mon[125939]: pgmap v3039: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T05:17:25.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:25 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:17:25.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:25 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T05:17:25.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:25 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T05:17:25.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:25 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:17:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5584.523236 secs 2023-05-08T05:17:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5584.523236 secs 2023-05-08T05:17:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5584.523236 secs 2023-05-08T05:17:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:27 smithi096 ceph-mon[124666]: pgmap v3040: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2023-05-08T05:17:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:27 smithi186 ceph-mon[126480]: pgmap v3040: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2023-05-08T05:17:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:27 smithi133 ceph-mon[125939]: pgmap v3040: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2023-05-08T05:17:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:29 smithi096 ceph-mon[124666]: pgmap v3041: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:17:29.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5587.685768 secs 2023-05-08T05:17:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:29 smithi186 ceph-mon[126480]: pgmap v3041: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:17:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5587.685768 secs 2023-05-08T05:17:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:29 smithi133 ceph-mon[125939]: pgmap v3041: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:17:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5587.685768 secs 2023-05-08T05:17:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5588.242860 secs 2023-05-08T05:17:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5588.242860 secs 2023-05-08T05:17:30.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5588.242860 secs 2023-05-08T05:17:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:31 smithi186 ceph-mon[126480]: pgmap v3042: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T05:17:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5589.523355 secs 2023-05-08T05:17:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:31 smithi133 ceph-mon[125939]: pgmap v3042: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T05:17:31.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5589.523355 secs 2023-05-08T05:17:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:31 smithi096 ceph-mon[124666]: pgmap v3042: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T05:17:31.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5589.523355 secs 2023-05-08T05:17:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:33 smithi186 ceph-mon[126480]: pgmap v3043: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:17:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:33 smithi133 ceph-mon[125939]: pgmap v3043: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:17:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:33 smithi096 ceph-mon[124666]: pgmap v3043: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:17:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5592.685875 secs 2023-05-08T05:17:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5592.685875 secs 2023-05-08T05:17:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5592.685875 secs 2023-05-08T05:17:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5593.242976 secs 2023-05-08T05:17:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:35 smithi186 ceph-mon[126480]: pgmap v3044: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:17:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5593.242976 secs 2023-05-08T05:17:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:35 smithi133 ceph-mon[125939]: pgmap v3044: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:17:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5593.242976 secs 2023-05-08T05:17:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:35 smithi096 ceph-mon[124666]: pgmap v3044: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:17:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:37 smithi186 ceph-mon[126480]: pgmap v3045: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 118 KiB/s wr, 8 op/s 2023-05-08T05:17:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:37 smithi133 ceph-mon[125939]: pgmap v3045: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 118 KiB/s wr, 8 op/s 2023-05-08T05:17:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:37 smithi096 ceph-mon[124666]: pgmap v3045: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 118 KiB/s wr, 8 op/s 2023-05-08T05:17:38.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:38 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:17:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:38 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:17:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:38 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:17:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:39 smithi186 ceph-mon[126480]: pgmap v3046: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 118 KiB/s wr, 5 op/s 2023-05-08T05:17:39.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5597.685974 secs 2023-05-08T05:17:39.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:39 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:17:39.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:39 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:17:39.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:39 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:17:39.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5598.243097 secs 2023-05-08T05:17:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:39 smithi133 ceph-mon[125939]: pgmap v3046: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 118 KiB/s wr, 5 op/s 2023-05-08T05:17:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5597.685974 secs 2023-05-08T05:17:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:39 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:17:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:39 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:17:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:39 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:17:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5598.243097 secs 2023-05-08T05:17:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:39 smithi096 ceph-mon[124666]: pgmap v3046: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 118 KiB/s wr, 5 op/s 2023-05-08T05:17:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5597.685974 secs 2023-05-08T05:17:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:39 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:17:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:39 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:17:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:39 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:17:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5598.243097 secs 2023-05-08T05:17:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:41 smithi186 ceph-mon[126480]: pgmap v3047: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 118 KiB/s wr, 8 op/s 2023-05-08T05:17:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5599.523608 secs 2023-05-08T05:17:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:41 smithi133 ceph-mon[125939]: pgmap v3047: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 118 KiB/s wr, 8 op/s 2023-05-08T05:17:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5599.523608 secs 2023-05-08T05:17:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:41 smithi096 ceph-mon[124666]: pgmap v3047: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 118 KiB/s wr, 8 op/s 2023-05-08T05:17:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5599.523608 secs 2023-05-08T05:17:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:43 smithi186 ceph-mon[126480]: pgmap v3048: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 138 KiB/s wr, 7 op/s 2023-05-08T05:17:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:17:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:17:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:43 smithi133 ceph-mon[125939]: pgmap v3048: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 138 KiB/s wr, 7 op/s 2023-05-08T05:17:43.779 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:17:43.779 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:17:43.780 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:43 smithi096 ceph-mon[124666]: pgmap v3048: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 138 KiB/s wr, 7 op/s 2023-05-08T05:17:43.780 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:17:43.780 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:17:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5602.686126 secs 2023-05-08T05:17:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5603.243215 secs 2023-05-08T05:17:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:44 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:17:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5602.686126 secs 2023-05-08T05:17:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5603.243215 secs 2023-05-08T05:17:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:44 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:17:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5602.686126 secs 2023-05-08T05:17:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5603.243215 secs 2023-05-08T05:17:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:44 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:17:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:45 smithi186 ceph-mon[126480]: pgmap v3049: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 138 KiB/s wr, 7 op/s 2023-05-08T05:17:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:45 smithi133 ceph-mon[125939]: pgmap v3049: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 138 KiB/s wr, 7 op/s 2023-05-08T05:17:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:45 smithi096 ceph-mon[124666]: pgmap v3049: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 138 KiB/s wr, 7 op/s 2023-05-08T05:17:46.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5604.523754 secs 2023-05-08T05:17:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5604.523754 secs 2023-05-08T05:17:46.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5604.523754 secs 2023-05-08T05:17:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:47 smithi186 ceph-mon[126480]: pgmap v3050: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 178 KiB/s wr, 10 op/s 2023-05-08T05:17:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:47 smithi133 ceph-mon[125939]: pgmap v3050: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 178 KiB/s wr, 10 op/s 2023-05-08T05:17:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:47 smithi096 ceph-mon[124666]: pgmap v3050: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 178 KiB/s wr, 10 op/s 2023-05-08T05:17:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:49 smithi186 ceph-mon[126480]: pgmap v3051: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 60 KiB/s wr, 6 op/s 2023-05-08T05:17:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5607.686208 secs 2023-05-08T05:17:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5608.243337 secs 2023-05-08T05:17:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:49 smithi133 ceph-mon[125939]: pgmap v3051: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 60 KiB/s wr, 6 op/s 2023-05-08T05:17:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5607.686208 secs 2023-05-08T05:17:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5608.243337 secs 2023-05-08T05:17:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:49 smithi096 ceph-mon[124666]: pgmap v3051: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 60 KiB/s wr, 6 op/s 2023-05-08T05:17:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5607.686208 secs 2023-05-08T05:17:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5608.243337 secs 2023-05-08T05:17:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:51 smithi186 ceph-mon[126480]: pgmap v3052: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 60 KiB/s wr, 9 op/s 2023-05-08T05:17:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5609.523894 secs 2023-05-08T05:17:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:51 smithi133 ceph-mon[125939]: pgmap v3052: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 60 KiB/s wr, 9 op/s 2023-05-08T05:17:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5609.523894 secs 2023-05-08T05:17:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:51 smithi096 ceph-mon[124666]: pgmap v3052: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 60 KiB/s wr, 9 op/s 2023-05-08T05:17:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5609.523894 secs 2023-05-08T05:17:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:53 smithi186 ceph-mon[126480]: pgmap v3053: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 60 KiB/s wr, 6 op/s 2023-05-08T05:17:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:53 smithi133 ceph-mon[125939]: pgmap v3053: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 60 KiB/s wr, 6 op/s 2023-05-08T05:17:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:53 smithi096 ceph-mon[124666]: pgmap v3053: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 60 KiB/s wr, 6 op/s 2023-05-08T05:17:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5612.686323 secs 2023-05-08T05:17:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5613.243490 secs 2023-05-08T05:17:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5612.686323 secs 2023-05-08T05:17:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5613.243490 secs 2023-05-08T05:17:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5612.686323 secs 2023-05-08T05:17:54.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5613.243490 secs 2023-05-08T05:17:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:55 smithi186 ceph-mon[126480]: pgmap v3054: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 40 KiB/s wr, 6 op/s 2023-05-08T05:17:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:55 smithi133 ceph-mon[125939]: pgmap v3054: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 40 KiB/s wr, 6 op/s 2023-05-08T05:17:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:55 smithi096 ceph-mon[124666]: pgmap v3054: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 40 KiB/s wr, 6 op/s 2023-05-08T05:17:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5614.524033 secs 2023-05-08T05:17:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5614.524033 secs 2023-05-08T05:17:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5614.524033 secs 2023-05-08T05:17:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:57 smithi186 ceph-mon[126480]: pgmap v3055: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 40 KiB/s wr, 9 op/s 2023-05-08T05:17:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:57 smithi133 ceph-mon[125939]: pgmap v3055: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 40 KiB/s wr, 9 op/s 2023-05-08T05:17:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:57 smithi096 ceph-mon[124666]: pgmap v3055: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 40 KiB/s wr, 9 op/s 2023-05-08T05:17:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:59 smithi186 ceph-mon[126480]: pgmap v3056: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2023-05-08T05:17:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5617.686441 secs 2023-05-08T05:17:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:17:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5618.243611 secs 2023-05-08T05:17:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:59 smithi133 ceph-mon[125939]: pgmap v3056: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2023-05-08T05:17:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5617.686441 secs 2023-05-08T05:17:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:17:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5618.243611 secs 2023-05-08T05:17:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:59 smithi096 ceph-mon[124666]: pgmap v3056: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2023-05-08T05:17:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5617.686441 secs 2023-05-08T05:17:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:17:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5618.243611 secs 2023-05-08T05:18:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:01 smithi186 ceph-mon[126480]: pgmap v3057: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 8 op/s 2023-05-08T05:18:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5619.524150 secs 2023-05-08T05:18:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:01 smithi133 ceph-mon[125939]: pgmap v3057: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 8 op/s 2023-05-08T05:18:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5619.524150 secs 2023-05-08T05:18:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:01 smithi096 ceph-mon[124666]: pgmap v3057: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 8 op/s 2023-05-08T05:18:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5619.524150 secs 2023-05-08T05:18:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:03 smithi186 ceph-mon[126480]: pgmap v3058: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2023-05-08T05:18:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:03 smithi133 ceph-mon[125939]: pgmap v3058: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2023-05-08T05:18:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:03 smithi096 ceph-mon[124666]: pgmap v3058: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2023-05-08T05:18:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5622.686553 secs 2023-05-08T05:18:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5623.243732 secs 2023-05-08T05:18:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5622.686553 secs 2023-05-08T05:18:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5623.243732 secs 2023-05-08T05:18:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5622.686553 secs 2023-05-08T05:18:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5623.243732 secs 2023-05-08T05:18:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:05 smithi186 ceph-mon[126480]: pgmap v3059: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:18:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:05 smithi133 ceph-mon[125939]: pgmap v3059: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:18:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:05 smithi096 ceph-mon[124666]: pgmap v3059: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:18:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5624.524267 secs 2023-05-08T05:18:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:06 smithi186 ceph-mon[126480]: osdmap e270: 12 total, 12 up, 12 in 2023-05-08T05:18:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5624.524267 secs 2023-05-08T05:18:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:06 smithi133 ceph-mon[125939]: osdmap e270: 12 total, 12 up, 12 in 2023-05-08T05:18:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5624.524267 secs 2023-05-08T05:18:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:06 smithi096 ceph-mon[124666]: osdmap e270: 12 total, 12 up, 12 in 2023-05-08T05:18:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:07 smithi186 ceph-mon[126480]: pgmap v3061: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 121 KiB/s wr, 25 op/s 2023-05-08T05:18:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:07 smithi133 ceph-mon[125939]: pgmap v3061: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 121 KiB/s wr, 25 op/s 2023-05-08T05:18:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:07 smithi096 ceph-mon[124666]: pgmap v3061: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 121 KiB/s wr, 25 op/s 2023-05-08T05:18:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:09 smithi133 ceph-mon[125939]: pgmap v3062: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 121 KiB/s wr, 25 op/s 2023-05-08T05:18:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5627.686691 secs 2023-05-08T05:18:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5628.243817 secs 2023-05-08T05:18:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:09 smithi096 ceph-mon[124666]: pgmap v3062: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 121 KiB/s wr, 25 op/s 2023-05-08T05:18:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5627.686691 secs 2023-05-08T05:18:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5628.243817 secs 2023-05-08T05:18:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:09 smithi186 ceph-mon[126480]: pgmap v3062: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 121 KiB/s wr, 25 op/s 2023-05-08T05:18:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5627.686691 secs 2023-05-08T05:18:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5628.243817 secs 2023-05-08T05:18:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:11 smithi133 ceph-mon[125939]: pgmap v3063: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 122 KiB/s wr, 26 op/s 2023-05-08T05:18:11.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5629.524377 secs 2023-05-08T05:18:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:11 smithi096 ceph-mon[124666]: pgmap v3063: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 122 KiB/s wr, 26 op/s 2023-05-08T05:18:11.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5629.524377 secs 2023-05-08T05:18:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:11 smithi186 ceph-mon[126480]: pgmap v3063: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 122 KiB/s wr, 26 op/s 2023-05-08T05:18:11.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5629.524377 secs 2023-05-08T05:18:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:13 smithi133 ceph-mon[125939]: pgmap v3064: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 122 KiB/s wr, 25 op/s 2023-05-08T05:18:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:13 smithi096 ceph-mon[124666]: pgmap v3064: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 122 KiB/s wr, 25 op/s 2023-05-08T05:18:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:13 smithi186 ceph-mon[126480]: pgmap v3064: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 122 KiB/s wr, 25 op/s 2023-05-08T05:18:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5632.686824 secs 2023-05-08T05:18:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5633.243942 secs 2023-05-08T05:18:14.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:14 smithi133 ceph-mon[125939]: osdmap e271: 12 total, 12 up, 12 in 2023-05-08T05:18:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5632.686824 secs 2023-05-08T05:18:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5633.243942 secs 2023-05-08T05:18:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:14 smithi096 ceph-mon[124666]: osdmap e271: 12 total, 12 up, 12 in 2023-05-08T05:18:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5632.686824 secs 2023-05-08T05:18:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5633.243942 secs 2023-05-08T05:18:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:14 smithi186 ceph-mon[126480]: osdmap e271: 12 total, 12 up, 12 in 2023-05-08T05:18:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:15 smithi133 ceph-mon[125939]: pgmap v3065: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 122 KiB/s wr, 25 op/s 2023-05-08T05:18:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:15 smithi096 ceph-mon[124666]: pgmap v3065: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 122 KiB/s wr, 25 op/s 2023-05-08T05:18:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:15 smithi186 ceph-mon[126480]: pgmap v3065: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 122 KiB/s wr, 25 op/s 2023-05-08T05:18:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5634.524497 secs 2023-05-08T05:18:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5634.524497 secs 2023-05-08T05:18:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5634.524497 secs 2023-05-08T05:18:17.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:17 smithi133 ceph-mon[125939]: pgmap v3067: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 KiB/s wr, 7 op/s 2023-05-08T05:18:17.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:17 smithi096 ceph-mon[124666]: pgmap v3067: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 KiB/s wr, 7 op/s 2023-05-08T05:18:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:17 smithi186 ceph-mon[126480]: pgmap v3067: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 KiB/s wr, 7 op/s 2023-05-08T05:18:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:19 smithi133 ceph-mon[125939]: pgmap v3068: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 KiB/s wr, 7 op/s 2023-05-08T05:18:19.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5637.686978 secs 2023-05-08T05:18:19.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5638.244064 secs 2023-05-08T05:18:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:19 smithi096 ceph-mon[124666]: pgmap v3068: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 KiB/s wr, 7 op/s 2023-05-08T05:18:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5637.686978 secs 2023-05-08T05:18:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5638.244064 secs 2023-05-08T05:18:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:19 smithi186 ceph-mon[126480]: pgmap v3068: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 KiB/s wr, 7 op/s 2023-05-08T05:18:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5637.686978 secs 2023-05-08T05:18:19.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5638.244064 secs 2023-05-08T05:18:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:21 smithi133 ceph-mon[125939]: pgmap v3069: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T05:18:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5639.524625 secs 2023-05-08T05:18:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:21 smithi096 ceph-mon[124666]: pgmap v3069: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T05:18:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5639.524625 secs 2023-05-08T05:18:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:21 smithi186 ceph-mon[126480]: pgmap v3069: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T05:18:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5639.524625 secs 2023-05-08T05:18:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:23 smithi133 ceph-mon[125939]: pgmap v3070: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T05:18:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:23 smithi096 ceph-mon[124666]: pgmap v3070: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T05:18:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:23 smithi186 ceph-mon[126480]: pgmap v3070: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T05:18:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5642.687102 secs 2023-05-08T05:18:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5643.244187 secs 2023-05-08T05:18:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:18:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5642.687102 secs 2023-05-08T05:18:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5643.244187 secs 2023-05-08T05:18:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:18:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5642.687102 secs 2023-05-08T05:18:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5643.244187 secs 2023-05-08T05:18:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:18:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:25 smithi133 ceph-mon[125939]: pgmap v3071: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T05:18:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:25 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:18:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:25 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:18:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:25 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:18:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:25 smithi096 ceph-mon[124666]: pgmap v3071: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T05:18:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:25 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:18:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:25 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:18:25.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:25 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:18:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:25 smithi186 ceph-mon[126480]: pgmap v3071: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T05:18:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:25 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:18:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:25 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:18:25.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:25 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:18:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:26 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:18:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:26 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T05:18:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:26 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T05:18:26.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:26 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:18:26.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5644.524708 secs 2023-05-08T05:18:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:26 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:18:26.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:26 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T05:18:26.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:26 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T05:18:26.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:26 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:18:26.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5644.524708 secs 2023-05-08T05:18:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:26 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:18:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:26 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T05:18:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:26 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T05:18:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:26 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:18:26.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5644.524708 secs 2023-05-08T05:18:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:27 smithi133 ceph-mon[125939]: pgmap v3072: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 29 KiB/s wr, 7 op/s 2023-05-08T05:18:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:27 smithi096 ceph-mon[124666]: pgmap v3072: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 29 KiB/s wr, 7 op/s 2023-05-08T05:18:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:27 smithi186 ceph-mon[126480]: pgmap v3072: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 29 KiB/s wr, 7 op/s 2023-05-08T05:18:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:29 smithi133 ceph-mon[125939]: pgmap v3073: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:18:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5647.687242 secs 2023-05-08T05:18:29.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5648.244320 secs 2023-05-08T05:18:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:29 smithi096 ceph-mon[124666]: pgmap v3073: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:18:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5647.687242 secs 2023-05-08T05:18:29.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5648.244320 secs 2023-05-08T05:18:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:29 smithi186 ceph-mon[126480]: pgmap v3073: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:18:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5647.687242 secs 2023-05-08T05:18:29.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5648.244320 secs 2023-05-08T05:18:30.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:30 smithi133 ceph-mon[125939]: pgmap v3074: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T05:18:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:30 smithi096 ceph-mon[124666]: pgmap v3074: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T05:18:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:30 smithi186 ceph-mon[126480]: pgmap v3074: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T05:18:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5649.524820 secs 2023-05-08T05:18:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5649.524820 secs 2023-05-08T05:18:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5649.524820 secs 2023-05-08T05:18:32.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:32 smithi133 ceph-mon[125939]: pgmap v3075: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:18:32.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:32 smithi096 ceph-mon[124666]: pgmap v3075: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:18:32.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:32 smithi186 ceph-mon[126480]: pgmap v3075: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:18:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5652.687333 secs 2023-05-08T05:18:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5653.244455 secs 2023-05-08T05:18:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:34 smithi186 ceph-mon[126480]: pgmap v3076: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:18:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5652.687333 secs 2023-05-08T05:18:35.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5653.244455 secs 2023-05-08T05:18:35.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:34 smithi133 ceph-mon[125939]: pgmap v3076: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:18:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5652.687333 secs 2023-05-08T05:18:35.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5653.244455 secs 2023-05-08T05:18:35.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:34 smithi096 ceph-mon[124666]: pgmap v3076: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:18:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:36 smithi186 ceph-mon[126480]: pgmap v3077: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 65 KiB/s wr, 8 op/s 2023-05-08T05:18:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:36 smithi133 ceph-mon[125939]: pgmap v3077: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 65 KiB/s wr, 8 op/s 2023-05-08T05:18:37.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:36 smithi096 ceph-mon[124666]: pgmap v3077: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 65 KiB/s wr, 8 op/s 2023-05-08T05:18:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:38 smithi186 ceph-mon[126480]: pgmap v3078: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 65 KiB/s wr, 5 op/s 2023-05-08T05:18:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:38 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:18:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:38 smithi133 ceph-mon[125939]: pgmap v3078: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 65 KiB/s wr, 5 op/s 2023-05-08T05:18:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:38 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:18:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:38 smithi096 ceph-mon[124666]: pgmap v3078: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 65 KiB/s wr, 5 op/s 2023-05-08T05:18:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:38 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:18:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5657.687447 secs 2023-05-08T05:18:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5658.244575 secs 2023-05-08T05:18:40.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:39 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:18:40.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:39 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:18:40.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:39 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:18:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5657.687447 secs 2023-05-08T05:18:40.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5658.244575 secs 2023-05-08T05:18:40.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:39 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:18:40.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:39 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:18:40.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:39 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:18:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5657.687447 secs 2023-05-08T05:18:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5658.244575 secs 2023-05-08T05:18:40.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:39 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:18:40.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:39 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:18:40.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:39 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:18:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:41 smithi096 ceph-mon[124666]: pgmap v3079: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 120 KiB/s wr, 9 op/s 2023-05-08T05:18:41.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5659.524999 secs 2023-05-08T05:18:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:41 smithi186 ceph-mon[126480]: pgmap v3079: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 120 KiB/s wr, 9 op/s 2023-05-08T05:18:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5659.524999 secs 2023-05-08T05:18:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:41 smithi133 ceph-mon[125939]: pgmap v3079: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 120 KiB/s wr, 9 op/s 2023-05-08T05:18:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5659.524999 secs 2023-05-08T05:18:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:43 smithi186 ceph-mon[126480]: pgmap v3080: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 120 KiB/s wr, 6 op/s 2023-05-08T05:18:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:18:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:18:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:43 smithi133 ceph-mon[125939]: pgmap v3080: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 120 KiB/s wr, 6 op/s 2023-05-08T05:18:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:18:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:18:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:43 smithi096 ceph-mon[124666]: pgmap v3080: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 120 KiB/s wr, 6 op/s 2023-05-08T05:18:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:18:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:18:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5662.687566 secs 2023-05-08T05:18:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:44 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:18:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5662.687566 secs 2023-05-08T05:18:44.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:44 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:18:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5662.687566 secs 2023-05-08T05:18:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:44 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:18:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5663.244677 secs 2023-05-08T05:18:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:45 smithi186 ceph-mon[126480]: pgmap v3081: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 120 KiB/s wr, 6 op/s 2023-05-08T05:18:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5663.244677 secs 2023-05-08T05:18:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:45 smithi133 ceph-mon[125939]: pgmap v3081: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 120 KiB/s wr, 6 op/s 2023-05-08T05:18:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5663.244677 secs 2023-05-08T05:18:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:45 smithi096 ceph-mon[124666]: pgmap v3081: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 120 KiB/s wr, 6 op/s 2023-05-08T05:18:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5664.525065 secs 2023-05-08T05:18:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5664.525065 secs 2023-05-08T05:18:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5664.525065 secs 2023-05-08T05:18:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:47 smithi186 ceph-mon[126480]: pgmap v3082: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 148 KiB/s wr, 9 op/s 2023-05-08T05:18:47.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:47 smithi133 ceph-mon[125939]: pgmap v3082: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 148 KiB/s wr, 9 op/s 2023-05-08T05:18:47.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:47 smithi096 ceph-mon[124666]: pgmap v3082: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 148 KiB/s wr, 9 op/s 2023-05-08T05:18:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:49 smithi186 ceph-mon[126480]: pgmap v3083: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 83 KiB/s wr, 6 op/s 2023-05-08T05:18:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5667.687700 secs 2023-05-08T05:18:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:49 smithi133 ceph-mon[125939]: pgmap v3083: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 83 KiB/s wr, 6 op/s 2023-05-08T05:18:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5667.687700 secs 2023-05-08T05:18:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:49 smithi096 ceph-mon[124666]: pgmap v3083: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 83 KiB/s wr, 6 op/s 2023-05-08T05:18:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5667.687700 secs 2023-05-08T05:18:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5668.244797 secs 2023-05-08T05:18:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5668.244797 secs 2023-05-08T05:18:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5668.244797 secs 2023-05-08T05:18:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:51 smithi186 ceph-mon[126480]: pgmap v3084: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 83 KiB/s wr, 9 op/s 2023-05-08T05:18:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5669.525176 secs 2023-05-08T05:18:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:51 smithi133 ceph-mon[125939]: pgmap v3084: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 83 KiB/s wr, 9 op/s 2023-05-08T05:18:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5669.525176 secs 2023-05-08T05:18:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:51 smithi096 ceph-mon[124666]: pgmap v3084: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 83 KiB/s wr, 9 op/s 2023-05-08T05:18:51.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5669.525176 secs 2023-05-08T05:18:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:53 smithi186 ceph-mon[126480]: pgmap v3085: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 5 op/s 2023-05-08T05:18:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:53 smithi133 ceph-mon[125939]: pgmap v3085: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 5 op/s 2023-05-08T05:18:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:53 smithi096 ceph-mon[124666]: pgmap v3085: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 5 op/s 2023-05-08T05:18:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5672.687834 secs 2023-05-08T05:18:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5672.687834 secs 2023-05-08T05:18:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5672.687834 secs 2023-05-08T05:18:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5673.244930 secs 2023-05-08T05:18:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:55 smithi186 ceph-mon[126480]: pgmap v3086: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 5 op/s 2023-05-08T05:18:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5673.244930 secs 2023-05-08T05:18:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:55 smithi133 ceph-mon[125939]: pgmap v3086: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 5 op/s 2023-05-08T05:18:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5673.244930 secs 2023-05-08T05:18:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:55 smithi096 ceph-mon[124666]: pgmap v3086: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 5 op/s 2023-05-08T05:18:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5674.525290 secs 2023-05-08T05:18:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5674.525290 secs 2023-05-08T05:18:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5674.525290 secs 2023-05-08T05:18:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:57 smithi186 ceph-mon[126480]: pgmap v3087: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 28 KiB/s wr, 8 op/s 2023-05-08T05:18:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:57 smithi133 ceph-mon[125939]: pgmap v3087: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 28 KiB/s wr, 8 op/s 2023-05-08T05:18:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:57 smithi096 ceph-mon[124666]: pgmap v3087: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 28 KiB/s wr, 8 op/s 2023-05-08T05:18:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:59 smithi186 ceph-mon[126480]: pgmap v3088: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:18:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:18:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5677.687951 secs 2023-05-08T05:18:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:59 smithi133 ceph-mon[125939]: pgmap v3088: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:18:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:18:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5677.687951 secs 2023-05-08T05:18:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:59 smithi096 ceph-mon[124666]: pgmap v3088: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:18:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:18:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5677.687951 secs 2023-05-08T05:19:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5678.245070 secs 2023-05-08T05:19:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5678.245070 secs 2023-05-08T05:19:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5678.245070 secs 2023-05-08T05:19:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:01 smithi186 ceph-mon[126480]: pgmap v3089: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T05:19:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5679.525400 secs 2023-05-08T05:19:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:01 smithi133 ceph-mon[125939]: pgmap v3089: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T05:19:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5679.525400 secs 2023-05-08T05:19:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:01 smithi096 ceph-mon[124666]: pgmap v3089: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T05:19:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5679.525400 secs 2023-05-08T05:19:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:03 smithi186 ceph-mon[126480]: pgmap v3090: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:19:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:03 smithi133 ceph-mon[125939]: pgmap v3090: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:19:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:03 smithi096 ceph-mon[124666]: pgmap v3090: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:19:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5682.688090 secs 2023-05-08T05:19:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5682.688090 secs 2023-05-08T05:19:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5682.688090 secs 2023-05-08T05:19:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5683.245189 secs 2023-05-08T05:19:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:05 smithi186 ceph-mon[126480]: pgmap v3091: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:19:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5683.245189 secs 2023-05-08T05:19:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:05 smithi133 ceph-mon[125939]: pgmap v3091: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:19:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5683.245189 secs 2023-05-08T05:19:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:05 smithi096 ceph-mon[124666]: pgmap v3091: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:19:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5684.525491 secs 2023-05-08T05:19:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:06 smithi186 ceph-mon[126480]: osdmap e272: 12 total, 12 up, 12 in 2023-05-08T05:19:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5684.525491 secs 2023-05-08T05:19:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:06 smithi133 ceph-mon[125939]: osdmap e272: 12 total, 12 up, 12 in 2023-05-08T05:19:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5684.525491 secs 2023-05-08T05:19:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:06 smithi096 ceph-mon[124666]: osdmap e272: 12 total, 12 up, 12 in 2023-05-08T05:19:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:07 smithi186 ceph-mon[126480]: pgmap v3093: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 122 KiB/s wr, 25 op/s 2023-05-08T05:19:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:07 smithi133 ceph-mon[125939]: pgmap v3093: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 122 KiB/s wr, 25 op/s 2023-05-08T05:19:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:07 smithi096 ceph-mon[124666]: pgmap v3093: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 122 KiB/s wr, 25 op/s 2023-05-08T05:19:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:09 smithi186 ceph-mon[126480]: pgmap v3094: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 122 KiB/s wr, 25 op/s 2023-05-08T05:19:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5687.688220 secs 2023-05-08T05:19:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:09 smithi133 ceph-mon[125939]: pgmap v3094: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 122 KiB/s wr, 25 op/s 2023-05-08T05:19:09.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5687.688220 secs 2023-05-08T05:19:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:09 smithi096 ceph-mon[124666]: pgmap v3094: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 122 KiB/s wr, 25 op/s 2023-05-08T05:19:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5687.688220 secs 2023-05-08T05:19:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5688.245293 secs 2023-05-08T05:19:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5688.245293 secs 2023-05-08T05:19:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5688.245293 secs 2023-05-08T05:19:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:11 smithi186 ceph-mon[126480]: pgmap v3095: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 123 KiB/s wr, 25 op/s 2023-05-08T05:19:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5689.525627 secs 2023-05-08T05:19:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:11 smithi133 ceph-mon[125939]: pgmap v3095: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 123 KiB/s wr, 25 op/s 2023-05-08T05:19:11.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5689.525627 secs 2023-05-08T05:19:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:11 smithi096 ceph-mon[124666]: pgmap v3095: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 123 KiB/s wr, 25 op/s 2023-05-08T05:19:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5689.525627 secs 2023-05-08T05:19:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:13 smithi186 ceph-mon[126480]: pgmap v3096: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 123 KiB/s wr, 25 op/s 2023-05-08T05:19:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:13 smithi133 ceph-mon[125939]: pgmap v3096: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 123 KiB/s wr, 25 op/s 2023-05-08T05:19:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:13 smithi096 ceph-mon[124666]: pgmap v3096: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 123 KiB/s wr, 25 op/s 2023-05-08T05:19:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5692.688377 secs 2023-05-08T05:19:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:14 smithi186 ceph-mon[126480]: osdmap e273: 12 total, 12 up, 12 in 2023-05-08T05:19:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5692.688377 secs 2023-05-08T05:19:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:14 smithi133 ceph-mon[125939]: osdmap e273: 12 total, 12 up, 12 in 2023-05-08T05:19:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5692.688377 secs 2023-05-08T05:19:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:14 smithi096 ceph-mon[124666]: osdmap e273: 12 total, 12 up, 12 in 2023-05-08T05:19:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5693.245410 secs 2023-05-08T05:19:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:15 smithi186 ceph-mon[126480]: pgmap v3097: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 123 KiB/s wr, 25 op/s 2023-05-08T05:19:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5693.245410 secs 2023-05-08T05:19:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:15 smithi133 ceph-mon[125939]: pgmap v3097: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 123 KiB/s wr, 25 op/s 2023-05-08T05:19:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5693.245410 secs 2023-05-08T05:19:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:15 smithi096 ceph-mon[124666]: pgmap v3097: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 123 KiB/s wr, 25 op/s 2023-05-08T05:19:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5694.525706 secs 2023-05-08T05:19:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5694.525706 secs 2023-05-08T05:19:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5694.525706 secs 2023-05-08T05:19:17.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:17 smithi186 ceph-mon[126480]: pgmap v3099: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 67 KiB/s wr, 7 op/s 2023-05-08T05:19:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:17 smithi133 ceph-mon[125939]: pgmap v3099: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 67 KiB/s wr, 7 op/s 2023-05-08T05:19:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:17 smithi096 ceph-mon[124666]: pgmap v3099: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 67 KiB/s wr, 7 op/s 2023-05-08T05:19:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:19 smithi186 ceph-mon[126480]: pgmap v3100: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 67 KiB/s wr, 7 op/s 2023-05-08T05:19:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5697.688445 secs 2023-05-08T05:19:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:19 smithi133 ceph-mon[125939]: pgmap v3100: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 67 KiB/s wr, 7 op/s 2023-05-08T05:19:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5697.688445 secs 2023-05-08T05:19:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:19 smithi096 ceph-mon[124666]: pgmap v3100: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 67 KiB/s wr, 7 op/s 2023-05-08T05:19:19.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5697.688445 secs 2023-05-08T05:19:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5698.245528 secs 2023-05-08T05:19:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5698.245528 secs 2023-05-08T05:19:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5698.245528 secs 2023-05-08T05:19:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:21 smithi133 ceph-mon[125939]: pgmap v3101: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 67 KiB/s wr, 7 op/s 2023-05-08T05:19:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5699.525834 secs 2023-05-08T05:19:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:21 smithi096 ceph-mon[124666]: pgmap v3101: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 67 KiB/s wr, 7 op/s 2023-05-08T05:19:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5699.525834 secs 2023-05-08T05:19:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:21 smithi186 ceph-mon[126480]: pgmap v3101: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 67 KiB/s wr, 7 op/s 2023-05-08T05:19:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5699.525834 secs 2023-05-08T05:19:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:23 smithi133 ceph-mon[125939]: pgmap v3102: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 67 KiB/s wr, 7 op/s 2023-05-08T05:19:23.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:23 smithi096 ceph-mon[124666]: pgmap v3102: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 67 KiB/s wr, 7 op/s 2023-05-08T05:19:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:23 smithi186 ceph-mon[126480]: pgmap v3102: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 67 KiB/s wr, 7 op/s 2023-05-08T05:19:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5702.688507 secs 2023-05-08T05:19:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5702.688507 secs 2023-05-08T05:19:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5702.688507 secs 2023-05-08T05:19:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5703.245652 secs 2023-05-08T05:19:25.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:25 smithi133 ceph-mon[125939]: pgmap v3103: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 67 KiB/s wr, 7 op/s 2023-05-08T05:19:25.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:25 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:19:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5703.245652 secs 2023-05-08T05:19:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:25 smithi096 ceph-mon[124666]: pgmap v3103: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 67 KiB/s wr, 7 op/s 2023-05-08T05:19:25.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:25 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:19:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5703.245652 secs 2023-05-08T05:19:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:25 smithi186 ceph-mon[126480]: pgmap v3103: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 67 KiB/s wr, 7 op/s 2023-05-08T05:19:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:25 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:19:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5704.525902 secs 2023-05-08T05:19:26.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:19:26.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:19:26.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:26 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:19:26.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:19:26.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:26 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T05:19:26.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:26 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T05:19:26.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:26 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:19:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5704.525902 secs 2023-05-08T05:19:26.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:19:26.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:19:26.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:26 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:19:26.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:19:26.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:26 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T05:19:26.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:26 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T05:19:26.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:26 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:19:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5704.525902 secs 2023-05-08T05:19:26.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:19:26.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:19:26.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:26 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:19:26.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:19:26.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:26 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T05:19:26.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:26 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T05:19:26.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:26 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:19:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:27 smithi133 ceph-mon[125939]: pgmap v3104: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 57 KiB/s wr, 9 op/s 2023-05-08T05:19:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:27 smithi096 ceph-mon[124666]: pgmap v3104: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 57 KiB/s wr, 9 op/s 2023-05-08T05:19:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:27 smithi186 ceph-mon[126480]: pgmap v3104: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 57 KiB/s wr, 9 op/s 2023-05-08T05:19:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:29 smithi133 ceph-mon[125939]: pgmap v3105: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2023-05-08T05:19:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5707.688573 secs 2023-05-08T05:19:29.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5708.245766 secs 2023-05-08T05:19:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:29 smithi096 ceph-mon[124666]: pgmap v3105: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2023-05-08T05:19:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5707.688573 secs 2023-05-08T05:19:29.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5708.245766 secs 2023-05-08T05:19:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:29 smithi186 ceph-mon[126480]: pgmap v3105: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2023-05-08T05:19:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5707.688573 secs 2023-05-08T05:19:29.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5708.245766 secs 2023-05-08T05:19:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:31 smithi133 ceph-mon[125939]: pgmap v3106: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 8 op/s 2023-05-08T05:19:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5709.526045 secs 2023-05-08T05:19:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:31 smithi096 ceph-mon[124666]: pgmap v3106: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 8 op/s 2023-05-08T05:19:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5709.526045 secs 2023-05-08T05:19:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:31 smithi186 ceph-mon[126480]: pgmap v3106: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 8 op/s 2023-05-08T05:19:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5709.526045 secs 2023-05-08T05:19:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:33 smithi133 ceph-mon[125939]: pgmap v3107: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:19:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:33 smithi096 ceph-mon[124666]: pgmap v3107: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:19:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:33 smithi186 ceph-mon[126480]: pgmap v3107: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:19:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5712.688643 secs 2023-05-08T05:19:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5713.245856 secs 2023-05-08T05:19:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5712.688643 secs 2023-05-08T05:19:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5713.245856 secs 2023-05-08T05:19:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5712.688643 secs 2023-05-08T05:19:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5713.245856 secs 2023-05-08T05:19:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:35 smithi133 ceph-mon[125939]: pgmap v3108: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:19:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:35 smithi096 ceph-mon[124666]: pgmap v3108: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:19:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:35 smithi186 ceph-mon[126480]: pgmap v3108: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:19:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:36 smithi133 ceph-mon[125939]: pgmap v3109: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 70 KiB/s wr, 9 op/s 2023-05-08T05:19:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:36 smithi096 ceph-mon[124666]: pgmap v3109: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 70 KiB/s wr, 9 op/s 2023-05-08T05:19:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:36 smithi186 ceph-mon[126480]: pgmap v3109: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 70 KiB/s wr, 9 op/s 2023-05-08T05:19:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:38 smithi186 ceph-mon[126480]: pgmap v3110: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 70 KiB/s wr, 6 op/s 2023-05-08T05:19:39.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:38 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:19:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:38 smithi133 ceph-mon[125939]: pgmap v3110: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 70 KiB/s wr, 6 op/s 2023-05-08T05:19:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:38 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:19:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:38 smithi096 ceph-mon[124666]: pgmap v3110: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 70 KiB/s wr, 6 op/s 2023-05-08T05:19:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:38 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:19:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5717.688761 secs 2023-05-08T05:19:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5718.245979 secs 2023-05-08T05:19:40.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:39 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:19:40.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:39 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:19:40.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:39 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:19:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5717.688761 secs 2023-05-08T05:19:40.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5718.245979 secs 2023-05-08T05:19:40.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:39 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:19:40.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:39 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:19:40.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:39 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:19:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5717.688761 secs 2023-05-08T05:19:40.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5718.245979 secs 2023-05-08T05:19:40.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:39 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:19:40.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:39 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:19:40.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:39 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:19:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:41 smithi186 ceph-mon[126480]: pgmap v3111: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 125 KiB/s wr, 9 op/s 2023-05-08T05:19:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5719.526318 secs 2023-05-08T05:19:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:41 smithi133 ceph-mon[125939]: pgmap v3111: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 125 KiB/s wr, 9 op/s 2023-05-08T05:19:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5719.526318 secs 2023-05-08T05:19:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:41 smithi096 ceph-mon[124666]: pgmap v3111: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 125 KiB/s wr, 9 op/s 2023-05-08T05:19:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5719.526318 secs 2023-05-08T05:19:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:43 smithi186 ceph-mon[126480]: pgmap v3112: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 125 KiB/s wr, 6 op/s 2023-05-08T05:19:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:19:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:19:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:43 smithi133 ceph-mon[125939]: pgmap v3112: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 125 KiB/s wr, 6 op/s 2023-05-08T05:19:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:19:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:19:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:43 smithi096 ceph-mon[124666]: pgmap v3112: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 125 KiB/s wr, 6 op/s 2023-05-08T05:19:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:19:43.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:19:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5722.688881 secs 2023-05-08T05:19:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:44 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:19:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5722.688881 secs 2023-05-08T05:19:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:44 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:19:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5722.688881 secs 2023-05-08T05:19:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:44 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:19:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5723.246100 secs 2023-05-08T05:19:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:45 smithi186 ceph-mon[126480]: pgmap v3113: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 125 KiB/s wr, 6 op/s 2023-05-08T05:19:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5723.246100 secs 2023-05-08T05:19:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:45 smithi133 ceph-mon[125939]: pgmap v3113: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 125 KiB/s wr, 6 op/s 2023-05-08T05:19:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5723.246100 secs 2023-05-08T05:19:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:45 smithi096 ceph-mon[124666]: pgmap v3113: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 125 KiB/s wr, 6 op/s 2023-05-08T05:19:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5724.526381 secs 2023-05-08T05:19:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5724.526381 secs 2023-05-08T05:19:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5724.526381 secs 2023-05-08T05:19:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:47 smithi186 ceph-mon[126480]: pgmap v3114: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 158 KiB/s wr, 10 op/s 2023-05-08T05:19:47.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:47 smithi133 ceph-mon[125939]: pgmap v3114: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 158 KiB/s wr, 10 op/s 2023-05-08T05:19:47.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:47 smithi096 ceph-mon[124666]: pgmap v3114: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 158 KiB/s wr, 10 op/s 2023-05-08T05:19:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:49 smithi186 ceph-mon[126480]: pgmap v3115: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 88 KiB/s wr, 6 op/s 2023-05-08T05:19:49.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5727.689001 secs 2023-05-08T05:19:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:49 smithi133 ceph-mon[125939]: pgmap v3115: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 88 KiB/s wr, 6 op/s 2023-05-08T05:19:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5727.689001 secs 2023-05-08T05:19:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:49 smithi096 ceph-mon[124666]: pgmap v3115: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 88 KiB/s wr, 6 op/s 2023-05-08T05:19:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5727.689001 secs 2023-05-08T05:19:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5728.246214 secs 2023-05-08T05:19:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5728.246214 secs 2023-05-08T05:19:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5728.246214 secs 2023-05-08T05:19:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:51 smithi186 ceph-mon[126480]: pgmap v3116: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 88 KiB/s wr, 9 op/s 2023-05-08T05:19:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5729.526515 secs 2023-05-08T05:19:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:51 smithi133 ceph-mon[125939]: pgmap v3116: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 88 KiB/s wr, 9 op/s 2023-05-08T05:19:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5729.526515 secs 2023-05-08T05:19:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:51 smithi096 ceph-mon[124666]: pgmap v3116: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 88 KiB/s wr, 9 op/s 2023-05-08T05:19:51.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5729.526515 secs 2023-05-08T05:19:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:53 smithi186 ceph-mon[126480]: pgmap v3117: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 5 op/s 2023-05-08T05:19:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:53 smithi133 ceph-mon[125939]: pgmap v3117: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 5 op/s 2023-05-08T05:19:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:53 smithi096 ceph-mon[124666]: pgmap v3117: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 5 op/s 2023-05-08T05:19:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5732.689141 secs 2023-05-08T05:19:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5732.689141 secs 2023-05-08T05:19:54.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5732.689141 secs 2023-05-08T05:19:55.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5733.246329 secs 2023-05-08T05:19:55.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:55 smithi186 ceph-mon[126480]: pgmap v3118: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 5 op/s 2023-05-08T05:19:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5733.246329 secs 2023-05-08T05:19:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:55 smithi133 ceph-mon[125939]: pgmap v3118: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 5 op/s 2023-05-08T05:19:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5733.246329 secs 2023-05-08T05:19:55.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:55 smithi096 ceph-mon[124666]: pgmap v3118: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 5 op/s 2023-05-08T05:19:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5734.526655 secs 2023-05-08T05:19:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5734.526655 secs 2023-05-08T05:19:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5734.526655 secs 2023-05-08T05:19:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:57 smithi186 ceph-mon[126480]: pgmap v3119: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 34 KiB/s wr, 8 op/s 2023-05-08T05:19:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:57 smithi133 ceph-mon[125939]: pgmap v3119: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 34 KiB/s wr, 8 op/s 2023-05-08T05:19:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:57 smithi096 ceph-mon[124666]: pgmap v3119: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 34 KiB/s wr, 8 op/s 2023-05-08T05:19:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:59 smithi186 ceph-mon[126480]: pgmap v3120: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:19:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:19:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5737.689207 secs 2023-05-08T05:19:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:59 smithi133 ceph-mon[125939]: pgmap v3120: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:19:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:19:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5737.689207 secs 2023-05-08T05:19:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:59 smithi096 ceph-mon[124666]: pgmap v3120: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:19:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:19:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5737.689207 secs 2023-05-08T05:20:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5738.246435 secs 2023-05-08T05:20:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:00 smithi186 ceph-mon[126480]: overall HEALTH_WARN 3 MDSs report slow requests 2023-05-08T05:20:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5738.246435 secs 2023-05-08T05:20:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:00 smithi133 ceph-mon[125939]: overall HEALTH_WARN 3 MDSs report slow requests 2023-05-08T05:20:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5738.246435 secs 2023-05-08T05:20:00.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:00 smithi096 ceph-mon[124666]: overall HEALTH_WARN 3 MDSs report slow requests 2023-05-08T05:20:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:01 smithi186 ceph-mon[126480]: pgmap v3121: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T05:20:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5739.526811 secs 2023-05-08T05:20:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:01 smithi133 ceph-mon[125939]: pgmap v3121: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T05:20:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5739.526811 secs 2023-05-08T05:20:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:01 smithi096 ceph-mon[124666]: pgmap v3121: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T05:20:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5739.526811 secs 2023-05-08T05:20:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:03 smithi186 ceph-mon[126480]: pgmap v3122: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:20:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:03 smithi133 ceph-mon[125939]: pgmap v3122: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:20:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:03 smithi096 ceph-mon[124666]: pgmap v3122: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:20:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5742.689321 secs 2023-05-08T05:20:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5742.689321 secs 2023-05-08T05:20:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5742.689321 secs 2023-05-08T05:20:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5743.246550 secs 2023-05-08T05:20:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:05 smithi186 ceph-mon[126480]: pgmap v3123: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:20:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5743.246550 secs 2023-05-08T05:20:05.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:05 smithi133 ceph-mon[125939]: pgmap v3123: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:20:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5743.246550 secs 2023-05-08T05:20:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:05 smithi096 ceph-mon[124666]: pgmap v3123: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:20:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5744.526927 secs 2023-05-08T05:20:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:06 smithi186 ceph-mon[126480]: osdmap e274: 12 total, 12 up, 12 in 2023-05-08T05:20:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5744.526927 secs 2023-05-08T05:20:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:06 smithi133 ceph-mon[125939]: osdmap e274: 12 total, 12 up, 12 in 2023-05-08T05:20:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5744.526927 secs 2023-05-08T05:20:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:06 smithi096 ceph-mon[124666]: osdmap e274: 12 total, 12 up, 12 in 2023-05-08T05:20:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:07 smithi186 ceph-mon[126480]: pgmap v3125: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 123 KiB/s wr, 25 op/s 2023-05-08T05:20:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:07 smithi133 ceph-mon[125939]: pgmap v3125: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 123 KiB/s wr, 25 op/s 2023-05-08T05:20:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:07 smithi096 ceph-mon[124666]: pgmap v3125: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 123 KiB/s wr, 25 op/s 2023-05-08T05:20:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:09 smithi133 ceph-mon[125939]: pgmap v3126: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 123 KiB/s wr, 25 op/s 2023-05-08T05:20:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5747.689443 secs 2023-05-08T05:20:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:09 smithi096 ceph-mon[124666]: pgmap v3126: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 123 KiB/s wr, 25 op/s 2023-05-08T05:20:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5747.689443 secs 2023-05-08T05:20:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:09 smithi186 ceph-mon[126480]: pgmap v3126: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 123 KiB/s wr, 25 op/s 2023-05-08T05:20:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5747.689443 secs 2023-05-08T05:20:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5748.246649 secs 2023-05-08T05:20:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5748.246649 secs 2023-05-08T05:20:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5748.246649 secs 2023-05-08T05:20:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:11 smithi133 ceph-mon[125939]: pgmap v3127: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 123 KiB/s wr, 25 op/s 2023-05-08T05:20:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5749.527048 secs 2023-05-08T05:20:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:11 smithi096 ceph-mon[124666]: pgmap v3127: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 123 KiB/s wr, 25 op/s 2023-05-08T05:20:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5749.527048 secs 2023-05-08T05:20:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:11 smithi186 ceph-mon[126480]: pgmap v3127: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 123 KiB/s wr, 25 op/s 2023-05-08T05:20:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5749.527048 secs 2023-05-08T05:20:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:13 smithi133 ceph-mon[125939]: pgmap v3128: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 123 KiB/s wr, 25 op/s 2023-05-08T05:20:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:13 smithi096 ceph-mon[124666]: pgmap v3128: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 123 KiB/s wr, 25 op/s 2023-05-08T05:20:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:13 smithi186 ceph-mon[126480]: pgmap v3128: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 123 KiB/s wr, 25 op/s 2023-05-08T05:20:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5752.689542 secs 2023-05-08T05:20:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:14 smithi133 ceph-mon[125939]: osdmap e275: 12 total, 12 up, 12 in 2023-05-08T05:20:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5752.689542 secs 2023-05-08T05:20:14.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:14 smithi096 ceph-mon[124666]: osdmap e275: 12 total, 12 up, 12 in 2023-05-08T05:20:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5752.689542 secs 2023-05-08T05:20:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:14 smithi186 ceph-mon[126480]: osdmap e275: 12 total, 12 up, 12 in 2023-05-08T05:20:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5753.246802 secs 2023-05-08T05:20:15.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:15 smithi133 ceph-mon[125939]: pgmap v3129: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 123 KiB/s wr, 25 op/s 2023-05-08T05:20:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5753.246802 secs 2023-05-08T05:20:15.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:15 smithi096 ceph-mon[124666]: pgmap v3129: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 123 KiB/s wr, 25 op/s 2023-05-08T05:20:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5753.246802 secs 2023-05-08T05:20:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:15 smithi186 ceph-mon[126480]: pgmap v3129: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 123 KiB/s wr, 25 op/s 2023-05-08T05:20:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5754.527169 secs 2023-05-08T05:20:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5754.527169 secs 2023-05-08T05:20:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5754.527169 secs 2023-05-08T05:20:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:17 smithi133 ceph-mon[125939]: pgmap v3131: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 KiB/s wr, 7 op/s 2023-05-08T05:20:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:17 smithi096 ceph-mon[124666]: pgmap v3131: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 KiB/s wr, 7 op/s 2023-05-08T05:20:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:17 smithi186 ceph-mon[126480]: pgmap v3131: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 KiB/s wr, 7 op/s 2023-05-08T05:20:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:19 smithi133 ceph-mon[125939]: pgmap v3132: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 KiB/s wr, 7 op/s 2023-05-08T05:20:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5757.689653 secs 2023-05-08T05:20:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:19 smithi096 ceph-mon[124666]: pgmap v3132: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 KiB/s wr, 7 op/s 2023-05-08T05:20:19.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5757.689653 secs 2023-05-08T05:20:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:19 smithi186 ceph-mon[126480]: pgmap v3132: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 KiB/s wr, 7 op/s 2023-05-08T05:20:19.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5757.689653 secs 2023-05-08T05:20:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5758.246908 secs 2023-05-08T05:20:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5758.246908 secs 2023-05-08T05:20:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5758.246908 secs 2023-05-08T05:20:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:21 smithi133 ceph-mon[125939]: pgmap v3133: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T05:20:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5759.527309 secs 2023-05-08T05:20:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:21 smithi096 ceph-mon[124666]: pgmap v3133: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T05:20:21.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5759.527309 secs 2023-05-08T05:20:21.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:21 smithi186 ceph-mon[126480]: pgmap v3133: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T05:20:21.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5759.527309 secs 2023-05-08T05:20:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:23 smithi133 ceph-mon[125939]: pgmap v3134: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T05:20:23.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:23 smithi096 ceph-mon[124666]: pgmap v3134: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T05:20:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:23 smithi186 ceph-mon[126480]: pgmap v3134: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T05:20:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:24 smithi133 ceph-mon[125939]: 1 slow requests, 1 included below; oldest blocked for > 5762.689791 secs 2023-05-08T05:20:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:24 smithi133 ceph-mon[125939]: slow request 5762.689790 seconds old, received at 2023-05-08T03:44:20.260233+0000: client_request(client.15258:3163 link #0x10000000007/0000000100000000000000F2 #0x10000000007/0000000100000000000000C5 2023-05-08T03:44:20.259302+0000 caller_uid=26, caller_gid=26{26,}) currently acquired locks 2023-05-08T05:20:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:24 smithi096 ceph-mon[124666]: 1 slow requests, 1 included below; oldest blocked for > 5762.689791 secs 2023-05-08T05:20:24.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:24 smithi096 ceph-mon[124666]: slow request 5762.689790 seconds old, received at 2023-05-08T03:44:20.260233+0000: client_request(client.15258:3163 link #0x10000000007/0000000100000000000000F2 #0x10000000007/0000000100000000000000C5 2023-05-08T03:44:20.259302+0000 caller_uid=26, caller_gid=26{26,}) currently acquired locks 2023-05-08T05:20:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:24 smithi186 ceph-mon[126480]: 1 slow requests, 1 included below; oldest blocked for > 5762.689791 secs 2023-05-08T05:20:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:24 smithi186 ceph-mon[126480]: slow request 5762.689790 seconds old, received at 2023-05-08T03:44:20.260233+0000: client_request(client.15258:3163 link #0x10000000007/0000000100000000000000F2 #0x10000000007/0000000100000000000000C5 2023-05-08T03:44:20.259302+0000 caller_uid=26, caller_gid=26{26,}) currently acquired locks 2023-05-08T05:20:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:25 smithi133 ceph-mon[125939]: 1 slow requests, 1 included below; oldest blocked for > 5763.247044 secs 2023-05-08T05:20:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:25 smithi133 ceph-mon[125939]: slow request 5763.247043 seconds old, received at 2023-05-08T03:44:20.272100+0000: peer_request:client.15258:3163 currently acquired locks 2023-05-08T05:20:25.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:25 smithi133 ceph-mon[125939]: pgmap v3135: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T05:20:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:25 smithi096 ceph-mon[124666]: 1 slow requests, 1 included below; oldest blocked for > 5763.247044 secs 2023-05-08T05:20:25.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:25 smithi096 ceph-mon[124666]: slow request 5763.247043 seconds old, received at 2023-05-08T03:44:20.272100+0000: peer_request:client.15258:3163 currently acquired locks 2023-05-08T05:20:25.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:25 smithi096 ceph-mon[124666]: pgmap v3135: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T05:20:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:25 smithi186 ceph-mon[126480]: 1 slow requests, 1 included below; oldest blocked for > 5763.247044 secs 2023-05-08T05:20:25.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:25 smithi186 ceph-mon[126480]: slow request 5763.247043 seconds old, received at 2023-05-08T03:44:20.272100+0000: peer_request:client.15258:3163 currently acquired locks 2023-05-08T05:20:25.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:25 smithi186 ceph-mon[126480]: pgmap v3135: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T05:20:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:26 smithi133 ceph-mon[125939]: 1 slow requests, 1 included below; oldest blocked for > 5764.527396 secs 2023-05-08T05:20:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:26 smithi133 ceph-mon[125939]: slow request 5764.527396 seconds old, received at 2023-05-08T03:44:20.261840+0000: peer_request:client.15258:3163 currently dispatched 2023-05-08T05:20:26.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:20:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:26 smithi096 ceph-mon[124666]: 1 slow requests, 1 included below; oldest blocked for > 5764.527396 secs 2023-05-08T05:20:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:26 smithi096 ceph-mon[124666]: slow request 5764.527396 seconds old, received at 2023-05-08T03:44:20.261840+0000: peer_request:client.15258:3163 currently dispatched 2023-05-08T05:20:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:20:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:26 smithi186 ceph-mon[126480]: 1 slow requests, 1 included below; oldest blocked for > 5764.527396 secs 2023-05-08T05:20:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:26 smithi186 ceph-mon[126480]: slow request 5764.527396 seconds old, received at 2023-05-08T03:44:20.261840+0000: peer_request:client.15258:3163 currently dispatched 2023-05-08T05:20:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:20:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:27 smithi133 ceph-mon[125939]: pgmap v3136: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 29 KiB/s wr, 8 op/s 2023-05-08T05:20:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:20:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:20:27.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:27 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:20:27.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:20:27.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:27 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T05:20:27.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:27 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T05:20:27.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:27 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:20:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:27 smithi096 ceph-mon[124666]: pgmap v3136: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 29 KiB/s wr, 8 op/s 2023-05-08T05:20:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:20:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:20:27.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:27 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:20:27.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:20:27.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:27 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T05:20:27.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:27 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T05:20:27.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:27 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:20:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:27 smithi186 ceph-mon[126480]: pgmap v3136: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 29 KiB/s wr, 8 op/s 2023-05-08T05:20:27.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:20:27.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:20:27.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:27 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:20:27.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:20:27.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:27 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T05:20:27.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:27 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T05:20:27.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:27 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:20:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:29 smithi133 ceph-mon[125939]: pgmap v3137: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:20:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5767.689919 secs 2023-05-08T05:20:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:29 smithi096 ceph-mon[124666]: pgmap v3137: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:20:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5767.689919 secs 2023-05-08T05:20:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:29 smithi186 ceph-mon[126480]: pgmap v3137: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:20:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5767.689919 secs 2023-05-08T05:20:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5768.247151 secs 2023-05-08T05:20:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5768.247151 secs 2023-05-08T05:20:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5768.247151 secs 2023-05-08T05:20:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:31 smithi133 ceph-mon[125939]: pgmap v3138: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T05:20:31.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5769.527541 secs 2023-05-08T05:20:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:31 smithi096 ceph-mon[124666]: pgmap v3138: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T05:20:31.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5769.527541 secs 2023-05-08T05:20:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:31 smithi186 ceph-mon[126480]: pgmap v3138: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T05:20:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5769.527541 secs 2023-05-08T05:20:33.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:33 smithi133 ceph-mon[125939]: pgmap v3139: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:20:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:33 smithi096 ceph-mon[124666]: pgmap v3139: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:20:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:33 smithi186 ceph-mon[126480]: pgmap v3139: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:20:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5772.690034 secs 2023-05-08T05:20:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5772.690034 secs 2023-05-08T05:20:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5772.690034 secs 2023-05-08T05:20:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5773.247290 secs 2023-05-08T05:20:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:35 smithi133 ceph-mon[125939]: pgmap v3140: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:20:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5773.247290 secs 2023-05-08T05:20:35.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:35 smithi096 ceph-mon[124666]: pgmap v3140: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:20:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5773.247290 secs 2023-05-08T05:20:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:35 smithi186 ceph-mon[126480]: pgmap v3140: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:20:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:37 smithi133 ceph-mon[125939]: pgmap v3141: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 65 KiB/s wr, 8 op/s 2023-05-08T05:20:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:37 smithi096 ceph-mon[124666]: pgmap v3141: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 65 KiB/s wr, 8 op/s 2023-05-08T05:20:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:37 smithi186 ceph-mon[126480]: pgmap v3141: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 65 KiB/s wr, 8 op/s 2023-05-08T05:20:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:38 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:20:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:38 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:20:38.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:38 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:20:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:39 smithi133 ceph-mon[125939]: pgmap v3142: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 65 KiB/s wr, 6 op/s 2023-05-08T05:20:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5777.690155 secs 2023-05-08T05:20:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:39 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:20:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:39 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:20:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:39 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:20:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:39 smithi096 ceph-mon[124666]: pgmap v3142: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 65 KiB/s wr, 6 op/s 2023-05-08T05:20:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5777.690155 secs 2023-05-08T05:20:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:39 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:20:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:39 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:20:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:39 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:20:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:39 smithi186 ceph-mon[126480]: pgmap v3142: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 65 KiB/s wr, 6 op/s 2023-05-08T05:20:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5777.690155 secs 2023-05-08T05:20:39.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:39 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:20:39.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:39 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:20:39.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:39 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:20:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5778.247422 secs 2023-05-08T05:20:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5778.247422 secs 2023-05-08T05:20:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5778.247422 secs 2023-05-08T05:20:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:41 smithi133 ceph-mon[125939]: pgmap v3143: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 149 KiB/s wr, 10 op/s 2023-05-08T05:20:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5779.527831 secs 2023-05-08T05:20:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:41 smithi096 ceph-mon[124666]: pgmap v3143: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 149 KiB/s wr, 10 op/s 2023-05-08T05:20:41.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5779.527831 secs 2023-05-08T05:20:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:41 smithi186 ceph-mon[126480]: pgmap v3143: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 149 KiB/s wr, 10 op/s 2023-05-08T05:20:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5779.527831 secs 2023-05-08T05:20:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:43 smithi133 ceph-mon[125939]: pgmap v3144: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 149 KiB/s wr, 7 op/s 2023-05-08T05:20:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:20:43.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:20:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:43 smithi096 ceph-mon[124666]: pgmap v3144: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 149 KiB/s wr, 7 op/s 2023-05-08T05:20:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:20:43.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:20:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:43 smithi186 ceph-mon[126480]: pgmap v3144: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 149 KiB/s wr, 7 op/s 2023-05-08T05:20:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:20:43.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:20:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5782.690274 secs 2023-05-08T05:20:44.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:44 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:20:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5782.690274 secs 2023-05-08T05:20:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:44 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:20:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5782.690274 secs 2023-05-08T05:20:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:44 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:20:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5783.247540 secs 2023-05-08T05:20:45.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:45 smithi096 ceph-mon[124666]: pgmap v3145: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 149 KiB/s wr, 7 op/s 2023-05-08T05:20:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5783.247540 secs 2023-05-08T05:20:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:45 smithi186 ceph-mon[126480]: pgmap v3145: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 149 KiB/s wr, 7 op/s 2023-05-08T05:20:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5783.247540 secs 2023-05-08T05:20:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:45 smithi133 ceph-mon[125939]: pgmap v3145: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 149 KiB/s wr, 7 op/s 2023-05-08T05:20:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5784.527953 secs 2023-05-08T05:20:46.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5784.527953 secs 2023-05-08T05:20:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5784.527953 secs 2023-05-08T05:20:47.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:47 smithi096 ceph-mon[124666]: pgmap v3146: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 183 KiB/s wr, 11 op/s 2023-05-08T05:20:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:47 smithi186 ceph-mon[126480]: pgmap v3146: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 183 KiB/s wr, 11 op/s 2023-05-08T05:20:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:47 smithi133 ceph-mon[125939]: pgmap v3146: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 183 KiB/s wr, 11 op/s 2023-05-08T05:20:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:49 smithi186 ceph-mon[126480]: pgmap v3147: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 117 KiB/s wr, 7 op/s 2023-05-08T05:20:49.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5787.690403 secs 2023-05-08T05:20:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:49 smithi133 ceph-mon[125939]: pgmap v3147: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 117 KiB/s wr, 7 op/s 2023-05-08T05:20:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5787.690403 secs 2023-05-08T05:20:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:49 smithi096 ceph-mon[124666]: pgmap v3147: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 117 KiB/s wr, 7 op/s 2023-05-08T05:20:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5787.690403 secs 2023-05-08T05:20:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5788.247655 secs 2023-05-08T05:20:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5788.247655 secs 2023-05-08T05:20:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5788.247655 secs 2023-05-08T05:20:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:51 smithi186 ceph-mon[126480]: pgmap v3148: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 142 KiB/s wr, 10 op/s 2023-05-08T05:20:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5789.528069 secs 2023-05-08T05:20:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:51 smithi133 ceph-mon[125939]: pgmap v3148: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 142 KiB/s wr, 10 op/s 2023-05-08T05:20:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5789.528069 secs 2023-05-08T05:20:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:51 smithi096 ceph-mon[124666]: pgmap v3148: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 142 KiB/s wr, 10 op/s 2023-05-08T05:20:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5789.528069 secs 2023-05-08T05:20:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:53 smithi186 ceph-mon[126480]: pgmap v3149: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 59 KiB/s wr, 6 op/s 2023-05-08T05:20:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:53 smithi133 ceph-mon[125939]: pgmap v3149: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 59 KiB/s wr, 6 op/s 2023-05-08T05:20:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:53 smithi096 ceph-mon[124666]: pgmap v3149: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 59 KiB/s wr, 6 op/s 2023-05-08T05:20:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5792.690497 secs 2023-05-08T05:20:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5792.690497 secs 2023-05-08T05:20:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5792.690497 secs 2023-05-08T05:20:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5793.247762 secs 2023-05-08T05:20:55.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:55 smithi186 ceph-mon[126480]: pgmap v3150: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 59 KiB/s wr, 6 op/s 2023-05-08T05:20:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5793.247762 secs 2023-05-08T05:20:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:55 smithi133 ceph-mon[125939]: pgmap v3150: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 59 KiB/s wr, 6 op/s 2023-05-08T05:20:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5793.247762 secs 2023-05-08T05:20:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:55 smithi096 ceph-mon[124666]: pgmap v3150: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 59 KiB/s wr, 6 op/s 2023-05-08T05:20:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5794.528189 secs 2023-05-08T05:20:56.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5794.528189 secs 2023-05-08T05:20:56.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5794.528189 secs 2023-05-08T05:20:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:57 smithi186 ceph-mon[126480]: pgmap v3151: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 59 KiB/s wr, 9 op/s 2023-05-08T05:20:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:57 smithi133 ceph-mon[125939]: pgmap v3151: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 59 KiB/s wr, 9 op/s 2023-05-08T05:20:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:57 smithi096 ceph-mon[124666]: pgmap v3151: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 59 KiB/s wr, 9 op/s 2023-05-08T05:20:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:59 smithi186 ceph-mon[126480]: pgmap v3152: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 6 op/s 2023-05-08T05:20:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:20:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5797.690642 secs 2023-05-08T05:20:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:59 smithi133 ceph-mon[125939]: pgmap v3152: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 6 op/s 2023-05-08T05:20:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:20:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5797.690642 secs 2023-05-08T05:20:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:59 smithi096 ceph-mon[124666]: pgmap v3152: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 6 op/s 2023-05-08T05:20:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:20:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5797.690642 secs 2023-05-08T05:21:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5798.247898 secs 2023-05-08T05:21:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5798.247898 secs 2023-05-08T05:21:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5798.247898 secs 2023-05-08T05:21:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:01 smithi186 ceph-mon[126480]: pgmap v3153: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 25 KiB/s wr, 9 op/s 2023-05-08T05:21:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5799.528323 secs 2023-05-08T05:21:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:01 smithi133 ceph-mon[125939]: pgmap v3153: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 25 KiB/s wr, 9 op/s 2023-05-08T05:21:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5799.528323 secs 2023-05-08T05:21:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:01 smithi096 ceph-mon[124666]: pgmap v3153: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 25 KiB/s wr, 9 op/s 2023-05-08T05:21:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5799.528323 secs 2023-05-08T05:21:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:03 smithi186 ceph-mon[126480]: pgmap v3154: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:21:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:03 smithi133 ceph-mon[125939]: pgmap v3154: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:21:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:03 smithi096 ceph-mon[124666]: pgmap v3154: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:21:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5802.690743 secs 2023-05-08T05:21:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5802.690743 secs 2023-05-08T05:21:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5802.690743 secs 2023-05-08T05:21:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5803.248033 secs 2023-05-08T05:21:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:05 smithi186 ceph-mon[126480]: pgmap v3155: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:21:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5803.248033 secs 2023-05-08T05:21:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:05 smithi133 ceph-mon[125939]: pgmap v3155: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:21:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5803.248033 secs 2023-05-08T05:21:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:05 smithi096 ceph-mon[124666]: pgmap v3155: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:21:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5804.528388 secs 2023-05-08T05:21:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:06 smithi186 ceph-mon[126480]: osdmap e276: 12 total, 12 up, 12 in 2023-05-08T05:21:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5804.528388 secs 2023-05-08T05:21:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:06 smithi133 ceph-mon[125939]: osdmap e276: 12 total, 12 up, 12 in 2023-05-08T05:21:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5804.528388 secs 2023-05-08T05:21:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:06 smithi096 ceph-mon[124666]: osdmap e276: 12 total, 12 up, 12 in 2023-05-08T05:21:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:07 smithi186 ceph-mon[126480]: pgmap v3157: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 124 KiB/s wr, 25 op/s 2023-05-08T05:21:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:07 smithi133 ceph-mon[125939]: pgmap v3157: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 124 KiB/s wr, 25 op/s 2023-05-08T05:21:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:07 smithi096 ceph-mon[124666]: pgmap v3157: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 124 KiB/s wr, 25 op/s 2023-05-08T05:21:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:09 smithi186 ceph-mon[126480]: pgmap v3158: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 124 KiB/s wr, 25 op/s 2023-05-08T05:21:09.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5807.690864 secs 2023-05-08T05:21:09.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5808.248169 secs 2023-05-08T05:21:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:09 smithi133 ceph-mon[125939]: pgmap v3158: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 124 KiB/s wr, 25 op/s 2023-05-08T05:21:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5807.690864 secs 2023-05-08T05:21:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5808.248169 secs 2023-05-08T05:21:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:09 smithi096 ceph-mon[124666]: pgmap v3158: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 124 KiB/s wr, 25 op/s 2023-05-08T05:21:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5807.690864 secs 2023-05-08T05:21:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5808.248169 secs 2023-05-08T05:21:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:11 smithi186 ceph-mon[126480]: pgmap v3159: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 124 KiB/s wr, 25 op/s 2023-05-08T05:21:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5809.528507 secs 2023-05-08T05:21:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:11 smithi133 ceph-mon[125939]: pgmap v3159: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 124 KiB/s wr, 25 op/s 2023-05-08T05:21:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5809.528507 secs 2023-05-08T05:21:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:11 smithi096 ceph-mon[124666]: pgmap v3159: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 124 KiB/s wr, 25 op/s 2023-05-08T05:21:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5809.528507 secs 2023-05-08T05:21:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:13 smithi186 ceph-mon[126480]: pgmap v3160: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 124 KiB/s wr, 25 op/s 2023-05-08T05:21:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:13 smithi133 ceph-mon[125939]: pgmap v3160: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 124 KiB/s wr, 25 op/s 2023-05-08T05:21:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:13 smithi096 ceph-mon[124666]: pgmap v3160: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 124 KiB/s wr, 25 op/s 2023-05-08T05:21:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5812.690979 secs 2023-05-08T05:21:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5813.248313 secs 2023-05-08T05:21:14.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:14 smithi186 ceph-mon[126480]: osdmap e277: 12 total, 12 up, 12 in 2023-05-08T05:21:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5812.690979 secs 2023-05-08T05:21:14.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5813.248313 secs 2023-05-08T05:21:14.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:14 smithi133 ceph-mon[125939]: osdmap e277: 12 total, 12 up, 12 in 2023-05-08T05:21:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5812.690979 secs 2023-05-08T05:21:14.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5813.248313 secs 2023-05-08T05:21:14.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:14 smithi096 ceph-mon[124666]: osdmap e277: 12 total, 12 up, 12 in 2023-05-08T05:21:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:15 smithi186 ceph-mon[126480]: pgmap v3161: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 124 KiB/s wr, 25 op/s 2023-05-08T05:21:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:15 smithi133 ceph-mon[125939]: pgmap v3161: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 124 KiB/s wr, 25 op/s 2023-05-08T05:21:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:15 smithi096 ceph-mon[124666]: pgmap v3161: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 124 KiB/s wr, 25 op/s 2023-05-08T05:21:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5814.528613 secs 2023-05-08T05:21:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5814.528613 secs 2023-05-08T05:21:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5814.528613 secs 2023-05-08T05:21:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:17 smithi186 ceph-mon[126480]: pgmap v3163: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 KiB/s wr, 7 op/s 2023-05-08T05:21:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:17 smithi133 ceph-mon[125939]: pgmap v3163: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 KiB/s wr, 7 op/s 2023-05-08T05:21:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:17 smithi096 ceph-mon[124666]: pgmap v3163: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 KiB/s wr, 7 op/s 2023-05-08T05:21:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:19 smithi186 ceph-mon[126480]: pgmap v3164: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 KiB/s wr, 7 op/s 2023-05-08T05:21:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5817.691096 secs 2023-05-08T05:21:19.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5818.248460 secs 2023-05-08T05:21:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:19 smithi133 ceph-mon[125939]: pgmap v3164: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 KiB/s wr, 7 op/s 2023-05-08T05:21:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5817.691096 secs 2023-05-08T05:21:19.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5818.248460 secs 2023-05-08T05:21:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:19 smithi096 ceph-mon[124666]: pgmap v3164: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 KiB/s wr, 7 op/s 2023-05-08T05:21:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5817.691096 secs 2023-05-08T05:21:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5818.248460 secs 2023-05-08T05:21:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:21 smithi186 ceph-mon[126480]: pgmap v3165: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 KiB/s wr, 6 op/s 2023-05-08T05:21:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5819.528713 secs 2023-05-08T05:21:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:21 smithi133 ceph-mon[125939]: pgmap v3165: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 KiB/s wr, 6 op/s 2023-05-08T05:21:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5819.528713 secs 2023-05-08T05:21:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:21 smithi096 ceph-mon[124666]: pgmap v3165: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 KiB/s wr, 6 op/s 2023-05-08T05:21:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5819.528713 secs 2023-05-08T05:21:23.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:23 smithi186 ceph-mon[126480]: pgmap v3166: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 KiB/s wr, 6 op/s 2023-05-08T05:21:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:23 smithi133 ceph-mon[125939]: pgmap v3166: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 KiB/s wr, 6 op/s 2023-05-08T05:21:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:23 smithi096 ceph-mon[124666]: pgmap v3166: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 KiB/s wr, 6 op/s 2023-05-08T05:21:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5822.691212 secs 2023-05-08T05:21:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5823.248568 secs 2023-05-08T05:21:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5822.691212 secs 2023-05-08T05:21:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5823.248568 secs 2023-05-08T05:21:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5822.691212 secs 2023-05-08T05:21:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5823.248568 secs 2023-05-08T05:21:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:25 smithi133 ceph-mon[125939]: pgmap v3167: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 KiB/s wr, 6 op/s 2023-05-08T05:21:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:25 smithi096 ceph-mon[124666]: pgmap v3167: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 KiB/s wr, 6 op/s 2023-05-08T05:21:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:25 smithi186 ceph-mon[126480]: pgmap v3167: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 KiB/s wr, 6 op/s 2023-05-08T05:21:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5824.528836 secs 2023-05-08T05:21:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:21:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5824.528836 secs 2023-05-08T05:21:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:21:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5824.528836 secs 2023-05-08T05:21:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:21:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:27 smithi133 ceph-mon[125939]: pgmap v3168: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 30 KiB/s wr, 8 op/s 2023-05-08T05:21:27.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:21:27.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:21:27.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:21:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:27 smithi096 ceph-mon[124666]: pgmap v3168: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 30 KiB/s wr, 8 op/s 2023-05-08T05:21:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:21:27.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:21:27.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:21:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:27 smithi186 ceph-mon[126480]: pgmap v3168: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 30 KiB/s wr, 8 op/s 2023-05-08T05:21:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:21:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:21:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:21:28.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:28 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:21:28.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:28 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T05:21:28.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:28 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T05:21:28.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:28 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:21:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:28 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:21:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:28 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T05:21:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:28 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T05:21:28.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:28 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:21:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:28 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:21:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:28 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T05:21:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:28 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T05:21:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:28 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:21:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:29 smithi133 ceph-mon[125939]: pgmap v3169: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:21:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5827.691370 secs 2023-05-08T05:21:29.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5828.248690 secs 2023-05-08T05:21:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:29 smithi096 ceph-mon[124666]: pgmap v3169: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:21:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5827.691370 secs 2023-05-08T05:21:29.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5828.248690 secs 2023-05-08T05:21:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:29 smithi186 ceph-mon[126480]: pgmap v3169: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:21:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5827.691370 secs 2023-05-08T05:21:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5828.248690 secs 2023-05-08T05:21:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:31 smithi133 ceph-mon[125939]: pgmap v3170: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T05:21:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5829.528925 secs 2023-05-08T05:21:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:31 smithi096 ceph-mon[124666]: pgmap v3170: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T05:21:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5829.528925 secs 2023-05-08T05:21:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:31 smithi186 ceph-mon[126480]: pgmap v3170: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T05:21:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5829.528925 secs 2023-05-08T05:21:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:33 smithi133 ceph-mon[125939]: pgmap v3171: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:21:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:33 smithi096 ceph-mon[124666]: pgmap v3171: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:21:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:33 smithi186 ceph-mon[126480]: pgmap v3171: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:21:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5832.691490 secs 2023-05-08T05:21:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5833.248807 secs 2023-05-08T05:21:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5832.691490 secs 2023-05-08T05:21:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5833.248807 secs 2023-05-08T05:21:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5832.691490 secs 2023-05-08T05:21:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5833.248807 secs 2023-05-08T05:21:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:35 smithi133 ceph-mon[125939]: pgmap v3172: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:21:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:35 smithi096 ceph-mon[124666]: pgmap v3172: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:21:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:35 smithi186 ceph-mon[126480]: pgmap v3172: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T05:21:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:37 smithi133 ceph-mon[125939]: pgmap v3173: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 101 KiB/s wr, 8 op/s 2023-05-08T05:21:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:37 smithi096 ceph-mon[124666]: pgmap v3173: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 101 KiB/s wr, 8 op/s 2023-05-08T05:21:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:37 smithi186 ceph-mon[126480]: pgmap v3173: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 101 KiB/s wr, 8 op/s 2023-05-08T05:21:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:38 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:21:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:38 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:21:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:38 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:21:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:39 smithi133 ceph-mon[125939]: pgmap v3174: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 101 KiB/s wr, 6 op/s 2023-05-08T05:21:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5837.691585 secs 2023-05-08T05:21:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:39 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:21:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:39 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:21:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:39 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:21:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5838.248904 secs 2023-05-08T05:21:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:39 smithi096 ceph-mon[124666]: pgmap v3174: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 101 KiB/s wr, 6 op/s 2023-05-08T05:21:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5837.691585 secs 2023-05-08T05:21:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:39 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:21:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:39 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:21:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:39 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:21:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5838.248904 secs 2023-05-08T05:21:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:39 smithi186 ceph-mon[126480]: pgmap v3174: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 101 KiB/s wr, 6 op/s 2023-05-08T05:21:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5837.691585 secs 2023-05-08T05:21:39.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:39 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:21:39.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:39 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:21:39.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:39 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:21:39.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5838.248904 secs 2023-05-08T05:21:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:41 smithi133 ceph-mon[125939]: pgmap v3175: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 155 KiB/s wr, 10 op/s 2023-05-08T05:21:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5839.529174 secs 2023-05-08T05:21:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:41 smithi096 ceph-mon[124666]: pgmap v3175: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 155 KiB/s wr, 10 op/s 2023-05-08T05:21:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5839.529174 secs 2023-05-08T05:21:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:41 smithi186 ceph-mon[126480]: pgmap v3175: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 155 KiB/s wr, 10 op/s 2023-05-08T05:21:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5839.529174 secs 2023-05-08T05:21:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:43 smithi133 ceph-mon[125939]: pgmap v3176: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 155 KiB/s wr, 7 op/s 2023-05-08T05:21:43.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:21:43.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:21:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:43 smithi096 ceph-mon[124666]: pgmap v3176: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 155 KiB/s wr, 7 op/s 2023-05-08T05:21:43.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:21:43.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:21:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:43 smithi186 ceph-mon[126480]: pgmap v3176: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 155 KiB/s wr, 7 op/s 2023-05-08T05:21:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:21:43.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:21:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5842.691707 secs 2023-05-08T05:21:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5843.249003 secs 2023-05-08T05:21:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:44 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:21:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5842.691707 secs 2023-05-08T05:21:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5843.249003 secs 2023-05-08T05:21:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:44 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:21:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5842.691707 secs 2023-05-08T05:21:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5843.249003 secs 2023-05-08T05:21:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:44 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:21:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:45 smithi133 ceph-mon[125939]: pgmap v3177: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 155 KiB/s wr, 7 op/s 2023-05-08T05:21:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:45 smithi096 ceph-mon[124666]: pgmap v3177: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 155 KiB/s wr, 7 op/s 2023-05-08T05:21:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:45 smithi186 ceph-mon[126480]: pgmap v3177: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 155 KiB/s wr, 7 op/s 2023-05-08T05:21:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5844.529240 secs 2023-05-08T05:21:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5844.529240 secs 2023-05-08T05:21:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5844.529240 secs 2023-05-08T05:21:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:47 smithi133 ceph-mon[125939]: pgmap v3178: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 194 KiB/s wr, 11 op/s 2023-05-08T05:21:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:47 smithi096 ceph-mon[124666]: pgmap v3178: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 194 KiB/s wr, 11 op/s 2023-05-08T05:21:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:47 smithi186 ceph-mon[126480]: pgmap v3178: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 194 KiB/s wr, 11 op/s 2023-05-08T05:21:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:49 smithi133 ceph-mon[125939]: pgmap v3179: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 93 KiB/s wr, 7 op/s 2023-05-08T05:21:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5847.691792 secs 2023-05-08T05:21:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5848.249125 secs 2023-05-08T05:21:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:49 smithi096 ceph-mon[124666]: pgmap v3179: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 93 KiB/s wr, 7 op/s 2023-05-08T05:21:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5847.691792 secs 2023-05-08T05:21:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5848.249125 secs 2023-05-08T05:21:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:49 smithi186 ceph-mon[126480]: pgmap v3179: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 93 KiB/s wr, 7 op/s 2023-05-08T05:21:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5847.691792 secs 2023-05-08T05:21:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5848.249125 secs 2023-05-08T05:21:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:51 smithi133 ceph-mon[125939]: pgmap v3180: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 93 KiB/s wr, 10 op/s 2023-05-08T05:21:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5849.529359 secs 2023-05-08T05:21:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:51 smithi096 ceph-mon[124666]: pgmap v3180: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 93 KiB/s wr, 10 op/s 2023-05-08T05:21:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5849.529359 secs 2023-05-08T05:21:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:51 smithi186 ceph-mon[126480]: pgmap v3180: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 93 KiB/s wr, 10 op/s 2023-05-08T05:21:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5849.529359 secs 2023-05-08T05:21:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:53 smithi133 ceph-mon[125939]: pgmap v3181: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 39 KiB/s wr, 6 op/s 2023-05-08T05:21:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:53 smithi096 ceph-mon[124666]: pgmap v3181: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 39 KiB/s wr, 6 op/s 2023-05-08T05:21:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:53 smithi186 ceph-mon[126480]: pgmap v3181: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 39 KiB/s wr, 6 op/s 2023-05-08T05:21:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5852.691909 secs 2023-05-08T05:21:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5853.249253 secs 2023-05-08T05:21:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5852.691909 secs 2023-05-08T05:21:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5853.249253 secs 2023-05-08T05:21:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5852.691909 secs 2023-05-08T05:21:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5853.249253 secs 2023-05-08T05:21:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:55 smithi133 ceph-mon[125939]: pgmap v3182: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 39 KiB/s wr, 6 op/s 2023-05-08T05:21:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:55 smithi096 ceph-mon[124666]: pgmap v3182: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 39 KiB/s wr, 6 op/s 2023-05-08T05:21:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:55 smithi186 ceph-mon[126480]: pgmap v3182: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 39 KiB/s wr, 6 op/s 2023-05-08T05:21:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5854.529499 secs 2023-05-08T05:21:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5854.529499 secs 2023-05-08T05:21:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5854.529499 secs 2023-05-08T05:21:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:57 smithi133 ceph-mon[125939]: pgmap v3183: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 39 KiB/s wr, 9 op/s 2023-05-08T05:21:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:57 smithi096 ceph-mon[124666]: pgmap v3183: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 39 KiB/s wr, 9 op/s 2023-05-08T05:21:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:57 smithi186 ceph-mon[126480]: pgmap v3183: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 39 KiB/s wr, 9 op/s 2023-05-08T05:21:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:58 smithi133 ceph-mon[125939]: pgmap v3184: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:21:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:58 smithi096 ceph-mon[124666]: pgmap v3184: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:21:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:58 smithi186 ceph-mon[126480]: pgmap v3184: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:21:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5857.692032 secs 2023-05-08T05:21:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:21:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5858.249384 secs 2023-05-08T05:21:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5857.692032 secs 2023-05-08T05:21:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:21:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5858.249384 secs 2023-05-08T05:21:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5857.692032 secs 2023-05-08T05:21:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:21:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5858.249384 secs 2023-05-08T05:22:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:00 smithi133 ceph-mon[125939]: pgmap v3185: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T05:22:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:00 smithi096 ceph-mon[124666]: pgmap v3185: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T05:22:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:00 smithi186 ceph-mon[126480]: pgmap v3185: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T05:22:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5859.529635 secs 2023-05-08T05:22:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5859.529635 secs 2023-05-08T05:22:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5859.529635 secs 2023-05-08T05:22:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:02 smithi133 ceph-mon[125939]: pgmap v3186: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:22:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:02 smithi096 ceph-mon[124666]: pgmap v3186: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:22:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:02 smithi186 ceph-mon[126480]: pgmap v3186: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:22:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5862.692096 secs 2023-05-08T05:22:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5862.692096 secs 2023-05-08T05:22:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5862.692096 secs 2023-05-08T05:22:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5863.249484 secs 2023-05-08T05:22:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:05 smithi186 ceph-mon[126480]: pgmap v3187: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:22:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5863.249484 secs 2023-05-08T05:22:05.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:05 smithi133 ceph-mon[125939]: pgmap v3187: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:22:05.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5863.249484 secs 2023-05-08T05:22:05.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:05 smithi096 ceph-mon[124666]: pgmap v3187: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T05:22:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5864.529760 secs 2023-05-08T05:22:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:06 smithi186 ceph-mon[126480]: osdmap e278: 12 total, 12 up, 12 in 2023-05-08T05:22:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5864.529760 secs 2023-05-08T05:22:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:06 smithi133 ceph-mon[125939]: osdmap e278: 12 total, 12 up, 12 in 2023-05-08T05:22:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5864.529760 secs 2023-05-08T05:22:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:06 smithi096 ceph-mon[124666]: osdmap e278: 12 total, 12 up, 12 in 2023-05-08T05:22:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:07 smithi186 ceph-mon[126480]: pgmap v3189: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 124 KiB/s wr, 25 op/s 2023-05-08T05:22:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:07 smithi133 ceph-mon[125939]: pgmap v3189: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 124 KiB/s wr, 25 op/s 2023-05-08T05:22:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:07 smithi096 ceph-mon[124666]: pgmap v3189: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 124 KiB/s wr, 25 op/s 2023-05-08T05:22:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:09 smithi186 ceph-mon[126480]: pgmap v3190: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 124 KiB/s wr, 25 op/s 2023-05-08T05:22:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5867.692191 secs 2023-05-08T05:22:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:09 smithi133 ceph-mon[125939]: pgmap v3190: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 124 KiB/s wr, 25 op/s 2023-05-08T05:22:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5867.692191 secs 2023-05-08T05:22:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:09 smithi096 ceph-mon[124666]: pgmap v3190: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 124 KiB/s wr, 25 op/s 2023-05-08T05:22:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5867.692191 secs 2023-05-08T05:22:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5868.249602 secs 2023-05-08T05:22:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5868.249602 secs 2023-05-08T05:22:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5868.249602 secs 2023-05-08T05:22:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:11 smithi186 ceph-mon[126480]: pgmap v3191: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 166 KiB/s wr, 26 op/s 2023-05-08T05:22:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5869.529880 secs 2023-05-08T05:22:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:11 smithi133 ceph-mon[125939]: pgmap v3191: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 166 KiB/s wr, 26 op/s 2023-05-08T05:22:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5869.529880 secs 2023-05-08T05:22:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:11 smithi096 ceph-mon[124666]: pgmap v3191: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 166 KiB/s wr, 26 op/s 2023-05-08T05:22:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5869.529880 secs 2023-05-08T05:22:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:13 smithi186 ceph-mon[126480]: pgmap v3192: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 166 KiB/s wr, 26 op/s 2023-05-08T05:22:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:13 smithi133 ceph-mon[125939]: pgmap v3192: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 166 KiB/s wr, 26 op/s 2023-05-08T05:22:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:13 smithi096 ceph-mon[124666]: pgmap v3192: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 166 KiB/s wr, 26 op/s 2023-05-08T05:22:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5872.692310 secs 2023-05-08T05:22:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:14 smithi186 ceph-mon[126480]: osdmap e279: 12 total, 12 up, 12 in 2023-05-08T05:22:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5872.692310 secs 2023-05-08T05:22:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:14 smithi133 ceph-mon[125939]: osdmap e279: 12 total, 12 up, 12 in 2023-05-08T05:22:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5872.692310 secs 2023-05-08T05:22:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:14 smithi096 ceph-mon[124666]: osdmap e279: 12 total, 12 up, 12 in 2023-05-08T05:22:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5873.249672 secs 2023-05-08T05:22:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:15 smithi186 ceph-mon[126480]: pgmap v3193: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 166 KiB/s wr, 26 op/s 2023-05-08T05:22:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5873.249672 secs 2023-05-08T05:22:15.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:15 smithi133 ceph-mon[125939]: pgmap v3193: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 166 KiB/s wr, 26 op/s 2023-05-08T05:22:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5873.249672 secs 2023-05-08T05:22:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:15 smithi096 ceph-mon[124666]: pgmap v3193: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 166 KiB/s wr, 26 op/s 2023-05-08T05:22:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5874.529979 secs 2023-05-08T05:22:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5874.529979 secs 2023-05-08T05:22:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5874.529979 secs 2023-05-08T05:22:17.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:17 smithi186 ceph-mon[126480]: pgmap v3195: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 141 KiB/s wr, 10 op/s 2023-05-08T05:22:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:17 smithi133 ceph-mon[125939]: pgmap v3195: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 141 KiB/s wr, 10 op/s 2023-05-08T05:22:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:17 smithi096 ceph-mon[124666]: pgmap v3195: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 141 KiB/s wr, 10 op/s 2023-05-08T05:22:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:19 smithi186 ceph-mon[126480]: pgmap v3196: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 141 KiB/s wr, 10 op/s 2023-05-08T05:22:19.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5877.692473 secs 2023-05-08T05:22:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:19 smithi133 ceph-mon[125939]: pgmap v3196: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 141 KiB/s wr, 10 op/s 2023-05-08T05:22:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5877.692473 secs 2023-05-08T05:22:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:19 smithi096 ceph-mon[124666]: pgmap v3196: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 141 KiB/s wr, 10 op/s 2023-05-08T05:22:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5877.692473 secs 2023-05-08T05:22:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5878.249738 secs 2023-05-08T05:22:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5878.249738 secs 2023-05-08T05:22:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5878.249738 secs 2023-05-08T05:22:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:21 smithi186 ceph-mon[126480]: pgmap v3197: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 152 KiB/s wr, 11 op/s 2023-05-08T05:22:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:21 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:22:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:21 smithi133 ceph-mon[125939]: pgmap v3197: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 152 KiB/s wr, 11 op/s 2023-05-08T05:22:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:21 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:22:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:21 smithi096 ceph-mon[124666]: pgmap v3197: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 152 KiB/s wr, 11 op/s 2023-05-08T05:22:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:21 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:22:22.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:22 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:22:22.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:22 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:22:22.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:22 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:22:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:23 smithi133 ceph-mon[125939]: pgmap v3198: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 152 KiB/s wr, 11 op/s 2023-05-08T05:22:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:23 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:22:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:23 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:22:23.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:23 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:22:23.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:23 smithi096 ceph-mon[124666]: pgmap v3198: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 152 KiB/s wr, 11 op/s 2023-05-08T05:22:23.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:23 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:22:23.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:23 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:22:23.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:23 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:22:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:23 smithi186 ceph-mon[126480]: pgmap v3198: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 152 KiB/s wr, 11 op/s 2023-05-08T05:22:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:23 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:22:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:23 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:22:23.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:23 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:22:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5882.692590 secs 2023-05-08T05:22:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5882.692590 secs 2023-05-08T05:22:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5882.692590 secs 2023-05-08T05:22:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5883.249851 secs 2023-05-08T05:22:25.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:25 smithi133 ceph-mon[125939]: pgmap v3199: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 152 KiB/s wr, 11 op/s 2023-05-08T05:22:25.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5883.249851 secs 2023-05-08T05:22:25.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:25 smithi096 ceph-mon[124666]: pgmap v3199: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 152 KiB/s wr, 11 op/s 2023-05-08T05:22:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5883.249851 secs 2023-05-08T05:22:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:25 smithi186 ceph-mon[126480]: pgmap v3199: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 152 KiB/s wr, 11 op/s 2023-05-08T05:22:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:26 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:22:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:26 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:22:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:26 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:22:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:27 smithi133 ceph-mon[125939]: pgmap v3200: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 252 KiB/s wr, 14 op/s 2023-05-08T05:22:27.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:22:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:27 smithi096 ceph-mon[124666]: pgmap v3200: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 252 KiB/s wr, 14 op/s 2023-05-08T05:22:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:22:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:27 smithi186 ceph-mon[126480]: pgmap v3200: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 252 KiB/s wr, 14 op/s 2023-05-08T05:22:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:22:28.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:28 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:22:28.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:28 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:22:28.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:28 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:22:28.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:28 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:22:28.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:28 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:22:28.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:28 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:22:28.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:28 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:22:28.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:28 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:22:28.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:28 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:22:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:29 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:22:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:29 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T05:22:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:29 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T05:22:29.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:29 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:22:29.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:29 smithi133 ceph-mon[125939]: pgmap v3201: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 164 KiB/s wr, 9 op/s 2023-05-08T05:22:29.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5887.692701 secs 2023-05-08T05:22:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:29 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:22:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:29 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T05:22:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:29 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T05:22:29.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:29 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:22:29.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:29 smithi096 ceph-mon[124666]: pgmap v3201: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 164 KiB/s wr, 9 op/s 2023-05-08T05:22:29.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5887.692701 secs 2023-05-08T05:22:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:29 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:22:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:29 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T05:22:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:29 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T05:22:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:29 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:22:29.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:29 smithi186 ceph-mon[126480]: pgmap v3201: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 164 KiB/s wr, 9 op/s 2023-05-08T05:22:29.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5887.692701 secs 2023-05-08T05:22:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:30 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:22:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:30 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:22:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:30 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:22:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:30 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:22:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:30 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:22:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:30 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:22:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5889.530286 secs 2023-05-08T05:22:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:31 smithi133 ceph-mon[125939]: pgmap v3202: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 248 KiB/s wr, 15 op/s 2023-05-08T05:22:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:31 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:22:31.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:31 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:22:31.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:31 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:22:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5889.530286 secs 2023-05-08T05:22:31.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:31 smithi096 ceph-mon[124666]: pgmap v3202: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 248 KiB/s wr, 15 op/s 2023-05-08T05:22:31.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:31 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:22:31.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:31 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:22:31.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:31 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:22:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5889.530286 secs 2023-05-08T05:22:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:31 smithi186 ceph-mon[126480]: pgmap v3202: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 248 KiB/s wr, 15 op/s 2023-05-08T05:22:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:31 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:22:31.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:31 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:22:31.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:31 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:22:33.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:33 smithi133 ceph-mon[125939]: pgmap v3203: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 203 KiB/s wr, 11 op/s 2023-05-08T05:22:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:33 smithi096 ceph-mon[124666]: pgmap v3203: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 203 KiB/s wr, 11 op/s 2023-05-08T05:22:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:33 smithi186 ceph-mon[126480]: pgmap v3203: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 203 KiB/s wr, 11 op/s 2023-05-08T05:22:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:34 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:22:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:34 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:22:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:34 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:22:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:35 smithi133 ceph-mon[125939]: pgmap v3204: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 203 KiB/s wr, 11 op/s 2023-05-08T05:22:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:35 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:22:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:35 smithi096 ceph-mon[124666]: pgmap v3204: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 203 KiB/s wr, 11 op/s 2023-05-08T05:22:35.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:35 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:22:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:35 smithi186 ceph-mon[126480]: pgmap v3204: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 203 KiB/s wr, 11 op/s 2023-05-08T05:22:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:35 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:22:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:37 smithi133 ceph-mon[125939]: pgmap v3205: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 700 KiB/s rd, 697 KiB/s wr, 20 op/s 2023-05-08T05:22:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:37 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:22:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:37 smithi096 ceph-mon[124666]: pgmap v3205: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 700 KiB/s rd, 697 KiB/s wr, 20 op/s 2023-05-08T05:22:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:37 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:22:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:37 smithi186 ceph-mon[126480]: pgmap v3205: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 700 KiB/s rd, 697 KiB/s wr, 20 op/s 2023-05-08T05:22:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:37 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:22:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:38 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:22:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:38 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T05:22:38.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:38 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:22:38.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:38 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:22:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:38 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:22:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:38 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T05:22:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:38 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:22:38.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:38 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:22:38.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:38 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:22:38.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:38 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T05:22:38.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:38 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:22:38.642 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:38 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:22:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:39 smithi133 ceph-mon[125939]: pgmap v3206: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 584 KiB/s rd, 577 KiB/s wr, 15 op/s 2023-05-08T05:22:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5897.692966 secs 2023-05-08T05:22:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:39 smithi133 ceph-mon[125939]: Health check cleared: MDS_SLOW_REQUEST (was: 1 MDSs report slow requests) 2023-05-08T05:22:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:39 smithi133 ceph-mon[125939]: Cluster is now healthy 2023-05-08T05:22:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:39 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:22:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:39 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:22:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:39 smithi096 ceph-mon[124666]: pgmap v3206: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 584 KiB/s rd, 577 KiB/s wr, 15 op/s 2023-05-08T05:22:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5897.692966 secs 2023-05-08T05:22:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:39 smithi096 ceph-mon[124666]: Health check cleared: MDS_SLOW_REQUEST (was: 1 MDSs report slow requests) 2023-05-08T05:22:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:39 smithi096 ceph-mon[124666]: Cluster is now healthy 2023-05-08T05:22:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:39 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:22:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:39 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:22:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:39 smithi186 ceph-mon[126480]: pgmap v3206: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 584 KiB/s rd, 577 KiB/s wr, 15 op/s 2023-05-08T05:22:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5897.692966 secs 2023-05-08T05:22:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:39 smithi186 ceph-mon[126480]: Health check cleared: MDS_SLOW_REQUEST (was: 1 MDSs report slow requests) 2023-05-08T05:22:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:39 smithi186 ceph-mon[126480]: Cluster is now healthy 2023-05-08T05:22:39.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:39 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:22:39.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:39 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:22:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5899.530537 secs 2023-05-08T05:22:41.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:41 smithi133 ceph-mon[125939]: pgmap v3207: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 791 KiB/s rd, 789 KiB/s wr, 22 op/s 2023-05-08T05:22:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5899.530537 secs 2023-05-08T05:22:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:41 smithi096 ceph-mon[124666]: pgmap v3207: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 791 KiB/s rd, 789 KiB/s wr, 22 op/s 2023-05-08T05:22:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5899.530537 secs 2023-05-08T05:22:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:41 smithi186 ceph-mon[126480]: pgmap v3207: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 791 KiB/s rd, 789 KiB/s wr, 22 op/s 2023-05-08T05:22:42.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:42 smithi133 ceph-mon[125939]: Health check failed: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:22:42.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:42 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T05:22:42.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:42 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:22:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:42 smithi096 ceph-mon[124666]: Health check failed: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:22:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:42 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T05:22:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:42 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:22:42.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:42 smithi186 ceph-mon[126480]: Health check failed: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:22:42.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:42 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T05:22:42.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:42 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:22:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:43 smithi133 ceph-mon[125939]: pgmap v3208: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 712 KiB/s rd, 705 KiB/s wr, 16 op/s 2023-05-08T05:22:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:22:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:22:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:43 smithi096 ceph-mon[124666]: pgmap v3208: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 712 KiB/s rd, 705 KiB/s wr, 16 op/s 2023-05-08T05:22:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:22:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:22:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:43 smithi186 ceph-mon[126480]: pgmap v3208: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 712 KiB/s rd, 705 KiB/s wr, 16 op/s 2023-05-08T05:22:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:22:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:22:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5902.693093 secs 2023-05-08T05:22:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5902.693093 secs 2023-05-08T05:22:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5902.693093 secs 2023-05-08T05:22:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:45 smithi133 ceph-mon[125939]: pgmap v3209: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 712 KiB/s rd, 705 KiB/s wr, 16 op/s 2023-05-08T05:22:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:45 smithi096 ceph-mon[124666]: pgmap v3209: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 712 KiB/s rd, 705 KiB/s wr, 16 op/s 2023-05-08T05:22:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:45 smithi186 ceph-mon[126480]: pgmap v3209: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 712 KiB/s rd, 705 KiB/s wr, 16 op/s 2023-05-08T05:22:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5904.530685 secs 2023-05-08T05:22:46.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5904.530685 secs 2023-05-08T05:22:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5904.530685 secs 2023-05-08T05:22:47.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:47 smithi096 ceph-mon[124666]: pgmap v3210: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 756 KiB/s rd, 754 KiB/s wr, 22 op/s 2023-05-08T05:22:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:47 smithi186 ceph-mon[126480]: pgmap v3210: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 756 KiB/s rd, 754 KiB/s wr, 22 op/s 2023-05-08T05:22:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:47 smithi133 ceph-mon[125939]: pgmap v3210: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 756 KiB/s rd, 754 KiB/s wr, 22 op/s 2023-05-08T05:22:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:49 smithi096 ceph-mon[124666]: pgmap v3211: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 261 KiB/s wr, 12 op/s 2023-05-08T05:22:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5907.693224 secs 2023-05-08T05:22:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:22:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:49 smithi186 ceph-mon[126480]: pgmap v3211: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 261 KiB/s wr, 12 op/s 2023-05-08T05:22:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5907.693224 secs 2023-05-08T05:22:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:22:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:49 smithi133 ceph-mon[125939]: pgmap v3211: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 261 KiB/s wr, 12 op/s 2023-05-08T05:22:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5907.693224 secs 2023-05-08T05:22:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:22:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5909.530822 secs 2023-05-08T05:22:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:51 smithi096 ceph-mon[124666]: pgmap v3212: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 332 KiB/s wr, 17 op/s 2023-05-08T05:22:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5909.530822 secs 2023-05-08T05:22:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:51 smithi186 ceph-mon[126480]: pgmap v3212: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 332 KiB/s wr, 17 op/s 2023-05-08T05:22:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5909.530822 secs 2023-05-08T05:22:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:51 smithi133 ceph-mon[125939]: pgmap v3212: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 332 KiB/s wr, 17 op/s 2023-05-08T05:22:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:53 smithi096 ceph-mon[124666]: pgmap v3213: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 120 KiB/s wr, 10 op/s 2023-05-08T05:22:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:53 smithi186 ceph-mon[126480]: pgmap v3213: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 120 KiB/s wr, 10 op/s 2023-05-08T05:22:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:53 smithi133 ceph-mon[125939]: pgmap v3213: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 120 KiB/s wr, 10 op/s 2023-05-08T05:22:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5912.693318 secs 2023-05-08T05:22:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5912.693318 secs 2023-05-08T05:22:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5912.693318 secs 2023-05-08T05:22:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5913.250528 secs 2023-05-08T05:22:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:55 smithi186 ceph-mon[126480]: pgmap v3214: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 120 KiB/s wr, 10 op/s 2023-05-08T05:22:55.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:55 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:22:55.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:55 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:22:55.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:55 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:22:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5913.250528 secs 2023-05-08T05:22:55.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:55 smithi133 ceph-mon[125939]: pgmap v3214: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 120 KiB/s wr, 10 op/s 2023-05-08T05:22:55.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:55 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:22:55.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:55 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:22:55.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:55 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:22:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5913.250528 secs 2023-05-08T05:22:55.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:55 smithi096 ceph-mon[124666]: pgmap v3214: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 120 KiB/s wr, 10 op/s 2023-05-08T05:22:55.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:55 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:22:55.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:55 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:22:55.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:55 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:22:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5914.530947 secs 2023-05-08T05:22:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5914.530947 secs 2023-05-08T05:22:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5914.530947 secs 2023-05-08T05:22:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:57 smithi186 ceph-mon[126480]: pgmap v3215: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 147 KiB/s wr, 14 op/s 2023-05-08T05:22:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:57 smithi133 ceph-mon[125939]: pgmap v3215: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 147 KiB/s wr, 14 op/s 2023-05-08T05:22:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:57 smithi096 ceph-mon[124666]: pgmap v3215: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 147 KiB/s wr, 14 op/s 2023-05-08T05:22:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:59 smithi186 ceph-mon[126480]: pgmap v3216: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 99 KiB/s wr, 8 op/s 2023-05-08T05:22:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:22:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5917.693397 secs 2023-05-08T05:22:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:59 smithi133 ceph-mon[125939]: pgmap v3216: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 99 KiB/s wr, 8 op/s 2023-05-08T05:22:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:22:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5917.693397 secs 2023-05-08T05:22:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:59 smithi096 ceph-mon[124666]: pgmap v3216: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 99 KiB/s wr, 8 op/s 2023-05-08T05:22:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:22:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5917.693397 secs 2023-05-08T05:23:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5918.250669 secs 2023-05-08T05:23:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5918.250669 secs 2023-05-08T05:23:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5918.250669 secs 2023-05-08T05:23:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5919.531022 secs 2023-05-08T05:23:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:01 smithi186 ceph-mon[126480]: pgmap v3217: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 128 KiB/s wr, 11 op/s 2023-05-08T05:23:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5919.531022 secs 2023-05-08T05:23:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:01 smithi133 ceph-mon[125939]: pgmap v3217: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 128 KiB/s wr, 11 op/s 2023-05-08T05:23:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5919.531022 secs 2023-05-08T05:23:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:01 smithi096 ceph-mon[124666]: pgmap v3217: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 128 KiB/s wr, 11 op/s 2023-05-08T05:23:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:03 smithi186 ceph-mon[126480]: pgmap v3218: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 57 KiB/s wr, 6 op/s 2023-05-08T05:23:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:03 smithi133 ceph-mon[125939]: pgmap v3218: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 57 KiB/s wr, 6 op/s 2023-05-08T05:23:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:03 smithi096 ceph-mon[124666]: pgmap v3218: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 57 KiB/s wr, 6 op/s 2023-05-08T05:23:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5922.693518 secs 2023-05-08T05:23:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5922.693518 secs 2023-05-08T05:23:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5922.693518 secs 2023-05-08T05:23:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5923.250790 secs 2023-05-08T05:23:05.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:05 smithi186 ceph-mon[126480]: pgmap v3219: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 57 KiB/s wr, 6 op/s 2023-05-08T05:23:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5923.250790 secs 2023-05-08T05:23:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:05 smithi133 ceph-mon[125939]: pgmap v3219: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 57 KiB/s wr, 6 op/s 2023-05-08T05:23:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5923.250790 secs 2023-05-08T05:23:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:05 smithi096 ceph-mon[124666]: pgmap v3219: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 57 KiB/s wr, 6 op/s 2023-05-08T05:23:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5924.531141 secs 2023-05-08T05:23:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5924.531141 secs 2023-05-08T05:23:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5924.531141 secs 2023-05-08T05:23:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:07 smithi186 ceph-mon[126480]: pgmap v3220: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 103 KiB/s wr, 24 op/s 2023-05-08T05:23:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:07 smithi133 ceph-mon[125939]: pgmap v3220: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 103 KiB/s wr, 24 op/s 2023-05-08T05:23:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:07 smithi096 ceph-mon[124666]: pgmap v3220: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 103 KiB/s wr, 24 op/s 2023-05-08T05:23:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:09 smithi186 ceph-mon[126480]: pgmap v3221: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 76 KiB/s wr, 20 op/s 2023-05-08T05:23:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5927.693603 secs 2023-05-08T05:23:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:09 smithi133 ceph-mon[125939]: pgmap v3221: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 76 KiB/s wr, 20 op/s 2023-05-08T05:23:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5927.693603 secs 2023-05-08T05:23:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:09 smithi096 ceph-mon[124666]: pgmap v3221: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 76 KiB/s wr, 20 op/s 2023-05-08T05:23:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5927.693603 secs 2023-05-08T05:23:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5928.250912 secs 2023-05-08T05:23:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5928.250912 secs 2023-05-08T05:23:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5928.250912 secs 2023-05-08T05:23:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5929.531202 secs 2023-05-08T05:23:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:11 smithi186 ceph-mon[126480]: pgmap v3222: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 174 KiB/s wr, 25 op/s 2023-05-08T05:23:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:11 smithi186 ceph-mon[126480]: osdmap e280: 12 total, 12 up, 12 in 2023-05-08T05:23:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5929.531202 secs 2023-05-08T05:23:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:11 smithi133 ceph-mon[125939]: pgmap v3222: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 174 KiB/s wr, 25 op/s 2023-05-08T05:23:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:11 smithi133 ceph-mon[125939]: osdmap e280: 12 total, 12 up, 12 in 2023-05-08T05:23:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5929.531202 secs 2023-05-08T05:23:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:11 smithi096 ceph-mon[124666]: pgmap v3222: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 174 KiB/s wr, 25 op/s 2023-05-08T05:23:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:11 smithi096 ceph-mon[124666]: osdmap e280: 12 total, 12 up, 12 in 2023-05-08T05:23:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:13 smithi186 ceph-mon[126480]: pgmap v3224: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 174 KiB/s wr, 26 op/s 2023-05-08T05:23:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:13 smithi133 ceph-mon[125939]: pgmap v3224: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 174 KiB/s wr, 26 op/s 2023-05-08T05:23:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:13 smithi096 ceph-mon[124666]: pgmap v3224: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 174 KiB/s wr, 26 op/s 2023-05-08T05:23:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5932.693679 secs 2023-05-08T05:23:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5932.693679 secs 2023-05-08T05:23:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5932.693679 secs 2023-05-08T05:23:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5933.251029 secs 2023-05-08T05:23:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:15 smithi186 ceph-mon[126480]: pgmap v3225: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 174 KiB/s wr, 26 op/s 2023-05-08T05:23:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5933.251029 secs 2023-05-08T05:23:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:15 smithi133 ceph-mon[125939]: pgmap v3225: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 174 KiB/s wr, 26 op/s 2023-05-08T05:23:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5933.251029 secs 2023-05-08T05:23:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:15 smithi096 ceph-mon[124666]: pgmap v3225: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 174 KiB/s wr, 26 op/s 2023-05-08T05:23:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5934.531307 secs 2023-05-08T05:23:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5934.531307 secs 2023-05-08T05:23:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5934.531307 secs 2023-05-08T05:23:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:17 smithi186 ceph-mon[126480]: pgmap v3226: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 216 KiB/s wr, 12 op/s 2023-05-08T05:23:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:17 smithi133 ceph-mon[125939]: pgmap v3226: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 216 KiB/s wr, 12 op/s 2023-05-08T05:23:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:17 smithi096 ceph-mon[124666]: pgmap v3226: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 216 KiB/s wr, 12 op/s 2023-05-08T05:23:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:19 smithi186 ceph-mon[126480]: pgmap v3227: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 216 KiB/s wr, 12 op/s 2023-05-08T05:23:19.654 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5937.693838 secs 2023-05-08T05:23:19.654 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5938.251169 secs 2023-05-08T05:23:19.655 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:19 smithi186 ceph-mon[126480]: osdmap e281: 12 total, 12 up, 12 in 2023-05-08T05:23:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:19 smithi133 ceph-mon[125939]: pgmap v3227: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 216 KiB/s wr, 12 op/s 2023-05-08T05:23:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5937.693838 secs 2023-05-08T05:23:19.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5938.251169 secs 2023-05-08T05:23:19.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:19 smithi133 ceph-mon[125939]: osdmap e281: 12 total, 12 up, 12 in 2023-05-08T05:23:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:19 smithi096 ceph-mon[124666]: pgmap v3227: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 216 KiB/s wr, 12 op/s 2023-05-08T05:23:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5937.693838 secs 2023-05-08T05:23:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5938.251169 secs 2023-05-08T05:23:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:19 smithi096 ceph-mon[124666]: osdmap e281: 12 total, 12 up, 12 in 2023-05-08T05:23:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5939.531430 secs 2023-05-08T05:23:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:21 smithi186 ceph-mon[126480]: pgmap v3229: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 244 KiB/s wr, 14 op/s 2023-05-08T05:23:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5939.531430 secs 2023-05-08T05:23:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:21 smithi133 ceph-mon[125939]: pgmap v3229: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 244 KiB/s wr, 14 op/s 2023-05-08T05:23:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5939.531430 secs 2023-05-08T05:23:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:21 smithi096 ceph-mon[124666]: pgmap v3229: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 244 KiB/s wr, 14 op/s 2023-05-08T05:23:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:23 smithi186 ceph-mon[126480]: pgmap v3230: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 232 KiB/s wr, 13 op/s 2023-05-08T05:23:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:23 smithi133 ceph-mon[125939]: pgmap v3230: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 232 KiB/s wr, 13 op/s 2023-05-08T05:23:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:23 smithi096 ceph-mon[124666]: pgmap v3230: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 232 KiB/s wr, 13 op/s 2023-05-08T05:23:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5942.693975 secs 2023-05-08T05:23:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5943.251273 secs 2023-05-08T05:23:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5942.693975 secs 2023-05-08T05:23:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5943.251273 secs 2023-05-08T05:23:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5942.693975 secs 2023-05-08T05:23:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5943.251273 secs 2023-05-08T05:23:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:25 smithi186 ceph-mon[126480]: pgmap v3231: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 232 KiB/s wr, 13 op/s 2023-05-08T05:23:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:25 smithi133 ceph-mon[125939]: pgmap v3231: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 232 KiB/s wr, 13 op/s 2023-05-08T05:23:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:25 smithi096 ceph-mon[124666]: pgmap v3231: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 232 KiB/s wr, 13 op/s 2023-05-08T05:23:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:26 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:23:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:26 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:23:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:26 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:23:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:27 smithi186 ceph-mon[126480]: pgmap v3232: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1002 KiB/s rd, 1014 KiB/s wr, 21 op/s 2023-05-08T05:23:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:27 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:23:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:27 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:23:27.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:27 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:23:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:27 smithi133 ceph-mon[125939]: pgmap v3232: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1002 KiB/s rd, 1014 KiB/s wr, 21 op/s 2023-05-08T05:23:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:27 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:23:27.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:27 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:23:27.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:27 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:23:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:27 smithi096 ceph-mon[124666]: pgmap v3232: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1002 KiB/s rd, 1014 KiB/s wr, 21 op/s 2023-05-08T05:23:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:27 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:23:27.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:27 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:23:27.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:27 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:23:28.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:28 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:23:28.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:28 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:23:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:28 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:23:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:29 smithi186 ceph-mon[126480]: pgmap v3233: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1002 KiB/s rd, 1014 KiB/s wr, 21 op/s 2023-05-08T05:23:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5947.694075 secs 2023-05-08T05:23:29.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:29 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:23:29.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:29 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:23:29.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5948.251361 secs 2023-05-08T05:23:29.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:29 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:23:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:29 smithi133 ceph-mon[125939]: pgmap v3233: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1002 KiB/s rd, 1014 KiB/s wr, 21 op/s 2023-05-08T05:23:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5947.694075 secs 2023-05-08T05:23:29.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:29 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:23:29.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:29 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:23:29.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5948.251361 secs 2023-05-08T05:23:29.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:29 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:23:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:29 smithi096 ceph-mon[124666]: pgmap v3233: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1002 KiB/s rd, 1014 KiB/s wr, 21 op/s 2023-05-08T05:23:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5947.694075 secs 2023-05-08T05:23:29.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:29 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:23:29.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:29 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:23:29.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5948.251361 secs 2023-05-08T05:23:29.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:29 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:23:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:30 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:23:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:30 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T05:23:30.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:30 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T05:23:30.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:30 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:23:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:30 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:23:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:30 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T05:23:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:30 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T05:23:30.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:30 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:23:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:30 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:23:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:30 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T05:23:30.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:30 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T05:23:30.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:30 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:23:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5949.531694 secs 2023-05-08T05:23:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:31 smithi186 ceph-mon[126480]: pgmap v3234: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 971 KiB/s rd, 980 KiB/s wr, 25 op/s 2023-05-08T05:23:31.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:31 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:23:31.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:31 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:23:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5949.531694 secs 2023-05-08T05:23:31.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:31 smithi133 ceph-mon[125939]: pgmap v3234: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 971 KiB/s rd, 980 KiB/s wr, 25 op/s 2023-05-08T05:23:31.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:31 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:23:31.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:31 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:23:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5949.531694 secs 2023-05-08T05:23:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:31 smithi096 ceph-mon[124666]: pgmap v3234: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 971 KiB/s rd, 980 KiB/s wr, 25 op/s 2023-05-08T05:23:31.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:31 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:23:31.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:31 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:23:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:33 smithi133 ceph-mon[125939]: pgmap v3235: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 765 KiB/s rd, 765 KiB/s wr, 16 op/s 2023-05-08T05:23:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:33 smithi096 ceph-mon[124666]: pgmap v3235: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 765 KiB/s rd, 765 KiB/s wr, 16 op/s 2023-05-08T05:23:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:33 smithi186 ceph-mon[126480]: pgmap v3235: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 765 KiB/s rd, 765 KiB/s wr, 16 op/s 2023-05-08T05:23:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5952.694194 secs 2023-05-08T05:23:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5953.251485 secs 2023-05-08T05:23:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:34 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:23:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5952.694194 secs 2023-05-08T05:23:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5953.251485 secs 2023-05-08T05:23:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:34 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:23:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5952.694194 secs 2023-05-08T05:23:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5953.251485 secs 2023-05-08T05:23:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:34 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:23:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:35 smithi133 ceph-mon[125939]: pgmap v3236: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 765 KiB/s rd, 765 KiB/s wr, 16 op/s 2023-05-08T05:23:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:35 smithi096 ceph-mon[124666]: pgmap v3236: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 765 KiB/s rd, 765 KiB/s wr, 16 op/s 2023-05-08T05:23:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:35 smithi186 ceph-mon[126480]: pgmap v3236: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 765 KiB/s rd, 765 KiB/s wr, 16 op/s 2023-05-08T05:23:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:37 smithi133 ceph-mon[125939]: pgmap v3237: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 899 KiB/s rd, 867 KiB/s wr, 20 op/s 2023-05-08T05:23:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:37 smithi096 ceph-mon[124666]: pgmap v3237: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 899 KiB/s rd, 867 KiB/s wr, 20 op/s 2023-05-08T05:23:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:37 smithi186 ceph-mon[126480]: pgmap v3237: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 899 KiB/s rd, 867 KiB/s wr, 20 op/s 2023-05-08T05:23:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:38 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:23:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:38 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:23:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:38 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:23:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:39 smithi133 ceph-mon[125939]: pgmap v3238: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 134 KiB/s wr, 9 op/s 2023-05-08T05:23:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5957.694274 secs 2023-05-08T05:23:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:39 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:23:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:39 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:23:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5958.251572 secs 2023-05-08T05:23:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:39 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:23:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:39 smithi096 ceph-mon[124666]: pgmap v3238: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 134 KiB/s wr, 9 op/s 2023-05-08T05:23:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5957.694274 secs 2023-05-08T05:23:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:39 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:23:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:39 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:23:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5958.251572 secs 2023-05-08T05:23:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:39 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:23:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:39 smithi186 ceph-mon[126480]: pgmap v3238: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 134 KiB/s wr, 9 op/s 2023-05-08T05:23:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5957.694274 secs 2023-05-08T05:23:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:39 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:23:39.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:39 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:23:39.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5958.251572 secs 2023-05-08T05:23:39.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:39 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:23:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5959.531959 secs 2023-05-08T05:23:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:41 smithi133 ceph-mon[125939]: pgmap v3239: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 140 KiB/s wr, 14 op/s 2023-05-08T05:23:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5959.531959 secs 2023-05-08T05:23:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:41 smithi096 ceph-mon[124666]: pgmap v3239: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 140 KiB/s wr, 14 op/s 2023-05-08T05:23:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5959.531959 secs 2023-05-08T05:23:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:41 smithi186 ceph-mon[126480]: pgmap v3239: 97 pgs: 97 active+clean; 5.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 140 KiB/s wr, 14 op/s 2023-05-08T05:23:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:43 smithi133 ceph-mon[125939]: pgmap v3240: 97 pgs: 97 active+clean; 5.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 283 KiB/s wr, 10 op/s 2023-05-08T05:23:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:23:43.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:23:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:43 smithi096 ceph-mon[124666]: pgmap v3240: 97 pgs: 97 active+clean; 5.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 283 KiB/s wr, 10 op/s 2023-05-08T05:23:43.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:23:43.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:23:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:43 smithi186 ceph-mon[126480]: pgmap v3240: 97 pgs: 97 active+clean; 5.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 283 KiB/s wr, 10 op/s 2023-05-08T05:23:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:23:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:23:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5962.694367 secs 2023-05-08T05:23:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5963.251672 secs 2023-05-08T05:23:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:44 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:23:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5962.694367 secs 2023-05-08T05:23:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5963.251672 secs 2023-05-08T05:23:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:44 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:23:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5962.694367 secs 2023-05-08T05:23:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5963.251672 secs 2023-05-08T05:23:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:44 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:23:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:45 smithi133 ceph-mon[125939]: pgmap v3241: 97 pgs: 97 active+clean; 5.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 283 KiB/s wr, 10 op/s 2023-05-08T05:23:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:45 smithi096 ceph-mon[124666]: pgmap v3241: 97 pgs: 97 active+clean; 5.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 283 KiB/s wr, 10 op/s 2023-05-08T05:23:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:45 smithi186 ceph-mon[126480]: pgmap v3241: 97 pgs: 97 active+clean; 5.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 283 KiB/s wr, 10 op/s 2023-05-08T05:23:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5964.532038 secs 2023-05-08T05:23:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5964.532038 secs 2023-05-08T05:23:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5964.532038 secs 2023-05-08T05:23:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:47 smithi133 ceph-mon[125939]: pgmap v3242: 97 pgs: 97 active+clean; 5.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 413 KiB/s wr, 19 op/s 2023-05-08T05:23:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:47 smithi096 ceph-mon[124666]: pgmap v3242: 97 pgs: 97 active+clean; 5.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 413 KiB/s wr, 19 op/s 2023-05-08T05:23:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:47 smithi186 ceph-mon[126480]: pgmap v3242: 97 pgs: 97 active+clean; 5.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 413 KiB/s wr, 19 op/s 2023-05-08T05:23:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:49 smithi133 ceph-mon[125939]: pgmap v3243: 97 pgs: 97 active+clean; 5.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 310 KiB/s wr, 14 op/s 2023-05-08T05:23:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5967.694488 secs 2023-05-08T05:23:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:49 smithi096 ceph-mon[124666]: pgmap v3243: 97 pgs: 97 active+clean; 5.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 310 KiB/s wr, 14 op/s 2023-05-08T05:23:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5967.694488 secs 2023-05-08T05:23:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:49 smithi186 ceph-mon[126480]: pgmap v3243: 97 pgs: 97 active+clean; 5.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 310 KiB/s wr, 14 op/s 2023-05-08T05:23:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5967.694488 secs 2023-05-08T05:23:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:50 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:23:50.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:50 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:23:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:50 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:23:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5969.532152 secs 2023-05-08T05:23:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:51 smithi133 ceph-mon[125939]: pgmap v3244: 97 pgs: 97 active+clean; 5.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 533 KiB/s rd, 482 KiB/s wr, 23 op/s 2023-05-08T05:23:51.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:51 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:23:51.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:23:51.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:23:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5969.532152 secs 2023-05-08T05:23:51.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:51 smithi096 ceph-mon[124666]: pgmap v3244: 97 pgs: 97 active+clean; 5.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 533 KiB/s rd, 482 KiB/s wr, 23 op/s 2023-05-08T05:23:51.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:51 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:23:51.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:23:51.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:23:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5969.532152 secs 2023-05-08T05:23:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:51 smithi186 ceph-mon[126480]: pgmap v3244: 97 pgs: 97 active+clean; 5.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 533 KiB/s rd, 482 KiB/s wr, 23 op/s 2023-05-08T05:23:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:51 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:23:51.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:23:51.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:23:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:53 smithi133 ceph-mon[125939]: pgmap v3245: 97 pgs: 97 active+clean; 5.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 476 KiB/s wr, 19 op/s 2023-05-08T05:23:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:53 smithi096 ceph-mon[124666]: pgmap v3245: 97 pgs: 97 active+clean; 5.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 476 KiB/s wr, 19 op/s 2023-05-08T05:23:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:53 smithi186 ceph-mon[126480]: pgmap v3245: 97 pgs: 97 active+clean; 5.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 476 KiB/s wr, 19 op/s 2023-05-08T05:23:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5972.694609 secs 2023-05-08T05:23:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5972.694609 secs 2023-05-08T05:23:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5972.694609 secs 2023-05-08T05:23:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:55 smithi133 ceph-mon[125939]: pgmap v3246: 97 pgs: 97 active+clean; 5.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 302 KiB/s wr, 18 op/s 2023-05-08T05:23:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:55 smithi096 ceph-mon[124666]: pgmap v3246: 97 pgs: 97 active+clean; 5.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 302 KiB/s wr, 18 op/s 2023-05-08T05:23:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:55 smithi186 ceph-mon[126480]: pgmap v3246: 97 pgs: 97 active+clean; 5.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 302 KiB/s wr, 18 op/s 2023-05-08T05:23:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5974.532244 secs 2023-05-08T05:23:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5974.532244 secs 2023-05-08T05:23:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5974.532244 secs 2023-05-08T05:23:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:57 smithi133 ceph-mon[125939]: pgmap v3247: 97 pgs: 97 active+clean; 5.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 405 KiB/s wr, 26 op/s 2023-05-08T05:23:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:57 smithi096 ceph-mon[124666]: pgmap v3247: 97 pgs: 97 active+clean; 5.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 405 KiB/s wr, 26 op/s 2023-05-08T05:23:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:57 smithi186 ceph-mon[126480]: pgmap v3247: 97 pgs: 97 active+clean; 5.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 405 KiB/s wr, 26 op/s 2023-05-08T05:23:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:59 smithi133 ceph-mon[125939]: pgmap v3248: 97 pgs: 97 active+clean; 5.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 275 KiB/s wr, 18 op/s 2023-05-08T05:23:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:23:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5977.694727 secs 2023-05-08T05:23:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:59 smithi096 ceph-mon[124666]: pgmap v3248: 97 pgs: 97 active+clean; 5.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 275 KiB/s wr, 18 op/s 2023-05-08T05:23:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:23:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5977.694727 secs 2023-05-08T05:23:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:59 smithi186 ceph-mon[126480]: pgmap v3248: 97 pgs: 97 active+clean; 5.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 275 KiB/s wr, 18 op/s 2023-05-08T05:23:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:23:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5977.694727 secs 2023-05-08T05:24:01.744 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5979.532357 secs 2023-05-08T05:24:01.744 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:01 smithi133 ceph-mon[125939]: pgmap v3249: 97 pgs: 97 active+clean; 5.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 334 KiB/s wr, 25 op/s 2023-05-08T05:24:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5979.532357 secs 2023-05-08T05:24:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:01 smithi096 ceph-mon[124666]: pgmap v3249: 97 pgs: 97 active+clean; 5.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 334 KiB/s wr, 25 op/s 2023-05-08T05:24:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5979.532357 secs 2023-05-08T05:24:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:01 smithi186 ceph-mon[126480]: pgmap v3249: 97 pgs: 97 active+clean; 5.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 334 KiB/s wr, 25 op/s 2023-05-08T05:24:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:03 smithi133 ceph-mon[125939]: pgmap v3250: 97 pgs: 97 active+clean; 5.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 162 KiB/s wr, 16 op/s 2023-05-08T05:24:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:03 smithi096 ceph-mon[124666]: pgmap v3250: 97 pgs: 97 active+clean; 5.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 162 KiB/s wr, 16 op/s 2023-05-08T05:24:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:03 smithi186 ceph-mon[126480]: pgmap v3250: 97 pgs: 97 active+clean; 5.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 162 KiB/s wr, 16 op/s 2023-05-08T05:24:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5982.694837 secs 2023-05-08T05:24:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5982.694837 secs 2023-05-08T05:24:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5982.694837 secs 2023-05-08T05:24:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:05 smithi133 ceph-mon[125939]: pgmap v3251: 97 pgs: 97 active+clean; 5.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 162 KiB/s wr, 16 op/s 2023-05-08T05:24:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:05 smithi096 ceph-mon[124666]: pgmap v3251: 97 pgs: 97 active+clean; 5.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 162 KiB/s wr, 16 op/s 2023-05-08T05:24:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:05 smithi186 ceph-mon[126480]: pgmap v3251: 97 pgs: 97 active+clean; 5.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 162 KiB/s wr, 16 op/s 2023-05-08T05:24:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5984.532429 secs 2023-05-08T05:24:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:06 smithi133 ceph-mon[125939]: osdmap e282: 12 total, 12 up, 12 in 2023-05-08T05:24:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5984.532429 secs 2023-05-08T05:24:06.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:06 smithi096 ceph-mon[124666]: osdmap e282: 12 total, 12 up, 12 in 2023-05-08T05:24:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5984.532429 secs 2023-05-08T05:24:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:06 smithi186 ceph-mon[126480]: osdmap e282: 12 total, 12 up, 12 in 2023-05-08T05:24:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:07 smithi133 ceph-mon[125939]: pgmap v3253: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 779 KiB/s rd, 802 KiB/s wr, 39 op/s 2023-05-08T05:24:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:07 smithi096 ceph-mon[124666]: pgmap v3253: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 779 KiB/s rd, 802 KiB/s wr, 39 op/s 2023-05-08T05:24:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:07 smithi186 ceph-mon[126480]: pgmap v3253: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 779 KiB/s rd, 802 KiB/s wr, 39 op/s 2023-05-08T05:24:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:09 smithi133 ceph-mon[125939]: pgmap v3254: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 779 KiB/s rd, 802 KiB/s wr, 39 op/s 2023-05-08T05:24:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5987.694979 secs 2023-05-08T05:24:09.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5988.252241 secs 2023-05-08T05:24:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:09 smithi096 ceph-mon[124666]: pgmap v3254: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 779 KiB/s rd, 802 KiB/s wr, 39 op/s 2023-05-08T05:24:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5987.694979 secs 2023-05-08T05:24:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5988.252241 secs 2023-05-08T05:24:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:09 smithi186 ceph-mon[126480]: pgmap v3254: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 779 KiB/s rd, 802 KiB/s wr, 39 op/s 2023-05-08T05:24:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5987.694979 secs 2023-05-08T05:24:09.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5988.252241 secs 2023-05-08T05:24:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:10 smithi186 ceph-mon[126480]: pgmap v3255: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 684 KiB/s rd, 732 KiB/s wr, 35 op/s 2023-05-08T05:24:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:10 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:24:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:10 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:24:10.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:10 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:24:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:10 smithi133 ceph-mon[125939]: pgmap v3255: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 684 KiB/s rd, 732 KiB/s wr, 35 op/s 2023-05-08T05:24:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:10 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:24:10.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:10 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:24:10.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:10 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:24:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:10 smithi096 ceph-mon[124666]: pgmap v3255: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 684 KiB/s rd, 732 KiB/s wr, 35 op/s 2023-05-08T05:24:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:10 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:24:11.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:10 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:24:11.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:10 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:24:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5989.532538 secs 2023-05-08T05:24:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5989.532538 secs 2023-05-08T05:24:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5989.532538 secs 2023-05-08T05:24:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:12 smithi186 ceph-mon[126480]: pgmap v3256: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 684 KiB/s rd, 732 KiB/s wr, 35 op/s 2023-05-08T05:24:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:12 smithi133 ceph-mon[125939]: pgmap v3256: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 684 KiB/s rd, 732 KiB/s wr, 35 op/s 2023-05-08T05:24:13.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:12 smithi096 ceph-mon[124666]: pgmap v3256: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 684 KiB/s rd, 732 KiB/s wr, 35 op/s 2023-05-08T05:24:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5992.695111 secs 2023-05-08T05:24:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5992.695111 secs 2023-05-08T05:24:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5992.695111 secs 2023-05-08T05:24:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5993.252357 secs 2023-05-08T05:24:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:15 smithi186 ceph-mon[126480]: pgmap v3257: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 684 KiB/s rd, 732 KiB/s wr, 35 op/s 2023-05-08T05:24:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:15 smithi186 ceph-mon[126480]: osdmap e283: 12 total, 12 up, 12 in 2023-05-08T05:24:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5993.252357 secs 2023-05-08T05:24:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:15 smithi133 ceph-mon[125939]: pgmap v3257: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 684 KiB/s rd, 732 KiB/s wr, 35 op/s 2023-05-08T05:24:15.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:15 smithi133 ceph-mon[125939]: osdmap e283: 12 total, 12 up, 12 in 2023-05-08T05:24:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5993.252357 secs 2023-05-08T05:24:15.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:15 smithi096 ceph-mon[124666]: pgmap v3257: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 684 KiB/s rd, 732 KiB/s wr, 35 op/s 2023-05-08T05:24:15.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:15 smithi096 ceph-mon[124666]: osdmap e283: 12 total, 12 up, 12 in 2023-05-08T05:24:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5994.532674 secs 2023-05-08T05:24:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5994.532674 secs 2023-05-08T05:24:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5994.532674 secs 2023-05-08T05:24:17.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:17 smithi186 ceph-mon[126480]: pgmap v3259: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 KiB/s wr, 9 op/s 2023-05-08T05:24:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:17 smithi133 ceph-mon[125939]: pgmap v3259: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 KiB/s wr, 9 op/s 2023-05-08T05:24:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:17 smithi096 ceph-mon[124666]: pgmap v3259: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 KiB/s wr, 9 op/s 2023-05-08T05:24:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:19 smithi186 ceph-mon[126480]: pgmap v3260: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 KiB/s wr, 9 op/s 2023-05-08T05:24:19.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5997.695198 secs 2023-05-08T05:24:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:19 smithi133 ceph-mon[125939]: pgmap v3260: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 KiB/s wr, 9 op/s 2023-05-08T05:24:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5997.695198 secs 2023-05-08T05:24:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:19 smithi096 ceph-mon[124666]: pgmap v3260: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 KiB/s wr, 9 op/s 2023-05-08T05:24:19.509 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5997.695198 secs 2023-05-08T05:24:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5998.252510 secs 2023-05-08T05:24:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5998.252510 secs 2023-05-08T05:24:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5998.252510 secs 2023-05-08T05:24:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 5999.532806 secs 2023-05-08T05:24:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:21 smithi186 ceph-mon[126480]: pgmap v3261: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 78 KiB/s wr, 8 op/s 2023-05-08T05:24:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 5999.532806 secs 2023-05-08T05:24:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:21 smithi133 ceph-mon[125939]: pgmap v3261: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 78 KiB/s wr, 8 op/s 2023-05-08T05:24:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 5999.532806 secs 2023-05-08T05:24:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:21 smithi096 ceph-mon[124666]: pgmap v3261: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 78 KiB/s wr, 8 op/s 2023-05-08T05:24:23.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:23 smithi186 ceph-mon[126480]: pgmap v3262: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 78 KiB/s wr, 9 op/s 2023-05-08T05:24:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:23 smithi133 ceph-mon[125939]: pgmap v3262: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 78 KiB/s wr, 9 op/s 2023-05-08T05:24:23.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:23 smithi096 ceph-mon[124666]: pgmap v3262: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 78 KiB/s wr, 9 op/s 2023-05-08T05:24:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6002.695351 secs 2023-05-08T05:24:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6002.695351 secs 2023-05-08T05:24:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6002.695351 secs 2023-05-08T05:24:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6003.252623 secs 2023-05-08T05:24:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:25 smithi133 ceph-mon[125939]: pgmap v3263: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 78 KiB/s wr, 9 op/s 2023-05-08T05:24:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6003.252623 secs 2023-05-08T05:24:25.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:25 smithi096 ceph-mon[124666]: pgmap v3263: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 78 KiB/s wr, 9 op/s 2023-05-08T05:24:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6003.252623 secs 2023-05-08T05:24:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:25 smithi186 ceph-mon[126480]: pgmap v3263: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 78 KiB/s wr, 9 op/s 2023-05-08T05:24:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6004.532929 secs 2023-05-08T05:24:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6004.532929 secs 2023-05-08T05:24:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6004.532929 secs 2023-05-08T05:24:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:27 smithi133 ceph-mon[125939]: pgmap v3264: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 84 KiB/s wr, 11 op/s 2023-05-08T05:24:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:27 smithi096 ceph-mon[124666]: pgmap v3264: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 84 KiB/s wr, 11 op/s 2023-05-08T05:24:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:27 smithi186 ceph-mon[126480]: pgmap v3264: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 84 KiB/s wr, 11 op/s 2023-05-08T05:24:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:29 smithi133 ceph-mon[125939]: pgmap v3265: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 51 KiB/s wr, 7 op/s 2023-05-08T05:24:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6007.695462 secs 2023-05-08T05:24:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:29 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:24:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:29 smithi096 ceph-mon[124666]: pgmap v3265: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 51 KiB/s wr, 7 op/s 2023-05-08T05:24:29.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6007.695462 secs 2023-05-08T05:24:29.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:29 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:24:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:29 smithi186 ceph-mon[126480]: pgmap v3265: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 51 KiB/s wr, 7 op/s 2023-05-08T05:24:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6007.695462 secs 2023-05-08T05:24:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:29 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:24:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6008.252765 secs 2023-05-08T05:24:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6008.252765 secs 2023-05-08T05:24:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6008.252765 secs 2023-05-08T05:24:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6009.532992 secs 2023-05-08T05:24:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:31 smithi133 ceph-mon[125939]: pgmap v3266: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 9 op/s 2023-05-08T05:24:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6009.532992 secs 2023-05-08T05:24:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:31 smithi096 ceph-mon[124666]: pgmap v3266: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 9 op/s 2023-05-08T05:24:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6009.532992 secs 2023-05-08T05:24:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:31 smithi186 ceph-mon[126480]: pgmap v3266: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 9 op/s 2023-05-08T05:24:32.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:24:32.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:24:32.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:24:32.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:24:32.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:24:32.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:24:32.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:24:32.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:24:32.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:24:32.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:24:32.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:24:32.623 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:24:32.623 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:24:32.623 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:24:32.623 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:24:32.624 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:24:32.624 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:24:32.624 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:24:32.625 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:24:32.625 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:24:32.626 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:24:32.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:24:32.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:24:32.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:24:32.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:24:32.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:24:32.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:24:32.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:24:32.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:24:32.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:24:32.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:24:32.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:24:32.744 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:24:32.744 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:24:32.744 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:24:32.745 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:24:32.745 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:24:32.745 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:24:32.745 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:24:32.746 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:24:32.746 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:24:32.746 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:24:32.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:24:32.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:24:32.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:24:32.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:24:32.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:24:32.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:24:32.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:24:32.759 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:24:32.759 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:24:32.760 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:24:32.760 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:24:32.761 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:24:32.761 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:24:32.761 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:24:32.762 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:24:32.762 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:24:32.763 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:24:32.763 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:24:32.763 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:24:32.764 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:24:32.764 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:24:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:33 smithi133 ceph-mon[125939]: pgmap v3267: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 17 KiB/s wr, 6 op/s 2023-05-08T05:24:33.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:33 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi096 to 196.2M 2023-05-08T05:24:33.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:33 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi096 to 205766758: error parsing value: Value '205766758' is below minimum 939524096 2023-05-08T05:24:33.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:33 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T05:24:33.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:33 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T05:24:33.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:33 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T05:24:33.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:33 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T05:24:33.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:33 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:24:33.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:33 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T05:24:33.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:33 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T05:24:33.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:33 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:24:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:33 smithi096 ceph-mon[124666]: pgmap v3267: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 17 KiB/s wr, 6 op/s 2023-05-08T05:24:33.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:33 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi096 to 196.2M 2023-05-08T05:24:33.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:33 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi096 to 205766758: error parsing value: Value '205766758' is below minimum 939524096 2023-05-08T05:24:33.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:33 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T05:24:33.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:33 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T05:24:33.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:33 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T05:24:33.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:33 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T05:24:33.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:33 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:24:33.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:33 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T05:24:33.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:33 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T05:24:33.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:33 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:24:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:33 smithi186 ceph-mon[126480]: pgmap v3267: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 17 KiB/s wr, 6 op/s 2023-05-08T05:24:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:33 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi096 to 196.2M 2023-05-08T05:24:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:33 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi096 to 205766758: error parsing value: Value '205766758' is below minimum 939524096 2023-05-08T05:24:33.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:33 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T05:24:33.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:33 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T05:24:33.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:33 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T05:24:33.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:33 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T05:24:33.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:33 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:24:33.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:33 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T05:24:33.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:33 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T05:24:33.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:33 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:24:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6012.695575 secs 2023-05-08T05:24:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6013.252832 secs 2023-05-08T05:24:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6012.695575 secs 2023-05-08T05:24:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6013.252832 secs 2023-05-08T05:24:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6012.695575 secs 2023-05-08T05:24:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6013.252832 secs 2023-05-08T05:24:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:35 smithi133 ceph-mon[125939]: pgmap v3268: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 17 KiB/s wr, 6 op/s 2023-05-08T05:24:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:35 smithi096 ceph-mon[124666]: pgmap v3268: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 17 KiB/s wr, 6 op/s 2023-05-08T05:24:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:35 smithi186 ceph-mon[126480]: pgmap v3268: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 17 KiB/s wr, 6 op/s 2023-05-08T05:24:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:37 smithi133 ceph-mon[125939]: pgmap v3269: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 30 KiB/s wr, 9 op/s 2023-05-08T05:24:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:37 smithi096 ceph-mon[124666]: pgmap v3269: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 30 KiB/s wr, 9 op/s 2023-05-08T05:24:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:37 smithi186 ceph-mon[126480]: pgmap v3269: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 30 KiB/s wr, 9 op/s 2023-05-08T05:24:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:38 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:24:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:38 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:24:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:38 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:24:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:39 smithi133 ceph-mon[125939]: pgmap v3270: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 5 op/s 2023-05-08T05:24:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6017.695670 secs 2023-05-08T05:24:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:39 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:24:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:39 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:24:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:39 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:24:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6018.252954 secs 2023-05-08T05:24:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:39 smithi096 ceph-mon[124666]: pgmap v3270: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 5 op/s 2023-05-08T05:24:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6017.695670 secs 2023-05-08T05:24:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:39 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:24:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:39 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:24:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:39 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:24:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6018.252954 secs 2023-05-08T05:24:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:39 smithi186 ceph-mon[126480]: pgmap v3270: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 5 op/s 2023-05-08T05:24:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6017.695670 secs 2023-05-08T05:24:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:39 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:24:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:39 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:24:39.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:39 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:24:39.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6018.252954 secs 2023-05-08T05:24:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:41 smithi133 ceph-mon[125939]: pgmap v3271: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 48 KiB/s wr, 8 op/s 2023-05-08T05:24:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:41 smithi096 ceph-mon[124666]: pgmap v3271: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 48 KiB/s wr, 8 op/s 2023-05-08T05:24:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:41 smithi186 ceph-mon[126480]: pgmap v3271: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 48 KiB/s wr, 8 op/s 2023-05-08T05:24:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:42 smithi186 ceph-mon[126480]: pgmap v3272: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 48 KiB/s wr, 5 op/s 2023-05-08T05:24:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:42 smithi133 ceph-mon[125939]: pgmap v3272: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 48 KiB/s wr, 5 op/s 2023-05-08T05:24:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:42 smithi096 ceph-mon[124666]: pgmap v3272: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 48 KiB/s wr, 5 op/s 2023-05-08T05:24:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6022.695816 secs 2023-05-08T05:24:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6022.695816 secs 2023-05-08T05:24:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6022.695816 secs 2023-05-08T05:24:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:45 smithi186 ceph-mon[126480]: pgmap v3273: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 48 KiB/s wr, 5 op/s 2023-05-08T05:24:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:45 smithi133 ceph-mon[125939]: pgmap v3273: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 48 KiB/s wr, 5 op/s 2023-05-08T05:24:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:45 smithi096 ceph-mon[124666]: pgmap v3273: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 48 KiB/s wr, 5 op/s 2023-05-08T05:24:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6024.533294 secs 2023-05-08T05:24:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:46 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:24:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6024.533294 secs 2023-05-08T05:24:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:46 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:24:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6024.533294 secs 2023-05-08T05:24:46.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:46 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:24:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:47 smithi186 ceph-mon[126480]: pgmap v3274: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 245 KiB/s wr, 11 op/s 2023-05-08T05:24:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:47 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:24:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:47 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:24:47.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:47 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:24:47.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:47 smithi133 ceph-mon[125939]: pgmap v3274: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 245 KiB/s wr, 11 op/s 2023-05-08T05:24:47.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:47 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:24:47.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:47 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:24:47.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:47 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:24:47.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:47 smithi096 ceph-mon[124666]: pgmap v3274: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 245 KiB/s wr, 11 op/s 2023-05-08T05:24:47.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:47 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:24:47.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:47 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:24:47.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:47 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:24:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:49 smithi186 ceph-mon[126480]: pgmap v3275: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 232 KiB/s wr, 8 op/s 2023-05-08T05:24:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6027.695957 secs 2023-05-08T05:24:49.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:49 smithi133 ceph-mon[125939]: pgmap v3275: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 232 KiB/s wr, 8 op/s 2023-05-08T05:24:49.502 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6027.695957 secs 2023-05-08T05:24:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:49 smithi096 ceph-mon[124666]: pgmap v3275: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 232 KiB/s wr, 8 op/s 2023-05-08T05:24:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6027.695957 secs 2023-05-08T05:24:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6028.253222 secs 2023-05-08T05:24:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6028.253222 secs 2023-05-08T05:24:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6028.253222 secs 2023-05-08T05:24:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6029.533403 secs 2023-05-08T05:24:51.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:51 smithi133 ceph-mon[125939]: pgmap v3276: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 330 KiB/s wr, 13 op/s 2023-05-08T05:24:51.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:51 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:24:51.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:24:51.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:24:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6029.533403 secs 2023-05-08T05:24:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:51 smithi096 ceph-mon[124666]: pgmap v3276: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 330 KiB/s wr, 13 op/s 2023-05-08T05:24:51.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:51 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:24:51.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:24:51.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:24:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6029.533403 secs 2023-05-08T05:24:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:51 smithi186 ceph-mon[126480]: pgmap v3276: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 330 KiB/s wr, 13 op/s 2023-05-08T05:24:51.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:51 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:24:51.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:24:51.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:24:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:53 smithi133 ceph-mon[125939]: pgmap v3277: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 295 KiB/s wr, 10 op/s 2023-05-08T05:24:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:53 smithi096 ceph-mon[124666]: pgmap v3277: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 295 KiB/s wr, 10 op/s 2023-05-08T05:24:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:53 smithi186 ceph-mon[126480]: pgmap v3277: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 295 KiB/s wr, 10 op/s 2023-05-08T05:24:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6032.696093 secs 2023-05-08T05:24:54.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:54 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:24:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6032.696093 secs 2023-05-08T05:24:54.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:54 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:24:54.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6032.696093 secs 2023-05-08T05:24:54.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:54 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:24:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:55 smithi133 ceph-mon[125939]: pgmap v3278: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 295 KiB/s wr, 10 op/s 2023-05-08T05:24:55.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:55 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:24:55.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:55 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:24:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:55 smithi096 ceph-mon[124666]: pgmap v3278: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 295 KiB/s wr, 10 op/s 2023-05-08T05:24:55.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:55 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:24:55.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:55 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:24:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:55 smithi186 ceph-mon[126480]: pgmap v3278: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 295 KiB/s wr, 10 op/s 2023-05-08T05:24:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:55 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:24:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:55 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:24:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6034.533528 secs 2023-05-08T05:24:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6034.533528 secs 2023-05-08T05:24:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6034.533528 secs 2023-05-08T05:24:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:57 smithi133 ceph-mon[125939]: pgmap v3279: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 336 KiB/s wr, 14 op/s 2023-05-08T05:24:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:57 smithi096 ceph-mon[124666]: pgmap v3279: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 336 KiB/s wr, 14 op/s 2023-05-08T05:24:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:57 smithi186 ceph-mon[126480]: pgmap v3279: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 336 KiB/s wr, 14 op/s 2023-05-08T05:24:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:59 smithi133 ceph-mon[125939]: pgmap v3280: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 139 KiB/s wr, 9 op/s 2023-05-08T05:24:59.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6037.696156 secs 2023-05-08T05:24:59.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:24:59 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:24:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:59 smithi096 ceph-mon[124666]: pgmap v3280: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 139 KiB/s wr, 9 op/s 2023-05-08T05:24:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6037.696156 secs 2023-05-08T05:24:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:24:59 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:24:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:59 smithi186 ceph-mon[126480]: pgmap v3280: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 139 KiB/s wr, 9 op/s 2023-05-08T05:24:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6037.696156 secs 2023-05-08T05:24:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:24:59 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:25:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6038.253463 secs 2023-05-08T05:25:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6038.253463 secs 2023-05-08T05:25:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6038.253463 secs 2023-05-08T05:25:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6039.533645 secs 2023-05-08T05:25:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:01 smithi133 ceph-mon[125939]: pgmap v3281: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 205 KiB/s wr, 13 op/s 2023-05-08T05:25:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6039.533645 secs 2023-05-08T05:25:01.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:01 smithi096 ceph-mon[124666]: pgmap v3281: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 205 KiB/s wr, 13 op/s 2023-05-08T05:25:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6039.533645 secs 2023-05-08T05:25:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:01 smithi186 ceph-mon[126480]: pgmap v3281: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 205 KiB/s wr, 13 op/s 2023-05-08T05:25:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:03 smithi133 ceph-mon[125939]: pgmap v3282: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 107 KiB/s wr, 8 op/s 2023-05-08T05:25:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:25:03.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:03 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:25:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:03 smithi096 ceph-mon[124666]: pgmap v3282: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 107 KiB/s wr, 8 op/s 2023-05-08T05:25:03.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:25:03.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:03 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:25:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:03 smithi186 ceph-mon[126480]: pgmap v3282: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 107 KiB/s wr, 8 op/s 2023-05-08T05:25:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:25:03.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:03 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:25:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6042.696284 secs 2023-05-08T05:25:04.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:04 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:25:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6042.696284 secs 2023-05-08T05:25:04.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:04 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:25:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6042.696284 secs 2023-05-08T05:25:04.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:04 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:25:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6043.253574 secs 2023-05-08T05:25:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:05 smithi133 ceph-mon[125939]: pgmap v3283: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 107 KiB/s wr, 8 op/s 2023-05-08T05:25:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6043.253574 secs 2023-05-08T05:25:05.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:05 smithi096 ceph-mon[124666]: pgmap v3283: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 107 KiB/s wr, 8 op/s 2023-05-08T05:25:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6043.253574 secs 2023-05-08T05:25:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:05 smithi186 ceph-mon[126480]: pgmap v3283: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 107 KiB/s wr, 8 op/s 2023-05-08T05:25:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6044.533791 secs 2023-05-08T05:25:06.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:06 smithi133 ceph-mon[125939]: osdmap e284: 12 total, 12 up, 12 in 2023-05-08T05:25:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6044.533791 secs 2023-05-08T05:25:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:06 smithi096 ceph-mon[124666]: osdmap e284: 12 total, 12 up, 12 in 2023-05-08T05:25:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6044.533791 secs 2023-05-08T05:25:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:06 smithi186 ceph-mon[126480]: osdmap e284: 12 total, 12 up, 12 in 2023-05-08T05:25:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:07 smithi133 ceph-mon[125939]: pgmap v3285: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 254 KiB/s wr, 28 op/s 2023-05-08T05:25:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:07 smithi096 ceph-mon[124666]: pgmap v3285: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 254 KiB/s wr, 28 op/s 2023-05-08T05:25:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:07 smithi186 ceph-mon[126480]: pgmap v3285: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 254 KiB/s wr, 28 op/s 2023-05-08T05:25:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:09 smithi133 ceph-mon[125939]: pgmap v3286: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 254 KiB/s wr, 28 op/s 2023-05-08T05:25:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6047.696437 secs 2023-05-08T05:25:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:09 smithi096 ceph-mon[124666]: pgmap v3286: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 254 KiB/s wr, 28 op/s 2023-05-08T05:25:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6047.696437 secs 2023-05-08T05:25:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:09 smithi186 ceph-mon[126480]: pgmap v3286: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 254 KiB/s wr, 28 op/s 2023-05-08T05:25:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6047.696437 secs 2023-05-08T05:25:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6048.253667 secs 2023-05-08T05:25:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6048.253667 secs 2023-05-08T05:25:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6048.253667 secs 2023-05-08T05:25:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6049.533902 secs 2023-05-08T05:25:11.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:11 smithi133 ceph-mon[125939]: pgmap v3287: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 202 KiB/s wr, 26 op/s 2023-05-08T05:25:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6049.533902 secs 2023-05-08T05:25:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:11 smithi096 ceph-mon[124666]: pgmap v3287: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 202 KiB/s wr, 26 op/s 2023-05-08T05:25:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6049.533902 secs 2023-05-08T05:25:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:11 smithi186 ceph-mon[126480]: pgmap v3287: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 202 KiB/s wr, 26 op/s 2023-05-08T05:25:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:13 smithi133 ceph-mon[125939]: pgmap v3288: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 202 KiB/s wr, 26 op/s 2023-05-08T05:25:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:13 smithi096 ceph-mon[124666]: pgmap v3288: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 202 KiB/s wr, 26 op/s 2023-05-08T05:25:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:13 smithi186 ceph-mon[126480]: pgmap v3288: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 202 KiB/s wr, 26 op/s 2023-05-08T05:25:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6052.696552 secs 2023-05-08T05:25:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:14 smithi133 ceph-mon[125939]: osdmap e285: 12 total, 12 up, 12 in 2023-05-08T05:25:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6052.696552 secs 2023-05-08T05:25:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:14 smithi096 ceph-mon[124666]: osdmap e285: 12 total, 12 up, 12 in 2023-05-08T05:25:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6052.696552 secs 2023-05-08T05:25:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:14 smithi186 ceph-mon[126480]: osdmap e285: 12 total, 12 up, 12 in 2023-05-08T05:25:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6053.253786 secs 2023-05-08T05:25:15.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:15 smithi133 ceph-mon[125939]: pgmap v3289: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 202 KiB/s wr, 26 op/s 2023-05-08T05:25:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6053.253786 secs 2023-05-08T05:25:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:15 smithi096 ceph-mon[124666]: pgmap v3289: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 202 KiB/s wr, 26 op/s 2023-05-08T05:25:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6053.253786 secs 2023-05-08T05:25:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:15 smithi186 ceph-mon[126480]: pgmap v3289: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 202 KiB/s wr, 26 op/s 2023-05-08T05:25:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6054.534017 secs 2023-05-08T05:25:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6054.534017 secs 2023-05-08T05:25:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6054.534017 secs 2023-05-08T05:25:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:17 smithi133 ceph-mon[125939]: pgmap v3291: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 27 KiB/s wr, 7 op/s 2023-05-08T05:25:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:17 smithi096 ceph-mon[124666]: pgmap v3291: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 27 KiB/s wr, 7 op/s 2023-05-08T05:25:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:17 smithi186 ceph-mon[126480]: pgmap v3291: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 27 KiB/s wr, 7 op/s 2023-05-08T05:25:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:19 smithi133 ceph-mon[125939]: pgmap v3292: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 27 KiB/s wr, 7 op/s 2023-05-08T05:25:19.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6057.696700 secs 2023-05-08T05:25:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:19 smithi096 ceph-mon[124666]: pgmap v3292: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 27 KiB/s wr, 7 op/s 2023-05-08T05:25:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6057.696700 secs 2023-05-08T05:25:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:19 smithi186 ceph-mon[126480]: pgmap v3292: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 27 KiB/s wr, 7 op/s 2023-05-08T05:25:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6057.696700 secs 2023-05-08T05:25:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6058.253882 secs 2023-05-08T05:25:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6058.253882 secs 2023-05-08T05:25:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6058.253882 secs 2023-05-08T05:25:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6059.534132 secs 2023-05-08T05:25:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:21 smithi133 ceph-mon[125939]: pgmap v3293: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.9 KiB/s wr, 7 op/s 2023-05-08T05:25:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6059.534132 secs 2023-05-08T05:25:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:21 smithi096 ceph-mon[124666]: pgmap v3293: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.9 KiB/s wr, 7 op/s 2023-05-08T05:25:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6059.534132 secs 2023-05-08T05:25:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:21 smithi186 ceph-mon[126480]: pgmap v3293: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.9 KiB/s wr, 7 op/s 2023-05-08T05:25:23.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:23 smithi096 ceph-mon[124666]: pgmap v3294: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.9 KiB/s wr, 7 op/s 2023-05-08T05:25:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:23 smithi186 ceph-mon[126480]: pgmap v3294: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.9 KiB/s wr, 7 op/s 2023-05-08T05:25:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:23 smithi133 ceph-mon[125939]: pgmap v3294: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.9 KiB/s wr, 7 op/s 2023-05-08T05:25:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6062.696818 secs 2023-05-08T05:25:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6062.696818 secs 2023-05-08T05:25:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6062.696818 secs 2023-05-08T05:25:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6063.254021 secs 2023-05-08T05:25:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:25 smithi096 ceph-mon[124666]: pgmap v3295: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.9 KiB/s wr, 7 op/s 2023-05-08T05:25:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6063.254021 secs 2023-05-08T05:25:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:25 smithi186 ceph-mon[126480]: pgmap v3295: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.9 KiB/s wr, 7 op/s 2023-05-08T05:25:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6063.254021 secs 2023-05-08T05:25:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:25 smithi133 ceph-mon[125939]: pgmap v3295: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.9 KiB/s wr, 7 op/s 2023-05-08T05:25:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6064.534247 secs 2023-05-08T05:25:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6064.534247 secs 2023-05-08T05:25:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6064.534247 secs 2023-05-08T05:25:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:27 smithi186 ceph-mon[126480]: pgmap v3296: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 35 KiB/s wr, 7 op/s 2023-05-08T05:25:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:27 smithi133 ceph-mon[125939]: pgmap v3296: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 35 KiB/s wr, 7 op/s 2023-05-08T05:25:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:27 smithi096 ceph-mon[124666]: pgmap v3296: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 35 KiB/s wr, 7 op/s 2023-05-08T05:25:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:29 smithi186 ceph-mon[126480]: pgmap v3297: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 35 KiB/s wr, 6 op/s 2023-05-08T05:25:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6067.696941 secs 2023-05-08T05:25:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:29 smithi133 ceph-mon[125939]: pgmap v3297: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 35 KiB/s wr, 6 op/s 2023-05-08T05:25:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6067.696941 secs 2023-05-08T05:25:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:29 smithi096 ceph-mon[124666]: pgmap v3297: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 35 KiB/s wr, 6 op/s 2023-05-08T05:25:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6067.696941 secs 2023-05-08T05:25:30.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6068.254116 secs 2023-05-08T05:25:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6068.254116 secs 2023-05-08T05:25:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6068.254116 secs 2023-05-08T05:25:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6069.534380 secs 2023-05-08T05:25:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:31 smithi186 ceph-mon[126480]: pgmap v3298: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 35 KiB/s wr, 10 op/s 2023-05-08T05:25:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6069.534380 secs 2023-05-08T05:25:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:31 smithi133 ceph-mon[125939]: pgmap v3298: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 35 KiB/s wr, 10 op/s 2023-05-08T05:25:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6069.534380 secs 2023-05-08T05:25:31.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:31 smithi096 ceph-mon[124666]: pgmap v3298: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 35 KiB/s wr, 10 op/s 2023-05-08T05:25:32.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:25:32.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:25:32.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:25:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:33 smithi186 ceph-mon[126480]: pgmap v3299: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 35 KiB/s wr, 7 op/s 2023-05-08T05:25:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:33 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:25:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:33 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:25:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:33 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:25:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:33 smithi133 ceph-mon[125939]: pgmap v3299: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 35 KiB/s wr, 7 op/s 2023-05-08T05:25:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:33 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:25:33.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:33 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:25:33.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:33 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:25:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:33 smithi096 ceph-mon[124666]: pgmap v3299: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 35 KiB/s wr, 7 op/s 2023-05-08T05:25:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:33 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:25:33.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:33 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:25:33.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:33 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:25:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:34 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:25:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:34 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T05:25:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:34 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T05:25:34.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:34 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:25:34.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6072.697085 secs 2023-05-08T05:25:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:34 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:25:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:34 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T05:25:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:34 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T05:25:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:34 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:25:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6072.697085 secs 2023-05-08T05:25:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:34 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:25:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:34 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T05:25:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:34 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T05:25:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:34 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:25:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6072.697085 secs 2023-05-08T05:25:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6073.254258 secs 2023-05-08T05:25:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:35 smithi186 ceph-mon[126480]: pgmap v3300: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 35 KiB/s wr, 7 op/s 2023-05-08T05:25:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6073.254258 secs 2023-05-08T05:25:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:35 smithi133 ceph-mon[125939]: pgmap v3300: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 35 KiB/s wr, 7 op/s 2023-05-08T05:25:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6073.254258 secs 2023-05-08T05:25:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:35 smithi096 ceph-mon[124666]: pgmap v3300: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 35 KiB/s wr, 7 op/s 2023-05-08T05:25:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:37 smithi186 ceph-mon[126480]: pgmap v3301: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 KiB/s wr, 10 op/s 2023-05-08T05:25:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:37 smithi133 ceph-mon[125939]: pgmap v3301: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 KiB/s wr, 10 op/s 2023-05-08T05:25:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:37 smithi096 ceph-mon[124666]: pgmap v3301: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 KiB/s wr, 10 op/s 2023-05-08T05:25:38.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:38 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:25:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:38 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:25:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:38 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:25:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:39 smithi186 ceph-mon[126480]: pgmap v3302: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 682 B/s wr, 6 op/s 2023-05-08T05:25:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6077.697213 secs 2023-05-08T05:25:39.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:39 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:25:39.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:39 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:25:39.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:39 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:25:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:39 smithi133 ceph-mon[125939]: pgmap v3302: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 682 B/s wr, 6 op/s 2023-05-08T05:25:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6077.697213 secs 2023-05-08T05:25:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:39 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:25:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:39 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:25:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:39 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:25:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:39 smithi096 ceph-mon[124666]: pgmap v3302: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 682 B/s wr, 6 op/s 2023-05-08T05:25:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6077.697213 secs 2023-05-08T05:25:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:39 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:25:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:39 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:25:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:39 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:25:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6078.254375 secs 2023-05-08T05:25:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6078.254375 secs 2023-05-08T05:25:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6078.254375 secs 2023-05-08T05:25:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:41 smithi186 ceph-mon[126480]: pgmap v3303: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 36 KiB/s wr, 9 op/s 2023-05-08T05:25:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:41 smithi133 ceph-mon[125939]: pgmap v3303: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 36 KiB/s wr, 9 op/s 2023-05-08T05:25:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:41 smithi096 ceph-mon[124666]: pgmap v3303: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 36 KiB/s wr, 9 op/s 2023-05-08T05:25:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:43 smithi186 ceph-mon[126480]: pgmap v3304: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 5 op/s 2023-05-08T05:25:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:43 smithi133 ceph-mon[125939]: pgmap v3304: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 5 op/s 2023-05-08T05:25:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:43 smithi096 ceph-mon[124666]: pgmap v3304: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 5 op/s 2023-05-08T05:25:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6082.697329 secs 2023-05-08T05:25:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6082.697329 secs 2023-05-08T05:25:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6082.697329 secs 2023-05-08T05:25:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:45 smithi186 ceph-mon[126480]: pgmap v3305: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 5 op/s 2023-05-08T05:25:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:45 smithi133 ceph-mon[125939]: pgmap v3305: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 5 op/s 2023-05-08T05:25:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:45 smithi096 ceph-mon[124666]: pgmap v3305: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 5 op/s 2023-05-08T05:25:46.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:46 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:25:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:46 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:25:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:46 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:25:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:47 smithi186 ceph-mon[126480]: pgmap v3306: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 99 KiB/s wr, 9 op/s 2023-05-08T05:25:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:47 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:25:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:47 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:25:47.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:47 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:25:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:47 smithi133 ceph-mon[125939]: pgmap v3306: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 99 KiB/s wr, 9 op/s 2023-05-08T05:25:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:47 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:25:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:47 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:25:47.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:47 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:25:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:47 smithi096 ceph-mon[124666]: pgmap v3306: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 99 KiB/s wr, 9 op/s 2023-05-08T05:25:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:47 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:25:47.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:47 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:25:47.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:47 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:25:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:49 smithi186 ceph-mon[126480]: pgmap v3307: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 99 KiB/s wr, 6 op/s 2023-05-08T05:25:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6087.697446 secs 2023-05-08T05:25:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:49 smithi133 ceph-mon[125939]: pgmap v3307: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 99 KiB/s wr, 6 op/s 2023-05-08T05:25:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6087.697446 secs 2023-05-08T05:25:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:49 smithi096 ceph-mon[124666]: pgmap v3307: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 99 KiB/s wr, 6 op/s 2023-05-08T05:25:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6087.697446 secs 2023-05-08T05:25:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6089.534870 secs 2023-05-08T05:25:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:51 smithi186 ceph-mon[126480]: pgmap v3308: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 303 KiB/s wr, 12 op/s 2023-05-08T05:25:51.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:25:51.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:25:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6089.534870 secs 2023-05-08T05:25:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:51 smithi133 ceph-mon[125939]: pgmap v3308: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 303 KiB/s wr, 12 op/s 2023-05-08T05:25:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:25:51.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:25:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6089.534870 secs 2023-05-08T05:25:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:51 smithi096 ceph-mon[124666]: pgmap v3308: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 303 KiB/s wr, 12 op/s 2023-05-08T05:25:51.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:25:51.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:25:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:53 smithi186 ceph-mon[126480]: pgmap v3309: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 268 KiB/s wr, 9 op/s 2023-05-08T05:25:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:53 smithi133 ceph-mon[125939]: pgmap v3309: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 268 KiB/s wr, 9 op/s 2023-05-08T05:25:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:53 smithi096 ceph-mon[124666]: pgmap v3309: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 268 KiB/s wr, 9 op/s 2023-05-08T05:25:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6092.697536 secs 2023-05-08T05:25:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:54 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:25:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6092.697536 secs 2023-05-08T05:25:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:54 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:25:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6092.697536 secs 2023-05-08T05:25:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:54 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:25:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6093.254703 secs 2023-05-08T05:25:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:55 smithi186 ceph-mon[126480]: pgmap v3310: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 268 KiB/s wr, 9 op/s 2023-05-08T05:25:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:55 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:25:55.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:55 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:25:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6093.254703 secs 2023-05-08T05:25:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:55 smithi133 ceph-mon[125939]: pgmap v3310: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 268 KiB/s wr, 9 op/s 2023-05-08T05:25:55.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:55 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:25:55.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:55 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:25:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6093.254703 secs 2023-05-08T05:25:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:55 smithi096 ceph-mon[124666]: pgmap v3310: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 268 KiB/s wr, 9 op/s 2023-05-08T05:25:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:55 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:25:55.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:55 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:25:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6094.534989 secs 2023-05-08T05:25:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6094.534989 secs 2023-05-08T05:25:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6094.534989 secs 2023-05-08T05:25:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:57 smithi186 ceph-mon[126480]: pgmap v3311: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 304 KiB/s wr, 14 op/s 2023-05-08T05:25:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:57 smithi133 ceph-mon[125939]: pgmap v3311: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 304 KiB/s wr, 14 op/s 2023-05-08T05:25:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:57 smithi096 ceph-mon[124666]: pgmap v3311: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 304 KiB/s wr, 14 op/s 2023-05-08T05:25:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:59 smithi186 ceph-mon[126480]: pgmap v3312: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 241 KiB/s wr, 10 op/s 2023-05-08T05:25:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6097.697648 secs 2023-05-08T05:25:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:25:59 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:25:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:59 smithi133 ceph-mon[125939]: pgmap v3312: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 241 KiB/s wr, 10 op/s 2023-05-08T05:25:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6097.697648 secs 2023-05-08T05:25:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:25:59 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:25:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:59 smithi096 ceph-mon[124666]: pgmap v3312: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 241 KiB/s wr, 10 op/s 2023-05-08T05:25:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6097.697648 secs 2023-05-08T05:25:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:25:59 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:26:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6099.535124 secs 2023-05-08T05:26:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:01 smithi186 ceph-mon[126480]: pgmap v3313: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 343 KiB/s wr, 15 op/s 2023-05-08T05:26:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6099.535124 secs 2023-05-08T05:26:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:01 smithi133 ceph-mon[125939]: pgmap v3313: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 343 KiB/s wr, 15 op/s 2023-05-08T05:26:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6099.535124 secs 2023-05-08T05:26:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:01 smithi096 ceph-mon[124666]: pgmap v3313: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 343 KiB/s wr, 15 op/s 2023-05-08T05:26:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:02 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:26:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:02 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:26:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:02 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:26:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:03 smithi186 ceph-mon[126480]: pgmap v3314: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 138 KiB/s wr, 9 op/s 2023-05-08T05:26:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:26:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:03 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:26:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:03 smithi133 ceph-mon[125939]: pgmap v3314: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 138 KiB/s wr, 9 op/s 2023-05-08T05:26:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:26:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:03 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:26:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:03 smithi096 ceph-mon[124666]: pgmap v3314: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 138 KiB/s wr, 9 op/s 2023-05-08T05:26:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:26:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:03 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:26:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6102.697780 secs 2023-05-08T05:26:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6103.254912 secs 2023-05-08T05:26:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:04 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:26:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6102.697780 secs 2023-05-08T05:26:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6103.254912 secs 2023-05-08T05:26:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:04 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:26:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6102.697780 secs 2023-05-08T05:26:04.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6103.254912 secs 2023-05-08T05:26:04.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:04 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:26:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:05 smithi133 ceph-mon[125939]: pgmap v3315: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 138 KiB/s wr, 9 op/s 2023-05-08T05:26:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:05 smithi096 ceph-mon[124666]: pgmap v3315: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 138 KiB/s wr, 9 op/s 2023-05-08T05:26:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:05 smithi186 ceph-mon[126480]: pgmap v3315: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 138 KiB/s wr, 9 op/s 2023-05-08T05:26:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6104.535276 secs 2023-05-08T05:26:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6104.535276 secs 2023-05-08T05:26:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6104.535276 secs 2023-05-08T05:26:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:07 smithi133 ceph-mon[125939]: pgmap v3316: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 202 KiB/s wr, 28 op/s 2023-05-08T05:26:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:07 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:26:07.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:07 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:26:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:07 smithi096 ceph-mon[124666]: pgmap v3316: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 202 KiB/s wr, 28 op/s 2023-05-08T05:26:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:07 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:26:07.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:07 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:26:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:07 smithi186 ceph-mon[126480]: pgmap v3316: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 202 KiB/s wr, 28 op/s 2023-05-08T05:26:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:07 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:26:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:07 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:26:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:09 smithi133 ceph-mon[125939]: pgmap v3317: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 165 KiB/s wr, 23 op/s 2023-05-08T05:26:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6107.697924 secs 2023-05-08T05:26:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6108.255030 secs 2023-05-08T05:26:09.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:09 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:26:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:09 smithi096 ceph-mon[124666]: pgmap v3317: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 165 KiB/s wr, 23 op/s 2023-05-08T05:26:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6107.697924 secs 2023-05-08T05:26:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6108.255030 secs 2023-05-08T05:26:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:09 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:26:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:09 smithi186 ceph-mon[126480]: pgmap v3317: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 165 KiB/s wr, 23 op/s 2023-05-08T05:26:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6107.697924 secs 2023-05-08T05:26:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6108.255030 secs 2023-05-08T05:26:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:09 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:26:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6109.535414 secs 2023-05-08T05:26:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:11 smithi133 ceph-mon[125939]: pgmap v3318: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 197 KiB/s wr, 26 op/s 2023-05-08T05:26:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:11 smithi133 ceph-mon[125939]: osdmap e286: 12 total, 12 up, 12 in 2023-05-08T05:26:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6109.535414 secs 2023-05-08T05:26:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:11 smithi096 ceph-mon[124666]: pgmap v3318: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 197 KiB/s wr, 26 op/s 2023-05-08T05:26:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:11 smithi096 ceph-mon[124666]: osdmap e286: 12 total, 12 up, 12 in 2023-05-08T05:26:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6109.535414 secs 2023-05-08T05:26:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:11 smithi186 ceph-mon[126480]: pgmap v3318: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 197 KiB/s wr, 26 op/s 2023-05-08T05:26:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:11 smithi186 ceph-mon[126480]: osdmap e286: 12 total, 12 up, 12 in 2023-05-08T05:26:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:13 smithi133 ceph-mon[125939]: pgmap v3320: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 113 KiB/s wr, 26 op/s 2023-05-08T05:26:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:13 smithi096 ceph-mon[124666]: pgmap v3320: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 113 KiB/s wr, 26 op/s 2023-05-08T05:26:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:13 smithi186 ceph-mon[126480]: pgmap v3320: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 113 KiB/s wr, 26 op/s 2023-05-08T05:26:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6112.698037 secs 2023-05-08T05:26:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6113.255167 secs 2023-05-08T05:26:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6112.698037 secs 2023-05-08T05:26:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6113.255167 secs 2023-05-08T05:26:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6112.698037 secs 2023-05-08T05:26:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6113.255167 secs 2023-05-08T05:26:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:15 smithi133 ceph-mon[125939]: pgmap v3321: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 113 KiB/s wr, 26 op/s 2023-05-08T05:26:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:15 smithi096 ceph-mon[124666]: pgmap v3321: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 113 KiB/s wr, 26 op/s 2023-05-08T05:26:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:15 smithi186 ceph-mon[126480]: pgmap v3321: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 113 KiB/s wr, 26 op/s 2023-05-08T05:26:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6114.535553 secs 2023-05-08T05:26:16.762 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6114.535553 secs 2023-05-08T05:26:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6114.535553 secs 2023-05-08T05:26:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:17 smithi133 ceph-mon[125939]: pgmap v3322: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 37 KiB/s wr, 7 op/s 2023-05-08T05:26:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:17 smithi096 ceph-mon[124666]: pgmap v3322: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 37 KiB/s wr, 7 op/s 2023-05-08T05:26:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:17 smithi186 ceph-mon[126480]: pgmap v3322: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 37 KiB/s wr, 7 op/s 2023-05-08T05:26:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:19 smithi133 ceph-mon[125939]: pgmap v3323: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 37 KiB/s wr, 7 op/s 2023-05-08T05:26:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6117.698135 secs 2023-05-08T05:26:19.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6118.255282 secs 2023-05-08T05:26:19.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:19 smithi133 ceph-mon[125939]: osdmap e287: 12 total, 12 up, 12 in 2023-05-08T05:26:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:19 smithi096 ceph-mon[124666]: pgmap v3323: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 37 KiB/s wr, 7 op/s 2023-05-08T05:26:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6117.698135 secs 2023-05-08T05:26:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6118.255282 secs 2023-05-08T05:26:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:19 smithi096 ceph-mon[124666]: osdmap e287: 12 total, 12 up, 12 in 2023-05-08T05:26:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:19 smithi186 ceph-mon[126480]: pgmap v3323: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 37 KiB/s wr, 7 op/s 2023-05-08T05:26:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6117.698135 secs 2023-05-08T05:26:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6118.255282 secs 2023-05-08T05:26:19.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:19 smithi186 ceph-mon[126480]: osdmap e287: 12 total, 12 up, 12 in 2023-05-08T05:26:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6119.535692 secs 2023-05-08T05:26:21.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:21 smithi133 ceph-mon[125939]: pgmap v3325: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 648 B/s wr, 7 op/s 2023-05-08T05:26:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6119.535692 secs 2023-05-08T05:26:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:21 smithi096 ceph-mon[124666]: pgmap v3325: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 648 B/s wr, 7 op/s 2023-05-08T05:26:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6119.535692 secs 2023-05-08T05:26:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:21 smithi186 ceph-mon[126480]: pgmap v3325: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 648 B/s wr, 7 op/s 2023-05-08T05:26:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:23 smithi133 ceph-mon[125939]: pgmap v3326: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 818 B/s wr, 6 op/s 2023-05-08T05:26:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:23 smithi096 ceph-mon[124666]: pgmap v3326: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 818 B/s wr, 6 op/s 2023-05-08T05:26:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:23 smithi186 ceph-mon[126480]: pgmap v3326: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 818 B/s wr, 6 op/s 2023-05-08T05:26:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6122.698213 secs 2023-05-08T05:26:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6123.255438 secs 2023-05-08T05:26:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6122.698213 secs 2023-05-08T05:26:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6123.255438 secs 2023-05-08T05:26:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6122.698213 secs 2023-05-08T05:26:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6123.255438 secs 2023-05-08T05:26:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:25 smithi133 ceph-mon[125939]: pgmap v3327: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 818 B/s wr, 6 op/s 2023-05-08T05:26:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:25 smithi096 ceph-mon[124666]: pgmap v3327: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 818 B/s wr, 6 op/s 2023-05-08T05:26:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:25 smithi186 ceph-mon[126480]: pgmap v3327: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 818 B/s wr, 6 op/s 2023-05-08T05:26:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6124.535808 secs 2023-05-08T05:26:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6124.535808 secs 2023-05-08T05:26:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6124.535808 secs 2023-05-08T05:26:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:27 smithi133 ceph-mon[125939]: pgmap v3328: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 KiB/s wr, 7 op/s 2023-05-08T05:26:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:27 smithi096 ceph-mon[124666]: pgmap v3328: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 KiB/s wr, 7 op/s 2023-05-08T05:26:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:27 smithi186 ceph-mon[126480]: pgmap v3328: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 KiB/s wr, 7 op/s 2023-05-08T05:26:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:29 smithi133 ceph-mon[125939]: pgmap v3329: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 KiB/s wr, 7 op/s 2023-05-08T05:26:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6127.698330 secs 2023-05-08T05:26:29.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6128.255557 secs 2023-05-08T05:26:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:29 smithi096 ceph-mon[124666]: pgmap v3329: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 KiB/s wr, 7 op/s 2023-05-08T05:26:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6127.698330 secs 2023-05-08T05:26:29.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6128.255557 secs 2023-05-08T05:26:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:29 smithi186 ceph-mon[126480]: pgmap v3329: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 KiB/s wr, 7 op/s 2023-05-08T05:26:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6127.698330 secs 2023-05-08T05:26:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6128.255557 secs 2023-05-08T05:26:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6129.535923 secs 2023-05-08T05:26:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:31 smithi133 ceph-mon[125939]: pgmap v3330: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 39 KiB/s wr, 7 op/s 2023-05-08T05:26:31.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:31 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:26:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6129.535923 secs 2023-05-08T05:26:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:31 smithi096 ceph-mon[124666]: pgmap v3330: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 39 KiB/s wr, 7 op/s 2023-05-08T05:26:31.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:31 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:26:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6129.535923 secs 2023-05-08T05:26:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:31 smithi186 ceph-mon[126480]: pgmap v3330: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 39 KiB/s wr, 7 op/s 2023-05-08T05:26:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:31 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:26:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:33 smithi133 ceph-mon[125939]: pgmap v3331: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 6 op/s 2023-05-08T05:26:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:33 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:26:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:33 smithi096 ceph-mon[124666]: pgmap v3331: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 6 op/s 2023-05-08T05:26:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:33 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:26:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:33 smithi186 ceph-mon[126480]: pgmap v3331: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 6 op/s 2023-05-08T05:26:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:33 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:26:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6132.698441 secs 2023-05-08T05:26:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6133.255675 secs 2023-05-08T05:26:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:34 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:26:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:34 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:26:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:34 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:26:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6132.698441 secs 2023-05-08T05:26:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6133.255675 secs 2023-05-08T05:26:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:34 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:26:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:34 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:26:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:34 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:26:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6132.698441 secs 2023-05-08T05:26:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6133.255675 secs 2023-05-08T05:26:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:34 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:26:34.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:34 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:26:34.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:34 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:26:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:35 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:26:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:35 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T05:26:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:35 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T05:26:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:35 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:26:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:35 smithi133 ceph-mon[125939]: pgmap v3332: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T05:26:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:35 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:26:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:35 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T05:26:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:35 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T05:26:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:35 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:26:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:35 smithi096 ceph-mon[124666]: pgmap v3332: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T05:26:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:35 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:26:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:35 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T05:26:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:35 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T05:26:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:35 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:26:35.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:35 smithi186 ceph-mon[126480]: pgmap v3332: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T05:26:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:36 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:26:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:36 smithi186 ceph-mon[126480]: pgmap v3333: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 KiB/s wr, 9 op/s 2023-05-08T05:26:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:36 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:26:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:36 smithi133 ceph-mon[125939]: pgmap v3333: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 KiB/s wr, 9 op/s 2023-05-08T05:26:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:36 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:26:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:36 smithi096 ceph-mon[124666]: pgmap v3333: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 KiB/s wr, 9 op/s 2023-05-08T05:26:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:37 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:26:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:37 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:26:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:37 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:26:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:38 smithi133 ceph-mon[125939]: pgmap v3334: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 767 B/s wr, 6 op/s 2023-05-08T05:26:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:38 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:26:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:38 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:26:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:38 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:26:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6137.698570 secs 2023-05-08T05:26:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:38 smithi096 ceph-mon[124666]: pgmap v3334: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 767 B/s wr, 6 op/s 2023-05-08T05:26:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:38 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:26:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:38 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:26:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:38 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:26:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6137.698570 secs 2023-05-08T05:26:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:38 smithi186 ceph-mon[126480]: pgmap v3334: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 767 B/s wr, 6 op/s 2023-05-08T05:26:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:38 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:26:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:38 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:26:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:38 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:26:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6137.698570 secs 2023-05-08T05:26:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6138.255788 secs 2023-05-08T05:26:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:39 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:26:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6138.255788 secs 2023-05-08T05:26:40.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:39 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:26:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6138.255788 secs 2023-05-08T05:26:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:39 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:26:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:41 smithi133 ceph-mon[125939]: pgmap v3335: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 41 KiB/s wr, 9 op/s 2023-05-08T05:26:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:41 smithi096 ceph-mon[124666]: pgmap v3335: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 41 KiB/s wr, 9 op/s 2023-05-08T05:26:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:41 smithi186 ceph-mon[126480]: pgmap v3335: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 41 KiB/s wr, 9 op/s 2023-05-08T05:26:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:43 smithi133 ceph-mon[125939]: pgmap v3336: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 186 KiB/s wr, 7 op/s 2023-05-08T05:26:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:43 smithi096 ceph-mon[124666]: pgmap v3336: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 186 KiB/s wr, 7 op/s 2023-05-08T05:26:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:43 smithi186 ceph-mon[126480]: pgmap v3336: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 186 KiB/s wr, 7 op/s 2023-05-08T05:26:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6142.698647 secs 2023-05-08T05:26:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6142.698647 secs 2023-05-08T05:26:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6142.698647 secs 2023-05-08T05:26:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:45 smithi133 ceph-mon[125939]: pgmap v3337: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 186 KiB/s wr, 7 op/s 2023-05-08T05:26:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:45 smithi096 ceph-mon[124666]: pgmap v3337: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 186 KiB/s wr, 7 op/s 2023-05-08T05:26:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:45 smithi186 ceph-mon[126480]: pgmap v3337: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 186 KiB/s wr, 7 op/s 2023-05-08T05:26:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6144.536233 secs 2023-05-08T05:26:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:46 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:26:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6144.536233 secs 2023-05-08T05:26:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:46 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:26:46.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6144.536233 secs 2023-05-08T05:26:46.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:46 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:26:47.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:47 smithi133 ceph-mon[125939]: pgmap v3338: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 202 KiB/s wr, 12 op/s 2023-05-08T05:26:47.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:47 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:26:47.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:47 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:26:47.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:47 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:26:47.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:47 smithi096 ceph-mon[124666]: pgmap v3338: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 202 KiB/s wr, 12 op/s 2023-05-08T05:26:47.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:47 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:26:47.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:47 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:26:47.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:47 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:26:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:47 smithi186 ceph-mon[126480]: pgmap v3338: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 202 KiB/s wr, 12 op/s 2023-05-08T05:26:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:47 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:26:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:47 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:26:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:47 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:26:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:49 smithi133 ceph-mon[125939]: pgmap v3339: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 202 KiB/s wr, 9 op/s 2023-05-08T05:26:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6147.698709 secs 2023-05-08T05:26:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:26:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:49 smithi096 ceph-mon[124666]: pgmap v3339: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 202 KiB/s wr, 9 op/s 2023-05-08T05:26:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6147.698709 secs 2023-05-08T05:26:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:26:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:49 smithi186 ceph-mon[126480]: pgmap v3339: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 202 KiB/s wr, 9 op/s 2023-05-08T05:26:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6147.698709 secs 2023-05-08T05:26:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:26:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6148.256015 secs 2023-05-08T05:26:50.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:26:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6148.256015 secs 2023-05-08T05:26:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:26:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6148.256015 secs 2023-05-08T05:26:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:26:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6149.536352 secs 2023-05-08T05:26:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:51 smithi133 ceph-mon[125939]: pgmap v3340: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 204 KiB/s wr, 13 op/s 2023-05-08T05:26:51.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:51 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:26:51.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:26:51.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:26:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6149.536352 secs 2023-05-08T05:26:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:51 smithi096 ceph-mon[124666]: pgmap v3340: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 204 KiB/s wr, 13 op/s 2023-05-08T05:26:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:51 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:26:51.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:26:51.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:26:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6149.536352 secs 2023-05-08T05:26:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:51 smithi186 ceph-mon[126480]: pgmap v3340: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 204 KiB/s wr, 13 op/s 2023-05-08T05:26:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:51 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:26:51.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:26:51.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:26:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:53 smithi133 ceph-mon[125939]: pgmap v3341: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 304 KiB/s wr, 11 op/s 2023-05-08T05:26:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:53 smithi096 ceph-mon[124666]: pgmap v3341: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 304 KiB/s wr, 11 op/s 2023-05-08T05:26:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:53 smithi186 ceph-mon[126480]: pgmap v3341: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 304 KiB/s wr, 11 op/s 2023-05-08T05:26:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6152.698816 secs 2023-05-08T05:26:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:54 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:26:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6152.698816 secs 2023-05-08T05:26:54.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:54 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:26:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6152.698816 secs 2023-05-08T05:26:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:54 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:26:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:55 smithi133 ceph-mon[125939]: pgmap v3342: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 159 KiB/s wr, 10 op/s 2023-05-08T05:26:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:55 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:26:55.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:55 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:26:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:55 smithi096 ceph-mon[124666]: pgmap v3342: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 159 KiB/s wr, 10 op/s 2023-05-08T05:26:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:55 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:26:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:55 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:26:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:55 smithi186 ceph-mon[126480]: pgmap v3342: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 159 KiB/s wr, 10 op/s 2023-05-08T05:26:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:55 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:26:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:55 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:26:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6154.536506 secs 2023-05-08T05:26:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6154.536506 secs 2023-05-08T05:26:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6154.536506 secs 2023-05-08T05:26:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:57 smithi133 ceph-mon[125939]: pgmap v3343: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 196 KiB/s wr, 14 op/s 2023-05-08T05:26:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:57 smithi096 ceph-mon[124666]: pgmap v3343: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 196 KiB/s wr, 14 op/s 2023-05-08T05:26:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:57 smithi186 ceph-mon[126480]: pgmap v3343: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 196 KiB/s wr, 14 op/s 2023-05-08T05:26:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:59 smithi133 ceph-mon[125939]: pgmap v3344: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 180 KiB/s wr, 10 op/s 2023-05-08T05:26:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6157.698926 secs 2023-05-08T05:26:59.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:26:59 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:26:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:59 smithi096 ceph-mon[124666]: pgmap v3344: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 180 KiB/s wr, 10 op/s 2023-05-08T05:26:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6157.698926 secs 2023-05-08T05:26:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:26:59 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:26:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:59 smithi186 ceph-mon[126480]: pgmap v3344: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 180 KiB/s wr, 10 op/s 2023-05-08T05:26:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6157.698926 secs 2023-05-08T05:26:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:26:59 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:27:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6158.256259 secs 2023-05-08T05:27:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6158.256259 secs 2023-05-08T05:27:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6158.256259 secs 2023-05-08T05:27:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6159.536600 secs 2023-05-08T05:27:01.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:01 smithi133 ceph-mon[125939]: pgmap v3345: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 264 KiB/s wr, 13 op/s 2023-05-08T05:27:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6159.536600 secs 2023-05-08T05:27:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:01 smithi096 ceph-mon[124666]: pgmap v3345: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 264 KiB/s wr, 13 op/s 2023-05-08T05:27:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6159.536600 secs 2023-05-08T05:27:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:01 smithi186 ceph-mon[126480]: pgmap v3345: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 264 KiB/s wr, 13 op/s 2023-05-08T05:27:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:03 smithi133 ceph-mon[125939]: pgmap v3346: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 269 KiB/s wr, 9 op/s 2023-05-08T05:27:03.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:27:03.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:03 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:27:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:03 smithi096 ceph-mon[124666]: pgmap v3346: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 269 KiB/s wr, 9 op/s 2023-05-08T05:27:03.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:27:03.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:03 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:27:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:03 smithi186 ceph-mon[126480]: pgmap v3346: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 269 KiB/s wr, 9 op/s 2023-05-08T05:27:03.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:27:03.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:03 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:27:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6162.699036 secs 2023-05-08T05:27:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:04 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:27:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6162.699036 secs 2023-05-08T05:27:04.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:04 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:27:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6162.699036 secs 2023-05-08T05:27:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:04 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:27:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6163.256376 secs 2023-05-08T05:27:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:05 smithi133 ceph-mon[125939]: pgmap v3347: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 129 KiB/s wr, 8 op/s 2023-05-08T05:27:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6163.256376 secs 2023-05-08T05:27:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:05 smithi096 ceph-mon[124666]: pgmap v3347: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 129 KiB/s wr, 8 op/s 2023-05-08T05:27:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6163.256376 secs 2023-05-08T05:27:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:05 smithi186 ceph-mon[126480]: pgmap v3347: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 129 KiB/s wr, 8 op/s 2023-05-08T05:27:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6164.536681 secs 2023-05-08T05:27:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6164.536681 secs 2023-05-08T05:27:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6164.536681 secs 2023-05-08T05:27:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:07 smithi133 ceph-mon[125939]: pgmap v3348: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 201 KiB/s wr, 27 op/s 2023-05-08T05:27:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:07 smithi096 ceph-mon[124666]: pgmap v3348: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 201 KiB/s wr, 27 op/s 2023-05-08T05:27:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:07 smithi186 ceph-mon[126480]: pgmap v3348: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 201 KiB/s wr, 27 op/s 2023-05-08T05:27:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:09 smithi133 ceph-mon[125939]: pgmap v3349: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 163 KiB/s wr, 22 op/s 2023-05-08T05:27:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6167.699166 secs 2023-05-08T05:27:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:09 smithi096 ceph-mon[124666]: pgmap v3349: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 163 KiB/s wr, 22 op/s 2023-05-08T05:27:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6167.699166 secs 2023-05-08T05:27:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:09 smithi186 ceph-mon[126480]: pgmap v3349: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 163 KiB/s wr, 22 op/s 2023-05-08T05:27:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6167.699166 secs 2023-05-08T05:27:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6168.256491 secs 2023-05-08T05:27:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6168.256491 secs 2023-05-08T05:27:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6168.256491 secs 2023-05-08T05:27:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6169.536797 secs 2023-05-08T05:27:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:11 smithi133 ceph-mon[125939]: pgmap v3350: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 185 KiB/s wr, 25 op/s 2023-05-08T05:27:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:11 smithi133 ceph-mon[125939]: osdmap e288: 12 total, 12 up, 12 in 2023-05-08T05:27:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6169.536797 secs 2023-05-08T05:27:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:11 smithi096 ceph-mon[124666]: pgmap v3350: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 185 KiB/s wr, 25 op/s 2023-05-08T05:27:11.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:11 smithi096 ceph-mon[124666]: osdmap e288: 12 total, 12 up, 12 in 2023-05-08T05:27:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6169.536797 secs 2023-05-08T05:27:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:11 smithi186 ceph-mon[126480]: pgmap v3350: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 185 KiB/s wr, 25 op/s 2023-05-08T05:27:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:11 smithi186 ceph-mon[126480]: osdmap e288: 12 total, 12 up, 12 in 2023-05-08T05:27:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:13 smithi096 ceph-mon[124666]: pgmap v3352: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 113 KiB/s wr, 26 op/s 2023-05-08T05:27:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:13 smithi186 ceph-mon[126480]: pgmap v3352: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 113 KiB/s wr, 26 op/s 2023-05-08T05:27:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:13 smithi133 ceph-mon[125939]: pgmap v3352: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 113 KiB/s wr, 26 op/s 2023-05-08T05:27:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6172.699295 secs 2023-05-08T05:27:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6172.699295 secs 2023-05-08T05:27:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6172.699295 secs 2023-05-08T05:27:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6173.256604 secs 2023-05-08T05:27:15.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:15 smithi096 ceph-mon[124666]: pgmap v3353: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 113 KiB/s wr, 26 op/s 2023-05-08T05:27:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6173.256604 secs 2023-05-08T05:27:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:15 smithi186 ceph-mon[126480]: pgmap v3353: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 113 KiB/s wr, 26 op/s 2023-05-08T05:27:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6173.256604 secs 2023-05-08T05:27:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:15 smithi133 ceph-mon[125939]: pgmap v3353: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 113 KiB/s wr, 26 op/s 2023-05-08T05:27:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6174.536933 secs 2023-05-08T05:27:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6174.536933 secs 2023-05-08T05:27:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6174.536933 secs 2023-05-08T05:27:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:17 smithi186 ceph-mon[126480]: pgmap v3354: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 44 KiB/s wr, 7 op/s 2023-05-08T05:27:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:17 smithi133 ceph-mon[125939]: pgmap v3354: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 44 KiB/s wr, 7 op/s 2023-05-08T05:27:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:17 smithi096 ceph-mon[124666]: pgmap v3354: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 44 KiB/s wr, 7 op/s 2023-05-08T05:27:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:19 smithi186 ceph-mon[126480]: pgmap v3355: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 44 KiB/s wr, 7 op/s 2023-05-08T05:27:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6177.699411 secs 2023-05-08T05:27:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:19 smithi186 ceph-mon[126480]: osdmap e289: 12 total, 12 up, 12 in 2023-05-08T05:27:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:19 smithi133 ceph-mon[125939]: pgmap v3355: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 44 KiB/s wr, 7 op/s 2023-05-08T05:27:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6177.699411 secs 2023-05-08T05:27:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:19 smithi133 ceph-mon[125939]: osdmap e289: 12 total, 12 up, 12 in 2023-05-08T05:27:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:19 smithi096 ceph-mon[124666]: pgmap v3355: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 44 KiB/s wr, 7 op/s 2023-05-08T05:27:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6177.699411 secs 2023-05-08T05:27:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:19 smithi096 ceph-mon[124666]: osdmap e289: 12 total, 12 up, 12 in 2023-05-08T05:27:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6178.256720 secs 2023-05-08T05:27:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6178.256720 secs 2023-05-08T05:27:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6178.256720 secs 2023-05-08T05:27:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6179.537048 secs 2023-05-08T05:27:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:21 smithi186 ceph-mon[126480]: pgmap v3357: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 61 KiB/s wr, 8 op/s 2023-05-08T05:27:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6179.537048 secs 2023-05-08T05:27:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:21 smithi133 ceph-mon[125939]: pgmap v3357: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 61 KiB/s wr, 8 op/s 2023-05-08T05:27:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6179.537048 secs 2023-05-08T05:27:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:21 smithi096 ceph-mon[124666]: pgmap v3357: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 61 KiB/s wr, 8 op/s 2023-05-08T05:27:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:23 smithi186 ceph-mon[126480]: pgmap v3358: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 59 KiB/s wr, 8 op/s 2023-05-08T05:27:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:23 smithi133 ceph-mon[125939]: pgmap v3358: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 59 KiB/s wr, 8 op/s 2023-05-08T05:27:23.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:23 smithi096 ceph-mon[124666]: pgmap v3358: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 59 KiB/s wr, 8 op/s 2023-05-08T05:27:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6182.699527 secs 2023-05-08T05:27:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6182.699527 secs 2023-05-08T05:27:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6182.699527 secs 2023-05-08T05:27:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6183.256830 secs 2023-05-08T05:27:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:25 smithi186 ceph-mon[126480]: pgmap v3359: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 59 KiB/s wr, 8 op/s 2023-05-08T05:27:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6183.256830 secs 2023-05-08T05:27:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:25 smithi133 ceph-mon[125939]: pgmap v3359: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 59 KiB/s wr, 8 op/s 2023-05-08T05:27:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6183.256830 secs 2023-05-08T05:27:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:25 smithi096 ceph-mon[124666]: pgmap v3359: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 59 KiB/s wr, 8 op/s 2023-05-08T05:27:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6184.537169 secs 2023-05-08T05:27:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6184.537169 secs 2023-05-08T05:27:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6184.537169 secs 2023-05-08T05:27:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:27 smithi186 ceph-mon[126480]: pgmap v3360: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 42 KiB/s wr, 8 op/s 2023-05-08T05:27:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:27 smithi133 ceph-mon[125939]: pgmap v3360: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 42 KiB/s wr, 8 op/s 2023-05-08T05:27:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:27 smithi096 ceph-mon[124666]: pgmap v3360: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 42 KiB/s wr, 8 op/s 2023-05-08T05:27:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:29 smithi186 ceph-mon[126480]: pgmap v3361: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 42 KiB/s wr, 8 op/s 2023-05-08T05:27:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6187.699634 secs 2023-05-08T05:27:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:29 smithi133 ceph-mon[125939]: pgmap v3361: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 42 KiB/s wr, 8 op/s 2023-05-08T05:27:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6187.699634 secs 2023-05-08T05:27:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:29 smithi096 ceph-mon[124666]: pgmap v3361: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 42 KiB/s wr, 8 op/s 2023-05-08T05:27:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6187.699634 secs 2023-05-08T05:27:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6188.256919 secs 2023-05-08T05:27:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6188.256919 secs 2023-05-08T05:27:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6188.256919 secs 2023-05-08T05:27:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6189.537302 secs 2023-05-08T05:27:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:31 smithi186 ceph-mon[126480]: pgmap v3362: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 39 KiB/s wr, 7 op/s 2023-05-08T05:27:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6189.537302 secs 2023-05-08T05:27:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:31 smithi133 ceph-mon[125939]: pgmap v3362: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 39 KiB/s wr, 7 op/s 2023-05-08T05:27:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6189.537302 secs 2023-05-08T05:27:31.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:31 smithi096 ceph-mon[124666]: pgmap v3362: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 39 KiB/s wr, 7 op/s 2023-05-08T05:27:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:33 smithi186 ceph-mon[126480]: pgmap v3363: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 6 op/s 2023-05-08T05:27:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:33 smithi133 ceph-mon[125939]: pgmap v3363: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 6 op/s 2023-05-08T05:27:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:33 smithi096 ceph-mon[124666]: pgmap v3363: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 6 op/s 2023-05-08T05:27:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6192.699749 secs 2023-05-08T05:27:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:34 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:27:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:34 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:27:34.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:34 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:27:34.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:34 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:27:34.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:34 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:27:34.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:34 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:27:34.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:34 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:27:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6192.699749 secs 2023-05-08T05:27:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:34 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:27:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:34 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:27:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:34 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:27:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:34 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:27:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:34 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:27:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:34 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:27:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:34 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:27:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6192.699749 secs 2023-05-08T05:27:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:34 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:27:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:34 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:27:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:34 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:27:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:34 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:27:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:34 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:27:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:34 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:27:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:34 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:27:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6193.256981 secs 2023-05-08T05:27:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:35 smithi186 ceph-mon[126480]: pgmap v3364: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 6 op/s 2023-05-08T05:27:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:27:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:27:35.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:27:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6193.256981 secs 2023-05-08T05:27:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:35 smithi133 ceph-mon[125939]: pgmap v3364: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 6 op/s 2023-05-08T05:27:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:27:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:27:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:27:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6193.256981 secs 2023-05-08T05:27:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:35 smithi096 ceph-mon[124666]: pgmap v3364: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 6 op/s 2023-05-08T05:27:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:27:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:27:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:27:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:36 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:27:36.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:36 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T05:27:36.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:36 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T05:27:36.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:36 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:27:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:36 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:27:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:36 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T05:27:36.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:36 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T05:27:36.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:36 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:27:36.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:36 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:27:36.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:36 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T05:27:36.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:36 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T05:27:36.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:36 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:27:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:37 smithi186 ceph-mon[126480]: pgmap v3365: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 35 KiB/s wr, 9 op/s 2023-05-08T05:27:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:37 smithi133 ceph-mon[125939]: pgmap v3365: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 35 KiB/s wr, 9 op/s 2023-05-08T05:27:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:37 smithi096 ceph-mon[124666]: pgmap v3365: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 35 KiB/s wr, 9 op/s 2023-05-08T05:27:38.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:38 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:27:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:38 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:27:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:38 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:27:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:39 smithi186 ceph-mon[126480]: pgmap v3366: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 6 op/s 2023-05-08T05:27:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6197.699865 secs 2023-05-08T05:27:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:39 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:27:39.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:39 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:27:39.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:39 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:27:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:39 smithi133 ceph-mon[125939]: pgmap v3366: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 6 op/s 2023-05-08T05:27:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6197.699865 secs 2023-05-08T05:27:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:39 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:27:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:39 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:27:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:39 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:27:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:39 smithi096 ceph-mon[124666]: pgmap v3366: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 6 op/s 2023-05-08T05:27:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6197.699865 secs 2023-05-08T05:27:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:39 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:27:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:39 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:27:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:39 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:27:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6198.257118 secs 2023-05-08T05:27:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6198.257118 secs 2023-05-08T05:27:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6198.257118 secs 2023-05-08T05:27:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:41 smithi186 ceph-mon[126480]: pgmap v3367: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 71 KiB/s wr, 9 op/s 2023-05-08T05:27:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:41 smithi133 ceph-mon[125939]: pgmap v3367: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 71 KiB/s wr, 9 op/s 2023-05-08T05:27:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:41 smithi096 ceph-mon[124666]: pgmap v3367: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 71 KiB/s wr, 9 op/s 2023-05-08T05:27:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:43 smithi186 ceph-mon[126480]: pgmap v3368: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 5 op/s 2023-05-08T05:27:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:43 smithi133 ceph-mon[125939]: pgmap v3368: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 5 op/s 2023-05-08T05:27:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:43 smithi096 ceph-mon[124666]: pgmap v3368: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 5 op/s 2023-05-08T05:27:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6202.699967 secs 2023-05-08T05:27:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6202.699967 secs 2023-05-08T05:27:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6202.699967 secs 2023-05-08T05:27:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:45 smithi186 ceph-mon[126480]: pgmap v3369: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 5 op/s 2023-05-08T05:27:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:45 smithi133 ceph-mon[125939]: pgmap v3369: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 5 op/s 2023-05-08T05:27:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:45 smithi096 ceph-mon[124666]: pgmap v3369: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 5 op/s 2023-05-08T05:27:46.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:46 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:27:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:46 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:27:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:46 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:27:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:47 smithi186 ceph-mon[126480]: pgmap v3370: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 100 KiB/s wr, 10 op/s 2023-05-08T05:27:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:47 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:27:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:47 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:27:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:47 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:27:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:47 smithi133 ceph-mon[125939]: pgmap v3370: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 100 KiB/s wr, 10 op/s 2023-05-08T05:27:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:47 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:27:47.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:47 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:27:47.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:47 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:27:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:47 smithi096 ceph-mon[124666]: pgmap v3370: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 100 KiB/s wr, 10 op/s 2023-05-08T05:27:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:47 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:27:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:47 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:27:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:47 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:27:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:49 smithi186 ceph-mon[126480]: pgmap v3371: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 100 KiB/s wr, 7 op/s 2023-05-08T05:27:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6207.700063 secs 2023-05-08T05:27:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:49 smithi133 ceph-mon[125939]: pgmap v3371: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 100 KiB/s wr, 7 op/s 2023-05-08T05:27:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6207.700063 secs 2023-05-08T05:27:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:49 smithi096 ceph-mon[124666]: pgmap v3371: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 100 KiB/s wr, 7 op/s 2023-05-08T05:27:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6207.700063 secs 2023-05-08T05:27:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6209.537799 secs 2023-05-08T05:27:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:51 smithi186 ceph-mon[126480]: pgmap v3372: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 243 KiB/s wr, 12 op/s 2023-05-08T05:27:51.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:27:51.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:27:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6209.537799 secs 2023-05-08T05:27:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:51 smithi133 ceph-mon[125939]: pgmap v3372: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 243 KiB/s wr, 12 op/s 2023-05-08T05:27:51.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:27:51.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:27:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6209.537799 secs 2023-05-08T05:27:51.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:51 smithi096 ceph-mon[124666]: pgmap v3372: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 243 KiB/s wr, 12 op/s 2023-05-08T05:27:51.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:27:51.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:27:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:53 smithi133 ceph-mon[125939]: pgmap v3373: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 207 KiB/s wr, 9 op/s 2023-05-08T05:27:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:53 smithi096 ceph-mon[124666]: pgmap v3373: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 207 KiB/s wr, 9 op/s 2023-05-08T05:27:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:53 smithi186 ceph-mon[126480]: pgmap v3373: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 207 KiB/s wr, 9 op/s 2023-05-08T05:27:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6212.700176 secs 2023-05-08T05:27:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:54 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:27:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6212.700176 secs 2023-05-08T05:27:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:54 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:27:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6212.700176 secs 2023-05-08T05:27:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:54 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:27:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6213.257450 secs 2023-05-08T05:27:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:55 smithi133 ceph-mon[125939]: pgmap v3374: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 207 KiB/s wr, 9 op/s 2023-05-08T05:27:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:55 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:27:55.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:55 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:27:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6213.257450 secs 2023-05-08T05:27:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:55 smithi096 ceph-mon[124666]: pgmap v3374: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 207 KiB/s wr, 9 op/s 2023-05-08T05:27:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:55 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:27:55.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:55 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:27:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6213.257450 secs 2023-05-08T05:27:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:55 smithi186 ceph-mon[126480]: pgmap v3374: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 207 KiB/s wr, 9 op/s 2023-05-08T05:27:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:55 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:27:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:55 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:27:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6214.537928 secs 2023-05-08T05:27:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6214.537928 secs 2023-05-08T05:27:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6214.537928 secs 2023-05-08T05:27:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:57 smithi133 ceph-mon[125939]: pgmap v3375: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 250 KiB/s wr, 14 op/s 2023-05-08T05:27:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:57 smithi096 ceph-mon[124666]: pgmap v3375: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 250 KiB/s wr, 14 op/s 2023-05-08T05:27:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:57 smithi186 ceph-mon[126480]: pgmap v3375: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 250 KiB/s wr, 14 op/s 2023-05-08T05:27:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:59 smithi133 ceph-mon[125939]: pgmap v3376: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 186 KiB/s wr, 9 op/s 2023-05-08T05:27:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6217.700289 secs 2023-05-08T05:27:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:27:59 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:27:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:59 smithi096 ceph-mon[124666]: pgmap v3376: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 186 KiB/s wr, 9 op/s 2023-05-08T05:27:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6217.700289 secs 2023-05-08T05:27:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:27:59 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:27:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:59 smithi186 ceph-mon[126480]: pgmap v3376: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 186 KiB/s wr, 9 op/s 2023-05-08T05:27:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6217.700289 secs 2023-05-08T05:27:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:27:59 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:28:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6219.538018 secs 2023-05-08T05:28:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:01 smithi133 ceph-mon[125939]: pgmap v3377: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 295 KiB/s wr, 15 op/s 2023-05-08T05:28:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6219.538018 secs 2023-05-08T05:28:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:01 smithi096 ceph-mon[124666]: pgmap v3377: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 295 KiB/s wr, 15 op/s 2023-05-08T05:28:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6219.538018 secs 2023-05-08T05:28:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:01 smithi186 ceph-mon[126480]: pgmap v3377: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 295 KiB/s wr, 15 op/s 2023-05-08T05:28:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:02 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:28:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:02 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:28:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:02 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:28:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:03 smithi133 ceph-mon[125939]: pgmap v3378: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 152 KiB/s wr, 10 op/s 2023-05-08T05:28:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:28:03.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:03 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:28:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:03 smithi096 ceph-mon[124666]: pgmap v3378: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 152 KiB/s wr, 10 op/s 2023-05-08T05:28:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:28:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:03 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:28:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:03 smithi186 ceph-mon[126480]: pgmap v3378: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 152 KiB/s wr, 10 op/s 2023-05-08T05:28:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:28:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:03 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:28:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6222.700401 secs 2023-05-08T05:28:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6223.257654 secs 2023-05-08T05:28:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:04 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:28:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6222.700401 secs 2023-05-08T05:28:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6223.257654 secs 2023-05-08T05:28:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:04 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:28:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6222.700401 secs 2023-05-08T05:28:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6223.257654 secs 2023-05-08T05:28:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:04 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:28:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:05 smithi133 ceph-mon[125939]: pgmap v3379: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 152 KiB/s wr, 10 op/s 2023-05-08T05:28:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:05 smithi096 ceph-mon[124666]: pgmap v3379: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 152 KiB/s wr, 10 op/s 2023-05-08T05:28:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:05 smithi186 ceph-mon[126480]: pgmap v3379: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 152 KiB/s wr, 10 op/s 2023-05-08T05:28:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6224.538138 secs 2023-05-08T05:28:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6224.538138 secs 2023-05-08T05:28:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6224.538138 secs 2023-05-08T05:28:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:07 smithi133 ceph-mon[125939]: pgmap v3380: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 230 KiB/s wr, 29 op/s 2023-05-08T05:28:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:07 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:28:07.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:07 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:28:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:07 smithi096 ceph-mon[124666]: pgmap v3380: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 230 KiB/s wr, 29 op/s 2023-05-08T05:28:07.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:07 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:28:07.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:07 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:28:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:07 smithi186 ceph-mon[126480]: pgmap v3380: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 230 KiB/s wr, 29 op/s 2023-05-08T05:28:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:07 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:28:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:07 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:28:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:09 smithi133 ceph-mon[125939]: pgmap v3381: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 188 KiB/s wr, 24 op/s 2023-05-08T05:28:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6227.700523 secs 2023-05-08T05:28:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6228.257770 secs 2023-05-08T05:28:09.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:09 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:28:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:09 smithi096 ceph-mon[124666]: pgmap v3381: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 188 KiB/s wr, 24 op/s 2023-05-08T05:28:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6227.700523 secs 2023-05-08T05:28:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6228.257770 secs 2023-05-08T05:28:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:09 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:28:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:09 smithi186 ceph-mon[126480]: pgmap v3381: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 188 KiB/s wr, 24 op/s 2023-05-08T05:28:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6227.700523 secs 2023-05-08T05:28:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6228.257770 secs 2023-05-08T05:28:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:09 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:28:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6229.538234 secs 2023-05-08T05:28:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:11 smithi133 ceph-mon[125939]: pgmap v3382: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 210 KiB/s wr, 27 op/s 2023-05-08T05:28:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:11 smithi133 ceph-mon[125939]: osdmap e290: 12 total, 12 up, 12 in 2023-05-08T05:28:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6229.538234 secs 2023-05-08T05:28:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:11 smithi096 ceph-mon[124666]: pgmap v3382: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 210 KiB/s wr, 27 op/s 2023-05-08T05:28:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:11 smithi096 ceph-mon[124666]: osdmap e290: 12 total, 12 up, 12 in 2023-05-08T05:28:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6229.538234 secs 2023-05-08T05:28:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:11 smithi186 ceph-mon[126480]: pgmap v3382: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 210 KiB/s wr, 27 op/s 2023-05-08T05:28:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:11 smithi186 ceph-mon[126480]: osdmap e290: 12 total, 12 up, 12 in 2023-05-08T05:28:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:13 smithi133 ceph-mon[125939]: pgmap v3384: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 120 KiB/s wr, 26 op/s 2023-05-08T05:28:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:13 smithi096 ceph-mon[124666]: pgmap v3384: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 120 KiB/s wr, 26 op/s 2023-05-08T05:28:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:13 smithi186 ceph-mon[126480]: pgmap v3384: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 120 KiB/s wr, 26 op/s 2023-05-08T05:28:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6232.700637 secs 2023-05-08T05:28:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6233.257837 secs 2023-05-08T05:28:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6232.700637 secs 2023-05-08T05:28:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6233.257837 secs 2023-05-08T05:28:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6232.700637 secs 2023-05-08T05:28:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6233.257837 secs 2023-05-08T05:28:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:15 smithi133 ceph-mon[125939]: pgmap v3385: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 120 KiB/s wr, 26 op/s 2023-05-08T05:28:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:15 smithi096 ceph-mon[124666]: pgmap v3385: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 120 KiB/s wr, 26 op/s 2023-05-08T05:28:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:15 smithi186 ceph-mon[126480]: pgmap v3385: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 120 KiB/s wr, 26 op/s 2023-05-08T05:28:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6234.538350 secs 2023-05-08T05:28:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6234.538350 secs 2023-05-08T05:28:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6234.538350 secs 2023-05-08T05:28:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:17 smithi133 ceph-mon[125939]: pgmap v3386: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 KiB/s wr, 6 op/s 2023-05-08T05:28:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:17 smithi096 ceph-mon[124666]: pgmap v3386: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 KiB/s wr, 6 op/s 2023-05-08T05:28:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:17 smithi186 ceph-mon[126480]: pgmap v3386: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 KiB/s wr, 6 op/s 2023-05-08T05:28:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:19 smithi133 ceph-mon[125939]: pgmap v3387: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 KiB/s wr, 6 op/s 2023-05-08T05:28:19.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6237.700727 secs 2023-05-08T05:28:19.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6238.257931 secs 2023-05-08T05:28:19.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:19 smithi133 ceph-mon[125939]: osdmap e291: 12 total, 12 up, 12 in 2023-05-08T05:28:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:19 smithi096 ceph-mon[124666]: pgmap v3387: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 KiB/s wr, 6 op/s 2023-05-08T05:28:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6237.700727 secs 2023-05-08T05:28:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6238.257931 secs 2023-05-08T05:28:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:19 smithi096 ceph-mon[124666]: osdmap e291: 12 total, 12 up, 12 in 2023-05-08T05:28:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:19 smithi186 ceph-mon[126480]: pgmap v3387: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 KiB/s wr, 6 op/s 2023-05-08T05:28:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6237.700727 secs 2023-05-08T05:28:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6238.257931 secs 2023-05-08T05:28:19.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:19 smithi186 ceph-mon[126480]: osdmap e291: 12 total, 12 up, 12 in 2023-05-08T05:28:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6239.538471 secs 2023-05-08T05:28:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:21 smithi133 ceph-mon[125939]: pgmap v3389: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 756 B/s wr, 7 op/s 2023-05-08T05:28:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6239.538471 secs 2023-05-08T05:28:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:21 smithi096 ceph-mon[124666]: pgmap v3389: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 756 B/s wr, 7 op/s 2023-05-08T05:28:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6239.538471 secs 2023-05-08T05:28:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:21 smithi186 ceph-mon[126480]: pgmap v3389: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 756 B/s wr, 7 op/s 2023-05-08T05:28:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:23 smithi133 ceph-mon[125939]: pgmap v3390: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 716 B/s wr, 6 op/s 2023-05-08T05:28:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:23 smithi096 ceph-mon[124666]: pgmap v3390: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 716 B/s wr, 6 op/s 2023-05-08T05:28:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:23 smithi186 ceph-mon[126480]: pgmap v3390: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 716 B/s wr, 6 op/s 2023-05-08T05:28:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6242.700842 secs 2023-05-08T05:28:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6243.258028 secs 2023-05-08T05:28:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6242.700842 secs 2023-05-08T05:28:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6243.258028 secs 2023-05-08T05:28:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6242.700842 secs 2023-05-08T05:28:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6243.258028 secs 2023-05-08T05:28:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:25 smithi133 ceph-mon[125939]: pgmap v3391: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 716 B/s wr, 6 op/s 2023-05-08T05:28:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:25 smithi096 ceph-mon[124666]: pgmap v3391: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 716 B/s wr, 6 op/s 2023-05-08T05:28:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:25 smithi186 ceph-mon[126480]: pgmap v3391: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 716 B/s wr, 6 op/s 2023-05-08T05:28:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6244.538627 secs 2023-05-08T05:28:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6244.538627 secs 2023-05-08T05:28:26.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6244.538627 secs 2023-05-08T05:28:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:27 smithi133 ceph-mon[125939]: pgmap v3392: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 42 KiB/s wr, 8 op/s 2023-05-08T05:28:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:27 smithi096 ceph-mon[124666]: pgmap v3392: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 42 KiB/s wr, 8 op/s 2023-05-08T05:28:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:27 smithi186 ceph-mon[126480]: pgmap v3392: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 42 KiB/s wr, 8 op/s 2023-05-08T05:28:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:29 smithi133 ceph-mon[125939]: pgmap v3393: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 42 KiB/s wr, 8 op/s 2023-05-08T05:28:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6247.700962 secs 2023-05-08T05:28:29.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6248.258153 secs 2023-05-08T05:28:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:29 smithi096 ceph-mon[124666]: pgmap v3393: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 42 KiB/s wr, 8 op/s 2023-05-08T05:28:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6247.700962 secs 2023-05-08T05:28:29.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6248.258153 secs 2023-05-08T05:28:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:29 smithi186 ceph-mon[126480]: pgmap v3393: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 42 KiB/s wr, 8 op/s 2023-05-08T05:28:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6247.700962 secs 2023-05-08T05:28:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6248.258153 secs 2023-05-08T05:28:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6249.538692 secs 2023-05-08T05:28:31.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:31 smithi133 ceph-mon[125939]: pgmap v3394: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 120 KiB/s wr, 8 op/s 2023-05-08T05:28:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6249.538692 secs 2023-05-08T05:28:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:31 smithi096 ceph-mon[124666]: pgmap v3394: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 120 KiB/s wr, 8 op/s 2023-05-08T05:28:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6249.538692 secs 2023-05-08T05:28:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:31 smithi186 ceph-mon[126480]: pgmap v3394: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 120 KiB/s wr, 8 op/s 2023-05-08T05:28:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:33 smithi133 ceph-mon[125939]: pgmap v3395: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 107 KiB/s wr, 7 op/s 2023-05-08T05:28:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:33 smithi096 ceph-mon[124666]: pgmap v3395: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 107 KiB/s wr, 7 op/s 2023-05-08T05:28:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:33 smithi186 ceph-mon[126480]: pgmap v3395: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 107 KiB/s wr, 7 op/s 2023-05-08T05:28:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6252.701068 secs 2023-05-08T05:28:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6253.258295 secs 2023-05-08T05:28:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6252.701068 secs 2023-05-08T05:28:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6253.258295 secs 2023-05-08T05:28:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6252.701068 secs 2023-05-08T05:28:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6253.258295 secs 2023-05-08T05:28:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:35 smithi096 ceph-mon[124666]: pgmap v3396: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 107 KiB/s wr, 7 op/s 2023-05-08T05:28:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:28:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:35 smithi186 ceph-mon[126480]: pgmap v3396: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 107 KiB/s wr, 7 op/s 2023-05-08T05:28:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:28:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:35 smithi133 ceph-mon[125939]: pgmap v3396: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 107 KiB/s wr, 7 op/s 2023-05-08T05:28:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:28:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6254.538813 secs 2023-05-08T05:28:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:28:36.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:28:36.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:28:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6254.538813 secs 2023-05-08T05:28:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:28:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:28:36.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:28:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6254.538813 secs 2023-05-08T05:28:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:28:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:28:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:28:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:37 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:28:37.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:37 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T05:28:37.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:37 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T05:28:37.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:37 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:28:37.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:37 smithi096 ceph-mon[124666]: pgmap v3397: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 178 KiB/s wr, 11 op/s 2023-05-08T05:28:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:37 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:28:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:37 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T05:28:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:37 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T05:28:37.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:37 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:28:37.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:37 smithi186 ceph-mon[126480]: pgmap v3397: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 178 KiB/s wr, 11 op/s 2023-05-08T05:28:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:37 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:28:37.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:37 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T05:28:37.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:37 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T05:28:37.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:37 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:28:37.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:37 smithi133 ceph-mon[125939]: pgmap v3397: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 178 KiB/s wr, 11 op/s 2023-05-08T05:28:39.500 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:39 smithi186 ceph-mon[126480]: pgmap v3398: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 143 KiB/s wr, 7 op/s 2023-05-08T05:28:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:39 smithi096 ceph-mon[124666]: pgmap v3398: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 143 KiB/s wr, 7 op/s 2023-05-08T05:28:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6257.701209 secs 2023-05-08T05:28:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6257.701209 secs 2023-05-08T05:28:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:39 smithi133 ceph-mon[125939]: pgmap v3398: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 143 KiB/s wr, 7 op/s 2023-05-08T05:28:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6257.701209 secs 2023-05-08T05:28:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6259.538949 secs 2023-05-08T05:28:41.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:41 smithi096 ceph-mon[124666]: pgmap v3399: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 182 KiB/s wr, 12 op/s 2023-05-08T05:28:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6259.538949 secs 2023-05-08T05:28:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:41 smithi186 ceph-mon[126480]: pgmap v3399: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 182 KiB/s wr, 12 op/s 2023-05-08T05:28:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6259.538949 secs 2023-05-08T05:28:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:41 smithi133 ceph-mon[125939]: pgmap v3399: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 182 KiB/s wr, 12 op/s 2023-05-08T05:28:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:28:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:28:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:28:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:43 smithi096 ceph-mon[124666]: pgmap v3400: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 109 KiB/s wr, 8 op/s 2023-05-08T05:28:43.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:43 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:28:43.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:28:43.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:28:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:43 smithi186 ceph-mon[126480]: pgmap v3400: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 109 KiB/s wr, 8 op/s 2023-05-08T05:28:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:43 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:28:43.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:28:43.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:28:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:43 smithi133 ceph-mon[125939]: pgmap v3400: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 109 KiB/s wr, 8 op/s 2023-05-08T05:28:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:43 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:28:43.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:28:43.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:28:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6262.701349 secs 2023-05-08T05:28:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6262.701349 secs 2023-05-08T05:28:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6262.701349 secs 2023-05-08T05:28:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:45 smithi186 ceph-mon[126480]: pgmap v3401: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 109 KiB/s wr, 8 op/s 2023-05-08T05:28:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:45 smithi133 ceph-mon[125939]: pgmap v3401: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 109 KiB/s wr, 8 op/s 2023-05-08T05:28:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:45 smithi096 ceph-mon[124666]: pgmap v3401: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 109 KiB/s wr, 8 op/s 2023-05-08T05:28:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6264.539070 secs 2023-05-08T05:28:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6264.539070 secs 2023-05-08T05:28:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6264.539070 secs 2023-05-08T05:28:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:47 smithi186 ceph-mon[126480]: pgmap v3402: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 262 KiB/s wr, 13 op/s 2023-05-08T05:28:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:47 smithi133 ceph-mon[125939]: pgmap v3402: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 262 KiB/s wr, 13 op/s 2023-05-08T05:28:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:47 smithi096 ceph-mon[124666]: pgmap v3402: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 262 KiB/s wr, 13 op/s 2023-05-08T05:28:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:49 smithi186 ceph-mon[126480]: pgmap v3403: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 192 KiB/s wr, 9 op/s 2023-05-08T05:28:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6267.701426 secs 2023-05-08T05:28:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6268.258608 secs 2023-05-08T05:28:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:49 smithi133 ceph-mon[125939]: pgmap v3403: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 192 KiB/s wr, 9 op/s 2023-05-08T05:28:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6267.701426 secs 2023-05-08T05:28:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6268.258608 secs 2023-05-08T05:28:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:49 smithi096 ceph-mon[124666]: pgmap v3403: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 192 KiB/s wr, 9 op/s 2023-05-08T05:28:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6267.701426 secs 2023-05-08T05:28:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6268.258608 secs 2023-05-08T05:28:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:50 smithi186 ceph-mon[126480]: pgmap v3404: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 279 KiB/s wr, 14 op/s 2023-05-08T05:28:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:50 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:28:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:28:50.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:28:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:50 smithi133 ceph-mon[125939]: pgmap v3404: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 279 KiB/s wr, 14 op/s 2023-05-08T05:28:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:50 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:28:50.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:28:50.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:28:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:50 smithi096 ceph-mon[124666]: pgmap v3404: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 279 KiB/s wr, 14 op/s 2023-05-08T05:28:51.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:50 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:28:51.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:28:51.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:28:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6269.539189 secs 2023-05-08T05:28:51.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6269.539189 secs 2023-05-08T05:28:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6269.539189 secs 2023-05-08T05:28:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:52 smithi186 ceph-mon[126480]: pgmap v3405: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 241 KiB/s wr, 10 op/s 2023-05-08T05:28:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:52 smithi133 ceph-mon[125939]: pgmap v3405: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 241 KiB/s wr, 10 op/s 2023-05-08T05:28:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:52 smithi096 ceph-mon[124666]: pgmap v3405: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 241 KiB/s wr, 10 op/s 2023-05-08T05:28:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6272.701564 secs 2023-05-08T05:28:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6272.701564 secs 2023-05-08T05:28:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6272.701564 secs 2023-05-08T05:28:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6273.258733 secs 2023-05-08T05:28:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:55 smithi133 ceph-mon[125939]: pgmap v3406: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 241 KiB/s wr, 9 op/s 2023-05-08T05:28:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6273.258733 secs 2023-05-08T05:28:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:55 smithi096 ceph-mon[124666]: pgmap v3406: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 241 KiB/s wr, 9 op/s 2023-05-08T05:28:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6273.258733 secs 2023-05-08T05:28:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:55 smithi186 ceph-mon[126480]: pgmap v3406: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 241 KiB/s wr, 9 op/s 2023-05-08T05:28:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6274.539287 secs 2023-05-08T05:28:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6274.539287 secs 2023-05-08T05:28:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6274.539287 secs 2023-05-08T05:28:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:57 smithi133 ceph-mon[125939]: pgmap v3407: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 352 KiB/s rd, 340 KiB/s wr, 14 op/s 2023-05-08T05:28:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:57 smithi096 ceph-mon[124666]: pgmap v3407: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 352 KiB/s rd, 340 KiB/s wr, 14 op/s 2023-05-08T05:28:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:57 smithi186 ceph-mon[126480]: pgmap v3407: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 352 KiB/s rd, 340 KiB/s wr, 14 op/s 2023-05-08T05:28:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:59 smithi133 ceph-mon[125939]: pgmap v3408: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 186 KiB/s wr, 9 op/s 2023-05-08T05:28:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:28:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6277.701687 secs 2023-05-08T05:28:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:59 smithi096 ceph-mon[124666]: pgmap v3408: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 186 KiB/s wr, 9 op/s 2023-05-08T05:28:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:28:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6277.701687 secs 2023-05-08T05:28:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:59 smithi186 ceph-mon[126480]: pgmap v3408: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 186 KiB/s wr, 9 op/s 2023-05-08T05:28:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:28:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6277.701687 secs 2023-05-08T05:29:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6278.258846 secs 2023-05-08T05:29:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6278.258846 secs 2023-05-08T05:29:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6278.258846 secs 2023-05-08T05:29:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6279.539363 secs 2023-05-08T05:29:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:01 smithi133 ceph-mon[125939]: pgmap v3409: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 230 KiB/s wr, 14 op/s 2023-05-08T05:29:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6279.539363 secs 2023-05-08T05:29:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:01 smithi096 ceph-mon[124666]: pgmap v3409: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 230 KiB/s wr, 14 op/s 2023-05-08T05:29:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6279.539363 secs 2023-05-08T05:29:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:01 smithi186 ceph-mon[126480]: pgmap v3409: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 230 KiB/s wr, 14 op/s 2023-05-08T05:29:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:03 smithi133 ceph-mon[125939]: pgmap v3410: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 142 KiB/s wr, 9 op/s 2023-05-08T05:29:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:03 smithi096 ceph-mon[124666]: pgmap v3410: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 142 KiB/s wr, 9 op/s 2023-05-08T05:29:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:03 smithi186 ceph-mon[126480]: pgmap v3410: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 142 KiB/s wr, 9 op/s 2023-05-08T05:29:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6282.701764 secs 2023-05-08T05:29:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6282.701764 secs 2023-05-08T05:29:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6282.701764 secs 2023-05-08T05:29:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6283.258973 secs 2023-05-08T05:29:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:05 smithi133 ceph-mon[125939]: pgmap v3411: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 142 KiB/s wr, 9 op/s 2023-05-08T05:29:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6283.258973 secs 2023-05-08T05:29:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:05 smithi096 ceph-mon[124666]: pgmap v3411: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 142 KiB/s wr, 9 op/s 2023-05-08T05:29:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6283.258973 secs 2023-05-08T05:29:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:05 smithi186 ceph-mon[126480]: pgmap v3411: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 142 KiB/s wr, 9 op/s 2023-05-08T05:29:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6284.539480 secs 2023-05-08T05:29:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:06 smithi133 ceph-mon[125939]: osdmap e292: 12 total, 12 up, 12 in 2023-05-08T05:29:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6284.539480 secs 2023-05-08T05:29:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:06 smithi096 ceph-mon[124666]: osdmap e292: 12 total, 12 up, 12 in 2023-05-08T05:29:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6284.539480 secs 2023-05-08T05:29:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:06 smithi186 ceph-mon[126480]: osdmap e292: 12 total, 12 up, 12 in 2023-05-08T05:29:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:07 smithi133 ceph-mon[125939]: pgmap v3413: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 202 KiB/s wr, 27 op/s 2023-05-08T05:29:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:07 smithi096 ceph-mon[124666]: pgmap v3413: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 202 KiB/s wr, 27 op/s 2023-05-08T05:29:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:07 smithi186 ceph-mon[126480]: pgmap v3413: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 202 KiB/s wr, 27 op/s 2023-05-08T05:29:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:09 smithi133 ceph-mon[125939]: pgmap v3414: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 202 KiB/s wr, 27 op/s 2023-05-08T05:29:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6287.701882 secs 2023-05-08T05:29:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:09 smithi096 ceph-mon[124666]: pgmap v3414: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 202 KiB/s wr, 27 op/s 2023-05-08T05:29:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6287.701882 secs 2023-05-08T05:29:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:09 smithi186 ceph-mon[126480]: pgmap v3414: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 202 KiB/s wr, 27 op/s 2023-05-08T05:29:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6287.701882 secs 2023-05-08T05:29:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6288.259084 secs 2023-05-08T05:29:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6288.259084 secs 2023-05-08T05:29:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6288.259084 secs 2023-05-08T05:29:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6289.539588 secs 2023-05-08T05:29:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:11 smithi133 ceph-mon[125939]: pgmap v3415: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 183 KiB/s wr, 26 op/s 2023-05-08T05:29:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6289.539588 secs 2023-05-08T05:29:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:11 smithi096 ceph-mon[124666]: pgmap v3415: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 183 KiB/s wr, 26 op/s 2023-05-08T05:29:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6289.539588 secs 2023-05-08T05:29:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:11 smithi186 ceph-mon[126480]: pgmap v3415: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 183 KiB/s wr, 26 op/s 2023-05-08T05:29:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:13 smithi133 ceph-mon[125939]: pgmap v3416: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 183 KiB/s wr, 26 op/s 2023-05-08T05:29:13.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:13 smithi096 ceph-mon[124666]: pgmap v3416: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 183 KiB/s wr, 26 op/s 2023-05-08T05:29:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:13 smithi186 ceph-mon[126480]: pgmap v3416: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 183 KiB/s wr, 26 op/s 2023-05-08T05:29:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6292.701992 secs 2023-05-08T05:29:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:14 smithi096 ceph-mon[124666]: osdmap e293: 12 total, 12 up, 12 in 2023-05-08T05:29:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6292.701992 secs 2023-05-08T05:29:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:14 smithi186 ceph-mon[126480]: osdmap e293: 12 total, 12 up, 12 in 2023-05-08T05:29:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6292.701992 secs 2023-05-08T05:29:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:14 smithi133 ceph-mon[125939]: osdmap e293: 12 total, 12 up, 12 in 2023-05-08T05:29:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6293.259203 secs 2023-05-08T05:29:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:15 smithi096 ceph-mon[124666]: pgmap v3417: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 183 KiB/s wr, 26 op/s 2023-05-08T05:29:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6293.259203 secs 2023-05-08T05:29:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:15 smithi186 ceph-mon[126480]: pgmap v3417: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 183 KiB/s wr, 26 op/s 2023-05-08T05:29:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6293.259203 secs 2023-05-08T05:29:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:15 smithi133 ceph-mon[125939]: pgmap v3417: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 183 KiB/s wr, 26 op/s 2023-05-08T05:29:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6294.539725 secs 2023-05-08T05:29:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6294.539725 secs 2023-05-08T05:29:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6294.539725 secs 2023-05-08T05:29:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:17 smithi186 ceph-mon[126480]: pgmap v3419: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 60 KiB/s wr, 8 op/s 2023-05-08T05:29:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:17 smithi133 ceph-mon[125939]: pgmap v3419: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 60 KiB/s wr, 8 op/s 2023-05-08T05:29:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:17 smithi096 ceph-mon[124666]: pgmap v3419: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 60 KiB/s wr, 8 op/s 2023-05-08T05:29:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:19 smithi186 ceph-mon[126480]: pgmap v3420: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 60 KiB/s wr, 8 op/s 2023-05-08T05:29:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6297.702070 secs 2023-05-08T05:29:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:19 smithi133 ceph-mon[125939]: pgmap v3420: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 60 KiB/s wr, 8 op/s 2023-05-08T05:29:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6297.702070 secs 2023-05-08T05:29:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:19 smithi096 ceph-mon[124666]: pgmap v3420: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 60 KiB/s wr, 8 op/s 2023-05-08T05:29:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6297.702070 secs 2023-05-08T05:29:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6298.259318 secs 2023-05-08T05:29:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6298.259318 secs 2023-05-08T05:29:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6298.259318 secs 2023-05-08T05:29:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6299.539864 secs 2023-05-08T05:29:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:21 smithi186 ceph-mon[126480]: pgmap v3421: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 123 KiB/s wr, 9 op/s 2023-05-08T05:29:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6299.539864 secs 2023-05-08T05:29:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:21 smithi133 ceph-mon[125939]: pgmap v3421: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 123 KiB/s wr, 9 op/s 2023-05-08T05:29:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6299.539864 secs 2023-05-08T05:29:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:21 smithi096 ceph-mon[124666]: pgmap v3421: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 123 KiB/s wr, 9 op/s 2023-05-08T05:29:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:23 smithi186 ceph-mon[126480]: pgmap v3422: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 123 KiB/s wr, 9 op/s 2023-05-08T05:29:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:23 smithi133 ceph-mon[125939]: pgmap v3422: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 123 KiB/s wr, 9 op/s 2023-05-08T05:29:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:23 smithi096 ceph-mon[124666]: pgmap v3422: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 123 KiB/s wr, 9 op/s 2023-05-08T05:29:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6302.702182 secs 2023-05-08T05:29:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6302.702182 secs 2023-05-08T05:29:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6302.702182 secs 2023-05-08T05:29:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6303.259454 secs 2023-05-08T05:29:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:25 smithi186 ceph-mon[126480]: pgmap v3423: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 123 KiB/s wr, 9 op/s 2023-05-08T05:29:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6303.259454 secs 2023-05-08T05:29:25.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:25 smithi133 ceph-mon[125939]: pgmap v3423: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 123 KiB/s wr, 9 op/s 2023-05-08T05:29:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6303.259454 secs 2023-05-08T05:29:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:25 smithi096 ceph-mon[124666]: pgmap v3423: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 123 KiB/s wr, 9 op/s 2023-05-08T05:29:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6304.539982 secs 2023-05-08T05:29:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6304.539982 secs 2023-05-08T05:29:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6304.539982 secs 2023-05-08T05:29:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:27 smithi186 ceph-mon[126480]: pgmap v3424: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 128 KiB/s wr, 8 op/s 2023-05-08T05:29:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:27 smithi133 ceph-mon[125939]: pgmap v3424: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 128 KiB/s wr, 8 op/s 2023-05-08T05:29:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:27 smithi096 ceph-mon[124666]: pgmap v3424: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 128 KiB/s wr, 8 op/s 2023-05-08T05:29:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:29 smithi186 ceph-mon[126480]: pgmap v3425: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 125 KiB/s wr, 7 op/s 2023-05-08T05:29:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6307.702304 secs 2023-05-08T05:29:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:29 smithi133 ceph-mon[125939]: pgmap v3425: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 125 KiB/s wr, 7 op/s 2023-05-08T05:29:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6307.702304 secs 2023-05-08T05:29:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:29 smithi096 ceph-mon[124666]: pgmap v3425: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 125 KiB/s wr, 7 op/s 2023-05-08T05:29:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6307.702304 secs 2023-05-08T05:29:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6308.259570 secs 2023-05-08T05:29:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6308.259570 secs 2023-05-08T05:29:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6308.259570 secs 2023-05-08T05:29:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6309.540098 secs 2023-05-08T05:29:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:31 smithi186 ceph-mon[126480]: pgmap v3426: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 126 KiB/s wr, 11 op/s 2023-05-08T05:29:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6309.540098 secs 2023-05-08T05:29:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:31 smithi133 ceph-mon[125939]: pgmap v3426: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 126 KiB/s wr, 11 op/s 2023-05-08T05:29:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6309.540098 secs 2023-05-08T05:29:31.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:31 smithi096 ceph-mon[124666]: pgmap v3426: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 126 KiB/s wr, 11 op/s 2023-05-08T05:29:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:33 smithi186 ceph-mon[126480]: pgmap v3427: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 46 KiB/s wr, 7 op/s 2023-05-08T05:29:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:33 smithi133 ceph-mon[125939]: pgmap v3427: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 46 KiB/s wr, 7 op/s 2023-05-08T05:29:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:33 smithi096 ceph-mon[124666]: pgmap v3427: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 46 KiB/s wr, 7 op/s 2023-05-08T05:29:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6312.702425 secs 2023-05-08T05:29:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6312.702425 secs 2023-05-08T05:29:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6312.702425 secs 2023-05-08T05:29:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6313.259680 secs 2023-05-08T05:29:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:35 smithi186 ceph-mon[126480]: pgmap v3428: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 46 KiB/s wr, 7 op/s 2023-05-08T05:29:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6313.259680 secs 2023-05-08T05:29:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:35 smithi133 ceph-mon[125939]: pgmap v3428: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 46 KiB/s wr, 7 op/s 2023-05-08T05:29:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6313.259680 secs 2023-05-08T05:29:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:35 smithi096 ceph-mon[124666]: pgmap v3428: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 46 KiB/s wr, 7 op/s 2023-05-08T05:29:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:29:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:29:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:29:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:37 smithi186 ceph-mon[126480]: pgmap v3429: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 144 KiB/s wr, 10 op/s 2023-05-08T05:29:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:37 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:29:37.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:37 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:29:37.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:37 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:29:37.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:37 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:29:37.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:37 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T05:29:37.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:37 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T05:29:37.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:37 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:29:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:37 smithi133 ceph-mon[125939]: pgmap v3429: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 144 KiB/s wr, 10 op/s 2023-05-08T05:29:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:37 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:29:37.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:37 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:29:37.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:37 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:29:37.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:37 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:29:37.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:37 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T05:29:37.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:37 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T05:29:37.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:37 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:29:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:37 smithi096 ceph-mon[124666]: pgmap v3429: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 144 KiB/s wr, 10 op/s 2023-05-08T05:29:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:37 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:29:37.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:37 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:29:37.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:37 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:29:37.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:37 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:29:37.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:37 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T05:29:37.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:37 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T05:29:37.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:37 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:29:38.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:38 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:29:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:38 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:29:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:38 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:29:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:39 smithi186 ceph-mon[126480]: pgmap v3430: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 99 KiB/s wr, 6 op/s 2023-05-08T05:29:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6317.702545 secs 2023-05-08T05:29:39.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:39 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:29:39.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:39 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:29:39.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:39 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:29:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:39 smithi133 ceph-mon[125939]: pgmap v3430: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 99 KiB/s wr, 6 op/s 2023-05-08T05:29:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6317.702545 secs 2023-05-08T05:29:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:39 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:29:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:39 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:29:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:39 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:29:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:39 smithi096 ceph-mon[124666]: pgmap v3430: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 99 KiB/s wr, 6 op/s 2023-05-08T05:29:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6317.702545 secs 2023-05-08T05:29:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:39 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:29:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:39 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:29:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:39 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:29:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:41 smithi186 ceph-mon[126480]: pgmap v3431: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 164 KiB/s wr, 10 op/s 2023-05-08T05:29:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:41 smithi133 ceph-mon[125939]: pgmap v3431: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 164 KiB/s wr, 10 op/s 2023-05-08T05:29:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:41 smithi096 ceph-mon[124666]: pgmap v3431: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 164 KiB/s wr, 10 op/s 2023-05-08T05:29:42.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:29:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:29:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:29:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:43 smithi186 ceph-mon[126480]: pgmap v3432: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 164 KiB/s wr, 7 op/s 2023-05-08T05:29:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:29:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:29:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:43 smithi133 ceph-mon[125939]: pgmap v3432: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 164 KiB/s wr, 7 op/s 2023-05-08T05:29:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:29:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:29:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:43 smithi096 ceph-mon[124666]: pgmap v3432: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 164 KiB/s wr, 7 op/s 2023-05-08T05:29:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:29:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:29:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6322.702604 secs 2023-05-08T05:29:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:44 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:29:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6322.702604 secs 2023-05-08T05:29:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:44 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:29:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6322.702604 secs 2023-05-08T05:29:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:44 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:29:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:45 smithi186 ceph-mon[126480]: pgmap v3433: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 164 KiB/s wr, 7 op/s 2023-05-08T05:29:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:45 smithi133 ceph-mon[125939]: pgmap v3433: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 164 KiB/s wr, 7 op/s 2023-05-08T05:29:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:45 smithi096 ceph-mon[124666]: pgmap v3433: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 164 KiB/s wr, 7 op/s 2023-05-08T05:29:46.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6324.540455 secs 2023-05-08T05:29:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6324.540455 secs 2023-05-08T05:29:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6324.540455 secs 2023-05-08T05:29:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:47 smithi186 ceph-mon[126480]: pgmap v3434: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 337 KiB/s wr, 12 op/s 2023-05-08T05:29:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:47 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:29:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:47 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:29:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:47 smithi133 ceph-mon[125939]: pgmap v3434: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 337 KiB/s wr, 12 op/s 2023-05-08T05:29:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:47 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:29:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:47 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:29:47.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:47 smithi096 ceph-mon[124666]: pgmap v3434: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 337 KiB/s wr, 12 op/s 2023-05-08T05:29:47.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:47 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:29:47.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:47 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:29:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:49 smithi186 ceph-mon[126480]: pgmap v3435: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 239 KiB/s wr, 9 op/s 2023-05-08T05:29:49.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6327.702700 secs 2023-05-08T05:29:49.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:29:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:49 smithi133 ceph-mon[125939]: pgmap v3435: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 239 KiB/s wr, 9 op/s 2023-05-08T05:29:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6327.702700 secs 2023-05-08T05:29:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:29:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:49 smithi096 ceph-mon[124666]: pgmap v3435: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 239 KiB/s wr, 9 op/s 2023-05-08T05:29:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6327.702700 secs 2023-05-08T05:29:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:29:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6328.260029 secs 2023-05-08T05:29:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6328.260029 secs 2023-05-08T05:29:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6328.260029 secs 2023-05-08T05:29:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6329.540589 secs 2023-05-08T05:29:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:51 smithi186 ceph-mon[126480]: pgmap v3436: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 250 KiB/s wr, 13 op/s 2023-05-08T05:29:51.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:29:51.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:29:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6329.540589 secs 2023-05-08T05:29:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:51 smithi133 ceph-mon[125939]: pgmap v3436: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 250 KiB/s wr, 13 op/s 2023-05-08T05:29:51.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:29:51.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:29:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6329.540589 secs 2023-05-08T05:29:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:51 smithi096 ceph-mon[124666]: pgmap v3436: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 250 KiB/s wr, 13 op/s 2023-05-08T05:29:51.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:29:51.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:29:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:53 smithi133 ceph-mon[125939]: pgmap v3437: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 185 KiB/s wr, 9 op/s 2023-05-08T05:29:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:53 smithi096 ceph-mon[124666]: pgmap v3437: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 185 KiB/s wr, 9 op/s 2023-05-08T05:29:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:53 smithi186 ceph-mon[126480]: pgmap v3437: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 185 KiB/s wr, 9 op/s 2023-05-08T05:29:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:54 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:29:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:54 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:29:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:54 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:29:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6333.260169 secs 2023-05-08T05:29:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:55 smithi133 ceph-mon[125939]: pgmap v3438: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 185 KiB/s wr, 9 op/s 2023-05-08T05:29:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6333.260169 secs 2023-05-08T05:29:55.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:55 smithi096 ceph-mon[124666]: pgmap v3438: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 185 KiB/s wr, 9 op/s 2023-05-08T05:29:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6333.260169 secs 2023-05-08T05:29:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:55 smithi186 ceph-mon[126480]: pgmap v3438: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 185 KiB/s wr, 9 op/s 2023-05-08T05:29:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6334.540708 secs 2023-05-08T05:29:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6334.540708 secs 2023-05-08T05:29:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6334.540708 secs 2023-05-08T05:29:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:57 smithi133 ceph-mon[125939]: pgmap v3439: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 316 KiB/s wr, 13 op/s 2023-05-08T05:29:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:29:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:57 smithi096 ceph-mon[124666]: pgmap v3439: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 316 KiB/s wr, 13 op/s 2023-05-08T05:29:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:29:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:57 smithi186 ceph-mon[126480]: pgmap v3439: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 316 KiB/s wr, 13 op/s 2023-05-08T05:29:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:29:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T05:29:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:29:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T05:29:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:29:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T05:29:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:29:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:59 smithi133 ceph-mon[125939]: pgmap v3440: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 143 KiB/s wr, 8 op/s 2023-05-08T05:29:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6337.702912 secs 2023-05-08T05:29:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6338.260289 secs 2023-05-08T05:29:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:29:59 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:29:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:59 smithi096 ceph-mon[124666]: pgmap v3440: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 143 KiB/s wr, 8 op/s 2023-05-08T05:29:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6337.702912 secs 2023-05-08T05:29:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6338.260289 secs 2023-05-08T05:29:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:29:59 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:29:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:59 smithi186 ceph-mon[126480]: pgmap v3440: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 143 KiB/s wr, 8 op/s 2023-05-08T05:29:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6337.702912 secs 2023-05-08T05:29:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6338.260289 secs 2023-05-08T05:29:59.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:29:59 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:30:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:00 smithi133 ceph-mon[125939]: Health detail: HEALTH_WARN 2 MDSs report slow requests 2023-05-08T05:30:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:00 smithi133 ceph-mon[125939]: [WRN] MDS_SLOW_REQUEST: 2 MDSs report slow requests 2023-05-08T05:30:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:00 smithi133 ceph-mon[125939]: mds.c(mds.2): 1 slow requests are blocked > 180 secs 2023-05-08T05:30:00.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:00 smithi133 ceph-mon[125939]: mds.b(mds.0): 1 slow requests are blocked > 180 secs 2023-05-08T05:30:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:00 smithi096 ceph-mon[124666]: Health detail: HEALTH_WARN 2 MDSs report slow requests 2023-05-08T05:30:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:00 smithi096 ceph-mon[124666]: [WRN] MDS_SLOW_REQUEST: 2 MDSs report slow requests 2023-05-08T05:30:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:00 smithi096 ceph-mon[124666]: mds.c(mds.2): 1 slow requests are blocked > 180 secs 2023-05-08T05:30:00.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:00 smithi096 ceph-mon[124666]: mds.b(mds.0): 1 slow requests are blocked > 180 secs 2023-05-08T05:30:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:00 smithi186 ceph-mon[126480]: Health detail: HEALTH_WARN 2 MDSs report slow requests 2023-05-08T05:30:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:00 smithi186 ceph-mon[126480]: [WRN] MDS_SLOW_REQUEST: 2 MDSs report slow requests 2023-05-08T05:30:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:00 smithi186 ceph-mon[126480]: mds.c(mds.2): 1 slow requests are blocked > 180 secs 2023-05-08T05:30:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:00 smithi186 ceph-mon[126480]: mds.b(mds.0): 1 slow requests are blocked > 180 secs 2023-05-08T05:30:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6339.540848 secs 2023-05-08T05:30:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:01 smithi133 ceph-mon[125939]: pgmap v3441: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 155 KiB/s wr, 12 op/s 2023-05-08T05:30:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6339.540848 secs 2023-05-08T05:30:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:01 smithi096 ceph-mon[124666]: pgmap v3441: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 155 KiB/s wr, 12 op/s 2023-05-08T05:30:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6339.540848 secs 2023-05-08T05:30:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:01 smithi186 ceph-mon[126480]: pgmap v3441: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 155 KiB/s wr, 12 op/s 2023-05-08T05:30:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T05:30:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:30:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T05:30:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:30:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T05:30:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:30:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:03 smithi133 ceph-mon[125939]: pgmap v3442: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 143 KiB/s wr, 8 op/s 2023-05-08T05:30:03.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:03 smithi096 ceph-mon[124666]: pgmap v3442: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 143 KiB/s wr, 8 op/s 2023-05-08T05:30:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:03 smithi186 ceph-mon[126480]: pgmap v3442: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 143 KiB/s wr, 8 op/s 2023-05-08T05:30:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6342.703042 secs 2023-05-08T05:30:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6343.260402 secs 2023-05-08T05:30:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:04 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:30:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6342.703042 secs 2023-05-08T05:30:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6343.260402 secs 2023-05-08T05:30:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:04 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:30:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6342.703042 secs 2023-05-08T05:30:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6343.260402 secs 2023-05-08T05:30:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:04 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:30:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:05 smithi133 ceph-mon[125939]: pgmap v3443: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 143 KiB/s wr, 8 op/s 2023-05-08T05:30:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:05 smithi096 ceph-mon[124666]: pgmap v3443: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 143 KiB/s wr, 8 op/s 2023-05-08T05:30:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:05 smithi186 ceph-mon[126480]: pgmap v3443: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 143 KiB/s wr, 8 op/s 2023-05-08T05:30:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6344.540962 secs 2023-05-08T05:30:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:06 smithi133 ceph-mon[125939]: osdmap e294: 12 total, 12 up, 12 in 2023-05-08T05:30:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6344.540962 secs 2023-05-08T05:30:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:06 smithi096 ceph-mon[124666]: osdmap e294: 12 total, 12 up, 12 in 2023-05-08T05:30:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6344.540962 secs 2023-05-08T05:30:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:06 smithi186 ceph-mon[126480]: osdmap e294: 12 total, 12 up, 12 in 2023-05-08T05:30:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:07 smithi133 ceph-mon[125939]: pgmap v3445: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 165 KiB/s wr, 27 op/s 2023-05-08T05:30:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:07 smithi096 ceph-mon[124666]: pgmap v3445: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 165 KiB/s wr, 27 op/s 2023-05-08T05:30:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:07 smithi186 ceph-mon[126480]: pgmap v3445: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 165 KiB/s wr, 27 op/s 2023-05-08T05:30:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:09 smithi133 ceph-mon[125939]: pgmap v3446: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 165 KiB/s wr, 27 op/s 2023-05-08T05:30:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6347.703154 secs 2023-05-08T05:30:09.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6348.260529 secs 2023-05-08T05:30:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:09 smithi096 ceph-mon[124666]: pgmap v3446: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 165 KiB/s wr, 27 op/s 2023-05-08T05:30:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6347.703154 secs 2023-05-08T05:30:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6348.260529 secs 2023-05-08T05:30:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:09 smithi186 ceph-mon[126480]: pgmap v3446: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 165 KiB/s wr, 27 op/s 2023-05-08T05:30:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6347.703154 secs 2023-05-08T05:30:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6348.260529 secs 2023-05-08T05:30:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6349.541077 secs 2023-05-08T05:30:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:11 smithi133 ceph-mon[125939]: pgmap v3447: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 153 KiB/s wr, 27 op/s 2023-05-08T05:30:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6349.541077 secs 2023-05-08T05:30:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:11 smithi096 ceph-mon[124666]: pgmap v3447: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 153 KiB/s wr, 27 op/s 2023-05-08T05:30:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6349.541077 secs 2023-05-08T05:30:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:11 smithi186 ceph-mon[126480]: pgmap v3447: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 153 KiB/s wr, 27 op/s 2023-05-08T05:30:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:13 smithi133 ceph-mon[125939]: pgmap v3448: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 153 KiB/s wr, 27 op/s 2023-05-08T05:30:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:13 smithi096 ceph-mon[124666]: pgmap v3448: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 153 KiB/s wr, 27 op/s 2023-05-08T05:30:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:13 smithi186 ceph-mon[126480]: pgmap v3448: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 153 KiB/s wr, 27 op/s 2023-05-08T05:30:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6352.703249 secs 2023-05-08T05:30:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6353.260650 secs 2023-05-08T05:30:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:14 smithi133 ceph-mon[125939]: osdmap e295: 12 total, 12 up, 12 in 2023-05-08T05:30:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6352.703249 secs 2023-05-08T05:30:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6353.260650 secs 2023-05-08T05:30:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:14 smithi096 ceph-mon[124666]: osdmap e295: 12 total, 12 up, 12 in 2023-05-08T05:30:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6352.703249 secs 2023-05-08T05:30:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6353.260650 secs 2023-05-08T05:30:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:14 smithi186 ceph-mon[126480]: osdmap e295: 12 total, 12 up, 12 in 2023-05-08T05:30:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:15 smithi133 ceph-mon[125939]: pgmap v3449: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 153 KiB/s wr, 27 op/s 2023-05-08T05:30:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:15 smithi096 ceph-mon[124666]: pgmap v3449: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 153 KiB/s wr, 27 op/s 2023-05-08T05:30:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:15 smithi186 ceph-mon[126480]: pgmap v3449: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 153 KiB/s wr, 27 op/s 2023-05-08T05:30:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6354.541207 secs 2023-05-08T05:30:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6354.541207 secs 2023-05-08T05:30:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6354.541207 secs 2023-05-08T05:30:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:17 smithi133 ceph-mon[125939]: pgmap v3451: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 84 KiB/s wr, 9 op/s 2023-05-08T05:30:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:17 smithi096 ceph-mon[124666]: pgmap v3451: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 84 KiB/s wr, 9 op/s 2023-05-08T05:30:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:17 smithi186 ceph-mon[126480]: pgmap v3451: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 84 KiB/s wr, 9 op/s 2023-05-08T05:30:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:19 smithi133 ceph-mon[125939]: pgmap v3452: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 84 KiB/s wr, 9 op/s 2023-05-08T05:30:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6357.703369 secs 2023-05-08T05:30:19.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6358.260745 secs 2023-05-08T05:30:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:19 smithi096 ceph-mon[124666]: pgmap v3452: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 84 KiB/s wr, 9 op/s 2023-05-08T05:30:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6357.703369 secs 2023-05-08T05:30:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6358.260745 secs 2023-05-08T05:30:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:19 smithi186 ceph-mon[126480]: pgmap v3452: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 84 KiB/s wr, 9 op/s 2023-05-08T05:30:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6357.703369 secs 2023-05-08T05:30:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6358.260745 secs 2023-05-08T05:30:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6359.541336 secs 2023-05-08T05:30:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:21 smithi133 ceph-mon[125939]: pgmap v3453: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 124 KiB/s wr, 9 op/s 2023-05-08T05:30:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6359.541336 secs 2023-05-08T05:30:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:21 smithi096 ceph-mon[124666]: pgmap v3453: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 124 KiB/s wr, 9 op/s 2023-05-08T05:30:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6359.541336 secs 2023-05-08T05:30:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:21 smithi186 ceph-mon[126480]: pgmap v3453: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 124 KiB/s wr, 9 op/s 2023-05-08T05:30:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:23 smithi133 ceph-mon[125939]: pgmap v3454: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 124 KiB/s wr, 9 op/s 2023-05-08T05:30:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:23 smithi096 ceph-mon[124666]: pgmap v3454: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 124 KiB/s wr, 9 op/s 2023-05-08T05:30:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:23 smithi186 ceph-mon[126480]: pgmap v3454: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 124 KiB/s wr, 9 op/s 2023-05-08T05:30:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6362.703452 secs 2023-05-08T05:30:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6363.260874 secs 2023-05-08T05:30:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6362.703452 secs 2023-05-08T05:30:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6363.260874 secs 2023-05-08T05:30:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6362.703452 secs 2023-05-08T05:30:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6363.260874 secs 2023-05-08T05:30:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:25 smithi096 ceph-mon[124666]: pgmap v3455: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 124 KiB/s wr, 9 op/s 2023-05-08T05:30:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:25 smithi186 ceph-mon[126480]: pgmap v3455: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 124 KiB/s wr, 9 op/s 2023-05-08T05:30:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:25 smithi133 ceph-mon[125939]: pgmap v3455: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 124 KiB/s wr, 9 op/s 2023-05-08T05:30:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6364.541442 secs 2023-05-08T05:30:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6364.541442 secs 2023-05-08T05:30:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6364.541442 secs 2023-05-08T05:30:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:27 smithi186 ceph-mon[126480]: pgmap v3456: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 85 KiB/s wr, 7 op/s 2023-05-08T05:30:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:27 smithi133 ceph-mon[125939]: pgmap v3456: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 85 KiB/s wr, 7 op/s 2023-05-08T05:30:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:27 smithi096 ceph-mon[124666]: pgmap v3456: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 85 KiB/s wr, 7 op/s 2023-05-08T05:30:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:29 smithi186 ceph-mon[126480]: pgmap v3457: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 83 KiB/s wr, 7 op/s 2023-05-08T05:30:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6367.703575 secs 2023-05-08T05:30:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6368.260984 secs 2023-05-08T05:30:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:29 smithi133 ceph-mon[125939]: pgmap v3457: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 83 KiB/s wr, 7 op/s 2023-05-08T05:30:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6367.703575 secs 2023-05-08T05:30:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6368.260984 secs 2023-05-08T05:30:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:29 smithi096 ceph-mon[124666]: pgmap v3457: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 83 KiB/s wr, 7 op/s 2023-05-08T05:30:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6367.703575 secs 2023-05-08T05:30:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6368.260984 secs 2023-05-08T05:30:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6369.541503 secs 2023-05-08T05:30:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:31 smithi186 ceph-mon[126480]: pgmap v3458: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 83 KiB/s wr, 10 op/s 2023-05-08T05:30:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6369.541503 secs 2023-05-08T05:30:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:31 smithi133 ceph-mon[125939]: pgmap v3458: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 83 KiB/s wr, 10 op/s 2023-05-08T05:30:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6369.541503 secs 2023-05-08T05:30:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:31 smithi096 ceph-mon[124666]: pgmap v3458: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 83 KiB/s wr, 10 op/s 2023-05-08T05:30:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:33 smithi186 ceph-mon[126480]: pgmap v3459: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 48 KiB/s wr, 6 op/s 2023-05-08T05:30:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:33 smithi133 ceph-mon[125939]: pgmap v3459: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 48 KiB/s wr, 6 op/s 2023-05-08T05:30:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:33 smithi096 ceph-mon[124666]: pgmap v3459: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 48 KiB/s wr, 6 op/s 2023-05-08T05:30:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6372.703691 secs 2023-05-08T05:30:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6373.261145 secs 2023-05-08T05:30:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6372.703691 secs 2023-05-08T05:30:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6373.261145 secs 2023-05-08T05:30:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6372.703691 secs 2023-05-08T05:30:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6373.261145 secs 2023-05-08T05:30:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:35 smithi186 ceph-mon[126480]: pgmap v3460: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 48 KiB/s wr, 6 op/s 2023-05-08T05:30:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:35 smithi133 ceph-mon[125939]: pgmap v3460: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 48 KiB/s wr, 6 op/s 2023-05-08T05:30:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:35 smithi096 ceph-mon[124666]: pgmap v3460: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 48 KiB/s wr, 6 op/s 2023-05-08T05:30:36.785 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:30:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:30:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:30:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:37 smithi186 ceph-mon[126480]: pgmap v3461: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 147 KiB/s wr, 10 op/s 2023-05-08T05:30:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:37 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:30:37.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:37 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:30:37.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:37 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:30:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:37 smithi133 ceph-mon[125939]: pgmap v3461: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 147 KiB/s wr, 10 op/s 2023-05-08T05:30:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:37 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:30:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:37 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:30:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:37 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:30:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:37 smithi096 ceph-mon[124666]: pgmap v3461: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 147 KiB/s wr, 10 op/s 2023-05-08T05:30:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:37 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:30:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:37 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:30:38.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:37 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:30:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:38 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:30:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:38 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T05:30:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:38 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T05:30:38.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:38 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:30:38.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:38 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:30:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:38 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:30:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:38 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T05:30:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:38 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T05:30:38.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:38 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:30:38.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:38 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:30:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:38 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:30:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:38 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T05:30:39.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:38 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T05:30:39.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:38 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:30:39.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:38 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:30:39.544 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:39 smithi133 ceph-mon[125939]: pgmap v3462: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 100 KiB/s wr, 6 op/s 2023-05-08T05:30:39.545 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6377.703802 secs 2023-05-08T05:30:39.545 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:39 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:30:39.545 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:39 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:30:39.545 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:39 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:30:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:39 smithi186 ceph-mon[126480]: pgmap v3462: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 100 KiB/s wr, 6 op/s 2023-05-08T05:30:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6377.703802 secs 2023-05-08T05:30:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:39 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:30:39.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:39 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:30:39.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:39 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:30:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:39 smithi096 ceph-mon[124666]: pgmap v3462: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 100 KiB/s wr, 6 op/s 2023-05-08T05:30:40.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6377.703802 secs 2023-05-08T05:30:40.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:39 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:30:40.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:39 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:30:40.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:39 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:30:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:41 smithi186 ceph-mon[126480]: pgmap v3463: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 261 KiB/s rd, 189 KiB/s wr, 10 op/s 2023-05-08T05:30:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:41 smithi133 ceph-mon[125939]: pgmap v3463: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 261 KiB/s rd, 189 KiB/s wr, 10 op/s 2023-05-08T05:30:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:41 smithi096 ceph-mon[124666]: pgmap v3463: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 261 KiB/s rd, 189 KiB/s wr, 10 op/s 2023-05-08T05:30:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:30:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:30:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:30:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:43 smithi186 ceph-mon[126480]: pgmap v3464: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 189 KiB/s wr, 7 op/s 2023-05-08T05:30:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:30:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:30:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:43 smithi133 ceph-mon[125939]: pgmap v3464: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 189 KiB/s wr, 7 op/s 2023-05-08T05:30:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:30:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:30:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:43 smithi096 ceph-mon[124666]: pgmap v3464: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 189 KiB/s wr, 7 op/s 2023-05-08T05:30:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:30:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:30:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6382.703935 secs 2023-05-08T05:30:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:44 smithi186 ceph-mon[126480]: pgmap v3465: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 189 KiB/s wr, 7 op/s 2023-05-08T05:30:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:44 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:30:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6382.703935 secs 2023-05-08T05:30:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:44 smithi133 ceph-mon[125939]: pgmap v3465: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 189 KiB/s wr, 7 op/s 2023-05-08T05:30:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:44 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:30:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6382.703935 secs 2023-05-08T05:30:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:44 smithi096 ceph-mon[124666]: pgmap v3465: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 189 KiB/s wr, 7 op/s 2023-05-08T05:30:45.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:44 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:30:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6384.541914 secs 2023-05-08T05:30:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6384.541914 secs 2023-05-08T05:30:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6384.541914 secs 2023-05-08T05:30:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:46 smithi133 ceph-mon[125939]: pgmap v3466: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 469 KiB/s rd, 339 KiB/s wr, 13 op/s 2023-05-08T05:30:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:46 smithi096 ceph-mon[124666]: pgmap v3466: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 469 KiB/s rd, 339 KiB/s wr, 13 op/s 2023-05-08T05:30:47.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:46 smithi186 ceph-mon[126480]: pgmap v3466: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 469 KiB/s rd, 339 KiB/s wr, 13 op/s 2023-05-08T05:30:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:47 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:30:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:47 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:30:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:47 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:30:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:47 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:30:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:47 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:30:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:47 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:30:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:48 smithi096 ceph-mon[124666]: pgmap v3467: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 240 KiB/s wr, 9 op/s 2023-05-08T05:30:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:48 smithi186 ceph-mon[126480]: pgmap v3467: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 240 KiB/s wr, 9 op/s 2023-05-08T05:30:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:48 smithi133 ceph-mon[125939]: pgmap v3467: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 240 KiB/s wr, 9 op/s 2023-05-08T05:30:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6387.704040 secs 2023-05-08T05:30:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6388.261502 secs 2023-05-08T05:30:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:30:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6387.704040 secs 2023-05-08T05:30:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6388.261502 secs 2023-05-08T05:30:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:30:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6387.704040 secs 2023-05-08T05:30:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6388.261502 secs 2023-05-08T05:30:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:30:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6389.542059 secs 2023-05-08T05:30:51.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:50 smithi096 ceph-mon[124666]: pgmap v3468: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 252 KiB/s wr, 14 op/s 2023-05-08T05:30:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6389.542059 secs 2023-05-08T05:30:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:50 smithi186 ceph-mon[126480]: pgmap v3468: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 252 KiB/s wr, 14 op/s 2023-05-08T05:30:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6389.542059 secs 2023-05-08T05:30:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:50 smithi133 ceph-mon[125939]: pgmap v3468: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 252 KiB/s wr, 14 op/s 2023-05-08T05:30:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:30:52.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:30:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:30:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:30:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:30:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:30:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:52 smithi096 ceph-mon[124666]: pgmap v3469: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 162 KiB/s wr, 10 op/s 2023-05-08T05:30:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:52 smithi186 ceph-mon[126480]: pgmap v3469: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 162 KiB/s wr, 10 op/s 2023-05-08T05:30:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:52 smithi133 ceph-mon[125939]: pgmap v3469: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 162 KiB/s wr, 10 op/s 2023-05-08T05:30:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6392.704156 secs 2023-05-08T05:30:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6392.704156 secs 2023-05-08T05:30:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6392.704156 secs 2023-05-08T05:30:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6393.261593 secs 2023-05-08T05:30:55.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:54 smithi096 ceph-mon[124666]: pgmap v3470: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 162 KiB/s wr, 10 op/s 2023-05-08T05:30:55.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:54 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:30:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6393.261593 secs 2023-05-08T05:30:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:55 smithi186 ceph-mon[126480]: pgmap v3470: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 162 KiB/s wr, 10 op/s 2023-05-08T05:30:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:55 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:30:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6393.261593 secs 2023-05-08T05:30:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:55 smithi133 ceph-mon[125939]: pgmap v3470: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 162 KiB/s wr, 10 op/s 2023-05-08T05:30:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:55 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:30:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6394.542176 secs 2023-05-08T05:30:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6394.542176 secs 2023-05-08T05:30:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6394.542176 secs 2023-05-08T05:30:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:57 smithi186 ceph-mon[126480]: pgmap v3471: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 295 KiB/s wr, 14 op/s 2023-05-08T05:30:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:57 smithi133 ceph-mon[125939]: pgmap v3471: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 295 KiB/s wr, 14 op/s 2023-05-08T05:30:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:57 smithi096 ceph-mon[124666]: pgmap v3471: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 295 KiB/s wr, 14 op/s 2023-05-08T05:30:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:59 smithi186 ceph-mon[126480]: pgmap v3472: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 145 KiB/s wr, 8 op/s 2023-05-08T05:30:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:30:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6397.704268 secs 2023-05-08T05:30:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:59 smithi133 ceph-mon[125939]: pgmap v3472: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 145 KiB/s wr, 8 op/s 2023-05-08T05:30:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:30:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6397.704268 secs 2023-05-08T05:30:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:59 smithi096 ceph-mon[124666]: pgmap v3472: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 145 KiB/s wr, 8 op/s 2023-05-08T05:30:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:30:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6397.704268 secs 2023-05-08T05:31:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6398.261689 secs 2023-05-08T05:31:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6398.261689 secs 2023-05-08T05:31:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6398.261689 secs 2023-05-08T05:31:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6399.542293 secs 2023-05-08T05:31:01.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:01 smithi133 ceph-mon[125939]: pgmap v3473: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 156 KiB/s wr, 13 op/s 2023-05-08T05:31:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6399.542293 secs 2023-05-08T05:31:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:01 smithi096 ceph-mon[124666]: pgmap v3473: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 156 KiB/s wr, 13 op/s 2023-05-08T05:31:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6399.542293 secs 2023-05-08T05:31:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:01 smithi186 ceph-mon[126480]: pgmap v3473: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 156 KiB/s wr, 13 op/s 2023-05-08T05:31:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:03 smithi133 ceph-mon[125939]: pgmap v3474: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 145 KiB/s wr, 8 op/s 2023-05-08T05:31:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:03 smithi096 ceph-mon[124666]: pgmap v3474: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 145 KiB/s wr, 8 op/s 2023-05-08T05:31:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:03 smithi186 ceph-mon[126480]: pgmap v3474: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 145 KiB/s wr, 8 op/s 2023-05-08T05:31:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6402.704381 secs 2023-05-08T05:31:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6402.704381 secs 2023-05-08T05:31:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6402.704381 secs 2023-05-08T05:31:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6403.261827 secs 2023-05-08T05:31:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:05 smithi133 ceph-mon[125939]: pgmap v3475: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 145 KiB/s wr, 8 op/s 2023-05-08T05:31:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6403.261827 secs 2023-05-08T05:31:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:05 smithi096 ceph-mon[124666]: pgmap v3475: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 145 KiB/s wr, 8 op/s 2023-05-08T05:31:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6403.261827 secs 2023-05-08T05:31:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:05 smithi186 ceph-mon[126480]: pgmap v3475: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 145 KiB/s wr, 8 op/s 2023-05-08T05:31:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6404.542410 secs 2023-05-08T05:31:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:06 smithi096 ceph-mon[124666]: osdmap e296: 12 total, 12 up, 12 in 2023-05-08T05:31:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6404.542410 secs 2023-05-08T05:31:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:06 smithi186 ceph-mon[126480]: osdmap e296: 12 total, 12 up, 12 in 2023-05-08T05:31:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6404.542410 secs 2023-05-08T05:31:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:06 smithi133 ceph-mon[125939]: osdmap e296: 12 total, 12 up, 12 in 2023-05-08T05:31:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:07 smithi096 ceph-mon[124666]: pgmap v3477: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 252 KiB/s wr, 28 op/s 2023-05-08T05:31:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:07 smithi186 ceph-mon[126480]: pgmap v3477: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 252 KiB/s wr, 28 op/s 2023-05-08T05:31:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:07 smithi133 ceph-mon[125939]: pgmap v3477: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 252 KiB/s wr, 28 op/s 2023-05-08T05:31:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:09 smithi096 ceph-mon[124666]: pgmap v3478: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 252 KiB/s wr, 28 op/s 2023-05-08T05:31:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6407.704495 secs 2023-05-08T05:31:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:09 smithi186 ceph-mon[126480]: pgmap v3478: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 252 KiB/s wr, 28 op/s 2023-05-08T05:31:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6407.704495 secs 2023-05-08T05:31:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:09 smithi133 ceph-mon[125939]: pgmap v3478: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 252 KiB/s wr, 28 op/s 2023-05-08T05:31:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6407.704495 secs 2023-05-08T05:31:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6408.261954 secs 2023-05-08T05:31:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6408.261954 secs 2023-05-08T05:31:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6408.261954 secs 2023-05-08T05:31:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6409.542527 secs 2023-05-08T05:31:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:11 smithi096 ceph-mon[124666]: pgmap v3479: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 240 KiB/s wr, 27 op/s 2023-05-08T05:31:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6409.542527 secs 2023-05-08T05:31:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:11 smithi186 ceph-mon[126480]: pgmap v3479: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 240 KiB/s wr, 27 op/s 2023-05-08T05:31:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6409.542527 secs 2023-05-08T05:31:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:11 smithi133 ceph-mon[125939]: pgmap v3479: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 240 KiB/s wr, 27 op/s 2023-05-08T05:31:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:13 smithi186 ceph-mon[126480]: pgmap v3480: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 240 KiB/s wr, 27 op/s 2023-05-08T05:31:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:13 smithi133 ceph-mon[125939]: pgmap v3480: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 240 KiB/s wr, 27 op/s 2023-05-08T05:31:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:13 smithi096 ceph-mon[124666]: pgmap v3480: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 240 KiB/s wr, 27 op/s 2023-05-08T05:31:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6412.704610 secs 2023-05-08T05:31:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:14 smithi186 ceph-mon[126480]: osdmap e297: 12 total, 12 up, 12 in 2023-05-08T05:31:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6412.704610 secs 2023-05-08T05:31:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:14 smithi133 ceph-mon[125939]: osdmap e297: 12 total, 12 up, 12 in 2023-05-08T05:31:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6412.704610 secs 2023-05-08T05:31:14.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:14 smithi096 ceph-mon[124666]: osdmap e297: 12 total, 12 up, 12 in 2023-05-08T05:31:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6413.262088 secs 2023-05-08T05:31:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:15 smithi186 ceph-mon[126480]: pgmap v3481: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 240 KiB/s wr, 27 op/s 2023-05-08T05:31:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6413.262088 secs 2023-05-08T05:31:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:15 smithi133 ceph-mon[125939]: pgmap v3481: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 240 KiB/s wr, 27 op/s 2023-05-08T05:31:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6413.262088 secs 2023-05-08T05:31:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:15 smithi096 ceph-mon[124666]: pgmap v3481: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 240 KiB/s wr, 27 op/s 2023-05-08T05:31:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6414.542646 secs 2023-05-08T05:31:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6414.542646 secs 2023-05-08T05:31:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6414.542646 secs 2023-05-08T05:31:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:17 smithi186 ceph-mon[126480]: pgmap v3483: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 30 KiB/s wr, 8 op/s 2023-05-08T05:31:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:17 smithi133 ceph-mon[125939]: pgmap v3483: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 30 KiB/s wr, 8 op/s 2023-05-08T05:31:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:17 smithi096 ceph-mon[124666]: pgmap v3483: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 30 KiB/s wr, 8 op/s 2023-05-08T05:31:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:19 smithi186 ceph-mon[126480]: pgmap v3484: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 30 KiB/s wr, 8 op/s 2023-05-08T05:31:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6417.704728 secs 2023-05-08T05:31:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:19 smithi133 ceph-mon[125939]: pgmap v3484: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 30 KiB/s wr, 8 op/s 2023-05-08T05:31:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6417.704728 secs 2023-05-08T05:31:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:19 smithi096 ceph-mon[124666]: pgmap v3484: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 30 KiB/s wr, 8 op/s 2023-05-08T05:31:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6417.704728 secs 2023-05-08T05:31:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6418.262222 secs 2023-05-08T05:31:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6418.262222 secs 2023-05-08T05:31:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6418.262222 secs 2023-05-08T05:31:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6419.542796 secs 2023-05-08T05:31:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:21 smithi186 ceph-mon[126480]: pgmap v3485: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 71 KiB/s wr, 8 op/s 2023-05-08T05:31:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6419.542796 secs 2023-05-08T05:31:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:21 smithi133 ceph-mon[125939]: pgmap v3485: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 71 KiB/s wr, 8 op/s 2023-05-08T05:31:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6419.542796 secs 2023-05-08T05:31:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:21 smithi096 ceph-mon[124666]: pgmap v3485: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 71 KiB/s wr, 8 op/s 2023-05-08T05:31:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:23 smithi186 ceph-mon[126480]: pgmap v3486: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 71 KiB/s wr, 8 op/s 2023-05-08T05:31:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:23 smithi133 ceph-mon[125939]: pgmap v3486: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 71 KiB/s wr, 8 op/s 2023-05-08T05:31:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:23 smithi096 ceph-mon[124666]: pgmap v3486: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 71 KiB/s wr, 8 op/s 2023-05-08T05:31:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6422.704836 secs 2023-05-08T05:31:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6422.704836 secs 2023-05-08T05:31:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6422.704836 secs 2023-05-08T05:31:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6423.262327 secs 2023-05-08T05:31:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:25 smithi186 ceph-mon[126480]: pgmap v3487: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 71 KiB/s wr, 8 op/s 2023-05-08T05:31:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6423.262327 secs 2023-05-08T05:31:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:25 smithi133 ceph-mon[125939]: pgmap v3487: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 71 KiB/s wr, 8 op/s 2023-05-08T05:31:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6423.262327 secs 2023-05-08T05:31:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:25 smithi096 ceph-mon[124666]: pgmap v3487: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 71 KiB/s wr, 8 op/s 2023-05-08T05:31:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6424.542917 secs 2023-05-08T05:31:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6424.542917 secs 2023-05-08T05:31:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6424.542917 secs 2023-05-08T05:31:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:27 smithi186 ceph-mon[126480]: pgmap v3488: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 84 KiB/s wr, 7 op/s 2023-05-08T05:31:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:27 smithi133 ceph-mon[125939]: pgmap v3488: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 84 KiB/s wr, 7 op/s 2023-05-08T05:31:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:27 smithi096 ceph-mon[124666]: pgmap v3488: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 84 KiB/s wr, 7 op/s 2023-05-08T05:31:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:29 smithi186 ceph-mon[126480]: pgmap v3489: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 82 KiB/s wr, 6 op/s 2023-05-08T05:31:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6427.704973 secs 2023-05-08T05:31:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:29 smithi133 ceph-mon[125939]: pgmap v3489: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 82 KiB/s wr, 6 op/s 2023-05-08T05:31:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6427.704973 secs 2023-05-08T05:31:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:29 smithi096 ceph-mon[124666]: pgmap v3489: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 82 KiB/s wr, 6 op/s 2023-05-08T05:31:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6427.704973 secs 2023-05-08T05:31:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6428.262464 secs 2023-05-08T05:31:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6428.262464 secs 2023-05-08T05:31:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6428.262464 secs 2023-05-08T05:31:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6429.543029 secs 2023-05-08T05:31:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:31 smithi186 ceph-mon[126480]: pgmap v3490: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 83 KiB/s wr, 10 op/s 2023-05-08T05:31:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6429.543029 secs 2023-05-08T05:31:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:31 smithi133 ceph-mon[125939]: pgmap v3490: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 83 KiB/s wr, 10 op/s 2023-05-08T05:31:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6429.543029 secs 2023-05-08T05:31:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:31 smithi096 ceph-mon[124666]: pgmap v3490: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 83 KiB/s wr, 10 op/s 2023-05-08T05:31:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:33 smithi186 ceph-mon[126480]: pgmap v3491: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 47 KiB/s wr, 6 op/s 2023-05-08T05:31:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:33 smithi133 ceph-mon[125939]: pgmap v3491: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 47 KiB/s wr, 6 op/s 2023-05-08T05:31:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:33 smithi096 ceph-mon[124666]: pgmap v3491: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 47 KiB/s wr, 6 op/s 2023-05-08T05:31:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6432.705090 secs 2023-05-08T05:31:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6432.705090 secs 2023-05-08T05:31:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6432.705090 secs 2023-05-08T05:31:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6433.262583 secs 2023-05-08T05:31:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:35 smithi186 ceph-mon[126480]: pgmap v3492: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 47 KiB/s wr, 6 op/s 2023-05-08T05:31:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6433.262583 secs 2023-05-08T05:31:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:35 smithi133 ceph-mon[125939]: pgmap v3492: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 47 KiB/s wr, 6 op/s 2023-05-08T05:31:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6433.262583 secs 2023-05-08T05:31:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:35 smithi096 ceph-mon[124666]: pgmap v3492: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 47 KiB/s wr, 6 op/s 2023-05-08T05:31:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:37 smithi186 ceph-mon[126480]: pgmap v3493: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 147 KiB/s wr, 9 op/s 2023-05-08T05:31:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:37 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:31:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:37 smithi133 ceph-mon[125939]: pgmap v3493: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 147 KiB/s wr, 9 op/s 2023-05-08T05:31:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:37 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:31:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:37 smithi096 ceph-mon[124666]: pgmap v3493: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 147 KiB/s wr, 9 op/s 2023-05-08T05:31:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:37 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:31:38.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:38 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:31:38.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:31:38.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:31:38.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:31:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:38 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:31:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:31:38.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:31:38.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:31:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:38 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:31:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:31:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:31:38.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:31:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:39 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:31:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:39 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T05:31:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:39 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T05:31:39.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:39 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:31:39.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:39 smithi186 ceph-mon[126480]: pgmap v3494: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 100 KiB/s wr, 6 op/s 2023-05-08T05:31:39.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6437.705210 secs 2023-05-08T05:31:39.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:39 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:31:39.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:39 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:31:39.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:39 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:31:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:39 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:31:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:39 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T05:31:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:39 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T05:31:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:39 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:31:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:39 smithi133 ceph-mon[125939]: pgmap v3494: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 100 KiB/s wr, 6 op/s 2023-05-08T05:31:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6437.705210 secs 2023-05-08T05:31:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:39 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:31:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:39 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:31:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:39 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:31:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:39 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:31:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:39 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T05:31:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:39 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T05:31:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:39 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:31:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:39 smithi096 ceph-mon[124666]: pgmap v3494: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 100 KiB/s wr, 6 op/s 2023-05-08T05:31:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6437.705210 secs 2023-05-08T05:31:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:39 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:31:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:39 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:31:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:39 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:31:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:41 smithi186 ceph-mon[126480]: pgmap v3495: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 213 KiB/s wr, 10 op/s 2023-05-08T05:31:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:41 smithi133 ceph-mon[125939]: pgmap v3495: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 213 KiB/s wr, 10 op/s 2023-05-08T05:31:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:41 smithi096 ceph-mon[124666]: pgmap v3495: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 213 KiB/s wr, 10 op/s 2023-05-08T05:31:42.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:31:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:31:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:31:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:43 smithi186 ceph-mon[126480]: pgmap v3496: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 213 KiB/s wr, 7 op/s 2023-05-08T05:31:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:31:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:31:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:43 smithi133 ceph-mon[125939]: pgmap v3496: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 213 KiB/s wr, 7 op/s 2023-05-08T05:31:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:31:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:31:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:43 smithi096 ceph-mon[124666]: pgmap v3496: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 213 KiB/s wr, 7 op/s 2023-05-08T05:31:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:31:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:31:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6442.705305 secs 2023-05-08T05:31:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:44 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:31:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6442.705305 secs 2023-05-08T05:31:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:44 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:31:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6442.705305 secs 2023-05-08T05:31:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:44 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:31:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:45 smithi186 ceph-mon[126480]: pgmap v3497: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 213 KiB/s wr, 7 op/s 2023-05-08T05:31:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:45 smithi133 ceph-mon[125939]: pgmap v3497: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 213 KiB/s wr, 7 op/s 2023-05-08T05:31:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:45 smithi096 ceph-mon[124666]: pgmap v3497: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 213 KiB/s wr, 7 op/s 2023-05-08T05:31:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:47 smithi186 ceph-mon[126480]: pgmap v3498: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 343 KiB/s wr, 13 op/s 2023-05-08T05:31:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:47 smithi133 ceph-mon[125939]: pgmap v3498: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 343 KiB/s wr, 13 op/s 2023-05-08T05:31:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:47 smithi096 ceph-mon[124666]: pgmap v3498: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 343 KiB/s wr, 13 op/s 2023-05-08T05:31:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:49 smithi186 ceph-mon[126480]: pgmap v3499: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 243 KiB/s wr, 10 op/s 2023-05-08T05:31:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6447.705426 secs 2023-05-08T05:31:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:49 smithi133 ceph-mon[125939]: pgmap v3499: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 243 KiB/s wr, 10 op/s 2023-05-08T05:31:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6447.705426 secs 2023-05-08T05:31:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:49 smithi096 ceph-mon[124666]: pgmap v3499: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 243 KiB/s wr, 10 op/s 2023-05-08T05:31:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6447.705426 secs 2023-05-08T05:31:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6448.262889 secs 2023-05-08T05:31:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6448.262889 secs 2023-05-08T05:31:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6448.262889 secs 2023-05-08T05:31:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:51 smithi133 ceph-mon[125939]: pgmap v3500: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 255 KiB/s wr, 14 op/s 2023-05-08T05:31:51.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:51 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:31:51.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:31:51.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:31:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:51 smithi096 ceph-mon[124666]: pgmap v3500: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 255 KiB/s wr, 14 op/s 2023-05-08T05:31:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:51 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:31:51.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:31:51.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:31:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:51 smithi186 ceph-mon[126480]: pgmap v3500: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 255 KiB/s wr, 14 op/s 2023-05-08T05:31:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:51 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:31:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:31:51.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:31:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:53 smithi133 ceph-mon[125939]: pgmap v3501: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 142 KiB/s wr, 10 op/s 2023-05-08T05:31:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:53 smithi096 ceph-mon[124666]: pgmap v3501: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 142 KiB/s wr, 10 op/s 2023-05-08T05:31:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:53 smithi186 ceph-mon[126480]: pgmap v3501: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 142 KiB/s wr, 10 op/s 2023-05-08T05:31:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6452.705540 secs 2023-05-08T05:31:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6452.705540 secs 2023-05-08T05:31:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6452.705540 secs 2023-05-08T05:31:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6453.263005 secs 2023-05-08T05:31:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:55 smithi133 ceph-mon[125939]: pgmap v3502: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 142 KiB/s wr, 10 op/s 2023-05-08T05:31:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6453.263005 secs 2023-05-08T05:31:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:55 smithi096 ceph-mon[124666]: pgmap v3502: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 142 KiB/s wr, 10 op/s 2023-05-08T05:31:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6453.263005 secs 2023-05-08T05:31:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:55 smithi186 ceph-mon[126480]: pgmap v3502: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 142 KiB/s wr, 10 op/s 2023-05-08T05:31:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:57 smithi133 ceph-mon[125939]: pgmap v3503: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 276 KiB/s wr, 14 op/s 2023-05-08T05:31:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:57 smithi096 ceph-mon[124666]: pgmap v3503: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 276 KiB/s wr, 14 op/s 2023-05-08T05:31:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:57 smithi186 ceph-mon[126480]: pgmap v3503: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 276 KiB/s wr, 14 op/s 2023-05-08T05:31:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:59 smithi133 ceph-mon[125939]: pgmap v3504: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 146 KiB/s wr, 8 op/s 2023-05-08T05:31:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:31:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6457.705668 secs 2023-05-08T05:31:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:59 smithi096 ceph-mon[124666]: pgmap v3504: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 146 KiB/s wr, 8 op/s 2023-05-08T05:31:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:31:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6457.705668 secs 2023-05-08T05:31:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:59 smithi186 ceph-mon[126480]: pgmap v3504: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 146 KiB/s wr, 8 op/s 2023-05-08T05:31:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:31:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6457.705668 secs 2023-05-08T05:32:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6458.263144 secs 2023-05-08T05:32:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6458.263144 secs 2023-05-08T05:32:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6458.263144 secs 2023-05-08T05:32:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6459.543758 secs 2023-05-08T05:32:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:01 smithi133 ceph-mon[125939]: pgmap v3505: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 203 KiB/s wr, 13 op/s 2023-05-08T05:32:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6459.543758 secs 2023-05-08T05:32:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:01 smithi096 ceph-mon[124666]: pgmap v3505: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 203 KiB/s wr, 13 op/s 2023-05-08T05:32:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6459.543758 secs 2023-05-08T05:32:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:01 smithi186 ceph-mon[126480]: pgmap v3505: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 203 KiB/s wr, 13 op/s 2023-05-08T05:32:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:02 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:32:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:32:02.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:32:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:02 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:32:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:32:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:32:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:02 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:32:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:32:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:32:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:03 smithi133 ceph-mon[125939]: pgmap v3506: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 191 KiB/s wr, 8 op/s 2023-05-08T05:32:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:03 smithi096 ceph-mon[124666]: pgmap v3506: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 191 KiB/s wr, 8 op/s 2023-05-08T05:32:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:03 smithi186 ceph-mon[126480]: pgmap v3506: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 191 KiB/s wr, 8 op/s 2023-05-08T05:32:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6462.705782 secs 2023-05-08T05:32:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6463.263280 secs 2023-05-08T05:32:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6462.705782 secs 2023-05-08T05:32:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6463.263280 secs 2023-05-08T05:32:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6462.705782 secs 2023-05-08T05:32:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6463.263280 secs 2023-05-08T05:32:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:05 smithi133 ceph-mon[125939]: pgmap v3507: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 191 KiB/s wr, 8 op/s 2023-05-08T05:32:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:05 smithi096 ceph-mon[124666]: pgmap v3507: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 191 KiB/s wr, 8 op/s 2023-05-08T05:32:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:05 smithi186 ceph-mon[126480]: pgmap v3507: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 191 KiB/s wr, 8 op/s 2023-05-08T05:32:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6464.543874 secs 2023-05-08T05:32:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:06 smithi133 ceph-mon[125939]: osdmap e298: 12 total, 12 up, 12 in 2023-05-08T05:32:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6464.543874 secs 2023-05-08T05:32:06.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:06 smithi096 ceph-mon[124666]: osdmap e298: 12 total, 12 up, 12 in 2023-05-08T05:32:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6464.543874 secs 2023-05-08T05:32:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:06 smithi186 ceph-mon[126480]: osdmap e298: 12 total, 12 up, 12 in 2023-05-08T05:32:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:07 smithi133 ceph-mon[125939]: pgmap v3509: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 221 KiB/s wr, 28 op/s 2023-05-08T05:32:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:07 smithi096 ceph-mon[124666]: pgmap v3509: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 221 KiB/s wr, 28 op/s 2023-05-08T05:32:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:07 smithi186 ceph-mon[126480]: pgmap v3509: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 221 KiB/s wr, 28 op/s 2023-05-08T05:32:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6467.705922 secs 2023-05-08T05:32:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:09 smithi133 ceph-mon[125939]: pgmap v3510: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 221 KiB/s wr, 28 op/s 2023-05-08T05:32:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6468.263432 secs 2023-05-08T05:32:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6467.705922 secs 2023-05-08T05:32:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:09 smithi096 ceph-mon[124666]: pgmap v3510: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 221 KiB/s wr, 28 op/s 2023-05-08T05:32:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6468.263432 secs 2023-05-08T05:32:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6467.705922 secs 2023-05-08T05:32:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:09 smithi186 ceph-mon[126480]: pgmap v3510: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 221 KiB/s wr, 28 op/s 2023-05-08T05:32:09.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6468.263432 secs 2023-05-08T05:32:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6469.543976 secs 2023-05-08T05:32:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:11 smithi133 ceph-mon[125939]: pgmap v3511: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 154 KiB/s wr, 27 op/s 2023-05-08T05:32:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6469.543976 secs 2023-05-08T05:32:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:11 smithi096 ceph-mon[124666]: pgmap v3511: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 154 KiB/s wr, 27 op/s 2023-05-08T05:32:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6469.543976 secs 2023-05-08T05:32:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:11 smithi186 ceph-mon[126480]: pgmap v3511: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 154 KiB/s wr, 27 op/s 2023-05-08T05:32:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:13 smithi133 ceph-mon[125939]: pgmap v3512: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 154 KiB/s wr, 27 op/s 2023-05-08T05:32:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:13 smithi096 ceph-mon[124666]: pgmap v3512: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 154 KiB/s wr, 27 op/s 2023-05-08T05:32:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:13 smithi186 ceph-mon[126480]: pgmap v3512: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 154 KiB/s wr, 27 op/s 2023-05-08T05:32:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6472.706055 secs 2023-05-08T05:32:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6473.263597 secs 2023-05-08T05:32:14.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:14 smithi096 ceph-mon[124666]: osdmap e299: 12 total, 12 up, 12 in 2023-05-08T05:32:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6472.706055 secs 2023-05-08T05:32:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6473.263597 secs 2023-05-08T05:32:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:14 smithi186 ceph-mon[126480]: osdmap e299: 12 total, 12 up, 12 in 2023-05-08T05:32:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6472.706055 secs 2023-05-08T05:32:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6473.263597 secs 2023-05-08T05:32:14.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:14 smithi133 ceph-mon[125939]: osdmap e299: 12 total, 12 up, 12 in 2023-05-08T05:32:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:15 smithi096 ceph-mon[124666]: pgmap v3513: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 154 KiB/s wr, 27 op/s 2023-05-08T05:32:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:15 smithi186 ceph-mon[126480]: pgmap v3513: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 154 KiB/s wr, 27 op/s 2023-05-08T05:32:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:15 smithi133 ceph-mon[125939]: pgmap v3513: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 154 KiB/s wr, 27 op/s 2023-05-08T05:32:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6474.544105 secs 2023-05-08T05:32:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6474.544105 secs 2023-05-08T05:32:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6474.544105 secs 2023-05-08T05:32:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:17 smithi096 ceph-mon[124666]: pgmap v3515: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 30 KiB/s wr, 9 op/s 2023-05-08T05:32:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:17 smithi186 ceph-mon[126480]: pgmap v3515: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 30 KiB/s wr, 9 op/s 2023-05-08T05:32:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:17 smithi133 ceph-mon[125939]: pgmap v3515: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 30 KiB/s wr, 9 op/s 2023-05-08T05:32:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6477.706178 secs 2023-05-08T05:32:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:19 smithi096 ceph-mon[124666]: pgmap v3516: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 30 KiB/s wr, 9 op/s 2023-05-08T05:32:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6478.263712 secs 2023-05-08T05:32:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6477.706178 secs 2023-05-08T05:32:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:19 smithi186 ceph-mon[126480]: pgmap v3516: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 30 KiB/s wr, 9 op/s 2023-05-08T05:32:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6478.263712 secs 2023-05-08T05:32:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6477.706178 secs 2023-05-08T05:32:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:19 smithi133 ceph-mon[125939]: pgmap v3516: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 30 KiB/s wr, 9 op/s 2023-05-08T05:32:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6478.263712 secs 2023-05-08T05:32:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6479.544203 secs 2023-05-08T05:32:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:21 smithi186 ceph-mon[126480]: pgmap v3517: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 71 KiB/s wr, 8 op/s 2023-05-08T05:32:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6479.544203 secs 2023-05-08T05:32:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:21 smithi133 ceph-mon[125939]: pgmap v3517: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 71 KiB/s wr, 8 op/s 2023-05-08T05:32:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6479.544203 secs 2023-05-08T05:32:22.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:21 smithi096 ceph-mon[124666]: pgmap v3517: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 71 KiB/s wr, 8 op/s 2023-05-08T05:32:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:23 smithi186 ceph-mon[126480]: pgmap v3518: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 71 KiB/s wr, 8 op/s 2023-05-08T05:32:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:23 smithi133 ceph-mon[125939]: pgmap v3518: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 71 KiB/s wr, 8 op/s 2023-05-08T05:32:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:23 smithi096 ceph-mon[124666]: pgmap v3518: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 71 KiB/s wr, 8 op/s 2023-05-08T05:32:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6482.706322 secs 2023-05-08T05:32:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6483.263832 secs 2023-05-08T05:32:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6482.706322 secs 2023-05-08T05:32:24.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6483.263832 secs 2023-05-08T05:32:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6482.706322 secs 2023-05-08T05:32:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6483.263832 secs 2023-05-08T05:32:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:25 smithi186 ceph-mon[126480]: pgmap v3519: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 71 KiB/s wr, 8 op/s 2023-05-08T05:32:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:25 smithi133 ceph-mon[125939]: pgmap v3519: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 71 KiB/s wr, 8 op/s 2023-05-08T05:32:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:25 smithi096 ceph-mon[124666]: pgmap v3519: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 71 KiB/s wr, 8 op/s 2023-05-08T05:32:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6484.544325 secs 2023-05-08T05:32:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6484.544325 secs 2023-05-08T05:32:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6484.544325 secs 2023-05-08T05:32:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:27 smithi186 ceph-mon[126480]: pgmap v3520: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 85 KiB/s wr, 6 op/s 2023-05-08T05:32:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:27 smithi133 ceph-mon[125939]: pgmap v3520: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 85 KiB/s wr, 6 op/s 2023-05-08T05:32:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:27 smithi096 ceph-mon[124666]: pgmap v3520: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 85 KiB/s wr, 6 op/s 2023-05-08T05:32:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6487.706410 secs 2023-05-08T05:32:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:29 smithi186 ceph-mon[126480]: pgmap v3521: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 83 KiB/s wr, 6 op/s 2023-05-08T05:32:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6488.263953 secs 2023-05-08T05:32:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6487.706410 secs 2023-05-08T05:32:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:29 smithi133 ceph-mon[125939]: pgmap v3521: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 83 KiB/s wr, 6 op/s 2023-05-08T05:32:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6488.263953 secs 2023-05-08T05:32:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6487.706410 secs 2023-05-08T05:32:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:29 smithi096 ceph-mon[124666]: pgmap v3521: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 83 KiB/s wr, 6 op/s 2023-05-08T05:32:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6488.263953 secs 2023-05-08T05:32:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6489.544463 secs 2023-05-08T05:32:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:31 smithi186 ceph-mon[126480]: pgmap v3522: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 83 KiB/s wr, 9 op/s 2023-05-08T05:32:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6489.544463 secs 2023-05-08T05:32:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:31 smithi133 ceph-mon[125939]: pgmap v3522: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 83 KiB/s wr, 9 op/s 2023-05-08T05:32:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6489.544463 secs 2023-05-08T05:32:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:31 smithi096 ceph-mon[124666]: pgmap v3522: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 83 KiB/s wr, 9 op/s 2023-05-08T05:32:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:33 smithi186 ceph-mon[126480]: pgmap v3523: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 48 KiB/s wr, 6 op/s 2023-05-08T05:32:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:33 smithi133 ceph-mon[125939]: pgmap v3523: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 48 KiB/s wr, 6 op/s 2023-05-08T05:32:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:33 smithi096 ceph-mon[124666]: pgmap v3523: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 48 KiB/s wr, 6 op/s 2023-05-08T05:32:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6492.706474 secs 2023-05-08T05:32:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6493.264038 secs 2023-05-08T05:32:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6492.706474 secs 2023-05-08T05:32:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6493.264038 secs 2023-05-08T05:32:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6492.706474 secs 2023-05-08T05:32:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6493.264038 secs 2023-05-08T05:32:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:35 smithi186 ceph-mon[126480]: pgmap v3524: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 48 KiB/s wr, 6 op/s 2023-05-08T05:32:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:35 smithi133 ceph-mon[125939]: pgmap v3524: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 48 KiB/s wr, 6 op/s 2023-05-08T05:32:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:35 smithi096 ceph-mon[124666]: pgmap v3524: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 48 KiB/s wr, 6 op/s 2023-05-08T05:32:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:37 smithi186 ceph-mon[126480]: pgmap v3525: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 149 KiB/s wr, 10 op/s 2023-05-08T05:32:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:37 smithi133 ceph-mon[125939]: pgmap v3525: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 149 KiB/s wr, 10 op/s 2023-05-08T05:32:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:37 smithi096 ceph-mon[124666]: pgmap v3525: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 149 KiB/s wr, 10 op/s 2023-05-08T05:32:38.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:38 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:32:38.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:32:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:38 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:32:38.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:32:39.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:38 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:32:39.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:32:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6497.706540 secs 2023-05-08T05:32:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:39 smithi186 ceph-mon[126480]: pgmap v3526: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 101 KiB/s wr, 6 op/s 2023-05-08T05:32:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:39 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:32:39.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:39 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:32:39.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:39 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:32:39.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:32:39.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:32:39.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:32:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6497.706540 secs 2023-05-08T05:32:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:39 smithi133 ceph-mon[125939]: pgmap v3526: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 101 KiB/s wr, 6 op/s 2023-05-08T05:32:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:39 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:32:39.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:39 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:32:39.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:39 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:32:39.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:32:39.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:32:39.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:32:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6497.706540 secs 2023-05-08T05:32:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:39 smithi096 ceph-mon[124666]: pgmap v3526: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 101 KiB/s wr, 6 op/s 2023-05-08T05:32:40.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:39 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:32:40.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:39 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:32:40.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:39 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:32:40.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:32:40.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:32:40.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:32:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:40 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:32:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:40 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T05:32:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:40 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T05:32:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:40 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:32:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:40 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:32:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:40 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T05:32:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:40 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T05:32:40.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:40 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:32:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:40 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:32:41.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:40 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T05:32:41.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:40 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T05:32:41.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:40 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:32:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:41 smithi186 ceph-mon[126480]: pgmap v3527: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 215 KiB/s wr, 10 op/s 2023-05-08T05:32:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:41 smithi133 ceph-mon[125939]: pgmap v3527: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 215 KiB/s wr, 10 op/s 2023-05-08T05:32:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:41 smithi096 ceph-mon[124666]: pgmap v3527: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 215 KiB/s wr, 10 op/s 2023-05-08T05:32:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:32:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:32:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:32:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:43 smithi186 ceph-mon[126480]: pgmap v3528: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 215 KiB/s wr, 7 op/s 2023-05-08T05:32:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:32:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:32:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:43 smithi133 ceph-mon[125939]: pgmap v3528: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 215 KiB/s wr, 7 op/s 2023-05-08T05:32:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:32:43.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:32:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:43 smithi096 ceph-mon[124666]: pgmap v3528: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 215 KiB/s wr, 7 op/s 2023-05-08T05:32:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:32:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:32:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6502.706627 secs 2023-05-08T05:32:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:44 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:32:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6502.706627 secs 2023-05-08T05:32:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:44 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:32:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6502.706627 secs 2023-05-08T05:32:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:44 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:32:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:45 smithi186 ceph-mon[126480]: pgmap v3529: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 215 KiB/s wr, 7 op/s 2023-05-08T05:32:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:45 smithi133 ceph-mon[125939]: pgmap v3529: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 215 KiB/s wr, 7 op/s 2023-05-08T05:32:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:45 smithi096 ceph-mon[124666]: pgmap v3529: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 215 KiB/s wr, 7 op/s 2023-05-08T05:32:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:46 smithi186 ceph-mon[126480]: pgmap v3530: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 359 KiB/s rd, 345 KiB/s wr, 13 op/s 2023-05-08T05:32:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:46 smithi133 ceph-mon[125939]: pgmap v3530: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 359 KiB/s rd, 345 KiB/s wr, 13 op/s 2023-05-08T05:32:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:46 smithi096 ceph-mon[124666]: pgmap v3530: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 359 KiB/s rd, 345 KiB/s wr, 13 op/s 2023-05-08T05:32:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6507.706761 secs 2023-05-08T05:32:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:49 smithi186 ceph-mon[126480]: pgmap v3531: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 245 KiB/s wr, 10 op/s 2023-05-08T05:32:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6507.706761 secs 2023-05-08T05:32:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:49 smithi133 ceph-mon[125939]: pgmap v3531: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 245 KiB/s wr, 10 op/s 2023-05-08T05:32:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6507.706761 secs 2023-05-08T05:32:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:49 smithi096 ceph-mon[124666]: pgmap v3531: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 245 KiB/s wr, 10 op/s 2023-05-08T05:32:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6508.264382 secs 2023-05-08T05:32:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6508.264382 secs 2023-05-08T05:32:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6508.264382 secs 2023-05-08T05:32:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:51 smithi096 ceph-mon[124666]: pgmap v3532: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 257 KiB/s wr, 14 op/s 2023-05-08T05:32:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:51 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:32:51.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:32:51.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:32:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:51 smithi186 ceph-mon[126480]: pgmap v3532: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 257 KiB/s wr, 14 op/s 2023-05-08T05:32:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:51 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:32:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:32:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:32:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:51 smithi133 ceph-mon[125939]: pgmap v3532: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 257 KiB/s wr, 14 op/s 2023-05-08T05:32:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:51 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:32:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:32:51.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:32:53.624 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:53 smithi186 ceph-mon[126480]: pgmap v3533: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 143 KiB/s wr, 10 op/s 2023-05-08T05:32:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:53 smithi133 ceph-mon[125939]: pgmap v3533: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 143 KiB/s wr, 10 op/s 2023-05-08T05:32:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:53 smithi096 ceph-mon[124666]: pgmap v3533: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 143 KiB/s wr, 10 op/s 2023-05-08T05:32:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6512.706902 secs 2023-05-08T05:32:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6512.706902 secs 2023-05-08T05:32:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6512.706902 secs 2023-05-08T05:32:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6513.264522 secs 2023-05-08T05:32:55.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:55 smithi186 ceph-mon[126480]: pgmap v3534: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 143 KiB/s wr, 10 op/s 2023-05-08T05:32:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6513.264522 secs 2023-05-08T05:32:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:55 smithi133 ceph-mon[125939]: pgmap v3534: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 143 KiB/s wr, 10 op/s 2023-05-08T05:32:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6513.264522 secs 2023-05-08T05:32:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:55 smithi096 ceph-mon[124666]: pgmap v3534: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 143 KiB/s wr, 10 op/s 2023-05-08T05:32:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6514.545106 secs 2023-05-08T05:32:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6514.545106 secs 2023-05-08T05:32:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6514.545106 secs 2023-05-08T05:32:57.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:57 smithi186 ceph-mon[126480]: pgmap v3535: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 379 KiB/s wr, 14 op/s 2023-05-08T05:32:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:57 smithi133 ceph-mon[125939]: pgmap v3535: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 379 KiB/s wr, 14 op/s 2023-05-08T05:32:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:57 smithi096 ceph-mon[124666]: pgmap v3535: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 379 KiB/s wr, 14 op/s 2023-05-08T05:32:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:58 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:32:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:32:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:32:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:58 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:32:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:32:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:32:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:58 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:32:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:32:58.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:32:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6517.707023 secs 2023-05-08T05:32:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:32:59 smithi186 ceph-mon[126480]: pgmap v3536: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 248 KiB/s wr, 8 op/s 2023-05-08T05:32:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6517.707023 secs 2023-05-08T05:32:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:32:59 smithi133 ceph-mon[125939]: pgmap v3536: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 248 KiB/s wr, 8 op/s 2023-05-08T05:32:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6517.707023 secs 2023-05-08T05:32:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:32:59 smithi096 ceph-mon[124666]: pgmap v3536: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 248 KiB/s wr, 8 op/s 2023-05-08T05:33:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6518.264623 secs 2023-05-08T05:33:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6518.264623 secs 2023-05-08T05:33:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6518.264623 secs 2023-05-08T05:33:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6519.545224 secs 2023-05-08T05:33:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:01 smithi186 ceph-mon[126480]: pgmap v3537: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 260 KiB/s wr, 13 op/s 2023-05-08T05:33:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6519.545224 secs 2023-05-08T05:33:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:01 smithi133 ceph-mon[125939]: pgmap v3537: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 260 KiB/s wr, 13 op/s 2023-05-08T05:33:01.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6519.545224 secs 2023-05-08T05:33:01.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:01 smithi096 ceph-mon[124666]: pgmap v3537: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 260 KiB/s wr, 13 op/s 2023-05-08T05:33:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:03 smithi186 ceph-mon[126480]: pgmap v3538: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 248 KiB/s wr, 9 op/s 2023-05-08T05:33:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:03 smithi133 ceph-mon[125939]: pgmap v3538: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 248 KiB/s wr, 9 op/s 2023-05-08T05:33:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:03 smithi096 ceph-mon[124666]: pgmap v3538: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 248 KiB/s wr, 9 op/s 2023-05-08T05:33:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6522.707137 secs 2023-05-08T05:33:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6522.707137 secs 2023-05-08T05:33:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6522.707137 secs 2023-05-08T05:33:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6523.264734 secs 2023-05-08T05:33:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:05 smithi186 ceph-mon[126480]: pgmap v3539: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 248 KiB/s wr, 9 op/s 2023-05-08T05:33:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6523.264734 secs 2023-05-08T05:33:05.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:05 smithi133 ceph-mon[125939]: pgmap v3539: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 248 KiB/s wr, 9 op/s 2023-05-08T05:33:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6523.264734 secs 2023-05-08T05:33:05.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:05 smithi096 ceph-mon[124666]: pgmap v3539: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 248 KiB/s wr, 9 op/s 2023-05-08T05:33:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6524.545338 secs 2023-05-08T05:33:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:06 smithi186 ceph-mon[126480]: osdmap e300: 12 total, 12 up, 12 in 2023-05-08T05:33:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6524.545338 secs 2023-05-08T05:33:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:06 smithi133 ceph-mon[125939]: osdmap e300: 12 total, 12 up, 12 in 2023-05-08T05:33:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6524.545338 secs 2023-05-08T05:33:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:06 smithi096 ceph-mon[124666]: osdmap e300: 12 total, 12 up, 12 in 2023-05-08T05:33:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:07 smithi186 ceph-mon[126480]: pgmap v3541: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 162 KiB/s wr, 28 op/s 2023-05-08T05:33:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:07 smithi133 ceph-mon[125939]: pgmap v3541: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 162 KiB/s wr, 28 op/s 2023-05-08T05:33:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:07 smithi096 ceph-mon[124666]: pgmap v3541: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 162 KiB/s wr, 28 op/s 2023-05-08T05:33:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6527.707241 secs 2023-05-08T05:33:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:09 smithi186 ceph-mon[126480]: pgmap v3542: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 162 KiB/s wr, 28 op/s 2023-05-08T05:33:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6527.707241 secs 2023-05-08T05:33:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:09 smithi133 ceph-mon[125939]: pgmap v3542: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 162 KiB/s wr, 28 op/s 2023-05-08T05:33:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6527.707241 secs 2023-05-08T05:33:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:09 smithi096 ceph-mon[124666]: pgmap v3542: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 162 KiB/s wr, 28 op/s 2023-05-08T05:33:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6528.264851 secs 2023-05-08T05:33:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6528.264851 secs 2023-05-08T05:33:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6528.264851 secs 2023-05-08T05:33:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6529.545453 secs 2023-05-08T05:33:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:11 smithi133 ceph-mon[125939]: pgmap v3543: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 148 KiB/s wr, 26 op/s 2023-05-08T05:33:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6529.545453 secs 2023-05-08T05:33:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:11 smithi096 ceph-mon[124666]: pgmap v3543: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 148 KiB/s wr, 26 op/s 2023-05-08T05:33:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6529.545453 secs 2023-05-08T05:33:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:11 smithi186 ceph-mon[126480]: pgmap v3543: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 148 KiB/s wr, 26 op/s 2023-05-08T05:33:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:13 smithi133 ceph-mon[125939]: pgmap v3544: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 148 KiB/s wr, 26 op/s 2023-05-08T05:33:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:13 smithi096 ceph-mon[124666]: pgmap v3544: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 148 KiB/s wr, 26 op/s 2023-05-08T05:33:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:13 smithi186 ceph-mon[126480]: pgmap v3544: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 148 KiB/s wr, 26 op/s 2023-05-08T05:33:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6532.707383 secs 2023-05-08T05:33:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:14 smithi133 ceph-mon[125939]: osdmap e301: 12 total, 12 up, 12 in 2023-05-08T05:33:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6532.707383 secs 2023-05-08T05:33:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:14 smithi096 ceph-mon[124666]: osdmap e301: 12 total, 12 up, 12 in 2023-05-08T05:33:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6532.707383 secs 2023-05-08T05:33:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:14 smithi186 ceph-mon[126480]: osdmap e301: 12 total, 12 up, 12 in 2023-05-08T05:33:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6533.265003 secs 2023-05-08T05:33:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:15 smithi133 ceph-mon[125939]: pgmap v3545: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 148 KiB/s wr, 26 op/s 2023-05-08T05:33:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6533.265003 secs 2023-05-08T05:33:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:15 smithi096 ceph-mon[124666]: pgmap v3545: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 148 KiB/s wr, 26 op/s 2023-05-08T05:33:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6533.265003 secs 2023-05-08T05:33:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:15 smithi186 ceph-mon[126480]: pgmap v3545: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 148 KiB/s wr, 26 op/s 2023-05-08T05:33:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6534.545586 secs 2023-05-08T05:33:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6534.545586 secs 2023-05-08T05:33:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6534.545586 secs 2023-05-08T05:33:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:17 smithi133 ceph-mon[125939]: pgmap v3547: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 7 op/s 2023-05-08T05:33:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:17 smithi096 ceph-mon[124666]: pgmap v3547: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 7 op/s 2023-05-08T05:33:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:17 smithi186 ceph-mon[126480]: pgmap v3547: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 7 op/s 2023-05-08T05:33:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6537.707502 secs 2023-05-08T05:33:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:19 smithi133 ceph-mon[125939]: pgmap v3548: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 7 op/s 2023-05-08T05:33:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6537.707502 secs 2023-05-08T05:33:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:19 smithi096 ceph-mon[124666]: pgmap v3548: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 7 op/s 2023-05-08T05:33:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6537.707502 secs 2023-05-08T05:33:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:19 smithi186 ceph-mon[126480]: pgmap v3548: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 7 op/s 2023-05-08T05:33:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6538.265133 secs 2023-05-08T05:33:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6538.265133 secs 2023-05-08T05:33:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6538.265133 secs 2023-05-08T05:33:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6539.545673 secs 2023-05-08T05:33:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:21 smithi133 ceph-mon[125939]: pgmap v3549: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 71 KiB/s wr, 7 op/s 2023-05-08T05:33:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6539.545673 secs 2023-05-08T05:33:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:21 smithi096 ceph-mon[124666]: pgmap v3549: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 71 KiB/s wr, 7 op/s 2023-05-08T05:33:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6539.545673 secs 2023-05-08T05:33:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:21 smithi186 ceph-mon[126480]: pgmap v3549: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 71 KiB/s wr, 7 op/s 2023-05-08T05:33:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:23 smithi133 ceph-mon[125939]: pgmap v3550: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 71 KiB/s wr, 7 op/s 2023-05-08T05:33:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:23 smithi096 ceph-mon[124666]: pgmap v3550: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 71 KiB/s wr, 7 op/s 2023-05-08T05:33:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:23 smithi186 ceph-mon[126480]: pgmap v3550: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 71 KiB/s wr, 7 op/s 2023-05-08T05:33:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6542.707585 secs 2023-05-08T05:33:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6542.707585 secs 2023-05-08T05:33:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6542.707585 secs 2023-05-08T05:33:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6543.265247 secs 2023-05-08T05:33:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:25 smithi133 ceph-mon[125939]: pgmap v3551: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 71 KiB/s wr, 7 op/s 2023-05-08T05:33:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6543.265247 secs 2023-05-08T05:33:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:25 smithi096 ceph-mon[124666]: pgmap v3551: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 71 KiB/s wr, 7 op/s 2023-05-08T05:33:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6543.265247 secs 2023-05-08T05:33:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:25 smithi186 ceph-mon[126480]: pgmap v3551: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 71 KiB/s wr, 7 op/s 2023-05-08T05:33:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6544.545809 secs 2023-05-08T05:33:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6544.545809 secs 2023-05-08T05:33:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6544.545809 secs 2023-05-08T05:33:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:27 smithi133 ceph-mon[125939]: pgmap v3552: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 86 KiB/s wr, 7 op/s 2023-05-08T05:33:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:27 smithi096 ceph-mon[124666]: pgmap v3552: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 86 KiB/s wr, 7 op/s 2023-05-08T05:33:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:27 smithi186 ceph-mon[126480]: pgmap v3552: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 86 KiB/s wr, 7 op/s 2023-05-08T05:33:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6547.707659 secs 2023-05-08T05:33:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:29 smithi133 ceph-mon[125939]: pgmap v3553: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 84 KiB/s wr, 7 op/s 2023-05-08T05:33:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6547.707659 secs 2023-05-08T05:33:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:29 smithi096 ceph-mon[124666]: pgmap v3553: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 84 KiB/s wr, 7 op/s 2023-05-08T05:33:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6547.707659 secs 2023-05-08T05:33:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:29 smithi186 ceph-mon[126480]: pgmap v3553: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 84 KiB/s wr, 7 op/s 2023-05-08T05:33:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6548.265375 secs 2023-05-08T05:33:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6548.265375 secs 2023-05-08T05:33:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6548.265375 secs 2023-05-08T05:33:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6549.545924 secs 2023-05-08T05:33:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:31 smithi133 ceph-mon[125939]: pgmap v3554: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 84 KiB/s wr, 10 op/s 2023-05-08T05:33:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6549.545924 secs 2023-05-08T05:33:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:31 smithi096 ceph-mon[124666]: pgmap v3554: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 84 KiB/s wr, 10 op/s 2023-05-08T05:33:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6549.545924 secs 2023-05-08T05:33:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:31 smithi186 ceph-mon[126480]: pgmap v3554: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 84 KiB/s wr, 10 op/s 2023-05-08T05:33:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:33 smithi133 ceph-mon[125939]: pgmap v3555: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 48 KiB/s wr, 7 op/s 2023-05-08T05:33:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:33 smithi096 ceph-mon[124666]: pgmap v3555: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 48 KiB/s wr, 7 op/s 2023-05-08T05:33:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:33 smithi186 ceph-mon[126480]: pgmap v3555: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 48 KiB/s wr, 7 op/s 2023-05-08T05:33:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6552.707774 secs 2023-05-08T05:33:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6553.265508 secs 2023-05-08T05:33:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6552.707774 secs 2023-05-08T05:33:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6553.265508 secs 2023-05-08T05:33:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6552.707774 secs 2023-05-08T05:33:34.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6553.265508 secs 2023-05-08T05:33:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:35 smithi133 ceph-mon[125939]: pgmap v3556: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 48 KiB/s wr, 7 op/s 2023-05-08T05:33:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:35 smithi096 ceph-mon[124666]: pgmap v3556: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 48 KiB/s wr, 7 op/s 2023-05-08T05:33:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:35 smithi186 ceph-mon[126480]: pgmap v3556: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 48 KiB/s wr, 7 op/s 2023-05-08T05:33:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:37 smithi133 ceph-mon[125939]: pgmap v3557: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 196 KiB/s wr, 11 op/s 2023-05-08T05:33:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:37 smithi096 ceph-mon[124666]: pgmap v3557: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 196 KiB/s wr, 11 op/s 2023-05-08T05:33:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:37 smithi186 ceph-mon[126480]: pgmap v3557: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 196 KiB/s wr, 11 op/s 2023-05-08T05:33:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:38 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:33:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:38 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:33:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:38 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:33:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6557.707893 secs 2023-05-08T05:33:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:39 smithi133 ceph-mon[125939]: pgmap v3558: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 148 KiB/s wr, 7 op/s 2023-05-08T05:33:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:39 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:33:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:39 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:33:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:39 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:33:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:33:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6557.707893 secs 2023-05-08T05:33:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:39 smithi096 ceph-mon[124666]: pgmap v3558: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 148 KiB/s wr, 7 op/s 2023-05-08T05:33:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:39 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:33:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:39 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:33:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:39 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:33:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:33:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6557.707893 secs 2023-05-08T05:33:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:39 smithi186 ceph-mon[126480]: pgmap v3558: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 148 KiB/s wr, 7 op/s 2023-05-08T05:33:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:39 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:33:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:39 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:33:39.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:39 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:33:39.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:33:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:40 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:33:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:40 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:33:40.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:40 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:33:40.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:40 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:33:40.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:40 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T05:33:40.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:40 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T05:33:40.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:40 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:33:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:40 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:33:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:40 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:33:40.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:40 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:33:40.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:40 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:33:40.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:40 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T05:33:40.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:40 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T05:33:40.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:40 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:33:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:40 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:33:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:40 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:33:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:40 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:33:40.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:40 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:33:40.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:40 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T05:33:40.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:40 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T05:33:40.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:40 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:33:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:41 smithi096 ceph-mon[124666]: pgmap v3559: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 217 KiB/s wr, 11 op/s 2023-05-08T05:33:41.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:41 smithi186 ceph-mon[126480]: pgmap v3559: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 217 KiB/s wr, 11 op/s 2023-05-08T05:33:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:41 smithi133 ceph-mon[125939]: pgmap v3559: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 217 KiB/s wr, 11 op/s 2023-05-08T05:33:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:33:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:33:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:33:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:43 smithi096 ceph-mon[124666]: pgmap v3560: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 217 KiB/s wr, 7 op/s 2023-05-08T05:33:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:33:43.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:33:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:43 smithi186 ceph-mon[126480]: pgmap v3560: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 217 KiB/s wr, 7 op/s 2023-05-08T05:33:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:33:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:33:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:43 smithi133 ceph-mon[125939]: pgmap v3560: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 217 KiB/s wr, 7 op/s 2023-05-08T05:33:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:33:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:33:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6562.707981 secs 2023-05-08T05:33:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:44 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:33:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6562.707981 secs 2023-05-08T05:33:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:44 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:33:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6562.707981 secs 2023-05-08T05:33:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:44 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:33:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:45 smithi186 ceph-mon[126480]: pgmap v3561: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 217 KiB/s wr, 7 op/s 2023-05-08T05:33:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:45 smithi133 ceph-mon[125939]: pgmap v3561: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 217 KiB/s wr, 7 op/s 2023-05-08T05:33:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:45 smithi096 ceph-mon[124666]: pgmap v3561: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 217 KiB/s wr, 7 op/s 2023-05-08T05:33:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:47 smithi186 ceph-mon[126480]: pgmap v3562: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 349 KiB/s wr, 12 op/s 2023-05-08T05:33:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:47 smithi133 ceph-mon[125939]: pgmap v3562: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 349 KiB/s wr, 12 op/s 2023-05-08T05:33:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:47 smithi096 ceph-mon[124666]: pgmap v3562: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 349 KiB/s wr, 12 op/s 2023-05-08T05:33:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6567.708098 secs 2023-05-08T05:33:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:49 smithi186 ceph-mon[126480]: pgmap v3563: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 201 KiB/s wr, 9 op/s 2023-05-08T05:33:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6568.265786 secs 2023-05-08T05:33:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6567.708098 secs 2023-05-08T05:33:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:49 smithi133 ceph-mon[125939]: pgmap v3563: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 201 KiB/s wr, 9 op/s 2023-05-08T05:33:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6568.265786 secs 2023-05-08T05:33:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6567.708098 secs 2023-05-08T05:33:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:49 smithi096 ceph-mon[124666]: pgmap v3563: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 201 KiB/s wr, 9 op/s 2023-05-08T05:33:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6568.265786 secs 2023-05-08T05:33:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:33:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:33:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:33:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:33:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:33:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:33:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:33:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:33:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:33:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:51 smithi186 ceph-mon[126480]: pgmap v3564: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 259 KiB/s wr, 13 op/s 2023-05-08T05:33:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:51 smithi133 ceph-mon[125939]: pgmap v3564: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 259 KiB/s wr, 13 op/s 2023-05-08T05:33:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:51 smithi096 ceph-mon[124666]: pgmap v3564: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 259 KiB/s wr, 13 op/s 2023-05-08T05:33:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:53 smithi186 ceph-mon[126480]: pgmap v3565: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 191 KiB/s wr, 9 op/s 2023-05-08T05:33:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:53 smithi133 ceph-mon[125939]: pgmap v3565: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 191 KiB/s wr, 9 op/s 2023-05-08T05:33:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:53 smithi096 ceph-mon[124666]: pgmap v3565: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 191 KiB/s wr, 9 op/s 2023-05-08T05:33:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6572.708235 secs 2023-05-08T05:33:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6573.265931 secs 2023-05-08T05:33:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6572.708235 secs 2023-05-08T05:33:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6573.265931 secs 2023-05-08T05:33:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6572.708235 secs 2023-05-08T05:33:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6573.265931 secs 2023-05-08T05:33:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:55 smithi186 ceph-mon[126480]: pgmap v3566: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 191 KiB/s wr, 9 op/s 2023-05-08T05:33:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:55 smithi133 ceph-mon[125939]: pgmap v3566: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 191 KiB/s wr, 9 op/s 2023-05-08T05:33:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:55 smithi096 ceph-mon[124666]: pgmap v3566: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 191 KiB/s wr, 9 op/s 2023-05-08T05:33:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:56 smithi186 ceph-mon[126480]: pgmap v3567: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 327 KiB/s wr, 13 op/s 2023-05-08T05:33:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:56 smithi133 ceph-mon[125939]: pgmap v3567: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 327 KiB/s wr, 13 op/s 2023-05-08T05:33:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:56 smithi096 ceph-mon[124666]: pgmap v3567: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 327 KiB/s wr, 13 op/s 2023-05-08T05:33:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6577.708374 secs 2023-05-08T05:33:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:33:59 smithi186 ceph-mon[126480]: pgmap v3568: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 194 KiB/s wr, 8 op/s 2023-05-08T05:33:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6577.708374 secs 2023-05-08T05:33:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:33:59 smithi133 ceph-mon[125939]: pgmap v3568: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 194 KiB/s wr, 8 op/s 2023-05-08T05:33:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6577.708374 secs 2023-05-08T05:33:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:33:59 smithi096 ceph-mon[124666]: pgmap v3568: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 194 KiB/s wr, 8 op/s 2023-05-08T05:34:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6578.266049 secs 2023-05-08T05:34:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6578.266049 secs 2023-05-08T05:34:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6578.266049 secs 2023-05-08T05:34:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6579.546605 secs 2023-05-08T05:34:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:01 smithi186 ceph-mon[126480]: pgmap v3569: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 207 KiB/s wr, 12 op/s 2023-05-08T05:34:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6579.546605 secs 2023-05-08T05:34:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:01 smithi133 ceph-mon[125939]: pgmap v3569: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 207 KiB/s wr, 12 op/s 2023-05-08T05:34:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6579.546605 secs 2023-05-08T05:34:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:01 smithi096 ceph-mon[124666]: pgmap v3569: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 207 KiB/s wr, 12 op/s 2023-05-08T05:34:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:02 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:34:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:34:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:34:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:02 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:34:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:34:02.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:34:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:02 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:34:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:34:02.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:34:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:03 smithi186 ceph-mon[126480]: pgmap v3570: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 148 KiB/s wr, 7 op/s 2023-05-08T05:34:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:03 smithi133 ceph-mon[125939]: pgmap v3570: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 148 KiB/s wr, 7 op/s 2023-05-08T05:34:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:03 smithi096 ceph-mon[124666]: pgmap v3570: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 148 KiB/s wr, 7 op/s 2023-05-08T05:34:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6582.708423 secs 2023-05-08T05:34:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6582.708423 secs 2023-05-08T05:34:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6582.708423 secs 2023-05-08T05:34:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6583.266144 secs 2023-05-08T05:34:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:05 smithi186 ceph-mon[126480]: pgmap v3571: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 148 KiB/s wr, 7 op/s 2023-05-08T05:34:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6583.266144 secs 2023-05-08T05:34:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:05 smithi133 ceph-mon[125939]: pgmap v3571: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 148 KiB/s wr, 7 op/s 2023-05-08T05:34:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6583.266144 secs 2023-05-08T05:34:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:05 smithi096 ceph-mon[124666]: pgmap v3571: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 148 KiB/s wr, 7 op/s 2023-05-08T05:34:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6584.546742 secs 2023-05-08T05:34:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:06 smithi186 ceph-mon[126480]: osdmap e302: 12 total, 12 up, 12 in 2023-05-08T05:34:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6584.546742 secs 2023-05-08T05:34:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:06 smithi133 ceph-mon[125939]: osdmap e302: 12 total, 12 up, 12 in 2023-05-08T05:34:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6584.546742 secs 2023-05-08T05:34:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:06 smithi096 ceph-mon[124666]: osdmap e302: 12 total, 12 up, 12 in 2023-05-08T05:34:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:07 smithi186 ceph-mon[126480]: pgmap v3573: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 169 KiB/s wr, 27 op/s 2023-05-08T05:34:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:07 smithi133 ceph-mon[125939]: pgmap v3573: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 169 KiB/s wr, 27 op/s 2023-05-08T05:34:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:07 smithi096 ceph-mon[124666]: pgmap v3573: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 169 KiB/s wr, 27 op/s 2023-05-08T05:34:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6587.708536 secs 2023-05-08T05:34:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:09 smithi186 ceph-mon[126480]: pgmap v3574: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 169 KiB/s wr, 27 op/s 2023-05-08T05:34:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6587.708536 secs 2023-05-08T05:34:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:09 smithi133 ceph-mon[125939]: pgmap v3574: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 169 KiB/s wr, 27 op/s 2023-05-08T05:34:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6587.708536 secs 2023-05-08T05:34:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:09 smithi096 ceph-mon[124666]: pgmap v3574: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 169 KiB/s wr, 27 op/s 2023-05-08T05:34:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6588.266266 secs 2023-05-08T05:34:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6588.266266 secs 2023-05-08T05:34:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6588.266266 secs 2023-05-08T05:34:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6589.546880 secs 2023-05-08T05:34:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:11 smithi186 ceph-mon[126480]: pgmap v3575: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 156 KiB/s wr, 26 op/s 2023-05-08T05:34:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6589.546880 secs 2023-05-08T05:34:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:11 smithi133 ceph-mon[125939]: pgmap v3575: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 156 KiB/s wr, 26 op/s 2023-05-08T05:34:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6589.546880 secs 2023-05-08T05:34:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:11 smithi096 ceph-mon[124666]: pgmap v3575: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 156 KiB/s wr, 26 op/s 2023-05-08T05:34:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:13 smithi186 ceph-mon[126480]: pgmap v3576: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 156 KiB/s wr, 27 op/s 2023-05-08T05:34:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:13 smithi133 ceph-mon[125939]: pgmap v3576: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 156 KiB/s wr, 27 op/s 2023-05-08T05:34:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:13 smithi096 ceph-mon[124666]: pgmap v3576: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 156 KiB/s wr, 27 op/s 2023-05-08T05:34:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6592.708597 secs 2023-05-08T05:34:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:14 smithi186 ceph-mon[126480]: osdmap e303: 12 total, 12 up, 12 in 2023-05-08T05:34:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6592.708597 secs 2023-05-08T05:34:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:14 smithi133 ceph-mon[125939]: osdmap e303: 12 total, 12 up, 12 in 2023-05-08T05:34:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6592.708597 secs 2023-05-08T05:34:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:14 smithi096 ceph-mon[124666]: osdmap e303: 12 total, 12 up, 12 in 2023-05-08T05:34:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6593.266402 secs 2023-05-08T05:34:15.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:15 smithi186 ceph-mon[126480]: pgmap v3577: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 156 KiB/s wr, 27 op/s 2023-05-08T05:34:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6593.266402 secs 2023-05-08T05:34:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:15 smithi133 ceph-mon[125939]: pgmap v3577: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 156 KiB/s wr, 27 op/s 2023-05-08T05:34:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6593.266402 secs 2023-05-08T05:34:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:15 smithi096 ceph-mon[124666]: pgmap v3577: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 156 KiB/s wr, 27 op/s 2023-05-08T05:34:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6594.546948 secs 2023-05-08T05:34:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6594.546948 secs 2023-05-08T05:34:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6594.546948 secs 2023-05-08T05:34:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:17 smithi133 ceph-mon[125939]: pgmap v3579: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 8 op/s 2023-05-08T05:34:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:17 smithi096 ceph-mon[124666]: pgmap v3579: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 8 op/s 2023-05-08T05:34:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:17 smithi186 ceph-mon[126480]: pgmap v3579: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 8 op/s 2023-05-08T05:34:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6597.708680 secs 2023-05-08T05:34:19.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:19 smithi133 ceph-mon[125939]: pgmap v3580: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 8 op/s 2023-05-08T05:34:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6597.708680 secs 2023-05-08T05:34:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:19 smithi096 ceph-mon[124666]: pgmap v3580: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 8 op/s 2023-05-08T05:34:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6597.708680 secs 2023-05-08T05:34:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:19 smithi186 ceph-mon[126480]: pgmap v3580: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 8 op/s 2023-05-08T05:34:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6598.266476 secs 2023-05-08T05:34:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6598.266476 secs 2023-05-08T05:34:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6598.266476 secs 2023-05-08T05:34:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6599.547056 secs 2023-05-08T05:34:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:21 smithi133 ceph-mon[125939]: pgmap v3581: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 72 KiB/s wr, 8 op/s 2023-05-08T05:34:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6599.547056 secs 2023-05-08T05:34:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:21 smithi096 ceph-mon[124666]: pgmap v3581: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 72 KiB/s wr, 8 op/s 2023-05-08T05:34:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6599.547056 secs 2023-05-08T05:34:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:21 smithi186 ceph-mon[126480]: pgmap v3581: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 72 KiB/s wr, 8 op/s 2023-05-08T05:34:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:23 smithi133 ceph-mon[125939]: pgmap v3582: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 72 KiB/s wr, 7 op/s 2023-05-08T05:34:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:23 smithi096 ceph-mon[124666]: pgmap v3582: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 72 KiB/s wr, 7 op/s 2023-05-08T05:34:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:23 smithi186 ceph-mon[126480]: pgmap v3582: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 72 KiB/s wr, 7 op/s 2023-05-08T05:34:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6602.708756 secs 2023-05-08T05:34:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6602.708756 secs 2023-05-08T05:34:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6602.708756 secs 2023-05-08T05:34:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6603.266592 secs 2023-05-08T05:34:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:25 smithi133 ceph-mon[125939]: pgmap v3583: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 72 KiB/s wr, 7 op/s 2023-05-08T05:34:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6603.266592 secs 2023-05-08T05:34:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:25 smithi096 ceph-mon[124666]: pgmap v3583: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 72 KiB/s wr, 7 op/s 2023-05-08T05:34:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6603.266592 secs 2023-05-08T05:34:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:25 smithi186 ceph-mon[126480]: pgmap v3583: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 72 KiB/s wr, 7 op/s 2023-05-08T05:34:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6604.547196 secs 2023-05-08T05:34:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6604.547196 secs 2023-05-08T05:34:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6604.547196 secs 2023-05-08T05:34:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:27 smithi133 ceph-mon[125939]: pgmap v3584: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 134 KiB/s wr, 7 op/s 2023-05-08T05:34:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:27 smithi096 ceph-mon[124666]: pgmap v3584: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 134 KiB/s wr, 7 op/s 2023-05-08T05:34:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:27 smithi186 ceph-mon[126480]: pgmap v3584: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 134 KiB/s wr, 7 op/s 2023-05-08T05:34:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6607.708874 secs 2023-05-08T05:34:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:29 smithi133 ceph-mon[125939]: pgmap v3585: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 131 KiB/s wr, 7 op/s 2023-05-08T05:34:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6607.708874 secs 2023-05-08T05:34:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:29 smithi096 ceph-mon[124666]: pgmap v3585: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 131 KiB/s wr, 7 op/s 2023-05-08T05:34:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6607.708874 secs 2023-05-08T05:34:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:29 smithi186 ceph-mon[126480]: pgmap v3585: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 131 KiB/s wr, 7 op/s 2023-05-08T05:34:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6608.266754 secs 2023-05-08T05:34:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6608.266754 secs 2023-05-08T05:34:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6608.266754 secs 2023-05-08T05:34:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6609.547317 secs 2023-05-08T05:34:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:31 smithi133 ceph-mon[125939]: pgmap v3586: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 131 KiB/s wr, 10 op/s 2023-05-08T05:34:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6609.547317 secs 2023-05-08T05:34:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:31 smithi096 ceph-mon[124666]: pgmap v3586: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 131 KiB/s wr, 10 op/s 2023-05-08T05:34:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6609.547317 secs 2023-05-08T05:34:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:31 smithi186 ceph-mon[126480]: pgmap v3586: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 131 KiB/s wr, 10 op/s 2023-05-08T05:34:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:33 smithi133 ceph-mon[125939]: pgmap v3587: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 95 KiB/s wr, 7 op/s 2023-05-08T05:34:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:33 smithi096 ceph-mon[124666]: pgmap v3587: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 95 KiB/s wr, 7 op/s 2023-05-08T05:34:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:33 smithi186 ceph-mon[126480]: pgmap v3587: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 95 KiB/s wr, 7 op/s 2023-05-08T05:34:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6612.708954 secs 2023-05-08T05:34:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6612.708954 secs 2023-05-08T05:34:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6612.708954 secs 2023-05-08T05:34:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6613.266881 secs 2023-05-08T05:34:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:35 smithi133 ceph-mon[125939]: pgmap v3588: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 95 KiB/s wr, 7 op/s 2023-05-08T05:34:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6613.266881 secs 2023-05-08T05:34:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:35 smithi096 ceph-mon[124666]: pgmap v3588: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 95 KiB/s wr, 7 op/s 2023-05-08T05:34:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6613.266881 secs 2023-05-08T05:34:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:35 smithi186 ceph-mon[126480]: pgmap v3588: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 95 KiB/s wr, 7 op/s 2023-05-08T05:34:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:37 smithi133 ceph-mon[125939]: pgmap v3589: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 198 KiB/s wr, 10 op/s 2023-05-08T05:34:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:37 smithi096 ceph-mon[124666]: pgmap v3589: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 198 KiB/s wr, 10 op/s 2023-05-08T05:34:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:37 smithi186 ceph-mon[126480]: pgmap v3589: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 198 KiB/s wr, 10 op/s 2023-05-08T05:34:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:38 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:34:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:38 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:34:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:38 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:34:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6617.709068 secs 2023-05-08T05:34:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:39 smithi133 ceph-mon[125939]: pgmap v3590: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 103 KiB/s wr, 6 op/s 2023-05-08T05:34:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:39 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:34:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:39 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:34:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:39 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:34:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6617.709068 secs 2023-05-08T05:34:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:39 smithi096 ceph-mon[124666]: pgmap v3590: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 103 KiB/s wr, 6 op/s 2023-05-08T05:34:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:39 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:34:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:39 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:34:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:39 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:34:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6617.709068 secs 2023-05-08T05:34:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:39 smithi186 ceph-mon[126480]: pgmap v3590: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 103 KiB/s wr, 6 op/s 2023-05-08T05:34:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:39 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:34:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:39 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:34:39.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:39 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:34:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:40 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:34:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:40 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:34:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:40 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:34:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:41 smithi133 ceph-mon[125939]: pgmap v3591: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 172 KiB/s wr, 10 op/s 2023-05-08T05:34:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:41 smithi096 ceph-mon[124666]: pgmap v3591: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 172 KiB/s wr, 10 op/s 2023-05-08T05:34:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:41 smithi186 ceph-mon[126480]: pgmap v3591: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 172 KiB/s wr, 10 op/s 2023-05-08T05:34:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:34:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:34:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:34:42.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:34:42.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:34:42.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:34:42.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:34:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:34:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:34:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:34:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:34:42.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:34:42.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:34:42.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:34:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:34:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:34:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:34:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:34:42.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:34:42.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:34:42.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:34:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:43 smithi133 ceph-mon[125939]: pgmap v3592: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 172 KiB/s wr, 7 op/s 2023-05-08T05:34:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:34:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:34:43.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:43 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:34:43.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:43 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:34:43.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:43 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:34:43.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:43 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:34:43.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:43 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:34:43.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:43 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:34:43.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:43 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:34:43.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:43 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:34:43.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:43 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:34:43.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:43 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:34:43.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:43 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:34:43.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:43 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:34:43.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:43 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:34:43.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:43 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:34:43.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:43 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:34:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:43 smithi096 ceph-mon[124666]: pgmap v3592: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 172 KiB/s wr, 7 op/s 2023-05-08T05:34:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:34:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:34:43.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:43 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:34:43.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:43 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:34:43.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:43 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:34:43.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:43 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:34:43.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:43 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:34:43.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:43 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:34:43.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:43 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:34:43.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:43 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:34:43.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:43 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:34:43.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:43 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:34:43.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:43 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:34:43.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:43 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:34:43.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:43 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:34:43.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:43 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:34:43.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:43 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:34:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:43 smithi186 ceph-mon[126480]: pgmap v3592: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 172 KiB/s wr, 7 op/s 2023-05-08T05:34:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:34:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:34:43.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:43 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:34:43.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:43 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:34:43.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:43 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:34:43.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:43 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:34:43.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:43 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:34:43.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:43 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:34:43.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:43 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:34:43.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:43 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:34:43.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:43 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:34:43.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:43 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:34:43.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:43 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:34:43.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:43 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:34:43.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:43 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:34:43.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:43 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:34:43.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:43 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:34:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:44 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T05:34:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:44 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T05:34:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6622.709130 secs 2023-05-08T05:34:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:44 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi096 to 196.2M 2023-05-08T05:34:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:44 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi096 to 205766758: error parsing value: Value '205766758' is below minimum 939524096 2023-05-08T05:34:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:44 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T05:34:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:44 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T05:34:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:44 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:34:44.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:44 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T05:34:44.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:44 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T05:34:44.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:44 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:34:44.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:44 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:34:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:44 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T05:34:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:44 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T05:34:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6622.709130 secs 2023-05-08T05:34:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:44 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi096 to 196.2M 2023-05-08T05:34:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:44 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi096 to 205766758: error parsing value: Value '205766758' is below minimum 939524096 2023-05-08T05:34:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:44 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T05:34:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:44 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T05:34:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:44 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:34:44.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:44 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T05:34:44.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:44 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T05:34:44.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:44 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:34:44.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:44 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:34:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:44 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T05:34:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:44 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T05:34:44.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6622.709130 secs 2023-05-08T05:34:44.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:44 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi096 to 196.2M 2023-05-08T05:34:44.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:44 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi096 to 205766758: error parsing value: Value '205766758' is below minimum 939524096 2023-05-08T05:34:44.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:44 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T05:34:44.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:44 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T05:34:44.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:44 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:34:44.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:44 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T05:34:44.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:44 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T05:34:44.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:44 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:34:44.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:44 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:34:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:45 smithi133 ceph-mon[125939]: pgmap v3593: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 172 KiB/s wr, 7 op/s 2023-05-08T05:34:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:45 smithi096 ceph-mon[124666]: pgmap v3593: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 172 KiB/s wr, 7 op/s 2023-05-08T05:34:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:45 smithi186 ceph-mon[126480]: pgmap v3593: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 172 KiB/s wr, 7 op/s 2023-05-08T05:34:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:47 smithi133 ceph-mon[125939]: pgmap v3594: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 384 KiB/s rd, 362 KiB/s wr, 13 op/s 2023-05-08T05:34:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:47 smithi096 ceph-mon[124666]: pgmap v3594: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 384 KiB/s rd, 362 KiB/s wr, 13 op/s 2023-05-08T05:34:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:47 smithi186 ceph-mon[126480]: pgmap v3594: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 384 KiB/s rd, 362 KiB/s wr, 13 op/s 2023-05-08T05:34:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6627.709194 secs 2023-05-08T05:34:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:49 smithi133 ceph-mon[125939]: pgmap v3595: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 260 KiB/s wr, 10 op/s 2023-05-08T05:34:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6628.267246 secs 2023-05-08T05:34:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6627.709194 secs 2023-05-08T05:34:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:49 smithi096 ceph-mon[124666]: pgmap v3595: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 260 KiB/s wr, 10 op/s 2023-05-08T05:34:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6628.267246 secs 2023-05-08T05:34:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6627.709194 secs 2023-05-08T05:34:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:49 smithi186 ceph-mon[126480]: pgmap v3595: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 260 KiB/s wr, 10 op/s 2023-05-08T05:34:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6628.267246 secs 2023-05-08T05:34:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:34:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:34:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:34:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:34:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:34:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:34:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:34:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:34:51.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:34:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:51 smithi186 ceph-mon[126480]: pgmap v3596: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 261 KiB/s wr, 13 op/s 2023-05-08T05:34:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:51 smithi133 ceph-mon[125939]: pgmap v3596: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 261 KiB/s wr, 13 op/s 2023-05-08T05:34:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:51 smithi096 ceph-mon[124666]: pgmap v3596: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 261 KiB/s wr, 13 op/s 2023-05-08T05:34:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:53 smithi186 ceph-mon[126480]: pgmap v3597: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 258 KiB/s wr, 10 op/s 2023-05-08T05:34:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:53 smithi133 ceph-mon[125939]: pgmap v3597: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 258 KiB/s wr, 10 op/s 2023-05-08T05:34:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:53 smithi096 ceph-mon[124666]: pgmap v3597: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 258 KiB/s wr, 10 op/s 2023-05-08T05:34:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6632.709252 secs 2023-05-08T05:34:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6633.267337 secs 2023-05-08T05:34:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6632.709252 secs 2023-05-08T05:34:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6633.267337 secs 2023-05-08T05:34:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6632.709252 secs 2023-05-08T05:34:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6633.267337 secs 2023-05-08T05:34:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:55 smithi186 ceph-mon[126480]: pgmap v3598: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 258 KiB/s wr, 10 op/s 2023-05-08T05:34:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:55 smithi133 ceph-mon[125939]: pgmap v3598: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 258 KiB/s wr, 10 op/s 2023-05-08T05:34:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:55 smithi096 ceph-mon[124666]: pgmap v3598: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 258 KiB/s wr, 10 op/s 2023-05-08T05:34:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6634.547837 secs 2023-05-08T05:34:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6634.547837 secs 2023-05-08T05:34:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6634.547837 secs 2023-05-08T05:34:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:57 smithi186 ceph-mon[126480]: pgmap v3599: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 418 KiB/s rd, 396 KiB/s wr, 14 op/s 2023-05-08T05:34:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:57 smithi133 ceph-mon[125939]: pgmap v3599: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 418 KiB/s rd, 396 KiB/s wr, 14 op/s 2023-05-08T05:34:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:57 smithi096 ceph-mon[124666]: pgmap v3599: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 418 KiB/s rd, 396 KiB/s wr, 14 op/s 2023-05-08T05:34:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:58 smithi186 ceph-mon[126480]: pgmap v3600: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 206 KiB/s wr, 8 op/s 2023-05-08T05:34:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:58 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:34:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:34:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:34:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:58 smithi133 ceph-mon[125939]: pgmap v3600: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 206 KiB/s wr, 8 op/s 2023-05-08T05:34:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:58 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:34:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:34:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:34:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:58 smithi096 ceph-mon[124666]: pgmap v3600: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 206 KiB/s wr, 8 op/s 2023-05-08T05:34:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:58 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:34:59.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:34:59.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:34:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6637.709398 secs 2023-05-08T05:34:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:34:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6638.267402 secs 2023-05-08T05:34:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6637.709398 secs 2023-05-08T05:34:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:34:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6638.267402 secs 2023-05-08T05:35:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6637.709398 secs 2023-05-08T05:35:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:34:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6638.267402 secs 2023-05-08T05:35:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:35:00 smithi186 ceph-mon[126480]: pgmap v3601: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 208 KiB/s wr, 12 op/s 2023-05-08T05:35:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:35:00 smithi133 ceph-mon[125939]: pgmap v3601: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 208 KiB/s wr, 12 op/s 2023-05-08T05:35:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:35:00 smithi096 ceph-mon[124666]: pgmap v3601: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 208 KiB/s wr, 12 op/s 2023-05-08T05:35:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:35:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6639.547950 secs 2023-05-08T05:35:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:35:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6639.547950 secs 2023-05-08T05:35:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:35:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6639.547950 secs 2023-05-08T05:35:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:35:02 smithi186 ceph-mon[126480]: pgmap v3602: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 281 KiB/s wr, 9 op/s 2023-05-08T05:35:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:35:02 smithi133 ceph-mon[125939]: pgmap v3602: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 281 KiB/s wr, 9 op/s 2023-05-08T05:35:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:35:02 smithi096 ceph-mon[124666]: pgmap v3602: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 281 KiB/s wr, 9 op/s 2023-05-08T05:35:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:35:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6642.709537 secs 2023-05-08T05:35:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:35:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6642.709537 secs 2023-05-08T05:35:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:35:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6642.709537 secs 2023-05-08T05:35:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:35:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6643.267518 secs 2023-05-08T05:35:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:35:05 smithi186 ceph-mon[126480]: pgmap v3603: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 214 KiB/s wr, 8 op/s 2023-05-08T05:35:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:35:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6643.267518 secs 2023-05-08T05:35:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:35:05 smithi133 ceph-mon[125939]: pgmap v3603: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 214 KiB/s wr, 8 op/s 2023-05-08T05:35:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:35:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6643.267518 secs 2023-05-08T05:35:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:35:05 smithi096 ceph-mon[124666]: pgmap v3603: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 214 KiB/s wr, 8 op/s 2023-05-08T05:35:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:35:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6644.548066 secs 2023-05-08T05:35:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:35:06 smithi186 ceph-mon[126480]: osdmap e304: 12 total, 12 up, 12 in 2023-05-08T05:35:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:35:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6644.548066 secs 2023-05-08T05:35:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:35:06 smithi133 ceph-mon[125939]: osdmap e304: 12 total, 12 up, 12 in 2023-05-08T05:35:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:35:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6644.548066 secs 2023-05-08T05:35:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:35:06 smithi096 ceph-mon[124666]: osdmap e304: 12 total, 12 up, 12 in 2023-05-08T05:35:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:35:07 smithi186 ceph-mon[126480]: pgmap v3605: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 208 KiB/s wr, 28 op/s 2023-05-08T05:35:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:35:07 smithi133 ceph-mon[125939]: pgmap v3605: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 208 KiB/s wr, 28 op/s 2023-05-08T05:35:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:35:07 smithi096 ceph-mon[124666]: pgmap v3605: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 208 KiB/s wr, 28 op/s 2023-05-08T05:35:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:35:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6647.709682 secs 2023-05-08T05:35:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:35:09 smithi186 ceph-mon[126480]: pgmap v3606: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 208 KiB/s wr, 28 op/s 2023-05-08T05:35:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:35:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6647.709682 secs 2023-05-08T05:35:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:35:09 smithi133 ceph-mon[125939]: pgmap v3606: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 208 KiB/s wr, 28 op/s 2023-05-08T05:35:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:35:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6647.709682 secs 2023-05-08T05:35:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:35:09 smithi096 ceph-mon[124666]: pgmap v3606: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 208 KiB/s wr, 28 op/s 2023-05-08T05:35:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:35:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6648.267638 secs 2023-05-08T05:35:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:35:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6648.267638 secs 2023-05-08T05:35:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:35:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6648.267638 secs 2023-05-08T05:35:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:35:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6649.548202 secs 2023-05-08T05:35:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:35:11 smithi186 ceph-mon[126480]: pgmap v3607: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 206 KiB/s wr, 27 op/s 2023-05-08T05:35:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:35:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6649.548202 secs 2023-05-08T05:35:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:35:11 smithi133 ceph-mon[125939]: pgmap v3607: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 206 KiB/s wr, 27 op/s 2023-05-08T05:35:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:35:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6649.548202 secs 2023-05-08T05:35:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:35:11 smithi096 ceph-mon[124666]: pgmap v3607: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 206 KiB/s wr, 27 op/s 2023-05-08T05:35:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:35:13 smithi186 ceph-mon[126480]: pgmap v3608: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 144 KiB/s wr, 27 op/s 2023-05-08T05:35:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:35:13 smithi133 ceph-mon[125939]: pgmap v3608: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 144 KiB/s wr, 27 op/s 2023-05-08T05:35:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:35:13 smithi096 ceph-mon[124666]: pgmap v3608: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 144 KiB/s wr, 27 op/s 2023-05-08T05:35:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:35:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6652.709811 secs 2023-05-08T05:35:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:35:14 smithi186 ceph-mon[126480]: osdmap e305: 12 total, 12 up, 12 in 2023-05-08T05:35:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:35:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6652.709811 secs 2023-05-08T05:35:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:35:14 smithi133 ceph-mon[125939]: osdmap e305: 12 total, 12 up, 12 in 2023-05-08T05:35:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:35:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6652.709811 secs 2023-05-08T05:35:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:35:14 smithi096 ceph-mon[124666]: osdmap e305: 12 total, 12 up, 12 in 2023-05-08T05:35:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:35:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6653.267703 secs 2023-05-08T05:35:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:35:15 smithi186 ceph-mon[126480]: pgmap v3609: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 144 KiB/s wr, 27 op/s 2023-05-08T05:35:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:35:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6653.267703 secs 2023-05-08T05:35:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:35:15 smithi133 ceph-mon[125939]: pgmap v3609: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 144 KiB/s wr, 27 op/s 2023-05-08T05:35:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:35:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6653.267703 secs 2023-05-08T05:35:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:35:15 smithi096 ceph-mon[124666]: pgmap v3609: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 144 KiB/s wr, 27 op/s 2023-05-08T05:35:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:35:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6654.548329 secs 2023-05-08T05:35:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:35:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6654.548329 secs 2023-05-08T05:35:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:35:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6654.548329 secs 2023-05-08T05:35:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:35:17 smithi186 ceph-mon[126480]: pgmap v3611: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 8 op/s 2023-05-08T05:35:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:35:17 smithi133 ceph-mon[125939]: pgmap v3611: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 8 op/s 2023-05-08T05:35:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:35:17 smithi096 ceph-mon[124666]: pgmap v3611: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 8 op/s 2023-05-08T05:35:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:35:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6657.709930 secs 2023-05-08T05:35:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:35:19 smithi186 ceph-mon[126480]: pgmap v3612: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 8 op/s 2023-05-08T05:35:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:35:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6657.709930 secs 2023-05-08T05:35:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:35:19 smithi133 ceph-mon[125939]: pgmap v3612: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 8 op/s 2023-05-08T05:35:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:35:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6657.709930 secs 2023-05-08T05:35:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:35:19 smithi096 ceph-mon[124666]: pgmap v3612: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 8 op/s 2023-05-08T05:35:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:35:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6658.267825 secs 2023-05-08T05:35:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:35:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6658.267825 secs 2023-05-08T05:35:20.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:35:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6658.267825 secs 2023-05-08T05:35:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:35:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6659.548449 secs 2023-05-08T05:35:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:35:21 smithi186 ceph-mon[126480]: pgmap v3613: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 7 op/s 2023-05-08T05:35:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:35:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6659.548449 secs 2023-05-08T05:35:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:35:21 smithi133 ceph-mon[125939]: pgmap v3613: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 7 op/s 2023-05-08T05:35:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:35:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6659.548449 secs 2023-05-08T05:35:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:35:21 smithi096 ceph-mon[124666]: pgmap v3613: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 7 op/s 2023-05-08T05:35:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:35:23 smithi186 ceph-mon[126480]: pgmap v3614: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 66 KiB/s wr, 7 op/s 2023-05-08T05:35:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:35:23 smithi133 ceph-mon[125939]: pgmap v3614: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 66 KiB/s wr, 7 op/s 2023-05-08T05:35:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:35:23 smithi096 ceph-mon[124666]: pgmap v3614: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 66 KiB/s wr, 7 op/s 2023-05-08T05:35:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:35:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6662.710064 secs 2023-05-08T05:35:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:35:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6662.710064 secs 2023-05-08T05:35:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:35:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6662.710064 secs 2023-05-08T05:35:25.348 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:35:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6663.267950 secs 2023-05-08T05:35:25.348 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:35:25 smithi096 ceph-mon[124666]: pgmap v3615: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 66 KiB/s wr, 7 op/s 2023-05-08T05:35:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:35:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6663.267950 secs 2023-05-08T05:35:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:35:25 smithi186 ceph-mon[126480]: pgmap v3615: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 66 KiB/s wr, 7 op/s 2023-05-08T05:35:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:35:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6663.267950 secs 2023-05-08T05:35:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:35:25 smithi133 ceph-mon[125939]: pgmap v3615: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 66 KiB/s wr, 7 op/s 2023-05-08T05:35:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:35:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6664.548572 secs 2023-05-08T05:35:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:35:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6664.548572 secs 2023-05-08T05:35:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:35:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6664.548572 secs 2023-05-08T05:35:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:35:27 smithi186 ceph-mon[126480]: pgmap v3616: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 87 KiB/s wr, 7 op/s 2023-05-08T05:35:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:35:27 smithi133 ceph-mon[125939]: pgmap v3616: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 87 KiB/s wr, 7 op/s 2023-05-08T05:35:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:35:27 smithi096 ceph-mon[124666]: pgmap v3616: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 87 KiB/s wr, 7 op/s 2023-05-08T05:35:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:35:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6667.710195 secs 2023-05-08T05:35:29.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:35:29 smithi186 ceph-mon[126480]: pgmap v3617: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 85 KiB/s wr, 6 op/s 2023-05-08T05:35:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:35:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6667.710195 secs 2023-05-08T05:35:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:35:29 smithi133 ceph-mon[125939]: pgmap v3617: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 85 KiB/s wr, 6 op/s 2023-05-08T05:35:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:35:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6667.710195 secs 2023-05-08T05:35:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:35:29 smithi096 ceph-mon[124666]: pgmap v3617: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 85 KiB/s wr, 6 op/s 2023-05-08T05:35:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:35:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6668.268072 secs 2023-05-08T05:35:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:35:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6668.268072 secs 2023-05-08T05:35:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:35:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6668.268072 secs 2023-05-08T05:35:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:35:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6669.548688 secs 2023-05-08T05:35:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:35:31 smithi186 ceph-mon[126480]: pgmap v3618: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 86 KiB/s wr, 9 op/s 2023-05-08T05:35:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:35:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6669.548688 secs 2023-05-08T05:35:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:35:31 smithi133 ceph-mon[125939]: pgmap v3618: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 86 KiB/s wr, 9 op/s 2023-05-08T05:35:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:35:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6669.548688 secs 2023-05-08T05:35:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:35:31 smithi096 ceph-mon[124666]: pgmap v3618: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 86 KiB/s wr, 9 op/s 2023-05-08T05:35:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:35:33 smithi133 ceph-mon[125939]: pgmap v3619: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 114 KiB/s wr, 7 op/s 2023-05-08T05:35:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:35:33 smithi096 ceph-mon[124666]: pgmap v3619: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 114 KiB/s wr, 7 op/s 2023-05-08T05:35:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:35:33 smithi186 ceph-mon[126480]: pgmap v3619: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 114 KiB/s wr, 7 op/s 2023-05-08T05:35:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:35:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6672.710307 secs 2023-05-08T05:35:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:35:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6672.710307 secs 2023-05-08T05:35:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:35:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6672.710307 secs 2023-05-08T05:35:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:35:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6673.268223 secs 2023-05-08T05:35:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:35:35 smithi133 ceph-mon[125939]: pgmap v3620: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 59 KiB/s wr, 6 op/s 2023-05-08T05:35:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:35:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6673.268223 secs 2023-05-08T05:35:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:35:35 smithi096 ceph-mon[124666]: pgmap v3620: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 59 KiB/s wr, 6 op/s 2023-05-08T05:35:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:35:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6673.268223 secs 2023-05-08T05:35:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:35:35 smithi186 ceph-mon[126480]: pgmap v3620: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 59 KiB/s wr, 6 op/s 2023-05-08T05:35:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:35:37 smithi133 ceph-mon[125939]: pgmap v3621: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 161 KiB/s wr, 10 op/s 2023-05-08T05:35:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:35:37 smithi096 ceph-mon[124666]: pgmap v3621: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 161 KiB/s wr, 10 op/s 2023-05-08T05:35:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:35:37 smithi186 ceph-mon[126480]: pgmap v3621: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 161 KiB/s wr, 10 op/s 2023-05-08T05:35:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:35:38 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:35:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:35:38 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:35:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:35:38 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:35:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:35:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6677.710429 secs 2023-05-08T05:35:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:35:39 smithi133 ceph-mon[125939]: pgmap v3622: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 131 KiB/s wr, 6 op/s 2023-05-08T05:35:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:35:39 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:35:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:35:39 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:35:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:35:39 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:35:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:35:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6677.710429 secs 2023-05-08T05:35:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:35:39 smithi096 ceph-mon[124666]: pgmap v3622: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 131 KiB/s wr, 6 op/s 2023-05-08T05:35:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:35:39 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:35:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:35:39 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:35:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:35:39 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:35:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:35:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6677.710429 secs 2023-05-08T05:35:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:35:39 smithi186 ceph-mon[126480]: pgmap v3622: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 131 KiB/s wr, 6 op/s 2023-05-08T05:35:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:35:39 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:35:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:35:39 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:35:39.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:35:39 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:35:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:35:41 smithi133 ceph-mon[125939]: pgmap v3623: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 221 KiB/s wr, 10 op/s 2023-05-08T05:35:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:35:41 smithi096 ceph-mon[124666]: pgmap v3623: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 221 KiB/s wr, 10 op/s 2023-05-08T05:35:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:35:41 smithi186 ceph-mon[126480]: pgmap v3623: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 221 KiB/s wr, 10 op/s 2023-05-08T05:35:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:35:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:35:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:35:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:35:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:35:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:35:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:35:43 smithi133 ceph-mon[125939]: pgmap v3624: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 220 KiB/s wr, 8 op/s 2023-05-08T05:35:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:35:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:35:43.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:35:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:35:43.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:35:43 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:35:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:35:43 smithi096 ceph-mon[124666]: pgmap v3624: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 220 KiB/s wr, 8 op/s 2023-05-08T05:35:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:35:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:35:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:35:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:35:43.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:35:43 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:35:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:35:43 smithi186 ceph-mon[126480]: pgmap v3624: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 220 KiB/s wr, 8 op/s 2023-05-08T05:35:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:35:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:35:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:35:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:35:43.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:35:43 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:35:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:35:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6682.710556 secs 2023-05-08T05:35:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:35:44 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:35:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:35:44 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:35:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:35:44 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:35:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:35:44 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:35:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:35:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6682.710556 secs 2023-05-08T05:35:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:35:44 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:35:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:35:44 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:35:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:35:44 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:35:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:35:44 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:35:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:35:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6682.710556 secs 2023-05-08T05:35:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:35:44 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:35:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:35:44 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:35:44.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:35:44 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:35:44.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:35:44 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:35:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:35:45 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:35:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:35:45 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T05:35:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:35:45 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T05:35:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:35:45 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:35:45.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:35:45 smithi133 ceph-mon[125939]: pgmap v3625: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 192 KiB/s wr, 7 op/s 2023-05-08T05:35:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:35:45 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:35:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:35:45 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T05:35:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:35:45 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T05:35:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:35:45 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:35:45.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:35:45 smithi096 ceph-mon[124666]: pgmap v3625: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 192 KiB/s wr, 7 op/s 2023-05-08T05:35:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:35:45 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:35:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:35:45 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T05:35:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:35:45 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T05:35:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:35:45 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:35:45.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:35:45 smithi186 ceph-mon[126480]: pgmap v3625: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 192 KiB/s wr, 7 op/s 2023-05-08T05:35:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:35:47 smithi133 ceph-mon[125939]: pgmap v3626: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 340 KiB/s rd, 327 KiB/s wr, 12 op/s 2023-05-08T05:35:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:35:47 smithi096 ceph-mon[124666]: pgmap v3626: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 340 KiB/s rd, 327 KiB/s wr, 12 op/s 2023-05-08T05:35:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:35:47 smithi186 ceph-mon[126480]: pgmap v3626: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 340 KiB/s rd, 327 KiB/s wr, 12 op/s 2023-05-08T05:35:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:35:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6687.710678 secs 2023-05-08T05:35:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:35:49 smithi133 ceph-mon[125939]: pgmap v3627: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 225 KiB/s wr, 9 op/s 2023-05-08T05:35:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:35:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6687.710678 secs 2023-05-08T05:35:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:35:49 smithi096 ceph-mon[124666]: pgmap v3627: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 225 KiB/s wr, 9 op/s 2023-05-08T05:35:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:35:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6687.710678 secs 2023-05-08T05:35:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:35:49 smithi186 ceph-mon[126480]: pgmap v3627: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 225 KiB/s wr, 9 op/s 2023-05-08T05:35:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:35:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6688.268590 secs 2023-05-08T05:35:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:35:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6688.268590 secs 2023-05-08T05:35:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:35:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6688.268590 secs 2023-05-08T05:35:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:35:51 smithi133 ceph-mon[125939]: pgmap v3628: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 237 KiB/s wr, 13 op/s 2023-05-08T05:35:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:35:51 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:35:51.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:35:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:35:51.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:35:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:35:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:35:51 smithi096 ceph-mon[124666]: pgmap v3628: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 237 KiB/s wr, 13 op/s 2023-05-08T05:35:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:35:51 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:35:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:35:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:35:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:35:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:35:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:35:51 smithi186 ceph-mon[126480]: pgmap v3628: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 237 KiB/s wr, 13 op/s 2023-05-08T05:35:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:35:51 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:35:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:35:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:35:51.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:35:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:35:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:35:53 smithi133 ceph-mon[125939]: pgmap v3629: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 147 KiB/s wr, 9 op/s 2023-05-08T05:35:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:35:53 smithi096 ceph-mon[124666]: pgmap v3629: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 147 KiB/s wr, 9 op/s 2023-05-08T05:35:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:35:53 smithi186 ceph-mon[126480]: pgmap v3629: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 147 KiB/s wr, 9 op/s 2023-05-08T05:35:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:35:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6692.710795 secs 2023-05-08T05:35:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:35:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6692.710795 secs 2023-05-08T05:35:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:35:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6692.710795 secs 2023-05-08T05:35:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:35:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6693.268670 secs 2023-05-08T05:35:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:35:55 smithi133 ceph-mon[125939]: pgmap v3630: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 147 KiB/s wr, 9 op/s 2023-05-08T05:35:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:35:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6693.268670 secs 2023-05-08T05:35:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:35:55 smithi096 ceph-mon[124666]: pgmap v3630: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 147 KiB/s wr, 9 op/s 2023-05-08T05:35:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:35:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6693.268670 secs 2023-05-08T05:35:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:35:55 smithi186 ceph-mon[126480]: pgmap v3630: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 147 KiB/s wr, 9 op/s 2023-05-08T05:35:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:35:57 smithi133 ceph-mon[125939]: pgmap v3631: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 332 KiB/s wr, 13 op/s 2023-05-08T05:35:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:35:57 smithi096 ceph-mon[124666]: pgmap v3631: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 332 KiB/s wr, 13 op/s 2023-05-08T05:35:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:35:57 smithi186 ceph-mon[126480]: pgmap v3631: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 332 KiB/s wr, 13 op/s 2023-05-08T05:35:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:35:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6697.710913 secs 2023-05-08T05:35:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:35:59 smithi133 ceph-mon[125939]: pgmap v3632: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 198 KiB/s wr, 8 op/s 2023-05-08T05:35:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:35:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6697.710913 secs 2023-05-08T05:35:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:35:59 smithi096 ceph-mon[124666]: pgmap v3632: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 198 KiB/s wr, 8 op/s 2023-05-08T05:35:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:35:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6697.710913 secs 2023-05-08T05:35:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:35:59 smithi186 ceph-mon[126480]: pgmap v3632: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 198 KiB/s wr, 8 op/s 2023-05-08T05:36:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6698.268794 secs 2023-05-08T05:36:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6698.268794 secs 2023-05-08T05:36:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6698.268794 secs 2023-05-08T05:36:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6699.549399 secs 2023-05-08T05:36:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:01 smithi133 ceph-mon[125939]: pgmap v3633: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 210 KiB/s wr, 12 op/s 2023-05-08T05:36:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6699.549399 secs 2023-05-08T05:36:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:01 smithi096 ceph-mon[124666]: pgmap v3633: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 210 KiB/s wr, 12 op/s 2023-05-08T05:36:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6699.549399 secs 2023-05-08T05:36:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:01 smithi186 ceph-mon[126480]: pgmap v3633: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 210 KiB/s wr, 12 op/s 2023-05-08T05:36:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:02 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:36:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:36:02.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:36:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:02 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:36:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:36:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:36:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:02 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:36:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:36:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:36:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:03 smithi096 ceph-mon[124666]: pgmap v3634: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 198 KiB/s wr, 8 op/s 2023-05-08T05:36:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:03 smithi186 ceph-mon[126480]: pgmap v3634: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 198 KiB/s wr, 8 op/s 2023-05-08T05:36:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:03 smithi133 ceph-mon[125939]: pgmap v3634: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 198 KiB/s wr, 8 op/s 2023-05-08T05:36:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6702.711036 secs 2023-05-08T05:36:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6703.268918 secs 2023-05-08T05:36:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6702.711036 secs 2023-05-08T05:36:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6703.268918 secs 2023-05-08T05:36:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6702.711036 secs 2023-05-08T05:36:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6703.268918 secs 2023-05-08T05:36:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:05 smithi186 ceph-mon[126480]: pgmap v3635: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 198 KiB/s wr, 8 op/s 2023-05-08T05:36:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:05 smithi133 ceph-mon[125939]: pgmap v3635: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 198 KiB/s wr, 8 op/s 2023-05-08T05:36:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:05 smithi096 ceph-mon[124666]: pgmap v3635: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 198 KiB/s wr, 8 op/s 2023-05-08T05:36:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6704.549499 secs 2023-05-08T05:36:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:06 smithi186 ceph-mon[126480]: osdmap e306: 12 total, 12 up, 12 in 2023-05-08T05:36:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6704.549499 secs 2023-05-08T05:36:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:06 smithi133 ceph-mon[125939]: osdmap e306: 12 total, 12 up, 12 in 2023-05-08T05:36:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6704.549499 secs 2023-05-08T05:36:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:06 smithi096 ceph-mon[124666]: osdmap e306: 12 total, 12 up, 12 in 2023-05-08T05:36:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:07 smithi186 ceph-mon[126480]: pgmap v3637: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 171 KiB/s wr, 28 op/s 2023-05-08T05:36:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:07 smithi133 ceph-mon[125939]: pgmap v3637: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 171 KiB/s wr, 28 op/s 2023-05-08T05:36:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:07 smithi096 ceph-mon[124666]: pgmap v3637: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 171 KiB/s wr, 28 op/s 2023-05-08T05:36:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6707.711155 secs 2023-05-08T05:36:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:09 smithi186 ceph-mon[126480]: pgmap v3638: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 171 KiB/s wr, 28 op/s 2023-05-08T05:36:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6708.269037 secs 2023-05-08T05:36:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6707.711155 secs 2023-05-08T05:36:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:09 smithi133 ceph-mon[125939]: pgmap v3638: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 171 KiB/s wr, 28 op/s 2023-05-08T05:36:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6708.269037 secs 2023-05-08T05:36:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6707.711155 secs 2023-05-08T05:36:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:09 smithi096 ceph-mon[124666]: pgmap v3638: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 171 KiB/s wr, 28 op/s 2023-05-08T05:36:10.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6708.269037 secs 2023-05-08T05:36:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6709.549624 secs 2023-05-08T05:36:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:11 smithi186 ceph-mon[126480]: pgmap v3639: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 158 KiB/s wr, 27 op/s 2023-05-08T05:36:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6709.549624 secs 2023-05-08T05:36:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:11 smithi133 ceph-mon[125939]: pgmap v3639: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 158 KiB/s wr, 27 op/s 2023-05-08T05:36:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6709.549624 secs 2023-05-08T05:36:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:11 smithi096 ceph-mon[124666]: pgmap v3639: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 158 KiB/s wr, 27 op/s 2023-05-08T05:36:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:13 smithi186 ceph-mon[126480]: pgmap v3640: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 158 KiB/s wr, 27 op/s 2023-05-08T05:36:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:13 smithi133 ceph-mon[125939]: pgmap v3640: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 158 KiB/s wr, 27 op/s 2023-05-08T05:36:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:13 smithi096 ceph-mon[124666]: pgmap v3640: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 158 KiB/s wr, 27 op/s 2023-05-08T05:36:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6712.711292 secs 2023-05-08T05:36:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6713.269153 secs 2023-05-08T05:36:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:14 smithi186 ceph-mon[126480]: osdmap e307: 12 total, 12 up, 12 in 2023-05-08T05:36:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6712.711292 secs 2023-05-08T05:36:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6713.269153 secs 2023-05-08T05:36:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:14 smithi133 ceph-mon[125939]: osdmap e307: 12 total, 12 up, 12 in 2023-05-08T05:36:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6712.711292 secs 2023-05-08T05:36:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6713.269153 secs 2023-05-08T05:36:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:14 smithi096 ceph-mon[124666]: osdmap e307: 12 total, 12 up, 12 in 2023-05-08T05:36:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:15 smithi186 ceph-mon[126480]: pgmap v3641: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 158 KiB/s wr, 27 op/s 2023-05-08T05:36:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:15 smithi133 ceph-mon[125939]: pgmap v3641: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 158 KiB/s wr, 27 op/s 2023-05-08T05:36:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:15 smithi096 ceph-mon[124666]: pgmap v3641: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 158 KiB/s wr, 27 op/s 2023-05-08T05:36:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6714.549743 secs 2023-05-08T05:36:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6714.549743 secs 2023-05-08T05:36:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6714.549743 secs 2023-05-08T05:36:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:17 smithi186 ceph-mon[126480]: pgmap v3643: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 8 op/s 2023-05-08T05:36:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:17 smithi133 ceph-mon[125939]: pgmap v3643: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 8 op/s 2023-05-08T05:36:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:17 smithi096 ceph-mon[124666]: pgmap v3643: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 8 op/s 2023-05-08T05:36:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6717.711387 secs 2023-05-08T05:36:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:19 smithi186 ceph-mon[126480]: pgmap v3644: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 8 op/s 2023-05-08T05:36:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6718.269277 secs 2023-05-08T05:36:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6717.711387 secs 2023-05-08T05:36:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:19 smithi133 ceph-mon[125939]: pgmap v3644: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 8 op/s 2023-05-08T05:36:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6718.269277 secs 2023-05-08T05:36:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6717.711387 secs 2023-05-08T05:36:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:19 smithi096 ceph-mon[124666]: pgmap v3644: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 8 op/s 2023-05-08T05:36:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6718.269277 secs 2023-05-08T05:36:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6719.549863 secs 2023-05-08T05:36:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:21 smithi186 ceph-mon[126480]: pgmap v3645: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 73 KiB/s wr, 7 op/s 2023-05-08T05:36:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6719.549863 secs 2023-05-08T05:36:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:21 smithi133 ceph-mon[125939]: pgmap v3645: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 73 KiB/s wr, 7 op/s 2023-05-08T05:36:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6719.549863 secs 2023-05-08T05:36:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:21 smithi096 ceph-mon[124666]: pgmap v3645: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 73 KiB/s wr, 7 op/s 2023-05-08T05:36:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:23 smithi186 ceph-mon[126480]: pgmap v3646: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 73 KiB/s wr, 7 op/s 2023-05-08T05:36:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:23 smithi133 ceph-mon[125939]: pgmap v3646: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 73 KiB/s wr, 7 op/s 2023-05-08T05:36:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:23 smithi096 ceph-mon[124666]: pgmap v3646: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 73 KiB/s wr, 7 op/s 2023-05-08T05:36:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6722.711451 secs 2023-05-08T05:36:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6723.269419 secs 2023-05-08T05:36:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6722.711451 secs 2023-05-08T05:36:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6723.269419 secs 2023-05-08T05:36:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6722.711451 secs 2023-05-08T05:36:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6723.269419 secs 2023-05-08T05:36:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:25 smithi186 ceph-mon[126480]: pgmap v3647: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 73 KiB/s wr, 7 op/s 2023-05-08T05:36:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:25 smithi133 ceph-mon[125939]: pgmap v3647: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 73 KiB/s wr, 7 op/s 2023-05-08T05:36:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:25 smithi096 ceph-mon[124666]: pgmap v3647: 97 pgs: 97 active+clean; 6.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 73 KiB/s wr, 7 op/s 2023-05-08T05:36:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6724.549987 secs 2023-05-08T05:36:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6724.549987 secs 2023-05-08T05:36:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6724.549987 secs 2023-05-08T05:36:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:27 smithi186 ceph-mon[126480]: pgmap v3648: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 88 KiB/s wr, 6 op/s 2023-05-08T05:36:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:27 smithi133 ceph-mon[125939]: pgmap v3648: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 88 KiB/s wr, 6 op/s 2023-05-08T05:36:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:27 smithi096 ceph-mon[124666]: pgmap v3648: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 88 KiB/s wr, 6 op/s 2023-05-08T05:36:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6727.711567 secs 2023-05-08T05:36:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:29 smithi186 ceph-mon[126480]: pgmap v3649: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 86 KiB/s wr, 6 op/s 2023-05-08T05:36:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6728.269530 secs 2023-05-08T05:36:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6727.711567 secs 2023-05-08T05:36:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:29 smithi133 ceph-mon[125939]: pgmap v3649: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 86 KiB/s wr, 6 op/s 2023-05-08T05:36:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6728.269530 secs 2023-05-08T05:36:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6727.711567 secs 2023-05-08T05:36:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:29 smithi096 ceph-mon[124666]: pgmap v3649: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 86 KiB/s wr, 6 op/s 2023-05-08T05:36:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6728.269530 secs 2023-05-08T05:36:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6729.550103 secs 2023-05-08T05:36:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:31 smithi186 ceph-mon[126480]: pgmap v3650: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 87 KiB/s wr, 9 op/s 2023-05-08T05:36:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6729.550103 secs 2023-05-08T05:36:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:31 smithi133 ceph-mon[125939]: pgmap v3650: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 87 KiB/s wr, 9 op/s 2023-05-08T05:36:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6729.550103 secs 2023-05-08T05:36:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:31 smithi096 ceph-mon[124666]: pgmap v3650: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 87 KiB/s wr, 9 op/s 2023-05-08T05:36:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:33 smithi186 ceph-mon[126480]: pgmap v3651: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 50 KiB/s wr, 6 op/s 2023-05-08T05:36:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:33 smithi133 ceph-mon[125939]: pgmap v3651: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 50 KiB/s wr, 6 op/s 2023-05-08T05:36:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:33 smithi096 ceph-mon[124666]: pgmap v3651: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 50 KiB/s wr, 6 op/s 2023-05-08T05:36:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6732.711678 secs 2023-05-08T05:36:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6733.269670 secs 2023-05-08T05:36:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6732.711678 secs 2023-05-08T05:36:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6733.269670 secs 2023-05-08T05:36:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6732.711678 secs 2023-05-08T05:36:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6733.269670 secs 2023-05-08T05:36:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:35 smithi186 ceph-mon[126480]: pgmap v3652: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 50 KiB/s wr, 6 op/s 2023-05-08T05:36:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:35 smithi133 ceph-mon[125939]: pgmap v3652: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 50 KiB/s wr, 6 op/s 2023-05-08T05:36:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:35 smithi096 ceph-mon[124666]: pgmap v3652: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 50 KiB/s wr, 6 op/s 2023-05-08T05:36:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:37 smithi186 ceph-mon[126480]: pgmap v3653: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 201 KiB/s wr, 10 op/s 2023-05-08T05:36:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:37 smithi133 ceph-mon[125939]: pgmap v3653: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 201 KiB/s wr, 10 op/s 2023-05-08T05:36:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:37 smithi096 ceph-mon[124666]: pgmap v3653: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 201 KiB/s wr, 10 op/s 2023-05-08T05:36:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:38 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:36:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:38 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:36:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:38 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:36:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6737.711794 secs 2023-05-08T05:36:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:39 smithi186 ceph-mon[126480]: pgmap v3654: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 152 KiB/s wr, 6 op/s 2023-05-08T05:36:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:39 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:36:39.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:39 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:36:39.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:39 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:36:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6737.711794 secs 2023-05-08T05:36:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:39 smithi133 ceph-mon[125939]: pgmap v3654: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 152 KiB/s wr, 6 op/s 2023-05-08T05:36:39.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:39 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:36:39.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:39 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:36:39.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:39 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:36:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6737.711794 secs 2023-05-08T05:36:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:39 smithi096 ceph-mon[124666]: pgmap v3654: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 152 KiB/s wr, 6 op/s 2023-05-08T05:36:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:39 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:36:40.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:39 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:36:40.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:39 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:36:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:41 smithi186 ceph-mon[126480]: pgmap v3655: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 223 KiB/s wr, 10 op/s 2023-05-08T05:36:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:41 smithi133 ceph-mon[125939]: pgmap v3655: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 223 KiB/s wr, 10 op/s 2023-05-08T05:36:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:41 smithi096 ceph-mon[124666]: pgmap v3655: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 223 KiB/s wr, 10 op/s 2023-05-08T05:36:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:36:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:36:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:36:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:43 smithi186 ceph-mon[126480]: pgmap v3656: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 222 KiB/s wr, 7 op/s 2023-05-08T05:36:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:36:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:36:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:43 smithi133 ceph-mon[125939]: pgmap v3656: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 222 KiB/s wr, 7 op/s 2023-05-08T05:36:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:36:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:36:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:43 smithi096 ceph-mon[124666]: pgmap v3656: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 222 KiB/s wr, 7 op/s 2023-05-08T05:36:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:36:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:36:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6742.711970 secs 2023-05-08T05:36:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6743.269888 secs 2023-05-08T05:36:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:44 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:36:44.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:44 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:36:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6742.711970 secs 2023-05-08T05:36:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6743.269888 secs 2023-05-08T05:36:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:44 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:36:44.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:44 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:36:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6742.711970 secs 2023-05-08T05:36:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6743.269888 secs 2023-05-08T05:36:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:44 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:36:45.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:44 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:36:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:45 smithi186 ceph-mon[126480]: pgmap v3657: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 222 KiB/s wr, 7 op/s 2023-05-08T05:36:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:36:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:36:45.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:36:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:45 smithi133 ceph-mon[125939]: pgmap v3657: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 222 KiB/s wr, 7 op/s 2023-05-08T05:36:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:36:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:36:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:36:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:45 smithi096 ceph-mon[124666]: pgmap v3657: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 222 KiB/s wr, 7 op/s 2023-05-08T05:36:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:36:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:36:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:36:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:46 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:36:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:46 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T05:36:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:46 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T05:36:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:46 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:36:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:46 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:36:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:46 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T05:36:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:46 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T05:36:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:46 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:36:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:46 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:36:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:46 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T05:36:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:46 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T05:36:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:46 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:36:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:47 smithi186 ceph-mon[126480]: pgmap v3658: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 357 KiB/s wr, 12 op/s 2023-05-08T05:36:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:47 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:36:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:47 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:36:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:47 smithi133 ceph-mon[125939]: pgmap v3658: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 357 KiB/s wr, 12 op/s 2023-05-08T05:36:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:47 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:36:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:47 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:36:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:47 smithi096 ceph-mon[124666]: pgmap v3658: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 357 KiB/s wr, 12 op/s 2023-05-08T05:36:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:47 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:36:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:47 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:36:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:48 smithi133 ceph-mon[125939]: pgmap v3659: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 206 KiB/s wr, 9 op/s 2023-05-08T05:36:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:48 smithi096 ceph-mon[124666]: pgmap v3659: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 206 KiB/s wr, 9 op/s 2023-05-08T05:36:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:48 smithi186 ceph-mon[126480]: pgmap v3659: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 206 KiB/s wr, 9 op/s 2023-05-08T05:36:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6747.712090 secs 2023-05-08T05:36:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6748.269976 secs 2023-05-08T05:36:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:36:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6747.712090 secs 2023-05-08T05:36:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6748.269976 secs 2023-05-08T05:36:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:36:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6747.712090 secs 2023-05-08T05:36:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6748.269976 secs 2023-05-08T05:36:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:36:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:50 smithi133 ceph-mon[125939]: pgmap v3660: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 219 KiB/s wr, 13 op/s 2023-05-08T05:36:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:50 smithi096 ceph-mon[124666]: pgmap v3660: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 219 KiB/s wr, 13 op/s 2023-05-08T05:36:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:50 smithi186 ceph-mon[126480]: pgmap v3660: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 219 KiB/s wr, 13 op/s 2023-05-08T05:36:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:53 smithi186 ceph-mon[126480]: pgmap v3661: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 148 KiB/s wr, 8 op/s 2023-05-08T05:36:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:53 smithi133 ceph-mon[125939]: pgmap v3661: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 148 KiB/s wr, 8 op/s 2023-05-08T05:36:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:53 smithi096 ceph-mon[124666]: pgmap v3661: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 148 KiB/s wr, 8 op/s 2023-05-08T05:36:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6752.712223 secs 2023-05-08T05:36:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6752.712223 secs 2023-05-08T05:36:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6752.712223 secs 2023-05-08T05:36:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6753.270116 secs 2023-05-08T05:36:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:55 smithi186 ceph-mon[126480]: pgmap v3662: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 148 KiB/s wr, 8 op/s 2023-05-08T05:36:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6753.270116 secs 2023-05-08T05:36:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:55 smithi133 ceph-mon[125939]: pgmap v3662: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 148 KiB/s wr, 8 op/s 2023-05-08T05:36:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6753.270116 secs 2023-05-08T05:36:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:55 smithi096 ceph-mon[124666]: pgmap v3662: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 148 KiB/s wr, 8 op/s 2023-05-08T05:36:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:57 smithi186 ceph-mon[126480]: pgmap v3663: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 335 KiB/s wr, 13 op/s 2023-05-08T05:36:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:57 smithi133 ceph-mon[125939]: pgmap v3663: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 335 KiB/s wr, 13 op/s 2023-05-08T05:36:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:57 smithi096 ceph-mon[124666]: pgmap v3663: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 335 KiB/s wr, 13 op/s 2023-05-08T05:36:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6757.712354 secs 2023-05-08T05:36:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:36:59 smithi186 ceph-mon[126480]: pgmap v3664: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 200 KiB/s wr, 8 op/s 2023-05-08T05:36:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6757.712354 secs 2023-05-08T05:36:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:36:59 smithi133 ceph-mon[125939]: pgmap v3664: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 200 KiB/s wr, 8 op/s 2023-05-08T05:36:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6757.712354 secs 2023-05-08T05:36:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:36:59 smithi096 ceph-mon[124666]: pgmap v3664: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 200 KiB/s wr, 8 op/s 2023-05-08T05:37:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6758.270213 secs 2023-05-08T05:37:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6758.270213 secs 2023-05-08T05:37:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6758.270213 secs 2023-05-08T05:37:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6759.550741 secs 2023-05-08T05:37:01.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:01 smithi186 ceph-mon[126480]: pgmap v3665: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 223 KiB/s wr, 12 op/s 2023-05-08T05:37:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6759.550741 secs 2023-05-08T05:37:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:01 smithi133 ceph-mon[125939]: pgmap v3665: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 223 KiB/s wr, 12 op/s 2023-05-08T05:37:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6759.550741 secs 2023-05-08T05:37:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:01 smithi096 ceph-mon[124666]: pgmap v3665: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 223 KiB/s wr, 12 op/s 2023-05-08T05:37:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:02 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:37:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:37:02.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:37:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:02 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:37:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:37:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:37:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:02 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:37:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:37:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:37:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:03 smithi133 ceph-mon[125939]: pgmap v3666: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 210 KiB/s wr, 8 op/s 2023-05-08T05:37:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:03 smithi096 ceph-mon[124666]: pgmap v3666: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 210 KiB/s wr, 8 op/s 2023-05-08T05:37:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:03 smithi186 ceph-mon[126480]: pgmap v3666: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 210 KiB/s wr, 8 op/s 2023-05-08T05:37:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6762.712468 secs 2023-05-08T05:37:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6762.712468 secs 2023-05-08T05:37:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6762.712468 secs 2023-05-08T05:37:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6763.270358 secs 2023-05-08T05:37:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:05 smithi133 ceph-mon[125939]: pgmap v3667: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 210 KiB/s wr, 8 op/s 2023-05-08T05:37:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6763.270358 secs 2023-05-08T05:37:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:05 smithi096 ceph-mon[124666]: pgmap v3667: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 210 KiB/s wr, 8 op/s 2023-05-08T05:37:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6763.270358 secs 2023-05-08T05:37:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:05 smithi186 ceph-mon[126480]: pgmap v3667: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 210 KiB/s wr, 8 op/s 2023-05-08T05:37:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6764.550841 secs 2023-05-08T05:37:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:06 smithi133 ceph-mon[125939]: osdmap e308: 12 total, 12 up, 12 in 2023-05-08T05:37:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6764.550841 secs 2023-05-08T05:37:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:06 smithi096 ceph-mon[124666]: osdmap e308: 12 total, 12 up, 12 in 2023-05-08T05:37:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6764.550841 secs 2023-05-08T05:37:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:06 smithi186 ceph-mon[126480]: osdmap e308: 12 total, 12 up, 12 in 2023-05-08T05:37:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:07 smithi133 ceph-mon[125939]: pgmap v3669: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 184 KiB/s wr, 28 op/s 2023-05-08T05:37:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:07 smithi096 ceph-mon[124666]: pgmap v3669: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 184 KiB/s wr, 28 op/s 2023-05-08T05:37:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:07 smithi186 ceph-mon[126480]: pgmap v3669: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 184 KiB/s wr, 28 op/s 2023-05-08T05:37:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6767.712548 secs 2023-05-08T05:37:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:09 smithi133 ceph-mon[125939]: pgmap v3670: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 184 KiB/s wr, 28 op/s 2023-05-08T05:37:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6767.712548 secs 2023-05-08T05:37:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:09 smithi096 ceph-mon[124666]: pgmap v3670: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 184 KiB/s wr, 28 op/s 2023-05-08T05:37:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6767.712548 secs 2023-05-08T05:37:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:09 smithi186 ceph-mon[126480]: pgmap v3670: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 184 KiB/s wr, 28 op/s 2023-05-08T05:37:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6768.270496 secs 2023-05-08T05:37:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6768.270496 secs 2023-05-08T05:37:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6768.270496 secs 2023-05-08T05:37:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6769.550957 secs 2023-05-08T05:37:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:11 smithi133 ceph-mon[125939]: pgmap v3671: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 159 KiB/s wr, 27 op/s 2023-05-08T05:37:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6769.550957 secs 2023-05-08T05:37:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:11 smithi096 ceph-mon[124666]: pgmap v3671: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 159 KiB/s wr, 27 op/s 2023-05-08T05:37:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6769.550957 secs 2023-05-08T05:37:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:11 smithi186 ceph-mon[126480]: pgmap v3671: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 159 KiB/s wr, 27 op/s 2023-05-08T05:37:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:13 smithi133 ceph-mon[125939]: pgmap v3672: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 159 KiB/s wr, 27 op/s 2023-05-08T05:37:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:13 smithi096 ceph-mon[124666]: pgmap v3672: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 159 KiB/s wr, 27 op/s 2023-05-08T05:37:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:13 smithi186 ceph-mon[126480]: pgmap v3672: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 159 KiB/s wr, 27 op/s 2023-05-08T05:37:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6772.712662 secs 2023-05-08T05:37:14.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:14 smithi133 ceph-mon[125939]: osdmap e309: 12 total, 12 up, 12 in 2023-05-08T05:37:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6772.712662 secs 2023-05-08T05:37:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:14 smithi096 ceph-mon[124666]: osdmap e309: 12 total, 12 up, 12 in 2023-05-08T05:37:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6772.712662 secs 2023-05-08T05:37:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:14 smithi186 ceph-mon[126480]: osdmap e309: 12 total, 12 up, 12 in 2023-05-08T05:37:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6773.270564 secs 2023-05-08T05:37:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:15 smithi133 ceph-mon[125939]: pgmap v3673: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 159 KiB/s wr, 27 op/s 2023-05-08T05:37:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6773.270564 secs 2023-05-08T05:37:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:15 smithi096 ceph-mon[124666]: pgmap v3673: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 159 KiB/s wr, 27 op/s 2023-05-08T05:37:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6773.270564 secs 2023-05-08T05:37:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:15 smithi186 ceph-mon[126480]: pgmap v3673: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 159 KiB/s wr, 27 op/s 2023-05-08T05:37:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6774.551032 secs 2023-05-08T05:37:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6774.551032 secs 2023-05-08T05:37:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6774.551032 secs 2023-05-08T05:37:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:17 smithi133 ceph-mon[125939]: pgmap v3675: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 32 KiB/s wr, 8 op/s 2023-05-08T05:37:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:17 smithi096 ceph-mon[124666]: pgmap v3675: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 32 KiB/s wr, 8 op/s 2023-05-08T05:37:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:17 smithi186 ceph-mon[126480]: pgmap v3675: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 32 KiB/s wr, 8 op/s 2023-05-08T05:37:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6777.712802 secs 2023-05-08T05:37:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:19 smithi133 ceph-mon[125939]: pgmap v3676: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 32 KiB/s wr, 8 op/s 2023-05-08T05:37:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6777.712802 secs 2023-05-08T05:37:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:19 smithi096 ceph-mon[124666]: pgmap v3676: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 32 KiB/s wr, 8 op/s 2023-05-08T05:37:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6777.712802 secs 2023-05-08T05:37:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:19 smithi186 ceph-mon[126480]: pgmap v3676: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 32 KiB/s wr, 8 op/s 2023-05-08T05:37:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6778.270683 secs 2023-05-08T05:37:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6778.270683 secs 2023-05-08T05:37:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6778.270683 secs 2023-05-08T05:37:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6779.551150 secs 2023-05-08T05:37:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:21 smithi133 ceph-mon[125939]: pgmap v3677: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 74 KiB/s wr, 7 op/s 2023-05-08T05:37:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6779.551150 secs 2023-05-08T05:37:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:21 smithi096 ceph-mon[124666]: pgmap v3677: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 74 KiB/s wr, 7 op/s 2023-05-08T05:37:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6779.551150 secs 2023-05-08T05:37:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:21 smithi186 ceph-mon[126480]: pgmap v3677: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 74 KiB/s wr, 7 op/s 2023-05-08T05:37:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:23 smithi133 ceph-mon[125939]: pgmap v3678: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 74 KiB/s wr, 7 op/s 2023-05-08T05:37:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:23 smithi096 ceph-mon[124666]: pgmap v3678: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 74 KiB/s wr, 7 op/s 2023-05-08T05:37:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:23 smithi186 ceph-mon[126480]: pgmap v3678: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 74 KiB/s wr, 7 op/s 2023-05-08T05:37:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6782.712889 secs 2023-05-08T05:37:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6782.712889 secs 2023-05-08T05:37:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6782.712889 secs 2023-05-08T05:37:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6783.270767 secs 2023-05-08T05:37:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:25 smithi133 ceph-mon[125939]: pgmap v3679: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 74 KiB/s wr, 7 op/s 2023-05-08T05:37:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6783.270767 secs 2023-05-08T05:37:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:25 smithi096 ceph-mon[124666]: pgmap v3679: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 74 KiB/s wr, 7 op/s 2023-05-08T05:37:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6783.270767 secs 2023-05-08T05:37:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:25 smithi186 ceph-mon[126480]: pgmap v3679: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 74 KiB/s wr, 7 op/s 2023-05-08T05:37:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6784.551270 secs 2023-05-08T05:37:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6784.551270 secs 2023-05-08T05:37:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6784.551270 secs 2023-05-08T05:37:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:27 smithi133 ceph-mon[125939]: pgmap v3680: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 89 KiB/s wr, 7 op/s 2023-05-08T05:37:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:27 smithi096 ceph-mon[124666]: pgmap v3680: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 89 KiB/s wr, 7 op/s 2023-05-08T05:37:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:27 smithi186 ceph-mon[126480]: pgmap v3680: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 89 KiB/s wr, 7 op/s 2023-05-08T05:37:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6787.713030 secs 2023-05-08T05:37:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:29 smithi133 ceph-mon[125939]: pgmap v3681: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 87 KiB/s wr, 7 op/s 2023-05-08T05:37:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6788.270830 secs 2023-05-08T05:37:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6787.713030 secs 2023-05-08T05:37:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:29 smithi096 ceph-mon[124666]: pgmap v3681: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 87 KiB/s wr, 7 op/s 2023-05-08T05:37:29.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6788.270830 secs 2023-05-08T05:37:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6787.713030 secs 2023-05-08T05:37:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:29 smithi186 ceph-mon[126480]: pgmap v3681: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 87 KiB/s wr, 7 op/s 2023-05-08T05:37:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6788.270830 secs 2023-05-08T05:37:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6789.551379 secs 2023-05-08T05:37:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:31 smithi133 ceph-mon[125939]: pgmap v3682: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 87 KiB/s wr, 10 op/s 2023-05-08T05:37:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6789.551379 secs 2023-05-08T05:37:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:31 smithi096 ceph-mon[124666]: pgmap v3682: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 87 KiB/s wr, 10 op/s 2023-05-08T05:37:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6789.551379 secs 2023-05-08T05:37:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:31 smithi186 ceph-mon[126480]: pgmap v3682: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 87 KiB/s wr, 10 op/s 2023-05-08T05:37:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:33 smithi133 ceph-mon[125939]: pgmap v3683: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 50 KiB/s wr, 7 op/s 2023-05-08T05:37:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:33 smithi096 ceph-mon[124666]: pgmap v3683: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 50 KiB/s wr, 7 op/s 2023-05-08T05:37:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:33 smithi186 ceph-mon[126480]: pgmap v3683: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 50 KiB/s wr, 7 op/s 2023-05-08T05:37:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6792.713137 secs 2023-05-08T05:37:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6793.270972 secs 2023-05-08T05:37:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6792.713137 secs 2023-05-08T05:37:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6793.270972 secs 2023-05-08T05:37:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6792.713137 secs 2023-05-08T05:37:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6793.270972 secs 2023-05-08T05:37:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:35 smithi133 ceph-mon[125939]: pgmap v3684: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 50 KiB/s wr, 7 op/s 2023-05-08T05:37:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:35 smithi096 ceph-mon[124666]: pgmap v3684: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 50 KiB/s wr, 7 op/s 2023-05-08T05:37:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:35 smithi186 ceph-mon[126480]: pgmap v3684: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 50 KiB/s wr, 7 op/s 2023-05-08T05:37:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:37 smithi133 ceph-mon[125939]: pgmap v3685: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 203 KiB/s wr, 11 op/s 2023-05-08T05:37:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:37 smithi096 ceph-mon[124666]: pgmap v3685: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 203 KiB/s wr, 11 op/s 2023-05-08T05:37:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:37 smithi186 ceph-mon[126480]: pgmap v3685: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 203 KiB/s wr, 11 op/s 2023-05-08T05:37:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:38 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:37:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:38 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:37:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:38 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:37:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6797.713252 secs 2023-05-08T05:37:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:39 smithi096 ceph-mon[124666]: pgmap v3686: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 153 KiB/s wr, 7 op/s 2023-05-08T05:37:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:39 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:37:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:39 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:37:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:39 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:37:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6797.713252 secs 2023-05-08T05:37:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:39 smithi186 ceph-mon[126480]: pgmap v3686: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 153 KiB/s wr, 7 op/s 2023-05-08T05:37:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:39 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:37:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:39 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:37:39.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:39 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:37:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6797.713252 secs 2023-05-08T05:37:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:39 smithi133 ceph-mon[125939]: pgmap v3686: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 153 KiB/s wr, 7 op/s 2023-05-08T05:37:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:39 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:37:39.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:39 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:37:39.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:39 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:37:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:41 smithi096 ceph-mon[124666]: pgmap v3687: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 225 KiB/s wr, 11 op/s 2023-05-08T05:37:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:41 smithi186 ceph-mon[126480]: pgmap v3687: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 225 KiB/s wr, 11 op/s 2023-05-08T05:37:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:41 smithi133 ceph-mon[125939]: pgmap v3687: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 225 KiB/s wr, 11 op/s 2023-05-08T05:37:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:37:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:37:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:37:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:43 smithi186 ceph-mon[126480]: pgmap v3688: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 224 KiB/s wr, 7 op/s 2023-05-08T05:37:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:37:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:37:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:43 smithi133 ceph-mon[125939]: pgmap v3688: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 224 KiB/s wr, 7 op/s 2023-05-08T05:37:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:37:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:37:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:43 smithi096 ceph-mon[124666]: pgmap v3688: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 224 KiB/s wr, 7 op/s 2023-05-08T05:37:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:37:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:37:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6802.713345 secs 2023-05-08T05:37:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:44 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:37:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6802.713345 secs 2023-05-08T05:37:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:44 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:37:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6802.713345 secs 2023-05-08T05:37:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:44 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:37:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:45 smithi186 ceph-mon[126480]: pgmap v3689: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 224 KiB/s wr, 7 op/s 2023-05-08T05:37:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:37:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:37:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:37:45.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:37:45.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:37:45.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:37:45.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:37:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:45 smithi133 ceph-mon[125939]: pgmap v3689: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 224 KiB/s wr, 7 op/s 2023-05-08T05:37:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:37:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:37:45.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:37:45.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:37:45.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:37:45.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:37:45.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:37:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:45 smithi096 ceph-mon[124666]: pgmap v3689: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 224 KiB/s wr, 7 op/s 2023-05-08T05:37:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:37:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:37:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:37:46.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:37:46.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:37:46.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:37:46.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:37:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:46 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:37:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:46 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:37:46.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:46 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:37:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:46 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:37:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:46 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:37:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:46 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:37:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:46 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:37:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:46 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:37:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:46 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:37:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:47 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:37:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:47 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T05:37:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:47 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T05:37:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:47 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:37:47.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:47 smithi186 ceph-mon[126480]: pgmap v3690: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 409 KiB/s wr, 12 op/s 2023-05-08T05:37:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:47 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:37:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:47 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T05:37:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:47 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T05:37:47.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:47 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:37:47.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:47 smithi133 ceph-mon[125939]: pgmap v3690: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 409 KiB/s wr, 12 op/s 2023-05-08T05:37:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:47 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:37:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:47 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T05:37:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:47 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T05:37:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:47 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:37:48.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:47 smithi096 ceph-mon[124666]: pgmap v3690: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 409 KiB/s wr, 12 op/s 2023-05-08T05:37:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6807.713475 secs 2023-05-08T05:37:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:49 smithi186 ceph-mon[126480]: pgmap v3691: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 256 KiB/s wr, 9 op/s 2023-05-08T05:37:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6808.271366 secs 2023-05-08T05:37:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6807.713475 secs 2023-05-08T05:37:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:49 smithi133 ceph-mon[125939]: pgmap v3691: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 256 KiB/s wr, 9 op/s 2023-05-08T05:37:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6808.271366 secs 2023-05-08T05:37:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6807.713475 secs 2023-05-08T05:37:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:49 smithi096 ceph-mon[124666]: pgmap v3691: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 256 KiB/s wr, 9 op/s 2023-05-08T05:37:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6808.271366 secs 2023-05-08T05:37:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:37:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:37:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:37:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:37:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:37:50.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:37:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:37:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:37:51.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:37:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:51 smithi186 ceph-mon[126480]: pgmap v3692: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 359 KiB/s rd, 269 KiB/s wr, 13 op/s 2023-05-08T05:37:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:51 smithi133 ceph-mon[125939]: pgmap v3692: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 359 KiB/s rd, 269 KiB/s wr, 13 op/s 2023-05-08T05:37:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:51 smithi096 ceph-mon[124666]: pgmap v3692: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 359 KiB/s rd, 269 KiB/s wr, 13 op/s 2023-05-08T05:37:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:53 smithi186 ceph-mon[126480]: pgmap v3693: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 197 KiB/s wr, 9 op/s 2023-05-08T05:37:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:53 smithi133 ceph-mon[125939]: pgmap v3693: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 197 KiB/s wr, 9 op/s 2023-05-08T05:37:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:53 smithi096 ceph-mon[124666]: pgmap v3693: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 197 KiB/s wr, 9 op/s 2023-05-08T05:37:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6812.713596 secs 2023-05-08T05:37:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6813.271503 secs 2023-05-08T05:37:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6812.713596 secs 2023-05-08T05:37:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6813.271503 secs 2023-05-08T05:37:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6812.713596 secs 2023-05-08T05:37:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6813.271503 secs 2023-05-08T05:37:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:55 smithi186 ceph-mon[126480]: pgmap v3694: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 197 KiB/s wr, 9 op/s 2023-05-08T05:37:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:55 smithi133 ceph-mon[125939]: pgmap v3694: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 197 KiB/s wr, 9 op/s 2023-05-08T05:37:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:55 smithi096 ceph-mon[124666]: pgmap v3694: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 197 KiB/s wr, 9 op/s 2023-05-08T05:37:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:57 smithi186 ceph-mon[126480]: pgmap v3695: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 338 KiB/s wr, 14 op/s 2023-05-08T05:37:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:57 smithi133 ceph-mon[125939]: pgmap v3695: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 338 KiB/s wr, 14 op/s 2023-05-08T05:37:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:57 smithi096 ceph-mon[124666]: pgmap v3695: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 338 KiB/s wr, 14 op/s 2023-05-08T05:37:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6817.713680 secs 2023-05-08T05:37:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:59 smithi186 ceph-mon[126480]: pgmap v3696: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 154 KiB/s wr, 9 op/s 2023-05-08T05:37:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:37:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6818.271619 secs 2023-05-08T05:37:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6817.713680 secs 2023-05-08T05:37:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:59 smithi133 ceph-mon[125939]: pgmap v3696: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 154 KiB/s wr, 9 op/s 2023-05-08T05:37:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:37:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6818.271619 secs 2023-05-08T05:38:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6817.713680 secs 2023-05-08T05:38:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:59 smithi096 ceph-mon[124666]: pgmap v3696: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 154 KiB/s wr, 9 op/s 2023-05-08T05:38:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:37:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6818.271619 secs 2023-05-08T05:38:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6819.552113 secs 2023-05-08T05:38:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:01 smithi186 ceph-mon[126480]: pgmap v3697: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 167 KiB/s wr, 13 op/s 2023-05-08T05:38:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6819.552113 secs 2023-05-08T05:38:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:01 smithi133 ceph-mon[125939]: pgmap v3697: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 167 KiB/s wr, 13 op/s 2023-05-08T05:38:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6819.552113 secs 2023-05-08T05:38:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:01 smithi096 ceph-mon[124666]: pgmap v3697: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 167 KiB/s wr, 13 op/s 2023-05-08T05:38:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:02 smithi133 ceph-mon[125939]: pgmap v3698: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 154 KiB/s wr, 8 op/s 2023-05-08T05:38:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:02 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:38:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:38:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:38:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:02 smithi096 ceph-mon[124666]: pgmap v3698: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 154 KiB/s wr, 8 op/s 2023-05-08T05:38:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:02 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:38:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:38:03.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:38:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:02 smithi186 ceph-mon[126480]: pgmap v3698: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 154 KiB/s wr, 8 op/s 2023-05-08T05:38:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:02 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:38:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:38:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:38:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6822.713801 secs 2023-05-08T05:38:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6822.713801 secs 2023-05-08T05:38:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6822.713801 secs 2023-05-08T05:38:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6823.271743 secs 2023-05-08T05:38:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:05 smithi186 ceph-mon[126480]: pgmap v3699: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 154 KiB/s wr, 8 op/s 2023-05-08T05:38:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6823.271743 secs 2023-05-08T05:38:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:05 smithi133 ceph-mon[125939]: pgmap v3699: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 154 KiB/s wr, 8 op/s 2023-05-08T05:38:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6823.271743 secs 2023-05-08T05:38:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:05 smithi096 ceph-mon[124666]: pgmap v3699: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 154 KiB/s wr, 8 op/s 2023-05-08T05:38:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6824.552211 secs 2023-05-08T05:38:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:06 smithi186 ceph-mon[126480]: osdmap e310: 12 total, 12 up, 12 in 2023-05-08T05:38:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6824.552211 secs 2023-05-08T05:38:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:06 smithi133 ceph-mon[125939]: osdmap e310: 12 total, 12 up, 12 in 2023-05-08T05:38:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6824.552211 secs 2023-05-08T05:38:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:06 smithi096 ceph-mon[124666]: osdmap e310: 12 total, 12 up, 12 in 2023-05-08T05:38:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:07 smithi186 ceph-mon[126480]: pgmap v3701: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 173 KiB/s wr, 27 op/s 2023-05-08T05:38:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:07 smithi133 ceph-mon[125939]: pgmap v3701: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 173 KiB/s wr, 27 op/s 2023-05-08T05:38:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:07 smithi096 ceph-mon[124666]: pgmap v3701: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 173 KiB/s wr, 27 op/s 2023-05-08T05:38:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6827.713888 secs 2023-05-08T05:38:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:09 smithi186 ceph-mon[126480]: pgmap v3702: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 173 KiB/s wr, 27 op/s 2023-05-08T05:38:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6827.713888 secs 2023-05-08T05:38:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:09 smithi133 ceph-mon[125939]: pgmap v3702: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 173 KiB/s wr, 27 op/s 2023-05-08T05:38:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6827.713888 secs 2023-05-08T05:38:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:09 smithi096 ceph-mon[124666]: pgmap v3702: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 173 KiB/s wr, 27 op/s 2023-05-08T05:38:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6828.271863 secs 2023-05-08T05:38:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6828.271863 secs 2023-05-08T05:38:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6828.271863 secs 2023-05-08T05:38:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6829.552361 secs 2023-05-08T05:38:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:11 smithi186 ceph-mon[126480]: pgmap v3703: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 160 KiB/s wr, 26 op/s 2023-05-08T05:38:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6829.552361 secs 2023-05-08T05:38:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:11 smithi133 ceph-mon[125939]: pgmap v3703: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 160 KiB/s wr, 26 op/s 2023-05-08T05:38:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6829.552361 secs 2023-05-08T05:38:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:11 smithi096 ceph-mon[124666]: pgmap v3703: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 160 KiB/s wr, 26 op/s 2023-05-08T05:38:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:13 smithi186 ceph-mon[126480]: pgmap v3704: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 160 KiB/s wr, 26 op/s 2023-05-08T05:38:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:13 smithi133 ceph-mon[125939]: pgmap v3704: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 160 KiB/s wr, 26 op/s 2023-05-08T05:38:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:13 smithi096 ceph-mon[124666]: pgmap v3704: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 160 KiB/s wr, 26 op/s 2023-05-08T05:38:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6832.714025 secs 2023-05-08T05:38:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:14 smithi133 ceph-mon[125939]: osdmap e311: 12 total, 12 up, 12 in 2023-05-08T05:38:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6832.714025 secs 2023-05-08T05:38:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:14 smithi096 ceph-mon[124666]: osdmap e311: 12 total, 12 up, 12 in 2023-05-08T05:38:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6832.714025 secs 2023-05-08T05:38:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:14 smithi186 ceph-mon[126480]: osdmap e311: 12 total, 12 up, 12 in 2023-05-08T05:38:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6833.272022 secs 2023-05-08T05:38:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:15 smithi133 ceph-mon[125939]: pgmap v3705: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 160 KiB/s wr, 26 op/s 2023-05-08T05:38:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6833.272022 secs 2023-05-08T05:38:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:15 smithi096 ceph-mon[124666]: pgmap v3705: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 160 KiB/s wr, 26 op/s 2023-05-08T05:38:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6833.272022 secs 2023-05-08T05:38:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:15 smithi186 ceph-mon[126480]: pgmap v3705: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 160 KiB/s wr, 26 op/s 2023-05-08T05:38:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6834.552442 secs 2023-05-08T05:38:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6834.552442 secs 2023-05-08T05:38:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6834.552442 secs 2023-05-08T05:38:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:17 smithi133 ceph-mon[125939]: pgmap v3707: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 32 KiB/s wr, 9 op/s 2023-05-08T05:38:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:17 smithi096 ceph-mon[124666]: pgmap v3707: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 32 KiB/s wr, 9 op/s 2023-05-08T05:38:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:17 smithi186 ceph-mon[126480]: pgmap v3707: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 32 KiB/s wr, 9 op/s 2023-05-08T05:38:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6837.714172 secs 2023-05-08T05:38:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:19 smithi133 ceph-mon[125939]: pgmap v3708: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 32 KiB/s wr, 9 op/s 2023-05-08T05:38:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6837.714172 secs 2023-05-08T05:38:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:19 smithi096 ceph-mon[124666]: pgmap v3708: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 32 KiB/s wr, 9 op/s 2023-05-08T05:38:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6837.714172 secs 2023-05-08T05:38:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:19 smithi186 ceph-mon[126480]: pgmap v3708: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 32 KiB/s wr, 9 op/s 2023-05-08T05:38:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6838.272165 secs 2023-05-08T05:38:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6838.272165 secs 2023-05-08T05:38:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6838.272165 secs 2023-05-08T05:38:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6839.552556 secs 2023-05-08T05:38:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:21 smithi133 ceph-mon[125939]: pgmap v3709: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 132 KiB/s wr, 9 op/s 2023-05-08T05:38:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6839.552556 secs 2023-05-08T05:38:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:21 smithi096 ceph-mon[124666]: pgmap v3709: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 132 KiB/s wr, 9 op/s 2023-05-08T05:38:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6839.552556 secs 2023-05-08T05:38:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:21 smithi186 ceph-mon[126480]: pgmap v3709: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 132 KiB/s wr, 9 op/s 2023-05-08T05:38:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:23 smithi133 ceph-mon[125939]: pgmap v3710: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 132 KiB/s wr, 8 op/s 2023-05-08T05:38:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:23 smithi096 ceph-mon[124666]: pgmap v3710: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 132 KiB/s wr, 8 op/s 2023-05-08T05:38:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:23 smithi186 ceph-mon[126480]: pgmap v3710: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 132 KiB/s wr, 8 op/s 2023-05-08T05:38:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6842.714293 secs 2023-05-08T05:38:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6842.714293 secs 2023-05-08T05:38:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6842.714293 secs 2023-05-08T05:38:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6843.272299 secs 2023-05-08T05:38:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:25 smithi133 ceph-mon[125939]: pgmap v3711: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 132 KiB/s wr, 8 op/s 2023-05-08T05:38:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6843.272299 secs 2023-05-08T05:38:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:25 smithi096 ceph-mon[124666]: pgmap v3711: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 132 KiB/s wr, 8 op/s 2023-05-08T05:38:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6843.272299 secs 2023-05-08T05:38:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:25 smithi186 ceph-mon[126480]: pgmap v3711: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 132 KiB/s wr, 8 op/s 2023-05-08T05:38:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6844.552673 secs 2023-05-08T05:38:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6844.552673 secs 2023-05-08T05:38:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6844.552673 secs 2023-05-08T05:38:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:27 smithi133 ceph-mon[125939]: pgmap v3712: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 139 KiB/s wr, 8 op/s 2023-05-08T05:38:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:27 smithi096 ceph-mon[124666]: pgmap v3712: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 139 KiB/s wr, 8 op/s 2023-05-08T05:38:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:27 smithi186 ceph-mon[126480]: pgmap v3712: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 139 KiB/s wr, 8 op/s 2023-05-08T05:38:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6847.714415 secs 2023-05-08T05:38:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:29 smithi133 ceph-mon[125939]: pgmap v3713: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 136 KiB/s wr, 7 op/s 2023-05-08T05:38:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6847.714415 secs 2023-05-08T05:38:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:29 smithi096 ceph-mon[124666]: pgmap v3713: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 136 KiB/s wr, 7 op/s 2023-05-08T05:38:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6847.714415 secs 2023-05-08T05:38:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:29 smithi186 ceph-mon[126480]: pgmap v3713: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 136 KiB/s wr, 7 op/s 2023-05-08T05:38:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6848.272428 secs 2023-05-08T05:38:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6848.272428 secs 2023-05-08T05:38:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6848.272428 secs 2023-05-08T05:38:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6849.552800 secs 2023-05-08T05:38:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:31 smithi133 ceph-mon[125939]: pgmap v3714: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 136 KiB/s wr, 11 op/s 2023-05-08T05:38:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6849.552800 secs 2023-05-08T05:38:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:31 smithi096 ceph-mon[124666]: pgmap v3714: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 136 KiB/s wr, 11 op/s 2023-05-08T05:38:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6849.552800 secs 2023-05-08T05:38:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:31 smithi186 ceph-mon[126480]: pgmap v3714: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 136 KiB/s wr, 11 op/s 2023-05-08T05:38:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:33 smithi133 ceph-mon[125939]: pgmap v3715: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 51 KiB/s wr, 7 op/s 2023-05-08T05:38:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:33 smithi096 ceph-mon[124666]: pgmap v3715: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 51 KiB/s wr, 7 op/s 2023-05-08T05:38:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:33 smithi186 ceph-mon[126480]: pgmap v3715: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 51 KiB/s wr, 7 op/s 2023-05-08T05:38:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6852.714481 secs 2023-05-08T05:38:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6852.714481 secs 2023-05-08T05:38:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6852.714481 secs 2023-05-08T05:38:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6853.272544 secs 2023-05-08T05:38:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:35 smithi133 ceph-mon[125939]: pgmap v3716: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 51 KiB/s wr, 7 op/s 2023-05-08T05:38:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6853.272544 secs 2023-05-08T05:38:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:35 smithi096 ceph-mon[124666]: pgmap v3716: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 51 KiB/s wr, 7 op/s 2023-05-08T05:38:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6853.272544 secs 2023-05-08T05:38:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:35 smithi186 ceph-mon[126480]: pgmap v3716: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 51 KiB/s wr, 7 op/s 2023-05-08T05:38:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:37 smithi133 ceph-mon[125939]: pgmap v3717: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 157 KiB/s wr, 10 op/s 2023-05-08T05:38:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:37 smithi096 ceph-mon[124666]: pgmap v3717: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 157 KiB/s wr, 10 op/s 2023-05-08T05:38:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:37 smithi186 ceph-mon[126480]: pgmap v3717: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 157 KiB/s wr, 10 op/s 2023-05-08T05:38:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:38 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:38:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:38 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:38:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:38 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:38:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6857.714546 secs 2023-05-08T05:38:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:39 smithi133 ceph-mon[125939]: pgmap v3718: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 106 KiB/s wr, 6 op/s 2023-05-08T05:38:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:39 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:38:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:39 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:38:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:39 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:38:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6857.714546 secs 2023-05-08T05:38:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:39 smithi096 ceph-mon[124666]: pgmap v3718: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 106 KiB/s wr, 6 op/s 2023-05-08T05:38:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:39 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:38:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:39 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:38:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:39 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:38:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6857.714546 secs 2023-05-08T05:38:39.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:39 smithi186 ceph-mon[126480]: pgmap v3718: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 106 KiB/s wr, 6 op/s 2023-05-08T05:38:39.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:39 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:38:39.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:39 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:38:39.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:39 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:38:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:41 smithi133 ceph-mon[125939]: pgmap v3719: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 208 KiB/s wr, 10 op/s 2023-05-08T05:38:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:41 smithi096 ceph-mon[124666]: pgmap v3719: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 208 KiB/s wr, 10 op/s 2023-05-08T05:38:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:41 smithi186 ceph-mon[126480]: pgmap v3719: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 208 KiB/s wr, 10 op/s 2023-05-08T05:38:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:38:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:38:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:38:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:43 smithi133 ceph-mon[125939]: pgmap v3720: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 208 KiB/s wr, 7 op/s 2023-05-08T05:38:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:38:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:38:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:43 smithi096 ceph-mon[124666]: pgmap v3720: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 208 KiB/s wr, 7 op/s 2023-05-08T05:38:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:38:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:38:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:43 smithi186 ceph-mon[126480]: pgmap v3720: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 208 KiB/s wr, 7 op/s 2023-05-08T05:38:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:38:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:38:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6862.714604 secs 2023-05-08T05:38:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:44 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:38:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6862.714604 secs 2023-05-08T05:38:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:44 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:38:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6862.714604 secs 2023-05-08T05:38:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:44 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:38:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:45 smithi133 ceph-mon[125939]: pgmap v3721: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 208 KiB/s wr, 7 op/s 2023-05-08T05:38:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:45 smithi096 ceph-mon[124666]: pgmap v3721: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 208 KiB/s wr, 7 op/s 2023-05-08T05:38:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:45 smithi186 ceph-mon[126480]: pgmap v3721: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 208 KiB/s wr, 7 op/s 2023-05-08T05:38:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:46 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:38:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:46 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:38:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:46 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:38:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:47 smithi133 ceph-mon[125939]: pgmap v3722: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 527 KiB/s rd, 363 KiB/s wr, 12 op/s 2023-05-08T05:38:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:47 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:38:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:47 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:38:47.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:47 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:38:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:47 smithi096 ceph-mon[124666]: pgmap v3722: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 527 KiB/s rd, 363 KiB/s wr, 12 op/s 2023-05-08T05:38:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:47 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:38:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:47 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:38:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:47 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:38:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:47 smithi186 ceph-mon[126480]: pgmap v3722: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 527 KiB/s rd, 363 KiB/s wr, 12 op/s 2023-05-08T05:38:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:47 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:38:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:47 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:38:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:47 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:38:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:48 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:38:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:48 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T05:38:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:48 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T05:38:48.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:48 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:38:48.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6867.714700 secs 2023-05-08T05:38:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:48 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:38:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:48 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T05:38:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:48 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T05:38:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:48 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:38:48.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6867.714700 secs 2023-05-08T05:38:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:48 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:38:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:48 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T05:38:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:48 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T05:38:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:48 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:38:48.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6867.714700 secs 2023-05-08T05:38:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:49 smithi096 ceph-mon[124666]: pgmap v3723: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 496 KiB/s rd, 257 KiB/s wr, 9 op/s 2023-05-08T05:38:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6868.272900 secs 2023-05-08T05:38:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:49 smithi186 ceph-mon[126480]: pgmap v3723: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 496 KiB/s rd, 257 KiB/s wr, 9 op/s 2023-05-08T05:38:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6868.272900 secs 2023-05-08T05:38:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:49 smithi133 ceph-mon[125939]: pgmap v3723: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 496 KiB/s rd, 257 KiB/s wr, 9 op/s 2023-05-08T05:38:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6868.272900 secs 2023-05-08T05:38:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:38:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:38:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:38:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:38:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:38:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:38:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:38:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:38:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:38:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:51 smithi186 ceph-mon[126480]: pgmap v3724: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 510 KiB/s rd, 270 KiB/s wr, 13 op/s 2023-05-08T05:38:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:51 smithi133 ceph-mon[125939]: pgmap v3724: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 510 KiB/s rd, 270 KiB/s wr, 13 op/s 2023-05-08T05:38:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:51 smithi096 ceph-mon[124666]: pgmap v3724: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 510 KiB/s rd, 270 KiB/s wr, 13 op/s 2023-05-08T05:38:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:53 smithi186 ceph-mon[126480]: pgmap v3725: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 169 KiB/s wr, 9 op/s 2023-05-08T05:38:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6872.714812 secs 2023-05-08T05:38:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:53 smithi133 ceph-mon[125939]: pgmap v3725: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 169 KiB/s wr, 9 op/s 2023-05-08T05:38:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6872.714812 secs 2023-05-08T05:38:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:53 smithi096 ceph-mon[124666]: pgmap v3725: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 169 KiB/s wr, 9 op/s 2023-05-08T05:38:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6872.714812 secs 2023-05-08T05:38:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6873.272968 secs 2023-05-08T05:38:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:55 smithi186 ceph-mon[126480]: pgmap v3726: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 168 KiB/s wr, 9 op/s 2023-05-08T05:38:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6873.272968 secs 2023-05-08T05:38:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:55 smithi133 ceph-mon[125939]: pgmap v3726: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 168 KiB/s wr, 9 op/s 2023-05-08T05:38:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6873.272968 secs 2023-05-08T05:38:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:55 smithi096 ceph-mon[124666]: pgmap v3726: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 168 KiB/s wr, 9 op/s 2023-05-08T05:38:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:57 smithi186 ceph-mon[126480]: pgmap v3727: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 311 KiB/s wr, 13 op/s 2023-05-08T05:38:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:57 smithi133 ceph-mon[125939]: pgmap v3727: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 311 KiB/s wr, 13 op/s 2023-05-08T05:38:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:57 smithi096 ceph-mon[124666]: pgmap v3727: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 311 KiB/s wr, 13 op/s 2023-05-08T05:38:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6877.714974 secs 2023-05-08T05:38:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6877.714974 secs 2023-05-08T05:38:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6877.714974 secs 2023-05-08T05:38:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:38:59 smithi186 ceph-mon[126480]: pgmap v3728: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 155 KiB/s wr, 8 op/s 2023-05-08T05:38:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:38:59 smithi133 ceph-mon[125939]: pgmap v3728: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 155 KiB/s wr, 8 op/s 2023-05-08T05:38:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:38:59 smithi096 ceph-mon[124666]: pgmap v3728: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 155 KiB/s wr, 8 op/s 2023-05-08T05:39:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6878.273076 secs 2023-05-08T05:39:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6878.273076 secs 2023-05-08T05:39:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6878.273076 secs 2023-05-08T05:39:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6879.553424 secs 2023-05-08T05:39:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:01 smithi133 ceph-mon[125939]: pgmap v3729: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 196 KiB/s wr, 13 op/s 2023-05-08T05:39:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6879.553424 secs 2023-05-08T05:39:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:01 smithi096 ceph-mon[124666]: pgmap v3729: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 196 KiB/s wr, 13 op/s 2023-05-08T05:39:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6879.553424 secs 2023-05-08T05:39:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:01 smithi186 ceph-mon[126480]: pgmap v3729: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 196 KiB/s wr, 13 op/s 2023-05-08T05:39:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:02 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:39:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:39:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:39:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:02 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:39:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:39:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:39:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:02 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:39:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:39:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:39:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:03 smithi133 ceph-mon[125939]: pgmap v3730: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 183 KiB/s wr, 8 op/s 2023-05-08T05:39:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6882.715124 secs 2023-05-08T05:39:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:03 smithi096 ceph-mon[124666]: pgmap v3730: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 183 KiB/s wr, 8 op/s 2023-05-08T05:39:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6882.715124 secs 2023-05-08T05:39:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:03 smithi186 ceph-mon[126480]: pgmap v3730: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 183 KiB/s wr, 8 op/s 2023-05-08T05:39:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6882.715124 secs 2023-05-08T05:39:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6883.273218 secs 2023-05-08T05:39:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:05 smithi133 ceph-mon[125939]: pgmap v3731: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 183 KiB/s wr, 8 op/s 2023-05-08T05:39:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6883.273218 secs 2023-05-08T05:39:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:05 smithi096 ceph-mon[124666]: pgmap v3731: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 183 KiB/s wr, 8 op/s 2023-05-08T05:39:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6883.273218 secs 2023-05-08T05:39:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:05 smithi186 ceph-mon[126480]: pgmap v3731: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 183 KiB/s wr, 8 op/s 2023-05-08T05:39:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6884.553565 secs 2023-05-08T05:39:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:06 smithi133 ceph-mon[125939]: osdmap e312: 12 total, 12 up, 12 in 2023-05-08T05:39:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6884.553565 secs 2023-05-08T05:39:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:06 smithi096 ceph-mon[124666]: osdmap e312: 12 total, 12 up, 12 in 2023-05-08T05:39:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6884.553565 secs 2023-05-08T05:39:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:06 smithi186 ceph-mon[126480]: osdmap e312: 12 total, 12 up, 12 in 2023-05-08T05:39:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:07 smithi133 ceph-mon[125939]: pgmap v3733: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 267 KiB/s wr, 28 op/s 2023-05-08T05:39:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:07 smithi096 ceph-mon[124666]: pgmap v3733: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 267 KiB/s wr, 28 op/s 2023-05-08T05:39:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:07 smithi186 ceph-mon[126480]: pgmap v3733: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 267 KiB/s wr, 28 op/s 2023-05-08T05:39:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6887.715252 secs 2023-05-08T05:39:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6887.715252 secs 2023-05-08T05:39:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6887.715252 secs 2023-05-08T05:39:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:09 smithi133 ceph-mon[125939]: pgmap v3734: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 267 KiB/s wr, 28 op/s 2023-05-08T05:39:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:09 smithi096 ceph-mon[124666]: pgmap v3734: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 267 KiB/s wr, 28 op/s 2023-05-08T05:39:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:09 smithi186 ceph-mon[126480]: pgmap v3734: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 267 KiB/s wr, 28 op/s 2023-05-08T05:39:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6888.273367 secs 2023-05-08T05:39:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6888.273367 secs 2023-05-08T05:39:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6888.273367 secs 2023-05-08T05:39:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6889.553688 secs 2023-05-08T05:39:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:11 smithi133 ceph-mon[125939]: pgmap v3735: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 221 KiB/s wr, 27 op/s 2023-05-08T05:39:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6889.553688 secs 2023-05-08T05:39:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:11 smithi096 ceph-mon[124666]: pgmap v3735: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 221 KiB/s wr, 27 op/s 2023-05-08T05:39:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6889.553688 secs 2023-05-08T05:39:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:11 smithi186 ceph-mon[126480]: pgmap v3735: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 221 KiB/s wr, 27 op/s 2023-05-08T05:39:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:13 smithi133 ceph-mon[125939]: pgmap v3736: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 221 KiB/s wr, 27 op/s 2023-05-08T05:39:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6892.715305 secs 2023-05-08T05:39:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:13 smithi096 ceph-mon[124666]: pgmap v3736: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 221 KiB/s wr, 27 op/s 2023-05-08T05:39:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6892.715305 secs 2023-05-08T05:39:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:13 smithi186 ceph-mon[126480]: pgmap v3736: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 221 KiB/s wr, 27 op/s 2023-05-08T05:39:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6892.715305 secs 2023-05-08T05:39:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6893.273508 secs 2023-05-08T05:39:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:15 smithi186 ceph-mon[126480]: pgmap v3737: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 221 KiB/s wr, 27 op/s 2023-05-08T05:39:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:15 smithi186 ceph-mon[126480]: osdmap e313: 12 total, 12 up, 12 in 2023-05-08T05:39:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6893.273508 secs 2023-05-08T05:39:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:15 smithi133 ceph-mon[125939]: pgmap v3737: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 221 KiB/s wr, 27 op/s 2023-05-08T05:39:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:15 smithi133 ceph-mon[125939]: osdmap e313: 12 total, 12 up, 12 in 2023-05-08T05:39:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6893.273508 secs 2023-05-08T05:39:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:15 smithi096 ceph-mon[124666]: pgmap v3737: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 221 KiB/s wr, 27 op/s 2023-05-08T05:39:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:15 smithi096 ceph-mon[124666]: osdmap e313: 12 total, 12 up, 12 in 2023-05-08T05:39:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6894.553846 secs 2023-05-08T05:39:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6894.553846 secs 2023-05-08T05:39:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6894.553846 secs 2023-05-08T05:39:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:17 smithi186 ceph-mon[126480]: pgmap v3739: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 32 KiB/s wr, 8 op/s 2023-05-08T05:39:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:17 smithi133 ceph-mon[125939]: pgmap v3739: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 32 KiB/s wr, 8 op/s 2023-05-08T05:39:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:17 smithi096 ceph-mon[124666]: pgmap v3739: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 32 KiB/s wr, 8 op/s 2023-05-08T05:39:18.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6897.715426 secs 2023-05-08T05:39:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6897.715426 secs 2023-05-08T05:39:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6897.715426 secs 2023-05-08T05:39:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:19 smithi133 ceph-mon[125939]: pgmap v3740: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 32 KiB/s wr, 8 op/s 2023-05-08T05:39:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:19 smithi096 ceph-mon[124666]: pgmap v3740: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 32 KiB/s wr, 8 op/s 2023-05-08T05:39:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:19 smithi186 ceph-mon[126480]: pgmap v3740: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 32 KiB/s wr, 8 op/s 2023-05-08T05:39:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6898.273623 secs 2023-05-08T05:39:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6898.273623 secs 2023-05-08T05:39:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6898.273623 secs 2023-05-08T05:39:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6899.553928 secs 2023-05-08T05:39:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:21 smithi133 ceph-mon[125939]: pgmap v3741: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 75 KiB/s wr, 7 op/s 2023-05-08T05:39:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6899.553928 secs 2023-05-08T05:39:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:21 smithi096 ceph-mon[124666]: pgmap v3741: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 75 KiB/s wr, 7 op/s 2023-05-08T05:39:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6899.553928 secs 2023-05-08T05:39:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:21 smithi186 ceph-mon[126480]: pgmap v3741: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 75 KiB/s wr, 7 op/s 2023-05-08T05:39:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:23 smithi133 ceph-mon[125939]: pgmap v3742: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 75 KiB/s wr, 7 op/s 2023-05-08T05:39:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6902.715543 secs 2023-05-08T05:39:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:23 smithi096 ceph-mon[124666]: pgmap v3742: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 75 KiB/s wr, 7 op/s 2023-05-08T05:39:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6902.715543 secs 2023-05-08T05:39:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:23 smithi186 ceph-mon[126480]: pgmap v3742: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 75 KiB/s wr, 7 op/s 2023-05-08T05:39:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6902.715543 secs 2023-05-08T05:39:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6903.273701 secs 2023-05-08T05:39:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:25 smithi133 ceph-mon[125939]: pgmap v3743: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 75 KiB/s wr, 7 op/s 2023-05-08T05:39:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6903.273701 secs 2023-05-08T05:39:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:25 smithi096 ceph-mon[124666]: pgmap v3743: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 75 KiB/s wr, 7 op/s 2023-05-08T05:39:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6903.273701 secs 2023-05-08T05:39:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:25 smithi186 ceph-mon[126480]: pgmap v3743: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 75 KiB/s wr, 7 op/s 2023-05-08T05:39:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6904.553990 secs 2023-05-08T05:39:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6904.553990 secs 2023-05-08T05:39:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6904.553990 secs 2023-05-08T05:39:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:27 smithi133 ceph-mon[125939]: pgmap v3744: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 91 KiB/s wr, 7 op/s 2023-05-08T05:39:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:27 smithi096 ceph-mon[124666]: pgmap v3744: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 91 KiB/s wr, 7 op/s 2023-05-08T05:39:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:27 smithi186 ceph-mon[126480]: pgmap v3744: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 91 KiB/s wr, 7 op/s 2023-05-08T05:39:28.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6907.715655 secs 2023-05-08T05:39:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6907.715655 secs 2023-05-08T05:39:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6907.715655 secs 2023-05-08T05:39:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:29 smithi133 ceph-mon[125939]: pgmap v3745: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 89 KiB/s wr, 6 op/s 2023-05-08T05:39:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:29 smithi096 ceph-mon[124666]: pgmap v3745: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 89 KiB/s wr, 6 op/s 2023-05-08T05:39:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:29 smithi186 ceph-mon[126480]: pgmap v3745: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 89 KiB/s wr, 6 op/s 2023-05-08T05:39:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6908.273815 secs 2023-05-08T05:39:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6908.273815 secs 2023-05-08T05:39:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6908.273815 secs 2023-05-08T05:39:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6909.554114 secs 2023-05-08T05:39:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:31 smithi133 ceph-mon[125939]: pgmap v3746: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 89 KiB/s wr, 9 op/s 2023-05-08T05:39:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6909.554114 secs 2023-05-08T05:39:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:31 smithi096 ceph-mon[124666]: pgmap v3746: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 89 KiB/s wr, 9 op/s 2023-05-08T05:39:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6909.554114 secs 2023-05-08T05:39:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:31 smithi186 ceph-mon[126480]: pgmap v3746: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 89 KiB/s wr, 9 op/s 2023-05-08T05:39:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:33 smithi133 ceph-mon[125939]: pgmap v3747: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 51 KiB/s wr, 6 op/s 2023-05-08T05:39:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6912.715767 secs 2023-05-08T05:39:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:33 smithi096 ceph-mon[124666]: pgmap v3747: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 51 KiB/s wr, 6 op/s 2023-05-08T05:39:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6912.715767 secs 2023-05-08T05:39:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:33 smithi186 ceph-mon[126480]: pgmap v3747: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 51 KiB/s wr, 6 op/s 2023-05-08T05:39:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6912.715767 secs 2023-05-08T05:39:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6913.273933 secs 2023-05-08T05:39:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:35 smithi133 ceph-mon[125939]: pgmap v3748: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 7 op/s 2023-05-08T05:39:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6913.273933 secs 2023-05-08T05:39:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:35 smithi096 ceph-mon[124666]: pgmap v3748: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 7 op/s 2023-05-08T05:39:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6913.273933 secs 2023-05-08T05:39:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:35 smithi186 ceph-mon[126480]: pgmap v3748: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 7 op/s 2023-05-08T05:39:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6914.554237 secs 2023-05-08T05:39:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6914.554237 secs 2023-05-08T05:39:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6914.554237 secs 2023-05-08T05:39:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:37 smithi133 ceph-mon[125939]: pgmap v3749: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 158 KiB/s wr, 10 op/s 2023-05-08T05:39:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:37 smithi096 ceph-mon[124666]: pgmap v3749: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 158 KiB/s wr, 10 op/s 2023-05-08T05:39:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:37 smithi186 ceph-mon[126480]: pgmap v3749: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 158 KiB/s wr, 10 op/s 2023-05-08T05:39:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6917.715898 secs 2023-05-08T05:39:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6917.715898 secs 2023-05-08T05:39:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6917.715898 secs 2023-05-08T05:39:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:39 smithi133 ceph-mon[125939]: pgmap v3750: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 107 KiB/s wr, 6 op/s 2023-05-08T05:39:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:39 smithi096 ceph-mon[124666]: pgmap v3750: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 107 KiB/s wr, 6 op/s 2023-05-08T05:39:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:39 smithi186 ceph-mon[126480]: pgmap v3750: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 107 KiB/s wr, 6 op/s 2023-05-08T05:39:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6919.554356 secs 2023-05-08T05:39:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:41 smithi133 ceph-mon[125939]: pgmap v3751: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 228 KiB/s wr, 10 op/s 2023-05-08T05:39:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6919.554356 secs 2023-05-08T05:39:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:41 smithi096 ceph-mon[124666]: pgmap v3751: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 228 KiB/s wr, 10 op/s 2023-05-08T05:39:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6919.554356 secs 2023-05-08T05:39:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:41 smithi186 ceph-mon[126480]: pgmap v3751: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 228 KiB/s wr, 10 op/s 2023-05-08T05:39:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:39:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:39:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:39:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:43 smithi133 ceph-mon[125939]: pgmap v3752: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 228 KiB/s wr, 7 op/s 2023-05-08T05:39:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:43 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:39:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:39:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:39:43.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6922.715990 secs 2023-05-08T05:39:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:43 smithi096 ceph-mon[124666]: pgmap v3752: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 228 KiB/s wr, 7 op/s 2023-05-08T05:39:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:43 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:39:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:39:43.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:39:43.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6922.715990 secs 2023-05-08T05:39:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:43 smithi186 ceph-mon[126480]: pgmap v3752: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 228 KiB/s wr, 7 op/s 2023-05-08T05:39:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:43 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:39:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:39:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:39:43.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6922.715990 secs 2023-05-08T05:39:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6923.274139 secs 2023-05-08T05:39:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:45 smithi133 ceph-mon[125939]: pgmap v3753: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 228 KiB/s wr, 8 op/s 2023-05-08T05:39:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6923.274139 secs 2023-05-08T05:39:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:45 smithi096 ceph-mon[124666]: pgmap v3753: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 228 KiB/s wr, 8 op/s 2023-05-08T05:39:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6923.274139 secs 2023-05-08T05:39:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:45 smithi186 ceph-mon[126480]: pgmap v3753: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 228 KiB/s wr, 8 op/s 2023-05-08T05:39:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:46 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:39:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:46 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:39:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:46 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:39:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:47 smithi133 ceph-mon[125939]: pgmap v3754: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 381 KiB/s rd, 367 KiB/s wr, 12 op/s 2023-05-08T05:39:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:47 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:39:47.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:47 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:39:47.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:47 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:39:47.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:47 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:39:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:47 smithi096 ceph-mon[124666]: pgmap v3754: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 381 KiB/s rd, 367 KiB/s wr, 12 op/s 2023-05-08T05:39:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:47 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:39:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:47 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:39:47.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:47 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:39:47.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:47 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:39:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:47 smithi186 ceph-mon[126480]: pgmap v3754: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 381 KiB/s rd, 367 KiB/s wr, 12 op/s 2023-05-08T05:39:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:47 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:39:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:47 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:39:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:47 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:39:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:47 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:39:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:48 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:39:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:48 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:39:48.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:48 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:39:48.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:48 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:39:48.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:48 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T05:39:48.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:48 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T05:39:48.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:48 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:39:48.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6927.716082 secs 2023-05-08T05:39:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:48 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:39:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:48 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:39:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:48 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:39:48.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:48 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:39:48.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:48 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T05:39:48.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:48 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T05:39:48.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:48 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:39:48.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6927.716082 secs 2023-05-08T05:39:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:48 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:39:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:48 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:39:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:48 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:39:48.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:48 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:39:48.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:48 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T05:39:48.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:48 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T05:39:48.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:48 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:39:48.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6927.716082 secs 2023-05-08T05:39:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:49 smithi133 ceph-mon[125939]: pgmap v3755: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 261 KiB/s wr, 9 op/s 2023-05-08T05:39:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:49 smithi096 ceph-mon[124666]: pgmap v3755: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 261 KiB/s wr, 9 op/s 2023-05-08T05:39:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:49 smithi186 ceph-mon[126480]: pgmap v3755: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 261 KiB/s wr, 9 op/s 2023-05-08T05:39:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6928.274263 secs 2023-05-08T05:39:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6928.274263 secs 2023-05-08T05:39:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6928.274263 secs 2023-05-08T05:39:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:51 smithi133 ceph-mon[125939]: pgmap v3756: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 274 KiB/s wr, 13 op/s 2023-05-08T05:39:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:51 smithi096 ceph-mon[124666]: pgmap v3756: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 274 KiB/s wr, 13 op/s 2023-05-08T05:39:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:51 smithi186 ceph-mon[126480]: pgmap v3756: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 274 KiB/s wr, 13 op/s 2023-05-08T05:39:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:53 smithi133 ceph-mon[125939]: pgmap v3757: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 152 KiB/s wr, 8 op/s 2023-05-08T05:39:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6932.716205 secs 2023-05-08T05:39:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:53 smithi096 ceph-mon[124666]: pgmap v3757: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 152 KiB/s wr, 8 op/s 2023-05-08T05:39:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6932.716205 secs 2023-05-08T05:39:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:53 smithi186 ceph-mon[126480]: pgmap v3757: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 152 KiB/s wr, 8 op/s 2023-05-08T05:39:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6932.716205 secs 2023-05-08T05:39:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6933.274414 secs 2023-05-08T05:39:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:55 smithi186 ceph-mon[126480]: pgmap v3758: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 153 KiB/s wr, 10 op/s 2023-05-08T05:39:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6933.274414 secs 2023-05-08T05:39:55.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:55 smithi133 ceph-mon[125939]: pgmap v3758: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 153 KiB/s wr, 10 op/s 2023-05-08T05:39:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6933.274414 secs 2023-05-08T05:39:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:55 smithi096 ceph-mon[124666]: pgmap v3758: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 153 KiB/s wr, 10 op/s 2023-05-08T05:39:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:57 smithi186 ceph-mon[126480]: pgmap v3759: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 344 KiB/s wr, 12 op/s 2023-05-08T05:39:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:57 smithi133 ceph-mon[125939]: pgmap v3759: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 344 KiB/s wr, 12 op/s 2023-05-08T05:39:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:57 smithi096 ceph-mon[124666]: pgmap v3759: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 344 KiB/s wr, 12 op/s 2023-05-08T05:39:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6937.716340 secs 2023-05-08T05:39:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6937.716340 secs 2023-05-08T05:39:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6937.716340 secs 2023-05-08T05:39:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:39:59 smithi133 ceph-mon[125939]: pgmap v3760: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 205 KiB/s wr, 8 op/s 2023-05-08T05:39:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:39:59 smithi096 ceph-mon[124666]: pgmap v3760: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 205 KiB/s wr, 8 op/s 2023-05-08T05:39:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:39:59 smithi186 ceph-mon[126480]: pgmap v3760: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 205 KiB/s wr, 8 op/s 2023-05-08T05:40:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6938.274534 secs 2023-05-08T05:40:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:00 smithi133 ceph-mon[125939]: overall HEALTH_WARN 2 MDSs report slow requests 2023-05-08T05:40:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6938.274534 secs 2023-05-08T05:40:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:00 smithi096 ceph-mon[124666]: overall HEALTH_WARN 2 MDSs report slow requests 2023-05-08T05:40:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6938.274534 secs 2023-05-08T05:40:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:00 smithi186 ceph-mon[126480]: overall HEALTH_WARN 2 MDSs report slow requests 2023-05-08T05:40:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6939.554821 secs 2023-05-08T05:40:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:01 smithi133 ceph-mon[125939]: pgmap v3761: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 218 KiB/s wr, 13 op/s 2023-05-08T05:40:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6939.554821 secs 2023-05-08T05:40:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:01 smithi096 ceph-mon[124666]: pgmap v3761: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 218 KiB/s wr, 13 op/s 2023-05-08T05:40:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6939.554821 secs 2023-05-08T05:40:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:01 smithi186 ceph-mon[126480]: pgmap v3761: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 218 KiB/s wr, 13 op/s 2023-05-08T05:40:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:02 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:40:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:40:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:40:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:02 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:40:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:40:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:40:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:02 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:40:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:40:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:40:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:03 smithi133 ceph-mon[125939]: pgmap v3762: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 205 KiB/s wr, 9 op/s 2023-05-08T05:40:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6942.716464 secs 2023-05-08T05:40:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:03 smithi096 ceph-mon[124666]: pgmap v3762: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 205 KiB/s wr, 9 op/s 2023-05-08T05:40:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6942.716464 secs 2023-05-08T05:40:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:03 smithi186 ceph-mon[126480]: pgmap v3762: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 205 KiB/s wr, 9 op/s 2023-05-08T05:40:03.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6942.716464 secs 2023-05-08T05:40:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6943.274617 secs 2023-05-08T05:40:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:05 smithi133 ceph-mon[125939]: pgmap v3763: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 227 KiB/s wr, 22 op/s 2023-05-08T05:40:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6943.274617 secs 2023-05-08T05:40:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:05 smithi096 ceph-mon[124666]: pgmap v3763: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 227 KiB/s wr, 22 op/s 2023-05-08T05:40:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6943.274617 secs 2023-05-08T05:40:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:05 smithi186 ceph-mon[126480]: pgmap v3763: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 227 KiB/s wr, 22 op/s 2023-05-08T05:40:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6944.554923 secs 2023-05-08T05:40:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:06 smithi133 ceph-mon[125939]: osdmap e314: 12 total, 12 up, 12 in 2023-05-08T05:40:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6944.554923 secs 2023-05-08T05:40:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:06 smithi096 ceph-mon[124666]: osdmap e314: 12 total, 12 up, 12 in 2023-05-08T05:40:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6944.554923 secs 2023-05-08T05:40:06.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:06 smithi186 ceph-mon[126480]: osdmap e314: 12 total, 12 up, 12 in 2023-05-08T05:40:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:07 smithi133 ceph-mon[125939]: pgmap v3765: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 175 KiB/s wr, 28 op/s 2023-05-08T05:40:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:07 smithi096 ceph-mon[124666]: pgmap v3765: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 175 KiB/s wr, 28 op/s 2023-05-08T05:40:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:07 smithi186 ceph-mon[126480]: pgmap v3765: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 175 KiB/s wr, 28 op/s 2023-05-08T05:40:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6947.716587 secs 2023-05-08T05:40:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6947.716587 secs 2023-05-08T05:40:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6947.716587 secs 2023-05-08T05:40:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:09 smithi133 ceph-mon[125939]: pgmap v3766: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 175 KiB/s wr, 28 op/s 2023-05-08T05:40:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:09 smithi096 ceph-mon[124666]: pgmap v3766: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 175 KiB/s wr, 28 op/s 2023-05-08T05:40:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:09 smithi186 ceph-mon[126480]: pgmap v3766: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 175 KiB/s wr, 28 op/s 2023-05-08T05:40:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6948.274656 secs 2023-05-08T05:40:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6948.274656 secs 2023-05-08T05:40:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6948.274656 secs 2023-05-08T05:40:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6949.555040 secs 2023-05-08T05:40:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:11 smithi133 ceph-mon[125939]: pgmap v3767: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 162 KiB/s wr, 27 op/s 2023-05-08T05:40:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6949.555040 secs 2023-05-08T05:40:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:11 smithi096 ceph-mon[124666]: pgmap v3767: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 162 KiB/s wr, 27 op/s 2023-05-08T05:40:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6949.555040 secs 2023-05-08T05:40:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:11 smithi186 ceph-mon[126480]: pgmap v3767: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 162 KiB/s wr, 27 op/s 2023-05-08T05:40:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:13 smithi133 ceph-mon[125939]: pgmap v3768: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 162 KiB/s wr, 27 op/s 2023-05-08T05:40:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6952.716730 secs 2023-05-08T05:40:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:13 smithi096 ceph-mon[124666]: pgmap v3768: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 162 KiB/s wr, 27 op/s 2023-05-08T05:40:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6952.716730 secs 2023-05-08T05:40:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:13 smithi186 ceph-mon[126480]: pgmap v3768: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 162 KiB/s wr, 27 op/s 2023-05-08T05:40:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6952.716730 secs 2023-05-08T05:40:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6953.274775 secs 2023-05-08T05:40:15.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:15 smithi133 ceph-mon[125939]: pgmap v3769: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 137 KiB/s wr, 12 op/s 2023-05-08T05:40:15.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:15 smithi133 ceph-mon[125939]: osdmap e315: 12 total, 12 up, 12 in 2023-05-08T05:40:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6953.274775 secs 2023-05-08T05:40:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:15 smithi096 ceph-mon[124666]: pgmap v3769: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 137 KiB/s wr, 12 op/s 2023-05-08T05:40:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:15 smithi096 ceph-mon[124666]: osdmap e315: 12 total, 12 up, 12 in 2023-05-08T05:40:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6953.274775 secs 2023-05-08T05:40:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:15 smithi186 ceph-mon[126480]: pgmap v3769: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 137 KiB/s wr, 12 op/s 2023-05-08T05:40:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:15 smithi186 ceph-mon[126480]: osdmap e315: 12 total, 12 up, 12 in 2023-05-08T05:40:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6954.555166 secs 2023-05-08T05:40:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6954.555166 secs 2023-05-08T05:40:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6954.555166 secs 2023-05-08T05:40:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:17 smithi133 ceph-mon[125939]: pgmap v3771: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 8 op/s 2023-05-08T05:40:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:17 smithi096 ceph-mon[124666]: pgmap v3771: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 8 op/s 2023-05-08T05:40:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:17 smithi186 ceph-mon[126480]: pgmap v3771: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 8 op/s 2023-05-08T05:40:18.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6957.716854 secs 2023-05-08T05:40:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6957.716854 secs 2023-05-08T05:40:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6957.716854 secs 2023-05-08T05:40:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:19 smithi133 ceph-mon[125939]: pgmap v3772: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 8 op/s 2023-05-08T05:40:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:19 smithi096 ceph-mon[124666]: pgmap v3772: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 8 op/s 2023-05-08T05:40:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:19 smithi186 ceph-mon[126480]: pgmap v3772: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 8 op/s 2023-05-08T05:40:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6958.274894 secs 2023-05-08T05:40:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6958.274894 secs 2023-05-08T05:40:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6958.274894 secs 2023-05-08T05:40:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6959.555322 secs 2023-05-08T05:40:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:21 smithi133 ceph-mon[125939]: pgmap v3773: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 76 KiB/s wr, 7 op/s 2023-05-08T05:40:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6959.555322 secs 2023-05-08T05:40:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:21 smithi096 ceph-mon[124666]: pgmap v3773: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 76 KiB/s wr, 7 op/s 2023-05-08T05:40:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6959.555322 secs 2023-05-08T05:40:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:21 smithi186 ceph-mon[126480]: pgmap v3773: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 76 KiB/s wr, 7 op/s 2023-05-08T05:40:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:23 smithi133 ceph-mon[125939]: pgmap v3774: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 76 KiB/s wr, 7 op/s 2023-05-08T05:40:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6962.716972 secs 2023-05-08T05:40:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:23 smithi096 ceph-mon[124666]: pgmap v3774: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 76 KiB/s wr, 7 op/s 2023-05-08T05:40:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6962.716972 secs 2023-05-08T05:40:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:23 smithi186 ceph-mon[126480]: pgmap v3774: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 76 KiB/s wr, 7 op/s 2023-05-08T05:40:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6962.716972 secs 2023-05-08T05:40:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6963.275014 secs 2023-05-08T05:40:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:25 smithi133 ceph-mon[125939]: pgmap v3775: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 76 KiB/s wr, 8 op/s 2023-05-08T05:40:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6963.275014 secs 2023-05-08T05:40:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:25 smithi096 ceph-mon[124666]: pgmap v3775: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 76 KiB/s wr, 8 op/s 2023-05-08T05:40:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6963.275014 secs 2023-05-08T05:40:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:25 smithi186 ceph-mon[126480]: pgmap v3775: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 76 KiB/s wr, 8 op/s 2023-05-08T05:40:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6964.555421 secs 2023-05-08T05:40:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6964.555421 secs 2023-05-08T05:40:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6964.555421 secs 2023-05-08T05:40:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:27 smithi133 ceph-mon[125939]: pgmap v3776: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 91 KiB/s wr, 7 op/s 2023-05-08T05:40:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:27 smithi096 ceph-mon[124666]: pgmap v3776: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 91 KiB/s wr, 7 op/s 2023-05-08T05:40:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:27 smithi186 ceph-mon[126480]: pgmap v3776: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 91 KiB/s wr, 7 op/s 2023-05-08T05:40:28.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6967.717091 secs 2023-05-08T05:40:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6967.717091 secs 2023-05-08T05:40:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6967.717091 secs 2023-05-08T05:40:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:29 smithi133 ceph-mon[125939]: pgmap v3777: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 89 KiB/s wr, 6 op/s 2023-05-08T05:40:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:29 smithi096 ceph-mon[124666]: pgmap v3777: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 89 KiB/s wr, 6 op/s 2023-05-08T05:40:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:29 smithi186 ceph-mon[126480]: pgmap v3777: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 89 KiB/s wr, 6 op/s 2023-05-08T05:40:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6968.275136 secs 2023-05-08T05:40:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6968.275136 secs 2023-05-08T05:40:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6968.275136 secs 2023-05-08T05:40:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6969.555539 secs 2023-05-08T05:40:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:31 smithi133 ceph-mon[125939]: pgmap v3778: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 90 KiB/s wr, 9 op/s 2023-05-08T05:40:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6969.555539 secs 2023-05-08T05:40:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:31 smithi096 ceph-mon[124666]: pgmap v3778: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 90 KiB/s wr, 9 op/s 2023-05-08T05:40:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6969.555539 secs 2023-05-08T05:40:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:31 smithi186 ceph-mon[126480]: pgmap v3778: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 90 KiB/s wr, 9 op/s 2023-05-08T05:40:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:33 smithi133 ceph-mon[125939]: pgmap v3779: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 52 KiB/s wr, 6 op/s 2023-05-08T05:40:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6972.717230 secs 2023-05-08T05:40:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:33 smithi096 ceph-mon[124666]: pgmap v3779: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 52 KiB/s wr, 6 op/s 2023-05-08T05:40:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6972.717230 secs 2023-05-08T05:40:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:33 smithi186 ceph-mon[126480]: pgmap v3779: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 52 KiB/s wr, 6 op/s 2023-05-08T05:40:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6972.717230 secs 2023-05-08T05:40:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6973.275203 secs 2023-05-08T05:40:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:35 smithi133 ceph-mon[125939]: pgmap v3780: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 KiB/s wr, 7 op/s 2023-05-08T05:40:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6973.275203 secs 2023-05-08T05:40:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:35 smithi096 ceph-mon[124666]: pgmap v3780: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 KiB/s wr, 7 op/s 2023-05-08T05:40:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6973.275203 secs 2023-05-08T05:40:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:35 smithi186 ceph-mon[126480]: pgmap v3780: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 KiB/s wr, 7 op/s 2023-05-08T05:40:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6974.555661 secs 2023-05-08T05:40:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6974.555661 secs 2023-05-08T05:40:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6974.555661 secs 2023-05-08T05:40:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:37 smithi133 ceph-mon[125939]: pgmap v3781: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 207 KiB/s wr, 9 op/s 2023-05-08T05:40:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:37 smithi096 ceph-mon[124666]: pgmap v3781: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 207 KiB/s wr, 9 op/s 2023-05-08T05:40:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:37 smithi186 ceph-mon[126480]: pgmap v3781: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 207 KiB/s wr, 9 op/s 2023-05-08T05:40:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6977.717374 secs 2023-05-08T05:40:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6977.717374 secs 2023-05-08T05:40:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6977.717374 secs 2023-05-08T05:40:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:39 smithi133 ceph-mon[125939]: pgmap v3782: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 157 KiB/s wr, 6 op/s 2023-05-08T05:40:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:39 smithi096 ceph-mon[124666]: pgmap v3782: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 157 KiB/s wr, 6 op/s 2023-05-08T05:40:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:39 smithi186 ceph-mon[126480]: pgmap v3782: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 157 KiB/s wr, 6 op/s 2023-05-08T05:40:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6979.555751 secs 2023-05-08T05:40:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:41 smithi133 ceph-mon[125939]: pgmap v3783: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 230 KiB/s wr, 10 op/s 2023-05-08T05:40:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6979.555751 secs 2023-05-08T05:40:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:41 smithi096 ceph-mon[124666]: pgmap v3783: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 230 KiB/s wr, 10 op/s 2023-05-08T05:40:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6979.555751 secs 2023-05-08T05:40:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:41 smithi186 ceph-mon[126480]: pgmap v3783: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 230 KiB/s wr, 10 op/s 2023-05-08T05:40:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:40:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:40:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:40:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:43 smithi133 ceph-mon[125939]: pgmap v3784: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 230 KiB/s wr, 7 op/s 2023-05-08T05:40:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:43 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:40:43.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:40:43.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:40:43.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6982.717495 secs 2023-05-08T05:40:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:43 smithi096 ceph-mon[124666]: pgmap v3784: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 230 KiB/s wr, 7 op/s 2023-05-08T05:40:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:43 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:40:43.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:40:43.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:40:43.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6982.717495 secs 2023-05-08T05:40:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:43 smithi186 ceph-mon[126480]: pgmap v3784: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 230 KiB/s wr, 7 op/s 2023-05-08T05:40:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:43 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:40:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:40:43.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:40:43.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6982.717495 secs 2023-05-08T05:40:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:45 smithi133 ceph-mon[125939]: pgmap v3785: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 232 KiB/s wr, 9 op/s 2023-05-08T05:40:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:45 smithi096 ceph-mon[124666]: pgmap v3785: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 232 KiB/s wr, 9 op/s 2023-05-08T05:40:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:45 smithi186 ceph-mon[126480]: pgmap v3785: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 232 KiB/s wr, 9 op/s 2023-05-08T05:40:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:46 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:40:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:46 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:40:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:46 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:40:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:47 smithi133 ceph-mon[125939]: pgmap v3786: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 429 KiB/s wr, 12 op/s 2023-05-08T05:40:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:47 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:40:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:47 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:40:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:47 smithi096 ceph-mon[124666]: pgmap v3786: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 429 KiB/s wr, 12 op/s 2023-05-08T05:40:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:47 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:40:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:47 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:40:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:47 smithi186 ceph-mon[126480]: pgmap v3786: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 429 KiB/s wr, 12 op/s 2023-05-08T05:40:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:47 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:40:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:47 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:40:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:48 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:40:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6987.717624 secs 2023-05-08T05:40:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:48 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:40:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:48 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:40:48.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:48 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:40:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:48 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:40:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6987.717624 secs 2023-05-08T05:40:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:48 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:40:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:48 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:40:48.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:48 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:40:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:48 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:40:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6987.717624 secs 2023-05-08T05:40:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:48 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:40:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:48 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:40:48.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:48 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:40:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:49 smithi133 ceph-mon[125939]: pgmap v3787: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 286 KiB/s rd, 273 KiB/s wr, 9 op/s 2023-05-08T05:40:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:49 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:40:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:49 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T05:40:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:49 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T05:40:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:49 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:40:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:49 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:40:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:49 smithi096 ceph-mon[124666]: pgmap v3787: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 286 KiB/s rd, 273 KiB/s wr, 9 op/s 2023-05-08T05:40:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:49 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:40:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:49 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T05:40:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:49 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T05:40:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:49 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:40:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:49 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:40:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:49 smithi186 ceph-mon[126480]: pgmap v3787: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 286 KiB/s rd, 273 KiB/s wr, 9 op/s 2023-05-08T05:40:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:49 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:40:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:49 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T05:40:49.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:49 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T05:40:49.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:49 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:40:49.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:49 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:40:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6988.275544 secs 2023-05-08T05:40:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6988.275544 secs 2023-05-08T05:40:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6988.275544 secs 2023-05-08T05:40:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:51 smithi133 ceph-mon[125939]: pgmap v3788: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 275 KiB/s wr, 13 op/s 2023-05-08T05:40:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:40:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:40:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:51 smithi096 ceph-mon[124666]: pgmap v3788: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 275 KiB/s wr, 13 op/s 2023-05-08T05:40:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:40:51.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:40:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:51 smithi186 ceph-mon[126480]: pgmap v3788: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 275 KiB/s wr, 13 op/s 2023-05-08T05:40:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:40:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:40:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:53 smithi096 ceph-mon[124666]: pgmap v3789: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 284 KiB/s rd, 271 KiB/s wr, 10 op/s 2023-05-08T05:40:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6992.717732 secs 2023-05-08T05:40:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:53 smithi186 ceph-mon[126480]: pgmap v3789: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 284 KiB/s rd, 271 KiB/s wr, 10 op/s 2023-05-08T05:40:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6992.717732 secs 2023-05-08T05:40:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:53 smithi133 ceph-mon[125939]: pgmap v3789: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 284 KiB/s rd, 271 KiB/s wr, 10 op/s 2023-05-08T05:40:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6992.717732 secs 2023-05-08T05:40:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:54 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:40:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:54 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:40:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:54 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:40:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6993.275661 secs 2023-05-08T05:40:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:55 smithi096 ceph-mon[124666]: pgmap v3790: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 272 KiB/s wr, 11 op/s 2023-05-08T05:40:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6993.275661 secs 2023-05-08T05:40:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:55 smithi186 ceph-mon[126480]: pgmap v3790: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 272 KiB/s wr, 11 op/s 2023-05-08T05:40:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6993.275661 secs 2023-05-08T05:40:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:55 smithi133 ceph-mon[125939]: pgmap v3790: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 272 KiB/s wr, 11 op/s 2023-05-08T05:40:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:57 smithi096 ceph-mon[124666]: pgmap v3791: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 355 KiB/s wr, 13 op/s 2023-05-08T05:40:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:57 smithi186 ceph-mon[126480]: pgmap v3791: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 355 KiB/s wr, 13 op/s 2023-05-08T05:40:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:57 smithi133 ceph-mon[125939]: pgmap v3791: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 355 KiB/s wr, 13 op/s 2023-05-08T05:40:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6997.717828 secs 2023-05-08T05:40:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6997.717828 secs 2023-05-08T05:40:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6997.717828 secs 2023-05-08T05:40:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:59 smithi186 ceph-mon[126480]: pgmap v3792: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 158 KiB/s wr, 9 op/s 2023-05-08T05:40:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:40:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6998.275744 secs 2023-05-08T05:40:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:59 smithi133 ceph-mon[125939]: pgmap v3792: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 158 KiB/s wr, 9 op/s 2023-05-08T05:40:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:40:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6998.275744 secs 2023-05-08T05:41:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:59 smithi096 ceph-mon[124666]: pgmap v3792: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 158 KiB/s wr, 9 op/s 2023-05-08T05:41:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:40:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6998.275744 secs 2023-05-08T05:41:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 6999.556249 secs 2023-05-08T05:41:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:01 smithi186 ceph-mon[126480]: pgmap v3793: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 161 KiB/s wr, 12 op/s 2023-05-08T05:41:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 6999.556249 secs 2023-05-08T05:41:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:01 smithi133 ceph-mon[125939]: pgmap v3793: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 161 KiB/s wr, 12 op/s 2023-05-08T05:41:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 6999.556249 secs 2023-05-08T05:41:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:01 smithi096 ceph-mon[124666]: pgmap v3793: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 161 KiB/s wr, 12 op/s 2023-05-08T05:41:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:02 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:41:02.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:41:02.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:41:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:02 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:41:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:41:02.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:41:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:02 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:41:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:41:03.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:41:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:03 smithi186 ceph-mon[126480]: pgmap v3794: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 224 KiB/s wr, 9 op/s 2023-05-08T05:41:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7002.717949 secs 2023-05-08T05:41:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:03 smithi133 ceph-mon[125939]: pgmap v3794: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 224 KiB/s wr, 9 op/s 2023-05-08T05:41:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7002.717949 secs 2023-05-08T05:41:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:03 smithi096 ceph-mon[124666]: pgmap v3794: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 224 KiB/s wr, 9 op/s 2023-05-08T05:41:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7002.717949 secs 2023-05-08T05:41:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7003.275859 secs 2023-05-08T05:41:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:05 smithi133 ceph-mon[125939]: pgmap v3795: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 176 KiB/s wr, 22 op/s 2023-05-08T05:41:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7003.275859 secs 2023-05-08T05:41:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:05 smithi096 ceph-mon[124666]: pgmap v3795: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 176 KiB/s wr, 22 op/s 2023-05-08T05:41:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7003.275859 secs 2023-05-08T05:41:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:05 smithi186 ceph-mon[126480]: pgmap v3795: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 176 KiB/s wr, 22 op/s 2023-05-08T05:41:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7004.556331 secs 2023-05-08T05:41:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:06 smithi186 ceph-mon[126480]: osdmap e316: 12 total, 12 up, 12 in 2023-05-08T05:41:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7004.556331 secs 2023-05-08T05:41:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:06 smithi133 ceph-mon[125939]: osdmap e316: 12 total, 12 up, 12 in 2023-05-08T05:41:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7004.556331 secs 2023-05-08T05:41:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:06 smithi096 ceph-mon[124666]: osdmap e316: 12 total, 12 up, 12 in 2023-05-08T05:41:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:07 smithi186 ceph-mon[126480]: pgmap v3797: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 199 KiB/s wr, 27 op/s 2023-05-08T05:41:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:07 smithi133 ceph-mon[125939]: pgmap v3797: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 199 KiB/s wr, 27 op/s 2023-05-08T05:41:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:07 smithi096 ceph-mon[124666]: pgmap v3797: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 199 KiB/s wr, 27 op/s 2023-05-08T05:41:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7007.718071 secs 2023-05-08T05:41:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7007.718071 secs 2023-05-08T05:41:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7007.718071 secs 2023-05-08T05:41:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:09 smithi186 ceph-mon[126480]: pgmap v3798: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 199 KiB/s wr, 27 op/s 2023-05-08T05:41:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7008.275979 secs 2023-05-08T05:41:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:09 smithi133 ceph-mon[125939]: pgmap v3798: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 199 KiB/s wr, 27 op/s 2023-05-08T05:41:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7008.275979 secs 2023-05-08T05:41:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:09 smithi096 ceph-mon[124666]: pgmap v3798: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 199 KiB/s wr, 27 op/s 2023-05-08T05:41:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7008.275979 secs 2023-05-08T05:41:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7009.556448 secs 2023-05-08T05:41:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:11 smithi186 ceph-mon[126480]: pgmap v3799: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 199 KiB/s wr, 27 op/s 2023-05-08T05:41:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7009.556448 secs 2023-05-08T05:41:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:11 smithi133 ceph-mon[125939]: pgmap v3799: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 199 KiB/s wr, 27 op/s 2023-05-08T05:41:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7009.556448 secs 2023-05-08T05:41:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:11 smithi096 ceph-mon[124666]: pgmap v3799: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 199 KiB/s wr, 27 op/s 2023-05-08T05:41:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:13 smithi186 ceph-mon[126480]: pgmap v3800: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 120 KiB/s wr, 26 op/s 2023-05-08T05:41:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7012.718191 secs 2023-05-08T05:41:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:13 smithi133 ceph-mon[125939]: pgmap v3800: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 120 KiB/s wr, 26 op/s 2023-05-08T05:41:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7012.718191 secs 2023-05-08T05:41:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:13 smithi096 ceph-mon[124666]: pgmap v3800: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 120 KiB/s wr, 26 op/s 2023-05-08T05:41:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7012.718191 secs 2023-05-08T05:41:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7013.276115 secs 2023-05-08T05:41:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:15 smithi133 ceph-mon[125939]: pgmap v3801: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 94 KiB/s wr, 12 op/s 2023-05-08T05:41:15.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:15 smithi133 ceph-mon[125939]: osdmap e317: 12 total, 12 up, 12 in 2023-05-08T05:41:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7013.276115 secs 2023-05-08T05:41:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:15 smithi096 ceph-mon[124666]: pgmap v3801: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 94 KiB/s wr, 12 op/s 2023-05-08T05:41:15.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:15 smithi096 ceph-mon[124666]: osdmap e317: 12 total, 12 up, 12 in 2023-05-08T05:41:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7013.276115 secs 2023-05-08T05:41:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:15 smithi186 ceph-mon[126480]: pgmap v3801: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 94 KiB/s wr, 12 op/s 2023-05-08T05:41:15.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:15 smithi186 ceph-mon[126480]: osdmap e317: 12 total, 12 up, 12 in 2023-05-08T05:41:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7014.556578 secs 2023-05-08T05:41:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7014.556578 secs 2023-05-08T05:41:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7014.556578 secs 2023-05-08T05:41:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:17 smithi133 ceph-mon[125939]: pgmap v3803: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 92 KiB/s wr, 9 op/s 2023-05-08T05:41:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:17 smithi096 ceph-mon[124666]: pgmap v3803: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 92 KiB/s wr, 9 op/s 2023-05-08T05:41:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:17 smithi186 ceph-mon[126480]: pgmap v3803: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 92 KiB/s wr, 9 op/s 2023-05-08T05:41:18.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7017.718313 secs 2023-05-08T05:41:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7017.718313 secs 2023-05-08T05:41:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7017.718313 secs 2023-05-08T05:41:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:19 smithi133 ceph-mon[125939]: pgmap v3804: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 92 KiB/s wr, 9 op/s 2023-05-08T05:41:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:19 smithi096 ceph-mon[124666]: pgmap v3804: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 92 KiB/s wr, 9 op/s 2023-05-08T05:41:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:19 smithi186 ceph-mon[126480]: pgmap v3804: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 92 KiB/s wr, 9 op/s 2023-05-08T05:41:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7018.276228 secs 2023-05-08T05:41:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7018.276228 secs 2023-05-08T05:41:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7018.276228 secs 2023-05-08T05:41:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7019.556700 secs 2023-05-08T05:41:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:21 smithi133 ceph-mon[125939]: pgmap v3805: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 135 KiB/s wr, 8 op/s 2023-05-08T05:41:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7019.556700 secs 2023-05-08T05:41:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:21 smithi096 ceph-mon[124666]: pgmap v3805: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 135 KiB/s wr, 8 op/s 2023-05-08T05:41:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7019.556700 secs 2023-05-08T05:41:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:21 smithi186 ceph-mon[126480]: pgmap v3805: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 135 KiB/s wr, 8 op/s 2023-05-08T05:41:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:23 smithi133 ceph-mon[125939]: pgmap v3806: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 135 KiB/s wr, 8 op/s 2023-05-08T05:41:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7022.718431 secs 2023-05-08T05:41:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:23 smithi096 ceph-mon[124666]: pgmap v3806: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 135 KiB/s wr, 8 op/s 2023-05-08T05:41:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7022.718431 secs 2023-05-08T05:41:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:23 smithi186 ceph-mon[126480]: pgmap v3806: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 135 KiB/s wr, 8 op/s 2023-05-08T05:41:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7022.718431 secs 2023-05-08T05:41:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7023.276349 secs 2023-05-08T05:41:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:25 smithi133 ceph-mon[125939]: pgmap v3807: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 135 KiB/s wr, 8 op/s 2023-05-08T05:41:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7023.276349 secs 2023-05-08T05:41:25.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:25 smithi096 ceph-mon[124666]: pgmap v3807: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 135 KiB/s wr, 8 op/s 2023-05-08T05:41:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7023.276349 secs 2023-05-08T05:41:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:25 smithi186 ceph-mon[126480]: pgmap v3807: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 135 KiB/s wr, 8 op/s 2023-05-08T05:41:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7024.556794 secs 2023-05-08T05:41:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7024.556794 secs 2023-05-08T05:41:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7024.556794 secs 2023-05-08T05:41:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:27 smithi133 ceph-mon[125939]: pgmap v3808: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 92 KiB/s wr, 6 op/s 2023-05-08T05:41:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:27 smithi096 ceph-mon[124666]: pgmap v3808: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 92 KiB/s wr, 6 op/s 2023-05-08T05:41:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:27 smithi186 ceph-mon[126480]: pgmap v3808: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 92 KiB/s wr, 6 op/s 2023-05-08T05:41:28.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7027.718557 secs 2023-05-08T05:41:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7027.718557 secs 2023-05-08T05:41:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7027.718557 secs 2023-05-08T05:41:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:29 smithi133 ceph-mon[125939]: pgmap v3809: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 90 KiB/s wr, 6 op/s 2023-05-08T05:41:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:29 smithi096 ceph-mon[124666]: pgmap v3809: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 90 KiB/s wr, 6 op/s 2023-05-08T05:41:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:29 smithi186 ceph-mon[126480]: pgmap v3809: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 90 KiB/s wr, 6 op/s 2023-05-08T05:41:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7028.276479 secs 2023-05-08T05:41:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7028.276479 secs 2023-05-08T05:41:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7028.276479 secs 2023-05-08T05:41:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7029.556948 secs 2023-05-08T05:41:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:31 smithi133 ceph-mon[125939]: pgmap v3810: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 90 KiB/s wr, 9 op/s 2023-05-08T05:41:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7029.556948 secs 2023-05-08T05:41:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:31 smithi096 ceph-mon[124666]: pgmap v3810: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 90 KiB/s wr, 9 op/s 2023-05-08T05:41:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7029.556948 secs 2023-05-08T05:41:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:31 smithi186 ceph-mon[126480]: pgmap v3810: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 90 KiB/s wr, 9 op/s 2023-05-08T05:41:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:33 smithi133 ceph-mon[125939]: pgmap v3811: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 KiB/s wr, 6 op/s 2023-05-08T05:41:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7032.718695 secs 2023-05-08T05:41:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:33 smithi096 ceph-mon[124666]: pgmap v3811: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 KiB/s wr, 6 op/s 2023-05-08T05:41:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7032.718695 secs 2023-05-08T05:41:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:33 smithi186 ceph-mon[126480]: pgmap v3811: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 KiB/s wr, 6 op/s 2023-05-08T05:41:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7032.718695 secs 2023-05-08T05:41:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7033.276591 secs 2023-05-08T05:41:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:35 smithi133 ceph-mon[125939]: pgmap v3812: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 KiB/s wr, 7 op/s 2023-05-08T05:41:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7033.276591 secs 2023-05-08T05:41:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:35 smithi096 ceph-mon[124666]: pgmap v3812: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 KiB/s wr, 7 op/s 2023-05-08T05:41:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7033.276591 secs 2023-05-08T05:41:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:35 smithi186 ceph-mon[126480]: pgmap v3812: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 KiB/s wr, 7 op/s 2023-05-08T05:41:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7034.557076 secs 2023-05-08T05:41:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7034.557076 secs 2023-05-08T05:41:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7034.557076 secs 2023-05-08T05:41:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:37 smithi133 ceph-mon[125939]: pgmap v3813: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 213 KiB/s wr, 9 op/s 2023-05-08T05:41:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:37 smithi096 ceph-mon[124666]: pgmap v3813: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 213 KiB/s wr, 9 op/s 2023-05-08T05:41:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:37 smithi186 ceph-mon[126480]: pgmap v3813: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 213 KiB/s wr, 9 op/s 2023-05-08T05:41:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7037.718833 secs 2023-05-08T05:41:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7037.718833 secs 2023-05-08T05:41:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7037.718833 secs 2023-05-08T05:41:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:39 smithi133 ceph-mon[125939]: pgmap v3814: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 162 KiB/s wr, 6 op/s 2023-05-08T05:41:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:39 smithi096 ceph-mon[124666]: pgmap v3814: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 162 KiB/s wr, 6 op/s 2023-05-08T05:41:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:39 smithi186 ceph-mon[126480]: pgmap v3814: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 162 KiB/s wr, 6 op/s 2023-05-08T05:41:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7039.557195 secs 2023-05-08T05:41:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:41 smithi133 ceph-mon[125939]: pgmap v3815: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 232 KiB/s wr, 10 op/s 2023-05-08T05:41:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7039.557195 secs 2023-05-08T05:41:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:41 smithi096 ceph-mon[124666]: pgmap v3815: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 232 KiB/s wr, 10 op/s 2023-05-08T05:41:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7039.557195 secs 2023-05-08T05:41:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:41 smithi186 ceph-mon[126480]: pgmap v3815: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 232 KiB/s wr, 10 op/s 2023-05-08T05:41:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:41:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:41:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:41:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:43 smithi133 ceph-mon[125939]: pgmap v3816: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 308 KiB/s wr, 8 op/s 2023-05-08T05:41:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:43 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:41:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:41:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:41:43.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7042.718977 secs 2023-05-08T05:41:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:43 smithi096 ceph-mon[124666]: pgmap v3816: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 308 KiB/s wr, 8 op/s 2023-05-08T05:41:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:43 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:41:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:41:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:41:43.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7042.718977 secs 2023-05-08T05:41:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:43 smithi186 ceph-mon[126480]: pgmap v3816: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 308 KiB/s wr, 8 op/s 2023-05-08T05:41:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:43 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:41:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:41:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:41:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7042.718977 secs 2023-05-08T05:41:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:45 smithi133 ceph-mon[125939]: pgmap v3817: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 310 KiB/s wr, 10 op/s 2023-05-08T05:41:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:45 smithi096 ceph-mon[124666]: pgmap v3817: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 310 KiB/s wr, 10 op/s 2023-05-08T05:41:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:45 smithi186 ceph-mon[126480]: pgmap v3817: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 310 KiB/s wr, 10 op/s 2023-05-08T05:41:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7044.557268 secs 2023-05-08T05:41:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7044.557268 secs 2023-05-08T05:41:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7044.557268 secs 2023-05-08T05:41:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:47 smithi133 ceph-mon[125939]: pgmap v3818: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 398 KiB/s rd, 384 KiB/s wr, 13 op/s 2023-05-08T05:41:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:47 smithi096 ceph-mon[124666]: pgmap v3818: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 398 KiB/s rd, 384 KiB/s wr, 13 op/s 2023-05-08T05:41:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:47 smithi186 ceph-mon[126480]: pgmap v3818: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 398 KiB/s rd, 384 KiB/s wr, 13 op/s 2023-05-08T05:41:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:48 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:41:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:48 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:41:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:48 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:41:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:49 smithi133 ceph-mon[125939]: pgmap v3819: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 223 KiB/s wr, 10 op/s 2023-05-08T05:41:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:41:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:49 smithi096 ceph-mon[124666]: pgmap v3819: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 223 KiB/s wr, 10 op/s 2023-05-08T05:41:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:41:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:49 smithi186 ceph-mon[126480]: pgmap v3819: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 223 KiB/s wr, 10 op/s 2023-05-08T05:41:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:41:50.492 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7048.276918 secs 2023-05-08T05:41:50.492 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:50 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:41:50.493 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T05:41:50.748 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7048.276918 secs 2023-05-08T05:41:50.749 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:50 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:41:50.749 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T05:41:50.749 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:41:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:41:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7048.276918 secs 2023-05-08T05:41:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:50 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:41:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T05:41:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:41:51.526 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7049.557332 secs 2023-05-08T05:41:51.526 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:51 smithi133 ceph-mon[125939]: pgmap v3820: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 225 KiB/s wr, 14 op/s 2023-05-08T05:41:51.526 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:41:51.527 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:41:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7049.557332 secs 2023-05-08T05:41:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:51 smithi096 ceph-mon[124666]: pgmap v3820: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 225 KiB/s wr, 14 op/s 2023-05-08T05:41:51.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:41:51.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:41:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7049.557332 secs 2023-05-08T05:41:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:51 smithi186 ceph-mon[126480]: pgmap v3820: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 225 KiB/s wr, 14 op/s 2023-05-08T05:41:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:41:51.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:41:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:41:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:41:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:41:52.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:41:52.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:41:52.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:41:52.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:52 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:41:52.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:41:52.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:52 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T05:41:52.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:52 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T05:41:52.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:52 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:41:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:41:52.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:41:52.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:41:52.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:41:52.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:41:52.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:41:52.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:52 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:41:52.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:41:52.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:52 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T05:41:52.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:52 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T05:41:52.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:52 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:41:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:41:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:41:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:41:53.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:41:53.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:41:53.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:41:53.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:52 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:41:53.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:41:53.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:52 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T05:41:53.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:52 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T05:41:53.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:52 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:41:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:53 smithi186 ceph-mon[126480]: pgmap v3821: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 226 KiB/s wr, 10 op/s 2023-05-08T05:41:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:53 smithi133 ceph-mon[125939]: pgmap v3821: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 226 KiB/s wr, 10 op/s 2023-05-08T05:41:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:53 smithi096 ceph-mon[124666]: pgmap v3821: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 226 KiB/s wr, 10 op/s 2023-05-08T05:41:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7053.277054 secs 2023-05-08T05:41:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:55 smithi133 ceph-mon[125939]: pgmap v3822: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 150 KiB/s wr, 11 op/s 2023-05-08T05:41:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7053.277054 secs 2023-05-08T05:41:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:55 smithi096 ceph-mon[124666]: pgmap v3822: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 150 KiB/s wr, 11 op/s 2023-05-08T05:41:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7053.277054 secs 2023-05-08T05:41:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:55 smithi186 ceph-mon[126480]: pgmap v3822: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 150 KiB/s wr, 11 op/s 2023-05-08T05:41:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:57 smithi133 ceph-mon[125939]: pgmap v3823: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 222 KiB/s wr, 11 op/s 2023-05-08T05:41:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:57 smithi096 ceph-mon[124666]: pgmap v3823: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 222 KiB/s wr, 11 op/s 2023-05-08T05:41:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:57 smithi186 ceph-mon[126480]: pgmap v3823: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 222 KiB/s wr, 11 op/s 2023-05-08T05:41:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:58 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:41:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7057.719345 secs 2023-05-08T05:41:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:58 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:41:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7057.719345 secs 2023-05-08T05:41:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:58 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:41:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7057.719345 secs 2023-05-08T05:41:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:59 smithi133 ceph-mon[125939]: pgmap v3824: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 148 KiB/s wr, 7 op/s 2023-05-08T05:41:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:59 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:41:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:59 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:41:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:41:59 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:41:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:59 smithi096 ceph-mon[124666]: pgmap v3824: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 148 KiB/s wr, 7 op/s 2023-05-08T05:41:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:59 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:41:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:59 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:41:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:41:59 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:41:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:59 smithi186 ceph-mon[126480]: pgmap v3824: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 148 KiB/s wr, 7 op/s 2023-05-08T05:41:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:59 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:41:59.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:59 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:41:59.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:41:59 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:42:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7058.277189 secs 2023-05-08T05:42:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7058.277189 secs 2023-05-08T05:42:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7058.277189 secs 2023-05-08T05:42:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7059.557559 secs 2023-05-08T05:42:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:01 smithi133 ceph-mon[125939]: pgmap v3825: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 211 KiB/s wr, 11 op/s 2023-05-08T05:42:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7059.557559 secs 2023-05-08T05:42:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:01 smithi096 ceph-mon[124666]: pgmap v3825: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 211 KiB/s wr, 11 op/s 2023-05-08T05:42:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7059.557559 secs 2023-05-08T05:42:01.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:01 smithi186 ceph-mon[126480]: pgmap v3825: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 211 KiB/s wr, 11 op/s 2023-05-08T05:42:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T05:42:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:42:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T05:42:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:42:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T05:42:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:42:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:03 smithi133 ceph-mon[125939]: pgmap v3826: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 208 KiB/s wr, 8 op/s 2023-05-08T05:42:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:42:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:03 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:42:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7062.719413 secs 2023-05-08T05:42:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:03 smithi096 ceph-mon[124666]: pgmap v3826: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 208 KiB/s wr, 8 op/s 2023-05-08T05:42:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:42:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:03 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:42:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7062.719413 secs 2023-05-08T05:42:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:03 smithi186 ceph-mon[126480]: pgmap v3826: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 208 KiB/s wr, 8 op/s 2023-05-08T05:42:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:42:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:03 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:42:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7062.719413 secs 2023-05-08T05:42:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:04 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:42:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:04 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:42:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:04 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:42:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7063.277286 secs 2023-05-08T05:42:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:05 smithi133 ceph-mon[125939]: pgmap v3827: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 159 KiB/s wr, 21 op/s 2023-05-08T05:42:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7063.277286 secs 2023-05-08T05:42:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:05 smithi096 ceph-mon[124666]: pgmap v3827: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 159 KiB/s wr, 21 op/s 2023-05-08T05:42:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7063.277286 secs 2023-05-08T05:42:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:05 smithi186 ceph-mon[126480]: pgmap v3827: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 159 KiB/s wr, 21 op/s 2023-05-08T05:42:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7064.557676 secs 2023-05-08T05:42:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:06 smithi133 ceph-mon[125939]: osdmap e318: 12 total, 12 up, 12 in 2023-05-08T05:42:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7064.557676 secs 2023-05-08T05:42:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:06 smithi096 ceph-mon[124666]: osdmap e318: 12 total, 12 up, 12 in 2023-05-08T05:42:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7064.557676 secs 2023-05-08T05:42:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:06 smithi186 ceph-mon[126480]: osdmap e318: 12 total, 12 up, 12 in 2023-05-08T05:42:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:07 smithi133 ceph-mon[125939]: pgmap v3829: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 234 KiB/s wr, 27 op/s 2023-05-08T05:42:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:07 smithi096 ceph-mon[124666]: pgmap v3829: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 234 KiB/s wr, 27 op/s 2023-05-08T05:42:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:07 smithi186 ceph-mon[126480]: pgmap v3829: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 234 KiB/s wr, 27 op/s 2023-05-08T05:42:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7067.719536 secs 2023-05-08T05:42:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7067.719536 secs 2023-05-08T05:42:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7067.719536 secs 2023-05-08T05:42:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:09 smithi133 ceph-mon[125939]: pgmap v3830: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 234 KiB/s wr, 27 op/s 2023-05-08T05:42:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:09 smithi096 ceph-mon[124666]: pgmap v3830: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 234 KiB/s wr, 27 op/s 2023-05-08T05:42:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:09 smithi186 ceph-mon[126480]: pgmap v3830: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 234 KiB/s wr, 27 op/s 2023-05-08T05:42:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7068.277399 secs 2023-05-08T05:42:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7068.277399 secs 2023-05-08T05:42:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7068.277399 secs 2023-05-08T05:42:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7069.557814 secs 2023-05-08T05:42:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:11 smithi133 ceph-mon[125939]: pgmap v3831: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 164 KiB/s wr, 27 op/s 2023-05-08T05:42:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7069.557814 secs 2023-05-08T05:42:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:11 smithi096 ceph-mon[124666]: pgmap v3831: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 164 KiB/s wr, 27 op/s 2023-05-08T05:42:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7069.557814 secs 2023-05-08T05:42:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:11 smithi186 ceph-mon[126480]: pgmap v3831: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 164 KiB/s wr, 27 op/s 2023-05-08T05:42:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:13 smithi133 ceph-mon[125939]: pgmap v3832: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 164 KiB/s wr, 26 op/s 2023-05-08T05:42:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7072.719656 secs 2023-05-08T05:42:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:13 smithi096 ceph-mon[124666]: pgmap v3832: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 164 KiB/s wr, 26 op/s 2023-05-08T05:42:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7072.719656 secs 2023-05-08T05:42:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:13 smithi186 ceph-mon[126480]: pgmap v3832: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 164 KiB/s wr, 26 op/s 2023-05-08T05:42:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7072.719656 secs 2023-05-08T05:42:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7073.277557 secs 2023-05-08T05:42:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:15 smithi133 ceph-mon[125939]: pgmap v3833: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 139 KiB/s wr, 11 op/s 2023-05-08T05:42:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:15 smithi133 ceph-mon[125939]: osdmap e319: 12 total, 12 up, 12 in 2023-05-08T05:42:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7073.277557 secs 2023-05-08T05:42:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:15 smithi096 ceph-mon[124666]: pgmap v3833: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 139 KiB/s wr, 11 op/s 2023-05-08T05:42:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:15 smithi096 ceph-mon[124666]: osdmap e319: 12 total, 12 up, 12 in 2023-05-08T05:42:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7073.277557 secs 2023-05-08T05:42:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:15 smithi186 ceph-mon[126480]: pgmap v3833: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 139 KiB/s wr, 11 op/s 2023-05-08T05:42:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:15 smithi186 ceph-mon[126480]: osdmap e319: 12 total, 12 up, 12 in 2023-05-08T05:42:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7074.557931 secs 2023-05-08T05:42:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7074.557931 secs 2023-05-08T05:42:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7074.557931 secs 2023-05-08T05:42:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:17 smithi133 ceph-mon[125939]: pgmap v3835: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 8 op/s 2023-05-08T05:42:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:17 smithi096 ceph-mon[124666]: pgmap v3835: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 8 op/s 2023-05-08T05:42:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:17 smithi186 ceph-mon[126480]: pgmap v3835: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 8 op/s 2023-05-08T05:42:18.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7077.719780 secs 2023-05-08T05:42:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7077.719780 secs 2023-05-08T05:42:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7077.719780 secs 2023-05-08T05:42:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:19 smithi133 ceph-mon[125939]: pgmap v3836: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 8 op/s 2023-05-08T05:42:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:19 smithi096 ceph-mon[124666]: pgmap v3836: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 8 op/s 2023-05-08T05:42:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:19 smithi186 ceph-mon[126480]: pgmap v3836: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 8 op/s 2023-05-08T05:42:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7078.277693 secs 2023-05-08T05:42:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7078.277693 secs 2023-05-08T05:42:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7078.277693 secs 2023-05-08T05:42:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7079.558077 secs 2023-05-08T05:42:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:21 smithi133 ceph-mon[125939]: pgmap v3837: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 77 KiB/s wr, 7 op/s 2023-05-08T05:42:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7079.558077 secs 2023-05-08T05:42:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:21 smithi096 ceph-mon[124666]: pgmap v3837: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 77 KiB/s wr, 7 op/s 2023-05-08T05:42:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7079.558077 secs 2023-05-08T05:42:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:21 smithi186 ceph-mon[126480]: pgmap v3837: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 77 KiB/s wr, 7 op/s 2023-05-08T05:42:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:23 smithi133 ceph-mon[125939]: pgmap v3838: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 77 KiB/s wr, 7 op/s 2023-05-08T05:42:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7082.719899 secs 2023-05-08T05:42:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:23 smithi096 ceph-mon[124666]: pgmap v3838: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 77 KiB/s wr, 7 op/s 2023-05-08T05:42:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7082.719899 secs 2023-05-08T05:42:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:23 smithi186 ceph-mon[126480]: pgmap v3838: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 77 KiB/s wr, 7 op/s 2023-05-08T05:42:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7082.719899 secs 2023-05-08T05:42:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7083.277786 secs 2023-05-08T05:42:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:25 smithi133 ceph-mon[125939]: pgmap v3839: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 138 KiB/s wr, 10 op/s 2023-05-08T05:42:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7083.277786 secs 2023-05-08T05:42:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:25 smithi096 ceph-mon[124666]: pgmap v3839: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 138 KiB/s wr, 10 op/s 2023-05-08T05:42:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7083.277786 secs 2023-05-08T05:42:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:25 smithi186 ceph-mon[126480]: pgmap v3839: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 138 KiB/s wr, 10 op/s 2023-05-08T05:42:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7084.558184 secs 2023-05-08T05:42:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7084.558184 secs 2023-05-08T05:42:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7084.558184 secs 2023-05-08T05:42:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:27 smithi133 ceph-mon[125939]: pgmap v3840: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 92 KiB/s wr, 6 op/s 2023-05-08T05:42:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:27 smithi096 ceph-mon[124666]: pgmap v3840: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 92 KiB/s wr, 6 op/s 2023-05-08T05:42:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:27 smithi186 ceph-mon[126480]: pgmap v3840: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 92 KiB/s wr, 6 op/s 2023-05-08T05:42:28.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7087.720022 secs 2023-05-08T05:42:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7087.720022 secs 2023-05-08T05:42:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7087.720022 secs 2023-05-08T05:42:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:29 smithi133 ceph-mon[125939]: pgmap v3841: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 90 KiB/s wr, 6 op/s 2023-05-08T05:42:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:29 smithi096 ceph-mon[124666]: pgmap v3841: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 90 KiB/s wr, 6 op/s 2023-05-08T05:42:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:29 smithi186 ceph-mon[126480]: pgmap v3841: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 90 KiB/s wr, 6 op/s 2023-05-08T05:42:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7088.277904 secs 2023-05-08T05:42:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7088.277904 secs 2023-05-08T05:42:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7088.277904 secs 2023-05-08T05:42:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7089.558324 secs 2023-05-08T05:42:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:31 smithi133 ceph-mon[125939]: pgmap v3842: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 91 KiB/s wr, 9 op/s 2023-05-08T05:42:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7089.558324 secs 2023-05-08T05:42:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:31 smithi096 ceph-mon[124666]: pgmap v3842: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 91 KiB/s wr, 9 op/s 2023-05-08T05:42:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7089.558324 secs 2023-05-08T05:42:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:31 smithi186 ceph-mon[126480]: pgmap v3842: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 91 KiB/s wr, 9 op/s 2023-05-08T05:42:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:33 smithi133 ceph-mon[125939]: pgmap v3843: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 52 KiB/s wr, 6 op/s 2023-05-08T05:42:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7092.720145 secs 2023-05-08T05:42:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:33 smithi096 ceph-mon[124666]: pgmap v3843: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 52 KiB/s wr, 6 op/s 2023-05-08T05:42:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7092.720145 secs 2023-05-08T05:42:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:33 smithi186 ceph-mon[126480]: pgmap v3843: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 52 KiB/s wr, 6 op/s 2023-05-08T05:42:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7092.720145 secs 2023-05-08T05:42:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7093.278047 secs 2023-05-08T05:42:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:35 smithi133 ceph-mon[125939]: pgmap v3844: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 83 KiB/s wr, 9 op/s 2023-05-08T05:42:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7093.278047 secs 2023-05-08T05:42:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:35 smithi096 ceph-mon[124666]: pgmap v3844: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 83 KiB/s wr, 9 op/s 2023-05-08T05:42:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7093.278047 secs 2023-05-08T05:42:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:35 smithi186 ceph-mon[126480]: pgmap v3844: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 83 KiB/s wr, 9 op/s 2023-05-08T05:42:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:37 smithi133 ceph-mon[125939]: pgmap v3845: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T05:42:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:37 smithi096 ceph-mon[124666]: pgmap v3845: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T05:42:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:37 smithi186 ceph-mon[126480]: pgmap v3845: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T05:42:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:38 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:42:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7097.720265 secs 2023-05-08T05:42:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:38 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:42:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7097.720265 secs 2023-05-08T05:42:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:38 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:42:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7097.720265 secs 2023-05-08T05:42:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:39 smithi133 ceph-mon[125939]: pgmap v3846: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T05:42:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:39 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:42:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:39 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:42:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:39 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:42:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:39 smithi096 ceph-mon[124666]: pgmap v3846: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T05:42:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:39 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:42:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:39 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:42:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:39 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:42:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:39 smithi186 ceph-mon[126480]: pgmap v3846: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T05:42:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:39 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:42:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:39 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:42:39.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:39 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:42:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7098.278141 secs 2023-05-08T05:42:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7098.278141 secs 2023-05-08T05:42:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7098.278141 secs 2023-05-08T05:42:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7099.558570 secs 2023-05-08T05:42:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:41 smithi096 ceph-mon[124666]: pgmap v3847: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 204 KiB/s wr, 10 op/s 2023-05-08T05:42:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7099.558570 secs 2023-05-08T05:42:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:41 smithi186 ceph-mon[126480]: pgmap v3847: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 204 KiB/s wr, 10 op/s 2023-05-08T05:42:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7099.558570 secs 2023-05-08T05:42:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:41 smithi133 ceph-mon[125939]: pgmap v3847: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 204 KiB/s wr, 10 op/s 2023-05-08T05:42:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:43 smithi096 ceph-mon[124666]: pgmap v3848: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 203 KiB/s wr, 7 op/s 2023-05-08T05:42:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:42:43.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:42:43.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7102.720380 secs 2023-05-08T05:42:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:43 smithi186 ceph-mon[126480]: pgmap v3848: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 203 KiB/s wr, 7 op/s 2023-05-08T05:42:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:42:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:42:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7102.720380 secs 2023-05-08T05:42:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:43 smithi133 ceph-mon[125939]: pgmap v3848: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 203 KiB/s wr, 7 op/s 2023-05-08T05:42:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:42:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:42:43.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7102.720380 secs 2023-05-08T05:42:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:44 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:42:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:44 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:42:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:44 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:42:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:45 smithi186 ceph-mon[126480]: pgmap v3849: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 246 KiB/s wr, 12 op/s 2023-05-08T05:42:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:45 smithi133 ceph-mon[125939]: pgmap v3849: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 246 KiB/s wr, 12 op/s 2023-05-08T05:42:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:45 smithi096 ceph-mon[124666]: pgmap v3849: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 246 KiB/s wr, 12 op/s 2023-05-08T05:42:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7104.558723 secs 2023-05-08T05:42:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:46 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:42:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7104.558723 secs 2023-05-08T05:42:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:46 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:42:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7104.558723 secs 2023-05-08T05:42:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:46 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:42:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:47 smithi186 ceph-mon[126480]: pgmap v3850: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 216 KiB/s wr, 9 op/s 2023-05-08T05:42:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:47 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:42:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:47 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:42:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:47 smithi133 ceph-mon[125939]: pgmap v3850: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 216 KiB/s wr, 9 op/s 2023-05-08T05:42:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:47 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:42:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:47 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:42:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:47 smithi096 ceph-mon[124666]: pgmap v3850: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 216 KiB/s wr, 9 op/s 2023-05-08T05:42:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:47 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:42:48.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:47 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:42:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7107.720501 secs 2023-05-08T05:42:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7107.720501 secs 2023-05-08T05:42:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7107.720501 secs 2023-05-08T05:42:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:49 smithi186 ceph-mon[126480]: pgmap v3851: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 216 KiB/s wr, 9 op/s 2023-05-08T05:42:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7108.278380 secs 2023-05-08T05:42:49.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:42:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:49 smithi133 ceph-mon[125939]: pgmap v3851: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 216 KiB/s wr, 9 op/s 2023-05-08T05:42:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7108.278380 secs 2023-05-08T05:42:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:42:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:49 smithi096 ceph-mon[124666]: pgmap v3851: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 216 KiB/s wr, 9 op/s 2023-05-08T05:42:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7108.278380 secs 2023-05-08T05:42:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:42:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:50 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:42:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:50 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:42:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:50 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:42:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:51 smithi186 ceph-mon[126480]: pgmap v3852: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 344 KiB/s wr, 14 op/s 2023-05-08T05:42:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:42:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:42:51.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:42:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:51 smithi133 ceph-mon[125939]: pgmap v3852: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 344 KiB/s wr, 14 op/s 2023-05-08T05:42:51.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:42:51.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:42:51.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:42:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:51 smithi096 ceph-mon[124666]: pgmap v3852: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 344 KiB/s wr, 14 op/s 2023-05-08T05:42:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:42:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:42:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:42:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:42:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:42:53.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:42:53.691 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:53 smithi186 ceph-mon[126480]: pgmap v3853: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 294 KiB/s rd, 172 KiB/s wr, 10 op/s 2023-05-08T05:42:53.691 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7112.720574 secs 2023-05-08T05:42:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:53 smithi133 ceph-mon[125939]: pgmap v3853: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 294 KiB/s rd, 172 KiB/s wr, 10 op/s 2023-05-08T05:42:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7112.720574 secs 2023-05-08T05:42:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:53 smithi096 ceph-mon[124666]: pgmap v3853: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 294 KiB/s rd, 172 KiB/s wr, 10 op/s 2023-05-08T05:42:54.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7112.720574 secs 2023-05-08T05:42:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:54 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:42:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:54 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:42:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:54 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:42:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:55 smithi186 ceph-mon[126480]: pgmap v3854: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 226 KiB/s wr, 15 op/s 2023-05-08T05:42:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:55 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:42:55.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:55 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:42:55.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:55 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:42:55.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:55 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:42:55.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:55 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:42:55.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:55 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:42:55.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:55 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:42:55.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:55 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:42:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:55 smithi133 ceph-mon[125939]: pgmap v3854: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 226 KiB/s wr, 15 op/s 2023-05-08T05:42:55.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:55 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:42:55.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:55 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:42:55.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:55 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:42:55.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:55 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:42:55.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:55 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:42:55.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:55 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:42:55.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:55 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:42:55.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:55 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:42:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:55 smithi096 ceph-mon[124666]: pgmap v3854: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 226 KiB/s wr, 15 op/s 2023-05-08T05:42:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:55 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:42:56.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:55 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:42:56.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:55 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:42:56.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:55 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:42:56.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:55 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:42:56.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:55 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:42:56.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:55 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:42:56.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:55 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:42:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:56 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:42:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:56 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T05:42:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:56 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T05:42:56.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:56 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:42:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:56 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:42:56.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:56 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T05:42:56.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:56 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T05:42:56.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:56 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:42:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:56 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:42:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:56 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T05:42:57.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:56 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T05:42:57.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:56 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:42:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:57 smithi186 ceph-mon[126480]: pgmap v3855: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 182 KiB/s wr, 9 op/s 2023-05-08T05:42:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:57 smithi133 ceph-mon[125939]: pgmap v3855: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 182 KiB/s wr, 9 op/s 2023-05-08T05:42:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:57 smithi096 ceph-mon[124666]: pgmap v3855: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 182 KiB/s wr, 9 op/s 2023-05-08T05:42:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7117.720688 secs 2023-05-08T05:42:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7117.720688 secs 2023-05-08T05:42:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7117.720688 secs 2023-05-08T05:42:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:59 smithi186 ceph-mon[126480]: pgmap v3856: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 182 KiB/s wr, 9 op/s 2023-05-08T05:42:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:42:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7118.278509 secs 2023-05-08T05:42:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:59 smithi133 ceph-mon[125939]: pgmap v3856: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 182 KiB/s wr, 9 op/s 2023-05-08T05:42:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:42:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7118.278509 secs 2023-05-08T05:43:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:59 smithi096 ceph-mon[124666]: pgmap v3856: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 182 KiB/s wr, 9 op/s 2023-05-08T05:43:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:42:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7118.278509 secs 2023-05-08T05:43:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7119.559116 secs 2023-05-08T05:43:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:01 smithi186 ceph-mon[126480]: pgmap v3857: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 303 KiB/s wr, 14 op/s 2023-05-08T05:43:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7119.559116 secs 2023-05-08T05:43:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:01 smithi133 ceph-mon[125939]: pgmap v3857: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 303 KiB/s wr, 14 op/s 2023-05-08T05:43:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7119.559116 secs 2023-05-08T05:43:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:01 smithi096 ceph-mon[124666]: pgmap v3857: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 303 KiB/s wr, 14 op/s 2023-05-08T05:43:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:02 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:43:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:43:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:43:02.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:43:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:02 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:43:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:43:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:43:02.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:43:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:02 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:43:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:43:03.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:43:03.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:43:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:03 smithi186 ceph-mon[126480]: pgmap v3858: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 175 KiB/s wr, 9 op/s 2023-05-08T05:43:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7122.720804 secs 2023-05-08T05:43:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:03 smithi133 ceph-mon[125939]: pgmap v3858: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 175 KiB/s wr, 9 op/s 2023-05-08T05:43:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7122.720804 secs 2023-05-08T05:43:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:03 smithi096 ceph-mon[124666]: pgmap v3858: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 175 KiB/s wr, 9 op/s 2023-05-08T05:43:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7122.720804 secs 2023-05-08T05:43:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7123.278623 secs 2023-05-08T05:43:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:05 smithi133 ceph-mon[125939]: pgmap v3859: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 258 KiB/s wr, 28 op/s 2023-05-08T05:43:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7123.278623 secs 2023-05-08T05:43:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:05 smithi096 ceph-mon[124666]: pgmap v3859: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 258 KiB/s wr, 28 op/s 2023-05-08T05:43:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7123.278623 secs 2023-05-08T05:43:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:05 smithi186 ceph-mon[126480]: pgmap v3859: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 258 KiB/s wr, 28 op/s 2023-05-08T05:43:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7124.559240 secs 2023-05-08T05:43:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7124.559240 secs 2023-05-08T05:43:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7124.559240 secs 2023-05-08T05:43:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:07 smithi133 ceph-mon[125939]: pgmap v3860: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 204 KiB/s wr, 23 op/s 2023-05-08T05:43:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:07 smithi096 ceph-mon[124666]: pgmap v3860: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 204 KiB/s wr, 23 op/s 2023-05-08T05:43:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:07 smithi186 ceph-mon[126480]: pgmap v3860: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 204 KiB/s wr, 23 op/s 2023-05-08T05:43:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7127.720949 secs 2023-05-08T05:43:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7127.720949 secs 2023-05-08T05:43:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7127.720949 secs 2023-05-08T05:43:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:09 smithi133 ceph-mon[125939]: pgmap v3861: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 204 KiB/s wr, 23 op/s 2023-05-08T05:43:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:09 smithi096 ceph-mon[124666]: pgmap v3861: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 204 KiB/s wr, 23 op/s 2023-05-08T05:43:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:09 smithi186 ceph-mon[126480]: pgmap v3861: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 204 KiB/s wr, 23 op/s 2023-05-08T05:43:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7128.278722 secs 2023-05-08T05:43:10.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7128.278722 secs 2023-05-08T05:43:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7128.278722 secs 2023-05-08T05:43:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7129.559385 secs 2023-05-08T05:43:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:11 smithi133 ceph-mon[125939]: pgmap v3862: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 229 KiB/s wr, 26 op/s 2023-05-08T05:43:11.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:11 smithi133 ceph-mon[125939]: osdmap e320: 12 total, 12 up, 12 in 2023-05-08T05:43:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7129.559385 secs 2023-05-08T05:43:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:11 smithi096 ceph-mon[124666]: pgmap v3862: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 229 KiB/s wr, 26 op/s 2023-05-08T05:43:11.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:11 smithi096 ceph-mon[124666]: osdmap e320: 12 total, 12 up, 12 in 2023-05-08T05:43:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7129.559385 secs 2023-05-08T05:43:11.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:11 smithi186 ceph-mon[126480]: pgmap v3862: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 229 KiB/s wr, 26 op/s 2023-05-08T05:43:11.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:11 smithi186 ceph-mon[126480]: osdmap e320: 12 total, 12 up, 12 in 2023-05-08T05:43:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:13 smithi133 ceph-mon[125939]: pgmap v3864: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 130 KiB/s wr, 26 op/s 2023-05-08T05:43:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7132.721067 secs 2023-05-08T05:43:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:13 smithi096 ceph-mon[124666]: pgmap v3864: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 130 KiB/s wr, 26 op/s 2023-05-08T05:43:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7132.721067 secs 2023-05-08T05:43:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:13 smithi186 ceph-mon[126480]: pgmap v3864: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 130 KiB/s wr, 26 op/s 2023-05-08T05:43:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7132.721067 secs 2023-05-08T05:43:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7133.278849 secs 2023-05-08T05:43:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:15 smithi133 ceph-mon[125939]: pgmap v3865: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 33 KiB/s wr, 8 op/s 2023-05-08T05:43:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7133.278849 secs 2023-05-08T05:43:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:15 smithi096 ceph-mon[124666]: pgmap v3865: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 33 KiB/s wr, 8 op/s 2023-05-08T05:43:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7133.278849 secs 2023-05-08T05:43:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:15 smithi186 ceph-mon[126480]: pgmap v3865: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 33 KiB/s wr, 8 op/s 2023-05-08T05:43:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7134.559535 secs 2023-05-08T05:43:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7134.559535 secs 2023-05-08T05:43:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7134.559535 secs 2023-05-08T05:43:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:17 smithi133 ceph-mon[125939]: pgmap v3866: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 33 KiB/s wr, 8 op/s 2023-05-08T05:43:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:17 smithi096 ceph-mon[124666]: pgmap v3866: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 33 KiB/s wr, 8 op/s 2023-05-08T05:43:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:17 smithi186 ceph-mon[126480]: pgmap v3866: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 33 KiB/s wr, 8 op/s 2023-05-08T05:43:18.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7137.721198 secs 2023-05-08T05:43:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7137.721198 secs 2023-05-08T05:43:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7137.721198 secs 2023-05-08T05:43:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:19 smithi133 ceph-mon[125939]: pgmap v3867: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 33 KiB/s wr, 8 op/s 2023-05-08T05:43:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:19 smithi133 ceph-mon[125939]: osdmap e321: 12 total, 12 up, 12 in 2023-05-08T05:43:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:19 smithi096 ceph-mon[124666]: pgmap v3867: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 33 KiB/s wr, 8 op/s 2023-05-08T05:43:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:19 smithi096 ceph-mon[124666]: osdmap e321: 12 total, 12 up, 12 in 2023-05-08T05:43:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:19 smithi186 ceph-mon[126480]: pgmap v3867: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 33 KiB/s wr, 8 op/s 2023-05-08T05:43:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:19 smithi186 ceph-mon[126480]: osdmap e321: 12 total, 12 up, 12 in 2023-05-08T05:43:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7138.278969 secs 2023-05-08T05:43:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7138.278969 secs 2023-05-08T05:43:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7138.278969 secs 2023-05-08T05:43:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7139.559665 secs 2023-05-08T05:43:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:21 smithi133 ceph-mon[125939]: pgmap v3869: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 51 KiB/s wr, 8 op/s 2023-05-08T05:43:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7139.559665 secs 2023-05-08T05:43:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:21 smithi096 ceph-mon[124666]: pgmap v3869: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 51 KiB/s wr, 8 op/s 2023-05-08T05:43:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7139.559665 secs 2023-05-08T05:43:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:21 smithi186 ceph-mon[126480]: pgmap v3869: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 51 KiB/s wr, 8 op/s 2023-05-08T05:43:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:23 smithi133 ceph-mon[125939]: pgmap v3870: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 50 KiB/s wr, 8 op/s 2023-05-08T05:43:23.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7142.721321 secs 2023-05-08T05:43:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:23 smithi096 ceph-mon[124666]: pgmap v3870: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 50 KiB/s wr, 8 op/s 2023-05-08T05:43:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7142.721321 secs 2023-05-08T05:43:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:23 smithi186 ceph-mon[126480]: pgmap v3870: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 50 KiB/s wr, 8 op/s 2023-05-08T05:43:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7142.721321 secs 2023-05-08T05:43:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7143.279090 secs 2023-05-08T05:43:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:25 smithi096 ceph-mon[124666]: pgmap v3871: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 47 KiB/s wr, 9 op/s 2023-05-08T05:43:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7143.279090 secs 2023-05-08T05:43:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:25 smithi186 ceph-mon[126480]: pgmap v3871: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 47 KiB/s wr, 9 op/s 2023-05-08T05:43:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7143.279090 secs 2023-05-08T05:43:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:25 smithi133 ceph-mon[125939]: pgmap v3871: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 47 KiB/s wr, 9 op/s 2023-05-08T05:43:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7144.559833 secs 2023-05-08T05:43:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7144.559833 secs 2023-05-08T05:43:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7144.559833 secs 2023-05-08T05:43:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:27 smithi096 ceph-mon[124666]: pgmap v3872: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 47 KiB/s wr, 9 op/s 2023-05-08T05:43:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:27 smithi186 ceph-mon[126480]: pgmap v3872: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 47 KiB/s wr, 9 op/s 2023-05-08T05:43:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:27 smithi133 ceph-mon[125939]: pgmap v3872: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 47 KiB/s wr, 9 op/s 2023-05-08T05:43:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7147.721453 secs 2023-05-08T05:43:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7147.721453 secs 2023-05-08T05:43:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7147.721453 secs 2023-05-08T05:43:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:29 smithi186 ceph-mon[126480]: pgmap v3873: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 47 KiB/s wr, 9 op/s 2023-05-08T05:43:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:29 smithi133 ceph-mon[125939]: pgmap v3873: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 47 KiB/s wr, 9 op/s 2023-05-08T05:43:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:29 smithi096 ceph-mon[124666]: pgmap v3873: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 47 KiB/s wr, 9 op/s 2023-05-08T05:43:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7148.279212 secs 2023-05-08T05:43:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7148.279212 secs 2023-05-08T05:43:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7148.279212 secs 2023-05-08T05:43:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7149.559954 secs 2023-05-08T05:43:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:31 smithi186 ceph-mon[126480]: pgmap v3874: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 79 KiB/s wr, 8 op/s 2023-05-08T05:43:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7149.559954 secs 2023-05-08T05:43:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:31 smithi133 ceph-mon[125939]: pgmap v3874: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 79 KiB/s wr, 8 op/s 2023-05-08T05:43:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7149.559954 secs 2023-05-08T05:43:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:31 smithi096 ceph-mon[124666]: pgmap v3874: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 79 KiB/s wr, 8 op/s 2023-05-08T05:43:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:33 smithi186 ceph-mon[126480]: pgmap v3875: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 70 KiB/s wr, 7 op/s 2023-05-08T05:43:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7152.721572 secs 2023-05-08T05:43:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:33 smithi133 ceph-mon[125939]: pgmap v3875: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 70 KiB/s wr, 7 op/s 2023-05-08T05:43:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7152.721572 secs 2023-05-08T05:43:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:33 smithi096 ceph-mon[124666]: pgmap v3875: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 70 KiB/s wr, 7 op/s 2023-05-08T05:43:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7152.721572 secs 2023-05-08T05:43:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7153.279351 secs 2023-05-08T05:43:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:35 smithi133 ceph-mon[125939]: pgmap v3876: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 72 KiB/s wr, 11 op/s 2023-05-08T05:43:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7153.279351 secs 2023-05-08T05:43:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:35 smithi096 ceph-mon[124666]: pgmap v3876: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 72 KiB/s wr, 11 op/s 2023-05-08T05:43:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7153.279351 secs 2023-05-08T05:43:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:35 smithi186 ceph-mon[126480]: pgmap v3876: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 72 KiB/s wr, 11 op/s 2023-05-08T05:43:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:37 smithi133 ceph-mon[125939]: pgmap v3877: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 71 KiB/s wr, 7 op/s 2023-05-08T05:43:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:37 smithi096 ceph-mon[124666]: pgmap v3877: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 71 KiB/s wr, 7 op/s 2023-05-08T05:43:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:37 smithi186 ceph-mon[126480]: pgmap v3877: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 71 KiB/s wr, 7 op/s 2023-05-08T05:43:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7157.721696 secs 2023-05-08T05:43:38.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:38 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:43:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7157.721696 secs 2023-05-08T05:43:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:38 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:43:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7157.721696 secs 2023-05-08T05:43:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:38 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:43:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:39 smithi133 ceph-mon[125939]: pgmap v3878: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 71 KiB/s wr, 7 op/s 2023-05-08T05:43:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:39 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:43:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:39 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:43:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:39 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:43:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:39 smithi096 ceph-mon[124666]: pgmap v3878: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 71 KiB/s wr, 7 op/s 2023-05-08T05:43:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:39 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:43:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:39 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:43:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:39 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:43:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:39 smithi186 ceph-mon[126480]: pgmap v3878: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 71 KiB/s wr, 7 op/s 2023-05-08T05:43:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:39 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:43:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:39 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:43:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:39 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:43:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7158.279502 secs 2023-05-08T05:43:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7158.279502 secs 2023-05-08T05:43:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7158.279502 secs 2023-05-08T05:43:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7159.560147 secs 2023-05-08T05:43:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:41 smithi133 ceph-mon[125939]: pgmap v3879: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 125 KiB/s wr, 10 op/s 2023-05-08T05:43:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7159.560147 secs 2023-05-08T05:43:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:41 smithi096 ceph-mon[124666]: pgmap v3879: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 125 KiB/s wr, 10 op/s 2023-05-08T05:43:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7159.560147 secs 2023-05-08T05:43:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:41 smithi186 ceph-mon[126480]: pgmap v3879: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 125 KiB/s wr, 10 op/s 2023-05-08T05:43:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:43 smithi133 ceph-mon[125939]: pgmap v3880: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 55 KiB/s wr, 7 op/s 2023-05-08T05:43:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:43:43.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:43:43.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7162.721832 secs 2023-05-08T05:43:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:43 smithi096 ceph-mon[124666]: pgmap v3880: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 55 KiB/s wr, 7 op/s 2023-05-08T05:43:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:43:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:43:43.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7162.721832 secs 2023-05-08T05:43:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:43 smithi186 ceph-mon[126480]: pgmap v3880: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 55 KiB/s wr, 7 op/s 2023-05-08T05:43:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:43:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:43:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7162.721832 secs 2023-05-08T05:43:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:44 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:43:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:44 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:43:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:44 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:43:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:45 smithi133 ceph-mon[125939]: pgmap v3881: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 166 KiB/s wr, 11 op/s 2023-05-08T05:43:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:45 smithi096 ceph-mon[124666]: pgmap v3881: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 166 KiB/s wr, 11 op/s 2023-05-08T05:43:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:45 smithi186 ceph-mon[126480]: pgmap v3881: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 166 KiB/s wr, 11 op/s 2023-05-08T05:43:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7164.560277 secs 2023-05-08T05:43:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:46 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:43:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7164.560277 secs 2023-05-08T05:43:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:46 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:43:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7164.560277 secs 2023-05-08T05:43:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:46 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:43:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:47 smithi133 ceph-mon[125939]: pgmap v3882: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 165 KiB/s wr, 7 op/s 2023-05-08T05:43:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:47 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:43:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:47 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:43:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:47 smithi096 ceph-mon[124666]: pgmap v3882: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 165 KiB/s wr, 7 op/s 2023-05-08T05:43:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:47 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:43:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:47 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:43:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:47 smithi186 ceph-mon[126480]: pgmap v3882: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 165 KiB/s wr, 7 op/s 2023-05-08T05:43:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:47 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:43:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:47 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:43:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7167.721961 secs 2023-05-08T05:43:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7167.721961 secs 2023-05-08T05:43:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7167.721961 secs 2023-05-08T05:43:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:49 smithi133 ceph-mon[125939]: pgmap v3883: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 165 KiB/s wr, 7 op/s 2023-05-08T05:43:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:43:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:49 smithi096 ceph-mon[124666]: pgmap v3883: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 165 KiB/s wr, 7 op/s 2023-05-08T05:43:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:43:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:49 smithi186 ceph-mon[126480]: pgmap v3883: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 165 KiB/s wr, 7 op/s 2023-05-08T05:43:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:43:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7169.560418 secs 2023-05-08T05:43:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:51 smithi133 ceph-mon[125939]: pgmap v3884: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 353 KiB/s rd, 278 KiB/s wr, 13 op/s 2023-05-08T05:43:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7169.560418 secs 2023-05-08T05:43:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:51 smithi096 ceph-mon[124666]: pgmap v3884: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 353 KiB/s rd, 278 KiB/s wr, 13 op/s 2023-05-08T05:43:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7169.560418 secs 2023-05-08T05:43:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:51 smithi186 ceph-mon[126480]: pgmap v3884: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 353 KiB/s rd, 278 KiB/s wr, 13 op/s 2023-05-08T05:43:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:53 smithi133 ceph-mon[125939]: pgmap v3885: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 225 KiB/s wr, 10 op/s 2023-05-08T05:43:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7172.722091 secs 2023-05-08T05:43:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:53 smithi096 ceph-mon[124666]: pgmap v3885: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 225 KiB/s wr, 10 op/s 2023-05-08T05:43:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7172.722091 secs 2023-05-08T05:43:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:53 smithi186 ceph-mon[126480]: pgmap v3885: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 225 KiB/s wr, 10 op/s 2023-05-08T05:43:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7172.722091 secs 2023-05-08T05:43:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7173.279861 secs 2023-05-08T05:43:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:55 smithi133 ceph-mon[125939]: pgmap v3886: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 275 KiB/s wr, 14 op/s 2023-05-08T05:43:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:55 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:43:55.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:55 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:43:55.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:55 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:43:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7173.279861 secs 2023-05-08T05:43:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:55 smithi096 ceph-mon[124666]: pgmap v3886: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 275 KiB/s wr, 14 op/s 2023-05-08T05:43:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:55 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:43:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:55 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:43:55.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:55 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:43:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7173.279861 secs 2023-05-08T05:43:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:55 smithi186 ceph-mon[126480]: pgmap v3886: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 275 KiB/s wr, 14 op/s 2023-05-08T05:43:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:55 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:43:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:55 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:43:55.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:55 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:43:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7174.560545 secs 2023-05-08T05:43:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:43:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:43:56.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:43:56.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:43:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7174.560545 secs 2023-05-08T05:43:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:43:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:43:56.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:43:56.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:43:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7174.560545 secs 2023-05-08T05:43:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:43:56.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:43:56.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:43:56.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:43:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:57 smithi133 ceph-mon[125939]: pgmap v3887: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 163 KiB/s wr, 10 op/s 2023-05-08T05:43:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:57 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:43:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:57 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T05:43:57.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:57 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T05:43:57.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:57 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:43:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:57 smithi096 ceph-mon[124666]: pgmap v3887: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 163 KiB/s wr, 10 op/s 2023-05-08T05:43:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:57 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:43:57.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:57 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T05:43:57.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:57 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T05:43:57.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:57 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:43:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:57 smithi186 ceph-mon[126480]: pgmap v3887: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 163 KiB/s wr, 10 op/s 2023-05-08T05:43:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:57 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:43:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:57 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T05:43:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:57 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T05:43:57.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:57 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:43:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7177.722163 secs 2023-05-08T05:43:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7177.722163 secs 2023-05-08T05:43:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7177.722163 secs 2023-05-08T05:43:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:43:59 smithi133 ceph-mon[125939]: pgmap v3888: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 163 KiB/s wr, 10 op/s 2023-05-08T05:43:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:43:59 smithi096 ceph-mon[124666]: pgmap v3888: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 163 KiB/s wr, 10 op/s 2023-05-08T05:43:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:43:59 smithi186 ceph-mon[126480]: pgmap v3888: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 163 KiB/s wr, 10 op/s 2023-05-08T05:44:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7179.560666 secs 2023-05-08T05:44:01.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:01 smithi133 ceph-mon[125939]: pgmap v3889: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 340 KiB/s wr, 14 op/s 2023-05-08T05:44:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7179.560666 secs 2023-05-08T05:44:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:01 smithi096 ceph-mon[124666]: pgmap v3889: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 340 KiB/s wr, 14 op/s 2023-05-08T05:44:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7179.560666 secs 2023-05-08T05:44:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:01 smithi186 ceph-mon[126480]: pgmap v3889: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 340 KiB/s wr, 14 op/s 2023-05-08T05:44:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:02 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:44:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:02 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:44:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:02 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:44:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:03 smithi133 ceph-mon[125939]: pgmap v3890: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 226 KiB/s wr, 9 op/s 2023-05-08T05:44:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:03 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:44:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:44:03.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:03 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:44:03.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7182.722270 secs 2023-05-08T05:44:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:03 smithi096 ceph-mon[124666]: pgmap v3890: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 226 KiB/s wr, 9 op/s 2023-05-08T05:44:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:03 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:44:03.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:44:03.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:03 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:44:03.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7182.722270 secs 2023-05-08T05:44:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:03 smithi186 ceph-mon[126480]: pgmap v3890: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 226 KiB/s wr, 9 op/s 2023-05-08T05:44:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:03 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:44:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:44:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:03 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:44:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7182.722270 secs 2023-05-08T05:44:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7183.280090 secs 2023-05-08T05:44:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:05 smithi133 ceph-mon[125939]: pgmap v3891: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 309 KiB/s wr, 28 op/s 2023-05-08T05:44:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7183.280090 secs 2023-05-08T05:44:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:05 smithi096 ceph-mon[124666]: pgmap v3891: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 309 KiB/s wr, 28 op/s 2023-05-08T05:44:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7183.280090 secs 2023-05-08T05:44:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:05 smithi186 ceph-mon[126480]: pgmap v3891: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 309 KiB/s wr, 28 op/s 2023-05-08T05:44:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7184.560810 secs 2023-05-08T05:44:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7184.560810 secs 2023-05-08T05:44:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7184.560810 secs 2023-05-08T05:44:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:07 smithi133 ceph-mon[125939]: pgmap v3892: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 259 KiB/s wr, 23 op/s 2023-05-08T05:44:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:07 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:44:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:07 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:44:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:07 smithi096 ceph-mon[124666]: pgmap v3892: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 259 KiB/s wr, 23 op/s 2023-05-08T05:44:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:07 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:44:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:07 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:44:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:07 smithi186 ceph-mon[126480]: pgmap v3892: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 259 KiB/s wr, 23 op/s 2023-05-08T05:44:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:07 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:44:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:07 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:44:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7187.722375 secs 2023-05-08T05:44:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7187.722375 secs 2023-05-08T05:44:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7187.722375 secs 2023-05-08T05:44:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:09 smithi133 ceph-mon[125939]: pgmap v3893: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 259 KiB/s wr, 23 op/s 2023-05-08T05:44:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:09 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:44:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:09 smithi096 ceph-mon[124666]: pgmap v3893: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 259 KiB/s wr, 23 op/s 2023-05-08T05:44:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:09 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:44:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:09 smithi186 ceph-mon[126480]: pgmap v3893: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 259 KiB/s wr, 23 op/s 2023-05-08T05:44:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:09 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:44:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7188.280226 secs 2023-05-08T05:44:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7188.280226 secs 2023-05-08T05:44:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7188.280226 secs 2023-05-08T05:44:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7189.560877 secs 2023-05-08T05:44:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:11 smithi133 ceph-mon[125939]: pgmap v3894: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 285 KiB/s wr, 27 op/s 2023-05-08T05:44:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:11 smithi133 ceph-mon[125939]: osdmap e322: 12 total, 12 up, 12 in 2023-05-08T05:44:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7189.560877 secs 2023-05-08T05:44:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:11 smithi096 ceph-mon[124666]: pgmap v3894: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 285 KiB/s wr, 27 op/s 2023-05-08T05:44:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:11 smithi096 ceph-mon[124666]: osdmap e322: 12 total, 12 up, 12 in 2023-05-08T05:44:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7189.560877 secs 2023-05-08T05:44:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:11 smithi186 ceph-mon[126480]: pgmap v3894: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 285 KiB/s wr, 27 op/s 2023-05-08T05:44:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:11 smithi186 ceph-mon[126480]: osdmap e322: 12 total, 12 up, 12 in 2023-05-08T05:44:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:13 smithi133 ceph-mon[125939]: pgmap v3896: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 130 KiB/s wr, 27 op/s 2023-05-08T05:44:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7192.722490 secs 2023-05-08T05:44:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:13 smithi096 ceph-mon[124666]: pgmap v3896: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 130 KiB/s wr, 27 op/s 2023-05-08T05:44:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7192.722490 secs 2023-05-08T05:44:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:13 smithi186 ceph-mon[126480]: pgmap v3896: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 130 KiB/s wr, 27 op/s 2023-05-08T05:44:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7192.722490 secs 2023-05-08T05:44:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7193.280332 secs 2023-05-08T05:44:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:15 smithi096 ceph-mon[124666]: pgmap v3897: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 33 KiB/s wr, 8 op/s 2023-05-08T05:44:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7193.280332 secs 2023-05-08T05:44:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:15 smithi186 ceph-mon[126480]: pgmap v3897: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 33 KiB/s wr, 8 op/s 2023-05-08T05:44:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7193.280332 secs 2023-05-08T05:44:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:15 smithi133 ceph-mon[125939]: pgmap v3897: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 33 KiB/s wr, 8 op/s 2023-05-08T05:44:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7194.560992 secs 2023-05-08T05:44:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7194.560992 secs 2023-05-08T05:44:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7194.560992 secs 2023-05-08T05:44:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:17 smithi096 ceph-mon[124666]: pgmap v3898: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 33 KiB/s wr, 8 op/s 2023-05-08T05:44:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:17 smithi186 ceph-mon[126480]: pgmap v3898: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 33 KiB/s wr, 8 op/s 2023-05-08T05:44:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:17 smithi133 ceph-mon[125939]: pgmap v3898: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 33 KiB/s wr, 8 op/s 2023-05-08T05:44:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7197.722617 secs 2023-05-08T05:44:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7197.722617 secs 2023-05-08T05:44:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7197.722617 secs 2023-05-08T05:44:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:19 smithi186 ceph-mon[126480]: pgmap v3899: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 33 KiB/s wr, 8 op/s 2023-05-08T05:44:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:19 smithi186 ceph-mon[126480]: osdmap e323: 12 total, 12 up, 12 in 2023-05-08T05:44:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:19 smithi133 ceph-mon[125939]: pgmap v3899: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 33 KiB/s wr, 8 op/s 2023-05-08T05:44:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:19 smithi133 ceph-mon[125939]: osdmap e323: 12 total, 12 up, 12 in 2023-05-08T05:44:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:19 smithi096 ceph-mon[124666]: pgmap v3899: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 33 KiB/s wr, 8 op/s 2023-05-08T05:44:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:19 smithi096 ceph-mon[124666]: osdmap e323: 12 total, 12 up, 12 in 2023-05-08T05:44:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7198.280482 secs 2023-05-08T05:44:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7198.280482 secs 2023-05-08T05:44:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7198.280482 secs 2023-05-08T05:44:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7199.561068 secs 2023-05-08T05:44:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:21 smithi186 ceph-mon[126480]: pgmap v3901: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 3.5 KiB/s wr, 8 op/s 2023-05-08T05:44:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7199.561068 secs 2023-05-08T05:44:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:21 smithi133 ceph-mon[125939]: pgmap v3901: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 3.5 KiB/s wr, 8 op/s 2023-05-08T05:44:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7199.561068 secs 2023-05-08T05:44:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:21 smithi096 ceph-mon[124666]: pgmap v3901: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 3.5 KiB/s wr, 8 op/s 2023-05-08T05:44:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:23 smithi186 ceph-mon[126480]: pgmap v3902: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 3.4 KiB/s wr, 7 op/s 2023-05-08T05:44:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7202.722715 secs 2023-05-08T05:44:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:23 smithi133 ceph-mon[125939]: pgmap v3902: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 3.4 KiB/s wr, 7 op/s 2023-05-08T05:44:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7202.722715 secs 2023-05-08T05:44:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:23 smithi096 ceph-mon[124666]: pgmap v3902: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 3.4 KiB/s wr, 7 op/s 2023-05-08T05:44:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7202.722715 secs 2023-05-08T05:44:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7203.280583 secs 2023-05-08T05:44:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:25 smithi186 ceph-mon[126480]: pgmap v3903: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 48 KiB/s wr, 7 op/s 2023-05-08T05:44:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7203.280583 secs 2023-05-08T05:44:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:25 smithi133 ceph-mon[125939]: pgmap v3903: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 48 KiB/s wr, 7 op/s 2023-05-08T05:44:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7203.280583 secs 2023-05-08T05:44:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:25 smithi096 ceph-mon[124666]: pgmap v3903: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 48 KiB/s wr, 7 op/s 2023-05-08T05:44:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7204.561172 secs 2023-05-08T05:44:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7204.561172 secs 2023-05-08T05:44:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7204.561172 secs 2023-05-08T05:44:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:27 smithi186 ceph-mon[126480]: pgmap v3904: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 48 KiB/s wr, 7 op/s 2023-05-08T05:44:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:27 smithi133 ceph-mon[125939]: pgmap v3904: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 48 KiB/s wr, 7 op/s 2023-05-08T05:44:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:27 smithi096 ceph-mon[124666]: pgmap v3904: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 48 KiB/s wr, 7 op/s 2023-05-08T05:44:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7207.722801 secs 2023-05-08T05:44:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7207.722801 secs 2023-05-08T05:44:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7207.722801 secs 2023-05-08T05:44:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:29 smithi186 ceph-mon[126480]: pgmap v3905: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 48 KiB/s wr, 7 op/s 2023-05-08T05:44:29.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7208.280705 secs 2023-05-08T05:44:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:29 smithi133 ceph-mon[125939]: pgmap v3905: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 48 KiB/s wr, 7 op/s 2023-05-08T05:44:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7208.280705 secs 2023-05-08T05:44:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:29 smithi096 ceph-mon[124666]: pgmap v3905: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 48 KiB/s wr, 7 op/s 2023-05-08T05:44:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7208.280705 secs 2023-05-08T05:44:31.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7209.561289 secs 2023-05-08T05:44:31.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:31 smithi186 ceph-mon[126480]: pgmap v3906: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 81 KiB/s wr, 7 op/s 2023-05-08T05:44:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7209.561289 secs 2023-05-08T05:44:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:31 smithi133 ceph-mon[125939]: pgmap v3906: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 81 KiB/s wr, 7 op/s 2023-05-08T05:44:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7209.561289 secs 2023-05-08T05:44:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:31 smithi096 ceph-mon[124666]: pgmap v3906: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 81 KiB/s wr, 7 op/s 2023-05-08T05:44:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:33 smithi186 ceph-mon[126480]: pgmap v3907: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 73 KiB/s wr, 6 op/s 2023-05-08T05:44:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7212.722943 secs 2023-05-08T05:44:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:33 smithi133 ceph-mon[125939]: pgmap v3907: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 73 KiB/s wr, 6 op/s 2023-05-08T05:44:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7212.722943 secs 2023-05-08T05:44:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:33 smithi096 ceph-mon[124666]: pgmap v3907: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 73 KiB/s wr, 6 op/s 2023-05-08T05:44:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7212.722943 secs 2023-05-08T05:44:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7213.280807 secs 2023-05-08T05:44:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:35 smithi133 ceph-mon[125939]: pgmap v3908: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 153 KiB/s wr, 9 op/s 2023-05-08T05:44:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7213.280807 secs 2023-05-08T05:44:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:35 smithi096 ceph-mon[124666]: pgmap v3908: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 153 KiB/s wr, 9 op/s 2023-05-08T05:44:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7213.280807 secs 2023-05-08T05:44:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:35 smithi186 ceph-mon[126480]: pgmap v3908: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 153 KiB/s wr, 9 op/s 2023-05-08T05:44:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:37 smithi133 ceph-mon[125939]: pgmap v3909: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 114 KiB/s wr, 7 op/s 2023-05-08T05:44:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:37 smithi096 ceph-mon[124666]: pgmap v3909: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 114 KiB/s wr, 7 op/s 2023-05-08T05:44:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:37 smithi186 ceph-mon[126480]: pgmap v3909: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 114 KiB/s wr, 7 op/s 2023-05-08T05:44:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7217.723064 secs 2023-05-08T05:44:38.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:38 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:44:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7217.723064 secs 2023-05-08T05:44:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:38 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:44:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7217.723064 secs 2023-05-08T05:44:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:38 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:44:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:39 smithi133 ceph-mon[125939]: pgmap v3910: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 114 KiB/s wr, 7 op/s 2023-05-08T05:44:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:39 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:44:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:39 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:44:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:39 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:44:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:39 smithi096 ceph-mon[124666]: pgmap v3910: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 114 KiB/s wr, 7 op/s 2023-05-08T05:44:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:39 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:44:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:39 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:44:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:39 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:44:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:39 smithi186 ceph-mon[126480]: pgmap v3910: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 114 KiB/s wr, 7 op/s 2023-05-08T05:44:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:39 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:44:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:39 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:44:39.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:39 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:44:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:41 smithi133 ceph-mon[125939]: pgmap v3911: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 208 KiB/s wr, 11 op/s 2023-05-08T05:44:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:41 smithi096 ceph-mon[124666]: pgmap v3911: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 208 KiB/s wr, 11 op/s 2023-05-08T05:44:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:41 smithi186 ceph-mon[126480]: pgmap v3911: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 208 KiB/s wr, 11 op/s 2023-05-08T05:44:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:44:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:44:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:44:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:43 smithi133 ceph-mon[125939]: pgmap v3912: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 175 KiB/s wr, 7 op/s 2023-05-08T05:44:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:44:43.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:44:43.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7222.723172 secs 2023-05-08T05:44:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:43 smithi096 ceph-mon[124666]: pgmap v3912: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 175 KiB/s wr, 7 op/s 2023-05-08T05:44:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:44:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:44:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7222.723172 secs 2023-05-08T05:44:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:43 smithi186 ceph-mon[126480]: pgmap v3912: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 175 KiB/s wr, 7 op/s 2023-05-08T05:44:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:44:43.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:44:43.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7222.723172 secs 2023-05-08T05:44:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:44 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:44:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:44 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:44:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:44 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:44:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:45 smithi133 ceph-mon[125939]: pgmap v3913: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 350 KiB/s wr, 12 op/s 2023-05-08T05:44:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:45 smithi096 ceph-mon[124666]: pgmap v3913: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 350 KiB/s wr, 12 op/s 2023-05-08T05:44:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:45 smithi186 ceph-mon[126480]: pgmap v3913: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 350 KiB/s wr, 12 op/s 2023-05-08T05:44:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7224.561589 secs 2023-05-08T05:44:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7224.561589 secs 2023-05-08T05:44:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7224.561589 secs 2023-05-08T05:44:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:47 smithi133 ceph-mon[125939]: pgmap v3914: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 270 KiB/s wr, 9 op/s 2023-05-08T05:44:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:47 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:44:47.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:47 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:44:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:47 smithi096 ceph-mon[124666]: pgmap v3914: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 270 KiB/s wr, 9 op/s 2023-05-08T05:44:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:47 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:44:47.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:47 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:44:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:47 smithi186 ceph-mon[126480]: pgmap v3914: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 270 KiB/s wr, 9 op/s 2023-05-08T05:44:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:47 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:44:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:47 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:44:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7227.723288 secs 2023-05-08T05:44:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7227.723288 secs 2023-05-08T05:44:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7227.723288 secs 2023-05-08T05:44:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:49 smithi133 ceph-mon[125939]: pgmap v3915: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 270 KiB/s wr, 9 op/s 2023-05-08T05:44:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:44:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:49 smithi096 ceph-mon[124666]: pgmap v3915: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 270 KiB/s wr, 9 op/s 2023-05-08T05:44:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:44:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:49 smithi186 ceph-mon[126480]: pgmap v3915: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 270 KiB/s wr, 9 op/s 2023-05-08T05:44:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:44:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7228.281124 secs 2023-05-08T05:44:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7228.281124 secs 2023-05-08T05:44:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7228.281124 secs 2023-05-08T05:44:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7229.561704 secs 2023-05-08T05:44:51.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:51 smithi096 ceph-mon[124666]: pgmap v3916: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 320 KiB/s wr, 14 op/s 2023-05-08T05:44:51.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:44:51.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:44:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7229.561704 secs 2023-05-08T05:44:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:51 smithi186 ceph-mon[126480]: pgmap v3916: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 320 KiB/s wr, 14 op/s 2023-05-08T05:44:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:44:51.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:44:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7229.561704 secs 2023-05-08T05:44:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:51 smithi133 ceph-mon[125939]: pgmap v3916: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 320 KiB/s wr, 14 op/s 2023-05-08T05:44:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:44:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:44:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:53 smithi096 ceph-mon[124666]: pgmap v3917: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 226 KiB/s wr, 9 op/s 2023-05-08T05:44:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7232.723433 secs 2023-05-08T05:44:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:53 smithi186 ceph-mon[126480]: pgmap v3917: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 226 KiB/s wr, 9 op/s 2023-05-08T05:44:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7232.723433 secs 2023-05-08T05:44:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:53 smithi133 ceph-mon[125939]: pgmap v3917: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 226 KiB/s wr, 9 op/s 2023-05-08T05:44:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7232.723433 secs 2023-05-08T05:44:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:54 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:44:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:54 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:44:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:54 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:44:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:54 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:44:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:54 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:44:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:54 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:44:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:55 smithi096 ceph-mon[124666]: pgmap v3918: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 493 KiB/s wr, 14 op/s 2023-05-08T05:44:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:55 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:44:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:55 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:44:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:55 smithi186 ceph-mon[126480]: pgmap v3918: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 493 KiB/s wr, 14 op/s 2023-05-08T05:44:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:55 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:44:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:55 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:44:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:55 smithi133 ceph-mon[125939]: pgmap v3918: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 493 KiB/s wr, 14 op/s 2023-05-08T05:44:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:55 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:44:55.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:55 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:44:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7234.561822 secs 2023-05-08T05:44:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:44:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7234.561822 secs 2023-05-08T05:44:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:44:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7234.561822 secs 2023-05-08T05:44:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:44:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:57 smithi186 ceph-mon[126480]: pgmap v3919: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 317 KiB/s wr, 9 op/s 2023-05-08T05:44:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:57 smithi133 ceph-mon[125939]: pgmap v3919: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 317 KiB/s wr, 9 op/s 2023-05-08T05:44:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:57 smithi096 ceph-mon[124666]: pgmap v3919: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 317 KiB/s wr, 9 op/s 2023-05-08T05:44:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7237.723545 secs 2023-05-08T05:44:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7237.723545 secs 2023-05-08T05:44:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7237.723545 secs 2023-05-08T05:44:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:59 smithi186 ceph-mon[126480]: pgmap v3920: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 317 KiB/s wr, 9 op/s 2023-05-08T05:44:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:44:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:44:59.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:44:59.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:44:59.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:44:59.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:44:59.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:44:59 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:44:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:59 smithi133 ceph-mon[125939]: pgmap v3920: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 317 KiB/s wr, 9 op/s 2023-05-08T05:44:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:44:59.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:44:59.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:44:59.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:44:59.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:44:59.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:44:59.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:44:59 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:45:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:59 smithi096 ceph-mon[124666]: pgmap v3920: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 317 KiB/s wr, 9 op/s 2023-05-08T05:45:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:45:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:45:00.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:45:00.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:45:00.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:45:00.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:45:00.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:44:59 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:45:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7238.281380 secs 2023-05-08T05:45:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:45:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:45:00.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:45:00.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:45:00.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:45:00.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:45:00.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:45:00.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:45:00.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:45:00.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:45:00.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:45:00.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:45:00.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:45:00.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:45:00.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:45:00.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:45:00.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:45:00.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:45:00.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:45:00.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:45:00.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:45:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7238.281380 secs 2023-05-08T05:45:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:45:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:45:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:45:00.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:45:00.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:45:00.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:45:00.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:45:00.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:45:00.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:45:00.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:45:00.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:45:00.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:45:00.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:45:00.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:45:00.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:45:00.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:45:00.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:45:00.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:45:00.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:45:00.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:45:00.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:45:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7238.281380 secs 2023-05-08T05:45:01.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:45:01.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:45:01.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:45:01.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:45:01.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:45:01.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:45:01.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:45:01.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:45:01.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:45:01.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:45:01.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:45:01.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:45:01.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:45:01.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:45:01.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:45:01.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:45:01.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:45:01.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:45:01.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:45:01.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:45:01.009 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:45:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7239.561890 secs 2023-05-08T05:45:01.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:01 smithi186 ceph-mon[126480]: pgmap v3921: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 354 KiB/s wr, 13 op/s 2023-05-08T05:45:01.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:01 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T05:45:01.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:01 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T05:45:01.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:01 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi096 to 196.2M 2023-05-08T05:45:01.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:01 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi096 to 205766758: error parsing value: Value '205766758' is below minimum 939524096 2023-05-08T05:45:01.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:01 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T05:45:01.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:01 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T05:45:01.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:01 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:45:01.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:01 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T05:45:01.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:01 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T05:45:01.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:01 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:45:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7239.561890 secs 2023-05-08T05:45:01.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:01 smithi133 ceph-mon[125939]: pgmap v3921: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 354 KiB/s wr, 13 op/s 2023-05-08T05:45:01.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:01 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T05:45:01.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:01 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T05:45:01.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:01 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi096 to 196.2M 2023-05-08T05:45:01.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:01 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi096 to 205766758: error parsing value: Value '205766758' is below minimum 939524096 2023-05-08T05:45:01.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:01 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T05:45:01.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:01 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T05:45:01.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:01 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:45:01.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:01 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T05:45:01.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:01 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T05:45:01.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:01 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:45:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7239.561890 secs 2023-05-08T05:45:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:01 smithi096 ceph-mon[124666]: pgmap v3921: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 354 KiB/s wr, 13 op/s 2023-05-08T05:45:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:01 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T05:45:02.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:01 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T05:45:02.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:01 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi096 to 196.2M 2023-05-08T05:45:02.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:01 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi096 to 205766758: error parsing value: Value '205766758' is below minimum 939524096 2023-05-08T05:45:02.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:01 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T05:45:02.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:01 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T05:45:02.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:01 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:45:02.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:01 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T05:45:02.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:01 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T05:45:02.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:01 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:45:03.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:03 smithi186 ceph-mon[126480]: pgmap v3922: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 304 KiB/s wr, 8 op/s 2023-05-08T05:45:03.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:45:03.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:03 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:45:03.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7242.723654 secs 2023-05-08T05:45:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:03 smithi133 ceph-mon[125939]: pgmap v3922: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 304 KiB/s wr, 8 op/s 2023-05-08T05:45:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:45:03.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:03 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:45:03.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7242.723654 secs 2023-05-08T05:45:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:03 smithi096 ceph-mon[124666]: pgmap v3922: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 304 KiB/s wr, 8 op/s 2023-05-08T05:45:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:45:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:03 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:45:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7242.723654 secs 2023-05-08T05:45:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:04 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:45:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:04 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:45:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:04 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:45:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7243.281484 secs 2023-05-08T05:45:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:05 smithi186 ceph-mon[126480]: pgmap v3923: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 376 KiB/s wr, 26 op/s 2023-05-08T05:45:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7243.281484 secs 2023-05-08T05:45:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:05 smithi133 ceph-mon[125939]: pgmap v3923: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 376 KiB/s wr, 26 op/s 2023-05-08T05:45:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7243.281484 secs 2023-05-08T05:45:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:05 smithi096 ceph-mon[124666]: pgmap v3923: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 376 KiB/s wr, 26 op/s 2023-05-08T05:45:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7244.561994 secs 2023-05-08T05:45:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7244.561994 secs 2023-05-08T05:45:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7244.561994 secs 2023-05-08T05:45:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:07 smithi186 ceph-mon[126480]: pgmap v3924: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 108 KiB/s wr, 22 op/s 2023-05-08T05:45:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:07 smithi133 ceph-mon[125939]: pgmap v3924: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 108 KiB/s wr, 22 op/s 2023-05-08T05:45:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:07 smithi096 ceph-mon[124666]: pgmap v3924: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 108 KiB/s wr, 22 op/s 2023-05-08T05:45:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7247.723734 secs 2023-05-08T05:45:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7247.723734 secs 2023-05-08T05:45:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7247.723734 secs 2023-05-08T05:45:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:09 smithi186 ceph-mon[126480]: pgmap v3925: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 108 KiB/s wr, 22 op/s 2023-05-08T05:45:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7248.281549 secs 2023-05-08T05:45:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:09 smithi133 ceph-mon[125939]: pgmap v3925: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 108 KiB/s wr, 22 op/s 2023-05-08T05:45:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7248.281549 secs 2023-05-08T05:45:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:09 smithi096 ceph-mon[124666]: pgmap v3925: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 108 KiB/s wr, 22 op/s 2023-05-08T05:45:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7248.281549 secs 2023-05-08T05:45:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7249.562115 secs 2023-05-08T05:45:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:11 smithi186 ceph-mon[126480]: pgmap v3926: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 111 KiB/s wr, 25 op/s 2023-05-08T05:45:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:11 smithi186 ceph-mon[126480]: osdmap e324: 12 total, 12 up, 12 in 2023-05-08T05:45:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7249.562115 secs 2023-05-08T05:45:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:11 smithi133 ceph-mon[125939]: pgmap v3926: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 111 KiB/s wr, 25 op/s 2023-05-08T05:45:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:11 smithi133 ceph-mon[125939]: osdmap e324: 12 total, 12 up, 12 in 2023-05-08T05:45:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7249.562115 secs 2023-05-08T05:45:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:11 smithi096 ceph-mon[124666]: pgmap v3926: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 111 KiB/s wr, 25 op/s 2023-05-08T05:45:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:11 smithi096 ceph-mon[124666]: osdmap e324: 12 total, 12 up, 12 in 2023-05-08T05:45:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:13 smithi186 ceph-mon[126480]: pgmap v3928: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 89 KiB/s wr, 26 op/s 2023-05-08T05:45:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7252.723870 secs 2023-05-08T05:45:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:13 smithi133 ceph-mon[125939]: pgmap v3928: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 89 KiB/s wr, 26 op/s 2023-05-08T05:45:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7252.723870 secs 2023-05-08T05:45:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:13 smithi096 ceph-mon[124666]: pgmap v3928: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 89 KiB/s wr, 26 op/s 2023-05-08T05:45:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7252.723870 secs 2023-05-08T05:45:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7253.281673 secs 2023-05-08T05:45:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:15 smithi133 ceph-mon[125939]: pgmap v3929: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 3.6 KiB/s wr, 8 op/s 2023-05-08T05:45:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7253.281673 secs 2023-05-08T05:45:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:15 smithi096 ceph-mon[124666]: pgmap v3929: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 3.6 KiB/s wr, 8 op/s 2023-05-08T05:45:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7253.281673 secs 2023-05-08T05:45:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:15 smithi186 ceph-mon[126480]: pgmap v3929: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 3.6 KiB/s wr, 8 op/s 2023-05-08T05:45:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7254.562232 secs 2023-05-08T05:45:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7254.562232 secs 2023-05-08T05:45:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7254.562232 secs 2023-05-08T05:45:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:17 smithi133 ceph-mon[125939]: pgmap v3930: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 3.5 KiB/s wr, 8 op/s 2023-05-08T05:45:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:17 smithi096 ceph-mon[124666]: pgmap v3930: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 3.5 KiB/s wr, 8 op/s 2023-05-08T05:45:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:17 smithi186 ceph-mon[126480]: pgmap v3930: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 3.5 KiB/s wr, 8 op/s 2023-05-08T05:45:18.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7257.723986 secs 2023-05-08T05:45:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7257.723986 secs 2023-05-08T05:45:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7257.723986 secs 2023-05-08T05:45:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:19 smithi133 ceph-mon[125939]: pgmap v3931: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 3.5 KiB/s wr, 8 op/s 2023-05-08T05:45:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:19 smithi133 ceph-mon[125939]: osdmap e325: 12 total, 12 up, 12 in 2023-05-08T05:45:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:19 smithi096 ceph-mon[124666]: pgmap v3931: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 3.5 KiB/s wr, 8 op/s 2023-05-08T05:45:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:19 smithi096 ceph-mon[124666]: osdmap e325: 12 total, 12 up, 12 in 2023-05-08T05:45:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:19 smithi186 ceph-mon[126480]: pgmap v3931: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 3.5 KiB/s wr, 8 op/s 2023-05-08T05:45:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:19 smithi186 ceph-mon[126480]: osdmap e325: 12 total, 12 up, 12 in 2023-05-08T05:45:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7258.281751 secs 2023-05-08T05:45:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7258.281751 secs 2023-05-08T05:45:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7258.281751 secs 2023-05-08T05:45:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7259.562349 secs 2023-05-08T05:45:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:21 smithi133 ceph-mon[125939]: pgmap v3933: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 50 KiB/s wr, 7 op/s 2023-05-08T05:45:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7259.562349 secs 2023-05-08T05:45:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:21 smithi096 ceph-mon[124666]: pgmap v3933: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 50 KiB/s wr, 7 op/s 2023-05-08T05:45:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7259.562349 secs 2023-05-08T05:45:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:21 smithi186 ceph-mon[126480]: pgmap v3933: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 50 KiB/s wr, 7 op/s 2023-05-08T05:45:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:23 smithi133 ceph-mon[125939]: pgmap v3934: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 48 KiB/s wr, 7 op/s 2023-05-08T05:45:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7262.724100 secs 2023-05-08T05:45:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:23 smithi096 ceph-mon[124666]: pgmap v3934: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 48 KiB/s wr, 7 op/s 2023-05-08T05:45:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7262.724100 secs 2023-05-08T05:45:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:23 smithi186 ceph-mon[126480]: pgmap v3934: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 48 KiB/s wr, 7 op/s 2023-05-08T05:45:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7262.724100 secs 2023-05-08T05:45:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7263.281869 secs 2023-05-08T05:45:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:25 smithi133 ceph-mon[125939]: pgmap v3935: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 88 KiB/s wr, 8 op/s 2023-05-08T05:45:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7263.281869 secs 2023-05-08T05:45:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:25 smithi096 ceph-mon[124666]: pgmap v3935: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 88 KiB/s wr, 8 op/s 2023-05-08T05:45:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7263.281869 secs 2023-05-08T05:45:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:25 smithi186 ceph-mon[126480]: pgmap v3935: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 88 KiB/s wr, 8 op/s 2023-05-08T05:45:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7264.562467 secs 2023-05-08T05:45:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7264.562467 secs 2023-05-08T05:45:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7264.562467 secs 2023-05-08T05:45:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:27 smithi096 ceph-mon[124666]: pgmap v3936: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 88 KiB/s wr, 8 op/s 2023-05-08T05:45:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:27 smithi186 ceph-mon[126480]: pgmap v3936: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 88 KiB/s wr, 8 op/s 2023-05-08T05:45:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:27 smithi133 ceph-mon[125939]: pgmap v3936: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 88 KiB/s wr, 8 op/s 2023-05-08T05:45:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7267.724219 secs 2023-05-08T05:45:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7267.724219 secs 2023-05-08T05:45:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7267.724219 secs 2023-05-08T05:45:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:29 smithi096 ceph-mon[124666]: pgmap v3937: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 88 KiB/s wr, 8 op/s 2023-05-08T05:45:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:29 smithi186 ceph-mon[126480]: pgmap v3937: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 88 KiB/s wr, 8 op/s 2023-05-08T05:45:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:29 smithi133 ceph-mon[125939]: pgmap v3937: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 88 KiB/s wr, 8 op/s 2023-05-08T05:45:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7268.281992 secs 2023-05-08T05:45:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7268.281992 secs 2023-05-08T05:45:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7268.281992 secs 2023-05-08T05:45:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7269.562591 secs 2023-05-08T05:45:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:31 smithi186 ceph-mon[126480]: pgmap v3938: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 81 KiB/s wr, 7 op/s 2023-05-08T05:45:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7269.562591 secs 2023-05-08T05:45:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:31 smithi133 ceph-mon[125939]: pgmap v3938: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 81 KiB/s wr, 7 op/s 2023-05-08T05:45:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7269.562591 secs 2023-05-08T05:45:32.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:31 smithi096 ceph-mon[124666]: pgmap v3938: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 81 KiB/s wr, 7 op/s 2023-05-08T05:45:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:33 smithi186 ceph-mon[126480]: pgmap v3939: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 73 KiB/s wr, 6 op/s 2023-05-08T05:45:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7272.724349 secs 2023-05-08T05:45:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:33 smithi133 ceph-mon[125939]: pgmap v3939: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 73 KiB/s wr, 6 op/s 2023-05-08T05:45:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7272.724349 secs 2023-05-08T05:45:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:33 smithi096 ceph-mon[124666]: pgmap v3939: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 73 KiB/s wr, 6 op/s 2023-05-08T05:45:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7272.724349 secs 2023-05-08T05:45:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7273.282118 secs 2023-05-08T05:45:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:35 smithi186 ceph-mon[126480]: pgmap v3940: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 155 KiB/s wr, 10 op/s 2023-05-08T05:45:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7273.282118 secs 2023-05-08T05:45:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:35 smithi133 ceph-mon[125939]: pgmap v3940: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 155 KiB/s wr, 10 op/s 2023-05-08T05:45:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7273.282118 secs 2023-05-08T05:45:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:35 smithi096 ceph-mon[124666]: pgmap v3940: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 155 KiB/s wr, 10 op/s 2023-05-08T05:45:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:37 smithi186 ceph-mon[126480]: pgmap v3941: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 121 KiB/s wr, 6 op/s 2023-05-08T05:45:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:37 smithi133 ceph-mon[125939]: pgmap v3941: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 121 KiB/s wr, 6 op/s 2023-05-08T05:45:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:37 smithi096 ceph-mon[124666]: pgmap v3941: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 121 KiB/s wr, 6 op/s 2023-05-08T05:45:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7277.724442 secs 2023-05-08T05:45:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:38 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:45:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7277.724442 secs 2023-05-08T05:45:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:38 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:45:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7277.724442 secs 2023-05-08T05:45:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:38 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:45:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:39 smithi186 ceph-mon[126480]: pgmap v3942: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 121 KiB/s wr, 6 op/s 2023-05-08T05:45:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:39 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:45:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:39 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:45:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:39 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:45:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:39 smithi133 ceph-mon[125939]: pgmap v3942: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 121 KiB/s wr, 6 op/s 2023-05-08T05:45:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:39 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:45:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:39 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:45:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:39 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:45:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:39 smithi096 ceph-mon[124666]: pgmap v3942: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 121 KiB/s wr, 6 op/s 2023-05-08T05:45:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:39 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:45:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:39 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:45:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:39 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:45:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7278.282254 secs 2023-05-08T05:45:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7278.282254 secs 2023-05-08T05:45:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7278.282254 secs 2023-05-08T05:45:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:41 smithi186 ceph-mon[126480]: pgmap v3943: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 163 KiB/s wr, 9 op/s 2023-05-08T05:45:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:41 smithi133 ceph-mon[125939]: pgmap v3943: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 163 KiB/s wr, 9 op/s 2023-05-08T05:45:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:41 smithi096 ceph-mon[124666]: pgmap v3943: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 163 KiB/s wr, 9 op/s 2023-05-08T05:45:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:43 smithi186 ceph-mon[126480]: pgmap v3944: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 124 KiB/s wr, 7 op/s 2023-05-08T05:45:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7282.724570 secs 2023-05-08T05:45:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:43 smithi133 ceph-mon[125939]: pgmap v3944: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 124 KiB/s wr, 7 op/s 2023-05-08T05:45:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7282.724570 secs 2023-05-08T05:45:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:43 smithi096 ceph-mon[124666]: pgmap v3944: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 124 KiB/s wr, 7 op/s 2023-05-08T05:45:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7282.724570 secs 2023-05-08T05:45:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:45 smithi186 ceph-mon[126480]: pgmap v3945: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 200 KiB/s wr, 10 op/s 2023-05-08T05:45:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:45 smithi133 ceph-mon[125939]: pgmap v3945: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 200 KiB/s wr, 10 op/s 2023-05-08T05:45:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:45 smithi096 ceph-mon[124666]: pgmap v3945: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 200 KiB/s wr, 10 op/s 2023-05-08T05:45:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:46 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:45:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:46 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:45:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:46 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:45:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:47 smithi186 ceph-mon[126480]: pgmap v3946: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 118 KiB/s wr, 7 op/s 2023-05-08T05:45:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:47 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:45:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:47 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:45:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:47 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:45:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:47 smithi133 ceph-mon[125939]: pgmap v3946: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 118 KiB/s wr, 7 op/s 2023-05-08T05:45:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:47 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:45:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:47 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:45:47.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:47 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:45:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:47 smithi096 ceph-mon[124666]: pgmap v3946: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 118 KiB/s wr, 7 op/s 2023-05-08T05:45:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:47 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:45:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:47 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:45:48.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:47 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:45:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7287.724687 secs 2023-05-08T05:45:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7287.724687 secs 2023-05-08T05:45:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7287.724687 secs 2023-05-08T05:45:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:49 smithi186 ceph-mon[126480]: pgmap v3947: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 118 KiB/s wr, 7 op/s 2023-05-08T05:45:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:49 smithi133 ceph-mon[125939]: pgmap v3947: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 118 KiB/s wr, 7 op/s 2023-05-08T05:45:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:49 smithi096 ceph-mon[124666]: pgmap v3947: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 118 KiB/s wr, 7 op/s 2023-05-08T05:45:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7289.562915 secs 2023-05-08T05:45:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:51 smithi186 ceph-mon[126480]: pgmap v3948: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 233 KiB/s wr, 11 op/s 2023-05-08T05:45:51.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:45:51.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:45:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7289.562915 secs 2023-05-08T05:45:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:51 smithi133 ceph-mon[125939]: pgmap v3948: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 233 KiB/s wr, 11 op/s 2023-05-08T05:45:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:45:51.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:45:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7289.562915 secs 2023-05-08T05:45:52.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:51 smithi096 ceph-mon[124666]: pgmap v3948: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 233 KiB/s wr, 11 op/s 2023-05-08T05:45:52.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:45:52.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:45:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:53 smithi186 ceph-mon[126480]: pgmap v3949: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 191 KiB/s wr, 8 op/s 2023-05-08T05:45:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7292.724794 secs 2023-05-08T05:45:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:53 smithi133 ceph-mon[125939]: pgmap v3949: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 191 KiB/s wr, 8 op/s 2023-05-08T05:45:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7292.724794 secs 2023-05-08T05:45:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:53 smithi096 ceph-mon[124666]: pgmap v3949: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 191 KiB/s wr, 8 op/s 2023-05-08T05:45:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7292.724794 secs 2023-05-08T05:45:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7293.282602 secs 2023-05-08T05:45:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:54 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:45:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7293.282602 secs 2023-05-08T05:45:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:54 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:45:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7293.282602 secs 2023-05-08T05:45:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:54 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:45:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:55 smithi186 ceph-mon[126480]: pgmap v3950: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 292 KiB/s wr, 13 op/s 2023-05-08T05:45:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:55 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:45:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:55 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:45:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:55 smithi133 ceph-mon[125939]: pgmap v3950: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 292 KiB/s wr, 13 op/s 2023-05-08T05:45:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:55 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:45:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:55 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:45:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:55 smithi096 ceph-mon[124666]: pgmap v3950: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 292 KiB/s wr, 13 op/s 2023-05-08T05:45:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:55 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:45:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:55 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:45:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7294.563008 secs 2023-05-08T05:45:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7294.563008 secs 2023-05-08T05:45:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7294.563008 secs 2023-05-08T05:45:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:57 smithi186 ceph-mon[126480]: pgmap v3951: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 216 KiB/s wr, 9 op/s 2023-05-08T05:45:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:57 smithi133 ceph-mon[125939]: pgmap v3951: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 216 KiB/s wr, 9 op/s 2023-05-08T05:45:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:57 smithi096 ceph-mon[124666]: pgmap v3951: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 216 KiB/s wr, 9 op/s 2023-05-08T05:45:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7297.724917 secs 2023-05-08T05:45:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7297.724917 secs 2023-05-08T05:45:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7297.724917 secs 2023-05-08T05:45:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:59 smithi186 ceph-mon[126480]: pgmap v3952: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 216 KiB/s wr, 9 op/s 2023-05-08T05:45:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:45:59 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:45:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:59 smithi133 ceph-mon[125939]: pgmap v3952: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 216 KiB/s wr, 9 op/s 2023-05-08T05:45:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:45:59 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:46:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:59 smithi096 ceph-mon[124666]: pgmap v3952: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 216 KiB/s wr, 9 op/s 2023-05-08T05:46:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:45:59 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:46:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:46:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:46:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:46:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7299.563120 secs 2023-05-08T05:46:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:01 smithi186 ceph-mon[126480]: pgmap v3953: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 345 KiB/s wr, 13 op/s 2023-05-08T05:46:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:01 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:46:01.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:01 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:46:01.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:01 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:46:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7299.563120 secs 2023-05-08T05:46:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:01 smithi133 ceph-mon[125939]: pgmap v3953: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 345 KiB/s wr, 13 op/s 2023-05-08T05:46:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:01 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:46:01.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:01 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:46:01.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:01 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:46:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7299.563120 secs 2023-05-08T05:46:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:01 smithi096 ceph-mon[124666]: pgmap v3953: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 345 KiB/s wr, 13 op/s 2023-05-08T05:46:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:01 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:46:02.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:01 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:46:02.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:01 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:46:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:02 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:46:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:02 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T05:46:02.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:02 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T05:46:02.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:02 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:46:02.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:02 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:46:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:02 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:46:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:02 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T05:46:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:02 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T05:46:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:02 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:46:02.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:02 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:46:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:02 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:46:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:02 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T05:46:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:02 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T05:46:03.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:02 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:46:03.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:02 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:46:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:03 smithi186 ceph-mon[126480]: pgmap v3954: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 230 KiB/s wr, 8 op/s 2023-05-08T05:46:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:46:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:03 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:46:03.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7302.724979 secs 2023-05-08T05:46:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:03 smithi133 ceph-mon[125939]: pgmap v3954: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 230 KiB/s wr, 8 op/s 2023-05-08T05:46:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:46:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:03 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:46:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7302.724979 secs 2023-05-08T05:46:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:03 smithi096 ceph-mon[124666]: pgmap v3954: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 230 KiB/s wr, 8 op/s 2023-05-08T05:46:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:46:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:03 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:46:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7302.724979 secs 2023-05-08T05:46:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7303.282823 secs 2023-05-08T05:46:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:04 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:46:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7303.282823 secs 2023-05-08T05:46:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:04 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:46:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7303.282823 secs 2023-05-08T05:46:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:04 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:46:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:05 smithi186 ceph-mon[126480]: pgmap v3955: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 312 KiB/s wr, 27 op/s 2023-05-08T05:46:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:05 smithi133 ceph-mon[125939]: pgmap v3955: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 312 KiB/s wr, 27 op/s 2023-05-08T05:46:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:05 smithi096 ceph-mon[124666]: pgmap v3955: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 312 KiB/s wr, 27 op/s 2023-05-08T05:46:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7304.563246 secs 2023-05-08T05:46:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7304.563246 secs 2023-05-08T05:46:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7304.563246 secs 2023-05-08T05:46:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:07 smithi186 ceph-mon[126480]: pgmap v3956: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 211 KiB/s wr, 22 op/s 2023-05-08T05:46:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:07 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:46:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:07 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:46:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:07 smithi133 ceph-mon[125939]: pgmap v3956: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 211 KiB/s wr, 22 op/s 2023-05-08T05:46:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:07 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:46:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:07 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:46:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:07 smithi096 ceph-mon[124666]: pgmap v3956: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 211 KiB/s wr, 22 op/s 2023-05-08T05:46:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:07 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:46:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:07 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:46:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7307.725100 secs 2023-05-08T05:46:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7307.725100 secs 2023-05-08T05:46:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7307.725100 secs 2023-05-08T05:46:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:09 smithi133 ceph-mon[125939]: pgmap v3957: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 211 KiB/s wr, 22 op/s 2023-05-08T05:46:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7308.282960 secs 2023-05-08T05:46:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:09 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:46:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:09 smithi096 ceph-mon[124666]: pgmap v3957: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 211 KiB/s wr, 22 op/s 2023-05-08T05:46:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7308.282960 secs 2023-05-08T05:46:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:09 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:46:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:09 smithi186 ceph-mon[126480]: pgmap v3957: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 211 KiB/s wr, 22 op/s 2023-05-08T05:46:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7308.282960 secs 2023-05-08T05:46:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:09 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:46:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7309.563360 secs 2023-05-08T05:46:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:11 smithi133 ceph-mon[125939]: pgmap v3958: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 238 KiB/s wr, 26 op/s 2023-05-08T05:46:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:11 smithi133 ceph-mon[125939]: osdmap e326: 12 total, 12 up, 12 in 2023-05-08T05:46:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7309.563360 secs 2023-05-08T05:46:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:11 smithi096 ceph-mon[124666]: pgmap v3958: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 238 KiB/s wr, 26 op/s 2023-05-08T05:46:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:11 smithi096 ceph-mon[124666]: osdmap e326: 12 total, 12 up, 12 in 2023-05-08T05:46:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7309.563360 secs 2023-05-08T05:46:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:11 smithi186 ceph-mon[126480]: pgmap v3958: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 238 KiB/s wr, 26 op/s 2023-05-08T05:46:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:11 smithi186 ceph-mon[126480]: osdmap e326: 12 total, 12 up, 12 in 2023-05-08T05:46:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:13 smithi133 ceph-mon[125939]: pgmap v3960: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 131 KiB/s wr, 26 op/s 2023-05-08T05:46:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7312.725233 secs 2023-05-08T05:46:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:13 smithi096 ceph-mon[124666]: pgmap v3960: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 131 KiB/s wr, 26 op/s 2023-05-08T05:46:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7312.725233 secs 2023-05-08T05:46:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:13 smithi186 ceph-mon[126480]: pgmap v3960: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 131 KiB/s wr, 26 op/s 2023-05-08T05:46:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7312.725233 secs 2023-05-08T05:46:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7313.283106 secs 2023-05-08T05:46:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:15 smithi133 ceph-mon[125939]: pgmap v3961: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 8 op/s 2023-05-08T05:46:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7313.283106 secs 2023-05-08T05:46:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:15 smithi096 ceph-mon[124666]: pgmap v3961: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 8 op/s 2023-05-08T05:46:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7313.283106 secs 2023-05-08T05:46:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:15 smithi186 ceph-mon[126480]: pgmap v3961: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 8 op/s 2023-05-08T05:46:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7314.563482 secs 2023-05-08T05:46:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7314.563482 secs 2023-05-08T05:46:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7314.563482 secs 2023-05-08T05:46:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:17 smithi133 ceph-mon[125939]: pgmap v3962: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 8 op/s 2023-05-08T05:46:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:17 smithi096 ceph-mon[124666]: pgmap v3962: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 8 op/s 2023-05-08T05:46:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:17 smithi186 ceph-mon[126480]: pgmap v3962: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 8 op/s 2023-05-08T05:46:18.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7317.725376 secs 2023-05-08T05:46:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7317.725376 secs 2023-05-08T05:46:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7317.725376 secs 2023-05-08T05:46:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:19 smithi133 ceph-mon[125939]: pgmap v3963: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 8 op/s 2023-05-08T05:46:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:19 smithi133 ceph-mon[125939]: osdmap e327: 12 total, 12 up, 12 in 2023-05-08T05:46:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:19 smithi096 ceph-mon[124666]: pgmap v3963: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 8 op/s 2023-05-08T05:46:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:19 smithi096 ceph-mon[124666]: osdmap e327: 12 total, 12 up, 12 in 2023-05-08T05:46:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:19 smithi186 ceph-mon[126480]: pgmap v3963: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 8 op/s 2023-05-08T05:46:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:19 smithi186 ceph-mon[126480]: osdmap e327: 12 total, 12 up, 12 in 2023-05-08T05:46:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7318.283221 secs 2023-05-08T05:46:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7318.283221 secs 2023-05-08T05:46:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7318.283221 secs 2023-05-08T05:46:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7319.563599 secs 2023-05-08T05:46:21.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:21 smithi096 ceph-mon[124666]: pgmap v3965: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 3.9 KiB/s wr, 8 op/s 2023-05-08T05:46:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7319.563599 secs 2023-05-08T05:46:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:21 smithi186 ceph-mon[126480]: pgmap v3965: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 3.9 KiB/s wr, 8 op/s 2023-05-08T05:46:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7319.563599 secs 2023-05-08T05:46:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:21 smithi133 ceph-mon[125939]: pgmap v3965: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 3.9 KiB/s wr, 8 op/s 2023-05-08T05:46:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:23 smithi096 ceph-mon[124666]: pgmap v3966: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 3.7 KiB/s wr, 8 op/s 2023-05-08T05:46:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7322.725505 secs 2023-05-08T05:46:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:23 smithi186 ceph-mon[126480]: pgmap v3966: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 3.7 KiB/s wr, 8 op/s 2023-05-08T05:46:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7322.725505 secs 2023-05-08T05:46:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:23 smithi133 ceph-mon[125939]: pgmap v3966: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 3.7 KiB/s wr, 8 op/s 2023-05-08T05:46:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7322.725505 secs 2023-05-08T05:46:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7323.283337 secs 2023-05-08T05:46:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:25 smithi096 ceph-mon[124666]: pgmap v3967: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 48 KiB/s wr, 7 op/s 2023-05-08T05:46:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7323.283337 secs 2023-05-08T05:46:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:25 smithi186 ceph-mon[126480]: pgmap v3967: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 48 KiB/s wr, 7 op/s 2023-05-08T05:46:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7323.283337 secs 2023-05-08T05:46:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:25 smithi133 ceph-mon[125939]: pgmap v3967: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 48 KiB/s wr, 7 op/s 2023-05-08T05:46:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7324.563702 secs 2023-05-08T05:46:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7324.563702 secs 2023-05-08T05:46:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7324.563702 secs 2023-05-08T05:46:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:27 smithi186 ceph-mon[126480]: pgmap v3968: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 48 KiB/s wr, 7 op/s 2023-05-08T05:46:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:27 smithi133 ceph-mon[125939]: pgmap v3968: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 48 KiB/s wr, 7 op/s 2023-05-08T05:46:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:27 smithi096 ceph-mon[124666]: pgmap v3968: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 48 KiB/s wr, 7 op/s 2023-05-08T05:46:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7327.725616 secs 2023-05-08T05:46:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7327.725616 secs 2023-05-08T05:46:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7327.725616 secs 2023-05-08T05:46:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:29 smithi186 ceph-mon[126480]: pgmap v3969: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 48 KiB/s wr, 7 op/s 2023-05-08T05:46:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:29 smithi133 ceph-mon[125939]: pgmap v3969: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 48 KiB/s wr, 7 op/s 2023-05-08T05:46:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:29 smithi096 ceph-mon[124666]: pgmap v3969: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 48 KiB/s wr, 7 op/s 2023-05-08T05:46:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7328.283452 secs 2023-05-08T05:46:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7328.283452 secs 2023-05-08T05:46:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7328.283452 secs 2023-05-08T05:46:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7329.563819 secs 2023-05-08T05:46:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:31 smithi186 ceph-mon[126480]: pgmap v3970: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 82 KiB/s wr, 7 op/s 2023-05-08T05:46:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7329.563819 secs 2023-05-08T05:46:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:31 smithi133 ceph-mon[125939]: pgmap v3970: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 82 KiB/s wr, 7 op/s 2023-05-08T05:46:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7329.563819 secs 2023-05-08T05:46:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:31 smithi096 ceph-mon[124666]: pgmap v3970: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 82 KiB/s wr, 7 op/s 2023-05-08T05:46:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:33 smithi186 ceph-mon[126480]: pgmap v3971: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 74 KiB/s wr, 6 op/s 2023-05-08T05:46:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7332.725740 secs 2023-05-08T05:46:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:33 smithi133 ceph-mon[125939]: pgmap v3971: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 74 KiB/s wr, 6 op/s 2023-05-08T05:46:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7332.725740 secs 2023-05-08T05:46:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:33 smithi096 ceph-mon[124666]: pgmap v3971: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 74 KiB/s wr, 6 op/s 2023-05-08T05:46:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7332.725740 secs 2023-05-08T05:46:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7333.283575 secs 2023-05-08T05:46:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:35 smithi186 ceph-mon[126480]: pgmap v3972: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 181 KiB/s wr, 10 op/s 2023-05-08T05:46:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7333.283575 secs 2023-05-08T05:46:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:35 smithi133 ceph-mon[125939]: pgmap v3972: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 181 KiB/s wr, 10 op/s 2023-05-08T05:46:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7333.283575 secs 2023-05-08T05:46:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:35 smithi096 ceph-mon[124666]: pgmap v3972: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 181 KiB/s wr, 10 op/s 2023-05-08T05:46:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:37 smithi186 ceph-mon[126480]: pgmap v3973: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 142 KiB/s wr, 8 op/s 2023-05-08T05:46:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:37 smithi133 ceph-mon[125939]: pgmap v3973: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 142 KiB/s wr, 8 op/s 2023-05-08T05:46:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:37 smithi096 ceph-mon[124666]: pgmap v3973: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 142 KiB/s wr, 8 op/s 2023-05-08T05:46:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7337.725877 secs 2023-05-08T05:46:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:38 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:46:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7337.725877 secs 2023-05-08T05:46:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:38 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:46:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7337.725877 secs 2023-05-08T05:46:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:38 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:46:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:39 smithi186 ceph-mon[126480]: pgmap v3974: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 142 KiB/s wr, 8 op/s 2023-05-08T05:46:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:39 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:46:39.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:39 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:46:39.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:39 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:46:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:39 smithi133 ceph-mon[125939]: pgmap v3974: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 142 KiB/s wr, 8 op/s 2023-05-08T05:46:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:39 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:46:39.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:39 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:46:39.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:39 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:46:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:39 smithi096 ceph-mon[124666]: pgmap v3974: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 142 KiB/s wr, 8 op/s 2023-05-08T05:46:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:39 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:46:40.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:39 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:46:40.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:39 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:46:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:41 smithi186 ceph-mon[126480]: pgmap v3975: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 186 KiB/s wr, 12 op/s 2023-05-08T05:46:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:41 smithi133 ceph-mon[125939]: pgmap v3975: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 186 KiB/s wr, 12 op/s 2023-05-08T05:46:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:41 smithi096 ceph-mon[124666]: pgmap v3975: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 186 KiB/s wr, 12 op/s 2023-05-08T05:46:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:46:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:46:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:46:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:43 smithi186 ceph-mon[126480]: pgmap v3976: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 152 KiB/s wr, 8 op/s 2023-05-08T05:46:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:46:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:46:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7342.726002 secs 2023-05-08T05:46:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:43 smithi133 ceph-mon[125939]: pgmap v3976: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 152 KiB/s wr, 8 op/s 2023-05-08T05:46:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:46:43.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:46:43.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7342.726002 secs 2023-05-08T05:46:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:43 smithi096 ceph-mon[124666]: pgmap v3976: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 152 KiB/s wr, 8 op/s 2023-05-08T05:46:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:46:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:46:44.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7342.726002 secs 2023-05-08T05:46:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:44 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:46:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:44 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:46:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:44 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:46:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:45 smithi186 ceph-mon[126480]: pgmap v3977: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 291 KiB/s wr, 13 op/s 2023-05-08T05:46:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:45 smithi133 ceph-mon[125939]: pgmap v3977: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 291 KiB/s wr, 13 op/s 2023-05-08T05:46:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:45 smithi096 ceph-mon[124666]: pgmap v3977: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 291 KiB/s wr, 13 op/s 2023-05-08T05:46:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7344.564159 secs 2023-05-08T05:46:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7344.564159 secs 2023-05-08T05:46:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7344.564159 secs 2023-05-08T05:46:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:47 smithi186 ceph-mon[126480]: pgmap v3978: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 184 KiB/s wr, 9 op/s 2023-05-08T05:46:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:47 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:46:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:47 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:46:47.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:47 smithi133 ceph-mon[125939]: pgmap v3978: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 184 KiB/s wr, 9 op/s 2023-05-08T05:46:47.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:47 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:46:47.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:47 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:46:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:47 smithi096 ceph-mon[124666]: pgmap v3978: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 184 KiB/s wr, 9 op/s 2023-05-08T05:46:48.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:47 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:46:48.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:47 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:46:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7347.726133 secs 2023-05-08T05:46:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7347.726133 secs 2023-05-08T05:46:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7347.726133 secs 2023-05-08T05:46:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:49 smithi186 ceph-mon[126480]: pgmap v3979: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 184 KiB/s wr, 9 op/s 2023-05-08T05:46:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7348.283935 secs 2023-05-08T05:46:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:46:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:49 smithi133 ceph-mon[125939]: pgmap v3979: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 184 KiB/s wr, 9 op/s 2023-05-08T05:46:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7348.283935 secs 2023-05-08T05:46:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:46:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:49 smithi096 ceph-mon[124666]: pgmap v3979: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 184 KiB/s wr, 9 op/s 2023-05-08T05:46:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7348.283935 secs 2023-05-08T05:46:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:46:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7349.564278 secs 2023-05-08T05:46:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:51 smithi186 ceph-mon[126480]: pgmap v3980: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 280 KiB/s wr, 14 op/s 2023-05-08T05:46:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:46:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:46:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7349.564278 secs 2023-05-08T05:46:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:51 smithi133 ceph-mon[125939]: pgmap v3980: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 280 KiB/s wr, 14 op/s 2023-05-08T05:46:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:46:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:46:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7349.564278 secs 2023-05-08T05:46:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:51 smithi096 ceph-mon[124666]: pgmap v3980: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 280 KiB/s wr, 14 op/s 2023-05-08T05:46:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:46:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:46:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:53 smithi186 ceph-mon[126480]: pgmap v3981: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 235 KiB/s wr, 9 op/s 2023-05-08T05:46:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7352.726257 secs 2023-05-08T05:46:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:53 smithi133 ceph-mon[125939]: pgmap v3981: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 235 KiB/s wr, 9 op/s 2023-05-08T05:46:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7352.726257 secs 2023-05-08T05:46:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:53 smithi096 ceph-mon[124666]: pgmap v3981: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 235 KiB/s wr, 9 op/s 2023-05-08T05:46:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7352.726257 secs 2023-05-08T05:46:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7353.284030 secs 2023-05-08T05:46:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:54 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:46:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7353.284030 secs 2023-05-08T05:46:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:54 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:46:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7353.284030 secs 2023-05-08T05:46:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:54 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:46:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:55 smithi186 ceph-mon[126480]: pgmap v3982: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 360 KiB/s wr, 13 op/s 2023-05-08T05:46:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:55 smithi133 ceph-mon[125939]: pgmap v3982: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 360 KiB/s wr, 13 op/s 2023-05-08T05:46:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:55 smithi096 ceph-mon[124666]: pgmap v3982: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 360 KiB/s wr, 13 op/s 2023-05-08T05:46:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7354.564422 secs 2023-05-08T05:46:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7354.564422 secs 2023-05-08T05:46:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7354.564422 secs 2023-05-08T05:46:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:57 smithi186 ceph-mon[126480]: pgmap v3983: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 221 KiB/s wr, 8 op/s 2023-05-08T05:46:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:57 smithi133 ceph-mon[125939]: pgmap v3983: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 221 KiB/s wr, 8 op/s 2023-05-08T05:46:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:57 smithi096 ceph-mon[124666]: pgmap v3983: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 221 KiB/s wr, 8 op/s 2023-05-08T05:46:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7357.726384 secs 2023-05-08T05:46:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7357.726384 secs 2023-05-08T05:46:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7357.726384 secs 2023-05-08T05:46:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:59 smithi186 ceph-mon[126480]: pgmap v3984: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 221 KiB/s wr, 8 op/s 2023-05-08T05:46:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:46:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7358.284167 secs 2023-05-08T05:46:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:59 smithi133 ceph-mon[125939]: pgmap v3984: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 221 KiB/s wr, 8 op/s 2023-05-08T05:46:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:46:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7358.284167 secs 2023-05-08T05:47:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:59 smithi096 ceph-mon[124666]: pgmap v3984: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 221 KiB/s wr, 8 op/s 2023-05-08T05:47:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:46:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7358.284167 secs 2023-05-08T05:47:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7359.564552 secs 2023-05-08T05:47:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:01 smithi186 ceph-mon[126480]: pgmap v3985: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 266 KiB/s wr, 13 op/s 2023-05-08T05:47:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:01 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:47:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7359.564552 secs 2023-05-08T05:47:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:01 smithi133 ceph-mon[125939]: pgmap v3985: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 266 KiB/s wr, 13 op/s 2023-05-08T05:47:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:01 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:47:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7359.564552 secs 2023-05-08T05:47:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:01 smithi096 ceph-mon[124666]: pgmap v3985: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 266 KiB/s wr, 13 op/s 2023-05-08T05:47:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:01 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:47:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:02 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:47:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:02 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:47:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:02 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:47:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:02 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:47:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:02 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:47:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:02 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:47:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:02 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:47:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:02 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:47:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:02 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:47:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:03 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:47:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:03 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T05:47:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:03 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T05:47:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:03 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:47:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:03 smithi186 ceph-mon[126480]: pgmap v3986: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 170 KiB/s wr, 8 op/s 2023-05-08T05:47:03.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7362.726508 secs 2023-05-08T05:47:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:03 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:47:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:03 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T05:47:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:03 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T05:47:03.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:03 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:47:03.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:03 smithi133 ceph-mon[125939]: pgmap v3986: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 170 KiB/s wr, 8 op/s 2023-05-08T05:47:03.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7362.726508 secs 2023-05-08T05:47:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:03 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:47:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:03 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T05:47:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:03 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T05:47:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:03 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:47:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:03 smithi096 ceph-mon[124666]: pgmap v3986: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 170 KiB/s wr, 8 op/s 2023-05-08T05:47:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7362.726508 secs 2023-05-08T05:47:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7363.284282 secs 2023-05-08T05:47:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:05 smithi133 ceph-mon[125939]: pgmap v3987: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 292 KiB/s rd, 325 KiB/s wr, 26 op/s 2023-05-08T05:47:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7363.284282 secs 2023-05-08T05:47:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:05 smithi096 ceph-mon[124666]: pgmap v3987: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 292 KiB/s rd, 325 KiB/s wr, 26 op/s 2023-05-08T05:47:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7363.284282 secs 2023-05-08T05:47:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:05 smithi186 ceph-mon[126480]: pgmap v3987: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 292 KiB/s rd, 325 KiB/s wr, 26 op/s 2023-05-08T05:47:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7364.564612 secs 2023-05-08T05:47:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:06 smithi133 ceph-mon[125939]: osdmap e328: 12 total, 12 up, 12 in 2023-05-08T05:47:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7364.564612 secs 2023-05-08T05:47:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:06 smithi096 ceph-mon[124666]: osdmap e328: 12 total, 12 up, 12 in 2023-05-08T05:47:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7364.564612 secs 2023-05-08T05:47:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:06 smithi186 ceph-mon[126480]: osdmap e328: 12 total, 12 up, 12 in 2023-05-08T05:47:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:07 smithi133 ceph-mon[125939]: pgmap v3989: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 241 KiB/s wr, 27 op/s 2023-05-08T05:47:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:07 smithi096 ceph-mon[124666]: pgmap v3989: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 241 KiB/s wr, 27 op/s 2023-05-08T05:47:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:07 smithi186 ceph-mon[126480]: pgmap v3989: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 241 KiB/s wr, 27 op/s 2023-05-08T05:47:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7367.726641 secs 2023-05-08T05:47:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7367.726641 secs 2023-05-08T05:47:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7367.726641 secs 2023-05-08T05:47:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:09 smithi133 ceph-mon[125939]: pgmap v3990: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 241 KiB/s wr, 27 op/s 2023-05-08T05:47:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7368.284392 secs 2023-05-08T05:47:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:09 smithi096 ceph-mon[124666]: pgmap v3990: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 241 KiB/s wr, 27 op/s 2023-05-08T05:47:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7368.284392 secs 2023-05-08T05:47:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:09 smithi186 ceph-mon[126480]: pgmap v3990: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 241 KiB/s wr, 27 op/s 2023-05-08T05:47:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7368.284392 secs 2023-05-08T05:47:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7369.564708 secs 2023-05-08T05:47:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7369.564708 secs 2023-05-08T05:47:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7369.564708 secs 2023-05-08T05:47:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:11 smithi133 ceph-mon[125939]: pgmap v3991: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 227 KiB/s wr, 26 op/s 2023-05-08T05:47:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:11 smithi096 ceph-mon[124666]: pgmap v3991: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 227 KiB/s wr, 26 op/s 2023-05-08T05:47:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:11 smithi186 ceph-mon[126480]: pgmap v3991: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 227 KiB/s wr, 26 op/s 2023-05-08T05:47:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:13 smithi133 ceph-mon[125939]: pgmap v3992: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 227 KiB/s wr, 26 op/s 2023-05-08T05:47:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7372.726771 secs 2023-05-08T05:47:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:13 smithi096 ceph-mon[124666]: pgmap v3992: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 227 KiB/s wr, 26 op/s 2023-05-08T05:47:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7372.726771 secs 2023-05-08T05:47:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:13 smithi186 ceph-mon[126480]: pgmap v3992: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 227 KiB/s wr, 26 op/s 2023-05-08T05:47:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7372.726771 secs 2023-05-08T05:47:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7373.284503 secs 2023-05-08T05:47:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:15 smithi096 ceph-mon[124666]: pgmap v3993: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 133 KiB/s wr, 9 op/s 2023-05-08T05:47:15.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:15 smithi096 ceph-mon[124666]: osdmap e329: 12 total, 12 up, 12 in 2023-05-08T05:47:15.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7374.564832 secs 2023-05-08T05:47:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7373.284503 secs 2023-05-08T05:47:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:15 smithi186 ceph-mon[126480]: pgmap v3993: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 133 KiB/s wr, 9 op/s 2023-05-08T05:47:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:15 smithi186 ceph-mon[126480]: osdmap e329: 12 total, 12 up, 12 in 2023-05-08T05:47:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7374.564832 secs 2023-05-08T05:47:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7373.284503 secs 2023-05-08T05:47:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:15 smithi133 ceph-mon[125939]: pgmap v3993: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 133 KiB/s wr, 9 op/s 2023-05-08T05:47:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:15 smithi133 ceph-mon[125939]: osdmap e329: 12 total, 12 up, 12 in 2023-05-08T05:47:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7374.564832 secs 2023-05-08T05:47:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:17 smithi096 ceph-mon[124666]: pgmap v3995: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 133 KiB/s wr, 9 op/s 2023-05-08T05:47:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:17 smithi186 ceph-mon[126480]: pgmap v3995: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 133 KiB/s wr, 9 op/s 2023-05-08T05:47:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:17 smithi133 ceph-mon[125939]: pgmap v3995: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 133 KiB/s wr, 9 op/s 2023-05-08T05:47:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7377.726887 secs 2023-05-08T05:47:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7377.726887 secs 2023-05-08T05:47:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7377.726887 secs 2023-05-08T05:47:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:19 smithi096 ceph-mon[124666]: pgmap v3996: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 133 KiB/s wr, 9 op/s 2023-05-08T05:47:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:19 smithi186 ceph-mon[126480]: pgmap v3996: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 133 KiB/s wr, 9 op/s 2023-05-08T05:47:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:19 smithi133 ceph-mon[125939]: pgmap v3996: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 133 KiB/s wr, 9 op/s 2023-05-08T05:47:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7378.284529 secs 2023-05-08T05:47:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7379.564920 secs 2023-05-08T05:47:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7378.284529 secs 2023-05-08T05:47:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7379.564920 secs 2023-05-08T05:47:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7378.284529 secs 2023-05-08T05:47:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7379.564920 secs 2023-05-08T05:47:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:21 smithi186 ceph-mon[126480]: pgmap v3997: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 141 KiB/s wr, 7 op/s 2023-05-08T05:47:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:21 smithi133 ceph-mon[125939]: pgmap v3997: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 141 KiB/s wr, 7 op/s 2023-05-08T05:47:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:21 smithi096 ceph-mon[124666]: pgmap v3997: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 141 KiB/s wr, 7 op/s 2023-05-08T05:47:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:23 smithi186 ceph-mon[126480]: pgmap v3998: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 141 KiB/s wr, 7 op/s 2023-05-08T05:47:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7382.727001 secs 2023-05-08T05:47:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:23 smithi133 ceph-mon[125939]: pgmap v3998: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 141 KiB/s wr, 7 op/s 2023-05-08T05:47:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7382.727001 secs 2023-05-08T05:47:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:23 smithi096 ceph-mon[124666]: pgmap v3998: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 141 KiB/s wr, 7 op/s 2023-05-08T05:47:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7382.727001 secs 2023-05-08T05:47:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7383.284662 secs 2023-05-08T05:47:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7383.284662 secs 2023-05-08T05:47:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7383.284662 secs 2023-05-08T05:47:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:25 smithi186 ceph-mon[126480]: pgmap v3999: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 107 KiB/s wr, 8 op/s 2023-05-08T05:47:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7384.565043 secs 2023-05-08T05:47:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:25 smithi133 ceph-mon[125939]: pgmap v3999: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 107 KiB/s wr, 8 op/s 2023-05-08T05:47:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7384.565043 secs 2023-05-08T05:47:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:25 smithi096 ceph-mon[124666]: pgmap v3999: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 107 KiB/s wr, 8 op/s 2023-05-08T05:47:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7384.565043 secs 2023-05-08T05:47:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:27 smithi186 ceph-mon[126480]: pgmap v4000: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 91 KiB/s wr, 6 op/s 2023-05-08T05:47:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:27 smithi133 ceph-mon[125939]: pgmap v4000: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 91 KiB/s wr, 6 op/s 2023-05-08T05:47:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:27 smithi096 ceph-mon[124666]: pgmap v4000: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 91 KiB/s wr, 6 op/s 2023-05-08T05:47:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7387.727121 secs 2023-05-08T05:47:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7387.727121 secs 2023-05-08T05:47:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7387.727121 secs 2023-05-08T05:47:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:29 smithi186 ceph-mon[126480]: pgmap v4001: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 89 KiB/s wr, 6 op/s 2023-05-08T05:47:29.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7388.284809 secs 2023-05-08T05:47:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:29 smithi133 ceph-mon[125939]: pgmap v4001: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 89 KiB/s wr, 6 op/s 2023-05-08T05:47:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7388.284809 secs 2023-05-08T05:47:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:29 smithi096 ceph-mon[124666]: pgmap v4001: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 89 KiB/s wr, 6 op/s 2023-05-08T05:47:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7388.284809 secs 2023-05-08T05:47:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7389.565159 secs 2023-05-08T05:47:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7389.565159 secs 2023-05-08T05:47:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7389.565159 secs 2023-05-08T05:47:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:31 smithi186 ceph-mon[126480]: pgmap v4002: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 90 KiB/s wr, 9 op/s 2023-05-08T05:47:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:31 smithi133 ceph-mon[125939]: pgmap v4002: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 90 KiB/s wr, 9 op/s 2023-05-08T05:47:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:31 smithi096 ceph-mon[124666]: pgmap v4002: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 90 KiB/s wr, 9 op/s 2023-05-08T05:47:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:33 smithi186 ceph-mon[126480]: pgmap v4003: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 50 KiB/s wr, 6 op/s 2023-05-08T05:47:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7392.727212 secs 2023-05-08T05:47:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:33 smithi133 ceph-mon[125939]: pgmap v4003: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 50 KiB/s wr, 6 op/s 2023-05-08T05:47:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7392.727212 secs 2023-05-08T05:47:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:33 smithi096 ceph-mon[124666]: pgmap v4003: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 50 KiB/s wr, 6 op/s 2023-05-08T05:47:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7392.727212 secs 2023-05-08T05:47:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7393.284950 secs 2023-05-08T05:47:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7393.284950 secs 2023-05-08T05:47:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7393.284950 secs 2023-05-08T05:47:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:35 smithi186 ceph-mon[126480]: pgmap v4004: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 81 KiB/s wr, 10 op/s 2023-05-08T05:47:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:35 smithi133 ceph-mon[125939]: pgmap v4004: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 81 KiB/s wr, 10 op/s 2023-05-08T05:47:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:35 smithi096 ceph-mon[124666]: pgmap v4004: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 81 KiB/s wr, 10 op/s 2023-05-08T05:47:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:37 smithi186 ceph-mon[126480]: pgmap v4005: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T05:47:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:37 smithi133 ceph-mon[125939]: pgmap v4005: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T05:47:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:37 smithi096 ceph-mon[124666]: pgmap v4005: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T05:47:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7397.727357 secs 2023-05-08T05:47:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:38 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:47:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7397.727357 secs 2023-05-08T05:47:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:38 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:47:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7397.727357 secs 2023-05-08T05:47:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:38 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:47:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:39 smithi186 ceph-mon[126480]: pgmap v4006: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T05:47:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:39 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:47:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7398.285036 secs 2023-05-08T05:47:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:39 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:47:39.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:39 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:47:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:39 smithi133 ceph-mon[125939]: pgmap v4006: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T05:47:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:39 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:47:39.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7398.285036 secs 2023-05-08T05:47:39.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:39 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:47:39.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:39 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:47:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:39 smithi096 ceph-mon[124666]: pgmap v4006: 97 pgs: 97 active+clean; 6.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T05:47:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:39 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:47:40.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7398.285036 secs 2023-05-08T05:47:40.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:39 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:47:40.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:39 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:47:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:41 smithi186 ceph-mon[126480]: pgmap v4007: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 160 KiB/s wr, 9 op/s 2023-05-08T05:47:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:41 smithi133 ceph-mon[125939]: pgmap v4007: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 160 KiB/s wr, 9 op/s 2023-05-08T05:47:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:41 smithi096 ceph-mon[124666]: pgmap v4007: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 160 KiB/s wr, 9 op/s 2023-05-08T05:47:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:43 smithi186 ceph-mon[126480]: pgmap v4008: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 160 KiB/s wr, 6 op/s 2023-05-08T05:47:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7402.727457 secs 2023-05-08T05:47:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:43 smithi133 ceph-mon[125939]: pgmap v4008: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 160 KiB/s wr, 6 op/s 2023-05-08T05:47:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7402.727457 secs 2023-05-08T05:47:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:43 smithi096 ceph-mon[124666]: pgmap v4008: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 160 KiB/s wr, 6 op/s 2023-05-08T05:47:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7402.727457 secs 2023-05-08T05:47:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:45 smithi186 ceph-mon[126480]: pgmap v4009: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 263 KiB/s wr, 12 op/s 2023-05-08T05:47:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:45 smithi133 ceph-mon[125939]: pgmap v4009: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 263 KiB/s wr, 12 op/s 2023-05-08T05:47:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:45 smithi096 ceph-mon[124666]: pgmap v4009: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 263 KiB/s wr, 12 op/s 2023-05-08T05:47:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:46 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:47:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:46 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:47:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:46 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:47:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:47 smithi186 ceph-mon[126480]: pgmap v4010: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 231 KiB/s wr, 9 op/s 2023-05-08T05:47:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:47 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:47:47.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:47 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:47:47.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:47 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:47:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:47 smithi133 ceph-mon[125939]: pgmap v4010: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 231 KiB/s wr, 9 op/s 2023-05-08T05:47:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:47 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:47:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:47 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:47:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:47 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:47:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:47 smithi096 ceph-mon[124666]: pgmap v4010: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 231 KiB/s wr, 9 op/s 2023-05-08T05:47:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:47 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:47:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:47 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:47:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:47 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:47:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7407.727579 secs 2023-05-08T05:47:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7408.285305 secs 2023-05-08T05:47:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7407.727579 secs 2023-05-08T05:47:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7408.285305 secs 2023-05-08T05:47:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7407.727579 secs 2023-05-08T05:47:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7408.285305 secs 2023-05-08T05:47:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:49 smithi186 ceph-mon[126480]: pgmap v4011: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 231 KiB/s wr, 9 op/s 2023-05-08T05:47:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:49 smithi133 ceph-mon[125939]: pgmap v4011: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 231 KiB/s wr, 9 op/s 2023-05-08T05:47:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:49 smithi096 ceph-mon[124666]: pgmap v4011: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 231 KiB/s wr, 9 op/s 2023-05-08T05:47:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7409.565629 secs 2023-05-08T05:47:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7409.565629 secs 2023-05-08T05:47:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7409.565629 secs 2023-05-08T05:47:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:51 smithi186 ceph-mon[126480]: pgmap v4012: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 348 KiB/s wr, 13 op/s 2023-05-08T05:47:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:47:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:47:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:47:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:51 smithi133 ceph-mon[125939]: pgmap v4012: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 348 KiB/s wr, 13 op/s 2023-05-08T05:47:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:47:51.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:47:51.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:47:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:51 smithi096 ceph-mon[124666]: pgmap v4012: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 348 KiB/s wr, 13 op/s 2023-05-08T05:47:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:47:52.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:47:52.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:47:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:53 smithi186 ceph-mon[126480]: pgmap v4013: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 220 KiB/s wr, 10 op/s 2023-05-08T05:47:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7412.727693 secs 2023-05-08T05:47:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:53 smithi133 ceph-mon[125939]: pgmap v4013: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 220 KiB/s wr, 10 op/s 2023-05-08T05:47:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7412.727693 secs 2023-05-08T05:47:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:53 smithi096 ceph-mon[124666]: pgmap v4013: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 220 KiB/s wr, 10 op/s 2023-05-08T05:47:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7412.727693 secs 2023-05-08T05:47:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:54 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:47:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:54 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:47:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:54 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:47:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:54 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:47:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:54 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:47:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:54 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:47:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:55 smithi186 ceph-mon[126480]: pgmap v4014: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 286 KiB/s rd, 271 KiB/s wr, 14 op/s 2023-05-08T05:47:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:55 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:47:55.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:55 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:47:55.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7414.565757 secs 2023-05-08T05:47:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:55 smithi133 ceph-mon[125939]: pgmap v4014: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 286 KiB/s rd, 271 KiB/s wr, 14 op/s 2023-05-08T05:47:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:55 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:47:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:55 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:47:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7414.565757 secs 2023-05-08T05:47:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:55 smithi096 ceph-mon[124666]: pgmap v4014: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 286 KiB/s rd, 271 KiB/s wr, 14 op/s 2023-05-08T05:47:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:55 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:47:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:55 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:47:56.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7414.565757 secs 2023-05-08T05:47:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:57 smithi186 ceph-mon[126480]: pgmap v4015: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 168 KiB/s wr, 8 op/s 2023-05-08T05:47:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:57 smithi133 ceph-mon[125939]: pgmap v4015: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 168 KiB/s wr, 8 op/s 2023-05-08T05:47:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:57 smithi096 ceph-mon[124666]: pgmap v4015: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 168 KiB/s wr, 8 op/s 2023-05-08T05:47:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7417.727816 secs 2023-05-08T05:47:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7418.285548 secs 2023-05-08T05:47:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7417.727816 secs 2023-05-08T05:47:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7418.285548 secs 2023-05-08T05:47:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7417.727816 secs 2023-05-08T05:47:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7418.285548 secs 2023-05-08T05:47:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:59 smithi186 ceph-mon[126480]: pgmap v4016: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 168 KiB/s wr, 8 op/s 2023-05-08T05:47:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:47:59 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:47:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:59 smithi133 ceph-mon[125939]: pgmap v4016: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 168 KiB/s wr, 8 op/s 2023-05-08T05:47:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:47:59 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:48:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:59 smithi096 ceph-mon[124666]: pgmap v4016: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 168 KiB/s wr, 8 op/s 2023-05-08T05:48:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:47:59 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:48:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7419.565875 secs 2023-05-08T05:48:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7419.565875 secs 2023-05-08T05:48:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7419.565875 secs 2023-05-08T05:48:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:01 smithi133 ceph-mon[125939]: pgmap v4017: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 361 KiB/s wr, 13 op/s 2023-05-08T05:48:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:01 smithi096 ceph-mon[124666]: pgmap v4017: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 361 KiB/s wr, 13 op/s 2023-05-08T05:48:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:01 smithi186 ceph-mon[126480]: pgmap v4017: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 361 KiB/s wr, 13 op/s 2023-05-08T05:48:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:02 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:48:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:02 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:48:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:02 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:48:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:02 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:48:02.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:02 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:48:02.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:02 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:48:02.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:02 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:48:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:02 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:48:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:02 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:48:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:02 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:48:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:02 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:48:03.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:02 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:48:03.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:02 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:48:03.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:02 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:48:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:02 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:48:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:02 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:48:03.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:02 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:48:03.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:02 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:48:03.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:02 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:48:03.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:02 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:48:03.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:02 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:48:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:03 smithi133 ceph-mon[125939]: pgmap v4018: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 245 KiB/s wr, 8 op/s 2023-05-08T05:48:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:48:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:03 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:48:03.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7422.727907 secs 2023-05-08T05:48:03.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:48:03.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:48:03.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:48:03.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7423.285644 secs 2023-05-08T05:48:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:03 smithi096 ceph-mon[124666]: pgmap v4018: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 245 KiB/s wr, 8 op/s 2023-05-08T05:48:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:48:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:03 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:48:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7422.727907 secs 2023-05-08T05:48:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:48:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:48:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:48:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7423.285644 secs 2023-05-08T05:48:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:03 smithi186 ceph-mon[126480]: pgmap v4018: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 245 KiB/s wr, 8 op/s 2023-05-08T05:48:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:48:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:03 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:48:04.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7422.727907 secs 2023-05-08T05:48:04.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:48:04.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:48:04.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:48:04.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7423.285644 secs 2023-05-08T05:48:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:04 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:48:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:04 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T05:48:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:04 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T05:48:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:04 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:48:04.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:04 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:48:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:04 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:48:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:04 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T05:48:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:04 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T05:48:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:04 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:48:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:04 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:48:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:04 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:48:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:04 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T05:48:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:04 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T05:48:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:04 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:48:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:04 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:48:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:05 smithi133 ceph-mon[125939]: pgmap v4019: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 328 KiB/s wr, 27 op/s 2023-05-08T05:48:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7424.565999 secs 2023-05-08T05:48:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:05 smithi096 ceph-mon[124666]: pgmap v4019: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 328 KiB/s wr, 27 op/s 2023-05-08T05:48:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7424.565999 secs 2023-05-08T05:48:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:05 smithi186 ceph-mon[126480]: pgmap v4019: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 328 KiB/s wr, 27 op/s 2023-05-08T05:48:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7424.565999 secs 2023-05-08T05:48:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:07 smithi133 ceph-mon[125939]: pgmap v4020: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 278 KiB/s wr, 23 op/s 2023-05-08T05:48:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:07 smithi096 ceph-mon[124666]: pgmap v4020: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 278 KiB/s wr, 23 op/s 2023-05-08T05:48:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:07 smithi186 ceph-mon[126480]: pgmap v4020: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 278 KiB/s wr, 23 op/s 2023-05-08T05:48:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7427.728047 secs 2023-05-08T05:48:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7428.285715 secs 2023-05-08T05:48:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7427.728047 secs 2023-05-08T05:48:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7428.285715 secs 2023-05-08T05:48:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7427.728047 secs 2023-05-08T05:48:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7428.285715 secs 2023-05-08T05:48:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:09 smithi133 ceph-mon[125939]: pgmap v4021: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 278 KiB/s wr, 23 op/s 2023-05-08T05:48:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:09 smithi096 ceph-mon[124666]: pgmap v4021: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 278 KiB/s wr, 23 op/s 2023-05-08T05:48:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:09 smithi186 ceph-mon[126480]: pgmap v4021: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 278 KiB/s wr, 23 op/s 2023-05-08T05:48:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7429.566118 secs 2023-05-08T05:48:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7429.566118 secs 2023-05-08T05:48:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7429.566118 secs 2023-05-08T05:48:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:11 smithi133 ceph-mon[125939]: pgmap v4022: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 304 KiB/s wr, 26 op/s 2023-05-08T05:48:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:11 smithi133 ceph-mon[125939]: osdmap e330: 12 total, 12 up, 12 in 2023-05-08T05:48:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:11 smithi096 ceph-mon[124666]: pgmap v4022: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 304 KiB/s wr, 26 op/s 2023-05-08T05:48:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:11 smithi096 ceph-mon[124666]: osdmap e330: 12 total, 12 up, 12 in 2023-05-08T05:48:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:11 smithi186 ceph-mon[126480]: pgmap v4022: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 304 KiB/s wr, 26 op/s 2023-05-08T05:48:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:11 smithi186 ceph-mon[126480]: osdmap e330: 12 total, 12 up, 12 in 2023-05-08T05:48:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:13 smithi133 ceph-mon[125939]: pgmap v4024: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 132 KiB/s wr, 26 op/s 2023-05-08T05:48:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7432.728190 secs 2023-05-08T05:48:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7433.285835 secs 2023-05-08T05:48:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:13 smithi096 ceph-mon[124666]: pgmap v4024: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 132 KiB/s wr, 26 op/s 2023-05-08T05:48:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7432.728190 secs 2023-05-08T05:48:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7433.285835 secs 2023-05-08T05:48:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:13 smithi186 ceph-mon[126480]: pgmap v4024: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 132 KiB/s wr, 26 op/s 2023-05-08T05:48:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7432.728190 secs 2023-05-08T05:48:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7433.285835 secs 2023-05-08T05:48:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:15 smithi133 ceph-mon[125939]: pgmap v4025: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 8 op/s 2023-05-08T05:48:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7434.566220 secs 2023-05-08T05:48:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:15 smithi096 ceph-mon[124666]: pgmap v4025: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 8 op/s 2023-05-08T05:48:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7434.566220 secs 2023-05-08T05:48:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:15 smithi186 ceph-mon[126480]: pgmap v4025: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 8 op/s 2023-05-08T05:48:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7434.566220 secs 2023-05-08T05:48:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:17 smithi133 ceph-mon[125939]: pgmap v4026: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 8 op/s 2023-05-08T05:48:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:17 smithi096 ceph-mon[124666]: pgmap v4026: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 8 op/s 2023-05-08T05:48:18.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:17 smithi186 ceph-mon[126480]: pgmap v4026: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 8 op/s 2023-05-08T05:48:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7437.728323 secs 2023-05-08T05:48:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7438.285946 secs 2023-05-08T05:48:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7437.728323 secs 2023-05-08T05:48:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7438.285946 secs 2023-05-08T05:48:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7437.728323 secs 2023-05-08T05:48:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7438.285946 secs 2023-05-08T05:48:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:19 smithi133 ceph-mon[125939]: pgmap v4027: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 8 op/s 2023-05-08T05:48:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:19 smithi133 ceph-mon[125939]: osdmap e331: 12 total, 12 up, 12 in 2023-05-08T05:48:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:19 smithi096 ceph-mon[124666]: pgmap v4027: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 8 op/s 2023-05-08T05:48:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:19 smithi096 ceph-mon[124666]: osdmap e331: 12 total, 12 up, 12 in 2023-05-08T05:48:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:19 smithi186 ceph-mon[126480]: pgmap v4027: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 8 op/s 2023-05-08T05:48:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:19 smithi186 ceph-mon[126480]: osdmap e331: 12 total, 12 up, 12 in 2023-05-08T05:48:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7439.566344 secs 2023-05-08T05:48:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7439.566344 secs 2023-05-08T05:48:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7439.566344 secs 2023-05-08T05:48:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:21 smithi133 ceph-mon[125939]: pgmap v4029: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 8 op/s 2023-05-08T05:48:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:21 smithi096 ceph-mon[124666]: pgmap v4029: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 8 op/s 2023-05-08T05:48:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:21 smithi186 ceph-mon[126480]: pgmap v4029: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 8 op/s 2023-05-08T05:48:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:23 smithi133 ceph-mon[125939]: pgmap v4030: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 KiB/s wr, 8 op/s 2023-05-08T05:48:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7442.728436 secs 2023-05-08T05:48:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7443.286071 secs 2023-05-08T05:48:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:23 smithi096 ceph-mon[124666]: pgmap v4030: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 KiB/s wr, 8 op/s 2023-05-08T05:48:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7442.728436 secs 2023-05-08T05:48:24.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7443.286071 secs 2023-05-08T05:48:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:23 smithi186 ceph-mon[126480]: pgmap v4030: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 KiB/s wr, 8 op/s 2023-05-08T05:48:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7442.728436 secs 2023-05-08T05:48:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7443.286071 secs 2023-05-08T05:48:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:25 smithi133 ceph-mon[125939]: pgmap v4031: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 49 KiB/s wr, 8 op/s 2023-05-08T05:48:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7444.566471 secs 2023-05-08T05:48:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:25 smithi096 ceph-mon[124666]: pgmap v4031: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 49 KiB/s wr, 8 op/s 2023-05-08T05:48:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7444.566471 secs 2023-05-08T05:48:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:25 smithi186 ceph-mon[126480]: pgmap v4031: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 49 KiB/s wr, 8 op/s 2023-05-08T05:48:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7444.566471 secs 2023-05-08T05:48:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:27 smithi133 ceph-mon[125939]: pgmap v4032: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 49 KiB/s wr, 8 op/s 2023-05-08T05:48:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:27 smithi096 ceph-mon[124666]: pgmap v4032: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 49 KiB/s wr, 8 op/s 2023-05-08T05:48:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:27 smithi186 ceph-mon[126480]: pgmap v4032: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 49 KiB/s wr, 8 op/s 2023-05-08T05:48:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7447.728561 secs 2023-05-08T05:48:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7448.286168 secs 2023-05-08T05:48:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7447.728561 secs 2023-05-08T05:48:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7448.286168 secs 2023-05-08T05:48:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7447.728561 secs 2023-05-08T05:48:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7448.286168 secs 2023-05-08T05:48:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:29 smithi133 ceph-mon[125939]: pgmap v4033: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 49 KiB/s wr, 8 op/s 2023-05-08T05:48:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:29 smithi096 ceph-mon[124666]: pgmap v4033: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 49 KiB/s wr, 8 op/s 2023-05-08T05:48:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:29 smithi186 ceph-mon[126480]: pgmap v4033: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 49 KiB/s wr, 8 op/s 2023-05-08T05:48:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7449.566585 secs 2023-05-08T05:48:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7449.566585 secs 2023-05-08T05:48:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7449.566585 secs 2023-05-08T05:48:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:31 smithi133 ceph-mon[125939]: pgmap v4034: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 45 KiB/s wr, 7 op/s 2023-05-08T05:48:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:31 smithi096 ceph-mon[124666]: pgmap v4034: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 45 KiB/s wr, 7 op/s 2023-05-08T05:48:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:31 smithi186 ceph-mon[126480]: pgmap v4034: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 45 KiB/s wr, 7 op/s 2023-05-08T05:48:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:33 smithi133 ceph-mon[125939]: pgmap v4035: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 41 KiB/s wr, 6 op/s 2023-05-08T05:48:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7452.728640 secs 2023-05-08T05:48:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7453.286236 secs 2023-05-08T05:48:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:33 smithi096 ceph-mon[124666]: pgmap v4035: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 41 KiB/s wr, 6 op/s 2023-05-08T05:48:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7452.728640 secs 2023-05-08T05:48:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7453.286236 secs 2023-05-08T05:48:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:33 smithi186 ceph-mon[126480]: pgmap v4035: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 41 KiB/s wr, 6 op/s 2023-05-08T05:48:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7452.728640 secs 2023-05-08T05:48:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7453.286236 secs 2023-05-08T05:48:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:35 smithi133 ceph-mon[125939]: pgmap v4036: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 KiB/s wr, 9 op/s 2023-05-08T05:48:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:35 smithi096 ceph-mon[124666]: pgmap v4036: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 KiB/s wr, 9 op/s 2023-05-08T05:48:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:35 smithi186 ceph-mon[126480]: pgmap v4036: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 KiB/s wr, 9 op/s 2023-05-08T05:48:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:36 smithi133 ceph-mon[125939]: pgmap v4037: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 40 KiB/s wr, 6 op/s 2023-05-08T05:48:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:36 smithi096 ceph-mon[124666]: pgmap v4037: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 40 KiB/s wr, 6 op/s 2023-05-08T05:48:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:36 smithi186 ceph-mon[126480]: pgmap v4037: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 40 KiB/s wr, 6 op/s 2023-05-08T05:48:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:38 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:48:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:38 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:48:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:38 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:48:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:38 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:48:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:38 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:48:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:38 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:48:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7457.728761 secs 2023-05-08T05:48:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:39 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:48:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:39 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:48:39.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:39 smithi186 ceph-mon[126480]: pgmap v4038: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 40 KiB/s wr, 6 op/s 2023-05-08T05:48:39.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7458.286385 secs 2023-05-08T05:48:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7457.728761 secs 2023-05-08T05:48:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:39 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:48:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:39 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:48:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:39 smithi133 ceph-mon[125939]: pgmap v4038: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 40 KiB/s wr, 6 op/s 2023-05-08T05:48:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7458.286385 secs 2023-05-08T05:48:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7457.728761 secs 2023-05-08T05:48:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:39 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:48:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:39 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:48:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:39 smithi096 ceph-mon[124666]: pgmap v4038: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 40 KiB/s wr, 6 op/s 2023-05-08T05:48:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7458.286385 secs 2023-05-08T05:48:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:41 smithi186 ceph-mon[126480]: pgmap v4039: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 83 KiB/s wr, 8 op/s 2023-05-08T05:48:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:41 smithi133 ceph-mon[125939]: pgmap v4039: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 83 KiB/s wr, 8 op/s 2023-05-08T05:48:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:41 smithi096 ceph-mon[124666]: pgmap v4039: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 83 KiB/s wr, 8 op/s 2023-05-08T05:48:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:43 smithi186 ceph-mon[126480]: pgmap v4040: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 129 KiB/s wr, 6 op/s 2023-05-08T05:48:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7462.728882 secs 2023-05-08T05:48:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:43 smithi133 ceph-mon[125939]: pgmap v4040: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 129 KiB/s wr, 6 op/s 2023-05-08T05:48:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7462.728882 secs 2023-05-08T05:48:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:43 smithi096 ceph-mon[124666]: pgmap v4040: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 129 KiB/s wr, 6 op/s 2023-05-08T05:48:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7462.728882 secs 2023-05-08T05:48:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:45 smithi186 ceph-mon[126480]: pgmap v4041: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 172 KiB/s wr, 10 op/s 2023-05-08T05:48:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:45 smithi133 ceph-mon[125939]: pgmap v4041: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 172 KiB/s wr, 10 op/s 2023-05-08T05:48:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:45 smithi096 ceph-mon[124666]: pgmap v4041: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 172 KiB/s wr, 10 op/s 2023-05-08T05:48:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:46 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:48:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:46 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:48:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:46 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:48:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:47 smithi186 ceph-mon[126480]: pgmap v4042: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 283 KiB/s wr, 8 op/s 2023-05-08T05:48:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:47 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:48:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:47 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:48:47.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:47 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:48:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:47 smithi133 ceph-mon[125939]: pgmap v4042: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 283 KiB/s wr, 8 op/s 2023-05-08T05:48:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:47 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:48:47.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:47 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:48:47.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:47 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:48:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:47 smithi096 ceph-mon[124666]: pgmap v4042: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 283 KiB/s wr, 8 op/s 2023-05-08T05:48:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:47 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:48:48.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:47 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:48:48.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:47 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:48:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7467.729010 secs 2023-05-08T05:48:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7467.729010 secs 2023-05-08T05:48:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7467.729010 secs 2023-05-08T05:48:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:49 smithi186 ceph-mon[126480]: pgmap v4043: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 283 KiB/s wr, 8 op/s 2023-05-08T05:48:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:49 smithi133 ceph-mon[125939]: pgmap v4043: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 283 KiB/s wr, 8 op/s 2023-05-08T05:48:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:49 smithi096 ceph-mon[124666]: pgmap v4043: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 283 KiB/s wr, 8 op/s 2023-05-08T05:48:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:51 smithi186 ceph-mon[126480]: pgmap v4044: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 287 KiB/s wr, 12 op/s 2023-05-08T05:48:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:51 smithi133 ceph-mon[125939]: pgmap v4044: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 287 KiB/s wr, 12 op/s 2023-05-08T05:48:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:51 smithi096 ceph-mon[124666]: pgmap v4044: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 287 KiB/s wr, 12 op/s 2023-05-08T05:48:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:53 smithi186 ceph-mon[126480]: pgmap v4045: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 368 KiB/s wr, 11 op/s 2023-05-08T05:48:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7472.729146 secs 2023-05-08T05:48:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:53 smithi133 ceph-mon[125939]: pgmap v4045: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 368 KiB/s wr, 11 op/s 2023-05-08T05:48:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7472.729146 secs 2023-05-08T05:48:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:53 smithi096 ceph-mon[124666]: pgmap v4045: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 368 KiB/s wr, 11 op/s 2023-05-08T05:48:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7472.729146 secs 2023-05-08T05:48:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7473.286744 secs 2023-05-08T05:48:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7473.286744 secs 2023-05-08T05:48:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7473.286744 secs 2023-05-08T05:48:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:55 smithi186 ceph-mon[126480]: pgmap v4046: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 283 KiB/s wr, 13 op/s 2023-05-08T05:48:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:55 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:48:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:55 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:48:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:55 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:48:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:55 smithi133 ceph-mon[125939]: pgmap v4046: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 283 KiB/s wr, 13 op/s 2023-05-08T05:48:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:55 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:48:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:55 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:48:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:55 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:48:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:55 smithi096 ceph-mon[124666]: pgmap v4046: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 283 KiB/s wr, 13 op/s 2023-05-08T05:48:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:55 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:48:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:55 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:48:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:55 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:48:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:57 smithi186 ceph-mon[126480]: pgmap v4047: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 265 KiB/s wr, 11 op/s 2023-05-08T05:48:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:57 smithi133 ceph-mon[125939]: pgmap v4047: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 265 KiB/s wr, 11 op/s 2023-05-08T05:48:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:57 smithi096 ceph-mon[124666]: pgmap v4047: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 265 KiB/s wr, 11 op/s 2023-05-08T05:48:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7477.729252 secs 2023-05-08T05:48:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7477.729252 secs 2023-05-08T05:48:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7477.729252 secs 2023-05-08T05:48:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:48:59 smithi186 ceph-mon[126480]: pgmap v4048: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 154 KiB/s wr, 10 op/s 2023-05-08T05:48:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:48:59 smithi133 ceph-mon[125939]: pgmap v4048: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 154 KiB/s wr, 10 op/s 2023-05-08T05:49:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:48:59 smithi096 ceph-mon[124666]: pgmap v4048: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 154 KiB/s wr, 10 op/s 2023-05-08T05:49:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7479.567216 secs 2023-05-08T05:49:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7479.567216 secs 2023-05-08T05:49:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7479.567216 secs 2023-05-08T05:49:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:01 smithi186 ceph-mon[126480]: pgmap v4049: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 304 KiB/s wr, 13 op/s 2023-05-08T05:49:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:01 smithi133 ceph-mon[125939]: pgmap v4049: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 304 KiB/s wr, 13 op/s 2023-05-08T05:49:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:01 smithi096 ceph-mon[124666]: pgmap v4049: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 304 KiB/s wr, 13 op/s 2023-05-08T05:49:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:02 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:49:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:02 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:49:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:02 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:49:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:03 smithi186 ceph-mon[126480]: pgmap v4050: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 302 KiB/s wr, 11 op/s 2023-05-08T05:49:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:49:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:49:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:03 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:49:03.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7482.729360 secs 2023-05-08T05:49:03.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:49:03.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7483.286917 secs 2023-05-08T05:49:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:03 smithi133 ceph-mon[125939]: pgmap v4050: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 302 KiB/s wr, 11 op/s 2023-05-08T05:49:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:49:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:49:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:03 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:49:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7482.729360 secs 2023-05-08T05:49:03.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:49:03.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7483.286917 secs 2023-05-08T05:49:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:03 smithi096 ceph-mon[124666]: pgmap v4050: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 302 KiB/s wr, 11 op/s 2023-05-08T05:49:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:49:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:49:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:03 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:49:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7482.729360 secs 2023-05-08T05:49:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:49:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7483.286917 secs 2023-05-08T05:49:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:04 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:49:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:04 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:49:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:04 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:49:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:04 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:49:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:04 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:49:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:04 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:49:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:04 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:49:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:04 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:49:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:04 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:49:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:05 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:49:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:05 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T05:49:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:05 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T05:49:05.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:05 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:49:05.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:05 smithi186 ceph-mon[126480]: pgmap v4051: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 279 KiB/s wr, 27 op/s 2023-05-08T05:49:05.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7484.567362 secs 2023-05-08T05:49:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:05 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:49:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:05 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T05:49:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:05 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T05:49:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:05 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:49:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:05 smithi133 ceph-mon[125939]: pgmap v4051: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 279 KiB/s wr, 27 op/s 2023-05-08T05:49:05.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7484.567362 secs 2023-05-08T05:49:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:05 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:49:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:05 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T05:49:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:05 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T05:49:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:05 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:49:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:05 smithi096 ceph-mon[124666]: pgmap v4051: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 279 KiB/s wr, 27 op/s 2023-05-08T05:49:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7484.567362 secs 2023-05-08T05:49:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:06 smithi186 ceph-mon[126480]: osdmap e332: 12 total, 12 up, 12 in 2023-05-08T05:49:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:06 smithi133 ceph-mon[125939]: osdmap e332: 12 total, 12 up, 12 in 2023-05-08T05:49:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:06 smithi096 ceph-mon[124666]: osdmap e332: 12 total, 12 up, 12 in 2023-05-08T05:49:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:07 smithi186 ceph-mon[126480]: pgmap v4053: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 304 KiB/s wr, 29 op/s 2023-05-08T05:49:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:07 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:49:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:07 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:49:07.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:07 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:49:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:07 smithi133 ceph-mon[125939]: pgmap v4053: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 304 KiB/s wr, 29 op/s 2023-05-08T05:49:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:07 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:49:07.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:07 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:49:07.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:07 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:49:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:07 smithi096 ceph-mon[124666]: pgmap v4053: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 304 KiB/s wr, 29 op/s 2023-05-08T05:49:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:07 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:49:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:07 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:49:08.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:07 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:49:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7487.729482 secs 2023-05-08T05:49:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7488.287032 secs 2023-05-08T05:49:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7487.729482 secs 2023-05-08T05:49:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7488.287032 secs 2023-05-08T05:49:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7487.729482 secs 2023-05-08T05:49:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7488.287032 secs 2023-05-08T05:49:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:09 smithi186 ceph-mon[126480]: pgmap v4054: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 304 KiB/s wr, 29 op/s 2023-05-08T05:49:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:09 smithi133 ceph-mon[125939]: pgmap v4054: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 304 KiB/s wr, 29 op/s 2023-05-08T05:49:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:09 smithi096 ceph-mon[124666]: pgmap v4054: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 304 KiB/s wr, 29 op/s 2023-05-08T05:49:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7489.567496 secs 2023-05-08T05:49:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7489.567496 secs 2023-05-08T05:49:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7489.567496 secs 2023-05-08T05:49:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:11 smithi133 ceph-mon[125939]: pgmap v4055: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 169 KiB/s wr, 28 op/s 2023-05-08T05:49:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:11 smithi096 ceph-mon[124666]: pgmap v4055: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 169 KiB/s wr, 28 op/s 2023-05-08T05:49:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:11 smithi186 ceph-mon[126480]: pgmap v4055: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 169 KiB/s wr, 28 op/s 2023-05-08T05:49:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:13 smithi133 ceph-mon[125939]: pgmap v4056: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 166 KiB/s wr, 27 op/s 2023-05-08T05:49:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7492.729556 secs 2023-05-08T05:49:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7493.287127 secs 2023-05-08T05:49:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:13 smithi096 ceph-mon[124666]: pgmap v4056: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 166 KiB/s wr, 27 op/s 2023-05-08T05:49:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7492.729556 secs 2023-05-08T05:49:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7493.287127 secs 2023-05-08T05:49:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:13 smithi186 ceph-mon[126480]: pgmap v4056: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 166 KiB/s wr, 27 op/s 2023-05-08T05:49:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7492.729556 secs 2023-05-08T05:49:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7493.287127 secs 2023-05-08T05:49:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:15 smithi186 ceph-mon[126480]: pgmap v4057: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 46 KiB/s wr, 7 op/s 2023-05-08T05:49:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:15 smithi186 ceph-mon[126480]: osdmap e333: 12 total, 12 up, 12 in 2023-05-08T05:49:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7494.567624 secs 2023-05-08T05:49:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:15 smithi133 ceph-mon[125939]: pgmap v4057: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 46 KiB/s wr, 7 op/s 2023-05-08T05:49:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:15 smithi133 ceph-mon[125939]: osdmap e333: 12 total, 12 up, 12 in 2023-05-08T05:49:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7494.567624 secs 2023-05-08T05:49:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:15 smithi096 ceph-mon[124666]: pgmap v4057: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 46 KiB/s wr, 7 op/s 2023-05-08T05:49:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:15 smithi096 ceph-mon[124666]: osdmap e333: 12 total, 12 up, 12 in 2023-05-08T05:49:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7494.567624 secs 2023-05-08T05:49:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:17 smithi186 ceph-mon[126480]: pgmap v4059: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 47 KiB/s wr, 7 op/s 2023-05-08T05:49:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:17 smithi133 ceph-mon[125939]: pgmap v4059: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 47 KiB/s wr, 7 op/s 2023-05-08T05:49:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:17 smithi096 ceph-mon[124666]: pgmap v4059: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 47 KiB/s wr, 7 op/s 2023-05-08T05:49:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7497.729681 secs 2023-05-08T05:49:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7497.729681 secs 2023-05-08T05:49:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7497.729681 secs 2023-05-08T05:49:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:19 smithi186 ceph-mon[126480]: pgmap v4060: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 47 KiB/s wr, 7 op/s 2023-05-08T05:49:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7498.287227 secs 2023-05-08T05:49:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:19 smithi133 ceph-mon[125939]: pgmap v4060: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 47 KiB/s wr, 7 op/s 2023-05-08T05:49:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7498.287227 secs 2023-05-08T05:49:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:19 smithi096 ceph-mon[124666]: pgmap v4060: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 47 KiB/s wr, 7 op/s 2023-05-08T05:49:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7498.287227 secs 2023-05-08T05:49:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7499.567719 secs 2023-05-08T05:49:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7499.567719 secs 2023-05-08T05:49:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7499.567719 secs 2023-05-08T05:49:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:21 smithi186 ceph-mon[126480]: pgmap v4061: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.7 KiB/s wr, 7 op/s 2023-05-08T05:49:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:21 smithi133 ceph-mon[125939]: pgmap v4061: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.7 KiB/s wr, 7 op/s 2023-05-08T05:49:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:21 smithi096 ceph-mon[124666]: pgmap v4061: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.7 KiB/s wr, 7 op/s 2023-05-08T05:49:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:23 smithi186 ceph-mon[126480]: pgmap v4062: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.7 KiB/s wr, 7 op/s 2023-05-08T05:49:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7502.729788 secs 2023-05-08T05:49:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:23 smithi133 ceph-mon[125939]: pgmap v4062: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.7 KiB/s wr, 7 op/s 2023-05-08T05:49:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7502.729788 secs 2023-05-08T05:49:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:23 smithi096 ceph-mon[124666]: pgmap v4062: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.7 KiB/s wr, 7 op/s 2023-05-08T05:49:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7502.729788 secs 2023-05-08T05:49:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7503.287296 secs 2023-05-08T05:49:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7503.287296 secs 2023-05-08T05:49:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7503.287296 secs 2023-05-08T05:49:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:25 smithi186 ceph-mon[126480]: pgmap v4063: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 51 KiB/s wr, 7 op/s 2023-05-08T05:49:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7504.567824 secs 2023-05-08T05:49:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:25 smithi133 ceph-mon[125939]: pgmap v4063: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 51 KiB/s wr, 7 op/s 2023-05-08T05:49:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7504.567824 secs 2023-05-08T05:49:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:25 smithi096 ceph-mon[124666]: pgmap v4063: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 51 KiB/s wr, 7 op/s 2023-05-08T05:49:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7504.567824 secs 2023-05-08T05:49:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:27 smithi186 ceph-mon[126480]: pgmap v4064: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 44 KiB/s wr, 7 op/s 2023-05-08T05:49:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:27 smithi133 ceph-mon[125939]: pgmap v4064: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 44 KiB/s wr, 7 op/s 2023-05-08T05:49:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:27 smithi096 ceph-mon[124666]: pgmap v4064: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 44 KiB/s wr, 7 op/s 2023-05-08T05:49:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7507.729900 secs 2023-05-08T05:49:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7507.729900 secs 2023-05-08T05:49:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7507.729900 secs 2023-05-08T05:49:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:29 smithi186 ceph-mon[126480]: pgmap v4065: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 41 KiB/s wr, 6 op/s 2023-05-08T05:49:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7508.287390 secs 2023-05-08T05:49:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:29 smithi133 ceph-mon[125939]: pgmap v4065: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 41 KiB/s wr, 6 op/s 2023-05-08T05:49:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7508.287390 secs 2023-05-08T05:49:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:29 smithi096 ceph-mon[124666]: pgmap v4065: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 41 KiB/s wr, 6 op/s 2023-05-08T05:49:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7508.287390 secs 2023-05-08T05:49:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7509.567945 secs 2023-05-08T05:49:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7509.567945 secs 2023-05-08T05:49:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7509.567945 secs 2023-05-08T05:49:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:31 smithi186 ceph-mon[126480]: pgmap v4066: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 42 KiB/s wr, 9 op/s 2023-05-08T05:49:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:31 smithi133 ceph-mon[125939]: pgmap v4066: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 42 KiB/s wr, 9 op/s 2023-05-08T05:49:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:31 smithi096 ceph-mon[124666]: pgmap v4066: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 42 KiB/s wr, 9 op/s 2023-05-08T05:49:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:33 smithi186 ceph-mon[126480]: pgmap v4067: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 41 KiB/s wr, 7 op/s 2023-05-08T05:49:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7512.730011 secs 2023-05-08T05:49:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:33 smithi133 ceph-mon[125939]: pgmap v4067: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 41 KiB/s wr, 7 op/s 2023-05-08T05:49:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7512.730011 secs 2023-05-08T05:49:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:33 smithi096 ceph-mon[124666]: pgmap v4067: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 41 KiB/s wr, 7 op/s 2023-05-08T05:49:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7512.730011 secs 2023-05-08T05:49:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7513.287508 secs 2023-05-08T05:49:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7513.287508 secs 2023-05-08T05:49:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7513.287508 secs 2023-05-08T05:49:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:35 smithi186 ceph-mon[126480]: pgmap v4068: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 125 KiB/s wr, 9 op/s 2023-05-08T05:49:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:35 smithi133 ceph-mon[125939]: pgmap v4068: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 125 KiB/s wr, 9 op/s 2023-05-08T05:49:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:35 smithi096 ceph-mon[124666]: pgmap v4068: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 125 KiB/s wr, 9 op/s 2023-05-08T05:49:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:37 smithi186 ceph-mon[126480]: pgmap v4069: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 84 KiB/s wr, 7 op/s 2023-05-08T05:49:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:37 smithi133 ceph-mon[125939]: pgmap v4069: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 84 KiB/s wr, 7 op/s 2023-05-08T05:49:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:37 smithi096 ceph-mon[124666]: pgmap v4069: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 84 KiB/s wr, 7 op/s 2023-05-08T05:49:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7517.730113 secs 2023-05-08T05:49:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:38 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:49:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7517.730113 secs 2023-05-08T05:49:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:38 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:49:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7517.730113 secs 2023-05-08T05:49:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:38 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:49:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:39 smithi186 ceph-mon[126480]: pgmap v4070: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 84 KiB/s wr, 6 op/s 2023-05-08T05:49:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:39 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:49:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:39 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:49:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:39 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:49:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:39 smithi133 ceph-mon[125939]: pgmap v4070: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 84 KiB/s wr, 6 op/s 2023-05-08T05:49:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:39 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:49:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:39 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:49:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:39 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:49:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:39 smithi096 ceph-mon[124666]: pgmap v4070: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 84 KiB/s wr, 6 op/s 2023-05-08T05:49:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:39 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:49:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:39 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:49:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:39 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:49:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:41 smithi186 ceph-mon[126480]: pgmap v4071: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 151 KiB/s wr, 10 op/s 2023-05-08T05:49:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:41 smithi133 ceph-mon[125939]: pgmap v4071: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 151 KiB/s wr, 10 op/s 2023-05-08T05:49:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:41 smithi096 ceph-mon[124666]: pgmap v4071: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 151 KiB/s wr, 10 op/s 2023-05-08T05:49:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:49:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:49:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:49:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:43 smithi186 ceph-mon[126480]: pgmap v4072: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 152 KiB/s wr, 8 op/s 2023-05-08T05:49:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:49:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:49:43.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7522.730235 secs 2023-05-08T05:49:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:43 smithi133 ceph-mon[125939]: pgmap v4072: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 152 KiB/s wr, 8 op/s 2023-05-08T05:49:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:49:43.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:49:43.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7522.730235 secs 2023-05-08T05:49:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:43 smithi096 ceph-mon[124666]: pgmap v4072: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 152 KiB/s wr, 8 op/s 2023-05-08T05:49:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:49:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:49:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7522.730235 secs 2023-05-08T05:49:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:44 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:49:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:44 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:49:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:44 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:49:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:45 smithi186 ceph-mon[126480]: pgmap v4073: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 299 KiB/s wr, 12 op/s 2023-05-08T05:49:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:45 smithi133 ceph-mon[125939]: pgmap v4073: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 299 KiB/s wr, 12 op/s 2023-05-08T05:49:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:45 smithi096 ceph-mon[124666]: pgmap v4073: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 299 KiB/s wr, 12 op/s 2023-05-08T05:49:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:47 smithi186 ceph-mon[126480]: pgmap v4074: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 218 KiB/s wr, 10 op/s 2023-05-08T05:49:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:47 smithi133 ceph-mon[125939]: pgmap v4074: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 218 KiB/s wr, 10 op/s 2023-05-08T05:49:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:47 smithi096 ceph-mon[124666]: pgmap v4074: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 218 KiB/s wr, 10 op/s 2023-05-08T05:49:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7527.730377 secs 2023-05-08T05:49:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7528.287828 secs 2023-05-08T05:49:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7527.730377 secs 2023-05-08T05:49:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7528.287828 secs 2023-05-08T05:49:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7527.730377 secs 2023-05-08T05:49:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7528.287828 secs 2023-05-08T05:49:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:49 smithi133 ceph-mon[125939]: pgmap v4075: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 217 KiB/s wr, 9 op/s 2023-05-08T05:49:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:49 smithi096 ceph-mon[124666]: pgmap v4075: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 217 KiB/s wr, 9 op/s 2023-05-08T05:49:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:49 smithi186 ceph-mon[126480]: pgmap v4075: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 217 KiB/s wr, 9 op/s 2023-05-08T05:49:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:49:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:49:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:49:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:49:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:49:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:49:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:49:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:49:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:49:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:51 smithi133 ceph-mon[125939]: pgmap v4076: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 230 KiB/s wr, 12 op/s 2023-05-08T05:49:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:51 smithi096 ceph-mon[124666]: pgmap v4076: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 230 KiB/s wr, 12 op/s 2023-05-08T05:49:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:51 smithi186 ceph-mon[126480]: pgmap v4076: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 230 KiB/s wr, 12 op/s 2023-05-08T05:49:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:53 smithi133 ceph-mon[125939]: pgmap v4077: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 164 KiB/s wr, 9 op/s 2023-05-08T05:49:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7532.730500 secs 2023-05-08T05:49:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:53 smithi096 ceph-mon[124666]: pgmap v4077: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 164 KiB/s wr, 9 op/s 2023-05-08T05:49:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7532.730500 secs 2023-05-08T05:49:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:53 smithi186 ceph-mon[126480]: pgmap v4077: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 164 KiB/s wr, 9 op/s 2023-05-08T05:49:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7532.730500 secs 2023-05-08T05:49:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:54 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:49:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:54 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:49:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:54 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:49:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:55 smithi133 ceph-mon[125939]: pgmap v4078: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 420 KiB/s wr, 13 op/s 2023-05-08T05:49:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:55 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:49:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:55 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:49:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7534.568451 secs 2023-05-08T05:49:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:55 smithi096 ceph-mon[124666]: pgmap v4078: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 420 KiB/s wr, 13 op/s 2023-05-08T05:49:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:55 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:49:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:55 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:49:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7534.568451 secs 2023-05-08T05:49:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:55 smithi186 ceph-mon[126480]: pgmap v4078: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 420 KiB/s wr, 13 op/s 2023-05-08T05:49:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:55 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:49:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:55 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:49:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7534.568451 secs 2023-05-08T05:49:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:57 smithi133 ceph-mon[125939]: pgmap v4079: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 274 KiB/s wr, 9 op/s 2023-05-08T05:49:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:57 smithi096 ceph-mon[124666]: pgmap v4079: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 274 KiB/s wr, 9 op/s 2023-05-08T05:49:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:57 smithi186 ceph-mon[126480]: pgmap v4079: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 274 KiB/s wr, 9 op/s 2023-05-08T05:49:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7537.730623 secs 2023-05-08T05:49:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7538.288021 secs 2023-05-08T05:49:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7537.730623 secs 2023-05-08T05:49:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7538.288021 secs 2023-05-08T05:49:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7537.730623 secs 2023-05-08T05:49:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7538.288021 secs 2023-05-08T05:49:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:59 smithi133 ceph-mon[125939]: pgmap v4080: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 273 KiB/s wr, 9 op/s 2023-05-08T05:49:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:59 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:49:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:59 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:49:59.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:49:59 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:50:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:59 smithi096 ceph-mon[124666]: pgmap v4080: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 273 KiB/s wr, 9 op/s 2023-05-08T05:50:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:59 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:50:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:59 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:50:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:49:59 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:50:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:59 smithi186 ceph-mon[126480]: pgmap v4080: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 273 KiB/s wr, 9 op/s 2023-05-08T05:50:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:59 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:50:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:59 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:50:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:49:59 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:50:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7539.568570 secs 2023-05-08T05:50:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:00 smithi133 ceph-mon[125939]: overall HEALTH_WARN 2 MDSs report slow requests 2023-05-08T05:50:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7539.568570 secs 2023-05-08T05:50:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:00 smithi096 ceph-mon[124666]: overall HEALTH_WARN 2 MDSs report slow requests 2023-05-08T05:50:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7539.568570 secs 2023-05-08T05:50:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:00 smithi186 ceph-mon[126480]: overall HEALTH_WARN 2 MDSs report slow requests 2023-05-08T05:50:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:01 smithi133 ceph-mon[125939]: pgmap v4081: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 273 KiB/s wr, 12 op/s 2023-05-08T05:50:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:01 smithi096 ceph-mon[124666]: pgmap v4081: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 273 KiB/s wr, 12 op/s 2023-05-08T05:50:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:01 smithi186 ceph-mon[126480]: pgmap v4081: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 273 KiB/s wr, 12 op/s 2023-05-08T05:50:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:03 smithi133 ceph-mon[125939]: pgmap v4082: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 261 KiB/s wr, 9 op/s 2023-05-08T05:50:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:50:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:03 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:50:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7542.730706 secs 2023-05-08T05:50:03.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7543.288151 secs 2023-05-08T05:50:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:03 smithi096 ceph-mon[124666]: pgmap v4082: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 261 KiB/s wr, 9 op/s 2023-05-08T05:50:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:50:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:03 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:50:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7542.730706 secs 2023-05-08T05:50:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7543.288151 secs 2023-05-08T05:50:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:03 smithi186 ceph-mon[126480]: pgmap v4082: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 261 KiB/s wr, 9 op/s 2023-05-08T05:50:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:50:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:03 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:50:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7542.730706 secs 2023-05-08T05:50:04.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7543.288151 secs 2023-05-08T05:50:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:04 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:50:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:04 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:50:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:04 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:50:04.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:04 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:50:04.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:04 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:50:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:04 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:50:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:04 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:50:05.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:04 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:50:05.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:04 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:50:05.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:04 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:50:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:04 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:50:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:04 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:50:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:04 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:50:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:04 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:50:05.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:04 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:50:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:05 smithi133 ceph-mon[125939]: pgmap v4083: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 343 KiB/s wr, 26 op/s 2023-05-08T05:50:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:05 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:50:05.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:05 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T05:50:05.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:05 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T05:50:05.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:05 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:50:05.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7544.568693 secs 2023-05-08T05:50:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:05 smithi096 ceph-mon[124666]: pgmap v4083: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 343 KiB/s wr, 26 op/s 2023-05-08T05:50:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:05 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:50:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:05 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T05:50:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:05 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T05:50:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:05 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:50:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7544.568693 secs 2023-05-08T05:50:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:05 smithi186 ceph-mon[126480]: pgmap v4083: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 343 KiB/s wr, 26 op/s 2023-05-08T05:50:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:05 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:50:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:05 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T05:50:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:05 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T05:50:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:05 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:50:06.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7544.568693 secs 2023-05-08T05:50:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:07 smithi133 ceph-mon[125939]: pgmap v4084: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 85 KiB/s wr, 21 op/s 2023-05-08T05:50:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:07 smithi096 ceph-mon[124666]: pgmap v4084: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 85 KiB/s wr, 21 op/s 2023-05-08T05:50:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:07 smithi186 ceph-mon[126480]: pgmap v4084: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 85 KiB/s wr, 21 op/s 2023-05-08T05:50:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7547.730832 secs 2023-05-08T05:50:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7548.288253 secs 2023-05-08T05:50:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7547.730832 secs 2023-05-08T05:50:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7548.288253 secs 2023-05-08T05:50:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7547.730832 secs 2023-05-08T05:50:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7548.288253 secs 2023-05-08T05:50:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:09 smithi133 ceph-mon[125939]: pgmap v4085: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 83 KiB/s wr, 21 op/s 2023-05-08T05:50:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:09 smithi096 ceph-mon[124666]: pgmap v4085: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 83 KiB/s wr, 21 op/s 2023-05-08T05:50:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:09 smithi186 ceph-mon[126480]: pgmap v4085: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 83 KiB/s wr, 21 op/s 2023-05-08T05:50:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7549.568818 secs 2023-05-08T05:50:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7549.568818 secs 2023-05-08T05:50:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7549.568818 secs 2023-05-08T05:50:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:11 smithi096 ceph-mon[124666]: pgmap v4086: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 85 KiB/s wr, 24 op/s 2023-05-08T05:50:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:11 smithi096 ceph-mon[124666]: osdmap e334: 12 total, 12 up, 12 in 2023-05-08T05:50:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:11 smithi186 ceph-mon[126480]: pgmap v4086: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 85 KiB/s wr, 24 op/s 2023-05-08T05:50:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:11 smithi186 ceph-mon[126480]: osdmap e334: 12 total, 12 up, 12 in 2023-05-08T05:50:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:11 smithi133 ceph-mon[125939]: pgmap v4086: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 85 KiB/s wr, 24 op/s 2023-05-08T05:50:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:11 smithi133 ceph-mon[125939]: osdmap e334: 12 total, 12 up, 12 in 2023-05-08T05:50:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:13 smithi096 ceph-mon[124666]: pgmap v4088: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 104 KiB/s wr, 25 op/s 2023-05-08T05:50:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7552.730973 secs 2023-05-08T05:50:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7553.288370 secs 2023-05-08T05:50:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:13 smithi186 ceph-mon[126480]: pgmap v4088: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 104 KiB/s wr, 25 op/s 2023-05-08T05:50:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7552.730973 secs 2023-05-08T05:50:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7553.288370 secs 2023-05-08T05:50:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:13 smithi133 ceph-mon[125939]: pgmap v4088: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 104 KiB/s wr, 25 op/s 2023-05-08T05:50:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7552.730973 secs 2023-05-08T05:50:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7553.288370 secs 2023-05-08T05:50:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:15 smithi096 ceph-mon[124666]: pgmap v4089: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 8 op/s 2023-05-08T05:50:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7554.568937 secs 2023-05-08T05:50:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:15 smithi186 ceph-mon[126480]: pgmap v4089: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 8 op/s 2023-05-08T05:50:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7554.568937 secs 2023-05-08T05:50:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:15 smithi133 ceph-mon[125939]: pgmap v4089: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 8 op/s 2023-05-08T05:50:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7554.568937 secs 2023-05-08T05:50:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:16 smithi096 ceph-mon[124666]: pgmap v4090: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 9 op/s 2023-05-08T05:50:17.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:16 smithi186 ceph-mon[126480]: pgmap v4090: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 9 op/s 2023-05-08T05:50:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:16 smithi133 ceph-mon[125939]: pgmap v4090: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 9 op/s 2023-05-08T05:50:18.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7557.731115 secs 2023-05-08T05:50:18.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7557.731115 secs 2023-05-08T05:50:18.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7557.731115 secs 2023-05-08T05:50:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:19 smithi133 ceph-mon[125939]: pgmap v4091: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 9 op/s 2023-05-08T05:50:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7558.288499 secs 2023-05-08T05:50:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:19 smithi096 ceph-mon[124666]: pgmap v4091: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 9 op/s 2023-05-08T05:50:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7558.288499 secs 2023-05-08T05:50:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:19 smithi186 ceph-mon[126480]: pgmap v4091: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 9 op/s 2023-05-08T05:50:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7558.288499 secs 2023-05-08T05:50:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:20 smithi186 ceph-mon[126480]: osdmap e335: 12 total, 12 up, 12 in 2023-05-08T05:50:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7559.568998 secs 2023-05-08T05:50:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:20 smithi133 ceph-mon[125939]: osdmap e335: 12 total, 12 up, 12 in 2023-05-08T05:50:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7559.568998 secs 2023-05-08T05:50:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:20 smithi096 ceph-mon[124666]: osdmap e335: 12 total, 12 up, 12 in 2023-05-08T05:50:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7559.568998 secs 2023-05-08T05:50:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:21 smithi186 ceph-mon[126480]: pgmap v4093: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 85 KiB/s wr, 8 op/s 2023-05-08T05:50:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:21 smithi133 ceph-mon[125939]: pgmap v4093: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 85 KiB/s wr, 8 op/s 2023-05-08T05:50:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:21 smithi096 ceph-mon[124666]: pgmap v4093: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 85 KiB/s wr, 8 op/s 2023-05-08T05:50:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:23 smithi186 ceph-mon[126480]: pgmap v4094: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 81 KiB/s wr, 8 op/s 2023-05-08T05:50:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7562.731254 secs 2023-05-08T05:50:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:23 smithi133 ceph-mon[125939]: pgmap v4094: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 81 KiB/s wr, 8 op/s 2023-05-08T05:50:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7562.731254 secs 2023-05-08T05:50:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:23 smithi096 ceph-mon[124666]: pgmap v4094: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 81 KiB/s wr, 8 op/s 2023-05-08T05:50:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7562.731254 secs 2023-05-08T05:50:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7563.288570 secs 2023-05-08T05:50:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7563.288570 secs 2023-05-08T05:50:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7563.288570 secs 2023-05-08T05:50:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:25 smithi186 ceph-mon[126480]: pgmap v4095: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 91 KiB/s wr, 8 op/s 2023-05-08T05:50:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7564.569126 secs 2023-05-08T05:50:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:25 smithi133 ceph-mon[125939]: pgmap v4095: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 91 KiB/s wr, 8 op/s 2023-05-08T05:50:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7564.569126 secs 2023-05-08T05:50:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:25 smithi096 ceph-mon[124666]: pgmap v4095: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 91 KiB/s wr, 8 op/s 2023-05-08T05:50:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7564.569126 secs 2023-05-08T05:50:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:27 smithi186 ceph-mon[126480]: pgmap v4096: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 91 KiB/s wr, 8 op/s 2023-05-08T05:50:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:27 smithi133 ceph-mon[125939]: pgmap v4096: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 91 KiB/s wr, 8 op/s 2023-05-08T05:50:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:27 smithi096 ceph-mon[124666]: pgmap v4096: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 91 KiB/s wr, 8 op/s 2023-05-08T05:50:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7567.731365 secs 2023-05-08T05:50:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7567.731365 secs 2023-05-08T05:50:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7567.731365 secs 2023-05-08T05:50:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:29 smithi186 ceph-mon[126480]: pgmap v4097: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 91 KiB/s wr, 8 op/s 2023-05-08T05:50:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7568.288687 secs 2023-05-08T05:50:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:29 smithi133 ceph-mon[125939]: pgmap v4097: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 91 KiB/s wr, 8 op/s 2023-05-08T05:50:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7568.288687 secs 2023-05-08T05:50:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:29 smithi096 ceph-mon[124666]: pgmap v4097: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 91 KiB/s wr, 8 op/s 2023-05-08T05:50:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7568.288687 secs 2023-05-08T05:50:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7569.569238 secs 2023-05-08T05:50:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7569.569238 secs 2023-05-08T05:50:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7569.569238 secs 2023-05-08T05:50:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:31 smithi186 ceph-mon[126480]: pgmap v4098: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 85 KiB/s wr, 7 op/s 2023-05-08T05:50:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:31 smithi133 ceph-mon[125939]: pgmap v4098: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 85 KiB/s wr, 7 op/s 2023-05-08T05:50:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:31 smithi096 ceph-mon[124666]: pgmap v4098: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 85 KiB/s wr, 7 op/s 2023-05-08T05:50:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:33 smithi186 ceph-mon[126480]: pgmap v4099: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 76 KiB/s wr, 7 op/s 2023-05-08T05:50:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7572.731487 secs 2023-05-08T05:50:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:33 smithi133 ceph-mon[125939]: pgmap v4099: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 76 KiB/s wr, 7 op/s 2023-05-08T05:50:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7572.731487 secs 2023-05-08T05:50:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:33 smithi096 ceph-mon[124666]: pgmap v4099: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 76 KiB/s wr, 7 op/s 2023-05-08T05:50:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7572.731487 secs 2023-05-08T05:50:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7573.288809 secs 2023-05-08T05:50:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7573.288809 secs 2023-05-08T05:50:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7573.288809 secs 2023-05-08T05:50:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:35 smithi186 ceph-mon[126480]: pgmap v4100: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 109 KiB/s wr, 10 op/s 2023-05-08T05:50:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:35 smithi133 ceph-mon[125939]: pgmap v4100: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 109 KiB/s wr, 10 op/s 2023-05-08T05:50:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:35 smithi096 ceph-mon[124666]: pgmap v4100: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 109 KiB/s wr, 10 op/s 2023-05-08T05:50:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:37 smithi186 ceph-mon[126480]: pgmap v4101: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 74 KiB/s wr, 7 op/s 2023-05-08T05:50:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:37 smithi133 ceph-mon[125939]: pgmap v4101: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 74 KiB/s wr, 7 op/s 2023-05-08T05:50:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:37 smithi096 ceph-mon[124666]: pgmap v4101: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 74 KiB/s wr, 7 op/s 2023-05-08T05:50:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7577.731614 secs 2023-05-08T05:50:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:38 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:50:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7578.288898 secs 2023-05-08T05:50:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7577.731614 secs 2023-05-08T05:50:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:38 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:50:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7578.288898 secs 2023-05-08T05:50:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7577.731614 secs 2023-05-08T05:50:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:38 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:50:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7578.288898 secs 2023-05-08T05:50:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:39 smithi186 ceph-mon[126480]: pgmap v4102: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 73 KiB/s wr, 7 op/s 2023-05-08T05:50:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:39 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:50:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:39 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:50:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:39 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:50:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:39 smithi133 ceph-mon[125939]: pgmap v4102: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 73 KiB/s wr, 7 op/s 2023-05-08T05:50:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:39 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:50:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:39 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:50:39.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:39 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:50:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:39 smithi096 ceph-mon[124666]: pgmap v4102: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 73 KiB/s wr, 7 op/s 2023-05-08T05:50:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:39 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:50:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:39 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:50:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:39 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:50:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:41 smithi186 ceph-mon[126480]: pgmap v4103: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 170 KiB/s wr, 9 op/s 2023-05-08T05:50:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:41 smithi133 ceph-mon[125939]: pgmap v4103: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 170 KiB/s wr, 9 op/s 2023-05-08T05:50:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:41 smithi096 ceph-mon[124666]: pgmap v4103: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 170 KiB/s wr, 9 op/s 2023-05-08T05:50:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:43 smithi186 ceph-mon[126480]: pgmap v4104: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 129 KiB/s wr, 7 op/s 2023-05-08T05:50:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7582.731742 secs 2023-05-08T05:50:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:43 smithi133 ceph-mon[125939]: pgmap v4104: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 129 KiB/s wr, 7 op/s 2023-05-08T05:50:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7582.731742 secs 2023-05-08T05:50:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:43 smithi096 ceph-mon[124666]: pgmap v4104: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 129 KiB/s wr, 7 op/s 2023-05-08T05:50:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7582.731742 secs 2023-05-08T05:50:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:45 smithi186 ceph-mon[126480]: pgmap v4105: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 208 KiB/s wr, 10 op/s 2023-05-08T05:50:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:45 smithi133 ceph-mon[125939]: pgmap v4105: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 208 KiB/s wr, 10 op/s 2023-05-08T05:50:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:45 smithi096 ceph-mon[124666]: pgmap v4105: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 208 KiB/s wr, 10 op/s 2023-05-08T05:50:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:46 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:50:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:46 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:50:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:46 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:50:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:47 smithi186 ceph-mon[126480]: pgmap v4106: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 177 KiB/s wr, 7 op/s 2023-05-08T05:50:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:47 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:50:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:47 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:50:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:47 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:50:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:47 smithi133 ceph-mon[125939]: pgmap v4106: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 177 KiB/s wr, 7 op/s 2023-05-08T05:50:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:47 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:50:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:47 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:50:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:47 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:50:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:47 smithi096 ceph-mon[124666]: pgmap v4106: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 177 KiB/s wr, 7 op/s 2023-05-08T05:50:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:47 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:50:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:47 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:50:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:47 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:50:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7587.731867 secs 2023-05-08T05:50:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7587.731867 secs 2023-05-08T05:50:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7587.731867 secs 2023-05-08T05:50:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:49 smithi133 ceph-mon[125939]: pgmap v4107: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 177 KiB/s wr, 7 op/s 2023-05-08T05:50:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:49 smithi096 ceph-mon[124666]: pgmap v4107: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 177 KiB/s wr, 7 op/s 2023-05-08T05:50:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:49 smithi186 ceph-mon[126480]: pgmap v4107: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 177 KiB/s wr, 7 op/s 2023-05-08T05:50:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:51 smithi133 ceph-mon[125939]: pgmap v4108: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 294 KiB/s wr, 11 op/s 2023-05-08T05:50:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:51 smithi096 ceph-mon[124666]: pgmap v4108: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 294 KiB/s wr, 11 op/s 2023-05-08T05:50:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:51 smithi186 ceph-mon[126480]: pgmap v4108: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 294 KiB/s wr, 11 op/s 2023-05-08T05:50:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:53 smithi133 ceph-mon[125939]: pgmap v4109: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 200 KiB/s wr, 9 op/s 2023-05-08T05:50:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7592.732006 secs 2023-05-08T05:50:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7593.289275 secs 2023-05-08T05:50:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:53 smithi096 ceph-mon[124666]: pgmap v4109: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 200 KiB/s wr, 9 op/s 2023-05-08T05:50:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7592.732006 secs 2023-05-08T05:50:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7593.289275 secs 2023-05-08T05:50:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:53 smithi186 ceph-mon[126480]: pgmap v4109: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 200 KiB/s wr, 9 op/s 2023-05-08T05:50:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7592.732006 secs 2023-05-08T05:50:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7593.289275 secs 2023-05-08T05:50:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:55 smithi186 ceph-mon[126480]: pgmap v4110: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 302 KiB/s wr, 12 op/s 2023-05-08T05:50:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:55 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:50:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:55 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:50:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:55 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:50:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:55 smithi133 ceph-mon[125939]: pgmap v4110: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 302 KiB/s wr, 12 op/s 2023-05-08T05:50:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:55 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:50:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:55 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:50:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:55 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:50:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:55 smithi096 ceph-mon[124666]: pgmap v4110: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 302 KiB/s wr, 12 op/s 2023-05-08T05:50:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:55 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:50:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:55 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:50:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:55 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:50:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:57 smithi186 ceph-mon[126480]: pgmap v4111: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 223 KiB/s wr, 9 op/s 2023-05-08T05:50:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:57 smithi133 ceph-mon[125939]: pgmap v4111: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 223 KiB/s wr, 9 op/s 2023-05-08T05:50:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:57 smithi096 ceph-mon[124666]: pgmap v4111: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 223 KiB/s wr, 9 op/s 2023-05-08T05:50:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7597.732131 secs 2023-05-08T05:50:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7597.732131 secs 2023-05-08T05:50:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7597.732131 secs 2023-05-08T05:50:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:50:59 smithi186 ceph-mon[126480]: pgmap v4112: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 221 KiB/s wr, 9 op/s 2023-05-08T05:50:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:50:59 smithi133 ceph-mon[125939]: pgmap v4112: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 221 KiB/s wr, 9 op/s 2023-05-08T05:51:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:50:59 smithi096 ceph-mon[124666]: pgmap v4112: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 221 KiB/s wr, 9 op/s 2023-05-08T05:51:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7599.569894 secs 2023-05-08T05:51:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7599.569894 secs 2023-05-08T05:51:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7599.569894 secs 2023-05-08T05:51:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:01 smithi186 ceph-mon[126480]: pgmap v4113: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 429 KiB/s wr, 13 op/s 2023-05-08T05:51:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:01 smithi133 ceph-mon[125939]: pgmap v4113: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 429 KiB/s wr, 13 op/s 2023-05-08T05:51:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:01 smithi096 ceph-mon[124666]: pgmap v4113: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 429 KiB/s wr, 13 op/s 2023-05-08T05:51:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:02 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:51:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:02 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:51:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:02 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:51:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:03 smithi186 ceph-mon[126480]: pgmap v4114: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 314 KiB/s wr, 10 op/s 2023-05-08T05:51:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:51:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:51:03.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:03 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:51:03.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7602.732257 secs 2023-05-08T05:51:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:03 smithi133 ceph-mon[125939]: pgmap v4114: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 314 KiB/s wr, 10 op/s 2023-05-08T05:51:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:51:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:51:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:03 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:51:03.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7602.732257 secs 2023-05-08T05:51:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:03 smithi096 ceph-mon[124666]: pgmap v4114: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 314 KiB/s wr, 10 op/s 2023-05-08T05:51:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:51:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:51:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:03 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:51:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7602.732257 secs 2023-05-08T05:51:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7603.289451 secs 2023-05-08T05:51:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7603.289451 secs 2023-05-08T05:51:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7603.289451 secs 2023-05-08T05:51:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:05 smithi186 ceph-mon[126480]: pgmap v4115: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 395 KiB/s wr, 27 op/s 2023-05-08T05:51:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:05 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:51:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7604.569967 secs 2023-05-08T05:51:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:05 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:51:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:05 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:51:05.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:05 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:51:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:05 smithi133 ceph-mon[125939]: pgmap v4115: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 395 KiB/s wr, 27 op/s 2023-05-08T05:51:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:05 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:51:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7604.569967 secs 2023-05-08T05:51:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:05 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:51:05.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:05 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:51:05.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:05 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:51:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:05 smithi096 ceph-mon[124666]: pgmap v4115: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 395 KiB/s wr, 27 op/s 2023-05-08T05:51:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:05 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:51:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7604.569967 secs 2023-05-08T05:51:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:05 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:51:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:05 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:51:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:05 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:51:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:06 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:51:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:06 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T05:51:06.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:06 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T05:51:06.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:06 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:51:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:06 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:51:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:06 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T05:51:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:06 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T05:51:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:06 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:51:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:06 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:51:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:06 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T05:51:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:06 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T05:51:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:06 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:51:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:07 smithi186 ceph-mon[126480]: pgmap v4116: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 293 KiB/s wr, 24 op/s 2023-05-08T05:51:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:07 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:51:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:07 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:51:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:07 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:51:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:07 smithi133 ceph-mon[125939]: pgmap v4116: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 293 KiB/s wr, 24 op/s 2023-05-08T05:51:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:07 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:51:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:07 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:51:07.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:07 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:51:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:07 smithi096 ceph-mon[124666]: pgmap v4116: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 293 KiB/s wr, 24 op/s 2023-05-08T05:51:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:07 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:51:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:07 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:51:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:07 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:51:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7607.732387 secs 2023-05-08T05:51:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7607.732387 secs 2023-05-08T05:51:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7607.732387 secs 2023-05-08T05:51:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:09 smithi186 ceph-mon[126480]: pgmap v4117: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 293 KiB/s wr, 24 op/s 2023-05-08T05:51:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7608.289551 secs 2023-05-08T05:51:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:09 smithi133 ceph-mon[125939]: pgmap v4117: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 293 KiB/s wr, 24 op/s 2023-05-08T05:51:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7608.289551 secs 2023-05-08T05:51:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:09 smithi096 ceph-mon[124666]: pgmap v4117: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 293 KiB/s wr, 24 op/s 2023-05-08T05:51:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7608.289551 secs 2023-05-08T05:51:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7609.570055 secs 2023-05-08T05:51:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7609.570055 secs 2023-05-08T05:51:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7609.570055 secs 2023-05-08T05:51:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:11 smithi186 ceph-mon[126480]: pgmap v4118: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 295 KiB/s wr, 27 op/s 2023-05-08T05:51:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:11 smithi186 ceph-mon[126480]: osdmap e336: 12 total, 12 up, 12 in 2023-05-08T05:51:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:11 smithi133 ceph-mon[125939]: pgmap v4118: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 295 KiB/s wr, 27 op/s 2023-05-08T05:51:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:11 smithi133 ceph-mon[125939]: osdmap e336: 12 total, 12 up, 12 in 2023-05-08T05:51:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:11 smithi096 ceph-mon[124666]: pgmap v4118: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 295 KiB/s wr, 27 op/s 2023-05-08T05:51:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:11 smithi096 ceph-mon[124666]: osdmap e336: 12 total, 12 up, 12 in 2023-05-08T05:51:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:13 smithi186 ceph-mon[126480]: pgmap v4120: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 103 KiB/s wr, 27 op/s 2023-05-08T05:51:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7612.732509 secs 2023-05-08T05:51:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7613.289648 secs 2023-05-08T05:51:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:13 smithi133 ceph-mon[125939]: pgmap v4120: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 103 KiB/s wr, 27 op/s 2023-05-08T05:51:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7612.732509 secs 2023-05-08T05:51:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7613.289648 secs 2023-05-08T05:51:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:13 smithi096 ceph-mon[124666]: pgmap v4120: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 103 KiB/s wr, 27 op/s 2023-05-08T05:51:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7612.732509 secs 2023-05-08T05:51:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7613.289648 secs 2023-05-08T05:51:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:15 smithi186 ceph-mon[126480]: pgmap v4121: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 KiB/s wr, 9 op/s 2023-05-08T05:51:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7614.570178 secs 2023-05-08T05:51:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:15 smithi133 ceph-mon[125939]: pgmap v4121: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 KiB/s wr, 9 op/s 2023-05-08T05:51:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7614.570178 secs 2023-05-08T05:51:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:15 smithi096 ceph-mon[124666]: pgmap v4121: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 KiB/s wr, 9 op/s 2023-05-08T05:51:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7614.570178 secs 2023-05-08T05:51:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:17 smithi186 ceph-mon[126480]: pgmap v4122: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 9 op/s 2023-05-08T05:51:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:17 smithi133 ceph-mon[125939]: pgmap v4122: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 9 op/s 2023-05-08T05:51:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:17 smithi096 ceph-mon[124666]: pgmap v4122: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 9 op/s 2023-05-08T05:51:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7617.732642 secs 2023-05-08T05:51:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7618.289744 secs 2023-05-08T05:51:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7617.732642 secs 2023-05-08T05:51:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7618.289744 secs 2023-05-08T05:51:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7617.732642 secs 2023-05-08T05:51:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7618.289744 secs 2023-05-08T05:51:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:19 smithi133 ceph-mon[125939]: pgmap v4123: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 9 op/s 2023-05-08T05:51:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:19 smithi133 ceph-mon[125939]: osdmap e337: 12 total, 12 up, 12 in 2023-05-08T05:51:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:19 smithi096 ceph-mon[124666]: pgmap v4123: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 9 op/s 2023-05-08T05:51:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:19 smithi096 ceph-mon[124666]: osdmap e337: 12 total, 12 up, 12 in 2023-05-08T05:51:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:19 smithi186 ceph-mon[126480]: pgmap v4123: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 9 op/s 2023-05-08T05:51:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:19 smithi186 ceph-mon[126480]: osdmap e337: 12 total, 12 up, 12 in 2023-05-08T05:51:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7619.570291 secs 2023-05-08T05:51:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7619.570291 secs 2023-05-08T05:51:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7619.570291 secs 2023-05-08T05:51:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:21 smithi133 ceph-mon[125939]: pgmap v4125: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 101 KiB/s wr, 9 op/s 2023-05-08T05:51:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:21 smithi096 ceph-mon[124666]: pgmap v4125: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 101 KiB/s wr, 9 op/s 2023-05-08T05:51:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:21 smithi186 ceph-mon[126480]: pgmap v4125: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 101 KiB/s wr, 9 op/s 2023-05-08T05:51:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:23 smithi133 ceph-mon[125939]: pgmap v4126: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 98 KiB/s wr, 9 op/s 2023-05-08T05:51:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7622.732781 secs 2023-05-08T05:51:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7623.289820 secs 2023-05-08T05:51:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:23 smithi096 ceph-mon[124666]: pgmap v4126: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 98 KiB/s wr, 9 op/s 2023-05-08T05:51:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7622.732781 secs 2023-05-08T05:51:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7623.289820 secs 2023-05-08T05:51:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:23 smithi186 ceph-mon[126480]: pgmap v4126: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 98 KiB/s wr, 9 op/s 2023-05-08T05:51:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7622.732781 secs 2023-05-08T05:51:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7623.289820 secs 2023-05-08T05:51:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:25 smithi133 ceph-mon[125939]: pgmap v4127: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 115 KiB/s wr, 8 op/s 2023-05-08T05:51:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7624.570394 secs 2023-05-08T05:51:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:25 smithi096 ceph-mon[124666]: pgmap v4127: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 115 KiB/s wr, 8 op/s 2023-05-08T05:51:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7624.570394 secs 2023-05-08T05:51:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:25 smithi186 ceph-mon[126480]: pgmap v4127: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 115 KiB/s wr, 8 op/s 2023-05-08T05:51:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7624.570394 secs 2023-05-08T05:51:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:27 smithi133 ceph-mon[125939]: pgmap v4128: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 113 KiB/s wr, 8 op/s 2023-05-08T05:51:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:27 smithi096 ceph-mon[124666]: pgmap v4128: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 113 KiB/s wr, 8 op/s 2023-05-08T05:51:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:27 smithi186 ceph-mon[126480]: pgmap v4128: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 113 KiB/s wr, 8 op/s 2023-05-08T05:51:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7627.732932 secs 2023-05-08T05:51:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7628.289946 secs 2023-05-08T05:51:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7627.732932 secs 2023-05-08T05:51:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7628.289946 secs 2023-05-08T05:51:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7627.732932 secs 2023-05-08T05:51:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7628.289946 secs 2023-05-08T05:51:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:29 smithi133 ceph-mon[125939]: pgmap v4129: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 113 KiB/s wr, 8 op/s 2023-05-08T05:51:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:29 smithi096 ceph-mon[124666]: pgmap v4129: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 113 KiB/s wr, 8 op/s 2023-05-08T05:51:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:29 smithi186 ceph-mon[126480]: pgmap v4129: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 113 KiB/s wr, 8 op/s 2023-05-08T05:51:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7629.570513 secs 2023-05-08T05:51:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7629.570513 secs 2023-05-08T05:51:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7629.570513 secs 2023-05-08T05:51:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:31 smithi133 ceph-mon[125939]: pgmap v4130: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 86 KiB/s wr, 8 op/s 2023-05-08T05:51:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:31 smithi096 ceph-mon[124666]: pgmap v4130: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 86 KiB/s wr, 8 op/s 2023-05-08T05:51:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:31 smithi186 ceph-mon[126480]: pgmap v4130: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 86 KiB/s wr, 8 op/s 2023-05-08T05:51:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:33 smithi133 ceph-mon[125939]: pgmap v4131: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 77 KiB/s wr, 8 op/s 2023-05-08T05:51:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7632.733055 secs 2023-05-08T05:51:33.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7633.290068 secs 2023-05-08T05:51:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:33 smithi096 ceph-mon[124666]: pgmap v4131: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 77 KiB/s wr, 8 op/s 2023-05-08T05:51:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7632.733055 secs 2023-05-08T05:51:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7633.290068 secs 2023-05-08T05:51:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:33 smithi186 ceph-mon[126480]: pgmap v4131: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 77 KiB/s wr, 8 op/s 2023-05-08T05:51:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7632.733055 secs 2023-05-08T05:51:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7633.290068 secs 2023-05-08T05:51:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:35 smithi133 ceph-mon[125939]: pgmap v4132: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 135 KiB/s wr, 10 op/s 2023-05-08T05:51:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:35 smithi096 ceph-mon[124666]: pgmap v4132: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 135 KiB/s wr, 10 op/s 2023-05-08T05:51:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:35 smithi186 ceph-mon[126480]: pgmap v4132: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 135 KiB/s wr, 10 op/s 2023-05-08T05:51:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:37 smithi133 ceph-mon[125939]: pgmap v4133: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 95 KiB/s wr, 8 op/s 2023-05-08T05:51:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:37 smithi096 ceph-mon[124666]: pgmap v4133: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 95 KiB/s wr, 8 op/s 2023-05-08T05:51:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:37 smithi186 ceph-mon[126480]: pgmap v4133: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 95 KiB/s wr, 8 op/s 2023-05-08T05:51:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7637.733183 secs 2023-05-08T05:51:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:38 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:51:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7637.733183 secs 2023-05-08T05:51:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:38 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:51:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7637.733183 secs 2023-05-08T05:51:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:38 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:51:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:39 smithi133 ceph-mon[125939]: pgmap v4134: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 94 KiB/s wr, 7 op/s 2023-05-08T05:51:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:39 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:51:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:39 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:51:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:39 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:51:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:39 smithi096 ceph-mon[124666]: pgmap v4134: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 94 KiB/s wr, 7 op/s 2023-05-08T05:51:40.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:39 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:51:40.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:39 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:51:40.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:39 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:51:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:39 smithi186 ceph-mon[126480]: pgmap v4134: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 94 KiB/s wr, 7 op/s 2023-05-08T05:51:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:39 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:51:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:39 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:51:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:39 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:51:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:41 smithi133 ceph-mon[125939]: pgmap v4135: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 141 KiB/s wr, 10 op/s 2023-05-08T05:51:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:41 smithi096 ceph-mon[124666]: pgmap v4135: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 141 KiB/s wr, 10 op/s 2023-05-08T05:51:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:41 smithi186 ceph-mon[126480]: pgmap v4135: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 141 KiB/s wr, 10 op/s 2023-05-08T05:51:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:51:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:51:43.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:51:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:43 smithi133 ceph-mon[125939]: pgmap v4136: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 107 KiB/s wr, 8 op/s 2023-05-08T05:51:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:51:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:51:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7642.733299 secs 2023-05-08T05:51:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:43 smithi096 ceph-mon[124666]: pgmap v4136: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 107 KiB/s wr, 8 op/s 2023-05-08T05:51:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:51:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:51:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7642.733299 secs 2023-05-08T05:51:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:43 smithi186 ceph-mon[126480]: pgmap v4136: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 107 KiB/s wr, 8 op/s 2023-05-08T05:51:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:51:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:51:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7642.733299 secs 2023-05-08T05:51:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:44 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:51:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:44 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:51:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:44 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:51:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:45 smithi133 ceph-mon[125939]: pgmap v4137: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 302 KiB/s wr, 11 op/s 2023-05-08T05:51:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:45 smithi096 ceph-mon[124666]: pgmap v4137: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 302 KiB/s wr, 11 op/s 2023-05-08T05:51:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:45 smithi186 ceph-mon[126480]: pgmap v4137: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 302 KiB/s wr, 11 op/s 2023-05-08T05:51:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:47 smithi133 ceph-mon[125939]: pgmap v4138: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 246 KiB/s wr, 9 op/s 2023-05-08T05:51:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:47 smithi096 ceph-mon[124666]: pgmap v4138: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 246 KiB/s wr, 9 op/s 2023-05-08T05:51:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:47 smithi186 ceph-mon[126480]: pgmap v4138: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 246 KiB/s wr, 9 op/s 2023-05-08T05:51:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7647.733414 secs 2023-05-08T05:51:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7648.290431 secs 2023-05-08T05:51:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7647.733414 secs 2023-05-08T05:51:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7648.290431 secs 2023-05-08T05:51:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7647.733414 secs 2023-05-08T05:51:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7648.290431 secs 2023-05-08T05:51:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:49 smithi133 ceph-mon[125939]: pgmap v4139: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 245 KiB/s wr, 9 op/s 2023-05-08T05:51:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:49 smithi096 ceph-mon[124666]: pgmap v4139: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 245 KiB/s wr, 9 op/s 2023-05-08T05:51:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:49 smithi186 ceph-mon[126480]: pgmap v4139: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 245 KiB/s wr, 9 op/s 2023-05-08T05:51:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:51:51.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:51:51.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:51:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:51:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:51:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:51:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:51:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:51:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:51:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:51 smithi096 ceph-mon[124666]: pgmap v4140: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 290 KiB/s wr, 12 op/s 2023-05-08T05:51:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:51 smithi186 ceph-mon[126480]: pgmap v4140: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 290 KiB/s wr, 12 op/s 2023-05-08T05:51:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:51 smithi133 ceph-mon[125939]: pgmap v4140: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 290 KiB/s wr, 12 op/s 2023-05-08T05:51:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:53 smithi096 ceph-mon[124666]: pgmap v4141: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 244 KiB/s wr, 10 op/s 2023-05-08T05:51:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7652.733552 secs 2023-05-08T05:51:54.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7653.290578 secs 2023-05-08T05:51:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:53 smithi186 ceph-mon[126480]: pgmap v4141: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 244 KiB/s wr, 10 op/s 2023-05-08T05:51:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7652.733552 secs 2023-05-08T05:51:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7653.290578 secs 2023-05-08T05:51:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:53 smithi133 ceph-mon[125939]: pgmap v4141: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 244 KiB/s wr, 10 op/s 2023-05-08T05:51:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7652.733552 secs 2023-05-08T05:51:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7653.290578 secs 2023-05-08T05:51:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:55 smithi186 ceph-mon[126480]: pgmap v4142: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 371 KiB/s wr, 13 op/s 2023-05-08T05:51:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:55 smithi133 ceph-mon[125939]: pgmap v4142: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 371 KiB/s wr, 13 op/s 2023-05-08T05:51:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:55 smithi096 ceph-mon[124666]: pgmap v4142: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 371 KiB/s wr, 13 op/s 2023-05-08T05:51:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:57 smithi186 ceph-mon[126480]: pgmap v4143: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 179 KiB/s wr, 9 op/s 2023-05-08T05:51:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:57 smithi133 ceph-mon[125939]: pgmap v4143: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 179 KiB/s wr, 9 op/s 2023-05-08T05:51:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:57 smithi096 ceph-mon[124666]: pgmap v4143: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 179 KiB/s wr, 9 op/s 2023-05-08T05:51:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7657.733708 secs 2023-05-08T05:51:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7658.290687 secs 2023-05-08T05:51:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7657.733708 secs 2023-05-08T05:51:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7658.290687 secs 2023-05-08T05:51:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7657.733708 secs 2023-05-08T05:51:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7658.290687 secs 2023-05-08T05:52:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:51:59 smithi186 ceph-mon[126480]: pgmap v4144: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 177 KiB/s wr, 8 op/s 2023-05-08T05:52:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:51:59 smithi133 ceph-mon[125939]: pgmap v4144: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 177 KiB/s wr, 8 op/s 2023-05-08T05:52:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:51:59 smithi096 ceph-mon[124666]: pgmap v4144: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 177 KiB/s wr, 8 op/s 2023-05-08T05:52:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7659.571223 secs 2023-05-08T05:52:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:00 smithi186 ceph-mon[126480]: pgmap v4145: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 221 KiB/s wr, 12 op/s 2023-05-08T05:52:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7659.571223 secs 2023-05-08T05:52:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:00 smithi133 ceph-mon[125939]: pgmap v4145: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 221 KiB/s wr, 12 op/s 2023-05-08T05:52:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7659.571223 secs 2023-05-08T05:52:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:00 smithi096 ceph-mon[124666]: pgmap v4145: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 221 KiB/s wr, 12 op/s 2023-05-08T05:52:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:02 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:52:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:52:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:52:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:02 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:52:02.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:52:02.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:52:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:02 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:52:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:52:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:52:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:03 smithi133 ceph-mon[125939]: pgmap v4146: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 176 KiB/s wr, 9 op/s 2023-05-08T05:52:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7662.733816 secs 2023-05-08T05:52:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:03 smithi096 ceph-mon[124666]: pgmap v4146: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 176 KiB/s wr, 9 op/s 2023-05-08T05:52:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7662.733816 secs 2023-05-08T05:52:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:03 smithi186 ceph-mon[126480]: pgmap v4146: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 176 KiB/s wr, 9 op/s 2023-05-08T05:52:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7662.733816 secs 2023-05-08T05:52:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7663.290784 secs 2023-05-08T05:52:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7663.290784 secs 2023-05-08T05:52:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7663.290784 secs 2023-05-08T05:52:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:05 smithi186 ceph-mon[126480]: pgmap v4147: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 384 KiB/s wr, 27 op/s 2023-05-08T05:52:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7664.571342 secs 2023-05-08T05:52:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:05 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:52:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:05 smithi133 ceph-mon[125939]: pgmap v4147: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 384 KiB/s wr, 27 op/s 2023-05-08T05:52:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7664.571342 secs 2023-05-08T05:52:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:05 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:52:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:05 smithi096 ceph-mon[124666]: pgmap v4147: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 384 KiB/s wr, 27 op/s 2023-05-08T05:52:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7664.571342 secs 2023-05-08T05:52:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:05 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:52:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:06 smithi186 ceph-mon[126480]: osdmap e338: 12 total, 12 up, 12 in 2023-05-08T05:52:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:06 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:52:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:06 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:52:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:06 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:52:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:06 smithi133 ceph-mon[125939]: osdmap e338: 12 total, 12 up, 12 in 2023-05-08T05:52:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:06 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:52:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:06 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:52:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:06 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:52:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:06 smithi096 ceph-mon[124666]: osdmap e338: 12 total, 12 up, 12 in 2023-05-08T05:52:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:06 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:52:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:06 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:52:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:06 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:52:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:07 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:52:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:07 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T05:52:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:07 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T05:52:07.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:07 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:52:07.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:07 smithi186 ceph-mon[126480]: pgmap v4149: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 303 KiB/s wr, 28 op/s 2023-05-08T05:52:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:07 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:52:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:07 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T05:52:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:07 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T05:52:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:07 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:52:07.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:07 smithi133 ceph-mon[125939]: pgmap v4149: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 303 KiB/s wr, 28 op/s 2023-05-08T05:52:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:07 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:52:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:07 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T05:52:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:07 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T05:52:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:07 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:52:08.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:07 smithi096 ceph-mon[124666]: pgmap v4149: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 303 KiB/s wr, 28 op/s 2023-05-08T05:52:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7667.733910 secs 2023-05-08T05:52:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7667.733910 secs 2023-05-08T05:52:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7667.733910 secs 2023-05-08T05:52:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:09 smithi186 ceph-mon[126480]: pgmap v4150: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 303 KiB/s wr, 28 op/s 2023-05-08T05:52:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7668.290928 secs 2023-05-08T05:52:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:09 smithi133 ceph-mon[125939]: pgmap v4150: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 303 KiB/s wr, 28 op/s 2023-05-08T05:52:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7668.290928 secs 2023-05-08T05:52:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:09 smithi096 ceph-mon[124666]: pgmap v4150: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 303 KiB/s wr, 28 op/s 2023-05-08T05:52:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7668.290928 secs 2023-05-08T05:52:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7669.571469 secs 2023-05-08T05:52:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7669.571469 secs 2023-05-08T05:52:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7669.571469 secs 2023-05-08T05:52:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:11 smithi186 ceph-mon[126480]: pgmap v4151: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 291 KiB/s wr, 28 op/s 2023-05-08T05:52:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:11 smithi133 ceph-mon[125939]: pgmap v4151: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 291 KiB/s wr, 28 op/s 2023-05-08T05:52:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:11 smithi096 ceph-mon[124666]: pgmap v4151: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 291 KiB/s wr, 28 op/s 2023-05-08T05:52:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:13 smithi186 ceph-mon[126480]: pgmap v4152: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 291 KiB/s wr, 28 op/s 2023-05-08T05:52:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7672.734026 secs 2023-05-08T05:52:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:13 smithi133 ceph-mon[125939]: pgmap v4152: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 291 KiB/s wr, 28 op/s 2023-05-08T05:52:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7672.734026 secs 2023-05-08T05:52:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:13 smithi096 ceph-mon[124666]: pgmap v4152: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 291 KiB/s wr, 28 op/s 2023-05-08T05:52:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7672.734026 secs 2023-05-08T05:52:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7673.291064 secs 2023-05-08T05:52:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:14 smithi186 ceph-mon[126480]: osdmap e339: 12 total, 12 up, 12 in 2023-05-08T05:52:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7673.291064 secs 2023-05-08T05:52:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:14 smithi133 ceph-mon[125939]: osdmap e339: 12 total, 12 up, 12 in 2023-05-08T05:52:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7673.291064 secs 2023-05-08T05:52:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:14 smithi096 ceph-mon[124666]: osdmap e339: 12 total, 12 up, 12 in 2023-05-08T05:52:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:15 smithi186 ceph-mon[126480]: pgmap v4153: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 75 KiB/s wr, 9 op/s 2023-05-08T05:52:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7674.571556 secs 2023-05-08T05:52:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:15 smithi133 ceph-mon[125939]: pgmap v4153: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 75 KiB/s wr, 9 op/s 2023-05-08T05:52:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7674.571556 secs 2023-05-08T05:52:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:15 smithi096 ceph-mon[124666]: pgmap v4153: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 75 KiB/s wr, 9 op/s 2023-05-08T05:52:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7674.571556 secs 2023-05-08T05:52:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:17 smithi186 ceph-mon[126480]: pgmap v4155: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 75 KiB/s wr, 9 op/s 2023-05-08T05:52:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:17 smithi133 ceph-mon[125939]: pgmap v4155: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 75 KiB/s wr, 9 op/s 2023-05-08T05:52:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:17 smithi096 ceph-mon[124666]: pgmap v4155: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 75 KiB/s wr, 9 op/s 2023-05-08T05:52:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7677.734164 secs 2023-05-08T05:52:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7678.291159 secs 2023-05-08T05:52:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7677.734164 secs 2023-05-08T05:52:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7678.291159 secs 2023-05-08T05:52:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7677.734164 secs 2023-05-08T05:52:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7678.291159 secs 2023-05-08T05:52:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:19 smithi186 ceph-mon[126480]: pgmap v4156: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 75 KiB/s wr, 9 op/s 2023-05-08T05:52:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:19 smithi133 ceph-mon[125939]: pgmap v4156: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 75 KiB/s wr, 9 op/s 2023-05-08T05:52:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:19 smithi096 ceph-mon[124666]: pgmap v4156: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 75 KiB/s wr, 9 op/s 2023-05-08T05:52:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7679.571683 secs 2023-05-08T05:52:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7679.571683 secs 2023-05-08T05:52:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7679.571683 secs 2023-05-08T05:52:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:21 smithi133 ceph-mon[125939]: pgmap v4157: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 83 KiB/s wr, 8 op/s 2023-05-08T05:52:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:21 smithi096 ceph-mon[124666]: pgmap v4157: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 83 KiB/s wr, 8 op/s 2023-05-08T05:52:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:21 smithi186 ceph-mon[126480]: pgmap v4157: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 83 KiB/s wr, 8 op/s 2023-05-08T05:52:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:23 smithi133 ceph-mon[125939]: pgmap v4158: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 83 KiB/s wr, 8 op/s 2023-05-08T05:52:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7682.734261 secs 2023-05-08T05:52:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7683.291272 secs 2023-05-08T05:52:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:23 smithi096 ceph-mon[124666]: pgmap v4158: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 83 KiB/s wr, 8 op/s 2023-05-08T05:52:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7682.734261 secs 2023-05-08T05:52:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7683.291272 secs 2023-05-08T05:52:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:23 smithi186 ceph-mon[126480]: pgmap v4158: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 83 KiB/s wr, 8 op/s 2023-05-08T05:52:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7682.734261 secs 2023-05-08T05:52:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7683.291272 secs 2023-05-08T05:52:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:25 smithi133 ceph-mon[125939]: pgmap v4159: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 112 KiB/s wr, 8 op/s 2023-05-08T05:52:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7684.571829 secs 2023-05-08T05:52:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:25 smithi096 ceph-mon[124666]: pgmap v4159: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 112 KiB/s wr, 8 op/s 2023-05-08T05:52:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7684.571829 secs 2023-05-08T05:52:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:25 smithi186 ceph-mon[126480]: pgmap v4159: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 112 KiB/s wr, 8 op/s 2023-05-08T05:52:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7684.571829 secs 2023-05-08T05:52:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:27 smithi133 ceph-mon[125939]: pgmap v4160: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 95 KiB/s wr, 7 op/s 2023-05-08T05:52:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:27 smithi096 ceph-mon[124666]: pgmap v4160: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 95 KiB/s wr, 7 op/s 2023-05-08T05:52:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:27 smithi186 ceph-mon[126480]: pgmap v4160: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 95 KiB/s wr, 7 op/s 2023-05-08T05:52:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7687.734377 secs 2023-05-08T05:52:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7688.291369 secs 2023-05-08T05:52:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7687.734377 secs 2023-05-08T05:52:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7688.291369 secs 2023-05-08T05:52:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7687.734377 secs 2023-05-08T05:52:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7688.291369 secs 2023-05-08T05:52:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:29 smithi133 ceph-mon[125939]: pgmap v4161: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 93 KiB/s wr, 7 op/s 2023-05-08T05:52:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:29 smithi096 ceph-mon[124666]: pgmap v4161: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 93 KiB/s wr, 7 op/s 2023-05-08T05:52:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:29 smithi186 ceph-mon[126480]: pgmap v4161: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 93 KiB/s wr, 7 op/s 2023-05-08T05:52:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7689.571984 secs 2023-05-08T05:52:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7689.571984 secs 2023-05-08T05:52:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7689.571984 secs 2023-05-08T05:52:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:31 smithi133 ceph-mon[125939]: pgmap v4162: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 93 KiB/s wr, 9 op/s 2023-05-08T05:52:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:31 smithi096 ceph-mon[124666]: pgmap v4162: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 93 KiB/s wr, 9 op/s 2023-05-08T05:52:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:31 smithi186 ceph-mon[126480]: pgmap v4162: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 93 KiB/s wr, 9 op/s 2023-05-08T05:52:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:33 smithi133 ceph-mon[125939]: pgmap v4163: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 52 KiB/s wr, 7 op/s 2023-05-08T05:52:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7692.734483 secs 2023-05-08T05:52:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7693.291505 secs 2023-05-08T05:52:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:33 smithi096 ceph-mon[124666]: pgmap v4163: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 52 KiB/s wr, 7 op/s 2023-05-08T05:52:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7692.734483 secs 2023-05-08T05:52:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7693.291505 secs 2023-05-08T05:52:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:33 smithi186 ceph-mon[126480]: pgmap v4163: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 52 KiB/s wr, 7 op/s 2023-05-08T05:52:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7692.734483 secs 2023-05-08T05:52:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7693.291505 secs 2023-05-08T05:52:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:35 smithi133 ceph-mon[125939]: pgmap v4164: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 115 KiB/s wr, 9 op/s 2023-05-08T05:52:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:35 smithi096 ceph-mon[124666]: pgmap v4164: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 115 KiB/s wr, 9 op/s 2023-05-08T05:52:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:35 smithi186 ceph-mon[126480]: pgmap v4164: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 115 KiB/s wr, 9 op/s 2023-05-08T05:52:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:37 smithi133 ceph-mon[125939]: pgmap v4165: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 131 KiB/s wr, 7 op/s 2023-05-08T05:52:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:37 smithi096 ceph-mon[124666]: pgmap v4165: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 131 KiB/s wr, 7 op/s 2023-05-08T05:52:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:37 smithi186 ceph-mon[126480]: pgmap v4165: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 131 KiB/s wr, 7 op/s 2023-05-08T05:52:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7697.734597 secs 2023-05-08T05:52:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:38 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:52:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7698.291614 secs 2023-05-08T05:52:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7697.734597 secs 2023-05-08T05:52:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:38 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:52:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7698.291614 secs 2023-05-08T05:52:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7697.734597 secs 2023-05-08T05:52:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:38 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:52:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7698.291614 secs 2023-05-08T05:52:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:39 smithi133 ceph-mon[125939]: pgmap v4166: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 131 KiB/s wr, 6 op/s 2023-05-08T05:52:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:39 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:52:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:39 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:52:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:39 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:52:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:39 smithi096 ceph-mon[124666]: pgmap v4166: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 131 KiB/s wr, 6 op/s 2023-05-08T05:52:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:39 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:52:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:39 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:52:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:39 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:52:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:39 smithi186 ceph-mon[126480]: pgmap v4166: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 131 KiB/s wr, 6 op/s 2023-05-08T05:52:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:39 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:52:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:39 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:52:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:39 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:52:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:41 smithi133 ceph-mon[125939]: pgmap v4167: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 133 KiB/s wr, 9 op/s 2023-05-08T05:52:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:41 smithi096 ceph-mon[124666]: pgmap v4167: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 133 KiB/s wr, 9 op/s 2023-05-08T05:52:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:41 smithi186 ceph-mon[126480]: pgmap v4167: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 133 KiB/s wr, 9 op/s 2023-05-08T05:52:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:43 smithi133 ceph-mon[125939]: pgmap v4168: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 272 KiB/s wr, 8 op/s 2023-05-08T05:52:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7702.734698 secs 2023-05-08T05:52:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:43 smithi096 ceph-mon[124666]: pgmap v4168: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 272 KiB/s wr, 8 op/s 2023-05-08T05:52:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7702.734698 secs 2023-05-08T05:52:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:43 smithi186 ceph-mon[126480]: pgmap v4168: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 272 KiB/s wr, 8 op/s 2023-05-08T05:52:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7702.734698 secs 2023-05-08T05:52:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:45 smithi133 ceph-mon[125939]: pgmap v4169: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 273 KiB/s wr, 11 op/s 2023-05-08T05:52:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:45 smithi096 ceph-mon[124666]: pgmap v4169: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 273 KiB/s wr, 11 op/s 2023-05-08T05:52:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:45 smithi186 ceph-mon[126480]: pgmap v4169: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 273 KiB/s wr, 11 op/s 2023-05-08T05:52:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:46 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:52:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:46 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:52:47.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:46 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:52:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:47 smithi133 ceph-mon[125939]: pgmap v4170: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 284 KiB/s rd, 222 KiB/s wr, 10 op/s 2023-05-08T05:52:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:47 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:52:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:47 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:52:47.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:47 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:52:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:47 smithi096 ceph-mon[124666]: pgmap v4170: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 284 KiB/s rd, 222 KiB/s wr, 10 op/s 2023-05-08T05:52:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:47 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:52:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:47 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:52:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:47 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:52:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:47 smithi186 ceph-mon[126480]: pgmap v4170: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 284 KiB/s rd, 222 KiB/s wr, 10 op/s 2023-05-08T05:52:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:47 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:52:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:47 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:52:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:47 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:52:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7707.734833 secs 2023-05-08T05:52:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7708.291822 secs 2023-05-08T05:52:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7707.734833 secs 2023-05-08T05:52:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7708.291822 secs 2023-05-08T05:52:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7707.734833 secs 2023-05-08T05:52:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7708.291822 secs 2023-05-08T05:52:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:49 smithi133 ceph-mon[125939]: pgmap v4171: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 155 KiB/s wr, 9 op/s 2023-05-08T05:52:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:49 smithi096 ceph-mon[124666]: pgmap v4171: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 155 KiB/s wr, 9 op/s 2023-05-08T05:52:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:49 smithi186 ceph-mon[126480]: pgmap v4171: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 155 KiB/s wr, 9 op/s 2023-05-08T05:52:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:51 smithi133 ceph-mon[125939]: pgmap v4172: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 155 KiB/s wr, 12 op/s 2023-05-08T05:52:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:52:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:52:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:51 smithi096 ceph-mon[124666]: pgmap v4172: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 155 KiB/s wr, 12 op/s 2023-05-08T05:52:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:52:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:52:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:51 smithi186 ceph-mon[126480]: pgmap v4172: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 155 KiB/s wr, 12 op/s 2023-05-08T05:52:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:52:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:52:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:53 smithi133 ceph-mon[125939]: pgmap v4173: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 280 KiB/s wr, 12 op/s 2023-05-08T05:52:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7712.734949 secs 2023-05-08T05:52:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:53 smithi096 ceph-mon[124666]: pgmap v4173: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 280 KiB/s wr, 12 op/s 2023-05-08T05:52:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7712.734949 secs 2023-05-08T05:52:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:53 smithi186 ceph-mon[126480]: pgmap v4173: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 280 KiB/s wr, 12 op/s 2023-05-08T05:52:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7712.734949 secs 2023-05-08T05:52:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:54 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:52:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:54 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:52:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:54 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:52:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:54 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:52:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:54 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:52:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:54 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:52:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:55 smithi133 ceph-mon[125939]: pgmap v4174: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 228 KiB/s wr, 14 op/s 2023-05-08T05:52:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:55 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:52:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:55 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:52:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:55 smithi096 ceph-mon[124666]: pgmap v4174: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 228 KiB/s wr, 14 op/s 2023-05-08T05:52:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:55 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:52:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:55 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:52:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:55 smithi186 ceph-mon[126480]: pgmap v4174: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 228 KiB/s wr, 14 op/s 2023-05-08T05:52:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:55 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:52:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:55 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:52:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:57 smithi133 ceph-mon[125939]: pgmap v4175: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 229 KiB/s wr, 11 op/s 2023-05-08T05:52:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:57 smithi096 ceph-mon[124666]: pgmap v4175: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 229 KiB/s wr, 11 op/s 2023-05-08T05:52:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:57 smithi186 ceph-mon[126480]: pgmap v4175: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 229 KiB/s wr, 11 op/s 2023-05-08T05:52:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7717.735068 secs 2023-05-08T05:52:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7718.292053 secs 2023-05-08T05:52:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7717.735068 secs 2023-05-08T05:52:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7718.292053 secs 2023-05-08T05:52:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7717.735068 secs 2023-05-08T05:52:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7718.292053 secs 2023-05-08T05:52:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:59 smithi133 ceph-mon[125939]: pgmap v4176: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 217 KiB/s wr, 10 op/s 2023-05-08T05:52:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:52:59 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:53:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:59 smithi096 ceph-mon[124666]: pgmap v4176: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 217 KiB/s wr, 10 op/s 2023-05-08T05:53:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:52:59 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:53:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:59 smithi186 ceph-mon[126480]: pgmap v4176: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 217 KiB/s wr, 10 op/s 2023-05-08T05:53:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:52:59 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:53:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7719.572750 secs 2023-05-08T05:53:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7719.572750 secs 2023-05-08T05:53:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7719.572750 secs 2023-05-08T05:53:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:01 smithi133 ceph-mon[125939]: pgmap v4177: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 377 KiB/s rd, 362 KiB/s wr, 13 op/s 2023-05-08T05:53:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:01 smithi096 ceph-mon[124666]: pgmap v4177: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 377 KiB/s rd, 362 KiB/s wr, 13 op/s 2023-05-08T05:53:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:01 smithi186 ceph-mon[126480]: pgmap v4177: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 377 KiB/s rd, 362 KiB/s wr, 13 op/s 2023-05-08T05:53:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:03 smithi133 ceph-mon[125939]: pgmap v4178: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 362 KiB/s wr, 11 op/s 2023-05-08T05:53:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:53:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:53:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:03 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:53:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7722.735180 secs 2023-05-08T05:53:03.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7723.292210 secs 2023-05-08T05:53:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:03 smithi096 ceph-mon[124666]: pgmap v4178: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 362 KiB/s wr, 11 op/s 2023-05-08T05:53:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:53:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:53:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:03 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:53:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7722.735180 secs 2023-05-08T05:53:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7723.292210 secs 2023-05-08T05:53:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:03 smithi186 ceph-mon[126480]: pgmap v4178: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 362 KiB/s wr, 11 op/s 2023-05-08T05:53:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:53:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:53:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:03 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:53:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7722.735180 secs 2023-05-08T05:53:04.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7723.292210 secs 2023-05-08T05:53:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:04 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:53:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:04 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:53:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:04 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:53:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:05 smithi096 ceph-mon[124666]: pgmap v4179: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 320 KiB/s wr, 26 op/s 2023-05-08T05:53:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7724.572883 secs 2023-05-08T05:53:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:05 smithi186 ceph-mon[126480]: pgmap v4179: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 320 KiB/s wr, 26 op/s 2023-05-08T05:53:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7724.572883 secs 2023-05-08T05:53:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:05 smithi133 ceph-mon[125939]: pgmap v4179: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 320 KiB/s wr, 26 op/s 2023-05-08T05:53:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7724.572883 secs 2023-05-08T05:53:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:06 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:53:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:06 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:53:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:06 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:53:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:07 smithi096 ceph-mon[124666]: pgmap v4180: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 233 KiB/s wr, 24 op/s 2023-05-08T05:53:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:07 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:53:08.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:07 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:53:08.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:07 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:53:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:07 smithi186 ceph-mon[126480]: pgmap v4180: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 233 KiB/s wr, 24 op/s 2023-05-08T05:53:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:07 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:53:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:07 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:53:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:07 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:53:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:07 smithi133 ceph-mon[125939]: pgmap v4180: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 233 KiB/s wr, 24 op/s 2023-05-08T05:53:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:07 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:53:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:07 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:53:08.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:07 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:53:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:08 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:53:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:08 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T05:53:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:08 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T05:53:09.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:08 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:53:09.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7727.735284 secs 2023-05-08T05:53:09.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7728.292344 secs 2023-05-08T05:53:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:08 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:53:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:08 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T05:53:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:08 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T05:53:09.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:08 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:53:09.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7727.735284 secs 2023-05-08T05:53:09.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7728.292344 secs 2023-05-08T05:53:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:08 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:53:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:08 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T05:53:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:08 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T05:53:09.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:08 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:53:09.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7727.735284 secs 2023-05-08T05:53:09.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7728.292344 secs 2023-05-08T05:53:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:09 smithi186 ceph-mon[126480]: pgmap v4181: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 231 KiB/s wr, 22 op/s 2023-05-08T05:53:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:09 smithi133 ceph-mon[125939]: pgmap v4181: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 231 KiB/s wr, 22 op/s 2023-05-08T05:53:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:09 smithi096 ceph-mon[124666]: pgmap v4181: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 231 KiB/s wr, 22 op/s 2023-05-08T05:53:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7729.573003 secs 2023-05-08T05:53:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7729.573003 secs 2023-05-08T05:53:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7729.573003 secs 2023-05-08T05:53:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:11 smithi186 ceph-mon[126480]: pgmap v4182: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 258 KiB/s wr, 25 op/s 2023-05-08T05:53:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:11 smithi186 ceph-mon[126480]: osdmap e340: 12 total, 12 up, 12 in 2023-05-08T05:53:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:11 smithi133 ceph-mon[125939]: pgmap v4182: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 258 KiB/s wr, 25 op/s 2023-05-08T05:53:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:11 smithi133 ceph-mon[125939]: osdmap e340: 12 total, 12 up, 12 in 2023-05-08T05:53:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:11 smithi096 ceph-mon[124666]: pgmap v4182: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 258 KiB/s wr, 25 op/s 2023-05-08T05:53:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:11 smithi096 ceph-mon[124666]: osdmap e340: 12 total, 12 up, 12 in 2023-05-08T05:53:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:13 smithi186 ceph-mon[126480]: pgmap v4184: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 135 KiB/s wr, 26 op/s 2023-05-08T05:53:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7732.735352 secs 2023-05-08T05:53:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7733.292459 secs 2023-05-08T05:53:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:13 smithi133 ceph-mon[125939]: pgmap v4184: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 135 KiB/s wr, 26 op/s 2023-05-08T05:53:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7732.735352 secs 2023-05-08T05:53:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7733.292459 secs 2023-05-08T05:53:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:13 smithi096 ceph-mon[124666]: pgmap v4184: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 135 KiB/s wr, 26 op/s 2023-05-08T05:53:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7732.735352 secs 2023-05-08T05:53:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7733.292459 secs 2023-05-08T05:53:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:15 smithi186 ceph-mon[126480]: pgmap v4185: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 40 KiB/s wr, 8 op/s 2023-05-08T05:53:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7734.573150 secs 2023-05-08T05:53:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:15 smithi133 ceph-mon[125939]: pgmap v4185: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 40 KiB/s wr, 8 op/s 2023-05-08T05:53:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7734.573150 secs 2023-05-08T05:53:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:15 smithi096 ceph-mon[124666]: pgmap v4185: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 40 KiB/s wr, 8 op/s 2023-05-08T05:53:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7734.573150 secs 2023-05-08T05:53:17.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:16 smithi186 ceph-mon[126480]: pgmap v4186: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 42 KiB/s wr, 7 op/s 2023-05-08T05:53:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:16 smithi133 ceph-mon[125939]: pgmap v4186: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 42 KiB/s wr, 7 op/s 2023-05-08T05:53:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:16 smithi096 ceph-mon[124666]: pgmap v4186: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 42 KiB/s wr, 7 op/s 2023-05-08T05:53:18.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7737.735467 secs 2023-05-08T05:53:18.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7737.735467 secs 2023-05-08T05:53:18.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7737.735467 secs 2023-05-08T05:53:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:19 smithi133 ceph-mon[125939]: pgmap v4187: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 42 KiB/s wr, 7 op/s 2023-05-08T05:53:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7738.292565 secs 2023-05-08T05:53:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:19 smithi096 ceph-mon[124666]: pgmap v4187: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 42 KiB/s wr, 7 op/s 2023-05-08T05:53:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7738.292565 secs 2023-05-08T05:53:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:19 smithi186 ceph-mon[126480]: pgmap v4187: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 42 KiB/s wr, 7 op/s 2023-05-08T05:53:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7738.292565 secs 2023-05-08T05:53:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:20 smithi186 ceph-mon[126480]: osdmap e341: 12 total, 12 up, 12 in 2023-05-08T05:53:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7739.573276 secs 2023-05-08T05:53:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:20 smithi133 ceph-mon[125939]: osdmap e341: 12 total, 12 up, 12 in 2023-05-08T05:53:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7739.573276 secs 2023-05-08T05:53:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:20 smithi096 ceph-mon[124666]: osdmap e341: 12 total, 12 up, 12 in 2023-05-08T05:53:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7739.573276 secs 2023-05-08T05:53:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:21 smithi186 ceph-mon[126480]: pgmap v4189: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 63 KiB/s wr, 8 op/s 2023-05-08T05:53:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:21 smithi133 ceph-mon[125939]: pgmap v4189: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 63 KiB/s wr, 8 op/s 2023-05-08T05:53:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:21 smithi096 ceph-mon[124666]: pgmap v4189: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 63 KiB/s wr, 8 op/s 2023-05-08T05:53:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:23 smithi186 ceph-mon[126480]: pgmap v4190: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 60 KiB/s wr, 8 op/s 2023-05-08T05:53:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7742.735587 secs 2023-05-08T05:53:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:23 smithi133 ceph-mon[125939]: pgmap v4190: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 60 KiB/s wr, 8 op/s 2023-05-08T05:53:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7742.735587 secs 2023-05-08T05:53:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:23 smithi096 ceph-mon[124666]: pgmap v4190: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 60 KiB/s wr, 8 op/s 2023-05-08T05:53:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7742.735587 secs 2023-05-08T05:53:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7743.292643 secs 2023-05-08T05:53:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7743.292643 secs 2023-05-08T05:53:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7743.292643 secs 2023-05-08T05:53:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:25 smithi186 ceph-mon[126480]: pgmap v4191: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 53 KiB/s wr, 9 op/s 2023-05-08T05:53:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7744.573411 secs 2023-05-08T05:53:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:25 smithi133 ceph-mon[125939]: pgmap v4191: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 53 KiB/s wr, 9 op/s 2023-05-08T05:53:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7744.573411 secs 2023-05-08T05:53:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:25 smithi096 ceph-mon[124666]: pgmap v4191: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 53 KiB/s wr, 9 op/s 2023-05-08T05:53:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7744.573411 secs 2023-05-08T05:53:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:27 smithi133 ceph-mon[125939]: pgmap v4192: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 9 op/s 2023-05-08T05:53:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:27 smithi096 ceph-mon[124666]: pgmap v4192: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 9 op/s 2023-05-08T05:53:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:27 smithi186 ceph-mon[126480]: pgmap v4192: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 9 op/s 2023-05-08T05:53:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7747.735710 secs 2023-05-08T05:53:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7748.292767 secs 2023-05-08T05:53:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7747.735710 secs 2023-05-08T05:53:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7748.292767 secs 2023-05-08T05:53:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7747.735710 secs 2023-05-08T05:53:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7748.292767 secs 2023-05-08T05:53:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:29 smithi133 ceph-mon[125939]: pgmap v4193: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 9 op/s 2023-05-08T05:53:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:29 smithi096 ceph-mon[124666]: pgmap v4193: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 9 op/s 2023-05-08T05:53:30.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:29 smithi186 ceph-mon[126480]: pgmap v4193: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 9 op/s 2023-05-08T05:53:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7749.573531 secs 2023-05-08T05:53:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7749.573531 secs 2023-05-08T05:53:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7749.573531 secs 2023-05-08T05:53:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:31 smithi133 ceph-mon[125939]: pgmap v4194: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 107 KiB/s wr, 8 op/s 2023-05-08T05:53:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:31 smithi096 ceph-mon[124666]: pgmap v4194: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 107 KiB/s wr, 8 op/s 2023-05-08T05:53:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:31 smithi186 ceph-mon[126480]: pgmap v4194: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 107 KiB/s wr, 8 op/s 2023-05-08T05:53:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:33 smithi133 ceph-mon[125939]: pgmap v4195: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 96 KiB/s wr, 7 op/s 2023-05-08T05:53:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7752.735825 secs 2023-05-08T05:53:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7753.292884 secs 2023-05-08T05:53:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:33 smithi096 ceph-mon[124666]: pgmap v4195: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 96 KiB/s wr, 7 op/s 2023-05-08T05:53:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7752.735825 secs 2023-05-08T05:53:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7753.292884 secs 2023-05-08T05:53:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:33 smithi186 ceph-mon[126480]: pgmap v4195: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 96 KiB/s wr, 7 op/s 2023-05-08T05:53:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7752.735825 secs 2023-05-08T05:53:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7753.292884 secs 2023-05-08T05:53:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:35 smithi133 ceph-mon[125939]: pgmap v4196: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 96 KiB/s wr, 9 op/s 2023-05-08T05:53:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7754.573657 secs 2023-05-08T05:53:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:35 smithi096 ceph-mon[124666]: pgmap v4196: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 96 KiB/s wr, 9 op/s 2023-05-08T05:53:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7754.573657 secs 2023-05-08T05:53:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:35 smithi186 ceph-mon[126480]: pgmap v4196: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 96 KiB/s wr, 9 op/s 2023-05-08T05:53:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7754.573657 secs 2023-05-08T05:53:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:37 smithi133 ceph-mon[125939]: pgmap v4197: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 96 KiB/s wr, 7 op/s 2023-05-08T05:53:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:37 smithi096 ceph-mon[124666]: pgmap v4197: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 96 KiB/s wr, 7 op/s 2023-05-08T05:53:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:37 smithi186 ceph-mon[126480]: pgmap v4197: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 96 KiB/s wr, 7 op/s 2023-05-08T05:53:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7757.735937 secs 2023-05-08T05:53:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7758.292982 secs 2023-05-08T05:53:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7757.735937 secs 2023-05-08T05:53:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7758.292982 secs 2023-05-08T05:53:39.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7757.735937 secs 2023-05-08T05:53:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7758.292982 secs 2023-05-08T05:53:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:39 smithi133 ceph-mon[125939]: pgmap v4198: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 96 KiB/s wr, 6 op/s 2023-05-08T05:53:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:39 smithi096 ceph-mon[124666]: pgmap v4198: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 96 KiB/s wr, 6 op/s 2023-05-08T05:53:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:39 smithi186 ceph-mon[126480]: pgmap v4198: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 96 KiB/s wr, 6 op/s 2023-05-08T05:53:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:41 smithi133 ceph-mon[125939]: pgmap v4199: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 140 KiB/s wr, 8 op/s 2023-05-08T05:53:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:41 smithi096 ceph-mon[124666]: pgmap v4199: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 140 KiB/s wr, 8 op/s 2023-05-08T05:53:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:41 smithi186 ceph-mon[126480]: pgmap v4199: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 140 KiB/s wr, 8 op/s 2023-05-08T05:53:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:53:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:53:43.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:53:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:43 smithi133 ceph-mon[125939]: pgmap v4200: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 45 KiB/s wr, 6 op/s 2023-05-08T05:53:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:43 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:53:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:53:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:53:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7762.736060 secs 2023-05-08T05:53:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:43 smithi096 ceph-mon[124666]: pgmap v4200: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 45 KiB/s wr, 6 op/s 2023-05-08T05:53:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:43 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:53:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:53:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:53:44.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7762.736060 secs 2023-05-08T05:53:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:43 smithi186 ceph-mon[126480]: pgmap v4200: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 45 KiB/s wr, 6 op/s 2023-05-08T05:53:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:43 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:53:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:53:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:53:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7762.736060 secs 2023-05-08T05:53:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:45 smithi133 ceph-mon[125939]: pgmap v4201: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 125 KiB/s wr, 9 op/s 2023-05-08T05:53:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:45 smithi096 ceph-mon[124666]: pgmap v4201: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 125 KiB/s wr, 9 op/s 2023-05-08T05:53:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:45 smithi186 ceph-mon[126480]: pgmap v4201: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 125 KiB/s wr, 9 op/s 2023-05-08T05:53:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:46 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:53:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:46 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:53:47.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:46 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:53:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:47 smithi133 ceph-mon[125939]: pgmap v4202: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 127 KiB/s wr, 7 op/s 2023-05-08T05:53:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:47 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:53:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:47 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:53:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:47 smithi096 ceph-mon[124666]: pgmap v4202: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 127 KiB/s wr, 7 op/s 2023-05-08T05:53:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:47 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:53:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:47 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:53:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:47 smithi186 ceph-mon[126480]: pgmap v4202: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 127 KiB/s wr, 7 op/s 2023-05-08T05:53:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:47 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:53:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:47 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:53:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7767.736172 secs 2023-05-08T05:53:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7767.736172 secs 2023-05-08T05:53:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7767.736172 secs 2023-05-08T05:53:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:49 smithi133 ceph-mon[125939]: pgmap v4203: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 127 KiB/s wr, 6 op/s 2023-05-08T05:53:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:49 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:53:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:49 smithi096 ceph-mon[124666]: pgmap v4203: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 127 KiB/s wr, 6 op/s 2023-05-08T05:53:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:49 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:53:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:49 smithi186 ceph-mon[126480]: pgmap v4203: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 127 KiB/s wr, 6 op/s 2023-05-08T05:53:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:49 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:53:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:51 smithi133 ceph-mon[125939]: pgmap v4204: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 366 KiB/s wr, 11 op/s 2023-05-08T05:53:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:51 smithi096 ceph-mon[124666]: pgmap v4204: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 366 KiB/s wr, 11 op/s 2023-05-08T05:53:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:51 smithi186 ceph-mon[126480]: pgmap v4204: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 366 KiB/s wr, 11 op/s 2023-05-08T05:53:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:53 smithi133 ceph-mon[125939]: pgmap v4205: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 340 KiB/s rd, 323 KiB/s wr, 9 op/s 2023-05-08T05:53:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7772.736307 secs 2023-05-08T05:53:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7773.293339 secs 2023-05-08T05:53:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:53 smithi096 ceph-mon[124666]: pgmap v4205: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 340 KiB/s rd, 323 KiB/s wr, 9 op/s 2023-05-08T05:53:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7772.736307 secs 2023-05-08T05:53:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7773.293339 secs 2023-05-08T05:53:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:53 smithi186 ceph-mon[126480]: pgmap v4205: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 340 KiB/s rd, 323 KiB/s wr, 9 op/s 2023-05-08T05:53:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7772.736307 secs 2023-05-08T05:53:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7773.293339 secs 2023-05-08T05:53:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:55 smithi186 ceph-mon[126480]: pgmap v4206: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 444 KiB/s rd, 426 KiB/s wr, 13 op/s 2023-05-08T05:53:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:55 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:53:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:55 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:53:55.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:55 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:53:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:55 smithi133 ceph-mon[125939]: pgmap v4206: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 444 KiB/s rd, 426 KiB/s wr, 13 op/s 2023-05-08T05:53:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:55 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:53:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:55 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:53:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:55 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:53:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:55 smithi096 ceph-mon[124666]: pgmap v4206: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 444 KiB/s rd, 426 KiB/s wr, 13 op/s 2023-05-08T05:53:56.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:55 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:53:56.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:55 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:53:56.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:55 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:53:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:57 smithi186 ceph-mon[126480]: pgmap v4207: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 346 KiB/s wr, 10 op/s 2023-05-08T05:53:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:57 smithi133 ceph-mon[125939]: pgmap v4207: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 346 KiB/s wr, 10 op/s 2023-05-08T05:53:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:57 smithi096 ceph-mon[124666]: pgmap v4207: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 346 KiB/s wr, 10 op/s 2023-05-08T05:53:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7777.736382 secs 2023-05-08T05:53:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7777.736382 secs 2023-05-08T05:53:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7777.736382 secs 2023-05-08T05:53:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:53:59 smithi186 ceph-mon[126480]: pgmap v4208: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 344 KiB/s wr, 10 op/s 2023-05-08T05:53:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:53:59 smithi133 ceph-mon[125939]: pgmap v4208: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 344 KiB/s wr, 10 op/s 2023-05-08T05:54:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:53:59 smithi096 ceph-mon[124666]: pgmap v4208: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 344 KiB/s wr, 10 op/s 2023-05-08T05:54:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7779.574291 secs 2023-05-08T05:54:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7779.574291 secs 2023-05-08T05:54:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7779.574291 secs 2023-05-08T05:54:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:01 smithi133 ceph-mon[125939]: pgmap v4209: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 476 KiB/s rd, 459 KiB/s wr, 14 op/s 2023-05-08T05:54:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:01 smithi096 ceph-mon[124666]: pgmap v4209: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 476 KiB/s rd, 459 KiB/s wr, 14 op/s 2023-05-08T05:54:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:01 smithi186 ceph-mon[126480]: pgmap v4209: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 476 KiB/s rd, 459 KiB/s wr, 14 op/s 2023-05-08T05:54:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:02 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:54:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:02 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:54:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:02 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:54:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:03 smithi133 ceph-mon[125939]: pgmap v4210: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 222 KiB/s wr, 10 op/s 2023-05-08T05:54:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:54:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:54:03.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:03 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:54:03.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7782.736499 secs 2023-05-08T05:54:03.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7783.293549 secs 2023-05-08T05:54:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:03 smithi096 ceph-mon[124666]: pgmap v4210: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 222 KiB/s wr, 10 op/s 2023-05-08T05:54:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:54:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:54:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:03 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:54:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7782.736499 secs 2023-05-08T05:54:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7783.293549 secs 2023-05-08T05:54:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:03 smithi186 ceph-mon[126480]: pgmap v4210: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 222 KiB/s wr, 10 op/s 2023-05-08T05:54:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:54:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:54:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:03 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:54:04.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7782.736499 secs 2023-05-08T05:54:04.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7783.293549 secs 2023-05-08T05:54:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:05 smithi133 ceph-mon[125939]: pgmap v4211: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 358 KiB/s wr, 28 op/s 2023-05-08T05:54:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7784.574422 secs 2023-05-08T05:54:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:05 smithi096 ceph-mon[124666]: pgmap v4211: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 358 KiB/s wr, 28 op/s 2023-05-08T05:54:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7784.574422 secs 2023-05-08T05:54:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:05 smithi186 ceph-mon[126480]: pgmap v4211: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 358 KiB/s wr, 28 op/s 2023-05-08T05:54:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7784.574422 secs 2023-05-08T05:54:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:06 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:54:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:54:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:54:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:06 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:54:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:54:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:54:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:06 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:54:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:54:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:54:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:07 smithi133 ceph-mon[125939]: pgmap v4212: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 256 KiB/s wr, 25 op/s 2023-05-08T05:54:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:07 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:54:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:07 smithi096 ceph-mon[124666]: pgmap v4212: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 256 KiB/s wr, 25 op/s 2023-05-08T05:54:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:07 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:54:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:07 smithi186 ceph-mon[126480]: pgmap v4212: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 256 KiB/s wr, 25 op/s 2023-05-08T05:54:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:07 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:54:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:08 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:54:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:08 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:54:08.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:08 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:54:08.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:08 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:54:08.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:08 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T05:54:08.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:08 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T05:54:08.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:08 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:54:08.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7787.736563 secs 2023-05-08T05:54:08.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7788.293667 secs 2023-05-08T05:54:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:08 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:54:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:08 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:54:09.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:08 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:54:09.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:08 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:54:09.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:08 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T05:54:09.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:08 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T05:54:09.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:08 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:54:09.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7787.736563 secs 2023-05-08T05:54:09.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7788.293667 secs 2023-05-08T05:54:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:08 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:54:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:08 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:54:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:08 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:54:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:08 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:54:09.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:08 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T05:54:09.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:08 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T05:54:09.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:08 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:54:09.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7787.736563 secs 2023-05-08T05:54:09.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7788.293667 secs 2023-05-08T05:54:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:09 smithi133 ceph-mon[125939]: pgmap v4213: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 255 KiB/s wr, 24 op/s 2023-05-08T05:54:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:09 smithi096 ceph-mon[124666]: pgmap v4213: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 255 KiB/s wr, 24 op/s 2023-05-08T05:54:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:09 smithi186 ceph-mon[126480]: pgmap v4213: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 255 KiB/s wr, 24 op/s 2023-05-08T05:54:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7789.574483 secs 2023-05-08T05:54:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7789.574483 secs 2023-05-08T05:54:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7789.574483 secs 2023-05-08T05:54:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:11 smithi133 ceph-mon[125939]: pgmap v4214: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 285 KiB/s wr, 27 op/s 2023-05-08T05:54:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:11 smithi133 ceph-mon[125939]: osdmap e342: 12 total, 12 up, 12 in 2023-05-08T05:54:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:11 smithi096 ceph-mon[124666]: pgmap v4214: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 285 KiB/s wr, 27 op/s 2023-05-08T05:54:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:11 smithi096 ceph-mon[124666]: osdmap e342: 12 total, 12 up, 12 in 2023-05-08T05:54:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:11 smithi186 ceph-mon[126480]: pgmap v4214: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 285 KiB/s wr, 27 op/s 2023-05-08T05:54:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:11 smithi186 ceph-mon[126480]: osdmap e342: 12 total, 12 up, 12 in 2023-05-08T05:54:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:13 smithi133 ceph-mon[125939]: pgmap v4216: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 201 KiB/s wr, 27 op/s 2023-05-08T05:54:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7792.736685 secs 2023-05-08T05:54:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7793.293783 secs 2023-05-08T05:54:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:13 smithi096 ceph-mon[124666]: pgmap v4216: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 201 KiB/s wr, 27 op/s 2023-05-08T05:54:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7792.736685 secs 2023-05-08T05:54:14.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7793.293783 secs 2023-05-08T05:54:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:13 smithi186 ceph-mon[126480]: pgmap v4216: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 201 KiB/s wr, 27 op/s 2023-05-08T05:54:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7792.736685 secs 2023-05-08T05:54:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7793.293783 secs 2023-05-08T05:54:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:15 smithi133 ceph-mon[125939]: pgmap v4217: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 8 op/s 2023-05-08T05:54:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7794.574619 secs 2023-05-08T05:54:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:15 smithi096 ceph-mon[124666]: pgmap v4217: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 8 op/s 2023-05-08T05:54:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7794.574619 secs 2023-05-08T05:54:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:15 smithi186 ceph-mon[126480]: pgmap v4217: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 8 op/s 2023-05-08T05:54:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7794.574619 secs 2023-05-08T05:54:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:17 smithi096 ceph-mon[124666]: pgmap v4218: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 8 op/s 2023-05-08T05:54:18.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:17 smithi186 ceph-mon[126480]: pgmap v4218: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 8 op/s 2023-05-08T05:54:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:17 smithi133 ceph-mon[125939]: pgmap v4218: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 8 op/s 2023-05-08T05:54:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7797.736800 secs 2023-05-08T05:54:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7798.293918 secs 2023-05-08T05:54:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7797.736800 secs 2023-05-08T05:54:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7798.293918 secs 2023-05-08T05:54:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7797.736800 secs 2023-05-08T05:54:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7798.293918 secs 2023-05-08T05:54:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:19 smithi096 ceph-mon[124666]: pgmap v4219: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 8 op/s 2023-05-08T05:54:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:19 smithi096 ceph-mon[124666]: osdmap e343: 12 total, 12 up, 12 in 2023-05-08T05:54:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:19 smithi186 ceph-mon[126480]: pgmap v4219: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 8 op/s 2023-05-08T05:54:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:19 smithi186 ceph-mon[126480]: osdmap e343: 12 total, 12 up, 12 in 2023-05-08T05:54:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:19 smithi133 ceph-mon[125939]: pgmap v4219: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 8 op/s 2023-05-08T05:54:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:19 smithi133 ceph-mon[125939]: osdmap e343: 12 total, 12 up, 12 in 2023-05-08T05:54:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7799.574761 secs 2023-05-08T05:54:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7799.574761 secs 2023-05-08T05:54:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7799.574761 secs 2023-05-08T05:54:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:21 smithi186 ceph-mon[126480]: pgmap v4221: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 637 B/s wr, 7 op/s 2023-05-08T05:54:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:21 smithi133 ceph-mon[125939]: pgmap v4221: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 637 B/s wr, 7 op/s 2023-05-08T05:54:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:21 smithi096 ceph-mon[124666]: pgmap v4221: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 637 B/s wr, 7 op/s 2023-05-08T05:54:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:23 smithi186 ceph-mon[126480]: pgmap v4222: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 614 B/s wr, 7 op/s 2023-05-08T05:54:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7802.736891 secs 2023-05-08T05:54:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7803.294050 secs 2023-05-08T05:54:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:23 smithi133 ceph-mon[125939]: pgmap v4222: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 614 B/s wr, 7 op/s 2023-05-08T05:54:24.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7802.736891 secs 2023-05-08T05:54:24.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7803.294050 secs 2023-05-08T05:54:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:23 smithi096 ceph-mon[124666]: pgmap v4222: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 614 B/s wr, 7 op/s 2023-05-08T05:54:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7802.736891 secs 2023-05-08T05:54:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7803.294050 secs 2023-05-08T05:54:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:25 smithi186 ceph-mon[126480]: pgmap v4223: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 511 B/s wr, 7 op/s 2023-05-08T05:54:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7804.574865 secs 2023-05-08T05:54:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:25 smithi133 ceph-mon[125939]: pgmap v4223: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 511 B/s wr, 7 op/s 2023-05-08T05:54:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7804.574865 secs 2023-05-08T05:54:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:25 smithi096 ceph-mon[124666]: pgmap v4223: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 511 B/s wr, 7 op/s 2023-05-08T05:54:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7804.574865 secs 2023-05-08T05:54:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:27 smithi186 ceph-mon[126480]: pgmap v4224: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 818 B/s wr, 7 op/s 2023-05-08T05:54:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:27 smithi133 ceph-mon[125939]: pgmap v4224: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 818 B/s wr, 7 op/s 2023-05-08T05:54:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:27 smithi096 ceph-mon[124666]: pgmap v4224: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 818 B/s wr, 7 op/s 2023-05-08T05:54:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7807.737008 secs 2023-05-08T05:54:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7808.294163 secs 2023-05-08T05:54:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7807.737008 secs 2023-05-08T05:54:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7808.294163 secs 2023-05-08T05:54:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7807.737008 secs 2023-05-08T05:54:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7808.294163 secs 2023-05-08T05:54:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:29 smithi186 ceph-mon[126480]: pgmap v4225: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 818 B/s wr, 7 op/s 2023-05-08T05:54:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:29 smithi133 ceph-mon[125939]: pgmap v4225: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 818 B/s wr, 7 op/s 2023-05-08T05:54:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:29 smithi096 ceph-mon[124666]: pgmap v4225: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 818 B/s wr, 7 op/s 2023-05-08T05:54:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7809.574986 secs 2023-05-08T05:54:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7809.574986 secs 2023-05-08T05:54:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7809.574986 secs 2023-05-08T05:54:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:31 smithi186 ceph-mon[126480]: pgmap v4226: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 48 KiB/s wr, 8 op/s 2023-05-08T05:54:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:31 smithi133 ceph-mon[125939]: pgmap v4226: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 48 KiB/s wr, 8 op/s 2023-05-08T05:54:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:31 smithi096 ceph-mon[124666]: pgmap v4226: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 48 KiB/s wr, 8 op/s 2023-05-08T05:54:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:33 smithi186 ceph-mon[126480]: pgmap v4227: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 43 KiB/s wr, 7 op/s 2023-05-08T05:54:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7812.737095 secs 2023-05-08T05:54:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7813.294280 secs 2023-05-08T05:54:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:33 smithi133 ceph-mon[125939]: pgmap v4227: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 43 KiB/s wr, 7 op/s 2023-05-08T05:54:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7812.737095 secs 2023-05-08T05:54:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7813.294280 secs 2023-05-08T05:54:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:33 smithi096 ceph-mon[124666]: pgmap v4227: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 43 KiB/s wr, 7 op/s 2023-05-08T05:54:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7812.737095 secs 2023-05-08T05:54:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7813.294280 secs 2023-05-08T05:54:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:35 smithi186 ceph-mon[126480]: pgmap v4228: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 43 KiB/s wr, 9 op/s 2023-05-08T05:54:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7814.575115 secs 2023-05-08T05:54:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:35 smithi133 ceph-mon[125939]: pgmap v4228: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 43 KiB/s wr, 9 op/s 2023-05-08T05:54:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7814.575115 secs 2023-05-08T05:54:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:35 smithi096 ceph-mon[124666]: pgmap v4228: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 43 KiB/s wr, 9 op/s 2023-05-08T05:54:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7814.575115 secs 2023-05-08T05:54:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:37 smithi186 ceph-mon[126480]: pgmap v4229: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 43 KiB/s wr, 7 op/s 2023-05-08T05:54:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:37 smithi133 ceph-mon[125939]: pgmap v4229: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 43 KiB/s wr, 7 op/s 2023-05-08T05:54:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:37 smithi096 ceph-mon[124666]: pgmap v4229: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 43 KiB/s wr, 7 op/s 2023-05-08T05:54:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7817.737146 secs 2023-05-08T05:54:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7817.737146 secs 2023-05-08T05:54:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7817.737146 secs 2023-05-08T05:54:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:39 smithi133 ceph-mon[125939]: pgmap v4230: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 43 KiB/s wr, 7 op/s 2023-05-08T05:54:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7818.294396 secs 2023-05-08T05:54:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:39 smithi096 ceph-mon[124666]: pgmap v4230: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 43 KiB/s wr, 7 op/s 2023-05-08T05:54:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7818.294396 secs 2023-05-08T05:54:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:39 smithi186 ceph-mon[126480]: pgmap v4230: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 43 KiB/s wr, 7 op/s 2023-05-08T05:54:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7818.294396 secs 2023-05-08T05:54:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:41 smithi133 ceph-mon[125939]: pgmap v4231: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 177 KiB/s wr, 10 op/s 2023-05-08T05:54:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:41 smithi096 ceph-mon[124666]: pgmap v4231: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 177 KiB/s wr, 10 op/s 2023-05-08T05:54:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:41 smithi186 ceph-mon[126480]: pgmap v4231: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 177 KiB/s wr, 10 op/s 2023-05-08T05:54:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:54:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:54:43.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:54:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:43 smithi133 ceph-mon[125939]: pgmap v4232: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 137 KiB/s wr, 7 op/s 2023-05-08T05:54:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:43 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:54:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:54:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:54:43.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7822.737291 secs 2023-05-08T05:54:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:43 smithi096 ceph-mon[124666]: pgmap v4232: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 137 KiB/s wr, 7 op/s 2023-05-08T05:54:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:43 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:54:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:54:44.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:54:44.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7822.737291 secs 2023-05-08T05:54:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:43 smithi186 ceph-mon[126480]: pgmap v4232: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 137 KiB/s wr, 7 op/s 2023-05-08T05:54:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:43 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:54:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:54:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:54:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7822.737291 secs 2023-05-08T05:54:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:45 smithi133 ceph-mon[125939]: pgmap v4233: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 199 KiB/s wr, 11 op/s 2023-05-08T05:54:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:45 smithi096 ceph-mon[124666]: pgmap v4233: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 199 KiB/s wr, 11 op/s 2023-05-08T05:54:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:45 smithi186 ceph-mon[126480]: pgmap v4233: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 199 KiB/s wr, 11 op/s 2023-05-08T05:54:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:46 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:54:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:46 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:54:47.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:46 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:54:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:47 smithi133 ceph-mon[125939]: pgmap v4234: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 199 KiB/s wr, 9 op/s 2023-05-08T05:54:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:47 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:54:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:47 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:54:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:47 smithi096 ceph-mon[124666]: pgmap v4234: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 199 KiB/s wr, 9 op/s 2023-05-08T05:54:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:47 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:54:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:47 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:54:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:47 smithi186 ceph-mon[126480]: pgmap v4234: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 199 KiB/s wr, 9 op/s 2023-05-08T05:54:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:47 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:54:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:47 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:54:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7827.737423 secs 2023-05-08T05:54:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7828.294627 secs 2023-05-08T05:54:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7827.737423 secs 2023-05-08T05:54:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7828.294627 secs 2023-05-08T05:54:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7827.737423 secs 2023-05-08T05:54:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7828.294627 secs 2023-05-08T05:54:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:49 smithi133 ceph-mon[125939]: pgmap v4235: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 198 KiB/s wr, 8 op/s 2023-05-08T05:54:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:49 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:54:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:49 smithi096 ceph-mon[124666]: pgmap v4235: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 198 KiB/s wr, 8 op/s 2023-05-08T05:54:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:49 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:54:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:49 smithi186 ceph-mon[126480]: pgmap v4235: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 198 KiB/s wr, 8 op/s 2023-05-08T05:54:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:49 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:54:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:51 smithi133 ceph-mon[125939]: pgmap v4236: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 396 KiB/s rd, 362 KiB/s wr, 12 op/s 2023-05-08T05:54:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:54:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:54:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:51 smithi096 ceph-mon[124666]: pgmap v4236: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 396 KiB/s rd, 362 KiB/s wr, 12 op/s 2023-05-08T05:54:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:54:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:54:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:51 smithi186 ceph-mon[126480]: pgmap v4236: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 396 KiB/s rd, 362 KiB/s wr, 12 op/s 2023-05-08T05:54:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:54:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:54:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:53 smithi133 ceph-mon[125939]: pgmap v4237: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 265 KiB/s rd, 231 KiB/s wr, 10 op/s 2023-05-08T05:54:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7832.737561 secs 2023-05-08T05:54:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:53 smithi096 ceph-mon[124666]: pgmap v4237: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 265 KiB/s rd, 231 KiB/s wr, 10 op/s 2023-05-08T05:54:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7832.737561 secs 2023-05-08T05:54:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:53 smithi186 ceph-mon[126480]: pgmap v4237: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 265 KiB/s rd, 231 KiB/s wr, 10 op/s 2023-05-08T05:54:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7832.737561 secs 2023-05-08T05:54:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:54 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:54:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:54 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:54:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:54 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:54:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:54 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:54:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:54 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:54:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:54 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:54:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:55 smithi133 ceph-mon[125939]: pgmap v4238: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 282 KiB/s wr, 14 op/s 2023-05-08T05:54:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:55 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:54:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:55 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:54:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:55 smithi096 ceph-mon[124666]: pgmap v4238: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 282 KiB/s wr, 14 op/s 2023-05-08T05:54:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:55 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:54:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:55 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:54:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:55 smithi186 ceph-mon[126480]: pgmap v4238: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 282 KiB/s wr, 14 op/s 2023-05-08T05:54:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:55 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:54:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:55 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:54:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:57 smithi133 ceph-mon[125939]: pgmap v4239: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 222 KiB/s wr, 10 op/s 2023-05-08T05:54:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:57 smithi096 ceph-mon[124666]: pgmap v4239: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 222 KiB/s wr, 10 op/s 2023-05-08T05:54:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:57 smithi186 ceph-mon[126480]: pgmap v4239: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 222 KiB/s wr, 10 op/s 2023-05-08T05:54:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7837.737681 secs 2023-05-08T05:54:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7838.294849 secs 2023-05-08T05:54:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7837.737681 secs 2023-05-08T05:54:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7838.294849 secs 2023-05-08T05:54:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7837.737681 secs 2023-05-08T05:54:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7838.294849 secs 2023-05-08T05:54:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:59 smithi133 ceph-mon[125939]: pgmap v4240: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 222 KiB/s wr, 10 op/s 2023-05-08T05:54:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:54:59 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:55:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:59 smithi096 ceph-mon[124666]: pgmap v4240: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 222 KiB/s wr, 10 op/s 2023-05-08T05:55:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:54:59 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:55:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:59 smithi186 ceph-mon[126480]: pgmap v4240: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 222 KiB/s wr, 10 op/s 2023-05-08T05:55:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:54:59 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:55:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7839.575682 secs 2023-05-08T05:55:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7839.575682 secs 2023-05-08T05:55:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7839.575682 secs 2023-05-08T05:55:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:01 smithi133 ceph-mon[125939]: pgmap v4241: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 352 KiB/s rd, 347 KiB/s wr, 13 op/s 2023-05-08T05:55:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:01 smithi096 ceph-mon[124666]: pgmap v4241: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 352 KiB/s rd, 347 KiB/s wr, 13 op/s 2023-05-08T05:55:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:01 smithi186 ceph-mon[126480]: pgmap v4241: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 352 KiB/s rd, 347 KiB/s wr, 13 op/s 2023-05-08T05:55:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:03 smithi133 ceph-mon[125939]: pgmap v4242: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 184 KiB/s wr, 10 op/s 2023-05-08T05:55:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:55:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:55:03.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:03 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:55:03.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7842.737756 secs 2023-05-08T05:55:03.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7843.294984 secs 2023-05-08T05:55:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:03 smithi096 ceph-mon[124666]: pgmap v4242: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 184 KiB/s wr, 10 op/s 2023-05-08T05:55:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:55:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:55:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:03 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:55:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7842.737756 secs 2023-05-08T05:55:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7843.294984 secs 2023-05-08T05:55:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:03 smithi186 ceph-mon[126480]: pgmap v4242: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 184 KiB/s wr, 10 op/s 2023-05-08T05:55:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:55:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:55:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:03 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:55:04.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7842.737756 secs 2023-05-08T05:55:04.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7843.294984 secs 2023-05-08T05:55:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:04 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:55:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:04 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:55:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:04 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:55:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:05 smithi133 ceph-mon[125939]: pgmap v4243: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 320 KiB/s wr, 27 op/s 2023-05-08T05:55:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7844.575817 secs 2023-05-08T05:55:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:05 smithi096 ceph-mon[124666]: pgmap v4243: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 320 KiB/s wr, 27 op/s 2023-05-08T05:55:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7844.575817 secs 2023-05-08T05:55:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:05 smithi186 ceph-mon[126480]: pgmap v4243: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 320 KiB/s wr, 27 op/s 2023-05-08T05:55:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7844.575817 secs 2023-05-08T05:55:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:07 smithi133 ceph-mon[125939]: pgmap v4244: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 266 KiB/s wr, 23 op/s 2023-05-08T05:55:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:07 smithi096 ceph-mon[124666]: pgmap v4244: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 266 KiB/s wr, 23 op/s 2023-05-08T05:55:08.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:07 smithi186 ceph-mon[126480]: pgmap v4244: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 266 KiB/s wr, 23 op/s 2023-05-08T05:55:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:08 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:55:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7847.737852 secs 2023-05-08T05:55:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7848.295071 secs 2023-05-08T05:55:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:08 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:55:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7847.737852 secs 2023-05-08T05:55:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7848.295071 secs 2023-05-08T05:55:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:08 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:55:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7847.737852 secs 2023-05-08T05:55:09.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7848.295071 secs 2023-05-08T05:55:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:09 smithi133 ceph-mon[125939]: pgmap v4245: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 264 KiB/s wr, 22 op/s 2023-05-08T05:55:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:09 smithi096 ceph-mon[124666]: pgmap v4245: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 264 KiB/s wr, 22 op/s 2023-05-08T05:55:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:09 smithi186 ceph-mon[126480]: pgmap v4245: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 264 KiB/s wr, 22 op/s 2023-05-08T05:55:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7849.575878 secs 2023-05-08T05:55:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:10 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:55:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:10 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:55:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:10 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:55:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:10 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:55:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7849.575878 secs 2023-05-08T05:55:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:10 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:55:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:10 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:55:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:10 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:55:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:10 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:55:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7849.575878 secs 2023-05-08T05:55:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:10 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:55:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:10 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:55:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:10 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:55:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:10 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:55:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:11 smithi133 ceph-mon[125939]: pgmap v4246: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 266 KiB/s wr, 26 op/s 2023-05-08T05:55:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:11 smithi133 ceph-mon[125939]: osdmap e344: 12 total, 12 up, 12 in 2023-05-08T05:55:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:11 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:55:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:11 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:55:11.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:11 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:55:11.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:11 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:55:11.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:11 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:55:11.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:11 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:55:11.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:11 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:55:11.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:11 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:55:11.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:11 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:55:11.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:11 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:55:11.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:11 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:55:11.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:11 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:55:11.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:11 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:55:11.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:11 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:55:11.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:11 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:55:11.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:11 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:55:11.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:11 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:55:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:11 smithi096 ceph-mon[124666]: pgmap v4246: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 266 KiB/s wr, 26 op/s 2023-05-08T05:55:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:11 smithi096 ceph-mon[124666]: osdmap e344: 12 total, 12 up, 12 in 2023-05-08T05:55:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:11 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:55:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:11 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:55:12.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:11 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:55:12.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:11 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:55:12.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:11 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:55:12.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:11 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:55:12.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:11 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:55:12.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:11 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:55:12.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:11 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:55:12.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:11 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:55:12.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:11 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:55:12.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:11 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:55:12.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:11 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:55:12.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:11 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:55:12.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:11 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:55:12.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:11 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:55:12.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:11 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:55:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:11 smithi186 ceph-mon[126480]: pgmap v4246: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 266 KiB/s wr, 26 op/s 2023-05-08T05:55:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:11 smithi186 ceph-mon[126480]: osdmap e344: 12 total, 12 up, 12 in 2023-05-08T05:55:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:11 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:55:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:11 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:55:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:11 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:55:12.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:11 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:55:12.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:11 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:55:12.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:11 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:55:12.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:11 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:55:12.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:11 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:55:12.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:11 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:55:12.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:11 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:55:12.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:11 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:55:12.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:11 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:55:12.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:11 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:55:12.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:11 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T05:55:12.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:11 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:55:12.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:11 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:55:12.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:11 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:55:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:12 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T05:55:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:12 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T05:55:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:12 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi096 to 196.2M 2023-05-08T05:55:12.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:12 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi096 to 205766758: error parsing value: Value '205766758' is below minimum 939524096 2023-05-08T05:55:12.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:12 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T05:55:12.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:12 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T05:55:12.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:12 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:55:12.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:12 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T05:55:12.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:12 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T05:55:12.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:12 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:55:13.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:12 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T05:55:13.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:12 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T05:55:13.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:12 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi096 to 196.2M 2023-05-08T05:55:13.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:12 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi096 to 205766758: error parsing value: Value '205766758' is below minimum 939524096 2023-05-08T05:55:13.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:12 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T05:55:13.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:12 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T05:55:13.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:12 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:55:13.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:12 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T05:55:13.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:12 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T05:55:13.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:12 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:55:13.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:12 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T05:55:13.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:12 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T05:55:13.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:12 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi096 to 196.2M 2023-05-08T05:55:13.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:12 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi096 to 205766758: error parsing value: Value '205766758' is below minimum 939524096 2023-05-08T05:55:13.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:12 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T05:55:13.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:12 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T05:55:13.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:12 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:55:13.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:12 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T05:55:13.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:12 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T05:55:13.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:12 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:55:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:13 smithi133 ceph-mon[125939]: pgmap v4248: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 169 KiB/s wr, 26 op/s 2023-05-08T05:55:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7852.737966 secs 2023-05-08T05:55:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7853.295206 secs 2023-05-08T05:55:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:13 smithi096 ceph-mon[124666]: pgmap v4248: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 169 KiB/s wr, 26 op/s 2023-05-08T05:55:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7852.737966 secs 2023-05-08T05:55:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7853.295206 secs 2023-05-08T05:55:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:13 smithi186 ceph-mon[126480]: pgmap v4248: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 169 KiB/s wr, 26 op/s 2023-05-08T05:55:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7852.737966 secs 2023-05-08T05:55:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7853.295206 secs 2023-05-08T05:55:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:15 smithi133 ceph-mon[125939]: pgmap v4249: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 9 op/s 2023-05-08T05:55:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7854.575964 secs 2023-05-08T05:55:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:15 smithi096 ceph-mon[124666]: pgmap v4249: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 9 op/s 2023-05-08T05:55:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7854.575964 secs 2023-05-08T05:55:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:15 smithi186 ceph-mon[126480]: pgmap v4249: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 9 op/s 2023-05-08T05:55:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7854.575964 secs 2023-05-08T05:55:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:17 smithi096 ceph-mon[124666]: pgmap v4250: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 39 KiB/s wr, 9 op/s 2023-05-08T05:55:18.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:17 smithi186 ceph-mon[126480]: pgmap v4250: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 39 KiB/s wr, 9 op/s 2023-05-08T05:55:18.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:17 smithi133 ceph-mon[125939]: pgmap v4250: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 39 KiB/s wr, 9 op/s 2023-05-08T05:55:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7857.738083 secs 2023-05-08T05:55:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7858.295318 secs 2023-05-08T05:55:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7857.738083 secs 2023-05-08T05:55:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7858.295318 secs 2023-05-08T05:55:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7857.738083 secs 2023-05-08T05:55:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7858.295318 secs 2023-05-08T05:55:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:19 smithi096 ceph-mon[124666]: pgmap v4251: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 39 KiB/s wr, 9 op/s 2023-05-08T05:55:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:19 smithi096 ceph-mon[124666]: osdmap e345: 12 total, 12 up, 12 in 2023-05-08T05:55:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:19 smithi186 ceph-mon[126480]: pgmap v4251: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 39 KiB/s wr, 9 op/s 2023-05-08T05:55:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:19 smithi186 ceph-mon[126480]: osdmap e345: 12 total, 12 up, 12 in 2023-05-08T05:55:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:19 smithi133 ceph-mon[125939]: pgmap v4251: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 39 KiB/s wr, 9 op/s 2023-05-08T05:55:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:19 smithi133 ceph-mon[125939]: osdmap e345: 12 total, 12 up, 12 in 2023-05-08T05:55:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7859.576039 secs 2023-05-08T05:55:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7859.576039 secs 2023-05-08T05:55:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7859.576039 secs 2023-05-08T05:55:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:21 smithi186 ceph-mon[126480]: pgmap v4253: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 90 KiB/s wr, 9 op/s 2023-05-08T05:55:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:21 smithi133 ceph-mon[125939]: pgmap v4253: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 90 KiB/s wr, 9 op/s 2023-05-08T05:55:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:21 smithi096 ceph-mon[124666]: pgmap v4253: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 90 KiB/s wr, 9 op/s 2023-05-08T05:55:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:23 smithi186 ceph-mon[126480]: pgmap v4254: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 87 KiB/s wr, 9 op/s 2023-05-08T05:55:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7862.738198 secs 2023-05-08T05:55:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7863.295433 secs 2023-05-08T05:55:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:23 smithi133 ceph-mon[125939]: pgmap v4254: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 87 KiB/s wr, 9 op/s 2023-05-08T05:55:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7862.738198 secs 2023-05-08T05:55:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7863.295433 secs 2023-05-08T05:55:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:23 smithi096 ceph-mon[124666]: pgmap v4254: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 87 KiB/s wr, 9 op/s 2023-05-08T05:55:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7862.738198 secs 2023-05-08T05:55:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7863.295433 secs 2023-05-08T05:55:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:25 smithi186 ceph-mon[126480]: pgmap v4255: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 8 op/s 2023-05-08T05:55:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7864.576162 secs 2023-05-08T05:55:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:25 smithi133 ceph-mon[125939]: pgmap v4255: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 8 op/s 2023-05-08T05:55:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7864.576162 secs 2023-05-08T05:55:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:25 smithi096 ceph-mon[124666]: pgmap v4255: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 8 op/s 2023-05-08T05:55:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7864.576162 secs 2023-05-08T05:55:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:27 smithi186 ceph-mon[126480]: pgmap v4256: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 KiB/s wr, 8 op/s 2023-05-08T05:55:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:27 smithi133 ceph-mon[125939]: pgmap v4256: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 KiB/s wr, 8 op/s 2023-05-08T05:55:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:27 smithi096 ceph-mon[124666]: pgmap v4256: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 KiB/s wr, 8 op/s 2023-05-08T05:55:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7867.738300 secs 2023-05-08T05:55:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7868.295569 secs 2023-05-08T05:55:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7867.738300 secs 2023-05-08T05:55:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7868.295569 secs 2023-05-08T05:55:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7867.738300 secs 2023-05-08T05:55:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7868.295569 secs 2023-05-08T05:55:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:29 smithi186 ceph-mon[126480]: pgmap v4257: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 KiB/s wr, 8 op/s 2023-05-08T05:55:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:29 smithi133 ceph-mon[125939]: pgmap v4257: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 KiB/s wr, 8 op/s 2023-05-08T05:55:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:29 smithi096 ceph-mon[124666]: pgmap v4257: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 KiB/s wr, 8 op/s 2023-05-08T05:55:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7869.576273 secs 2023-05-08T05:55:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7869.576273 secs 2023-05-08T05:55:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7869.576273 secs 2023-05-08T05:55:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:31 smithi186 ceph-mon[126480]: pgmap v4258: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 48 KiB/s wr, 7 op/s 2023-05-08T05:55:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:31 smithi133 ceph-mon[125939]: pgmap v4258: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 48 KiB/s wr, 7 op/s 2023-05-08T05:55:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:31 smithi096 ceph-mon[124666]: pgmap v4258: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 48 KiB/s wr, 7 op/s 2023-05-08T05:55:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:33 smithi186 ceph-mon[126480]: pgmap v4259: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 43 KiB/s wr, 6 op/s 2023-05-08T05:55:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:33 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:55:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7873.295686 secs 2023-05-08T05:55:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:33 smithi133 ceph-mon[125939]: pgmap v4259: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 43 KiB/s wr, 6 op/s 2023-05-08T05:55:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:33 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:55:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7873.295686 secs 2023-05-08T05:55:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:33 smithi096 ceph-mon[124666]: pgmap v4259: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 43 KiB/s wr, 6 op/s 2023-05-08T05:55:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:33 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:55:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7873.295686 secs 2023-05-08T05:55:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:34 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:55:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:34 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T05:55:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:34 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:55:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:34 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:55:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:34 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T05:55:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:34 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:55:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:34 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:55:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:34 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T05:55:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:34 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:55:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:35 smithi186 ceph-mon[126480]: pgmap v4260: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 43 KiB/s wr, 9 op/s 2023-05-08T05:55:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7874.576394 secs 2023-05-08T05:55:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:35 smithi133 ceph-mon[125939]: pgmap v4260: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 43 KiB/s wr, 9 op/s 2023-05-08T05:55:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7874.576394 secs 2023-05-08T05:55:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:35 smithi096 ceph-mon[124666]: pgmap v4260: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 43 KiB/s wr, 9 op/s 2023-05-08T05:55:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7874.576394 secs 2023-05-08T05:55:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:37 smithi186 ceph-mon[126480]: pgmap v4261: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 43 KiB/s wr, 6 op/s 2023-05-08T05:55:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:37 smithi133 ceph-mon[125939]: pgmap v4261: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 43 KiB/s wr, 6 op/s 2023-05-08T05:55:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:37 smithi096 ceph-mon[124666]: pgmap v4261: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 43 KiB/s wr, 6 op/s 2023-05-08T05:55:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7878.295801 secs 2023-05-08T05:55:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7878.295801 secs 2023-05-08T05:55:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7878.295801 secs 2023-05-08T05:55:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:39 smithi186 ceph-mon[126480]: pgmap v4262: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 43 KiB/s wr, 6 op/s 2023-05-08T05:55:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:39 smithi133 ceph-mon[125939]: pgmap v4262: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 43 KiB/s wr, 6 op/s 2023-05-08T05:55:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:39 smithi096 ceph-mon[124666]: pgmap v4262: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 43 KiB/s wr, 6 op/s 2023-05-08T05:55:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7879.576530 secs 2023-05-08T05:55:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:40 smithi186 ceph-mon[126480]: pgmap v4263: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 88 KiB/s wr, 8 op/s 2023-05-08T05:55:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7879.576530 secs 2023-05-08T05:55:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:40 smithi133 ceph-mon[125939]: pgmap v4263: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 88 KiB/s wr, 8 op/s 2023-05-08T05:55:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7879.576530 secs 2023-05-08T05:55:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:40 smithi096 ceph-mon[124666]: pgmap v4263: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 88 KiB/s wr, 8 op/s 2023-05-08T05:55:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:43 smithi133 ceph-mon[125939]: pgmap v4264: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 46 KiB/s wr, 6 op/s 2023-05-08T05:55:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7882.738592 secs 2023-05-08T05:55:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:43 smithi096 ceph-mon[124666]: pgmap v4264: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 46 KiB/s wr, 6 op/s 2023-05-08T05:55:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7882.738592 secs 2023-05-08T05:55:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:43 smithi186 ceph-mon[126480]: pgmap v4264: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 46 KiB/s wr, 6 op/s 2023-05-08T05:55:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7882.738592 secs 2023-05-08T05:55:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:45 smithi133 ceph-mon[125939]: pgmap v4265: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 127 KiB/s wr, 9 op/s 2023-05-08T05:55:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7884.576664 secs 2023-05-08T05:55:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:45 smithi096 ceph-mon[124666]: pgmap v4265: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 127 KiB/s wr, 9 op/s 2023-05-08T05:55:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7884.576664 secs 2023-05-08T05:55:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:45 smithi186 ceph-mon[126480]: pgmap v4265: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 127 KiB/s wr, 9 op/s 2023-05-08T05:55:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7884.576664 secs 2023-05-08T05:55:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:46 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:55:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:46 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T05:55:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:46 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:55:46.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:46 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:55:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:46 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:55:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:46 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T05:55:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:46 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:55:47.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:46 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:55:47.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:46 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:55:47.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:46 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T05:55:47.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:46 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:55:47.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:46 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:55:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:47 smithi133 ceph-mon[125939]: pgmap v4266: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 129 KiB/s wr, 7 op/s 2023-05-08T05:55:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:47 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:55:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:47 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:55:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:47 smithi096 ceph-mon[124666]: pgmap v4266: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 129 KiB/s wr, 7 op/s 2023-05-08T05:55:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:47 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:55:48.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:47 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:55:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:47 smithi186 ceph-mon[126480]: pgmap v4266: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 129 KiB/s wr, 7 op/s 2023-05-08T05:55:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:47 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:55:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:47 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:55:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7887.738713 secs 2023-05-08T05:55:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7887.738713 secs 2023-05-08T05:55:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7887.738713 secs 2023-05-08T05:55:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:49 smithi133 ceph-mon[125939]: pgmap v4267: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 129 KiB/s wr, 6 op/s 2023-05-08T05:55:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:49 smithi096 ceph-mon[124666]: pgmap v4267: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 129 KiB/s wr, 6 op/s 2023-05-08T05:55:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:49 smithi186 ceph-mon[126480]: pgmap v4267: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 129 KiB/s wr, 6 op/s 2023-05-08T05:55:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:50 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:55:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:50 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:55:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:50 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:55:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:51 smithi133 ceph-mon[125939]: pgmap v4268: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 305 KiB/s wr, 11 op/s 2023-05-08T05:55:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:51 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:55:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:55:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:55:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:51 smithi096 ceph-mon[124666]: pgmap v4268: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 305 KiB/s wr, 11 op/s 2023-05-08T05:55:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:51 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:55:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:55:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:55:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:51 smithi186 ceph-mon[126480]: pgmap v4268: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 305 KiB/s wr, 11 op/s 2023-05-08T05:55:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:51 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:55:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:55:52.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:55:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:53 smithi133 ceph-mon[125939]: pgmap v4269: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 262 KiB/s wr, 9 op/s 2023-05-08T05:55:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7892.738806 secs 2023-05-08T05:55:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7893.296174 secs 2023-05-08T05:55:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:53 smithi096 ceph-mon[124666]: pgmap v4269: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 262 KiB/s wr, 9 op/s 2023-05-08T05:55:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7892.738806 secs 2023-05-08T05:55:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7893.296174 secs 2023-05-08T05:55:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:53 smithi186 ceph-mon[126480]: pgmap v4269: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 262 KiB/s wr, 9 op/s 2023-05-08T05:55:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7892.738806 secs 2023-05-08T05:55:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7893.296174 secs 2023-05-08T05:55:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:55 smithi133 ceph-mon[125939]: pgmap v4270: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 314 KiB/s wr, 13 op/s 2023-05-08T05:55:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:55 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:55:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:55 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:55:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:55 smithi096 ceph-mon[124666]: pgmap v4270: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 314 KiB/s wr, 13 op/s 2023-05-08T05:55:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:55 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:55:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:55 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:55:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:55 smithi186 ceph-mon[126480]: pgmap v4270: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 314 KiB/s wr, 13 op/s 2023-05-08T05:55:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:55 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:55:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:55 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:55:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:57 smithi133 ceph-mon[125939]: pgmap v4271: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 233 KiB/s wr, 10 op/s 2023-05-08T05:55:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:57 smithi096 ceph-mon[124666]: pgmap v4271: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 233 KiB/s wr, 10 op/s 2023-05-08T05:55:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:57 smithi186 ceph-mon[126480]: pgmap v4271: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 233 KiB/s wr, 10 op/s 2023-05-08T05:55:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7897.738940 secs 2023-05-08T05:55:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7897.738940 secs 2023-05-08T05:55:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7897.738940 secs 2023-05-08T05:55:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:59 smithi133 ceph-mon[125939]: pgmap v4272: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 230 KiB/s wr, 10 op/s 2023-05-08T05:55:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:55:59 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:56:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:59 smithi096 ceph-mon[124666]: pgmap v4272: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 230 KiB/s wr, 10 op/s 2023-05-08T05:56:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:55:59 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:56:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:59 smithi186 ceph-mon[126480]: pgmap v4272: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 230 KiB/s wr, 10 op/s 2023-05-08T05:56:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:55:59 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:56:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7899.577027 secs 2023-05-08T05:56:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7899.577027 secs 2023-05-08T05:56:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7899.577027 secs 2023-05-08T05:56:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:01 smithi133 ceph-mon[125939]: pgmap v4273: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 368 KiB/s wr, 14 op/s 2023-05-08T05:56:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:01 smithi096 ceph-mon[124666]: pgmap v4273: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 368 KiB/s wr, 14 op/s 2023-05-08T05:56:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:01 smithi186 ceph-mon[126480]: pgmap v4273: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 368 KiB/s wr, 14 op/s 2023-05-08T05:56:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:02 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:56:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:02 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:56:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:02 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:56:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:03 smithi133 ceph-mon[125939]: pgmap v4274: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 194 KiB/s wr, 9 op/s 2023-05-08T05:56:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:56:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:56:03.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:03 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:56:03.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7902.739051 secs 2023-05-08T05:56:03.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7903.296405 secs 2023-05-08T05:56:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:03 smithi096 ceph-mon[124666]: pgmap v4274: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 194 KiB/s wr, 9 op/s 2023-05-08T05:56:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:56:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:56:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:03 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:56:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7902.739051 secs 2023-05-08T05:56:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7903.296405 secs 2023-05-08T05:56:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:03 smithi186 ceph-mon[126480]: pgmap v4274: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 194 KiB/s wr, 9 op/s 2023-05-08T05:56:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:56:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:56:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:03 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:56:04.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7902.739051 secs 2023-05-08T05:56:04.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7903.296405 secs 2023-05-08T05:56:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:05 smithi133 ceph-mon[125939]: pgmap v4275: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 331 KiB/s wr, 27 op/s 2023-05-08T05:56:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7904.577116 secs 2023-05-08T05:56:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:05 smithi096 ceph-mon[124666]: pgmap v4275: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 331 KiB/s wr, 27 op/s 2023-05-08T05:56:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7904.577116 secs 2023-05-08T05:56:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:05 smithi186 ceph-mon[126480]: pgmap v4275: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 331 KiB/s wr, 27 op/s 2023-05-08T05:56:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7904.577116 secs 2023-05-08T05:56:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:06 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:56:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:56:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:56:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:06 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:56:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:56:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:56:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:06 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:56:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:56:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:56:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:07 smithi186 ceph-mon[126480]: pgmap v4276: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 279 KiB/s wr, 24 op/s 2023-05-08T05:56:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:07 smithi133 ceph-mon[125939]: pgmap v4276: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 279 KiB/s wr, 24 op/s 2023-05-08T05:56:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:07 smithi096 ceph-mon[124666]: pgmap v4276: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 279 KiB/s wr, 24 op/s 2023-05-08T05:56:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7907.739189 secs 2023-05-08T05:56:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7908.296502 secs 2023-05-08T05:56:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7907.739189 secs 2023-05-08T05:56:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7908.296502 secs 2023-05-08T05:56:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7907.739189 secs 2023-05-08T05:56:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7908.296502 secs 2023-05-08T05:56:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:09 smithi186 ceph-mon[126480]: pgmap v4277: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 279 KiB/s wr, 23 op/s 2023-05-08T05:56:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:09 smithi133 ceph-mon[125939]: pgmap v4277: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 279 KiB/s wr, 23 op/s 2023-05-08T05:56:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:09 smithi096 ceph-mon[124666]: pgmap v4277: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 279 KiB/s wr, 23 op/s 2023-05-08T05:56:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7909.577198 secs 2023-05-08T05:56:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7909.577198 secs 2023-05-08T05:56:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7909.577198 secs 2023-05-08T05:56:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:11 smithi186 ceph-mon[126480]: pgmap v4278: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 309 KiB/s wr, 26 op/s 2023-05-08T05:56:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:11 smithi186 ceph-mon[126480]: osdmap e346: 12 total, 12 up, 12 in 2023-05-08T05:56:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:11 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:56:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:11 smithi133 ceph-mon[125939]: pgmap v4278: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 309 KiB/s wr, 26 op/s 2023-05-08T05:56:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:11 smithi133 ceph-mon[125939]: osdmap e346: 12 total, 12 up, 12 in 2023-05-08T05:56:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:11 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:56:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:11 smithi096 ceph-mon[124666]: pgmap v4278: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 309 KiB/s wr, 26 op/s 2023-05-08T05:56:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:11 smithi096 ceph-mon[124666]: osdmap e346: 12 total, 12 up, 12 in 2023-05-08T05:56:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:11 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:56:13.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:12 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:56:13.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:12 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:56:13.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:12 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:56:13.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:12 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:56:13.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:12 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:56:13.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:12 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:56:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:12 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:56:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:12 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:56:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:12 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:56:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:13 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:56:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:13 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T05:56:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:13 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T05:56:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:13 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:56:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:13 smithi186 ceph-mon[126480]: pgmap v4280: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 203 KiB/s wr, 27 op/s 2023-05-08T05:56:14.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7912.739300 secs 2023-05-08T05:56:14.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7913.296643 secs 2023-05-08T05:56:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:13 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:56:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:13 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T05:56:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:13 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T05:56:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:13 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:56:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:13 smithi133 ceph-mon[125939]: pgmap v4280: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 203 KiB/s wr, 27 op/s 2023-05-08T05:56:14.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7912.739300 secs 2023-05-08T05:56:14.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7913.296643 secs 2023-05-08T05:56:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:13 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:56:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:13 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T05:56:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:13 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T05:56:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:13 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:56:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:13 smithi096 ceph-mon[124666]: pgmap v4280: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 203 KiB/s wr, 27 op/s 2023-05-08T05:56:14.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7912.739300 secs 2023-05-08T05:56:14.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7913.296643 secs 2023-05-08T05:56:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:15 smithi186 ceph-mon[126480]: pgmap v4281: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 8 op/s 2023-05-08T05:56:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7914.577345 secs 2023-05-08T05:56:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:15 smithi133 ceph-mon[125939]: pgmap v4281: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 8 op/s 2023-05-08T05:56:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7914.577345 secs 2023-05-08T05:56:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:15 smithi096 ceph-mon[124666]: pgmap v4281: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 8 op/s 2023-05-08T05:56:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7914.577345 secs 2023-05-08T05:56:18.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:17 smithi186 ceph-mon[126480]: pgmap v4282: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 7 op/s 2023-05-08T05:56:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:17 smithi133 ceph-mon[125939]: pgmap v4282: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 7 op/s 2023-05-08T05:56:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:17 smithi096 ceph-mon[124666]: pgmap v4282: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 7 op/s 2023-05-08T05:56:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7917.739423 secs 2023-05-08T05:56:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7918.296763 secs 2023-05-08T05:56:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7917.739423 secs 2023-05-08T05:56:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7918.296763 secs 2023-05-08T05:56:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7917.739423 secs 2023-05-08T05:56:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7918.296763 secs 2023-05-08T05:56:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:19 smithi186 ceph-mon[126480]: pgmap v4283: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 7 op/s 2023-05-08T05:56:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:19 smithi186 ceph-mon[126480]: osdmap e347: 12 total, 12 up, 12 in 2023-05-08T05:56:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:19 smithi133 ceph-mon[125939]: pgmap v4283: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 7 op/s 2023-05-08T05:56:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:19 smithi133 ceph-mon[125939]: osdmap e347: 12 total, 12 up, 12 in 2023-05-08T05:56:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:19 smithi096 ceph-mon[124666]: pgmap v4283: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 7 op/s 2023-05-08T05:56:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:19 smithi096 ceph-mon[124666]: osdmap e347: 12 total, 12 up, 12 in 2023-05-08T05:56:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7919.577483 secs 2023-05-08T05:56:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7919.577483 secs 2023-05-08T05:56:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7919.577483 secs 2023-05-08T05:56:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:21 smithi186 ceph-mon[126480]: pgmap v4285: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 744 B/s wr, 6 op/s 2023-05-08T05:56:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:21 smithi133 ceph-mon[125939]: pgmap v4285: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 744 B/s wr, 6 op/s 2023-05-08T05:56:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:21 smithi096 ceph-mon[124666]: pgmap v4285: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 744 B/s wr, 6 op/s 2023-05-08T05:56:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:23 smithi186 ceph-mon[126480]: pgmap v4286: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 921 B/s wr, 7 op/s 2023-05-08T05:56:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7922.739530 secs 2023-05-08T05:56:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7923.296883 secs 2023-05-08T05:56:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:23 smithi133 ceph-mon[125939]: pgmap v4286: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 921 B/s wr, 7 op/s 2023-05-08T05:56:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7922.739530 secs 2023-05-08T05:56:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7923.296883 secs 2023-05-08T05:56:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:23 smithi096 ceph-mon[124666]: pgmap v4286: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 921 B/s wr, 7 op/s 2023-05-08T05:56:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7922.739530 secs 2023-05-08T05:56:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7923.296883 secs 2023-05-08T05:56:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:25 smithi186 ceph-mon[126480]: pgmap v4287: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 51 KiB/s wr, 7 op/s 2023-05-08T05:56:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7924.577609 secs 2023-05-08T05:56:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:25 smithi133 ceph-mon[125939]: pgmap v4287: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 51 KiB/s wr, 7 op/s 2023-05-08T05:56:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7924.577609 secs 2023-05-08T05:56:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:25 smithi096 ceph-mon[124666]: pgmap v4287: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 51 KiB/s wr, 7 op/s 2023-05-08T05:56:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7924.577609 secs 2023-05-08T05:56:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:26 smithi186 ceph-mon[126480]: pgmap v4288: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 51 KiB/s wr, 7 op/s 2023-05-08T05:56:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:26 smithi133 ceph-mon[125939]: pgmap v4288: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 51 KiB/s wr, 7 op/s 2023-05-08T05:56:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:26 smithi096 ceph-mon[124666]: pgmap v4288: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 51 KiB/s wr, 7 op/s 2023-05-08T05:56:28.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7927.739616 secs 2023-05-08T05:56:28.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7927.739616 secs 2023-05-08T05:56:28.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7927.739616 secs 2023-05-08T05:56:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:29 smithi133 ceph-mon[125939]: pgmap v4289: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 51 KiB/s wr, 7 op/s 2023-05-08T05:56:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7928.297004 secs 2023-05-08T05:56:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:29 smithi096 ceph-mon[124666]: pgmap v4289: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 51 KiB/s wr, 7 op/s 2023-05-08T05:56:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7928.297004 secs 2023-05-08T05:56:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:29 smithi186 ceph-mon[126480]: pgmap v4289: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 51 KiB/s wr, 7 op/s 2023-05-08T05:56:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7928.297004 secs 2023-05-08T05:56:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7929.577750 secs 2023-05-08T05:56:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7929.577750 secs 2023-05-08T05:56:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7929.577750 secs 2023-05-08T05:56:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:31 smithi133 ceph-mon[125939]: pgmap v4290: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 89 KiB/s wr, 7 op/s 2023-05-08T05:56:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:31 smithi096 ceph-mon[124666]: pgmap v4290: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 89 KiB/s wr, 7 op/s 2023-05-08T05:56:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:31 smithi186 ceph-mon[126480]: pgmap v4290: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 89 KiB/s wr, 7 op/s 2023-05-08T05:56:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:33 smithi133 ceph-mon[125939]: pgmap v4291: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 80 KiB/s wr, 7 op/s 2023-05-08T05:56:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7932.739731 secs 2023-05-08T05:56:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7933.297151 secs 2023-05-08T05:56:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:33 smithi096 ceph-mon[124666]: pgmap v4291: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 80 KiB/s wr, 7 op/s 2023-05-08T05:56:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7932.739731 secs 2023-05-08T05:56:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7933.297151 secs 2023-05-08T05:56:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:33 smithi186 ceph-mon[126480]: pgmap v4291: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 80 KiB/s wr, 7 op/s 2023-05-08T05:56:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7932.739731 secs 2023-05-08T05:56:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7933.297151 secs 2023-05-08T05:56:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:35 smithi133 ceph-mon[125939]: pgmap v4292: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 140 KiB/s wr, 9 op/s 2023-05-08T05:56:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7934.577871 secs 2023-05-08T05:56:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:35 smithi096 ceph-mon[124666]: pgmap v4292: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 140 KiB/s wr, 9 op/s 2023-05-08T05:56:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7934.577871 secs 2023-05-08T05:56:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:35 smithi186 ceph-mon[126480]: pgmap v4292: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 140 KiB/s wr, 9 op/s 2023-05-08T05:56:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7934.577871 secs 2023-05-08T05:56:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:37 smithi133 ceph-mon[125939]: pgmap v4293: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 98 KiB/s wr, 7 op/s 2023-05-08T05:56:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:37 smithi096 ceph-mon[124666]: pgmap v4293: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 98 KiB/s wr, 7 op/s 2023-05-08T05:56:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:37 smithi186 ceph-mon[126480]: pgmap v4293: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 98 KiB/s wr, 7 op/s 2023-05-08T05:56:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7937.739874 secs 2023-05-08T05:56:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7937.739874 secs 2023-05-08T05:56:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7937.739874 secs 2023-05-08T05:56:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:39 smithi133 ceph-mon[125939]: pgmap v4294: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 98 KiB/s wr, 7 op/s 2023-05-08T05:56:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:39 smithi096 ceph-mon[124666]: pgmap v4294: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 98 KiB/s wr, 7 op/s 2023-05-08T05:56:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:39 smithi186 ceph-mon[126480]: pgmap v4294: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 98 KiB/s wr, 7 op/s 2023-05-08T05:56:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:41 smithi133 ceph-mon[125939]: pgmap v4295: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 147 KiB/s wr, 11 op/s 2023-05-08T05:56:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:41 smithi096 ceph-mon[124666]: pgmap v4295: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 147 KiB/s wr, 11 op/s 2023-05-08T05:56:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:41 smithi186 ceph-mon[126480]: pgmap v4295: 97 pgs: 97 active+clean; 6.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 147 KiB/s wr, 11 op/s 2023-05-08T05:56:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:56:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:56:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:56:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:56:43.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:56:43.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:56:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:43 smithi133 ceph-mon[125939]: pgmap v4296: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 112 KiB/s wr, 8 op/s 2023-05-08T05:56:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:43 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:56:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:56:43.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:56:43.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:56:43.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7942.739988 secs 2023-05-08T05:56:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:43 smithi096 ceph-mon[124666]: pgmap v4296: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 112 KiB/s wr, 8 op/s 2023-05-08T05:56:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:43 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:56:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:56:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:56:44.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:56:44.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7942.739988 secs 2023-05-08T05:56:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:43 smithi186 ceph-mon[126480]: pgmap v4296: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 112 KiB/s wr, 8 op/s 2023-05-08T05:56:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:43 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:56:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:56:44.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:56:44.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:56:44.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7942.739988 secs 2023-05-08T05:56:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:45 smithi133 ceph-mon[125939]: pgmap v4297: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 313 KiB/s wr, 12 op/s 2023-05-08T05:56:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:45 smithi096 ceph-mon[124666]: pgmap v4297: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 313 KiB/s wr, 12 op/s 2023-05-08T05:56:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:45 smithi186 ceph-mon[126480]: pgmap v4297: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 313 KiB/s wr, 12 op/s 2023-05-08T05:56:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:47 smithi133 ceph-mon[125939]: pgmap v4298: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 256 KiB/s wr, 10 op/s 2023-05-08T05:56:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:47 smithi096 ceph-mon[124666]: pgmap v4298: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 256 KiB/s wr, 10 op/s 2023-05-08T05:56:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:47 smithi186 ceph-mon[126480]: pgmap v4298: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 256 KiB/s wr, 10 op/s 2023-05-08T05:56:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7947.740110 secs 2023-05-08T05:56:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7948.297503 secs 2023-05-08T05:56:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7947.740110 secs 2023-05-08T05:56:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7948.297503 secs 2023-05-08T05:56:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7947.740110 secs 2023-05-08T05:56:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7948.297503 secs 2023-05-08T05:56:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:49 smithi133 ceph-mon[125939]: pgmap v4299: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 255 KiB/s wr, 9 op/s 2023-05-08T05:56:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:49 smithi096 ceph-mon[124666]: pgmap v4299: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 255 KiB/s wr, 9 op/s 2023-05-08T05:56:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:49 smithi186 ceph-mon[126480]: pgmap v4299: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 255 KiB/s wr, 9 op/s 2023-05-08T05:56:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:56:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:56:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:56:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:56:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:56:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:56:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:56:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:56:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:56:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:51 smithi096 ceph-mon[124666]: pgmap v4300: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 302 KiB/s wr, 13 op/s 2023-05-08T05:56:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:51 smithi186 ceph-mon[126480]: pgmap v4300: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 302 KiB/s wr, 13 op/s 2023-05-08T05:56:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:51 smithi133 ceph-mon[125939]: pgmap v4300: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 302 KiB/s wr, 13 op/s 2023-05-08T05:56:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:53 smithi096 ceph-mon[124666]: pgmap v4301: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 253 KiB/s wr, 10 op/s 2023-05-08T05:56:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7952.740231 secs 2023-05-08T05:56:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7953.297586 secs 2023-05-08T05:56:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:53 smithi186 ceph-mon[126480]: pgmap v4301: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 253 KiB/s wr, 10 op/s 2023-05-08T05:56:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7952.740231 secs 2023-05-08T05:56:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7953.297586 secs 2023-05-08T05:56:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:53 smithi133 ceph-mon[125939]: pgmap v4301: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 253 KiB/s wr, 10 op/s 2023-05-08T05:56:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7952.740231 secs 2023-05-08T05:56:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7953.297586 secs 2023-05-08T05:56:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:55 smithi096 ceph-mon[124666]: pgmap v4302: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 385 KiB/s wr, 13 op/s 2023-05-08T05:56:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:55 smithi186 ceph-mon[126480]: pgmap v4302: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 385 KiB/s wr, 13 op/s 2023-05-08T05:56:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:55 smithi133 ceph-mon[125939]: pgmap v4302: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 385 KiB/s wr, 13 op/s 2023-05-08T05:56:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:57 smithi096 ceph-mon[124666]: pgmap v4303: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 186 KiB/s wr, 9 op/s 2023-05-08T05:56:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:57 smithi186 ceph-mon[126480]: pgmap v4303: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 186 KiB/s wr, 9 op/s 2023-05-08T05:56:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:57 smithi133 ceph-mon[125939]: pgmap v4303: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 186 KiB/s wr, 9 op/s 2023-05-08T05:56:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7957.740371 secs 2023-05-08T05:56:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7958.297708 secs 2023-05-08T05:56:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7957.740371 secs 2023-05-08T05:56:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7958.297708 secs 2023-05-08T05:56:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7957.740371 secs 2023-05-08T05:56:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7958.297708 secs 2023-05-08T05:57:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:56:59 smithi186 ceph-mon[126480]: pgmap v4304: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 183 KiB/s wr, 8 op/s 2023-05-08T05:57:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:56:59 smithi133 ceph-mon[125939]: pgmap v4304: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 183 KiB/s wr, 8 op/s 2023-05-08T05:57:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:56:59 smithi096 ceph-mon[124666]: pgmap v4304: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 183 KiB/s wr, 8 op/s 2023-05-08T05:57:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7959.578478 secs 2023-05-08T05:57:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7959.578478 secs 2023-05-08T05:57:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7959.578478 secs 2023-05-08T05:57:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:01 smithi186 ceph-mon[126480]: pgmap v4305: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 285 KiB/s wr, 12 op/s 2023-05-08T05:57:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:01 smithi133 ceph-mon[125939]: pgmap v4305: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 285 KiB/s wr, 12 op/s 2023-05-08T05:57:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:01 smithi096 ceph-mon[124666]: pgmap v4305: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 285 KiB/s wr, 12 op/s 2023-05-08T05:57:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:02 smithi186 ceph-mon[126480]: pgmap v4306: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 238 KiB/s wr, 9 op/s 2023-05-08T05:57:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:02 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:57:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:57:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:57:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:02 smithi133 ceph-mon[125939]: pgmap v4306: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 238 KiB/s wr, 9 op/s 2023-05-08T05:57:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:02 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:57:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:57:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:57:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:02 smithi096 ceph-mon[124666]: pgmap v4306: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 238 KiB/s wr, 9 op/s 2023-05-08T05:57:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:02 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:57:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:57:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:57:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7962.740482 secs 2023-05-08T05:57:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7963.297847 secs 2023-05-08T05:57:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7962.740482 secs 2023-05-08T05:57:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7963.297847 secs 2023-05-08T05:57:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7962.740482 secs 2023-05-08T05:57:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7963.297847 secs 2023-05-08T05:57:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:05 smithi133 ceph-mon[125939]: pgmap v4307: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 311 KiB/s rd, 402 KiB/s wr, 26 op/s 2023-05-08T05:57:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7964.578605 secs 2023-05-08T05:57:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:05 smithi096 ceph-mon[124666]: pgmap v4307: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 311 KiB/s rd, 402 KiB/s wr, 26 op/s 2023-05-08T05:57:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7964.578605 secs 2023-05-08T05:57:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:05 smithi186 ceph-mon[126480]: pgmap v4307: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 311 KiB/s rd, 402 KiB/s wr, 26 op/s 2023-05-08T05:57:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7964.578605 secs 2023-05-08T05:57:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:06 smithi186 ceph-mon[126480]: osdmap e348: 12 total, 12 up, 12 in 2023-05-08T05:57:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:06 smithi186 ceph-mon[126480]: pgmap v4309: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 318 KiB/s wr, 27 op/s 2023-05-08T05:57:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:06 smithi133 ceph-mon[125939]: osdmap e348: 12 total, 12 up, 12 in 2023-05-08T05:57:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:06 smithi133 ceph-mon[125939]: pgmap v4309: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 318 KiB/s wr, 27 op/s 2023-05-08T05:57:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:06 smithi096 ceph-mon[124666]: osdmap e348: 12 total, 12 up, 12 in 2023-05-08T05:57:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:06 smithi096 ceph-mon[124666]: pgmap v4309: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 318 KiB/s wr, 27 op/s 2023-05-08T05:57:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7967.740611 secs 2023-05-08T05:57:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7967.740611 secs 2023-05-08T05:57:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7967.740611 secs 2023-05-08T05:57:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:09 smithi133 ceph-mon[125939]: pgmap v4310: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 318 KiB/s wr, 27 op/s 2023-05-08T05:57:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7968.297964 secs 2023-05-08T05:57:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:09 smithi096 ceph-mon[124666]: pgmap v4310: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 318 KiB/s wr, 27 op/s 2023-05-08T05:57:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7968.297964 secs 2023-05-08T05:57:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:09 smithi186 ceph-mon[126480]: pgmap v4310: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 318 KiB/s wr, 27 op/s 2023-05-08T05:57:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7968.297964 secs 2023-05-08T05:57:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7969.578721 secs 2023-05-08T05:57:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7969.578721 secs 2023-05-08T05:57:11.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7969.578721 secs 2023-05-08T05:57:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:11 smithi133 ceph-mon[125939]: pgmap v4311: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 240 KiB/s wr, 26 op/s 2023-05-08T05:57:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:11 smithi096 ceph-mon[124666]: pgmap v4311: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 240 KiB/s wr, 26 op/s 2023-05-08T05:57:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:11 smithi186 ceph-mon[126480]: pgmap v4311: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 240 KiB/s wr, 26 op/s 2023-05-08T05:57:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:12 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:57:13.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:12 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:57:13.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:12 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:57:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:13 smithi133 ceph-mon[125939]: pgmap v4312: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 240 KiB/s wr, 26 op/s 2023-05-08T05:57:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:13 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:57:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:13 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:57:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:13 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:57:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7972.740710 secs 2023-05-08T05:57:13.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7973.298058 secs 2023-05-08T05:57:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:13 smithi096 ceph-mon[124666]: pgmap v4312: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 240 KiB/s wr, 26 op/s 2023-05-08T05:57:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:13 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:57:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:13 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:57:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:13 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:57:14.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7972.740710 secs 2023-05-08T05:57:14.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7973.298058 secs 2023-05-08T05:57:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:13 smithi186 ceph-mon[126480]: pgmap v4312: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 240 KiB/s wr, 26 op/s 2023-05-08T05:57:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:13 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:57:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:13 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:57:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:13 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:57:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7972.740710 secs 2023-05-08T05:57:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7973.298058 secs 2023-05-08T05:57:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:14 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:57:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:14 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T05:57:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:14 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T05:57:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:14 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:57:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:14 smithi133 ceph-mon[125939]: osdmap e349: 12 total, 12 up, 12 in 2023-05-08T05:57:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:14 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:57:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:14 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T05:57:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:14 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T05:57:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:14 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:57:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:14 smithi096 ceph-mon[124666]: osdmap e349: 12 total, 12 up, 12 in 2023-05-08T05:57:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:14 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:57:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:14 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T05:57:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:14 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T05:57:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:14 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:57:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:14 smithi186 ceph-mon[126480]: osdmap e349: 12 total, 12 up, 12 in 2023-05-08T05:57:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:15 smithi133 ceph-mon[125939]: pgmap v4313: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 78 KiB/s wr, 8 op/s 2023-05-08T05:57:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7974.578810 secs 2023-05-08T05:57:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:15 smithi096 ceph-mon[124666]: pgmap v4313: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 78 KiB/s wr, 8 op/s 2023-05-08T05:57:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7974.578810 secs 2023-05-08T05:57:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:15 smithi186 ceph-mon[126480]: pgmap v4313: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 78 KiB/s wr, 8 op/s 2023-05-08T05:57:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7974.578810 secs 2023-05-08T05:57:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:17 smithi133 ceph-mon[125939]: pgmap v4315: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 78 KiB/s wr, 8 op/s 2023-05-08T05:57:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:17 smithi096 ceph-mon[124666]: pgmap v4315: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 78 KiB/s wr, 8 op/s 2023-05-08T05:57:18.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:17 smithi186 ceph-mon[126480]: pgmap v4315: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 78 KiB/s wr, 8 op/s 2023-05-08T05:57:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7977.740834 secs 2023-05-08T05:57:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7978.298152 secs 2023-05-08T05:57:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7977.740834 secs 2023-05-08T05:57:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7978.298152 secs 2023-05-08T05:57:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7977.740834 secs 2023-05-08T05:57:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7978.298152 secs 2023-05-08T05:57:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:19 smithi133 ceph-mon[125939]: pgmap v4316: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 78 KiB/s wr, 8 op/s 2023-05-08T05:57:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:19 smithi096 ceph-mon[124666]: pgmap v4316: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 78 KiB/s wr, 8 op/s 2023-05-08T05:57:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:19 smithi186 ceph-mon[126480]: pgmap v4316: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 78 KiB/s wr, 8 op/s 2023-05-08T05:57:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7979.578926 secs 2023-05-08T05:57:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7979.578926 secs 2023-05-08T05:57:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7979.578926 secs 2023-05-08T05:57:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:21 smithi133 ceph-mon[125939]: pgmap v4317: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 86 KiB/s wr, 7 op/s 2023-05-08T05:57:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:21 smithi096 ceph-mon[124666]: pgmap v4317: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 86 KiB/s wr, 7 op/s 2023-05-08T05:57:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:21 smithi186 ceph-mon[126480]: pgmap v4317: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 86 KiB/s wr, 7 op/s 2023-05-08T05:57:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:23 smithi133 ceph-mon[125939]: pgmap v4318: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 85 KiB/s wr, 7 op/s 2023-05-08T05:57:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7982.740939 secs 2023-05-08T05:57:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7983.298253 secs 2023-05-08T05:57:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:23 smithi096 ceph-mon[124666]: pgmap v4318: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 85 KiB/s wr, 7 op/s 2023-05-08T05:57:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7982.740939 secs 2023-05-08T05:57:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7983.298253 secs 2023-05-08T05:57:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:23 smithi186 ceph-mon[126480]: pgmap v4318: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 85 KiB/s wr, 7 op/s 2023-05-08T05:57:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7982.740939 secs 2023-05-08T05:57:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7983.298253 secs 2023-05-08T05:57:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:25 smithi133 ceph-mon[125939]: pgmap v4319: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 183 KiB/s wr, 8 op/s 2023-05-08T05:57:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7984.578994 secs 2023-05-08T05:57:26.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:25 smithi096 ceph-mon[124666]: pgmap v4319: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 183 KiB/s wr, 8 op/s 2023-05-08T05:57:26.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7984.578994 secs 2023-05-08T05:57:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:25 smithi186 ceph-mon[126480]: pgmap v4319: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 183 KiB/s wr, 8 op/s 2023-05-08T05:57:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7984.578994 secs 2023-05-08T05:57:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:27 smithi133 ceph-mon[125939]: pgmap v4320: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 156 KiB/s wr, 8 op/s 2023-05-08T05:57:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:27 smithi096 ceph-mon[124666]: pgmap v4320: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 156 KiB/s wr, 8 op/s 2023-05-08T05:57:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:27 smithi186 ceph-mon[126480]: pgmap v4320: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 156 KiB/s wr, 8 op/s 2023-05-08T05:57:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7987.741055 secs 2023-05-08T05:57:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7988.298372 secs 2023-05-08T05:57:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7987.741055 secs 2023-05-08T05:57:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7988.298372 secs 2023-05-08T05:57:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7987.741055 secs 2023-05-08T05:57:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7988.298372 secs 2023-05-08T05:57:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:29 smithi133 ceph-mon[125939]: pgmap v4321: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 152 KiB/s wr, 7 op/s 2023-05-08T05:57:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:29 smithi096 ceph-mon[124666]: pgmap v4321: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 152 KiB/s wr, 7 op/s 2023-05-08T05:57:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:29 smithi186 ceph-mon[126480]: pgmap v4321: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 152 KiB/s wr, 7 op/s 2023-05-08T05:57:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7989.579117 secs 2023-05-08T05:57:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7989.579117 secs 2023-05-08T05:57:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7989.579117 secs 2023-05-08T05:57:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:31 smithi133 ceph-mon[125939]: pgmap v4322: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 152 KiB/s wr, 10 op/s 2023-05-08T05:57:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:31 smithi096 ceph-mon[124666]: pgmap v4322: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 152 KiB/s wr, 10 op/s 2023-05-08T05:57:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:31 smithi186 ceph-mon[126480]: pgmap v4322: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 152 KiB/s wr, 10 op/s 2023-05-08T05:57:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:33 smithi133 ceph-mon[125939]: pgmap v4323: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 109 KiB/s wr, 8 op/s 2023-05-08T05:57:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7992.741169 secs 2023-05-08T05:57:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7993.298499 secs 2023-05-08T05:57:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:33 smithi096 ceph-mon[124666]: pgmap v4323: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 109 KiB/s wr, 8 op/s 2023-05-08T05:57:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7992.741169 secs 2023-05-08T05:57:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7993.298499 secs 2023-05-08T05:57:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:33 smithi186 ceph-mon[126480]: pgmap v4323: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 109 KiB/s wr, 8 op/s 2023-05-08T05:57:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7992.741169 secs 2023-05-08T05:57:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7993.298499 secs 2023-05-08T05:57:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:35 smithi096 ceph-mon[124666]: pgmap v4324: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 143 KiB/s wr, 10 op/s 2023-05-08T05:57:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7994.579236 secs 2023-05-08T05:57:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:35 smithi186 ceph-mon[126480]: pgmap v4324: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 143 KiB/s wr, 10 op/s 2023-05-08T05:57:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7994.579236 secs 2023-05-08T05:57:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:35 smithi133 ceph-mon[125939]: pgmap v4324: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 143 KiB/s wr, 10 op/s 2023-05-08T05:57:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7994.579236 secs 2023-05-08T05:57:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:37 smithi096 ceph-mon[124666]: pgmap v4325: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 34 KiB/s wr, 7 op/s 2023-05-08T05:57:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:37 smithi186 ceph-mon[126480]: pgmap v4325: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 34 KiB/s wr, 7 op/s 2023-05-08T05:57:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:37 smithi133 ceph-mon[125939]: pgmap v4325: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 34 KiB/s wr, 7 op/s 2023-05-08T05:57:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7997.741284 secs 2023-05-08T05:57:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7998.298651 secs 2023-05-08T05:57:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7997.741284 secs 2023-05-08T05:57:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7998.298651 secs 2023-05-08T05:57:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7997.741284 secs 2023-05-08T05:57:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7998.298651 secs 2023-05-08T05:57:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:39 smithi096 ceph-mon[124666]: pgmap v4326: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T05:57:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:39 smithi186 ceph-mon[126480]: pgmap v4326: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T05:57:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:39 smithi133 ceph-mon[125939]: pgmap v4326: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T05:57:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 7999.579355 secs 2023-05-08T05:57:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 7999.579355 secs 2023-05-08T05:57:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 7999.579355 secs 2023-05-08T05:57:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:41 smithi186 ceph-mon[126480]: pgmap v4327: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 173 KiB/s wr, 9 op/s 2023-05-08T05:57:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:41 smithi133 ceph-mon[125939]: pgmap v4327: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 173 KiB/s wr, 9 op/s 2023-05-08T05:57:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:41 smithi096 ceph-mon[124666]: pgmap v4327: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 173 KiB/s wr, 9 op/s 2023-05-08T05:57:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:43 smithi186 ceph-mon[126480]: pgmap v4328: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 175 KiB/s wr, 7 op/s 2023-05-08T05:57:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8002.741403 secs 2023-05-08T05:57:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:43 smithi133 ceph-mon[125939]: pgmap v4328: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 175 KiB/s wr, 7 op/s 2023-05-08T05:57:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8002.741403 secs 2023-05-08T05:57:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:43 smithi096 ceph-mon[124666]: pgmap v4328: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 175 KiB/s wr, 7 op/s 2023-05-08T05:57:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8002.741403 secs 2023-05-08T05:57:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:45 smithi186 ceph-mon[126480]: pgmap v4329: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 228 KiB/s wr, 11 op/s 2023-05-08T05:57:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:45 smithi133 ceph-mon[125939]: pgmap v4329: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 228 KiB/s wr, 11 op/s 2023-05-08T05:57:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:45 smithi096 ceph-mon[124666]: pgmap v4329: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 228 KiB/s wr, 11 op/s 2023-05-08T05:57:47.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:46 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:57:47.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:46 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:57:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:46 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:57:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:46 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:57:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:46 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:57:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:46 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:57:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:47 smithi186 ceph-mon[126480]: pgmap v4330: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 194 KiB/s wr, 9 op/s 2023-05-08T05:57:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:47 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:57:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:47 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:57:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:47 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:57:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:47 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:57:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:47 smithi133 ceph-mon[125939]: pgmap v4330: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 194 KiB/s wr, 9 op/s 2023-05-08T05:57:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:47 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:57:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:47 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:57:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:47 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:57:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:47 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:57:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:47 smithi096 ceph-mon[124666]: pgmap v4330: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 194 KiB/s wr, 9 op/s 2023-05-08T05:57:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:47 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:57:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:47 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:57:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:47 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:57:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:47 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:57:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8007.741522 secs 2023-05-08T05:57:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8008.298873 secs 2023-05-08T05:57:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8007.741522 secs 2023-05-08T05:57:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8008.298873 secs 2023-05-08T05:57:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8007.741522 secs 2023-05-08T05:57:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8008.298873 secs 2023-05-08T05:57:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:49 smithi186 ceph-mon[126480]: pgmap v4331: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 194 KiB/s wr, 8 op/s 2023-05-08T05:57:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:49 smithi133 ceph-mon[125939]: pgmap v4331: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 194 KiB/s wr, 8 op/s 2023-05-08T05:57:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:49 smithi096 ceph-mon[124666]: pgmap v4331: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 194 KiB/s wr, 8 op/s 2023-05-08T05:57:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:51 smithi186 ceph-mon[126480]: pgmap v4332: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 397 KiB/s rd, 372 KiB/s wr, 12 op/s 2023-05-08T05:57:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:57:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:57:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:51 smithi133 ceph-mon[125939]: pgmap v4332: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 397 KiB/s rd, 372 KiB/s wr, 12 op/s 2023-05-08T05:57:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:57:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:57:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:51 smithi096 ceph-mon[124666]: pgmap v4332: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 397 KiB/s rd, 372 KiB/s wr, 12 op/s 2023-05-08T05:57:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:57:52.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:57:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:53 smithi186 ceph-mon[126480]: pgmap v4333: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 353 KiB/s rd, 236 KiB/s wr, 10 op/s 2023-05-08T05:57:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8012.741637 secs 2023-05-08T05:57:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:53 smithi133 ceph-mon[125939]: pgmap v4333: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 353 KiB/s rd, 236 KiB/s wr, 10 op/s 2023-05-08T05:57:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8012.741637 secs 2023-05-08T05:57:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:53 smithi096 ceph-mon[124666]: pgmap v4333: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 353 KiB/s rd, 236 KiB/s wr, 10 op/s 2023-05-08T05:57:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8012.741637 secs 2023-05-08T05:57:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:54 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:57:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:54 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:57:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:54 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:57:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:54 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:57:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:54 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:57:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:54 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:57:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:55 smithi186 ceph-mon[126480]: pgmap v4334: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 427 KiB/s rd, 289 KiB/s wr, 13 op/s 2023-05-08T05:57:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:55 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:57:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:55 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:57:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:55 smithi133 ceph-mon[125939]: pgmap v4334: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 427 KiB/s rd, 289 KiB/s wr, 13 op/s 2023-05-08T05:57:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:55 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:57:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:55 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:57:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:55 smithi096 ceph-mon[124666]: pgmap v4334: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 427 KiB/s rd, 289 KiB/s wr, 13 op/s 2023-05-08T05:57:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:55 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:57:56.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:55 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:57:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:57 smithi186 ceph-mon[126480]: pgmap v4335: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 238 KiB/s wr, 10 op/s 2023-05-08T05:57:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:57 smithi133 ceph-mon[125939]: pgmap v4335: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 238 KiB/s wr, 10 op/s 2023-05-08T05:57:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:57 smithi096 ceph-mon[124666]: pgmap v4335: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 238 KiB/s wr, 10 op/s 2023-05-08T05:57:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8017.741721 secs 2023-05-08T05:57:59.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8018.299107 secs 2023-05-08T05:57:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8017.741721 secs 2023-05-08T05:57:59.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8018.299107 secs 2023-05-08T05:57:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8017.741721 secs 2023-05-08T05:57:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8018.299107 secs 2023-05-08T05:58:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:59 smithi186 ceph-mon[126480]: pgmap v4336: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 238 KiB/s wr, 9 op/s 2023-05-08T05:58:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:57:59 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:58:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:59 smithi133 ceph-mon[125939]: pgmap v4336: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 238 KiB/s wr, 9 op/s 2023-05-08T05:58:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:57:59 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:58:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:59 smithi096 ceph-mon[124666]: pgmap v4336: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 238 KiB/s wr, 9 op/s 2023-05-08T05:58:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:57:59 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:58:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8019.579852 secs 2023-05-08T05:58:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8019.579852 secs 2023-05-08T05:58:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8019.579852 secs 2023-05-08T05:58:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:01 smithi186 ceph-mon[126480]: pgmap v4337: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 424 KiB/s rd, 389 KiB/s wr, 13 op/s 2023-05-08T05:58:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:01 smithi133 ceph-mon[125939]: pgmap v4337: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 424 KiB/s rd, 389 KiB/s wr, 13 op/s 2023-05-08T05:58:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:01 smithi096 ceph-mon[124666]: pgmap v4337: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 424 KiB/s rd, 389 KiB/s wr, 13 op/s 2023-05-08T05:58:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:03 smithi186 ceph-mon[126480]: pgmap v4338: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 211 KiB/s wr, 10 op/s 2023-05-08T05:58:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:58:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:58:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:03 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:58:04.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8022.741843 secs 2023-05-08T05:58:04.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8023.299250 secs 2023-05-08T05:58:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:03 smithi133 ceph-mon[125939]: pgmap v4338: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 211 KiB/s wr, 10 op/s 2023-05-08T05:58:04.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:58:04.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:58:04.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:03 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:58:04.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8022.741843 secs 2023-05-08T05:58:04.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8023.299250 secs 2023-05-08T05:58:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:03 smithi096 ceph-mon[124666]: pgmap v4338: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 211 KiB/s wr, 10 op/s 2023-05-08T05:58:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:58:04.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:58:04.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:03 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:58:04.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8022.741843 secs 2023-05-08T05:58:04.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8023.299250 secs 2023-05-08T05:58:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:04 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:58:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:04 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:58:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:04 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:58:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:05 smithi186 ceph-mon[126480]: pgmap v4339: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 349 KiB/s wr, 27 op/s 2023-05-08T05:58:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8024.579968 secs 2023-05-08T05:58:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:05 smithi133 ceph-mon[125939]: pgmap v4339: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 349 KiB/s wr, 27 op/s 2023-05-08T05:58:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8024.579968 secs 2023-05-08T05:58:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:05 smithi096 ceph-mon[124666]: pgmap v4339: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 349 KiB/s wr, 27 op/s 2023-05-08T05:58:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8024.579968 secs 2023-05-08T05:58:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:06 smithi186 ceph-mon[126480]: pgmap v4340: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 294 KiB/s wr, 23 op/s 2023-05-08T05:58:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:06 smithi133 ceph-mon[125939]: pgmap v4340: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 294 KiB/s wr, 23 op/s 2023-05-08T05:58:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:06 smithi096 ceph-mon[124666]: pgmap v4340: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 294 KiB/s wr, 23 op/s 2023-05-08T05:58:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8027.741984 secs 2023-05-08T05:58:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8027.741984 secs 2023-05-08T05:58:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8027.741984 secs 2023-05-08T05:58:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:09 smithi133 ceph-mon[125939]: pgmap v4341: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 291 KiB/s wr, 23 op/s 2023-05-08T05:58:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8028.299391 secs 2023-05-08T05:58:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:09 smithi096 ceph-mon[124666]: pgmap v4341: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 291 KiB/s wr, 23 op/s 2023-05-08T05:58:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8028.299391 secs 2023-05-08T05:58:09.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:09 smithi186 ceph-mon[126480]: pgmap v4341: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 291 KiB/s wr, 23 op/s 2023-05-08T05:58:09.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8028.299391 secs 2023-05-08T05:58:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8029.580089 secs 2023-05-08T05:58:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8029.580089 secs 2023-05-08T05:58:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8029.580089 secs 2023-05-08T05:58:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:11 smithi133 ceph-mon[125939]: pgmap v4342: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 322 KiB/s wr, 26 op/s 2023-05-08T05:58:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:11 smithi133 ceph-mon[125939]: osdmap e350: 12 total, 12 up, 12 in 2023-05-08T05:58:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:11 smithi096 ceph-mon[124666]: pgmap v4342: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 322 KiB/s wr, 26 op/s 2023-05-08T05:58:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:11 smithi096 ceph-mon[124666]: osdmap e350: 12 total, 12 up, 12 in 2023-05-08T05:58:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:11 smithi186 ceph-mon[126480]: pgmap v4342: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 322 KiB/s wr, 26 op/s 2023-05-08T05:58:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:11 smithi186 ceph-mon[126480]: osdmap e350: 12 total, 12 up, 12 in 2023-05-08T05:58:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:13 smithi133 ceph-mon[125939]: pgmap v4344: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 205 KiB/s wr, 26 op/s 2023-05-08T05:58:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8032.742122 secs 2023-05-08T05:58:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:13 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:58:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:13 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:58:13.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:13 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:58:13.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:13 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:58:13.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:13 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:58:13.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:13 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:58:13.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:13 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:58:13.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8033.299480 secs 2023-05-08T05:58:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:13 smithi096 ceph-mon[124666]: pgmap v4344: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 205 KiB/s wr, 26 op/s 2023-05-08T05:58:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8032.742122 secs 2023-05-08T05:58:14.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:13 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:58:14.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:13 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:58:14.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:13 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:58:14.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:13 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:58:14.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:13 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:58:14.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:13 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:58:14.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:13 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:58:14.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8033.299480 secs 2023-05-08T05:58:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:13 smithi186 ceph-mon[126480]: pgmap v4344: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 205 KiB/s wr, 26 op/s 2023-05-08T05:58:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8032.742122 secs 2023-05-08T05:58:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:13 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:58:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:13 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:58:14.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:13 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:58:14.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:13 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:58:14.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:13 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:58:14.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:13 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:58:14.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:13 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:58:14.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8033.299480 secs 2023-05-08T05:58:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:58:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:58:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:58:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:58:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:58:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:58:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:58:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:58:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:58:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:15 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:58:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:15 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T05:58:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:15 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T05:58:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:15 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:58:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:15 smithi133 ceph-mon[125939]: pgmap v4345: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 37 KiB/s wr, 8 op/s 2023-05-08T05:58:15.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8034.580211 secs 2023-05-08T05:58:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:15 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:58:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:15 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T05:58:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:15 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T05:58:16.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:15 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:58:16.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:15 smithi096 ceph-mon[124666]: pgmap v4345: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 37 KiB/s wr, 8 op/s 2023-05-08T05:58:16.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8034.580211 secs 2023-05-08T05:58:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:15 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:58:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:15 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T05:58:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:15 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T05:58:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:15 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:58:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:15 smithi186 ceph-mon[126480]: pgmap v4345: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 37 KiB/s wr, 8 op/s 2023-05-08T05:58:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8034.580211 secs 2023-05-08T05:58:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:17 smithi133 ceph-mon[125939]: pgmap v4346: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 40 KiB/s wr, 8 op/s 2023-05-08T05:58:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:17 smithi096 ceph-mon[124666]: pgmap v4346: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 40 KiB/s wr, 8 op/s 2023-05-08T05:58:18.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:17 smithi186 ceph-mon[126480]: pgmap v4346: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 40 KiB/s wr, 8 op/s 2023-05-08T05:58:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8037.742257 secs 2023-05-08T05:58:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8038.299556 secs 2023-05-08T05:58:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8037.742257 secs 2023-05-08T05:58:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8038.299556 secs 2023-05-08T05:58:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8037.742257 secs 2023-05-08T05:58:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8038.299556 secs 2023-05-08T05:58:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:19 smithi133 ceph-mon[125939]: pgmap v4347: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 40 KiB/s wr, 8 op/s 2023-05-08T05:58:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:19 smithi133 ceph-mon[125939]: osdmap e351: 12 total, 12 up, 12 in 2023-05-08T05:58:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:19 smithi096 ceph-mon[124666]: pgmap v4347: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 40 KiB/s wr, 8 op/s 2023-05-08T05:58:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:19 smithi096 ceph-mon[124666]: osdmap e351: 12 total, 12 up, 12 in 2023-05-08T05:58:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:19 smithi186 ceph-mon[126480]: pgmap v4347: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 40 KiB/s wr, 8 op/s 2023-05-08T05:58:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:19 smithi186 ceph-mon[126480]: osdmap e351: 12 total, 12 up, 12 in 2023-05-08T05:58:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8039.580337 secs 2023-05-08T05:58:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8039.580337 secs 2023-05-08T05:58:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8039.580337 secs 2023-05-08T05:58:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:21 smithi133 ceph-mon[125939]: pgmap v4349: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 3.7 KiB/s wr, 7 op/s 2023-05-08T05:58:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:21 smithi096 ceph-mon[124666]: pgmap v4349: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 3.7 KiB/s wr, 7 op/s 2023-05-08T05:58:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:21 smithi186 ceph-mon[126480]: pgmap v4349: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 3.7 KiB/s wr, 7 op/s 2023-05-08T05:58:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:23 smithi133 ceph-mon[125939]: pgmap v4350: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 3.8 KiB/s wr, 8 op/s 2023-05-08T05:58:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8042.742374 secs 2023-05-08T05:58:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8043.299677 secs 2023-05-08T05:58:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:23 smithi096 ceph-mon[124666]: pgmap v4350: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 3.8 KiB/s wr, 8 op/s 2023-05-08T05:58:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8042.742374 secs 2023-05-08T05:58:24.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8043.299677 secs 2023-05-08T05:58:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:23 smithi186 ceph-mon[126480]: pgmap v4350: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 3.8 KiB/s wr, 8 op/s 2023-05-08T05:58:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8042.742374 secs 2023-05-08T05:58:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8043.299677 secs 2023-05-08T05:58:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:25 smithi133 ceph-mon[125939]: pgmap v4351: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 55 KiB/s wr, 8 op/s 2023-05-08T05:58:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8044.580493 secs 2023-05-08T05:58:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:25 smithi096 ceph-mon[124666]: pgmap v4351: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 55 KiB/s wr, 8 op/s 2023-05-08T05:58:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8044.580493 secs 2023-05-08T05:58:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:25 smithi186 ceph-mon[126480]: pgmap v4351: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 55 KiB/s wr, 8 op/s 2023-05-08T05:58:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8044.580493 secs 2023-05-08T05:58:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:27 smithi133 ceph-mon[125939]: pgmap v4352: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 52 KiB/s wr, 8 op/s 2023-05-08T05:58:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:27 smithi096 ceph-mon[124666]: pgmap v4352: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 52 KiB/s wr, 8 op/s 2023-05-08T05:58:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:27 smithi186 ceph-mon[126480]: pgmap v4352: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 52 KiB/s wr, 8 op/s 2023-05-08T05:58:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8047.742476 secs 2023-05-08T05:58:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8048.299794 secs 2023-05-08T05:58:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8047.742476 secs 2023-05-08T05:58:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8048.299794 secs 2023-05-08T05:58:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8047.742476 secs 2023-05-08T05:58:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8048.299794 secs 2023-05-08T05:58:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:29 smithi133 ceph-mon[125939]: pgmap v4353: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 52 KiB/s wr, 8 op/s 2023-05-08T05:58:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:29 smithi096 ceph-mon[124666]: pgmap v4353: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 52 KiB/s wr, 8 op/s 2023-05-08T05:58:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:29 smithi186 ceph-mon[126480]: pgmap v4353: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 52 KiB/s wr, 8 op/s 2023-05-08T05:58:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8049.580630 secs 2023-05-08T05:58:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8049.580630 secs 2023-05-08T05:58:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8049.580630 secs 2023-05-08T05:58:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:31 smithi133 ceph-mon[125939]: pgmap v4354: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 49 KiB/s wr, 7 op/s 2023-05-08T05:58:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:31 smithi096 ceph-mon[124666]: pgmap v4354: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 49 KiB/s wr, 7 op/s 2023-05-08T05:58:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:31 smithi186 ceph-mon[126480]: pgmap v4354: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 49 KiB/s wr, 7 op/s 2023-05-08T05:58:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:33 smithi096 ceph-mon[124666]: pgmap v4355: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 44 KiB/s wr, 7 op/s 2023-05-08T05:58:34.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8052.742554 secs 2023-05-08T05:58:34.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8053.299920 secs 2023-05-08T05:58:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:33 smithi186 ceph-mon[126480]: pgmap v4355: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 44 KiB/s wr, 7 op/s 2023-05-08T05:58:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8052.742554 secs 2023-05-08T05:58:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8053.299920 secs 2023-05-08T05:58:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:33 smithi133 ceph-mon[125939]: pgmap v4355: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 44 KiB/s wr, 7 op/s 2023-05-08T05:58:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8052.742554 secs 2023-05-08T05:58:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8053.299920 secs 2023-05-08T05:58:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:35 smithi096 ceph-mon[124666]: pgmap v4356: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 133 KiB/s wr, 9 op/s 2023-05-08T05:58:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8054.580758 secs 2023-05-08T05:58:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:35 smithi186 ceph-mon[126480]: pgmap v4356: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 133 KiB/s wr, 9 op/s 2023-05-08T05:58:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8054.580758 secs 2023-05-08T05:58:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:35 smithi133 ceph-mon[125939]: pgmap v4356: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 133 KiB/s wr, 9 op/s 2023-05-08T05:58:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8054.580758 secs 2023-05-08T05:58:38.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:37 smithi096 ceph-mon[124666]: pgmap v4357: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 90 KiB/s wr, 7 op/s 2023-05-08T05:58:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:37 smithi186 ceph-mon[126480]: pgmap v4357: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 90 KiB/s wr, 7 op/s 2023-05-08T05:58:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:37 smithi133 ceph-mon[125939]: pgmap v4357: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 90 KiB/s wr, 7 op/s 2023-05-08T05:58:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8057.742673 secs 2023-05-08T05:58:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8057.742673 secs 2023-05-08T05:58:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8057.742673 secs 2023-05-08T05:58:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:39 smithi186 ceph-mon[126480]: pgmap v4358: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 90 KiB/s wr, 6 op/s 2023-05-08T05:58:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:39 smithi133 ceph-mon[125939]: pgmap v4358: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 90 KiB/s wr, 6 op/s 2023-05-08T05:58:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:39 smithi096 ceph-mon[124666]: pgmap v4358: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 90 KiB/s wr, 6 op/s 2023-05-08T05:58:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8059.580873 secs 2023-05-08T05:58:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8059.580873 secs 2023-05-08T05:58:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8059.580873 secs 2023-05-08T05:58:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:41 smithi186 ceph-mon[126480]: pgmap v4359: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 105 KiB/s wr, 10 op/s 2023-05-08T05:58:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:41 smithi133 ceph-mon[125939]: pgmap v4359: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 105 KiB/s wr, 10 op/s 2023-05-08T05:58:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:41 smithi096 ceph-mon[124666]: pgmap v4359: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 105 KiB/s wr, 10 op/s 2023-05-08T05:58:43.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:58:43.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:58:43.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:58:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:43 smithi186 ceph-mon[126480]: pgmap v4360: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 107 KiB/s wr, 7 op/s 2023-05-08T05:58:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:43 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:58:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:58:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:58:44.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8062.742783 secs 2023-05-08T05:58:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:43 smithi133 ceph-mon[125939]: pgmap v4360: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 107 KiB/s wr, 7 op/s 2023-05-08T05:58:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:43 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:58:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:58:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:58:44.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8062.742783 secs 2023-05-08T05:58:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:43 smithi096 ceph-mon[124666]: pgmap v4360: 97 pgs: 97 active+clean; 6.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 107 KiB/s wr, 7 op/s 2023-05-08T05:58:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:43 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:58:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:58:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:58:44.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8062.742783 secs 2023-05-08T05:58:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:45 smithi186 ceph-mon[126480]: pgmap v4361: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 320 KiB/s wr, 12 op/s 2023-05-08T05:58:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:45 smithi133 ceph-mon[125939]: pgmap v4361: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 320 KiB/s wr, 12 op/s 2023-05-08T05:58:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:45 smithi096 ceph-mon[124666]: pgmap v4361: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 320 KiB/s wr, 12 op/s 2023-05-08T05:58:47.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:46 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:58:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:46 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:58:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:46 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:58:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:47 smithi186 ceph-mon[126480]: pgmap v4362: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 336 KiB/s rd, 234 KiB/s wr, 10 op/s 2023-05-08T05:58:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:47 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:58:48.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:47 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:58:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:47 smithi133 ceph-mon[125939]: pgmap v4362: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 336 KiB/s rd, 234 KiB/s wr, 10 op/s 2023-05-08T05:58:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:47 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:58:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:47 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:58:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:47 smithi096 ceph-mon[124666]: pgmap v4362: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 336 KiB/s rd, 234 KiB/s wr, 10 op/s 2023-05-08T05:58:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:47 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:58:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:47 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:58:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8067.742903 secs 2023-05-08T05:58:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8068.300285 secs 2023-05-08T05:58:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8067.742903 secs 2023-05-08T05:58:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8068.300285 secs 2023-05-08T05:58:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8067.742903 secs 2023-05-08T05:58:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8068.300285 secs 2023-05-08T05:58:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:49 smithi186 ceph-mon[126480]: pgmap v4363: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 234 KiB/s wr, 9 op/s 2023-05-08T05:58:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:49 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:58:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:49 smithi133 ceph-mon[125939]: pgmap v4363: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 234 KiB/s wr, 9 op/s 2023-05-08T05:58:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:49 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:58:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:49 smithi096 ceph-mon[124666]: pgmap v4363: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 234 KiB/s wr, 9 op/s 2023-05-08T05:58:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:49 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:58:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:51 smithi186 ceph-mon[126480]: pgmap v4364: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 247 KiB/s wr, 13 op/s 2023-05-08T05:58:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:58:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:58:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:51 smithi133 ceph-mon[125939]: pgmap v4364: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 247 KiB/s wr, 13 op/s 2023-05-08T05:58:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:58:52.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:58:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:51 smithi096 ceph-mon[124666]: pgmap v4364: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 247 KiB/s wr, 13 op/s 2023-05-08T05:58:52.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:58:52.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:58:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:53 smithi186 ceph-mon[126480]: pgmap v4365: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 232 KiB/s wr, 10 op/s 2023-05-08T05:58:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8072.743020 secs 2023-05-08T05:58:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:53 smithi133 ceph-mon[125939]: pgmap v4365: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 232 KiB/s wr, 10 op/s 2023-05-08T05:58:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8072.743020 secs 2023-05-08T05:58:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:53 smithi096 ceph-mon[124666]: pgmap v4365: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 232 KiB/s wr, 10 op/s 2023-05-08T05:58:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8072.743020 secs 2023-05-08T05:58:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:54 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:58:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:54 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:58:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:54 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:58:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:54 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:58:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:54 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:58:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:54 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:58:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:55 smithi186 ceph-mon[126480]: pgmap v4366: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 408 KiB/s rd, 408 KiB/s wr, 14 op/s 2023-05-08T05:58:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:55 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:58:56.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:55 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:58:56.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8074.581210 secs 2023-05-08T05:58:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:55 smithi133 ceph-mon[125939]: pgmap v4366: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 408 KiB/s rd, 408 KiB/s wr, 14 op/s 2023-05-08T05:58:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:55 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:58:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:55 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:58:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8074.581210 secs 2023-05-08T05:58:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:55 smithi096 ceph-mon[124666]: pgmap v4366: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 408 KiB/s rd, 408 KiB/s wr, 14 op/s 2023-05-08T05:58:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:55 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:58:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:55 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:58:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8074.581210 secs 2023-05-08T05:58:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:57 smithi186 ceph-mon[126480]: pgmap v4367: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 199 KiB/s wr, 10 op/s 2023-05-08T05:58:58.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:57 smithi133 ceph-mon[125939]: pgmap v4367: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 199 KiB/s wr, 10 op/s 2023-05-08T05:58:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:57 smithi096 ceph-mon[124666]: pgmap v4367: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 199 KiB/s wr, 10 op/s 2023-05-08T05:58:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8077.743141 secs 2023-05-08T05:58:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8078.300525 secs 2023-05-08T05:58:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8077.743141 secs 2023-05-08T05:58:59.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8078.300525 secs 2023-05-08T05:58:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8077.743141 secs 2023-05-08T05:58:59.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8078.300525 secs 2023-05-08T05:59:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:59 smithi186 ceph-mon[126480]: pgmap v4368: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 196 KiB/s wr, 9 op/s 2023-05-08T05:59:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:59 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:59:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:58:59 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:59:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:59 smithi133 ceph-mon[125939]: pgmap v4368: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 196 KiB/s wr, 9 op/s 2023-05-08T05:59:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:59 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:59:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:58:59 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:59:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:59 smithi096 ceph-mon[124666]: pgmap v4368: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 196 KiB/s wr, 9 op/s 2023-05-08T05:59:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:59 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:59:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:58:59 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:59:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8079.581345 secs 2023-05-08T05:59:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8079.581345 secs 2023-05-08T05:59:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8079.581345 secs 2023-05-08T05:59:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:01 smithi186 ceph-mon[126480]: pgmap v4369: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 197 KiB/s wr, 13 op/s 2023-05-08T05:59:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:01 smithi133 ceph-mon[125939]: pgmap v4369: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 197 KiB/s wr, 13 op/s 2023-05-08T05:59:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:01 smithi096 ceph-mon[124666]: pgmap v4369: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 197 KiB/s wr, 13 op/s 2023-05-08T05:59:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:02 smithi186 ceph-mon[126480]: pgmap v4370: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 281 KiB/s wr, 11 op/s 2023-05-08T05:59:03.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:02 smithi133 ceph-mon[125939]: pgmap v4370: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 281 KiB/s wr, 11 op/s 2023-05-08T05:59:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:02 smithi096 ceph-mon[124666]: pgmap v4370: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 281 KiB/s wr, 11 op/s 2023-05-08T05:59:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:03 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:59:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:59:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:03 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:59:04.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8082.743257 secs 2023-05-08T05:59:04.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8083.300607 secs 2023-05-08T05:59:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:03 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:59:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:59:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:03 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:59:04.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8082.743257 secs 2023-05-08T05:59:04.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8083.300607 secs 2023-05-08T05:59:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:03 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:59:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:59:04.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:03 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:59:04.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8082.743257 secs 2023-05-08T05:59:04.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8083.300607 secs 2023-05-08T05:59:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:05 smithi133 ceph-mon[125939]: pgmap v4371: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 325 KiB/s wr, 26 op/s 2023-05-08T05:59:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8084.581472 secs 2023-05-08T05:59:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:05 smithi096 ceph-mon[124666]: pgmap v4371: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 325 KiB/s wr, 26 op/s 2023-05-08T05:59:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8084.581472 secs 2023-05-08T05:59:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:05 smithi186 ceph-mon[126480]: pgmap v4371: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 325 KiB/s wr, 26 op/s 2023-05-08T05:59:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8084.581472 secs 2023-05-08T05:59:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:07 smithi133 ceph-mon[125939]: pgmap v4372: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 145 KiB/s wr, 23 op/s 2023-05-08T05:59:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:07 smithi096 ceph-mon[124666]: pgmap v4372: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 145 KiB/s wr, 23 op/s 2023-05-08T05:59:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:07 smithi186 ceph-mon[126480]: pgmap v4372: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 145 KiB/s wr, 23 op/s 2023-05-08T05:59:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8087.743377 secs 2023-05-08T05:59:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8088.300729 secs 2023-05-08T05:59:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8087.743377 secs 2023-05-08T05:59:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8088.300729 secs 2023-05-08T05:59:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8087.743377 secs 2023-05-08T05:59:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8088.300729 secs 2023-05-08T05:59:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:09 smithi133 ceph-mon[125939]: pgmap v4373: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 142 KiB/s wr, 22 op/s 2023-05-08T05:59:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:09 smithi096 ceph-mon[124666]: pgmap v4373: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 142 KiB/s wr, 22 op/s 2023-05-08T05:59:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:09 smithi186 ceph-mon[126480]: pgmap v4373: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 142 KiB/s wr, 22 op/s 2023-05-08T05:59:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8089.581588 secs 2023-05-08T05:59:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8089.581588 secs 2023-05-08T05:59:11.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8089.581588 secs 2023-05-08T05:59:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:11 smithi133 ceph-mon[125939]: pgmap v4374: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 144 KiB/s wr, 24 op/s 2023-05-08T05:59:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:11 smithi133 ceph-mon[125939]: osdmap e352: 12 total, 12 up, 12 in 2023-05-08T05:59:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:11 smithi096 ceph-mon[124666]: pgmap v4374: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 144 KiB/s wr, 24 op/s 2023-05-08T05:59:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:11 smithi096 ceph-mon[124666]: osdmap e352: 12 total, 12 up, 12 in 2023-05-08T05:59:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:11 smithi186 ceph-mon[126480]: pgmap v4374: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 144 KiB/s wr, 24 op/s 2023-05-08T05:59:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:11 smithi186 ceph-mon[126480]: osdmap e352: 12 total, 12 up, 12 in 2023-05-08T05:59:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:13 smithi133 ceph-mon[125939]: pgmap v4376: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 90 KiB/s wr, 24 op/s 2023-05-08T05:59:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8092.743492 secs 2023-05-08T05:59:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8093.300850 secs 2023-05-08T05:59:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:13 smithi096 ceph-mon[124666]: pgmap v4376: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 90 KiB/s wr, 24 op/s 2023-05-08T05:59:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8092.743492 secs 2023-05-08T05:59:14.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8093.300850 secs 2023-05-08T05:59:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:13 smithi186 ceph-mon[126480]: pgmap v4376: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 90 KiB/s wr, 24 op/s 2023-05-08T05:59:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8092.743492 secs 2023-05-08T05:59:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8093.300850 secs 2023-05-08T05:59:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:59:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:59:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T05:59:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:15 smithi133 ceph-mon[125939]: pgmap v4377: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 37 KiB/s wr, 7 op/s 2023-05-08T05:59:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8094.581689 secs 2023-05-08T05:59:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:15 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:59:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:15 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:59:15.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:15 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:59:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:15 smithi096 ceph-mon[124666]: pgmap v4377: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 37 KiB/s wr, 7 op/s 2023-05-08T05:59:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8094.581689 secs 2023-05-08T05:59:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:15 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:59:16.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:15 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:59:16.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:15 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:59:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:15 smithi186 ceph-mon[126480]: pgmap v4377: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 37 KiB/s wr, 7 op/s 2023-05-08T05:59:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8094.581689 secs 2023-05-08T05:59:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:15 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T05:59:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:15 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T05:59:16.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:15 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T05:59:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:16 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:59:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:16 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T05:59:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:16 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T05:59:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:16 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T05:59:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:16 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:59:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:16 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T05:59:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:16 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T05:59:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:16 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T05:59:17.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:16 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:59:17.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:16 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T05:59:17.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:16 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T05:59:17.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:16 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T05:59:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:17 smithi133 ceph-mon[125939]: pgmap v4378: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 37 KiB/s wr, 7 op/s 2023-05-08T05:59:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:17 smithi096 ceph-mon[124666]: pgmap v4378: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 37 KiB/s wr, 7 op/s 2023-05-08T05:59:18.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:17 smithi186 ceph-mon[126480]: pgmap v4378: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 37 KiB/s wr, 7 op/s 2023-05-08T05:59:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8097.743609 secs 2023-05-08T05:59:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8098.300985 secs 2023-05-08T05:59:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8097.743609 secs 2023-05-08T05:59:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8098.300985 secs 2023-05-08T05:59:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8097.743609 secs 2023-05-08T05:59:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8098.300985 secs 2023-05-08T05:59:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:19 smithi096 ceph-mon[124666]: pgmap v4379: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 37 KiB/s wr, 7 op/s 2023-05-08T05:59:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:19 smithi096 ceph-mon[124666]: osdmap e353: 12 total, 12 up, 12 in 2023-05-08T05:59:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:19 smithi186 ceph-mon[126480]: pgmap v4379: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 37 KiB/s wr, 7 op/s 2023-05-08T05:59:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:19 smithi186 ceph-mon[126480]: osdmap e353: 12 total, 12 up, 12 in 2023-05-08T05:59:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:19 smithi133 ceph-mon[125939]: pgmap v4379: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 37 KiB/s wr, 7 op/s 2023-05-08T05:59:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:19 smithi133 ceph-mon[125939]: osdmap e353: 12 total, 12 up, 12 in 2023-05-08T05:59:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8099.581805 secs 2023-05-08T05:59:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8099.581805 secs 2023-05-08T05:59:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8099.581805 secs 2023-05-08T05:59:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:21 smithi096 ceph-mon[124666]: pgmap v4381: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 630 B/s wr, 6 op/s 2023-05-08T05:59:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:21 smithi186 ceph-mon[126480]: pgmap v4381: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 630 B/s wr, 6 op/s 2023-05-08T05:59:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:21 smithi133 ceph-mon[125939]: pgmap v4381: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 630 B/s wr, 6 op/s 2023-05-08T05:59:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:23 smithi096 ceph-mon[124666]: pgmap v4382: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 818 B/s wr, 7 op/s 2023-05-08T05:59:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8102.743726 secs 2023-05-08T05:59:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8103.301106 secs 2023-05-08T05:59:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:23 smithi186 ceph-mon[126480]: pgmap v4382: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 818 B/s wr, 7 op/s 2023-05-08T05:59:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8102.743726 secs 2023-05-08T05:59:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8103.301106 secs 2023-05-08T05:59:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:23 smithi133 ceph-mon[125939]: pgmap v4382: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 818 B/s wr, 7 op/s 2023-05-08T05:59:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8102.743726 secs 2023-05-08T05:59:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8103.301106 secs 2023-05-08T05:59:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:25 smithi096 ceph-mon[124666]: pgmap v4383: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 1.3 KiB/s wr, 8 op/s 2023-05-08T05:59:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8104.581951 secs 2023-05-08T05:59:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:25 smithi186 ceph-mon[126480]: pgmap v4383: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 1.3 KiB/s wr, 8 op/s 2023-05-08T05:59:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8104.581951 secs 2023-05-08T05:59:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:25 smithi133 ceph-mon[125939]: pgmap v4383: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 1.3 KiB/s wr, 8 op/s 2023-05-08T05:59:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8104.581951 secs 2023-05-08T05:59:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:27 smithi186 ceph-mon[126480]: pgmap v4384: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 57 KiB/s wr, 8 op/s 2023-05-08T05:59:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:27 smithi133 ceph-mon[125939]: pgmap v4384: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 57 KiB/s wr, 8 op/s 2023-05-08T05:59:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:27 smithi096 ceph-mon[124666]: pgmap v4384: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 57 KiB/s wr, 8 op/s 2023-05-08T05:59:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8107.743863 secs 2023-05-08T05:59:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8108.301222 secs 2023-05-08T05:59:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8107.743863 secs 2023-05-08T05:59:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8108.301222 secs 2023-05-08T05:59:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8107.743863 secs 2023-05-08T05:59:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8108.301222 secs 2023-05-08T05:59:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:29 smithi186 ceph-mon[126480]: pgmap v4385: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 57 KiB/s wr, 8 op/s 2023-05-08T05:59:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:29 smithi133 ceph-mon[125939]: pgmap v4385: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 57 KiB/s wr, 8 op/s 2023-05-08T05:59:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:29 smithi096 ceph-mon[124666]: pgmap v4385: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 57 KiB/s wr, 8 op/s 2023-05-08T05:59:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8109.582065 secs 2023-05-08T05:59:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8109.582065 secs 2023-05-08T05:59:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8109.582065 secs 2023-05-08T05:59:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:31 smithi186 ceph-mon[126480]: pgmap v4386: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 53 KiB/s wr, 7 op/s 2023-05-08T05:59:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:31 smithi133 ceph-mon[125939]: pgmap v4386: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 53 KiB/s wr, 7 op/s 2023-05-08T05:59:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:31 smithi096 ceph-mon[124666]: pgmap v4386: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 53 KiB/s wr, 7 op/s 2023-05-08T05:59:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:33 smithi186 ceph-mon[126480]: pgmap v4387: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 82 KiB/s wr, 8 op/s 2023-05-08T05:59:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8112.744001 secs 2023-05-08T05:59:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8113.301318 secs 2023-05-08T05:59:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:33 smithi133 ceph-mon[125939]: pgmap v4387: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 82 KiB/s wr, 8 op/s 2023-05-08T05:59:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8112.744001 secs 2023-05-08T05:59:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8113.301318 secs 2023-05-08T05:59:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:33 smithi096 ceph-mon[124666]: pgmap v4387: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 82 KiB/s wr, 8 op/s 2023-05-08T05:59:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8112.744001 secs 2023-05-08T05:59:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8113.301318 secs 2023-05-08T05:59:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:35 smithi186 ceph-mon[126480]: pgmap v4388: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 82 KiB/s wr, 9 op/s 2023-05-08T05:59:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8114.582187 secs 2023-05-08T05:59:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:35 smithi133 ceph-mon[125939]: pgmap v4388: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 82 KiB/s wr, 9 op/s 2023-05-08T05:59:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8114.582187 secs 2023-05-08T05:59:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:35 smithi096 ceph-mon[124666]: pgmap v4388: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 82 KiB/s wr, 9 op/s 2023-05-08T05:59:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8114.582187 secs 2023-05-08T05:59:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:37 smithi186 ceph-mon[126480]: pgmap v4389: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 216 KiB/s wr, 7 op/s 2023-05-08T05:59:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:37 smithi133 ceph-mon[125939]: pgmap v4389: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 216 KiB/s wr, 7 op/s 2023-05-08T05:59:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:37 smithi096 ceph-mon[124666]: pgmap v4389: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 216 KiB/s wr, 7 op/s 2023-05-08T05:59:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8117.744119 secs 2023-05-08T05:59:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8117.744119 secs 2023-05-08T05:59:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8117.744119 secs 2023-05-08T05:59:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:39 smithi186 ceph-mon[126480]: pgmap v4390: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 170 KiB/s wr, 6 op/s 2023-05-08T05:59:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:39 smithi133 ceph-mon[125939]: pgmap v4390: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 170 KiB/s wr, 6 op/s 2023-05-08T05:59:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:39 smithi096 ceph-mon[124666]: pgmap v4390: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 170 KiB/s wr, 6 op/s 2023-05-08T05:59:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:41 smithi186 ceph-mon[126480]: pgmap v4391: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 266 KiB/s wr, 9 op/s 2023-05-08T05:59:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:41 smithi133 ceph-mon[125939]: pgmap v4391: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 266 KiB/s wr, 9 op/s 2023-05-08T05:59:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:41 smithi096 ceph-mon[124666]: pgmap v4391: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 266 KiB/s wr, 9 op/s 2023-05-08T05:59:43.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:59:43.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:59:43.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:59:43.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:59:43.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:59:43.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T05:59:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:43 smithi186 ceph-mon[126480]: pgmap v4392: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 268 KiB/s wr, 9 op/s 2023-05-08T05:59:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:43 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:59:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:59:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:59:44.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:59:44.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8122.744239 secs 2023-05-08T05:59:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:43 smithi133 ceph-mon[125939]: pgmap v4392: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 268 KiB/s wr, 9 op/s 2023-05-08T05:59:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:43 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:59:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:59:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:59:44.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:59:44.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8122.744239 secs 2023-05-08T05:59:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:43 smithi096 ceph-mon[124666]: pgmap v4392: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 268 KiB/s wr, 9 op/s 2023-05-08T05:59:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:43 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:59:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T05:59:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:59:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:59:44.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8122.744239 secs 2023-05-08T05:59:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:45 smithi186 ceph-mon[126480]: pgmap v4393: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 392 KiB/s wr, 12 op/s 2023-05-08T05:59:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:45 smithi133 ceph-mon[125939]: pgmap v4393: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 392 KiB/s wr, 12 op/s 2023-05-08T05:59:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:45 smithi096 ceph-mon[124666]: pgmap v4393: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 392 KiB/s wr, 12 op/s 2023-05-08T05:59:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:47 smithi186 ceph-mon[126480]: pgmap v4394: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 395 KiB/s wr, 11 op/s 2023-05-08T05:59:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:47 smithi133 ceph-mon[125939]: pgmap v4394: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 395 KiB/s wr, 11 op/s 2023-05-08T05:59:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:47 smithi096 ceph-mon[124666]: pgmap v4394: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 395 KiB/s wr, 11 op/s 2023-05-08T05:59:49.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8127.744397 secs 2023-05-08T05:59:49.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8128.301676 secs 2023-05-08T05:59:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8127.744397 secs 2023-05-08T05:59:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8128.301676 secs 2023-05-08T05:59:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8127.744397 secs 2023-05-08T05:59:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8128.301676 secs 2023-05-08T05:59:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:49 smithi186 ceph-mon[126480]: pgmap v4395: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 260 KiB/s wr, 9 op/s 2023-05-08T05:59:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:49 smithi133 ceph-mon[125939]: pgmap v4395: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 260 KiB/s wr, 9 op/s 2023-05-08T05:59:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:49 smithi096 ceph-mon[124666]: pgmap v4395: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 260 KiB/s wr, 9 op/s 2023-05-08T05:59:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:50 smithi133 ceph-mon[125939]: pgmap v4396: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 273 KiB/s wr, 13 op/s 2023-05-08T05:59:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:59:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:59:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:59:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:50 smithi096 ceph-mon[124666]: pgmap v4396: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 273 KiB/s wr, 13 op/s 2023-05-08T05:59:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:59:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:59:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:59:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:50 smithi186 ceph-mon[126480]: pgmap v4396: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 273 KiB/s wr, 13 op/s 2023-05-08T05:59:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T05:59:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T05:59:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T05:59:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:53 smithi186 ceph-mon[126480]: pgmap v4397: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 177 KiB/s wr, 10 op/s 2023-05-08T05:59:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8132.744493 secs 2023-05-08T05:59:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:53 smithi133 ceph-mon[125939]: pgmap v4397: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 177 KiB/s wr, 10 op/s 2023-05-08T05:59:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8132.744493 secs 2023-05-08T05:59:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:53 smithi096 ceph-mon[124666]: pgmap v4397: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 177 KiB/s wr, 10 op/s 2023-05-08T05:59:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8132.744493 secs 2023-05-08T05:59:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8133.301809 secs 2023-05-08T05:59:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8133.301809 secs 2023-05-08T05:59:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8133.301809 secs 2023-05-08T05:59:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:55 smithi133 ceph-mon[125939]: pgmap v4398: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 465 KiB/s wr, 12 op/s 2023-05-08T05:59:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:55 smithi096 ceph-mon[124666]: pgmap v4398: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 465 KiB/s wr, 12 op/s 2023-05-08T05:59:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:55 smithi186 ceph-mon[126480]: pgmap v4398: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 465 KiB/s wr, 12 op/s 2023-05-08T05:59:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:57 smithi133 ceph-mon[125939]: pgmap v4399: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 310 KiB/s wr, 17 op/s 2023-05-08T05:59:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:57 smithi096 ceph-mon[124666]: pgmap v4399: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 310 KiB/s wr, 17 op/s 2023-05-08T05:59:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:57 smithi186 ceph-mon[126480]: pgmap v4399: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 310 KiB/s wr, 17 op/s 2023-05-08T05:59:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8137.744617 secs 2023-05-08T05:59:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8138.301911 secs 2023-05-08T05:59:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8137.744617 secs 2023-05-08T05:59:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8138.301911 secs 2023-05-08T05:59:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8137.744617 secs 2023-05-08T05:59:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8138.301911 secs 2023-05-08T05:59:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 05:59:59 smithi133 ceph-mon[125939]: pgmap v4400: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 308 KiB/s wr, 16 op/s 2023-05-08T06:00:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 05:59:59 smithi096 ceph-mon[124666]: pgmap v4400: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 308 KiB/s wr, 16 op/s 2023-05-08T06:00:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 05:59:59 smithi186 ceph-mon[126480]: pgmap v4400: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 308 KiB/s wr, 16 op/s 2023-05-08T06:00:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:00 smithi133 ceph-mon[125939]: overall HEALTH_WARN 2 MDSs report slow requests 2023-05-08T06:00:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:00 smithi096 ceph-mon[124666]: overall HEALTH_WARN 2 MDSs report slow requests 2023-05-08T06:00:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:00 smithi186 ceph-mon[126480]: overall HEALTH_WARN 2 MDSs report slow requests 2023-05-08T06:00:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:01 smithi133 ceph-mon[125939]: pgmap v4401: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 324 KiB/s rd, 338 KiB/s wr, 104 op/s 2023-05-08T06:00:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:00:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:01 smithi096 ceph-mon[124666]: pgmap v4401: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 324 KiB/s rd, 338 KiB/s wr, 104 op/s 2023-05-08T06:00:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:00:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:01 smithi186 ceph-mon[126480]: pgmap v4401: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 324 KiB/s rd, 338 KiB/s wr, 104 op/s 2023-05-08T06:00:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:00:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:03 smithi133 ceph-mon[125939]: pgmap v4402: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 325 KiB/s wr, 102 op/s 2023-05-08T06:00:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8142.744731 secs 2023-05-08T06:00:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8143.302033 secs 2023-05-08T06:00:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:03 smithi096 ceph-mon[124666]: pgmap v4402: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 325 KiB/s wr, 102 op/s 2023-05-08T06:00:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8142.744731 secs 2023-05-08T06:00:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8143.302033 secs 2023-05-08T06:00:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:03 smithi186 ceph-mon[126480]: pgmap v4402: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 325 KiB/s wr, 102 op/s 2023-05-08T06:00:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8142.744731 secs 2023-05-08T06:00:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8143.302033 secs 2023-05-08T06:00:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:05 smithi133 ceph-mon[125939]: pgmap v4403: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 464 KiB/s wr, 120 op/s 2023-05-08T06:00:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8144.582954 secs 2023-05-08T06:00:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:05 smithi096 ceph-mon[124666]: pgmap v4403: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 464 KiB/s wr, 120 op/s 2023-05-08T06:00:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8144.582954 secs 2023-05-08T06:00:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:05 smithi186 ceph-mon[126480]: pgmap v4403: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 464 KiB/s wr, 120 op/s 2023-05-08T06:00:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8144.582954 secs 2023-05-08T06:00:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:06 smithi096 ceph-mon[124666]: osdmap e354: 12 total, 12 up, 12 in 2023-05-08T06:00:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:00:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:06 smithi186 ceph-mon[126480]: osdmap e354: 12 total, 12 up, 12 in 2023-05-08T06:00:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:00:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:06 smithi133 ceph-mon[125939]: osdmap e354: 12 total, 12 up, 12 in 2023-05-08T06:00:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:00:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:07 smithi096 ceph-mon[124666]: pgmap v4405: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 204 KiB/s wr, 129 op/s 2023-05-08T06:00:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:07 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:00:08.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:07 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:00:08.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:07 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:00:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:07 smithi186 ceph-mon[126480]: pgmap v4405: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 204 KiB/s wr, 129 op/s 2023-05-08T06:00:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:07 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:00:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:07 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:00:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:07 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:00:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:07 smithi133 ceph-mon[125939]: pgmap v4405: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 204 KiB/s wr, 129 op/s 2023-05-08T06:00:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:07 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:00:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:07 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:00:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:07 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:00:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8147.744883 secs 2023-05-08T06:00:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8147.744883 secs 2023-05-08T06:00:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8147.744883 secs 2023-05-08T06:00:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:09 smithi186 ceph-mon[126480]: pgmap v4406: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 204 KiB/s wr, 129 op/s 2023-05-08T06:00:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:00:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:09 smithi133 ceph-mon[125939]: pgmap v4406: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 204 KiB/s wr, 129 op/s 2023-05-08T06:00:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:00:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:09 smithi096 ceph-mon[124666]: pgmap v4406: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 204 KiB/s wr, 129 op/s 2023-05-08T06:00:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:00:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8149.583050 secs 2023-05-08T06:00:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:10 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:00:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8149.583050 secs 2023-05-08T06:00:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:10 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:00:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8149.583050 secs 2023-05-08T06:00:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:10 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:00:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:11 smithi186 ceph-mon[126480]: pgmap v4407: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 229 KiB/s wr, 29 op/s 2023-05-08T06:00:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:11 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:00:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:11 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:00:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:11 smithi133 ceph-mon[125939]: pgmap v4407: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 229 KiB/s wr, 29 op/s 2023-05-08T06:00:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:11 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:00:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:11 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:00:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:11 smithi096 ceph-mon[124666]: pgmap v4407: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 229 KiB/s wr, 29 op/s 2023-05-08T06:00:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:11 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:00:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:11 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:00:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:13 smithi186 ceph-mon[126480]: pgmap v4408: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 237 KiB/s wr, 30 op/s 2023-05-08T06:00:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8152.745015 secs 2023-05-08T06:00:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8153.302280 secs 2023-05-08T06:00:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:13 smithi133 ceph-mon[125939]: pgmap v4408: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 237 KiB/s wr, 30 op/s 2023-05-08T06:00:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8152.745015 secs 2023-05-08T06:00:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8153.302280 secs 2023-05-08T06:00:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:13 smithi096 ceph-mon[124666]: pgmap v4408: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 237 KiB/s wr, 30 op/s 2023-05-08T06:00:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8152.745015 secs 2023-05-08T06:00:14.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8153.302280 secs 2023-05-08T06:00:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:14 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:00:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:14 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:00:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:14 smithi186 ceph-mon[126480]: osdmap e355: 12 total, 12 up, 12 in 2023-05-08T06:00:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:14 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:00:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:14 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:00:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:14 smithi133 ceph-mon[125939]: osdmap e355: 12 total, 12 up, 12 in 2023-05-08T06:00:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:14 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:00:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:14 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:00:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:14 smithi096 ceph-mon[124666]: osdmap e355: 12 total, 12 up, 12 in 2023-05-08T06:00:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:15 smithi186 ceph-mon[126480]: pgmap v4409: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 79 KiB/s wr, 11 op/s 2023-05-08T06:00:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:15 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:00:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:15 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:00:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8154.583133 secs 2023-05-08T06:00:16.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:15 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:00:16.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:15 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:00:16.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:15 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:00:16.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:15 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:00:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:15 smithi133 ceph-mon[125939]: pgmap v4409: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 79 KiB/s wr, 11 op/s 2023-05-08T06:00:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:15 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:00:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:15 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:00:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8154.583133 secs 2023-05-08T06:00:16.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:15 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:00:16.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:15 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:00:16.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:15 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:00:16.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:15 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:00:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:15 smithi096 ceph-mon[124666]: pgmap v4409: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 79 KiB/s wr, 11 op/s 2023-05-08T06:00:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:15 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:00:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:15 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:00:16.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8154.583133 secs 2023-05-08T06:00:16.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:15 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:00:16.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:15 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:00:16.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:15 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:00:16.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:15 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:00:17.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:16 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:00:17.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:16 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T06:00:17.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:16 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T06:00:17.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:16 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:00:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:16 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:00:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:16 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T06:00:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:16 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T06:00:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:16 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:00:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:16 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:00:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:16 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T06:00:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:16 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T06:00:17.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:16 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:00:18.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:17 smithi186 ceph-mon[126480]: pgmap v4411: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 80 KiB/s wr, 11 op/s 2023-05-08T06:00:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:17 smithi133 ceph-mon[125939]: pgmap v4411: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 80 KiB/s wr, 11 op/s 2023-05-08T06:00:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:17 smithi096 ceph-mon[124666]: pgmap v4411: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 80 KiB/s wr, 11 op/s 2023-05-08T06:00:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8157.745136 secs 2023-05-08T06:00:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8158.302413 secs 2023-05-08T06:00:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8157.745136 secs 2023-05-08T06:00:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8158.302413 secs 2023-05-08T06:00:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8157.745136 secs 2023-05-08T06:00:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8158.302413 secs 2023-05-08T06:00:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:19 smithi186 ceph-mon[126480]: pgmap v4412: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 80 KiB/s wr, 11 op/s 2023-05-08T06:00:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:19 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:00:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:19 smithi133 ceph-mon[125939]: pgmap v4412: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 80 KiB/s wr, 11 op/s 2023-05-08T06:00:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:19 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:00:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:19 smithi096 ceph-mon[124666]: pgmap v4412: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 80 KiB/s wr, 11 op/s 2023-05-08T06:00:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:19 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:00:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8159.583254 secs 2023-05-08T06:00:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8159.583254 secs 2023-05-08T06:00:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8159.583254 secs 2023-05-08T06:00:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:21 smithi186 ceph-mon[126480]: pgmap v4413: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 34 KiB/s wr, 10 op/s 2023-05-08T06:00:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:21 smithi133 ceph-mon[125939]: pgmap v4413: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 34 KiB/s wr, 10 op/s 2023-05-08T06:00:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:21 smithi096 ceph-mon[124666]: pgmap v4413: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 34 KiB/s wr, 10 op/s 2023-05-08T06:00:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:23 smithi186 ceph-mon[126480]: pgmap v4414: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 8 op/s 2023-05-08T06:00:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8162.745274 secs 2023-05-08T06:00:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8163.302532 secs 2023-05-08T06:00:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:23 smithi133 ceph-mon[125939]: pgmap v4414: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 8 op/s 2023-05-08T06:00:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8162.745274 secs 2023-05-08T06:00:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8163.302532 secs 2023-05-08T06:00:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:23 smithi096 ceph-mon[124666]: pgmap v4414: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 8 op/s 2023-05-08T06:00:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8162.745274 secs 2023-05-08T06:00:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8163.302532 secs 2023-05-08T06:00:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:25 smithi186 ceph-mon[126480]: pgmap v4415: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 8 op/s 2023-05-08T06:00:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8164.583375 secs 2023-05-08T06:00:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:25 smithi133 ceph-mon[125939]: pgmap v4415: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 8 op/s 2023-05-08T06:00:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8164.583375 secs 2023-05-08T06:00:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:25 smithi096 ceph-mon[124666]: pgmap v4415: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 8 op/s 2023-05-08T06:00:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8164.583375 secs 2023-05-08T06:00:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:27 smithi186 ceph-mon[126480]: pgmap v4416: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 7 op/s 2023-05-08T06:00:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:27 smithi133 ceph-mon[125939]: pgmap v4416: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 7 op/s 2023-05-08T06:00:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:27 smithi096 ceph-mon[124666]: pgmap v4416: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 7 op/s 2023-05-08T06:00:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8167.745390 secs 2023-05-08T06:00:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8168.302655 secs 2023-05-08T06:00:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8167.745390 secs 2023-05-08T06:00:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8168.302655 secs 2023-05-08T06:00:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8167.745390 secs 2023-05-08T06:00:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8168.302655 secs 2023-05-08T06:00:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:29 smithi186 ceph-mon[126480]: pgmap v4417: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 6 op/s 2023-05-08T06:00:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:29 smithi133 ceph-mon[125939]: pgmap v4417: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 6 op/s 2023-05-08T06:00:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:29 smithi096 ceph-mon[124666]: pgmap v4417: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 6 op/s 2023-05-08T06:00:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8169.583437 secs 2023-05-08T06:00:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8169.583437 secs 2023-05-08T06:00:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8169.583437 secs 2023-05-08T06:00:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:31 smithi186 ceph-mon[126480]: pgmap v4418: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 52 KiB/s wr, 10 op/s 2023-05-08T06:00:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:31 smithi133 ceph-mon[125939]: pgmap v4418: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 52 KiB/s wr, 10 op/s 2023-05-08T06:00:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:31 smithi096 ceph-mon[124666]: pgmap v4418: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 52 KiB/s wr, 10 op/s 2023-05-08T06:00:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:33 smithi186 ceph-mon[126480]: pgmap v4419: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 39 KiB/s wr, 7 op/s 2023-05-08T06:00:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8172.745495 secs 2023-05-08T06:00:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8173.302752 secs 2023-05-08T06:00:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:33 smithi133 ceph-mon[125939]: pgmap v4419: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 39 KiB/s wr, 7 op/s 2023-05-08T06:00:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8172.745495 secs 2023-05-08T06:00:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8173.302752 secs 2023-05-08T06:00:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:33 smithi096 ceph-mon[124666]: pgmap v4419: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 39 KiB/s wr, 7 op/s 2023-05-08T06:00:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8172.745495 secs 2023-05-08T06:00:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8173.302752 secs 2023-05-08T06:00:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:35 smithi186 ceph-mon[126480]: pgmap v4420: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 49 KiB/s wr, 11 op/s 2023-05-08T06:00:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:35 smithi133 ceph-mon[125939]: pgmap v4420: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 49 KiB/s wr, 11 op/s 2023-05-08T06:00:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:35 smithi096 ceph-mon[124666]: pgmap v4420: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 49 KiB/s wr, 11 op/s 2023-05-08T06:00:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:37 smithi186 ceph-mon[126480]: pgmap v4421: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 40 KiB/s wr, 9 op/s 2023-05-08T06:00:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:37 smithi133 ceph-mon[125939]: pgmap v4421: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 40 KiB/s wr, 9 op/s 2023-05-08T06:00:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:37 smithi096 ceph-mon[124666]: pgmap v4421: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 40 KiB/s wr, 9 op/s 2023-05-08T06:00:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8177.745614 secs 2023-05-08T06:00:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:38 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:00:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8178.302845 secs 2023-05-08T06:00:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8177.745614 secs 2023-05-08T06:00:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:38 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:00:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8178.302845 secs 2023-05-08T06:00:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8177.745614 secs 2023-05-08T06:00:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:38 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:00:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8178.302845 secs 2023-05-08T06:00:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:39 smithi186 ceph-mon[126480]: pgmap v4422: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 39 KiB/s wr, 8 op/s 2023-05-08T06:00:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:39 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:00:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:39 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:00:40.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:39 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:00:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:39 smithi133 ceph-mon[125939]: pgmap v4422: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 39 KiB/s wr, 8 op/s 2023-05-08T06:00:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:39 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:00:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:39 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:00:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:39 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:00:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:39 smithi096 ceph-mon[124666]: pgmap v4422: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 39 KiB/s wr, 8 op/s 2023-05-08T06:00:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:39 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:00:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:39 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:00:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:39 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:00:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:41 smithi186 ceph-mon[126480]: pgmap v4423: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 49 KiB/s wr, 11 op/s 2023-05-08T06:00:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:41 smithi133 ceph-mon[125939]: pgmap v4423: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 49 KiB/s wr, 11 op/s 2023-05-08T06:00:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:41 smithi096 ceph-mon[124666]: pgmap v4423: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 49 KiB/s wr, 11 op/s 2023-05-08T06:00:43.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:42 smithi133 ceph-mon[125939]: pgmap v4424: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 KiB/s wr, 7 op/s 2023-05-08T06:00:43.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:42 smithi096 ceph-mon[124666]: pgmap v4424: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 KiB/s wr, 7 op/s 2023-05-08T06:00:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:42 smithi186 ceph-mon[126480]: pgmap v4424: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 KiB/s wr, 7 op/s 2023-05-08T06:00:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8182.745745 secs 2023-05-08T06:00:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8182.745745 secs 2023-05-08T06:00:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8182.745745 secs 2023-05-08T06:00:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:45 smithi133 ceph-mon[125939]: pgmap v4425: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 40 KiB/s wr, 10 op/s 2023-05-08T06:00:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:45 smithi096 ceph-mon[124666]: pgmap v4425: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 40 KiB/s wr, 10 op/s 2023-05-08T06:00:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:45 smithi186 ceph-mon[126480]: pgmap v4425: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 40 KiB/s wr, 10 op/s 2023-05-08T06:00:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:46 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:00:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:46 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:00:47.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:46 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:00:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:47 smithi133 ceph-mon[125939]: pgmap v4426: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 7 op/s 2023-05-08T06:00:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:47 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:00:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:47 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:00:47.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:47 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:00:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:47 smithi096 ceph-mon[124666]: pgmap v4426: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 7 op/s 2023-05-08T06:00:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:47 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:00:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:47 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:00:48.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:47 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:00:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:47 smithi186 ceph-mon[126480]: pgmap v4426: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 7 op/s 2023-05-08T06:00:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:47 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:00:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:47 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:00:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:47 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:00:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8187.745882 secs 2023-05-08T06:00:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8187.745882 secs 2023-05-08T06:00:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8187.745882 secs 2023-05-08T06:00:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:49 smithi133 ceph-mon[125939]: pgmap v4427: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T06:00:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:49 smithi096 ceph-mon[124666]: pgmap v4427: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T06:00:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:49 smithi186 ceph-mon[126480]: pgmap v4427: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T06:00:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:51 smithi133 ceph-mon[125939]: pgmap v4428: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 63 KiB/s wr, 11 op/s 2023-05-08T06:00:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:51 smithi096 ceph-mon[124666]: pgmap v4428: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 63 KiB/s wr, 11 op/s 2023-05-08T06:00:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:51 smithi186 ceph-mon[126480]: pgmap v4428: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 63 KiB/s wr, 11 op/s 2023-05-08T06:00:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:53 smithi133 ceph-mon[125939]: pgmap v4429: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 54 KiB/s wr, 9 op/s 2023-05-08T06:00:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8192.745995 secs 2023-05-08T06:00:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8193.303197 secs 2023-05-08T06:00:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:53 smithi096 ceph-mon[124666]: pgmap v4429: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 54 KiB/s wr, 9 op/s 2023-05-08T06:00:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8192.745995 secs 2023-05-08T06:00:54.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8193.303197 secs 2023-05-08T06:00:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:53 smithi186 ceph-mon[126480]: pgmap v4429: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 54 KiB/s wr, 9 op/s 2023-05-08T06:00:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8192.745995 secs 2023-05-08T06:00:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8193.303197 secs 2023-05-08T06:00:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:55 smithi133 ceph-mon[125939]: pgmap v4430: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 64 KiB/s wr, 12 op/s 2023-05-08T06:00:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:55 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:00:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:55 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:00:55.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:55 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:00:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:55 smithi096 ceph-mon[124666]: pgmap v4430: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 64 KiB/s wr, 12 op/s 2023-05-08T06:00:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:55 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:00:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:55 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:00:56.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:55 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:00:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:55 smithi186 ceph-mon[126480]: pgmap v4430: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 64 KiB/s wr, 12 op/s 2023-05-08T06:00:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:55 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:00:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:55 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:00:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:55 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:00:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:57 smithi133 ceph-mon[125939]: pgmap v4431: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 43 KiB/s wr, 9 op/s 2023-05-08T06:00:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:57 smithi096 ceph-mon[124666]: pgmap v4431: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 43 KiB/s wr, 9 op/s 2023-05-08T06:00:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:57 smithi186 ceph-mon[126480]: pgmap v4431: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 43 KiB/s wr, 9 op/s 2023-05-08T06:00:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8197.746118 secs 2023-05-08T06:00:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8197.746118 secs 2023-05-08T06:00:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8197.746118 secs 2023-05-08T06:00:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:00:59 smithi133 ceph-mon[125939]: pgmap v4432: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 41 KiB/s wr, 9 op/s 2023-05-08T06:01:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:00:59 smithi096 ceph-mon[124666]: pgmap v4432: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 41 KiB/s wr, 9 op/s 2023-05-08T06:01:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:00:59 smithi186 ceph-mon[126480]: pgmap v4432: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 41 KiB/s wr, 9 op/s 2023-05-08T06:01:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8199.584208 secs 2023-05-08T06:01:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8199.584208 secs 2023-05-08T06:01:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8199.584208 secs 2023-05-08T06:01:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:01 smithi096 ceph-mon[124666]: pgmap v4433: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 83 KiB/s wr, 13 op/s 2023-05-08T06:01:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:01 smithi186 ceph-mon[126480]: pgmap v4433: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 83 KiB/s wr, 13 op/s 2023-05-08T06:01:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:01 smithi133 ceph-mon[125939]: pgmap v4433: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 83 KiB/s wr, 13 op/s 2023-05-08T06:01:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:02 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:01:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:02 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:01:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:02 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:01:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:03 smithi096 ceph-mon[124666]: pgmap v4434: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 53 KiB/s wr, 8 op/s 2023-05-08T06:01:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:01:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:01:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:03 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:01:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8202.746223 secs 2023-05-08T06:01:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8203.303490 secs 2023-05-08T06:01:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:03 smithi186 ceph-mon[126480]: pgmap v4434: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 53 KiB/s wr, 8 op/s 2023-05-08T06:01:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:01:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:01:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:03 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:01:04.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8202.746223 secs 2023-05-08T06:01:04.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8203.303490 secs 2023-05-08T06:01:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:03 smithi133 ceph-mon[125939]: pgmap v4434: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 53 KiB/s wr, 8 op/s 2023-05-08T06:01:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:01:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:01:04.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:03 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:01:04.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8202.746223 secs 2023-05-08T06:01:04.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8203.303490 secs 2023-05-08T06:01:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:05 smithi096 ceph-mon[124666]: pgmap v4435: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 107 KiB/s wr, 26 op/s 2023-05-08T06:01:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8204.584345 secs 2023-05-08T06:01:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:05 smithi186 ceph-mon[126480]: pgmap v4435: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 107 KiB/s wr, 26 op/s 2023-05-08T06:01:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8204.584345 secs 2023-05-08T06:01:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:05 smithi133 ceph-mon[125939]: pgmap v4435: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 107 KiB/s wr, 26 op/s 2023-05-08T06:01:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8204.584345 secs 2023-05-08T06:01:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:06 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:01:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:01:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:01:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:06 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:01:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:01:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:01:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:06 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:01:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:01:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:01:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:07 smithi186 ceph-mon[126480]: pgmap v4436: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 96 KiB/s wr, 23 op/s 2023-05-08T06:01:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:07 smithi133 ceph-mon[125939]: pgmap v4436: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 96 KiB/s wr, 23 op/s 2023-05-08T06:01:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:07 smithi096 ceph-mon[124666]: pgmap v4436: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 96 KiB/s wr, 23 op/s 2023-05-08T06:01:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8207.746351 secs 2023-05-08T06:01:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8208.303529 secs 2023-05-08T06:01:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8207.746351 secs 2023-05-08T06:01:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8208.303529 secs 2023-05-08T06:01:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8207.746351 secs 2023-05-08T06:01:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8208.303529 secs 2023-05-08T06:01:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:09 smithi186 ceph-mon[126480]: pgmap v4437: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 96 KiB/s wr, 22 op/s 2023-05-08T06:01:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:09 smithi133 ceph-mon[125939]: pgmap v4437: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 96 KiB/s wr, 22 op/s 2023-05-08T06:01:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:09 smithi096 ceph-mon[124666]: pgmap v4437: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 96 KiB/s wr, 22 op/s 2023-05-08T06:01:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8209.584441 secs 2023-05-08T06:01:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8209.584441 secs 2023-05-08T06:01:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8209.584441 secs 2023-05-08T06:01:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:11 smithi186 ceph-mon[126480]: pgmap v4438: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 107 KiB/s wr, 26 op/s 2023-05-08T06:01:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:11 smithi186 ceph-mon[126480]: osdmap e356: 12 total, 12 up, 12 in 2023-05-08T06:01:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:11 smithi133 ceph-mon[125939]: pgmap v4438: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 107 KiB/s wr, 26 op/s 2023-05-08T06:01:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:11 smithi133 ceph-mon[125939]: osdmap e356: 12 total, 12 up, 12 in 2023-05-08T06:01:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:11 smithi096 ceph-mon[124666]: pgmap v4438: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 107 KiB/s wr, 26 op/s 2023-05-08T06:01:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:11 smithi096 ceph-mon[124666]: osdmap e356: 12 total, 12 up, 12 in 2023-05-08T06:01:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:13 smithi186 ceph-mon[126480]: pgmap v4440: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 78 KiB/s wr, 26 op/s 2023-05-08T06:01:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8212.746425 secs 2023-05-08T06:01:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8213.303646 secs 2023-05-08T06:01:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:13 smithi133 ceph-mon[125939]: pgmap v4440: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 78 KiB/s wr, 26 op/s 2023-05-08T06:01:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8212.746425 secs 2023-05-08T06:01:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8213.303646 secs 2023-05-08T06:01:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:13 smithi096 ceph-mon[124666]: pgmap v4440: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 78 KiB/s wr, 26 op/s 2023-05-08T06:01:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8212.746425 secs 2023-05-08T06:01:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8213.303646 secs 2023-05-08T06:01:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:15 smithi186 ceph-mon[126480]: pgmap v4441: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 8 op/s 2023-05-08T06:01:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8214.584586 secs 2023-05-08T06:01:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:15 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:01:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:15 smithi133 ceph-mon[125939]: pgmap v4441: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 8 op/s 2023-05-08T06:01:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8214.584586 secs 2023-05-08T06:01:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:15 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:01:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:15 smithi096 ceph-mon[124666]: pgmap v4441: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 8 op/s 2023-05-08T06:01:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8214.584586 secs 2023-05-08T06:01:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:15 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:01:17.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:16 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:01:17.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:16 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:01:17.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:16 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:01:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:16 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:01:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:16 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:01:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:16 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:01:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:16 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:01:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:16 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:01:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:16 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:01:18.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:17 smithi186 ceph-mon[126480]: pgmap v4442: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 16 KiB/s wr, 8 op/s 2023-05-08T06:01:18.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:17 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:01:18.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:17 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T06:01:18.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:17 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T06:01:18.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:17 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:01:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:17 smithi133 ceph-mon[125939]: pgmap v4442: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 16 KiB/s wr, 8 op/s 2023-05-08T06:01:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:17 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:01:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:17 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T06:01:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:17 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T06:01:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:17 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:01:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:17 smithi096 ceph-mon[124666]: pgmap v4442: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 16 KiB/s wr, 8 op/s 2023-05-08T06:01:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:17 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:01:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:17 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T06:01:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:17 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T06:01:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:17 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:01:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8217.746571 secs 2023-05-08T06:01:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8218.303765 secs 2023-05-08T06:01:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8217.746571 secs 2023-05-08T06:01:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8218.303765 secs 2023-05-08T06:01:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8217.746571 secs 2023-05-08T06:01:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8218.303765 secs 2023-05-08T06:01:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:19 smithi186 ceph-mon[126480]: pgmap v4443: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 16 KiB/s wr, 8 op/s 2023-05-08T06:01:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:19 smithi186 ceph-mon[126480]: osdmap e357: 12 total, 12 up, 12 in 2023-05-08T06:01:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:19 smithi133 ceph-mon[125939]: pgmap v4443: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 16 KiB/s wr, 8 op/s 2023-05-08T06:01:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:19 smithi133 ceph-mon[125939]: osdmap e357: 12 total, 12 up, 12 in 2023-05-08T06:01:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:19 smithi096 ceph-mon[124666]: pgmap v4443: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 16 KiB/s wr, 8 op/s 2023-05-08T06:01:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:19 smithi096 ceph-mon[124666]: osdmap e357: 12 total, 12 up, 12 in 2023-05-08T06:01:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8219.584710 secs 2023-05-08T06:01:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8219.584710 secs 2023-05-08T06:01:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8219.584710 secs 2023-05-08T06:01:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:21 smithi186 ceph-mon[126480]: pgmap v4445: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.1 KiB/s wr, 8 op/s 2023-05-08T06:01:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:21 smithi133 ceph-mon[125939]: pgmap v4445: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.1 KiB/s wr, 8 op/s 2023-05-08T06:01:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:21 smithi096 ceph-mon[124666]: pgmap v4445: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.1 KiB/s wr, 8 op/s 2023-05-08T06:01:23.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:22 smithi133 ceph-mon[125939]: pgmap v4446: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.0 KiB/s wr, 8 op/s 2023-05-08T06:01:23.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:22 smithi096 ceph-mon[124666]: pgmap v4446: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.0 KiB/s wr, 8 op/s 2023-05-08T06:01:23.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:22 smithi186 ceph-mon[126480]: pgmap v4446: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.0 KiB/s wr, 8 op/s 2023-05-08T06:01:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8222.746704 secs 2023-05-08T06:01:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8223.303877 secs 2023-05-08T06:01:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8222.746704 secs 2023-05-08T06:01:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8223.303877 secs 2023-05-08T06:01:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8222.746704 secs 2023-05-08T06:01:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8223.303877 secs 2023-05-08T06:01:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:25 smithi133 ceph-mon[125939]: pgmap v4447: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 8 op/s 2023-05-08T06:01:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8224.584809 secs 2023-05-08T06:01:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:25 smithi096 ceph-mon[124666]: pgmap v4447: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 8 op/s 2023-05-08T06:01:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8224.584809 secs 2023-05-08T06:01:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:25 smithi186 ceph-mon[126480]: pgmap v4447: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 8 op/s 2023-05-08T06:01:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8224.584809 secs 2023-05-08T06:01:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:27 smithi133 ceph-mon[125939]: pgmap v4448: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 8 op/s 2023-05-08T06:01:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:27 smithi096 ceph-mon[124666]: pgmap v4448: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 8 op/s 2023-05-08T06:01:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:27 smithi186 ceph-mon[126480]: pgmap v4448: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 8 op/s 2023-05-08T06:01:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8227.746848 secs 2023-05-08T06:01:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8228.303998 secs 2023-05-08T06:01:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8227.746848 secs 2023-05-08T06:01:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8228.303998 secs 2023-05-08T06:01:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8227.746848 secs 2023-05-08T06:01:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8228.303998 secs 2023-05-08T06:01:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:29 smithi096 ceph-mon[124666]: pgmap v4449: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 8 op/s 2023-05-08T06:01:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:29 smithi186 ceph-mon[126480]: pgmap v4449: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 8 op/s 2023-05-08T06:01:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:29 smithi133 ceph-mon[125939]: pgmap v4449: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 8 op/s 2023-05-08T06:01:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8229.584927 secs 2023-05-08T06:01:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8229.584927 secs 2023-05-08T06:01:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8229.584927 secs 2023-05-08T06:01:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:31 smithi096 ceph-mon[124666]: pgmap v4450: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 8 op/s 2023-05-08T06:01:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:31 smithi186 ceph-mon[126480]: pgmap v4450: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 8 op/s 2023-05-08T06:01:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:31 smithi133 ceph-mon[125939]: pgmap v4450: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 8 op/s 2023-05-08T06:01:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:33 smithi096 ceph-mon[124666]: pgmap v4451: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 6 op/s 2023-05-08T06:01:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8232.746970 secs 2023-05-08T06:01:34.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8233.304109 secs 2023-05-08T06:01:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:33 smithi186 ceph-mon[126480]: pgmap v4451: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 6 op/s 2023-05-08T06:01:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8232.746970 secs 2023-05-08T06:01:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8233.304109 secs 2023-05-08T06:01:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:33 smithi133 ceph-mon[125939]: pgmap v4451: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 6 op/s 2023-05-08T06:01:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8232.746970 secs 2023-05-08T06:01:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8233.304109 secs 2023-05-08T06:01:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:35 smithi096 ceph-mon[124666]: pgmap v4452: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 9 op/s 2023-05-08T06:01:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:35 smithi186 ceph-mon[126480]: pgmap v4452: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 9 op/s 2023-05-08T06:01:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:35 smithi133 ceph-mon[125939]: pgmap v4452: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 9 op/s 2023-05-08T06:01:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:37 smithi186 ceph-mon[126480]: pgmap v4453: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 7 op/s 2023-05-08T06:01:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:37 smithi133 ceph-mon[125939]: pgmap v4453: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 7 op/s 2023-05-08T06:01:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:37 smithi096 ceph-mon[124666]: pgmap v4453: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 7 op/s 2023-05-08T06:01:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8237.747097 secs 2023-05-08T06:01:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:38 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:01:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8237.747097 secs 2023-05-08T06:01:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:38 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:01:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8237.747097 secs 2023-05-08T06:01:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:38 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:01:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:39 smithi186 ceph-mon[126480]: pgmap v4454: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 7 op/s 2023-05-08T06:01:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:39 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:01:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:39 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:01:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:39 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:01:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:39 smithi133 ceph-mon[125939]: pgmap v4454: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 7 op/s 2023-05-08T06:01:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:39 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:01:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:39 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:01:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:39 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:01:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:39 smithi096 ceph-mon[124666]: pgmap v4454: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 7 op/s 2023-05-08T06:01:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:39 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:01:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:39 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:01:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:39 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:01:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:41 smithi186 ceph-mon[126480]: pgmap v4455: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 40 KiB/s wr, 11 op/s 2023-05-08T06:01:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:41 smithi133 ceph-mon[125939]: pgmap v4455: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 40 KiB/s wr, 11 op/s 2023-05-08T06:01:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:41 smithi096 ceph-mon[124666]: pgmap v4455: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 40 KiB/s wr, 11 op/s 2023-05-08T06:01:43.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:01:43.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:01:43.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:01:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:43 smithi186 ceph-mon[126480]: pgmap v4456: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 7 op/s 2023-05-08T06:01:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:01:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:01:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8242.747218 secs 2023-05-08T06:01:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:43 smithi133 ceph-mon[125939]: pgmap v4456: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 7 op/s 2023-05-08T06:01:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:01:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:01:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8242.747218 secs 2023-05-08T06:01:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:43 smithi096 ceph-mon[124666]: pgmap v4456: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 7 op/s 2023-05-08T06:01:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:01:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:01:44.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8242.747218 secs 2023-05-08T06:01:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:44 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:01:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:44 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:01:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:44 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:01:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:45 smithi186 ceph-mon[126480]: pgmap v4457: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 60 KiB/s wr, 12 op/s 2023-05-08T06:01:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:45 smithi133 ceph-mon[125939]: pgmap v4457: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 60 KiB/s wr, 12 op/s 2023-05-08T06:01:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:45 smithi096 ceph-mon[124666]: pgmap v4457: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 60 KiB/s wr, 12 op/s 2023-05-08T06:01:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:47 smithi186 ceph-mon[126480]: pgmap v4458: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 49 KiB/s wr, 10 op/s 2023-05-08T06:01:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:47 smithi133 ceph-mon[125939]: pgmap v4458: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 49 KiB/s wr, 10 op/s 2023-05-08T06:01:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:47 smithi096 ceph-mon[124666]: pgmap v4458: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 49 KiB/s wr, 10 op/s 2023-05-08T06:01:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8247.747326 secs 2023-05-08T06:01:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8248.304501 secs 2023-05-08T06:01:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8247.747326 secs 2023-05-08T06:01:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8248.304501 secs 2023-05-08T06:01:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8247.747326 secs 2023-05-08T06:01:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8248.304501 secs 2023-05-08T06:01:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:49 smithi186 ceph-mon[126480]: pgmap v4459: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 49 KiB/s wr, 9 op/s 2023-05-08T06:01:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:49 smithi133 ceph-mon[125939]: pgmap v4459: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 49 KiB/s wr, 9 op/s 2023-05-08T06:01:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:49 smithi096 ceph-mon[124666]: pgmap v4459: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 49 KiB/s wr, 9 op/s 2023-05-08T06:01:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:01:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:01:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:01:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:01:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:01:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:01:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:01:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:01:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:01:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:51 smithi186 ceph-mon[126480]: pgmap v4460: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 59 KiB/s wr, 13 op/s 2023-05-08T06:01:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:51 smithi133 ceph-mon[125939]: pgmap v4460: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 59 KiB/s wr, 13 op/s 2023-05-08T06:01:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:51 smithi096 ceph-mon[124666]: pgmap v4460: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 59 KiB/s wr, 13 op/s 2023-05-08T06:01:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:53 smithi186 ceph-mon[126480]: pgmap v4461: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 44 KiB/s wr, 9 op/s 2023-05-08T06:01:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8252.747464 secs 2023-05-08T06:01:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8253.304581 secs 2023-05-08T06:01:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:53 smithi133 ceph-mon[125939]: pgmap v4461: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 44 KiB/s wr, 9 op/s 2023-05-08T06:01:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8252.747464 secs 2023-05-08T06:01:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8253.304581 secs 2023-05-08T06:01:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:53 smithi096 ceph-mon[124666]: pgmap v4461: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 44 KiB/s wr, 9 op/s 2023-05-08T06:01:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8252.747464 secs 2023-05-08T06:01:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8253.304581 secs 2023-05-08T06:01:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:55 smithi186 ceph-mon[126480]: pgmap v4462: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 74 KiB/s wr, 12 op/s 2023-05-08T06:01:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:55 smithi133 ceph-mon[125939]: pgmap v4462: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 74 KiB/s wr, 12 op/s 2023-05-08T06:01:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:55 smithi096 ceph-mon[124666]: pgmap v4462: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 74 KiB/s wr, 12 op/s 2023-05-08T06:01:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:57 smithi186 ceph-mon[126480]: pgmap v4463: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 47 KiB/s wr, 8 op/s 2023-05-08T06:01:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:57 smithi133 ceph-mon[125939]: pgmap v4463: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 47 KiB/s wr, 8 op/s 2023-05-08T06:01:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:57 smithi096 ceph-mon[124666]: pgmap v4463: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 47 KiB/s wr, 8 op/s 2023-05-08T06:01:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8257.747589 secs 2023-05-08T06:01:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8258.304682 secs 2023-05-08T06:01:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8257.747589 secs 2023-05-08T06:01:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8258.304682 secs 2023-05-08T06:01:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8257.747589 secs 2023-05-08T06:01:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8258.304682 secs 2023-05-08T06:02:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:59 smithi186 ceph-mon[126480]: pgmap v4464: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 44 KiB/s wr, 7 op/s 2023-05-08T06:02:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:01:59 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:02:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:59 smithi133 ceph-mon[125939]: pgmap v4464: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 44 KiB/s wr, 7 op/s 2023-05-08T06:02:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:01:59 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:02:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:59 smithi096 ceph-mon[124666]: pgmap v4464: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 44 KiB/s wr, 7 op/s 2023-05-08T06:02:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:01:59 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:02:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8259.585650 secs 2023-05-08T06:02:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8259.585650 secs 2023-05-08T06:02:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8259.585650 secs 2023-05-08T06:02:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:01 smithi133 ceph-mon[125939]: pgmap v4465: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 54 KiB/s wr, 11 op/s 2023-05-08T06:02:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:01 smithi096 ceph-mon[124666]: pgmap v4465: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 54 KiB/s wr, 11 op/s 2023-05-08T06:02:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:01 smithi186 ceph-mon[126480]: pgmap v4465: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 54 KiB/s wr, 11 op/s 2023-05-08T06:02:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:02 smithi133 ceph-mon[125939]: pgmap v4466: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 44 KiB/s wr, 7 op/s 2023-05-08T06:02:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:02 smithi096 ceph-mon[124666]: pgmap v4466: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 44 KiB/s wr, 7 op/s 2023-05-08T06:02:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:02 smithi186 ceph-mon[126480]: pgmap v4466: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 44 KiB/s wr, 7 op/s 2023-05-08T06:02:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:03 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:02:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:02:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:03 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:02:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8262.747710 secs 2023-05-08T06:02:04.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8263.304795 secs 2023-05-08T06:02:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:03 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:02:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:02:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:03 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:02:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8262.747710 secs 2023-05-08T06:02:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8263.304795 secs 2023-05-08T06:02:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:03 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:02:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:02:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:03 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:02:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8262.747710 secs 2023-05-08T06:02:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8263.304795 secs 2023-05-08T06:02:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:05 smithi096 ceph-mon[124666]: pgmap v4467: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 113 KiB/s wr, 25 op/s 2023-05-08T06:02:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8264.585770 secs 2023-05-08T06:02:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:05 smithi186 ceph-mon[126480]: pgmap v4467: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 113 KiB/s wr, 25 op/s 2023-05-08T06:02:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8264.585770 secs 2023-05-08T06:02:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:05 smithi133 ceph-mon[125939]: pgmap v4467: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 113 KiB/s wr, 25 op/s 2023-05-08T06:02:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8264.585770 secs 2023-05-08T06:02:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:06 smithi096 ceph-mon[124666]: osdmap e358: 12 total, 12 up, 12 in 2023-05-08T06:02:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:06 smithi186 ceph-mon[126480]: osdmap e358: 12 total, 12 up, 12 in 2023-05-08T06:02:07.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:06 smithi133 ceph-mon[125939]: osdmap e358: 12 total, 12 up, 12 in 2023-05-08T06:02:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:07 smithi096 ceph-mon[124666]: pgmap v4469: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 95 KiB/s wr, 26 op/s 2023-05-08T06:02:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:07 smithi186 ceph-mon[126480]: pgmap v4469: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 95 KiB/s wr, 26 op/s 2023-05-08T06:02:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:07 smithi133 ceph-mon[125939]: pgmap v4469: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 95 KiB/s wr, 26 op/s 2023-05-08T06:02:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8267.747837 secs 2023-05-08T06:02:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8268.304940 secs 2023-05-08T06:02:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8267.747837 secs 2023-05-08T06:02:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8268.304940 secs 2023-05-08T06:02:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8267.747837 secs 2023-05-08T06:02:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8268.304940 secs 2023-05-08T06:02:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:09 smithi186 ceph-mon[126480]: pgmap v4470: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 95 KiB/s wr, 26 op/s 2023-05-08T06:02:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:09 smithi133 ceph-mon[125939]: pgmap v4470: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 95 KiB/s wr, 26 op/s 2023-05-08T06:02:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:09 smithi096 ceph-mon[124666]: pgmap v4470: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 95 KiB/s wr, 26 op/s 2023-05-08T06:02:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8269.585904 secs 2023-05-08T06:02:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8269.585904 secs 2023-05-08T06:02:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8269.585904 secs 2023-05-08T06:02:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:11 smithi186 ceph-mon[126480]: pgmap v4471: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 97 KiB/s wr, 26 op/s 2023-05-08T06:02:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:11 smithi133 ceph-mon[125939]: pgmap v4471: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 97 KiB/s wr, 26 op/s 2023-05-08T06:02:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:11 smithi096 ceph-mon[124666]: pgmap v4471: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 97 KiB/s wr, 26 op/s 2023-05-08T06:02:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:13 smithi186 ceph-mon[126480]: pgmap v4472: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 97 KiB/s wr, 26 op/s 2023-05-08T06:02:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8272.747953 secs 2023-05-08T06:02:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8273.305004 secs 2023-05-08T06:02:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:13 smithi133 ceph-mon[125939]: pgmap v4472: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 97 KiB/s wr, 26 op/s 2023-05-08T06:02:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8272.747953 secs 2023-05-08T06:02:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8273.305004 secs 2023-05-08T06:02:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:13 smithi096 ceph-mon[124666]: pgmap v4472: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 97 KiB/s wr, 26 op/s 2023-05-08T06:02:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8272.747953 secs 2023-05-08T06:02:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8273.305004 secs 2023-05-08T06:02:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:15 smithi096 ceph-mon[124666]: pgmap v4473: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 25 KiB/s wr, 8 op/s 2023-05-08T06:02:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:15 smithi096 ceph-mon[124666]: osdmap e359: 12 total, 12 up, 12 in 2023-05-08T06:02:16.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8274.586052 secs 2023-05-08T06:02:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:15 smithi186 ceph-mon[126480]: pgmap v4473: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 25 KiB/s wr, 8 op/s 2023-05-08T06:02:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:15 smithi186 ceph-mon[126480]: osdmap e359: 12 total, 12 up, 12 in 2023-05-08T06:02:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8274.586052 secs 2023-05-08T06:02:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:15 smithi133 ceph-mon[125939]: pgmap v4473: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 25 KiB/s wr, 8 op/s 2023-05-08T06:02:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:15 smithi133 ceph-mon[125939]: osdmap e359: 12 total, 12 up, 12 in 2023-05-08T06:02:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8274.586052 secs 2023-05-08T06:02:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:16 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:02:17.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:16 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:02:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:16 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:02:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:17 smithi096 ceph-mon[124666]: pgmap v4475: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 28 KiB/s wr, 8 op/s 2023-05-08T06:02:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:17 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:02:18.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:17 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:02:18.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:17 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:02:18.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:17 smithi186 ceph-mon[126480]: pgmap v4475: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 28 KiB/s wr, 8 op/s 2023-05-08T06:02:18.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:17 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:02:18.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:17 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:02:18.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:17 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:02:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:17 smithi133 ceph-mon[125939]: pgmap v4475: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 28 KiB/s wr, 8 op/s 2023-05-08T06:02:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:17 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:02:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:17 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:02:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:17 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:02:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:18 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:02:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:18 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T06:02:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:18 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T06:02:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:18 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:02:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8277.748104 secs 2023-05-08T06:02:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8278.305111 secs 2023-05-08T06:02:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:18 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:02:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:18 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T06:02:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:18 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T06:02:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:18 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:02:19.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8277.748104 secs 2023-05-08T06:02:19.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8278.305111 secs 2023-05-08T06:02:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:18 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:02:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:18 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T06:02:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:18 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T06:02:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:18 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:02:19.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8277.748104 secs 2023-05-08T06:02:19.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8278.305111 secs 2023-05-08T06:02:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:19 smithi186 ceph-mon[126480]: pgmap v4476: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 28 KiB/s wr, 8 op/s 2023-05-08T06:02:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:19 smithi133 ceph-mon[125939]: pgmap v4476: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 28 KiB/s wr, 8 op/s 2023-05-08T06:02:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:19 smithi096 ceph-mon[124666]: pgmap v4476: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 28 KiB/s wr, 8 op/s 2023-05-08T06:02:21.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8279.586168 secs 2023-05-08T06:02:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8279.586168 secs 2023-05-08T06:02:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8279.586168 secs 2023-05-08T06:02:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:21 smithi186 ceph-mon[126480]: pgmap v4477: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 8 op/s 2023-05-08T06:02:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:21 smithi133 ceph-mon[125939]: pgmap v4477: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 8 op/s 2023-05-08T06:02:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:21 smithi096 ceph-mon[124666]: pgmap v4477: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 8 op/s 2023-05-08T06:02:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:23 smithi186 ceph-mon[126480]: pgmap v4478: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 8 op/s 2023-05-08T06:02:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8282.748226 secs 2023-05-08T06:02:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8283.305200 secs 2023-05-08T06:02:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:23 smithi133 ceph-mon[125939]: pgmap v4478: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 8 op/s 2023-05-08T06:02:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8282.748226 secs 2023-05-08T06:02:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8283.305200 secs 2023-05-08T06:02:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:23 smithi096 ceph-mon[124666]: pgmap v4478: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 8 op/s 2023-05-08T06:02:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8282.748226 secs 2023-05-08T06:02:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8283.305200 secs 2023-05-08T06:02:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:25 smithi186 ceph-mon[126480]: pgmap v4479: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 27 KiB/s wr, 8 op/s 2023-05-08T06:02:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8284.586294 secs 2023-05-08T06:02:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:25 smithi133 ceph-mon[125939]: pgmap v4479: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 27 KiB/s wr, 8 op/s 2023-05-08T06:02:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8284.586294 secs 2023-05-08T06:02:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:25 smithi096 ceph-mon[124666]: pgmap v4479: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 27 KiB/s wr, 8 op/s 2023-05-08T06:02:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8284.586294 secs 2023-05-08T06:02:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:27 smithi186 ceph-mon[126480]: pgmap v4480: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 7 op/s 2023-05-08T06:02:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:27 smithi133 ceph-mon[125939]: pgmap v4480: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 7 op/s 2023-05-08T06:02:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:27 smithi096 ceph-mon[124666]: pgmap v4480: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 7 op/s 2023-05-08T06:02:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8287.748358 secs 2023-05-08T06:02:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8288.305318 secs 2023-05-08T06:02:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8287.748358 secs 2023-05-08T06:02:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8288.305318 secs 2023-05-08T06:02:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8287.748358 secs 2023-05-08T06:02:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8288.305318 secs 2023-05-08T06:02:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:29 smithi186 ceph-mon[126480]: pgmap v4481: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 20 KiB/s wr, 6 op/s 2023-05-08T06:02:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:29 smithi133 ceph-mon[125939]: pgmap v4481: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 20 KiB/s wr, 6 op/s 2023-05-08T06:02:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:29 smithi096 ceph-mon[124666]: pgmap v4481: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 20 KiB/s wr, 6 op/s 2023-05-08T06:02:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8289.586410 secs 2023-05-08T06:02:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8289.586410 secs 2023-05-08T06:02:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8289.586410 secs 2023-05-08T06:02:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:31 smithi186 ceph-mon[126480]: pgmap v4482: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 22 KiB/s wr, 10 op/s 2023-05-08T06:02:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:31 smithi133 ceph-mon[125939]: pgmap v4482: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 22 KiB/s wr, 10 op/s 2023-05-08T06:02:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:31 smithi096 ceph-mon[124666]: pgmap v4482: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 22 KiB/s wr, 10 op/s 2023-05-08T06:02:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:33 smithi186 ceph-mon[126480]: pgmap v4483: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 6 op/s 2023-05-08T06:02:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8292.748452 secs 2023-05-08T06:02:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8293.305384 secs 2023-05-08T06:02:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:33 smithi133 ceph-mon[125939]: pgmap v4483: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 6 op/s 2023-05-08T06:02:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8292.748452 secs 2023-05-08T06:02:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8293.305384 secs 2023-05-08T06:02:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:33 smithi096 ceph-mon[124666]: pgmap v4483: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 6 op/s 2023-05-08T06:02:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8292.748452 secs 2023-05-08T06:02:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8293.305384 secs 2023-05-08T06:02:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:35 smithi186 ceph-mon[126480]: pgmap v4484: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 63 KiB/s wr, 9 op/s 2023-05-08T06:02:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8294.586542 secs 2023-05-08T06:02:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:35 smithi133 ceph-mon[125939]: pgmap v4484: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 63 KiB/s wr, 9 op/s 2023-05-08T06:02:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8294.586542 secs 2023-05-08T06:02:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:35 smithi096 ceph-mon[124666]: pgmap v4484: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 63 KiB/s wr, 9 op/s 2023-05-08T06:02:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8294.586542 secs 2023-05-08T06:02:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:36 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:02:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:36 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:02:37.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:36 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:02:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:37 smithi186 ceph-mon[126480]: pgmap v4485: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 43 KiB/s wr, 8 op/s 2023-05-08T06:02:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:37 smithi133 ceph-mon[125939]: pgmap v4485: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 43 KiB/s wr, 8 op/s 2023-05-08T06:02:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:37 smithi096 ceph-mon[124666]: pgmap v4485: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 43 KiB/s wr, 8 op/s 2023-05-08T06:02:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8297.748587 secs 2023-05-08T06:02:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8297.748587 secs 2023-05-08T06:02:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8297.748587 secs 2023-05-08T06:02:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:39 smithi186 ceph-mon[126480]: pgmap v4486: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 43 KiB/s wr, 8 op/s 2023-05-08T06:02:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:39 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:02:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:39 smithi133 ceph-mon[125939]: pgmap v4486: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 43 KiB/s wr, 8 op/s 2023-05-08T06:02:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:39 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:02:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:39 smithi096 ceph-mon[124666]: pgmap v4486: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 43 KiB/s wr, 8 op/s 2023-05-08T06:02:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:39 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:02:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:41 smithi186 ceph-mon[126480]: pgmap v4487: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 72 KiB/s wr, 25 op/s 2023-05-08T06:02:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:41 smithi133 ceph-mon[125939]: pgmap v4487: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 72 KiB/s wr, 25 op/s 2023-05-08T06:02:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:41 smithi096 ceph-mon[124666]: pgmap v4487: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 72 KiB/s wr, 25 op/s 2023-05-08T06:02:43.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:02:43.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:02:43.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:02:43.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:02:43.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:02:43.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:02:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:43 smithi186 ceph-mon[126480]: pgmap v4488: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 70 KiB/s wr, 22 op/s 2023-05-08T06:02:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:43 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:02:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:02:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:02:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:02:44.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8302.748665 secs 2023-05-08T06:02:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:43 smithi133 ceph-mon[125939]: pgmap v4488: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 70 KiB/s wr, 22 op/s 2023-05-08T06:02:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:43 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:02:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:02:44.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:02:44.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:02:44.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8302.748665 secs 2023-05-08T06:02:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:43 smithi096 ceph-mon[124666]: pgmap v4488: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 70 KiB/s wr, 22 op/s 2023-05-08T06:02:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:43 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:02:44.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:02:44.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:02:44.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:02:44.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8302.748665 secs 2023-05-08T06:02:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:45 smithi186 ceph-mon[126480]: pgmap v4489: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 107 KiB/s wr, 26 op/s 2023-05-08T06:02:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:45 smithi133 ceph-mon[125939]: pgmap v4489: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 107 KiB/s wr, 26 op/s 2023-05-08T06:02:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:45 smithi096 ceph-mon[124666]: pgmap v4489: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 107 KiB/s wr, 26 op/s 2023-05-08T06:02:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:47 smithi186 ceph-mon[126480]: pgmap v4490: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 69 KiB/s wr, 24 op/s 2023-05-08T06:02:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:47 smithi133 ceph-mon[125939]: pgmap v4490: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 69 KiB/s wr, 24 op/s 2023-05-08T06:02:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:47 smithi096 ceph-mon[124666]: pgmap v4490: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 69 KiB/s wr, 24 op/s 2023-05-08T06:02:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8307.748786 secs 2023-05-08T06:02:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8308.305665 secs 2023-05-08T06:02:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8307.748786 secs 2023-05-08T06:02:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8308.305665 secs 2023-05-08T06:02:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8307.748786 secs 2023-05-08T06:02:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8308.305665 secs 2023-05-08T06:02:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:49 smithi186 ceph-mon[126480]: pgmap v4491: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 69 KiB/s wr, 22 op/s 2023-05-08T06:02:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:49 smithi133 ceph-mon[125939]: pgmap v4491: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 69 KiB/s wr, 22 op/s 2023-05-08T06:02:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:49 smithi096 ceph-mon[124666]: pgmap v4491: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 69 KiB/s wr, 22 op/s 2023-05-08T06:02:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:50 smithi133 ceph-mon[125939]: pgmap v4492: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 71 KiB/s wr, 26 op/s 2023-05-08T06:02:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:02:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:02:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:02:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:50 smithi096 ceph-mon[124666]: pgmap v4492: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 71 KiB/s wr, 26 op/s 2023-05-08T06:02:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:02:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:02:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:02:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:50 smithi186 ceph-mon[126480]: pgmap v4492: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 71 KiB/s wr, 26 op/s 2023-05-08T06:02:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:02:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:02:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:02:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:53 smithi186 ceph-mon[126480]: pgmap v4493: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 43 KiB/s wr, 9 op/s 2023-05-08T06:02:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8312.748904 secs 2023-05-08T06:02:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:53 smithi133 ceph-mon[125939]: pgmap v4493: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 43 KiB/s wr, 9 op/s 2023-05-08T06:02:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8312.748904 secs 2023-05-08T06:02:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:53 smithi096 ceph-mon[124666]: pgmap v4493: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 43 KiB/s wr, 9 op/s 2023-05-08T06:02:54.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8312.748904 secs 2023-05-08T06:02:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8313.305749 secs 2023-05-08T06:02:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8313.305749 secs 2023-05-08T06:02:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8313.305749 secs 2023-05-08T06:02:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:55 smithi186 ceph-mon[126480]: pgmap v4494: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 83 KiB/s wr, 12 op/s 2023-05-08T06:02:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:55 smithi133 ceph-mon[125939]: pgmap v4494: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 83 KiB/s wr, 12 op/s 2023-05-08T06:02:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:55 smithi096 ceph-mon[124666]: pgmap v4494: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 83 KiB/s wr, 12 op/s 2023-05-08T06:02:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:02:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:02:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:02:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:57 smithi186 ceph-mon[126480]: pgmap v4495: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 48 KiB/s wr, 9 op/s 2023-05-08T06:02:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:57 smithi133 ceph-mon[125939]: pgmap v4495: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 48 KiB/s wr, 9 op/s 2023-05-08T06:02:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:57 smithi096 ceph-mon[124666]: pgmap v4495: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 48 KiB/s wr, 9 op/s 2023-05-08T06:02:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8317.749012 secs 2023-05-08T06:02:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8318.305865 secs 2023-05-08T06:02:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8317.749012 secs 2023-05-08T06:02:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8318.305865 secs 2023-05-08T06:02:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8317.749012 secs 2023-05-08T06:02:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8318.305865 secs 2023-05-08T06:03:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:02:59 smithi186 ceph-mon[126480]: pgmap v4496: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 45 KiB/s wr, 8 op/s 2023-05-08T06:03:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:02:59 smithi133 ceph-mon[125939]: pgmap v4496: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 45 KiB/s wr, 8 op/s 2023-05-08T06:03:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:02:59 smithi096 ceph-mon[124666]: pgmap v4496: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 45 KiB/s wr, 8 op/s 2023-05-08T06:03:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8319.587140 secs 2023-05-08T06:03:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8319.587140 secs 2023-05-08T06:03:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8319.587140 secs 2023-05-08T06:03:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:01 smithi186 ceph-mon[126480]: pgmap v4497: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 47 KiB/s wr, 12 op/s 2023-05-08T06:03:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:01 smithi133 ceph-mon[125939]: pgmap v4497: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 47 KiB/s wr, 12 op/s 2023-05-08T06:03:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:01 smithi096 ceph-mon[124666]: pgmap v4497: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 47 KiB/s wr, 12 op/s 2023-05-08T06:03:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:02 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:03:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:03:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:03:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:02 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:03:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:03:03.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:03:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:02 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:03:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:03:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:03:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:03 smithi186 ceph-mon[126480]: pgmap v4498: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 45 KiB/s wr, 8 op/s 2023-05-08T06:03:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8322.749124 secs 2023-05-08T06:03:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8323.305960 secs 2023-05-08T06:03:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:03 smithi133 ceph-mon[125939]: pgmap v4498: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 45 KiB/s wr, 8 op/s 2023-05-08T06:03:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8322.749124 secs 2023-05-08T06:03:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8323.305960 secs 2023-05-08T06:03:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:03 smithi096 ceph-mon[124666]: pgmap v4498: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 45 KiB/s wr, 8 op/s 2023-05-08T06:03:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8322.749124 secs 2023-05-08T06:03:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8323.305960 secs 2023-05-08T06:03:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:05 smithi186 ceph-mon[126480]: pgmap v4499: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 118 KiB/s wr, 26 op/s 2023-05-08T06:03:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8324.587258 secs 2023-05-08T06:03:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:05 smithi133 ceph-mon[125939]: pgmap v4499: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 118 KiB/s wr, 26 op/s 2023-05-08T06:03:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8324.587258 secs 2023-05-08T06:03:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:05 smithi096 ceph-mon[124666]: pgmap v4499: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 118 KiB/s wr, 26 op/s 2023-05-08T06:03:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8324.587258 secs 2023-05-08T06:03:07.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:06 smithi186 ceph-mon[126480]: osdmap e360: 12 total, 12 up, 12 in 2023-05-08T06:03:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:06 smithi133 ceph-mon[125939]: osdmap e360: 12 total, 12 up, 12 in 2023-05-08T06:03:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:06 smithi096 ceph-mon[124666]: osdmap e360: 12 total, 12 up, 12 in 2023-05-08T06:03:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:07 smithi186 ceph-mon[126480]: pgmap v4501: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 90 KiB/s wr, 27 op/s 2023-05-08T06:03:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:07 smithi133 ceph-mon[125939]: pgmap v4501: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 90 KiB/s wr, 27 op/s 2023-05-08T06:03:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:07 smithi096 ceph-mon[124666]: pgmap v4501: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 90 KiB/s wr, 27 op/s 2023-05-08T06:03:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8327.749246 secs 2023-05-08T06:03:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8328.305997 secs 2023-05-08T06:03:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8327.749246 secs 2023-05-08T06:03:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8328.305997 secs 2023-05-08T06:03:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8327.749246 secs 2023-05-08T06:03:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8328.305997 secs 2023-05-08T06:03:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:09 smithi186 ceph-mon[126480]: pgmap v4502: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 90 KiB/s wr, 27 op/s 2023-05-08T06:03:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:09 smithi133 ceph-mon[125939]: pgmap v4502: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 90 KiB/s wr, 27 op/s 2023-05-08T06:03:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:09 smithi096 ceph-mon[124666]: pgmap v4502: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 90 KiB/s wr, 27 op/s 2023-05-08T06:03:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8329.587390 secs 2023-05-08T06:03:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8329.587390 secs 2023-05-08T06:03:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8329.587390 secs 2023-05-08T06:03:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:11 smithi133 ceph-mon[125939]: pgmap v4503: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 91 KiB/s wr, 26 op/s 2023-05-08T06:03:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:11 smithi096 ceph-mon[124666]: pgmap v4503: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 91 KiB/s wr, 26 op/s 2023-05-08T06:03:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:11 smithi186 ceph-mon[126480]: pgmap v4503: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 91 KiB/s wr, 26 op/s 2023-05-08T06:03:13.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:12 smithi133 ceph-mon[125939]: pgmap v4504: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 91 KiB/s wr, 26 op/s 2023-05-08T06:03:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:12 smithi096 ceph-mon[124666]: pgmap v4504: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 91 KiB/s wr, 26 op/s 2023-05-08T06:03:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:12 smithi186 ceph-mon[126480]: pgmap v4504: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 91 KiB/s wr, 26 op/s 2023-05-08T06:03:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8332.749390 secs 2023-05-08T06:03:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8333.306077 secs 2023-05-08T06:03:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8332.749390 secs 2023-05-08T06:03:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8333.306077 secs 2023-05-08T06:03:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8332.749390 secs 2023-05-08T06:03:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8333.306077 secs 2023-05-08T06:03:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:15 smithi186 ceph-mon[126480]: pgmap v4505: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 15 KiB/s wr, 8 op/s 2023-05-08T06:03:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:15 smithi186 ceph-mon[126480]: osdmap e361: 12 total, 12 up, 12 in 2023-05-08T06:03:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8334.587512 secs 2023-05-08T06:03:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:15 smithi133 ceph-mon[125939]: pgmap v4505: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 15 KiB/s wr, 8 op/s 2023-05-08T06:03:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:15 smithi133 ceph-mon[125939]: osdmap e361: 12 total, 12 up, 12 in 2023-05-08T06:03:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8334.587512 secs 2023-05-08T06:03:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:15 smithi096 ceph-mon[124666]: pgmap v4505: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 15 KiB/s wr, 8 op/s 2023-05-08T06:03:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:15 smithi096 ceph-mon[124666]: osdmap e361: 12 total, 12 up, 12 in 2023-05-08T06:03:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8334.587512 secs 2023-05-08T06:03:18.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:17 smithi186 ceph-mon[126480]: pgmap v4507: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 15 KiB/s wr, 8 op/s 2023-05-08T06:03:18.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:17 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:03:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:17 smithi133 ceph-mon[125939]: pgmap v4507: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 15 KiB/s wr, 8 op/s 2023-05-08T06:03:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:17 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:03:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:17 smithi096 ceph-mon[124666]: pgmap v4507: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 15 KiB/s wr, 8 op/s 2023-05-08T06:03:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:17 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:03:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8337.749454 secs 2023-05-08T06:03:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:03:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:03:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:03:19.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8338.306189 secs 2023-05-08T06:03:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8337.749454 secs 2023-05-08T06:03:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:03:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:03:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:03:19.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8338.306189 secs 2023-05-08T06:03:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8337.749454 secs 2023-05-08T06:03:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:03:19.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:03:19.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:03:19.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8338.306189 secs 2023-05-08T06:03:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:19 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:03:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:19 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T06:03:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:19 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T06:03:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:19 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:03:20.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:19 smithi186 ceph-mon[126480]: pgmap v4508: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 15 KiB/s wr, 8 op/s 2023-05-08T06:03:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:19 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:03:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:19 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T06:03:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:19 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T06:03:20.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:19 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:03:20.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:19 smithi133 ceph-mon[125939]: pgmap v4508: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 15 KiB/s wr, 8 op/s 2023-05-08T06:03:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:19 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:03:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:19 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T06:03:20.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:19 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T06:03:20.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:19 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:03:20.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:19 smithi096 ceph-mon[124666]: pgmap v4508: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 15 KiB/s wr, 8 op/s 2023-05-08T06:03:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8339.587631 secs 2023-05-08T06:03:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8339.587631 secs 2023-05-08T06:03:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8339.587631 secs 2023-05-08T06:03:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:21 smithi186 ceph-mon[126480]: pgmap v4509: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 7 op/s 2023-05-08T06:03:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:21 smithi133 ceph-mon[125939]: pgmap v4509: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 7 op/s 2023-05-08T06:03:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:21 smithi096 ceph-mon[124666]: pgmap v4509: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 7 op/s 2023-05-08T06:03:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:23 smithi186 ceph-mon[126480]: pgmap v4510: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 7 op/s 2023-05-08T06:03:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8342.749555 secs 2023-05-08T06:03:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8343.306307 secs 2023-05-08T06:03:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:23 smithi133 ceph-mon[125939]: pgmap v4510: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 7 op/s 2023-05-08T06:03:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8342.749555 secs 2023-05-08T06:03:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8343.306307 secs 2023-05-08T06:03:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:23 smithi096 ceph-mon[124666]: pgmap v4510: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 7 op/s 2023-05-08T06:03:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8342.749555 secs 2023-05-08T06:03:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8343.306307 secs 2023-05-08T06:03:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:25 smithi186 ceph-mon[126480]: pgmap v4511: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 KiB/s wr, 8 op/s 2023-05-08T06:03:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8344.587754 secs 2023-05-08T06:03:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:25 smithi133 ceph-mon[125939]: pgmap v4511: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 KiB/s wr, 8 op/s 2023-05-08T06:03:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8344.587754 secs 2023-05-08T06:03:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:25 smithi096 ceph-mon[124666]: pgmap v4511: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 KiB/s wr, 8 op/s 2023-05-08T06:03:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8344.587754 secs 2023-05-08T06:03:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:27 smithi186 ceph-mon[126480]: pgmap v4512: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 23 KiB/s wr, 7 op/s 2023-05-08T06:03:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:27 smithi133 ceph-mon[125939]: pgmap v4512: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 23 KiB/s wr, 7 op/s 2023-05-08T06:03:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:27 smithi096 ceph-mon[124666]: pgmap v4512: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 23 KiB/s wr, 7 op/s 2023-05-08T06:03:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8347.749693 secs 2023-05-08T06:03:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8348.306422 secs 2023-05-08T06:03:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8347.749693 secs 2023-05-08T06:03:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8348.306422 secs 2023-05-08T06:03:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8347.749693 secs 2023-05-08T06:03:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8348.306422 secs 2023-05-08T06:03:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:29 smithi186 ceph-mon[126480]: pgmap v4513: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 23 KiB/s wr, 6 op/s 2023-05-08T06:03:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:29 smithi133 ceph-mon[125939]: pgmap v4513: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 23 KiB/s wr, 6 op/s 2023-05-08T06:03:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:29 smithi096 ceph-mon[124666]: pgmap v4513: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 23 KiB/s wr, 6 op/s 2023-05-08T06:03:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8349.587865 secs 2023-05-08T06:03:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8349.587865 secs 2023-05-08T06:03:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8349.587865 secs 2023-05-08T06:03:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:31 smithi186 ceph-mon[126480]: pgmap v4514: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 23 KiB/s wr, 9 op/s 2023-05-08T06:03:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:31 smithi133 ceph-mon[125939]: pgmap v4514: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 23 KiB/s wr, 9 op/s 2023-05-08T06:03:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:31 smithi096 ceph-mon[124666]: pgmap v4514: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 23 KiB/s wr, 9 op/s 2023-05-08T06:03:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:33 smithi186 ceph-mon[126480]: pgmap v4515: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 6 op/s 2023-05-08T06:03:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8352.749785 secs 2023-05-08T06:03:34.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8353.306567 secs 2023-05-08T06:03:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:33 smithi133 ceph-mon[125939]: pgmap v4515: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 6 op/s 2023-05-08T06:03:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8352.749785 secs 2023-05-08T06:03:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8353.306567 secs 2023-05-08T06:03:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:33 smithi096 ceph-mon[124666]: pgmap v4515: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 6 op/s 2023-05-08T06:03:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8352.749785 secs 2023-05-08T06:03:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8353.306567 secs 2023-05-08T06:03:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:35 smithi186 ceph-mon[126480]: pgmap v4516: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 46 KiB/s wr, 9 op/s 2023-05-08T06:03:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8354.587982 secs 2023-05-08T06:03:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:35 smithi133 ceph-mon[125939]: pgmap v4516: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 46 KiB/s wr, 9 op/s 2023-05-08T06:03:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8354.587982 secs 2023-05-08T06:03:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:35 smithi096 ceph-mon[124666]: pgmap v4516: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 46 KiB/s wr, 9 op/s 2023-05-08T06:03:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8354.587982 secs 2023-05-08T06:03:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:37 smithi186 ceph-mon[126480]: pgmap v4517: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 24 KiB/s wr, 6 op/s 2023-05-08T06:03:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:37 smithi133 ceph-mon[125939]: pgmap v4517: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 24 KiB/s wr, 6 op/s 2023-05-08T06:03:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:37 smithi096 ceph-mon[124666]: pgmap v4517: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 24 KiB/s wr, 6 op/s 2023-05-08T06:03:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8357.749902 secs 2023-05-08T06:03:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8357.749902 secs 2023-05-08T06:03:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8357.749902 secs 2023-05-08T06:03:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:39 smithi186 ceph-mon[126480]: pgmap v4518: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 24 KiB/s wr, 6 op/s 2023-05-08T06:03:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:39 smithi133 ceph-mon[125939]: pgmap v4518: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 24 KiB/s wr, 6 op/s 2023-05-08T06:03:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:39 smithi096 ceph-mon[124666]: pgmap v4518: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 24 KiB/s wr, 6 op/s 2023-05-08T06:03:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:41 smithi186 ceph-mon[126480]: pgmap v4519: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 50 KiB/s wr, 10 op/s 2023-05-08T06:03:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:41 smithi133 ceph-mon[125939]: pgmap v4519: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 50 KiB/s wr, 10 op/s 2023-05-08T06:03:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:41 smithi096 ceph-mon[124666]: pgmap v4519: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 50 KiB/s wr, 10 op/s 2023-05-08T06:03:43.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:03:43.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:03:43.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:03:43.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:03:43.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:03:43.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:03:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:43 smithi186 ceph-mon[126480]: pgmap v4520: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 49 KiB/s wr, 7 op/s 2023-05-08T06:03:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:43 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:03:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:03:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:03:44.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:03:44.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8362.750031 secs 2023-05-08T06:03:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:43 smithi133 ceph-mon[125939]: pgmap v4520: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 49 KiB/s wr, 7 op/s 2023-05-08T06:03:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:43 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:03:44.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:03:44.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:03:44.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:03:44.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8362.750031 secs 2023-05-08T06:03:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:43 smithi096 ceph-mon[124666]: pgmap v4520: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 49 KiB/s wr, 7 op/s 2023-05-08T06:03:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:43 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:03:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:03:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:03:44.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:03:44.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8362.750031 secs 2023-05-08T06:03:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:45 smithi186 ceph-mon[126480]: pgmap v4521: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 89 KiB/s wr, 12 op/s 2023-05-08T06:03:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:45 smithi133 ceph-mon[125939]: pgmap v4521: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 89 KiB/s wr, 12 op/s 2023-05-08T06:03:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:45 smithi096 ceph-mon[124666]: pgmap v4521: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 89 KiB/s wr, 12 op/s 2023-05-08T06:03:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:47 smithi186 ceph-mon[126480]: pgmap v4522: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 68 KiB/s wr, 9 op/s 2023-05-08T06:03:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:47 smithi133 ceph-mon[125939]: pgmap v4522: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 68 KiB/s wr, 9 op/s 2023-05-08T06:03:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:47 smithi096 ceph-mon[124666]: pgmap v4522: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 68 KiB/s wr, 9 op/s 2023-05-08T06:03:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8367.750092 secs 2023-05-08T06:03:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8368.306967 secs 2023-05-08T06:03:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8367.750092 secs 2023-05-08T06:03:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8368.306967 secs 2023-05-08T06:03:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8367.750092 secs 2023-05-08T06:03:49.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8368.306967 secs 2023-05-08T06:03:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:49 smithi186 ceph-mon[126480]: pgmap v4523: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 68 KiB/s wr, 9 op/s 2023-05-08T06:03:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:49 smithi133 ceph-mon[125939]: pgmap v4523: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 68 KiB/s wr, 9 op/s 2023-05-08T06:03:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:49 smithi096 ceph-mon[124666]: pgmap v4523: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 68 KiB/s wr, 9 op/s 2023-05-08T06:03:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:50 smithi133 ceph-mon[125939]: pgmap v4524: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 70 KiB/s wr, 13 op/s 2023-05-08T06:03:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:03:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:03:51.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:03:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:50 smithi096 ceph-mon[124666]: pgmap v4524: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 70 KiB/s wr, 13 op/s 2023-05-08T06:03:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:03:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:03:51.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:03:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:50 smithi186 ceph-mon[126480]: pgmap v4524: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 70 KiB/s wr, 13 op/s 2023-05-08T06:03:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:03:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:03:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:03:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:53 smithi186 ceph-mon[126480]: pgmap v4525: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 44 KiB/s wr, 9 op/s 2023-05-08T06:03:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8372.750204 secs 2023-05-08T06:03:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:53 smithi133 ceph-mon[125939]: pgmap v4525: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 44 KiB/s wr, 9 op/s 2023-05-08T06:03:53.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8372.750204 secs 2023-05-08T06:03:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:53 smithi096 ceph-mon[124666]: pgmap v4525: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 44 KiB/s wr, 9 op/s 2023-05-08T06:03:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8372.750204 secs 2023-05-08T06:03:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8373.307096 secs 2023-05-08T06:03:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8373.307096 secs 2023-05-08T06:03:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8373.307096 secs 2023-05-08T06:03:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:55 smithi186 ceph-mon[126480]: pgmap v4526: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 87 KiB/s wr, 12 op/s 2023-05-08T06:03:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:55 smithi133 ceph-mon[125939]: pgmap v4526: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 87 KiB/s wr, 12 op/s 2023-05-08T06:03:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:55 smithi096 ceph-mon[124666]: pgmap v4526: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 87 KiB/s wr, 12 op/s 2023-05-08T06:03:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:57 smithi186 ceph-mon[126480]: pgmap v4527: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 51 KiB/s wr, 8 op/s 2023-05-08T06:03:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:57 smithi133 ceph-mon[125939]: pgmap v4527: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 51 KiB/s wr, 8 op/s 2023-05-08T06:03:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:57 smithi096 ceph-mon[124666]: pgmap v4527: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 51 KiB/s wr, 8 op/s 2023-05-08T06:03:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8377.750322 secs 2023-05-08T06:03:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8378.307233 secs 2023-05-08T06:03:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8377.750322 secs 2023-05-08T06:03:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8378.307233 secs 2023-05-08T06:03:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8377.750322 secs 2023-05-08T06:03:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8378.307233 secs 2023-05-08T06:04:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:03:59 smithi186 ceph-mon[126480]: pgmap v4528: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 48 KiB/s wr, 8 op/s 2023-05-08T06:04:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:03:59 smithi133 ceph-mon[125939]: pgmap v4528: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 48 KiB/s wr, 8 op/s 2023-05-08T06:04:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:03:59 smithi096 ceph-mon[124666]: pgmap v4528: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 48 KiB/s wr, 8 op/s 2023-05-08T06:04:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8379.588624 secs 2023-05-08T06:04:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8379.588624 secs 2023-05-08T06:04:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8379.588624 secs 2023-05-08T06:04:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:01 smithi186 ceph-mon[126480]: pgmap v4529: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 50 KiB/s wr, 12 op/s 2023-05-08T06:04:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:01 smithi133 ceph-mon[125939]: pgmap v4529: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 50 KiB/s wr, 12 op/s 2023-05-08T06:04:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:01 smithi096 ceph-mon[124666]: pgmap v4529: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 50 KiB/s wr, 12 op/s 2023-05-08T06:04:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:02 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:04:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:04:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:04:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:02 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:04:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:04:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:04:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:02 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:04:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:04:03.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:04:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:03 smithi186 ceph-mon[126480]: pgmap v4530: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 48 KiB/s wr, 8 op/s 2023-05-08T06:04:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8382.750441 secs 2023-05-08T06:04:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8383.307366 secs 2023-05-08T06:04:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:03 smithi133 ceph-mon[125939]: pgmap v4530: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 48 KiB/s wr, 8 op/s 2023-05-08T06:04:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8382.750441 secs 2023-05-08T06:04:04.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8383.307366 secs 2023-05-08T06:04:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:03 smithi096 ceph-mon[124666]: pgmap v4530: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 48 KiB/s wr, 8 op/s 2023-05-08T06:04:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8382.750441 secs 2023-05-08T06:04:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8383.307366 secs 2023-05-08T06:04:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:05 smithi186 ceph-mon[126480]: pgmap v4531: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 120 KiB/s wr, 26 op/s 2023-05-08T06:04:06.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8384.588727 secs 2023-05-08T06:04:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:05 smithi133 ceph-mon[125939]: pgmap v4531: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 120 KiB/s wr, 26 op/s 2023-05-08T06:04:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8384.588727 secs 2023-05-08T06:04:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:05 smithi096 ceph-mon[124666]: pgmap v4531: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 120 KiB/s wr, 26 op/s 2023-05-08T06:04:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8384.588727 secs 2023-05-08T06:04:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:06 smithi186 ceph-mon[126480]: osdmap e362: 12 total, 12 up, 12 in 2023-05-08T06:04:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:06 smithi133 ceph-mon[125939]: osdmap e362: 12 total, 12 up, 12 in 2023-05-08T06:04:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:06 smithi096 ceph-mon[124666]: osdmap e362: 12 total, 12 up, 12 in 2023-05-08T06:04:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:07 smithi186 ceph-mon[126480]: pgmap v4533: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 89 KiB/s wr, 26 op/s 2023-05-08T06:04:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:07 smithi133 ceph-mon[125939]: pgmap v4533: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 89 KiB/s wr, 26 op/s 2023-05-08T06:04:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:07 smithi096 ceph-mon[124666]: pgmap v4533: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 89 KiB/s wr, 26 op/s 2023-05-08T06:04:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8387.750560 secs 2023-05-08T06:04:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8388.307515 secs 2023-05-08T06:04:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8387.750560 secs 2023-05-08T06:04:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8388.307515 secs 2023-05-08T06:04:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8387.750560 secs 2023-05-08T06:04:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8388.307515 secs 2023-05-08T06:04:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:09 smithi133 ceph-mon[125939]: pgmap v4534: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 89 KiB/s wr, 26 op/s 2023-05-08T06:04:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:09 smithi096 ceph-mon[124666]: pgmap v4534: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 89 KiB/s wr, 26 op/s 2023-05-08T06:04:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:09 smithi186 ceph-mon[126480]: pgmap v4534: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 89 KiB/s wr, 26 op/s 2023-05-08T06:04:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8389.588843 secs 2023-05-08T06:04:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8389.588843 secs 2023-05-08T06:04:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8389.588843 secs 2023-05-08T06:04:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:11 smithi133 ceph-mon[125939]: pgmap v4535: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 94 KiB/s wr, 26 op/s 2023-05-08T06:04:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:11 smithi096 ceph-mon[124666]: pgmap v4535: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 94 KiB/s wr, 26 op/s 2023-05-08T06:04:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:11 smithi186 ceph-mon[126480]: pgmap v4535: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 94 KiB/s wr, 26 op/s 2023-05-08T06:04:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:13 smithi133 ceph-mon[125939]: pgmap v4536: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 94 KiB/s wr, 26 op/s 2023-05-08T06:04:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8392.750622 secs 2023-05-08T06:04:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8393.307548 secs 2023-05-08T06:04:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:13 smithi096 ceph-mon[124666]: pgmap v4536: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 94 KiB/s wr, 26 op/s 2023-05-08T06:04:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8392.750622 secs 2023-05-08T06:04:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8393.307548 secs 2023-05-08T06:04:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:13 smithi186 ceph-mon[126480]: pgmap v4536: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 94 KiB/s wr, 26 op/s 2023-05-08T06:04:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8392.750622 secs 2023-05-08T06:04:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8393.307548 secs 2023-05-08T06:04:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:15 smithi186 ceph-mon[126480]: pgmap v4537: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 32 KiB/s wr, 9 op/s 2023-05-08T06:04:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:15 smithi186 ceph-mon[126480]: osdmap e363: 12 total, 12 up, 12 in 2023-05-08T06:04:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8394.588964 secs 2023-05-08T06:04:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:15 smithi133 ceph-mon[125939]: pgmap v4537: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 32 KiB/s wr, 9 op/s 2023-05-08T06:04:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:15 smithi133 ceph-mon[125939]: osdmap e363: 12 total, 12 up, 12 in 2023-05-08T06:04:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8394.588964 secs 2023-05-08T06:04:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:15 smithi096 ceph-mon[124666]: pgmap v4537: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 32 KiB/s wr, 9 op/s 2023-05-08T06:04:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:15 smithi096 ceph-mon[124666]: osdmap e363: 12 total, 12 up, 12 in 2023-05-08T06:04:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8394.588964 secs 2023-05-08T06:04:18.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:17 smithi186 ceph-mon[126480]: pgmap v4539: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 32 KiB/s wr, 10 op/s 2023-05-08T06:04:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:17 smithi133 ceph-mon[125939]: pgmap v4539: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 32 KiB/s wr, 10 op/s 2023-05-08T06:04:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:17 smithi096 ceph-mon[124666]: pgmap v4539: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 32 KiB/s wr, 10 op/s 2023-05-08T06:04:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8397.750755 secs 2023-05-08T06:04:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:04:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8398.307671 secs 2023-05-08T06:04:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8397.750755 secs 2023-05-08T06:04:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:04:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8398.307671 secs 2023-05-08T06:04:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8397.750755 secs 2023-05-08T06:04:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:04:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8398.307671 secs 2023-05-08T06:04:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:19 smithi186 ceph-mon[126480]: pgmap v4540: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 32 KiB/s wr, 10 op/s 2023-05-08T06:04:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:19 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:04:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:19 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:04:20.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:19 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:04:20.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:19 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:04:20.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:19 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T06:04:20.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:19 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T06:04:20.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:19 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:04:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:19 smithi133 ceph-mon[125939]: pgmap v4540: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 32 KiB/s wr, 10 op/s 2023-05-08T06:04:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:19 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:04:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:19 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:04:20.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:19 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:04:20.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:19 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:04:20.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:19 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T06:04:20.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:19 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T06:04:20.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:19 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:04:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:19 smithi096 ceph-mon[124666]: pgmap v4540: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 32 KiB/s wr, 10 op/s 2023-05-08T06:04:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:19 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:04:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:19 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:04:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:19 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:04:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:19 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:04:20.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:19 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T06:04:20.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:19 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T06:04:20.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:19 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:04:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8399.589115 secs 2023-05-08T06:04:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8399.589115 secs 2023-05-08T06:04:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8399.589115 secs 2023-05-08T06:04:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:21 smithi186 ceph-mon[126480]: pgmap v4541: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 26 KiB/s wr, 13 op/s 2023-05-08T06:04:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:21 smithi133 ceph-mon[125939]: pgmap v4541: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 26 KiB/s wr, 13 op/s 2023-05-08T06:04:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:21 smithi096 ceph-mon[124666]: pgmap v4541: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 26 KiB/s wr, 13 op/s 2023-05-08T06:04:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:23 smithi186 ceph-mon[126480]: pgmap v4542: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 26 KiB/s wr, 13 op/s 2023-05-08T06:04:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8402.750874 secs 2023-05-08T06:04:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8403.307752 secs 2023-05-08T06:04:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:23 smithi133 ceph-mon[125939]: pgmap v4542: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 26 KiB/s wr, 13 op/s 2023-05-08T06:04:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8402.750874 secs 2023-05-08T06:04:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8403.307752 secs 2023-05-08T06:04:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:23 smithi096 ceph-mon[124666]: pgmap v4542: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 26 KiB/s wr, 13 op/s 2023-05-08T06:04:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8402.750874 secs 2023-05-08T06:04:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8403.307752 secs 2023-05-08T06:04:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:25 smithi186 ceph-mon[126480]: pgmap v4543: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 29 KiB/s wr, 12 op/s 2023-05-08T06:04:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8404.589239 secs 2023-05-08T06:04:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:25 smithi133 ceph-mon[125939]: pgmap v4543: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 29 KiB/s wr, 12 op/s 2023-05-08T06:04:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8404.589239 secs 2023-05-08T06:04:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:25 smithi096 ceph-mon[124666]: pgmap v4543: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 29 KiB/s wr, 12 op/s 2023-05-08T06:04:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8404.589239 secs 2023-05-08T06:04:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:27 smithi186 ceph-mon[126480]: pgmap v4544: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 25 KiB/s wr, 11 op/s 2023-05-08T06:04:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:27 smithi133 ceph-mon[125939]: pgmap v4544: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 25 KiB/s wr, 11 op/s 2023-05-08T06:04:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:27 smithi096 ceph-mon[124666]: pgmap v4544: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 25 KiB/s wr, 11 op/s 2023-05-08T06:04:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8407.750981 secs 2023-05-08T06:04:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8408.307847 secs 2023-05-08T06:04:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8407.750981 secs 2023-05-08T06:04:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8408.307847 secs 2023-05-08T06:04:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8407.750981 secs 2023-05-08T06:04:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8408.307847 secs 2023-05-08T06:04:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:29 smithi186 ceph-mon[126480]: pgmap v4545: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 24 KiB/s wr, 9 op/s 2023-05-08T06:04:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:29 smithi133 ceph-mon[125939]: pgmap v4545: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 24 KiB/s wr, 9 op/s 2023-05-08T06:04:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:29 smithi096 ceph-mon[124666]: pgmap v4545: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 24 KiB/s wr, 9 op/s 2023-05-08T06:04:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8409.589359 secs 2023-05-08T06:04:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8409.589359 secs 2023-05-08T06:04:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8409.589359 secs 2023-05-08T06:04:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:31 smithi186 ceph-mon[126480]: pgmap v4546: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 13 op/s 2023-05-08T06:04:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:31 smithi133 ceph-mon[125939]: pgmap v4546: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 13 op/s 2023-05-08T06:04:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:31 smithi096 ceph-mon[124666]: pgmap v4546: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 13 op/s 2023-05-08T06:04:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:33 smithi186 ceph-mon[126480]: pgmap v4547: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 7 op/s 2023-05-08T06:04:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8412.751095 secs 2023-05-08T06:04:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8413.307937 secs 2023-05-08T06:04:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:33 smithi133 ceph-mon[125939]: pgmap v4547: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 7 op/s 2023-05-08T06:04:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8412.751095 secs 2023-05-08T06:04:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8413.307937 secs 2023-05-08T06:04:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:33 smithi096 ceph-mon[124666]: pgmap v4547: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 7 op/s 2023-05-08T06:04:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8412.751095 secs 2023-05-08T06:04:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8413.307937 secs 2023-05-08T06:04:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:35 smithi186 ceph-mon[126480]: pgmap v4548: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 47 KiB/s wr, 9 op/s 2023-05-08T06:04:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8414.589494 secs 2023-05-08T06:04:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:35 smithi133 ceph-mon[125939]: pgmap v4548: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 47 KiB/s wr, 9 op/s 2023-05-08T06:04:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8414.589494 secs 2023-05-08T06:04:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:35 smithi096 ceph-mon[124666]: pgmap v4548: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 47 KiB/s wr, 9 op/s 2023-05-08T06:04:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8414.589494 secs 2023-05-08T06:04:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:37 smithi186 ceph-mon[126480]: pgmap v4549: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 6 op/s 2023-05-08T06:04:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:37 smithi133 ceph-mon[125939]: pgmap v4549: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 6 op/s 2023-05-08T06:04:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:37 smithi096 ceph-mon[124666]: pgmap v4549: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 6 op/s 2023-05-08T06:04:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8417.751236 secs 2023-05-08T06:04:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8417.751236 secs 2023-05-08T06:04:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8417.751236 secs 2023-05-08T06:04:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:39 smithi186 ceph-mon[126480]: pgmap v4550: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 6 op/s 2023-05-08T06:04:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:39 smithi133 ceph-mon[125939]: pgmap v4550: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 6 op/s 2023-05-08T06:04:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:39 smithi096 ceph-mon[124666]: pgmap v4550: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 6 op/s 2023-05-08T06:04:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8419.589564 secs 2023-05-08T06:04:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8419.589564 secs 2023-05-08T06:04:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8419.589564 secs 2023-05-08T06:04:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:41 smithi186 ceph-mon[126480]: pgmap v4551: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 51 KiB/s wr, 10 op/s 2023-05-08T06:04:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:41 smithi133 ceph-mon[125939]: pgmap v4551: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 51 KiB/s wr, 10 op/s 2023-05-08T06:04:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:41 smithi096 ceph-mon[124666]: pgmap v4551: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 51 KiB/s wr, 10 op/s 2023-05-08T06:04:43.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:04:43.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:04:43.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:04:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:43 smithi186 ceph-mon[126480]: pgmap v4552: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 51 KiB/s wr, 7 op/s 2023-05-08T06:04:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:43 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:04:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:04:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:04:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8422.751365 secs 2023-05-08T06:04:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:43 smithi133 ceph-mon[125939]: pgmap v4552: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 51 KiB/s wr, 7 op/s 2023-05-08T06:04:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:43 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:04:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:04:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:04:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8422.751365 secs 2023-05-08T06:04:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:43 smithi096 ceph-mon[124666]: pgmap v4552: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 51 KiB/s wr, 7 op/s 2023-05-08T06:04:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:43 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:04:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:04:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:04:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8422.751365 secs 2023-05-08T06:04:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:45 smithi186 ceph-mon[126480]: pgmap v4553: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 91 KiB/s wr, 11 op/s 2023-05-08T06:04:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:45 smithi133 ceph-mon[125939]: pgmap v4553: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 91 KiB/s wr, 11 op/s 2023-05-08T06:04:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:45 smithi096 ceph-mon[124666]: pgmap v4553: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 91 KiB/s wr, 11 op/s 2023-05-08T06:04:47.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:46 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:04:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:46 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:04:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:46 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:04:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:47 smithi133 ceph-mon[125939]: pgmap v4554: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 71 KiB/s wr, 9 op/s 2023-05-08T06:04:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:47 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:04:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:47 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:04:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:47 smithi096 ceph-mon[124666]: pgmap v4554: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 71 KiB/s wr, 9 op/s 2023-05-08T06:04:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:47 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:04:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:47 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:04:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:47 smithi186 ceph-mon[126480]: pgmap v4554: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 71 KiB/s wr, 9 op/s 2023-05-08T06:04:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:47 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:04:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:47 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:04:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8427.751508 secs 2023-05-08T06:04:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8428.308326 secs 2023-05-08T06:04:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8427.751508 secs 2023-05-08T06:04:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8428.308326 secs 2023-05-08T06:04:49.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8427.751508 secs 2023-05-08T06:04:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8428.308326 secs 2023-05-08T06:04:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:49 smithi133 ceph-mon[125939]: pgmap v4555: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 71 KiB/s wr, 9 op/s 2023-05-08T06:04:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:49 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:04:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:49 smithi096 ceph-mon[124666]: pgmap v4555: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 71 KiB/s wr, 9 op/s 2023-05-08T06:04:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:49 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:04:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:49 smithi186 ceph-mon[126480]: pgmap v4555: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 71 KiB/s wr, 9 op/s 2023-05-08T06:04:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:49 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:04:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:51 smithi133 ceph-mon[125939]: pgmap v4556: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 73 KiB/s wr, 13 op/s 2023-05-08T06:04:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:04:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:04:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:51 smithi096 ceph-mon[124666]: pgmap v4556: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 73 KiB/s wr, 13 op/s 2023-05-08T06:04:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:04:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:04:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:51 smithi186 ceph-mon[126480]: pgmap v4556: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 73 KiB/s wr, 13 op/s 2023-05-08T06:04:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:04:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:04:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:53 smithi133 ceph-mon[125939]: pgmap v4557: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 46 KiB/s wr, 8 op/s 2023-05-08T06:04:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8432.751624 secs 2023-05-08T06:04:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8433.308440 secs 2023-05-08T06:04:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:53 smithi096 ceph-mon[124666]: pgmap v4557: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 46 KiB/s wr, 8 op/s 2023-05-08T06:04:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8432.751624 secs 2023-05-08T06:04:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8433.308440 secs 2023-05-08T06:04:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:53 smithi186 ceph-mon[126480]: pgmap v4557: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 46 KiB/s wr, 8 op/s 2023-05-08T06:04:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8432.751624 secs 2023-05-08T06:04:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8433.308440 secs 2023-05-08T06:04:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:54 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:04:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:54 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:04:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:54 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:04:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:55 smithi133 ceph-mon[125939]: pgmap v4558: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 89 KiB/s wr, 12 op/s 2023-05-08T06:04:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:55 smithi096 ceph-mon[124666]: pgmap v4558: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 89 KiB/s wr, 12 op/s 2023-05-08T06:04:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:55 smithi186 ceph-mon[126480]: pgmap v4558: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 89 KiB/s wr, 12 op/s 2023-05-08T06:04:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:56 smithi133 ceph-mon[125939]: pgmap v4559: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 52 KiB/s wr, 9 op/s 2023-05-08T06:04:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:56 smithi096 ceph-mon[124666]: pgmap v4559: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 52 KiB/s wr, 9 op/s 2023-05-08T06:04:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:56 smithi186 ceph-mon[126480]: pgmap v4559: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 52 KiB/s wr, 9 op/s 2023-05-08T06:04:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8437.751766 secs 2023-05-08T06:04:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8437.751766 secs 2023-05-08T06:04:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8437.751766 secs 2023-05-08T06:04:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:59 smithi186 ceph-mon[126480]: pgmap v4560: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 48 KiB/s wr, 8 op/s 2023-05-08T06:04:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:04:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8438.308556 secs 2023-05-08T06:04:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:59 smithi133 ceph-mon[125939]: pgmap v4560: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 48 KiB/s wr, 8 op/s 2023-05-08T06:04:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:04:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8438.308556 secs 2023-05-08T06:04:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:59 smithi096 ceph-mon[124666]: pgmap v4560: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 48 KiB/s wr, 8 op/s 2023-05-08T06:04:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:04:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8438.308556 secs 2023-05-08T06:05:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8439.590095 secs 2023-05-08T06:05:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8439.590095 secs 2023-05-08T06:05:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8439.590095 secs 2023-05-08T06:05:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:01 smithi186 ceph-mon[126480]: pgmap v4561: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 51 KiB/s wr, 12 op/s 2023-05-08T06:05:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:01 smithi133 ceph-mon[125939]: pgmap v4561: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 51 KiB/s wr, 12 op/s 2023-05-08T06:05:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:01 smithi096 ceph-mon[124666]: pgmap v4561: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 51 KiB/s wr, 12 op/s 2023-05-08T06:05:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:02 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:05:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:05:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:05:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:02 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:05:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:05:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:05:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:02 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:05:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:05:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:05:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:03 smithi186 ceph-mon[126480]: pgmap v4562: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 49 KiB/s wr, 8 op/s 2023-05-08T06:05:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8442.751882 secs 2023-05-08T06:05:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8443.308629 secs 2023-05-08T06:05:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:03 smithi133 ceph-mon[125939]: pgmap v4562: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 49 KiB/s wr, 8 op/s 2023-05-08T06:05:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8442.751882 secs 2023-05-08T06:05:04.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8443.308629 secs 2023-05-08T06:05:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:03 smithi096 ceph-mon[124666]: pgmap v4562: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 49 KiB/s wr, 8 op/s 2023-05-08T06:05:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8442.751882 secs 2023-05-08T06:05:04.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8443.308629 secs 2023-05-08T06:05:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:05 smithi186 ceph-mon[126480]: pgmap v4563: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 99 KiB/s wr, 24 op/s 2023-05-08T06:05:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8444.590185 secs 2023-05-08T06:05:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:05 smithi133 ceph-mon[125939]: pgmap v4563: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 99 KiB/s wr, 24 op/s 2023-05-08T06:05:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8444.590185 secs 2023-05-08T06:05:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:05 smithi096 ceph-mon[124666]: pgmap v4563: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 99 KiB/s wr, 24 op/s 2023-05-08T06:05:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8444.590185 secs 2023-05-08T06:05:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:07 smithi186 ceph-mon[126480]: pgmap v4564: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 56 KiB/s wr, 20 op/s 2023-05-08T06:05:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:07 smithi133 ceph-mon[125939]: pgmap v4564: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 56 KiB/s wr, 20 op/s 2023-05-08T06:05:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:07 smithi096 ceph-mon[124666]: pgmap v4564: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 56 KiB/s wr, 20 op/s 2023-05-08T06:05:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8447.752002 secs 2023-05-08T06:05:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8448.308749 secs 2023-05-08T06:05:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8447.752002 secs 2023-05-08T06:05:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8448.308749 secs 2023-05-08T06:05:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8447.752002 secs 2023-05-08T06:05:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8448.308749 secs 2023-05-08T06:05:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:09 smithi186 ceph-mon[126480]: pgmap v4565: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 53 KiB/s wr, 19 op/s 2023-05-08T06:05:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:09 smithi133 ceph-mon[125939]: pgmap v4565: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 53 KiB/s wr, 19 op/s 2023-05-08T06:05:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:09 smithi096 ceph-mon[124666]: pgmap v4565: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 53 KiB/s wr, 19 op/s 2023-05-08T06:05:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8449.590244 secs 2023-05-08T06:05:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8449.590244 secs 2023-05-08T06:05:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8449.590244 secs 2023-05-08T06:05:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:11 smithi133 ceph-mon[125939]: pgmap v4566: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 59 KiB/s wr, 23 op/s 2023-05-08T06:05:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:11 smithi096 ceph-mon[124666]: pgmap v4566: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 59 KiB/s wr, 23 op/s 2023-05-08T06:05:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:11 smithi186 ceph-mon[126480]: pgmap v4566: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 59 KiB/s wr, 23 op/s 2023-05-08T06:05:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:13 smithi133 ceph-mon[125939]: pgmap v4567: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 57 KiB/s wr, 19 op/s 2023-05-08T06:05:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8452.752073 secs 2023-05-08T06:05:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8453.308858 secs 2023-05-08T06:05:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:13 smithi096 ceph-mon[124666]: pgmap v4567: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 57 KiB/s wr, 19 op/s 2023-05-08T06:05:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8452.752073 secs 2023-05-08T06:05:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8453.308858 secs 2023-05-08T06:05:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:13 smithi186 ceph-mon[126480]: pgmap v4567: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 57 KiB/s wr, 19 op/s 2023-05-08T06:05:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8452.752073 secs 2023-05-08T06:05:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8453.308858 secs 2023-05-08T06:05:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:15 smithi133 ceph-mon[125939]: pgmap v4568: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 66 KiB/s wr, 22 op/s 2023-05-08T06:05:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8454.590375 secs 2023-05-08T06:05:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:15 smithi096 ceph-mon[124666]: pgmap v4568: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 66 KiB/s wr, 22 op/s 2023-05-08T06:05:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8454.590375 secs 2023-05-08T06:05:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:15 smithi186 ceph-mon[126480]: pgmap v4568: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 66 KiB/s wr, 22 op/s 2023-05-08T06:05:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8454.590375 secs 2023-05-08T06:05:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:17 smithi133 ceph-mon[125939]: pgmap v4569: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 16 KiB/s wr, 8 op/s 2023-05-08T06:05:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:17 smithi096 ceph-mon[124666]: pgmap v4569: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 16 KiB/s wr, 8 op/s 2023-05-08T06:05:18.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:17 smithi186 ceph-mon[126480]: pgmap v4569: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 16 KiB/s wr, 8 op/s 2023-05-08T06:05:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8457.752162 secs 2023-05-08T06:05:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8458.308977 secs 2023-05-08T06:05:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8457.752162 secs 2023-05-08T06:05:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8458.308977 secs 2023-05-08T06:05:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8457.752162 secs 2023-05-08T06:05:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8458.308977 secs 2023-05-08T06:05:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:19 smithi133 ceph-mon[125939]: pgmap v4570: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 16 KiB/s wr, 7 op/s 2023-05-08T06:05:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:19 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:05:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:19 smithi096 ceph-mon[124666]: pgmap v4570: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 16 KiB/s wr, 7 op/s 2023-05-08T06:05:20.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:19 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:05:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:19 smithi186 ceph-mon[126480]: pgmap v4570: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 16 KiB/s wr, 7 op/s 2023-05-08T06:05:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:19 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:05:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8459.590503 secs 2023-05-08T06:05:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8459.590503 secs 2023-05-08T06:05:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8459.590503 secs 2023-05-08T06:05:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:21 smithi133 ceph-mon[125939]: pgmap v4571: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 29 KiB/s wr, 10 op/s 2023-05-08T06:05:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:05:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:05:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:05:22.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:05:22.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:05:22.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:05:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:21 smithi096 ceph-mon[124666]: pgmap v4571: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 29 KiB/s wr, 10 op/s 2023-05-08T06:05:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:05:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:05:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:05:22.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:05:22.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:05:22.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:05:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:21 smithi186 ceph-mon[126480]: pgmap v4571: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 29 KiB/s wr, 10 op/s 2023-05-08T06:05:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:05:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:05:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:05:22.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:05:22.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:05:22.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:05:23.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:22 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:05:23.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:22 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:05:23.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:22 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:05:23.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:22 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:05:23.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:22 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:05:23.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:22 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:05:23.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:22 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:05:23.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:22 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:05:23.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:22 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:05:23.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:22 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:05:23.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:22 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:05:23.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:22 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:05:23.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:22 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:05:23.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:22 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:05:23.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:22 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:05:23.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:22 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:05:23.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:22 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:05:23.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:22 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:05:23.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:22 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:05:23.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:22 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:05:23.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:22 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:05:23.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:22 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:05:23.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:22 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:05:23.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:22 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:05:23.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:22 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:05:23.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:22 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:05:23.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:22 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:05:23.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:22 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:05:23.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:22 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:05:23.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:22 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:05:23.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:22 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:05:23.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:22 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:05:23.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:22 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:05:23.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:22 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:05:23.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:22 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:05:23.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:22 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:05:23.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:22 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:05:23.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:22 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:05:23.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:22 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:05:23.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:22 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:05:23.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:22 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:05:23.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:22 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:05:23.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:22 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:05:23.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:22 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:05:23.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:22 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:05:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:23 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T06:05:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:23 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T06:05:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:23 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T06:05:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:23 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T06:05:24.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:23 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi096 to 196.2M 2023-05-08T06:05:24.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:23 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi096 to 205766758: error parsing value: Value '205766758' is below minimum 939524096 2023-05-08T06:05:24.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:23 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:05:24.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:23 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T06:05:24.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:23 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T06:05:24.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:23 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:05:24.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:23 smithi133 ceph-mon[125939]: pgmap v4572: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 6 op/s 2023-05-08T06:05:24.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8462.752278 secs 2023-05-08T06:05:24.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8463.309116 secs 2023-05-08T06:05:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:23 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T06:05:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:23 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T06:05:24.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:23 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T06:05:24.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:23 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T06:05:24.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:23 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi096 to 196.2M 2023-05-08T06:05:24.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:23 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi096 to 205766758: error parsing value: Value '205766758' is below minimum 939524096 2023-05-08T06:05:24.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:23 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:05:24.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:23 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T06:05:24.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:23 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T06:05:24.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:23 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:05:24.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:23 smithi096 ceph-mon[124666]: pgmap v4572: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 6 op/s 2023-05-08T06:05:24.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8462.752278 secs 2023-05-08T06:05:24.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8463.309116 secs 2023-05-08T06:05:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:23 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T06:05:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:23 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T06:05:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:23 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T06:05:24.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:23 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T06:05:24.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:23 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi096 to 196.2M 2023-05-08T06:05:24.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:23 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi096 to 205766758: error parsing value: Value '205766758' is below minimum 939524096 2023-05-08T06:05:24.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:23 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:05:24.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:23 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T06:05:24.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:23 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T06:05:24.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:23 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:05:24.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:23 smithi186 ceph-mon[126480]: pgmap v4572: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 6 op/s 2023-05-08T06:05:24.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8462.752278 secs 2023-05-08T06:05:24.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8463.309116 secs 2023-05-08T06:05:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:25 smithi186 ceph-mon[126480]: pgmap v4573: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 42 KiB/s wr, 10 op/s 2023-05-08T06:05:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8464.590644 secs 2023-05-08T06:05:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:25 smithi133 ceph-mon[125939]: pgmap v4573: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 42 KiB/s wr, 10 op/s 2023-05-08T06:05:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8464.590644 secs 2023-05-08T06:05:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:25 smithi096 ceph-mon[124666]: pgmap v4573: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 42 KiB/s wr, 10 op/s 2023-05-08T06:05:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8464.590644 secs 2023-05-08T06:05:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:27 smithi186 ceph-mon[126480]: pgmap v4574: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 33 KiB/s wr, 7 op/s 2023-05-08T06:05:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:27 smithi133 ceph-mon[125939]: pgmap v4574: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 33 KiB/s wr, 7 op/s 2023-05-08T06:05:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:27 smithi096 ceph-mon[124666]: pgmap v4574: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 33 KiB/s wr, 7 op/s 2023-05-08T06:05:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8467.752402 secs 2023-05-08T06:05:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8468.309233 secs 2023-05-08T06:05:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8467.752402 secs 2023-05-08T06:05:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8468.309233 secs 2023-05-08T06:05:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8467.752402 secs 2023-05-08T06:05:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8468.309233 secs 2023-05-08T06:05:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:29 smithi186 ceph-mon[126480]: pgmap v4575: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T06:05:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:29 smithi133 ceph-mon[125939]: pgmap v4575: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T06:05:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:29 smithi096 ceph-mon[124666]: pgmap v4575: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T06:05:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8469.590739 secs 2023-05-08T06:05:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8469.590739 secs 2023-05-08T06:05:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8469.590739 secs 2023-05-08T06:05:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:31 smithi186 ceph-mon[126480]: pgmap v4576: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 46 KiB/s wr, 10 op/s 2023-05-08T06:05:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:31 smithi133 ceph-mon[125939]: pgmap v4576: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 46 KiB/s wr, 10 op/s 2023-05-08T06:05:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:31 smithi096 ceph-mon[124666]: pgmap v4576: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 46 KiB/s wr, 10 op/s 2023-05-08T06:05:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:33 smithi186 ceph-mon[126480]: pgmap v4577: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 33 KiB/s wr, 7 op/s 2023-05-08T06:05:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8472.752504 secs 2023-05-08T06:05:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8473.309336 secs 2023-05-08T06:05:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:33 smithi133 ceph-mon[125939]: pgmap v4577: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 33 KiB/s wr, 7 op/s 2023-05-08T06:05:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8472.752504 secs 2023-05-08T06:05:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8473.309336 secs 2023-05-08T06:05:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:33 smithi096 ceph-mon[124666]: pgmap v4577: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 33 KiB/s wr, 7 op/s 2023-05-08T06:05:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8472.752504 secs 2023-05-08T06:05:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8473.309336 secs 2023-05-08T06:05:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:35 smithi186 ceph-mon[126480]: pgmap v4578: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 42 KiB/s wr, 9 op/s 2023-05-08T06:05:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8474.590858 secs 2023-05-08T06:05:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:35 smithi133 ceph-mon[125939]: pgmap v4578: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 42 KiB/s wr, 9 op/s 2023-05-08T06:05:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8474.590858 secs 2023-05-08T06:05:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:35 smithi096 ceph-mon[124666]: pgmap v4578: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 42 KiB/s wr, 9 op/s 2023-05-08T06:05:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8474.590858 secs 2023-05-08T06:05:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:37 smithi186 ceph-mon[126480]: pgmap v4579: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 23 KiB/s wr, 7 op/s 2023-05-08T06:05:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:37 smithi133 ceph-mon[125939]: pgmap v4579: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 23 KiB/s wr, 7 op/s 2023-05-08T06:05:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:37 smithi096 ceph-mon[124666]: pgmap v4579: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 23 KiB/s wr, 7 op/s 2023-05-08T06:05:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8477.752570 secs 2023-05-08T06:05:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8478.309427 secs 2023-05-08T06:05:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8477.752570 secs 2023-05-08T06:05:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8478.309427 secs 2023-05-08T06:05:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8477.752570 secs 2023-05-08T06:05:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8478.309427 secs 2023-05-08T06:05:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:39 smithi186 ceph-mon[126480]: pgmap v4580: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 23 KiB/s wr, 6 op/s 2023-05-08T06:05:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:39 smithi133 ceph-mon[125939]: pgmap v4580: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 23 KiB/s wr, 6 op/s 2023-05-08T06:05:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:39 smithi096 ceph-mon[124666]: pgmap v4580: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 23 KiB/s wr, 6 op/s 2023-05-08T06:05:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8479.590954 secs 2023-05-08T06:05:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8479.590954 secs 2023-05-08T06:05:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8479.590954 secs 2023-05-08T06:05:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:41 smithi186 ceph-mon[126480]: pgmap v4581: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 34 KiB/s wr, 9 op/s 2023-05-08T06:05:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:41 smithi133 ceph-mon[125939]: pgmap v4581: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 34 KiB/s wr, 9 op/s 2023-05-08T06:05:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:41 smithi096 ceph-mon[124666]: pgmap v4581: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 34 KiB/s wr, 9 op/s 2023-05-08T06:05:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:43 smithi186 ceph-mon[126480]: pgmap v4582: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 6 op/s 2023-05-08T06:05:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8482.752648 secs 2023-05-08T06:05:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:43 smithi133 ceph-mon[125939]: pgmap v4582: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 6 op/s 2023-05-08T06:05:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8482.752648 secs 2023-05-08T06:05:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:43 smithi096 ceph-mon[124666]: pgmap v4582: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 6 op/s 2023-05-08T06:05:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8482.752648 secs 2023-05-08T06:05:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:45 smithi186 ceph-mon[126480]: pgmap v4583: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 44 KiB/s wr, 9 op/s 2023-05-08T06:05:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8484.591024 secs 2023-05-08T06:05:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:45 smithi133 ceph-mon[125939]: pgmap v4583: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 44 KiB/s wr, 9 op/s 2023-05-08T06:05:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8484.591024 secs 2023-05-08T06:05:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:45 smithi096 ceph-mon[124666]: pgmap v4583: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 44 KiB/s wr, 9 op/s 2023-05-08T06:05:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8484.591024 secs 2023-05-08T06:05:47.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:46 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:05:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:46 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:05:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:46 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:05:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:47 smithi186 ceph-mon[126480]: pgmap v4584: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 38 KiB/s wr, 7 op/s 2023-05-08T06:05:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:47 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:05:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:47 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:05:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:47 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:05:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:47 smithi133 ceph-mon[125939]: pgmap v4584: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 38 KiB/s wr, 7 op/s 2023-05-08T06:05:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:47 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:05:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:47 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:05:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:47 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:05:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:47 smithi096 ceph-mon[124666]: pgmap v4584: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 38 KiB/s wr, 7 op/s 2023-05-08T06:05:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:47 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:05:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:47 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:05:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:47 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:05:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8487.752800 secs 2023-05-08T06:05:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8487.752800 secs 2023-05-08T06:05:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8487.752800 secs 2023-05-08T06:05:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:49 smithi186 ceph-mon[126480]: pgmap v4585: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 38 KiB/s wr, 6 op/s 2023-05-08T06:05:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:49 smithi133 ceph-mon[125939]: pgmap v4585: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 38 KiB/s wr, 6 op/s 2023-05-08T06:05:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:49 smithi096 ceph-mon[124666]: pgmap v4585: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 38 KiB/s wr, 6 op/s 2023-05-08T06:05:51.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8489.591162 secs 2023-05-08T06:05:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8489.591162 secs 2023-05-08T06:05:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8489.591162 secs 2023-05-08T06:05:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:51 smithi133 ceph-mon[125939]: pgmap v4586: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 72 KiB/s wr, 11 op/s 2023-05-08T06:05:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:51 smithi096 ceph-mon[124666]: pgmap v4586: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 72 KiB/s wr, 11 op/s 2023-05-08T06:05:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:51 smithi186 ceph-mon[126480]: pgmap v4586: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 72 KiB/s wr, 11 op/s 2023-05-08T06:05:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:53 smithi133 ceph-mon[125939]: pgmap v4587: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 61 KiB/s wr, 8 op/s 2023-05-08T06:05:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8492.752939 secs 2023-05-08T06:05:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8493.309744 secs 2023-05-08T06:05:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:53 smithi096 ceph-mon[124666]: pgmap v4587: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 61 KiB/s wr, 8 op/s 2023-05-08T06:05:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8492.752939 secs 2023-05-08T06:05:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8493.309744 secs 2023-05-08T06:05:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:53 smithi186 ceph-mon[126480]: pgmap v4587: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 61 KiB/s wr, 8 op/s 2023-05-08T06:05:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8492.752939 secs 2023-05-08T06:05:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8493.309744 secs 2023-05-08T06:05:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:55 smithi186 ceph-mon[126480]: pgmap v4588: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 73 KiB/s wr, 12 op/s 2023-05-08T06:05:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:55 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:05:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:55 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:05:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:55 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:05:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:55 smithi133 ceph-mon[125939]: pgmap v4588: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 73 KiB/s wr, 12 op/s 2023-05-08T06:05:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:55 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:05:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:55 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:05:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:55 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:05:56.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:55 smithi096 ceph-mon[124666]: pgmap v4588: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 73 KiB/s wr, 12 op/s 2023-05-08T06:05:56.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:55 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:05:56.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:55 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:05:56.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:55 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:05:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:57 smithi186 ceph-mon[126480]: pgmap v4589: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 50 KiB/s wr, 10 op/s 2023-05-08T06:05:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:57 smithi133 ceph-mon[125939]: pgmap v4589: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 50 KiB/s wr, 10 op/s 2023-05-08T06:05:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:57 smithi096 ceph-mon[124666]: pgmap v4589: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 50 KiB/s wr, 10 op/s 2023-05-08T06:05:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8497.753059 secs 2023-05-08T06:05:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:58 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:05:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8498.309815 secs 2023-05-08T06:05:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8497.753059 secs 2023-05-08T06:05:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:58 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:05:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8498.309815 secs 2023-05-08T06:05:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8497.753059 secs 2023-05-08T06:05:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:58 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:05:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8498.309815 secs 2023-05-08T06:06:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:59 smithi186 ceph-mon[126480]: pgmap v4590: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 47 KiB/s wr, 9 op/s 2023-05-08T06:06:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:59 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:06:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:05:59 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:06:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:59 smithi133 ceph-mon[125939]: pgmap v4590: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 47 KiB/s wr, 9 op/s 2023-05-08T06:06:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:59 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:06:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:05:59 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:06:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:59 smithi096 ceph-mon[124666]: pgmap v4590: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 47 KiB/s wr, 9 op/s 2023-05-08T06:06:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:59 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:06:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:05:59 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:06:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:01 smithi186 ceph-mon[126480]: pgmap v4591: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 98 KiB/s wr, 13 op/s 2023-05-08T06:06:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:01 smithi133 ceph-mon[125939]: pgmap v4591: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 98 KiB/s wr, 13 op/s 2023-05-08T06:06:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:01 smithi096 ceph-mon[124666]: pgmap v4591: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 98 KiB/s wr, 13 op/s 2023-05-08T06:06:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:03 smithi186 ceph-mon[126480]: pgmap v4592: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 64 KiB/s wr, 8 op/s 2023-05-08T06:06:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8502.753190 secs 2023-05-08T06:06:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8503.309938 secs 2023-05-08T06:06:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:03 smithi133 ceph-mon[125939]: pgmap v4592: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 64 KiB/s wr, 8 op/s 2023-05-08T06:06:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8502.753190 secs 2023-05-08T06:06:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8503.309938 secs 2023-05-08T06:06:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:03 smithi096 ceph-mon[124666]: pgmap v4592: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 64 KiB/s wr, 8 op/s 2023-05-08T06:06:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8502.753190 secs 2023-05-08T06:06:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8503.309938 secs 2023-05-08T06:06:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:04 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:06:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:04 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:06:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:04 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:06:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:05 smithi186 ceph-mon[126480]: pgmap v4593: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 123 KiB/s wr, 30 op/s 2023-05-08T06:06:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8504.591545 secs 2023-05-08T06:06:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:05 smithi133 ceph-mon[125939]: pgmap v4593: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 123 KiB/s wr, 30 op/s 2023-05-08T06:06:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8504.591545 secs 2023-05-08T06:06:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:05 smithi096 ceph-mon[124666]: pgmap v4593: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 123 KiB/s wr, 30 op/s 2023-05-08T06:06:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8504.591545 secs 2023-05-08T06:06:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:07 smithi186 ceph-mon[126480]: pgmap v4594: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 110 KiB/s wr, 26 op/s 2023-05-08T06:06:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:07 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:06:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:07 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:06:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:07 smithi133 ceph-mon[125939]: pgmap v4594: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 110 KiB/s wr, 26 op/s 2023-05-08T06:06:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:07 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:06:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:07 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:06:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:07 smithi096 ceph-mon[124666]: pgmap v4594: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 110 KiB/s wr, 26 op/s 2023-05-08T06:06:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:07 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:06:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:07 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:06:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8507.753315 secs 2023-05-08T06:06:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8508.310057 secs 2023-05-08T06:06:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8507.753315 secs 2023-05-08T06:06:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8508.310057 secs 2023-05-08T06:06:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8507.753315 secs 2023-05-08T06:06:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8508.310057 secs 2023-05-08T06:06:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:09 smithi186 ceph-mon[126480]: pgmap v4595: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 110 KiB/s wr, 26 op/s 2023-05-08T06:06:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:09 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:06:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:09 smithi133 ceph-mon[125939]: pgmap v4595: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 110 KiB/s wr, 26 op/s 2023-05-08T06:06:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:09 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:06:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:09 smithi096 ceph-mon[124666]: pgmap v4595: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 110 KiB/s wr, 26 op/s 2023-05-08T06:06:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:09 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:06:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8509.591607 secs 2023-05-08T06:06:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8509.591607 secs 2023-05-08T06:06:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8509.591607 secs 2023-05-08T06:06:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:11 smithi186 ceph-mon[126480]: pgmap v4596: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 140 KiB/s wr, 30 op/s 2023-05-08T06:06:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:11 smithi186 ceph-mon[126480]: osdmap e364: 12 total, 12 up, 12 in 2023-05-08T06:06:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:11 smithi133 ceph-mon[125939]: pgmap v4596: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 140 KiB/s wr, 30 op/s 2023-05-08T06:06:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:11 smithi133 ceph-mon[125939]: osdmap e364: 12 total, 12 up, 12 in 2023-05-08T06:06:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:11 smithi096 ceph-mon[124666]: pgmap v4596: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 140 KiB/s wr, 30 op/s 2023-05-08T06:06:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:11 smithi096 ceph-mon[124666]: osdmap e364: 12 total, 12 up, 12 in 2023-05-08T06:06:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:13 smithi186 ceph-mon[126480]: pgmap v4598: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 107 KiB/s wr, 31 op/s 2023-05-08T06:06:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8512.753452 secs 2023-05-08T06:06:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8513.310198 secs 2023-05-08T06:06:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:13 smithi133 ceph-mon[125939]: pgmap v4598: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 107 KiB/s wr, 31 op/s 2023-05-08T06:06:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8512.753452 secs 2023-05-08T06:06:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8513.310198 secs 2023-05-08T06:06:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:13 smithi096 ceph-mon[124666]: pgmap v4598: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 107 KiB/s wr, 31 op/s 2023-05-08T06:06:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8512.753452 secs 2023-05-08T06:06:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8513.310198 secs 2023-05-08T06:06:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:15 smithi186 ceph-mon[126480]: pgmap v4599: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 60 KiB/s wr, 9 op/s 2023-05-08T06:06:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8514.591671 secs 2023-05-08T06:06:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:15 smithi133 ceph-mon[125939]: pgmap v4599: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 60 KiB/s wr, 9 op/s 2023-05-08T06:06:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8514.591671 secs 2023-05-08T06:06:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:15 smithi096 ceph-mon[124666]: pgmap v4599: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 60 KiB/s wr, 9 op/s 2023-05-08T06:06:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8514.591671 secs 2023-05-08T06:06:18.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:17 smithi186 ceph-mon[126480]: pgmap v4600: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 60 KiB/s wr, 9 op/s 2023-05-08T06:06:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:17 smithi133 ceph-mon[125939]: pgmap v4600: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 60 KiB/s wr, 9 op/s 2023-05-08T06:06:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:17 smithi096 ceph-mon[124666]: pgmap v4600: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 60 KiB/s wr, 9 op/s 2023-05-08T06:06:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8517.753577 secs 2023-05-08T06:06:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8518.310337 secs 2023-05-08T06:06:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8517.753577 secs 2023-05-08T06:06:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8518.310337 secs 2023-05-08T06:06:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8517.753577 secs 2023-05-08T06:06:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8518.310337 secs 2023-05-08T06:06:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:19 smithi133 ceph-mon[125939]: pgmap v4601: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 60 KiB/s wr, 9 op/s 2023-05-08T06:06:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:19 smithi133 ceph-mon[125939]: osdmap e365: 12 total, 12 up, 12 in 2023-05-08T06:06:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:19 smithi096 ceph-mon[124666]: pgmap v4601: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 60 KiB/s wr, 9 op/s 2023-05-08T06:06:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:19 smithi096 ceph-mon[124666]: osdmap e365: 12 total, 12 up, 12 in 2023-05-08T06:06:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:19 smithi186 ceph-mon[126480]: pgmap v4601: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 60 KiB/s wr, 9 op/s 2023-05-08T06:06:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:19 smithi186 ceph-mon[126480]: osdmap e365: 12 total, 12 up, 12 in 2023-05-08T06:06:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8519.591796 secs 2023-05-08T06:06:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8519.591796 secs 2023-05-08T06:06:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8519.591796 secs 2023-05-08T06:06:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:21 smithi133 ceph-mon[125939]: pgmap v4603: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 40 KiB/s wr, 8 op/s 2023-05-08T06:06:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:21 smithi096 ceph-mon[124666]: pgmap v4603: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 40 KiB/s wr, 8 op/s 2023-05-08T06:06:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:21 smithi186 ceph-mon[126480]: pgmap v4603: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 40 KiB/s wr, 8 op/s 2023-05-08T06:06:23.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:22 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:06:23.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:22 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:06:23.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:22 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:06:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:23 smithi133 ceph-mon[125939]: pgmap v4604: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 38 KiB/s wr, 8 op/s 2023-05-08T06:06:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8522.753647 secs 2023-05-08T06:06:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:06:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:06:24.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:06:24.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8523.310503 secs 2023-05-08T06:06:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:23 smithi096 ceph-mon[124666]: pgmap v4604: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 38 KiB/s wr, 8 op/s 2023-05-08T06:06:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8522.753647 secs 2023-05-08T06:06:24.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:06:24.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:06:24.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:06:24.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8523.310503 secs 2023-05-08T06:06:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:23 smithi186 ceph-mon[126480]: pgmap v4604: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 38 KiB/s wr, 8 op/s 2023-05-08T06:06:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8522.753647 secs 2023-05-08T06:06:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:06:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:06:24.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:06:24.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8523.310503 secs 2023-05-08T06:06:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:24 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:06:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:24 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T06:06:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:24 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T06:06:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:24 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:06:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:24 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:06:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:24 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T06:06:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:24 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T06:06:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:24 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:06:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:24 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:06:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:24 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T06:06:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:24 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T06:06:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:24 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:06:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:25 smithi133 ceph-mon[125939]: pgmap v4605: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 8 op/s 2023-05-08T06:06:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8524.591861 secs 2023-05-08T06:06:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:25 smithi096 ceph-mon[124666]: pgmap v4605: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 8 op/s 2023-05-08T06:06:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8524.591861 secs 2023-05-08T06:06:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:25 smithi186 ceph-mon[126480]: pgmap v4605: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 8 op/s 2023-05-08T06:06:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8524.591861 secs 2023-05-08T06:06:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:27 smithi133 ceph-mon[125939]: pgmap v4606: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 8 op/s 2023-05-08T06:06:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:27 smithi096 ceph-mon[124666]: pgmap v4606: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 8 op/s 2023-05-08T06:06:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:27 smithi186 ceph-mon[126480]: pgmap v4606: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 8 op/s 2023-05-08T06:06:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8527.753759 secs 2023-05-08T06:06:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8528.310545 secs 2023-05-08T06:06:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8527.753759 secs 2023-05-08T06:06:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8528.310545 secs 2023-05-08T06:06:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8527.753759 secs 2023-05-08T06:06:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8528.310545 secs 2023-05-08T06:06:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:29 smithi133 ceph-mon[125939]: pgmap v4607: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 8 op/s 2023-05-08T06:06:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:29 smithi096 ceph-mon[124666]: pgmap v4607: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 8 op/s 2023-05-08T06:06:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:29 smithi186 ceph-mon[126480]: pgmap v4607: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 8 op/s 2023-05-08T06:06:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8529.591974 secs 2023-05-08T06:06:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:30 smithi133 ceph-mon[125939]: pgmap v4608: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 8 op/s 2023-05-08T06:06:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8529.591974 secs 2023-05-08T06:06:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:30 smithi096 ceph-mon[124666]: pgmap v4608: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 8 op/s 2023-05-08T06:06:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8529.591974 secs 2023-05-08T06:06:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:30 smithi186 ceph-mon[126480]: pgmap v4608: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 8 op/s 2023-05-08T06:06:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:33 smithi133 ceph-mon[125939]: pgmap v4609: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 6 op/s 2023-05-08T06:06:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8532.753883 secs 2023-05-08T06:06:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:33 smithi096 ceph-mon[124666]: pgmap v4609: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 6 op/s 2023-05-08T06:06:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8532.753883 secs 2023-05-08T06:06:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:33 smithi186 ceph-mon[126480]: pgmap v4609: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 6 op/s 2023-05-08T06:06:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8532.753883 secs 2023-05-08T06:06:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8533.310660 secs 2023-05-08T06:06:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8533.310660 secs 2023-05-08T06:06:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8533.310660 secs 2023-05-08T06:06:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:35 smithi186 ceph-mon[126480]: pgmap v4610: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 16 KiB/s wr, 9 op/s 2023-05-08T06:06:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:35 smithi133 ceph-mon[125939]: pgmap v4610: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 16 KiB/s wr, 9 op/s 2023-05-08T06:06:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:35 smithi096 ceph-mon[124666]: pgmap v4610: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 16 KiB/s wr, 9 op/s 2023-05-08T06:06:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:37 smithi186 ceph-mon[126480]: pgmap v4611: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 KiB/s wr, 7 op/s 2023-05-08T06:06:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:37 smithi133 ceph-mon[125939]: pgmap v4611: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 KiB/s wr, 7 op/s 2023-05-08T06:06:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:37 smithi096 ceph-mon[124666]: pgmap v4611: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 KiB/s wr, 7 op/s 2023-05-08T06:06:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8537.754016 secs 2023-05-08T06:06:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:38 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:06:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8538.310755 secs 2023-05-08T06:06:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8537.754016 secs 2023-05-08T06:06:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:38 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:06:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8538.310755 secs 2023-05-08T06:06:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8537.754016 secs 2023-05-08T06:06:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:38 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:06:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8538.310755 secs 2023-05-08T06:06:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:39 smithi186 ceph-mon[126480]: pgmap v4612: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 KiB/s wr, 6 op/s 2023-05-08T06:06:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:39 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:06:40.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:39 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:06:40.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:39 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:06:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:39 smithi133 ceph-mon[125939]: pgmap v4612: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 KiB/s wr, 6 op/s 2023-05-08T06:06:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:39 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:06:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:39 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:06:40.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:39 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:06:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:39 smithi096 ceph-mon[124666]: pgmap v4612: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 KiB/s wr, 6 op/s 2023-05-08T06:06:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:39 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:06:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:39 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:06:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:39 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:06:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8539.592219 secs 2023-05-08T06:06:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8539.592219 secs 2023-05-08T06:06:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8539.592219 secs 2023-05-08T06:06:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:41 smithi186 ceph-mon[126480]: pgmap v4613: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 59 KiB/s wr, 10 op/s 2023-05-08T06:06:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:41 smithi133 ceph-mon[125939]: pgmap v4613: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 59 KiB/s wr, 10 op/s 2023-05-08T06:06:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:41 smithi096 ceph-mon[124666]: pgmap v4613: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 59 KiB/s wr, 10 op/s 2023-05-08T06:06:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:43 smithi186 ceph-mon[126480]: pgmap v4614: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 46 KiB/s wr, 7 op/s 2023-05-08T06:06:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:06:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:06:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8542.754143 secs 2023-05-08T06:06:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:43 smithi133 ceph-mon[125939]: pgmap v4614: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 46 KiB/s wr, 7 op/s 2023-05-08T06:06:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:06:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:06:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8542.754143 secs 2023-05-08T06:06:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:43 smithi096 ceph-mon[124666]: pgmap v4614: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 46 KiB/s wr, 7 op/s 2023-05-08T06:06:44.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:06:44.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:06:44.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8542.754143 secs 2023-05-08T06:06:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:44 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:06:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:44 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:06:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:44 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:06:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:45 smithi186 ceph-mon[126480]: pgmap v4615: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 68 KiB/s wr, 11 op/s 2023-05-08T06:06:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8544.592344 secs 2023-05-08T06:06:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:45 smithi133 ceph-mon[125939]: pgmap v4615: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 68 KiB/s wr, 11 op/s 2023-05-08T06:06:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8544.592344 secs 2023-05-08T06:06:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:45 smithi096 ceph-mon[124666]: pgmap v4615: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 68 KiB/s wr, 11 op/s 2023-05-08T06:06:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8544.592344 secs 2023-05-08T06:06:47.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:46 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:06:47.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:46 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:06:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:46 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:06:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:47 smithi186 ceph-mon[126480]: pgmap v4616: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 66 KiB/s wr, 8 op/s 2023-05-08T06:06:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:47 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:06:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:47 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:06:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:47 smithi133 ceph-mon[125939]: pgmap v4616: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 66 KiB/s wr, 8 op/s 2023-05-08T06:06:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:47 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:06:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:47 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:06:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:47 smithi096 ceph-mon[124666]: pgmap v4616: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 66 KiB/s wr, 8 op/s 2023-05-08T06:06:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:47 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:06:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:47 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:06:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8547.754287 secs 2023-05-08T06:06:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8548.311016 secs 2023-05-08T06:06:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8547.754287 secs 2023-05-08T06:06:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8548.311016 secs 2023-05-08T06:06:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8547.754287 secs 2023-05-08T06:06:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8548.311016 secs 2023-05-08T06:06:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:49 smithi186 ceph-mon[126480]: pgmap v4617: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 65 KiB/s wr, 8 op/s 2023-05-08T06:06:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:06:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:49 smithi133 ceph-mon[125939]: pgmap v4617: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 65 KiB/s wr, 8 op/s 2023-05-08T06:06:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:06:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:49 smithi096 ceph-mon[124666]: pgmap v4617: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 65 KiB/s wr, 8 op/s 2023-05-08T06:06:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:06:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8549.592477 secs 2023-05-08T06:06:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8549.592477 secs 2023-05-08T06:06:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8549.592477 secs 2023-05-08T06:06:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:51 smithi186 ceph-mon[126480]: pgmap v4618: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 112 KiB/s wr, 12 op/s 2023-05-08T06:06:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:06:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:06:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:51 smithi133 ceph-mon[125939]: pgmap v4618: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 112 KiB/s wr, 12 op/s 2023-05-08T06:06:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:06:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:06:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:51 smithi096 ceph-mon[124666]: pgmap v4618: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 112 KiB/s wr, 12 op/s 2023-05-08T06:06:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:06:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:06:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:53 smithi133 ceph-mon[125939]: pgmap v4619: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 69 KiB/s wr, 9 op/s 2023-05-08T06:06:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8552.754368 secs 2023-05-08T06:06:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:53 smithi096 ceph-mon[124666]: pgmap v4619: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 69 KiB/s wr, 9 op/s 2023-05-08T06:06:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8552.754368 secs 2023-05-08T06:06:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:53 smithi186 ceph-mon[126480]: pgmap v4619: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 69 KiB/s wr, 9 op/s 2023-05-08T06:06:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8552.754368 secs 2023-05-08T06:06:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:54 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:06:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:54 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:06:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:54 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:06:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:54 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:06:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:54 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:06:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:54 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:06:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:55 smithi133 ceph-mon[125939]: pgmap v4620: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 75 KiB/s wr, 13 op/s 2023-05-08T06:06:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:55 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:06:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:55 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:06:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:55 smithi096 ceph-mon[124666]: pgmap v4620: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 75 KiB/s wr, 13 op/s 2023-05-08T06:06:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:55 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:06:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:55 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:06:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:55 smithi186 ceph-mon[126480]: pgmap v4620: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 75 KiB/s wr, 13 op/s 2023-05-08T06:06:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:55 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:06:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:55 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:06:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:57 smithi133 ceph-mon[125939]: pgmap v4621: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 55 KiB/s wr, 9 op/s 2023-05-08T06:06:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:57 smithi096 ceph-mon[124666]: pgmap v4621: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 55 KiB/s wr, 9 op/s 2023-05-08T06:06:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:57 smithi186 ceph-mon[126480]: pgmap v4621: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 55 KiB/s wr, 9 op/s 2023-05-08T06:06:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8557.754436 secs 2023-05-08T06:06:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:58 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:06:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8558.311312 secs 2023-05-08T06:06:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8557.754436 secs 2023-05-08T06:06:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:58 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:06:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8558.311312 secs 2023-05-08T06:06:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8557.754436 secs 2023-05-08T06:06:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:58 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:06:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8558.311312 secs 2023-05-08T06:07:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:59 smithi133 ceph-mon[125939]: pgmap v4622: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 55 KiB/s wr, 9 op/s 2023-05-08T06:07:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:59 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:07:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:59 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:07:00.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:06:59 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:07:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:59 smithi096 ceph-mon[124666]: pgmap v4622: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 55 KiB/s wr, 9 op/s 2023-05-08T06:07:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:59 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:07:00.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:59 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:07:00.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:06:59 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:07:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:59 smithi186 ceph-mon[126480]: pgmap v4622: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 55 KiB/s wr, 9 op/s 2023-05-08T06:07:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:59 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:07:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:59 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:07:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:06:59 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:07:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8559.592706 secs 2023-05-08T06:07:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8559.592706 secs 2023-05-08T06:07:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8559.592706 secs 2023-05-08T06:07:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:01 smithi133 ceph-mon[125939]: pgmap v4623: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 105 KiB/s wr, 13 op/s 2023-05-08T06:07:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:01 smithi096 ceph-mon[124666]: pgmap v4623: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 105 KiB/s wr, 13 op/s 2023-05-08T06:07:02.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:01 smithi186 ceph-mon[126480]: pgmap v4623: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 105 KiB/s wr, 13 op/s 2023-05-08T06:07:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:03 smithi133 ceph-mon[125939]: pgmap v4624: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 59 KiB/s wr, 8 op/s 2023-05-08T06:07:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:07:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:07:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:03 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:07:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8562.754596 secs 2023-05-08T06:07:04.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8563.311375 secs 2023-05-08T06:07:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:03 smithi096 ceph-mon[124666]: pgmap v4624: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 59 KiB/s wr, 8 op/s 2023-05-08T06:07:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:07:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:07:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:03 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:07:04.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8562.754596 secs 2023-05-08T06:07:04.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8563.311375 secs 2023-05-08T06:07:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:03 smithi186 ceph-mon[126480]: pgmap v4624: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 59 KiB/s wr, 8 op/s 2023-05-08T06:07:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:07:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:07:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:03 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:07:04.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8562.754596 secs 2023-05-08T06:07:04.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8563.311375 secs 2023-05-08T06:07:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:04 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:07:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:04 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:07:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:04 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:07:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:05 smithi133 ceph-mon[125939]: pgmap v4625: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 104 KiB/s wr, 25 op/s 2023-05-08T06:07:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8564.592839 secs 2023-05-08T06:07:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:05 smithi096 ceph-mon[124666]: pgmap v4625: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 104 KiB/s wr, 25 op/s 2023-05-08T06:07:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8564.592839 secs 2023-05-08T06:07:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:05 smithi186 ceph-mon[126480]: pgmap v4625: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 104 KiB/s wr, 25 op/s 2023-05-08T06:07:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8564.592839 secs 2023-05-08T06:07:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:06 smithi133 ceph-mon[125939]: pgmap v4626: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 98 KiB/s wr, 22 op/s 2023-05-08T06:07:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:06 smithi096 ceph-mon[124666]: pgmap v4626: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 98 KiB/s wr, 22 op/s 2023-05-08T06:07:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:06 smithi186 ceph-mon[126480]: pgmap v4626: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 98 KiB/s wr, 22 op/s 2023-05-08T06:07:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8567.754699 secs 2023-05-08T06:07:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8567.754699 secs 2023-05-08T06:07:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8567.754699 secs 2023-05-08T06:07:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8568.311504 secs 2023-05-08T06:07:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:09 smithi186 ceph-mon[126480]: pgmap v4627: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 95 KiB/s wr, 21 op/s 2023-05-08T06:07:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8568.311504 secs 2023-05-08T06:07:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:09 smithi133 ceph-mon[125939]: pgmap v4627: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 95 KiB/s wr, 21 op/s 2023-05-08T06:07:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8568.311504 secs 2023-05-08T06:07:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:09 smithi096 ceph-mon[124666]: pgmap v4627: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 95 KiB/s wr, 21 op/s 2023-05-08T06:07:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8569.592944 secs 2023-05-08T06:07:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8569.592944 secs 2023-05-08T06:07:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8569.592944 secs 2023-05-08T06:07:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:11 smithi186 ceph-mon[126480]: pgmap v4628: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 119 KiB/s wr, 25 op/s 2023-05-08T06:07:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:11 smithi186 ceph-mon[126480]: osdmap e366: 12 total, 12 up, 12 in 2023-05-08T06:07:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:11 smithi133 ceph-mon[125939]: pgmap v4628: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 119 KiB/s wr, 25 op/s 2023-05-08T06:07:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:11 smithi133 ceph-mon[125939]: osdmap e366: 12 total, 12 up, 12 in 2023-05-08T06:07:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:11 smithi096 ceph-mon[124666]: pgmap v4628: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 119 KiB/s wr, 25 op/s 2023-05-08T06:07:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:11 smithi096 ceph-mon[124666]: osdmap e366: 12 total, 12 up, 12 in 2023-05-08T06:07:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:13 smithi186 ceph-mon[126480]: pgmap v4630: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 82 KiB/s wr, 25 op/s 2023-05-08T06:07:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8572.754804 secs 2023-05-08T06:07:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8573.311628 secs 2023-05-08T06:07:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:13 smithi133 ceph-mon[125939]: pgmap v4630: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 82 KiB/s wr, 25 op/s 2023-05-08T06:07:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8572.754804 secs 2023-05-08T06:07:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8573.311628 secs 2023-05-08T06:07:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:13 smithi096 ceph-mon[124666]: pgmap v4630: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 82 KiB/s wr, 25 op/s 2023-05-08T06:07:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8572.754804 secs 2023-05-08T06:07:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8573.311628 secs 2023-05-08T06:07:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:15 smithi186 ceph-mon[126480]: pgmap v4631: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 8 op/s 2023-05-08T06:07:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8574.593070 secs 2023-05-08T06:07:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:15 smithi133 ceph-mon[125939]: pgmap v4631: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 8 op/s 2023-05-08T06:07:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8574.593070 secs 2023-05-08T06:07:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:15 smithi096 ceph-mon[124666]: pgmap v4631: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 8 op/s 2023-05-08T06:07:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8574.593070 secs 2023-05-08T06:07:18.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:17 smithi186 ceph-mon[126480]: pgmap v4632: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 KiB/s wr, 8 op/s 2023-05-08T06:07:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:17 smithi133 ceph-mon[125939]: pgmap v4632: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 KiB/s wr, 8 op/s 2023-05-08T06:07:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:17 smithi096 ceph-mon[124666]: pgmap v4632: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 KiB/s wr, 8 op/s 2023-05-08T06:07:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8577.754967 secs 2023-05-08T06:07:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8578.311693 secs 2023-05-08T06:07:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8577.754967 secs 2023-05-08T06:07:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8578.311693 secs 2023-05-08T06:07:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8577.754967 secs 2023-05-08T06:07:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8578.311693 secs 2023-05-08T06:07:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:19 smithi186 ceph-mon[126480]: pgmap v4633: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 KiB/s wr, 8 op/s 2023-05-08T06:07:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:19 smithi186 ceph-mon[126480]: osdmap e367: 12 total, 12 up, 12 in 2023-05-08T06:07:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:19 smithi133 ceph-mon[125939]: pgmap v4633: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 KiB/s wr, 8 op/s 2023-05-08T06:07:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:19 smithi133 ceph-mon[125939]: osdmap e367: 12 total, 12 up, 12 in 2023-05-08T06:07:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:19 smithi096 ceph-mon[124666]: pgmap v4633: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 KiB/s wr, 8 op/s 2023-05-08T06:07:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:19 smithi096 ceph-mon[124666]: osdmap e367: 12 total, 12 up, 12 in 2023-05-08T06:07:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8579.593159 secs 2023-05-08T06:07:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8579.593159 secs 2023-05-08T06:07:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8579.593159 secs 2023-05-08T06:07:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:21 smithi186 ceph-mon[126480]: pgmap v4635: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 8 op/s 2023-05-08T06:07:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:21 smithi133 ceph-mon[125939]: pgmap v4635: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 8 op/s 2023-05-08T06:07:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:21 smithi096 ceph-mon[124666]: pgmap v4635: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 8 op/s 2023-05-08T06:07:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:23 smithi186 ceph-mon[126480]: pgmap v4636: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 16 KiB/s wr, 8 op/s 2023-05-08T06:07:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8582.755091 secs 2023-05-08T06:07:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:07:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8583.311762 secs 2023-05-08T06:07:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:23 smithi133 ceph-mon[125939]: pgmap v4636: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 16 KiB/s wr, 8 op/s 2023-05-08T06:07:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8582.755091 secs 2023-05-08T06:07:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:07:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8583.311762 secs 2023-05-08T06:07:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:23 smithi096 ceph-mon[124666]: pgmap v4636: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 16 KiB/s wr, 8 op/s 2023-05-08T06:07:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8582.755091 secs 2023-05-08T06:07:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:07:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8583.311762 secs 2023-05-08T06:07:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:07:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:07:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:07:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:07:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:07:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:07:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:07:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:07:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:07:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:25 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:07:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:25 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T06:07:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:25 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T06:07:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:25 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:07:26.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:25 smithi186 ceph-mon[126480]: pgmap v4637: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 8 op/s 2023-05-08T06:07:26.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8584.593275 secs 2023-05-08T06:07:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:25 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:07:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:25 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T06:07:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:25 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T06:07:26.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:25 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:07:26.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:25 smithi133 ceph-mon[125939]: pgmap v4637: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 8 op/s 2023-05-08T06:07:26.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8584.593275 secs 2023-05-08T06:07:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:25 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:07:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:25 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T06:07:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:25 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T06:07:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:25 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:07:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:25 smithi096 ceph-mon[124666]: pgmap v4637: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 8 op/s 2023-05-08T06:07:26.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8584.593275 secs 2023-05-08T06:07:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:27 smithi133 ceph-mon[125939]: pgmap v4638: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 7 op/s 2023-05-08T06:07:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:27 smithi096 ceph-mon[124666]: pgmap v4638: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 7 op/s 2023-05-08T06:07:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:27 smithi186 ceph-mon[126480]: pgmap v4638: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 7 op/s 2023-05-08T06:07:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8587.755237 secs 2023-05-08T06:07:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8588.311884 secs 2023-05-08T06:07:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8587.755237 secs 2023-05-08T06:07:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8588.311884 secs 2023-05-08T06:07:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8587.755237 secs 2023-05-08T06:07:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8588.311884 secs 2023-05-08T06:07:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:29 smithi133 ceph-mon[125939]: pgmap v4639: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 7 op/s 2023-05-08T06:07:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:29 smithi096 ceph-mon[124666]: pgmap v4639: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 7 op/s 2023-05-08T06:07:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:29 smithi186 ceph-mon[126480]: pgmap v4639: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 7 op/s 2023-05-08T06:07:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8589.593393 secs 2023-05-08T06:07:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8589.593393 secs 2023-05-08T06:07:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8589.593393 secs 2023-05-08T06:07:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:31 smithi133 ceph-mon[125939]: pgmap v4640: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 KiB/s wr, 8 op/s 2023-05-08T06:07:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:31 smithi096 ceph-mon[124666]: pgmap v4640: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 KiB/s wr, 8 op/s 2023-05-08T06:07:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:31 smithi186 ceph-mon[126480]: pgmap v4640: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 KiB/s wr, 8 op/s 2023-05-08T06:07:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:33 smithi133 ceph-mon[125939]: pgmap v4641: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 6 op/s 2023-05-08T06:07:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8592.755368 secs 2023-05-08T06:07:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8593.311989 secs 2023-05-08T06:07:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:33 smithi096 ceph-mon[124666]: pgmap v4641: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 6 op/s 2023-05-08T06:07:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8592.755368 secs 2023-05-08T06:07:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8593.311989 secs 2023-05-08T06:07:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:33 smithi186 ceph-mon[126480]: pgmap v4641: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 6 op/s 2023-05-08T06:07:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8592.755368 secs 2023-05-08T06:07:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8593.311989 secs 2023-05-08T06:07:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:35 smithi133 ceph-mon[125939]: pgmap v4642: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 30 KiB/s wr, 9 op/s 2023-05-08T06:07:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8594.593533 secs 2023-05-08T06:07:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:35 smithi096 ceph-mon[124666]: pgmap v4642: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 30 KiB/s wr, 9 op/s 2023-05-08T06:07:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8594.593533 secs 2023-05-08T06:07:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:35 smithi186 ceph-mon[126480]: pgmap v4642: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 30 KiB/s wr, 9 op/s 2023-05-08T06:07:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8594.593533 secs 2023-05-08T06:07:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:37 smithi133 ceph-mon[125939]: pgmap v4643: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 6 op/s 2023-05-08T06:07:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:37 smithi096 ceph-mon[124666]: pgmap v4643: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 6 op/s 2023-05-08T06:07:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:37 smithi186 ceph-mon[126480]: pgmap v4643: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 6 op/s 2023-05-08T06:07:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8597.755500 secs 2023-05-08T06:07:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8597.755500 secs 2023-05-08T06:07:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8597.755500 secs 2023-05-08T06:07:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:39 smithi133 ceph-mon[125939]: pgmap v4644: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 6 op/s 2023-05-08T06:07:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:39 smithi096 ceph-mon[124666]: pgmap v4644: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 6 op/s 2023-05-08T06:07:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:39 smithi186 ceph-mon[126480]: pgmap v4644: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 6 op/s 2023-05-08T06:07:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8599.593681 secs 2023-05-08T06:07:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8599.593681 secs 2023-05-08T06:07:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8599.593681 secs 2023-05-08T06:07:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:41 smithi133 ceph-mon[125939]: pgmap v4645: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 10 op/s 2023-05-08T06:07:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:41 smithi096 ceph-mon[124666]: pgmap v4645: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 10 op/s 2023-05-08T06:07:42.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:41 smithi186 ceph-mon[126480]: pgmap v4645: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 10 op/s 2023-05-08T06:07:43.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:07:43.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:07:43.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:07:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:43 smithi133 ceph-mon[125939]: pgmap v4646: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 7 op/s 2023-05-08T06:07:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:43 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:07:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:07:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:07:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8602.755569 secs 2023-05-08T06:07:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:43 smithi096 ceph-mon[124666]: pgmap v4646: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 7 op/s 2023-05-08T06:07:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:43 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:07:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:07:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:07:44.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8602.755569 secs 2023-05-08T06:07:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:43 smithi186 ceph-mon[126480]: pgmap v4646: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 7 op/s 2023-05-08T06:07:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:43 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:07:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:07:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:07:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8602.755569 secs 2023-05-08T06:07:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:45 smithi133 ceph-mon[125939]: pgmap v4647: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 82 KiB/s wr, 12 op/s 2023-05-08T06:07:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8604.593825 secs 2023-05-08T06:07:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:45 smithi096 ceph-mon[124666]: pgmap v4647: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 82 KiB/s wr, 12 op/s 2023-05-08T06:07:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8604.593825 secs 2023-05-08T06:07:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:45 smithi186 ceph-mon[126480]: pgmap v4647: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 82 KiB/s wr, 12 op/s 2023-05-08T06:07:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8604.593825 secs 2023-05-08T06:07:47.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:46 smithi133 ceph-mon[125939]: pgmap v4648: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 69 KiB/s wr, 10 op/s 2023-05-08T06:07:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:46 smithi096 ceph-mon[124666]: pgmap v4648: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 69 KiB/s wr, 10 op/s 2023-05-08T06:07:47.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:46 smithi186 ceph-mon[126480]: pgmap v4648: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 69 KiB/s wr, 10 op/s 2023-05-08T06:07:48.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8607.755685 secs 2023-05-08T06:07:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8607.755685 secs 2023-05-08T06:07:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8607.755685 secs 2023-05-08T06:07:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8608.312394 secs 2023-05-08T06:07:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:49 smithi186 ceph-mon[126480]: pgmap v4649: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 69 KiB/s wr, 10 op/s 2023-05-08T06:07:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8608.312394 secs 2023-05-08T06:07:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:49 smithi133 ceph-mon[125939]: pgmap v4649: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 69 KiB/s wr, 10 op/s 2023-05-08T06:07:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8608.312394 secs 2023-05-08T06:07:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:49 smithi096 ceph-mon[124666]: pgmap v4649: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 69 KiB/s wr, 10 op/s 2023-05-08T06:07:51.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:50 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:07:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:50 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:07:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:50 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:07:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:51 smithi186 ceph-mon[126480]: pgmap v4650: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 72 KiB/s wr, 14 op/s 2023-05-08T06:07:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:07:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:07:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:07:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:51 smithi133 ceph-mon[125939]: pgmap v4650: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 72 KiB/s wr, 14 op/s 2023-05-08T06:07:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:07:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:07:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:07:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:51 smithi096 ceph-mon[124666]: pgmap v4650: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 72 KiB/s wr, 14 op/s 2023-05-08T06:07:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:07:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:07:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:07:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:53 smithi186 ceph-mon[126480]: pgmap v4651: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 63 KiB/s wr, 10 op/s 2023-05-08T06:07:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8612.755830 secs 2023-05-08T06:07:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:53 smithi133 ceph-mon[125939]: pgmap v4651: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 63 KiB/s wr, 10 op/s 2023-05-08T06:07:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8612.755830 secs 2023-05-08T06:07:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:53 smithi096 ceph-mon[124666]: pgmap v4651: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 63 KiB/s wr, 10 op/s 2023-05-08T06:07:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8612.755830 secs 2023-05-08T06:07:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:54 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:07:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:54 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:07:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:54 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:07:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:55 smithi186 ceph-mon[126480]: pgmap v4652: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 114 KiB/s wr, 14 op/s 2023-05-08T06:07:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:55 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:07:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8614.594030 secs 2023-05-08T06:07:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:55 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:07:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:55 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:07:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:55 smithi133 ceph-mon[125939]: pgmap v4652: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 114 KiB/s wr, 14 op/s 2023-05-08T06:07:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:55 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:07:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8614.594030 secs 2023-05-08T06:07:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:55 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:07:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:55 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:07:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:55 smithi096 ceph-mon[124666]: pgmap v4652: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 114 KiB/s wr, 14 op/s 2023-05-08T06:07:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:55 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:07:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8614.594030 secs 2023-05-08T06:07:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:55 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:07:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:55 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:07:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:57 smithi186 ceph-mon[126480]: pgmap v4653: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 60 KiB/s wr, 9 op/s 2023-05-08T06:07:58.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:57 smithi133 ceph-mon[125939]: pgmap v4653: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 60 KiB/s wr, 9 op/s 2023-05-08T06:07:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:57 smithi096 ceph-mon[124666]: pgmap v4653: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 60 KiB/s wr, 9 op/s 2023-05-08T06:07:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8617.755971 secs 2023-05-08T06:07:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8618.312615 secs 2023-05-08T06:07:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8617.755971 secs 2023-05-08T06:07:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8618.312615 secs 2023-05-08T06:07:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8617.755971 secs 2023-05-08T06:07:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8618.312615 secs 2023-05-08T06:08:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:59 smithi186 ceph-mon[126480]: pgmap v4654: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 56 KiB/s wr, 9 op/s 2023-05-08T06:08:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:59 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:08:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:07:59 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:08:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:59 smithi133 ceph-mon[125939]: pgmap v4654: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 56 KiB/s wr, 9 op/s 2023-05-08T06:08:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:59 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:08:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:07:59 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:08:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:59 smithi096 ceph-mon[124666]: pgmap v4654: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 56 KiB/s wr, 9 op/s 2023-05-08T06:08:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:59 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:08:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:07:59 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:08:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8619.594148 secs 2023-05-08T06:08:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8619.594148 secs 2023-05-08T06:08:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8619.594148 secs 2023-05-08T06:08:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:01 smithi133 ceph-mon[125939]: pgmap v4655: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 57 KiB/s wr, 12 op/s 2023-05-08T06:08:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:01 smithi096 ceph-mon[124666]: pgmap v4655: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 57 KiB/s wr, 12 op/s 2023-05-08T06:08:02.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:01 smithi186 ceph-mon[126480]: pgmap v4655: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 57 KiB/s wr, 12 op/s 2023-05-08T06:08:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:02 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:08:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:08:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:08:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:02 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:08:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:08:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:08:03.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:02 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:08:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:08:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:08:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:03 smithi133 ceph-mon[125939]: pgmap v4656: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 8 op/s 2023-05-08T06:08:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8622.756084 secs 2023-05-08T06:08:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8623.312733 secs 2023-05-08T06:08:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:03 smithi096 ceph-mon[124666]: pgmap v4656: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 8 op/s 2023-05-08T06:08:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8622.756084 secs 2023-05-08T06:08:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8623.312733 secs 2023-05-08T06:08:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:03 smithi186 ceph-mon[126480]: pgmap v4656: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 8 op/s 2023-05-08T06:08:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8622.756084 secs 2023-05-08T06:08:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8623.312733 secs 2023-05-08T06:08:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:05 smithi186 ceph-mon[126480]: pgmap v4657: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 111 KiB/s wr, 25 op/s 2023-05-08T06:08:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8624.594232 secs 2023-05-08T06:08:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:05 smithi133 ceph-mon[125939]: pgmap v4657: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 111 KiB/s wr, 25 op/s 2023-05-08T06:08:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8624.594232 secs 2023-05-08T06:08:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:05 smithi096 ceph-mon[124666]: pgmap v4657: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 111 KiB/s wr, 25 op/s 2023-05-08T06:08:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8624.594232 secs 2023-05-08T06:08:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:07 smithi186 ceph-mon[126480]: pgmap v4658: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 60 KiB/s wr, 22 op/s 2023-05-08T06:08:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:07 smithi133 ceph-mon[125939]: pgmap v4658: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 60 KiB/s wr, 22 op/s 2023-05-08T06:08:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:07 smithi096 ceph-mon[124666]: pgmap v4658: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 60 KiB/s wr, 22 op/s 2023-05-08T06:08:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8627.756206 secs 2023-05-08T06:08:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8628.312868 secs 2023-05-08T06:08:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8627.756206 secs 2023-05-08T06:08:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8628.312868 secs 2023-05-08T06:08:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8627.756206 secs 2023-05-08T06:08:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8628.312868 secs 2023-05-08T06:08:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:09 smithi186 ceph-mon[126480]: pgmap v4659: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 57 KiB/s wr, 21 op/s 2023-05-08T06:08:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:09 smithi133 ceph-mon[125939]: pgmap v4659: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 57 KiB/s wr, 21 op/s 2023-05-08T06:08:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:09 smithi096 ceph-mon[124666]: pgmap v4659: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 57 KiB/s wr, 21 op/s 2023-05-08T06:08:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8629.594326 secs 2023-05-08T06:08:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8629.594326 secs 2023-05-08T06:08:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8629.594326 secs 2023-05-08T06:08:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:11 smithi186 ceph-mon[126480]: pgmap v4660: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 61 KiB/s wr, 24 op/s 2023-05-08T06:08:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:11 smithi186 ceph-mon[126480]: osdmap e368: 12 total, 12 up, 12 in 2023-05-08T06:08:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:11 smithi133 ceph-mon[125939]: pgmap v4660: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 61 KiB/s wr, 24 op/s 2023-05-08T06:08:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:11 smithi133 ceph-mon[125939]: osdmap e368: 12 total, 12 up, 12 in 2023-05-08T06:08:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:11 smithi096 ceph-mon[124666]: pgmap v4660: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 61 KiB/s wr, 24 op/s 2023-05-08T06:08:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:11 smithi096 ceph-mon[124666]: osdmap e368: 12 total, 12 up, 12 in 2023-05-08T06:08:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:13 smithi186 ceph-mon[126480]: pgmap v4662: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 72 KiB/s wr, 25 op/s 2023-05-08T06:08:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8632.756328 secs 2023-05-08T06:08:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8633.312990 secs 2023-05-08T06:08:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:13 smithi133 ceph-mon[125939]: pgmap v4662: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 72 KiB/s wr, 25 op/s 2023-05-08T06:08:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8632.756328 secs 2023-05-08T06:08:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8633.312990 secs 2023-05-08T06:08:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:13 smithi096 ceph-mon[124666]: pgmap v4662: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 72 KiB/s wr, 25 op/s 2023-05-08T06:08:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8632.756328 secs 2023-05-08T06:08:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8633.312990 secs 2023-05-08T06:08:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:15 smithi133 ceph-mon[125939]: pgmap v4663: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 KiB/s wr, 7 op/s 2023-05-08T06:08:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8634.594451 secs 2023-05-08T06:08:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:15 smithi096 ceph-mon[124666]: pgmap v4663: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 KiB/s wr, 7 op/s 2023-05-08T06:08:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8634.594451 secs 2023-05-08T06:08:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:15 smithi186 ceph-mon[126480]: pgmap v4663: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 KiB/s wr, 7 op/s 2023-05-08T06:08:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8634.594451 secs 2023-05-08T06:08:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:17 smithi133 ceph-mon[125939]: pgmap v4664: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 KiB/s wr, 7 op/s 2023-05-08T06:08:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:17 smithi096 ceph-mon[124666]: pgmap v4664: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 KiB/s wr, 7 op/s 2023-05-08T06:08:18.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:17 smithi186 ceph-mon[126480]: pgmap v4664: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 KiB/s wr, 7 op/s 2023-05-08T06:08:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8637.756473 secs 2023-05-08T06:08:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8638.313094 secs 2023-05-08T06:08:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8637.756473 secs 2023-05-08T06:08:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8638.313094 secs 2023-05-08T06:08:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8637.756473 secs 2023-05-08T06:08:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8638.313094 secs 2023-05-08T06:08:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:19 smithi133 ceph-mon[125939]: pgmap v4665: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 KiB/s wr, 7 op/s 2023-05-08T06:08:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:19 smithi133 ceph-mon[125939]: osdmap e369: 12 total, 12 up, 12 in 2023-05-08T06:08:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:19 smithi096 ceph-mon[124666]: pgmap v4665: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 KiB/s wr, 7 op/s 2023-05-08T06:08:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:19 smithi096 ceph-mon[124666]: osdmap e369: 12 total, 12 up, 12 in 2023-05-08T06:08:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:19 smithi186 ceph-mon[126480]: pgmap v4665: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 KiB/s wr, 7 op/s 2023-05-08T06:08:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:19 smithi186 ceph-mon[126480]: osdmap e369: 12 total, 12 up, 12 in 2023-05-08T06:08:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8639.594524 secs 2023-05-08T06:08:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8639.594524 secs 2023-05-08T06:08:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8639.594524 secs 2023-05-08T06:08:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:21 smithi133 ceph-mon[125939]: pgmap v4667: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 7 op/s 2023-05-08T06:08:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:21 smithi096 ceph-mon[124666]: pgmap v4667: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 7 op/s 2023-05-08T06:08:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:21 smithi186 ceph-mon[126480]: pgmap v4667: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 7 op/s 2023-05-08T06:08:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:23 smithi133 ceph-mon[125939]: pgmap v4668: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 7 op/s 2023-05-08T06:08:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8642.756584 secs 2023-05-08T06:08:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8643.313221 secs 2023-05-08T06:08:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:23 smithi096 ceph-mon[124666]: pgmap v4668: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 7 op/s 2023-05-08T06:08:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8642.756584 secs 2023-05-08T06:08:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8643.313221 secs 2023-05-08T06:08:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:23 smithi186 ceph-mon[126480]: pgmap v4668: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 7 op/s 2023-05-08T06:08:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8642.756584 secs 2023-05-08T06:08:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8643.313221 secs 2023-05-08T06:08:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:08:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:08:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:08:25.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:08:25.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:08:25.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:08:25.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:08:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:08:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:08:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:08:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:08:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:08:25.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:08:25.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:08:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:08:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:08:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:08:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:08:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:08:25.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:08:25.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:08:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:25 smithi096 ceph-mon[124666]: pgmap v4669: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 8 op/s 2023-05-08T06:08:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8644.594612 secs 2023-05-08T06:08:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:25 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:08:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:25 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:08:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:25 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:08:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:25 smithi186 ceph-mon[126480]: pgmap v4669: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 8 op/s 2023-05-08T06:08:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8644.594612 secs 2023-05-08T06:08:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:25 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:08:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:25 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:08:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:25 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:08:26.447 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:25 smithi133 ceph-mon[125939]: pgmap v4669: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 8 op/s 2023-05-08T06:08:26.448 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8644.594612 secs 2023-05-08T06:08:26.448 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:25 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:08:26.448 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:25 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:08:26.448 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:25 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:08:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:26 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:08:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:26 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T06:08:27.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:26 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T06:08:27.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:26 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:08:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:26 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:08:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:26 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T06:08:27.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:26 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T06:08:27.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:26 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:08:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:26 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:08:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:26 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T06:08:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:26 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T06:08:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:26 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:08:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:27 smithi133 ceph-mon[125939]: pgmap v4670: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 8 op/s 2023-05-08T06:08:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:27 smithi096 ceph-mon[124666]: pgmap v4670: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 8 op/s 2023-05-08T06:08:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:27 smithi186 ceph-mon[126480]: pgmap v4670: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 8 op/s 2023-05-08T06:08:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8647.756694 secs 2023-05-08T06:08:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8648.313370 secs 2023-05-08T06:08:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8647.756694 secs 2023-05-08T06:08:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8648.313370 secs 2023-05-08T06:08:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8647.756694 secs 2023-05-08T06:08:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8648.313370 secs 2023-05-08T06:08:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:29 smithi133 ceph-mon[125939]: pgmap v4671: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 8 op/s 2023-05-08T06:08:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:29 smithi096 ceph-mon[124666]: pgmap v4671: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 8 op/s 2023-05-08T06:08:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:29 smithi186 ceph-mon[126480]: pgmap v4671: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 8 op/s 2023-05-08T06:08:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8649.594726 secs 2023-05-08T06:08:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8649.594726 secs 2023-05-08T06:08:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8649.594726 secs 2023-05-08T06:08:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:31 smithi133 ceph-mon[125939]: pgmap v4672: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 8 op/s 2023-05-08T06:08:32.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:31 smithi096 ceph-mon[124666]: pgmap v4672: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 8 op/s 2023-05-08T06:08:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:31 smithi186 ceph-mon[126480]: pgmap v4672: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 8 op/s 2023-05-08T06:08:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:33 smithi133 ceph-mon[125939]: pgmap v4673: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 17 KiB/s wr, 6 op/s 2023-05-08T06:08:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8652.756814 secs 2023-05-08T06:08:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8653.313512 secs 2023-05-08T06:08:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:33 smithi096 ceph-mon[124666]: pgmap v4673: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 17 KiB/s wr, 6 op/s 2023-05-08T06:08:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8652.756814 secs 2023-05-08T06:08:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8653.313512 secs 2023-05-08T06:08:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:33 smithi186 ceph-mon[126480]: pgmap v4673: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 17 KiB/s wr, 6 op/s 2023-05-08T06:08:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8652.756814 secs 2023-05-08T06:08:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8653.313512 secs 2023-05-08T06:08:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:35 smithi186 ceph-mon[126480]: pgmap v4674: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 43 KiB/s wr, 9 op/s 2023-05-08T06:08:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8654.594821 secs 2023-05-08T06:08:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:35 smithi133 ceph-mon[125939]: pgmap v4674: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 43 KiB/s wr, 9 op/s 2023-05-08T06:08:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8654.594821 secs 2023-05-08T06:08:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:35 smithi096 ceph-mon[124666]: pgmap v4674: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 43 KiB/s wr, 9 op/s 2023-05-08T06:08:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8654.594821 secs 2023-05-08T06:08:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:37 smithi186 ceph-mon[126480]: pgmap v4675: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 KiB/s wr, 6 op/s 2023-05-08T06:08:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:37 smithi133 ceph-mon[125939]: pgmap v4675: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 KiB/s wr, 6 op/s 2023-05-08T06:08:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:37 smithi096 ceph-mon[124666]: pgmap v4675: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 KiB/s wr, 6 op/s 2023-05-08T06:08:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8657.756952 secs 2023-05-08T06:08:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8657.756952 secs 2023-05-08T06:08:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8657.756952 secs 2023-05-08T06:08:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:39 smithi186 ceph-mon[126480]: pgmap v4676: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 KiB/s wr, 6 op/s 2023-05-08T06:08:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:39 smithi133 ceph-mon[125939]: pgmap v4676: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 KiB/s wr, 6 op/s 2023-05-08T06:08:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:39 smithi096 ceph-mon[124666]: pgmap v4676: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 KiB/s wr, 6 op/s 2023-05-08T06:08:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8659.594885 secs 2023-05-08T06:08:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8659.594885 secs 2023-05-08T06:08:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8659.594885 secs 2023-05-08T06:08:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:41 smithi133 ceph-mon[125939]: pgmap v4677: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 57 KiB/s wr, 10 op/s 2023-05-08T06:08:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:41 smithi096 ceph-mon[124666]: pgmap v4677: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 57 KiB/s wr, 10 op/s 2023-05-08T06:08:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:41 smithi186 ceph-mon[126480]: pgmap v4677: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 57 KiB/s wr, 10 op/s 2023-05-08T06:08:43.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:08:43.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:08:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:08:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:43 smithi133 ceph-mon[125939]: pgmap v4678: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 57 KiB/s wr, 7 op/s 2023-05-08T06:08:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:43 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:08:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:08:44.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:08:44.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8662.757059 secs 2023-05-08T06:08:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:43 smithi096 ceph-mon[124666]: pgmap v4678: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 57 KiB/s wr, 7 op/s 2023-05-08T06:08:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:43 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:08:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:08:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:08:44.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8662.757059 secs 2023-05-08T06:08:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:43 smithi186 ceph-mon[126480]: pgmap v4678: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 57 KiB/s wr, 7 op/s 2023-05-08T06:08:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:43 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:08:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:08:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:08:44.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8662.757059 secs 2023-05-08T06:08:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:45 smithi133 ceph-mon[125939]: pgmap v4679: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 102 KiB/s wr, 11 op/s 2023-05-08T06:08:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8664.594953 secs 2023-05-08T06:08:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:45 smithi096 ceph-mon[124666]: pgmap v4679: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 102 KiB/s wr, 11 op/s 2023-05-08T06:08:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8664.594953 secs 2023-05-08T06:08:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:45 smithi186 ceph-mon[126480]: pgmap v4679: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 102 KiB/s wr, 11 op/s 2023-05-08T06:08:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8664.594953 secs 2023-05-08T06:08:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:47 smithi133 ceph-mon[125939]: pgmap v4680: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 79 KiB/s wr, 9 op/s 2023-05-08T06:08:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:47 smithi096 ceph-mon[124666]: pgmap v4680: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 79 KiB/s wr, 9 op/s 2023-05-08T06:08:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:47 smithi186 ceph-mon[126480]: pgmap v4680: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 79 KiB/s wr, 9 op/s 2023-05-08T06:08:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8667.757180 secs 2023-05-08T06:08:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8668.313828 secs 2023-05-08T06:08:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8667.757180 secs 2023-05-08T06:08:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8668.313828 secs 2023-05-08T06:08:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8667.757180 secs 2023-05-08T06:08:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8668.313828 secs 2023-05-08T06:08:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:49 smithi133 ceph-mon[125939]: pgmap v4681: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 79 KiB/s wr, 9 op/s 2023-05-08T06:08:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:49 smithi096 ceph-mon[124666]: pgmap v4681: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 79 KiB/s wr, 9 op/s 2023-05-08T06:08:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:49 smithi186 ceph-mon[126480]: pgmap v4681: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 79 KiB/s wr, 9 op/s 2023-05-08T06:08:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:50 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:08:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:50 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:08:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:50 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:08:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:51 smithi133 ceph-mon[125939]: pgmap v4682: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 82 KiB/s wr, 13 op/s 2023-05-08T06:08:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:08:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:08:52.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:08:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:51 smithi096 ceph-mon[124666]: pgmap v4682: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 82 KiB/s wr, 13 op/s 2023-05-08T06:08:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:08:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:08:52.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:08:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:51 smithi186 ceph-mon[126480]: pgmap v4682: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 82 KiB/s wr, 13 op/s 2023-05-08T06:08:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:08:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:08:52.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:08:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:53 smithi133 ceph-mon[125939]: pgmap v4683: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 52 KiB/s wr, 9 op/s 2023-05-08T06:08:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8672.757295 secs 2023-05-08T06:08:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8673.313956 secs 2023-05-08T06:08:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:53 smithi096 ceph-mon[124666]: pgmap v4683: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 52 KiB/s wr, 9 op/s 2023-05-08T06:08:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8672.757295 secs 2023-05-08T06:08:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8673.313956 secs 2023-05-08T06:08:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:53 smithi186 ceph-mon[126480]: pgmap v4683: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 52 KiB/s wr, 9 op/s 2023-05-08T06:08:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8672.757295 secs 2023-05-08T06:08:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8673.313956 secs 2023-05-08T06:08:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:55 smithi133 ceph-mon[125939]: pgmap v4684: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 120 KiB/s wr, 12 op/s 2023-05-08T06:08:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:55 smithi096 ceph-mon[124666]: pgmap v4684: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 120 KiB/s wr, 12 op/s 2023-05-08T06:08:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:55 smithi186 ceph-mon[126480]: pgmap v4684: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 120 KiB/s wr, 12 op/s 2023-05-08T06:08:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:57 smithi133 ceph-mon[125939]: pgmap v4685: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 77 KiB/s wr, 8 op/s 2023-05-08T06:08:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:57 smithi096 ceph-mon[124666]: pgmap v4685: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 77 KiB/s wr, 8 op/s 2023-05-08T06:08:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:57 smithi186 ceph-mon[126480]: pgmap v4685: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 77 KiB/s wr, 8 op/s 2023-05-08T06:08:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8677.757408 secs 2023-05-08T06:08:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8678.314099 secs 2023-05-08T06:08:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8677.757408 secs 2023-05-08T06:08:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8678.314099 secs 2023-05-08T06:08:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8677.757408 secs 2023-05-08T06:08:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8678.314099 secs 2023-05-08T06:09:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:08:59 smithi133 ceph-mon[125939]: pgmap v4686: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 74 KiB/s wr, 7 op/s 2023-05-08T06:09:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:08:59 smithi096 ceph-mon[124666]: pgmap v4686: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 74 KiB/s wr, 7 op/s 2023-05-08T06:09:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:08:59 smithi186 ceph-mon[126480]: pgmap v4686: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 74 KiB/s wr, 7 op/s 2023-05-08T06:09:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8679.595175 secs 2023-05-08T06:09:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8679.595175 secs 2023-05-08T06:09:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8679.595175 secs 2023-05-08T06:09:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:01 smithi133 ceph-mon[125939]: pgmap v4687: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 77 KiB/s wr, 11 op/s 2023-05-08T06:09:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:01 smithi096 ceph-mon[124666]: pgmap v4687: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 77 KiB/s wr, 11 op/s 2023-05-08T06:09:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:01 smithi186 ceph-mon[126480]: pgmap v4687: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 77 KiB/s wr, 11 op/s 2023-05-08T06:09:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:02 smithi133 ceph-mon[125939]: pgmap v4688: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 74 KiB/s wr, 7 op/s 2023-05-08T06:09:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:02 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:09:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:09:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:09:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:02 smithi096 ceph-mon[124666]: pgmap v4688: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 74 KiB/s wr, 7 op/s 2023-05-08T06:09:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:02 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:09:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:09:03.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:09:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:02 smithi186 ceph-mon[126480]: pgmap v4688: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 74 KiB/s wr, 7 op/s 2023-05-08T06:09:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:02 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:09:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:09:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:09:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8682.757524 secs 2023-05-08T06:09:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8683.314205 secs 2023-05-08T06:09:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8682.757524 secs 2023-05-08T06:09:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8683.314205 secs 2023-05-08T06:09:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8682.757524 secs 2023-05-08T06:09:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8683.314205 secs 2023-05-08T06:09:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:05 smithi186 ceph-mon[126480]: pgmap v4689: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 149 KiB/s wr, 25 op/s 2023-05-08T06:09:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8684.595270 secs 2023-05-08T06:09:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:05 smithi133 ceph-mon[125939]: pgmap v4689: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 149 KiB/s wr, 25 op/s 2023-05-08T06:09:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8684.595270 secs 2023-05-08T06:09:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:05 smithi096 ceph-mon[124666]: pgmap v4689: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 149 KiB/s wr, 25 op/s 2023-05-08T06:09:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8684.595270 secs 2023-05-08T06:09:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:06 smithi133 ceph-mon[125939]: osdmap e370: 12 total, 12 up, 12 in 2023-05-08T06:09:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:06 smithi096 ceph-mon[124666]: osdmap e370: 12 total, 12 up, 12 in 2023-05-08T06:09:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:06 smithi186 ceph-mon[126480]: osdmap e370: 12 total, 12 up, 12 in 2023-05-08T06:09:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:07 smithi133 ceph-mon[125939]: pgmap v4691: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 93 KiB/s wr, 26 op/s 2023-05-08T06:09:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:07 smithi096 ceph-mon[124666]: pgmap v4691: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 93 KiB/s wr, 26 op/s 2023-05-08T06:09:08.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:07 smithi186 ceph-mon[126480]: pgmap v4691: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 93 KiB/s wr, 26 op/s 2023-05-08T06:09:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8687.757645 secs 2023-05-08T06:09:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8688.314310 secs 2023-05-08T06:09:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8687.757645 secs 2023-05-08T06:09:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8688.314310 secs 2023-05-08T06:09:09.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8687.757645 secs 2023-05-08T06:09:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8688.314310 secs 2023-05-08T06:09:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:09 smithi133 ceph-mon[125939]: pgmap v4692: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 93 KiB/s wr, 26 op/s 2023-05-08T06:09:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:09 smithi096 ceph-mon[124666]: pgmap v4692: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 93 KiB/s wr, 26 op/s 2023-05-08T06:09:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:09 smithi186 ceph-mon[126480]: pgmap v4692: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 93 KiB/s wr, 26 op/s 2023-05-08T06:09:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8689.595391 secs 2023-05-08T06:09:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8689.595391 secs 2023-05-08T06:09:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8689.595391 secs 2023-05-08T06:09:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:11 smithi133 ceph-mon[125939]: pgmap v4693: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 98 KiB/s wr, 26 op/s 2023-05-08T06:09:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:11 smithi096 ceph-mon[124666]: pgmap v4693: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 98 KiB/s wr, 26 op/s 2023-05-08T06:09:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:11 smithi186 ceph-mon[126480]: pgmap v4693: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 98 KiB/s wr, 26 op/s 2023-05-08T06:09:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:13 smithi133 ceph-mon[125939]: pgmap v4694: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 98 KiB/s wr, 26 op/s 2023-05-08T06:09:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8692.757704 secs 2023-05-08T06:09:14.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8693.314436 secs 2023-05-08T06:09:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:13 smithi096 ceph-mon[124666]: pgmap v4694: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 98 KiB/s wr, 26 op/s 2023-05-08T06:09:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8692.757704 secs 2023-05-08T06:09:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8693.314436 secs 2023-05-08T06:09:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:13 smithi186 ceph-mon[126480]: pgmap v4694: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 98 KiB/s wr, 26 op/s 2023-05-08T06:09:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8692.757704 secs 2023-05-08T06:09:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8693.314436 secs 2023-05-08T06:09:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:15 smithi186 ceph-mon[126480]: pgmap v4695: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 9 op/s 2023-05-08T06:09:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8694.595510 secs 2023-05-08T06:09:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:15 smithi186 ceph-mon[126480]: osdmap e371: 12 total, 12 up, 12 in 2023-05-08T06:09:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:15 smithi133 ceph-mon[125939]: pgmap v4695: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 9 op/s 2023-05-08T06:09:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8694.595510 secs 2023-05-08T06:09:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:15 smithi133 ceph-mon[125939]: osdmap e371: 12 total, 12 up, 12 in 2023-05-08T06:09:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:15 smithi096 ceph-mon[124666]: pgmap v4695: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 9 op/s 2023-05-08T06:09:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8694.595510 secs 2023-05-08T06:09:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:15 smithi096 ceph-mon[124666]: osdmap e371: 12 total, 12 up, 12 in 2023-05-08T06:09:18.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:17 smithi133 ceph-mon[125939]: pgmap v4697: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 9 op/s 2023-05-08T06:09:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:17 smithi096 ceph-mon[124666]: pgmap v4697: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 9 op/s 2023-05-08T06:09:18.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:17 smithi186 ceph-mon[126480]: pgmap v4697: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 9 op/s 2023-05-08T06:09:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8697.757822 secs 2023-05-08T06:09:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8698.314552 secs 2023-05-08T06:09:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8697.757822 secs 2023-05-08T06:09:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8698.314552 secs 2023-05-08T06:09:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8697.757822 secs 2023-05-08T06:09:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8698.314552 secs 2023-05-08T06:09:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:19 smithi133 ceph-mon[125939]: pgmap v4698: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 9 op/s 2023-05-08T06:09:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:19 smithi096 ceph-mon[124666]: pgmap v4698: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 9 op/s 2023-05-08T06:09:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:19 smithi186 ceph-mon[126480]: pgmap v4698: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 9 op/s 2023-05-08T06:09:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8699.595627 secs 2023-05-08T06:09:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8699.595627 secs 2023-05-08T06:09:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8699.595627 secs 2023-05-08T06:09:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:21 smithi133 ceph-mon[125939]: pgmap v4699: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 8 op/s 2023-05-08T06:09:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:21 smithi096 ceph-mon[124666]: pgmap v4699: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 8 op/s 2023-05-08T06:09:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:21 smithi186 ceph-mon[126480]: pgmap v4699: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 8 op/s 2023-05-08T06:09:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:23 smithi133 ceph-mon[125939]: pgmap v4700: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 8 op/s 2023-05-08T06:09:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8702.757936 secs 2023-05-08T06:09:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8703.314672 secs 2023-05-08T06:09:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:23 smithi096 ceph-mon[124666]: pgmap v4700: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 8 op/s 2023-05-08T06:09:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8702.757936 secs 2023-05-08T06:09:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8703.314672 secs 2023-05-08T06:09:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:23 smithi186 ceph-mon[126480]: pgmap v4700: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 8 op/s 2023-05-08T06:09:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8702.757936 secs 2023-05-08T06:09:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8703.314672 secs 2023-05-08T06:09:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:25 smithi133 ceph-mon[125939]: pgmap v4701: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 47 KiB/s wr, 8 op/s 2023-05-08T06:09:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8704.595744 secs 2023-05-08T06:09:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:25 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:09:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:25 smithi096 ceph-mon[124666]: pgmap v4701: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 47 KiB/s wr, 8 op/s 2023-05-08T06:09:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8704.595744 secs 2023-05-08T06:09:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:25 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:09:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:25 smithi186 ceph-mon[126480]: pgmap v4701: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 47 KiB/s wr, 8 op/s 2023-05-08T06:09:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8704.595744 secs 2023-05-08T06:09:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:25 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:09:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:09:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:09:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:09:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:09:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:09:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:09:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:09:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:09:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:09:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:27 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:09:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:27 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T06:09:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:27 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T06:09:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:27 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:09:28.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:27 smithi133 ceph-mon[125939]: pgmap v4702: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 40 KiB/s wr, 7 op/s 2023-05-08T06:09:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:27 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:09:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:27 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T06:09:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:27 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T06:09:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:27 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:09:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:27 smithi096 ceph-mon[124666]: pgmap v4702: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 40 KiB/s wr, 7 op/s 2023-05-08T06:09:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:27 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:09:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:27 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T06:09:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:27 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T06:09:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:27 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:09:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:27 smithi186 ceph-mon[126480]: pgmap v4702: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 40 KiB/s wr, 7 op/s 2023-05-08T06:09:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8707.758064 secs 2023-05-08T06:09:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8708.314798 secs 2023-05-08T06:09:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8707.758064 secs 2023-05-08T06:09:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8708.314798 secs 2023-05-08T06:09:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8707.758064 secs 2023-05-08T06:09:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8708.314798 secs 2023-05-08T06:09:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:29 smithi133 ceph-mon[125939]: pgmap v4703: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 39 KiB/s wr, 6 op/s 2023-05-08T06:09:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:29 smithi096 ceph-mon[124666]: pgmap v4703: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 39 KiB/s wr, 6 op/s 2023-05-08T06:09:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:29 smithi186 ceph-mon[126480]: pgmap v4703: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 39 KiB/s wr, 6 op/s 2023-05-08T06:09:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8709.595886 secs 2023-05-08T06:09:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8709.595886 secs 2023-05-08T06:09:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8709.595886 secs 2023-05-08T06:09:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:31 smithi133 ceph-mon[125939]: pgmap v4704: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 40 KiB/s wr, 10 op/s 2023-05-08T06:09:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:31 smithi096 ceph-mon[124666]: pgmap v4704: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 40 KiB/s wr, 10 op/s 2023-05-08T06:09:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:31 smithi186 ceph-mon[126480]: pgmap v4704: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 40 KiB/s wr, 10 op/s 2023-05-08T06:09:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:33 smithi133 ceph-mon[125939]: pgmap v4705: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 40 KiB/s wr, 7 op/s 2023-05-08T06:09:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8712.758191 secs 2023-05-08T06:09:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8713.314919 secs 2023-05-08T06:09:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:33 smithi096 ceph-mon[124666]: pgmap v4705: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 40 KiB/s wr, 7 op/s 2023-05-08T06:09:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8712.758191 secs 2023-05-08T06:09:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8713.314919 secs 2023-05-08T06:09:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:33 smithi186 ceph-mon[126480]: pgmap v4705: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 40 KiB/s wr, 7 op/s 2023-05-08T06:09:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8712.758191 secs 2023-05-08T06:09:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8713.314919 secs 2023-05-08T06:09:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:35 smithi133 ceph-mon[125939]: pgmap v4706: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 67 KiB/s wr, 10 op/s 2023-05-08T06:09:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8714.596031 secs 2023-05-08T06:09:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:35 smithi096 ceph-mon[124666]: pgmap v4706: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 67 KiB/s wr, 10 op/s 2023-05-08T06:09:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8714.596031 secs 2023-05-08T06:09:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:35 smithi186 ceph-mon[126480]: pgmap v4706: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 67 KiB/s wr, 10 op/s 2023-05-08T06:09:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8714.596031 secs 2023-05-08T06:09:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:37 smithi133 ceph-mon[125939]: pgmap v4707: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 28 KiB/s wr, 7 op/s 2023-05-08T06:09:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:37 smithi096 ceph-mon[124666]: pgmap v4707: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 28 KiB/s wr, 7 op/s 2023-05-08T06:09:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:37 smithi186 ceph-mon[126480]: pgmap v4707: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 28 KiB/s wr, 7 op/s 2023-05-08T06:09:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8717.758301 secs 2023-05-08T06:09:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8717.758301 secs 2023-05-08T06:09:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8717.758301 secs 2023-05-08T06:09:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:39 smithi133 ceph-mon[125939]: pgmap v4708: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 28 KiB/s wr, 7 op/s 2023-05-08T06:09:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:39 smithi096 ceph-mon[124666]: pgmap v4708: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 28 KiB/s wr, 7 op/s 2023-05-08T06:09:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:39 smithi186 ceph-mon[126480]: pgmap v4708: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 28 KiB/s wr, 7 op/s 2023-05-08T06:09:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8719.596145 secs 2023-05-08T06:09:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8719.596145 secs 2023-05-08T06:09:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8719.596145 secs 2023-05-08T06:09:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:41 smithi133 ceph-mon[125939]: pgmap v4709: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 59 KiB/s wr, 11 op/s 2023-05-08T06:09:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:41 smithi096 ceph-mon[124666]: pgmap v4709: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 59 KiB/s wr, 11 op/s 2023-05-08T06:09:42.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:41 smithi186 ceph-mon[126480]: pgmap v4709: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 59 KiB/s wr, 11 op/s 2023-05-08T06:09:43.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:09:43.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:09:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:09:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:43 smithi133 ceph-mon[125939]: pgmap v4710: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 7 op/s 2023-05-08T06:09:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:43 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:09:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:09:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:09:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8722.758421 secs 2023-05-08T06:09:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:43 smithi096 ceph-mon[124666]: pgmap v4710: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 7 op/s 2023-05-08T06:09:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:43 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:09:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:09:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:09:44.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8722.758421 secs 2023-05-08T06:09:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:43 smithi186 ceph-mon[126480]: pgmap v4710: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 7 op/s 2023-05-08T06:09:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:43 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:09:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:09:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:09:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8722.758421 secs 2023-05-08T06:09:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:45 smithi133 ceph-mon[125939]: pgmap v4711: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 105 KiB/s wr, 11 op/s 2023-05-08T06:09:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8724.596212 secs 2023-05-08T06:09:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:45 smithi096 ceph-mon[124666]: pgmap v4711: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 105 KiB/s wr, 11 op/s 2023-05-08T06:09:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8724.596212 secs 2023-05-08T06:09:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:45 smithi186 ceph-mon[126480]: pgmap v4711: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 105 KiB/s wr, 11 op/s 2023-05-08T06:09:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8724.596212 secs 2023-05-08T06:09:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:47 smithi133 ceph-mon[125939]: pgmap v4712: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 81 KiB/s wr, 9 op/s 2023-05-08T06:09:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:47 smithi096 ceph-mon[124666]: pgmap v4712: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 81 KiB/s wr, 9 op/s 2023-05-08T06:09:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:47 smithi186 ceph-mon[126480]: pgmap v4712: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 81 KiB/s wr, 9 op/s 2023-05-08T06:09:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8727.758529 secs 2023-05-08T06:09:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8728.315301 secs 2023-05-08T06:09:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8727.758529 secs 2023-05-08T06:09:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8728.315301 secs 2023-05-08T06:09:49.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8727.758529 secs 2023-05-08T06:09:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8728.315301 secs 2023-05-08T06:09:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:49 smithi133 ceph-mon[125939]: pgmap v4713: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 81 KiB/s wr, 9 op/s 2023-05-08T06:09:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:49 smithi096 ceph-mon[124666]: pgmap v4713: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 81 KiB/s wr, 9 op/s 2023-05-08T06:09:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:49 smithi186 ceph-mon[126480]: pgmap v4713: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 81 KiB/s wr, 9 op/s 2023-05-08T06:09:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:50 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:09:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:50 smithi133 ceph-mon[125939]: pgmap v4714: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 84 KiB/s wr, 13 op/s 2023-05-08T06:09:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:50 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:09:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:50 smithi096 ceph-mon[124666]: pgmap v4714: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 84 KiB/s wr, 13 op/s 2023-05-08T06:09:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:50 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:09:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:50 smithi186 ceph-mon[126480]: pgmap v4714: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 84 KiB/s wr, 13 op/s 2023-05-08T06:09:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:09:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:09:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:09:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:09:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:09:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:09:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:09:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:09:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:09:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:52 smithi133 ceph-mon[125939]: pgmap v4715: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 53 KiB/s wr, 9 op/s 2023-05-08T06:09:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:52 smithi096 ceph-mon[124666]: pgmap v4715: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 53 KiB/s wr, 9 op/s 2023-05-08T06:09:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:52 smithi186 ceph-mon[126480]: pgmap v4715: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 53 KiB/s wr, 9 op/s 2023-05-08T06:09:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8732.758638 secs 2023-05-08T06:09:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8733.315417 secs 2023-05-08T06:09:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8732.758638 secs 2023-05-08T06:09:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8733.315417 secs 2023-05-08T06:09:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8732.758638 secs 2023-05-08T06:09:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8733.315417 secs 2023-05-08T06:09:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:55 smithi133 ceph-mon[125939]: pgmap v4716: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 102 KiB/s wr, 12 op/s 2023-05-08T06:09:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:55 smithi096 ceph-mon[124666]: pgmap v4716: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 102 KiB/s wr, 12 op/s 2023-05-08T06:09:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:55 smithi186 ceph-mon[126480]: pgmap v4716: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 102 KiB/s wr, 12 op/s 2023-05-08T06:09:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:57 smithi133 ceph-mon[125939]: pgmap v4717: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 59 KiB/s wr, 8 op/s 2023-05-08T06:09:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:57 smithi096 ceph-mon[124666]: pgmap v4717: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 59 KiB/s wr, 8 op/s 2023-05-08T06:09:58.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:57 smithi186 ceph-mon[126480]: pgmap v4717: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 59 KiB/s wr, 8 op/s 2023-05-08T06:09:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8737.758764 secs 2023-05-08T06:09:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8738.315538 secs 2023-05-08T06:09:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8737.758764 secs 2023-05-08T06:09:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8738.315538 secs 2023-05-08T06:09:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8737.758764 secs 2023-05-08T06:09:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8738.315538 secs 2023-05-08T06:10:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:09:59 smithi133 ceph-mon[125939]: pgmap v4718: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 55 KiB/s wr, 7 op/s 2023-05-08T06:10:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:09:59 smithi096 ceph-mon[124666]: pgmap v4718: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 55 KiB/s wr, 7 op/s 2023-05-08T06:10:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:09:59 smithi186 ceph-mon[126480]: pgmap v4718: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 55 KiB/s wr, 7 op/s 2023-05-08T06:10:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8739.596560 secs 2023-05-08T06:10:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:00 smithi133 ceph-mon[125939]: overall HEALTH_WARN 2 MDSs report slow requests 2023-05-08T06:10:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8739.596560 secs 2023-05-08T06:10:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:00 smithi096 ceph-mon[124666]: overall HEALTH_WARN 2 MDSs report slow requests 2023-05-08T06:10:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8739.596560 secs 2023-05-08T06:10:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:00 smithi186 ceph-mon[126480]: overall HEALTH_WARN 2 MDSs report slow requests 2023-05-08T06:10:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:01 smithi133 ceph-mon[125939]: pgmap v4719: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 58 KiB/s wr, 11 op/s 2023-05-08T06:10:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:01 smithi096 ceph-mon[124666]: pgmap v4719: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 58 KiB/s wr, 11 op/s 2023-05-08T06:10:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:01 smithi186 ceph-mon[126480]: pgmap v4719: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 58 KiB/s wr, 11 op/s 2023-05-08T06:10:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:02 smithi133 ceph-mon[125939]: pgmap v4720: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 55 KiB/s wr, 7 op/s 2023-05-08T06:10:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:02 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:10:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:10:03.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:10:03.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:02 smithi096 ceph-mon[124666]: pgmap v4720: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 55 KiB/s wr, 7 op/s 2023-05-08T06:10:03.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:02 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:10:03.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:10:03.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:10:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:02 smithi186 ceph-mon[126480]: pgmap v4720: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 55 KiB/s wr, 7 op/s 2023-05-08T06:10:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:02 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:10:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:10:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:10:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8742.758841 secs 2023-05-08T06:10:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8743.315640 secs 2023-05-08T06:10:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8742.758841 secs 2023-05-08T06:10:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8743.315640 secs 2023-05-08T06:10:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8742.758841 secs 2023-05-08T06:10:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8743.315640 secs 2023-05-08T06:10:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:05 smithi133 ceph-mon[125939]: pgmap v4721: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 131 KiB/s wr, 25 op/s 2023-05-08T06:10:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8744.596688 secs 2023-05-08T06:10:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:05 smithi133 ceph-mon[125939]: osdmap e372: 12 total, 12 up, 12 in 2023-05-08T06:10:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:05 smithi096 ceph-mon[124666]: pgmap v4721: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 131 KiB/s wr, 25 op/s 2023-05-08T06:10:06.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8744.596688 secs 2023-05-08T06:10:06.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:05 smithi096 ceph-mon[124666]: osdmap e372: 12 total, 12 up, 12 in 2023-05-08T06:10:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:05 smithi186 ceph-mon[126480]: pgmap v4721: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 131 KiB/s wr, 25 op/s 2023-05-08T06:10:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8744.596688 secs 2023-05-08T06:10:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:05 smithi186 ceph-mon[126480]: osdmap e372: 12 total, 12 up, 12 in 2023-05-08T06:10:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:07 smithi133 ceph-mon[125939]: pgmap v4723: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 95 KiB/s wr, 26 op/s 2023-05-08T06:10:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:07 smithi096 ceph-mon[124666]: pgmap v4723: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 95 KiB/s wr, 26 op/s 2023-05-08T06:10:08.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:07 smithi186 ceph-mon[126480]: pgmap v4723: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 95 KiB/s wr, 26 op/s 2023-05-08T06:10:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8747.758966 secs 2023-05-08T06:10:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8748.315729 secs 2023-05-08T06:10:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8747.758966 secs 2023-05-08T06:10:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8748.315729 secs 2023-05-08T06:10:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8747.758966 secs 2023-05-08T06:10:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8748.315729 secs 2023-05-08T06:10:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:09 smithi133 ceph-mon[125939]: pgmap v4724: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 95 KiB/s wr, 26 op/s 2023-05-08T06:10:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:09 smithi096 ceph-mon[124666]: pgmap v4724: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 95 KiB/s wr, 26 op/s 2023-05-08T06:10:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:09 smithi186 ceph-mon[126480]: pgmap v4724: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 95 KiB/s wr, 26 op/s 2023-05-08T06:10:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8749.596790 secs 2023-05-08T06:10:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8749.596790 secs 2023-05-08T06:10:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8749.596790 secs 2023-05-08T06:10:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:11 smithi133 ceph-mon[125939]: pgmap v4725: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 96 KiB/s wr, 26 op/s 2023-05-08T06:10:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:11 smithi096 ceph-mon[124666]: pgmap v4725: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 96 KiB/s wr, 26 op/s 2023-05-08T06:10:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:11 smithi186 ceph-mon[126480]: pgmap v4725: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 96 KiB/s wr, 26 op/s 2023-05-08T06:10:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:13 smithi133 ceph-mon[125939]: pgmap v4726: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 96 KiB/s wr, 26 op/s 2023-05-08T06:10:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8752.759110 secs 2023-05-08T06:10:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8753.315795 secs 2023-05-08T06:10:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:13 smithi096 ceph-mon[124666]: pgmap v4726: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 96 KiB/s wr, 26 op/s 2023-05-08T06:10:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8752.759110 secs 2023-05-08T06:10:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8753.315795 secs 2023-05-08T06:10:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:13 smithi186 ceph-mon[126480]: pgmap v4726: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 96 KiB/s wr, 26 op/s 2023-05-08T06:10:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8752.759110 secs 2023-05-08T06:10:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8753.315795 secs 2023-05-08T06:10:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:15 smithi133 ceph-mon[125939]: pgmap v4727: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 8 op/s 2023-05-08T06:10:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8754.596891 secs 2023-05-08T06:10:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:15 smithi133 ceph-mon[125939]: osdmap e373: 12 total, 12 up, 12 in 2023-05-08T06:10:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:15 smithi096 ceph-mon[124666]: pgmap v4727: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 8 op/s 2023-05-08T06:10:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8754.596891 secs 2023-05-08T06:10:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:15 smithi096 ceph-mon[124666]: osdmap e373: 12 total, 12 up, 12 in 2023-05-08T06:10:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:15 smithi186 ceph-mon[126480]: pgmap v4727: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 8 op/s 2023-05-08T06:10:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8754.596891 secs 2023-05-08T06:10:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:15 smithi186 ceph-mon[126480]: osdmap e373: 12 total, 12 up, 12 in 2023-05-08T06:10:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:17 smithi133 ceph-mon[125939]: pgmap v4729: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 9 op/s 2023-05-08T06:10:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:17 smithi096 ceph-mon[124666]: pgmap v4729: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 9 op/s 2023-05-08T06:10:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:17 smithi186 ceph-mon[126480]: pgmap v4729: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 9 op/s 2023-05-08T06:10:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8757.759235 secs 2023-05-08T06:10:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8758.315913 secs 2023-05-08T06:10:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8757.759235 secs 2023-05-08T06:10:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8758.315913 secs 2023-05-08T06:10:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8757.759235 secs 2023-05-08T06:10:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8758.315913 secs 2023-05-08T06:10:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:19 smithi133 ceph-mon[125939]: pgmap v4730: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 9 op/s 2023-05-08T06:10:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:19 smithi096 ceph-mon[124666]: pgmap v4730: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 9 op/s 2023-05-08T06:10:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:19 smithi186 ceph-mon[126480]: pgmap v4730: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 9 op/s 2023-05-08T06:10:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8759.597005 secs 2023-05-08T06:10:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8759.597005 secs 2023-05-08T06:10:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8759.597005 secs 2023-05-08T06:10:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:21 smithi133 ceph-mon[125939]: pgmap v4731: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 16 KiB/s wr, 8 op/s 2023-05-08T06:10:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:21 smithi096 ceph-mon[124666]: pgmap v4731: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 16 KiB/s wr, 8 op/s 2023-05-08T06:10:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:21 smithi186 ceph-mon[126480]: pgmap v4731: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 16 KiB/s wr, 8 op/s 2023-05-08T06:10:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:23 smithi133 ceph-mon[125939]: pgmap v4732: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 16 KiB/s wr, 8 op/s 2023-05-08T06:10:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8762.759379 secs 2023-05-08T06:10:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8763.316045 secs 2023-05-08T06:10:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:23 smithi096 ceph-mon[124666]: pgmap v4732: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 16 KiB/s wr, 8 op/s 2023-05-08T06:10:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8762.759379 secs 2023-05-08T06:10:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8763.316045 secs 2023-05-08T06:10:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:23 smithi186 ceph-mon[126480]: pgmap v4732: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 16 KiB/s wr, 8 op/s 2023-05-08T06:10:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8762.759379 secs 2023-05-08T06:10:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8763.316045 secs 2023-05-08T06:10:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:25 smithi133 ceph-mon[125939]: pgmap v4733: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 33 KiB/s wr, 8 op/s 2023-05-08T06:10:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8764.597130 secs 2023-05-08T06:10:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:25 smithi096 ceph-mon[124666]: pgmap v4733: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 33 KiB/s wr, 8 op/s 2023-05-08T06:10:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8764.597130 secs 2023-05-08T06:10:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:25 smithi186 ceph-mon[126480]: pgmap v4733: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 33 KiB/s wr, 8 op/s 2023-05-08T06:10:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8764.597130 secs 2023-05-08T06:10:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:10:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:10:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:10:27.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:10:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:10:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:10:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:10:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:10:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:10:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:10:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:10:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:10:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:27 smithi133 ceph-mon[125939]: pgmap v4734: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 7 op/s 2023-05-08T06:10:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:27 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:10:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:27 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T06:10:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:27 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T06:10:28.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:27 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:10:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:27 smithi096 ceph-mon[124666]: pgmap v4734: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 7 op/s 2023-05-08T06:10:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:27 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:10:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:27 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T06:10:28.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:27 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T06:10:28.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:27 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:10:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:27 smithi186 ceph-mon[126480]: pgmap v4734: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 7 op/s 2023-05-08T06:10:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:27 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:10:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:27 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T06:10:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:27 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T06:10:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:27 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:10:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8767.759509 secs 2023-05-08T06:10:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8768.316124 secs 2023-05-08T06:10:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8767.759509 secs 2023-05-08T06:10:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8768.316124 secs 2023-05-08T06:10:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8767.759509 secs 2023-05-08T06:10:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8768.316124 secs 2023-05-08T06:10:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:29 smithi133 ceph-mon[125939]: pgmap v4735: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 6 op/s 2023-05-08T06:10:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:29 smithi096 ceph-mon[124666]: pgmap v4735: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 6 op/s 2023-05-08T06:10:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:29 smithi186 ceph-mon[126480]: pgmap v4735: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 6 op/s 2023-05-08T06:10:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8769.597241 secs 2023-05-08T06:10:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8769.597241 secs 2023-05-08T06:10:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8769.597241 secs 2023-05-08T06:10:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:31 smithi133 ceph-mon[125939]: pgmap v4736: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 KiB/s wr, 10 op/s 2023-05-08T06:10:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:31 smithi096 ceph-mon[124666]: pgmap v4736: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 KiB/s wr, 10 op/s 2023-05-08T06:10:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:31 smithi186 ceph-mon[126480]: pgmap v4736: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 KiB/s wr, 10 op/s 2023-05-08T06:10:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:33 smithi133 ceph-mon[125939]: pgmap v4737: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 7 op/s 2023-05-08T06:10:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8772.759603 secs 2023-05-08T06:10:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8773.316243 secs 2023-05-08T06:10:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:33 smithi096 ceph-mon[124666]: pgmap v4737: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 7 op/s 2023-05-08T06:10:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8772.759603 secs 2023-05-08T06:10:34.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8773.316243 secs 2023-05-08T06:10:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:33 smithi186 ceph-mon[126480]: pgmap v4737: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 7 op/s 2023-05-08T06:10:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8772.759603 secs 2023-05-08T06:10:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8773.316243 secs 2023-05-08T06:10:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:35 smithi133 ceph-mon[125939]: pgmap v4738: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 55 KiB/s wr, 10 op/s 2023-05-08T06:10:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8774.597375 secs 2023-05-08T06:10:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:35 smithi096 ceph-mon[124666]: pgmap v4738: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 55 KiB/s wr, 10 op/s 2023-05-08T06:10:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8774.597375 secs 2023-05-08T06:10:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:35 smithi186 ceph-mon[126480]: pgmap v4738: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 55 KiB/s wr, 10 op/s 2023-05-08T06:10:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8774.597375 secs 2023-05-08T06:10:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:37 smithi133 ceph-mon[125939]: pgmap v4739: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 7 op/s 2023-05-08T06:10:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:37 smithi096 ceph-mon[124666]: pgmap v4739: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 7 op/s 2023-05-08T06:10:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:37 smithi186 ceph-mon[126480]: pgmap v4739: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 7 op/s 2023-05-08T06:10:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8777.759686 secs 2023-05-08T06:10:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8777.759686 secs 2023-05-08T06:10:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8777.759686 secs 2023-05-08T06:10:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:39 smithi133 ceph-mon[125939]: pgmap v4740: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 6 op/s 2023-05-08T06:10:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:39 smithi096 ceph-mon[124666]: pgmap v4740: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 6 op/s 2023-05-08T06:10:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:39 smithi186 ceph-mon[126480]: pgmap v4740: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 6 op/s 2023-05-08T06:10:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8779.597500 secs 2023-05-08T06:10:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8779.597500 secs 2023-05-08T06:10:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8779.597500 secs 2023-05-08T06:10:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:41 smithi133 ceph-mon[125939]: pgmap v4741: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 11 op/s 2023-05-08T06:10:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:41 smithi096 ceph-mon[124666]: pgmap v4741: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 11 op/s 2023-05-08T06:10:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:41 smithi186 ceph-mon[126480]: pgmap v4741: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 11 op/s 2023-05-08T06:10:43.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:10:43.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:42 smithi133 ceph-mon[125939]: pgmap v4742: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 60 KiB/s wr, 7 op/s 2023-05-08T06:10:43.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:10:43.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:42 smithi096 ceph-mon[124666]: pgmap v4742: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 60 KiB/s wr, 7 op/s 2023-05-08T06:10:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:10:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:42 smithi186 ceph-mon[126480]: pgmap v4742: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 60 KiB/s wr, 7 op/s 2023-05-08T06:10:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:43 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:10:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:10:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:10:44.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8782.759776 secs 2023-05-08T06:10:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:43 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:10:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:10:44.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:10:44.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8782.759776 secs 2023-05-08T06:10:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:43 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:10:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:10:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:10:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8782.759776 secs 2023-05-08T06:10:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:45 smithi133 ceph-mon[125939]: pgmap v4743: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 107 KiB/s wr, 11 op/s 2023-05-08T06:10:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:45 smithi096 ceph-mon[124666]: pgmap v4743: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 107 KiB/s wr, 11 op/s 2023-05-08T06:10:46.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:45 smithi186 ceph-mon[126480]: pgmap v4743: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 107 KiB/s wr, 11 op/s 2023-05-08T06:10:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:46 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:10:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:46 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:10:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:46 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:10:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:47 smithi133 ceph-mon[125939]: pgmap v4744: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 83 KiB/s wr, 9 op/s 2023-05-08T06:10:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:47 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:10:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:47 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:10:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:47 smithi096 ceph-mon[124666]: pgmap v4744: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 83 KiB/s wr, 9 op/s 2023-05-08T06:10:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:47 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:10:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:47 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:10:48.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:47 smithi186 ceph-mon[126480]: pgmap v4744: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 83 KiB/s wr, 9 op/s 2023-05-08T06:10:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:47 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:10:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:47 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:10:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8787.759884 secs 2023-05-08T06:10:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8788.316607 secs 2023-05-08T06:10:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8787.759884 secs 2023-05-08T06:10:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8788.316607 secs 2023-05-08T06:10:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8787.759884 secs 2023-05-08T06:10:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8788.316607 secs 2023-05-08T06:10:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:49 smithi133 ceph-mon[125939]: pgmap v4745: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 83 KiB/s wr, 9 op/s 2023-05-08T06:10:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:49 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:10:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:49 smithi096 ceph-mon[124666]: pgmap v4745: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 83 KiB/s wr, 9 op/s 2023-05-08T06:10:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:49 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:10:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:49 smithi186 ceph-mon[126480]: pgmap v4745: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 83 KiB/s wr, 9 op/s 2023-05-08T06:10:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:49 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:10:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:51 smithi133 ceph-mon[125939]: pgmap v4746: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 92 KiB/s wr, 13 op/s 2023-05-08T06:10:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:10:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:10:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:51 smithi096 ceph-mon[124666]: pgmap v4746: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 92 KiB/s wr, 13 op/s 2023-05-08T06:10:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:10:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:10:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:51 smithi186 ceph-mon[126480]: pgmap v4746: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 92 KiB/s wr, 13 op/s 2023-05-08T06:10:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:10:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:10:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:53 smithi133 ceph-mon[125939]: pgmap v4747: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 60 KiB/s wr, 9 op/s 2023-05-08T06:10:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8792.759964 secs 2023-05-08T06:10:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8793.316724 secs 2023-05-08T06:10:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:53 smithi096 ceph-mon[124666]: pgmap v4747: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 60 KiB/s wr, 9 op/s 2023-05-08T06:10:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8792.759964 secs 2023-05-08T06:10:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8793.316724 secs 2023-05-08T06:10:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:53 smithi186 ceph-mon[126480]: pgmap v4747: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 60 KiB/s wr, 9 op/s 2023-05-08T06:10:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8792.759964 secs 2023-05-08T06:10:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8793.316724 secs 2023-05-08T06:10:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:54 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:10:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:54 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:10:55.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:54 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:10:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:55 smithi133 ceph-mon[125939]: pgmap v4748: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 139 KiB/s wr, 13 op/s 2023-05-08T06:10:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:55 smithi096 ceph-mon[124666]: pgmap v4748: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 139 KiB/s wr, 13 op/s 2023-05-08T06:10:56.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:55 smithi186 ceph-mon[126480]: pgmap v4748: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 139 KiB/s wr, 13 op/s 2023-05-08T06:10:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:57 smithi133 ceph-mon[125939]: pgmap v4749: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 95 KiB/s wr, 9 op/s 2023-05-08T06:10:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:57 smithi096 ceph-mon[124666]: pgmap v4749: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 95 KiB/s wr, 9 op/s 2023-05-08T06:10:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:57 smithi186 ceph-mon[126480]: pgmap v4749: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 95 KiB/s wr, 9 op/s 2023-05-08T06:10:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8797.760086 secs 2023-05-08T06:10:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8798.316835 secs 2023-05-08T06:10:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8797.760086 secs 2023-05-08T06:10:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8798.316835 secs 2023-05-08T06:10:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8797.760086 secs 2023-05-08T06:10:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8798.316835 secs 2023-05-08T06:11:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:10:59 smithi133 ceph-mon[125939]: pgmap v4750: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 92 KiB/s wr, 9 op/s 2023-05-08T06:11:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:10:59 smithi096 ceph-mon[124666]: pgmap v4750: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 92 KiB/s wr, 9 op/s 2023-05-08T06:11:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:10:59 smithi186 ceph-mon[126480]: pgmap v4750: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 92 KiB/s wr, 9 op/s 2023-05-08T06:11:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8799.597999 secs 2023-05-08T06:11:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8799.597999 secs 2023-05-08T06:11:01.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8799.597999 secs 2023-05-08T06:11:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:01 smithi133 ceph-mon[125939]: pgmap v4751: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 95 KiB/s wr, 13 op/s 2023-05-08T06:11:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:01 smithi096 ceph-mon[124666]: pgmap v4751: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 95 KiB/s wr, 13 op/s 2023-05-08T06:11:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:01 smithi186 ceph-mon[126480]: pgmap v4751: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 95 KiB/s wr, 13 op/s 2023-05-08T06:11:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:02 smithi096 ceph-mon[124666]: pgmap v4752: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 85 KiB/s wr, 9 op/s 2023-05-08T06:11:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:02 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:11:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:11:03.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:11:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:02 smithi186 ceph-mon[126480]: pgmap v4752: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 85 KiB/s wr, 9 op/s 2023-05-08T06:11:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:02 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:11:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:11:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:11:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:02 smithi133 ceph-mon[125939]: pgmap v4752: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 85 KiB/s wr, 9 op/s 2023-05-08T06:11:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:02 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:11:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:11:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:11:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8802.760201 secs 2023-05-08T06:11:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8803.316954 secs 2023-05-08T06:11:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8802.760201 secs 2023-05-08T06:11:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8803.316954 secs 2023-05-08T06:11:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8802.760201 secs 2023-05-08T06:11:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8803.316954 secs 2023-05-08T06:11:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:05 smithi133 ceph-mon[125939]: pgmap v4753: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 162 KiB/s wr, 27 op/s 2023-05-08T06:11:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8804.598143 secs 2023-05-08T06:11:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:05 smithi133 ceph-mon[125939]: osdmap e374: 12 total, 12 up, 12 in 2023-05-08T06:11:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:05 smithi096 ceph-mon[124666]: pgmap v4753: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 162 KiB/s wr, 27 op/s 2023-05-08T06:11:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8804.598143 secs 2023-05-08T06:11:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:05 smithi096 ceph-mon[124666]: osdmap e374: 12 total, 12 up, 12 in 2023-05-08T06:11:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:05 smithi186 ceph-mon[126480]: pgmap v4753: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 162 KiB/s wr, 27 op/s 2023-05-08T06:11:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8804.598143 secs 2023-05-08T06:11:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:05 smithi186 ceph-mon[126480]: osdmap e374: 12 total, 12 up, 12 in 2023-05-08T06:11:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:07 smithi133 ceph-mon[125939]: pgmap v4755: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 95 KiB/s wr, 27 op/s 2023-05-08T06:11:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:07 smithi096 ceph-mon[124666]: pgmap v4755: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 95 KiB/s wr, 27 op/s 2023-05-08T06:11:08.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:07 smithi186 ceph-mon[126480]: pgmap v4755: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 95 KiB/s wr, 27 op/s 2023-05-08T06:11:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8807.760323 secs 2023-05-08T06:11:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8808.317049 secs 2023-05-08T06:11:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8807.760323 secs 2023-05-08T06:11:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8808.317049 secs 2023-05-08T06:11:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8807.760323 secs 2023-05-08T06:11:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8808.317049 secs 2023-05-08T06:11:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:09 smithi133 ceph-mon[125939]: pgmap v4756: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 95 KiB/s wr, 27 op/s 2023-05-08T06:11:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:09 smithi096 ceph-mon[124666]: pgmap v4756: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 95 KiB/s wr, 27 op/s 2023-05-08T06:11:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:09 smithi186 ceph-mon[126480]: pgmap v4756: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 95 KiB/s wr, 27 op/s 2023-05-08T06:11:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8809.598264 secs 2023-05-08T06:11:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8809.598264 secs 2023-05-08T06:11:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8809.598264 secs 2023-05-08T06:11:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:11 smithi133 ceph-mon[125939]: pgmap v4757: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 96 KiB/s wr, 26 op/s 2023-05-08T06:11:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:11 smithi096 ceph-mon[124666]: pgmap v4757: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 96 KiB/s wr, 26 op/s 2023-05-08T06:11:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:11 smithi186 ceph-mon[126480]: pgmap v4757: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 96 KiB/s wr, 26 op/s 2023-05-08T06:11:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:13 smithi133 ceph-mon[125939]: pgmap v4758: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 96 KiB/s wr, 26 op/s 2023-05-08T06:11:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8812.760448 secs 2023-05-08T06:11:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8813.317148 secs 2023-05-08T06:11:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:13 smithi096 ceph-mon[124666]: pgmap v4758: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 96 KiB/s wr, 26 op/s 2023-05-08T06:11:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8812.760448 secs 2023-05-08T06:11:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8813.317148 secs 2023-05-08T06:11:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:13 smithi186 ceph-mon[126480]: pgmap v4758: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 96 KiB/s wr, 26 op/s 2023-05-08T06:11:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8812.760448 secs 2023-05-08T06:11:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8813.317148 secs 2023-05-08T06:11:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:15 smithi133 ceph-mon[125939]: pgmap v4759: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 17 KiB/s wr, 8 op/s 2023-05-08T06:11:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8814.598392 secs 2023-05-08T06:11:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:15 smithi133 ceph-mon[125939]: osdmap e375: 12 total, 12 up, 12 in 2023-05-08T06:11:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:15 smithi096 ceph-mon[124666]: pgmap v4759: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 17 KiB/s wr, 8 op/s 2023-05-08T06:11:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8814.598392 secs 2023-05-08T06:11:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:15 smithi096 ceph-mon[124666]: osdmap e375: 12 total, 12 up, 12 in 2023-05-08T06:11:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:15 smithi186 ceph-mon[126480]: pgmap v4759: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 17 KiB/s wr, 8 op/s 2023-05-08T06:11:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8814.598392 secs 2023-05-08T06:11:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:15 smithi186 ceph-mon[126480]: osdmap e375: 12 total, 12 up, 12 in 2023-05-08T06:11:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:17 smithi133 ceph-mon[125939]: pgmap v4761: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 17 KiB/s wr, 8 op/s 2023-05-08T06:11:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:17 smithi096 ceph-mon[124666]: pgmap v4761: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 17 KiB/s wr, 8 op/s 2023-05-08T06:11:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:17 smithi186 ceph-mon[126480]: pgmap v4761: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 17 KiB/s wr, 8 op/s 2023-05-08T06:11:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8817.760578 secs 2023-05-08T06:11:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8818.317263 secs 2023-05-08T06:11:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8817.760578 secs 2023-05-08T06:11:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8818.317263 secs 2023-05-08T06:11:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8817.760578 secs 2023-05-08T06:11:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8818.317263 secs 2023-05-08T06:11:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:19 smithi133 ceph-mon[125939]: pgmap v4762: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 17 KiB/s wr, 8 op/s 2023-05-08T06:11:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:19 smithi096 ceph-mon[124666]: pgmap v4762: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 17 KiB/s wr, 8 op/s 2023-05-08T06:11:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:19 smithi186 ceph-mon[126480]: pgmap v4762: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 17 KiB/s wr, 8 op/s 2023-05-08T06:11:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8819.598506 secs 2023-05-08T06:11:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8819.598506 secs 2023-05-08T06:11:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8819.598506 secs 2023-05-08T06:11:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:21 smithi133 ceph-mon[125939]: pgmap v4763: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 7 op/s 2023-05-08T06:11:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:21 smithi096 ceph-mon[124666]: pgmap v4763: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 7 op/s 2023-05-08T06:11:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:21 smithi186 ceph-mon[126480]: pgmap v4763: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 7 op/s 2023-05-08T06:11:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:23 smithi133 ceph-mon[125939]: pgmap v4764: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 7 op/s 2023-05-08T06:11:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8822.760724 secs 2023-05-08T06:11:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8823.317377 secs 2023-05-08T06:11:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:23 smithi096 ceph-mon[124666]: pgmap v4764: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 7 op/s 2023-05-08T06:11:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8822.760724 secs 2023-05-08T06:11:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8823.317377 secs 2023-05-08T06:11:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:23 smithi186 ceph-mon[126480]: pgmap v4764: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 7 op/s 2023-05-08T06:11:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8822.760724 secs 2023-05-08T06:11:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8823.317377 secs 2023-05-08T06:11:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:25 smithi133 ceph-mon[125939]: pgmap v4765: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 30 KiB/s wr, 8 op/s 2023-05-08T06:11:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8824.598571 secs 2023-05-08T06:11:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:25 smithi096 ceph-mon[124666]: pgmap v4765: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 30 KiB/s wr, 8 op/s 2023-05-08T06:11:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8824.598571 secs 2023-05-08T06:11:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:25 smithi186 ceph-mon[126480]: pgmap v4765: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 30 KiB/s wr, 8 op/s 2023-05-08T06:11:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8824.598571 secs 2023-05-08T06:11:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:11:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:11:27.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:11:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:27 smithi133 ceph-mon[125939]: pgmap v4766: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 26 KiB/s wr, 7 op/s 2023-05-08T06:11:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:11:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:11:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:11:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:27 smithi096 ceph-mon[124666]: pgmap v4766: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 26 KiB/s wr, 7 op/s 2023-05-08T06:11:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:11:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:11:28.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:11:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:27 smithi186 ceph-mon[126480]: pgmap v4766: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 26 KiB/s wr, 7 op/s 2023-05-08T06:11:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:11:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:11:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:11:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:28 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:11:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:28 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T06:11:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:28 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T06:11:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:28 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:11:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8827.760843 secs 2023-05-08T06:11:29.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8828.317500 secs 2023-05-08T06:11:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:28 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:11:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:28 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T06:11:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:28 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T06:11:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:28 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:11:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8827.760843 secs 2023-05-08T06:11:29.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8828.317500 secs 2023-05-08T06:11:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:28 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:11:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:28 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T06:11:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:28 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T06:11:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:28 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:11:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8827.760843 secs 2023-05-08T06:11:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8828.317500 secs 2023-05-08T06:11:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:29 smithi133 ceph-mon[125939]: pgmap v4767: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 25 KiB/s wr, 6 op/s 2023-05-08T06:11:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:29 smithi096 ceph-mon[124666]: pgmap v4767: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 25 KiB/s wr, 6 op/s 2023-05-08T06:11:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:29 smithi186 ceph-mon[126480]: pgmap v4767: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 25 KiB/s wr, 6 op/s 2023-05-08T06:11:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8829.598700 secs 2023-05-08T06:11:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8829.598700 secs 2023-05-08T06:11:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8829.598700 secs 2023-05-08T06:11:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:31 smithi133 ceph-mon[125939]: pgmap v4768: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 10 op/s 2023-05-08T06:11:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:31 smithi096 ceph-mon[124666]: pgmap v4768: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 10 op/s 2023-05-08T06:11:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:31 smithi186 ceph-mon[126480]: pgmap v4768: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 10 op/s 2023-05-08T06:11:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:33 smithi133 ceph-mon[125939]: pgmap v4769: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 28 KiB/s wr, 6 op/s 2023-05-08T06:11:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8832.760956 secs 2023-05-08T06:11:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8833.317560 secs 2023-05-08T06:11:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:33 smithi096 ceph-mon[124666]: pgmap v4769: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 28 KiB/s wr, 6 op/s 2023-05-08T06:11:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8832.760956 secs 2023-05-08T06:11:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8833.317560 secs 2023-05-08T06:11:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:33 smithi186 ceph-mon[126480]: pgmap v4769: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 28 KiB/s wr, 6 op/s 2023-05-08T06:11:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8832.760956 secs 2023-05-08T06:11:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8833.317560 secs 2023-05-08T06:11:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:35 smithi133 ceph-mon[125939]: pgmap v4770: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 56 KiB/s wr, 9 op/s 2023-05-08T06:11:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8834.598807 secs 2023-05-08T06:11:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:35 smithi096 ceph-mon[124666]: pgmap v4770: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 56 KiB/s wr, 9 op/s 2023-05-08T06:11:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8834.598807 secs 2023-05-08T06:11:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:35 smithi186 ceph-mon[126480]: pgmap v4770: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 56 KiB/s wr, 9 op/s 2023-05-08T06:11:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8834.598807 secs 2023-05-08T06:11:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:37 smithi133 ceph-mon[125939]: pgmap v4771: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 32 KiB/s wr, 7 op/s 2023-05-08T06:11:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:37 smithi096 ceph-mon[124666]: pgmap v4771: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 32 KiB/s wr, 7 op/s 2023-05-08T06:11:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:37 smithi186 ceph-mon[126480]: pgmap v4771: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 32 KiB/s wr, 7 op/s 2023-05-08T06:11:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8837.761098 secs 2023-05-08T06:11:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8837.761098 secs 2023-05-08T06:11:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8837.761098 secs 2023-05-08T06:11:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:39 smithi133 ceph-mon[125939]: pgmap v4772: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T06:11:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:39 smithi096 ceph-mon[124666]: pgmap v4772: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T06:11:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:39 smithi186 ceph-mon[126480]: pgmap v4772: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T06:11:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8839.598901 secs 2023-05-08T06:11:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:40 smithi133 ceph-mon[125939]: pgmap v4773: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 64 KiB/s wr, 10 op/s 2023-05-08T06:11:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8839.598901 secs 2023-05-08T06:11:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:40 smithi096 ceph-mon[124666]: pgmap v4773: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 64 KiB/s wr, 10 op/s 2023-05-08T06:11:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8839.598901 secs 2023-05-08T06:11:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:40 smithi186 ceph-mon[126480]: pgmap v4773: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 64 KiB/s wr, 10 op/s 2023-05-08T06:11:42.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:11:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:11:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:11:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:43 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:11:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:11:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:11:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:43 smithi186 ceph-mon[126480]: pgmap v4774: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 61 KiB/s wr, 7 op/s 2023-05-08T06:11:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8842.761222 secs 2023-05-08T06:11:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:43 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:11:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:11:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:11:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:43 smithi133 ceph-mon[125939]: pgmap v4774: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 61 KiB/s wr, 7 op/s 2023-05-08T06:11:43.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8842.761222 secs 2023-05-08T06:11:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:43 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:11:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:11:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:11:43.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:43 smithi096 ceph-mon[124666]: pgmap v4774: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 61 KiB/s wr, 7 op/s 2023-05-08T06:11:43.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8842.761222 secs 2023-05-08T06:11:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:45 smithi133 ceph-mon[125939]: pgmap v4775: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 110 KiB/s wr, 11 op/s 2023-05-08T06:11:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:45 smithi096 ceph-mon[124666]: pgmap v4775: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 110 KiB/s wr, 11 op/s 2023-05-08T06:11:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:45 smithi186 ceph-mon[126480]: pgmap v4775: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 110 KiB/s wr, 11 op/s 2023-05-08T06:11:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:46 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:11:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:46 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:11:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:46 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:11:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:47 smithi133 ceph-mon[125939]: pgmap v4776: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 85 KiB/s wr, 9 op/s 2023-05-08T06:11:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:47 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:11:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:47 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:11:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:47 smithi096 ceph-mon[124666]: pgmap v4776: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 85 KiB/s wr, 9 op/s 2023-05-08T06:11:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:47 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:11:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:47 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:11:48.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:47 smithi186 ceph-mon[126480]: pgmap v4776: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 85 KiB/s wr, 9 op/s 2023-05-08T06:11:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:47 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:11:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:47 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:11:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8847.761374 secs 2023-05-08T06:11:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8848.317869 secs 2023-05-08T06:11:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8847.761374 secs 2023-05-08T06:11:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8848.317869 secs 2023-05-08T06:11:49.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8847.761374 secs 2023-05-08T06:11:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8848.317869 secs 2023-05-08T06:11:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:49 smithi133 ceph-mon[125939]: pgmap v4777: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 85 KiB/s wr, 9 op/s 2023-05-08T06:11:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:49 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:11:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:49 smithi096 ceph-mon[124666]: pgmap v4777: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 85 KiB/s wr, 9 op/s 2023-05-08T06:11:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:49 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:11:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:49 smithi186 ceph-mon[126480]: pgmap v4777: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 85 KiB/s wr, 9 op/s 2023-05-08T06:11:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:49 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:11:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:51 smithi133 ceph-mon[125939]: pgmap v4778: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 88 KiB/s wr, 13 op/s 2023-05-08T06:11:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:11:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:11:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:51 smithi096 ceph-mon[124666]: pgmap v4778: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 88 KiB/s wr, 13 op/s 2023-05-08T06:11:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:11:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:11:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:51 smithi186 ceph-mon[126480]: pgmap v4778: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 88 KiB/s wr, 13 op/s 2023-05-08T06:11:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:11:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:11:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:53 smithi133 ceph-mon[125939]: pgmap v4779: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 56 KiB/s wr, 9 op/s 2023-05-08T06:11:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8852.761496 secs 2023-05-08T06:11:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8853.318020 secs 2023-05-08T06:11:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:53 smithi096 ceph-mon[124666]: pgmap v4779: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 56 KiB/s wr, 9 op/s 2023-05-08T06:11:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8852.761496 secs 2023-05-08T06:11:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8853.318020 secs 2023-05-08T06:11:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:53 smithi186 ceph-mon[126480]: pgmap v4779: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 56 KiB/s wr, 9 op/s 2023-05-08T06:11:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8852.761496 secs 2023-05-08T06:11:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8853.318020 secs 2023-05-08T06:11:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:54 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:11:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:54 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:11:55.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:54 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:11:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:55 smithi133 ceph-mon[125939]: pgmap v4780: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 108 KiB/s wr, 12 op/s 2023-05-08T06:11:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:55 smithi096 ceph-mon[124666]: pgmap v4780: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 108 KiB/s wr, 12 op/s 2023-05-08T06:11:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:55 smithi186 ceph-mon[126480]: pgmap v4780: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 108 KiB/s wr, 12 op/s 2023-05-08T06:11:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:57 smithi133 ceph-mon[125939]: pgmap v4781: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 62 KiB/s wr, 8 op/s 2023-05-08T06:11:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:57 smithi096 ceph-mon[124666]: pgmap v4781: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 62 KiB/s wr, 8 op/s 2023-05-08T06:11:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:57 smithi186 ceph-mon[126480]: pgmap v4781: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 62 KiB/s wr, 8 op/s 2023-05-08T06:11:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8857.761562 secs 2023-05-08T06:11:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8858.318135 secs 2023-05-08T06:11:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8857.761562 secs 2023-05-08T06:11:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8858.318135 secs 2023-05-08T06:11:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8857.761562 secs 2023-05-08T06:11:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8858.318135 secs 2023-05-08T06:12:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:11:59 smithi133 ceph-mon[125939]: pgmap v4782: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 58 KiB/s wr, 8 op/s 2023-05-08T06:12:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:11:59 smithi096 ceph-mon[124666]: pgmap v4782: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 58 KiB/s wr, 8 op/s 2023-05-08T06:12:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:11:59 smithi186 ceph-mon[126480]: pgmap v4782: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 58 KiB/s wr, 8 op/s 2023-05-08T06:12:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8859.599347 secs 2023-05-08T06:12:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8859.599347 secs 2023-05-08T06:12:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8859.599347 secs 2023-05-08T06:12:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:01 smithi133 ceph-mon[125939]: pgmap v4783: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 61 KiB/s wr, 12 op/s 2023-05-08T06:12:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:01 smithi096 ceph-mon[124666]: pgmap v4783: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 61 KiB/s wr, 12 op/s 2023-05-08T06:12:02.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:01 smithi186 ceph-mon[126480]: pgmap v4783: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 61 KiB/s wr, 12 op/s 2023-05-08T06:12:03.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:03 smithi186 ceph-mon[126480]: pgmap v4784: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 8 op/s 2023-05-08T06:12:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:03 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:12:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:12:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:03 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:12:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:03 smithi133 ceph-mon[125939]: pgmap v4784: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 8 op/s 2023-05-08T06:12:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:03 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:12:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:12:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:03 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:12:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:03 smithi096 ceph-mon[124666]: pgmap v4784: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 8 op/s 2023-05-08T06:12:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:03 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:12:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:12:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:03 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:12:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8862.761679 secs 2023-05-08T06:12:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8863.318234 secs 2023-05-08T06:12:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8862.761679 secs 2023-05-08T06:12:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8863.318234 secs 2023-05-08T06:12:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8862.761679 secs 2023-05-08T06:12:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8863.318234 secs 2023-05-08T06:12:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:05 smithi133 ceph-mon[125939]: pgmap v4785: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 136 KiB/s wr, 25 op/s 2023-05-08T06:12:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8864.599498 secs 2023-05-08T06:12:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:05 smithi133 ceph-mon[125939]: osdmap e376: 12 total, 12 up, 12 in 2023-05-08T06:12:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:05 smithi096 ceph-mon[124666]: pgmap v4785: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 136 KiB/s wr, 25 op/s 2023-05-08T06:12:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8864.599498 secs 2023-05-08T06:12:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:05 smithi096 ceph-mon[124666]: osdmap e376: 12 total, 12 up, 12 in 2023-05-08T06:12:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:05 smithi186 ceph-mon[126480]: pgmap v4785: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 136 KiB/s wr, 25 op/s 2023-05-08T06:12:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8864.599498 secs 2023-05-08T06:12:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:05 smithi186 ceph-mon[126480]: osdmap e376: 12 total, 12 up, 12 in 2023-05-08T06:12:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:07 smithi133 ceph-mon[125939]: pgmap v4787: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 96 KiB/s wr, 26 op/s 2023-05-08T06:12:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:07 smithi096 ceph-mon[124666]: pgmap v4787: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 96 KiB/s wr, 26 op/s 2023-05-08T06:12:08.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:07 smithi186 ceph-mon[126480]: pgmap v4787: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 96 KiB/s wr, 26 op/s 2023-05-08T06:12:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8867.761765 secs 2023-05-08T06:12:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8868.318357 secs 2023-05-08T06:12:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8867.761765 secs 2023-05-08T06:12:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8868.318357 secs 2023-05-08T06:12:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8867.761765 secs 2023-05-08T06:12:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8868.318357 secs 2023-05-08T06:12:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:09 smithi133 ceph-mon[125939]: pgmap v4788: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 96 KiB/s wr, 26 op/s 2023-05-08T06:12:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:09 smithi096 ceph-mon[124666]: pgmap v4788: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 96 KiB/s wr, 26 op/s 2023-05-08T06:12:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:09 smithi186 ceph-mon[126480]: pgmap v4788: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 96 KiB/s wr, 26 op/s 2023-05-08T06:12:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8869.599640 secs 2023-05-08T06:12:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8869.599640 secs 2023-05-08T06:12:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8869.599640 secs 2023-05-08T06:12:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:11 smithi133 ceph-mon[125939]: pgmap v4789: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 98 KiB/s wr, 26 op/s 2023-05-08T06:12:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:11 smithi096 ceph-mon[124666]: pgmap v4789: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 98 KiB/s wr, 26 op/s 2023-05-08T06:12:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:11 smithi186 ceph-mon[126480]: pgmap v4789: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 98 KiB/s wr, 26 op/s 2023-05-08T06:12:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:13 smithi133 ceph-mon[125939]: pgmap v4790: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 98 KiB/s wr, 26 op/s 2023-05-08T06:12:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8872.761856 secs 2023-05-08T06:12:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8873.318494 secs 2023-05-08T06:12:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:13 smithi096 ceph-mon[124666]: pgmap v4790: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 98 KiB/s wr, 26 op/s 2023-05-08T06:12:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8872.761856 secs 2023-05-08T06:12:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8873.318494 secs 2023-05-08T06:12:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:13 smithi186 ceph-mon[126480]: pgmap v4790: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 98 KiB/s wr, 26 op/s 2023-05-08T06:12:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8872.761856 secs 2023-05-08T06:12:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8873.318494 secs 2023-05-08T06:12:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:15 smithi133 ceph-mon[125939]: pgmap v4791: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 18 KiB/s wr, 9 op/s 2023-05-08T06:12:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8874.599765 secs 2023-05-08T06:12:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:15 smithi133 ceph-mon[125939]: osdmap e377: 12 total, 12 up, 12 in 2023-05-08T06:12:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:15 smithi096 ceph-mon[124666]: pgmap v4791: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 18 KiB/s wr, 9 op/s 2023-05-08T06:12:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8874.599765 secs 2023-05-08T06:12:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:15 smithi096 ceph-mon[124666]: osdmap e377: 12 total, 12 up, 12 in 2023-05-08T06:12:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:15 smithi186 ceph-mon[126480]: pgmap v4791: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 18 KiB/s wr, 9 op/s 2023-05-08T06:12:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8874.599765 secs 2023-05-08T06:12:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:15 smithi186 ceph-mon[126480]: osdmap e377: 12 total, 12 up, 12 in 2023-05-08T06:12:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:17 smithi133 ceph-mon[125939]: pgmap v4793: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 22 KiB/s wr, 9 op/s 2023-05-08T06:12:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:17 smithi096 ceph-mon[124666]: pgmap v4793: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 22 KiB/s wr, 9 op/s 2023-05-08T06:12:18.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:17 smithi186 ceph-mon[126480]: pgmap v4793: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 22 KiB/s wr, 9 op/s 2023-05-08T06:12:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8877.761979 secs 2023-05-08T06:12:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8878.318576 secs 2023-05-08T06:12:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8877.761979 secs 2023-05-08T06:12:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8878.318576 secs 2023-05-08T06:12:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8877.761979 secs 2023-05-08T06:12:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8878.318576 secs 2023-05-08T06:12:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:19 smithi133 ceph-mon[125939]: pgmap v4794: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 22 KiB/s wr, 9 op/s 2023-05-08T06:12:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:19 smithi096 ceph-mon[124666]: pgmap v4794: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 22 KiB/s wr, 9 op/s 2023-05-08T06:12:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:19 smithi186 ceph-mon[126480]: pgmap v4794: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 22 KiB/s wr, 9 op/s 2023-05-08T06:12:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8879.599818 secs 2023-05-08T06:12:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8879.599818 secs 2023-05-08T06:12:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8879.599818 secs 2023-05-08T06:12:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:21 smithi133 ceph-mon[125939]: pgmap v4795: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 8 op/s 2023-05-08T06:12:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:21 smithi096 ceph-mon[124666]: pgmap v4795: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 8 op/s 2023-05-08T06:12:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:21 smithi186 ceph-mon[126480]: pgmap v4795: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 8 op/s 2023-05-08T06:12:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:23 smithi133 ceph-mon[125939]: pgmap v4796: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 8 op/s 2023-05-08T06:12:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8882.762071 secs 2023-05-08T06:12:24.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8883.318688 secs 2023-05-08T06:12:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:23 smithi096 ceph-mon[124666]: pgmap v4796: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 8 op/s 2023-05-08T06:12:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8882.762071 secs 2023-05-08T06:12:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8883.318688 secs 2023-05-08T06:12:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:23 smithi186 ceph-mon[126480]: pgmap v4796: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 8 op/s 2023-05-08T06:12:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8882.762071 secs 2023-05-08T06:12:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8883.318688 secs 2023-05-08T06:12:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:25 smithi133 ceph-mon[125939]: pgmap v4797: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 52 KiB/s wr, 8 op/s 2023-05-08T06:12:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8884.599938 secs 2023-05-08T06:12:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:25 smithi096 ceph-mon[124666]: pgmap v4797: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 52 KiB/s wr, 8 op/s 2023-05-08T06:12:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8884.599938 secs 2023-05-08T06:12:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:25 smithi186 ceph-mon[126480]: pgmap v4797: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 52 KiB/s wr, 8 op/s 2023-05-08T06:12:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8884.599938 secs 2023-05-08T06:12:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:27 smithi133 ceph-mon[125939]: pgmap v4798: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 44 KiB/s wr, 7 op/s 2023-05-08T06:12:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:12:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:27 smithi096 ceph-mon[124666]: pgmap v4798: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 44 KiB/s wr, 7 op/s 2023-05-08T06:12:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:12:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:27 smithi186 ceph-mon[126480]: pgmap v4798: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 44 KiB/s wr, 7 op/s 2023-05-08T06:12:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:12:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8887.762231 secs 2023-05-08T06:12:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8888.318789 secs 2023-05-08T06:12:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8887.762231 secs 2023-05-08T06:12:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8888.318789 secs 2023-05-08T06:12:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8887.762231 secs 2023-05-08T06:12:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8888.318789 secs 2023-05-08T06:12:30.231 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:29 smithi096 ceph-mon[124666]: pgmap v4799: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 40 KiB/s wr, 7 op/s 2023-05-08T06:12:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:29 smithi133 ceph-mon[125939]: pgmap v4799: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 40 KiB/s wr, 7 op/s 2023-05-08T06:12:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:29 smithi186 ceph-mon[126480]: pgmap v4799: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 40 KiB/s wr, 7 op/s 2023-05-08T06:12:31.140 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8889.600005 secs 2023-05-08T06:12:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8889.600005 secs 2023-05-08T06:12:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8889.600005 secs 2023-05-08T06:12:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:31 smithi133 ceph-mon[125939]: pgmap v4800: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 43 KiB/s wr, 11 op/s 2023-05-08T06:12:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:31 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:12:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:31 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:12:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:31 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:12:32.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:31 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:12:32.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:31 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:12:32.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:31 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:12:32.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:31 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:12:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:31 smithi096 ceph-mon[124666]: pgmap v4800: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 43 KiB/s wr, 11 op/s 2023-05-08T06:12:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:31 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:12:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:31 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:12:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:31 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:12:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:31 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:12:32.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:31 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:12:32.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:31 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:12:32.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:31 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:12:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:31 smithi186 ceph-mon[126480]: pgmap v4800: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 43 KiB/s wr, 11 op/s 2023-05-08T06:12:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:31 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:12:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:31 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:12:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:31 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:12:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:31 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:12:32.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:31 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:12:32.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:31 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:12:32.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:31 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:12:33.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:32 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:12:33.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:32 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T06:12:33.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:32 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T06:12:33.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:32 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:12:33.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:32 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:12:33.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:32 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T06:12:33.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:32 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T06:12:33.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:32 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:12:33.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:32 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:12:33.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:32 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T06:12:33.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:32 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T06:12:33.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:32 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:12:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:33 smithi133 ceph-mon[125939]: pgmap v4801: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 43 KiB/s wr, 8 op/s 2023-05-08T06:12:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8892.762365 secs 2023-05-08T06:12:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8893.318910 secs 2023-05-08T06:12:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:33 smithi096 ceph-mon[124666]: pgmap v4801: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 43 KiB/s wr, 8 op/s 2023-05-08T06:12:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8892.762365 secs 2023-05-08T06:12:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8893.318910 secs 2023-05-08T06:12:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:33 smithi186 ceph-mon[126480]: pgmap v4801: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 43 KiB/s wr, 8 op/s 2023-05-08T06:12:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8892.762365 secs 2023-05-08T06:12:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8893.318910 secs 2023-05-08T06:12:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:35 smithi133 ceph-mon[125939]: pgmap v4802: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 72 KiB/s wr, 10 op/s 2023-05-08T06:12:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8894.600123 secs 2023-05-08T06:12:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:35 smithi096 ceph-mon[124666]: pgmap v4802: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 72 KiB/s wr, 10 op/s 2023-05-08T06:12:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8894.600123 secs 2023-05-08T06:12:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:35 smithi186 ceph-mon[126480]: pgmap v4802: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 72 KiB/s wr, 10 op/s 2023-05-08T06:12:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8894.600123 secs 2023-05-08T06:12:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:37 smithi133 ceph-mon[125939]: pgmap v4803: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 32 KiB/s wr, 7 op/s 2023-05-08T06:12:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:37 smithi096 ceph-mon[124666]: pgmap v4803: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 32 KiB/s wr, 7 op/s 2023-05-08T06:12:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:37 smithi186 ceph-mon[126480]: pgmap v4803: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 32 KiB/s wr, 7 op/s 2023-05-08T06:12:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8897.762441 secs 2023-05-08T06:12:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8897.762441 secs 2023-05-08T06:12:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8897.762441 secs 2023-05-08T06:12:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:39 smithi133 ceph-mon[125939]: pgmap v4804: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 32 KiB/s wr, 7 op/s 2023-05-08T06:12:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:39 smithi096 ceph-mon[124666]: pgmap v4804: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 32 KiB/s wr, 7 op/s 2023-05-08T06:12:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:39 smithi186 ceph-mon[126480]: pgmap v4804: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 32 KiB/s wr, 7 op/s 2023-05-08T06:12:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8899.600181 secs 2023-05-08T06:12:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:40 smithi096 ceph-mon[124666]: pgmap v4805: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 65 KiB/s wr, 11 op/s 2023-05-08T06:12:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8899.600181 secs 2023-05-08T06:12:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:40 smithi186 ceph-mon[126480]: pgmap v4805: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 65 KiB/s wr, 11 op/s 2023-05-08T06:12:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8899.600181 secs 2023-05-08T06:12:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:40 smithi133 ceph-mon[125939]: pgmap v4805: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 65 KiB/s wr, 11 op/s 2023-05-08T06:12:42.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:12:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:12:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:12:43.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:43 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:12:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:12:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:12:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:43 smithi186 ceph-mon[126480]: pgmap v4806: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 62 KiB/s wr, 7 op/s 2023-05-08T06:12:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8902.762551 secs 2023-05-08T06:12:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:43 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:12:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:12:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:12:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:43 smithi133 ceph-mon[125939]: pgmap v4806: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 62 KiB/s wr, 7 op/s 2023-05-08T06:12:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8902.762551 secs 2023-05-08T06:12:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:43 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:12:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:12:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:12:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:43 smithi096 ceph-mon[124666]: pgmap v4806: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 62 KiB/s wr, 7 op/s 2023-05-08T06:12:43.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8902.762551 secs 2023-05-08T06:12:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:45 smithi133 ceph-mon[125939]: pgmap v4807: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 112 KiB/s wr, 11 op/s 2023-05-08T06:12:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8904.600256 secs 2023-05-08T06:12:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:45 smithi096 ceph-mon[124666]: pgmap v4807: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 112 KiB/s wr, 11 op/s 2023-05-08T06:12:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8904.600256 secs 2023-05-08T06:12:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:45 smithi186 ceph-mon[126480]: pgmap v4807: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 112 KiB/s wr, 11 op/s 2023-05-08T06:12:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8904.600256 secs 2023-05-08T06:12:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:47 smithi133 ceph-mon[125939]: pgmap v4808: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 87 KiB/s wr, 9 op/s 2023-05-08T06:12:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:47 smithi096 ceph-mon[124666]: pgmap v4808: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 87 KiB/s wr, 9 op/s 2023-05-08T06:12:48.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:47 smithi186 ceph-mon[126480]: pgmap v4808: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 87 KiB/s wr, 9 op/s 2023-05-08T06:12:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8907.762676 secs 2023-05-08T06:12:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8908.319251 secs 2023-05-08T06:12:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8907.762676 secs 2023-05-08T06:12:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8908.319251 secs 2023-05-08T06:12:49.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8907.762676 secs 2023-05-08T06:12:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8908.319251 secs 2023-05-08T06:12:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:49 smithi133 ceph-mon[125939]: pgmap v4809: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 87 KiB/s wr, 9 op/s 2023-05-08T06:12:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:49 smithi096 ceph-mon[124666]: pgmap v4809: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 87 KiB/s wr, 9 op/s 2023-05-08T06:12:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:49 smithi186 ceph-mon[126480]: pgmap v4809: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 87 KiB/s wr, 9 op/s 2023-05-08T06:12:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:50 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:12:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:50 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:12:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:50 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:12:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:51 smithi133 ceph-mon[125939]: pgmap v4810: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 90 KiB/s wr, 13 op/s 2023-05-08T06:12:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:12:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:12:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:12:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:51 smithi096 ceph-mon[124666]: pgmap v4810: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 90 KiB/s wr, 13 op/s 2023-05-08T06:12:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:12:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:12:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:12:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:51 smithi186 ceph-mon[126480]: pgmap v4810: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 90 KiB/s wr, 13 op/s 2023-05-08T06:12:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:12:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:12:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:12:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:53 smithi133 ceph-mon[125939]: pgmap v4811: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 57 KiB/s wr, 9 op/s 2023-05-08T06:12:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8912.762721 secs 2023-05-08T06:12:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8913.319386 secs 2023-05-08T06:12:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:53 smithi096 ceph-mon[124666]: pgmap v4811: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 57 KiB/s wr, 9 op/s 2023-05-08T06:12:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8912.762721 secs 2023-05-08T06:12:54.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8913.319386 secs 2023-05-08T06:12:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:53 smithi186 ceph-mon[126480]: pgmap v4811: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 57 KiB/s wr, 9 op/s 2023-05-08T06:12:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8912.762721 secs 2023-05-08T06:12:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8913.319386 secs 2023-05-08T06:12:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:55 smithi133 ceph-mon[125939]: pgmap v4812: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 110 KiB/s wr, 12 op/s 2023-05-08T06:12:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:55 smithi096 ceph-mon[124666]: pgmap v4812: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 110 KiB/s wr, 12 op/s 2023-05-08T06:12:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:55 smithi186 ceph-mon[126480]: pgmap v4812: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 110 KiB/s wr, 12 op/s 2023-05-08T06:12:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:57 smithi133 ceph-mon[125939]: pgmap v4813: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 63 KiB/s wr, 8 op/s 2023-05-08T06:12:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:57 smithi096 ceph-mon[124666]: pgmap v4813: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 63 KiB/s wr, 8 op/s 2023-05-08T06:12:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:57 smithi186 ceph-mon[126480]: pgmap v4813: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 63 KiB/s wr, 8 op/s 2023-05-08T06:12:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8917.762844 secs 2023-05-08T06:12:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8918.319461 secs 2023-05-08T06:12:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8917.762844 secs 2023-05-08T06:12:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8918.319461 secs 2023-05-08T06:12:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8917.762844 secs 2023-05-08T06:12:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8918.319461 secs 2023-05-08T06:13:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:12:59 smithi133 ceph-mon[125939]: pgmap v4814: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 60 KiB/s wr, 7 op/s 2023-05-08T06:13:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:12:59 smithi096 ceph-mon[124666]: pgmap v4814: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 60 KiB/s wr, 7 op/s 2023-05-08T06:13:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:12:59 smithi186 ceph-mon[126480]: pgmap v4814: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 60 KiB/s wr, 7 op/s 2023-05-08T06:13:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8919.600541 secs 2023-05-08T06:13:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8919.600541 secs 2023-05-08T06:13:01.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8919.600541 secs 2023-05-08T06:13:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:01 smithi133 ceph-mon[125939]: pgmap v4815: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 65 KiB/s wr, 11 op/s 2023-05-08T06:13:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:01 smithi096 ceph-mon[124666]: pgmap v4815: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 65 KiB/s wr, 11 op/s 2023-05-08T06:13:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:01 smithi186 ceph-mon[126480]: pgmap v4815: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 65 KiB/s wr, 11 op/s 2023-05-08T06:13:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:03 smithi186 ceph-mon[126480]: pgmap v4816: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 62 KiB/s wr, 7 op/s 2023-05-08T06:13:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:03 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:13:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:13:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:03 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:13:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:03 smithi133 ceph-mon[125939]: pgmap v4816: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 62 KiB/s wr, 7 op/s 2023-05-08T06:13:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:03 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:13:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:13:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:03 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:13:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:03 smithi096 ceph-mon[124666]: pgmap v4816: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 62 KiB/s wr, 7 op/s 2023-05-08T06:13:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:03 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:13:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:13:03.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:03 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:13:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8922.762939 secs 2023-05-08T06:13:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8923.319528 secs 2023-05-08T06:13:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8922.762939 secs 2023-05-08T06:13:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8923.319528 secs 2023-05-08T06:13:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8922.762939 secs 2023-05-08T06:13:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8923.319528 secs 2023-05-08T06:13:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:05 smithi133 ceph-mon[125939]: pgmap v4817: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 140 KiB/s wr, 25 op/s 2023-05-08T06:13:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8924.600641 secs 2023-05-08T06:13:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:05 smithi133 ceph-mon[125939]: osdmap e378: 12 total, 12 up, 12 in 2023-05-08T06:13:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:05 smithi096 ceph-mon[124666]: pgmap v4817: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 140 KiB/s wr, 25 op/s 2023-05-08T06:13:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8924.600641 secs 2023-05-08T06:13:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:05 smithi096 ceph-mon[124666]: osdmap e378: 12 total, 12 up, 12 in 2023-05-08T06:13:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:05 smithi186 ceph-mon[126480]: pgmap v4817: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 140 KiB/s wr, 25 op/s 2023-05-08T06:13:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8924.600641 secs 2023-05-08T06:13:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:05 smithi186 ceph-mon[126480]: osdmap e378: 12 total, 12 up, 12 in 2023-05-08T06:13:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:07 smithi133 ceph-mon[125939]: pgmap v4819: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 100 KiB/s wr, 26 op/s 2023-05-08T06:13:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:07 smithi096 ceph-mon[124666]: pgmap v4819: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 100 KiB/s wr, 26 op/s 2023-05-08T06:13:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:07 smithi186 ceph-mon[126480]: pgmap v4819: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 100 KiB/s wr, 26 op/s 2023-05-08T06:13:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8927.763085 secs 2023-05-08T06:13:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8928.319650 secs 2023-05-08T06:13:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8927.763085 secs 2023-05-08T06:13:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8928.319650 secs 2023-05-08T06:13:09.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8927.763085 secs 2023-05-08T06:13:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8928.319650 secs 2023-05-08T06:13:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:09 smithi133 ceph-mon[125939]: pgmap v4820: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 100 KiB/s wr, 26 op/s 2023-05-08T06:13:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:09 smithi096 ceph-mon[124666]: pgmap v4820: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 100 KiB/s wr, 26 op/s 2023-05-08T06:13:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:09 smithi186 ceph-mon[126480]: pgmap v4820: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 100 KiB/s wr, 26 op/s 2023-05-08T06:13:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8929.600750 secs 2023-05-08T06:13:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8929.600750 secs 2023-05-08T06:13:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8929.600750 secs 2023-05-08T06:13:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:11 smithi133 ceph-mon[125939]: pgmap v4821: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 99 KiB/s wr, 26 op/s 2023-05-08T06:13:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:11 smithi096 ceph-mon[124666]: pgmap v4821: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 99 KiB/s wr, 26 op/s 2023-05-08T06:13:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:11 smithi186 ceph-mon[126480]: pgmap v4821: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 99 KiB/s wr, 26 op/s 2023-05-08T06:13:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:13 smithi133 ceph-mon[125939]: pgmap v4822: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 99 KiB/s wr, 26 op/s 2023-05-08T06:13:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8932.763203 secs 2023-05-08T06:13:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8933.319791 secs 2023-05-08T06:13:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:13 smithi096 ceph-mon[124666]: pgmap v4822: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 99 KiB/s wr, 26 op/s 2023-05-08T06:13:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8932.763203 secs 2023-05-08T06:13:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8933.319791 secs 2023-05-08T06:13:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:13 smithi186 ceph-mon[126480]: pgmap v4822: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 99 KiB/s wr, 26 op/s 2023-05-08T06:13:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8932.763203 secs 2023-05-08T06:13:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8933.319791 secs 2023-05-08T06:13:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:15 smithi133 ceph-mon[125939]: pgmap v4823: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 18 KiB/s wr, 8 op/s 2023-05-08T06:13:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8934.600871 secs 2023-05-08T06:13:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:15 smithi133 ceph-mon[125939]: osdmap e379: 12 total, 12 up, 12 in 2023-05-08T06:13:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:15 smithi096 ceph-mon[124666]: pgmap v4823: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 18 KiB/s wr, 8 op/s 2023-05-08T06:13:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8934.600871 secs 2023-05-08T06:13:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:15 smithi096 ceph-mon[124666]: osdmap e379: 12 total, 12 up, 12 in 2023-05-08T06:13:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:15 smithi186 ceph-mon[126480]: pgmap v4823: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 18 KiB/s wr, 8 op/s 2023-05-08T06:13:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8934.600871 secs 2023-05-08T06:13:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:15 smithi186 ceph-mon[126480]: osdmap e379: 12 total, 12 up, 12 in 2023-05-08T06:13:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:17 smithi133 ceph-mon[125939]: pgmap v4825: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 22 KiB/s wr, 9 op/s 2023-05-08T06:13:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:17 smithi096 ceph-mon[124666]: pgmap v4825: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 22 KiB/s wr, 9 op/s 2023-05-08T06:13:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:17 smithi186 ceph-mon[126480]: pgmap v4825: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 22 KiB/s wr, 9 op/s 2023-05-08T06:13:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8937.763368 secs 2023-05-08T06:13:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8938.319910 secs 2023-05-08T06:13:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8937.763368 secs 2023-05-08T06:13:19.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8938.319910 secs 2023-05-08T06:13:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8937.763368 secs 2023-05-08T06:13:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8938.319910 secs 2023-05-08T06:13:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:19 smithi133 ceph-mon[125939]: pgmap v4826: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 22 KiB/s wr, 9 op/s 2023-05-08T06:13:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:19 smithi096 ceph-mon[124666]: pgmap v4826: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 22 KiB/s wr, 9 op/s 2023-05-08T06:13:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:19 smithi186 ceph-mon[126480]: pgmap v4826: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 22 KiB/s wr, 9 op/s 2023-05-08T06:13:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8939.600980 secs 2023-05-08T06:13:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8939.600980 secs 2023-05-08T06:13:21.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8939.600980 secs 2023-05-08T06:13:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:21 smithi133 ceph-mon[125939]: pgmap v4827: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 8 op/s 2023-05-08T06:13:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:21 smithi096 ceph-mon[124666]: pgmap v4827: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 8 op/s 2023-05-08T06:13:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:21 smithi186 ceph-mon[126480]: pgmap v4827: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 8 op/s 2023-05-08T06:13:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:23 smithi133 ceph-mon[125939]: pgmap v4828: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 8 op/s 2023-05-08T06:13:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8942.763490 secs 2023-05-08T06:13:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8943.319990 secs 2023-05-08T06:13:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:23 smithi096 ceph-mon[124666]: pgmap v4828: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 8 op/s 2023-05-08T06:13:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8942.763490 secs 2023-05-08T06:13:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8943.319990 secs 2023-05-08T06:13:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:23 smithi186 ceph-mon[126480]: pgmap v4828: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 8 op/s 2023-05-08T06:13:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8942.763490 secs 2023-05-08T06:13:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8943.319990 secs 2023-05-08T06:13:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:25 smithi133 ceph-mon[125939]: pgmap v4829: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 38 KiB/s wr, 8 op/s 2023-05-08T06:13:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8944.601065 secs 2023-05-08T06:13:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:25 smithi096 ceph-mon[124666]: pgmap v4829: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 38 KiB/s wr, 8 op/s 2023-05-08T06:13:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8944.601065 secs 2023-05-08T06:13:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:25 smithi186 ceph-mon[126480]: pgmap v4829: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 38 KiB/s wr, 8 op/s 2023-05-08T06:13:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8944.601065 secs 2023-05-08T06:13:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:27 smithi133 ceph-mon[125939]: pgmap v4830: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 33 KiB/s wr, 7 op/s 2023-05-08T06:13:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:27 smithi096 ceph-mon[124666]: pgmap v4830: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 33 KiB/s wr, 7 op/s 2023-05-08T06:13:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:27 smithi186 ceph-mon[126480]: pgmap v4830: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 33 KiB/s wr, 7 op/s 2023-05-08T06:13:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8947.763619 secs 2023-05-08T06:13:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8948.320070 secs 2023-05-08T06:13:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8947.763619 secs 2023-05-08T06:13:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8948.320070 secs 2023-05-08T06:13:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8947.763619 secs 2023-05-08T06:13:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8948.320070 secs 2023-05-08T06:13:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:29 smithi133 ceph-mon[125939]: pgmap v4831: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 29 KiB/s wr, 6 op/s 2023-05-08T06:13:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:29 smithi096 ceph-mon[124666]: pgmap v4831: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 29 KiB/s wr, 6 op/s 2023-05-08T06:13:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:29 smithi186 ceph-mon[126480]: pgmap v4831: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 29 KiB/s wr, 6 op/s 2023-05-08T06:13:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8949.601205 secs 2023-05-08T06:13:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8949.601205 secs 2023-05-08T06:13:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8949.601205 secs 2023-05-08T06:13:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:31 smithi133 ceph-mon[125939]: pgmap v4832: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 10 op/s 2023-05-08T06:13:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:31 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:13:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:31 smithi096 ceph-mon[124666]: pgmap v4832: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 10 op/s 2023-05-08T06:13:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:31 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:13:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:31 smithi186 ceph-mon[126480]: pgmap v4832: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 10 op/s 2023-05-08T06:13:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:31 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:13:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:33 smithi186 ceph-mon[126480]: pgmap v4833: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 29 KiB/s wr, 7 op/s 2023-05-08T06:13:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8952.763681 secs 2023-05-08T06:13:34.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8953.320161 secs 2023-05-08T06:13:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:33 smithi133 ceph-mon[125939]: pgmap v4833: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 29 KiB/s wr, 7 op/s 2023-05-08T06:13:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8952.763681 secs 2023-05-08T06:13:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8953.320161 secs 2023-05-08T06:13:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:33 smithi096 ceph-mon[124666]: pgmap v4833: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 29 KiB/s wr, 7 op/s 2023-05-08T06:13:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8952.763681 secs 2023-05-08T06:13:34.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8953.320161 secs 2023-05-08T06:13:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:35 smithi186 ceph-mon[126480]: pgmap v4834: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 59 KiB/s wr, 9 op/s 2023-05-08T06:13:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:13:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:13:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:13:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:13:36.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:35 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:13:36.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:13:36.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:35 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T06:13:36.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:35 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T06:13:36.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:35 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:13:36.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8954.601319 secs 2023-05-08T06:13:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:35 smithi133 ceph-mon[125939]: pgmap v4834: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 59 KiB/s wr, 9 op/s 2023-05-08T06:13:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:13:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:13:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:13:36.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:13:36.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:35 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:13:36.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:13:36.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:35 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T06:13:36.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:35 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T06:13:36.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:35 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:13:36.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8954.601319 secs 2023-05-08T06:13:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:35 smithi096 ceph-mon[124666]: pgmap v4834: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 59 KiB/s wr, 9 op/s 2023-05-08T06:13:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:13:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:13:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:13:36.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:13:36.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:35 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:13:36.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:13:36.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:35 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T06:13:36.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:35 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T06:13:36.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:35 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:13:36.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8954.601319 secs 2023-05-08T06:13:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:37 smithi186 ceph-mon[126480]: pgmap v4835: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 30 KiB/s wr, 6 op/s 2023-05-08T06:13:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:37 smithi133 ceph-mon[125939]: pgmap v4835: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 30 KiB/s wr, 6 op/s 2023-05-08T06:13:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:37 smithi096 ceph-mon[124666]: pgmap v4835: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 30 KiB/s wr, 6 op/s 2023-05-08T06:13:39.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8957.763789 secs 2023-05-08T06:13:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8957.763789 secs 2023-05-08T06:13:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8957.763789 secs 2023-05-08T06:13:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:39 smithi186 ceph-mon[126480]: pgmap v4836: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 30 KiB/s wr, 6 op/s 2023-05-08T06:13:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:39 smithi133 ceph-mon[125939]: pgmap v4836: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 30 KiB/s wr, 6 op/s 2023-05-08T06:13:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:39 smithi096 ceph-mon[124666]: pgmap v4836: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 30 KiB/s wr, 6 op/s 2023-05-08T06:13:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8959.601430 secs 2023-05-08T06:13:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8959.601430 secs 2023-05-08T06:13:41.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8959.601430 secs 2023-05-08T06:13:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:41 smithi133 ceph-mon[125939]: pgmap v4837: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 64 KiB/s wr, 10 op/s 2023-05-08T06:13:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:41 smithi096 ceph-mon[124666]: pgmap v4837: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 64 KiB/s wr, 10 op/s 2023-05-08T06:13:42.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:41 smithi186 ceph-mon[126480]: pgmap v4837: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 64 KiB/s wr, 10 op/s 2023-05-08T06:13:43.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:13:43.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:13:43.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:13:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:43 smithi133 ceph-mon[125939]: pgmap v4838: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 64 KiB/s wr, 7 op/s 2023-05-08T06:13:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:43 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:13:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:13:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:13:44.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8962.763876 secs 2023-05-08T06:13:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:43 smithi096 ceph-mon[124666]: pgmap v4838: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 64 KiB/s wr, 7 op/s 2023-05-08T06:13:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:43 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:13:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:13:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:13:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8962.763876 secs 2023-05-08T06:13:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:43 smithi186 ceph-mon[126480]: pgmap v4838: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 64 KiB/s wr, 7 op/s 2023-05-08T06:13:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:43 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:13:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:13:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:13:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8962.763876 secs 2023-05-08T06:13:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:45 smithi133 ceph-mon[125939]: pgmap v4839: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 130 KiB/s wr, 12 op/s 2023-05-08T06:13:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:45 smithi096 ceph-mon[124666]: pgmap v4839: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 130 KiB/s wr, 12 op/s 2023-05-08T06:13:46.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:45 smithi186 ceph-mon[126480]: pgmap v4839: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 130 KiB/s wr, 12 op/s 2023-05-08T06:13:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:46 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:13:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:46 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:13:47.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:46 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:13:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:47 smithi133 ceph-mon[125939]: pgmap v4840: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 104 KiB/s wr, 10 op/s 2023-05-08T06:13:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:47 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:13:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:47 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:13:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:47 smithi096 ceph-mon[124666]: pgmap v4840: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 104 KiB/s wr, 10 op/s 2023-05-08T06:13:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:47 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:13:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:47 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:13:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:47 smithi186 ceph-mon[126480]: pgmap v4840: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 104 KiB/s wr, 10 op/s 2023-05-08T06:13:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:47 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:13:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:47 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:13:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8967.764004 secs 2023-05-08T06:13:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8968.320504 secs 2023-05-08T06:13:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8967.764004 secs 2023-05-08T06:13:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8968.320504 secs 2023-05-08T06:13:49.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8967.764004 secs 2023-05-08T06:13:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8968.320504 secs 2023-05-08T06:13:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:49 smithi133 ceph-mon[125939]: pgmap v4841: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 104 KiB/s wr, 10 op/s 2023-05-08T06:13:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:49 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:13:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:49 smithi096 ceph-mon[124666]: pgmap v4841: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 104 KiB/s wr, 10 op/s 2023-05-08T06:13:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:49 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:13:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:49 smithi186 ceph-mon[126480]: pgmap v4841: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 104 KiB/s wr, 10 op/s 2023-05-08T06:13:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:49 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:13:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:51 smithi133 ceph-mon[125939]: pgmap v4842: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 108 KiB/s wr, 14 op/s 2023-05-08T06:13:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:13:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:13:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:51 smithi096 ceph-mon[124666]: pgmap v4842: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 108 KiB/s wr, 14 op/s 2023-05-08T06:13:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:13:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:13:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:51 smithi186 ceph-mon[126480]: pgmap v4842: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 108 KiB/s wr, 14 op/s 2023-05-08T06:13:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:13:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:13:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:53 smithi133 ceph-mon[125939]: pgmap v4843: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 74 KiB/s wr, 10 op/s 2023-05-08T06:13:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8972.764132 secs 2023-05-08T06:13:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8973.320627 secs 2023-05-08T06:13:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:53 smithi096 ceph-mon[124666]: pgmap v4843: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 74 KiB/s wr, 10 op/s 2023-05-08T06:13:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8972.764132 secs 2023-05-08T06:13:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8973.320627 secs 2023-05-08T06:13:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:53 smithi186 ceph-mon[126480]: pgmap v4843: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 74 KiB/s wr, 10 op/s 2023-05-08T06:13:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8972.764132 secs 2023-05-08T06:13:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8973.320627 secs 2023-05-08T06:13:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:54 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:13:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:54 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:13:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:54 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:13:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:55 smithi133 ceph-mon[125939]: pgmap v4844: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 128 KiB/s wr, 14 op/s 2023-05-08T06:13:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:55 smithi096 ceph-mon[124666]: pgmap v4844: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 128 KiB/s wr, 14 op/s 2023-05-08T06:13:56.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:55 smithi186 ceph-mon[126480]: pgmap v4844: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 128 KiB/s wr, 14 op/s 2023-05-08T06:13:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:56 smithi133 ceph-mon[125939]: pgmap v4845: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 65 KiB/s wr, 9 op/s 2023-05-08T06:13:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:56 smithi096 ceph-mon[124666]: pgmap v4845: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 65 KiB/s wr, 9 op/s 2023-05-08T06:13:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:56 smithi186 ceph-mon[126480]: pgmap v4845: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 65 KiB/s wr, 9 op/s 2023-05-08T06:13:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8977.764255 secs 2023-05-08T06:13:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8977.764255 secs 2023-05-08T06:13:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8977.764255 secs 2023-05-08T06:13:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8978.320884 secs 2023-05-08T06:13:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:13:59 smithi186 ceph-mon[126480]: pgmap v4846: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 61 KiB/s wr, 8 op/s 2023-05-08T06:13:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8978.320884 secs 2023-05-08T06:13:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:13:59 smithi133 ceph-mon[125939]: pgmap v4846: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 61 KiB/s wr, 8 op/s 2023-05-08T06:13:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8978.320884 secs 2023-05-08T06:13:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:13:59 smithi096 ceph-mon[124666]: pgmap v4846: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 61 KiB/s wr, 8 op/s 2023-05-08T06:14:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8979.601854 secs 2023-05-08T06:14:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8979.601854 secs 2023-05-08T06:14:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8979.601854 secs 2023-05-08T06:14:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:01 smithi133 ceph-mon[125939]: pgmap v4847: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 64 KiB/s wr, 12 op/s 2023-05-08T06:14:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:01 smithi096 ceph-mon[124666]: pgmap v4847: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 64 KiB/s wr, 12 op/s 2023-05-08T06:14:02.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:01 smithi186 ceph-mon[126480]: pgmap v4847: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 64 KiB/s wr, 12 op/s 2023-05-08T06:14:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:03 smithi096 ceph-mon[124666]: pgmap v4848: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 61 KiB/s wr, 8 op/s 2023-05-08T06:14:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:03 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:14:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:14:03.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:03 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:14:03.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:03 smithi186 ceph-mon[126480]: pgmap v4848: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 61 KiB/s wr, 8 op/s 2023-05-08T06:14:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:03 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:14:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:14:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:03 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:14:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:03 smithi133 ceph-mon[125939]: pgmap v4848: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 61 KiB/s wr, 8 op/s 2023-05-08T06:14:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:03 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:14:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:14:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:03 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:14:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8982.764379 secs 2023-05-08T06:14:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8983.321025 secs 2023-05-08T06:14:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8982.764379 secs 2023-05-08T06:14:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8983.321025 secs 2023-05-08T06:14:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8982.764379 secs 2023-05-08T06:14:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8983.321025 secs 2023-05-08T06:14:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:05 smithi133 ceph-mon[125939]: pgmap v4849: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 140 KiB/s wr, 26 op/s 2023-05-08T06:14:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8984.601972 secs 2023-05-08T06:14:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:05 smithi133 ceph-mon[125939]: osdmap e380: 12 total, 12 up, 12 in 2023-05-08T06:14:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:05 smithi096 ceph-mon[124666]: pgmap v4849: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 140 KiB/s wr, 26 op/s 2023-05-08T06:14:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8984.601972 secs 2023-05-08T06:14:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:05 smithi096 ceph-mon[124666]: osdmap e380: 12 total, 12 up, 12 in 2023-05-08T06:14:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:05 smithi186 ceph-mon[126480]: pgmap v4849: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 140 KiB/s wr, 26 op/s 2023-05-08T06:14:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8984.601972 secs 2023-05-08T06:14:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:05 smithi186 ceph-mon[126480]: osdmap e380: 12 total, 12 up, 12 in 2023-05-08T06:14:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:07 smithi133 ceph-mon[125939]: pgmap v4851: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 99 KiB/s wr, 27 op/s 2023-05-08T06:14:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:07 smithi096 ceph-mon[124666]: pgmap v4851: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 99 KiB/s wr, 27 op/s 2023-05-08T06:14:08.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:07 smithi186 ceph-mon[126480]: pgmap v4851: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 99 KiB/s wr, 27 op/s 2023-05-08T06:14:09.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8987.764463 secs 2023-05-08T06:14:09.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8988.321173 secs 2023-05-08T06:14:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8987.764463 secs 2023-05-08T06:14:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8988.321173 secs 2023-05-08T06:14:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8987.764463 secs 2023-05-08T06:14:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8988.321173 secs 2023-05-08T06:14:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:09 smithi133 ceph-mon[125939]: pgmap v4852: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 99 KiB/s wr, 27 op/s 2023-05-08T06:14:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:09 smithi096 ceph-mon[124666]: pgmap v4852: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 99 KiB/s wr, 27 op/s 2023-05-08T06:14:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:09 smithi186 ceph-mon[126480]: pgmap v4852: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 99 KiB/s wr, 27 op/s 2023-05-08T06:14:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8989.602047 secs 2023-05-08T06:14:11.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8989.602047 secs 2023-05-08T06:14:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8989.602047 secs 2023-05-08T06:14:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:11 smithi133 ceph-mon[125939]: pgmap v4853: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 100 KiB/s wr, 26 op/s 2023-05-08T06:14:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:11 smithi096 ceph-mon[124666]: pgmap v4853: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 100 KiB/s wr, 26 op/s 2023-05-08T06:14:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:11 smithi186 ceph-mon[126480]: pgmap v4853: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 100 KiB/s wr, 26 op/s 2023-05-08T06:14:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:13 smithi133 ceph-mon[125939]: pgmap v4854: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 100 KiB/s wr, 26 op/s 2023-05-08T06:14:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8992.764591 secs 2023-05-08T06:14:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8993.321317 secs 2023-05-08T06:14:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:13 smithi096 ceph-mon[124666]: pgmap v4854: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 100 KiB/s wr, 26 op/s 2023-05-08T06:14:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8992.764591 secs 2023-05-08T06:14:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8993.321317 secs 2023-05-08T06:14:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:13 smithi186 ceph-mon[126480]: pgmap v4854: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 100 KiB/s wr, 26 op/s 2023-05-08T06:14:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8992.764591 secs 2023-05-08T06:14:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8993.321317 secs 2023-05-08T06:14:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:15 smithi133 ceph-mon[125939]: pgmap v4855: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 8 op/s 2023-05-08T06:14:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8994.602144 secs 2023-05-08T06:14:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:15 smithi133 ceph-mon[125939]: osdmap e381: 12 total, 12 up, 12 in 2023-05-08T06:14:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:15 smithi096 ceph-mon[124666]: pgmap v4855: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 8 op/s 2023-05-08T06:14:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8994.602144 secs 2023-05-08T06:14:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:15 smithi096 ceph-mon[124666]: osdmap e381: 12 total, 12 up, 12 in 2023-05-08T06:14:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:15 smithi186 ceph-mon[126480]: pgmap v4855: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 8 op/s 2023-05-08T06:14:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8994.602144 secs 2023-05-08T06:14:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:15 smithi186 ceph-mon[126480]: osdmap e381: 12 total, 12 up, 12 in 2023-05-08T06:14:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:17 smithi133 ceph-mon[125939]: pgmap v4857: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 8 op/s 2023-05-08T06:14:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:17 smithi096 ceph-mon[124666]: pgmap v4857: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 8 op/s 2023-05-08T06:14:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:17 smithi186 ceph-mon[126480]: pgmap v4857: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 8 op/s 2023-05-08T06:14:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8997.764716 secs 2023-05-08T06:14:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8998.321450 secs 2023-05-08T06:14:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8997.764716 secs 2023-05-08T06:14:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8998.321450 secs 2023-05-08T06:14:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8997.764716 secs 2023-05-08T06:14:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8998.321450 secs 2023-05-08T06:14:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:19 smithi133 ceph-mon[125939]: pgmap v4858: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 8 op/s 2023-05-08T06:14:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:19 smithi096 ceph-mon[124666]: pgmap v4858: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 8 op/s 2023-05-08T06:14:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:19 smithi186 ceph-mon[126480]: pgmap v4858: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 8 op/s 2023-05-08T06:14:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 8999.602252 secs 2023-05-08T06:14:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 8999.602252 secs 2023-05-08T06:14:21.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 8999.602252 secs 2023-05-08T06:14:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:21 smithi133 ceph-mon[125939]: pgmap v4859: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 7 op/s 2023-05-08T06:14:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:21 smithi096 ceph-mon[124666]: pgmap v4859: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 7 op/s 2023-05-08T06:14:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:21 smithi186 ceph-mon[126480]: pgmap v4859: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 7 op/s 2023-05-08T06:14:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:23 smithi133 ceph-mon[125939]: pgmap v4860: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 7 op/s 2023-05-08T06:14:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9002.764841 secs 2023-05-08T06:14:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9003.321512 secs 2023-05-08T06:14:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:23 smithi096 ceph-mon[124666]: pgmap v4860: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 7 op/s 2023-05-08T06:14:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9002.764841 secs 2023-05-08T06:14:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9003.321512 secs 2023-05-08T06:14:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:23 smithi186 ceph-mon[126480]: pgmap v4860: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 7 op/s 2023-05-08T06:14:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9002.764841 secs 2023-05-08T06:14:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9003.321512 secs 2023-05-08T06:14:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:25 smithi133 ceph-mon[125939]: pgmap v4861: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 KiB/s wr, 8 op/s 2023-05-08T06:14:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9004.602371 secs 2023-05-08T06:14:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:25 smithi096 ceph-mon[124666]: pgmap v4861: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 KiB/s wr, 8 op/s 2023-05-08T06:14:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9004.602371 secs 2023-05-08T06:14:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:25 smithi186 ceph-mon[126480]: pgmap v4861: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 KiB/s wr, 8 op/s 2023-05-08T06:14:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9004.602371 secs 2023-05-08T06:14:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:27 smithi133 ceph-mon[125939]: pgmap v4862: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 7 op/s 2023-05-08T06:14:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:27 smithi096 ceph-mon[124666]: pgmap v4862: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 7 op/s 2023-05-08T06:14:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:27 smithi186 ceph-mon[126480]: pgmap v4862: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 7 op/s 2023-05-08T06:14:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9007.764966 secs 2023-05-08T06:14:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9008.321585 secs 2023-05-08T06:14:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9007.764966 secs 2023-05-08T06:14:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9008.321585 secs 2023-05-08T06:14:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9007.764966 secs 2023-05-08T06:14:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9008.321585 secs 2023-05-08T06:14:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:29 smithi096 ceph-mon[124666]: pgmap v4863: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 6 op/s 2023-05-08T06:14:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:29 smithi186 ceph-mon[126480]: pgmap v4863: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 6 op/s 2023-05-08T06:14:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:29 smithi133 ceph-mon[125939]: pgmap v4863: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 6 op/s 2023-05-08T06:14:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9009.602441 secs 2023-05-08T06:14:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:30 smithi096 ceph-mon[124666]: pgmap v4864: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 10 op/s 2023-05-08T06:14:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9009.602441 secs 2023-05-08T06:14:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:30 smithi186 ceph-mon[126480]: pgmap v4864: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 10 op/s 2023-05-08T06:14:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9009.602441 secs 2023-05-08T06:14:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:30 smithi133 ceph-mon[125939]: pgmap v4864: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 10 op/s 2023-05-08T06:14:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:33 smithi186 ceph-mon[126480]: pgmap v4865: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 6 op/s 2023-05-08T06:14:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9012.765081 secs 2023-05-08T06:14:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:33 smithi133 ceph-mon[125939]: pgmap v4865: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 6 op/s 2023-05-08T06:14:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9012.765081 secs 2023-05-08T06:14:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:33 smithi096 ceph-mon[124666]: pgmap v4865: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 6 op/s 2023-05-08T06:14:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9012.765081 secs 2023-05-08T06:14:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9013.321728 secs 2023-05-08T06:14:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9013.321728 secs 2023-05-08T06:14:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9013.321728 secs 2023-05-08T06:14:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:35 smithi133 ceph-mon[125939]: pgmap v4866: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 60 KiB/s wr, 9 op/s 2023-05-08T06:14:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9014.602564 secs 2023-05-08T06:14:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:14:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:14:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:14:36.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:14:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:35 smithi096 ceph-mon[124666]: pgmap v4866: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 60 KiB/s wr, 9 op/s 2023-05-08T06:14:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9014.602564 secs 2023-05-08T06:14:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:14:36.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:14:36.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:14:36.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:14:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:35 smithi186 ceph-mon[126480]: pgmap v4866: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 60 KiB/s wr, 9 op/s 2023-05-08T06:14:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9014.602564 secs 2023-05-08T06:14:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:14:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:14:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:14:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:14:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:36 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:14:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:36 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T06:14:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:36 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T06:14:37.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:36 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:14:37.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:36 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:14:37.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:36 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T06:14:37.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:36 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T06:14:37.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:36 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:14:37.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:36 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:14:37.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:36 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T06:14:37.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:36 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T06:14:37.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:36 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:14:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:37 smithi133 ceph-mon[125939]: pgmap v4867: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T06:14:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:37 smithi096 ceph-mon[124666]: pgmap v4867: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T06:14:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:37 smithi186 ceph-mon[126480]: pgmap v4867: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T06:14:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9017.765193 secs 2023-05-08T06:14:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9017.765193 secs 2023-05-08T06:14:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9017.765193 secs 2023-05-08T06:14:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:39 smithi133 ceph-mon[125939]: pgmap v4868: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T06:14:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:39 smithi096 ceph-mon[124666]: pgmap v4868: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T06:14:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:39 smithi186 ceph-mon[126480]: pgmap v4868: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T06:14:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9019.602681 secs 2023-05-08T06:14:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9019.602681 secs 2023-05-08T06:14:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9019.602681 secs 2023-05-08T06:14:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:41 smithi133 ceph-mon[125939]: pgmap v4869: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 68 KiB/s wr, 10 op/s 2023-05-08T06:14:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:41 smithi096 ceph-mon[124666]: pgmap v4869: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 68 KiB/s wr, 10 op/s 2023-05-08T06:14:42.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:41 smithi186 ceph-mon[126480]: pgmap v4869: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 68 KiB/s wr, 10 op/s 2023-05-08T06:14:43.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:14:43.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:14:43.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:14:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:43 smithi133 ceph-mon[125939]: pgmap v4870: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 65 KiB/s wr, 7 op/s 2023-05-08T06:14:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:43 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:14:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:14:44.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:14:44.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9022.765362 secs 2023-05-08T06:14:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:43 smithi096 ceph-mon[124666]: pgmap v4870: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 65 KiB/s wr, 7 op/s 2023-05-08T06:14:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:43 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:14:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:14:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:14:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9022.765362 secs 2023-05-08T06:14:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:43 smithi186 ceph-mon[126480]: pgmap v4870: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 65 KiB/s wr, 7 op/s 2023-05-08T06:14:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:43 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:14:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:14:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:14:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9022.765362 secs 2023-05-08T06:14:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:45 smithi133 ceph-mon[125939]: pgmap v4871: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 117 KiB/s wr, 11 op/s 2023-05-08T06:14:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:45 smithi096 ceph-mon[124666]: pgmap v4871: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 117 KiB/s wr, 11 op/s 2023-05-08T06:14:46.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:45 smithi186 ceph-mon[126480]: pgmap v4871: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 117 KiB/s wr, 11 op/s 2023-05-08T06:14:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:46 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:14:47.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:46 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:14:47.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:46 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:14:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:47 smithi096 ceph-mon[124666]: pgmap v4872: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 91 KiB/s wr, 9 op/s 2023-05-08T06:14:48.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:47 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:14:48.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:47 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:14:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:47 smithi186 ceph-mon[126480]: pgmap v4872: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 91 KiB/s wr, 9 op/s 2023-05-08T06:14:48.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:47 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:14:48.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:47 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:14:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:47 smithi133 ceph-mon[125939]: pgmap v4872: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 91 KiB/s wr, 9 op/s 2023-05-08T06:14:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:47 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:14:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:47 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:14:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9027.765407 secs 2023-05-08T06:14:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9028.322075 secs 2023-05-08T06:14:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9027.765407 secs 2023-05-08T06:14:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9028.322075 secs 2023-05-08T06:14:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9027.765407 secs 2023-05-08T06:14:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9028.322075 secs 2023-05-08T06:14:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:49 smithi096 ceph-mon[124666]: pgmap v4873: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 91 KiB/s wr, 9 op/s 2023-05-08T06:14:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:49 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:14:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:49 smithi186 ceph-mon[126480]: pgmap v4873: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 91 KiB/s wr, 9 op/s 2023-05-08T06:14:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:49 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:14:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:49 smithi133 ceph-mon[125939]: pgmap v4873: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 91 KiB/s wr, 9 op/s 2023-05-08T06:14:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:49 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:14:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:51 smithi186 ceph-mon[126480]: pgmap v4874: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 94 KiB/s wr, 13 op/s 2023-05-08T06:14:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:51 smithi133 ceph-mon[125939]: pgmap v4874: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 94 KiB/s wr, 13 op/s 2023-05-08T06:14:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:51 smithi096 ceph-mon[124666]: pgmap v4874: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 94 KiB/s wr, 13 op/s 2023-05-08T06:14:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:14:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:14:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:14:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:14:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:14:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:14:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:53 smithi186 ceph-mon[126480]: pgmap v4875: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 59 KiB/s wr, 8 op/s 2023-05-08T06:14:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:53 smithi133 ceph-mon[125939]: pgmap v4875: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 59 KiB/s wr, 8 op/s 2023-05-08T06:14:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:53 smithi096 ceph-mon[124666]: pgmap v4875: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 59 KiB/s wr, 8 op/s 2023-05-08T06:14:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9032.765502 secs 2023-05-08T06:14:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9033.322191 secs 2023-05-08T06:14:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9032.765502 secs 2023-05-08T06:14:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9033.322191 secs 2023-05-08T06:14:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9032.765502 secs 2023-05-08T06:14:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9033.322191 secs 2023-05-08T06:14:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:55 smithi186 ceph-mon[126480]: pgmap v4876: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 116 KiB/s wr, 12 op/s 2023-05-08T06:14:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:55 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:14:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:55 smithi133 ceph-mon[125939]: pgmap v4876: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 116 KiB/s wr, 12 op/s 2023-05-08T06:14:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:55 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:14:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:55 smithi096 ceph-mon[124666]: pgmap v4876: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 116 KiB/s wr, 12 op/s 2023-05-08T06:14:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:55 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:14:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:57 smithi186 ceph-mon[126480]: pgmap v4877: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 67 KiB/s wr, 9 op/s 2023-05-08T06:14:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:57 smithi133 ceph-mon[125939]: pgmap v4877: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 67 KiB/s wr, 9 op/s 2023-05-08T06:14:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:57 smithi096 ceph-mon[124666]: pgmap v4877: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 67 KiB/s wr, 9 op/s 2023-05-08T06:14:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9037.765643 secs 2023-05-08T06:14:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9037.765643 secs 2023-05-08T06:14:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9037.765643 secs 2023-05-08T06:15:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9038.322279 secs 2023-05-08T06:15:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:14:59 smithi186 ceph-mon[126480]: pgmap v4878: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 63 KiB/s wr, 8 op/s 2023-05-08T06:15:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9038.322279 secs 2023-05-08T06:15:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:14:59 smithi133 ceph-mon[125939]: pgmap v4878: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 63 KiB/s wr, 8 op/s 2023-05-08T06:15:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9038.322279 secs 2023-05-08T06:15:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:14:59 smithi096 ceph-mon[124666]: pgmap v4878: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 63 KiB/s wr, 8 op/s 2023-05-08T06:15:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9039.603214 secs 2023-05-08T06:15:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9039.603214 secs 2023-05-08T06:15:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9039.603214 secs 2023-05-08T06:15:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:01 smithi133 ceph-mon[125939]: pgmap v4879: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 104 KiB/s wr, 13 op/s 2023-05-08T06:15:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:01 smithi096 ceph-mon[124666]: pgmap v4879: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 104 KiB/s wr, 13 op/s 2023-05-08T06:15:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:01 smithi186 ceph-mon[126480]: pgmap v4879: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 104 KiB/s wr, 13 op/s 2023-05-08T06:15:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:03 smithi186 ceph-mon[126480]: pgmap v4880: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 101 KiB/s wr, 9 op/s 2023-05-08T06:15:03.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:03 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:15:03.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:15:03.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:03 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:15:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:03 smithi133 ceph-mon[125939]: pgmap v4880: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 101 KiB/s wr, 9 op/s 2023-05-08T06:15:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:03 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:15:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:15:03.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:03 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:15:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:03 smithi096 ceph-mon[124666]: pgmap v4880: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 101 KiB/s wr, 9 op/s 2023-05-08T06:15:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:03 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:15:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:15:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:03 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:15:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9042.765764 secs 2023-05-08T06:15:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9043.322397 secs 2023-05-08T06:15:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9042.765764 secs 2023-05-08T06:15:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9043.322397 secs 2023-05-08T06:15:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9042.765764 secs 2023-05-08T06:15:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9043.322397 secs 2023-05-08T06:15:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:05 smithi133 ceph-mon[125939]: pgmap v4881: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 181 KiB/s wr, 26 op/s 2023-05-08T06:15:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9044.603333 secs 2023-05-08T06:15:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:05 smithi133 ceph-mon[125939]: osdmap e382: 12 total, 12 up, 12 in 2023-05-08T06:15:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:05 smithi096 ceph-mon[124666]: pgmap v4881: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 181 KiB/s wr, 26 op/s 2023-05-08T06:15:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9044.603333 secs 2023-05-08T06:15:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:05 smithi096 ceph-mon[124666]: osdmap e382: 12 total, 12 up, 12 in 2023-05-08T06:15:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:05 smithi186 ceph-mon[126480]: pgmap v4881: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 181 KiB/s wr, 26 op/s 2023-05-08T06:15:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9044.603333 secs 2023-05-08T06:15:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:05 smithi186 ceph-mon[126480]: osdmap e382: 12 total, 12 up, 12 in 2023-05-08T06:15:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:07 smithi133 ceph-mon[125939]: pgmap v4883: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 144 KiB/s wr, 26 op/s 2023-05-08T06:15:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:07 smithi096 ceph-mon[124666]: pgmap v4883: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 144 KiB/s wr, 26 op/s 2023-05-08T06:15:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:07 smithi186 ceph-mon[126480]: pgmap v4883: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 144 KiB/s wr, 26 op/s 2023-05-08T06:15:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9047.765851 secs 2023-05-08T06:15:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9048.322477 secs 2023-05-08T06:15:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9047.765851 secs 2023-05-08T06:15:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9048.322477 secs 2023-05-08T06:15:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9047.765851 secs 2023-05-08T06:15:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9048.322477 secs 2023-05-08T06:15:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:09 smithi133 ceph-mon[125939]: pgmap v4884: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 144 KiB/s wr, 26 op/s 2023-05-08T06:15:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:09 smithi096 ceph-mon[124666]: pgmap v4884: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 144 KiB/s wr, 26 op/s 2023-05-08T06:15:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:09 smithi186 ceph-mon[126480]: pgmap v4884: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 144 KiB/s wr, 26 op/s 2023-05-08T06:15:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9049.603451 secs 2023-05-08T06:15:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9049.603451 secs 2023-05-08T06:15:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9049.603451 secs 2023-05-08T06:15:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:11 smithi133 ceph-mon[125939]: pgmap v4885: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 101 KiB/s wr, 26 op/s 2023-05-08T06:15:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:11 smithi096 ceph-mon[124666]: pgmap v4885: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 101 KiB/s wr, 26 op/s 2023-05-08T06:15:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:11 smithi186 ceph-mon[126480]: pgmap v4885: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 101 KiB/s wr, 26 op/s 2023-05-08T06:15:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:13 smithi133 ceph-mon[125939]: pgmap v4886: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 101 KiB/s wr, 26 op/s 2023-05-08T06:15:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9052.766006 secs 2023-05-08T06:15:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9053.322534 secs 2023-05-08T06:15:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:13 smithi096 ceph-mon[124666]: pgmap v4886: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 101 KiB/s wr, 26 op/s 2023-05-08T06:15:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9052.766006 secs 2023-05-08T06:15:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9053.322534 secs 2023-05-08T06:15:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:13 smithi186 ceph-mon[126480]: pgmap v4886: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 101 KiB/s wr, 26 op/s 2023-05-08T06:15:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9052.766006 secs 2023-05-08T06:15:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9053.322534 secs 2023-05-08T06:15:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:15 smithi133 ceph-mon[125939]: pgmap v4887: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 8 op/s 2023-05-08T06:15:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9054.603572 secs 2023-05-08T06:15:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:15 smithi133 ceph-mon[125939]: osdmap e383: 12 total, 12 up, 12 in 2023-05-08T06:15:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:15 smithi096 ceph-mon[124666]: pgmap v4887: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 8 op/s 2023-05-08T06:15:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9054.603572 secs 2023-05-08T06:15:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:15 smithi096 ceph-mon[124666]: osdmap e383: 12 total, 12 up, 12 in 2023-05-08T06:15:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:15 smithi186 ceph-mon[126480]: pgmap v4887: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 8 op/s 2023-05-08T06:15:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9054.603572 secs 2023-05-08T06:15:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:15 smithi186 ceph-mon[126480]: osdmap e383: 12 total, 12 up, 12 in 2023-05-08T06:15:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:17 smithi133 ceph-mon[125939]: pgmap v4889: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 8 op/s 2023-05-08T06:15:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:17 smithi096 ceph-mon[124666]: pgmap v4889: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 8 op/s 2023-05-08T06:15:18.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:17 smithi186 ceph-mon[126480]: pgmap v4889: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 8 op/s 2023-05-08T06:15:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9057.766130 secs 2023-05-08T06:15:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9058.322602 secs 2023-05-08T06:15:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9057.766130 secs 2023-05-08T06:15:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9058.322602 secs 2023-05-08T06:15:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9057.766130 secs 2023-05-08T06:15:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9058.322602 secs 2023-05-08T06:15:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:19 smithi133 ceph-mon[125939]: pgmap v4890: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 8 op/s 2023-05-08T06:15:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:19 smithi096 ceph-mon[124666]: pgmap v4890: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 8 op/s 2023-05-08T06:15:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:19 smithi186 ceph-mon[126480]: pgmap v4890: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 8 op/s 2023-05-08T06:15:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9059.603687 secs 2023-05-08T06:15:21.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9059.603687 secs 2023-05-08T06:15:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9059.603687 secs 2023-05-08T06:15:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:21 smithi096 ceph-mon[124666]: pgmap v4891: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 8 op/s 2023-05-08T06:15:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:21 smithi186 ceph-mon[126480]: pgmap v4891: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 8 op/s 2023-05-08T06:15:22.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:21 smithi133 ceph-mon[125939]: pgmap v4891: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 8 op/s 2023-05-08T06:15:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:23 smithi096 ceph-mon[124666]: pgmap v4892: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 8 op/s 2023-05-08T06:15:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9062.766229 secs 2023-05-08T06:15:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9063.322684 secs 2023-05-08T06:15:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:23 smithi186 ceph-mon[126480]: pgmap v4892: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 8 op/s 2023-05-08T06:15:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9062.766229 secs 2023-05-08T06:15:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9063.322684 secs 2023-05-08T06:15:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:23 smithi133 ceph-mon[125939]: pgmap v4892: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 8 op/s 2023-05-08T06:15:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9062.766229 secs 2023-05-08T06:15:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9063.322684 secs 2023-05-08T06:15:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:25 smithi133 ceph-mon[125939]: pgmap v4893: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 8 op/s 2023-05-08T06:15:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9064.603806 secs 2023-05-08T06:15:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:25 smithi096 ceph-mon[124666]: pgmap v4893: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 8 op/s 2023-05-08T06:15:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9064.603806 secs 2023-05-08T06:15:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:25 smithi186 ceph-mon[126480]: pgmap v4893: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 8 op/s 2023-05-08T06:15:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9064.603806 secs 2023-05-08T06:15:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:27 smithi133 ceph-mon[125939]: pgmap v4894: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 7 op/s 2023-05-08T06:15:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:27 smithi096 ceph-mon[124666]: pgmap v4894: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 7 op/s 2023-05-08T06:15:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:27 smithi186 ceph-mon[126480]: pgmap v4894: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 7 op/s 2023-05-08T06:15:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9067.766360 secs 2023-05-08T06:15:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9068.322759 secs 2023-05-08T06:15:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9067.766360 secs 2023-05-08T06:15:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9068.322759 secs 2023-05-08T06:15:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9067.766360 secs 2023-05-08T06:15:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9068.322759 secs 2023-05-08T06:15:30.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:29 smithi133 ceph-mon[125939]: pgmap v4895: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 6 op/s 2023-05-08T06:15:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:29 smithi096 ceph-mon[124666]: pgmap v4895: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 6 op/s 2023-05-08T06:15:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:29 smithi186 ceph-mon[126480]: pgmap v4895: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 6 op/s 2023-05-08T06:15:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9069.603866 secs 2023-05-08T06:15:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9069.603866 secs 2023-05-08T06:15:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9069.603866 secs 2023-05-08T06:15:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:31 smithi133 ceph-mon[125939]: pgmap v4896: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 10 op/s 2023-05-08T06:15:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:31 smithi096 ceph-mon[124666]: pgmap v4896: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 10 op/s 2023-05-08T06:15:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:31 smithi186 ceph-mon[126480]: pgmap v4896: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 10 op/s 2023-05-08T06:15:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:33 smithi096 ceph-mon[124666]: pgmap v4897: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 7 op/s 2023-05-08T06:15:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9072.766508 secs 2023-05-08T06:15:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9073.322877 secs 2023-05-08T06:15:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:33 smithi186 ceph-mon[126480]: pgmap v4897: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 7 op/s 2023-05-08T06:15:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9072.766508 secs 2023-05-08T06:15:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9073.322877 secs 2023-05-08T06:15:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:33 smithi133 ceph-mon[125939]: pgmap v4897: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 7 op/s 2023-05-08T06:15:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9072.766508 secs 2023-05-08T06:15:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9073.322877 secs 2023-05-08T06:15:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:35 smithi096 ceph-mon[124666]: pgmap v4898: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 61 KiB/s wr, 9 op/s 2023-05-08T06:15:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9074.604005 secs 2023-05-08T06:15:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:15:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:35 smithi186 ceph-mon[126480]: pgmap v4898: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 61 KiB/s wr, 9 op/s 2023-05-08T06:15:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9074.604005 secs 2023-05-08T06:15:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:15:36.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:35 smithi133 ceph-mon[125939]: pgmap v4898: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 61 KiB/s wr, 9 op/s 2023-05-08T06:15:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9074.604005 secs 2023-05-08T06:15:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:15:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:37 smithi096 ceph-mon[124666]: pgmap v4899: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 7 op/s 2023-05-08T06:15:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:37 smithi186 ceph-mon[126480]: pgmap v4899: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 7 op/s 2023-05-08T06:15:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:37 smithi133 ceph-mon[125939]: pgmap v4899: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 7 op/s 2023-05-08T06:15:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9077.766576 secs 2023-05-08T06:15:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:15:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:15:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:15:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:15:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:15:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:15:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9077.766576 secs 2023-05-08T06:15:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:15:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:15:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:15:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:15:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:15:39.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:15:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9077.766576 secs 2023-05-08T06:15:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:15:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:15:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:15:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:15:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:15:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:15:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:39 smithi096 ceph-mon[124666]: pgmap v4900: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T06:15:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:15:40.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:15:40.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:15:40.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:15:40.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:15:40.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:15:40.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:15:40.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:15:40.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:15:40.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:15:40.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:15:40.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:15:40.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:15:40.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:15:40.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:15:40.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:15:40.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:15:40.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:15:40.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:15:40.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:15:40.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:15:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:39 smithi186 ceph-mon[126480]: pgmap v4900: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T06:15:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:15:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:15:40.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:15:40.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:15:40.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:15:40.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:15:40.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:15:40.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:15:40.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:15:40.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:15:40.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:15:40.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:15:40.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:15:40.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:15:40.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:15:40.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:15:40.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:15:40.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:15:40.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:15:40.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:15:40.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:15:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:39 smithi133 ceph-mon[125939]: pgmap v4900: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T06:15:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:15:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:15:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:15:40.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:15:40.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:15:40.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:15:40.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:15:40.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:15:40.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:15:40.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:15:40.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:15:40.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:15:40.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:15:40.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:15:40.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:15:40.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:15:40.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:15:40.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:15:40.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:15:40.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:15:40.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:15:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:41 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T06:15:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:41 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi096 to 196.2M 2023-05-08T06:15:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:41 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T06:15:41.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:41 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T06:15:41.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:41 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi096 to 205766758: error parsing value: Value '205766758' is below minimum 939524096 2023-05-08T06:15:41.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:41 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T06:15:41.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:41 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:15:41.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:41 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T06:15:41.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:41 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T06:15:41.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:41 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:15:41.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9079.604147 secs 2023-05-08T06:15:41.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:41 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T06:15:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:41 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi096 to 196.2M 2023-05-08T06:15:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:41 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T06:15:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:41 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T06:15:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:41 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi096 to 205766758: error parsing value: Value '205766758' is below minimum 939524096 2023-05-08T06:15:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:41 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T06:15:41.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:41 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:15:41.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:41 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T06:15:41.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:41 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T06:15:41.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:41 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:15:41.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9079.604147 secs 2023-05-08T06:15:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:41 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T06:15:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:41 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi096 to 196.2M 2023-05-08T06:15:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:41 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T06:15:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:41 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T06:15:41.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:41 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi096 to 205766758: error parsing value: Value '205766758' is below minimum 939524096 2023-05-08T06:15:41.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:41 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T06:15:41.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:41 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:15:41.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:41 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T06:15:41.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:41 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T06:15:41.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:41 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:15:41.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9079.604147 secs 2023-05-08T06:15:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:42 smithi186 ceph-mon[126480]: pgmap v4901: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 70 KiB/s wr, 11 op/s 2023-05-08T06:15:42.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:42 smithi133 ceph-mon[125939]: pgmap v4901: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 70 KiB/s wr, 11 op/s 2023-05-08T06:15:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:42 smithi096 ceph-mon[124666]: pgmap v4901: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 70 KiB/s wr, 11 op/s 2023-05-08T06:15:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:15:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:43 smithi186 ceph-mon[126480]: pgmap v4902: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 67 KiB/s wr, 7 op/s 2023-05-08T06:15:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:15:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:43 smithi133 ceph-mon[125939]: pgmap v4902: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 67 KiB/s wr, 7 op/s 2023-05-08T06:15:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:15:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:43 smithi096 ceph-mon[124666]: pgmap v4902: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 67 KiB/s wr, 7 op/s 2023-05-08T06:15:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:15:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:15:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:15:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9082.766700 secs 2023-05-08T06:15:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:15:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:15:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:15:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9082.766700 secs 2023-05-08T06:15:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:15:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:15:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:15:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9082.766700 secs 2023-05-08T06:15:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:45 smithi133 ceph-mon[125939]: pgmap v4903: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 120 KiB/s wr, 12 op/s 2023-05-08T06:15:46.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:45 smithi096 ceph-mon[124666]: pgmap v4903: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 120 KiB/s wr, 12 op/s 2023-05-08T06:15:46.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:45 smithi186 ceph-mon[126480]: pgmap v4903: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 120 KiB/s wr, 12 op/s 2023-05-08T06:15:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:46 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:15:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:46 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:15:47.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:46 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:15:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:47 smithi133 ceph-mon[125939]: pgmap v4904: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 93 KiB/s wr, 9 op/s 2023-05-08T06:15:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:47 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:15:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:47 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:15:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:47 smithi096 ceph-mon[124666]: pgmap v4904: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 93 KiB/s wr, 9 op/s 2023-05-08T06:15:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:47 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:15:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:47 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:15:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:47 smithi186 ceph-mon[126480]: pgmap v4904: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 93 KiB/s wr, 9 op/s 2023-05-08T06:15:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:47 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:15:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:47 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:15:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9087.766805 secs 2023-05-08T06:15:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9088.323175 secs 2023-05-08T06:15:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9087.766805 secs 2023-05-08T06:15:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9088.323175 secs 2023-05-08T06:15:49.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9087.766805 secs 2023-05-08T06:15:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9088.323175 secs 2023-05-08T06:15:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:49 smithi096 ceph-mon[124666]: pgmap v4905: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 93 KiB/s wr, 9 op/s 2023-05-08T06:15:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:49 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:15:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:49 smithi186 ceph-mon[126480]: pgmap v4905: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 93 KiB/s wr, 9 op/s 2023-05-08T06:15:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:49 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:15:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:49 smithi133 ceph-mon[125939]: pgmap v4905: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 93 KiB/s wr, 9 op/s 2023-05-08T06:15:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:49 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:15:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:51 smithi096 ceph-mon[124666]: pgmap v4906: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 96 KiB/s wr, 13 op/s 2023-05-08T06:15:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:15:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:15:52.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:51 smithi186 ceph-mon[126480]: pgmap v4906: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 96 KiB/s wr, 13 op/s 2023-05-08T06:15:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:15:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:15:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:51 smithi133 ceph-mon[125939]: pgmap v4906: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 96 KiB/s wr, 13 op/s 2023-05-08T06:15:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:15:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:15:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:54 smithi096 ceph-mon[124666]: pgmap v4907: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 61 KiB/s wr, 8 op/s 2023-05-08T06:15:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9092.766916 secs 2023-05-08T06:15:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9093.323266 secs 2023-05-08T06:15:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:54 smithi186 ceph-mon[126480]: pgmap v4907: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 61 KiB/s wr, 8 op/s 2023-05-08T06:15:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9092.766916 secs 2023-05-08T06:15:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9093.323266 secs 2023-05-08T06:15:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:54 smithi133 ceph-mon[125939]: pgmap v4907: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 61 KiB/s wr, 8 op/s 2023-05-08T06:15:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9092.766916 secs 2023-05-08T06:15:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9093.323266 secs 2023-05-08T06:15:55.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:55 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:15:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:55 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:15:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:55 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:15:56.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:56 smithi186 ceph-mon[126480]: pgmap v4908: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 118 KiB/s wr, 12 op/s 2023-05-08T06:15:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:56 smithi133 ceph-mon[125939]: pgmap v4908: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 118 KiB/s wr, 12 op/s 2023-05-08T06:15:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:56 smithi096 ceph-mon[124666]: pgmap v4908: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 118 KiB/s wr, 12 op/s 2023-05-08T06:15:57.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:57 smithi186 ceph-mon[126480]: pgmap v4909: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 68 KiB/s wr, 9 op/s 2023-05-08T06:15:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:57 smithi133 ceph-mon[125939]: pgmap v4909: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 68 KiB/s wr, 9 op/s 2023-05-08T06:15:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:57 smithi096 ceph-mon[124666]: pgmap v4909: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 68 KiB/s wr, 9 op/s 2023-05-08T06:15:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9097.767040 secs 2023-05-08T06:15:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9097.767040 secs 2023-05-08T06:15:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9097.767040 secs 2023-05-08T06:15:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9098.323409 secs 2023-05-08T06:15:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:15:59 smithi133 ceph-mon[125939]: pgmap v4910: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 64 KiB/s wr, 8 op/s 2023-05-08T06:15:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9098.323409 secs 2023-05-08T06:15:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:15:59 smithi096 ceph-mon[124666]: pgmap v4910: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 64 KiB/s wr, 8 op/s 2023-05-08T06:15:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9098.323409 secs 2023-05-08T06:15:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:15:59 smithi186 ceph-mon[126480]: pgmap v4910: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 64 KiB/s wr, 8 op/s 2023-05-08T06:16:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9099.604600 secs 2023-05-08T06:16:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9099.604600 secs 2023-05-08T06:16:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9099.604600 secs 2023-05-08T06:16:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:01 smithi133 ceph-mon[125939]: pgmap v4911: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 67 KiB/s wr, 12 op/s 2023-05-08T06:16:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:01 smithi096 ceph-mon[124666]: pgmap v4911: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 67 KiB/s wr, 12 op/s 2023-05-08T06:16:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:01 smithi186 ceph-mon[126480]: pgmap v4911: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 67 KiB/s wr, 12 op/s 2023-05-08T06:16:03.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:03 smithi186 ceph-mon[126480]: pgmap v4912: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 64 KiB/s wr, 8 op/s 2023-05-08T06:16:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:03 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:16:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:16:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:03 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:16:03.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:03 smithi133 ceph-mon[125939]: pgmap v4912: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 64 KiB/s wr, 8 op/s 2023-05-08T06:16:03.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:03 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:16:03.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:16:03.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:03 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:16:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:03 smithi096 ceph-mon[124666]: pgmap v4912: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 64 KiB/s wr, 8 op/s 2023-05-08T06:16:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:03 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:16:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:16:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:03 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:16:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9102.767153 secs 2023-05-08T06:16:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9103.323513 secs 2023-05-08T06:16:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9102.767153 secs 2023-05-08T06:16:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9103.323513 secs 2023-05-08T06:16:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9102.767153 secs 2023-05-08T06:16:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9103.323513 secs 2023-05-08T06:16:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:05 smithi133 ceph-mon[125939]: pgmap v4913: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 144 KiB/s wr, 26 op/s 2023-05-08T06:16:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9104.604701 secs 2023-05-08T06:16:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:05 smithi133 ceph-mon[125939]: osdmap e384: 12 total, 12 up, 12 in 2023-05-08T06:16:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:05 smithi096 ceph-mon[124666]: pgmap v4913: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 144 KiB/s wr, 26 op/s 2023-05-08T06:16:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9104.604701 secs 2023-05-08T06:16:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:05 smithi096 ceph-mon[124666]: osdmap e384: 12 total, 12 up, 12 in 2023-05-08T06:16:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:05 smithi186 ceph-mon[126480]: pgmap v4913: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 144 KiB/s wr, 26 op/s 2023-05-08T06:16:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9104.604701 secs 2023-05-08T06:16:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:05 smithi186 ceph-mon[126480]: osdmap e384: 12 total, 12 up, 12 in 2023-05-08T06:16:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:07 smithi133 ceph-mon[125939]: pgmap v4915: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 100 KiB/s wr, 26 op/s 2023-05-08T06:16:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:07 smithi096 ceph-mon[124666]: pgmap v4915: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 100 KiB/s wr, 26 op/s 2023-05-08T06:16:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:07 smithi186 ceph-mon[126480]: pgmap v4915: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 100 KiB/s wr, 26 op/s 2023-05-08T06:16:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9107.767254 secs 2023-05-08T06:16:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9108.323600 secs 2023-05-08T06:16:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9107.767254 secs 2023-05-08T06:16:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9108.323600 secs 2023-05-08T06:16:09.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9107.767254 secs 2023-05-08T06:16:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9108.323600 secs 2023-05-08T06:16:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:09 smithi096 ceph-mon[124666]: pgmap v4916: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 100 KiB/s wr, 26 op/s 2023-05-08T06:16:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:09 smithi186 ceph-mon[126480]: pgmap v4916: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 100 KiB/s wr, 26 op/s 2023-05-08T06:16:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:09 smithi133 ceph-mon[125939]: pgmap v4916: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 100 KiB/s wr, 26 op/s 2023-05-08T06:16:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9109.604815 secs 2023-05-08T06:16:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9109.604815 secs 2023-05-08T06:16:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9109.604815 secs 2023-05-08T06:16:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:11 smithi096 ceph-mon[124666]: pgmap v4917: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 102 KiB/s wr, 26 op/s 2023-05-08T06:16:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:11 smithi186 ceph-mon[126480]: pgmap v4917: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 102 KiB/s wr, 26 op/s 2023-05-08T06:16:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:11 smithi133 ceph-mon[125939]: pgmap v4917: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 102 KiB/s wr, 26 op/s 2023-05-08T06:16:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:13 smithi096 ceph-mon[124666]: pgmap v4918: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 102 KiB/s wr, 26 op/s 2023-05-08T06:16:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9112.767373 secs 2023-05-08T06:16:14.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9113.323721 secs 2023-05-08T06:16:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:13 smithi186 ceph-mon[126480]: pgmap v4918: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 102 KiB/s wr, 26 op/s 2023-05-08T06:16:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9112.767373 secs 2023-05-08T06:16:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9113.323721 secs 2023-05-08T06:16:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:13 smithi133 ceph-mon[125939]: pgmap v4918: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 102 KiB/s wr, 26 op/s 2023-05-08T06:16:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9112.767373 secs 2023-05-08T06:16:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9113.323721 secs 2023-05-08T06:16:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:15 smithi133 ceph-mon[125939]: pgmap v4919: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 8 op/s 2023-05-08T06:16:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9114.604934 secs 2023-05-08T06:16:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:15 smithi133 ceph-mon[125939]: osdmap e385: 12 total, 12 up, 12 in 2023-05-08T06:16:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:15 smithi096 ceph-mon[124666]: pgmap v4919: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 8 op/s 2023-05-08T06:16:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9114.604934 secs 2023-05-08T06:16:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:15 smithi096 ceph-mon[124666]: osdmap e385: 12 total, 12 up, 12 in 2023-05-08T06:16:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:15 smithi186 ceph-mon[126480]: pgmap v4919: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 8 op/s 2023-05-08T06:16:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9114.604934 secs 2023-05-08T06:16:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:15 smithi186 ceph-mon[126480]: osdmap e385: 12 total, 12 up, 12 in 2023-05-08T06:16:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:17 smithi133 ceph-mon[125939]: pgmap v4921: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 23 KiB/s wr, 8 op/s 2023-05-08T06:16:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:17 smithi096 ceph-mon[124666]: pgmap v4921: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 23 KiB/s wr, 8 op/s 2023-05-08T06:16:18.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:17 smithi186 ceph-mon[126480]: pgmap v4921: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 23 KiB/s wr, 8 op/s 2023-05-08T06:16:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9117.767502 secs 2023-05-08T06:16:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9118.323812 secs 2023-05-08T06:16:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9117.767502 secs 2023-05-08T06:16:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9118.323812 secs 2023-05-08T06:16:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9117.767502 secs 2023-05-08T06:16:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9118.323812 secs 2023-05-08T06:16:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:19 smithi096 ceph-mon[124666]: pgmap v4922: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 23 KiB/s wr, 8 op/s 2023-05-08T06:16:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:19 smithi186 ceph-mon[126480]: pgmap v4922: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 23 KiB/s wr, 8 op/s 2023-05-08T06:16:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:19 smithi133 ceph-mon[125939]: pgmap v4922: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 23 KiB/s wr, 8 op/s 2023-05-08T06:16:21.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9119.605049 secs 2023-05-08T06:16:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9119.605049 secs 2023-05-08T06:16:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9119.605049 secs 2023-05-08T06:16:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:22 smithi186 ceph-mon[126480]: pgmap v4923: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 8 op/s 2023-05-08T06:16:22.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:22 smithi133 ceph-mon[125939]: pgmap v4923: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 8 op/s 2023-05-08T06:16:22.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:22 smithi096 ceph-mon[124666]: pgmap v4923: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 8 op/s 2023-05-08T06:16:23.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:23 smithi186 ceph-mon[126480]: pgmap v4924: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 8 op/s 2023-05-08T06:16:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:23 smithi133 ceph-mon[125939]: pgmap v4924: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 8 op/s 2023-05-08T06:16:23.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:23 smithi096 ceph-mon[124666]: pgmap v4924: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 8 op/s 2023-05-08T06:16:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9122.767634 secs 2023-05-08T06:16:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9123.323931 secs 2023-05-08T06:16:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9122.767634 secs 2023-05-08T06:16:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9123.323931 secs 2023-05-08T06:16:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9122.767634 secs 2023-05-08T06:16:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9123.323931 secs 2023-05-08T06:16:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:25 smithi133 ceph-mon[125939]: pgmap v4925: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 KiB/s wr, 8 op/s 2023-05-08T06:16:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9124.605182 secs 2023-05-08T06:16:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:25 smithi096 ceph-mon[124666]: pgmap v4925: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 KiB/s wr, 8 op/s 2023-05-08T06:16:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9124.605182 secs 2023-05-08T06:16:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:25 smithi186 ceph-mon[126480]: pgmap v4925: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 KiB/s wr, 8 op/s 2023-05-08T06:16:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9124.605182 secs 2023-05-08T06:16:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:27 smithi096 ceph-mon[124666]: pgmap v4926: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 KiB/s wr, 7 op/s 2023-05-08T06:16:28.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:27 smithi186 ceph-mon[126480]: pgmap v4926: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 KiB/s wr, 7 op/s 2023-05-08T06:16:28.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:27 smithi133 ceph-mon[125939]: pgmap v4926: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 KiB/s wr, 7 op/s 2023-05-08T06:16:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9127.767759 secs 2023-05-08T06:16:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9128.323995 secs 2023-05-08T06:16:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9127.767759 secs 2023-05-08T06:16:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9128.323995 secs 2023-05-08T06:16:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9127.767759 secs 2023-05-08T06:16:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9128.323995 secs 2023-05-08T06:16:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:29 smithi096 ceph-mon[124666]: pgmap v4927: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 28 KiB/s wr, 6 op/s 2023-05-08T06:16:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:29 smithi186 ceph-mon[126480]: pgmap v4927: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 28 KiB/s wr, 6 op/s 2023-05-08T06:16:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:29 smithi133 ceph-mon[125939]: pgmap v4927: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 28 KiB/s wr, 6 op/s 2023-05-08T06:16:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9129.605243 secs 2023-05-08T06:16:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9129.605243 secs 2023-05-08T06:16:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9129.605243 secs 2023-05-08T06:16:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:32 smithi096 ceph-mon[124666]: pgmap v4928: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 47 KiB/s wr, 10 op/s 2023-05-08T06:16:32.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:32 smithi186 ceph-mon[126480]: pgmap v4928: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 47 KiB/s wr, 10 op/s 2023-05-08T06:16:32.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:32 smithi133 ceph-mon[125939]: pgmap v4928: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 47 KiB/s wr, 10 op/s 2023-05-08T06:16:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:34 smithi186 ceph-mon[126480]: pgmap v4929: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 47 KiB/s wr, 7 op/s 2023-05-08T06:16:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9132.767902 secs 2023-05-08T06:16:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9133.324114 secs 2023-05-08T06:16:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:34 smithi133 ceph-mon[125939]: pgmap v4929: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 47 KiB/s wr, 7 op/s 2023-05-08T06:16:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9132.767902 secs 2023-05-08T06:16:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9133.324114 secs 2023-05-08T06:16:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:34 smithi096 ceph-mon[124666]: pgmap v4929: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 47 KiB/s wr, 7 op/s 2023-05-08T06:16:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9132.767902 secs 2023-05-08T06:16:34.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9133.324114 secs 2023-05-08T06:16:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:36 smithi186 ceph-mon[126480]: pgmap v4930: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 78 KiB/s wr, 10 op/s 2023-05-08T06:16:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9134.605383 secs 2023-05-08T06:16:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:36 smithi133 ceph-mon[125939]: pgmap v4930: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 78 KiB/s wr, 10 op/s 2023-05-08T06:16:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9134.605383 secs 2023-05-08T06:16:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:36 smithi096 ceph-mon[124666]: pgmap v4930: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 78 KiB/s wr, 10 op/s 2023-05-08T06:16:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9134.605383 secs 2023-05-08T06:16:37.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:37 smithi186 ceph-mon[126480]: pgmap v4931: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 51 KiB/s wr, 7 op/s 2023-05-08T06:16:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:37 smithi133 ceph-mon[125939]: pgmap v4931: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 51 KiB/s wr, 7 op/s 2023-05-08T06:16:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:37 smithi096 ceph-mon[124666]: pgmap v4931: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 51 KiB/s wr, 7 op/s 2023-05-08T06:16:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9137.768051 secs 2023-05-08T06:16:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9137.768051 secs 2023-05-08T06:16:38.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9137.768051 secs 2023-05-08T06:16:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:39 smithi133 ceph-mon[125939]: pgmap v4932: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 51 KiB/s wr, 6 op/s 2023-05-08T06:16:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:39 smithi096 ceph-mon[124666]: pgmap v4932: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 51 KiB/s wr, 6 op/s 2023-05-08T06:16:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:39 smithi186 ceph-mon[126480]: pgmap v4932: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 51 KiB/s wr, 6 op/s 2023-05-08T06:16:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:40 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:16:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9139.605445 secs 2023-05-08T06:16:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:40 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:16:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9139.605445 secs 2023-05-08T06:16:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:40 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:16:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9139.605445 secs 2023-05-08T06:16:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:16:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:16:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:41 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:16:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:16:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:41 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T06:16:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:41 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T06:16:41.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:41 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:16:41.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:41 smithi133 ceph-mon[125939]: pgmap v4933: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 87 KiB/s wr, 11 op/s 2023-05-08T06:16:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:16:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:16:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:41 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:16:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:16:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:41 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T06:16:41.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:41 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T06:16:41.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:41 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:16:41.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:41 smithi096 ceph-mon[124666]: pgmap v4933: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 87 KiB/s wr, 11 op/s 2023-05-08T06:16:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:16:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:16:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:41 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:16:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:16:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:41 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T06:16:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:41 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T06:16:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:41 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:16:41.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:41 smithi186 ceph-mon[126480]: pgmap v4933: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 87 KiB/s wr, 11 op/s 2023-05-08T06:16:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:16:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:16:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:16:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:43 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:16:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:16:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:16:43.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:43 smithi133 ceph-mon[125939]: pgmap v4934: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 68 KiB/s wr, 7 op/s 2023-05-08T06:16:43.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9142.768131 secs 2023-05-08T06:16:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:43 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:16:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:16:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:16:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:43 smithi096 ceph-mon[124666]: pgmap v4934: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 68 KiB/s wr, 7 op/s 2023-05-08T06:16:43.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9142.768131 secs 2023-05-08T06:16:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:43 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:16:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:16:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:16:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:43 smithi186 ceph-mon[126480]: pgmap v4934: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 68 KiB/s wr, 7 op/s 2023-05-08T06:16:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9142.768131 secs 2023-05-08T06:16:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:45 smithi096 ceph-mon[124666]: pgmap v4935: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 123 KiB/s wr, 12 op/s 2023-05-08T06:16:46.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:45 smithi186 ceph-mon[126480]: pgmap v4935: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 123 KiB/s wr, 12 op/s 2023-05-08T06:16:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:45 smithi133 ceph-mon[125939]: pgmap v4935: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 123 KiB/s wr, 12 op/s 2023-05-08T06:16:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:46 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:16:47.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:46 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:16:47.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:46 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:16:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:47 smithi096 ceph-mon[124666]: pgmap v4936: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 95 KiB/s wr, 10 op/s 2023-05-08T06:16:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:47 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:16:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:47 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:16:48.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:47 smithi186 ceph-mon[126480]: pgmap v4936: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 95 KiB/s wr, 10 op/s 2023-05-08T06:16:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:47 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:16:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:47 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:16:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:47 smithi133 ceph-mon[125939]: pgmap v4936: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 95 KiB/s wr, 10 op/s 2023-05-08T06:16:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:47 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:16:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:47 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:16:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9147.768257 secs 2023-05-08T06:16:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9148.324520 secs 2023-05-08T06:16:49.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9147.768257 secs 2023-05-08T06:16:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9148.324520 secs 2023-05-08T06:16:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9147.768257 secs 2023-05-08T06:16:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9148.324520 secs 2023-05-08T06:16:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:50 smithi186 ceph-mon[126480]: pgmap v4937: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 95 KiB/s wr, 9 op/s 2023-05-08T06:16:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:50 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:16:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:50 smithi133 ceph-mon[125939]: pgmap v4937: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 95 KiB/s wr, 9 op/s 2023-05-08T06:16:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:50 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:16:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:50 smithi096 ceph-mon[124666]: pgmap v4937: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 95 KiB/s wr, 9 op/s 2023-05-08T06:16:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:50 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:16:52.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:52 smithi186 ceph-mon[126480]: pgmap v4938: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 98 KiB/s wr, 13 op/s 2023-05-08T06:16:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:16:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:16:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:52 smithi133 ceph-mon[125939]: pgmap v4938: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 98 KiB/s wr, 13 op/s 2023-05-08T06:16:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:16:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:16:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:52 smithi096 ceph-mon[124666]: pgmap v4938: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 98 KiB/s wr, 13 op/s 2023-05-08T06:16:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:16:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:16:53.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:53 smithi186 ceph-mon[126480]: pgmap v4939: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 62 KiB/s wr, 9 op/s 2023-05-08T06:16:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:53 smithi133 ceph-mon[125939]: pgmap v4939: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 62 KiB/s wr, 9 op/s 2023-05-08T06:16:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:53 smithi096 ceph-mon[124666]: pgmap v4939: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 62 KiB/s wr, 9 op/s 2023-05-08T06:16:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:54 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:16:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9153.324646 secs 2023-05-08T06:16:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:54 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:16:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9153.324646 secs 2023-05-08T06:16:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:54 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:16:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9153.324646 secs 2023-05-08T06:16:55.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:55 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T06:16:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:55 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:16:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:55 smithi186 ceph-mon[126480]: pgmap v4940: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 120 KiB/s wr, 13 op/s 2023-05-08T06:16:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:55 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T06:16:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:55 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:16:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:55 smithi133 ceph-mon[125939]: pgmap v4940: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 120 KiB/s wr, 13 op/s 2023-05-08T06:16:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:55 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T06:16:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:55 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:16:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:55 smithi096 ceph-mon[124666]: pgmap v4940: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 120 KiB/s wr, 13 op/s 2023-05-08T06:16:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:57 smithi186 ceph-mon[126480]: pgmap v4941: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 69 KiB/s wr, 9 op/s 2023-05-08T06:16:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:57 smithi133 ceph-mon[125939]: pgmap v4941: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 69 KiB/s wr, 9 op/s 2023-05-08T06:16:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:57 smithi096 ceph-mon[124666]: pgmap v4941: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 69 KiB/s wr, 9 op/s 2023-05-08T06:16:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9157.768495 secs 2023-05-08T06:16:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9157.768495 secs 2023-05-08T06:16:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9157.768495 secs 2023-05-08T06:17:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9158.324727 secs 2023-05-08T06:17:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:16:59 smithi186 ceph-mon[126480]: pgmap v4942: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 65 KiB/s wr, 8 op/s 2023-05-08T06:17:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9158.324727 secs 2023-05-08T06:17:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:16:59 smithi133 ceph-mon[125939]: pgmap v4942: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 65 KiB/s wr, 8 op/s 2023-05-08T06:17:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9158.324727 secs 2023-05-08T06:17:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:16:59 smithi096 ceph-mon[124666]: pgmap v4942: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 65 KiB/s wr, 8 op/s 2023-05-08T06:17:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9159.605940 secs 2023-05-08T06:17:01.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9159.605940 secs 2023-05-08T06:17:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9159.605940 secs 2023-05-08T06:17:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:02 smithi096 ceph-mon[124666]: pgmap v4943: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 69 KiB/s wr, 12 op/s 2023-05-08T06:17:02.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:02 smithi186 ceph-mon[126480]: pgmap v4943: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 69 KiB/s wr, 12 op/s 2023-05-08T06:17:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:02 smithi133 ceph-mon[125939]: pgmap v4943: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 69 KiB/s wr, 12 op/s 2023-05-08T06:17:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:03 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:17:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T06:17:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:03 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:17:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:03 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:17:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T06:17:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:03 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:17:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:03 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:17:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T06:17:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:03 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:17:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:04 smithi186 ceph-mon[126480]: pgmap v4944: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 66 KiB/s wr, 8 op/s 2023-05-08T06:17:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:04 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:17:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:04 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:17:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9162.768612 secs 2023-05-08T06:17:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9163.324845 secs 2023-05-08T06:17:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:04 smithi133 ceph-mon[125939]: pgmap v4944: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 66 KiB/s wr, 8 op/s 2023-05-08T06:17:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:04 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:17:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:04 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:17:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9162.768612 secs 2023-05-08T06:17:04.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9163.324845 secs 2023-05-08T06:17:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:04 smithi096 ceph-mon[124666]: pgmap v4944: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 66 KiB/s wr, 8 op/s 2023-05-08T06:17:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:04 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:17:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:04 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:17:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9162.768612 secs 2023-05-08T06:17:04.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9163.324845 secs 2023-05-08T06:17:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:06 smithi186 ceph-mon[126480]: pgmap v4945: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 159 KiB/s wr, 26 op/s 2023-05-08T06:17:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9164.606049 secs 2023-05-08T06:17:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:06 smithi186 ceph-mon[126480]: osdmap e386: 12 total, 12 up, 12 in 2023-05-08T06:17:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:06 smithi133 ceph-mon[125939]: pgmap v4945: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 159 KiB/s wr, 26 op/s 2023-05-08T06:17:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9164.606049 secs 2023-05-08T06:17:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:06 smithi133 ceph-mon[125939]: osdmap e386: 12 total, 12 up, 12 in 2023-05-08T06:17:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:06 smithi096 ceph-mon[124666]: pgmap v4945: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 159 KiB/s wr, 26 op/s 2023-05-08T06:17:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9164.606049 secs 2023-05-08T06:17:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:06 smithi096 ceph-mon[124666]: osdmap e386: 12 total, 12 up, 12 in 2023-05-08T06:17:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:07 smithi186 ceph-mon[126480]: pgmap v4947: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 116 KiB/s wr, 27 op/s 2023-05-08T06:17:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:07 smithi133 ceph-mon[125939]: pgmap v4947: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 116 KiB/s wr, 27 op/s 2023-05-08T06:17:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:07 smithi096 ceph-mon[124666]: pgmap v4947: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 116 KiB/s wr, 27 op/s 2023-05-08T06:17:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9167.768754 secs 2023-05-08T06:17:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9167.768754 secs 2023-05-08T06:17:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9167.768754 secs 2023-05-08T06:17:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9168.324969 secs 2023-05-08T06:17:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:09 smithi133 ceph-mon[125939]: pgmap v4948: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 116 KiB/s wr, 27 op/s 2023-05-08T06:17:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9168.324969 secs 2023-05-08T06:17:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:09 smithi096 ceph-mon[124666]: pgmap v4948: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 116 KiB/s wr, 27 op/s 2023-05-08T06:17:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9168.324969 secs 2023-05-08T06:17:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:09 smithi186 ceph-mon[126480]: pgmap v4948: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 116 KiB/s wr, 27 op/s 2023-05-08T06:17:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9169.606169 secs 2023-05-08T06:17:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:10 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:17:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9169.606169 secs 2023-05-08T06:17:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:10 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:17:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9169.606169 secs 2023-05-08T06:17:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:10 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:17:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:11 smithi133 ceph-mon[125939]: pgmap v4949: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 117 KiB/s wr, 26 op/s 2023-05-08T06:17:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:11 smithi096 ceph-mon[124666]: pgmap v4949: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 117 KiB/s wr, 26 op/s 2023-05-08T06:17:11.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:11 smithi186 ceph-mon[126480]: pgmap v4949: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 117 KiB/s wr, 26 op/s 2023-05-08T06:17:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:13 smithi186 ceph-mon[126480]: pgmap v4950: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 117 KiB/s wr, 26 op/s 2023-05-08T06:17:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9172.768853 secs 2023-05-08T06:17:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:13 smithi133 ceph-mon[125939]: pgmap v4950: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 117 KiB/s wr, 26 op/s 2023-05-08T06:17:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9172.768853 secs 2023-05-08T06:17:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:13 smithi096 ceph-mon[124666]: pgmap v4950: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 117 KiB/s wr, 26 op/s 2023-05-08T06:17:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9172.768853 secs 2023-05-08T06:17:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9173.325108 secs 2023-05-08T06:17:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9173.325108 secs 2023-05-08T06:17:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9173.325108 secs 2023-05-08T06:17:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:15 smithi096 ceph-mon[124666]: pgmap v4951: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 7 op/s 2023-05-08T06:17:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9174.606305 secs 2023-05-08T06:17:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:15 smithi096 ceph-mon[124666]: osdmap e387: 12 total, 12 up, 12 in 2023-05-08T06:17:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:15 smithi186 ceph-mon[126480]: pgmap v4951: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 7 op/s 2023-05-08T06:17:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9174.606305 secs 2023-05-08T06:17:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:15 smithi186 ceph-mon[126480]: osdmap e387: 12 total, 12 up, 12 in 2023-05-08T06:17:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:15 smithi133 ceph-mon[125939]: pgmap v4951: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 7 op/s 2023-05-08T06:17:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9174.606305 secs 2023-05-08T06:17:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:15 smithi133 ceph-mon[125939]: osdmap e387: 12 total, 12 up, 12 in 2023-05-08T06:17:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:18 smithi096 ceph-mon[124666]: pgmap v4953: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 7 op/s 2023-05-08T06:17:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:18 smithi186 ceph-mon[126480]: pgmap v4953: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 7 op/s 2023-05-08T06:17:18.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:18 smithi133 ceph-mon[125939]: pgmap v4953: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 7 op/s 2023-05-08T06:17:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9177.768991 secs 2023-05-08T06:17:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9178.325240 secs 2023-05-08T06:17:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9177.768991 secs 2023-05-08T06:17:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9178.325240 secs 2023-05-08T06:17:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9177.768991 secs 2023-05-08T06:17:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9178.325240 secs 2023-05-08T06:17:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:20 smithi186 ceph-mon[126480]: pgmap v4954: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 7 op/s 2023-05-08T06:17:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:20 smithi133 ceph-mon[125939]: pgmap v4954: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 7 op/s 2023-05-08T06:17:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:20 smithi096 ceph-mon[124666]: pgmap v4954: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 7 op/s 2023-05-08T06:17:21.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9179.606418 secs 2023-05-08T06:17:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9179.606418 secs 2023-05-08T06:17:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9179.606418 secs 2023-05-08T06:17:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:22 smithi186 ceph-mon[126480]: pgmap v4955: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 7 op/s 2023-05-08T06:17:22.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:22 smithi133 ceph-mon[125939]: pgmap v4955: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 7 op/s 2023-05-08T06:17:22.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:22 smithi096 ceph-mon[124666]: pgmap v4955: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 7 op/s 2023-05-08T06:17:23.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:23 smithi186 ceph-mon[126480]: pgmap v4956: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 7 op/s 2023-05-08T06:17:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:23 smithi133 ceph-mon[125939]: pgmap v4956: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 7 op/s 2023-05-08T06:17:23.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:23 smithi096 ceph-mon[124666]: pgmap v4956: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 7 op/s 2023-05-08T06:17:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9182.769042 secs 2023-05-08T06:17:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9183.325357 secs 2023-05-08T06:17:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9182.769042 secs 2023-05-08T06:17:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9183.325357 secs 2023-05-08T06:17:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9182.769042 secs 2023-05-08T06:17:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9183.325357 secs 2023-05-08T06:17:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:25 smithi096 ceph-mon[124666]: pgmap v4957: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 8 op/s 2023-05-08T06:17:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9184.606535 secs 2023-05-08T06:17:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:26 smithi186 ceph-mon[126480]: pgmap v4957: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 8 op/s 2023-05-08T06:17:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9184.606535 secs 2023-05-08T06:17:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:26 smithi133 ceph-mon[125939]: pgmap v4957: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 8 op/s 2023-05-08T06:17:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9184.606535 secs 2023-05-08T06:17:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:28 smithi096 ceph-mon[124666]: pgmap v4958: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 7 op/s 2023-05-08T06:17:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:28 smithi186 ceph-mon[126480]: pgmap v4958: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 7 op/s 2023-05-08T06:17:28.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:28 smithi133 ceph-mon[125939]: pgmap v4958: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 7 op/s 2023-05-08T06:17:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9187.769158 secs 2023-05-08T06:17:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9188.325507 secs 2023-05-08T06:17:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9187.769158 secs 2023-05-08T06:17:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9188.325507 secs 2023-05-08T06:17:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9187.769158 secs 2023-05-08T06:17:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9188.325507 secs 2023-05-08T06:17:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:30 smithi186 ceph-mon[126480]: pgmap v4959: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 28 KiB/s wr, 6 op/s 2023-05-08T06:17:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:30 smithi133 ceph-mon[125939]: pgmap v4959: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 28 KiB/s wr, 6 op/s 2023-05-08T06:17:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:30 smithi096 ceph-mon[124666]: pgmap v4959: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 28 KiB/s wr, 6 op/s 2023-05-08T06:17:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9189.606673 secs 2023-05-08T06:17:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9189.606673 secs 2023-05-08T06:17:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9189.606673 secs 2023-05-08T06:17:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:32 smithi186 ceph-mon[126480]: pgmap v4960: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 10 op/s 2023-05-08T06:17:32.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:32 smithi133 ceph-mon[125939]: pgmap v4960: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 10 op/s 2023-05-08T06:17:32.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:32 smithi096 ceph-mon[124666]: pgmap v4960: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 10 op/s 2023-05-08T06:17:33.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:33 smithi186 ceph-mon[126480]: pgmap v4961: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 6 op/s 2023-05-08T06:17:33.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:33 smithi133 ceph-mon[125939]: pgmap v4961: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 6 op/s 2023-05-08T06:17:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:33 smithi096 ceph-mon[124666]: pgmap v4961: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 6 op/s 2023-05-08T06:17:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9192.769219 secs 2023-05-08T06:17:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9193.325631 secs 2023-05-08T06:17:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9192.769219 secs 2023-05-08T06:17:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9193.325631 secs 2023-05-08T06:17:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9192.769219 secs 2023-05-08T06:17:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9193.325631 secs 2023-05-08T06:17:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:36 smithi096 ceph-mon[124666]: pgmap v4962: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 63 KiB/s wr, 9 op/s 2023-05-08T06:17:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9194.606799 secs 2023-05-08T06:17:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:36 smithi186 ceph-mon[126480]: pgmap v4962: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 63 KiB/s wr, 9 op/s 2023-05-08T06:17:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9194.606799 secs 2023-05-08T06:17:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:36 smithi133 ceph-mon[125939]: pgmap v4962: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 63 KiB/s wr, 9 op/s 2023-05-08T06:17:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9194.606799 secs 2023-05-08T06:17:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:38 smithi186 ceph-mon[126480]: pgmap v4963: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 36 KiB/s wr, 6 op/s 2023-05-08T06:17:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:38 smithi133 ceph-mon[125939]: pgmap v4963: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 36 KiB/s wr, 6 op/s 2023-05-08T06:17:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:38 smithi096 ceph-mon[124666]: pgmap v4963: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 36 KiB/s wr, 6 op/s 2023-05-08T06:17:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9197.769328 secs 2023-05-08T06:17:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9197.769328 secs 2023-05-08T06:17:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9197.769328 secs 2023-05-08T06:17:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:40 smithi186 ceph-mon[126480]: pgmap v4964: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 36 KiB/s wr, 6 op/s 2023-05-08T06:17:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:40 smithi133 ceph-mon[125939]: pgmap v4964: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 36 KiB/s wr, 6 op/s 2023-05-08T06:17:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:40 smithi096 ceph-mon[124666]: pgmap v4964: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 36 KiB/s wr, 6 op/s 2023-05-08T06:17:41.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9199.606856 secs 2023-05-08T06:17:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:17:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9199.606856 secs 2023-05-08T06:17:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:17:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9199.606856 secs 2023-05-08T06:17:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:17:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:42 smithi186 ceph-mon[126480]: pgmap v4965: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 91 KiB/s wr, 11 op/s 2023-05-08T06:17:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:17:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:17:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:42 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:17:42.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:17:42.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:42 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T06:17:42.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:42 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T06:17:42.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:42 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:17:42.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:42 smithi133 ceph-mon[125939]: pgmap v4965: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 91 KiB/s wr, 11 op/s 2023-05-08T06:17:42.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:17:42.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:17:42.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:42 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:17:42.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:17:42.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:42 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T06:17:42.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:42 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T06:17:42.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:42 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:17:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:42 smithi096 ceph-mon[124666]: pgmap v4965: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 91 KiB/s wr, 11 op/s 2023-05-08T06:17:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:17:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:17:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:42 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:17:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:17:42.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:42 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T06:17:42.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:42 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T06:17:42.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:42 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:17:43.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:17:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:43 smithi186 ceph-mon[126480]: pgmap v4966: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 88 KiB/s wr, 8 op/s 2023-05-08T06:17:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:17:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:43 smithi133 ceph-mon[125939]: pgmap v4966: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 88 KiB/s wr, 8 op/s 2023-05-08T06:17:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:17:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:43 smithi096 ceph-mon[124666]: pgmap v4966: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 88 KiB/s wr, 8 op/s 2023-05-08T06:17:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:17:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9202.769397 secs 2023-05-08T06:17:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:17:44.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:17:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:17:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9202.769397 secs 2023-05-08T06:17:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:17:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:17:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:17:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9202.769397 secs 2023-05-08T06:17:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:17:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:17:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:46 smithi186 ceph-mon[126480]: pgmap v4967: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 145 KiB/s wr, 13 op/s 2023-05-08T06:17:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:46 smithi133 ceph-mon[125939]: pgmap v4967: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 145 KiB/s wr, 13 op/s 2023-05-08T06:17:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:46 smithi096 ceph-mon[124666]: pgmap v4967: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 145 KiB/s wr, 13 op/s 2023-05-08T06:17:47.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:17:47.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:17:47.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:17:48.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:48 smithi186 ceph-mon[126480]: pgmap v4968: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 117 KiB/s wr, 11 op/s 2023-05-08T06:17:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:17:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:17:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:48 smithi133 ceph-mon[125939]: pgmap v4968: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 117 KiB/s wr, 11 op/s 2023-05-08T06:17:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:17:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:17:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:48 smithi096 ceph-mon[124666]: pgmap v4968: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 117 KiB/s wr, 11 op/s 2023-05-08T06:17:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:17:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:17:49.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9207.769515 secs 2023-05-08T06:17:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9208.325962 secs 2023-05-08T06:17:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9207.769515 secs 2023-05-08T06:17:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9208.325962 secs 2023-05-08T06:17:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9207.769515 secs 2023-05-08T06:17:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9208.325962 secs 2023-05-08T06:17:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:50 smithi186 ceph-mon[126480]: pgmap v4969: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 117 KiB/s wr, 10 op/s 2023-05-08T06:17:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:50 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:17:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:50 smithi133 ceph-mon[125939]: pgmap v4969: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 117 KiB/s wr, 10 op/s 2023-05-08T06:17:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:50 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:17:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:50 smithi096 ceph-mon[124666]: pgmap v4969: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 117 KiB/s wr, 10 op/s 2023-05-08T06:17:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:50 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:17:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:51 smithi186 ceph-mon[126480]: pgmap v4970: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 120 KiB/s wr, 14 op/s 2023-05-08T06:17:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:51 smithi133 ceph-mon[125939]: pgmap v4970: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 120 KiB/s wr, 14 op/s 2023-05-08T06:17:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:51 smithi096 ceph-mon[124666]: pgmap v4970: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 120 KiB/s wr, 14 op/s 2023-05-08T06:17:52.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:17:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:17:52.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:17:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:17:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:17:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:17:53.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:53 smithi186 ceph-mon[126480]: pgmap v4971: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 65 KiB/s wr, 9 op/s 2023-05-08T06:17:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:53 smithi133 ceph-mon[125939]: pgmap v4971: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 65 KiB/s wr, 9 op/s 2023-05-08T06:17:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:53 smithi096 ceph-mon[124666]: pgmap v4971: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 65 KiB/s wr, 9 op/s 2023-05-08T06:17:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9212.769630 secs 2023-05-08T06:17:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9213.326111 secs 2023-05-08T06:17:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9212.769630 secs 2023-05-08T06:17:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9213.326111 secs 2023-05-08T06:17:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9212.769630 secs 2023-05-08T06:17:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9213.326111 secs 2023-05-08T06:17:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:55 smithi186 ceph-mon[126480]: pgmap v4972: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 123 KiB/s wr, 13 op/s 2023-05-08T06:17:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:55 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:17:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:55 smithi133 ceph-mon[125939]: pgmap v4972: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 123 KiB/s wr, 13 op/s 2023-05-08T06:17:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:55 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:17:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:55 smithi096 ceph-mon[124666]: pgmap v4972: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 123 KiB/s wr, 13 op/s 2023-05-08T06:17:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:55 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:17:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:57 smithi186 ceph-mon[126480]: pgmap v4973: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 70 KiB/s wr, 9 op/s 2023-05-08T06:17:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:57 smithi133 ceph-mon[125939]: pgmap v4973: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 70 KiB/s wr, 9 op/s 2023-05-08T06:17:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:57 smithi096 ceph-mon[124666]: pgmap v4973: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 70 KiB/s wr, 9 op/s 2023-05-08T06:17:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9217.769772 secs 2023-05-08T06:17:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9217.769772 secs 2023-05-08T06:17:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9217.769772 secs 2023-05-08T06:18:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9218.326229 secs 2023-05-08T06:18:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:17:59 smithi186 ceph-mon[126480]: pgmap v4974: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 65 KiB/s wr, 8 op/s 2023-05-08T06:18:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9218.326229 secs 2023-05-08T06:18:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:17:59 smithi133 ceph-mon[125939]: pgmap v4974: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 65 KiB/s wr, 8 op/s 2023-05-08T06:18:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9218.326229 secs 2023-05-08T06:18:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:17:59 smithi096 ceph-mon[124666]: pgmap v4974: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 65 KiB/s wr, 8 op/s 2023-05-08T06:18:01.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9219.607332 secs 2023-05-08T06:18:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9219.607332 secs 2023-05-08T06:18:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9219.607332 secs 2023-05-08T06:18:02.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:02 smithi186 ceph-mon[126480]: pgmap v4975: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 69 KiB/s wr, 12 op/s 2023-05-08T06:18:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:02 smithi133 ceph-mon[125939]: pgmap v4975: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 69 KiB/s wr, 12 op/s 2023-05-08T06:18:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:02 smithi096 ceph-mon[124666]: pgmap v4975: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 69 KiB/s wr, 12 op/s 2023-05-08T06:18:03.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:03 smithi186 ceph-mon[126480]: pgmap v4976: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 66 KiB/s wr, 8 op/s 2023-05-08T06:18:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:03 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:18:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:18:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:03 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:18:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:03 smithi133 ceph-mon[125939]: pgmap v4976: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 66 KiB/s wr, 8 op/s 2023-05-08T06:18:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:03 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:18:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:18:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:03 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:18:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:03 smithi096 ceph-mon[124666]: pgmap v4976: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 66 KiB/s wr, 8 op/s 2023-05-08T06:18:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:03 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:18:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:18:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:03 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:18:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9222.769912 secs 2023-05-08T06:18:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9223.326342 secs 2023-05-08T06:18:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9222.769912 secs 2023-05-08T06:18:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9223.326342 secs 2023-05-08T06:18:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9222.769912 secs 2023-05-08T06:18:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9223.326342 secs 2023-05-08T06:18:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:06 smithi186 ceph-mon[126480]: pgmap v4977: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 147 KiB/s wr, 26 op/s 2023-05-08T06:18:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9224.607456 secs 2023-05-08T06:18:06.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:06 smithi186 ceph-mon[126480]: osdmap e388: 12 total, 12 up, 12 in 2023-05-08T06:18:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:06 smithi133 ceph-mon[125939]: pgmap v4977: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 147 KiB/s wr, 26 op/s 2023-05-08T06:18:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9224.607456 secs 2023-05-08T06:18:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:06 smithi133 ceph-mon[125939]: osdmap e388: 12 total, 12 up, 12 in 2023-05-08T06:18:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:06 smithi096 ceph-mon[124666]: pgmap v4977: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 147 KiB/s wr, 26 op/s 2023-05-08T06:18:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9224.607456 secs 2023-05-08T06:18:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:06 smithi096 ceph-mon[124666]: osdmap e388: 12 total, 12 up, 12 in 2023-05-08T06:18:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:08 smithi186 ceph-mon[126480]: pgmap v4979: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 102 KiB/s wr, 26 op/s 2023-05-08T06:18:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:08 smithi133 ceph-mon[125939]: pgmap v4979: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 102 KiB/s wr, 26 op/s 2023-05-08T06:18:08.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:08 smithi096 ceph-mon[124666]: pgmap v4979: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 102 KiB/s wr, 26 op/s 2023-05-08T06:18:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9227.770045 secs 2023-05-08T06:18:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9228.326505 secs 2023-05-08T06:18:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9227.770045 secs 2023-05-08T06:18:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9228.326505 secs 2023-05-08T06:18:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9227.770045 secs 2023-05-08T06:18:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9228.326505 secs 2023-05-08T06:18:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:10 smithi186 ceph-mon[126480]: pgmap v4980: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 102 KiB/s wr, 26 op/s 2023-05-08T06:18:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:10 smithi133 ceph-mon[125939]: pgmap v4980: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 102 KiB/s wr, 26 op/s 2023-05-08T06:18:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:10 smithi096 ceph-mon[124666]: pgmap v4980: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 102 KiB/s wr, 26 op/s 2023-05-08T06:18:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9229.607587 secs 2023-05-08T06:18:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:11 smithi186 ceph-mon[126480]: pgmap v4981: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 102 KiB/s wr, 26 op/s 2023-05-08T06:18:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9229.607587 secs 2023-05-08T06:18:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:11 smithi133 ceph-mon[125939]: pgmap v4981: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 102 KiB/s wr, 26 op/s 2023-05-08T06:18:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9229.607587 secs 2023-05-08T06:18:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:11 smithi096 ceph-mon[124666]: pgmap v4981: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 102 KiB/s wr, 26 op/s 2023-05-08T06:18:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:13 smithi186 ceph-mon[126480]: pgmap v4982: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 102 KiB/s wr, 26 op/s 2023-05-08T06:18:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9232.770106 secs 2023-05-08T06:18:14.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:13 smithi133 ceph-mon[125939]: pgmap v4982: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 102 KiB/s wr, 26 op/s 2023-05-08T06:18:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9232.770106 secs 2023-05-08T06:18:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:13 smithi096 ceph-mon[124666]: pgmap v4982: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 102 KiB/s wr, 26 op/s 2023-05-08T06:18:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9232.770106 secs 2023-05-08T06:18:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9233.326586 secs 2023-05-08T06:18:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9233.326586 secs 2023-05-08T06:18:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9233.326586 secs 2023-05-08T06:18:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:16 smithi186 ceph-mon[126480]: pgmap v4983: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 18 KiB/s wr, 8 op/s 2023-05-08T06:18:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9234.607728 secs 2023-05-08T06:18:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:16 smithi186 ceph-mon[126480]: osdmap e389: 12 total, 12 up, 12 in 2023-05-08T06:18:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:16 smithi133 ceph-mon[125939]: pgmap v4983: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 18 KiB/s wr, 8 op/s 2023-05-08T06:18:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9234.607728 secs 2023-05-08T06:18:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:16 smithi133 ceph-mon[125939]: osdmap e389: 12 total, 12 up, 12 in 2023-05-08T06:18:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:16 smithi096 ceph-mon[124666]: pgmap v4983: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 18 KiB/s wr, 8 op/s 2023-05-08T06:18:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9234.607728 secs 2023-05-08T06:18:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:16 smithi096 ceph-mon[124666]: osdmap e389: 12 total, 12 up, 12 in 2023-05-08T06:18:18.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:18 smithi186 ceph-mon[126480]: pgmap v4985: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 23 KiB/s wr, 9 op/s 2023-05-08T06:18:18.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:18 smithi133 ceph-mon[125939]: pgmap v4985: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 23 KiB/s wr, 9 op/s 2023-05-08T06:18:18.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:18 smithi096 ceph-mon[124666]: pgmap v4985: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 23 KiB/s wr, 9 op/s 2023-05-08T06:18:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9237.770241 secs 2023-05-08T06:18:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9238.326700 secs 2023-05-08T06:18:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9237.770241 secs 2023-05-08T06:18:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9238.326700 secs 2023-05-08T06:18:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9237.770241 secs 2023-05-08T06:18:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9238.326700 secs 2023-05-08T06:18:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:20 smithi186 ceph-mon[126480]: pgmap v4986: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 23 KiB/s wr, 9 op/s 2023-05-08T06:18:20.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:20 smithi133 ceph-mon[125939]: pgmap v4986: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 23 KiB/s wr, 9 op/s 2023-05-08T06:18:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:20 smithi096 ceph-mon[124666]: pgmap v4986: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 23 KiB/s wr, 9 op/s 2023-05-08T06:18:21.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9239.607809 secs 2023-05-08T06:18:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9239.607809 secs 2023-05-08T06:18:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9239.607809 secs 2023-05-08T06:18:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:22 smithi186 ceph-mon[126480]: pgmap v4987: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 8 op/s 2023-05-08T06:18:22.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:22 smithi133 ceph-mon[125939]: pgmap v4987: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 8 op/s 2023-05-08T06:18:22.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:22 smithi096 ceph-mon[124666]: pgmap v4987: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 8 op/s 2023-05-08T06:18:23.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:23 smithi186 ceph-mon[126480]: pgmap v4988: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 8 op/s 2023-05-08T06:18:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:23 smithi133 ceph-mon[125939]: pgmap v4988: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 8 op/s 2023-05-08T06:18:23.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:23 smithi096 ceph-mon[124666]: pgmap v4988: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 8 op/s 2023-05-08T06:18:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9242.770358 secs 2023-05-08T06:18:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9243.326819 secs 2023-05-08T06:18:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9242.770358 secs 2023-05-08T06:18:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9243.326819 secs 2023-05-08T06:18:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9242.770358 secs 2023-05-08T06:18:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9243.326819 secs 2023-05-08T06:18:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:26 smithi186 ceph-mon[126480]: pgmap v4989: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 39 KiB/s wr, 8 op/s 2023-05-08T06:18:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9244.607888 secs 2023-05-08T06:18:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:26 smithi133 ceph-mon[125939]: pgmap v4989: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 39 KiB/s wr, 8 op/s 2023-05-08T06:18:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9244.607888 secs 2023-05-08T06:18:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:26 smithi096 ceph-mon[124666]: pgmap v4989: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 39 KiB/s wr, 8 op/s 2023-05-08T06:18:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9244.607888 secs 2023-05-08T06:18:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:28 smithi186 ceph-mon[126480]: pgmap v4990: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 33 KiB/s wr, 7 op/s 2023-05-08T06:18:28.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:28 smithi133 ceph-mon[125939]: pgmap v4990: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 33 KiB/s wr, 7 op/s 2023-05-08T06:18:28.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:28 smithi096 ceph-mon[124666]: pgmap v4990: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 33 KiB/s wr, 7 op/s 2023-05-08T06:18:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9247.770465 secs 2023-05-08T06:18:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9248.326919 secs 2023-05-08T06:18:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9247.770465 secs 2023-05-08T06:18:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9248.326919 secs 2023-05-08T06:18:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9247.770465 secs 2023-05-08T06:18:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9248.326919 secs 2023-05-08T06:18:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:30 smithi186 ceph-mon[126480]: pgmap v4991: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 28 KiB/s wr, 6 op/s 2023-05-08T06:18:30.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:30 smithi133 ceph-mon[125939]: pgmap v4991: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 28 KiB/s wr, 6 op/s 2023-05-08T06:18:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:30 smithi096 ceph-mon[124666]: pgmap v4991: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 28 KiB/s wr, 6 op/s 2023-05-08T06:18:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9249.607949 secs 2023-05-08T06:18:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9249.607949 secs 2023-05-08T06:18:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9249.607949 secs 2023-05-08T06:18:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:32 smithi186 ceph-mon[126480]: pgmap v4992: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 10 op/s 2023-05-08T06:18:32.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:32 smithi133 ceph-mon[125939]: pgmap v4992: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 10 op/s 2023-05-08T06:18:32.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:32 smithi096 ceph-mon[124666]: pgmap v4992: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 10 op/s 2023-05-08T06:18:33.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:33 smithi186 ceph-mon[126480]: pgmap v4993: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 32 KiB/s wr, 7 op/s 2023-05-08T06:18:33.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:33 smithi133 ceph-mon[125939]: pgmap v4993: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 32 KiB/s wr, 7 op/s 2023-05-08T06:18:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:33 smithi096 ceph-mon[124666]: pgmap v4993: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 32 KiB/s wr, 7 op/s 2023-05-08T06:18:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9252.770569 secs 2023-05-08T06:18:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9253.327061 secs 2023-05-08T06:18:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9252.770569 secs 2023-05-08T06:18:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9253.327061 secs 2023-05-08T06:18:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9252.770569 secs 2023-05-08T06:18:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9253.327061 secs 2023-05-08T06:18:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:36 smithi186 ceph-mon[126480]: pgmap v4994: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 65 KiB/s wr, 9 op/s 2023-05-08T06:18:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9254.608048 secs 2023-05-08T06:18:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:36 smithi133 ceph-mon[125939]: pgmap v4994: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 65 KiB/s wr, 9 op/s 2023-05-08T06:18:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9254.608048 secs 2023-05-08T06:18:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:36 smithi096 ceph-mon[124666]: pgmap v4994: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 65 KiB/s wr, 9 op/s 2023-05-08T06:18:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9254.608048 secs 2023-05-08T06:18:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:38 smithi186 ceph-mon[126480]: pgmap v4995: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 37 KiB/s wr, 7 op/s 2023-05-08T06:18:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:38 smithi133 ceph-mon[125939]: pgmap v4995: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 37 KiB/s wr, 7 op/s 2023-05-08T06:18:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:38 smithi096 ceph-mon[124666]: pgmap v4995: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 37 KiB/s wr, 7 op/s 2023-05-08T06:18:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9257.770646 secs 2023-05-08T06:18:39.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9257.770646 secs 2023-05-08T06:18:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9257.770646 secs 2023-05-08T06:18:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:40 smithi186 ceph-mon[126480]: pgmap v4996: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 37 KiB/s wr, 6 op/s 2023-05-08T06:18:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:40 smithi133 ceph-mon[125939]: pgmap v4996: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 37 KiB/s wr, 6 op/s 2023-05-08T06:18:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:40 smithi096 ceph-mon[124666]: pgmap v4996: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 37 KiB/s wr, 6 op/s 2023-05-08T06:18:42.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:42 smithi186 ceph-mon[126480]: pgmap v4997: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 73 KiB/s wr, 11 op/s 2023-05-08T06:18:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:18:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:18:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:18:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:18:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:18:42.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:18:42.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:18:42.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:42 smithi133 ceph-mon[125939]: pgmap v4997: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 73 KiB/s wr, 11 op/s 2023-05-08T06:18:42.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:18:42.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:18:42.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:18:42.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:18:42.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:18:42.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:18:42.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:18:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:42 smithi096 ceph-mon[124666]: pgmap v4997: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 73 KiB/s wr, 11 op/s 2023-05-08T06:18:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:18:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:18:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:18:42.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:18:42.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:18:42.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:18:42.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:18:43.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:18:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:18:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:43 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:18:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:43 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:18:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:43 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:18:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:18:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:18:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:43 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:18:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:43 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:18:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:43 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:18:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:18:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:18:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:43 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:18:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:43 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:18:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:43 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:18:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:44 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:18:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:44 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T06:18:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:44 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T06:18:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:44 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:18:44.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:44 smithi186 ceph-mon[126480]: pgmap v4998: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 70 KiB/s wr, 7 op/s 2023-05-08T06:18:44.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:44 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:18:44.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9262.770702 secs 2023-05-08T06:18:44.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:18:44.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:18:44.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:18:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:44 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:18:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:44 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T06:18:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:44 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T06:18:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:44 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:18:44.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:44 smithi133 ceph-mon[125939]: pgmap v4998: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 70 KiB/s wr, 7 op/s 2023-05-08T06:18:44.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:44 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:18:44.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9262.770702 secs 2023-05-08T06:18:44.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:18:44.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:18:44.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:18:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:44 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:18:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:44 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T06:18:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:44 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T06:18:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:44 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:18:44.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:44 smithi096 ceph-mon[124666]: pgmap v4998: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 70 KiB/s wr, 7 op/s 2023-05-08T06:18:44.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:44 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:18:44.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9262.770702 secs 2023-05-08T06:18:44.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:18:44.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:18:44.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:18:46.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:46 smithi186 ceph-mon[126480]: pgmap v4999: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 127 KiB/s wr, 12 op/s 2023-05-08T06:18:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:46 smithi133 ceph-mon[125939]: pgmap v4999: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 127 KiB/s wr, 12 op/s 2023-05-08T06:18:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:46 smithi096 ceph-mon[124666]: pgmap v4999: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 127 KiB/s wr, 12 op/s 2023-05-08T06:18:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:48 smithi186 ceph-mon[126480]: pgmap v5000: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 98 KiB/s wr, 10 op/s 2023-05-08T06:18:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:48 smithi133 ceph-mon[125939]: pgmap v5000: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 98 KiB/s wr, 10 op/s 2023-05-08T06:18:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:48 smithi096 ceph-mon[124666]: pgmap v5000: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 98 KiB/s wr, 10 op/s 2023-05-08T06:18:49.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9267.770768 secs 2023-05-08T06:18:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9268.327433 secs 2023-05-08T06:18:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9267.770768 secs 2023-05-08T06:18:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9268.327433 secs 2023-05-08T06:18:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9267.770768 secs 2023-05-08T06:18:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9268.327433 secs 2023-05-08T06:18:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:50 smithi186 ceph-mon[126480]: pgmap v5001: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 98 KiB/s wr, 9 op/s 2023-05-08T06:18:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:50 smithi133 ceph-mon[125939]: pgmap v5001: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 98 KiB/s wr, 9 op/s 2023-05-08T06:18:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:50 smithi096 ceph-mon[124666]: pgmap v5001: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 98 KiB/s wr, 9 op/s 2023-05-08T06:18:51.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:51 smithi186 ceph-mon[126480]: pgmap v5002: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 118 KiB/s wr, 14 op/s 2023-05-08T06:18:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:51 smithi133 ceph-mon[125939]: pgmap v5002: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 118 KiB/s wr, 14 op/s 2023-05-08T06:18:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:51 smithi096 ceph-mon[124666]: pgmap v5002: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 118 KiB/s wr, 14 op/s 2023-05-08T06:18:52.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:52 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:18:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:18:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:18:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:52 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:18:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:18:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:18:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:52 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:18:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:18:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:18:53.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:53 smithi186 ceph-mon[126480]: pgmap v5003: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 82 KiB/s wr, 10 op/s 2023-05-08T06:18:53.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:53 smithi133 ceph-mon[125939]: pgmap v5003: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 82 KiB/s wr, 10 op/s 2023-05-08T06:18:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:53 smithi096 ceph-mon[124666]: pgmap v5003: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 82 KiB/s wr, 10 op/s 2023-05-08T06:18:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9272.770896 secs 2023-05-08T06:18:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9273.327553 secs 2023-05-08T06:18:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9272.770896 secs 2023-05-08T06:18:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9273.327553 secs 2023-05-08T06:18:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9272.770896 secs 2023-05-08T06:18:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9273.327553 secs 2023-05-08T06:18:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:56 smithi186 ceph-mon[126480]: pgmap v5004: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 141 KiB/s wr, 13 op/s 2023-05-08T06:18:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:56 smithi133 ceph-mon[125939]: pgmap v5004: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 141 KiB/s wr, 13 op/s 2023-05-08T06:18:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:56 smithi096 ceph-mon[124666]: pgmap v5004: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 141 KiB/s wr, 13 op/s 2023-05-08T06:18:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:58 smithi186 ceph-mon[126480]: pgmap v5005: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 86 KiB/s wr, 9 op/s 2023-05-08T06:18:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:58 smithi133 ceph-mon[125939]: pgmap v5005: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 86 KiB/s wr, 9 op/s 2023-05-08T06:18:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:58 smithi096 ceph-mon[124666]: pgmap v5005: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 86 KiB/s wr, 9 op/s 2023-05-08T06:18:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9277.770992 secs 2023-05-08T06:18:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:18:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9278.327671 secs 2023-05-08T06:18:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9277.770992 secs 2023-05-08T06:18:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:18:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9278.327671 secs 2023-05-08T06:18:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9277.770992 secs 2023-05-08T06:18:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:18:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9278.327671 secs 2023-05-08T06:19:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:00 smithi186 ceph-mon[126480]: pgmap v5006: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 81 KiB/s wr, 8 op/s 2023-05-08T06:19:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:00 smithi133 ceph-mon[125939]: pgmap v5006: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 81 KiB/s wr, 8 op/s 2023-05-08T06:19:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:00 smithi096 ceph-mon[124666]: pgmap v5006: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 81 KiB/s wr, 8 op/s 2023-05-08T06:19:01.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9279.608547 secs 2023-05-08T06:19:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:01 smithi186 ceph-mon[126480]: pgmap v5007: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 114 KiB/s wr, 13 op/s 2023-05-08T06:19:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9279.608547 secs 2023-05-08T06:19:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:01 smithi133 ceph-mon[125939]: pgmap v5007: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 114 KiB/s wr, 13 op/s 2023-05-08T06:19:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9279.608547 secs 2023-05-08T06:19:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:01 smithi096 ceph-mon[124666]: pgmap v5007: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 114 KiB/s wr, 13 op/s 2023-05-08T06:19:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:02 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:19:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:19:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:19:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:02 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:19:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:19:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:19:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:02 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:19:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:19:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:19:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:03 smithi186 ceph-mon[126480]: pgmap v5008: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 93 KiB/s wr, 8 op/s 2023-05-08T06:19:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:03 smithi133 ceph-mon[125939]: pgmap v5008: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 93 KiB/s wr, 8 op/s 2023-05-08T06:19:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:03 smithi096 ceph-mon[124666]: pgmap v5008: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 93 KiB/s wr, 8 op/s 2023-05-08T06:19:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9282.771125 secs 2023-05-08T06:19:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9283.327786 secs 2023-05-08T06:19:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9282.771125 secs 2023-05-08T06:19:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9283.327786 secs 2023-05-08T06:19:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9282.771125 secs 2023-05-08T06:19:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9283.327786 secs 2023-05-08T06:19:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:06 smithi186 ceph-mon[126480]: pgmap v5009: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 177 KiB/s wr, 27 op/s 2023-05-08T06:19:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9284.608667 secs 2023-05-08T06:19:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:06 smithi186 ceph-mon[126480]: osdmap e390: 12 total, 12 up, 12 in 2023-05-08T06:19:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:06 smithi133 ceph-mon[125939]: pgmap v5009: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 177 KiB/s wr, 27 op/s 2023-05-08T06:19:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9284.608667 secs 2023-05-08T06:19:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:06 smithi133 ceph-mon[125939]: osdmap e390: 12 total, 12 up, 12 in 2023-05-08T06:19:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:06 smithi096 ceph-mon[124666]: pgmap v5009: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 177 KiB/s wr, 27 op/s 2023-05-08T06:19:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9284.608667 secs 2023-05-08T06:19:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:06 smithi096 ceph-mon[124666]: osdmap e390: 12 total, 12 up, 12 in 2023-05-08T06:19:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:08 smithi186 ceph-mon[126480]: pgmap v5011: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 140 KiB/s wr, 27 op/s 2023-05-08T06:19:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:08 smithi133 ceph-mon[125939]: pgmap v5011: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 140 KiB/s wr, 27 op/s 2023-05-08T06:19:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:08 smithi096 ceph-mon[124666]: pgmap v5011: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 140 KiB/s wr, 27 op/s 2023-05-08T06:19:09.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9287.771192 secs 2023-05-08T06:19:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9288.327893 secs 2023-05-08T06:19:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9287.771192 secs 2023-05-08T06:19:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9288.327893 secs 2023-05-08T06:19:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9287.771192 secs 2023-05-08T06:19:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9288.327893 secs 2023-05-08T06:19:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:10 smithi186 ceph-mon[126480]: pgmap v5012: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 140 KiB/s wr, 27 op/s 2023-05-08T06:19:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:10 smithi133 ceph-mon[125939]: pgmap v5012: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 140 KiB/s wr, 27 op/s 2023-05-08T06:19:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:10 smithi096 ceph-mon[124666]: pgmap v5012: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 140 KiB/s wr, 27 op/s 2023-05-08T06:19:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9289.608795 secs 2023-05-08T06:19:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:11 smithi186 ceph-mon[126480]: pgmap v5013: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 105 KiB/s wr, 26 op/s 2023-05-08T06:19:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9289.608795 secs 2023-05-08T06:19:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:11 smithi133 ceph-mon[125939]: pgmap v5013: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 105 KiB/s wr, 26 op/s 2023-05-08T06:19:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9289.608795 secs 2023-05-08T06:19:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:11 smithi096 ceph-mon[124666]: pgmap v5013: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 105 KiB/s wr, 26 op/s 2023-05-08T06:19:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:13 smithi186 ceph-mon[126480]: pgmap v5014: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 105 KiB/s wr, 26 op/s 2023-05-08T06:19:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9292.771306 secs 2023-05-08T06:19:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9293.328033 secs 2023-05-08T06:19:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:13 smithi133 ceph-mon[125939]: pgmap v5014: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 105 KiB/s wr, 26 op/s 2023-05-08T06:19:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9292.771306 secs 2023-05-08T06:19:14.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9293.328033 secs 2023-05-08T06:19:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:13 smithi096 ceph-mon[124666]: pgmap v5014: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 105 KiB/s wr, 26 op/s 2023-05-08T06:19:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9292.771306 secs 2023-05-08T06:19:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9293.328033 secs 2023-05-08T06:19:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:16 smithi186 ceph-mon[126480]: pgmap v5015: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 18 KiB/s wr, 8 op/s 2023-05-08T06:19:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9294.608914 secs 2023-05-08T06:19:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:16 smithi186 ceph-mon[126480]: osdmap e391: 12 total, 12 up, 12 in 2023-05-08T06:19:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:16 smithi133 ceph-mon[125939]: pgmap v5015: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 18 KiB/s wr, 8 op/s 2023-05-08T06:19:16.535 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9294.608914 secs 2023-05-08T06:19:16.536 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:16 smithi133 ceph-mon[125939]: osdmap e391: 12 total, 12 up, 12 in 2023-05-08T06:19:16.537 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:16 smithi096 ceph-mon[124666]: pgmap v5015: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 18 KiB/s wr, 8 op/s 2023-05-08T06:19:16.537 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9294.608914 secs 2023-05-08T06:19:16.537 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:16 smithi096 ceph-mon[124666]: osdmap e391: 12 total, 12 up, 12 in 2023-05-08T06:19:17.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:17 smithi186 ceph-mon[126480]: pgmap v5017: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 18 KiB/s wr, 8 op/s 2023-05-08T06:19:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:17 smithi133 ceph-mon[125939]: pgmap v5017: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 18 KiB/s wr, 8 op/s 2023-05-08T06:19:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:17 smithi096 ceph-mon[124666]: pgmap v5017: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 18 KiB/s wr, 8 op/s 2023-05-08T06:19:18.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9297.771393 secs 2023-05-08T06:19:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9297.771393 secs 2023-05-08T06:19:18.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9297.771393 secs 2023-05-08T06:19:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9298.328193 secs 2023-05-08T06:19:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:19 smithi133 ceph-mon[125939]: pgmap v5018: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 18 KiB/s wr, 8 op/s 2023-05-08T06:19:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9298.328193 secs 2023-05-08T06:19:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:19 smithi096 ceph-mon[124666]: pgmap v5018: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 18 KiB/s wr, 8 op/s 2023-05-08T06:19:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9298.328193 secs 2023-05-08T06:19:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:19 smithi186 ceph-mon[126480]: pgmap v5018: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 18 KiB/s wr, 8 op/s 2023-05-08T06:19:21.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9299.609033 secs 2023-05-08T06:19:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9299.609033 secs 2023-05-08T06:19:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9299.609033 secs 2023-05-08T06:19:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:22 smithi186 ceph-mon[126480]: pgmap v5019: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 7 op/s 2023-05-08T06:19:22.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:22 smithi133 ceph-mon[125939]: pgmap v5019: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 7 op/s 2023-05-08T06:19:22.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:22 smithi096 ceph-mon[124666]: pgmap v5019: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 7 op/s 2023-05-08T06:19:23.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:23 smithi186 ceph-mon[126480]: pgmap v5020: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 7 op/s 2023-05-08T06:19:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:23 smithi133 ceph-mon[125939]: pgmap v5020: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 7 op/s 2023-05-08T06:19:23.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:23 smithi096 ceph-mon[124666]: pgmap v5020: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 7 op/s 2023-05-08T06:19:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9302.771506 secs 2023-05-08T06:19:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9303.328330 secs 2023-05-08T06:19:24.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9302.771506 secs 2023-05-08T06:19:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9303.328330 secs 2023-05-08T06:19:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9302.771506 secs 2023-05-08T06:19:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9303.328330 secs 2023-05-08T06:19:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:26 smithi186 ceph-mon[126480]: pgmap v5021: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 35 KiB/s wr, 7 op/s 2023-05-08T06:19:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9304.609131 secs 2023-05-08T06:19:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:26 smithi133 ceph-mon[125939]: pgmap v5021: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 35 KiB/s wr, 7 op/s 2023-05-08T06:19:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9304.609131 secs 2023-05-08T06:19:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:26 smithi096 ceph-mon[124666]: pgmap v5021: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 35 KiB/s wr, 7 op/s 2023-05-08T06:19:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9304.609131 secs 2023-05-08T06:19:27.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:27 smithi186 ceph-mon[126480]: pgmap v5022: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 30 KiB/s wr, 6 op/s 2023-05-08T06:19:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:27 smithi133 ceph-mon[125939]: pgmap v5022: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 30 KiB/s wr, 6 op/s 2023-05-08T06:19:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:27 smithi096 ceph-mon[124666]: pgmap v5022: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 30 KiB/s wr, 6 op/s 2023-05-08T06:19:28.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9307.771629 secs 2023-05-08T06:19:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9307.771629 secs 2023-05-08T06:19:28.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9307.771629 secs 2023-05-08T06:19:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9308.328421 secs 2023-05-08T06:19:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:29 smithi133 ceph-mon[125939]: pgmap v5023: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 29 KiB/s wr, 6 op/s 2023-05-08T06:19:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9308.328421 secs 2023-05-08T06:19:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:29 smithi096 ceph-mon[124666]: pgmap v5023: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 29 KiB/s wr, 6 op/s 2023-05-08T06:19:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9308.328421 secs 2023-05-08T06:19:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:29 smithi186 ceph-mon[126480]: pgmap v5023: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 29 KiB/s wr, 6 op/s 2023-05-08T06:19:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9309.609273 secs 2023-05-08T06:19:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:31 smithi186 ceph-mon[126480]: pgmap v5024: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 10 op/s 2023-05-08T06:19:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9309.609273 secs 2023-05-08T06:19:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:31 smithi133 ceph-mon[125939]: pgmap v5024: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 10 op/s 2023-05-08T06:19:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9309.609273 secs 2023-05-08T06:19:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:31 smithi096 ceph-mon[124666]: pgmap v5024: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 10 op/s 2023-05-08T06:19:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:33 smithi186 ceph-mon[126480]: pgmap v5025: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T06:19:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9312.771742 secs 2023-05-08T06:19:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9313.328568 secs 2023-05-08T06:19:34.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:33 smithi133 ceph-mon[125939]: pgmap v5025: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T06:19:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9312.771742 secs 2023-05-08T06:19:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9313.328568 secs 2023-05-08T06:19:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:33 smithi096 ceph-mon[124666]: pgmap v5025: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T06:19:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9312.771742 secs 2023-05-08T06:19:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9313.328568 secs 2023-05-08T06:19:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:35 smithi133 ceph-mon[125939]: pgmap v5026: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 66 KiB/s wr, 10 op/s 2023-05-08T06:19:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9314.609359 secs 2023-05-08T06:19:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:35 smithi096 ceph-mon[124666]: pgmap v5026: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 66 KiB/s wr, 10 op/s 2023-05-08T06:19:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9314.609359 secs 2023-05-08T06:19:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:35 smithi186 ceph-mon[126480]: pgmap v5026: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 66 KiB/s wr, 10 op/s 2023-05-08T06:19:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9314.609359 secs 2023-05-08T06:19:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:37 smithi133 ceph-mon[125939]: pgmap v5027: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 37 KiB/s wr, 6 op/s 2023-05-08T06:19:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:37 smithi096 ceph-mon[124666]: pgmap v5027: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 37 KiB/s wr, 6 op/s 2023-05-08T06:19:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:37 smithi186 ceph-mon[126480]: pgmap v5027: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 37 KiB/s wr, 6 op/s 2023-05-08T06:19:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9317.771857 secs 2023-05-08T06:19:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9317.771857 secs 2023-05-08T06:19:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9317.771857 secs 2023-05-08T06:19:40.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:39 smithi133 ceph-mon[125939]: pgmap v5028: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 37 KiB/s wr, 6 op/s 2023-05-08T06:19:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:39 smithi096 ceph-mon[124666]: pgmap v5028: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 37 KiB/s wr, 6 op/s 2023-05-08T06:19:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:39 smithi186 ceph-mon[126480]: pgmap v5028: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 37 KiB/s wr, 6 op/s 2023-05-08T06:19:41.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9319.609497 secs 2023-05-08T06:19:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:41 smithi186 ceph-mon[126480]: pgmap v5029: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 71 KiB/s wr, 10 op/s 2023-05-08T06:19:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9319.609497 secs 2023-05-08T06:19:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:41 smithi133 ceph-mon[125939]: pgmap v5029: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 71 KiB/s wr, 10 op/s 2023-05-08T06:19:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9319.609497 secs 2023-05-08T06:19:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:41 smithi096 ceph-mon[124666]: pgmap v5029: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 71 KiB/s wr, 10 op/s 2023-05-08T06:19:42.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:19:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:19:42.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:19:43.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:43 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:19:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:19:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:19:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:43 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:19:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:43 smithi186 ceph-mon[126480]: pgmap v5030: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 67 KiB/s wr, 7 op/s 2023-05-08T06:19:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:43 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:19:43.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:43 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:19:43.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:43 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:19:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:43 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:19:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:19:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:19:43.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:43 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:19:43.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:43 smithi133 ceph-mon[125939]: pgmap v5030: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 67 KiB/s wr, 7 op/s 2023-05-08T06:19:43.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:43 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:19:43.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:43 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:19:43.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:43 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:19:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:43 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:19:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:19:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:19:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:43 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:19:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:43 smithi096 ceph-mon[124666]: pgmap v5030: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 67 KiB/s wr, 7 op/s 2023-05-08T06:19:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:43 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:19:43.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:43 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:19:43.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:43 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:19:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9322.771935 secs 2023-05-08T06:19:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:44 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:19:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:44 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T06:19:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:44 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T06:19:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:44 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:19:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9322.771935 secs 2023-05-08T06:19:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:44 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:19:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:44 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T06:19:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:44 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T06:19:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:44 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:19:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9322.771935 secs 2023-05-08T06:19:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:44 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:19:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:44 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T06:19:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:44 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T06:19:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:44 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:19:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:45 smithi186 ceph-mon[126480]: pgmap v5031: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 129 KiB/s wr, 12 op/s 2023-05-08T06:19:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:45 smithi133 ceph-mon[125939]: pgmap v5031: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 129 KiB/s wr, 12 op/s 2023-05-08T06:19:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:45 smithi096 ceph-mon[124666]: pgmap v5031: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 129 KiB/s wr, 12 op/s 2023-05-08T06:19:46.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:46 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:19:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:46 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:19:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:46 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:19:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:47 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:19:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:47 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:19:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:47 smithi133 ceph-mon[125939]: pgmap v5032: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 95 KiB/s wr, 9 op/s 2023-05-08T06:19:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:47 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:19:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:47 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:19:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:47 smithi096 ceph-mon[124666]: pgmap v5032: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 95 KiB/s wr, 9 op/s 2023-05-08T06:19:47.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:47 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:19:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:47 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:19:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:47 smithi186 ceph-mon[126480]: pgmap v5032: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 95 KiB/s wr, 9 op/s 2023-05-08T06:19:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9327.772044 secs 2023-05-08T06:19:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9327.772044 secs 2023-05-08T06:19:48.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9327.772044 secs 2023-05-08T06:19:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9328.328887 secs 2023-05-08T06:19:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:49 smithi133 ceph-mon[125939]: pgmap v5033: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 95 KiB/s wr, 9 op/s 2023-05-08T06:19:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9328.328887 secs 2023-05-08T06:19:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:49 smithi096 ceph-mon[124666]: pgmap v5033: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 95 KiB/s wr, 9 op/s 2023-05-08T06:19:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9328.328887 secs 2023-05-08T06:19:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:49 smithi186 ceph-mon[126480]: pgmap v5033: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 95 KiB/s wr, 9 op/s 2023-05-08T06:19:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:50 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:19:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:50 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:19:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:50 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:19:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:51 smithi133 ceph-mon[125939]: pgmap v5034: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 102 KiB/s wr, 13 op/s 2023-05-08T06:19:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:19:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:19:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:51 smithi096 ceph-mon[124666]: pgmap v5034: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 102 KiB/s wr, 13 op/s 2023-05-08T06:19:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:19:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:19:51.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:51 smithi186 ceph-mon[126480]: pgmap v5034: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 102 KiB/s wr, 13 op/s 2023-05-08T06:19:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:19:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:19:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:53 smithi133 ceph-mon[125939]: pgmap v5035: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 68 KiB/s wr, 9 op/s 2023-05-08T06:19:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9332.772187 secs 2023-05-08T06:19:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9333.329013 secs 2023-05-08T06:19:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:53 smithi096 ceph-mon[124666]: pgmap v5035: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 68 KiB/s wr, 9 op/s 2023-05-08T06:19:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9332.772187 secs 2023-05-08T06:19:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9333.329013 secs 2023-05-08T06:19:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:53 smithi186 ceph-mon[126480]: pgmap v5035: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 68 KiB/s wr, 9 op/s 2023-05-08T06:19:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9332.772187 secs 2023-05-08T06:19:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9333.329013 secs 2023-05-08T06:19:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:55 smithi133 ceph-mon[125939]: pgmap v5036: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 146 KiB/s wr, 13 op/s 2023-05-08T06:19:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:55 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:19:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:55 smithi096 ceph-mon[124666]: pgmap v5036: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 146 KiB/s wr, 13 op/s 2023-05-08T06:19:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:55 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:19:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:55 smithi186 ceph-mon[126480]: pgmap v5036: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 146 KiB/s wr, 13 op/s 2023-05-08T06:19:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:55 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:19:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:57 smithi133 ceph-mon[125939]: pgmap v5037: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 84 KiB/s wr, 8 op/s 2023-05-08T06:19:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:57 smithi096 ceph-mon[124666]: pgmap v5037: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 84 KiB/s wr, 8 op/s 2023-05-08T06:19:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:57 smithi186 ceph-mon[126480]: pgmap v5037: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 84 KiB/s wr, 8 op/s 2023-05-08T06:19:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9337.772316 secs 2023-05-08T06:19:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9338.329174 secs 2023-05-08T06:19:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9337.772316 secs 2023-05-08T06:19:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9338.329174 secs 2023-05-08T06:19:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9337.772316 secs 2023-05-08T06:19:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9338.329174 secs 2023-05-08T06:20:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:19:59 smithi133 ceph-mon[125939]: pgmap v5038: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 84 KiB/s wr, 8 op/s 2023-05-08T06:20:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:19:59 smithi096 ceph-mon[124666]: pgmap v5038: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 84 KiB/s wr, 8 op/s 2023-05-08T06:20:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:19:59 smithi186 ceph-mon[126480]: pgmap v5038: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 84 KiB/s wr, 8 op/s 2023-05-08T06:20:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9339.610028 secs 2023-05-08T06:20:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:00 smithi133 ceph-mon[125939]: overall HEALTH_WARN 2 MDSs report slow requests 2023-05-08T06:20:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9339.610028 secs 2023-05-08T06:20:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:00 smithi096 ceph-mon[124666]: overall HEALTH_WARN 2 MDSs report slow requests 2023-05-08T06:20:01.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9339.610028 secs 2023-05-08T06:20:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:00 smithi186 ceph-mon[126480]: overall HEALTH_WARN 2 MDSs report slow requests 2023-05-08T06:20:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:01 smithi133 ceph-mon[125939]: pgmap v5039: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 91 KiB/s wr, 12 op/s 2023-05-08T06:20:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:01 smithi096 ceph-mon[124666]: pgmap v5039: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 91 KiB/s wr, 12 op/s 2023-05-08T06:20:02.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:01 smithi186 ceph-mon[126480]: pgmap v5039: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 91 KiB/s wr, 12 op/s 2023-05-08T06:20:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:02 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:20:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:20:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:20:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:02 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:20:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:20:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:20:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:02 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:20:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:20:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:20:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:03 smithi133 ceph-mon[125939]: pgmap v5040: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 84 KiB/s wr, 8 op/s 2023-05-08T06:20:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9342.772439 secs 2023-05-08T06:20:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9343.329300 secs 2023-05-08T06:20:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:03 smithi096 ceph-mon[124666]: pgmap v5040: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 84 KiB/s wr, 8 op/s 2023-05-08T06:20:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9342.772439 secs 2023-05-08T06:20:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9343.329300 secs 2023-05-08T06:20:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:03 smithi186 ceph-mon[126480]: pgmap v5040: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 84 KiB/s wr, 8 op/s 2023-05-08T06:20:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9342.772439 secs 2023-05-08T06:20:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9343.329300 secs 2023-05-08T06:20:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:05 smithi133 ceph-mon[125939]: pgmap v5041: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 168 KiB/s wr, 26 op/s 2023-05-08T06:20:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9344.610147 secs 2023-05-08T06:20:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:05 smithi133 ceph-mon[125939]: osdmap e392: 12 total, 12 up, 12 in 2023-05-08T06:20:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:05 smithi096 ceph-mon[124666]: pgmap v5041: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 168 KiB/s wr, 26 op/s 2023-05-08T06:20:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9344.610147 secs 2023-05-08T06:20:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:05 smithi096 ceph-mon[124666]: osdmap e392: 12 total, 12 up, 12 in 2023-05-08T06:20:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:05 smithi186 ceph-mon[126480]: pgmap v5041: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 168 KiB/s wr, 26 op/s 2023-05-08T06:20:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9344.610147 secs 2023-05-08T06:20:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:05 smithi186 ceph-mon[126480]: osdmap e392: 12 total, 12 up, 12 in 2023-05-08T06:20:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:07 smithi133 ceph-mon[125939]: pgmap v5043: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 109 KiB/s wr, 27 op/s 2023-05-08T06:20:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:07 smithi096 ceph-mon[124666]: pgmap v5043: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 109 KiB/s wr, 27 op/s 2023-05-08T06:20:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:07 smithi186 ceph-mon[126480]: pgmap v5043: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 109 KiB/s wr, 27 op/s 2023-05-08T06:20:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9347.772537 secs 2023-05-08T06:20:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9348.329441 secs 2023-05-08T06:20:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9347.772537 secs 2023-05-08T06:20:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9348.329441 secs 2023-05-08T06:20:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9347.772537 secs 2023-05-08T06:20:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9348.329441 secs 2023-05-08T06:20:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:09 smithi133 ceph-mon[125939]: pgmap v5044: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 109 KiB/s wr, 27 op/s 2023-05-08T06:20:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:09 smithi096 ceph-mon[124666]: pgmap v5044: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 109 KiB/s wr, 27 op/s 2023-05-08T06:20:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:09 smithi186 ceph-mon[126480]: pgmap v5044: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 109 KiB/s wr, 27 op/s 2023-05-08T06:20:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9349.610271 secs 2023-05-08T06:20:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:11 smithi186 ceph-mon[126480]: pgmap v5045: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 105 KiB/s wr, 25 op/s 2023-05-08T06:20:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9349.610271 secs 2023-05-08T06:20:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:11 smithi133 ceph-mon[125939]: pgmap v5045: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 105 KiB/s wr, 25 op/s 2023-05-08T06:20:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9349.610271 secs 2023-05-08T06:20:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:11 smithi096 ceph-mon[124666]: pgmap v5045: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 105 KiB/s wr, 25 op/s 2023-05-08T06:20:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:13 smithi133 ceph-mon[125939]: pgmap v5046: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 105 KiB/s wr, 25 op/s 2023-05-08T06:20:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9352.772682 secs 2023-05-08T06:20:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9353.329569 secs 2023-05-08T06:20:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:13 smithi096 ceph-mon[124666]: pgmap v5046: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 105 KiB/s wr, 25 op/s 2023-05-08T06:20:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9352.772682 secs 2023-05-08T06:20:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9353.329569 secs 2023-05-08T06:20:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:13 smithi186 ceph-mon[126480]: pgmap v5046: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 105 KiB/s wr, 25 op/s 2023-05-08T06:20:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9352.772682 secs 2023-05-08T06:20:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9353.329569 secs 2023-05-08T06:20:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:15 smithi133 ceph-mon[125939]: pgmap v5047: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 22 KiB/s wr, 8 op/s 2023-05-08T06:20:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9354.610408 secs 2023-05-08T06:20:16.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:15 smithi133 ceph-mon[125939]: osdmap e393: 12 total, 12 up, 12 in 2023-05-08T06:20:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:15 smithi096 ceph-mon[124666]: pgmap v5047: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 22 KiB/s wr, 8 op/s 2023-05-08T06:20:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9354.610408 secs 2023-05-08T06:20:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:15 smithi096 ceph-mon[124666]: osdmap e393: 12 total, 12 up, 12 in 2023-05-08T06:20:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:15 smithi186 ceph-mon[126480]: pgmap v5047: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 22 KiB/s wr, 8 op/s 2023-05-08T06:20:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9354.610408 secs 2023-05-08T06:20:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:15 smithi186 ceph-mon[126480]: osdmap e393: 12 total, 12 up, 12 in 2023-05-08T06:20:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:17 smithi133 ceph-mon[125939]: pgmap v5049: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 22 KiB/s wr, 8 op/s 2023-05-08T06:20:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:17 smithi096 ceph-mon[124666]: pgmap v5049: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 22 KiB/s wr, 8 op/s 2023-05-08T06:20:18.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:17 smithi186 ceph-mon[126480]: pgmap v5049: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 22 KiB/s wr, 8 op/s 2023-05-08T06:20:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9357.772802 secs 2023-05-08T06:20:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9358.329704 secs 2023-05-08T06:20:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9357.772802 secs 2023-05-08T06:20:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9358.329704 secs 2023-05-08T06:20:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9357.772802 secs 2023-05-08T06:20:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9358.329704 secs 2023-05-08T06:20:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:19 smithi133 ceph-mon[125939]: pgmap v5050: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 22 KiB/s wr, 8 op/s 2023-05-08T06:20:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:19 smithi096 ceph-mon[124666]: pgmap v5050: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 22 KiB/s wr, 8 op/s 2023-05-08T06:20:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:19 smithi186 ceph-mon[126480]: pgmap v5050: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 22 KiB/s wr, 8 op/s 2023-05-08T06:20:21.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9359.610525 secs 2023-05-08T06:20:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:21 smithi186 ceph-mon[126480]: pgmap v5051: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 8 op/s 2023-05-08T06:20:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9359.610525 secs 2023-05-08T06:20:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:21 smithi133 ceph-mon[125939]: pgmap v5051: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 8 op/s 2023-05-08T06:20:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9359.610525 secs 2023-05-08T06:20:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:21 smithi096 ceph-mon[124666]: pgmap v5051: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 8 op/s 2023-05-08T06:20:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:23 smithi133 ceph-mon[125939]: pgmap v5052: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 8 op/s 2023-05-08T06:20:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9362.772914 secs 2023-05-08T06:20:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9363.329764 secs 2023-05-08T06:20:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:23 smithi096 ceph-mon[124666]: pgmap v5052: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 8 op/s 2023-05-08T06:20:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9362.772914 secs 2023-05-08T06:20:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9363.329764 secs 2023-05-08T06:20:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:23 smithi186 ceph-mon[126480]: pgmap v5052: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 8 op/s 2023-05-08T06:20:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9362.772914 secs 2023-05-08T06:20:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9363.329764 secs 2023-05-08T06:20:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:25 smithi133 ceph-mon[125939]: pgmap v5053: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 34 KiB/s wr, 7 op/s 2023-05-08T06:20:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9364.610646 secs 2023-05-08T06:20:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:25 smithi096 ceph-mon[124666]: pgmap v5053: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 34 KiB/s wr, 7 op/s 2023-05-08T06:20:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9364.610646 secs 2023-05-08T06:20:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:25 smithi186 ceph-mon[126480]: pgmap v5053: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 34 KiB/s wr, 7 op/s 2023-05-08T06:20:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9364.610646 secs 2023-05-08T06:20:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:27 smithi133 ceph-mon[125939]: pgmap v5054: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 29 KiB/s wr, 6 op/s 2023-05-08T06:20:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:27 smithi096 ceph-mon[124666]: pgmap v5054: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 29 KiB/s wr, 6 op/s 2023-05-08T06:20:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:27 smithi186 ceph-mon[126480]: pgmap v5054: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 29 KiB/s wr, 6 op/s 2023-05-08T06:20:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9367.773040 secs 2023-05-08T06:20:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9368.329857 secs 2023-05-08T06:20:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9367.773040 secs 2023-05-08T06:20:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9368.329857 secs 2023-05-08T06:20:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9367.773040 secs 2023-05-08T06:20:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9368.329857 secs 2023-05-08T06:20:30.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:29 smithi133 ceph-mon[125939]: pgmap v5055: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 28 KiB/s wr, 6 op/s 2023-05-08T06:20:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:29 smithi096 ceph-mon[124666]: pgmap v5055: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 28 KiB/s wr, 6 op/s 2023-05-08T06:20:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:29 smithi186 ceph-mon[126480]: pgmap v5055: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 28 KiB/s wr, 6 op/s 2023-05-08T06:20:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9369.610768 secs 2023-05-08T06:20:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:31 smithi186 ceph-mon[126480]: pgmap v5056: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 32 KiB/s wr, 10 op/s 2023-05-08T06:20:31.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9369.610768 secs 2023-05-08T06:20:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:31 smithi133 ceph-mon[125939]: pgmap v5056: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 32 KiB/s wr, 10 op/s 2023-05-08T06:20:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9369.610768 secs 2023-05-08T06:20:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:31 smithi096 ceph-mon[124666]: pgmap v5056: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 32 KiB/s wr, 10 op/s 2023-05-08T06:20:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:33 smithi133 ceph-mon[125939]: pgmap v5057: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 7 op/s 2023-05-08T06:20:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9372.773156 secs 2023-05-08T06:20:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9373.329976 secs 2023-05-08T06:20:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:33 smithi096 ceph-mon[124666]: pgmap v5057: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 7 op/s 2023-05-08T06:20:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9372.773156 secs 2023-05-08T06:20:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9373.329976 secs 2023-05-08T06:20:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:33 smithi186 ceph-mon[126480]: pgmap v5057: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 7 op/s 2023-05-08T06:20:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9372.773156 secs 2023-05-08T06:20:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9373.329976 secs 2023-05-08T06:20:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:35 smithi133 ceph-mon[125939]: pgmap v5058: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 66 KiB/s wr, 10 op/s 2023-05-08T06:20:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9374.610893 secs 2023-05-08T06:20:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:35 smithi096 ceph-mon[124666]: pgmap v5058: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 66 KiB/s wr, 10 op/s 2023-05-08T06:20:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9374.610893 secs 2023-05-08T06:20:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:35 smithi186 ceph-mon[126480]: pgmap v5058: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 66 KiB/s wr, 10 op/s 2023-05-08T06:20:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9374.610893 secs 2023-05-08T06:20:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:37 smithi133 ceph-mon[125939]: pgmap v5059: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 38 KiB/s wr, 6 op/s 2023-05-08T06:20:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:37 smithi096 ceph-mon[124666]: pgmap v5059: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 38 KiB/s wr, 6 op/s 2023-05-08T06:20:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:37 smithi186 ceph-mon[126480]: pgmap v5059: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 38 KiB/s wr, 6 op/s 2023-05-08T06:20:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9377.773259 secs 2023-05-08T06:20:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9377.773259 secs 2023-05-08T06:20:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9377.773259 secs 2023-05-08T06:20:40.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:39 smithi133 ceph-mon[125939]: pgmap v5060: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 38 KiB/s wr, 6 op/s 2023-05-08T06:20:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:39 smithi096 ceph-mon[124666]: pgmap v5060: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 38 KiB/s wr, 6 op/s 2023-05-08T06:20:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:39 smithi186 ceph-mon[126480]: pgmap v5060: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 38 KiB/s wr, 6 op/s 2023-05-08T06:20:41.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9379.610997 secs 2023-05-08T06:20:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:41 smithi186 ceph-mon[126480]: pgmap v5061: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 72 KiB/s wr, 10 op/s 2023-05-08T06:20:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9379.610997 secs 2023-05-08T06:20:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:41 smithi133 ceph-mon[125939]: pgmap v5061: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 72 KiB/s wr, 10 op/s 2023-05-08T06:20:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9379.610997 secs 2023-05-08T06:20:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:41 smithi096 ceph-mon[124666]: pgmap v5061: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 72 KiB/s wr, 10 op/s 2023-05-08T06:20:42.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:20:42.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:20:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:20:43.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:43 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:20:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:20:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:20:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:43 smithi186 ceph-mon[126480]: pgmap v5062: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 68 KiB/s wr, 7 op/s 2023-05-08T06:20:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:43 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:20:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:20:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:20:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:43 smithi133 ceph-mon[125939]: pgmap v5062: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 68 KiB/s wr, 7 op/s 2023-05-08T06:20:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:43 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:20:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:20:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:20:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:43 smithi096 ceph-mon[124666]: pgmap v5062: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 68 KiB/s wr, 7 op/s 2023-05-08T06:20:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9382.773355 secs 2023-05-08T06:20:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:44 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:20:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:44 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:20:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:44 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:20:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:44 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:20:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9382.773355 secs 2023-05-08T06:20:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:44 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:20:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:44 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:20:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:44 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:20:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:44 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:20:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9382.773355 secs 2023-05-08T06:20:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:44 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:20:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:44 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:20:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:44 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:20:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:44 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:20:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:45 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:20:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:45 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T06:20:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:45 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T06:20:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:45 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:20:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:45 smithi186 ceph-mon[126480]: pgmap v5063: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 131 KiB/s wr, 12 op/s 2023-05-08T06:20:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:45 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:20:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:45 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T06:20:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:45 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T06:20:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:45 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:20:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:45 smithi133 ceph-mon[125939]: pgmap v5063: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 131 KiB/s wr, 12 op/s 2023-05-08T06:20:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:45 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:20:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:45 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T06:20:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:45 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T06:20:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:45 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:20:45.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:45 smithi096 ceph-mon[124666]: pgmap v5063: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 131 KiB/s wr, 12 op/s 2023-05-08T06:20:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:46 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:20:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:46 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:20:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:46 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:20:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:47 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:20:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:47 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:20:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:47 smithi133 ceph-mon[125939]: pgmap v5064: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 96 KiB/s wr, 9 op/s 2023-05-08T06:20:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:47 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:20:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:47 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:20:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:47 smithi096 ceph-mon[124666]: pgmap v5064: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 96 KiB/s wr, 9 op/s 2023-05-08T06:20:47.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:47 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:20:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:47 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:20:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:47 smithi186 ceph-mon[126480]: pgmap v5064: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 96 KiB/s wr, 9 op/s 2023-05-08T06:20:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9387.773412 secs 2023-05-08T06:20:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9387.773412 secs 2023-05-08T06:20:48.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9387.773412 secs 2023-05-08T06:20:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9388.330338 secs 2023-05-08T06:20:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:49 smithi133 ceph-mon[125939]: pgmap v5065: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 96 KiB/s wr, 9 op/s 2023-05-08T06:20:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9388.330338 secs 2023-05-08T06:20:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:49 smithi096 ceph-mon[124666]: pgmap v5065: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 96 KiB/s wr, 9 op/s 2023-05-08T06:20:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9388.330338 secs 2023-05-08T06:20:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:49 smithi186 ceph-mon[126480]: pgmap v5065: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 96 KiB/s wr, 9 op/s 2023-05-08T06:20:50.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:50 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:20:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:50 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:20:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:50 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:20:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:51 smithi133 ceph-mon[125939]: pgmap v5066: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 103 KiB/s wr, 13 op/s 2023-05-08T06:20:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:20:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:20:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:51 smithi096 ceph-mon[124666]: pgmap v5066: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 103 KiB/s wr, 13 op/s 2023-05-08T06:20:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:20:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:20:51.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:51 smithi186 ceph-mon[126480]: pgmap v5066: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 103 KiB/s wr, 13 op/s 2023-05-08T06:20:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:20:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:20:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:53 smithi133 ceph-mon[125939]: pgmap v5067: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 69 KiB/s wr, 9 op/s 2023-05-08T06:20:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9392.773529 secs 2023-05-08T06:20:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9393.330451 secs 2023-05-08T06:20:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:53 smithi096 ceph-mon[124666]: pgmap v5067: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 69 KiB/s wr, 9 op/s 2023-05-08T06:20:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9392.773529 secs 2023-05-08T06:20:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9393.330451 secs 2023-05-08T06:20:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:53 smithi186 ceph-mon[126480]: pgmap v5067: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 69 KiB/s wr, 9 op/s 2023-05-08T06:20:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9392.773529 secs 2023-05-08T06:20:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9393.330451 secs 2023-05-08T06:20:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:55 smithi133 ceph-mon[125939]: pgmap v5068: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 157 KiB/s wr, 13 op/s 2023-05-08T06:20:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:55 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:20:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:55 smithi096 ceph-mon[124666]: pgmap v5068: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 157 KiB/s wr, 13 op/s 2023-05-08T06:20:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:55 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:20:56.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:55 smithi186 ceph-mon[126480]: pgmap v5068: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 157 KiB/s wr, 13 op/s 2023-05-08T06:20:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:55 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:20:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:57 smithi133 ceph-mon[125939]: pgmap v5069: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 94 KiB/s wr, 8 op/s 2023-05-08T06:20:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:57 smithi096 ceph-mon[124666]: pgmap v5069: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 94 KiB/s wr, 8 op/s 2023-05-08T06:20:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:57 smithi186 ceph-mon[126480]: pgmap v5069: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 94 KiB/s wr, 8 op/s 2023-05-08T06:20:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9397.773617 secs 2023-05-08T06:20:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9398.330567 secs 2023-05-08T06:20:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9397.773617 secs 2023-05-08T06:20:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9398.330567 secs 2023-05-08T06:20:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9397.773617 secs 2023-05-08T06:20:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9398.330567 secs 2023-05-08T06:21:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:20:59 smithi133 ceph-mon[125939]: pgmap v5070: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 94 KiB/s wr, 8 op/s 2023-05-08T06:21:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:20:59 smithi096 ceph-mon[124666]: pgmap v5070: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 94 KiB/s wr, 8 op/s 2023-05-08T06:21:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:20:59 smithi186 ceph-mon[126480]: pgmap v5070: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 94 KiB/s wr, 8 op/s 2023-05-08T06:21:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9399.611486 secs 2023-05-08T06:21:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:01 smithi186 ceph-mon[126480]: pgmap v5071: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 101 KiB/s wr, 12 op/s 2023-05-08T06:21:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9399.611486 secs 2023-05-08T06:21:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:01 smithi133 ceph-mon[125939]: pgmap v5071: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 101 KiB/s wr, 12 op/s 2023-05-08T06:21:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9399.611486 secs 2023-05-08T06:21:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:01 smithi096 ceph-mon[124666]: pgmap v5071: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 101 KiB/s wr, 12 op/s 2023-05-08T06:21:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:02 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:21:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:21:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:21:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:02 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:21:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:21:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:21:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:02 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:21:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:21:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:21:03.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:03 smithi186 ceph-mon[126480]: pgmap v5072: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 94 KiB/s wr, 7 op/s 2023-05-08T06:21:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:03 smithi133 ceph-mon[125939]: pgmap v5072: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 94 KiB/s wr, 7 op/s 2023-05-08T06:21:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:03 smithi096 ceph-mon[124666]: pgmap v5072: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 94 KiB/s wr, 7 op/s 2023-05-08T06:21:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9402.773734 secs 2023-05-08T06:21:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9403.330661 secs 2023-05-08T06:21:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9402.773734 secs 2023-05-08T06:21:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9403.330661 secs 2023-05-08T06:21:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9402.773734 secs 2023-05-08T06:21:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9403.330661 secs 2023-05-08T06:21:05.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:05 smithi186 ceph-mon[126480]: pgmap v5073: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 194 KiB/s wr, 26 op/s 2023-05-08T06:21:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9404.611605 secs 2023-05-08T06:21:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:05 smithi133 ceph-mon[125939]: pgmap v5073: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 194 KiB/s wr, 26 op/s 2023-05-08T06:21:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9404.611605 secs 2023-05-08T06:21:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:05 smithi096 ceph-mon[124666]: pgmap v5073: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 194 KiB/s wr, 26 op/s 2023-05-08T06:21:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9404.611605 secs 2023-05-08T06:21:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:06 smithi186 ceph-mon[126480]: osdmap e394: 12 total, 12 up, 12 in 2023-05-08T06:21:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:06 smithi133 ceph-mon[125939]: osdmap e394: 12 total, 12 up, 12 in 2023-05-08T06:21:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:06 smithi096 ceph-mon[124666]: osdmap e394: 12 total, 12 up, 12 in 2023-05-08T06:21:07.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:07 smithi186 ceph-mon[126480]: pgmap v5075: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 128 KiB/s wr, 27 op/s 2023-05-08T06:21:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:07 smithi133 ceph-mon[125939]: pgmap v5075: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 128 KiB/s wr, 27 op/s 2023-05-08T06:21:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:07 smithi096 ceph-mon[124666]: pgmap v5075: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 128 KiB/s wr, 27 op/s 2023-05-08T06:21:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9407.773864 secs 2023-05-08T06:21:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9407.773864 secs 2023-05-08T06:21:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9407.773864 secs 2023-05-08T06:21:09.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9408.330804 secs 2023-05-08T06:21:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:09 smithi133 ceph-mon[125939]: pgmap v5076: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 128 KiB/s wr, 27 op/s 2023-05-08T06:21:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9408.330804 secs 2023-05-08T06:21:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:09 smithi096 ceph-mon[124666]: pgmap v5076: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 128 KiB/s wr, 27 op/s 2023-05-08T06:21:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9408.330804 secs 2023-05-08T06:21:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:09 smithi186 ceph-mon[126480]: pgmap v5076: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 128 KiB/s wr, 27 op/s 2023-05-08T06:21:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9409.611731 secs 2023-05-08T06:21:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:11 smithi186 ceph-mon[126480]: pgmap v5077: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 124 KiB/s wr, 27 op/s 2023-05-08T06:21:11.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9409.611731 secs 2023-05-08T06:21:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:11 smithi133 ceph-mon[125939]: pgmap v5077: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 124 KiB/s wr, 27 op/s 2023-05-08T06:21:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9409.611731 secs 2023-05-08T06:21:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:11 smithi096 ceph-mon[124666]: pgmap v5077: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 124 KiB/s wr, 27 op/s 2023-05-08T06:21:14.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:13 smithi133 ceph-mon[125939]: pgmap v5078: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 124 KiB/s wr, 27 op/s 2023-05-08T06:21:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9412.773978 secs 2023-05-08T06:21:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9413.330921 secs 2023-05-08T06:21:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:13 smithi096 ceph-mon[124666]: pgmap v5078: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 124 KiB/s wr, 27 op/s 2023-05-08T06:21:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9412.773978 secs 2023-05-08T06:21:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9413.330921 secs 2023-05-08T06:21:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:13 smithi186 ceph-mon[126480]: pgmap v5078: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 124 KiB/s wr, 27 op/s 2023-05-08T06:21:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9412.773978 secs 2023-05-08T06:21:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9413.330921 secs 2023-05-08T06:21:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:15 smithi133 ceph-mon[125939]: pgmap v5079: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 23 KiB/s wr, 9 op/s 2023-05-08T06:21:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9414.611846 secs 2023-05-08T06:21:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:15 smithi133 ceph-mon[125939]: osdmap e395: 12 total, 12 up, 12 in 2023-05-08T06:21:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:15 smithi096 ceph-mon[124666]: pgmap v5079: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 23 KiB/s wr, 9 op/s 2023-05-08T06:21:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9414.611846 secs 2023-05-08T06:21:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:15 smithi096 ceph-mon[124666]: osdmap e395: 12 total, 12 up, 12 in 2023-05-08T06:21:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:15 smithi186 ceph-mon[126480]: pgmap v5079: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 23 KiB/s wr, 9 op/s 2023-05-08T06:21:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9414.611846 secs 2023-05-08T06:21:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:15 smithi186 ceph-mon[126480]: osdmap e395: 12 total, 12 up, 12 in 2023-05-08T06:21:18.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:17 smithi133 ceph-mon[125939]: pgmap v5081: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 23 KiB/s wr, 9 op/s 2023-05-08T06:21:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:17 smithi096 ceph-mon[124666]: pgmap v5081: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 23 KiB/s wr, 9 op/s 2023-05-08T06:21:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:17 smithi186 ceph-mon[126480]: pgmap v5081: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 23 KiB/s wr, 9 op/s 2023-05-08T06:21:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9417.774089 secs 2023-05-08T06:21:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9418.331068 secs 2023-05-08T06:21:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9417.774089 secs 2023-05-08T06:21:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9418.331068 secs 2023-05-08T06:21:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9417.774089 secs 2023-05-08T06:21:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9418.331068 secs 2023-05-08T06:21:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:19 smithi133 ceph-mon[125939]: pgmap v5082: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 23 KiB/s wr, 9 op/s 2023-05-08T06:21:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:19 smithi096 ceph-mon[124666]: pgmap v5082: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 23 KiB/s wr, 9 op/s 2023-05-08T06:21:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:19 smithi186 ceph-mon[126480]: pgmap v5082: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 23 KiB/s wr, 9 op/s 2023-05-08T06:21:21.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9419.611927 secs 2023-05-08T06:21:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:21 smithi186 ceph-mon[126480]: pgmap v5083: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 8 op/s 2023-05-08T06:21:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9419.611927 secs 2023-05-08T06:21:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:21 smithi133 ceph-mon[125939]: pgmap v5083: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 8 op/s 2023-05-08T06:21:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9419.611927 secs 2023-05-08T06:21:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:21 smithi096 ceph-mon[124666]: pgmap v5083: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 8 op/s 2023-05-08T06:21:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:23 smithi133 ceph-mon[125939]: pgmap v5084: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 8 op/s 2023-05-08T06:21:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9422.774232 secs 2023-05-08T06:21:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9423.331186 secs 2023-05-08T06:21:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:23 smithi096 ceph-mon[124666]: pgmap v5084: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 8 op/s 2023-05-08T06:21:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9422.774232 secs 2023-05-08T06:21:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9423.331186 secs 2023-05-08T06:21:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:23 smithi186 ceph-mon[126480]: pgmap v5084: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 8 op/s 2023-05-08T06:21:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9422.774232 secs 2023-05-08T06:21:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9423.331186 secs 2023-05-08T06:21:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:25 smithi133 ceph-mon[125939]: pgmap v5085: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 36 KiB/s wr, 7 op/s 2023-05-08T06:21:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9424.612028 secs 2023-05-08T06:21:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:25 smithi096 ceph-mon[124666]: pgmap v5085: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 36 KiB/s wr, 7 op/s 2023-05-08T06:21:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9424.612028 secs 2023-05-08T06:21:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:25 smithi186 ceph-mon[126480]: pgmap v5085: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 36 KiB/s wr, 7 op/s 2023-05-08T06:21:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9424.612028 secs 2023-05-08T06:21:28.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:27 smithi133 ceph-mon[125939]: pgmap v5086: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 30 KiB/s wr, 6 op/s 2023-05-08T06:21:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:27 smithi096 ceph-mon[124666]: pgmap v5086: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 30 KiB/s wr, 6 op/s 2023-05-08T06:21:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:27 smithi186 ceph-mon[126480]: pgmap v5086: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 30 KiB/s wr, 6 op/s 2023-05-08T06:21:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9427.774375 secs 2023-05-08T06:21:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9428.331324 secs 2023-05-08T06:21:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9427.774375 secs 2023-05-08T06:21:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9428.331324 secs 2023-05-08T06:21:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9427.774375 secs 2023-05-08T06:21:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9428.331324 secs 2023-05-08T06:21:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:29 smithi133 ceph-mon[125939]: pgmap v5087: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 30 KiB/s wr, 6 op/s 2023-05-08T06:21:30.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:29 smithi096 ceph-mon[124666]: pgmap v5087: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 30 KiB/s wr, 6 op/s 2023-05-08T06:21:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:29 smithi186 ceph-mon[126480]: pgmap v5087: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 30 KiB/s wr, 6 op/s 2023-05-08T06:21:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9429.612148 secs 2023-05-08T06:21:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:31 smithi186 ceph-mon[126480]: pgmap v5088: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 34 KiB/s wr, 10 op/s 2023-05-08T06:21:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9429.612148 secs 2023-05-08T06:21:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:31 smithi133 ceph-mon[125939]: pgmap v5088: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 34 KiB/s wr, 10 op/s 2023-05-08T06:21:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9429.612148 secs 2023-05-08T06:21:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:31 smithi096 ceph-mon[124666]: pgmap v5088: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 34 KiB/s wr, 10 op/s 2023-05-08T06:21:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:33 smithi133 ceph-mon[125939]: pgmap v5089: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 7 op/s 2023-05-08T06:21:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9432.774516 secs 2023-05-08T06:21:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9433.331441 secs 2023-05-08T06:21:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:33 smithi096 ceph-mon[124666]: pgmap v5089: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 7 op/s 2023-05-08T06:21:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9432.774516 secs 2023-05-08T06:21:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9433.331441 secs 2023-05-08T06:21:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:33 smithi186 ceph-mon[126480]: pgmap v5089: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 7 op/s 2023-05-08T06:21:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9432.774516 secs 2023-05-08T06:21:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9433.331441 secs 2023-05-08T06:21:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:35 smithi133 ceph-mon[125939]: pgmap v5090: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 68 KiB/s wr, 10 op/s 2023-05-08T06:21:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9434.612240 secs 2023-05-08T06:21:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:35 smithi096 ceph-mon[124666]: pgmap v5090: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 68 KiB/s wr, 10 op/s 2023-05-08T06:21:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9434.612240 secs 2023-05-08T06:21:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:35 smithi186 ceph-mon[126480]: pgmap v5090: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 68 KiB/s wr, 10 op/s 2023-05-08T06:21:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9434.612240 secs 2023-05-08T06:21:38.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:37 smithi133 ceph-mon[125939]: pgmap v5091: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 39 KiB/s wr, 6 op/s 2023-05-08T06:21:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:37 smithi096 ceph-mon[124666]: pgmap v5091: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 39 KiB/s wr, 6 op/s 2023-05-08T06:21:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:37 smithi186 ceph-mon[126480]: pgmap v5091: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 39 KiB/s wr, 6 op/s 2023-05-08T06:21:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9437.774621 secs 2023-05-08T06:21:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9437.774621 secs 2023-05-08T06:21:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9437.774621 secs 2023-05-08T06:21:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:39 smithi133 ceph-mon[125939]: pgmap v5092: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 39 KiB/s wr, 6 op/s 2023-05-08T06:21:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:39 smithi096 ceph-mon[124666]: pgmap v5092: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 39 KiB/s wr, 6 op/s 2023-05-08T06:21:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:39 smithi186 ceph-mon[126480]: pgmap v5092: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 39 KiB/s wr, 6 op/s 2023-05-08T06:21:41.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:41 smithi186 ceph-mon[126480]: pgmap v5093: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 73 KiB/s wr, 11 op/s 2023-05-08T06:21:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:41 smithi133 ceph-mon[125939]: pgmap v5093: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 73 KiB/s wr, 11 op/s 2023-05-08T06:21:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:41 smithi096 ceph-mon[124666]: pgmap v5093: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 73 KiB/s wr, 11 op/s 2023-05-08T06:21:42.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:21:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:21:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:21:43.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:43 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:21:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:21:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:21:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:21:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:43 smithi186 ceph-mon[126480]: pgmap v5094: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 70 KiB/s wr, 7 op/s 2023-05-08T06:21:43.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:43 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:21:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:21:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:21:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:21:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:43 smithi133 ceph-mon[125939]: pgmap v5094: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 70 KiB/s wr, 7 op/s 2023-05-08T06:21:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:43 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:21:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:21:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:21:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:21:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:43 smithi096 ceph-mon[124666]: pgmap v5094: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 70 KiB/s wr, 7 op/s 2023-05-08T06:21:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9442.774725 secs 2023-05-08T06:21:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:21:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:21:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:44 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:21:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9442.774725 secs 2023-05-08T06:21:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:21:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:21:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:44 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:21:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9442.774725 secs 2023-05-08T06:21:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:21:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:21:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:44 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:21:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:21:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:21:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:45 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:21:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:21:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:45 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T06:21:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:45 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T06:21:45.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:45 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:21:45.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:45 smithi186 ceph-mon[126480]: pgmap v5095: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 134 KiB/s wr, 12 op/s 2023-05-08T06:21:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:21:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:21:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:45 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:21:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:21:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:45 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T06:21:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:45 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T06:21:45.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:45 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:21:45.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:45 smithi133 ceph-mon[125939]: pgmap v5095: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 134 KiB/s wr, 12 op/s 2023-05-08T06:21:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:21:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:21:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:45 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:21:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:21:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:45 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T06:21:45.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:45 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T06:21:45.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:45 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:21:45.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:45 smithi096 ceph-mon[124666]: pgmap v5095: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 134 KiB/s wr, 12 op/s 2023-05-08T06:21:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:47 smithi133 ceph-mon[125939]: pgmap v5096: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 99 KiB/s wr, 9 op/s 2023-05-08T06:21:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:47 smithi096 ceph-mon[124666]: pgmap v5096: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 99 KiB/s wr, 9 op/s 2023-05-08T06:21:48.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:47 smithi186 ceph-mon[126480]: pgmap v5096: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 99 KiB/s wr, 9 op/s 2023-05-08T06:21:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9447.774791 secs 2023-05-08T06:21:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9448.331742 secs 2023-05-08T06:21:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9447.774791 secs 2023-05-08T06:21:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9448.331742 secs 2023-05-08T06:21:49.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9447.774791 secs 2023-05-08T06:21:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9448.331742 secs 2023-05-08T06:21:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:49 smithi133 ceph-mon[125939]: pgmap v5097: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 99 KiB/s wr, 9 op/s 2023-05-08T06:21:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:49 smithi096 ceph-mon[124666]: pgmap v5097: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 99 KiB/s wr, 9 op/s 2023-05-08T06:21:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:49 smithi186 ceph-mon[126480]: pgmap v5097: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 99 KiB/s wr, 9 op/s 2023-05-08T06:21:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:50 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:21:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:50 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:21:51.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:50 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:21:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:51 smithi133 ceph-mon[125939]: pgmap v5098: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 106 KiB/s wr, 13 op/s 2023-05-08T06:21:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:21:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:21:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:51 smithi096 ceph-mon[124666]: pgmap v5098: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 106 KiB/s wr, 13 op/s 2023-05-08T06:21:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:21:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:21:52.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:51 smithi186 ceph-mon[126480]: pgmap v5098: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 106 KiB/s wr, 13 op/s 2023-05-08T06:21:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:21:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:21:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:53 smithi133 ceph-mon[125939]: pgmap v5099: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 71 KiB/s wr, 9 op/s 2023-05-08T06:21:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9452.774920 secs 2023-05-08T06:21:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9453.331817 secs 2023-05-08T06:21:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:53 smithi096 ceph-mon[124666]: pgmap v5099: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 71 KiB/s wr, 9 op/s 2023-05-08T06:21:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9452.774920 secs 2023-05-08T06:21:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9453.331817 secs 2023-05-08T06:21:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:53 smithi186 ceph-mon[126480]: pgmap v5099: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 71 KiB/s wr, 9 op/s 2023-05-08T06:21:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9452.774920 secs 2023-05-08T06:21:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9453.331817 secs 2023-05-08T06:21:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:55 smithi133 ceph-mon[125939]: pgmap v5100: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 134 KiB/s wr, 13 op/s 2023-05-08T06:21:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:55 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:21:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:55 smithi096 ceph-mon[124666]: pgmap v5100: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 134 KiB/s wr, 13 op/s 2023-05-08T06:21:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:55 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:21:56.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:55 smithi186 ceph-mon[126480]: pgmap v5100: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 134 KiB/s wr, 13 op/s 2023-05-08T06:21:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:55 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:21:58.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:57 smithi133 ceph-mon[125939]: pgmap v5101: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 70 KiB/s wr, 7 op/s 2023-05-08T06:21:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:57 smithi096 ceph-mon[124666]: pgmap v5101: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 70 KiB/s wr, 7 op/s 2023-05-08T06:21:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:57 smithi186 ceph-mon[126480]: pgmap v5101: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 70 KiB/s wr, 7 op/s 2023-05-08T06:21:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9457.775050 secs 2023-05-08T06:21:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9458.331942 secs 2023-05-08T06:21:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9457.775050 secs 2023-05-08T06:21:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9458.331942 secs 2023-05-08T06:21:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9457.775050 secs 2023-05-08T06:21:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9458.331942 secs 2023-05-08T06:22:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:21:59 smithi133 ceph-mon[125939]: pgmap v5102: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 70 KiB/s wr, 7 op/s 2023-05-08T06:22:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:21:59 smithi096 ceph-mon[124666]: pgmap v5102: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 70 KiB/s wr, 7 op/s 2023-05-08T06:22:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:21:59 smithi186 ceph-mon[126480]: pgmap v5102: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 70 KiB/s wr, 7 op/s 2023-05-08T06:22:01.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9459.612806 secs 2023-05-08T06:22:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:01 smithi186 ceph-mon[126480]: pgmap v5103: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 77 KiB/s wr, 12 op/s 2023-05-08T06:22:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9459.612806 secs 2023-05-08T06:22:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:01 smithi133 ceph-mon[125939]: pgmap v5103: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 77 KiB/s wr, 12 op/s 2023-05-08T06:22:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9459.612806 secs 2023-05-08T06:22:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:01 smithi096 ceph-mon[124666]: pgmap v5103: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 77 KiB/s wr, 12 op/s 2023-05-08T06:22:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:02 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:22:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:22:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:22:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:02 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:22:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:22:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:22:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:02 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:22:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:22:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:22:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:03 smithi186 ceph-mon[126480]: pgmap v5104: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 70 KiB/s wr, 8 op/s 2023-05-08T06:22:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:03 smithi133 ceph-mon[125939]: pgmap v5104: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 70 KiB/s wr, 8 op/s 2023-05-08T06:22:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:03 smithi096 ceph-mon[124666]: pgmap v5104: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 70 KiB/s wr, 8 op/s 2023-05-08T06:22:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9462.775171 secs 2023-05-08T06:22:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9463.332086 secs 2023-05-08T06:22:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9462.775171 secs 2023-05-08T06:22:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9463.332086 secs 2023-05-08T06:22:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9462.775171 secs 2023-05-08T06:22:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9463.332086 secs 2023-05-08T06:22:05.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:05 smithi186 ceph-mon[126480]: pgmap v5105: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 156 KiB/s wr, 26 op/s 2023-05-08T06:22:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9464.612904 secs 2023-05-08T06:22:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:05 smithi133 ceph-mon[125939]: pgmap v5105: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 156 KiB/s wr, 26 op/s 2023-05-08T06:22:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9464.612904 secs 2023-05-08T06:22:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:05 smithi096 ceph-mon[124666]: pgmap v5105: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 156 KiB/s wr, 26 op/s 2023-05-08T06:22:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9464.612904 secs 2023-05-08T06:22:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:06 smithi186 ceph-mon[126480]: osdmap e396: 12 total, 12 up, 12 in 2023-05-08T06:22:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:06 smithi133 ceph-mon[125939]: osdmap e396: 12 total, 12 up, 12 in 2023-05-08T06:22:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:06 smithi096 ceph-mon[124666]: osdmap e396: 12 total, 12 up, 12 in 2023-05-08T06:22:07.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:07 smithi186 ceph-mon[126480]: pgmap v5107: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 111 KiB/s wr, 27 op/s 2023-05-08T06:22:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:07 smithi133 ceph-mon[125939]: pgmap v5107: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 111 KiB/s wr, 27 op/s 2023-05-08T06:22:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:07 smithi096 ceph-mon[124666]: pgmap v5107: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 111 KiB/s wr, 27 op/s 2023-05-08T06:22:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9467.775298 secs 2023-05-08T06:22:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9467.775298 secs 2023-05-08T06:22:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9467.775298 secs 2023-05-08T06:22:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9468.332224 secs 2023-05-08T06:22:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:09 smithi133 ceph-mon[125939]: pgmap v5108: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 111 KiB/s wr, 27 op/s 2023-05-08T06:22:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9468.332224 secs 2023-05-08T06:22:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:09 smithi096 ceph-mon[124666]: pgmap v5108: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 111 KiB/s wr, 27 op/s 2023-05-08T06:22:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9468.332224 secs 2023-05-08T06:22:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:09 smithi186 ceph-mon[126480]: pgmap v5108: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 111 KiB/s wr, 27 op/s 2023-05-08T06:22:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9469.613045 secs 2023-05-08T06:22:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:11 smithi186 ceph-mon[126480]: pgmap v5109: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 107 KiB/s wr, 25 op/s 2023-05-08T06:22:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9469.613045 secs 2023-05-08T06:22:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:11 smithi133 ceph-mon[125939]: pgmap v5109: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 107 KiB/s wr, 25 op/s 2023-05-08T06:22:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9469.613045 secs 2023-05-08T06:22:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:11 smithi096 ceph-mon[124666]: pgmap v5109: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 107 KiB/s wr, 25 op/s 2023-05-08T06:22:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:13 smithi133 ceph-mon[125939]: pgmap v5110: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 107 KiB/s wr, 25 op/s 2023-05-08T06:22:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9472.775427 secs 2023-05-08T06:22:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9473.332339 secs 2023-05-08T06:22:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:13 smithi096 ceph-mon[124666]: pgmap v5110: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 107 KiB/s wr, 25 op/s 2023-05-08T06:22:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9472.775427 secs 2023-05-08T06:22:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9473.332339 secs 2023-05-08T06:22:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:13 smithi186 ceph-mon[126480]: pgmap v5110: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 107 KiB/s wr, 25 op/s 2023-05-08T06:22:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9472.775427 secs 2023-05-08T06:22:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9473.332339 secs 2023-05-08T06:22:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:15 smithi133 ceph-mon[125939]: pgmap v5111: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 8 op/s 2023-05-08T06:22:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9474.613185 secs 2023-05-08T06:22:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:15 smithi133 ceph-mon[125939]: osdmap e397: 12 total, 12 up, 12 in 2023-05-08T06:22:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:15 smithi096 ceph-mon[124666]: pgmap v5111: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 8 op/s 2023-05-08T06:22:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9474.613185 secs 2023-05-08T06:22:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:15 smithi096 ceph-mon[124666]: osdmap e397: 12 total, 12 up, 12 in 2023-05-08T06:22:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:15 smithi186 ceph-mon[126480]: pgmap v5111: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 8 op/s 2023-05-08T06:22:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9474.613185 secs 2023-05-08T06:22:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:15 smithi186 ceph-mon[126480]: osdmap e397: 12 total, 12 up, 12 in 2023-05-08T06:22:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:17 smithi133 ceph-mon[125939]: pgmap v5113: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 8 op/s 2023-05-08T06:22:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:17 smithi096 ceph-mon[124666]: pgmap v5113: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 8 op/s 2023-05-08T06:22:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:17 smithi186 ceph-mon[126480]: pgmap v5113: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 8 op/s 2023-05-08T06:22:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9477.775557 secs 2023-05-08T06:22:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9478.332433 secs 2023-05-08T06:22:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9477.775557 secs 2023-05-08T06:22:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9478.332433 secs 2023-05-08T06:22:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9477.775557 secs 2023-05-08T06:22:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9478.332433 secs 2023-05-08T06:22:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:19 smithi133 ceph-mon[125939]: pgmap v5114: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 8 op/s 2023-05-08T06:22:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:19 smithi096 ceph-mon[124666]: pgmap v5114: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 8 op/s 2023-05-08T06:22:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:19 smithi186 ceph-mon[126480]: pgmap v5114: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 8 op/s 2023-05-08T06:22:21.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9479.613302 secs 2023-05-08T06:22:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:21 smithi186 ceph-mon[126480]: pgmap v5115: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 7 op/s 2023-05-08T06:22:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9479.613302 secs 2023-05-08T06:22:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:21 smithi133 ceph-mon[125939]: pgmap v5115: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 7 op/s 2023-05-08T06:22:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9479.613302 secs 2023-05-08T06:22:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:21 smithi096 ceph-mon[124666]: pgmap v5115: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 7 op/s 2023-05-08T06:22:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:23 smithi133 ceph-mon[125939]: pgmap v5116: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 7 op/s 2023-05-08T06:22:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9482.775681 secs 2023-05-08T06:22:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9483.332499 secs 2023-05-08T06:22:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:23 smithi096 ceph-mon[124666]: pgmap v5116: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 7 op/s 2023-05-08T06:22:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9482.775681 secs 2023-05-08T06:22:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9483.332499 secs 2023-05-08T06:22:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:23 smithi186 ceph-mon[126480]: pgmap v5116: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 7 op/s 2023-05-08T06:22:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9482.775681 secs 2023-05-08T06:22:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9483.332499 secs 2023-05-08T06:22:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:25 smithi133 ceph-mon[125939]: pgmap v5117: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 56 KiB/s wr, 8 op/s 2023-05-08T06:22:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9484.613422 secs 2023-05-08T06:22:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:25 smithi096 ceph-mon[124666]: pgmap v5117: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 56 KiB/s wr, 8 op/s 2023-05-08T06:22:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9484.613422 secs 2023-05-08T06:22:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:25 smithi186 ceph-mon[126480]: pgmap v5117: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 56 KiB/s wr, 8 op/s 2023-05-08T06:22:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9484.613422 secs 2023-05-08T06:22:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:27 smithi133 ceph-mon[125939]: pgmap v5118: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 48 KiB/s wr, 7 op/s 2023-05-08T06:22:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:27 smithi096 ceph-mon[124666]: pgmap v5118: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 48 KiB/s wr, 7 op/s 2023-05-08T06:22:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:27 smithi186 ceph-mon[126480]: pgmap v5118: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 48 KiB/s wr, 7 op/s 2023-05-08T06:22:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9487.775802 secs 2023-05-08T06:22:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9488.332585 secs 2023-05-08T06:22:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9487.775802 secs 2023-05-08T06:22:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9488.332585 secs 2023-05-08T06:22:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9487.775802 secs 2023-05-08T06:22:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9488.332585 secs 2023-05-08T06:22:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:29 smithi133 ceph-mon[125939]: pgmap v5119: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 47 KiB/s wr, 6 op/s 2023-05-08T06:22:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:29 smithi096 ceph-mon[124666]: pgmap v5119: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 47 KiB/s wr, 6 op/s 2023-05-08T06:22:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:29 smithi186 ceph-mon[126480]: pgmap v5119: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 47 KiB/s wr, 6 op/s 2023-05-08T06:22:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9489.613540 secs 2023-05-08T06:22:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:31 smithi186 ceph-mon[126480]: pgmap v5120: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 10 op/s 2023-05-08T06:22:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9489.613540 secs 2023-05-08T06:22:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:31 smithi133 ceph-mon[125939]: pgmap v5120: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 10 op/s 2023-05-08T06:22:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9489.613540 secs 2023-05-08T06:22:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:31 smithi096 ceph-mon[124666]: pgmap v5120: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 10 op/s 2023-05-08T06:22:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:33 smithi133 ceph-mon[125939]: pgmap v5121: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 51 KiB/s wr, 7 op/s 2023-05-08T06:22:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9492.775916 secs 2023-05-08T06:22:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9493.332706 secs 2023-05-08T06:22:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:33 smithi096 ceph-mon[124666]: pgmap v5121: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 51 KiB/s wr, 7 op/s 2023-05-08T06:22:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9492.775916 secs 2023-05-08T06:22:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9493.332706 secs 2023-05-08T06:22:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:33 smithi186 ceph-mon[126480]: pgmap v5121: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 51 KiB/s wr, 7 op/s 2023-05-08T06:22:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9492.775916 secs 2023-05-08T06:22:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9493.332706 secs 2023-05-08T06:22:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:35 smithi133 ceph-mon[125939]: pgmap v5122: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 86 KiB/s wr, 11 op/s 2023-05-08T06:22:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9494.613636 secs 2023-05-08T06:22:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:35 smithi096 ceph-mon[124666]: pgmap v5122: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 86 KiB/s wr, 11 op/s 2023-05-08T06:22:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9494.613636 secs 2023-05-08T06:22:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:35 smithi186 ceph-mon[126480]: pgmap v5122: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 86 KiB/s wr, 11 op/s 2023-05-08T06:22:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9494.613636 secs 2023-05-08T06:22:38.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:37 smithi133 ceph-mon[125939]: pgmap v5123: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 40 KiB/s wr, 7 op/s 2023-05-08T06:22:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:37 smithi096 ceph-mon[124666]: pgmap v5123: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 40 KiB/s wr, 7 op/s 2023-05-08T06:22:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:37 smithi186 ceph-mon[126480]: pgmap v5123: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 40 KiB/s wr, 7 op/s 2023-05-08T06:22:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9497.776041 secs 2023-05-08T06:22:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9497.776041 secs 2023-05-08T06:22:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9497.776041 secs 2023-05-08T06:22:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:39 smithi133 ceph-mon[125939]: pgmap v5124: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 40 KiB/s wr, 7 op/s 2023-05-08T06:22:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:39 smithi096 ceph-mon[124666]: pgmap v5124: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 40 KiB/s wr, 7 op/s 2023-05-08T06:22:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:39 smithi186 ceph-mon[126480]: pgmap v5124: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 40 KiB/s wr, 7 op/s 2023-05-08T06:22:41.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:41 smithi186 ceph-mon[126480]: pgmap v5125: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 75 KiB/s wr, 11 op/s 2023-05-08T06:22:41.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:41 smithi133 ceph-mon[125939]: pgmap v5125: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 75 KiB/s wr, 11 op/s 2023-05-08T06:22:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:41 smithi096 ceph-mon[124666]: pgmap v5125: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 75 KiB/s wr, 11 op/s 2023-05-08T06:22:42.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:22:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:22:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:22:43.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:43 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:22:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:22:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:22:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:22:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:43 smithi186 ceph-mon[126480]: pgmap v5126: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 71 KiB/s wr, 7 op/s 2023-05-08T06:22:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:43 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:22:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:22:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:22:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:22:43.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:43 smithi133 ceph-mon[125939]: pgmap v5126: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 71 KiB/s wr, 7 op/s 2023-05-08T06:22:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:43 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:22:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:22:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:22:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:22:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:43 smithi096 ceph-mon[124666]: pgmap v5126: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 71 KiB/s wr, 7 op/s 2023-05-08T06:22:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9502.776144 secs 2023-05-08T06:22:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:22:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:22:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9502.776144 secs 2023-05-08T06:22:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:22:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:22:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9502.776144 secs 2023-05-08T06:22:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:22:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:22:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:45 smithi186 ceph-mon[126480]: pgmap v5127: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 136 KiB/s wr, 12 op/s 2023-05-08T06:22:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:22:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:45 smithi133 ceph-mon[125939]: pgmap v5127: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 136 KiB/s wr, 12 op/s 2023-05-08T06:22:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:22:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:45 smithi096 ceph-mon[124666]: pgmap v5127: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 136 KiB/s wr, 12 op/s 2023-05-08T06:22:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:22:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:46 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:22:46.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:46 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:22:46.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:46 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:22:46.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:46 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:22:46.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:46 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T06:22:46.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:46 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T06:22:46.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:46 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:22:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:46 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:22:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:46 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:22:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:46 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:22:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:46 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:22:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:46 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T06:22:46.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:46 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T06:22:46.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:46 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:22:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:46 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:22:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:46 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:22:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:46 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:22:46.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:46 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:22:46.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:46 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T06:22:46.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:46 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T06:22:46.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:46 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:22:47.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:47 smithi186 ceph-mon[126480]: pgmap v5128: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 100 KiB/s wr, 9 op/s 2023-05-08T06:22:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:47 smithi133 ceph-mon[125939]: pgmap v5128: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 100 KiB/s wr, 9 op/s 2023-05-08T06:22:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:47 smithi096 ceph-mon[124666]: pgmap v5128: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 100 KiB/s wr, 9 op/s 2023-05-08T06:22:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9507.776279 secs 2023-05-08T06:22:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9507.776279 secs 2023-05-08T06:22:48.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9507.776279 secs 2023-05-08T06:22:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9508.333093 secs 2023-05-08T06:22:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:49 smithi133 ceph-mon[125939]: pgmap v5129: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 100 KiB/s wr, 9 op/s 2023-05-08T06:22:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9508.333093 secs 2023-05-08T06:22:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:49 smithi096 ceph-mon[124666]: pgmap v5129: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 100 KiB/s wr, 9 op/s 2023-05-08T06:22:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9508.333093 secs 2023-05-08T06:22:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:49 smithi186 ceph-mon[126480]: pgmap v5129: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 100 KiB/s wr, 9 op/s 2023-05-08T06:22:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:50 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:22:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:50 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:22:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:50 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:22:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:51 smithi133 ceph-mon[125939]: pgmap v5130: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 107 KiB/s wr, 13 op/s 2023-05-08T06:22:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:22:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:22:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:51 smithi096 ceph-mon[124666]: pgmap v5130: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 107 KiB/s wr, 13 op/s 2023-05-08T06:22:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:22:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:22:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:51 smithi186 ceph-mon[126480]: pgmap v5130: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 107 KiB/s wr, 13 op/s 2023-05-08T06:22:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:22:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:22:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:53 smithi133 ceph-mon[125939]: pgmap v5131: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 71 KiB/s wr, 9 op/s 2023-05-08T06:22:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9512.776419 secs 2023-05-08T06:22:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9513.333182 secs 2023-05-08T06:22:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:53 smithi096 ceph-mon[124666]: pgmap v5131: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 71 KiB/s wr, 9 op/s 2023-05-08T06:22:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9512.776419 secs 2023-05-08T06:22:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9513.333182 secs 2023-05-08T06:22:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:53 smithi186 ceph-mon[126480]: pgmap v5131: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 71 KiB/s wr, 9 op/s 2023-05-08T06:22:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9512.776419 secs 2023-05-08T06:22:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9513.333182 secs 2023-05-08T06:22:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:55 smithi133 ceph-mon[125939]: pgmap v5132: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 162 KiB/s wr, 12 op/s 2023-05-08T06:22:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:55 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:22:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:55 smithi096 ceph-mon[124666]: pgmap v5132: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 162 KiB/s wr, 12 op/s 2023-05-08T06:22:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:55 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:22:56.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:55 smithi186 ceph-mon[126480]: pgmap v5132: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 162 KiB/s wr, 12 op/s 2023-05-08T06:22:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:55 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:22:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:57 smithi133 ceph-mon[125939]: pgmap v5133: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 98 KiB/s wr, 7 op/s 2023-05-08T06:22:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:57 smithi096 ceph-mon[124666]: pgmap v5133: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 98 KiB/s wr, 7 op/s 2023-05-08T06:22:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:57 smithi186 ceph-mon[126480]: pgmap v5133: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 98 KiB/s wr, 7 op/s 2023-05-08T06:22:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9517.776501 secs 2023-05-08T06:22:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9518.333305 secs 2023-05-08T06:22:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9517.776501 secs 2023-05-08T06:22:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9518.333305 secs 2023-05-08T06:22:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9517.776501 secs 2023-05-08T06:22:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9518.333305 secs 2023-05-08T06:23:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:22:59 smithi133 ceph-mon[125939]: pgmap v5134: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 98 KiB/s wr, 7 op/s 2023-05-08T06:23:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:22:59 smithi096 ceph-mon[124666]: pgmap v5134: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 98 KiB/s wr, 7 op/s 2023-05-08T06:23:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:22:59 smithi186 ceph-mon[126480]: pgmap v5134: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 98 KiB/s wr, 7 op/s 2023-05-08T06:23:01.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9519.614232 secs 2023-05-08T06:23:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:01 smithi186 ceph-mon[126480]: pgmap v5135: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 105 KiB/s wr, 12 op/s 2023-05-08T06:23:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9519.614232 secs 2023-05-08T06:23:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:01 smithi133 ceph-mon[125939]: pgmap v5135: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 105 KiB/s wr, 12 op/s 2023-05-08T06:23:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9519.614232 secs 2023-05-08T06:23:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:01 smithi096 ceph-mon[124666]: pgmap v5135: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 105 KiB/s wr, 12 op/s 2023-05-08T06:23:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:02 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:23:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:23:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:23:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:02 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:23:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:23:02.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:23:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:02 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:23:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:23:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:23:03.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:03 smithi186 ceph-mon[126480]: pgmap v5136: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 98 KiB/s wr, 7 op/s 2023-05-08T06:23:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:03 smithi133 ceph-mon[125939]: pgmap v5136: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 98 KiB/s wr, 7 op/s 2023-05-08T06:23:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:03 smithi096 ceph-mon[124666]: pgmap v5136: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 98 KiB/s wr, 7 op/s 2023-05-08T06:23:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9522.776624 secs 2023-05-08T06:23:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9523.333423 secs 2023-05-08T06:23:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9522.776624 secs 2023-05-08T06:23:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9523.333423 secs 2023-05-08T06:23:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9522.776624 secs 2023-05-08T06:23:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9523.333423 secs 2023-05-08T06:23:05.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:05 smithi186 ceph-mon[126480]: pgmap v5137: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 182 KiB/s wr, 26 op/s 2023-05-08T06:23:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9524.614333 secs 2023-05-08T06:23:05.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:05 smithi133 ceph-mon[125939]: pgmap v5137: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 182 KiB/s wr, 26 op/s 2023-05-08T06:23:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9524.614333 secs 2023-05-08T06:23:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:05 smithi096 ceph-mon[124666]: pgmap v5137: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 182 KiB/s wr, 26 op/s 2023-05-08T06:23:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9524.614333 secs 2023-05-08T06:23:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:06 smithi186 ceph-mon[126480]: osdmap e398: 12 total, 12 up, 12 in 2023-05-08T06:23:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:06 smithi133 ceph-mon[125939]: osdmap e398: 12 total, 12 up, 12 in 2023-05-08T06:23:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:06 smithi096 ceph-mon[124666]: osdmap e398: 12 total, 12 up, 12 in 2023-05-08T06:23:07.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:07 smithi186 ceph-mon[126480]: pgmap v5139: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 109 KiB/s wr, 26 op/s 2023-05-08T06:23:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:07 smithi133 ceph-mon[125939]: pgmap v5139: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 109 KiB/s wr, 26 op/s 2023-05-08T06:23:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:07 smithi096 ceph-mon[124666]: pgmap v5139: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 109 KiB/s wr, 26 op/s 2023-05-08T06:23:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9527.776752 secs 2023-05-08T06:23:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9527.776752 secs 2023-05-08T06:23:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9527.776752 secs 2023-05-08T06:23:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9528.333558 secs 2023-05-08T06:23:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:09 smithi133 ceph-mon[125939]: pgmap v5140: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 109 KiB/s wr, 26 op/s 2023-05-08T06:23:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9528.333558 secs 2023-05-08T06:23:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:09 smithi096 ceph-mon[124666]: pgmap v5140: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 109 KiB/s wr, 26 op/s 2023-05-08T06:23:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9528.333558 secs 2023-05-08T06:23:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:09 smithi186 ceph-mon[126480]: pgmap v5140: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 109 KiB/s wr, 26 op/s 2023-05-08T06:23:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9529.614482 secs 2023-05-08T06:23:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:11 smithi186 ceph-mon[126480]: pgmap v5141: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 105 KiB/s wr, 25 op/s 2023-05-08T06:23:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9529.614482 secs 2023-05-08T06:23:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:11 smithi133 ceph-mon[125939]: pgmap v5141: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 105 KiB/s wr, 25 op/s 2023-05-08T06:23:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9529.614482 secs 2023-05-08T06:23:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:11 smithi096 ceph-mon[124666]: pgmap v5141: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 105 KiB/s wr, 25 op/s 2023-05-08T06:23:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:13 smithi133 ceph-mon[125939]: pgmap v5142: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 105 KiB/s wr, 25 op/s 2023-05-08T06:23:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9532.776844 secs 2023-05-08T06:23:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9533.333678 secs 2023-05-08T06:23:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:13 smithi096 ceph-mon[124666]: pgmap v5142: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 105 KiB/s wr, 25 op/s 2023-05-08T06:23:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9532.776844 secs 2023-05-08T06:23:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9533.333678 secs 2023-05-08T06:23:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:13 smithi186 ceph-mon[126480]: pgmap v5142: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 105 KiB/s wr, 25 op/s 2023-05-08T06:23:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9532.776844 secs 2023-05-08T06:23:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9533.333678 secs 2023-05-08T06:23:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9534.614601 secs 2023-05-08T06:23:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:15 smithi133 ceph-mon[125939]: pgmap v5143: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 8 op/s 2023-05-08T06:23:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:15 smithi133 ceph-mon[125939]: osdmap e399: 12 total, 12 up, 12 in 2023-05-08T06:23:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9534.614601 secs 2023-05-08T06:23:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:15 smithi096 ceph-mon[124666]: pgmap v5143: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 8 op/s 2023-05-08T06:23:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:15 smithi096 ceph-mon[124666]: osdmap e399: 12 total, 12 up, 12 in 2023-05-08T06:23:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9534.614601 secs 2023-05-08T06:23:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:15 smithi186 ceph-mon[126480]: pgmap v5143: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 8 op/s 2023-05-08T06:23:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:15 smithi186 ceph-mon[126480]: osdmap e399: 12 total, 12 up, 12 in 2023-05-08T06:23:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:17 smithi133 ceph-mon[125939]: pgmap v5145: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 8 op/s 2023-05-08T06:23:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:17 smithi096 ceph-mon[124666]: pgmap v5145: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 8 op/s 2023-05-08T06:23:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:17 smithi186 ceph-mon[126480]: pgmap v5145: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 8 op/s 2023-05-08T06:23:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9537.776971 secs 2023-05-08T06:23:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9538.333789 secs 2023-05-08T06:23:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9537.776971 secs 2023-05-08T06:23:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9538.333789 secs 2023-05-08T06:23:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9537.776971 secs 2023-05-08T06:23:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9538.333789 secs 2023-05-08T06:23:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:19 smithi133 ceph-mon[125939]: pgmap v5146: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 8 op/s 2023-05-08T06:23:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:19 smithi096 ceph-mon[124666]: pgmap v5146: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 8 op/s 2023-05-08T06:23:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:19 smithi186 ceph-mon[126480]: pgmap v5146: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 8 op/s 2023-05-08T06:23:21.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9539.614721 secs 2023-05-08T06:23:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:21 smithi186 ceph-mon[126480]: pgmap v5147: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 8 op/s 2023-05-08T06:23:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9539.614721 secs 2023-05-08T06:23:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:21 smithi133 ceph-mon[125939]: pgmap v5147: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 8 op/s 2023-05-08T06:23:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9539.614721 secs 2023-05-08T06:23:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:21 smithi096 ceph-mon[124666]: pgmap v5147: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 8 op/s 2023-05-08T06:23:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:23 smithi133 ceph-mon[125939]: pgmap v5148: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 8 op/s 2023-05-08T06:23:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9542.777097 secs 2023-05-08T06:23:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9543.333907 secs 2023-05-08T06:23:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:23 smithi096 ceph-mon[124666]: pgmap v5148: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 8 op/s 2023-05-08T06:23:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9542.777097 secs 2023-05-08T06:23:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9543.333907 secs 2023-05-08T06:23:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:23 smithi186 ceph-mon[126480]: pgmap v5148: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 8 op/s 2023-05-08T06:23:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9542.777097 secs 2023-05-08T06:23:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9543.333907 secs 2023-05-08T06:23:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9544.614843 secs 2023-05-08T06:23:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:25 smithi133 ceph-mon[125939]: pgmap v5149: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 37 KiB/s wr, 8 op/s 2023-05-08T06:23:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9544.614843 secs 2023-05-08T06:23:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:25 smithi096 ceph-mon[124666]: pgmap v5149: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 37 KiB/s wr, 8 op/s 2023-05-08T06:23:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9544.614843 secs 2023-05-08T06:23:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:25 smithi186 ceph-mon[126480]: pgmap v5149: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 37 KiB/s wr, 8 op/s 2023-05-08T06:23:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:27 smithi133 ceph-mon[125939]: pgmap v5150: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 KiB/s wr, 7 op/s 2023-05-08T06:23:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:27 smithi096 ceph-mon[124666]: pgmap v5150: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 KiB/s wr, 7 op/s 2023-05-08T06:23:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:27 smithi186 ceph-mon[126480]: pgmap v5150: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 KiB/s wr, 7 op/s 2023-05-08T06:23:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9547.777218 secs 2023-05-08T06:23:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9548.334016 secs 2023-05-08T06:23:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9547.777218 secs 2023-05-08T06:23:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9548.334016 secs 2023-05-08T06:23:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9547.777218 secs 2023-05-08T06:23:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9548.334016 secs 2023-05-08T06:23:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:29 smithi133 ceph-mon[125939]: pgmap v5151: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 7 op/s 2023-05-08T06:23:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:29 smithi096 ceph-mon[124666]: pgmap v5151: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 7 op/s 2023-05-08T06:23:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:29 smithi186 ceph-mon[126480]: pgmap v5151: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 7 op/s 2023-05-08T06:23:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9549.614910 secs 2023-05-08T06:23:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:31 smithi186 ceph-mon[126480]: pgmap v5152: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 67 KiB/s wr, 11 op/s 2023-05-08T06:23:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9549.614910 secs 2023-05-08T06:23:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:31 smithi133 ceph-mon[125939]: pgmap v5152: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 67 KiB/s wr, 11 op/s 2023-05-08T06:23:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9549.614910 secs 2023-05-08T06:23:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:31 smithi096 ceph-mon[124666]: pgmap v5152: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 67 KiB/s wr, 11 op/s 2023-05-08T06:23:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:33 smithi133 ceph-mon[125939]: pgmap v5153: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 67 KiB/s wr, 7 op/s 2023-05-08T06:23:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9552.777332 secs 2023-05-08T06:23:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9553.334136 secs 2023-05-08T06:23:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:33 smithi096 ceph-mon[124666]: pgmap v5153: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 67 KiB/s wr, 7 op/s 2023-05-08T06:23:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9552.777332 secs 2023-05-08T06:23:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9553.334136 secs 2023-05-08T06:23:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:33 smithi186 ceph-mon[126480]: pgmap v5153: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 67 KiB/s wr, 7 op/s 2023-05-08T06:23:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9552.777332 secs 2023-05-08T06:23:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9553.334136 secs 2023-05-08T06:23:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9554.615034 secs 2023-05-08T06:23:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:35 smithi133 ceph-mon[125939]: pgmap v5154: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 103 KiB/s wr, 11 op/s 2023-05-08T06:23:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9554.615034 secs 2023-05-08T06:23:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:35 smithi096 ceph-mon[124666]: pgmap v5154: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 103 KiB/s wr, 11 op/s 2023-05-08T06:23:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9554.615034 secs 2023-05-08T06:23:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:35 smithi186 ceph-mon[126480]: pgmap v5154: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 103 KiB/s wr, 11 op/s 2023-05-08T06:23:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:37 smithi133 ceph-mon[125939]: pgmap v5155: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 72 KiB/s wr, 7 op/s 2023-05-08T06:23:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:37 smithi096 ceph-mon[124666]: pgmap v5155: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 72 KiB/s wr, 7 op/s 2023-05-08T06:23:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:37 smithi186 ceph-mon[126480]: pgmap v5155: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 72 KiB/s wr, 7 op/s 2023-05-08T06:23:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9557.777462 secs 2023-05-08T06:23:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9557.777462 secs 2023-05-08T06:23:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9557.777462 secs 2023-05-08T06:23:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:39 smithi133 ceph-mon[125939]: pgmap v5156: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 72 KiB/s wr, 7 op/s 2023-05-08T06:23:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:39 smithi096 ceph-mon[124666]: pgmap v5156: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 72 KiB/s wr, 7 op/s 2023-05-08T06:23:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:39 smithi186 ceph-mon[126480]: pgmap v5156: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 72 KiB/s wr, 7 op/s 2023-05-08T06:23:41.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9559.615158 secs 2023-05-08T06:23:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:41 smithi186 ceph-mon[126480]: pgmap v5157: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 108 KiB/s wr, 11 op/s 2023-05-08T06:23:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9559.615158 secs 2023-05-08T06:23:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:41 smithi133 ceph-mon[125939]: pgmap v5157: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 108 KiB/s wr, 11 op/s 2023-05-08T06:23:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9559.615158 secs 2023-05-08T06:23:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:41 smithi096 ceph-mon[124666]: pgmap v5157: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 108 KiB/s wr, 11 op/s 2023-05-08T06:23:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:23:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:23:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:23:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:43 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:23:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:23:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:23:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:43 smithi133 ceph-mon[125939]: pgmap v5158: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 72 KiB/s wr, 7 op/s 2023-05-08T06:23:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:43 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:23:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:23:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:23:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:43 smithi096 ceph-mon[124666]: pgmap v5158: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 72 KiB/s wr, 7 op/s 2023-05-08T06:23:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:43 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:23:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:23:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:23:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:43 smithi186 ceph-mon[126480]: pgmap v5158: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 72 KiB/s wr, 7 op/s 2023-05-08T06:23:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9562.777561 secs 2023-05-08T06:23:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9562.777561 secs 2023-05-08T06:23:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9562.777561 secs 2023-05-08T06:23:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:45 smithi133 ceph-mon[125939]: pgmap v5159: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 139 KiB/s wr, 12 op/s 2023-05-08T06:23:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:45 smithi096 ceph-mon[124666]: pgmap v5159: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 139 KiB/s wr, 12 op/s 2023-05-08T06:23:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:45 smithi186 ceph-mon[126480]: pgmap v5159: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 139 KiB/s wr, 12 op/s 2023-05-08T06:23:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:46 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:23:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:46 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:23:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:46 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:23:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:46 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:23:46.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:46 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:23:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:46 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:23:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:47 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:23:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:47 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:23:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:47 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:23:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:47 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:23:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:47 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:23:47.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:47 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:23:47.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:47 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T06:23:47.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:47 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T06:23:47.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:47 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:23:47.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:47 smithi133 ceph-mon[125939]: pgmap v5160: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 102 KiB/s wr, 9 op/s 2023-05-08T06:23:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:47 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:23:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:47 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:23:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:47 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:23:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:47 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:23:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:47 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:23:47.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:47 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:23:47.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:47 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T06:23:47.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:47 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T06:23:47.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:47 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:23:47.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:47 smithi096 ceph-mon[124666]: pgmap v5160: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 102 KiB/s wr, 9 op/s 2023-05-08T06:23:47.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:47 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:23:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:47 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:23:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:47 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:23:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:47 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:23:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:47 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:23:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:47 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:23:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:47 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T06:23:47.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:47 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T06:23:47.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:47 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:23:47.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:47 smithi186 ceph-mon[126480]: pgmap v5160: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 102 KiB/s wr, 9 op/s 2023-05-08T06:23:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9567.777695 secs 2023-05-08T06:23:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9567.777695 secs 2023-05-08T06:23:48.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9567.777695 secs 2023-05-08T06:23:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9568.334528 secs 2023-05-08T06:23:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:49 smithi133 ceph-mon[125939]: pgmap v5161: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 102 KiB/s wr, 9 op/s 2023-05-08T06:23:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9568.334528 secs 2023-05-08T06:23:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:49 smithi096 ceph-mon[124666]: pgmap v5161: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 102 KiB/s wr, 9 op/s 2023-05-08T06:23:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9568.334528 secs 2023-05-08T06:23:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:49 smithi186 ceph-mon[126480]: pgmap v5161: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 102 KiB/s wr, 9 op/s 2023-05-08T06:23:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:50 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:23:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:50 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:23:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:50 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:23:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:51 smithi133 ceph-mon[125939]: pgmap v5162: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 110 KiB/s wr, 13 op/s 2023-05-08T06:23:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:23:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:23:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:51 smithi096 ceph-mon[124666]: pgmap v5162: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 110 KiB/s wr, 13 op/s 2023-05-08T06:23:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:23:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:23:51.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:51 smithi186 ceph-mon[126480]: pgmap v5162: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 110 KiB/s wr, 13 op/s 2023-05-08T06:23:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:23:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:23:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:53 smithi133 ceph-mon[125939]: pgmap v5163: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 74 KiB/s wr, 9 op/s 2023-05-08T06:23:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:53 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:23:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9573.334691 secs 2023-05-08T06:23:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:53 smithi096 ceph-mon[124666]: pgmap v5163: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 74 KiB/s wr, 9 op/s 2023-05-08T06:23:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:53 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:23:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9573.334691 secs 2023-05-08T06:23:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:53 smithi186 ceph-mon[126480]: pgmap v5163: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 74 KiB/s wr, 9 op/s 2023-05-08T06:23:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:53 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:23:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9573.334691 secs 2023-05-08T06:23:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:54 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T06:23:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:54 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:23:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:54 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T06:23:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:54 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:23:55.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:54 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T06:23:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:54 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:23:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:55 smithi133 ceph-mon[125939]: pgmap v5164: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 139 KiB/s wr, 13 op/s 2023-05-08T06:23:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:55 smithi096 ceph-mon[124666]: pgmap v5164: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 139 KiB/s wr, 13 op/s 2023-05-08T06:23:56.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:55 smithi186 ceph-mon[126480]: pgmap v5164: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 139 KiB/s wr, 13 op/s 2023-05-08T06:23:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:57 smithi133 ceph-mon[125939]: pgmap v5165: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 72 KiB/s wr, 7 op/s 2023-05-08T06:23:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:57 smithi096 ceph-mon[124666]: pgmap v5165: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 72 KiB/s wr, 7 op/s 2023-05-08T06:23:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:57 smithi186 ceph-mon[126480]: pgmap v5165: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 72 KiB/s wr, 7 op/s 2023-05-08T06:23:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9577.777964 secs 2023-05-08T06:23:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9578.334766 secs 2023-05-08T06:23:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9577.777964 secs 2023-05-08T06:23:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9578.334766 secs 2023-05-08T06:23:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9577.777964 secs 2023-05-08T06:23:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9578.334766 secs 2023-05-08T06:24:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:23:59 smithi133 ceph-mon[125939]: pgmap v5166: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 72 KiB/s wr, 7 op/s 2023-05-08T06:24:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:23:59 smithi096 ceph-mon[124666]: pgmap v5166: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 72 KiB/s wr, 7 op/s 2023-05-08T06:24:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:23:59 smithi186 ceph-mon[126480]: pgmap v5166: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 72 KiB/s wr, 7 op/s 2023-05-08T06:24:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9579.615684 secs 2023-05-08T06:24:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:01 smithi133 ceph-mon[125939]: pgmap v5167: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 80 KiB/s wr, 12 op/s 2023-05-08T06:24:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9579.615684 secs 2023-05-08T06:24:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:01 smithi096 ceph-mon[124666]: pgmap v5167: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 80 KiB/s wr, 12 op/s 2023-05-08T06:24:01.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9579.615684 secs 2023-05-08T06:24:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:01 smithi186 ceph-mon[126480]: pgmap v5167: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 80 KiB/s wr, 12 op/s 2023-05-08T06:24:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:02 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:24:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T06:24:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:24:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:02 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:24:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T06:24:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:24:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:02 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:24:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T06:24:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:24:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:03 smithi133 ceph-mon[125939]: pgmap v5168: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 72 KiB/s wr, 7 op/s 2023-05-08T06:24:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:03 smithi096 ceph-mon[124666]: pgmap v5168: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 72 KiB/s wr, 7 op/s 2023-05-08T06:24:03.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:03 smithi186 ceph-mon[126480]: pgmap v5168: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 72 KiB/s wr, 7 op/s 2023-05-08T06:24:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9582.778088 secs 2023-05-08T06:24:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:04 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:24:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:04 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:24:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9583.334900 secs 2023-05-08T06:24:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9582.778088 secs 2023-05-08T06:24:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:04 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:24:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:04 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:24:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9583.334900 secs 2023-05-08T06:24:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9582.778088 secs 2023-05-08T06:24:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:04 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:24:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:04 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:24:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9583.334900 secs 2023-05-08T06:24:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:05 smithi133 ceph-mon[125939]: pgmap v5169: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 158 KiB/s wr, 26 op/s 2023-05-08T06:24:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:05 smithi096 ceph-mon[124666]: pgmap v5169: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 158 KiB/s wr, 26 op/s 2023-05-08T06:24:05.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:05 smithi186 ceph-mon[126480]: pgmap v5169: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 158 KiB/s wr, 26 op/s 2023-05-08T06:24:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9584.615806 secs 2023-05-08T06:24:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:06 smithi133 ceph-mon[125939]: osdmap e400: 12 total, 12 up, 12 in 2023-05-08T06:24:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9584.615806 secs 2023-05-08T06:24:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:06 smithi096 ceph-mon[124666]: osdmap e400: 12 total, 12 up, 12 in 2023-05-08T06:24:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9584.615806 secs 2023-05-08T06:24:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:06 smithi186 ceph-mon[126480]: osdmap e400: 12 total, 12 up, 12 in 2023-05-08T06:24:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:07 smithi133 ceph-mon[125939]: pgmap v5171: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 112 KiB/s wr, 26 op/s 2023-05-08T06:24:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:07 smithi096 ceph-mon[124666]: pgmap v5171: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 112 KiB/s wr, 26 op/s 2023-05-08T06:24:07.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:07 smithi186 ceph-mon[126480]: pgmap v5171: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 112 KiB/s wr, 26 op/s 2023-05-08T06:24:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9587.778215 secs 2023-05-08T06:24:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9587.778215 secs 2023-05-08T06:24:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9587.778215 secs 2023-05-08T06:24:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9588.335042 secs 2023-05-08T06:24:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:09 smithi133 ceph-mon[125939]: pgmap v5172: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 112 KiB/s wr, 26 op/s 2023-05-08T06:24:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9588.335042 secs 2023-05-08T06:24:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:09 smithi096 ceph-mon[124666]: pgmap v5172: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 112 KiB/s wr, 26 op/s 2023-05-08T06:24:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9588.335042 secs 2023-05-08T06:24:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:09 smithi186 ceph-mon[126480]: pgmap v5172: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 112 KiB/s wr, 26 op/s 2023-05-08T06:24:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9589.615926 secs 2023-05-08T06:24:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:10 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:24:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9589.615926 secs 2023-05-08T06:24:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:10 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:24:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9589.615926 secs 2023-05-08T06:24:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:10 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:24:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:11 smithi133 ceph-mon[125939]: pgmap v5173: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 108 KiB/s wr, 26 op/s 2023-05-08T06:24:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:11 smithi096 ceph-mon[124666]: pgmap v5173: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 108 KiB/s wr, 26 op/s 2023-05-08T06:24:11.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:11 smithi186 ceph-mon[126480]: pgmap v5173: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 108 KiB/s wr, 26 op/s 2023-05-08T06:24:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:13 smithi133 ceph-mon[125939]: pgmap v5174: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 108 KiB/s wr, 26 op/s 2023-05-08T06:24:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9592.778315 secs 2023-05-08T06:24:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9593.335139 secs 2023-05-08T06:24:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:13 smithi096 ceph-mon[124666]: pgmap v5174: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 108 KiB/s wr, 26 op/s 2023-05-08T06:24:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9592.778315 secs 2023-05-08T06:24:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9593.335139 secs 2023-05-08T06:24:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:13 smithi186 ceph-mon[126480]: pgmap v5174: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 108 KiB/s wr, 26 op/s 2023-05-08T06:24:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9592.778315 secs 2023-05-08T06:24:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9593.335139 secs 2023-05-08T06:24:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9594.616046 secs 2023-05-08T06:24:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:15 smithi133 ceph-mon[125939]: pgmap v5175: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 23 KiB/s wr, 8 op/s 2023-05-08T06:24:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:15 smithi133 ceph-mon[125939]: osdmap e401: 12 total, 12 up, 12 in 2023-05-08T06:24:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9594.616046 secs 2023-05-08T06:24:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:15 smithi096 ceph-mon[124666]: pgmap v5175: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 23 KiB/s wr, 8 op/s 2023-05-08T06:24:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:15 smithi096 ceph-mon[124666]: osdmap e401: 12 total, 12 up, 12 in 2023-05-08T06:24:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9594.616046 secs 2023-05-08T06:24:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:15 smithi186 ceph-mon[126480]: pgmap v5175: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 23 KiB/s wr, 8 op/s 2023-05-08T06:24:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:15 smithi186 ceph-mon[126480]: osdmap e401: 12 total, 12 up, 12 in 2023-05-08T06:24:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:17 smithi133 ceph-mon[125939]: pgmap v5177: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 23 KiB/s wr, 8 op/s 2023-05-08T06:24:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:17 smithi096 ceph-mon[124666]: pgmap v5177: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 23 KiB/s wr, 8 op/s 2023-05-08T06:24:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:17 smithi186 ceph-mon[126480]: pgmap v5177: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 23 KiB/s wr, 8 op/s 2023-05-08T06:24:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9597.778430 secs 2023-05-08T06:24:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9598.335257 secs 2023-05-08T06:24:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9597.778430 secs 2023-05-08T06:24:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9598.335257 secs 2023-05-08T06:24:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9597.778430 secs 2023-05-08T06:24:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9598.335257 secs 2023-05-08T06:24:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:19 smithi133 ceph-mon[125939]: pgmap v5178: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 23 KiB/s wr, 8 op/s 2023-05-08T06:24:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:19 smithi096 ceph-mon[124666]: pgmap v5178: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 23 KiB/s wr, 8 op/s 2023-05-08T06:24:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:19 smithi186 ceph-mon[126480]: pgmap v5178: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 23 KiB/s wr, 8 op/s 2023-05-08T06:24:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9599.616174 secs 2023-05-08T06:24:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:21 smithi133 ceph-mon[125939]: pgmap v5179: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 8 op/s 2023-05-08T06:24:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9599.616174 secs 2023-05-08T06:24:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:21 smithi096 ceph-mon[124666]: pgmap v5179: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 8 op/s 2023-05-08T06:24:21.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9599.616174 secs 2023-05-08T06:24:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:21 smithi186 ceph-mon[126480]: pgmap v5179: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 8 op/s 2023-05-08T06:24:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:23 smithi133 ceph-mon[125939]: pgmap v5180: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 8 op/s 2023-05-08T06:24:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9602.778518 secs 2023-05-08T06:24:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9603.335405 secs 2023-05-08T06:24:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:23 smithi096 ceph-mon[124666]: pgmap v5180: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 8 op/s 2023-05-08T06:24:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9602.778518 secs 2023-05-08T06:24:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9603.335405 secs 2023-05-08T06:24:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:23 smithi186 ceph-mon[126480]: pgmap v5180: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 8 op/s 2023-05-08T06:24:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9602.778518 secs 2023-05-08T06:24:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9603.335405 secs 2023-05-08T06:24:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9604.616300 secs 2023-05-08T06:24:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:25 smithi133 ceph-mon[125939]: pgmap v5181: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 KiB/s wr, 8 op/s 2023-05-08T06:24:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9604.616300 secs 2023-05-08T06:24:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:25 smithi096 ceph-mon[124666]: pgmap v5181: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 KiB/s wr, 8 op/s 2023-05-08T06:24:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9604.616300 secs 2023-05-08T06:24:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:25 smithi186 ceph-mon[126480]: pgmap v5181: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 KiB/s wr, 8 op/s 2023-05-08T06:24:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:27 smithi133 ceph-mon[125939]: pgmap v5182: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 KiB/s wr, 7 op/s 2023-05-08T06:24:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:27 smithi096 ceph-mon[124666]: pgmap v5182: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 KiB/s wr, 7 op/s 2023-05-08T06:24:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:27 smithi186 ceph-mon[126480]: pgmap v5182: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 KiB/s wr, 7 op/s 2023-05-08T06:24:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9607.778647 secs 2023-05-08T06:24:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9608.335522 secs 2023-05-08T06:24:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9607.778647 secs 2023-05-08T06:24:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9608.335522 secs 2023-05-08T06:24:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9607.778647 secs 2023-05-08T06:24:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9608.335522 secs 2023-05-08T06:24:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:29 smithi133 ceph-mon[125939]: pgmap v5183: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T06:24:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:29 smithi096 ceph-mon[124666]: pgmap v5183: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T06:24:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:29 smithi186 ceph-mon[126480]: pgmap v5183: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T06:24:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9609.616424 secs 2023-05-08T06:24:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:31 smithi133 ceph-mon[125939]: pgmap v5184: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 KiB/s wr, 10 op/s 2023-05-08T06:24:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9609.616424 secs 2023-05-08T06:24:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:31 smithi096 ceph-mon[124666]: pgmap v5184: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 KiB/s wr, 10 op/s 2023-05-08T06:24:31.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9609.616424 secs 2023-05-08T06:24:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:31 smithi186 ceph-mon[126480]: pgmap v5184: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 KiB/s wr, 10 op/s 2023-05-08T06:24:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:33 smithi133 ceph-mon[125939]: pgmap v5185: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 7 op/s 2023-05-08T06:24:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9612.778751 secs 2023-05-08T06:24:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9613.335641 secs 2023-05-08T06:24:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:33 smithi096 ceph-mon[124666]: pgmap v5185: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 7 op/s 2023-05-08T06:24:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9612.778751 secs 2023-05-08T06:24:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9613.335641 secs 2023-05-08T06:24:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:33 smithi186 ceph-mon[126480]: pgmap v5185: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 7 op/s 2023-05-08T06:24:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9612.778751 secs 2023-05-08T06:24:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9613.335641 secs 2023-05-08T06:24:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9614.616584 secs 2023-05-08T06:24:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:35 smithi133 ceph-mon[125939]: pgmap v5186: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 91 KiB/s wr, 11 op/s 2023-05-08T06:24:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9614.616584 secs 2023-05-08T06:24:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:35 smithi096 ceph-mon[124666]: pgmap v5186: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 91 KiB/s wr, 11 op/s 2023-05-08T06:24:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9614.616584 secs 2023-05-08T06:24:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:35 smithi186 ceph-mon[126480]: pgmap v5186: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 91 KiB/s wr, 11 op/s 2023-05-08T06:24:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:37 smithi133 ceph-mon[125939]: pgmap v5187: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 60 KiB/s wr, 7 op/s 2023-05-08T06:24:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:37 smithi096 ceph-mon[124666]: pgmap v5187: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 60 KiB/s wr, 7 op/s 2023-05-08T06:24:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:37 smithi186 ceph-mon[126480]: pgmap v5187: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 60 KiB/s wr, 7 op/s 2023-05-08T06:24:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9617.778896 secs 2023-05-08T06:24:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9617.778896 secs 2023-05-08T06:24:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9617.778896 secs 2023-05-08T06:24:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:39 smithi133 ceph-mon[125939]: pgmap v5188: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 60 KiB/s wr, 7 op/s 2023-05-08T06:24:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:39 smithi096 ceph-mon[124666]: pgmap v5188: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 60 KiB/s wr, 7 op/s 2023-05-08T06:24:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:39 smithi186 ceph-mon[126480]: pgmap v5188: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 60 KiB/s wr, 7 op/s 2023-05-08T06:24:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9619.616713 secs 2023-05-08T06:24:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:41 smithi133 ceph-mon[125939]: pgmap v5189: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 97 KiB/s wr, 11 op/s 2023-05-08T06:24:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9619.616713 secs 2023-05-08T06:24:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:41 smithi096 ceph-mon[124666]: pgmap v5189: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 97 KiB/s wr, 11 op/s 2023-05-08T06:24:41.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9619.616713 secs 2023-05-08T06:24:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:41 smithi186 ceph-mon[126480]: pgmap v5189: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 97 KiB/s wr, 11 op/s 2023-05-08T06:24:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:24:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:24:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:24:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:43 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:24:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:24:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:24:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:43 smithi133 ceph-mon[125939]: pgmap v5190: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 93 KiB/s wr, 8 op/s 2023-05-08T06:24:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:43 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:24:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:24:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:24:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:43 smithi096 ceph-mon[124666]: pgmap v5190: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 93 KiB/s wr, 8 op/s 2023-05-08T06:24:43.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:43 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:24:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:24:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:24:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:43 smithi186 ceph-mon[126480]: pgmap v5190: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 93 KiB/s wr, 8 op/s 2023-05-08T06:24:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9622.779036 secs 2023-05-08T06:24:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9622.779036 secs 2023-05-08T06:24:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9622.779036 secs 2023-05-08T06:24:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:45 smithi133 ceph-mon[125939]: pgmap v5191: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 160 KiB/s wr, 13 op/s 2023-05-08T06:24:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:45 smithi096 ceph-mon[124666]: pgmap v5191: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 160 KiB/s wr, 13 op/s 2023-05-08T06:24:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:45 smithi186 ceph-mon[126480]: pgmap v5191: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 160 KiB/s wr, 13 op/s 2023-05-08T06:24:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:46 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:24:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:46 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:24:46.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:46 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:24:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:47 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:24:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:47 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:24:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:47 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:24:47.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:47 smithi133 ceph-mon[125939]: pgmap v5192: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 104 KiB/s wr, 9 op/s 2023-05-08T06:24:47.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:47 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:24:47.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:47 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:24:47.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:47 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:24:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:47 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:24:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:47 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:24:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:47 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:24:47.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:47 smithi096 ceph-mon[124666]: pgmap v5192: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 104 KiB/s wr, 9 op/s 2023-05-08T06:24:47.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:47 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:24:47.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:47 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:24:47.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:47 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:24:47.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:47 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:24:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:47 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:24:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:47 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:24:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:47 smithi186 ceph-mon[126480]: pgmap v5192: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 104 KiB/s wr, 9 op/s 2023-05-08T06:24:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:47 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:24:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:47 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:24:47.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:47 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:24:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:48 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:24:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:48 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T06:24:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:48 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T06:24:48.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:48 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:24:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:48 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:24:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:48 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T06:24:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:48 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T06:24:48.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:48 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:24:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:48 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:24:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:48 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T06:24:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:48 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T06:24:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:48 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:24:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9627.779177 secs 2023-05-08T06:24:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9628.336009 secs 2023-05-08T06:24:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:49 smithi133 ceph-mon[125939]: pgmap v5193: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 104 KiB/s wr, 9 op/s 2023-05-08T06:24:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9627.779177 secs 2023-05-08T06:24:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9628.336009 secs 2023-05-08T06:24:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:49 smithi096 ceph-mon[124666]: pgmap v5193: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 104 KiB/s wr, 9 op/s 2023-05-08T06:24:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9627.779177 secs 2023-05-08T06:24:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9628.336009 secs 2023-05-08T06:24:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:49 smithi186 ceph-mon[126480]: pgmap v5193: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 104 KiB/s wr, 9 op/s 2023-05-08T06:24:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:50 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:24:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:50 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:24:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:50 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:24:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:51 smithi133 ceph-mon[125939]: pgmap v5194: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 111 KiB/s wr, 13 op/s 2023-05-08T06:24:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:24:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:24:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:51 smithi096 ceph-mon[124666]: pgmap v5194: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 111 KiB/s wr, 13 op/s 2023-05-08T06:24:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:24:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:24:51.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:51 smithi186 ceph-mon[126480]: pgmap v5194: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 111 KiB/s wr, 13 op/s 2023-05-08T06:24:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:24:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:24:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:53 smithi133 ceph-mon[125939]: pgmap v5195: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 74 KiB/s wr, 9 op/s 2023-05-08T06:24:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9632.779296 secs 2023-05-08T06:24:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9633.336117 secs 2023-05-08T06:24:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:53 smithi096 ceph-mon[124666]: pgmap v5195: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 74 KiB/s wr, 9 op/s 2023-05-08T06:24:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9632.779296 secs 2023-05-08T06:24:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9633.336117 secs 2023-05-08T06:24:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:53 smithi186 ceph-mon[126480]: pgmap v5195: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 74 KiB/s wr, 9 op/s 2023-05-08T06:24:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9632.779296 secs 2023-05-08T06:24:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9633.336117 secs 2023-05-08T06:24:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:55 smithi133 ceph-mon[125939]: pgmap v5196: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 169 KiB/s wr, 13 op/s 2023-05-08T06:24:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:55 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:24:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:55 smithi096 ceph-mon[124666]: pgmap v5196: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 169 KiB/s wr, 13 op/s 2023-05-08T06:24:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:55 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:24:56.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:55 smithi186 ceph-mon[126480]: pgmap v5196: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 169 KiB/s wr, 13 op/s 2023-05-08T06:24:56.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:55 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:24:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:57 smithi133 ceph-mon[125939]: pgmap v5197: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 101 KiB/s wr, 8 op/s 2023-05-08T06:24:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:57 smithi096 ceph-mon[124666]: pgmap v5197: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 101 KiB/s wr, 8 op/s 2023-05-08T06:24:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:57 smithi186 ceph-mon[126480]: pgmap v5197: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 101 KiB/s wr, 8 op/s 2023-05-08T06:24:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9637.779420 secs 2023-05-08T06:24:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9638.336256 secs 2023-05-08T06:24:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9637.779420 secs 2023-05-08T06:24:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9638.336256 secs 2023-05-08T06:24:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9637.779420 secs 2023-05-08T06:24:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9638.336256 secs 2023-05-08T06:25:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:24:59 smithi133 ceph-mon[125939]: pgmap v5198: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 101 KiB/s wr, 8 op/s 2023-05-08T06:25:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:24:59 smithi096 ceph-mon[124666]: pgmap v5198: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 101 KiB/s wr, 8 op/s 2023-05-08T06:25:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:24:59 smithi186 ceph-mon[126480]: pgmap v5198: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 101 KiB/s wr, 8 op/s 2023-05-08T06:25:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9639.617260 secs 2023-05-08T06:25:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:01 smithi133 ceph-mon[125939]: pgmap v5199: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 109 KiB/s wr, 11 op/s 2023-05-08T06:25:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9639.617260 secs 2023-05-08T06:25:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:01 smithi096 ceph-mon[124666]: pgmap v5199: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 109 KiB/s wr, 11 op/s 2023-05-08T06:25:01.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9639.617260 secs 2023-05-08T06:25:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:01 smithi186 ceph-mon[126480]: pgmap v5199: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 109 KiB/s wr, 11 op/s 2023-05-08T06:25:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:02 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:25:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:25:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:25:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:02 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:25:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:25:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:25:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:02 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:25:02.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:25:02.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:25:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:03 smithi186 ceph-mon[126480]: pgmap v5200: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 102 KiB/s wr, 7 op/s 2023-05-08T06:25:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:03 smithi133 ceph-mon[125939]: pgmap v5200: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 102 KiB/s wr, 7 op/s 2023-05-08T06:25:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:03 smithi096 ceph-mon[124666]: pgmap v5200: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 102 KiB/s wr, 7 op/s 2023-05-08T06:25:04.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9642.779540 secs 2023-05-08T06:25:04.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9643.336379 secs 2023-05-08T06:25:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9642.779540 secs 2023-05-08T06:25:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9643.336379 secs 2023-05-08T06:25:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9642.779540 secs 2023-05-08T06:25:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9643.336379 secs 2023-05-08T06:25:05.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9644.617382 secs 2023-05-08T06:25:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:05 smithi186 ceph-mon[126480]: pgmap v5201: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 187 KiB/s wr, 25 op/s 2023-05-08T06:25:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9644.617382 secs 2023-05-08T06:25:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:05 smithi133 ceph-mon[125939]: pgmap v5201: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 187 KiB/s wr, 25 op/s 2023-05-08T06:25:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9644.617382 secs 2023-05-08T06:25:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:05 smithi096 ceph-mon[124666]: pgmap v5201: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 187 KiB/s wr, 25 op/s 2023-05-08T06:25:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:06 smithi186 ceph-mon[126480]: osdmap e402: 12 total, 12 up, 12 in 2023-05-08T06:25:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:06 smithi133 ceph-mon[125939]: osdmap e402: 12 total, 12 up, 12 in 2023-05-08T06:25:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:06 smithi096 ceph-mon[124666]: osdmap e402: 12 total, 12 up, 12 in 2023-05-08T06:25:07.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:07 smithi186 ceph-mon[126480]: pgmap v5203: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 111 KiB/s wr, 26 op/s 2023-05-08T06:25:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:07 smithi133 ceph-mon[125939]: pgmap v5203: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 111 KiB/s wr, 26 op/s 2023-05-08T06:25:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:07 smithi096 ceph-mon[124666]: pgmap v5203: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 111 KiB/s wr, 26 op/s 2023-05-08T06:25:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9647.779661 secs 2023-05-08T06:25:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9647.779661 secs 2023-05-08T06:25:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9647.779661 secs 2023-05-08T06:25:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9648.336520 secs 2023-05-08T06:25:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:09 smithi133 ceph-mon[125939]: pgmap v5204: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 111 KiB/s wr, 26 op/s 2023-05-08T06:25:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9648.336520 secs 2023-05-08T06:25:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:09 smithi096 ceph-mon[124666]: pgmap v5204: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 111 KiB/s wr, 26 op/s 2023-05-08T06:25:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9648.336520 secs 2023-05-08T06:25:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:09 smithi186 ceph-mon[126480]: pgmap v5204: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 111 KiB/s wr, 26 op/s 2023-05-08T06:25:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9649.617512 secs 2023-05-08T06:25:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:11 smithi133 ceph-mon[125939]: pgmap v5205: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 107 KiB/s wr, 26 op/s 2023-05-08T06:25:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9649.617512 secs 2023-05-08T06:25:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:11 smithi096 ceph-mon[124666]: pgmap v5205: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 107 KiB/s wr, 26 op/s 2023-05-08T06:25:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9649.617512 secs 2023-05-08T06:25:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:11 smithi186 ceph-mon[126480]: pgmap v5205: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 107 KiB/s wr, 26 op/s 2023-05-08T06:25:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:13 smithi133 ceph-mon[125939]: pgmap v5206: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 107 KiB/s wr, 26 op/s 2023-05-08T06:25:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9652.779781 secs 2023-05-08T06:25:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9653.336669 secs 2023-05-08T06:25:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:13 smithi096 ceph-mon[124666]: pgmap v5206: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 107 KiB/s wr, 26 op/s 2023-05-08T06:25:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9652.779781 secs 2023-05-08T06:25:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9653.336669 secs 2023-05-08T06:25:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:13 smithi186 ceph-mon[126480]: pgmap v5206: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 107 KiB/s wr, 26 op/s 2023-05-08T06:25:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9652.779781 secs 2023-05-08T06:25:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9653.336669 secs 2023-05-08T06:25:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9654.617599 secs 2023-05-08T06:25:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:15 smithi133 ceph-mon[125939]: pgmap v5207: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 24 KiB/s wr, 8 op/s 2023-05-08T06:25:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:15 smithi133 ceph-mon[125939]: osdmap e403: 12 total, 12 up, 12 in 2023-05-08T06:25:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9654.617599 secs 2023-05-08T06:25:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:15 smithi096 ceph-mon[124666]: pgmap v5207: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 24 KiB/s wr, 8 op/s 2023-05-08T06:25:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:15 smithi096 ceph-mon[124666]: osdmap e403: 12 total, 12 up, 12 in 2023-05-08T06:25:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9654.617599 secs 2023-05-08T06:25:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:15 smithi186 ceph-mon[126480]: pgmap v5207: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 24 KiB/s wr, 8 op/s 2023-05-08T06:25:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:15 smithi186 ceph-mon[126480]: osdmap e403: 12 total, 12 up, 12 in 2023-05-08T06:25:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:17 smithi133 ceph-mon[125939]: pgmap v5209: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 24 KiB/s wr, 8 op/s 2023-05-08T06:25:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:17 smithi096 ceph-mon[124666]: pgmap v5209: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 24 KiB/s wr, 8 op/s 2023-05-08T06:25:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:17 smithi186 ceph-mon[126480]: pgmap v5209: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 24 KiB/s wr, 8 op/s 2023-05-08T06:25:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9657.779913 secs 2023-05-08T06:25:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9658.336773 secs 2023-05-08T06:25:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9657.779913 secs 2023-05-08T06:25:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9658.336773 secs 2023-05-08T06:25:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9657.779913 secs 2023-05-08T06:25:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9658.336773 secs 2023-05-08T06:25:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:19 smithi133 ceph-mon[125939]: pgmap v5210: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 24 KiB/s wr, 8 op/s 2023-05-08T06:25:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:19 smithi096 ceph-mon[124666]: pgmap v5210: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 24 KiB/s wr, 8 op/s 2023-05-08T06:25:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:19 smithi186 ceph-mon[126480]: pgmap v5210: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 24 KiB/s wr, 8 op/s 2023-05-08T06:25:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9659.617740 secs 2023-05-08T06:25:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:21 smithi133 ceph-mon[125939]: pgmap v5211: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 8 op/s 2023-05-08T06:25:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9659.617740 secs 2023-05-08T06:25:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:21 smithi096 ceph-mon[124666]: pgmap v5211: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 8 op/s 2023-05-08T06:25:21.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9659.617740 secs 2023-05-08T06:25:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:21 smithi186 ceph-mon[126480]: pgmap v5211: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 8 op/s 2023-05-08T06:25:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:23 smithi133 ceph-mon[125939]: pgmap v5212: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 8 op/s 2023-05-08T06:25:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9662.780029 secs 2023-05-08T06:25:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9663.336854 secs 2023-05-08T06:25:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:23 smithi096 ceph-mon[124666]: pgmap v5212: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 8 op/s 2023-05-08T06:25:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9662.780029 secs 2023-05-08T06:25:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9663.336854 secs 2023-05-08T06:25:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:23 smithi186 ceph-mon[126480]: pgmap v5212: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 8 op/s 2023-05-08T06:25:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9662.780029 secs 2023-05-08T06:25:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9663.336854 secs 2023-05-08T06:25:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9664.617870 secs 2023-05-08T06:25:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:25 smithi133 ceph-mon[125939]: pgmap v5213: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 38 KiB/s wr, 8 op/s 2023-05-08T06:25:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9664.617870 secs 2023-05-08T06:25:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:25 smithi096 ceph-mon[124666]: pgmap v5213: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 38 KiB/s wr, 8 op/s 2023-05-08T06:25:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9664.617870 secs 2023-05-08T06:25:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:25 smithi186 ceph-mon[126480]: pgmap v5213: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 38 KiB/s wr, 8 op/s 2023-05-08T06:25:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:27 smithi133 ceph-mon[125939]: pgmap v5214: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T06:25:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:27 smithi096 ceph-mon[124666]: pgmap v5214: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T06:25:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:27 smithi186 ceph-mon[126480]: pgmap v5214: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T06:25:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9667.780164 secs 2023-05-08T06:25:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9668.336969 secs 2023-05-08T06:25:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9667.780164 secs 2023-05-08T06:25:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9668.336969 secs 2023-05-08T06:25:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9667.780164 secs 2023-05-08T06:25:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9668.336969 secs 2023-05-08T06:25:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:29 smithi133 ceph-mon[125939]: pgmap v5215: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T06:25:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:29 smithi096 ceph-mon[124666]: pgmap v5215: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T06:25:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:29 smithi186 ceph-mon[126480]: pgmap v5215: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T06:25:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9669.618014 secs 2023-05-08T06:25:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:31 smithi133 ceph-mon[125939]: pgmap v5216: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 10 op/s 2023-05-08T06:25:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9669.618014 secs 2023-05-08T06:25:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:31 smithi096 ceph-mon[124666]: pgmap v5216: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 10 op/s 2023-05-08T06:25:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9669.618014 secs 2023-05-08T06:25:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:31 smithi186 ceph-mon[126480]: pgmap v5216: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 10 op/s 2023-05-08T06:25:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:33 smithi133 ceph-mon[125939]: pgmap v5217: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 7 op/s 2023-05-08T06:25:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9672.780263 secs 2023-05-08T06:25:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9673.337062 secs 2023-05-08T06:25:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:33 smithi096 ceph-mon[124666]: pgmap v5217: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 7 op/s 2023-05-08T06:25:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9672.780263 secs 2023-05-08T06:25:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9673.337062 secs 2023-05-08T06:25:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:33 smithi186 ceph-mon[126480]: pgmap v5217: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 7 op/s 2023-05-08T06:25:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9672.780263 secs 2023-05-08T06:25:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9673.337062 secs 2023-05-08T06:25:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9674.618087 secs 2023-05-08T06:25:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:35 smithi133 ceph-mon[125939]: pgmap v5218: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 93 KiB/s wr, 10 op/s 2023-05-08T06:25:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9674.618087 secs 2023-05-08T06:25:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:35 smithi096 ceph-mon[124666]: pgmap v5218: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 93 KiB/s wr, 10 op/s 2023-05-08T06:25:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9674.618087 secs 2023-05-08T06:25:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:35 smithi186 ceph-mon[126480]: pgmap v5218: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 93 KiB/s wr, 10 op/s 2023-05-08T06:25:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:37 smithi133 ceph-mon[125939]: pgmap v5219: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 61 KiB/s wr, 7 op/s 2023-05-08T06:25:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:37 smithi096 ceph-mon[124666]: pgmap v5219: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 61 KiB/s wr, 7 op/s 2023-05-08T06:25:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:37 smithi186 ceph-mon[126480]: pgmap v5219: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 61 KiB/s wr, 7 op/s 2023-05-08T06:25:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9677.780392 secs 2023-05-08T06:25:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9677.780392 secs 2023-05-08T06:25:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9677.780392 secs 2023-05-08T06:25:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:39 smithi133 ceph-mon[125939]: pgmap v5220: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 61 KiB/s wr, 7 op/s 2023-05-08T06:25:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:39 smithi096 ceph-mon[124666]: pgmap v5220: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 61 KiB/s wr, 7 op/s 2023-05-08T06:25:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:39 smithi186 ceph-mon[126480]: pgmap v5220: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 61 KiB/s wr, 7 op/s 2023-05-08T06:25:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9679.618206 secs 2023-05-08T06:25:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:41 smithi133 ceph-mon[125939]: pgmap v5221: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 98 KiB/s wr, 11 op/s 2023-05-08T06:25:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9679.618206 secs 2023-05-08T06:25:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:41 smithi096 ceph-mon[124666]: pgmap v5221: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 98 KiB/s wr, 11 op/s 2023-05-08T06:25:41.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9679.618206 secs 2023-05-08T06:25:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:41 smithi186 ceph-mon[126480]: pgmap v5221: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 98 KiB/s wr, 11 op/s 2023-05-08T06:25:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:25:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:25:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:25:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:43 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:25:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:25:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:25:43.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:43 smithi133 ceph-mon[125939]: pgmap v5222: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 94 KiB/s wr, 7 op/s 2023-05-08T06:25:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:43 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:25:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:25:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:25:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:43 smithi096 ceph-mon[124666]: pgmap v5222: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 94 KiB/s wr, 7 op/s 2023-05-08T06:25:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:43 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:25:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:25:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:25:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:43 smithi186 ceph-mon[126480]: pgmap v5222: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 94 KiB/s wr, 7 op/s 2023-05-08T06:25:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9682.780530 secs 2023-05-08T06:25:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9682.780530 secs 2023-05-08T06:25:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9682.780530 secs 2023-05-08T06:25:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:45 smithi133 ceph-mon[125939]: pgmap v5223: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 164 KiB/s wr, 12 op/s 2023-05-08T06:25:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:45 smithi096 ceph-mon[124666]: pgmap v5223: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 164 KiB/s wr, 12 op/s 2023-05-08T06:25:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:45 smithi186 ceph-mon[126480]: pgmap v5223: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 164 KiB/s wr, 12 op/s 2023-05-08T06:25:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:46 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:25:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:46 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:25:46.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:46 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:25:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:47 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:25:47.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:47 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:25:47.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:47 smithi133 ceph-mon[125939]: pgmap v5224: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 106 KiB/s wr, 9 op/s 2023-05-08T06:25:47.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:47 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:25:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:47 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:25:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:47 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:25:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:47 smithi096 ceph-mon[124666]: pgmap v5224: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 106 KiB/s wr, 9 op/s 2023-05-08T06:25:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:47 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:25:47.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:47 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:25:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:47 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:25:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:47 smithi186 ceph-mon[126480]: pgmap v5224: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 106 KiB/s wr, 9 op/s 2023-05-08T06:25:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:47 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:25:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9687.780623 secs 2023-05-08T06:25:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9687.780623 secs 2023-05-08T06:25:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9687.780623 secs 2023-05-08T06:25:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9688.337408 secs 2023-05-08T06:25:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:49 smithi133 ceph-mon[125939]: pgmap v5225: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 106 KiB/s wr, 9 op/s 2023-05-08T06:25:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9688.337408 secs 2023-05-08T06:25:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:49 smithi096 ceph-mon[124666]: pgmap v5225: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 106 KiB/s wr, 9 op/s 2023-05-08T06:25:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9688.337408 secs 2023-05-08T06:25:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:49 smithi186 ceph-mon[126480]: pgmap v5225: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 106 KiB/s wr, 9 op/s 2023-05-08T06:25:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:25:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:25:51.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:25:51.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:25:51.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:25:51.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:25:51.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:50 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:25:51.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:25:51.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:25:51.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:25:51.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:25:51.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:25:51.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:25:51.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:25:51.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:25:51.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:25:51.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:25:51.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:25:51.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:25:51.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:25:51.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:25:51.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:25:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:25:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:25:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:25:51.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:25:51.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:25:51.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:25:51.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:50 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:25:51.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:25:51.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:25:51.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:25:51.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:25:51.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:25:51.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:25:51.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:25:51.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:25:51.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:25:51.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:25:51.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:25:51.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:25:51.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:25:51.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:25:51.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:25:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:25:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:25:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:25:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:25:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:25:51.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:25:51.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:50 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:25:51.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:25:51.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:25:51.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:25:51.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:25:51.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:25:51.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:25:51.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:25:51.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:25:51.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:25:51.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:25:51.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:25:51.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:25:51.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:25:51.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:25:51.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:25:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:51 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T06:25:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:51 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T06:25:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:51 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi096 to 196.2M 2023-05-08T06:25:52.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:51 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi096 to 205766758: error parsing value: Value '205766758' is below minimum 939524096 2023-05-08T06:25:52.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:51 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T06:25:52.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:51 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T06:25:52.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:51 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:25:52.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:51 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T06:25:52.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:51 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T06:25:52.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:51 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:25:52.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:51 smithi133 ceph-mon[125939]: pgmap v5226: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 114 KiB/s wr, 13 op/s 2023-05-08T06:25:52.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:25:52.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:25:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:51 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T06:25:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:51 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T06:25:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:51 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi096 to 196.2M 2023-05-08T06:25:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:51 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi096 to 205766758: error parsing value: Value '205766758' is below minimum 939524096 2023-05-08T06:25:52.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:51 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T06:25:52.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:51 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T06:25:52.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:51 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:25:52.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:51 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T06:25:52.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:51 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T06:25:52.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:51 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:25:52.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:51 smithi096 ceph-mon[124666]: pgmap v5226: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 114 KiB/s wr, 13 op/s 2023-05-08T06:25:52.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:25:52.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:25:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:51 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T06:25:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:51 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T06:25:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:51 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi096 to 196.2M 2023-05-08T06:25:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:51 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi096 to 205766758: error parsing value: Value '205766758' is below minimum 939524096 2023-05-08T06:25:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:51 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T06:25:52.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:51 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T06:25:52.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:51 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:25:52.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:51 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T06:25:52.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:51 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T06:25:52.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:51 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:25:52.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:51 smithi186 ceph-mon[126480]: pgmap v5226: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 114 KiB/s wr, 13 op/s 2023-05-08T06:25:52.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:25:52.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:25:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:53 smithi133 ceph-mon[125939]: pgmap v5227: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 77 KiB/s wr, 9 op/s 2023-05-08T06:25:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9692.780743 secs 2023-05-08T06:25:54.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9693.337548 secs 2023-05-08T06:25:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:53 smithi096 ceph-mon[124666]: pgmap v5227: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 77 KiB/s wr, 9 op/s 2023-05-08T06:25:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9692.780743 secs 2023-05-08T06:25:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9693.337548 secs 2023-05-08T06:25:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:53 smithi186 ceph-mon[126480]: pgmap v5227: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 77 KiB/s wr, 9 op/s 2023-05-08T06:25:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9692.780743 secs 2023-05-08T06:25:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9693.337548 secs 2023-05-08T06:25:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:55 smithi133 ceph-mon[125939]: pgmap v5228: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 144 KiB/s wr, 13 op/s 2023-05-08T06:25:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:55 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:25:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:55 smithi096 ceph-mon[124666]: pgmap v5228: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 144 KiB/s wr, 13 op/s 2023-05-08T06:25:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:55 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:25:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:55 smithi186 ceph-mon[126480]: pgmap v5228: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 144 KiB/s wr, 13 op/s 2023-05-08T06:25:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:55 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:25:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:57 smithi133 ceph-mon[125939]: pgmap v5229: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 75 KiB/s wr, 7 op/s 2023-05-08T06:25:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:57 smithi096 ceph-mon[124666]: pgmap v5229: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 75 KiB/s wr, 7 op/s 2023-05-08T06:25:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:57 smithi186 ceph-mon[126480]: pgmap v5229: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 75 KiB/s wr, 7 op/s 2023-05-08T06:25:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9697.780893 secs 2023-05-08T06:25:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9698.337651 secs 2023-05-08T06:25:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9697.780893 secs 2023-05-08T06:25:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9698.337651 secs 2023-05-08T06:25:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9697.780893 secs 2023-05-08T06:25:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9698.337651 secs 2023-05-08T06:26:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:25:59 smithi133 ceph-mon[125939]: pgmap v5230: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 75 KiB/s wr, 7 op/s 2023-05-08T06:26:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:25:59 smithi096 ceph-mon[124666]: pgmap v5230: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 75 KiB/s wr, 7 op/s 2023-05-08T06:26:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:25:59 smithi186 ceph-mon[126480]: pgmap v5230: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 75 KiB/s wr, 7 op/s 2023-05-08T06:26:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9699.618723 secs 2023-05-08T06:26:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:01 smithi133 ceph-mon[125939]: pgmap v5231: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 83 KiB/s wr, 11 op/s 2023-05-08T06:26:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9699.618723 secs 2023-05-08T06:26:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:01 smithi096 ceph-mon[124666]: pgmap v5231: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 83 KiB/s wr, 11 op/s 2023-05-08T06:26:01.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9699.618723 secs 2023-05-08T06:26:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:01 smithi186 ceph-mon[126480]: pgmap v5231: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 83 KiB/s wr, 11 op/s 2023-05-08T06:26:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:02 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:26:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:26:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:26:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:02 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:26:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:26:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:26:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:02 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:26:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:26:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:26:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:03 smithi186 ceph-mon[126480]: pgmap v5232: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 75 KiB/s wr, 7 op/s 2023-05-08T06:26:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:03 smithi133 ceph-mon[125939]: pgmap v5232: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 75 KiB/s wr, 7 op/s 2023-05-08T06:26:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:03 smithi096 ceph-mon[124666]: pgmap v5232: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 75 KiB/s wr, 7 op/s 2023-05-08T06:26:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9702.781012 secs 2023-05-08T06:26:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9703.337742 secs 2023-05-08T06:26:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9702.781012 secs 2023-05-08T06:26:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9703.337742 secs 2023-05-08T06:26:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9702.781012 secs 2023-05-08T06:26:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9703.337742 secs 2023-05-08T06:26:05.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9704.618853 secs 2023-05-08T06:26:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:05 smithi186 ceph-mon[126480]: pgmap v5233: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 163 KiB/s wr, 25 op/s 2023-05-08T06:26:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9704.618853 secs 2023-05-08T06:26:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:05 smithi133 ceph-mon[125939]: pgmap v5233: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 163 KiB/s wr, 25 op/s 2023-05-08T06:26:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9704.618853 secs 2023-05-08T06:26:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:05 smithi096 ceph-mon[124666]: pgmap v5233: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 163 KiB/s wr, 25 op/s 2023-05-08T06:26:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:06 smithi186 ceph-mon[126480]: osdmap e404: 12 total, 12 up, 12 in 2023-05-08T06:26:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:06 smithi133 ceph-mon[125939]: osdmap e404: 12 total, 12 up, 12 in 2023-05-08T06:26:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:06 smithi096 ceph-mon[124666]: osdmap e404: 12 total, 12 up, 12 in 2023-05-08T06:26:07.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:07 smithi186 ceph-mon[126480]: pgmap v5235: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 114 KiB/s wr, 26 op/s 2023-05-08T06:26:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:07 smithi133 ceph-mon[125939]: pgmap v5235: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 114 KiB/s wr, 26 op/s 2023-05-08T06:26:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:07 smithi096 ceph-mon[124666]: pgmap v5235: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 114 KiB/s wr, 26 op/s 2023-05-08T06:26:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9707.781136 secs 2023-05-08T06:26:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9707.781136 secs 2023-05-08T06:26:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9707.781136 secs 2023-05-08T06:26:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9708.337873 secs 2023-05-08T06:26:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:09 smithi133 ceph-mon[125939]: pgmap v5236: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 114 KiB/s wr, 26 op/s 2023-05-08T06:26:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9708.337873 secs 2023-05-08T06:26:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:09 smithi096 ceph-mon[124666]: pgmap v5236: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 114 KiB/s wr, 26 op/s 2023-05-08T06:26:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9708.337873 secs 2023-05-08T06:26:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:09 smithi186 ceph-mon[126480]: pgmap v5236: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 114 KiB/s wr, 26 op/s 2023-05-08T06:26:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9709.618981 secs 2023-05-08T06:26:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:11 smithi133 ceph-mon[125939]: pgmap v5237: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 109 KiB/s wr, 25 op/s 2023-05-08T06:26:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9709.618981 secs 2023-05-08T06:26:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:11 smithi096 ceph-mon[124666]: pgmap v5237: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 109 KiB/s wr, 25 op/s 2023-05-08T06:26:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9709.618981 secs 2023-05-08T06:26:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:11 smithi186 ceph-mon[126480]: pgmap v5237: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 109 KiB/s wr, 25 op/s 2023-05-08T06:26:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:13 smithi133 ceph-mon[125939]: pgmap v5238: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 109 KiB/s wr, 25 op/s 2023-05-08T06:26:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9712.781235 secs 2023-05-08T06:26:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9713.337985 secs 2023-05-08T06:26:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:13 smithi096 ceph-mon[124666]: pgmap v5238: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 109 KiB/s wr, 25 op/s 2023-05-08T06:26:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9712.781235 secs 2023-05-08T06:26:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9713.337985 secs 2023-05-08T06:26:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:13 smithi186 ceph-mon[126480]: pgmap v5238: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 109 KiB/s wr, 25 op/s 2023-05-08T06:26:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9712.781235 secs 2023-05-08T06:26:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9713.337985 secs 2023-05-08T06:26:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9714.619109 secs 2023-05-08T06:26:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:15 smithi096 ceph-mon[124666]: pgmap v5239: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 25 KiB/s wr, 8 op/s 2023-05-08T06:26:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:15 smithi096 ceph-mon[124666]: osdmap e405: 12 total, 12 up, 12 in 2023-05-08T06:26:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9714.619109 secs 2023-05-08T06:26:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:15 smithi186 ceph-mon[126480]: pgmap v5239: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 25 KiB/s wr, 8 op/s 2023-05-08T06:26:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:15 smithi186 ceph-mon[126480]: osdmap e405: 12 total, 12 up, 12 in 2023-05-08T06:26:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9714.619109 secs 2023-05-08T06:26:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:15 smithi133 ceph-mon[125939]: pgmap v5239: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 25 KiB/s wr, 8 op/s 2023-05-08T06:26:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:15 smithi133 ceph-mon[125939]: osdmap e405: 12 total, 12 up, 12 in 2023-05-08T06:26:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:17 smithi096 ceph-mon[124666]: pgmap v5241: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 25 KiB/s wr, 8 op/s 2023-05-08T06:26:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:17 smithi186 ceph-mon[126480]: pgmap v5241: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 25 KiB/s wr, 8 op/s 2023-05-08T06:26:18.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:17 smithi133 ceph-mon[125939]: pgmap v5241: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 25 KiB/s wr, 8 op/s 2023-05-08T06:26:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9717.781393 secs 2023-05-08T06:26:19.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9718.338104 secs 2023-05-08T06:26:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9717.781393 secs 2023-05-08T06:26:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9718.338104 secs 2023-05-08T06:26:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9717.781393 secs 2023-05-08T06:26:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9718.338104 secs 2023-05-08T06:26:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:20 smithi096 ceph-mon[124666]: pgmap v5242: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 25 KiB/s wr, 8 op/s 2023-05-08T06:26:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:20 smithi186 ceph-mon[126480]: pgmap v5242: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 25 KiB/s wr, 8 op/s 2023-05-08T06:26:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:20 smithi133 ceph-mon[125939]: pgmap v5242: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 25 KiB/s wr, 8 op/s 2023-05-08T06:26:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9719.619235 secs 2023-05-08T06:26:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:21 smithi133 ceph-mon[125939]: pgmap v5243: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 8 op/s 2023-05-08T06:26:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9719.619235 secs 2023-05-08T06:26:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:21 smithi096 ceph-mon[124666]: pgmap v5243: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 8 op/s 2023-05-08T06:26:21.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9719.619235 secs 2023-05-08T06:26:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:21 smithi186 ceph-mon[126480]: pgmap v5243: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 8 op/s 2023-05-08T06:26:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:23 smithi096 ceph-mon[124666]: pgmap v5244: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 8 op/s 2023-05-08T06:26:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9722.781463 secs 2023-05-08T06:26:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9723.338227 secs 2023-05-08T06:26:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:23 smithi186 ceph-mon[126480]: pgmap v5244: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 8 op/s 2023-05-08T06:26:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9722.781463 secs 2023-05-08T06:26:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9723.338227 secs 2023-05-08T06:26:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:23 smithi133 ceph-mon[125939]: pgmap v5244: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 8 op/s 2023-05-08T06:26:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9722.781463 secs 2023-05-08T06:26:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9723.338227 secs 2023-05-08T06:26:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9724.619358 secs 2023-05-08T06:26:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:25 smithi096 ceph-mon[124666]: pgmap v5245: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 39 KiB/s wr, 8 op/s 2023-05-08T06:26:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9724.619358 secs 2023-05-08T06:26:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:25 smithi186 ceph-mon[126480]: pgmap v5245: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 39 KiB/s wr, 8 op/s 2023-05-08T06:26:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9724.619358 secs 2023-05-08T06:26:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:25 smithi133 ceph-mon[125939]: pgmap v5245: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 39 KiB/s wr, 8 op/s 2023-05-08T06:26:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:27 smithi096 ceph-mon[124666]: pgmap v5246: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 33 KiB/s wr, 7 op/s 2023-05-08T06:26:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:27 smithi186 ceph-mon[126480]: pgmap v5246: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 33 KiB/s wr, 7 op/s 2023-05-08T06:26:28.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:27 smithi133 ceph-mon[125939]: pgmap v5246: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 33 KiB/s wr, 7 op/s 2023-05-08T06:26:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9727.781574 secs 2023-05-08T06:26:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9728.338291 secs 2023-05-08T06:26:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9727.781574 secs 2023-05-08T06:26:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9728.338291 secs 2023-05-08T06:26:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9727.781574 secs 2023-05-08T06:26:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9728.338291 secs 2023-05-08T06:26:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:30 smithi096 ceph-mon[124666]: pgmap v5247: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T06:26:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:30 smithi186 ceph-mon[126480]: pgmap v5247: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T06:26:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:30 smithi133 ceph-mon[125939]: pgmap v5247: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T06:26:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9729.619483 secs 2023-05-08T06:26:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:31 smithi133 ceph-mon[125939]: pgmap v5248: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 51 KiB/s wr, 10 op/s 2023-05-08T06:26:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9729.619483 secs 2023-05-08T06:26:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:31 smithi096 ceph-mon[124666]: pgmap v5248: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 51 KiB/s wr, 10 op/s 2023-05-08T06:26:31.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9729.619483 secs 2023-05-08T06:26:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:31 smithi186 ceph-mon[126480]: pgmap v5248: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 51 KiB/s wr, 10 op/s 2023-05-08T06:26:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:33 smithi096 ceph-mon[124666]: pgmap v5249: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 50 KiB/s wr, 7 op/s 2023-05-08T06:26:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9732.781699 secs 2023-05-08T06:26:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9733.338428 secs 2023-05-08T06:26:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:33 smithi186 ceph-mon[126480]: pgmap v5249: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 50 KiB/s wr, 7 op/s 2023-05-08T06:26:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9732.781699 secs 2023-05-08T06:26:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9733.338428 secs 2023-05-08T06:26:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:33 smithi133 ceph-mon[125939]: pgmap v5249: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 50 KiB/s wr, 7 op/s 2023-05-08T06:26:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9732.781699 secs 2023-05-08T06:26:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9733.338428 secs 2023-05-08T06:26:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9734.619553 secs 2023-05-08T06:26:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:35 smithi096 ceph-mon[124666]: pgmap v5250: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 108 KiB/s wr, 10 op/s 2023-05-08T06:26:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9734.619553 secs 2023-05-08T06:26:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:35 smithi186 ceph-mon[126480]: pgmap v5250: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 108 KiB/s wr, 10 op/s 2023-05-08T06:26:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9734.619553 secs 2023-05-08T06:26:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:35 smithi133 ceph-mon[125939]: pgmap v5250: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 108 KiB/s wr, 10 op/s 2023-05-08T06:26:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:37 smithi096 ceph-mon[124666]: pgmap v5251: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 76 KiB/s wr, 6 op/s 2023-05-08T06:26:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:37 smithi186 ceph-mon[126480]: pgmap v5251: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 76 KiB/s wr, 6 op/s 2023-05-08T06:26:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:37 smithi133 ceph-mon[125939]: pgmap v5251: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 76 KiB/s wr, 6 op/s 2023-05-08T06:26:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9737.781818 secs 2023-05-08T06:26:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9737.781818 secs 2023-05-08T06:26:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9737.781818 secs 2023-05-08T06:26:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:40 smithi186 ceph-mon[126480]: pgmap v5252: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 76 KiB/s wr, 6 op/s 2023-05-08T06:26:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:40 smithi133 ceph-mon[125939]: pgmap v5252: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 76 KiB/s wr, 6 op/s 2023-05-08T06:26:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:40 smithi096 ceph-mon[124666]: pgmap v5252: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 76 KiB/s wr, 6 op/s 2023-05-08T06:26:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9739.619674 secs 2023-05-08T06:26:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:41 smithi133 ceph-mon[125939]: pgmap v5253: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 115 KiB/s wr, 11 op/s 2023-05-08T06:26:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9739.619674 secs 2023-05-08T06:26:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:41 smithi096 ceph-mon[124666]: pgmap v5253: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 115 KiB/s wr, 11 op/s 2023-05-08T06:26:41.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9739.619674 secs 2023-05-08T06:26:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:41 smithi186 ceph-mon[126480]: pgmap v5253: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 115 KiB/s wr, 11 op/s 2023-05-08T06:26:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:26:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:26:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:26:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:43 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:26:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:26:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:26:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:43 smithi133 ceph-mon[125939]: pgmap v5254: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 96 KiB/s wr, 7 op/s 2023-05-08T06:26:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:43 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:26:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:26:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:26:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:43 smithi096 ceph-mon[124666]: pgmap v5254: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 96 KiB/s wr, 7 op/s 2023-05-08T06:26:43.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:43 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:26:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:26:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:26:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:43 smithi186 ceph-mon[126480]: pgmap v5254: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 96 KiB/s wr, 7 op/s 2023-05-08T06:26:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9742.781932 secs 2023-05-08T06:26:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9742.781932 secs 2023-05-08T06:26:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9742.781932 secs 2023-05-08T06:26:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:45 smithi133 ceph-mon[125939]: pgmap v5255: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 166 KiB/s wr, 13 op/s 2023-05-08T06:26:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:45 smithi096 ceph-mon[124666]: pgmap v5255: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 166 KiB/s wr, 13 op/s 2023-05-08T06:26:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:45 smithi186 ceph-mon[126480]: pgmap v5255: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 166 KiB/s wr, 13 op/s 2023-05-08T06:26:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:46 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:26:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:46 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:26:46.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:46 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:26:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:47 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:26:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:47 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:26:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:47 smithi133 ceph-mon[125939]: pgmap v5256: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 108 KiB/s wr, 9 op/s 2023-05-08T06:26:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:47 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:26:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:47 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:26:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:47 smithi096 ceph-mon[124666]: pgmap v5256: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 108 KiB/s wr, 9 op/s 2023-05-08T06:26:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:47 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:26:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:47 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:26:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:47 smithi186 ceph-mon[126480]: pgmap v5256: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 108 KiB/s wr, 9 op/s 2023-05-08T06:26:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9747.782048 secs 2023-05-08T06:26:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9747.782048 secs 2023-05-08T06:26:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9747.782048 secs 2023-05-08T06:26:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9748.338783 secs 2023-05-08T06:26:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:49 smithi133 ceph-mon[125939]: pgmap v5257: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 108 KiB/s wr, 9 op/s 2023-05-08T06:26:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9748.338783 secs 2023-05-08T06:26:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:49 smithi096 ceph-mon[124666]: pgmap v5257: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 108 KiB/s wr, 9 op/s 2023-05-08T06:26:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9748.338783 secs 2023-05-08T06:26:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:49 smithi186 ceph-mon[126480]: pgmap v5257: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 108 KiB/s wr, 9 op/s 2023-05-08T06:26:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:50 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:26:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:50 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:26:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:50 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:26:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:51 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:26:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:51 smithi133 ceph-mon[125939]: pgmap v5258: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 115 KiB/s wr, 13 op/s 2023-05-08T06:26:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:26:51.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:26:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:51 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:26:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:51 smithi096 ceph-mon[124666]: pgmap v5258: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 115 KiB/s wr, 13 op/s 2023-05-08T06:26:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:26:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:26:51.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:51 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:26:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:51 smithi186 ceph-mon[126480]: pgmap v5258: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 115 KiB/s wr, 13 op/s 2023-05-08T06:26:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:26:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:26:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:26:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:26:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:52 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:26:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:26:52.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:52 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T06:26:52.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:52 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T06:26:52.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:52 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:26:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:26:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:26:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:52 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:26:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:26:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:52 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T06:26:52.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:52 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T06:26:52.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:52 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:26:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:26:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:26:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:52 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:26:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:26:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:52 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T06:26:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:52 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T06:26:52.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:52 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:26:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:53 smithi133 ceph-mon[125939]: pgmap v5259: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 77 KiB/s wr, 9 op/s 2023-05-08T06:26:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9752.782162 secs 2023-05-08T06:26:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:53 smithi096 ceph-mon[124666]: pgmap v5259: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 77 KiB/s wr, 9 op/s 2023-05-08T06:26:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9752.782162 secs 2023-05-08T06:26:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:53 smithi186 ceph-mon[126480]: pgmap v5259: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 77 KiB/s wr, 9 op/s 2023-05-08T06:26:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9752.782162 secs 2023-05-08T06:26:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9753.338911 secs 2023-05-08T06:26:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9753.338911 secs 2023-05-08T06:26:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9753.338911 secs 2023-05-08T06:26:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:55 smithi133 ceph-mon[125939]: pgmap v5260: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 175 KiB/s wr, 13 op/s 2023-05-08T06:26:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:55 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:26:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:55 smithi096 ceph-mon[124666]: pgmap v5260: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 175 KiB/s wr, 13 op/s 2023-05-08T06:26:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:55 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:26:55.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:55 smithi186 ceph-mon[126480]: pgmap v5260: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 175 KiB/s wr, 13 op/s 2023-05-08T06:26:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:55 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:26:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:57 smithi096 ceph-mon[124666]: pgmap v5261: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 105 KiB/s wr, 7 op/s 2023-05-08T06:26:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:57 smithi186 ceph-mon[126480]: pgmap v5261: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 105 KiB/s wr, 7 op/s 2023-05-08T06:26:58.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:57 smithi133 ceph-mon[125939]: pgmap v5261: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 105 KiB/s wr, 7 op/s 2023-05-08T06:26:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9757.782278 secs 2023-05-08T06:26:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:26:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9758.339027 secs 2023-05-08T06:26:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9757.782278 secs 2023-05-08T06:26:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:26:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9758.339027 secs 2023-05-08T06:26:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9757.782278 secs 2023-05-08T06:26:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:26:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9758.339027 secs 2023-05-08T06:27:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:00 smithi186 ceph-mon[126480]: pgmap v5262: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 105 KiB/s wr, 7 op/s 2023-05-08T06:27:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:00 smithi133 ceph-mon[125939]: pgmap v5262: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 105 KiB/s wr, 7 op/s 2023-05-08T06:27:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:00 smithi096 ceph-mon[124666]: pgmap v5262: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 105 KiB/s wr, 7 op/s 2023-05-08T06:27:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9759.620146 secs 2023-05-08T06:27:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:01 smithi133 ceph-mon[125939]: pgmap v5263: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 113 KiB/s wr, 12 op/s 2023-05-08T06:27:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9759.620146 secs 2023-05-08T06:27:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:01 smithi096 ceph-mon[124666]: pgmap v5263: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 113 KiB/s wr, 12 op/s 2023-05-08T06:27:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9759.620146 secs 2023-05-08T06:27:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:01 smithi186 ceph-mon[126480]: pgmap v5263: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 113 KiB/s wr, 12 op/s 2023-05-08T06:27:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:02 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:27:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:27:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:27:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:02 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:27:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:27:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:27:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:02 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:27:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:27:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:27:03.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:03 smithi186 ceph-mon[126480]: pgmap v5264: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 105 KiB/s wr, 8 op/s 2023-05-08T06:27:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:03 smithi133 ceph-mon[125939]: pgmap v5264: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 105 KiB/s wr, 8 op/s 2023-05-08T06:27:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:03 smithi096 ceph-mon[124666]: pgmap v5264: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 105 KiB/s wr, 8 op/s 2023-05-08T06:27:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9762.782391 secs 2023-05-08T06:27:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9763.339148 secs 2023-05-08T06:27:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9762.782391 secs 2023-05-08T06:27:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9763.339148 secs 2023-05-08T06:27:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9762.782391 secs 2023-05-08T06:27:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9763.339148 secs 2023-05-08T06:27:05.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9764.620250 secs 2023-05-08T06:27:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:05 smithi186 ceph-mon[126480]: pgmap v5265: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 192 KiB/s wr, 26 op/s 2023-05-08T06:27:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9764.620250 secs 2023-05-08T06:27:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:05 smithi133 ceph-mon[125939]: pgmap v5265: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 192 KiB/s wr, 26 op/s 2023-05-08T06:27:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9764.620250 secs 2023-05-08T06:27:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:05 smithi096 ceph-mon[124666]: pgmap v5265: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 192 KiB/s wr, 26 op/s 2023-05-08T06:27:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:06 smithi186 ceph-mon[126480]: osdmap e406: 12 total, 12 up, 12 in 2023-05-08T06:27:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:06 smithi133 ceph-mon[125939]: osdmap e406: 12 total, 12 up, 12 in 2023-05-08T06:27:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:06 smithi096 ceph-mon[124666]: osdmap e406: 12 total, 12 up, 12 in 2023-05-08T06:27:07.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:07 smithi186 ceph-mon[126480]: pgmap v5267: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 113 KiB/s wr, 27 op/s 2023-05-08T06:27:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:07 smithi133 ceph-mon[125939]: pgmap v5267: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 113 KiB/s wr, 27 op/s 2023-05-08T06:27:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:07 smithi096 ceph-mon[124666]: pgmap v5267: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 113 KiB/s wr, 27 op/s 2023-05-08T06:27:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9767.782508 secs 2023-05-08T06:27:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9767.782508 secs 2023-05-08T06:27:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9767.782508 secs 2023-05-08T06:27:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9768.339262 secs 2023-05-08T06:27:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:09 smithi133 ceph-mon[125939]: pgmap v5268: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 113 KiB/s wr, 27 op/s 2023-05-08T06:27:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9768.339262 secs 2023-05-08T06:27:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:09 smithi096 ceph-mon[124666]: pgmap v5268: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 113 KiB/s wr, 27 op/s 2023-05-08T06:27:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9768.339262 secs 2023-05-08T06:27:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:09 smithi186 ceph-mon[126480]: pgmap v5268: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 113 KiB/s wr, 27 op/s 2023-05-08T06:27:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9769.620351 secs 2023-05-08T06:27:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:11 smithi133 ceph-mon[125939]: pgmap v5269: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 109 KiB/s wr, 26 op/s 2023-05-08T06:27:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9769.620351 secs 2023-05-08T06:27:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:11 smithi096 ceph-mon[124666]: pgmap v5269: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 109 KiB/s wr, 26 op/s 2023-05-08T06:27:11.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9769.620351 secs 2023-05-08T06:27:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:11 smithi186 ceph-mon[126480]: pgmap v5269: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 109 KiB/s wr, 26 op/s 2023-05-08T06:27:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:14 smithi096 ceph-mon[124666]: pgmap v5270: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 109 KiB/s wr, 26 op/s 2023-05-08T06:27:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9772.782579 secs 2023-05-08T06:27:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9773.339381 secs 2023-05-08T06:27:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:14 smithi186 ceph-mon[126480]: pgmap v5270: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 109 KiB/s wr, 26 op/s 2023-05-08T06:27:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9772.782579 secs 2023-05-08T06:27:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9773.339381 secs 2023-05-08T06:27:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:14 smithi133 ceph-mon[125939]: pgmap v5270: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 109 KiB/s wr, 26 op/s 2023-05-08T06:27:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9772.782579 secs 2023-05-08T06:27:14.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9773.339381 secs 2023-05-08T06:27:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9774.620475 secs 2023-05-08T06:27:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:16 smithi186 ceph-mon[126480]: pgmap v5271: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 21 KiB/s wr, 8 op/s 2023-05-08T06:27:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:16 smithi186 ceph-mon[126480]: osdmap e407: 12 total, 12 up, 12 in 2023-05-08T06:27:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9774.620475 secs 2023-05-08T06:27:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:16 smithi133 ceph-mon[125939]: pgmap v5271: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 21 KiB/s wr, 8 op/s 2023-05-08T06:27:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:16 smithi133 ceph-mon[125939]: osdmap e407: 12 total, 12 up, 12 in 2023-05-08T06:27:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9774.620475 secs 2023-05-08T06:27:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:16 smithi096 ceph-mon[124666]: pgmap v5271: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 21 KiB/s wr, 8 op/s 2023-05-08T06:27:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:16 smithi096 ceph-mon[124666]: osdmap e407: 12 total, 12 up, 12 in 2023-05-08T06:27:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:18 smithi186 ceph-mon[126480]: pgmap v5273: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 21 KiB/s wr, 8 op/s 2023-05-08T06:27:18.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:18 smithi133 ceph-mon[125939]: pgmap v5273: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 21 KiB/s wr, 8 op/s 2023-05-08T06:27:18.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:18 smithi096 ceph-mon[124666]: pgmap v5273: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 21 KiB/s wr, 8 op/s 2023-05-08T06:27:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9777.782693 secs 2023-05-08T06:27:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9778.339515 secs 2023-05-08T06:27:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9777.782693 secs 2023-05-08T06:27:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9778.339515 secs 2023-05-08T06:27:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9777.782693 secs 2023-05-08T06:27:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9778.339515 secs 2023-05-08T06:27:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:20 smithi186 ceph-mon[126480]: pgmap v5274: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 21 KiB/s wr, 8 op/s 2023-05-08T06:27:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:20 smithi133 ceph-mon[125939]: pgmap v5274: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 21 KiB/s wr, 8 op/s 2023-05-08T06:27:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:20 smithi096 ceph-mon[124666]: pgmap v5274: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 21 KiB/s wr, 8 op/s 2023-05-08T06:27:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9779.620590 secs 2023-05-08T06:27:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:21 smithi133 ceph-mon[125939]: pgmap v5275: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 7 op/s 2023-05-08T06:27:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9779.620590 secs 2023-05-08T06:27:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:21 smithi096 ceph-mon[124666]: pgmap v5275: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 7 op/s 2023-05-08T06:27:21.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9779.620590 secs 2023-05-08T06:27:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:21 smithi186 ceph-mon[126480]: pgmap v5275: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 7 op/s 2023-05-08T06:27:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:24 smithi186 ceph-mon[126480]: pgmap v5276: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 7 op/s 2023-05-08T06:27:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9782.782810 secs 2023-05-08T06:27:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9783.339639 secs 2023-05-08T06:27:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:24 smithi133 ceph-mon[125939]: pgmap v5276: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 7 op/s 2023-05-08T06:27:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9782.782810 secs 2023-05-08T06:27:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9783.339639 secs 2023-05-08T06:27:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:24 smithi096 ceph-mon[124666]: pgmap v5276: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 7 op/s 2023-05-08T06:27:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9782.782810 secs 2023-05-08T06:27:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9783.339639 secs 2023-05-08T06:27:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9784.620687 secs 2023-05-08T06:27:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:26 smithi186 ceph-mon[126480]: pgmap v5277: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 39 KiB/s wr, 7 op/s 2023-05-08T06:27:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9784.620687 secs 2023-05-08T06:27:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:26 smithi133 ceph-mon[125939]: pgmap v5277: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 39 KiB/s wr, 7 op/s 2023-05-08T06:27:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9784.620687 secs 2023-05-08T06:27:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:26 smithi096 ceph-mon[124666]: pgmap v5277: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 39 KiB/s wr, 7 op/s 2023-05-08T06:27:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:28 smithi186 ceph-mon[126480]: pgmap v5278: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T06:27:28.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:28 smithi133 ceph-mon[125939]: pgmap v5278: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T06:27:28.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:28 smithi096 ceph-mon[124666]: pgmap v5278: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T06:27:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9787.782957 secs 2023-05-08T06:27:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9788.339760 secs 2023-05-08T06:27:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9787.782957 secs 2023-05-08T06:27:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9788.339760 secs 2023-05-08T06:27:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9787.782957 secs 2023-05-08T06:27:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9788.339760 secs 2023-05-08T06:27:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:30 smithi186 ceph-mon[126480]: pgmap v5279: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T06:27:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:30 smithi133 ceph-mon[125939]: pgmap v5279: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T06:27:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:30 smithi096 ceph-mon[124666]: pgmap v5279: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T06:27:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9789.620810 secs 2023-05-08T06:27:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:31 smithi133 ceph-mon[125939]: pgmap v5280: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 10 op/s 2023-05-08T06:27:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9789.620810 secs 2023-05-08T06:27:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:31 smithi096 ceph-mon[124666]: pgmap v5280: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 10 op/s 2023-05-08T06:27:31.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9789.620810 secs 2023-05-08T06:27:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:31 smithi186 ceph-mon[126480]: pgmap v5280: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 10 op/s 2023-05-08T06:27:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:34 smithi186 ceph-mon[126480]: pgmap v5281: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 51 KiB/s wr, 6 op/s 2023-05-08T06:27:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9792.783074 secs 2023-05-08T06:27:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9793.339884 secs 2023-05-08T06:27:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:34 smithi133 ceph-mon[125939]: pgmap v5281: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 51 KiB/s wr, 6 op/s 2023-05-08T06:27:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9792.783074 secs 2023-05-08T06:27:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9793.339884 secs 2023-05-08T06:27:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:34 smithi096 ceph-mon[124666]: pgmap v5281: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 51 KiB/s wr, 6 op/s 2023-05-08T06:27:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9792.783074 secs 2023-05-08T06:27:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9793.339884 secs 2023-05-08T06:27:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9794.620934 secs 2023-05-08T06:27:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:36 smithi186 ceph-mon[126480]: pgmap v5282: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 110 KiB/s wr, 10 op/s 2023-05-08T06:27:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9794.620934 secs 2023-05-08T06:27:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:36 smithi133 ceph-mon[125939]: pgmap v5282: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 110 KiB/s wr, 10 op/s 2023-05-08T06:27:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9794.620934 secs 2023-05-08T06:27:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:36 smithi096 ceph-mon[124666]: pgmap v5282: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 110 KiB/s wr, 10 op/s 2023-05-08T06:27:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:38 smithi186 ceph-mon[126480]: pgmap v5283: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 78 KiB/s wr, 7 op/s 2023-05-08T06:27:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:38 smithi133 ceph-mon[125939]: pgmap v5283: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 78 KiB/s wr, 7 op/s 2023-05-08T06:27:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:38 smithi096 ceph-mon[124666]: pgmap v5283: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 78 KiB/s wr, 7 op/s 2023-05-08T06:27:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9797.783212 secs 2023-05-08T06:27:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9797.783212 secs 2023-05-08T06:27:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9797.783212 secs 2023-05-08T06:27:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:40 smithi186 ceph-mon[126480]: pgmap v5284: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 78 KiB/s wr, 7 op/s 2023-05-08T06:27:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:40 smithi133 ceph-mon[125939]: pgmap v5284: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 78 KiB/s wr, 7 op/s 2023-05-08T06:27:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:40 smithi096 ceph-mon[124666]: pgmap v5284: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 78 KiB/s wr, 7 op/s 2023-05-08T06:27:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9799.621013 secs 2023-05-08T06:27:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:41 smithi133 ceph-mon[125939]: pgmap v5285: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 116 KiB/s wr, 11 op/s 2023-05-08T06:27:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9799.621013 secs 2023-05-08T06:27:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:41 smithi096 ceph-mon[124666]: pgmap v5285: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 116 KiB/s wr, 11 op/s 2023-05-08T06:27:41.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9799.621013 secs 2023-05-08T06:27:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:41 smithi186 ceph-mon[126480]: pgmap v5285: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 116 KiB/s wr, 11 op/s 2023-05-08T06:27:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:27:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:27:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:27:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:43 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:27:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:27:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:27:43.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:43 smithi133 ceph-mon[125939]: pgmap v5286: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 98 KiB/s wr, 8 op/s 2023-05-08T06:27:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:43 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:27:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:27:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:27:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:43 smithi096 ceph-mon[124666]: pgmap v5286: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 98 KiB/s wr, 8 op/s 2023-05-08T06:27:43.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:43 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:27:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:27:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:27:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:43 smithi186 ceph-mon[126480]: pgmap v5286: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 98 KiB/s wr, 8 op/s 2023-05-08T06:27:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9802.783276 secs 2023-05-08T06:27:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9802.783276 secs 2023-05-08T06:27:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9802.783276 secs 2023-05-08T06:27:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:45 smithi133 ceph-mon[125939]: pgmap v5287: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 169 KiB/s wr, 13 op/s 2023-05-08T06:27:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:45 smithi096 ceph-mon[124666]: pgmap v5287: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 169 KiB/s wr, 13 op/s 2023-05-08T06:27:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:45 smithi186 ceph-mon[126480]: pgmap v5287: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 169 KiB/s wr, 13 op/s 2023-05-08T06:27:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:46 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:27:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:46 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:27:46.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:46 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:27:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:47 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:27:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:47 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:27:47.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:47 smithi133 ceph-mon[125939]: pgmap v5288: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 110 KiB/s wr, 9 op/s 2023-05-08T06:27:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:47 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:27:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:47 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:27:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:47 smithi096 ceph-mon[124666]: pgmap v5288: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 110 KiB/s wr, 9 op/s 2023-05-08T06:27:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:47 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:27:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:47 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:27:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:47 smithi186 ceph-mon[126480]: pgmap v5288: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 110 KiB/s wr, 9 op/s 2023-05-08T06:27:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9807.783415 secs 2023-05-08T06:27:48.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9807.783415 secs 2023-05-08T06:27:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9807.783415 secs 2023-05-08T06:27:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9808.340286 secs 2023-05-08T06:27:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:49 smithi096 ceph-mon[124666]: pgmap v5289: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 110 KiB/s wr, 9 op/s 2023-05-08T06:27:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9808.340286 secs 2023-05-08T06:27:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:49 smithi186 ceph-mon[126480]: pgmap v5289: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 110 KiB/s wr, 9 op/s 2023-05-08T06:27:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9808.340286 secs 2023-05-08T06:27:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:49 smithi133 ceph-mon[125939]: pgmap v5289: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 110 KiB/s wr, 9 op/s 2023-05-08T06:27:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:50 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:27:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:50 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:27:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:50 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:27:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:51 smithi186 ceph-mon[126480]: pgmap v5290: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 118 KiB/s wr, 13 op/s 2023-05-08T06:27:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:27:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:27:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:51 smithi133 ceph-mon[125939]: pgmap v5290: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 118 KiB/s wr, 13 op/s 2023-05-08T06:27:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:27:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:27:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:51 smithi096 ceph-mon[124666]: pgmap v5290: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 118 KiB/s wr, 13 op/s 2023-05-08T06:27:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:27:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:27:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:27:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:27:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:27:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:27:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:27:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:27:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:27:52.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:27:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:27:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:27:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:27:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:27:53.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:53 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:27:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:53 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T06:27:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:53 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T06:27:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:53 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:27:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:53 smithi186 ceph-mon[126480]: pgmap v5291: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 79 KiB/s wr, 9 op/s 2023-05-08T06:27:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9812.783524 secs 2023-05-08T06:27:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:53 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:27:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:53 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T06:27:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:53 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T06:27:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:53 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:27:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:53 smithi133 ceph-mon[125939]: pgmap v5291: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 79 KiB/s wr, 9 op/s 2023-05-08T06:27:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9812.783524 secs 2023-05-08T06:27:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:53 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:27:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:53 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T06:27:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:53 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T06:27:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:53 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:27:54.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:53 smithi096 ceph-mon[124666]: pgmap v5291: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 79 KiB/s wr, 9 op/s 2023-05-08T06:27:54.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9812.783524 secs 2023-05-08T06:27:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9813.340415 secs 2023-05-08T06:27:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9813.340415 secs 2023-05-08T06:27:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9813.340415 secs 2023-05-08T06:27:55.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:55 smithi186 ceph-mon[126480]: pgmap v5292: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 149 KiB/s wr, 13 op/s 2023-05-08T06:27:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:55 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:27:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:55 smithi133 ceph-mon[125939]: pgmap v5292: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 149 KiB/s wr, 13 op/s 2023-05-08T06:27:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:55 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:27:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:55 smithi096 ceph-mon[124666]: pgmap v5292: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 149 KiB/s wr, 13 op/s 2023-05-08T06:27:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:55 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:27:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:58 smithi186 ceph-mon[126480]: pgmap v5293: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 78 KiB/s wr, 7 op/s 2023-05-08T06:27:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:58 smithi133 ceph-mon[125939]: pgmap v5293: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 78 KiB/s wr, 7 op/s 2023-05-08T06:27:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:58 smithi096 ceph-mon[124666]: pgmap v5293: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 78 KiB/s wr, 7 op/s 2023-05-08T06:27:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9817.783640 secs 2023-05-08T06:27:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:27:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9818.340545 secs 2023-05-08T06:27:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9817.783640 secs 2023-05-08T06:27:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:27:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9818.340545 secs 2023-05-08T06:27:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9817.783640 secs 2023-05-08T06:27:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:27:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9818.340545 secs 2023-05-08T06:28:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:00 smithi186 ceph-mon[126480]: pgmap v5294: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 78 KiB/s wr, 7 op/s 2023-05-08T06:28:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:00 smithi133 ceph-mon[125939]: pgmap v5294: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 78 KiB/s wr, 7 op/s 2023-05-08T06:28:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:00 smithi096 ceph-mon[124666]: pgmap v5294: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 78 KiB/s wr, 7 op/s 2023-05-08T06:28:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9819.621500 secs 2023-05-08T06:28:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:01 smithi133 ceph-mon[125939]: pgmap v5295: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 86 KiB/s wr, 11 op/s 2023-05-08T06:28:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9819.621500 secs 2023-05-08T06:28:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:01 smithi096 ceph-mon[124666]: pgmap v5295: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 86 KiB/s wr, 11 op/s 2023-05-08T06:28:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9819.621500 secs 2023-05-08T06:28:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:01 smithi186 ceph-mon[126480]: pgmap v5295: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 86 KiB/s wr, 11 op/s 2023-05-08T06:28:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:02 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:28:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:28:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:28:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:02 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:28:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:28:02.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:28:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:02 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:28:02.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:28:02.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:28:03.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:03 smithi186 ceph-mon[126480]: pgmap v5296: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 78 KiB/s wr, 7 op/s 2023-05-08T06:28:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:03 smithi133 ceph-mon[125939]: pgmap v5296: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 78 KiB/s wr, 7 op/s 2023-05-08T06:28:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:03 smithi096 ceph-mon[124666]: pgmap v5296: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 78 KiB/s wr, 7 op/s 2023-05-08T06:28:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9822.783755 secs 2023-05-08T06:28:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9823.340663 secs 2023-05-08T06:28:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9822.783755 secs 2023-05-08T06:28:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9823.340663 secs 2023-05-08T06:28:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9822.783755 secs 2023-05-08T06:28:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9823.340663 secs 2023-05-08T06:28:05.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9824.621635 secs 2023-05-08T06:28:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:05 smithi186 ceph-mon[126480]: pgmap v5297: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 167 KiB/s wr, 25 op/s 2023-05-08T06:28:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9824.621635 secs 2023-05-08T06:28:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:05 smithi133 ceph-mon[125939]: pgmap v5297: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 167 KiB/s wr, 25 op/s 2023-05-08T06:28:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9824.621635 secs 2023-05-08T06:28:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:05 smithi096 ceph-mon[124666]: pgmap v5297: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 167 KiB/s wr, 25 op/s 2023-05-08T06:28:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:06 smithi186 ceph-mon[126480]: osdmap e408: 12 total, 12 up, 12 in 2023-05-08T06:28:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:06 smithi133 ceph-mon[125939]: osdmap e408: 12 total, 12 up, 12 in 2023-05-08T06:28:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:06 smithi096 ceph-mon[124666]: osdmap e408: 12 total, 12 up, 12 in 2023-05-08T06:28:07.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:07 smithi186 ceph-mon[126480]: pgmap v5299: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 116 KiB/s wr, 26 op/s 2023-05-08T06:28:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:07 smithi133 ceph-mon[125939]: pgmap v5299: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 116 KiB/s wr, 26 op/s 2023-05-08T06:28:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:07 smithi096 ceph-mon[124666]: pgmap v5299: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 116 KiB/s wr, 26 op/s 2023-05-08T06:28:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9827.783886 secs 2023-05-08T06:28:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9827.783886 secs 2023-05-08T06:28:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9827.783886 secs 2023-05-08T06:28:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9828.340740 secs 2023-05-08T06:28:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:09 smithi096 ceph-mon[124666]: pgmap v5300: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 116 KiB/s wr, 26 op/s 2023-05-08T06:28:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9828.340740 secs 2023-05-08T06:28:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:09 smithi186 ceph-mon[126480]: pgmap v5300: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 116 KiB/s wr, 26 op/s 2023-05-08T06:28:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9828.340740 secs 2023-05-08T06:28:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:09 smithi133 ceph-mon[125939]: pgmap v5300: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 116 KiB/s wr, 26 op/s 2023-05-08T06:28:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9829.621772 secs 2023-05-08T06:28:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:11 smithi133 ceph-mon[125939]: pgmap v5301: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 111 KiB/s wr, 26 op/s 2023-05-08T06:28:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9829.621772 secs 2023-05-08T06:28:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:11 smithi096 ceph-mon[124666]: pgmap v5301: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 111 KiB/s wr, 26 op/s 2023-05-08T06:28:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9829.621772 secs 2023-05-08T06:28:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:11 smithi186 ceph-mon[126480]: pgmap v5301: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 111 KiB/s wr, 26 op/s 2023-05-08T06:28:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:14 smithi186 ceph-mon[126480]: pgmap v5302: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 111 KiB/s wr, 26 op/s 2023-05-08T06:28:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9832.784017 secs 2023-05-08T06:28:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9833.340867 secs 2023-05-08T06:28:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:14 smithi133 ceph-mon[125939]: pgmap v5302: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 111 KiB/s wr, 26 op/s 2023-05-08T06:28:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9832.784017 secs 2023-05-08T06:28:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9833.340867 secs 2023-05-08T06:28:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:14 smithi096 ceph-mon[124666]: pgmap v5302: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 111 KiB/s wr, 26 op/s 2023-05-08T06:28:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9832.784017 secs 2023-05-08T06:28:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9833.340867 secs 2023-05-08T06:28:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9834.621891 secs 2023-05-08T06:28:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:16 smithi186 ceph-mon[126480]: pgmap v5303: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 25 KiB/s wr, 8 op/s 2023-05-08T06:28:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:16 smithi186 ceph-mon[126480]: osdmap e409: 12 total, 12 up, 12 in 2023-05-08T06:28:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9834.621891 secs 2023-05-08T06:28:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:16 smithi133 ceph-mon[125939]: pgmap v5303: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 25 KiB/s wr, 8 op/s 2023-05-08T06:28:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:16 smithi133 ceph-mon[125939]: osdmap e409: 12 total, 12 up, 12 in 2023-05-08T06:28:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9834.621891 secs 2023-05-08T06:28:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:16 smithi096 ceph-mon[124666]: pgmap v5303: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 25 KiB/s wr, 8 op/s 2023-05-08T06:28:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:16 smithi096 ceph-mon[124666]: osdmap e409: 12 total, 12 up, 12 in 2023-05-08T06:28:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:18 smithi186 ceph-mon[126480]: pgmap v5305: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 25 KiB/s wr, 8 op/s 2023-05-08T06:28:18.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:18 smithi133 ceph-mon[125939]: pgmap v5305: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 25 KiB/s wr, 8 op/s 2023-05-08T06:28:18.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:18 smithi096 ceph-mon[124666]: pgmap v5305: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 25 KiB/s wr, 8 op/s 2023-05-08T06:28:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9837.784137 secs 2023-05-08T06:28:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9838.340949 secs 2023-05-08T06:28:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9837.784137 secs 2023-05-08T06:28:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9838.340949 secs 2023-05-08T06:28:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9837.784137 secs 2023-05-08T06:28:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9838.340949 secs 2023-05-08T06:28:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:20 smithi186 ceph-mon[126480]: pgmap v5306: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 25 KiB/s wr, 8 op/s 2023-05-08T06:28:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:20 smithi133 ceph-mon[125939]: pgmap v5306: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 25 KiB/s wr, 8 op/s 2023-05-08T06:28:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:20 smithi096 ceph-mon[124666]: pgmap v5306: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 25 KiB/s wr, 8 op/s 2023-05-08T06:28:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9839.622029 secs 2023-05-08T06:28:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:21 smithi133 ceph-mon[125939]: pgmap v5307: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 8 op/s 2023-05-08T06:28:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9839.622029 secs 2023-05-08T06:28:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:21 smithi096 ceph-mon[124666]: pgmap v5307: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 8 op/s 2023-05-08T06:28:21.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9839.622029 secs 2023-05-08T06:28:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:21 smithi186 ceph-mon[126480]: pgmap v5307: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 8 op/s 2023-05-08T06:28:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:24 smithi186 ceph-mon[126480]: pgmap v5308: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 8 op/s 2023-05-08T06:28:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9842.784253 secs 2023-05-08T06:28:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9843.341072 secs 2023-05-08T06:28:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:24 smithi133 ceph-mon[125939]: pgmap v5308: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 8 op/s 2023-05-08T06:28:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9842.784253 secs 2023-05-08T06:28:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9843.341072 secs 2023-05-08T06:28:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:24 smithi096 ceph-mon[124666]: pgmap v5308: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 8 op/s 2023-05-08T06:28:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9842.784253 secs 2023-05-08T06:28:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9843.341072 secs 2023-05-08T06:28:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9844.622150 secs 2023-05-08T06:28:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:26 smithi186 ceph-mon[126480]: pgmap v5309: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 40 KiB/s wr, 8 op/s 2023-05-08T06:28:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9844.622150 secs 2023-05-08T06:28:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:26 smithi133 ceph-mon[125939]: pgmap v5309: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 40 KiB/s wr, 8 op/s 2023-05-08T06:28:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9844.622150 secs 2023-05-08T06:28:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:26 smithi096 ceph-mon[124666]: pgmap v5309: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 40 KiB/s wr, 8 op/s 2023-05-08T06:28:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:28 smithi186 ceph-mon[126480]: pgmap v5310: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T06:28:28.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:28 smithi133 ceph-mon[125939]: pgmap v5310: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T06:28:28.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:28 smithi096 ceph-mon[124666]: pgmap v5310: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T06:28:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9847.784373 secs 2023-05-08T06:28:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9848.341210 secs 2023-05-08T06:28:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9847.784373 secs 2023-05-08T06:28:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9848.341210 secs 2023-05-08T06:28:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9847.784373 secs 2023-05-08T06:28:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9848.341210 secs 2023-05-08T06:28:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:30 smithi186 ceph-mon[126480]: pgmap v5311: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T06:28:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:30 smithi133 ceph-mon[125939]: pgmap v5311: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T06:28:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:30 smithi096 ceph-mon[124666]: pgmap v5311: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T06:28:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9849.622275 secs 2023-05-08T06:28:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:31 smithi133 ceph-mon[125939]: pgmap v5312: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 52 KiB/s wr, 10 op/s 2023-05-08T06:28:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9849.622275 secs 2023-05-08T06:28:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:31 smithi096 ceph-mon[124666]: pgmap v5312: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 52 KiB/s wr, 10 op/s 2023-05-08T06:28:31.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9849.622275 secs 2023-05-08T06:28:31.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:31 smithi186 ceph-mon[126480]: pgmap v5312: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 52 KiB/s wr, 10 op/s 2023-05-08T06:28:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:34 smithi186 ceph-mon[126480]: pgmap v5313: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 KiB/s wr, 7 op/s 2023-05-08T06:28:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9852.784490 secs 2023-05-08T06:28:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9853.341362 secs 2023-05-08T06:28:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:34 smithi133 ceph-mon[125939]: pgmap v5313: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 KiB/s wr, 7 op/s 2023-05-08T06:28:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9852.784490 secs 2023-05-08T06:28:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9853.341362 secs 2023-05-08T06:28:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:34 smithi096 ceph-mon[124666]: pgmap v5313: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 KiB/s wr, 7 op/s 2023-05-08T06:28:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9852.784490 secs 2023-05-08T06:28:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9853.341362 secs 2023-05-08T06:28:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9854.622416 secs 2023-05-08T06:28:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:36 smithi186 ceph-mon[126480]: pgmap v5314: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 112 KiB/s wr, 10 op/s 2023-05-08T06:28:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9854.622416 secs 2023-05-08T06:28:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:36 smithi133 ceph-mon[125939]: pgmap v5314: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 112 KiB/s wr, 10 op/s 2023-05-08T06:28:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9854.622416 secs 2023-05-08T06:28:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:36 smithi096 ceph-mon[124666]: pgmap v5314: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 112 KiB/s wr, 10 op/s 2023-05-08T06:28:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:38 smithi186 ceph-mon[126480]: pgmap v5315: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 79 KiB/s wr, 7 op/s 2023-05-08T06:28:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:38 smithi133 ceph-mon[125939]: pgmap v5315: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 79 KiB/s wr, 7 op/s 2023-05-08T06:28:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:38 smithi096 ceph-mon[124666]: pgmap v5315: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 79 KiB/s wr, 7 op/s 2023-05-08T06:28:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9857.784556 secs 2023-05-08T06:28:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9857.784556 secs 2023-05-08T06:28:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9857.784556 secs 2023-05-08T06:28:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:40 smithi186 ceph-mon[126480]: pgmap v5316: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 79 KiB/s wr, 7 op/s 2023-05-08T06:28:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:40 smithi133 ceph-mon[125939]: pgmap v5316: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 79 KiB/s wr, 7 op/s 2023-05-08T06:28:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:40 smithi096 ceph-mon[124666]: pgmap v5316: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 79 KiB/s wr, 7 op/s 2023-05-08T06:28:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9859.622556 secs 2023-05-08T06:28:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:41 smithi133 ceph-mon[125939]: pgmap v5317: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 119 KiB/s wr, 11 op/s 2023-05-08T06:28:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9859.622556 secs 2023-05-08T06:28:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:41 smithi096 ceph-mon[124666]: pgmap v5317: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 119 KiB/s wr, 11 op/s 2023-05-08T06:28:41.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9859.622556 secs 2023-05-08T06:28:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:41 smithi186 ceph-mon[126480]: pgmap v5317: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 119 KiB/s wr, 11 op/s 2023-05-08T06:28:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:28:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:28:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:28:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:43 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:28:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:28:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:28:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:43 smithi133 ceph-mon[125939]: pgmap v5318: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 100 KiB/s wr, 8 op/s 2023-05-08T06:28:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:43 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:28:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:28:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:28:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:43 smithi096 ceph-mon[124666]: pgmap v5318: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 100 KiB/s wr, 8 op/s 2023-05-08T06:28:43.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:43 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:28:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:28:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:28:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:43 smithi186 ceph-mon[126480]: pgmap v5318: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 100 KiB/s wr, 8 op/s 2023-05-08T06:28:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9862.784679 secs 2023-05-08T06:28:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9862.784679 secs 2023-05-08T06:28:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9862.784679 secs 2023-05-08T06:28:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:45 smithi133 ceph-mon[125939]: pgmap v5319: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 172 KiB/s wr, 13 op/s 2023-05-08T06:28:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:45 smithi096 ceph-mon[124666]: pgmap v5319: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 172 KiB/s wr, 13 op/s 2023-05-08T06:28:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:45 smithi186 ceph-mon[126480]: pgmap v5319: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 172 KiB/s wr, 13 op/s 2023-05-08T06:28:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:46 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:28:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:46 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:28:46.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:46 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:28:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:47 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:28:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:47 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:28:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:47 smithi133 ceph-mon[125939]: pgmap v5320: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 111 KiB/s wr, 9 op/s 2023-05-08T06:28:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:47 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:28:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:47 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:28:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:47 smithi096 ceph-mon[124666]: pgmap v5320: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 111 KiB/s wr, 9 op/s 2023-05-08T06:28:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:47 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:28:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:47 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:28:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:47 smithi186 ceph-mon[126480]: pgmap v5320: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 111 KiB/s wr, 9 op/s 2023-05-08T06:28:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9867.784802 secs 2023-05-08T06:28:48.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9867.784802 secs 2023-05-08T06:28:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9867.784802 secs 2023-05-08T06:28:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9868.341679 secs 2023-05-08T06:28:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:49 smithi096 ceph-mon[124666]: pgmap v5321: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 111 KiB/s wr, 9 op/s 2023-05-08T06:28:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9868.341679 secs 2023-05-08T06:28:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:49 smithi186 ceph-mon[126480]: pgmap v5321: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 111 KiB/s wr, 9 op/s 2023-05-08T06:28:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9868.341679 secs 2023-05-08T06:28:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:49 smithi133 ceph-mon[125939]: pgmap v5321: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 111 KiB/s wr, 9 op/s 2023-05-08T06:28:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:50 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:28:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:50 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:28:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:50 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:28:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:51 smithi186 ceph-mon[126480]: pgmap v5322: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 119 KiB/s wr, 13 op/s 2023-05-08T06:28:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:28:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:28:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:51 smithi133 ceph-mon[125939]: pgmap v5322: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 119 KiB/s wr, 13 op/s 2023-05-08T06:28:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:28:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:28:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:51 smithi096 ceph-mon[124666]: pgmap v5322: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 119 KiB/s wr, 13 op/s 2023-05-08T06:28:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:28:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:28:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:28:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:28:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:28:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:53 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:28:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:53 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:28:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:53 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:28:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:53 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:28:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:53 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:28:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:53 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:28:54.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:53 smithi186 ceph-mon[126480]: pgmap v5323: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 80 KiB/s wr, 9 op/s 2023-05-08T06:28:54.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9872.784890 secs 2023-05-08T06:28:54.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:53 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:28:54.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:53 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:28:54.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:53 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:28:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:53 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:28:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:53 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:28:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:53 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:28:54.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:53 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:28:54.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:53 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:28:54.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:53 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:28:54.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:53 smithi133 ceph-mon[125939]: pgmap v5323: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 80 KiB/s wr, 9 op/s 2023-05-08T06:28:54.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9872.784890 secs 2023-05-08T06:28:54.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:53 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:28:54.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:53 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:28:54.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:53 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:28:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:53 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:28:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:53 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:28:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:53 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:28:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:53 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:28:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:53 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:28:54.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:53 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:28:54.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:53 smithi096 ceph-mon[124666]: pgmap v5323: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 80 KiB/s wr, 9 op/s 2023-05-08T06:28:54.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9872.784890 secs 2023-05-08T06:28:54.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:53 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:28:54.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:53 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:28:54.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:53 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:28:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:54 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:28:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:54 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T06:28:55.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:54 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T06:28:55.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:54 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:28:55.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9873.341771 secs 2023-05-08T06:28:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:54 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:28:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:54 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T06:28:55.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:54 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T06:28:55.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:54 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:28:55.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9873.341771 secs 2023-05-08T06:28:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:54 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:28:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:54 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T06:28:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:54 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T06:28:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:54 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:28:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9873.341771 secs 2023-05-08T06:28:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:55 smithi133 ceph-mon[125939]: pgmap v5324: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 151 KiB/s wr, 13 op/s 2023-05-08T06:28:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:55 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:28:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:55 smithi096 ceph-mon[124666]: pgmap v5324: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 151 KiB/s wr, 13 op/s 2023-05-08T06:28:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:55 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:28:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:55 smithi186 ceph-mon[126480]: pgmap v5324: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 151 KiB/s wr, 13 op/s 2023-05-08T06:28:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:55 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:28:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:58 smithi186 ceph-mon[126480]: pgmap v5325: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 79 KiB/s wr, 7 op/s 2023-05-08T06:28:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:58 smithi133 ceph-mon[125939]: pgmap v5325: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 79 KiB/s wr, 7 op/s 2023-05-08T06:28:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:58 smithi096 ceph-mon[124666]: pgmap v5325: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 79 KiB/s wr, 7 op/s 2023-05-08T06:28:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9877.785029 secs 2023-05-08T06:28:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:28:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9878.341838 secs 2023-05-08T06:28:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9877.785029 secs 2023-05-08T06:28:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:28:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9878.341838 secs 2023-05-08T06:28:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9877.785029 secs 2023-05-08T06:28:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:28:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9878.341838 secs 2023-05-08T06:29:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:00 smithi186 ceph-mon[126480]: pgmap v5326: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 79 KiB/s wr, 7 op/s 2023-05-08T06:29:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:00 smithi133 ceph-mon[125939]: pgmap v5326: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 79 KiB/s wr, 7 op/s 2023-05-08T06:29:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:00 smithi096 ceph-mon[124666]: pgmap v5326: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 79 KiB/s wr, 7 op/s 2023-05-08T06:29:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9879.623086 secs 2023-05-08T06:29:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:01 smithi133 ceph-mon[125939]: pgmap v5327: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 91 KiB/s wr, 12 op/s 2023-05-08T06:29:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9879.623086 secs 2023-05-08T06:29:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:01 smithi096 ceph-mon[124666]: pgmap v5327: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 91 KiB/s wr, 12 op/s 2023-05-08T06:29:01.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9879.623086 secs 2023-05-08T06:29:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:01 smithi186 ceph-mon[126480]: pgmap v5327: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 91 KiB/s wr, 12 op/s 2023-05-08T06:29:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:02 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:29:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:29:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:29:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:02 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:29:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:29:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:29:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:02 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:29:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:29:02.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:29:03.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:03 smithi186 ceph-mon[126480]: pgmap v5328: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 83 KiB/s wr, 7 op/s 2023-05-08T06:29:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:03 smithi133 ceph-mon[125939]: pgmap v5328: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 83 KiB/s wr, 7 op/s 2023-05-08T06:29:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:03 smithi096 ceph-mon[124666]: pgmap v5328: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 83 KiB/s wr, 7 op/s 2023-05-08T06:29:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9882.785143 secs 2023-05-08T06:29:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9883.341965 secs 2023-05-08T06:29:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9882.785143 secs 2023-05-08T06:29:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9883.341965 secs 2023-05-08T06:29:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9882.785143 secs 2023-05-08T06:29:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9883.341965 secs 2023-05-08T06:29:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9884.623226 secs 2023-05-08T06:29:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:05 smithi186 ceph-mon[126480]: pgmap v5329: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 174 KiB/s wr, 26 op/s 2023-05-08T06:29:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9884.623226 secs 2023-05-08T06:29:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:05 smithi133 ceph-mon[125939]: pgmap v5329: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 174 KiB/s wr, 26 op/s 2023-05-08T06:29:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9884.623226 secs 2023-05-08T06:29:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:05 smithi096 ceph-mon[124666]: pgmap v5329: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 174 KiB/s wr, 26 op/s 2023-05-08T06:29:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:06 smithi186 ceph-mon[126480]: osdmap e410: 12 total, 12 up, 12 in 2023-05-08T06:29:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:06 smithi133 ceph-mon[125939]: osdmap e410: 12 total, 12 up, 12 in 2023-05-08T06:29:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:06 smithi096 ceph-mon[124666]: osdmap e410: 12 total, 12 up, 12 in 2023-05-08T06:29:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:07 smithi133 ceph-mon[125939]: pgmap v5331: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 123 KiB/s wr, 26 op/s 2023-05-08T06:29:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:07 smithi096 ceph-mon[124666]: pgmap v5331: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 123 KiB/s wr, 26 op/s 2023-05-08T06:29:07.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:07 smithi186 ceph-mon[126480]: pgmap v5331: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 123 KiB/s wr, 26 op/s 2023-05-08T06:29:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9887.785263 secs 2023-05-08T06:29:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9887.785263 secs 2023-05-08T06:29:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9887.785263 secs 2023-05-08T06:29:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9888.342104 secs 2023-05-08T06:29:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:09 smithi186 ceph-mon[126480]: pgmap v5332: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 123 KiB/s wr, 26 op/s 2023-05-08T06:29:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9888.342104 secs 2023-05-08T06:29:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:09 smithi133 ceph-mon[125939]: pgmap v5332: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 123 KiB/s wr, 26 op/s 2023-05-08T06:29:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9888.342104 secs 2023-05-08T06:29:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:09 smithi096 ceph-mon[124666]: pgmap v5332: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 123 KiB/s wr, 26 op/s 2023-05-08T06:29:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9889.623345 secs 2023-05-08T06:29:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:11 smithi133 ceph-mon[125939]: pgmap v5333: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 114 KiB/s wr, 26 op/s 2023-05-08T06:29:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9889.623345 secs 2023-05-08T06:29:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:11 smithi096 ceph-mon[124666]: pgmap v5333: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 114 KiB/s wr, 26 op/s 2023-05-08T06:29:11.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9889.623345 secs 2023-05-08T06:29:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:11 smithi186 ceph-mon[126480]: pgmap v5333: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 114 KiB/s wr, 26 op/s 2023-05-08T06:29:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:14 smithi186 ceph-mon[126480]: pgmap v5334: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 114 KiB/s wr, 26 op/s 2023-05-08T06:29:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9892.785366 secs 2023-05-08T06:29:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9893.342260 secs 2023-05-08T06:29:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:14 smithi133 ceph-mon[125939]: pgmap v5334: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 114 KiB/s wr, 26 op/s 2023-05-08T06:29:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9892.785366 secs 2023-05-08T06:29:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9893.342260 secs 2023-05-08T06:29:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:14 smithi096 ceph-mon[124666]: pgmap v5334: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 114 KiB/s wr, 26 op/s 2023-05-08T06:29:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9892.785366 secs 2023-05-08T06:29:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9893.342260 secs 2023-05-08T06:29:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9894.623464 secs 2023-05-08T06:29:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:16 smithi186 ceph-mon[126480]: pgmap v5335: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 26 KiB/s wr, 8 op/s 2023-05-08T06:29:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:16 smithi186 ceph-mon[126480]: osdmap e411: 12 total, 12 up, 12 in 2023-05-08T06:29:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9894.623464 secs 2023-05-08T06:29:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:16 smithi133 ceph-mon[125939]: pgmap v5335: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 26 KiB/s wr, 8 op/s 2023-05-08T06:29:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:16 smithi133 ceph-mon[125939]: osdmap e411: 12 total, 12 up, 12 in 2023-05-08T06:29:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9894.623464 secs 2023-05-08T06:29:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:16 smithi096 ceph-mon[124666]: pgmap v5335: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 26 KiB/s wr, 8 op/s 2023-05-08T06:29:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:16 smithi096 ceph-mon[124666]: osdmap e411: 12 total, 12 up, 12 in 2023-05-08T06:29:18.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:18 smithi186 ceph-mon[126480]: pgmap v5337: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 26 KiB/s wr, 8 op/s 2023-05-08T06:29:18.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:18 smithi133 ceph-mon[125939]: pgmap v5337: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 26 KiB/s wr, 8 op/s 2023-05-08T06:29:18.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:18 smithi096 ceph-mon[124666]: pgmap v5337: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 26 KiB/s wr, 8 op/s 2023-05-08T06:29:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9897.785417 secs 2023-05-08T06:29:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9898.342380 secs 2023-05-08T06:29:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9897.785417 secs 2023-05-08T06:29:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9898.342380 secs 2023-05-08T06:29:19.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9897.785417 secs 2023-05-08T06:29:19.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9898.342380 secs 2023-05-08T06:29:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:20 smithi186 ceph-mon[126480]: pgmap v5338: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 26 KiB/s wr, 8 op/s 2023-05-08T06:29:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:20 smithi133 ceph-mon[125939]: pgmap v5338: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 26 KiB/s wr, 8 op/s 2023-05-08T06:29:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:20 smithi096 ceph-mon[124666]: pgmap v5338: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 26 KiB/s wr, 8 op/s 2023-05-08T06:29:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9899.623585 secs 2023-05-08T06:29:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:21 smithi133 ceph-mon[125939]: pgmap v5339: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 21 KiB/s wr, 8 op/s 2023-05-08T06:29:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9899.623585 secs 2023-05-08T06:29:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:21 smithi096 ceph-mon[124666]: pgmap v5339: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 21 KiB/s wr, 8 op/s 2023-05-08T06:29:21.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9899.623585 secs 2023-05-08T06:29:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:21 smithi186 ceph-mon[126480]: pgmap v5339: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 21 KiB/s wr, 8 op/s 2023-05-08T06:29:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:24 smithi186 ceph-mon[126480]: pgmap v5340: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 21 KiB/s wr, 8 op/s 2023-05-08T06:29:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9902.785509 secs 2023-05-08T06:29:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9903.342505 secs 2023-05-08T06:29:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:24 smithi133 ceph-mon[125939]: pgmap v5340: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 21 KiB/s wr, 8 op/s 2023-05-08T06:29:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9902.785509 secs 2023-05-08T06:29:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9903.342505 secs 2023-05-08T06:29:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:24 smithi096 ceph-mon[124666]: pgmap v5340: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 21 KiB/s wr, 8 op/s 2023-05-08T06:29:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9902.785509 secs 2023-05-08T06:29:24.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9903.342505 secs 2023-05-08T06:29:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9904.623706 secs 2023-05-08T06:29:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:26 smithi186 ceph-mon[126480]: pgmap v5341: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 39 KiB/s wr, 8 op/s 2023-05-08T06:29:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9904.623706 secs 2023-05-08T06:29:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:26 smithi133 ceph-mon[125939]: pgmap v5341: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 39 KiB/s wr, 8 op/s 2023-05-08T06:29:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9904.623706 secs 2023-05-08T06:29:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:26 smithi096 ceph-mon[124666]: pgmap v5341: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 39 KiB/s wr, 8 op/s 2023-05-08T06:29:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:28 smithi186 ceph-mon[126480]: pgmap v5342: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 33 KiB/s wr, 7 op/s 2023-05-08T06:29:28.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:28 smithi133 ceph-mon[125939]: pgmap v5342: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 33 KiB/s wr, 7 op/s 2023-05-08T06:29:28.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:28 smithi096 ceph-mon[124666]: pgmap v5342: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 33 KiB/s wr, 7 op/s 2023-05-08T06:29:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9907.785571 secs 2023-05-08T06:29:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9908.342623 secs 2023-05-08T06:29:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9907.785571 secs 2023-05-08T06:29:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9908.342623 secs 2023-05-08T06:29:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9907.785571 secs 2023-05-08T06:29:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9908.342623 secs 2023-05-08T06:29:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:30 smithi186 ceph-mon[126480]: pgmap v5343: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T06:29:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:30 smithi133 ceph-mon[125939]: pgmap v5343: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T06:29:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:30 smithi096 ceph-mon[124666]: pgmap v5343: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T06:29:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9909.623827 secs 2023-05-08T06:29:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:31 smithi133 ceph-mon[125939]: pgmap v5344: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 36 KiB/s wr, 10 op/s 2023-05-08T06:29:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9909.623827 secs 2023-05-08T06:29:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:31 smithi096 ceph-mon[124666]: pgmap v5344: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 36 KiB/s wr, 10 op/s 2023-05-08T06:29:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9909.623827 secs 2023-05-08T06:29:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:31 smithi186 ceph-mon[126480]: pgmap v5344: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 36 KiB/s wr, 10 op/s 2023-05-08T06:29:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:34 smithi186 ceph-mon[126480]: pgmap v5345: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 7 op/s 2023-05-08T06:29:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9912.785631 secs 2023-05-08T06:29:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9913.342735 secs 2023-05-08T06:29:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:34 smithi133 ceph-mon[125939]: pgmap v5345: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 7 op/s 2023-05-08T06:29:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9912.785631 secs 2023-05-08T06:29:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9913.342735 secs 2023-05-08T06:29:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:34 smithi096 ceph-mon[124666]: pgmap v5345: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 7 op/s 2023-05-08T06:29:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9912.785631 secs 2023-05-08T06:29:34.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9913.342735 secs 2023-05-08T06:29:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9914.623891 secs 2023-05-08T06:29:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:36 smithi186 ceph-mon[126480]: pgmap v5346: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 97 KiB/s wr, 11 op/s 2023-05-08T06:29:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9914.623891 secs 2023-05-08T06:29:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:36 smithi133 ceph-mon[125939]: pgmap v5346: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 97 KiB/s wr, 11 op/s 2023-05-08T06:29:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9914.623891 secs 2023-05-08T06:29:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:36 smithi096 ceph-mon[124666]: pgmap v5346: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 97 KiB/s wr, 11 op/s 2023-05-08T06:29:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:38 smithi186 ceph-mon[126480]: pgmap v5347: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 65 KiB/s wr, 7 op/s 2023-05-08T06:29:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:38 smithi133 ceph-mon[125939]: pgmap v5347: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 65 KiB/s wr, 7 op/s 2023-05-08T06:29:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:38 smithi096 ceph-mon[124666]: pgmap v5347: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 65 KiB/s wr, 7 op/s 2023-05-08T06:29:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9917.785747 secs 2023-05-08T06:29:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9917.785747 secs 2023-05-08T06:29:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9917.785747 secs 2023-05-08T06:29:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:40 smithi186 ceph-mon[126480]: pgmap v5348: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 65 KiB/s wr, 7 op/s 2023-05-08T06:29:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:40 smithi133 ceph-mon[125939]: pgmap v5348: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 65 KiB/s wr, 7 op/s 2023-05-08T06:29:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:40 smithi096 ceph-mon[124666]: pgmap v5348: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 65 KiB/s wr, 7 op/s 2023-05-08T06:29:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9919.624012 secs 2023-05-08T06:29:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:41 smithi133 ceph-mon[125939]: pgmap v5349: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 106 KiB/s wr, 11 op/s 2023-05-08T06:29:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9919.624012 secs 2023-05-08T06:29:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:41 smithi096 ceph-mon[124666]: pgmap v5349: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 106 KiB/s wr, 11 op/s 2023-05-08T06:29:41.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9919.624012 secs 2023-05-08T06:29:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:41 smithi186 ceph-mon[126480]: pgmap v5349: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 106 KiB/s wr, 11 op/s 2023-05-08T06:29:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:29:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:42 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:29:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:29:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:42 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:29:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:29:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:42 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:29:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:29:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:29:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:43 smithi133 ceph-mon[125939]: pgmap v5350: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 101 KiB/s wr, 8 op/s 2023-05-08T06:29:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:29:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:29:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:43 smithi096 ceph-mon[124666]: pgmap v5350: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 101 KiB/s wr, 8 op/s 2023-05-08T06:29:43.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:29:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:29:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:43 smithi186 ceph-mon[126480]: pgmap v5350: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 101 KiB/s wr, 8 op/s 2023-05-08T06:29:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9922.785865 secs 2023-05-08T06:29:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9922.785865 secs 2023-05-08T06:29:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9922.785865 secs 2023-05-08T06:29:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:45 smithi133 ceph-mon[125939]: pgmap v5351: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 175 KiB/s wr, 13 op/s 2023-05-08T06:29:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:45 smithi096 ceph-mon[124666]: pgmap v5351: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 175 KiB/s wr, 13 op/s 2023-05-08T06:29:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:45 smithi186 ceph-mon[126480]: pgmap v5351: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 175 KiB/s wr, 13 op/s 2023-05-08T06:29:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:46 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:29:46.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:46 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:29:46.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:46 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:29:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:47 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:29:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:47 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:29:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:47 smithi133 ceph-mon[125939]: pgmap v5352: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 114 KiB/s wr, 9 op/s 2023-05-08T06:29:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:47 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:29:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:47 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:29:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:47 smithi096 ceph-mon[124666]: pgmap v5352: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 114 KiB/s wr, 9 op/s 2023-05-08T06:29:47.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:47 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:29:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:47 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:29:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:47 smithi186 ceph-mon[126480]: pgmap v5352: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 114 KiB/s wr, 9 op/s 2023-05-08T06:29:48.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9927.785986 secs 2023-05-08T06:29:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9927.785986 secs 2023-05-08T06:29:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9927.785986 secs 2023-05-08T06:29:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9928.343102 secs 2023-05-08T06:29:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:49 smithi186 ceph-mon[126480]: pgmap v5353: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 114 KiB/s wr, 9 op/s 2023-05-08T06:29:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9928.343102 secs 2023-05-08T06:29:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:49 smithi133 ceph-mon[125939]: pgmap v5353: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 114 KiB/s wr, 9 op/s 2023-05-08T06:29:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9928.343102 secs 2023-05-08T06:29:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:49 smithi096 ceph-mon[124666]: pgmap v5353: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 114 KiB/s wr, 9 op/s 2023-05-08T06:29:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:50 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:29:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:50 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:29:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:50 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:29:51.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:51 smithi186 ceph-mon[126480]: pgmap v5354: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 122 KiB/s wr, 13 op/s 2023-05-08T06:29:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:29:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:29:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:51 smithi133 ceph-mon[125939]: pgmap v5354: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 122 KiB/s wr, 13 op/s 2023-05-08T06:29:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:29:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:29:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:51 smithi096 ceph-mon[124666]: pgmap v5354: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 122 KiB/s wr, 13 op/s 2023-05-08T06:29:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:29:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:29:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:54 smithi186 ceph-mon[126480]: pgmap v5355: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 82 KiB/s wr, 9 op/s 2023-05-08T06:29:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9932.786126 secs 2023-05-08T06:29:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9933.343210 secs 2023-05-08T06:29:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:29:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:54 smithi133 ceph-mon[125939]: pgmap v5355: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 82 KiB/s wr, 9 op/s 2023-05-08T06:29:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9932.786126 secs 2023-05-08T06:29:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9933.343210 secs 2023-05-08T06:29:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:29:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:54 smithi096 ceph-mon[124666]: pgmap v5355: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 82 KiB/s wr, 9 op/s 2023-05-08T06:29:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9932.786126 secs 2023-05-08T06:29:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9933.343210 secs 2023-05-08T06:29:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:29:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:55 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:29:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:55 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:29:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:55 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:29:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:55 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:29:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:55 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:29:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:55 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:29:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:55 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:29:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:55 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:29:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:55 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:29:56.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:56 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:29:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:56 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T06:29:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:56 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T06:29:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:56 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:29:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:56 smithi186 ceph-mon[126480]: pgmap v5356: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 155 KiB/s wr, 13 op/s 2023-05-08T06:29:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:56 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:29:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:56 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:29:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:56 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T06:29:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:56 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T06:29:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:56 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:29:56.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:56 smithi133 ceph-mon[125939]: pgmap v5356: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 155 KiB/s wr, 13 op/s 2023-05-08T06:29:56.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:56 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:29:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:56 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:29:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:56 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T06:29:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:56 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T06:29:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:56 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:29:56.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:56 smithi096 ceph-mon[124666]: pgmap v5356: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 155 KiB/s wr, 13 op/s 2023-05-08T06:29:56.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:56 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:29:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:58 smithi186 ceph-mon[126480]: pgmap v5357: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 81 KiB/s wr, 8 op/s 2023-05-08T06:29:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:58 smithi133 ceph-mon[125939]: pgmap v5357: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 81 KiB/s wr, 8 op/s 2023-05-08T06:29:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:58 smithi096 ceph-mon[124666]: pgmap v5357: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 81 KiB/s wr, 8 op/s 2023-05-08T06:29:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9937.786240 secs 2023-05-08T06:29:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:29:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9938.343316 secs 2023-05-08T06:29:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9937.786240 secs 2023-05-08T06:29:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:29:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9938.343316 secs 2023-05-08T06:29:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9937.786240 secs 2023-05-08T06:29:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:29:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9938.343316 secs 2023-05-08T06:30:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:00 smithi186 ceph-mon[126480]: pgmap v5358: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 81 KiB/s wr, 8 op/s 2023-05-08T06:30:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:00 smithi186 ceph-mon[126480]: overall HEALTH_WARN 2 MDSs report slow requests 2023-05-08T06:30:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:00 smithi133 ceph-mon[125939]: pgmap v5358: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 81 KiB/s wr, 8 op/s 2023-05-08T06:30:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:00 smithi133 ceph-mon[125939]: overall HEALTH_WARN 2 MDSs report slow requests 2023-05-08T06:30:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:00 smithi096 ceph-mon[124666]: pgmap v5358: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 81 KiB/s wr, 8 op/s 2023-05-08T06:30:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:00 smithi096 ceph-mon[124666]: overall HEALTH_WARN 2 MDSs report slow requests 2023-05-08T06:30:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9939.624451 secs 2023-05-08T06:30:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:01 smithi133 ceph-mon[125939]: pgmap v5359: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 89 KiB/s wr, 12 op/s 2023-05-08T06:30:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9939.624451 secs 2023-05-08T06:30:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:01 smithi096 ceph-mon[124666]: pgmap v5359: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 89 KiB/s wr, 12 op/s 2023-05-08T06:30:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9939.624451 secs 2023-05-08T06:30:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:01 smithi186 ceph-mon[126480]: pgmap v5359: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 89 KiB/s wr, 12 op/s 2023-05-08T06:30:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:02 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:30:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:30:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:30:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:02 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:30:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:30:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:30:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:02 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:30:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:30:02.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:30:03.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:03 smithi186 ceph-mon[126480]: pgmap v5360: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 81 KiB/s wr, 8 op/s 2023-05-08T06:30:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:03 smithi133 ceph-mon[125939]: pgmap v5360: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 81 KiB/s wr, 8 op/s 2023-05-08T06:30:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:03 smithi096 ceph-mon[124666]: pgmap v5360: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 81 KiB/s wr, 8 op/s 2023-05-08T06:30:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9942.786376 secs 2023-05-08T06:30:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9943.343444 secs 2023-05-08T06:30:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9942.786376 secs 2023-05-08T06:30:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9943.343444 secs 2023-05-08T06:30:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9942.786376 secs 2023-05-08T06:30:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9943.343444 secs 2023-05-08T06:30:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9944.624588 secs 2023-05-08T06:30:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:05 smithi186 ceph-mon[126480]: pgmap v5361: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 171 KiB/s wr, 27 op/s 2023-05-08T06:30:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9944.624588 secs 2023-05-08T06:30:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:05 smithi133 ceph-mon[125939]: pgmap v5361: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 171 KiB/s wr, 27 op/s 2023-05-08T06:30:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9944.624588 secs 2023-05-08T06:30:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:05 smithi096 ceph-mon[124666]: pgmap v5361: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 171 KiB/s wr, 27 op/s 2023-05-08T06:30:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:06 smithi186 ceph-mon[126480]: osdmap e412: 12 total, 12 up, 12 in 2023-05-08T06:30:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:06 smithi133 ceph-mon[125939]: osdmap e412: 12 total, 12 up, 12 in 2023-05-08T06:30:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:06 smithi096 ceph-mon[124666]: osdmap e412: 12 total, 12 up, 12 in 2023-05-08T06:30:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:07 smithi133 ceph-mon[125939]: pgmap v5363: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 118 KiB/s wr, 27 op/s 2023-05-08T06:30:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:07 smithi096 ceph-mon[124666]: pgmap v5363: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 118 KiB/s wr, 27 op/s 2023-05-08T06:30:07.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:07 smithi186 ceph-mon[126480]: pgmap v5363: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 118 KiB/s wr, 27 op/s 2023-05-08T06:30:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9947.786511 secs 2023-05-08T06:30:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9947.786511 secs 2023-05-08T06:30:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9947.786511 secs 2023-05-08T06:30:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9948.343579 secs 2023-05-08T06:30:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:09 smithi186 ceph-mon[126480]: pgmap v5364: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 118 KiB/s wr, 27 op/s 2023-05-08T06:30:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9948.343579 secs 2023-05-08T06:30:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:09 smithi133 ceph-mon[125939]: pgmap v5364: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 118 KiB/s wr, 27 op/s 2023-05-08T06:30:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9948.343579 secs 2023-05-08T06:30:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:09 smithi096 ceph-mon[124666]: pgmap v5364: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 118 KiB/s wr, 27 op/s 2023-05-08T06:30:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9949.624710 secs 2023-05-08T06:30:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:11 smithi133 ceph-mon[125939]: pgmap v5365: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 113 KiB/s wr, 26 op/s 2023-05-08T06:30:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9949.624710 secs 2023-05-08T06:30:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:11 smithi096 ceph-mon[124666]: pgmap v5365: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 113 KiB/s wr, 26 op/s 2023-05-08T06:30:11.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9949.624710 secs 2023-05-08T06:30:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:11 smithi186 ceph-mon[126480]: pgmap v5365: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 113 KiB/s wr, 26 op/s 2023-05-08T06:30:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:14 smithi186 ceph-mon[126480]: pgmap v5366: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 113 KiB/s wr, 26 op/s 2023-05-08T06:30:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9952.786617 secs 2023-05-08T06:30:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9953.343702 secs 2023-05-08T06:30:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:14 smithi133 ceph-mon[125939]: pgmap v5366: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 113 KiB/s wr, 26 op/s 2023-05-08T06:30:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9952.786617 secs 2023-05-08T06:30:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9953.343702 secs 2023-05-08T06:30:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:14 smithi096 ceph-mon[124666]: pgmap v5366: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 113 KiB/s wr, 26 op/s 2023-05-08T06:30:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9952.786617 secs 2023-05-08T06:30:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9953.343702 secs 2023-05-08T06:30:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9954.624861 secs 2023-05-08T06:30:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:16 smithi186 ceph-mon[126480]: pgmap v5367: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 8 op/s 2023-05-08T06:30:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:16 smithi186 ceph-mon[126480]: osdmap e413: 12 total, 12 up, 12 in 2023-05-08T06:30:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9954.624861 secs 2023-05-08T06:30:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:16 smithi133 ceph-mon[125939]: pgmap v5367: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 8 op/s 2023-05-08T06:30:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:16 smithi133 ceph-mon[125939]: osdmap e413: 12 total, 12 up, 12 in 2023-05-08T06:30:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9954.624861 secs 2023-05-08T06:30:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:16 smithi096 ceph-mon[124666]: pgmap v5367: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 8 op/s 2023-05-08T06:30:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:16 smithi096 ceph-mon[124666]: osdmap e413: 12 total, 12 up, 12 in 2023-05-08T06:30:18.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:18 smithi186 ceph-mon[126480]: pgmap v5369: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 8 op/s 2023-05-08T06:30:18.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:18 smithi133 ceph-mon[125939]: pgmap v5369: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 8 op/s 2023-05-08T06:30:18.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:18 smithi096 ceph-mon[124666]: pgmap v5369: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 8 op/s 2023-05-08T06:30:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9957.786682 secs 2023-05-08T06:30:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9958.343823 secs 2023-05-08T06:30:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9957.786682 secs 2023-05-08T06:30:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9958.343823 secs 2023-05-08T06:30:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9957.786682 secs 2023-05-08T06:30:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9958.343823 secs 2023-05-08T06:30:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:20 smithi186 ceph-mon[126480]: pgmap v5370: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 8 op/s 2023-05-08T06:30:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:20 smithi133 ceph-mon[125939]: pgmap v5370: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 8 op/s 2023-05-08T06:30:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:20 smithi096 ceph-mon[124666]: pgmap v5370: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 8 op/s 2023-05-08T06:30:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9959.624957 secs 2023-05-08T06:30:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:21 smithi133 ceph-mon[125939]: pgmap v5371: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 7 op/s 2023-05-08T06:30:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9959.624957 secs 2023-05-08T06:30:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:21 smithi096 ceph-mon[124666]: pgmap v5371: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 7 op/s 2023-05-08T06:30:21.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9959.624957 secs 2023-05-08T06:30:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:21 smithi186 ceph-mon[126480]: pgmap v5371: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 7 op/s 2023-05-08T06:30:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:24 smithi186 ceph-mon[126480]: pgmap v5372: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 7 op/s 2023-05-08T06:30:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9962.786740 secs 2023-05-08T06:30:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9963.343933 secs 2023-05-08T06:30:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:24 smithi133 ceph-mon[125939]: pgmap v5372: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 7 op/s 2023-05-08T06:30:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9962.786740 secs 2023-05-08T06:30:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9963.343933 secs 2023-05-08T06:30:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:24 smithi096 ceph-mon[124666]: pgmap v5372: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 7 op/s 2023-05-08T06:30:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9962.786740 secs 2023-05-08T06:30:24.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9963.343933 secs 2023-05-08T06:30:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9964.625039 secs 2023-05-08T06:30:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:26 smithi186 ceph-mon[126480]: pgmap v5373: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 KiB/s wr, 8 op/s 2023-05-08T06:30:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9964.625039 secs 2023-05-08T06:30:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:26 smithi133 ceph-mon[125939]: pgmap v5373: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 KiB/s wr, 8 op/s 2023-05-08T06:30:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9964.625039 secs 2023-05-08T06:30:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:26 smithi096 ceph-mon[124666]: pgmap v5373: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 KiB/s wr, 8 op/s 2023-05-08T06:30:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:28 smithi186 ceph-mon[126480]: pgmap v5374: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 6 op/s 2023-05-08T06:30:28.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:28 smithi133 ceph-mon[125939]: pgmap v5374: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 6 op/s 2023-05-08T06:30:28.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:28 smithi096 ceph-mon[124666]: pgmap v5374: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 6 op/s 2023-05-08T06:30:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9967.786864 secs 2023-05-08T06:30:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9968.344051 secs 2023-05-08T06:30:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9967.786864 secs 2023-05-08T06:30:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9968.344051 secs 2023-05-08T06:30:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9967.786864 secs 2023-05-08T06:30:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9968.344051 secs 2023-05-08T06:30:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:30 smithi186 ceph-mon[126480]: pgmap v5375: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T06:30:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:30 smithi133 ceph-mon[125939]: pgmap v5375: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T06:30:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:30 smithi096 ceph-mon[124666]: pgmap v5375: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T06:30:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9969.625121 secs 2023-05-08T06:30:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:31 smithi133 ceph-mon[125939]: pgmap v5376: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 39 KiB/s wr, 10 op/s 2023-05-08T06:30:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9969.625121 secs 2023-05-08T06:30:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:31 smithi096 ceph-mon[124666]: pgmap v5376: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 39 KiB/s wr, 10 op/s 2023-05-08T06:30:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9969.625121 secs 2023-05-08T06:30:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:31 smithi186 ceph-mon[126480]: pgmap v5376: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 39 KiB/s wr, 10 op/s 2023-05-08T06:30:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:34 smithi186 ceph-mon[126480]: pgmap v5377: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 KiB/s wr, 6 op/s 2023-05-08T06:30:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9972.787001 secs 2023-05-08T06:30:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9973.344168 secs 2023-05-08T06:30:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:34 smithi133 ceph-mon[125939]: pgmap v5377: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 KiB/s wr, 6 op/s 2023-05-08T06:30:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9972.787001 secs 2023-05-08T06:30:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9973.344168 secs 2023-05-08T06:30:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:34 smithi096 ceph-mon[124666]: pgmap v5377: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 KiB/s wr, 6 op/s 2023-05-08T06:30:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9972.787001 secs 2023-05-08T06:30:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9973.344168 secs 2023-05-08T06:30:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9974.625242 secs 2023-05-08T06:30:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:36 smithi186 ceph-mon[126480]: pgmap v5378: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 100 KiB/s wr, 10 op/s 2023-05-08T06:30:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9974.625242 secs 2023-05-08T06:30:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:36 smithi133 ceph-mon[125939]: pgmap v5378: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 100 KiB/s wr, 10 op/s 2023-05-08T06:30:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9974.625242 secs 2023-05-08T06:30:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:36 smithi096 ceph-mon[124666]: pgmap v5378: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 100 KiB/s wr, 10 op/s 2023-05-08T06:30:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:38 smithi186 ceph-mon[126480]: pgmap v5379: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 67 KiB/s wr, 6 op/s 2023-05-08T06:30:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:38 smithi133 ceph-mon[125939]: pgmap v5379: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 67 KiB/s wr, 6 op/s 2023-05-08T06:30:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:38 smithi096 ceph-mon[124666]: pgmap v5379: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 67 KiB/s wr, 6 op/s 2023-05-08T06:30:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9977.787135 secs 2023-05-08T06:30:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9977.787135 secs 2023-05-08T06:30:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9977.787135 secs 2023-05-08T06:30:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:40 smithi186 ceph-mon[126480]: pgmap v5380: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 67 KiB/s wr, 6 op/s 2023-05-08T06:30:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:40 smithi133 ceph-mon[125939]: pgmap v5380: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 67 KiB/s wr, 6 op/s 2023-05-08T06:30:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:40 smithi096 ceph-mon[124666]: pgmap v5380: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 67 KiB/s wr, 6 op/s 2023-05-08T06:30:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9979.625366 secs 2023-05-08T06:30:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:41 smithi133 ceph-mon[125939]: pgmap v5381: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 107 KiB/s wr, 11 op/s 2023-05-08T06:30:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9979.625366 secs 2023-05-08T06:30:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:41 smithi096 ceph-mon[124666]: pgmap v5381: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 107 KiB/s wr, 11 op/s 2023-05-08T06:30:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9979.625366 secs 2023-05-08T06:30:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:41 smithi186 ceph-mon[126480]: pgmap v5381: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 107 KiB/s wr, 11 op/s 2023-05-08T06:30:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:30:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:30:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:30:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:43 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:30:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:30:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:30:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:43 smithi133 ceph-mon[125939]: pgmap v5382: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 103 KiB/s wr, 7 op/s 2023-05-08T06:30:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:43 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:30:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:30:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:30:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:43 smithi096 ceph-mon[124666]: pgmap v5382: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 103 KiB/s wr, 7 op/s 2023-05-08T06:30:43.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:43 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:30:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:30:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:30:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:43 smithi186 ceph-mon[126480]: pgmap v5382: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 103 KiB/s wr, 7 op/s 2023-05-08T06:30:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9982.787253 secs 2023-05-08T06:30:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9982.787253 secs 2023-05-08T06:30:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9982.787253 secs 2023-05-08T06:30:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:45 smithi133 ceph-mon[125939]: pgmap v5383: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 178 KiB/s wr, 12 op/s 2023-05-08T06:30:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:45 smithi096 ceph-mon[124666]: pgmap v5383: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 178 KiB/s wr, 12 op/s 2023-05-08T06:30:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:45 smithi186 ceph-mon[126480]: pgmap v5383: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 178 KiB/s wr, 12 op/s 2023-05-08T06:30:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:46 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:30:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:46 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:30:46.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:46 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:30:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:47 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:30:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:47 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:30:47.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:47 smithi133 ceph-mon[125939]: pgmap v5384: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 115 KiB/s wr, 9 op/s 2023-05-08T06:30:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:47 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:30:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:47 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:30:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:47 smithi096 ceph-mon[124666]: pgmap v5384: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 115 KiB/s wr, 9 op/s 2023-05-08T06:30:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:47 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:30:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:47 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:30:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:47 smithi186 ceph-mon[126480]: pgmap v5384: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 115 KiB/s wr, 9 op/s 2023-05-08T06:30:48.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9987.787376 secs 2023-05-08T06:30:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9987.787376 secs 2023-05-08T06:30:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9987.787376 secs 2023-05-08T06:30:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9988.344542 secs 2023-05-08T06:30:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:49 smithi186 ceph-mon[126480]: pgmap v5385: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 115 KiB/s wr, 9 op/s 2023-05-08T06:30:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9988.344542 secs 2023-05-08T06:30:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:49 smithi133 ceph-mon[125939]: pgmap v5385: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 115 KiB/s wr, 9 op/s 2023-05-08T06:30:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9988.344542 secs 2023-05-08T06:30:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:49 smithi096 ceph-mon[124666]: pgmap v5385: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 115 KiB/s wr, 9 op/s 2023-05-08T06:30:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:50 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:30:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:50 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:30:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:50 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:30:51.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:51 smithi186 ceph-mon[126480]: pgmap v5386: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 124 KiB/s wr, 13 op/s 2023-05-08T06:30:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:30:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:30:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:51 smithi133 ceph-mon[125939]: pgmap v5386: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 124 KiB/s wr, 13 op/s 2023-05-08T06:30:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:30:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:30:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:51 smithi096 ceph-mon[124666]: pgmap v5386: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 124 KiB/s wr, 13 op/s 2023-05-08T06:30:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:30:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:30:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:54 smithi186 ceph-mon[126480]: pgmap v5387: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 83 KiB/s wr, 8 op/s 2023-05-08T06:30:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9992.787493 secs 2023-05-08T06:30:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9993.344661 secs 2023-05-08T06:30:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:54 smithi133 ceph-mon[125939]: pgmap v5387: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 83 KiB/s wr, 8 op/s 2023-05-08T06:30:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9992.787493 secs 2023-05-08T06:30:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9993.344661 secs 2023-05-08T06:30:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:54 smithi096 ceph-mon[124666]: pgmap v5387: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 83 KiB/s wr, 8 op/s 2023-05-08T06:30:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9992.787493 secs 2023-05-08T06:30:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9993.344661 secs 2023-05-08T06:30:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:55 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:30:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:55 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:30:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:55 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:30:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:56 smithi186 ceph-mon[126480]: pgmap v5388: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 157 KiB/s wr, 13 op/s 2023-05-08T06:30:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:30:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:30:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:56 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:30:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:30:56.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:56 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T06:30:56.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:56 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T06:30:56.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:56 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:30:56.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:56 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:30:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:56 smithi133 ceph-mon[125939]: pgmap v5388: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 157 KiB/s wr, 13 op/s 2023-05-08T06:30:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:30:56.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:30:56.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:56 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:30:56.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:30:56.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:56 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T06:30:56.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:56 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T06:30:56.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:56 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:30:56.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:56 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:30:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:56 smithi096 ceph-mon[124666]: pgmap v5388: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 157 KiB/s wr, 13 op/s 2023-05-08T06:30:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:30:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:30:56.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:56 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:30:56.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:30:56.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:56 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T06:30:56.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:56 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T06:30:56.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:56 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:30:56.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:56 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:30:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:58 smithi186 ceph-mon[126480]: pgmap v5389: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 82 KiB/s wr, 8 op/s 2023-05-08T06:30:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:58 smithi133 ceph-mon[125939]: pgmap v5389: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 82 KiB/s wr, 8 op/s 2023-05-08T06:30:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:58 smithi096 ceph-mon[124666]: pgmap v5389: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 82 KiB/s wr, 8 op/s 2023-05-08T06:30:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9997.787638 secs 2023-05-08T06:30:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:30:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9998.344749 secs 2023-05-08T06:30:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9997.787638 secs 2023-05-08T06:30:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:30:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9998.344749 secs 2023-05-08T06:30:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9997.787638 secs 2023-05-08T06:30:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:30:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9998.344749 secs 2023-05-08T06:31:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:00 smithi186 ceph-mon[126480]: pgmap v5390: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 82 KiB/s wr, 8 op/s 2023-05-08T06:31:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:00 smithi133 ceph-mon[125939]: pgmap v5390: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 82 KiB/s wr, 8 op/s 2023-05-08T06:31:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:00 smithi096 ceph-mon[124666]: pgmap v5390: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 82 KiB/s wr, 8 op/s 2023-05-08T06:31:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 9999.625836 secs 2023-05-08T06:31:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:01 smithi133 ceph-mon[125939]: pgmap v5391: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 121 KiB/s wr, 12 op/s 2023-05-08T06:31:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 9999.625836 secs 2023-05-08T06:31:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:01 smithi096 ceph-mon[124666]: pgmap v5391: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 121 KiB/s wr, 12 op/s 2023-05-08T06:31:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 9999.625836 secs 2023-05-08T06:31:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:01 smithi186 ceph-mon[126480]: pgmap v5391: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 121 KiB/s wr, 12 op/s 2023-05-08T06:31:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:02 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:31:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:31:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:31:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:02 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:31:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:31:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:31:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:02 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:31:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:31:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:31:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:03 smithi133 ceph-mon[125939]: pgmap v5392: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 113 KiB/s wr, 8 op/s 2023-05-08T06:31:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:03 smithi096 ceph-mon[124666]: pgmap v5392: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 113 KiB/s wr, 8 op/s 2023-05-08T06:31:03.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:03 smithi186 ceph-mon[126480]: pgmap v5392: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 113 KiB/s wr, 8 op/s 2023-05-08T06:31:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10002.787758 secs 2023-05-08T06:31:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10003.344901 secs 2023-05-08T06:31:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10002.787758 secs 2023-05-08T06:31:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10003.344901 secs 2023-05-08T06:31:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10002.787758 secs 2023-05-08T06:31:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10003.344901 secs 2023-05-08T06:31:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10004.625954 secs 2023-05-08T06:31:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:05 smithi133 ceph-mon[125939]: pgmap v5393: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 204 KiB/s wr, 26 op/s 2023-05-08T06:31:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10004.625954 secs 2023-05-08T06:31:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:05 smithi096 ceph-mon[124666]: pgmap v5393: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 204 KiB/s wr, 26 op/s 2023-05-08T06:31:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10004.625954 secs 2023-05-08T06:31:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:05 smithi186 ceph-mon[126480]: pgmap v5393: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 204 KiB/s wr, 26 op/s 2023-05-08T06:31:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:06 smithi133 ceph-mon[125939]: osdmap e414: 12 total, 12 up, 12 in 2023-05-08T06:31:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:06 smithi096 ceph-mon[124666]: osdmap e414: 12 total, 12 up, 12 in 2023-05-08T06:31:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:06 smithi186 ceph-mon[126480]: osdmap e414: 12 total, 12 up, 12 in 2023-05-08T06:31:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:07 smithi133 ceph-mon[125939]: pgmap v5395: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 156 KiB/s wr, 26 op/s 2023-05-08T06:31:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:07 smithi096 ceph-mon[124666]: pgmap v5395: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 156 KiB/s wr, 26 op/s 2023-05-08T06:31:07.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:07 smithi186 ceph-mon[126480]: pgmap v5395: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 156 KiB/s wr, 26 op/s 2023-05-08T06:31:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10007.787853 secs 2023-05-08T06:31:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10007.787853 secs 2023-05-08T06:31:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10007.787853 secs 2023-05-08T06:31:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10008.345056 secs 2023-05-08T06:31:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:09 smithi186 ceph-mon[126480]: pgmap v5396: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 156 KiB/s wr, 26 op/s 2023-05-08T06:31:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10008.345056 secs 2023-05-08T06:31:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:09 smithi133 ceph-mon[125939]: pgmap v5396: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 156 KiB/s wr, 26 op/s 2023-05-08T06:31:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10008.345056 secs 2023-05-08T06:31:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:09 smithi096 ceph-mon[124666]: pgmap v5396: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 156 KiB/s wr, 26 op/s 2023-05-08T06:31:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10009.626091 secs 2023-05-08T06:31:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:11 smithi096 ceph-mon[124666]: pgmap v5397: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 114 KiB/s wr, 26 op/s 2023-05-08T06:31:11.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10009.626091 secs 2023-05-08T06:31:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:11 smithi186 ceph-mon[126480]: pgmap v5397: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 114 KiB/s wr, 26 op/s 2023-05-08T06:31:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10009.626091 secs 2023-05-08T06:31:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:11 smithi133 ceph-mon[125939]: pgmap v5397: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 114 KiB/s wr, 26 op/s 2023-05-08T06:31:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:14 smithi186 ceph-mon[126480]: pgmap v5398: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 114 KiB/s wr, 26 op/s 2023-05-08T06:31:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10012.787951 secs 2023-05-08T06:31:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10013.345184 secs 2023-05-08T06:31:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:14 smithi133 ceph-mon[125939]: pgmap v5398: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 114 KiB/s wr, 26 op/s 2023-05-08T06:31:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10012.787951 secs 2023-05-08T06:31:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10013.345184 secs 2023-05-08T06:31:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:14 smithi096 ceph-mon[124666]: pgmap v5398: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 114 KiB/s wr, 26 op/s 2023-05-08T06:31:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10012.787951 secs 2023-05-08T06:31:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10013.345184 secs 2023-05-08T06:31:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10014.626189 secs 2023-05-08T06:31:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:16 smithi186 ceph-mon[126480]: pgmap v5399: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 8 op/s 2023-05-08T06:31:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:16 smithi186 ceph-mon[126480]: osdmap e415: 12 total, 12 up, 12 in 2023-05-08T06:31:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10014.626189 secs 2023-05-08T06:31:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:16 smithi133 ceph-mon[125939]: pgmap v5399: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 8 op/s 2023-05-08T06:31:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:16 smithi133 ceph-mon[125939]: osdmap e415: 12 total, 12 up, 12 in 2023-05-08T06:31:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10014.626189 secs 2023-05-08T06:31:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:16 smithi096 ceph-mon[124666]: pgmap v5399: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 8 op/s 2023-05-08T06:31:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:16 smithi096 ceph-mon[124666]: osdmap e415: 12 total, 12 up, 12 in 2023-05-08T06:31:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:18 smithi186 ceph-mon[126480]: pgmap v5401: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 8 op/s 2023-05-08T06:31:18.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:18 smithi133 ceph-mon[125939]: pgmap v5401: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 8 op/s 2023-05-08T06:31:18.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:18 smithi096 ceph-mon[124666]: pgmap v5401: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 8 op/s 2023-05-08T06:31:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10017.788054 secs 2023-05-08T06:31:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10018.345305 secs 2023-05-08T06:31:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10017.788054 secs 2023-05-08T06:31:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10018.345305 secs 2023-05-08T06:31:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10017.788054 secs 2023-05-08T06:31:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10018.345305 secs 2023-05-08T06:31:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:20 smithi186 ceph-mon[126480]: pgmap v5402: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 8 op/s 2023-05-08T06:31:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:20 smithi133 ceph-mon[125939]: pgmap v5402: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 8 op/s 2023-05-08T06:31:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:20 smithi096 ceph-mon[124666]: pgmap v5402: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 8 op/s 2023-05-08T06:31:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10019.626306 secs 2023-05-08T06:31:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:21 smithi096 ceph-mon[124666]: pgmap v5403: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 8 op/s 2023-05-08T06:31:21.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10019.626306 secs 2023-05-08T06:31:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:21 smithi186 ceph-mon[126480]: pgmap v5403: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 8 op/s 2023-05-08T06:31:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10019.626306 secs 2023-05-08T06:31:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:21 smithi133 ceph-mon[125939]: pgmap v5403: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 8 op/s 2023-05-08T06:31:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:24 smithi186 ceph-mon[126480]: pgmap v5404: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 8 op/s 2023-05-08T06:31:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10022.788187 secs 2023-05-08T06:31:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10023.345426 secs 2023-05-08T06:31:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:24 smithi133 ceph-mon[125939]: pgmap v5404: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 8 op/s 2023-05-08T06:31:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10022.788187 secs 2023-05-08T06:31:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10023.345426 secs 2023-05-08T06:31:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:24 smithi096 ceph-mon[124666]: pgmap v5404: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 8 op/s 2023-05-08T06:31:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10022.788187 secs 2023-05-08T06:31:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10023.345426 secs 2023-05-08T06:31:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10024.626404 secs 2023-05-08T06:31:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:26 smithi186 ceph-mon[126480]: pgmap v5405: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 42 KiB/s wr, 8 op/s 2023-05-08T06:31:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10024.626404 secs 2023-05-08T06:31:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:26 smithi133 ceph-mon[125939]: pgmap v5405: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 42 KiB/s wr, 8 op/s 2023-05-08T06:31:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10024.626404 secs 2023-05-08T06:31:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:26 smithi096 ceph-mon[124666]: pgmap v5405: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 42 KiB/s wr, 8 op/s 2023-05-08T06:31:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:28 smithi186 ceph-mon[126480]: pgmap v5406: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 7 op/s 2023-05-08T06:31:28.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:28 smithi133 ceph-mon[125939]: pgmap v5406: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 7 op/s 2023-05-08T06:31:28.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:28 smithi096 ceph-mon[124666]: pgmap v5406: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 7 op/s 2023-05-08T06:31:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10027.788305 secs 2023-05-08T06:31:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10028.345575 secs 2023-05-08T06:31:29.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10027.788305 secs 2023-05-08T06:31:29.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10028.345575 secs 2023-05-08T06:31:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10027.788305 secs 2023-05-08T06:31:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10028.345575 secs 2023-05-08T06:31:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:30 smithi186 ceph-mon[126480]: pgmap v5407: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 7 op/s 2023-05-08T06:31:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:30 smithi133 ceph-mon[125939]: pgmap v5407: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 7 op/s 2023-05-08T06:31:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:30 smithi096 ceph-mon[124666]: pgmap v5407: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 7 op/s 2023-05-08T06:31:31.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10029.626527 secs 2023-05-08T06:31:31.509 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:31 smithi096 ceph-mon[124666]: pgmap v5408: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 77 KiB/s wr, 10 op/s 2023-05-08T06:31:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10029.626527 secs 2023-05-08T06:31:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:31 smithi186 ceph-mon[126480]: pgmap v5408: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 77 KiB/s wr, 10 op/s 2023-05-08T06:31:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10029.626527 secs 2023-05-08T06:31:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:31 smithi133 ceph-mon[125939]: pgmap v5408: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 77 KiB/s wr, 10 op/s 2023-05-08T06:31:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:34 smithi186 ceph-mon[126480]: pgmap v5409: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 76 KiB/s wr, 7 op/s 2023-05-08T06:31:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10032.788441 secs 2023-05-08T06:31:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10033.345692 secs 2023-05-08T06:31:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:34 smithi133 ceph-mon[125939]: pgmap v5409: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 76 KiB/s wr, 7 op/s 2023-05-08T06:31:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10032.788441 secs 2023-05-08T06:31:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10033.345692 secs 2023-05-08T06:31:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:34 smithi096 ceph-mon[124666]: pgmap v5409: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 76 KiB/s wr, 7 op/s 2023-05-08T06:31:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10032.788441 secs 2023-05-08T06:31:34.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10033.345692 secs 2023-05-08T06:31:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10034.626653 secs 2023-05-08T06:31:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:36 smithi186 ceph-mon[126480]: pgmap v5410: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 102 KiB/s wr, 10 op/s 2023-05-08T06:31:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10034.626653 secs 2023-05-08T06:31:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:36 smithi133 ceph-mon[125939]: pgmap v5410: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 102 KiB/s wr, 10 op/s 2023-05-08T06:31:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10034.626653 secs 2023-05-08T06:31:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:36 smithi096 ceph-mon[124666]: pgmap v5410: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 102 KiB/s wr, 10 op/s 2023-05-08T06:31:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:38 smithi186 ceph-mon[126480]: pgmap v5411: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 68 KiB/s wr, 6 op/s 2023-05-08T06:31:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:38 smithi133 ceph-mon[125939]: pgmap v5411: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 68 KiB/s wr, 6 op/s 2023-05-08T06:31:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:38 smithi096 ceph-mon[124666]: pgmap v5411: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 68 KiB/s wr, 6 op/s 2023-05-08T06:31:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10037.788560 secs 2023-05-08T06:31:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10037.788560 secs 2023-05-08T06:31:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10037.788560 secs 2023-05-08T06:31:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:40 smithi186 ceph-mon[126480]: pgmap v5412: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 68 KiB/s wr, 6 op/s 2023-05-08T06:31:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:40 smithi133 ceph-mon[125939]: pgmap v5412: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 68 KiB/s wr, 6 op/s 2023-05-08T06:31:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:40 smithi096 ceph-mon[124666]: pgmap v5412: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 68 KiB/s wr, 6 op/s 2023-05-08T06:31:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10039.626772 secs 2023-05-08T06:31:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:41 smithi096 ceph-mon[124666]: pgmap v5413: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 92 KiB/s wr, 10 op/s 2023-05-08T06:31:41.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10039.626772 secs 2023-05-08T06:31:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:41 smithi186 ceph-mon[126480]: pgmap v5413: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 92 KiB/s wr, 10 op/s 2023-05-08T06:31:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10039.626772 secs 2023-05-08T06:31:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:41 smithi133 ceph-mon[125939]: pgmap v5413: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 92 KiB/s wr, 10 op/s 2023-05-08T06:31:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:31:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:42 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:31:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:31:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:42 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:31:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:31:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:42 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:31:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:31:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:31:43.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:43 smithi133 ceph-mon[125939]: pgmap v5414: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 50 KiB/s wr, 7 op/s 2023-05-08T06:31:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:31:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:31:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:43 smithi096 ceph-mon[124666]: pgmap v5414: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 50 KiB/s wr, 7 op/s 2023-05-08T06:31:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:31:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:31:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:43 smithi186 ceph-mon[126480]: pgmap v5414: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 50 KiB/s wr, 7 op/s 2023-05-08T06:31:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10042.788674 secs 2023-05-08T06:31:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10042.788674 secs 2023-05-08T06:31:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10042.788674 secs 2023-05-08T06:31:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:45 smithi133 ceph-mon[125939]: pgmap v5415: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 117 KiB/s wr, 12 op/s 2023-05-08T06:31:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:45 smithi096 ceph-mon[124666]: pgmap v5415: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 117 KiB/s wr, 12 op/s 2023-05-08T06:31:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:45 smithi186 ceph-mon[126480]: pgmap v5415: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 117 KiB/s wr, 12 op/s 2023-05-08T06:31:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:46 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:31:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:46 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:31:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:46 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:31:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:47 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:31:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:47 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:31:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:47 smithi133 ceph-mon[125939]: pgmap v5416: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 90 KiB/s wr, 9 op/s 2023-05-08T06:31:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:47 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:31:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:47 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:31:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:47 smithi096 ceph-mon[124666]: pgmap v5416: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 90 KiB/s wr, 9 op/s 2023-05-08T06:31:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:47 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:31:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:47 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:31:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:47 smithi186 ceph-mon[126480]: pgmap v5416: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 90 KiB/s wr, 9 op/s 2023-05-08T06:31:48.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10047.788793 secs 2023-05-08T06:31:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10047.788793 secs 2023-05-08T06:31:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10047.788793 secs 2023-05-08T06:31:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10048.346096 secs 2023-05-08T06:31:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:49 smithi186 ceph-mon[126480]: pgmap v5417: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 90 KiB/s wr, 9 op/s 2023-05-08T06:31:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10048.346096 secs 2023-05-08T06:31:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:49 smithi133 ceph-mon[125939]: pgmap v5417: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 90 KiB/s wr, 9 op/s 2023-05-08T06:31:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10048.346096 secs 2023-05-08T06:31:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:49 smithi096 ceph-mon[124666]: pgmap v5417: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 90 KiB/s wr, 9 op/s 2023-05-08T06:31:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:50 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:31:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:50 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:31:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:50 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:31:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:51 smithi186 ceph-mon[126480]: pgmap v5418: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 114 KiB/s wr, 13 op/s 2023-05-08T06:31:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:31:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:31:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:51 smithi133 ceph-mon[125939]: pgmap v5418: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 114 KiB/s wr, 13 op/s 2023-05-08T06:31:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:31:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:31:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:51 smithi096 ceph-mon[124666]: pgmap v5418: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 114 KiB/s wr, 13 op/s 2023-05-08T06:31:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:31:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:31:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:54 smithi186 ceph-mon[126480]: pgmap v5419: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 90 KiB/s wr, 9 op/s 2023-05-08T06:31:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10052.788909 secs 2023-05-08T06:31:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10053.346224 secs 2023-05-08T06:31:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:54 smithi133 ceph-mon[125939]: pgmap v5419: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 90 KiB/s wr, 9 op/s 2023-05-08T06:31:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10052.788909 secs 2023-05-08T06:31:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10053.346224 secs 2023-05-08T06:31:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:54 smithi096 ceph-mon[124666]: pgmap v5419: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 90 KiB/s wr, 9 op/s 2023-05-08T06:31:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10052.788909 secs 2023-05-08T06:31:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10053.346224 secs 2023-05-08T06:31:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:56 smithi186 ceph-mon[126480]: pgmap v5420: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 150 KiB/s wr, 13 op/s 2023-05-08T06:31:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:31:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:56 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:31:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:31:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:31:56.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:31:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:56 smithi133 ceph-mon[125939]: pgmap v5420: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 150 KiB/s wr, 13 op/s 2023-05-08T06:31:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:31:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:56 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:31:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:31:56.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:31:56.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:31:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:56 smithi096 ceph-mon[124666]: pgmap v5420: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 150 KiB/s wr, 13 op/s 2023-05-08T06:31:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:31:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:56 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:31:56.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:31:56.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:31:56.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:31:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:57 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:31:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:57 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T06:31:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:57 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T06:31:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:57 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:31:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:57 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:31:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:57 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T06:31:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:57 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T06:31:57.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:57 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:31:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:57 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:31:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:57 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T06:31:57.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:57 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T06:31:57.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:57 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:31:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:58 smithi186 ceph-mon[126480]: pgmap v5421: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 84 KiB/s wr, 8 op/s 2023-05-08T06:31:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:58 smithi133 ceph-mon[125939]: pgmap v5421: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 84 KiB/s wr, 8 op/s 2023-05-08T06:31:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:58 smithi096 ceph-mon[124666]: pgmap v5421: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 84 KiB/s wr, 8 op/s 2023-05-08T06:31:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10057.788965 secs 2023-05-08T06:31:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:31:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10058.346363 secs 2023-05-08T06:31:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10057.788965 secs 2023-05-08T06:31:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:31:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10058.346363 secs 2023-05-08T06:31:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10057.788965 secs 2023-05-08T06:31:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:31:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10058.346363 secs 2023-05-08T06:32:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:00 smithi186 ceph-mon[126480]: pgmap v5422: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 84 KiB/s wr, 8 op/s 2023-05-08T06:32:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:00 smithi133 ceph-mon[125939]: pgmap v5422: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 84 KiB/s wr, 8 op/s 2023-05-08T06:32:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:00 smithi096 ceph-mon[124666]: pgmap v5422: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 84 KiB/s wr, 8 op/s 2023-05-08T06:32:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10059.627316 secs 2023-05-08T06:32:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:01 smithi096 ceph-mon[124666]: pgmap v5423: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 108 KiB/s wr, 12 op/s 2023-05-08T06:32:01.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10059.627316 secs 2023-05-08T06:32:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:01 smithi186 ceph-mon[126480]: pgmap v5423: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 108 KiB/s wr, 12 op/s 2023-05-08T06:32:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10059.627316 secs 2023-05-08T06:32:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:01 smithi133 ceph-mon[125939]: pgmap v5423: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 108 KiB/s wr, 12 op/s 2023-05-08T06:32:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:02 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:32:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:32:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:32:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:02 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:32:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:32:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:32:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:02 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:32:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:32:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:32:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:03 smithi133 ceph-mon[125939]: pgmap v5424: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 84 KiB/s wr, 8 op/s 2023-05-08T06:32:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:03 smithi096 ceph-mon[124666]: pgmap v5424: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 84 KiB/s wr, 8 op/s 2023-05-08T06:32:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:03 smithi186 ceph-mon[126480]: pgmap v5424: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 84 KiB/s wr, 8 op/s 2023-05-08T06:32:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10062.789082 secs 2023-05-08T06:32:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10063.346507 secs 2023-05-08T06:32:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10062.789082 secs 2023-05-08T06:32:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10063.346507 secs 2023-05-08T06:32:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10062.789082 secs 2023-05-08T06:32:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10063.346507 secs 2023-05-08T06:32:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10064.627457 secs 2023-05-08T06:32:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:05 smithi133 ceph-mon[125939]: pgmap v5425: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 170 KiB/s wr, 26 op/s 2023-05-08T06:32:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10064.627457 secs 2023-05-08T06:32:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:05 smithi096 ceph-mon[124666]: pgmap v5425: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 170 KiB/s wr, 26 op/s 2023-05-08T06:32:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10064.627457 secs 2023-05-08T06:32:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:05 smithi186 ceph-mon[126480]: pgmap v5425: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 170 KiB/s wr, 26 op/s 2023-05-08T06:32:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:06 smithi133 ceph-mon[125939]: osdmap e416: 12 total, 12 up, 12 in 2023-05-08T06:32:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:06 smithi096 ceph-mon[124666]: osdmap e416: 12 total, 12 up, 12 in 2023-05-08T06:32:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:06 smithi186 ceph-mon[126480]: osdmap e416: 12 total, 12 up, 12 in 2023-05-08T06:32:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:07 smithi133 ceph-mon[125939]: pgmap v5427: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 132 KiB/s wr, 26 op/s 2023-05-08T06:32:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:07 smithi096 ceph-mon[124666]: pgmap v5427: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 132 KiB/s wr, 26 op/s 2023-05-08T06:32:07.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:07 smithi186 ceph-mon[126480]: pgmap v5427: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 132 KiB/s wr, 26 op/s 2023-05-08T06:32:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10067.789213 secs 2023-05-08T06:32:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10067.789213 secs 2023-05-08T06:32:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10067.789213 secs 2023-05-08T06:32:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10068.346538 secs 2023-05-08T06:32:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:09 smithi186 ceph-mon[126480]: pgmap v5428: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 132 KiB/s wr, 26 op/s 2023-05-08T06:32:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10068.346538 secs 2023-05-08T06:32:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:09 smithi133 ceph-mon[125939]: pgmap v5428: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 132 KiB/s wr, 26 op/s 2023-05-08T06:32:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10068.346538 secs 2023-05-08T06:32:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:09 smithi096 ceph-mon[124666]: pgmap v5428: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 132 KiB/s wr, 26 op/s 2023-05-08T06:32:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10069.627729 secs 2023-05-08T06:32:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:11 smithi096 ceph-mon[124666]: pgmap v5429: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 128 KiB/s wr, 25 op/s 2023-05-08T06:32:11.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10069.627729 secs 2023-05-08T06:32:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:11 smithi186 ceph-mon[126480]: pgmap v5429: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 128 KiB/s wr, 25 op/s 2023-05-08T06:32:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10069.627729 secs 2023-05-08T06:32:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:11 smithi133 ceph-mon[125939]: pgmap v5429: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 128 KiB/s wr, 25 op/s 2023-05-08T06:32:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:14 smithi186 ceph-mon[126480]: pgmap v5430: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 128 KiB/s wr, 25 op/s 2023-05-08T06:32:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10072.789344 secs 2023-05-08T06:32:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10073.346652 secs 2023-05-08T06:32:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:14 smithi133 ceph-mon[125939]: pgmap v5430: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 128 KiB/s wr, 25 op/s 2023-05-08T06:32:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10072.789344 secs 2023-05-08T06:32:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10073.346652 secs 2023-05-08T06:32:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:14 smithi096 ceph-mon[124666]: pgmap v5430: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 128 KiB/s wr, 25 op/s 2023-05-08T06:32:14.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10072.789344 secs 2023-05-08T06:32:14.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10073.346652 secs 2023-05-08T06:32:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10074.627836 secs 2023-05-08T06:32:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:16 smithi186 ceph-mon[126480]: pgmap v5431: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 46 KiB/s wr, 8 op/s 2023-05-08T06:32:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:16 smithi186 ceph-mon[126480]: osdmap e417: 12 total, 12 up, 12 in 2023-05-08T06:32:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10074.627836 secs 2023-05-08T06:32:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:16 smithi133 ceph-mon[125939]: pgmap v5431: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 46 KiB/s wr, 8 op/s 2023-05-08T06:32:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:16 smithi133 ceph-mon[125939]: osdmap e417: 12 total, 12 up, 12 in 2023-05-08T06:32:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10074.627836 secs 2023-05-08T06:32:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:16 smithi096 ceph-mon[124666]: pgmap v5431: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 46 KiB/s wr, 8 op/s 2023-05-08T06:32:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:16 smithi096 ceph-mon[124666]: osdmap e417: 12 total, 12 up, 12 in 2023-05-08T06:32:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:18 smithi186 ceph-mon[126480]: pgmap v5433: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 46 KiB/s wr, 8 op/s 2023-05-08T06:32:18.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:18 smithi133 ceph-mon[125939]: pgmap v5433: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 46 KiB/s wr, 8 op/s 2023-05-08T06:32:18.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:18 smithi096 ceph-mon[124666]: pgmap v5433: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 46 KiB/s wr, 8 op/s 2023-05-08T06:32:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10077.789431 secs 2023-05-08T06:32:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10078.346773 secs 2023-05-08T06:32:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10077.789431 secs 2023-05-08T06:32:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10078.346773 secs 2023-05-08T06:32:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10077.789431 secs 2023-05-08T06:32:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10078.346773 secs 2023-05-08T06:32:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:20 smithi186 ceph-mon[126480]: pgmap v5434: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 46 KiB/s wr, 8 op/s 2023-05-08T06:32:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:20 smithi133 ceph-mon[125939]: pgmap v5434: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 46 KiB/s wr, 8 op/s 2023-05-08T06:32:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:20 smithi096 ceph-mon[124666]: pgmap v5434: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 46 KiB/s wr, 8 op/s 2023-05-08T06:32:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10079.627965 secs 2023-05-08T06:32:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:21 smithi186 ceph-mon[126480]: pgmap v5435: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 22 KiB/s wr, 8 op/s 2023-05-08T06:32:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10079.627965 secs 2023-05-08T06:32:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:21 smithi133 ceph-mon[125939]: pgmap v5435: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 22 KiB/s wr, 8 op/s 2023-05-08T06:32:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10079.627965 secs 2023-05-08T06:32:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:21 smithi096 ceph-mon[124666]: pgmap v5435: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 22 KiB/s wr, 8 op/s 2023-05-08T06:32:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:24 smithi186 ceph-mon[126480]: pgmap v5436: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 22 KiB/s wr, 8 op/s 2023-05-08T06:32:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10082.789552 secs 2023-05-08T06:32:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10083.346874 secs 2023-05-08T06:32:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:24 smithi133 ceph-mon[125939]: pgmap v5436: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 22 KiB/s wr, 8 op/s 2023-05-08T06:32:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10082.789552 secs 2023-05-08T06:32:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10083.346874 secs 2023-05-08T06:32:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:24 smithi096 ceph-mon[124666]: pgmap v5436: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 22 KiB/s wr, 8 op/s 2023-05-08T06:32:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10082.789552 secs 2023-05-08T06:32:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10083.346874 secs 2023-05-08T06:32:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10084.628092 secs 2023-05-08T06:32:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:26 smithi186 ceph-mon[126480]: pgmap v5437: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 40 KiB/s wr, 8 op/s 2023-05-08T06:32:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10084.628092 secs 2023-05-08T06:32:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:26 smithi133 ceph-mon[125939]: pgmap v5437: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 40 KiB/s wr, 8 op/s 2023-05-08T06:32:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10084.628092 secs 2023-05-08T06:32:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:26 smithi096 ceph-mon[124666]: pgmap v5437: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 40 KiB/s wr, 8 op/s 2023-05-08T06:32:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:28 smithi186 ceph-mon[126480]: pgmap v5438: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 34 KiB/s wr, 7 op/s 2023-05-08T06:32:28.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:28 smithi133 ceph-mon[125939]: pgmap v5438: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 34 KiB/s wr, 7 op/s 2023-05-08T06:32:28.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:28 smithi096 ceph-mon[124666]: pgmap v5438: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 34 KiB/s wr, 7 op/s 2023-05-08T06:32:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10087.789644 secs 2023-05-08T06:32:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10088.346991 secs 2023-05-08T06:32:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10087.789644 secs 2023-05-08T06:32:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10088.346991 secs 2023-05-08T06:32:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10087.789644 secs 2023-05-08T06:32:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10088.346991 secs 2023-05-08T06:32:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:30 smithi186 ceph-mon[126480]: pgmap v5439: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T06:32:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:30 smithi133 ceph-mon[125939]: pgmap v5439: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T06:32:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:30 smithi096 ceph-mon[124666]: pgmap v5439: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T06:32:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10089.628240 secs 2023-05-08T06:32:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:31 smithi186 ceph-mon[126480]: pgmap v5440: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 76 KiB/s wr, 11 op/s 2023-05-08T06:32:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10089.628240 secs 2023-05-08T06:32:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:31 smithi133 ceph-mon[125939]: pgmap v5440: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 76 KiB/s wr, 11 op/s 2023-05-08T06:32:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10089.628240 secs 2023-05-08T06:32:31.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:31 smithi096 ceph-mon[124666]: pgmap v5440: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 76 KiB/s wr, 11 op/s 2023-05-08T06:32:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:34 smithi186 ceph-mon[126480]: pgmap v5441: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 75 KiB/s wr, 7 op/s 2023-05-08T06:32:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10092.789760 secs 2023-05-08T06:32:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10093.347110 secs 2023-05-08T06:32:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:34 smithi133 ceph-mon[125939]: pgmap v5441: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 75 KiB/s wr, 7 op/s 2023-05-08T06:32:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10092.789760 secs 2023-05-08T06:32:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10093.347110 secs 2023-05-08T06:32:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:34 smithi096 ceph-mon[124666]: pgmap v5441: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 75 KiB/s wr, 7 op/s 2023-05-08T06:32:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10092.789760 secs 2023-05-08T06:32:34.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10093.347110 secs 2023-05-08T06:32:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10094.628379 secs 2023-05-08T06:32:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:36 smithi186 ceph-mon[126480]: pgmap v5442: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 118 KiB/s wr, 10 op/s 2023-05-08T06:32:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10094.628379 secs 2023-05-08T06:32:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:36 smithi133 ceph-mon[125939]: pgmap v5442: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 118 KiB/s wr, 10 op/s 2023-05-08T06:32:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10094.628379 secs 2023-05-08T06:32:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:36 smithi096 ceph-mon[124666]: pgmap v5442: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 118 KiB/s wr, 10 op/s 2023-05-08T06:32:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:38 smithi186 ceph-mon[126480]: pgmap v5443: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 85 KiB/s wr, 7 op/s 2023-05-08T06:32:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:38 smithi133 ceph-mon[125939]: pgmap v5443: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 85 KiB/s wr, 7 op/s 2023-05-08T06:32:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:38 smithi096 ceph-mon[124666]: pgmap v5443: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 85 KiB/s wr, 7 op/s 2023-05-08T06:32:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10097.789880 secs 2023-05-08T06:32:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10097.789880 secs 2023-05-08T06:32:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10097.789880 secs 2023-05-08T06:32:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:40 smithi186 ceph-mon[126480]: pgmap v5444: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 85 KiB/s wr, 7 op/s 2023-05-08T06:32:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:40 smithi133 ceph-mon[125939]: pgmap v5444: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 85 KiB/s wr, 7 op/s 2023-05-08T06:32:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:40 smithi096 ceph-mon[124666]: pgmap v5444: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 85 KiB/s wr, 7 op/s 2023-05-08T06:32:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10099.628538 secs 2023-05-08T06:32:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:41 smithi186 ceph-mon[126480]: pgmap v5445: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 126 KiB/s wr, 10 op/s 2023-05-08T06:32:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10099.628538 secs 2023-05-08T06:32:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:41 smithi133 ceph-mon[125939]: pgmap v5445: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 126 KiB/s wr, 10 op/s 2023-05-08T06:32:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10099.628538 secs 2023-05-08T06:32:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:41 smithi096 ceph-mon[124666]: pgmap v5445: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 126 KiB/s wr, 10 op/s 2023-05-08T06:32:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:32:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:32:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:32:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:43 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:32:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:32:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:32:43.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:43 smithi133 ceph-mon[125939]: pgmap v5446: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 84 KiB/s wr, 6 op/s 2023-05-08T06:32:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:43 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:32:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:32:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:32:43.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:43 smithi096 ceph-mon[124666]: pgmap v5446: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 84 KiB/s wr, 6 op/s 2023-05-08T06:32:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:43 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:32:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:32:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:32:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:43 smithi186 ceph-mon[126480]: pgmap v5446: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 84 KiB/s wr, 6 op/s 2023-05-08T06:32:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10102.789996 secs 2023-05-08T06:32:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10102.789996 secs 2023-05-08T06:32:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10102.789996 secs 2023-05-08T06:32:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:45 smithi133 ceph-mon[125939]: pgmap v5447: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 161 KiB/s wr, 12 op/s 2023-05-08T06:32:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:45 smithi096 ceph-mon[124666]: pgmap v5447: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 161 KiB/s wr, 12 op/s 2023-05-08T06:32:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:45 smithi186 ceph-mon[126480]: pgmap v5447: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 161 KiB/s wr, 12 op/s 2023-05-08T06:32:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:46 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:32:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:46 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:32:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:46 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:32:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:47 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:32:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:47 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:32:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:47 smithi133 ceph-mon[125939]: pgmap v5448: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 119 KiB/s wr, 9 op/s 2023-05-08T06:32:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:47 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:32:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:47 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:32:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:47 smithi096 ceph-mon[124666]: pgmap v5448: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 119 KiB/s wr, 9 op/s 2023-05-08T06:32:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:47 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:32:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:47 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:32:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:47 smithi186 ceph-mon[126480]: pgmap v5448: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 119 KiB/s wr, 9 op/s 2023-05-08T06:32:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10107.790115 secs 2023-05-08T06:32:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10107.790115 secs 2023-05-08T06:32:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10107.790115 secs 2023-05-08T06:32:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10108.347457 secs 2023-05-08T06:32:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:49 smithi186 ceph-mon[126480]: pgmap v5449: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 119 KiB/s wr, 9 op/s 2023-05-08T06:32:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10108.347457 secs 2023-05-08T06:32:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:49 smithi133 ceph-mon[125939]: pgmap v5449: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 119 KiB/s wr, 9 op/s 2023-05-08T06:32:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10108.347457 secs 2023-05-08T06:32:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:49 smithi096 ceph-mon[124666]: pgmap v5449: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 119 KiB/s wr, 9 op/s 2023-05-08T06:32:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:50 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:32:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:50 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:32:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:50 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:32:51.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:51 smithi186 ceph-mon[126480]: pgmap v5450: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 128 KiB/s wr, 13 op/s 2023-05-08T06:32:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:32:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:32:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:51 smithi133 ceph-mon[125939]: pgmap v5450: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 128 KiB/s wr, 13 op/s 2023-05-08T06:32:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:32:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:32:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:51 smithi096 ceph-mon[124666]: pgmap v5450: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 128 KiB/s wr, 13 op/s 2023-05-08T06:32:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:32:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:32:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10112.790250 secs 2023-05-08T06:32:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:54 smithi186 ceph-mon[126480]: pgmap v5451: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 86 KiB/s wr, 9 op/s 2023-05-08T06:32:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10113.347577 secs 2023-05-08T06:32:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10112.790250 secs 2023-05-08T06:32:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:54 smithi133 ceph-mon[125939]: pgmap v5451: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 86 KiB/s wr, 9 op/s 2023-05-08T06:32:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10113.347577 secs 2023-05-08T06:32:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10112.790250 secs 2023-05-08T06:32:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:54 smithi096 ceph-mon[124666]: pgmap v5451: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 86 KiB/s wr, 9 op/s 2023-05-08T06:32:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10113.347577 secs 2023-05-08T06:32:56.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:56 smithi186 ceph-mon[126480]: pgmap v5452: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 162 KiB/s wr, 13 op/s 2023-05-08T06:32:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:56 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:32:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:32:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:56 smithi133 ceph-mon[125939]: pgmap v5452: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 162 KiB/s wr, 13 op/s 2023-05-08T06:32:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:56 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:32:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:32:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:56 smithi096 ceph-mon[124666]: pgmap v5452: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 162 KiB/s wr, 13 op/s 2023-05-08T06:32:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:56 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:32:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:32:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:32:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:32:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:32:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:32:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:32:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:32:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:32:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:32:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:32:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:58 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:32:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:58 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T06:32:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:58 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T06:32:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:58 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:32:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:58 smithi186 ceph-mon[126480]: pgmap v5453: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 85 KiB/s wr, 8 op/s 2023-05-08T06:32:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:58 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:32:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:58 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T06:32:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:58 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T06:32:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:58 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:32:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:58 smithi133 ceph-mon[125939]: pgmap v5453: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 85 KiB/s wr, 8 op/s 2023-05-08T06:32:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:58 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:32:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:58 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T06:32:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:58 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T06:32:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:58 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:32:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:58 smithi096 ceph-mon[124666]: pgmap v5453: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 85 KiB/s wr, 8 op/s 2023-05-08T06:32:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10117.790374 secs 2023-05-08T06:32:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:32:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10118.347665 secs 2023-05-08T06:32:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10117.790374 secs 2023-05-08T06:32:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:32:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10118.347665 secs 2023-05-08T06:32:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10117.790374 secs 2023-05-08T06:32:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:32:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10118.347665 secs 2023-05-08T06:33:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:00 smithi133 ceph-mon[125939]: pgmap v5454: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 89 KiB/s wr, 10 op/s 2023-05-08T06:33:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:00 smithi096 ceph-mon[124666]: pgmap v5454: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 89 KiB/s wr, 10 op/s 2023-05-08T06:33:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:00 smithi186 ceph-mon[126480]: pgmap v5454: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 89 KiB/s wr, 10 op/s 2023-05-08T06:33:01.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10119.629075 secs 2023-05-08T06:33:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:01 smithi186 ceph-mon[126480]: pgmap v5455: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 94 KiB/s wr, 12 op/s 2023-05-08T06:33:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10119.629075 secs 2023-05-08T06:33:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:01 smithi133 ceph-mon[125939]: pgmap v5455: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 94 KiB/s wr, 12 op/s 2023-05-08T06:33:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10119.629075 secs 2023-05-08T06:33:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:01 smithi096 ceph-mon[124666]: pgmap v5455: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 94 KiB/s wr, 12 op/s 2023-05-08T06:33:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:02 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:33:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:33:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:33:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:02 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:33:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:33:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:33:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:02 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:33:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:33:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:33:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:03 smithi133 ceph-mon[125939]: pgmap v5456: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 85 KiB/s wr, 8 op/s 2023-05-08T06:33:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:03 smithi096 ceph-mon[124666]: pgmap v5456: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 85 KiB/s wr, 8 op/s 2023-05-08T06:33:03.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:03 smithi186 ceph-mon[126480]: pgmap v5456: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 85 KiB/s wr, 8 op/s 2023-05-08T06:33:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10122.790450 secs 2023-05-08T06:33:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10123.347783 secs 2023-05-08T06:33:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10122.790450 secs 2023-05-08T06:33:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10123.347783 secs 2023-05-08T06:33:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10122.790450 secs 2023-05-08T06:33:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10123.347783 secs 2023-05-08T06:33:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10124.629212 secs 2023-05-08T06:33:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:05 smithi133 ceph-mon[125939]: pgmap v5457: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 217 KiB/s wr, 26 op/s 2023-05-08T06:33:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10124.629212 secs 2023-05-08T06:33:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:05 smithi096 ceph-mon[124666]: pgmap v5457: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 217 KiB/s wr, 26 op/s 2023-05-08T06:33:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10124.629212 secs 2023-05-08T06:33:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:05 smithi186 ceph-mon[126480]: pgmap v5457: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 217 KiB/s wr, 26 op/s 2023-05-08T06:33:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:06 smithi133 ceph-mon[125939]: osdmap e418: 12 total, 12 up, 12 in 2023-05-08T06:33:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:06 smithi096 ceph-mon[124666]: osdmap e418: 12 total, 12 up, 12 in 2023-05-08T06:33:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:06 smithi186 ceph-mon[126480]: osdmap e418: 12 total, 12 up, 12 in 2023-05-08T06:33:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:07 smithi133 ceph-mon[125939]: pgmap v5459: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 169 KiB/s wr, 26 op/s 2023-05-08T06:33:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:07 smithi096 ceph-mon[124666]: pgmap v5459: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 169 KiB/s wr, 26 op/s 2023-05-08T06:33:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:07 smithi186 ceph-mon[126480]: pgmap v5459: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 169 KiB/s wr, 26 op/s 2023-05-08T06:33:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10127.790528 secs 2023-05-08T06:33:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10127.790528 secs 2023-05-08T06:33:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10127.790528 secs 2023-05-08T06:33:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10128.347899 secs 2023-05-08T06:33:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:09 smithi186 ceph-mon[126480]: pgmap v5460: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 164 KiB/s wr, 26 op/s 2023-05-08T06:33:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10128.347899 secs 2023-05-08T06:33:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:09 smithi133 ceph-mon[125939]: pgmap v5460: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 164 KiB/s wr, 26 op/s 2023-05-08T06:33:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10128.347899 secs 2023-05-08T06:33:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:09 smithi096 ceph-mon[124666]: pgmap v5460: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 164 KiB/s wr, 26 op/s 2023-05-08T06:33:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10129.629367 secs 2023-05-08T06:33:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:11 smithi186 ceph-mon[126480]: pgmap v5461: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 164 KiB/s wr, 26 op/s 2023-05-08T06:33:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10129.629367 secs 2023-05-08T06:33:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:11 smithi133 ceph-mon[125939]: pgmap v5461: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 164 KiB/s wr, 26 op/s 2023-05-08T06:33:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10129.629367 secs 2023-05-08T06:33:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:11 smithi096 ceph-mon[124666]: pgmap v5461: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 164 KiB/s wr, 26 op/s 2023-05-08T06:33:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10132.790607 secs 2023-05-08T06:33:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:14 smithi186 ceph-mon[126480]: pgmap v5462: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 164 KiB/s wr, 26 op/s 2023-05-08T06:33:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10133.348038 secs 2023-05-08T06:33:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10132.790607 secs 2023-05-08T06:33:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:14 smithi133 ceph-mon[125939]: pgmap v5462: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 164 KiB/s wr, 26 op/s 2023-05-08T06:33:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10133.348038 secs 2023-05-08T06:33:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10132.790607 secs 2023-05-08T06:33:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:14 smithi096 ceph-mon[124666]: pgmap v5462: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 164 KiB/s wr, 26 op/s 2023-05-08T06:33:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10133.348038 secs 2023-05-08T06:33:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10134.629474 secs 2023-05-08T06:33:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:16 smithi186 ceph-mon[126480]: pgmap v5463: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 28 KiB/s wr, 9 op/s 2023-05-08T06:33:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:16 smithi186 ceph-mon[126480]: osdmap e419: 12 total, 12 up, 12 in 2023-05-08T06:33:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10134.629474 secs 2023-05-08T06:33:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:16 smithi133 ceph-mon[125939]: pgmap v5463: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 28 KiB/s wr, 9 op/s 2023-05-08T06:33:16.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:16 smithi133 ceph-mon[125939]: osdmap e419: 12 total, 12 up, 12 in 2023-05-08T06:33:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10134.629474 secs 2023-05-08T06:33:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:16 smithi096 ceph-mon[124666]: pgmap v5463: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 28 KiB/s wr, 9 op/s 2023-05-08T06:33:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:16 smithi096 ceph-mon[124666]: osdmap e419: 12 total, 12 up, 12 in 2023-05-08T06:33:18.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:18 smithi133 ceph-mon[125939]: pgmap v5465: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 27 KiB/s wr, 9 op/s 2023-05-08T06:33:18.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:18 smithi096 ceph-mon[124666]: pgmap v5465: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 27 KiB/s wr, 9 op/s 2023-05-08T06:33:18.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:18 smithi186 ceph-mon[126480]: pgmap v5465: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 27 KiB/s wr, 9 op/s 2023-05-08T06:33:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10137.790693 secs 2023-05-08T06:33:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10138.348183 secs 2023-05-08T06:33:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10137.790693 secs 2023-05-08T06:33:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10138.348183 secs 2023-05-08T06:33:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10137.790693 secs 2023-05-08T06:33:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10138.348183 secs 2023-05-08T06:33:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:20 smithi133 ceph-mon[125939]: pgmap v5466: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 28 KiB/s wr, 8 op/s 2023-05-08T06:33:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:20 smithi096 ceph-mon[124666]: pgmap v5466: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 28 KiB/s wr, 8 op/s 2023-05-08T06:33:20.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:20 smithi186 ceph-mon[126480]: pgmap v5466: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 28 KiB/s wr, 8 op/s 2023-05-08T06:33:21.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10139.629554 secs 2023-05-08T06:33:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:21 smithi186 ceph-mon[126480]: pgmap v5467: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 8 op/s 2023-05-08T06:33:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10139.629554 secs 2023-05-08T06:33:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:21 smithi133 ceph-mon[125939]: pgmap v5467: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 8 op/s 2023-05-08T06:33:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10139.629554 secs 2023-05-08T06:33:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:21 smithi096 ceph-mon[124666]: pgmap v5467: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 8 op/s 2023-05-08T06:33:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10142.790748 secs 2023-05-08T06:33:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:24 smithi186 ceph-mon[126480]: pgmap v5468: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 8 op/s 2023-05-08T06:33:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10143.348307 secs 2023-05-08T06:33:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10142.790748 secs 2023-05-08T06:33:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:24 smithi133 ceph-mon[125939]: pgmap v5468: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 8 op/s 2023-05-08T06:33:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10143.348307 secs 2023-05-08T06:33:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10142.790748 secs 2023-05-08T06:33:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:24 smithi096 ceph-mon[124666]: pgmap v5468: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 8 op/s 2023-05-08T06:33:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10143.348307 secs 2023-05-08T06:33:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10144.629675 secs 2023-05-08T06:33:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:26 smithi133 ceph-mon[125939]: pgmap v5469: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 41 KiB/s wr, 8 op/s 2023-05-08T06:33:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10144.629675 secs 2023-05-08T06:33:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:26 smithi096 ceph-mon[124666]: pgmap v5469: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 41 KiB/s wr, 8 op/s 2023-05-08T06:33:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10144.629675 secs 2023-05-08T06:33:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:26 smithi186 ceph-mon[126480]: pgmap v5469: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 41 KiB/s wr, 8 op/s 2023-05-08T06:33:28.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:28 smithi133 ceph-mon[125939]: pgmap v5470: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 35 KiB/s wr, 7 op/s 2023-05-08T06:33:28.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:28 smithi096 ceph-mon[124666]: pgmap v5470: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 35 KiB/s wr, 7 op/s 2023-05-08T06:33:28.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:28 smithi186 ceph-mon[126480]: pgmap v5470: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 35 KiB/s wr, 7 op/s 2023-05-08T06:33:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10147.790869 secs 2023-05-08T06:33:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10148.348451 secs 2023-05-08T06:33:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10147.790869 secs 2023-05-08T06:33:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10148.348451 secs 2023-05-08T06:33:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10147.790869 secs 2023-05-08T06:33:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10148.348451 secs 2023-05-08T06:33:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:30 smithi133 ceph-mon[125939]: pgmap v5471: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 35 KiB/s wr, 7 op/s 2023-05-08T06:33:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:30 smithi096 ceph-mon[124666]: pgmap v5471: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 35 KiB/s wr, 7 op/s 2023-05-08T06:33:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:30 smithi186 ceph-mon[126480]: pgmap v5471: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 35 KiB/s wr, 7 op/s 2023-05-08T06:33:31.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10149.629806 secs 2023-05-08T06:33:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:31 smithi186 ceph-mon[126480]: pgmap v5472: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 55 KiB/s wr, 9 op/s 2023-05-08T06:33:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10149.629806 secs 2023-05-08T06:33:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:31 smithi133 ceph-mon[125939]: pgmap v5472: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 55 KiB/s wr, 9 op/s 2023-05-08T06:33:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10149.629806 secs 2023-05-08T06:33:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:31 smithi096 ceph-mon[124666]: pgmap v5472: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 55 KiB/s wr, 9 op/s 2023-05-08T06:33:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10152.790992 secs 2023-05-08T06:33:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:34 smithi133 ceph-mon[125939]: pgmap v5473: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 6 op/s 2023-05-08T06:33:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10153.348579 secs 2023-05-08T06:33:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10152.790992 secs 2023-05-08T06:33:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:34 smithi096 ceph-mon[124666]: pgmap v5473: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 6 op/s 2023-05-08T06:33:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10153.348579 secs 2023-05-08T06:33:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10152.790992 secs 2023-05-08T06:33:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:34 smithi186 ceph-mon[126480]: pgmap v5473: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 6 op/s 2023-05-08T06:33:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10153.348579 secs 2023-05-08T06:33:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10154.629932 secs 2023-05-08T06:33:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:36 smithi133 ceph-mon[125939]: pgmap v5474: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 97 KiB/s wr, 9 op/s 2023-05-08T06:33:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10154.629932 secs 2023-05-08T06:33:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:36 smithi096 ceph-mon[124666]: pgmap v5474: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 97 KiB/s wr, 9 op/s 2023-05-08T06:33:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10154.629932 secs 2023-05-08T06:33:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:36 smithi186 ceph-mon[126480]: pgmap v5474: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 97 KiB/s wr, 9 op/s 2023-05-08T06:33:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:38 smithi133 ceph-mon[125939]: pgmap v5475: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 64 KiB/s wr, 6 op/s 2023-05-08T06:33:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:38 smithi096 ceph-mon[124666]: pgmap v5475: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 64 KiB/s wr, 6 op/s 2023-05-08T06:33:38.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:38 smithi186 ceph-mon[126480]: pgmap v5475: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 64 KiB/s wr, 6 op/s 2023-05-08T06:33:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10157.791110 secs 2023-05-08T06:33:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10157.791110 secs 2023-05-08T06:33:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10157.791110 secs 2023-05-08T06:33:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:40 smithi133 ceph-mon[125939]: pgmap v5476: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 64 KiB/s wr, 7 op/s 2023-05-08T06:33:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:40 smithi096 ceph-mon[124666]: pgmap v5476: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 64 KiB/s wr, 7 op/s 2023-05-08T06:33:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:40 smithi186 ceph-mon[126480]: pgmap v5476: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 64 KiB/s wr, 7 op/s 2023-05-08T06:33:41.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10159.630054 secs 2023-05-08T06:33:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:41 smithi186 ceph-mon[126480]: pgmap v5477: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 106 KiB/s wr, 9 op/s 2023-05-08T06:33:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10159.630054 secs 2023-05-08T06:33:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:41 smithi133 ceph-mon[125939]: pgmap v5477: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 106 KiB/s wr, 9 op/s 2023-05-08T06:33:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10159.630054 secs 2023-05-08T06:33:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:41 smithi096 ceph-mon[124666]: pgmap v5477: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 106 KiB/s wr, 9 op/s 2023-05-08T06:33:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:33:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:33:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:33:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:43 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:33:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:33:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:33:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:43 smithi133 ceph-mon[125939]: pgmap v5478: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 86 KiB/s wr, 7 op/s 2023-05-08T06:33:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:43 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:33:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:33:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:33:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:43 smithi096 ceph-mon[124666]: pgmap v5478: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 86 KiB/s wr, 7 op/s 2023-05-08T06:33:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:43 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:33:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:33:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:33:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:43 smithi186 ceph-mon[126480]: pgmap v5478: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 86 KiB/s wr, 7 op/s 2023-05-08T06:33:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10162.791241 secs 2023-05-08T06:33:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10162.791241 secs 2023-05-08T06:33:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10162.791241 secs 2023-05-08T06:33:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:45 smithi133 ceph-mon[125939]: pgmap v5479: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 165 KiB/s wr, 12 op/s 2023-05-08T06:33:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:45 smithi096 ceph-mon[124666]: pgmap v5479: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 165 KiB/s wr, 12 op/s 2023-05-08T06:33:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:45 smithi186 ceph-mon[126480]: pgmap v5479: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 165 KiB/s wr, 12 op/s 2023-05-08T06:33:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:46 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:33:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:46 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:33:46.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:46 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:33:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:47 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:33:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:47 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:33:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:47 smithi133 ceph-mon[125939]: pgmap v5480: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 122 KiB/s wr, 9 op/s 2023-05-08T06:33:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:47 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:33:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:47 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:33:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:47 smithi096 ceph-mon[124666]: pgmap v5480: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 122 KiB/s wr, 9 op/s 2023-05-08T06:33:47.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:47 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:33:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:47 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:33:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:47 smithi186 ceph-mon[126480]: pgmap v5480: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 122 KiB/s wr, 9 op/s 2023-05-08T06:33:48.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10167.791373 secs 2023-05-08T06:33:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10167.791373 secs 2023-05-08T06:33:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10167.791373 secs 2023-05-08T06:33:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10168.348936 secs 2023-05-08T06:33:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:49 smithi186 ceph-mon[126480]: pgmap v5481: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 126 KiB/s wr, 11 op/s 2023-05-08T06:33:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10168.348936 secs 2023-05-08T06:33:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:49 smithi133 ceph-mon[125939]: pgmap v5481: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 126 KiB/s wr, 11 op/s 2023-05-08T06:33:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10168.348936 secs 2023-05-08T06:33:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:49 smithi096 ceph-mon[124666]: pgmap v5481: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 126 KiB/s wr, 11 op/s 2023-05-08T06:33:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:50 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:33:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:50 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:33:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:50 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:33:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:51 smithi186 ceph-mon[126480]: pgmap v5482: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 130 KiB/s wr, 11 op/s 2023-05-08T06:33:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:33:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:33:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:51 smithi133 ceph-mon[125939]: pgmap v5482: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 130 KiB/s wr, 11 op/s 2023-05-08T06:33:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:33:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:33:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:51 smithi096 ceph-mon[124666]: pgmap v5482: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 130 KiB/s wr, 11 op/s 2023-05-08T06:33:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:33:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:33:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10172.791492 secs 2023-05-08T06:33:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:54 smithi133 ceph-mon[125939]: pgmap v5483: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 88 KiB/s wr, 9 op/s 2023-05-08T06:33:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10173.349082 secs 2023-05-08T06:33:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10172.791492 secs 2023-05-08T06:33:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:54 smithi096 ceph-mon[124666]: pgmap v5483: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 88 KiB/s wr, 9 op/s 2023-05-08T06:33:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10173.349082 secs 2023-05-08T06:33:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10172.791492 secs 2023-05-08T06:33:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:54 smithi186 ceph-mon[126480]: pgmap v5483: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 88 KiB/s wr, 9 op/s 2023-05-08T06:33:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10173.349082 secs 2023-05-08T06:33:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:56 smithi133 ceph-mon[125939]: pgmap v5484: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 165 KiB/s wr, 13 op/s 2023-05-08T06:33:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:56 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:33:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:56 smithi096 ceph-mon[124666]: pgmap v5484: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 165 KiB/s wr, 13 op/s 2023-05-08T06:33:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:56 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:33:56.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:56 smithi186 ceph-mon[126480]: pgmap v5484: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 165 KiB/s wr, 13 op/s 2023-05-08T06:33:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:56 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:33:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:33:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:33:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:33:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:58 smithi133 ceph-mon[125939]: pgmap v5485: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 86 KiB/s wr, 8 op/s 2023-05-08T06:33:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:33:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:33:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:33:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:58 smithi096 ceph-mon[124666]: pgmap v5485: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 86 KiB/s wr, 8 op/s 2023-05-08T06:33:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:33:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:33:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:33:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:58 smithi186 ceph-mon[126480]: pgmap v5485: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 86 KiB/s wr, 8 op/s 2023-05-08T06:33:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:33:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:33:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:33:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:59 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:33:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:59 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T06:33:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:59 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T06:33:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:59 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:33:59.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10177.791625 secs 2023-05-08T06:33:59.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:33:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10178.349184 secs 2023-05-08T06:33:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:59 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:33:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:59 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T06:33:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:59 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T06:33:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:59 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:33:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10177.791625 secs 2023-05-08T06:33:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:33:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10178.349184 secs 2023-05-08T06:33:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:59 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:33:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:59 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T06:33:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:59 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T06:33:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:59 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:33:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10177.791625 secs 2023-05-08T06:33:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:33:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10178.349184 secs 2023-05-08T06:34:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:00 smithi133 ceph-mon[125939]: pgmap v5486: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 91 KiB/s wr, 10 op/s 2023-05-08T06:34:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:00 smithi096 ceph-mon[124666]: pgmap v5486: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 91 KiB/s wr, 10 op/s 2023-05-08T06:34:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:00 smithi186 ceph-mon[126480]: pgmap v5486: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 91 KiB/s wr, 10 op/s 2023-05-08T06:34:01.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10179.630510 secs 2023-05-08T06:34:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:01 smithi186 ceph-mon[126480]: pgmap v5487: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 91 KiB/s wr, 10 op/s 2023-05-08T06:34:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10179.630510 secs 2023-05-08T06:34:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:01 smithi133 ceph-mon[125939]: pgmap v5487: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 91 KiB/s wr, 10 op/s 2023-05-08T06:34:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10179.630510 secs 2023-05-08T06:34:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:01 smithi096 ceph-mon[124666]: pgmap v5487: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 91 KiB/s wr, 10 op/s 2023-05-08T06:34:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:02 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:34:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:34:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:34:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:02 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:34:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:34:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:34:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:02 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:34:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:34:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:34:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:03 smithi186 ceph-mon[126480]: pgmap v5488: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 87 KiB/s wr, 8 op/s 2023-05-08T06:34:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:03 smithi133 ceph-mon[125939]: pgmap v5488: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 87 KiB/s wr, 8 op/s 2023-05-08T06:34:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:03 smithi096 ceph-mon[124666]: pgmap v5488: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 87 KiB/s wr, 8 op/s 2023-05-08T06:34:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10182.791742 secs 2023-05-08T06:34:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10183.349318 secs 2023-05-08T06:34:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10182.791742 secs 2023-05-08T06:34:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10183.349318 secs 2023-05-08T06:34:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10182.791742 secs 2023-05-08T06:34:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10183.349318 secs 2023-05-08T06:34:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10184.630609 secs 2023-05-08T06:34:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:05 smithi186 ceph-mon[126480]: pgmap v5489: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 201 KiB/s wr, 27 op/s 2023-05-08T06:34:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10184.630609 secs 2023-05-08T06:34:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:05 smithi133 ceph-mon[125939]: pgmap v5489: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 201 KiB/s wr, 27 op/s 2023-05-08T06:34:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10184.630609 secs 2023-05-08T06:34:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:05 smithi096 ceph-mon[124666]: pgmap v5489: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 201 KiB/s wr, 27 op/s 2023-05-08T06:34:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:06 smithi186 ceph-mon[126480]: osdmap e420: 12 total, 12 up, 12 in 2023-05-08T06:34:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:06 smithi133 ceph-mon[125939]: osdmap e420: 12 total, 12 up, 12 in 2023-05-08T06:34:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:06 smithi096 ceph-mon[124666]: osdmap e420: 12 total, 12 up, 12 in 2023-05-08T06:34:07.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:07 smithi186 ceph-mon[126480]: pgmap v5491: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 149 KiB/s wr, 27 op/s 2023-05-08T06:34:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:07 smithi133 ceph-mon[125939]: pgmap v5491: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 149 KiB/s wr, 27 op/s 2023-05-08T06:34:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:07 smithi096 ceph-mon[124666]: pgmap v5491: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 149 KiB/s wr, 27 op/s 2023-05-08T06:34:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10187.791862 secs 2023-05-08T06:34:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10187.791862 secs 2023-05-08T06:34:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10187.791862 secs 2023-05-08T06:34:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10188.349458 secs 2023-05-08T06:34:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:09 smithi186 ceph-mon[126480]: pgmap v5492: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 148 KiB/s wr, 27 op/s 2023-05-08T06:34:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10188.349458 secs 2023-05-08T06:34:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:09 smithi133 ceph-mon[125939]: pgmap v5492: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 148 KiB/s wr, 27 op/s 2023-05-08T06:34:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10188.349458 secs 2023-05-08T06:34:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:09 smithi096 ceph-mon[124666]: pgmap v5492: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 148 KiB/s wr, 27 op/s 2023-05-08T06:34:11.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10189.630734 secs 2023-05-08T06:34:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:11 smithi186 ceph-mon[126480]: pgmap v5493: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 143 KiB/s wr, 27 op/s 2023-05-08T06:34:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10189.630734 secs 2023-05-08T06:34:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:11 smithi133 ceph-mon[125939]: pgmap v5493: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 143 KiB/s wr, 27 op/s 2023-05-08T06:34:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10189.630734 secs 2023-05-08T06:34:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:11 smithi096 ceph-mon[124666]: pgmap v5493: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 143 KiB/s wr, 27 op/s 2023-05-08T06:34:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10192.791982 secs 2023-05-08T06:34:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:14 smithi133 ceph-mon[125939]: pgmap v5494: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 143 KiB/s wr, 27 op/s 2023-05-08T06:34:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10193.349600 secs 2023-05-08T06:34:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10192.791982 secs 2023-05-08T06:34:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:14 smithi096 ceph-mon[124666]: pgmap v5494: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 143 KiB/s wr, 27 op/s 2023-05-08T06:34:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10193.349600 secs 2023-05-08T06:34:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10192.791982 secs 2023-05-08T06:34:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:14 smithi186 ceph-mon[126480]: pgmap v5494: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 143 KiB/s wr, 27 op/s 2023-05-08T06:34:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10193.349600 secs 2023-05-08T06:34:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10194.630852 secs 2023-05-08T06:34:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:16 smithi133 ceph-mon[125939]: pgmap v5495: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 28 KiB/s wr, 9 op/s 2023-05-08T06:34:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:16 smithi133 ceph-mon[125939]: osdmap e421: 12 total, 12 up, 12 in 2023-05-08T06:34:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10194.630852 secs 2023-05-08T06:34:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:16 smithi096 ceph-mon[124666]: pgmap v5495: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 28 KiB/s wr, 9 op/s 2023-05-08T06:34:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:16 smithi096 ceph-mon[124666]: osdmap e421: 12 total, 12 up, 12 in 2023-05-08T06:34:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10194.630852 secs 2023-05-08T06:34:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:16 smithi186 ceph-mon[126480]: pgmap v5495: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 28 KiB/s wr, 9 op/s 2023-05-08T06:34:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:16 smithi186 ceph-mon[126480]: osdmap e421: 12 total, 12 up, 12 in 2023-05-08T06:34:18.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:18 smithi133 ceph-mon[125939]: pgmap v5497: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 28 KiB/s wr, 9 op/s 2023-05-08T06:34:18.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:18 smithi096 ceph-mon[124666]: pgmap v5497: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 28 KiB/s wr, 9 op/s 2023-05-08T06:34:18.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:18 smithi186 ceph-mon[126480]: pgmap v5497: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 28 KiB/s wr, 9 op/s 2023-05-08T06:34:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10197.792097 secs 2023-05-08T06:34:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10198.349685 secs 2023-05-08T06:34:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10197.792097 secs 2023-05-08T06:34:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10198.349685 secs 2023-05-08T06:34:19.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10197.792097 secs 2023-05-08T06:34:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10198.349685 secs 2023-05-08T06:34:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:20 smithi133 ceph-mon[125939]: pgmap v5498: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 8 op/s 2023-05-08T06:34:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:20 smithi096 ceph-mon[124666]: pgmap v5498: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 8 op/s 2023-05-08T06:34:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:20 smithi186 ceph-mon[126480]: pgmap v5498: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 8 op/s 2023-05-08T06:34:21.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10199.630930 secs 2023-05-08T06:34:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:21 smithi186 ceph-mon[126480]: pgmap v5499: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 8 op/s 2023-05-08T06:34:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10199.630930 secs 2023-05-08T06:34:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:21 smithi133 ceph-mon[125939]: pgmap v5499: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 8 op/s 2023-05-08T06:34:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10199.630930 secs 2023-05-08T06:34:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:21 smithi096 ceph-mon[124666]: pgmap v5499: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 8 op/s 2023-05-08T06:34:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10202.792222 secs 2023-05-08T06:34:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:24 smithi133 ceph-mon[125939]: pgmap v5500: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 8 op/s 2023-05-08T06:34:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10203.349817 secs 2023-05-08T06:34:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10202.792222 secs 2023-05-08T06:34:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:24 smithi096 ceph-mon[124666]: pgmap v5500: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 8 op/s 2023-05-08T06:34:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10203.349817 secs 2023-05-08T06:34:24.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10202.792222 secs 2023-05-08T06:34:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:24 smithi186 ceph-mon[126480]: pgmap v5500: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 8 op/s 2023-05-08T06:34:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10203.349817 secs 2023-05-08T06:34:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10204.631040 secs 2023-05-08T06:34:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:26 smithi133 ceph-mon[125939]: pgmap v5501: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 44 KiB/s wr, 8 op/s 2023-05-08T06:34:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10204.631040 secs 2023-05-08T06:34:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:26 smithi096 ceph-mon[124666]: pgmap v5501: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 44 KiB/s wr, 8 op/s 2023-05-08T06:34:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10204.631040 secs 2023-05-08T06:34:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:26 smithi186 ceph-mon[126480]: pgmap v5501: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 44 KiB/s wr, 8 op/s 2023-05-08T06:34:28.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:28 smithi133 ceph-mon[125939]: pgmap v5502: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 37 KiB/s wr, 7 op/s 2023-05-08T06:34:28.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:28 smithi096 ceph-mon[124666]: pgmap v5502: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 37 KiB/s wr, 7 op/s 2023-05-08T06:34:28.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:28 smithi186 ceph-mon[126480]: pgmap v5502: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 37 KiB/s wr, 7 op/s 2023-05-08T06:34:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10207.792346 secs 2023-05-08T06:34:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10208.349952 secs 2023-05-08T06:34:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10207.792346 secs 2023-05-08T06:34:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10208.349952 secs 2023-05-08T06:34:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10207.792346 secs 2023-05-08T06:34:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10208.349952 secs 2023-05-08T06:34:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:30 smithi133 ceph-mon[125939]: pgmap v5503: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 41 KiB/s wr, 9 op/s 2023-05-08T06:34:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:30 smithi096 ceph-mon[124666]: pgmap v5503: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 41 KiB/s wr, 9 op/s 2023-05-08T06:34:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:30 smithi186 ceph-mon[126480]: pgmap v5503: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 41 KiB/s wr, 9 op/s 2023-05-08T06:34:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10209.631177 secs 2023-05-08T06:34:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:31 smithi186 ceph-mon[126480]: pgmap v5504: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 41 KiB/s wr, 8 op/s 2023-05-08T06:34:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10209.631177 secs 2023-05-08T06:34:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:31 smithi133 ceph-mon[125939]: pgmap v5504: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 41 KiB/s wr, 8 op/s 2023-05-08T06:34:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10209.631177 secs 2023-05-08T06:34:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:31 smithi096 ceph-mon[124666]: pgmap v5504: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 41 KiB/s wr, 8 op/s 2023-05-08T06:34:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10212.792467 secs 2023-05-08T06:34:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:34 smithi133 ceph-mon[125939]: pgmap v5505: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 41 KiB/s wr, 7 op/s 2023-05-08T06:34:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10213.350094 secs 2023-05-08T06:34:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10212.792467 secs 2023-05-08T06:34:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:34 smithi096 ceph-mon[124666]: pgmap v5505: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 41 KiB/s wr, 7 op/s 2023-05-08T06:34:34.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10213.350094 secs 2023-05-08T06:34:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10212.792467 secs 2023-05-08T06:34:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:34 smithi186 ceph-mon[126480]: pgmap v5505: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 41 KiB/s wr, 7 op/s 2023-05-08T06:34:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10213.350094 secs 2023-05-08T06:34:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10214.631313 secs 2023-05-08T06:34:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:36 smithi133 ceph-mon[125939]: pgmap v5506: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 84 KiB/s wr, 10 op/s 2023-05-08T06:34:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10214.631313 secs 2023-05-08T06:34:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:36 smithi096 ceph-mon[124666]: pgmap v5506: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 84 KiB/s wr, 10 op/s 2023-05-08T06:34:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10214.631313 secs 2023-05-08T06:34:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:36 smithi186 ceph-mon[126480]: pgmap v5506: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 84 KiB/s wr, 10 op/s 2023-05-08T06:34:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:38 smithi133 ceph-mon[125939]: pgmap v5507: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 48 KiB/s wr, 6 op/s 2023-05-08T06:34:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:38 smithi096 ceph-mon[124666]: pgmap v5507: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 48 KiB/s wr, 6 op/s 2023-05-08T06:34:38.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:38 smithi186 ceph-mon[126480]: pgmap v5507: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 48 KiB/s wr, 6 op/s 2023-05-08T06:34:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10217.792585 secs 2023-05-08T06:34:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10217.792585 secs 2023-05-08T06:34:39.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10217.792585 secs 2023-05-08T06:34:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:40 smithi133 ceph-mon[125939]: pgmap v5508: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 92 KiB/s wr, 9 op/s 2023-05-08T06:34:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:40 smithi096 ceph-mon[124666]: pgmap v5508: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 92 KiB/s wr, 9 op/s 2023-05-08T06:34:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:40 smithi186 ceph-mon[126480]: pgmap v5508: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 92 KiB/s wr, 9 op/s 2023-05-08T06:34:41.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10219.631448 secs 2023-05-08T06:34:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:41 smithi186 ceph-mon[126480]: pgmap v5509: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 87 KiB/s wr, 7 op/s 2023-05-08T06:34:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10219.631448 secs 2023-05-08T06:34:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:41 smithi133 ceph-mon[125939]: pgmap v5509: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 87 KiB/s wr, 7 op/s 2023-05-08T06:34:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10219.631448 secs 2023-05-08T06:34:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:41 smithi096 ceph-mon[124666]: pgmap v5509: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 87 KiB/s wr, 7 op/s 2023-05-08T06:34:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:34:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:34:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:34:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:43 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:34:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:34:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:34:43.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:43 smithi133 ceph-mon[125939]: pgmap v5510: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 87 KiB/s wr, 6 op/s 2023-05-08T06:34:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:43 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:34:43.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:34:43.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:34:43.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:43 smithi096 ceph-mon[124666]: pgmap v5510: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 87 KiB/s wr, 6 op/s 2023-05-08T06:34:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:43 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:34:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:34:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:34:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:43 smithi186 ceph-mon[126480]: pgmap v5510: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 87 KiB/s wr, 6 op/s 2023-05-08T06:34:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10222.792734 secs 2023-05-08T06:34:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10222.792734 secs 2023-05-08T06:34:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10222.792734 secs 2023-05-08T06:34:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:45 smithi133 ceph-mon[125939]: pgmap v5511: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 166 KiB/s wr, 12 op/s 2023-05-08T06:34:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:45 smithi096 ceph-mon[124666]: pgmap v5511: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 166 KiB/s wr, 12 op/s 2023-05-08T06:34:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:45 smithi186 ceph-mon[126480]: pgmap v5511: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 166 KiB/s wr, 12 op/s 2023-05-08T06:34:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:46 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:34:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:46 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:34:46.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:46 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:34:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:47 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:34:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:47 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:34:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:47 smithi133 ceph-mon[125939]: pgmap v5512: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 123 KiB/s wr, 9 op/s 2023-05-08T06:34:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:47 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:34:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:47 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:34:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:47 smithi096 ceph-mon[124666]: pgmap v5512: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 123 KiB/s wr, 9 op/s 2023-05-08T06:34:47.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:47 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:34:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:47 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:34:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:47 smithi186 ceph-mon[126480]: pgmap v5512: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 123 KiB/s wr, 9 op/s 2023-05-08T06:34:48.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10227.792874 secs 2023-05-08T06:34:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10227.792874 secs 2023-05-08T06:34:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10227.792874 secs 2023-05-08T06:34:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10228.350525 secs 2023-05-08T06:34:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:49 smithi186 ceph-mon[126480]: pgmap v5513: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 132 KiB/s wr, 12 op/s 2023-05-08T06:34:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10228.350525 secs 2023-05-08T06:34:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:49 smithi133 ceph-mon[125939]: pgmap v5513: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 132 KiB/s wr, 12 op/s 2023-05-08T06:34:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10228.350525 secs 2023-05-08T06:34:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:49 smithi096 ceph-mon[124666]: pgmap v5513: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 132 KiB/s wr, 12 op/s 2023-05-08T06:34:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:50 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:34:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:50 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:34:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:50 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:34:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:51 smithi186 ceph-mon[126480]: pgmap v5514: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 89 KiB/s wr, 10 op/s 2023-05-08T06:34:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:34:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:34:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:51 smithi133 ceph-mon[125939]: pgmap v5514: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 89 KiB/s wr, 10 op/s 2023-05-08T06:34:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:34:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:34:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:51 smithi096 ceph-mon[124666]: pgmap v5514: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 89 KiB/s wr, 10 op/s 2023-05-08T06:34:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:34:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:34:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10232.792985 secs 2023-05-08T06:34:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:54 smithi133 ceph-mon[125939]: pgmap v5515: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 88 KiB/s wr, 9 op/s 2023-05-08T06:34:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10233.350642 secs 2023-05-08T06:34:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10232.792985 secs 2023-05-08T06:34:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:54 smithi096 ceph-mon[124666]: pgmap v5515: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 88 KiB/s wr, 9 op/s 2023-05-08T06:34:54.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10233.350642 secs 2023-05-08T06:34:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10232.792985 secs 2023-05-08T06:34:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:54 smithi186 ceph-mon[126480]: pgmap v5515: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 88 KiB/s wr, 9 op/s 2023-05-08T06:34:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10233.350642 secs 2023-05-08T06:34:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:56 smithi133 ceph-mon[125939]: pgmap v5516: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 190 KiB/s wr, 13 op/s 2023-05-08T06:34:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:56 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:34:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:56 smithi096 ceph-mon[124666]: pgmap v5516: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 190 KiB/s wr, 13 op/s 2023-05-08T06:34:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:56 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:34:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:56 smithi186 ceph-mon[126480]: pgmap v5516: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 190 KiB/s wr, 13 op/s 2023-05-08T06:34:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:56 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:34:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:58 smithi133 ceph-mon[125939]: pgmap v5517: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 110 KiB/s wr, 8 op/s 2023-05-08T06:34:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:34:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:58 smithi096 ceph-mon[124666]: pgmap v5517: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 110 KiB/s wr, 8 op/s 2023-05-08T06:34:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:34:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:58 smithi186 ceph-mon[126480]: pgmap v5517: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 110 KiB/s wr, 8 op/s 2023-05-08T06:34:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:34:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10237.793056 secs 2023-05-08T06:34:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:34:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:34:59.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:34:59.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:34:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10238.350718 secs 2023-05-08T06:34:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10237.793056 secs 2023-05-08T06:34:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:34:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:34:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:34:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:34:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10238.350718 secs 2023-05-08T06:34:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10237.793056 secs 2023-05-08T06:34:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:34:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:34:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:34:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:34:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10238.350718 secs 2023-05-08T06:35:00.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:00 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:35:00.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:00 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T06:35:00.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:00 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T06:35:00.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:00 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:35:00.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:00 smithi133 ceph-mon[125939]: pgmap v5518: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 152 KiB/s wr, 11 op/s 2023-05-08T06:35:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:00 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:35:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:00 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T06:35:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:00 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T06:35:00.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:00 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:35:00.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:00 smithi096 ceph-mon[124666]: pgmap v5518: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 152 KiB/s wr, 11 op/s 2023-05-08T06:35:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:00 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:35:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:00 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T06:35:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:00 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T06:35:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:00 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:35:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:00 smithi186 ceph-mon[126480]: pgmap v5518: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 152 KiB/s wr, 11 op/s 2023-05-08T06:35:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10239.631926 secs 2023-05-08T06:35:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10239.631926 secs 2023-05-08T06:35:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10239.631926 secs 2023-05-08T06:35:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:02 smithi133 ceph-mon[125939]: pgmap v5519: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 143 KiB/s wr, 9 op/s 2023-05-08T06:35:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:02 smithi096 ceph-mon[124666]: pgmap v5519: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 143 KiB/s wr, 9 op/s 2023-05-08T06:35:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:02 smithi186 ceph-mon[126480]: pgmap v5519: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 143 KiB/s wr, 9 op/s 2023-05-08T06:35:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:03 smithi133 ceph-mon[125939]: pgmap v5520: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 143 KiB/s wr, 8 op/s 2023-05-08T06:35:03.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:03 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:35:03.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:35:03.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:03 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:35:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:03 smithi096 ceph-mon[124666]: pgmap v5520: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 143 KiB/s wr, 8 op/s 2023-05-08T06:35:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:03 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:35:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:35:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:03 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:35:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:03 smithi186 ceph-mon[126480]: pgmap v5520: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 143 KiB/s wr, 8 op/s 2023-05-08T06:35:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:03 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:35:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:35:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:03 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:35:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10242.793169 secs 2023-05-08T06:35:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10243.350797 secs 2023-05-08T06:35:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10242.793169 secs 2023-05-08T06:35:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10243.350797 secs 2023-05-08T06:35:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10242.793169 secs 2023-05-08T06:35:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10243.350797 secs 2023-05-08T06:35:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:05 smithi133 ceph-mon[125939]: pgmap v5521: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 237 KiB/s wr, 26 op/s 2023-05-08T06:35:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:05 smithi096 ceph-mon[124666]: pgmap v5521: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 237 KiB/s wr, 26 op/s 2023-05-08T06:35:05.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:05 smithi186 ceph-mon[126480]: pgmap v5521: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 237 KiB/s wr, 26 op/s 2023-05-08T06:35:06.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10244.632073 secs 2023-05-08T06:35:06.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:06 smithi133 ceph-mon[125939]: osdmap e422: 12 total, 12 up, 12 in 2023-05-08T06:35:06.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10244.632073 secs 2023-05-08T06:35:06.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:06 smithi096 ceph-mon[124666]: osdmap e422: 12 total, 12 up, 12 in 2023-05-08T06:35:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10244.632073 secs 2023-05-08T06:35:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:06 smithi186 ceph-mon[126480]: osdmap e422: 12 total, 12 up, 12 in 2023-05-08T06:35:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:07 smithi133 ceph-mon[125939]: pgmap v5523: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 162 KiB/s wr, 27 op/s 2023-05-08T06:35:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:07 smithi096 ceph-mon[124666]: pgmap v5523: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 162 KiB/s wr, 27 op/s 2023-05-08T06:35:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:07 smithi186 ceph-mon[126480]: pgmap v5523: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 162 KiB/s wr, 27 op/s 2023-05-08T06:35:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10247.793294 secs 2023-05-08T06:35:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10247.793294 secs 2023-05-08T06:35:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10247.793294 secs 2023-05-08T06:35:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10248.350914 secs 2023-05-08T06:35:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:09 smithi186 ceph-mon[126480]: pgmap v5524: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 118 KiB/s wr, 26 op/s 2023-05-08T06:35:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10248.350914 secs 2023-05-08T06:35:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:09 smithi133 ceph-mon[125939]: pgmap v5524: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 118 KiB/s wr, 26 op/s 2023-05-08T06:35:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10248.350914 secs 2023-05-08T06:35:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:09 smithi096 ceph-mon[124666]: pgmap v5524: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 118 KiB/s wr, 26 op/s 2023-05-08T06:35:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10249.632178 secs 2023-05-08T06:35:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10249.632178 secs 2023-05-08T06:35:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10249.632178 secs 2023-05-08T06:35:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:11 smithi186 ceph-mon[126480]: pgmap v5525: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 118 KiB/s wr, 25 op/s 2023-05-08T06:35:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:11 smithi133 ceph-mon[125939]: pgmap v5525: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 118 KiB/s wr, 25 op/s 2023-05-08T06:35:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:11 smithi096 ceph-mon[124666]: pgmap v5525: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 118 KiB/s wr, 25 op/s 2023-05-08T06:35:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10252.793413 secs 2023-05-08T06:35:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:14 smithi133 ceph-mon[125939]: pgmap v5526: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 118 KiB/s wr, 25 op/s 2023-05-08T06:35:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10253.351049 secs 2023-05-08T06:35:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10252.793413 secs 2023-05-08T06:35:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:14 smithi096 ceph-mon[124666]: pgmap v5526: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 118 KiB/s wr, 25 op/s 2023-05-08T06:35:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10253.351049 secs 2023-05-08T06:35:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10252.793413 secs 2023-05-08T06:35:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:14 smithi186 ceph-mon[126480]: pgmap v5526: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 118 KiB/s wr, 25 op/s 2023-05-08T06:35:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10253.351049 secs 2023-05-08T06:35:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10254.632276 secs 2023-05-08T06:35:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:16 smithi133 ceph-mon[125939]: pgmap v5527: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 28 KiB/s wr, 8 op/s 2023-05-08T06:35:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:16 smithi133 ceph-mon[125939]: osdmap e423: 12 total, 12 up, 12 in 2023-05-08T06:35:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10254.632276 secs 2023-05-08T06:35:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:16 smithi096 ceph-mon[124666]: pgmap v5527: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 28 KiB/s wr, 8 op/s 2023-05-08T06:35:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:16 smithi096 ceph-mon[124666]: osdmap e423: 12 total, 12 up, 12 in 2023-05-08T06:35:16.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10254.632276 secs 2023-05-08T06:35:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:16 smithi186 ceph-mon[126480]: pgmap v5527: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 28 KiB/s wr, 8 op/s 2023-05-08T06:35:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:16 smithi186 ceph-mon[126480]: osdmap e423: 12 total, 12 up, 12 in 2023-05-08T06:35:18.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:18 smithi133 ceph-mon[125939]: pgmap v5529: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 28 KiB/s wr, 8 op/s 2023-05-08T06:35:18.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:18 smithi096 ceph-mon[124666]: pgmap v5529: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 28 KiB/s wr, 8 op/s 2023-05-08T06:35:18.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:18 smithi186 ceph-mon[126480]: pgmap v5529: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 28 KiB/s wr, 8 op/s 2023-05-08T06:35:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10257.793525 secs 2023-05-08T06:35:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10258.351156 secs 2023-05-08T06:35:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10257.793525 secs 2023-05-08T06:35:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10258.351156 secs 2023-05-08T06:35:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10257.793525 secs 2023-05-08T06:35:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10258.351156 secs 2023-05-08T06:35:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:20 smithi133 ceph-mon[125939]: pgmap v5530: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 8 op/s 2023-05-08T06:35:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:20 smithi096 ceph-mon[124666]: pgmap v5530: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 8 op/s 2023-05-08T06:35:20.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:20 smithi186 ceph-mon[126480]: pgmap v5530: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 8 op/s 2023-05-08T06:35:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10259.632418 secs 2023-05-08T06:35:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10259.632418 secs 2023-05-08T06:35:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10259.632418 secs 2023-05-08T06:35:22.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:22 smithi133 ceph-mon[125939]: pgmap v5531: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 8 op/s 2023-05-08T06:35:22.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:22 smithi096 ceph-mon[124666]: pgmap v5531: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 8 op/s 2023-05-08T06:35:22.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:22 smithi186 ceph-mon[126480]: pgmap v5531: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 8 op/s 2023-05-08T06:35:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10262.793643 secs 2023-05-08T06:35:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:24 smithi133 ceph-mon[125939]: pgmap v5532: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 8 op/s 2023-05-08T06:35:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10263.351267 secs 2023-05-08T06:35:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10262.793643 secs 2023-05-08T06:35:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:24 smithi096 ceph-mon[124666]: pgmap v5532: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 8 op/s 2023-05-08T06:35:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10263.351267 secs 2023-05-08T06:35:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10262.793643 secs 2023-05-08T06:35:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:24 smithi186 ceph-mon[126480]: pgmap v5532: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 8 op/s 2023-05-08T06:35:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10263.351267 secs 2023-05-08T06:35:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10264.632534 secs 2023-05-08T06:35:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:26 smithi133 ceph-mon[125939]: pgmap v5533: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 44 KiB/s wr, 8 op/s 2023-05-08T06:35:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10264.632534 secs 2023-05-08T06:35:26.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:26 smithi096 ceph-mon[124666]: pgmap v5533: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 44 KiB/s wr, 8 op/s 2023-05-08T06:35:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10264.632534 secs 2023-05-08T06:35:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:26 smithi186 ceph-mon[126480]: pgmap v5533: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 44 KiB/s wr, 8 op/s 2023-05-08T06:35:28.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:28 smithi133 ceph-mon[125939]: pgmap v5534: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 37 KiB/s wr, 7 op/s 2023-05-08T06:35:28.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:28 smithi096 ceph-mon[124666]: pgmap v5534: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 37 KiB/s wr, 7 op/s 2023-05-08T06:35:28.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:28 smithi186 ceph-mon[126480]: pgmap v5534: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 37 KiB/s wr, 7 op/s 2023-05-08T06:35:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10267.793759 secs 2023-05-08T06:35:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10268.351388 secs 2023-05-08T06:35:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10267.793759 secs 2023-05-08T06:35:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10268.351388 secs 2023-05-08T06:35:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10267.793759 secs 2023-05-08T06:35:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10268.351388 secs 2023-05-08T06:35:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:30 smithi133 ceph-mon[125939]: pgmap v5535: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 58 KiB/s wr, 9 op/s 2023-05-08T06:35:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:30 smithi096 ceph-mon[124666]: pgmap v5535: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 58 KiB/s wr, 9 op/s 2023-05-08T06:35:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:30 smithi186 ceph-mon[126480]: pgmap v5535: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 58 KiB/s wr, 9 op/s 2023-05-08T06:35:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10269.632665 secs 2023-05-08T06:35:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10269.632665 secs 2023-05-08T06:35:31.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10269.632665 secs 2023-05-08T06:35:32.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:32 smithi133 ceph-mon[125939]: pgmap v5536: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 8 op/s 2023-05-08T06:35:32.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:32 smithi096 ceph-mon[124666]: pgmap v5536: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 8 op/s 2023-05-08T06:35:32.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:32 smithi186 ceph-mon[126480]: pgmap v5536: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 8 op/s 2023-05-08T06:35:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10272.793852 secs 2023-05-08T06:35:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:34 smithi133 ceph-mon[125939]: pgmap v5537: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 58 KiB/s wr, 7 op/s 2023-05-08T06:35:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10273.351503 secs 2023-05-08T06:35:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10272.793852 secs 2023-05-08T06:35:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:34 smithi096 ceph-mon[124666]: pgmap v5537: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 58 KiB/s wr, 7 op/s 2023-05-08T06:35:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10273.351503 secs 2023-05-08T06:35:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10272.793852 secs 2023-05-08T06:35:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:34 smithi186 ceph-mon[126480]: pgmap v5537: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 58 KiB/s wr, 7 op/s 2023-05-08T06:35:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10273.351503 secs 2023-05-08T06:35:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10274.632804 secs 2023-05-08T06:35:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:36 smithi133 ceph-mon[125939]: pgmap v5538: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 85 KiB/s wr, 10 op/s 2023-05-08T06:35:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10274.632804 secs 2023-05-08T06:35:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:36 smithi096 ceph-mon[124666]: pgmap v5538: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 85 KiB/s wr, 10 op/s 2023-05-08T06:35:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10274.632804 secs 2023-05-08T06:35:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:36 smithi186 ceph-mon[126480]: pgmap v5538: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 85 KiB/s wr, 10 op/s 2023-05-08T06:35:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:38 smithi133 ceph-mon[125939]: pgmap v5539: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 49 KiB/s wr, 6 op/s 2023-05-08T06:35:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:38 smithi096 ceph-mon[124666]: pgmap v5539: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 49 KiB/s wr, 6 op/s 2023-05-08T06:35:38.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:38 smithi186 ceph-mon[126480]: pgmap v5539: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 49 KiB/s wr, 6 op/s 2023-05-08T06:35:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10277.793980 secs 2023-05-08T06:35:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10277.793980 secs 2023-05-08T06:35:39.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10277.793980 secs 2023-05-08T06:35:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:40 smithi133 ceph-mon[125939]: pgmap v5540: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 75 KiB/s wr, 9 op/s 2023-05-08T06:35:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:40 smithi096 ceph-mon[124666]: pgmap v5540: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 75 KiB/s wr, 9 op/s 2023-05-08T06:35:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:40 smithi186 ceph-mon[126480]: pgmap v5540: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 75 KiB/s wr, 9 op/s 2023-05-08T06:35:41.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10279.632884 secs 2023-05-08T06:35:41.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:41 smithi133 ceph-mon[125939]: pgmap v5541: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 7 op/s 2023-05-08T06:35:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10279.632884 secs 2023-05-08T06:35:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:41 smithi096 ceph-mon[124666]: pgmap v5541: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 7 op/s 2023-05-08T06:35:41.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10279.632884 secs 2023-05-08T06:35:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:41 smithi186 ceph-mon[126480]: pgmap v5541: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 7 op/s 2023-05-08T06:35:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:35:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:35:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:35:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:43 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:35:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:35:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:35:43.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:43 smithi133 ceph-mon[125939]: pgmap v5542: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 53 KiB/s wr, 6 op/s 2023-05-08T06:35:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:43 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:35:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:35:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:35:43.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:43 smithi096 ceph-mon[124666]: pgmap v5542: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 53 KiB/s wr, 6 op/s 2023-05-08T06:35:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:43 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:35:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:35:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:35:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:43 smithi186 ceph-mon[126480]: pgmap v5542: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 53 KiB/s wr, 6 op/s 2023-05-08T06:35:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10282.794113 secs 2023-05-08T06:35:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10282.794113 secs 2023-05-08T06:35:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10282.794113 secs 2023-05-08T06:35:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:45 smithi133 ceph-mon[125939]: pgmap v5543: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 122 KiB/s wr, 12 op/s 2023-05-08T06:35:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:45 smithi096 ceph-mon[124666]: pgmap v5543: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 122 KiB/s wr, 12 op/s 2023-05-08T06:35:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:45 smithi186 ceph-mon[126480]: pgmap v5543: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 122 KiB/s wr, 12 op/s 2023-05-08T06:35:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:46 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:35:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:46 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:35:46.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:46 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:35:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:47 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:35:47.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:47 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:35:47.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:47 smithi133 ceph-mon[125939]: pgmap v5544: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 95 KiB/s wr, 9 op/s 2023-05-08T06:35:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:47 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:35:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:47 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:35:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:47 smithi096 ceph-mon[124666]: pgmap v5544: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 95 KiB/s wr, 9 op/s 2023-05-08T06:35:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:47 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:35:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:47 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:35:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:47 smithi186 ceph-mon[126480]: pgmap v5544: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 95 KiB/s wr, 9 op/s 2023-05-08T06:35:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10287.794250 secs 2023-05-08T06:35:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10287.794250 secs 2023-05-08T06:35:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10287.794250 secs 2023-05-08T06:35:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10288.351812 secs 2023-05-08T06:35:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:49 smithi186 ceph-mon[126480]: pgmap v5545: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 120 KiB/s wr, 12 op/s 2023-05-08T06:35:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10288.351812 secs 2023-05-08T06:35:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:49 smithi133 ceph-mon[125939]: pgmap v5545: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 120 KiB/s wr, 12 op/s 2023-05-08T06:35:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10288.351812 secs 2023-05-08T06:35:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:49 smithi096 ceph-mon[124666]: pgmap v5545: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 120 KiB/s wr, 12 op/s 2023-05-08T06:35:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:50 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:35:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:50 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:35:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:50 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:35:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:51 smithi186 ceph-mon[126480]: pgmap v5546: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 95 KiB/s wr, 10 op/s 2023-05-08T06:35:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:35:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:35:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:51 smithi133 ceph-mon[125939]: pgmap v5546: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 95 KiB/s wr, 10 op/s 2023-05-08T06:35:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:35:51.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:35:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:51 smithi096 ceph-mon[124666]: pgmap v5546: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 95 KiB/s wr, 10 op/s 2023-05-08T06:35:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:35:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:35:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10292.794373 secs 2023-05-08T06:35:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:54 smithi133 ceph-mon[125939]: pgmap v5547: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 95 KiB/s wr, 9 op/s 2023-05-08T06:35:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10293.351926 secs 2023-05-08T06:35:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10292.794373 secs 2023-05-08T06:35:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:54 smithi096 ceph-mon[124666]: pgmap v5547: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 95 KiB/s wr, 9 op/s 2023-05-08T06:35:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10293.351926 secs 2023-05-08T06:35:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10292.794373 secs 2023-05-08T06:35:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:54 smithi186 ceph-mon[126480]: pgmap v5547: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 95 KiB/s wr, 9 op/s 2023-05-08T06:35:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10293.351926 secs 2023-05-08T06:35:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:56 smithi133 ceph-mon[125939]: pgmap v5548: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 181 KiB/s wr, 14 op/s 2023-05-08T06:35:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:56 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:35:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:56 smithi096 ceph-mon[124666]: pgmap v5548: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 181 KiB/s wr, 14 op/s 2023-05-08T06:35:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:56 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:35:56.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:56 smithi186 ceph-mon[126480]: pgmap v5548: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 181 KiB/s wr, 14 op/s 2023-05-08T06:35:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:56 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:35:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:58 smithi133 ceph-mon[125939]: pgmap v5549: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 112 KiB/s wr, 8 op/s 2023-05-08T06:35:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:58 smithi096 ceph-mon[124666]: pgmap v5549: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 112 KiB/s wr, 8 op/s 2023-05-08T06:35:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:58 smithi186 ceph-mon[126480]: pgmap v5549: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 112 KiB/s wr, 8 op/s 2023-05-08T06:35:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10297.794492 secs 2023-05-08T06:35:59.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:35:59.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:35:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10298.351996 secs 2023-05-08T06:35:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10297.794492 secs 2023-05-08T06:35:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:35:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:35:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10298.351996 secs 2023-05-08T06:35:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10297.794492 secs 2023-05-08T06:35:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:35:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:35:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10298.351996 secs 2023-05-08T06:36:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:00 smithi133 ceph-mon[125939]: pgmap v5550: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 139 KiB/s wr, 12 op/s 2023-05-08T06:36:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:00 smithi096 ceph-mon[124666]: pgmap v5550: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 139 KiB/s wr, 12 op/s 2023-05-08T06:36:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:00 smithi186 ceph-mon[126480]: pgmap v5550: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 139 KiB/s wr, 12 op/s 2023-05-08T06:36:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10299.633364 secs 2023-05-08T06:36:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:01 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:36:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:01 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:36:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:01 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:36:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:01 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:36:01.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:01 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:36:01.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:01 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:36:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10299.633364 secs 2023-05-08T06:36:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:01 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:36:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:01 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:36:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:01 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:36:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:01 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:36:01.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:01 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:36:01.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:01 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:36:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10299.633364 secs 2023-05-08T06:36:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:01 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:36:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:01 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:36:01.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:01 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:36:01.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:01 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:36:01.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:01 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:36:01.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:01 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:36:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:02 smithi133 ceph-mon[125939]: pgmap v5551: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 113 KiB/s wr, 10 op/s 2023-05-08T06:36:02.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:02 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:36:02.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:02 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:36:02.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:02 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:36:02.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:02 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:36:02.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:02 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:36:02.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:02 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:36:02.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:02 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:36:02.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:02 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:36:02.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:02 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:36:02.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:02 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:36:02.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:02 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:36:02.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:02 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:36:02.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:02 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:36:02.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:02 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:36:02.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:02 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:36:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:02 smithi096 ceph-mon[124666]: pgmap v5551: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 113 KiB/s wr, 10 op/s 2023-05-08T06:36:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:02 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:36:02.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:02 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:36:02.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:02 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:36:02.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:02 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:36:02.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:02 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:36:02.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:02 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:36:02.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:02 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:36:02.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:02 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:36:02.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:02 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:36:02.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:02 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:36:02.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:02 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:36:02.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:02 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:36:02.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:02 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:36:02.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:02 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:36:02.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:02 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:36:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:02 smithi186 ceph-mon[126480]: pgmap v5551: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 113 KiB/s wr, 10 op/s 2023-05-08T06:36:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:02 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:36:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:02 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:36:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:02 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:36:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:02 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:36:02.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:02 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:36:02.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:02 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:36:02.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:02 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:36:02.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:02 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:36:02.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:02 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:36:02.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:02 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:36:02.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:02 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:36:02.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:02 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:36:02.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:02 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:36:02.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:02 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:36:02.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:02 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:36:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:03 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T06:36:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:03 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T06:36:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:03 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T06:36:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:03 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T06:36:03.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:03 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi096 to 196.2M 2023-05-08T06:36:03.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:03 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi096 to 205766758: error parsing value: Value '205766758' is below minimum 939524096 2023-05-08T06:36:03.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:03 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:36:03.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:03 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T06:36:03.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:03 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T06:36:03.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:03 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:36:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:03 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T06:36:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:03 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T06:36:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:03 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T06:36:03.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:03 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T06:36:03.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:03 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi096 to 196.2M 2023-05-08T06:36:03.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:03 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi096 to 205766758: error parsing value: Value '205766758' is below minimum 939524096 2023-05-08T06:36:03.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:03 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:36:03.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:03 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T06:36:03.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:03 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T06:36:03.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:03 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:36:03.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:03 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T06:36:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:03 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T06:36:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:03 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T06:36:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:03 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T06:36:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:03 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi096 to 196.2M 2023-05-08T06:36:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:03 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi096 to 205766758: error parsing value: Value '205766758' is below minimum 939524096 2023-05-08T06:36:03.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:03 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:36:03.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:03 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T06:36:03.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:03 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T06:36:03.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:03 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:36:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10302.794610 secs 2023-05-08T06:36:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:04 smithi133 ceph-mon[125939]: pgmap v5552: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 113 KiB/s wr, 9 op/s 2023-05-08T06:36:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:04 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:36:04.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:04 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:36:04.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:04 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:36:04.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10303.352132 secs 2023-05-08T06:36:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10302.794610 secs 2023-05-08T06:36:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:04 smithi096 ceph-mon[124666]: pgmap v5552: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 113 KiB/s wr, 9 op/s 2023-05-08T06:36:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:04 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:36:04.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:04 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:36:04.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:04 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:36:04.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10303.352132 secs 2023-05-08T06:36:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10302.794610 secs 2023-05-08T06:36:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:04 smithi186 ceph-mon[126480]: pgmap v5552: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 113 KiB/s wr, 9 op/s 2023-05-08T06:36:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:04 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:36:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:04 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:36:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:04 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:36:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10303.352132 secs 2023-05-08T06:36:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10304.633516 secs 2023-05-08T06:36:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:06 smithi133 ceph-mon[125939]: pgmap v5553: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 201 KiB/s wr, 27 op/s 2023-05-08T06:36:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:06 smithi133 ceph-mon[125939]: osdmap e424: 12 total, 12 up, 12 in 2023-05-08T06:36:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10304.633516 secs 2023-05-08T06:36:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:06 smithi096 ceph-mon[124666]: pgmap v5553: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 201 KiB/s wr, 27 op/s 2023-05-08T06:36:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:06 smithi096 ceph-mon[124666]: osdmap e424: 12 total, 12 up, 12 in 2023-05-08T06:36:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10304.633516 secs 2023-05-08T06:36:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:06 smithi186 ceph-mon[126480]: pgmap v5553: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 201 KiB/s wr, 27 op/s 2023-05-08T06:36:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:06 smithi186 ceph-mon[126480]: osdmap e424: 12 total, 12 up, 12 in 2023-05-08T06:36:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:08 smithi133 ceph-mon[125939]: pgmap v5555: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 138 KiB/s wr, 27 op/s 2023-05-08T06:36:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:08 smithi096 ceph-mon[124666]: pgmap v5555: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 138 KiB/s wr, 27 op/s 2023-05-08T06:36:08.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:08 smithi186 ceph-mon[126480]: pgmap v5555: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 138 KiB/s wr, 27 op/s 2023-05-08T06:36:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10307.794702 secs 2023-05-08T06:36:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10308.352245 secs 2023-05-08T06:36:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10307.794702 secs 2023-05-08T06:36:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10308.352245 secs 2023-05-08T06:36:09.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10307.794702 secs 2023-05-08T06:36:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10308.352245 secs 2023-05-08T06:36:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:10 smithi133 ceph-mon[125939]: pgmap v5556: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 132 KiB/s wr, 26 op/s 2023-05-08T06:36:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:10 smithi096 ceph-mon[124666]: pgmap v5556: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 132 KiB/s wr, 26 op/s 2023-05-08T06:36:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:10 smithi186 ceph-mon[126480]: pgmap v5556: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 132 KiB/s wr, 26 op/s 2023-05-08T06:36:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10309.633661 secs 2023-05-08T06:36:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10309.633661 secs 2023-05-08T06:36:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10309.633661 secs 2023-05-08T06:36:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:12 smithi133 ceph-mon[125939]: pgmap v5557: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 132 KiB/s wr, 25 op/s 2023-05-08T06:36:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:12 smithi096 ceph-mon[124666]: pgmap v5557: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 132 KiB/s wr, 25 op/s 2023-05-08T06:36:12.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:12 smithi186 ceph-mon[126480]: pgmap v5557: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 132 KiB/s wr, 25 op/s 2023-05-08T06:36:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:13 smithi133 ceph-mon[125939]: pgmap v5558: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 132 KiB/s wr, 25 op/s 2023-05-08T06:36:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:13 smithi096 ceph-mon[124666]: pgmap v5558: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 132 KiB/s wr, 25 op/s 2023-05-08T06:36:13.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:13 smithi186 ceph-mon[126480]: pgmap v5558: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 132 KiB/s wr, 25 op/s 2023-05-08T06:36:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10312.794824 secs 2023-05-08T06:36:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10313.352355 secs 2023-05-08T06:36:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10312.794824 secs 2023-05-08T06:36:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10313.352355 secs 2023-05-08T06:36:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10312.794824 secs 2023-05-08T06:36:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10313.352355 secs 2023-05-08T06:36:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:15 smithi133 ceph-mon[125939]: pgmap v5559: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 44 KiB/s wr, 8 op/s 2023-05-08T06:36:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:15 smithi096 ceph-mon[124666]: pgmap v5559: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 44 KiB/s wr, 8 op/s 2023-05-08T06:36:15.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:15 smithi186 ceph-mon[126480]: pgmap v5559: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 44 KiB/s wr, 8 op/s 2023-05-08T06:36:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10314.633801 secs 2023-05-08T06:36:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:16 smithi133 ceph-mon[125939]: osdmap e425: 12 total, 12 up, 12 in 2023-05-08T06:36:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10314.633801 secs 2023-05-08T06:36:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:16 smithi096 ceph-mon[124666]: osdmap e425: 12 total, 12 up, 12 in 2023-05-08T06:36:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10314.633801 secs 2023-05-08T06:36:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:16 smithi186 ceph-mon[126480]: osdmap e425: 12 total, 12 up, 12 in 2023-05-08T06:36:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:17 smithi133 ceph-mon[125939]: pgmap v5561: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 44 KiB/s wr, 8 op/s 2023-05-08T06:36:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:17 smithi096 ceph-mon[124666]: pgmap v5561: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 44 KiB/s wr, 8 op/s 2023-05-08T06:36:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:17 smithi186 ceph-mon[126480]: pgmap v5561: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 44 KiB/s wr, 8 op/s 2023-05-08T06:36:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10317.794943 secs 2023-05-08T06:36:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10317.794943 secs 2023-05-08T06:36:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10317.794943 secs 2023-05-08T06:36:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10318.352448 secs 2023-05-08T06:36:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:19 smithi186 ceph-mon[126480]: pgmap v5562: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 7 op/s 2023-05-08T06:36:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10318.352448 secs 2023-05-08T06:36:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:19 smithi133 ceph-mon[125939]: pgmap v5562: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 7 op/s 2023-05-08T06:36:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10318.352448 secs 2023-05-08T06:36:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:19 smithi096 ceph-mon[124666]: pgmap v5562: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 7 op/s 2023-05-08T06:36:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10319.633927 secs 2023-05-08T06:36:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10319.633927 secs 2023-05-08T06:36:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10319.633927 secs 2023-05-08T06:36:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:21 smithi186 ceph-mon[126480]: pgmap v5563: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 7 op/s 2023-05-08T06:36:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:21 smithi133 ceph-mon[125939]: pgmap v5563: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 7 op/s 2023-05-08T06:36:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:21 smithi096 ceph-mon[124666]: pgmap v5563: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 7 op/s 2023-05-08T06:36:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10322.795061 secs 2023-05-08T06:36:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:24 smithi133 ceph-mon[125939]: pgmap v5564: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 7 op/s 2023-05-08T06:36:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10323.352566 secs 2023-05-08T06:36:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10322.795061 secs 2023-05-08T06:36:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:24 smithi096 ceph-mon[124666]: pgmap v5564: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 7 op/s 2023-05-08T06:36:24.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10323.352566 secs 2023-05-08T06:36:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10322.795061 secs 2023-05-08T06:36:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:24 smithi186 ceph-mon[126480]: pgmap v5564: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 7 op/s 2023-05-08T06:36:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10323.352566 secs 2023-05-08T06:36:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10324.634083 secs 2023-05-08T06:36:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:26 smithi133 ceph-mon[125939]: pgmap v5565: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 42 KiB/s wr, 8 op/s 2023-05-08T06:36:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10324.634083 secs 2023-05-08T06:36:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:26 smithi096 ceph-mon[124666]: pgmap v5565: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 42 KiB/s wr, 8 op/s 2023-05-08T06:36:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10324.634083 secs 2023-05-08T06:36:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:26 smithi186 ceph-mon[126480]: pgmap v5565: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 42 KiB/s wr, 8 op/s 2023-05-08T06:36:28.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:28 smithi133 ceph-mon[125939]: pgmap v5566: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 6 op/s 2023-05-08T06:36:28.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:28 smithi096 ceph-mon[124666]: pgmap v5566: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 6 op/s 2023-05-08T06:36:28.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:28 smithi186 ceph-mon[126480]: pgmap v5566: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 6 op/s 2023-05-08T06:36:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10327.795208 secs 2023-05-08T06:36:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10328.352658 secs 2023-05-08T06:36:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10327.795208 secs 2023-05-08T06:36:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10328.352658 secs 2023-05-08T06:36:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10327.795208 secs 2023-05-08T06:36:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10328.352658 secs 2023-05-08T06:36:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:30 smithi133 ceph-mon[125939]: pgmap v5567: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 57 KiB/s wr, 9 op/s 2023-05-08T06:36:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:30 smithi096 ceph-mon[124666]: pgmap v5567: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 57 KiB/s wr, 9 op/s 2023-05-08T06:36:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:30 smithi186 ceph-mon[126480]: pgmap v5567: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 57 KiB/s wr, 9 op/s 2023-05-08T06:36:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10329.634208 secs 2023-05-08T06:36:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10329.634208 secs 2023-05-08T06:36:31.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10329.634208 secs 2023-05-08T06:36:32.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:32 smithi133 ceph-mon[125939]: pgmap v5568: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 56 KiB/s wr, 7 op/s 2023-05-08T06:36:32.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:32 smithi096 ceph-mon[124666]: pgmap v5568: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 56 KiB/s wr, 7 op/s 2023-05-08T06:36:32.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:32 smithi186 ceph-mon[126480]: pgmap v5568: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 56 KiB/s wr, 7 op/s 2023-05-08T06:36:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10332.795323 secs 2023-05-08T06:36:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:34 smithi133 ceph-mon[125939]: pgmap v5569: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 7 op/s 2023-05-08T06:36:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10333.352748 secs 2023-05-08T06:36:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10332.795323 secs 2023-05-08T06:36:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:34 smithi096 ceph-mon[124666]: pgmap v5569: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 7 op/s 2023-05-08T06:36:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10333.352748 secs 2023-05-08T06:36:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10332.795323 secs 2023-05-08T06:36:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:34 smithi186 ceph-mon[126480]: pgmap v5569: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 7 op/s 2023-05-08T06:36:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10333.352748 secs 2023-05-08T06:36:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10334.634293 secs 2023-05-08T06:36:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:36 smithi133 ceph-mon[125939]: pgmap v5570: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 85 KiB/s wr, 10 op/s 2023-05-08T06:36:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10334.634293 secs 2023-05-08T06:36:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:36 smithi096 ceph-mon[124666]: pgmap v5570: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 85 KiB/s wr, 10 op/s 2023-05-08T06:36:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10334.634293 secs 2023-05-08T06:36:36.650 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:36 smithi186 ceph-mon[126480]: pgmap v5570: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 85 KiB/s wr, 10 op/s 2023-05-08T06:36:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:38 smithi133 ceph-mon[125939]: pgmap v5571: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 50 KiB/s wr, 6 op/s 2023-05-08T06:36:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:38 smithi096 ceph-mon[124666]: pgmap v5571: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 50 KiB/s wr, 6 op/s 2023-05-08T06:36:38.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:38 smithi186 ceph-mon[126480]: pgmap v5571: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 50 KiB/s wr, 6 op/s 2023-05-08T06:36:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10337.795435 secs 2023-05-08T06:36:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10337.795435 secs 2023-05-08T06:36:39.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10337.795435 secs 2023-05-08T06:36:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:40 smithi133 ceph-mon[125939]: pgmap v5572: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 76 KiB/s wr, 9 op/s 2023-05-08T06:36:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:40 smithi096 ceph-mon[124666]: pgmap v5572: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 76 KiB/s wr, 9 op/s 2023-05-08T06:36:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:40 smithi186 ceph-mon[126480]: pgmap v5572: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 76 KiB/s wr, 9 op/s 2023-05-08T06:36:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10339.634418 secs 2023-05-08T06:36:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10339.634418 secs 2023-05-08T06:36:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10339.634418 secs 2023-05-08T06:36:42.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:42 smithi133 ceph-mon[125939]: pgmap v5573: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 54 KiB/s wr, 7 op/s 2023-05-08T06:36:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:42 smithi096 ceph-mon[124666]: pgmap v5573: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 54 KiB/s wr, 7 op/s 2023-05-08T06:36:42.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:42 smithi186 ceph-mon[126480]: pgmap v5573: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 54 KiB/s wr, 7 op/s 2023-05-08T06:36:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:36:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:43 smithi133 ceph-mon[125939]: pgmap v5574: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 6 op/s 2023-05-08T06:36:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:36:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:43 smithi096 ceph-mon[124666]: pgmap v5574: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 6 op/s 2023-05-08T06:36:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:36:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:43 smithi186 ceph-mon[126480]: pgmap v5574: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 6 op/s 2023-05-08T06:36:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10342.795528 secs 2023-05-08T06:36:44.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:36:44.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:36:44.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:36:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10342.795528 secs 2023-05-08T06:36:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:36:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:36:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:36:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10342.795528 secs 2023-05-08T06:36:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:36:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:36:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:36:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:45 smithi133 ceph-mon[125939]: pgmap v5575: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 126 KiB/s wr, 11 op/s 2023-05-08T06:36:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:45 smithi096 ceph-mon[124666]: pgmap v5575: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 126 KiB/s wr, 11 op/s 2023-05-08T06:36:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:45 smithi186 ceph-mon[126480]: pgmap v5575: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 126 KiB/s wr, 11 op/s 2023-05-08T06:36:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:46 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:36:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:46 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:36:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:46 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:36:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:47 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:36:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:47 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:36:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:47 smithi186 ceph-mon[126480]: pgmap v5576: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 97 KiB/s wr, 8 op/s 2023-05-08T06:36:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:47 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:36:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:47 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:36:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:47 smithi133 ceph-mon[125939]: pgmap v5576: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 97 KiB/s wr, 8 op/s 2023-05-08T06:36:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:47 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:36:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:47 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:36:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:47 smithi096 ceph-mon[124666]: pgmap v5576: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 97 KiB/s wr, 8 op/s 2023-05-08T06:36:48.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10347.795624 secs 2023-05-08T06:36:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10347.795624 secs 2023-05-08T06:36:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10347.795624 secs 2023-05-08T06:36:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10348.353059 secs 2023-05-08T06:36:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:49 smithi186 ceph-mon[126480]: pgmap v5577: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 147 KiB/s wr, 12 op/s 2023-05-08T06:36:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10348.353059 secs 2023-05-08T06:36:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:49 smithi133 ceph-mon[125939]: pgmap v5577: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 147 KiB/s wr, 12 op/s 2023-05-08T06:36:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10348.353059 secs 2023-05-08T06:36:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:49 smithi096 ceph-mon[124666]: pgmap v5577: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 147 KiB/s wr, 12 op/s 2023-05-08T06:36:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:50 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:36:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:50 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:36:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:50 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:36:51.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:51 smithi186 ceph-mon[126480]: pgmap v5578: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 121 KiB/s wr, 11 op/s 2023-05-08T06:36:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:36:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:36:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:51 smithi133 ceph-mon[125939]: pgmap v5578: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 121 KiB/s wr, 11 op/s 2023-05-08T06:36:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:36:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:36:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:51 smithi096 ceph-mon[124666]: pgmap v5578: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 121 KiB/s wr, 11 op/s 2023-05-08T06:36:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:36:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:36:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10352.795766 secs 2023-05-08T06:36:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:54 smithi133 ceph-mon[125939]: pgmap v5579: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 121 KiB/s wr, 10 op/s 2023-05-08T06:36:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10353.353177 secs 2023-05-08T06:36:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10352.795766 secs 2023-05-08T06:36:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:54 smithi096 ceph-mon[124666]: pgmap v5579: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 121 KiB/s wr, 10 op/s 2023-05-08T06:36:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10353.353177 secs 2023-05-08T06:36:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10352.795766 secs 2023-05-08T06:36:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:54 smithi186 ceph-mon[126480]: pgmap v5579: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 121 KiB/s wr, 10 op/s 2023-05-08T06:36:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10353.353177 secs 2023-05-08T06:36:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:56 smithi133 ceph-mon[125939]: pgmap v5580: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 219 KiB/s wr, 14 op/s 2023-05-08T06:36:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:56 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:36:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:56 smithi096 ceph-mon[124666]: pgmap v5580: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 219 KiB/s wr, 14 op/s 2023-05-08T06:36:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:56 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:36:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:56 smithi186 ceph-mon[126480]: pgmap v5580: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 219 KiB/s wr, 14 op/s 2023-05-08T06:36:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:56 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:36:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:58 smithi133 ceph-mon[125939]: pgmap v5581: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 148 KiB/s wr, 9 op/s 2023-05-08T06:36:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:58 smithi096 ceph-mon[124666]: pgmap v5581: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 148 KiB/s wr, 9 op/s 2023-05-08T06:36:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:58 smithi186 ceph-mon[126480]: pgmap v5581: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 148 KiB/s wr, 9 op/s 2023-05-08T06:36:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10357.795913 secs 2023-05-08T06:36:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:36:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10358.353310 secs 2023-05-08T06:36:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10357.795913 secs 2023-05-08T06:36:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:36:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10358.353310 secs 2023-05-08T06:36:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10357.795913 secs 2023-05-08T06:36:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:36:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10358.353310 secs 2023-05-08T06:37:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:00 smithi133 ceph-mon[125939]: pgmap v5582: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 174 KiB/s wr, 12 op/s 2023-05-08T06:37:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:00 smithi096 ceph-mon[124666]: pgmap v5582: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 174 KiB/s wr, 12 op/s 2023-05-08T06:37:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:00 smithi186 ceph-mon[126480]: pgmap v5582: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 174 KiB/s wr, 12 op/s 2023-05-08T06:37:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10359.634945 secs 2023-05-08T06:37:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10359.634945 secs 2023-05-08T06:37:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10359.634945 secs 2023-05-08T06:37:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:02 smithi133 ceph-mon[125939]: pgmap v5583: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 124 KiB/s wr, 9 op/s 2023-05-08T06:37:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:02 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:37:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:02 smithi096 ceph-mon[124666]: pgmap v5583: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 124 KiB/s wr, 9 op/s 2023-05-08T06:37:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:02 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:37:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:02 smithi186 ceph-mon[126480]: pgmap v5583: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 124 KiB/s wr, 9 op/s 2023-05-08T06:37:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:02 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:37:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:37:03.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:37:03.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:37:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:37:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:37:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:37:03.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:37:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:37:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:37:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:04 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:37:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:04 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T06:37:04.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:04 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T06:37:04.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:04 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:37:04.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10362.796061 secs 2023-05-08T06:37:04.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:04 smithi133 ceph-mon[125939]: pgmap v5584: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 124 KiB/s wr, 8 op/s 2023-05-08T06:37:04.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:04 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:37:04.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:04 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:37:04.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:04 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:37:04.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10363.353449 secs 2023-05-08T06:37:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:04 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:37:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:04 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T06:37:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:04 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T06:37:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:04 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:37:04.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10362.796061 secs 2023-05-08T06:37:04.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:04 smithi096 ceph-mon[124666]: pgmap v5584: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 124 KiB/s wr, 8 op/s 2023-05-08T06:37:04.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:04 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:37:04.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:04 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:37:04.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:04 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:37:04.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10363.353449 secs 2023-05-08T06:37:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:04 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:37:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:04 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T06:37:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:04 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T06:37:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:04 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:37:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10362.796061 secs 2023-05-08T06:37:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:04 smithi186 ceph-mon[126480]: pgmap v5584: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 124 KiB/s wr, 8 op/s 2023-05-08T06:37:04.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:04 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:37:04.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:04 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:37:04.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:04 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:37:04.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10363.353449 secs 2023-05-08T06:37:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10364.635065 secs 2023-05-08T06:37:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:06 smithi133 ceph-mon[125939]: pgmap v5585: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 213 KiB/s wr, 26 op/s 2023-05-08T06:37:06.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:06 smithi133 ceph-mon[125939]: osdmap e426: 12 total, 12 up, 12 in 2023-05-08T06:37:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10364.635065 secs 2023-05-08T06:37:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:06 smithi096 ceph-mon[124666]: pgmap v5585: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 213 KiB/s wr, 26 op/s 2023-05-08T06:37:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:06 smithi096 ceph-mon[124666]: osdmap e426: 12 total, 12 up, 12 in 2023-05-08T06:37:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10364.635065 secs 2023-05-08T06:37:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:06 smithi186 ceph-mon[126480]: pgmap v5585: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 213 KiB/s wr, 26 op/s 2023-05-08T06:37:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:06 smithi186 ceph-mon[126480]: osdmap e426: 12 total, 12 up, 12 in 2023-05-08T06:37:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:08 smithi133 ceph-mon[125939]: pgmap v5587: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 138 KiB/s wr, 26 op/s 2023-05-08T06:37:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:08 smithi096 ceph-mon[124666]: pgmap v5587: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 138 KiB/s wr, 26 op/s 2023-05-08T06:37:08.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:08 smithi186 ceph-mon[126480]: pgmap v5587: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 138 KiB/s wr, 26 op/s 2023-05-08T06:37:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10367.796160 secs 2023-05-08T06:37:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10368.353551 secs 2023-05-08T06:37:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10367.796160 secs 2023-05-08T06:37:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10368.353551 secs 2023-05-08T06:37:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10367.796160 secs 2023-05-08T06:37:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10368.353551 secs 2023-05-08T06:37:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:10 smithi133 ceph-mon[125939]: pgmap v5588: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 133 KiB/s wr, 25 op/s 2023-05-08T06:37:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:10 smithi096 ceph-mon[124666]: pgmap v5588: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 133 KiB/s wr, 25 op/s 2023-05-08T06:37:10.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:10 smithi186 ceph-mon[126480]: pgmap v5588: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 133 KiB/s wr, 25 op/s 2023-05-08T06:37:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10369.635187 secs 2023-05-08T06:37:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:11 smithi133 ceph-mon[125939]: pgmap v5589: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 133 KiB/s wr, 25 op/s 2023-05-08T06:37:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10369.635187 secs 2023-05-08T06:37:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:11 smithi096 ceph-mon[124666]: pgmap v5589: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 133 KiB/s wr, 25 op/s 2023-05-08T06:37:11.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10369.635187 secs 2023-05-08T06:37:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:11 smithi186 ceph-mon[126480]: pgmap v5589: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 133 KiB/s wr, 25 op/s 2023-05-08T06:37:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10372.796280 secs 2023-05-08T06:37:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:14 smithi133 ceph-mon[125939]: pgmap v5590: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 133 KiB/s wr, 25 op/s 2023-05-08T06:37:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10373.353665 secs 2023-05-08T06:37:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10372.796280 secs 2023-05-08T06:37:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:14 smithi096 ceph-mon[124666]: pgmap v5590: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 133 KiB/s wr, 25 op/s 2023-05-08T06:37:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10373.353665 secs 2023-05-08T06:37:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10372.796280 secs 2023-05-08T06:37:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:14 smithi186 ceph-mon[126480]: pgmap v5590: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 133 KiB/s wr, 25 op/s 2023-05-08T06:37:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10373.353665 secs 2023-05-08T06:37:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10374.635305 secs 2023-05-08T06:37:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:16 smithi133 ceph-mon[125939]: pgmap v5591: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 50 KiB/s wr, 8 op/s 2023-05-08T06:37:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:16 smithi133 ceph-mon[125939]: osdmap e427: 12 total, 12 up, 12 in 2023-05-08T06:37:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10374.635305 secs 2023-05-08T06:37:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:16 smithi096 ceph-mon[124666]: pgmap v5591: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 50 KiB/s wr, 8 op/s 2023-05-08T06:37:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:16 smithi096 ceph-mon[124666]: osdmap e427: 12 total, 12 up, 12 in 2023-05-08T06:37:16.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10374.635305 secs 2023-05-08T06:37:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:16 smithi186 ceph-mon[126480]: pgmap v5591: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 50 KiB/s wr, 8 op/s 2023-05-08T06:37:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:16 smithi186 ceph-mon[126480]: osdmap e427: 12 total, 12 up, 12 in 2023-05-08T06:37:18.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:18 smithi133 ceph-mon[125939]: pgmap v5593: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 50 KiB/s wr, 8 op/s 2023-05-08T06:37:18.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:18 smithi096 ceph-mon[124666]: pgmap v5593: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 50 KiB/s wr, 8 op/s 2023-05-08T06:37:18.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:18 smithi186 ceph-mon[126480]: pgmap v5593: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 50 KiB/s wr, 8 op/s 2023-05-08T06:37:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10377.796399 secs 2023-05-08T06:37:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10378.353767 secs 2023-05-08T06:37:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10377.796399 secs 2023-05-08T06:37:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10378.353767 secs 2023-05-08T06:37:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10377.796399 secs 2023-05-08T06:37:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10378.353767 secs 2023-05-08T06:37:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:20 smithi133 ceph-mon[125939]: pgmap v5594: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 8 op/s 2023-05-08T06:37:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:20 smithi096 ceph-mon[124666]: pgmap v5594: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 8 op/s 2023-05-08T06:37:20.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:20 smithi186 ceph-mon[126480]: pgmap v5594: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 8 op/s 2023-05-08T06:37:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10379.635370 secs 2023-05-08T06:37:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10379.635370 secs 2023-05-08T06:37:21.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10379.635370 secs 2023-05-08T06:37:22.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:22 smithi133 ceph-mon[125939]: pgmap v5595: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 8 op/s 2023-05-08T06:37:22.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:22 smithi096 ceph-mon[124666]: pgmap v5595: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 8 op/s 2023-05-08T06:37:22.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:22 smithi186 ceph-mon[126480]: pgmap v5595: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 8 op/s 2023-05-08T06:37:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10382.796517 secs 2023-05-08T06:37:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:24 smithi133 ceph-mon[125939]: pgmap v5596: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 8 op/s 2023-05-08T06:37:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10383.353887 secs 2023-05-08T06:37:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10382.796517 secs 2023-05-08T06:37:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:24 smithi096 ceph-mon[124666]: pgmap v5596: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 8 op/s 2023-05-08T06:37:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10383.353887 secs 2023-05-08T06:37:24.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10382.796517 secs 2023-05-08T06:37:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:24 smithi186 ceph-mon[126480]: pgmap v5596: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 8 op/s 2023-05-08T06:37:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10383.353887 secs 2023-05-08T06:37:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10384.635444 secs 2023-05-08T06:37:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:26 smithi133 ceph-mon[125939]: pgmap v5597: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 43 KiB/s wr, 8 op/s 2023-05-08T06:37:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10384.635444 secs 2023-05-08T06:37:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:26 smithi096 ceph-mon[124666]: pgmap v5597: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 43 KiB/s wr, 8 op/s 2023-05-08T06:37:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10384.635444 secs 2023-05-08T06:37:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:26 smithi186 ceph-mon[126480]: pgmap v5597: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 43 KiB/s wr, 8 op/s 2023-05-08T06:37:28.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:28 smithi133 ceph-mon[125939]: pgmap v5598: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 36 KiB/s wr, 7 op/s 2023-05-08T06:37:28.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:28 smithi096 ceph-mon[124666]: pgmap v5598: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 36 KiB/s wr, 7 op/s 2023-05-08T06:37:28.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:28 smithi186 ceph-mon[126480]: pgmap v5598: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 36 KiB/s wr, 7 op/s 2023-05-08T06:37:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10387.796634 secs 2023-05-08T06:37:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10388.353989 secs 2023-05-08T06:37:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10387.796634 secs 2023-05-08T06:37:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10388.353989 secs 2023-05-08T06:37:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10387.796634 secs 2023-05-08T06:37:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10388.353989 secs 2023-05-08T06:37:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:30 smithi133 ceph-mon[125939]: pgmap v5599: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 58 KiB/s wr, 9 op/s 2023-05-08T06:37:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:30 smithi096 ceph-mon[124666]: pgmap v5599: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 58 KiB/s wr, 9 op/s 2023-05-08T06:37:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:30 smithi186 ceph-mon[126480]: pgmap v5599: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 58 KiB/s wr, 9 op/s 2023-05-08T06:37:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10389.635570 secs 2023-05-08T06:37:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10389.635570 secs 2023-05-08T06:37:31.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10389.635570 secs 2023-05-08T06:37:32.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:32 smithi133 ceph-mon[125939]: pgmap v5600: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 8 op/s 2023-05-08T06:37:32.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:32 smithi096 ceph-mon[124666]: pgmap v5600: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 8 op/s 2023-05-08T06:37:32.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:32 smithi186 ceph-mon[126480]: pgmap v5600: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 8 op/s 2023-05-08T06:37:33.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:33 smithi133 ceph-mon[125939]: pgmap v5601: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 57 KiB/s wr, 7 op/s 2023-05-08T06:37:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:33 smithi096 ceph-mon[124666]: pgmap v5601: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 57 KiB/s wr, 7 op/s 2023-05-08T06:37:33.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:33 smithi186 ceph-mon[126480]: pgmap v5601: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 57 KiB/s wr, 7 op/s 2023-05-08T06:37:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10392.796753 secs 2023-05-08T06:37:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10393.354081 secs 2023-05-08T06:37:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10392.796753 secs 2023-05-08T06:37:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10393.354081 secs 2023-05-08T06:37:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10392.796753 secs 2023-05-08T06:37:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10393.354081 secs 2023-05-08T06:37:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:35 smithi133 ceph-mon[125939]: pgmap v5602: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 103 KiB/s wr, 10 op/s 2023-05-08T06:37:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:35 smithi096 ceph-mon[124666]: pgmap v5602: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 103 KiB/s wr, 10 op/s 2023-05-08T06:37:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:35 smithi186 ceph-mon[126480]: pgmap v5602: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 103 KiB/s wr, 10 op/s 2023-05-08T06:37:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10394.635688 secs 2023-05-08T06:37:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10394.635688 secs 2023-05-08T06:37:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10394.635688 secs 2023-05-08T06:37:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:37 smithi096 ceph-mon[124666]: pgmap v5603: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 68 KiB/s wr, 6 op/s 2023-05-08T06:37:37.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:37 smithi186 ceph-mon[126480]: pgmap v5603: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 68 KiB/s wr, 6 op/s 2023-05-08T06:37:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:37 smithi133 ceph-mon[125939]: pgmap v5603: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 68 KiB/s wr, 6 op/s 2023-05-08T06:37:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10397.796852 secs 2023-05-08T06:37:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10397.796852 secs 2023-05-08T06:37:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10397.796852 secs 2023-05-08T06:37:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:39 smithi186 ceph-mon[126480]: pgmap v5604: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 137 KiB/s wr, 10 op/s 2023-05-08T06:37:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:39 smithi133 ceph-mon[125939]: pgmap v5604: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 137 KiB/s wr, 10 op/s 2023-05-08T06:37:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:39 smithi096 ceph-mon[124666]: pgmap v5604: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 137 KiB/s wr, 10 op/s 2023-05-08T06:37:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10399.635809 secs 2023-05-08T06:37:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10399.635809 secs 2023-05-08T06:37:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10399.635809 secs 2023-05-08T06:37:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:41 smithi186 ceph-mon[126480]: pgmap v5605: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 115 KiB/s wr, 8 op/s 2023-05-08T06:37:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:41 smithi133 ceph-mon[125939]: pgmap v5605: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 115 KiB/s wr, 8 op/s 2023-05-08T06:37:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:41 smithi096 ceph-mon[124666]: pgmap v5605: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 115 KiB/s wr, 8 op/s 2023-05-08T06:37:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:37:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:37:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:37:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:43 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:37:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:37:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:37:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10402.796974 secs 2023-05-08T06:37:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:43 smithi186 ceph-mon[126480]: pgmap v5606: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 115 KiB/s wr, 7 op/s 2023-05-08T06:37:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:43 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:37:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:37:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:37:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10402.796974 secs 2023-05-08T06:37:43.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:43 smithi133 ceph-mon[125939]: pgmap v5606: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 115 KiB/s wr, 7 op/s 2023-05-08T06:37:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:43 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:37:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:37:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:37:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10402.796974 secs 2023-05-08T06:37:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:43 smithi096 ceph-mon[124666]: pgmap v5606: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 115 KiB/s wr, 7 op/s 2023-05-08T06:37:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:46 smithi133 ceph-mon[125939]: pgmap v5607: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 199 KiB/s wr, 13 op/s 2023-05-08T06:37:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:46 smithi096 ceph-mon[124666]: pgmap v5607: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 199 KiB/s wr, 13 op/s 2023-05-08T06:37:46.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:46 smithi186 ceph-mon[126480]: pgmap v5607: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 199 KiB/s wr, 13 op/s 2023-05-08T06:37:47.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:37:47.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:37:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:37:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:48 smithi133 ceph-mon[125939]: pgmap v5608: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 153 KiB/s wr, 9 op/s 2023-05-08T06:37:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:37:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:37:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:48 smithi096 ceph-mon[124666]: pgmap v5608: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 153 KiB/s wr, 9 op/s 2023-05-08T06:37:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:37:48.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:37:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:48 smithi186 ceph-mon[126480]: pgmap v5608: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 153 KiB/s wr, 9 op/s 2023-05-08T06:37:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:37:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:37:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10407.797090 secs 2023-05-08T06:37:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10408.354485 secs 2023-05-08T06:37:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10407.797090 secs 2023-05-08T06:37:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10408.354485 secs 2023-05-08T06:37:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10407.797090 secs 2023-05-08T06:37:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10408.354485 secs 2023-05-08T06:37:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:50 smithi133 ceph-mon[125939]: pgmap v5609: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 162 KiB/s wr, 12 op/s 2023-05-08T06:37:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:50 smithi096 ceph-mon[124666]: pgmap v5609: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 162 KiB/s wr, 12 op/s 2023-05-08T06:37:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:50 smithi186 ceph-mon[126480]: pgmap v5609: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 162 KiB/s wr, 12 op/s 2023-05-08T06:37:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:51 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:37:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:51 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:37:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:51 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:37:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:52 smithi133 ceph-mon[125939]: pgmap v5610: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 93 KiB/s wr, 10 op/s 2023-05-08T06:37:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:37:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:37:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:52 smithi096 ceph-mon[124666]: pgmap v5610: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 93 KiB/s wr, 10 op/s 2023-05-08T06:37:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:37:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:37:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:52 smithi186 ceph-mon[126480]: pgmap v5610: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 93 KiB/s wr, 10 op/s 2023-05-08T06:37:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:37:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:37:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10412.797209 secs 2023-05-08T06:37:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:54 smithi133 ceph-mon[125939]: pgmap v5611: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 93 KiB/s wr, 9 op/s 2023-05-08T06:37:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10413.354597 secs 2023-05-08T06:37:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10412.797209 secs 2023-05-08T06:37:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:54 smithi096 ceph-mon[124666]: pgmap v5611: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 93 KiB/s wr, 9 op/s 2023-05-08T06:37:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10413.354597 secs 2023-05-08T06:37:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10412.797209 secs 2023-05-08T06:37:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:54 smithi186 ceph-mon[126480]: pgmap v5611: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 93 KiB/s wr, 9 op/s 2023-05-08T06:37:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10413.354597 secs 2023-05-08T06:37:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:56 smithi133 ceph-mon[125939]: pgmap v5612: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 176 KiB/s wr, 13 op/s 2023-05-08T06:37:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:56 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:37:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:56 smithi096 ceph-mon[124666]: pgmap v5612: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 176 KiB/s wr, 13 op/s 2023-05-08T06:37:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:56 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:37:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:56 smithi186 ceph-mon[126480]: pgmap v5612: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 176 KiB/s wr, 13 op/s 2023-05-08T06:37:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:56 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:37:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:57 smithi133 ceph-mon[125939]: pgmap v5613: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 92 KiB/s wr, 7 op/s 2023-05-08T06:37:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:57 smithi096 ceph-mon[124666]: pgmap v5613: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 92 KiB/s wr, 7 op/s 2023-05-08T06:37:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:57 smithi186 ceph-mon[126480]: pgmap v5613: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 92 KiB/s wr, 7 op/s 2023-05-08T06:37:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10417.797377 secs 2023-05-08T06:37:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10417.797377 secs 2023-05-08T06:37:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10417.797377 secs 2023-05-08T06:37:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10418.354690 secs 2023-05-08T06:37:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:37:59 smithi186 ceph-mon[126480]: pgmap v5614: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 101 KiB/s wr, 11 op/s 2023-05-08T06:37:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10418.354690 secs 2023-05-08T06:37:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:37:59 smithi133 ceph-mon[125939]: pgmap v5614: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 101 KiB/s wr, 11 op/s 2023-05-08T06:38:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10418.354690 secs 2023-05-08T06:38:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:37:59 smithi096 ceph-mon[124666]: pgmap v5614: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 101 KiB/s wr, 11 op/s 2023-05-08T06:38:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10419.636308 secs 2023-05-08T06:38:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10419.636308 secs 2023-05-08T06:38:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10419.636308 secs 2023-05-08T06:38:01.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:01 smithi186 ceph-mon[126480]: pgmap v5615: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 92 KiB/s wr, 9 op/s 2023-05-08T06:38:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:01 smithi133 ceph-mon[125939]: pgmap v5615: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 92 KiB/s wr, 9 op/s 2023-05-08T06:38:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:01 smithi096 ceph-mon[124666]: pgmap v5615: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 92 KiB/s wr, 9 op/s 2023-05-08T06:38:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:02 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:38:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:38:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:38:02.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:02 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:38:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:02 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:38:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:38:03.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:38:03.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:02 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:38:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:02 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:38:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:38:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:38:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:02 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:38:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10422.797443 secs 2023-05-08T06:38:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:03 smithi133 ceph-mon[125939]: pgmap v5616: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 92 KiB/s wr, 7 op/s 2023-05-08T06:38:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:38:03.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:38:03.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:38:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10422.797443 secs 2023-05-08T06:38:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:03 smithi096 ceph-mon[124666]: pgmap v5616: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 92 KiB/s wr, 7 op/s 2023-05-08T06:38:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:38:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:38:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:38:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10422.797443 secs 2023-05-08T06:38:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:03 smithi186 ceph-mon[126480]: pgmap v5616: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 92 KiB/s wr, 7 op/s 2023-05-08T06:38:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:38:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:38:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:38:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:04 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:38:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:04 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T06:38:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:04 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T06:38:04.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:04 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:38:04.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10423.354752 secs 2023-05-08T06:38:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:04 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:38:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:04 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T06:38:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:04 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T06:38:05.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:04 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:38:05.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10423.354752 secs 2023-05-08T06:38:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:04 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:38:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:04 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T06:38:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:04 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T06:38:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:04 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:38:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10423.354752 secs 2023-05-08T06:38:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10424.636384 secs 2023-05-08T06:38:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:05 smithi133 ceph-mon[125939]: pgmap v5617: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 189 KiB/s wr, 26 op/s 2023-05-08T06:38:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10424.636384 secs 2023-05-08T06:38:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:05 smithi096 ceph-mon[124666]: pgmap v5617: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 189 KiB/s wr, 26 op/s 2023-05-08T06:38:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10424.636384 secs 2023-05-08T06:38:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:05 smithi186 ceph-mon[126480]: pgmap v5617: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 189 KiB/s wr, 26 op/s 2023-05-08T06:38:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:06 smithi133 ceph-mon[125939]: osdmap e428: 12 total, 12 up, 12 in 2023-05-08T06:38:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:06 smithi096 ceph-mon[124666]: osdmap e428: 12 total, 12 up, 12 in 2023-05-08T06:38:07.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:06 smithi186 ceph-mon[126480]: osdmap e428: 12 total, 12 up, 12 in 2023-05-08T06:38:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:07 smithi133 ceph-mon[125939]: pgmap v5619: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 128 KiB/s wr, 26 op/s 2023-05-08T06:38:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:07 smithi096 ceph-mon[124666]: pgmap v5619: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 128 KiB/s wr, 26 op/s 2023-05-08T06:38:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:07 smithi186 ceph-mon[126480]: pgmap v5619: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 128 KiB/s wr, 26 op/s 2023-05-08T06:38:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10427.797568 secs 2023-05-08T06:38:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10427.797568 secs 2023-05-08T06:38:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10427.797568 secs 2023-05-08T06:38:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10428.354842 secs 2023-05-08T06:38:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:09 smithi133 ceph-mon[125939]: pgmap v5620: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 123 KiB/s wr, 26 op/s 2023-05-08T06:38:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10428.354842 secs 2023-05-08T06:38:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:09 smithi096 ceph-mon[124666]: pgmap v5620: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 123 KiB/s wr, 26 op/s 2023-05-08T06:38:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10428.354842 secs 2023-05-08T06:38:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:09 smithi186 ceph-mon[126480]: pgmap v5620: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 123 KiB/s wr, 26 op/s 2023-05-08T06:38:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10429.636530 secs 2023-05-08T06:38:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10429.636530 secs 2023-05-08T06:38:11.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10429.636530 secs 2023-05-08T06:38:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:11 smithi133 ceph-mon[125939]: pgmap v5621: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 123 KiB/s wr, 26 op/s 2023-05-08T06:38:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:11 smithi096 ceph-mon[124666]: pgmap v5621: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 123 KiB/s wr, 26 op/s 2023-05-08T06:38:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:11 smithi186 ceph-mon[126480]: pgmap v5621: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 123 KiB/s wr, 26 op/s 2023-05-08T06:38:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10432.797709 secs 2023-05-08T06:38:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:14 smithi133 ceph-mon[125939]: pgmap v5622: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 123 KiB/s wr, 26 op/s 2023-05-08T06:38:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10433.354957 secs 2023-05-08T06:38:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10432.797709 secs 2023-05-08T06:38:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:14 smithi096 ceph-mon[124666]: pgmap v5622: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 123 KiB/s wr, 26 op/s 2023-05-08T06:38:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10433.354957 secs 2023-05-08T06:38:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10432.797709 secs 2023-05-08T06:38:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:14 smithi186 ceph-mon[126480]: pgmap v5622: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 123 KiB/s wr, 26 op/s 2023-05-08T06:38:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10433.354957 secs 2023-05-08T06:38:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10434.636668 secs 2023-05-08T06:38:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:16 smithi133 ceph-mon[125939]: pgmap v5623: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 8 op/s 2023-05-08T06:38:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:16 smithi133 ceph-mon[125939]: osdmap e429: 12 total, 12 up, 12 in 2023-05-08T06:38:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10434.636668 secs 2023-05-08T06:38:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:16 smithi096 ceph-mon[124666]: pgmap v5623: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 8 op/s 2023-05-08T06:38:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:16 smithi096 ceph-mon[124666]: osdmap e429: 12 total, 12 up, 12 in 2023-05-08T06:38:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10434.636668 secs 2023-05-08T06:38:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:16 smithi186 ceph-mon[126480]: pgmap v5623: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 8 op/s 2023-05-08T06:38:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:16 smithi186 ceph-mon[126480]: osdmap e429: 12 total, 12 up, 12 in 2023-05-08T06:38:18.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:18 smithi133 ceph-mon[125939]: pgmap v5625: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 8 op/s 2023-05-08T06:38:18.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:18 smithi096 ceph-mon[124666]: pgmap v5625: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 8 op/s 2023-05-08T06:38:18.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:18 smithi186 ceph-mon[126480]: pgmap v5625: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 8 op/s 2023-05-08T06:38:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10437.797836 secs 2023-05-08T06:38:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10438.355090 secs 2023-05-08T06:38:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10437.797836 secs 2023-05-08T06:38:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10438.355090 secs 2023-05-08T06:38:19.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10437.797836 secs 2023-05-08T06:38:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10438.355090 secs 2023-05-08T06:38:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:20 smithi133 ceph-mon[125939]: pgmap v5626: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 8 op/s 2023-05-08T06:38:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:20 smithi096 ceph-mon[124666]: pgmap v5626: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 8 op/s 2023-05-08T06:38:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:20 smithi186 ceph-mon[126480]: pgmap v5626: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 8 op/s 2023-05-08T06:38:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10439.636805 secs 2023-05-08T06:38:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10439.636805 secs 2023-05-08T06:38:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10439.636805 secs 2023-05-08T06:38:22.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:22 smithi133 ceph-mon[125939]: pgmap v5627: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 8 op/s 2023-05-08T06:38:22.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:22 smithi096 ceph-mon[124666]: pgmap v5627: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 8 op/s 2023-05-08T06:38:22.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:22 smithi186 ceph-mon[126480]: pgmap v5627: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 8 op/s 2023-05-08T06:38:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10442.797955 secs 2023-05-08T06:38:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:24 smithi133 ceph-mon[125939]: pgmap v5628: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 8 op/s 2023-05-08T06:38:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10443.355184 secs 2023-05-08T06:38:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10442.797955 secs 2023-05-08T06:38:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:24 smithi096 ceph-mon[124666]: pgmap v5628: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 8 op/s 2023-05-08T06:38:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10443.355184 secs 2023-05-08T06:38:24.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10442.797955 secs 2023-05-08T06:38:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:24 smithi186 ceph-mon[126480]: pgmap v5628: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 8 op/s 2023-05-08T06:38:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10443.355184 secs 2023-05-08T06:38:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10444.636906 secs 2023-05-08T06:38:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:26 smithi133 ceph-mon[125939]: pgmap v5629: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 44 KiB/s wr, 8 op/s 2023-05-08T06:38:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10444.636906 secs 2023-05-08T06:38:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:26 smithi096 ceph-mon[124666]: pgmap v5629: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 44 KiB/s wr, 8 op/s 2023-05-08T06:38:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10444.636906 secs 2023-05-08T06:38:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:26 smithi186 ceph-mon[126480]: pgmap v5629: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 44 KiB/s wr, 8 op/s 2023-05-08T06:38:27.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:27 smithi186 ceph-mon[126480]: pgmap v5630: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 7 op/s 2023-05-08T06:38:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:27 smithi133 ceph-mon[125939]: pgmap v5630: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 7 op/s 2023-05-08T06:38:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:27 smithi096 ceph-mon[124666]: pgmap v5630: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 7 op/s 2023-05-08T06:38:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10447.798071 secs 2023-05-08T06:38:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10447.798071 secs 2023-05-08T06:38:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10447.798071 secs 2023-05-08T06:38:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10448.355315 secs 2023-05-08T06:38:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:29 smithi186 ceph-mon[126480]: pgmap v5631: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 59 KiB/s wr, 10 op/s 2023-05-08T06:38:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10448.355315 secs 2023-05-08T06:38:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:29 smithi133 ceph-mon[125939]: pgmap v5631: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 59 KiB/s wr, 10 op/s 2023-05-08T06:38:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10448.355315 secs 2023-05-08T06:38:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:29 smithi096 ceph-mon[124666]: pgmap v5631: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 59 KiB/s wr, 10 op/s 2023-05-08T06:38:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10449.637005 secs 2023-05-08T06:38:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10449.637005 secs 2023-05-08T06:38:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10449.637005 secs 2023-05-08T06:38:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:31 smithi186 ceph-mon[126480]: pgmap v5632: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 58 KiB/s wr, 8 op/s 2023-05-08T06:38:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:31 smithi133 ceph-mon[125939]: pgmap v5632: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 58 KiB/s wr, 8 op/s 2023-05-08T06:38:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:31 smithi096 ceph-mon[124666]: pgmap v5632: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 58 KiB/s wr, 8 op/s 2023-05-08T06:38:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10452.798206 secs 2023-05-08T06:38:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:34 smithi133 ceph-mon[125939]: pgmap v5633: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 7 op/s 2023-05-08T06:38:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10453.355414 secs 2023-05-08T06:38:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10452.798206 secs 2023-05-08T06:38:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:34 smithi096 ceph-mon[124666]: pgmap v5633: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 7 op/s 2023-05-08T06:38:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10453.355414 secs 2023-05-08T06:38:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10452.798206 secs 2023-05-08T06:38:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:34 smithi186 ceph-mon[126480]: pgmap v5633: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 7 op/s 2023-05-08T06:38:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10453.355414 secs 2023-05-08T06:38:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10454.637147 secs 2023-05-08T06:38:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:36 smithi133 ceph-mon[125939]: pgmap v5634: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 122 KiB/s wr, 11 op/s 2023-05-08T06:38:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10454.637147 secs 2023-05-08T06:38:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:36 smithi096 ceph-mon[124666]: pgmap v5634: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 122 KiB/s wr, 11 op/s 2023-05-08T06:38:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10454.637147 secs 2023-05-08T06:38:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:36 smithi186 ceph-mon[126480]: pgmap v5634: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 122 KiB/s wr, 11 op/s 2023-05-08T06:38:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:38 smithi133 ceph-mon[125939]: pgmap v5635: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 86 KiB/s wr, 7 op/s 2023-05-08T06:38:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:38 smithi096 ceph-mon[124666]: pgmap v5635: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 86 KiB/s wr, 7 op/s 2023-05-08T06:38:38.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:38 smithi186 ceph-mon[126480]: pgmap v5635: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 86 KiB/s wr, 7 op/s 2023-05-08T06:38:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10457.798351 secs 2023-05-08T06:38:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10458.355561 secs 2023-05-08T06:38:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10457.798351 secs 2023-05-08T06:38:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10458.355561 secs 2023-05-08T06:38:39.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10457.798351 secs 2023-05-08T06:38:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10458.355561 secs 2023-05-08T06:38:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:40 smithi133 ceph-mon[125939]: pgmap v5636: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 91 KiB/s wr, 10 op/s 2023-05-08T06:38:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:40 smithi096 ceph-mon[124666]: pgmap v5636: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 91 KiB/s wr, 10 op/s 2023-05-08T06:38:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:40 smithi186 ceph-mon[126480]: pgmap v5636: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 91 KiB/s wr, 10 op/s 2023-05-08T06:38:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10459.637241 secs 2023-05-08T06:38:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10459.637241 secs 2023-05-08T06:38:41.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10459.637241 secs 2023-05-08T06:38:42.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:42 smithi133 ceph-mon[125939]: pgmap v5637: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 69 KiB/s wr, 7 op/s 2023-05-08T06:38:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:42 smithi096 ceph-mon[124666]: pgmap v5637: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 69 KiB/s wr, 7 op/s 2023-05-08T06:38:42.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:42 smithi186 ceph-mon[126480]: pgmap v5637: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 69 KiB/s wr, 7 op/s 2023-05-08T06:38:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10462.798409 secs 2023-05-08T06:38:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:44 smithi133 ceph-mon[125939]: pgmap v5638: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 69 KiB/s wr, 7 op/s 2023-05-08T06:38:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10462.798409 secs 2023-05-08T06:38:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:44 smithi096 ceph-mon[124666]: pgmap v5638: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 69 KiB/s wr, 7 op/s 2023-05-08T06:38:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10462.798409 secs 2023-05-08T06:38:44.669 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:44 smithi186 ceph-mon[126480]: pgmap v5638: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 69 KiB/s wr, 7 op/s 2023-05-08T06:38:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:45 smithi186 ceph-mon[126480]: pgmap v5639: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 115 KiB/s wr, 10 op/s 2023-05-08T06:38:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:45 smithi133 ceph-mon[125939]: pgmap v5639: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 115 KiB/s wr, 10 op/s 2023-05-08T06:38:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:45 smithi096 ceph-mon[124666]: pgmap v5639: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 115 KiB/s wr, 10 op/s 2023-05-08T06:38:46.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10464.637342 secs 2023-05-08T06:38:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10464.637342 secs 2023-05-08T06:38:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10464.637342 secs 2023-05-08T06:38:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:38:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:47 smithi186 ceph-mon[126480]: pgmap v5640: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 51 KiB/s wr, 7 op/s 2023-05-08T06:38:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:38:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:47 smithi133 ceph-mon[125939]: pgmap v5640: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 51 KiB/s wr, 7 op/s 2023-05-08T06:38:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:38:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:47 smithi096 ceph-mon[124666]: pgmap v5640: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 51 KiB/s wr, 7 op/s 2023-05-08T06:38:48.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:48 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:38:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:38:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:38:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:48 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:38:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:38:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:38:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:48 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:38:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:38:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:38:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10467.798522 secs 2023-05-08T06:38:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:49 smithi186 ceph-mon[126480]: pgmap v5641: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 114 KiB/s wr, 11 op/s 2023-05-08T06:38:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10467.798522 secs 2023-05-08T06:38:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:49 smithi133 ceph-mon[125939]: pgmap v5641: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 114 KiB/s wr, 11 op/s 2023-05-08T06:38:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10467.798522 secs 2023-05-08T06:38:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:49 smithi096 ceph-mon[124666]: pgmap v5641: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 114 KiB/s wr, 11 op/s 2023-05-08T06:38:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:50 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:38:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:50 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:38:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:50 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:38:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:38:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:38:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:51 smithi133 ceph-mon[125939]: pgmap v5642: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 109 KiB/s wr, 9 op/s 2023-05-08T06:38:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:38:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:38:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:51 smithi096 ceph-mon[124666]: pgmap v5642: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 109 KiB/s wr, 9 op/s 2023-05-08T06:38:51.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:38:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:38:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:51 smithi186 ceph-mon[126480]: pgmap v5642: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 109 KiB/s wr, 9 op/s 2023-05-08T06:38:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10472.798637 secs 2023-05-08T06:38:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:54 smithi133 ceph-mon[125939]: pgmap v5643: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 109 KiB/s wr, 8 op/s 2023-05-08T06:38:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10473.355873 secs 2023-05-08T06:38:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10472.798637 secs 2023-05-08T06:38:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:54 smithi096 ceph-mon[124666]: pgmap v5643: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 109 KiB/s wr, 8 op/s 2023-05-08T06:38:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10473.355873 secs 2023-05-08T06:38:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10472.798637 secs 2023-05-08T06:38:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:54 smithi186 ceph-mon[126480]: pgmap v5643: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 109 KiB/s wr, 8 op/s 2023-05-08T06:38:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10473.355873 secs 2023-05-08T06:38:55.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:55 smithi186 ceph-mon[126480]: pgmap v5644: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 138 KiB/s wr, 13 op/s 2023-05-08T06:38:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:55 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:38:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:55 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:38:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:55 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:38:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:55 smithi133 ceph-mon[125939]: pgmap v5644: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 138 KiB/s wr, 13 op/s 2023-05-08T06:38:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:55 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:38:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:55 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:38:55.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:55 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:38:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:55 smithi096 ceph-mon[124666]: pgmap v5644: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 138 KiB/s wr, 13 op/s 2023-05-08T06:38:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:55 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:38:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:55 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:38:55.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:55 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:38:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:58 smithi133 ceph-mon[125939]: pgmap v5645: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 92 KiB/s wr, 9 op/s 2023-05-08T06:38:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:58 smithi096 ceph-mon[124666]: pgmap v5645: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 92 KiB/s wr, 9 op/s 2023-05-08T06:38:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:58 smithi186 ceph-mon[126480]: pgmap v5645: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 92 KiB/s wr, 9 op/s 2023-05-08T06:38:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:38:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10477.798731 secs 2023-05-08T06:38:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:38:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10477.798731 secs 2023-05-08T06:38:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:38:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10477.798731 secs 2023-05-08T06:39:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:00 smithi133 ceph-mon[125939]: pgmap v5646: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 187 KiB/s wr, 12 op/s 2023-05-08T06:39:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:00 smithi096 ceph-mon[124666]: pgmap v5646: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 187 KiB/s wr, 12 op/s 2023-05-08T06:39:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:00 smithi186 ceph-mon[126480]: pgmap v5646: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 187 KiB/s wr, 12 op/s 2023-05-08T06:39:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10479.637656 secs 2023-05-08T06:39:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10479.637656 secs 2023-05-08T06:39:01.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10479.637656 secs 2023-05-08T06:39:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:02 smithi133 ceph-mon[125939]: pgmap v5647: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 124 KiB/s wr, 9 op/s 2023-05-08T06:39:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:02 smithi096 ceph-mon[124666]: pgmap v5647: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 124 KiB/s wr, 9 op/s 2023-05-08T06:39:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:02 smithi186 ceph-mon[126480]: pgmap v5647: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 124 KiB/s wr, 9 op/s 2023-05-08T06:39:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:03 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:39:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:03 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:39:03.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:03 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:39:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10482.798841 secs 2023-05-08T06:39:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:04 smithi133 ceph-mon[125939]: pgmap v5648: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 124 KiB/s wr, 8 op/s 2023-05-08T06:39:04.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:04 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:39:04.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:04 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:39:04.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:04 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:39:04.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:04 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:39:04.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10483.356060 secs 2023-05-08T06:39:04.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:04 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:39:04.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:04 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:39:04.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:04 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:39:04.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:04 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:39:04.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:04 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:39:04.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:04 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:39:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10482.798841 secs 2023-05-08T06:39:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:04 smithi096 ceph-mon[124666]: pgmap v5648: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 124 KiB/s wr, 8 op/s 2023-05-08T06:39:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:04 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:39:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:04 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:39:04.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:04 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:39:04.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:04 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:39:04.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10483.356060 secs 2023-05-08T06:39:04.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:04 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:39:04.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:04 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:39:04.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:04 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:39:04.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:04 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:39:04.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:04 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:39:04.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:04 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:39:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10482.798841 secs 2023-05-08T06:39:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:04 smithi186 ceph-mon[126480]: pgmap v5648: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 124 KiB/s wr, 8 op/s 2023-05-08T06:39:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:04 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:39:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:04 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:39:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:04 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:39:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:04 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:39:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10483.356060 secs 2023-05-08T06:39:04.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:04 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:39:04.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:04 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:39:04.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:04 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:39:04.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:04 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:39:04.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:04 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:39:04.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:04 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:39:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:05 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:39:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:05 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:39:05.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:05 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:39:05.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:05 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:39:05.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:05 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T06:39:05.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:05 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T06:39:05.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:05 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:39:05.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:05 smithi096 ceph-mon[124666]: pgmap v5649: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 189 KiB/s wr, 27 op/s 2023-05-08T06:39:05.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:05 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:39:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:05 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:39:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:05 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:39:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:05 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:39:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:05 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T06:39:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:05 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T06:39:05.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:05 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:39:05.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:05 smithi186 ceph-mon[126480]: pgmap v5649: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 189 KiB/s wr, 27 op/s 2023-05-08T06:39:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:05 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:39:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:05 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:39:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:05 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:39:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:05 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:39:05.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:05 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T06:39:05.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:05 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T06:39:05.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:05 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:39:05.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:05 smithi133 ceph-mon[125939]: pgmap v5649: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 189 KiB/s wr, 27 op/s 2023-05-08T06:39:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10484.637790 secs 2023-05-08T06:39:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10484.637790 secs 2023-05-08T06:39:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10484.637790 secs 2023-05-08T06:39:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:07 smithi096 ceph-mon[124666]: pgmap v5650: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 160 KiB/s wr, 22 op/s 2023-05-08T06:39:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:07 smithi186 ceph-mon[126480]: pgmap v5650: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 160 KiB/s wr, 22 op/s 2023-05-08T06:39:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:07 smithi133 ceph-mon[125939]: pgmap v5650: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 160 KiB/s wr, 22 op/s 2023-05-08T06:39:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:08 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:39:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:39:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:39:08.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:08 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:39:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:39:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:39:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:08 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:39:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:39:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:39:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10487.798975 secs 2023-05-08T06:39:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10488.356197 secs 2023-05-08T06:39:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:09 smithi096 ceph-mon[124666]: pgmap v5651: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 164 KiB/s wr, 25 op/s 2023-05-08T06:39:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10487.798975 secs 2023-05-08T06:39:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10488.356197 secs 2023-05-08T06:39:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:09 smithi186 ceph-mon[126480]: pgmap v5651: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 164 KiB/s wr, 25 op/s 2023-05-08T06:39:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10487.798975 secs 2023-05-08T06:39:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10488.356197 secs 2023-05-08T06:39:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:09 smithi133 ceph-mon[125939]: pgmap v5651: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 164 KiB/s wr, 25 op/s 2023-05-08T06:39:11.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10489.637893 secs 2023-05-08T06:39:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:11 smithi186 ceph-mon[126480]: osdmap e430: 12 total, 12 up, 12 in 2023-05-08T06:39:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:11 smithi186 ceph-mon[126480]: pgmap v5653: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 84 KiB/s wr, 26 op/s 2023-05-08T06:39:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10489.637893 secs 2023-05-08T06:39:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:11 smithi133 ceph-mon[125939]: osdmap e430: 12 total, 12 up, 12 in 2023-05-08T06:39:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:11 smithi133 ceph-mon[125939]: pgmap v5653: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 84 KiB/s wr, 26 op/s 2023-05-08T06:39:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10489.637893 secs 2023-05-08T06:39:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:11 smithi096 ceph-mon[124666]: osdmap e430: 12 total, 12 up, 12 in 2023-05-08T06:39:11.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:11 smithi096 ceph-mon[124666]: pgmap v5653: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 84 KiB/s wr, 26 op/s 2023-05-08T06:39:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10492.799099 secs 2023-05-08T06:39:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:14 smithi133 ceph-mon[125939]: pgmap v5654: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 84 KiB/s wr, 26 op/s 2023-05-08T06:39:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10493.356336 secs 2023-05-08T06:39:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10492.799099 secs 2023-05-08T06:39:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:14 smithi096 ceph-mon[124666]: pgmap v5654: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 84 KiB/s wr, 26 op/s 2023-05-08T06:39:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10493.356336 secs 2023-05-08T06:39:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10492.799099 secs 2023-05-08T06:39:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:14 smithi186 ceph-mon[126480]: pgmap v5654: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 84 KiB/s wr, 26 op/s 2023-05-08T06:39:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10493.356336 secs 2023-05-08T06:39:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10494.638010 secs 2023-05-08T06:39:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:16 smithi133 ceph-mon[125939]: pgmap v5655: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 7 op/s 2023-05-08T06:39:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:16 smithi133 ceph-mon[125939]: osdmap e431: 12 total, 12 up, 12 in 2023-05-08T06:39:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10494.638010 secs 2023-05-08T06:39:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:16 smithi096 ceph-mon[124666]: pgmap v5655: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 7 op/s 2023-05-08T06:39:16.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:16 smithi096 ceph-mon[124666]: osdmap e431: 12 total, 12 up, 12 in 2023-05-08T06:39:16.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10494.638010 secs 2023-05-08T06:39:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:16 smithi186 ceph-mon[126480]: pgmap v5655: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 7 op/s 2023-05-08T06:39:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:16 smithi186 ceph-mon[126480]: osdmap e431: 12 total, 12 up, 12 in 2023-05-08T06:39:18.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:18 smithi133 ceph-mon[125939]: pgmap v5657: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 5 op/s 2023-05-08T06:39:18.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:18 smithi096 ceph-mon[124666]: pgmap v5657: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 5 op/s 2023-05-08T06:39:18.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:18 smithi186 ceph-mon[126480]: pgmap v5657: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 5 op/s 2023-05-08T06:39:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10497.799200 secs 2023-05-08T06:39:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10498.356504 secs 2023-05-08T06:39:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10497.799200 secs 2023-05-08T06:39:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10498.356504 secs 2023-05-08T06:39:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10497.799200 secs 2023-05-08T06:39:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10498.356504 secs 2023-05-08T06:39:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:20 smithi133 ceph-mon[125939]: pgmap v5658: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 7 op/s 2023-05-08T06:39:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:20 smithi096 ceph-mon[124666]: pgmap v5658: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 7 op/s 2023-05-08T06:39:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:20 smithi186 ceph-mon[126480]: pgmap v5658: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 7 op/s 2023-05-08T06:39:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10499.638134 secs 2023-05-08T06:39:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10499.638134 secs 2023-05-08T06:39:21.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10499.638134 secs 2023-05-08T06:39:22.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:22 smithi096 ceph-mon[124666]: pgmap v5659: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 7 op/s 2023-05-08T06:39:22.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:22 smithi186 ceph-mon[126480]: pgmap v5659: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 7 op/s 2023-05-08T06:39:22.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:22 smithi133 ceph-mon[125939]: pgmap v5659: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 7 op/s 2023-05-08T06:39:23.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:23 smithi096 ceph-mon[124666]: pgmap v5660: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 7 op/s 2023-05-08T06:39:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:23 smithi186 ceph-mon[126480]: pgmap v5660: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 7 op/s 2023-05-08T06:39:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:23 smithi133 ceph-mon[125939]: pgmap v5660: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 7 op/s 2023-05-08T06:39:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10502.799295 secs 2023-05-08T06:39:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10503.356576 secs 2023-05-08T06:39:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10502.799295 secs 2023-05-08T06:39:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10503.356576 secs 2023-05-08T06:39:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10502.799295 secs 2023-05-08T06:39:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10503.356576 secs 2023-05-08T06:39:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:25 smithi096 ceph-mon[124666]: pgmap v5661: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 6.3 KiB/s wr, 8 op/s 2023-05-08T06:39:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:25 smithi186 ceph-mon[126480]: pgmap v5661: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 6.3 KiB/s wr, 8 op/s 2023-05-08T06:39:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:25 smithi133 ceph-mon[125939]: pgmap v5661: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 6.3 KiB/s wr, 8 op/s 2023-05-08T06:39:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10504.638274 secs 2023-05-08T06:39:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10504.638274 secs 2023-05-08T06:39:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10504.638274 secs 2023-05-08T06:39:27.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:27 smithi186 ceph-mon[126480]: pgmap v5662: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 5.3 KiB/s wr, 7 op/s 2023-05-08T06:39:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:27 smithi133 ceph-mon[125939]: pgmap v5662: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 5.3 KiB/s wr, 7 op/s 2023-05-08T06:39:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:27 smithi096 ceph-mon[124666]: pgmap v5662: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 5.3 KiB/s wr, 7 op/s 2023-05-08T06:39:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10507.799413 secs 2023-05-08T06:39:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10507.799413 secs 2023-05-08T06:39:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10507.799413 secs 2023-05-08T06:39:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10508.356697 secs 2023-05-08T06:39:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:29 smithi186 ceph-mon[126480]: pgmap v5663: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 50 KiB/s wr, 10 op/s 2023-05-08T06:39:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10508.356697 secs 2023-05-08T06:39:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:29 smithi133 ceph-mon[125939]: pgmap v5663: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 50 KiB/s wr, 10 op/s 2023-05-08T06:39:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10508.356697 secs 2023-05-08T06:39:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:29 smithi096 ceph-mon[124666]: pgmap v5663: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 50 KiB/s wr, 10 op/s 2023-05-08T06:39:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10509.638382 secs 2023-05-08T06:39:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10509.638382 secs 2023-05-08T06:39:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10509.638382 secs 2023-05-08T06:39:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:31 smithi186 ceph-mon[126480]: pgmap v5664: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 46 KiB/s wr, 8 op/s 2023-05-08T06:39:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:31 smithi133 ceph-mon[125939]: pgmap v5664: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 46 KiB/s wr, 8 op/s 2023-05-08T06:39:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:31 smithi096 ceph-mon[124666]: pgmap v5664: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 46 KiB/s wr, 8 op/s 2023-05-08T06:39:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10512.799536 secs 2023-05-08T06:39:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:34 smithi133 ceph-mon[125939]: pgmap v5665: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 46 KiB/s wr, 7 op/s 2023-05-08T06:39:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10513.356815 secs 2023-05-08T06:39:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10512.799536 secs 2023-05-08T06:39:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:34 smithi096 ceph-mon[124666]: pgmap v5665: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 46 KiB/s wr, 7 op/s 2023-05-08T06:39:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10513.356815 secs 2023-05-08T06:39:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10512.799536 secs 2023-05-08T06:39:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:34 smithi186 ceph-mon[126480]: pgmap v5665: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 46 KiB/s wr, 7 op/s 2023-05-08T06:39:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10513.356815 secs 2023-05-08T06:39:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10514.638525 secs 2023-05-08T06:39:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:36 smithi133 ceph-mon[125939]: pgmap v5666: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 46 KiB/s wr, 11 op/s 2023-05-08T06:39:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10514.638525 secs 2023-05-08T06:39:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:36 smithi096 ceph-mon[124666]: pgmap v5666: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 46 KiB/s wr, 11 op/s 2023-05-08T06:39:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10514.638525 secs 2023-05-08T06:39:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:36 smithi186 ceph-mon[126480]: pgmap v5666: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 46 KiB/s wr, 11 op/s 2023-05-08T06:39:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:38 smithi133 ceph-mon[125939]: pgmap v5667: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 45 KiB/s wr, 7 op/s 2023-05-08T06:39:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:38 smithi096 ceph-mon[124666]: pgmap v5667: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 45 KiB/s wr, 7 op/s 2023-05-08T06:39:38.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:38 smithi186 ceph-mon[126480]: pgmap v5667: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 45 KiB/s wr, 7 op/s 2023-05-08T06:39:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10517.799636 secs 2023-05-08T06:39:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10518.356928 secs 2023-05-08T06:39:39.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10517.799636 secs 2023-05-08T06:39:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10518.356928 secs 2023-05-08T06:39:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10517.799636 secs 2023-05-08T06:39:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10518.356928 secs 2023-05-08T06:39:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:40 smithi096 ceph-mon[124666]: pgmap v5668: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 110 KiB/s wr, 10 op/s 2023-05-08T06:39:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:40 smithi186 ceph-mon[126480]: pgmap v5668: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 110 KiB/s wr, 10 op/s 2023-05-08T06:39:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:40 smithi133 ceph-mon[125939]: pgmap v5668: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 110 KiB/s wr, 10 op/s 2023-05-08T06:39:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10519.638644 secs 2023-05-08T06:39:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:41 smithi096 ceph-mon[124666]: pgmap v5669: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 65 KiB/s wr, 7 op/s 2023-05-08T06:39:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10519.638644 secs 2023-05-08T06:39:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:41 smithi186 ceph-mon[126480]: pgmap v5669: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 65 KiB/s wr, 7 op/s 2023-05-08T06:39:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10519.638644 secs 2023-05-08T06:39:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:41 smithi133 ceph-mon[125939]: pgmap v5669: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 65 KiB/s wr, 7 op/s 2023-05-08T06:39:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10522.799739 secs 2023-05-08T06:39:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:44 smithi133 ceph-mon[125939]: pgmap v5670: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 65 KiB/s wr, 6 op/s 2023-05-08T06:39:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10522.799739 secs 2023-05-08T06:39:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:44 smithi096 ceph-mon[124666]: pgmap v5670: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 65 KiB/s wr, 6 op/s 2023-05-08T06:39:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10522.799739 secs 2023-05-08T06:39:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:44 smithi186 ceph-mon[126480]: pgmap v5670: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 65 KiB/s wr, 6 op/s 2023-05-08T06:39:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10524.638758 secs 2023-05-08T06:39:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:46 smithi133 ceph-mon[125939]: pgmap v5671: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 113 KiB/s wr, 10 op/s 2023-05-08T06:39:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10524.638758 secs 2023-05-08T06:39:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:46 smithi096 ceph-mon[124666]: pgmap v5671: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 113 KiB/s wr, 10 op/s 2023-05-08T06:39:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10524.638758 secs 2023-05-08T06:39:46.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:46 smithi186 ceph-mon[126480]: pgmap v5671: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 113 KiB/s wr, 10 op/s 2023-05-08T06:39:47.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:39:47.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:39:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:39:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:48 smithi133 ceph-mon[125939]: pgmap v5672: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 113 KiB/s wr, 7 op/s 2023-05-08T06:39:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:48 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:39:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:39:48.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:39:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:48 smithi096 ceph-mon[124666]: pgmap v5672: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 113 KiB/s wr, 7 op/s 2023-05-08T06:39:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:48 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:39:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:39:48.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:39:48.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:48 smithi186 ceph-mon[126480]: pgmap v5672: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 113 KiB/s wr, 7 op/s 2023-05-08T06:39:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:48 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:39:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:39:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:39:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10527.799878 secs 2023-05-08T06:39:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10527.799878 secs 2023-05-08T06:39:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10527.799878 secs 2023-05-08T06:39:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:50 smithi096 ceph-mon[124666]: pgmap v5673: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 195 KiB/s wr, 11 op/s 2023-05-08T06:39:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:50 smithi186 ceph-mon[126480]: pgmap v5673: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 195 KiB/s wr, 11 op/s 2023-05-08T06:39:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:50 smithi133 ceph-mon[125939]: pgmap v5673: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 195 KiB/s wr, 11 op/s 2023-05-08T06:39:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:39:51.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:51 smithi096 ceph-mon[124666]: pgmap v5674: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 131 KiB/s wr, 9 op/s 2023-05-08T06:39:51.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:39:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:51 smithi186 ceph-mon[126480]: pgmap v5674: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 131 KiB/s wr, 9 op/s 2023-05-08T06:39:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:39:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:51 smithi133 ceph-mon[125939]: pgmap v5674: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 131 KiB/s wr, 9 op/s 2023-05-08T06:39:52.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:39:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:39:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:39:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:39:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:39:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:39:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:53 smithi186 ceph-mon[126480]: pgmap v5675: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 131 KiB/s wr, 8 op/s 2023-05-08T06:39:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:53 smithi133 ceph-mon[125939]: pgmap v5675: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 131 KiB/s wr, 8 op/s 2023-05-08T06:39:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:53 smithi096 ceph-mon[124666]: pgmap v5675: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 131 KiB/s wr, 8 op/s 2023-05-08T06:39:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10532.799991 secs 2023-05-08T06:39:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10533.357329 secs 2023-05-08T06:39:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10532.799991 secs 2023-05-08T06:39:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10533.357329 secs 2023-05-08T06:39:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10532.799991 secs 2023-05-08T06:39:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10533.357329 secs 2023-05-08T06:39:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:55 smithi186 ceph-mon[126480]: pgmap v5676: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 140 KiB/s wr, 13 op/s 2023-05-08T06:39:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:55 smithi133 ceph-mon[125939]: pgmap v5676: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 140 KiB/s wr, 13 op/s 2023-05-08T06:39:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:55 smithi096 ceph-mon[124666]: pgmap v5676: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 140 KiB/s wr, 13 op/s 2023-05-08T06:39:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:56 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:39:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:39:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:39:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:56 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:39:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:39:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:39:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:56 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:39:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:39:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:39:57.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:57 smithi186 ceph-mon[126480]: pgmap v5677: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 92 KiB/s wr, 9 op/s 2023-05-08T06:39:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:57 smithi133 ceph-mon[125939]: pgmap v5677: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 92 KiB/s wr, 9 op/s 2023-05-08T06:39:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:57 smithi096 ceph-mon[124666]: pgmap v5677: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 92 KiB/s wr, 9 op/s 2023-05-08T06:39:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10537.800116 secs 2023-05-08T06:39:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10537.800116 secs 2023-05-08T06:39:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10537.800116 secs 2023-05-08T06:39:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10538.357493 secs 2023-05-08T06:39:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:39:59 smithi186 ceph-mon[126480]: pgmap v5678: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 177 KiB/s wr, 12 op/s 2023-05-08T06:39:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10538.357493 secs 2023-05-08T06:39:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:39:59 smithi133 ceph-mon[125939]: pgmap v5678: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 177 KiB/s wr, 12 op/s 2023-05-08T06:40:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10538.357493 secs 2023-05-08T06:40:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:39:59 smithi096 ceph-mon[124666]: pgmap v5678: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 177 KiB/s wr, 12 op/s 2023-05-08T06:40:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:00 smithi186 ceph-mon[126480]: overall HEALTH_WARN 2 MDSs report slow requests 2023-05-08T06:40:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:00 smithi133 ceph-mon[125939]: overall HEALTH_WARN 2 MDSs report slow requests 2023-05-08T06:40:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:00 smithi096 ceph-mon[124666]: overall HEALTH_WARN 2 MDSs report slow requests 2023-05-08T06:40:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:01 smithi133 ceph-mon[125939]: pgmap v5679: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 95 KiB/s wr, 9 op/s 2023-05-08T06:40:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:01 smithi096 ceph-mon[124666]: pgmap v5679: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 95 KiB/s wr, 9 op/s 2023-05-08T06:40:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:01 smithi186 ceph-mon[126480]: pgmap v5679: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 95 KiB/s wr, 9 op/s 2023-05-08T06:40:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10542.800210 secs 2023-05-08T06:40:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:04 smithi133 ceph-mon[125939]: pgmap v5680: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 95 KiB/s wr, 8 op/s 2023-05-08T06:40:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10543.357603 secs 2023-05-08T06:40:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10542.800210 secs 2023-05-08T06:40:04.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:04 smithi096 ceph-mon[124666]: pgmap v5680: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 95 KiB/s wr, 8 op/s 2023-05-08T06:40:04.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10543.357603 secs 2023-05-08T06:40:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10542.800210 secs 2023-05-08T06:40:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:04 smithi186 ceph-mon[126480]: pgmap v5680: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 95 KiB/s wr, 8 op/s 2023-05-08T06:40:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10543.357603 secs 2023-05-08T06:40:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:05 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:40:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:05 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:40:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:05 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:40:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10544.639174 secs 2023-05-08T06:40:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:06 smithi096 ceph-mon[124666]: pgmap v5681: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 150 KiB/s wr, 27 op/s 2023-05-08T06:40:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:06 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:40:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:06 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:40:06.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:06 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:40:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10544.639174 secs 2023-05-08T06:40:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:06 smithi186 ceph-mon[126480]: pgmap v5681: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 150 KiB/s wr, 27 op/s 2023-05-08T06:40:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:06 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:40:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:06 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:40:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:06 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:40:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10544.639174 secs 2023-05-08T06:40:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:06 smithi133 ceph-mon[125939]: pgmap v5681: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 150 KiB/s wr, 27 op/s 2023-05-08T06:40:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:06 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:40:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:06 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:40:06.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:06 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:40:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:07 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:40:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:07 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T06:40:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:07 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T06:40:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:07 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:40:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:07 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:40:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:07 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T06:40:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:07 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T06:40:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:07 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:40:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:07 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:40:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:07 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T06:40:07.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:07 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T06:40:07.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:07 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:40:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:08 smithi096 ceph-mon[124666]: pgmap v5682: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 140 KiB/s wr, 22 op/s 2023-05-08T06:40:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:08 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:40:08.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:40:08.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:40:08.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:08 smithi186 ceph-mon[126480]: pgmap v5682: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 140 KiB/s wr, 22 op/s 2023-05-08T06:40:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:08 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:40:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:40:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:40:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:08 smithi133 ceph-mon[125939]: pgmap v5682: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 140 KiB/s wr, 22 op/s 2023-05-08T06:40:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:08 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:40:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:40:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:40:09.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10547.800358 secs 2023-05-08T06:40:09.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10548.357800 secs 2023-05-08T06:40:09.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:09 smithi186 ceph-mon[126480]: pgmap v5683: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 200 KiB/s wr, 26 op/s 2023-05-08T06:40:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10547.800358 secs 2023-05-08T06:40:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10548.357800 secs 2023-05-08T06:40:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:09 smithi133 ceph-mon[125939]: pgmap v5683: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 200 KiB/s wr, 26 op/s 2023-05-08T06:40:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10547.800358 secs 2023-05-08T06:40:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10548.357800 secs 2023-05-08T06:40:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:09 smithi096 ceph-mon[124666]: pgmap v5683: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 200 KiB/s wr, 26 op/s 2023-05-08T06:40:11.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10549.639295 secs 2023-05-08T06:40:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:11 smithi186 ceph-mon[126480]: osdmap e432: 12 total, 12 up, 12 in 2023-05-08T06:40:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:11 smithi186 ceph-mon[126480]: pgmap v5685: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 137 KiB/s wr, 28 op/s 2023-05-08T06:40:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10549.639295 secs 2023-05-08T06:40:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:11 smithi133 ceph-mon[125939]: osdmap e432: 12 total, 12 up, 12 in 2023-05-08T06:40:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:11 smithi133 ceph-mon[125939]: pgmap v5685: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 137 KiB/s wr, 28 op/s 2023-05-08T06:40:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10549.639295 secs 2023-05-08T06:40:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:11 smithi096 ceph-mon[124666]: osdmap e432: 12 total, 12 up, 12 in 2023-05-08T06:40:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:11 smithi096 ceph-mon[124666]: pgmap v5685: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 137 KiB/s wr, 28 op/s 2023-05-08T06:40:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10552.800460 secs 2023-05-08T06:40:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:14 smithi096 ceph-mon[124666]: pgmap v5686: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 137 KiB/s wr, 28 op/s 2023-05-08T06:40:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10553.357885 secs 2023-05-08T06:40:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10552.800460 secs 2023-05-08T06:40:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:14 smithi186 ceph-mon[126480]: pgmap v5686: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 137 KiB/s wr, 28 op/s 2023-05-08T06:40:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10553.357885 secs 2023-05-08T06:40:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10552.800460 secs 2023-05-08T06:40:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:14 smithi133 ceph-mon[125939]: pgmap v5686: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 137 KiB/s wr, 28 op/s 2023-05-08T06:40:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10553.357885 secs 2023-05-08T06:40:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10554.639419 secs 2023-05-08T06:40:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:16 smithi096 ceph-mon[124666]: pgmap v5687: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 123 KiB/s wr, 10 op/s 2023-05-08T06:40:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:16 smithi096 ceph-mon[124666]: osdmap e433: 12 total, 12 up, 12 in 2023-05-08T06:40:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10554.639419 secs 2023-05-08T06:40:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:16 smithi186 ceph-mon[126480]: pgmap v5687: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 123 KiB/s wr, 10 op/s 2023-05-08T06:40:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:16 smithi186 ceph-mon[126480]: osdmap e433: 12 total, 12 up, 12 in 2023-05-08T06:40:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10554.639419 secs 2023-05-08T06:40:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:16 smithi133 ceph-mon[125939]: pgmap v5687: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 123 KiB/s wr, 10 op/s 2023-05-08T06:40:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:16 smithi133 ceph-mon[125939]: osdmap e433: 12 total, 12 up, 12 in 2023-05-08T06:40:17.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:17 smithi186 ceph-mon[126480]: pgmap v5689: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 65 KiB/s wr, 7 op/s 2023-05-08T06:40:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:17 smithi133 ceph-mon[125939]: pgmap v5689: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 65 KiB/s wr, 7 op/s 2023-05-08T06:40:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:17 smithi096 ceph-mon[124666]: pgmap v5689: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 65 KiB/s wr, 7 op/s 2023-05-08T06:40:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10557.800579 secs 2023-05-08T06:40:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10557.800579 secs 2023-05-08T06:40:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10557.800579 secs 2023-05-08T06:40:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10558.358009 secs 2023-05-08T06:40:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:19 smithi186 ceph-mon[126480]: pgmap v5690: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 86 KiB/s wr, 9 op/s 2023-05-08T06:40:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10558.358009 secs 2023-05-08T06:40:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:19 smithi133 ceph-mon[125939]: pgmap v5690: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 86 KiB/s wr, 9 op/s 2023-05-08T06:40:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10558.358009 secs 2023-05-08T06:40:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:19 smithi096 ceph-mon[124666]: pgmap v5690: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 86 KiB/s wr, 9 op/s 2023-05-08T06:40:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10559.639540 secs 2023-05-08T06:40:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10559.639540 secs 2023-05-08T06:40:21.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10559.639540 secs 2023-05-08T06:40:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:21 smithi133 ceph-mon[125939]: pgmap v5691: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 77 KiB/s wr, 9 op/s 2023-05-08T06:40:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:21 smithi096 ceph-mon[124666]: pgmap v5691: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 77 KiB/s wr, 9 op/s 2023-05-08T06:40:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:21 smithi186 ceph-mon[126480]: pgmap v5691: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 77 KiB/s wr, 9 op/s 2023-05-08T06:40:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10562.800697 secs 2023-05-08T06:40:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:24 smithi096 ceph-mon[124666]: pgmap v5692: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 77 KiB/s wr, 9 op/s 2023-05-08T06:40:24.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10563.358121 secs 2023-05-08T06:40:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10562.800697 secs 2023-05-08T06:40:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:24 smithi186 ceph-mon[126480]: pgmap v5692: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 77 KiB/s wr, 9 op/s 2023-05-08T06:40:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10563.358121 secs 2023-05-08T06:40:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10562.800697 secs 2023-05-08T06:40:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:24 smithi133 ceph-mon[125939]: pgmap v5692: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 77 KiB/s wr, 9 op/s 2023-05-08T06:40:24.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10563.358121 secs 2023-05-08T06:40:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10564.639653 secs 2023-05-08T06:40:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:26 smithi096 ceph-mon[124666]: pgmap v5693: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 9 op/s 2023-05-08T06:40:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10564.639653 secs 2023-05-08T06:40:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:26 smithi186 ceph-mon[126480]: pgmap v5693: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 9 op/s 2023-05-08T06:40:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10564.639653 secs 2023-05-08T06:40:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:26 smithi133 ceph-mon[125939]: pgmap v5693: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 9 op/s 2023-05-08T06:40:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:27 smithi096 ceph-mon[124666]: pgmap v5694: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 7 op/s 2023-05-08T06:40:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:27 smithi186 ceph-mon[126480]: pgmap v5694: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 7 op/s 2023-05-08T06:40:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:27 smithi133 ceph-mon[125939]: pgmap v5694: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 7 op/s 2023-05-08T06:40:28.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10567.800772 secs 2023-05-08T06:40:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10567.800772 secs 2023-05-08T06:40:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10567.800772 secs 2023-05-08T06:40:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10568.358225 secs 2023-05-08T06:40:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:29 smithi186 ceph-mon[126480]: pgmap v5695: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 71 KiB/s wr, 10 op/s 2023-05-08T06:40:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10568.358225 secs 2023-05-08T06:40:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:29 smithi133 ceph-mon[125939]: pgmap v5695: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 71 KiB/s wr, 10 op/s 2023-05-08T06:40:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10568.358225 secs 2023-05-08T06:40:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:29 smithi096 ceph-mon[124666]: pgmap v5695: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 71 KiB/s wr, 10 op/s 2023-05-08T06:40:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10569.639754 secs 2023-05-08T06:40:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10569.639754 secs 2023-05-08T06:40:31.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10569.639754 secs 2023-05-08T06:40:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:31 smithi133 ceph-mon[125939]: pgmap v5696: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 50 KiB/s wr, 8 op/s 2023-05-08T06:40:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:31 smithi096 ceph-mon[124666]: pgmap v5696: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 50 KiB/s wr, 8 op/s 2023-05-08T06:40:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:31 smithi186 ceph-mon[126480]: pgmap v5696: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 50 KiB/s wr, 8 op/s 2023-05-08T06:40:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10572.800902 secs 2023-05-08T06:40:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:34 smithi096 ceph-mon[124666]: pgmap v5697: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 50 KiB/s wr, 6 op/s 2023-05-08T06:40:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10573.358371 secs 2023-05-08T06:40:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10572.800902 secs 2023-05-08T06:40:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:34 smithi186 ceph-mon[126480]: pgmap v5697: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 50 KiB/s wr, 6 op/s 2023-05-08T06:40:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10573.358371 secs 2023-05-08T06:40:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10572.800902 secs 2023-05-08T06:40:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:34 smithi133 ceph-mon[125939]: pgmap v5697: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 50 KiB/s wr, 6 op/s 2023-05-08T06:40:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10573.358371 secs 2023-05-08T06:40:35.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:35 smithi186 ceph-mon[126480]: pgmap v5698: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 10 op/s 2023-05-08T06:40:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:35 smithi133 ceph-mon[125939]: pgmap v5698: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 10 op/s 2023-05-08T06:40:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:35 smithi096 ceph-mon[124666]: pgmap v5698: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 10 op/s 2023-05-08T06:40:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10574.639873 secs 2023-05-08T06:40:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10574.639873 secs 2023-05-08T06:40:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10574.639873 secs 2023-05-08T06:40:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:37 smithi186 ceph-mon[126480]: pgmap v5699: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 50 KiB/s wr, 7 op/s 2023-05-08T06:40:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:37 smithi133 ceph-mon[125939]: pgmap v5699: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 50 KiB/s wr, 7 op/s 2023-05-08T06:40:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:37 smithi096 ceph-mon[124666]: pgmap v5699: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 50 KiB/s wr, 7 op/s 2023-05-08T06:40:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10577.801018 secs 2023-05-08T06:40:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10577.801018 secs 2023-05-08T06:40:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10577.801018 secs 2023-05-08T06:40:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10578.358517 secs 2023-05-08T06:40:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:39 smithi186 ceph-mon[126480]: pgmap v5700: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 125 KiB/s wr, 9 op/s 2023-05-08T06:40:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10578.358517 secs 2023-05-08T06:40:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:39 smithi133 ceph-mon[125939]: pgmap v5700: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 125 KiB/s wr, 9 op/s 2023-05-08T06:40:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10578.358517 secs 2023-05-08T06:40:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:39 smithi096 ceph-mon[124666]: pgmap v5700: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 125 KiB/s wr, 9 op/s 2023-05-08T06:40:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10579.639987 secs 2023-05-08T06:40:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10579.639987 secs 2023-05-08T06:40:41.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10579.639987 secs 2023-05-08T06:40:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:41 smithi133 ceph-mon[125939]: pgmap v5701: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 75 KiB/s wr, 7 op/s 2023-05-08T06:40:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:41 smithi096 ceph-mon[124666]: pgmap v5701: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 75 KiB/s wr, 7 op/s 2023-05-08T06:40:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:41 smithi186 ceph-mon[126480]: pgmap v5701: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 75 KiB/s wr, 7 op/s 2023-05-08T06:40:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:43 smithi186 ceph-mon[126480]: pgmap v5702: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 75 KiB/s wr, 7 op/s 2023-05-08T06:40:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:43 smithi133 ceph-mon[125939]: pgmap v5702: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 75 KiB/s wr, 7 op/s 2023-05-08T06:40:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:43 smithi096 ceph-mon[124666]: pgmap v5702: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 75 KiB/s wr, 7 op/s 2023-05-08T06:40:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10582.801139 secs 2023-05-08T06:40:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10582.801139 secs 2023-05-08T06:40:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10582.801139 secs 2023-05-08T06:40:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:45 smithi186 ceph-mon[126480]: pgmap v5703: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 123 KiB/s wr, 12 op/s 2023-05-08T06:40:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:45 smithi133 ceph-mon[125939]: pgmap v5703: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 123 KiB/s wr, 12 op/s 2023-05-08T06:40:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:45 smithi096 ceph-mon[124666]: pgmap v5703: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 123 KiB/s wr, 12 op/s 2023-05-08T06:40:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:46 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:40:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:46 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:40:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:46 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:40:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:47 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:40:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:47 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:40:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:47 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:40:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:40:47.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:47 smithi133 ceph-mon[125939]: pgmap v5704: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 123 KiB/s wr, 8 op/s 2023-05-08T06:40:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:47 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:40:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:47 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:40:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:47 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:40:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:40:47.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:47 smithi096 ceph-mon[124666]: pgmap v5704: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 123 KiB/s wr, 8 op/s 2023-05-08T06:40:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:47 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:40:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:47 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:40:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:47 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:40:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:40:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:47 smithi186 ceph-mon[126480]: pgmap v5704: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 123 KiB/s wr, 8 op/s 2023-05-08T06:40:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:40:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:40:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:40:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:40:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:40:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:40:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10587.801278 secs 2023-05-08T06:40:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10588.358776 secs 2023-05-08T06:40:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:49 smithi133 ceph-mon[125939]: pgmap v5705: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 209 KiB/s wr, 12 op/s 2023-05-08T06:40:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10587.801278 secs 2023-05-08T06:40:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10588.358776 secs 2023-05-08T06:40:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:49 smithi096 ceph-mon[124666]: pgmap v5705: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 209 KiB/s wr, 12 op/s 2023-05-08T06:40:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10587.801278 secs 2023-05-08T06:40:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10588.358776 secs 2023-05-08T06:40:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:49 smithi186 ceph-mon[126480]: pgmap v5705: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 209 KiB/s wr, 12 op/s 2023-05-08T06:40:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:51 smithi133 ceph-mon[125939]: pgmap v5706: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 135 KiB/s wr, 10 op/s 2023-05-08T06:40:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:51 smithi096 ceph-mon[124666]: pgmap v5706: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 135 KiB/s wr, 10 op/s 2023-05-08T06:40:51.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:51 smithi186 ceph-mon[126480]: pgmap v5706: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 135 KiB/s wr, 10 op/s 2023-05-08T06:40:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:52 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:40:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:40:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:40:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:52 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:40:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:40:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:40:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:52 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:40:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:40:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:40:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:53 smithi133 ceph-mon[125939]: pgmap v5707: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 135 KiB/s wr, 9 op/s 2023-05-08T06:40:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:53 smithi096 ceph-mon[124666]: pgmap v5707: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 135 KiB/s wr, 9 op/s 2023-05-08T06:40:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:53 smithi186 ceph-mon[126480]: pgmap v5707: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 135 KiB/s wr, 9 op/s 2023-05-08T06:40:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10592.801375 secs 2023-05-08T06:40:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:54 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:40:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10592.801375 secs 2023-05-08T06:40:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:54 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:40:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10592.801375 secs 2023-05-08T06:40:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:54 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:40:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:55 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:40:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:55 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:40:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:55 smithi133 ceph-mon[125939]: pgmap v5708: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 145 KiB/s wr, 13 op/s 2023-05-08T06:40:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:55 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:40:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:55 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:40:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:55 smithi096 ceph-mon[124666]: pgmap v5708: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 145 KiB/s wr, 13 op/s 2023-05-08T06:40:55.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:55 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:40:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:55 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:40:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:55 smithi186 ceph-mon[126480]: pgmap v5708: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 145 KiB/s wr, 13 op/s 2023-05-08T06:40:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:57 smithi186 ceph-mon[126480]: pgmap v5709: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 97 KiB/s wr, 8 op/s 2023-05-08T06:40:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:57 smithi133 ceph-mon[125939]: pgmap v5709: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 97 KiB/s wr, 8 op/s 2023-05-08T06:40:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:57 smithi096 ceph-mon[124666]: pgmap v5709: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 97 KiB/s wr, 8 op/s 2023-05-08T06:40:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10597.801497 secs 2023-05-08T06:40:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10597.801497 secs 2023-05-08T06:40:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10597.801497 secs 2023-05-08T06:40:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10598.359006 secs 2023-05-08T06:40:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:40:59 smithi133 ceph-mon[125939]: pgmap v5710: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 204 KiB/s wr, 12 op/s 2023-05-08T06:41:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10598.359006 secs 2023-05-08T06:41:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:40:59 smithi096 ceph-mon[124666]: pgmap v5710: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 204 KiB/s wr, 12 op/s 2023-05-08T06:41:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10598.359006 secs 2023-05-08T06:41:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:40:59 smithi186 ceph-mon[126480]: pgmap v5710: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 204 KiB/s wr, 12 op/s 2023-05-08T06:41:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10599.640415 secs 2023-05-08T06:41:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:00 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:41:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10599.640415 secs 2023-05-08T06:41:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:00 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:41:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10599.640415 secs 2023-05-08T06:41:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:00 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:41:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:01 smithi133 ceph-mon[125939]: pgmap v5711: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 117 KiB/s wr, 10 op/s 2023-05-08T06:41:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:01 smithi096 ceph-mon[124666]: pgmap v5711: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 117 KiB/s wr, 10 op/s 2023-05-08T06:41:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:01 smithi186 ceph-mon[126480]: pgmap v5711: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 117 KiB/s wr, 10 op/s 2023-05-08T06:41:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:41:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:41:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:03 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:41:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10602.801562 secs 2023-05-08T06:41:03.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:03 smithi133 ceph-mon[125939]: pgmap v5712: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 117 KiB/s wr, 9 op/s 2023-05-08T06:41:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:41:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:41:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:03 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:41:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10602.801562 secs 2023-05-08T06:41:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:03 smithi096 ceph-mon[124666]: pgmap v5712: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 117 KiB/s wr, 9 op/s 2023-05-08T06:41:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:41:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:41:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:03 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:41:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10602.801562 secs 2023-05-08T06:41:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:03 smithi186 ceph-mon[126480]: pgmap v5712: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 117 KiB/s wr, 9 op/s 2023-05-08T06:41:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10603.359148 secs 2023-05-08T06:41:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10603.359148 secs 2023-05-08T06:41:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10603.359148 secs 2023-05-08T06:41:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10604.640516 secs 2023-05-08T06:41:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:05 smithi133 ceph-mon[125939]: pgmap v5713: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 162 KiB/s wr, 27 op/s 2023-05-08T06:41:05.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:05 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:41:05.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:05 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:41:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10604.640516 secs 2023-05-08T06:41:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:05 smithi096 ceph-mon[124666]: pgmap v5713: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 162 KiB/s wr, 27 op/s 2023-05-08T06:41:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:05 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:41:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:05 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:41:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10604.640516 secs 2023-05-08T06:41:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:05 smithi186 ceph-mon[126480]: pgmap v5713: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 162 KiB/s wr, 27 op/s 2023-05-08T06:41:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:05 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:41:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:05 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:41:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:06 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:41:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:06 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:41:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:06 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:41:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:06 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:41:06.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:06 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T06:41:06.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:06 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T06:41:06.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:06 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:41:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:06 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:41:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:06 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:41:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:06 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:41:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:06 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:41:07.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:06 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T06:41:07.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:06 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T06:41:07.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:06 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:41:07.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:06 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:41:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:06 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:41:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:06 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:41:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:06 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:41:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:06 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T06:41:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:06 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T06:41:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:06 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:41:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:07 smithi133 ceph-mon[125939]: pgmap v5714: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 152 KiB/s wr, 22 op/s 2023-05-08T06:41:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:07 smithi096 ceph-mon[124666]: pgmap v5714: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 152 KiB/s wr, 22 op/s 2023-05-08T06:41:08.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:07 smithi186 ceph-mon[126480]: pgmap v5714: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 152 KiB/s wr, 22 op/s 2023-05-08T06:41:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10607.801657 secs 2023-05-08T06:41:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10607.801657 secs 2023-05-08T06:41:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10607.801657 secs 2023-05-08T06:41:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10608.359294 secs 2023-05-08T06:41:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:09 smithi133 ceph-mon[125939]: pgmap v5715: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 175 KiB/s wr, 25 op/s 2023-05-08T06:41:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10608.359294 secs 2023-05-08T06:41:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:09 smithi096 ceph-mon[124666]: pgmap v5715: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 175 KiB/s wr, 25 op/s 2023-05-08T06:41:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10608.359294 secs 2023-05-08T06:41:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:09 smithi186 ceph-mon[126480]: pgmap v5715: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 175 KiB/s wr, 25 op/s 2023-05-08T06:41:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10609.640658 secs 2023-05-08T06:41:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10609.640658 secs 2023-05-08T06:41:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10609.640658 secs 2023-05-08T06:41:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:11 smithi133 ceph-mon[125939]: osdmap e434: 12 total, 12 up, 12 in 2023-05-08T06:41:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:11 smithi133 ceph-mon[125939]: pgmap v5717: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 82 KiB/s wr, 25 op/s 2023-05-08T06:41:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:11 smithi096 ceph-mon[124666]: osdmap e434: 12 total, 12 up, 12 in 2023-05-08T06:41:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:11 smithi096 ceph-mon[124666]: pgmap v5717: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 82 KiB/s wr, 25 op/s 2023-05-08T06:41:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:11 smithi186 ceph-mon[126480]: osdmap e434: 12 total, 12 up, 12 in 2023-05-08T06:41:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:11 smithi186 ceph-mon[126480]: pgmap v5717: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 82 KiB/s wr, 25 op/s 2023-05-08T06:41:13.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:13 smithi186 ceph-mon[126480]: pgmap v5718: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 82 KiB/s wr, 25 op/s 2023-05-08T06:41:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:13 smithi133 ceph-mon[125939]: pgmap v5718: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 82 KiB/s wr, 25 op/s 2023-05-08T06:41:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:13 smithi096 ceph-mon[124666]: pgmap v5718: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 82 KiB/s wr, 25 op/s 2023-05-08T06:41:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10612.801766 secs 2023-05-08T06:41:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10613.359439 secs 2023-05-08T06:41:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10612.801766 secs 2023-05-08T06:41:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10613.359439 secs 2023-05-08T06:41:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10612.801766 secs 2023-05-08T06:41:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10613.359439 secs 2023-05-08T06:41:15.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:15 smithi186 ceph-mon[126480]: pgmap v5719: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 33 KiB/s wr, 8 op/s 2023-05-08T06:41:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:15 smithi133 ceph-mon[125939]: pgmap v5719: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 33 KiB/s wr, 8 op/s 2023-05-08T06:41:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:15 smithi096 ceph-mon[124666]: pgmap v5719: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 33 KiB/s wr, 8 op/s 2023-05-08T06:41:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10614.640795 secs 2023-05-08T06:41:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10614.640795 secs 2023-05-08T06:41:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10614.640795 secs 2023-05-08T06:41:17.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:17 smithi186 ceph-mon[126480]: pgmap v5720: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 33 KiB/s wr, 8 op/s 2023-05-08T06:41:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:17 smithi133 ceph-mon[125939]: pgmap v5720: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 33 KiB/s wr, 8 op/s 2023-05-08T06:41:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:17 smithi096 ceph-mon[124666]: pgmap v5720: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 33 KiB/s wr, 8 op/s 2023-05-08T06:41:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10617.801866 secs 2023-05-08T06:41:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10617.801866 secs 2023-05-08T06:41:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10617.801866 secs 2023-05-08T06:41:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10618.359574 secs 2023-05-08T06:41:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:19 smithi133 ceph-mon[125939]: pgmap v5721: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 8 op/s 2023-05-08T06:41:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10618.359574 secs 2023-05-08T06:41:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:19 smithi096 ceph-mon[124666]: pgmap v5721: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 8 op/s 2023-05-08T06:41:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10618.359574 secs 2023-05-08T06:41:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:19 smithi186 ceph-mon[126480]: pgmap v5721: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 8 op/s 2023-05-08T06:41:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10619.640916 secs 2023-05-08T06:41:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:20 smithi133 ceph-mon[125939]: osdmap e435: 12 total, 12 up, 12 in 2023-05-08T06:41:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10619.640916 secs 2023-05-08T06:41:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:20 smithi096 ceph-mon[124666]: osdmap e435: 12 total, 12 up, 12 in 2023-05-08T06:41:21.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10619.640916 secs 2023-05-08T06:41:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:20 smithi186 ceph-mon[126480]: osdmap e435: 12 total, 12 up, 12 in 2023-05-08T06:41:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:21 smithi133 ceph-mon[125939]: pgmap v5723: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 8 op/s 2023-05-08T06:41:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:21 smithi096 ceph-mon[124666]: pgmap v5723: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 8 op/s 2023-05-08T06:41:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:21 smithi186 ceph-mon[126480]: pgmap v5723: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 8 op/s 2023-05-08T06:41:23.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:23 smithi186 ceph-mon[126480]: pgmap v5724: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 8 op/s 2023-05-08T06:41:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:23 smithi133 ceph-mon[125939]: pgmap v5724: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 8 op/s 2023-05-08T06:41:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:23 smithi096 ceph-mon[124666]: pgmap v5724: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 8 op/s 2023-05-08T06:41:24.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10622.802009 secs 2023-05-08T06:41:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10623.359665 secs 2023-05-08T06:41:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10622.802009 secs 2023-05-08T06:41:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10623.359665 secs 2023-05-08T06:41:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10622.802009 secs 2023-05-08T06:41:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10623.359665 secs 2023-05-08T06:41:25.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:25 smithi186 ceph-mon[126480]: pgmap v5725: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 53 KiB/s wr, 8 op/s 2023-05-08T06:41:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:25 smithi133 ceph-mon[125939]: pgmap v5725: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 53 KiB/s wr, 8 op/s 2023-05-08T06:41:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:25 smithi096 ceph-mon[124666]: pgmap v5725: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 53 KiB/s wr, 8 op/s 2023-05-08T06:41:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10624.640980 secs 2023-05-08T06:41:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10624.640980 secs 2023-05-08T06:41:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10624.640980 secs 2023-05-08T06:41:27.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:27 smithi186 ceph-mon[126480]: pgmap v5726: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 53 KiB/s wr, 8 op/s 2023-05-08T06:41:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:27 smithi133 ceph-mon[125939]: pgmap v5726: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 53 KiB/s wr, 8 op/s 2023-05-08T06:41:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:27 smithi096 ceph-mon[124666]: pgmap v5726: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 53 KiB/s wr, 8 op/s 2023-05-08T06:41:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10627.802152 secs 2023-05-08T06:41:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10627.802152 secs 2023-05-08T06:41:29.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10627.802152 secs 2023-05-08T06:41:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10628.359792 secs 2023-05-08T06:41:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:29 smithi133 ceph-mon[125939]: pgmap v5727: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 40 KiB/s wr, 8 op/s 2023-05-08T06:41:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10628.359792 secs 2023-05-08T06:41:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:29 smithi096 ceph-mon[124666]: pgmap v5727: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 40 KiB/s wr, 8 op/s 2023-05-08T06:41:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10628.359792 secs 2023-05-08T06:41:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:29 smithi186 ceph-mon[126480]: pgmap v5727: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 40 KiB/s wr, 8 op/s 2023-05-08T06:41:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10629.641092 secs 2023-05-08T06:41:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10629.641092 secs 2023-05-08T06:41:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10629.641092 secs 2023-05-08T06:41:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:31 smithi133 ceph-mon[125939]: pgmap v5728: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 7 op/s 2023-05-08T06:41:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:31 smithi096 ceph-mon[124666]: pgmap v5728: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 7 op/s 2023-05-08T06:41:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:31 smithi186 ceph-mon[126480]: pgmap v5728: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 7 op/s 2023-05-08T06:41:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:33 smithi186 ceph-mon[126480]: pgmap v5729: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T06:41:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:33 smithi133 ceph-mon[125939]: pgmap v5729: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T06:41:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:33 smithi096 ceph-mon[124666]: pgmap v5729: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T06:41:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10632.802282 secs 2023-05-08T06:41:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10633.359915 secs 2023-05-08T06:41:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10632.802282 secs 2023-05-08T06:41:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10633.359915 secs 2023-05-08T06:41:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10632.802282 secs 2023-05-08T06:41:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10633.359915 secs 2023-05-08T06:41:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:35 smithi186 ceph-mon[126480]: pgmap v5730: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 57 KiB/s wr, 9 op/s 2023-05-08T06:41:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:35 smithi133 ceph-mon[125939]: pgmap v5730: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 57 KiB/s wr, 9 op/s 2023-05-08T06:41:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:35 smithi096 ceph-mon[124666]: pgmap v5730: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 57 KiB/s wr, 9 op/s 2023-05-08T06:41:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10634.641178 secs 2023-05-08T06:41:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10634.641178 secs 2023-05-08T06:41:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10634.641178 secs 2023-05-08T06:41:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:37 smithi186 ceph-mon[126480]: pgmap v5731: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T06:41:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:37 smithi133 ceph-mon[125939]: pgmap v5731: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T06:41:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:37 smithi096 ceph-mon[124666]: pgmap v5731: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T06:41:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10637.802412 secs 2023-05-08T06:41:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10637.802412 secs 2023-05-08T06:41:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10637.802412 secs 2023-05-08T06:41:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10638.360064 secs 2023-05-08T06:41:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:39 smithi133 ceph-mon[125939]: pgmap v5732: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 38 KiB/s wr, 8 op/s 2023-05-08T06:41:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10638.360064 secs 2023-05-08T06:41:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:39 smithi096 ceph-mon[124666]: pgmap v5732: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 38 KiB/s wr, 8 op/s 2023-05-08T06:41:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10638.360064 secs 2023-05-08T06:41:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:39 smithi186 ceph-mon[126480]: pgmap v5732: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 38 KiB/s wr, 8 op/s 2023-05-08T06:41:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10639.641320 secs 2023-05-08T06:41:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10639.641320 secs 2023-05-08T06:41:41.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10639.641320 secs 2023-05-08T06:41:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:41 smithi133 ceph-mon[125939]: pgmap v5733: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 7 op/s 2023-05-08T06:41:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:41 smithi096 ceph-mon[124666]: pgmap v5733: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 7 op/s 2023-05-08T06:41:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:41 smithi186 ceph-mon[126480]: pgmap v5733: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 7 op/s 2023-05-08T06:41:43.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:43 smithi186 ceph-mon[126480]: pgmap v5734: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 6 op/s 2023-05-08T06:41:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:43 smithi133 ceph-mon[125939]: pgmap v5734: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 6 op/s 2023-05-08T06:41:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:43 smithi096 ceph-mon[124666]: pgmap v5734: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 6 op/s 2023-05-08T06:41:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10642.802475 secs 2023-05-08T06:41:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10642.802475 secs 2023-05-08T06:41:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10642.802475 secs 2023-05-08T06:41:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:45 smithi186 ceph-mon[126480]: pgmap v5735: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 74 KiB/s wr, 10 op/s 2023-05-08T06:41:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:45 smithi133 ceph-mon[125939]: pgmap v5735: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 74 KiB/s wr, 10 op/s 2023-05-08T06:41:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:45 smithi096 ceph-mon[124666]: pgmap v5735: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 74 KiB/s wr, 10 op/s 2023-05-08T06:41:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10644.641444 secs 2023-05-08T06:41:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10644.641444 secs 2023-05-08T06:41:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10644.641444 secs 2023-05-08T06:41:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:41:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:47 smithi186 ceph-mon[126480]: pgmap v5736: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 51 KiB/s wr, 7 op/s 2023-05-08T06:41:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:41:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:47 smithi133 ceph-mon[125939]: pgmap v5736: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 51 KiB/s wr, 7 op/s 2023-05-08T06:41:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:41:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:47 smithi096 ceph-mon[124666]: pgmap v5736: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 51 KiB/s wr, 7 op/s 2023-05-08T06:41:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:48 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:41:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:41:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:41:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:48 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:41:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:41:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:41:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:48 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:41:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:41:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:41:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10647.802573 secs 2023-05-08T06:41:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:49 smithi186 ceph-mon[126480]: pgmap v5737: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 117 KiB/s wr, 11 op/s 2023-05-08T06:41:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10647.802573 secs 2023-05-08T06:41:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:49 smithi133 ceph-mon[125939]: pgmap v5737: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 117 KiB/s wr, 11 op/s 2023-05-08T06:41:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10647.802573 secs 2023-05-08T06:41:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:49 smithi096 ceph-mon[124666]: pgmap v5737: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 117 KiB/s wr, 11 op/s 2023-05-08T06:41:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:50 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:41:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:50 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:41:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:50 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:41:51.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:41:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:41:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:51 smithi186 ceph-mon[126480]: pgmap v5738: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 112 KiB/s wr, 9 op/s 2023-05-08T06:41:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:41:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:41:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:51 smithi133 ceph-mon[125939]: pgmap v5738: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 112 KiB/s wr, 9 op/s 2023-05-08T06:41:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:41:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:41:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:51 smithi096 ceph-mon[124666]: pgmap v5738: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 112 KiB/s wr, 9 op/s 2023-05-08T06:41:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:53 smithi186 ceph-mon[126480]: pgmap v5739: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 112 KiB/s wr, 8 op/s 2023-05-08T06:41:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:53 smithi133 ceph-mon[125939]: pgmap v5739: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 112 KiB/s wr, 8 op/s 2023-05-08T06:41:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:53 smithi096 ceph-mon[124666]: pgmap v5739: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 112 KiB/s wr, 8 op/s 2023-05-08T06:41:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10652.802695 secs 2023-05-08T06:41:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10653.360494 secs 2023-05-08T06:41:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10652.802695 secs 2023-05-08T06:41:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10653.360494 secs 2023-05-08T06:41:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10652.802695 secs 2023-05-08T06:41:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10653.360494 secs 2023-05-08T06:41:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:55 smithi186 ceph-mon[126480]: pgmap v5740: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 142 KiB/s wr, 13 op/s 2023-05-08T06:41:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:55 smithi133 ceph-mon[125939]: pgmap v5740: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 142 KiB/s wr, 13 op/s 2023-05-08T06:41:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:55 smithi096 ceph-mon[124666]: pgmap v5740: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 142 KiB/s wr, 13 op/s 2023-05-08T06:41:56.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:56 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:41:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:41:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:41:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:56 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:41:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:41:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:41:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:56 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:41:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:41:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:41:57.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:57 smithi186 ceph-mon[126480]: pgmap v5741: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 96 KiB/s wr, 9 op/s 2023-05-08T06:41:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:57 smithi133 ceph-mon[125939]: pgmap v5741: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 96 KiB/s wr, 9 op/s 2023-05-08T06:41:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:57 smithi096 ceph-mon[124666]: pgmap v5741: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 96 KiB/s wr, 9 op/s 2023-05-08T06:41:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10657.802817 secs 2023-05-08T06:41:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10657.802817 secs 2023-05-08T06:41:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10657.802817 secs 2023-05-08T06:41:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:41:59 smithi133 ceph-mon[125939]: pgmap v5742: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 198 KiB/s wr, 12 op/s 2023-05-08T06:42:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:41:59 smithi096 ceph-mon[124666]: pgmap v5742: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 198 KiB/s wr, 12 op/s 2023-05-08T06:42:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:41:59 smithi186 ceph-mon[126480]: pgmap v5742: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 198 KiB/s wr, 12 op/s 2023-05-08T06:42:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10659.641817 secs 2023-05-08T06:42:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10659.641817 secs 2023-05-08T06:42:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10659.641817 secs 2023-05-08T06:42:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:01 smithi133 ceph-mon[125939]: pgmap v5743: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 133 KiB/s wr, 9 op/s 2023-05-08T06:42:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:01 smithi096 ceph-mon[124666]: pgmap v5743: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 133 KiB/s wr, 9 op/s 2023-05-08T06:42:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:01 smithi186 ceph-mon[126480]: pgmap v5743: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 133 KiB/s wr, 9 op/s 2023-05-08T06:42:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:02 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:42:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:02 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:42:03.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:02 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:42:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:42:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:42:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:03 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:42:03.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10662.802932 secs 2023-05-08T06:42:03.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:03 smithi133 ceph-mon[125939]: pgmap v5744: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 132 KiB/s wr, 8 op/s 2023-05-08T06:42:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:42:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:42:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:03 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:42:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10662.802932 secs 2023-05-08T06:42:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:03 smithi096 ceph-mon[124666]: pgmap v5744: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 132 KiB/s wr, 8 op/s 2023-05-08T06:42:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:42:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:42:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:03 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:42:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10662.802932 secs 2023-05-08T06:42:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:03 smithi186 ceph-mon[126480]: pgmap v5744: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 132 KiB/s wr, 8 op/s 2023-05-08T06:42:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10663.360736 secs 2023-05-08T06:42:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10663.360736 secs 2023-05-08T06:42:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10663.360736 secs 2023-05-08T06:42:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10664.641884 secs 2023-05-08T06:42:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:05 smithi133 ceph-mon[125939]: pgmap v5745: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 200 KiB/s wr, 28 op/s 2023-05-08T06:42:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10664.641884 secs 2023-05-08T06:42:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:05 smithi096 ceph-mon[124666]: pgmap v5745: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 200 KiB/s wr, 28 op/s 2023-05-08T06:42:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10664.641884 secs 2023-05-08T06:42:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:05 smithi186 ceph-mon[126480]: pgmap v5745: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 200 KiB/s wr, 28 op/s 2023-05-08T06:42:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:06 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:42:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:06 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:42:07.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:06 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:42:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:07 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:42:07.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:07 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:42:07.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:07 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:42:07.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:07 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:42:07.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:07 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:42:07.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:07 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:42:07.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:07 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:42:07.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:07 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T06:42:07.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:07 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T06:42:07.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:07 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:42:07.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:07 smithi133 ceph-mon[125939]: pgmap v5746: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 169 KiB/s wr, 23 op/s 2023-05-08T06:42:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:07 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:42:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:07 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:42:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:07 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:42:08.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:07 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:42:08.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:07 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:42:08.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:07 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:42:08.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:07 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:42:08.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:07 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T06:42:08.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:07 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T06:42:08.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:07 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:42:08.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:07 smithi096 ceph-mon[124666]: pgmap v5746: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 169 KiB/s wr, 23 op/s 2023-05-08T06:42:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:07 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:42:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:07 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:42:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:07 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:42:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:07 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:42:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:07 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:42:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:07 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:42:08.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:07 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:42:08.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:07 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T06:42:08.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:07 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T06:42:08.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:07 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:42:08.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:07 smithi186 ceph-mon[126480]: pgmap v5746: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 169 KiB/s wr, 23 op/s 2023-05-08T06:42:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10667.803050 secs 2023-05-08T06:42:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10667.803050 secs 2023-05-08T06:42:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10667.803050 secs 2023-05-08T06:42:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10668.360841 secs 2023-05-08T06:42:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:09 smithi186 ceph-mon[126480]: pgmap v5747: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 208 KiB/s wr, 26 op/s 2023-05-08T06:42:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10668.360841 secs 2023-05-08T06:42:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:09 smithi133 ceph-mon[125939]: pgmap v5747: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 208 KiB/s wr, 26 op/s 2023-05-08T06:42:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10668.360841 secs 2023-05-08T06:42:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:09 smithi096 ceph-mon[124666]: pgmap v5747: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 208 KiB/s wr, 26 op/s 2023-05-08T06:42:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10669.641961 secs 2023-05-08T06:42:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10669.641961 secs 2023-05-08T06:42:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10669.641961 secs 2023-05-08T06:42:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:11 smithi186 ceph-mon[126480]: osdmap e436: 12 total, 12 up, 12 in 2023-05-08T06:42:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:11 smithi186 ceph-mon[126480]: pgmap v5749: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 128 KiB/s wr, 28 op/s 2023-05-08T06:42:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:11 smithi133 ceph-mon[125939]: osdmap e436: 12 total, 12 up, 12 in 2023-05-08T06:42:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:11 smithi133 ceph-mon[125939]: pgmap v5749: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 128 KiB/s wr, 28 op/s 2023-05-08T06:42:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:11 smithi096 ceph-mon[124666]: osdmap e436: 12 total, 12 up, 12 in 2023-05-08T06:42:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:11 smithi096 ceph-mon[124666]: pgmap v5749: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 128 KiB/s wr, 28 op/s 2023-05-08T06:42:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:13 smithi186 ceph-mon[126480]: pgmap v5750: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 128 KiB/s wr, 28 op/s 2023-05-08T06:42:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:13 smithi133 ceph-mon[125939]: pgmap v5750: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 128 KiB/s wr, 28 op/s 2023-05-08T06:42:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:13 smithi096 ceph-mon[124666]: pgmap v5750: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 128 KiB/s wr, 28 op/s 2023-05-08T06:42:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10672.803142 secs 2023-05-08T06:42:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10673.360980 secs 2023-05-08T06:42:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10672.803142 secs 2023-05-08T06:42:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10673.360980 secs 2023-05-08T06:42:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10672.803142 secs 2023-05-08T06:42:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10673.360980 secs 2023-05-08T06:42:15.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:15 smithi186 ceph-mon[126480]: pgmap v5751: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 47 KiB/s wr, 8 op/s 2023-05-08T06:42:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:15 smithi133 ceph-mon[125939]: pgmap v5751: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 47 KiB/s wr, 8 op/s 2023-05-08T06:42:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:15 smithi096 ceph-mon[124666]: pgmap v5751: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 47 KiB/s wr, 8 op/s 2023-05-08T06:42:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10674.642044 secs 2023-05-08T06:42:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10674.642044 secs 2023-05-08T06:42:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10674.642044 secs 2023-05-08T06:42:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:17 smithi186 ceph-mon[126480]: pgmap v5752: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 47 KiB/s wr, 8 op/s 2023-05-08T06:42:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:17 smithi133 ceph-mon[125939]: pgmap v5752: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 47 KiB/s wr, 8 op/s 2023-05-08T06:42:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:17 smithi096 ceph-mon[124666]: pgmap v5752: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 47 KiB/s wr, 8 op/s 2023-05-08T06:42:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10677.803265 secs 2023-05-08T06:42:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10677.803265 secs 2023-05-08T06:42:19.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10677.803265 secs 2023-05-08T06:42:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10678.361068 secs 2023-05-08T06:42:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:19 smithi133 ceph-mon[125939]: pgmap v5753: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 6.3 KiB/s wr, 9 op/s 2023-05-08T06:42:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10678.361068 secs 2023-05-08T06:42:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:19 smithi096 ceph-mon[124666]: pgmap v5753: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 6.3 KiB/s wr, 9 op/s 2023-05-08T06:42:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10678.361068 secs 2023-05-08T06:42:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:19 smithi186 ceph-mon[126480]: pgmap v5753: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 6.3 KiB/s wr, 9 op/s 2023-05-08T06:42:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10679.642160 secs 2023-05-08T06:42:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:20 smithi133 ceph-mon[125939]: osdmap e437: 12 total, 12 up, 12 in 2023-05-08T06:42:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10679.642160 secs 2023-05-08T06:42:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:20 smithi096 ceph-mon[124666]: osdmap e437: 12 total, 12 up, 12 in 2023-05-08T06:42:21.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10679.642160 secs 2023-05-08T06:42:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:20 smithi186 ceph-mon[126480]: osdmap e437: 12 total, 12 up, 12 in 2023-05-08T06:42:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:21 smithi133 ceph-mon[125939]: pgmap v5755: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6.0 KiB/s wr, 8 op/s 2023-05-08T06:42:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:21 smithi096 ceph-mon[124666]: pgmap v5755: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6.0 KiB/s wr, 8 op/s 2023-05-08T06:42:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:21 smithi186 ceph-mon[126480]: pgmap v5755: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6.0 KiB/s wr, 8 op/s 2023-05-08T06:42:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:23 smithi186 ceph-mon[126480]: pgmap v5756: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6.0 KiB/s wr, 8 op/s 2023-05-08T06:42:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:23 smithi133 ceph-mon[125939]: pgmap v5756: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6.0 KiB/s wr, 8 op/s 2023-05-08T06:42:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:23 smithi096 ceph-mon[124666]: pgmap v5756: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6.0 KiB/s wr, 8 op/s 2023-05-08T06:42:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10682.803401 secs 2023-05-08T06:42:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10683.361165 secs 2023-05-08T06:42:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10682.803401 secs 2023-05-08T06:42:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10683.361165 secs 2023-05-08T06:42:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10682.803401 secs 2023-05-08T06:42:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10683.361165 secs 2023-05-08T06:42:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:25 smithi186 ceph-mon[126480]: pgmap v5757: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 6.2 KiB/s wr, 8 op/s 2023-05-08T06:42:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:25 smithi133 ceph-mon[125939]: pgmap v5757: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 6.2 KiB/s wr, 8 op/s 2023-05-08T06:42:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:25 smithi096 ceph-mon[124666]: pgmap v5757: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 6.2 KiB/s wr, 8 op/s 2023-05-08T06:42:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10684.642288 secs 2023-05-08T06:42:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10684.642288 secs 2023-05-08T06:42:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10684.642288 secs 2023-05-08T06:42:27.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:27 smithi186 ceph-mon[126480]: pgmap v5758: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 6.2 KiB/s wr, 8 op/s 2023-05-08T06:42:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:27 smithi133 ceph-mon[125939]: pgmap v5758: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 6.2 KiB/s wr, 8 op/s 2023-05-08T06:42:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:27 smithi096 ceph-mon[124666]: pgmap v5758: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 6.2 KiB/s wr, 8 op/s 2023-05-08T06:42:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10687.803519 secs 2023-05-08T06:42:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10687.803519 secs 2023-05-08T06:42:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10687.803519 secs 2023-05-08T06:42:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10688.361269 secs 2023-05-08T06:42:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:29 smithi133 ceph-mon[125939]: pgmap v5759: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 29 KiB/s wr, 7 op/s 2023-05-08T06:42:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10688.361269 secs 2023-05-08T06:42:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:29 smithi096 ceph-mon[124666]: pgmap v5759: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 29 KiB/s wr, 7 op/s 2023-05-08T06:42:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10688.361269 secs 2023-05-08T06:42:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:29 smithi186 ceph-mon[126480]: pgmap v5759: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 29 KiB/s wr, 7 op/s 2023-05-08T06:42:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10689.642441 secs 2023-05-08T06:42:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10689.642441 secs 2023-05-08T06:42:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10689.642441 secs 2023-05-08T06:42:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:31 smithi133 ceph-mon[125939]: pgmap v5760: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 27 KiB/s wr, 7 op/s 2023-05-08T06:42:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:31 smithi096 ceph-mon[124666]: pgmap v5760: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 27 KiB/s wr, 7 op/s 2023-05-08T06:42:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:31 smithi186 ceph-mon[126480]: pgmap v5760: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 27 KiB/s wr, 7 op/s 2023-05-08T06:42:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:33 smithi186 ceph-mon[126480]: pgmap v5761: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 24 KiB/s wr, 6 op/s 2023-05-08T06:42:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:33 smithi133 ceph-mon[125939]: pgmap v5761: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 24 KiB/s wr, 6 op/s 2023-05-08T06:42:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:33 smithi096 ceph-mon[124666]: pgmap v5761: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 24 KiB/s wr, 6 op/s 2023-05-08T06:42:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10692.803636 secs 2023-05-08T06:42:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10693.361417 secs 2023-05-08T06:42:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10692.803636 secs 2023-05-08T06:42:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10693.361417 secs 2023-05-08T06:42:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10692.803636 secs 2023-05-08T06:42:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10693.361417 secs 2023-05-08T06:42:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:35 smithi186 ceph-mon[126480]: pgmap v5762: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 48 KiB/s wr, 10 op/s 2023-05-08T06:42:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:35 smithi133 ceph-mon[125939]: pgmap v5762: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 48 KiB/s wr, 10 op/s 2023-05-08T06:42:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:35 smithi096 ceph-mon[124666]: pgmap v5762: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 48 KiB/s wr, 10 op/s 2023-05-08T06:42:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10694.642562 secs 2023-05-08T06:42:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10694.642562 secs 2023-05-08T06:42:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10694.642562 secs 2023-05-08T06:42:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:37 smithi186 ceph-mon[126480]: pgmap v5763: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 48 KiB/s wr, 7 op/s 2023-05-08T06:42:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:37 smithi133 ceph-mon[125939]: pgmap v5763: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 48 KiB/s wr, 7 op/s 2023-05-08T06:42:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:37 smithi096 ceph-mon[124666]: pgmap v5763: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 48 KiB/s wr, 7 op/s 2023-05-08T06:42:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10697.803747 secs 2023-05-08T06:42:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10697.803747 secs 2023-05-08T06:42:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10697.803747 secs 2023-05-08T06:42:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10698.361488 secs 2023-05-08T06:42:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:39 smithi133 ceph-mon[125939]: pgmap v5764: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 122 KiB/s wr, 11 op/s 2023-05-08T06:42:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10698.361488 secs 2023-05-08T06:42:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:39 smithi096 ceph-mon[124666]: pgmap v5764: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 122 KiB/s wr, 11 op/s 2023-05-08T06:42:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10698.361488 secs 2023-05-08T06:42:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:39 smithi186 ceph-mon[126480]: pgmap v5764: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 122 KiB/s wr, 11 op/s 2023-05-08T06:42:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10699.642703 secs 2023-05-08T06:42:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10699.642703 secs 2023-05-08T06:42:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10699.642703 secs 2023-05-08T06:42:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:41 smithi133 ceph-mon[125939]: pgmap v5765: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 98 KiB/s wr, 7 op/s 2023-05-08T06:42:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:41 smithi096 ceph-mon[124666]: pgmap v5765: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 98 KiB/s wr, 7 op/s 2023-05-08T06:42:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:41 smithi186 ceph-mon[126480]: pgmap v5765: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 98 KiB/s wr, 7 op/s 2023-05-08T06:42:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:43 smithi186 ceph-mon[126480]: pgmap v5766: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 98 KiB/s wr, 7 op/s 2023-05-08T06:42:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:43 smithi133 ceph-mon[125939]: pgmap v5766: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 98 KiB/s wr, 7 op/s 2023-05-08T06:42:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:43 smithi096 ceph-mon[124666]: pgmap v5766: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 98 KiB/s wr, 7 op/s 2023-05-08T06:42:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10702.803863 secs 2023-05-08T06:42:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10702.803863 secs 2023-05-08T06:42:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10702.803863 secs 2023-05-08T06:42:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:45 smithi186 ceph-mon[126480]: pgmap v5767: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 126 KiB/s wr, 12 op/s 2023-05-08T06:42:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:45 smithi133 ceph-mon[125939]: pgmap v5767: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 126 KiB/s wr, 12 op/s 2023-05-08T06:42:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:45 smithi096 ceph-mon[124666]: pgmap v5767: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 126 KiB/s wr, 12 op/s 2023-05-08T06:42:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:46 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:42:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:46 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:42:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:46 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:42:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:46 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:42:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:46 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:42:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:46 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:42:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:47 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:42:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:47 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:42:47.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:47 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:42:47.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:47 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:42:47.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:47 smithi133 ceph-mon[125939]: pgmap v5768: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 103 KiB/s wr, 8 op/s 2023-05-08T06:42:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:47 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:42:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:47 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:42:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:47 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:42:47.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:47 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:42:47.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:47 smithi096 ceph-mon[124666]: pgmap v5768: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 103 KiB/s wr, 8 op/s 2023-05-08T06:42:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:47 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:42:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:47 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:42:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:47 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:42:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:47 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:42:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:47 smithi186 ceph-mon[126480]: pgmap v5768: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 103 KiB/s wr, 8 op/s 2023-05-08T06:42:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10707.803982 secs 2023-05-08T06:42:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10707.803982 secs 2023-05-08T06:42:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10707.803982 secs 2023-05-08T06:42:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10708.361594 secs 2023-05-08T06:42:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:49 smithi133 ceph-mon[125939]: pgmap v5769: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 173 KiB/s wr, 13 op/s 2023-05-08T06:42:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10708.361594 secs 2023-05-08T06:42:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:49 smithi096 ceph-mon[124666]: pgmap v5769: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 173 KiB/s wr, 13 op/s 2023-05-08T06:42:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10708.361594 secs 2023-05-08T06:42:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:49 smithi186 ceph-mon[126480]: pgmap v5769: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 173 KiB/s wr, 13 op/s 2023-05-08T06:42:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:42:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:42:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:51 smithi133 ceph-mon[125939]: pgmap v5770: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 98 KiB/s wr, 9 op/s 2023-05-08T06:42:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:42:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:42:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:51 smithi096 ceph-mon[124666]: pgmap v5770: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 98 KiB/s wr, 9 op/s 2023-05-08T06:42:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:42:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:42:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:51 smithi186 ceph-mon[126480]: pgmap v5770: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 98 KiB/s wr, 9 op/s 2023-05-08T06:42:53.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:53 smithi186 ceph-mon[126480]: pgmap v5771: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 98 KiB/s wr, 9 op/s 2023-05-08T06:42:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:53 smithi133 ceph-mon[125939]: pgmap v5771: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 98 KiB/s wr, 9 op/s 2023-05-08T06:42:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:53 smithi096 ceph-mon[124666]: pgmap v5771: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 98 KiB/s wr, 9 op/s 2023-05-08T06:42:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10712.804045 secs 2023-05-08T06:42:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10712.804045 secs 2023-05-08T06:42:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10712.804045 secs 2023-05-08T06:42:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:55 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:42:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:55 smithi186 ceph-mon[126480]: pgmap v5772: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 129 KiB/s wr, 13 op/s 2023-05-08T06:42:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:55 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:42:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:55 smithi133 ceph-mon[125939]: pgmap v5772: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 129 KiB/s wr, 13 op/s 2023-05-08T06:42:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:55 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:42:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:55 smithi096 ceph-mon[124666]: pgmap v5772: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 129 KiB/s wr, 13 op/s 2023-05-08T06:42:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:56 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:42:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:42:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:42:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:56 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:42:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:42:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:42:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:56 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:42:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:42:56.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:42:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:57 smithi186 ceph-mon[126480]: pgmap v5773: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 101 KiB/s wr, 8 op/s 2023-05-08T06:42:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:57 smithi133 ceph-mon[125939]: pgmap v5773: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 101 KiB/s wr, 8 op/s 2023-05-08T06:42:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:57 smithi096 ceph-mon[124666]: pgmap v5773: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 101 KiB/s wr, 8 op/s 2023-05-08T06:42:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10717.804170 secs 2023-05-08T06:42:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10717.804170 secs 2023-05-08T06:42:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10717.804170 secs 2023-05-08T06:42:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10718.361787 secs 2023-05-08T06:42:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:42:59 smithi133 ceph-mon[125939]: pgmap v5774: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 171 KiB/s wr, 12 op/s 2023-05-08T06:43:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10718.361787 secs 2023-05-08T06:43:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:42:59 smithi096 ceph-mon[124666]: pgmap v5774: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 171 KiB/s wr, 12 op/s 2023-05-08T06:43:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10718.361787 secs 2023-05-08T06:43:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:42:59 smithi186 ceph-mon[126480]: pgmap v5774: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 171 KiB/s wr, 12 op/s 2023-05-08T06:43:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10719.643156 secs 2023-05-08T06:43:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10719.643156 secs 2023-05-08T06:43:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10719.643156 secs 2023-05-08T06:43:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:01 smithi133 ceph-mon[125939]: pgmap v5775: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 101 KiB/s wr, 8 op/s 2023-05-08T06:43:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:01 smithi096 ceph-mon[124666]: pgmap v5775: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 101 KiB/s wr, 8 op/s 2023-05-08T06:43:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:01 smithi186 ceph-mon[126480]: pgmap v5775: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 101 KiB/s wr, 8 op/s 2023-05-08T06:43:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:02 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:43:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:43:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:43:02.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:43:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:02 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:43:03.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:43:03.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:43:03.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:43:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:02 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:43:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:43:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:43:03.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:43:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10722.804285 secs 2023-05-08T06:43:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:03 smithi133 ceph-mon[125939]: pgmap v5776: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 101 KiB/s wr, 8 op/s 2023-05-08T06:43:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10722.804285 secs 2023-05-08T06:43:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:03 smithi096 ceph-mon[124666]: pgmap v5776: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 101 KiB/s wr, 8 op/s 2023-05-08T06:43:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10722.804285 secs 2023-05-08T06:43:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:03 smithi186 ceph-mon[126480]: pgmap v5776: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 101 KiB/s wr, 8 op/s 2023-05-08T06:43:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10723.361902 secs 2023-05-08T06:43:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10723.361902 secs 2023-05-08T06:43:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10723.361902 secs 2023-05-08T06:43:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10724.643279 secs 2023-05-08T06:43:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:05 smithi133 ceph-mon[125939]: pgmap v5777: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 169 KiB/s wr, 27 op/s 2023-05-08T06:43:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10724.643279 secs 2023-05-08T06:43:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:05 smithi096 ceph-mon[124666]: pgmap v5777: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 169 KiB/s wr, 27 op/s 2023-05-08T06:43:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10724.643279 secs 2023-05-08T06:43:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:05 smithi186 ceph-mon[126480]: pgmap v5777: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 169 KiB/s wr, 27 op/s 2023-05-08T06:43:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:06 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:43:07.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:06 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:43:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:06 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:43:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:08 smithi096 ceph-mon[124666]: pgmap v5778: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 138 KiB/s wr, 22 op/s 2023-05-08T06:43:08.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:08 smithi186 ceph-mon[126480]: pgmap v5778: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 138 KiB/s wr, 22 op/s 2023-05-08T06:43:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:08 smithi133 ceph-mon[125939]: pgmap v5778: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 138 KiB/s wr, 22 op/s 2023-05-08T06:43:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10727.804393 secs 2023-05-08T06:43:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10727.804393 secs 2023-05-08T06:43:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10727.804393 secs 2023-05-08T06:43:10.086 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10728.362045 secs 2023-05-08T06:43:10.087 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:10 smithi133 ceph-mon[125939]: pgmap v5779: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 159 KiB/s wr, 25 op/s 2023-05-08T06:43:10.244 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10728.362045 secs 2023-05-08T06:43:10.244 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:10 smithi096 ceph-mon[124666]: pgmap v5779: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 159 KiB/s wr, 25 op/s 2023-05-08T06:43:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10728.362045 secs 2023-05-08T06:43:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:10 smithi186 ceph-mon[126480]: pgmap v5779: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 159 KiB/s wr, 25 op/s 2023-05-08T06:43:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10729.643400 secs 2023-05-08T06:43:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:11 smithi186 ceph-mon[126480]: osdmap e438: 12 total, 12 up, 12 in 2023-05-08T06:43:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:11 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:43:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:11 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:43:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:11 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:43:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:11 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:43:11.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:11 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:43:11.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:11 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:43:11.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:11 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:43:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10729.643400 secs 2023-05-08T06:43:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:11 smithi133 ceph-mon[125939]: osdmap e438: 12 total, 12 up, 12 in 2023-05-08T06:43:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:11 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:43:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:11 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:43:11.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:11 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:43:11.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:11 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:43:11.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:11 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:43:11.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:11 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:43:11.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:11 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:43:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10729.643400 secs 2023-05-08T06:43:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:11 smithi096 ceph-mon[124666]: osdmap e438: 12 total, 12 up, 12 in 2023-05-08T06:43:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:11 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:43:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:11 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:43:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:11 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:43:11.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:11 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:43:11.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:11 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:43:11.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:11 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:43:11.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:11 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:43:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:12 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:43:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:12 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T06:43:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:12 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T06:43:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:12 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:43:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:12 smithi186 ceph-mon[126480]: pgmap v5781: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 107 KiB/s wr, 26 op/s 2023-05-08T06:43:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:12 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:43:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:12 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T06:43:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:12 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T06:43:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:12 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:43:12.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:12 smithi133 ceph-mon[125939]: pgmap v5781: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 107 KiB/s wr, 26 op/s 2023-05-08T06:43:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:12 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:43:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:12 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T06:43:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:12 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T06:43:12.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:12 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:43:12.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:12 smithi096 ceph-mon[124666]: pgmap v5781: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 107 KiB/s wr, 26 op/s 2023-05-08T06:43:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:13 smithi186 ceph-mon[126480]: pgmap v5782: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 107 KiB/s wr, 26 op/s 2023-05-08T06:43:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:13 smithi133 ceph-mon[125939]: pgmap v5782: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 107 KiB/s wr, 26 op/s 2023-05-08T06:43:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:13 smithi096 ceph-mon[124666]: pgmap v5782: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 107 KiB/s wr, 26 op/s 2023-05-08T06:43:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10732.804506 secs 2023-05-08T06:43:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10733.362198 secs 2023-05-08T06:43:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10732.804506 secs 2023-05-08T06:43:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10733.362198 secs 2023-05-08T06:43:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10732.804506 secs 2023-05-08T06:43:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10733.362198 secs 2023-05-08T06:43:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:15 smithi186 ceph-mon[126480]: pgmap v5783: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 30 KiB/s wr, 8 op/s 2023-05-08T06:43:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:15 smithi133 ceph-mon[125939]: pgmap v5783: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 30 KiB/s wr, 8 op/s 2023-05-08T06:43:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:15 smithi096 ceph-mon[124666]: pgmap v5783: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 30 KiB/s wr, 8 op/s 2023-05-08T06:43:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10734.643524 secs 2023-05-08T06:43:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:16 smithi186 ceph-mon[126480]: osdmap e439: 12 total, 12 up, 12 in 2023-05-08T06:43:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10734.643524 secs 2023-05-08T06:43:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:16 smithi133 ceph-mon[125939]: osdmap e439: 12 total, 12 up, 12 in 2023-05-08T06:43:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10734.643524 secs 2023-05-08T06:43:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:16 smithi096 ceph-mon[124666]: osdmap e439: 12 total, 12 up, 12 in 2023-05-08T06:43:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:17 smithi186 ceph-mon[126480]: pgmap v5785: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 6.2 KiB/s wr, 5 op/s 2023-05-08T06:43:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:17 smithi133 ceph-mon[125939]: pgmap v5785: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 6.2 KiB/s wr, 5 op/s 2023-05-08T06:43:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:17 smithi096 ceph-mon[124666]: pgmap v5785: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 6.2 KiB/s wr, 5 op/s 2023-05-08T06:43:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10737.804598 secs 2023-05-08T06:43:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10737.804598 secs 2023-05-08T06:43:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10737.804598 secs 2023-05-08T06:43:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10738.362318 secs 2023-05-08T06:43:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:19 smithi133 ceph-mon[125939]: pgmap v5786: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 6.0 KiB/s wr, 8 op/s 2023-05-08T06:43:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10738.362318 secs 2023-05-08T06:43:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:19 smithi096 ceph-mon[124666]: pgmap v5786: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 6.0 KiB/s wr, 8 op/s 2023-05-08T06:43:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10738.362318 secs 2023-05-08T06:43:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:19 smithi186 ceph-mon[126480]: pgmap v5786: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 6.0 KiB/s wr, 8 op/s 2023-05-08T06:43:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10739.643623 secs 2023-05-08T06:43:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10739.643623 secs 2023-05-08T06:43:21.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10739.643623 secs 2023-05-08T06:43:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:21 smithi133 ceph-mon[125939]: pgmap v5787: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.4 KiB/s wr, 8 op/s 2023-05-08T06:43:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:21 smithi096 ceph-mon[124666]: pgmap v5787: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.4 KiB/s wr, 8 op/s 2023-05-08T06:43:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:21 smithi186 ceph-mon[126480]: pgmap v5787: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.4 KiB/s wr, 8 op/s 2023-05-08T06:43:23.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:23 smithi186 ceph-mon[126480]: pgmap v5788: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.4 KiB/s wr, 8 op/s 2023-05-08T06:43:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:23 smithi133 ceph-mon[125939]: pgmap v5788: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.4 KiB/s wr, 8 op/s 2023-05-08T06:43:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:23 smithi096 ceph-mon[124666]: pgmap v5788: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.4 KiB/s wr, 8 op/s 2023-05-08T06:43:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10742.804716 secs 2023-05-08T06:43:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10743.362460 secs 2023-05-08T06:43:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10742.804716 secs 2023-05-08T06:43:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10743.362460 secs 2023-05-08T06:43:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10742.804716 secs 2023-05-08T06:43:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10743.362460 secs 2023-05-08T06:43:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:25 smithi186 ceph-mon[126480]: pgmap v5789: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 30 KiB/s wr, 8 op/s 2023-05-08T06:43:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:25 smithi133 ceph-mon[125939]: pgmap v5789: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 30 KiB/s wr, 8 op/s 2023-05-08T06:43:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:25 smithi096 ceph-mon[124666]: pgmap v5789: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 30 KiB/s wr, 8 op/s 2023-05-08T06:43:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10744.643764 secs 2023-05-08T06:43:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10744.643764 secs 2023-05-08T06:43:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10744.643764 secs 2023-05-08T06:43:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:27 smithi186 ceph-mon[126480]: pgmap v5790: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 25 KiB/s wr, 6 op/s 2023-05-08T06:43:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:27 smithi133 ceph-mon[125939]: pgmap v5790: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 25 KiB/s wr, 6 op/s 2023-05-08T06:43:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:27 smithi096 ceph-mon[124666]: pgmap v5790: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 25 KiB/s wr, 6 op/s 2023-05-08T06:43:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10747.804852 secs 2023-05-08T06:43:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10747.804852 secs 2023-05-08T06:43:29.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10747.804852 secs 2023-05-08T06:43:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10748.362508 secs 2023-05-08T06:43:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:29 smithi133 ceph-mon[125939]: pgmap v5791: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 25 KiB/s wr, 10 op/s 2023-05-08T06:43:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10748.362508 secs 2023-05-08T06:43:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:29 smithi096 ceph-mon[124666]: pgmap v5791: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 25 KiB/s wr, 10 op/s 2023-05-08T06:43:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10748.362508 secs 2023-05-08T06:43:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:29 smithi186 ceph-mon[126480]: pgmap v5791: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 25 KiB/s wr, 10 op/s 2023-05-08T06:43:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10749.643885 secs 2023-05-08T06:43:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10749.643885 secs 2023-05-08T06:43:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10749.643885 secs 2023-05-08T06:43:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:31 smithi133 ceph-mon[125939]: pgmap v5792: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 7 op/s 2023-05-08T06:43:32.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:31 smithi096 ceph-mon[124666]: pgmap v5792: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 7 op/s 2023-05-08T06:43:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:31 smithi186 ceph-mon[126480]: pgmap v5792: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 7 op/s 2023-05-08T06:43:33.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:33 smithi186 ceph-mon[126480]: pgmap v5793: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 7 op/s 2023-05-08T06:43:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:33 smithi133 ceph-mon[125939]: pgmap v5793: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 7 op/s 2023-05-08T06:43:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:33 smithi096 ceph-mon[124666]: pgmap v5793: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 7 op/s 2023-05-08T06:43:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10752.804918 secs 2023-05-08T06:43:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10753.362629 secs 2023-05-08T06:43:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10752.804918 secs 2023-05-08T06:43:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10753.362629 secs 2023-05-08T06:43:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10752.804918 secs 2023-05-08T06:43:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10753.362629 secs 2023-05-08T06:43:35.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:35 smithi186 ceph-mon[126480]: pgmap v5794: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 9 op/s 2023-05-08T06:43:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:35 smithi133 ceph-mon[125939]: pgmap v5794: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 9 op/s 2023-05-08T06:43:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:35 smithi096 ceph-mon[124666]: pgmap v5794: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 9 op/s 2023-05-08T06:43:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10754.644007 secs 2023-05-08T06:43:36.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10754.644007 secs 2023-05-08T06:43:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10754.644007 secs 2023-05-08T06:43:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:37 smithi186 ceph-mon[126480]: pgmap v5795: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T06:43:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:37 smithi133 ceph-mon[125939]: pgmap v5795: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T06:43:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:37 smithi096 ceph-mon[124666]: pgmap v5795: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T06:43:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10757.805064 secs 2023-05-08T06:43:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10757.805064 secs 2023-05-08T06:43:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10757.805064 secs 2023-05-08T06:43:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10758.362742 secs 2023-05-08T06:43:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:39 smithi133 ceph-mon[125939]: pgmap v5796: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 24 KiB/s wr, 9 op/s 2023-05-08T06:43:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10758.362742 secs 2023-05-08T06:43:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:39 smithi096 ceph-mon[124666]: pgmap v5796: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 24 KiB/s wr, 9 op/s 2023-05-08T06:43:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10758.362742 secs 2023-05-08T06:43:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:39 smithi186 ceph-mon[126480]: pgmap v5796: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 24 KiB/s wr, 9 op/s 2023-05-08T06:43:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10759.644090 secs 2023-05-08T06:43:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10759.644090 secs 2023-05-08T06:43:41.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10759.644090 secs 2023-05-08T06:43:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:41 smithi133 ceph-mon[125939]: pgmap v5797: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 5 op/s 2023-05-08T06:43:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:41 smithi096 ceph-mon[124666]: pgmap v5797: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 5 op/s 2023-05-08T06:43:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:41 smithi186 ceph-mon[126480]: pgmap v5797: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 5 op/s 2023-05-08T06:43:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:43 smithi186 ceph-mon[126480]: pgmap v5798: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 5 op/s 2023-05-08T06:43:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:43 smithi133 ceph-mon[125939]: pgmap v5798: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 5 op/s 2023-05-08T06:43:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:43 smithi096 ceph-mon[124666]: pgmap v5798: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 5 op/s 2023-05-08T06:43:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10762.805179 secs 2023-05-08T06:43:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10762.805179 secs 2023-05-08T06:43:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10762.805179 secs 2023-05-08T06:43:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:45 smithi186 ceph-mon[126480]: pgmap v5799: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 71 KiB/s wr, 9 op/s 2023-05-08T06:43:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:45 smithi133 ceph-mon[125939]: pgmap v5799: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 71 KiB/s wr, 9 op/s 2023-05-08T06:43:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:45 smithi096 ceph-mon[124666]: pgmap v5799: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 71 KiB/s wr, 9 op/s 2023-05-08T06:43:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:46 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:43:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:46 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:43:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:46 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:43:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:46 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:43:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:46 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:43:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:46 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:43:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:47 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:43:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:47 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:43:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:47 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:43:47.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:47 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:43:47.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:47 smithi133 ceph-mon[125939]: pgmap v5800: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 71 KiB/s wr, 7 op/s 2023-05-08T06:43:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:47 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:43:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:47 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:43:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:47 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:43:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:47 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:43:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:47 smithi096 ceph-mon[124666]: pgmap v5800: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 71 KiB/s wr, 7 op/s 2023-05-08T06:43:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:47 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:43:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:47 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:43:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:47 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:43:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:47 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:43:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:47 smithi186 ceph-mon[126480]: pgmap v5800: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 71 KiB/s wr, 7 op/s 2023-05-08T06:43:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10767.805279 secs 2023-05-08T06:43:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10767.805279 secs 2023-05-08T06:43:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10767.805279 secs 2023-05-08T06:43:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:49 smithi133 ceph-mon[125939]: pgmap v5801: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 138 KiB/s wr, 12 op/s 2023-05-08T06:43:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:49 smithi096 ceph-mon[124666]: pgmap v5801: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 138 KiB/s wr, 12 op/s 2023-05-08T06:43:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:49 smithi186 ceph-mon[126480]: pgmap v5801: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 138 KiB/s wr, 12 op/s 2023-05-08T06:43:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:51 smithi133 ceph-mon[125939]: pgmap v5802: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 115 KiB/s wr, 9 op/s 2023-05-08T06:43:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:51 smithi096 ceph-mon[124666]: pgmap v5802: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 115 KiB/s wr, 9 op/s 2023-05-08T06:43:51.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:51 smithi186 ceph-mon[126480]: pgmap v5802: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 115 KiB/s wr, 9 op/s 2023-05-08T06:43:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:53 smithi186 ceph-mon[126480]: pgmap v5803: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 115 KiB/s wr, 9 op/s 2023-05-08T06:43:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:53 smithi133 ceph-mon[125939]: pgmap v5803: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 115 KiB/s wr, 9 op/s 2023-05-08T06:43:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:53 smithi096 ceph-mon[124666]: pgmap v5803: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 115 KiB/s wr, 9 op/s 2023-05-08T06:43:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10772.805367 secs 2023-05-08T06:43:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10773.363101 secs 2023-05-08T06:43:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10772.805367 secs 2023-05-08T06:43:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10773.363101 secs 2023-05-08T06:43:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10772.805367 secs 2023-05-08T06:43:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10773.363101 secs 2023-05-08T06:43:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:55 smithi186 ceph-mon[126480]: pgmap v5804: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 145 KiB/s wr, 13 op/s 2023-05-08T06:43:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:55 smithi133 ceph-mon[125939]: pgmap v5804: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 145 KiB/s wr, 13 op/s 2023-05-08T06:43:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:55 smithi096 ceph-mon[124666]: pgmap v5804: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 145 KiB/s wr, 13 op/s 2023-05-08T06:43:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:56 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:43:56.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:43:56.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:43:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:56 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:43:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:43:56.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:43:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:56 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:43:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:43:56.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:43:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:57 smithi186 ceph-mon[126480]: pgmap v5805: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 98 KiB/s wr, 9 op/s 2023-05-08T06:43:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:57 smithi133 ceph-mon[125939]: pgmap v5805: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 98 KiB/s wr, 9 op/s 2023-05-08T06:43:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:57 smithi096 ceph-mon[124666]: pgmap v5805: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 98 KiB/s wr, 9 op/s 2023-05-08T06:43:58.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10777.805450 secs 2023-05-08T06:43:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10777.805450 secs 2023-05-08T06:43:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10777.805450 secs 2023-05-08T06:43:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:43:59 smithi133 ceph-mon[125939]: pgmap v5806: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 176 KiB/s wr, 14 op/s 2023-05-08T06:44:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:43:59 smithi096 ceph-mon[124666]: pgmap v5806: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 176 KiB/s wr, 14 op/s 2023-05-08T06:44:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:43:59 smithi186 ceph-mon[126480]: pgmap v5806: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 176 KiB/s wr, 14 op/s 2023-05-08T06:44:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10779.644645 secs 2023-05-08T06:44:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10779.644645 secs 2023-05-08T06:44:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10779.644645 secs 2023-05-08T06:44:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:01 smithi133 ceph-mon[125939]: pgmap v5807: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 108 KiB/s wr, 9 op/s 2023-05-08T06:44:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:01 smithi096 ceph-mon[124666]: pgmap v5807: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 108 KiB/s wr, 9 op/s 2023-05-08T06:44:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:01 smithi186 ceph-mon[126480]: pgmap v5807: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 108 KiB/s wr, 9 op/s 2023-05-08T06:44:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:02 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:44:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:02 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:44:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:02 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:44:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:44:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:44:03.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:03 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:44:03.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10782.805516 secs 2023-05-08T06:44:03.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:03 smithi133 ceph-mon[125939]: pgmap v5808: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 108 KiB/s wr, 9 op/s 2023-05-08T06:44:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:44:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:44:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:03 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:44:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10782.805516 secs 2023-05-08T06:44:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:03 smithi096 ceph-mon[124666]: pgmap v5808: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 108 KiB/s wr, 9 op/s 2023-05-08T06:44:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:44:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:44:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:03 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:44:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10782.805516 secs 2023-05-08T06:44:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:03 smithi186 ceph-mon[126480]: pgmap v5808: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 108 KiB/s wr, 9 op/s 2023-05-08T06:44:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10783.363291 secs 2023-05-08T06:44:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10783.363291 secs 2023-05-08T06:44:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10783.363291 secs 2023-05-08T06:44:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10784.644798 secs 2023-05-08T06:44:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:05 smithi133 ceph-mon[125939]: pgmap v5809: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 201 KiB/s wr, 27 op/s 2023-05-08T06:44:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10784.644798 secs 2023-05-08T06:44:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:05 smithi096 ceph-mon[124666]: pgmap v5809: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 201 KiB/s wr, 27 op/s 2023-05-08T06:44:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10784.644798 secs 2023-05-08T06:44:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:05 smithi186 ceph-mon[126480]: pgmap v5809: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 201 KiB/s wr, 27 op/s 2023-05-08T06:44:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:06 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:44:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:44:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:44:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:06 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:44:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:44:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:44:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:06 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:44:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:44:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:44:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:07 smithi096 ceph-mon[124666]: pgmap v5810: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 171 KiB/s wr, 24 op/s 2023-05-08T06:44:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:07 smithi186 ceph-mon[126480]: pgmap v5810: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 171 KiB/s wr, 24 op/s 2023-05-08T06:44:08.364 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:07 smithi133 ceph-mon[125939]: pgmap v5810: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 171 KiB/s wr, 24 op/s 2023-05-08T06:44:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10787.805628 secs 2023-05-08T06:44:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10787.805628 secs 2023-05-08T06:44:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10787.805628 secs 2023-05-08T06:44:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10788.363443 secs 2023-05-08T06:44:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:09 smithi096 ceph-mon[124666]: pgmap v5811: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 192 KiB/s wr, 28 op/s 2023-05-08T06:44:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10788.363443 secs 2023-05-08T06:44:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:09 smithi186 ceph-mon[126480]: pgmap v5811: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 192 KiB/s wr, 28 op/s 2023-05-08T06:44:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10788.363443 secs 2023-05-08T06:44:10.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:09 smithi133 ceph-mon[125939]: pgmap v5811: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 192 KiB/s wr, 28 op/s 2023-05-08T06:44:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10789.644892 secs 2023-05-08T06:44:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:10 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:44:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10789.644892 secs 2023-05-08T06:44:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:10 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:44:11.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10789.644892 secs 2023-05-08T06:44:11.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:10 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:44:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:11 smithi186 ceph-mon[126480]: osdmap e440: 12 total, 12 up, 12 in 2023-05-08T06:44:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:11 smithi186 ceph-mon[126480]: pgmap v5813: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 137 KiB/s wr, 27 op/s 2023-05-08T06:44:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:11 smithi133 ceph-mon[125939]: osdmap e440: 12 total, 12 up, 12 in 2023-05-08T06:44:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:11 smithi133 ceph-mon[125939]: pgmap v5813: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 137 KiB/s wr, 27 op/s 2023-05-08T06:44:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:11 smithi096 ceph-mon[124666]: osdmap e440: 12 total, 12 up, 12 in 2023-05-08T06:44:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:11 smithi096 ceph-mon[124666]: pgmap v5813: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 137 KiB/s wr, 27 op/s 2023-05-08T06:44:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:13 smithi186 ceph-mon[126480]: pgmap v5814: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 137 KiB/s wr, 27 op/s 2023-05-08T06:44:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:13 smithi133 ceph-mon[125939]: pgmap v5814: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 137 KiB/s wr, 27 op/s 2023-05-08T06:44:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:13 smithi096 ceph-mon[124666]: pgmap v5814: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 137 KiB/s wr, 27 op/s 2023-05-08T06:44:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10792.805694 secs 2023-05-08T06:44:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10793.363491 secs 2023-05-08T06:44:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:44:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:44:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:44:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:44:14.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:14 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:44:14.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:44:14.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:14 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T06:44:14.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:14 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T06:44:14.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:14 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:44:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10792.805694 secs 2023-05-08T06:44:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10793.363491 secs 2023-05-08T06:44:14.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:44:14.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:44:14.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:44:14.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:44:14.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:14 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:44:14.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:44:14.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:14 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T06:44:14.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:14 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T06:44:14.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:14 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:44:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10792.805694 secs 2023-05-08T06:44:14.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10793.363491 secs 2023-05-08T06:44:14.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:44:14.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:44:14.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:44:14.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:44:14.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:14 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:44:14.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:44:14.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:14 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T06:44:14.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:14 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T06:44:14.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:14 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:44:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:15 smithi186 ceph-mon[126480]: pgmap v5815: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 8 op/s 2023-05-08T06:44:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:15 smithi133 ceph-mon[125939]: pgmap v5815: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 8 op/s 2023-05-08T06:44:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:15 smithi096 ceph-mon[124666]: pgmap v5815: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 8 op/s 2023-05-08T06:44:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10794.645006 secs 2023-05-08T06:44:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10794.645006 secs 2023-05-08T06:44:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10794.645006 secs 2023-05-08T06:44:17.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:17 smithi186 ceph-mon[126480]: pgmap v5816: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 8 op/s 2023-05-08T06:44:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:17 smithi133 ceph-mon[125939]: pgmap v5816: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 8 op/s 2023-05-08T06:44:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:17 smithi096 ceph-mon[124666]: pgmap v5816: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 8 op/s 2023-05-08T06:44:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10797.805812 secs 2023-05-08T06:44:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10797.805812 secs 2023-05-08T06:44:19.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10797.805812 secs 2023-05-08T06:44:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10798.363632 secs 2023-05-08T06:44:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:19 smithi133 ceph-mon[125939]: pgmap v5817: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 1023 B/s wr, 7 op/s 2023-05-08T06:44:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10798.363632 secs 2023-05-08T06:44:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:19 smithi096 ceph-mon[124666]: pgmap v5817: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 1023 B/s wr, 7 op/s 2023-05-08T06:44:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10798.363632 secs 2023-05-08T06:44:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:19 smithi186 ceph-mon[126480]: pgmap v5817: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 1023 B/s wr, 7 op/s 2023-05-08T06:44:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10799.645093 secs 2023-05-08T06:44:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:20 smithi133 ceph-mon[125939]: osdmap e441: 12 total, 12 up, 12 in 2023-05-08T06:44:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10799.645093 secs 2023-05-08T06:44:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:20 smithi096 ceph-mon[124666]: osdmap e441: 12 total, 12 up, 12 in 2023-05-08T06:44:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10799.645093 secs 2023-05-08T06:44:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:20 smithi186 ceph-mon[126480]: osdmap e441: 12 total, 12 up, 12 in 2023-05-08T06:44:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:21 smithi133 ceph-mon[125939]: pgmap v5819: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 921 B/s wr, 7 op/s 2023-05-08T06:44:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:21 smithi096 ceph-mon[124666]: pgmap v5819: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 921 B/s wr, 7 op/s 2023-05-08T06:44:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:21 smithi186 ceph-mon[126480]: pgmap v5819: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 921 B/s wr, 7 op/s 2023-05-08T06:44:23.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:23 smithi186 ceph-mon[126480]: pgmap v5820: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 921 B/s wr, 7 op/s 2023-05-08T06:44:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:23 smithi133 ceph-mon[125939]: pgmap v5820: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 921 B/s wr, 7 op/s 2023-05-08T06:44:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:23 smithi096 ceph-mon[124666]: pgmap v5820: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 921 B/s wr, 7 op/s 2023-05-08T06:44:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10802.805905 secs 2023-05-08T06:44:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10803.363734 secs 2023-05-08T06:44:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10802.805905 secs 2023-05-08T06:44:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10803.363734 secs 2023-05-08T06:44:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10802.805905 secs 2023-05-08T06:44:24.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10803.363734 secs 2023-05-08T06:44:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:25 smithi186 ceph-mon[126480]: pgmap v5821: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 7 op/s 2023-05-08T06:44:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:25 smithi133 ceph-mon[125939]: pgmap v5821: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 7 op/s 2023-05-08T06:44:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:25 smithi096 ceph-mon[124666]: pgmap v5821: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 7 op/s 2023-05-08T06:44:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10804.645243 secs 2023-05-08T06:44:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10804.645243 secs 2023-05-08T06:44:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10804.645243 secs 2023-05-08T06:44:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:27 smithi186 ceph-mon[126480]: pgmap v5822: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 7 op/s 2023-05-08T06:44:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:27 smithi133 ceph-mon[125939]: pgmap v5822: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 7 op/s 2023-05-08T06:44:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:27 smithi096 ceph-mon[124666]: pgmap v5822: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 7 op/s 2023-05-08T06:44:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10807.806017 secs 2023-05-08T06:44:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10807.806017 secs 2023-05-08T06:44:29.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10807.806017 secs 2023-05-08T06:44:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10808.363857 secs 2023-05-08T06:44:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:29 smithi133 ceph-mon[125939]: pgmap v5823: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 8 op/s 2023-05-08T06:44:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10808.363857 secs 2023-05-08T06:44:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:29 smithi096 ceph-mon[124666]: pgmap v5823: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 8 op/s 2023-05-08T06:44:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10808.363857 secs 2023-05-08T06:44:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:29 smithi186 ceph-mon[126480]: pgmap v5823: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 8 op/s 2023-05-08T06:44:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10809.645382 secs 2023-05-08T06:44:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10809.645382 secs 2023-05-08T06:44:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10809.645382 secs 2023-05-08T06:44:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:31 smithi133 ceph-mon[125939]: pgmap v5824: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 7 op/s 2023-05-08T06:44:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:31 smithi096 ceph-mon[124666]: pgmap v5824: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 7 op/s 2023-05-08T06:44:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:31 smithi186 ceph-mon[126480]: pgmap v5824: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 7 op/s 2023-05-08T06:44:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:33 smithi186 ceph-mon[126480]: pgmap v5825: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 49 KiB/s wr, 7 op/s 2023-05-08T06:44:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:33 smithi133 ceph-mon[125939]: pgmap v5825: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 49 KiB/s wr, 7 op/s 2023-05-08T06:44:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:33 smithi096 ceph-mon[124666]: pgmap v5825: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 49 KiB/s wr, 7 op/s 2023-05-08T06:44:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10812.806155 secs 2023-05-08T06:44:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10813.363974 secs 2023-05-08T06:44:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10812.806155 secs 2023-05-08T06:44:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10813.363974 secs 2023-05-08T06:44:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10812.806155 secs 2023-05-08T06:44:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10813.363974 secs 2023-05-08T06:44:35.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:35 smithi186 ceph-mon[126480]: pgmap v5826: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 73 KiB/s wr, 10 op/s 2023-05-08T06:44:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:35 smithi133 ceph-mon[125939]: pgmap v5826: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 73 KiB/s wr, 10 op/s 2023-05-08T06:44:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:35 smithi096 ceph-mon[124666]: pgmap v5826: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 73 KiB/s wr, 10 op/s 2023-05-08T06:44:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10814.645507 secs 2023-05-08T06:44:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10814.645507 secs 2023-05-08T06:44:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10814.645507 secs 2023-05-08T06:44:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:37 smithi186 ceph-mon[126480]: pgmap v5827: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 48 KiB/s wr, 6 op/s 2023-05-08T06:44:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:37 smithi133 ceph-mon[125939]: pgmap v5827: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 48 KiB/s wr, 6 op/s 2023-05-08T06:44:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:37 smithi096 ceph-mon[124666]: pgmap v5827: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 48 KiB/s wr, 6 op/s 2023-05-08T06:44:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10817.806284 secs 2023-05-08T06:44:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10817.806284 secs 2023-05-08T06:44:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10817.806284 secs 2023-05-08T06:44:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10818.364092 secs 2023-05-08T06:44:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:39 smithi133 ceph-mon[125939]: pgmap v5828: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 73 KiB/s wr, 9 op/s 2023-05-08T06:44:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10818.364092 secs 2023-05-08T06:44:40.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:39 smithi096 ceph-mon[124666]: pgmap v5828: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 73 KiB/s wr, 9 op/s 2023-05-08T06:44:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10818.364092 secs 2023-05-08T06:44:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:39 smithi186 ceph-mon[126480]: pgmap v5828: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 73 KiB/s wr, 9 op/s 2023-05-08T06:44:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10819.645638 secs 2023-05-08T06:44:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10819.645638 secs 2023-05-08T06:44:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10819.645638 secs 2023-05-08T06:44:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:41 smithi133 ceph-mon[125939]: pgmap v5829: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 48 KiB/s wr, 6 op/s 2023-05-08T06:44:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:41 smithi096 ceph-mon[124666]: pgmap v5829: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 48 KiB/s wr, 6 op/s 2023-05-08T06:44:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:41 smithi186 ceph-mon[126480]: pgmap v5829: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 48 KiB/s wr, 6 op/s 2023-05-08T06:44:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:43 smithi186 ceph-mon[126480]: pgmap v5830: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 48 KiB/s wr, 6 op/s 2023-05-08T06:44:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:43 smithi133 ceph-mon[125939]: pgmap v5830: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 48 KiB/s wr, 6 op/s 2023-05-08T06:44:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:43 smithi096 ceph-mon[124666]: pgmap v5830: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 48 KiB/s wr, 6 op/s 2023-05-08T06:44:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10822.806407 secs 2023-05-08T06:44:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10822.806407 secs 2023-05-08T06:44:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10822.806407 secs 2023-05-08T06:44:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:45 smithi186 ceph-mon[126480]: pgmap v5831: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 101 KiB/s wr, 10 op/s 2023-05-08T06:44:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:45 smithi133 ceph-mon[125939]: pgmap v5831: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 101 KiB/s wr, 10 op/s 2023-05-08T06:44:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:45 smithi096 ceph-mon[124666]: pgmap v5831: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 101 KiB/s wr, 10 op/s 2023-05-08T06:44:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:46 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:44:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:46 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:44:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:46 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:44:46.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:46 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:44:46.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:46 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:44:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:46 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:44:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:47 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:44:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:47 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:44:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:47 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:44:47.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:47 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:44:47.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:47 smithi133 ceph-mon[125939]: pgmap v5832: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 77 KiB/s wr, 7 op/s 2023-05-08T06:44:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:47 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:44:47.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:47 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:44:47.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:47 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:44:47.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:47 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:44:47.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:47 smithi096 ceph-mon[124666]: pgmap v5832: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 77 KiB/s wr, 7 op/s 2023-05-08T06:44:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:47 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:44:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:47 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:44:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:47 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:44:47.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:47 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:44:47.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:47 smithi186 ceph-mon[126480]: pgmap v5832: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 77 KiB/s wr, 7 op/s 2023-05-08T06:44:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10827.806480 secs 2023-05-08T06:44:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10827.806480 secs 2023-05-08T06:44:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10827.806480 secs 2023-05-08T06:44:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:49 smithi133 ceph-mon[125939]: pgmap v5833: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 163 KiB/s wr, 12 op/s 2023-05-08T06:44:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:49 smithi096 ceph-mon[124666]: pgmap v5833: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 163 KiB/s wr, 12 op/s 2023-05-08T06:44:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:49 smithi186 ceph-mon[126480]: pgmap v5833: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 163 KiB/s wr, 12 op/s 2023-05-08T06:44:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:51 smithi133 ceph-mon[125939]: pgmap v5834: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 139 KiB/s wr, 8 op/s 2023-05-08T06:44:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:51 smithi096 ceph-mon[124666]: pgmap v5834: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 139 KiB/s wr, 8 op/s 2023-05-08T06:44:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:51 smithi186 ceph-mon[126480]: pgmap v5834: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 139 KiB/s wr, 8 op/s 2023-05-08T06:44:53.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:53 smithi186 ceph-mon[126480]: pgmap v5835: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 139 KiB/s wr, 8 op/s 2023-05-08T06:44:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:53 smithi133 ceph-mon[125939]: pgmap v5835: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 139 KiB/s wr, 8 op/s 2023-05-08T06:44:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:53 smithi096 ceph-mon[124666]: pgmap v5835: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 139 KiB/s wr, 8 op/s 2023-05-08T06:44:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10832.806619 secs 2023-05-08T06:44:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10833.364450 secs 2023-05-08T06:44:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10832.806619 secs 2023-05-08T06:44:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10833.364450 secs 2023-05-08T06:44:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10832.806619 secs 2023-05-08T06:44:54.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10833.364450 secs 2023-05-08T06:44:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:55 smithi186 ceph-mon[126480]: pgmap v5836: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 148 KiB/s wr, 12 op/s 2023-05-08T06:44:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:55 smithi133 ceph-mon[125939]: pgmap v5836: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 148 KiB/s wr, 12 op/s 2023-05-08T06:44:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:55 smithi096 ceph-mon[124666]: pgmap v5836: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 148 KiB/s wr, 12 op/s 2023-05-08T06:44:56.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:56 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:44:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:44:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:44:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:56 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:44:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:44:56.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:44:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:56 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:44:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:44:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:44:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:57 smithi186 ceph-mon[126480]: pgmap v5837: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 96 KiB/s wr, 8 op/s 2023-05-08T06:44:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:57 smithi133 ceph-mon[125939]: pgmap v5837: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 96 KiB/s wr, 8 op/s 2023-05-08T06:44:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:57 smithi096 ceph-mon[124666]: pgmap v5837: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 96 KiB/s wr, 8 op/s 2023-05-08T06:44:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10837.806742 secs 2023-05-08T06:44:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10837.806742 secs 2023-05-08T06:44:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10837.806742 secs 2023-05-08T06:44:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10838.364570 secs 2023-05-08T06:44:59.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:44:59 smithi133 ceph-mon[125939]: pgmap v5838: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 213 KiB/s wr, 13 op/s 2023-05-08T06:45:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10838.364570 secs 2023-05-08T06:45:00.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:44:59 smithi096 ceph-mon[124666]: pgmap v5838: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 213 KiB/s wr, 13 op/s 2023-05-08T06:45:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10838.364570 secs 2023-05-08T06:45:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:44:59 smithi186 ceph-mon[126480]: pgmap v5838: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 213 KiB/s wr, 13 op/s 2023-05-08T06:45:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:01 smithi133 ceph-mon[125939]: pgmap v5839: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 127 KiB/s wr, 8 op/s 2023-05-08T06:45:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:01 smithi096 ceph-mon[124666]: pgmap v5839: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 127 KiB/s wr, 8 op/s 2023-05-08T06:45:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:01 smithi186 ceph-mon[126480]: pgmap v5839: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 127 KiB/s wr, 8 op/s 2023-05-08T06:45:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:03 smithi186 ceph-mon[126480]: pgmap v5840: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 127 KiB/s wr, 8 op/s 2023-05-08T06:45:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:03 smithi133 ceph-mon[125939]: pgmap v5840: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 127 KiB/s wr, 8 op/s 2023-05-08T06:45:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:03 smithi096 ceph-mon[124666]: pgmap v5840: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 127 KiB/s wr, 8 op/s 2023-05-08T06:45:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10842.806845 secs 2023-05-08T06:45:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10843.364697 secs 2023-05-08T06:45:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10842.806845 secs 2023-05-08T06:45:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10843.364697 secs 2023-05-08T06:45:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10842.806845 secs 2023-05-08T06:45:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10843.364697 secs 2023-05-08T06:45:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:05 smithi186 ceph-mon[126480]: pgmap v5841: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 187 KiB/s wr, 27 op/s 2023-05-08T06:45:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:05 smithi133 ceph-mon[125939]: pgmap v5841: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 187 KiB/s wr, 27 op/s 2023-05-08T06:45:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:05 smithi096 ceph-mon[124666]: pgmap v5841: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 187 KiB/s wr, 27 op/s 2023-05-08T06:45:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10844.646228 secs 2023-05-08T06:45:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10844.646228 secs 2023-05-08T06:45:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10844.646228 secs 2023-05-08T06:45:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:07 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:45:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:07 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:45:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:07 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:45:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:07 smithi186 ceph-mon[126480]: pgmap v5842: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 177 KiB/s wr, 23 op/s 2023-05-08T06:45:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:07 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:45:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:07 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:45:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:07 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:45:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:07 smithi133 ceph-mon[125939]: pgmap v5842: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 177 KiB/s wr, 23 op/s 2023-05-08T06:45:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:07 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:45:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:07 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:45:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:07 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:45:07.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:07 smithi096 ceph-mon[124666]: pgmap v5842: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 177 KiB/s wr, 23 op/s 2023-05-08T06:45:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10847.806959 secs 2023-05-08T06:45:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10847.806959 secs 2023-05-08T06:45:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10847.806959 secs 2023-05-08T06:45:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10848.364815 secs 2023-05-08T06:45:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:09 smithi133 ceph-mon[125939]: pgmap v5843: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 240 KiB/s wr, 28 op/s 2023-05-08T06:45:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10848.364815 secs 2023-05-08T06:45:10.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:09 smithi096 ceph-mon[124666]: pgmap v5843: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 240 KiB/s wr, 28 op/s 2023-05-08T06:45:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10848.364815 secs 2023-05-08T06:45:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:09 smithi186 ceph-mon[126480]: pgmap v5843: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 240 KiB/s wr, 28 op/s 2023-05-08T06:45:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10849.646312 secs 2023-05-08T06:45:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10849.646312 secs 2023-05-08T06:45:11.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10849.646312 secs 2023-05-08T06:45:11.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:11 smithi133 ceph-mon[125939]: osdmap e442: 12 total, 12 up, 12 in 2023-05-08T06:45:11.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:11 smithi133 ceph-mon[125939]: pgmap v5845: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 147 KiB/s wr, 27 op/s 2023-05-08T06:45:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:11 smithi096 ceph-mon[124666]: osdmap e442: 12 total, 12 up, 12 in 2023-05-08T06:45:12.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:11 smithi096 ceph-mon[124666]: pgmap v5845: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 147 KiB/s wr, 27 op/s 2023-05-08T06:45:12.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:11 smithi186 ceph-mon[126480]: osdmap e442: 12 total, 12 up, 12 in 2023-05-08T06:45:12.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:11 smithi186 ceph-mon[126480]: pgmap v5845: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 147 KiB/s wr, 27 op/s 2023-05-08T06:45:13.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:13 smithi186 ceph-mon[126480]: pgmap v5846: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 147 KiB/s wr, 27 op/s 2023-05-08T06:45:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:13 smithi133 ceph-mon[125939]: pgmap v5846: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 147 KiB/s wr, 27 op/s 2023-05-08T06:45:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:13 smithi096 ceph-mon[124666]: pgmap v5846: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 147 KiB/s wr, 27 op/s 2023-05-08T06:45:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10852.807064 secs 2023-05-08T06:45:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10853.364911 secs 2023-05-08T06:45:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:45:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10852.807064 secs 2023-05-08T06:45:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10853.364911 secs 2023-05-08T06:45:14.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:45:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10852.807064 secs 2023-05-08T06:45:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10853.364911 secs 2023-05-08T06:45:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:45:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:15 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:45:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:15 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:45:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:15 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:45:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:15 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:45:15.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:15 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T06:45:15.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:15 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T06:45:15.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:15 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:45:15.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:15 smithi186 ceph-mon[126480]: pgmap v5847: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 76 KiB/s wr, 8 op/s 2023-05-08T06:45:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:15 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:45:15.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:15 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:45:15.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:15 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:45:15.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:15 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:45:15.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:15 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T06:45:15.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:15 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T06:45:15.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:15 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:45:15.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:15 smithi133 ceph-mon[125939]: pgmap v5847: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 76 KiB/s wr, 8 op/s 2023-05-08T06:45:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:15 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:45:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:15 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:45:15.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:15 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:45:15.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:15 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:45:15.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:15 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T06:45:15.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:15 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T06:45:15.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:15 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:45:15.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:15 smithi096 ceph-mon[124666]: pgmap v5847: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 76 KiB/s wr, 8 op/s 2023-05-08T06:45:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10854.646408 secs 2023-05-08T06:45:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10854.646408 secs 2023-05-08T06:45:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10854.646408 secs 2023-05-08T06:45:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:17 smithi186 ceph-mon[126480]: pgmap v5848: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 76 KiB/s wr, 8 op/s 2023-05-08T06:45:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:17 smithi133 ceph-mon[125939]: pgmap v5848: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 76 KiB/s wr, 8 op/s 2023-05-08T06:45:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:17 smithi096 ceph-mon[124666]: pgmap v5848: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 76 KiB/s wr, 8 op/s 2023-05-08T06:45:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10857.807205 secs 2023-05-08T06:45:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10857.807205 secs 2023-05-08T06:45:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10857.807205 secs 2023-05-08T06:45:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10858.365037 secs 2023-05-08T06:45:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:19 smithi133 ceph-mon[125939]: pgmap v5849: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 26 KiB/s wr, 7 op/s 2023-05-08T06:45:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10858.365037 secs 2023-05-08T06:45:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:19 smithi096 ceph-mon[124666]: pgmap v5849: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 26 KiB/s wr, 7 op/s 2023-05-08T06:45:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10858.365037 secs 2023-05-08T06:45:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:19 smithi186 ceph-mon[126480]: pgmap v5849: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 26 KiB/s wr, 7 op/s 2023-05-08T06:45:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10859.646549 secs 2023-05-08T06:45:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:20 smithi133 ceph-mon[125939]: osdmap e443: 12 total, 12 up, 12 in 2023-05-08T06:45:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10859.646549 secs 2023-05-08T06:45:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:20 smithi096 ceph-mon[124666]: osdmap e443: 12 total, 12 up, 12 in 2023-05-08T06:45:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10859.646549 secs 2023-05-08T06:45:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:20 smithi186 ceph-mon[126480]: osdmap e443: 12 total, 12 up, 12 in 2023-05-08T06:45:21.994 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:21 smithi133 ceph-mon[125939]: pgmap v5851: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 25 KiB/s wr, 7 op/s 2023-05-08T06:45:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:21 smithi096 ceph-mon[124666]: pgmap v5851: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 25 KiB/s wr, 7 op/s 2023-05-08T06:45:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:21 smithi186 ceph-mon[126480]: pgmap v5851: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 25 KiB/s wr, 7 op/s 2023-05-08T06:45:23.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:23 smithi186 ceph-mon[126480]: pgmap v5852: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 25 KiB/s wr, 7 op/s 2023-05-08T06:45:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:23 smithi133 ceph-mon[125939]: pgmap v5852: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 25 KiB/s wr, 7 op/s 2023-05-08T06:45:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:23 smithi096 ceph-mon[124666]: pgmap v5852: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 25 KiB/s wr, 7 op/s 2023-05-08T06:45:24.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10862.807299 secs 2023-05-08T06:45:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10863.365142 secs 2023-05-08T06:45:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10862.807299 secs 2023-05-08T06:45:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10863.365142 secs 2023-05-08T06:45:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10862.807299 secs 2023-05-08T06:45:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10863.365142 secs 2023-05-08T06:45:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:25 smithi186 ceph-mon[126480]: pgmap v5853: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 8 op/s 2023-05-08T06:45:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:25 smithi133 ceph-mon[125939]: pgmap v5853: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 8 op/s 2023-05-08T06:45:25.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:25 smithi096 ceph-mon[124666]: pgmap v5853: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 8 op/s 2023-05-08T06:45:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10864.646675 secs 2023-05-08T06:45:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10864.646675 secs 2023-05-08T06:45:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10864.646675 secs 2023-05-08T06:45:27.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:27 smithi186 ceph-mon[126480]: pgmap v5854: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 8 op/s 2023-05-08T06:45:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:27 smithi133 ceph-mon[125939]: pgmap v5854: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 8 op/s 2023-05-08T06:45:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:27 smithi096 ceph-mon[124666]: pgmap v5854: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 8 op/s 2023-05-08T06:45:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10867.807436 secs 2023-05-08T06:45:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10867.807436 secs 2023-05-08T06:45:29.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10867.807436 secs 2023-05-08T06:45:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10868.365291 secs 2023-05-08T06:45:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:29 smithi133 ceph-mon[125939]: pgmap v5855: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 65 KiB/s wr, 8 op/s 2023-05-08T06:45:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10868.365291 secs 2023-05-08T06:45:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:29 smithi096 ceph-mon[124666]: pgmap v5855: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 65 KiB/s wr, 8 op/s 2023-05-08T06:45:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10868.365291 secs 2023-05-08T06:45:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:29 smithi186 ceph-mon[126480]: pgmap v5855: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 65 KiB/s wr, 8 op/s 2023-05-08T06:45:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10869.646820 secs 2023-05-08T06:45:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10869.646820 secs 2023-05-08T06:45:31.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10869.646820 secs 2023-05-08T06:45:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:31 smithi133 ceph-mon[125939]: pgmap v5856: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 60 KiB/s wr, 8 op/s 2023-05-08T06:45:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:31 smithi096 ceph-mon[124666]: pgmap v5856: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 60 KiB/s wr, 8 op/s 2023-05-08T06:45:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:31 smithi186 ceph-mon[126480]: pgmap v5856: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 60 KiB/s wr, 8 op/s 2023-05-08T06:45:33.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:33 smithi186 ceph-mon[126480]: pgmap v5857: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 54 KiB/s wr, 7 op/s 2023-05-08T06:45:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:33 smithi133 ceph-mon[125939]: pgmap v5857: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 54 KiB/s wr, 7 op/s 2023-05-08T06:45:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:33 smithi096 ceph-mon[124666]: pgmap v5857: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 54 KiB/s wr, 7 op/s 2023-05-08T06:45:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10872.807533 secs 2023-05-08T06:45:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10873.365462 secs 2023-05-08T06:45:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10872.807533 secs 2023-05-08T06:45:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10873.365462 secs 2023-05-08T06:45:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10872.807533 secs 2023-05-08T06:45:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10873.365462 secs 2023-05-08T06:45:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:35 smithi186 ceph-mon[126480]: pgmap v5858: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 54 KiB/s wr, 10 op/s 2023-05-08T06:45:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:35 smithi133 ceph-mon[125939]: pgmap v5858: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 54 KiB/s wr, 10 op/s 2023-05-08T06:45:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:35 smithi096 ceph-mon[124666]: pgmap v5858: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 54 KiB/s wr, 10 op/s 2023-05-08T06:45:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10874.646914 secs 2023-05-08T06:45:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10874.646914 secs 2023-05-08T06:45:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10874.646914 secs 2023-05-08T06:45:37.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:37 smithi186 ceph-mon[126480]: pgmap v5859: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 53 KiB/s wr, 6 op/s 2023-05-08T06:45:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:37 smithi133 ceph-mon[125939]: pgmap v5859: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 53 KiB/s wr, 6 op/s 2023-05-08T06:45:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:37 smithi096 ceph-mon[124666]: pgmap v5859: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 53 KiB/s wr, 6 op/s 2023-05-08T06:45:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10877.807654 secs 2023-05-08T06:45:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10877.807654 secs 2023-05-08T06:45:39.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10877.807654 secs 2023-05-08T06:45:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10878.365611 secs 2023-05-08T06:45:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:39 smithi133 ceph-mon[125939]: pgmap v5860: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 134 KiB/s wr, 10 op/s 2023-05-08T06:45:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10878.365611 secs 2023-05-08T06:45:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:39 smithi096 ceph-mon[124666]: pgmap v5860: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 134 KiB/s wr, 10 op/s 2023-05-08T06:45:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10878.365611 secs 2023-05-08T06:45:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:39 smithi186 ceph-mon[126480]: pgmap v5860: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 134 KiB/s wr, 10 op/s 2023-05-08T06:45:40.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10879.647035 secs 2023-05-08T06:45:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10879.647035 secs 2023-05-08T06:45:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10879.647035 secs 2023-05-08T06:45:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:41 smithi133 ceph-mon[125939]: pgmap v5861: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 80 KiB/s wr, 7 op/s 2023-05-08T06:45:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:41 smithi096 ceph-mon[124666]: pgmap v5861: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 80 KiB/s wr, 7 op/s 2023-05-08T06:45:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:41 smithi186 ceph-mon[126480]: pgmap v5861: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 80 KiB/s wr, 7 op/s 2023-05-08T06:45:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:43 smithi186 ceph-mon[126480]: pgmap v5862: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 80 KiB/s wr, 7 op/s 2023-05-08T06:45:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:43 smithi133 ceph-mon[125939]: pgmap v5862: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 80 KiB/s wr, 7 op/s 2023-05-08T06:45:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:43 smithi096 ceph-mon[124666]: pgmap v5862: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 80 KiB/s wr, 7 op/s 2023-05-08T06:45:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10882.807761 secs 2023-05-08T06:45:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10882.807761 secs 2023-05-08T06:45:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10882.807761 secs 2023-05-08T06:45:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:45 smithi186 ceph-mon[126480]: pgmap v5863: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 149 KiB/s wr, 12 op/s 2023-05-08T06:45:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:45 smithi133 ceph-mon[125939]: pgmap v5863: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 149 KiB/s wr, 12 op/s 2023-05-08T06:45:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:45 smithi096 ceph-mon[124666]: pgmap v5863: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 149 KiB/s wr, 12 op/s 2023-05-08T06:45:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:46 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:45:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:46 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:45:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:46 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:45:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:46 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:45:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:46 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:45:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:46 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:45:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:47 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:45:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:47 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:45:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:47 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:45:47.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:47 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:45:47.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:47 smithi133 ceph-mon[125939]: pgmap v5864: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 149 KiB/s wr, 9 op/s 2023-05-08T06:45:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:47 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:45:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:47 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:45:47.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:47 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:45:47.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:47 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:45:47.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:47 smithi096 ceph-mon[124666]: pgmap v5864: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 149 KiB/s wr, 9 op/s 2023-05-08T06:45:47.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:47 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:45:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:47 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:45:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:47 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:45:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:47 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:45:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:47 smithi186 ceph-mon[126480]: pgmap v5864: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 149 KiB/s wr, 9 op/s 2023-05-08T06:45:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10887.807886 secs 2023-05-08T06:45:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10887.807886 secs 2023-05-08T06:45:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10887.807886 secs 2023-05-08T06:45:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10888.365896 secs 2023-05-08T06:45:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:49 smithi133 ceph-mon[125939]: pgmap v5865: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 250 KiB/s wr, 15 op/s 2023-05-08T06:45:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10888.365896 secs 2023-05-08T06:45:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:49 smithi096 ceph-mon[124666]: pgmap v5865: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 250 KiB/s wr, 15 op/s 2023-05-08T06:45:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10888.365896 secs 2023-05-08T06:45:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:49 smithi186 ceph-mon[126480]: pgmap v5865: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 250 KiB/s wr, 15 op/s 2023-05-08T06:45:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:45:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:45:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:51 smithi133 ceph-mon[125939]: pgmap v5866: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 170 KiB/s wr, 11 op/s 2023-05-08T06:45:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:45:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:45:52.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:51 smithi096 ceph-mon[124666]: pgmap v5866: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 170 KiB/s wr, 11 op/s 2023-05-08T06:45:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:45:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:45:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:51 smithi186 ceph-mon[126480]: pgmap v5866: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 170 KiB/s wr, 11 op/s 2023-05-08T06:45:53.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:53 smithi186 ceph-mon[126480]: pgmap v5867: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 170 KiB/s wr, 11 op/s 2023-05-08T06:45:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:53 smithi133 ceph-mon[125939]: pgmap v5867: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 170 KiB/s wr, 11 op/s 2023-05-08T06:45:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:53 smithi096 ceph-mon[124666]: pgmap v5867: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 170 KiB/s wr, 11 op/s 2023-05-08T06:45:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10892.808004 secs 2023-05-08T06:45:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10892.808004 secs 2023-05-08T06:45:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10892.808004 secs 2023-05-08T06:45:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:55 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:45:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:55 smithi186 ceph-mon[126480]: pgmap v5868: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 290 KiB/s rd, 180 KiB/s wr, 15 op/s 2023-05-08T06:45:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:55 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:45:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:55 smithi133 ceph-mon[125939]: pgmap v5868: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 290 KiB/s rd, 180 KiB/s wr, 15 op/s 2023-05-08T06:45:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:55 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:45:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:55 smithi096 ceph-mon[124666]: pgmap v5868: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 290 KiB/s rd, 180 KiB/s wr, 15 op/s 2023-05-08T06:45:56.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:56 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:45:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:45:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:45:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:56 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:45:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:45:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:45:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:56 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:45:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:45:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:45:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:57 smithi186 ceph-mon[126480]: pgmap v5869: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 112 KiB/s wr, 10 op/s 2023-05-08T06:45:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:57 smithi133 ceph-mon[125939]: pgmap v5869: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 112 KiB/s wr, 10 op/s 2023-05-08T06:45:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:57 smithi096 ceph-mon[124666]: pgmap v5869: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 112 KiB/s wr, 10 op/s 2023-05-08T06:45:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10897.808125 secs 2023-05-08T06:45:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10897.808125 secs 2023-05-08T06:45:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10897.808125 secs 2023-05-08T06:45:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10898.366167 secs 2023-05-08T06:45:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:45:59 smithi133 ceph-mon[125939]: pgmap v5870: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 201 KiB/s wr, 14 op/s 2023-05-08T06:46:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10898.366167 secs 2023-05-08T06:46:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:45:59 smithi096 ceph-mon[124666]: pgmap v5870: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 201 KiB/s wr, 14 op/s 2023-05-08T06:46:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10898.366167 secs 2023-05-08T06:46:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:45:59 smithi186 ceph-mon[126480]: pgmap v5870: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 201 KiB/s wr, 14 op/s 2023-05-08T06:46:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10899.648371 secs 2023-05-08T06:46:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10899.648371 secs 2023-05-08T06:46:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10899.648371 secs 2023-05-08T06:46:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:01 smithi133 ceph-mon[125939]: pgmap v5871: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 100 KiB/s wr, 9 op/s 2023-05-08T06:46:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:01 smithi096 ceph-mon[124666]: pgmap v5871: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 100 KiB/s wr, 9 op/s 2023-05-08T06:46:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:01 smithi186 ceph-mon[126480]: pgmap v5871: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 100 KiB/s wr, 9 op/s 2023-05-08T06:46:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:02 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:46:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:46:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:46:02.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:46:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:02 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:46:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:46:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:46:03.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:46:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:02 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:46:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:46:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:46:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:46:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10902.808249 secs 2023-05-08T06:46:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:03 smithi133 ceph-mon[125939]: pgmap v5872: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 100 KiB/s wr, 9 op/s 2023-05-08T06:46:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10902.808249 secs 2023-05-08T06:46:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:03 smithi096 ceph-mon[124666]: pgmap v5872: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 100 KiB/s wr, 9 op/s 2023-05-08T06:46:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10902.808249 secs 2023-05-08T06:46:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:03 smithi186 ceph-mon[126480]: pgmap v5872: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 100 KiB/s wr, 9 op/s 2023-05-08T06:46:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10903.366295 secs 2023-05-08T06:46:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10903.366295 secs 2023-05-08T06:46:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10903.366295 secs 2023-05-08T06:46:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10904.648508 secs 2023-05-08T06:46:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:05 smithi096 ceph-mon[124666]: pgmap v5873: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 166 KiB/s wr, 26 op/s 2023-05-08T06:46:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10904.648508 secs 2023-05-08T06:46:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:05 smithi186 ceph-mon[126480]: pgmap v5873: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 166 KiB/s wr, 26 op/s 2023-05-08T06:46:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10904.648508 secs 2023-05-08T06:46:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:05 smithi133 ceph-mon[125939]: pgmap v5873: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 166 KiB/s wr, 26 op/s 2023-05-08T06:46:07.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:07 smithi186 ceph-mon[126480]: pgmap v5874: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 156 KiB/s wr, 22 op/s 2023-05-08T06:46:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:07 smithi133 ceph-mon[125939]: pgmap v5874: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 156 KiB/s wr, 22 op/s 2023-05-08T06:46:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:07 smithi096 ceph-mon[124666]: pgmap v5874: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 156 KiB/s wr, 22 op/s 2023-05-08T06:46:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10907.808362 secs 2023-05-08T06:46:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10907.808362 secs 2023-05-08T06:46:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10907.808362 secs 2023-05-08T06:46:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10908.366477 secs 2023-05-08T06:46:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:09 smithi133 ceph-mon[125939]: pgmap v5875: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 183 KiB/s wr, 26 op/s 2023-05-08T06:46:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10908.366477 secs 2023-05-08T06:46:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:09 smithi096 ceph-mon[124666]: pgmap v5875: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 183 KiB/s wr, 26 op/s 2023-05-08T06:46:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10908.366477 secs 2023-05-08T06:46:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:09 smithi186 ceph-mon[126480]: pgmap v5875: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 183 KiB/s wr, 26 op/s 2023-05-08T06:46:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10909.648647 secs 2023-05-08T06:46:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10909.648647 secs 2023-05-08T06:46:11.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10909.648647 secs 2023-05-08T06:46:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:11 smithi133 ceph-mon[125939]: osdmap e444: 12 total, 12 up, 12 in 2023-05-08T06:46:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:11 smithi133 ceph-mon[125939]: pgmap v5877: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 112 KiB/s wr, 25 op/s 2023-05-08T06:46:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:11 smithi096 ceph-mon[124666]: osdmap e444: 12 total, 12 up, 12 in 2023-05-08T06:46:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:11 smithi096 ceph-mon[124666]: pgmap v5877: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 112 KiB/s wr, 25 op/s 2023-05-08T06:46:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:11 smithi186 ceph-mon[126480]: osdmap e444: 12 total, 12 up, 12 in 2023-05-08T06:46:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:11 smithi186 ceph-mon[126480]: pgmap v5877: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 112 KiB/s wr, 25 op/s 2023-05-08T06:46:13.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:13 smithi186 ceph-mon[126480]: pgmap v5878: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 112 KiB/s wr, 25 op/s 2023-05-08T06:46:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:13 smithi133 ceph-mon[125939]: pgmap v5878: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 112 KiB/s wr, 25 op/s 2023-05-08T06:46:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:13 smithi096 ceph-mon[124666]: pgmap v5878: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 112 KiB/s wr, 25 op/s 2023-05-08T06:46:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10912.808483 secs 2023-05-08T06:46:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10913.366569 secs 2023-05-08T06:46:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10912.808483 secs 2023-05-08T06:46:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10913.366569 secs 2023-05-08T06:46:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10912.808483 secs 2023-05-08T06:46:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10913.366569 secs 2023-05-08T06:46:15.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:15 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:46:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:15 smithi186 ceph-mon[126480]: pgmap v5879: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 37 KiB/s wr, 8 op/s 2023-05-08T06:46:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:15 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:46:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:15 smithi133 ceph-mon[125939]: pgmap v5879: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 37 KiB/s wr, 8 op/s 2023-05-08T06:46:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:15 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:46:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:15 smithi096 ceph-mon[124666]: pgmap v5879: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 37 KiB/s wr, 8 op/s 2023-05-08T06:46:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10914.648807 secs 2023-05-08T06:46:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10914.648807 secs 2023-05-08T06:46:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10914.648807 secs 2023-05-08T06:46:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:17 smithi186 ceph-mon[126480]: pgmap v5880: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 37 KiB/s wr, 8 op/s 2023-05-08T06:46:17.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:17 smithi133 ceph-mon[125939]: pgmap v5880: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 37 KiB/s wr, 8 op/s 2023-05-08T06:46:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:17 smithi096 ceph-mon[124666]: pgmap v5880: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 37 KiB/s wr, 8 op/s 2023-05-08T06:46:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:46:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:46:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:46:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:46:18.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:46:18.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:46:18.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10917.808552 secs 2023-05-08T06:46:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:46:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:46:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:46:19.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:46:19.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:46:19.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:46:19.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10917.808552 secs 2023-05-08T06:46:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:46:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:46:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:46:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:46:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:46:19.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:46:19.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10917.808552 secs 2023-05-08T06:46:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10918.366645 secs 2023-05-08T06:46:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:19 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:46:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:19 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:46:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:19 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:46:20.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:19 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:46:20.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:19 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:46:20.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:19 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:46:20.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:19 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:46:20.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:19 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:46:20.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:19 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:46:20.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:19 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:46:20.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:19 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:46:20.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:19 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T06:46:20.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:19 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:46:20.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:19 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T06:46:20.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:19 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi096 to 196.2M 2023-05-08T06:46:20.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:19 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi096 to 205766758: error parsing value: Value '205766758' is below minimum 939524096 2023-05-08T06:46:20.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:19 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:46:20.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:19 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:46:20.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:19 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:46:20.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:19 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:46:20.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:19 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:46:20.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:19 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:46:20.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:19 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T06:46:20.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:19 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T06:46:20.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:19 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:46:20.123 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:19 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:46:20.123 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:19 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:46:20.123 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:19 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:46:20.123 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:19 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T06:46:20.123 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:19 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T06:46:20.123 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:19 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:46:20.123 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:19 smithi186 ceph-mon[126480]: pgmap v5881: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 32 KiB/s wr, 8 op/s 2023-05-08T06:46:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10918.366645 secs 2023-05-08T06:46:20.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:19 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:46:20.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:19 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:46:20.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:19 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:46:20.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:19 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:46:20.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:19 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:46:20.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:19 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:46:20.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:19 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:46:20.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:19 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:46:20.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:19 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:46:20.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:19 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:46:20.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:19 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:46:20.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:19 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T06:46:20.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:19 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:46:20.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:19 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T06:46:20.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:19 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi096 to 196.2M 2023-05-08T06:46:20.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:19 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi096 to 205766758: error parsing value: Value '205766758' is below minimum 939524096 2023-05-08T06:46:20.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:19 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:46:20.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:19 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:46:20.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:19 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:46:20.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:19 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:46:20.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:19 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:46:20.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:19 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:46:20.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:19 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T06:46:20.244 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:19 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T06:46:20.244 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:19 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:46:20.244 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:19 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:46:20.244 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:19 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:46:20.244 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:19 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:46:20.244 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:19 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T06:46:20.244 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:19 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T06:46:20.245 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:19 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:46:20.245 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:19 smithi133 ceph-mon[125939]: pgmap v5881: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 32 KiB/s wr, 8 op/s 2023-05-08T06:46:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10918.366645 secs 2023-05-08T06:46:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:19 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:46:20.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:19 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:46:20.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:19 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:46:20.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:19 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:46:20.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:19 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:46:20.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:19 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:46:20.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:19 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:46:20.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:19 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:46:20.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:19 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:46:20.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:19 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:46:20.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:19 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:46:20.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:19 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T06:46:20.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:19 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:46:20.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:19 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T06:46:20.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:19 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi096 to 196.2M 2023-05-08T06:46:20.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:19 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi096 to 205766758: error parsing value: Value '205766758' is below minimum 939524096 2023-05-08T06:46:20.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:19 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:46:20.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:19 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:46:20.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:19 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:46:20.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:19 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:46:20.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:19 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:46:20.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:19 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:46:20.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:19 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T06:46:20.259 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:19 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T06:46:20.259 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:19 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:46:20.259 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:19 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:46:20.259 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:19 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:46:20.259 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:19 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:46:20.259 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:19 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T06:46:20.259 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:19 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T06:46:20.259 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:19 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:46:20.260 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:19 smithi096 ceph-mon[124666]: pgmap v5881: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 32 KiB/s wr, 8 op/s 2023-05-08T06:46:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10919.648880 secs 2023-05-08T06:46:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:20 smithi186 ceph-mon[126480]: osdmap e445: 12 total, 12 up, 12 in 2023-05-08T06:46:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10919.648880 secs 2023-05-08T06:46:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:20 smithi133 ceph-mon[125939]: osdmap e445: 12 total, 12 up, 12 in 2023-05-08T06:46:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10919.648880 secs 2023-05-08T06:46:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:20 smithi096 ceph-mon[124666]: osdmap e445: 12 total, 12 up, 12 in 2023-05-08T06:46:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:21 smithi186 ceph-mon[126480]: pgmap v5883: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 8 op/s 2023-05-08T06:46:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:21 smithi133 ceph-mon[125939]: pgmap v5883: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 8 op/s 2023-05-08T06:46:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:21 smithi096 ceph-mon[124666]: pgmap v5883: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 8 op/s 2023-05-08T06:46:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:23 smithi186 ceph-mon[126480]: pgmap v5884: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 8 op/s 2023-05-08T06:46:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:23 smithi133 ceph-mon[125939]: pgmap v5884: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 8 op/s 2023-05-08T06:46:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:23 smithi096 ceph-mon[124666]: pgmap v5884: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 8 op/s 2023-05-08T06:46:24.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10922.808690 secs 2023-05-08T06:46:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10923.366723 secs 2023-05-08T06:46:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10922.808690 secs 2023-05-08T06:46:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10923.366723 secs 2023-05-08T06:46:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10922.808690 secs 2023-05-08T06:46:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10923.366723 secs 2023-05-08T06:46:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:25 smithi133 ceph-mon[125939]: pgmap v5885: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 56 KiB/s wr, 8 op/s 2023-05-08T06:46:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:25 smithi096 ceph-mon[124666]: pgmap v5885: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 56 KiB/s wr, 8 op/s 2023-05-08T06:46:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:25 smithi186 ceph-mon[126480]: pgmap v5885: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 56 KiB/s wr, 8 op/s 2023-05-08T06:46:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10924.648957 secs 2023-05-08T06:46:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10924.648957 secs 2023-05-08T06:46:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10924.648957 secs 2023-05-08T06:46:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:27 smithi133 ceph-mon[125939]: pgmap v5886: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 56 KiB/s wr, 8 op/s 2023-05-08T06:46:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:27 smithi096 ceph-mon[124666]: pgmap v5886: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 56 KiB/s wr, 8 op/s 2023-05-08T06:46:27.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:27 smithi186 ceph-mon[126480]: pgmap v5886: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 56 KiB/s wr, 8 op/s 2023-05-08T06:46:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10927.808763 secs 2023-05-08T06:46:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10927.808763 secs 2023-05-08T06:46:29.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10927.808763 secs 2023-05-08T06:46:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10928.366832 secs 2023-05-08T06:46:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:29 smithi133 ceph-mon[125939]: pgmap v5887: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 8 op/s 2023-05-08T06:46:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10928.366832 secs 2023-05-08T06:46:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:29 smithi096 ceph-mon[124666]: pgmap v5887: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 8 op/s 2023-05-08T06:46:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10928.366832 secs 2023-05-08T06:46:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:29 smithi186 ceph-mon[126480]: pgmap v5887: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 8 op/s 2023-05-08T06:46:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10929.649039 secs 2023-05-08T06:46:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10929.649039 secs 2023-05-08T06:46:31.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10929.649039 secs 2023-05-08T06:46:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:31 smithi133 ceph-mon[125939]: pgmap v5888: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 7 op/s 2023-05-08T06:46:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:31 smithi096 ceph-mon[124666]: pgmap v5888: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 7 op/s 2023-05-08T06:46:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:31 smithi186 ceph-mon[126480]: pgmap v5888: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 7 op/s 2023-05-08T06:46:33.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:33 smithi186 ceph-mon[126480]: pgmap v5889: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 6 op/s 2023-05-08T06:46:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:33 smithi133 ceph-mon[125939]: pgmap v5889: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 6 op/s 2023-05-08T06:46:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:33 smithi096 ceph-mon[124666]: pgmap v5889: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 6 op/s 2023-05-08T06:46:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10932.808876 secs 2023-05-08T06:46:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10933.366940 secs 2023-05-08T06:46:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10932.808876 secs 2023-05-08T06:46:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10933.366940 secs 2023-05-08T06:46:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10932.808876 secs 2023-05-08T06:46:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10933.366940 secs 2023-05-08T06:46:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:35 smithi133 ceph-mon[125939]: pgmap v5890: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 50 KiB/s wr, 9 op/s 2023-05-08T06:46:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:35 smithi096 ceph-mon[124666]: pgmap v5890: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 50 KiB/s wr, 9 op/s 2023-05-08T06:46:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:35 smithi186 ceph-mon[126480]: pgmap v5890: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 50 KiB/s wr, 9 op/s 2023-05-08T06:46:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10934.649109 secs 2023-05-08T06:46:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10934.649109 secs 2023-05-08T06:46:36.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10934.649109 secs 2023-05-08T06:46:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:37 smithi133 ceph-mon[125939]: pgmap v5891: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 6 op/s 2023-05-08T06:46:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:37 smithi096 ceph-mon[124666]: pgmap v5891: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 6 op/s 2023-05-08T06:46:37.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:37 smithi186 ceph-mon[126480]: pgmap v5891: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 6 op/s 2023-05-08T06:46:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10937.808961 secs 2023-05-08T06:46:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10937.808961 secs 2023-05-08T06:46:39.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10937.808961 secs 2023-05-08T06:46:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10938.367060 secs 2023-05-08T06:46:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:39 smithi133 ceph-mon[125939]: pgmap v5892: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 31 KiB/s wr, 9 op/s 2023-05-08T06:46:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10938.367060 secs 2023-05-08T06:46:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:39 smithi096 ceph-mon[124666]: pgmap v5892: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 31 KiB/s wr, 9 op/s 2023-05-08T06:46:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10938.367060 secs 2023-05-08T06:46:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:39 smithi186 ceph-mon[126480]: pgmap v5892: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 31 KiB/s wr, 9 op/s 2023-05-08T06:46:40.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10939.649231 secs 2023-05-08T06:46:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10939.649231 secs 2023-05-08T06:46:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10939.649231 secs 2023-05-08T06:46:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:41 smithi133 ceph-mon[125939]: pgmap v5893: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 6 op/s 2023-05-08T06:46:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:41 smithi096 ceph-mon[124666]: pgmap v5893: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 6 op/s 2023-05-08T06:46:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:41 smithi186 ceph-mon[126480]: pgmap v5893: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 6 op/s 2023-05-08T06:46:43.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:43 smithi186 ceph-mon[126480]: pgmap v5894: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 6 op/s 2023-05-08T06:46:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:43 smithi133 ceph-mon[125939]: pgmap v5894: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 6 op/s 2023-05-08T06:46:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:43 smithi096 ceph-mon[124666]: pgmap v5894: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 6 op/s 2023-05-08T06:46:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10942.809085 secs 2023-05-08T06:46:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10942.809085 secs 2023-05-08T06:46:44.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10942.809085 secs 2023-05-08T06:46:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:45 smithi133 ceph-mon[125939]: pgmap v5895: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 108 KiB/s wr, 10 op/s 2023-05-08T06:46:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:45 smithi096 ceph-mon[124666]: pgmap v5895: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 108 KiB/s wr, 10 op/s 2023-05-08T06:46:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:45 smithi186 ceph-mon[126480]: pgmap v5895: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 108 KiB/s wr, 10 op/s 2023-05-08T06:46:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10944.649348 secs 2023-05-08T06:46:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10944.649348 secs 2023-05-08T06:46:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10944.649348 secs 2023-05-08T06:46:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:46:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:47 smithi133 ceph-mon[125939]: pgmap v5896: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 84 KiB/s wr, 8 op/s 2023-05-08T06:46:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:46:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:47 smithi096 ceph-mon[124666]: pgmap v5896: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 84 KiB/s wr, 8 op/s 2023-05-08T06:46:47.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:46:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:47 smithi186 ceph-mon[126480]: pgmap v5896: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 84 KiB/s wr, 8 op/s 2023-05-08T06:46:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:48 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:46:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:46:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:46:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:48 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:46:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:46:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:46:48.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:48 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:46:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:46:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:46:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10947.809207 secs 2023-05-08T06:46:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:49 smithi133 ceph-mon[125939]: pgmap v5897: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 155 KiB/s wr, 13 op/s 2023-05-08T06:46:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10947.809207 secs 2023-05-08T06:46:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:49 smithi096 ceph-mon[124666]: pgmap v5897: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 155 KiB/s wr, 13 op/s 2023-05-08T06:46:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10947.809207 secs 2023-05-08T06:46:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:49 smithi186 ceph-mon[126480]: pgmap v5897: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 155 KiB/s wr, 13 op/s 2023-05-08T06:46:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:50 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:46:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:50 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:46:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:50 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:46:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:46:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:46:51.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:51 smithi133 ceph-mon[125939]: pgmap v5898: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 149 KiB/s wr, 10 op/s 2023-05-08T06:46:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:46:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:46:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:51 smithi096 ceph-mon[124666]: pgmap v5898: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 149 KiB/s wr, 10 op/s 2023-05-08T06:46:51.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:46:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:46:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:51 smithi186 ceph-mon[126480]: pgmap v5898: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 149 KiB/s wr, 10 op/s 2023-05-08T06:46:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:53 smithi133 ceph-mon[125939]: pgmap v5899: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 149 KiB/s wr, 10 op/s 2023-05-08T06:46:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:53 smithi096 ceph-mon[124666]: pgmap v5899: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 149 KiB/s wr, 10 op/s 2023-05-08T06:46:53.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:53 smithi186 ceph-mon[126480]: pgmap v5899: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 149 KiB/s wr, 10 op/s 2023-05-08T06:46:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10952.809328 secs 2023-05-08T06:46:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10953.367445 secs 2023-05-08T06:46:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10952.809328 secs 2023-05-08T06:46:54.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10953.367445 secs 2023-05-08T06:46:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10952.809328 secs 2023-05-08T06:46:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10953.367445 secs 2023-05-08T06:46:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:55 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:46:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:55 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:46:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:55 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:46:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:55 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:46:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:55 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:46:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:55 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:46:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:55 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:46:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:55 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:46:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:55 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:46:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:56 smithi096 ceph-mon[124666]: pgmap v5900: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 181 KiB/s wr, 15 op/s 2023-05-08T06:46:56.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:56 smithi186 ceph-mon[126480]: pgmap v5900: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 181 KiB/s wr, 15 op/s 2023-05-08T06:46:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:56 smithi133 ceph-mon[125939]: pgmap v5900: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 181 KiB/s wr, 15 op/s 2023-05-08T06:46:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:58 smithi096 ceph-mon[124666]: pgmap v5901: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 103 KiB/s wr, 10 op/s 2023-05-08T06:46:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:58 smithi186 ceph-mon[126480]: pgmap v5901: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 103 KiB/s wr, 10 op/s 2023-05-08T06:46:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:58 smithi133 ceph-mon[125939]: pgmap v5901: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 103 KiB/s wr, 10 op/s 2023-05-08T06:46:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:46:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10957.809414 secs 2023-05-08T06:46:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:46:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10957.809414 secs 2023-05-08T06:46:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:46:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10957.809414 secs 2023-05-08T06:47:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:00 smithi186 ceph-mon[126480]: pgmap v5902: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 186 KiB/s wr, 15 op/s 2023-05-08T06:47:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10959.649691 secs 2023-05-08T06:47:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:00 smithi133 ceph-mon[125939]: pgmap v5902: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 186 KiB/s wr, 15 op/s 2023-05-08T06:47:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10959.649691 secs 2023-05-08T06:47:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:00 smithi096 ceph-mon[124666]: pgmap v5902: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 186 KiB/s wr, 15 op/s 2023-05-08T06:47:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10959.649691 secs 2023-05-08T06:47:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:02 smithi186 ceph-mon[126480]: pgmap v5903: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 115 KiB/s wr, 9 op/s 2023-05-08T06:47:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:02 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:47:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:02 smithi133 ceph-mon[125939]: pgmap v5903: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 115 KiB/s wr, 9 op/s 2023-05-08T06:47:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:02 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:47:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:02 smithi096 ceph-mon[124666]: pgmap v5903: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 115 KiB/s wr, 9 op/s 2023-05-08T06:47:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:02 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:47:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:47:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:47:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:03 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:47:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:47:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:47:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:03 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:47:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:47:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:47:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:03 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:47:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10962.809505 secs 2023-05-08T06:47:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:04 smithi186 ceph-mon[126480]: pgmap v5904: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 115 KiB/s wr, 9 op/s 2023-05-08T06:47:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10963.367702 secs 2023-05-08T06:47:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10962.809505 secs 2023-05-08T06:47:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:04 smithi133 ceph-mon[125939]: pgmap v5904: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 115 KiB/s wr, 9 op/s 2023-05-08T06:47:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10963.367702 secs 2023-05-08T06:47:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10962.809505 secs 2023-05-08T06:47:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:04 smithi096 ceph-mon[124666]: pgmap v5904: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 115 KiB/s wr, 9 op/s 2023-05-08T06:47:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10963.367702 secs 2023-05-08T06:47:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10964.649796 secs 2023-05-08T06:47:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10964.649796 secs 2023-05-08T06:47:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10964.649796 secs 2023-05-08T06:47:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:06 smithi186 ceph-mon[126480]: pgmap v5905: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 182 KiB/s wr, 27 op/s 2023-05-08T06:47:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:06 smithi133 ceph-mon[125939]: pgmap v5905: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 182 KiB/s wr, 27 op/s 2023-05-08T06:47:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:06 smithi096 ceph-mon[124666]: pgmap v5905: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 182 KiB/s wr, 27 op/s 2023-05-08T06:47:07.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:07 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:47:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:07 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:47:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:07 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:47:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:07 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:47:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:07 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:47:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:07 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:47:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:07 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:47:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:07 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:47:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:07 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:47:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:08 smithi186 ceph-mon[126480]: pgmap v5906: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 150 KiB/s wr, 23 op/s 2023-05-08T06:47:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:08 smithi133 ceph-mon[125939]: pgmap v5906: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 150 KiB/s wr, 23 op/s 2023-05-08T06:47:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:08 smithi096 ceph-mon[124666]: pgmap v5906: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 150 KiB/s wr, 23 op/s 2023-05-08T06:47:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10967.809605 secs 2023-05-08T06:47:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10968.367830 secs 2023-05-08T06:47:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10967.809605 secs 2023-05-08T06:47:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10968.367830 secs 2023-05-08T06:47:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10967.809605 secs 2023-05-08T06:47:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10968.367830 secs 2023-05-08T06:47:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:10 smithi186 ceph-mon[126480]: pgmap v5907: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 171 KiB/s wr, 26 op/s 2023-05-08T06:47:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10969.649871 secs 2023-05-08T06:47:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:10 smithi133 ceph-mon[125939]: pgmap v5907: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 171 KiB/s wr, 26 op/s 2023-05-08T06:47:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10969.649871 secs 2023-05-08T06:47:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:10 smithi096 ceph-mon[124666]: pgmap v5907: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 171 KiB/s wr, 26 op/s 2023-05-08T06:47:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10969.649871 secs 2023-05-08T06:47:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:11 smithi186 ceph-mon[126480]: osdmap e446: 12 total, 12 up, 12 in 2023-05-08T06:47:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:11 smithi133 ceph-mon[125939]: osdmap e446: 12 total, 12 up, 12 in 2023-05-08T06:47:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:11 smithi096 ceph-mon[124666]: osdmap e446: 12 total, 12 up, 12 in 2023-05-08T06:47:12.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:12 smithi186 ceph-mon[126480]: pgmap v5909: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 106 KiB/s wr, 26 op/s 2023-05-08T06:47:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:12 smithi133 ceph-mon[125939]: pgmap v5909: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 106 KiB/s wr, 26 op/s 2023-05-08T06:47:13.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:12 smithi096 ceph-mon[124666]: pgmap v5909: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 106 KiB/s wr, 26 op/s 2023-05-08T06:47:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10972.809703 secs 2023-05-08T06:47:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:14 smithi186 ceph-mon[126480]: pgmap v5910: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 106 KiB/s wr, 26 op/s 2023-05-08T06:47:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10973.367973 secs 2023-05-08T06:47:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10972.809703 secs 2023-05-08T06:47:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:14 smithi133 ceph-mon[125939]: pgmap v5910: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 106 KiB/s wr, 26 op/s 2023-05-08T06:47:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10973.367973 secs 2023-05-08T06:47:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10972.809703 secs 2023-05-08T06:47:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:14 smithi096 ceph-mon[124666]: pgmap v5910: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 106 KiB/s wr, 26 op/s 2023-05-08T06:47:15.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10973.367973 secs 2023-05-08T06:47:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10974.650006 secs 2023-05-08T06:47:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10974.650006 secs 2023-05-08T06:47:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10974.650006 secs 2023-05-08T06:47:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:16 smithi186 ceph-mon[126480]: pgmap v5911: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 8 op/s 2023-05-08T06:47:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:16 smithi133 ceph-mon[125939]: pgmap v5911: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 8 op/s 2023-05-08T06:47:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:16 smithi096 ceph-mon[124666]: pgmap v5911: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 8 op/s 2023-05-08T06:47:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:18 smithi186 ceph-mon[126480]: pgmap v5912: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 8 op/s 2023-05-08T06:47:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:18 smithi133 ceph-mon[125939]: pgmap v5912: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 8 op/s 2023-05-08T06:47:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:18 smithi096 ceph-mon[124666]: pgmap v5912: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 8 op/s 2023-05-08T06:47:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10977.809840 secs 2023-05-08T06:47:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10978.368130 secs 2023-05-08T06:47:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:19 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:47:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10977.809840 secs 2023-05-08T06:47:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10978.368130 secs 2023-05-08T06:47:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:19 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:47:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10977.809840 secs 2023-05-08T06:47:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10978.368130 secs 2023-05-08T06:47:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:19 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:47:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:20 smithi186 ceph-mon[126480]: pgmap v5913: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 5.9 KiB/s wr, 8 op/s 2023-05-08T06:47:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:20 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:47:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:20 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:47:20.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:20 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:47:20.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:20 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:47:20.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:20 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T06:47:20.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:20 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T06:47:20.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:20 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:47:20.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10979.650153 secs 2023-05-08T06:47:20.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:20 smithi186 ceph-mon[126480]: osdmap e447: 12 total, 12 up, 12 in 2023-05-08T06:47:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:20 smithi133 ceph-mon[125939]: pgmap v5913: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 5.9 KiB/s wr, 8 op/s 2023-05-08T06:47:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:20 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:47:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:20 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:47:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:20 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:47:20.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:20 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:47:20.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:20 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T06:47:20.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:20 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T06:47:20.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:20 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:47:20.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10979.650153 secs 2023-05-08T06:47:20.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:20 smithi133 ceph-mon[125939]: osdmap e447: 12 total, 12 up, 12 in 2023-05-08T06:47:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:20 smithi096 ceph-mon[124666]: pgmap v5913: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 5.9 KiB/s wr, 8 op/s 2023-05-08T06:47:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:20 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:47:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:20 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:47:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:20 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:47:21.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:20 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:47:21.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:20 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T06:47:21.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:20 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T06:47:21.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:20 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:47:21.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10979.650153 secs 2023-05-08T06:47:21.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:20 smithi096 ceph-mon[124666]: osdmap e447: 12 total, 12 up, 12 in 2023-05-08T06:47:22.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:22 smithi186 ceph-mon[126480]: pgmap v5915: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 5.8 KiB/s wr, 8 op/s 2023-05-08T06:47:22.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:22 smithi133 ceph-mon[125939]: pgmap v5915: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 5.8 KiB/s wr, 8 op/s 2023-05-08T06:47:23.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:22 smithi096 ceph-mon[124666]: pgmap v5915: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 5.8 KiB/s wr, 8 op/s 2023-05-08T06:47:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10982.809971 secs 2023-05-08T06:47:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:24 smithi186 ceph-mon[126480]: pgmap v5916: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 5.8 KiB/s wr, 8 op/s 2023-05-08T06:47:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10983.368294 secs 2023-05-08T06:47:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10982.809971 secs 2023-05-08T06:47:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:24 smithi133 ceph-mon[125939]: pgmap v5916: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 5.8 KiB/s wr, 8 op/s 2023-05-08T06:47:24.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10983.368294 secs 2023-05-08T06:47:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10982.809971 secs 2023-05-08T06:47:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:24 smithi096 ceph-mon[124666]: pgmap v5916: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 5.8 KiB/s wr, 8 op/s 2023-05-08T06:47:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10983.368294 secs 2023-05-08T06:47:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10984.650304 secs 2023-05-08T06:47:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10984.650304 secs 2023-05-08T06:47:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10984.650304 secs 2023-05-08T06:47:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:26 smithi186 ceph-mon[126480]: pgmap v5917: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 31 KiB/s wr, 7 op/s 2023-05-08T06:47:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:26 smithi133 ceph-mon[125939]: pgmap v5917: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 31 KiB/s wr, 7 op/s 2023-05-08T06:47:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:26 smithi096 ceph-mon[124666]: pgmap v5917: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 31 KiB/s wr, 7 op/s 2023-05-08T06:47:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:28 smithi186 ceph-mon[126480]: pgmap v5918: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 31 KiB/s wr, 7 op/s 2023-05-08T06:47:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:28 smithi133 ceph-mon[125939]: pgmap v5918: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 31 KiB/s wr, 7 op/s 2023-05-08T06:47:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:28 smithi096 ceph-mon[124666]: pgmap v5918: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 31 KiB/s wr, 7 op/s 2023-05-08T06:47:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10987.810099 secs 2023-05-08T06:47:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10988.368475 secs 2023-05-08T06:47:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10987.810099 secs 2023-05-08T06:47:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10988.368475 secs 2023-05-08T06:47:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10987.810099 secs 2023-05-08T06:47:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10988.368475 secs 2023-05-08T06:47:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:30 smithi186 ceph-mon[126480]: pgmap v5919: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 61 KiB/s wr, 8 op/s 2023-05-08T06:47:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10989.650425 secs 2023-05-08T06:47:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:30 smithi133 ceph-mon[125939]: pgmap v5919: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 61 KiB/s wr, 8 op/s 2023-05-08T06:47:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10989.650425 secs 2023-05-08T06:47:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:30 smithi096 ceph-mon[124666]: pgmap v5919: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 61 KiB/s wr, 8 op/s 2023-05-08T06:47:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10989.650425 secs 2023-05-08T06:47:32.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:32 smithi186 ceph-mon[126480]: pgmap v5920: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 7 op/s 2023-05-08T06:47:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:32 smithi133 ceph-mon[125939]: pgmap v5920: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 7 op/s 2023-05-08T06:47:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:32 smithi096 ceph-mon[124666]: pgmap v5920: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 7 op/s 2023-05-08T06:47:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10992.810216 secs 2023-05-08T06:47:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:34 smithi133 ceph-mon[125939]: pgmap v5921: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 51 KiB/s wr, 7 op/s 2023-05-08T06:47:34.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10993.368608 secs 2023-05-08T06:47:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10992.810216 secs 2023-05-08T06:47:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:34 smithi096 ceph-mon[124666]: pgmap v5921: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 51 KiB/s wr, 7 op/s 2023-05-08T06:47:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10993.368608 secs 2023-05-08T06:47:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10992.810216 secs 2023-05-08T06:47:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:34 smithi186 ceph-mon[126480]: pgmap v5921: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 51 KiB/s wr, 7 op/s 2023-05-08T06:47:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10993.368608 secs 2023-05-08T06:47:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10994.650545 secs 2023-05-08T06:47:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10994.650545 secs 2023-05-08T06:47:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10994.650545 secs 2023-05-08T06:47:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:36 smithi133 ceph-mon[125939]: pgmap v5922: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 76 KiB/s wr, 9 op/s 2023-05-08T06:47:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:36 smithi096 ceph-mon[124666]: pgmap v5922: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 76 KiB/s wr, 9 op/s 2023-05-08T06:47:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:36 smithi186 ceph-mon[126480]: pgmap v5922: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 76 KiB/s wr, 9 op/s 2023-05-08T06:47:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:38 smithi133 ceph-mon[125939]: pgmap v5923: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 50 KiB/s wr, 6 op/s 2023-05-08T06:47:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10997.810351 secs 2023-05-08T06:47:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:38 smithi096 ceph-mon[124666]: pgmap v5923: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 50 KiB/s wr, 6 op/s 2023-05-08T06:47:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10997.810351 secs 2023-05-08T06:47:39.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:38 smithi186 ceph-mon[126480]: pgmap v5923: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 50 KiB/s wr, 6 op/s 2023-05-08T06:47:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10997.810351 secs 2023-05-08T06:47:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10998.368672 secs 2023-05-08T06:47:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10998.368672 secs 2023-05-08T06:47:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10998.368672 secs 2023-05-08T06:47:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:40 smithi133 ceph-mon[125939]: pgmap v5924: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 79 KiB/s wr, 10 op/s 2023-05-08T06:47:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 10999.650683 secs 2023-05-08T06:47:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:40 smithi096 ceph-mon[124666]: pgmap v5924: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 79 KiB/s wr, 10 op/s 2023-05-08T06:47:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 10999.650683 secs 2023-05-08T06:47:41.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:40 smithi186 ceph-mon[126480]: pgmap v5924: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 79 KiB/s wr, 10 op/s 2023-05-08T06:47:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 10999.650683 secs 2023-05-08T06:47:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:42 smithi133 ceph-mon[125939]: pgmap v5925: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 53 KiB/s wr, 6 op/s 2023-05-08T06:47:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:42 smithi096 ceph-mon[124666]: pgmap v5925: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 53 KiB/s wr, 6 op/s 2023-05-08T06:47:43.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:42 smithi186 ceph-mon[126480]: pgmap v5925: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 53 KiB/s wr, 6 op/s 2023-05-08T06:47:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11002.810447 secs 2023-05-08T06:47:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11002.810447 secs 2023-05-08T06:47:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11002.810447 secs 2023-05-08T06:47:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:44 smithi133 ceph-mon[125939]: pgmap v5926: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 53 KiB/s wr, 6 op/s 2023-05-08T06:47:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:44 smithi096 ceph-mon[124666]: pgmap v5926: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 53 KiB/s wr, 6 op/s 2023-05-08T06:47:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:44 smithi186 ceph-mon[126480]: pgmap v5926: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 53 KiB/s wr, 6 op/s 2023-05-08T06:47:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11004.650834 secs 2023-05-08T06:47:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11004.650834 secs 2023-05-08T06:47:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11004.650834 secs 2023-05-08T06:47:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:46 smithi133 ceph-mon[125939]: pgmap v5927: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 131 KiB/s wr, 11 op/s 2023-05-08T06:47:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:46 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:47:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:46 smithi096 ceph-mon[124666]: pgmap v5927: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 131 KiB/s wr, 11 op/s 2023-05-08T06:47:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:46 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:47:47.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:46 smithi186 ceph-mon[126480]: pgmap v5927: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 131 KiB/s wr, 11 op/s 2023-05-08T06:47:47.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:46 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:47:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:47 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:47:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:47 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:47:47.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:47 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:47:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:47 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:47:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:47 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:47:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:47 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:47:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:47 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:47:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:47 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:47:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:47 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:47:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:48 smithi133 ceph-mon[125939]: pgmap v5928: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 107 KiB/s wr, 8 op/s 2023-05-08T06:47:49.164 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11007.810589 secs 2023-05-08T06:47:49.165 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:48 smithi186 ceph-mon[126480]: pgmap v5928: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 107 KiB/s wr, 8 op/s 2023-05-08T06:47:49.166 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11007.810589 secs 2023-05-08T06:47:49.166 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:48 smithi096 ceph-mon[124666]: pgmap v5928: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 107 KiB/s wr, 8 op/s 2023-05-08T06:47:49.166 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11007.810589 secs 2023-05-08T06:47:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:50 smithi133 ceph-mon[125939]: pgmap v5929: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 196 KiB/s wr, 13 op/s 2023-05-08T06:47:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:50 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:47:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:50 smithi096 ceph-mon[124666]: pgmap v5929: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 196 KiB/s wr, 13 op/s 2023-05-08T06:47:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:50 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:47:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:50 smithi186 ceph-mon[126480]: pgmap v5929: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 196 KiB/s wr, 13 op/s 2023-05-08T06:47:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:50 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:47:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:47:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:47:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:47:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:47:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:47:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:47:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:52 smithi133 ceph-mon[125939]: pgmap v5930: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 168 KiB/s wr, 9 op/s 2023-05-08T06:47:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:52 smithi096 ceph-mon[124666]: pgmap v5930: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 168 KiB/s wr, 9 op/s 2023-05-08T06:47:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:52 smithi186 ceph-mon[126480]: pgmap v5930: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 168 KiB/s wr, 9 op/s 2023-05-08T06:47:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11012.810709 secs 2023-05-08T06:47:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11012.810709 secs 2023-05-08T06:47:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11012.810709 secs 2023-05-08T06:47:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:54 smithi133 ceph-mon[125939]: pgmap v5931: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 168 KiB/s wr, 9 op/s 2023-05-08T06:47:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11013.369073 secs 2023-05-08T06:47:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:54 smithi096 ceph-mon[124666]: pgmap v5931: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 168 KiB/s wr, 9 op/s 2023-05-08T06:47:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11013.369073 secs 2023-05-08T06:47:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:54 smithi186 ceph-mon[126480]: pgmap v5931: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 168 KiB/s wr, 9 op/s 2023-05-08T06:47:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11013.369073 secs 2023-05-08T06:47:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:55 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:47:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:55 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:47:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:55 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:47:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:55 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:47:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:55 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:47:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:55 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:47:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:55 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:47:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:55 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:47:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:55 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:47:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:56 smithi133 ceph-mon[125939]: pgmap v5932: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 178 KiB/s wr, 13 op/s 2023-05-08T06:47:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:56 smithi096 ceph-mon[124666]: pgmap v5932: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 178 KiB/s wr, 13 op/s 2023-05-08T06:47:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:56 smithi186 ceph-mon[126480]: pgmap v5932: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 178 KiB/s wr, 13 op/s 2023-05-08T06:47:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:58 smithi133 ceph-mon[125939]: pgmap v5933: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 100 KiB/s wr, 9 op/s 2023-05-08T06:47:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11017.810829 secs 2023-05-08T06:47:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:58 smithi096 ceph-mon[124666]: pgmap v5933: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 100 KiB/s wr, 9 op/s 2023-05-08T06:47:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11017.810829 secs 2023-05-08T06:47:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:58 smithi186 ceph-mon[126480]: pgmap v5933: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 100 KiB/s wr, 9 op/s 2023-05-08T06:47:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11017.810829 secs 2023-05-08T06:47:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:47:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11018.369189 secs 2023-05-08T06:48:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:47:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11018.369189 secs 2023-05-08T06:48:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:47:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11018.369189 secs 2023-05-08T06:48:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:00 smithi133 ceph-mon[125939]: pgmap v5934: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 194 KiB/s wr, 13 op/s 2023-05-08T06:48:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:00 smithi096 ceph-mon[124666]: pgmap v5934: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 194 KiB/s wr, 13 op/s 2023-05-08T06:48:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:00 smithi186 ceph-mon[126480]: pgmap v5934: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 194 KiB/s wr, 13 op/s 2023-05-08T06:48:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:02 smithi133 ceph-mon[125939]: pgmap v5935: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 104 KiB/s wr, 8 op/s 2023-05-08T06:48:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:02 smithi096 ceph-mon[124666]: pgmap v5935: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 104 KiB/s wr, 8 op/s 2023-05-08T06:48:03.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:02 smithi186 ceph-mon[126480]: pgmap v5935: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 104 KiB/s wr, 8 op/s 2023-05-08T06:48:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11022.810936 secs 2023-05-08T06:48:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11022.810936 secs 2023-05-08T06:48:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11022.810936 secs 2023-05-08T06:48:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:04 smithi096 ceph-mon[124666]: pgmap v5936: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 104 KiB/s wr, 8 op/s 2023-05-08T06:48:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11023.369316 secs 2023-05-08T06:48:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:04 smithi186 ceph-mon[126480]: pgmap v5936: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 104 KiB/s wr, 8 op/s 2023-05-08T06:48:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11023.369316 secs 2023-05-08T06:48:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:04 smithi133 ceph-mon[125939]: pgmap v5936: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 104 KiB/s wr, 8 op/s 2023-05-08T06:48:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11023.369316 secs 2023-05-08T06:48:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11024.651353 secs 2023-05-08T06:48:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11024.651353 secs 2023-05-08T06:48:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11024.651353 secs 2023-05-08T06:48:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:06 smithi096 ceph-mon[124666]: pgmap v5937: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 159 KiB/s wr, 27 op/s 2023-05-08T06:48:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:06 smithi186 ceph-mon[126480]: pgmap v5937: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 159 KiB/s wr, 27 op/s 2023-05-08T06:48:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:06 smithi133 ceph-mon[125939]: pgmap v5937: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 159 KiB/s wr, 27 op/s 2023-05-08T06:48:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:07 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:48:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:07 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:48:08.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:07 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:48:08.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:07 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:48:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:07 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:48:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:07 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:48:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:07 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:48:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:07 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:48:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:07 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:48:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:08 smithi186 ceph-mon[126480]: pgmap v5938: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 149 KiB/s wr, 22 op/s 2023-05-08T06:48:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11027.811056 secs 2023-05-08T06:48:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:08 smithi133 ceph-mon[125939]: pgmap v5938: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 149 KiB/s wr, 22 op/s 2023-05-08T06:48:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11027.811056 secs 2023-05-08T06:48:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:08 smithi096 ceph-mon[124666]: pgmap v5938: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 149 KiB/s wr, 22 op/s 2023-05-08T06:48:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11027.811056 secs 2023-05-08T06:48:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11028.369486 secs 2023-05-08T06:48:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11028.369486 secs 2023-05-08T06:48:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11028.369486 secs 2023-05-08T06:48:11.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:10 smithi186 ceph-mon[126480]: pgmap v5939: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 218 KiB/s wr, 27 op/s 2023-05-08T06:48:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11029.651492 secs 2023-05-08T06:48:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:10 smithi133 ceph-mon[125939]: pgmap v5939: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 218 KiB/s wr, 27 op/s 2023-05-08T06:48:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11029.651492 secs 2023-05-08T06:48:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:10 smithi096 ceph-mon[124666]: pgmap v5939: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 218 KiB/s wr, 27 op/s 2023-05-08T06:48:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11029.651492 secs 2023-05-08T06:48:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:11 smithi186 ceph-mon[126480]: osdmap e448: 12 total, 12 up, 12 in 2023-05-08T06:48:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:11 smithi133 ceph-mon[125939]: osdmap e448: 12 total, 12 up, 12 in 2023-05-08T06:48:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:11 smithi096 ceph-mon[124666]: osdmap e448: 12 total, 12 up, 12 in 2023-05-08T06:48:13.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:12 smithi186 ceph-mon[126480]: pgmap v5941: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 150 KiB/s wr, 27 op/s 2023-05-08T06:48:13.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:12 smithi133 ceph-mon[125939]: pgmap v5941: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 150 KiB/s wr, 27 op/s 2023-05-08T06:48:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:12 smithi096 ceph-mon[124666]: pgmap v5941: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 150 KiB/s wr, 27 op/s 2023-05-08T06:48:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11032.811207 secs 2023-05-08T06:48:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11032.811207 secs 2023-05-08T06:48:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11032.811207 secs 2023-05-08T06:48:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:14 smithi186 ceph-mon[126480]: pgmap v5942: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 150 KiB/s wr, 27 op/s 2023-05-08T06:48:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11033.369606 secs 2023-05-08T06:48:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:14 smithi133 ceph-mon[125939]: pgmap v5942: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 150 KiB/s wr, 27 op/s 2023-05-08T06:48:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11033.369606 secs 2023-05-08T06:48:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:14 smithi096 ceph-mon[124666]: pgmap v5942: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 150 KiB/s wr, 27 op/s 2023-05-08T06:48:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11033.369606 secs 2023-05-08T06:48:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11034.651646 secs 2023-05-08T06:48:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11034.651646 secs 2023-05-08T06:48:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11034.651646 secs 2023-05-08T06:48:17.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:16 smithi186 ceph-mon[126480]: pgmap v5943: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 89 KiB/s wr, 9 op/s 2023-05-08T06:48:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:16 smithi133 ceph-mon[125939]: pgmap v5943: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 89 KiB/s wr, 9 op/s 2023-05-08T06:48:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:16 smithi096 ceph-mon[124666]: pgmap v5943: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 89 KiB/s wr, 9 op/s 2023-05-08T06:48:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:18 smithi186 ceph-mon[126480]: pgmap v5944: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 89 KiB/s wr, 9 op/s 2023-05-08T06:48:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11037.811381 secs 2023-05-08T06:48:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:18 smithi133 ceph-mon[125939]: pgmap v5944: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 89 KiB/s wr, 9 op/s 2023-05-08T06:48:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11037.811381 secs 2023-05-08T06:48:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:18 smithi096 ceph-mon[124666]: pgmap v5944: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 89 KiB/s wr, 9 op/s 2023-05-08T06:48:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11037.811381 secs 2023-05-08T06:48:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11038.369711 secs 2023-05-08T06:48:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:19 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:48:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11038.369711 secs 2023-05-08T06:48:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:19 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:48:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11038.369711 secs 2023-05-08T06:48:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:19 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:48:21.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:20 smithi186 ceph-mon[126480]: pgmap v5945: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 27 KiB/s wr, 8 op/s 2023-05-08T06:48:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11039.651734 secs 2023-05-08T06:48:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:20 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:48:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:20 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:48:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:20 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:48:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:20 smithi186 ceph-mon[126480]: osdmap e449: 12 total, 12 up, 12 in 2023-05-08T06:48:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:20 smithi133 ceph-mon[125939]: pgmap v5945: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 27 KiB/s wr, 8 op/s 2023-05-08T06:48:21.277 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11039.651734 secs 2023-05-08T06:48:21.278 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:20 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:48:21.278 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:20 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:48:21.278 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:20 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:48:21.278 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:20 smithi133 ceph-mon[125939]: osdmap e449: 12 total, 12 up, 12 in 2023-05-08T06:48:21.279 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:20 smithi096 ceph-mon[124666]: pgmap v5945: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 27 KiB/s wr, 8 op/s 2023-05-08T06:48:21.279 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11039.651734 secs 2023-05-08T06:48:21.279 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:20 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:48:21.279 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:20 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:48:21.279 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:20 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:48:21.280 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:20 smithi096 ceph-mon[124666]: osdmap e449: 12 total, 12 up, 12 in 2023-05-08T06:48:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:21 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:48:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:21 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T06:48:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:21 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T06:48:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:21 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:48:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:21 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:48:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:21 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T06:48:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:21 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T06:48:22.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:21 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:48:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:21 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:48:22.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:21 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T06:48:22.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:21 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T06:48:22.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:21 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:48:23.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:22 smithi186 ceph-mon[126480]: pgmap v5947: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 27 KiB/s wr, 8 op/s 2023-05-08T06:48:23.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:22 smithi133 ceph-mon[125939]: pgmap v5947: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 27 KiB/s wr, 8 op/s 2023-05-08T06:48:23.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:22 smithi096 ceph-mon[124666]: pgmap v5947: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 27 KiB/s wr, 8 op/s 2023-05-08T06:48:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11042.811443 secs 2023-05-08T06:48:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11042.811443 secs 2023-05-08T06:48:24.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11042.811443 secs 2023-05-08T06:48:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:24 smithi186 ceph-mon[126480]: pgmap v5948: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 27 KiB/s wr, 8 op/s 2023-05-08T06:48:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11043.369857 secs 2023-05-08T06:48:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:24 smithi133 ceph-mon[125939]: pgmap v5948: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 27 KiB/s wr, 8 op/s 2023-05-08T06:48:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11043.369857 secs 2023-05-08T06:48:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:24 smithi096 ceph-mon[124666]: pgmap v5948: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 27 KiB/s wr, 8 op/s 2023-05-08T06:48:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11043.369857 secs 2023-05-08T06:48:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11044.651823 secs 2023-05-08T06:48:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11044.651823 secs 2023-05-08T06:48:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11044.651823 secs 2023-05-08T06:48:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:26 smithi186 ceph-mon[126480]: pgmap v5949: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 52 KiB/s wr, 8 op/s 2023-05-08T06:48:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:26 smithi133 ceph-mon[125939]: pgmap v5949: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 52 KiB/s wr, 8 op/s 2023-05-08T06:48:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:26 smithi096 ceph-mon[124666]: pgmap v5949: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 52 KiB/s wr, 8 op/s 2023-05-08T06:48:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:28 smithi186 ceph-mon[126480]: pgmap v5950: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 52 KiB/s wr, 8 op/s 2023-05-08T06:48:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11047.811568 secs 2023-05-08T06:48:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:28 smithi133 ceph-mon[125939]: pgmap v5950: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 52 KiB/s wr, 8 op/s 2023-05-08T06:48:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11047.811568 secs 2023-05-08T06:48:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:28 smithi096 ceph-mon[124666]: pgmap v5950: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 52 KiB/s wr, 8 op/s 2023-05-08T06:48:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11047.811568 secs 2023-05-08T06:48:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11048.370000 secs 2023-05-08T06:48:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11048.370000 secs 2023-05-08T06:48:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11048.370000 secs 2023-05-08T06:48:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:30 smithi186 ceph-mon[126480]: pgmap v5951: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 100 KiB/s wr, 9 op/s 2023-05-08T06:48:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11049.651886 secs 2023-05-08T06:48:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:30 smithi133 ceph-mon[125939]: pgmap v5951: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 100 KiB/s wr, 9 op/s 2023-05-08T06:48:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11049.651886 secs 2023-05-08T06:48:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:30 smithi096 ceph-mon[124666]: pgmap v5951: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 100 KiB/s wr, 9 op/s 2023-05-08T06:48:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11049.651886 secs 2023-05-08T06:48:33.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:32 smithi186 ceph-mon[126480]: pgmap v5952: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 93 KiB/s wr, 8 op/s 2023-05-08T06:48:33.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:32 smithi133 ceph-mon[125939]: pgmap v5952: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 93 KiB/s wr, 8 op/s 2023-05-08T06:48:33.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:32 smithi096 ceph-mon[124666]: pgmap v5952: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 93 KiB/s wr, 8 op/s 2023-05-08T06:48:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11052.811692 secs 2023-05-08T06:48:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11052.811692 secs 2023-05-08T06:48:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11052.811692 secs 2023-05-08T06:48:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:34 smithi186 ceph-mon[126480]: pgmap v5953: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 84 KiB/s wr, 7 op/s 2023-05-08T06:48:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11053.370137 secs 2023-05-08T06:48:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:34 smithi133 ceph-mon[125939]: pgmap v5953: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 84 KiB/s wr, 7 op/s 2023-05-08T06:48:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11053.370137 secs 2023-05-08T06:48:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:34 smithi096 ceph-mon[124666]: pgmap v5953: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 84 KiB/s wr, 7 op/s 2023-05-08T06:48:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11053.370137 secs 2023-05-08T06:48:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11054.651951 secs 2023-05-08T06:48:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11054.651951 secs 2023-05-08T06:48:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11054.651951 secs 2023-05-08T06:48:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:36 smithi133 ceph-mon[125939]: pgmap v5954: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 84 KiB/s wr, 11 op/s 2023-05-08T06:48:37.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:36 smithi096 ceph-mon[124666]: pgmap v5954: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 84 KiB/s wr, 11 op/s 2023-05-08T06:48:37.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:36 smithi186 ceph-mon[126480]: pgmap v5954: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 84 KiB/s wr, 11 op/s 2023-05-08T06:48:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:38 smithi133 ceph-mon[125939]: pgmap v5955: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 58 KiB/s wr, 7 op/s 2023-05-08T06:48:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11057.811815 secs 2023-05-08T06:48:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:38 smithi096 ceph-mon[124666]: pgmap v5955: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 58 KiB/s wr, 7 op/s 2023-05-08T06:48:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11057.811815 secs 2023-05-08T06:48:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:38 smithi186 ceph-mon[126480]: pgmap v5955: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 58 KiB/s wr, 7 op/s 2023-05-08T06:48:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11057.811815 secs 2023-05-08T06:48:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11058.370286 secs 2023-05-08T06:48:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11058.370286 secs 2023-05-08T06:48:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11058.370286 secs 2023-05-08T06:48:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:40 smithi133 ceph-mon[125939]: pgmap v5956: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 143 KiB/s wr, 11 op/s 2023-05-08T06:48:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11059.652023 secs 2023-05-08T06:48:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:40 smithi096 ceph-mon[124666]: pgmap v5956: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 143 KiB/s wr, 11 op/s 2023-05-08T06:48:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11059.652023 secs 2023-05-08T06:48:41.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:40 smithi186 ceph-mon[126480]: pgmap v5956: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 143 KiB/s wr, 11 op/s 2023-05-08T06:48:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11059.652023 secs 2023-05-08T06:48:43.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:42 smithi133 ceph-mon[125939]: pgmap v5957: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 85 KiB/s wr, 7 op/s 2023-05-08T06:48:43.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:42 smithi096 ceph-mon[124666]: pgmap v5957: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 85 KiB/s wr, 7 op/s 2023-05-08T06:48:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:42 smithi186 ceph-mon[126480]: pgmap v5957: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 85 KiB/s wr, 7 op/s 2023-05-08T06:48:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11062.811915 secs 2023-05-08T06:48:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11062.811915 secs 2023-05-08T06:48:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11062.811915 secs 2023-05-08T06:48:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:44 smithi133 ceph-mon[125939]: pgmap v5958: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 85 KiB/s wr, 7 op/s 2023-05-08T06:48:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:44 smithi096 ceph-mon[124666]: pgmap v5958: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 85 KiB/s wr, 7 op/s 2023-05-08T06:48:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:44 smithi186 ceph-mon[126480]: pgmap v5958: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 85 KiB/s wr, 7 op/s 2023-05-08T06:48:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:46 smithi133 ceph-mon[125939]: pgmap v5959: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 137 KiB/s wr, 12 op/s 2023-05-08T06:48:47.284 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:46 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:48:47.285 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:46 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:48:47.285 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:46 smithi096 ceph-mon[124666]: pgmap v5959: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 137 KiB/s wr, 12 op/s 2023-05-08T06:48:47.285 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:46 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:48:47.286 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:46 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:48:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:46 smithi186 ceph-mon[126480]: pgmap v5959: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 137 KiB/s wr, 12 op/s 2023-05-08T06:48:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:46 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:48:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:46 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:48:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:47 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:48:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:47 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:48:48.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:47 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:48:48.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:47 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:48:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:47 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:48:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:47 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:48:48.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:47 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:48:48.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:47 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:48:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:47 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:48:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:47 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:48:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:47 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:48:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:47 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:48:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:48 smithi133 ceph-mon[125939]: pgmap v5960: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 137 KiB/s wr, 8 op/s 2023-05-08T06:48:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11067.812031 secs 2023-05-08T06:48:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:48 smithi096 ceph-mon[124666]: pgmap v5960: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 137 KiB/s wr, 8 op/s 2023-05-08T06:48:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11067.812031 secs 2023-05-08T06:48:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:48 smithi186 ceph-mon[126480]: pgmap v5960: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 137 KiB/s wr, 8 op/s 2023-05-08T06:48:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11067.812031 secs 2023-05-08T06:48:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11068.370590 secs 2023-05-08T06:48:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11068.370590 secs 2023-05-08T06:48:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11068.370590 secs 2023-05-08T06:48:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:50 smithi133 ceph-mon[125939]: pgmap v5961: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 233 KiB/s wr, 13 op/s 2023-05-08T06:48:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:50 smithi096 ceph-mon[124666]: pgmap v5961: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 233 KiB/s wr, 13 op/s 2023-05-08T06:48:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:50 smithi186 ceph-mon[126480]: pgmap v5961: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 233 KiB/s wr, 13 op/s 2023-05-08T06:48:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:48:52.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:48:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:48:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:48:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:48:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:48:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:52 smithi133 ceph-mon[125939]: pgmap v5962: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 149 KiB/s wr, 9 op/s 2023-05-08T06:48:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:52 smithi096 ceph-mon[124666]: pgmap v5962: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 149 KiB/s wr, 9 op/s 2023-05-08T06:48:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:52 smithi186 ceph-mon[126480]: pgmap v5962: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 149 KiB/s wr, 9 op/s 2023-05-08T06:48:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11072.812130 secs 2023-05-08T06:48:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11072.812130 secs 2023-05-08T06:48:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11072.812130 secs 2023-05-08T06:48:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:54 smithi133 ceph-mon[125939]: pgmap v5963: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 149 KiB/s wr, 9 op/s 2023-05-08T06:48:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:54 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:48:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:54 smithi096 ceph-mon[124666]: pgmap v5963: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 149 KiB/s wr, 9 op/s 2023-05-08T06:48:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:54 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:48:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:54 smithi186 ceph-mon[126480]: pgmap v5963: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 149 KiB/s wr, 9 op/s 2023-05-08T06:48:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:54 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:48:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:55 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:48:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:55 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:48:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:55 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:48:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:55 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:48:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:55 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:48:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:55 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:48:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:55 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:48:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:55 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:48:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:55 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:48:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:56 smithi133 ceph-mon[125939]: pgmap v5964: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 159 KiB/s wr, 14 op/s 2023-05-08T06:48:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:56 smithi096 ceph-mon[124666]: pgmap v5964: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 159 KiB/s wr, 14 op/s 2023-05-08T06:48:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:56 smithi186 ceph-mon[126480]: pgmap v5964: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 159 KiB/s wr, 14 op/s 2023-05-08T06:48:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:58 smithi133 ceph-mon[125939]: pgmap v5965: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 107 KiB/s wr, 8 op/s 2023-05-08T06:48:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11077.812249 secs 2023-05-08T06:48:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:58 smithi096 ceph-mon[124666]: pgmap v5965: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 107 KiB/s wr, 8 op/s 2023-05-08T06:48:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11077.812249 secs 2023-05-08T06:48:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:58 smithi186 ceph-mon[126480]: pgmap v5965: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 107 KiB/s wr, 8 op/s 2023-05-08T06:48:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11077.812249 secs 2023-05-08T06:49:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:48:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11078.370817 secs 2023-05-08T06:49:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:48:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11078.370817 secs 2023-05-08T06:49:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:48:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11078.370817 secs 2023-05-08T06:49:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:00 smithi133 ceph-mon[125939]: pgmap v5966: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 232 KiB/s wr, 13 op/s 2023-05-08T06:49:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11079.652369 secs 2023-05-08T06:49:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:00 smithi096 ceph-mon[124666]: pgmap v5966: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 232 KiB/s wr, 13 op/s 2023-05-08T06:49:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11079.652369 secs 2023-05-08T06:49:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:00 smithi186 ceph-mon[126480]: pgmap v5966: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 232 KiB/s wr, 13 op/s 2023-05-08T06:49:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11079.652369 secs 2023-05-08T06:49:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:02 smithi133 ceph-mon[125939]: pgmap v5967: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 136 KiB/s wr, 9 op/s 2023-05-08T06:49:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:02 smithi096 ceph-mon[124666]: pgmap v5967: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 136 KiB/s wr, 9 op/s 2023-05-08T06:49:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:02 smithi186 ceph-mon[126480]: pgmap v5967: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 136 KiB/s wr, 9 op/s 2023-05-08T06:49:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:03 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:49:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:49:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:49:04.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:03 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:49:04.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11082.812409 secs 2023-05-08T06:49:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:03 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:49:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:49:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:49:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:03 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:49:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11082.812409 secs 2023-05-08T06:49:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:03 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:49:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:49:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:49:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:03 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:49:04.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11082.812409 secs 2023-05-08T06:49:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:04 smithi096 ceph-mon[124666]: pgmap v5968: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 136 KiB/s wr, 9 op/s 2023-05-08T06:49:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11083.370945 secs 2023-05-08T06:49:05.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:04 smithi186 ceph-mon[126480]: pgmap v5968: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 136 KiB/s wr, 9 op/s 2023-05-08T06:49:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11083.370945 secs 2023-05-08T06:49:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:04 smithi133 ceph-mon[125939]: pgmap v5968: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 136 KiB/s wr, 9 op/s 2023-05-08T06:49:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11083.370945 secs 2023-05-08T06:49:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11084.652436 secs 2023-05-08T06:49:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11084.652436 secs 2023-05-08T06:49:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11084.652436 secs 2023-05-08T06:49:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:07 smithi096 ceph-mon[124666]: pgmap v5969: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 181 KiB/s wr, 26 op/s 2023-05-08T06:49:07.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:07 smithi186 ceph-mon[126480]: pgmap v5969: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 181 KiB/s wr, 26 op/s 2023-05-08T06:49:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:07 smithi133 ceph-mon[125939]: pgmap v5969: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 181 KiB/s wr, 26 op/s 2023-05-08T06:49:09.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:09 smithi186 ceph-mon[126480]: pgmap v5970: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 171 KiB/s wr, 22 op/s 2023-05-08T06:49:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11087.812495 secs 2023-05-08T06:49:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:09 smithi133 ceph-mon[125939]: pgmap v5970: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 171 KiB/s wr, 22 op/s 2023-05-08T06:49:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11087.812495 secs 2023-05-08T06:49:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:09 smithi096 ceph-mon[124666]: pgmap v5970: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 171 KiB/s wr, 22 op/s 2023-05-08T06:49:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11087.812495 secs 2023-05-08T06:49:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11088.371075 secs 2023-05-08T06:49:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11088.371075 secs 2023-05-08T06:49:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11088.371075 secs 2023-05-08T06:49:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:11 smithi186 ceph-mon[126480]: pgmap v5971: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 197 KiB/s wr, 26 op/s 2023-05-08T06:49:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11089.652504 secs 2023-05-08T06:49:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:11 smithi186 ceph-mon[126480]: osdmap e450: 12 total, 12 up, 12 in 2023-05-08T06:49:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:11 smithi133 ceph-mon[125939]: pgmap v5971: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 197 KiB/s wr, 26 op/s 2023-05-08T06:49:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11089.652504 secs 2023-05-08T06:49:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:11 smithi133 ceph-mon[125939]: osdmap e450: 12 total, 12 up, 12 in 2023-05-08T06:49:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:11 smithi096 ceph-mon[124666]: pgmap v5971: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 197 KiB/s wr, 26 op/s 2023-05-08T06:49:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11089.652504 secs 2023-05-08T06:49:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:11 smithi096 ceph-mon[124666]: osdmap e450: 12 total, 12 up, 12 in 2023-05-08T06:49:13.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:13 smithi186 ceph-mon[126480]: pgmap v5973: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 86 KiB/s wr, 25 op/s 2023-05-08T06:49:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:13 smithi133 ceph-mon[125939]: pgmap v5973: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 86 KiB/s wr, 25 op/s 2023-05-08T06:49:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:13 smithi096 ceph-mon[124666]: pgmap v5973: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 86 KiB/s wr, 25 op/s 2023-05-08T06:49:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11092.812614 secs 2023-05-08T06:49:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11092.812614 secs 2023-05-08T06:49:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11092.812614 secs 2023-05-08T06:49:15.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:15 smithi186 ceph-mon[126480]: pgmap v5974: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 86 KiB/s wr, 25 op/s 2023-05-08T06:49:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11093.371237 secs 2023-05-08T06:49:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:15 smithi133 ceph-mon[125939]: pgmap v5974: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 86 KiB/s wr, 25 op/s 2023-05-08T06:49:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11093.371237 secs 2023-05-08T06:49:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:15 smithi096 ceph-mon[124666]: pgmap v5974: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 86 KiB/s wr, 25 op/s 2023-05-08T06:49:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11093.371237 secs 2023-05-08T06:49:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11094.652572 secs 2023-05-08T06:49:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11094.652572 secs 2023-05-08T06:49:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11094.652572 secs 2023-05-08T06:49:17.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:17 smithi186 ceph-mon[126480]: pgmap v5975: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 KiB/s wr, 8 op/s 2023-05-08T06:49:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:17 smithi133 ceph-mon[125939]: pgmap v5975: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 KiB/s wr, 8 op/s 2023-05-08T06:49:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:17 smithi096 ceph-mon[124666]: pgmap v5975: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 KiB/s wr, 8 op/s 2023-05-08T06:49:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:19 smithi186 ceph-mon[126480]: pgmap v5976: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 KiB/s wr, 8 op/s 2023-05-08T06:49:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11097.812741 secs 2023-05-08T06:49:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:19 smithi133 ceph-mon[125939]: pgmap v5976: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 KiB/s wr, 8 op/s 2023-05-08T06:49:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11097.812741 secs 2023-05-08T06:49:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:19 smithi096 ceph-mon[124666]: pgmap v5976: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 KiB/s wr, 8 op/s 2023-05-08T06:49:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11097.812741 secs 2023-05-08T06:49:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11098.371372 secs 2023-05-08T06:49:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11098.371372 secs 2023-05-08T06:49:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11098.371372 secs 2023-05-08T06:49:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:21 smithi186 ceph-mon[126480]: pgmap v5977: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 8 op/s 2023-05-08T06:49:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11099.652637 secs 2023-05-08T06:49:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:49:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:21 smithi186 ceph-mon[126480]: osdmap e451: 12 total, 12 up, 12 in 2023-05-08T06:49:21.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:49:21.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:49:21.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:49:21.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:49:21.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:49:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:21 smithi133 ceph-mon[125939]: pgmap v5977: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 8 op/s 2023-05-08T06:49:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11099.652637 secs 2023-05-08T06:49:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:49:21.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:21 smithi133 ceph-mon[125939]: osdmap e451: 12 total, 12 up, 12 in 2023-05-08T06:49:21.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:49:21.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:49:21.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:49:21.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:49:21.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:49:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:21 smithi096 ceph-mon[124666]: pgmap v5977: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 8 op/s 2023-05-08T06:49:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11099.652637 secs 2023-05-08T06:49:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:49:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:21 smithi096 ceph-mon[124666]: osdmap e451: 12 total, 12 up, 12 in 2023-05-08T06:49:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:49:21.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:49:21.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:49:21.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:49:21.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:49:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:22 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:49:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:22 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:49:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:22 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:49:22.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:22 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:49:22.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:22 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:49:22.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:22 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:49:22.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:22 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:49:22.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:22 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:49:22.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:22 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:49:22.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:22 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:49:22.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:22 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:49:22.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:22 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:49:23.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:23 smithi186 ceph-mon[126480]: pgmap v5979: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 8 op/s 2023-05-08T06:49:23.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:23 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:49:23.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:23 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T06:49:23.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:23 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T06:49:23.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:23 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:49:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:23 smithi133 ceph-mon[125939]: pgmap v5979: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 8 op/s 2023-05-08T06:49:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:23 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:49:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:23 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T06:49:23.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:23 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T06:49:23.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:23 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:49:23.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:23 smithi096 ceph-mon[124666]: pgmap v5979: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 8 op/s 2023-05-08T06:49:23.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:23 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:49:23.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:23 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T06:49:23.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:23 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T06:49:23.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:23 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:49:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11102.812846 secs 2023-05-08T06:49:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11102.812846 secs 2023-05-08T06:49:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11102.812846 secs 2023-05-08T06:49:25.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:25 smithi186 ceph-mon[126480]: pgmap v5980: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 8 op/s 2023-05-08T06:49:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11103.371532 secs 2023-05-08T06:49:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:25 smithi133 ceph-mon[125939]: pgmap v5980: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 8 op/s 2023-05-08T06:49:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11103.371532 secs 2023-05-08T06:49:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:25 smithi096 ceph-mon[124666]: pgmap v5980: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 8 op/s 2023-05-08T06:49:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11103.371532 secs 2023-05-08T06:49:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11104.652706 secs 2023-05-08T06:49:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11104.652706 secs 2023-05-08T06:49:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11104.652706 secs 2023-05-08T06:49:27.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:27 smithi186 ceph-mon[126480]: pgmap v5981: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 59 KiB/s wr, 8 op/s 2023-05-08T06:49:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:27 smithi133 ceph-mon[125939]: pgmap v5981: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 59 KiB/s wr, 8 op/s 2023-05-08T06:49:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:27 smithi096 ceph-mon[124666]: pgmap v5981: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 59 KiB/s wr, 8 op/s 2023-05-08T06:49:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:29 smithi186 ceph-mon[126480]: pgmap v5982: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 59 KiB/s wr, 8 op/s 2023-05-08T06:49:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11107.812986 secs 2023-05-08T06:49:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:29 smithi133 ceph-mon[125939]: pgmap v5982: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 59 KiB/s wr, 8 op/s 2023-05-08T06:49:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11107.812986 secs 2023-05-08T06:49:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:29 smithi096 ceph-mon[124666]: pgmap v5982: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 59 KiB/s wr, 8 op/s 2023-05-08T06:49:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11107.812986 secs 2023-05-08T06:49:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11108.371619 secs 2023-05-08T06:49:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11108.371619 secs 2023-05-08T06:49:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11108.371619 secs 2023-05-08T06:49:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:31 smithi186 ceph-mon[126480]: pgmap v5983: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 47 KiB/s wr, 8 op/s 2023-05-08T06:49:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11109.652836 secs 2023-05-08T06:49:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:31 smithi133 ceph-mon[125939]: pgmap v5983: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 47 KiB/s wr, 8 op/s 2023-05-08T06:49:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11109.652836 secs 2023-05-08T06:49:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:31 smithi096 ceph-mon[124666]: pgmap v5983: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 47 KiB/s wr, 8 op/s 2023-05-08T06:49:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11109.652836 secs 2023-05-08T06:49:33.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:33 smithi186 ceph-mon[126480]: pgmap v5984: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 43 KiB/s wr, 7 op/s 2023-05-08T06:49:33.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:33 smithi133 ceph-mon[125939]: pgmap v5984: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 43 KiB/s wr, 7 op/s 2023-05-08T06:49:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:33 smithi096 ceph-mon[124666]: pgmap v5984: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 43 KiB/s wr, 7 op/s 2023-05-08T06:49:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11112.813132 secs 2023-05-08T06:49:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11112.813132 secs 2023-05-08T06:49:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11112.813132 secs 2023-05-08T06:49:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:35 smithi186 ceph-mon[126480]: pgmap v5985: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 39 KiB/s wr, 7 op/s 2023-05-08T06:49:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11113.371725 secs 2023-05-08T06:49:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:35 smithi133 ceph-mon[125939]: pgmap v5985: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 39 KiB/s wr, 7 op/s 2023-05-08T06:49:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11113.371725 secs 2023-05-08T06:49:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:35 smithi096 ceph-mon[124666]: pgmap v5985: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 39 KiB/s wr, 7 op/s 2023-05-08T06:49:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11113.371725 secs 2023-05-08T06:49:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11114.652970 secs 2023-05-08T06:49:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11114.652970 secs 2023-05-08T06:49:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11114.652970 secs 2023-05-08T06:49:37.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:37 smithi186 ceph-mon[126480]: pgmap v5986: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 39 KiB/s wr, 9 op/s 2023-05-08T06:49:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:37 smithi133 ceph-mon[125939]: pgmap v5986: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 39 KiB/s wr, 9 op/s 2023-05-08T06:49:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:37 smithi096 ceph-mon[124666]: pgmap v5986: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 39 KiB/s wr, 9 op/s 2023-05-08T06:49:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:39 smithi186 ceph-mon[126480]: pgmap v5987: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 13 KiB/s wr, 6 op/s 2023-05-08T06:49:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11117.813251 secs 2023-05-08T06:49:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:39 smithi133 ceph-mon[125939]: pgmap v5987: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 13 KiB/s wr, 6 op/s 2023-05-08T06:49:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11117.813251 secs 2023-05-08T06:49:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:39 smithi096 ceph-mon[124666]: pgmap v5987: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 13 KiB/s wr, 6 op/s 2023-05-08T06:49:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11117.813251 secs 2023-05-08T06:49:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11118.371801 secs 2023-05-08T06:49:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11118.371801 secs 2023-05-08T06:49:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11118.371801 secs 2023-05-08T06:49:41.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:41 smithi186 ceph-mon[126480]: pgmap v5988: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 39 KiB/s wr, 9 op/s 2023-05-08T06:49:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11119.653073 secs 2023-05-08T06:49:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:41 smithi133 ceph-mon[125939]: pgmap v5988: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 39 KiB/s wr, 9 op/s 2023-05-08T06:49:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11119.653073 secs 2023-05-08T06:49:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:41 smithi096 ceph-mon[124666]: pgmap v5988: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 39 KiB/s wr, 9 op/s 2023-05-08T06:49:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11119.653073 secs 2023-05-08T06:49:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:43 smithi186 ceph-mon[126480]: pgmap v5989: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 5 op/s 2023-05-08T06:49:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:43 smithi133 ceph-mon[125939]: pgmap v5989: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 5 op/s 2023-05-08T06:49:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:43 smithi096 ceph-mon[124666]: pgmap v5989: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 5 op/s 2023-05-08T06:49:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11122.813365 secs 2023-05-08T06:49:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11122.813365 secs 2023-05-08T06:49:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11122.813365 secs 2023-05-08T06:49:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:45 smithi133 ceph-mon[125939]: pgmap v5990: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 5 op/s 2023-05-08T06:49:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:45 smithi096 ceph-mon[124666]: pgmap v5990: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 5 op/s 2023-05-08T06:49:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:45 smithi186 ceph-mon[126480]: pgmap v5990: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 5 op/s 2023-05-08T06:49:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11124.653239 secs 2023-05-08T06:49:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11124.653239 secs 2023-05-08T06:49:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11124.653239 secs 2023-05-08T06:49:47.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:47 smithi133 ceph-mon[125939]: pgmap v5991: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 55 KiB/s wr, 9 op/s 2023-05-08T06:49:47.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:49:47.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:47 smithi096 ceph-mon[124666]: pgmap v5991: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 55 KiB/s wr, 9 op/s 2023-05-08T06:49:47.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:49:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:47 smithi186 ceph-mon[126480]: pgmap v5991: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 55 KiB/s wr, 9 op/s 2023-05-08T06:49:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:49:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:48 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:49:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:49:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:49:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:48 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:49:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:49:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:49:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:48 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:49:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:49:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:49:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:49 smithi133 ceph-mon[125939]: pgmap v5992: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 56 KiB/s wr, 6 op/s 2023-05-08T06:49:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11127.813462 secs 2023-05-08T06:49:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:49 smithi096 ceph-mon[124666]: pgmap v5992: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 56 KiB/s wr, 6 op/s 2023-05-08T06:49:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11127.813462 secs 2023-05-08T06:49:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:49 smithi186 ceph-mon[126480]: pgmap v5992: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 56 KiB/s wr, 6 op/s 2023-05-08T06:49:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11127.813462 secs 2023-05-08T06:49:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:51 smithi133 ceph-mon[125939]: pgmap v5993: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 128 KiB/s wr, 11 op/s 2023-05-08T06:49:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:49:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:51 smithi096 ceph-mon[124666]: pgmap v5993: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 128 KiB/s wr, 11 op/s 2023-05-08T06:49:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:49:51.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:51 smithi186 ceph-mon[126480]: pgmap v5993: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 128 KiB/s wr, 11 op/s 2023-05-08T06:49:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:49:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:49:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:49:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:49:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:49:52.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:49:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:49:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:53 smithi133 ceph-mon[125939]: pgmap v5994: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 102 KiB/s wr, 8 op/s 2023-05-08T06:49:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:53 smithi096 ceph-mon[124666]: pgmap v5994: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 102 KiB/s wr, 8 op/s 2023-05-08T06:49:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:53 smithi186 ceph-mon[126480]: pgmap v5994: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 102 KiB/s wr, 8 op/s 2023-05-08T06:49:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11132.813519 secs 2023-05-08T06:49:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11133.372164 secs 2023-05-08T06:49:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11132.813519 secs 2023-05-08T06:49:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11133.372164 secs 2023-05-08T06:49:54.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11132.813519 secs 2023-05-08T06:49:54.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11133.372164 secs 2023-05-08T06:49:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:55 smithi133 ceph-mon[125939]: pgmap v5995: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 102 KiB/s wr, 8 op/s 2023-05-08T06:49:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:55 smithi096 ceph-mon[124666]: pgmap v5995: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 102 KiB/s wr, 8 op/s 2023-05-08T06:49:55.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:55 smithi186 ceph-mon[126480]: pgmap v5995: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 102 KiB/s wr, 8 op/s 2023-05-08T06:49:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:56 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:49:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:49:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:49:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:56 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:49:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:49:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:49:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:56 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:49:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:49:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:49:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:57 smithi133 ceph-mon[125939]: pgmap v5996: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 135 KiB/s wr, 12 op/s 2023-05-08T06:49:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:57 smithi096 ceph-mon[124666]: pgmap v5996: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 135 KiB/s wr, 12 op/s 2023-05-08T06:49:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:57 smithi186 ceph-mon[126480]: pgmap v5996: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 135 KiB/s wr, 12 op/s 2023-05-08T06:49:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:59 smithi133 ceph-mon[125939]: pgmap v5997: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 106 KiB/s wr, 9 op/s 2023-05-08T06:49:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:49:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11137.813600 secs 2023-05-08T06:49:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:59 smithi096 ceph-mon[124666]: pgmap v5997: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 106 KiB/s wr, 9 op/s 2023-05-08T06:49:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:49:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11137.813600 secs 2023-05-08T06:49:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:59 smithi186 ceph-mon[126480]: pgmap v5997: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 106 KiB/s wr, 9 op/s 2023-05-08T06:49:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:49:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11137.813600 secs 2023-05-08T06:50:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:00 smithi133 ceph-mon[125939]: overall HEALTH_WARN 2 MDSs report slow requests 2023-05-08T06:50:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:00 smithi096 ceph-mon[124666]: overall HEALTH_WARN 2 MDSs report slow requests 2023-05-08T06:50:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:00 smithi186 ceph-mon[126480]: overall HEALTH_WARN 2 MDSs report slow requests 2023-05-08T06:50:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:01 smithi133 ceph-mon[125939]: pgmap v5998: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 217 KiB/s wr, 14 op/s 2023-05-08T06:50:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11139.653621 secs 2023-05-08T06:50:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:01 smithi096 ceph-mon[124666]: pgmap v5998: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 217 KiB/s wr, 14 op/s 2023-05-08T06:50:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11139.653621 secs 2023-05-08T06:50:01.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:01 smithi186 ceph-mon[126480]: pgmap v5998: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 217 KiB/s wr, 14 op/s 2023-05-08T06:50:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11139.653621 secs 2023-05-08T06:50:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:03 smithi133 ceph-mon[125939]: pgmap v5999: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 145 KiB/s wr, 9 op/s 2023-05-08T06:50:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:03 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:50:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:03 smithi096 ceph-mon[124666]: pgmap v5999: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 145 KiB/s wr, 9 op/s 2023-05-08T06:50:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:03 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:50:03.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:03 smithi186 ceph-mon[126480]: pgmap v5999: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 145 KiB/s wr, 9 op/s 2023-05-08T06:50:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:03 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:50:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11142.813702 secs 2023-05-08T06:50:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:04 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:50:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:04 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:50:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:04 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:50:04.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11143.372463 secs 2023-05-08T06:50:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11142.813702 secs 2023-05-08T06:50:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:04 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:50:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:04 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:50:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:04 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:50:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11143.372463 secs 2023-05-08T06:50:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11142.813702 secs 2023-05-08T06:50:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:04 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:50:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:04 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:50:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:04 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:50:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11143.372463 secs 2023-05-08T06:50:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:05 smithi133 ceph-mon[125939]: pgmap v6000: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 145 KiB/s wr, 9 op/s 2023-05-08T06:50:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:05 smithi096 ceph-mon[124666]: pgmap v6000: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 145 KiB/s wr, 9 op/s 2023-05-08T06:50:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:05 smithi186 ceph-mon[126480]: pgmap v6000: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 145 KiB/s wr, 9 op/s 2023-05-08T06:50:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11144.653760 secs 2023-05-08T06:50:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11144.653760 secs 2023-05-08T06:50:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11144.653760 secs 2023-05-08T06:50:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:07 smithi133 ceph-mon[125939]: pgmap v6001: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 213 KiB/s wr, 28 op/s 2023-05-08T06:50:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:07 smithi096 ceph-mon[124666]: pgmap v6001: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 213 KiB/s wr, 28 op/s 2023-05-08T06:50:07.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:07 smithi186 ceph-mon[126480]: pgmap v6001: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 213 KiB/s wr, 28 op/s 2023-05-08T06:50:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:08 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:50:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:50:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:50:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:08 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:50:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:50:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:50:08.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:08 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:50:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:50:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:50:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:09 smithi133 ceph-mon[125939]: pgmap v6002: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 180 KiB/s wr, 23 op/s 2023-05-08T06:50:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11147.813841 secs 2023-05-08T06:50:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11148.372591 secs 2023-05-08T06:50:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:09 smithi096 ceph-mon[124666]: pgmap v6002: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 180 KiB/s wr, 23 op/s 2023-05-08T06:50:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11147.813841 secs 2023-05-08T06:50:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11148.372591 secs 2023-05-08T06:50:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:09 smithi186 ceph-mon[126480]: pgmap v6002: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 180 KiB/s wr, 23 op/s 2023-05-08T06:50:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11147.813841 secs 2023-05-08T06:50:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11148.372591 secs 2023-05-08T06:50:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:11 smithi133 ceph-mon[125939]: pgmap v6003: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 202 KiB/s wr, 27 op/s 2023-05-08T06:50:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11149.653879 secs 2023-05-08T06:50:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:11 smithi133 ceph-mon[125939]: osdmap e452: 12 total, 12 up, 12 in 2023-05-08T06:50:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:11 smithi096 ceph-mon[124666]: pgmap v6003: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 202 KiB/s wr, 27 op/s 2023-05-08T06:50:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11149.653879 secs 2023-05-08T06:50:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:11 smithi096 ceph-mon[124666]: osdmap e452: 12 total, 12 up, 12 in 2023-05-08T06:50:11.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:11 smithi186 ceph-mon[126480]: pgmap v6003: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 202 KiB/s wr, 27 op/s 2023-05-08T06:50:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11149.653879 secs 2023-05-08T06:50:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:11 smithi186 ceph-mon[126480]: osdmap e452: 12 total, 12 up, 12 in 2023-05-08T06:50:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:13 smithi133 ceph-mon[125939]: pgmap v6005: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 108 KiB/s wr, 26 op/s 2023-05-08T06:50:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:13 smithi096 ceph-mon[124666]: pgmap v6005: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 108 KiB/s wr, 26 op/s 2023-05-08T06:50:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:13 smithi186 ceph-mon[126480]: pgmap v6005: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 108 KiB/s wr, 26 op/s 2023-05-08T06:50:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11152.813939 secs 2023-05-08T06:50:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11153.372674 secs 2023-05-08T06:50:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11152.813939 secs 2023-05-08T06:50:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11153.372674 secs 2023-05-08T06:50:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11152.813939 secs 2023-05-08T06:50:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11153.372674 secs 2023-05-08T06:50:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:15 smithi096 ceph-mon[124666]: pgmap v6006: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 108 KiB/s wr, 26 op/s 2023-05-08T06:50:15.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:15 smithi186 ceph-mon[126480]: pgmap v6006: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 108 KiB/s wr, 26 op/s 2023-05-08T06:50:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:15 smithi133 ceph-mon[125939]: pgmap v6006: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 108 KiB/s wr, 26 op/s 2023-05-08T06:50:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11154.653989 secs 2023-05-08T06:50:16.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11154.653989 secs 2023-05-08T06:50:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11154.653989 secs 2023-05-08T06:50:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:17 smithi096 ceph-mon[124666]: pgmap v6007: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 7 op/s 2023-05-08T06:50:17.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:17 smithi186 ceph-mon[126480]: pgmap v6007: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 7 op/s 2023-05-08T06:50:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:17 smithi133 ceph-mon[125939]: pgmap v6007: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 7 op/s 2023-05-08T06:50:19.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:19 smithi186 ceph-mon[126480]: pgmap v6008: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 7 op/s 2023-05-08T06:50:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11157.814064 secs 2023-05-08T06:50:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11158.372758 secs 2023-05-08T06:50:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:19 smithi133 ceph-mon[125939]: pgmap v6008: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 7 op/s 2023-05-08T06:50:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11157.814064 secs 2023-05-08T06:50:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11158.372758 secs 2023-05-08T06:50:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:19 smithi096 ceph-mon[124666]: pgmap v6008: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 7 op/s 2023-05-08T06:50:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11157.814064 secs 2023-05-08T06:50:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11158.372758 secs 2023-05-08T06:50:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:21 smithi186 ceph-mon[126480]: pgmap v6009: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6.0 KiB/s wr, 7 op/s 2023-05-08T06:50:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11159.654099 secs 2023-05-08T06:50:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:21 smithi186 ceph-mon[126480]: osdmap e453: 12 total, 12 up, 12 in 2023-05-08T06:50:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:21 smithi133 ceph-mon[125939]: pgmap v6009: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6.0 KiB/s wr, 7 op/s 2023-05-08T06:50:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11159.654099 secs 2023-05-08T06:50:21.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:21 smithi133 ceph-mon[125939]: osdmap e453: 12 total, 12 up, 12 in 2023-05-08T06:50:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:21 smithi096 ceph-mon[124666]: pgmap v6009: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6.0 KiB/s wr, 7 op/s 2023-05-08T06:50:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11159.654099 secs 2023-05-08T06:50:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:21 smithi096 ceph-mon[124666]: osdmap e453: 12 total, 12 up, 12 in 2023-05-08T06:50:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:22 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:50:22.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:22 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:50:22.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:22 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:50:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:23 smithi186 ceph-mon[126480]: pgmap v6011: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6.0 KiB/s wr, 7 op/s 2023-05-08T06:50:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:50:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:50:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:50:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:23 smithi133 ceph-mon[125939]: pgmap v6011: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6.0 KiB/s wr, 7 op/s 2023-05-08T06:50:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:50:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:50:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:50:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:23 smithi096 ceph-mon[124666]: pgmap v6011: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6.0 KiB/s wr, 7 op/s 2023-05-08T06:50:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:50:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:50:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:50:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:24 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:50:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:24 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T06:50:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:24 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T06:50:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:24 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:50:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11162.814182 secs 2023-05-08T06:50:24.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11163.372905 secs 2023-05-08T06:50:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:24 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:50:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:24 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T06:50:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:24 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T06:50:24.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:24 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:50:24.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11162.814182 secs 2023-05-08T06:50:24.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11163.372905 secs 2023-05-08T06:50:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:24 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:50:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:24 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T06:50:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:24 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T06:50:24.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:24 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:50:24.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11162.814182 secs 2023-05-08T06:50:24.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11163.372905 secs 2023-05-08T06:50:25.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:25 smithi186 ceph-mon[126480]: pgmap v6012: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6.0 KiB/s wr, 7 op/s 2023-05-08T06:50:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:25 smithi133 ceph-mon[125939]: pgmap v6012: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6.0 KiB/s wr, 7 op/s 2023-05-08T06:50:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:25 smithi096 ceph-mon[124666]: pgmap v6012: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6.0 KiB/s wr, 7 op/s 2023-05-08T06:50:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11164.654247 secs 2023-05-08T06:50:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11164.654247 secs 2023-05-08T06:50:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11164.654247 secs 2023-05-08T06:50:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:27 smithi186 ceph-mon[126480]: pgmap v6013: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 6.4 KiB/s wr, 8 op/s 2023-05-08T06:50:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:27 smithi133 ceph-mon[125939]: pgmap v6013: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 6.4 KiB/s wr, 8 op/s 2023-05-08T06:50:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:27 smithi096 ceph-mon[124666]: pgmap v6013: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 6.4 KiB/s wr, 8 op/s 2023-05-08T06:50:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:29 smithi186 ceph-mon[126480]: pgmap v6014: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 6.3 KiB/s wr, 8 op/s 2023-05-08T06:50:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11167.814301 secs 2023-05-08T06:50:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11168.373050 secs 2023-05-08T06:50:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:29 smithi133 ceph-mon[125939]: pgmap v6014: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 6.3 KiB/s wr, 8 op/s 2023-05-08T06:50:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11167.814301 secs 2023-05-08T06:50:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11168.373050 secs 2023-05-08T06:50:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:29 smithi096 ceph-mon[124666]: pgmap v6014: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 6.3 KiB/s wr, 8 op/s 2023-05-08T06:50:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11167.814301 secs 2023-05-08T06:50:29.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11168.373050 secs 2023-05-08T06:50:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:31 smithi186 ceph-mon[126480]: pgmap v6015: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 63 KiB/s wr, 8 op/s 2023-05-08T06:50:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11169.654385 secs 2023-05-08T06:50:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:31 smithi133 ceph-mon[125939]: pgmap v6015: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 63 KiB/s wr, 8 op/s 2023-05-08T06:50:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11169.654385 secs 2023-05-08T06:50:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:31 smithi096 ceph-mon[124666]: pgmap v6015: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 63 KiB/s wr, 8 op/s 2023-05-08T06:50:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11169.654385 secs 2023-05-08T06:50:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:33 smithi186 ceph-mon[126480]: pgmap v6016: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 58 KiB/s wr, 8 op/s 2023-05-08T06:50:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:33 smithi133 ceph-mon[125939]: pgmap v6016: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 58 KiB/s wr, 8 op/s 2023-05-08T06:50:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:33 smithi096 ceph-mon[124666]: pgmap v6016: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 58 KiB/s wr, 8 op/s 2023-05-08T06:50:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11172.814378 secs 2023-05-08T06:50:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11173.373193 secs 2023-05-08T06:50:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11172.814378 secs 2023-05-08T06:50:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11173.373193 secs 2023-05-08T06:50:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11172.814378 secs 2023-05-08T06:50:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11173.373193 secs 2023-05-08T06:50:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:35 smithi186 ceph-mon[126480]: pgmap v6017: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 53 KiB/s wr, 7 op/s 2023-05-08T06:50:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:35 smithi133 ceph-mon[125939]: pgmap v6017: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 53 KiB/s wr, 7 op/s 2023-05-08T06:50:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:35 smithi096 ceph-mon[124666]: pgmap v6017: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 53 KiB/s wr, 7 op/s 2023-05-08T06:50:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11174.654563 secs 2023-05-08T06:50:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11174.654563 secs 2023-05-08T06:50:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11174.654563 secs 2023-05-08T06:50:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:37 smithi186 ceph-mon[126480]: pgmap v6018: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 53 KiB/s wr, 10 op/s 2023-05-08T06:50:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:37 smithi133 ceph-mon[125939]: pgmap v6018: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 53 KiB/s wr, 10 op/s 2023-05-08T06:50:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:37 smithi096 ceph-mon[124666]: pgmap v6018: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 53 KiB/s wr, 10 op/s 2023-05-08T06:50:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:39 smithi186 ceph-mon[126480]: pgmap v6019: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 KiB/s wr, 6 op/s 2023-05-08T06:50:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11177.814492 secs 2023-05-08T06:50:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11178.373320 secs 2023-05-08T06:50:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:39 smithi133 ceph-mon[125939]: pgmap v6019: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 KiB/s wr, 6 op/s 2023-05-08T06:50:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11177.814492 secs 2023-05-08T06:50:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11178.373320 secs 2023-05-08T06:50:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:39 smithi096 ceph-mon[124666]: pgmap v6019: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 KiB/s wr, 6 op/s 2023-05-08T06:50:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11177.814492 secs 2023-05-08T06:50:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11178.373320 secs 2023-05-08T06:50:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:41 smithi186 ceph-mon[126480]: pgmap v6020: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 84 KiB/s wr, 10 op/s 2023-05-08T06:50:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11179.654684 secs 2023-05-08T06:50:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:41 smithi133 ceph-mon[125939]: pgmap v6020: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 84 KiB/s wr, 10 op/s 2023-05-08T06:50:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11179.654684 secs 2023-05-08T06:50:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:41 smithi096 ceph-mon[124666]: pgmap v6020: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 84 KiB/s wr, 10 op/s 2023-05-08T06:50:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11179.654684 secs 2023-05-08T06:50:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:43 smithi186 ceph-mon[126480]: pgmap v6021: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T06:50:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:43 smithi133 ceph-mon[125939]: pgmap v6021: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T06:50:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:43 smithi096 ceph-mon[124666]: pgmap v6021: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T06:50:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11182.814607 secs 2023-05-08T06:50:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11182.814607 secs 2023-05-08T06:50:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11182.814607 secs 2023-05-08T06:50:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:45 smithi186 ceph-mon[126480]: pgmap v6022: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T06:50:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:45 smithi133 ceph-mon[125939]: pgmap v6022: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T06:50:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:45 smithi096 ceph-mon[124666]: pgmap v6022: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T06:50:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11184.654858 secs 2023-05-08T06:50:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11184.654858 secs 2023-05-08T06:50:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11184.654858 secs 2023-05-08T06:50:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:47 smithi186 ceph-mon[126480]: pgmap v6023: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 84 KiB/s wr, 9 op/s 2023-05-08T06:50:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:50:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:47 smithi133 ceph-mon[125939]: pgmap v6023: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 84 KiB/s wr, 9 op/s 2023-05-08T06:50:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:50:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:47 smithi096 ceph-mon[124666]: pgmap v6023: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 84 KiB/s wr, 9 op/s 2023-05-08T06:50:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:50:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:48 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:50:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:50:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:50:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:48 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:50:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:50:48.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:50:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:48 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:50:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:50:48.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:50:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:49 smithi186 ceph-mon[126480]: pgmap v6024: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 84 KiB/s wr, 6 op/s 2023-05-08T06:50:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11187.814738 secs 2023-05-08T06:50:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11188.373568 secs 2023-05-08T06:50:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:49 smithi133 ceph-mon[125939]: pgmap v6024: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 84 KiB/s wr, 6 op/s 2023-05-08T06:50:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11187.814738 secs 2023-05-08T06:50:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11188.373568 secs 2023-05-08T06:50:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:49 smithi096 ceph-mon[124666]: pgmap v6024: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 84 KiB/s wr, 6 op/s 2023-05-08T06:50:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11187.814738 secs 2023-05-08T06:50:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11188.373568 secs 2023-05-08T06:50:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:51 smithi186 ceph-mon[126480]: pgmap v6025: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 178 KiB/s wr, 12 op/s 2023-05-08T06:50:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:50:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:51 smithi133 ceph-mon[125939]: pgmap v6025: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 178 KiB/s wr, 12 op/s 2023-05-08T06:50:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:50:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:51 smithi096 ceph-mon[124666]: pgmap v6025: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 178 KiB/s wr, 12 op/s 2023-05-08T06:50:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:50:52.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:50:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:50:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:50:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:52 smithi186 ceph-mon[126480]: pgmap v6026: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 146 KiB/s wr, 8 op/s 2023-05-08T06:50:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:50:52.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:50:52.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:50:52.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:52 smithi133 ceph-mon[125939]: pgmap v6026: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 146 KiB/s wr, 8 op/s 2023-05-08T06:50:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:50:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:50:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:50:52.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:52 smithi096 ceph-mon[124666]: pgmap v6026: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 146 KiB/s wr, 8 op/s 2023-05-08T06:50:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11192.814894 secs 2023-05-08T06:50:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:54 smithi133 ceph-mon[125939]: pgmap v6027: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 146 KiB/s wr, 8 op/s 2023-05-08T06:50:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11193.373682 secs 2023-05-08T06:50:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11192.814894 secs 2023-05-08T06:50:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:54 smithi096 ceph-mon[124666]: pgmap v6027: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 146 KiB/s wr, 8 op/s 2023-05-08T06:50:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11193.373682 secs 2023-05-08T06:50:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11192.814894 secs 2023-05-08T06:50:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:54 smithi186 ceph-mon[126480]: pgmap v6027: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 146 KiB/s wr, 8 op/s 2023-05-08T06:50:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11193.373682 secs 2023-05-08T06:50:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:56 smithi186 ceph-mon[126480]: pgmap v6028: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 158 KiB/s wr, 13 op/s 2023-05-08T06:50:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:56 smithi133 ceph-mon[125939]: pgmap v6028: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 158 KiB/s wr, 13 op/s 2023-05-08T06:50:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:56 smithi096 ceph-mon[124666]: pgmap v6028: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 158 KiB/s wr, 13 op/s 2023-05-08T06:50:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:58 smithi186 ceph-mon[126480]: pgmap v6029: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 105 KiB/s wr, 10 op/s 2023-05-08T06:50:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:58 smithi133 ceph-mon[125939]: pgmap v6029: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 105 KiB/s wr, 10 op/s 2023-05-08T06:50:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:58 smithi096 ceph-mon[124666]: pgmap v6029: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 105 KiB/s wr, 10 op/s 2023-05-08T06:50:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11197.814975 secs 2023-05-08T06:50:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:50:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11198.373800 secs 2023-05-08T06:50:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11197.814975 secs 2023-05-08T06:50:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:50:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11198.373800 secs 2023-05-08T06:51:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11197.814975 secs 2023-05-08T06:51:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:50:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11198.373800 secs 2023-05-08T06:51:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:00 smithi186 ceph-mon[126480]: pgmap v6030: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 230 KiB/s wr, 14 op/s 2023-05-08T06:51:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:00 smithi133 ceph-mon[125939]: pgmap v6030: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 230 KiB/s wr, 14 op/s 2023-05-08T06:51:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:00 smithi096 ceph-mon[124666]: pgmap v6030: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 230 KiB/s wr, 14 op/s 2023-05-08T06:51:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:02 smithi186 ceph-mon[126480]: pgmap v6031: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 137 KiB/s wr, 9 op/s 2023-05-08T06:51:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:02 smithi133 ceph-mon[125939]: pgmap v6031: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 137 KiB/s wr, 9 op/s 2023-05-08T06:51:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:02 smithi096 ceph-mon[124666]: pgmap v6031: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 137 KiB/s wr, 9 op/s 2023-05-08T06:51:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11202.815127 secs 2023-05-08T06:51:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:04 smithi186 ceph-mon[126480]: pgmap v6032: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 137 KiB/s wr, 9 op/s 2023-05-08T06:51:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11203.373919 secs 2023-05-08T06:51:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11202.815127 secs 2023-05-08T06:51:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:04 smithi133 ceph-mon[125939]: pgmap v6032: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 137 KiB/s wr, 9 op/s 2023-05-08T06:51:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11203.373919 secs 2023-05-08T06:51:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11202.815127 secs 2023-05-08T06:51:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:04 smithi096 ceph-mon[124666]: pgmap v6032: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 137 KiB/s wr, 9 op/s 2023-05-08T06:51:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11203.373919 secs 2023-05-08T06:51:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11204.655410 secs 2023-05-08T06:51:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11204.655410 secs 2023-05-08T06:51:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11204.655410 secs 2023-05-08T06:51:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:06 smithi186 ceph-mon[126480]: pgmap v6033: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 193 KiB/s wr, 28 op/s 2023-05-08T06:51:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:06 smithi133 ceph-mon[125939]: pgmap v6033: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 193 KiB/s wr, 28 op/s 2023-05-08T06:51:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:06 smithi096 ceph-mon[124666]: pgmap v6033: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 193 KiB/s wr, 28 op/s 2023-05-08T06:51:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:07 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:51:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:07 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:51:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:07 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:51:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:07 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:51:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:07 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:51:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:07 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:51:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:07 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:51:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:07 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:51:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:07 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:51:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:08 smithi186 ceph-mon[126480]: pgmap v6034: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 181 KiB/s wr, 24 op/s 2023-05-08T06:51:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:08 smithi133 ceph-mon[125939]: pgmap v6034: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 181 KiB/s wr, 24 op/s 2023-05-08T06:51:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:08 smithi096 ceph-mon[124666]: pgmap v6034: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 181 KiB/s wr, 24 op/s 2023-05-08T06:51:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11207.815242 secs 2023-05-08T06:51:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11208.374045 secs 2023-05-08T06:51:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11207.815242 secs 2023-05-08T06:51:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11208.374045 secs 2023-05-08T06:51:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11207.815242 secs 2023-05-08T06:51:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11208.374045 secs 2023-05-08T06:51:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:10 smithi186 ceph-mon[126480]: pgmap v6035: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 268 KiB/s wr, 28 op/s 2023-05-08T06:51:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11209.655554 secs 2023-05-08T06:51:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:10 smithi133 ceph-mon[125939]: pgmap v6035: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 268 KiB/s wr, 28 op/s 2023-05-08T06:51:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11209.655554 secs 2023-05-08T06:51:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:10 smithi096 ceph-mon[124666]: pgmap v6035: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 268 KiB/s wr, 28 op/s 2023-05-08T06:51:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11209.655554 secs 2023-05-08T06:51:11.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:11 smithi186 ceph-mon[126480]: osdmap e454: 12 total, 12 up, 12 in 2023-05-08T06:51:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:11 smithi133 ceph-mon[125939]: osdmap e454: 12 total, 12 up, 12 in 2023-05-08T06:51:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:11 smithi096 ceph-mon[124666]: osdmap e454: 12 total, 12 up, 12 in 2023-05-08T06:51:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:12 smithi133 ceph-mon[125939]: pgmap v6037: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 172 KiB/s wr, 28 op/s 2023-05-08T06:51:13.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:12 smithi096 ceph-mon[124666]: pgmap v6037: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 172 KiB/s wr, 28 op/s 2023-05-08T06:51:13.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:12 smithi186 ceph-mon[126480]: pgmap v6037: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 172 KiB/s wr, 28 op/s 2023-05-08T06:51:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11212.815404 secs 2023-05-08T06:51:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:14 smithi133 ceph-mon[125939]: pgmap v6038: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 172 KiB/s wr, 28 op/s 2023-05-08T06:51:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11213.374168 secs 2023-05-08T06:51:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11212.815404 secs 2023-05-08T06:51:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:14 smithi096 ceph-mon[124666]: pgmap v6038: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 172 KiB/s wr, 28 op/s 2023-05-08T06:51:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11213.374168 secs 2023-05-08T06:51:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11212.815404 secs 2023-05-08T06:51:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:14 smithi186 ceph-mon[126480]: pgmap v6038: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 172 KiB/s wr, 28 op/s 2023-05-08T06:51:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11213.374168 secs 2023-05-08T06:51:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11214.655685 secs 2023-05-08T06:51:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11214.655685 secs 2023-05-08T06:51:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11214.655685 secs 2023-05-08T06:51:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:16 smithi133 ceph-mon[125939]: pgmap v6039: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 105 KiB/s wr, 8 op/s 2023-05-08T06:51:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:16 smithi096 ceph-mon[124666]: pgmap v6039: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 105 KiB/s wr, 8 op/s 2023-05-08T06:51:17.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:16 smithi186 ceph-mon[126480]: pgmap v6039: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 105 KiB/s wr, 8 op/s 2023-05-08T06:51:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:18 smithi133 ceph-mon[125939]: pgmap v6040: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 105 KiB/s wr, 8 op/s 2023-05-08T06:51:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:18 smithi096 ceph-mon[124666]: pgmap v6040: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 105 KiB/s wr, 8 op/s 2023-05-08T06:51:19.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:18 smithi186 ceph-mon[126480]: pgmap v6040: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 105 KiB/s wr, 8 op/s 2023-05-08T06:51:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11217.815510 secs 2023-05-08T06:51:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11218.374310 secs 2023-05-08T06:51:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11217.815510 secs 2023-05-08T06:51:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11218.374310 secs 2023-05-08T06:51:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11217.815510 secs 2023-05-08T06:51:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11218.374310 secs 2023-05-08T06:51:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:20 smithi133 ceph-mon[125939]: pgmap v6041: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 7 op/s 2023-05-08T06:51:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11219.655814 secs 2023-05-08T06:51:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:20 smithi133 ceph-mon[125939]: osdmap e455: 12 total, 12 up, 12 in 2023-05-08T06:51:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:20 smithi096 ceph-mon[124666]: pgmap v6041: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 7 op/s 2023-05-08T06:51:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11219.655814 secs 2023-05-08T06:51:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:20 smithi096 ceph-mon[124666]: osdmap e455: 12 total, 12 up, 12 in 2023-05-08T06:51:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:20 smithi186 ceph-mon[126480]: pgmap v6041: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 7 op/s 2023-05-08T06:51:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11219.655814 secs 2023-05-08T06:51:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:20 smithi186 ceph-mon[126480]: osdmap e455: 12 total, 12 up, 12 in 2023-05-08T06:51:22.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:22 smithi133 ceph-mon[125939]: pgmap v6043: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 7 op/s 2023-05-08T06:51:22.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:22 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:51:23.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:22 smithi096 ceph-mon[124666]: pgmap v6043: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 7 op/s 2023-05-08T06:51:23.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:22 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:51:23.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:22 smithi186 ceph-mon[126480]: pgmap v6043: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 7 op/s 2023-05-08T06:51:23.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:22 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:51:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:51:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:51:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:23 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:51:23.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:51:23.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:23 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T06:51:23.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:23 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T06:51:23.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:23 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:51:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:51:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:51:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:23 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:51:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:51:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:23 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T06:51:24.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:23 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T06:51:24.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:23 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:51:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:51:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:51:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:23 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:51:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:51:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:23 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T06:51:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:23 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T06:51:24.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:23 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:51:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11222.815577 secs 2023-05-08T06:51:24.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:24 smithi133 ceph-mon[125939]: pgmap v6044: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 7 op/s 2023-05-08T06:51:24.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11223.374458 secs 2023-05-08T06:51:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11222.815577 secs 2023-05-08T06:51:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:24 smithi096 ceph-mon[124666]: pgmap v6044: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 7 op/s 2023-05-08T06:51:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11223.374458 secs 2023-05-08T06:51:25.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11222.815577 secs 2023-05-08T06:51:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:24 smithi186 ceph-mon[126480]: pgmap v6044: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 7 op/s 2023-05-08T06:51:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11223.374458 secs 2023-05-08T06:51:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11224.655943 secs 2023-05-08T06:51:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11224.655943 secs 2023-05-08T06:51:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11224.655943 secs 2023-05-08T06:51:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:26 smithi133 ceph-mon[125939]: pgmap v6045: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 8 op/s 2023-05-08T06:51:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:26 smithi096 ceph-mon[124666]: pgmap v6045: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 8 op/s 2023-05-08T06:51:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:26 smithi186 ceph-mon[126480]: pgmap v6045: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 8 op/s 2023-05-08T06:51:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:28 smithi133 ceph-mon[125939]: pgmap v6046: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 8 op/s 2023-05-08T06:51:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:28 smithi096 ceph-mon[124666]: pgmap v6046: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 8 op/s 2023-05-08T06:51:29.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:28 smithi186 ceph-mon[126480]: pgmap v6046: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 8 op/s 2023-05-08T06:51:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11227.815716 secs 2023-05-08T06:51:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11228.374582 secs 2023-05-08T06:51:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11227.815716 secs 2023-05-08T06:51:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11228.374582 secs 2023-05-08T06:51:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11227.815716 secs 2023-05-08T06:51:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11228.374582 secs 2023-05-08T06:51:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:30 smithi133 ceph-mon[125939]: pgmap v6047: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 66 KiB/s wr, 8 op/s 2023-05-08T06:51:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11229.656095 secs 2023-05-08T06:51:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:30 smithi096 ceph-mon[124666]: pgmap v6047: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 66 KiB/s wr, 8 op/s 2023-05-08T06:51:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11229.656095 secs 2023-05-08T06:51:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:30 smithi186 ceph-mon[126480]: pgmap v6047: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 66 KiB/s wr, 8 op/s 2023-05-08T06:51:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11229.656095 secs 2023-05-08T06:51:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:32 smithi133 ceph-mon[125939]: pgmap v6048: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 61 KiB/s wr, 7 op/s 2023-05-08T06:51:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:32 smithi096 ceph-mon[124666]: pgmap v6048: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 61 KiB/s wr, 7 op/s 2023-05-08T06:51:33.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:32 smithi186 ceph-mon[126480]: pgmap v6048: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 61 KiB/s wr, 7 op/s 2023-05-08T06:51:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11232.815843 secs 2023-05-08T06:51:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11232.815843 secs 2023-05-08T06:51:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11232.815843 secs 2023-05-08T06:51:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:34 smithi133 ceph-mon[125939]: pgmap v6049: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 55 KiB/s wr, 6 op/s 2023-05-08T06:51:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11233.374714 secs 2023-05-08T06:51:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:34 smithi096 ceph-mon[124666]: pgmap v6049: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 55 KiB/s wr, 6 op/s 2023-05-08T06:51:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11233.374714 secs 2023-05-08T06:51:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:34 smithi186 ceph-mon[126480]: pgmap v6049: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 55 KiB/s wr, 6 op/s 2023-05-08T06:51:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11233.374714 secs 2023-05-08T06:51:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11234.656216 secs 2023-05-08T06:51:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11234.656216 secs 2023-05-08T06:51:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11234.656216 secs 2023-05-08T06:51:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:36 smithi133 ceph-mon[125939]: pgmap v6050: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 56 KiB/s wr, 10 op/s 2023-05-08T06:51:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:36 smithi096 ceph-mon[124666]: pgmap v6050: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 56 KiB/s wr, 10 op/s 2023-05-08T06:51:37.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:36 smithi186 ceph-mon[126480]: pgmap v6050: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 56 KiB/s wr, 10 op/s 2023-05-08T06:51:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:38 smithi133 ceph-mon[125939]: pgmap v6051: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 6 op/s 2023-05-08T06:51:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11237.815965 secs 2023-05-08T06:51:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:38 smithi096 ceph-mon[124666]: pgmap v6051: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 6 op/s 2023-05-08T06:51:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11237.815965 secs 2023-05-08T06:51:39.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:38 smithi186 ceph-mon[126480]: pgmap v6051: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 6 op/s 2023-05-08T06:51:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11237.815965 secs 2023-05-08T06:51:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11238.374835 secs 2023-05-08T06:51:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11238.374835 secs 2023-05-08T06:51:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11238.374835 secs 2023-05-08T06:51:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:40 smithi133 ceph-mon[125939]: pgmap v6052: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 107 KiB/s wr, 11 op/s 2023-05-08T06:51:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11239.656321 secs 2023-05-08T06:51:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:40 smithi096 ceph-mon[124666]: pgmap v6052: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 107 KiB/s wr, 11 op/s 2023-05-08T06:51:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11239.656321 secs 2023-05-08T06:51:41.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:40 smithi186 ceph-mon[126480]: pgmap v6052: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 107 KiB/s wr, 11 op/s 2023-05-08T06:51:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11239.656321 secs 2023-05-08T06:51:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:42 smithi133 ceph-mon[125939]: pgmap v6053: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 78 KiB/s wr, 7 op/s 2023-05-08T06:51:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:42 smithi096 ceph-mon[124666]: pgmap v6053: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 78 KiB/s wr, 7 op/s 2023-05-08T06:51:43.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:42 smithi186 ceph-mon[126480]: pgmap v6053: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 78 KiB/s wr, 7 op/s 2023-05-08T06:51:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11242.816095 secs 2023-05-08T06:51:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11242.816095 secs 2023-05-08T06:51:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11242.816095 secs 2023-05-08T06:51:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:44 smithi133 ceph-mon[125939]: pgmap v6054: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 78 KiB/s wr, 7 op/s 2023-05-08T06:51:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:44 smithi096 ceph-mon[124666]: pgmap v6054: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 78 KiB/s wr, 7 op/s 2023-05-08T06:51:45.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:44 smithi186 ceph-mon[126480]: pgmap v6054: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 78 KiB/s wr, 7 op/s 2023-05-08T06:51:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:46 smithi133 ceph-mon[125939]: pgmap v6055: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 161 KiB/s wr, 12 op/s 2023-05-08T06:51:46.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:46 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:51:46.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:46 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:51:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:46 smithi096 ceph-mon[124666]: pgmap v6055: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 161 KiB/s wr, 12 op/s 2023-05-08T06:51:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:46 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:51:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:46 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:51:47.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:46 smithi186 ceph-mon[126480]: pgmap v6055: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 161 KiB/s wr, 12 op/s 2023-05-08T06:51:47.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:46 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:51:47.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:46 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:51:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:47 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:51:47.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:47 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:51:47.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:47 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:51:47.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:47 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:51:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:47 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:51:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:47 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:51:48.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:47 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:51:48.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:47 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:51:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:47 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:51:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:47 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:51:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:47 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:51:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:47 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:51:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:48 smithi133 ceph-mon[125939]: pgmap v6056: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 161 KiB/s wr, 9 op/s 2023-05-08T06:51:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11247.816233 secs 2023-05-08T06:51:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:48 smithi096 ceph-mon[124666]: pgmap v6056: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 161 KiB/s wr, 9 op/s 2023-05-08T06:51:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11247.816233 secs 2023-05-08T06:51:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:48 smithi186 ceph-mon[126480]: pgmap v6056: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 161 KiB/s wr, 9 op/s 2023-05-08T06:51:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11247.816233 secs 2023-05-08T06:51:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11248.375080 secs 2023-05-08T06:51:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11248.375080 secs 2023-05-08T06:51:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11248.375080 secs 2023-05-08T06:51:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:50 smithi096 ceph-mon[124666]: pgmap v6057: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 258 KiB/s wr, 13 op/s 2023-05-08T06:51:51.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:50 smithi186 ceph-mon[126480]: pgmap v6057: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 258 KiB/s wr, 13 op/s 2023-05-08T06:51:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:50 smithi133 ceph-mon[125939]: pgmap v6057: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 258 KiB/s wr, 13 op/s 2023-05-08T06:51:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:51:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:51:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:51:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:51:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:51:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:51:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:52 smithi186 ceph-mon[126480]: pgmap v6058: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 181 KiB/s wr, 9 op/s 2023-05-08T06:51:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:52 smithi133 ceph-mon[125939]: pgmap v6058: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 181 KiB/s wr, 9 op/s 2023-05-08T06:51:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:52 smithi096 ceph-mon[124666]: pgmap v6058: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 181 KiB/s wr, 9 op/s 2023-05-08T06:51:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11252.816343 secs 2023-05-08T06:51:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11252.816343 secs 2023-05-08T06:51:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11252.816343 secs 2023-05-08T06:51:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:54 smithi186 ceph-mon[126480]: pgmap v6059: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 181 KiB/s wr, 9 op/s 2023-05-08T06:51:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:54 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:51:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:54 smithi133 ceph-mon[125939]: pgmap v6059: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 181 KiB/s wr, 9 op/s 2023-05-08T06:51:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:54 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:51:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:54 smithi096 ceph-mon[124666]: pgmap v6059: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 181 KiB/s wr, 9 op/s 2023-05-08T06:51:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:54 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:51:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:55 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:51:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:55 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:51:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:55 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:51:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:55 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:51:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:55 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:51:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:55 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:51:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:55 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:51:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:55 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:51:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:55 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:51:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:56 smithi186 ceph-mon[126480]: pgmap v6060: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 191 KiB/s wr, 13 op/s 2023-05-08T06:51:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:56 smithi133 ceph-mon[125939]: pgmap v6060: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 191 KiB/s wr, 13 op/s 2023-05-08T06:51:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:56 smithi096 ceph-mon[124666]: pgmap v6060: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 191 KiB/s wr, 13 op/s 2023-05-08T06:51:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:58 smithi186 ceph-mon[126480]: pgmap v6061: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 108 KiB/s wr, 9 op/s 2023-05-08T06:51:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11257.816473 secs 2023-05-08T06:51:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:58 smithi133 ceph-mon[125939]: pgmap v6061: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 108 KiB/s wr, 9 op/s 2023-05-08T06:51:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11257.816473 secs 2023-05-08T06:51:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:58 smithi096 ceph-mon[124666]: pgmap v6061: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 108 KiB/s wr, 9 op/s 2023-05-08T06:51:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11257.816473 secs 2023-05-08T06:52:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:51:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11258.375329 secs 2023-05-08T06:52:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:51:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11258.375329 secs 2023-05-08T06:52:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:51:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11258.375329 secs 2023-05-08T06:52:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:00 smithi186 ceph-mon[126480]: pgmap v6062: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 207 KiB/s wr, 13 op/s 2023-05-08T06:52:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11259.656861 secs 2023-05-08T06:52:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:00 smithi133 ceph-mon[125939]: pgmap v6062: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 207 KiB/s wr, 13 op/s 2023-05-08T06:52:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11259.656861 secs 2023-05-08T06:52:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:00 smithi096 ceph-mon[124666]: pgmap v6062: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 207 KiB/s wr, 13 op/s 2023-05-08T06:52:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11259.656861 secs 2023-05-08T06:52:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:02 smithi186 ceph-mon[126480]: pgmap v6063: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 110 KiB/s wr, 8 op/s 2023-05-08T06:52:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:02 smithi133 ceph-mon[125939]: pgmap v6063: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 110 KiB/s wr, 8 op/s 2023-05-08T06:52:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:02 smithi096 ceph-mon[124666]: pgmap v6063: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 110 KiB/s wr, 8 op/s 2023-05-08T06:52:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:03 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:52:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:52:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:52:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:03 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:52:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11262.816594 secs 2023-05-08T06:52:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:03 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:52:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:52:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:52:04.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:03 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:52:04.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11262.816594 secs 2023-05-08T06:52:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:03 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:52:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:52:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:52:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:03 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:52:04.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11262.816594 secs 2023-05-08T06:52:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:04 smithi186 ceph-mon[126480]: pgmap v6064: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 110 KiB/s wr, 8 op/s 2023-05-08T06:52:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11263.375480 secs 2023-05-08T06:52:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:04 smithi133 ceph-mon[125939]: pgmap v6064: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 110 KiB/s wr, 8 op/s 2023-05-08T06:52:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11263.375480 secs 2023-05-08T06:52:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:04 smithi096 ceph-mon[124666]: pgmap v6064: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 110 KiB/s wr, 8 op/s 2023-05-08T06:52:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11263.375480 secs 2023-05-08T06:52:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11264.657002 secs 2023-05-08T06:52:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11264.657002 secs 2023-05-08T06:52:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11264.657002 secs 2023-05-08T06:52:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:06 smithi186 ceph-mon[126480]: pgmap v6065: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 155 KiB/s wr, 26 op/s 2023-05-08T06:52:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:06 smithi133 ceph-mon[125939]: pgmap v6065: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 155 KiB/s wr, 26 op/s 2023-05-08T06:52:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:06 smithi096 ceph-mon[124666]: pgmap v6065: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 155 KiB/s wr, 26 op/s 2023-05-08T06:52:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:08 smithi186 ceph-mon[126480]: pgmap v6066: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 144 KiB/s wr, 22 op/s 2023-05-08T06:52:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11267.816686 secs 2023-05-08T06:52:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:08 smithi133 ceph-mon[125939]: pgmap v6066: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 144 KiB/s wr, 22 op/s 2023-05-08T06:52:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11267.816686 secs 2023-05-08T06:52:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:08 smithi096 ceph-mon[124666]: pgmap v6066: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 144 KiB/s wr, 22 op/s 2023-05-08T06:52:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11267.816686 secs 2023-05-08T06:52:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11268.375590 secs 2023-05-08T06:52:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11268.375590 secs 2023-05-08T06:52:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11268.375590 secs 2023-05-08T06:52:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:10 smithi186 ceph-mon[126480]: pgmap v6067: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 172 KiB/s wr, 25 op/s 2023-05-08T06:52:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11269.657082 secs 2023-05-08T06:52:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:10 smithi133 ceph-mon[125939]: pgmap v6067: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 172 KiB/s wr, 25 op/s 2023-05-08T06:52:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11269.657082 secs 2023-05-08T06:52:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:10 smithi096 ceph-mon[124666]: pgmap v6067: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 172 KiB/s wr, 25 op/s 2023-05-08T06:52:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11269.657082 secs 2023-05-08T06:52:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:11 smithi186 ceph-mon[126480]: osdmap e456: 12 total, 12 up, 12 in 2023-05-08T06:52:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:11 smithi133 ceph-mon[125939]: osdmap e456: 12 total, 12 up, 12 in 2023-05-08T06:52:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:11 smithi096 ceph-mon[124666]: osdmap e456: 12 total, 12 up, 12 in 2023-05-08T06:52:13.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:12 smithi186 ceph-mon[126480]: pgmap v6069: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 88 KiB/s wr, 25 op/s 2023-05-08T06:52:13.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:12 smithi133 ceph-mon[125939]: pgmap v6069: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 88 KiB/s wr, 25 op/s 2023-05-08T06:52:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:12 smithi096 ceph-mon[124666]: pgmap v6069: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 88 KiB/s wr, 25 op/s 2023-05-08T06:52:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11272.816807 secs 2023-05-08T06:52:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11272.816807 secs 2023-05-08T06:52:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11272.816807 secs 2023-05-08T06:52:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:14 smithi186 ceph-mon[126480]: pgmap v6070: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 88 KiB/s wr, 25 op/s 2023-05-08T06:52:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11273.375668 secs 2023-05-08T06:52:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:14 smithi133 ceph-mon[125939]: pgmap v6070: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 88 KiB/s wr, 25 op/s 2023-05-08T06:52:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11273.375668 secs 2023-05-08T06:52:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:14 smithi096 ceph-mon[124666]: pgmap v6070: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 88 KiB/s wr, 25 op/s 2023-05-08T06:52:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11273.375668 secs 2023-05-08T06:52:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11274.657197 secs 2023-05-08T06:52:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11274.657197 secs 2023-05-08T06:52:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11274.657197 secs 2023-05-08T06:52:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:16 smithi133 ceph-mon[125939]: pgmap v6071: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 40 KiB/s wr, 9 op/s 2023-05-08T06:52:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:16 smithi096 ceph-mon[124666]: pgmap v6071: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 40 KiB/s wr, 9 op/s 2023-05-08T06:52:17.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:16 smithi186 ceph-mon[126480]: pgmap v6071: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 40 KiB/s wr, 9 op/s 2023-05-08T06:52:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:18 smithi133 ceph-mon[125939]: pgmap v6072: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 40 KiB/s wr, 9 op/s 2023-05-08T06:52:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11277.816910 secs 2023-05-08T06:52:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:18 smithi096 ceph-mon[124666]: pgmap v6072: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 40 KiB/s wr, 9 op/s 2023-05-08T06:52:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11277.816910 secs 2023-05-08T06:52:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:18 smithi186 ceph-mon[126480]: pgmap v6072: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 40 KiB/s wr, 9 op/s 2023-05-08T06:52:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11277.816910 secs 2023-05-08T06:52:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11278.375772 secs 2023-05-08T06:52:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11278.375772 secs 2023-05-08T06:52:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11278.375772 secs 2023-05-08T06:52:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:20 smithi133 ceph-mon[125939]: pgmap v6073: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 75 KiB/s wr, 9 op/s 2023-05-08T06:52:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11279.657347 secs 2023-05-08T06:52:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:20 smithi133 ceph-mon[125939]: osdmap e457: 12 total, 12 up, 12 in 2023-05-08T06:52:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:20 smithi096 ceph-mon[124666]: pgmap v6073: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 75 KiB/s wr, 9 op/s 2023-05-08T06:52:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11279.657347 secs 2023-05-08T06:52:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:20 smithi096 ceph-mon[124666]: osdmap e457: 12 total, 12 up, 12 in 2023-05-08T06:52:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:20 smithi186 ceph-mon[126480]: pgmap v6073: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 75 KiB/s wr, 9 op/s 2023-05-08T06:52:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11279.657347 secs 2023-05-08T06:52:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:20 smithi186 ceph-mon[126480]: osdmap e457: 12 total, 12 up, 12 in 2023-05-08T06:52:23.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:22 smithi133 ceph-mon[125939]: pgmap v6075: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 75 KiB/s wr, 9 op/s 2023-05-08T06:52:23.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:22 smithi096 ceph-mon[124666]: pgmap v6075: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 75 KiB/s wr, 9 op/s 2023-05-08T06:52:23.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:22 smithi186 ceph-mon[126480]: pgmap v6075: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 75 KiB/s wr, 9 op/s 2023-05-08T06:52:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11282.817065 secs 2023-05-08T06:52:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:52:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11282.817065 secs 2023-05-08T06:52:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:52:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11282.817065 secs 2023-05-08T06:52:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:52:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:24 smithi133 ceph-mon[125939]: pgmap v6076: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 75 KiB/s wr, 9 op/s 2023-05-08T06:52:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11283.375839 secs 2023-05-08T06:52:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:52:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:52:25.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:24 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:52:25.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:52:25.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:24 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T06:52:25.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:24 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T06:52:25.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:24 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:52:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:24 smithi096 ceph-mon[124666]: pgmap v6076: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 75 KiB/s wr, 9 op/s 2023-05-08T06:52:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11283.375839 secs 2023-05-08T06:52:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:52:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:52:25.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:24 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:52:25.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:52:25.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:24 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T06:52:25.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:24 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T06:52:25.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:24 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:52:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:24 smithi186 ceph-mon[126480]: pgmap v6076: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 75 KiB/s wr, 9 op/s 2023-05-08T06:52:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11283.375839 secs 2023-05-08T06:52:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:52:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:52:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:24 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:52:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:52:25.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:24 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T06:52:25.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:24 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T06:52:25.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:24 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:52:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11284.657484 secs 2023-05-08T06:52:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11284.657484 secs 2023-05-08T06:52:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11284.657484 secs 2023-05-08T06:52:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:26 smithi133 ceph-mon[125939]: pgmap v6077: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 70 KiB/s wr, 9 op/s 2023-05-08T06:52:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:26 smithi096 ceph-mon[124666]: pgmap v6077: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 70 KiB/s wr, 9 op/s 2023-05-08T06:52:27.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:26 smithi186 ceph-mon[126480]: pgmap v6077: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 70 KiB/s wr, 9 op/s 2023-05-08T06:52:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:28 smithi133 ceph-mon[125939]: pgmap v6078: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 70 KiB/s wr, 9 op/s 2023-05-08T06:52:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11287.817187 secs 2023-05-08T06:52:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:28 smithi096 ceph-mon[124666]: pgmap v6078: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 70 KiB/s wr, 9 op/s 2023-05-08T06:52:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11287.817187 secs 2023-05-08T06:52:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:28 smithi186 ceph-mon[126480]: pgmap v6078: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 70 KiB/s wr, 9 op/s 2023-05-08T06:52:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11287.817187 secs 2023-05-08T06:52:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11288.375957 secs 2023-05-08T06:52:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11288.375957 secs 2023-05-08T06:52:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11288.375957 secs 2023-05-08T06:52:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:30 smithi133 ceph-mon[125939]: pgmap v6079: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 86 KiB/s wr, 8 op/s 2023-05-08T06:52:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11289.657577 secs 2023-05-08T06:52:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:30 smithi096 ceph-mon[124666]: pgmap v6079: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 86 KiB/s wr, 8 op/s 2023-05-08T06:52:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11289.657577 secs 2023-05-08T06:52:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:30 smithi186 ceph-mon[126480]: pgmap v6079: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 86 KiB/s wr, 8 op/s 2023-05-08T06:52:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11289.657577 secs 2023-05-08T06:52:33.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:32 smithi133 ceph-mon[125939]: pgmap v6080: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 79 KiB/s wr, 7 op/s 2023-05-08T06:52:33.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:32 smithi096 ceph-mon[124666]: pgmap v6080: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 79 KiB/s wr, 7 op/s 2023-05-08T06:52:33.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:32 smithi186 ceph-mon[126480]: pgmap v6080: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 79 KiB/s wr, 7 op/s 2023-05-08T06:52:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11292.817306 secs 2023-05-08T06:52:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11292.817306 secs 2023-05-08T06:52:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11292.817306 secs 2023-05-08T06:52:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:34 smithi133 ceph-mon[125939]: pgmap v6081: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 72 KiB/s wr, 7 op/s 2023-05-08T06:52:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11293.376050 secs 2023-05-08T06:52:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:34 smithi096 ceph-mon[124666]: pgmap v6081: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 72 KiB/s wr, 7 op/s 2023-05-08T06:52:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11293.376050 secs 2023-05-08T06:52:35.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:34 smithi186 ceph-mon[126480]: pgmap v6081: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 72 KiB/s wr, 7 op/s 2023-05-08T06:52:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11293.376050 secs 2023-05-08T06:52:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11294.657694 secs 2023-05-08T06:52:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11294.657694 secs 2023-05-08T06:52:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11294.657694 secs 2023-05-08T06:52:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:36 smithi133 ceph-mon[125939]: pgmap v6082: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 72 KiB/s wr, 10 op/s 2023-05-08T06:52:37.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:36 smithi096 ceph-mon[124666]: pgmap v6082: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 72 KiB/s wr, 10 op/s 2023-05-08T06:52:37.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:36 smithi186 ceph-mon[126480]: pgmap v6082: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 72 KiB/s wr, 10 op/s 2023-05-08T06:52:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:38 smithi133 ceph-mon[125939]: pgmap v6083: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 71 KiB/s wr, 6 op/s 2023-05-08T06:52:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11297.817430 secs 2023-05-08T06:52:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:38 smithi096 ceph-mon[124666]: pgmap v6083: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 71 KiB/s wr, 6 op/s 2023-05-08T06:52:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11297.817430 secs 2023-05-08T06:52:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:38 smithi186 ceph-mon[126480]: pgmap v6083: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 71 KiB/s wr, 6 op/s 2023-05-08T06:52:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11297.817430 secs 2023-05-08T06:52:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11298.376170 secs 2023-05-08T06:52:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11298.376170 secs 2023-05-08T06:52:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11298.376170 secs 2023-05-08T06:52:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:40 smithi133 ceph-mon[125939]: pgmap v6084: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 98 KiB/s wr, 9 op/s 2023-05-08T06:52:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11299.657812 secs 2023-05-08T06:52:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:40 smithi096 ceph-mon[124666]: pgmap v6084: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 98 KiB/s wr, 9 op/s 2023-05-08T06:52:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11299.657812 secs 2023-05-08T06:52:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:40 smithi186 ceph-mon[126480]: pgmap v6084: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 98 KiB/s wr, 9 op/s 2023-05-08T06:52:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11299.657812 secs 2023-05-08T06:52:43.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:42 smithi133 ceph-mon[125939]: pgmap v6085: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 6 op/s 2023-05-08T06:52:43.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:42 smithi096 ceph-mon[124666]: pgmap v6085: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 6 op/s 2023-05-08T06:52:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:42 smithi186 ceph-mon[126480]: pgmap v6085: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 6 op/s 2023-05-08T06:52:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11302.817510 secs 2023-05-08T06:52:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11302.817510 secs 2023-05-08T06:52:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11302.817510 secs 2023-05-08T06:52:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:44 smithi133 ceph-mon[125939]: pgmap v6086: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 6 op/s 2023-05-08T06:52:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:44 smithi096 ceph-mon[124666]: pgmap v6086: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 6 op/s 2023-05-08T06:52:45.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:44 smithi186 ceph-mon[126480]: pgmap v6086: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 6 op/s 2023-05-08T06:52:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11304.657892 secs 2023-05-08T06:52:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11304.657892 secs 2023-05-08T06:52:46.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11304.657892 secs 2023-05-08T06:52:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:46 smithi133 ceph-mon[125939]: pgmap v6087: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 58 KiB/s wr, 10 op/s 2023-05-08T06:52:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:46 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:52:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:46 smithi096 ceph-mon[124666]: pgmap v6087: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 58 KiB/s wr, 10 op/s 2023-05-08T06:52:47.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:46 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:52:47.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:46 smithi186 ceph-mon[126480]: pgmap v6087: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 58 KiB/s wr, 10 op/s 2023-05-08T06:52:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:46 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:52:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:47 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:52:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:47 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:52:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:47 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:52:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:47 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:52:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:47 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:52:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:47 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:52:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:47 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:52:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:47 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:52:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:47 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:52:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:48 smithi133 ceph-mon[125939]: pgmap v6088: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 6 op/s 2023-05-08T06:52:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11307.817628 secs 2023-05-08T06:52:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:48 smithi096 ceph-mon[124666]: pgmap v6088: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 6 op/s 2023-05-08T06:52:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11307.817628 secs 2023-05-08T06:52:49.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:48 smithi186 ceph-mon[126480]: pgmap v6088: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 6 op/s 2023-05-08T06:52:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11307.817628 secs 2023-05-08T06:52:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:50 smithi096 ceph-mon[124666]: pgmap v6089: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 133 KiB/s wr, 12 op/s 2023-05-08T06:52:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:50 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:52:51.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:50 smithi186 ceph-mon[126480]: pgmap v6089: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 133 KiB/s wr, 12 op/s 2023-05-08T06:52:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:50 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:52:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:50 smithi133 ceph-mon[125939]: pgmap v6089: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 133 KiB/s wr, 12 op/s 2023-05-08T06:52:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:50 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:52:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:52:52.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:52:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:52:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:52:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:52:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:52:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:53 smithi186 ceph-mon[126480]: pgmap v6090: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 106 KiB/s wr, 9 op/s 2023-05-08T06:52:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:53 smithi133 ceph-mon[125939]: pgmap v6090: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 106 KiB/s wr, 9 op/s 2023-05-08T06:52:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:53 smithi096 ceph-mon[124666]: pgmap v6090: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 106 KiB/s wr, 9 op/s 2023-05-08T06:52:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11312.817746 secs 2023-05-08T06:52:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11312.817746 secs 2023-05-08T06:52:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11312.817746 secs 2023-05-08T06:52:55.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:55 smithi186 ceph-mon[126480]: pgmap v6091: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 106 KiB/s wr, 9 op/s 2023-05-08T06:52:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11313.376529 secs 2023-05-08T06:52:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:55 smithi133 ceph-mon[125939]: pgmap v6091: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 106 KiB/s wr, 9 op/s 2023-05-08T06:52:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11313.376529 secs 2023-05-08T06:52:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:55 smithi096 ceph-mon[124666]: pgmap v6091: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 106 KiB/s wr, 9 op/s 2023-05-08T06:52:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11313.376529 secs 2023-05-08T06:52:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:56 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:52:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:52:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:52:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:56 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:52:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:52:56.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:52:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:56 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:52:56.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:52:56.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:52:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:57 smithi186 ceph-mon[126480]: pgmap v6092: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 141 KiB/s wr, 13 op/s 2023-05-08T06:52:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:57 smithi133 ceph-mon[125939]: pgmap v6092: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 141 KiB/s wr, 13 op/s 2023-05-08T06:52:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:57 smithi096 ceph-mon[124666]: pgmap v6092: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 141 KiB/s wr, 13 op/s 2023-05-08T06:52:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:59 smithi186 ceph-mon[126480]: pgmap v6093: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 109 KiB/s wr, 9 op/s 2023-05-08T06:52:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:52:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11317.817898 secs 2023-05-08T06:52:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:59 smithi133 ceph-mon[125939]: pgmap v6093: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 109 KiB/s wr, 9 op/s 2023-05-08T06:52:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:52:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11317.817898 secs 2023-05-08T06:52:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:59 smithi096 ceph-mon[124666]: pgmap v6093: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 109 KiB/s wr, 9 op/s 2023-05-08T06:52:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:52:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11317.817898 secs 2023-05-08T06:53:01.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:01 smithi186 ceph-mon[126480]: pgmap v6094: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 199 KiB/s wr, 14 op/s 2023-05-08T06:53:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11319.658232 secs 2023-05-08T06:53:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:01 smithi133 ceph-mon[125939]: pgmap v6094: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 199 KiB/s wr, 14 op/s 2023-05-08T06:53:01.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11319.658232 secs 2023-05-08T06:53:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:01 smithi096 ceph-mon[124666]: pgmap v6094: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 199 KiB/s wr, 14 op/s 2023-05-08T06:53:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11319.658232 secs 2023-05-08T06:53:03.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:03 smithi186 ceph-mon[126480]: pgmap v6095: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 124 KiB/s wr, 8 op/s 2023-05-08T06:53:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:03 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:53:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:03 smithi133 ceph-mon[125939]: pgmap v6095: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 124 KiB/s wr, 8 op/s 2023-05-08T06:53:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:03 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:53:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:03 smithi096 ceph-mon[124666]: pgmap v6095: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 124 KiB/s wr, 8 op/s 2023-05-08T06:53:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:03 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:53:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:04 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:53:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:04 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:53:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:04 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:53:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11322.818016 secs 2023-05-08T06:53:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:04 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:53:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:04 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:53:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:04 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:53:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11322.818016 secs 2023-05-08T06:53:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:04 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:53:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:04 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:53:04.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:04 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:53:04.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11322.818016 secs 2023-05-08T06:53:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:05 smithi186 ceph-mon[126480]: pgmap v6096: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 124 KiB/s wr, 8 op/s 2023-05-08T06:53:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11323.376731 secs 2023-05-08T06:53:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:05 smithi133 ceph-mon[125939]: pgmap v6096: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 124 KiB/s wr, 8 op/s 2023-05-08T06:53:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11323.376731 secs 2023-05-08T06:53:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:05 smithi096 ceph-mon[124666]: pgmap v6096: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 124 KiB/s wr, 8 op/s 2023-05-08T06:53:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11323.376731 secs 2023-05-08T06:53:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11324.658355 secs 2023-05-08T06:53:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11324.658355 secs 2023-05-08T06:53:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11324.658355 secs 2023-05-08T06:53:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:07 smithi186 ceph-mon[126480]: pgmap v6097: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 222 KiB/s wr, 27 op/s 2023-05-08T06:53:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:07 smithi133 ceph-mon[125939]: pgmap v6097: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 222 KiB/s wr, 27 op/s 2023-05-08T06:53:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:07 smithi096 ceph-mon[124666]: pgmap v6097: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 222 KiB/s wr, 27 op/s 2023-05-08T06:53:08.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:08 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:53:08.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:53:08.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:53:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:08 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:53:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:53:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:53:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:08 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:53:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:53:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:53:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:09 smithi186 ceph-mon[126480]: pgmap v6098: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 188 KiB/s wr, 23 op/s 2023-05-08T06:53:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11327.818112 secs 2023-05-08T06:53:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:09 smithi133 ceph-mon[125939]: pgmap v6098: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 188 KiB/s wr, 23 op/s 2023-05-08T06:53:09.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11327.818112 secs 2023-05-08T06:53:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:09 smithi096 ceph-mon[124666]: pgmap v6098: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 188 KiB/s wr, 23 op/s 2023-05-08T06:53:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11327.818112 secs 2023-05-08T06:53:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11328.376813 secs 2023-05-08T06:53:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11328.376813 secs 2023-05-08T06:53:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11328.376813 secs 2023-05-08T06:53:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:11 smithi186 ceph-mon[126480]: pgmap v6099: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 211 KiB/s wr, 27 op/s 2023-05-08T06:53:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11329.658477 secs 2023-05-08T06:53:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:11 smithi186 ceph-mon[126480]: osdmap e458: 12 total, 12 up, 12 in 2023-05-08T06:53:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:11 smithi133 ceph-mon[125939]: pgmap v6099: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 211 KiB/s wr, 27 op/s 2023-05-08T06:53:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11329.658477 secs 2023-05-08T06:53:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:11 smithi133 ceph-mon[125939]: osdmap e458: 12 total, 12 up, 12 in 2023-05-08T06:53:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:11 smithi096 ceph-mon[124666]: pgmap v6099: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 211 KiB/s wr, 27 op/s 2023-05-08T06:53:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11329.658477 secs 2023-05-08T06:53:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:11 smithi096 ceph-mon[124666]: osdmap e458: 12 total, 12 up, 12 in 2023-05-08T06:53:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:13 smithi186 ceph-mon[126480]: pgmap v6101: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 145 KiB/s wr, 27 op/s 2023-05-08T06:53:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:13 smithi133 ceph-mon[125939]: pgmap v6101: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 145 KiB/s wr, 27 op/s 2023-05-08T06:53:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:13 smithi096 ceph-mon[124666]: pgmap v6101: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 145 KiB/s wr, 27 op/s 2023-05-08T06:53:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11332.818255 secs 2023-05-08T06:53:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11332.818255 secs 2023-05-08T06:53:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11332.818255 secs 2023-05-08T06:53:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:15 smithi186 ceph-mon[126480]: pgmap v6102: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 145 KiB/s wr, 27 op/s 2023-05-08T06:53:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11333.376889 secs 2023-05-08T06:53:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:15 smithi133 ceph-mon[125939]: pgmap v6102: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 145 KiB/s wr, 27 op/s 2023-05-08T06:53:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11333.376889 secs 2023-05-08T06:53:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:15 smithi096 ceph-mon[124666]: pgmap v6102: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 145 KiB/s wr, 27 op/s 2023-05-08T06:53:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11333.376889 secs 2023-05-08T06:53:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11334.658558 secs 2023-05-08T06:53:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11334.658558 secs 2023-05-08T06:53:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11334.658558 secs 2023-05-08T06:53:17.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:17 smithi186 ceph-mon[126480]: pgmap v6103: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 33 KiB/s wr, 8 op/s 2023-05-08T06:53:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:17 smithi133 ceph-mon[125939]: pgmap v6103: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 33 KiB/s wr, 8 op/s 2023-05-08T06:53:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:17 smithi096 ceph-mon[124666]: pgmap v6103: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 33 KiB/s wr, 8 op/s 2023-05-08T06:53:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:19 smithi186 ceph-mon[126480]: pgmap v6104: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 33 KiB/s wr, 9 op/s 2023-05-08T06:53:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11337.818385 secs 2023-05-08T06:53:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:19 smithi133 ceph-mon[125939]: pgmap v6104: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 33 KiB/s wr, 9 op/s 2023-05-08T06:53:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11337.818385 secs 2023-05-08T06:53:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:19 smithi096 ceph-mon[124666]: pgmap v6104: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 33 KiB/s wr, 9 op/s 2023-05-08T06:53:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11337.818385 secs 2023-05-08T06:53:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11338.377007 secs 2023-05-08T06:53:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11338.377007 secs 2023-05-08T06:53:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11338.377007 secs 2023-05-08T06:53:21.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:21 smithi186 ceph-mon[126480]: pgmap v6105: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 6.6 KiB/s wr, 7 op/s 2023-05-08T06:53:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11339.658695 secs 2023-05-08T06:53:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:21 smithi186 ceph-mon[126480]: osdmap e459: 12 total, 12 up, 12 in 2023-05-08T06:53:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:21 smithi133 ceph-mon[125939]: pgmap v6105: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 6.6 KiB/s wr, 7 op/s 2023-05-08T06:53:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11339.658695 secs 2023-05-08T06:53:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:21 smithi133 ceph-mon[125939]: osdmap e459: 12 total, 12 up, 12 in 2023-05-08T06:53:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:21 smithi096 ceph-mon[124666]: pgmap v6105: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 6.6 KiB/s wr, 7 op/s 2023-05-08T06:53:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11339.658695 secs 2023-05-08T06:53:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:21 smithi096 ceph-mon[124666]: osdmap e459: 12 total, 12 up, 12 in 2023-05-08T06:53:23.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:23 smithi186 ceph-mon[126480]: pgmap v6107: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 6.6 KiB/s wr, 7 op/s 2023-05-08T06:53:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:23 smithi133 ceph-mon[125939]: pgmap v6107: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 6.6 KiB/s wr, 7 op/s 2023-05-08T06:53:23.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:23 smithi096 ceph-mon[124666]: pgmap v6107: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 6.6 KiB/s wr, 7 op/s 2023-05-08T06:53:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11342.818468 secs 2023-05-08T06:53:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11342.818468 secs 2023-05-08T06:53:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11342.818468 secs 2023-05-08T06:53:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:25 smithi186 ceph-mon[126480]: pgmap v6108: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 6.6 KiB/s wr, 7 op/s 2023-05-08T06:53:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11343.377142 secs 2023-05-08T06:53:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:25 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:53:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:25 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:53:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:25 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:53:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:25 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:53:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:25 smithi133 ceph-mon[125939]: pgmap v6108: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 6.6 KiB/s wr, 7 op/s 2023-05-08T06:53:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11343.377142 secs 2023-05-08T06:53:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:25 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:53:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:25 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:53:25.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:25 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:53:25.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:25 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:53:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:25 smithi096 ceph-mon[124666]: pgmap v6108: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 6.6 KiB/s wr, 7 op/s 2023-05-08T06:53:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11343.377142 secs 2023-05-08T06:53:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:25 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:53:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:25 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:53:25.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:25 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:53:25.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:25 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:53:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:26 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:53:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:26 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T06:53:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:26 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T06:53:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:26 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:53:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11344.658816 secs 2023-05-08T06:53:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:26 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:53:26.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:26 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T06:53:26.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:26 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T06:53:26.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:26 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:53:26.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11344.658816 secs 2023-05-08T06:53:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:26 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:53:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:26 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T06:53:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:26 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T06:53:26.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:26 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:53:26.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11344.658816 secs 2023-05-08T06:53:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:27 smithi186 ceph-mon[126480]: pgmap v6109: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 33 KiB/s wr, 7 op/s 2023-05-08T06:53:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:27 smithi133 ceph-mon[125939]: pgmap v6109: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 33 KiB/s wr, 7 op/s 2023-05-08T06:53:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:27 smithi096 ceph-mon[124666]: pgmap v6109: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 33 KiB/s wr, 7 op/s 2023-05-08T06:53:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:29 smithi133 ceph-mon[125939]: pgmap v6110: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 33 KiB/s wr, 7 op/s 2023-05-08T06:53:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11347.818549 secs 2023-05-08T06:53:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:29 smithi096 ceph-mon[124666]: pgmap v6110: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 33 KiB/s wr, 7 op/s 2023-05-08T06:53:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11347.818549 secs 2023-05-08T06:53:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:29 smithi186 ceph-mon[126480]: pgmap v6110: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 33 KiB/s wr, 7 op/s 2023-05-08T06:53:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11347.818549 secs 2023-05-08T06:53:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11348.377220 secs 2023-05-08T06:53:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11348.377220 secs 2023-05-08T06:53:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11348.377220 secs 2023-05-08T06:53:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:31 smithi133 ceph-mon[125939]: pgmap v6111: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 65 KiB/s wr, 8 op/s 2023-05-08T06:53:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11349.658938 secs 2023-05-08T06:53:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:31 smithi096 ceph-mon[124666]: pgmap v6111: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 65 KiB/s wr, 8 op/s 2023-05-08T06:53:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11349.658938 secs 2023-05-08T06:53:31.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:31 smithi186 ceph-mon[126480]: pgmap v6111: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 65 KiB/s wr, 8 op/s 2023-05-08T06:53:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11349.658938 secs 2023-05-08T06:53:33.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:33 smithi133 ceph-mon[125939]: pgmap v6112: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 60 KiB/s wr, 7 op/s 2023-05-08T06:53:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:33 smithi096 ceph-mon[124666]: pgmap v6112: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 60 KiB/s wr, 7 op/s 2023-05-08T06:53:33.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:33 smithi186 ceph-mon[126480]: pgmap v6112: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 60 KiB/s wr, 7 op/s 2023-05-08T06:53:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11352.818657 secs 2023-05-08T06:53:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11352.818657 secs 2023-05-08T06:53:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11352.818657 secs 2023-05-08T06:53:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:35 smithi133 ceph-mon[125939]: pgmap v6113: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 6 op/s 2023-05-08T06:53:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11353.377337 secs 2023-05-08T06:53:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:35 smithi096 ceph-mon[124666]: pgmap v6113: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 6 op/s 2023-05-08T06:53:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11353.377337 secs 2023-05-08T06:53:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:35 smithi186 ceph-mon[126480]: pgmap v6113: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 6 op/s 2023-05-08T06:53:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11353.377337 secs 2023-05-08T06:53:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11354.659077 secs 2023-05-08T06:53:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11354.659077 secs 2023-05-08T06:53:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11354.659077 secs 2023-05-08T06:53:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:37 smithi133 ceph-mon[125939]: pgmap v6114: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 81 KiB/s wr, 9 op/s 2023-05-08T06:53:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:37 smithi096 ceph-mon[124666]: pgmap v6114: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 81 KiB/s wr, 9 op/s 2023-05-08T06:53:37.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:37 smithi186 ceph-mon[126480]: pgmap v6114: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 81 KiB/s wr, 9 op/s 2023-05-08T06:53:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:39 smithi133 ceph-mon[125939]: pgmap v6115: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 6 op/s 2023-05-08T06:53:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11357.818766 secs 2023-05-08T06:53:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:39 smithi096 ceph-mon[124666]: pgmap v6115: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 6 op/s 2023-05-08T06:53:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11357.818766 secs 2023-05-08T06:53:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:39 smithi186 ceph-mon[126480]: pgmap v6115: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 6 op/s 2023-05-08T06:53:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11357.818766 secs 2023-05-08T06:53:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11358.377460 secs 2023-05-08T06:53:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11358.377460 secs 2023-05-08T06:53:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11358.377460 secs 2023-05-08T06:53:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:41 smithi133 ceph-mon[125939]: pgmap v6116: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 81 KiB/s wr, 10 op/s 2023-05-08T06:53:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11359.659175 secs 2023-05-08T06:53:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:41 smithi096 ceph-mon[124666]: pgmap v6116: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 81 KiB/s wr, 10 op/s 2023-05-08T06:53:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11359.659175 secs 2023-05-08T06:53:41.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:41 smithi186 ceph-mon[126480]: pgmap v6116: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 81 KiB/s wr, 10 op/s 2023-05-08T06:53:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11359.659175 secs 2023-05-08T06:53:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:43 smithi133 ceph-mon[125939]: pgmap v6117: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 6 op/s 2023-05-08T06:53:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:43 smithi096 ceph-mon[124666]: pgmap v6117: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 6 op/s 2023-05-08T06:53:43.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:43 smithi186 ceph-mon[126480]: pgmap v6117: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 6 op/s 2023-05-08T06:53:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11362.818892 secs 2023-05-08T06:53:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11362.818892 secs 2023-05-08T06:53:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11362.818892 secs 2023-05-08T06:53:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:45 smithi133 ceph-mon[125939]: pgmap v6118: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 6 op/s 2023-05-08T06:53:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:45 smithi096 ceph-mon[124666]: pgmap v6118: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 6 op/s 2023-05-08T06:53:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:45 smithi186 ceph-mon[126480]: pgmap v6118: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 6 op/s 2023-05-08T06:53:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11364.659294 secs 2023-05-08T06:53:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11364.659294 secs 2023-05-08T06:53:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11364.659294 secs 2023-05-08T06:53:47.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:47 smithi133 ceph-mon[125939]: pgmap v6119: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 112 KiB/s wr, 10 op/s 2023-05-08T06:53:47.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:53:47.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:47 smithi096 ceph-mon[124666]: pgmap v6119: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 112 KiB/s wr, 10 op/s 2023-05-08T06:53:47.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:53:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:47 smithi186 ceph-mon[126480]: pgmap v6119: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 112 KiB/s wr, 10 op/s 2023-05-08T06:53:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:53:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:48 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:53:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:53:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:53:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:48 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:53:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:53:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:53:48.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:48 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:53:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:53:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:53:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:49 smithi133 ceph-mon[125939]: pgmap v6120: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 85 KiB/s wr, 7 op/s 2023-05-08T06:53:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11367.819027 secs 2023-05-08T06:53:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:49 smithi096 ceph-mon[124666]: pgmap v6120: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 85 KiB/s wr, 7 op/s 2023-05-08T06:53:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11367.819027 secs 2023-05-08T06:53:49.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:49 smithi186 ceph-mon[126480]: pgmap v6120: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 85 KiB/s wr, 7 op/s 2023-05-08T06:53:49.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11367.819027 secs 2023-05-08T06:53:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:51 smithi133 ceph-mon[125939]: pgmap v6121: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 182 KiB/s wr, 12 op/s 2023-05-08T06:53:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:53:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:51 smithi096 ceph-mon[124666]: pgmap v6121: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 182 KiB/s wr, 12 op/s 2023-05-08T06:53:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:53:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:51 smithi186 ceph-mon[126480]: pgmap v6121: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 182 KiB/s wr, 12 op/s 2023-05-08T06:53:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:53:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:53:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:53:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:53:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:53:52.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:53:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:53:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:53 smithi133 ceph-mon[125939]: pgmap v6122: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 155 KiB/s wr, 9 op/s 2023-05-08T06:53:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:53 smithi096 ceph-mon[124666]: pgmap v6122: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 155 KiB/s wr, 9 op/s 2023-05-08T06:53:53.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:53 smithi186 ceph-mon[126480]: pgmap v6122: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 155 KiB/s wr, 9 op/s 2023-05-08T06:53:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11372.819151 secs 2023-05-08T06:53:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11373.377839 secs 2023-05-08T06:53:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11372.819151 secs 2023-05-08T06:53:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11373.377839 secs 2023-05-08T06:53:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11372.819151 secs 2023-05-08T06:53:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11373.377839 secs 2023-05-08T06:53:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:55 smithi133 ceph-mon[125939]: pgmap v6123: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 155 KiB/s wr, 9 op/s 2023-05-08T06:53:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:55 smithi096 ceph-mon[124666]: pgmap v6123: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 155 KiB/s wr, 9 op/s 2023-05-08T06:53:55.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:55 smithi186 ceph-mon[126480]: pgmap v6123: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 155 KiB/s wr, 9 op/s 2023-05-08T06:53:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:56 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:53:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:53:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:53:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:56 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:53:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:53:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:53:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:56 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:53:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:53:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:53:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:57 smithi133 ceph-mon[125939]: pgmap v6124: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 166 KiB/s wr, 13 op/s 2023-05-08T06:53:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:57 smithi096 ceph-mon[124666]: pgmap v6124: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 166 KiB/s wr, 13 op/s 2023-05-08T06:53:57.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:57 smithi186 ceph-mon[126480]: pgmap v6124: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 166 KiB/s wr, 13 op/s 2023-05-08T06:53:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:59 smithi133 ceph-mon[125939]: pgmap v6125: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 108 KiB/s wr, 9 op/s 2023-05-08T06:53:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11377.819262 secs 2023-05-08T06:53:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:53:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11378.377951 secs 2023-05-08T06:53:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:59 smithi096 ceph-mon[124666]: pgmap v6125: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 108 KiB/s wr, 9 op/s 2023-05-08T06:53:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11377.819262 secs 2023-05-08T06:53:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:53:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11378.377951 secs 2023-05-08T06:53:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:59 smithi186 ceph-mon[126480]: pgmap v6125: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 108 KiB/s wr, 9 op/s 2023-05-08T06:53:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11377.819262 secs 2023-05-08T06:53:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:53:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11378.377951 secs 2023-05-08T06:54:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:01 smithi096 ceph-mon[124666]: pgmap v6126: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 281 KiB/s wr, 14 op/s 2023-05-08T06:54:01.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:01 smithi186 ceph-mon[126480]: pgmap v6126: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 281 KiB/s wr, 14 op/s 2023-05-08T06:54:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:01 smithi133 ceph-mon[125939]: pgmap v6126: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 281 KiB/s wr, 14 op/s 2023-05-08T06:54:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:03 smithi096 ceph-mon[124666]: pgmap v6127: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 185 KiB/s wr, 9 op/s 2023-05-08T06:54:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:03 smithi186 ceph-mon[126480]: pgmap v6127: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 185 KiB/s wr, 9 op/s 2023-05-08T06:54:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:03 smithi133 ceph-mon[125939]: pgmap v6127: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 185 KiB/s wr, 9 op/s 2023-05-08T06:54:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11382.819383 secs 2023-05-08T06:54:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11383.378076 secs 2023-05-08T06:54:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11382.819383 secs 2023-05-08T06:54:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11383.378076 secs 2023-05-08T06:54:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11382.819383 secs 2023-05-08T06:54:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11383.378076 secs 2023-05-08T06:54:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:05 smithi096 ceph-mon[124666]: pgmap v6128: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 185 KiB/s wr, 9 op/s 2023-05-08T06:54:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:05 smithi186 ceph-mon[126480]: pgmap v6128: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 185 KiB/s wr, 9 op/s 2023-05-08T06:54:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:05 smithi133 ceph-mon[125939]: pgmap v6128: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 185 KiB/s wr, 9 op/s 2023-05-08T06:54:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11384.659725 secs 2023-05-08T06:54:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11384.659725 secs 2023-05-08T06:54:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11384.659725 secs 2023-05-08T06:54:07.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:07 smithi186 ceph-mon[126480]: pgmap v6129: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 242 KiB/s wr, 28 op/s 2023-05-08T06:54:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:07 smithi133 ceph-mon[125939]: pgmap v6129: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 242 KiB/s wr, 28 op/s 2023-05-08T06:54:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:07 smithi096 ceph-mon[124666]: pgmap v6129: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 242 KiB/s wr, 28 op/s 2023-05-08T06:54:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:08 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:54:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:54:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:54:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:08 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:54:08.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:54:08.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:54:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:08 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:54:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:54:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:54:09.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:09 smithi186 ceph-mon[126480]: pgmap v6130: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 230 KiB/s wr, 24 op/s 2023-05-08T06:54:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11387.819503 secs 2023-05-08T06:54:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11388.378207 secs 2023-05-08T06:54:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:09 smithi133 ceph-mon[125939]: pgmap v6130: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 230 KiB/s wr, 24 op/s 2023-05-08T06:54:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11387.819503 secs 2023-05-08T06:54:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11388.378207 secs 2023-05-08T06:54:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:09 smithi096 ceph-mon[124666]: pgmap v6130: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 230 KiB/s wr, 24 op/s 2023-05-08T06:54:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11387.819503 secs 2023-05-08T06:54:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11388.378207 secs 2023-05-08T06:54:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:11 smithi186 ceph-mon[126480]: pgmap v6131: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 292 KiB/s wr, 28 op/s 2023-05-08T06:54:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11389.659842 secs 2023-05-08T06:54:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:11 smithi186 ceph-mon[126480]: osdmap e460: 12 total, 12 up, 12 in 2023-05-08T06:54:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:11 smithi133 ceph-mon[125939]: pgmap v6131: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 292 KiB/s wr, 28 op/s 2023-05-08T06:54:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11389.659842 secs 2023-05-08T06:54:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:11 smithi133 ceph-mon[125939]: osdmap e460: 12 total, 12 up, 12 in 2023-05-08T06:54:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:11 smithi096 ceph-mon[124666]: pgmap v6131: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 292 KiB/s wr, 28 op/s 2023-05-08T06:54:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11389.659842 secs 2023-05-08T06:54:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:11 smithi096 ceph-mon[124666]: osdmap e460: 12 total, 12 up, 12 in 2023-05-08T06:54:13.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:13 smithi186 ceph-mon[126480]: pgmap v6133: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 142 KiB/s wr, 28 op/s 2023-05-08T06:54:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:13 smithi133 ceph-mon[125939]: pgmap v6133: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 142 KiB/s wr, 28 op/s 2023-05-08T06:54:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:13 smithi096 ceph-mon[124666]: pgmap v6133: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 142 KiB/s wr, 28 op/s 2023-05-08T06:54:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11392.819581 secs 2023-05-08T06:54:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11393.378344 secs 2023-05-08T06:54:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11392.819581 secs 2023-05-08T06:54:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11393.378344 secs 2023-05-08T06:54:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11392.819581 secs 2023-05-08T06:54:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11393.378344 secs 2023-05-08T06:54:15.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:15 smithi186 ceph-mon[126480]: pgmap v6134: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 142 KiB/s wr, 28 op/s 2023-05-08T06:54:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:15 smithi133 ceph-mon[125939]: pgmap v6134: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 142 KiB/s wr, 28 op/s 2023-05-08T06:54:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:15 smithi096 ceph-mon[124666]: pgmap v6134: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 142 KiB/s wr, 28 op/s 2023-05-08T06:54:16.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11394.659981 secs 2023-05-08T06:54:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11394.659981 secs 2023-05-08T06:54:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11394.659981 secs 2023-05-08T06:54:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:17 smithi186 ceph-mon[126480]: pgmap v6135: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 100 KiB/s wr, 9 op/s 2023-05-08T06:54:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:17 smithi133 ceph-mon[125939]: pgmap v6135: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 100 KiB/s wr, 9 op/s 2023-05-08T06:54:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:17 smithi096 ceph-mon[124666]: pgmap v6135: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 100 KiB/s wr, 9 op/s 2023-05-08T06:54:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:19 smithi186 ceph-mon[126480]: pgmap v6136: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 100 KiB/s wr, 9 op/s 2023-05-08T06:54:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11397.819692 secs 2023-05-08T06:54:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11398.378487 secs 2023-05-08T06:54:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:19 smithi133 ceph-mon[125939]: pgmap v6136: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 100 KiB/s wr, 9 op/s 2023-05-08T06:54:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11397.819692 secs 2023-05-08T06:54:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11398.378487 secs 2023-05-08T06:54:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:19 smithi096 ceph-mon[124666]: pgmap v6136: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 100 KiB/s wr, 9 op/s 2023-05-08T06:54:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11397.819692 secs 2023-05-08T06:54:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11398.378487 secs 2023-05-08T06:54:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:21 smithi186 ceph-mon[126480]: pgmap v6137: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 49 KiB/s wr, 8 op/s 2023-05-08T06:54:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11399.660118 secs 2023-05-08T06:54:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:21 smithi186 ceph-mon[126480]: osdmap e461: 12 total, 12 up, 12 in 2023-05-08T06:54:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:21 smithi133 ceph-mon[125939]: pgmap v6137: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 49 KiB/s wr, 8 op/s 2023-05-08T06:54:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11399.660118 secs 2023-05-08T06:54:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:21 smithi133 ceph-mon[125939]: osdmap e461: 12 total, 12 up, 12 in 2023-05-08T06:54:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:21 smithi096 ceph-mon[124666]: pgmap v6137: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 49 KiB/s wr, 8 op/s 2023-05-08T06:54:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11399.660118 secs 2023-05-08T06:54:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:21 smithi096 ceph-mon[124666]: osdmap e461: 12 total, 12 up, 12 in 2023-05-08T06:54:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:23 smithi186 ceph-mon[126480]: pgmap v6139: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 49 KiB/s wr, 7 op/s 2023-05-08T06:54:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:23 smithi133 ceph-mon[125939]: pgmap v6139: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 49 KiB/s wr, 7 op/s 2023-05-08T06:54:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:23 smithi096 ceph-mon[124666]: pgmap v6139: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 49 KiB/s wr, 7 op/s 2023-05-08T06:54:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11402.819844 secs 2023-05-08T06:54:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11403.378570 secs 2023-05-08T06:54:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11402.819844 secs 2023-05-08T06:54:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11403.378570 secs 2023-05-08T06:54:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11402.819844 secs 2023-05-08T06:54:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11403.378570 secs 2023-05-08T06:54:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:25 smithi186 ceph-mon[126480]: pgmap v6140: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 49 KiB/s wr, 7 op/s 2023-05-08T06:54:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:25 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:54:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:25 smithi133 ceph-mon[125939]: pgmap v6140: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 49 KiB/s wr, 7 op/s 2023-05-08T06:54:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:25 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:54:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:25 smithi096 ceph-mon[124666]: pgmap v6140: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 49 KiB/s wr, 7 op/s 2023-05-08T06:54:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:25 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:54:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11404.660200 secs 2023-05-08T06:54:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:54:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:54:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:54:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11404.660200 secs 2023-05-08T06:54:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:54:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:54:26.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:54:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11404.660200 secs 2023-05-08T06:54:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:54:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:54:26.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:54:27.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:27 smithi186 ceph-mon[126480]: pgmap v6141: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 55 KiB/s wr, 7 op/s 2023-05-08T06:54:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:27 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:54:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:27 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T06:54:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:27 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T06:54:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:27 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:54:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:27 smithi133 ceph-mon[125939]: pgmap v6141: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 55 KiB/s wr, 7 op/s 2023-05-08T06:54:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:27 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:54:27.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:27 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T06:54:27.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:27 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T06:54:27.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:27 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:54:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:27 smithi096 ceph-mon[124666]: pgmap v6141: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 55 KiB/s wr, 7 op/s 2023-05-08T06:54:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:27 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:54:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:27 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T06:54:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:27 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T06:54:27.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:27 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:54:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:29 smithi186 ceph-mon[126480]: pgmap v6142: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 55 KiB/s wr, 7 op/s 2023-05-08T06:54:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11407.819991 secs 2023-05-08T06:54:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11408.378694 secs 2023-05-08T06:54:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:29 smithi133 ceph-mon[125939]: pgmap v6142: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 55 KiB/s wr, 7 op/s 2023-05-08T06:54:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11407.819991 secs 2023-05-08T06:54:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11408.378694 secs 2023-05-08T06:54:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:29 smithi096 ceph-mon[124666]: pgmap v6142: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 55 KiB/s wr, 7 op/s 2023-05-08T06:54:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11407.819991 secs 2023-05-08T06:54:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11408.378694 secs 2023-05-08T06:54:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:31 smithi186 ceph-mon[126480]: pgmap v6143: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 68 KiB/s wr, 8 op/s 2023-05-08T06:54:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11409.660320 secs 2023-05-08T06:54:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:31 smithi133 ceph-mon[125939]: pgmap v6143: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 68 KiB/s wr, 8 op/s 2023-05-08T06:54:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11409.660320 secs 2023-05-08T06:54:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:31 smithi096 ceph-mon[124666]: pgmap v6143: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 68 KiB/s wr, 8 op/s 2023-05-08T06:54:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11409.660320 secs 2023-05-08T06:54:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:33 smithi186 ceph-mon[126480]: pgmap v6144: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 63 KiB/s wr, 7 op/s 2023-05-08T06:54:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:33 smithi133 ceph-mon[125939]: pgmap v6144: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 63 KiB/s wr, 7 op/s 2023-05-08T06:54:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:33 smithi096 ceph-mon[124666]: pgmap v6144: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 63 KiB/s wr, 7 op/s 2023-05-08T06:54:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11412.820113 secs 2023-05-08T06:54:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11413.378811 secs 2023-05-08T06:54:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11412.820113 secs 2023-05-08T06:54:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11413.378811 secs 2023-05-08T06:54:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11412.820113 secs 2023-05-08T06:54:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11413.378811 secs 2023-05-08T06:54:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:35 smithi186 ceph-mon[126480]: pgmap v6145: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 57 KiB/s wr, 7 op/s 2023-05-08T06:54:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:35 smithi133 ceph-mon[125939]: pgmap v6145: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 57 KiB/s wr, 7 op/s 2023-05-08T06:54:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:35 smithi096 ceph-mon[124666]: pgmap v6145: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 57 KiB/s wr, 7 op/s 2023-05-08T06:54:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11414.660485 secs 2023-05-08T06:54:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11414.660485 secs 2023-05-08T06:54:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11414.660485 secs 2023-05-08T06:54:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:37 smithi186 ceph-mon[126480]: pgmap v6146: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 57 KiB/s wr, 10 op/s 2023-05-08T06:54:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:37 smithi133 ceph-mon[125939]: pgmap v6146: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 57 KiB/s wr, 10 op/s 2023-05-08T06:54:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:37 smithi096 ceph-mon[124666]: pgmap v6146: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 57 KiB/s wr, 10 op/s 2023-05-08T06:54:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:39 smithi186 ceph-mon[126480]: pgmap v6147: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 30 KiB/s wr, 7 op/s 2023-05-08T06:54:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11417.820217 secs 2023-05-08T06:54:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11418.378945 secs 2023-05-08T06:54:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:39 smithi133 ceph-mon[125939]: pgmap v6147: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 30 KiB/s wr, 7 op/s 2023-05-08T06:54:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11417.820217 secs 2023-05-08T06:54:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11418.378945 secs 2023-05-08T06:54:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:39 smithi096 ceph-mon[124666]: pgmap v6147: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 30 KiB/s wr, 7 op/s 2023-05-08T06:54:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11417.820217 secs 2023-05-08T06:54:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11418.378945 secs 2023-05-08T06:54:41.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:41 smithi186 ceph-mon[126480]: pgmap v6148: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 106 KiB/s wr, 11 op/s 2023-05-08T06:54:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11419.660623 secs 2023-05-08T06:54:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:41 smithi133 ceph-mon[125939]: pgmap v6148: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 106 KiB/s wr, 11 op/s 2023-05-08T06:54:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11419.660623 secs 2023-05-08T06:54:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:41 smithi096 ceph-mon[124666]: pgmap v6148: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 106 KiB/s wr, 11 op/s 2023-05-08T06:54:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11419.660623 secs 2023-05-08T06:54:43.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:43 smithi186 ceph-mon[126480]: pgmap v6149: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 76 KiB/s wr, 7 op/s 2023-05-08T06:54:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:43 smithi133 ceph-mon[125939]: pgmap v6149: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 76 KiB/s wr, 7 op/s 2023-05-08T06:54:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:43 smithi096 ceph-mon[124666]: pgmap v6149: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 76 KiB/s wr, 7 op/s 2023-05-08T06:54:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11422.820377 secs 2023-05-08T06:54:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11422.820377 secs 2023-05-08T06:54:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11422.820377 secs 2023-05-08T06:54:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:45 smithi133 ceph-mon[125939]: pgmap v6150: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 76 KiB/s wr, 7 op/s 2023-05-08T06:54:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:45 smithi096 ceph-mon[124666]: pgmap v6150: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 76 KiB/s wr, 7 op/s 2023-05-08T06:54:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:45 smithi186 ceph-mon[126480]: pgmap v6150: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 76 KiB/s wr, 7 op/s 2023-05-08T06:54:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:47 smithi133 ceph-mon[125939]: pgmap v6151: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 163 KiB/s wr, 12 op/s 2023-05-08T06:54:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:54:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:54:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:47 smithi096 ceph-mon[124666]: pgmap v6151: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 163 KiB/s wr, 12 op/s 2023-05-08T06:54:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:54:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:54:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:47 smithi186 ceph-mon[126480]: pgmap v6151: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 163 KiB/s wr, 12 op/s 2023-05-08T06:54:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:54:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:54:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:48 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:54:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:54:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:54:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:54:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:48 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:54:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:54:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:54:48.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:54:48.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:48 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:54:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:54:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:54:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:54:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:49 smithi133 ceph-mon[125939]: pgmap v6152: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 162 KiB/s wr, 9 op/s 2023-05-08T06:54:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11427.820500 secs 2023-05-08T06:54:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11428.379202 secs 2023-05-08T06:54:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:49 smithi096 ceph-mon[124666]: pgmap v6152: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 162 KiB/s wr, 9 op/s 2023-05-08T06:54:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11427.820500 secs 2023-05-08T06:54:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11428.379202 secs 2023-05-08T06:54:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:49 smithi186 ceph-mon[126480]: pgmap v6152: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 162 KiB/s wr, 9 op/s 2023-05-08T06:54:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11427.820500 secs 2023-05-08T06:54:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11428.379202 secs 2023-05-08T06:54:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:51 smithi133 ceph-mon[125939]: pgmap v6153: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 265 KiB/s rd, 263 KiB/s wr, 13 op/s 2023-05-08T06:54:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:51 smithi096 ceph-mon[124666]: pgmap v6153: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 265 KiB/s rd, 263 KiB/s wr, 13 op/s 2023-05-08T06:54:51.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:51 smithi186 ceph-mon[126480]: pgmap v6153: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 265 KiB/s rd, 263 KiB/s wr, 13 op/s 2023-05-08T06:54:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:54:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:54:52.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:52 smithi133 ceph-mon[125939]: pgmap v6154: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 188 KiB/s wr, 9 op/s 2023-05-08T06:54:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:54:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:54:52.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:52 smithi096 ceph-mon[124666]: pgmap v6154: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 188 KiB/s wr, 9 op/s 2023-05-08T06:54:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:54:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:54:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:52 smithi186 ceph-mon[126480]: pgmap v6154: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 188 KiB/s wr, 9 op/s 2023-05-08T06:54:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11432.820647 secs 2023-05-08T06:54:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:54 smithi186 ceph-mon[126480]: pgmap v6155: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 188 KiB/s wr, 9 op/s 2023-05-08T06:54:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:54 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:54:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11432.820647 secs 2023-05-08T06:54:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:54 smithi133 ceph-mon[125939]: pgmap v6155: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 188 KiB/s wr, 9 op/s 2023-05-08T06:54:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:54 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:54:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11432.820647 secs 2023-05-08T06:54:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:54 smithi096 ceph-mon[124666]: pgmap v6155: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 188 KiB/s wr, 9 op/s 2023-05-08T06:54:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:54 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:54:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:55 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:54:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:55 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:54:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:55 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:54:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:55 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:54:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:55 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:54:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:55 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:54:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:55 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:54:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:55 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:54:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:55 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:54:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:56 smithi133 ceph-mon[125939]: pgmap v6156: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 199 KiB/s wr, 14 op/s 2023-05-08T06:54:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:56 smithi096 ceph-mon[124666]: pgmap v6156: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 199 KiB/s wr, 14 op/s 2023-05-08T06:54:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:56 smithi186 ceph-mon[126480]: pgmap v6156: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 199 KiB/s wr, 14 op/s 2023-05-08T06:54:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:58 smithi133 ceph-mon[125939]: pgmap v6157: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 112 KiB/s wr, 8 op/s 2023-05-08T06:54:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:58 smithi096 ceph-mon[124666]: pgmap v6157: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 112 KiB/s wr, 8 op/s 2023-05-08T06:54:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:58 smithi186 ceph-mon[126480]: pgmap v6157: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 112 KiB/s wr, 8 op/s 2023-05-08T06:54:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11437.820772 secs 2023-05-08T06:54:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:54:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11438.379439 secs 2023-05-08T06:55:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11437.820772 secs 2023-05-08T06:55:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:54:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11438.379439 secs 2023-05-08T06:55:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11437.820772 secs 2023-05-08T06:55:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:54:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11438.379439 secs 2023-05-08T06:55:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:00 smithi133 ceph-mon[125939]: pgmap v6158: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 209 KiB/s wr, 13 op/s 2023-05-08T06:55:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11439.661069 secs 2023-05-08T06:55:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:00 smithi096 ceph-mon[124666]: pgmap v6158: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 209 KiB/s wr, 13 op/s 2023-05-08T06:55:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11439.661069 secs 2023-05-08T06:55:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:00 smithi186 ceph-mon[126480]: pgmap v6158: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 209 KiB/s wr, 13 op/s 2023-05-08T06:55:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11439.661069 secs 2023-05-08T06:55:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:02 smithi133 ceph-mon[125939]: pgmap v6159: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 109 KiB/s wr, 8 op/s 2023-05-08T06:55:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:02 smithi096 ceph-mon[124666]: pgmap v6159: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 109 KiB/s wr, 8 op/s 2023-05-08T06:55:03.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:02 smithi186 ceph-mon[126480]: pgmap v6159: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 109 KiB/s wr, 8 op/s 2023-05-08T06:55:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:03 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:55:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:55:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:55:03.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:03 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:55:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:03 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:55:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:55:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:55:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:03 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:55:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:03 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:55:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:55:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:55:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:03 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:55:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11442.820930 secs 2023-05-08T06:55:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:04 smithi133 ceph-mon[125939]: pgmap v6160: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 109 KiB/s wr, 8 op/s 2023-05-08T06:55:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11443.379530 secs 2023-05-08T06:55:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11442.820930 secs 2023-05-08T06:55:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:04 smithi096 ceph-mon[124666]: pgmap v6160: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 109 KiB/s wr, 8 op/s 2023-05-08T06:55:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11443.379530 secs 2023-05-08T06:55:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11442.820930 secs 2023-05-08T06:55:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:04 smithi186 ceph-mon[126480]: pgmap v6160: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 109 KiB/s wr, 8 op/s 2023-05-08T06:55:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11443.379530 secs 2023-05-08T06:55:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11444.661195 secs 2023-05-08T06:55:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11444.661195 secs 2023-05-08T06:55:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11444.661195 secs 2023-05-08T06:55:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:06 smithi133 ceph-mon[125939]: pgmap v6161: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 154 KiB/s wr, 26 op/s 2023-05-08T06:55:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:06 smithi096 ceph-mon[124666]: pgmap v6161: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 154 KiB/s wr, 26 op/s 2023-05-08T06:55:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:06 smithi186 ceph-mon[126480]: pgmap v6161: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 154 KiB/s wr, 26 op/s 2023-05-08T06:55:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:08 smithi133 ceph-mon[125939]: pgmap v6162: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 143 KiB/s wr, 21 op/s 2023-05-08T06:55:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:08 smithi096 ceph-mon[124666]: pgmap v6162: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 143 KiB/s wr, 21 op/s 2023-05-08T06:55:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:08 smithi186 ceph-mon[126480]: pgmap v6162: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 143 KiB/s wr, 21 op/s 2023-05-08T06:55:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11447.821079 secs 2023-05-08T06:55:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11448.379667 secs 2023-05-08T06:55:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11447.821079 secs 2023-05-08T06:55:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11448.379667 secs 2023-05-08T06:55:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11447.821079 secs 2023-05-08T06:55:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11448.379667 secs 2023-05-08T06:55:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:10 smithi133 ceph-mon[125939]: pgmap v6163: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 187 KiB/s wr, 25 op/s 2023-05-08T06:55:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11449.661317 secs 2023-05-08T06:55:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:10 smithi096 ceph-mon[124666]: pgmap v6163: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 187 KiB/s wr, 25 op/s 2023-05-08T06:55:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11449.661317 secs 2023-05-08T06:55:11.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:10 smithi186 ceph-mon[126480]: pgmap v6163: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 187 KiB/s wr, 25 op/s 2023-05-08T06:55:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11449.661317 secs 2023-05-08T06:55:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:11 smithi133 ceph-mon[125939]: osdmap e462: 12 total, 12 up, 12 in 2023-05-08T06:55:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:11 smithi096 ceph-mon[124666]: osdmap e462: 12 total, 12 up, 12 in 2023-05-08T06:55:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:11 smithi186 ceph-mon[126480]: osdmap e462: 12 total, 12 up, 12 in 2023-05-08T06:55:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:12 smithi133 ceph-mon[125939]: pgmap v6165: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 108 KiB/s wr, 25 op/s 2023-05-08T06:55:13.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:12 smithi096 ceph-mon[124666]: pgmap v6165: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 108 KiB/s wr, 25 op/s 2023-05-08T06:55:13.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:12 smithi186 ceph-mon[126480]: pgmap v6165: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 108 KiB/s wr, 25 op/s 2023-05-08T06:55:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11452.821182 secs 2023-05-08T06:55:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:14 smithi133 ceph-mon[125939]: pgmap v6166: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 108 KiB/s wr, 25 op/s 2023-05-08T06:55:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11453.379785 secs 2023-05-08T06:55:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11452.821182 secs 2023-05-08T06:55:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:14 smithi096 ceph-mon[124666]: pgmap v6166: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 108 KiB/s wr, 25 op/s 2023-05-08T06:55:15.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11453.379785 secs 2023-05-08T06:55:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11452.821182 secs 2023-05-08T06:55:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:14 smithi186 ceph-mon[126480]: pgmap v6166: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 108 KiB/s wr, 25 op/s 2023-05-08T06:55:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11453.379785 secs 2023-05-08T06:55:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11454.661455 secs 2023-05-08T06:55:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11454.661455 secs 2023-05-08T06:55:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11454.661455 secs 2023-05-08T06:55:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:16 smithi133 ceph-mon[125939]: pgmap v6167: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 60 KiB/s wr, 9 op/s 2023-05-08T06:55:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:16 smithi096 ceph-mon[124666]: pgmap v6167: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 60 KiB/s wr, 9 op/s 2023-05-08T06:55:17.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:16 smithi186 ceph-mon[126480]: pgmap v6167: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 60 KiB/s wr, 9 op/s 2023-05-08T06:55:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:18 smithi133 ceph-mon[125939]: pgmap v6168: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 60 KiB/s wr, 9 op/s 2023-05-08T06:55:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:18 smithi096 ceph-mon[124666]: pgmap v6168: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 60 KiB/s wr, 9 op/s 2023-05-08T06:55:19.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:18 smithi186 ceph-mon[126480]: pgmap v6168: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 60 KiB/s wr, 9 op/s 2023-05-08T06:55:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11457.821330 secs 2023-05-08T06:55:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11458.379899 secs 2023-05-08T06:55:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11457.821330 secs 2023-05-08T06:55:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11458.379899 secs 2023-05-08T06:55:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11457.821330 secs 2023-05-08T06:55:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11458.379899 secs 2023-05-08T06:55:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:20 smithi133 ceph-mon[125939]: pgmap v6169: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 101 KiB/s wr, 9 op/s 2023-05-08T06:55:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11459.661578 secs 2023-05-08T06:55:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:20 smithi133 ceph-mon[125939]: osdmap e463: 12 total, 12 up, 12 in 2023-05-08T06:55:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:20 smithi096 ceph-mon[124666]: pgmap v6169: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 101 KiB/s wr, 9 op/s 2023-05-08T06:55:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11459.661578 secs 2023-05-08T06:55:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:20 smithi096 ceph-mon[124666]: osdmap e463: 12 total, 12 up, 12 in 2023-05-08T06:55:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:20 smithi186 ceph-mon[126480]: pgmap v6169: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 101 KiB/s wr, 9 op/s 2023-05-08T06:55:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11459.661578 secs 2023-05-08T06:55:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:20 smithi186 ceph-mon[126480]: osdmap e463: 12 total, 12 up, 12 in 2023-05-08T06:55:22.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:22 smithi133 ceph-mon[125939]: pgmap v6171: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 101 KiB/s wr, 9 op/s 2023-05-08T06:55:23.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:22 smithi096 ceph-mon[124666]: pgmap v6171: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 101 KiB/s wr, 9 op/s 2023-05-08T06:55:23.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:22 smithi186 ceph-mon[126480]: pgmap v6171: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 101 KiB/s wr, 9 op/s 2023-05-08T06:55:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11462.821391 secs 2023-05-08T06:55:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11462.821391 secs 2023-05-08T06:55:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11462.821391 secs 2023-05-08T06:55:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:24 smithi133 ceph-mon[125939]: pgmap v6172: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 101 KiB/s wr, 9 op/s 2023-05-08T06:55:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11463.379993 secs 2023-05-08T06:55:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:24 smithi096 ceph-mon[124666]: pgmap v6172: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 101 KiB/s wr, 9 op/s 2023-05-08T06:55:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11463.379993 secs 2023-05-08T06:55:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:24 smithi186 ceph-mon[126480]: pgmap v6172: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 101 KiB/s wr, 9 op/s 2023-05-08T06:55:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11463.379993 secs 2023-05-08T06:55:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11464.661682 secs 2023-05-08T06:55:25.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:25 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:55:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11464.661682 secs 2023-05-08T06:55:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:25 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:55:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11464.661682 secs 2023-05-08T06:55:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:25 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:55:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:26 smithi133 ceph-mon[125939]: pgmap v6173: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 96 KiB/s wr, 9 op/s 2023-05-08T06:55:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:55:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:55:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:26 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:55:26.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:55:26.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:26 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T06:55:26.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:26 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T06:55:26.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:26 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:55:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:26 smithi096 ceph-mon[124666]: pgmap v6173: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 96 KiB/s wr, 9 op/s 2023-05-08T06:55:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:55:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:55:27.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:26 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:55:27.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:55:27.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:26 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T06:55:27.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:26 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T06:55:27.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:26 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:55:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:26 smithi186 ceph-mon[126480]: pgmap v6173: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 96 KiB/s wr, 9 op/s 2023-05-08T06:55:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:55:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:55:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:26 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:55:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:55:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:26 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T06:55:27.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:26 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T06:55:27.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:26 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:55:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:28 smithi133 ceph-mon[125939]: pgmap v6174: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 96 KiB/s wr, 9 op/s 2023-05-08T06:55:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11467.821500 secs 2023-05-08T06:55:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:28 smithi096 ceph-mon[124666]: pgmap v6174: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 96 KiB/s wr, 9 op/s 2023-05-08T06:55:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11467.821500 secs 2023-05-08T06:55:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:28 smithi186 ceph-mon[126480]: pgmap v6174: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 96 KiB/s wr, 9 op/s 2023-05-08T06:55:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11467.821500 secs 2023-05-08T06:55:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11468.380107 secs 2023-05-08T06:55:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11468.380107 secs 2023-05-08T06:55:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11468.380107 secs 2023-05-08T06:55:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:30 smithi133 ceph-mon[125939]: pgmap v6175: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 44 KiB/s wr, 8 op/s 2023-05-08T06:55:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11469.661814 secs 2023-05-08T06:55:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:30 smithi096 ceph-mon[124666]: pgmap v6175: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 44 KiB/s wr, 8 op/s 2023-05-08T06:55:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11469.661814 secs 2023-05-08T06:55:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:30 smithi186 ceph-mon[126480]: pgmap v6175: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 44 KiB/s wr, 8 op/s 2023-05-08T06:55:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11469.661814 secs 2023-05-08T06:55:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:32 smithi133 ceph-mon[125939]: pgmap v6176: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 40 KiB/s wr, 8 op/s 2023-05-08T06:55:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:32 smithi096 ceph-mon[124666]: pgmap v6176: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 40 KiB/s wr, 8 op/s 2023-05-08T06:55:33.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:32 smithi186 ceph-mon[126480]: pgmap v6176: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 40 KiB/s wr, 8 op/s 2023-05-08T06:55:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11472.821619 secs 2023-05-08T06:55:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11472.821619 secs 2023-05-08T06:55:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11472.821619 secs 2023-05-08T06:55:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:34 smithi096 ceph-mon[124666]: pgmap v6177: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 36 KiB/s wr, 7 op/s 2023-05-08T06:55:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11473.380259 secs 2023-05-08T06:55:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:34 smithi186 ceph-mon[126480]: pgmap v6177: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 36 KiB/s wr, 7 op/s 2023-05-08T06:55:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11473.380259 secs 2023-05-08T06:55:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:34 smithi133 ceph-mon[125939]: pgmap v6177: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 36 KiB/s wr, 7 op/s 2023-05-08T06:55:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11473.380259 secs 2023-05-08T06:55:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11474.661932 secs 2023-05-08T06:55:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11474.661932 secs 2023-05-08T06:55:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11474.661932 secs 2023-05-08T06:55:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:36 smithi096 ceph-mon[124666]: pgmap v6178: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 37 KiB/s wr, 10 op/s 2023-05-08T06:55:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:36 smithi186 ceph-mon[126480]: pgmap v6178: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 37 KiB/s wr, 10 op/s 2023-05-08T06:55:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:36 smithi133 ceph-mon[125939]: pgmap v6178: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 37 KiB/s wr, 10 op/s 2023-05-08T06:55:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:38 smithi096 ceph-mon[124666]: pgmap v6179: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 6 op/s 2023-05-08T06:55:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11477.821732 secs 2023-05-08T06:55:39.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:38 smithi186 ceph-mon[126480]: pgmap v6179: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 6 op/s 2023-05-08T06:55:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11477.821732 secs 2023-05-08T06:55:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:38 smithi133 ceph-mon[125939]: pgmap v6179: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 6 op/s 2023-05-08T06:55:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11477.821732 secs 2023-05-08T06:55:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11478.380370 secs 2023-05-08T06:55:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11478.380370 secs 2023-05-08T06:55:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11478.380370 secs 2023-05-08T06:55:41.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:40 smithi186 ceph-mon[126480]: pgmap v6180: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 63 KiB/s wr, 9 op/s 2023-05-08T06:55:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11479.661999 secs 2023-05-08T06:55:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:40 smithi133 ceph-mon[125939]: pgmap v6180: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 63 KiB/s wr, 9 op/s 2023-05-08T06:55:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11479.661999 secs 2023-05-08T06:55:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:40 smithi096 ceph-mon[124666]: pgmap v6180: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 63 KiB/s wr, 9 op/s 2023-05-08T06:55:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11479.661999 secs 2023-05-08T06:55:43.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:42 smithi186 ceph-mon[126480]: pgmap v6181: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 28 KiB/s wr, 6 op/s 2023-05-08T06:55:43.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:42 smithi133 ceph-mon[125939]: pgmap v6181: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 28 KiB/s wr, 6 op/s 2023-05-08T06:55:43.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:42 smithi096 ceph-mon[124666]: pgmap v6181: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 28 KiB/s wr, 6 op/s 2023-05-08T06:55:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11482.821874 secs 2023-05-08T06:55:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11482.821874 secs 2023-05-08T06:55:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11482.821874 secs 2023-05-08T06:55:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:44 smithi186 ceph-mon[126480]: pgmap v6182: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 28 KiB/s wr, 6 op/s 2023-05-08T06:55:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:44 smithi133 ceph-mon[125939]: pgmap v6182: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 28 KiB/s wr, 6 op/s 2023-05-08T06:55:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:44 smithi096 ceph-mon[124666]: pgmap v6182: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 28 KiB/s wr, 6 op/s 2023-05-08T06:55:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11484.662121 secs 2023-05-08T06:55:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11484.662121 secs 2023-05-08T06:55:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11484.662121 secs 2023-05-08T06:55:47.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:46 smithi186 ceph-mon[126480]: pgmap v6183: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 60 KiB/s wr, 10 op/s 2023-05-08T06:55:47.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:46 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:55:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:46 smithi133 ceph-mon[125939]: pgmap v6183: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 60 KiB/s wr, 10 op/s 2023-05-08T06:55:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:46 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:55:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:46 smithi096 ceph-mon[124666]: pgmap v6183: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 60 KiB/s wr, 10 op/s 2023-05-08T06:55:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:46 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:55:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:47 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:55:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:47 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:55:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:47 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:55:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:47 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:55:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:47 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:55:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:47 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:55:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:47 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:55:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:47 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:55:48.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:47 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:55:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:48 smithi186 ceph-mon[126480]: pgmap v6184: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 60 KiB/s wr, 7 op/s 2023-05-08T06:55:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11487.822022 secs 2023-05-08T06:55:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:48 smithi133 ceph-mon[125939]: pgmap v6184: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 60 KiB/s wr, 7 op/s 2023-05-08T06:55:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11487.822022 secs 2023-05-08T06:55:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:48 smithi096 ceph-mon[124666]: pgmap v6184: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 60 KiB/s wr, 7 op/s 2023-05-08T06:55:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11487.822022 secs 2023-05-08T06:55:51.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:50 smithi186 ceph-mon[126480]: pgmap v6185: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 138 KiB/s wr, 12 op/s 2023-05-08T06:55:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:50 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:55:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:50 smithi133 ceph-mon[125939]: pgmap v6185: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 138 KiB/s wr, 12 op/s 2023-05-08T06:55:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:50 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:55:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:50 smithi096 ceph-mon[124666]: pgmap v6185: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 138 KiB/s wr, 12 op/s 2023-05-08T06:55:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:50 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:55:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:55:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:55:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:55:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:55:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:55:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:55:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:52 smithi186 ceph-mon[126480]: pgmap v6186: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 111 KiB/s wr, 9 op/s 2023-05-08T06:55:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:52 smithi133 ceph-mon[125939]: pgmap v6186: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 111 KiB/s wr, 9 op/s 2023-05-08T06:55:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:52 smithi096 ceph-mon[124666]: pgmap v6186: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 111 KiB/s wr, 9 op/s 2023-05-08T06:55:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11492.822129 secs 2023-05-08T06:55:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11492.822129 secs 2023-05-08T06:55:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11492.822129 secs 2023-05-08T06:55:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:54 smithi186 ceph-mon[126480]: pgmap v6187: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 111 KiB/s wr, 9 op/s 2023-05-08T06:55:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11493.380738 secs 2023-05-08T06:55:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:54 smithi133 ceph-mon[125939]: pgmap v6187: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 111 KiB/s wr, 9 op/s 2023-05-08T06:55:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11493.380738 secs 2023-05-08T06:55:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:54 smithi096 ceph-mon[124666]: pgmap v6187: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 111 KiB/s wr, 9 op/s 2023-05-08T06:55:55.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11493.380738 secs 2023-05-08T06:55:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:55 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:55:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:55 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:55:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:55 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:55:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:55 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:55:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:55 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:55:56.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:55 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:55:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:55 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:55:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:55 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:55:56.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:55 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:55:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:56 smithi186 ceph-mon[126480]: pgmap v6188: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 146 KiB/s wr, 13 op/s 2023-05-08T06:55:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:56 smithi133 ceph-mon[125939]: pgmap v6188: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 146 KiB/s wr, 13 op/s 2023-05-08T06:55:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:56 smithi096 ceph-mon[124666]: pgmap v6188: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 146 KiB/s wr, 13 op/s 2023-05-08T06:55:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:58 smithi186 ceph-mon[126480]: pgmap v6189: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 114 KiB/s wr, 9 op/s 2023-05-08T06:55:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:55:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11497.822249 secs 2023-05-08T06:55:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:58 smithi133 ceph-mon[125939]: pgmap v6189: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 114 KiB/s wr, 9 op/s 2023-05-08T06:55:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:55:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11497.822249 secs 2023-05-08T06:55:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:58 smithi096 ceph-mon[124666]: pgmap v6189: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 114 KiB/s wr, 9 op/s 2023-05-08T06:55:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:55:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11497.822249 secs 2023-05-08T06:56:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:00 smithi186 ceph-mon[126480]: pgmap v6190: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 237 KiB/s wr, 13 op/s 2023-05-08T06:56:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11499.662519 secs 2023-05-08T06:56:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:00 smithi133 ceph-mon[125939]: pgmap v6190: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 237 KiB/s wr, 13 op/s 2023-05-08T06:56:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11499.662519 secs 2023-05-08T06:56:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:00 smithi096 ceph-mon[124666]: pgmap v6190: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 237 KiB/s wr, 13 op/s 2023-05-08T06:56:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11499.662519 secs 2023-05-08T06:56:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:02 smithi186 ceph-mon[126480]: pgmap v6191: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 159 KiB/s wr, 8 op/s 2023-05-08T06:56:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:02 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:56:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:02 smithi133 ceph-mon[125939]: pgmap v6191: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 159 KiB/s wr, 8 op/s 2023-05-08T06:56:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:02 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:56:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:02 smithi096 ceph-mon[124666]: pgmap v6191: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 159 KiB/s wr, 8 op/s 2023-05-08T06:56:03.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:02 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:56:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:56:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:56:04.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:03 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:56:04.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11502.822388 secs 2023-05-08T06:56:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:56:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:56:04.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:03 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:56:04.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11502.822388 secs 2023-05-08T06:56:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:56:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:56:04.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:03 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:56:04.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11502.822388 secs 2023-05-08T06:56:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:04 smithi186 ceph-mon[126480]: pgmap v6192: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 159 KiB/s wr, 8 op/s 2023-05-08T06:56:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11503.380959 secs 2023-05-08T06:56:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:04 smithi133 ceph-mon[125939]: pgmap v6192: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 159 KiB/s wr, 8 op/s 2023-05-08T06:56:05.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11503.380959 secs 2023-05-08T06:56:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:04 smithi096 ceph-mon[124666]: pgmap v6192: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 159 KiB/s wr, 8 op/s 2023-05-08T06:56:05.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11503.380959 secs 2023-05-08T06:56:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11504.662619 secs 2023-05-08T06:56:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11504.662619 secs 2023-05-08T06:56:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11504.662619 secs 2023-05-08T06:56:07.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:06 smithi186 ceph-mon[126480]: pgmap v6193: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 229 KiB/s wr, 27 op/s 2023-05-08T06:56:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:06 smithi133 ceph-mon[125939]: pgmap v6193: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 229 KiB/s wr, 27 op/s 2023-05-08T06:56:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:06 smithi096 ceph-mon[124666]: pgmap v6193: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 229 KiB/s wr, 27 op/s 2023-05-08T06:56:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:07 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:56:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:07 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:56:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:07 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:56:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:07 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:56:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:07 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:56:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:07 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:56:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:07 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:56:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:07 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:56:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:07 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:56:09.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:08 smithi133 ceph-mon[125939]: pgmap v6194: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 194 KiB/s wr, 23 op/s 2023-05-08T06:56:09.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11507.822501 secs 2023-05-08T06:56:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:08 smithi096 ceph-mon[124666]: pgmap v6194: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 194 KiB/s wr, 23 op/s 2023-05-08T06:56:09.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11507.822501 secs 2023-05-08T06:56:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:08 smithi186 ceph-mon[126480]: pgmap v6194: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 194 KiB/s wr, 23 op/s 2023-05-08T06:56:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11507.822501 secs 2023-05-08T06:56:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11508.381075 secs 2023-05-08T06:56:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11508.381075 secs 2023-05-08T06:56:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11508.381075 secs 2023-05-08T06:56:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:10 smithi133 ceph-mon[125939]: pgmap v6195: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 217 KiB/s wr, 26 op/s 2023-05-08T06:56:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11509.662753 secs 2023-05-08T06:56:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:10 smithi096 ceph-mon[124666]: pgmap v6195: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 217 KiB/s wr, 26 op/s 2023-05-08T06:56:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11509.662753 secs 2023-05-08T06:56:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:10 smithi186 ceph-mon[126480]: pgmap v6195: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 217 KiB/s wr, 26 op/s 2023-05-08T06:56:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11509.662753 secs 2023-05-08T06:56:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:11 smithi133 ceph-mon[125939]: osdmap e464: 12 total, 12 up, 12 in 2023-05-08T06:56:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:11 smithi096 ceph-mon[124666]: osdmap e464: 12 total, 12 up, 12 in 2023-05-08T06:56:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:11 smithi186 ceph-mon[126480]: osdmap e464: 12 total, 12 up, 12 in 2023-05-08T06:56:13.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:12 smithi133 ceph-mon[125939]: pgmap v6197: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 112 KiB/s wr, 26 op/s 2023-05-08T06:56:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:12 smithi096 ceph-mon[124666]: pgmap v6197: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 112 KiB/s wr, 26 op/s 2023-05-08T06:56:13.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:12 smithi186 ceph-mon[126480]: pgmap v6197: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 112 KiB/s wr, 26 op/s 2023-05-08T06:56:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11512.822614 secs 2023-05-08T06:56:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11512.822614 secs 2023-05-08T06:56:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11512.822614 secs 2023-05-08T06:56:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:14 smithi133 ceph-mon[125939]: pgmap v6198: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 112 KiB/s wr, 26 op/s 2023-05-08T06:56:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11513.381228 secs 2023-05-08T06:56:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:14 smithi096 ceph-mon[124666]: pgmap v6198: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 112 KiB/s wr, 26 op/s 2023-05-08T06:56:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11513.381228 secs 2023-05-08T06:56:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:14 smithi186 ceph-mon[126480]: pgmap v6198: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 112 KiB/s wr, 26 op/s 2023-05-08T06:56:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11513.381228 secs 2023-05-08T06:56:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11514.662877 secs 2023-05-08T06:56:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11514.662877 secs 2023-05-08T06:56:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11514.662877 secs 2023-05-08T06:56:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:16 smithi133 ceph-mon[125939]: pgmap v6199: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 34 KiB/s wr, 8 op/s 2023-05-08T06:56:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:16 smithi096 ceph-mon[124666]: pgmap v6199: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 34 KiB/s wr, 8 op/s 2023-05-08T06:56:17.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:16 smithi186 ceph-mon[126480]: pgmap v6199: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 34 KiB/s wr, 8 op/s 2023-05-08T06:56:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:18 smithi133 ceph-mon[125939]: pgmap v6200: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 34 KiB/s wr, 8 op/s 2023-05-08T06:56:19.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11517.822733 secs 2023-05-08T06:56:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:18 smithi096 ceph-mon[124666]: pgmap v6200: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 34 KiB/s wr, 8 op/s 2023-05-08T06:56:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11517.822733 secs 2023-05-08T06:56:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:18 smithi186 ceph-mon[126480]: pgmap v6200: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 34 KiB/s wr, 8 op/s 2023-05-08T06:56:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11517.822733 secs 2023-05-08T06:56:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11518.381339 secs 2023-05-08T06:56:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11518.381339 secs 2023-05-08T06:56:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11518.381339 secs 2023-05-08T06:56:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:20 smithi133 ceph-mon[125939]: pgmap v6201: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 6.9 KiB/s wr, 8 op/s 2023-05-08T06:56:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11519.662938 secs 2023-05-08T06:56:21.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:20 smithi133 ceph-mon[125939]: osdmap e465: 12 total, 12 up, 12 in 2023-05-08T06:56:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:20 smithi096 ceph-mon[124666]: pgmap v6201: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 6.9 KiB/s wr, 8 op/s 2023-05-08T06:56:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11519.662938 secs 2023-05-08T06:56:21.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:20 smithi096 ceph-mon[124666]: osdmap e465: 12 total, 12 up, 12 in 2023-05-08T06:56:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:20 smithi186 ceph-mon[126480]: pgmap v6201: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 6.9 KiB/s wr, 8 op/s 2023-05-08T06:56:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11519.662938 secs 2023-05-08T06:56:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:20 smithi186 ceph-mon[126480]: osdmap e465: 12 total, 12 up, 12 in 2023-05-08T06:56:23.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:22 smithi133 ceph-mon[125939]: pgmap v6203: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 6.8 KiB/s wr, 8 op/s 2023-05-08T06:56:23.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:22 smithi096 ceph-mon[124666]: pgmap v6203: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 6.8 KiB/s wr, 8 op/s 2023-05-08T06:56:23.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:22 smithi186 ceph-mon[126480]: pgmap v6203: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 6.8 KiB/s wr, 8 op/s 2023-05-08T06:56:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:23 smithi133 ceph-mon[125939]: 1 slow requests, 1 included below; oldest blocked for > 11522.822821 secs 2023-05-08T06:56:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:23 smithi133 ceph-mon[125939]: slow request 11522.822820 seconds old, received at 2023-05-08T03:44:20.260233+0000: client_request(client.15258:3163 link #0x10000000007/0000000100000000000000F2 #0x10000000007/0000000100000000000000C5 2023-05-08T03:44:20.259302+0000 caller_uid=26, caller_gid=26{26,}) currently acquired locks 2023-05-08T06:56:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:23 smithi096 ceph-mon[124666]: 1 slow requests, 1 included below; oldest blocked for > 11522.822821 secs 2023-05-08T06:56:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:23 smithi096 ceph-mon[124666]: slow request 11522.822820 seconds old, received at 2023-05-08T03:44:20.260233+0000: client_request(client.15258:3163 link #0x10000000007/0000000100000000000000F2 #0x10000000007/0000000100000000000000C5 2023-05-08T03:44:20.259302+0000 caller_uid=26, caller_gid=26{26,}) currently acquired locks 2023-05-08T06:56:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:23 smithi186 ceph-mon[126480]: 1 slow requests, 1 included below; oldest blocked for > 11522.822821 secs 2023-05-08T06:56:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:23 smithi186 ceph-mon[126480]: slow request 11522.822820 seconds old, received at 2023-05-08T03:44:20.260233+0000: client_request(client.15258:3163 link #0x10000000007/0000000100000000000000F2 #0x10000000007/0000000100000000000000C5 2023-05-08T03:44:20.259302+0000 caller_uid=26, caller_gid=26{26,}) currently acquired locks 2023-05-08T06:56:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:24 smithi133 ceph-mon[125939]: pgmap v6204: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 6.8 KiB/s wr, 8 op/s 2023-05-08T06:56:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:24 smithi133 ceph-mon[125939]: 1 slow requests, 1 included below; oldest blocked for > 11523.381456 secs 2023-05-08T06:56:25.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:24 smithi133 ceph-mon[125939]: slow request 11523.381455 seconds old, received at 2023-05-08T03:44:20.272100+0000: peer_request:client.15258:3163 currently acquired locks 2023-05-08T06:56:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:24 smithi096 ceph-mon[124666]: pgmap v6204: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 6.8 KiB/s wr, 8 op/s 2023-05-08T06:56:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:24 smithi096 ceph-mon[124666]: 1 slow requests, 1 included below; oldest blocked for > 11523.381456 secs 2023-05-08T06:56:25.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:24 smithi096 ceph-mon[124666]: slow request 11523.381455 seconds old, received at 2023-05-08T03:44:20.272100+0000: peer_request:client.15258:3163 currently acquired locks 2023-05-08T06:56:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:24 smithi186 ceph-mon[126480]: pgmap v6204: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 6.8 KiB/s wr, 8 op/s 2023-05-08T06:56:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:24 smithi186 ceph-mon[126480]: 1 slow requests, 1 included below; oldest blocked for > 11523.381456 secs 2023-05-08T06:56:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:24 smithi186 ceph-mon[126480]: slow request 11523.381455 seconds old, received at 2023-05-08T03:44:20.272100+0000: peer_request:client.15258:3163 currently acquired locks 2023-05-08T06:56:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:25 smithi133 ceph-mon[125939]: 1 slow requests, 1 included below; oldest blocked for > 11524.663005 secs 2023-05-08T06:56:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:25 smithi133 ceph-mon[125939]: slow request 11524.663004 seconds old, received at 2023-05-08T03:44:20.261840+0000: peer_request:client.15258:3163 currently dispatched 2023-05-08T06:56:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:25 smithi096 ceph-mon[124666]: 1 slow requests, 1 included below; oldest blocked for > 11524.663005 secs 2023-05-08T06:56:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:25 smithi096 ceph-mon[124666]: slow request 11524.663004 seconds old, received at 2023-05-08T03:44:20.261840+0000: peer_request:client.15258:3163 currently dispatched 2023-05-08T06:56:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:25 smithi186 ceph-mon[126480]: 1 slow requests, 1 included below; oldest blocked for > 11524.663005 secs 2023-05-08T06:56:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:25 smithi186 ceph-mon[126480]: slow request 11524.663004 seconds old, received at 2023-05-08T03:44:20.261840+0000: peer_request:client.15258:3163 currently dispatched 2023-05-08T06:56:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:26 smithi133 ceph-mon[125939]: pgmap v6205: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 34 KiB/s wr, 7 op/s 2023-05-08T06:56:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:56:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:26 smithi096 ceph-mon[124666]: pgmap v6205: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 34 KiB/s wr, 7 op/s 2023-05-08T06:56:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:56:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:26 smithi186 ceph-mon[126480]: pgmap v6205: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 34 KiB/s wr, 7 op/s 2023-05-08T06:56:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:56:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:28 smithi133 ceph-mon[125939]: pgmap v6206: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 34 KiB/s wr, 7 op/s 2023-05-08T06:56:29.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11527.822944 secs 2023-05-08T06:56:29.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:28 smithi096 ceph-mon[124666]: pgmap v6206: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 34 KiB/s wr, 7 op/s 2023-05-08T06:56:29.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11527.822944 secs 2023-05-08T06:56:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:28 smithi186 ceph-mon[126480]: pgmap v6206: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 34 KiB/s wr, 7 op/s 2023-05-08T06:56:29.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11527.822944 secs 2023-05-08T06:56:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11528.381518 secs 2023-05-08T06:56:30.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:56:30.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:56:30.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:56:30.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:56:30.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:56:30.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:56:30.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:56:30.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:56:30.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:56:30.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:56:30.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:56:30.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:56:30.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:56:30.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:56:30.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:56:30.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:56:30.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:56:30.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:56:30.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:56:30.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:56:30.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:56:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11528.381518 secs 2023-05-08T06:56:30.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:56:30.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:56:30.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:56:30.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:56:30.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:56:30.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:56:30.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:56:30.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:56:30.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:56:30.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:56:30.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:56:30.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:56:30.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:56:30.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:56:30.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:56:30.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:56:30.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:56:30.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:56:30.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:56:30.509 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:56:30.509 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:56:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11528.381518 secs 2023-05-08T06:56:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:56:30.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:56:30.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:56:30.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:56:30.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:56:30.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:56:30.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:56:30.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:56:30.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:56:30.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:56:30.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:56:30.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:56:30.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:56:30.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:56:30.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:56:30.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:56:30.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:56:30.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T06:56:30.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:56:30.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:56:30.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:56:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:31 smithi096 ceph-mon[124666]: pgmap v6207: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 67 KiB/s wr, 8 op/s 2023-05-08T06:56:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:31 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi096 to 187.0M 2023-05-08T06:56:31.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:31 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T06:56:31.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:31 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi096 to 196103082: error parsing value: Value '196103082' is below minimum 939524096 2023-05-08T06:56:31.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:31 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T06:56:31.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:31 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T06:56:31.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:31 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T06:56:31.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:31 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:56:31.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:31 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T06:56:31.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:31 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T06:56:31.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:31 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:56:31.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11529.663091 secs 2023-05-08T06:56:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:31 smithi186 ceph-mon[126480]: pgmap v6207: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 67 KiB/s wr, 8 op/s 2023-05-08T06:56:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:31 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi096 to 187.0M 2023-05-08T06:56:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:31 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T06:56:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:31 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi096 to 196103082: error parsing value: Value '196103082' is below minimum 939524096 2023-05-08T06:56:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:31 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T06:56:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:31 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T06:56:31.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:31 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T06:56:31.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:31 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:56:31.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:31 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T06:56:31.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:31 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T06:56:31.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:31 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:56:31.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11529.663091 secs 2023-05-08T06:56:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:31 smithi133 ceph-mon[125939]: pgmap v6207: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 67 KiB/s wr, 8 op/s 2023-05-08T06:56:31.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:31 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi096 to 187.0M 2023-05-08T06:56:31.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:31 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T06:56:31.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:31 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi096 to 196103082: error parsing value: Value '196103082' is below minimum 939524096 2023-05-08T06:56:31.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:31 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T06:56:31.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:31 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T06:56:31.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:31 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T06:56:31.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:31 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:56:31.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:31 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T06:56:31.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:31 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T06:56:31.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:31 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:56:31.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11529.663091 secs 2023-05-08T06:56:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:33 smithi096 ceph-mon[124666]: pgmap v6208: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 62 KiB/s wr, 7 op/s 2023-05-08T06:56:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:33 smithi186 ceph-mon[126480]: pgmap v6208: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 62 KiB/s wr, 7 op/s 2023-05-08T06:56:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:33 smithi133 ceph-mon[125939]: pgmap v6208: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 62 KiB/s wr, 7 op/s 2023-05-08T06:56:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11532.823042 secs 2023-05-08T06:56:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11533.381638 secs 2023-05-08T06:56:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11532.823042 secs 2023-05-08T06:56:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11533.381638 secs 2023-05-08T06:56:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11532.823042 secs 2023-05-08T06:56:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11533.381638 secs 2023-05-08T06:56:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:35 smithi186 ceph-mon[126480]: pgmap v6209: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 6 op/s 2023-05-08T06:56:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:35 smithi133 ceph-mon[125939]: pgmap v6209: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 6 op/s 2023-05-08T06:56:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:35 smithi096 ceph-mon[124666]: pgmap v6209: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 6 op/s 2023-05-08T06:56:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11534.663215 secs 2023-05-08T06:56:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11534.663215 secs 2023-05-08T06:56:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11534.663215 secs 2023-05-08T06:56:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:37 smithi186 ceph-mon[126480]: pgmap v6210: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 84 KiB/s wr, 9 op/s 2023-05-08T06:56:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:37 smithi133 ceph-mon[125939]: pgmap v6210: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 84 KiB/s wr, 9 op/s 2023-05-08T06:56:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:37 smithi096 ceph-mon[124666]: pgmap v6210: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 84 KiB/s wr, 9 op/s 2023-05-08T06:56:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:39 smithi186 ceph-mon[126480]: pgmap v6211: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 6 op/s 2023-05-08T06:56:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11537.823167 secs 2023-05-08T06:56:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11538.381750 secs 2023-05-08T06:56:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:39 smithi133 ceph-mon[125939]: pgmap v6211: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 6 op/s 2023-05-08T06:56:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11537.823167 secs 2023-05-08T06:56:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11538.381750 secs 2023-05-08T06:56:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:39 smithi096 ceph-mon[124666]: pgmap v6211: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 6 op/s 2023-05-08T06:56:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11537.823167 secs 2023-05-08T06:56:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11538.381750 secs 2023-05-08T06:56:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:41 smithi186 ceph-mon[126480]: pgmap v6212: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 84 KiB/s wr, 10 op/s 2023-05-08T06:56:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11539.663332 secs 2023-05-08T06:56:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:41 smithi133 ceph-mon[125939]: pgmap v6212: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 84 KiB/s wr, 10 op/s 2023-05-08T06:56:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11539.663332 secs 2023-05-08T06:56:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:41 smithi096 ceph-mon[124666]: pgmap v6212: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 84 KiB/s wr, 10 op/s 2023-05-08T06:56:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11539.663332 secs 2023-05-08T06:56:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:43 smithi186 ceph-mon[126480]: pgmap v6213: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 6 op/s 2023-05-08T06:56:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:43 smithi133 ceph-mon[125939]: pgmap v6213: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 6 op/s 2023-05-08T06:56:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:43 smithi096 ceph-mon[124666]: pgmap v6213: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 6 op/s 2023-05-08T06:56:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11542.823294 secs 2023-05-08T06:56:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11542.823294 secs 2023-05-08T06:56:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11542.823294 secs 2023-05-08T06:56:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:45 smithi186 ceph-mon[126480]: pgmap v6214: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 6 op/s 2023-05-08T06:56:45.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:45 smithi133 ceph-mon[125939]: pgmap v6214: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 6 op/s 2023-05-08T06:56:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:45 smithi096 ceph-mon[124666]: pgmap v6214: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 6 op/s 2023-05-08T06:56:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11544.663454 secs 2023-05-08T06:56:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11544.663454 secs 2023-05-08T06:56:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11544.663454 secs 2023-05-08T06:56:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:47 smithi186 ceph-mon[126480]: pgmap v6215: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 116 KiB/s wr, 10 op/s 2023-05-08T06:56:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:56:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:47 smithi133 ceph-mon[125939]: pgmap v6215: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 116 KiB/s wr, 10 op/s 2023-05-08T06:56:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:56:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:47 smithi096 ceph-mon[124666]: pgmap v6215: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 116 KiB/s wr, 10 op/s 2023-05-08T06:56:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:56:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:48 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:56:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:56:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:56:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:48 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:56:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:56:48.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:56:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:48 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:56:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:56:48.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:56:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:49 smithi186 ceph-mon[126480]: pgmap v6216: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 89 KiB/s wr, 7 op/s 2023-05-08T06:56:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11547.823428 secs 2023-05-08T06:56:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:49 smithi133 ceph-mon[125939]: pgmap v6216: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 89 KiB/s wr, 7 op/s 2023-05-08T06:56:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11547.823428 secs 2023-05-08T06:56:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:49 smithi096 ceph-mon[124666]: pgmap v6216: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 89 KiB/s wr, 7 op/s 2023-05-08T06:56:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11547.823428 secs 2023-05-08T06:56:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:51 smithi186 ceph-mon[126480]: pgmap v6217: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 188 KiB/s wr, 12 op/s 2023-05-08T06:56:51.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:56:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:51 smithi133 ceph-mon[125939]: pgmap v6217: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 188 KiB/s wr, 12 op/s 2023-05-08T06:56:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:56:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:51 smithi096 ceph-mon[124666]: pgmap v6217: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 188 KiB/s wr, 12 op/s 2023-05-08T06:56:51.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:56:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:56:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:56:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:56:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:56:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:56:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:56:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:53 smithi186 ceph-mon[126480]: pgmap v6218: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 160 KiB/s wr, 9 op/s 2023-05-08T06:56:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:53 smithi133 ceph-mon[125939]: pgmap v6218: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 160 KiB/s wr, 9 op/s 2023-05-08T06:56:53.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:53 smithi096 ceph-mon[124666]: pgmap v6218: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 160 KiB/s wr, 9 op/s 2023-05-08T06:56:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11552.823546 secs 2023-05-08T06:56:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11553.382090 secs 2023-05-08T06:56:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11552.823546 secs 2023-05-08T06:56:54.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11553.382090 secs 2023-05-08T06:56:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11552.823546 secs 2023-05-08T06:56:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11553.382090 secs 2023-05-08T06:56:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:55 smithi186 ceph-mon[126480]: pgmap v6219: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 160 KiB/s wr, 9 op/s 2023-05-08T06:56:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:55 smithi133 ceph-mon[125939]: pgmap v6219: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 160 KiB/s wr, 9 op/s 2023-05-08T06:56:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:55 smithi096 ceph-mon[124666]: pgmap v6219: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 160 KiB/s wr, 9 op/s 2023-05-08T06:56:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:56 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:56:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:56:56.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:56:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:56 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:56:56.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:56:56.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:56:56.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:56 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:56:56.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:56:56.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:56:57.625 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:57 smithi186 ceph-mon[126480]: pgmap v6220: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 203 KiB/s wr, 13 op/s 2023-05-08T06:56:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:57 smithi133 ceph-mon[125939]: pgmap v6220: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 203 KiB/s wr, 13 op/s 2023-05-08T06:56:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:57 smithi096 ceph-mon[124666]: pgmap v6220: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 203 KiB/s wr, 13 op/s 2023-05-08T06:56:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:59 smithi186 ceph-mon[126480]: pgmap v6221: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 143 KiB/s wr, 9 op/s 2023-05-08T06:56:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11557.823613 secs 2023-05-08T06:56:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:56:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11558.382232 secs 2023-05-08T06:56:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:59 smithi133 ceph-mon[125939]: pgmap v6221: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 143 KiB/s wr, 9 op/s 2023-05-08T06:56:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11557.823613 secs 2023-05-08T06:56:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:56:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11558.382232 secs 2023-05-08T06:56:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:59 smithi096 ceph-mon[124666]: pgmap v6221: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 143 KiB/s wr, 9 op/s 2023-05-08T06:56:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11557.823613 secs 2023-05-08T06:56:59.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:56:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11558.382232 secs 2023-05-08T06:57:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:01 smithi186 ceph-mon[126480]: pgmap v6222: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 291 KiB/s wr, 13 op/s 2023-05-08T06:57:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:01 smithi133 ceph-mon[125939]: pgmap v6222: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 291 KiB/s wr, 13 op/s 2023-05-08T06:57:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:01 smithi096 ceph-mon[124666]: pgmap v6222: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 291 KiB/s wr, 13 op/s 2023-05-08T06:57:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:03 smithi186 ceph-mon[126480]: pgmap v6223: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 191 KiB/s wr, 8 op/s 2023-05-08T06:57:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:03 smithi133 ceph-mon[125939]: pgmap v6223: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 191 KiB/s wr, 8 op/s 2023-05-08T06:57:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:03 smithi096 ceph-mon[124666]: pgmap v6223: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 191 KiB/s wr, 8 op/s 2023-05-08T06:57:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11562.823730 secs 2023-05-08T06:57:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11563.382372 secs 2023-05-08T06:57:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11562.823730 secs 2023-05-08T06:57:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11563.382372 secs 2023-05-08T06:57:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11562.823730 secs 2023-05-08T06:57:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11563.382372 secs 2023-05-08T06:57:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:05 smithi186 ceph-mon[126480]: pgmap v6224: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 191 KiB/s wr, 8 op/s 2023-05-08T06:57:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:05 smithi133 ceph-mon[125939]: pgmap v6224: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 191 KiB/s wr, 8 op/s 2023-05-08T06:57:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:05 smithi096 ceph-mon[124666]: pgmap v6224: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 191 KiB/s wr, 8 op/s 2023-05-08T06:57:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11564.663965 secs 2023-05-08T06:57:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11564.663965 secs 2023-05-08T06:57:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11564.663965 secs 2023-05-08T06:57:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:07 smithi133 ceph-mon[125939]: pgmap v6225: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 248 KiB/s wr, 27 op/s 2023-05-08T06:57:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:07 smithi096 ceph-mon[124666]: pgmap v6225: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 248 KiB/s wr, 27 op/s 2023-05-08T06:57:07.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:07 smithi186 ceph-mon[126480]: pgmap v6225: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 248 KiB/s wr, 27 op/s 2023-05-08T06:57:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:08 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:57:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:57:08.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:57:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:08 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:57:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:57:08.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:57:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:08 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:57:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:57:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:57:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:09 smithi133 ceph-mon[125939]: pgmap v6226: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 205 KiB/s wr, 22 op/s 2023-05-08T06:57:09.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11567.823886 secs 2023-05-08T06:57:09.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11568.382511 secs 2023-05-08T06:57:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:09 smithi096 ceph-mon[124666]: pgmap v6226: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 205 KiB/s wr, 22 op/s 2023-05-08T06:57:09.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11567.823886 secs 2023-05-08T06:57:09.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11568.382511 secs 2023-05-08T06:57:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:09 smithi186 ceph-mon[126480]: pgmap v6226: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 205 KiB/s wr, 22 op/s 2023-05-08T06:57:09.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11567.823886 secs 2023-05-08T06:57:09.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11568.382511 secs 2023-05-08T06:57:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:11 smithi133 ceph-mon[125939]: pgmap v6227: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 274 KiB/s wr, 27 op/s 2023-05-08T06:57:11.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11569.664061 secs 2023-05-08T06:57:11.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:11 smithi133 ceph-mon[125939]: osdmap e466: 12 total, 12 up, 12 in 2023-05-08T06:57:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:11 smithi096 ceph-mon[124666]: pgmap v6227: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 274 KiB/s wr, 27 op/s 2023-05-08T06:57:11.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11569.664061 secs 2023-05-08T06:57:11.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:11 smithi096 ceph-mon[124666]: osdmap e466: 12 total, 12 up, 12 in 2023-05-08T06:57:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:11 smithi186 ceph-mon[126480]: pgmap v6227: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 274 KiB/s wr, 27 op/s 2023-05-08T06:57:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11569.664061 secs 2023-05-08T06:57:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:11 smithi186 ceph-mon[126480]: osdmap e466: 12 total, 12 up, 12 in 2023-05-08T06:57:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:13 smithi133 ceph-mon[125939]: pgmap v6229: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 151 KiB/s wr, 28 op/s 2023-05-08T06:57:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:13 smithi096 ceph-mon[124666]: pgmap v6229: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 151 KiB/s wr, 28 op/s 2023-05-08T06:57:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:13 smithi186 ceph-mon[126480]: pgmap v6229: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 151 KiB/s wr, 28 op/s 2023-05-08T06:57:14.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11572.824040 secs 2023-05-08T06:57:14.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11573.382584 secs 2023-05-08T06:57:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11572.824040 secs 2023-05-08T06:57:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11573.382584 secs 2023-05-08T06:57:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11572.824040 secs 2023-05-08T06:57:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11573.382584 secs 2023-05-08T06:57:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:15 smithi133 ceph-mon[125939]: pgmap v6230: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 151 KiB/s wr, 28 op/s 2023-05-08T06:57:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:15 smithi096 ceph-mon[124666]: pgmap v6230: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 151 KiB/s wr, 28 op/s 2023-05-08T06:57:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:15 smithi186 ceph-mon[126480]: pgmap v6230: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 151 KiB/s wr, 28 op/s 2023-05-08T06:57:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11574.664164 secs 2023-05-08T06:57:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11574.664164 secs 2023-05-08T06:57:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11574.664164 secs 2023-05-08T06:57:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:17 smithi133 ceph-mon[125939]: pgmap v6231: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 116 KiB/s wr, 9 op/s 2023-05-08T06:57:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:17 smithi096 ceph-mon[124666]: pgmap v6231: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 116 KiB/s wr, 9 op/s 2023-05-08T06:57:17.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:17 smithi186 ceph-mon[126480]: pgmap v6231: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 116 KiB/s wr, 9 op/s 2023-05-08T06:57:19.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:19 smithi133 ceph-mon[125939]: pgmap v6232: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 116 KiB/s wr, 9 op/s 2023-05-08T06:57:19.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11577.824184 secs 2023-05-08T06:57:19.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11578.382673 secs 2023-05-08T06:57:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:19 smithi096 ceph-mon[124666]: pgmap v6232: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 116 KiB/s wr, 9 op/s 2023-05-08T06:57:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11577.824184 secs 2023-05-08T06:57:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11578.382673 secs 2023-05-08T06:57:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:19 smithi186 ceph-mon[126480]: pgmap v6232: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 116 KiB/s wr, 9 op/s 2023-05-08T06:57:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11577.824184 secs 2023-05-08T06:57:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11578.382673 secs 2023-05-08T06:57:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:21 smithi133 ceph-mon[125939]: pgmap v6233: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 57 KiB/s wr, 8 op/s 2023-05-08T06:57:21.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11579.664285 secs 2023-05-08T06:57:21.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:21 smithi133 ceph-mon[125939]: osdmap e467: 12 total, 12 up, 12 in 2023-05-08T06:57:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:21 smithi096 ceph-mon[124666]: pgmap v6233: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 57 KiB/s wr, 8 op/s 2023-05-08T06:57:21.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11579.664285 secs 2023-05-08T06:57:21.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:21 smithi096 ceph-mon[124666]: osdmap e467: 12 total, 12 up, 12 in 2023-05-08T06:57:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:21 smithi186 ceph-mon[126480]: pgmap v6233: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 57 KiB/s wr, 8 op/s 2023-05-08T06:57:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11579.664285 secs 2023-05-08T06:57:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:21 smithi186 ceph-mon[126480]: osdmap e467: 12 total, 12 up, 12 in 2023-05-08T06:57:23.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:23 smithi133 ceph-mon[125939]: pgmap v6235: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 56 KiB/s wr, 8 op/s 2023-05-08T06:57:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:23 smithi096 ceph-mon[124666]: pgmap v6235: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 56 KiB/s wr, 8 op/s 2023-05-08T06:57:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:23 smithi186 ceph-mon[126480]: pgmap v6235: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 56 KiB/s wr, 8 op/s 2023-05-08T06:57:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11582.824310 secs 2023-05-08T06:57:24.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:24 smithi133 ceph-mon[125939]: pgmap v6236: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 56 KiB/s wr, 8 op/s 2023-05-08T06:57:24.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11583.382789 secs 2023-05-08T06:57:24.760 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11582.824310 secs 2023-05-08T06:57:24.761 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:24 smithi096 ceph-mon[124666]: pgmap v6236: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 56 KiB/s wr, 8 op/s 2023-05-08T06:57:24.761 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11583.382789 secs 2023-05-08T06:57:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11582.824310 secs 2023-05-08T06:57:24.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:24 smithi186 ceph-mon[126480]: pgmap v6236: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 56 KiB/s wr, 8 op/s 2023-05-08T06:57:24.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11583.382789 secs 2023-05-08T06:57:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11584.664406 secs 2023-05-08T06:57:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11584.664406 secs 2023-05-08T06:57:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11584.664406 secs 2023-05-08T06:57:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:26 smithi133 ceph-mon[125939]: pgmap v6237: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 57 KiB/s wr, 8 op/s 2023-05-08T06:57:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:26 smithi096 ceph-mon[124666]: pgmap v6237: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 57 KiB/s wr, 8 op/s 2023-05-08T06:57:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:26 smithi186 ceph-mon[126480]: pgmap v6237: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 57 KiB/s wr, 8 op/s 2023-05-08T06:57:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:28 smithi133 ceph-mon[125939]: pgmap v6238: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 57 KiB/s wr, 8 op/s 2023-05-08T06:57:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:28 smithi096 ceph-mon[124666]: pgmap v6238: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 57 KiB/s wr, 8 op/s 2023-05-08T06:57:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:28 smithi186 ceph-mon[126480]: pgmap v6238: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 57 KiB/s wr, 8 op/s 2023-05-08T06:57:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11587.824431 secs 2023-05-08T06:57:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11588.382910 secs 2023-05-08T06:57:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11587.824431 secs 2023-05-08T06:57:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11588.382910 secs 2023-05-08T06:57:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11587.824431 secs 2023-05-08T06:57:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11588.382910 secs 2023-05-08T06:57:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:30 smithi133 ceph-mon[125939]: pgmap v6239: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 109 KiB/s wr, 8 op/s 2023-05-08T06:57:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11589.664547 secs 2023-05-08T06:57:30.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:57:30.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:57:30.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:57:30.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:57:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:30 smithi096 ceph-mon[124666]: pgmap v6239: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 109 KiB/s wr, 8 op/s 2023-05-08T06:57:31.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11589.664547 secs 2023-05-08T06:57:31.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:57:31.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:57:31.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:57:31.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:57:31.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:30 smithi186 ceph-mon[126480]: pgmap v6239: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 109 KiB/s wr, 8 op/s 2023-05-08T06:57:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11589.664547 secs 2023-05-08T06:57:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:57:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:57:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:57:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:57:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:31 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:57:31.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:31 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T06:57:31.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:31 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T06:57:31.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:31 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:57:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:31 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:57:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:31 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T06:57:32.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:31 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T06:57:32.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:31 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:57:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:31 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:57:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:31 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T06:57:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:31 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T06:57:32.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:31 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:57:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:32 smithi133 ceph-mon[125939]: pgmap v6240: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 100 KiB/s wr, 8 op/s 2023-05-08T06:57:33.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:32 smithi096 ceph-mon[124666]: pgmap v6240: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 100 KiB/s wr, 8 op/s 2023-05-08T06:57:33.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:32 smithi186 ceph-mon[126480]: pgmap v6240: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 100 KiB/s wr, 8 op/s 2023-05-08T06:57:34.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11592.824546 secs 2023-05-08T06:57:35.032 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:34 smithi133 ceph-mon[125939]: pgmap v6241: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 91 KiB/s wr, 7 op/s 2023-05-08T06:57:35.033 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11593.383043 secs 2023-05-08T06:57:35.034 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11592.824546 secs 2023-05-08T06:57:35.035 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:34 smithi096 ceph-mon[124666]: pgmap v6241: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 91 KiB/s wr, 7 op/s 2023-05-08T06:57:35.035 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11593.383043 secs 2023-05-08T06:57:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11592.824546 secs 2023-05-08T06:57:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:34 smithi186 ceph-mon[126480]: pgmap v6241: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 91 KiB/s wr, 7 op/s 2023-05-08T06:57:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11593.383043 secs 2023-05-08T06:57:35.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11594.664696 secs 2023-05-08T06:57:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11594.664696 secs 2023-05-08T06:57:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11594.664696 secs 2023-05-08T06:57:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:36 smithi133 ceph-mon[125939]: pgmap v6242: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 91 KiB/s wr, 10 op/s 2023-05-08T06:57:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:36 smithi096 ceph-mon[124666]: pgmap v6242: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 91 KiB/s wr, 10 op/s 2023-05-08T06:57:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:36 smithi186 ceph-mon[126480]: pgmap v6242: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 91 KiB/s wr, 10 op/s 2023-05-08T06:57:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:38 smithi133 ceph-mon[125939]: pgmap v6243: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 63 KiB/s wr, 7 op/s 2023-05-08T06:57:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:38 smithi096 ceph-mon[124666]: pgmap v6243: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 63 KiB/s wr, 7 op/s 2023-05-08T06:57:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:38 smithi186 ceph-mon[126480]: pgmap v6243: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 63 KiB/s wr, 7 op/s 2023-05-08T06:57:39.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11597.824686 secs 2023-05-08T06:57:39.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11598.383173 secs 2023-05-08T06:57:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11597.824686 secs 2023-05-08T06:57:40.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11598.383173 secs 2023-05-08T06:57:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11597.824686 secs 2023-05-08T06:57:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11598.383173 secs 2023-05-08T06:57:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:40 smithi133 ceph-mon[125939]: pgmap v6244: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 146 KiB/s wr, 11 op/s 2023-05-08T06:57:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11599.664824 secs 2023-05-08T06:57:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:40 smithi096 ceph-mon[124666]: pgmap v6244: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 146 KiB/s wr, 11 op/s 2023-05-08T06:57:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11599.664824 secs 2023-05-08T06:57:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:40 smithi186 ceph-mon[126480]: pgmap v6244: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 146 KiB/s wr, 11 op/s 2023-05-08T06:57:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11599.664824 secs 2023-05-08T06:57:42.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:42 smithi133 ceph-mon[125939]: pgmap v6245: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 84 KiB/s wr, 7 op/s 2023-05-08T06:57:43.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:42 smithi096 ceph-mon[124666]: pgmap v6245: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 84 KiB/s wr, 7 op/s 2023-05-08T06:57:43.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:42 smithi186 ceph-mon[126480]: pgmap v6245: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 84 KiB/s wr, 7 op/s 2023-05-08T06:57:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11602.824786 secs 2023-05-08T06:57:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11602.824786 secs 2023-05-08T06:57:44.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11602.824786 secs 2023-05-08T06:57:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:44 smithi186 ceph-mon[126480]: pgmap v6246: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 84 KiB/s wr, 7 op/s 2023-05-08T06:57:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:44 smithi133 ceph-mon[125939]: pgmap v6246: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 84 KiB/s wr, 7 op/s 2023-05-08T06:57:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:44 smithi096 ceph-mon[124666]: pgmap v6246: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 84 KiB/s wr, 7 op/s 2023-05-08T06:57:47.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:46 smithi186 ceph-mon[126480]: pgmap v6247: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 142 KiB/s wr, 12 op/s 2023-05-08T06:57:47.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:46 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:57:47.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:46 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:57:47.244 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:46 smithi133 ceph-mon[125939]: pgmap v6247: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 142 KiB/s wr, 12 op/s 2023-05-08T06:57:47.244 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:46 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:57:47.245 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:46 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:57:47.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:46 smithi096 ceph-mon[124666]: pgmap v6247: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 142 KiB/s wr, 12 op/s 2023-05-08T06:57:47.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:46 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:57:47.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:46 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:57:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:47 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:57:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:47 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:57:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:47 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:57:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:47 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:57:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:47 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:57:48.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:47 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:57:48.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:47 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:57:48.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:47 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:57:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:47 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:57:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:47 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:57:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:47 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:57:48.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:47 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:57:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:48 smithi186 ceph-mon[126480]: pgmap v6248: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 142 KiB/s wr, 9 op/s 2023-05-08T06:57:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11607.824893 secs 2023-05-08T06:57:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:48 smithi133 ceph-mon[125939]: pgmap v6248: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 142 KiB/s wr, 9 op/s 2023-05-08T06:57:49.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11607.824893 secs 2023-05-08T06:57:49.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:48 smithi096 ceph-mon[124666]: pgmap v6248: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 142 KiB/s wr, 9 op/s 2023-05-08T06:57:49.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11607.824893 secs 2023-05-08T06:57:50.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11608.383384 secs 2023-05-08T06:57:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11608.383384 secs 2023-05-08T06:57:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11608.383384 secs 2023-05-08T06:57:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:50 smithi186 ceph-mon[126480]: pgmap v6249: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 246 KiB/s wr, 13 op/s 2023-05-08T06:57:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:50 smithi133 ceph-mon[125939]: pgmap v6249: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 246 KiB/s wr, 13 op/s 2023-05-08T06:57:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:50 smithi096 ceph-mon[124666]: pgmap v6249: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 246 KiB/s wr, 13 op/s 2023-05-08T06:57:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:57:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:57:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:57:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:57:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:57:52.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:57:53.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:52 smithi186 ceph-mon[126480]: pgmap v6250: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 163 KiB/s wr, 9 op/s 2023-05-08T06:57:53.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:52 smithi133 ceph-mon[125939]: pgmap v6250: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 163 KiB/s wr, 9 op/s 2023-05-08T06:57:53.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:52 smithi096 ceph-mon[124666]: pgmap v6250: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 163 KiB/s wr, 9 op/s 2023-05-08T06:57:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11612.825020 secs 2023-05-08T06:57:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11612.825020 secs 2023-05-08T06:57:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11612.825020 secs 2023-05-08T06:57:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:54 smithi186 ceph-mon[126480]: pgmap v6251: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 163 KiB/s wr, 9 op/s 2023-05-08T06:57:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:54 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:57:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:54 smithi133 ceph-mon[125939]: pgmap v6251: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 163 KiB/s wr, 9 op/s 2023-05-08T06:57:55.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:54 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:57:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:54 smithi096 ceph-mon[124666]: pgmap v6251: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 163 KiB/s wr, 9 op/s 2023-05-08T06:57:55.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:54 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:57:56.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:55 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:57:56.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:55 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:57:56.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:55 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:57:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:55 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:57:56.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:55 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:57:56.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:55 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:57:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:55 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:57:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:55 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:57:56.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:55 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:57:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:56 smithi186 ceph-mon[126480]: pgmap v6252: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 175 KiB/s wr, 13 op/s 2023-05-08T06:57:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:56 smithi133 ceph-mon[125939]: pgmap v6252: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 175 KiB/s wr, 13 op/s 2023-05-08T06:57:57.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:56 smithi096 ceph-mon[124666]: pgmap v6252: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 175 KiB/s wr, 13 op/s 2023-05-08T06:57:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:58 smithi186 ceph-mon[126480]: pgmap v6253: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 116 KiB/s wr, 8 op/s 2023-05-08T06:57:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11617.825161 secs 2023-05-08T06:57:59.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:58 smithi133 ceph-mon[125939]: pgmap v6253: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 116 KiB/s wr, 8 op/s 2023-05-08T06:57:59.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11617.825161 secs 2023-05-08T06:57:59.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:58 smithi096 ceph-mon[124666]: pgmap v6253: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 116 KiB/s wr, 8 op/s 2023-05-08T06:57:59.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11617.825161 secs 2023-05-08T06:58:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:57:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11618.383631 secs 2023-05-08T06:58:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:57:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11618.383631 secs 2023-05-08T06:58:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:57:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11618.383631 secs 2023-05-08T06:58:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:00 smithi186 ceph-mon[126480]: pgmap v6254: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 254 KiB/s wr, 13 op/s 2023-05-08T06:58:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11619.665333 secs 2023-05-08T06:58:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:00 smithi133 ceph-mon[125939]: pgmap v6254: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 254 KiB/s wr, 13 op/s 2023-05-08T06:58:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11619.665333 secs 2023-05-08T06:58:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:00 smithi096 ceph-mon[124666]: pgmap v6254: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 254 KiB/s wr, 13 op/s 2023-05-08T06:58:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11619.665333 secs 2023-05-08T06:58:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:02 smithi186 ceph-mon[126480]: pgmap v6255: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 149 KiB/s wr, 8 op/s 2023-05-08T06:58:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:02 smithi133 ceph-mon[125939]: pgmap v6255: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 149 KiB/s wr, 8 op/s 2023-05-08T06:58:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:02 smithi096 ceph-mon[124666]: pgmap v6255: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 149 KiB/s wr, 8 op/s 2023-05-08T06:58:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:03 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:58:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:58:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:58:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:03 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:58:04.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11622.825293 secs 2023-05-08T06:58:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:03 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:58:04.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:58:04.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:58:04.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:03 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:58:04.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11622.825293 secs 2023-05-08T06:58:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:03 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:58:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:58:04.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:58:04.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:03 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:58:04.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11622.825293 secs 2023-05-08T06:58:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:04 smithi186 ceph-mon[126480]: pgmap v6256: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 149 KiB/s wr, 8 op/s 2023-05-08T06:58:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11623.383747 secs 2023-05-08T06:58:05.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:04 smithi133 ceph-mon[125939]: pgmap v6256: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 149 KiB/s wr, 8 op/s 2023-05-08T06:58:05.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11623.383747 secs 2023-05-08T06:58:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:04 smithi096 ceph-mon[124666]: pgmap v6256: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 149 KiB/s wr, 8 op/s 2023-05-08T06:58:05.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11623.383747 secs 2023-05-08T06:58:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11624.665477 secs 2023-05-08T06:58:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11624.665477 secs 2023-05-08T06:58:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11624.665477 secs 2023-05-08T06:58:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:06 smithi133 ceph-mon[125939]: pgmap v6257: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 195 KiB/s wr, 26 op/s 2023-05-08T06:58:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:06 smithi096 ceph-mon[124666]: pgmap v6257: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 195 KiB/s wr, 26 op/s 2023-05-08T06:58:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:06 smithi186 ceph-mon[126480]: pgmap v6257: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 195 KiB/s wr, 26 op/s 2023-05-08T06:58:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:08 smithi133 ceph-mon[125939]: pgmap v6258: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 183 KiB/s wr, 22 op/s 2023-05-08T06:58:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11627.825422 secs 2023-05-08T06:58:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:08 smithi096 ceph-mon[124666]: pgmap v6258: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 183 KiB/s wr, 22 op/s 2023-05-08T06:58:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11627.825422 secs 2023-05-08T06:58:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:08 smithi186 ceph-mon[126480]: pgmap v6258: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 183 KiB/s wr, 22 op/s 2023-05-08T06:58:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11627.825422 secs 2023-05-08T06:58:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11628.383828 secs 2023-05-08T06:58:10.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11628.383828 secs 2023-05-08T06:58:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11628.383828 secs 2023-05-08T06:58:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:10 smithi133 ceph-mon[125939]: pgmap v6259: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 213 KiB/s wr, 26 op/s 2023-05-08T06:58:11.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11629.665623 secs 2023-05-08T06:58:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:10 smithi096 ceph-mon[124666]: pgmap v6259: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 213 KiB/s wr, 26 op/s 2023-05-08T06:58:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11629.665623 secs 2023-05-08T06:58:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:10 smithi186 ceph-mon[126480]: pgmap v6259: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 213 KiB/s wr, 26 op/s 2023-05-08T06:58:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11629.665623 secs 2023-05-08T06:58:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:11 smithi133 ceph-mon[125939]: osdmap e468: 12 total, 12 up, 12 in 2023-05-08T06:58:12.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:11 smithi096 ceph-mon[124666]: osdmap e468: 12 total, 12 up, 12 in 2023-05-08T06:58:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:11 smithi186 ceph-mon[126480]: osdmap e468: 12 total, 12 up, 12 in 2023-05-08T06:58:13.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:12 smithi133 ceph-mon[125939]: pgmap v6261: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 90 KiB/s wr, 25 op/s 2023-05-08T06:58:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:12 smithi096 ceph-mon[124666]: pgmap v6261: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 90 KiB/s wr, 25 op/s 2023-05-08T06:58:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:12 smithi186 ceph-mon[126480]: pgmap v6261: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 90 KiB/s wr, 25 op/s 2023-05-08T06:58:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11632.825552 secs 2023-05-08T06:58:14.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11632.825552 secs 2023-05-08T06:58:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11632.825552 secs 2023-05-08T06:58:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:14 smithi133 ceph-mon[125939]: pgmap v6262: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 90 KiB/s wr, 25 op/s 2023-05-08T06:58:15.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11633.383965 secs 2023-05-08T06:58:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:14 smithi096 ceph-mon[124666]: pgmap v6262: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 90 KiB/s wr, 25 op/s 2023-05-08T06:58:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11633.383965 secs 2023-05-08T06:58:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:14 smithi186 ceph-mon[126480]: pgmap v6262: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 90 KiB/s wr, 25 op/s 2023-05-08T06:58:15.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11633.383965 secs 2023-05-08T06:58:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11634.665686 secs 2023-05-08T06:58:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11634.665686 secs 2023-05-08T06:58:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11634.665686 secs 2023-05-08T06:58:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:16 smithi133 ceph-mon[125939]: pgmap v6263: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 42 KiB/s wr, 8 op/s 2023-05-08T06:58:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:16 smithi096 ceph-mon[124666]: pgmap v6263: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 42 KiB/s wr, 8 op/s 2023-05-08T06:58:17.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:16 smithi186 ceph-mon[126480]: pgmap v6263: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 42 KiB/s wr, 8 op/s 2023-05-08T06:58:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:18 smithi133 ceph-mon[125939]: pgmap v6264: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 42 KiB/s wr, 8 op/s 2023-05-08T06:58:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11637.825700 secs 2023-05-08T06:58:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:18 smithi096 ceph-mon[124666]: pgmap v6264: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 42 KiB/s wr, 8 op/s 2023-05-08T06:58:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11637.825700 secs 2023-05-08T06:58:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:18 smithi186 ceph-mon[126480]: pgmap v6264: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 42 KiB/s wr, 8 op/s 2023-05-08T06:58:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11637.825700 secs 2023-05-08T06:58:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11638.384088 secs 2023-05-08T06:58:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11638.384088 secs 2023-05-08T06:58:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11638.384088 secs 2023-05-08T06:58:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:20 smithi133 ceph-mon[125939]: pgmap v6265: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 80 KiB/s wr, 8 op/s 2023-05-08T06:58:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11639.665807 secs 2023-05-08T06:58:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:20 smithi133 ceph-mon[125939]: osdmap e469: 12 total, 12 up, 12 in 2023-05-08T06:58:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:20 smithi096 ceph-mon[124666]: pgmap v6265: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 80 KiB/s wr, 8 op/s 2023-05-08T06:58:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11639.665807 secs 2023-05-08T06:58:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:20 smithi096 ceph-mon[124666]: osdmap e469: 12 total, 12 up, 12 in 2023-05-08T06:58:21.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:20 smithi186 ceph-mon[126480]: pgmap v6265: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 80 KiB/s wr, 8 op/s 2023-05-08T06:58:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11639.665807 secs 2023-05-08T06:58:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:20 smithi186 ceph-mon[126480]: osdmap e469: 12 total, 12 up, 12 in 2023-05-08T06:58:23.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:22 smithi133 ceph-mon[125939]: pgmap v6267: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 80 KiB/s wr, 8 op/s 2023-05-08T06:58:23.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:22 smithi096 ceph-mon[124666]: pgmap v6267: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 80 KiB/s wr, 8 op/s 2023-05-08T06:58:23.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:22 smithi186 ceph-mon[126480]: pgmap v6267: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 80 KiB/s wr, 8 op/s 2023-05-08T06:58:24.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11642.825802 secs 2023-05-08T06:58:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11642.825802 secs 2023-05-08T06:58:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11642.825802 secs 2023-05-08T06:58:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:24 smithi133 ceph-mon[125939]: pgmap v6268: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 80 KiB/s wr, 8 op/s 2023-05-08T06:58:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11643.384186 secs 2023-05-08T06:58:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:24 smithi096 ceph-mon[124666]: pgmap v6268: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 80 KiB/s wr, 8 op/s 2023-05-08T06:58:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11643.384186 secs 2023-05-08T06:58:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:24 smithi186 ceph-mon[126480]: pgmap v6268: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 80 KiB/s wr, 8 op/s 2023-05-08T06:58:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11643.384186 secs 2023-05-08T06:58:26.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11644.665925 secs 2023-05-08T06:58:26.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11644.665925 secs 2023-05-08T06:58:26.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11644.665925 secs 2023-05-08T06:58:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:26 smithi133 ceph-mon[125939]: pgmap v6269: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 74 KiB/s wr, 8 op/s 2023-05-08T06:58:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:26 smithi096 ceph-mon[124666]: pgmap v6269: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 74 KiB/s wr, 8 op/s 2023-05-08T06:58:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:26 smithi186 ceph-mon[126480]: pgmap v6269: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 74 KiB/s wr, 8 op/s 2023-05-08T06:58:29.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:28 smithi133 ceph-mon[125939]: pgmap v6270: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 74 KiB/s wr, 8 op/s 2023-05-08T06:58:29.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11647.825930 secs 2023-05-08T06:58:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:28 smithi096 ceph-mon[124666]: pgmap v6270: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 74 KiB/s wr, 8 op/s 2023-05-08T06:58:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11647.825930 secs 2023-05-08T06:58:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:28 smithi186 ceph-mon[126480]: pgmap v6270: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 74 KiB/s wr, 8 op/s 2023-05-08T06:58:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11647.825930 secs 2023-05-08T06:58:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11648.384300 secs 2023-05-08T06:58:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11648.384300 secs 2023-05-08T06:58:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11648.384300 secs 2023-05-08T06:58:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:30 smithi133 ceph-mon[125939]: pgmap v6271: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 8 op/s 2023-05-08T06:58:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11649.665988 secs 2023-05-08T06:58:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:58:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:30 smithi096 ceph-mon[124666]: pgmap v6271: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 8 op/s 2023-05-08T06:58:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11649.665988 secs 2023-05-08T06:58:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:58:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:30 smithi186 ceph-mon[126480]: pgmap v6271: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 8 op/s 2023-05-08T06:58:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11649.665988 secs 2023-05-08T06:58:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:58:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:31 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:58:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:31 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:58:32.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:31 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:58:32.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:31 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:58:32.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:31 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T06:58:32.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:31 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T06:58:32.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:31 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:58:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:31 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:58:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:31 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:58:32.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:31 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:58:32.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:31 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:58:32.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:31 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T06:58:32.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:31 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T06:58:32.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:31 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:58:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:31 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:58:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:31 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:58:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:31 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:58:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:31 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:58:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:31 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T06:58:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:31 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T06:58:32.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:31 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:58:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:33 smithi133 ceph-mon[125939]: pgmap v6272: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 50 KiB/s wr, 7 op/s 2023-05-08T06:58:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:33 smithi096 ceph-mon[124666]: pgmap v6272: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 50 KiB/s wr, 7 op/s 2023-05-08T06:58:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:33 smithi186 ceph-mon[126480]: pgmap v6272: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 50 KiB/s wr, 7 op/s 2023-05-08T06:58:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11652.826058 secs 2023-05-08T06:58:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11653.384420 secs 2023-05-08T06:58:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11652.826058 secs 2023-05-08T06:58:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11653.384420 secs 2023-05-08T06:58:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11652.826058 secs 2023-05-08T06:58:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11653.384420 secs 2023-05-08T06:58:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:35 smithi133 ceph-mon[125939]: pgmap v6273: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 45 KiB/s wr, 6 op/s 2023-05-08T06:58:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:35 smithi096 ceph-mon[124666]: pgmap v6273: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 45 KiB/s wr, 6 op/s 2023-05-08T06:58:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:35 smithi186 ceph-mon[126480]: pgmap v6273: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 45 KiB/s wr, 6 op/s 2023-05-08T06:58:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11654.666064 secs 2023-05-08T06:58:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11654.666064 secs 2023-05-08T06:58:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11654.666064 secs 2023-05-08T06:58:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:37 smithi133 ceph-mon[125939]: pgmap v6274: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 45 KiB/s wr, 9 op/s 2023-05-08T06:58:37.836 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:37 smithi096 ceph-mon[124666]: pgmap v6274: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 45 KiB/s wr, 9 op/s 2023-05-08T06:58:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:37 smithi186 ceph-mon[126480]: pgmap v6274: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 45 KiB/s wr, 9 op/s 2023-05-08T06:58:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:39 smithi133 ceph-mon[125939]: pgmap v6275: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 45 KiB/s wr, 6 op/s 2023-05-08T06:58:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11657.826162 secs 2023-05-08T06:58:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11658.384538 secs 2023-05-08T06:58:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:39 smithi096 ceph-mon[124666]: pgmap v6275: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 45 KiB/s wr, 6 op/s 2023-05-08T06:58:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11657.826162 secs 2023-05-08T06:58:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11658.384538 secs 2023-05-08T06:58:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:39 smithi186 ceph-mon[126480]: pgmap v6275: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 45 KiB/s wr, 6 op/s 2023-05-08T06:58:39.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11657.826162 secs 2023-05-08T06:58:39.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11658.384538 secs 2023-05-08T06:58:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:41 smithi133 ceph-mon[125939]: pgmap v6276: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 73 KiB/s wr, 9 op/s 2023-05-08T06:58:41.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11659.666187 secs 2023-05-08T06:58:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:41 smithi096 ceph-mon[124666]: pgmap v6276: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 73 KiB/s wr, 9 op/s 2023-05-08T06:58:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11659.666187 secs 2023-05-08T06:58:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:41 smithi186 ceph-mon[126480]: pgmap v6276: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 73 KiB/s wr, 9 op/s 2023-05-08T06:58:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11659.666187 secs 2023-05-08T06:58:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:43 smithi133 ceph-mon[125939]: pgmap v6277: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 6 op/s 2023-05-08T06:58:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:43 smithi096 ceph-mon[124666]: pgmap v6277: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 6 op/s 2023-05-08T06:58:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:43 smithi186 ceph-mon[126480]: pgmap v6277: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 6 op/s 2023-05-08T06:58:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11662.826312 secs 2023-05-08T06:58:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11662.826312 secs 2023-05-08T06:58:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11662.826312 secs 2023-05-08T06:58:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:45 smithi133 ceph-mon[125939]: pgmap v6278: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 6 op/s 2023-05-08T06:58:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:45 smithi096 ceph-mon[124666]: pgmap v6278: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 6 op/s 2023-05-08T06:58:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:45 smithi186 ceph-mon[126480]: pgmap v6278: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 6 op/s 2023-05-08T06:58:46.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11664.666310 secs 2023-05-08T06:58:46.801 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:46 smithi133 ceph-mon[125939]: pgmap v6279: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 62 KiB/s wr, 10 op/s 2023-05-08T06:58:46.802 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11664.666310 secs 2023-05-08T06:58:46.802 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:46 smithi096 ceph-mon[124666]: pgmap v6279: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 62 KiB/s wr, 10 op/s 2023-05-08T06:58:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11664.666310 secs 2023-05-08T06:58:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:46 smithi186 ceph-mon[126480]: pgmap v6279: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 62 KiB/s wr, 10 op/s 2023-05-08T06:58:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:58:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:58:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:58:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:48 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:58:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:58:48.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:58:48.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:48 smithi133 ceph-mon[125939]: pgmap v6280: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 62 KiB/s wr, 7 op/s 2023-05-08T06:58:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:48 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:58:48.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:58:48.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:58:48.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:48 smithi096 ceph-mon[124666]: pgmap v6280: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 62 KiB/s wr, 7 op/s 2023-05-08T06:58:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:48 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:58:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:58:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:58:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:48 smithi186 ceph-mon[126480]: pgmap v6280: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 62 KiB/s wr, 7 op/s 2023-05-08T06:58:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11667.826439 secs 2023-05-08T06:58:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11667.826439 secs 2023-05-08T06:58:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11667.826439 secs 2023-05-08T06:58:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:50 smithi133 ceph-mon[125939]: pgmap v6281: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 143 KiB/s wr, 11 op/s 2023-05-08T06:58:50.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:50 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:58:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:50 smithi096 ceph-mon[124666]: pgmap v6281: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 143 KiB/s wr, 11 op/s 2023-05-08T06:58:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:50 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:58:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:50 smithi186 ceph-mon[126480]: pgmap v6281: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 143 KiB/s wr, 11 op/s 2023-05-08T06:58:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:50 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:58:51.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:58:51.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:58:51.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:58:51.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:58:51.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:58:51.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:58:52.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:52 smithi133 ceph-mon[125939]: pgmap v6282: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 114 KiB/s wr, 8 op/s 2023-05-08T06:58:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:52 smithi096 ceph-mon[124666]: pgmap v6282: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 114 KiB/s wr, 8 op/s 2023-05-08T06:58:52.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:52 smithi186 ceph-mon[126480]: pgmap v6282: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 114 KiB/s wr, 8 op/s 2023-05-08T06:58:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:53 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:58:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:53 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:58:53.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:53 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:58:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:54 smithi133 ceph-mon[125939]: Health check cleared: MDS_SLOW_REQUEST (was: 1 MDSs report slow requests) 2023-05-08T06:58:54.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:54 smithi133 ceph-mon[125939]: Cluster is now healthy 2023-05-08T06:58:54.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:54 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T06:58:54.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:54 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:58:54.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:54 smithi133 ceph-mon[125939]: pgmap v6283: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 114 KiB/s wr, 8 op/s 2023-05-08T06:58:54.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11673.384908 secs 2023-05-08T06:58:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:54 smithi096 ceph-mon[124666]: Health check cleared: MDS_SLOW_REQUEST (was: 1 MDSs report slow requests) 2023-05-08T06:58:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:54 smithi096 ceph-mon[124666]: Cluster is now healthy 2023-05-08T06:58:54.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:54 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T06:58:54.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:54 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:58:54.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:54 smithi096 ceph-mon[124666]: pgmap v6283: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 114 KiB/s wr, 8 op/s 2023-05-08T06:58:54.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11673.384908 secs 2023-05-08T06:58:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:54 smithi186 ceph-mon[126480]: Health check cleared: MDS_SLOW_REQUEST (was: 1 MDSs report slow requests) 2023-05-08T06:58:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:54 smithi186 ceph-mon[126480]: Cluster is now healthy 2023-05-08T06:58:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:54 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T06:58:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:54 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:58:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:54 smithi186 ceph-mon[126480]: pgmap v6283: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 114 KiB/s wr, 8 op/s 2023-05-08T06:58:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11673.384908 secs 2023-05-08T06:58:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:55 smithi186 ceph-mon[126480]: Health check failed: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:58:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:55 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:58:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:55 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:58:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:55 smithi133 ceph-mon[125939]: Health check failed: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:58:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:55 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:58:55.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:55 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:58:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:55 smithi096 ceph-mon[124666]: Health check failed: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:58:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:55 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:58:56.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:55 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:58:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:56 smithi133 ceph-mon[125939]: pgmap v6284: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 183 KiB/s wr, 13 op/s 2023-05-08T06:58:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:56 smithi096 ceph-mon[124666]: pgmap v6284: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 183 KiB/s wr, 13 op/s 2023-05-08T06:58:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:56 smithi186 ceph-mon[126480]: pgmap v6284: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 183 KiB/s wr, 13 op/s 2023-05-08T06:58:58.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:58 smithi133 ceph-mon[125939]: pgmap v6285: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 149 KiB/s wr, 9 op/s 2023-05-08T06:58:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:58 smithi096 ceph-mon[124666]: pgmap v6285: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 149 KiB/s wr, 9 op/s 2023-05-08T06:58:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:58 smithi186 ceph-mon[126480]: pgmap v6285: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 149 KiB/s wr, 9 op/s 2023-05-08T06:58:59.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:58:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11677.826679 secs 2023-05-08T06:59:00.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:58:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11677.826679 secs 2023-05-08T06:59:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:58:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11677.826679 secs 2023-05-08T06:59:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:00 smithi133 ceph-mon[125939]: pgmap v6286: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 246 KiB/s wr, 14 op/s 2023-05-08T06:59:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11679.666674 secs 2023-05-08T06:59:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:00 smithi096 ceph-mon[124666]: pgmap v6286: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 246 KiB/s wr, 14 op/s 2023-05-08T06:59:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11679.666674 secs 2023-05-08T06:59:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:00 smithi186 ceph-mon[126480]: pgmap v6286: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 246 KiB/s wr, 14 op/s 2023-05-08T06:59:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11679.666674 secs 2023-05-08T06:59:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:01 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:59:02.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T06:59:02.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:59:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:01 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:59:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T06:59:02.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:59:02.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:01 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:59:02.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T06:59:02.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:59:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:02 smithi186 ceph-mon[126480]: pgmap v6287: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 166 KiB/s wr, 9 op/s 2023-05-08T06:59:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:02 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:59:03.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:02 smithi133 ceph-mon[125939]: pgmap v6287: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 166 KiB/s wr, 9 op/s 2023-05-08T06:59:03.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:02 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:59:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:02 smithi096 ceph-mon[124666]: pgmap v6287: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 166 KiB/s wr, 9 op/s 2023-05-08T06:59:03.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:02 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:59:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:59:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:59:04.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:03 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:59:04.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11682.826776 secs 2023-05-08T06:59:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:59:04.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:59:04.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:03 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:59:04.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11682.826776 secs 2023-05-08T06:59:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:59:04.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:59:04.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:03 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:59:04.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11682.826776 secs 2023-05-08T06:59:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:04 smithi186 ceph-mon[126480]: pgmap v6288: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 166 KiB/s wr, 9 op/s 2023-05-08T06:59:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11683.385162 secs 2023-05-08T06:59:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:04 smithi133 ceph-mon[125939]: pgmap v6288: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 166 KiB/s wr, 9 op/s 2023-05-08T06:59:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11683.385162 secs 2023-05-08T06:59:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:04 smithi096 ceph-mon[124666]: pgmap v6288: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 166 KiB/s wr, 9 op/s 2023-05-08T06:59:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11683.385162 secs 2023-05-08T06:59:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11684.666833 secs 2023-05-08T06:59:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11684.666833 secs 2023-05-08T06:59:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11684.666833 secs 2023-05-08T06:59:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:06 smithi186 ceph-mon[126480]: pgmap v6289: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 236 KiB/s wr, 27 op/s 2023-05-08T06:59:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:06 smithi133 ceph-mon[125939]: pgmap v6289: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 236 KiB/s wr, 27 op/s 2023-05-08T06:59:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:06 smithi096 ceph-mon[124666]: pgmap v6289: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 236 KiB/s wr, 27 op/s 2023-05-08T06:59:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:07 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:59:08.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:07 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:59:08.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:07 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:59:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:07 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:59:08.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:07 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:59:08.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:07 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:59:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:07 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:59:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:07 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:59:08.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:07 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:59:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:08 smithi186 ceph-mon[126480]: pgmap v6290: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 168 KiB/s wr, 23 op/s 2023-05-08T06:59:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11687.826925 secs 2023-05-08T06:59:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:08 smithi133 ceph-mon[125939]: pgmap v6290: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 168 KiB/s wr, 23 op/s 2023-05-08T06:59:09.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11687.826925 secs 2023-05-08T06:59:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:08 smithi096 ceph-mon[124666]: pgmap v6290: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 168 KiB/s wr, 23 op/s 2023-05-08T06:59:09.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11687.826925 secs 2023-05-08T06:59:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11688.385301 secs 2023-05-08T06:59:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11688.385301 secs 2023-05-08T06:59:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11688.385301 secs 2023-05-08T06:59:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:10 smithi186 ceph-mon[126480]: pgmap v6291: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 192 KiB/s wr, 26 op/s 2023-05-08T06:59:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11689.666959 secs 2023-05-08T06:59:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:10 smithi133 ceph-mon[125939]: pgmap v6291: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 192 KiB/s wr, 26 op/s 2023-05-08T06:59:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11689.666959 secs 2023-05-08T06:59:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:10 smithi096 ceph-mon[124666]: pgmap v6291: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 192 KiB/s wr, 26 op/s 2023-05-08T06:59:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11689.666959 secs 2023-05-08T06:59:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:11 smithi186 ceph-mon[126480]: osdmap e470: 12 total, 12 up, 12 in 2023-05-08T06:59:12.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:11 smithi133 ceph-mon[125939]: osdmap e470: 12 total, 12 up, 12 in 2023-05-08T06:59:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:11 smithi096 ceph-mon[124666]: osdmap e470: 12 total, 12 up, 12 in 2023-05-08T06:59:13.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:12 smithi186 ceph-mon[126480]: pgmap v6293: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 114 KiB/s wr, 25 op/s 2023-05-08T06:59:13.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:12 smithi133 ceph-mon[125939]: pgmap v6293: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 114 KiB/s wr, 25 op/s 2023-05-08T06:59:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:12 smithi096 ceph-mon[124666]: pgmap v6293: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 114 KiB/s wr, 25 op/s 2023-05-08T06:59:14.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11692.827053 secs 2023-05-08T06:59:14.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11692.827053 secs 2023-05-08T06:59:14.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11692.827053 secs 2023-05-08T06:59:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:14 smithi186 ceph-mon[126480]: pgmap v6294: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 114 KiB/s wr, 25 op/s 2023-05-08T06:59:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11693.385423 secs 2023-05-08T06:59:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:14 smithi133 ceph-mon[125939]: pgmap v6294: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 114 KiB/s wr, 25 op/s 2023-05-08T06:59:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11693.385423 secs 2023-05-08T06:59:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:14 smithi096 ceph-mon[124666]: pgmap v6294: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 114 KiB/s wr, 25 op/s 2023-05-08T06:59:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11693.385423 secs 2023-05-08T06:59:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11694.667022 secs 2023-05-08T06:59:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11694.667022 secs 2023-05-08T06:59:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11694.667022 secs 2023-05-08T06:59:17.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:16 smithi186 ceph-mon[126480]: pgmap v6295: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 8 op/s 2023-05-08T06:59:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:16 smithi133 ceph-mon[125939]: pgmap v6295: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 8 op/s 2023-05-08T06:59:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:16 smithi096 ceph-mon[124666]: pgmap v6295: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 8 op/s 2023-05-08T06:59:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:18 smithi186 ceph-mon[126480]: pgmap v6296: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 8 op/s 2023-05-08T06:59:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11697.827186 secs 2023-05-08T06:59:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:18 smithi133 ceph-mon[125939]: pgmap v6296: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 8 op/s 2023-05-08T06:59:19.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11697.827186 secs 2023-05-08T06:59:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:18 smithi096 ceph-mon[124666]: pgmap v6296: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 8 op/s 2023-05-08T06:59:19.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11697.827186 secs 2023-05-08T06:59:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11698.385570 secs 2023-05-08T06:59:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11698.385570 secs 2023-05-08T06:59:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11698.385570 secs 2023-05-08T06:59:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:20 smithi186 ceph-mon[126480]: pgmap v6297: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6.9 KiB/s wr, 7 op/s 2023-05-08T06:59:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11699.667157 secs 2023-05-08T06:59:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:20 smithi186 ceph-mon[126480]: osdmap e471: 12 total, 12 up, 12 in 2023-05-08T06:59:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:20 smithi133 ceph-mon[125939]: pgmap v6297: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6.9 KiB/s wr, 7 op/s 2023-05-08T06:59:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11699.667157 secs 2023-05-08T06:59:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:20 smithi133 ceph-mon[125939]: osdmap e471: 12 total, 12 up, 12 in 2023-05-08T06:59:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:20 smithi096 ceph-mon[124666]: pgmap v6297: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6.9 KiB/s wr, 7 op/s 2023-05-08T06:59:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11699.667157 secs 2023-05-08T06:59:21.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:20 smithi096 ceph-mon[124666]: osdmap e471: 12 total, 12 up, 12 in 2023-05-08T06:59:23.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:22 smithi186 ceph-mon[126480]: pgmap v6299: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6.8 KiB/s wr, 7 op/s 2023-05-08T06:59:23.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:22 smithi133 ceph-mon[125939]: pgmap v6299: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6.8 KiB/s wr, 7 op/s 2023-05-08T06:59:23.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:22 smithi096 ceph-mon[124666]: pgmap v6299: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6.8 KiB/s wr, 7 op/s 2023-05-08T06:59:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11702.827320 secs 2023-05-08T06:59:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11702.827320 secs 2023-05-08T06:59:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11702.827320 secs 2023-05-08T06:59:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:24 smithi186 ceph-mon[126480]: pgmap v6300: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6.8 KiB/s wr, 7 op/s 2023-05-08T06:59:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11703.385700 secs 2023-05-08T06:59:25.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:24 smithi133 ceph-mon[125939]: pgmap v6300: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6.8 KiB/s wr, 7 op/s 2023-05-08T06:59:25.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11703.385700 secs 2023-05-08T06:59:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:24 smithi096 ceph-mon[124666]: pgmap v6300: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6.8 KiB/s wr, 7 op/s 2023-05-08T06:59:25.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11703.385700 secs 2023-05-08T06:59:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11704.667283 secs 2023-05-08T06:59:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11704.667283 secs 2023-05-08T06:59:26.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11704.667283 secs 2023-05-08T06:59:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:26 smithi186 ceph-mon[126480]: pgmap v6301: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 41 KiB/s wr, 8 op/s 2023-05-08T06:59:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:26 smithi133 ceph-mon[125939]: pgmap v6301: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 41 KiB/s wr, 8 op/s 2023-05-08T06:59:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:26 smithi096 ceph-mon[124666]: pgmap v6301: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 41 KiB/s wr, 8 op/s 2023-05-08T06:59:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:28 smithi186 ceph-mon[126480]: pgmap v6302: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 41 KiB/s wr, 8 op/s 2023-05-08T06:59:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11707.827451 secs 2023-05-08T06:59:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:28 smithi133 ceph-mon[125939]: pgmap v6302: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 41 KiB/s wr, 8 op/s 2023-05-08T06:59:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11707.827451 secs 2023-05-08T06:59:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:28 smithi096 ceph-mon[124666]: pgmap v6302: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 41 KiB/s wr, 8 op/s 2023-05-08T06:59:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11707.827451 secs 2023-05-08T06:59:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11708.385823 secs 2023-05-08T06:59:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11708.385823 secs 2023-05-08T06:59:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11708.385823 secs 2023-05-08T06:59:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:30 smithi133 ceph-mon[125939]: pgmap v6303: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 70 KiB/s wr, 9 op/s 2023-05-08T06:59:31.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11709.667452 secs 2023-05-08T06:59:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:30 smithi096 ceph-mon[124666]: pgmap v6303: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 70 KiB/s wr, 9 op/s 2023-05-08T06:59:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11709.667452 secs 2023-05-08T06:59:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:30 smithi186 ceph-mon[126480]: pgmap v6303: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 70 KiB/s wr, 9 op/s 2023-05-08T06:59:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11709.667452 secs 2023-05-08T06:59:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:31 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:59:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:31 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:59:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:31 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T06:59:33.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:33 smithi186 ceph-mon[126480]: pgmap v6304: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 64 KiB/s wr, 8 op/s 2023-05-08T06:59:33.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:33 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:59:33.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:33 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:59:33.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:33 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:59:33.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:33 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:59:33.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:33 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:59:33.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:33 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:59:33.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:33 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:59:33.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:33 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:59:33.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:33 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:59:33.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:33 smithi133 ceph-mon[125939]: pgmap v6304: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 64 KiB/s wr, 8 op/s 2023-05-08T06:59:33.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:33 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:59:33.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:33 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:59:33.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:33 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:59:33.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:33 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:59:33.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:33 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:59:33.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:33 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:59:33.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:33 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:59:33.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:33 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:59:33.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:33 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:59:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:33 smithi096 ceph-mon[124666]: pgmap v6304: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 64 KiB/s wr, 8 op/s 2023-05-08T06:59:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:33 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:59:33.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:33 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:59:33.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:33 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:59:33.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:33 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:59:33.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:33 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:59:33.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:33 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:59:33.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:33 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T06:59:33.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:33 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T06:59:33.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:33 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T06:59:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:34 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:59:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:34 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T06:59:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:34 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T06:59:34.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:34 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T06:59:34.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11712.827571 secs 2023-05-08T06:59:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:34 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:59:34.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:34 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T06:59:34.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:34 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T06:59:34.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:34 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T06:59:34.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11712.827571 secs 2023-05-08T06:59:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:34 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:59:34.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:34 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T06:59:34.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:34 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T06:59:34.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:34 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T06:59:34.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11712.827571 secs 2023-05-08T06:59:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:35 smithi186 ceph-mon[126480]: pgmap v6305: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 58 KiB/s wr, 7 op/s 2023-05-08T06:59:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11713.385931 secs 2023-05-08T06:59:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:35 smithi133 ceph-mon[125939]: pgmap v6305: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 58 KiB/s wr, 7 op/s 2023-05-08T06:59:35.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11713.385931 secs 2023-05-08T06:59:35.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:35 smithi096 ceph-mon[124666]: pgmap v6305: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 58 KiB/s wr, 7 op/s 2023-05-08T06:59:35.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11713.385931 secs 2023-05-08T06:59:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11714.667594 secs 2023-05-08T06:59:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11714.667594 secs 2023-05-08T06:59:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11714.667594 secs 2023-05-08T06:59:37.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:37 smithi186 ceph-mon[126480]: pgmap v6306: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 87 KiB/s wr, 10 op/s 2023-05-08T06:59:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:37 smithi133 ceph-mon[125939]: pgmap v6306: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 87 KiB/s wr, 10 op/s 2023-05-08T06:59:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:37 smithi096 ceph-mon[124666]: pgmap v6306: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 87 KiB/s wr, 10 op/s 2023-05-08T06:59:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:39 smithi186 ceph-mon[126480]: pgmap v6307: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 6 op/s 2023-05-08T06:59:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11717.827699 secs 2023-05-08T06:59:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:39 smithi133 ceph-mon[125939]: pgmap v6307: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 6 op/s 2023-05-08T06:59:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11717.827699 secs 2023-05-08T06:59:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:39 smithi096 ceph-mon[124666]: pgmap v6307: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 6 op/s 2023-05-08T06:59:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11717.827699 secs 2023-05-08T06:59:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11718.386072 secs 2023-05-08T06:59:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11718.386072 secs 2023-05-08T06:59:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11718.386072 secs 2023-05-08T06:59:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:41 smithi186 ceph-mon[126480]: pgmap v6308: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 87 KiB/s wr, 10 op/s 2023-05-08T06:59:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11719.667689 secs 2023-05-08T06:59:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:41 smithi133 ceph-mon[125939]: pgmap v6308: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 87 KiB/s wr, 10 op/s 2023-05-08T06:59:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11719.667689 secs 2023-05-08T06:59:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:41 smithi096 ceph-mon[124666]: pgmap v6308: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 87 KiB/s wr, 10 op/s 2023-05-08T06:59:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11719.667689 secs 2023-05-08T06:59:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:43 smithi186 ceph-mon[126480]: pgmap v6309: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 6 op/s 2023-05-08T06:59:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:43 smithi133 ceph-mon[125939]: pgmap v6309: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 6 op/s 2023-05-08T06:59:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:43 smithi096 ceph-mon[124666]: pgmap v6309: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 6 op/s 2023-05-08T06:59:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11722.827805 secs 2023-05-08T06:59:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11722.827805 secs 2023-05-08T06:59:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11722.827805 secs 2023-05-08T06:59:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:45 smithi186 ceph-mon[126480]: pgmap v6310: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 6 op/s 2023-05-08T06:59:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:45 smithi133 ceph-mon[125939]: pgmap v6310: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 6 op/s 2023-05-08T06:59:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:45 smithi096 ceph-mon[124666]: pgmap v6310: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 6 op/s 2023-05-08T06:59:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11724.667829 secs 2023-05-08T06:59:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11724.667829 secs 2023-05-08T06:59:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11724.667829 secs 2023-05-08T06:59:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:47 smithi186 ceph-mon[126480]: pgmap v6311: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 152 KiB/s wr, 10 op/s 2023-05-08T06:59:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:59:47.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:47 smithi133 ceph-mon[125939]: pgmap v6311: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 152 KiB/s wr, 10 op/s 2023-05-08T06:59:47.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:59:47.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:47 smithi096 ceph-mon[124666]: pgmap v6311: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 152 KiB/s wr, 10 op/s 2023-05-08T06:59:47.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:59:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:48 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:59:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:59:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:59:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:48 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:59:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:59:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:59:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:48 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:59:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:59:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:59:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:49 smithi186 ceph-mon[126480]: pgmap v6312: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 124 KiB/s wr, 7 op/s 2023-05-08T06:59:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11727.827900 secs 2023-05-08T06:59:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:49 smithi133 ceph-mon[125939]: pgmap v6312: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 124 KiB/s wr, 7 op/s 2023-05-08T06:59:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11727.827900 secs 2023-05-08T06:59:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:49 smithi096 ceph-mon[124666]: pgmap v6312: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 124 KiB/s wr, 7 op/s 2023-05-08T06:59:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11727.827900 secs 2023-05-08T06:59:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:51 smithi186 ceph-mon[126480]: pgmap v6313: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 227 KiB/s wr, 13 op/s 2023-05-08T06:59:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:59:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:51 smithi133 ceph-mon[125939]: pgmap v6313: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 227 KiB/s wr, 13 op/s 2023-05-08T06:59:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:59:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:51 smithi096 ceph-mon[124666]: pgmap v6313: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 227 KiB/s wr, 13 op/s 2023-05-08T06:59:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T06:59:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:59:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:59:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:59:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:59:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T06:59:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:59:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:53 smithi186 ceph-mon[126480]: pgmap v6314: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 198 KiB/s wr, 9 op/s 2023-05-08T06:59:53.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:53 smithi133 ceph-mon[125939]: pgmap v6314: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 198 KiB/s wr, 9 op/s 2023-05-08T06:59:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:53 smithi096 ceph-mon[124666]: pgmap v6314: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 198 KiB/s wr, 9 op/s 2023-05-08T06:59:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11732.828074 secs 2023-05-08T06:59:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11732.828074 secs 2023-05-08T06:59:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11732.828074 secs 2023-05-08T06:59:55.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:55 smithi186 ceph-mon[126480]: pgmap v6315: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 198 KiB/s wr, 9 op/s 2023-05-08T06:59:55.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11733.386511 secs 2023-05-08T06:59:55.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:55 smithi133 ceph-mon[125939]: pgmap v6315: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 198 KiB/s wr, 9 op/s 2023-05-08T06:59:55.494 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11733.386511 secs 2023-05-08T06:59:55.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:55 smithi096 ceph-mon[124666]: pgmap v6315: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 198 KiB/s wr, 9 op/s 2023-05-08T06:59:55.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11733.386511 secs 2023-05-08T06:59:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:56 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:59:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:59:56.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:59:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:56 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:59:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:59:56.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:59:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:56 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T06:59:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T06:59:56.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T06:59:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:57 smithi133 ceph-mon[125939]: pgmap v6316: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 210 KiB/s wr, 13 op/s 2023-05-08T06:59:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:57 smithi096 ceph-mon[124666]: pgmap v6316: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 210 KiB/s wr, 13 op/s 2023-05-08T06:59:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:57 smithi186 ceph-mon[126480]: pgmap v6316: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 210 KiB/s wr, 13 op/s 2023-05-08T06:59:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:59 smithi133 ceph-mon[125939]: pgmap v6317: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 116 KiB/s wr, 9 op/s 2023-05-08T06:59:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 06:59:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11737.828194 secs 2023-05-08T06:59:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:59 smithi096 ceph-mon[124666]: pgmap v6317: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 116 KiB/s wr, 9 op/s 2023-05-08T06:59:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 06:59:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11737.828194 secs 2023-05-08T06:59:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:59 smithi186 ceph-mon[126480]: pgmap v6317: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 116 KiB/s wr, 9 op/s 2023-05-08T06:59:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 06:59:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11737.828194 secs 2023-05-08T07:00:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11738.386593 secs 2023-05-08T07:00:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:00 smithi133 ceph-mon[125939]: overall HEALTH_WARN 2 MDSs report slow requests 2023-05-08T07:00:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11738.386593 secs 2023-05-08T07:00:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:00 smithi096 ceph-mon[124666]: overall HEALTH_WARN 2 MDSs report slow requests 2023-05-08T07:00:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11738.386593 secs 2023-05-08T07:00:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:00 smithi186 ceph-mon[126480]: overall HEALTH_WARN 2 MDSs report slow requests 2023-05-08T07:00:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:01 smithi133 ceph-mon[125939]: pgmap v6318: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 224 KiB/s wr, 13 op/s 2023-05-08T07:00:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:01 smithi096 ceph-mon[124666]: pgmap v6318: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 224 KiB/s wr, 13 op/s 2023-05-08T07:00:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:01 smithi186 ceph-mon[126480]: pgmap v6318: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 224 KiB/s wr, 13 op/s 2023-05-08T07:00:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:03 smithi133 ceph-mon[125939]: pgmap v6319: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 121 KiB/s wr, 8 op/s 2023-05-08T07:00:03.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:03 smithi096 ceph-mon[124666]: pgmap v6319: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 121 KiB/s wr, 8 op/s 2023-05-08T07:00:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:03 smithi186 ceph-mon[126480]: pgmap v6319: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 121 KiB/s wr, 8 op/s 2023-05-08T07:00:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11742.828321 secs 2023-05-08T07:00:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11742.828321 secs 2023-05-08T07:00:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11742.828321 secs 2023-05-08T07:00:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:05 smithi133 ceph-mon[125939]: pgmap v6320: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 121 KiB/s wr, 8 op/s 2023-05-08T07:00:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11743.386729 secs 2023-05-08T07:00:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:05 smithi096 ceph-mon[124666]: pgmap v6320: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 121 KiB/s wr, 8 op/s 2023-05-08T07:00:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11743.386729 secs 2023-05-08T07:00:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:05 smithi186 ceph-mon[126480]: pgmap v6320: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 121 KiB/s wr, 8 op/s 2023-05-08T07:00:05.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11743.386729 secs 2023-05-08T07:00:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11744.668209 secs 2023-05-08T07:00:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11744.668209 secs 2023-05-08T07:00:06.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11744.668209 secs 2023-05-08T07:00:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:07 smithi133 ceph-mon[125939]: pgmap v6321: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 178 KiB/s wr, 27 op/s 2023-05-08T07:00:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:07 smithi096 ceph-mon[124666]: pgmap v6321: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 178 KiB/s wr, 27 op/s 2023-05-08T07:00:07.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:07 smithi186 ceph-mon[126480]: pgmap v6321: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 178 KiB/s wr, 27 op/s 2023-05-08T07:00:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:08 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:00:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:00:08.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:00:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:08 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:00:08.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:00:08.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:00:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:08 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:00:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:00:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:00:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:09 smithi133 ceph-mon[125939]: pgmap v6322: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 166 KiB/s wr, 23 op/s 2023-05-08T07:00:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11747.828437 secs 2023-05-08T07:00:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:09 smithi096 ceph-mon[124666]: pgmap v6322: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 166 KiB/s wr, 23 op/s 2023-05-08T07:00:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11747.828437 secs 2023-05-08T07:00:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:09 smithi186 ceph-mon[126480]: pgmap v6322: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 166 KiB/s wr, 23 op/s 2023-05-08T07:00:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11747.828437 secs 2023-05-08T07:00:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11748.386819 secs 2023-05-08T07:00:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11748.386819 secs 2023-05-08T07:00:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11748.386819 secs 2023-05-08T07:00:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:11 smithi133 ceph-mon[125939]: pgmap v6323: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 240 KiB/s wr, 27 op/s 2023-05-08T07:00:11.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11749.668342 secs 2023-05-08T07:00:11.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:11 smithi133 ceph-mon[125939]: osdmap e472: 12 total, 12 up, 12 in 2023-05-08T07:00:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:11 smithi096 ceph-mon[124666]: pgmap v6323: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 240 KiB/s wr, 27 op/s 2023-05-08T07:00:11.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11749.668342 secs 2023-05-08T07:00:11.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:11 smithi096 ceph-mon[124666]: osdmap e472: 12 total, 12 up, 12 in 2023-05-08T07:00:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:11 smithi186 ceph-mon[126480]: pgmap v6323: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 240 KiB/s wr, 27 op/s 2023-05-08T07:00:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11749.668342 secs 2023-05-08T07:00:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:11 smithi186 ceph-mon[126480]: osdmap e472: 12 total, 12 up, 12 in 2023-05-08T07:00:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:13 smithi133 ceph-mon[125939]: pgmap v6325: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 157 KiB/s wr, 27 op/s 2023-05-08T07:00:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:13 smithi096 ceph-mon[124666]: pgmap v6325: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 157 KiB/s wr, 27 op/s 2023-05-08T07:00:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:13 smithi186 ceph-mon[126480]: pgmap v6325: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 157 KiB/s wr, 27 op/s 2023-05-08T07:00:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11752.828557 secs 2023-05-08T07:00:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11752.828557 secs 2023-05-08T07:00:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11752.828557 secs 2023-05-08T07:00:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:15 smithi133 ceph-mon[125939]: pgmap v6326: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 157 KiB/s wr, 27 op/s 2023-05-08T07:00:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11753.386953 secs 2023-05-08T07:00:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:15 smithi096 ceph-mon[124666]: pgmap v6326: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 157 KiB/s wr, 27 op/s 2023-05-08T07:00:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11753.386953 secs 2023-05-08T07:00:15.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:15 smithi186 ceph-mon[126480]: pgmap v6326: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 157 KiB/s wr, 27 op/s 2023-05-08T07:00:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11753.386953 secs 2023-05-08T07:00:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11754.668467 secs 2023-05-08T07:00:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11754.668467 secs 2023-05-08T07:00:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11754.668467 secs 2023-05-08T07:00:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:17 smithi133 ceph-mon[125939]: pgmap v6327: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 95 KiB/s wr, 8 op/s 2023-05-08T07:00:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:17 smithi096 ceph-mon[124666]: pgmap v6327: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 95 KiB/s wr, 8 op/s 2023-05-08T07:00:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:17 smithi186 ceph-mon[126480]: pgmap v6327: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 95 KiB/s wr, 8 op/s 2023-05-08T07:00:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:19 smithi133 ceph-mon[125939]: pgmap v6328: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 95 KiB/s wr, 8 op/s 2023-05-08T07:00:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11757.828690 secs 2023-05-08T07:00:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:19 smithi096 ceph-mon[124666]: pgmap v6328: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 95 KiB/s wr, 8 op/s 2023-05-08T07:00:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11757.828690 secs 2023-05-08T07:00:19.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:19 smithi186 ceph-mon[126480]: pgmap v6328: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 95 KiB/s wr, 8 op/s 2023-05-08T07:00:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11757.828690 secs 2023-05-08T07:00:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11758.387087 secs 2023-05-08T07:00:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11758.387087 secs 2023-05-08T07:00:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11758.387087 secs 2023-05-08T07:00:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:21 smithi133 ceph-mon[125939]: pgmap v6329: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 70 KiB/s wr, 9 op/s 2023-05-08T07:00:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11759.668592 secs 2023-05-08T07:00:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:21 smithi133 ceph-mon[125939]: osdmap e473: 12 total, 12 up, 12 in 2023-05-08T07:00:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:21 smithi096 ceph-mon[124666]: pgmap v6329: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 70 KiB/s wr, 9 op/s 2023-05-08T07:00:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11759.668592 secs 2023-05-08T07:00:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:21 smithi096 ceph-mon[124666]: osdmap e473: 12 total, 12 up, 12 in 2023-05-08T07:00:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:21 smithi186 ceph-mon[126480]: pgmap v6329: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 70 KiB/s wr, 9 op/s 2023-05-08T07:00:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11759.668592 secs 2023-05-08T07:00:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:21 smithi186 ceph-mon[126480]: osdmap e473: 12 total, 12 up, 12 in 2023-05-08T07:00:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:23 smithi133 ceph-mon[125939]: pgmap v6331: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 70 KiB/s wr, 8 op/s 2023-05-08T07:00:23.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:23 smithi096 ceph-mon[124666]: pgmap v6331: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 70 KiB/s wr, 8 op/s 2023-05-08T07:00:23.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:23 smithi186 ceph-mon[126480]: pgmap v6331: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 70 KiB/s wr, 8 op/s 2023-05-08T07:00:24.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11762.828786 secs 2023-05-08T07:00:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11762.828786 secs 2023-05-08T07:00:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11762.828786 secs 2023-05-08T07:00:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:25 smithi133 ceph-mon[125939]: pgmap v6332: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 70 KiB/s wr, 8 op/s 2023-05-08T07:00:25.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11763.387205 secs 2023-05-08T07:00:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:25 smithi096 ceph-mon[124666]: pgmap v6332: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 70 KiB/s wr, 8 op/s 2023-05-08T07:00:25.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11763.387205 secs 2023-05-08T07:00:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:25 smithi186 ceph-mon[126480]: pgmap v6332: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 70 KiB/s wr, 8 op/s 2023-05-08T07:00:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11763.387205 secs 2023-05-08T07:00:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11764.668743 secs 2023-05-08T07:00:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11764.668743 secs 2023-05-08T07:00:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11764.668743 secs 2023-05-08T07:00:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:27 smithi133 ceph-mon[125939]: pgmap v6333: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 98 KiB/s wr, 9 op/s 2023-05-08T07:00:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:27 smithi096 ceph-mon[124666]: pgmap v6333: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 98 KiB/s wr, 9 op/s 2023-05-08T07:00:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:27 smithi186 ceph-mon[126480]: pgmap v6333: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 98 KiB/s wr, 9 op/s 2023-05-08T07:00:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:29 smithi133 ceph-mon[125939]: pgmap v6334: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 98 KiB/s wr, 9 op/s 2023-05-08T07:00:29.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11767.828904 secs 2023-05-08T07:00:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:29 smithi096 ceph-mon[124666]: pgmap v6334: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 98 KiB/s wr, 9 op/s 2023-05-08T07:00:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11767.828904 secs 2023-05-08T07:00:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:29 smithi186 ceph-mon[126480]: pgmap v6334: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 98 KiB/s wr, 9 op/s 2023-05-08T07:00:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11767.828904 secs 2023-05-08T07:00:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11768.387316 secs 2023-05-08T07:00:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11768.387316 secs 2023-05-08T07:00:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11768.387316 secs 2023-05-08T07:00:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:31 smithi096 ceph-mon[124666]: pgmap v6335: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 74 KiB/s wr, 8 op/s 2023-05-08T07:00:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11769.668865 secs 2023-05-08T07:00:31.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:31 smithi186 ceph-mon[126480]: pgmap v6335: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 74 KiB/s wr, 8 op/s 2023-05-08T07:00:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11769.668865 secs 2023-05-08T07:00:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:31 smithi133 ceph-mon[125939]: pgmap v6335: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 74 KiB/s wr, 8 op/s 2023-05-08T07:00:31.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11769.668865 secs 2023-05-08T07:00:33.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:33 smithi186 ceph-mon[126480]: pgmap v6336: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 68 KiB/s wr, 8 op/s 2023-05-08T07:00:33.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:33 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:00:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:33 smithi096 ceph-mon[124666]: pgmap v6336: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 68 KiB/s wr, 8 op/s 2023-05-08T07:00:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:33 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:00:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:33 smithi133 ceph-mon[125939]: pgmap v6336: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 68 KiB/s wr, 8 op/s 2023-05-08T07:00:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:33 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:00:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11772.828993 secs 2023-05-08T07:00:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:34 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:00:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:34 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:00:34.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:34 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:00:34.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11773.387426 secs 2023-05-08T07:00:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11772.828993 secs 2023-05-08T07:00:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:34 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:00:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:34 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:00:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:34 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:00:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11773.387426 secs 2023-05-08T07:00:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11772.828993 secs 2023-05-08T07:00:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:34 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:00:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:34 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:00:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:34 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:00:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11773.387426 secs 2023-05-08T07:00:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:35 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:00:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:35 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T07:00:35.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:35 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T07:00:35.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:35 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:00:35.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:35 smithi096 ceph-mon[124666]: pgmap v6337: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 61 KiB/s wr, 7 op/s 2023-05-08T07:00:35.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:35 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:00:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:35 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T07:00:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:35 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T07:00:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:35 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:00:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:35 smithi186 ceph-mon[126480]: pgmap v6337: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 61 KiB/s wr, 7 op/s 2023-05-08T07:00:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:35 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:00:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:35 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T07:00:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:35 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T07:00:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:35 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:00:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:35 smithi133 ceph-mon[125939]: pgmap v6337: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 61 KiB/s wr, 7 op/s 2023-05-08T07:00:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11774.668990 secs 2023-05-08T07:00:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11774.668990 secs 2023-05-08T07:00:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11774.668990 secs 2023-05-08T07:00:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:37 smithi096 ceph-mon[124666]: pgmap v6338: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 62 KiB/s wr, 10 op/s 2023-05-08T07:00:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:37 smithi186 ceph-mon[126480]: pgmap v6338: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 62 KiB/s wr, 10 op/s 2023-05-08T07:00:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:37 smithi133 ceph-mon[125939]: pgmap v6338: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 62 KiB/s wr, 10 op/s 2023-05-08T07:00:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:39 smithi186 ceph-mon[126480]: pgmap v6339: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T07:00:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11777.829132 secs 2023-05-08T07:00:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11778.387564 secs 2023-05-08T07:00:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:39 smithi133 ceph-mon[125939]: pgmap v6339: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T07:00:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11777.829132 secs 2023-05-08T07:00:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11778.387564 secs 2023-05-08T07:00:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:39 smithi096 ceph-mon[124666]: pgmap v6339: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T07:00:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11777.829132 secs 2023-05-08T07:00:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11778.387564 secs 2023-05-08T07:00:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:41 smithi186 ceph-mon[126480]: pgmap v6340: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 119 KiB/s wr, 10 op/s 2023-05-08T07:00:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11779.669105 secs 2023-05-08T07:00:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:41 smithi133 ceph-mon[125939]: pgmap v6340: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 119 KiB/s wr, 10 op/s 2023-05-08T07:00:41.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11779.669105 secs 2023-05-08T07:00:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:41 smithi096 ceph-mon[124666]: pgmap v6340: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 119 KiB/s wr, 10 op/s 2023-05-08T07:00:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11779.669105 secs 2023-05-08T07:00:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:43 smithi186 ceph-mon[126480]: pgmap v6341: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 86 KiB/s wr, 7 op/s 2023-05-08T07:00:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:43 smithi133 ceph-mon[125939]: pgmap v6341: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 86 KiB/s wr, 7 op/s 2023-05-08T07:00:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:43 smithi096 ceph-mon[124666]: pgmap v6341: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 86 KiB/s wr, 7 op/s 2023-05-08T07:00:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11782.829254 secs 2023-05-08T07:00:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11783.387661 secs 2023-05-08T07:00:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11782.829254 secs 2023-05-08T07:00:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11783.387661 secs 2023-05-08T07:00:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11782.829254 secs 2023-05-08T07:00:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11783.387661 secs 2023-05-08T07:00:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:45 smithi186 ceph-mon[126480]: pgmap v6342: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 86 KiB/s wr, 7 op/s 2023-05-08T07:00:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:45 smithi133 ceph-mon[125939]: pgmap v6342: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 86 KiB/s wr, 7 op/s 2023-05-08T07:00:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:45 smithi096 ceph-mon[124666]: pgmap v6342: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 86 KiB/s wr, 7 op/s 2023-05-08T07:00:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:47 smithi186 ceph-mon[126480]: pgmap v6343: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 147 KiB/s wr, 12 op/s 2023-05-08T07:00:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:00:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:47 smithi133 ceph-mon[125939]: pgmap v6343: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 147 KiB/s wr, 12 op/s 2023-05-08T07:00:47.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:00:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:47 smithi096 ceph-mon[124666]: pgmap v6343: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 147 KiB/s wr, 12 op/s 2023-05-08T07:00:47.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:00:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:48 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:00:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:00:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:00:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:48 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:00:48.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:00:48.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:00:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:48 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:00:48.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:00:48.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:00:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:49 smithi186 ceph-mon[126480]: pgmap v6344: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 147 KiB/s wr, 9 op/s 2023-05-08T07:00:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11787.829405 secs 2023-05-08T07:00:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11788.387779 secs 2023-05-08T07:00:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:49 smithi133 ceph-mon[125939]: pgmap v6344: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 147 KiB/s wr, 9 op/s 2023-05-08T07:00:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11787.829405 secs 2023-05-08T07:00:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11788.387779 secs 2023-05-08T07:00:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:49 smithi096 ceph-mon[124666]: pgmap v6344: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 147 KiB/s wr, 9 op/s 2023-05-08T07:00:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11787.829405 secs 2023-05-08T07:00:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11788.387779 secs 2023-05-08T07:00:51.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:51 smithi186 ceph-mon[126480]: pgmap v6345: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 255 KiB/s wr, 13 op/s 2023-05-08T07:00:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:51 smithi133 ceph-mon[125939]: pgmap v6345: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 255 KiB/s wr, 13 op/s 2023-05-08T07:00:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:51 smithi096 ceph-mon[124666]: pgmap v6345: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 255 KiB/s wr, 13 op/s 2023-05-08T07:00:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:53 smithi186 ceph-mon[126480]: pgmap v6346: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 169 KiB/s wr, 9 op/s 2023-05-08T07:00:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:53 smithi133 ceph-mon[125939]: pgmap v6346: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 169 KiB/s wr, 9 op/s 2023-05-08T07:00:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:53 smithi096 ceph-mon[124666]: pgmap v6346: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 169 KiB/s wr, 9 op/s 2023-05-08T07:00:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11792.829486 secs 2023-05-08T07:00:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11792.829486 secs 2023-05-08T07:00:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11792.829486 secs 2023-05-08T07:00:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:55 smithi186 ceph-mon[126480]: pgmap v6347: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 169 KiB/s wr, 9 op/s 2023-05-08T07:00:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:55 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:00:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:55 smithi133 ceph-mon[125939]: pgmap v6347: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 169 KiB/s wr, 9 op/s 2023-05-08T07:00:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:55 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:00:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:55 smithi096 ceph-mon[124666]: pgmap v6347: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 169 KiB/s wr, 9 op/s 2023-05-08T07:00:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:55 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:00:56.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:56 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:00:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:00:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:00:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:56 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:00:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:00:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:00:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:56 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:00:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:00:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:00:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:57 smithi186 ceph-mon[126480]: pgmap v6348: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 213 KiB/s wr, 13 op/s 2023-05-08T07:00:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:57 smithi133 ceph-mon[125939]: pgmap v6348: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 213 KiB/s wr, 13 op/s 2023-05-08T07:00:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:57 smithi096 ceph-mon[124666]: pgmap v6348: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 213 KiB/s wr, 13 op/s 2023-05-08T07:00:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:59 smithi186 ceph-mon[126480]: pgmap v6349: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 152 KiB/s wr, 8 op/s 2023-05-08T07:00:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11797.829597 secs 2023-05-08T07:00:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:00:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11798.388015 secs 2023-05-08T07:00:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:59 smithi133 ceph-mon[125939]: pgmap v6349: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 152 KiB/s wr, 8 op/s 2023-05-08T07:00:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11797.829597 secs 2023-05-08T07:00:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:00:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11798.388015 secs 2023-05-08T07:00:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:59 smithi096 ceph-mon[124666]: pgmap v6349: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 152 KiB/s wr, 8 op/s 2023-05-08T07:00:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11797.829597 secs 2023-05-08T07:00:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:00:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11798.388015 secs 2023-05-08T07:01:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:01 smithi186 ceph-mon[126480]: pgmap v6350: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 248 KiB/s wr, 13 op/s 2023-05-08T07:01:01.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11799.669632 secs 2023-05-08T07:01:01.630 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:01 smithi096 ceph-mon[124666]: pgmap v6350: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 248 KiB/s wr, 13 op/s 2023-05-08T07:01:01.631 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11799.669632 secs 2023-05-08T07:01:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:01 smithi133 ceph-mon[125939]: pgmap v6350: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 248 KiB/s wr, 13 op/s 2023-05-08T07:01:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11799.669632 secs 2023-05-08T07:01:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:03 smithi186 ceph-mon[126480]: pgmap v6351: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 140 KiB/s wr, 8 op/s 2023-05-08T07:01:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:03 smithi133 ceph-mon[125939]: pgmap v6351: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 140 KiB/s wr, 8 op/s 2023-05-08T07:01:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:03 smithi096 ceph-mon[124666]: pgmap v6351: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 140 KiB/s wr, 8 op/s 2023-05-08T07:01:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11802.829689 secs 2023-05-08T07:01:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:04 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:01:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:04 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:01:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:04 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:01:04.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:04 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:01:04.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11803.388135 secs 2023-05-08T07:01:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11802.829689 secs 2023-05-08T07:01:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:04 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:01:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:04 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:01:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:04 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:01:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:04 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:01:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11803.388135 secs 2023-05-08T07:01:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11802.829689 secs 2023-05-08T07:01:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:04 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:01:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:04 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:01:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:04 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:01:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:04 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:01:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11803.388135 secs 2023-05-08T07:01:05.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:05 smithi186 ceph-mon[126480]: pgmap v6352: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 140 KiB/s wr, 8 op/s 2023-05-08T07:01:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:05 smithi133 ceph-mon[125939]: pgmap v6352: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 140 KiB/s wr, 8 op/s 2023-05-08T07:01:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:05 smithi096 ceph-mon[124666]: pgmap v6352: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 140 KiB/s wr, 8 op/s 2023-05-08T07:01:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11804.669788 secs 2023-05-08T07:01:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11804.669788 secs 2023-05-08T07:01:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11804.669788 secs 2023-05-08T07:01:07.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:07 smithi186 ceph-mon[126480]: pgmap v6353: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 214 KiB/s wr, 26 op/s 2023-05-08T07:01:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:07 smithi133 ceph-mon[125939]: pgmap v6353: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 214 KiB/s wr, 26 op/s 2023-05-08T07:01:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:07 smithi096 ceph-mon[124666]: pgmap v6353: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 214 KiB/s wr, 26 op/s 2023-05-08T07:01:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:09 smithi186 ceph-mon[126480]: pgmap v6354: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 169 KiB/s wr, 22 op/s 2023-05-08T07:01:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11807.829800 secs 2023-05-08T07:01:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11808.388255 secs 2023-05-08T07:01:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:09 smithi133 ceph-mon[125939]: pgmap v6354: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 169 KiB/s wr, 22 op/s 2023-05-08T07:01:09.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11807.829800 secs 2023-05-08T07:01:09.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11808.388255 secs 2023-05-08T07:01:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:09 smithi096 ceph-mon[124666]: pgmap v6354: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 169 KiB/s wr, 22 op/s 2023-05-08T07:01:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11807.829800 secs 2023-05-08T07:01:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11808.388255 secs 2023-05-08T07:01:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:11 smithi186 ceph-mon[126480]: pgmap v6355: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 198 KiB/s wr, 26 op/s 2023-05-08T07:01:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11809.669876 secs 2023-05-08T07:01:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:11 smithi186 ceph-mon[126480]: osdmap e474: 12 total, 12 up, 12 in 2023-05-08T07:01:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:11 smithi133 ceph-mon[125939]: pgmap v6355: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 198 KiB/s wr, 26 op/s 2023-05-08T07:01:11.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11809.669876 secs 2023-05-08T07:01:11.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:11 smithi133 ceph-mon[125939]: osdmap e474: 12 total, 12 up, 12 in 2023-05-08T07:01:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:11 smithi096 ceph-mon[124666]: pgmap v6355: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 198 KiB/s wr, 26 op/s 2023-05-08T07:01:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11809.669876 secs 2023-05-08T07:01:11.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:11 smithi096 ceph-mon[124666]: osdmap e474: 12 total, 12 up, 12 in 2023-05-08T07:01:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:13 smithi186 ceph-mon[126480]: pgmap v6357: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 123 KiB/s wr, 25 op/s 2023-05-08T07:01:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:13 smithi133 ceph-mon[125939]: pgmap v6357: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 123 KiB/s wr, 25 op/s 2023-05-08T07:01:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:13 smithi096 ceph-mon[124666]: pgmap v6357: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 123 KiB/s wr, 25 op/s 2023-05-08T07:01:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11812.829917 secs 2023-05-08T07:01:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11813.388393 secs 2023-05-08T07:01:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11812.829917 secs 2023-05-08T07:01:14.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11813.388393 secs 2023-05-08T07:01:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11812.829917 secs 2023-05-08T07:01:14.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11813.388393 secs 2023-05-08T07:01:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:15 smithi186 ceph-mon[126480]: pgmap v6358: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 123 KiB/s wr, 25 op/s 2023-05-08T07:01:15.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:15 smithi133 ceph-mon[125939]: pgmap v6358: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 123 KiB/s wr, 25 op/s 2023-05-08T07:01:15.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:15 smithi096 ceph-mon[124666]: pgmap v6358: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 123 KiB/s wr, 25 op/s 2023-05-08T07:01:16.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11814.669942 secs 2023-05-08T07:01:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11814.669942 secs 2023-05-08T07:01:16.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11814.669942 secs 2023-05-08T07:01:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:17 smithi186 ceph-mon[126480]: pgmap v6359: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 41 KiB/s wr, 8 op/s 2023-05-08T07:01:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:17 smithi133 ceph-mon[125939]: pgmap v6359: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 41 KiB/s wr, 8 op/s 2023-05-08T07:01:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:17 smithi096 ceph-mon[124666]: pgmap v6359: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 41 KiB/s wr, 8 op/s 2023-05-08T07:01:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:19 smithi133 ceph-mon[125939]: pgmap v6360: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 41 KiB/s wr, 8 op/s 2023-05-08T07:01:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11817.830054 secs 2023-05-08T07:01:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11818.388515 secs 2023-05-08T07:01:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:19 smithi096 ceph-mon[124666]: pgmap v6360: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 41 KiB/s wr, 8 op/s 2023-05-08T07:01:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11817.830054 secs 2023-05-08T07:01:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11818.388515 secs 2023-05-08T07:01:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:19 smithi186 ceph-mon[126480]: pgmap v6360: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 41 KiB/s wr, 8 op/s 2023-05-08T07:01:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11817.830054 secs 2023-05-08T07:01:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11818.388515 secs 2023-05-08T07:01:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:21 smithi133 ceph-mon[125939]: pgmap v6361: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 82 KiB/s wr, 8 op/s 2023-05-08T07:01:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11819.670067 secs 2023-05-08T07:01:21.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:21 smithi133 ceph-mon[125939]: osdmap e475: 12 total, 12 up, 12 in 2023-05-08T07:01:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:21 smithi096 ceph-mon[124666]: pgmap v6361: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 82 KiB/s wr, 8 op/s 2023-05-08T07:01:21.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11819.670067 secs 2023-05-08T07:01:21.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:21 smithi096 ceph-mon[124666]: osdmap e475: 12 total, 12 up, 12 in 2023-05-08T07:01:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:21 smithi186 ceph-mon[126480]: pgmap v6361: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 82 KiB/s wr, 8 op/s 2023-05-08T07:01:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11819.670067 secs 2023-05-08T07:01:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:21 smithi186 ceph-mon[126480]: osdmap e475: 12 total, 12 up, 12 in 2023-05-08T07:01:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:23 smithi133 ceph-mon[125939]: pgmap v6363: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 82 KiB/s wr, 8 op/s 2023-05-08T07:01:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:23 smithi096 ceph-mon[124666]: pgmap v6363: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 82 KiB/s wr, 8 op/s 2023-05-08T07:01:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:23 smithi186 ceph-mon[126480]: pgmap v6363: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 82 KiB/s wr, 8 op/s 2023-05-08T07:01:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11822.830157 secs 2023-05-08T07:01:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11823.388636 secs 2023-05-08T07:01:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11822.830157 secs 2023-05-08T07:01:24.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11823.388636 secs 2023-05-08T07:01:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11822.830157 secs 2023-05-08T07:01:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11823.388636 secs 2023-05-08T07:01:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:25 smithi133 ceph-mon[125939]: pgmap v6364: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 82 KiB/s wr, 8 op/s 2023-05-08T07:01:25.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:25 smithi096 ceph-mon[124666]: pgmap v6364: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 82 KiB/s wr, 8 op/s 2023-05-08T07:01:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:25 smithi186 ceph-mon[126480]: pgmap v6364: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 82 KiB/s wr, 8 op/s 2023-05-08T07:01:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11824.670193 secs 2023-05-08T07:01:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11824.670193 secs 2023-05-08T07:01:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11824.670193 secs 2023-05-08T07:01:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:27 smithi133 ceph-mon[125939]: pgmap v6365: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 76 KiB/s wr, 8 op/s 2023-05-08T07:01:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:27 smithi096 ceph-mon[124666]: pgmap v6365: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 76 KiB/s wr, 8 op/s 2023-05-08T07:01:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:27 smithi186 ceph-mon[126480]: pgmap v6365: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 76 KiB/s wr, 8 op/s 2023-05-08T07:01:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:29 smithi133 ceph-mon[125939]: pgmap v6366: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 76 KiB/s wr, 8 op/s 2023-05-08T07:01:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11827.830282 secs 2023-05-08T07:01:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11828.388758 secs 2023-05-08T07:01:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:29 smithi096 ceph-mon[124666]: pgmap v6366: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 76 KiB/s wr, 8 op/s 2023-05-08T07:01:29.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11827.830282 secs 2023-05-08T07:01:29.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11828.388758 secs 2023-05-08T07:01:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:29 smithi186 ceph-mon[126480]: pgmap v6366: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 76 KiB/s wr, 8 op/s 2023-05-08T07:01:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11827.830282 secs 2023-05-08T07:01:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11828.388758 secs 2023-05-08T07:01:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:31 smithi133 ceph-mon[125939]: pgmap v6367: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 56 KiB/s wr, 8 op/s 2023-05-08T07:01:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11829.670331 secs 2023-05-08T07:01:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:31 smithi096 ceph-mon[124666]: pgmap v6367: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 56 KiB/s wr, 8 op/s 2023-05-08T07:01:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11829.670331 secs 2023-05-08T07:01:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:31 smithi186 ceph-mon[126480]: pgmap v6367: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 56 KiB/s wr, 8 op/s 2023-05-08T07:01:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11829.670331 secs 2023-05-08T07:01:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:33 smithi133 ceph-mon[125939]: pgmap v6368: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 52 KiB/s wr, 8 op/s 2023-05-08T07:01:33.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:33 smithi096 ceph-mon[124666]: pgmap v6368: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 52 KiB/s wr, 8 op/s 2023-05-08T07:01:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:33 smithi186 ceph-mon[126480]: pgmap v6368: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 52 KiB/s wr, 8 op/s 2023-05-08T07:01:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11832.830398 secs 2023-05-08T07:01:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:34 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:01:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11833.388828 secs 2023-05-08T07:01:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:34 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:01:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:34 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:01:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:34 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:01:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11832.830398 secs 2023-05-08T07:01:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:34 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:01:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11833.388828 secs 2023-05-08T07:01:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:34 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:01:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:34 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:01:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:34 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:01:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11832.830398 secs 2023-05-08T07:01:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:34 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:01:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11833.388828 secs 2023-05-08T07:01:34.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:34 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:01:34.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:34 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:01:34.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:34 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:01:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:35 smithi133 ceph-mon[125939]: pgmap v6369: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 47 KiB/s wr, 7 op/s 2023-05-08T07:01:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:35 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:01:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:35 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T07:01:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:35 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T07:01:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:35 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:01:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:35 smithi096 ceph-mon[124666]: pgmap v6369: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 47 KiB/s wr, 7 op/s 2023-05-08T07:01:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:35 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:01:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:35 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T07:01:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:35 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T07:01:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:35 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:01:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:35 smithi186 ceph-mon[126480]: pgmap v6369: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 47 KiB/s wr, 7 op/s 2023-05-08T07:01:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:35 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:01:35.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:35 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T07:01:35.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:35 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T07:01:35.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:35 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:01:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11834.670451 secs 2023-05-08T07:01:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11834.670451 secs 2023-05-08T07:01:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11834.670451 secs 2023-05-08T07:01:37.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:37 smithi133 ceph-mon[125939]: pgmap v6370: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 47 KiB/s wr, 10 op/s 2023-05-08T07:01:37.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:37 smithi096 ceph-mon[124666]: pgmap v6370: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 47 KiB/s wr, 10 op/s 2023-05-08T07:01:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:37 smithi186 ceph-mon[126480]: pgmap v6370: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 47 KiB/s wr, 10 op/s 2023-05-08T07:01:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:39 smithi133 ceph-mon[125939]: pgmap v6371: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 46 KiB/s wr, 6 op/s 2023-05-08T07:01:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11837.830531 secs 2023-05-08T07:01:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11838.388973 secs 2023-05-08T07:01:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:39 smithi096 ceph-mon[124666]: pgmap v6371: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 46 KiB/s wr, 6 op/s 2023-05-08T07:01:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11837.830531 secs 2023-05-08T07:01:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11838.388973 secs 2023-05-08T07:01:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:39 smithi186 ceph-mon[126480]: pgmap v6371: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 46 KiB/s wr, 6 op/s 2023-05-08T07:01:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11837.830531 secs 2023-05-08T07:01:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11838.388973 secs 2023-05-08T07:01:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:41 smithi133 ceph-mon[125939]: pgmap v6372: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 76 KiB/s wr, 9 op/s 2023-05-08T07:01:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11839.670596 secs 2023-05-08T07:01:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:41 smithi096 ceph-mon[124666]: pgmap v6372: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 76 KiB/s wr, 9 op/s 2023-05-08T07:01:41.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11839.670596 secs 2023-05-08T07:01:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:41 smithi186 ceph-mon[126480]: pgmap v6372: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 76 KiB/s wr, 9 op/s 2023-05-08T07:01:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11839.670596 secs 2023-05-08T07:01:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:43 smithi133 ceph-mon[125939]: pgmap v6373: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 6 op/s 2023-05-08T07:01:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:43 smithi096 ceph-mon[124666]: pgmap v6373: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 6 op/s 2023-05-08T07:01:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:43 smithi186 ceph-mon[126480]: pgmap v6373: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 6 op/s 2023-05-08T07:01:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11842.830641 secs 2023-05-08T07:01:44.775 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11842.830641 secs 2023-05-08T07:01:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11842.830641 secs 2023-05-08T07:01:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:45 smithi133 ceph-mon[125939]: pgmap v6374: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 6 op/s 2023-05-08T07:01:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:45 smithi096 ceph-mon[124666]: pgmap v6374: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 6 op/s 2023-05-08T07:01:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:45 smithi186 ceph-mon[126480]: pgmap v6374: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 6 op/s 2023-05-08T07:01:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11844.670728 secs 2023-05-08T07:01:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11844.670728 secs 2023-05-08T07:01:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11844.670728 secs 2023-05-08T07:01:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:47 smithi133 ceph-mon[125939]: pgmap v6375: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 98 KiB/s wr, 10 op/s 2023-05-08T07:01:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:01:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:47 smithi096 ceph-mon[124666]: pgmap v6375: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 98 KiB/s wr, 10 op/s 2023-05-08T07:01:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:01:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:47 smithi186 ceph-mon[126480]: pgmap v6375: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 98 KiB/s wr, 10 op/s 2023-05-08T07:01:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:01:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:48 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:01:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:01:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:01:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:48 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:01:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:01:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:01:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:48 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:01:48.929 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:01:48.929 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:01:49.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:49 smithi133 ceph-mon[125939]: pgmap v6376: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 98 KiB/s wr, 7 op/s 2023-05-08T07:01:49.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11847.830779 secs 2023-05-08T07:01:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:49 smithi096 ceph-mon[124666]: pgmap v6376: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 98 KiB/s wr, 7 op/s 2023-05-08T07:01:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11847.830779 secs 2023-05-08T07:01:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:49 smithi186 ceph-mon[126480]: pgmap v6376: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 98 KiB/s wr, 7 op/s 2023-05-08T07:01:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11847.830779 secs 2023-05-08T07:01:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:50 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:01:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:50 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:01:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:50 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:01:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:51 smithi133 ceph-mon[125939]: pgmap v6377: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 183 KiB/s wr, 13 op/s 2023-05-08T07:01:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:01:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:01:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:51 smithi096 ceph-mon[124666]: pgmap v6377: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 183 KiB/s wr, 13 op/s 2023-05-08T07:01:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:01:51.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:01:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:51 smithi186 ceph-mon[126480]: pgmap v6377: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 183 KiB/s wr, 13 op/s 2023-05-08T07:01:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:01:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:01:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:52 smithi186 ceph-mon[126480]: pgmap v6378: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 153 KiB/s wr, 10 op/s 2023-05-08T07:01:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:52 smithi133 ceph-mon[125939]: pgmap v6378: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 153 KiB/s wr, 10 op/s 2023-05-08T07:01:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:52 smithi096 ceph-mon[124666]: pgmap v6378: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 153 KiB/s wr, 10 op/s 2023-05-08T07:01:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11852.830899 secs 2023-05-08T07:01:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:54 smithi133 ceph-mon[125939]: pgmap v6379: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 153 KiB/s wr, 10 op/s 2023-05-08T07:01:54.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11853.389328 secs 2023-05-08T07:01:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11852.830899 secs 2023-05-08T07:01:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:54 smithi096 ceph-mon[124666]: pgmap v6379: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 153 KiB/s wr, 10 op/s 2023-05-08T07:01:55.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11853.389328 secs 2023-05-08T07:01:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11852.830899 secs 2023-05-08T07:01:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:54 smithi186 ceph-mon[126480]: pgmap v6379: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 153 KiB/s wr, 10 op/s 2023-05-08T07:01:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11853.389328 secs 2023-05-08T07:01:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:55 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:01:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:55 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:01:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:55 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:01:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:55 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:01:56.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:55 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:01:56.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:55 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:01:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:55 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:01:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:55 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:01:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:55 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:01:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:56 smithi096 ceph-mon[124666]: pgmap v6380: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 191 KiB/s wr, 14 op/s 2023-05-08T07:01:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:56 smithi186 ceph-mon[126480]: pgmap v6380: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 191 KiB/s wr, 14 op/s 2023-05-08T07:01:57.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:56 smithi133 ceph-mon[125939]: pgmap v6380: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 191 KiB/s wr, 14 op/s 2023-05-08T07:01:59.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:58 smithi096 ceph-mon[124666]: pgmap v6381: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 124 KiB/s wr, 10 op/s 2023-05-08T07:01:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:58 smithi186 ceph-mon[126480]: pgmap v6381: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 124 KiB/s wr, 10 op/s 2023-05-08T07:01:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:58 smithi133 ceph-mon[125939]: pgmap v6381: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 124 KiB/s wr, 10 op/s 2023-05-08T07:02:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:01:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11857.831013 secs 2023-05-08T07:02:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:01:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11857.831013 secs 2023-05-08T07:02:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:01:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11857.831013 secs 2023-05-08T07:02:01.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:00 smithi096 ceph-mon[124666]: pgmap v6382: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 223 KiB/s wr, 15 op/s 2023-05-08T07:02:01.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11859.671106 secs 2023-05-08T07:02:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:00 smithi186 ceph-mon[126480]: pgmap v6382: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 223 KiB/s wr, 15 op/s 2023-05-08T07:02:01.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11859.671106 secs 2023-05-08T07:02:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:00 smithi133 ceph-mon[125939]: pgmap v6382: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 223 KiB/s wr, 15 op/s 2023-05-08T07:02:01.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11859.671106 secs 2023-05-08T07:02:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:02 smithi186 ceph-mon[126480]: pgmap v6383: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 138 KiB/s wr, 9 op/s 2023-05-08T07:02:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:02 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:02:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:02 smithi133 ceph-mon[125939]: pgmap v6383: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 138 KiB/s wr, 9 op/s 2023-05-08T07:02:03.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:02 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:02:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:02 smithi096 ceph-mon[124666]: pgmap v6383: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 138 KiB/s wr, 9 op/s 2023-05-08T07:02:03.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:02 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:02:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:02:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:02:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:03 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:02:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:02:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:02:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:03 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:02:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:02:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:02:04.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:03 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:02:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11862.831138 secs 2023-05-08T07:02:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:04 smithi186 ceph-mon[126480]: pgmap v6384: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 138 KiB/s wr, 9 op/s 2023-05-08T07:02:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11863.389556 secs 2023-05-08T07:02:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11862.831138 secs 2023-05-08T07:02:05.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:04 smithi133 ceph-mon[125939]: pgmap v6384: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 138 KiB/s wr, 9 op/s 2023-05-08T07:02:05.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11863.389556 secs 2023-05-08T07:02:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11862.831138 secs 2023-05-08T07:02:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:04 smithi096 ceph-mon[124666]: pgmap v6384: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 138 KiB/s wr, 9 op/s 2023-05-08T07:02:05.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11863.389556 secs 2023-05-08T07:02:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11864.671232 secs 2023-05-08T07:02:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11864.671232 secs 2023-05-08T07:02:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11864.671232 secs 2023-05-08T07:02:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:06 smithi186 ceph-mon[126480]: pgmap v6385: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 210 KiB/s wr, 28 op/s 2023-05-08T07:02:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:06 smithi133 ceph-mon[125939]: pgmap v6385: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 210 KiB/s wr, 28 op/s 2023-05-08T07:02:07.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:06 smithi096 ceph-mon[124666]: pgmap v6385: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 210 KiB/s wr, 28 op/s 2023-05-08T07:02:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:07 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:02:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:07 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:02:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:07 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:02:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:07 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:02:08.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:07 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:02:08.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:07 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:02:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:07 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:02:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:07 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:02:08.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:07 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:02:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:08 smithi186 ceph-mon[126480]: pgmap v6386: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 171 KiB/s wr, 24 op/s 2023-05-08T07:02:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11867.831282 secs 2023-05-08T07:02:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:08 smithi133 ceph-mon[125939]: pgmap v6386: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 171 KiB/s wr, 24 op/s 2023-05-08T07:02:09.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11867.831282 secs 2023-05-08T07:02:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:08 smithi096 ceph-mon[124666]: pgmap v6386: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 171 KiB/s wr, 24 op/s 2023-05-08T07:02:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11867.831282 secs 2023-05-08T07:02:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11868.389671 secs 2023-05-08T07:02:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11868.389671 secs 2023-05-08T07:02:10.300 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11868.389671 secs 2023-05-08T07:02:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:10 smithi186 ceph-mon[126480]: pgmap v6387: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 196 KiB/s wr, 27 op/s 2023-05-08T07:02:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11869.671388 secs 2023-05-08T07:02:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:10 smithi133 ceph-mon[125939]: pgmap v6387: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 196 KiB/s wr, 27 op/s 2023-05-08T07:02:11.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11869.671388 secs 2023-05-08T07:02:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:10 smithi096 ceph-mon[124666]: pgmap v6387: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 196 KiB/s wr, 27 op/s 2023-05-08T07:02:11.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11869.671388 secs 2023-05-08T07:02:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:11 smithi186 ceph-mon[126480]: osdmap e476: 12 total, 12 up, 12 in 2023-05-08T07:02:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:11 smithi133 ceph-mon[125939]: osdmap e476: 12 total, 12 up, 12 in 2023-05-08T07:02:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:11 smithi096 ceph-mon[124666]: osdmap e476: 12 total, 12 up, 12 in 2023-05-08T07:02:13.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:12 smithi186 ceph-mon[126480]: pgmap v6389: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 116 KiB/s wr, 26 op/s 2023-05-08T07:02:13.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:12 smithi133 ceph-mon[125939]: pgmap v6389: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 116 KiB/s wr, 26 op/s 2023-05-08T07:02:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:12 smithi096 ceph-mon[124666]: pgmap v6389: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 116 KiB/s wr, 26 op/s 2023-05-08T07:02:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11872.831407 secs 2023-05-08T07:02:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11872.831407 secs 2023-05-08T07:02:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11872.831407 secs 2023-05-08T07:02:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:14 smithi186 ceph-mon[126480]: pgmap v6390: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 116 KiB/s wr, 26 op/s 2023-05-08T07:02:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11873.389736 secs 2023-05-08T07:02:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:14 smithi133 ceph-mon[125939]: pgmap v6390: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 116 KiB/s wr, 26 op/s 2023-05-08T07:02:15.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11873.389736 secs 2023-05-08T07:02:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:14 smithi096 ceph-mon[124666]: pgmap v6390: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 116 KiB/s wr, 26 op/s 2023-05-08T07:02:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11873.389736 secs 2023-05-08T07:02:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11874.671519 secs 2023-05-08T07:02:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11874.671519 secs 2023-05-08T07:02:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11874.671519 secs 2023-05-08T07:02:17.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:16 smithi186 ceph-mon[126480]: pgmap v6391: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 36 KiB/s wr, 8 op/s 2023-05-08T07:02:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:16 smithi133 ceph-mon[125939]: pgmap v6391: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 36 KiB/s wr, 8 op/s 2023-05-08T07:02:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:16 smithi096 ceph-mon[124666]: pgmap v6391: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 36 KiB/s wr, 8 op/s 2023-05-08T07:02:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:18 smithi186 ceph-mon[126480]: pgmap v6392: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 36 KiB/s wr, 8 op/s 2023-05-08T07:02:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11877.831526 secs 2023-05-08T07:02:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:18 smithi133 ceph-mon[125939]: pgmap v6392: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 36 KiB/s wr, 8 op/s 2023-05-08T07:02:19.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11877.831526 secs 2023-05-08T07:02:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:18 smithi096 ceph-mon[124666]: pgmap v6392: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 36 KiB/s wr, 8 op/s 2023-05-08T07:02:19.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11877.831526 secs 2023-05-08T07:02:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11878.389801 secs 2023-05-08T07:02:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11878.389801 secs 2023-05-08T07:02:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11878.389801 secs 2023-05-08T07:02:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:20 smithi186 ceph-mon[126480]: pgmap v6393: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 6.5 KiB/s wr, 8 op/s 2023-05-08T07:02:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11879.671652 secs 2023-05-08T07:02:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:20 smithi186 ceph-mon[126480]: osdmap e477: 12 total, 12 up, 12 in 2023-05-08T07:02:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:20 smithi133 ceph-mon[125939]: pgmap v6393: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 6.5 KiB/s wr, 8 op/s 2023-05-08T07:02:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11879.671652 secs 2023-05-08T07:02:21.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:20 smithi133 ceph-mon[125939]: osdmap e477: 12 total, 12 up, 12 in 2023-05-08T07:02:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:20 smithi096 ceph-mon[124666]: pgmap v6393: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 6.5 KiB/s wr, 8 op/s 2023-05-08T07:02:21.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11879.671652 secs 2023-05-08T07:02:21.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:20 smithi096 ceph-mon[124666]: osdmap e477: 12 total, 12 up, 12 in 2023-05-08T07:02:23.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:22 smithi186 ceph-mon[126480]: pgmap v6395: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 6.4 KiB/s wr, 8 op/s 2023-05-08T07:02:23.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:22 smithi133 ceph-mon[125939]: pgmap v6395: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 6.4 KiB/s wr, 8 op/s 2023-05-08T07:02:23.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:22 smithi096 ceph-mon[124666]: pgmap v6395: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 6.4 KiB/s wr, 8 op/s 2023-05-08T07:02:24.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11882.831615 secs 2023-05-08T07:02:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11882.831615 secs 2023-05-08T07:02:24.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11882.831615 secs 2023-05-08T07:02:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:24 smithi186 ceph-mon[126480]: pgmap v6396: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 6.4 KiB/s wr, 8 op/s 2023-05-08T07:02:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11883.389918 secs 2023-05-08T07:02:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:24 smithi133 ceph-mon[125939]: pgmap v6396: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 6.4 KiB/s wr, 8 op/s 2023-05-08T07:02:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11883.389918 secs 2023-05-08T07:02:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:24 smithi096 ceph-mon[124666]: pgmap v6396: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 6.4 KiB/s wr, 8 op/s 2023-05-08T07:02:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11883.389918 secs 2023-05-08T07:02:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11884.671807 secs 2023-05-08T07:02:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11884.671807 secs 2023-05-08T07:02:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11884.671807 secs 2023-05-08T07:02:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:26 smithi186 ceph-mon[126480]: pgmap v6397: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 36 KiB/s wr, 8 op/s 2023-05-08T07:02:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:26 smithi133 ceph-mon[125939]: pgmap v6397: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 36 KiB/s wr, 8 op/s 2023-05-08T07:02:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:26 smithi096 ceph-mon[124666]: pgmap v6397: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 36 KiB/s wr, 8 op/s 2023-05-08T07:02:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:28 smithi186 ceph-mon[126480]: pgmap v6398: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 36 KiB/s wr, 8 op/s 2023-05-08T07:02:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11887.831740 secs 2023-05-08T07:02:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:28 smithi133 ceph-mon[125939]: pgmap v6398: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 36 KiB/s wr, 8 op/s 2023-05-08T07:02:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11887.831740 secs 2023-05-08T07:02:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:28 smithi096 ceph-mon[124666]: pgmap v6398: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 36 KiB/s wr, 8 op/s 2023-05-08T07:02:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11887.831740 secs 2023-05-08T07:02:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11888.390040 secs 2023-05-08T07:02:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11888.390040 secs 2023-05-08T07:02:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11888.390040 secs 2023-05-08T07:02:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:30 smithi186 ceph-mon[126480]: pgmap v6399: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 72 KiB/s wr, 8 op/s 2023-05-08T07:02:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11889.671857 secs 2023-05-08T07:02:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:30 smithi133 ceph-mon[125939]: pgmap v6399: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 72 KiB/s wr, 8 op/s 2023-05-08T07:02:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11889.671857 secs 2023-05-08T07:02:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:30 smithi096 ceph-mon[124666]: pgmap v6399: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 72 KiB/s wr, 8 op/s 2023-05-08T07:02:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11889.671857 secs 2023-05-08T07:02:33.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:32 smithi186 ceph-mon[126480]: pgmap v6400: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 66 KiB/s wr, 8 op/s 2023-05-08T07:02:33.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:32 smithi133 ceph-mon[125939]: pgmap v6400: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 66 KiB/s wr, 8 op/s 2023-05-08T07:02:33.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:32 smithi096 ceph-mon[124666]: pgmap v6400: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 66 KiB/s wr, 8 op/s 2023-05-08T07:02:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11892.831861 secs 2023-05-08T07:02:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11892.831861 secs 2023-05-08T07:02:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11892.831861 secs 2023-05-08T07:02:35.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:34 smithi133 ceph-mon[125939]: pgmap v6401: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 60 KiB/s wr, 7 op/s 2023-05-08T07:02:35.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11893.390159 secs 2023-05-08T07:02:35.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:34 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:02:35.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:34 smithi096 ceph-mon[124666]: pgmap v6401: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 60 KiB/s wr, 7 op/s 2023-05-08T07:02:35.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11893.390159 secs 2023-05-08T07:02:35.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:34 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:02:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:34 smithi186 ceph-mon[126480]: pgmap v6401: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 60 KiB/s wr, 7 op/s 2023-05-08T07:02:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11893.390159 secs 2023-05-08T07:02:35.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:34 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:02:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11894.671954 secs 2023-05-08T07:02:36.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:02:36.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:02:36.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:35 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:02:36.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:02:36.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:35 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T07:02:36.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:35 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T07:02:36.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:35 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:02:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11894.671954 secs 2023-05-08T07:02:36.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:02:36.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:02:36.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:35 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:02:36.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:02:36.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:35 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T07:02:36.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:35 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T07:02:36.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:35 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:02:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11894.671954 secs 2023-05-08T07:02:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:02:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:02:36.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:35 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:02:36.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:02:36.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:35 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T07:02:36.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:35 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T07:02:36.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:35 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:02:37.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:37 smithi186 ceph-mon[126480]: pgmap v6402: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 89 KiB/s wr, 10 op/s 2023-05-08T07:02:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:37 smithi133 ceph-mon[125939]: pgmap v6402: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 89 KiB/s wr, 10 op/s 2023-05-08T07:02:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:37 smithi096 ceph-mon[124666]: pgmap v6402: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 89 KiB/s wr, 10 op/s 2023-05-08T07:02:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:39 smithi186 ceph-mon[126480]: pgmap v6403: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 59 KiB/s wr, 6 op/s 2023-05-08T07:02:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11897.831960 secs 2023-05-08T07:02:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:39 smithi133 ceph-mon[125939]: pgmap v6403: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 59 KiB/s wr, 6 op/s 2023-05-08T07:02:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11897.831960 secs 2023-05-08T07:02:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:39 smithi096 ceph-mon[124666]: pgmap v6403: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 59 KiB/s wr, 6 op/s 2023-05-08T07:02:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11897.831960 secs 2023-05-08T07:02:40.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11898.390281 secs 2023-05-08T07:02:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11898.390281 secs 2023-05-08T07:02:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11898.390281 secs 2023-05-08T07:02:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:41 smithi186 ceph-mon[126480]: pgmap v6404: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 123 KiB/s wr, 10 op/s 2023-05-08T07:02:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11899.672074 secs 2023-05-08T07:02:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:41 smithi133 ceph-mon[125939]: pgmap v6404: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 123 KiB/s wr, 10 op/s 2023-05-08T07:02:41.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11899.672074 secs 2023-05-08T07:02:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:41 smithi096 ceph-mon[124666]: pgmap v6404: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 123 KiB/s wr, 10 op/s 2023-05-08T07:02:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11899.672074 secs 2023-05-08T07:02:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:43 smithi186 ceph-mon[126480]: pgmap v6405: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 93 KiB/s wr, 7 op/s 2023-05-08T07:02:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:43 smithi133 ceph-mon[125939]: pgmap v6405: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 93 KiB/s wr, 7 op/s 2023-05-08T07:02:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:43 smithi096 ceph-mon[124666]: pgmap v6405: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 93 KiB/s wr, 7 op/s 2023-05-08T07:02:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11902.832108 secs 2023-05-08T07:02:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11902.832108 secs 2023-05-08T07:02:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11902.832108 secs 2023-05-08T07:02:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:45 smithi186 ceph-mon[126480]: pgmap v6406: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 93 KiB/s wr, 7 op/s 2023-05-08T07:02:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:45 smithi133 ceph-mon[125939]: pgmap v6406: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 93 KiB/s wr, 7 op/s 2023-05-08T07:02:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:45 smithi096 ceph-mon[124666]: pgmap v6406: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 93 KiB/s wr, 7 op/s 2023-05-08T07:02:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11904.672173 secs 2023-05-08T07:02:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11904.672173 secs 2023-05-08T07:02:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11904.672173 secs 2023-05-08T07:02:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:47 smithi186 ceph-mon[126480]: pgmap v6407: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 157 KiB/s wr, 10 op/s 2023-05-08T07:02:47.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:02:47.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:47 smithi133 ceph-mon[125939]: pgmap v6407: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 157 KiB/s wr, 10 op/s 2023-05-08T07:02:47.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:02:47.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:47 smithi096 ceph-mon[124666]: pgmap v6407: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 157 KiB/s wr, 10 op/s 2023-05-08T07:02:47.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:02:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:48 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:02:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:02:48.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:02:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:48 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:02:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:02:48.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:02:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:48 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:02:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:02:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:02:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:49 smithi186 ceph-mon[126480]: pgmap v6408: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 128 KiB/s wr, 7 op/s 2023-05-08T07:02:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11907.832204 secs 2023-05-08T07:02:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:49 smithi133 ceph-mon[125939]: pgmap v6408: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 128 KiB/s wr, 7 op/s 2023-05-08T07:02:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11907.832204 secs 2023-05-08T07:02:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:49 smithi096 ceph-mon[124666]: pgmap v6408: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 128 KiB/s wr, 7 op/s 2023-05-08T07:02:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11907.832204 secs 2023-05-08T07:02:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:51 smithi186 ceph-mon[126480]: pgmap v6409: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 234 KiB/s wr, 12 op/s 2023-05-08T07:02:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:02:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:51 smithi133 ceph-mon[125939]: pgmap v6409: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 234 KiB/s wr, 12 op/s 2023-05-08T07:02:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:02:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:51 smithi096 ceph-mon[124666]: pgmap v6409: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 234 KiB/s wr, 12 op/s 2023-05-08T07:02:51.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:02:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:02:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:02:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:02:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:02:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:02:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:02:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:53 smithi186 ceph-mon[126480]: pgmap v6410: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 171 KiB/s wr, 8 op/s 2023-05-08T07:02:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:53 smithi133 ceph-mon[125939]: pgmap v6410: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 171 KiB/s wr, 8 op/s 2023-05-08T07:02:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:53 smithi096 ceph-mon[124666]: pgmap v6410: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 171 KiB/s wr, 8 op/s 2023-05-08T07:02:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11912.832317 secs 2023-05-08T07:02:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11912.832317 secs 2023-05-08T07:02:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11912.832317 secs 2023-05-08T07:02:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:55 smithi133 ceph-mon[125939]: pgmap v6411: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 171 KiB/s wr, 8 op/s 2023-05-08T07:02:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11913.390642 secs 2023-05-08T07:02:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:55 smithi096 ceph-mon[124666]: pgmap v6411: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 171 KiB/s wr, 8 op/s 2023-05-08T07:02:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11913.390642 secs 2023-05-08T07:02:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:55 smithi186 ceph-mon[126480]: pgmap v6411: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 171 KiB/s wr, 8 op/s 2023-05-08T07:02:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11913.390642 secs 2023-05-08T07:02:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:56 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:02:56.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:02:56.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:02:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:56 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:02:56.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:02:56.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:02:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:56 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:02:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:02:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:02:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:57 smithi133 ceph-mon[125939]: pgmap v6412: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 183 KiB/s wr, 12 op/s 2023-05-08T07:02:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:57 smithi096 ceph-mon[124666]: pgmap v6412: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 183 KiB/s wr, 12 op/s 2023-05-08T07:02:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:57 smithi186 ceph-mon[126480]: pgmap v6412: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 183 KiB/s wr, 12 op/s 2023-05-08T07:02:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:59 smithi133 ceph-mon[125939]: pgmap v6413: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 118 KiB/s wr, 9 op/s 2023-05-08T07:02:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:02:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11917.832405 secs 2023-05-08T07:02:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:59 smithi096 ceph-mon[124666]: pgmap v6413: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 118 KiB/s wr, 9 op/s 2023-05-08T07:02:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:02:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11917.832405 secs 2023-05-08T07:02:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:59 smithi186 ceph-mon[126480]: pgmap v6413: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 118 KiB/s wr, 9 op/s 2023-05-08T07:02:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:02:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11917.832405 secs 2023-05-08T07:03:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11918.390755 secs 2023-05-08T07:03:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11918.390755 secs 2023-05-08T07:03:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11918.390755 secs 2023-05-08T07:03:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:01 smithi133 ceph-mon[125939]: pgmap v6414: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 263 KiB/s wr, 13 op/s 2023-05-08T07:03:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:01 smithi096 ceph-mon[124666]: pgmap v6414: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 263 KiB/s wr, 13 op/s 2023-05-08T07:03:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:01 smithi186 ceph-mon[126480]: pgmap v6414: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 263 KiB/s wr, 13 op/s 2023-05-08T07:03:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:03 smithi133 ceph-mon[125939]: pgmap v6415: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 157 KiB/s wr, 8 op/s 2023-05-08T07:03:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:03 smithi096 ceph-mon[124666]: pgmap v6415: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 157 KiB/s wr, 8 op/s 2023-05-08T07:03:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:03 smithi186 ceph-mon[126480]: pgmap v6415: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 157 KiB/s wr, 8 op/s 2023-05-08T07:03:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11922.832507 secs 2023-05-08T07:03:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11922.832507 secs 2023-05-08T07:03:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11922.832507 secs 2023-05-08T07:03:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:05 smithi133 ceph-mon[125939]: pgmap v6416: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 157 KiB/s wr, 8 op/s 2023-05-08T07:03:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11923.390853 secs 2023-05-08T07:03:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:05 smithi096 ceph-mon[124666]: pgmap v6416: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 157 KiB/s wr, 8 op/s 2023-05-08T07:03:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11923.390853 secs 2023-05-08T07:03:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:05 smithi186 ceph-mon[126480]: pgmap v6416: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 157 KiB/s wr, 8 op/s 2023-05-08T07:03:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11923.390853 secs 2023-05-08T07:03:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11924.672672 secs 2023-05-08T07:03:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11924.672672 secs 2023-05-08T07:03:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11924.672672 secs 2023-05-08T07:03:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:07 smithi133 ceph-mon[125939]: pgmap v6417: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 260 KiB/s wr, 27 op/s 2023-05-08T07:03:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:07 smithi096 ceph-mon[124666]: pgmap v6417: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 260 KiB/s wr, 27 op/s 2023-05-08T07:03:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:07 smithi186 ceph-mon[126480]: pgmap v6417: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 260 KiB/s wr, 27 op/s 2023-05-08T07:03:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:08 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:03:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:03:08.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:03:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:08 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:03:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:03:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:03:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:08 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:03:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:03:08.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:03:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:09 smithi133 ceph-mon[125939]: pgmap v6418: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 248 KiB/s wr, 23 op/s 2023-05-08T07:03:09.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11927.832609 secs 2023-05-08T07:03:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:09 smithi096 ceph-mon[124666]: pgmap v6418: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 248 KiB/s wr, 23 op/s 2023-05-08T07:03:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11927.832609 secs 2023-05-08T07:03:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:09 smithi186 ceph-mon[126480]: pgmap v6418: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 248 KiB/s wr, 23 op/s 2023-05-08T07:03:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11927.832609 secs 2023-05-08T07:03:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11928.390968 secs 2023-05-08T07:03:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11928.390968 secs 2023-05-08T07:03:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11928.390968 secs 2023-05-08T07:03:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:11 smithi133 ceph-mon[125939]: pgmap v6419: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 325 KiB/s wr, 27 op/s 2023-05-08T07:03:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11929.672816 secs 2023-05-08T07:03:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:11 smithi133 ceph-mon[125939]: osdmap e478: 12 total, 12 up, 12 in 2023-05-08T07:03:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:11 smithi096 ceph-mon[124666]: pgmap v6419: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 325 KiB/s wr, 27 op/s 2023-05-08T07:03:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11929.672816 secs 2023-05-08T07:03:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:11 smithi096 ceph-mon[124666]: osdmap e478: 12 total, 12 up, 12 in 2023-05-08T07:03:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:11 smithi186 ceph-mon[126480]: pgmap v6419: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 325 KiB/s wr, 27 op/s 2023-05-08T07:03:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11929.672816 secs 2023-05-08T07:03:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:11 smithi186 ceph-mon[126480]: osdmap e478: 12 total, 12 up, 12 in 2023-05-08T07:03:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:13 smithi133 ceph-mon[125939]: pgmap v6421: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 215 KiB/s wr, 27 op/s 2023-05-08T07:03:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:13 smithi096 ceph-mon[124666]: pgmap v6421: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 215 KiB/s wr, 27 op/s 2023-05-08T07:03:13.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:13 smithi186 ceph-mon[126480]: pgmap v6421: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 215 KiB/s wr, 27 op/s 2023-05-08T07:03:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11932.832744 secs 2023-05-08T07:03:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11932.832744 secs 2023-05-08T07:03:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11932.832744 secs 2023-05-08T07:03:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:15 smithi133 ceph-mon[125939]: pgmap v6422: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 215 KiB/s wr, 27 op/s 2023-05-08T07:03:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11933.391108 secs 2023-05-08T07:03:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:15 smithi096 ceph-mon[124666]: pgmap v6422: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 215 KiB/s wr, 27 op/s 2023-05-08T07:03:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11933.391108 secs 2023-05-08T07:03:15.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:15 smithi186 ceph-mon[126480]: pgmap v6422: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 215 KiB/s wr, 27 op/s 2023-05-08T07:03:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11933.391108 secs 2023-05-08T07:03:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11934.672940 secs 2023-05-08T07:03:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11934.672940 secs 2023-05-08T07:03:16.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11934.672940 secs 2023-05-08T07:03:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:17 smithi133 ceph-mon[125939]: pgmap v6423: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 98 KiB/s wr, 8 op/s 2023-05-08T07:03:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:17 smithi096 ceph-mon[124666]: pgmap v6423: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 98 KiB/s wr, 8 op/s 2023-05-08T07:03:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:17 smithi186 ceph-mon[126480]: pgmap v6423: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 98 KiB/s wr, 8 op/s 2023-05-08T07:03:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:19 smithi133 ceph-mon[125939]: pgmap v6424: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 98 KiB/s wr, 8 op/s 2023-05-08T07:03:19.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11937.832866 secs 2023-05-08T07:03:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:19 smithi096 ceph-mon[124666]: pgmap v6424: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 98 KiB/s wr, 8 op/s 2023-05-08T07:03:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11937.832866 secs 2023-05-08T07:03:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:19 smithi186 ceph-mon[126480]: pgmap v6424: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 98 KiB/s wr, 8 op/s 2023-05-08T07:03:19.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11937.832866 secs 2023-05-08T07:03:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11938.391225 secs 2023-05-08T07:03:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11938.391225 secs 2023-05-08T07:03:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11938.391225 secs 2023-05-08T07:03:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:21 smithi133 ceph-mon[125939]: pgmap v6425: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 31 KiB/s wr, 8 op/s 2023-05-08T07:03:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11939.673095 secs 2023-05-08T07:03:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:21 smithi133 ceph-mon[125939]: osdmap e479: 12 total, 12 up, 12 in 2023-05-08T07:03:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:21 smithi096 ceph-mon[124666]: pgmap v6425: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 31 KiB/s wr, 8 op/s 2023-05-08T07:03:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11939.673095 secs 2023-05-08T07:03:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:21 smithi096 ceph-mon[124666]: osdmap e479: 12 total, 12 up, 12 in 2023-05-08T07:03:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:21 smithi186 ceph-mon[126480]: pgmap v6425: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 31 KiB/s wr, 8 op/s 2023-05-08T07:03:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11939.673095 secs 2023-05-08T07:03:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:21 smithi186 ceph-mon[126480]: osdmap e479: 12 total, 12 up, 12 in 2023-05-08T07:03:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:23 smithi133 ceph-mon[125939]: pgmap v6427: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 31 KiB/s wr, 8 op/s 2023-05-08T07:03:23.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:23 smithi096 ceph-mon[124666]: pgmap v6427: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 31 KiB/s wr, 8 op/s 2023-05-08T07:03:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:23 smithi186 ceph-mon[126480]: pgmap v6427: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 31 KiB/s wr, 8 op/s 2023-05-08T07:03:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11942.832974 secs 2023-05-08T07:03:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11942.832974 secs 2023-05-08T07:03:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11942.832974 secs 2023-05-08T07:03:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:25 smithi133 ceph-mon[125939]: pgmap v6428: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 31 KiB/s wr, 8 op/s 2023-05-08T07:03:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11943.391336 secs 2023-05-08T07:03:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:25 smithi096 ceph-mon[124666]: pgmap v6428: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 31 KiB/s wr, 8 op/s 2023-05-08T07:03:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11943.391336 secs 2023-05-08T07:03:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:25 smithi186 ceph-mon[126480]: pgmap v6428: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 31 KiB/s wr, 8 op/s 2023-05-08T07:03:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11943.391336 secs 2023-05-08T07:03:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11944.673213 secs 2023-05-08T07:03:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11944.673213 secs 2023-05-08T07:03:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11944.673213 secs 2023-05-08T07:03:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:27 smithi133 ceph-mon[125939]: pgmap v6429: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 61 KiB/s wr, 8 op/s 2023-05-08T07:03:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:27 smithi096 ceph-mon[124666]: pgmap v6429: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 61 KiB/s wr, 8 op/s 2023-05-08T07:03:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:27 smithi186 ceph-mon[126480]: pgmap v6429: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 61 KiB/s wr, 8 op/s 2023-05-08T07:03:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:29 smithi133 ceph-mon[125939]: pgmap v6430: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 61 KiB/s wr, 8 op/s 2023-05-08T07:03:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11947.833104 secs 2023-05-08T07:03:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:29 smithi096 ceph-mon[124666]: pgmap v6430: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 61 KiB/s wr, 8 op/s 2023-05-08T07:03:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11947.833104 secs 2023-05-08T07:03:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:29 smithi186 ceph-mon[126480]: pgmap v6430: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 61 KiB/s wr, 8 op/s 2023-05-08T07:03:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11947.833104 secs 2023-05-08T07:03:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11948.391431 secs 2023-05-08T07:03:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11948.391431 secs 2023-05-08T07:03:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11948.391431 secs 2023-05-08T07:03:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:31 smithi096 ceph-mon[124666]: pgmap v6431: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 75 KiB/s wr, 8 op/s 2023-05-08T07:03:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11949.673351 secs 2023-05-08T07:03:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:31 smithi186 ceph-mon[126480]: pgmap v6431: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 75 KiB/s wr, 8 op/s 2023-05-08T07:03:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11949.673351 secs 2023-05-08T07:03:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:31 smithi133 ceph-mon[125939]: pgmap v6431: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 75 KiB/s wr, 8 op/s 2023-05-08T07:03:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11949.673351 secs 2023-05-08T07:03:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:33 smithi096 ceph-mon[124666]: pgmap v6432: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 70 KiB/s wr, 7 op/s 2023-05-08T07:03:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:33 smithi186 ceph-mon[126480]: pgmap v6432: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 70 KiB/s wr, 7 op/s 2023-05-08T07:03:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:33 smithi133 ceph-mon[125939]: pgmap v6432: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 70 KiB/s wr, 7 op/s 2023-05-08T07:03:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11952.833256 secs 2023-05-08T07:03:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11952.833256 secs 2023-05-08T07:03:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11952.833256 secs 2023-05-08T07:03:35.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:35 smithi186 ceph-mon[126480]: pgmap v6433: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 63 KiB/s wr, 6 op/s 2023-05-08T07:03:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11953.391504 secs 2023-05-08T07:03:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:03:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:35 smithi133 ceph-mon[125939]: pgmap v6433: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 63 KiB/s wr, 6 op/s 2023-05-08T07:03:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11953.391504 secs 2023-05-08T07:03:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:03:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:35 smithi096 ceph-mon[124666]: pgmap v6433: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 63 KiB/s wr, 6 op/s 2023-05-08T07:03:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11953.391504 secs 2023-05-08T07:03:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:03:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11954.673486 secs 2023-05-08T07:03:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:03:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:03:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:03:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11954.673486 secs 2023-05-08T07:03:36.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:03:36.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:03:36.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:03:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11954.673486 secs 2023-05-08T07:03:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:03:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:03:36.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:03:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:37 smithi186 ceph-mon[126480]: pgmap v6434: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 63 KiB/s wr, 9 op/s 2023-05-08T07:03:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:37 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:03:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:37 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T07:03:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:37 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T07:03:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:37 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:03:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:37 smithi133 ceph-mon[125939]: pgmap v6434: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 63 KiB/s wr, 9 op/s 2023-05-08T07:03:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:37 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:03:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:37 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T07:03:37.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:37 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T07:03:37.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:37 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:03:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:37 smithi096 ceph-mon[124666]: pgmap v6434: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 63 KiB/s wr, 9 op/s 2023-05-08T07:03:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:37 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:03:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:37 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T07:03:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:37 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T07:03:37.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:37 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:03:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:39 smithi186 ceph-mon[126480]: pgmap v6435: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T07:03:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11957.833390 secs 2023-05-08T07:03:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:39 smithi133 ceph-mon[125939]: pgmap v6435: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T07:03:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11957.833390 secs 2023-05-08T07:03:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:39 smithi096 ceph-mon[124666]: pgmap v6435: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T07:03:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11957.833390 secs 2023-05-08T07:03:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11958.391619 secs 2023-05-08T07:03:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11958.391619 secs 2023-05-08T07:03:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11958.391619 secs 2023-05-08T07:03:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:41 smithi186 ceph-mon[126480]: pgmap v6436: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 122 KiB/s wr, 10 op/s 2023-05-08T07:03:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11959.673602 secs 2023-05-08T07:03:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:41 smithi133 ceph-mon[125939]: pgmap v6436: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 122 KiB/s wr, 10 op/s 2023-05-08T07:03:41.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11959.673602 secs 2023-05-08T07:03:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:41 smithi096 ceph-mon[124666]: pgmap v6436: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 122 KiB/s wr, 10 op/s 2023-05-08T07:03:41.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11959.673602 secs 2023-05-08T07:03:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:43 smithi186 ceph-mon[126480]: pgmap v6437: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 89 KiB/s wr, 6 op/s 2023-05-08T07:03:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:43 smithi133 ceph-mon[125939]: pgmap v6437: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 89 KiB/s wr, 6 op/s 2023-05-08T07:03:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:43 smithi096 ceph-mon[124666]: pgmap v6437: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 89 KiB/s wr, 6 op/s 2023-05-08T07:03:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11962.833510 secs 2023-05-08T07:03:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11962.833510 secs 2023-05-08T07:03:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11962.833510 secs 2023-05-08T07:03:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:45 smithi186 ceph-mon[126480]: pgmap v6438: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 89 KiB/s wr, 6 op/s 2023-05-08T07:03:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:45 smithi133 ceph-mon[125939]: pgmap v6438: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 89 KiB/s wr, 6 op/s 2023-05-08T07:03:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:45 smithi096 ceph-mon[124666]: pgmap v6438: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 89 KiB/s wr, 6 op/s 2023-05-08T07:03:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:47 smithi186 ceph-mon[126480]: pgmap v6439: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 185 KiB/s wr, 12 op/s 2023-05-08T07:03:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:03:47.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:03:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:47 smithi133 ceph-mon[125939]: pgmap v6439: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 185 KiB/s wr, 12 op/s 2023-05-08T07:03:47.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:03:47.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:03:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:47 smithi096 ceph-mon[124666]: pgmap v6439: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 185 KiB/s wr, 12 op/s 2023-05-08T07:03:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:03:47.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:03:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:48 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:03:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:03:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:03:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:03:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:48 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:03:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:03:48.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:03:48.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:03:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:48 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:03:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:03:48.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:03:48.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:03:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:49 smithi186 ceph-mon[126480]: pgmap v6440: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 184 KiB/s wr, 9 op/s 2023-05-08T07:03:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11967.833611 secs 2023-05-08T07:03:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11968.391825 secs 2023-05-08T07:03:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:49 smithi133 ceph-mon[125939]: pgmap v6440: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 184 KiB/s wr, 9 op/s 2023-05-08T07:03:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11967.833611 secs 2023-05-08T07:03:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11968.391825 secs 2023-05-08T07:03:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:49 smithi096 ceph-mon[124666]: pgmap v6440: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 184 KiB/s wr, 9 op/s 2023-05-08T07:03:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11967.833611 secs 2023-05-08T07:03:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11968.391825 secs 2023-05-08T07:03:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:51 smithi186 ceph-mon[126480]: pgmap v6441: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 295 KiB/s wr, 14 op/s 2023-05-08T07:03:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:51 smithi133 ceph-mon[125939]: pgmap v6441: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 295 KiB/s wr, 14 op/s 2023-05-08T07:03:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:51 smithi096 ceph-mon[124666]: pgmap v6441: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 295 KiB/s wr, 14 op/s 2023-05-08T07:03:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:03:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:03:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:03:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:03:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:03:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:03:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:53 smithi186 ceph-mon[126480]: pgmap v6442: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 207 KiB/s wr, 9 op/s 2023-05-08T07:03:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:53 smithi133 ceph-mon[125939]: pgmap v6442: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 207 KiB/s wr, 9 op/s 2023-05-08T07:03:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:53 smithi096 ceph-mon[124666]: pgmap v6442: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 207 KiB/s wr, 9 op/s 2023-05-08T07:03:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11972.833738 secs 2023-05-08T07:03:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11972.833738 secs 2023-05-08T07:03:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11972.833738 secs 2023-05-08T07:03:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:55 smithi186 ceph-mon[126480]: pgmap v6443: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 207 KiB/s wr, 9 op/s 2023-05-08T07:03:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:55 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:03:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:55 smithi133 ceph-mon[125939]: pgmap v6443: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 207 KiB/s wr, 9 op/s 2023-05-08T07:03:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:55 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:03:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:55 smithi096 ceph-mon[124666]: pgmap v6443: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 207 KiB/s wr, 9 op/s 2023-05-08T07:03:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:55 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:03:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:56 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:03:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:03:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:03:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:56 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:03:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:03:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:03:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:56 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:03:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:03:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:03:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:57 smithi186 ceph-mon[126480]: pgmap v6444: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 219 KiB/s wr, 14 op/s 2023-05-08T07:03:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:57 smithi133 ceph-mon[125939]: pgmap v6444: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 219 KiB/s wr, 14 op/s 2023-05-08T07:03:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:57 smithi096 ceph-mon[124666]: pgmap v6444: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 219 KiB/s wr, 14 op/s 2023-05-08T07:03:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:59 smithi186 ceph-mon[126480]: pgmap v6445: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 123 KiB/s wr, 8 op/s 2023-05-08T07:03:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11977.833859 secs 2023-05-08T07:03:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:03:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11978.392072 secs 2023-05-08T07:03:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:59 smithi133 ceph-mon[125939]: pgmap v6445: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 123 KiB/s wr, 8 op/s 2023-05-08T07:03:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11977.833859 secs 2023-05-08T07:03:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:03:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11978.392072 secs 2023-05-08T07:03:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:59 smithi096 ceph-mon[124666]: pgmap v6445: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 123 KiB/s wr, 8 op/s 2023-05-08T07:03:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11977.833859 secs 2023-05-08T07:03:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:03:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11978.392072 secs 2023-05-08T07:04:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:01 smithi186 ceph-mon[126480]: pgmap v6446: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 230 KiB/s wr, 13 op/s 2023-05-08T07:04:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11979.674016 secs 2023-05-08T07:04:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:01 smithi133 ceph-mon[125939]: pgmap v6446: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 230 KiB/s wr, 13 op/s 2023-05-08T07:04:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11979.674016 secs 2023-05-08T07:04:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:01 smithi096 ceph-mon[124666]: pgmap v6446: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 230 KiB/s wr, 13 op/s 2023-05-08T07:04:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11979.674016 secs 2023-05-08T07:04:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:03 smithi186 ceph-mon[126480]: pgmap v6447: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 119 KiB/s wr, 8 op/s 2023-05-08T07:04:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:03 smithi133 ceph-mon[125939]: pgmap v6447: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 119 KiB/s wr, 8 op/s 2023-05-08T07:04:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:03 smithi096 ceph-mon[124666]: pgmap v6447: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 119 KiB/s wr, 8 op/s 2023-05-08T07:04:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11982.833957 secs 2023-05-08T07:04:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:04 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:04:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:04 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:04:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:04 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:04:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:04 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:04:04.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11983.392191 secs 2023-05-08T07:04:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11982.833957 secs 2023-05-08T07:04:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:04 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:04:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:04 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:04:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:04 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:04:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:04 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:04:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11983.392191 secs 2023-05-08T07:04:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11982.833957 secs 2023-05-08T07:04:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:04 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:04:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:04 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:04:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:04 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:04:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:04 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:04:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11983.392191 secs 2023-05-08T07:04:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:05 smithi186 ceph-mon[126480]: pgmap v6448: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 119 KiB/s wr, 8 op/s 2023-05-08T07:04:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:05 smithi133 ceph-mon[125939]: pgmap v6448: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 119 KiB/s wr, 8 op/s 2023-05-08T07:04:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:05 smithi096 ceph-mon[124666]: pgmap v6448: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 119 KiB/s wr, 8 op/s 2023-05-08T07:04:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11984.674135 secs 2023-05-08T07:04:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11984.674135 secs 2023-05-08T07:04:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11984.674135 secs 2023-05-08T07:04:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:07 smithi133 ceph-mon[125939]: pgmap v6449: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 191 KiB/s wr, 26 op/s 2023-05-08T07:04:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:07 smithi096 ceph-mon[124666]: pgmap v6449: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 191 KiB/s wr, 26 op/s 2023-05-08T07:04:07.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:07 smithi186 ceph-mon[126480]: pgmap v6449: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 191 KiB/s wr, 26 op/s 2023-05-08T07:04:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:09 smithi133 ceph-mon[125939]: pgmap v6450: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 179 KiB/s wr, 22 op/s 2023-05-08T07:04:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11987.834096 secs 2023-05-08T07:04:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11988.392294 secs 2023-05-08T07:04:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:09 smithi096 ceph-mon[124666]: pgmap v6450: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 179 KiB/s wr, 22 op/s 2023-05-08T07:04:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11987.834096 secs 2023-05-08T07:04:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11988.392294 secs 2023-05-08T07:04:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:09 smithi186 ceph-mon[126480]: pgmap v6450: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 179 KiB/s wr, 22 op/s 2023-05-08T07:04:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11987.834096 secs 2023-05-08T07:04:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11988.392294 secs 2023-05-08T07:04:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:11 smithi133 ceph-mon[125939]: pgmap v6451: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 211 KiB/s wr, 26 op/s 2023-05-08T07:04:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11989.674258 secs 2023-05-08T07:04:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:11 smithi133 ceph-mon[125939]: osdmap e480: 12 total, 12 up, 12 in 2023-05-08T07:04:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:11 smithi096 ceph-mon[124666]: pgmap v6451: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 211 KiB/s wr, 26 op/s 2023-05-08T07:04:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11989.674258 secs 2023-05-08T07:04:11.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:11 smithi096 ceph-mon[124666]: osdmap e480: 12 total, 12 up, 12 in 2023-05-08T07:04:11.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:11 smithi186 ceph-mon[126480]: pgmap v6451: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 211 KiB/s wr, 26 op/s 2023-05-08T07:04:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11989.674258 secs 2023-05-08T07:04:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:11 smithi186 ceph-mon[126480]: osdmap e480: 12 total, 12 up, 12 in 2023-05-08T07:04:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:13 smithi133 ceph-mon[125939]: pgmap v6453: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 125 KiB/s wr, 26 op/s 2023-05-08T07:04:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:13 smithi096 ceph-mon[124666]: pgmap v6453: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 125 KiB/s wr, 26 op/s 2023-05-08T07:04:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:13 smithi186 ceph-mon[126480]: pgmap v6453: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 125 KiB/s wr, 26 op/s 2023-05-08T07:04:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11992.834218 secs 2023-05-08T07:04:14.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11993.392415 secs 2023-05-08T07:04:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11992.834218 secs 2023-05-08T07:04:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11993.392415 secs 2023-05-08T07:04:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11992.834218 secs 2023-05-08T07:04:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11993.392415 secs 2023-05-08T07:04:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:15 smithi133 ceph-mon[125939]: pgmap v6454: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 125 KiB/s wr, 26 op/s 2023-05-08T07:04:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:15 smithi096 ceph-mon[124666]: pgmap v6454: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 125 KiB/s wr, 26 op/s 2023-05-08T07:04:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:15 smithi186 ceph-mon[126480]: pgmap v6454: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 125 KiB/s wr, 26 op/s 2023-05-08T07:04:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11994.674406 secs 2023-05-08T07:04:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11994.674406 secs 2023-05-08T07:04:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11994.674406 secs 2023-05-08T07:04:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:17 smithi133 ceph-mon[125939]: pgmap v6455: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 45 KiB/s wr, 9 op/s 2023-05-08T07:04:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:17 smithi096 ceph-mon[124666]: pgmap v6455: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 45 KiB/s wr, 9 op/s 2023-05-08T07:04:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:17 smithi186 ceph-mon[126480]: pgmap v6455: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 45 KiB/s wr, 9 op/s 2023-05-08T07:04:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:19 smithi133 ceph-mon[125939]: pgmap v6456: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 45 KiB/s wr, 9 op/s 2023-05-08T07:04:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11997.834381 secs 2023-05-08T07:04:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11998.392542 secs 2023-05-08T07:04:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:19 smithi096 ceph-mon[124666]: pgmap v6456: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 45 KiB/s wr, 9 op/s 2023-05-08T07:04:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11997.834381 secs 2023-05-08T07:04:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11998.392542 secs 2023-05-08T07:04:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:19 smithi186 ceph-mon[126480]: pgmap v6456: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 45 KiB/s wr, 9 op/s 2023-05-08T07:04:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11997.834381 secs 2023-05-08T07:04:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11998.392542 secs 2023-05-08T07:04:21.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:21 smithi133 ceph-mon[125939]: pgmap v6457: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 125 KiB/s wr, 9 op/s 2023-05-08T07:04:21.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 11999.674530 secs 2023-05-08T07:04:21.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:21 smithi133 ceph-mon[125939]: osdmap e481: 12 total, 12 up, 12 in 2023-05-08T07:04:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:21 smithi096 ceph-mon[124666]: pgmap v6457: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 125 KiB/s wr, 9 op/s 2023-05-08T07:04:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 11999.674530 secs 2023-05-08T07:04:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:21 smithi096 ceph-mon[124666]: osdmap e481: 12 total, 12 up, 12 in 2023-05-08T07:04:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:21 smithi186 ceph-mon[126480]: pgmap v6457: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 125 KiB/s wr, 9 op/s 2023-05-08T07:04:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 11999.674530 secs 2023-05-08T07:04:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:21 smithi186 ceph-mon[126480]: osdmap e481: 12 total, 12 up, 12 in 2023-05-08T07:04:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:23 smithi133 ceph-mon[125939]: pgmap v6459: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 125 KiB/s wr, 9 op/s 2023-05-08T07:04:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:23 smithi096 ceph-mon[124666]: pgmap v6459: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 125 KiB/s wr, 9 op/s 2023-05-08T07:04:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:23 smithi186 ceph-mon[126480]: pgmap v6459: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 125 KiB/s wr, 9 op/s 2023-05-08T07:04:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12002.834526 secs 2023-05-08T07:04:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12003.392635 secs 2023-05-08T07:04:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12002.834526 secs 2023-05-08T07:04:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12003.392635 secs 2023-05-08T07:04:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12002.834526 secs 2023-05-08T07:04:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12003.392635 secs 2023-05-08T07:04:25.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:25 smithi133 ceph-mon[125939]: pgmap v6460: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 125 KiB/s wr, 9 op/s 2023-05-08T07:04:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:25 smithi096 ceph-mon[124666]: pgmap v6460: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 125 KiB/s wr, 9 op/s 2023-05-08T07:04:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:25 smithi186 ceph-mon[126480]: pgmap v6460: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 125 KiB/s wr, 9 op/s 2023-05-08T07:04:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12004.674657 secs 2023-05-08T07:04:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12004.674657 secs 2023-05-08T07:04:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12004.674657 secs 2023-05-08T07:04:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:27 smithi133 ceph-mon[125939]: pgmap v6461: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 119 KiB/s wr, 9 op/s 2023-05-08T07:04:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:27 smithi096 ceph-mon[124666]: pgmap v6461: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 119 KiB/s wr, 9 op/s 2023-05-08T07:04:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:27 smithi186 ceph-mon[126480]: pgmap v6461: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 119 KiB/s wr, 9 op/s 2023-05-08T07:04:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:29 smithi133 ceph-mon[125939]: pgmap v6462: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 119 KiB/s wr, 9 op/s 2023-05-08T07:04:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12007.834612 secs 2023-05-08T07:04:29.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12008.392750 secs 2023-05-08T07:04:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:29 smithi096 ceph-mon[124666]: pgmap v6462: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 119 KiB/s wr, 9 op/s 2023-05-08T07:04:29.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12007.834612 secs 2023-05-08T07:04:29.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12008.392750 secs 2023-05-08T07:04:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:29 smithi186 ceph-mon[126480]: pgmap v6462: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 119 KiB/s wr, 9 op/s 2023-05-08T07:04:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12007.834612 secs 2023-05-08T07:04:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12008.392750 secs 2023-05-08T07:04:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:31 smithi133 ceph-mon[125939]: pgmap v6463: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 57 KiB/s wr, 8 op/s 2023-05-08T07:04:31.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12009.674798 secs 2023-05-08T07:04:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:31 smithi096 ceph-mon[124666]: pgmap v6463: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 57 KiB/s wr, 8 op/s 2023-05-08T07:04:31.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12009.674798 secs 2023-05-08T07:04:31.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:31 smithi186 ceph-mon[126480]: pgmap v6463: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 57 KiB/s wr, 8 op/s 2023-05-08T07:04:31.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12009.674798 secs 2023-05-08T07:04:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:33 smithi133 ceph-mon[125939]: pgmap v6464: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 53 KiB/s wr, 7 op/s 2023-05-08T07:04:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:33 smithi096 ceph-mon[124666]: pgmap v6464: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 53 KiB/s wr, 7 op/s 2023-05-08T07:04:33.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:33 smithi186 ceph-mon[126480]: pgmap v6464: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 53 KiB/s wr, 7 op/s 2023-05-08T07:04:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12012.834732 secs 2023-05-08T07:04:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12013.392884 secs 2023-05-08T07:04:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12012.834732 secs 2023-05-08T07:04:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12013.392884 secs 2023-05-08T07:04:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12012.834732 secs 2023-05-08T07:04:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12013.392884 secs 2023-05-08T07:04:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:35 smithi133 ceph-mon[125939]: pgmap v6465: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 48 KiB/s wr, 7 op/s 2023-05-08T07:04:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:35 smithi096 ceph-mon[124666]: pgmap v6465: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 48 KiB/s wr, 7 op/s 2023-05-08T07:04:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:35 smithi186 ceph-mon[126480]: pgmap v6465: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 48 KiB/s wr, 7 op/s 2023-05-08T07:04:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12014.674917 secs 2023-05-08T07:04:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:04:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12014.674917 secs 2023-05-08T07:04:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:04:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12014.674917 secs 2023-05-08T07:04:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:04:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:37 smithi133 ceph-mon[125939]: pgmap v6466: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 48 KiB/s wr, 9 op/s 2023-05-08T07:04:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:37 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:04:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:37 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:04:37.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:37 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:04:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:37 smithi096 ceph-mon[124666]: pgmap v6466: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 48 KiB/s wr, 9 op/s 2023-05-08T07:04:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:37 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:04:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:37 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:04:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:37 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:04:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:37 smithi186 ceph-mon[126480]: pgmap v6466: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 48 KiB/s wr, 9 op/s 2023-05-08T07:04:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:37 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:04:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:37 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:04:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:37 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:04:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:38 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:04:38.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:38 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T07:04:38.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:38 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T07:04:38.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:38 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:04:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:38 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:04:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:38 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T07:04:38.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:38 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T07:04:38.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:38 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:04:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:38 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:04:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:38 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T07:04:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:38 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T07:04:38.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:38 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:04:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:39 smithi133 ceph-mon[125939]: pgmap v6467: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 47 KiB/s wr, 6 op/s 2023-05-08T07:04:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12017.834857 secs 2023-05-08T07:04:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12018.393007 secs 2023-05-08T07:04:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:39 smithi096 ceph-mon[124666]: pgmap v6467: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 47 KiB/s wr, 6 op/s 2023-05-08T07:04:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12017.834857 secs 2023-05-08T07:04:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12018.393007 secs 2023-05-08T07:04:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:39 smithi186 ceph-mon[126480]: pgmap v6467: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 47 KiB/s wr, 6 op/s 2023-05-08T07:04:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12017.834857 secs 2023-05-08T07:04:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12018.393007 secs 2023-05-08T07:04:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:41 smithi133 ceph-mon[125939]: pgmap v6468: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 78 KiB/s wr, 9 op/s 2023-05-08T07:04:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12019.674980 secs 2023-05-08T07:04:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:41 smithi096 ceph-mon[124666]: pgmap v6468: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 78 KiB/s wr, 9 op/s 2023-05-08T07:04:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12019.674980 secs 2023-05-08T07:04:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:41 smithi186 ceph-mon[126480]: pgmap v6468: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 78 KiB/s wr, 9 op/s 2023-05-08T07:04:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12019.674980 secs 2023-05-08T07:04:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:43 smithi133 ceph-mon[125939]: pgmap v6469: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 5 op/s 2023-05-08T07:04:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:43 smithi096 ceph-mon[124666]: pgmap v6469: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 5 op/s 2023-05-08T07:04:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:43 smithi186 ceph-mon[126480]: pgmap v6469: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 5 op/s 2023-05-08T07:04:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12022.834956 secs 2023-05-08T07:04:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12022.834956 secs 2023-05-08T07:04:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12022.834956 secs 2023-05-08T07:04:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:45 smithi133 ceph-mon[125939]: pgmap v6470: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 5 op/s 2023-05-08T07:04:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:45 smithi096 ceph-mon[124666]: pgmap v6470: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 5 op/s 2023-05-08T07:04:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:45 smithi186 ceph-mon[126480]: pgmap v6470: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 5 op/s 2023-05-08T07:04:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12024.675044 secs 2023-05-08T07:04:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12024.675044 secs 2023-05-08T07:04:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12024.675044 secs 2023-05-08T07:04:47.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:47 smithi133 ceph-mon[125939]: pgmap v6471: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 67 KiB/s wr, 9 op/s 2023-05-08T07:04:47.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:04:47.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:47 smithi096 ceph-mon[124666]: pgmap v6471: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 67 KiB/s wr, 9 op/s 2023-05-08T07:04:47.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:04:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:47 smithi186 ceph-mon[126480]: pgmap v6471: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 67 KiB/s wr, 9 op/s 2023-05-08T07:04:47.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:04:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:48 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:04:48.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:04:48.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:04:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:48 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:04:48.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:04:48.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:04:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:48 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:04:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:04:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:04:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:49 smithi096 ceph-mon[124666]: pgmap v6472: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 67 KiB/s wr, 7 op/s 2023-05-08T07:04:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12027.835089 secs 2023-05-08T07:04:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:49 smithi186 ceph-mon[126480]: pgmap v6472: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 67 KiB/s wr, 7 op/s 2023-05-08T07:04:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12027.835089 secs 2023-05-08T07:04:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:49 smithi133 ceph-mon[125939]: pgmap v6472: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 67 KiB/s wr, 7 op/s 2023-05-08T07:04:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12027.835089 secs 2023-05-08T07:04:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:50 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:04:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:50 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:04:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:50 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:04:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:51 smithi096 ceph-mon[124666]: pgmap v6473: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 152 KiB/s wr, 12 op/s 2023-05-08T07:04:51.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:04:51.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:04:51.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:51 smithi186 ceph-mon[126480]: pgmap v6473: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 152 KiB/s wr, 12 op/s 2023-05-08T07:04:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:04:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:04:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:51 smithi133 ceph-mon[125939]: pgmap v6473: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 152 KiB/s wr, 12 op/s 2023-05-08T07:04:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:04:51.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:04:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:52 smithi186 ceph-mon[126480]: pgmap v6474: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 121 KiB/s wr, 8 op/s 2023-05-08T07:04:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:52 smithi133 ceph-mon[125939]: pgmap v6474: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 121 KiB/s wr, 8 op/s 2023-05-08T07:04:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:52 smithi096 ceph-mon[124666]: pgmap v6474: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 121 KiB/s wr, 8 op/s 2023-05-08T07:04:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12032.835207 secs 2023-05-08T07:04:54.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:54 smithi133 ceph-mon[125939]: pgmap v6475: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 121 KiB/s wr, 8 op/s 2023-05-08T07:04:54.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12033.393320 secs 2023-05-08T07:04:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12032.835207 secs 2023-05-08T07:04:55.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:54 smithi096 ceph-mon[124666]: pgmap v6475: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 121 KiB/s wr, 8 op/s 2023-05-08T07:04:55.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12033.393320 secs 2023-05-08T07:04:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12032.835207 secs 2023-05-08T07:04:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:54 smithi186 ceph-mon[126480]: pgmap v6475: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 121 KiB/s wr, 8 op/s 2023-05-08T07:04:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12033.393320 secs 2023-05-08T07:04:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:55 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:04:55.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:55 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:04:55.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:55 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:04:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:55 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:04:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:55 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:04:56.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:55 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:04:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:55 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:04:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:55 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:04:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:55 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:04:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:56 smithi186 ceph-mon[126480]: pgmap v6476: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 167 KiB/s wr, 13 op/s 2023-05-08T07:04:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:56 smithi133 ceph-mon[125939]: pgmap v6476: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 167 KiB/s wr, 13 op/s 2023-05-08T07:04:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:56 smithi096 ceph-mon[124666]: pgmap v6476: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 167 KiB/s wr, 13 op/s 2023-05-08T07:04:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:58 smithi186 ceph-mon[126480]: pgmap v6477: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 131 KiB/s wr, 9 op/s 2023-05-08T07:04:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:04:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12037.835358 secs 2023-05-08T07:04:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:58 smithi133 ceph-mon[125939]: pgmap v6477: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 131 KiB/s wr, 9 op/s 2023-05-08T07:04:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:04:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12037.835358 secs 2023-05-08T07:04:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:58 smithi096 ceph-mon[124666]: pgmap v6477: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 131 KiB/s wr, 9 op/s 2023-05-08T07:04:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:04:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12037.835358 secs 2023-05-08T07:05:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:00 smithi186 ceph-mon[126480]: pgmap v6478: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 261 KiB/s wr, 15 op/s 2023-05-08T07:05:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12039.675386 secs 2023-05-08T07:05:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:00 smithi133 ceph-mon[125939]: pgmap v6478: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 261 KiB/s wr, 15 op/s 2023-05-08T07:05:01.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12039.675386 secs 2023-05-08T07:05:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:00 smithi096 ceph-mon[124666]: pgmap v6478: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 261 KiB/s wr, 15 op/s 2023-05-08T07:05:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12039.675386 secs 2023-05-08T07:05:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:02 smithi186 ceph-mon[126480]: pgmap v6479: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 176 KiB/s wr, 10 op/s 2023-05-08T07:05:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:02 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:05:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:02 smithi133 ceph-mon[125939]: pgmap v6479: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 176 KiB/s wr, 10 op/s 2023-05-08T07:05:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:02 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:05:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:02 smithi096 ceph-mon[124666]: pgmap v6479: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 176 KiB/s wr, 10 op/s 2023-05-08T07:05:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:02 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:05:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:05:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:05:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:03 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:05:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12042.835452 secs 2023-05-08T07:05:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:05:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:05:04.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:03 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:05:04.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12042.835452 secs 2023-05-08T07:05:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:05:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:05:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:03 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:05:04.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12042.835452 secs 2023-05-08T07:05:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:04 smithi186 ceph-mon[126480]: pgmap v6480: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 176 KiB/s wr, 10 op/s 2023-05-08T07:05:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12043.393557 secs 2023-05-08T07:05:05.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:04 smithi133 ceph-mon[125939]: pgmap v6480: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 176 KiB/s wr, 10 op/s 2023-05-08T07:05:05.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12043.393557 secs 2023-05-08T07:05:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:04 smithi096 ceph-mon[124666]: pgmap v6480: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 176 KiB/s wr, 10 op/s 2023-05-08T07:05:05.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12043.393557 secs 2023-05-08T07:05:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12044.675486 secs 2023-05-08T07:05:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12044.675486 secs 2023-05-08T07:05:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12044.675486 secs 2023-05-08T07:05:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:06 smithi186 ceph-mon[126480]: pgmap v6481: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 248 KiB/s wr, 28 op/s 2023-05-08T07:05:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:06 smithi133 ceph-mon[125939]: pgmap v6481: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 248 KiB/s wr, 28 op/s 2023-05-08T07:05:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:06 smithi096 ceph-mon[124666]: pgmap v6481: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 248 KiB/s wr, 28 op/s 2023-05-08T07:05:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:07 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:05:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:07 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:05:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:07 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:05:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:07 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:05:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:07 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:05:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:07 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:05:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:07 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:05:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:07 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:05:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:07 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:05:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:08 smithi186 ceph-mon[126480]: pgmap v6482: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 203 KiB/s wr, 23 op/s 2023-05-08T07:05:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12047.835555 secs 2023-05-08T07:05:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:08 smithi133 ceph-mon[125939]: pgmap v6482: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 203 KiB/s wr, 23 op/s 2023-05-08T07:05:09.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12047.835555 secs 2023-05-08T07:05:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:08 smithi096 ceph-mon[124666]: pgmap v6482: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 203 KiB/s wr, 23 op/s 2023-05-08T07:05:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12047.835555 secs 2023-05-08T07:05:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12048.393664 secs 2023-05-08T07:05:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12048.393664 secs 2023-05-08T07:05:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12048.393664 secs 2023-05-08T07:05:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:10 smithi186 ceph-mon[126480]: pgmap v6483: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 229 KiB/s wr, 27 op/s 2023-05-08T07:05:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12049.675612 secs 2023-05-08T07:05:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:10 smithi133 ceph-mon[125939]: pgmap v6483: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 229 KiB/s wr, 27 op/s 2023-05-08T07:05:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12049.675612 secs 2023-05-08T07:05:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:10 smithi096 ceph-mon[124666]: pgmap v6483: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 229 KiB/s wr, 27 op/s 2023-05-08T07:05:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12049.675612 secs 2023-05-08T07:05:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:11 smithi186 ceph-mon[126480]: osdmap e482: 12 total, 12 up, 12 in 2023-05-08T07:05:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:11 smithi133 ceph-mon[125939]: osdmap e482: 12 total, 12 up, 12 in 2023-05-08T07:05:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:11 smithi096 ceph-mon[124666]: osdmap e482: 12 total, 12 up, 12 in 2023-05-08T07:05:13.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:12 smithi186 ceph-mon[126480]: pgmap v6485: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 118 KiB/s wr, 26 op/s 2023-05-08T07:05:13.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:12 smithi133 ceph-mon[125939]: pgmap v6485: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 118 KiB/s wr, 26 op/s 2023-05-08T07:05:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:12 smithi096 ceph-mon[124666]: pgmap v6485: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 118 KiB/s wr, 26 op/s 2023-05-08T07:05:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12052.835659 secs 2023-05-08T07:05:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12052.835659 secs 2023-05-08T07:05:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12052.835659 secs 2023-05-08T07:05:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:14 smithi186 ceph-mon[126480]: pgmap v6486: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 118 KiB/s wr, 26 op/s 2023-05-08T07:05:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12053.393802 secs 2023-05-08T07:05:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:14 smithi133 ceph-mon[125939]: pgmap v6486: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 118 KiB/s wr, 26 op/s 2023-05-08T07:05:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12053.393802 secs 2023-05-08T07:05:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:14 smithi096 ceph-mon[124666]: pgmap v6486: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 118 KiB/s wr, 26 op/s 2023-05-08T07:05:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12053.393802 secs 2023-05-08T07:05:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12054.675744 secs 2023-05-08T07:05:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12054.675744 secs 2023-05-08T07:05:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12054.675744 secs 2023-05-08T07:05:17.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:16 smithi186 ceph-mon[126480]: pgmap v6487: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 8 op/s 2023-05-08T07:05:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:16 smithi133 ceph-mon[125939]: pgmap v6487: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 8 op/s 2023-05-08T07:05:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:16 smithi096 ceph-mon[124666]: pgmap v6487: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 8 op/s 2023-05-08T07:05:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:18 smithi133 ceph-mon[125939]: pgmap v6488: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 8 op/s 2023-05-08T07:05:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12057.835738 secs 2023-05-08T07:05:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:18 smithi096 ceph-mon[124666]: pgmap v6488: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 8 op/s 2023-05-08T07:05:19.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12057.835738 secs 2023-05-08T07:05:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:18 smithi186 ceph-mon[126480]: pgmap v6488: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 8 op/s 2023-05-08T07:05:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12057.835738 secs 2023-05-08T07:05:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12058.393921 secs 2023-05-08T07:05:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12058.393921 secs 2023-05-08T07:05:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12058.393921 secs 2023-05-08T07:05:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:20 smithi133 ceph-mon[125939]: pgmap v6489: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 6.8 KiB/s wr, 8 op/s 2023-05-08T07:05:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12059.675843 secs 2023-05-08T07:05:21.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:20 smithi133 ceph-mon[125939]: osdmap e483: 12 total, 12 up, 12 in 2023-05-08T07:05:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:20 smithi096 ceph-mon[124666]: pgmap v6489: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 6.8 KiB/s wr, 8 op/s 2023-05-08T07:05:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12059.675843 secs 2023-05-08T07:05:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:20 smithi096 ceph-mon[124666]: osdmap e483: 12 total, 12 up, 12 in 2023-05-08T07:05:21.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:20 smithi186 ceph-mon[126480]: pgmap v6489: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 6.8 KiB/s wr, 8 op/s 2023-05-08T07:05:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12059.675843 secs 2023-05-08T07:05:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:20 smithi186 ceph-mon[126480]: osdmap e483: 12 total, 12 up, 12 in 2023-05-08T07:05:23.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:22 smithi133 ceph-mon[125939]: pgmap v6491: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 6.7 KiB/s wr, 8 op/s 2023-05-08T07:05:23.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:22 smithi096 ceph-mon[124666]: pgmap v6491: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 6.7 KiB/s wr, 8 op/s 2023-05-08T07:05:23.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:22 smithi186 ceph-mon[126480]: pgmap v6491: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 6.7 KiB/s wr, 8 op/s 2023-05-08T07:05:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12062.835868 secs 2023-05-08T07:05:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12062.835868 secs 2023-05-08T07:05:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12062.835868 secs 2023-05-08T07:05:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:24 smithi133 ceph-mon[125939]: pgmap v6492: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 6.7 KiB/s wr, 8 op/s 2023-05-08T07:05:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12063.394041 secs 2023-05-08T07:05:25.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:24 smithi096 ceph-mon[124666]: pgmap v6492: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 6.7 KiB/s wr, 8 op/s 2023-05-08T07:05:25.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12063.394041 secs 2023-05-08T07:05:25.376 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:24 smithi186 ceph-mon[126480]: pgmap v6492: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 6.7 KiB/s wr, 8 op/s 2023-05-08T07:05:25.377 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12063.394041 secs 2023-05-08T07:05:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12064.675948 secs 2023-05-08T07:05:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12064.675948 secs 2023-05-08T07:05:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12064.675948 secs 2023-05-08T07:05:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:26 smithi133 ceph-mon[125939]: pgmap v6493: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 37 KiB/s wr, 8 op/s 2023-05-08T07:05:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:26 smithi096 ceph-mon[124666]: pgmap v6493: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 37 KiB/s wr, 8 op/s 2023-05-08T07:05:27.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:26 smithi186 ceph-mon[126480]: pgmap v6493: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 37 KiB/s wr, 8 op/s 2023-05-08T07:05:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:28 smithi133 ceph-mon[125939]: pgmap v6494: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 37 KiB/s wr, 8 op/s 2023-05-08T07:05:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12067.835967 secs 2023-05-08T07:05:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:28 smithi096 ceph-mon[124666]: pgmap v6494: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 37 KiB/s wr, 8 op/s 2023-05-08T07:05:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12067.835967 secs 2023-05-08T07:05:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:28 smithi186 ceph-mon[126480]: pgmap v6494: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 37 KiB/s wr, 8 op/s 2023-05-08T07:05:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12067.835967 secs 2023-05-08T07:05:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12068.394158 secs 2023-05-08T07:05:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12068.394158 secs 2023-05-08T07:05:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12068.394158 secs 2023-05-08T07:05:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:30 smithi133 ceph-mon[125939]: pgmap v6495: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 74 KiB/s wr, 8 op/s 2023-05-08T07:05:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12069.676091 secs 2023-05-08T07:05:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:30 smithi096 ceph-mon[124666]: pgmap v6495: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 74 KiB/s wr, 8 op/s 2023-05-08T07:05:31.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12069.676091 secs 2023-05-08T07:05:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:30 smithi186 ceph-mon[126480]: pgmap v6495: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 74 KiB/s wr, 8 op/s 2023-05-08T07:05:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12069.676091 secs 2023-05-08T07:05:33.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:32 smithi133 ceph-mon[125939]: pgmap v6496: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 68 KiB/s wr, 7 op/s 2023-05-08T07:05:33.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:32 smithi096 ceph-mon[124666]: pgmap v6496: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 68 KiB/s wr, 7 op/s 2023-05-08T07:05:33.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:32 smithi186 ceph-mon[126480]: pgmap v6496: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 68 KiB/s wr, 7 op/s 2023-05-08T07:05:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12072.836099 secs 2023-05-08T07:05:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12072.836099 secs 2023-05-08T07:05:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12072.836099 secs 2023-05-08T07:05:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:34 smithi133 ceph-mon[125939]: pgmap v6497: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 61 KiB/s wr, 7 op/s 2023-05-08T07:05:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12073.394295 secs 2023-05-08T07:05:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:34 smithi096 ceph-mon[124666]: pgmap v6497: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 61 KiB/s wr, 7 op/s 2023-05-08T07:05:35.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12073.394295 secs 2023-05-08T07:05:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:34 smithi186 ceph-mon[126480]: pgmap v6497: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 61 KiB/s wr, 7 op/s 2023-05-08T07:05:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12073.394295 secs 2023-05-08T07:05:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12074.676230 secs 2023-05-08T07:05:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12074.676230 secs 2023-05-08T07:05:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12074.676230 secs 2023-05-08T07:05:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:36 smithi133 ceph-mon[125939]: pgmap v6498: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 91 KiB/s wr, 9 op/s 2023-05-08T07:05:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:05:37.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:36 smithi096 ceph-mon[124666]: pgmap v6498: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 91 KiB/s wr, 9 op/s 2023-05-08T07:05:37.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:05:37.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:36 smithi186 ceph-mon[126480]: pgmap v6498: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 91 KiB/s wr, 9 op/s 2023-05-08T07:05:37.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:05:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:37 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:05:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:37 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:05:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:37 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:05:38.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:37 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:05:38.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:37 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T07:05:38.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:37 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T07:05:38.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:37 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:05:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:37 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:05:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:37 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:05:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:37 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:05:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:37 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:05:38.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:37 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T07:05:38.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:37 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T07:05:38.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:37 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:05:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:37 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:05:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:37 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:05:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:37 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:05:38.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:37 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:05:38.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:37 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T07:05:38.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:37 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T07:05:38.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:37 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:05:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:39 smithi133 ceph-mon[125939]: pgmap v6499: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 61 KiB/s wr, 6 op/s 2023-05-08T07:05:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12077.836244 secs 2023-05-08T07:05:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12078.394433 secs 2023-05-08T07:05:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:39 smithi096 ceph-mon[124666]: pgmap v6499: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 61 KiB/s wr, 6 op/s 2023-05-08T07:05:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12077.836244 secs 2023-05-08T07:05:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12078.394433 secs 2023-05-08T07:05:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:39 smithi186 ceph-mon[126480]: pgmap v6499: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 61 KiB/s wr, 6 op/s 2023-05-08T07:05:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12077.836244 secs 2023-05-08T07:05:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12078.394433 secs 2023-05-08T07:05:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:41 smithi133 ceph-mon[125939]: pgmap v6500: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 92 KiB/s wr, 10 op/s 2023-05-08T07:05:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12079.676351 secs 2023-05-08T07:05:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:41 smithi096 ceph-mon[124666]: pgmap v6500: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 92 KiB/s wr, 10 op/s 2023-05-08T07:05:41.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12079.676351 secs 2023-05-08T07:05:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:41 smithi186 ceph-mon[126480]: pgmap v6500: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 92 KiB/s wr, 10 op/s 2023-05-08T07:05:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12079.676351 secs 2023-05-08T07:05:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:43 smithi133 ceph-mon[125939]: pgmap v6501: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 61 KiB/s wr, 6 op/s 2023-05-08T07:05:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:43 smithi096 ceph-mon[124666]: pgmap v6501: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 61 KiB/s wr, 6 op/s 2023-05-08T07:05:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:43 smithi186 ceph-mon[126480]: pgmap v6501: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 61 KiB/s wr, 6 op/s 2023-05-08T07:05:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12082.836373 secs 2023-05-08T07:05:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12082.836373 secs 2023-05-08T07:05:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12082.836373 secs 2023-05-08T07:05:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:45 smithi133 ceph-mon[125939]: pgmap v6502: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 61 KiB/s wr, 6 op/s 2023-05-08T07:05:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:45 smithi096 ceph-mon[124666]: pgmap v6502: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 61 KiB/s wr, 6 op/s 2023-05-08T07:05:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:45 smithi186 ceph-mon[126480]: pgmap v6502: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 61 KiB/s wr, 6 op/s 2023-05-08T07:05:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12084.676475 secs 2023-05-08T07:05:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12084.676475 secs 2023-05-08T07:05:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12084.676475 secs 2023-05-08T07:05:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:47 smithi133 ceph-mon[125939]: pgmap v6503: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 162 KiB/s wr, 10 op/s 2023-05-08T07:05:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:05:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:47 smithi096 ceph-mon[124666]: pgmap v6503: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 162 KiB/s wr, 10 op/s 2023-05-08T07:05:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:05:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:47 smithi186 ceph-mon[126480]: pgmap v6503: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 162 KiB/s wr, 10 op/s 2023-05-08T07:05:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:05:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:48 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:05:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:05:48.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:05:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:48 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:05:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:05:48.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:05:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:48 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:05:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:05:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:05:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:49 smithi133 ceph-mon[125939]: pgmap v6504: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 132 KiB/s wr, 7 op/s 2023-05-08T07:05:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12087.836485 secs 2023-05-08T07:05:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:49 smithi096 ceph-mon[124666]: pgmap v6504: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 132 KiB/s wr, 7 op/s 2023-05-08T07:05:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12087.836485 secs 2023-05-08T07:05:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:49 smithi186 ceph-mon[126480]: pgmap v6504: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 132 KiB/s wr, 7 op/s 2023-05-08T07:05:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12087.836485 secs 2023-05-08T07:05:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:51 smithi133 ceph-mon[125939]: pgmap v6505: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 255 KiB/s rd, 242 KiB/s wr, 12 op/s 2023-05-08T07:05:51.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:05:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:51 smithi096 ceph-mon[124666]: pgmap v6505: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 255 KiB/s rd, 242 KiB/s wr, 12 op/s 2023-05-08T07:05:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:05:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:51 smithi186 ceph-mon[126480]: pgmap v6505: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 255 KiB/s rd, 242 KiB/s wr, 12 op/s 2023-05-08T07:05:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:05:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:05:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:05:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:05:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:05:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:05:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:05:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:53 smithi133 ceph-mon[125939]: pgmap v6506: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 211 KiB/s wr, 9 op/s 2023-05-08T07:05:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:53 smithi096 ceph-mon[124666]: pgmap v6506: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 211 KiB/s wr, 9 op/s 2023-05-08T07:05:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:53 smithi186 ceph-mon[126480]: pgmap v6506: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 211 KiB/s wr, 9 op/s 2023-05-08T07:05:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12092.836615 secs 2023-05-08T07:05:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12093.394751 secs 2023-05-08T07:05:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12092.836615 secs 2023-05-08T07:05:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12093.394751 secs 2023-05-08T07:05:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12092.836615 secs 2023-05-08T07:05:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12093.394751 secs 2023-05-08T07:05:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:55 smithi133 ceph-mon[125939]: pgmap v6507: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 211 KiB/s wr, 9 op/s 2023-05-08T07:05:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:55 smithi096 ceph-mon[124666]: pgmap v6507: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 211 KiB/s wr, 9 op/s 2023-05-08T07:05:55.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:55 smithi186 ceph-mon[126480]: pgmap v6507: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 211 KiB/s wr, 9 op/s 2023-05-08T07:05:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:56 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:05:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:05:56.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:05:56.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:56 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:05:56.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:05:56.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:05:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:56 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:05:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:05:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:05:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:57 smithi133 ceph-mon[125939]: pgmap v6508: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 223 KiB/s wr, 13 op/s 2023-05-08T07:05:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:57 smithi096 ceph-mon[124666]: pgmap v6508: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 223 KiB/s wr, 13 op/s 2023-05-08T07:05:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:57 smithi186 ceph-mon[126480]: pgmap v6508: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 223 KiB/s wr, 13 op/s 2023-05-08T07:05:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:59 smithi133 ceph-mon[125939]: pgmap v6509: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 122 KiB/s wr, 9 op/s 2023-05-08T07:05:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12097.836740 secs 2023-05-08T07:05:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:05:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12098.394873 secs 2023-05-08T07:05:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:59 smithi096 ceph-mon[124666]: pgmap v6509: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 122 KiB/s wr, 9 op/s 2023-05-08T07:05:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12097.836740 secs 2023-05-08T07:05:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:05:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12098.394873 secs 2023-05-08T07:05:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:59 smithi186 ceph-mon[126480]: pgmap v6509: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 122 KiB/s wr, 9 op/s 2023-05-08T07:05:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12097.836740 secs 2023-05-08T07:05:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:05:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12098.394873 secs 2023-05-08T07:06:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:01 smithi133 ceph-mon[125939]: pgmap v6510: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 248 KiB/s wr, 13 op/s 2023-05-08T07:06:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:01 smithi096 ceph-mon[124666]: pgmap v6510: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 248 KiB/s wr, 13 op/s 2023-05-08T07:06:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:01 smithi186 ceph-mon[126480]: pgmap v6510: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 248 KiB/s wr, 13 op/s 2023-05-08T07:06:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:03 smithi133 ceph-mon[125939]: pgmap v6511: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 139 KiB/s wr, 8 op/s 2023-05-08T07:06:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:03 smithi096 ceph-mon[124666]: pgmap v6511: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 139 KiB/s wr, 8 op/s 2023-05-08T07:06:03.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:03 smithi186 ceph-mon[126480]: pgmap v6511: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 139 KiB/s wr, 8 op/s 2023-05-08T07:06:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12102.836867 secs 2023-05-08T07:06:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12103.394989 secs 2023-05-08T07:06:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12102.836867 secs 2023-05-08T07:06:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12103.394989 secs 2023-05-08T07:06:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12102.836867 secs 2023-05-08T07:06:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12103.394989 secs 2023-05-08T07:06:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:05 smithi133 ceph-mon[125939]: pgmap v6512: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 139 KiB/s wr, 8 op/s 2023-05-08T07:06:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:05 smithi096 ceph-mon[124666]: pgmap v6512: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 139 KiB/s wr, 8 op/s 2023-05-08T07:06:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:05 smithi186 ceph-mon[126480]: pgmap v6512: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 139 KiB/s wr, 8 op/s 2023-05-08T07:06:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12104.676989 secs 2023-05-08T07:06:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12104.676989 secs 2023-05-08T07:06:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12104.676989 secs 2023-05-08T07:06:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:07 smithi133 ceph-mon[125939]: pgmap v6513: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 197 KiB/s wr, 27 op/s 2023-05-08T07:06:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:07 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:06:07.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:07 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:06:07.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:07 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:06:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:07 smithi096 ceph-mon[124666]: pgmap v6513: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 197 KiB/s wr, 27 op/s 2023-05-08T07:06:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:07 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:06:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:07 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:06:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:07 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:06:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:07 smithi186 ceph-mon[126480]: pgmap v6513: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 197 KiB/s wr, 27 op/s 2023-05-08T07:06:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:07 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:06:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:07 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:06:07.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:07 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:06:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:09 smithi133 ceph-mon[125939]: pgmap v6514: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 184 KiB/s wr, 23 op/s 2023-05-08T07:06:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12107.836980 secs 2023-05-08T07:06:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12108.395130 secs 2023-05-08T07:06:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:09 smithi096 ceph-mon[124666]: pgmap v6514: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 184 KiB/s wr, 23 op/s 2023-05-08T07:06:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12107.836980 secs 2023-05-08T07:06:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12108.395130 secs 2023-05-08T07:06:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:09 smithi186 ceph-mon[126480]: pgmap v6514: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 184 KiB/s wr, 23 op/s 2023-05-08T07:06:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12107.836980 secs 2023-05-08T07:06:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12108.395130 secs 2023-05-08T07:06:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:11 smithi096 ceph-mon[124666]: pgmap v6515: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 260 KiB/s wr, 28 op/s 2023-05-08T07:06:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12109.677124 secs 2023-05-08T07:06:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:11 smithi096 ceph-mon[124666]: osdmap e484: 12 total, 12 up, 12 in 2023-05-08T07:06:11.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:11 smithi186 ceph-mon[126480]: pgmap v6515: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 260 KiB/s wr, 28 op/s 2023-05-08T07:06:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12109.677124 secs 2023-05-08T07:06:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:11 smithi186 ceph-mon[126480]: osdmap e484: 12 total, 12 up, 12 in 2023-05-08T07:06:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:11 smithi133 ceph-mon[125939]: pgmap v6515: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 260 KiB/s wr, 28 op/s 2023-05-08T07:06:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12109.677124 secs 2023-05-08T07:06:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:11 smithi133 ceph-mon[125939]: osdmap e484: 12 total, 12 up, 12 in 2023-05-08T07:06:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:13 smithi096 ceph-mon[124666]: pgmap v6517: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 160 KiB/s wr, 28 op/s 2023-05-08T07:06:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:13 smithi186 ceph-mon[126480]: pgmap v6517: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 160 KiB/s wr, 28 op/s 2023-05-08T07:06:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:13 smithi133 ceph-mon[125939]: pgmap v6517: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 160 KiB/s wr, 28 op/s 2023-05-08T07:06:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12112.837113 secs 2023-05-08T07:06:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12113.395238 secs 2023-05-08T07:06:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12112.837113 secs 2023-05-08T07:06:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12113.395238 secs 2023-05-08T07:06:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12112.837113 secs 2023-05-08T07:06:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12113.395238 secs 2023-05-08T07:06:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:15 smithi096 ceph-mon[124666]: pgmap v6518: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 160 KiB/s wr, 28 op/s 2023-05-08T07:06:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:15 smithi186 ceph-mon[126480]: pgmap v6518: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 160 KiB/s wr, 28 op/s 2023-05-08T07:06:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:15 smithi133 ceph-mon[125939]: pgmap v6518: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 160 KiB/s wr, 28 op/s 2023-05-08T07:06:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12114.677247 secs 2023-05-08T07:06:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12114.677247 secs 2023-05-08T07:06:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12114.677247 secs 2023-05-08T07:06:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:17 smithi186 ceph-mon[126480]: pgmap v6519: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 168 KiB/s wr, 10 op/s 2023-05-08T07:06:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:17 smithi133 ceph-mon[125939]: pgmap v6519: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 168 KiB/s wr, 10 op/s 2023-05-08T07:06:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:17 smithi096 ceph-mon[124666]: pgmap v6519: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 168 KiB/s wr, 10 op/s 2023-05-08T07:06:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:18 smithi186 ceph-mon[126480]: pgmap v6520: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 168 KiB/s wr, 10 op/s 2023-05-08T07:06:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:18 smithi133 ceph-mon[125939]: pgmap v6520: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 168 KiB/s wr, 10 op/s 2023-05-08T07:06:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:18 smithi096 ceph-mon[124666]: pgmap v6520: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 168 KiB/s wr, 10 op/s 2023-05-08T07:06:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12117.837234 secs 2023-05-08T07:06:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12118.395335 secs 2023-05-08T07:06:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12117.837234 secs 2023-05-08T07:06:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12118.395335 secs 2023-05-08T07:06:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12117.837234 secs 2023-05-08T07:06:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12118.395335 secs 2023-05-08T07:06:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:20 smithi186 ceph-mon[126480]: pgmap v6521: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 103 KiB/s wr, 9 op/s 2023-05-08T07:06:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:20 smithi133 ceph-mon[125939]: pgmap v6521: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 103 KiB/s wr, 9 op/s 2023-05-08T07:06:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:20 smithi096 ceph-mon[124666]: pgmap v6521: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 103 KiB/s wr, 9 op/s 2023-05-08T07:06:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12119.677361 secs 2023-05-08T07:06:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:21 smithi186 ceph-mon[126480]: osdmap e485: 12 total, 12 up, 12 in 2023-05-08T07:06:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12119.677361 secs 2023-05-08T07:06:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:21 smithi133 ceph-mon[125939]: osdmap e485: 12 total, 12 up, 12 in 2023-05-08T07:06:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12119.677361 secs 2023-05-08T07:06:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:21 smithi096 ceph-mon[124666]: osdmap e485: 12 total, 12 up, 12 in 2023-05-08T07:06:22.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:22 smithi186 ceph-mon[126480]: pgmap v6523: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 103 KiB/s wr, 9 op/s 2023-05-08T07:06:22.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:22 smithi133 ceph-mon[125939]: pgmap v6523: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 103 KiB/s wr, 9 op/s 2023-05-08T07:06:23.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:22 smithi096 ceph-mon[124666]: pgmap v6523: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 103 KiB/s wr, 9 op/s 2023-05-08T07:06:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12122.837306 secs 2023-05-08T07:06:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12123.395434 secs 2023-05-08T07:06:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:24 smithi133 ceph-mon[125939]: pgmap v6524: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 103 KiB/s wr, 9 op/s 2023-05-08T07:06:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12122.837306 secs 2023-05-08T07:06:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12123.395434 secs 2023-05-08T07:06:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:24 smithi096 ceph-mon[124666]: pgmap v6524: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 103 KiB/s wr, 9 op/s 2023-05-08T07:06:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12122.837306 secs 2023-05-08T07:06:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12123.395434 secs 2023-05-08T07:06:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:24 smithi186 ceph-mon[126480]: pgmap v6524: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 103 KiB/s wr, 9 op/s 2023-05-08T07:06:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12124.677459 secs 2023-05-08T07:06:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12124.677459 secs 2023-05-08T07:06:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12124.677459 secs 2023-05-08T07:06:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:26 smithi186 ceph-mon[126480]: pgmap v6525: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 63 KiB/s wr, 9 op/s 2023-05-08T07:06:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:26 smithi133 ceph-mon[125939]: pgmap v6525: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 63 KiB/s wr, 9 op/s 2023-05-08T07:06:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:26 smithi096 ceph-mon[124666]: pgmap v6525: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 63 KiB/s wr, 9 op/s 2023-05-08T07:06:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:28 smithi186 ceph-mon[126480]: pgmap v6526: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 63 KiB/s wr, 9 op/s 2023-05-08T07:06:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12127.837427 secs 2023-05-08T07:06:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:28 smithi133 ceph-mon[125939]: pgmap v6526: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 63 KiB/s wr, 9 op/s 2023-05-08T07:06:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12127.837427 secs 2023-05-08T07:06:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:28 smithi096 ceph-mon[124666]: pgmap v6526: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 63 KiB/s wr, 9 op/s 2023-05-08T07:06:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12127.837427 secs 2023-05-08T07:06:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12128.395556 secs 2023-05-08T07:06:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12128.395556 secs 2023-05-08T07:06:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12128.395556 secs 2023-05-08T07:06:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:30 smithi186 ceph-mon[126480]: pgmap v6527: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 78 KiB/s wr, 8 op/s 2023-05-08T07:06:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12129.677583 secs 2023-05-08T07:06:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:30 smithi133 ceph-mon[125939]: pgmap v6527: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 78 KiB/s wr, 8 op/s 2023-05-08T07:06:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12129.677583 secs 2023-05-08T07:06:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:30 smithi096 ceph-mon[124666]: pgmap v6527: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 78 KiB/s wr, 8 op/s 2023-05-08T07:06:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12129.677583 secs 2023-05-08T07:06:33.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:32 smithi186 ceph-mon[126480]: pgmap v6528: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 71 KiB/s wr, 7 op/s 2023-05-08T07:06:33.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:32 smithi133 ceph-mon[125939]: pgmap v6528: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 71 KiB/s wr, 7 op/s 2023-05-08T07:06:33.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:32 smithi096 ceph-mon[124666]: pgmap v6528: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 71 KiB/s wr, 7 op/s 2023-05-08T07:06:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12132.837537 secs 2023-05-08T07:06:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12132.837537 secs 2023-05-08T07:06:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12132.837537 secs 2023-05-08T07:06:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12133.395669 secs 2023-05-08T07:06:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:34 smithi186 ceph-mon[126480]: pgmap v6529: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 65 KiB/s wr, 6 op/s 2023-05-08T07:06:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12133.395669 secs 2023-05-08T07:06:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:34 smithi133 ceph-mon[125939]: pgmap v6529: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 65 KiB/s wr, 6 op/s 2023-05-08T07:06:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12133.395669 secs 2023-05-08T07:06:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:34 smithi096 ceph-mon[124666]: pgmap v6529: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 65 KiB/s wr, 6 op/s 2023-05-08T07:06:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12134.677701 secs 2023-05-08T07:06:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12134.677701 secs 2023-05-08T07:06:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12134.677701 secs 2023-05-08T07:06:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:36 smithi186 ceph-mon[126480]: pgmap v6530: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 65 KiB/s wr, 9 op/s 2023-05-08T07:06:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:36 smithi133 ceph-mon[125939]: pgmap v6530: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 65 KiB/s wr, 9 op/s 2023-05-08T07:06:37.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:36 smithi096 ceph-mon[124666]: pgmap v6530: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 65 KiB/s wr, 9 op/s 2023-05-08T07:06:38.123 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:37 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:06:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:37 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:06:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:37 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:06:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:38 smithi186 ceph-mon[126480]: pgmap v6531: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T07:06:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12137.837603 secs 2023-05-08T07:06:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:38 smithi133 ceph-mon[125939]: pgmap v6531: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T07:06:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12137.837603 secs 2023-05-08T07:06:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:38 smithi096 ceph-mon[124666]: pgmap v6531: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T07:06:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12137.837603 secs 2023-05-08T07:06:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12138.395738 secs 2023-05-08T07:06:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12138.395738 secs 2023-05-08T07:06:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12138.395738 secs 2023-05-08T07:06:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:41 smithi133 ceph-mon[125939]: pgmap v6532: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 126 KiB/s wr, 10 op/s 2023-05-08T07:06:41.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12139.677847 secs 2023-05-08T07:06:41.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:06:41.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:06:41.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:06:41.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:06:41.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:06:41.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:06:41.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:06:41.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:06:41.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:06:41.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:06:41.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:06:41.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:06:41.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:06:41.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:06:41.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:06:41.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:06:41.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:06:41.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:06:41.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:06:41.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:06:41.494 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:06:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:41 smithi096 ceph-mon[124666]: pgmap v6532: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 126 KiB/s wr, 10 op/s 2023-05-08T07:06:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12139.677847 secs 2023-05-08T07:06:41.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:06:41.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:06:41.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:06:41.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:06:41.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:06:41.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:06:41.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:06:41.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:06:41.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:06:41.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:06:41.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:06:41.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:06:41.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:06:41.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:06:41.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:06:41.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:06:41.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:06:41.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:06:41.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:06:41.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:06:41.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:06:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:41 smithi186 ceph-mon[126480]: pgmap v6532: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 126 KiB/s wr, 10 op/s 2023-05-08T07:06:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12139.677847 secs 2023-05-08T07:06:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:06:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:06:41.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:06:41.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:06:41.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:06:41.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:06:41.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:06:41.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:06:41.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:06:41.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:06:41.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:06:41.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:06:41.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:06:41.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:06:41.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:06:41.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:06:41.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:06:41.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:06:41.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:06:41.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:06:41.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:06:42.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:42 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi096 to 174.2M 2023-05-08T07:06:42.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:42 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi096 to 182681309: error parsing value: Value '182681309' is below minimum 939524096 2023-05-08T07:06:42.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:42 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T07:06:42.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:42 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T07:06:42.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:42 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T07:06:42.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:42 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T07:06:42.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:42 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:06:42.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:42 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T07:06:42.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:42 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T07:06:42.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:42 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:06:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:42 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi096 to 174.2M 2023-05-08T07:06:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:42 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi096 to 182681309: error parsing value: Value '182681309' is below minimum 939524096 2023-05-08T07:06:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:42 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T07:06:42.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:42 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T07:06:42.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:42 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T07:06:42.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:42 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T07:06:42.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:42 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:06:42.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:42 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T07:06:42.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:42 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T07:06:42.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:42 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:06:42.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:42 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi096 to 174.2M 2023-05-08T07:06:42.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:42 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi096 to 182681309: error parsing value: Value '182681309' is below minimum 939524096 2023-05-08T07:06:42.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:42 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T07:06:42.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:42 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T07:06:42.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:42 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T07:06:42.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:42 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T07:06:42.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:42 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:06:42.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:42 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T07:06:42.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:42 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T07:06:42.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:42 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:06:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:43 smithi133 ceph-mon[125939]: pgmap v6533: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 92 KiB/s wr, 7 op/s 2023-05-08T07:06:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:43 smithi096 ceph-mon[124666]: pgmap v6533: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 92 KiB/s wr, 7 op/s 2023-05-08T07:06:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:43 smithi186 ceph-mon[126480]: pgmap v6533: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 92 KiB/s wr, 7 op/s 2023-05-08T07:06:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12142.837722 secs 2023-05-08T07:06:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12142.837722 secs 2023-05-08T07:06:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12142.837722 secs 2023-05-08T07:06:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:45 smithi133 ceph-mon[125939]: pgmap v6534: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 92 KiB/s wr, 7 op/s 2023-05-08T07:06:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:45 smithi096 ceph-mon[124666]: pgmap v6534: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 92 KiB/s wr, 7 op/s 2023-05-08T07:06:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:45 smithi186 ceph-mon[126480]: pgmap v6534: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 92 KiB/s wr, 7 op/s 2023-05-08T07:06:47.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:47 smithi133 ceph-mon[125939]: pgmap v6535: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 156 KiB/s wr, 11 op/s 2023-05-08T07:06:47.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:06:47.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:06:47.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:47 smithi096 ceph-mon[124666]: pgmap v6535: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 156 KiB/s wr, 11 op/s 2023-05-08T07:06:47.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:06:47.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:06:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:47 smithi186 ceph-mon[126480]: pgmap v6535: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 156 KiB/s wr, 11 op/s 2023-05-08T07:06:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:06:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:06:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:48 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:06:48.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:06:48.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:06:48.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:06:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:48 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:06:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:06:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:06:48.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:06:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:48 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:06:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:06:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:06:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:06:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:49 smithi133 ceph-mon[125939]: pgmap v6536: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 156 KiB/s wr, 8 op/s 2023-05-08T07:06:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12147.837845 secs 2023-05-08T07:06:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:49 smithi096 ceph-mon[124666]: pgmap v6536: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 156 KiB/s wr, 8 op/s 2023-05-08T07:06:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12147.837845 secs 2023-05-08T07:06:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:49 smithi186 ceph-mon[126480]: pgmap v6536: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 156 KiB/s wr, 8 op/s 2023-05-08T07:06:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12147.837845 secs 2023-05-08T07:06:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12148.395950 secs 2023-05-08T07:06:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12148.395950 secs 2023-05-08T07:06:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12148.395950 secs 2023-05-08T07:06:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:51 smithi133 ceph-mon[125939]: pgmap v6537: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 305 KiB/s wr, 13 op/s 2023-05-08T07:06:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:51 smithi096 ceph-mon[124666]: pgmap v6537: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 305 KiB/s wr, 13 op/s 2023-05-08T07:06:51.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:51 smithi186 ceph-mon[126480]: pgmap v6537: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 305 KiB/s wr, 13 op/s 2023-05-08T07:06:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:06:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:06:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:06:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:06:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:06:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:06:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:53 smithi133 ceph-mon[125939]: pgmap v6538: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 213 KiB/s wr, 9 op/s 2023-05-08T07:06:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:53 smithi096 ceph-mon[124666]: pgmap v6538: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 213 KiB/s wr, 9 op/s 2023-05-08T07:06:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:53 smithi186 ceph-mon[126480]: pgmap v6538: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 213 KiB/s wr, 9 op/s 2023-05-08T07:06:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12152.837975 secs 2023-05-08T07:06:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12152.837975 secs 2023-05-08T07:06:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12152.837975 secs 2023-05-08T07:06:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:55 smithi133 ceph-mon[125939]: pgmap v6539: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 213 KiB/s wr, 9 op/s 2023-05-08T07:06:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:55 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:06:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:55 smithi096 ceph-mon[124666]: pgmap v6539: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 213 KiB/s wr, 9 op/s 2023-05-08T07:06:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:55 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:06:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:55 smithi186 ceph-mon[126480]: pgmap v6539: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 213 KiB/s wr, 9 op/s 2023-05-08T07:06:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:55 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:06:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:56 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:06:56.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:06:56.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:06:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:56 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:06:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:06:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:06:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:56 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:06:56.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:06:56.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:06:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:57 smithi133 ceph-mon[125939]: pgmap v6540: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 226 KiB/s wr, 14 op/s 2023-05-08T07:06:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:57 smithi096 ceph-mon[124666]: pgmap v6540: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 226 KiB/s wr, 14 op/s 2023-05-08T07:06:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:57 smithi186 ceph-mon[126480]: pgmap v6540: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 226 KiB/s wr, 14 op/s 2023-05-08T07:06:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:59 smithi096 ceph-mon[124666]: pgmap v6541: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 163 KiB/s wr, 9 op/s 2023-05-08T07:06:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:06:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12157.838072 secs 2023-05-08T07:06:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:59 smithi186 ceph-mon[126480]: pgmap v6541: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 163 KiB/s wr, 9 op/s 2023-05-08T07:06:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:06:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12157.838072 secs 2023-05-08T07:06:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:59 smithi133 ceph-mon[125939]: pgmap v6541: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 163 KiB/s wr, 9 op/s 2023-05-08T07:06:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:06:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12157.838072 secs 2023-05-08T07:07:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12158.396170 secs 2023-05-08T07:07:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12158.396170 secs 2023-05-08T07:07:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12158.396170 secs 2023-05-08T07:07:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:01 smithi096 ceph-mon[124666]: pgmap v6542: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 265 KiB/s rd, 263 KiB/s wr, 14 op/s 2023-05-08T07:07:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12159.678286 secs 2023-05-08T07:07:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:01 smithi186 ceph-mon[126480]: pgmap v6542: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 265 KiB/s rd, 263 KiB/s wr, 14 op/s 2023-05-08T07:07:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12159.678286 secs 2023-05-08T07:07:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:01 smithi133 ceph-mon[125939]: pgmap v6542: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 265 KiB/s rd, 263 KiB/s wr, 14 op/s 2023-05-08T07:07:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12159.678286 secs 2023-05-08T07:07:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:03 smithi096 ceph-mon[124666]: pgmap v6543: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 114 KiB/s wr, 9 op/s 2023-05-08T07:07:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:03 smithi186 ceph-mon[126480]: pgmap v6543: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 114 KiB/s wr, 9 op/s 2023-05-08T07:07:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:03 smithi133 ceph-mon[125939]: pgmap v6543: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 114 KiB/s wr, 9 op/s 2023-05-08T07:07:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12162.838187 secs 2023-05-08T07:07:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:04 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:07:04.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:04 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:07:04.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:04 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:07:04.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:04 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:07:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12162.838187 secs 2023-05-08T07:07:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:04 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:07:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:04 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:07:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:04 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:07:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:04 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:07:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12162.838187 secs 2023-05-08T07:07:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:04 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:07:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:04 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:07:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:04 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:07:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:04 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:07:05.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12163.396257 secs 2023-05-08T07:07:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:05 smithi186 ceph-mon[126480]: pgmap v6544: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 114 KiB/s wr, 9 op/s 2023-05-08T07:07:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12163.396257 secs 2023-05-08T07:07:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:05 smithi133 ceph-mon[125939]: pgmap v6544: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 114 KiB/s wr, 9 op/s 2023-05-08T07:07:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12163.396257 secs 2023-05-08T07:07:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:05 smithi096 ceph-mon[124666]: pgmap v6544: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 114 KiB/s wr, 9 op/s 2023-05-08T07:07:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12164.678404 secs 2023-05-08T07:07:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12164.678404 secs 2023-05-08T07:07:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12164.678404 secs 2023-05-08T07:07:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:07 smithi186 ceph-mon[126480]: pgmap v6545: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 190 KiB/s wr, 26 op/s 2023-05-08T07:07:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:07 smithi133 ceph-mon[125939]: pgmap v6545: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 190 KiB/s wr, 26 op/s 2023-05-08T07:07:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:07 smithi096 ceph-mon[124666]: pgmap v6545: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 190 KiB/s wr, 26 op/s 2023-05-08T07:07:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:09 smithi186 ceph-mon[126480]: pgmap v6546: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 177 KiB/s wr, 22 op/s 2023-05-08T07:07:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12167.838311 secs 2023-05-08T07:07:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:09 smithi133 ceph-mon[125939]: pgmap v6546: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 177 KiB/s wr, 22 op/s 2023-05-08T07:07:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12167.838311 secs 2023-05-08T07:07:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:09 smithi096 ceph-mon[124666]: pgmap v6546: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 177 KiB/s wr, 22 op/s 2023-05-08T07:07:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12167.838311 secs 2023-05-08T07:07:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12168.396376 secs 2023-05-08T07:07:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12168.396376 secs 2023-05-08T07:07:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12168.396376 secs 2023-05-08T07:07:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:11 smithi186 ceph-mon[126480]: pgmap v6547: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 207 KiB/s wr, 25 op/s 2023-05-08T07:07:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12169.678550 secs 2023-05-08T07:07:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:11 smithi186 ceph-mon[126480]: osdmap e486: 12 total, 12 up, 12 in 2023-05-08T07:07:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:11 smithi133 ceph-mon[125939]: pgmap v6547: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 207 KiB/s wr, 25 op/s 2023-05-08T07:07:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12169.678550 secs 2023-05-08T07:07:11.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:11 smithi133 ceph-mon[125939]: osdmap e486: 12 total, 12 up, 12 in 2023-05-08T07:07:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:11 smithi096 ceph-mon[124666]: pgmap v6547: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 207 KiB/s wr, 25 op/s 2023-05-08T07:07:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12169.678550 secs 2023-05-08T07:07:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:11 smithi096 ceph-mon[124666]: osdmap e486: 12 total, 12 up, 12 in 2023-05-08T07:07:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:13 smithi186 ceph-mon[126480]: pgmap v6549: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 128 KiB/s wr, 26 op/s 2023-05-08T07:07:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:13 smithi133 ceph-mon[125939]: pgmap v6549: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 128 KiB/s wr, 26 op/s 2023-05-08T07:07:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:13 smithi096 ceph-mon[124666]: pgmap v6549: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 128 KiB/s wr, 26 op/s 2023-05-08T07:07:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12172.838378 secs 2023-05-08T07:07:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12172.838378 secs 2023-05-08T07:07:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12172.838378 secs 2023-05-08T07:07:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12173.396476 secs 2023-05-08T07:07:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:15 smithi186 ceph-mon[126480]: pgmap v6550: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 128 KiB/s wr, 26 op/s 2023-05-08T07:07:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12173.396476 secs 2023-05-08T07:07:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:15 smithi133 ceph-mon[125939]: pgmap v6550: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 128 KiB/s wr, 26 op/s 2023-05-08T07:07:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12173.396476 secs 2023-05-08T07:07:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:15 smithi096 ceph-mon[124666]: pgmap v6550: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 128 KiB/s wr, 26 op/s 2023-05-08T07:07:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12174.678671 secs 2023-05-08T07:07:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12174.678671 secs 2023-05-08T07:07:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12174.678671 secs 2023-05-08T07:07:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:17 smithi186 ceph-mon[126480]: pgmap v6551: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 43 KiB/s wr, 8 op/s 2023-05-08T07:07:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:17 smithi133 ceph-mon[125939]: pgmap v6551: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 43 KiB/s wr, 8 op/s 2023-05-08T07:07:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:17 smithi096 ceph-mon[124666]: pgmap v6551: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 43 KiB/s wr, 8 op/s 2023-05-08T07:07:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:19 smithi186 ceph-mon[126480]: pgmap v6552: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 43 KiB/s wr, 8 op/s 2023-05-08T07:07:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12177.838492 secs 2023-05-08T07:07:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12178.396595 secs 2023-05-08T07:07:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:19 smithi133 ceph-mon[125939]: pgmap v6552: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 43 KiB/s wr, 8 op/s 2023-05-08T07:07:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12177.838492 secs 2023-05-08T07:07:19.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12178.396595 secs 2023-05-08T07:07:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:19 smithi096 ceph-mon[124666]: pgmap v6552: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 43 KiB/s wr, 8 op/s 2023-05-08T07:07:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12177.838492 secs 2023-05-08T07:07:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12178.396595 secs 2023-05-08T07:07:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:21 smithi186 ceph-mon[126480]: pgmap v6553: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 87 KiB/s wr, 8 op/s 2023-05-08T07:07:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12179.678833 secs 2023-05-08T07:07:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:21 smithi186 ceph-mon[126480]: osdmap e487: 12 total, 12 up, 12 in 2023-05-08T07:07:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:21 smithi133 ceph-mon[125939]: pgmap v6553: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 87 KiB/s wr, 8 op/s 2023-05-08T07:07:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12179.678833 secs 2023-05-08T07:07:21.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:21 smithi133 ceph-mon[125939]: osdmap e487: 12 total, 12 up, 12 in 2023-05-08T07:07:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:21 smithi096 ceph-mon[124666]: pgmap v6553: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 87 KiB/s wr, 8 op/s 2023-05-08T07:07:21.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12179.678833 secs 2023-05-08T07:07:21.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:21 smithi096 ceph-mon[124666]: osdmap e487: 12 total, 12 up, 12 in 2023-05-08T07:07:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:23 smithi186 ceph-mon[126480]: pgmap v6555: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 87 KiB/s wr, 8 op/s 2023-05-08T07:07:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:23 smithi133 ceph-mon[125939]: pgmap v6555: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 87 KiB/s wr, 8 op/s 2023-05-08T07:07:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:23 smithi096 ceph-mon[124666]: pgmap v6555: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 87 KiB/s wr, 8 op/s 2023-05-08T07:07:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12182.838605 secs 2023-05-08T07:07:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12183.396712 secs 2023-05-08T07:07:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12182.838605 secs 2023-05-08T07:07:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12183.396712 secs 2023-05-08T07:07:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12182.838605 secs 2023-05-08T07:07:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12183.396712 secs 2023-05-08T07:07:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:25 smithi186 ceph-mon[126480]: pgmap v6556: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 87 KiB/s wr, 8 op/s 2023-05-08T07:07:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:25 smithi133 ceph-mon[125939]: pgmap v6556: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 87 KiB/s wr, 8 op/s 2023-05-08T07:07:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:25 smithi096 ceph-mon[124666]: pgmap v6556: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 87 KiB/s wr, 8 op/s 2023-05-08T07:07:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12184.678960 secs 2023-05-08T07:07:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12184.678960 secs 2023-05-08T07:07:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12184.678960 secs 2023-05-08T07:07:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:27 smithi186 ceph-mon[126480]: pgmap v6557: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 82 KiB/s wr, 9 op/s 2023-05-08T07:07:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:27 smithi133 ceph-mon[125939]: pgmap v6557: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 82 KiB/s wr, 9 op/s 2023-05-08T07:07:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:27 smithi096 ceph-mon[124666]: pgmap v6557: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 82 KiB/s wr, 9 op/s 2023-05-08T07:07:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:29 smithi186 ceph-mon[126480]: pgmap v6558: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 82 KiB/s wr, 9 op/s 2023-05-08T07:07:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12187.838698 secs 2023-05-08T07:07:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12188.396825 secs 2023-05-08T07:07:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:29 smithi133 ceph-mon[125939]: pgmap v6558: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 82 KiB/s wr, 9 op/s 2023-05-08T07:07:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12187.838698 secs 2023-05-08T07:07:29.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12188.396825 secs 2023-05-08T07:07:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:29 smithi096 ceph-mon[124666]: pgmap v6558: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 82 KiB/s wr, 9 op/s 2023-05-08T07:07:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12187.838698 secs 2023-05-08T07:07:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12188.396825 secs 2023-05-08T07:07:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:31 smithi186 ceph-mon[126480]: pgmap v6559: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 102 KiB/s wr, 9 op/s 2023-05-08T07:07:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12189.679059 secs 2023-05-08T07:07:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:31 smithi133 ceph-mon[125939]: pgmap v6559: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 102 KiB/s wr, 9 op/s 2023-05-08T07:07:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12189.679059 secs 2023-05-08T07:07:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:31 smithi096 ceph-mon[124666]: pgmap v6559: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 102 KiB/s wr, 9 op/s 2023-05-08T07:07:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12189.679059 secs 2023-05-08T07:07:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:33 smithi186 ceph-mon[126480]: pgmap v6560: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 94 KiB/s wr, 8 op/s 2023-05-08T07:07:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:33 smithi133 ceph-mon[125939]: pgmap v6560: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 94 KiB/s wr, 8 op/s 2023-05-08T07:07:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:33 smithi096 ceph-mon[124666]: pgmap v6560: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 94 KiB/s wr, 8 op/s 2023-05-08T07:07:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12192.838812 secs 2023-05-08T07:07:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12193.396960 secs 2023-05-08T07:07:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12192.838812 secs 2023-05-08T07:07:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12193.396960 secs 2023-05-08T07:07:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12192.838812 secs 2023-05-08T07:07:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12193.396960 secs 2023-05-08T07:07:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:35 smithi186 ceph-mon[126480]: pgmap v6561: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 85 KiB/s wr, 7 op/s 2023-05-08T07:07:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:35 smithi133 ceph-mon[125939]: pgmap v6561: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 85 KiB/s wr, 7 op/s 2023-05-08T07:07:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:35 smithi096 ceph-mon[124666]: pgmap v6561: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 85 KiB/s wr, 7 op/s 2023-05-08T07:07:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12194.679187 secs 2023-05-08T07:07:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12194.679187 secs 2023-05-08T07:07:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12194.679187 secs 2023-05-08T07:07:37.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:37 smithi186 ceph-mon[126480]: pgmap v6562: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 85 KiB/s wr, 10 op/s 2023-05-08T07:07:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:37 smithi133 ceph-mon[125939]: pgmap v6562: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 85 KiB/s wr, 10 op/s 2023-05-08T07:07:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:37 smithi096 ceph-mon[124666]: pgmap v6562: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 85 KiB/s wr, 10 op/s 2023-05-08T07:07:39.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:39 smithi186 ceph-mon[126480]: pgmap v6563: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 84 KiB/s wr, 7 op/s 2023-05-08T07:07:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12197.838933 secs 2023-05-08T07:07:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12198.397069 secs 2023-05-08T07:07:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:39 smithi133 ceph-mon[125939]: pgmap v6563: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 84 KiB/s wr, 7 op/s 2023-05-08T07:07:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12197.838933 secs 2023-05-08T07:07:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12198.397069 secs 2023-05-08T07:07:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:39 smithi096 ceph-mon[124666]: pgmap v6563: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 84 KiB/s wr, 7 op/s 2023-05-08T07:07:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12197.838933 secs 2023-05-08T07:07:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12198.397069 secs 2023-05-08T07:07:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:41 smithi186 ceph-mon[126480]: pgmap v6564: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 117 KiB/s wr, 10 op/s 2023-05-08T07:07:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12199.679333 secs 2023-05-08T07:07:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:07:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:41 smithi133 ceph-mon[125939]: pgmap v6564: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 117 KiB/s wr, 10 op/s 2023-05-08T07:07:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12199.679333 secs 2023-05-08T07:07:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:07:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:41 smithi096 ceph-mon[124666]: pgmap v6564: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 117 KiB/s wr, 10 op/s 2023-05-08T07:07:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12199.679333 secs 2023-05-08T07:07:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:07:42.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:07:42.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:07:42.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:07:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:07:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:07:42.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:07:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:07:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:07:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:07:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:43 smithi186 ceph-mon[126480]: pgmap v6565: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T07:07:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:43 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:07:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:43 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T07:07:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:43 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T07:07:43.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:43 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:07:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:43 smithi133 ceph-mon[125939]: pgmap v6565: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T07:07:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:43 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:07:43.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:43 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T07:07:43.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:43 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T07:07:43.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:43 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:07:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:43 smithi096 ceph-mon[124666]: pgmap v6565: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T07:07:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:43 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:07:43.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:43 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T07:07:43.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:43 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T07:07:43.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:43 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:07:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12202.839069 secs 2023-05-08T07:07:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12202.839069 secs 2023-05-08T07:07:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12202.839069 secs 2023-05-08T07:07:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:45 smithi133 ceph-mon[125939]: pgmap v6566: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T07:07:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:45 smithi096 ceph-mon[124666]: pgmap v6566: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T07:07:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:45 smithi186 ceph-mon[126480]: pgmap v6566: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T07:07:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12204.679430 secs 2023-05-08T07:07:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12204.679430 secs 2023-05-08T07:07:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12204.679430 secs 2023-05-08T07:07:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:47 smithi133 ceph-mon[125939]: pgmap v6567: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 70 KiB/s wr, 9 op/s 2023-05-08T07:07:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:07:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:47 smithi096 ceph-mon[124666]: pgmap v6567: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 70 KiB/s wr, 9 op/s 2023-05-08T07:07:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:07:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:47 smithi186 ceph-mon[126480]: pgmap v6567: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 70 KiB/s wr, 9 op/s 2023-05-08T07:07:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:07:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:48 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:07:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:07:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:07:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:48 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:07:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:07:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:07:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:48 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:07:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:07:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:07:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:49 smithi133 ceph-mon[125939]: pgmap v6568: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 70 KiB/s wr, 6 op/s 2023-05-08T07:07:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12207.839207 secs 2023-05-08T07:07:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:49 smithi096 ceph-mon[124666]: pgmap v6568: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 70 KiB/s wr, 6 op/s 2023-05-08T07:07:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12207.839207 secs 2023-05-08T07:07:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:49 smithi186 ceph-mon[126480]: pgmap v6568: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 70 KiB/s wr, 6 op/s 2023-05-08T07:07:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12207.839207 secs 2023-05-08T07:07:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:51 smithi133 ceph-mon[125939]: pgmap v6569: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 159 KiB/s wr, 12 op/s 2023-05-08T07:07:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:07:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:51 smithi096 ceph-mon[124666]: pgmap v6569: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 159 KiB/s wr, 12 op/s 2023-05-08T07:07:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:07:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:51 smithi186 ceph-mon[126480]: pgmap v6569: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 159 KiB/s wr, 12 op/s 2023-05-08T07:07:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:07:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:07:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:07:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:07:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:07:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:07:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:07:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:53 smithi133 ceph-mon[125939]: pgmap v6570: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 126 KiB/s wr, 9 op/s 2023-05-08T07:07:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:53 smithi096 ceph-mon[124666]: pgmap v6570: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 126 KiB/s wr, 9 op/s 2023-05-08T07:07:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:53 smithi186 ceph-mon[126480]: pgmap v6570: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 126 KiB/s wr, 9 op/s 2023-05-08T07:07:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12212.839321 secs 2023-05-08T07:07:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12213.397408 secs 2023-05-08T07:07:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12212.839321 secs 2023-05-08T07:07:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12213.397408 secs 2023-05-08T07:07:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12212.839321 secs 2023-05-08T07:07:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12213.397408 secs 2023-05-08T07:07:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:55 smithi133 ceph-mon[125939]: pgmap v6571: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 126 KiB/s wr, 9 op/s 2023-05-08T07:07:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:55 smithi096 ceph-mon[124666]: pgmap v6571: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 126 KiB/s wr, 9 op/s 2023-05-08T07:07:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:55 smithi186 ceph-mon[126480]: pgmap v6571: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 126 KiB/s wr, 9 op/s 2023-05-08T07:07:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:56 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:07:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:07:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:07:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:56 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:07:56.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:07:56.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:07:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:56 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:07:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:07:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:07:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:57 smithi133 ceph-mon[125939]: pgmap v6572: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 167 KiB/s wr, 13 op/s 2023-05-08T07:07:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:57 smithi096 ceph-mon[124666]: pgmap v6572: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 167 KiB/s wr, 13 op/s 2023-05-08T07:07:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:57 smithi186 ceph-mon[126480]: pgmap v6572: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 167 KiB/s wr, 13 op/s 2023-05-08T07:07:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:59 smithi133 ceph-mon[125939]: pgmap v6573: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 130 KiB/s wr, 9 op/s 2023-05-08T07:07:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:07:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12217.839462 secs 2023-05-08T07:07:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:59 smithi096 ceph-mon[124666]: pgmap v6573: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 130 KiB/s wr, 9 op/s 2023-05-08T07:07:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:07:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12217.839462 secs 2023-05-08T07:07:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:59 smithi186 ceph-mon[126480]: pgmap v6573: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 130 KiB/s wr, 9 op/s 2023-05-08T07:07:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:07:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12217.839462 secs 2023-05-08T07:08:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:01 smithi133 ceph-mon[125939]: pgmap v6574: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 237 KiB/s wr, 14 op/s 2023-05-08T07:08:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12219.679835 secs 2023-05-08T07:08:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:01 smithi096 ceph-mon[124666]: pgmap v6574: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 237 KiB/s wr, 14 op/s 2023-05-08T07:08:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12219.679835 secs 2023-05-08T07:08:01.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:01 smithi186 ceph-mon[126480]: pgmap v6574: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 237 KiB/s wr, 14 op/s 2023-05-08T07:08:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12219.679835 secs 2023-05-08T07:08:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:03 smithi133 ceph-mon[125939]: pgmap v6575: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 148 KiB/s wr, 8 op/s 2023-05-08T07:08:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:03 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:08:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:03 smithi096 ceph-mon[124666]: pgmap v6575: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 148 KiB/s wr, 8 op/s 2023-05-08T07:08:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:03 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:08:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:03 smithi186 ceph-mon[126480]: pgmap v6575: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 148 KiB/s wr, 8 op/s 2023-05-08T07:08:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:03 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:08:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12222.839579 secs 2023-05-08T07:08:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:04 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:08:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:04 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:08:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:04 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:08:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12223.397641 secs 2023-05-08T07:08:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12222.839579 secs 2023-05-08T07:08:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:04 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:08:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:04 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:08:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:04 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:08:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12223.397641 secs 2023-05-08T07:08:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12222.839579 secs 2023-05-08T07:08:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:04 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:08:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:04 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:08:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:04 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:08:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12223.397641 secs 2023-05-08T07:08:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:05 smithi133 ceph-mon[125939]: pgmap v6576: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 148 KiB/s wr, 8 op/s 2023-05-08T07:08:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:05 smithi096 ceph-mon[124666]: pgmap v6576: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 148 KiB/s wr, 8 op/s 2023-05-08T07:08:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:05 smithi186 ceph-mon[126480]: pgmap v6576: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 148 KiB/s wr, 8 op/s 2023-05-08T07:08:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12224.679932 secs 2023-05-08T07:08:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12224.679932 secs 2023-05-08T07:08:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12224.679932 secs 2023-05-08T07:08:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:07 smithi133 ceph-mon[125939]: pgmap v6577: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 257 KiB/s wr, 27 op/s 2023-05-08T07:08:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:07 smithi096 ceph-mon[124666]: pgmap v6577: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 257 KiB/s wr, 27 op/s 2023-05-08T07:08:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:07 smithi186 ceph-mon[126480]: pgmap v6577: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 257 KiB/s wr, 27 op/s 2023-05-08T07:08:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:08 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:08:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:08:08.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:08:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:08 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:08:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:08:08.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:08:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:08 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:08:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:08:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:08:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:09 smithi133 ceph-mon[125939]: pgmap v6578: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 216 KiB/s wr, 23 op/s 2023-05-08T07:08:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12227.839675 secs 2023-05-08T07:08:09.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12228.397781 secs 2023-05-08T07:08:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:09 smithi096 ceph-mon[124666]: pgmap v6578: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 216 KiB/s wr, 23 op/s 2023-05-08T07:08:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12227.839675 secs 2023-05-08T07:08:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12228.397781 secs 2023-05-08T07:08:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:09 smithi186 ceph-mon[126480]: pgmap v6578: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 216 KiB/s wr, 23 op/s 2023-05-08T07:08:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12227.839675 secs 2023-05-08T07:08:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12228.397781 secs 2023-05-08T07:08:11.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:11 smithi133 ceph-mon[125939]: pgmap v6579: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 243 KiB/s wr, 26 op/s 2023-05-08T07:08:11.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12229.680002 secs 2023-05-08T07:08:11.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:11 smithi133 ceph-mon[125939]: osdmap e488: 12 total, 12 up, 12 in 2023-05-08T07:08:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:11 smithi096 ceph-mon[124666]: pgmap v6579: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 243 KiB/s wr, 26 op/s 2023-05-08T07:08:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12229.680002 secs 2023-05-08T07:08:11.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:11 smithi096 ceph-mon[124666]: osdmap e488: 12 total, 12 up, 12 in 2023-05-08T07:08:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:11 smithi186 ceph-mon[126480]: pgmap v6579: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 243 KiB/s wr, 26 op/s 2023-05-08T07:08:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12229.680002 secs 2023-05-08T07:08:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:11 smithi186 ceph-mon[126480]: osdmap e488: 12 total, 12 up, 12 in 2023-05-08T07:08:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:13 smithi133 ceph-mon[125939]: pgmap v6581: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 163 KiB/s wr, 26 op/s 2023-05-08T07:08:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:13 smithi096 ceph-mon[124666]: pgmap v6581: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 163 KiB/s wr, 26 op/s 2023-05-08T07:08:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:13 smithi186 ceph-mon[126480]: pgmap v6581: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 163 KiB/s wr, 26 op/s 2023-05-08T07:08:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12232.839815 secs 2023-05-08T07:08:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12233.397876 secs 2023-05-08T07:08:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12232.839815 secs 2023-05-08T07:08:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12233.397876 secs 2023-05-08T07:08:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12232.839815 secs 2023-05-08T07:08:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12233.397876 secs 2023-05-08T07:08:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:15 smithi133 ceph-mon[125939]: pgmap v6582: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 163 KiB/s wr, 26 op/s 2023-05-08T07:08:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:15 smithi096 ceph-mon[124666]: pgmap v6582: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 163 KiB/s wr, 26 op/s 2023-05-08T07:08:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:15 smithi186 ceph-mon[126480]: pgmap v6582: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 163 KiB/s wr, 26 op/s 2023-05-08T07:08:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12234.680068 secs 2023-05-08T07:08:16.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12234.680068 secs 2023-05-08T07:08:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12234.680068 secs 2023-05-08T07:08:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:17 smithi096 ceph-mon[124666]: pgmap v6583: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 39 KiB/s wr, 8 op/s 2023-05-08T07:08:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:17 smithi186 ceph-mon[126480]: pgmap v6583: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 39 KiB/s wr, 8 op/s 2023-05-08T07:08:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:17 smithi133 ceph-mon[125939]: pgmap v6583: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 39 KiB/s wr, 8 op/s 2023-05-08T07:08:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:19 smithi133 ceph-mon[125939]: pgmap v6584: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 39 KiB/s wr, 8 op/s 2023-05-08T07:08:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12237.839926 secs 2023-05-08T07:08:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12238.398001 secs 2023-05-08T07:08:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:19 smithi096 ceph-mon[124666]: pgmap v6584: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 39 KiB/s wr, 8 op/s 2023-05-08T07:08:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12237.839926 secs 2023-05-08T07:08:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12238.398001 secs 2023-05-08T07:08:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:19 smithi186 ceph-mon[126480]: pgmap v6584: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 39 KiB/s wr, 8 op/s 2023-05-08T07:08:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12237.839926 secs 2023-05-08T07:08:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12238.398001 secs 2023-05-08T07:08:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:21 smithi096 ceph-mon[124666]: pgmap v6585: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 7.1 KiB/s wr, 8 op/s 2023-05-08T07:08:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12239.680151 secs 2023-05-08T07:08:21.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:21 smithi096 ceph-mon[124666]: osdmap e489: 12 total, 12 up, 12 in 2023-05-08T07:08:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:21 smithi186 ceph-mon[126480]: pgmap v6585: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 7.1 KiB/s wr, 8 op/s 2023-05-08T07:08:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12239.680151 secs 2023-05-08T07:08:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:21 smithi186 ceph-mon[126480]: osdmap e489: 12 total, 12 up, 12 in 2023-05-08T07:08:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:21 smithi133 ceph-mon[125939]: pgmap v6585: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 7.1 KiB/s wr, 8 op/s 2023-05-08T07:08:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12239.680151 secs 2023-05-08T07:08:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:21 smithi133 ceph-mon[125939]: osdmap e489: 12 total, 12 up, 12 in 2023-05-08T07:08:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:23 smithi096 ceph-mon[124666]: pgmap v6587: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 7.0 KiB/s wr, 8 op/s 2023-05-08T07:08:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:23 smithi186 ceph-mon[126480]: pgmap v6587: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 7.0 KiB/s wr, 8 op/s 2023-05-08T07:08:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:23 smithi133 ceph-mon[125939]: pgmap v6587: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 7.0 KiB/s wr, 8 op/s 2023-05-08T07:08:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12242.840068 secs 2023-05-08T07:08:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12243.398082 secs 2023-05-08T07:08:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12242.840068 secs 2023-05-08T07:08:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12243.398082 secs 2023-05-08T07:08:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12242.840068 secs 2023-05-08T07:08:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12243.398082 secs 2023-05-08T07:08:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:25 smithi186 ceph-mon[126480]: pgmap v6588: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 7.0 KiB/s wr, 8 op/s 2023-05-08T07:08:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:25 smithi133 ceph-mon[125939]: pgmap v6588: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 7.0 KiB/s wr, 8 op/s 2023-05-08T07:08:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:25 smithi096 ceph-mon[124666]: pgmap v6588: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 7.0 KiB/s wr, 8 op/s 2023-05-08T07:08:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12244.680236 secs 2023-05-08T07:08:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12244.680236 secs 2023-05-08T07:08:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12244.680236 secs 2023-05-08T07:08:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:27 smithi186 ceph-mon[126480]: pgmap v6589: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 38 KiB/s wr, 8 op/s 2023-05-08T07:08:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:27 smithi133 ceph-mon[125939]: pgmap v6589: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 38 KiB/s wr, 8 op/s 2023-05-08T07:08:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:27 smithi096 ceph-mon[124666]: pgmap v6589: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 38 KiB/s wr, 8 op/s 2023-05-08T07:08:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:29 smithi186 ceph-mon[126480]: pgmap v6590: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 38 KiB/s wr, 8 op/s 2023-05-08T07:08:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12247.840187 secs 2023-05-08T07:08:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12248.398202 secs 2023-05-08T07:08:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:29 smithi133 ceph-mon[125939]: pgmap v6590: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 38 KiB/s wr, 8 op/s 2023-05-08T07:08:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12247.840187 secs 2023-05-08T07:08:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12248.398202 secs 2023-05-08T07:08:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:29 smithi096 ceph-mon[124666]: pgmap v6590: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 38 KiB/s wr, 8 op/s 2023-05-08T07:08:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12247.840187 secs 2023-05-08T07:08:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12248.398202 secs 2023-05-08T07:08:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:31 smithi186 ceph-mon[126480]: pgmap v6591: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 76 KiB/s wr, 8 op/s 2023-05-08T07:08:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12249.680319 secs 2023-05-08T07:08:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:31 smithi133 ceph-mon[125939]: pgmap v6591: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 76 KiB/s wr, 8 op/s 2023-05-08T07:08:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12249.680319 secs 2023-05-08T07:08:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:31 smithi096 ceph-mon[124666]: pgmap v6591: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 76 KiB/s wr, 8 op/s 2023-05-08T07:08:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12249.680319 secs 2023-05-08T07:08:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:33 smithi186 ceph-mon[126480]: pgmap v6592: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 70 KiB/s wr, 7 op/s 2023-05-08T07:08:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:33 smithi133 ceph-mon[125939]: pgmap v6592: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 70 KiB/s wr, 7 op/s 2023-05-08T07:08:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:33 smithi096 ceph-mon[124666]: pgmap v6592: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 70 KiB/s wr, 7 op/s 2023-05-08T07:08:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12252.840332 secs 2023-05-08T07:08:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12253.398356 secs 2023-05-08T07:08:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12252.840332 secs 2023-05-08T07:08:34.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12253.398356 secs 2023-05-08T07:08:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12252.840332 secs 2023-05-08T07:08:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12253.398356 secs 2023-05-08T07:08:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:35 smithi186 ceph-mon[126480]: pgmap v6593: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 64 KiB/s wr, 6 op/s 2023-05-08T07:08:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:35 smithi133 ceph-mon[125939]: pgmap v6593: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 64 KiB/s wr, 6 op/s 2023-05-08T07:08:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:35 smithi096 ceph-mon[124666]: pgmap v6593: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 64 KiB/s wr, 6 op/s 2023-05-08T07:08:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12254.680385 secs 2023-05-08T07:08:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12254.680385 secs 2023-05-08T07:08:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12254.680385 secs 2023-05-08T07:08:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:37 smithi186 ceph-mon[126480]: pgmap v6594: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 95 KiB/s wr, 9 op/s 2023-05-08T07:08:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:37 smithi133 ceph-mon[125939]: pgmap v6594: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 95 KiB/s wr, 9 op/s 2023-05-08T07:08:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:37 smithi096 ceph-mon[124666]: pgmap v6594: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 95 KiB/s wr, 9 op/s 2023-05-08T07:08:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:38 smithi186 ceph-mon[126480]: pgmap v6595: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 63 KiB/s wr, 6 op/s 2023-05-08T07:08:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:38 smithi133 ceph-mon[125939]: pgmap v6595: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 63 KiB/s wr, 6 op/s 2023-05-08T07:08:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:38 smithi096 ceph-mon[124666]: pgmap v6595: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 63 KiB/s wr, 6 op/s 2023-05-08T07:08:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12257.840405 secs 2023-05-08T07:08:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12258.398481 secs 2023-05-08T07:08:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12257.840405 secs 2023-05-08T07:08:39.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12258.398481 secs 2023-05-08T07:08:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12257.840405 secs 2023-05-08T07:08:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12258.398481 secs 2023-05-08T07:08:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:40 smithi186 ceph-mon[126480]: pgmap v6596: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 96 KiB/s wr, 10 op/s 2023-05-08T07:08:40.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:40 smithi133 ceph-mon[125939]: pgmap v6596: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 96 KiB/s wr, 10 op/s 2023-05-08T07:08:41.060 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:40 smithi096 ceph-mon[124666]: pgmap v6596: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 96 KiB/s wr, 10 op/s 2023-05-08T07:08:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12259.680503 secs 2023-05-08T07:08:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12259.680503 secs 2023-05-08T07:08:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12259.680503 secs 2023-05-08T07:08:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:42 smithi186 ceph-mon[126480]: pgmap v6597: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 64 KiB/s wr, 6 op/s 2023-05-08T07:08:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:08:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:08:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:08:42.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:42 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:08:42.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:08:42.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:42 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T07:08:42.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:42 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T07:08:42.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:42 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:08:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:42 smithi133 ceph-mon[125939]: pgmap v6597: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 64 KiB/s wr, 6 op/s 2023-05-08T07:08:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:08:42.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:08:42.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:08:42.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:42 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:08:42.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:08:42.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:42 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T07:08:42.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:42 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T07:08:42.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:42 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:08:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:42 smithi096 ceph-mon[124666]: pgmap v6597: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 64 KiB/s wr, 6 op/s 2023-05-08T07:08:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:08:43.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:08:43.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:08:43.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:42 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:08:43.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:08:43.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:42 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T07:08:43.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:42 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T07:08:43.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:42 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:08:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12262.840525 secs 2023-05-08T07:08:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:44 smithi186 ceph-mon[126480]: pgmap v6598: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 64 KiB/s wr, 6 op/s 2023-05-08T07:08:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12262.840525 secs 2023-05-08T07:08:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:44 smithi133 ceph-mon[125939]: pgmap v6598: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 64 KiB/s wr, 6 op/s 2023-05-08T07:08:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12262.840525 secs 2023-05-08T07:08:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:44 smithi096 ceph-mon[124666]: pgmap v6598: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 64 KiB/s wr, 6 op/s 2023-05-08T07:08:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12264.680661 secs 2023-05-08T07:08:46.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12264.680661 secs 2023-05-08T07:08:46.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12264.680661 secs 2023-05-08T07:08:47.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:46 smithi186 ceph-mon[126480]: pgmap v6599: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 167 KiB/s wr, 11 op/s 2023-05-08T07:08:47.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:46 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:08:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:46 smithi133 ceph-mon[125939]: pgmap v6599: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 167 KiB/s wr, 11 op/s 2023-05-08T07:08:47.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:46 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:08:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:46 smithi096 ceph-mon[124666]: pgmap v6599: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 167 KiB/s wr, 11 op/s 2023-05-08T07:08:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:46 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:08:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:47 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:08:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:47 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:08:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:47 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:08:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:47 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:08:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:47 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:08:48.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:47 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:08:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:47 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:08:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:47 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:08:48.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:47 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:08:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:48 smithi133 ceph-mon[125939]: pgmap v6600: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 136 KiB/s wr, 8 op/s 2023-05-08T07:08:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12267.840641 secs 2023-05-08T07:08:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:48 smithi096 ceph-mon[124666]: pgmap v6600: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 136 KiB/s wr, 8 op/s 2023-05-08T07:08:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12267.840641 secs 2023-05-08T07:08:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:48 smithi186 ceph-mon[126480]: pgmap v6600: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 136 KiB/s wr, 8 op/s 2023-05-08T07:08:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12267.840641 secs 2023-05-08T07:08:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:50 smithi133 ceph-mon[125939]: pgmap v6601: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 290 KiB/s rd, 287 KiB/s wr, 15 op/s 2023-05-08T07:08:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:50 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:08:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:50 smithi096 ceph-mon[124666]: pgmap v6601: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 290 KiB/s rd, 287 KiB/s wr, 15 op/s 2023-05-08T07:08:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:50 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:08:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:50 smithi186 ceph-mon[126480]: pgmap v6601: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 290 KiB/s rd, 287 KiB/s wr, 15 op/s 2023-05-08T07:08:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:50 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:08:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:08:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:08:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:08:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:08:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:08:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:08:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:52 smithi133 ceph-mon[125939]: pgmap v6602: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 254 KiB/s wr, 12 op/s 2023-05-08T07:08:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:52 smithi096 ceph-mon[124666]: pgmap v6602: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 254 KiB/s wr, 12 op/s 2023-05-08T07:08:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:52 smithi186 ceph-mon[126480]: pgmap v6602: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 254 KiB/s wr, 12 op/s 2023-05-08T07:08:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12272.840759 secs 2023-05-08T07:08:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12272.840759 secs 2023-05-08T07:08:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12272.840759 secs 2023-05-08T07:08:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12273.398797 secs 2023-05-08T07:08:55.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:54 smithi133 ceph-mon[125939]: pgmap v6603: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 254 KiB/s wr, 12 op/s 2023-05-08T07:08:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12273.398797 secs 2023-05-08T07:08:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:54 smithi096 ceph-mon[124666]: pgmap v6603: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 254 KiB/s wr, 12 op/s 2023-05-08T07:08:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12273.398797 secs 2023-05-08T07:08:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:54 smithi186 ceph-mon[126480]: pgmap v6603: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 254 KiB/s wr, 12 op/s 2023-05-08T07:08:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:55 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:08:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:55 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:08:56.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:55 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:08:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:55 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:08:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:55 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:08:56.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:55 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:08:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:55 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:08:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:55 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:08:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:55 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:08:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:56 smithi133 ceph-mon[125939]: pgmap v6604: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 325 KiB/s wr, 17 op/s 2023-05-08T07:08:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:56 smithi096 ceph-mon[124666]: pgmap v6604: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 325 KiB/s wr, 17 op/s 2023-05-08T07:08:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:56 smithi186 ceph-mon[126480]: pgmap v6604: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 325 KiB/s wr, 17 op/s 2023-05-08T07:08:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:58 smithi133 ceph-mon[125939]: pgmap v6605: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 222 KiB/s wr, 13 op/s 2023-05-08T07:08:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12277.840874 secs 2023-05-08T07:08:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:58 smithi096 ceph-mon[124666]: pgmap v6605: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 222 KiB/s wr, 13 op/s 2023-05-08T07:08:59.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12277.840874 secs 2023-05-08T07:08:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:58 smithi186 ceph-mon[126480]: pgmap v6605: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 222 KiB/s wr, 13 op/s 2023-05-08T07:08:59.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12277.840874 secs 2023-05-08T07:09:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:08:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12278.398886 secs 2023-05-08T07:09:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:08:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12278.398886 secs 2023-05-08T07:09:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:08:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12278.398886 secs 2023-05-08T07:09:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:00 smithi133 ceph-mon[125939]: pgmap v6606: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 382 KiB/s wr, 20 op/s 2023-05-08T07:09:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12279.681059 secs 2023-05-08T07:09:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:00 smithi096 ceph-mon[124666]: pgmap v6606: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 382 KiB/s wr, 20 op/s 2023-05-08T07:09:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12279.681059 secs 2023-05-08T07:09:01.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:00 smithi186 ceph-mon[126480]: pgmap v6606: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 382 KiB/s wr, 20 op/s 2023-05-08T07:09:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12279.681059 secs 2023-05-08T07:09:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:02 smithi133 ceph-mon[125939]: pgmap v6607: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 231 KiB/s wr, 12 op/s 2023-05-08T07:09:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:02 smithi096 ceph-mon[124666]: pgmap v6607: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 231 KiB/s wr, 12 op/s 2023-05-08T07:09:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:02 smithi186 ceph-mon[126480]: pgmap v6607: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 231 KiB/s wr, 12 op/s 2023-05-08T07:09:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:03 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:09:04.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:09:04.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:03 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:09:04.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12282.840993 secs 2023-05-08T07:09:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:03 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:09:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:09:04.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:03 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:09:04.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12282.840993 secs 2023-05-08T07:09:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:03 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:09:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:09:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:03 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:09:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12282.840993 secs 2023-05-08T07:09:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12283.399001 secs 2023-05-08T07:09:05.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:04 smithi133 ceph-mon[125939]: pgmap v6608: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 230 KiB/s wr, 12 op/s 2023-05-08T07:09:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12283.399001 secs 2023-05-08T07:09:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:04 smithi096 ceph-mon[124666]: pgmap v6608: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 230 KiB/s wr, 12 op/s 2023-05-08T07:09:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12283.399001 secs 2023-05-08T07:09:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:04 smithi186 ceph-mon[126480]: pgmap v6608: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 230 KiB/s wr, 12 op/s 2023-05-08T07:09:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:06 smithi133 ceph-mon[125939]: pgmap v6609: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 387 KiB/s wr, 32 op/s 2023-05-08T07:09:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:09:07.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:06 smithi133 ceph-mon[125939]: osdmap e490: 12 total, 12 up, 12 in 2023-05-08T07:09:07.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:06 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:09:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:06 smithi096 ceph-mon[124666]: pgmap v6609: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 387 KiB/s wr, 32 op/s 2023-05-08T07:09:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:09:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:06 smithi096 ceph-mon[124666]: osdmap e490: 12 total, 12 up, 12 in 2023-05-08T07:09:07.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:06 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:09:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:06 smithi186 ceph-mon[126480]: pgmap v6609: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 387 KiB/s wr, 32 op/s 2023-05-08T07:09:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:09:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:06 smithi186 ceph-mon[126480]: osdmap e490: 12 total, 12 up, 12 in 2023-05-08T07:09:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:06 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:09:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:07 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:09:08.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:07 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:09:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:07 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:09:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:07 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:09:08.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:07 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:09:08.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:07 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:09:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:08 smithi133 ceph-mon[125939]: pgmap v6611: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 379 KiB/s wr, 32 op/s 2023-05-08T07:09:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12287.841113 secs 2023-05-08T07:09:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:08 smithi096 ceph-mon[124666]: pgmap v6611: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 379 KiB/s wr, 32 op/s 2023-05-08T07:09:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12287.841113 secs 2023-05-08T07:09:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:08 smithi186 ceph-mon[126480]: pgmap v6611: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 379 KiB/s wr, 32 op/s 2023-05-08T07:09:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12287.841113 secs 2023-05-08T07:09:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:09:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:09:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:09:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:10 smithi133 ceph-mon[125939]: pgmap v6612: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 398 KiB/s wr, 33 op/s 2023-05-08T07:09:11.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12289.681324 secs 2023-05-08T07:09:11.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:10 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:09:11.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:10 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:09:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:10 smithi096 ceph-mon[124666]: pgmap v6612: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 398 KiB/s wr, 33 op/s 2023-05-08T07:09:11.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12289.681324 secs 2023-05-08T07:09:11.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:10 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:09:11.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:10 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:09:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:10 smithi186 ceph-mon[126480]: pgmap v6612: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 398 KiB/s wr, 33 op/s 2023-05-08T07:09:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12289.681324 secs 2023-05-08T07:09:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:10 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:09:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:10 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:09:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:11 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:09:12.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:11 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:09:12.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:11 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:09:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:11 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:09:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:11 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:09:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:11 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:09:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:11 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:09:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:11 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:09:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:11 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:09:13.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:12 smithi133 ceph-mon[125939]: pgmap v6613: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 405 KiB/s wr, 33 op/s 2023-05-08T07:09:13.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:12 smithi096 ceph-mon[124666]: pgmap v6613: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 405 KiB/s wr, 33 op/s 2023-05-08T07:09:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:12 smithi186 ceph-mon[126480]: pgmap v6613: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 405 KiB/s wr, 33 op/s 2023-05-08T07:09:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12292.841234 secs 2023-05-08T07:09:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12292.841234 secs 2023-05-08T07:09:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12292.841234 secs 2023-05-08T07:09:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12293.399228 secs 2023-05-08T07:09:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:14 smithi096 ceph-mon[124666]: pgmap v6614: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 405 KiB/s wr, 33 op/s 2023-05-08T07:09:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:14 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:09:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12293.399228 secs 2023-05-08T07:09:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:14 smithi186 ceph-mon[126480]: pgmap v6614: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 405 KiB/s wr, 33 op/s 2023-05-08T07:09:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:14 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:09:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12293.399228 secs 2023-05-08T07:09:15.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:14 smithi133 ceph-mon[125939]: pgmap v6614: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 405 KiB/s wr, 33 op/s 2023-05-08T07:09:15.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:14 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:09:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:15 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:09:16.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:15 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:09:16.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:15 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:09:16.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:15 smithi096 ceph-mon[124666]: osdmap e491: 12 total, 12 up, 12 in 2023-05-08T07:09:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:15 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:09:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:15 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:09:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:15 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:09:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:15 smithi186 ceph-mon[126480]: osdmap e491: 12 total, 12 up, 12 in 2023-05-08T07:09:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:15 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:09:16.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:15 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:09:16.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:15 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:09:16.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:15 smithi133 ceph-mon[125939]: osdmap e491: 12 total, 12 up, 12 in 2023-05-08T07:09:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:16 smithi096 ceph-mon[124666]: pgmap v6615: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 280 KiB/s wr, 14 op/s 2023-05-08T07:09:17.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:16 smithi186 ceph-mon[126480]: pgmap v6615: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 280 KiB/s wr, 14 op/s 2023-05-08T07:09:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:16 smithi133 ceph-mon[125939]: pgmap v6615: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 280 KiB/s wr, 14 op/s 2023-05-08T07:09:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:19 smithi096 ceph-mon[124666]: pgmap v6617: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 280 KiB/s wr, 14 op/s 2023-05-08T07:09:19.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12297.841369 secs 2023-05-08T07:09:19.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:19 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:09:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:19 smithi186 ceph-mon[126480]: pgmap v6617: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 280 KiB/s wr, 14 op/s 2023-05-08T07:09:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12297.841369 secs 2023-05-08T07:09:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:19 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:09:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:19 smithi133 ceph-mon[125939]: pgmap v6617: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 280 KiB/s wr, 14 op/s 2023-05-08T07:09:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12297.841369 secs 2023-05-08T07:09:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:19 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:09:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12298.399360 secs 2023-05-08T07:09:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:20 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:09:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:20 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:09:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12298.399360 secs 2023-05-08T07:09:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:20 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:09:20.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:20 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:09:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12298.399360 secs 2023-05-08T07:09:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:20 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:09:20.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:20 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:09:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:21 smithi186 ceph-mon[126480]: pgmap v6618: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 640 KiB/s rd, 643 KiB/s wr, 17 op/s 2023-05-08T07:09:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12299.681580 secs 2023-05-08T07:09:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:21 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:09:21.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:21 smithi133 ceph-mon[125939]: pgmap v6618: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 640 KiB/s rd, 643 KiB/s wr, 17 op/s 2023-05-08T07:09:21.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12299.681580 secs 2023-05-08T07:09:21.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:21 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:09:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:21 smithi096 ceph-mon[124666]: pgmap v6618: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 640 KiB/s rd, 643 KiB/s wr, 17 op/s 2023-05-08T07:09:21.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12299.681580 secs 2023-05-08T07:09:21.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:21 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:09:23.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:23 smithi186 ceph-mon[126480]: pgmap v6619: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 640 KiB/s rd, 637 KiB/s wr, 17 op/s 2023-05-08T07:09:23.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:23 smithi133 ceph-mon[125939]: pgmap v6619: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 640 KiB/s rd, 637 KiB/s wr, 17 op/s 2023-05-08T07:09:23.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:23 smithi096 ceph-mon[124666]: pgmap v6619: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 640 KiB/s rd, 637 KiB/s wr, 17 op/s 2023-05-08T07:09:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:24 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:09:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:24 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:09:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12302.841492 secs 2023-05-08T07:09:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:24 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:09:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:24 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:09:24.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12302.841492 secs 2023-05-08T07:09:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:24 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:09:24.553 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:24 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:09:24.553 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12302.841492 secs 2023-05-08T07:09:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12303.399492 secs 2023-05-08T07:09:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:25 smithi186 ceph-mon[126480]: pgmap v6620: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 640 KiB/s rd, 637 KiB/s wr, 17 op/s 2023-05-08T07:09:25.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12303.399492 secs 2023-05-08T07:09:25.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:25 smithi133 ceph-mon[125939]: pgmap v6620: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 640 KiB/s rd, 637 KiB/s wr, 17 op/s 2023-05-08T07:09:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12303.399492 secs 2023-05-08T07:09:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:25 smithi096 ceph-mon[124666]: pgmap v6620: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 640 KiB/s rd, 637 KiB/s wr, 17 op/s 2023-05-08T07:09:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12304.681716 secs 2023-05-08T07:09:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:26 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:09:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12304.681716 secs 2023-05-08T07:09:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:26 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:09:26.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12304.681716 secs 2023-05-08T07:09:26.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:26 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:09:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:27 smithi186 ceph-mon[126480]: pgmap v6621: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 580 KiB/s rd, 611 KiB/s wr, 17 op/s 2023-05-08T07:09:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:27 smithi133 ceph-mon[125939]: pgmap v6621: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 580 KiB/s rd, 611 KiB/s wr, 17 op/s 2023-05-08T07:09:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:27 smithi096 ceph-mon[124666]: pgmap v6621: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 580 KiB/s rd, 611 KiB/s wr, 17 op/s 2023-05-08T07:09:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:29 smithi186 ceph-mon[126480]: pgmap v6622: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 489 KiB/s rd, 516 KiB/s wr, 14 op/s 2023-05-08T07:09:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12307.841634 secs 2023-05-08T07:09:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:29 smithi133 ceph-mon[125939]: pgmap v6622: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 489 KiB/s rd, 516 KiB/s wr, 14 op/s 2023-05-08T07:09:29.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12307.841634 secs 2023-05-08T07:09:29.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:29 smithi096 ceph-mon[124666]: pgmap v6622: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 489 KiB/s rd, 516 KiB/s wr, 14 op/s 2023-05-08T07:09:29.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12307.841634 secs 2023-05-08T07:09:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12308.399627 secs 2023-05-08T07:09:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12308.399627 secs 2023-05-08T07:09:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12308.399627 secs 2023-05-08T07:09:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:31 smithi186 ceph-mon[126480]: pgmap v6623: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 591 KiB/s rd, 585 KiB/s wr, 19 op/s 2023-05-08T07:09:31.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12309.681858 secs 2023-05-08T07:09:31.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:31 smithi133 ceph-mon[125939]: pgmap v6623: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 591 KiB/s rd, 585 KiB/s wr, 19 op/s 2023-05-08T07:09:31.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12309.681858 secs 2023-05-08T07:09:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:31 smithi096 ceph-mon[124666]: pgmap v6623: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 591 KiB/s rd, 585 KiB/s wr, 19 op/s 2023-05-08T07:09:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12309.681858 secs 2023-05-08T07:09:33.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:33 smithi186 ceph-mon[126480]: pgmap v6624: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 108 KiB/s wr, 9 op/s 2023-05-08T07:09:33.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:33 smithi133 ceph-mon[125939]: pgmap v6624: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 108 KiB/s wr, 9 op/s 2023-05-08T07:09:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:33 smithi096 ceph-mon[124666]: pgmap v6624: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 108 KiB/s wr, 9 op/s 2023-05-08T07:09:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12312.841759 secs 2023-05-08T07:09:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12312.841759 secs 2023-05-08T07:09:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12312.841759 secs 2023-05-08T07:09:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12313.399745 secs 2023-05-08T07:09:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:35 smithi186 ceph-mon[126480]: pgmap v6625: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 108 KiB/s wr, 9 op/s 2023-05-08T07:09:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12313.399745 secs 2023-05-08T07:09:35.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:35 smithi133 ceph-mon[125939]: pgmap v6625: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 108 KiB/s wr, 9 op/s 2023-05-08T07:09:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12313.399745 secs 2023-05-08T07:09:35.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:35 smithi096 ceph-mon[124666]: pgmap v6625: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 108 KiB/s wr, 9 op/s 2023-05-08T07:09:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12314.681973 secs 2023-05-08T07:09:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12314.681973 secs 2023-05-08T07:09:36.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12314.681973 secs 2023-05-08T07:09:37.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:37 smithi186 ceph-mon[126480]: pgmap v6626: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 139 KiB/s wr, 12 op/s 2023-05-08T07:09:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:37 smithi133 ceph-mon[125939]: pgmap v6626: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 139 KiB/s wr, 12 op/s 2023-05-08T07:09:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:37 smithi096 ceph-mon[124666]: pgmap v6626: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 139 KiB/s wr, 12 op/s 2023-05-08T07:09:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:39 smithi186 ceph-mon[126480]: pgmap v6627: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 107 KiB/s wr, 8 op/s 2023-05-08T07:09:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12317.841893 secs 2023-05-08T07:09:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:39 smithi133 ceph-mon[125939]: pgmap v6627: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 107 KiB/s wr, 8 op/s 2023-05-08T07:09:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12317.841893 secs 2023-05-08T07:09:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:39 smithi096 ceph-mon[124666]: pgmap v6627: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 107 KiB/s wr, 8 op/s 2023-05-08T07:09:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12317.841893 secs 2023-05-08T07:09:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12318.399864 secs 2023-05-08T07:09:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12318.399864 secs 2023-05-08T07:09:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12318.399864 secs 2023-05-08T07:09:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:41 smithi186 ceph-mon[126480]: pgmap v6628: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 130 KiB/s wr, 12 op/s 2023-05-08T07:09:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12319.682097 secs 2023-05-08T07:09:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:41 smithi133 ceph-mon[125939]: pgmap v6628: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 130 KiB/s wr, 12 op/s 2023-05-08T07:09:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12319.682097 secs 2023-05-08T07:09:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:41 smithi096 ceph-mon[124666]: pgmap v6628: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 130 KiB/s wr, 12 op/s 2023-05-08T07:09:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12319.682097 secs 2023-05-08T07:09:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:43 smithi186 ceph-mon[126480]: pgmap v6629: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 7 op/s 2023-05-08T07:09:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:43 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:09:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:43 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:09:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:43 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:09:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:43 smithi133 ceph-mon[125939]: pgmap v6629: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 7 op/s 2023-05-08T07:09:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:43 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:09:43.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:43 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:09:43.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:43 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:09:43.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:43 smithi096 ceph-mon[124666]: pgmap v6629: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 7 op/s 2023-05-08T07:09:43.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:43 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:09:43.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:43 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:09:43.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:43 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:09:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12322.842022 secs 2023-05-08T07:09:44.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:44 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:09:44.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:44 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:09:44.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:44 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:09:44.373 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:44 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:09:44.373 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:44 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:09:44.373 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:44 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:09:44.373 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:44 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:09:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12322.842022 secs 2023-05-08T07:09:44.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:44 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:09:44.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:44 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:09:44.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:44 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:09:44.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:44 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:09:44.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:44 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:09:44.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:44 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:09:44.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:44 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:09:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12322.842022 secs 2023-05-08T07:09:44.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:44 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:09:44.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:44 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:09:44.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:44 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:09:44.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:44 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:09:44.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:44 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:09:44.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:44 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:09:44.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:44 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:09:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:45 smithi133 ceph-mon[125939]: pgmap v6630: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 7 op/s 2023-05-08T07:09:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:45 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:09:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:45 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T07:09:45.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:45 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T07:09:45.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:45 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:09:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:45 smithi096 ceph-mon[124666]: pgmap v6630: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 7 op/s 2023-05-08T07:09:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:45 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:09:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:45 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T07:09:45.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:45 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T07:09:45.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:45 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:09:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:45 smithi186 ceph-mon[126480]: pgmap v6630: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 7 op/s 2023-05-08T07:09:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:45 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:09:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:45 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T07:09:45.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:45 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T07:09:45.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:45 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:09:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12324.682217 secs 2023-05-08T07:09:46.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12324.682217 secs 2023-05-08T07:09:46.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12324.682217 secs 2023-05-08T07:09:47.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:47 smithi133 ceph-mon[125939]: pgmap v6631: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 105 KiB/s wr, 11 op/s 2023-05-08T07:09:47.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:09:47.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:47 smithi096 ceph-mon[124666]: pgmap v6631: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 105 KiB/s wr, 11 op/s 2023-05-08T07:09:47.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:09:47.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:47 smithi186 ceph-mon[126480]: pgmap v6631: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 105 KiB/s wr, 11 op/s 2023-05-08T07:09:47.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:09:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:48 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:09:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:09:48.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:09:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:48 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:09:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:09:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:09:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:48 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:09:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:09:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:09:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:49 smithi133 ceph-mon[125939]: pgmap v6632: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 74 KiB/s wr, 7 op/s 2023-05-08T07:09:49.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12327.842162 secs 2023-05-08T07:09:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:49 smithi096 ceph-mon[124666]: pgmap v6632: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 74 KiB/s wr, 7 op/s 2023-05-08T07:09:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12327.842162 secs 2023-05-08T07:09:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:49 smithi186 ceph-mon[126480]: pgmap v6632: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 74 KiB/s wr, 7 op/s 2023-05-08T07:09:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12327.842162 secs 2023-05-08T07:09:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:51 smithi133 ceph-mon[125939]: pgmap v6633: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 167 KiB/s wr, 13 op/s 2023-05-08T07:09:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:09:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:51 smithi096 ceph-mon[124666]: pgmap v6633: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 167 KiB/s wr, 13 op/s 2023-05-08T07:09:51.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:09:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:51 smithi186 ceph-mon[126480]: pgmap v6633: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 167 KiB/s wr, 13 op/s 2023-05-08T07:09:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:09:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:09:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:09:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:09:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:09:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:09:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:09:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:53 smithi133 ceph-mon[125939]: pgmap v6634: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 145 KiB/s wr, 9 op/s 2023-05-08T07:09:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:53 smithi096 ceph-mon[124666]: pgmap v6634: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 145 KiB/s wr, 9 op/s 2023-05-08T07:09:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:53 smithi186 ceph-mon[126480]: pgmap v6634: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 145 KiB/s wr, 9 op/s 2023-05-08T07:09:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12332.842298 secs 2023-05-08T07:09:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12332.842298 secs 2023-05-08T07:09:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12332.842298 secs 2023-05-08T07:09:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12333.400197 secs 2023-05-08T07:09:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:55 smithi133 ceph-mon[125939]: pgmap v6635: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 145 KiB/s wr, 9 op/s 2023-05-08T07:09:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12333.400197 secs 2023-05-08T07:09:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:55 smithi096 ceph-mon[124666]: pgmap v6635: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 145 KiB/s wr, 9 op/s 2023-05-08T07:09:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12333.400197 secs 2023-05-08T07:09:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:55 smithi186 ceph-mon[126480]: pgmap v6635: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 145 KiB/s wr, 9 op/s 2023-05-08T07:09:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:56 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:09:56.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:09:56.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:09:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:56 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:09:56.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:09:56.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:09:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:56 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:09:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:09:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:09:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:57 smithi133 ceph-mon[125939]: pgmap v6636: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 186 KiB/s wr, 13 op/s 2023-05-08T07:09:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:57 smithi096 ceph-mon[124666]: pgmap v6636: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 186 KiB/s wr, 13 op/s 2023-05-08T07:09:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:57 smithi186 ceph-mon[126480]: pgmap v6636: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 186 KiB/s wr, 13 op/s 2023-05-08T07:09:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:59 smithi133 ceph-mon[125939]: pgmap v6637: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 135 KiB/s wr, 9 op/s 2023-05-08T07:09:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:09:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12337.842433 secs 2023-05-08T07:09:59.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:59 smithi096 ceph-mon[124666]: pgmap v6637: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 135 KiB/s wr, 9 op/s 2023-05-08T07:09:59.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:09:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12337.842433 secs 2023-05-08T07:09:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:59 smithi186 ceph-mon[126480]: pgmap v6637: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 135 KiB/s wr, 9 op/s 2023-05-08T07:09:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:09:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12337.842433 secs 2023-05-08T07:10:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12338.400312 secs 2023-05-08T07:10:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:00 smithi133 ceph-mon[125939]: overall HEALTH_WARN 2 MDSs report slow requests 2023-05-08T07:10:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12338.400312 secs 2023-05-08T07:10:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:00 smithi096 ceph-mon[124666]: overall HEALTH_WARN 2 MDSs report slow requests 2023-05-08T07:10:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12338.400312 secs 2023-05-08T07:10:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:00 smithi186 ceph-mon[126480]: overall HEALTH_WARN 2 MDSs report slow requests 2023-05-08T07:10:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:01 smithi133 ceph-mon[125939]: pgmap v6638: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 273 KiB/s wr, 13 op/s 2023-05-08T07:10:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:01 smithi096 ceph-mon[124666]: pgmap v6638: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 273 KiB/s wr, 13 op/s 2023-05-08T07:10:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:01 smithi186 ceph-mon[126480]: pgmap v6638: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 273 KiB/s wr, 13 op/s 2023-05-08T07:10:03.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:03 smithi133 ceph-mon[125939]: pgmap v6639: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 179 KiB/s wr, 8 op/s 2023-05-08T07:10:03.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:03 smithi096 ceph-mon[124666]: pgmap v6639: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 179 KiB/s wr, 8 op/s 2023-05-08T07:10:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:03 smithi186 ceph-mon[126480]: pgmap v6639: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 179 KiB/s wr, 8 op/s 2023-05-08T07:10:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12342.842495 secs 2023-05-08T07:10:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12342.842495 secs 2023-05-08T07:10:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12342.842495 secs 2023-05-08T07:10:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12343.400428 secs 2023-05-08T07:10:05.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:05 smithi133 ceph-mon[125939]: pgmap v6640: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 179 KiB/s wr, 8 op/s 2023-05-08T07:10:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12343.400428 secs 2023-05-08T07:10:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:05 smithi096 ceph-mon[124666]: pgmap v6640: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 179 KiB/s wr, 8 op/s 2023-05-08T07:10:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12343.400428 secs 2023-05-08T07:10:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:05 smithi186 ceph-mon[126480]: pgmap v6640: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 179 KiB/s wr, 8 op/s 2023-05-08T07:10:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12344.682709 secs 2023-05-08T07:10:06.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:06 smithi133 ceph-mon[125939]: osdmap e492: 12 total, 12 up, 12 in 2023-05-08T07:10:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12344.682709 secs 2023-05-08T07:10:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:06 smithi096 ceph-mon[124666]: osdmap e492: 12 total, 12 up, 12 in 2023-05-08T07:10:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12344.682709 secs 2023-05-08T07:10:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:06 smithi186 ceph-mon[126480]: osdmap e492: 12 total, 12 up, 12 in 2023-05-08T07:10:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:07 smithi133 ceph-mon[125939]: pgmap v6642: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 305 KiB/s wr, 28 op/s 2023-05-08T07:10:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:07 smithi096 ceph-mon[124666]: pgmap v6642: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 305 KiB/s wr, 28 op/s 2023-05-08T07:10:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:07 smithi186 ceph-mon[126480]: pgmap v6642: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 305 KiB/s wr, 28 op/s 2023-05-08T07:10:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:08 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:10:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:10:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:10:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:08 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:10:08.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:10:08.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:10:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:08 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:10:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:10:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:10:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:09 smithi133 ceph-mon[125939]: pgmap v6643: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 305 KiB/s wr, 28 op/s 2023-05-08T07:10:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12347.842579 secs 2023-05-08T07:10:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:09 smithi096 ceph-mon[124666]: pgmap v6643: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 305 KiB/s wr, 28 op/s 2023-05-08T07:10:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12347.842579 secs 2023-05-08T07:10:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:09 smithi186 ceph-mon[126480]: pgmap v6643: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 305 KiB/s wr, 28 op/s 2023-05-08T07:10:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12347.842579 secs 2023-05-08T07:10:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12348.400549 secs 2023-05-08T07:10:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12348.400549 secs 2023-05-08T07:10:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12348.400549 secs 2023-05-08T07:10:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:11 smithi133 ceph-mon[125939]: pgmap v6644: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 223 KiB/s wr, 28 op/s 2023-05-08T07:10:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12349.682833 secs 2023-05-08T07:10:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:11 smithi133 ceph-mon[125939]: osdmap e493: 12 total, 12 up, 12 in 2023-05-08T07:10:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:11 smithi096 ceph-mon[124666]: pgmap v6644: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 223 KiB/s wr, 28 op/s 2023-05-08T07:10:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12349.682833 secs 2023-05-08T07:10:11.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:11 smithi096 ceph-mon[124666]: osdmap e493: 12 total, 12 up, 12 in 2023-05-08T07:10:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:11 smithi186 ceph-mon[126480]: pgmap v6644: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 223 KiB/s wr, 28 op/s 2023-05-08T07:10:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12349.682833 secs 2023-05-08T07:10:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:11 smithi186 ceph-mon[126480]: osdmap e493: 12 total, 12 up, 12 in 2023-05-08T07:10:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:13 smithi133 ceph-mon[125939]: pgmap v6646: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 333 KiB/s rd, 279 KiB/s wr, 36 op/s 2023-05-08T07:10:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:13 smithi096 ceph-mon[124666]: pgmap v6646: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 333 KiB/s rd, 279 KiB/s wr, 36 op/s 2023-05-08T07:10:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:13 smithi186 ceph-mon[126480]: pgmap v6646: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 333 KiB/s rd, 279 KiB/s wr, 36 op/s 2023-05-08T07:10:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12352.842693 secs 2023-05-08T07:10:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12352.842693 secs 2023-05-08T07:10:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12352.842693 secs 2023-05-08T07:10:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12353.400669 secs 2023-05-08T07:10:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:15 smithi133 ceph-mon[125939]: pgmap v6647: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 97 KiB/s wr, 6 op/s 2023-05-08T07:10:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12353.400669 secs 2023-05-08T07:10:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:15 smithi096 ceph-mon[124666]: pgmap v6647: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 97 KiB/s wr, 6 op/s 2023-05-08T07:10:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12353.400669 secs 2023-05-08T07:10:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:15 smithi186 ceph-mon[126480]: pgmap v6647: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 97 KiB/s wr, 6 op/s 2023-05-08T07:10:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12354.682952 secs 2023-05-08T07:10:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12354.682952 secs 2023-05-08T07:10:16.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12354.682952 secs 2023-05-08T07:10:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:17 smithi096 ceph-mon[124666]: pgmap v6648: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 151 KiB/s wr, 9 op/s 2023-05-08T07:10:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:17 smithi186 ceph-mon[126480]: pgmap v6648: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 151 KiB/s wr, 9 op/s 2023-05-08T07:10:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:17 smithi133 ceph-mon[125939]: pgmap v6648: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 151 KiB/s wr, 9 op/s 2023-05-08T07:10:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:19 smithi096 ceph-mon[124666]: pgmap v6649: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 151 KiB/s wr, 9 op/s 2023-05-08T07:10:19.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12357.842803 secs 2023-05-08T07:10:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:19 smithi186 ceph-mon[126480]: pgmap v6649: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 151 KiB/s wr, 9 op/s 2023-05-08T07:10:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12357.842803 secs 2023-05-08T07:10:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:19 smithi133 ceph-mon[125939]: pgmap v6649: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 151 KiB/s wr, 9 op/s 2023-05-08T07:10:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12357.842803 secs 2023-05-08T07:10:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12358.400783 secs 2023-05-08T07:10:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12358.400783 secs 2023-05-08T07:10:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12358.400783 secs 2023-05-08T07:10:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:21 smithi096 ceph-mon[124666]: pgmap v6650: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 130 KiB/s wr, 8 op/s 2023-05-08T07:10:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12359.683075 secs 2023-05-08T07:10:21.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:21 smithi186 ceph-mon[126480]: pgmap v6650: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 130 KiB/s wr, 8 op/s 2023-05-08T07:10:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12359.683075 secs 2023-05-08T07:10:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:21 smithi133 ceph-mon[125939]: pgmap v6650: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 130 KiB/s wr, 8 op/s 2023-05-08T07:10:21.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12359.683075 secs 2023-05-08T07:10:23.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:23 smithi096 ceph-mon[124666]: pgmap v6651: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 119 KiB/s wr, 8 op/s 2023-05-08T07:10:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:23 smithi186 ceph-mon[126480]: pgmap v6651: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 119 KiB/s wr, 8 op/s 2023-05-08T07:10:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:23 smithi133 ceph-mon[125939]: pgmap v6651: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 119 KiB/s wr, 8 op/s 2023-05-08T07:10:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12362.842895 secs 2023-05-08T07:10:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12362.842895 secs 2023-05-08T07:10:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12362.842895 secs 2023-05-08T07:10:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12363.400937 secs 2023-05-08T07:10:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:25 smithi186 ceph-mon[126480]: pgmap v6652: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 108 KiB/s wr, 7 op/s 2023-05-08T07:10:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12363.400937 secs 2023-05-08T07:10:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:25 smithi133 ceph-mon[125939]: pgmap v6652: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 108 KiB/s wr, 7 op/s 2023-05-08T07:10:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12363.400937 secs 2023-05-08T07:10:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:25 smithi096 ceph-mon[124666]: pgmap v6652: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 108 KiB/s wr, 7 op/s 2023-05-08T07:10:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12364.683166 secs 2023-05-08T07:10:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12364.683166 secs 2023-05-08T07:10:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12364.683166 secs 2023-05-08T07:10:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:27 smithi186 ceph-mon[126480]: pgmap v6653: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 140 KiB/s wr, 10 op/s 2023-05-08T07:10:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:27 smithi133 ceph-mon[125939]: pgmap v6653: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 140 KiB/s wr, 10 op/s 2023-05-08T07:10:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:27 smithi096 ceph-mon[124666]: pgmap v6653: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 140 KiB/s wr, 10 op/s 2023-05-08T07:10:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:29 smithi186 ceph-mon[126480]: pgmap v6654: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 84 KiB/s wr, 7 op/s 2023-05-08T07:10:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12367.843034 secs 2023-05-08T07:10:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:29 smithi133 ceph-mon[125939]: pgmap v6654: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 84 KiB/s wr, 7 op/s 2023-05-08T07:10:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12367.843034 secs 2023-05-08T07:10:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:29 smithi096 ceph-mon[124666]: pgmap v6654: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 84 KiB/s wr, 7 op/s 2023-05-08T07:10:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12367.843034 secs 2023-05-08T07:10:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12368.401028 secs 2023-05-08T07:10:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12368.401028 secs 2023-05-08T07:10:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12368.401028 secs 2023-05-08T07:10:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:31 smithi186 ceph-mon[126480]: pgmap v6655: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 159 KiB/s wr, 12 op/s 2023-05-08T07:10:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12369.683306 secs 2023-05-08T07:10:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:31 smithi133 ceph-mon[125939]: pgmap v6655: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 159 KiB/s wr, 12 op/s 2023-05-08T07:10:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12369.683306 secs 2023-05-08T07:10:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:31 smithi096 ceph-mon[124666]: pgmap v6655: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 159 KiB/s wr, 12 op/s 2023-05-08T07:10:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12369.683306 secs 2023-05-08T07:10:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:33 smithi186 ceph-mon[126480]: pgmap v6656: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 107 KiB/s wr, 8 op/s 2023-05-08T07:10:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:33 smithi133 ceph-mon[125939]: pgmap v6656: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 107 KiB/s wr, 8 op/s 2023-05-08T07:10:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:33 smithi096 ceph-mon[124666]: pgmap v6656: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 107 KiB/s wr, 8 op/s 2023-05-08T07:10:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12372.843173 secs 2023-05-08T07:10:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12372.843173 secs 2023-05-08T07:10:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12372.843173 secs 2023-05-08T07:10:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12373.401144 secs 2023-05-08T07:10:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:35 smithi186 ceph-mon[126480]: pgmap v6657: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 107 KiB/s wr, 8 op/s 2023-05-08T07:10:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12373.401144 secs 2023-05-08T07:10:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:35 smithi133 ceph-mon[125939]: pgmap v6657: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 107 KiB/s wr, 8 op/s 2023-05-08T07:10:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12373.401144 secs 2023-05-08T07:10:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:35 smithi096 ceph-mon[124666]: pgmap v6657: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 107 KiB/s wr, 8 op/s 2023-05-08T07:10:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:37 smithi133 ceph-mon[125939]: pgmap v6658: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 157 KiB/s wr, 13 op/s 2023-05-08T07:10:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:37 smithi186 ceph-mon[126480]: pgmap v6658: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 157 KiB/s wr, 13 op/s 2023-05-08T07:10:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:37 smithi096 ceph-mon[124666]: pgmap v6658: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 157 KiB/s wr, 13 op/s 2023-05-08T07:10:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:39 smithi186 ceph-mon[126480]: pgmap v6659: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 125 KiB/s wr, 10 op/s 2023-05-08T07:10:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12377.843289 secs 2023-05-08T07:10:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:39 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:10:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:39 smithi133 ceph-mon[125939]: pgmap v6659: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 125 KiB/s wr, 10 op/s 2023-05-08T07:10:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12377.843289 secs 2023-05-08T07:10:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:39 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:10:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:39 smithi096 ceph-mon[124666]: pgmap v6659: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 125 KiB/s wr, 10 op/s 2023-05-08T07:10:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12377.843289 secs 2023-05-08T07:10:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:39 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:10:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12378.401263 secs 2023-05-08T07:10:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:40 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:10:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:40 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:10:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:40 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:10:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12378.401263 secs 2023-05-08T07:10:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:40 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:10:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:40 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:10:40.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:40 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:10:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12378.401263 secs 2023-05-08T07:10:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:40 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:10:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:40 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:10:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:40 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:10:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:41 smithi186 ceph-mon[126480]: pgmap v6660: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 201 KiB/s wr, 14 op/s 2023-05-08T07:10:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:41 smithi133 ceph-mon[125939]: pgmap v6660: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 201 KiB/s wr, 14 op/s 2023-05-08T07:10:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:41 smithi096 ceph-mon[124666]: pgmap v6660: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 201 KiB/s wr, 14 op/s 2023-05-08T07:10:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:43 smithi186 ceph-mon[126480]: pgmap v6661: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 126 KiB/s wr, 9 op/s 2023-05-08T07:10:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:43 smithi133 ceph-mon[125939]: pgmap v6661: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 126 KiB/s wr, 9 op/s 2023-05-08T07:10:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:43 smithi096 ceph-mon[124666]: pgmap v6661: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 126 KiB/s wr, 9 op/s 2023-05-08T07:10:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12382.843373 secs 2023-05-08T07:10:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:44 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:10:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12382.843373 secs 2023-05-08T07:10:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:44 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:10:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12382.843373 secs 2023-05-08T07:10:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:44 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:10:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:45 smithi186 ceph-mon[126480]: pgmap v6662: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 126 KiB/s wr, 9 op/s 2023-05-08T07:10:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:10:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:10:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:45 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:10:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:10:45.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:45 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T07:10:45.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:45 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T07:10:45.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:45 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:10:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:45 smithi133 ceph-mon[125939]: pgmap v6662: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 126 KiB/s wr, 9 op/s 2023-05-08T07:10:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:10:45.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:10:45.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:45 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:10:45.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:10:45.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:45 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T07:10:45.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:45 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T07:10:45.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:45 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:10:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:45 smithi096 ceph-mon[124666]: pgmap v6662: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 126 KiB/s wr, 9 op/s 2023-05-08T07:10:45.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:10:45.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:10:45.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:45 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:10:45.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:10:45.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:45 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T07:10:45.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:45 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T07:10:45.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:45 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:10:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:47 smithi186 ceph-mon[126480]: pgmap v6663: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 165 KiB/s wr, 14 op/s 2023-05-08T07:10:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:10:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:47 smithi133 ceph-mon[125939]: pgmap v6663: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 165 KiB/s wr, 14 op/s 2023-05-08T07:10:47.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:10:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:47 smithi096 ceph-mon[124666]: pgmap v6663: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 165 KiB/s wr, 14 op/s 2023-05-08T07:10:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:10:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:48 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:10:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:10:48.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:10:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:48 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:10:48.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:10:48.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:10:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:48 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:10:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:10:48.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:10:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:49 smithi186 ceph-mon[126480]: pgmap v6664: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 115 KiB/s wr, 9 op/s 2023-05-08T07:10:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12387.843490 secs 2023-05-08T07:10:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:49 smithi133 ceph-mon[125939]: pgmap v6664: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 115 KiB/s wr, 9 op/s 2023-05-08T07:10:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12387.843490 secs 2023-05-08T07:10:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:49 smithi096 ceph-mon[124666]: pgmap v6664: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 115 KiB/s wr, 9 op/s 2023-05-08T07:10:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12387.843490 secs 2023-05-08T07:10:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12388.401477 secs 2023-05-08T07:10:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12388.401477 secs 2023-05-08T07:10:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12388.401477 secs 2023-05-08T07:10:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:51 smithi186 ceph-mon[126480]: pgmap v6665: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 220 KiB/s wr, 13 op/s 2023-05-08T07:10:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:51 smithi133 ceph-mon[125939]: pgmap v6665: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 220 KiB/s wr, 13 op/s 2023-05-08T07:10:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:51 smithi096 ceph-mon[124666]: pgmap v6665: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 220 KiB/s wr, 13 op/s 2023-05-08T07:10:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:10:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:10:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:10:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:10:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:10:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:10:53.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:53 smithi186 ceph-mon[126480]: pgmap v6666: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 144 KiB/s wr, 9 op/s 2023-05-08T07:10:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:53 smithi133 ceph-mon[125939]: pgmap v6666: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 144 KiB/s wr, 9 op/s 2023-05-08T07:10:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:53 smithi096 ceph-mon[124666]: pgmap v6666: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 144 KiB/s wr, 9 op/s 2023-05-08T07:10:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12392.843573 secs 2023-05-08T07:10:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12392.843573 secs 2023-05-08T07:10:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12392.843573 secs 2023-05-08T07:10:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:55 smithi186 ceph-mon[126480]: pgmap v6667: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 144 KiB/s wr, 9 op/s 2023-05-08T07:10:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:55 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:10:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:55 smithi133 ceph-mon[125939]: pgmap v6667: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 144 KiB/s wr, 9 op/s 2023-05-08T07:10:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:55 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:10:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:55 smithi096 ceph-mon[124666]: pgmap v6667: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 144 KiB/s wr, 9 op/s 2023-05-08T07:10:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:55 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:10:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12394.683841 secs 2023-05-08T07:10:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:56 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:10:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:10:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:10:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12394.683841 secs 2023-05-08T07:10:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:56 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:10:56.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:10:56.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:10:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12394.683841 secs 2023-05-08T07:10:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:56 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:10:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:10:56.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:10:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:57 smithi133 ceph-mon[125939]: pgmap v6668: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 226 KiB/s wr, 14 op/s 2023-05-08T07:10:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:57 smithi096 ceph-mon[124666]: pgmap v6668: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 226 KiB/s wr, 14 op/s 2023-05-08T07:10:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:57 smithi186 ceph-mon[126480]: pgmap v6668: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 226 KiB/s wr, 14 op/s 2023-05-08T07:10:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:59 smithi133 ceph-mon[125939]: pgmap v6669: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 187 KiB/s wr, 9 op/s 2023-05-08T07:10:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12397.843683 secs 2023-05-08T07:10:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:10:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12398.401694 secs 2023-05-08T07:10:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:59 smithi096 ceph-mon[124666]: pgmap v6669: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 187 KiB/s wr, 9 op/s 2023-05-08T07:10:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12397.843683 secs 2023-05-08T07:10:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:10:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12398.401694 secs 2023-05-08T07:10:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:59 smithi186 ceph-mon[126480]: pgmap v6669: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 187 KiB/s wr, 9 op/s 2023-05-08T07:10:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12397.843683 secs 2023-05-08T07:10:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:10:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12398.401694 secs 2023-05-08T07:11:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:11:00.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:11:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:11:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:11:00.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:11:00.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:11:01.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:01 smithi133 ceph-mon[125939]: pgmap v6670: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 277 KiB/s wr, 13 op/s 2023-05-08T07:11:01.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12399.683961 secs 2023-05-08T07:11:01.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:01 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:11:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:01 smithi096 ceph-mon[124666]: pgmap v6670: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 277 KiB/s wr, 13 op/s 2023-05-08T07:11:01.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12399.683961 secs 2023-05-08T07:11:01.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:01 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:11:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:01 smithi186 ceph-mon[126480]: pgmap v6670: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 277 KiB/s wr, 13 op/s 2023-05-08T07:11:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12399.683961 secs 2023-05-08T07:11:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:01 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:11:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:03 smithi133 ceph-mon[125939]: pgmap v6671: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 172 KiB/s wr, 9 op/s 2023-05-08T07:11:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:03 smithi096 ceph-mon[124666]: pgmap v6671: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 172 KiB/s wr, 9 op/s 2023-05-08T07:11:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:03 smithi186 ceph-mon[126480]: pgmap v6671: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 172 KiB/s wr, 9 op/s 2023-05-08T07:11:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12402.843809 secs 2023-05-08T07:11:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:04 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:11:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:04 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:11:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12403.401769 secs 2023-05-08T07:11:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12402.843809 secs 2023-05-08T07:11:04.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:04 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:11:04.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:04 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:11:04.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12403.401769 secs 2023-05-08T07:11:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12402.843809 secs 2023-05-08T07:11:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:04 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:11:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:04 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:11:04.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12403.401769 secs 2023-05-08T07:11:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:05 smithi133 ceph-mon[125939]: pgmap v6672: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 172 KiB/s wr, 9 op/s 2023-05-08T07:11:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:05 smithi096 ceph-mon[124666]: pgmap v6672: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 172 KiB/s wr, 9 op/s 2023-05-08T07:11:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:05 smithi186 ceph-mon[126480]: pgmap v6672: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 172 KiB/s wr, 9 op/s 2023-05-08T07:11:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12404.684079 secs 2023-05-08T07:11:06.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:06 smithi133 ceph-mon[125939]: osdmap e494: 12 total, 12 up, 12 in 2023-05-08T07:11:06.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:06 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:11:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12404.684079 secs 2023-05-08T07:11:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:06 smithi096 ceph-mon[124666]: osdmap e494: 12 total, 12 up, 12 in 2023-05-08T07:11:06.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:06 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:11:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12404.684079 secs 2023-05-08T07:11:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:06 smithi186 ceph-mon[126480]: osdmap e494: 12 total, 12 up, 12 in 2023-05-08T07:11:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:06 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:11:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:07 smithi133 ceph-mon[125939]: pgmap v6674: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 233 KiB/s wr, 27 op/s 2023-05-08T07:11:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:07 smithi096 ceph-mon[124666]: pgmap v6674: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 233 KiB/s wr, 27 op/s 2023-05-08T07:11:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:07 smithi186 ceph-mon[126480]: pgmap v6674: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 233 KiB/s wr, 27 op/s 2023-05-08T07:11:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:09 smithi133 ceph-mon[125939]: pgmap v6675: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 233 KiB/s wr, 27 op/s 2023-05-08T07:11:09.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12407.843953 secs 2023-05-08T07:11:09.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12408.401912 secs 2023-05-08T07:11:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:09 smithi096 ceph-mon[124666]: pgmap v6675: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 233 KiB/s wr, 27 op/s 2023-05-08T07:11:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12407.843953 secs 2023-05-08T07:11:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12408.401912 secs 2023-05-08T07:11:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:09 smithi186 ceph-mon[126480]: pgmap v6675: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 233 KiB/s wr, 27 op/s 2023-05-08T07:11:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12407.843953 secs 2023-05-08T07:11:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12408.401912 secs 2023-05-08T07:11:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:11 smithi133 ceph-mon[125939]: pgmap v6676: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 130 KiB/s wr, 25 op/s 2023-05-08T07:11:11.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12409.684196 secs 2023-05-08T07:11:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:11 smithi096 ceph-mon[124666]: pgmap v6676: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 130 KiB/s wr, 25 op/s 2023-05-08T07:11:11.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12409.684196 secs 2023-05-08T07:11:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:11 smithi186 ceph-mon[126480]: pgmap v6676: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 130 KiB/s wr, 25 op/s 2023-05-08T07:11:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12409.684196 secs 2023-05-08T07:11:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:13 smithi133 ceph-mon[125939]: pgmap v6677: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 130 KiB/s wr, 25 op/s 2023-05-08T07:11:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:13 smithi096 ceph-mon[124666]: pgmap v6677: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 130 KiB/s wr, 25 op/s 2023-05-08T07:11:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:13 smithi186 ceph-mon[126480]: pgmap v6677: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 130 KiB/s wr, 25 op/s 2023-05-08T07:11:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12412.844071 secs 2023-05-08T07:11:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12413.402064 secs 2023-05-08T07:11:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12412.844071 secs 2023-05-08T07:11:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12413.402064 secs 2023-05-08T07:11:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12412.844071 secs 2023-05-08T07:11:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12413.402064 secs 2023-05-08T07:11:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:15 smithi133 ceph-mon[125939]: pgmap v6678: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 130 KiB/s wr, 25 op/s 2023-05-08T07:11:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:15 smithi096 ceph-mon[124666]: pgmap v6678: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 130 KiB/s wr, 25 op/s 2023-05-08T07:11:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:15 smithi186 ceph-mon[126480]: pgmap v6678: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 130 KiB/s wr, 25 op/s 2023-05-08T07:11:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12414.684315 secs 2023-05-08T07:11:16.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:16 smithi133 ceph-mon[125939]: osdmap e495: 12 total, 12 up, 12 in 2023-05-08T07:11:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12414.684315 secs 2023-05-08T07:11:16.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:16 smithi096 ceph-mon[124666]: osdmap e495: 12 total, 12 up, 12 in 2023-05-08T07:11:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12414.684315 secs 2023-05-08T07:11:16.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:16 smithi186 ceph-mon[126480]: osdmap e495: 12 total, 12 up, 12 in 2023-05-08T07:11:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:17 smithi133 ceph-mon[125939]: pgmap v6679: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 KiB/s wr, 8 op/s 2023-05-08T07:11:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:17 smithi096 ceph-mon[124666]: pgmap v6679: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 KiB/s wr, 8 op/s 2023-05-08T07:11:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:17 smithi186 ceph-mon[126480]: pgmap v6679: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 KiB/s wr, 8 op/s 2023-05-08T07:11:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:19 smithi133 ceph-mon[125939]: pgmap v6681: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 39 KiB/s wr, 8 op/s 2023-05-08T07:11:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12417.844195 secs 2023-05-08T07:11:19.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12418.402198 secs 2023-05-08T07:11:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:19 smithi096 ceph-mon[124666]: pgmap v6681: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 39 KiB/s wr, 8 op/s 2023-05-08T07:11:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12417.844195 secs 2023-05-08T07:11:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12418.402198 secs 2023-05-08T07:11:19.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:19 smithi186 ceph-mon[126480]: pgmap v6681: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 39 KiB/s wr, 8 op/s 2023-05-08T07:11:19.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12417.844195 secs 2023-05-08T07:11:19.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12418.402198 secs 2023-05-08T07:11:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:21 smithi133 ceph-mon[125939]: pgmap v6682: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 72 KiB/s wr, 8 op/s 2023-05-08T07:11:21.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12419.684434 secs 2023-05-08T07:11:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:21 smithi096 ceph-mon[124666]: pgmap v6682: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 72 KiB/s wr, 8 op/s 2023-05-08T07:11:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12419.684434 secs 2023-05-08T07:11:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:21 smithi186 ceph-mon[126480]: pgmap v6682: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 72 KiB/s wr, 8 op/s 2023-05-08T07:11:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12419.684434 secs 2023-05-08T07:11:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:23 smithi133 ceph-mon[125939]: pgmap v6683: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 72 KiB/s wr, 8 op/s 2023-05-08T07:11:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:23 smithi096 ceph-mon[124666]: pgmap v6683: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 72 KiB/s wr, 8 op/s 2023-05-08T07:11:23.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:23 smithi186 ceph-mon[126480]: pgmap v6683: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 72 KiB/s wr, 8 op/s 2023-05-08T07:11:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12422.844296 secs 2023-05-08T07:11:24.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12423.402338 secs 2023-05-08T07:11:24.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12422.844296 secs 2023-05-08T07:11:24.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12423.402338 secs 2023-05-08T07:11:24.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12422.844296 secs 2023-05-08T07:11:24.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12423.402338 secs 2023-05-08T07:11:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:25 smithi133 ceph-mon[125939]: pgmap v6684: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 72 KiB/s wr, 8 op/s 2023-05-08T07:11:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:25 smithi096 ceph-mon[124666]: pgmap v6684: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 72 KiB/s wr, 8 op/s 2023-05-08T07:11:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:25 smithi186 ceph-mon[126480]: pgmap v6684: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 72 KiB/s wr, 8 op/s 2023-05-08T07:11:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12424.684552 secs 2023-05-08T07:11:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12424.684552 secs 2023-05-08T07:11:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12424.684552 secs 2023-05-08T07:11:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:27 smithi133 ceph-mon[125939]: pgmap v6685: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 39 KiB/s wr, 8 op/s 2023-05-08T07:11:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:27 smithi096 ceph-mon[124666]: pgmap v6685: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 39 KiB/s wr, 8 op/s 2023-05-08T07:11:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:27 smithi186 ceph-mon[126480]: pgmap v6685: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 39 KiB/s wr, 8 op/s 2023-05-08T07:11:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:29 smithi133 ceph-mon[125939]: pgmap v6686: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T07:11:29.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12427.844428 secs 2023-05-08T07:11:29.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12428.402460 secs 2023-05-08T07:11:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:29 smithi096 ceph-mon[124666]: pgmap v6686: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T07:11:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12427.844428 secs 2023-05-08T07:11:29.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12428.402460 secs 2023-05-08T07:11:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:29 smithi186 ceph-mon[126480]: pgmap v6686: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T07:11:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12427.844428 secs 2023-05-08T07:11:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12428.402460 secs 2023-05-08T07:11:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:31 smithi133 ceph-mon[125939]: pgmap v6687: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 65 KiB/s wr, 10 op/s 2023-05-08T07:11:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12429.684672 secs 2023-05-08T07:11:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:31 smithi096 ceph-mon[124666]: pgmap v6687: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 65 KiB/s wr, 10 op/s 2023-05-08T07:11:31.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12429.684672 secs 2023-05-08T07:11:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:31 smithi186 ceph-mon[126480]: pgmap v6687: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 65 KiB/s wr, 10 op/s 2023-05-08T07:11:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12429.684672 secs 2023-05-08T07:11:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:33 smithi133 ceph-mon[125939]: pgmap v6688: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T07:11:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:33 smithi096 ceph-mon[124666]: pgmap v6688: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T07:11:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:33 smithi186 ceph-mon[126480]: pgmap v6688: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T07:11:34.485 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12432.844544 secs 2023-05-08T07:11:34.486 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12433.402591 secs 2023-05-08T07:11:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12432.844544 secs 2023-05-08T07:11:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12433.402591 secs 2023-05-08T07:11:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12432.844544 secs 2023-05-08T07:11:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12433.402591 secs 2023-05-08T07:11:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:35 smithi133 ceph-mon[125939]: pgmap v6689: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T07:11:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:35 smithi096 ceph-mon[124666]: pgmap v6689: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T07:11:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:35 smithi186 ceph-mon[126480]: pgmap v6689: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T07:11:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:37 smithi133 ceph-mon[125939]: pgmap v6690: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 33 KiB/s wr, 9 op/s 2023-05-08T07:11:37.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:37 smithi096 ceph-mon[124666]: pgmap v6690: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 33 KiB/s wr, 9 op/s 2023-05-08T07:11:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:37 smithi186 ceph-mon[126480]: pgmap v6690: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 33 KiB/s wr, 9 op/s 2023-05-08T07:11:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:39 smithi096 ceph-mon[124666]: pgmap v6691: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T07:11:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12437.844662 secs 2023-05-08T07:11:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:39 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:11:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12438.402719 secs 2023-05-08T07:11:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:39 smithi186 ceph-mon[126480]: pgmap v6691: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T07:11:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12437.844662 secs 2023-05-08T07:11:39.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:39 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:11:39.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12438.402719 secs 2023-05-08T07:11:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:39 smithi133 ceph-mon[125939]: pgmap v6691: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T07:11:39.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12437.844662 secs 2023-05-08T07:11:39.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:39 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:11:39.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12438.402719 secs 2023-05-08T07:11:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:40 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:11:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:40 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:11:40.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:40 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:11:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:40 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:11:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:40 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:11:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:40 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:11:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:40 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:11:40.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:40 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:11:40.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:40 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:11:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:41 smithi186 ceph-mon[126480]: pgmap v6692: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 65 KiB/s wr, 9 op/s 2023-05-08T07:11:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:41 smithi133 ceph-mon[125939]: pgmap v6692: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 65 KiB/s wr, 9 op/s 2023-05-08T07:11:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:41 smithi096 ceph-mon[124666]: pgmap v6692: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 65 KiB/s wr, 9 op/s 2023-05-08T07:11:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:43 smithi186 ceph-mon[126480]: pgmap v6693: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 5 op/s 2023-05-08T07:11:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:43 smithi133 ceph-mon[125939]: pgmap v6693: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 5 op/s 2023-05-08T07:11:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:43 smithi096 ceph-mon[124666]: pgmap v6693: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 5 op/s 2023-05-08T07:11:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12442.844788 secs 2023-05-08T07:11:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12442.844788 secs 2023-05-08T07:11:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12442.844788 secs 2023-05-08T07:11:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:45 smithi186 ceph-mon[126480]: pgmap v6694: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 5 op/s 2023-05-08T07:11:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:45 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:11:45.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:11:45.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:11:45.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:11:45.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:11:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:45 smithi133 ceph-mon[125939]: pgmap v6694: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 5 op/s 2023-05-08T07:11:45.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:45 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:11:45.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:11:45.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:11:45.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:11:45.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:11:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:45 smithi096 ceph-mon[124666]: pgmap v6694: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 5 op/s 2023-05-08T07:11:46.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:45 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:11:46.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:11:46.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:11:46.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:11:46.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:11:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:46 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:11:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:46 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T07:11:46.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:46 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T07:11:46.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:46 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:11:46.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:46 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:11:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:46 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:11:46.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:46 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T07:11:46.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:46 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T07:11:46.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:46 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:11:46.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:46 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:11:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:46 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:11:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:46 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T07:11:47.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:46 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T07:11:47.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:46 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:11:47.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:46 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:11:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:47 smithi186 ceph-mon[126480]: pgmap v6695: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 73 KiB/s wr, 10 op/s 2023-05-08T07:11:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:11:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:47 smithi133 ceph-mon[125939]: pgmap v6695: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 73 KiB/s wr, 10 op/s 2023-05-08T07:11:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:11:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:47 smithi096 ceph-mon[124666]: pgmap v6695: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 73 KiB/s wr, 10 op/s 2023-05-08T07:11:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:11:48.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:48 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:11:48.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:11:48.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:11:48.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:48 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:11:48.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:11:48.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:11:49.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:48 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:11:49.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:11:49.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:11:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:49 smithi186 ceph-mon[126480]: pgmap v6696: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 72 KiB/s wr, 7 op/s 2023-05-08T07:11:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12447.844914 secs 2023-05-08T07:11:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:49 smithi133 ceph-mon[125939]: pgmap v6696: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 72 KiB/s wr, 7 op/s 2023-05-08T07:11:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12447.844914 secs 2023-05-08T07:11:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:49 smithi096 ceph-mon[124666]: pgmap v6696: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 72 KiB/s wr, 7 op/s 2023-05-08T07:11:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12447.844914 secs 2023-05-08T07:11:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:51 smithi186 ceph-mon[126480]: pgmap v6697: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 204 KiB/s wr, 12 op/s 2023-05-08T07:11:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:11:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:51 smithi133 ceph-mon[125939]: pgmap v6697: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 204 KiB/s wr, 12 op/s 2023-05-08T07:11:51.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:11:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:51 smithi096 ceph-mon[124666]: pgmap v6697: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 204 KiB/s wr, 12 op/s 2023-05-08T07:11:52.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:11:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:53 smithi186 ceph-mon[126480]: pgmap v6698: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 171 KiB/s wr, 9 op/s 2023-05-08T07:11:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:53 smithi133 ceph-mon[125939]: pgmap v6698: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 171 KiB/s wr, 9 op/s 2023-05-08T07:11:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:53 smithi096 ceph-mon[124666]: pgmap v6698: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 171 KiB/s wr, 9 op/s 2023-05-08T07:11:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12452.845039 secs 2023-05-08T07:11:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12453.403087 secs 2023-05-08T07:11:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12452.845039 secs 2023-05-08T07:11:54.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12453.403087 secs 2023-05-08T07:11:55.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12452.845039 secs 2023-05-08T07:11:55.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12453.403087 secs 2023-05-08T07:11:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:55 smithi186 ceph-mon[126480]: pgmap v6699: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 171 KiB/s wr, 9 op/s 2023-05-08T07:11:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:55 smithi133 ceph-mon[125939]: pgmap v6699: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 171 KiB/s wr, 9 op/s 2023-05-08T07:11:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:55 smithi096 ceph-mon[124666]: pgmap v6699: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 171 KiB/s wr, 9 op/s 2023-05-08T07:11:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:56 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:11:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:11:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:11:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:56 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:11:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:11:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:11:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:56 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:11:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:11:57.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:11:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:57 smithi186 ceph-mon[126480]: pgmap v6700: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 213 KiB/s wr, 14 op/s 2023-05-08T07:11:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:57 smithi133 ceph-mon[125939]: pgmap v6700: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 213 KiB/s wr, 14 op/s 2023-05-08T07:11:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:57 smithi096 ceph-mon[124666]: pgmap v6700: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 213 KiB/s wr, 14 op/s 2023-05-08T07:11:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:59 smithi186 ceph-mon[126480]: pgmap v6701: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 174 KiB/s wr, 10 op/s 2023-05-08T07:11:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12457.845165 secs 2023-05-08T07:11:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:11:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12458.403200 secs 2023-05-08T07:11:59.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:59 smithi133 ceph-mon[125939]: pgmap v6701: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 174 KiB/s wr, 10 op/s 2023-05-08T07:11:59.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12457.845165 secs 2023-05-08T07:11:59.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:11:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12458.403200 secs 2023-05-08T07:12:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:59 smithi096 ceph-mon[124666]: pgmap v6701: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 174 KiB/s wr, 10 op/s 2023-05-08T07:12:00.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12457.845165 secs 2023-05-08T07:12:00.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:11:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12458.403200 secs 2023-05-08T07:12:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:00 smithi186 ceph-mon[126480]: pgmap v6702: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 319 KiB/s wr, 13 op/s 2023-05-08T07:12:00.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:00 smithi133 ceph-mon[125939]: pgmap v6702: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 319 KiB/s wr, 13 op/s 2023-05-08T07:12:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:00 smithi096 ceph-mon[124666]: pgmap v6702: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 319 KiB/s wr, 13 op/s 2023-05-08T07:12:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12459.685351 secs 2023-05-08T07:12:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12459.685351 secs 2023-05-08T07:12:02.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12459.685351 secs 2023-05-08T07:12:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:02 smithi186 ceph-mon[126480]: pgmap v6703: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 188 KiB/s wr, 8 op/s 2023-05-08T07:12:02.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:02 smithi133 ceph-mon[125939]: pgmap v6703: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 188 KiB/s wr, 8 op/s 2023-05-08T07:12:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:02 smithi096 ceph-mon[124666]: pgmap v6703: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 188 KiB/s wr, 8 op/s 2023-05-08T07:12:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:03 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:12:03.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:12:03.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:03 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:12:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:03 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:12:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:12:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:03 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:12:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:03 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:12:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:12:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:03 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:12:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12462.845285 secs 2023-05-08T07:12:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12463.403334 secs 2023-05-08T07:12:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:04 smithi186 ceph-mon[126480]: pgmap v6704: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 188 KiB/s wr, 8 op/s 2023-05-08T07:12:04.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12462.845285 secs 2023-05-08T07:12:04.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12463.403334 secs 2023-05-08T07:12:04.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:04 smithi133 ceph-mon[125939]: pgmap v6704: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 188 KiB/s wr, 8 op/s 2023-05-08T07:12:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12462.845285 secs 2023-05-08T07:12:05.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12463.403334 secs 2023-05-08T07:12:05.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:04 smithi096 ceph-mon[124666]: pgmap v6704: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 188 KiB/s wr, 8 op/s 2023-05-08T07:12:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12464.685472 secs 2023-05-08T07:12:06.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:06 smithi186 ceph-mon[126480]: osdmap e496: 12 total, 12 up, 12 in 2023-05-08T07:12:06.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:06 smithi186 ceph-mon[126480]: pgmap v6706: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 315 KiB/s wr, 27 op/s 2023-05-08T07:12:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12464.685472 secs 2023-05-08T07:12:06.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:06 smithi133 ceph-mon[125939]: osdmap e496: 12 total, 12 up, 12 in 2023-05-08T07:12:06.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:06 smithi133 ceph-mon[125939]: pgmap v6706: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 315 KiB/s wr, 27 op/s 2023-05-08T07:12:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12464.685472 secs 2023-05-08T07:12:07.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:06 smithi096 ceph-mon[124666]: osdmap e496: 12 total, 12 up, 12 in 2023-05-08T07:12:07.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:06 smithi096 ceph-mon[124666]: pgmap v6706: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 315 KiB/s wr, 27 op/s 2023-05-08T07:12:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:08 smithi186 ceph-mon[126480]: pgmap v6707: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 315 KiB/s wr, 27 op/s 2023-05-08T07:12:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:08 smithi133 ceph-mon[125939]: pgmap v6707: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 315 KiB/s wr, 27 op/s 2023-05-08T07:12:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:08 smithi096 ceph-mon[124666]: pgmap v6707: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 315 KiB/s wr, 27 op/s 2023-05-08T07:12:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12467.845427 secs 2023-05-08T07:12:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12468.403448 secs 2023-05-08T07:12:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12467.845427 secs 2023-05-08T07:12:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12468.403448 secs 2023-05-08T07:12:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12467.845427 secs 2023-05-08T07:12:10.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12468.403448 secs 2023-05-08T07:12:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:10 smithi186 ceph-mon[126480]: pgmap v6708: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 255 KiB/s rd, 273 KiB/s wr, 28 op/s 2023-05-08T07:12:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12469.685599 secs 2023-05-08T07:12:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:10 smithi133 ceph-mon[125939]: pgmap v6708: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 255 KiB/s rd, 273 KiB/s wr, 28 op/s 2023-05-08T07:12:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12469.685599 secs 2023-05-08T07:12:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:10 smithi096 ceph-mon[124666]: pgmap v6708: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 255 KiB/s rd, 273 KiB/s wr, 28 op/s 2023-05-08T07:12:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12469.685599 secs 2023-05-08T07:12:13.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:12 smithi133 ceph-mon[125939]: pgmap v6709: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 255 KiB/s rd, 273 KiB/s wr, 28 op/s 2023-05-08T07:12:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:12 smithi096 ceph-mon[124666]: pgmap v6709: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 255 KiB/s rd, 273 KiB/s wr, 28 op/s 2023-05-08T07:12:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:12 smithi186 ceph-mon[126480]: pgmap v6709: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 255 KiB/s rd, 273 KiB/s wr, 28 op/s 2023-05-08T07:12:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12472.845567 secs 2023-05-08T07:12:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12472.845567 secs 2023-05-08T07:12:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12472.845567 secs 2023-05-08T07:12:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12473.403565 secs 2023-05-08T07:12:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:14 smithi133 ceph-mon[125939]: pgmap v6710: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 255 KiB/s rd, 273 KiB/s wr, 28 op/s 2023-05-08T07:12:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12473.403565 secs 2023-05-08T07:12:15.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:14 smithi096 ceph-mon[124666]: pgmap v6710: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 255 KiB/s rd, 273 KiB/s wr, 28 op/s 2023-05-08T07:12:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12473.403565 secs 2023-05-08T07:12:15.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:14 smithi186 ceph-mon[126480]: pgmap v6710: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 255 KiB/s rd, 273 KiB/s wr, 28 op/s 2023-05-08T07:12:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12474.685741 secs 2023-05-08T07:12:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:15 smithi133 ceph-mon[125939]: osdmap e497: 12 total, 12 up, 12 in 2023-05-08T07:12:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12474.685741 secs 2023-05-08T07:12:16.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:15 smithi096 ceph-mon[124666]: osdmap e497: 12 total, 12 up, 12 in 2023-05-08T07:12:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12474.685741 secs 2023-05-08T07:12:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:15 smithi186 ceph-mon[126480]: osdmap e497: 12 total, 12 up, 12 in 2023-05-08T07:12:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:16 smithi133 ceph-mon[125939]: pgmap v6711: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 167 KiB/s wr, 9 op/s 2023-05-08T07:12:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:16 smithi096 ceph-mon[124666]: pgmap v6711: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 167 KiB/s wr, 9 op/s 2023-05-08T07:12:17.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:16 smithi186 ceph-mon[126480]: pgmap v6711: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 167 KiB/s wr, 9 op/s 2023-05-08T07:12:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:18 smithi133 ceph-mon[125939]: pgmap v6713: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 170 KiB/s wr, 9 op/s 2023-05-08T07:12:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12477.845717 secs 2023-05-08T07:12:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:18 smithi096 ceph-mon[124666]: pgmap v6713: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 170 KiB/s wr, 9 op/s 2023-05-08T07:12:19.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12477.845717 secs 2023-05-08T07:12:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:18 smithi186 ceph-mon[126480]: pgmap v6713: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 170 KiB/s wr, 9 op/s 2023-05-08T07:12:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12477.845717 secs 2023-05-08T07:12:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12478.403681 secs 2023-05-08T07:12:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12478.403681 secs 2023-05-08T07:12:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12478.403681 secs 2023-05-08T07:12:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:20 smithi133 ceph-mon[125939]: pgmap v6714: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 65 KiB/s wr, 8 op/s 2023-05-08T07:12:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12479.685836 secs 2023-05-08T07:12:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:20 smithi096 ceph-mon[124666]: pgmap v6714: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 65 KiB/s wr, 8 op/s 2023-05-08T07:12:21.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12479.685836 secs 2023-05-08T07:12:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:20 smithi186 ceph-mon[126480]: pgmap v6714: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 65 KiB/s wr, 8 op/s 2023-05-08T07:12:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12479.685836 secs 2023-05-08T07:12:23.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:22 smithi133 ceph-mon[125939]: pgmap v6715: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 65 KiB/s wr, 8 op/s 2023-05-08T07:12:23.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:22 smithi096 ceph-mon[124666]: pgmap v6715: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 65 KiB/s wr, 8 op/s 2023-05-08T07:12:23.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:22 smithi186 ceph-mon[126480]: pgmap v6715: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 65 KiB/s wr, 8 op/s 2023-05-08T07:12:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12482.845843 secs 2023-05-08T07:12:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12482.845843 secs 2023-05-08T07:12:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12482.845843 secs 2023-05-08T07:12:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12483.403801 secs 2023-05-08T07:12:25.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:24 smithi133 ceph-mon[125939]: pgmap v6716: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 65 KiB/s wr, 8 op/s 2023-05-08T07:12:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12483.403801 secs 2023-05-08T07:12:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:24 smithi096 ceph-mon[124666]: pgmap v6716: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 65 KiB/s wr, 8 op/s 2023-05-08T07:12:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12483.403801 secs 2023-05-08T07:12:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:24 smithi186 ceph-mon[126480]: pgmap v6716: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 65 KiB/s wr, 8 op/s 2023-05-08T07:12:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12484.685898 secs 2023-05-08T07:12:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12484.685898 secs 2023-05-08T07:12:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12484.685898 secs 2023-05-08T07:12:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:26 smithi133 ceph-mon[125939]: pgmap v6717: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 66 KiB/s wr, 7 op/s 2023-05-08T07:12:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:26 smithi096 ceph-mon[124666]: pgmap v6717: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 66 KiB/s wr, 7 op/s 2023-05-08T07:12:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:26 smithi186 ceph-mon[126480]: pgmap v6717: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 66 KiB/s wr, 7 op/s 2023-05-08T07:12:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:28 smithi133 ceph-mon[125939]: pgmap v6718: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 6 op/s 2023-05-08T07:12:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12487.845989 secs 2023-05-08T07:12:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:28 smithi096 ceph-mon[124666]: pgmap v6718: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 6 op/s 2023-05-08T07:12:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12487.845989 secs 2023-05-08T07:12:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:28 smithi186 ceph-mon[126480]: pgmap v6718: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 6 op/s 2023-05-08T07:12:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12487.845989 secs 2023-05-08T07:12:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12488.403911 secs 2023-05-08T07:12:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12488.403911 secs 2023-05-08T07:12:30.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12488.403911 secs 2023-05-08T07:12:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:30 smithi133 ceph-mon[125939]: pgmap v6719: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 56 KiB/s wr, 9 op/s 2023-05-08T07:12:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12489.685993 secs 2023-05-08T07:12:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:30 smithi096 ceph-mon[124666]: pgmap v6719: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 56 KiB/s wr, 9 op/s 2023-05-08T07:12:31.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12489.685993 secs 2023-05-08T07:12:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:30 smithi186 ceph-mon[126480]: pgmap v6719: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 56 KiB/s wr, 9 op/s 2023-05-08T07:12:31.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12489.685993 secs 2023-05-08T07:12:33.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:32 smithi133 ceph-mon[125939]: pgmap v6720: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T07:12:33.269 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:32 smithi096 ceph-mon[124666]: pgmap v6720: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T07:12:33.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:32 smithi186 ceph-mon[126480]: pgmap v6720: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T07:12:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12492.846109 secs 2023-05-08T07:12:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12492.846109 secs 2023-05-08T07:12:34.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12492.846109 secs 2023-05-08T07:12:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12493.404022 secs 2023-05-08T07:12:35.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:34 smithi133 ceph-mon[125939]: pgmap v6721: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T07:12:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12493.404022 secs 2023-05-08T07:12:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:34 smithi096 ceph-mon[124666]: pgmap v6721: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T07:12:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12493.404022 secs 2023-05-08T07:12:35.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:34 smithi186 ceph-mon[126480]: pgmap v6721: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T07:12:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:36 smithi133 ceph-mon[125939]: pgmap v6722: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 64 KiB/s wr, 10 op/s 2023-05-08T07:12:37.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:36 smithi096 ceph-mon[124666]: pgmap v6722: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 64 KiB/s wr, 10 op/s 2023-05-08T07:12:37.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:36 smithi186 ceph-mon[126480]: pgmap v6722: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 64 KiB/s wr, 10 op/s 2023-05-08T07:12:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:38 smithi133 ceph-mon[125939]: pgmap v6723: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 6 op/s 2023-05-08T07:12:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12497.846234 secs 2023-05-08T07:12:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:38 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:12:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:38 smithi096 ceph-mon[124666]: pgmap v6723: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 6 op/s 2023-05-08T07:12:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12497.846234 secs 2023-05-08T07:12:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:38 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:12:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:38 smithi186 ceph-mon[126480]: pgmap v6723: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 6 op/s 2023-05-08T07:12:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12497.846234 secs 2023-05-08T07:12:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:38 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:12:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12498.404082 secs 2023-05-08T07:12:40.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:39 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:12:40.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:39 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:12:40.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:39 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:12:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12498.404082 secs 2023-05-08T07:12:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:39 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:12:40.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:39 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:12:40.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:39 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:12:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12498.404082 secs 2023-05-08T07:12:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:39 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:12:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:39 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:12:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:39 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:12:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:40 smithi096 ceph-mon[124666]: pgmap v6724: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 109 KiB/s wr, 10 op/s 2023-05-08T07:12:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:40 smithi186 ceph-mon[126480]: pgmap v6724: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 109 KiB/s wr, 10 op/s 2023-05-08T07:12:41.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:40 smithi133 ceph-mon[125939]: pgmap v6724: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 109 KiB/s wr, 10 op/s 2023-05-08T07:12:43.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:42 smithi096 ceph-mon[124666]: pgmap v6725: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 109 KiB/s wr, 7 op/s 2023-05-08T07:12:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:42 smithi186 ceph-mon[126480]: pgmap v6725: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 109 KiB/s wr, 7 op/s 2023-05-08T07:12:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:42 smithi133 ceph-mon[125939]: pgmap v6725: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 109 KiB/s wr, 7 op/s 2023-05-08T07:12:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12502.846383 secs 2023-05-08T07:12:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12502.846383 secs 2023-05-08T07:12:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12502.846383 secs 2023-05-08T07:12:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:45 smithi186 ceph-mon[126480]: pgmap v6726: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 109 KiB/s wr, 7 op/s 2023-05-08T07:12:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:45 smithi133 ceph-mon[125939]: pgmap v6726: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 109 KiB/s wr, 7 op/s 2023-05-08T07:12:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:45 smithi096 ceph-mon[124666]: pgmap v6726: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 109 KiB/s wr, 7 op/s 2023-05-08T07:12:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:46 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:12:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:46 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:12:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:46 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:12:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:47 smithi186 ceph-mon[126480]: pgmap v6727: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 189 KiB/s wr, 13 op/s 2023-05-08T07:12:47.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:47 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:12:47.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:47 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:12:47.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:47 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:12:47.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:47 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:12:47.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:47 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T07:12:47.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:47 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T07:12:47.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:47 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:12:47.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:12:47.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:47 smithi133 ceph-mon[125939]: pgmap v6727: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 189 KiB/s wr, 13 op/s 2023-05-08T07:12:47.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:47 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:12:47.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:47 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:12:47.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:47 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:12:47.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:47 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:12:47.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:47 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T07:12:47.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:47 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T07:12:47.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:47 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:12:47.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:12:47.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:47 smithi096 ceph-mon[124666]: pgmap v6727: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 189 KiB/s wr, 13 op/s 2023-05-08T07:12:47.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:47 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:12:47.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:47 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:12:47.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:47 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:12:47.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:47 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:12:47.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:47 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T07:12:47.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:47 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T07:12:47.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:47 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:12:47.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:12:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:48 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:12:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:12:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:12:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:48 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:12:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:12:48.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:12:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:48 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:12:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:12:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:12:49.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:49 smithi186 ceph-mon[126480]: pgmap v6728: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 159 KiB/s wr, 9 op/s 2023-05-08T07:12:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12507.846512 secs 2023-05-08T07:12:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:49 smithi133 ceph-mon[125939]: pgmap v6728: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 159 KiB/s wr, 9 op/s 2023-05-08T07:12:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12507.846512 secs 2023-05-08T07:12:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:49 smithi096 ceph-mon[124666]: pgmap v6728: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 159 KiB/s wr, 9 op/s 2023-05-08T07:12:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12507.846512 secs 2023-05-08T07:12:50.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12508.404343 secs 2023-05-08T07:12:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12508.404343 secs 2023-05-08T07:12:50.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12508.404343 secs 2023-05-08T07:12:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:51 smithi186 ceph-mon[126480]: pgmap v6729: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 324 KiB/s rd, 310 KiB/s wr, 13 op/s 2023-05-08T07:12:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:51 smithi133 ceph-mon[125939]: pgmap v6729: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 324 KiB/s rd, 310 KiB/s wr, 13 op/s 2023-05-08T07:12:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:51 smithi096 ceph-mon[124666]: pgmap v6729: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 324 KiB/s rd, 310 KiB/s wr, 13 op/s 2023-05-08T07:12:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:12:52.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:12:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:12:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:12:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:12:52.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:12:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:53 smithi186 ceph-mon[126480]: pgmap v6730: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 232 KiB/s wr, 9 op/s 2023-05-08T07:12:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:53 smithi133 ceph-mon[125939]: pgmap v6730: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 232 KiB/s wr, 9 op/s 2023-05-08T07:12:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:53 smithi096 ceph-mon[124666]: pgmap v6730: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 232 KiB/s wr, 9 op/s 2023-05-08T07:12:54.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12512.846639 secs 2023-05-08T07:12:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12512.846639 secs 2023-05-08T07:12:54.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12512.846639 secs 2023-05-08T07:12:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:55 smithi186 ceph-mon[126480]: pgmap v6731: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 232 KiB/s wr, 9 op/s 2023-05-08T07:12:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:55 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:12:55.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:55 smithi133 ceph-mon[125939]: pgmap v6731: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 232 KiB/s wr, 9 op/s 2023-05-08T07:12:55.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:55 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:12:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:55 smithi096 ceph-mon[124666]: pgmap v6731: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 232 KiB/s wr, 9 op/s 2023-05-08T07:12:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:55 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:12:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12514.686592 secs 2023-05-08T07:12:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:56 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:12:56.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:12:56.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:12:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12514.686592 secs 2023-05-08T07:12:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:56 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:12:56.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:12:56.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:12:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12514.686592 secs 2023-05-08T07:12:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:56 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:12:56.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:12:56.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:12:57.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:57 smithi186 ceph-mon[126480]: pgmap v6732: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 275 KiB/s wr, 14 op/s 2023-05-08T07:12:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:57 smithi133 ceph-mon[125939]: pgmap v6732: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 275 KiB/s wr, 14 op/s 2023-05-08T07:12:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:57 smithi096 ceph-mon[124666]: pgmap v6732: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 275 KiB/s wr, 14 op/s 2023-05-08T07:12:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:59 smithi186 ceph-mon[126480]: pgmap v6733: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 194 KiB/s wr, 8 op/s 2023-05-08T07:12:59.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:12:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12517.846803 secs 2023-05-08T07:12:59.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:59 smithi133 ceph-mon[125939]: pgmap v6733: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 194 KiB/s wr, 8 op/s 2023-05-08T07:12:59.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:12:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12517.846803 secs 2023-05-08T07:12:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:59 smithi096 ceph-mon[124666]: pgmap v6733: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 194 KiB/s wr, 8 op/s 2023-05-08T07:12:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:12:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12517.846803 secs 2023-05-08T07:13:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12518.404617 secs 2023-05-08T07:13:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:13:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:13:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12518.404617 secs 2023-05-08T07:13:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:13:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:13:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12518.404617 secs 2023-05-08T07:13:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:13:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:13:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:01 smithi133 ceph-mon[125939]: pgmap v6734: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 257 KiB/s wr, 12 op/s 2023-05-08T07:13:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12519.686713 secs 2023-05-08T07:13:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:01 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:13:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:01 smithi096 ceph-mon[124666]: pgmap v6734: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 257 KiB/s wr, 12 op/s 2023-05-08T07:13:01.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12519.686713 secs 2023-05-08T07:13:01.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:01 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:13:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:01 smithi186 ceph-mon[126480]: pgmap v6734: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 257 KiB/s wr, 12 op/s 2023-05-08T07:13:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12519.686713 secs 2023-05-08T07:13:01.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:01 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:13:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:03 smithi133 ceph-mon[125939]: pgmap v6735: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 106 KiB/s wr, 8 op/s 2023-05-08T07:13:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:03 smithi096 ceph-mon[124666]: pgmap v6735: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 106 KiB/s wr, 8 op/s 2023-05-08T07:13:03.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:03 smithi186 ceph-mon[126480]: pgmap v6735: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 106 KiB/s wr, 8 op/s 2023-05-08T07:13:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12522.846898 secs 2023-05-08T07:13:04.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:04 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:13:04.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:04 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:13:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12522.846898 secs 2023-05-08T07:13:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:04 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:13:04.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:04 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:13:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12522.846898 secs 2023-05-08T07:13:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:04 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:13:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:04 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:13:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12523.404693 secs 2023-05-08T07:13:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:05 smithi133 ceph-mon[125939]: pgmap v6736: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 106 KiB/s wr, 8 op/s 2023-05-08T07:13:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12523.404693 secs 2023-05-08T07:13:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:05 smithi096 ceph-mon[124666]: pgmap v6736: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 106 KiB/s wr, 8 op/s 2023-05-08T07:13:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12523.404693 secs 2023-05-08T07:13:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:05 smithi186 ceph-mon[126480]: pgmap v6736: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 106 KiB/s wr, 8 op/s 2023-05-08T07:13:06.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12524.686832 secs 2023-05-08T07:13:06.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:06 smithi133 ceph-mon[125939]: osdmap e498: 12 total, 12 up, 12 in 2023-05-08T07:13:06.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:06 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:13:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12524.686832 secs 2023-05-08T07:13:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:06 smithi096 ceph-mon[124666]: osdmap e498: 12 total, 12 up, 12 in 2023-05-08T07:13:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:06 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:13:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12524.686832 secs 2023-05-08T07:13:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:06 smithi186 ceph-mon[126480]: osdmap e498: 12 total, 12 up, 12 in 2023-05-08T07:13:06.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:06 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:13:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:07 smithi133 ceph-mon[125939]: pgmap v6738: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 202 KiB/s wr, 26 op/s 2023-05-08T07:13:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:07 smithi096 ceph-mon[124666]: pgmap v6738: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 202 KiB/s wr, 26 op/s 2023-05-08T07:13:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:07 smithi186 ceph-mon[126480]: pgmap v6738: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 202 KiB/s wr, 26 op/s 2023-05-08T07:13:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:09 smithi133 ceph-mon[125939]: pgmap v6739: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 202 KiB/s wr, 26 op/s 2023-05-08T07:13:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12527.847022 secs 2023-05-08T07:13:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:09 smithi096 ceph-mon[124666]: pgmap v6739: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 202 KiB/s wr, 26 op/s 2023-05-08T07:13:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12527.847022 secs 2023-05-08T07:13:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:09 smithi186 ceph-mon[126480]: pgmap v6739: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 202 KiB/s wr, 26 op/s 2023-05-08T07:13:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12527.847022 secs 2023-05-08T07:13:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12528.404768 secs 2023-05-08T07:13:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12528.404768 secs 2023-05-08T07:13:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12528.404768 secs 2023-05-08T07:13:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:11 smithi133 ceph-mon[125939]: pgmap v6740: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 213 KiB/s wr, 26 op/s 2023-05-08T07:13:11.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12529.686952 secs 2023-05-08T07:13:11.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:11 smithi133 ceph-mon[125939]: osdmap e499: 12 total, 12 up, 12 in 2023-05-08T07:13:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:11 smithi096 ceph-mon[124666]: pgmap v6740: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 213 KiB/s wr, 26 op/s 2023-05-08T07:13:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12529.686952 secs 2023-05-08T07:13:11.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:11 smithi096 ceph-mon[124666]: osdmap e499: 12 total, 12 up, 12 in 2023-05-08T07:13:11.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:11 smithi186 ceph-mon[126480]: pgmap v6740: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 213 KiB/s wr, 26 op/s 2023-05-08T07:13:11.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12529.686952 secs 2023-05-08T07:13:11.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:11 smithi186 ceph-mon[126480]: osdmap e499: 12 total, 12 up, 12 in 2023-05-08T07:13:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:13 smithi133 ceph-mon[125939]: pgmap v6742: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 266 KiB/s wr, 33 op/s 2023-05-08T07:13:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:13 smithi096 ceph-mon[124666]: pgmap v6742: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 266 KiB/s wr, 33 op/s 2023-05-08T07:13:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:13 smithi186 ceph-mon[126480]: pgmap v6742: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 266 KiB/s wr, 33 op/s 2023-05-08T07:13:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12532.847124 secs 2023-05-08T07:13:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12532.847124 secs 2023-05-08T07:13:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12532.847124 secs 2023-05-08T07:13:15.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12533.404880 secs 2023-05-08T07:13:15.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:15 smithi133 ceph-mon[125939]: pgmap v6743: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 101 KiB/s wr, 5 op/s 2023-05-08T07:13:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12533.404880 secs 2023-05-08T07:13:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:15 smithi096 ceph-mon[124666]: pgmap v6743: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 101 KiB/s wr, 5 op/s 2023-05-08T07:13:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12533.404880 secs 2023-05-08T07:13:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:15 smithi186 ceph-mon[126480]: pgmap v6743: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 101 KiB/s wr, 5 op/s 2023-05-08T07:13:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12534.687033 secs 2023-05-08T07:13:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12534.687033 secs 2023-05-08T07:13:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12534.687033 secs 2023-05-08T07:13:17.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:17 smithi133 ceph-mon[125939]: pgmap v6744: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 94 KiB/s wr, 9 op/s 2023-05-08T07:13:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:17 smithi096 ceph-mon[124666]: pgmap v6744: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 94 KiB/s wr, 9 op/s 2023-05-08T07:13:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:17 smithi186 ceph-mon[126480]: pgmap v6744: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 94 KiB/s wr, 9 op/s 2023-05-08T07:13:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:19 smithi133 ceph-mon[125939]: pgmap v6745: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 94 KiB/s wr, 9 op/s 2023-05-08T07:13:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12537.847270 secs 2023-05-08T07:13:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:19 smithi096 ceph-mon[124666]: pgmap v6745: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 94 KiB/s wr, 9 op/s 2023-05-08T07:13:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12537.847270 secs 2023-05-08T07:13:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:19 smithi186 ceph-mon[126480]: pgmap v6745: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 94 KiB/s wr, 9 op/s 2023-05-08T07:13:19.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12537.847270 secs 2023-05-08T07:13:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12538.404994 secs 2023-05-08T07:13:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12538.404994 secs 2023-05-08T07:13:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12538.404994 secs 2023-05-08T07:13:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:21 smithi133 ceph-mon[125939]: pgmap v6746: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 46 KiB/s wr, 8 op/s 2023-05-08T07:13:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12539.687098 secs 2023-05-08T07:13:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:21 smithi096 ceph-mon[124666]: pgmap v6746: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 46 KiB/s wr, 8 op/s 2023-05-08T07:13:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12539.687098 secs 2023-05-08T07:13:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:21 smithi186 ceph-mon[126480]: pgmap v6746: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 46 KiB/s wr, 8 op/s 2023-05-08T07:13:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12539.687098 secs 2023-05-08T07:13:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:23 smithi133 ceph-mon[125939]: pgmap v6747: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 42 KiB/s wr, 7 op/s 2023-05-08T07:13:23.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:23 smithi096 ceph-mon[124666]: pgmap v6747: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 42 KiB/s wr, 7 op/s 2023-05-08T07:13:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:23 smithi186 ceph-mon[126480]: pgmap v6747: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 42 KiB/s wr, 7 op/s 2023-05-08T07:13:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12542.847396 secs 2023-05-08T07:13:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12542.847396 secs 2023-05-08T07:13:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12542.847396 secs 2023-05-08T07:13:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12543.405090 secs 2023-05-08T07:13:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:25 smithi133 ceph-mon[125939]: pgmap v6748: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 KiB/s wr, 6 op/s 2023-05-08T07:13:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12543.405090 secs 2023-05-08T07:13:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:25 smithi096 ceph-mon[124666]: pgmap v6748: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 KiB/s wr, 6 op/s 2023-05-08T07:13:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12543.405090 secs 2023-05-08T07:13:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:25 smithi186 ceph-mon[126480]: pgmap v6748: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 KiB/s wr, 6 op/s 2023-05-08T07:13:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12544.687164 secs 2023-05-08T07:13:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12544.687164 secs 2023-05-08T07:13:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12544.687164 secs 2023-05-08T07:13:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:27 smithi133 ceph-mon[125939]: pgmap v6749: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 39 KiB/s wr, 10 op/s 2023-05-08T07:13:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:27 smithi096 ceph-mon[124666]: pgmap v6749: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 39 KiB/s wr, 10 op/s 2023-05-08T07:13:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:27 smithi186 ceph-mon[126480]: pgmap v6749: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 39 KiB/s wr, 10 op/s 2023-05-08T07:13:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:29 smithi133 ceph-mon[125939]: pgmap v6750: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T07:13:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12547.847515 secs 2023-05-08T07:13:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:29 smithi096 ceph-mon[124666]: pgmap v6750: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T07:13:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12547.847515 secs 2023-05-08T07:13:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:29 smithi186 ceph-mon[126480]: pgmap v6750: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T07:13:29.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12547.847515 secs 2023-05-08T07:13:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12548.405208 secs 2023-05-08T07:13:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12548.405208 secs 2023-05-08T07:13:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12548.405208 secs 2023-05-08T07:13:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:31 smithi133 ceph-mon[125939]: pgmap v6751: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 66 KiB/s wr, 10 op/s 2023-05-08T07:13:31.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12549.687307 secs 2023-05-08T07:13:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:31 smithi096 ceph-mon[124666]: pgmap v6751: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 66 KiB/s wr, 10 op/s 2023-05-08T07:13:31.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12549.687307 secs 2023-05-08T07:13:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:31 smithi186 ceph-mon[126480]: pgmap v6751: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 66 KiB/s wr, 10 op/s 2023-05-08T07:13:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12549.687307 secs 2023-05-08T07:13:33.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:33 smithi133 ceph-mon[125939]: pgmap v6752: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T07:13:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:33 smithi096 ceph-mon[124666]: pgmap v6752: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T07:13:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:33 smithi186 ceph-mon[126480]: pgmap v6752: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T07:13:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12552.847608 secs 2023-05-08T07:13:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12552.847608 secs 2023-05-08T07:13:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12552.847608 secs 2023-05-08T07:13:35.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12553.405354 secs 2023-05-08T07:13:35.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:35 smithi133 ceph-mon[125939]: pgmap v6753: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T07:13:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12553.405354 secs 2023-05-08T07:13:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:35 smithi096 ceph-mon[124666]: pgmap v6753: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T07:13:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12553.405354 secs 2023-05-08T07:13:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:35 smithi186 ceph-mon[126480]: pgmap v6753: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T07:13:37.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:37 smithi133 ceph-mon[125939]: pgmap v6754: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 34 KiB/s wr, 9 op/s 2023-05-08T07:13:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:37 smithi096 ceph-mon[124666]: pgmap v6754: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 34 KiB/s wr, 9 op/s 2023-05-08T07:13:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:37 smithi186 ceph-mon[126480]: pgmap v6754: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 34 KiB/s wr, 9 op/s 2023-05-08T07:13:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:39 smithi133 ceph-mon[125939]: pgmap v6755: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 5 op/s 2023-05-08T07:13:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12557.847727 secs 2023-05-08T07:13:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:39 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:13:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:39 smithi096 ceph-mon[124666]: pgmap v6755: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 5 op/s 2023-05-08T07:13:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12557.847727 secs 2023-05-08T07:13:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:39 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:13:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:39 smithi186 ceph-mon[126480]: pgmap v6755: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 5 op/s 2023-05-08T07:13:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12557.847727 secs 2023-05-08T07:13:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:39 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:13:40.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12558.405495 secs 2023-05-08T07:13:40.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:40 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:13:40.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:40 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:13:40.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:40 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:13:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12558.405495 secs 2023-05-08T07:13:40.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:40 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:13:40.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:40 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:13:40.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:40 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:13:40.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12558.405495 secs 2023-05-08T07:13:40.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:40 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:13:40.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:40 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:13:40.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:40 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:13:41.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:41 smithi096 ceph-mon[124666]: pgmap v6756: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 67 KiB/s wr, 9 op/s 2023-05-08T07:13:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:41 smithi186 ceph-mon[126480]: pgmap v6756: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 67 KiB/s wr, 9 op/s 2023-05-08T07:13:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:41 smithi133 ceph-mon[125939]: pgmap v6756: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 67 KiB/s wr, 9 op/s 2023-05-08T07:13:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:43 smithi096 ceph-mon[124666]: pgmap v6757: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 5 op/s 2023-05-08T07:13:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:43 smithi186 ceph-mon[126480]: pgmap v6757: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 5 op/s 2023-05-08T07:13:43.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:43 smithi133 ceph-mon[125939]: pgmap v6757: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 5 op/s 2023-05-08T07:13:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12562.847864 secs 2023-05-08T07:13:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12562.847864 secs 2023-05-08T07:13:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12562.847864 secs 2023-05-08T07:13:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12563.405616 secs 2023-05-08T07:13:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:45 smithi186 ceph-mon[126480]: pgmap v6758: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 5 op/s 2023-05-08T07:13:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12563.405616 secs 2023-05-08T07:13:45.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:45 smithi133 ceph-mon[125939]: pgmap v6758: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 5 op/s 2023-05-08T07:13:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12563.405616 secs 2023-05-08T07:13:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:45 smithi096 ceph-mon[124666]: pgmap v6758: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 5 op/s 2023-05-08T07:13:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:46 smithi133 ceph-mon[125939]: pgmap v6759: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 73 KiB/s wr, 9 op/s 2023-05-08T07:13:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:46 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:13:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:46 smithi096 ceph-mon[124666]: pgmap v6759: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 73 KiB/s wr, 9 op/s 2023-05-08T07:13:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:46 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:13:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:46 smithi186 ceph-mon[126480]: pgmap v6759: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 73 KiB/s wr, 9 op/s 2023-05-08T07:13:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:46 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:13:48.947 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:48 smithi133 ceph-mon[125939]: pgmap v6760: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 73 KiB/s wr, 7 op/s 2023-05-08T07:13:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:48 smithi096 ceph-mon[124666]: pgmap v6760: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 73 KiB/s wr, 7 op/s 2023-05-08T07:13:49.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12567.847922 secs 2023-05-08T07:13:49.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12567.847922 secs 2023-05-08T07:13:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:48 smithi186 ceph-mon[126480]: pgmap v6760: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 73 KiB/s wr, 7 op/s 2023-05-08T07:13:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12567.847922 secs 2023-05-08T07:13:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:13:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:13:50.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:13:50.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:13:50.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:13:50.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:13:50.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:13:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:13:50.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:13:50.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:13:50.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:13:50.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:13:50.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:13:50.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:13:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:13:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:13:50.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:13:50.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:13:50.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:13:50.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:13:50.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:13:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:51 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:13:51.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:51 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T07:13:51.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:51 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T07:13:51.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:51 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:13:51.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:51 smithi133 ceph-mon[125939]: pgmap v6761: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 167 KiB/s wr, 12 op/s 2023-05-08T07:13:51.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:13:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:51 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:13:51.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:51 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T07:13:51.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:51 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T07:13:51.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:51 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:13:51.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:51 smithi096 ceph-mon[124666]: pgmap v6761: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 167 KiB/s wr, 12 op/s 2023-05-08T07:13:51.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:13:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:51 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:13:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:51 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T07:13:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:51 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T07:13:51.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:51 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:13:51.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:51 smithi186 ceph-mon[126480]: pgmap v6761: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 167 KiB/s wr, 12 op/s 2023-05-08T07:13:51.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:13:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:52 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:13:52.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:13:52.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:13:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:52 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:13:52.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:13:52.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:13:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:52 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:13:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:13:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:13:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:53 smithi133 ceph-mon[125939]: pgmap v6762: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 133 KiB/s wr, 9 op/s 2023-05-08T07:13:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:53 smithi096 ceph-mon[124666]: pgmap v6762: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 133 KiB/s wr, 9 op/s 2023-05-08T07:13:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:53 smithi186 ceph-mon[126480]: pgmap v6762: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 133 KiB/s wr, 9 op/s 2023-05-08T07:13:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12572.848041 secs 2023-05-08T07:13:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12573.405803 secs 2023-05-08T07:13:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12572.848041 secs 2023-05-08T07:13:54.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12573.405803 secs 2023-05-08T07:13:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12572.848041 secs 2023-05-08T07:13:54.873 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12573.405803 secs 2023-05-08T07:13:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:55 smithi133 ceph-mon[125939]: pgmap v6763: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 133 KiB/s wr, 9 op/s 2023-05-08T07:13:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:55 smithi096 ceph-mon[124666]: pgmap v6763: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 133 KiB/s wr, 9 op/s 2023-05-08T07:13:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:55 smithi186 ceph-mon[126480]: pgmap v6763: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 133 KiB/s wr, 9 op/s 2023-05-08T07:13:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:13:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:13:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:13:56.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:13:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:13:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:13:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:57 smithi133 ceph-mon[125939]: pgmap v6764: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 177 KiB/s wr, 13 op/s 2023-05-08T07:13:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:57 smithi096 ceph-mon[124666]: pgmap v6764: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 177 KiB/s wr, 13 op/s 2023-05-08T07:13:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:57 smithi186 ceph-mon[126480]: pgmap v6764: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 177 KiB/s wr, 13 op/s 2023-05-08T07:13:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:59 smithi133 ceph-mon[125939]: pgmap v6765: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 137 KiB/s wr, 9 op/s 2023-05-08T07:13:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12577.848159 secs 2023-05-08T07:13:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:13:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12578.405917 secs 2023-05-08T07:13:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:59 smithi096 ceph-mon[124666]: pgmap v6765: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 137 KiB/s wr, 9 op/s 2023-05-08T07:13:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12577.848159 secs 2023-05-08T07:13:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:13:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12578.405917 secs 2023-05-08T07:13:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:59 smithi186 ceph-mon[126480]: pgmap v6765: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 137 KiB/s wr, 9 op/s 2023-05-08T07:13:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12577.848159 secs 2023-05-08T07:13:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:13:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12578.405917 secs 2023-05-08T07:14:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:01 smithi133 ceph-mon[125939]: pgmap v6766: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 271 KiB/s wr, 13 op/s 2023-05-08T07:14:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12579.688054 secs 2023-05-08T07:14:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:01 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:14:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:01 smithi096 ceph-mon[124666]: pgmap v6766: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 271 KiB/s wr, 13 op/s 2023-05-08T07:14:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12579.688054 secs 2023-05-08T07:14:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:01 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:14:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:01 smithi186 ceph-mon[126480]: pgmap v6766: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 271 KiB/s wr, 13 op/s 2023-05-08T07:14:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12579.688054 secs 2023-05-08T07:14:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:01 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:14:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:03 smithi133 ceph-mon[125939]: pgmap v6767: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 177 KiB/s wr, 8 op/s 2023-05-08T07:14:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:03 smithi096 ceph-mon[124666]: pgmap v6767: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 177 KiB/s wr, 8 op/s 2023-05-08T07:14:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:03 smithi186 ceph-mon[126480]: pgmap v6767: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 177 KiB/s wr, 8 op/s 2023-05-08T07:14:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12582.848246 secs 2023-05-08T07:14:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:04 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:14:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:04 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:14:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12583.406038 secs 2023-05-08T07:14:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12582.848246 secs 2023-05-08T07:14:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:04 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:14:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:04 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:14:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12583.406038 secs 2023-05-08T07:14:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12582.848246 secs 2023-05-08T07:14:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:04 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:14:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:04 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:14:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12583.406038 secs 2023-05-08T07:14:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:05 smithi133 ceph-mon[125939]: pgmap v6768: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 177 KiB/s wr, 8 op/s 2023-05-08T07:14:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:05 smithi096 ceph-mon[124666]: pgmap v6768: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 177 KiB/s wr, 8 op/s 2023-05-08T07:14:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:05 smithi186 ceph-mon[126480]: pgmap v6768: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 177 KiB/s wr, 8 op/s 2023-05-08T07:14:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12584.688132 secs 2023-05-08T07:14:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:06 smithi133 ceph-mon[125939]: osdmap e500: 12 total, 12 up, 12 in 2023-05-08T07:14:06.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:06 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:14:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12584.688132 secs 2023-05-08T07:14:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:06 smithi096 ceph-mon[124666]: osdmap e500: 12 total, 12 up, 12 in 2023-05-08T07:14:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:06 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:14:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12584.688132 secs 2023-05-08T07:14:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:06 smithi186 ceph-mon[126480]: osdmap e500: 12 total, 12 up, 12 in 2023-05-08T07:14:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:06 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:14:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:07 smithi133 ceph-mon[125939]: pgmap v6770: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 303 KiB/s wr, 28 op/s 2023-05-08T07:14:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:07 smithi096 ceph-mon[124666]: pgmap v6770: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 303 KiB/s wr, 28 op/s 2023-05-08T07:14:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:07 smithi186 ceph-mon[126480]: pgmap v6770: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 303 KiB/s wr, 28 op/s 2023-05-08T07:14:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:09 smithi133 ceph-mon[125939]: pgmap v6771: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 303 KiB/s wr, 28 op/s 2023-05-08T07:14:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12587.848374 secs 2023-05-08T07:14:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12588.406179 secs 2023-05-08T07:14:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:09 smithi096 ceph-mon[124666]: pgmap v6771: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 303 KiB/s wr, 28 op/s 2023-05-08T07:14:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12587.848374 secs 2023-05-08T07:14:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12588.406179 secs 2023-05-08T07:14:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:09 smithi186 ceph-mon[126480]: pgmap v6771: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 303 KiB/s wr, 28 op/s 2023-05-08T07:14:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12587.848374 secs 2023-05-08T07:14:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12588.406179 secs 2023-05-08T07:14:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:11 smithi133 ceph-mon[125939]: pgmap v6772: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 228 KiB/s wr, 27 op/s 2023-05-08T07:14:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12589.688252 secs 2023-05-08T07:14:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:11 smithi096 ceph-mon[124666]: pgmap v6772: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 228 KiB/s wr, 27 op/s 2023-05-08T07:14:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12589.688252 secs 2023-05-08T07:14:11.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:11 smithi186 ceph-mon[126480]: pgmap v6772: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 228 KiB/s wr, 27 op/s 2023-05-08T07:14:11.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12589.688252 secs 2023-05-08T07:14:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:13 smithi133 ceph-mon[125939]: pgmap v6773: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 228 KiB/s wr, 27 op/s 2023-05-08T07:14:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:13 smithi096 ceph-mon[124666]: pgmap v6773: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 228 KiB/s wr, 27 op/s 2023-05-08T07:14:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:13 smithi186 ceph-mon[126480]: pgmap v6773: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 228 KiB/s wr, 27 op/s 2023-05-08T07:14:14.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12592.848485 secs 2023-05-08T07:14:14.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12593.406316 secs 2023-05-08T07:14:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12592.848485 secs 2023-05-08T07:14:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12593.406316 secs 2023-05-08T07:14:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12592.848485 secs 2023-05-08T07:14:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12593.406316 secs 2023-05-08T07:14:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:15 smithi133 ceph-mon[125939]: pgmap v6774: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 228 KiB/s wr, 27 op/s 2023-05-08T07:14:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:15 smithi096 ceph-mon[124666]: pgmap v6774: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 228 KiB/s wr, 27 op/s 2023-05-08T07:14:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:15 smithi186 ceph-mon[126480]: pgmap v6774: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 228 KiB/s wr, 27 op/s 2023-05-08T07:14:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12594.688364 secs 2023-05-08T07:14:16.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:16 smithi133 ceph-mon[125939]: osdmap e501: 12 total, 12 up, 12 in 2023-05-08T07:14:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12594.688364 secs 2023-05-08T07:14:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:16 smithi096 ceph-mon[124666]: osdmap e501: 12 total, 12 up, 12 in 2023-05-08T07:14:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12594.688364 secs 2023-05-08T07:14:16.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:16 smithi186 ceph-mon[126480]: osdmap e501: 12 total, 12 up, 12 in 2023-05-08T07:14:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:17 smithi133 ceph-mon[125939]: pgmap v6775: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 119 KiB/s wr, 8 op/s 2023-05-08T07:14:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:17 smithi096 ceph-mon[124666]: pgmap v6775: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 119 KiB/s wr, 8 op/s 2023-05-08T07:14:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:17 smithi186 ceph-mon[126480]: pgmap v6775: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 119 KiB/s wr, 8 op/s 2023-05-08T07:14:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:19 smithi133 ceph-mon[125939]: pgmap v6777: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 124 KiB/s wr, 8 op/s 2023-05-08T07:14:19.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12597.848624 secs 2023-05-08T07:14:19.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12598.406378 secs 2023-05-08T07:14:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:19 smithi096 ceph-mon[124666]: pgmap v6777: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 124 KiB/s wr, 8 op/s 2023-05-08T07:14:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12597.848624 secs 2023-05-08T07:14:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12598.406378 secs 2023-05-08T07:14:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:19 smithi186 ceph-mon[126480]: pgmap v6777: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 124 KiB/s wr, 8 op/s 2023-05-08T07:14:19.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12597.848624 secs 2023-05-08T07:14:19.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12598.406378 secs 2023-05-08T07:14:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:21 smithi133 ceph-mon[125939]: pgmap v6778: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 66 KiB/s wr, 8 op/s 2023-05-08T07:14:21.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12599.688503 secs 2023-05-08T07:14:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:21 smithi096 ceph-mon[124666]: pgmap v6778: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 66 KiB/s wr, 8 op/s 2023-05-08T07:14:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12599.688503 secs 2023-05-08T07:14:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:21 smithi186 ceph-mon[126480]: pgmap v6778: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 66 KiB/s wr, 8 op/s 2023-05-08T07:14:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12599.688503 secs 2023-05-08T07:14:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:23 smithi096 ceph-mon[124666]: pgmap v6779: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 66 KiB/s wr, 8 op/s 2023-05-08T07:14:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:23 smithi186 ceph-mon[126480]: pgmap v6779: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 66 KiB/s wr, 8 op/s 2023-05-08T07:14:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:23 smithi133 ceph-mon[125939]: pgmap v6779: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 66 KiB/s wr, 8 op/s 2023-05-08T07:14:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12602.848764 secs 2023-05-08T07:14:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12603.406449 secs 2023-05-08T07:14:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12602.848764 secs 2023-05-08T07:14:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12603.406449 secs 2023-05-08T07:14:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12602.848764 secs 2023-05-08T07:14:24.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12603.406449 secs 2023-05-08T07:14:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:25 smithi096 ceph-mon[124666]: pgmap v6780: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 66 KiB/s wr, 8 op/s 2023-05-08T07:14:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:25 smithi186 ceph-mon[126480]: pgmap v6780: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 66 KiB/s wr, 8 op/s 2023-05-08T07:14:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:25 smithi133 ceph-mon[125939]: pgmap v6780: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 66 KiB/s wr, 8 op/s 2023-05-08T07:14:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12604.688646 secs 2023-05-08T07:14:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12604.688646 secs 2023-05-08T07:14:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12604.688646 secs 2023-05-08T07:14:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:27 smithi096 ceph-mon[124666]: pgmap v6781: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 67 KiB/s wr, 7 op/s 2023-05-08T07:14:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:27 smithi186 ceph-mon[126480]: pgmap v6781: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 67 KiB/s wr, 7 op/s 2023-05-08T07:14:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:27 smithi133 ceph-mon[125939]: pgmap v6781: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 67 KiB/s wr, 7 op/s 2023-05-08T07:14:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:29 smithi186 ceph-mon[126480]: pgmap v6782: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 57 KiB/s wr, 6 op/s 2023-05-08T07:14:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12607.848881 secs 2023-05-08T07:14:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12608.406576 secs 2023-05-08T07:14:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:29 smithi133 ceph-mon[125939]: pgmap v6782: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 57 KiB/s wr, 6 op/s 2023-05-08T07:14:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12607.848881 secs 2023-05-08T07:14:29.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12608.406576 secs 2023-05-08T07:14:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:29 smithi096 ceph-mon[124666]: pgmap v6782: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 57 KiB/s wr, 6 op/s 2023-05-08T07:14:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12607.848881 secs 2023-05-08T07:14:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12608.406576 secs 2023-05-08T07:14:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:31 smithi186 ceph-mon[126480]: pgmap v6783: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 57 KiB/s wr, 9 op/s 2023-05-08T07:14:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12609.688799 secs 2023-05-08T07:14:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:31 smithi133 ceph-mon[125939]: pgmap v6783: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 57 KiB/s wr, 9 op/s 2023-05-08T07:14:31.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12609.688799 secs 2023-05-08T07:14:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:31 smithi096 ceph-mon[124666]: pgmap v6783: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 57 KiB/s wr, 9 op/s 2023-05-08T07:14:32.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12609.688799 secs 2023-05-08T07:14:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:33 smithi186 ceph-mon[126480]: pgmap v6784: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T07:14:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:33 smithi133 ceph-mon[125939]: pgmap v6784: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T07:14:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:33 smithi096 ceph-mon[124666]: pgmap v6784: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T07:14:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12612.849002 secs 2023-05-08T07:14:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12613.406687 secs 2023-05-08T07:14:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12612.849002 secs 2023-05-08T07:14:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12613.406687 secs 2023-05-08T07:14:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12612.849002 secs 2023-05-08T07:14:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12613.406687 secs 2023-05-08T07:14:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:35 smithi186 ceph-mon[126480]: pgmap v6785: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T07:14:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:35 smithi133 ceph-mon[125939]: pgmap v6785: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T07:14:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:35 smithi096 ceph-mon[124666]: pgmap v6785: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T07:14:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:37 smithi186 ceph-mon[126480]: pgmap v6786: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 65 KiB/s wr, 10 op/s 2023-05-08T07:14:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:37 smithi133 ceph-mon[125939]: pgmap v6786: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 65 KiB/s wr, 10 op/s 2023-05-08T07:14:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:37 smithi096 ceph-mon[124666]: pgmap v6786: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 65 KiB/s wr, 10 op/s 2023-05-08T07:14:38.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:38 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:14:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:38 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:14:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:38 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:14:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:39 smithi186 ceph-mon[126480]: pgmap v6787: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T07:14:39.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12617.849148 secs 2023-05-08T07:14:39.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:39 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:14:39.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:39 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:14:39.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:39 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:14:39.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12618.406770 secs 2023-05-08T07:14:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:39 smithi133 ceph-mon[125939]: pgmap v6787: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T07:14:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12617.849148 secs 2023-05-08T07:14:39.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:39 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:14:39.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:39 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:14:39.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:39 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:14:39.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12618.406770 secs 2023-05-08T07:14:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:39 smithi096 ceph-mon[124666]: pgmap v6787: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T07:14:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12617.849148 secs 2023-05-08T07:14:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:39 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:14:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:39 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:14:40.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:39 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:14:40.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12618.406770 secs 2023-05-08T07:14:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:41 smithi186 ceph-mon[126480]: pgmap v6788: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 153 KiB/s wr, 11 op/s 2023-05-08T07:14:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:41 smithi133 ceph-mon[125939]: pgmap v6788: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 153 KiB/s wr, 11 op/s 2023-05-08T07:14:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:41 smithi096 ceph-mon[124666]: pgmap v6788: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 153 KiB/s wr, 11 op/s 2023-05-08T07:14:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:43 smithi186 ceph-mon[126480]: pgmap v6789: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 153 KiB/s wr, 8 op/s 2023-05-08T07:14:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:43 smithi133 ceph-mon[125939]: pgmap v6789: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 153 KiB/s wr, 8 op/s 2023-05-08T07:14:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:43 smithi096 ceph-mon[124666]: pgmap v6789: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 153 KiB/s wr, 8 op/s 2023-05-08T07:14:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12622.849311 secs 2023-05-08T07:14:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12622.849311 secs 2023-05-08T07:14:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12622.849311 secs 2023-05-08T07:14:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:45 smithi186 ceph-mon[126480]: pgmap v6790: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 153 KiB/s wr, 8 op/s 2023-05-08T07:14:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:45 smithi133 ceph-mon[125939]: pgmap v6790: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 153 KiB/s wr, 8 op/s 2023-05-08T07:14:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:45 smithi096 ceph-mon[124666]: pgmap v6790: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 153 KiB/s wr, 8 op/s 2023-05-08T07:14:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:47 smithi186 ceph-mon[126480]: pgmap v6791: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 193 KiB/s wr, 13 op/s 2023-05-08T07:14:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:14:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:47 smithi133 ceph-mon[125939]: pgmap v6791: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 193 KiB/s wr, 13 op/s 2023-05-08T07:14:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:14:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:47 smithi096 ceph-mon[124666]: pgmap v6791: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 193 KiB/s wr, 13 op/s 2023-05-08T07:14:48.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:14:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:48 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:14:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:14:48.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:14:48.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:48 smithi186 ceph-mon[126480]: pgmap v6792: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 162 KiB/s wr, 9 op/s 2023-05-08T07:14:48.995 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:48 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:14:48.995 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:14:48.995 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:14:48.995 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:48 smithi133 ceph-mon[125939]: pgmap v6792: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 162 KiB/s wr, 9 op/s 2023-05-08T07:14:49.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:48 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:14:49.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:14:49.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:14:49.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:48 smithi096 ceph-mon[124666]: pgmap v6792: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 162 KiB/s wr, 9 op/s 2023-05-08T07:14:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12627.849417 secs 2023-05-08T07:14:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12628.406956 secs 2023-05-08T07:14:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12627.849417 secs 2023-05-08T07:14:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12628.406956 secs 2023-05-08T07:14:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12627.849417 secs 2023-05-08T07:14:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12628.406956 secs 2023-05-08T07:14:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:50 smithi186 ceph-mon[126480]: pgmap v6793: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 317 KiB/s wr, 13 op/s 2023-05-08T07:14:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:14:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:50 smithi133 ceph-mon[125939]: pgmap v6793: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 317 KiB/s wr, 13 op/s 2023-05-08T07:14:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:14:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:50 smithi096 ceph-mon[124666]: pgmap v6793: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 317 KiB/s wr, 13 op/s 2023-05-08T07:14:51.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:14:52.885 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:14:52.885 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:14:52.886 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:52 smithi186 ceph-mon[126480]: pgmap v6794: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 195 KiB/s wr, 9 op/s 2023-05-08T07:14:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:14:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:14:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:52 smithi133 ceph-mon[125939]: pgmap v6794: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 195 KiB/s wr, 9 op/s 2023-05-08T07:14:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:14:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:14:53.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:52 smithi096 ceph-mon[124666]: pgmap v6794: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 195 KiB/s wr, 9 op/s 2023-05-08T07:14:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12632.849495 secs 2023-05-08T07:14:54.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:14:54.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:14:54.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:14:54.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:14:54.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:54 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:14:54.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:14:54.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:54 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T07:14:54.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:54 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T07:14:54.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:54 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:14:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12632.849495 secs 2023-05-08T07:14:54.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:14:54.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:14:54.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:14:54.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:14:54.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:54 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:14:54.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:14:54.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:54 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T07:14:54.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:54 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T07:14:54.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:54 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:14:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12632.849495 secs 2023-05-08T07:14:54.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:14:54.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:14:54.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:14:54.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:14:54.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:54 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:14:54.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:14:54.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:54 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T07:14:54.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:54 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T07:14:54.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:54 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:14:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:55 smithi133 ceph-mon[125939]: pgmap v6795: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 195 KiB/s wr, 9 op/s 2023-05-08T07:14:55.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:55 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:14:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:55 smithi096 ceph-mon[124666]: pgmap v6795: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 195 KiB/s wr, 9 op/s 2023-05-08T07:14:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:55 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:14:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:55 smithi186 ceph-mon[126480]: pgmap v6795: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 195 KiB/s wr, 9 op/s 2023-05-08T07:14:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:55 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:14:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:56 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:14:56.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:14:56.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:14:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:56 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:14:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:14:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:14:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:56 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:14:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:14:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:14:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:57 smithi133 ceph-mon[125939]: pgmap v6796: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 280 KiB/s wr, 14 op/s 2023-05-08T07:14:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:57 smithi096 ceph-mon[124666]: pgmap v6796: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 280 KiB/s wr, 14 op/s 2023-05-08T07:14:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:57 smithi186 ceph-mon[126480]: pgmap v6796: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 280 KiB/s wr, 14 op/s 2023-05-08T07:14:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:59 smithi133 ceph-mon[125939]: pgmap v6797: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 240 KiB/s wr, 9 op/s 2023-05-08T07:14:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:14:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12637.849625 secs 2023-05-08T07:14:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:59 smithi096 ceph-mon[124666]: pgmap v6797: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 240 KiB/s wr, 9 op/s 2023-05-08T07:14:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:14:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12637.849625 secs 2023-05-08T07:14:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:59 smithi186 ceph-mon[126480]: pgmap v6797: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 240 KiB/s wr, 9 op/s 2023-05-08T07:14:59.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:14:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12637.849625 secs 2023-05-08T07:15:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12638.407224 secs 2023-05-08T07:15:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12638.407224 secs 2023-05-08T07:15:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12638.407224 secs 2023-05-08T07:15:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:01 smithi133 ceph-mon[125939]: pgmap v6798: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 304 KiB/s wr, 13 op/s 2023-05-08T07:15:01.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12639.689414 secs 2023-05-08T07:15:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:01 smithi096 ceph-mon[124666]: pgmap v6798: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 304 KiB/s wr, 13 op/s 2023-05-08T07:15:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12639.689414 secs 2023-05-08T07:15:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:01 smithi186 ceph-mon[126480]: pgmap v6798: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 304 KiB/s wr, 13 op/s 2023-05-08T07:15:01.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12639.689414 secs 2023-05-08T07:15:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:03 smithi133 ceph-mon[125939]: pgmap v6799: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 149 KiB/s wr, 9 op/s 2023-05-08T07:15:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:03 smithi096 ceph-mon[124666]: pgmap v6799: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 149 KiB/s wr, 9 op/s 2023-05-08T07:15:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:03 smithi186 ceph-mon[126480]: pgmap v6799: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 149 KiB/s wr, 9 op/s 2023-05-08T07:15:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12642.849721 secs 2023-05-08T07:15:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:04 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:15:04.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:04 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:15:04.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:04 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:15:04.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:04 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:15:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12642.849721 secs 2023-05-08T07:15:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:04 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:15:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:04 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:15:04.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:04 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:15:04.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:04 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:15:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12642.849721 secs 2023-05-08T07:15:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:04 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:15:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:04 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:15:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:04 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:15:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:04 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:15:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12643.407340 secs 2023-05-08T07:15:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:05 smithi096 ceph-mon[124666]: pgmap v6800: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 149 KiB/s wr, 9 op/s 2023-05-08T07:15:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12643.407340 secs 2023-05-08T07:15:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:05 smithi186 ceph-mon[126480]: pgmap v6800: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 149 KiB/s wr, 9 op/s 2023-05-08T07:15:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12643.407340 secs 2023-05-08T07:15:05.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:05 smithi133 ceph-mon[125939]: pgmap v6800: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 149 KiB/s wr, 9 op/s 2023-05-08T07:15:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12644.689540 secs 2023-05-08T07:15:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12644.689540 secs 2023-05-08T07:15:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12644.689540 secs 2023-05-08T07:15:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:07 smithi096 ceph-mon[124666]: pgmap v6801: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 225 KiB/s wr, 27 op/s 2023-05-08T07:15:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:07 smithi186 ceph-mon[126480]: pgmap v6801: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 225 KiB/s wr, 27 op/s 2023-05-08T07:15:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:07 smithi133 ceph-mon[125939]: pgmap v6801: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 225 KiB/s wr, 27 op/s 2023-05-08T07:15:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:09 smithi096 ceph-mon[124666]: pgmap v6802: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 139 KiB/s wr, 21 op/s 2023-05-08T07:15:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12647.849866 secs 2023-05-08T07:15:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:09 smithi186 ceph-mon[126480]: pgmap v6802: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 139 KiB/s wr, 21 op/s 2023-05-08T07:15:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12647.849866 secs 2023-05-08T07:15:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:09 smithi133 ceph-mon[125939]: pgmap v6802: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 139 KiB/s wr, 21 op/s 2023-05-08T07:15:09.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12647.849866 secs 2023-05-08T07:15:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12648.407452 secs 2023-05-08T07:15:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12648.407452 secs 2023-05-08T07:15:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12648.407452 secs 2023-05-08T07:15:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:11 smithi186 ceph-mon[126480]: pgmap v6803: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 198 KiB/s wr, 25 op/s 2023-05-08T07:15:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12649.689660 secs 2023-05-08T07:15:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:11 smithi186 ceph-mon[126480]: osdmap e502: 12 total, 12 up, 12 in 2023-05-08T07:15:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:11 smithi133 ceph-mon[125939]: pgmap v6803: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 198 KiB/s wr, 25 op/s 2023-05-08T07:15:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12649.689660 secs 2023-05-08T07:15:11.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:11 smithi133 ceph-mon[125939]: osdmap e502: 12 total, 12 up, 12 in 2023-05-08T07:15:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:11 smithi096 ceph-mon[124666]: pgmap v6803: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 198 KiB/s wr, 25 op/s 2023-05-08T07:15:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12649.689660 secs 2023-05-08T07:15:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:11 smithi096 ceph-mon[124666]: osdmap e502: 12 total, 12 up, 12 in 2023-05-08T07:15:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:13 smithi186 ceph-mon[126480]: pgmap v6805: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 161 KiB/s wr, 26 op/s 2023-05-08T07:15:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:13 smithi133 ceph-mon[125939]: pgmap v6805: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 161 KiB/s wr, 26 op/s 2023-05-08T07:15:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:13 smithi096 ceph-mon[124666]: pgmap v6805: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 161 KiB/s wr, 26 op/s 2023-05-08T07:15:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12652.850001 secs 2023-05-08T07:15:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12652.850001 secs 2023-05-08T07:15:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12652.850001 secs 2023-05-08T07:15:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12653.407571 secs 2023-05-08T07:15:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:15 smithi186 ceph-mon[126480]: pgmap v6806: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 161 KiB/s wr, 26 op/s 2023-05-08T07:15:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12653.407571 secs 2023-05-08T07:15:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:15 smithi133 ceph-mon[125939]: pgmap v6806: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 161 KiB/s wr, 26 op/s 2023-05-08T07:15:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12653.407571 secs 2023-05-08T07:15:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:15 smithi096 ceph-mon[124666]: pgmap v6806: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 161 KiB/s wr, 26 op/s 2023-05-08T07:15:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12654.689815 secs 2023-05-08T07:15:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12654.689815 secs 2023-05-08T07:15:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12654.689815 secs 2023-05-08T07:15:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:17 smithi186 ceph-mon[126480]: pgmap v6807: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 80 KiB/s wr, 9 op/s 2023-05-08T07:15:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:17 smithi133 ceph-mon[125939]: pgmap v6807: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 80 KiB/s wr, 9 op/s 2023-05-08T07:15:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:17 smithi096 ceph-mon[124666]: pgmap v6807: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 80 KiB/s wr, 9 op/s 2023-05-08T07:15:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:19 smithi186 ceph-mon[126480]: pgmap v6808: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 80 KiB/s wr, 9 op/s 2023-05-08T07:15:19.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12657.850132 secs 2023-05-08T07:15:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:19 smithi133 ceph-mon[125939]: pgmap v6808: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 80 KiB/s wr, 9 op/s 2023-05-08T07:15:19.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12657.850132 secs 2023-05-08T07:15:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:19 smithi096 ceph-mon[124666]: pgmap v6808: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 80 KiB/s wr, 9 op/s 2023-05-08T07:15:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12657.850132 secs 2023-05-08T07:15:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12658.407691 secs 2023-05-08T07:15:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12658.407691 secs 2023-05-08T07:15:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12658.407691 secs 2023-05-08T07:15:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:21 smithi186 ceph-mon[126480]: pgmap v6809: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 50 KiB/s wr, 9 op/s 2023-05-08T07:15:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12659.689937 secs 2023-05-08T07:15:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:21 smithi186 ceph-mon[126480]: osdmap e503: 12 total, 12 up, 12 in 2023-05-08T07:15:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:21 smithi133 ceph-mon[125939]: pgmap v6809: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 50 KiB/s wr, 9 op/s 2023-05-08T07:15:21.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12659.689937 secs 2023-05-08T07:15:21.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:21 smithi133 ceph-mon[125939]: osdmap e503: 12 total, 12 up, 12 in 2023-05-08T07:15:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:21 smithi096 ceph-mon[124666]: pgmap v6809: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 50 KiB/s wr, 9 op/s 2023-05-08T07:15:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12659.689937 secs 2023-05-08T07:15:21.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:21 smithi096 ceph-mon[124666]: osdmap e503: 12 total, 12 up, 12 in 2023-05-08T07:15:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:23 smithi186 ceph-mon[126480]: pgmap v6811: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 50 KiB/s wr, 9 op/s 2023-05-08T07:15:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:23 smithi133 ceph-mon[125939]: pgmap v6811: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 50 KiB/s wr, 9 op/s 2023-05-08T07:15:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:23 smithi096 ceph-mon[124666]: pgmap v6811: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 50 KiB/s wr, 9 op/s 2023-05-08T07:15:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12662.850270 secs 2023-05-08T07:15:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12662.850270 secs 2023-05-08T07:15:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12662.850270 secs 2023-05-08T07:15:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12663.407789 secs 2023-05-08T07:15:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:25 smithi186 ceph-mon[126480]: pgmap v6812: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 50 KiB/s wr, 9 op/s 2023-05-08T07:15:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12663.407789 secs 2023-05-08T07:15:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:25 smithi133 ceph-mon[125939]: pgmap v6812: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 50 KiB/s wr, 9 op/s 2023-05-08T07:15:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12663.407789 secs 2023-05-08T07:15:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:25 smithi096 ceph-mon[124666]: pgmap v6812: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 50 KiB/s wr, 9 op/s 2023-05-08T07:15:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12664.690033 secs 2023-05-08T07:15:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12664.690033 secs 2023-05-08T07:15:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12664.690033 secs 2023-05-08T07:15:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:27 smithi186 ceph-mon[126480]: pgmap v6813: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 42 KiB/s wr, 9 op/s 2023-05-08T07:15:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:27 smithi133 ceph-mon[125939]: pgmap v6813: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 42 KiB/s wr, 9 op/s 2023-05-08T07:15:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:27 smithi096 ceph-mon[124666]: pgmap v6813: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 42 KiB/s wr, 9 op/s 2023-05-08T07:15:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:29 smithi186 ceph-mon[126480]: pgmap v6814: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 42 KiB/s wr, 9 op/s 2023-05-08T07:15:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12667.850390 secs 2023-05-08T07:15:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:29 smithi133 ceph-mon[125939]: pgmap v6814: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 42 KiB/s wr, 9 op/s 2023-05-08T07:15:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12667.850390 secs 2023-05-08T07:15:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:29 smithi096 ceph-mon[124666]: pgmap v6814: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 42 KiB/s wr, 9 op/s 2023-05-08T07:15:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12667.850390 secs 2023-05-08T07:15:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12668.407911 secs 2023-05-08T07:15:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12668.407911 secs 2023-05-08T07:15:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12668.407911 secs 2023-05-08T07:15:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:31 smithi186 ceph-mon[126480]: pgmap v6815: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 41 KiB/s wr, 9 op/s 2023-05-08T07:15:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12669.690152 secs 2023-05-08T07:15:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:31 smithi133 ceph-mon[125939]: pgmap v6815: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 41 KiB/s wr, 9 op/s 2023-05-08T07:15:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12669.690152 secs 2023-05-08T07:15:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:31 smithi096 ceph-mon[124666]: pgmap v6815: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 41 KiB/s wr, 9 op/s 2023-05-08T07:15:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12669.690152 secs 2023-05-08T07:15:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:33 smithi186 ceph-mon[126480]: pgmap v6816: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 38 KiB/s wr, 8 op/s 2023-05-08T07:15:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:33 smithi133 ceph-mon[125939]: pgmap v6816: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 38 KiB/s wr, 8 op/s 2023-05-08T07:15:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:33 smithi096 ceph-mon[124666]: pgmap v6816: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 38 KiB/s wr, 8 op/s 2023-05-08T07:15:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12672.850472 secs 2023-05-08T07:15:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12672.850472 secs 2023-05-08T07:15:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12672.850472 secs 2023-05-08T07:15:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12673.408028 secs 2023-05-08T07:15:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:35 smithi186 ceph-mon[126480]: pgmap v6817: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 34 KiB/s wr, 7 op/s 2023-05-08T07:15:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12673.408028 secs 2023-05-08T07:15:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:35 smithi133 ceph-mon[125939]: pgmap v6817: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 34 KiB/s wr, 7 op/s 2023-05-08T07:15:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12673.408028 secs 2023-05-08T07:15:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:35 smithi096 ceph-mon[124666]: pgmap v6817: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 34 KiB/s wr, 7 op/s 2023-05-08T07:15:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:37 smithi186 ceph-mon[126480]: pgmap v6818: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 34 KiB/s wr, 10 op/s 2023-05-08T07:15:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:37 smithi133 ceph-mon[125939]: pgmap v6818: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 34 KiB/s wr, 10 op/s 2023-05-08T07:15:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:37 smithi096 ceph-mon[124666]: pgmap v6818: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 34 KiB/s wr, 10 op/s 2023-05-08T07:15:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:39 smithi186 ceph-mon[126480]: pgmap v6819: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T07:15:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12677.850552 secs 2023-05-08T07:15:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:39 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:15:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:39 smithi133 ceph-mon[125939]: pgmap v6819: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T07:15:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12677.850552 secs 2023-05-08T07:15:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:39 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:15:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:39 smithi096 ceph-mon[124666]: pgmap v6819: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T07:15:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12677.850552 secs 2023-05-08T07:15:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:39 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:15:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12678.408146 secs 2023-05-08T07:15:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:40 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:15:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:40 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:15:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:40 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:15:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12678.408146 secs 2023-05-08T07:15:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:40 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:15:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:40 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:15:40.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:40 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:15:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12678.408146 secs 2023-05-08T07:15:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:40 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:15:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:40 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:15:40.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:40 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:15:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:41 smithi186 ceph-mon[126480]: pgmap v6820: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 68 KiB/s wr, 9 op/s 2023-05-08T07:15:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:41 smithi133 ceph-mon[125939]: pgmap v6820: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 68 KiB/s wr, 9 op/s 2023-05-08T07:15:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:41 smithi096 ceph-mon[124666]: pgmap v6820: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 68 KiB/s wr, 9 op/s 2023-05-08T07:15:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:43 smithi186 ceph-mon[126480]: pgmap v6821: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T07:15:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:43 smithi133 ceph-mon[125939]: pgmap v6821: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T07:15:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:43 smithi096 ceph-mon[124666]: pgmap v6821: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T07:15:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12682.850636 secs 2023-05-08T07:15:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12682.850636 secs 2023-05-08T07:15:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12682.850636 secs 2023-05-08T07:15:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:45 smithi186 ceph-mon[126480]: pgmap v6822: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T07:15:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:45 smithi133 ceph-mon[125939]: pgmap v6822: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T07:15:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:45 smithi096 ceph-mon[124666]: pgmap v6822: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T07:15:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:47 smithi133 ceph-mon[125939]: pgmap v6823: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 74 KiB/s wr, 10 op/s 2023-05-08T07:15:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:15:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:47 smithi096 ceph-mon[124666]: pgmap v6823: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 74 KiB/s wr, 10 op/s 2023-05-08T07:15:47.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:15:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:47 smithi186 ceph-mon[126480]: pgmap v6823: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 74 KiB/s wr, 10 op/s 2023-05-08T07:15:47.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:15:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:48 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:15:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:15:48.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:15:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:48 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:15:48.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:15:48.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:15:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:48 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:15:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:15:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:15:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:49 smithi133 ceph-mon[125939]: pgmap v6824: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 74 KiB/s wr, 7 op/s 2023-05-08T07:15:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12687.850701 secs 2023-05-08T07:15:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:49 smithi096 ceph-mon[124666]: pgmap v6824: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 74 KiB/s wr, 7 op/s 2023-05-08T07:15:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12687.850701 secs 2023-05-08T07:15:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:49 smithi186 ceph-mon[126480]: pgmap v6824: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 74 KiB/s wr, 7 op/s 2023-05-08T07:15:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12687.850701 secs 2023-05-08T07:15:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:51 smithi133 ceph-mon[125939]: pgmap v6825: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 212 KiB/s wr, 12 op/s 2023-05-08T07:15:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:51 smithi096 ceph-mon[124666]: pgmap v6825: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 212 KiB/s wr, 12 op/s 2023-05-08T07:15:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:51 smithi186 ceph-mon[126480]: pgmap v6825: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 212 KiB/s wr, 12 op/s 2023-05-08T07:15:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:53 smithi133 ceph-mon[125939]: pgmap v6826: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 177 KiB/s wr, 9 op/s 2023-05-08T07:15:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:53 smithi096 ceph-mon[124666]: pgmap v6826: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 177 KiB/s wr, 9 op/s 2023-05-08T07:15:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:53 smithi186 ceph-mon[126480]: pgmap v6826: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 177 KiB/s wr, 9 op/s 2023-05-08T07:15:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12692.850816 secs 2023-05-08T07:15:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:15:54.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12693.408456 secs 2023-05-08T07:15:54.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:15:54.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:15:54.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:15:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12692.850816 secs 2023-05-08T07:15:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:15:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12693.408456 secs 2023-05-08T07:15:54.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:15:54.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:15:54.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:15:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12692.850816 secs 2023-05-08T07:15:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:15:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12693.408456 secs 2023-05-08T07:15:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:15:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:15:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:15:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:55 smithi133 ceph-mon[125939]: pgmap v6827: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 177 KiB/s wr, 9 op/s 2023-05-08T07:15:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:55 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:15:55.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:55 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T07:15:55.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:55 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T07:15:55.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:55 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:15:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:55 smithi096 ceph-mon[124666]: pgmap v6827: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 177 KiB/s wr, 9 op/s 2023-05-08T07:15:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:55 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:15:55.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:55 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T07:15:55.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:55 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T07:15:55.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:55 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:15:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:55 smithi186 ceph-mon[126480]: pgmap v6827: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 177 KiB/s wr, 9 op/s 2023-05-08T07:15:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:55 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:15:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:55 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T07:15:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:55 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T07:15:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:55 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:15:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:56 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:15:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:15:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:15:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:56 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:15:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:15:56.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:15:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:56 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:15:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:15:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:15:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:57 smithi133 ceph-mon[125939]: pgmap v6828: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 221 KiB/s wr, 13 op/s 2023-05-08T07:15:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:57 smithi096 ceph-mon[124666]: pgmap v6828: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 221 KiB/s wr, 13 op/s 2023-05-08T07:15:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:57 smithi186 ceph-mon[126480]: pgmap v6828: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 221 KiB/s wr, 13 op/s 2023-05-08T07:15:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:59 smithi133 ceph-mon[125939]: pgmap v6829: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 181 KiB/s wr, 9 op/s 2023-05-08T07:15:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12697.850948 secs 2023-05-08T07:15:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:15:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12698.408569 secs 2023-05-08T07:15:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:59 smithi096 ceph-mon[124666]: pgmap v6829: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 181 KiB/s wr, 9 op/s 2023-05-08T07:15:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12697.850948 secs 2023-05-08T07:15:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:15:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12698.408569 secs 2023-05-08T07:15:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:59 smithi186 ceph-mon[126480]: pgmap v6829: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 181 KiB/s wr, 9 op/s 2023-05-08T07:15:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12697.850948 secs 2023-05-08T07:15:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:15:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12698.408569 secs 2023-05-08T07:16:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:01 smithi133 ceph-mon[125939]: pgmap v6830: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 276 KiB/s wr, 13 op/s 2023-05-08T07:16:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:01 smithi096 ceph-mon[124666]: pgmap v6830: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 276 KiB/s wr, 13 op/s 2023-05-08T07:16:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:01 smithi186 ceph-mon[126480]: pgmap v6830: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 276 KiB/s wr, 13 op/s 2023-05-08T07:16:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:03 smithi133 ceph-mon[125939]: pgmap v6831: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 139 KiB/s wr, 8 op/s 2023-05-08T07:16:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:03 smithi096 ceph-mon[124666]: pgmap v6831: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 139 KiB/s wr, 8 op/s 2023-05-08T07:16:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:03 smithi186 ceph-mon[126480]: pgmap v6831: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 139 KiB/s wr, 8 op/s 2023-05-08T07:16:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12702.851065 secs 2023-05-08T07:16:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12703.408698 secs 2023-05-08T07:16:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12702.851065 secs 2023-05-08T07:16:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12703.408698 secs 2023-05-08T07:16:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12702.851065 secs 2023-05-08T07:16:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12703.408698 secs 2023-05-08T07:16:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:05 smithi133 ceph-mon[125939]: pgmap v6832: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 139 KiB/s wr, 8 op/s 2023-05-08T07:16:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:05 smithi096 ceph-mon[124666]: pgmap v6832: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 139 KiB/s wr, 8 op/s 2023-05-08T07:16:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:05 smithi186 ceph-mon[126480]: pgmap v6832: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 139 KiB/s wr, 8 op/s 2023-05-08T07:16:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12704.691004 secs 2023-05-08T07:16:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:06 smithi133 ceph-mon[125939]: osdmap e504: 12 total, 12 up, 12 in 2023-05-08T07:16:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12704.691004 secs 2023-05-08T07:16:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:06 smithi096 ceph-mon[124666]: osdmap e504: 12 total, 12 up, 12 in 2023-05-08T07:16:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12704.691004 secs 2023-05-08T07:16:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:06 smithi186 ceph-mon[126480]: osdmap e504: 12 total, 12 up, 12 in 2023-05-08T07:16:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:07 smithi133 ceph-mon[125939]: pgmap v6834: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 258 KiB/s wr, 28 op/s 2023-05-08T07:16:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:07 smithi096 ceph-mon[124666]: pgmap v6834: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 258 KiB/s wr, 28 op/s 2023-05-08T07:16:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:07 smithi186 ceph-mon[126480]: pgmap v6834: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 258 KiB/s wr, 28 op/s 2023-05-08T07:16:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:08 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:16:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:16:08.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:16:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:08 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:16:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:16:08.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:16:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:08 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:16:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:16:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:16:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:09 smithi133 ceph-mon[125939]: pgmap v6835: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 258 KiB/s wr, 28 op/s 2023-05-08T07:16:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12707.851198 secs 2023-05-08T07:16:09.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12708.408836 secs 2023-05-08T07:16:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:09 smithi096 ceph-mon[124666]: pgmap v6835: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 258 KiB/s wr, 28 op/s 2023-05-08T07:16:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12707.851198 secs 2023-05-08T07:16:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12708.408836 secs 2023-05-08T07:16:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:09 smithi186 ceph-mon[126480]: pgmap v6835: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 258 KiB/s wr, 28 op/s 2023-05-08T07:16:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12707.851198 secs 2023-05-08T07:16:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12708.408836 secs 2023-05-08T07:16:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:11 smithi133 ceph-mon[125939]: pgmap v6836: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 281 KiB/s wr, 28 op/s 2023-05-08T07:16:11.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12709.691081 secs 2023-05-08T07:16:11.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:11 smithi133 ceph-mon[125939]: osdmap e505: 12 total, 12 up, 12 in 2023-05-08T07:16:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:11 smithi096 ceph-mon[124666]: pgmap v6836: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 281 KiB/s wr, 28 op/s 2023-05-08T07:16:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12709.691081 secs 2023-05-08T07:16:11.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:11 smithi096 ceph-mon[124666]: osdmap e505: 12 total, 12 up, 12 in 2023-05-08T07:16:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:11 smithi186 ceph-mon[126480]: pgmap v6836: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 281 KiB/s wr, 28 op/s 2023-05-08T07:16:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12709.691081 secs 2023-05-08T07:16:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:11 smithi186 ceph-mon[126480]: osdmap e505: 12 total, 12 up, 12 in 2023-05-08T07:16:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:13 smithi133 ceph-mon[125939]: pgmap v6838: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 288 KiB/s rd, 351 KiB/s wr, 35 op/s 2023-05-08T07:16:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:13 smithi096 ceph-mon[124666]: pgmap v6838: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 288 KiB/s rd, 351 KiB/s wr, 35 op/s 2023-05-08T07:16:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:13 smithi186 ceph-mon[126480]: pgmap v6838: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 288 KiB/s rd, 351 KiB/s wr, 35 op/s 2023-05-08T07:16:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12712.851352 secs 2023-05-08T07:16:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12713.408939 secs 2023-05-08T07:16:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12712.851352 secs 2023-05-08T07:16:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12713.408939 secs 2023-05-08T07:16:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12712.851352 secs 2023-05-08T07:16:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12713.408939 secs 2023-05-08T07:16:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:15 smithi133 ceph-mon[125939]: pgmap v6839: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 163 KiB/s wr, 6 op/s 2023-05-08T07:16:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:15 smithi096 ceph-mon[124666]: pgmap v6839: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 163 KiB/s wr, 6 op/s 2023-05-08T07:16:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:15 smithi186 ceph-mon[126480]: pgmap v6839: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 163 KiB/s wr, 6 op/s 2023-05-08T07:16:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12714.691174 secs 2023-05-08T07:16:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12714.691174 secs 2023-05-08T07:16:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12714.691174 secs 2023-05-08T07:16:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:17 smithi133 ceph-mon[125939]: pgmap v6840: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 176 KiB/s wr, 10 op/s 2023-05-08T07:16:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:17 smithi096 ceph-mon[124666]: pgmap v6840: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 176 KiB/s wr, 10 op/s 2023-05-08T07:16:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:17 smithi186 ceph-mon[126480]: pgmap v6840: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 176 KiB/s wr, 10 op/s 2023-05-08T07:16:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:19 smithi133 ceph-mon[125939]: pgmap v6841: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 176 KiB/s wr, 10 op/s 2023-05-08T07:16:19.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12717.851451 secs 2023-05-08T07:16:19.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12718.409057 secs 2023-05-08T07:16:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:19 smithi096 ceph-mon[124666]: pgmap v6841: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 176 KiB/s wr, 10 op/s 2023-05-08T07:16:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12717.851451 secs 2023-05-08T07:16:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12718.409057 secs 2023-05-08T07:16:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:19 smithi186 ceph-mon[126480]: pgmap v6841: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 176 KiB/s wr, 10 op/s 2023-05-08T07:16:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12717.851451 secs 2023-05-08T07:16:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12718.409057 secs 2023-05-08T07:16:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:21 smithi133 ceph-mon[125939]: pgmap v6842: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 67 KiB/s wr, 8 op/s 2023-05-08T07:16:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12719.691293 secs 2023-05-08T07:16:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:21 smithi096 ceph-mon[124666]: pgmap v6842: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 67 KiB/s wr, 8 op/s 2023-05-08T07:16:21.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12719.691293 secs 2023-05-08T07:16:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:21 smithi186 ceph-mon[126480]: pgmap v6842: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 67 KiB/s wr, 8 op/s 2023-05-08T07:16:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12719.691293 secs 2023-05-08T07:16:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:23 smithi133 ceph-mon[125939]: pgmap v6843: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 62 KiB/s wr, 8 op/s 2023-05-08T07:16:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:23 smithi096 ceph-mon[124666]: pgmap v6843: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 62 KiB/s wr, 8 op/s 2023-05-08T07:16:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:23 smithi186 ceph-mon[126480]: pgmap v6843: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 62 KiB/s wr, 8 op/s 2023-05-08T07:16:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12722.851565 secs 2023-05-08T07:16:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12723.409178 secs 2023-05-08T07:16:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12722.851565 secs 2023-05-08T07:16:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12723.409178 secs 2023-05-08T07:16:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12722.851565 secs 2023-05-08T07:16:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12723.409178 secs 2023-05-08T07:16:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:25 smithi133 ceph-mon[125939]: pgmap v6844: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 56 KiB/s wr, 7 op/s 2023-05-08T07:16:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:25 smithi096 ceph-mon[124666]: pgmap v6844: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 56 KiB/s wr, 7 op/s 2023-05-08T07:16:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:25 smithi186 ceph-mon[126480]: pgmap v6844: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 56 KiB/s wr, 7 op/s 2023-05-08T07:16:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12724.691418 secs 2023-05-08T07:16:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12724.691418 secs 2023-05-08T07:16:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12724.691418 secs 2023-05-08T07:16:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:27 smithi096 ceph-mon[124666]: pgmap v6845: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 89 KiB/s wr, 10 op/s 2023-05-08T07:16:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:27 smithi186 ceph-mon[126480]: pgmap v6845: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 89 KiB/s wr, 10 op/s 2023-05-08T07:16:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:27 smithi133 ceph-mon[125939]: pgmap v6845: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 89 KiB/s wr, 10 op/s 2023-05-08T07:16:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:29 smithi096 ceph-mon[124666]: pgmap v6846: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 57 KiB/s wr, 6 op/s 2023-05-08T07:16:29.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12727.851686 secs 2023-05-08T07:16:29.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12728.409331 secs 2023-05-08T07:16:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:29 smithi186 ceph-mon[126480]: pgmap v6846: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 57 KiB/s wr, 6 op/s 2023-05-08T07:16:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12727.851686 secs 2023-05-08T07:16:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12728.409331 secs 2023-05-08T07:16:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:29 smithi133 ceph-mon[125939]: pgmap v6846: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 57 KiB/s wr, 6 op/s 2023-05-08T07:16:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12727.851686 secs 2023-05-08T07:16:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12728.409331 secs 2023-05-08T07:16:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:31 smithi096 ceph-mon[124666]: pgmap v6847: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 58 KiB/s wr, 9 op/s 2023-05-08T07:16:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12729.691556 secs 2023-05-08T07:16:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:31 smithi186 ceph-mon[126480]: pgmap v6847: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 58 KiB/s wr, 9 op/s 2023-05-08T07:16:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12729.691556 secs 2023-05-08T07:16:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:31 smithi133 ceph-mon[125939]: pgmap v6847: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 58 KiB/s wr, 9 op/s 2023-05-08T07:16:31.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12729.691556 secs 2023-05-08T07:16:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:33 smithi186 ceph-mon[126480]: pgmap v6848: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T07:16:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:33 smithi133 ceph-mon[125939]: pgmap v6848: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T07:16:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:33 smithi096 ceph-mon[124666]: pgmap v6848: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T07:16:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12732.851805 secs 2023-05-08T07:16:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12733.409461 secs 2023-05-08T07:16:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12732.851805 secs 2023-05-08T07:16:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12733.409461 secs 2023-05-08T07:16:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12732.851805 secs 2023-05-08T07:16:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12733.409461 secs 2023-05-08T07:16:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:35 smithi186 ceph-mon[126480]: pgmap v6849: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T07:16:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:35 smithi133 ceph-mon[125939]: pgmap v6849: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T07:16:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:35 smithi096 ceph-mon[124666]: pgmap v6849: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T07:16:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:37 smithi186 ceph-mon[126480]: pgmap v6850: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 66 KiB/s wr, 9 op/s 2023-05-08T07:16:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:37 smithi133 ceph-mon[125939]: pgmap v6850: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 66 KiB/s wr, 9 op/s 2023-05-08T07:16:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:37 smithi096 ceph-mon[124666]: pgmap v6850: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 66 KiB/s wr, 9 op/s 2023-05-08T07:16:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:39 smithi186 ceph-mon[126480]: pgmap v6851: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T07:16:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12737.851939 secs 2023-05-08T07:16:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:39 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:16:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12738.409582 secs 2023-05-08T07:16:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:39 smithi133 ceph-mon[125939]: pgmap v6851: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T07:16:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12737.851939 secs 2023-05-08T07:16:39.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:39 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:16:39.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12738.409582 secs 2023-05-08T07:16:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:39 smithi096 ceph-mon[124666]: pgmap v6851: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T07:16:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12737.851939 secs 2023-05-08T07:16:40.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:39 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:16:40.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12738.409582 secs 2023-05-08T07:16:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:40 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:16:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:40 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:16:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:40 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:16:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:40 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:16:40.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:40 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:16:40.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:40 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:16:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:40 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:16:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:40 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:16:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:40 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:16:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:41 smithi186 ceph-mon[126480]: pgmap v6852: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 114 KiB/s wr, 10 op/s 2023-05-08T07:16:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:41 smithi133 ceph-mon[125939]: pgmap v6852: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 114 KiB/s wr, 10 op/s 2023-05-08T07:16:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:41 smithi096 ceph-mon[124666]: pgmap v6852: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 114 KiB/s wr, 10 op/s 2023-05-08T07:16:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:43 smithi186 ceph-mon[126480]: pgmap v6853: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 113 KiB/s wr, 7 op/s 2023-05-08T07:16:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:43 smithi133 ceph-mon[125939]: pgmap v6853: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 113 KiB/s wr, 7 op/s 2023-05-08T07:16:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:43 smithi096 ceph-mon[124666]: pgmap v6853: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 113 KiB/s wr, 7 op/s 2023-05-08T07:16:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12742.852061 secs 2023-05-08T07:16:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12743.409704 secs 2023-05-08T07:16:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12742.852061 secs 2023-05-08T07:16:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12743.409704 secs 2023-05-08T07:16:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12742.852061 secs 2023-05-08T07:16:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12743.409704 secs 2023-05-08T07:16:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:45 smithi186 ceph-mon[126480]: pgmap v6854: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 113 KiB/s wr, 7 op/s 2023-05-08T07:16:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:45 smithi133 ceph-mon[125939]: pgmap v6854: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 113 KiB/s wr, 7 op/s 2023-05-08T07:16:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:45 smithi096 ceph-mon[124666]: pgmap v6854: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 113 KiB/s wr, 7 op/s 2023-05-08T07:16:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:47 smithi186 ceph-mon[126480]: pgmap v6855: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 153 KiB/s wr, 12 op/s 2023-05-08T07:16:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:47 smithi133 ceph-mon[125939]: pgmap v6855: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 153 KiB/s wr, 12 op/s 2023-05-08T07:16:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:47 smithi096 ceph-mon[124666]: pgmap v6855: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 153 KiB/s wr, 12 op/s 2023-05-08T07:16:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:49 smithi186 ceph-mon[126480]: pgmap v6856: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 122 KiB/s wr, 8 op/s 2023-05-08T07:16:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12747.852184 secs 2023-05-08T07:16:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12748.409772 secs 2023-05-08T07:16:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:49 smithi133 ceph-mon[125939]: pgmap v6856: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 122 KiB/s wr, 8 op/s 2023-05-08T07:16:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12747.852184 secs 2023-05-08T07:16:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12748.409772 secs 2023-05-08T07:16:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:49 smithi096 ceph-mon[124666]: pgmap v6856: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 122 KiB/s wr, 8 op/s 2023-05-08T07:16:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12747.852184 secs 2023-05-08T07:16:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12748.409772 secs 2023-05-08T07:16:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:51 smithi186 ceph-mon[126480]: pgmap v6857: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 377 KiB/s rd, 321 KiB/s wr, 13 op/s 2023-05-08T07:16:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:51 smithi133 ceph-mon[125939]: pgmap v6857: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 377 KiB/s rd, 321 KiB/s wr, 13 op/s 2023-05-08T07:16:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:51 smithi096 ceph-mon[124666]: pgmap v6857: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 377 KiB/s rd, 321 KiB/s wr, 13 op/s 2023-05-08T07:16:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:53 smithi186 ceph-mon[126480]: pgmap v6858: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 336 KiB/s rd, 240 KiB/s wr, 9 op/s 2023-05-08T07:16:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:53 smithi133 ceph-mon[125939]: pgmap v6858: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 336 KiB/s rd, 240 KiB/s wr, 9 op/s 2023-05-08T07:16:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:53 smithi096 ceph-mon[124666]: pgmap v6858: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 336 KiB/s rd, 240 KiB/s wr, 9 op/s 2023-05-08T07:16:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12752.852324 secs 2023-05-08T07:16:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:16:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12752.852324 secs 2023-05-08T07:16:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:16:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12752.852324 secs 2023-05-08T07:16:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:16:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:55 smithi186 ceph-mon[126480]: pgmap v6859: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 336 KiB/s rd, 240 KiB/s wr, 9 op/s 2023-05-08T07:16:55.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:55 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:16:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:55 smithi133 ceph-mon[125939]: pgmap v6859: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 336 KiB/s rd, 240 KiB/s wr, 9 op/s 2023-05-08T07:16:55.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:55 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:16:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:55 smithi096 ceph-mon[124666]: pgmap v6859: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 336 KiB/s rd, 240 KiB/s wr, 9 op/s 2023-05-08T07:16:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:55 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:16:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:56 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:16:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:16:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:16:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:56 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:16:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:16:56.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:16:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:56 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:16:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:16:57.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:16:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:57 smithi186 ceph-mon[126480]: pgmap v6860: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 284 KiB/s wr, 13 op/s 2023-05-08T07:16:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:16:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:16:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:16:57.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:16:57.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:16:57.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:16:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:57 smithi133 ceph-mon[125939]: pgmap v6860: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 284 KiB/s wr, 13 op/s 2023-05-08T07:16:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:16:57.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:16:57.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:16:57.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:16:57.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:16:57.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:16:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:57 smithi096 ceph-mon[124666]: pgmap v6860: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 284 KiB/s wr, 13 op/s 2023-05-08T07:16:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:16:58.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:16:58.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:16:58.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:16:58.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:16:58.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:16:59.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:58 smithi133 ceph-mon[125939]: pgmap v6861: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 244 KiB/s wr, 8 op/s 2023-05-08T07:16:59.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:16:59.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:16:59.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:16:59.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:16:59.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:16:59.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:16:59.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:16:59.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:16:59.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:16:59.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:16:59.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:58 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi096 to 160.6M 2023-05-08T07:16:59.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:16:59.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:58 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi096 to 168454230: error parsing value: Value '168454230' is below minimum 939524096 2023-05-08T07:16:59.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:16:59.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:58 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T07:16:59.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:58 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T07:16:59.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:16:59.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:16:59.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:16:59.244 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:16:59.244 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:16:59.244 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:16:59.244 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:58 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T07:16:59.244 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:58 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T07:16:59.244 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:16:59.244 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:16:59.245 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:58 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:16:59.245 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:16:59.245 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:58 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T07:16:59.245 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:58 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T07:16:59.245 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:58 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:16:59.245 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12757.852350 secs 2023-05-08T07:16:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:58 smithi096 ceph-mon[124666]: pgmap v6861: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 244 KiB/s wr, 8 op/s 2023-05-08T07:16:59.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:16:59.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:16:59.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:16:59.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:16:59.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:16:59.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:16:59.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:16:59.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:16:59.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:16:59.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:16:59.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:58 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi096 to 160.6M 2023-05-08T07:16:59.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:16:59.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:58 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi096 to 168454230: error parsing value: Value '168454230' is below minimum 939524096 2023-05-08T07:16:59.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:16:59.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:58 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T07:16:59.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:58 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T07:16:59.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:16:59.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:16:59.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:16:59.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:16:59.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:16:59.259 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:16:59.259 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:58 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T07:16:59.259 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:58 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T07:16:59.259 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:16:59.259 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:16:59.259 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:58 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:16:59.260 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:16:59.260 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:58 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T07:16:59.260 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:58 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T07:16:59.260 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:58 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:16:59.260 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12757.852350 secs 2023-05-08T07:16:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:58 smithi186 ceph-mon[126480]: pgmap v6861: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 244 KiB/s wr, 8 op/s 2023-05-08T07:16:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:16:59.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:16:59.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:16:59.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:16:59.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:16:59.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:16:59.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:16:59.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:16:59.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:16:59.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:16:59.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:58 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi096 to 160.6M 2023-05-08T07:16:59.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:16:59.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:58 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi096 to 168454230: error parsing value: Value '168454230' is below minimum 939524096 2023-05-08T07:16:59.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:16:59.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:58 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T07:16:59.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:58 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T07:16:59.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:16:59.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:16:59.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:16:59.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:16:59.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:16:59.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:16:59.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:58 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T07:16:59.373 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:58 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T07:16:59.373 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:16:59.373 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:16:59.373 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:58 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:16:59.373 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:16:59.373 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:58 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T07:16:59.373 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:58 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T07:16:59.373 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:58 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:16:59.374 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12757.852350 secs 2023-05-08T07:17:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:16:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12758.410018 secs 2023-05-08T07:17:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:16:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12758.410018 secs 2023-05-08T07:17:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:16:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12758.410018 secs 2023-05-08T07:17:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:17:00 smithi133 ceph-mon[125939]: pgmap v6862: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 309 KiB/s wr, 12 op/s 2023-05-08T07:17:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:17:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12759.692218 secs 2023-05-08T07:17:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:17:00 smithi096 ceph-mon[124666]: pgmap v6862: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 309 KiB/s wr, 12 op/s 2023-05-08T07:17:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:17:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12759.692218 secs 2023-05-08T07:17:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:17:00 smithi186 ceph-mon[126480]: pgmap v6862: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 309 KiB/s wr, 12 op/s 2023-05-08T07:17:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:17:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12759.692218 secs 2023-05-08T07:17:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:17:02 smithi096 ceph-mon[124666]: pgmap v6863: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 109 KiB/s wr, 8 op/s 2023-05-08T07:17:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:17:02 smithi186 ceph-mon[126480]: pgmap v6863: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 109 KiB/s wr, 8 op/s 2023-05-08T07:17:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:17:03 smithi133 ceph-mon[125939]: pgmap v6863: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 109 KiB/s wr, 8 op/s 2023-05-08T07:17:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:17:04 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:17:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:17:04 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:17:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:17:04 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:17:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:17:04 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:17:04.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:17:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12762.852437 secs 2023-05-08T07:17:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:17:04 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:17:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:17:04 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:17:04.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:17:04 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:17:04.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:17:04 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:17:04.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:17:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12762.852437 secs 2023-05-08T07:17:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:17:04 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:17:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:17:04 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:17:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:17:04 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:17:04.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:17:04 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:17:04.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:17:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12762.852437 secs 2023-05-08T07:17:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:17:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12763.410154 secs 2023-05-08T07:17:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:17:05 smithi186 ceph-mon[126480]: pgmap v6864: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 109 KiB/s wr, 8 op/s 2023-05-08T07:17:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:17:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12763.410154 secs 2023-05-08T07:17:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:17:05 smithi133 ceph-mon[125939]: pgmap v6864: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 109 KiB/s wr, 8 op/s 2023-05-08T07:17:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:17:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12763.410154 secs 2023-05-08T07:17:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:17:05 smithi096 ceph-mon[124666]: pgmap v6864: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 109 KiB/s wr, 8 op/s 2023-05-08T07:17:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:17:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12764.692352 secs 2023-05-08T07:17:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:17:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12764.692352 secs 2023-05-08T07:17:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:17:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12764.692352 secs 2023-05-08T07:17:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:17:07 smithi186 ceph-mon[126480]: pgmap v6865: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 200 KiB/s wr, 26 op/s 2023-05-08T07:17:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:17:07 smithi133 ceph-mon[125939]: pgmap v6865: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 200 KiB/s wr, 26 op/s 2023-05-08T07:17:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:17:07 smithi096 ceph-mon[124666]: pgmap v6865: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 200 KiB/s wr, 26 op/s 2023-05-08T07:17:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:17:09 smithi186 ceph-mon[126480]: pgmap v6866: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 155 KiB/s wr, 22 op/s 2023-05-08T07:17:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:17:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12767.852584 secs 2023-05-08T07:17:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:17:09 smithi133 ceph-mon[125939]: pgmap v6866: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 155 KiB/s wr, 22 op/s 2023-05-08T07:17:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:17:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12767.852584 secs 2023-05-08T07:17:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:17:09 smithi096 ceph-mon[124666]: pgmap v6866: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 155 KiB/s wr, 22 op/s 2023-05-08T07:17:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:17:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12767.852584 secs 2023-05-08T07:17:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:17:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12768.410269 secs 2023-05-08T07:17:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:17:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12768.410269 secs 2023-05-08T07:17:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:17:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12768.410269 secs 2023-05-08T07:17:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:17:11 smithi186 ceph-mon[126480]: pgmap v6867: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 215 KiB/s wr, 26 op/s 2023-05-08T07:17:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:17:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12769.692490 secs 2023-05-08T07:17:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:17:11 smithi186 ceph-mon[126480]: osdmap e506: 12 total, 12 up, 12 in 2023-05-08T07:17:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:17:11 smithi133 ceph-mon[125939]: pgmap v6867: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 215 KiB/s wr, 26 op/s 2023-05-08T07:17:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:17:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12769.692490 secs 2023-05-08T07:17:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:17:11 smithi133 ceph-mon[125939]: osdmap e506: 12 total, 12 up, 12 in 2023-05-08T07:17:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:17:11 smithi096 ceph-mon[124666]: pgmap v6867: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 215 KiB/s wr, 26 op/s 2023-05-08T07:17:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:17:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12769.692490 secs 2023-05-08T07:17:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:17:11 smithi096 ceph-mon[124666]: osdmap e506: 12 total, 12 up, 12 in 2023-05-08T07:17:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:17:13 smithi186 ceph-mon[126480]: pgmap v6869: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 181 KiB/s wr, 26 op/s 2023-05-08T07:17:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:17:13 smithi133 ceph-mon[125939]: pgmap v6869: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 181 KiB/s wr, 26 op/s 2023-05-08T07:17:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:17:13 smithi096 ceph-mon[124666]: pgmap v6869: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 181 KiB/s wr, 26 op/s 2023-05-08T07:17:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:17:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12772.852648 secs 2023-05-08T07:17:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:17:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12772.852648 secs 2023-05-08T07:17:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:17:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12772.852648 secs 2023-05-08T07:17:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:17:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12773.410387 secs 2023-05-08T07:17:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:17:15 smithi186 ceph-mon[126480]: pgmap v6870: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 181 KiB/s wr, 26 op/s 2023-05-08T07:17:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:17:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12773.410387 secs 2023-05-08T07:17:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:17:15 smithi133 ceph-mon[125939]: pgmap v6870: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 181 KiB/s wr, 26 op/s 2023-05-08T07:17:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:17:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12773.410387 secs 2023-05-08T07:17:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:17:15 smithi096 ceph-mon[124666]: pgmap v6870: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 181 KiB/s wr, 26 op/s 2023-05-08T07:17:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:17:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12774.692628 secs 2023-05-08T07:17:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:17:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12774.692628 secs 2023-05-08T07:17:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:17:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12774.692628 secs 2023-05-08T07:17:17.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:17:17 smithi186 ceph-mon[126480]: pgmap v6871: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 145 KiB/s wr, 10 op/s 2023-05-08T07:17:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:17:17 smithi133 ceph-mon[125939]: pgmap v6871: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 145 KiB/s wr, 10 op/s 2023-05-08T07:17:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:17:17 smithi096 ceph-mon[124666]: pgmap v6871: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 145 KiB/s wr, 10 op/s 2023-05-08T07:17:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:17:19 smithi186 ceph-mon[126480]: pgmap v6872: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 145 KiB/s wr, 10 op/s 2023-05-08T07:17:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:17:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12777.852740 secs 2023-05-08T07:17:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:17:19 smithi133 ceph-mon[125939]: pgmap v6872: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 145 KiB/s wr, 10 op/s 2023-05-08T07:17:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:17:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12777.852740 secs 2023-05-08T07:17:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:17:19 smithi096 ceph-mon[124666]: pgmap v6872: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 145 KiB/s wr, 10 op/s 2023-05-08T07:17:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:17:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12777.852740 secs 2023-05-08T07:17:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:17:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12778.410511 secs 2023-05-08T07:17:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:17:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12778.410511 secs 2023-05-08T07:17:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:17:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12778.410511 secs 2023-05-08T07:17:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:17:21 smithi186 ceph-mon[126480]: pgmap v6873: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 114 KiB/s wr, 9 op/s 2023-05-08T07:17:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:17:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12779.692745 secs 2023-05-08T07:17:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:17:21 smithi186 ceph-mon[126480]: osdmap e507: 12 total, 12 up, 12 in 2023-05-08T07:17:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:17:21 smithi133 ceph-mon[125939]: pgmap v6873: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 114 KiB/s wr, 9 op/s 2023-05-08T07:17:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:17:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12779.692745 secs 2023-05-08T07:17:21.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:17:21 smithi133 ceph-mon[125939]: osdmap e507: 12 total, 12 up, 12 in 2023-05-08T07:17:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:17:21 smithi096 ceph-mon[124666]: pgmap v6873: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 114 KiB/s wr, 9 op/s 2023-05-08T07:17:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:17:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12779.692745 secs 2023-05-08T07:17:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:17:21 smithi096 ceph-mon[124666]: osdmap e507: 12 total, 12 up, 12 in 2023-05-08T07:17:23.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:17:23 smithi186 ceph-mon[126480]: pgmap v6875: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 114 KiB/s wr, 9 op/s 2023-05-08T07:17:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:17:23 smithi133 ceph-mon[125939]: pgmap v6875: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 114 KiB/s wr, 9 op/s 2023-05-08T07:17:23.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:17:23 smithi096 ceph-mon[124666]: pgmap v6875: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 114 KiB/s wr, 9 op/s 2023-05-08T07:17:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:17:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12782.852842 secs 2023-05-08T07:17:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:17:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12782.852842 secs 2023-05-08T07:17:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:17:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12782.852842 secs 2023-05-08T07:17:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:17:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12783.410628 secs 2023-05-08T07:17:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:17:25 smithi186 ceph-mon[126480]: pgmap v6876: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 114 KiB/s wr, 9 op/s 2023-05-08T07:17:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:17:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12783.410628 secs 2023-05-08T07:17:25.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:17:25 smithi133 ceph-mon[125939]: pgmap v6876: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 114 KiB/s wr, 9 op/s 2023-05-08T07:17:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:17:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12783.410628 secs 2023-05-08T07:17:25.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:17:25 smithi096 ceph-mon[124666]: pgmap v6876: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 114 KiB/s wr, 9 op/s 2023-05-08T07:17:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:17:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12784.692863 secs 2023-05-08T07:17:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:17:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12784.692863 secs 2023-05-08T07:17:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:17:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12784.692863 secs 2023-05-08T07:17:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:17:27 smithi186 ceph-mon[126480]: pgmap v6877: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 42 KiB/s wr, 8 op/s 2023-05-08T07:17:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:17:27 smithi133 ceph-mon[125939]: pgmap v6877: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 42 KiB/s wr, 8 op/s 2023-05-08T07:17:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:17:27 smithi096 ceph-mon[124666]: pgmap v6877: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 42 KiB/s wr, 8 op/s 2023-05-08T07:17:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:17:29 smithi186 ceph-mon[126480]: pgmap v6878: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 42 KiB/s wr, 8 op/s 2023-05-08T07:17:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:17:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12787.852959 secs 2023-05-08T07:17:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:17:29 smithi133 ceph-mon[125939]: pgmap v6878: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 42 KiB/s wr, 8 op/s 2023-05-08T07:17:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:17:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12787.852959 secs 2023-05-08T07:17:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:17:29 smithi096 ceph-mon[124666]: pgmap v6878: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 42 KiB/s wr, 8 op/s 2023-05-08T07:17:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:17:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12787.852959 secs 2023-05-08T07:17:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:17:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12788.410741 secs 2023-05-08T07:17:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:17:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12788.410741 secs 2023-05-08T07:17:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:17:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12788.410741 secs 2023-05-08T07:17:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:17:31 smithi186 ceph-mon[126480]: pgmap v6879: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 42 KiB/s wr, 8 op/s 2023-05-08T07:17:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:17:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12789.692989 secs 2023-05-08T07:17:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:17:31 smithi133 ceph-mon[125939]: pgmap v6879: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 42 KiB/s wr, 8 op/s 2023-05-08T07:17:31.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:17:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12789.692989 secs 2023-05-08T07:17:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:17:31 smithi096 ceph-mon[124666]: pgmap v6879: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 42 KiB/s wr, 8 op/s 2023-05-08T07:17:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:17:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12789.692989 secs 2023-05-08T07:17:33.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:17:33 smithi186 ceph-mon[126480]: pgmap v6880: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 38 KiB/s wr, 7 op/s 2023-05-08T07:17:33.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:17:33 smithi133 ceph-mon[125939]: pgmap v6880: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 38 KiB/s wr, 7 op/s 2023-05-08T07:17:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:17:33 smithi096 ceph-mon[124666]: pgmap v6880: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 38 KiB/s wr, 7 op/s 2023-05-08T07:17:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:17:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12792.853100 secs 2023-05-08T07:17:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:17:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12792.853100 secs 2023-05-08T07:17:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:17:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12792.853100 secs 2023-05-08T07:17:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:17:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12793.410853 secs 2023-05-08T07:17:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:17:35 smithi186 ceph-mon[126480]: pgmap v6881: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 35 KiB/s wr, 6 op/s 2023-05-08T07:17:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:17:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12793.410853 secs 2023-05-08T07:17:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:17:35 smithi133 ceph-mon[125939]: pgmap v6881: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 35 KiB/s wr, 6 op/s 2023-05-08T07:17:35.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:17:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12793.410853 secs 2023-05-08T07:17:35.509 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:17:35 smithi096 ceph-mon[124666]: pgmap v6881: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 35 KiB/s wr, 6 op/s 2023-05-08T07:17:37.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:17:37 smithi186 ceph-mon[126480]: pgmap v6882: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 35 KiB/s wr, 9 op/s 2023-05-08T07:17:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:17:37 smithi133 ceph-mon[125939]: pgmap v6882: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 35 KiB/s wr, 9 op/s 2023-05-08T07:17:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:17:37 smithi096 ceph-mon[124666]: pgmap v6882: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 35 KiB/s wr, 9 op/s 2023-05-08T07:17:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:17:39 smithi186 ceph-mon[126480]: pgmap v6883: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T07:17:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:17:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12797.853199 secs 2023-05-08T07:17:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:17:39 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:17:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:17:39 smithi133 ceph-mon[125939]: pgmap v6883: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T07:17:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:17:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12797.853199 secs 2023-05-08T07:17:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:17:39 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:17:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:17:39 smithi096 ceph-mon[124666]: pgmap v6883: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T07:17:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:17:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12797.853199 secs 2023-05-08T07:17:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:17:39 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:17:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:17:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12798.410974 secs 2023-05-08T07:17:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:17:40 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:17:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:17:40 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:17:40.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:17:40 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:17:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:17:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12798.410974 secs 2023-05-08T07:17:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:17:40 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:17:40.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:17:40 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:17:40.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:17:40 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:17:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:17:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12798.410974 secs 2023-05-08T07:17:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:17:40 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:17:40.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:17:40 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:17:40.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:17:40 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:17:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:17:41 smithi186 ceph-mon[126480]: pgmap v6884: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 69 KiB/s wr, 9 op/s 2023-05-08T07:17:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:17:41 smithi133 ceph-mon[125939]: pgmap v6884: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 69 KiB/s wr, 9 op/s 2023-05-08T07:17:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:17:41 smithi096 ceph-mon[124666]: pgmap v6884: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 69 KiB/s wr, 9 op/s 2023-05-08T07:17:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:17:43 smithi133 ceph-mon[125939]: pgmap v6885: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 KiB/s wr, 5 op/s 2023-05-08T07:17:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:17:43 smithi096 ceph-mon[124666]: pgmap v6885: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 KiB/s wr, 5 op/s 2023-05-08T07:17:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:17:43 smithi186 ceph-mon[126480]: pgmap v6885: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 KiB/s wr, 5 op/s 2023-05-08T07:17:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:17:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12802.853316 secs 2023-05-08T07:17:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:17:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12802.853316 secs 2023-05-08T07:17:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:17:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12802.853316 secs 2023-05-08T07:17:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:17:45 smithi133 ceph-mon[125939]: pgmap v6886: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 KiB/s wr, 5 op/s 2023-05-08T07:17:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:17:45 smithi096 ceph-mon[124666]: pgmap v6886: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 KiB/s wr, 5 op/s 2023-05-08T07:17:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:17:45 smithi186 ceph-mon[126480]: pgmap v6886: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 KiB/s wr, 5 op/s 2023-05-08T07:17:47.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:17:47 smithi133 ceph-mon[125939]: pgmap v6887: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 76 KiB/s wr, 9 op/s 2023-05-08T07:17:47.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:17:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:17:47.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:17:47 smithi096 ceph-mon[124666]: pgmap v6887: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 76 KiB/s wr, 9 op/s 2023-05-08T07:17:47.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:17:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:17:47.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:17:47 smithi186 ceph-mon[126480]: pgmap v6887: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 76 KiB/s wr, 9 op/s 2023-05-08T07:17:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:17:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:17:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:17:48 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:17:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:17:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:17:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:17:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:17:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:17:48 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:17:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:17:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:17:48.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:17:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:17:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:17:48 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:17:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:17:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:17:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:17:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:17:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:17:49 smithi133 ceph-mon[125939]: pgmap v6888: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 76 KiB/s wr, 7 op/s 2023-05-08T07:17:49.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:17:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12807.853432 secs 2023-05-08T07:17:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:17:49 smithi096 ceph-mon[124666]: pgmap v6888: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 76 KiB/s wr, 7 op/s 2023-05-08T07:17:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:17:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12807.853432 secs 2023-05-08T07:17:49.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:17:49 smithi186 ceph-mon[126480]: pgmap v6888: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 76 KiB/s wr, 7 op/s 2023-05-08T07:17:49.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:17:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12807.853432 secs 2023-05-08T07:17:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:17:51 smithi133 ceph-mon[125939]: pgmap v6889: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 173 KiB/s wr, 11 op/s 2023-05-08T07:17:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:17:51 smithi096 ceph-mon[124666]: pgmap v6889: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 173 KiB/s wr, 11 op/s 2023-05-08T07:17:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:17:51 smithi186 ceph-mon[126480]: pgmap v6889: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 173 KiB/s wr, 11 op/s 2023-05-08T07:17:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:17:53 smithi133 ceph-mon[125939]: pgmap v6890: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 138 KiB/s wr, 8 op/s 2023-05-08T07:17:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:17:53 smithi096 ceph-mon[124666]: pgmap v6890: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 138 KiB/s wr, 8 op/s 2023-05-08T07:17:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:17:53 smithi186 ceph-mon[126480]: pgmap v6890: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 138 KiB/s wr, 8 op/s 2023-05-08T07:17:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:17:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12812.853546 secs 2023-05-08T07:17:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:17:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12812.853546 secs 2023-05-08T07:17:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:17:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12812.853546 secs 2023-05-08T07:17:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:17:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12813.411322 secs 2023-05-08T07:17:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:17:55 smithi133 ceph-mon[125939]: pgmap v6891: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 138 KiB/s wr, 8 op/s 2023-05-08T07:17:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:17:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12813.411322 secs 2023-05-08T07:17:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:17:55 smithi096 ceph-mon[124666]: pgmap v6891: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 138 KiB/s wr, 8 op/s 2023-05-08T07:17:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:17:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12813.411322 secs 2023-05-08T07:17:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:17:55 smithi186 ceph-mon[126480]: pgmap v6891: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 138 KiB/s wr, 8 op/s 2023-05-08T07:17:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:17:56 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:17:56.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:17:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:17:56.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:17:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:17:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:17:56 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:17:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:17:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:17:56.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:17:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:17:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:17:56 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:17:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:17:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:17:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:17:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:17:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:17:57 smithi133 ceph-mon[125939]: pgmap v6892: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 183 KiB/s wr, 13 op/s 2023-05-08T07:17:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:17:57 smithi096 ceph-mon[124666]: pgmap v6892: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 183 KiB/s wr, 13 op/s 2023-05-08T07:17:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:17:57 smithi186 ceph-mon[126480]: pgmap v6892: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 183 KiB/s wr, 13 op/s 2023-05-08T07:17:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:17:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:17:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:17:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:17:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:17:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:17:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:17:59 smithi133 ceph-mon[125939]: pgmap v6893: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 142 KiB/s wr, 9 op/s 2023-05-08T07:17:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:17:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12817.853662 secs 2023-05-08T07:17:59.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:17:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:17:59.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:17:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:17:59.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:17:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:17:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:17:59 smithi096 ceph-mon[124666]: pgmap v6893: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 142 KiB/s wr, 9 op/s 2023-05-08T07:17:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:17:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12817.853662 secs 2023-05-08T07:17:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:17:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:17:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:17:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:17:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:17:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:17:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:17:59 smithi186 ceph-mon[126480]: pgmap v6893: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 142 KiB/s wr, 9 op/s 2023-05-08T07:17:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:17:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12817.853662 secs 2023-05-08T07:17:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:17:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:17:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:17:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:17:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:17:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:18:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12818.411397 secs 2023-05-08T07:18:00.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:00 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:18:00.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:00 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T07:18:00.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:00 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T07:18:00.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:00 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:18:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12818.411397 secs 2023-05-08T07:18:00.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:00 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:18:00.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:00 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T07:18:00.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:00 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T07:18:00.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:00 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:18:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12818.411397 secs 2023-05-08T07:18:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:00 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:18:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:00 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T07:18:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:00 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T07:18:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:00 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:18:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:01 smithi133 ceph-mon[125939]: pgmap v6894: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 281 KiB/s wr, 14 op/s 2023-05-08T07:18:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:01 smithi096 ceph-mon[124666]: pgmap v6894: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 281 KiB/s wr, 14 op/s 2023-05-08T07:18:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:01 smithi186 ceph-mon[126480]: pgmap v6894: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 281 KiB/s wr, 14 op/s 2023-05-08T07:18:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:03 smithi133 ceph-mon[125939]: pgmap v6895: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 184 KiB/s wr, 9 op/s 2023-05-08T07:18:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:03 smithi096 ceph-mon[124666]: pgmap v6895: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 184 KiB/s wr, 9 op/s 2023-05-08T07:18:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:03 smithi186 ceph-mon[126480]: pgmap v6895: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 184 KiB/s wr, 9 op/s 2023-05-08T07:18:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12822.853776 secs 2023-05-08T07:18:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12822.853776 secs 2023-05-08T07:18:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12822.853776 secs 2023-05-08T07:18:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12823.411516 secs 2023-05-08T07:18:05.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:05 smithi133 ceph-mon[125939]: pgmap v6896: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 184 KiB/s wr, 9 op/s 2023-05-08T07:18:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12823.411516 secs 2023-05-08T07:18:05.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:05 smithi096 ceph-mon[124666]: pgmap v6896: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 184 KiB/s wr, 9 op/s 2023-05-08T07:18:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12823.411516 secs 2023-05-08T07:18:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:05 smithi186 ceph-mon[126480]: pgmap v6896: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 184 KiB/s wr, 9 op/s 2023-05-08T07:18:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12824.693865 secs 2023-05-08T07:18:06.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:06 smithi133 ceph-mon[125939]: osdmap e508: 12 total, 12 up, 12 in 2023-05-08T07:18:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12824.693865 secs 2023-05-08T07:18:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:06 smithi096 ceph-mon[124666]: osdmap e508: 12 total, 12 up, 12 in 2023-05-08T07:18:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12824.693865 secs 2023-05-08T07:18:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:06 smithi186 ceph-mon[126480]: osdmap e508: 12 total, 12 up, 12 in 2023-05-08T07:18:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:07 smithi133 ceph-mon[125939]: pgmap v6898: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 313 KiB/s wr, 28 op/s 2023-05-08T07:18:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:07 smithi096 ceph-mon[124666]: pgmap v6898: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 313 KiB/s wr, 28 op/s 2023-05-08T07:18:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:07 smithi186 ceph-mon[126480]: pgmap v6898: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 313 KiB/s wr, 28 op/s 2023-05-08T07:18:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:08 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:18:08.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:18:08.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:18:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:08 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:18:08.558 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:18:08.559 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:18:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:08 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:18:08.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:18:08.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:18:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:09 smithi133 ceph-mon[125939]: pgmap v6899: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 313 KiB/s wr, 28 op/s 2023-05-08T07:18:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12827.853892 secs 2023-05-08T07:18:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:09 smithi096 ceph-mon[124666]: pgmap v6899: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 313 KiB/s wr, 28 op/s 2023-05-08T07:18:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12827.853892 secs 2023-05-08T07:18:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:09 smithi186 ceph-mon[126480]: pgmap v6899: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 313 KiB/s wr, 28 op/s 2023-05-08T07:18:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12827.853892 secs 2023-05-08T07:18:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12828.411635 secs 2023-05-08T07:18:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12828.411635 secs 2023-05-08T07:18:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12828.411635 secs 2023-05-08T07:18:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:11 smithi133 ceph-mon[125939]: pgmap v6900: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 286 KiB/s rd, 234 KiB/s wr, 27 op/s 2023-05-08T07:18:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12829.693984 secs 2023-05-08T07:18:11.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:11 smithi133 ceph-mon[125939]: osdmap e509: 12 total, 12 up, 12 in 2023-05-08T07:18:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:11 smithi096 ceph-mon[124666]: pgmap v6900: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 286 KiB/s rd, 234 KiB/s wr, 27 op/s 2023-05-08T07:18:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12829.693984 secs 2023-05-08T07:18:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:11 smithi096 ceph-mon[124666]: osdmap e509: 12 total, 12 up, 12 in 2023-05-08T07:18:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:11 smithi186 ceph-mon[126480]: pgmap v6900: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 286 KiB/s rd, 234 KiB/s wr, 27 op/s 2023-05-08T07:18:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12829.693984 secs 2023-05-08T07:18:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:11 smithi186 ceph-mon[126480]: osdmap e509: 12 total, 12 up, 12 in 2023-05-08T07:18:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:13 smithi096 ceph-mon[124666]: pgmap v6902: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 292 KiB/s wr, 34 op/s 2023-05-08T07:18:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:13 smithi186 ceph-mon[126480]: pgmap v6902: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 292 KiB/s wr, 34 op/s 2023-05-08T07:18:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:13 smithi133 ceph-mon[125939]: pgmap v6902: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 292 KiB/s wr, 34 op/s 2023-05-08T07:18:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12832.853958 secs 2023-05-08T07:18:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12832.853958 secs 2023-05-08T07:18:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12832.853958 secs 2023-05-08T07:18:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12833.411752 secs 2023-05-08T07:18:15.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:15 smithi096 ceph-mon[124666]: pgmap v6903: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 102 KiB/s wr, 5 op/s 2023-05-08T07:18:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12833.411752 secs 2023-05-08T07:18:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:15 smithi186 ceph-mon[126480]: pgmap v6903: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 102 KiB/s wr, 5 op/s 2023-05-08T07:18:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12833.411752 secs 2023-05-08T07:18:15.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:15 smithi133 ceph-mon[125939]: pgmap v6903: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 102 KiB/s wr, 5 op/s 2023-05-08T07:18:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12834.694083 secs 2023-05-08T07:18:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12834.694083 secs 2023-05-08T07:18:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12834.694083 secs 2023-05-08T07:18:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:17 smithi096 ceph-mon[124666]: pgmap v6904: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 128 KiB/s wr, 9 op/s 2023-05-08T07:18:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:17 smithi186 ceph-mon[126480]: pgmap v6904: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 128 KiB/s wr, 9 op/s 2023-05-08T07:18:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:17 smithi133 ceph-mon[125939]: pgmap v6904: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 128 KiB/s wr, 9 op/s 2023-05-08T07:18:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:19 smithi186 ceph-mon[126480]: pgmap v6905: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 128 KiB/s wr, 9 op/s 2023-05-08T07:18:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12837.854075 secs 2023-05-08T07:18:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:19 smithi133 ceph-mon[125939]: pgmap v6905: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 128 KiB/s wr, 9 op/s 2023-05-08T07:18:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12837.854075 secs 2023-05-08T07:18:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:19 smithi096 ceph-mon[124666]: pgmap v6905: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 128 KiB/s wr, 9 op/s 2023-05-08T07:18:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12837.854075 secs 2023-05-08T07:18:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12838.411863 secs 2023-05-08T07:18:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12838.411863 secs 2023-05-08T07:18:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12838.411863 secs 2023-05-08T07:18:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:21 smithi186 ceph-mon[126480]: pgmap v6906: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 68 KiB/s wr, 8 op/s 2023-05-08T07:18:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12839.694178 secs 2023-05-08T07:18:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:21 smithi133 ceph-mon[125939]: pgmap v6906: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 68 KiB/s wr, 8 op/s 2023-05-08T07:18:21.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12839.694178 secs 2023-05-08T07:18:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:21 smithi096 ceph-mon[124666]: pgmap v6906: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 68 KiB/s wr, 8 op/s 2023-05-08T07:18:21.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12839.694178 secs 2023-05-08T07:18:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:23 smithi186 ceph-mon[126480]: pgmap v6907: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 63 KiB/s wr, 7 op/s 2023-05-08T07:18:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:23 smithi133 ceph-mon[125939]: pgmap v6907: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 63 KiB/s wr, 7 op/s 2023-05-08T07:18:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:23 smithi096 ceph-mon[124666]: pgmap v6907: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 63 KiB/s wr, 7 op/s 2023-05-08T07:18:24.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12842.854214 secs 2023-05-08T07:18:24.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12842.854214 secs 2023-05-08T07:18:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12842.854214 secs 2023-05-08T07:18:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12843.411953 secs 2023-05-08T07:18:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:25 smithi186 ceph-mon[126480]: pgmap v6908: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 57 KiB/s wr, 7 op/s 2023-05-08T07:18:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12843.411953 secs 2023-05-08T07:18:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:25 smithi133 ceph-mon[125939]: pgmap v6908: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 57 KiB/s wr, 7 op/s 2023-05-08T07:18:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12843.411953 secs 2023-05-08T07:18:25.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:25 smithi096 ceph-mon[124666]: pgmap v6908: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 57 KiB/s wr, 7 op/s 2023-05-08T07:18:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12844.694316 secs 2023-05-08T07:18:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12844.694316 secs 2023-05-08T07:18:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12844.694316 secs 2023-05-08T07:18:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:27 smithi186 ceph-mon[126480]: pgmap v6909: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 91 KiB/s wr, 10 op/s 2023-05-08T07:18:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:27 smithi133 ceph-mon[125939]: pgmap v6909: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 91 KiB/s wr, 10 op/s 2023-05-08T07:18:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:27 smithi096 ceph-mon[124666]: pgmap v6909: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 91 KiB/s wr, 10 op/s 2023-05-08T07:18:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:29 smithi186 ceph-mon[126480]: pgmap v6910: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 58 KiB/s wr, 6 op/s 2023-05-08T07:18:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12847.854333 secs 2023-05-08T07:18:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:29 smithi133 ceph-mon[125939]: pgmap v6910: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 58 KiB/s wr, 6 op/s 2023-05-08T07:18:29.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12847.854333 secs 2023-05-08T07:18:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:29 smithi096 ceph-mon[124666]: pgmap v6910: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 58 KiB/s wr, 6 op/s 2023-05-08T07:18:29.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12847.854333 secs 2023-05-08T07:18:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12848.412065 secs 2023-05-08T07:18:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12848.412065 secs 2023-05-08T07:18:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12848.412065 secs 2023-05-08T07:18:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:31 smithi186 ceph-mon[126480]: pgmap v6911: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 59 KiB/s wr, 10 op/s 2023-05-08T07:18:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12849.694413 secs 2023-05-08T07:18:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:31 smithi133 ceph-mon[125939]: pgmap v6911: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 59 KiB/s wr, 10 op/s 2023-05-08T07:18:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12849.694413 secs 2023-05-08T07:18:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:31 smithi096 ceph-mon[124666]: pgmap v6911: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 59 KiB/s wr, 10 op/s 2023-05-08T07:18:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12849.694413 secs 2023-05-08T07:18:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:33 smithi186 ceph-mon[126480]: pgmap v6912: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 7 op/s 2023-05-08T07:18:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:33 smithi133 ceph-mon[125939]: pgmap v6912: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 7 op/s 2023-05-08T07:18:33.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:33 smithi096 ceph-mon[124666]: pgmap v6912: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 7 op/s 2023-05-08T07:18:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12852.854449 secs 2023-05-08T07:18:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12852.854449 secs 2023-05-08T07:18:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12852.854449 secs 2023-05-08T07:18:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12853.412199 secs 2023-05-08T07:18:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:35 smithi186 ceph-mon[126480]: pgmap v6913: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 7 op/s 2023-05-08T07:18:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12853.412199 secs 2023-05-08T07:18:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:35 smithi133 ceph-mon[125939]: pgmap v6913: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 7 op/s 2023-05-08T07:18:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12853.412199 secs 2023-05-08T07:18:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:35 smithi096 ceph-mon[124666]: pgmap v6913: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 7 op/s 2023-05-08T07:18:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:37 smithi186 ceph-mon[126480]: pgmap v6914: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 110 KiB/s wr, 10 op/s 2023-05-08T07:18:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:37 smithi133 ceph-mon[125939]: pgmap v6914: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 110 KiB/s wr, 10 op/s 2023-05-08T07:18:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:37 smithi096 ceph-mon[124666]: pgmap v6914: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 110 KiB/s wr, 10 op/s 2023-05-08T07:18:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:39 smithi186 ceph-mon[126480]: pgmap v6915: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 76 KiB/s wr, 7 op/s 2023-05-08T07:18:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12857.854577 secs 2023-05-08T07:18:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:39 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:18:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:39 smithi133 ceph-mon[125939]: pgmap v6915: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 76 KiB/s wr, 7 op/s 2023-05-08T07:18:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12857.854577 secs 2023-05-08T07:18:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:39 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:18:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:39 smithi096 ceph-mon[124666]: pgmap v6915: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 76 KiB/s wr, 7 op/s 2023-05-08T07:18:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12857.854577 secs 2023-05-08T07:18:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:39 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:18:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12858.412316 secs 2023-05-08T07:18:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:40 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:18:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:40 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:18:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:40 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:18:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12858.412316 secs 2023-05-08T07:18:40.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:40 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:18:40.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:40 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:18:40.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:40 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:18:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12858.412316 secs 2023-05-08T07:18:40.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:40 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:18:40.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:40 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:18:40.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:40 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:18:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:41 smithi186 ceph-mon[126480]: pgmap v6916: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 159 KiB/s wr, 11 op/s 2023-05-08T07:18:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:41 smithi133 ceph-mon[125939]: pgmap v6916: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 159 KiB/s wr, 11 op/s 2023-05-08T07:18:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:41 smithi096 ceph-mon[124666]: pgmap v6916: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 159 KiB/s wr, 11 op/s 2023-05-08T07:18:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:43 smithi186 ceph-mon[126480]: pgmap v6917: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 158 KiB/s wr, 7 op/s 2023-05-08T07:18:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:43 smithi133 ceph-mon[125939]: pgmap v6917: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 158 KiB/s wr, 7 op/s 2023-05-08T07:18:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:43 smithi096 ceph-mon[124666]: pgmap v6917: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 158 KiB/s wr, 7 op/s 2023-05-08T07:18:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12862.854697 secs 2023-05-08T07:18:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12862.854697 secs 2023-05-08T07:18:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12862.854697 secs 2023-05-08T07:18:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:45 smithi186 ceph-mon[126480]: pgmap v6918: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 158 KiB/s wr, 7 op/s 2023-05-08T07:18:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:45 smithi133 ceph-mon[125939]: pgmap v6918: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 158 KiB/s wr, 7 op/s 2023-05-08T07:18:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:45 smithi096 ceph-mon[124666]: pgmap v6918: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 158 KiB/s wr, 7 op/s 2023-05-08T07:18:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:47 smithi186 ceph-mon[126480]: pgmap v6919: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 199 KiB/s wr, 12 op/s 2023-05-08T07:18:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:18:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:47 smithi133 ceph-mon[125939]: pgmap v6919: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 199 KiB/s wr, 12 op/s 2023-05-08T07:18:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:18:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:47 smithi096 ceph-mon[124666]: pgmap v6919: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 199 KiB/s wr, 12 op/s 2023-05-08T07:18:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:18:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:48 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:18:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:18:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:18:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:48 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:18:48.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:18:48.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:18:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:48 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:18:48.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:18:48.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:18:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:49 smithi186 ceph-mon[126480]: pgmap v6920: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 124 KiB/s wr, 8 op/s 2023-05-08T07:18:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12867.854814 secs 2023-05-08T07:18:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:49 smithi133 ceph-mon[125939]: pgmap v6920: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 124 KiB/s wr, 8 op/s 2023-05-08T07:18:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12867.854814 secs 2023-05-08T07:18:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:49 smithi096 ceph-mon[124666]: pgmap v6920: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 124 KiB/s wr, 8 op/s 2023-05-08T07:18:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12867.854814 secs 2023-05-08T07:18:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12868.412520 secs 2023-05-08T07:18:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12868.412520 secs 2023-05-08T07:18:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12868.412520 secs 2023-05-08T07:18:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:51 smithi133 ceph-mon[125939]: pgmap v6921: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 328 KiB/s wr, 14 op/s 2023-05-08T07:18:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:51 smithi096 ceph-mon[124666]: pgmap v6921: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 328 KiB/s wr, 14 op/s 2023-05-08T07:18:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:51 smithi186 ceph-mon[126480]: pgmap v6921: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 328 KiB/s wr, 14 op/s 2023-05-08T07:18:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:18:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:18:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:18:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:18:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:18:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:18:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:53 smithi133 ceph-mon[125939]: pgmap v6922: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 245 KiB/s wr, 9 op/s 2023-05-08T07:18:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:53 smithi096 ceph-mon[124666]: pgmap v6922: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 245 KiB/s wr, 9 op/s 2023-05-08T07:18:53.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:53 smithi186 ceph-mon[126480]: pgmap v6922: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 245 KiB/s wr, 9 op/s 2023-05-08T07:18:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12872.854913 secs 2023-05-08T07:18:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12872.854913 secs 2023-05-08T07:18:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12872.854913 secs 2023-05-08T07:18:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:55 smithi133 ceph-mon[125939]: pgmap v6923: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 245 KiB/s wr, 9 op/s 2023-05-08T07:18:55.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:55 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:18:55.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:55 smithi096 ceph-mon[124666]: pgmap v6923: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 245 KiB/s wr, 9 op/s 2023-05-08T07:18:55.761 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:55 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:18:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:55 smithi186 ceph-mon[126480]: pgmap v6923: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 245 KiB/s wr, 9 op/s 2023-05-08T07:18:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:55 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:18:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:56 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:18:56.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:18:56.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:18:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:56 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:18:56.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:18:56.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:18:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:56 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:18:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:18:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:18:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:57 smithi133 ceph-mon[125939]: pgmap v6924: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 290 KiB/s wr, 14 op/s 2023-05-08T07:18:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:57 smithi096 ceph-mon[124666]: pgmap v6924: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 290 KiB/s wr, 14 op/s 2023-05-08T07:18:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:57 smithi186 ceph-mon[126480]: pgmap v6924: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 290 KiB/s wr, 14 op/s 2023-05-08T07:18:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:59 smithi133 ceph-mon[125939]: pgmap v6925: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 249 KiB/s wr, 10 op/s 2023-05-08T07:18:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12877.855030 secs 2023-05-08T07:18:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12878.412758 secs 2023-05-08T07:18:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:18:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:18:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:59 smithi096 ceph-mon[124666]: pgmap v6925: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 249 KiB/s wr, 10 op/s 2023-05-08T07:18:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12877.855030 secs 2023-05-08T07:18:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12878.412758 secs 2023-05-08T07:18:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:18:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:18:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:59 smithi186 ceph-mon[126480]: pgmap v6925: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 249 KiB/s wr, 10 op/s 2023-05-08T07:18:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12877.855030 secs 2023-05-08T07:18:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12878.412758 secs 2023-05-08T07:18:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:18:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:19:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:19:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:19:00.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:00 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:19:00.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:19:00.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:00 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T07:19:00.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:00 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T07:19:00.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:00 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:19:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:19:00.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:19:00.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:00 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:19:00.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:19:00.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:00 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T07:19:00.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:00 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T07:19:00.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:00 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:19:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:19:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:19:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:00 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:19:00.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:19:00.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:00 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T07:19:00.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:00 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T07:19:00.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:00 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:19:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:01 smithi186 ceph-mon[126480]: pgmap v6926: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 315 KiB/s wr, 13 op/s 2023-05-08T07:19:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12879.695094 secs 2023-05-08T07:19:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:01 smithi133 ceph-mon[125939]: pgmap v6926: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 315 KiB/s wr, 13 op/s 2023-05-08T07:19:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12879.695094 secs 2023-05-08T07:19:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:01 smithi096 ceph-mon[124666]: pgmap v6926: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 315 KiB/s wr, 13 op/s 2023-05-08T07:19:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12879.695094 secs 2023-05-08T07:19:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:02 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:19:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:19:02.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:19:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:02 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:19:03.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:19:03.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:19:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:02 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:19:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:19:03.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:19:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:03 smithi133 ceph-mon[125939]: pgmap v6927: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 112 KiB/s wr, 8 op/s 2023-05-08T07:19:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:03 smithi096 ceph-mon[124666]: pgmap v6927: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 112 KiB/s wr, 8 op/s 2023-05-08T07:19:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:03 smithi186 ceph-mon[126480]: pgmap v6927: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 112 KiB/s wr, 8 op/s 2023-05-08T07:19:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12882.855167 secs 2023-05-08T07:19:04.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:04 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:19:04.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:04 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:19:04.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12883.412867 secs 2023-05-08T07:19:04.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:04 smithi133 ceph-mon[125939]: pgmap v6928: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 112 KiB/s wr, 8 op/s 2023-05-08T07:19:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12882.855167 secs 2023-05-08T07:19:05.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:04 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:19:05.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:04 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:19:05.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12883.412867 secs 2023-05-08T07:19:05.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:04 smithi096 ceph-mon[124666]: pgmap v6928: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 112 KiB/s wr, 8 op/s 2023-05-08T07:19:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12882.855167 secs 2023-05-08T07:19:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:04 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:19:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:04 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:19:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12883.412867 secs 2023-05-08T07:19:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:04 smithi186 ceph-mon[126480]: pgmap v6928: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 112 KiB/s wr, 8 op/s 2023-05-08T07:19:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12884.695219 secs 2023-05-08T07:19:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12884.695219 secs 2023-05-08T07:19:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12884.695219 secs 2023-05-08T07:19:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:07 smithi186 ceph-mon[126480]: pgmap v6929: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 188 KiB/s wr, 26 op/s 2023-05-08T07:19:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:07 smithi133 ceph-mon[125939]: pgmap v6929: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 188 KiB/s wr, 26 op/s 2023-05-08T07:19:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:07 smithi096 ceph-mon[124666]: pgmap v6929: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 188 KiB/s wr, 26 op/s 2023-05-08T07:19:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:09 smithi186 ceph-mon[126480]: pgmap v6930: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 142 KiB/s wr, 21 op/s 2023-05-08T07:19:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12887.855289 secs 2023-05-08T07:19:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:09 smithi133 ceph-mon[125939]: pgmap v6930: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 142 KiB/s wr, 21 op/s 2023-05-08T07:19:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12887.855289 secs 2023-05-08T07:19:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:09 smithi096 ceph-mon[124666]: pgmap v6930: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 142 KiB/s wr, 21 op/s 2023-05-08T07:19:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12887.855289 secs 2023-05-08T07:19:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12888.412977 secs 2023-05-08T07:19:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12888.412977 secs 2023-05-08T07:19:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12888.412977 secs 2023-05-08T07:19:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:11 smithi186 ceph-mon[126480]: pgmap v6931: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 204 KiB/s wr, 25 op/s 2023-05-08T07:19:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12889.695355 secs 2023-05-08T07:19:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:11 smithi186 ceph-mon[126480]: osdmap e510: 12 total, 12 up, 12 in 2023-05-08T07:19:11.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:11 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:19:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:11 smithi133 ceph-mon[125939]: pgmap v6931: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 204 KiB/s wr, 25 op/s 2023-05-08T07:19:11.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12889.695355 secs 2023-05-08T07:19:11.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:11 smithi133 ceph-mon[125939]: osdmap e510: 12 total, 12 up, 12 in 2023-05-08T07:19:11.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:11 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:19:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:11 smithi096 ceph-mon[124666]: pgmap v6931: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 204 KiB/s wr, 25 op/s 2023-05-08T07:19:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12889.695355 secs 2023-05-08T07:19:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:11 smithi096 ceph-mon[124666]: osdmap e510: 12 total, 12 up, 12 in 2023-05-08T07:19:11.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:11 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:19:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:13 smithi186 ceph-mon[126480]: pgmap v6933: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 165 KiB/s wr, 26 op/s 2023-05-08T07:19:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:13 smithi133 ceph-mon[125939]: pgmap v6933: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 165 KiB/s wr, 26 op/s 2023-05-08T07:19:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:13 smithi096 ceph-mon[124666]: pgmap v6933: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 165 KiB/s wr, 26 op/s 2023-05-08T07:19:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12892.855412 secs 2023-05-08T07:19:14.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12892.855412 secs 2023-05-08T07:19:14.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12892.855412 secs 2023-05-08T07:19:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12893.413120 secs 2023-05-08T07:19:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:15 smithi186 ceph-mon[126480]: pgmap v6934: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 165 KiB/s wr, 26 op/s 2023-05-08T07:19:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12893.413120 secs 2023-05-08T07:19:15.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:15 smithi133 ceph-mon[125939]: pgmap v6934: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 165 KiB/s wr, 26 op/s 2023-05-08T07:19:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12893.413120 secs 2023-05-08T07:19:15.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:15 smithi096 ceph-mon[124666]: pgmap v6934: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 165 KiB/s wr, 26 op/s 2023-05-08T07:19:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12894.695473 secs 2023-05-08T07:19:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12894.695473 secs 2023-05-08T07:19:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12894.695473 secs 2023-05-08T07:19:17.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:17 smithi186 ceph-mon[126480]: pgmap v6935: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 81 KiB/s wr, 8 op/s 2023-05-08T07:19:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:17 smithi133 ceph-mon[125939]: pgmap v6935: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 81 KiB/s wr, 8 op/s 2023-05-08T07:19:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:17 smithi096 ceph-mon[124666]: pgmap v6935: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 81 KiB/s wr, 8 op/s 2023-05-08T07:19:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:19 smithi186 ceph-mon[126480]: pgmap v6936: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 81 KiB/s wr, 8 op/s 2023-05-08T07:19:19.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12897.855539 secs 2023-05-08T07:19:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:19 smithi133 ceph-mon[125939]: pgmap v6936: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 81 KiB/s wr, 8 op/s 2023-05-08T07:19:19.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12897.855539 secs 2023-05-08T07:19:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:19 smithi096 ceph-mon[124666]: pgmap v6936: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 81 KiB/s wr, 8 op/s 2023-05-08T07:19:19.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12897.855539 secs 2023-05-08T07:19:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12898.413238 secs 2023-05-08T07:19:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12898.413238 secs 2023-05-08T07:19:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12898.413238 secs 2023-05-08T07:19:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:21 smithi186 ceph-mon[126480]: pgmap v6937: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 48 KiB/s wr, 8 op/s 2023-05-08T07:19:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12899.695590 secs 2023-05-08T07:19:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:21 smithi186 ceph-mon[126480]: osdmap e511: 12 total, 12 up, 12 in 2023-05-08T07:19:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:21 smithi133 ceph-mon[125939]: pgmap v6937: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 48 KiB/s wr, 8 op/s 2023-05-08T07:19:21.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12899.695590 secs 2023-05-08T07:19:21.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:21 smithi133 ceph-mon[125939]: osdmap e511: 12 total, 12 up, 12 in 2023-05-08T07:19:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:21 smithi096 ceph-mon[124666]: pgmap v6937: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 48 KiB/s wr, 8 op/s 2023-05-08T07:19:21.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12899.695590 secs 2023-05-08T07:19:21.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:21 smithi096 ceph-mon[124666]: osdmap e511: 12 total, 12 up, 12 in 2023-05-08T07:19:23.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:23 smithi186 ceph-mon[126480]: pgmap v6939: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 48 KiB/s wr, 8 op/s 2023-05-08T07:19:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:23 smithi133 ceph-mon[125939]: pgmap v6939: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 48 KiB/s wr, 8 op/s 2023-05-08T07:19:23.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:23 smithi096 ceph-mon[124666]: pgmap v6939: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 48 KiB/s wr, 8 op/s 2023-05-08T07:19:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12902.855653 secs 2023-05-08T07:19:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12902.855653 secs 2023-05-08T07:19:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12902.855653 secs 2023-05-08T07:19:25.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12903.413352 secs 2023-05-08T07:19:25.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:25 smithi186 ceph-mon[126480]: pgmap v6940: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 48 KiB/s wr, 8 op/s 2023-05-08T07:19:25.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12903.413352 secs 2023-05-08T07:19:25.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:25 smithi133 ceph-mon[125939]: pgmap v6940: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 48 KiB/s wr, 8 op/s 2023-05-08T07:19:25.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12903.413352 secs 2023-05-08T07:19:25.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:25 smithi096 ceph-mon[124666]: pgmap v6940: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 48 KiB/s wr, 8 op/s 2023-05-08T07:19:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12904.695717 secs 2023-05-08T07:19:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12904.695717 secs 2023-05-08T07:19:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12904.695717 secs 2023-05-08T07:19:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:27 smithi186 ceph-mon[126480]: pgmap v6941: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 42 KiB/s wr, 8 op/s 2023-05-08T07:19:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:27 smithi133 ceph-mon[125939]: pgmap v6941: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 42 KiB/s wr, 8 op/s 2023-05-08T07:19:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:27 smithi096 ceph-mon[124666]: pgmap v6941: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 42 KiB/s wr, 8 op/s 2023-05-08T07:19:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:29 smithi186 ceph-mon[126480]: pgmap v6942: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 42 KiB/s wr, 8 op/s 2023-05-08T07:19:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12907.855775 secs 2023-05-08T07:19:29.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:29 smithi133 ceph-mon[125939]: pgmap v6942: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 42 KiB/s wr, 8 op/s 2023-05-08T07:19:29.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12907.855775 secs 2023-05-08T07:19:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:29 smithi096 ceph-mon[124666]: pgmap v6942: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 42 KiB/s wr, 8 op/s 2023-05-08T07:19:29.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12907.855775 secs 2023-05-08T07:19:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12908.413501 secs 2023-05-08T07:19:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12908.413501 secs 2023-05-08T07:19:30.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12908.413501 secs 2023-05-08T07:19:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:31 smithi186 ceph-mon[126480]: pgmap v6943: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 42 KiB/s wr, 8 op/s 2023-05-08T07:19:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12909.695829 secs 2023-05-08T07:19:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:31 smithi133 ceph-mon[125939]: pgmap v6943: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 42 KiB/s wr, 8 op/s 2023-05-08T07:19:31.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12909.695829 secs 2023-05-08T07:19:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:31 smithi096 ceph-mon[124666]: pgmap v6943: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 42 KiB/s wr, 8 op/s 2023-05-08T07:19:31.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12909.695829 secs 2023-05-08T07:19:33.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:33 smithi186 ceph-mon[126480]: pgmap v6944: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 39 KiB/s wr, 7 op/s 2023-05-08T07:19:33.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:33 smithi133 ceph-mon[125939]: pgmap v6944: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 39 KiB/s wr, 7 op/s 2023-05-08T07:19:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:33 smithi096 ceph-mon[124666]: pgmap v6944: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 39 KiB/s wr, 7 op/s 2023-05-08T07:19:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12912.855904 secs 2023-05-08T07:19:34.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12912.855904 secs 2023-05-08T07:19:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12912.855904 secs 2023-05-08T07:19:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12913.413611 secs 2023-05-08T07:19:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:35 smithi186 ceph-mon[126480]: pgmap v6945: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 6 op/s 2023-05-08T07:19:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12913.413611 secs 2023-05-08T07:19:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:35 smithi133 ceph-mon[125939]: pgmap v6945: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 6 op/s 2023-05-08T07:19:35.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12913.413611 secs 2023-05-08T07:19:35.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:35 smithi096 ceph-mon[124666]: pgmap v6945: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 6 op/s 2023-05-08T07:19:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:37 smithi133 ceph-mon[125939]: pgmap v6946: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 35 KiB/s wr, 9 op/s 2023-05-08T07:19:37.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:37 smithi096 ceph-mon[124666]: pgmap v6946: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 35 KiB/s wr, 9 op/s 2023-05-08T07:19:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:37 smithi186 ceph-mon[126480]: pgmap v6946: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 35 KiB/s wr, 9 op/s 2023-05-08T07:19:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:39 smithi133 ceph-mon[125939]: pgmap v6947: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 5 op/s 2023-05-08T07:19:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12917.856040 secs 2023-05-08T07:19:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:39 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:19:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:39 smithi096 ceph-mon[124666]: pgmap v6947: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 5 op/s 2023-05-08T07:19:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12917.856040 secs 2023-05-08T07:19:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:39 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:19:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:39 smithi186 ceph-mon[126480]: pgmap v6947: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 5 op/s 2023-05-08T07:19:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12917.856040 secs 2023-05-08T07:19:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:39 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:19:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12918.413673 secs 2023-05-08T07:19:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:40 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:19:40.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:40 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:19:40.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:40 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:19:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12918.413673 secs 2023-05-08T07:19:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:40 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:19:40.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:40 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:19:40.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:40 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:19:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12918.413673 secs 2023-05-08T07:19:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:40 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:19:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:40 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:19:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:40 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:19:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:41 smithi133 ceph-mon[125939]: pgmap v6948: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 114 KiB/s wr, 9 op/s 2023-05-08T07:19:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:41 smithi096 ceph-mon[124666]: pgmap v6948: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 114 KiB/s wr, 9 op/s 2023-05-08T07:19:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:41 smithi186 ceph-mon[126480]: pgmap v6948: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 114 KiB/s wr, 9 op/s 2023-05-08T07:19:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:43 smithi133 ceph-mon[125939]: pgmap v6949: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 79 KiB/s wr, 6 op/s 2023-05-08T07:19:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:43 smithi096 ceph-mon[124666]: pgmap v6949: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 79 KiB/s wr, 6 op/s 2023-05-08T07:19:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:43 smithi186 ceph-mon[126480]: pgmap v6949: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 79 KiB/s wr, 6 op/s 2023-05-08T07:19:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12922.856152 secs 2023-05-08T07:19:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12922.856152 secs 2023-05-08T07:19:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12922.856152 secs 2023-05-08T07:19:45.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:45 smithi133 ceph-mon[125939]: pgmap v6950: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 79 KiB/s wr, 6 op/s 2023-05-08T07:19:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:45 smithi096 ceph-mon[124666]: pgmap v6950: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 79 KiB/s wr, 6 op/s 2023-05-08T07:19:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:45 smithi186 ceph-mon[126480]: pgmap v6950: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 79 KiB/s wr, 6 op/s 2023-05-08T07:19:47.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:47 smithi133 ceph-mon[125939]: pgmap v6951: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 121 KiB/s wr, 10 op/s 2023-05-08T07:19:47.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:19:47.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:47 smithi096 ceph-mon[124666]: pgmap v6951: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 121 KiB/s wr, 10 op/s 2023-05-08T07:19:47.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:19:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:47 smithi186 ceph-mon[126480]: pgmap v6951: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 121 KiB/s wr, 10 op/s 2023-05-08T07:19:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:19:48.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:48 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:19:48.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:19:48.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:19:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:48 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:19:48.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:19:48.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:19:48.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:48 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:19:48.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:19:48.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:19:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:49 smithi133 ceph-mon[125939]: pgmap v6952: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 121 KiB/s wr, 7 op/s 2023-05-08T07:19:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12927.856267 secs 2023-05-08T07:19:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:49 smithi096 ceph-mon[124666]: pgmap v6952: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 121 KiB/s wr, 7 op/s 2023-05-08T07:19:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12927.856267 secs 2023-05-08T07:19:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:49 smithi186 ceph-mon[126480]: pgmap v6952: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 121 KiB/s wr, 7 op/s 2023-05-08T07:19:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12927.856267 secs 2023-05-08T07:19:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:51 smithi133 ceph-mon[125939]: pgmap v6953: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 220 KiB/s wr, 12 op/s 2023-05-08T07:19:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:51 smithi096 ceph-mon[124666]: pgmap v6953: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 220 KiB/s wr, 12 op/s 2023-05-08T07:19:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:51 smithi186 ceph-mon[126480]: pgmap v6953: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 220 KiB/s wr, 12 op/s 2023-05-08T07:19:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:53 smithi133 ceph-mon[125939]: pgmap v6954: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 141 KiB/s wr, 8 op/s 2023-05-08T07:19:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:53 smithi096 ceph-mon[124666]: pgmap v6954: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 141 KiB/s wr, 8 op/s 2023-05-08T07:19:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:53 smithi186 ceph-mon[126480]: pgmap v6954: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 141 KiB/s wr, 8 op/s 2023-05-08T07:19:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12932.856380 secs 2023-05-08T07:19:54.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12932.856380 secs 2023-05-08T07:19:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12932.856380 secs 2023-05-08T07:19:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12933.414037 secs 2023-05-08T07:19:55.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:55 smithi133 ceph-mon[125939]: pgmap v6955: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 141 KiB/s wr, 8 op/s 2023-05-08T07:19:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12933.414037 secs 2023-05-08T07:19:55.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:55 smithi096 ceph-mon[124666]: pgmap v6955: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 141 KiB/s wr, 8 op/s 2023-05-08T07:19:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12933.414037 secs 2023-05-08T07:19:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:55 smithi186 ceph-mon[126480]: pgmap v6955: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 141 KiB/s wr, 8 op/s 2023-05-08T07:19:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:56 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:19:56.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:19:56.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:19:56.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:56 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:19:56.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:19:56.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:19:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:56 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:19:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:19:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:19:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:57 smithi133 ceph-mon[125939]: pgmap v6956: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 186 KiB/s wr, 13 op/s 2023-05-08T07:19:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:57 smithi096 ceph-mon[124666]: pgmap v6956: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 186 KiB/s wr, 13 op/s 2023-05-08T07:19:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:57 smithi186 ceph-mon[126480]: pgmap v6956: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 186 KiB/s wr, 13 op/s 2023-05-08T07:19:59.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:59 smithi133 ceph-mon[125939]: pgmap v6957: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 145 KiB/s wr, 9 op/s 2023-05-08T07:19:59.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:19:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12937.856508 secs 2023-05-08T07:19:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:59 smithi096 ceph-mon[124666]: pgmap v6957: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 145 KiB/s wr, 9 op/s 2023-05-08T07:19:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:19:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12937.856508 secs 2023-05-08T07:19:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:59 smithi186 ceph-mon[126480]: pgmap v6957: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 145 KiB/s wr, 9 op/s 2023-05-08T07:19:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:19:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12937.856508 secs 2023-05-08T07:20:00.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12938.414159 secs 2023-05-08T07:20:00.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:20:00.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:00 smithi133 ceph-mon[125939]: overall HEALTH_WARN 2 MDSs report slow requests 2023-05-08T07:20:00.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12938.414159 secs 2023-05-08T07:20:00.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:20:00.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:00 smithi096 ceph-mon[124666]: overall HEALTH_WARN 2 MDSs report slow requests 2023-05-08T07:20:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12938.414159 secs 2023-05-08T07:20:00.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:20:00.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:00 smithi186 ceph-mon[126480]: overall HEALTH_WARN 2 MDSs report slow requests 2023-05-08T07:20:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:01 smithi133 ceph-mon[125939]: pgmap v6958: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 243 KiB/s wr, 13 op/s 2023-05-08T07:20:01.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12939.696501 secs 2023-05-08T07:20:01.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:01 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:20:01.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:01 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:20:01.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:01 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:20:01.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:01 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:20:01.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:01 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:20:01.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:01 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:20:01.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:01 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:20:01.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:01 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:20:01.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:01 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:20:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:01 smithi096 ceph-mon[124666]: pgmap v6958: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 243 KiB/s wr, 13 op/s 2023-05-08T07:20:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12939.696501 secs 2023-05-08T07:20:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:01 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:20:01.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:01 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:20:01.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:01 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:20:01.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:01 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:20:01.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:01 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:20:01.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:01 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:20:01.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:01 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:20:01.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:01 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:20:01.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:01 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:20:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:01 smithi186 ceph-mon[126480]: pgmap v6958: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 243 KiB/s wr, 13 op/s 2023-05-08T07:20:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12939.696501 secs 2023-05-08T07:20:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:01 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:20:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:01 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:20:01.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:01 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:20:01.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:01 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:20:01.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:01 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:20:01.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:01 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:20:01.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:01 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:20:01.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:01 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:20:01.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:01 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:20:02.211 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:02 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:20:02.212 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:02 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T07:20:02.212 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:02 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T07:20:02.212 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:02 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:20:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:02 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:20:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:02 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T07:20:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:02 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T07:20:02.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:02 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:20:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:02 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:20:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:02 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T07:20:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:02 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T07:20:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:02 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:20:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:03 smithi133 ceph-mon[125939]: pgmap v6959: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 144 KiB/s wr, 8 op/s 2023-05-08T07:20:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:03 smithi096 ceph-mon[124666]: pgmap v6959: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 144 KiB/s wr, 8 op/s 2023-05-08T07:20:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:03 smithi186 ceph-mon[126480]: pgmap v6959: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 144 KiB/s wr, 8 op/s 2023-05-08T07:20:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12942.856615 secs 2023-05-08T07:20:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:04 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:20:04.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:04 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:20:04.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:04 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:20:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12942.856615 secs 2023-05-08T07:20:04.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:04 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:20:04.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:04 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:20:04.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:04 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:20:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12942.856615 secs 2023-05-08T07:20:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:04 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:20:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:04 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:20:04.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:04 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:20:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12943.414282 secs 2023-05-08T07:20:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:05 smithi133 ceph-mon[125939]: pgmap v6960: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 144 KiB/s wr, 8 op/s 2023-05-08T07:20:05.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12943.414282 secs 2023-05-08T07:20:05.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:05 smithi096 ceph-mon[124666]: pgmap v6960: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 144 KiB/s wr, 8 op/s 2023-05-08T07:20:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12943.414282 secs 2023-05-08T07:20:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:05 smithi186 ceph-mon[126480]: pgmap v6960: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 144 KiB/s wr, 8 op/s 2023-05-08T07:20:06.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12944.696638 secs 2023-05-08T07:20:06.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:06 smithi096 ceph-mon[124666]: osdmap e512: 12 total, 12 up, 12 in 2023-05-08T07:20:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12944.696638 secs 2023-05-08T07:20:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:06 smithi186 ceph-mon[126480]: osdmap e512: 12 total, 12 up, 12 in 2023-05-08T07:20:06.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12944.696638 secs 2023-05-08T07:20:06.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:06 smithi133 ceph-mon[125939]: osdmap e512: 12 total, 12 up, 12 in 2023-05-08T07:20:07.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:07 smithi096 ceph-mon[124666]: pgmap v6962: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 318 KiB/s wr, 28 op/s 2023-05-08T07:20:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:07 smithi186 ceph-mon[126480]: pgmap v6962: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 318 KiB/s wr, 28 op/s 2023-05-08T07:20:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:07 smithi133 ceph-mon[125939]: pgmap v6962: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 318 KiB/s wr, 28 op/s 2023-05-08T07:20:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:09 smithi096 ceph-mon[124666]: pgmap v6963: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 318 KiB/s wr, 28 op/s 2023-05-08T07:20:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12947.856714 secs 2023-05-08T07:20:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:09 smithi186 ceph-mon[126480]: pgmap v6963: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 318 KiB/s wr, 28 op/s 2023-05-08T07:20:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12947.856714 secs 2023-05-08T07:20:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:09 smithi133 ceph-mon[125939]: pgmap v6963: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 318 KiB/s wr, 28 op/s 2023-05-08T07:20:09.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12947.856714 secs 2023-05-08T07:20:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12948.414402 secs 2023-05-08T07:20:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12948.414402 secs 2023-05-08T07:20:10.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12948.414402 secs 2023-05-08T07:20:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:11 smithi186 ceph-mon[126480]: pgmap v6964: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 265 KiB/s rd, 299 KiB/s wr, 29 op/s 2023-05-08T07:20:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12949.696759 secs 2023-05-08T07:20:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:11 smithi186 ceph-mon[126480]: osdmap e513: 12 total, 12 up, 12 in 2023-05-08T07:20:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:11 smithi133 ceph-mon[125939]: pgmap v6964: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 265 KiB/s rd, 299 KiB/s wr, 29 op/s 2023-05-08T07:20:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12949.696759 secs 2023-05-08T07:20:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:11 smithi133 ceph-mon[125939]: osdmap e513: 12 total, 12 up, 12 in 2023-05-08T07:20:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:11 smithi096 ceph-mon[124666]: pgmap v6964: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 265 KiB/s rd, 299 KiB/s wr, 29 op/s 2023-05-08T07:20:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12949.696759 secs 2023-05-08T07:20:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:11 smithi096 ceph-mon[124666]: osdmap e513: 12 total, 12 up, 12 in 2023-05-08T07:20:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:13 smithi186 ceph-mon[126480]: pgmap v6966: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 374 KiB/s wr, 36 op/s 2023-05-08T07:20:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:13 smithi133 ceph-mon[125939]: pgmap v6966: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 374 KiB/s wr, 36 op/s 2023-05-08T07:20:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:13 smithi096 ceph-mon[124666]: pgmap v6966: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 374 KiB/s wr, 36 op/s 2023-05-08T07:20:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12952.856836 secs 2023-05-08T07:20:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12952.856836 secs 2023-05-08T07:20:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12952.856836 secs 2023-05-08T07:20:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12953.414522 secs 2023-05-08T07:20:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:15 smithi186 ceph-mon[126480]: pgmap v6967: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 115 KiB/s wr, 6 op/s 2023-05-08T07:20:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12953.414522 secs 2023-05-08T07:20:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:15 smithi133 ceph-mon[125939]: pgmap v6967: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 115 KiB/s wr, 6 op/s 2023-05-08T07:20:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12953.414522 secs 2023-05-08T07:20:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:15 smithi096 ceph-mon[124666]: pgmap v6967: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 115 KiB/s wr, 6 op/s 2023-05-08T07:20:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12954.696859 secs 2023-05-08T07:20:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12954.696859 secs 2023-05-08T07:20:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12954.696859 secs 2023-05-08T07:20:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:17 smithi186 ceph-mon[126480]: pgmap v6968: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 134 KiB/s wr, 10 op/s 2023-05-08T07:20:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:17 smithi133 ceph-mon[125939]: pgmap v6968: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 134 KiB/s wr, 10 op/s 2023-05-08T07:20:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:17 smithi096 ceph-mon[124666]: pgmap v6968: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 134 KiB/s wr, 10 op/s 2023-05-08T07:20:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:19 smithi186 ceph-mon[126480]: pgmap v6969: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 134 KiB/s wr, 10 op/s 2023-05-08T07:20:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12957.856946 secs 2023-05-08T07:20:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:19 smithi133 ceph-mon[125939]: pgmap v6969: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 134 KiB/s wr, 10 op/s 2023-05-08T07:20:19.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12957.856946 secs 2023-05-08T07:20:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:19 smithi096 ceph-mon[124666]: pgmap v6969: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 134 KiB/s wr, 10 op/s 2023-05-08T07:20:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12957.856946 secs 2023-05-08T07:20:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12958.414659 secs 2023-05-08T07:20:20.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12958.414659 secs 2023-05-08T07:20:20.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12958.414659 secs 2023-05-08T07:20:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:21 smithi186 ceph-mon[126480]: pgmap v6970: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 63 KiB/s wr, 8 op/s 2023-05-08T07:20:21.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12959.696925 secs 2023-05-08T07:20:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:21 smithi133 ceph-mon[125939]: pgmap v6970: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 63 KiB/s wr, 8 op/s 2023-05-08T07:20:21.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12959.696925 secs 2023-05-08T07:20:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:21 smithi096 ceph-mon[124666]: pgmap v6970: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 63 KiB/s wr, 8 op/s 2023-05-08T07:20:21.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12959.696925 secs 2023-05-08T07:20:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:23 smithi186 ceph-mon[126480]: pgmap v6971: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 7 op/s 2023-05-08T07:20:23.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:23 smithi133 ceph-mon[125939]: pgmap v6971: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 7 op/s 2023-05-08T07:20:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:23 smithi096 ceph-mon[124666]: pgmap v6971: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 7 op/s 2023-05-08T07:20:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12962.857048 secs 2023-05-08T07:20:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12962.857048 secs 2023-05-08T07:20:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12962.857048 secs 2023-05-08T07:20:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12963.414753 secs 2023-05-08T07:20:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:25 smithi186 ceph-mon[126480]: pgmap v6972: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 KiB/s wr, 6 op/s 2023-05-08T07:20:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12963.414753 secs 2023-05-08T07:20:25.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:25 smithi133 ceph-mon[125939]: pgmap v6972: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 KiB/s wr, 6 op/s 2023-05-08T07:20:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12963.414753 secs 2023-05-08T07:20:25.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:25 smithi096 ceph-mon[124666]: pgmap v6972: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 KiB/s wr, 6 op/s 2023-05-08T07:20:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12964.697006 secs 2023-05-08T07:20:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12964.697006 secs 2023-05-08T07:20:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12964.697006 secs 2023-05-08T07:20:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:27 smithi186 ceph-mon[126480]: pgmap v6973: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 87 KiB/s wr, 10 op/s 2023-05-08T07:20:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:27 smithi133 ceph-mon[125939]: pgmap v6973: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 87 KiB/s wr, 10 op/s 2023-05-08T07:20:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:27 smithi096 ceph-mon[124666]: pgmap v6973: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 87 KiB/s wr, 10 op/s 2023-05-08T07:20:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:29 smithi186 ceph-mon[126480]: pgmap v6974: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 59 KiB/s wr, 6 op/s 2023-05-08T07:20:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12967.857151 secs 2023-05-08T07:20:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:29 smithi133 ceph-mon[125939]: pgmap v6974: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 59 KiB/s wr, 6 op/s 2023-05-08T07:20:29.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12967.857151 secs 2023-05-08T07:20:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:29 smithi096 ceph-mon[124666]: pgmap v6974: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 59 KiB/s wr, 6 op/s 2023-05-08T07:20:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12967.857151 secs 2023-05-08T07:20:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12968.414879 secs 2023-05-08T07:20:30.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12968.414879 secs 2023-05-08T07:20:30.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12968.414879 secs 2023-05-08T07:20:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:31 smithi186 ceph-mon[126480]: pgmap v6975: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 79 KiB/s wr, 10 op/s 2023-05-08T07:20:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12969.697147 secs 2023-05-08T07:20:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:31 smithi133 ceph-mon[125939]: pgmap v6975: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 79 KiB/s wr, 10 op/s 2023-05-08T07:20:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12969.697147 secs 2023-05-08T07:20:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:31 smithi096 ceph-mon[124666]: pgmap v6975: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 79 KiB/s wr, 10 op/s 2023-05-08T07:20:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12969.697147 secs 2023-05-08T07:20:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:33 smithi186 ceph-mon[126480]: pgmap v6976: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 55 KiB/s wr, 6 op/s 2023-05-08T07:20:33.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:33 smithi133 ceph-mon[125939]: pgmap v6976: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 55 KiB/s wr, 6 op/s 2023-05-08T07:20:33.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:33 smithi096 ceph-mon[124666]: pgmap v6976: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 55 KiB/s wr, 6 op/s 2023-05-08T07:20:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12972.857264 secs 2023-05-08T07:20:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12972.857264 secs 2023-05-08T07:20:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12972.857264 secs 2023-05-08T07:20:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12973.415031 secs 2023-05-08T07:20:35.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:35 smithi186 ceph-mon[126480]: pgmap v6977: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 55 KiB/s wr, 6 op/s 2023-05-08T07:20:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12973.415031 secs 2023-05-08T07:20:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:35 smithi133 ceph-mon[125939]: pgmap v6977: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 55 KiB/s wr, 6 op/s 2023-05-08T07:20:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12973.415031 secs 2023-05-08T07:20:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:35 smithi096 ceph-mon[124666]: pgmap v6977: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 55 KiB/s wr, 6 op/s 2023-05-08T07:20:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:37 smithi186 ceph-mon[126480]: pgmap v6978: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 88 KiB/s wr, 9 op/s 2023-05-08T07:20:37.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:37 smithi133 ceph-mon[125939]: pgmap v6978: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 88 KiB/s wr, 9 op/s 2023-05-08T07:20:37.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:37 smithi096 ceph-mon[124666]: pgmap v6978: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 88 KiB/s wr, 9 op/s 2023-05-08T07:20:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:39 smithi186 ceph-mon[126480]: pgmap v6979: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 53 KiB/s wr, 6 op/s 2023-05-08T07:20:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12977.857378 secs 2023-05-08T07:20:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:39 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:20:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:39 smithi133 ceph-mon[125939]: pgmap v6979: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 53 KiB/s wr, 6 op/s 2023-05-08T07:20:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12977.857378 secs 2023-05-08T07:20:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:39 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:20:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:39 smithi096 ceph-mon[124666]: pgmap v6979: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 53 KiB/s wr, 6 op/s 2023-05-08T07:20:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12977.857378 secs 2023-05-08T07:20:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:39 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:20:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12978.415174 secs 2023-05-08T07:20:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:40 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:20:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:40 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:20:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:40 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:20:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12978.415174 secs 2023-05-08T07:20:40.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:40 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:20:40.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:40 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:20:40.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:40 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:20:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12978.415174 secs 2023-05-08T07:20:40.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:40 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:20:40.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:40 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:20:40.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:40 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:20:41.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:41 smithi186 ceph-mon[126480]: pgmap v6980: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 182 KiB/s wr, 10 op/s 2023-05-08T07:20:41.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:41 smithi133 ceph-mon[125939]: pgmap v6980: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 182 KiB/s wr, 10 op/s 2023-05-08T07:20:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:41 smithi096 ceph-mon[124666]: pgmap v6980: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 182 KiB/s wr, 10 op/s 2023-05-08T07:20:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:43 smithi186 ceph-mon[126480]: pgmap v6981: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 161 KiB/s wr, 7 op/s 2023-05-08T07:20:43.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:43 smithi133 ceph-mon[125939]: pgmap v6981: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 161 KiB/s wr, 7 op/s 2023-05-08T07:20:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:43 smithi096 ceph-mon[124666]: pgmap v6981: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 161 KiB/s wr, 7 op/s 2023-05-08T07:20:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12982.857496 secs 2023-05-08T07:20:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12982.857496 secs 2023-05-08T07:20:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12982.857496 secs 2023-05-08T07:20:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:45 smithi186 ceph-mon[126480]: pgmap v6982: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 161 KiB/s wr, 7 op/s 2023-05-08T07:20:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:45 smithi133 ceph-mon[125939]: pgmap v6982: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 161 KiB/s wr, 7 op/s 2023-05-08T07:20:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:45 smithi096 ceph-mon[124666]: pgmap v6982: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 161 KiB/s wr, 7 op/s 2023-05-08T07:20:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:47 smithi186 ceph-mon[126480]: pgmap v6983: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 203 KiB/s wr, 12 op/s 2023-05-08T07:20:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:20:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:47 smithi133 ceph-mon[125939]: pgmap v6983: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 203 KiB/s wr, 12 op/s 2023-05-08T07:20:47.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:20:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:47 smithi096 ceph-mon[124666]: pgmap v6983: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 203 KiB/s wr, 12 op/s 2023-05-08T07:20:47.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:20:48.624 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:48 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:20:48.625 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:20:48.625 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:20:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:48 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:20:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:20:48.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:20:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:48 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:20:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:20:48.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:20:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:49 smithi186 ceph-mon[126480]: pgmap v6984: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 171 KiB/s wr, 9 op/s 2023-05-08T07:20:49.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12987.857591 secs 2023-05-08T07:20:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:49 smithi133 ceph-mon[125939]: pgmap v6984: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 171 KiB/s wr, 9 op/s 2023-05-08T07:20:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12987.857591 secs 2023-05-08T07:20:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:49 smithi096 ceph-mon[124666]: pgmap v6984: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 171 KiB/s wr, 9 op/s 2023-05-08T07:20:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12987.857591 secs 2023-05-08T07:20:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12988.415406 secs 2023-05-08T07:20:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12988.415406 secs 2023-05-08T07:20:50.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12988.415406 secs 2023-05-08T07:20:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:51 smithi133 ceph-mon[125939]: pgmap v6985: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 334 KiB/s wr, 13 op/s 2023-05-08T07:20:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:51 smithi096 ceph-mon[124666]: pgmap v6985: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 334 KiB/s wr, 13 op/s 2023-05-08T07:20:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:51 smithi186 ceph-mon[126480]: pgmap v6985: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 334 KiB/s wr, 13 op/s 2023-05-08T07:20:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:20:52.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:20:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:20:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:20:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:20:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:20:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:53 smithi133 ceph-mon[125939]: pgmap v6986: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 205 KiB/s wr, 9 op/s 2023-05-08T07:20:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:53 smithi096 ceph-mon[124666]: pgmap v6986: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 205 KiB/s wr, 9 op/s 2023-05-08T07:20:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:53 smithi186 ceph-mon[126480]: pgmap v6986: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 205 KiB/s wr, 9 op/s 2023-05-08T07:20:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12992.857739 secs 2023-05-08T07:20:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12992.857739 secs 2023-05-08T07:20:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12992.857739 secs 2023-05-08T07:20:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:55 smithi133 ceph-mon[125939]: pgmap v6987: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 205 KiB/s wr, 9 op/s 2023-05-08T07:20:55.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:55 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:20:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:55 smithi096 ceph-mon[124666]: pgmap v6987: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 205 KiB/s wr, 9 op/s 2023-05-08T07:20:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:55 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:20:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:55 smithi186 ceph-mon[126480]: pgmap v6987: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 205 KiB/s wr, 9 op/s 2023-05-08T07:20:55.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:55 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:20:56.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12994.697792 secs 2023-05-08T07:20:56.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:56 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:20:56.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:20:56.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:20:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12994.697792 secs 2023-05-08T07:20:56.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:56 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:20:56.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:20:56.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:20:56.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12994.697792 secs 2023-05-08T07:20:56.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:56 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:20:56.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:20:56.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:20:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:57 smithi133 ceph-mon[125939]: pgmap v6988: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 252 KiB/s wr, 14 op/s 2023-05-08T07:20:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:57 smithi096 ceph-mon[124666]: pgmap v6988: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 252 KiB/s wr, 14 op/s 2023-05-08T07:20:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:57 smithi186 ceph-mon[126480]: pgmap v6988: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 252 KiB/s wr, 14 op/s 2023-05-08T07:20:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:59 smithi133 ceph-mon[125939]: pgmap v6989: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 209 KiB/s wr, 8 op/s 2023-05-08T07:20:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:20:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12997.857876 secs 2023-05-08T07:20:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:59 smithi096 ceph-mon[124666]: pgmap v6989: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 209 KiB/s wr, 8 op/s 2023-05-08T07:20:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:20:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12997.857876 secs 2023-05-08T07:20:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:59 smithi186 ceph-mon[126480]: pgmap v6989: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 209 KiB/s wr, 8 op/s 2023-05-08T07:20:59.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:20:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12997.857876 secs 2023-05-08T07:21:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12998.415612 secs 2023-05-08T07:21:00.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:21:00.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:21:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12998.415612 secs 2023-05-08T07:21:00.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:21:00.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:21:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12998.415612 secs 2023-05-08T07:21:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:21:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:21:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:01 smithi133 ceph-mon[125939]: pgmap v6990: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 321 KiB/s wr, 13 op/s 2023-05-08T07:21:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 12999.697858 secs 2023-05-08T07:21:01.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:01 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:21:01.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:01 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:21:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:01 smithi096 ceph-mon[124666]: pgmap v6990: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 321 KiB/s wr, 13 op/s 2023-05-08T07:21:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 12999.697858 secs 2023-05-08T07:21:01.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:01 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:21:01.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:01 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:21:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:01 smithi186 ceph-mon[126480]: pgmap v6990: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 321 KiB/s wr, 13 op/s 2023-05-08T07:21:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 12999.697858 secs 2023-05-08T07:21:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:01 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:21:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:01 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:21:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:02 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:21:02.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:02 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:21:02.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:02 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:21:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:02 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:21:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:02 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:21:02.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:02 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:21:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:02 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:21:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:02 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:21:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:02 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:21:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:03 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:21:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:03 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T07:21:03.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:03 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T07:21:03.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:03 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:21:03.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:03 smithi133 ceph-mon[125939]: pgmap v6991: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 158 KiB/s wr, 8 op/s 2023-05-08T07:21:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:03 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:21:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:03 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T07:21:03.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:03 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T07:21:03.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:03 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:21:03.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:03 smithi096 ceph-mon[124666]: pgmap v6991: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 158 KiB/s wr, 8 op/s 2023-05-08T07:21:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:03 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:21:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:03 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T07:21:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:03 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T07:21:03.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:03 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:21:03.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:03 smithi186 ceph-mon[126480]: pgmap v6991: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 158 KiB/s wr, 8 op/s 2023-05-08T07:21:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13002.857999 secs 2023-05-08T07:21:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:04 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:21:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:04 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:21:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13002.857999 secs 2023-05-08T07:21:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:04 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:21:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:04 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:21:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13002.857999 secs 2023-05-08T07:21:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:04 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:21:04.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:04 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:21:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13003.415728 secs 2023-05-08T07:21:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:05 smithi133 ceph-mon[125939]: pgmap v6992: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 158 KiB/s wr, 8 op/s 2023-05-08T07:21:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13003.415728 secs 2023-05-08T07:21:05.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:05 smithi096 ceph-mon[124666]: pgmap v6992: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 158 KiB/s wr, 8 op/s 2023-05-08T07:21:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13003.415728 secs 2023-05-08T07:21:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:05 smithi186 ceph-mon[126480]: pgmap v6992: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 158 KiB/s wr, 8 op/s 2023-05-08T07:21:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13004.697987 secs 2023-05-08T07:21:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:06 smithi133 ceph-mon[125939]: osdmap e514: 12 total, 12 up, 12 in 2023-05-08T07:21:06.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:06 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:21:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13004.697987 secs 2023-05-08T07:21:06.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:06 smithi096 ceph-mon[124666]: osdmap e514: 12 total, 12 up, 12 in 2023-05-08T07:21:06.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:06 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:21:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13004.697987 secs 2023-05-08T07:21:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:06 smithi186 ceph-mon[126480]: osdmap e514: 12 total, 12 up, 12 in 2023-05-08T07:21:06.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:06 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:21:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:07 smithi133 ceph-mon[125939]: pgmap v6994: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 265 KiB/s wr, 27 op/s 2023-05-08T07:21:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:07 smithi096 ceph-mon[124666]: pgmap v6994: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 265 KiB/s wr, 27 op/s 2023-05-08T07:21:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:07 smithi186 ceph-mon[126480]: pgmap v6994: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 265 KiB/s wr, 27 op/s 2023-05-08T07:21:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:09 smithi133 ceph-mon[125939]: pgmap v6995: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 265 KiB/s wr, 27 op/s 2023-05-08T07:21:09.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13007.858113 secs 2023-05-08T07:21:09.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13008.415833 secs 2023-05-08T07:21:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:09 smithi096 ceph-mon[124666]: pgmap v6995: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 265 KiB/s wr, 27 op/s 2023-05-08T07:21:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13007.858113 secs 2023-05-08T07:21:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13008.415833 secs 2023-05-08T07:21:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:09 smithi186 ceph-mon[126480]: pgmap v6995: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 265 KiB/s wr, 27 op/s 2023-05-08T07:21:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13007.858113 secs 2023-05-08T07:21:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13008.415833 secs 2023-05-08T07:21:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:11 smithi133 ceph-mon[125939]: pgmap v6996: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 167 KiB/s wr, 25 op/s 2023-05-08T07:21:11.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13009.698105 secs 2023-05-08T07:21:11.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:11 smithi133 ceph-mon[125939]: osdmap e515: 12 total, 12 up, 12 in 2023-05-08T07:21:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:11 smithi096 ceph-mon[124666]: pgmap v6996: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 167 KiB/s wr, 25 op/s 2023-05-08T07:21:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13009.698105 secs 2023-05-08T07:21:11.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:11 smithi096 ceph-mon[124666]: osdmap e515: 12 total, 12 up, 12 in 2023-05-08T07:21:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:11 smithi186 ceph-mon[126480]: pgmap v6996: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 167 KiB/s wr, 25 op/s 2023-05-08T07:21:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13009.698105 secs 2023-05-08T07:21:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:11 smithi186 ceph-mon[126480]: osdmap e515: 12 total, 12 up, 12 in 2023-05-08T07:21:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:13 smithi133 ceph-mon[125939]: pgmap v6998: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 209 KiB/s wr, 32 op/s 2023-05-08T07:21:13.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:13 smithi096 ceph-mon[124666]: pgmap v6998: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 209 KiB/s wr, 32 op/s 2023-05-08T07:21:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:13 smithi186 ceph-mon[126480]: pgmap v6998: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 209 KiB/s wr, 32 op/s 2023-05-08T07:21:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13012.858226 secs 2023-05-08T07:21:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13013.415961 secs 2023-05-08T07:21:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13012.858226 secs 2023-05-08T07:21:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13013.415961 secs 2023-05-08T07:21:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13012.858226 secs 2023-05-08T07:21:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13013.415961 secs 2023-05-08T07:21:15.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:15 smithi133 ceph-mon[125939]: pgmap v6999: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 42 KiB/s wr, 4 op/s 2023-05-08T07:21:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:15 smithi096 ceph-mon[124666]: pgmap v6999: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 42 KiB/s wr, 4 op/s 2023-05-08T07:21:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:15 smithi186 ceph-mon[126480]: pgmap v6999: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 42 KiB/s wr, 4 op/s 2023-05-08T07:21:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13014.698201 secs 2023-05-08T07:21:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13014.698201 secs 2023-05-08T07:21:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13014.698201 secs 2023-05-08T07:21:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:17 smithi133 ceph-mon[125939]: pgmap v7000: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 43 KiB/s wr, 8 op/s 2023-05-08T07:21:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:17 smithi096 ceph-mon[124666]: pgmap v7000: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 43 KiB/s wr, 8 op/s 2023-05-08T07:21:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:17 smithi186 ceph-mon[126480]: pgmap v7000: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 43 KiB/s wr, 8 op/s 2023-05-08T07:21:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:19 smithi133 ceph-mon[125939]: pgmap v7001: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 43 KiB/s wr, 8 op/s 2023-05-08T07:21:19.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13017.858367 secs 2023-05-08T07:21:19.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13018.416081 secs 2023-05-08T07:21:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:19 smithi096 ceph-mon[124666]: pgmap v7001: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 43 KiB/s wr, 8 op/s 2023-05-08T07:21:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13017.858367 secs 2023-05-08T07:21:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13018.416081 secs 2023-05-08T07:21:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:19 smithi186 ceph-mon[126480]: pgmap v7001: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 43 KiB/s wr, 8 op/s 2023-05-08T07:21:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13017.858367 secs 2023-05-08T07:21:19.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13018.416081 secs 2023-05-08T07:21:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:21 smithi133 ceph-mon[125939]: pgmap v7002: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 49 KiB/s wr, 8 op/s 2023-05-08T07:21:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13019.698324 secs 2023-05-08T07:21:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:21 smithi096 ceph-mon[124666]: pgmap v7002: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 49 KiB/s wr, 8 op/s 2023-05-08T07:21:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13019.698324 secs 2023-05-08T07:21:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:21 smithi186 ceph-mon[126480]: pgmap v7002: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 49 KiB/s wr, 8 op/s 2023-05-08T07:21:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13019.698324 secs 2023-05-08T07:21:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:23 smithi133 ceph-mon[125939]: pgmap v7003: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 45 KiB/s wr, 7 op/s 2023-05-08T07:21:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:23 smithi096 ceph-mon[124666]: pgmap v7003: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 45 KiB/s wr, 7 op/s 2023-05-08T07:21:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:23 smithi186 ceph-mon[126480]: pgmap v7003: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 45 KiB/s wr, 7 op/s 2023-05-08T07:21:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13022.858491 secs 2023-05-08T07:21:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13023.416202 secs 2023-05-08T07:21:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13022.858491 secs 2023-05-08T07:21:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13023.416202 secs 2023-05-08T07:21:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13022.858491 secs 2023-05-08T07:21:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13023.416202 secs 2023-05-08T07:21:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:25 smithi096 ceph-mon[124666]: pgmap v7004: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 41 KiB/s wr, 7 op/s 2023-05-08T07:21:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:25 smithi186 ceph-mon[126480]: pgmap v7004: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 41 KiB/s wr, 7 op/s 2023-05-08T07:21:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:25 smithi133 ceph-mon[125939]: pgmap v7004: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 41 KiB/s wr, 7 op/s 2023-05-08T07:21:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13024.698441 secs 2023-05-08T07:21:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13024.698441 secs 2023-05-08T07:21:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13024.698441 secs 2023-05-08T07:21:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:27 smithi096 ceph-mon[124666]: pgmap v7005: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 42 KiB/s wr, 10 op/s 2023-05-08T07:21:27.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:27 smithi186 ceph-mon[126480]: pgmap v7005: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 42 KiB/s wr, 10 op/s 2023-05-08T07:21:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:27 smithi133 ceph-mon[125939]: pgmap v7005: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 42 KiB/s wr, 10 op/s 2023-05-08T07:21:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:29 smithi186 ceph-mon[126480]: pgmap v7006: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 6 op/s 2023-05-08T07:21:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13027.858596 secs 2023-05-08T07:21:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13028.416324 secs 2023-05-08T07:21:29.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:29 smithi133 ceph-mon[125939]: pgmap v7006: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 6 op/s 2023-05-08T07:21:29.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13027.858596 secs 2023-05-08T07:21:29.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13028.416324 secs 2023-05-08T07:21:30.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:29 smithi096 ceph-mon[124666]: pgmap v7006: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 6 op/s 2023-05-08T07:21:30.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13027.858596 secs 2023-05-08T07:21:30.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13028.416324 secs 2023-05-08T07:21:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:31 smithi186 ceph-mon[126480]: pgmap v7007: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 71 KiB/s wr, 10 op/s 2023-05-08T07:21:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13029.698565 secs 2023-05-08T07:21:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:31 smithi133 ceph-mon[125939]: pgmap v7007: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 71 KiB/s wr, 10 op/s 2023-05-08T07:21:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13029.698565 secs 2023-05-08T07:21:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:31 smithi096 ceph-mon[124666]: pgmap v7007: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 71 KiB/s wr, 10 op/s 2023-05-08T07:21:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13029.698565 secs 2023-05-08T07:21:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:33 smithi186 ceph-mon[126480]: pgmap v7008: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 6 op/s 2023-05-08T07:21:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:33 smithi133 ceph-mon[125939]: pgmap v7008: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 6 op/s 2023-05-08T07:21:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:33 smithi096 ceph-mon[124666]: pgmap v7008: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 6 op/s 2023-05-08T07:21:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13032.858741 secs 2023-05-08T07:21:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13033.416462 secs 2023-05-08T07:21:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13032.858741 secs 2023-05-08T07:21:34.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13033.416462 secs 2023-05-08T07:21:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13032.858741 secs 2023-05-08T07:21:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13033.416462 secs 2023-05-08T07:21:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:35 smithi186 ceph-mon[126480]: pgmap v7009: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 6 op/s 2023-05-08T07:21:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:35 smithi133 ceph-mon[125939]: pgmap v7009: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 6 op/s 2023-05-08T07:21:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:35 smithi096 ceph-mon[124666]: pgmap v7009: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 6 op/s 2023-05-08T07:21:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:37 smithi186 ceph-mon[126480]: pgmap v7010: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 36 KiB/s wr, 9 op/s 2023-05-08T07:21:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:37 smithi133 ceph-mon[125939]: pgmap v7010: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 36 KiB/s wr, 9 op/s 2023-05-08T07:21:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:37 smithi096 ceph-mon[124666]: pgmap v7010: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 36 KiB/s wr, 9 op/s 2023-05-08T07:21:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:39 smithi186 ceph-mon[126480]: pgmap v7011: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 5 op/s 2023-05-08T07:21:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13037.858859 secs 2023-05-08T07:21:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:39 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:21:39.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13038.416581 secs 2023-05-08T07:21:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:39 smithi133 ceph-mon[125939]: pgmap v7011: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 5 op/s 2023-05-08T07:21:39.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13037.858859 secs 2023-05-08T07:21:39.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:39 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:21:39.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13038.416581 secs 2023-05-08T07:21:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:39 smithi096 ceph-mon[124666]: pgmap v7011: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 5 op/s 2023-05-08T07:21:40.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13037.858859 secs 2023-05-08T07:21:40.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:39 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:21:40.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13038.416581 secs 2023-05-08T07:21:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:40 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:21:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:40 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:21:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:40 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:21:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:40 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:21:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:40 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:21:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:40 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:21:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:40 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:21:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:40 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:21:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:40 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:21:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:41 smithi186 ceph-mon[126480]: pgmap v7012: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 71 KiB/s wr, 9 op/s 2023-05-08T07:21:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:41 smithi133 ceph-mon[125939]: pgmap v7012: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 71 KiB/s wr, 9 op/s 2023-05-08T07:21:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:41 smithi096 ceph-mon[124666]: pgmap v7012: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 71 KiB/s wr, 9 op/s 2023-05-08T07:21:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:43 smithi186 ceph-mon[126480]: pgmap v7013: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 36 KiB/s wr, 5 op/s 2023-05-08T07:21:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:43 smithi133 ceph-mon[125939]: pgmap v7013: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 36 KiB/s wr, 5 op/s 2023-05-08T07:21:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:43 smithi096 ceph-mon[124666]: pgmap v7013: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 36 KiB/s wr, 5 op/s 2023-05-08T07:21:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13042.858981 secs 2023-05-08T07:21:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13042.858981 secs 2023-05-08T07:21:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13042.858981 secs 2023-05-08T07:21:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:45 smithi186 ceph-mon[126480]: pgmap v7014: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 36 KiB/s wr, 5 op/s 2023-05-08T07:21:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:45 smithi133 ceph-mon[125939]: pgmap v7014: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 36 KiB/s wr, 5 op/s 2023-05-08T07:21:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:45 smithi096 ceph-mon[124666]: pgmap v7014: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 36 KiB/s wr, 5 op/s 2023-05-08T07:21:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:47 smithi186 ceph-mon[126480]: pgmap v7015: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 79 KiB/s wr, 9 op/s 2023-05-08T07:21:47.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:21:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:47 smithi133 ceph-mon[125939]: pgmap v7015: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 79 KiB/s wr, 9 op/s 2023-05-08T07:21:47.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:21:48.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:47 smithi096 ceph-mon[124666]: pgmap v7015: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 79 KiB/s wr, 9 op/s 2023-05-08T07:21:48.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:21:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:48 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:21:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:21:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:21:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:48 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:21:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:21:48.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:21:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:48 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:21:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:21:49.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:21:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:49 smithi186 ceph-mon[126480]: pgmap v7016: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 79 KiB/s wr, 6 op/s 2023-05-08T07:21:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13047.859059 secs 2023-05-08T07:21:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:49 smithi133 ceph-mon[125939]: pgmap v7016: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 79 KiB/s wr, 6 op/s 2023-05-08T07:21:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13047.859059 secs 2023-05-08T07:21:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:49 smithi096 ceph-mon[124666]: pgmap v7016: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 79 KiB/s wr, 6 op/s 2023-05-08T07:21:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13047.859059 secs 2023-05-08T07:21:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:51 smithi186 ceph-mon[126480]: pgmap v7017: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 224 KiB/s wr, 12 op/s 2023-05-08T07:21:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:51 smithi133 ceph-mon[125939]: pgmap v7017: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 224 KiB/s wr, 12 op/s 2023-05-08T07:21:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:51 smithi096 ceph-mon[124666]: pgmap v7017: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 224 KiB/s wr, 12 op/s 2023-05-08T07:21:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:53 smithi186 ceph-mon[126480]: pgmap v7018: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 188 KiB/s wr, 9 op/s 2023-05-08T07:21:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:53 smithi133 ceph-mon[125939]: pgmap v7018: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 188 KiB/s wr, 9 op/s 2023-05-08T07:21:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:53 smithi096 ceph-mon[124666]: pgmap v7018: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 188 KiB/s wr, 9 op/s 2023-05-08T07:21:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13052.859200 secs 2023-05-08T07:21:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13053.416927 secs 2023-05-08T07:21:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13052.859200 secs 2023-05-08T07:21:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13053.416927 secs 2023-05-08T07:21:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13052.859200 secs 2023-05-08T07:21:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13053.416927 secs 2023-05-08T07:21:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:55 smithi186 ceph-mon[126480]: pgmap v7019: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 188 KiB/s wr, 9 op/s 2023-05-08T07:21:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:55 smithi133 ceph-mon[125939]: pgmap v7019: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 188 KiB/s wr, 9 op/s 2023-05-08T07:21:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:55 smithi096 ceph-mon[124666]: pgmap v7019: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 188 KiB/s wr, 9 op/s 2023-05-08T07:21:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:56 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:21:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:21:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:21:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:56 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:21:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:21:56.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:21:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:56 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:21:57.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:21:57.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:21:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:57 smithi186 ceph-mon[126480]: pgmap v7020: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 234 KiB/s wr, 14 op/s 2023-05-08T07:21:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:57 smithi133 ceph-mon[125939]: pgmap v7020: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 234 KiB/s wr, 14 op/s 2023-05-08T07:21:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:57 smithi096 ceph-mon[124666]: pgmap v7020: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 234 KiB/s wr, 14 op/s 2023-05-08T07:21:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:59 smithi186 ceph-mon[126480]: pgmap v7021: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 192 KiB/s wr, 10 op/s 2023-05-08T07:21:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13057.859281 secs 2023-05-08T07:21:59.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:21:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13058.417046 secs 2023-05-08T07:21:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:59 smithi133 ceph-mon[125939]: pgmap v7021: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 192 KiB/s wr, 10 op/s 2023-05-08T07:21:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13057.859281 secs 2023-05-08T07:21:59.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:21:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13058.417046 secs 2023-05-08T07:22:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:59 smithi096 ceph-mon[124666]: pgmap v7021: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 192 KiB/s wr, 10 op/s 2023-05-08T07:22:00.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13057.859281 secs 2023-05-08T07:22:00.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:21:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13058.417046 secs 2023-05-08T07:22:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:01 smithi186 ceph-mon[126480]: pgmap v7022: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 292 KiB/s wr, 14 op/s 2023-05-08T07:22:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:01 smithi133 ceph-mon[125939]: pgmap v7022: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 292 KiB/s wr, 14 op/s 2023-05-08T07:22:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:01 smithi096 ceph-mon[124666]: pgmap v7022: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 292 KiB/s wr, 14 op/s 2023-05-08T07:22:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:02 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:22:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:02 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:22:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:02 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:22:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:02 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:22:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:02 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:22:02.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:02 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:22:02.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:02 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:22:02.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:02 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:22:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:02 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:22:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:02 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:22:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:02 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:22:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:02 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:22:03.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:03 smithi186 ceph-mon[126480]: pgmap v7023: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 147 KiB/s wr, 9 op/s 2023-05-08T07:22:03.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:03 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:22:03.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:03 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T07:22:03.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:03 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T07:22:03.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:03 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:22:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:03 smithi133 ceph-mon[125939]: pgmap v7023: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 147 KiB/s wr, 9 op/s 2023-05-08T07:22:03.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:03 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:22:03.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:03 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T07:22:03.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:03 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T07:22:03.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:03 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:22:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:03 smithi096 ceph-mon[124666]: pgmap v7023: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 147 KiB/s wr, 9 op/s 2023-05-08T07:22:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:03 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:22:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:03 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T07:22:04.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:03 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T07:22:04.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:03 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:22:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13062.859396 secs 2023-05-08T07:22:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13063.417184 secs 2023-05-08T07:22:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13062.859396 secs 2023-05-08T07:22:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13063.417184 secs 2023-05-08T07:22:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13062.859396 secs 2023-05-08T07:22:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13063.417184 secs 2023-05-08T07:22:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:05 smithi133 ceph-mon[125939]: pgmap v7024: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 147 KiB/s wr, 9 op/s 2023-05-08T07:22:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:05 smithi096 ceph-mon[124666]: pgmap v7024: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 147 KiB/s wr, 9 op/s 2023-05-08T07:22:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:05 smithi186 ceph-mon[126480]: pgmap v7024: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 147 KiB/s wr, 9 op/s 2023-05-08T07:22:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13064.699322 secs 2023-05-08T07:22:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:06 smithi133 ceph-mon[125939]: osdmap e516: 12 total, 12 up, 12 in 2023-05-08T07:22:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13064.699322 secs 2023-05-08T07:22:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:06 smithi096 ceph-mon[124666]: osdmap e516: 12 total, 12 up, 12 in 2023-05-08T07:22:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13064.699322 secs 2023-05-08T07:22:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:06 smithi186 ceph-mon[126480]: osdmap e516: 12 total, 12 up, 12 in 2023-05-08T07:22:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:07 smithi133 ceph-mon[125939]: pgmap v7026: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 269 KiB/s wr, 28 op/s 2023-05-08T07:22:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:07 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:22:07.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:07 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:22:07.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:07 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:22:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:07 smithi096 ceph-mon[124666]: pgmap v7026: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 269 KiB/s wr, 28 op/s 2023-05-08T07:22:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:07 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:22:08.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:07 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:22:08.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:07 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:22:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:07 smithi186 ceph-mon[126480]: pgmap v7026: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 269 KiB/s wr, 28 op/s 2023-05-08T07:22:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:07 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:22:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:07 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:22:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:07 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:22:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:09 smithi133 ceph-mon[125939]: pgmap v7027: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 269 KiB/s wr, 28 op/s 2023-05-08T07:22:09.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13067.859459 secs 2023-05-08T07:22:09.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13068.417307 secs 2023-05-08T07:22:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:09 smithi096 ceph-mon[124666]: pgmap v7027: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 269 KiB/s wr, 28 op/s 2023-05-08T07:22:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13067.859459 secs 2023-05-08T07:22:10.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13068.417307 secs 2023-05-08T07:22:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:09 smithi186 ceph-mon[126480]: pgmap v7027: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 269 KiB/s wr, 28 op/s 2023-05-08T07:22:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13067.859459 secs 2023-05-08T07:22:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13068.417307 secs 2023-05-08T07:22:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:11 smithi133 ceph-mon[125939]: pgmap v7028: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 294 KiB/s wr, 27 op/s 2023-05-08T07:22:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13069.699462 secs 2023-05-08T07:22:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:11 smithi096 ceph-mon[124666]: pgmap v7028: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 294 KiB/s wr, 27 op/s 2023-05-08T07:22:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13069.699462 secs 2023-05-08T07:22:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:11 smithi186 ceph-mon[126480]: pgmap v7028: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 294 KiB/s wr, 27 op/s 2023-05-08T07:22:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13069.699462 secs 2023-05-08T07:22:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:13 smithi133 ceph-mon[125939]: pgmap v7029: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 294 KiB/s wr, 27 op/s 2023-05-08T07:22:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:13 smithi096 ceph-mon[124666]: pgmap v7029: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 294 KiB/s wr, 27 op/s 2023-05-08T07:22:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:13 smithi186 ceph-mon[126480]: pgmap v7029: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 294 KiB/s wr, 27 op/s 2023-05-08T07:22:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13072.859585 secs 2023-05-08T07:22:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13073.417450 secs 2023-05-08T07:22:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13072.859585 secs 2023-05-08T07:22:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13073.417450 secs 2023-05-08T07:22:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13072.859585 secs 2023-05-08T07:22:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13073.417450 secs 2023-05-08T07:22:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:15 smithi133 ceph-mon[125939]: pgmap v7030: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 294 KiB/s wr, 27 op/s 2023-05-08T07:22:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:15 smithi096 ceph-mon[124666]: pgmap v7030: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 294 KiB/s wr, 27 op/s 2023-05-08T07:22:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:15 smithi186 ceph-mon[126480]: pgmap v7030: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 294 KiB/s wr, 27 op/s 2023-05-08T07:22:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13074.699607 secs 2023-05-08T07:22:16.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:16 smithi133 ceph-mon[125939]: osdmap e517: 12 total, 12 up, 12 in 2023-05-08T07:22:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13074.699607 secs 2023-05-08T07:22:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:16 smithi096 ceph-mon[124666]: osdmap e517: 12 total, 12 up, 12 in 2023-05-08T07:22:17.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13074.699607 secs 2023-05-08T07:22:17.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:16 smithi186 ceph-mon[126480]: osdmap e517: 12 total, 12 up, 12 in 2023-05-08T07:22:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:17 smithi133 ceph-mon[125939]: pgmap v7031: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 180 KiB/s wr, 9 op/s 2023-05-08T07:22:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:17 smithi096 ceph-mon[124666]: pgmap v7031: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 180 KiB/s wr, 9 op/s 2023-05-08T07:22:18.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:17 smithi186 ceph-mon[126480]: pgmap v7031: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 180 KiB/s wr, 9 op/s 2023-05-08T07:22:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:19 smithi133 ceph-mon[125939]: pgmap v7033: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 186 KiB/s wr, 9 op/s 2023-05-08T07:22:19.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13077.859666 secs 2023-05-08T07:22:19.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13078.417520 secs 2023-05-08T07:22:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:19 smithi096 ceph-mon[124666]: pgmap v7033: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 186 KiB/s wr, 9 op/s 2023-05-08T07:22:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13077.859666 secs 2023-05-08T07:22:20.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13078.417520 secs 2023-05-08T07:22:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:19 smithi186 ceph-mon[126480]: pgmap v7033: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 186 KiB/s wr, 9 op/s 2023-05-08T07:22:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13077.859666 secs 2023-05-08T07:22:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13078.417520 secs 2023-05-08T07:22:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:21 smithi133 ceph-mon[125939]: pgmap v7034: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 71 KiB/s wr, 8 op/s 2023-05-08T07:22:21.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13079.699759 secs 2023-05-08T07:22:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:21 smithi096 ceph-mon[124666]: pgmap v7034: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 71 KiB/s wr, 8 op/s 2023-05-08T07:22:22.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13079.699759 secs 2023-05-08T07:22:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:21 smithi186 ceph-mon[126480]: pgmap v7034: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 71 KiB/s wr, 8 op/s 2023-05-08T07:22:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13079.699759 secs 2023-05-08T07:22:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:23 smithi133 ceph-mon[125939]: pgmap v7035: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 70 KiB/s wr, 8 op/s 2023-05-08T07:22:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:23 smithi096 ceph-mon[124666]: pgmap v7035: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 70 KiB/s wr, 8 op/s 2023-05-08T07:22:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:23 smithi186 ceph-mon[126480]: pgmap v7035: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 70 KiB/s wr, 8 op/s 2023-05-08T07:22:24.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13082.859792 secs 2023-05-08T07:22:24.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13083.417639 secs 2023-05-08T07:22:24.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:24 smithi133 ceph-mon[125939]: pgmap v7036: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 70 KiB/s wr, 8 op/s 2023-05-08T07:22:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13082.859792 secs 2023-05-08T07:22:25.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13083.417639 secs 2023-05-08T07:22:25.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:24 smithi096 ceph-mon[124666]: pgmap v7036: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 70 KiB/s wr, 8 op/s 2023-05-08T07:22:25.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13082.859792 secs 2023-05-08T07:22:25.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13083.417639 secs 2023-05-08T07:22:25.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:24 smithi186 ceph-mon[126480]: pgmap v7036: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 70 KiB/s wr, 8 op/s 2023-05-08T07:22:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13084.699884 secs 2023-05-08T07:22:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13084.699884 secs 2023-05-08T07:22:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13084.699884 secs 2023-05-08T07:22:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:27 smithi186 ceph-mon[126480]: pgmap v7037: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 72 KiB/s wr, 7 op/s 2023-05-08T07:22:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:27 smithi133 ceph-mon[125939]: pgmap v7037: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 72 KiB/s wr, 7 op/s 2023-05-08T07:22:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:27 smithi096 ceph-mon[124666]: pgmap v7037: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 72 KiB/s wr, 7 op/s 2023-05-08T07:22:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:29 smithi186 ceph-mon[126480]: pgmap v7038: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 60 KiB/s wr, 6 op/s 2023-05-08T07:22:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13087.859932 secs 2023-05-08T07:22:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:29 smithi133 ceph-mon[125939]: pgmap v7038: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 60 KiB/s wr, 6 op/s 2023-05-08T07:22:29.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13087.859932 secs 2023-05-08T07:22:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:29 smithi096 ceph-mon[124666]: pgmap v7038: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 60 KiB/s wr, 6 op/s 2023-05-08T07:22:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13087.859932 secs 2023-05-08T07:22:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13088.417755 secs 2023-05-08T07:22:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13088.417755 secs 2023-05-08T07:22:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13088.417755 secs 2023-05-08T07:22:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:31 smithi186 ceph-mon[126480]: pgmap v7039: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 61 KiB/s wr, 9 op/s 2023-05-08T07:22:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13089.699949 secs 2023-05-08T07:22:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:31 smithi133 ceph-mon[125939]: pgmap v7039: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 61 KiB/s wr, 9 op/s 2023-05-08T07:22:31.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13089.699949 secs 2023-05-08T07:22:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:31 smithi096 ceph-mon[124666]: pgmap v7039: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 61 KiB/s wr, 9 op/s 2023-05-08T07:22:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13089.699949 secs 2023-05-08T07:22:33.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:33 smithi186 ceph-mon[126480]: pgmap v7040: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 6 op/s 2023-05-08T07:22:33.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:33 smithi133 ceph-mon[125939]: pgmap v7040: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 6 op/s 2023-05-08T07:22:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:33 smithi096 ceph-mon[124666]: pgmap v7040: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 6 op/s 2023-05-08T07:22:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13092.860032 secs 2023-05-08T07:22:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13092.860032 secs 2023-05-08T07:22:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13092.860032 secs 2023-05-08T07:22:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13093.417903 secs 2023-05-08T07:22:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:35 smithi186 ceph-mon[126480]: pgmap v7041: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 6 op/s 2023-05-08T07:22:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13093.417903 secs 2023-05-08T07:22:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:35 smithi133 ceph-mon[125939]: pgmap v7041: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 6 op/s 2023-05-08T07:22:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13093.417903 secs 2023-05-08T07:22:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:35 smithi096 ceph-mon[124666]: pgmap v7041: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 6 op/s 2023-05-08T07:22:37.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:37 smithi186 ceph-mon[126480]: pgmap v7042: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 69 KiB/s wr, 9 op/s 2023-05-08T07:22:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:37 smithi133 ceph-mon[125939]: pgmap v7042: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 69 KiB/s wr, 9 op/s 2023-05-08T07:22:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:37 smithi096 ceph-mon[124666]: pgmap v7042: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 69 KiB/s wr, 9 op/s 2023-05-08T07:22:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:39 smithi133 ceph-mon[125939]: pgmap v7043: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T07:22:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13097.860124 secs 2023-05-08T07:22:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:39 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:22:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:39 smithi096 ceph-mon[124666]: pgmap v7043: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T07:22:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13097.860124 secs 2023-05-08T07:22:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:39 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:22:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:39 smithi186 ceph-mon[126480]: pgmap v7043: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 34 KiB/s wr, 6 op/s 2023-05-08T07:22:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13097.860124 secs 2023-05-08T07:22:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:39 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:22:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13098.418041 secs 2023-05-08T07:22:40.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:40 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:22:40.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:40 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:22:40.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:40 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:22:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13098.418041 secs 2023-05-08T07:22:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:40 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:22:40.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:40 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:22:40.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:40 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:22:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13098.418041 secs 2023-05-08T07:22:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:40 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:22:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:40 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:22:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:40 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:22:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:41 smithi133 ceph-mon[125939]: pgmap v7044: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 120 KiB/s wr, 10 op/s 2023-05-08T07:22:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:41 smithi096 ceph-mon[124666]: pgmap v7044: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 120 KiB/s wr, 10 op/s 2023-05-08T07:22:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:41 smithi186 ceph-mon[126480]: pgmap v7044: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 120 KiB/s wr, 10 op/s 2023-05-08T07:22:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:43 smithi133 ceph-mon[125939]: pgmap v7045: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 119 KiB/s wr, 7 op/s 2023-05-08T07:22:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:43 smithi096 ceph-mon[124666]: pgmap v7045: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 119 KiB/s wr, 7 op/s 2023-05-08T07:22:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:43 smithi186 ceph-mon[126480]: pgmap v7045: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 119 KiB/s wr, 7 op/s 2023-05-08T07:22:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13102.860243 secs 2023-05-08T07:22:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13102.860243 secs 2023-05-08T07:22:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13102.860243 secs 2023-05-08T07:22:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:45 smithi133 ceph-mon[125939]: pgmap v7046: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 119 KiB/s wr, 7 op/s 2023-05-08T07:22:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:45 smithi096 ceph-mon[124666]: pgmap v7046: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 119 KiB/s wr, 7 op/s 2023-05-08T07:22:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:45 smithi186 ceph-mon[126480]: pgmap v7046: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 119 KiB/s wr, 7 op/s 2023-05-08T07:22:47.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:47 smithi133 ceph-mon[125939]: pgmap v7047: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 162 KiB/s wr, 12 op/s 2023-05-08T07:22:47.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:22:47.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:47 smithi096 ceph-mon[124666]: pgmap v7047: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 162 KiB/s wr, 12 op/s 2023-05-08T07:22:47.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:22:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:47 smithi186 ceph-mon[126480]: pgmap v7047: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 162 KiB/s wr, 12 op/s 2023-05-08T07:22:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:22:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:48 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:22:48.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:22:48.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:22:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:48 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:22:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:22:48.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:22:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:48 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:22:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:22:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:22:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:49 smithi133 ceph-mon[125939]: pgmap v7048: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 129 KiB/s wr, 8 op/s 2023-05-08T07:22:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13107.860321 secs 2023-05-08T07:22:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:49 smithi096 ceph-mon[124666]: pgmap v7048: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 129 KiB/s wr, 8 op/s 2023-05-08T07:22:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13107.860321 secs 2023-05-08T07:22:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:49 smithi186 ceph-mon[126480]: pgmap v7048: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 129 KiB/s wr, 8 op/s 2023-05-08T07:22:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13107.860321 secs 2023-05-08T07:22:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13108.418272 secs 2023-05-08T07:22:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13108.418272 secs 2023-05-08T07:22:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13108.418272 secs 2023-05-08T07:22:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:51 smithi133 ceph-mon[125939]: pgmap v7049: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 340 KiB/s wr, 13 op/s 2023-05-08T07:22:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:51 smithi096 ceph-mon[124666]: pgmap v7049: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 340 KiB/s wr, 13 op/s 2023-05-08T07:22:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:51 smithi186 ceph-mon[126480]: pgmap v7049: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 340 KiB/s wr, 13 op/s 2023-05-08T07:22:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:22:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:22:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:22:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:22:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:22:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:22:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:53 smithi133 ceph-mon[125939]: pgmap v7050: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 324 KiB/s rd, 254 KiB/s wr, 9 op/s 2023-05-08T07:22:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:53 smithi096 ceph-mon[124666]: pgmap v7050: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 324 KiB/s rd, 254 KiB/s wr, 9 op/s 2023-05-08T07:22:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:53 smithi186 ceph-mon[126480]: pgmap v7050: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 324 KiB/s rd, 254 KiB/s wr, 9 op/s 2023-05-08T07:22:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13112.860441 secs 2023-05-08T07:22:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13112.860441 secs 2023-05-08T07:22:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13112.860441 secs 2023-05-08T07:22:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:55 smithi133 ceph-mon[125939]: pgmap v7051: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 324 KiB/s rd, 254 KiB/s wr, 9 op/s 2023-05-08T07:22:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:55 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:22:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:55 smithi096 ceph-mon[124666]: pgmap v7051: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 324 KiB/s rd, 254 KiB/s wr, 9 op/s 2023-05-08T07:22:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:55 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:22:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:55 smithi186 ceph-mon[126480]: pgmap v7051: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 324 KiB/s rd, 254 KiB/s wr, 9 op/s 2023-05-08T07:22:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:55 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:22:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13114.700575 secs 2023-05-08T07:22:56.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:56 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:22:56.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:22:56.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:22:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13114.700575 secs 2023-05-08T07:22:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:56 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:22:56.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:22:56.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:22:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13114.700575 secs 2023-05-08T07:22:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:56 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:22:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:22:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:22:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:57 smithi133 ceph-mon[125939]: pgmap v7052: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 301 KiB/s wr, 14 op/s 2023-05-08T07:22:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:57 smithi096 ceph-mon[124666]: pgmap v7052: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 301 KiB/s wr, 14 op/s 2023-05-08T07:22:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:57 smithi186 ceph-mon[126480]: pgmap v7052: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 301 KiB/s wr, 14 op/s 2023-05-08T07:22:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:59 smithi133 ceph-mon[125939]: pgmap v7053: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 258 KiB/s wr, 9 op/s 2023-05-08T07:22:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:22:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13117.860570 secs 2023-05-08T07:22:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:59 smithi096 ceph-mon[124666]: pgmap v7053: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 258 KiB/s wr, 9 op/s 2023-05-08T07:22:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:22:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13117.860570 secs 2023-05-08T07:22:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:59 smithi186 ceph-mon[126480]: pgmap v7053: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 258 KiB/s wr, 9 op/s 2023-05-08T07:22:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:22:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13117.860570 secs 2023-05-08T07:23:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13118.418551 secs 2023-05-08T07:23:00.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:23:00.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:23:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13118.418551 secs 2023-05-08T07:23:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:23:00.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:23:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13118.418551 secs 2023-05-08T07:23:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:23:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:23:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13119.700675 secs 2023-05-08T07:23:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:01 smithi133 ceph-mon[125939]: pgmap v7054: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 352 KiB/s rd, 327 KiB/s wr, 13 op/s 2023-05-08T07:23:01.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:01 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:23:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13119.700675 secs 2023-05-08T07:23:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:01 smithi096 ceph-mon[124666]: pgmap v7054: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 352 KiB/s rd, 327 KiB/s wr, 13 op/s 2023-05-08T07:23:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:01 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:23:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13119.700675 secs 2023-05-08T07:23:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:01 smithi186 ceph-mon[126480]: pgmap v7054: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 352 KiB/s rd, 327 KiB/s wr, 13 op/s 2023-05-08T07:23:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:01 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:23:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:03 smithi133 ceph-mon[125939]: pgmap v7055: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 116 KiB/s wr, 8 op/s 2023-05-08T07:23:03.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:23:03.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:23:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:03 smithi096 ceph-mon[124666]: pgmap v7055: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 116 KiB/s wr, 8 op/s 2023-05-08T07:23:03.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:23:03.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:23:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:03 smithi186 ceph-mon[126480]: pgmap v7055: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 116 KiB/s wr, 8 op/s 2023-05-08T07:23:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:23:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:23:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13122.860637 secs 2023-05-08T07:23:04.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:04 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:23:04.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:04 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:23:04.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:04 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:23:04.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:04 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:23:04.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:04 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:23:04.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:04 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T07:23:04.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:04 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T07:23:04.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:04 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:23:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13122.860637 secs 2023-05-08T07:23:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:04 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:23:04.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:04 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:23:04.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:04 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:23:04.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:04 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:23:04.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:04 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:23:04.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:04 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T07:23:04.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:04 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T07:23:04.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:04 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:23:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13122.860637 secs 2023-05-08T07:23:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:04 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:23:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:04 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:23:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:04 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:23:04.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:04 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:23:04.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:04 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:23:04.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:04 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T07:23:04.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:04 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T07:23:04.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:04 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:23:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13123.418641 secs 2023-05-08T07:23:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:05 smithi096 ceph-mon[124666]: pgmap v7056: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 116 KiB/s wr, 8 op/s 2023-05-08T07:23:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13123.418641 secs 2023-05-08T07:23:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:05 smithi186 ceph-mon[126480]: pgmap v7056: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 116 KiB/s wr, 8 op/s 2023-05-08T07:23:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13123.418641 secs 2023-05-08T07:23:05.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:05 smithi133 ceph-mon[125939]: pgmap v7056: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 116 KiB/s wr, 8 op/s 2023-05-08T07:23:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13124.700812 secs 2023-05-08T07:23:06.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:06 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:23:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13124.700812 secs 2023-05-08T07:23:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:06 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:23:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13124.700812 secs 2023-05-08T07:23:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:06 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:23:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:07 smithi096 ceph-mon[124666]: pgmap v7057: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 193 KiB/s wr, 26 op/s 2023-05-08T07:23:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:07 smithi186 ceph-mon[126480]: pgmap v7057: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 193 KiB/s wr, 26 op/s 2023-05-08T07:23:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:07 smithi133 ceph-mon[125939]: pgmap v7057: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 193 KiB/s wr, 26 op/s 2023-05-08T07:23:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:09 smithi096 ceph-mon[124666]: pgmap v7058: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 146 KiB/s wr, 21 op/s 2023-05-08T07:23:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13127.860757 secs 2023-05-08T07:23:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:09 smithi186 ceph-mon[126480]: pgmap v7058: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 146 KiB/s wr, 21 op/s 2023-05-08T07:23:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13127.860757 secs 2023-05-08T07:23:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:09 smithi133 ceph-mon[125939]: pgmap v7058: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 146 KiB/s wr, 21 op/s 2023-05-08T07:23:09.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13127.860757 secs 2023-05-08T07:23:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13128.418705 secs 2023-05-08T07:23:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13128.418705 secs 2023-05-08T07:23:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13128.418705 secs 2023-05-08T07:23:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13129.700924 secs 2023-05-08T07:23:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:11 smithi186 ceph-mon[126480]: pgmap v7059: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 259 KiB/s wr, 26 op/s 2023-05-08T07:23:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:11 smithi186 ceph-mon[126480]: osdmap e518: 12 total, 12 up, 12 in 2023-05-08T07:23:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13129.700924 secs 2023-05-08T07:23:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:11 smithi133 ceph-mon[125939]: pgmap v7059: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 259 KiB/s wr, 26 op/s 2023-05-08T07:23:11.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:11 smithi133 ceph-mon[125939]: osdmap e518: 12 total, 12 up, 12 in 2023-05-08T07:23:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13129.700924 secs 2023-05-08T07:23:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:11 smithi096 ceph-mon[124666]: pgmap v7059: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 259 KiB/s wr, 26 op/s 2023-05-08T07:23:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:11 smithi096 ceph-mon[124666]: osdmap e518: 12 total, 12 up, 12 in 2023-05-08T07:23:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:13 smithi186 ceph-mon[126480]: pgmap v7061: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 228 KiB/s wr, 27 op/s 2023-05-08T07:23:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:13 smithi133 ceph-mon[125939]: pgmap v7061: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 228 KiB/s wr, 27 op/s 2023-05-08T07:23:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:13 smithi096 ceph-mon[124666]: pgmap v7061: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 228 KiB/s wr, 27 op/s 2023-05-08T07:23:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13132.860879 secs 2023-05-08T07:23:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13132.860879 secs 2023-05-08T07:23:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13132.860879 secs 2023-05-08T07:23:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13133.418824 secs 2023-05-08T07:23:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:15 smithi186 ceph-mon[126480]: pgmap v7062: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 228 KiB/s wr, 27 op/s 2023-05-08T07:23:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13133.418824 secs 2023-05-08T07:23:15.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:15 smithi133 ceph-mon[125939]: pgmap v7062: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 228 KiB/s wr, 27 op/s 2023-05-08T07:23:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13133.418824 secs 2023-05-08T07:23:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:15 smithi096 ceph-mon[124666]: pgmap v7062: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 228 KiB/s wr, 27 op/s 2023-05-08T07:23:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13134.701018 secs 2023-05-08T07:23:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13134.701018 secs 2023-05-08T07:23:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13134.701018 secs 2023-05-08T07:23:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:17 smithi186 ceph-mon[126480]: pgmap v7063: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 143 KiB/s wr, 10 op/s 2023-05-08T07:23:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:17 smithi133 ceph-mon[125939]: pgmap v7063: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 143 KiB/s wr, 10 op/s 2023-05-08T07:23:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:17 smithi096 ceph-mon[124666]: pgmap v7063: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 143 KiB/s wr, 10 op/s 2023-05-08T07:23:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:19 smithi186 ceph-mon[126480]: pgmap v7064: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 143 KiB/s wr, 10 op/s 2023-05-08T07:23:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13137.860989 secs 2023-05-08T07:23:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:19 smithi133 ceph-mon[125939]: pgmap v7064: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 143 KiB/s wr, 10 op/s 2023-05-08T07:23:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13137.860989 secs 2023-05-08T07:23:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:19 smithi096 ceph-mon[124666]: pgmap v7064: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 143 KiB/s wr, 10 op/s 2023-05-08T07:23:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13137.860989 secs 2023-05-08T07:23:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13138.418916 secs 2023-05-08T07:23:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13138.418916 secs 2023-05-08T07:23:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13138.418916 secs 2023-05-08T07:23:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13139.701169 secs 2023-05-08T07:23:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:21 smithi186 ceph-mon[126480]: pgmap v7065: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 50 KiB/s wr, 8 op/s 2023-05-08T07:23:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:21 smithi186 ceph-mon[126480]: osdmap e519: 12 total, 12 up, 12 in 2023-05-08T07:23:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13139.701169 secs 2023-05-08T07:23:21.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:21 smithi133 ceph-mon[125939]: pgmap v7065: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 50 KiB/s wr, 8 op/s 2023-05-08T07:23:21.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:21 smithi133 ceph-mon[125939]: osdmap e519: 12 total, 12 up, 12 in 2023-05-08T07:23:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13139.701169 secs 2023-05-08T07:23:21.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:21 smithi096 ceph-mon[124666]: pgmap v7065: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 50 KiB/s wr, 8 op/s 2023-05-08T07:23:21.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:21 smithi096 ceph-mon[124666]: osdmap e519: 12 total, 12 up, 12 in 2023-05-08T07:23:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:23 smithi186 ceph-mon[126480]: pgmap v7067: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 50 KiB/s wr, 8 op/s 2023-05-08T07:23:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:23 smithi133 ceph-mon[125939]: pgmap v7067: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 50 KiB/s wr, 8 op/s 2023-05-08T07:23:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:23 smithi096 ceph-mon[124666]: pgmap v7067: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 50 KiB/s wr, 8 op/s 2023-05-08T07:23:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13142.861101 secs 2023-05-08T07:23:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13142.861101 secs 2023-05-08T07:23:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13142.861101 secs 2023-05-08T07:23:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13143.419035 secs 2023-05-08T07:23:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:25 smithi186 ceph-mon[126480]: pgmap v7068: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 50 KiB/s wr, 8 op/s 2023-05-08T07:23:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13143.419035 secs 2023-05-08T07:23:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:25 smithi133 ceph-mon[125939]: pgmap v7068: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 50 KiB/s wr, 8 op/s 2023-05-08T07:23:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13143.419035 secs 2023-05-08T07:23:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:25 smithi096 ceph-mon[124666]: pgmap v7068: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 50 KiB/s wr, 8 op/s 2023-05-08T07:23:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13144.701293 secs 2023-05-08T07:23:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13144.701293 secs 2023-05-08T07:23:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13144.701293 secs 2023-05-08T07:23:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:27 smithi186 ceph-mon[126480]: pgmap v7069: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 43 KiB/s wr, 8 op/s 2023-05-08T07:23:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:27 smithi133 ceph-mon[125939]: pgmap v7069: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 43 KiB/s wr, 8 op/s 2023-05-08T07:23:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:27 smithi096 ceph-mon[124666]: pgmap v7069: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 43 KiB/s wr, 8 op/s 2023-05-08T07:23:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:29 smithi186 ceph-mon[126480]: pgmap v7070: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 43 KiB/s wr, 8 op/s 2023-05-08T07:23:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13147.861192 secs 2023-05-08T07:23:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:29 smithi133 ceph-mon[125939]: pgmap v7070: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 43 KiB/s wr, 8 op/s 2023-05-08T07:23:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13147.861192 secs 2023-05-08T07:23:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:29 smithi096 ceph-mon[124666]: pgmap v7070: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 43 KiB/s wr, 8 op/s 2023-05-08T07:23:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13147.861192 secs 2023-05-08T07:23:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13148.419181 secs 2023-05-08T07:23:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13148.419181 secs 2023-05-08T07:23:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13148.419181 secs 2023-05-08T07:23:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13149.701412 secs 2023-05-08T07:23:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:31 smithi186 ceph-mon[126480]: pgmap v7071: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 44 KiB/s wr, 8 op/s 2023-05-08T07:23:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13149.701412 secs 2023-05-08T07:23:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:31 smithi133 ceph-mon[125939]: pgmap v7071: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 44 KiB/s wr, 8 op/s 2023-05-08T07:23:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13149.701412 secs 2023-05-08T07:23:31.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:31 smithi096 ceph-mon[124666]: pgmap v7071: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 44 KiB/s wr, 8 op/s 2023-05-08T07:23:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:33 smithi186 ceph-mon[126480]: pgmap v7072: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 40 KiB/s wr, 7 op/s 2023-05-08T07:23:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:33 smithi133 ceph-mon[125939]: pgmap v7072: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 40 KiB/s wr, 7 op/s 2023-05-08T07:23:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:33 smithi096 ceph-mon[124666]: pgmap v7072: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 40 KiB/s wr, 7 op/s 2023-05-08T07:23:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13152.861308 secs 2023-05-08T07:23:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13152.861308 secs 2023-05-08T07:23:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13152.861308 secs 2023-05-08T07:23:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13153.419323 secs 2023-05-08T07:23:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:35 smithi186 ceph-mon[126480]: pgmap v7073: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 36 KiB/s wr, 6 op/s 2023-05-08T07:23:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13153.419323 secs 2023-05-08T07:23:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:35 smithi133 ceph-mon[125939]: pgmap v7073: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 36 KiB/s wr, 6 op/s 2023-05-08T07:23:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13153.419323 secs 2023-05-08T07:23:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:35 smithi096 ceph-mon[124666]: pgmap v7073: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 36 KiB/s wr, 6 op/s 2023-05-08T07:23:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13154.701537 secs 2023-05-08T07:23:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13154.701537 secs 2023-05-08T07:23:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13154.701537 secs 2023-05-08T07:23:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:37 smithi186 ceph-mon[126480]: pgmap v7074: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 36 KiB/s wr, 9 op/s 2023-05-08T07:23:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:37 smithi133 ceph-mon[125939]: pgmap v7074: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 36 KiB/s wr, 9 op/s 2023-05-08T07:23:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:37 smithi096 ceph-mon[124666]: pgmap v7074: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 36 KiB/s wr, 9 op/s 2023-05-08T07:23:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:39 smithi186 ceph-mon[126480]: pgmap v7075: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 6 op/s 2023-05-08T07:23:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13157.861444 secs 2023-05-08T07:23:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:39 smithi133 ceph-mon[125939]: pgmap v7075: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 6 op/s 2023-05-08T07:23:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13157.861444 secs 2023-05-08T07:23:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:39 smithi096 ceph-mon[124666]: pgmap v7075: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 6 op/s 2023-05-08T07:23:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13157.861444 secs 2023-05-08T07:23:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13158.419451 secs 2023-05-08T07:23:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13158.419451 secs 2023-05-08T07:23:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13158.419451 secs 2023-05-08T07:23:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:41 smithi186 ceph-mon[126480]: pgmap v7076: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 36 KiB/s wr, 8 op/s 2023-05-08T07:23:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:41 smithi133 ceph-mon[125939]: pgmap v7076: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 36 KiB/s wr, 8 op/s 2023-05-08T07:23:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:41 smithi096 ceph-mon[124666]: pgmap v7076: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 36 KiB/s wr, 8 op/s 2023-05-08T07:23:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:43 smithi186 ceph-mon[126480]: pgmap v7077: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 341 B/s wr, 5 op/s 2023-05-08T07:23:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:23:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:43 smithi133 ceph-mon[125939]: pgmap v7077: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 341 B/s wr, 5 op/s 2023-05-08T07:23:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:23:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:43 smithi096 ceph-mon[124666]: pgmap v7077: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 341 B/s wr, 5 op/s 2023-05-08T07:23:43.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:23:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13162.861528 secs 2023-05-08T07:23:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:23:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:23:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:23:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13162.861528 secs 2023-05-08T07:23:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:23:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:23:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:23:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13162.861528 secs 2023-05-08T07:23:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:23:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:23:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:23:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13163.419548 secs 2023-05-08T07:23:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:45 smithi133 ceph-mon[125939]: pgmap v7078: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 341 B/s wr, 5 op/s 2023-05-08T07:23:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13163.419548 secs 2023-05-08T07:23:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:45 smithi096 ceph-mon[124666]: pgmap v7078: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 341 B/s wr, 5 op/s 2023-05-08T07:23:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13163.419548 secs 2023-05-08T07:23:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:45 smithi186 ceph-mon[126480]: pgmap v7078: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 341 B/s wr, 5 op/s 2023-05-08T07:23:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:47 smithi133 ceph-mon[125939]: pgmap v7079: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 37 KiB/s wr, 8 op/s 2023-05-08T07:23:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:47 smithi096 ceph-mon[124666]: pgmap v7079: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 37 KiB/s wr, 8 op/s 2023-05-08T07:23:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:47 smithi186 ceph-mon[126480]: pgmap v7079: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 37 KiB/s wr, 8 op/s 2023-05-08T07:23:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:49 smithi133 ceph-mon[125939]: pgmap v7080: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 5 op/s 2023-05-08T07:23:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13167.861603 secs 2023-05-08T07:23:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:49 smithi096 ceph-mon[124666]: pgmap v7080: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 5 op/s 2023-05-08T07:23:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13167.861603 secs 2023-05-08T07:23:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:49 smithi186 ceph-mon[126480]: pgmap v7080: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 5 op/s 2023-05-08T07:23:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13167.861603 secs 2023-05-08T07:23:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:51 smithi133 ceph-mon[125939]: pgmap v7081: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 108 KiB/s wr, 9 op/s 2023-05-08T07:23:51.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:23:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:51 smithi096 ceph-mon[124666]: pgmap v7081: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 108 KiB/s wr, 9 op/s 2023-05-08T07:23:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:23:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:51 smithi186 ceph-mon[126480]: pgmap v7081: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 108 KiB/s wr, 9 op/s 2023-05-08T07:23:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:23:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:52 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:23:52.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:23:52.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:23:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:52 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:23:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:23:52.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:23:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:52 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:23:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:23:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:23:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:53 smithi133 ceph-mon[125939]: pgmap v7082: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 108 KiB/s wr, 6 op/s 2023-05-08T07:23:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:53 smithi096 ceph-mon[124666]: pgmap v7082: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 108 KiB/s wr, 6 op/s 2023-05-08T07:23:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:53 smithi186 ceph-mon[126480]: pgmap v7082: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 108 KiB/s wr, 6 op/s 2023-05-08T07:23:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13172.861721 secs 2023-05-08T07:23:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13172.861721 secs 2023-05-08T07:23:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13172.861721 secs 2023-05-08T07:23:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:55 smithi133 ceph-mon[125939]: pgmap v7083: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 108 KiB/s wr, 6 op/s 2023-05-08T07:23:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:55 smithi096 ceph-mon[124666]: pgmap v7083: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 108 KiB/s wr, 6 op/s 2023-05-08T07:23:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:55 smithi186 ceph-mon[126480]: pgmap v7083: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 108 KiB/s wr, 6 op/s 2023-05-08T07:23:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13174.701931 secs 2023-05-08T07:23:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13174.701931 secs 2023-05-08T07:23:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13174.701931 secs 2023-05-08T07:23:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:57 smithi133 ceph-mon[125939]: pgmap v7084: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 256 KiB/s wr, 12 op/s 2023-05-08T07:23:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:57 smithi096 ceph-mon[124666]: pgmap v7084: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 256 KiB/s wr, 12 op/s 2023-05-08T07:23:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:57 smithi186 ceph-mon[126480]: pgmap v7084: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 256 KiB/s wr, 12 op/s 2023-05-08T07:23:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:59 smithi133 ceph-mon[125939]: pgmap v7085: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 219 KiB/s wr, 9 op/s 2023-05-08T07:23:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:23:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13177.861845 secs 2023-05-08T07:23:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:59 smithi096 ceph-mon[124666]: pgmap v7085: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 219 KiB/s wr, 9 op/s 2023-05-08T07:23:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:23:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13177.861845 secs 2023-05-08T07:23:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:59 smithi186 ceph-mon[126480]: pgmap v7085: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 219 KiB/s wr, 9 op/s 2023-05-08T07:23:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:23:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13177.861845 secs 2023-05-08T07:24:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13178.419947 secs 2023-05-08T07:24:00.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:00 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:24:00.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:24:00.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:24:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13178.419947 secs 2023-05-08T07:24:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:00 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:24:00.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:24:00.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:24:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13178.419947 secs 2023-05-08T07:24:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:00 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:24:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:24:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:24:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13179.702030 secs 2023-05-08T07:24:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:01 smithi133 ceph-mon[125939]: pgmap v7086: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 267 KiB/s wr, 13 op/s 2023-05-08T07:24:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13179.702030 secs 2023-05-08T07:24:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:01 smithi096 ceph-mon[124666]: pgmap v7086: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 267 KiB/s wr, 13 op/s 2023-05-08T07:24:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13179.702030 secs 2023-05-08T07:24:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:01 smithi186 ceph-mon[126480]: pgmap v7086: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 267 KiB/s wr, 13 op/s 2023-05-08T07:24:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:03 smithi133 ceph-mon[125939]: pgmap v7087: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 195 KiB/s wr, 9 op/s 2023-05-08T07:24:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:24:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:03 smithi096 ceph-mon[124666]: pgmap v7087: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 195 KiB/s wr, 9 op/s 2023-05-08T07:24:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:24:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:03 smithi186 ceph-mon[126480]: pgmap v7087: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 195 KiB/s wr, 9 op/s 2023-05-08T07:24:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:24:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13182.861939 secs 2023-05-08T07:24:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:04 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:24:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:04 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:24:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13182.861939 secs 2023-05-08T07:24:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:04 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:24:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:04 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:24:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13182.861939 secs 2023-05-08T07:24:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:04 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:24:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:04 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:24:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13183.420046 secs 2023-05-08T07:24:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:05 smithi133 ceph-mon[125939]: pgmap v7088: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 195 KiB/s wr, 9 op/s 2023-05-08T07:24:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13183.420046 secs 2023-05-08T07:24:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:05 smithi096 ceph-mon[124666]: pgmap v7088: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 195 KiB/s wr, 9 op/s 2023-05-08T07:24:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13183.420046 secs 2023-05-08T07:24:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:05 smithi186 ceph-mon[126480]: pgmap v7088: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 195 KiB/s wr, 9 op/s 2023-05-08T07:24:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:06 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:24:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:06 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:24:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:06 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:24:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:07 smithi133 ceph-mon[125939]: pgmap v7089: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 320 KiB/s wr, 26 op/s 2023-05-08T07:24:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:07 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:24:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:07 smithi096 ceph-mon[124666]: pgmap v7089: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 320 KiB/s wr, 26 op/s 2023-05-08T07:24:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:07 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:24:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:07 smithi186 ceph-mon[126480]: pgmap v7089: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 320 KiB/s wr, 26 op/s 2023-05-08T07:24:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:07 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:24:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:24:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:24:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:24:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:24:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:24:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:24:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:09 smithi133 ceph-mon[125939]: pgmap v7090: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 172 KiB/s wr, 20 op/s 2023-05-08T07:24:09.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13187.862061 secs 2023-05-08T07:24:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:09 smithi096 ceph-mon[124666]: pgmap v7090: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 172 KiB/s wr, 20 op/s 2023-05-08T07:24:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13187.862061 secs 2023-05-08T07:24:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:09 smithi186 ceph-mon[126480]: pgmap v7090: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 172 KiB/s wr, 20 op/s 2023-05-08T07:24:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13187.862061 secs 2023-05-08T07:24:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:11 smithi133 ceph-mon[125939]: pgmap v7091: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 250 KiB/s wr, 25 op/s 2023-05-08T07:24:11.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:11 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:24:11.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:11 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:24:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:11 smithi096 ceph-mon[124666]: pgmap v7091: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 250 KiB/s wr, 25 op/s 2023-05-08T07:24:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:11 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:24:11.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:11 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:24:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:11 smithi186 ceph-mon[126480]: pgmap v7091: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 250 KiB/s wr, 25 op/s 2023-05-08T07:24:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:11 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:24:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:11 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:24:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:12 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:24:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:12 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:24:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:12 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:24:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:12 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:24:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:12 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:24:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:12 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:24:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:13 smithi133 ceph-mon[125939]: pgmap v7092: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 202 KiB/s wr, 21 op/s 2023-05-08T07:24:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:13 smithi096 ceph-mon[124666]: pgmap v7092: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 202 KiB/s wr, 21 op/s 2023-05-08T07:24:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:13 smithi186 ceph-mon[126480]: pgmap v7092: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 202 KiB/s wr, 21 op/s 2023-05-08T07:24:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13192.862172 secs 2023-05-08T07:24:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13192.862172 secs 2023-05-08T07:24:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13192.862172 secs 2023-05-08T07:24:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:15 smithi133 ceph-mon[125939]: pgmap v7093: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 202 KiB/s wr, 21 op/s 2023-05-08T07:24:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:15 smithi096 ceph-mon[124666]: pgmap v7093: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 202 KiB/s wr, 21 op/s 2023-05-08T07:24:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:15 smithi186 ceph-mon[126480]: pgmap v7093: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 202 KiB/s wr, 21 op/s 2023-05-08T07:24:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:16 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:24:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:16 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:24:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:16 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:24:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:17 smithi096 ceph-mon[124666]: pgmap v7094: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 227 KiB/s wr, 24 op/s 2023-05-08T07:24:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:17 smithi186 ceph-mon[126480]: pgmap v7094: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 227 KiB/s wr, 24 op/s 2023-05-08T07:24:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:17 smithi133 ceph-mon[125939]: pgmap v7094: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 227 KiB/s wr, 24 op/s 2023-05-08T07:24:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:24:18.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:24:18.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:24:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:24:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:24:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:24:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:24:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:24:18.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:24:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:19 smithi096 ceph-mon[124666]: pgmap v7095: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 103 KiB/s wr, 7 op/s 2023-05-08T07:24:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13197.862272 secs 2023-05-08T07:24:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:19 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:24:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:19 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T07:24:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:19 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T07:24:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:19 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:24:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13198.420398 secs 2023-05-08T07:24:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:19 smithi186 ceph-mon[126480]: pgmap v7095: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 103 KiB/s wr, 7 op/s 2023-05-08T07:24:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13197.862272 secs 2023-05-08T07:24:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:19 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:24:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:19 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T07:24:19.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:19 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T07:24:19.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:19 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:24:19.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13198.420398 secs 2023-05-08T07:24:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:19 smithi133 ceph-mon[125939]: pgmap v7095: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 103 KiB/s wr, 7 op/s 2023-05-08T07:24:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13197.862272 secs 2023-05-08T07:24:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:19 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:24:19.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:19 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T07:24:19.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:19 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T07:24:19.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:19 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:24:19.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13198.420398 secs 2023-05-08T07:24:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13199.702575 secs 2023-05-08T07:24:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:21 smithi186 ceph-mon[126480]: pgmap v7096: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 305 KiB/s wr, 13 op/s 2023-05-08T07:24:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:21 smithi186 ceph-mon[126480]: osdmap e520: 12 total, 12 up, 12 in 2023-05-08T07:24:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13199.702575 secs 2023-05-08T07:24:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:21 smithi133 ceph-mon[125939]: pgmap v7096: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 305 KiB/s wr, 13 op/s 2023-05-08T07:24:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:21 smithi133 ceph-mon[125939]: osdmap e520: 12 total, 12 up, 12 in 2023-05-08T07:24:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13199.702575 secs 2023-05-08T07:24:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:21 smithi096 ceph-mon[124666]: pgmap v7096: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 305 KiB/s wr, 13 op/s 2023-05-08T07:24:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:21 smithi096 ceph-mon[124666]: osdmap e520: 12 total, 12 up, 12 in 2023-05-08T07:24:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:23 smithi186 ceph-mon[126480]: pgmap v7098: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 273 KiB/s wr, 10 op/s 2023-05-08T07:24:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:23 smithi133 ceph-mon[125939]: pgmap v7098: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 273 KiB/s wr, 10 op/s 2023-05-08T07:24:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:23 smithi096 ceph-mon[124666]: pgmap v7098: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 273 KiB/s wr, 10 op/s 2023-05-08T07:24:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13202.862412 secs 2023-05-08T07:24:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:24 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:24:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:24 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:24:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:24 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:24:24.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:24 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:24:24.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13203.420517 secs 2023-05-08T07:24:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13202.862412 secs 2023-05-08T07:24:24.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:24 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:24:24.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:24 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:24:24.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:24 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:24:24.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:24 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:24:24.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13203.420517 secs 2023-05-08T07:24:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13202.862412 secs 2023-05-08T07:24:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:24 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:24:25.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:24 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:24:25.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:24 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:24:25.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:24 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:24:25.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13203.420517 secs 2023-05-08T07:24:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:25 smithi186 ceph-mon[126480]: pgmap v7099: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 273 KiB/s wr, 10 op/s 2023-05-08T07:24:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:25 smithi133 ceph-mon[125939]: pgmap v7099: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 273 KiB/s wr, 10 op/s 2023-05-08T07:24:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:25 smithi096 ceph-mon[124666]: pgmap v7099: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 273 KiB/s wr, 10 op/s 2023-05-08T07:24:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13204.702702 secs 2023-05-08T07:24:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13204.702702 secs 2023-05-08T07:24:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13204.702702 secs 2023-05-08T07:24:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:27 smithi186 ceph-mon[126480]: pgmap v7100: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 302 KiB/s wr, 12 op/s 2023-05-08T07:24:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:27 smithi133 ceph-mon[125939]: pgmap v7100: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 302 KiB/s wr, 12 op/s 2023-05-08T07:24:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:27 smithi096 ceph-mon[124666]: pgmap v7100: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 302 KiB/s wr, 12 op/s 2023-05-08T07:24:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:29 smithi186 ceph-mon[126480]: pgmap v7101: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 302 KiB/s wr, 12 op/s 2023-05-08T07:24:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13207.862500 secs 2023-05-08T07:24:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13208.420668 secs 2023-05-08T07:24:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:29 smithi133 ceph-mon[125939]: pgmap v7101: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 302 KiB/s wr, 12 op/s 2023-05-08T07:24:29.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13207.862500 secs 2023-05-08T07:24:29.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13208.420668 secs 2023-05-08T07:24:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:29 smithi096 ceph-mon[124666]: pgmap v7101: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 302 KiB/s wr, 12 op/s 2023-05-08T07:24:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13207.862500 secs 2023-05-08T07:24:30.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13208.420668 secs 2023-05-08T07:24:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13209.702868 secs 2023-05-08T07:24:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:31 smithi186 ceph-mon[126480]: pgmap v7102: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 94 KiB/s wr, 9 op/s 2023-05-08T07:24:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:31 smithi186 ceph-mon[126480]: osdmap e521: 12 total, 12 up, 12 in 2023-05-08T07:24:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13209.702868 secs 2023-05-08T07:24:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:31 smithi133 ceph-mon[125939]: pgmap v7102: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 94 KiB/s wr, 9 op/s 2023-05-08T07:24:31.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:31 smithi133 ceph-mon[125939]: osdmap e521: 12 total, 12 up, 12 in 2023-05-08T07:24:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13209.702868 secs 2023-05-08T07:24:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:31 smithi096 ceph-mon[124666]: pgmap v7102: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 94 KiB/s wr, 9 op/s 2023-05-08T07:24:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:31 smithi096 ceph-mon[124666]: osdmap e521: 12 total, 12 up, 12 in 2023-05-08T07:24:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:33 smithi186 ceph-mon[126480]: pgmap v7104: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 94 KiB/s wr, 9 op/s 2023-05-08T07:24:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:33 smithi133 ceph-mon[125939]: pgmap v7104: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 94 KiB/s wr, 9 op/s 2023-05-08T07:24:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:33 smithi096 ceph-mon[124666]: pgmap v7104: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 94 KiB/s wr, 9 op/s 2023-05-08T07:24:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13212.862626 secs 2023-05-08T07:24:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13213.420748 secs 2023-05-08T07:24:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13212.862626 secs 2023-05-08T07:24:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13213.420748 secs 2023-05-08T07:24:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13212.862626 secs 2023-05-08T07:24:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13213.420748 secs 2023-05-08T07:24:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:35 smithi186 ceph-mon[126480]: pgmap v7105: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 94 KiB/s wr, 9 op/s 2023-05-08T07:24:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:35 smithi133 ceph-mon[125939]: pgmap v7105: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 94 KiB/s wr, 9 op/s 2023-05-08T07:24:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:35 smithi096 ceph-mon[124666]: pgmap v7105: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 94 KiB/s wr, 9 op/s 2023-05-08T07:24:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13214.702935 secs 2023-05-08T07:24:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13214.702935 secs 2023-05-08T07:24:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13214.702935 secs 2023-05-08T07:24:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:37 smithi186 ceph-mon[126480]: pgmap v7106: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 115 KiB/s wr, 8 op/s 2023-05-08T07:24:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:37 smithi133 ceph-mon[125939]: pgmap v7106: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 115 KiB/s wr, 8 op/s 2023-05-08T07:24:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:37 smithi096 ceph-mon[124666]: pgmap v7106: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 115 KiB/s wr, 8 op/s 2023-05-08T07:24:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:39 smithi186 ceph-mon[126480]: pgmap v7107: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 115 KiB/s wr, 8 op/s 2023-05-08T07:24:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13218.420859 secs 2023-05-08T07:24:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:39 smithi133 ceph-mon[125939]: pgmap v7107: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 115 KiB/s wr, 8 op/s 2023-05-08T07:24:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13218.420859 secs 2023-05-08T07:24:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:39 smithi096 ceph-mon[124666]: pgmap v7107: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 115 KiB/s wr, 8 op/s 2023-05-08T07:24:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13218.420859 secs 2023-05-08T07:24:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:41 smithi186 ceph-mon[126480]: pgmap v7108: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 165 KiB/s wr, 7 op/s 2023-05-08T07:24:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:41 smithi133 ceph-mon[125939]: pgmap v7108: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 165 KiB/s wr, 7 op/s 2023-05-08T07:24:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:41 smithi096 ceph-mon[124666]: pgmap v7108: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 165 KiB/s wr, 7 op/s 2023-05-08T07:24:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:24:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:24:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:24:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:43 smithi186 ceph-mon[126480]: pgmap v7109: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 152 KiB/s wr, 7 op/s 2023-05-08T07:24:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:43 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:24:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T07:24:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:24:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:24:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:43 smithi133 ceph-mon[125939]: pgmap v7109: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 152 KiB/s wr, 7 op/s 2023-05-08T07:24:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:43 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:24:43.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T07:24:43.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:24:43.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:24:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:43 smithi096 ceph-mon[124666]: pgmap v7109: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 152 KiB/s wr, 7 op/s 2023-05-08T07:24:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:43 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:24:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T07:24:44.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:24:44.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:24:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13222.862844 secs 2023-05-08T07:24:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:24:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:24:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13222.862844 secs 2023-05-08T07:24:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:24:44.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:24:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13222.862844 secs 2023-05-08T07:24:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:24:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:24:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:45 smithi186 ceph-mon[126480]: pgmap v7110: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 137 KiB/s wr, 6 op/s 2023-05-08T07:24:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:45 smithi133 ceph-mon[125939]: pgmap v7110: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 137 KiB/s wr, 6 op/s 2023-05-08T07:24:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:45 smithi096 ceph-mon[124666]: pgmap v7110: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 137 KiB/s wr, 6 op/s 2023-05-08T07:24:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:46 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T07:24:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:46 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:24:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:46 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T07:24:46.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:46 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:24:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:46 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T07:24:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:46 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:24:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:47 smithi186 ceph-mon[126480]: pgmap v7111: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 223 KiB/s wr, 10 op/s 2023-05-08T07:24:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:24:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:47 smithi133 ceph-mon[125939]: pgmap v7111: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 223 KiB/s wr, 10 op/s 2023-05-08T07:24:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:24:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:47 smithi096 ceph-mon[124666]: pgmap v7111: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 223 KiB/s wr, 10 op/s 2023-05-08T07:24:48.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:24:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:48 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:24:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:24:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:24:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:48 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:24:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:24:48.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:24:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:48 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:24:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:24:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:24:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:49 smithi186 ceph-mon[126480]: pgmap v7112: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 157 KiB/s wr, 7 op/s 2023-05-08T07:24:49.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13227.862932 secs 2023-05-08T07:24:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:49 smithi133 ceph-mon[125939]: pgmap v7112: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 157 KiB/s wr, 7 op/s 2023-05-08T07:24:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13227.862932 secs 2023-05-08T07:24:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:49 smithi096 ceph-mon[124666]: pgmap v7112: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 157 KiB/s wr, 7 op/s 2023-05-08T07:24:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13227.862932 secs 2023-05-08T07:24:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:51 smithi186 ceph-mon[126480]: pgmap v7113: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 270 KiB/s wr, 12 op/s 2023-05-08T07:24:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:51 smithi133 ceph-mon[125939]: pgmap v7113: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 270 KiB/s wr, 12 op/s 2023-05-08T07:24:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:51 smithi096 ceph-mon[124666]: pgmap v7113: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 270 KiB/s wr, 12 op/s 2023-05-08T07:24:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:53 smithi186 ceph-mon[126480]: pgmap v7114: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 199 KiB/s wr, 9 op/s 2023-05-08T07:24:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:53 smithi133 ceph-mon[125939]: pgmap v7114: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 199 KiB/s wr, 9 op/s 2023-05-08T07:24:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:53 smithi096 ceph-mon[124666]: pgmap v7114: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 199 KiB/s wr, 9 op/s 2023-05-08T07:24:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13232.863065 secs 2023-05-08T07:24:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13233.421129 secs 2023-05-08T07:24:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13232.863065 secs 2023-05-08T07:24:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13233.421129 secs 2023-05-08T07:24:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13232.863065 secs 2023-05-08T07:24:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13233.421129 secs 2023-05-08T07:24:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:55 smithi133 ceph-mon[125939]: pgmap v7115: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 199 KiB/s wr, 9 op/s 2023-05-08T07:24:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:55 smithi096 ceph-mon[124666]: pgmap v7115: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 199 KiB/s wr, 9 op/s 2023-05-08T07:24:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:55 smithi186 ceph-mon[126480]: pgmap v7115: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 199 KiB/s wr, 9 op/s 2023-05-08T07:24:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13234.703340 secs 2023-05-08T07:24:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:56 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:24:56.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:24:56.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:24:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13234.703340 secs 2023-05-08T07:24:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:56 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:24:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:24:57.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:24:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13234.703340 secs 2023-05-08T07:24:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:56 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:24:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:24:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:24:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:57 smithi133 ceph-mon[125939]: pgmap v7116: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 285 KiB/s wr, 14 op/s 2023-05-08T07:24:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:57 smithi096 ceph-mon[124666]: pgmap v7116: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 285 KiB/s wr, 14 op/s 2023-05-08T07:24:58.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:57 smithi186 ceph-mon[126480]: pgmap v7116: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 285 KiB/s wr, 14 op/s 2023-05-08T07:24:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:59 smithi133 ceph-mon[125939]: pgmap v7117: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 199 KiB/s wr, 9 op/s 2023-05-08T07:24:59.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13237.863181 secs 2023-05-08T07:24:59.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:59 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:24:59.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:24:59 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:25:00.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:59 smithi096 ceph-mon[124666]: pgmap v7117: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 199 KiB/s wr, 9 op/s 2023-05-08T07:25:00.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13237.863181 secs 2023-05-08T07:25:00.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:59 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:25:00.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:24:59 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:25:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:59 smithi186 ceph-mon[126480]: pgmap v7117: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 199 KiB/s wr, 9 op/s 2023-05-08T07:25:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13237.863181 secs 2023-05-08T07:25:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:59 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:25:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:24:59 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:25:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13239.703477 secs 2023-05-08T07:25:01.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:01 smithi133 ceph-mon[125939]: pgmap v7118: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 363 KiB/s wr, 14 op/s 2023-05-08T07:25:01.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:01 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:25:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13239.703477 secs 2023-05-08T07:25:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:01 smithi096 ceph-mon[124666]: pgmap v7118: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 363 KiB/s wr, 14 op/s 2023-05-08T07:25:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:01 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:25:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13239.703477 secs 2023-05-08T07:25:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:01 smithi186 ceph-mon[126480]: pgmap v7118: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 363 KiB/s wr, 14 op/s 2023-05-08T07:25:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:01 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:25:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:03 smithi133 ceph-mon[125939]: pgmap v7119: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 250 KiB/s wr, 8 op/s 2023-05-08T07:25:03.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:03 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:25:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:03 smithi096 ceph-mon[124666]: pgmap v7119: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 250 KiB/s wr, 8 op/s 2023-05-08T07:25:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:03 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:25:04.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:03 smithi186 ceph-mon[126480]: pgmap v7119: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 250 KiB/s wr, 8 op/s 2023-05-08T07:25:04.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:03 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:25:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13242.863302 secs 2023-05-08T07:25:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:04 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:25:04.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:04 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:25:04.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13243.421368 secs 2023-05-08T07:25:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13242.863302 secs 2023-05-08T07:25:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:04 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:25:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:04 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:25:05.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13243.421368 secs 2023-05-08T07:25:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13242.863302 secs 2023-05-08T07:25:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:04 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:25:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:04 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:25:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13243.421368 secs 2023-05-08T07:25:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:05 smithi133 ceph-mon[125939]: pgmap v7120: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 250 KiB/s wr, 8 op/s 2023-05-08T07:25:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:05 smithi096 ceph-mon[124666]: pgmap v7120: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 250 KiB/s wr, 8 op/s 2023-05-08T07:25:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:05 smithi186 ceph-mon[126480]: pgmap v7120: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 250 KiB/s wr, 8 op/s 2023-05-08T07:25:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13244.703572 secs 2023-05-08T07:25:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:06 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:25:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13244.703572 secs 2023-05-08T07:25:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:06 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:25:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13244.703572 secs 2023-05-08T07:25:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:06 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:25:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:07 smithi133 ceph-mon[125939]: pgmap v7121: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 313 KiB/s wr, 27 op/s 2023-05-08T07:25:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:07 smithi096 ceph-mon[124666]: pgmap v7121: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 313 KiB/s wr, 27 op/s 2023-05-08T07:25:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:07 smithi186 ceph-mon[126480]: pgmap v7121: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 313 KiB/s wr, 27 op/s 2023-05-08T07:25:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:25:08.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:25:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:25:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:25:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:25:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:25:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:09 smithi133 ceph-mon[125939]: pgmap v7122: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 227 KiB/s wr, 23 op/s 2023-05-08T07:25:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13247.863409 secs 2023-05-08T07:25:09.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13248.421505 secs 2023-05-08T07:25:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:09 smithi096 ceph-mon[124666]: pgmap v7122: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 227 KiB/s wr, 23 op/s 2023-05-08T07:25:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13247.863409 secs 2023-05-08T07:25:10.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13248.421505 secs 2023-05-08T07:25:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:09 smithi186 ceph-mon[126480]: pgmap v7122: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 227 KiB/s wr, 23 op/s 2023-05-08T07:25:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13247.863409 secs 2023-05-08T07:25:10.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13248.421505 secs 2023-05-08T07:25:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13249.703700 secs 2023-05-08T07:25:11.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:11 smithi133 ceph-mon[125939]: pgmap v7123: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 300 KiB/s wr, 27 op/s 2023-05-08T07:25:11.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:11 smithi133 ceph-mon[125939]: osdmap e522: 12 total, 12 up, 12 in 2023-05-08T07:25:11.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:11 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:25:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13249.703700 secs 2023-05-08T07:25:12.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:11 smithi096 ceph-mon[124666]: pgmap v7123: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 300 KiB/s wr, 27 op/s 2023-05-08T07:25:12.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:11 smithi096 ceph-mon[124666]: osdmap e522: 12 total, 12 up, 12 in 2023-05-08T07:25:12.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:11 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:25:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13249.703700 secs 2023-05-08T07:25:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:11 smithi186 ceph-mon[126480]: pgmap v7123: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 300 KiB/s wr, 27 op/s 2023-05-08T07:25:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:11 smithi186 ceph-mon[126480]: osdmap e522: 12 total, 12 up, 12 in 2023-05-08T07:25:12.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:11 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:25:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:13 smithi133 ceph-mon[125939]: pgmap v7125: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 164 KiB/s wr, 27 op/s 2023-05-08T07:25:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:13 smithi096 ceph-mon[124666]: pgmap v7125: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 164 KiB/s wr, 27 op/s 2023-05-08T07:25:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:13 smithi186 ceph-mon[126480]: pgmap v7125: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 164 KiB/s wr, 27 op/s 2023-05-08T07:25:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13252.863558 secs 2023-05-08T07:25:14.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13253.421572 secs 2023-05-08T07:25:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13252.863558 secs 2023-05-08T07:25:15.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13253.421572 secs 2023-05-08T07:25:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13252.863558 secs 2023-05-08T07:25:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13253.421572 secs 2023-05-08T07:25:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:15 smithi133 ceph-mon[125939]: pgmap v7126: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 164 KiB/s wr, 27 op/s 2023-05-08T07:25:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:15 smithi096 ceph-mon[124666]: pgmap v7126: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 164 KiB/s wr, 27 op/s 2023-05-08T07:25:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:15 smithi186 ceph-mon[126480]: pgmap v7126: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 164 KiB/s wr, 27 op/s 2023-05-08T07:25:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13254.703831 secs 2023-05-08T07:25:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13254.703831 secs 2023-05-08T07:25:17.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13254.703831 secs 2023-05-08T07:25:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:17 smithi133 ceph-mon[125939]: pgmap v7127: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 96 KiB/s wr, 9 op/s 2023-05-08T07:25:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:17 smithi096 ceph-mon[124666]: pgmap v7127: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 96 KiB/s wr, 9 op/s 2023-05-08T07:25:18.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:17 smithi186 ceph-mon[126480]: pgmap v7127: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 96 KiB/s wr, 9 op/s 2023-05-08T07:25:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:25:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:25:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:25:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:19 smithi133 ceph-mon[125939]: pgmap v7128: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 96 KiB/s wr, 9 op/s 2023-05-08T07:25:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13257.863638 secs 2023-05-08T07:25:19.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13258.421660 secs 2023-05-08T07:25:19.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:19 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:25:19.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:19 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:25:19.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:19 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:25:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:19 smithi096 ceph-mon[124666]: pgmap v7128: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 96 KiB/s wr, 9 op/s 2023-05-08T07:25:20.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13257.863638 secs 2023-05-08T07:25:20.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13258.421660 secs 2023-05-08T07:25:20.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:19 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:25:20.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:19 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:25:20.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:19 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:25:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:19 smithi186 ceph-mon[126480]: pgmap v7128: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 96 KiB/s wr, 9 op/s 2023-05-08T07:25:20.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13257.863638 secs 2023-05-08T07:25:20.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13258.421660 secs 2023-05-08T07:25:20.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:19 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:25:20.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:19 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:25:20.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:19 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:25:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:20 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:25:20.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:20 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T07:25:20.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:20 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T07:25:20.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:20 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:25:20.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:20 smithi133 ceph-mon[125939]: pgmap v7129: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 8 op/s 2023-05-08T07:25:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:20 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:25:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:20 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T07:25:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:20 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T07:25:21.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:20 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:25:21.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:20 smithi096 ceph-mon[124666]: pgmap v7129: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 8 op/s 2023-05-08T07:25:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:20 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:25:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:20 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T07:25:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:20 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T07:25:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:20 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:25:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:20 smithi186 ceph-mon[126480]: pgmap v7129: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 8 op/s 2023-05-08T07:25:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13259.703949 secs 2023-05-08T07:25:21.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:21 smithi133 ceph-mon[125939]: osdmap e523: 12 total, 12 up, 12 in 2023-05-08T07:25:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13259.703949 secs 2023-05-08T07:25:22.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:21 smithi096 ceph-mon[124666]: osdmap e523: 12 total, 12 up, 12 in 2023-05-08T07:25:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13259.703949 secs 2023-05-08T07:25:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:21 smithi186 ceph-mon[126480]: osdmap e523: 12 total, 12 up, 12 in 2023-05-08T07:25:22.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:22 smithi133 ceph-mon[125939]: pgmap v7131: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 7 op/s 2023-05-08T07:25:23.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:22 smithi096 ceph-mon[124666]: pgmap v7131: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 7 op/s 2023-05-08T07:25:23.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:22 smithi186 ceph-mon[126480]: pgmap v7131: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 7 op/s 2023-05-08T07:25:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13262.863716 secs 2023-05-08T07:25:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13262.863716 secs 2023-05-08T07:25:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13262.863716 secs 2023-05-08T07:25:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13263.421752 secs 2023-05-08T07:25:25.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:25 smithi186 ceph-mon[126480]: pgmap v7132: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 7 op/s 2023-05-08T07:25:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13263.421752 secs 2023-05-08T07:25:25.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:25 smithi133 ceph-mon[125939]: pgmap v7132: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 7 op/s 2023-05-08T07:25:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13263.421752 secs 2023-05-08T07:25:25.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:25 smithi096 ceph-mon[124666]: pgmap v7132: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 7 op/s 2023-05-08T07:25:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13264.704069 secs 2023-05-08T07:25:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13264.704069 secs 2023-05-08T07:25:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13264.704069 secs 2023-05-08T07:25:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:27 smithi133 ceph-mon[125939]: pgmap v7133: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 104 KiB/s wr, 8 op/s 2023-05-08T07:25:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:27 smithi096 ceph-mon[124666]: pgmap v7133: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 104 KiB/s wr, 8 op/s 2023-05-08T07:25:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:27 smithi186 ceph-mon[126480]: pgmap v7133: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 104 KiB/s wr, 8 op/s 2023-05-08T07:25:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:29 smithi133 ceph-mon[125939]: pgmap v7134: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 104 KiB/s wr, 8 op/s 2023-05-08T07:25:29.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13267.863834 secs 2023-05-08T07:25:29.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:29 smithi096 ceph-mon[124666]: pgmap v7134: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 104 KiB/s wr, 8 op/s 2023-05-08T07:25:29.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13267.863834 secs 2023-05-08T07:25:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:29 smithi186 ceph-mon[126480]: pgmap v7134: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 104 KiB/s wr, 8 op/s 2023-05-08T07:25:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13267.863834 secs 2023-05-08T07:25:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13268.421874 secs 2023-05-08T07:25:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13268.421874 secs 2023-05-08T07:25:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13268.421874 secs 2023-05-08T07:25:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13269.704212 secs 2023-05-08T07:25:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:31 smithi133 ceph-mon[125939]: pgmap v7135: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 79 KiB/s wr, 8 op/s 2023-05-08T07:25:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13269.704212 secs 2023-05-08T07:25:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:31 smithi096 ceph-mon[124666]: pgmap v7135: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 79 KiB/s wr, 8 op/s 2023-05-08T07:25:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13269.704212 secs 2023-05-08T07:25:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:31 smithi186 ceph-mon[126480]: pgmap v7135: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 79 KiB/s wr, 8 op/s 2023-05-08T07:25:33.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:33 smithi133 ceph-mon[125939]: pgmap v7136: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 73 KiB/s wr, 7 op/s 2023-05-08T07:25:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:33 smithi096 ceph-mon[124666]: pgmap v7136: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 73 KiB/s wr, 7 op/s 2023-05-08T07:25:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:33 smithi186 ceph-mon[126480]: pgmap v7136: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 73 KiB/s wr, 7 op/s 2023-05-08T07:25:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13272.863955 secs 2023-05-08T07:25:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13272.863955 secs 2023-05-08T07:25:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13272.863955 secs 2023-05-08T07:25:35.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13273.421955 secs 2023-05-08T07:25:35.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:35 smithi133 ceph-mon[125939]: pgmap v7137: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 66 KiB/s wr, 6 op/s 2023-05-08T07:25:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13273.421955 secs 2023-05-08T07:25:35.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:35 smithi096 ceph-mon[124666]: pgmap v7137: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 66 KiB/s wr, 6 op/s 2023-05-08T07:25:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13273.421955 secs 2023-05-08T07:25:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:35 smithi186 ceph-mon[126480]: pgmap v7137: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 66 KiB/s wr, 6 op/s 2023-05-08T07:25:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13274.704365 secs 2023-05-08T07:25:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13274.704365 secs 2023-05-08T07:25:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13274.704365 secs 2023-05-08T07:25:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:37 smithi133 ceph-mon[125939]: pgmap v7138: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 102 KiB/s wr, 9 op/s 2023-05-08T07:25:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:37 smithi096 ceph-mon[124666]: pgmap v7138: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 102 KiB/s wr, 9 op/s 2023-05-08T07:25:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:37 smithi186 ceph-mon[126480]: pgmap v7138: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 102 KiB/s wr, 9 op/s 2023-05-08T07:25:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:39 smithi133 ceph-mon[125939]: pgmap v7139: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 37 KiB/s wr, 6 op/s 2023-05-08T07:25:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13277.864028 secs 2023-05-08T07:25:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:39 smithi096 ceph-mon[124666]: pgmap v7139: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 37 KiB/s wr, 6 op/s 2023-05-08T07:25:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13277.864028 secs 2023-05-08T07:25:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:39 smithi186 ceph-mon[126480]: pgmap v7139: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 37 KiB/s wr, 6 op/s 2023-05-08T07:25:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13277.864028 secs 2023-05-08T07:25:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13278.422076 secs 2023-05-08T07:25:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13278.422076 secs 2023-05-08T07:25:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13278.422076 secs 2023-05-08T07:25:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:41 smithi133 ceph-mon[125939]: pgmap v7140: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 37 KiB/s wr, 9 op/s 2023-05-08T07:25:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:41 smithi096 ceph-mon[124666]: pgmap v7140: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 37 KiB/s wr, 9 op/s 2023-05-08T07:25:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:41 smithi186 ceph-mon[126480]: pgmap v7140: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 37 KiB/s wr, 9 op/s 2023-05-08T07:25:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:43 smithi133 ceph-mon[125939]: pgmap v7141: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 6 op/s 2023-05-08T07:25:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:25:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:43 smithi096 ceph-mon[124666]: pgmap v7141: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 6 op/s 2023-05-08T07:25:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:25:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:43 smithi186 ceph-mon[126480]: pgmap v7141: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 6 op/s 2023-05-08T07:25:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:25:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13282.864125 secs 2023-05-08T07:25:44.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:25:44.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:25:44.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:25:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13282.864125 secs 2023-05-08T07:25:44.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:25:44.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:25:44.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:25:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13282.864125 secs 2023-05-08T07:25:44.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:25:44.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:25:44.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:25:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13283.422195 secs 2023-05-08T07:25:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:45 smithi133 ceph-mon[125939]: pgmap v7142: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 6 op/s 2023-05-08T07:25:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13283.422195 secs 2023-05-08T07:25:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:45 smithi096 ceph-mon[124666]: pgmap v7142: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 6 op/s 2023-05-08T07:25:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13283.422195 secs 2023-05-08T07:25:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:45 smithi186 ceph-mon[126480]: pgmap v7142: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 6 op/s 2023-05-08T07:25:47.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:47 smithi133 ceph-mon[125939]: pgmap v7143: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 103 KiB/s wr, 9 op/s 2023-05-08T07:25:47.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:47 smithi096 ceph-mon[124666]: pgmap v7143: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 103 KiB/s wr, 9 op/s 2023-05-08T07:25:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:47 smithi186 ceph-mon[126480]: pgmap v7143: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 103 KiB/s wr, 9 op/s 2023-05-08T07:25:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:49 smithi133 ceph-mon[125939]: pgmap v7144: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 67 KiB/s wr, 6 op/s 2023-05-08T07:25:49.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13287.864258 secs 2023-05-08T07:25:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:49 smithi096 ceph-mon[124666]: pgmap v7144: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 67 KiB/s wr, 6 op/s 2023-05-08T07:25:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13287.864258 secs 2023-05-08T07:25:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:49 smithi186 ceph-mon[126480]: pgmap v7144: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 67 KiB/s wr, 6 op/s 2023-05-08T07:25:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13287.864258 secs 2023-05-08T07:25:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:51 smithi133 ceph-mon[125939]: pgmap v7145: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 158 KiB/s wr, 10 op/s 2023-05-08T07:25:51.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:25:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:51 smithi096 ceph-mon[124666]: pgmap v7145: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 158 KiB/s wr, 10 op/s 2023-05-08T07:25:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:25:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:51 smithi186 ceph-mon[126480]: pgmap v7145: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 158 KiB/s wr, 10 op/s 2023-05-08T07:25:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:25:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:52 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:25:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:25:52.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:25:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:52 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:25:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:25:52.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:25:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:52 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:25:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:25:52.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:25:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:53 smithi133 ceph-mon[125939]: pgmap v7146: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 158 KiB/s wr, 7 op/s 2023-05-08T07:25:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:53 smithi096 ceph-mon[124666]: pgmap v7146: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 158 KiB/s wr, 7 op/s 2023-05-08T07:25:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:53 smithi186 ceph-mon[126480]: pgmap v7146: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 158 KiB/s wr, 7 op/s 2023-05-08T07:25:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13292.864389 secs 2023-05-08T07:25:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13292.864389 secs 2023-05-08T07:25:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13292.864389 secs 2023-05-08T07:25:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:55 smithi133 ceph-mon[125939]: pgmap v7147: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 158 KiB/s wr, 7 op/s 2023-05-08T07:25:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:55 smithi096 ceph-mon[124666]: pgmap v7147: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 158 KiB/s wr, 7 op/s 2023-05-08T07:25:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:55 smithi186 ceph-mon[126480]: pgmap v7147: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 158 KiB/s wr, 7 op/s 2023-05-08T07:25:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13294.704756 secs 2023-05-08T07:25:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13294.704756 secs 2023-05-08T07:25:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13294.704756 secs 2023-05-08T07:25:57.494 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:57 smithi133 ceph-mon[125939]: pgmap v7148: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 264 KiB/s wr, 13 op/s 2023-05-08T07:25:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:57 smithi096 ceph-mon[124666]: pgmap v7148: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 264 KiB/s wr, 13 op/s 2023-05-08T07:25:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:57 smithi186 ceph-mon[126480]: pgmap v7148: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 264 KiB/s wr, 13 op/s 2023-05-08T07:25:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:59 smithi133 ceph-mon[125939]: pgmap v7149: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 197 KiB/s wr, 9 op/s 2023-05-08T07:25:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:25:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13297.864490 secs 2023-05-08T07:25:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:59 smithi096 ceph-mon[124666]: pgmap v7149: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 197 KiB/s wr, 9 op/s 2023-05-08T07:25:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:25:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13297.864490 secs 2023-05-08T07:25:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:59 smithi186 ceph-mon[126480]: pgmap v7149: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 197 KiB/s wr, 9 op/s 2023-05-08T07:25:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:25:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13297.864490 secs 2023-05-08T07:26:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13298.422568 secs 2023-05-08T07:26:00.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:00 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:26:00.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:26:00.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:26:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13298.422568 secs 2023-05-08T07:26:00.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:00 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:26:00.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:26:00.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:26:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13298.422568 secs 2023-05-08T07:26:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:00 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:26:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:26:00.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:26:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13299.704868 secs 2023-05-08T07:26:01.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:01 smithi133 ceph-mon[125939]: pgmap v7150: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 246 KiB/s wr, 14 op/s 2023-05-08T07:26:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13299.704868 secs 2023-05-08T07:26:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:01 smithi096 ceph-mon[124666]: pgmap v7150: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 246 KiB/s wr, 14 op/s 2023-05-08T07:26:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13299.704868 secs 2023-05-08T07:26:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:01 smithi186 ceph-mon[126480]: pgmap v7150: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 246 KiB/s wr, 14 op/s 2023-05-08T07:26:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:03 smithi133 ceph-mon[125939]: pgmap v7151: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 155 KiB/s wr, 9 op/s 2023-05-08T07:26:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:03 smithi096 ceph-mon[124666]: pgmap v7151: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 155 KiB/s wr, 9 op/s 2023-05-08T07:26:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:03 smithi186 ceph-mon[126480]: pgmap v7151: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 155 KiB/s wr, 9 op/s 2023-05-08T07:26:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13302.864589 secs 2023-05-08T07:26:04.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:04 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:26:04.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:04 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:26:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13302.864589 secs 2023-05-08T07:26:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:04 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:26:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:04 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:26:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13302.864589 secs 2023-05-08T07:26:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:04 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:26:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:04 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:26:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13303.422640 secs 2023-05-08T07:26:05.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:05 smithi096 ceph-mon[124666]: pgmap v7152: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 155 KiB/s wr, 9 op/s 2023-05-08T07:26:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13303.422640 secs 2023-05-08T07:26:05.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:05 smithi186 ceph-mon[126480]: pgmap v7152: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 155 KiB/s wr, 9 op/s 2023-05-08T07:26:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13303.422640 secs 2023-05-08T07:26:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:05 smithi133 ceph-mon[125939]: pgmap v7152: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 155 KiB/s wr, 9 op/s 2023-05-08T07:26:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:06 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:26:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:06 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:26:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:06 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:26:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:07 smithi186 ceph-mon[126480]: pgmap v7153: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 282 KiB/s wr, 26 op/s 2023-05-08T07:26:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:07 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:26:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:07 smithi133 ceph-mon[125939]: pgmap v7153: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 282 KiB/s wr, 26 op/s 2023-05-08T07:26:07.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:07 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:26:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:07 smithi096 ceph-mon[124666]: pgmap v7153: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 282 KiB/s wr, 26 op/s 2023-05-08T07:26:07.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:07 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:26:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:26:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:26:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:26:08.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:26:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:26:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:26:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:09 smithi186 ceph-mon[126480]: pgmap v7154: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 176 KiB/s wr, 20 op/s 2023-05-08T07:26:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13307.864708 secs 2023-05-08T07:26:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:09 smithi133 ceph-mon[125939]: pgmap v7154: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 176 KiB/s wr, 20 op/s 2023-05-08T07:26:09.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13307.864708 secs 2023-05-08T07:26:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:09 smithi096 ceph-mon[124666]: pgmap v7154: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 176 KiB/s wr, 20 op/s 2023-05-08T07:26:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13307.864708 secs 2023-05-08T07:26:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:11 smithi186 ceph-mon[126480]: pgmap v7155: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 290 KiB/s rd, 302 KiB/s wr, 25 op/s 2023-05-08T07:26:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:11 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:26:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:11 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:26:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:11 smithi133 ceph-mon[125939]: pgmap v7155: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 290 KiB/s rd, 302 KiB/s wr, 25 op/s 2023-05-08T07:26:11.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:11 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:26:11.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:11 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:26:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:11 smithi096 ceph-mon[124666]: pgmap v7155: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 290 KiB/s rd, 302 KiB/s wr, 25 op/s 2023-05-08T07:26:11.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:11 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:26:11.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:11 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:26:12.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:12 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:26:12.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:12 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:26:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:12 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:26:12.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:12 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:26:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:12 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:26:12.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:12 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:26:13.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:13 smithi186 ceph-mon[126480]: pgmap v7156: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 253 KiB/s wr, 21 op/s 2023-05-08T07:26:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:13 smithi133 ceph-mon[125939]: pgmap v7156: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 253 KiB/s wr, 21 op/s 2023-05-08T07:26:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:13 smithi096 ceph-mon[124666]: pgmap v7156: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 253 KiB/s wr, 21 op/s 2023-05-08T07:26:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13312.864824 secs 2023-05-08T07:26:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13312.864824 secs 2023-05-08T07:26:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13312.864824 secs 2023-05-08T07:26:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:15 smithi186 ceph-mon[126480]: pgmap v7157: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 253 KiB/s wr, 21 op/s 2023-05-08T07:26:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:15 smithi133 ceph-mon[125939]: pgmap v7157: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 253 KiB/s wr, 21 op/s 2023-05-08T07:26:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:15 smithi096 ceph-mon[124666]: pgmap v7157: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 253 KiB/s wr, 21 op/s 2023-05-08T07:26:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:16 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:26:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:16 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:26:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:16 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:26:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:17 smithi186 ceph-mon[126480]: pgmap v7158: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 279 KiB/s wr, 24 op/s 2023-05-08T07:26:17.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:17 smithi133 ceph-mon[125939]: pgmap v7158: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 279 KiB/s wr, 24 op/s 2023-05-08T07:26:17.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:17 smithi096 ceph-mon[124666]: pgmap v7158: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 279 KiB/s wr, 24 op/s 2023-05-08T07:26:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:19 smithi186 ceph-mon[126480]: pgmap v7159: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 152 KiB/s wr, 8 op/s 2023-05-08T07:26:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13317.864959 secs 2023-05-08T07:26:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:19 smithi133 ceph-mon[125939]: pgmap v7159: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 152 KiB/s wr, 8 op/s 2023-05-08T07:26:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13317.864959 secs 2023-05-08T07:26:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:19 smithi096 ceph-mon[124666]: pgmap v7159: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 152 KiB/s wr, 8 op/s 2023-05-08T07:26:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13317.864959 secs 2023-05-08T07:26:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:20 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:26:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:20 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:26:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:20 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:26:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:21 smithi186 ceph-mon[126480]: pgmap v7160: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 152 KiB/s wr, 11 op/s 2023-05-08T07:26:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:26:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:26:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:21 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:26:21.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:26:21.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:21 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T07:26:21.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:21 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T07:26:21.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:21 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:26:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:21 smithi133 ceph-mon[125939]: pgmap v7160: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 152 KiB/s wr, 11 op/s 2023-05-08T07:26:21.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:26:21.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:26:21.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:21 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:26:21.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:26:21.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:21 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T07:26:21.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:21 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T07:26:21.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:21 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:26:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:21 smithi096 ceph-mon[124666]: pgmap v7160: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 152 KiB/s wr, 11 op/s 2023-05-08T07:26:21.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:26:21.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:26:21.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:21 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:26:21.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:26:21.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:21 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T07:26:21.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:21 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T07:26:21.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:21 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:26:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:23 smithi186 ceph-mon[126480]: pgmap v7161: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 6 op/s 2023-05-08T07:26:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:23 smithi133 ceph-mon[125939]: pgmap v7161: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 6 op/s 2023-05-08T07:26:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:23 smithi096 ceph-mon[124666]: pgmap v7161: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 6 op/s 2023-05-08T07:26:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13322.865084 secs 2023-05-08T07:26:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13322.865084 secs 2023-05-08T07:26:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13322.865084 secs 2023-05-08T07:26:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13323.423071 secs 2023-05-08T07:26:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:25 smithi186 ceph-mon[126480]: pgmap v7162: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 6 op/s 2023-05-08T07:26:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13323.423071 secs 2023-05-08T07:26:25.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:25 smithi133 ceph-mon[125939]: pgmap v7162: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 6 op/s 2023-05-08T07:26:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13323.423071 secs 2023-05-08T07:26:25.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:25 smithi096 ceph-mon[124666]: pgmap v7162: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 6 op/s 2023-05-08T07:26:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13324.705512 secs 2023-05-08T07:26:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13324.705512 secs 2023-05-08T07:26:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13324.705512 secs 2023-05-08T07:26:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:27 smithi186 ceph-mon[126480]: pgmap v7163: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 128 KiB/s wr, 12 op/s 2023-05-08T07:26:27.807 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:27 smithi096 ceph-mon[124666]: pgmap v7163: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 128 KiB/s wr, 12 op/s 2023-05-08T07:26:27.808 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:27 smithi133 ceph-mon[125939]: pgmap v7163: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 128 KiB/s wr, 12 op/s 2023-05-08T07:26:28.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:28 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:26:28.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:28 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:26:28.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:28 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:26:28.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:28 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:26:28.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:28 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:26:28.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:28 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:26:28.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:28 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:26:28.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:28 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:26:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:28 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:26:28.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:28 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:26:28.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:28 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:26:28.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:28 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:26:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:29 smithi186 ceph-mon[126480]: pgmap v7164: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 102 KiB/s wr, 9 op/s 2023-05-08T07:26:29.753 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13327.865205 secs 2023-05-08T07:26:29.754 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:29 smithi133 ceph-mon[125939]: pgmap v7164: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 102 KiB/s wr, 9 op/s 2023-05-08T07:26:29.754 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13327.865205 secs 2023-05-08T07:26:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:29 smithi096 ceph-mon[124666]: pgmap v7164: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 102 KiB/s wr, 9 op/s 2023-05-08T07:26:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13327.865205 secs 2023-05-08T07:26:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13328.423212 secs 2023-05-08T07:26:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13328.423212 secs 2023-05-08T07:26:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13328.423212 secs 2023-05-08T07:26:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13329.705662 secs 2023-05-08T07:26:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:31 smithi186 ceph-mon[126480]: pgmap v7165: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 187 KiB/s wr, 14 op/s 2023-05-08T07:26:31.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:31 smithi186 ceph-mon[126480]: osdmap e524: 12 total, 12 up, 12 in 2023-05-08T07:26:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13329.705662 secs 2023-05-08T07:26:31.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:31 smithi133 ceph-mon[125939]: pgmap v7165: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 187 KiB/s wr, 14 op/s 2023-05-08T07:26:31.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:31 smithi133 ceph-mon[125939]: osdmap e524: 12 total, 12 up, 12 in 2023-05-08T07:26:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13329.705662 secs 2023-05-08T07:26:31.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:31 smithi096 ceph-mon[124666]: pgmap v7165: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 187 KiB/s wr, 14 op/s 2023-05-08T07:26:31.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:31 smithi096 ceph-mon[124666]: osdmap e524: 12 total, 12 up, 12 in 2023-05-08T07:26:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:33 smithi186 ceph-mon[126480]: pgmap v7167: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 224 KiB/s wr, 13 op/s 2023-05-08T07:26:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:33 smithi133 ceph-mon[125939]: pgmap v7167: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 224 KiB/s wr, 13 op/s 2023-05-08T07:26:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:33 smithi096 ceph-mon[124666]: pgmap v7167: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 224 KiB/s wr, 13 op/s 2023-05-08T07:26:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13332.865319 secs 2023-05-08T07:26:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13332.865319 secs 2023-05-08T07:26:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13332.865319 secs 2023-05-08T07:26:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13333.423311 secs 2023-05-08T07:26:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:35 smithi186 ceph-mon[126480]: pgmap v7168: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 224 KiB/s wr, 13 op/s 2023-05-08T07:26:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13333.423311 secs 2023-05-08T07:26:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:35 smithi133 ceph-mon[125939]: pgmap v7168: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 224 KiB/s wr, 13 op/s 2023-05-08T07:26:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13333.423311 secs 2023-05-08T07:26:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:35 smithi096 ceph-mon[124666]: pgmap v7168: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 224 KiB/s wr, 13 op/s 2023-05-08T07:26:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13334.705811 secs 2023-05-08T07:26:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13334.705811 secs 2023-05-08T07:26:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13334.705811 secs 2023-05-08T07:26:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:37 smithi186 ceph-mon[126480]: pgmap v7169: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 139 KiB/s wr, 10 op/s 2023-05-08T07:26:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:37 smithi133 ceph-mon[125939]: pgmap v7169: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 139 KiB/s wr, 10 op/s 2023-05-08T07:26:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:37 smithi096 ceph-mon[124666]: pgmap v7169: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 139 KiB/s wr, 10 op/s 2023-05-08T07:26:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:39 smithi133 ceph-mon[125939]: pgmap v7170: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 139 KiB/s wr, 10 op/s 2023-05-08T07:26:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13337.865438 secs 2023-05-08T07:26:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:39 smithi096 ceph-mon[124666]: pgmap v7170: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 139 KiB/s wr, 10 op/s 2023-05-08T07:26:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13337.865438 secs 2023-05-08T07:26:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:39 smithi186 ceph-mon[126480]: pgmap v7170: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 139 KiB/s wr, 10 op/s 2023-05-08T07:26:39.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13337.865438 secs 2023-05-08T07:26:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13338.423426 secs 2023-05-08T07:26:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13338.423426 secs 2023-05-08T07:26:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13338.423426 secs 2023-05-08T07:26:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:41 smithi133 ceph-mon[125939]: pgmap v7171: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 188 KiB/s wr, 8 op/s 2023-05-08T07:26:41.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:41 smithi133 ceph-mon[125939]: osdmap e525: 12 total, 12 up, 12 in 2023-05-08T07:26:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:41 smithi096 ceph-mon[124666]: pgmap v7171: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 188 KiB/s wr, 8 op/s 2023-05-08T07:26:41.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:41 smithi096 ceph-mon[124666]: osdmap e525: 12 total, 12 up, 12 in 2023-05-08T07:26:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:41 smithi186 ceph-mon[126480]: pgmap v7171: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 188 KiB/s wr, 8 op/s 2023-05-08T07:26:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:41 smithi186 ceph-mon[126480]: osdmap e525: 12 total, 12 up, 12 in 2023-05-08T07:26:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:43 smithi133 ceph-mon[125939]: pgmap v7173: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 188 KiB/s wr, 8 op/s 2023-05-08T07:26:43.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:26:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:43 smithi096 ceph-mon[124666]: pgmap v7173: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 188 KiB/s wr, 8 op/s 2023-05-08T07:26:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:26:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:43 smithi186 ceph-mon[126480]: pgmap v7173: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 188 KiB/s wr, 8 op/s 2023-05-08T07:26:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:26:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13342.865556 secs 2023-05-08T07:26:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:26:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:26:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:26:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13342.865556 secs 2023-05-08T07:26:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:26:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:26:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:26:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13342.865556 secs 2023-05-08T07:26:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:26:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:26:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:26:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:45 smithi133 ceph-mon[125939]: pgmap v7174: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 188 KiB/s wr, 8 op/s 2023-05-08T07:26:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:45 smithi096 ceph-mon[124666]: pgmap v7174: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 188 KiB/s wr, 8 op/s 2023-05-08T07:26:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:45 smithi186 ceph-mon[126480]: pgmap v7174: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 188 KiB/s wr, 8 op/s 2023-05-08T07:26:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:47 smithi133 ceph-mon[125939]: pgmap v7175: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 168 KiB/s wr, 9 op/s 2023-05-08T07:26:47.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:26:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:47 smithi096 ceph-mon[124666]: pgmap v7175: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 168 KiB/s wr, 9 op/s 2023-05-08T07:26:47.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:26:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:47 smithi186 ceph-mon[126480]: pgmap v7175: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 168 KiB/s wr, 9 op/s 2023-05-08T07:26:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:26:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:26:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:26:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:26:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:26:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:26:48.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:26:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:49 smithi133 ceph-mon[125939]: pgmap v7176: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 168 KiB/s wr, 9 op/s 2023-05-08T07:26:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13347.865671 secs 2023-05-08T07:26:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:49 smithi096 ceph-mon[124666]: pgmap v7176: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 168 KiB/s wr, 9 op/s 2023-05-08T07:26:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13347.865671 secs 2023-05-08T07:26:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:49 smithi186 ceph-mon[126480]: pgmap v7176: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 168 KiB/s wr, 9 op/s 2023-05-08T07:26:49.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13347.865671 secs 2023-05-08T07:26:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:51 smithi133 ceph-mon[125939]: pgmap v7177: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 182 KiB/s wr, 11 op/s 2023-05-08T07:26:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:51 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:26:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:51 smithi096 ceph-mon[124666]: pgmap v7177: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 182 KiB/s wr, 11 op/s 2023-05-08T07:26:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:51 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:26:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:51 smithi186 ceph-mon[126480]: pgmap v7177: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 182 KiB/s wr, 11 op/s 2023-05-08T07:26:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:51 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:26:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:53 smithi133 ceph-mon[125939]: pgmap v7178: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 167 KiB/s wr, 10 op/s 2023-05-08T07:26:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:53 smithi096 ceph-mon[124666]: pgmap v7178: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 167 KiB/s wr, 10 op/s 2023-05-08T07:26:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:53 smithi186 ceph-mon[126480]: pgmap v7178: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 167 KiB/s wr, 10 op/s 2023-05-08T07:26:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13352.865768 secs 2023-05-08T07:26:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13352.865768 secs 2023-05-08T07:26:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13352.865768 secs 2023-05-08T07:26:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13353.423788 secs 2023-05-08T07:26:55.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:55 smithi133 ceph-mon[125939]: pgmap v7179: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 152 KiB/s wr, 9 op/s 2023-05-08T07:26:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13353.423788 secs 2023-05-08T07:26:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:55 smithi096 ceph-mon[124666]: pgmap v7179: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 152 KiB/s wr, 9 op/s 2023-05-08T07:26:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13353.423788 secs 2023-05-08T07:26:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:55 smithi186 ceph-mon[126480]: pgmap v7179: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 152 KiB/s wr, 9 op/s 2023-05-08T07:26:56.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13354.706260 secs 2023-05-08T07:26:56.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:26:56.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:26:56.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:56 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:26:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13354.706260 secs 2023-05-08T07:26:56.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:26:56.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:26:56.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:56 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:26:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13354.706260 secs 2023-05-08T07:26:56.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:26:56.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:26:56.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:56 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:26:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:57 smithi133 ceph-mon[125939]: pgmap v7180: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 236 KiB/s wr, 13 op/s 2023-05-08T07:26:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:57 smithi096 ceph-mon[124666]: pgmap v7180: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 236 KiB/s wr, 13 op/s 2023-05-08T07:26:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:57 smithi186 ceph-mon[126480]: pgmap v7180: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 236 KiB/s wr, 13 op/s 2023-05-08T07:26:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:59 smithi133 ceph-mon[125939]: pgmap v7181: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 221 KiB/s wr, 9 op/s 2023-05-08T07:26:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:26:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13357.865892 secs 2023-05-08T07:26:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:59 smithi096 ceph-mon[124666]: pgmap v7181: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 221 KiB/s wr, 9 op/s 2023-05-08T07:26:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:26:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13357.865892 secs 2023-05-08T07:26:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:59 smithi186 ceph-mon[126480]: pgmap v7181: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 221 KiB/s wr, 9 op/s 2023-05-08T07:26:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:26:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13357.865892 secs 2023-05-08T07:27:00.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:27:00.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:27:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:27:00.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:27:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:27:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:27:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13359.706410 secs 2023-05-08T07:27:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:01 smithi133 ceph-mon[125939]: pgmap v7182: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 393 KiB/s wr, 14 op/s 2023-05-08T07:27:01.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:01 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:27:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13359.706410 secs 2023-05-08T07:27:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:01 smithi096 ceph-mon[124666]: pgmap v7182: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 393 KiB/s wr, 14 op/s 2023-05-08T07:27:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:01 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:27:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13359.706410 secs 2023-05-08T07:27:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:01 smithi186 ceph-mon[126480]: pgmap v7182: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 393 KiB/s wr, 14 op/s 2023-05-08T07:27:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:01 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:27:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:03 smithi133 ceph-mon[125939]: pgmap v7183: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 256 KiB/s wr, 9 op/s 2023-05-08T07:27:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:03 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:27:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:03 smithi096 ceph-mon[124666]: pgmap v7183: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 256 KiB/s wr, 9 op/s 2023-05-08T07:27:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:03 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:27:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:03 smithi186 ceph-mon[126480]: pgmap v7183: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 256 KiB/s wr, 9 op/s 2023-05-08T07:27:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:03 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:27:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13362.866030 secs 2023-05-08T07:27:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:04 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:27:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:04 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:27:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13362.866030 secs 2023-05-08T07:27:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:04 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:27:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:04 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:27:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13362.866030 secs 2023-05-08T07:27:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:04 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:27:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:04 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:27:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13363.424035 secs 2023-05-08T07:27:05.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:05 smithi133 ceph-mon[125939]: pgmap v7184: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 256 KiB/s wr, 9 op/s 2023-05-08T07:27:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13363.424035 secs 2023-05-08T07:27:05.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:05 smithi096 ceph-mon[124666]: pgmap v7184: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 256 KiB/s wr, 9 op/s 2023-05-08T07:27:05.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13363.424035 secs 2023-05-08T07:27:05.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:05 smithi186 ceph-mon[126480]: pgmap v7184: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 256 KiB/s wr, 9 op/s 2023-05-08T07:27:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13364.706475 secs 2023-05-08T07:27:06.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:06 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:27:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13364.706475 secs 2023-05-08T07:27:06.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:06 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:27:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13364.706475 secs 2023-05-08T07:27:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:06 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:27:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:07 smithi133 ceph-mon[125939]: pgmap v7185: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 302 KiB/s wr, 27 op/s 2023-05-08T07:27:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:07 smithi096 ceph-mon[124666]: pgmap v7185: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 302 KiB/s wr, 27 op/s 2023-05-08T07:27:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:07 smithi186 ceph-mon[126480]: pgmap v7185: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 302 KiB/s wr, 27 op/s 2023-05-08T07:27:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:27:08.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:27:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:27:08.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:27:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:27:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:27:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:09 smithi096 ceph-mon[124666]: pgmap v7186: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 218 KiB/s wr, 23 op/s 2023-05-08T07:27:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13367.866145 secs 2023-05-08T07:27:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13368.424174 secs 2023-05-08T07:27:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:09 smithi186 ceph-mon[126480]: pgmap v7186: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 218 KiB/s wr, 23 op/s 2023-05-08T07:27:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13367.866145 secs 2023-05-08T07:27:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13368.424174 secs 2023-05-08T07:27:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:09 smithi133 ceph-mon[125939]: pgmap v7186: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 218 KiB/s wr, 23 op/s 2023-05-08T07:27:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13367.866145 secs 2023-05-08T07:27:09.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13368.424174 secs 2023-05-08T07:27:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13369.706610 secs 2023-05-08T07:27:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:11 smithi186 ceph-mon[126480]: pgmap v7187: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 297 KiB/s wr, 27 op/s 2023-05-08T07:27:11.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:11 smithi186 ceph-mon[126480]: osdmap e526: 12 total, 12 up, 12 in 2023-05-08T07:27:11.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:11 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:27:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13369.706610 secs 2023-05-08T07:27:11.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:11 smithi133 ceph-mon[125939]: pgmap v7187: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 297 KiB/s wr, 27 op/s 2023-05-08T07:27:11.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:11 smithi133 ceph-mon[125939]: osdmap e526: 12 total, 12 up, 12 in 2023-05-08T07:27:11.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:11 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:27:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13369.706610 secs 2023-05-08T07:27:12.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:11 smithi096 ceph-mon[124666]: pgmap v7187: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 297 KiB/s wr, 27 op/s 2023-05-08T07:27:12.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:11 smithi096 ceph-mon[124666]: osdmap e526: 12 total, 12 up, 12 in 2023-05-08T07:27:12.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:11 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:27:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:13 smithi186 ceph-mon[126480]: pgmap v7189: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 150 KiB/s wr, 26 op/s 2023-05-08T07:27:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:13 smithi133 ceph-mon[125939]: pgmap v7189: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 150 KiB/s wr, 26 op/s 2023-05-08T07:27:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:13 smithi096 ceph-mon[124666]: pgmap v7189: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 150 KiB/s wr, 26 op/s 2023-05-08T07:27:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13372.866259 secs 2023-05-08T07:27:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13373.424293 secs 2023-05-08T07:27:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13372.866259 secs 2023-05-08T07:27:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13373.424293 secs 2023-05-08T07:27:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13372.866259 secs 2023-05-08T07:27:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13373.424293 secs 2023-05-08T07:27:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:15 smithi186 ceph-mon[126480]: pgmap v7190: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 150 KiB/s wr, 26 op/s 2023-05-08T07:27:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:15 smithi133 ceph-mon[125939]: pgmap v7190: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 150 KiB/s wr, 26 op/s 2023-05-08T07:27:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:15 smithi096 ceph-mon[124666]: pgmap v7190: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 150 KiB/s wr, 26 op/s 2023-05-08T07:27:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13374.706714 secs 2023-05-08T07:27:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13374.706714 secs 2023-05-08T07:27:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13374.706714 secs 2023-05-08T07:27:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:17 smithi186 ceph-mon[126480]: pgmap v7191: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 102 KiB/s wr, 9 op/s 2023-05-08T07:27:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:17 smithi133 ceph-mon[125939]: pgmap v7191: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 102 KiB/s wr, 9 op/s 2023-05-08T07:27:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:17 smithi096 ceph-mon[124666]: pgmap v7191: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 102 KiB/s wr, 9 op/s 2023-05-08T07:27:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:19 smithi186 ceph-mon[126480]: pgmap v7192: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 102 KiB/s wr, 9 op/s 2023-05-08T07:27:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13377.866374 secs 2023-05-08T07:27:19.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13378.424428 secs 2023-05-08T07:27:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:19 smithi133 ceph-mon[125939]: pgmap v7192: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 102 KiB/s wr, 9 op/s 2023-05-08T07:27:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13377.866374 secs 2023-05-08T07:27:19.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13378.424428 secs 2023-05-08T07:27:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:19 smithi096 ceph-mon[124666]: pgmap v7192: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 102 KiB/s wr, 9 op/s 2023-05-08T07:27:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13377.866374 secs 2023-05-08T07:27:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13378.424428 secs 2023-05-08T07:27:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13379.706837 secs 2023-05-08T07:27:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:21 smithi186 ceph-mon[126480]: pgmap v7193: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 8 op/s 2023-05-08T07:27:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:27:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:21 smithi186 ceph-mon[126480]: osdmap e527: 12 total, 12 up, 12 in 2023-05-08T07:27:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13379.706837 secs 2023-05-08T07:27:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:21 smithi133 ceph-mon[125939]: pgmap v7193: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 8 op/s 2023-05-08T07:27:21.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:27:21.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:21 smithi133 ceph-mon[125939]: osdmap e527: 12 total, 12 up, 12 in 2023-05-08T07:27:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13379.706837 secs 2023-05-08T07:27:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:21 smithi096 ceph-mon[124666]: pgmap v7193: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 8 op/s 2023-05-08T07:27:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:27:22.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:21 smithi096 ceph-mon[124666]: osdmap e527: 12 total, 12 up, 12 in 2023-05-08T07:27:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:23 smithi186 ceph-mon[126480]: pgmap v7195: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 8 op/s 2023-05-08T07:27:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:27:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:27:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:23 smithi133 ceph-mon[125939]: pgmap v7195: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 8 op/s 2023-05-08T07:27:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:27:23.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:27:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:23 smithi096 ceph-mon[124666]: pgmap v7195: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 8 op/s 2023-05-08T07:27:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:27:24.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:27:24.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13382.866441 secs 2023-05-08T07:27:24.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:27:24.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:27:24.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:27:24.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:27:24.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13383.424525 secs 2023-05-08T07:27:24.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:27:24.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:27:24.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:27:24.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:27:24.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:27:24.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:27:24.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:27:24.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:27:24.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:27:24.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:27:24.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:27:24.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:27:24.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:27:24.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:27:24.994 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:27:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13382.866441 secs 2023-05-08T07:27:25.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:27:25.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:27:25.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:27:25.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:27:25.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13383.424525 secs 2023-05-08T07:27:25.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:27:25.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:27:25.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:27:25.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:27:25.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:27:25.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:27:25.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:27:25.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:27:25.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:27:25.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:27:25.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:27:25.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:27:25.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:27:25.009 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:27:25.009 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:27:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13382.866441 secs 2023-05-08T07:27:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:27:25.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:27:25.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:27:25.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:27:25.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13383.424525 secs 2023-05-08T07:27:25.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:27:25.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:27:25.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:27:25.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:27:25.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:27:25.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:27:25.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:27:25.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:27:25.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:27:25.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:27:25.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:27:25.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:27:25.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:27:25.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:27:25.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:27:25.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:25 smithi133 ceph-mon[125939]: pgmap v7196: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 34 KiB/s wr, 9 op/s 2023-05-08T07:27:25.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:25 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi096 to 148.1M 2023-05-08T07:27:25.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:25 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi096 to 155300892: error parsing value: Value '155300892' is below minimum 939524096 2023-05-08T07:27:25.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:25 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T07:27:25.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:25 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T07:27:25.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:25 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T07:27:25.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:25 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T07:27:25.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:25 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:27:25.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:25 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T07:27:25.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:25 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T07:27:25.994 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:25 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:27:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:25 smithi096 ceph-mon[124666]: pgmap v7196: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 34 KiB/s wr, 9 op/s 2023-05-08T07:27:26.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:25 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi096 to 148.1M 2023-05-08T07:27:26.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:25 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi096 to 155300892: error parsing value: Value '155300892' is below minimum 939524096 2023-05-08T07:27:26.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:25 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T07:27:26.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:25 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T07:27:26.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:25 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T07:27:26.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:25 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T07:27:26.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:25 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:27:26.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:25 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T07:27:26.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:25 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T07:27:26.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:25 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:27:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:25 smithi186 ceph-mon[126480]: pgmap v7196: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 34 KiB/s wr, 9 op/s 2023-05-08T07:27:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:25 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi096 to 148.1M 2023-05-08T07:27:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:25 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi096 to 155300892: error parsing value: Value '155300892' is below minimum 939524096 2023-05-08T07:27:26.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:25 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T07:27:26.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:25 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T07:27:26.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:25 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T07:27:26.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:25 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T07:27:26.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:25 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:27:26.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:25 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T07:27:26.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:25 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T07:27:26.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:25 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:27:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13384.706989 secs 2023-05-08T07:27:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13384.706989 secs 2023-05-08T07:27:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13384.706989 secs 2023-05-08T07:27:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:27 smithi133 ceph-mon[125939]: pgmap v7197: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 71 KiB/s wr, 7 op/s 2023-05-08T07:27:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:27 smithi096 ceph-mon[124666]: pgmap v7197: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 71 KiB/s wr, 7 op/s 2023-05-08T07:27:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:27 smithi186 ceph-mon[126480]: pgmap v7197: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 71 KiB/s wr, 7 op/s 2023-05-08T07:27:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:29 smithi133 ceph-mon[125939]: pgmap v7198: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 71 KiB/s wr, 7 op/s 2023-05-08T07:27:29.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13387.866515 secs 2023-05-08T07:27:29.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13388.424646 secs 2023-05-08T07:27:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:29 smithi096 ceph-mon[124666]: pgmap v7198: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 71 KiB/s wr, 7 op/s 2023-05-08T07:27:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13387.866515 secs 2023-05-08T07:27:30.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13388.424646 secs 2023-05-08T07:27:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:29 smithi186 ceph-mon[126480]: pgmap v7198: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 71 KiB/s wr, 7 op/s 2023-05-08T07:27:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13387.866515 secs 2023-05-08T07:27:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13388.424646 secs 2023-05-08T07:27:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13389.707102 secs 2023-05-08T07:27:31.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:31 smithi133 ceph-mon[125939]: pgmap v7199: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 45 KiB/s wr, 7 op/s 2023-05-08T07:27:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13389.707102 secs 2023-05-08T07:27:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:31 smithi096 ceph-mon[124666]: pgmap v7199: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 45 KiB/s wr, 7 op/s 2023-05-08T07:27:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13389.707102 secs 2023-05-08T07:27:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:31 smithi186 ceph-mon[126480]: pgmap v7199: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 45 KiB/s wr, 7 op/s 2023-05-08T07:27:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:33 smithi133 ceph-mon[125939]: pgmap v7200: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 42 KiB/s wr, 7 op/s 2023-05-08T07:27:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:33 smithi096 ceph-mon[124666]: pgmap v7200: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 42 KiB/s wr, 7 op/s 2023-05-08T07:27:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:33 smithi186 ceph-mon[126480]: pgmap v7200: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 42 KiB/s wr, 7 op/s 2023-05-08T07:27:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13392.866655 secs 2023-05-08T07:27:34.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13393.424770 secs 2023-05-08T07:27:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13392.866655 secs 2023-05-08T07:27:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13393.424770 secs 2023-05-08T07:27:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13392.866655 secs 2023-05-08T07:27:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13393.424770 secs 2023-05-08T07:27:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:35 smithi133 ceph-mon[125939]: pgmap v7201: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 KiB/s wr, 7 op/s 2023-05-08T07:27:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:35 smithi096 ceph-mon[124666]: pgmap v7201: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 KiB/s wr, 7 op/s 2023-05-08T07:27:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:35 smithi186 ceph-mon[126480]: pgmap v7201: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 KiB/s wr, 7 op/s 2023-05-08T07:27:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13394.707223 secs 2023-05-08T07:27:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13394.707223 secs 2023-05-08T07:27:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13394.707223 secs 2023-05-08T07:27:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:37 smithi133 ceph-mon[125939]: pgmap v7202: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 75 KiB/s wr, 8 op/s 2023-05-08T07:27:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:37 smithi096 ceph-mon[124666]: pgmap v7202: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 75 KiB/s wr, 8 op/s 2023-05-08T07:27:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:37 smithi186 ceph-mon[126480]: pgmap v7202: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 75 KiB/s wr, 8 op/s 2023-05-08T07:27:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:39 smithi133 ceph-mon[125939]: pgmap v7203: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 KiB/s wr, 6 op/s 2023-05-08T07:27:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13397.866734 secs 2023-05-08T07:27:39.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13398.424883 secs 2023-05-08T07:27:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:39 smithi096 ceph-mon[124666]: pgmap v7203: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 KiB/s wr, 6 op/s 2023-05-08T07:27:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13397.866734 secs 2023-05-08T07:27:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13398.424883 secs 2023-05-08T07:27:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:39 smithi186 ceph-mon[126480]: pgmap v7203: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 KiB/s wr, 6 op/s 2023-05-08T07:27:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13397.866734 secs 2023-05-08T07:27:40.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13398.424883 secs 2023-05-08T07:27:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:41 smithi133 ceph-mon[125939]: pgmap v7204: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 38 KiB/s wr, 9 op/s 2023-05-08T07:27:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:41 smithi096 ceph-mon[124666]: pgmap v7204: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 38 KiB/s wr, 9 op/s 2023-05-08T07:27:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:41 smithi186 ceph-mon[126480]: pgmap v7204: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 38 KiB/s wr, 9 op/s 2023-05-08T07:27:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:27:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:27:43.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:27:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:43 smithi133 ceph-mon[125939]: pgmap v7205: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 KiB/s wr, 6 op/s 2023-05-08T07:27:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:43 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:27:43.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:27:43.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:27:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:43 smithi096 ceph-mon[124666]: pgmap v7205: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 KiB/s wr, 6 op/s 2023-05-08T07:27:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:43 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:27:44.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:27:44.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:27:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:43 smithi186 ceph-mon[126480]: pgmap v7205: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 KiB/s wr, 6 op/s 2023-05-08T07:27:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:43 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:27:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:27:44.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:27:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13402.866838 secs 2023-05-08T07:27:44.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13403.425008 secs 2023-05-08T07:27:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13402.866838 secs 2023-05-08T07:27:45.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13403.425008 secs 2023-05-08T07:27:45.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13402.866838 secs 2023-05-08T07:27:45.269 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13403.425008 secs 2023-05-08T07:27:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:45 smithi133 ceph-mon[125939]: pgmap v7206: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 KiB/s wr, 7 op/s 2023-05-08T07:27:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:45 smithi096 ceph-mon[124666]: pgmap v7206: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 KiB/s wr, 7 op/s 2023-05-08T07:27:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:45 smithi186 ceph-mon[126480]: pgmap v7206: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 KiB/s wr, 7 op/s 2023-05-08T07:27:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:47 smithi133 ceph-mon[125939]: pgmap v7207: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 86 KiB/s wr, 8 op/s 2023-05-08T07:27:48.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:47 smithi096 ceph-mon[124666]: pgmap v7207: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 86 KiB/s wr, 8 op/s 2023-05-08T07:27:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:47 smithi186 ceph-mon[126480]: pgmap v7207: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 86 KiB/s wr, 8 op/s 2023-05-08T07:27:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:49 smithi133 ceph-mon[125939]: pgmap v7208: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 48 KiB/s wr, 6 op/s 2023-05-08T07:27:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13407.866988 secs 2023-05-08T07:27:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:49 smithi096 ceph-mon[124666]: pgmap v7208: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 48 KiB/s wr, 6 op/s 2023-05-08T07:27:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13407.866988 secs 2023-05-08T07:27:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:49 smithi186 ceph-mon[126480]: pgmap v7208: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 48 KiB/s wr, 6 op/s 2023-05-08T07:27:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13407.866988 secs 2023-05-08T07:27:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:50 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:27:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:50 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:27:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:50 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:27:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:51 smithi133 ceph-mon[125939]: pgmap v7209: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 162 KiB/s wr, 10 op/s 2023-05-08T07:27:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:51 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:27:51.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:27:51.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:27:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:51 smithi096 ceph-mon[124666]: pgmap v7209: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 162 KiB/s wr, 10 op/s 2023-05-08T07:27:52.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:51 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:27:52.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:27:52.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:27:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:51 smithi186 ceph-mon[126480]: pgmap v7209: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 162 KiB/s wr, 10 op/s 2023-05-08T07:27:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:51 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:27:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:27:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:27:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:53 smithi133 ceph-mon[125939]: pgmap v7210: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 161 KiB/s wr, 7 op/s 2023-05-08T07:27:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:53 smithi096 ceph-mon[124666]: pgmap v7210: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 161 KiB/s wr, 7 op/s 2023-05-08T07:27:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:53 smithi186 ceph-mon[126480]: pgmap v7210: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 161 KiB/s wr, 7 op/s 2023-05-08T07:27:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13412.867107 secs 2023-05-08T07:27:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13412.867107 secs 2023-05-08T07:27:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13412.867107 secs 2023-05-08T07:27:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:55 smithi133 ceph-mon[125939]: pgmap v7211: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 269 KiB/s wr, 11 op/s 2023-05-08T07:27:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:55 smithi096 ceph-mon[124666]: pgmap v7211: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 269 KiB/s wr, 11 op/s 2023-05-08T07:27:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:55 smithi186 ceph-mon[126480]: pgmap v7211: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 269 KiB/s wr, 11 op/s 2023-05-08T07:27:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:57 smithi133 ceph-mon[125939]: pgmap v7212: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 269 KiB/s wr, 11 op/s 2023-05-08T07:27:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:57 smithi096 ceph-mon[124666]: pgmap v7212: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 269 KiB/s wr, 11 op/s 2023-05-08T07:27:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:57 smithi186 ceph-mon[126480]: pgmap v7212: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 269 KiB/s wr, 11 op/s 2023-05-08T07:27:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:59 smithi133 ceph-mon[125939]: pgmap v7213: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 221 KiB/s wr, 9 op/s 2023-05-08T07:27:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13417.867221 secs 2023-05-08T07:27:59.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:27:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13418.425385 secs 2023-05-08T07:28:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:59 smithi096 ceph-mon[124666]: pgmap v7213: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 221 KiB/s wr, 9 op/s 2023-05-08T07:28:00.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13417.867221 secs 2023-05-08T07:28:00.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:27:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13418.425385 secs 2023-05-08T07:28:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:59 smithi186 ceph-mon[126480]: pgmap v7213: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 221 KiB/s wr, 9 op/s 2023-05-08T07:28:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13417.867221 secs 2023-05-08T07:28:00.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:27:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13418.425385 secs 2023-05-08T07:28:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:01 smithi133 ceph-mon[125939]: pgmap v7214: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 294 KiB/s rd, 271 KiB/s wr, 13 op/s 2023-05-08T07:28:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:01 smithi096 ceph-mon[124666]: pgmap v7214: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 294 KiB/s rd, 271 KiB/s wr, 13 op/s 2023-05-08T07:28:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:01 smithi186 ceph-mon[126480]: pgmap v7214: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 294 KiB/s rd, 271 KiB/s wr, 13 op/s 2023-05-08T07:28:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:02 smithi186 ceph-mon[126480]: pgmap v7215: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 158 KiB/s wr, 9 op/s 2023-05-08T07:28:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:02 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:28:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:28:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:28:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:02 smithi133 ceph-mon[125939]: pgmap v7215: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 158 KiB/s wr, 9 op/s 2023-05-08T07:28:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:02 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:28:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:28:03.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:28:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:02 smithi096 ceph-mon[124666]: pgmap v7215: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 158 KiB/s wr, 9 op/s 2023-05-08T07:28:03.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:02 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:28:03.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:28:03.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:28:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13422.867379 secs 2023-05-08T07:28:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13422.867379 secs 2023-05-08T07:28:04.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13422.867379 secs 2023-05-08T07:28:05.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13423.425507 secs 2023-05-08T07:28:05.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:05 smithi186 ceph-mon[126480]: pgmap v7216: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 276 KiB/s wr, 24 op/s 2023-05-08T07:28:05.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13423.425507 secs 2023-05-08T07:28:05.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:05 smithi133 ceph-mon[125939]: pgmap v7216: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 276 KiB/s wr, 24 op/s 2023-05-08T07:28:05.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13423.425507 secs 2023-05-08T07:28:05.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:05 smithi096 ceph-mon[124666]: pgmap v7216: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 276 KiB/s wr, 24 op/s 2023-05-08T07:28:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:07 smithi133 ceph-mon[125939]: pgmap v7217: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 292 KiB/s wr, 22 op/s 2023-05-08T07:28:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:07 smithi096 ceph-mon[124666]: pgmap v7217: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 292 KiB/s wr, 22 op/s 2023-05-08T07:28:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:07 smithi186 ceph-mon[126480]: pgmap v7217: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 292 KiB/s wr, 22 op/s 2023-05-08T07:28:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:09 smithi133 ceph-mon[125939]: pgmap v7218: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 291 KiB/s wr, 20 op/s 2023-05-08T07:28:09.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13427.867474 secs 2023-05-08T07:28:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:09 smithi096 ceph-mon[124666]: pgmap v7218: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 291 KiB/s wr, 20 op/s 2023-05-08T07:28:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13427.867474 secs 2023-05-08T07:28:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:09 smithi186 ceph-mon[126480]: pgmap v7218: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 291 KiB/s wr, 20 op/s 2023-05-08T07:28:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13427.867474 secs 2023-05-08T07:28:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:11 smithi133 ceph-mon[125939]: pgmap v7219: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 371 KiB/s wr, 24 op/s 2023-05-08T07:28:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:11 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:28:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:11 smithi096 ceph-mon[124666]: pgmap v7219: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 371 KiB/s wr, 24 op/s 2023-05-08T07:28:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:11 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:28:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:11 smithi186 ceph-mon[126480]: pgmap v7219: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 371 KiB/s wr, 24 op/s 2023-05-08T07:28:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:11 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:28:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:12 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:28:12.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:12 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:28:12.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:12 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:28:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:12 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:28:12.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:12 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:28:12.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:12 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:28:12.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:12 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:28:12.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:12 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:28:12.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:12 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:28:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:13 smithi133 ceph-mon[125939]: pgmap v7220: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 322 KiB/s wr, 20 op/s 2023-05-08T07:28:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:13 smithi096 ceph-mon[124666]: pgmap v7220: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 322 KiB/s wr, 20 op/s 2023-05-08T07:28:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:13 smithi186 ceph-mon[126480]: pgmap v7220: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 322 KiB/s wr, 20 op/s 2023-05-08T07:28:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13432.867595 secs 2023-05-08T07:28:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13432.867595 secs 2023-05-08T07:28:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13432.867595 secs 2023-05-08T07:28:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:15 smithi133 ceph-mon[125939]: pgmap v7221: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 322 KiB/s wr, 22 op/s 2023-05-08T07:28:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:15 smithi096 ceph-mon[124666]: pgmap v7221: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 322 KiB/s wr, 22 op/s 2023-05-08T07:28:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:15 smithi186 ceph-mon[126480]: pgmap v7221: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 322 KiB/s wr, 22 op/s 2023-05-08T07:28:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:17 smithi133 ceph-mon[125939]: pgmap v7222: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 229 KiB/s wr, 9 op/s 2023-05-08T07:28:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:17 smithi096 ceph-mon[124666]: pgmap v7222: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 229 KiB/s wr, 9 op/s 2023-05-08T07:28:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:17 smithi186 ceph-mon[126480]: pgmap v7222: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 229 KiB/s wr, 9 op/s 2023-05-08T07:28:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:19 smithi133 ceph-mon[125939]: pgmap v7223: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 106 KiB/s wr, 7 op/s 2023-05-08T07:28:19.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13437.867710 secs 2023-05-08T07:28:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:19 smithi096 ceph-mon[124666]: pgmap v7223: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 106 KiB/s wr, 7 op/s 2023-05-08T07:28:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13437.867710 secs 2023-05-08T07:28:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:19 smithi186 ceph-mon[126480]: pgmap v7223: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 106 KiB/s wr, 7 op/s 2023-05-08T07:28:19.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13437.867710 secs 2023-05-08T07:28:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:21 smithi133 ceph-mon[125939]: pgmap v7224: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 106 KiB/s wr, 10 op/s 2023-05-08T07:28:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:21 smithi096 ceph-mon[124666]: pgmap v7224: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 106 KiB/s wr, 10 op/s 2023-05-08T07:28:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:21 smithi186 ceph-mon[126480]: pgmap v7224: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 106 KiB/s wr, 10 op/s 2023-05-08T07:28:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:23 smithi133 ceph-mon[125939]: pgmap v7225: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 5 op/s 2023-05-08T07:28:23.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:23 smithi096 ceph-mon[124666]: pgmap v7225: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 5 op/s 2023-05-08T07:28:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:23 smithi186 ceph-mon[126480]: pgmap v7225: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 5 op/s 2023-05-08T07:28:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13442.867830 secs 2023-05-08T07:28:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13442.867830 secs 2023-05-08T07:28:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13442.867830 secs 2023-05-08T07:28:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13443.425973 secs 2023-05-08T07:28:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:25 smithi133 ceph-mon[125939]: pgmap v7226: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 54 KiB/s wr, 10 op/s 2023-05-08T07:28:25.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:25 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:28:25.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:25 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:28:25.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:25 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:28:25.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:25 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:28:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13443.425973 secs 2023-05-08T07:28:25.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:25 smithi096 ceph-mon[124666]: pgmap v7226: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 54 KiB/s wr, 10 op/s 2023-05-08T07:28:25.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:25 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:28:25.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:25 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:28:25.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:25 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:28:25.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:25 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:28:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13443.425973 secs 2023-05-08T07:28:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:25 smithi186 ceph-mon[126480]: pgmap v7226: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 54 KiB/s wr, 10 op/s 2023-05-08T07:28:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:25 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:28:25.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:25 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:28:25.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:25 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:28:25.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:25 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:28:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13444.708347 secs 2023-05-08T07:28:26.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:26 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:28:26.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:26 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T07:28:26.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:26 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T07:28:26.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:26 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:28:26.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:26 smithi133 ceph-mon[125939]: osdmap e528: 12 total, 12 up, 12 in 2023-05-08T07:28:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13444.708347 secs 2023-05-08T07:28:26.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:26 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:28:26.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:26 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T07:28:26.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:26 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T07:28:26.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:26 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:28:26.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:26 smithi096 ceph-mon[124666]: osdmap e528: 12 total, 12 up, 12 in 2023-05-08T07:28:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13444.708347 secs 2023-05-08T07:28:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:26 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:28:26.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:26 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T07:28:26.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:26 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T07:28:26.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:26 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:28:26.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:26 smithi186 ceph-mon[126480]: osdmap e528: 12 total, 12 up, 12 in 2023-05-08T07:28:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:27 smithi096 ceph-mon[124666]: pgmap v7228: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 166 KiB/s wr, 10 op/s 2023-05-08T07:28:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:27 smithi186 ceph-mon[126480]: pgmap v7228: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 166 KiB/s wr, 10 op/s 2023-05-08T07:28:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:27 smithi133 ceph-mon[125939]: pgmap v7228: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 166 KiB/s wr, 10 op/s 2023-05-08T07:28:28.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:28 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:28:28.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:28 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:28:28.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:28 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:28:28.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:28 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:28:28.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:28 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:28:28.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:28 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:28:28.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:28 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:28:28.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:28 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:28:28.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:28 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:28:28.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:28 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:28:28.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:28 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:28:28.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:28 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:28:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:29 smithi096 ceph-mon[124666]: pgmap v7229: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 166 KiB/s wr, 10 op/s 2023-05-08T07:28:29.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13447.867945 secs 2023-05-08T07:28:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:29 smithi186 ceph-mon[126480]: pgmap v7229: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 166 KiB/s wr, 10 op/s 2023-05-08T07:28:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13447.867945 secs 2023-05-08T07:28:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:29 smithi133 ceph-mon[125939]: pgmap v7229: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 166 KiB/s wr, 10 op/s 2023-05-08T07:28:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13447.867945 secs 2023-05-08T07:28:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13448.426045 secs 2023-05-08T07:28:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13448.426045 secs 2023-05-08T07:28:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13448.426045 secs 2023-05-08T07:28:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13449.708470 secs 2023-05-08T07:28:31.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:31 smithi186 ceph-mon[126480]: pgmap v7230: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 321 KiB/s wr, 13 op/s 2023-05-08T07:28:31.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:31 smithi186 ceph-mon[126480]: osdmap e529: 12 total, 12 up, 12 in 2023-05-08T07:28:31.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13449.708470 secs 2023-05-08T07:28:31.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:31 smithi133 ceph-mon[125939]: pgmap v7230: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 321 KiB/s wr, 13 op/s 2023-05-08T07:28:31.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:31 smithi133 ceph-mon[125939]: osdmap e529: 12 total, 12 up, 12 in 2023-05-08T07:28:31.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13449.708470 secs 2023-05-08T07:28:31.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:31 smithi096 ceph-mon[124666]: pgmap v7230: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 321 KiB/s wr, 13 op/s 2023-05-08T07:28:31.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:31 smithi096 ceph-mon[124666]: osdmap e529: 12 total, 12 up, 12 in 2023-05-08T07:28:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:33 smithi186 ceph-mon[126480]: pgmap v7232: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 359 KiB/s wr, 10 op/s 2023-05-08T07:28:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:33 smithi133 ceph-mon[125939]: pgmap v7232: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 359 KiB/s wr, 10 op/s 2023-05-08T07:28:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:33 smithi096 ceph-mon[124666]: pgmap v7232: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 359 KiB/s wr, 10 op/s 2023-05-08T07:28:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13452.868063 secs 2023-05-08T07:28:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13452.868063 secs 2023-05-08T07:28:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13452.868063 secs 2023-05-08T07:28:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13453.426162 secs 2023-05-08T07:28:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:35 smithi186 ceph-mon[126480]: pgmap v7233: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 212 KiB/s wr, 10 op/s 2023-05-08T07:28:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13453.426162 secs 2023-05-08T07:28:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:35 smithi133 ceph-mon[125939]: pgmap v7233: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 212 KiB/s wr, 10 op/s 2023-05-08T07:28:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13453.426162 secs 2023-05-08T07:28:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:35 smithi096 ceph-mon[124666]: pgmap v7233: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 212 KiB/s wr, 10 op/s 2023-05-08T07:28:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13454.708617 secs 2023-05-08T07:28:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13454.708617 secs 2023-05-08T07:28:36.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13454.708617 secs 2023-05-08T07:28:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:37 smithi186 ceph-mon[126480]: pgmap v7234: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 187 KiB/s wr, 10 op/s 2023-05-08T07:28:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:37 smithi133 ceph-mon[125939]: pgmap v7234: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 187 KiB/s wr, 10 op/s 2023-05-08T07:28:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:37 smithi096 ceph-mon[124666]: pgmap v7234: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 187 KiB/s wr, 10 op/s 2023-05-08T07:28:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:39 smithi186 ceph-mon[126480]: pgmap v7235: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 187 KiB/s wr, 10 op/s 2023-05-08T07:28:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13457.868181 secs 2023-05-08T07:28:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:39 smithi133 ceph-mon[125939]: pgmap v7235: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 187 KiB/s wr, 10 op/s 2023-05-08T07:28:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13457.868181 secs 2023-05-08T07:28:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:39 smithi096 ceph-mon[124666]: pgmap v7235: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 187 KiB/s wr, 10 op/s 2023-05-08T07:28:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13457.868181 secs 2023-05-08T07:28:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13458.426279 secs 2023-05-08T07:28:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13458.426279 secs 2023-05-08T07:28:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13458.426279 secs 2023-05-08T07:28:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:41 smithi186 ceph-mon[126480]: pgmap v7236: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 122 KiB/s wr, 7 op/s 2023-05-08T07:28:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:41 smithi133 ceph-mon[125939]: pgmap v7236: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 122 KiB/s wr, 7 op/s 2023-05-08T07:28:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:41 smithi096 ceph-mon[124666]: pgmap v7236: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 122 KiB/s wr, 7 op/s 2023-05-08T07:28:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:43 smithi186 ceph-mon[126480]: pgmap v7237: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 112 KiB/s wr, 7 op/s 2023-05-08T07:28:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:28:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:43 smithi133 ceph-mon[125939]: pgmap v7237: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 112 KiB/s wr, 7 op/s 2023-05-08T07:28:43.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:28:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:43 smithi096 ceph-mon[124666]: pgmap v7237: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 112 KiB/s wr, 7 op/s 2023-05-08T07:28:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:28:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13462.868321 secs 2023-05-08T07:28:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:28:44.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:28:44.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:28:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13462.868321 secs 2023-05-08T07:28:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:28:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:28:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:28:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13462.868321 secs 2023-05-08T07:28:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:28:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:28:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:28:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:45 smithi186 ceph-mon[126480]: pgmap v7238: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 117 KiB/s wr, 9 op/s 2023-05-08T07:28:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:45 smithi133 ceph-mon[125939]: pgmap v7238: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 117 KiB/s wr, 9 op/s 2023-05-08T07:28:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:45 smithi096 ceph-mon[124666]: pgmap v7238: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 117 KiB/s wr, 9 op/s 2023-05-08T07:28:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:47 smithi186 ceph-mon[126480]: pgmap v7239: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 90 KiB/s wr, 7 op/s 2023-05-08T07:28:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:28:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:47 smithi133 ceph-mon[125939]: pgmap v7239: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 90 KiB/s wr, 7 op/s 2023-05-08T07:28:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:28:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:47 smithi096 ceph-mon[124666]: pgmap v7239: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 90 KiB/s wr, 7 op/s 2023-05-08T07:28:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:28:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:28:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:28:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:28:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:28:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:28:48.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:28:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:49 smithi186 ceph-mon[126480]: pgmap v7240: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 90 KiB/s wr, 6 op/s 2023-05-08T07:28:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13467.868476 secs 2023-05-08T07:28:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:49 smithi133 ceph-mon[125939]: pgmap v7240: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 90 KiB/s wr, 6 op/s 2023-05-08T07:28:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13467.868476 secs 2023-05-08T07:28:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:49 smithi096 ceph-mon[124666]: pgmap v7240: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 90 KiB/s wr, 6 op/s 2023-05-08T07:28:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13467.868476 secs 2023-05-08T07:28:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:51 smithi186 ceph-mon[126480]: pgmap v7241: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 279 KiB/s wr, 11 op/s 2023-05-08T07:28:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:51 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:28:51.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:51 smithi133 ceph-mon[125939]: pgmap v7241: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 279 KiB/s wr, 11 op/s 2023-05-08T07:28:51.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:51 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:28:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:51 smithi096 ceph-mon[124666]: pgmap v7241: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 279 KiB/s wr, 11 op/s 2023-05-08T07:28:51.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:51 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:28:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:53 smithi186 ceph-mon[126480]: pgmap v7242: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 204 KiB/s wr, 9 op/s 2023-05-08T07:28:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:53 smithi133 ceph-mon[125939]: pgmap v7242: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 204 KiB/s wr, 9 op/s 2023-05-08T07:28:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:53 smithi096 ceph-mon[124666]: pgmap v7242: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 204 KiB/s wr, 9 op/s 2023-05-08T07:28:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13472.868562 secs 2023-05-08T07:28:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13472.868562 secs 2023-05-08T07:28:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13472.868562 secs 2023-05-08T07:28:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13473.426624 secs 2023-05-08T07:28:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:55 smithi186 ceph-mon[126480]: pgmap v7243: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 292 KiB/s rd, 290 KiB/s wr, 12 op/s 2023-05-08T07:28:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13473.426624 secs 2023-05-08T07:28:55.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:55 smithi133 ceph-mon[125939]: pgmap v7243: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 292 KiB/s rd, 290 KiB/s wr, 12 op/s 2023-05-08T07:28:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13473.426624 secs 2023-05-08T07:28:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:55 smithi096 ceph-mon[124666]: pgmap v7243: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 292 KiB/s rd, 290 KiB/s wr, 12 op/s 2023-05-08T07:28:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:28:56.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:28:56.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:56 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:28:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:28:56.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:28:56.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:56 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:28:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:28:56.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:28:56.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:56 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:28:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:57 smithi186 ceph-mon[126480]: pgmap v7244: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 275 KiB/s wr, 10 op/s 2023-05-08T07:28:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:57 smithi133 ceph-mon[125939]: pgmap v7244: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 275 KiB/s wr, 10 op/s 2023-05-08T07:28:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:57 smithi096 ceph-mon[124666]: pgmap v7244: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 275 KiB/s wr, 10 op/s 2023-05-08T07:28:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:59 smithi186 ceph-mon[126480]: pgmap v7245: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 275 KiB/s wr, 9 op/s 2023-05-08T07:28:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:28:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13477.868698 secs 2023-05-08T07:28:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:59 smithi133 ceph-mon[125939]: pgmap v7245: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 275 KiB/s wr, 9 op/s 2023-05-08T07:28:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:28:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13477.868698 secs 2023-05-08T07:28:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:59 smithi096 ceph-mon[124666]: pgmap v7245: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 275 KiB/s wr, 9 op/s 2023-05-08T07:28:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:28:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13477.868698 secs 2023-05-08T07:29:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13479.709295 secs 2023-05-08T07:29:01.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:01 smithi186 ceph-mon[126480]: pgmap v7246: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 399 KiB/s wr, 13 op/s 2023-05-08T07:29:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13479.709295 secs 2023-05-08T07:29:01.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:01 smithi133 ceph-mon[125939]: pgmap v7246: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 399 KiB/s wr, 13 op/s 2023-05-08T07:29:01.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13479.709295 secs 2023-05-08T07:29:01.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:01 smithi096 ceph-mon[124666]: pgmap v7246: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 399 KiB/s wr, 13 op/s 2023-05-08T07:29:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:03 smithi133 ceph-mon[125939]: pgmap v7247: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 210 KiB/s wr, 8 op/s 2023-05-08T07:29:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:03 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:29:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:03 smithi096 ceph-mon[124666]: pgmap v7247: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 210 KiB/s wr, 8 op/s 2023-05-08T07:29:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:03 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:29:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:03 smithi186 ceph-mon[126480]: pgmap v7247: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 210 KiB/s wr, 8 op/s 2023-05-08T07:29:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:03 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:29:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13482.868828 secs 2023-05-08T07:29:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:04 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:29:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:04 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:29:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:04 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:29:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13482.868828 secs 2023-05-08T07:29:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:04 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:29:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:04 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:29:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:04 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:29:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13482.868828 secs 2023-05-08T07:29:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:04 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:29:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:04 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:29:04.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:04 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:29:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13483.426804 secs 2023-05-08T07:29:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:05 smithi133 ceph-mon[125939]: pgmap v7248: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 256 KiB/s wr, 26 op/s 2023-05-08T07:29:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13483.426804 secs 2023-05-08T07:29:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:05 smithi096 ceph-mon[124666]: pgmap v7248: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 256 KiB/s wr, 26 op/s 2023-05-08T07:29:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13483.426804 secs 2023-05-08T07:29:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:05 smithi186 ceph-mon[126480]: pgmap v7248: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 256 KiB/s wr, 26 op/s 2023-05-08T07:29:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13484.709378 secs 2023-05-08T07:29:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13484.709378 secs 2023-05-08T07:29:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13484.709378 secs 2023-05-08T07:29:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:07 smithi133 ceph-mon[125939]: pgmap v7249: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 170 KiB/s wr, 23 op/s 2023-05-08T07:29:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:07 smithi096 ceph-mon[124666]: pgmap v7249: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 170 KiB/s wr, 23 op/s 2023-05-08T07:29:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:07 smithi186 ceph-mon[126480]: pgmap v7249: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 170 KiB/s wr, 23 op/s 2023-05-08T07:29:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:08 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:29:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:29:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:29:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:08 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:29:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:29:08.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:29:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:08 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:29:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:29:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:29:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:09 smithi133 ceph-mon[125939]: pgmap v7250: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 169 KiB/s wr, 22 op/s 2023-05-08T07:29:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13487.868959 secs 2023-05-08T07:29:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:09 smithi096 ceph-mon[124666]: pgmap v7250: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 169 KiB/s wr, 22 op/s 2023-05-08T07:29:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13487.868959 secs 2023-05-08T07:29:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:09 smithi186 ceph-mon[126480]: pgmap v7250: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 169 KiB/s wr, 22 op/s 2023-05-08T07:29:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13487.868959 secs 2023-05-08T07:29:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13488.426921 secs 2023-05-08T07:29:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13488.426921 secs 2023-05-08T07:29:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13488.426921 secs 2023-05-08T07:29:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13489.709507 secs 2023-05-08T07:29:11.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:11 smithi133 ceph-mon[125939]: pgmap v7251: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 211 KiB/s wr, 25 op/s 2023-05-08T07:29:11.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:11 smithi133 ceph-mon[125939]: osdmap e530: 12 total, 12 up, 12 in 2023-05-08T07:29:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13489.709507 secs 2023-05-08T07:29:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:11 smithi096 ceph-mon[124666]: pgmap v7251: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 211 KiB/s wr, 25 op/s 2023-05-08T07:29:11.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:11 smithi096 ceph-mon[124666]: osdmap e530: 12 total, 12 up, 12 in 2023-05-08T07:29:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13489.709507 secs 2023-05-08T07:29:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:11 smithi186 ceph-mon[126480]: pgmap v7251: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 211 KiB/s wr, 25 op/s 2023-05-08T07:29:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:11 smithi186 ceph-mon[126480]: osdmap e530: 12 total, 12 up, 12 in 2023-05-08T07:29:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:13 smithi133 ceph-mon[125939]: pgmap v7253: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 104 KiB/s wr, 25 op/s 2023-05-08T07:29:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:13 smithi096 ceph-mon[124666]: pgmap v7253: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 104 KiB/s wr, 25 op/s 2023-05-08T07:29:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:13 smithi186 ceph-mon[126480]: pgmap v7253: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 104 KiB/s wr, 25 op/s 2023-05-08T07:29:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13492.869114 secs 2023-05-08T07:29:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13492.869114 secs 2023-05-08T07:29:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13492.869114 secs 2023-05-08T07:29:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13493.427055 secs 2023-05-08T07:29:15.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:15 smithi133 ceph-mon[125939]: pgmap v7254: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 100 KiB/s wr, 8 op/s 2023-05-08T07:29:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13493.427055 secs 2023-05-08T07:29:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:15 smithi096 ceph-mon[124666]: pgmap v7254: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 100 KiB/s wr, 8 op/s 2023-05-08T07:29:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13493.427055 secs 2023-05-08T07:29:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:15 smithi186 ceph-mon[126480]: pgmap v7254: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 100 KiB/s wr, 8 op/s 2023-05-08T07:29:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13494.709639 secs 2023-05-08T07:29:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13494.709639 secs 2023-05-08T07:29:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13494.709639 secs 2023-05-08T07:29:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:17 smithi133 ceph-mon[125939]: pgmap v7255: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 100 KiB/s wr, 9 op/s 2023-05-08T07:29:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:17 smithi096 ceph-mon[124666]: pgmap v7255: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 100 KiB/s wr, 9 op/s 2023-05-08T07:29:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:17 smithi186 ceph-mon[126480]: pgmap v7255: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 100 KiB/s wr, 9 op/s 2023-05-08T07:29:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:19 smithi133 ceph-mon[125939]: pgmap v7256: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 100 KiB/s wr, 9 op/s 2023-05-08T07:29:19.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13497.869263 secs 2023-05-08T07:29:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:19 smithi096 ceph-mon[124666]: pgmap v7256: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 100 KiB/s wr, 9 op/s 2023-05-08T07:29:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13497.869263 secs 2023-05-08T07:29:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:19 smithi186 ceph-mon[126480]: pgmap v7256: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 100 KiB/s wr, 9 op/s 2023-05-08T07:29:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13497.869263 secs 2023-05-08T07:29:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13498.427176 secs 2023-05-08T07:29:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13498.427176 secs 2023-05-08T07:29:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13498.427176 secs 2023-05-08T07:29:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13499.709759 secs 2023-05-08T07:29:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:21 smithi133 ceph-mon[125939]: pgmap v7257: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 77 KiB/s wr, 9 op/s 2023-05-08T07:29:21.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:21 smithi133 ceph-mon[125939]: osdmap e531: 12 total, 12 up, 12 in 2023-05-08T07:29:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13499.709759 secs 2023-05-08T07:29:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:21 smithi096 ceph-mon[124666]: pgmap v7257: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 77 KiB/s wr, 9 op/s 2023-05-08T07:29:21.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:21 smithi096 ceph-mon[124666]: osdmap e531: 12 total, 12 up, 12 in 2023-05-08T07:29:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13499.709759 secs 2023-05-08T07:29:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:21 smithi186 ceph-mon[126480]: pgmap v7257: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 77 KiB/s wr, 9 op/s 2023-05-08T07:29:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:21 smithi186 ceph-mon[126480]: osdmap e531: 12 total, 12 up, 12 in 2023-05-08T07:29:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:23 smithi133 ceph-mon[125939]: pgmap v7259: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 77 KiB/s wr, 9 op/s 2023-05-08T07:29:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:23 smithi096 ceph-mon[124666]: pgmap v7259: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 77 KiB/s wr, 9 op/s 2023-05-08T07:29:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:23 smithi186 ceph-mon[126480]: pgmap v7259: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 77 KiB/s wr, 9 op/s 2023-05-08T07:29:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13502.869411 secs 2023-05-08T07:29:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13502.869411 secs 2023-05-08T07:29:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13502.869411 secs 2023-05-08T07:29:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13503.427322 secs 2023-05-08T07:29:25.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:25 smithi133 ceph-mon[125939]: pgmap v7260: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 131 KiB/s wr, 9 op/s 2023-05-08T07:29:25.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:25 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:29:25.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13503.427322 secs 2023-05-08T07:29:25.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:25 smithi096 ceph-mon[124666]: pgmap v7260: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 131 KiB/s wr, 9 op/s 2023-05-08T07:29:25.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:25 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:29:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13503.427322 secs 2023-05-08T07:29:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:25 smithi186 ceph-mon[126480]: pgmap v7260: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 131 KiB/s wr, 9 op/s 2023-05-08T07:29:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:25 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:29:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13504.709852 secs 2023-05-08T07:29:26.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:29:26.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:29:26.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:29:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13504.709852 secs 2023-05-08T07:29:26.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:29:26.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:29:26.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:29:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13504.709852 secs 2023-05-08T07:29:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:29:26.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:29:26.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:29:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:27 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:29:27.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:27 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T07:29:27.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:27 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T07:29:27.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:27 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:29:27.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:27 smithi133 ceph-mon[125939]: pgmap v7261: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 131 KiB/s wr, 8 op/s 2023-05-08T07:29:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:27 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:29:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:27 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T07:29:27.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:27 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T07:29:27.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:27 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:29:27.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:27 smithi096 ceph-mon[124666]: pgmap v7261: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 131 KiB/s wr, 8 op/s 2023-05-08T07:29:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:27 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:29:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:27 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T07:29:27.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:27 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T07:29:27.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:27 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:29:27.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:27 smithi186 ceph-mon[126480]: pgmap v7261: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 131 KiB/s wr, 8 op/s 2023-05-08T07:29:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:29 smithi133 ceph-mon[125939]: pgmap v7262: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 131 KiB/s wr, 8 op/s 2023-05-08T07:29:29.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13507.869524 secs 2023-05-08T07:29:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:29 smithi096 ceph-mon[124666]: pgmap v7262: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 131 KiB/s wr, 8 op/s 2023-05-08T07:29:29.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13507.869524 secs 2023-05-08T07:29:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:29 smithi186 ceph-mon[126480]: pgmap v7262: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 131 KiB/s wr, 8 op/s 2023-05-08T07:29:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13507.869524 secs 2023-05-08T07:29:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13508.427452 secs 2023-05-08T07:29:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13508.427452 secs 2023-05-08T07:29:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13508.427452 secs 2023-05-08T07:29:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13509.709999 secs 2023-05-08T07:29:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:31 smithi133 ceph-mon[125939]: pgmap v7263: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 142 KiB/s wr, 9 op/s 2023-05-08T07:29:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13509.709999 secs 2023-05-08T07:29:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:31 smithi096 ceph-mon[124666]: pgmap v7263: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 142 KiB/s wr, 9 op/s 2023-05-08T07:29:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13509.709999 secs 2023-05-08T07:29:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:31 smithi186 ceph-mon[126480]: pgmap v7263: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 142 KiB/s wr, 9 op/s 2023-05-08T07:29:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:33 smithi133 ceph-mon[125939]: pgmap v7264: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 131 KiB/s wr, 8 op/s 2023-05-08T07:29:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:33 smithi096 ceph-mon[124666]: pgmap v7264: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 131 KiB/s wr, 8 op/s 2023-05-08T07:29:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:33 smithi186 ceph-mon[126480]: pgmap v7264: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 131 KiB/s wr, 8 op/s 2023-05-08T07:29:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13512.869642 secs 2023-05-08T07:29:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13512.869642 secs 2023-05-08T07:29:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13512.869642 secs 2023-05-08T07:29:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13513.427550 secs 2023-05-08T07:29:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:35 smithi133 ceph-mon[125939]: pgmap v7265: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 156 KiB/s wr, 9 op/s 2023-05-08T07:29:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13513.427550 secs 2023-05-08T07:29:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:35 smithi096 ceph-mon[124666]: pgmap v7265: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 156 KiB/s wr, 9 op/s 2023-05-08T07:29:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13513.427550 secs 2023-05-08T07:29:35.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:35 smithi186 ceph-mon[126480]: pgmap v7265: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 156 KiB/s wr, 9 op/s 2023-05-08T07:29:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13514.710127 secs 2023-05-08T07:29:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13514.710127 secs 2023-05-08T07:29:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13514.710127 secs 2023-05-08T07:29:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:37 smithi133 ceph-mon[125939]: pgmap v7266: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 69 KiB/s wr, 7 op/s 2023-05-08T07:29:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:37 smithi096 ceph-mon[124666]: pgmap v7266: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 69 KiB/s wr, 7 op/s 2023-05-08T07:29:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:37 smithi186 ceph-mon[126480]: pgmap v7266: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 69 KiB/s wr, 7 op/s 2023-05-08T07:29:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:39 smithi133 ceph-mon[125939]: pgmap v7267: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 69 KiB/s wr, 6 op/s 2023-05-08T07:29:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13517.869771 secs 2023-05-08T07:29:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:39 smithi096 ceph-mon[124666]: pgmap v7267: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 69 KiB/s wr, 6 op/s 2023-05-08T07:29:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13517.869771 secs 2023-05-08T07:29:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:39 smithi186 ceph-mon[126480]: pgmap v7267: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 69 KiB/s wr, 6 op/s 2023-05-08T07:29:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13517.869771 secs 2023-05-08T07:29:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13518.427682 secs 2023-05-08T07:29:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13518.427682 secs 2023-05-08T07:29:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13518.427682 secs 2023-05-08T07:29:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:41 smithi096 ceph-mon[124666]: pgmap v7268: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 70 KiB/s wr, 10 op/s 2023-05-08T07:29:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:41 smithi186 ceph-mon[126480]: pgmap v7268: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 70 KiB/s wr, 10 op/s 2023-05-08T07:29:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:41 smithi133 ceph-mon[125939]: pgmap v7268: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 70 KiB/s wr, 10 op/s 2023-05-08T07:29:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:43 smithi096 ceph-mon[124666]: pgmap v7269: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 38 KiB/s wr, 6 op/s 2023-05-08T07:29:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:29:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:43 smithi186 ceph-mon[126480]: pgmap v7269: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 38 KiB/s wr, 6 op/s 2023-05-08T07:29:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:29:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:43 smithi133 ceph-mon[125939]: pgmap v7269: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 38 KiB/s wr, 6 op/s 2023-05-08T07:29:43.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:29:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13522.869890 secs 2023-05-08T07:29:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:29:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:29:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:29:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13522.869890 secs 2023-05-08T07:29:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:29:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:29:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:29:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13522.869890 secs 2023-05-08T07:29:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:29:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:29:44.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:29:45.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13523.427800 secs 2023-05-08T07:29:45.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:45 smithi186 ceph-mon[126480]: pgmap v7270: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 78 KiB/s wr, 8 op/s 2023-05-08T07:29:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13523.427800 secs 2023-05-08T07:29:45.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:45 smithi133 ceph-mon[125939]: pgmap v7270: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 78 KiB/s wr, 8 op/s 2023-05-08T07:29:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13523.427800 secs 2023-05-08T07:29:46.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:45 smithi096 ceph-mon[124666]: pgmap v7270: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 78 KiB/s wr, 8 op/s 2023-05-08T07:29:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:47 smithi186 ceph-mon[126480]: pgmap v7271: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 40 KiB/s wr, 7 op/s 2023-05-08T07:29:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:47 smithi133 ceph-mon[125939]: pgmap v7271: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 40 KiB/s wr, 7 op/s 2023-05-08T07:29:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:47 smithi096 ceph-mon[124666]: pgmap v7271: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 40 KiB/s wr, 7 op/s 2023-05-08T07:29:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:49 smithi186 ceph-mon[126480]: pgmap v7272: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 40 KiB/s wr, 6 op/s 2023-05-08T07:29:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13527.870018 secs 2023-05-08T07:29:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:49 smithi133 ceph-mon[125939]: pgmap v7272: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 40 KiB/s wr, 6 op/s 2023-05-08T07:29:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13527.870018 secs 2023-05-08T07:29:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:49 smithi096 ceph-mon[124666]: pgmap v7272: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 40 KiB/s wr, 6 op/s 2023-05-08T07:29:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13527.870018 secs 2023-05-08T07:29:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:51 smithi186 ceph-mon[126480]: pgmap v7273: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 117 KiB/s wr, 10 op/s 2023-05-08T07:29:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:29:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:51 smithi133 ceph-mon[125939]: pgmap v7273: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 117 KiB/s wr, 10 op/s 2023-05-08T07:29:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:29:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:51 smithi096 ceph-mon[124666]: pgmap v7273: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 117 KiB/s wr, 10 op/s 2023-05-08T07:29:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:29:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:52 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:29:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:29:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:29:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:52 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:29:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:29:52.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:29:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:52 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:29:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:29:53.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:29:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:53 smithi186 ceph-mon[126480]: pgmap v7274: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 116 KiB/s wr, 6 op/s 2023-05-08T07:29:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:53 smithi133 ceph-mon[125939]: pgmap v7274: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 116 KiB/s wr, 6 op/s 2023-05-08T07:29:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:53 smithi096 ceph-mon[124666]: pgmap v7274: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 116 KiB/s wr, 6 op/s 2023-05-08T07:29:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13532.870150 secs 2023-05-08T07:29:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13532.870150 secs 2023-05-08T07:29:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13532.870150 secs 2023-05-08T07:29:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:55 smithi186 ceph-mon[126480]: pgmap v7275: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 276 KiB/s wr, 10 op/s 2023-05-08T07:29:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:55 smithi133 ceph-mon[125939]: pgmap v7275: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 276 KiB/s wr, 10 op/s 2023-05-08T07:29:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:55 smithi096 ceph-mon[124666]: pgmap v7275: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 276 KiB/s wr, 10 op/s 2023-05-08T07:29:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:57 smithi186 ceph-mon[126480]: pgmap v7276: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 237 KiB/s wr, 10 op/s 2023-05-08T07:29:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:57 smithi133 ceph-mon[125939]: pgmap v7276: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 237 KiB/s wr, 10 op/s 2023-05-08T07:29:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:57 smithi096 ceph-mon[124666]: pgmap v7276: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 237 KiB/s wr, 10 op/s 2023-05-08T07:29:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:59 smithi186 ceph-mon[126480]: pgmap v7277: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 237 KiB/s wr, 9 op/s 2023-05-08T07:29:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13537.870277 secs 2023-05-08T07:29:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:29:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13538.428152 secs 2023-05-08T07:29:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:59 smithi133 ceph-mon[125939]: pgmap v7277: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 237 KiB/s wr, 9 op/s 2023-05-08T07:29:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13537.870277 secs 2023-05-08T07:29:59.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:29:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13538.428152 secs 2023-05-08T07:30:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:59 smithi096 ceph-mon[124666]: pgmap v7277: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 237 KiB/s wr, 9 op/s 2023-05-08T07:30:00.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13537.870277 secs 2023-05-08T07:30:00.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:29:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13538.428152 secs 2023-05-08T07:30:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:00 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:30:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:30:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:30:00.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:00 smithi186 ceph-mon[126480]: overall HEALTH_WARN 2 MDSs report slow requests 2023-05-08T07:30:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:00 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:30:00.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:30:00.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:30:00.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:00 smithi133 ceph-mon[125939]: overall HEALTH_WARN 2 MDSs report slow requests 2023-05-08T07:30:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:00 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:30:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:30:01.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:30:01.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:00 smithi096 ceph-mon[124666]: overall HEALTH_WARN 2 MDSs report slow requests 2023-05-08T07:30:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:01 smithi186 ceph-mon[126480]: pgmap v7278: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 288 KiB/s wr, 13 op/s 2023-05-08T07:30:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:01 smithi133 ceph-mon[125939]: pgmap v7278: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 288 KiB/s wr, 13 op/s 2023-05-08T07:30:02.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:01 smithi096 ceph-mon[124666]: pgmap v7278: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 288 KiB/s wr, 13 op/s 2023-05-08T07:30:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:03 smithi186 ceph-mon[126480]: pgmap v7279: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 211 KiB/s wr, 9 op/s 2023-05-08T07:30:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:03 smithi133 ceph-mon[125939]: pgmap v7279: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 211 KiB/s wr, 9 op/s 2023-05-08T07:30:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:03 smithi096 ceph-mon[124666]: pgmap v7279: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 211 KiB/s wr, 9 op/s 2023-05-08T07:30:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13542.870400 secs 2023-05-08T07:30:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13543.428287 secs 2023-05-08T07:30:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13542.870400 secs 2023-05-08T07:30:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13543.428287 secs 2023-05-08T07:30:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13542.870400 secs 2023-05-08T07:30:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13543.428287 secs 2023-05-08T07:30:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:05 smithi186 ceph-mon[126480]: pgmap v7280: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 343 KiB/s wr, 24 op/s 2023-05-08T07:30:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:05 smithi133 ceph-mon[125939]: pgmap v7280: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 343 KiB/s wr, 24 op/s 2023-05-08T07:30:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:05 smithi096 ceph-mon[124666]: pgmap v7280: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 343 KiB/s wr, 24 op/s 2023-05-08T07:30:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:07 smithi186 ceph-mon[126480]: pgmap v7281: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 184 KiB/s wr, 21 op/s 2023-05-08T07:30:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:07 smithi133 ceph-mon[125939]: pgmap v7281: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 184 KiB/s wr, 21 op/s 2023-05-08T07:30:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:07 smithi096 ceph-mon[124666]: pgmap v7281: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 184 KiB/s wr, 21 op/s 2023-05-08T07:30:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:09 smithi186 ceph-mon[126480]: pgmap v7282: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 183 KiB/s wr, 20 op/s 2023-05-08T07:30:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13547.870522 secs 2023-05-08T07:30:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:09 smithi133 ceph-mon[125939]: pgmap v7282: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 183 KiB/s wr, 20 op/s 2023-05-08T07:30:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13547.870522 secs 2023-05-08T07:30:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:09 smithi096 ceph-mon[124666]: pgmap v7282: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 183 KiB/s wr, 20 op/s 2023-05-08T07:30:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13547.870522 secs 2023-05-08T07:30:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:11 smithi186 ceph-mon[126480]: pgmap v7283: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 266 KiB/s wr, 25 op/s 2023-05-08T07:30:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:11 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:30:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:11 smithi133 ceph-mon[125939]: pgmap v7283: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 266 KiB/s wr, 25 op/s 2023-05-08T07:30:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:11 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:30:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:11 smithi096 ceph-mon[124666]: pgmap v7283: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 266 KiB/s wr, 25 op/s 2023-05-08T07:30:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:11 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:30:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:12 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:30:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:12 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:30:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:12 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:30:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:12 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:30:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:12 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:30:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:12 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:30:13.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:12 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:30:13.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:12 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:30:13.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:12 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:30:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:13 smithi186 ceph-mon[126480]: pgmap v7284: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 214 KiB/s wr, 20 op/s 2023-05-08T07:30:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:13 smithi133 ceph-mon[125939]: pgmap v7284: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 214 KiB/s wr, 20 op/s 2023-05-08T07:30:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:13 smithi096 ceph-mon[124666]: pgmap v7284: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 214 KiB/s wr, 20 op/s 2023-05-08T07:30:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13552.870649 secs 2023-05-08T07:30:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13552.870649 secs 2023-05-08T07:30:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13552.870649 secs 2023-05-08T07:30:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:15 smithi186 ceph-mon[126480]: pgmap v7285: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 241 KiB/s wr, 22 op/s 2023-05-08T07:30:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:15 smithi133 ceph-mon[125939]: pgmap v7285: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 241 KiB/s wr, 22 op/s 2023-05-08T07:30:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:15 smithi096 ceph-mon[124666]: pgmap v7285: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 241 KiB/s wr, 22 op/s 2023-05-08T07:30:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:17 smithi186 ceph-mon[126480]: pgmap v7286: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 109 KiB/s wr, 8 op/s 2023-05-08T07:30:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:17 smithi133 ceph-mon[125939]: pgmap v7286: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 109 KiB/s wr, 8 op/s 2023-05-08T07:30:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:17 smithi096 ceph-mon[124666]: pgmap v7286: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 109 KiB/s wr, 8 op/s 2023-05-08T07:30:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:19 smithi186 ceph-mon[126480]: pgmap v7287: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 109 KiB/s wr, 7 op/s 2023-05-08T07:30:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13557.870776 secs 2023-05-08T07:30:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:19 smithi133 ceph-mon[125939]: pgmap v7287: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 109 KiB/s wr, 7 op/s 2023-05-08T07:30:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13557.870776 secs 2023-05-08T07:30:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:19 smithi096 ceph-mon[124666]: pgmap v7287: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 109 KiB/s wr, 7 op/s 2023-05-08T07:30:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13557.870776 secs 2023-05-08T07:30:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:21 smithi186 ceph-mon[126480]: pgmap v7288: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 113 KiB/s wr, 10 op/s 2023-05-08T07:30:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:21 smithi133 ceph-mon[125939]: pgmap v7288: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 113 KiB/s wr, 10 op/s 2023-05-08T07:30:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:21 smithi096 ceph-mon[124666]: pgmap v7288: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 113 KiB/s wr, 10 op/s 2023-05-08T07:30:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:23 smithi186 ceph-mon[126480]: pgmap v7289: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 31 KiB/s wr, 6 op/s 2023-05-08T07:30:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:23 smithi133 ceph-mon[125939]: pgmap v7289: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 31 KiB/s wr, 6 op/s 2023-05-08T07:30:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:23 smithi096 ceph-mon[124666]: pgmap v7289: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 31 KiB/s wr, 6 op/s 2023-05-08T07:30:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13562.870911 secs 2023-05-08T07:30:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13563.428795 secs 2023-05-08T07:30:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13562.870911 secs 2023-05-08T07:30:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13563.428795 secs 2023-05-08T07:30:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13562.870911 secs 2023-05-08T07:30:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13563.428795 secs 2023-05-08T07:30:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:25 smithi133 ceph-mon[125939]: pgmap v7290: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 181 KiB/s wr, 11 op/s 2023-05-08T07:30:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:25 smithi096 ceph-mon[124666]: pgmap v7290: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 181 KiB/s wr, 11 op/s 2023-05-08T07:30:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:25 smithi186 ceph-mon[126480]: pgmap v7290: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 181 KiB/s wr, 11 op/s 2023-05-08T07:30:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13564.711260 secs 2023-05-08T07:30:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:30:26.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:30:26.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:30:26.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:30:26.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:30:26.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:30:26.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:30:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13564.711260 secs 2023-05-08T07:30:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:30:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:30:27.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:30:27.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:30:27.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:30:27.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:30:27.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:30:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13564.711260 secs 2023-05-08T07:30:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:30:27.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:30:27.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:30:27.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:30:27.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:30:27.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:30:27.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:30:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:27 smithi133 ceph-mon[125939]: pgmap v7291: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 155 KiB/s wr, 10 op/s 2023-05-08T07:30:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:30:27.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:30:27.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:30:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:27 smithi096 ceph-mon[124666]: pgmap v7291: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 155 KiB/s wr, 10 op/s 2023-05-08T07:30:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:30:28.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:30:28.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:30:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:27 smithi186 ceph-mon[126480]: pgmap v7291: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 155 KiB/s wr, 10 op/s 2023-05-08T07:30:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:30:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:30:28.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:30:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:28 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:30:28.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:28 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T07:30:28.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:28 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T07:30:28.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:28 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:30:28.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:28 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:30:28.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:28 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:30:28.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:28 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:30:28.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:28 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:30:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:28 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:30:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:28 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T07:30:29.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:28 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T07:30:29.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:28 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:30:29.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:28 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:30:29.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:28 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:30:29.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:28 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:30:29.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:28 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:30:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:28 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:30:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:28 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T07:30:29.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:28 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T07:30:29.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:28 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:30:29.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:28 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:30:29.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:28 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:30:29.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:28 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:30:29.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:28 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:30:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:29 smithi133 ceph-mon[125939]: pgmap v7292: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 155 KiB/s wr, 9 op/s 2023-05-08T07:30:29.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13567.871051 secs 2023-05-08T07:30:29.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13568.428915 secs 2023-05-08T07:30:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:29 smithi096 ceph-mon[124666]: pgmap v7292: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 155 KiB/s wr, 9 op/s 2023-05-08T07:30:30.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13567.871051 secs 2023-05-08T07:30:30.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13568.428915 secs 2023-05-08T07:30:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:29 smithi186 ceph-mon[126480]: pgmap v7292: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 155 KiB/s wr, 9 op/s 2023-05-08T07:30:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13567.871051 secs 2023-05-08T07:30:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13568.428915 secs 2023-05-08T07:30:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13569.711407 secs 2023-05-08T07:30:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:31 smithi133 ceph-mon[125939]: pgmap v7293: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 237 KiB/s wr, 13 op/s 2023-05-08T07:30:31.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:31 smithi133 ceph-mon[125939]: osdmap e532: 12 total, 12 up, 12 in 2023-05-08T07:30:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13569.711407 secs 2023-05-08T07:30:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:31 smithi096 ceph-mon[124666]: pgmap v7293: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 237 KiB/s wr, 13 op/s 2023-05-08T07:30:32.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:31 smithi096 ceph-mon[124666]: osdmap e532: 12 total, 12 up, 12 in 2023-05-08T07:30:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13569.711407 secs 2023-05-08T07:30:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:31 smithi186 ceph-mon[126480]: pgmap v7293: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 237 KiB/s wr, 13 op/s 2023-05-08T07:30:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:31 smithi186 ceph-mon[126480]: osdmap e532: 12 total, 12 up, 12 in 2023-05-08T07:30:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:33 smithi133 ceph-mon[125939]: pgmap v7295: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 280 KiB/s wr, 13 op/s 2023-05-08T07:30:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:33 smithi096 ceph-mon[124666]: pgmap v7295: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 280 KiB/s wr, 13 op/s 2023-05-08T07:30:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:33 smithi186 ceph-mon[126480]: pgmap v7295: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 280 KiB/s wr, 13 op/s 2023-05-08T07:30:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13572.871160 secs 2023-05-08T07:30:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13573.429039 secs 2023-05-08T07:30:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13572.871160 secs 2023-05-08T07:30:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13573.429039 secs 2023-05-08T07:30:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13572.871160 secs 2023-05-08T07:30:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13573.429039 secs 2023-05-08T07:30:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:35 smithi133 ceph-mon[125939]: pgmap v7296: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 100 KiB/s wr, 9 op/s 2023-05-08T07:30:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:35 smithi096 ceph-mon[124666]: pgmap v7296: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 100 KiB/s wr, 9 op/s 2023-05-08T07:30:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:35 smithi186 ceph-mon[126480]: pgmap v7296: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 100 KiB/s wr, 9 op/s 2023-05-08T07:30:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13574.711533 secs 2023-05-08T07:30:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13574.711533 secs 2023-05-08T07:30:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13574.711533 secs 2023-05-08T07:30:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:37 smithi133 ceph-mon[125939]: pgmap v7297: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 100 KiB/s wr, 9 op/s 2023-05-08T07:30:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:37 smithi096 ceph-mon[124666]: pgmap v7297: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 100 KiB/s wr, 9 op/s 2023-05-08T07:30:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:37 smithi186 ceph-mon[126480]: pgmap v7297: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 100 KiB/s wr, 9 op/s 2023-05-08T07:30:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:39 smithi133 ceph-mon[125939]: pgmap v7298: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 100 KiB/s wr, 9 op/s 2023-05-08T07:30:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13577.871282 secs 2023-05-08T07:30:39.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13578.429194 secs 2023-05-08T07:30:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:39 smithi096 ceph-mon[124666]: pgmap v7298: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 100 KiB/s wr, 9 op/s 2023-05-08T07:30:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13577.871282 secs 2023-05-08T07:30:40.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13578.429194 secs 2023-05-08T07:30:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:39 smithi186 ceph-mon[126480]: pgmap v7298: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 100 KiB/s wr, 9 op/s 2023-05-08T07:30:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13577.871282 secs 2023-05-08T07:30:40.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13578.429194 secs 2023-05-08T07:30:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:41 smithi133 ceph-mon[125939]: pgmap v7299: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 99 KiB/s wr, 8 op/s 2023-05-08T07:30:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:41 smithi133 ceph-mon[125939]: osdmap e533: 12 total, 12 up, 12 in 2023-05-08T07:30:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:41 smithi096 ceph-mon[124666]: pgmap v7299: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 99 KiB/s wr, 8 op/s 2023-05-08T07:30:42.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:41 smithi096 ceph-mon[124666]: osdmap e533: 12 total, 12 up, 12 in 2023-05-08T07:30:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:41 smithi186 ceph-mon[126480]: pgmap v7299: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 99 KiB/s wr, 8 op/s 2023-05-08T07:30:42.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:41 smithi186 ceph-mon[126480]: osdmap e533: 12 total, 12 up, 12 in 2023-05-08T07:30:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:30:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:30:43.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:30:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:43 smithi133 ceph-mon[125939]: pgmap v7301: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 99 KiB/s wr, 8 op/s 2023-05-08T07:30:43.994 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:43 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:30:43.994 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:30:43.994 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:30:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:43 smithi096 ceph-mon[124666]: pgmap v7301: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 99 KiB/s wr, 8 op/s 2023-05-08T07:30:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:43 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:30:44.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:30:44.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:30:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:43 smithi186 ceph-mon[126480]: pgmap v7301: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 99 KiB/s wr, 8 op/s 2023-05-08T07:30:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:43 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:30:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:30:44.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:30:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13582.871387 secs 2023-05-08T07:30:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13582.871387 secs 2023-05-08T07:30:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13582.871387 secs 2023-05-08T07:30:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:45 smithi133 ceph-mon[125939]: pgmap v7302: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 117 KiB/s wr, 8 op/s 2023-05-08T07:30:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:45 smithi096 ceph-mon[124666]: pgmap v7302: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 117 KiB/s wr, 8 op/s 2023-05-08T07:30:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:45 smithi186 ceph-mon[126480]: pgmap v7302: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 117 KiB/s wr, 8 op/s 2023-05-08T07:30:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:47 smithi133 ceph-mon[125939]: pgmap v7303: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 117 KiB/s wr, 9 op/s 2023-05-08T07:30:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:30:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:47 smithi096 ceph-mon[124666]: pgmap v7303: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 117 KiB/s wr, 9 op/s 2023-05-08T07:30:48.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:30:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:47 smithi186 ceph-mon[126480]: pgmap v7303: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 117 KiB/s wr, 9 op/s 2023-05-08T07:30:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:30:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:48 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:30:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:30:48.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:30:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:48 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:30:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:30:49.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:30:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:48 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:30:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:30:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:30:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:49 smithi133 ceph-mon[125939]: pgmap v7304: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 117 KiB/s wr, 9 op/s 2023-05-08T07:30:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13587.871444 secs 2023-05-08T07:30:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:49 smithi096 ceph-mon[124666]: pgmap v7304: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 117 KiB/s wr, 9 op/s 2023-05-08T07:30:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13587.871444 secs 2023-05-08T07:30:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:49 smithi186 ceph-mon[126480]: pgmap v7304: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 117 KiB/s wr, 9 op/s 2023-05-08T07:30:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13587.871444 secs 2023-05-08T07:30:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:51 smithi133 ceph-mon[125939]: pgmap v7305: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 251 KiB/s wr, 11 op/s 2023-05-08T07:30:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:51 smithi096 ceph-mon[124666]: pgmap v7305: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 251 KiB/s wr, 11 op/s 2023-05-08T07:30:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:51 smithi186 ceph-mon[126480]: pgmap v7305: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 251 KiB/s wr, 11 op/s 2023-05-08T07:30:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:53 smithi133 ceph-mon[125939]: pgmap v7306: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 231 KiB/s wr, 10 op/s 2023-05-08T07:30:54.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:53 smithi096 ceph-mon[124666]: pgmap v7306: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 231 KiB/s wr, 10 op/s 2023-05-08T07:30:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:53 smithi186 ceph-mon[126480]: pgmap v7306: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 231 KiB/s wr, 10 op/s 2023-05-08T07:30:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13592.871510 secs 2023-05-08T07:30:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13593.429545 secs 2023-05-08T07:30:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13592.871510 secs 2023-05-08T07:30:55.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13593.429545 secs 2023-05-08T07:30:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13592.871510 secs 2023-05-08T07:30:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13593.429545 secs 2023-05-08T07:30:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:55 smithi133 ceph-mon[125939]: pgmap v7307: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 298 KiB/s wr, 13 op/s 2023-05-08T07:30:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:55 smithi096 ceph-mon[124666]: pgmap v7307: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 298 KiB/s wr, 13 op/s 2023-05-08T07:30:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:55 smithi186 ceph-mon[126480]: pgmap v7307: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 298 KiB/s wr, 13 op/s 2023-05-08T07:30:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:56 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:30:56.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:30:56.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:30:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:56 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:30:57.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:30:57.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:30:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:56 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:30:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:30:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:30:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:57 smithi133 ceph-mon[125939]: pgmap v7308: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 282 KiB/s wr, 11 op/s 2023-05-08T07:30:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:57 smithi096 ceph-mon[124666]: pgmap v7308: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 282 KiB/s wr, 11 op/s 2023-05-08T07:30:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:57 smithi186 ceph-mon[126480]: pgmap v7308: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 282 KiB/s wr, 11 op/s 2023-05-08T07:30:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:58 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:30:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:58 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:30:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:58 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:30:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:59 smithi133 ceph-mon[125939]: pgmap v7309: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 282 KiB/s wr, 9 op/s 2023-05-08T07:30:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13597.871591 secs 2023-05-08T07:30:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:59 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:30:59.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:30:59 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:31:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:59 smithi096 ceph-mon[124666]: pgmap v7309: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 282 KiB/s wr, 9 op/s 2023-05-08T07:31:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13597.871591 secs 2023-05-08T07:31:00.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:59 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:31:00.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:30:59 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:31:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:59 smithi186 ceph-mon[126480]: pgmap v7309: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 282 KiB/s wr, 9 op/s 2023-05-08T07:31:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13597.871591 secs 2023-05-08T07:31:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:59 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:31:00.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:30:59 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:31:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13599.712185 secs 2023-05-08T07:31:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:01 smithi133 ceph-mon[125939]: pgmap v7310: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 413 KiB/s wr, 14 op/s 2023-05-08T07:31:01.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:01 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:31:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13599.712185 secs 2023-05-08T07:31:02.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:01 smithi096 ceph-mon[124666]: pgmap v7310: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 413 KiB/s wr, 14 op/s 2023-05-08T07:31:02.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:01 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:31:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13599.712185 secs 2023-05-08T07:31:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:01 smithi186 ceph-mon[126480]: pgmap v7310: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 413 KiB/s wr, 14 op/s 2023-05-08T07:31:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:01 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:31:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:03 smithi096 ceph-mon[124666]: pgmap v7311: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 220 KiB/s wr, 9 op/s 2023-05-08T07:31:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:31:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:03 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:31:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:03 smithi186 ceph-mon[126480]: pgmap v7311: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 220 KiB/s wr, 9 op/s 2023-05-08T07:31:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:31:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:03 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:31:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:03 smithi133 ceph-mon[125939]: pgmap v7311: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 220 KiB/s wr, 9 op/s 2023-05-08T07:31:04.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:31:04.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:03 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:31:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13602.871705 secs 2023-05-08T07:31:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13603.429776 secs 2023-05-08T07:31:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13602.871705 secs 2023-05-08T07:31:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13603.429776 secs 2023-05-08T07:31:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13602.871705 secs 2023-05-08T07:31:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13603.429776 secs 2023-05-08T07:31:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:05 smithi186 ceph-mon[126480]: pgmap v7312: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 269 KiB/s wr, 26 op/s 2023-05-08T07:31:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:05 smithi133 ceph-mon[125939]: pgmap v7312: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 269 KiB/s wr, 26 op/s 2023-05-08T07:31:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:05 smithi096 ceph-mon[124666]: pgmap v7312: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 269 KiB/s wr, 26 op/s 2023-05-08T07:31:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13604.712303 secs 2023-05-08T07:31:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:06 smithi186 ceph-mon[126480]: osdmap e534: 12 total, 12 up, 12 in 2023-05-08T07:31:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:06 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:31:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13604.712303 secs 2023-05-08T07:31:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:06 smithi133 ceph-mon[125939]: osdmap e534: 12 total, 12 up, 12 in 2023-05-08T07:31:07.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:06 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:31:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13604.712303 secs 2023-05-08T07:31:07.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:06 smithi096 ceph-mon[124666]: osdmap e534: 12 total, 12 up, 12 in 2023-05-08T07:31:07.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:06 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:31:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:07 smithi186 ceph-mon[126480]: pgmap v7314: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 216 KiB/s wr, 27 op/s 2023-05-08T07:31:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:07 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:31:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:07 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:31:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:07 smithi133 ceph-mon[125939]: pgmap v7314: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 216 KiB/s wr, 27 op/s 2023-05-08T07:31:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:07 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:31:08.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:07 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:31:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:07 smithi096 ceph-mon[124666]: pgmap v7314: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 216 KiB/s wr, 27 op/s 2023-05-08T07:31:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:07 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:31:08.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:07 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:31:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:09 smithi186 ceph-mon[126480]: pgmap v7315: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 216 KiB/s wr, 27 op/s 2023-05-08T07:31:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13607.871844 secs 2023-05-08T07:31:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13608.429897 secs 2023-05-08T07:31:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:09 smithi133 ceph-mon[125939]: pgmap v7315: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 216 KiB/s wr, 27 op/s 2023-05-08T07:31:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13607.871844 secs 2023-05-08T07:31:10.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13608.429897 secs 2023-05-08T07:31:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:09 smithi096 ceph-mon[124666]: pgmap v7315: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 216 KiB/s wr, 27 op/s 2023-05-08T07:31:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13607.871844 secs 2023-05-08T07:31:10.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13608.429897 secs 2023-05-08T07:31:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13609.712450 secs 2023-05-08T07:31:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:10 smithi186 ceph-mon[126480]: pgmap v7316: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 208 KiB/s wr, 27 op/s 2023-05-08T07:31:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13609.712450 secs 2023-05-08T07:31:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:10 smithi133 ceph-mon[125939]: pgmap v7316: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 208 KiB/s wr, 27 op/s 2023-05-08T07:31:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13609.712450 secs 2023-05-08T07:31:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:10 smithi096 ceph-mon[124666]: pgmap v7316: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 208 KiB/s wr, 27 op/s 2023-05-08T07:31:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:11 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:31:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:11 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:31:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:11 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:31:13.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:12 smithi186 ceph-mon[126480]: pgmap v7317: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 208 KiB/s wr, 27 op/s 2023-05-08T07:31:13.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:12 smithi133 ceph-mon[125939]: pgmap v7317: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 208 KiB/s wr, 27 op/s 2023-05-08T07:31:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:12 smithi096 ceph-mon[124666]: pgmap v7317: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 208 KiB/s wr, 27 op/s 2023-05-08T07:31:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13612.871990 secs 2023-05-08T07:31:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13612.871990 secs 2023-05-08T07:31:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13612.871990 secs 2023-05-08T07:31:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13613.430011 secs 2023-05-08T07:31:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:15 smithi186 ceph-mon[126480]: pgmap v7318: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 196 KiB/s wr, 10 op/s 2023-05-08T07:31:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13613.430011 secs 2023-05-08T07:31:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:15 smithi133 ceph-mon[125939]: pgmap v7318: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 196 KiB/s wr, 10 op/s 2023-05-08T07:31:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13613.430011 secs 2023-05-08T07:31:15.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:15 smithi096 ceph-mon[124666]: pgmap v7318: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 196 KiB/s wr, 10 op/s 2023-05-08T07:31:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13614.712571 secs 2023-05-08T07:31:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13614.712571 secs 2023-05-08T07:31:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13614.712571 secs 2023-05-08T07:31:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:17 smithi133 ceph-mon[125939]: pgmap v7319: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 195 KiB/s wr, 10 op/s 2023-05-08T07:31:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:17 smithi133 ceph-mon[125939]: osdmap e535: 12 total, 12 up, 12 in 2023-05-08T07:31:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:17 smithi096 ceph-mon[124666]: pgmap v7319: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 195 KiB/s wr, 10 op/s 2023-05-08T07:31:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:17 smithi096 ceph-mon[124666]: osdmap e535: 12 total, 12 up, 12 in 2023-05-08T07:31:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:17 smithi186 ceph-mon[126480]: pgmap v7319: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 195 KiB/s wr, 10 op/s 2023-05-08T07:31:17.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:17 smithi186 ceph-mon[126480]: osdmap e535: 12 total, 12 up, 12 in 2023-05-08T07:31:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:19 smithi133 ceph-mon[125939]: pgmap v7321: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 202 KiB/s wr, 10 op/s 2023-05-08T07:31:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13617.872105 secs 2023-05-08T07:31:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:19 smithi096 ceph-mon[124666]: pgmap v7321: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 202 KiB/s wr, 10 op/s 2023-05-08T07:31:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13617.872105 secs 2023-05-08T07:31:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:19 smithi186 ceph-mon[126480]: pgmap v7321: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 202 KiB/s wr, 10 op/s 2023-05-08T07:31:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13617.872105 secs 2023-05-08T07:31:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13618.430140 secs 2023-05-08T07:31:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13618.430140 secs 2023-05-08T07:31:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13618.430140 secs 2023-05-08T07:31:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13619.712692 secs 2023-05-08T07:31:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:21 smithi096 ceph-mon[124666]: pgmap v7322: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 81 KiB/s wr, 10 op/s 2023-05-08T07:31:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13619.712692 secs 2023-05-08T07:31:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:21 smithi186 ceph-mon[126480]: pgmap v7322: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 81 KiB/s wr, 10 op/s 2023-05-08T07:31:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13619.712692 secs 2023-05-08T07:31:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:21 smithi133 ceph-mon[125939]: pgmap v7322: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 81 KiB/s wr, 10 op/s 2023-05-08T07:31:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:23 smithi186 ceph-mon[126480]: pgmap v7323: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 81 KiB/s wr, 10 op/s 2023-05-08T07:31:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:23 smithi133 ceph-mon[125939]: pgmap v7323: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 81 KiB/s wr, 10 op/s 2023-05-08T07:31:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:23 smithi096 ceph-mon[124666]: pgmap v7323: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 81 KiB/s wr, 10 op/s 2023-05-08T07:31:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13622.872190 secs 2023-05-08T07:31:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13622.872190 secs 2023-05-08T07:31:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13622.872190 secs 2023-05-08T07:31:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13623.430259 secs 2023-05-08T07:31:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:25 smithi186 ceph-mon[126480]: pgmap v7324: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 81 KiB/s wr, 9 op/s 2023-05-08T07:31:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13623.430259 secs 2023-05-08T07:31:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:25 smithi133 ceph-mon[125939]: pgmap v7324: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 81 KiB/s wr, 9 op/s 2023-05-08T07:31:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13623.430259 secs 2023-05-08T07:31:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:25 smithi096 ceph-mon[124666]: pgmap v7324: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 81 KiB/s wr, 9 op/s 2023-05-08T07:31:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13624.712857 secs 2023-05-08T07:31:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13624.712857 secs 2023-05-08T07:31:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13624.712857 secs 2023-05-08T07:31:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:27 smithi186 ceph-mon[126480]: pgmap v7325: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 76 KiB/s wr, 10 op/s 2023-05-08T07:31:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:31:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:27 smithi133 ceph-mon[125939]: pgmap v7325: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 76 KiB/s wr, 10 op/s 2023-05-08T07:31:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:31:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:27 smithi096 ceph-mon[124666]: pgmap v7325: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 76 KiB/s wr, 10 op/s 2023-05-08T07:31:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:31:28.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:28 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:31:28.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:28 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:31:28.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:28 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:31:28.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:28 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:31:28.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:28 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:31:28.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:28 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:31:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:28 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:31:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:28 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:31:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:28 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:31:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:29 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:31:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:29 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T07:31:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:29 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T07:31:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:29 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:31:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:29 smithi186 ceph-mon[126480]: pgmap v7326: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 64 KiB/s wr, 8 op/s 2023-05-08T07:31:29.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13627.872313 secs 2023-05-08T07:31:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:29 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:31:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:29 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T07:31:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:29 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T07:31:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:29 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:31:29.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:29 smithi133 ceph-mon[125939]: pgmap v7326: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 64 KiB/s wr, 8 op/s 2023-05-08T07:31:29.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13627.872313 secs 2023-05-08T07:31:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:29 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:31:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:29 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T07:31:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:29 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T07:31:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:29 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:31:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:29 smithi096 ceph-mon[124666]: pgmap v7326: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 64 KiB/s wr, 8 op/s 2023-05-08T07:31:29.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13627.872313 secs 2023-05-08T07:31:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13628.430401 secs 2023-05-08T07:31:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13628.430401 secs 2023-05-08T07:31:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13628.430401 secs 2023-05-08T07:31:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13629.712937 secs 2023-05-08T07:31:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:31 smithi186 ceph-mon[126480]: pgmap v7327: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 64 KiB/s wr, 11 op/s 2023-05-08T07:31:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13629.712937 secs 2023-05-08T07:31:31.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:31 smithi133 ceph-mon[125939]: pgmap v7327: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 64 KiB/s wr, 11 op/s 2023-05-08T07:31:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13629.712937 secs 2023-05-08T07:31:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:31 smithi096 ceph-mon[124666]: pgmap v7327: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 64 KiB/s wr, 11 op/s 2023-05-08T07:31:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:33 smithi186 ceph-mon[126480]: pgmap v7328: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 40 KiB/s wr, 7 op/s 2023-05-08T07:31:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:33 smithi133 ceph-mon[125939]: pgmap v7328: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 40 KiB/s wr, 7 op/s 2023-05-08T07:31:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:33 smithi096 ceph-mon[124666]: pgmap v7328: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 40 KiB/s wr, 7 op/s 2023-05-08T07:31:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13632.872434 secs 2023-05-08T07:31:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13632.872434 secs 2023-05-08T07:31:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13632.872434 secs 2023-05-08T07:31:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13633.430542 secs 2023-05-08T07:31:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:35 smithi186 ceph-mon[126480]: pgmap v7329: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 78 KiB/s wr, 8 op/s 2023-05-08T07:31:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13633.430542 secs 2023-05-08T07:31:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:35 smithi133 ceph-mon[125939]: pgmap v7329: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 78 KiB/s wr, 8 op/s 2023-05-08T07:31:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13633.430542 secs 2023-05-08T07:31:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:35 smithi096 ceph-mon[124666]: pgmap v7329: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 78 KiB/s wr, 8 op/s 2023-05-08T07:31:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13634.713036 secs 2023-05-08T07:31:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13634.713036 secs 2023-05-08T07:31:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13634.713036 secs 2023-05-08T07:31:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:37 smithi186 ceph-mon[126480]: pgmap v7330: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 39 KiB/s wr, 7 op/s 2023-05-08T07:31:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:37 smithi133 ceph-mon[125939]: pgmap v7330: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 39 KiB/s wr, 7 op/s 2023-05-08T07:31:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:37 smithi096 ceph-mon[124666]: pgmap v7330: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 39 KiB/s wr, 7 op/s 2023-05-08T07:31:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:39 smithi186 ceph-mon[126480]: pgmap v7331: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 39 KiB/s wr, 6 op/s 2023-05-08T07:31:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13637.872547 secs 2023-05-08T07:31:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:39 smithi133 ceph-mon[125939]: pgmap v7331: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 39 KiB/s wr, 6 op/s 2023-05-08T07:31:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13637.872547 secs 2023-05-08T07:31:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:39 smithi096 ceph-mon[124666]: pgmap v7331: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 39 KiB/s wr, 6 op/s 2023-05-08T07:31:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13637.872547 secs 2023-05-08T07:31:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13638.430656 secs 2023-05-08T07:31:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13638.430656 secs 2023-05-08T07:31:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13638.430656 secs 2023-05-08T07:31:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:41 smithi186 ceph-mon[126480]: pgmap v7332: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 40 KiB/s wr, 9 op/s 2023-05-08T07:31:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:41 smithi133 ceph-mon[125939]: pgmap v7332: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 40 KiB/s wr, 9 op/s 2023-05-08T07:31:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:41 smithi096 ceph-mon[124666]: pgmap v7332: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 40 KiB/s wr, 9 op/s 2023-05-08T07:31:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:43 smithi186 ceph-mon[126480]: pgmap v7333: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 39 KiB/s wr, 5 op/s 2023-05-08T07:31:43.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:31:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:43 smithi133 ceph-mon[125939]: pgmap v7333: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 39 KiB/s wr, 5 op/s 2023-05-08T07:31:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:31:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:43 smithi096 ceph-mon[124666]: pgmap v7333: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 39 KiB/s wr, 5 op/s 2023-05-08T07:31:43.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:31:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13642.872640 secs 2023-05-08T07:31:44.647 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:31:44.647 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:31:44.647 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:31:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13642.872640 secs 2023-05-08T07:31:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:31:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:31:44.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:31:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13642.872640 secs 2023-05-08T07:31:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:31:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:31:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:31:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13643.430771 secs 2023-05-08T07:31:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:45 smithi186 ceph-mon[126480]: pgmap v7334: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 80 KiB/s wr, 7 op/s 2023-05-08T07:31:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13643.430771 secs 2023-05-08T07:31:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:45 smithi133 ceph-mon[125939]: pgmap v7334: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 80 KiB/s wr, 7 op/s 2023-05-08T07:31:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13643.430771 secs 2023-05-08T07:31:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:45 smithi096 ceph-mon[124666]: pgmap v7334: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 80 KiB/s wr, 7 op/s 2023-05-08T07:31:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:47 smithi186 ceph-mon[126480]: pgmap v7335: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 41 KiB/s wr, 7 op/s 2023-05-08T07:31:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:47 smithi133 ceph-mon[125939]: pgmap v7335: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 41 KiB/s wr, 7 op/s 2023-05-08T07:31:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:47 smithi096 ceph-mon[124666]: pgmap v7335: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 41 KiB/s wr, 7 op/s 2023-05-08T07:31:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:49 smithi186 ceph-mon[126480]: pgmap v7336: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 41 KiB/s wr, 6 op/s 2023-05-08T07:31:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13647.872754 secs 2023-05-08T07:31:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:49 smithi133 ceph-mon[125939]: pgmap v7336: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 41 KiB/s wr, 6 op/s 2023-05-08T07:31:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13647.872754 secs 2023-05-08T07:31:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:49 smithi096 ceph-mon[124666]: pgmap v7336: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 41 KiB/s wr, 6 op/s 2023-05-08T07:31:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13647.872754 secs 2023-05-08T07:31:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:51 smithi186 ceph-mon[126480]: pgmap v7337: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 170 KiB/s wr, 10 op/s 2023-05-08T07:31:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:31:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:51 smithi133 ceph-mon[125939]: pgmap v7337: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 170 KiB/s wr, 10 op/s 2023-05-08T07:31:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:31:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:51 smithi096 ceph-mon[124666]: pgmap v7337: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 170 KiB/s wr, 10 op/s 2023-05-08T07:31:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:31:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:52 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:31:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:31:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:31:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:52 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:31:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:31:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:31:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:52 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:31:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:31:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:31:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:53 smithi186 ceph-mon[126480]: pgmap v7338: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 170 KiB/s wr, 7 op/s 2023-05-08T07:31:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:53 smithi133 ceph-mon[125939]: pgmap v7338: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 170 KiB/s wr, 7 op/s 2023-05-08T07:31:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:53 smithi096 ceph-mon[124666]: pgmap v7338: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 170 KiB/s wr, 7 op/s 2023-05-08T07:31:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13652.872882 secs 2023-05-08T07:31:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13652.872882 secs 2023-05-08T07:31:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13652.872882 secs 2023-05-08T07:31:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:55 smithi186 ceph-mon[126480]: pgmap v7339: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 276 KiB/s wr, 10 op/s 2023-05-08T07:31:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:55 smithi133 ceph-mon[125939]: pgmap v7339: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 276 KiB/s wr, 10 op/s 2023-05-08T07:31:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:55 smithi096 ceph-mon[124666]: pgmap v7339: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 276 KiB/s wr, 10 op/s 2023-05-08T07:31:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:57 smithi186 ceph-mon[126480]: pgmap v7340: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 255 KiB/s rd, 242 KiB/s wr, 10 op/s 2023-05-08T07:31:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:57 smithi133 ceph-mon[125939]: pgmap v7340: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 255 KiB/s rd, 242 KiB/s wr, 10 op/s 2023-05-08T07:31:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:57 smithi096 ceph-mon[124666]: pgmap v7340: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 255 KiB/s rd, 242 KiB/s wr, 10 op/s 2023-05-08T07:31:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:59 smithi186 ceph-mon[126480]: pgmap v7341: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 242 KiB/s wr, 9 op/s 2023-05-08T07:31:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:31:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13657.873019 secs 2023-05-08T07:31:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:59 smithi133 ceph-mon[125939]: pgmap v7341: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 242 KiB/s wr, 9 op/s 2023-05-08T07:31:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:31:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13657.873019 secs 2023-05-08T07:31:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:59 smithi096 ceph-mon[124666]: pgmap v7341: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 242 KiB/s wr, 9 op/s 2023-05-08T07:31:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:31:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13657.873019 secs 2023-05-08T07:32:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13658.431094 secs 2023-05-08T07:32:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:00 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:32:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:32:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:32:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13658.431094 secs 2023-05-08T07:32:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:00 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:32:00.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:32:00.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:32:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13658.431094 secs 2023-05-08T07:32:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:00 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:32:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:32:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:32:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:01 smithi133 ceph-mon[125939]: pgmap v7342: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 293 KiB/s wr, 13 op/s 2023-05-08T07:32:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:01 smithi096 ceph-mon[124666]: pgmap v7342: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 293 KiB/s wr, 13 op/s 2023-05-08T07:32:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:01 smithi186 ceph-mon[126480]: pgmap v7342: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 293 KiB/s wr, 13 op/s 2023-05-08T07:32:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:03 smithi133 ceph-mon[125939]: pgmap v7343: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 165 KiB/s wr, 9 op/s 2023-05-08T07:32:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:03 smithi096 ceph-mon[124666]: pgmap v7343: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 165 KiB/s wr, 9 op/s 2023-05-08T07:32:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:03 smithi186 ceph-mon[126480]: pgmap v7343: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 165 KiB/s wr, 9 op/s 2023-05-08T07:32:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13662.873160 secs 2023-05-08T07:32:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13662.873160 secs 2023-05-08T07:32:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13662.873160 secs 2023-05-08T07:32:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13663.431200 secs 2023-05-08T07:32:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:05 smithi133 ceph-mon[125939]: pgmap v7344: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 299 KiB/s wr, 24 op/s 2023-05-08T07:32:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13663.431200 secs 2023-05-08T07:32:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:05 smithi096 ceph-mon[124666]: pgmap v7344: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 299 KiB/s wr, 24 op/s 2023-05-08T07:32:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13663.431200 secs 2023-05-08T07:32:05.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:05 smithi186 ceph-mon[126480]: pgmap v7344: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 299 KiB/s wr, 24 op/s 2023-05-08T07:32:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:07 smithi133 ceph-mon[125939]: pgmap v7345: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 193 KiB/s wr, 23 op/s 2023-05-08T07:32:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:07 smithi096 ceph-mon[124666]: pgmap v7345: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 193 KiB/s wr, 23 op/s 2023-05-08T07:32:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:07 smithi186 ceph-mon[126480]: pgmap v7345: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 193 KiB/s wr, 23 op/s 2023-05-08T07:32:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13667.873258 secs 2023-05-08T07:32:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:09 smithi133 ceph-mon[125939]: pgmap v7346: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 187 KiB/s wr, 21 op/s 2023-05-08T07:32:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13667.873258 secs 2023-05-08T07:32:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:09 smithi096 ceph-mon[124666]: pgmap v7346: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 187 KiB/s wr, 21 op/s 2023-05-08T07:32:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13667.873258 secs 2023-05-08T07:32:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:09 smithi186 ceph-mon[126480]: pgmap v7346: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 187 KiB/s wr, 21 op/s 2023-05-08T07:32:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:11 smithi133 ceph-mon[125939]: pgmap v7347: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 322 KiB/s wr, 25 op/s 2023-05-08T07:32:11.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:11 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:32:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:11 smithi096 ceph-mon[124666]: pgmap v7347: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 322 KiB/s wr, 25 op/s 2023-05-08T07:32:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:11 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:32:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:11 smithi186 ceph-mon[126480]: pgmap v7347: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 322 KiB/s wr, 25 op/s 2023-05-08T07:32:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:11 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:32:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:12 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:32:12.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:12 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:32:12.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:12 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:32:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:12 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:32:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:12 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:32:12.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:12 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:32:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:12 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:32:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:12 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:32:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:12 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:32:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:13 smithi133 ceph-mon[125939]: pgmap v7348: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 270 KiB/s wr, 21 op/s 2023-05-08T07:32:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:13 smithi096 ceph-mon[124666]: pgmap v7348: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 270 KiB/s wr, 21 op/s 2023-05-08T07:32:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:13 smithi186 ceph-mon[126480]: pgmap v7348: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 270 KiB/s wr, 21 op/s 2023-05-08T07:32:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13672.873385 secs 2023-05-08T07:32:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13672.873385 secs 2023-05-08T07:32:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13672.873385 secs 2023-05-08T07:32:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:15 smithi133 ceph-mon[125939]: pgmap v7349: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 270 KiB/s wr, 22 op/s 2023-05-08T07:32:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:15 smithi096 ceph-mon[124666]: pgmap v7349: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 270 KiB/s wr, 22 op/s 2023-05-08T07:32:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:15 smithi186 ceph-mon[126480]: pgmap v7349: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 270 KiB/s wr, 22 op/s 2023-05-08T07:32:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:17 smithi133 ceph-mon[125939]: pgmap v7350: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 163 KiB/s wr, 9 op/s 2023-05-08T07:32:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:17 smithi096 ceph-mon[124666]: pgmap v7350: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 163 KiB/s wr, 9 op/s 2023-05-08T07:32:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:17 smithi186 ceph-mon[126480]: pgmap v7350: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 163 KiB/s wr, 9 op/s 2023-05-08T07:32:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13677.873502 secs 2023-05-08T07:32:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:19 smithi133 ceph-mon[125939]: pgmap v7351: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 162 KiB/s wr, 7 op/s 2023-05-08T07:32:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13677.873502 secs 2023-05-08T07:32:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:19 smithi096 ceph-mon[124666]: pgmap v7351: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 162 KiB/s wr, 7 op/s 2023-05-08T07:32:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13677.873502 secs 2023-05-08T07:32:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:19 smithi186 ceph-mon[126480]: pgmap v7351: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 162 KiB/s wr, 7 op/s 2023-05-08T07:32:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:21 smithi133 ceph-mon[125939]: pgmap v7352: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 163 KiB/s wr, 10 op/s 2023-05-08T07:32:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:21 smithi096 ceph-mon[124666]: pgmap v7352: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 163 KiB/s wr, 10 op/s 2023-05-08T07:32:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:21 smithi186 ceph-mon[126480]: pgmap v7352: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 163 KiB/s wr, 10 op/s 2023-05-08T07:32:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:23 smithi133 ceph-mon[125939]: pgmap v7353: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 KiB/s wr, 5 op/s 2023-05-08T07:32:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:23 smithi096 ceph-mon[124666]: pgmap v7353: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 KiB/s wr, 5 op/s 2023-05-08T07:32:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:23 smithi186 ceph-mon[126480]: pgmap v7353: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 KiB/s wr, 5 op/s 2023-05-08T07:32:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13682.873564 secs 2023-05-08T07:32:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13682.873564 secs 2023-05-08T07:32:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13682.873564 secs 2023-05-08T07:32:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13683.431711 secs 2023-05-08T07:32:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:25 smithi133 ceph-mon[125939]: pgmap v7354: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 49 KiB/s wr, 9 op/s 2023-05-08T07:32:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13683.431711 secs 2023-05-08T07:32:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:25 smithi096 ceph-mon[124666]: pgmap v7354: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 49 KiB/s wr, 9 op/s 2023-05-08T07:32:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13683.431711 secs 2023-05-08T07:32:25.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:25 smithi186 ceph-mon[126480]: pgmap v7354: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 49 KiB/s wr, 9 op/s 2023-05-08T07:32:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13684.714227 secs 2023-05-08T07:32:26.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:26 smithi133 ceph-mon[125939]: osdmap e536: 12 total, 12 up, 12 in 2023-05-08T07:32:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13684.714227 secs 2023-05-08T07:32:26.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:26 smithi096 ceph-mon[124666]: osdmap e536: 12 total, 12 up, 12 in 2023-05-08T07:32:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13684.714227 secs 2023-05-08T07:32:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:26 smithi186 ceph-mon[126480]: osdmap e536: 12 total, 12 up, 12 in 2023-05-08T07:32:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:27 smithi133 ceph-mon[125939]: pgmap v7356: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 166 KiB/s wr, 10 op/s 2023-05-08T07:32:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:27 smithi096 ceph-mon[124666]: pgmap v7356: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 166 KiB/s wr, 10 op/s 2023-05-08T07:32:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:27 smithi186 ceph-mon[126480]: pgmap v7356: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 166 KiB/s wr, 10 op/s 2023-05-08T07:32:28.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:28 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:32:28.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:28 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:32:28.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:28 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:32:28.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:28 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:32:28.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:28 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:32:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:28 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:32:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:28 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:32:28.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:28 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:32:28.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:28 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:32:28.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:28 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:32:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:28 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:32:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:28 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:32:28.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:28 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:32:28.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:28 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:32:28.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:28 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:32:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13687.873679 secs 2023-05-08T07:32:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:29 smithi133 ceph-mon[125939]: pgmap v7357: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 166 KiB/s wr, 10 op/s 2023-05-08T07:32:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:29 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:32:29.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:29 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:32:29.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:29 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:32:29.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:29 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:32:29.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:29 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T07:32:29.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:29 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T07:32:29.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:29 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:32:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13687.873679 secs 2023-05-08T07:32:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:29 smithi096 ceph-mon[124666]: pgmap v7357: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 166 KiB/s wr, 10 op/s 2023-05-08T07:32:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:29 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:32:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:29 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:32:29.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:29 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:32:29.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:29 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:32:29.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:29 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T07:32:29.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:29 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T07:32:29.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:29 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:32:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13687.873679 secs 2023-05-08T07:32:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:29 smithi186 ceph-mon[126480]: pgmap v7357: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 166 KiB/s wr, 10 op/s 2023-05-08T07:32:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:29 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:32:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:29 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:32:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:29 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:32:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:29 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:32:29.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:29 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T07:32:29.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:29 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T07:32:29.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:29 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:32:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13688.431787 secs 2023-05-08T07:32:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13688.431787 secs 2023-05-08T07:32:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13688.431787 secs 2023-05-08T07:32:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13689.714350 secs 2023-05-08T07:32:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:31 smithi133 ceph-mon[125939]: pgmap v7358: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 267 KiB/s wr, 12 op/s 2023-05-08T07:32:31.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:31 smithi133 ceph-mon[125939]: osdmap e537: 12 total, 12 up, 12 in 2023-05-08T07:32:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13689.714350 secs 2023-05-08T07:32:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:31 smithi096 ceph-mon[124666]: pgmap v7358: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 267 KiB/s wr, 12 op/s 2023-05-08T07:32:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:31 smithi096 ceph-mon[124666]: osdmap e537: 12 total, 12 up, 12 in 2023-05-08T07:32:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13689.714350 secs 2023-05-08T07:32:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:31 smithi186 ceph-mon[126480]: pgmap v7358: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 267 KiB/s wr, 12 op/s 2023-05-08T07:32:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:31 smithi186 ceph-mon[126480]: osdmap e537: 12 total, 12 up, 12 in 2023-05-08T07:32:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:33 smithi133 ceph-mon[125939]: pgmap v7360: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 301 KiB/s wr, 10 op/s 2023-05-08T07:32:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:33 smithi096 ceph-mon[124666]: pgmap v7360: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 301 KiB/s wr, 10 op/s 2023-05-08T07:32:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:33 smithi186 ceph-mon[126480]: pgmap v7360: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 301 KiB/s wr, 10 op/s 2023-05-08T07:32:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13692.873795 secs 2023-05-08T07:32:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13692.873795 secs 2023-05-08T07:32:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13692.873795 secs 2023-05-08T07:32:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13693.431912 secs 2023-05-08T07:32:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:35 smithi133 ceph-mon[125939]: pgmap v7361: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 117 KiB/s wr, 7 op/s 2023-05-08T07:32:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13693.431912 secs 2023-05-08T07:32:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:35 smithi096 ceph-mon[124666]: pgmap v7361: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 117 KiB/s wr, 7 op/s 2023-05-08T07:32:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13693.431912 secs 2023-05-08T07:32:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:35 smithi186 ceph-mon[126480]: pgmap v7361: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 117 KiB/s wr, 7 op/s 2023-05-08T07:32:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13694.714471 secs 2023-05-08T07:32:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13694.714471 secs 2023-05-08T07:32:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13694.714471 secs 2023-05-08T07:32:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:37 smithi096 ceph-mon[124666]: pgmap v7362: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 102 KiB/s wr, 8 op/s 2023-05-08T07:32:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:37 smithi186 ceph-mon[126480]: pgmap v7362: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 102 KiB/s wr, 8 op/s 2023-05-08T07:32:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:37 smithi133 ceph-mon[125939]: pgmap v7362: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 102 KiB/s wr, 8 op/s 2023-05-08T07:32:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13697.873907 secs 2023-05-08T07:32:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:39 smithi096 ceph-mon[124666]: pgmap v7363: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 102 KiB/s wr, 8 op/s 2023-05-08T07:32:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13697.873907 secs 2023-05-08T07:32:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:39 smithi186 ceph-mon[126480]: pgmap v7363: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 102 KiB/s wr, 8 op/s 2023-05-08T07:32:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13697.873907 secs 2023-05-08T07:32:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:39 smithi133 ceph-mon[125939]: pgmap v7363: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 102 KiB/s wr, 8 op/s 2023-05-08T07:32:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13698.432005 secs 2023-05-08T07:32:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13698.432005 secs 2023-05-08T07:32:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13698.432005 secs 2023-05-08T07:32:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:41 smithi096 ceph-mon[124666]: pgmap v7364: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 163 KiB/s wr, 7 op/s 2023-05-08T07:32:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:41 smithi186 ceph-mon[126480]: pgmap v7364: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 163 KiB/s wr, 7 op/s 2023-05-08T07:32:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:41 smithi133 ceph-mon[125939]: pgmap v7364: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 163 KiB/s wr, 7 op/s 2023-05-08T07:32:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:43 smithi096 ceph-mon[124666]: pgmap v7365: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 149 KiB/s wr, 7 op/s 2023-05-08T07:32:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:32:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:43 smithi186 ceph-mon[126480]: pgmap v7365: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 149 KiB/s wr, 7 op/s 2023-05-08T07:32:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:32:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:43 smithi133 ceph-mon[125939]: pgmap v7365: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 149 KiB/s wr, 7 op/s 2023-05-08T07:32:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:32:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13702.874025 secs 2023-05-08T07:32:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:32:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:32:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:32:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13702.874025 secs 2023-05-08T07:32:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:32:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:32:44.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:32:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13702.874025 secs 2023-05-08T07:32:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:32:45.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:32:45.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:32:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13703.432112 secs 2023-05-08T07:32:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:45 smithi186 ceph-mon[126480]: pgmap v7366: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 142 KiB/s wr, 8 op/s 2023-05-08T07:32:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13703.432112 secs 2023-05-08T07:32:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:45 smithi133 ceph-mon[125939]: pgmap v7366: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 142 KiB/s wr, 8 op/s 2023-05-08T07:32:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13703.432112 secs 2023-05-08T07:32:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:45 smithi096 ceph-mon[124666]: pgmap v7366: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 142 KiB/s wr, 8 op/s 2023-05-08T07:32:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:47 smithi186 ceph-mon[126480]: pgmap v7367: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 152 KiB/s wr, 9 op/s 2023-05-08T07:32:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:47 smithi133 ceph-mon[125939]: pgmap v7367: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 152 KiB/s wr, 9 op/s 2023-05-08T07:32:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:47 smithi096 ceph-mon[124666]: pgmap v7367: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 152 KiB/s wr, 9 op/s 2023-05-08T07:32:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13707.874144 secs 2023-05-08T07:32:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:49 smithi186 ceph-mon[126480]: pgmap v7368: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 151 KiB/s wr, 8 op/s 2023-05-08T07:32:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13707.874144 secs 2023-05-08T07:32:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:49 smithi133 ceph-mon[125939]: pgmap v7368: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 151 KiB/s wr, 8 op/s 2023-05-08T07:32:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13707.874144 secs 2023-05-08T07:32:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:49 smithi096 ceph-mon[124666]: pgmap v7368: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 151 KiB/s wr, 8 op/s 2023-05-08T07:32:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:51 smithi186 ceph-mon[126480]: pgmap v7369: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 311 KiB/s rd, 297 KiB/s wr, 13 op/s 2023-05-08T07:32:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:32:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:51 smithi133 ceph-mon[125939]: pgmap v7369: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 311 KiB/s rd, 297 KiB/s wr, 13 op/s 2023-05-08T07:32:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:32:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:51 smithi096 ceph-mon[124666]: pgmap v7369: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 311 KiB/s rd, 297 KiB/s wr, 13 op/s 2023-05-08T07:32:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:32:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:52 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:32:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:32:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:32:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:52 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:32:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:32:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:32:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:52 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:32:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:32:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:32:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:53 smithi186 ceph-mon[126480]: pgmap v7370: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 163 KiB/s wr, 9 op/s 2023-05-08T07:32:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:53 smithi133 ceph-mon[125939]: pgmap v7370: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 163 KiB/s wr, 9 op/s 2023-05-08T07:32:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:53 smithi096 ceph-mon[124666]: pgmap v7370: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 163 KiB/s wr, 9 op/s 2023-05-08T07:32:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:54 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:32:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:54 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:32:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:54 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:32:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13713.432304 secs 2023-05-08T07:32:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:55 smithi186 ceph-mon[126480]: pgmap v7371: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 163 KiB/s wr, 11 op/s 2023-05-08T07:32:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:55 smithi186 ceph-mon[126480]: Health check cleared: MDS_SLOW_REQUEST (was: 1 MDSs report slow requests) 2023-05-08T07:32:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:55 smithi186 ceph-mon[126480]: Cluster is now healthy 2023-05-08T07:32:55.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:55 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T07:32:55.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:55 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:32:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13713.432304 secs 2023-05-08T07:32:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:55 smithi133 ceph-mon[125939]: pgmap v7371: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 163 KiB/s wr, 11 op/s 2023-05-08T07:32:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:55 smithi133 ceph-mon[125939]: Health check cleared: MDS_SLOW_REQUEST (was: 1 MDSs report slow requests) 2023-05-08T07:32:55.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:55 smithi133 ceph-mon[125939]: Cluster is now healthy 2023-05-08T07:32:55.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:55 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T07:32:55.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:55 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:32:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13713.432304 secs 2023-05-08T07:32:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:55 smithi096 ceph-mon[124666]: pgmap v7371: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 163 KiB/s wr, 11 op/s 2023-05-08T07:32:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:55 smithi096 ceph-mon[124666]: Health check cleared: MDS_SLOW_REQUEST (was: 1 MDSs report slow requests) 2023-05-08T07:32:56.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:55 smithi096 ceph-mon[124666]: Cluster is now healthy 2023-05-08T07:32:56.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:55 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T07:32:56.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:55 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:32:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:56 smithi186 ceph-mon[126480]: Health check failed: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:32:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:32:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:32:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:56 smithi133 ceph-mon[125939]: Health check failed: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:32:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:32:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:32:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:56 smithi096 ceph-mon[124666]: Health check failed: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:32:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:32:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:32:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:57 smithi186 ceph-mon[126480]: pgmap v7372: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 246 KiB/s wr, 11 op/s 2023-05-08T07:32:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:57 smithi133 ceph-mon[125939]: pgmap v7372: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 246 KiB/s wr, 11 op/s 2023-05-08T07:32:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:57 smithi096 ceph-mon[124666]: pgmap v7372: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 246 KiB/s wr, 11 op/s 2023-05-08T07:32:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13717.874424 secs 2023-05-08T07:32:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:59 smithi186 ceph-mon[126480]: pgmap v7373: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 236 KiB/s wr, 9 op/s 2023-05-08T07:32:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:32:59 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:32:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13717.874424 secs 2023-05-08T07:32:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:59 smithi133 ceph-mon[125939]: pgmap v7373: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 236 KiB/s wr, 9 op/s 2023-05-08T07:32:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:32:59 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:33:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13717.874424 secs 2023-05-08T07:33:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:59 smithi096 ceph-mon[124666]: pgmap v7373: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 236 KiB/s wr, 9 op/s 2023-05-08T07:33:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:32:59 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:33:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:00 smithi186 ceph-mon[126480]: Health check cleared: MDS_SLOW_REQUEST (was: 1 MDSs report slow requests) 2023-05-08T07:33:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:00 smithi186 ceph-mon[126480]: Cluster is now healthy 2023-05-08T07:33:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:33:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:33:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:00 smithi133 ceph-mon[125939]: Health check cleared: MDS_SLOW_REQUEST (was: 1 MDSs report slow requests) 2023-05-08T07:33:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:00 smithi133 ceph-mon[125939]: Cluster is now healthy 2023-05-08T07:33:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:33:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:33:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:00 smithi096 ceph-mon[124666]: Health check cleared: MDS_SLOW_REQUEST (was: 1 MDSs report slow requests) 2023-05-08T07:33:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:00 smithi096 ceph-mon[124666]: Cluster is now healthy 2023-05-08T07:33:01.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:33:01.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:33:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13719.715103 secs 2023-05-08T07:33:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:01 smithi186 ceph-mon[126480]: pgmap v7374: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 421 KiB/s wr, 14 op/s 2023-05-08T07:33:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13719.715103 secs 2023-05-08T07:33:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:01 smithi133 ceph-mon[125939]: pgmap v7374: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 421 KiB/s wr, 14 op/s 2023-05-08T07:33:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13719.715103 secs 2023-05-08T07:33:02.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:01 smithi096 ceph-mon[124666]: pgmap v7374: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 421 KiB/s wr, 14 op/s 2023-05-08T07:33:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:02 smithi133 ceph-mon[125939]: Health check failed: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:33:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T07:33:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:33:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:02 smithi096 ceph-mon[124666]: Health check failed: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:33:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T07:33:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:33:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:02 smithi186 ceph-mon[126480]: Health check failed: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:33:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T07:33:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:33:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:03 smithi133 ceph-mon[125939]: pgmap v7375: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 275 KiB/s wr, 9 op/s 2023-05-08T07:33:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:03 smithi096 ceph-mon[124666]: pgmap v7375: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 275 KiB/s wr, 9 op/s 2023-05-08T07:33:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:03 smithi186 ceph-mon[126480]: pgmap v7375: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 275 KiB/s wr, 9 op/s 2023-05-08T07:33:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13722.874518 secs 2023-05-08T07:33:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:04 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:33:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:04 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:33:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13723.432538 secs 2023-05-08T07:33:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13722.874518 secs 2023-05-08T07:33:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:04 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:33:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:04 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:33:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13723.432538 secs 2023-05-08T07:33:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13722.874518 secs 2023-05-08T07:33:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:04 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:33:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:04 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:33:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13723.432538 secs 2023-05-08T07:33:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:05 smithi133 ceph-mon[125939]: pgmap v7376: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 319 KiB/s wr, 25 op/s 2023-05-08T07:33:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:05 smithi096 ceph-mon[124666]: pgmap v7376: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 319 KiB/s wr, 25 op/s 2023-05-08T07:33:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:05 smithi186 ceph-mon[126480]: pgmap v7376: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 319 KiB/s wr, 25 op/s 2023-05-08T07:33:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13724.715227 secs 2023-05-08T07:33:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13724.715227 secs 2023-05-08T07:33:07.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13724.715227 secs 2023-05-08T07:33:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:07 smithi133 ceph-mon[125939]: pgmap v7377: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 320 KiB/s wr, 26 op/s 2023-05-08T07:33:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:07 smithi096 ceph-mon[124666]: pgmap v7377: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 320 KiB/s wr, 26 op/s 2023-05-08T07:33:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:07 smithi186 ceph-mon[126480]: pgmap v7377: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 320 KiB/s wr, 26 op/s 2023-05-08T07:33:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:08 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:33:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:33:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:33:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:08 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:33:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:33:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:33:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:08 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:33:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:33:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:33:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13727.874646 secs 2023-05-08T07:33:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:09 smithi133 ceph-mon[125939]: pgmap v7378: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 231 KiB/s wr, 23 op/s 2023-05-08T07:33:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13728.432658 secs 2023-05-08T07:33:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13727.874646 secs 2023-05-08T07:33:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:09 smithi096 ceph-mon[124666]: pgmap v7378: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 231 KiB/s wr, 23 op/s 2023-05-08T07:33:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13728.432658 secs 2023-05-08T07:33:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13727.874646 secs 2023-05-08T07:33:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:09 smithi186 ceph-mon[126480]: pgmap v7378: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 231 KiB/s wr, 23 op/s 2023-05-08T07:33:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13728.432658 secs 2023-05-08T07:33:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13729.715351 secs 2023-05-08T07:33:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:11 smithi133 ceph-mon[125939]: pgmap v7379: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 278 KiB/s wr, 27 op/s 2023-05-08T07:33:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:11 smithi133 ceph-mon[125939]: osdmap e538: 12 total, 12 up, 12 in 2023-05-08T07:33:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13729.715351 secs 2023-05-08T07:33:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:11 smithi096 ceph-mon[124666]: pgmap v7379: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 278 KiB/s wr, 27 op/s 2023-05-08T07:33:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:11 smithi096 ceph-mon[124666]: osdmap e538: 12 total, 12 up, 12 in 2023-05-08T07:33:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13729.715351 secs 2023-05-08T07:33:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:11 smithi186 ceph-mon[126480]: pgmap v7379: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 278 KiB/s wr, 27 op/s 2023-05-08T07:33:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:11 smithi186 ceph-mon[126480]: osdmap e538: 12 total, 12 up, 12 in 2023-05-08T07:33:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:13 smithi133 ceph-mon[125939]: pgmap v7381: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 112 KiB/s wr, 26 op/s 2023-05-08T07:33:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:13 smithi096 ceph-mon[124666]: pgmap v7381: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 112 KiB/s wr, 26 op/s 2023-05-08T07:33:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:13 smithi186 ceph-mon[126480]: pgmap v7381: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 112 KiB/s wr, 26 op/s 2023-05-08T07:33:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13732.874774 secs 2023-05-08T07:33:14.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13733.432776 secs 2023-05-08T07:33:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13732.874774 secs 2023-05-08T07:33:15.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13733.432776 secs 2023-05-08T07:33:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13732.874774 secs 2023-05-08T07:33:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13733.432776 secs 2023-05-08T07:33:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:15 smithi133 ceph-mon[125939]: pgmap v7382: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 59 KiB/s wr, 9 op/s 2023-05-08T07:33:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:15 smithi096 ceph-mon[124666]: pgmap v7382: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 59 KiB/s wr, 9 op/s 2023-05-08T07:33:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:15 smithi186 ceph-mon[126480]: pgmap v7382: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 59 KiB/s wr, 9 op/s 2023-05-08T07:33:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13734.715444 secs 2023-05-08T07:33:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13734.715444 secs 2023-05-08T07:33:17.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13734.715444 secs 2023-05-08T07:33:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:17 smithi133 ceph-mon[125939]: pgmap v7383: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 109 KiB/s wr, 9 op/s 2023-05-08T07:33:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:17 smithi096 ceph-mon[124666]: pgmap v7383: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 109 KiB/s wr, 9 op/s 2023-05-08T07:33:18.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:17 smithi186 ceph-mon[126480]: pgmap v7383: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 109 KiB/s wr, 9 op/s 2023-05-08T07:33:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13737.874885 secs 2023-05-08T07:33:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:19 smithi133 ceph-mon[125939]: pgmap v7384: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 109 KiB/s wr, 9 op/s 2023-05-08T07:33:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13738.432874 secs 2023-05-08T07:33:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13737.874885 secs 2023-05-08T07:33:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:19 smithi096 ceph-mon[124666]: pgmap v7384: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 109 KiB/s wr, 9 op/s 2023-05-08T07:33:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13738.432874 secs 2023-05-08T07:33:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13737.874885 secs 2023-05-08T07:33:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:19 smithi186 ceph-mon[126480]: pgmap v7384: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 109 KiB/s wr, 9 op/s 2023-05-08T07:33:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13738.432874 secs 2023-05-08T07:33:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13739.715566 secs 2023-05-08T07:33:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:21 smithi133 ceph-mon[125939]: pgmap v7385: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 80 KiB/s wr, 8 op/s 2023-05-08T07:33:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:21 smithi133 ceph-mon[125939]: osdmap e539: 12 total, 12 up, 12 in 2023-05-08T07:33:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13739.715566 secs 2023-05-08T07:33:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:21 smithi096 ceph-mon[124666]: pgmap v7385: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 80 KiB/s wr, 8 op/s 2023-05-08T07:33:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:21 smithi096 ceph-mon[124666]: osdmap e539: 12 total, 12 up, 12 in 2023-05-08T07:33:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13739.715566 secs 2023-05-08T07:33:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:21 smithi186 ceph-mon[126480]: pgmap v7385: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 80 KiB/s wr, 8 op/s 2023-05-08T07:33:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:21 smithi186 ceph-mon[126480]: osdmap e539: 12 total, 12 up, 12 in 2023-05-08T07:33:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:23 smithi133 ceph-mon[125939]: pgmap v7387: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 80 KiB/s wr, 8 op/s 2023-05-08T07:33:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:23 smithi096 ceph-mon[124666]: pgmap v7387: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 80 KiB/s wr, 8 op/s 2023-05-08T07:33:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:23 smithi186 ceph-mon[126480]: pgmap v7387: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 80 KiB/s wr, 8 op/s 2023-05-08T07:33:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13742.874994 secs 2023-05-08T07:33:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13743.433011 secs 2023-05-08T07:33:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13742.874994 secs 2023-05-08T07:33:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13743.433011 secs 2023-05-08T07:33:25.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13742.874994 secs 2023-05-08T07:33:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13743.433011 secs 2023-05-08T07:33:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:25 smithi133 ceph-mon[125939]: pgmap v7388: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 80 KiB/s wr, 8 op/s 2023-05-08T07:33:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:25 smithi096 ceph-mon[124666]: pgmap v7388: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 80 KiB/s wr, 8 op/s 2023-05-08T07:33:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:25 smithi186 ceph-mon[126480]: pgmap v7388: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 80 KiB/s wr, 8 op/s 2023-05-08T07:33:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13744.715722 secs 2023-05-08T07:33:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13744.715722 secs 2023-05-08T07:33:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13744.715722 secs 2023-05-08T07:33:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:27 smithi133 ceph-mon[125939]: pgmap v7389: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 114 KiB/s wr, 8 op/s 2023-05-08T07:33:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:27 smithi096 ceph-mon[124666]: pgmap v7389: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 114 KiB/s wr, 8 op/s 2023-05-08T07:33:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:27 smithi186 ceph-mon[126480]: pgmap v7389: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 114 KiB/s wr, 8 op/s 2023-05-08T07:33:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13747.875131 secs 2023-05-08T07:33:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:29 smithi133 ceph-mon[125939]: pgmap v7390: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 114 KiB/s wr, 8 op/s 2023-05-08T07:33:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13748.433140 secs 2023-05-08T07:33:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:29 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:33:29.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:29 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:33:29.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:29 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:33:29.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:29 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:33:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13747.875131 secs 2023-05-08T07:33:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:29 smithi096 ceph-mon[124666]: pgmap v7390: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 114 KiB/s wr, 8 op/s 2023-05-08T07:33:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13748.433140 secs 2023-05-08T07:33:30.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:29 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:33:30.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:29 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:33:30.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:29 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:33:30.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:29 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:33:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13747.875131 secs 2023-05-08T07:33:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:29 smithi186 ceph-mon[126480]: pgmap v7390: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 114 KiB/s wr, 8 op/s 2023-05-08T07:33:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13748.433140 secs 2023-05-08T07:33:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:29 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:33:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:29 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:33:30.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:29 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:33:30.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:29 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:33:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:30 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:33:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:30 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T07:33:30.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:30 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T07:33:30.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:30 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:33:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:30 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:33:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:30 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T07:33:31.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:30 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T07:33:31.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:30 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:33:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:30 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:33:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:30 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T07:33:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:30 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T07:33:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:30 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:33:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13749.715849 secs 2023-05-08T07:33:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:31 smithi133 ceph-mon[125939]: pgmap v7391: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 87 KiB/s wr, 9 op/s 2023-05-08T07:33:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13749.715849 secs 2023-05-08T07:33:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:31 smithi096 ceph-mon[124666]: pgmap v7391: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 87 KiB/s wr, 9 op/s 2023-05-08T07:33:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13749.715849 secs 2023-05-08T07:33:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:31 smithi186 ceph-mon[126480]: pgmap v7391: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 87 KiB/s wr, 9 op/s 2023-05-08T07:33:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:33 smithi133 ceph-mon[125939]: pgmap v7392: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 80 KiB/s wr, 8 op/s 2023-05-08T07:33:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:33 smithi096 ceph-mon[124666]: pgmap v7392: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 80 KiB/s wr, 8 op/s 2023-05-08T07:33:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:33 smithi186 ceph-mon[126480]: pgmap v7392: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 80 KiB/s wr, 8 op/s 2023-05-08T07:33:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13752.875267 secs 2023-05-08T07:33:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13753.433256 secs 2023-05-08T07:33:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13752.875267 secs 2023-05-08T07:33:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13753.433256 secs 2023-05-08T07:33:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13752.875267 secs 2023-05-08T07:33:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13753.433256 secs 2023-05-08T07:33:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:35 smithi096 ceph-mon[124666]: pgmap v7393: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 73 KiB/s wr, 8 op/s 2023-05-08T07:33:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:35 smithi186 ceph-mon[126480]: pgmap v7393: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 73 KiB/s wr, 8 op/s 2023-05-08T07:33:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:35 smithi133 ceph-mon[125939]: pgmap v7393: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 73 KiB/s wr, 8 op/s 2023-05-08T07:33:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13754.715996 secs 2023-05-08T07:33:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13754.715996 secs 2023-05-08T07:33:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13754.715996 secs 2023-05-08T07:33:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:37 smithi096 ceph-mon[124666]: pgmap v7394: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 164 KiB/s wr, 9 op/s 2023-05-08T07:33:38.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:37 smithi186 ceph-mon[126480]: pgmap v7394: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 164 KiB/s wr, 9 op/s 2023-05-08T07:33:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:37 smithi133 ceph-mon[125939]: pgmap v7394: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 164 KiB/s wr, 9 op/s 2023-05-08T07:33:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13757.875391 secs 2023-05-08T07:33:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:39 smithi186 ceph-mon[126480]: pgmap v7395: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 92 KiB/s wr, 7 op/s 2023-05-08T07:33:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13758.433368 secs 2023-05-08T07:33:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13757.875391 secs 2023-05-08T07:33:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:39 smithi133 ceph-mon[125939]: pgmap v7395: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 92 KiB/s wr, 7 op/s 2023-05-08T07:33:40.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13758.433368 secs 2023-05-08T07:33:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13757.875391 secs 2023-05-08T07:33:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:39 smithi096 ceph-mon[124666]: pgmap v7395: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 92 KiB/s wr, 7 op/s 2023-05-08T07:33:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13758.433368 secs 2023-05-08T07:33:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13759.716084 secs 2023-05-08T07:33:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:41 smithi186 ceph-mon[126480]: pgmap v7396: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 92 KiB/s wr, 10 op/s 2023-05-08T07:33:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13759.716084 secs 2023-05-08T07:33:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:41 smithi133 ceph-mon[125939]: pgmap v7396: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 92 KiB/s wr, 10 op/s 2023-05-08T07:33:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13759.716084 secs 2023-05-08T07:33:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:41 smithi096 ceph-mon[124666]: pgmap v7396: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 92 KiB/s wr, 10 op/s 2023-05-08T07:33:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:43 smithi186 ceph-mon[126480]: pgmap v7397: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 92 KiB/s wr, 6 op/s 2023-05-08T07:33:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:43 smithi133 ceph-mon[125939]: pgmap v7397: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 92 KiB/s wr, 6 op/s 2023-05-08T07:33:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:43 smithi096 ceph-mon[124666]: pgmap v7397: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 92 KiB/s wr, 6 op/s 2023-05-08T07:33:45.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13762.875515 secs 2023-05-08T07:33:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13763.433499 secs 2023-05-08T07:33:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13762.875515 secs 2023-05-08T07:33:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13763.433499 secs 2023-05-08T07:33:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13762.875515 secs 2023-05-08T07:33:45.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13763.433499 secs 2023-05-08T07:33:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:45 smithi186 ceph-mon[126480]: pgmap v7398: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 92 KiB/s wr, 7 op/s 2023-05-08T07:33:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:45 smithi133 ceph-mon[125939]: pgmap v7398: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 92 KiB/s wr, 7 op/s 2023-05-08T07:33:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:45 smithi096 ceph-mon[124666]: pgmap v7398: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 92 KiB/s wr, 7 op/s 2023-05-08T07:33:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:47 smithi186 ceph-mon[126480]: pgmap v7399: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 134 KiB/s wr, 8 op/s 2023-05-08T07:33:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:33:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:47 smithi133 ceph-mon[125939]: pgmap v7399: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 134 KiB/s wr, 8 op/s 2023-05-08T07:33:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:33:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:47 smithi096 ceph-mon[124666]: pgmap v7399: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 134 KiB/s wr, 8 op/s 2023-05-08T07:33:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:33:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:48 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:33:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:33:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:33:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:48 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:33:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:33:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:33:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:48 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:33:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:33:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:33:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13767.875636 secs 2023-05-08T07:33:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:49 smithi186 ceph-mon[126480]: pgmap v7400: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 42 KiB/s wr, 6 op/s 2023-05-08T07:33:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13767.875636 secs 2023-05-08T07:33:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:49 smithi133 ceph-mon[125939]: pgmap v7400: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 42 KiB/s wr, 6 op/s 2023-05-08T07:33:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13767.875636 secs 2023-05-08T07:33:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:49 smithi096 ceph-mon[124666]: pgmap v7400: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 42 KiB/s wr, 6 op/s 2023-05-08T07:33:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:51 smithi186 ceph-mon[126480]: pgmap v7401: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 128 KiB/s wr, 10 op/s 2023-05-08T07:33:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:33:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:51 smithi133 ceph-mon[125939]: pgmap v7401: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 128 KiB/s wr, 10 op/s 2023-05-08T07:33:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:33:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:51 smithi096 ceph-mon[124666]: pgmap v7401: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 128 KiB/s wr, 10 op/s 2023-05-08T07:33:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:33:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:33:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:33:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:33:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:33:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:33:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:33:53.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:53 smithi186 ceph-mon[126480]: pgmap v7402: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 127 KiB/s wr, 6 op/s 2023-05-08T07:33:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:53 smithi133 ceph-mon[125939]: pgmap v7402: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 127 KiB/s wr, 6 op/s 2023-05-08T07:33:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:53 smithi096 ceph-mon[124666]: pgmap v7402: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 127 KiB/s wr, 6 op/s 2023-05-08T07:33:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13772.875763 secs 2023-05-08T07:33:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13772.875763 secs 2023-05-08T07:33:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13772.875763 secs 2023-05-08T07:33:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13773.433736 secs 2023-05-08T07:33:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:55 smithi186 ceph-mon[126480]: pgmap v7403: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 200 KiB/s wr, 9 op/s 2023-05-08T07:33:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13773.433736 secs 2023-05-08T07:33:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:55 smithi133 ceph-mon[125939]: pgmap v7403: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 200 KiB/s wr, 9 op/s 2023-05-08T07:33:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13773.433736 secs 2023-05-08T07:33:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:55 smithi096 ceph-mon[124666]: pgmap v7403: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 200 KiB/s wr, 9 op/s 2023-05-08T07:33:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:56 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:33:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:33:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:33:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:56 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:33:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:33:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:33:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:56 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:33:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:33:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:33:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:57 smithi186 ceph-mon[126480]: pgmap v7404: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 310 KiB/s wr, 12 op/s 2023-05-08T07:33:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:57 smithi133 ceph-mon[125939]: pgmap v7404: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 310 KiB/s wr, 12 op/s 2023-05-08T07:33:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:57 smithi096 ceph-mon[124666]: pgmap v7404: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 310 KiB/s wr, 12 op/s 2023-05-08T07:33:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13777.875867 secs 2023-05-08T07:33:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:59 smithi186 ceph-mon[126480]: pgmap v7405: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 268 KiB/s wr, 10 op/s 2023-05-08T07:33:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:33:59 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:33:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13777.875867 secs 2023-05-08T07:33:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:59 smithi133 ceph-mon[125939]: pgmap v7405: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 268 KiB/s wr, 10 op/s 2023-05-08T07:33:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:33:59 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:33:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13777.875867 secs 2023-05-08T07:33:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:59 smithi096 ceph-mon[124666]: pgmap v7405: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 268 KiB/s wr, 10 op/s 2023-05-08T07:33:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:33:59 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:34:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:34:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:34:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:34:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:34:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:34:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:34:01.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:01 smithi186 ceph-mon[126480]: pgmap v7406: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 328 KiB/s wr, 15 op/s 2023-05-08T07:34:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:01 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:34:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:01 smithi133 ceph-mon[125939]: pgmap v7406: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 328 KiB/s wr, 15 op/s 2023-05-08T07:34:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:01 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:34:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:01 smithi096 ceph-mon[124666]: pgmap v7406: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 328 KiB/s wr, 15 op/s 2023-05-08T07:34:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:01 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:34:03.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:03 smithi186 ceph-mon[126480]: pgmap v7407: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 243 KiB/s wr, 11 op/s 2023-05-08T07:34:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:03 smithi133 ceph-mon[125939]: pgmap v7407: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 243 KiB/s wr, 11 op/s 2023-05-08T07:34:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:03 smithi096 ceph-mon[124666]: pgmap v7407: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 243 KiB/s wr, 11 op/s 2023-05-08T07:34:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13782.875986 secs 2023-05-08T07:34:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13782.875986 secs 2023-05-08T07:34:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13782.875986 secs 2023-05-08T07:34:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13783.433964 secs 2023-05-08T07:34:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:05 smithi186 ceph-mon[126480]: pgmap v7408: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 360 KiB/s wr, 28 op/s 2023-05-08T07:34:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13783.433964 secs 2023-05-08T07:34:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:05 smithi133 ceph-mon[125939]: pgmap v7408: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 360 KiB/s wr, 28 op/s 2023-05-08T07:34:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13783.433964 secs 2023-05-08T07:34:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:05 smithi096 ceph-mon[124666]: pgmap v7408: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 360 KiB/s wr, 28 op/s 2023-05-08T07:34:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13784.716637 secs 2023-05-08T07:34:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:06 smithi133 ceph-mon[125939]: osdmap e540: 12 total, 12 up, 12 in 2023-05-08T07:34:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13784.716637 secs 2023-05-08T07:34:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:06 smithi096 ceph-mon[124666]: osdmap e540: 12 total, 12 up, 12 in 2023-05-08T07:34:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13784.716637 secs 2023-05-08T07:34:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:06 smithi186 ceph-mon[126480]: osdmap e540: 12 total, 12 up, 12 in 2023-05-08T07:34:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:07 smithi133 ceph-mon[125939]: pgmap v7410: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 219 KiB/s wr, 28 op/s 2023-05-08T07:34:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:07 smithi096 ceph-mon[124666]: pgmap v7410: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 219 KiB/s wr, 28 op/s 2023-05-08T07:34:07.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:07 smithi186 ceph-mon[126480]: pgmap v7410: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 219 KiB/s wr, 28 op/s 2023-05-08T07:34:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:08 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:34:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:34:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:34:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:34:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:08 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:34:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:34:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:34:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:34:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:08 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:34:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:34:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:34:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:34:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13787.876118 secs 2023-05-08T07:34:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:09 smithi133 ceph-mon[125939]: pgmap v7411: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 219 KiB/s wr, 28 op/s 2023-05-08T07:34:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13787.876118 secs 2023-05-08T07:34:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:09 smithi096 ceph-mon[124666]: pgmap v7411: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 219 KiB/s wr, 28 op/s 2023-05-08T07:34:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13787.876118 secs 2023-05-08T07:34:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:09 smithi186 ceph-mon[126480]: pgmap v7411: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 219 KiB/s wr, 28 op/s 2023-05-08T07:34:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13788.434081 secs 2023-05-08T07:34:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13788.434081 secs 2023-05-08T07:34:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13788.434081 secs 2023-05-08T07:34:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13789.716756 secs 2023-05-08T07:34:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:11 smithi133 ceph-mon[125939]: pgmap v7412: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 193 KiB/s wr, 27 op/s 2023-05-08T07:34:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:11 smithi133 ceph-mon[125939]: osdmap e541: 12 total, 12 up, 12 in 2023-05-08T07:34:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13789.716756 secs 2023-05-08T07:34:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:11 smithi096 ceph-mon[124666]: pgmap v7412: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 193 KiB/s wr, 27 op/s 2023-05-08T07:34:11.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:11 smithi096 ceph-mon[124666]: osdmap e541: 12 total, 12 up, 12 in 2023-05-08T07:34:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13789.716756 secs 2023-05-08T07:34:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:11 smithi186 ceph-mon[126480]: pgmap v7412: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 193 KiB/s wr, 27 op/s 2023-05-08T07:34:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:11 smithi186 ceph-mon[126480]: osdmap e541: 12 total, 12 up, 12 in 2023-05-08T07:34:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:13 smithi133 ceph-mon[125939]: pgmap v7414: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 66 KiB/s wr, 8 op/s 2023-05-08T07:34:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:13 smithi096 ceph-mon[124666]: pgmap v7414: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 66 KiB/s wr, 8 op/s 2023-05-08T07:34:13.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:13 smithi186 ceph-mon[126480]: pgmap v7414: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 66 KiB/s wr, 8 op/s 2023-05-08T07:34:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13792.876262 secs 2023-05-08T07:34:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13792.876262 secs 2023-05-08T07:34:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13792.876262 secs 2023-05-08T07:34:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13793.434195 secs 2023-05-08T07:34:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:15 smithi133 ceph-mon[125939]: pgmap v7415: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 89 KiB/s wr, 9 op/s 2023-05-08T07:34:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13793.434195 secs 2023-05-08T07:34:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:15 smithi096 ceph-mon[124666]: pgmap v7415: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 89 KiB/s wr, 9 op/s 2023-05-08T07:34:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13793.434195 secs 2023-05-08T07:34:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:15 smithi186 ceph-mon[126480]: pgmap v7415: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 89 KiB/s wr, 9 op/s 2023-05-08T07:34:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13794.716849 secs 2023-05-08T07:34:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13794.716849 secs 2023-05-08T07:34:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13794.716849 secs 2023-05-08T07:34:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:17 smithi133 ceph-mon[125939]: pgmap v7416: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 78 KiB/s wr, 8 op/s 2023-05-08T07:34:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:17 smithi096 ceph-mon[124666]: pgmap v7416: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 78 KiB/s wr, 8 op/s 2023-05-08T07:34:17.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:17 smithi186 ceph-mon[126480]: pgmap v7416: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 78 KiB/s wr, 8 op/s 2023-05-08T07:34:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13797.876381 secs 2023-05-08T07:34:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:19 smithi133 ceph-mon[125939]: pgmap v7417: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 78 KiB/s wr, 8 op/s 2023-05-08T07:34:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13797.876381 secs 2023-05-08T07:34:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:19 smithi096 ceph-mon[124666]: pgmap v7417: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 78 KiB/s wr, 8 op/s 2023-05-08T07:34:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13797.876381 secs 2023-05-08T07:34:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:19 smithi186 ceph-mon[126480]: pgmap v7417: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 78 KiB/s wr, 8 op/s 2023-05-08T07:34:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13798.434328 secs 2023-05-08T07:34:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13798.434328 secs 2023-05-08T07:34:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13798.434328 secs 2023-05-08T07:34:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13799.716978 secs 2023-05-08T07:34:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:21 smithi133 ceph-mon[125939]: pgmap v7418: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T07:34:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13799.716978 secs 2023-05-08T07:34:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:21 smithi096 ceph-mon[124666]: pgmap v7418: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T07:34:21.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13799.716978 secs 2023-05-08T07:34:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:21 smithi186 ceph-mon[126480]: pgmap v7418: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T07:34:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:23 smithi133 ceph-mon[125939]: pgmap v7419: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 6 op/s 2023-05-08T07:34:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:23 smithi096 ceph-mon[124666]: pgmap v7419: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 6 op/s 2023-05-08T07:34:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:23 smithi186 ceph-mon[126480]: pgmap v7419: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 6 op/s 2023-05-08T07:34:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13802.876468 secs 2023-05-08T07:34:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13802.876468 secs 2023-05-08T07:34:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13802.876468 secs 2023-05-08T07:34:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13803.434464 secs 2023-05-08T07:34:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:25 smithi133 ceph-mon[125939]: pgmap v7420: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 KiB/s wr, 7 op/s 2023-05-08T07:34:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13803.434464 secs 2023-05-08T07:34:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:25 smithi096 ceph-mon[124666]: pgmap v7420: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 KiB/s wr, 7 op/s 2023-05-08T07:34:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13803.434464 secs 2023-05-08T07:34:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:25 smithi186 ceph-mon[126480]: pgmap v7420: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 KiB/s wr, 7 op/s 2023-05-08T07:34:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13804.717076 secs 2023-05-08T07:34:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13804.717076 secs 2023-05-08T07:34:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13804.717076 secs 2023-05-08T07:34:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:27 smithi133 ceph-mon[125939]: pgmap v7421: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T07:34:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:27 smithi096 ceph-mon[124666]: pgmap v7421: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T07:34:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:27 smithi186 ceph-mon[126480]: pgmap v7421: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T07:34:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13807.876554 secs 2023-05-08T07:34:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:29 smithi133 ceph-mon[125939]: pgmap v7422: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T07:34:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13807.876554 secs 2023-05-08T07:34:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:29 smithi096 ceph-mon[124666]: pgmap v7422: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T07:34:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13807.876554 secs 2023-05-08T07:34:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:29 smithi186 ceph-mon[126480]: pgmap v7422: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T07:34:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13808.434574 secs 2023-05-08T07:34:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:34:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:34:30.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:34:30.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:34:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13808.434574 secs 2023-05-08T07:34:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:34:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:34:30.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:34:30.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:34:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13808.434574 secs 2023-05-08T07:34:30.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:34:30.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:34:30.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:34:30.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:34:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13809.717164 secs 2023-05-08T07:34:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:31 smithi133 ceph-mon[125939]: pgmap v7423: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T07:34:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:31 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:34:31.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:31 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T07:34:31.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:31 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T07:34:31.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:31 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:34:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13809.717164 secs 2023-05-08T07:34:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:31 smithi096 ceph-mon[124666]: pgmap v7423: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T07:34:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:31 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:34:31.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:31 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T07:34:31.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:31 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T07:34:31.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:31 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:34:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13809.717164 secs 2023-05-08T07:34:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:31 smithi186 ceph-mon[126480]: pgmap v7423: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T07:34:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:31 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:34:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:31 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T07:34:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:31 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T07:34:31.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:31 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:34:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:33 smithi133 ceph-mon[125939]: pgmap v7424: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T07:34:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:33 smithi096 ceph-mon[124666]: pgmap v7424: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T07:34:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:33 smithi186 ceph-mon[126480]: pgmap v7424: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T07:34:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13812.876666 secs 2023-05-08T07:34:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13812.876666 secs 2023-05-08T07:34:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13812.876666 secs 2023-05-08T07:34:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13813.434640 secs 2023-05-08T07:34:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:35 smithi133 ceph-mon[125939]: pgmap v7425: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 41 KiB/s wr, 8 op/s 2023-05-08T07:34:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13813.434640 secs 2023-05-08T07:34:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:35 smithi096 ceph-mon[124666]: pgmap v7425: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 41 KiB/s wr, 8 op/s 2023-05-08T07:34:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13813.434640 secs 2023-05-08T07:34:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:35 smithi186 ceph-mon[126480]: pgmap v7425: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 41 KiB/s wr, 8 op/s 2023-05-08T07:34:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13814.717286 secs 2023-05-08T07:34:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13814.717286 secs 2023-05-08T07:34:36.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13814.717286 secs 2023-05-08T07:34:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:37 smithi133 ceph-mon[125939]: pgmap v7426: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 41 KiB/s wr, 6 op/s 2023-05-08T07:34:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:37 smithi096 ceph-mon[124666]: pgmap v7426: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 41 KiB/s wr, 6 op/s 2023-05-08T07:34:37.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:37 smithi186 ceph-mon[126480]: pgmap v7426: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 41 KiB/s wr, 6 op/s 2023-05-08T07:34:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13817.876777 secs 2023-05-08T07:34:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:39 smithi133 ceph-mon[125939]: pgmap v7427: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 41 KiB/s wr, 6 op/s 2023-05-08T07:34:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13817.876777 secs 2023-05-08T07:34:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:39 smithi096 ceph-mon[124666]: pgmap v7427: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 41 KiB/s wr, 6 op/s 2023-05-08T07:34:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13817.876777 secs 2023-05-08T07:34:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:39 smithi186 ceph-mon[126480]: pgmap v7427: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 41 KiB/s wr, 6 op/s 2023-05-08T07:34:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13818.434738 secs 2023-05-08T07:34:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13818.434738 secs 2023-05-08T07:34:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13818.434738 secs 2023-05-08T07:34:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:41 smithi096 ceph-mon[124666]: pgmap v7428: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 KiB/s wr, 9 op/s 2023-05-08T07:34:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:41 smithi186 ceph-mon[126480]: pgmap v7428: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 KiB/s wr, 9 op/s 2023-05-08T07:34:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:41 smithi133 ceph-mon[125939]: pgmap v7428: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 KiB/s wr, 9 op/s 2023-05-08T07:34:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:43 smithi096 ceph-mon[124666]: pgmap v7429: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 41 KiB/s wr, 6 op/s 2023-05-08T07:34:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:34:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:43 smithi186 ceph-mon[126480]: pgmap v7429: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 41 KiB/s wr, 6 op/s 2023-05-08T07:34:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:34:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:43 smithi133 ceph-mon[125939]: pgmap v7429: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 41 KiB/s wr, 6 op/s 2023-05-08T07:34:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:34:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13822.876900 secs 2023-05-08T07:34:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:34:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:34:44.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:34:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13822.876900 secs 2023-05-08T07:34:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:34:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:34:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:34:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13822.876900 secs 2023-05-08T07:34:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:34:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:34:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:34:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13823.434877 secs 2023-05-08T07:34:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:45 smithi186 ceph-mon[126480]: pgmap v7430: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 87 KiB/s wr, 9 op/s 2023-05-08T07:34:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13823.434877 secs 2023-05-08T07:34:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:45 smithi133 ceph-mon[125939]: pgmap v7430: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 87 KiB/s wr, 9 op/s 2023-05-08T07:34:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13823.434877 secs 2023-05-08T07:34:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:45 smithi096 ceph-mon[124666]: pgmap v7430: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 87 KiB/s wr, 9 op/s 2023-05-08T07:34:47.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:47 smithi186 ceph-mon[126480]: pgmap v7431: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 47 KiB/s wr, 6 op/s 2023-05-08T07:34:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:47 smithi133 ceph-mon[125939]: pgmap v7431: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 47 KiB/s wr, 6 op/s 2023-05-08T07:34:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:47 smithi096 ceph-mon[124666]: pgmap v7431: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 47 KiB/s wr, 6 op/s 2023-05-08T07:34:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13827.877014 secs 2023-05-08T07:34:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:49 smithi186 ceph-mon[126480]: pgmap v7432: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 47 KiB/s wr, 6 op/s 2023-05-08T07:34:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13827.877014 secs 2023-05-08T07:34:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:49 smithi133 ceph-mon[125939]: pgmap v7432: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 47 KiB/s wr, 6 op/s 2023-05-08T07:34:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13827.877014 secs 2023-05-08T07:34:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:49 smithi096 ceph-mon[124666]: pgmap v7432: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 47 KiB/s wr, 6 op/s 2023-05-08T07:34:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:51 smithi186 ceph-mon[126480]: pgmap v7433: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 180 KiB/s wr, 10 op/s 2023-05-08T07:34:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:34:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:51 smithi133 ceph-mon[125939]: pgmap v7433: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 180 KiB/s wr, 10 op/s 2023-05-08T07:34:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:34:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:51 smithi096 ceph-mon[124666]: pgmap v7433: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 180 KiB/s wr, 10 op/s 2023-05-08T07:34:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:34:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:52 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:34:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:34:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:34:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:52 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:34:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:34:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:34:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:52 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:34:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:34:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:34:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:53 smithi186 ceph-mon[126480]: pgmap v7434: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 180 KiB/s wr, 7 op/s 2023-05-08T07:34:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:53 smithi133 ceph-mon[125939]: pgmap v7434: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 180 KiB/s wr, 7 op/s 2023-05-08T07:34:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:53 smithi096 ceph-mon[124666]: pgmap v7434: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 180 KiB/s wr, 7 op/s 2023-05-08T07:34:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13832.877136 secs 2023-05-08T07:34:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13832.877136 secs 2023-05-08T07:34:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13832.877136 secs 2023-05-08T07:34:55.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13833.435118 secs 2023-05-08T07:34:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:55 smithi186 ceph-mon[126480]: pgmap v7435: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 312 KiB/s wr, 13 op/s 2023-05-08T07:34:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13833.435118 secs 2023-05-08T07:34:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:55 smithi133 ceph-mon[125939]: pgmap v7435: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 312 KiB/s wr, 13 op/s 2023-05-08T07:34:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13833.435118 secs 2023-05-08T07:34:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:55 smithi096 ceph-mon[124666]: pgmap v7435: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 312 KiB/s wr, 13 op/s 2023-05-08T07:34:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:34:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:34:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:34:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:34:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:34:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:34:57.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:57 smithi186 ceph-mon[126480]: pgmap v7436: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 265 KiB/s wr, 10 op/s 2023-05-08T07:34:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:57 smithi133 ceph-mon[125939]: pgmap v7436: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 265 KiB/s wr, 10 op/s 2023-05-08T07:34:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:57 smithi096 ceph-mon[124666]: pgmap v7436: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 265 KiB/s wr, 10 op/s 2023-05-08T07:34:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13837.877254 secs 2023-05-08T07:34:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:59 smithi186 ceph-mon[126480]: pgmap v7437: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 265 KiB/s wr, 10 op/s 2023-05-08T07:34:59.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:34:59 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:34:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13837.877254 secs 2023-05-08T07:34:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:59 smithi133 ceph-mon[125939]: pgmap v7437: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 265 KiB/s wr, 10 op/s 2023-05-08T07:34:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:34:59 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:35:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13837.877254 secs 2023-05-08T07:35:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:59 smithi096 ceph-mon[124666]: pgmap v7437: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 265 KiB/s wr, 10 op/s 2023-05-08T07:35:00.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:34:59 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:35:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:00 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:35:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:35:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:35:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:00 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:35:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:35:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:35:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:00 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:35:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:35:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:35:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:01 smithi186 ceph-mon[126480]: pgmap v7438: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 325 KiB/s wr, 15 op/s 2023-05-08T07:35:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:01 smithi133 ceph-mon[125939]: pgmap v7438: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 325 KiB/s wr, 15 op/s 2023-05-08T07:35:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:01 smithi096 ceph-mon[124666]: pgmap v7438: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 325 KiB/s wr, 15 op/s 2023-05-08T07:35:03.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:03 smithi186 ceph-mon[126480]: pgmap v7439: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 191 KiB/s wr, 11 op/s 2023-05-08T07:35:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:03 smithi133 ceph-mon[125939]: pgmap v7439: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 191 KiB/s wr, 11 op/s 2023-05-08T07:35:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:03 smithi096 ceph-mon[124666]: pgmap v7439: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 191 KiB/s wr, 11 op/s 2023-05-08T07:35:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13842.877354 secs 2023-05-08T07:35:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13843.435371 secs 2023-05-08T07:35:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13842.877354 secs 2023-05-08T07:35:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13843.435371 secs 2023-05-08T07:35:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13842.877354 secs 2023-05-08T07:35:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13843.435371 secs 2023-05-08T07:35:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:05 smithi186 ceph-mon[126480]: pgmap v7440: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 286 KiB/s wr, 30 op/s 2023-05-08T07:35:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:05 smithi133 ceph-mon[125939]: pgmap v7440: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 286 KiB/s wr, 30 op/s 2023-05-08T07:35:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:05 smithi096 ceph-mon[124666]: pgmap v7440: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 286 KiB/s wr, 30 op/s 2023-05-08T07:35:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13844.718025 secs 2023-05-08T07:35:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:06 smithi186 ceph-mon[126480]: osdmap e542: 12 total, 12 up, 12 in 2023-05-08T07:35:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13844.718025 secs 2023-05-08T07:35:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:06 smithi133 ceph-mon[125939]: osdmap e542: 12 total, 12 up, 12 in 2023-05-08T07:35:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13844.718025 secs 2023-05-08T07:35:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:06 smithi096 ceph-mon[124666]: osdmap e542: 12 total, 12 up, 12 in 2023-05-08T07:35:07.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:07 smithi186 ceph-mon[126480]: pgmap v7442: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 328 KiB/s wr, 30 op/s 2023-05-08T07:35:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:07 smithi133 ceph-mon[125939]: pgmap v7442: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 328 KiB/s wr, 30 op/s 2023-05-08T07:35:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:07 smithi096 ceph-mon[124666]: pgmap v7442: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 328 KiB/s wr, 30 op/s 2023-05-08T07:35:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:08 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:35:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:35:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:35:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:35:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:08 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:35:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:35:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:35:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:35:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:08 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:35:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:35:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:35:09.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:35:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13847.877474 secs 2023-05-08T07:35:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:09 smithi186 ceph-mon[126480]: pgmap v7443: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 328 KiB/s wr, 30 op/s 2023-05-08T07:35:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13848.435465 secs 2023-05-08T07:35:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13847.877474 secs 2023-05-08T07:35:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:09 smithi133 ceph-mon[125939]: pgmap v7443: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 328 KiB/s wr, 30 op/s 2023-05-08T07:35:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13848.435465 secs 2023-05-08T07:35:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13847.877474 secs 2023-05-08T07:35:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:09 smithi096 ceph-mon[124666]: pgmap v7443: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 328 KiB/s wr, 30 op/s 2023-05-08T07:35:10.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13848.435465 secs 2023-05-08T07:35:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13849.718140 secs 2023-05-08T07:35:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:11 smithi186 ceph-mon[126480]: pgmap v7444: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 258 KiB/s wr, 28 op/s 2023-05-08T07:35:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:11 smithi186 ceph-mon[126480]: osdmap e543: 12 total, 12 up, 12 in 2023-05-08T07:35:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13849.718140 secs 2023-05-08T07:35:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:11 smithi133 ceph-mon[125939]: pgmap v7444: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 258 KiB/s wr, 28 op/s 2023-05-08T07:35:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:11 smithi133 ceph-mon[125939]: osdmap e543: 12 total, 12 up, 12 in 2023-05-08T07:35:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13849.718140 secs 2023-05-08T07:35:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:11 smithi096 ceph-mon[124666]: pgmap v7444: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 258 KiB/s wr, 28 op/s 2023-05-08T07:35:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:11 smithi096 ceph-mon[124666]: osdmap e543: 12 total, 12 up, 12 in 2023-05-08T07:35:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:13 smithi133 ceph-mon[125939]: pgmap v7446: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 221 KiB/s wr, 7 op/s 2023-05-08T07:35:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:13 smithi096 ceph-mon[124666]: pgmap v7446: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 221 KiB/s wr, 7 op/s 2023-05-08T07:35:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:13 smithi186 ceph-mon[126480]: pgmap v7446: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 221 KiB/s wr, 7 op/s 2023-05-08T07:35:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13852.877590 secs 2023-05-08T07:35:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13853.435582 secs 2023-05-08T07:35:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13852.877590 secs 2023-05-08T07:35:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13853.435582 secs 2023-05-08T07:35:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13852.877590 secs 2023-05-08T07:35:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13853.435582 secs 2023-05-08T07:35:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:15 smithi133 ceph-mon[125939]: pgmap v7447: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 206 KiB/s wr, 10 op/s 2023-05-08T07:35:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:15 smithi096 ceph-mon[124666]: pgmap v7447: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 206 KiB/s wr, 10 op/s 2023-05-08T07:35:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:15 smithi186 ceph-mon[126480]: pgmap v7447: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 206 KiB/s wr, 10 op/s 2023-05-08T07:35:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13854.718261 secs 2023-05-08T07:35:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13854.718261 secs 2023-05-08T07:35:17.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13854.718261 secs 2023-05-08T07:35:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:17 smithi133 ceph-mon[125939]: pgmap v7448: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 34 KiB/s wr, 8 op/s 2023-05-08T07:35:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:17 smithi096 ceph-mon[124666]: pgmap v7448: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 34 KiB/s wr, 8 op/s 2023-05-08T07:35:18.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:17 smithi186 ceph-mon[126480]: pgmap v7448: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 34 KiB/s wr, 8 op/s 2023-05-08T07:35:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13857.877712 secs 2023-05-08T07:35:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:19 smithi133 ceph-mon[125939]: pgmap v7449: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 34 KiB/s wr, 8 op/s 2023-05-08T07:35:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13858.435698 secs 2023-05-08T07:35:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13857.877712 secs 2023-05-08T07:35:20.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:19 smithi096 ceph-mon[124666]: pgmap v7449: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 34 KiB/s wr, 8 op/s 2023-05-08T07:35:20.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13858.435698 secs 2023-05-08T07:35:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13857.877712 secs 2023-05-08T07:35:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:19 smithi186 ceph-mon[126480]: pgmap v7449: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 34 KiB/s wr, 8 op/s 2023-05-08T07:35:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13858.435698 secs 2023-05-08T07:35:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13859.718387 secs 2023-05-08T07:35:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:21 smithi133 ceph-mon[125939]: pgmap v7450: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T07:35:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13859.718387 secs 2023-05-08T07:35:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:21 smithi096 ceph-mon[124666]: pgmap v7450: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T07:35:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13859.718387 secs 2023-05-08T07:35:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:21 smithi186 ceph-mon[126480]: pgmap v7450: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T07:35:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:23 smithi133 ceph-mon[125939]: pgmap v7451: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 0 B/s wr, 5 op/s 2023-05-08T07:35:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:23 smithi096 ceph-mon[124666]: pgmap v7451: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 0 B/s wr, 5 op/s 2023-05-08T07:35:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:23 smithi186 ceph-mon[126480]: pgmap v7451: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 0 B/s wr, 5 op/s 2023-05-08T07:35:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13862.877840 secs 2023-05-08T07:35:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13863.435811 secs 2023-05-08T07:35:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13862.877840 secs 2023-05-08T07:35:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13863.435811 secs 2023-05-08T07:35:25.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13862.877840 secs 2023-05-08T07:35:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13863.435811 secs 2023-05-08T07:35:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:25 smithi133 ceph-mon[125939]: pgmap v7452: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 341 B/s wr, 7 op/s 2023-05-08T07:35:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:25 smithi096 ceph-mon[124666]: pgmap v7452: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 341 B/s wr, 7 op/s 2023-05-08T07:35:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:25 smithi186 ceph-mon[126480]: pgmap v7452: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 341 B/s wr, 7 op/s 2023-05-08T07:35:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13864.718487 secs 2023-05-08T07:35:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13864.718487 secs 2023-05-08T07:35:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13864.718487 secs 2023-05-08T07:35:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:27 smithi133 ceph-mon[125939]: pgmap v7453: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 341 B/s wr, 5 op/s 2023-05-08T07:35:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:27 smithi096 ceph-mon[124666]: pgmap v7453: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 341 B/s wr, 5 op/s 2023-05-08T07:35:28.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:27 smithi186 ceph-mon[126480]: pgmap v7453: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 341 B/s wr, 5 op/s 2023-05-08T07:35:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13867.877941 secs 2023-05-08T07:35:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:29 smithi133 ceph-mon[125939]: pgmap v7454: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 341 B/s wr, 5 op/s 2023-05-08T07:35:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13868.435945 secs 2023-05-08T07:35:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13867.877941 secs 2023-05-08T07:35:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:29 smithi096 ceph-mon[124666]: pgmap v7454: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 341 B/s wr, 5 op/s 2023-05-08T07:35:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13868.435945 secs 2023-05-08T07:35:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13867.877941 secs 2023-05-08T07:35:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:29 smithi186 ceph-mon[126480]: pgmap v7454: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 341 B/s wr, 5 op/s 2023-05-08T07:35:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13868.435945 secs 2023-05-08T07:35:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:35:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:35:31.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:35:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13869.718643 secs 2023-05-08T07:35:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:31 smithi133 ceph-mon[125939]: pgmap v7455: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2023-05-08T07:35:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:31 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:35:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:31 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:35:31.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:31 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:35:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13869.718643 secs 2023-05-08T07:35:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:31 smithi096 ceph-mon[124666]: pgmap v7455: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2023-05-08T07:35:32.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:31 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:35:32.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:31 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:35:32.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:31 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:35:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13869.718643 secs 2023-05-08T07:35:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:31 smithi186 ceph-mon[126480]: pgmap v7455: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2023-05-08T07:35:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:31 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:35:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:31 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:35:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:31 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:35:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:32 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:35:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:32 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T07:35:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:32 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T07:35:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:32 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:35:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:32 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:35:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:32 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T07:35:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:32 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T07:35:33.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:32 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:35:33.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:32 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:35:33.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:32 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T07:35:33.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:32 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T07:35:33.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:32 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:35:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:33 smithi133 ceph-mon[125939]: pgmap v7456: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 46 KiB/s wr, 7 op/s 2023-05-08T07:35:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:33 smithi096 ceph-mon[124666]: pgmap v7456: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 46 KiB/s wr, 7 op/s 2023-05-08T07:35:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:33 smithi186 ceph-mon[126480]: pgmap v7456: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 46 KiB/s wr, 7 op/s 2023-05-08T07:35:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13872.878067 secs 2023-05-08T07:35:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13873.436058 secs 2023-05-08T07:35:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13872.878067 secs 2023-05-08T07:35:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13873.436058 secs 2023-05-08T07:35:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13872.878067 secs 2023-05-08T07:35:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13873.436058 secs 2023-05-08T07:35:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:35 smithi133 ceph-mon[125939]: pgmap v7457: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 46 KiB/s wr, 9 op/s 2023-05-08T07:35:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:35 smithi096 ceph-mon[124666]: pgmap v7457: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 46 KiB/s wr, 9 op/s 2023-05-08T07:35:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:35 smithi186 ceph-mon[126480]: pgmap v7457: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 46 KiB/s wr, 9 op/s 2023-05-08T07:35:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13874.718762 secs 2023-05-08T07:35:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13874.718762 secs 2023-05-08T07:35:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13874.718762 secs 2023-05-08T07:35:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:37 smithi133 ceph-mon[125939]: pgmap v7458: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 74 KiB/s wr, 7 op/s 2023-05-08T07:35:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:37 smithi096 ceph-mon[124666]: pgmap v7458: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 74 KiB/s wr, 7 op/s 2023-05-08T07:35:38.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:37 smithi186 ceph-mon[126480]: pgmap v7458: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 74 KiB/s wr, 7 op/s 2023-05-08T07:35:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13877.878204 secs 2023-05-08T07:35:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:39 smithi133 ceph-mon[125939]: pgmap v7459: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 74 KiB/s wr, 7 op/s 2023-05-08T07:35:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13878.436147 secs 2023-05-08T07:35:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13877.878204 secs 2023-05-08T07:35:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:39 smithi096 ceph-mon[124666]: pgmap v7459: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 74 KiB/s wr, 7 op/s 2023-05-08T07:35:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13878.436147 secs 2023-05-08T07:35:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13877.878204 secs 2023-05-08T07:35:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:39 smithi186 ceph-mon[126480]: pgmap v7459: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 74 KiB/s wr, 7 op/s 2023-05-08T07:35:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13878.436147 secs 2023-05-08T07:35:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:41 smithi133 ceph-mon[125939]: pgmap v7460: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 74 KiB/s wr, 9 op/s 2023-05-08T07:35:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:41 smithi096 ceph-mon[124666]: pgmap v7460: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 74 KiB/s wr, 9 op/s 2023-05-08T07:35:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:41 smithi186 ceph-mon[126480]: pgmap v7460: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 74 KiB/s wr, 9 op/s 2023-05-08T07:35:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:35:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:35:43.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:35:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:43 smithi133 ceph-mon[125939]: pgmap v7461: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 93 KiB/s wr, 6 op/s 2023-05-08T07:35:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:43 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:35:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:35:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:35:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:43 smithi096 ceph-mon[124666]: pgmap v7461: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 93 KiB/s wr, 6 op/s 2023-05-08T07:35:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:43 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:35:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:35:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:35:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:43 smithi186 ceph-mon[126480]: pgmap v7461: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 93 KiB/s wr, 6 op/s 2023-05-08T07:35:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:43 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:35:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:35:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:35:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13882.878359 secs 2023-05-08T07:35:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13883.436283 secs 2023-05-08T07:35:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13882.878359 secs 2023-05-08T07:35:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13883.436283 secs 2023-05-08T07:35:45.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13882.878359 secs 2023-05-08T07:35:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13883.436283 secs 2023-05-08T07:35:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:45 smithi133 ceph-mon[125939]: pgmap v7462: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 48 KiB/s wr, 8 op/s 2023-05-08T07:35:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:45 smithi096 ceph-mon[124666]: pgmap v7462: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 48 KiB/s wr, 8 op/s 2023-05-08T07:35:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:45 smithi186 ceph-mon[126480]: pgmap v7462: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 48 KiB/s wr, 8 op/s 2023-05-08T07:35:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:47 smithi133 ceph-mon[125939]: pgmap v7463: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 122 KiB/s wr, 6 op/s 2023-05-08T07:35:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:47 smithi096 ceph-mon[124666]: pgmap v7463: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 122 KiB/s wr, 6 op/s 2023-05-08T07:35:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:47 smithi186 ceph-mon[126480]: pgmap v7463: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 122 KiB/s wr, 6 op/s 2023-05-08T07:35:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13887.878454 secs 2023-05-08T07:35:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:49 smithi133 ceph-mon[125939]: pgmap v7464: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 95 KiB/s wr, 6 op/s 2023-05-08T07:35:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13887.878454 secs 2023-05-08T07:35:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:49 smithi096 ceph-mon[124666]: pgmap v7464: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 95 KiB/s wr, 6 op/s 2023-05-08T07:35:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13887.878454 secs 2023-05-08T07:35:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:49 smithi186 ceph-mon[126480]: pgmap v7464: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 95 KiB/s wr, 6 op/s 2023-05-08T07:35:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:51 smithi133 ceph-mon[125939]: pgmap v7465: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 102 KiB/s wr, 9 op/s 2023-05-08T07:35:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:35:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:51 smithi096 ceph-mon[124666]: pgmap v7465: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 102 KiB/s wr, 9 op/s 2023-05-08T07:35:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:35:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:51 smithi186 ceph-mon[126480]: pgmap v7465: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 102 KiB/s wr, 9 op/s 2023-05-08T07:35:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:35:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:52 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:35:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:35:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:35:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:52 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:35:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:35:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:35:53.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:52 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:35:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:35:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:35:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:53 smithi096 ceph-mon[124666]: pgmap v7466: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 130 KiB/s wr, 7 op/s 2023-05-08T07:35:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:53 smithi186 ceph-mon[126480]: pgmap v7466: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 130 KiB/s wr, 7 op/s 2023-05-08T07:35:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:53 smithi133 ceph-mon[125939]: pgmap v7466: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 130 KiB/s wr, 7 op/s 2023-05-08T07:35:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13892.878533 secs 2023-05-08T07:35:55.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13892.878533 secs 2023-05-08T07:35:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13892.878533 secs 2023-05-08T07:35:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:55 smithi186 ceph-mon[126480]: pgmap v7467: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 265 KiB/s rd, 251 KiB/s wr, 11 op/s 2023-05-08T07:35:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:55 smithi133 ceph-mon[125939]: pgmap v7467: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 265 KiB/s rd, 251 KiB/s wr, 11 op/s 2023-05-08T07:35:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:55 smithi096 ceph-mon[124666]: pgmap v7467: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 265 KiB/s rd, 251 KiB/s wr, 11 op/s 2023-05-08T07:35:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:57 smithi186 ceph-mon[126480]: pgmap v7468: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 251 KiB/s wr, 9 op/s 2023-05-08T07:35:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:57 smithi133 ceph-mon[125939]: pgmap v7468: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 251 KiB/s wr, 9 op/s 2023-05-08T07:35:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:57 smithi096 ceph-mon[124666]: pgmap v7468: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 251 KiB/s wr, 9 op/s 2023-05-08T07:35:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:58 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:35:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:35:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:35:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:58 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:35:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:35:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:35:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:58 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:35:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:35:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:36:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13897.878650 secs 2023-05-08T07:36:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:59 smithi186 ceph-mon[126480]: pgmap v7469: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 176 KiB/s wr, 8 op/s 2023-05-08T07:36:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:35:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13898.436622 secs 2023-05-08T07:36:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13897.878650 secs 2023-05-08T07:36:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:59 smithi133 ceph-mon[125939]: pgmap v7469: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 176 KiB/s wr, 8 op/s 2023-05-08T07:36:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:35:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13898.436622 secs 2023-05-08T07:36:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13897.878650 secs 2023-05-08T07:36:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:59 smithi096 ceph-mon[124666]: pgmap v7469: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 176 KiB/s wr, 8 op/s 2023-05-08T07:36:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:35:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13898.436622 secs 2023-05-08T07:36:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:00 smithi186 ceph-mon[126480]: pgmap v7470: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 231 KiB/s wr, 13 op/s 2023-05-08T07:36:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:00 smithi133 ceph-mon[125939]: pgmap v7470: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 231 KiB/s wr, 13 op/s 2023-05-08T07:36:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:00 smithi096 ceph-mon[124666]: pgmap v7470: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 231 KiB/s wr, 13 op/s 2023-05-08T07:36:03.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:03 smithi186 ceph-mon[126480]: pgmap v7471: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 224 KiB/s wr, 10 op/s 2023-05-08T07:36:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:03 smithi133 ceph-mon[125939]: pgmap v7471: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 224 KiB/s wr, 10 op/s 2023-05-08T07:36:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:03 smithi096 ceph-mon[124666]: pgmap v7471: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 224 KiB/s wr, 10 op/s 2023-05-08T07:36:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13902.878801 secs 2023-05-08T07:36:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13902.878801 secs 2023-05-08T07:36:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13902.878801 secs 2023-05-08T07:36:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13903.436741 secs 2023-05-08T07:36:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:05 smithi186 ceph-mon[126480]: pgmap v7472: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 339 KiB/s wr, 26 op/s 2023-05-08T07:36:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13903.436741 secs 2023-05-08T07:36:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:05 smithi133 ceph-mon[125939]: pgmap v7472: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 339 KiB/s wr, 26 op/s 2023-05-08T07:36:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13903.436741 secs 2023-05-08T07:36:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:05 smithi096 ceph-mon[124666]: pgmap v7472: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 339 KiB/s wr, 26 op/s 2023-05-08T07:36:07.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:07 smithi186 ceph-mon[126480]: pgmap v7473: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 198 KiB/s wr, 21 op/s 2023-05-08T07:36:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:07 smithi133 ceph-mon[125939]: pgmap v7473: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 198 KiB/s wr, 21 op/s 2023-05-08T07:36:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:07 smithi096 ceph-mon[124666]: pgmap v7473: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 198 KiB/s wr, 21 op/s 2023-05-08T07:36:09.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13907.878938 secs 2023-05-08T07:36:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:09 smithi186 ceph-mon[126480]: pgmap v7474: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 198 KiB/s wr, 21 op/s 2023-05-08T07:36:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13907.878938 secs 2023-05-08T07:36:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:09 smithi133 ceph-mon[125939]: pgmap v7474: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 198 KiB/s wr, 21 op/s 2023-05-08T07:36:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13907.878938 secs 2023-05-08T07:36:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:09 smithi096 ceph-mon[124666]: pgmap v7474: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 198 KiB/s wr, 21 op/s 2023-05-08T07:36:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:11 smithi186 ceph-mon[126480]: pgmap v7475: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 343 KiB/s wr, 26 op/s 2023-05-08T07:36:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:11 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:36:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:11 smithi133 ceph-mon[125939]: pgmap v7475: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 343 KiB/s wr, 26 op/s 2023-05-08T07:36:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:11 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:36:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:11 smithi096 ceph-mon[124666]: pgmap v7475: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 343 KiB/s wr, 26 op/s 2023-05-08T07:36:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:11 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:36:12.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:12 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:36:12.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:12 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:36:12.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:12 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:36:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:12 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:36:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:12 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:36:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:12 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:36:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:12 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:36:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:12 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:36:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:12 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:36:13.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:13 smithi186 ceph-mon[126480]: pgmap v7476: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 289 KiB/s wr, 21 op/s 2023-05-08T07:36:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:13 smithi133 ceph-mon[125939]: pgmap v7476: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 289 KiB/s wr, 21 op/s 2023-05-08T07:36:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:13 smithi096 ceph-mon[124666]: pgmap v7476: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 289 KiB/s wr, 21 op/s 2023-05-08T07:36:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13912.879056 secs 2023-05-08T07:36:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13912.879056 secs 2023-05-08T07:36:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13912.879056 secs 2023-05-08T07:36:15.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:15 smithi186 ceph-mon[126480]: pgmap v7477: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 317 KiB/s wr, 25 op/s 2023-05-08T07:36:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:15 smithi133 ceph-mon[125939]: pgmap v7477: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 317 KiB/s wr, 25 op/s 2023-05-08T07:36:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:15 smithi096 ceph-mon[124666]: pgmap v7477: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 317 KiB/s wr, 25 op/s 2023-05-08T07:36:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:17 smithi186 ceph-mon[126480]: pgmap v7478: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 173 KiB/s wr, 8 op/s 2023-05-08T07:36:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:17 smithi133 ceph-mon[125939]: pgmap v7478: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 173 KiB/s wr, 8 op/s 2023-05-08T07:36:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:17 smithi096 ceph-mon[124666]: pgmap v7478: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 173 KiB/s wr, 8 op/s 2023-05-08T07:36:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13917.879132 secs 2023-05-08T07:36:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:19 smithi186 ceph-mon[126480]: pgmap v7479: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 173 KiB/s wr, 8 op/s 2023-05-08T07:36:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13917.879132 secs 2023-05-08T07:36:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:19 smithi133 ceph-mon[125939]: pgmap v7479: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 173 KiB/s wr, 8 op/s 2023-05-08T07:36:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13917.879132 secs 2023-05-08T07:36:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:19 smithi096 ceph-mon[124666]: pgmap v7479: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 173 KiB/s wr, 8 op/s 2023-05-08T07:36:21.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:21 smithi186 ceph-mon[126480]: pgmap v7480: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 173 KiB/s wr, 11 op/s 2023-05-08T07:36:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:21 smithi133 ceph-mon[125939]: pgmap v7480: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 173 KiB/s wr, 11 op/s 2023-05-08T07:36:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:21 smithi096 ceph-mon[124666]: pgmap v7480: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 173 KiB/s wr, 11 op/s 2023-05-08T07:36:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:23 smithi133 ceph-mon[125939]: pgmap v7481: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 28 KiB/s wr, 6 op/s 2023-05-08T07:36:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:23 smithi096 ceph-mon[124666]: pgmap v7481: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 28 KiB/s wr, 6 op/s 2023-05-08T07:36:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:23 smithi186 ceph-mon[126480]: pgmap v7481: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 28 KiB/s wr, 6 op/s 2023-05-08T07:36:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13922.879247 secs 2023-05-08T07:36:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13922.879247 secs 2023-05-08T07:36:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13922.879247 secs 2023-05-08T07:36:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13923.437188 secs 2023-05-08T07:36:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:25 smithi133 ceph-mon[125939]: pgmap v7482: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 171 KiB/s wr, 12 op/s 2023-05-08T07:36:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13923.437188 secs 2023-05-08T07:36:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:25 smithi096 ceph-mon[124666]: pgmap v7482: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 171 KiB/s wr, 12 op/s 2023-05-08T07:36:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13923.437188 secs 2023-05-08T07:36:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:25 smithi186 ceph-mon[126480]: pgmap v7482: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 171 KiB/s wr, 12 op/s 2023-05-08T07:36:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13924.719875 secs 2023-05-08T07:36:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:26 smithi133 ceph-mon[125939]: osdmap e544: 12 total, 12 up, 12 in 2023-05-08T07:36:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13924.719875 secs 2023-05-08T07:36:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:26 smithi096 ceph-mon[124666]: osdmap e544: 12 total, 12 up, 12 in 2023-05-08T07:36:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13924.719875 secs 2023-05-08T07:36:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:26 smithi186 ceph-mon[126480]: osdmap e544: 12 total, 12 up, 12 in 2023-05-08T07:36:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:27 smithi133 ceph-mon[125939]: pgmap v7484: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 172 KiB/s wr, 10 op/s 2023-05-08T07:36:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:27 smithi096 ceph-mon[124666]: pgmap v7484: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 172 KiB/s wr, 10 op/s 2023-05-08T07:36:27.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:27 smithi186 ceph-mon[126480]: pgmap v7484: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 172 KiB/s wr, 10 op/s 2023-05-08T07:36:28.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:28 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:36:28.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:28 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:36:28.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:28 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:36:28.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:28 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:36:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:28 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:36:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:28 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:36:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:28 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:36:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:28 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:36:28.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:28 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:36:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:28 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:36:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:28 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:36:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:28 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:36:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13927.879360 secs 2023-05-08T07:36:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:29 smithi133 ceph-mon[125939]: pgmap v7485: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 172 KiB/s wr, 10 op/s 2023-05-08T07:36:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13927.879360 secs 2023-05-08T07:36:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:29 smithi096 ceph-mon[124666]: pgmap v7485: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 172 KiB/s wr, 10 op/s 2023-05-08T07:36:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13927.879360 secs 2023-05-08T07:36:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:29 smithi186 ceph-mon[126480]: pgmap v7485: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 172 KiB/s wr, 10 op/s 2023-05-08T07:36:30.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13928.437251 secs 2023-05-08T07:36:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13928.437251 secs 2023-05-08T07:36:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13928.437251 secs 2023-05-08T07:36:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13929.719973 secs 2023-05-08T07:36:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:31 smithi133 ceph-mon[125939]: pgmap v7486: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 276 KiB/s wr, 12 op/s 2023-05-08T07:36:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:31 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:36:31.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13929.719973 secs 2023-05-08T07:36:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:31 smithi096 ceph-mon[124666]: pgmap v7486: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 276 KiB/s wr, 12 op/s 2023-05-08T07:36:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:31 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:36:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13929.719973 secs 2023-05-08T07:36:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:31 smithi186 ceph-mon[126480]: pgmap v7486: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 276 KiB/s wr, 12 op/s 2023-05-08T07:36:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:31 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:36:32.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:36:32.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:36:32.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:32 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:36:32.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:36:32.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:32 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T07:36:32.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:32 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T07:36:32.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:32 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:36:32.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:36:32.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:36:32.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:32 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:36:32.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:36:32.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:32 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T07:36:32.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:32 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T07:36:32.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:32 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:36:32.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:36:32.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:36:32.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:32 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:36:32.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:36:32.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:32 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T07:36:32.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:32 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T07:36:32.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:32 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:36:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:33 smithi133 ceph-mon[125939]: pgmap v7487: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 276 KiB/s wr, 12 op/s 2023-05-08T07:36:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:33 smithi096 ceph-mon[124666]: pgmap v7487: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 276 KiB/s wr, 12 op/s 2023-05-08T07:36:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:33 smithi186 ceph-mon[126480]: pgmap v7487: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 276 KiB/s wr, 12 op/s 2023-05-08T07:36:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13932.879486 secs 2023-05-08T07:36:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13933.437370 secs 2023-05-08T07:36:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13932.879486 secs 2023-05-08T07:36:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13933.437370 secs 2023-05-08T07:36:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13932.879486 secs 2023-05-08T07:36:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13933.437370 secs 2023-05-08T07:36:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:35 smithi133 ceph-mon[125939]: pgmap v7488: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 106 KiB/s wr, 8 op/s 2023-05-08T07:36:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:35 smithi096 ceph-mon[124666]: pgmap v7488: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 106 KiB/s wr, 8 op/s 2023-05-08T07:36:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:35 smithi186 ceph-mon[126480]: pgmap v7488: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 106 KiB/s wr, 8 op/s 2023-05-08T07:36:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13934.720094 secs 2023-05-08T07:36:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:36 smithi133 ceph-mon[125939]: osdmap e545: 12 total, 12 up, 12 in 2023-05-08T07:36:37.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13934.720094 secs 2023-05-08T07:36:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:36 smithi096 ceph-mon[124666]: osdmap e545: 12 total, 12 up, 12 in 2023-05-08T07:36:37.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13934.720094 secs 2023-05-08T07:36:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:36 smithi186 ceph-mon[126480]: osdmap e545: 12 total, 12 up, 12 in 2023-05-08T07:36:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:37 smithi133 ceph-mon[125939]: pgmap v7489: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 98 KiB/s wr, 7 op/s 2023-05-08T07:36:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:37 smithi096 ceph-mon[124666]: pgmap v7489: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 98 KiB/s wr, 7 op/s 2023-05-08T07:36:38.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:37 smithi186 ceph-mon[126480]: pgmap v7489: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 98 KiB/s wr, 7 op/s 2023-05-08T07:36:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13937.879596 secs 2023-05-08T07:36:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:39 smithi133 ceph-mon[125939]: pgmap v7491: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 106 KiB/s wr, 8 op/s 2023-05-08T07:36:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13938.437489 secs 2023-05-08T07:36:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13937.879596 secs 2023-05-08T07:36:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:39 smithi096 ceph-mon[124666]: pgmap v7491: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 106 KiB/s wr, 8 op/s 2023-05-08T07:36:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13938.437489 secs 2023-05-08T07:36:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13937.879596 secs 2023-05-08T07:36:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:39 smithi186 ceph-mon[126480]: pgmap v7491: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 106 KiB/s wr, 8 op/s 2023-05-08T07:36:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13938.437489 secs 2023-05-08T07:36:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:41 smithi096 ceph-mon[124666]: pgmap v7492: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 169 KiB/s wr, 8 op/s 2023-05-08T07:36:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:41 smithi186 ceph-mon[126480]: pgmap v7492: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 169 KiB/s wr, 8 op/s 2023-05-08T07:36:42.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:41 smithi133 ceph-mon[125939]: pgmap v7492: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 169 KiB/s wr, 8 op/s 2023-05-08T07:36:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:36:43.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:36:43.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:36:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:43 smithi096 ceph-mon[124666]: pgmap v7493: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 169 KiB/s wr, 8 op/s 2023-05-08T07:36:44.086 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:43 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:36:44.086 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:36:44.087 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:36:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:43 smithi186 ceph-mon[126480]: pgmap v7493: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 169 KiB/s wr, 8 op/s 2023-05-08T07:36:44.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:43 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:36:44.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:36:44.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:36:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:43 smithi133 ceph-mon[125939]: pgmap v7493: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 169 KiB/s wr, 8 op/s 2023-05-08T07:36:44.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:43 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:36:44.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:36:44.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:36:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13942.879707 secs 2023-05-08T07:36:45.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13942.879707 secs 2023-05-08T07:36:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13942.879707 secs 2023-05-08T07:36:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:45 smithi096 ceph-mon[124666]: pgmap v7494: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 191 KiB/s wr, 9 op/s 2023-05-08T07:36:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:45 smithi186 ceph-mon[126480]: pgmap v7494: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 191 KiB/s wr, 9 op/s 2023-05-08T07:36:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:45 smithi133 ceph-mon[125939]: pgmap v7494: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 191 KiB/s wr, 9 op/s 2023-05-08T07:36:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:47 smithi186 ceph-mon[126480]: pgmap v7495: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 191 KiB/s wr, 9 op/s 2023-05-08T07:36:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:36:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:47 smithi133 ceph-mon[125939]: pgmap v7495: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 191 KiB/s wr, 9 op/s 2023-05-08T07:36:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:36:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:47 smithi096 ceph-mon[124666]: pgmap v7495: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 191 KiB/s wr, 9 op/s 2023-05-08T07:36:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:36:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:36:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:36:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:36:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:36:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:36:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:36:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13947.879830 secs 2023-05-08T07:36:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:49 smithi186 ceph-mon[126480]: pgmap v7496: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 161 KiB/s wr, 7 op/s 2023-05-08T07:36:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13947.879830 secs 2023-05-08T07:36:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:49 smithi133 ceph-mon[125939]: pgmap v7496: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 161 KiB/s wr, 7 op/s 2023-05-08T07:36:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13947.879830 secs 2023-05-08T07:36:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:49 smithi096 ceph-mon[124666]: pgmap v7496: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 161 KiB/s wr, 7 op/s 2023-05-08T07:36:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:51 smithi186 ceph-mon[126480]: pgmap v7497: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 311 KiB/s wr, 13 op/s 2023-05-08T07:36:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:51 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:36:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:51 smithi133 ceph-mon[125939]: pgmap v7497: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 311 KiB/s wr, 13 op/s 2023-05-08T07:36:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:51 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:36:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:51 smithi096 ceph-mon[124666]: pgmap v7497: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 311 KiB/s wr, 13 op/s 2023-05-08T07:36:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:51 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:36:53.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:53 smithi186 ceph-mon[126480]: pgmap v7498: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 171 KiB/s wr, 9 op/s 2023-05-08T07:36:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:53 smithi133 ceph-mon[125939]: pgmap v7498: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 171 KiB/s wr, 9 op/s 2023-05-08T07:36:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:53 smithi096 ceph-mon[124666]: pgmap v7498: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 171 KiB/s wr, 9 op/s 2023-05-08T07:36:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13952.879946 secs 2023-05-08T07:36:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13952.879946 secs 2023-05-08T07:36:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13952.879946 secs 2023-05-08T07:36:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13953.437783 secs 2023-05-08T07:36:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:55 smithi186 ceph-mon[126480]: pgmap v7499: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 265 KiB/s wr, 14 op/s 2023-05-08T07:36:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13953.437783 secs 2023-05-08T07:36:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:55 smithi133 ceph-mon[125939]: pgmap v7499: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 265 KiB/s wr, 14 op/s 2023-05-08T07:36:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13953.437783 secs 2023-05-08T07:36:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:55 smithi096 ceph-mon[124666]: pgmap v7499: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 265 KiB/s wr, 14 op/s 2023-05-08T07:36:56.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:36:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:36:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:56 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:36:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:36:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:36:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:56 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:36:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:36:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:36:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:56 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:36:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:57 smithi133 ceph-mon[125939]: pgmap v7500: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 245 KiB/s wr, 9 op/s 2023-05-08T07:36:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:57 smithi096 ceph-mon[124666]: pgmap v7500: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 245 KiB/s wr, 9 op/s 2023-05-08T07:36:57.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:57 smithi186 ceph-mon[126480]: pgmap v7500: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 245 KiB/s wr, 9 op/s 2023-05-08T07:36:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13957.880046 secs 2023-05-08T07:36:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:59 smithi133 ceph-mon[125939]: pgmap v7501: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 245 KiB/s wr, 9 op/s 2023-05-08T07:36:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:36:59 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:36:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13957.880046 secs 2023-05-08T07:36:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:59 smithi096 ceph-mon[124666]: pgmap v7501: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 245 KiB/s wr, 9 op/s 2023-05-08T07:36:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:36:59 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:36:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13957.880046 secs 2023-05-08T07:36:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:59 smithi186 ceph-mon[126480]: pgmap v7501: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 245 KiB/s wr, 9 op/s 2023-05-08T07:36:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:36:59 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:37:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:37:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:37:00.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:37:00.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:37:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:37:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:37:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13959.720703 secs 2023-05-08T07:37:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:01 smithi133 ceph-mon[125939]: pgmap v7502: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 438 KiB/s wr, 15 op/s 2023-05-08T07:37:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:01 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:37:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13959.720703 secs 2023-05-08T07:37:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:01 smithi096 ceph-mon[124666]: pgmap v7502: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 438 KiB/s wr, 15 op/s 2023-05-08T07:37:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:01 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:37:01.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13959.720703 secs 2023-05-08T07:37:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:01 smithi186 ceph-mon[126480]: pgmap v7502: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 438 KiB/s wr, 15 op/s 2023-05-08T07:37:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:01 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:37:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:03 smithi133 ceph-mon[125939]: pgmap v7503: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 287 KiB/s wr, 10 op/s 2023-05-08T07:37:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:03 smithi096 ceph-mon[124666]: pgmap v7503: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 287 KiB/s wr, 10 op/s 2023-05-08T07:37:03.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:03 smithi186 ceph-mon[126480]: pgmap v7503: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 287 KiB/s wr, 10 op/s 2023-05-08T07:37:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13962.880167 secs 2023-05-08T07:37:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:04 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:37:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:04 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:37:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13962.880167 secs 2023-05-08T07:37:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:04 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:37:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:04 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:37:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13962.880167 secs 2023-05-08T07:37:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:04 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:37:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:04 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:37:05.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13963.438039 secs 2023-05-08T07:37:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:05 smithi133 ceph-mon[125939]: pgmap v7504: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 332 KiB/s wr, 28 op/s 2023-05-08T07:37:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13963.438039 secs 2023-05-08T07:37:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:05 smithi096 ceph-mon[124666]: pgmap v7504: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 332 KiB/s wr, 28 op/s 2023-05-08T07:37:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13963.438039 secs 2023-05-08T07:37:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:05 smithi186 ceph-mon[126480]: pgmap v7504: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 332 KiB/s wr, 28 op/s 2023-05-08T07:37:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13964.720848 secs 2023-05-08T07:37:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:06 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:37:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13964.720848 secs 2023-05-08T07:37:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:06 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:37:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13964.720848 secs 2023-05-08T07:37:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:06 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:37:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:07 smithi133 ceph-mon[125939]: pgmap v7505: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 239 KiB/s wr, 23 op/s 2023-05-08T07:37:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:07 smithi096 ceph-mon[124666]: pgmap v7505: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 239 KiB/s wr, 23 op/s 2023-05-08T07:37:07.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:07 smithi186 ceph-mon[126480]: pgmap v7505: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 239 KiB/s wr, 23 op/s 2023-05-08T07:37:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:37:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:37:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:37:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:37:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:37:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:37:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13967.880286 secs 2023-05-08T07:37:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:09 smithi133 ceph-mon[125939]: pgmap v7506: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 239 KiB/s wr, 23 op/s 2023-05-08T07:37:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13967.880286 secs 2023-05-08T07:37:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:09 smithi096 ceph-mon[124666]: pgmap v7506: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 239 KiB/s wr, 23 op/s 2023-05-08T07:37:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13967.880286 secs 2023-05-08T07:37:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:09 smithi186 ceph-mon[126480]: pgmap v7506: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 239 KiB/s wr, 23 op/s 2023-05-08T07:37:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13968.438162 secs 2023-05-08T07:37:10.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13968.438162 secs 2023-05-08T07:37:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13968.438162 secs 2023-05-08T07:37:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13969.720934 secs 2023-05-08T07:37:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:11 smithi133 ceph-mon[125939]: pgmap v7507: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 331 KiB/s wr, 27 op/s 2023-05-08T07:37:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:11 smithi133 ceph-mon[125939]: osdmap e546: 12 total, 12 up, 12 in 2023-05-08T07:37:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:11 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:37:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13969.720934 secs 2023-05-08T07:37:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:11 smithi096 ceph-mon[124666]: pgmap v7507: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 331 KiB/s wr, 27 op/s 2023-05-08T07:37:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:11 smithi096 ceph-mon[124666]: osdmap e546: 12 total, 12 up, 12 in 2023-05-08T07:37:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:11 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:37:11.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13969.720934 secs 2023-05-08T07:37:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:11 smithi186 ceph-mon[126480]: pgmap v7507: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 331 KiB/s wr, 27 op/s 2023-05-08T07:37:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:11 smithi186 ceph-mon[126480]: osdmap e546: 12 total, 12 up, 12 in 2023-05-08T07:37:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:11 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:37:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:13 smithi133 ceph-mon[125939]: pgmap v7509: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 166 KiB/s wr, 26 op/s 2023-05-08T07:37:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:13 smithi096 ceph-mon[124666]: pgmap v7509: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 166 KiB/s wr, 26 op/s 2023-05-08T07:37:13.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:13 smithi186 ceph-mon[126480]: pgmap v7509: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 166 KiB/s wr, 26 op/s 2023-05-08T07:37:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13972.880406 secs 2023-05-08T07:37:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13972.880406 secs 2023-05-08T07:37:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13972.880406 secs 2023-05-08T07:37:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13973.438274 secs 2023-05-08T07:37:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:15 smithi133 ceph-mon[125939]: pgmap v7510: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 119 KiB/s wr, 8 op/s 2023-05-08T07:37:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13973.438274 secs 2023-05-08T07:37:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:15 smithi096 ceph-mon[124666]: pgmap v7510: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 119 KiB/s wr, 8 op/s 2023-05-08T07:37:15.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13973.438274 secs 2023-05-08T07:37:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:15 smithi186 ceph-mon[126480]: pgmap v7510: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 119 KiB/s wr, 8 op/s 2023-05-08T07:37:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13974.721000 secs 2023-05-08T07:37:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:16 smithi133 ceph-mon[125939]: osdmap e547: 12 total, 12 up, 12 in 2023-05-08T07:37:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13974.721000 secs 2023-05-08T07:37:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:16 smithi096 ceph-mon[124666]: osdmap e547: 12 total, 12 up, 12 in 2023-05-08T07:37:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13974.721000 secs 2023-05-08T07:37:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:16 smithi186 ceph-mon[126480]: osdmap e547: 12 total, 12 up, 12 in 2023-05-08T07:37:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:17 smithi133 ceph-mon[125939]: pgmap v7511: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 119 KiB/s wr, 8 op/s 2023-05-08T07:37:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:17 smithi096 ceph-mon[124666]: pgmap v7511: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 119 KiB/s wr, 8 op/s 2023-05-08T07:37:17.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:17 smithi186 ceph-mon[126480]: pgmap v7511: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 119 KiB/s wr, 8 op/s 2023-05-08T07:37:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13977.880537 secs 2023-05-08T07:37:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:19 smithi133 ceph-mon[125939]: pgmap v7513: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 KiB/s wr, 5 op/s 2023-05-08T07:37:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13977.880537 secs 2023-05-08T07:37:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:19 smithi096 ceph-mon[124666]: pgmap v7513: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 KiB/s wr, 5 op/s 2023-05-08T07:37:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13977.880537 secs 2023-05-08T07:37:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:19 smithi186 ceph-mon[126480]: pgmap v7513: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 KiB/s wr, 5 op/s 2023-05-08T07:37:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13978.438391 secs 2023-05-08T07:37:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13978.438391 secs 2023-05-08T07:37:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13978.438391 secs 2023-05-08T07:37:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13979.721118 secs 2023-05-08T07:37:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:21 smithi133 ceph-mon[125939]: pgmap v7514: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 KiB/s wr, 8 op/s 2023-05-08T07:37:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13979.721118 secs 2023-05-08T07:37:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:21 smithi096 ceph-mon[124666]: pgmap v7514: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 KiB/s wr, 8 op/s 2023-05-08T07:37:21.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13979.721118 secs 2023-05-08T07:37:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:21 smithi186 ceph-mon[126480]: pgmap v7514: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 KiB/s wr, 8 op/s 2023-05-08T07:37:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:23 smithi133 ceph-mon[125939]: pgmap v7515: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 8 op/s 2023-05-08T07:37:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:23 smithi096 ceph-mon[124666]: pgmap v7515: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 8 op/s 2023-05-08T07:37:23.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:23 smithi186 ceph-mon[126480]: pgmap v7515: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 8 op/s 2023-05-08T07:37:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13982.880654 secs 2023-05-08T07:37:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13982.880654 secs 2023-05-08T07:37:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13982.880654 secs 2023-05-08T07:37:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13983.438507 secs 2023-05-08T07:37:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:25 smithi133 ceph-mon[125939]: pgmap v7516: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 113 KiB/s wr, 8 op/s 2023-05-08T07:37:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13983.438507 secs 2023-05-08T07:37:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:25 smithi096 ceph-mon[124666]: pgmap v7516: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 113 KiB/s wr, 8 op/s 2023-05-08T07:37:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13983.438507 secs 2023-05-08T07:37:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:25 smithi186 ceph-mon[126480]: pgmap v7516: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 113 KiB/s wr, 8 op/s 2023-05-08T07:37:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13984.721254 secs 2023-05-08T07:37:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13984.721254 secs 2023-05-08T07:37:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13984.721254 secs 2023-05-08T07:37:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:27 smithi133 ceph-mon[125939]: pgmap v7517: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 113 KiB/s wr, 8 op/s 2023-05-08T07:37:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:27 smithi096 ceph-mon[124666]: pgmap v7517: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 113 KiB/s wr, 8 op/s 2023-05-08T07:37:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:27 smithi186 ceph-mon[126480]: pgmap v7517: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 113 KiB/s wr, 8 op/s 2023-05-08T07:37:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13987.880724 secs 2023-05-08T07:37:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:29 smithi133 ceph-mon[125939]: pgmap v7518: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 95 KiB/s wr, 7 op/s 2023-05-08T07:37:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13987.880724 secs 2023-05-08T07:37:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:29 smithi096 ceph-mon[124666]: pgmap v7518: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 95 KiB/s wr, 7 op/s 2023-05-08T07:37:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13987.880724 secs 2023-05-08T07:37:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:29 smithi186 ceph-mon[126480]: pgmap v7518: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 95 KiB/s wr, 7 op/s 2023-05-08T07:37:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13988.438619 secs 2023-05-08T07:37:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13988.438619 secs 2023-05-08T07:37:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13988.438619 secs 2023-05-08T07:37:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13989.721384 secs 2023-05-08T07:37:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:31 smithi096 ceph-mon[124666]: pgmap v7519: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 95 KiB/s wr, 11 op/s 2023-05-08T07:37:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13989.721384 secs 2023-05-08T07:37:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:31 smithi186 ceph-mon[126480]: pgmap v7519: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 95 KiB/s wr, 11 op/s 2023-05-08T07:37:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13989.721384 secs 2023-05-08T07:37:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:31 smithi133 ceph-mon[125939]: pgmap v7519: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 95 KiB/s wr, 11 op/s 2023-05-08T07:37:32.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:37:32.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:37:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:37:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:33 smithi096 ceph-mon[124666]: pgmap v7520: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 75 KiB/s wr, 7 op/s 2023-05-08T07:37:33.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:33 smithi186 ceph-mon[126480]: pgmap v7520: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 75 KiB/s wr, 7 op/s 2023-05-08T07:37:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:33 smithi133 ceph-mon[125939]: pgmap v7520: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 75 KiB/s wr, 7 op/s 2023-05-08T07:37:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13992.880869 secs 2023-05-08T07:37:34.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13992.880869 secs 2023-05-08T07:37:35.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13992.880869 secs 2023-05-08T07:37:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13993.438690 secs 2023-05-08T07:37:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:35 smithi186 ceph-mon[126480]: pgmap v7521: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 170 KiB/s wr, 10 op/s 2023-05-08T07:37:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:37:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:37:35.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:37:35.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:37:35.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:37:35.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:37:35.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:37:35.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:37:35.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:37:35.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:37:35.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:37:35.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:37:35.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:37:35.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:37:35.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:37:35.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:37:35.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:37:35.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:37:35.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:37:35.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:37:35.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:37:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13993.438690 secs 2023-05-08T07:37:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:35 smithi133 ceph-mon[125939]: pgmap v7521: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 170 KiB/s wr, 10 op/s 2023-05-08T07:37:35.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:37:35.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:37:35.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:37:35.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:37:35.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:37:35.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:37:35.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:37:35.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:37:35.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:37:35.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:37:35.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:37:35.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:37:35.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:37:35.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:37:35.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:37:35.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:37:35.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:37:35.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:37:35.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:37:35.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:37:35.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:37:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13993.438690 secs 2023-05-08T07:37:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:35 smithi096 ceph-mon[124666]: pgmap v7521: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 170 KiB/s wr, 10 op/s 2023-05-08T07:37:36.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:37:36.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:37:36.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:37:36.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:37:36.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:37:36.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:37:36.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:37:36.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:37:36.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:37:36.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:37:36.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:37:36.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:37:36.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:37:36.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:37:36.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:37:36.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:37:36.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:37:36.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:37:36.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:37:36.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:37:36.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:37:36.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13994.721528 secs 2023-05-08T07:37:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:36 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi096 to 135.8M 2023-05-08T07:37:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:36 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi096 to 142415990: error parsing value: Value '142415990' is below minimum 939524096 2023-05-08T07:37:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:36 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T07:37:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:36 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T07:37:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:36 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T07:37:36.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:36 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T07:37:36.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:36 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:37:36.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:36 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T07:37:36.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:36 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T07:37:36.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:36 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:37:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13994.721528 secs 2023-05-08T07:37:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:36 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi096 to 135.8M 2023-05-08T07:37:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:36 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi096 to 142415990: error parsing value: Value '142415990' is below minimum 939524096 2023-05-08T07:37:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:36 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T07:37:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:36 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T07:37:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:36 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T07:37:36.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:36 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T07:37:36.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:36 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:37:36.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:36 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T07:37:36.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:36 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T07:37:36.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:36 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:37:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13994.721528 secs 2023-05-08T07:37:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:36 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi096 to 135.8M 2023-05-08T07:37:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:36 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi096 to 142415990: error parsing value: Value '142415990' is below minimum 939524096 2023-05-08T07:37:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:36 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T07:37:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:36 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T07:37:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:36 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T07:37:37.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:36 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T07:37:37.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:36 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:37:37.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:36 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T07:37:37.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:36 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T07:37:37.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:36 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:37:37.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:37 smithi186 ceph-mon[126480]: pgmap v7522: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 95 KiB/s wr, 7 op/s 2023-05-08T07:37:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:37 smithi133 ceph-mon[125939]: pgmap v7522: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 95 KiB/s wr, 7 op/s 2023-05-08T07:37:38.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:37 smithi096 ceph-mon[124666]: pgmap v7522: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 95 KiB/s wr, 7 op/s 2023-05-08T07:37:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13997.880978 secs 2023-05-08T07:37:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:39 smithi186 ceph-mon[126480]: pgmap v7523: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 95 KiB/s wr, 7 op/s 2023-05-08T07:37:39.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13997.880978 secs 2023-05-08T07:37:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:39 smithi133 ceph-mon[125939]: pgmap v7523: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 95 KiB/s wr, 7 op/s 2023-05-08T07:37:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13997.880978 secs 2023-05-08T07:37:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:39 smithi096 ceph-mon[124666]: pgmap v7523: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 95 KiB/s wr, 7 op/s 2023-05-08T07:37:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 13998.438798 secs 2023-05-08T07:37:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 13998.438798 secs 2023-05-08T07:37:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 13998.438798 secs 2023-05-08T07:37:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:41 smithi186 ceph-mon[126480]: pgmap v7524: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 96 KiB/s wr, 10 op/s 2023-05-08T07:37:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:41 smithi133 ceph-mon[125939]: pgmap v7524: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 96 KiB/s wr, 10 op/s 2023-05-08T07:37:42.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:41 smithi096 ceph-mon[124666]: pgmap v7524: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 96 KiB/s wr, 10 op/s 2023-05-08T07:37:43.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:43 smithi186 ceph-mon[126480]: pgmap v7525: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 95 KiB/s wr, 6 op/s 2023-05-08T07:37:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:37:43.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:43 smithi133 ceph-mon[125939]: pgmap v7525: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 95 KiB/s wr, 6 op/s 2023-05-08T07:37:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:37:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:43 smithi096 ceph-mon[124666]: pgmap v7525: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 95 KiB/s wr, 6 op/s 2023-05-08T07:37:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:37:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14002.881075 secs 2023-05-08T07:37:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:37:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:37:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:37:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14002.881075 secs 2023-05-08T07:37:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:37:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:37:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:37:45.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14002.881075 secs 2023-05-08T07:37:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:37:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:37:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:37:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14003.438873 secs 2023-05-08T07:37:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:45 smithi186 ceph-mon[126480]: pgmap v7526: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 139 KiB/s wr, 9 op/s 2023-05-08T07:37:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14003.438873 secs 2023-05-08T07:37:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:45 smithi133 ceph-mon[125939]: pgmap v7526: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 139 KiB/s wr, 9 op/s 2023-05-08T07:37:46.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14003.438873 secs 2023-05-08T07:37:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:45 smithi096 ceph-mon[124666]: pgmap v7526: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 139 KiB/s wr, 9 op/s 2023-05-08T07:37:47.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:47 smithi186 ceph-mon[126480]: pgmap v7527: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 44 KiB/s wr, 6 op/s 2023-05-08T07:37:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:47 smithi133 ceph-mon[125939]: pgmap v7527: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 44 KiB/s wr, 6 op/s 2023-05-08T07:37:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:47 smithi096 ceph-mon[124666]: pgmap v7527: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 44 KiB/s wr, 6 op/s 2023-05-08T07:37:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14007.881177 secs 2023-05-08T07:37:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:49 smithi186 ceph-mon[126480]: pgmap v7528: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 44 KiB/s wr, 6 op/s 2023-05-08T07:37:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14007.881177 secs 2023-05-08T07:37:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:49 smithi133 ceph-mon[125939]: pgmap v7528: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 44 KiB/s wr, 6 op/s 2023-05-08T07:37:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14007.881177 secs 2023-05-08T07:37:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:49 smithi096 ceph-mon[124666]: pgmap v7528: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 44 KiB/s wr, 6 op/s 2023-05-08T07:37:51.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:51 smithi186 ceph-mon[126480]: pgmap v7529: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 128 KiB/s wr, 10 op/s 2023-05-08T07:37:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:37:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:51 smithi133 ceph-mon[125939]: pgmap v7529: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 128 KiB/s wr, 10 op/s 2023-05-08T07:37:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:37:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:51 smithi096 ceph-mon[124666]: pgmap v7529: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 128 KiB/s wr, 10 op/s 2023-05-08T07:37:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:37:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:52 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:37:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:37:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:37:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:52 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:37:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:37:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:37:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:52 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:37:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:37:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:37:53.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:53 smithi186 ceph-mon[126480]: pgmap v7530: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 127 KiB/s wr, 6 op/s 2023-05-08T07:37:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:53 smithi133 ceph-mon[125939]: pgmap v7530: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 127 KiB/s wr, 6 op/s 2023-05-08T07:37:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:53 smithi096 ceph-mon[124666]: pgmap v7530: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 127 KiB/s wr, 6 op/s 2023-05-08T07:37:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14012.881292 secs 2023-05-08T07:37:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14012.881292 secs 2023-05-08T07:37:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14012.881292 secs 2023-05-08T07:37:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:55 smithi186 ceph-mon[126480]: pgmap v7531: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 301 KiB/s wr, 11 op/s 2023-05-08T07:37:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:55 smithi133 ceph-mon[125939]: pgmap v7531: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 301 KiB/s wr, 11 op/s 2023-05-08T07:37:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:55 smithi096 ceph-mon[124666]: pgmap v7531: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 301 KiB/s wr, 11 op/s 2023-05-08T07:37:57.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:57 smithi186 ceph-mon[126480]: pgmap v7532: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 257 KiB/s wr, 9 op/s 2023-05-08T07:37:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:57 smithi133 ceph-mon[125939]: pgmap v7532: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 257 KiB/s wr, 9 op/s 2023-05-08T07:37:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:57 smithi096 ceph-mon[124666]: pgmap v7532: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 257 KiB/s wr, 9 op/s 2023-05-08T07:37:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14017.881428 secs 2023-05-08T07:37:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:59 smithi186 ceph-mon[126480]: pgmap v7533: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 257 KiB/s wr, 9 op/s 2023-05-08T07:37:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:37:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14018.439260 secs 2023-05-08T07:37:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14017.881428 secs 2023-05-08T07:37:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:59 smithi133 ceph-mon[125939]: pgmap v7533: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 257 KiB/s wr, 9 op/s 2023-05-08T07:37:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:37:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14018.439260 secs 2023-05-08T07:38:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14017.881428 secs 2023-05-08T07:38:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:59 smithi096 ceph-mon[124666]: pgmap v7533: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 257 KiB/s wr, 9 op/s 2023-05-08T07:38:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:37:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14018.439260 secs 2023-05-08T07:38:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:00 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:38:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:38:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:38:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:00 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:38:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:38:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:38:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:00 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:38:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:38:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:38:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:01 smithi186 ceph-mon[126480]: pgmap v7534: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 313 KiB/s wr, 13 op/s 2023-05-08T07:38:01.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:01 smithi133 ceph-mon[125939]: pgmap v7534: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 313 KiB/s wr, 13 op/s 2023-05-08T07:38:02.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:01 smithi096 ceph-mon[124666]: pgmap v7534: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 313 KiB/s wr, 13 op/s 2023-05-08T07:38:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:03 smithi133 ceph-mon[125939]: pgmap v7535: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 230 KiB/s wr, 10 op/s 2023-05-08T07:38:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:03 smithi096 ceph-mon[124666]: pgmap v7535: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 230 KiB/s wr, 10 op/s 2023-05-08T07:38:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:03 smithi186 ceph-mon[126480]: pgmap v7535: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 230 KiB/s wr, 10 op/s 2023-05-08T07:38:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14022.881537 secs 2023-05-08T07:38:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14023.439382 secs 2023-05-08T07:38:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14022.881537 secs 2023-05-08T07:38:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14023.439382 secs 2023-05-08T07:38:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14022.881537 secs 2023-05-08T07:38:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14023.439382 secs 2023-05-08T07:38:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:05 smithi133 ceph-mon[125939]: pgmap v7536: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 372 KiB/s wr, 26 op/s 2023-05-08T07:38:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:05 smithi096 ceph-mon[124666]: pgmap v7536: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 372 KiB/s wr, 26 op/s 2023-05-08T07:38:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:05 smithi186 ceph-mon[126480]: pgmap v7536: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 372 KiB/s wr, 26 op/s 2023-05-08T07:38:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:07 smithi133 ceph-mon[125939]: pgmap v7537: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 198 KiB/s wr, 21 op/s 2023-05-08T07:38:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:07 smithi096 ceph-mon[124666]: pgmap v7537: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 198 KiB/s wr, 21 op/s 2023-05-08T07:38:08.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:07 smithi186 ceph-mon[126480]: pgmap v7537: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 198 KiB/s wr, 21 op/s 2023-05-08T07:38:09.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14027.881654 secs 2023-05-08T07:38:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:09 smithi133 ceph-mon[125939]: pgmap v7538: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 198 KiB/s wr, 21 op/s 2023-05-08T07:38:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14027.881654 secs 2023-05-08T07:38:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:09 smithi096 ceph-mon[124666]: pgmap v7538: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 198 KiB/s wr, 21 op/s 2023-05-08T07:38:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14027.881654 secs 2023-05-08T07:38:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:09 smithi186 ceph-mon[126480]: pgmap v7538: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 198 KiB/s wr, 21 op/s 2023-05-08T07:38:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:11 smithi133 ceph-mon[125939]: pgmap v7539: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 288 KiB/s wr, 25 op/s 2023-05-08T07:38:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:11 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:38:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:11 smithi096 ceph-mon[124666]: pgmap v7539: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 288 KiB/s wr, 25 op/s 2023-05-08T07:38:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:11 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:38:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:11 smithi186 ceph-mon[126480]: pgmap v7539: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 288 KiB/s wr, 25 op/s 2023-05-08T07:38:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:11 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:38:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:12 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:38:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:12 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:38:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:12 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:38:13.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:12 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:38:13.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:12 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:38:13.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:12 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:38:13.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:12 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:38:13.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:12 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:38:13.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:12 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:38:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:13 smithi133 ceph-mon[125939]: pgmap v7540: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 232 KiB/s wr, 20 op/s 2023-05-08T07:38:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:13 smithi096 ceph-mon[124666]: pgmap v7540: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 232 KiB/s wr, 20 op/s 2023-05-08T07:38:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:13 smithi186 ceph-mon[126480]: pgmap v7540: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 232 KiB/s wr, 20 op/s 2023-05-08T07:38:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14032.881772 secs 2023-05-08T07:38:15.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14032.881772 secs 2023-05-08T07:38:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14032.881772 secs 2023-05-08T07:38:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:15 smithi133 ceph-mon[125939]: pgmap v7541: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 261 KiB/s wr, 23 op/s 2023-05-08T07:38:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:15 smithi096 ceph-mon[124666]: pgmap v7541: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 261 KiB/s wr, 23 op/s 2023-05-08T07:38:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:15 smithi186 ceph-mon[126480]: pgmap v7541: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 261 KiB/s wr, 23 op/s 2023-05-08T07:38:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:17 smithi133 ceph-mon[125939]: pgmap v7542: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 119 KiB/s wr, 7 op/s 2023-05-08T07:38:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:17 smithi096 ceph-mon[124666]: pgmap v7542: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 119 KiB/s wr, 7 op/s 2023-05-08T07:38:18.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:17 smithi186 ceph-mon[126480]: pgmap v7542: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 119 KiB/s wr, 7 op/s 2023-05-08T07:38:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14037.881893 secs 2023-05-08T07:38:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:19 smithi133 ceph-mon[125939]: pgmap v7543: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 119 KiB/s wr, 7 op/s 2023-05-08T07:38:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14037.881893 secs 2023-05-08T07:38:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:19 smithi096 ceph-mon[124666]: pgmap v7543: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 119 KiB/s wr, 7 op/s 2023-05-08T07:38:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14037.881893 secs 2023-05-08T07:38:20.244 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:19 smithi186 ceph-mon[126480]: pgmap v7543: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 119 KiB/s wr, 7 op/s 2023-05-08T07:38:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:21 smithi133 ceph-mon[125939]: pgmap v7544: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 119 KiB/s wr, 10 op/s 2023-05-08T07:38:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:21 smithi096 ceph-mon[124666]: pgmap v7544: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 119 KiB/s wr, 10 op/s 2023-05-08T07:38:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:21 smithi186 ceph-mon[126480]: pgmap v7544: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 119 KiB/s wr, 10 op/s 2023-05-08T07:38:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:23 smithi133 ceph-mon[125939]: pgmap v7545: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 6 op/s 2023-05-08T07:38:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:23 smithi096 ceph-mon[124666]: pgmap v7545: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 6 op/s 2023-05-08T07:38:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:23 smithi186 ceph-mon[126480]: pgmap v7545: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 6 op/s 2023-05-08T07:38:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14042.881997 secs 2023-05-08T07:38:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14043.439815 secs 2023-05-08T07:38:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14042.881997 secs 2023-05-08T07:38:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14043.439815 secs 2023-05-08T07:38:25.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14042.881997 secs 2023-05-08T07:38:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14043.439815 secs 2023-05-08T07:38:25.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:25 smithi133 ceph-mon[125939]: pgmap v7546: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 195 KiB/s wr, 12 op/s 2023-05-08T07:38:26.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:25 smithi096 ceph-mon[124666]: pgmap v7546: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 195 KiB/s wr, 12 op/s 2023-05-08T07:38:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:25 smithi186 ceph-mon[126480]: pgmap v7546: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 195 KiB/s wr, 12 op/s 2023-05-08T07:38:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14044.722742 secs 2023-05-08T07:38:27.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14044.722742 secs 2023-05-08T07:38:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14044.722742 secs 2023-05-08T07:38:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:27 smithi133 ceph-mon[125939]: pgmap v7547: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 166 KiB/s wr, 9 op/s 2023-05-08T07:38:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:27 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:38:27.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:27 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:38:27.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:27 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:38:27.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:27 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:38:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:27 smithi096 ceph-mon[124666]: pgmap v7547: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 166 KiB/s wr, 9 op/s 2023-05-08T07:38:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:27 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:38:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:27 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:38:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:27 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:38:28.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:27 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:38:28.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:27 smithi186 ceph-mon[126480]: pgmap v7547: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 166 KiB/s wr, 9 op/s 2023-05-08T07:38:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:27 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:38:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:27 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:38:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:27 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:38:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:27 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:38:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14047.882119 secs 2023-05-08T07:38:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:29 smithi133 ceph-mon[125939]: pgmap v7548: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 166 KiB/s wr, 9 op/s 2023-05-08T07:38:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14048.439904 secs 2023-05-08T07:38:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14047.882119 secs 2023-05-08T07:38:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:29 smithi096 ceph-mon[124666]: pgmap v7548: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 166 KiB/s wr, 9 op/s 2023-05-08T07:38:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14048.439904 secs 2023-05-08T07:38:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14047.882119 secs 2023-05-08T07:38:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:29 smithi186 ceph-mon[126480]: pgmap v7548: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 166 KiB/s wr, 9 op/s 2023-05-08T07:38:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14048.439904 secs 2023-05-08T07:38:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14049.722864 secs 2023-05-08T07:38:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:31 smithi133 ceph-mon[125939]: pgmap v7549: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 255 KiB/s wr, 13 op/s 2023-05-08T07:38:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:31 smithi133 ceph-mon[125939]: osdmap e548: 12 total, 12 up, 12 in 2023-05-08T07:38:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14049.722864 secs 2023-05-08T07:38:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:31 smithi096 ceph-mon[124666]: pgmap v7549: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 255 KiB/s wr, 13 op/s 2023-05-08T07:38:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:31 smithi096 ceph-mon[124666]: osdmap e548: 12 total, 12 up, 12 in 2023-05-08T07:38:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14049.722864 secs 2023-05-08T07:38:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:31 smithi186 ceph-mon[126480]: pgmap v7549: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 255 KiB/s wr, 13 op/s 2023-05-08T07:38:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:31 smithi186 ceph-mon[126480]: osdmap e548: 12 total, 12 up, 12 in 2023-05-08T07:38:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:33 smithi133 ceph-mon[125939]: pgmap v7551: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 306 KiB/s wr, 12 op/s 2023-05-08T07:38:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:33 smithi096 ceph-mon[124666]: pgmap v7551: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 306 KiB/s wr, 12 op/s 2023-05-08T07:38:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:33 smithi186 ceph-mon[126480]: pgmap v7551: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 306 KiB/s wr, 12 op/s 2023-05-08T07:38:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14052.882246 secs 2023-05-08T07:38:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14053.440002 secs 2023-05-08T07:38:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14052.882246 secs 2023-05-08T07:38:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14053.440002 secs 2023-05-08T07:38:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14052.882246 secs 2023-05-08T07:38:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14053.440002 secs 2023-05-08T07:38:35.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:35 smithi133 ceph-mon[125939]: pgmap v7552: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 108 KiB/s wr, 9 op/s 2023-05-08T07:38:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:38:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:35 smithi096 ceph-mon[124666]: pgmap v7552: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 108 KiB/s wr, 9 op/s 2023-05-08T07:38:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:38:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:35 smithi186 ceph-mon[126480]: pgmap v7552: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 108 KiB/s wr, 9 op/s 2023-05-08T07:38:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:38:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14054.722981 secs 2023-05-08T07:38:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:38:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:38:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:38:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14054.722981 secs 2023-05-08T07:38:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:38:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:38:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:38:37.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14054.722981 secs 2023-05-08T07:38:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:38:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:38:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:38:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:37 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:38:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:37 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T07:38:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:37 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T07:38:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:37 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:38:37.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:37 smithi133 ceph-mon[125939]: pgmap v7553: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 108 KiB/s wr, 9 op/s 2023-05-08T07:38:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:37 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:38:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:37 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T07:38:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:37 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T07:38:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:37 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:38:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:37 smithi096 ceph-mon[124666]: pgmap v7553: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 108 KiB/s wr, 9 op/s 2023-05-08T07:38:38.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:37 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:38:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:37 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T07:38:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:37 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T07:38:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:37 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:38:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:37 smithi186 ceph-mon[126480]: pgmap v7553: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 108 KiB/s wr, 9 op/s 2023-05-08T07:38:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14057.882369 secs 2023-05-08T07:38:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:39 smithi133 ceph-mon[125939]: pgmap v7554: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 108 KiB/s wr, 9 op/s 2023-05-08T07:38:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14058.440104 secs 2023-05-08T07:38:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14057.882369 secs 2023-05-08T07:38:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:39 smithi096 ceph-mon[124666]: pgmap v7554: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 108 KiB/s wr, 9 op/s 2023-05-08T07:38:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14058.440104 secs 2023-05-08T07:38:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14057.882369 secs 2023-05-08T07:38:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:39 smithi186 ceph-mon[126480]: pgmap v7554: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 108 KiB/s wr, 9 op/s 2023-05-08T07:38:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14058.440104 secs 2023-05-08T07:38:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:41 smithi133 ceph-mon[125939]: pgmap v7555: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 108 KiB/s wr, 8 op/s 2023-05-08T07:38:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:41 smithi133 ceph-mon[125939]: osdmap e549: 12 total, 12 up, 12 in 2023-05-08T07:38:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:41 smithi096 ceph-mon[124666]: pgmap v7555: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 108 KiB/s wr, 8 op/s 2023-05-08T07:38:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:41 smithi096 ceph-mon[124666]: osdmap e549: 12 total, 12 up, 12 in 2023-05-08T07:38:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:41 smithi186 ceph-mon[126480]: pgmap v7555: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 108 KiB/s wr, 8 op/s 2023-05-08T07:38:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:41 smithi186 ceph-mon[126480]: osdmap e549: 12 total, 12 up, 12 in 2023-05-08T07:38:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:38:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:38:43.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:38:43.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:43 smithi133 ceph-mon[125939]: pgmap v7557: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 108 KiB/s wr, 8 op/s 2023-05-08T07:38:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:43 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:38:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:38:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:38:44.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:43 smithi096 ceph-mon[124666]: pgmap v7557: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 108 KiB/s wr, 8 op/s 2023-05-08T07:38:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:43 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:38:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:38:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:38:44.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:43 smithi186 ceph-mon[126480]: pgmap v7557: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 108 KiB/s wr, 8 op/s 2023-05-08T07:38:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:43 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:38:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:38:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:38:44.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14062.882473 secs 2023-05-08T07:38:45.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14062.882473 secs 2023-05-08T07:38:45.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14062.882473 secs 2023-05-08T07:38:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:45 smithi133 ceph-mon[125939]: pgmap v7558: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 143 KiB/s wr, 8 op/s 2023-05-08T07:38:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:45 smithi096 ceph-mon[124666]: pgmap v7558: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 143 KiB/s wr, 8 op/s 2023-05-08T07:38:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:45 smithi186 ceph-mon[126480]: pgmap v7558: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 143 KiB/s wr, 8 op/s 2023-05-08T07:38:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:47 smithi096 ceph-mon[124666]: pgmap v7559: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 143 KiB/s wr, 8 op/s 2023-05-08T07:38:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:38:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:47 smithi186 ceph-mon[126480]: pgmap v7559: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 143 KiB/s wr, 8 op/s 2023-05-08T07:38:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:38:48.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:47 smithi133 ceph-mon[125939]: pgmap v7559: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 143 KiB/s wr, 8 op/s 2023-05-08T07:38:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:38:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:48 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:38:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:38:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:38:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:48 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:38:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:38:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:38:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:48 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:38:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:38:49.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:38:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14067.882573 secs 2023-05-08T07:38:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:49 smithi096 ceph-mon[124666]: pgmap v7560: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 143 KiB/s wr, 8 op/s 2023-05-08T07:38:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14067.882573 secs 2023-05-08T07:38:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:49 smithi186 ceph-mon[126480]: pgmap v7560: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 143 KiB/s wr, 8 op/s 2023-05-08T07:38:50.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14067.882573 secs 2023-05-08T07:38:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:49 smithi133 ceph-mon[125939]: pgmap v7560: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 143 KiB/s wr, 8 op/s 2023-05-08T07:38:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:51 smithi096 ceph-mon[124666]: pgmap v7561: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 273 KiB/s wr, 11 op/s 2023-05-08T07:38:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:51 smithi186 ceph-mon[126480]: pgmap v7561: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 273 KiB/s wr, 11 op/s 2023-05-08T07:38:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:51 smithi133 ceph-mon[125939]: pgmap v7561: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 273 KiB/s wr, 11 op/s 2023-05-08T07:38:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:53 smithi186 ceph-mon[126480]: pgmap v7562: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 333 KiB/s rd, 251 KiB/s wr, 10 op/s 2023-05-08T07:38:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:53 smithi133 ceph-mon[125939]: pgmap v7562: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 333 KiB/s rd, 251 KiB/s wr, 10 op/s 2023-05-08T07:38:54.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:53 smithi096 ceph-mon[124666]: pgmap v7562: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 333 KiB/s rd, 251 KiB/s wr, 10 op/s 2023-05-08T07:38:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14072.882692 secs 2023-05-08T07:38:55.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14073.440460 secs 2023-05-08T07:38:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14072.882692 secs 2023-05-08T07:38:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14073.440460 secs 2023-05-08T07:38:55.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14072.882692 secs 2023-05-08T07:38:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14073.440460 secs 2023-05-08T07:38:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:55 smithi186 ceph-mon[126480]: pgmap v7563: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 323 KiB/s wr, 14 op/s 2023-05-08T07:38:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:55 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:38:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:55 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:38:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:55 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:38:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:55 smithi133 ceph-mon[125939]: pgmap v7563: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 323 KiB/s wr, 14 op/s 2023-05-08T07:38:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:55 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:38:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:55 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:38:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:55 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:38:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:55 smithi096 ceph-mon[124666]: pgmap v7563: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 323 KiB/s wr, 14 op/s 2023-05-08T07:38:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:55 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:38:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:55 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:38:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:55 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:38:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:57 smithi186 ceph-mon[126480]: pgmap v7564: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 293 KiB/s wr, 10 op/s 2023-05-08T07:38:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:57 smithi133 ceph-mon[125939]: pgmap v7564: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 293 KiB/s wr, 10 op/s 2023-05-08T07:38:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:57 smithi096 ceph-mon[124666]: pgmap v7564: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 293 KiB/s wr, 10 op/s 2023-05-08T07:38:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:58 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:38:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:58 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:38:59.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:58 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:39:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14077.882805 secs 2023-05-08T07:39:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:59 smithi186 ceph-mon[126480]: pgmap v7565: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 293 KiB/s wr, 10 op/s 2023-05-08T07:39:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:59 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:39:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:38:59 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:39:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14077.882805 secs 2023-05-08T07:39:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:59 smithi133 ceph-mon[125939]: pgmap v7565: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 293 KiB/s wr, 10 op/s 2023-05-08T07:39:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:59 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:39:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:38:59 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:39:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14077.882805 secs 2023-05-08T07:39:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:59 smithi096 ceph-mon[124666]: pgmap v7565: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 293 KiB/s wr, 10 op/s 2023-05-08T07:39:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:59 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:39:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:38:59 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:39:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14079.723635 secs 2023-05-08T07:39:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:01 smithi186 ceph-mon[126480]: pgmap v7566: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 490 KiB/s wr, 15 op/s 2023-05-08T07:39:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:01 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:39:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14079.723635 secs 2023-05-08T07:39:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:01 smithi133 ceph-mon[125939]: pgmap v7566: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 490 KiB/s wr, 15 op/s 2023-05-08T07:39:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:01 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:39:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14079.723635 secs 2023-05-08T07:39:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:01 smithi096 ceph-mon[124666]: pgmap v7566: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 490 KiB/s wr, 15 op/s 2023-05-08T07:39:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:01 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:39:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:03 smithi186 ceph-mon[126480]: pgmap v7567: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 293 KiB/s wr, 10 op/s 2023-05-08T07:39:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:39:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:03 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:39:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:03 smithi133 ceph-mon[125939]: pgmap v7567: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 293 KiB/s wr, 10 op/s 2023-05-08T07:39:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:39:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:03 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:39:04.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:03 smithi096 ceph-mon[124666]: pgmap v7567: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 293 KiB/s wr, 10 op/s 2023-05-08T07:39:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:39:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:03 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:39:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14082.882918 secs 2023-05-08T07:39:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14083.440642 secs 2023-05-08T07:39:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14082.882918 secs 2023-05-08T07:39:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14083.440642 secs 2023-05-08T07:39:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14082.882918 secs 2023-05-08T07:39:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14083.440642 secs 2023-05-08T07:39:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:05 smithi186 ceph-mon[126480]: pgmap v7568: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 348 KiB/s rd, 339 KiB/s wr, 28 op/s 2023-05-08T07:39:06.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:05 smithi133 ceph-mon[125939]: pgmap v7568: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 348 KiB/s rd, 339 KiB/s wr, 28 op/s 2023-05-08T07:39:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:05 smithi096 ceph-mon[124666]: pgmap v7568: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 348 KiB/s rd, 339 KiB/s wr, 28 op/s 2023-05-08T07:39:07.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14084.723788 secs 2023-05-08T07:39:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:06 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:39:07.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14084.723788 secs 2023-05-08T07:39:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:06 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:39:07.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14084.723788 secs 2023-05-08T07:39:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:06 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:39:08.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:07 smithi186 ceph-mon[126480]: pgmap v7569: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 243 KiB/s wr, 23 op/s 2023-05-08T07:39:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:07 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:39:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:07 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:39:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:07 smithi133 ceph-mon[125939]: pgmap v7569: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 243 KiB/s wr, 23 op/s 2023-05-08T07:39:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:07 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:39:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:07 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:39:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:07 smithi096 ceph-mon[124666]: pgmap v7569: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 243 KiB/s wr, 23 op/s 2023-05-08T07:39:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:07 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:39:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:07 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:39:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14087.883054 secs 2023-05-08T07:39:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:09 smithi186 ceph-mon[126480]: pgmap v7570: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 243 KiB/s wr, 23 op/s 2023-05-08T07:39:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14088.440743 secs 2023-05-08T07:39:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14087.883054 secs 2023-05-08T07:39:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:09 smithi133 ceph-mon[125939]: pgmap v7570: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 243 KiB/s wr, 23 op/s 2023-05-08T07:39:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14088.440743 secs 2023-05-08T07:39:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14087.883054 secs 2023-05-08T07:39:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:09 smithi096 ceph-mon[124666]: pgmap v7570: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 243 KiB/s wr, 23 op/s 2023-05-08T07:39:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14088.440743 secs 2023-05-08T07:39:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14089.723906 secs 2023-05-08T07:39:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:11 smithi186 ceph-mon[126480]: pgmap v7571: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 333 KiB/s wr, 27 op/s 2023-05-08T07:39:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:11 smithi186 ceph-mon[126480]: osdmap e550: 12 total, 12 up, 12 in 2023-05-08T07:39:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:11 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:39:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14089.723906 secs 2023-05-08T07:39:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:11 smithi133 ceph-mon[125939]: pgmap v7571: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 333 KiB/s wr, 27 op/s 2023-05-08T07:39:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:11 smithi133 ceph-mon[125939]: osdmap e550: 12 total, 12 up, 12 in 2023-05-08T07:39:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:11 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:39:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14089.723906 secs 2023-05-08T07:39:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:11 smithi096 ceph-mon[124666]: pgmap v7571: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 333 KiB/s wr, 27 op/s 2023-05-08T07:39:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:11 smithi096 ceph-mon[124666]: osdmap e550: 12 total, 12 up, 12 in 2023-05-08T07:39:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:11 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:39:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:13 smithi186 ceph-mon[126480]: pgmap v7573: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 163 KiB/s wr, 26 op/s 2023-05-08T07:39:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:13 smithi133 ceph-mon[125939]: pgmap v7573: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 163 KiB/s wr, 26 op/s 2023-05-08T07:39:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:13 smithi096 ceph-mon[124666]: pgmap v7573: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 163 KiB/s wr, 26 op/s 2023-05-08T07:39:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14092.883173 secs 2023-05-08T07:39:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14093.440861 secs 2023-05-08T07:39:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14092.883173 secs 2023-05-08T07:39:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14093.440861 secs 2023-05-08T07:39:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14092.883173 secs 2023-05-08T07:39:15.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14093.440861 secs 2023-05-08T07:39:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:15 smithi186 ceph-mon[126480]: pgmap v7574: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 116 KiB/s wr, 8 op/s 2023-05-08T07:39:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:15 smithi133 ceph-mon[125939]: pgmap v7574: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 116 KiB/s wr, 8 op/s 2023-05-08T07:39:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:15 smithi096 ceph-mon[124666]: pgmap v7574: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 116 KiB/s wr, 8 op/s 2023-05-08T07:39:17.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14094.723986 secs 2023-05-08T07:39:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14094.723986 secs 2023-05-08T07:39:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14094.723986 secs 2023-05-08T07:39:18.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:17 smithi186 ceph-mon[126480]: pgmap v7575: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 116 KiB/s wr, 8 op/s 2023-05-08T07:39:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:17 smithi133 ceph-mon[125939]: pgmap v7575: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 116 KiB/s wr, 8 op/s 2023-05-08T07:39:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:17 smithi096 ceph-mon[124666]: pgmap v7575: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 116 KiB/s wr, 8 op/s 2023-05-08T07:39:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14097.883312 secs 2023-05-08T07:39:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:19 smithi186 ceph-mon[126480]: pgmap v7576: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 116 KiB/s wr, 8 op/s 2023-05-08T07:39:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14098.440977 secs 2023-05-08T07:39:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14097.883312 secs 2023-05-08T07:39:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:19 smithi133 ceph-mon[125939]: pgmap v7576: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 116 KiB/s wr, 8 op/s 2023-05-08T07:39:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14098.440977 secs 2023-05-08T07:39:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14097.883312 secs 2023-05-08T07:39:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:19 smithi096 ceph-mon[124666]: pgmap v7576: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 116 KiB/s wr, 8 op/s 2023-05-08T07:39:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14098.440977 secs 2023-05-08T07:39:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14099.724085 secs 2023-05-08T07:39:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:21 smithi186 ceph-mon[126480]: pgmap v7577: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 37 KiB/s wr, 8 op/s 2023-05-08T07:39:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:21 smithi186 ceph-mon[126480]: osdmap e551: 12 total, 12 up, 12 in 2023-05-08T07:39:22.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14099.724085 secs 2023-05-08T07:39:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:21 smithi133 ceph-mon[125939]: pgmap v7577: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 37 KiB/s wr, 8 op/s 2023-05-08T07:39:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:21 smithi133 ceph-mon[125939]: osdmap e551: 12 total, 12 up, 12 in 2023-05-08T07:39:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14099.724085 secs 2023-05-08T07:39:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:21 smithi096 ceph-mon[124666]: pgmap v7577: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 37 KiB/s wr, 8 op/s 2023-05-08T07:39:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:21 smithi096 ceph-mon[124666]: osdmap e551: 12 total, 12 up, 12 in 2023-05-08T07:39:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:23 smithi186 ceph-mon[126480]: pgmap v7579: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 37 KiB/s wr, 8 op/s 2023-05-08T07:39:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:23 smithi133 ceph-mon[125939]: pgmap v7579: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 37 KiB/s wr, 8 op/s 2023-05-08T07:39:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:23 smithi096 ceph-mon[124666]: pgmap v7579: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 37 KiB/s wr, 8 op/s 2023-05-08T07:39:25.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14102.883442 secs 2023-05-08T07:39:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14103.441131 secs 2023-05-08T07:39:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14102.883442 secs 2023-05-08T07:39:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14103.441131 secs 2023-05-08T07:39:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14102.883442 secs 2023-05-08T07:39:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14103.441131 secs 2023-05-08T07:39:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:25 smithi186 ceph-mon[126480]: pgmap v7580: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 80 KiB/s wr, 8 op/s 2023-05-08T07:39:26.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:25 smithi133 ceph-mon[125939]: pgmap v7580: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 80 KiB/s wr, 8 op/s 2023-05-08T07:39:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:25 smithi096 ceph-mon[124666]: pgmap v7580: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 80 KiB/s wr, 8 op/s 2023-05-08T07:39:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14104.724184 secs 2023-05-08T07:39:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14104.724184 secs 2023-05-08T07:39:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14104.724184 secs 2023-05-08T07:39:28.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:27 smithi186 ceph-mon[126480]: pgmap v7581: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 80 KiB/s wr, 8 op/s 2023-05-08T07:39:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:27 smithi133 ceph-mon[125939]: pgmap v7581: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 80 KiB/s wr, 8 op/s 2023-05-08T07:39:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:27 smithi096 ceph-mon[124666]: pgmap v7581: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 80 KiB/s wr, 8 op/s 2023-05-08T07:39:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:28 smithi133 ceph-mon[125939]: pgmap v7582: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 80 KiB/s wr, 8 op/s 2023-05-08T07:39:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:28 smithi096 ceph-mon[124666]: pgmap v7582: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 80 KiB/s wr, 8 op/s 2023-05-08T07:39:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:28 smithi186 ceph-mon[126480]: pgmap v7582: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 80 KiB/s wr, 8 op/s 2023-05-08T07:39:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14107.883552 secs 2023-05-08T07:39:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14108.441272 secs 2023-05-08T07:39:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14107.883552 secs 2023-05-08T07:39:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14108.441272 secs 2023-05-08T07:39:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14107.883552 secs 2023-05-08T07:39:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14108.441272 secs 2023-05-08T07:39:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:30 smithi133 ceph-mon[125939]: pgmap v7583: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 8 op/s 2023-05-08T07:39:31.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:30 smithi096 ceph-mon[124666]: pgmap v7583: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 8 op/s 2023-05-08T07:39:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:30 smithi186 ceph-mon[126480]: pgmap v7583: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 8 op/s 2023-05-08T07:39:32.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14109.724292 secs 2023-05-08T07:39:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14109.724292 secs 2023-05-08T07:39:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14109.724292 secs 2023-05-08T07:39:33.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:32 smithi133 ceph-mon[125939]: pgmap v7584: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 47 KiB/s wr, 7 op/s 2023-05-08T07:39:33.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:32 smithi096 ceph-mon[124666]: pgmap v7584: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 47 KiB/s wr, 7 op/s 2023-05-08T07:39:33.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:32 smithi186 ceph-mon[126480]: pgmap v7584: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 47 KiB/s wr, 7 op/s 2023-05-08T07:39:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14112.883652 secs 2023-05-08T07:39:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14112.883652 secs 2023-05-08T07:39:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14112.883652 secs 2023-05-08T07:39:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14113.441371 secs 2023-05-08T07:39:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:35 smithi133 ceph-mon[125939]: pgmap v7585: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 85 KiB/s wr, 9 op/s 2023-05-08T07:39:35.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14113.441371 secs 2023-05-08T07:39:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:35 smithi096 ceph-mon[124666]: pgmap v7585: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 85 KiB/s wr, 9 op/s 2023-05-08T07:39:35.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14113.441371 secs 2023-05-08T07:39:35.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:35 smithi186 ceph-mon[126480]: pgmap v7585: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 85 KiB/s wr, 9 op/s 2023-05-08T07:39:36.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14114.724429 secs 2023-05-08T07:39:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:39:36.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14114.724429 secs 2023-05-08T07:39:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:39:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14114.724429 secs 2023-05-08T07:39:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:39:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:37 smithi133 ceph-mon[125939]: pgmap v7586: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 42 KiB/s wr, 6 op/s 2023-05-08T07:39:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:37 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:39:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:37 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:39:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:37 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:39:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:37 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:39:37.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:37 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T07:39:37.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:37 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T07:39:37.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:37 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:39:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:37 smithi096 ceph-mon[124666]: pgmap v7586: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 42 KiB/s wr, 6 op/s 2023-05-08T07:39:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:37 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:39:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:37 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:39:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:37 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:39:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:37 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:39:37.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:37 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T07:39:37.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:37 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T07:39:37.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:37 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:39:37.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:37 smithi186 ceph-mon[126480]: pgmap v7586: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 42 KiB/s wr, 6 op/s 2023-05-08T07:39:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:37 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:39:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:37 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:39:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:37 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:39:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:37 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:39:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:37 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T07:39:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:37 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T07:39:37.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:37 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:39:39.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14117.883774 secs 2023-05-08T07:39:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:39 smithi133 ceph-mon[125939]: pgmap v7587: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 42 KiB/s wr, 6 op/s 2023-05-08T07:39:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14117.883774 secs 2023-05-08T07:39:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:39 smithi096 ceph-mon[124666]: pgmap v7587: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 42 KiB/s wr, 6 op/s 2023-05-08T07:39:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14117.883774 secs 2023-05-08T07:39:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:39 smithi186 ceph-mon[126480]: pgmap v7587: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 42 KiB/s wr, 6 op/s 2023-05-08T07:39:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14118.441514 secs 2023-05-08T07:39:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14118.441514 secs 2023-05-08T07:39:40.876 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14118.441514 secs 2023-05-08T07:39:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14119.724551 secs 2023-05-08T07:39:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:41 smithi133 ceph-mon[125939]: pgmap v7588: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 73 KiB/s wr, 9 op/s 2023-05-08T07:39:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14119.724551 secs 2023-05-08T07:39:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:41 smithi096 ceph-mon[124666]: pgmap v7588: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 73 KiB/s wr, 9 op/s 2023-05-08T07:39:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14119.724551 secs 2023-05-08T07:39:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:41 smithi186 ceph-mon[126480]: pgmap v7588: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 73 KiB/s wr, 9 op/s 2023-05-08T07:39:43.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:43 smithi133 ceph-mon[125939]: pgmap v7589: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 73 KiB/s wr, 6 op/s 2023-05-08T07:39:43.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:43 smithi096 ceph-mon[124666]: pgmap v7589: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 73 KiB/s wr, 6 op/s 2023-05-08T07:39:43.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:43 smithi186 ceph-mon[126480]: pgmap v7589: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 73 KiB/s wr, 6 op/s 2023-05-08T07:39:44.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14122.883890 secs 2023-05-08T07:39:44.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14122.883890 secs 2023-05-08T07:39:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14122.883890 secs 2023-05-08T07:39:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14123.441643 secs 2023-05-08T07:39:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:45 smithi133 ceph-mon[125939]: pgmap v7590: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 142 KiB/s wr, 10 op/s 2023-05-08T07:39:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14123.441643 secs 2023-05-08T07:39:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:45 smithi096 ceph-mon[124666]: pgmap v7590: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 142 KiB/s wr, 10 op/s 2023-05-08T07:39:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14123.441643 secs 2023-05-08T07:39:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:45 smithi186 ceph-mon[126480]: pgmap v7590: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 142 KiB/s wr, 10 op/s 2023-05-08T07:39:47.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:47 smithi133 ceph-mon[125939]: pgmap v7591: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 100 KiB/s wr, 7 op/s 2023-05-08T07:39:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:39:47.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:47 smithi096 ceph-mon[124666]: pgmap v7591: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 100 KiB/s wr, 7 op/s 2023-05-08T07:39:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:39:47.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:47 smithi186 ceph-mon[126480]: pgmap v7591: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 100 KiB/s wr, 7 op/s 2023-05-08T07:39:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:39:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:48 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:39:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:39:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:39:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:48 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:39:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:39:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:39:48.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:48 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:39:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:39:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:39:49.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14127.884036 secs 2023-05-08T07:39:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:49 smithi133 ceph-mon[125939]: pgmap v7592: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 100 KiB/s wr, 7 op/s 2023-05-08T07:39:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14127.884036 secs 2023-05-08T07:39:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:49 smithi096 ceph-mon[124666]: pgmap v7592: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 100 KiB/s wr, 7 op/s 2023-05-08T07:39:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14127.884036 secs 2023-05-08T07:39:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:49 smithi186 ceph-mon[126480]: pgmap v7592: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 100 KiB/s wr, 7 op/s 2023-05-08T07:39:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:51 smithi133 ceph-mon[125939]: pgmap v7593: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 340 KiB/s rd, 185 KiB/s wr, 11 op/s 2023-05-08T07:39:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:39:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:51 smithi096 ceph-mon[124666]: pgmap v7593: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 340 KiB/s rd, 185 KiB/s wr, 11 op/s 2023-05-08T07:39:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:39:51.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:51 smithi186 ceph-mon[126480]: pgmap v7593: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 340 KiB/s rd, 185 KiB/s wr, 11 op/s 2023-05-08T07:39:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:39:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:39:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:39:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:39:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:39:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:39:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:39:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:53 smithi133 ceph-mon[125939]: pgmap v7594: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 155 KiB/s wr, 7 op/s 2023-05-08T07:39:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:53 smithi096 ceph-mon[124666]: pgmap v7594: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 155 KiB/s wr, 7 op/s 2023-05-08T07:39:53.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:53 smithi186 ceph-mon[126480]: pgmap v7594: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 155 KiB/s wr, 7 op/s 2023-05-08T07:39:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14132.884213 secs 2023-05-08T07:39:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14132.884213 secs 2023-05-08T07:39:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14132.884213 secs 2023-05-08T07:39:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:55 smithi133 ceph-mon[125939]: pgmap v7595: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 352 KiB/s rd, 277 KiB/s wr, 13 op/s 2023-05-08T07:39:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:55 smithi096 ceph-mon[124666]: pgmap v7595: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 352 KiB/s rd, 277 KiB/s wr, 13 op/s 2023-05-08T07:39:55.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:55 smithi186 ceph-mon[126480]: pgmap v7595: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 352 KiB/s rd, 277 KiB/s wr, 13 op/s 2023-05-08T07:39:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:56 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:39:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:56 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:39:56.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:56 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:39:57.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:57 smithi133 ceph-mon[125939]: pgmap v7596: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 208 KiB/s wr, 9 op/s 2023-05-08T07:39:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:57 smithi096 ceph-mon[124666]: pgmap v7596: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 208 KiB/s wr, 9 op/s 2023-05-08T07:39:57.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:57 smithi186 ceph-mon[126480]: pgmap v7596: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 208 KiB/s wr, 9 op/s 2023-05-08T07:39:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14137.884331 secs 2023-05-08T07:39:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:39:59 smithi133 ceph-mon[125939]: pgmap v7597: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 208 KiB/s wr, 9 op/s 2023-05-08T07:39:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14137.884331 secs 2023-05-08T07:39:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:39:59 smithi096 ceph-mon[124666]: pgmap v7597: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 208 KiB/s wr, 9 op/s 2023-05-08T07:39:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14137.884331 secs 2023-05-08T07:39:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:39:59 smithi186 ceph-mon[126480]: pgmap v7597: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 208 KiB/s wr, 9 op/s 2023-05-08T07:40:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14138.441977 secs 2023-05-08T07:40:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:40:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:40:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:00 smithi133 ceph-mon[125939]: overall HEALTH_WARN 2 MDSs report slow requests 2023-05-08T07:40:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14138.441977 secs 2023-05-08T07:40:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:40:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:40:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:00 smithi096 ceph-mon[124666]: overall HEALTH_WARN 2 MDSs report slow requests 2023-05-08T07:40:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14138.441977 secs 2023-05-08T07:40:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:40:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:40:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:00 smithi186 ceph-mon[126480]: overall HEALTH_WARN 2 MDSs report slow requests 2023-05-08T07:40:01.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:01 smithi133 ceph-mon[125939]: pgmap v7598: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 265 KiB/s wr, 14 op/s 2023-05-08T07:40:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:01 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:40:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:01 smithi096 ceph-mon[124666]: pgmap v7598: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 265 KiB/s wr, 14 op/s 2023-05-08T07:40:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:01 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:40:01.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:01 smithi186 ceph-mon[126480]: pgmap v7598: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 265 KiB/s wr, 14 op/s 2023-05-08T07:40:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:01 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:40:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:03 smithi133 ceph-mon[125939]: pgmap v7599: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 180 KiB/s wr, 9 op/s 2023-05-08T07:40:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:03 smithi096 ceph-mon[124666]: pgmap v7599: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 180 KiB/s wr, 9 op/s 2023-05-08T07:40:03.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:03 smithi186 ceph-mon[126480]: pgmap v7599: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 180 KiB/s wr, 9 op/s 2023-05-08T07:40:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14142.884448 secs 2023-05-08T07:40:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14142.884448 secs 2023-05-08T07:40:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14142.884448 secs 2023-05-08T07:40:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14143.442126 secs 2023-05-08T07:40:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:05 smithi133 ceph-mon[125939]: pgmap v7600: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 488 KiB/s rd, 452 KiB/s wr, 26 op/s 2023-05-08T07:40:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14143.442126 secs 2023-05-08T07:40:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:05 smithi096 ceph-mon[124666]: pgmap v7600: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 488 KiB/s rd, 452 KiB/s wr, 26 op/s 2023-05-08T07:40:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14143.442126 secs 2023-05-08T07:40:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:05 smithi186 ceph-mon[126480]: pgmap v7600: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 488 KiB/s rd, 452 KiB/s wr, 26 op/s 2023-05-08T07:40:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:07 smithi133 ceph-mon[125939]: pgmap v7601: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 330 KiB/s wr, 21 op/s 2023-05-08T07:40:07.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:07 smithi096 ceph-mon[124666]: pgmap v7601: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 330 KiB/s wr, 21 op/s 2023-05-08T07:40:07.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:07 smithi186 ceph-mon[126480]: pgmap v7601: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 330 KiB/s wr, 21 op/s 2023-05-08T07:40:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14147.884571 secs 2023-05-08T07:40:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:09 smithi133 ceph-mon[125939]: pgmap v7602: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 330 KiB/s wr, 21 op/s 2023-05-08T07:40:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14147.884571 secs 2023-05-08T07:40:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:09 smithi096 ceph-mon[124666]: pgmap v7602: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 330 KiB/s wr, 21 op/s 2023-05-08T07:40:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14147.884571 secs 2023-05-08T07:40:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:09 smithi186 ceph-mon[126480]: pgmap v7602: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 330 KiB/s wr, 21 op/s 2023-05-08T07:40:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:11 smithi096 ceph-mon[124666]: pgmap v7603: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 422 KiB/s wr, 25 op/s 2023-05-08T07:40:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:11 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:40:11.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:11 smithi186 ceph-mon[126480]: pgmap v7603: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 422 KiB/s wr, 25 op/s 2023-05-08T07:40:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:11 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:40:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:11 smithi133 ceph-mon[125939]: pgmap v7603: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 422 KiB/s wr, 25 op/s 2023-05-08T07:40:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:11 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:40:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:12 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:40:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:12 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:40:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:12 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:40:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:12 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:40:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:12 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:40:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:12 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:40:12.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:12 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:40:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:12 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:40:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:12 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:40:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:13 smithi096 ceph-mon[124666]: pgmap v7604: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 365 KiB/s wr, 21 op/s 2023-05-08T07:40:13.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:13 smithi186 ceph-mon[126480]: pgmap v7604: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 365 KiB/s wr, 21 op/s 2023-05-08T07:40:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:13 smithi133 ceph-mon[125939]: pgmap v7604: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 365 KiB/s wr, 21 op/s 2023-05-08T07:40:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14152.884679 secs 2023-05-08T07:40:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14152.884679 secs 2023-05-08T07:40:14.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14152.884679 secs 2023-05-08T07:40:15.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:15 smithi186 ceph-mon[126480]: pgmap v7605: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 394 KiB/s wr, 23 op/s 2023-05-08T07:40:15.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:15 smithi133 ceph-mon[125939]: pgmap v7605: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 394 KiB/s wr, 23 op/s 2023-05-08T07:40:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:15 smithi096 ceph-mon[124666]: pgmap v7605: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 394 KiB/s wr, 23 op/s 2023-05-08T07:40:17.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:17 smithi186 ceph-mon[126480]: pgmap v7606: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 121 KiB/s wr, 7 op/s 2023-05-08T07:40:17.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:17 smithi133 ceph-mon[125939]: pgmap v7606: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 121 KiB/s wr, 7 op/s 2023-05-08T07:40:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:17 smithi096 ceph-mon[124666]: pgmap v7606: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 121 KiB/s wr, 7 op/s 2023-05-08T07:40:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14157.884821 secs 2023-05-08T07:40:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:19 smithi186 ceph-mon[126480]: pgmap v7607: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 121 KiB/s wr, 7 op/s 2023-05-08T07:40:19.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14157.884821 secs 2023-05-08T07:40:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:19 smithi133 ceph-mon[125939]: pgmap v7607: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 121 KiB/s wr, 7 op/s 2023-05-08T07:40:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14157.884821 secs 2023-05-08T07:40:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:19 smithi096 ceph-mon[124666]: pgmap v7607: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 121 KiB/s wr, 7 op/s 2023-05-08T07:40:21.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:21 smithi186 ceph-mon[126480]: pgmap v7608: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 136 KiB/s wr, 10 op/s 2023-05-08T07:40:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:21 smithi133 ceph-mon[125939]: pgmap v7608: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 136 KiB/s wr, 10 op/s 2023-05-08T07:40:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:21 smithi096 ceph-mon[124666]: pgmap v7608: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 136 KiB/s wr, 10 op/s 2023-05-08T07:40:23.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:23 smithi186 ceph-mon[126480]: pgmap v7609: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 44 KiB/s wr, 5 op/s 2023-05-08T07:40:23.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:23 smithi133 ceph-mon[125939]: pgmap v7609: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 44 KiB/s wr, 5 op/s 2023-05-08T07:40:24.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:23 smithi096 ceph-mon[124666]: pgmap v7609: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 44 KiB/s wr, 5 op/s 2023-05-08T07:40:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14162.884923 secs 2023-05-08T07:40:24.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14162.884923 secs 2023-05-08T07:40:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14162.884923 secs 2023-05-08T07:40:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14163.442585 secs 2023-05-08T07:40:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:25 smithi186 ceph-mon[126480]: pgmap v7610: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 294 KiB/s rd, 239 KiB/s wr, 12 op/s 2023-05-08T07:40:25.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14163.442585 secs 2023-05-08T07:40:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:25 smithi133 ceph-mon[125939]: pgmap v7610: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 294 KiB/s rd, 239 KiB/s wr, 12 op/s 2023-05-08T07:40:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14163.442585 secs 2023-05-08T07:40:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:25 smithi096 ceph-mon[124666]: pgmap v7610: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 294 KiB/s rd, 239 KiB/s wr, 12 op/s 2023-05-08T07:40:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14164.725629 secs 2023-05-08T07:40:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:26 smithi186 ceph-mon[126480]: osdmap e552: 12 total, 12 up, 12 in 2023-05-08T07:40:26.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14164.725629 secs 2023-05-08T07:40:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:26 smithi133 ceph-mon[125939]: osdmap e552: 12 total, 12 up, 12 in 2023-05-08T07:40:27.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14164.725629 secs 2023-05-08T07:40:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:26 smithi096 ceph-mon[124666]: osdmap e552: 12 total, 12 up, 12 in 2023-05-08T07:40:27.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:27 smithi186 ceph-mon[126480]: pgmap v7612: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 252 KiB/s wr, 11 op/s 2023-05-08T07:40:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:27 smithi133 ceph-mon[125939]: pgmap v7612: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 252 KiB/s wr, 11 op/s 2023-05-08T07:40:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:27 smithi096 ceph-mon[124666]: pgmap v7612: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 252 KiB/s wr, 11 op/s 2023-05-08T07:40:28.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:28 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:40:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:28 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:40:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:28 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:40:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:28 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:40:28.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:28 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:40:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:28 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:40:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:28 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:40:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:28 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:40:29.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:28 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:40:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:28 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:40:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:28 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:40:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:28 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:40:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14167.884998 secs 2023-05-08T07:40:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:29 smithi186 ceph-mon[126480]: pgmap v7613: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 252 KiB/s wr, 11 op/s 2023-05-08T07:40:29.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14167.884998 secs 2023-05-08T07:40:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:29 smithi133 ceph-mon[125939]: pgmap v7613: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 252 KiB/s wr, 11 op/s 2023-05-08T07:40:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14167.884998 secs 2023-05-08T07:40:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:29 smithi096 ceph-mon[124666]: pgmap v7613: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 252 KiB/s wr, 11 op/s 2023-05-08T07:40:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14168.442687 secs 2023-05-08T07:40:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14168.442687 secs 2023-05-08T07:40:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14168.442687 secs 2023-05-08T07:40:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14169.725763 secs 2023-05-08T07:40:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:31 smithi186 ceph-mon[126480]: pgmap v7614: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 343 KiB/s wr, 13 op/s 2023-05-08T07:40:31.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14169.725763 secs 2023-05-08T07:40:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:31 smithi133 ceph-mon[125939]: pgmap v7614: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 343 KiB/s wr, 13 op/s 2023-05-08T07:40:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14169.725763 secs 2023-05-08T07:40:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:31 smithi096 ceph-mon[124666]: pgmap v7614: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 343 KiB/s wr, 13 op/s 2023-05-08T07:40:33.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:33 smithi186 ceph-mon[126480]: pgmap v7615: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 343 KiB/s wr, 13 op/s 2023-05-08T07:40:33.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:33 smithi133 ceph-mon[125939]: pgmap v7615: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 343 KiB/s wr, 13 op/s 2023-05-08T07:40:34.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:33 smithi096 ceph-mon[124666]: pgmap v7615: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 343 KiB/s wr, 13 op/s 2023-05-08T07:40:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14172.885089 secs 2023-05-08T07:40:34.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14172.885089 secs 2023-05-08T07:40:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14172.885089 secs 2023-05-08T07:40:35.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14173.442770 secs 2023-05-08T07:40:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:35 smithi186 ceph-mon[126480]: pgmap v7616: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 146 KiB/s wr, 10 op/s 2023-05-08T07:40:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14173.442770 secs 2023-05-08T07:40:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:35 smithi133 ceph-mon[125939]: pgmap v7616: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 146 KiB/s wr, 10 op/s 2023-05-08T07:40:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14173.442770 secs 2023-05-08T07:40:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:35 smithi096 ceph-mon[124666]: pgmap v7616: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 146 KiB/s wr, 10 op/s 2023-05-08T07:40:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14174.725825 secs 2023-05-08T07:40:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:36 smithi186 ceph-mon[126480]: osdmap e553: 12 total, 12 up, 12 in 2023-05-08T07:40:36.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14174.725825 secs 2023-05-08T07:40:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:36 smithi133 ceph-mon[125939]: osdmap e553: 12 total, 12 up, 12 in 2023-05-08T07:40:37.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14174.725825 secs 2023-05-08T07:40:37.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:36 smithi096 ceph-mon[124666]: osdmap e553: 12 total, 12 up, 12 in 2023-05-08T07:40:37.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:37 smithi186 ceph-mon[126480]: pgmap v7617: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 135 KiB/s wr, 9 op/s 2023-05-08T07:40:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:37 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:40:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:37 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:40:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:37 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:40:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:37 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:40:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:37 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:40:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:37 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:40:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:37 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:40:37.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:37 smithi133 ceph-mon[125939]: pgmap v7617: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 135 KiB/s wr, 9 op/s 2023-05-08T07:40:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:37 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:40:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:37 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:40:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:37 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:40:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:37 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:40:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:37 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:40:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:37 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:40:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:37 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:40:38.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:37 smithi096 ceph-mon[124666]: pgmap v7617: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 135 KiB/s wr, 9 op/s 2023-05-08T07:40:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:37 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:40:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:37 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:40:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:37 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:40:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:37 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:40:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:37 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:40:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:37 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:40:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:37 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:40:38.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:40:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:40:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:40:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:40:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:40:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:40:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:40:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:40:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:40:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:39 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:40:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:39 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T07:40:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:39 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T07:40:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:39 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:40:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14177.885209 secs 2023-05-08T07:40:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:39 smithi186 ceph-mon[126480]: pgmap v7619: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 146 KiB/s wr, 10 op/s 2023-05-08T07:40:39.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:39 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:40:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:39 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T07:40:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:39 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T07:40:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:39 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:40:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14177.885209 secs 2023-05-08T07:40:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:39 smithi133 ceph-mon[125939]: pgmap v7619: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 146 KiB/s wr, 10 op/s 2023-05-08T07:40:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:39 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:40:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:39 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T07:40:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:39 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T07:40:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:39 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:40:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14177.885209 secs 2023-05-08T07:40:40.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:39 smithi096 ceph-mon[124666]: pgmap v7619: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 146 KiB/s wr, 10 op/s 2023-05-08T07:40:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14178.442869 secs 2023-05-08T07:40:40.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14178.442869 secs 2023-05-08T07:40:41.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14178.442869 secs 2023-05-08T07:40:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:41 smithi186 ceph-mon[126480]: pgmap v7620: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 139 KiB/s wr, 9 op/s 2023-05-08T07:40:41.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:41 smithi133 ceph-mon[125939]: pgmap v7620: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 139 KiB/s wr, 9 op/s 2023-05-08T07:40:42.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:41 smithi096 ceph-mon[124666]: pgmap v7620: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 139 KiB/s wr, 9 op/s 2023-05-08T07:40:43.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:43 smithi186 ceph-mon[126480]: pgmap v7621: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 139 KiB/s wr, 9 op/s 2023-05-08T07:40:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:40:43.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:43 smithi133 ceph-mon[125939]: pgmap v7621: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 139 KiB/s wr, 9 op/s 2023-05-08T07:40:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:40:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:43 smithi096 ceph-mon[124666]: pgmap v7621: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 139 KiB/s wr, 9 op/s 2023-05-08T07:40:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:40:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14182.885330 secs 2023-05-08T07:40:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:40:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:40:44.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:40:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14182.885330 secs 2023-05-08T07:40:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:40:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:40:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:40:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14182.885330 secs 2023-05-08T07:40:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:40:45.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:40:45.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:40:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:45 smithi186 ceph-mon[126480]: pgmap v7622: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 191 KiB/s wr, 9 op/s 2023-05-08T07:40:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:45 smithi133 ceph-mon[125939]: pgmap v7622: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 191 KiB/s wr, 9 op/s 2023-05-08T07:40:46.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:45 smithi096 ceph-mon[124666]: pgmap v7622: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 191 KiB/s wr, 9 op/s 2023-05-08T07:40:47.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:47 smithi186 ceph-mon[126480]: pgmap v7623: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 191 KiB/s wr, 9 op/s 2023-05-08T07:40:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:40:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:47 smithi133 ceph-mon[125939]: pgmap v7623: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 191 KiB/s wr, 9 op/s 2023-05-08T07:40:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:40:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:47 smithi096 ceph-mon[124666]: pgmap v7623: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 191 KiB/s wr, 9 op/s 2023-05-08T07:40:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:40:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:40:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:40:49.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:40:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:40:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:40:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:40:49.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14187.885471 secs 2023-05-08T07:40:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:49 smithi133 ceph-mon[125939]: pgmap v7624: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 161 KiB/s wr, 7 op/s 2023-05-08T07:40:50.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14187.885471 secs 2023-05-08T07:40:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:49 smithi096 ceph-mon[124666]: pgmap v7624: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 161 KiB/s wr, 7 op/s 2023-05-08T07:40:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14187.885471 secs 2023-05-08T07:40:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:49 smithi186 ceph-mon[126480]: pgmap v7624: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 161 KiB/s wr, 7 op/s 2023-05-08T07:40:51.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:51 smithi133 ceph-mon[125939]: pgmap v7625: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 318 KiB/s wr, 13 op/s 2023-05-08T07:40:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:51 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:40:52.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:51 smithi096 ceph-mon[124666]: pgmap v7625: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 318 KiB/s wr, 13 op/s 2023-05-08T07:40:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:51 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:40:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:51 smithi186 ceph-mon[126480]: pgmap v7625: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 318 KiB/s wr, 13 op/s 2023-05-08T07:40:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:51 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:40:53.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:53 smithi133 ceph-mon[125939]: pgmap v7626: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 233 KiB/s wr, 9 op/s 2023-05-08T07:40:54.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:53 smithi096 ceph-mon[124666]: pgmap v7626: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 233 KiB/s wr, 9 op/s 2023-05-08T07:40:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:53 smithi186 ceph-mon[126480]: pgmap v7626: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 233 KiB/s wr, 9 op/s 2023-05-08T07:40:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14192.885569 secs 2023-05-08T07:40:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14193.443244 secs 2023-05-08T07:40:55.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14192.885569 secs 2023-05-08T07:40:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14193.443244 secs 2023-05-08T07:40:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14192.885569 secs 2023-05-08T07:40:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14193.443244 secs 2023-05-08T07:40:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:55 smithi133 ceph-mon[125939]: pgmap v7627: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 330 KiB/s wr, 13 op/s 2023-05-08T07:40:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:55 smithi096 ceph-mon[124666]: pgmap v7627: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 330 KiB/s wr, 13 op/s 2023-05-08T07:40:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:55 smithi186 ceph-mon[126480]: pgmap v7627: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 330 KiB/s wr, 13 op/s 2023-05-08T07:40:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:40:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:40:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:56 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:40:57.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:40:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:40:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:56 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:40:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:40:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:40:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:56 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:40:57.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:57 smithi133 ceph-mon[125939]: pgmap v7628: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 257 KiB/s wr, 9 op/s 2023-05-08T07:40:58.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:57 smithi096 ceph-mon[124666]: pgmap v7628: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 257 KiB/s wr, 9 op/s 2023-05-08T07:40:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:57 smithi186 ceph-mon[126480]: pgmap v7628: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 257 KiB/s wr, 9 op/s 2023-05-08T07:40:59.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14197.885665 secs 2023-05-08T07:40:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:59 smithi133 ceph-mon[125939]: pgmap v7629: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 257 KiB/s wr, 9 op/s 2023-05-08T07:40:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:40:59 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:41:00.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14197.885665 secs 2023-05-08T07:41:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:59 smithi096 ceph-mon[124666]: pgmap v7629: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 257 KiB/s wr, 9 op/s 2023-05-08T07:41:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:40:59 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:41:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14197.885665 secs 2023-05-08T07:41:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:59 smithi186 ceph-mon[126480]: pgmap v7629: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 257 KiB/s wr, 9 op/s 2023-05-08T07:41:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:40:59 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:41:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:41:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:41:01.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:41:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:41:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:41:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:41:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14199.726427 secs 2023-05-08T07:41:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:01 smithi133 ceph-mon[125939]: pgmap v7630: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 384 KiB/s rd, 453 KiB/s wr, 14 op/s 2023-05-08T07:41:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:01 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:41:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14199.726427 secs 2023-05-08T07:41:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:01 smithi096 ceph-mon[124666]: pgmap v7630: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 384 KiB/s rd, 453 KiB/s wr, 14 op/s 2023-05-08T07:41:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:01 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:41:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14199.726427 secs 2023-05-08T07:41:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:01 smithi186 ceph-mon[126480]: pgmap v7630: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 384 KiB/s rd, 453 KiB/s wr, 14 op/s 2023-05-08T07:41:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:01 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:41:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:03 smithi133 ceph-mon[125939]: pgmap v7631: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 295 KiB/s wr, 8 op/s 2023-05-08T07:41:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:03 smithi096 ceph-mon[124666]: pgmap v7631: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 295 KiB/s wr, 8 op/s 2023-05-08T07:41:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:03 smithi186 ceph-mon[126480]: pgmap v7631: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 295 KiB/s wr, 8 op/s 2023-05-08T07:41:04.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14202.885784 secs 2023-05-08T07:41:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:04 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:41:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:04 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:41:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14203.443490 secs 2023-05-08T07:41:05.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14202.885784 secs 2023-05-08T07:41:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:04 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:41:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:04 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:41:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14203.443490 secs 2023-05-08T07:41:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14202.885784 secs 2023-05-08T07:41:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:04 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:41:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:04 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:41:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14203.443490 secs 2023-05-08T07:41:05.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:05 smithi133 ceph-mon[125939]: pgmap v7632: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 341 KiB/s wr, 27 op/s 2023-05-08T07:41:06.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:05 smithi096 ceph-mon[124666]: pgmap v7632: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 341 KiB/s wr, 27 op/s 2023-05-08T07:41:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:05 smithi186 ceph-mon[126480]: pgmap v7632: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 341 KiB/s wr, 27 op/s 2023-05-08T07:41:06.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14204.726571 secs 2023-05-08T07:41:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:06 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:41:07.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14204.726571 secs 2023-05-08T07:41:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:06 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:41:07.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14204.726571 secs 2023-05-08T07:41:07.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:06 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:41:07.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:07 smithi133 ceph-mon[125939]: pgmap v7633: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 243 KiB/s wr, 22 op/s 2023-05-08T07:41:08.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:07 smithi096 ceph-mon[124666]: pgmap v7633: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 243 KiB/s wr, 22 op/s 2023-05-08T07:41:08.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:07 smithi186 ceph-mon[126480]: pgmap v7633: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 243 KiB/s wr, 22 op/s 2023-05-08T07:41:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:41:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:41:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:41:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:41:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:41:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:41:09.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14207.885899 secs 2023-05-08T07:41:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:09 smithi133 ceph-mon[125939]: pgmap v7634: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 243 KiB/s wr, 22 op/s 2023-05-08T07:41:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14208.443586 secs 2023-05-08T07:41:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14207.885899 secs 2023-05-08T07:41:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:09 smithi096 ceph-mon[124666]: pgmap v7634: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 243 KiB/s wr, 22 op/s 2023-05-08T07:41:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14208.443586 secs 2023-05-08T07:41:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14207.885899 secs 2023-05-08T07:41:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:09 smithi186 ceph-mon[126480]: pgmap v7634: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 243 KiB/s wr, 22 op/s 2023-05-08T07:41:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14208.443586 secs 2023-05-08T07:41:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14209.726692 secs 2023-05-08T07:41:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:11 smithi133 ceph-mon[125939]: pgmap v7635: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 330 KiB/s wr, 26 op/s 2023-05-08T07:41:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:11 smithi133 ceph-mon[125939]: osdmap e554: 12 total, 12 up, 12 in 2023-05-08T07:41:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:11 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:41:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14209.726692 secs 2023-05-08T07:41:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:11 smithi096 ceph-mon[124666]: pgmap v7635: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 330 KiB/s wr, 26 op/s 2023-05-08T07:41:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:11 smithi096 ceph-mon[124666]: osdmap e554: 12 total, 12 up, 12 in 2023-05-08T07:41:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:11 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:41:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14209.726692 secs 2023-05-08T07:41:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:11 smithi186 ceph-mon[126480]: pgmap v7635: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 330 KiB/s wr, 26 op/s 2023-05-08T07:41:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:11 smithi186 ceph-mon[126480]: osdmap e554: 12 total, 12 up, 12 in 2023-05-08T07:41:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:11 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:41:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:13 smithi133 ceph-mon[125939]: pgmap v7637: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 160 KiB/s wr, 26 op/s 2023-05-08T07:41:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:13 smithi096 ceph-mon[124666]: pgmap v7637: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 160 KiB/s wr, 26 op/s 2023-05-08T07:41:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:13 smithi186 ceph-mon[126480]: pgmap v7637: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 160 KiB/s wr, 26 op/s 2023-05-08T07:41:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14212.886010 secs 2023-05-08T07:41:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14213.443699 secs 2023-05-08T07:41:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14212.886010 secs 2023-05-08T07:41:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14213.443699 secs 2023-05-08T07:41:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14212.886010 secs 2023-05-08T07:41:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14213.443699 secs 2023-05-08T07:41:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:15 smithi096 ceph-mon[124666]: pgmap v7638: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 114 KiB/s wr, 8 op/s 2023-05-08T07:41:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:15 smithi186 ceph-mon[126480]: pgmap v7638: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 114 KiB/s wr, 8 op/s 2023-05-08T07:41:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:15 smithi133 ceph-mon[125939]: pgmap v7638: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 114 KiB/s wr, 8 op/s 2023-05-08T07:41:17.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14214.726818 secs 2023-05-08T07:41:17.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14214.726818 secs 2023-05-08T07:41:17.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14214.726818 secs 2023-05-08T07:41:18.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:17 smithi186 ceph-mon[126480]: pgmap v7639: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 114 KiB/s wr, 8 op/s 2023-05-08T07:41:18.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:17 smithi133 ceph-mon[125939]: pgmap v7639: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 114 KiB/s wr, 8 op/s 2023-05-08T07:41:18.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:17 smithi096 ceph-mon[124666]: pgmap v7639: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 114 KiB/s wr, 8 op/s 2023-05-08T07:41:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14217.886127 secs 2023-05-08T07:41:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:19 smithi186 ceph-mon[126480]: pgmap v7640: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 114 KiB/s wr, 8 op/s 2023-05-08T07:41:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14218.443822 secs 2023-05-08T07:41:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14217.886127 secs 2023-05-08T07:41:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:19 smithi133 ceph-mon[125939]: pgmap v7640: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 114 KiB/s wr, 8 op/s 2023-05-08T07:41:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14218.443822 secs 2023-05-08T07:41:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14217.886127 secs 2023-05-08T07:41:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:19 smithi096 ceph-mon[124666]: pgmap v7640: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 114 KiB/s wr, 8 op/s 2023-05-08T07:41:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14218.443822 secs 2023-05-08T07:41:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14219.726944 secs 2023-05-08T07:41:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:21 smithi186 ceph-mon[126480]: pgmap v7641: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 KiB/s wr, 8 op/s 2023-05-08T07:41:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:21 smithi186 ceph-mon[126480]: osdmap e555: 12 total, 12 up, 12 in 2023-05-08T07:41:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14219.726944 secs 2023-05-08T07:41:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:21 smithi133 ceph-mon[125939]: pgmap v7641: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 KiB/s wr, 8 op/s 2023-05-08T07:41:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:21 smithi133 ceph-mon[125939]: osdmap e555: 12 total, 12 up, 12 in 2023-05-08T07:41:22.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14219.726944 secs 2023-05-08T07:41:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:21 smithi096 ceph-mon[124666]: pgmap v7641: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 KiB/s wr, 8 op/s 2023-05-08T07:41:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:21 smithi096 ceph-mon[124666]: osdmap e555: 12 total, 12 up, 12 in 2023-05-08T07:41:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:23 smithi186 ceph-mon[126480]: pgmap v7643: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 KiB/s wr, 8 op/s 2023-05-08T07:41:24.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:23 smithi133 ceph-mon[125939]: pgmap v7643: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 KiB/s wr, 8 op/s 2023-05-08T07:41:24.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:23 smithi096 ceph-mon[124666]: pgmap v7643: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 KiB/s wr, 8 op/s 2023-05-08T07:41:25.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14222.886246 secs 2023-05-08T07:41:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14223.443948 secs 2023-05-08T07:41:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14222.886246 secs 2023-05-08T07:41:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14223.443948 secs 2023-05-08T07:41:25.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14222.886246 secs 2023-05-08T07:41:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14223.443948 secs 2023-05-08T07:41:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:25 smithi186 ceph-mon[126480]: pgmap v7644: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 81 KiB/s wr, 8 op/s 2023-05-08T07:41:26.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:25 smithi133 ceph-mon[125939]: pgmap v7644: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 81 KiB/s wr, 8 op/s 2023-05-08T07:41:26.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:25 smithi096 ceph-mon[124666]: pgmap v7644: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 81 KiB/s wr, 8 op/s 2023-05-08T07:41:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14224.727068 secs 2023-05-08T07:41:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14224.727068 secs 2023-05-08T07:41:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14224.727068 secs 2023-05-08T07:41:28.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:27 smithi186 ceph-mon[126480]: pgmap v7645: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 81 KiB/s wr, 8 op/s 2023-05-08T07:41:28.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:27 smithi133 ceph-mon[125939]: pgmap v7645: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 81 KiB/s wr, 8 op/s 2023-05-08T07:41:28.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:27 smithi096 ceph-mon[124666]: pgmap v7645: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 81 KiB/s wr, 8 op/s 2023-05-08T07:41:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14227.886393 secs 2023-05-08T07:41:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:29 smithi186 ceph-mon[126480]: pgmap v7646: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 81 KiB/s wr, 8 op/s 2023-05-08T07:41:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14228.444064 secs 2023-05-08T07:41:30.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14227.886393 secs 2023-05-08T07:41:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:29 smithi133 ceph-mon[125939]: pgmap v7646: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 81 KiB/s wr, 8 op/s 2023-05-08T07:41:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14228.444064 secs 2023-05-08T07:41:30.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14227.886393 secs 2023-05-08T07:41:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:29 smithi096 ceph-mon[124666]: pgmap v7646: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 81 KiB/s wr, 8 op/s 2023-05-08T07:41:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14228.444064 secs 2023-05-08T07:41:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14229.727194 secs 2023-05-08T07:41:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:31 smithi186 ceph-mon[126480]: pgmap v7647: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 59 KiB/s wr, 8 op/s 2023-05-08T07:41:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14229.727194 secs 2023-05-08T07:41:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:31 smithi133 ceph-mon[125939]: pgmap v7647: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 59 KiB/s wr, 8 op/s 2023-05-08T07:41:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14229.727194 secs 2023-05-08T07:41:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:31 smithi096 ceph-mon[124666]: pgmap v7647: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 59 KiB/s wr, 8 op/s 2023-05-08T07:41:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:33 smithi186 ceph-mon[126480]: pgmap v7648: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 7 op/s 2023-05-08T07:41:34.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:33 smithi133 ceph-mon[125939]: pgmap v7648: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 7 op/s 2023-05-08T07:41:34.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:33 smithi096 ceph-mon[124666]: pgmap v7648: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 7 op/s 2023-05-08T07:41:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14232.886514 secs 2023-05-08T07:41:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14233.444177 secs 2023-05-08T07:41:35.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14232.886514 secs 2023-05-08T07:41:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14233.444177 secs 2023-05-08T07:41:35.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14232.886514 secs 2023-05-08T07:41:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14233.444177 secs 2023-05-08T07:41:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:35 smithi186 ceph-mon[126480]: pgmap v7649: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 177 KiB/s wr, 10 op/s 2023-05-08T07:41:36.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:35 smithi133 ceph-mon[125939]: pgmap v7649: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 177 KiB/s wr, 10 op/s 2023-05-08T07:41:36.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:35 smithi096 ceph-mon[124666]: pgmap v7649: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 177 KiB/s wr, 10 op/s 2023-05-08T07:41:37.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14234.727324 secs 2023-05-08T07:41:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14234.727324 secs 2023-05-08T07:41:37.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14234.727324 secs 2023-05-08T07:41:38.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:37 smithi186 ceph-mon[126480]: pgmap v7650: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 134 KiB/s wr, 7 op/s 2023-05-08T07:41:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:37 smithi133 ceph-mon[125939]: pgmap v7650: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 134 KiB/s wr, 7 op/s 2023-05-08T07:41:38.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:37 smithi096 ceph-mon[124666]: pgmap v7650: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 134 KiB/s wr, 7 op/s 2023-05-08T07:41:39.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:41:39.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:41:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:41:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:41:39.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:41:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:41:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:41:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:41:39.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:41:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:41:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:41:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:41:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14237.886579 secs 2023-05-08T07:41:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:39 smithi186 ceph-mon[126480]: pgmap v7651: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 134 KiB/s wr, 7 op/s 2023-05-08T07:41:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14238.444272 secs 2023-05-08T07:41:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:39 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:41:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:39 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T07:41:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:39 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T07:41:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:39 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:41:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14237.886579 secs 2023-05-08T07:41:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:39 smithi133 ceph-mon[125939]: pgmap v7651: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 134 KiB/s wr, 7 op/s 2023-05-08T07:41:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14238.444272 secs 2023-05-08T07:41:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:39 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:41:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:39 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T07:41:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:39 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T07:41:40.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:39 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:41:40.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14237.886579 secs 2023-05-08T07:41:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:39 smithi096 ceph-mon[124666]: pgmap v7651: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 134 KiB/s wr, 7 op/s 2023-05-08T07:41:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14238.444272 secs 2023-05-08T07:41:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:39 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:41:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:39 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T07:41:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:39 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T07:41:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:39 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:41:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:41 smithi186 ceph-mon[126480]: pgmap v7652: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 135 KiB/s wr, 10 op/s 2023-05-08T07:41:42.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:41 smithi133 ceph-mon[125939]: pgmap v7652: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 135 KiB/s wr, 10 op/s 2023-05-08T07:41:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:41 smithi096 ceph-mon[124666]: pgmap v7652: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 135 KiB/s wr, 10 op/s 2023-05-08T07:41:43.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:41:43.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:41:43.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:41:44.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:43 smithi186 ceph-mon[126480]: pgmap v7653: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 129 KiB/s wr, 7 op/s 2023-05-08T07:41:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:43 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:41:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:41:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:41:44.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:43 smithi133 ceph-mon[125939]: pgmap v7653: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 129 KiB/s wr, 7 op/s 2023-05-08T07:41:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:43 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:41:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:41:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:41:44.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:43 smithi096 ceph-mon[124666]: pgmap v7653: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 129 KiB/s wr, 7 op/s 2023-05-08T07:41:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:43 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:41:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:41:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:41:45.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14242.886696 secs 2023-05-08T07:41:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14243.444396 secs 2023-05-08T07:41:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14242.886696 secs 2023-05-08T07:41:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14243.444396 secs 2023-05-08T07:41:45.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14242.886696 secs 2023-05-08T07:41:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14243.444396 secs 2023-05-08T07:41:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:45 smithi186 ceph-mon[126480]: pgmap v7654: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 174 KiB/s wr, 9 op/s 2023-05-08T07:41:46.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:45 smithi133 ceph-mon[125939]: pgmap v7654: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 174 KiB/s wr, 9 op/s 2023-05-08T07:41:46.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:45 smithi096 ceph-mon[124666]: pgmap v7654: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 174 KiB/s wr, 9 op/s 2023-05-08T07:41:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:47 smithi186 ceph-mon[126480]: pgmap v7655: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 46 KiB/s wr, 6 op/s 2023-05-08T07:41:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:47 smithi133 ceph-mon[125939]: pgmap v7655: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 46 KiB/s wr, 6 op/s 2023-05-08T07:41:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:47 smithi096 ceph-mon[124666]: pgmap v7655: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 46 KiB/s wr, 6 op/s 2023-05-08T07:41:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14247.886845 secs 2023-05-08T07:41:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:49 smithi186 ceph-mon[126480]: pgmap v7656: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 46 KiB/s wr, 6 op/s 2023-05-08T07:41:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14247.886845 secs 2023-05-08T07:41:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:49 smithi133 ceph-mon[125939]: pgmap v7656: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 46 KiB/s wr, 6 op/s 2023-05-08T07:41:50.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14247.886845 secs 2023-05-08T07:41:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:49 smithi096 ceph-mon[124666]: pgmap v7656: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 46 KiB/s wr, 6 op/s 2023-05-08T07:41:51.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:50 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:41:51.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:50 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:41:51.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:50 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:41:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:51 smithi186 ceph-mon[126480]: pgmap v7657: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 133 KiB/s wr, 10 op/s 2023-05-08T07:41:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:51 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:41:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:41:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:41:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:51 smithi133 ceph-mon[125939]: pgmap v7657: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 133 KiB/s wr, 10 op/s 2023-05-08T07:41:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:51 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:41:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:41:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:41:52.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:51 smithi096 ceph-mon[124666]: pgmap v7657: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 133 KiB/s wr, 10 op/s 2023-05-08T07:41:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:51 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:41:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:41:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:41:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:53 smithi186 ceph-mon[126480]: pgmap v7658: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 133 KiB/s wr, 6 op/s 2023-05-08T07:41:54.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:53 smithi133 ceph-mon[125939]: pgmap v7658: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 133 KiB/s wr, 6 op/s 2023-05-08T07:41:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:53 smithi096 ceph-mon[124666]: pgmap v7658: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 133 KiB/s wr, 6 op/s 2023-05-08T07:41:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14252.886984 secs 2023-05-08T07:41:55.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14252.886984 secs 2023-05-08T07:41:55.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14252.886984 secs 2023-05-08T07:41:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:55 smithi186 ceph-mon[126480]: pgmap v7659: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 329 KiB/s rd, 315 KiB/s wr, 12 op/s 2023-05-08T07:41:56.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:55 smithi133 ceph-mon[125939]: pgmap v7659: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 329 KiB/s rd, 315 KiB/s wr, 12 op/s 2023-05-08T07:41:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:55 smithi096 ceph-mon[124666]: pgmap v7659: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 329 KiB/s rd, 315 KiB/s wr, 12 op/s 2023-05-08T07:41:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:57 smithi186 ceph-mon[126480]: pgmap v7660: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 270 KiB/s wr, 9 op/s 2023-05-08T07:41:58.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:57 smithi133 ceph-mon[125939]: pgmap v7660: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 270 KiB/s wr, 9 op/s 2023-05-08T07:41:58.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:57 smithi096 ceph-mon[124666]: pgmap v7660: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 270 KiB/s wr, 9 op/s 2023-05-08T07:41:59.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:58 smithi133 ceph-mon[125939]: pgmap v7661: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 270 KiB/s wr, 9 op/s 2023-05-08T07:41:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:58 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:41:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:41:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:41:59.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:58 smithi096 ceph-mon[124666]: pgmap v7661: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 270 KiB/s wr, 9 op/s 2023-05-08T07:41:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:58 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:41:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:41:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:41:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:58 smithi186 ceph-mon[126480]: pgmap v7661: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 270 KiB/s wr, 9 op/s 2023-05-08T07:41:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:58 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:41:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:41:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:42:00.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14257.887097 secs 2023-05-08T07:42:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:41:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14258.444750 secs 2023-05-08T07:42:00.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14257.887097 secs 2023-05-08T07:42:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:41:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14258.444750 secs 2023-05-08T07:42:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14257.887097 secs 2023-05-08T07:42:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:41:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14258.444750 secs 2023-05-08T07:42:01.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:00 smithi133 ceph-mon[125939]: pgmap v7662: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 328 KiB/s wr, 14 op/s 2023-05-08T07:42:01.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:00 smithi096 ceph-mon[124666]: pgmap v7662: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 328 KiB/s wr, 14 op/s 2023-05-08T07:42:01.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:00 smithi186 ceph-mon[126480]: pgmap v7662: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 328 KiB/s wr, 14 op/s 2023-05-08T07:42:03.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:03 smithi133 ceph-mon[125939]: pgmap v7663: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 240 KiB/s wr, 10 op/s 2023-05-08T07:42:03.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:03 smithi096 ceph-mon[124666]: pgmap v7663: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 240 KiB/s wr, 10 op/s 2023-05-08T07:42:03.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:03 smithi186 ceph-mon[126480]: pgmap v7663: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 240 KiB/s wr, 10 op/s 2023-05-08T07:42:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14262.887230 secs 2023-05-08T07:42:04.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14262.887230 secs 2023-05-08T07:42:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14262.887230 secs 2023-05-08T07:42:05.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14263.444814 secs 2023-05-08T07:42:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:05 smithi133 ceph-mon[125939]: pgmap v7664: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 387 KiB/s wr, 26 op/s 2023-05-08T07:42:05.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14263.444814 secs 2023-05-08T07:42:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:05 smithi096 ceph-mon[124666]: pgmap v7664: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 387 KiB/s wr, 26 op/s 2023-05-08T07:42:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14263.444814 secs 2023-05-08T07:42:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:05 smithi186 ceph-mon[126480]: pgmap v7664: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 387 KiB/s wr, 26 op/s 2023-05-08T07:42:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:07 smithi133 ceph-mon[125939]: pgmap v7665: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 206 KiB/s wr, 20 op/s 2023-05-08T07:42:07.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:07 smithi096 ceph-mon[124666]: pgmap v7665: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 206 KiB/s wr, 20 op/s 2023-05-08T07:42:07.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:07 smithi186 ceph-mon[126480]: pgmap v7665: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 206 KiB/s wr, 20 op/s 2023-05-08T07:42:09.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14267.887384 secs 2023-05-08T07:42:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:09 smithi133 ceph-mon[125939]: pgmap v7666: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 206 KiB/s wr, 20 op/s 2023-05-08T07:42:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14267.887384 secs 2023-05-08T07:42:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:09 smithi096 ceph-mon[124666]: pgmap v7666: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 206 KiB/s wr, 20 op/s 2023-05-08T07:42:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14267.887384 secs 2023-05-08T07:42:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:09 smithi186 ceph-mon[126480]: pgmap v7666: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 206 KiB/s wr, 20 op/s 2023-05-08T07:42:11.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:11 smithi133 ceph-mon[125939]: pgmap v7667: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 288 KiB/s rd, 299 KiB/s wr, 24 op/s 2023-05-08T07:42:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:11 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:42:11.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:11 smithi096 ceph-mon[124666]: pgmap v7667: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 288 KiB/s rd, 299 KiB/s wr, 24 op/s 2023-05-08T07:42:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:11 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:42:11.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:11 smithi186 ceph-mon[126480]: pgmap v7667: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 288 KiB/s rd, 299 KiB/s wr, 24 op/s 2023-05-08T07:42:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:11 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:42:12.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:12 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:42:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:12 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:42:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:12 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:42:12.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:12 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:42:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:12 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:42:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:12 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:42:12.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:12 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:42:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:12 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:42:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:12 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:42:13.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:13 smithi133 ceph-mon[125939]: pgmap v7668: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 241 KiB/s wr, 20 op/s 2023-05-08T07:42:13.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:13 smithi096 ceph-mon[124666]: pgmap v7668: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 241 KiB/s wr, 20 op/s 2023-05-08T07:42:13.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:13 smithi186 ceph-mon[126480]: pgmap v7668: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 241 KiB/s wr, 20 op/s 2023-05-08T07:42:14.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14272.887457 secs 2023-05-08T07:42:14.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14272.887457 secs 2023-05-08T07:42:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14272.887457 secs 2023-05-08T07:42:15.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:15 smithi133 ceph-mon[125939]: pgmap v7669: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 271 KiB/s wr, 24 op/s 2023-05-08T07:42:15.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:15 smithi096 ceph-mon[124666]: pgmap v7669: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 271 KiB/s wr, 24 op/s 2023-05-08T07:42:15.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:15 smithi186 ceph-mon[126480]: pgmap v7669: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 271 KiB/s wr, 24 op/s 2023-05-08T07:42:17.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:17 smithi133 ceph-mon[125939]: pgmap v7670: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 124 KiB/s wr, 7 op/s 2023-05-08T07:42:17.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:17 smithi096 ceph-mon[124666]: pgmap v7670: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 124 KiB/s wr, 7 op/s 2023-05-08T07:42:17.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:17 smithi186 ceph-mon[126480]: pgmap v7670: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 124 KiB/s wr, 7 op/s 2023-05-08T07:42:19.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14277.887541 secs 2023-05-08T07:42:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:19 smithi133 ceph-mon[125939]: pgmap v7671: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 124 KiB/s wr, 7 op/s 2023-05-08T07:42:19.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14277.887541 secs 2023-05-08T07:42:19.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:19 smithi096 ceph-mon[124666]: pgmap v7671: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 124 KiB/s wr, 7 op/s 2023-05-08T07:42:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14277.887541 secs 2023-05-08T07:42:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:19 smithi186 ceph-mon[126480]: pgmap v7671: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 124 KiB/s wr, 7 op/s 2023-05-08T07:42:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:21 smithi133 ceph-mon[125939]: pgmap v7672: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 124 KiB/s wr, 10 op/s 2023-05-08T07:42:21.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:21 smithi096 ceph-mon[124666]: pgmap v7672: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 124 KiB/s wr, 10 op/s 2023-05-08T07:42:21.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:21 smithi186 ceph-mon[126480]: pgmap v7672: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 124 KiB/s wr, 10 op/s 2023-05-08T07:42:23.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:23 smithi133 ceph-mon[125939]: pgmap v7673: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 6 op/s 2023-05-08T07:42:23.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:23 smithi096 ceph-mon[124666]: pgmap v7673: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 6 op/s 2023-05-08T07:42:23.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:23 smithi186 ceph-mon[126480]: pgmap v7673: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 6 op/s 2023-05-08T07:42:24.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14282.887634 secs 2023-05-08T07:42:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14282.887634 secs 2023-05-08T07:42:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14282.887634 secs 2023-05-08T07:42:25.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14283.445238 secs 2023-05-08T07:42:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:25 smithi133 ceph-mon[125939]: pgmap v7674: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 203 KiB/s wr, 12 op/s 2023-05-08T07:42:25.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14283.445238 secs 2023-05-08T07:42:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:25 smithi096 ceph-mon[124666]: pgmap v7674: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 203 KiB/s wr, 12 op/s 2023-05-08T07:42:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14283.445238 secs 2023-05-08T07:42:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:25 smithi186 ceph-mon[126480]: pgmap v7674: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 203 KiB/s wr, 12 op/s 2023-05-08T07:42:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14284.728549 secs 2023-05-08T07:42:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14284.728549 secs 2023-05-08T07:42:26.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14284.728549 secs 2023-05-08T07:42:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:27 smithi096 ceph-mon[124666]: pgmap v7675: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 173 KiB/s wr, 9 op/s 2023-05-08T07:42:27.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:27 smithi186 ceph-mon[126480]: pgmap v7675: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 173 KiB/s wr, 9 op/s 2023-05-08T07:42:27.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:27 smithi133 ceph-mon[125939]: pgmap v7675: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 173 KiB/s wr, 9 op/s 2023-05-08T07:42:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:28 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:42:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:28 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:42:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:28 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:42:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:28 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:42:28.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:28 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:42:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:28 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:42:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:28 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:42:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:28 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:42:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:28 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:42:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:28 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:42:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:28 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:42:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:28 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:42:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14287.887729 secs 2023-05-08T07:42:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:29 smithi096 ceph-mon[124666]: pgmap v7676: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 173 KiB/s wr, 9 op/s 2023-05-08T07:42:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14287.887729 secs 2023-05-08T07:42:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:29 smithi186 ceph-mon[126480]: pgmap v7676: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 173 KiB/s wr, 9 op/s 2023-05-08T07:42:29.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14287.887729 secs 2023-05-08T07:42:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:29 smithi133 ceph-mon[125939]: pgmap v7676: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 173 KiB/s wr, 9 op/s 2023-05-08T07:42:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14288.445378 secs 2023-05-08T07:42:30.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14288.445378 secs 2023-05-08T07:42:31.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14288.445378 secs 2023-05-08T07:42:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14289.728674 secs 2023-05-08T07:42:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:31 smithi186 ceph-mon[126480]: pgmap v7677: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 265 KiB/s wr, 13 op/s 2023-05-08T07:42:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:31 smithi186 ceph-mon[126480]: osdmap e556: 12 total, 12 up, 12 in 2023-05-08T07:42:31.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14289.728674 secs 2023-05-08T07:42:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:31 smithi133 ceph-mon[125939]: pgmap v7677: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 265 KiB/s wr, 13 op/s 2023-05-08T07:42:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:31 smithi133 ceph-mon[125939]: osdmap e556: 12 total, 12 up, 12 in 2023-05-08T07:42:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14289.728674 secs 2023-05-08T07:42:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:31 smithi096 ceph-mon[124666]: pgmap v7677: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 265 KiB/s wr, 13 op/s 2023-05-08T07:42:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:31 smithi096 ceph-mon[124666]: osdmap e556: 12 total, 12 up, 12 in 2023-05-08T07:42:33.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:33 smithi186 ceph-mon[126480]: pgmap v7679: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 318 KiB/s wr, 12 op/s 2023-05-08T07:42:33.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:33 smithi133 ceph-mon[125939]: pgmap v7679: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 318 KiB/s wr, 12 op/s 2023-05-08T07:42:34.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:33 smithi096 ceph-mon[124666]: pgmap v7679: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 318 KiB/s wr, 12 op/s 2023-05-08T07:42:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14292.887804 secs 2023-05-08T07:42:34.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14292.887804 secs 2023-05-08T07:42:35.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14292.887804 secs 2023-05-08T07:42:35.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14293.445477 secs 2023-05-08T07:42:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:35 smithi186 ceph-mon[126480]: pgmap v7680: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 112 KiB/s wr, 9 op/s 2023-05-08T07:42:35.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14293.445477 secs 2023-05-08T07:42:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:35 smithi133 ceph-mon[125939]: pgmap v7680: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 112 KiB/s wr, 9 op/s 2023-05-08T07:42:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14293.445477 secs 2023-05-08T07:42:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:35 smithi096 ceph-mon[124666]: pgmap v7680: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 112 KiB/s wr, 9 op/s 2023-05-08T07:42:36.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14294.728824 secs 2023-05-08T07:42:36.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:36 smithi186 ceph-mon[126480]: osdmap e557: 12 total, 12 up, 12 in 2023-05-08T07:42:36.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14294.728824 secs 2023-05-08T07:42:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:36 smithi133 ceph-mon[125939]: osdmap e557: 12 total, 12 up, 12 in 2023-05-08T07:42:37.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14294.728824 secs 2023-05-08T07:42:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:36 smithi096 ceph-mon[124666]: osdmap e557: 12 total, 12 up, 12 in 2023-05-08T07:42:37.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:37 smithi186 ceph-mon[126480]: pgmap v7681: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 112 KiB/s wr, 9 op/s 2023-05-08T07:42:37.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:37 smithi133 ceph-mon[125939]: pgmap v7681: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 112 KiB/s wr, 9 op/s 2023-05-08T07:42:38.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:37 smithi096 ceph-mon[124666]: pgmap v7681: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 112 KiB/s wr, 9 op/s 2023-05-08T07:42:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:39 smithi186 ceph-mon[126480]: pgmap v7683: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 1.5 KiB/s wr, 5 op/s 2023-05-08T07:42:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:42:39.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:39 smithi133 ceph-mon[125939]: pgmap v7683: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 1.5 KiB/s wr, 5 op/s 2023-05-08T07:42:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:42:40.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:39 smithi096 ceph-mon[124666]: pgmap v7683: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 1.5 KiB/s wr, 5 op/s 2023-05-08T07:42:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:42:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14298.445586 secs 2023-05-08T07:42:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:40 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:42:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:40 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:42:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:40 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:42:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:40 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:42:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:40 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T07:42:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:40 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T07:42:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:40 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:42:40.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14298.445586 secs 2023-05-08T07:42:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:40 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:42:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:40 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:42:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:40 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:42:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:40 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:42:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:40 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T07:42:40.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:40 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T07:42:40.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:40 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:42:41.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14298.445586 secs 2023-05-08T07:42:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:40 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:42:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:40 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:42:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:40 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:42:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:40 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:42:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:40 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T07:42:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:40 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T07:42:41.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:40 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:42:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:41 smithi186 ceph-mon[126480]: pgmap v7684: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 115 KiB/s wr, 8 op/s 2023-05-08T07:42:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:41 smithi133 ceph-mon[125939]: pgmap v7684: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 115 KiB/s wr, 8 op/s 2023-05-08T07:42:42.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:41 smithi096 ceph-mon[124666]: pgmap v7684: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 115 KiB/s wr, 8 op/s 2023-05-08T07:42:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:42:42.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:42:43.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:42:43.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:43 smithi186 ceph-mon[126480]: pgmap v7685: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 112 KiB/s wr, 8 op/s 2023-05-08T07:42:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:43 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:42:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T07:42:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:42:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:42:43.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:43 smithi133 ceph-mon[125939]: pgmap v7685: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 112 KiB/s wr, 8 op/s 2023-05-08T07:42:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:43 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:42:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T07:42:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:42:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:42:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:43 smithi096 ceph-mon[124666]: pgmap v7685: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 112 KiB/s wr, 8 op/s 2023-05-08T07:42:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:43 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:42:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T07:42:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:42:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:42:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14302.888016 secs 2023-05-08T07:42:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:42:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:42:44.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14302.888016 secs 2023-05-08T07:42:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:42:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:42:45.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14302.888016 secs 2023-05-08T07:42:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:42:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:42:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:45 smithi186 ceph-mon[126480]: pgmap v7686: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 202 KiB/s wr, 9 op/s 2023-05-08T07:42:45.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:45 smithi133 ceph-mon[125939]: pgmap v7686: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 202 KiB/s wr, 9 op/s 2023-05-08T07:42:46.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:45 smithi096 ceph-mon[124666]: pgmap v7686: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 202 KiB/s wr, 9 op/s 2023-05-08T07:42:47.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:47 smithi186 ceph-mon[126480]: pgmap v7687: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 202 KiB/s wr, 9 op/s 2023-05-08T07:42:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:47 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T07:42:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:47 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:42:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:42:47.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:47 smithi133 ceph-mon[125939]: pgmap v7687: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 202 KiB/s wr, 9 op/s 2023-05-08T07:42:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:47 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T07:42:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:47 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:42:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:42:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:47 smithi096 ceph-mon[124666]: pgmap v7687: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 202 KiB/s wr, 9 op/s 2023-05-08T07:42:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:47 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T07:42:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:47 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:42:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:42:48.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:48 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:42:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:42:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:42:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:48 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:42:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:42:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:42:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:48 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:42:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:42:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:42:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14307.888139 secs 2023-05-08T07:42:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:49 smithi186 ceph-mon[126480]: pgmap v7688: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 170 KiB/s wr, 7 op/s 2023-05-08T07:42:49.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14307.888139 secs 2023-05-08T07:42:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:49 smithi133 ceph-mon[125939]: pgmap v7688: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 170 KiB/s wr, 7 op/s 2023-05-08T07:42:50.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14307.888139 secs 2023-05-08T07:42:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:49 smithi096 ceph-mon[124666]: pgmap v7688: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 170 KiB/s wr, 7 op/s 2023-05-08T07:42:51.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:51 smithi186 ceph-mon[126480]: pgmap v7689: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 331 KiB/s wr, 13 op/s 2023-05-08T07:42:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:51 smithi133 ceph-mon[125939]: pgmap v7689: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 331 KiB/s wr, 13 op/s 2023-05-08T07:42:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:51 smithi096 ceph-mon[124666]: pgmap v7689: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 331 KiB/s wr, 13 op/s 2023-05-08T07:42:53.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:53 smithi186 ceph-mon[126480]: pgmap v7690: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 238 KiB/s wr, 9 op/s 2023-05-08T07:42:53.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:53 smithi133 ceph-mon[125939]: pgmap v7690: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 238 KiB/s wr, 9 op/s 2023-05-08T07:42:54.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:53 smithi096 ceph-mon[124666]: pgmap v7690: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 238 KiB/s wr, 9 op/s 2023-05-08T07:42:54.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14312.888258 secs 2023-05-08T07:42:55.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14312.888258 secs 2023-05-08T07:42:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14312.888258 secs 2023-05-08T07:42:55.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14313.445905 secs 2023-05-08T07:42:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:55 smithi133 ceph-mon[125939]: pgmap v7691: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 338 KiB/s wr, 13 op/s 2023-05-08T07:42:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14313.445905 secs 2023-05-08T07:42:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:55 smithi096 ceph-mon[124666]: pgmap v7691: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 338 KiB/s wr, 13 op/s 2023-05-08T07:42:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14313.445905 secs 2023-05-08T07:42:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:55 smithi186 ceph-mon[126480]: pgmap v7691: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 338 KiB/s wr, 13 op/s 2023-05-08T07:42:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:56 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:42:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:42:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:42:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:56 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:42:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:42:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:42:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:56 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:42:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:42:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:42:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:57 smithi133 ceph-mon[125939]: pgmap v7692: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 262 KiB/s wr, 9 op/s 2023-05-08T07:42:58.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:57 smithi096 ceph-mon[124666]: pgmap v7692: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 262 KiB/s wr, 9 op/s 2023-05-08T07:42:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:57 smithi186 ceph-mon[126480]: pgmap v7692: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 262 KiB/s wr, 9 op/s 2023-05-08T07:42:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14317.888391 secs 2023-05-08T07:42:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:59 smithi133 ceph-mon[125939]: pgmap v7693: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 262 KiB/s wr, 9 op/s 2023-05-08T07:42:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:42:59 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:43:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14317.888391 secs 2023-05-08T07:43:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:59 smithi096 ceph-mon[124666]: pgmap v7693: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 262 KiB/s wr, 9 op/s 2023-05-08T07:43:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:42:59 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:43:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14317.888391 secs 2023-05-08T07:43:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:59 smithi186 ceph-mon[126480]: pgmap v7693: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 262 KiB/s wr, 9 op/s 2023-05-08T07:43:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:42:59 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:43:00.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:43:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:43:01.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:43:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:43:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:43:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:43:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14319.729152 secs 2023-05-08T07:43:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:01 smithi133 ceph-mon[125939]: pgmap v7694: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 468 KiB/s wr, 14 op/s 2023-05-08T07:43:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:01 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:43:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14319.729152 secs 2023-05-08T07:43:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:01 smithi096 ceph-mon[124666]: pgmap v7694: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 468 KiB/s wr, 14 op/s 2023-05-08T07:43:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:01 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:43:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14319.729152 secs 2023-05-08T07:43:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:01 smithi186 ceph-mon[126480]: pgmap v7694: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 468 KiB/s wr, 14 op/s 2023-05-08T07:43:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:01 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:43:03.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:03 smithi133 ceph-mon[125939]: pgmap v7695: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 306 KiB/s wr, 9 op/s 2023-05-08T07:43:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14322.888525 secs 2023-05-08T07:43:04.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:03 smithi096 ceph-mon[124666]: pgmap v7695: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 306 KiB/s wr, 9 op/s 2023-05-08T07:43:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14322.888525 secs 2023-05-08T07:43:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:03 smithi186 ceph-mon[126480]: pgmap v7695: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 306 KiB/s wr, 9 op/s 2023-05-08T07:43:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14322.888525 secs 2023-05-08T07:43:04.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:04 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:43:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:04 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:43:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14323.446165 secs 2023-05-08T07:43:05.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:04 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:43:05.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:04 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:43:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14323.446165 secs 2023-05-08T07:43:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:04 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:43:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:04 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:43:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14323.446165 secs 2023-05-08T07:43:05.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:05 smithi133 ceph-mon[125939]: pgmap v7696: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 319 KiB/s rd, 352 KiB/s wr, 27 op/s 2023-05-08T07:43:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:05 smithi096 ceph-mon[124666]: pgmap v7696: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 319 KiB/s rd, 352 KiB/s wr, 27 op/s 2023-05-08T07:43:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:05 smithi186 ceph-mon[126480]: pgmap v7696: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 319 KiB/s rd, 352 KiB/s wr, 27 op/s 2023-05-08T07:43:06.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14324.729255 secs 2023-05-08T07:43:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:06 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:43:07.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14324.729255 secs 2023-05-08T07:43:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:06 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:43:07.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14324.729255 secs 2023-05-08T07:43:07.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:06 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:43:07.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:07 smithi133 ceph-mon[125939]: pgmap v7697: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 252 KiB/s wr, 23 op/s 2023-05-08T07:43:08.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:07 smithi096 ceph-mon[124666]: pgmap v7697: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 252 KiB/s wr, 23 op/s 2023-05-08T07:43:08.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:07 smithi186 ceph-mon[126480]: pgmap v7697: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 252 KiB/s wr, 23 op/s 2023-05-08T07:43:08.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:43:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:43:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14327.888645 secs 2023-05-08T07:43:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:43:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:43:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14327.888645 secs 2023-05-08T07:43:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:43:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:43:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14327.888645 secs 2023-05-08T07:43:09.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:09 smithi133 ceph-mon[125939]: pgmap v7698: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 252 KiB/s wr, 23 op/s 2023-05-08T07:43:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14328.446271 secs 2023-05-08T07:43:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:09 smithi096 ceph-mon[124666]: pgmap v7698: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 252 KiB/s wr, 23 op/s 2023-05-08T07:43:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14328.446271 secs 2023-05-08T07:43:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:09 smithi186 ceph-mon[126480]: pgmap v7698: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 252 KiB/s wr, 23 op/s 2023-05-08T07:43:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14328.446271 secs 2023-05-08T07:43:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14329.729393 secs 2023-05-08T07:43:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:11 smithi133 ceph-mon[125939]: pgmap v7699: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 346 KiB/s wr, 27 op/s 2023-05-08T07:43:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:11 smithi133 ceph-mon[125939]: osdmap e558: 12 total, 12 up, 12 in 2023-05-08T07:43:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:11 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:43:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14329.729393 secs 2023-05-08T07:43:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:11 smithi096 ceph-mon[124666]: pgmap v7699: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 346 KiB/s wr, 27 op/s 2023-05-08T07:43:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:11 smithi096 ceph-mon[124666]: osdmap e558: 12 total, 12 up, 12 in 2023-05-08T07:43:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:11 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:43:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14329.729393 secs 2023-05-08T07:43:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:11 smithi186 ceph-mon[126480]: pgmap v7699: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 346 KiB/s wr, 27 op/s 2023-05-08T07:43:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:11 smithi186 ceph-mon[126480]: osdmap e558: 12 total, 12 up, 12 in 2023-05-08T07:43:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:11 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:43:13.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:13 smithi133 ceph-mon[125939]: pgmap v7701: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 168 KiB/s wr, 27 op/s 2023-05-08T07:43:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14332.888762 secs 2023-05-08T07:43:14.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:13 smithi096 ceph-mon[124666]: pgmap v7701: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 168 KiB/s wr, 27 op/s 2023-05-08T07:43:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14332.888762 secs 2023-05-08T07:43:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:13 smithi186 ceph-mon[126480]: pgmap v7701: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 168 KiB/s wr, 27 op/s 2023-05-08T07:43:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14332.888762 secs 2023-05-08T07:43:14.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14333.446391 secs 2023-05-08T07:43:15.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14333.446391 secs 2023-05-08T07:43:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14333.446391 secs 2023-05-08T07:43:15.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:15 smithi133 ceph-mon[125939]: pgmap v7702: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 122 KiB/s wr, 8 op/s 2023-05-08T07:43:16.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:15 smithi096 ceph-mon[124666]: pgmap v7702: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 122 KiB/s wr, 8 op/s 2023-05-08T07:43:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:15 smithi186 ceph-mon[126480]: pgmap v7702: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 122 KiB/s wr, 8 op/s 2023-05-08T07:43:16.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14334.729498 secs 2023-05-08T07:43:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14334.729498 secs 2023-05-08T07:43:17.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14334.729498 secs 2023-05-08T07:43:17.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:17 smithi133 ceph-mon[125939]: pgmap v7703: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 122 KiB/s wr, 8 op/s 2023-05-08T07:43:18.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:17 smithi096 ceph-mon[124666]: pgmap v7703: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 122 KiB/s wr, 8 op/s 2023-05-08T07:43:18.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:17 smithi186 ceph-mon[126480]: pgmap v7703: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 122 KiB/s wr, 8 op/s 2023-05-08T07:43:18.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14337.888881 secs 2023-05-08T07:43:19.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14337.888881 secs 2023-05-08T07:43:19.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14337.888881 secs 2023-05-08T07:43:19.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:19 smithi133 ceph-mon[125939]: pgmap v7704: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 122 KiB/s wr, 8 op/s 2023-05-08T07:43:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14338.446448 secs 2023-05-08T07:43:20.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:19 smithi096 ceph-mon[124666]: pgmap v7704: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 122 KiB/s wr, 8 op/s 2023-05-08T07:43:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14338.446448 secs 2023-05-08T07:43:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:19 smithi186 ceph-mon[126480]: pgmap v7704: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 122 KiB/s wr, 8 op/s 2023-05-08T07:43:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14338.446448 secs 2023-05-08T07:43:21.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14339.729637 secs 2023-05-08T07:43:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:21 smithi133 ceph-mon[125939]: pgmap v7705: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 39 KiB/s wr, 8 op/s 2023-05-08T07:43:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:21 smithi133 ceph-mon[125939]: osdmap e559: 12 total, 12 up, 12 in 2023-05-08T07:43:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14339.729637 secs 2023-05-08T07:43:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:21 smithi096 ceph-mon[124666]: pgmap v7705: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 39 KiB/s wr, 8 op/s 2023-05-08T07:43:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:21 smithi096 ceph-mon[124666]: osdmap e559: 12 total, 12 up, 12 in 2023-05-08T07:43:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14339.729637 secs 2023-05-08T07:43:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:21 smithi186 ceph-mon[126480]: pgmap v7705: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 39 KiB/s wr, 8 op/s 2023-05-08T07:43:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:21 smithi186 ceph-mon[126480]: osdmap e559: 12 total, 12 up, 12 in 2023-05-08T07:43:23.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:23 smithi133 ceph-mon[125939]: pgmap v7707: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 39 KiB/s wr, 8 op/s 2023-05-08T07:43:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14342.888994 secs 2023-05-08T07:43:24.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:23 smithi096 ceph-mon[124666]: pgmap v7707: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 39 KiB/s wr, 8 op/s 2023-05-08T07:43:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14342.888994 secs 2023-05-08T07:43:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:23 smithi186 ceph-mon[126480]: pgmap v7707: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 39 KiB/s wr, 8 op/s 2023-05-08T07:43:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14342.888994 secs 2023-05-08T07:43:25.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14343.446593 secs 2023-05-08T07:43:25.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14343.446593 secs 2023-05-08T07:43:25.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14343.446593 secs 2023-05-08T07:43:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:25 smithi096 ceph-mon[124666]: pgmap v7708: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 83 KiB/s wr, 8 op/s 2023-05-08T07:43:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:25 smithi186 ceph-mon[126480]: pgmap v7708: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 83 KiB/s wr, 8 op/s 2023-05-08T07:43:26.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:25 smithi133 ceph-mon[125939]: pgmap v7708: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 83 KiB/s wr, 8 op/s 2023-05-08T07:43:27.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14344.729733 secs 2023-05-08T07:43:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14344.729733 secs 2023-05-08T07:43:27.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14344.729733 secs 2023-05-08T07:43:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:27 smithi096 ceph-mon[124666]: pgmap v7709: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 83 KiB/s wr, 8 op/s 2023-05-08T07:43:28.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:27 smithi186 ceph-mon[126480]: pgmap v7709: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 83 KiB/s wr, 8 op/s 2023-05-08T07:43:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:27 smithi133 ceph-mon[125939]: pgmap v7709: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 83 KiB/s wr, 8 op/s 2023-05-08T07:43:29.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14347.889112 secs 2023-05-08T07:43:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14347.889112 secs 2023-05-08T07:43:29.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14347.889112 secs 2023-05-08T07:43:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:29 smithi186 ceph-mon[126480]: pgmap v7710: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 83 KiB/s wr, 8 op/s 2023-05-08T07:43:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14348.446686 secs 2023-05-08T07:43:30.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:29 smithi133 ceph-mon[125939]: pgmap v7710: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 83 KiB/s wr, 8 op/s 2023-05-08T07:43:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14348.446686 secs 2023-05-08T07:43:30.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:29 smithi096 ceph-mon[124666]: pgmap v7710: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 83 KiB/s wr, 8 op/s 2023-05-08T07:43:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14348.446686 secs 2023-05-08T07:43:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14349.729855 secs 2023-05-08T07:43:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:31 smithi186 ceph-mon[126480]: pgmap v7711: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 53 KiB/s wr, 7 op/s 2023-05-08T07:43:32.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14349.729855 secs 2023-05-08T07:43:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:31 smithi133 ceph-mon[125939]: pgmap v7711: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 53 KiB/s wr, 7 op/s 2023-05-08T07:43:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14349.729855 secs 2023-05-08T07:43:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:31 smithi096 ceph-mon[124666]: pgmap v7711: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 53 KiB/s wr, 7 op/s 2023-05-08T07:43:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:33 smithi186 ceph-mon[126480]: pgmap v7712: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 49 KiB/s wr, 7 op/s 2023-05-08T07:43:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14352.889262 secs 2023-05-08T07:43:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:33 smithi133 ceph-mon[125939]: pgmap v7712: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 49 KiB/s wr, 7 op/s 2023-05-08T07:43:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14352.889262 secs 2023-05-08T07:43:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:33 smithi096 ceph-mon[124666]: pgmap v7712: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 49 KiB/s wr, 7 op/s 2023-05-08T07:43:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14352.889262 secs 2023-05-08T07:43:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14353.446833 secs 2023-05-08T07:43:35.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14353.446833 secs 2023-05-08T07:43:35.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14353.446833 secs 2023-05-08T07:43:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:35 smithi186 ceph-mon[126480]: pgmap v7713: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 63 KiB/s wr, 9 op/s 2023-05-08T07:43:36.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:35 smithi133 ceph-mon[125939]: pgmap v7713: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 63 KiB/s wr, 9 op/s 2023-05-08T07:43:36.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:35 smithi096 ceph-mon[124666]: pgmap v7713: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 63 KiB/s wr, 9 op/s 2023-05-08T07:43:37.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14354.729965 secs 2023-05-08T07:43:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14354.729965 secs 2023-05-08T07:43:37.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14354.729965 secs 2023-05-08T07:43:38.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:37 smithi186 ceph-mon[126480]: pgmap v7714: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 44 KiB/s wr, 6 op/s 2023-05-08T07:43:38.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:37 smithi133 ceph-mon[125939]: pgmap v7714: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 44 KiB/s wr, 6 op/s 2023-05-08T07:43:38.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:37 smithi096 ceph-mon[124666]: pgmap v7714: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 44 KiB/s wr, 6 op/s 2023-05-08T07:43:39.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14357.889361 secs 2023-05-08T07:43:39.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14357.889361 secs 2023-05-08T07:43:39.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14357.889361 secs 2023-05-08T07:43:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:39 smithi186 ceph-mon[126480]: pgmap v7715: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 44 KiB/s wr, 6 op/s 2023-05-08T07:43:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14358.446987 secs 2023-05-08T07:43:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:43:40.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:39 smithi133 ceph-mon[125939]: pgmap v7715: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 44 KiB/s wr, 6 op/s 2023-05-08T07:43:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14358.446987 secs 2023-05-08T07:43:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:43:40.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:39 smithi096 ceph-mon[124666]: pgmap v7715: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 44 KiB/s wr, 6 op/s 2023-05-08T07:43:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14358.446987 secs 2023-05-08T07:43:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:43:41.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:40 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:43:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:40 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:43:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:40 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:43:41.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:40 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:43:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:40 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:43:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:40 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:43:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:40 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:43:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:40 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:43:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:40 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:43:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:41 smithi186 ceph-mon[126480]: pgmap v7716: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 45 KiB/s wr, 10 op/s 2023-05-08T07:43:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:41 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:43:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:41 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T07:43:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:41 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T07:43:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:41 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:43:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:41 smithi133 ceph-mon[125939]: pgmap v7716: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 45 KiB/s wr, 10 op/s 2023-05-08T07:43:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:41 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:43:42.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:41 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T07:43:42.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:41 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T07:43:42.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:41 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:43:42.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:41 smithi096 ceph-mon[124666]: pgmap v7716: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 45 KiB/s wr, 10 op/s 2023-05-08T07:43:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:41 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:43:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:41 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T07:43:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:41 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T07:43:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:41 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:43:43.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:43:43.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:43:43.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:43:44.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:43 smithi186 ceph-mon[126480]: pgmap v7717: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 148 KiB/s wr, 6 op/s 2023-05-08T07:43:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:43 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:43:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:43:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:43:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14362.889441 secs 2023-05-08T07:43:44.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:43 smithi133 ceph-mon[125939]: pgmap v7717: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 148 KiB/s wr, 6 op/s 2023-05-08T07:43:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:43 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:43:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:43:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:43:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14362.889441 secs 2023-05-08T07:43:44.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:43 smithi096 ceph-mon[124666]: pgmap v7717: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 148 KiB/s wr, 6 op/s 2023-05-08T07:43:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:43 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:43:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:43:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:43:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14362.889441 secs 2023-05-08T07:43:45.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14363.447109 secs 2023-05-08T07:43:45.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14363.447109 secs 2023-05-08T07:43:45.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14363.447109 secs 2023-05-08T07:43:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:45 smithi186 ceph-mon[126480]: pgmap v7718: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 148 KiB/s wr, 9 op/s 2023-05-08T07:43:46.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:45 smithi133 ceph-mon[125939]: pgmap v7718: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 148 KiB/s wr, 9 op/s 2023-05-08T07:43:46.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:45 smithi096 ceph-mon[124666]: pgmap v7718: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 148 KiB/s wr, 9 op/s 2023-05-08T07:43:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:47 smithi186 ceph-mon[126480]: pgmap v7719: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 211 KiB/s wr, 7 op/s 2023-05-08T07:43:48.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:47 smithi133 ceph-mon[125939]: pgmap v7719: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 211 KiB/s wr, 7 op/s 2023-05-08T07:43:48.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:47 smithi096 ceph-mon[124666]: pgmap v7719: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 211 KiB/s wr, 7 op/s 2023-05-08T07:43:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14367.889560 secs 2023-05-08T07:43:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14367.889560 secs 2023-05-08T07:43:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14367.889560 secs 2023-05-08T07:43:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:49 smithi186 ceph-mon[126480]: pgmap v7720: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 186 KiB/s wr, 7 op/s 2023-05-08T07:43:50.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:49 smithi133 ceph-mon[125939]: pgmap v7720: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 186 KiB/s wr, 7 op/s 2023-05-08T07:43:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:49 smithi096 ceph-mon[124666]: pgmap v7720: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 186 KiB/s wr, 7 op/s 2023-05-08T07:43:51.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:50 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:43:51.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:50 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:43:51.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:50 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:43:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:51 smithi186 ceph-mon[126480]: pgmap v7721: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 194 KiB/s wr, 10 op/s 2023-05-08T07:43:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:51 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:43:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:43:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:43:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:51 smithi133 ceph-mon[125939]: pgmap v7721: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 194 KiB/s wr, 10 op/s 2023-05-08T07:43:52.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:51 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:43:52.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:43:52.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:43:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:51 smithi096 ceph-mon[124666]: pgmap v7721: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 194 KiB/s wr, 10 op/s 2023-05-08T07:43:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:51 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:43:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:43:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:43:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:53 smithi186 ceph-mon[126480]: pgmap v7722: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 210 KiB/s wr, 7 op/s 2023-05-08T07:43:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14372.889655 secs 2023-05-08T07:43:54.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:53 smithi133 ceph-mon[125939]: pgmap v7722: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 210 KiB/s wr, 7 op/s 2023-05-08T07:43:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14372.889655 secs 2023-05-08T07:43:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:53 smithi096 ceph-mon[124666]: pgmap v7722: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 210 KiB/s wr, 7 op/s 2023-05-08T07:43:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14372.889655 secs 2023-05-08T07:43:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:55 smithi186 ceph-mon[126480]: pgmap v7723: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 114 KiB/s wr, 11 op/s 2023-05-08T07:43:56.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:55 smithi133 ceph-mon[125939]: pgmap v7723: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 114 KiB/s wr, 11 op/s 2023-05-08T07:43:56.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:55 smithi096 ceph-mon[124666]: pgmap v7723: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 114 KiB/s wr, 11 op/s 2023-05-08T07:43:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:57 smithi186 ceph-mon[126480]: pgmap v7724: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 229 KiB/s wr, 9 op/s 2023-05-08T07:43:58.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:57 smithi133 ceph-mon[125939]: pgmap v7724: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 229 KiB/s wr, 9 op/s 2023-05-08T07:43:58.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:57 smithi096 ceph-mon[124666]: pgmap v7724: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 229 KiB/s wr, 9 op/s 2023-05-08T07:43:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14377.889806 secs 2023-05-08T07:43:59.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14377.889806 secs 2023-05-08T07:43:59.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14377.889806 secs 2023-05-08T07:44:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:59 smithi186 ceph-mon[126480]: pgmap v7725: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 147 KiB/s wr, 8 op/s 2023-05-08T07:44:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14378.447513 secs 2023-05-08T07:44:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:59 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:44:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:59 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:44:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:43:59 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:44:00.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:59 smithi133 ceph-mon[125939]: pgmap v7725: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 147 KiB/s wr, 8 op/s 2023-05-08T07:44:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14378.447513 secs 2023-05-08T07:44:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:59 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:44:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:59 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:44:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:43:59 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:44:00.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:59 smithi096 ceph-mon[124666]: pgmap v7725: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 147 KiB/s wr, 8 op/s 2023-05-08T07:44:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14378.447513 secs 2023-05-08T07:44:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:59 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:44:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:59 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:44:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:43:59 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:44:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:01 smithi186 ceph-mon[126480]: pgmap v7726: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 253 KiB/s wr, 12 op/s 2023-05-08T07:44:02.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:01 smithi133 ceph-mon[125939]: pgmap v7726: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 253 KiB/s wr, 12 op/s 2023-05-08T07:44:02.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:01 smithi096 ceph-mon[124666]: pgmap v7726: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 253 KiB/s wr, 12 op/s 2023-05-08T07:44:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:03 smithi186 ceph-mon[126480]: pgmap v7727: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 245 KiB/s wr, 10 op/s 2023-05-08T07:44:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14382.889918 secs 2023-05-08T07:44:04.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:03 smithi133 ceph-mon[125939]: pgmap v7727: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 245 KiB/s wr, 10 op/s 2023-05-08T07:44:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14382.889918 secs 2023-05-08T07:44:04.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:03 smithi096 ceph-mon[124666]: pgmap v7727: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 245 KiB/s wr, 10 op/s 2023-05-08T07:44:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14382.889918 secs 2023-05-08T07:44:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14383.447603 secs 2023-05-08T07:44:05.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14383.447603 secs 2023-05-08T07:44:05.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14383.447603 secs 2023-05-08T07:44:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:05 smithi186 ceph-mon[126480]: pgmap v7728: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 449 KiB/s wr, 25 op/s 2023-05-08T07:44:06.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:05 smithi133 ceph-mon[125939]: pgmap v7728: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 449 KiB/s wr, 25 op/s 2023-05-08T07:44:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:05 smithi096 ceph-mon[124666]: pgmap v7728: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 449 KiB/s wr, 25 op/s 2023-05-08T07:44:08.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:07 smithi186 ceph-mon[126480]: pgmap v7729: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 442 KiB/s wr, 22 op/s 2023-05-08T07:44:08.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:07 smithi133 ceph-mon[125939]: pgmap v7729: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 442 KiB/s wr, 22 op/s 2023-05-08T07:44:08.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:07 smithi096 ceph-mon[124666]: pgmap v7729: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 442 KiB/s wr, 22 op/s 2023-05-08T07:44:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14387.890064 secs 2023-05-08T07:44:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14387.890064 secs 2023-05-08T07:44:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14387.890064 secs 2023-05-08T07:44:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:09 smithi186 ceph-mon[126480]: pgmap v7730: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 326 KiB/s wr, 20 op/s 2023-05-08T07:44:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:09 smithi133 ceph-mon[125939]: pgmap v7730: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 326 KiB/s wr, 20 op/s 2023-05-08T07:44:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:09 smithi096 ceph-mon[124666]: pgmap v7730: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 326 KiB/s wr, 20 op/s 2023-05-08T07:44:11.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:10 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:44:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:10 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:44:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:10 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:44:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:11 smithi133 ceph-mon[125939]: pgmap v7731: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 425 KiB/s rd, 422 KiB/s wr, 25 op/s 2023-05-08T07:44:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:11 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:44:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:11 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:44:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:11 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:44:12.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:11 smithi096 ceph-mon[124666]: pgmap v7731: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 425 KiB/s rd, 422 KiB/s wr, 25 op/s 2023-05-08T07:44:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:11 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:44:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:11 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:44:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:11 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:44:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:11 smithi186 ceph-mon[126480]: pgmap v7731: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 425 KiB/s rd, 422 KiB/s wr, 25 op/s 2023-05-08T07:44:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:11 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:44:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:11 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:44:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:11 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:44:14.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:13 smithi133 ceph-mon[125939]: pgmap v7732: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 317 KiB/s wr, 21 op/s 2023-05-08T07:44:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14392.890191 secs 2023-05-08T07:44:14.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:13 smithi096 ceph-mon[124666]: pgmap v7732: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 317 KiB/s wr, 21 op/s 2023-05-08T07:44:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14392.890191 secs 2023-05-08T07:44:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:13 smithi186 ceph-mon[126480]: pgmap v7732: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 317 KiB/s wr, 21 op/s 2023-05-08T07:44:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14392.890191 secs 2023-05-08T07:44:16.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:15 smithi133 ceph-mon[125939]: pgmap v7733: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 412 KiB/s wr, 25 op/s 2023-05-08T07:44:16.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:15 smithi096 ceph-mon[124666]: pgmap v7733: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 412 KiB/s wr, 25 op/s 2023-05-08T07:44:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:15 smithi186 ceph-mon[126480]: pgmap v7733: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 412 KiB/s wr, 25 op/s 2023-05-08T07:44:18.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:17 smithi133 ceph-mon[125939]: pgmap v7734: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 191 KiB/s wr, 8 op/s 2023-05-08T07:44:18.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:17 smithi096 ceph-mon[124666]: pgmap v7734: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 191 KiB/s wr, 8 op/s 2023-05-08T07:44:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:17 smithi186 ceph-mon[126480]: pgmap v7734: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 191 KiB/s wr, 8 op/s 2023-05-08T07:44:19.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14397.890323 secs 2023-05-08T07:44:19.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14397.890323 secs 2023-05-08T07:44:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14397.890323 secs 2023-05-08T07:44:20.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:19 smithi133 ceph-mon[125939]: pgmap v7735: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 191 KiB/s wr, 8 op/s 2023-05-08T07:44:20.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:19 smithi096 ceph-mon[124666]: pgmap v7735: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 191 KiB/s wr, 8 op/s 2023-05-08T07:44:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:19 smithi186 ceph-mon[126480]: pgmap v7735: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 191 KiB/s wr, 8 op/s 2023-05-08T07:44:22.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:21 smithi133 ceph-mon[125939]: pgmap v7736: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 379 KiB/s rd, 192 KiB/s wr, 12 op/s 2023-05-08T07:44:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:21 smithi096 ceph-mon[124666]: pgmap v7736: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 379 KiB/s rd, 192 KiB/s wr, 12 op/s 2023-05-08T07:44:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:21 smithi186 ceph-mon[126480]: pgmap v7736: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 379 KiB/s rd, 192 KiB/s wr, 12 op/s 2023-05-08T07:44:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:23 smithi133 ceph-mon[125939]: pgmap v7737: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 96 KiB/s wr, 7 op/s 2023-05-08T07:44:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14402.890421 secs 2023-05-08T07:44:24.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:23 smithi096 ceph-mon[124666]: pgmap v7737: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 96 KiB/s wr, 7 op/s 2023-05-08T07:44:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14402.890421 secs 2023-05-08T07:44:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:23 smithi186 ceph-mon[126480]: pgmap v7737: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 96 KiB/s wr, 7 op/s 2023-05-08T07:44:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14402.890421 secs 2023-05-08T07:44:25.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14403.448062 secs 2023-05-08T07:44:25.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14403.448062 secs 2023-05-08T07:44:25.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14403.448062 secs 2023-05-08T07:44:26.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:25 smithi133 ceph-mon[125939]: pgmap v7738: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 249 KiB/s wr, 13 op/s 2023-05-08T07:44:26.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:25 smithi096 ceph-mon[124666]: pgmap v7738: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 249 KiB/s wr, 13 op/s 2023-05-08T07:44:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:25 smithi186 ceph-mon[126480]: pgmap v7738: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 249 KiB/s wr, 13 op/s 2023-05-08T07:44:27.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14404.731085 secs 2023-05-08T07:44:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:26 smithi133 ceph-mon[125939]: osdmap e560: 12 total, 12 up, 12 in 2023-05-08T07:44:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:26 smithi133 ceph-mon[125939]: pgmap v7740: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 185 KiB/s wr, 11 op/s 2023-05-08T07:44:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14404.731085 secs 2023-05-08T07:44:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:26 smithi096 ceph-mon[124666]: osdmap e560: 12 total, 12 up, 12 in 2023-05-08T07:44:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:26 smithi096 ceph-mon[124666]: pgmap v7740: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 185 KiB/s wr, 11 op/s 2023-05-08T07:44:27.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14404.731085 secs 2023-05-08T07:44:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:26 smithi186 ceph-mon[126480]: osdmap e560: 12 total, 12 up, 12 in 2023-05-08T07:44:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:26 smithi186 ceph-mon[126480]: pgmap v7740: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 185 KiB/s wr, 11 op/s 2023-05-08T07:44:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:27 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:44:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:27 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:44:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:27 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:44:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:27 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:44:28.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:27 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:44:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:27 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:44:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:27 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:44:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:27 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:44:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:27 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:44:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:27 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:44:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:27 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:44:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:27 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:44:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14407.890546 secs 2023-05-08T07:44:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:28 smithi133 ceph-mon[125939]: pgmap v7741: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 185 KiB/s wr, 11 op/s 2023-05-08T07:44:29.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14407.890546 secs 2023-05-08T07:44:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:28 smithi096 ceph-mon[124666]: pgmap v7741: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 185 KiB/s wr, 11 op/s 2023-05-08T07:44:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14407.890546 secs 2023-05-08T07:44:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:28 smithi186 ceph-mon[126480]: pgmap v7741: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 185 KiB/s wr, 11 op/s 2023-05-08T07:44:30.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14408.448215 secs 2023-05-08T07:44:30.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14408.448215 secs 2023-05-08T07:44:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14408.448215 secs 2023-05-08T07:44:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:30 smithi133 ceph-mon[125939]: pgmap v7742: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 298 KiB/s wr, 13 op/s 2023-05-08T07:44:31.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:30 smithi096 ceph-mon[124666]: pgmap v7742: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 298 KiB/s wr, 13 op/s 2023-05-08T07:44:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:30 smithi186 ceph-mon[126480]: pgmap v7742: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 298 KiB/s wr, 13 op/s 2023-05-08T07:44:32.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14409.731215 secs 2023-05-08T07:44:32.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14409.731215 secs 2023-05-08T07:44:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14409.731215 secs 2023-05-08T07:44:33.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:32 smithi133 ceph-mon[125939]: pgmap v7743: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 298 KiB/s wr, 13 op/s 2023-05-08T07:44:33.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:32 smithi096 ceph-mon[124666]: pgmap v7743: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 298 KiB/s wr, 13 op/s 2023-05-08T07:44:33.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:32 smithi186 ceph-mon[126480]: pgmap v7743: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 298 KiB/s wr, 13 op/s 2023-05-08T07:44:34.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14412.890626 secs 2023-05-08T07:44:34.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14412.890626 secs 2023-05-08T07:44:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14412.890626 secs 2023-05-08T07:44:35.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14413.448329 secs 2023-05-08T07:44:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:34 smithi133 ceph-mon[125939]: pgmap v7744: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 115 KiB/s wr, 9 op/s 2023-05-08T07:44:35.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14413.448329 secs 2023-05-08T07:44:35.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:34 smithi096 ceph-mon[124666]: pgmap v7744: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 115 KiB/s wr, 9 op/s 2023-05-08T07:44:35.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14413.448329 secs 2023-05-08T07:44:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:34 smithi186 ceph-mon[126480]: pgmap v7744: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 115 KiB/s wr, 9 op/s 2023-05-08T07:44:36.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14414.731297 secs 2023-05-08T07:44:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14414.731297 secs 2023-05-08T07:44:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14414.731297 secs 2023-05-08T07:44:37.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:37 smithi133 ceph-mon[125939]: pgmap v7745: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 110 KiB/s wr, 9 op/s 2023-05-08T07:44:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:37 smithi133 ceph-mon[125939]: osdmap e561: 12 total, 12 up, 12 in 2023-05-08T07:44:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:37 smithi096 ceph-mon[124666]: pgmap v7745: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 110 KiB/s wr, 9 op/s 2023-05-08T07:44:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:37 smithi096 ceph-mon[124666]: osdmap e561: 12 total, 12 up, 12 in 2023-05-08T07:44:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:37 smithi186 ceph-mon[126480]: pgmap v7745: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 110 KiB/s wr, 9 op/s 2023-05-08T07:44:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:37 smithi186 ceph-mon[126480]: osdmap e561: 12 total, 12 up, 12 in 2023-05-08T07:44:38.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14417.890690 secs 2023-05-08T07:44:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14417.890690 secs 2023-05-08T07:44:38.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14417.890690 secs 2023-05-08T07:44:39.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:39 smithi133 ceph-mon[125939]: pgmap v7747: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 115 KiB/s wr, 9 op/s 2023-05-08T07:44:39.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:39 smithi096 ceph-mon[124666]: pgmap v7747: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 115 KiB/s wr, 9 op/s 2023-05-08T07:44:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:39 smithi186 ceph-mon[126480]: pgmap v7747: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 115 KiB/s wr, 9 op/s 2023-05-08T07:44:40.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14418.448447 secs 2023-05-08T07:44:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:40 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:44:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14418.448447 secs 2023-05-08T07:44:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:40 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:44:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14418.448447 secs 2023-05-08T07:44:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:40 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:44:41.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:41 smithi133 ceph-mon[125939]: pgmap v7748: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 184 KiB/s wr, 8 op/s 2023-05-08T07:44:41.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:41 smithi096 ceph-mon[124666]: pgmap v7748: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 184 KiB/s wr, 8 op/s 2023-05-08T07:44:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:41 smithi186 ceph-mon[126480]: pgmap v7748: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 184 KiB/s wr, 8 op/s 2023-05-08T07:44:43.722 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:43 smithi133 ceph-mon[125939]: pgmap v7749: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 184 KiB/s wr, 8 op/s 2023-05-08T07:44:43.723 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:44:43.723 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14422.890791 secs 2023-05-08T07:44:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:43 smithi096 ceph-mon[124666]: pgmap v7749: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 184 KiB/s wr, 8 op/s 2023-05-08T07:44:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:44:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14422.890791 secs 2023-05-08T07:44:43.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:43 smithi186 ceph-mon[126480]: pgmap v7749: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 184 KiB/s wr, 8 op/s 2023-05-08T07:44:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:44:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14422.890791 secs 2023-05-08T07:44:44.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:44:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:44:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:44:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:44 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:44:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:44 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:44:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:44 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:44:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:44 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:44:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:44 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:44:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:44 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:44:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:44 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:44:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:44 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:44:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:44 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T07:44:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:44 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T07:44:44.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:44 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:44:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:44:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:44:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:44:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:44 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:44:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:44 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:44:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:44 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:44:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:44 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:44:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:44 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:44:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:44 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:44:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:44 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:44:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:44 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:44:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:44 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T07:44:44.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:44 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T07:44:44.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:44 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:44:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:44:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:44:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:44:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:44 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:44:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:44 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:44:44.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:44 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:44:44.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:44 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:44:44.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:44 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:44:44.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:44 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:44:44.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:44 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:44:44.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:44 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:44:44.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:44 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T07:44:44.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:44 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T07:44:44.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:44 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:44:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:45 smithi186 ceph-mon[126480]: pgmap v7750: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 205 KiB/s wr, 9 op/s 2023-05-08T07:44:46.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:45 smithi133 ceph-mon[125939]: pgmap v7750: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 205 KiB/s wr, 9 op/s 2023-05-08T07:44:46.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:45 smithi096 ceph-mon[124666]: pgmap v7750: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 205 KiB/s wr, 9 op/s 2023-05-08T07:44:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:47 smithi133 ceph-mon[125939]: pgmap v7751: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 205 KiB/s wr, 9 op/s 2023-05-08T07:44:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:44:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:47 smithi096 ceph-mon[124666]: pgmap v7751: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 205 KiB/s wr, 9 op/s 2023-05-08T07:44:47.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:44:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:47 smithi186 ceph-mon[126480]: pgmap v7751: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 205 KiB/s wr, 9 op/s 2023-05-08T07:44:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:44:48.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:44:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:44:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14427.890934 secs 2023-05-08T07:44:48.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:44:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:44:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14427.890934 secs 2023-05-08T07:44:48.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:44:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:44:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14427.890934 secs 2023-05-08T07:44:49.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:49 smithi133 ceph-mon[125939]: pgmap v7752: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 173 KiB/s wr, 8 op/s 2023-05-08T07:44:49.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:49 smithi096 ceph-mon[124666]: pgmap v7752: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 173 KiB/s wr, 8 op/s 2023-05-08T07:44:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:49 smithi186 ceph-mon[126480]: pgmap v7752: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 173 KiB/s wr, 8 op/s 2023-05-08T07:44:51.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:51 smithi133 ceph-mon[125939]: pgmap v7753: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 337 KiB/s wr, 13 op/s 2023-05-08T07:44:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:51 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:44:51.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:51 smithi096 ceph-mon[124666]: pgmap v7753: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 337 KiB/s wr, 13 op/s 2023-05-08T07:44:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:51 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:44:51.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:51 smithi186 ceph-mon[126480]: pgmap v7753: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 337 KiB/s wr, 13 op/s 2023-05-08T07:44:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:51 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:44:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:53 smithi096 ceph-mon[124666]: pgmap v7754: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 184 KiB/s wr, 9 op/s 2023-05-08T07:44:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14432.891076 secs 2023-05-08T07:44:53.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:53 smithi186 ceph-mon[126480]: pgmap v7754: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 184 KiB/s wr, 9 op/s 2023-05-08T07:44:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14432.891076 secs 2023-05-08T07:44:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:53 smithi133 ceph-mon[125939]: pgmap v7754: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 184 KiB/s wr, 9 op/s 2023-05-08T07:44:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14432.891076 secs 2023-05-08T07:44:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14433.448731 secs 2023-05-08T07:44:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:55 smithi096 ceph-mon[124666]: pgmap v7755: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 344 KiB/s wr, 14 op/s 2023-05-08T07:44:55.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14433.448731 secs 2023-05-08T07:44:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:55 smithi186 ceph-mon[126480]: pgmap v7755: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 344 KiB/s wr, 14 op/s 2023-05-08T07:44:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14433.448731 secs 2023-05-08T07:44:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:55 smithi133 ceph-mon[125939]: pgmap v7755: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 344 KiB/s wr, 14 op/s 2023-05-08T07:44:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:44:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:44:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:56 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:44:56.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:44:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:44:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:56 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:44:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:44:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:44:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:56 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:44:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:57 smithi096 ceph-mon[124666]: pgmap v7756: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 326 KiB/s wr, 10 op/s 2023-05-08T07:44:57.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:57 smithi186 ceph-mon[126480]: pgmap v7756: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 326 KiB/s wr, 10 op/s 2023-05-08T07:44:57.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:57 smithi133 ceph-mon[125939]: pgmap v7756: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 326 KiB/s wr, 10 op/s 2023-05-08T07:44:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14437.891195 secs 2023-05-08T07:44:58.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14437.891195 secs 2023-05-08T07:44:59.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14437.891195 secs 2023-05-08T07:44:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:59 smithi186 ceph-mon[126480]: pgmap v7757: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 326 KiB/s wr, 9 op/s 2023-05-08T07:44:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:44:59 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:44:59.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:59 smithi133 ceph-mon[125939]: pgmap v7757: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 326 KiB/s wr, 9 op/s 2023-05-08T07:44:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:44:59 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:45:00.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:59 smithi096 ceph-mon[124666]: pgmap v7757: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 326 KiB/s wr, 9 op/s 2023-05-08T07:45:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:44:59 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:45:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:45:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:45:00.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:45:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:45:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:45:01.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:45:01.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14439.731858 secs 2023-05-08T07:45:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:01 smithi186 ceph-mon[126480]: pgmap v7758: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 478 KiB/s wr, 14 op/s 2023-05-08T07:45:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:01 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:45:01.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14439.731858 secs 2023-05-08T07:45:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:01 smithi133 ceph-mon[125939]: pgmap v7758: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 478 KiB/s wr, 14 op/s 2023-05-08T07:45:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:01 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:45:02.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14439.731858 secs 2023-05-08T07:45:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:01 smithi096 ceph-mon[124666]: pgmap v7758: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 478 KiB/s wr, 14 op/s 2023-05-08T07:45:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:01 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:45:03.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:03 smithi186 ceph-mon[126480]: pgmap v7759: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 312 KiB/s wr, 9 op/s 2023-05-08T07:45:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14442.891307 secs 2023-05-08T07:45:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:03 smithi133 ceph-mon[125939]: pgmap v7759: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 312 KiB/s wr, 9 op/s 2023-05-08T07:45:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14442.891307 secs 2023-05-08T07:45:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:03 smithi096 ceph-mon[124666]: pgmap v7759: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 312 KiB/s wr, 9 op/s 2023-05-08T07:45:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14442.891307 secs 2023-05-08T07:45:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:04 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:45:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:04 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:45:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:04 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:45:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:04 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:45:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:04 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:45:05.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:04 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:45:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14443.448922 secs 2023-05-08T07:45:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:05 smithi186 ceph-mon[126480]: pgmap v7760: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 358 KiB/s wr, 27 op/s 2023-05-08T07:45:05.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14443.448922 secs 2023-05-08T07:45:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:05 smithi133 ceph-mon[125939]: pgmap v7760: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 358 KiB/s wr, 27 op/s 2023-05-08T07:45:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14443.448922 secs 2023-05-08T07:45:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:05 smithi096 ceph-mon[124666]: pgmap v7760: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 358 KiB/s wr, 27 op/s 2023-05-08T07:45:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14444.731924 secs 2023-05-08T07:45:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:06 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:45:06.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14444.731924 secs 2023-05-08T07:45:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:06 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:45:07.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14444.731924 secs 2023-05-08T07:45:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:06 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:45:07.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:07 smithi186 ceph-mon[126480]: pgmap v7761: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 197 KiB/s wr, 22 op/s 2023-05-08T07:45:07.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:07 smithi133 ceph-mon[125939]: pgmap v7761: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 197 KiB/s wr, 22 op/s 2023-05-08T07:45:08.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:07 smithi096 ceph-mon[124666]: pgmap v7761: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 197 KiB/s wr, 22 op/s 2023-05-08T07:45:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:45:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:45:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14447.891389 secs 2023-05-08T07:45:08.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:45:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:45:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14447.891389 secs 2023-05-08T07:45:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:45:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:45:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14447.891389 secs 2023-05-08T07:45:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:09 smithi186 ceph-mon[126480]: pgmap v7762: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 197 KiB/s wr, 22 op/s 2023-05-08T07:45:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:09 smithi133 ceph-mon[125939]: pgmap v7762: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 197 KiB/s wr, 22 op/s 2023-05-08T07:45:10.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:09 smithi096 ceph-mon[124666]: pgmap v7762: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 197 KiB/s wr, 22 op/s 2023-05-08T07:45:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14448.449039 secs 2023-05-08T07:45:10.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14448.449039 secs 2023-05-08T07:45:11.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14448.449039 secs 2023-05-08T07:45:11.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14449.732004 secs 2023-05-08T07:45:11.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:11 smithi186 ceph-mon[126480]: pgmap v7763: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 251 KiB/s wr, 26 op/s 2023-05-08T07:45:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:11 smithi186 ceph-mon[126480]: osdmap e562: 12 total, 12 up, 12 in 2023-05-08T07:45:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:11 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:45:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14449.732004 secs 2023-05-08T07:45:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:11 smithi133 ceph-mon[125939]: pgmap v7763: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 251 KiB/s wr, 26 op/s 2023-05-08T07:45:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:11 smithi133 ceph-mon[125939]: osdmap e562: 12 total, 12 up, 12 in 2023-05-08T07:45:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:11 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:45:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14449.732004 secs 2023-05-08T07:45:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:11 smithi096 ceph-mon[124666]: pgmap v7763: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 251 KiB/s wr, 26 op/s 2023-05-08T07:45:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:11 smithi096 ceph-mon[124666]: osdmap e562: 12 total, 12 up, 12 in 2023-05-08T07:45:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:11 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:45:13.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:13 smithi186 ceph-mon[126480]: pgmap v7765: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 119 KiB/s wr, 26 op/s 2023-05-08T07:45:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14452.891511 secs 2023-05-08T07:45:13.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:13 smithi133 ceph-mon[125939]: pgmap v7765: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 119 KiB/s wr, 26 op/s 2023-05-08T07:45:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14452.891511 secs 2023-05-08T07:45:14.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:13 smithi096 ceph-mon[124666]: pgmap v7765: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 119 KiB/s wr, 26 op/s 2023-05-08T07:45:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14452.891511 secs 2023-05-08T07:45:15.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14453.449154 secs 2023-05-08T07:45:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:15 smithi186 ceph-mon[126480]: pgmap v7766: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 124 KiB/s wr, 9 op/s 2023-05-08T07:45:15.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14453.449154 secs 2023-05-08T07:45:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:15 smithi133 ceph-mon[125939]: pgmap v7766: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 124 KiB/s wr, 9 op/s 2023-05-08T07:45:16.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14453.449154 secs 2023-05-08T07:45:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:15 smithi096 ceph-mon[124666]: pgmap v7766: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 124 KiB/s wr, 9 op/s 2023-05-08T07:45:16.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14454.732105 secs 2023-05-08T07:45:16.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14454.732105 secs 2023-05-08T07:45:17.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14454.732105 secs 2023-05-08T07:45:17.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:17 smithi186 ceph-mon[126480]: pgmap v7767: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 124 KiB/s wr, 9 op/s 2023-05-08T07:45:17.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:17 smithi133 ceph-mon[125939]: pgmap v7767: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 124 KiB/s wr, 9 op/s 2023-05-08T07:45:18.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:17 smithi096 ceph-mon[124666]: pgmap v7767: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 124 KiB/s wr, 9 op/s 2023-05-08T07:45:18.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14457.891621 secs 2023-05-08T07:45:18.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14457.891621 secs 2023-05-08T07:45:19.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14457.891621 secs 2023-05-08T07:45:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:19 smithi186 ceph-mon[126480]: pgmap v7768: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 124 KiB/s wr, 9 op/s 2023-05-08T07:45:19.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:19 smithi133 ceph-mon[125939]: pgmap v7768: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 124 KiB/s wr, 9 op/s 2023-05-08T07:45:20.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:19 smithi096 ceph-mon[124666]: pgmap v7768: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 124 KiB/s wr, 9 op/s 2023-05-08T07:45:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14458.449274 secs 2023-05-08T07:45:20.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14458.449274 secs 2023-05-08T07:45:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14458.449274 secs 2023-05-08T07:45:21.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14459.732183 secs 2023-05-08T07:45:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:21 smithi186 ceph-mon[126480]: pgmap v7769: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 161 KiB/s wr, 9 op/s 2023-05-08T07:45:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:21 smithi186 ceph-mon[126480]: osdmap e563: 12 total, 12 up, 12 in 2023-05-08T07:45:21.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14459.732183 secs 2023-05-08T07:45:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:21 smithi133 ceph-mon[125939]: pgmap v7769: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 161 KiB/s wr, 9 op/s 2023-05-08T07:45:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:21 smithi133 ceph-mon[125939]: osdmap e563: 12 total, 12 up, 12 in 2023-05-08T07:45:22.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14459.732183 secs 2023-05-08T07:45:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:21 smithi096 ceph-mon[124666]: pgmap v7769: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 161 KiB/s wr, 9 op/s 2023-05-08T07:45:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:21 smithi096 ceph-mon[124666]: osdmap e563: 12 total, 12 up, 12 in 2023-05-08T07:45:23.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:23 smithi186 ceph-mon[126480]: pgmap v7771: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 160 KiB/s wr, 9 op/s 2023-05-08T07:45:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14462.891726 secs 2023-05-08T07:45:23.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:23 smithi133 ceph-mon[125939]: pgmap v7771: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 160 KiB/s wr, 9 op/s 2023-05-08T07:45:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14462.891726 secs 2023-05-08T07:45:24.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:23 smithi096 ceph-mon[124666]: pgmap v7771: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 160 KiB/s wr, 9 op/s 2023-05-08T07:45:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14462.891726 secs 2023-05-08T07:45:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14463.449398 secs 2023-05-08T07:45:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:25 smithi186 ceph-mon[126480]: pgmap v7772: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 155 KiB/s wr, 9 op/s 2023-05-08T07:45:25.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14463.449398 secs 2023-05-08T07:45:25.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:25 smithi133 ceph-mon[125939]: pgmap v7772: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 155 KiB/s wr, 9 op/s 2023-05-08T07:45:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14463.449398 secs 2023-05-08T07:45:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:25 smithi096 ceph-mon[124666]: pgmap v7772: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 155 KiB/s wr, 9 op/s 2023-05-08T07:45:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14464.732278 secs 2023-05-08T07:45:26.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14464.732278 secs 2023-05-08T07:45:27.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14464.732278 secs 2023-05-08T07:45:27.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:27 smithi186 ceph-mon[126480]: pgmap v7773: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 155 KiB/s wr, 9 op/s 2023-05-08T07:45:27.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:27 smithi133 ceph-mon[125939]: pgmap v7773: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 155 KiB/s wr, 9 op/s 2023-05-08T07:45:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:27 smithi096 ceph-mon[124666]: pgmap v7773: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 155 KiB/s wr, 9 op/s 2023-05-08T07:45:28.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14467.891848 secs 2023-05-08T07:45:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14467.891848 secs 2023-05-08T07:45:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14467.891848 secs 2023-05-08T07:45:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:29 smithi186 ceph-mon[126480]: pgmap v7774: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 155 KiB/s wr, 9 op/s 2023-05-08T07:45:29.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:29 smithi133 ceph-mon[125939]: pgmap v7774: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 155 KiB/s wr, 9 op/s 2023-05-08T07:45:30.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:29 smithi096 ceph-mon[124666]: pgmap v7774: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 155 KiB/s wr, 9 op/s 2023-05-08T07:45:30.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14468.449568 secs 2023-05-08T07:45:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14468.449568 secs 2023-05-08T07:45:31.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14468.449568 secs 2023-05-08T07:45:31.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14469.732406 secs 2023-05-08T07:45:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:31 smithi133 ceph-mon[125939]: pgmap v7775: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 98 KiB/s wr, 8 op/s 2023-05-08T07:45:32.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14469.732406 secs 2023-05-08T07:45:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:31 smithi096 ceph-mon[124666]: pgmap v7775: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 98 KiB/s wr, 8 op/s 2023-05-08T07:45:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14469.732406 secs 2023-05-08T07:45:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:31 smithi186 ceph-mon[126480]: pgmap v7775: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 98 KiB/s wr, 8 op/s 2023-05-08T07:45:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:33 smithi133 ceph-mon[125939]: pgmap v7776: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 90 KiB/s wr, 7 op/s 2023-05-08T07:45:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14472.891960 secs 2023-05-08T07:45:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:33 smithi096 ceph-mon[124666]: pgmap v7776: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 90 KiB/s wr, 7 op/s 2023-05-08T07:45:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14472.891960 secs 2023-05-08T07:45:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:33 smithi186 ceph-mon[126480]: pgmap v7776: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 90 KiB/s wr, 7 op/s 2023-05-08T07:45:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14472.891960 secs 2023-05-08T07:45:35.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14473.449702 secs 2023-05-08T07:45:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:35 smithi133 ceph-mon[125939]: pgmap v7777: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 126 KiB/s wr, 10 op/s 2023-05-08T07:45:36.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14473.449702 secs 2023-05-08T07:45:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:35 smithi096 ceph-mon[124666]: pgmap v7777: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 126 KiB/s wr, 10 op/s 2023-05-08T07:45:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14473.449702 secs 2023-05-08T07:45:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:35 smithi186 ceph-mon[126480]: pgmap v7777: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 126 KiB/s wr, 10 op/s 2023-05-08T07:45:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14474.732498 secs 2023-05-08T07:45:37.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14474.732498 secs 2023-05-08T07:45:37.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14474.732498 secs 2023-05-08T07:45:37.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:37 smithi133 ceph-mon[125939]: pgmap v7778: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 81 KiB/s wr, 6 op/s 2023-05-08T07:45:38.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:37 smithi096 ceph-mon[124666]: pgmap v7778: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 81 KiB/s wr, 6 op/s 2023-05-08T07:45:38.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:37 smithi186 ceph-mon[126480]: pgmap v7778: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 81 KiB/s wr, 6 op/s 2023-05-08T07:45:38.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14477.892068 secs 2023-05-08T07:45:39.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14477.892068 secs 2023-05-08T07:45:39.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14477.892068 secs 2023-05-08T07:45:39.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:39 smithi133 ceph-mon[125939]: pgmap v7779: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 81 KiB/s wr, 6 op/s 2023-05-08T07:45:40.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:39 smithi096 ceph-mon[124666]: pgmap v7779: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 81 KiB/s wr, 6 op/s 2023-05-08T07:45:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:39 smithi186 ceph-mon[126480]: pgmap v7779: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 81 KiB/s wr, 6 op/s 2023-05-08T07:45:40.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14478.449830 secs 2023-05-08T07:45:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14478.449830 secs 2023-05-08T07:45:41.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14478.449830 secs 2023-05-08T07:45:41.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14479.732636 secs 2023-05-08T07:45:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:41 smithi133 ceph-mon[125939]: pgmap v7780: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 82 KiB/s wr, 9 op/s 2023-05-08T07:45:42.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14479.732636 secs 2023-05-08T07:45:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:41 smithi096 ceph-mon[124666]: pgmap v7780: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 82 KiB/s wr, 9 op/s 2023-05-08T07:45:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14479.732636 secs 2023-05-08T07:45:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:41 smithi186 ceph-mon[126480]: pgmap v7780: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 82 KiB/s wr, 9 op/s 2023-05-08T07:45:43.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:43 smithi133 ceph-mon[125939]: pgmap v7781: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 45 KiB/s wr, 5 op/s 2023-05-08T07:45:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14482.892164 secs 2023-05-08T07:45:44.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:43 smithi096 ceph-mon[124666]: pgmap v7781: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 45 KiB/s wr, 5 op/s 2023-05-08T07:45:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14482.892164 secs 2023-05-08T07:45:44.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:43 smithi186 ceph-mon[126480]: pgmap v7781: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 45 KiB/s wr, 5 op/s 2023-05-08T07:45:44.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14482.892164 secs 2023-05-08T07:45:44.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:44 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:45:45.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:44 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:45:45.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:44 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:45:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14483.449979 secs 2023-05-08T07:45:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:45 smithi186 ceph-mon[126480]: pgmap v7782: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 92 KiB/s wr, 8 op/s 2023-05-08T07:45:45.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14483.449979 secs 2023-05-08T07:45:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:45 smithi133 ceph-mon[125939]: pgmap v7782: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 92 KiB/s wr, 8 op/s 2023-05-08T07:45:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14483.449979 secs 2023-05-08T07:45:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:45 smithi096 ceph-mon[124666]: pgmap v7782: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 92 KiB/s wr, 8 op/s 2023-05-08T07:45:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:47 smithi133 ceph-mon[125939]: pgmap v7783: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 48 KiB/s wr, 6 op/s 2023-05-08T07:45:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:45:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:47 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:45:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:47 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:45:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:47 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:45:47.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:47 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:45:47.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:47 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:45:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:47 smithi096 ceph-mon[124666]: pgmap v7783: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 48 KiB/s wr, 6 op/s 2023-05-08T07:45:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:45:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:47 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:45:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:47 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:45:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:47 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:45:48.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:47 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:45:48.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:47 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:45:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:47 smithi186 ceph-mon[126480]: pgmap v7783: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 48 KiB/s wr, 6 op/s 2023-05-08T07:45:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:45:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:47 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:45:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:47 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:45:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:47 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:45:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:47 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:45:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:47 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:45:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:48 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:45:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:48 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T07:45:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:48 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T07:45:48.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:48 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:45:48.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:48 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:45:48.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:45:48.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:45:48.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14487.892262 secs 2023-05-08T07:45:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:48 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:45:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:48 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T07:45:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:48 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T07:45:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:48 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:45:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:48 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:45:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:45:49.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:45:49.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14487.892262 secs 2023-05-08T07:45:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:48 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:45:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:48 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T07:45:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:48 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T07:45:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:48 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:45:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:48 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:45:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:45:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:45:49.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14487.892262 secs 2023-05-08T07:45:49.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:49 smithi133 ceph-mon[125939]: pgmap v7784: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 48 KiB/s wr, 6 op/s 2023-05-08T07:45:50.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:49 smithi096 ceph-mon[124666]: pgmap v7784: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 48 KiB/s wr, 6 op/s 2023-05-08T07:45:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:49 smithi186 ceph-mon[126480]: pgmap v7784: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 48 KiB/s wr, 6 op/s 2023-05-08T07:45:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:51 smithi133 ceph-mon[125939]: pgmap v7785: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 197 KiB/s wr, 10 op/s 2023-05-08T07:45:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:45:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:51 smithi096 ceph-mon[124666]: pgmap v7785: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 197 KiB/s wr, 10 op/s 2023-05-08T07:45:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:45:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:51 smithi186 ceph-mon[126480]: pgmap v7785: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 197 KiB/s wr, 10 op/s 2023-05-08T07:45:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:45:52.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:45:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:45:53.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:45:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:45:53.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:45:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:45:53.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:53 smithi133 ceph-mon[125939]: pgmap v7786: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 196 KiB/s wr, 7 op/s 2023-05-08T07:45:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14492.892384 secs 2023-05-08T07:45:54.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:53 smithi096 ceph-mon[124666]: pgmap v7786: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 196 KiB/s wr, 7 op/s 2023-05-08T07:45:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14492.892384 secs 2023-05-08T07:45:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:53 smithi186 ceph-mon[126480]: pgmap v7786: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 196 KiB/s wr, 7 op/s 2023-05-08T07:45:54.157 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14492.892384 secs 2023-05-08T07:45:55.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:55 smithi133 ceph-mon[125939]: pgmap v7787: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 327 KiB/s wr, 12 op/s 2023-05-08T07:45:56.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:55 smithi096 ceph-mon[124666]: pgmap v7787: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 327 KiB/s wr, 12 op/s 2023-05-08T07:45:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:55 smithi186 ceph-mon[126480]: pgmap v7787: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 327 KiB/s wr, 12 op/s 2023-05-08T07:45:56.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:56 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:45:57.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:56 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:45:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:56 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:45:57.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:57 smithi133 ceph-mon[125939]: pgmap v7788: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 280 KiB/s wr, 9 op/s 2023-05-08T07:45:58.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:57 smithi096 ceph-mon[124666]: pgmap v7788: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 280 KiB/s wr, 9 op/s 2023-05-08T07:45:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:57 smithi186 ceph-mon[126480]: pgmap v7788: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 280 KiB/s wr, 9 op/s 2023-05-08T07:45:58.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14497.892510 secs 2023-05-08T07:45:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14497.892510 secs 2023-05-08T07:45:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14497.892510 secs 2023-05-08T07:45:59.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:59 smithi133 ceph-mon[125939]: pgmap v7789: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 280 KiB/s wr, 9 op/s 2023-05-08T07:45:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:45:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14498.450324 secs 2023-05-08T07:46:00.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:59 smithi096 ceph-mon[124666]: pgmap v7789: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 280 KiB/s wr, 9 op/s 2023-05-08T07:46:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:45:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14498.450324 secs 2023-05-08T07:46:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:59 smithi186 ceph-mon[126480]: pgmap v7789: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 280 KiB/s wr, 9 op/s 2023-05-08T07:46:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:45:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14498.450324 secs 2023-05-08T07:46:00.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:46:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:46:01.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:46:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:46:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:46:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:46:01.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:01 smithi133 ceph-mon[125939]: pgmap v7790: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 341 KiB/s wr, 13 op/s 2023-05-08T07:46:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:01 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:46:02.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:01 smithi096 ceph-mon[124666]: pgmap v7790: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 341 KiB/s wr, 13 op/s 2023-05-08T07:46:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:01 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:46:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:01 smithi186 ceph-mon[126480]: pgmap v7790: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 341 KiB/s wr, 13 op/s 2023-05-08T07:46:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:01 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:46:03.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:03 smithi133 ceph-mon[125939]: pgmap v7791: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 192 KiB/s wr, 9 op/s 2023-05-08T07:46:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14502.892628 secs 2023-05-08T07:46:04.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:03 smithi096 ceph-mon[124666]: pgmap v7791: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 192 KiB/s wr, 9 op/s 2023-05-08T07:46:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14502.892628 secs 2023-05-08T07:46:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:03 smithi186 ceph-mon[126480]: pgmap v7791: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 192 KiB/s wr, 9 op/s 2023-05-08T07:46:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14502.892628 secs 2023-05-08T07:46:05.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14503.450386 secs 2023-05-08T07:46:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14503.450386 secs 2023-05-08T07:46:05.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14503.450386 secs 2023-05-08T07:46:06.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:05 smithi096 ceph-mon[124666]: pgmap v7792: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 402 KiB/s wr, 25 op/s 2023-05-08T07:46:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:05 smithi186 ceph-mon[126480]: pgmap v7792: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 402 KiB/s wr, 25 op/s 2023-05-08T07:46:06.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:05 smithi133 ceph-mon[125939]: pgmap v7792: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 402 KiB/s wr, 25 op/s 2023-05-08T07:46:08.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:07 smithi096 ceph-mon[124666]: pgmap v7793: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 271 KiB/s wr, 20 op/s 2023-05-08T07:46:08.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:07 smithi186 ceph-mon[126480]: pgmap v7793: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 271 KiB/s wr, 20 op/s 2023-05-08T07:46:08.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:07 smithi133 ceph-mon[125939]: pgmap v7793: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 271 KiB/s wr, 20 op/s 2023-05-08T07:46:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14507.892747 secs 2023-05-08T07:46:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14507.892747 secs 2023-05-08T07:46:09.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14507.892747 secs 2023-05-08T07:46:10.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:09 smithi096 ceph-mon[124666]: pgmap v7794: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 271 KiB/s wr, 20 op/s 2023-05-08T07:46:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:09 smithi186 ceph-mon[126480]: pgmap v7794: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 271 KiB/s wr, 20 op/s 2023-05-08T07:46:10.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:09 smithi133 ceph-mon[125939]: pgmap v7794: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 271 KiB/s wr, 20 op/s 2023-05-08T07:46:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:11 smithi186 ceph-mon[126480]: pgmap v7795: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 369 KiB/s wr, 25 op/s 2023-05-08T07:46:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:11 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:46:12.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:11 smithi133 ceph-mon[125939]: pgmap v7795: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 369 KiB/s wr, 25 op/s 2023-05-08T07:46:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:11 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:46:12.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:11 smithi096 ceph-mon[124666]: pgmap v7795: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 369 KiB/s wr, 25 op/s 2023-05-08T07:46:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:11 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:46:13.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:12 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:46:13.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:12 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:46:13.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:12 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:46:13.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:12 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:46:13.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:12 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:46:13.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:12 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:46:13.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:12 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:46:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:12 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:46:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:12 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:46:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:13 smithi186 ceph-mon[126480]: pgmap v7796: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 308 KiB/s wr, 21 op/s 2023-05-08T07:46:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14512.892873 secs 2023-05-08T07:46:14.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:13 smithi133 ceph-mon[125939]: pgmap v7796: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 308 KiB/s wr, 21 op/s 2023-05-08T07:46:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14512.892873 secs 2023-05-08T07:46:14.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:13 smithi096 ceph-mon[124666]: pgmap v7796: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 308 KiB/s wr, 21 op/s 2023-05-08T07:46:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14512.892873 secs 2023-05-08T07:46:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:15 smithi186 ceph-mon[126480]: pgmap v7797: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 339 KiB/s wr, 24 op/s 2023-05-08T07:46:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:15 smithi133 ceph-mon[125939]: pgmap v7797: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 339 KiB/s wr, 24 op/s 2023-05-08T07:46:16.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:15 smithi096 ceph-mon[124666]: pgmap v7797: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 339 KiB/s wr, 24 op/s 2023-05-08T07:46:18.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:17 smithi186 ceph-mon[126480]: pgmap v7798: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 129 KiB/s wr, 7 op/s 2023-05-08T07:46:18.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:17 smithi133 ceph-mon[125939]: pgmap v7798: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 129 KiB/s wr, 7 op/s 2023-05-08T07:46:18.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:17 smithi096 ceph-mon[124666]: pgmap v7798: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 129 KiB/s wr, 7 op/s 2023-05-08T07:46:19.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14517.893015 secs 2023-05-08T07:46:19.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14517.893015 secs 2023-05-08T07:46:19.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14517.893015 secs 2023-05-08T07:46:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:19 smithi186 ceph-mon[126480]: pgmap v7799: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 129 KiB/s wr, 7 op/s 2023-05-08T07:46:20.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:19 smithi133 ceph-mon[125939]: pgmap v7799: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 129 KiB/s wr, 7 op/s 2023-05-08T07:46:20.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:19 smithi096 ceph-mon[124666]: pgmap v7799: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 129 KiB/s wr, 7 op/s 2023-05-08T07:46:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:21 smithi186 ceph-mon[126480]: pgmap v7800: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 129 KiB/s wr, 10 op/s 2023-05-08T07:46:22.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:21 smithi133 ceph-mon[125939]: pgmap v7800: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 129 KiB/s wr, 10 op/s 2023-05-08T07:46:22.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:21 smithi096 ceph-mon[124666]: pgmap v7800: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 129 KiB/s wr, 10 op/s 2023-05-08T07:46:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:23 smithi186 ceph-mon[126480]: pgmap v7801: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 5 op/s 2023-05-08T07:46:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14522.893158 secs 2023-05-08T07:46:24.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:23 smithi133 ceph-mon[125939]: pgmap v7801: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 5 op/s 2023-05-08T07:46:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14522.893158 secs 2023-05-08T07:46:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:23 smithi096 ceph-mon[124666]: pgmap v7801: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 5 op/s 2023-05-08T07:46:24.259 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14522.893158 secs 2023-05-08T07:46:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14523.450911 secs 2023-05-08T07:46:25.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14523.450911 secs 2023-05-08T07:46:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14523.450911 secs 2023-05-08T07:46:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:25 smithi186 ceph-mon[126480]: pgmap v7802: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 190 KiB/s wr, 12 op/s 2023-05-08T07:46:26.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:25 smithi133 ceph-mon[125939]: pgmap v7802: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 190 KiB/s wr, 12 op/s 2023-05-08T07:46:26.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:25 smithi096 ceph-mon[124666]: pgmap v7802: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 190 KiB/s wr, 12 op/s 2023-05-08T07:46:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14524.733750 secs 2023-05-08T07:46:27.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14524.733750 secs 2023-05-08T07:46:27.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14524.733750 secs 2023-05-08T07:46:28.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:27 smithi186 ceph-mon[126480]: pgmap v7803: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 159 KiB/s wr, 9 op/s 2023-05-08T07:46:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:27 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:46:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:27 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:46:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:27 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:46:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:27 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:46:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:27 smithi133 ceph-mon[125939]: pgmap v7803: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 159 KiB/s wr, 9 op/s 2023-05-08T07:46:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:27 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:46:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:27 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:46:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:27 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:46:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:27 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:46:28.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:27 smithi096 ceph-mon[124666]: pgmap v7803: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 159 KiB/s wr, 9 op/s 2023-05-08T07:46:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:27 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:46:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:27 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:46:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:27 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:46:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:27 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:46:29.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14527.893258 secs 2023-05-08T07:46:29.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14527.893258 secs 2023-05-08T07:46:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14527.893258 secs 2023-05-08T07:46:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:29 smithi186 ceph-mon[126480]: pgmap v7804: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 159 KiB/s wr, 9 op/s 2023-05-08T07:46:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14528.451032 secs 2023-05-08T07:46:30.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:29 smithi133 ceph-mon[125939]: pgmap v7804: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 159 KiB/s wr, 9 op/s 2023-05-08T07:46:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14528.451032 secs 2023-05-08T07:46:30.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:29 smithi096 ceph-mon[124666]: pgmap v7804: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 159 KiB/s wr, 9 op/s 2023-05-08T07:46:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14528.451032 secs 2023-05-08T07:46:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14529.733856 secs 2023-05-08T07:46:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:31 smithi186 ceph-mon[126480]: pgmap v7805: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 315 KiB/s wr, 14 op/s 2023-05-08T07:46:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:31 smithi186 ceph-mon[126480]: osdmap e564: 12 total, 12 up, 12 in 2023-05-08T07:46:32.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14529.733856 secs 2023-05-08T07:46:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:31 smithi133 ceph-mon[125939]: pgmap v7805: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 315 KiB/s wr, 14 op/s 2023-05-08T07:46:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:31 smithi133 ceph-mon[125939]: osdmap e564: 12 total, 12 up, 12 in 2023-05-08T07:46:32.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14529.733856 secs 2023-05-08T07:46:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:31 smithi096 ceph-mon[124666]: pgmap v7805: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 315 KiB/s wr, 14 op/s 2023-05-08T07:46:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:31 smithi096 ceph-mon[124666]: osdmap e564: 12 total, 12 up, 12 in 2023-05-08T07:46:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:33 smithi186 ceph-mon[126480]: pgmap v7807: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 355 KiB/s rd, 378 KiB/s wr, 14 op/s 2023-05-08T07:46:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14532.893377 secs 2023-05-08T07:46:34.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:33 smithi133 ceph-mon[125939]: pgmap v7807: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 355 KiB/s rd, 378 KiB/s wr, 14 op/s 2023-05-08T07:46:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14532.893377 secs 2023-05-08T07:46:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:33 smithi096 ceph-mon[124666]: pgmap v7807: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 355 KiB/s rd, 378 KiB/s wr, 14 op/s 2023-05-08T07:46:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14532.893377 secs 2023-05-08T07:46:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14533.451156 secs 2023-05-08T07:46:35.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14533.451156 secs 2023-05-08T07:46:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14533.451156 secs 2023-05-08T07:46:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:35 smithi186 ceph-mon[126480]: pgmap v7808: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 190 KiB/s wr, 11 op/s 2023-05-08T07:46:36.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:35 smithi133 ceph-mon[125939]: pgmap v7808: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 190 KiB/s wr, 11 op/s 2023-05-08T07:46:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:35 smithi096 ceph-mon[124666]: pgmap v7808: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 190 KiB/s wr, 11 op/s 2023-05-08T07:46:37.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14534.733996 secs 2023-05-08T07:46:37.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14534.733996 secs 2023-05-08T07:46:37.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14534.733996 secs 2023-05-08T07:46:38.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:37 smithi186 ceph-mon[126480]: pgmap v7809: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 190 KiB/s wr, 11 op/s 2023-05-08T07:46:38.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:37 smithi133 ceph-mon[125939]: pgmap v7809: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 190 KiB/s wr, 11 op/s 2023-05-08T07:46:38.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:37 smithi096 ceph-mon[124666]: pgmap v7809: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 190 KiB/s wr, 11 op/s 2023-05-08T07:46:39.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14537.893503 secs 2023-05-08T07:46:39.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14537.893503 secs 2023-05-08T07:46:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14537.893503 secs 2023-05-08T07:46:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:39 smithi186 ceph-mon[126480]: pgmap v7810: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 190 KiB/s wr, 11 op/s 2023-05-08T07:46:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14538.451301 secs 2023-05-08T07:46:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:39 smithi133 ceph-mon[125939]: pgmap v7810: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 190 KiB/s wr, 11 op/s 2023-05-08T07:46:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14538.451301 secs 2023-05-08T07:46:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:39 smithi096 ceph-mon[124666]: pgmap v7810: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 190 KiB/s wr, 11 op/s 2023-05-08T07:46:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14538.451301 secs 2023-05-08T07:46:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:41 smithi186 ceph-mon[126480]: pgmap v7811: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 117 KiB/s wr, 9 op/s 2023-05-08T07:46:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:41 smithi186 ceph-mon[126480]: osdmap e565: 12 total, 12 up, 12 in 2023-05-08T07:46:42.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:41 smithi133 ceph-mon[125939]: pgmap v7811: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 117 KiB/s wr, 9 op/s 2023-05-08T07:46:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:41 smithi133 ceph-mon[125939]: osdmap e565: 12 total, 12 up, 12 in 2023-05-08T07:46:42.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:41 smithi096 ceph-mon[124666]: pgmap v7811: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 117 KiB/s wr, 9 op/s 2023-05-08T07:46:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:41 smithi096 ceph-mon[124666]: osdmap e565: 12 total, 12 up, 12 in 2023-05-08T07:46:43.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:46:43.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:46:43.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:46:44.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:43 smithi186 ceph-mon[126480]: pgmap v7813: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 117 KiB/s wr, 9 op/s 2023-05-08T07:46:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:43 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:46:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:46:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:46:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14542.893620 secs 2023-05-08T07:46:44.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:43 smithi133 ceph-mon[125939]: pgmap v7813: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 117 KiB/s wr, 9 op/s 2023-05-08T07:46:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:43 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:46:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:46:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:46:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14542.893620 secs 2023-05-08T07:46:44.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:43 smithi096 ceph-mon[124666]: pgmap v7813: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 117 KiB/s wr, 9 op/s 2023-05-08T07:46:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:43 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:46:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:46:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:46:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14542.893620 secs 2023-05-08T07:46:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:45 smithi186 ceph-mon[126480]: pgmap v7814: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 139 KiB/s wr, 9 op/s 2023-05-08T07:46:46.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:45 smithi133 ceph-mon[125939]: pgmap v7814: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 139 KiB/s wr, 9 op/s 2023-05-08T07:46:46.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:45 smithi096 ceph-mon[124666]: pgmap v7814: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 139 KiB/s wr, 9 op/s 2023-05-08T07:46:47.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:47 smithi096 ceph-mon[124666]: pgmap v7815: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 139 KiB/s wr, 9 op/s 2023-05-08T07:46:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:46:47.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:47 smithi186 ceph-mon[126480]: pgmap v7815: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 139 KiB/s wr, 9 op/s 2023-05-08T07:46:47.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:46:47.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:47 smithi133 ceph-mon[125939]: pgmap v7815: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 139 KiB/s wr, 9 op/s 2023-05-08T07:46:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:46:48.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:46:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:46:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:48 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:46:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14547.893706 secs 2023-05-08T07:46:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:48 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:46:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:48 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:46:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:48 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:46:48.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:46:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:46:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:48 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:46:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14547.893706 secs 2023-05-08T07:46:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:48 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:46:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:48 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:46:48.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:48 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:46:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:46:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:46:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:48 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:46:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14547.893706 secs 2023-05-08T07:46:49.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:48 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:46:49.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:48 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:46:49.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:48 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:46:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:49 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:46:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:49 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T07:46:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:49 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T07:46:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:49 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:46:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:49 smithi186 ceph-mon[126480]: pgmap v7816: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 139 KiB/s wr, 9 op/s 2023-05-08T07:46:49.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:49 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:46:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:49 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T07:46:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:49 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T07:46:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:49 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:46:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:49 smithi133 ceph-mon[125939]: pgmap v7816: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 139 KiB/s wr, 9 op/s 2023-05-08T07:46:50.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:49 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:46:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:49 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T07:46:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:49 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T07:46:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:49 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:46:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:49 smithi096 ceph-mon[124666]: pgmap v7816: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 139 KiB/s wr, 9 op/s 2023-05-08T07:46:51.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:51 smithi186 ceph-mon[126480]: pgmap v7817: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 296 KiB/s wr, 11 op/s 2023-05-08T07:46:51.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:51 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:46:51.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:51 smithi133 ceph-mon[125939]: pgmap v7817: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 296 KiB/s wr, 11 op/s 2023-05-08T07:46:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:51 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:46:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:51 smithi096 ceph-mon[124666]: pgmap v7817: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 296 KiB/s wr, 11 op/s 2023-05-08T07:46:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:51 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:46:53.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:53 smithi186 ceph-mon[126480]: pgmap v7818: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 272 KiB/s wr, 10 op/s 2023-05-08T07:46:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14552.893828 secs 2023-05-08T07:46:53.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:53 smithi133 ceph-mon[125939]: pgmap v7818: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 272 KiB/s wr, 10 op/s 2023-05-08T07:46:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14552.893828 secs 2023-05-08T07:46:54.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:53 smithi096 ceph-mon[124666]: pgmap v7818: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 272 KiB/s wr, 10 op/s 2023-05-08T07:46:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14552.893828 secs 2023-05-08T07:46:55.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14553.451611 secs 2023-05-08T07:46:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:55 smithi186 ceph-mon[126480]: pgmap v7819: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 351 KiB/s wr, 14 op/s 2023-05-08T07:46:55.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14553.451611 secs 2023-05-08T07:46:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:55 smithi133 ceph-mon[125939]: pgmap v7819: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 351 KiB/s wr, 14 op/s 2023-05-08T07:46:56.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14553.451611 secs 2023-05-08T07:46:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:55 smithi096 ceph-mon[124666]: pgmap v7819: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 351 KiB/s wr, 14 op/s 2023-05-08T07:46:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:46:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:46:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:56 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:46:56.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:46:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:46:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:56 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:46:57.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:46:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:46:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:56 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:46:57.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:57 smithi186 ceph-mon[126480]: pgmap v7820: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 332 KiB/s wr, 10 op/s 2023-05-08T07:46:57.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:57 smithi133 ceph-mon[125939]: pgmap v7820: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 332 KiB/s wr, 10 op/s 2023-05-08T07:46:58.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:57 smithi096 ceph-mon[124666]: pgmap v7820: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 332 KiB/s wr, 10 op/s 2023-05-08T07:46:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14557.893922 secs 2023-05-08T07:46:58.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14557.893922 secs 2023-05-08T07:46:59.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14557.893922 secs 2023-05-08T07:46:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:59 smithi186 ceph-mon[126480]: pgmap v7821: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 331 KiB/s wr, 10 op/s 2023-05-08T07:46:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:46:59 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:46:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:59 smithi133 ceph-mon[125939]: pgmap v7821: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 331 KiB/s wr, 10 op/s 2023-05-08T07:46:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:46:59 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:47:00.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:59 smithi096 ceph-mon[124666]: pgmap v7821: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 331 KiB/s wr, 10 op/s 2023-05-08T07:47:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:46:59 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:47:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:47:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:47:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:47:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:47:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:47:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:47:01.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14559.734571 secs 2023-05-08T07:47:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:01 smithi186 ceph-mon[126480]: pgmap v7822: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 545 KiB/s wr, 14 op/s 2023-05-08T07:47:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:01 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:47:01.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14559.734571 secs 2023-05-08T07:47:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:01 smithi133 ceph-mon[125939]: pgmap v7822: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 545 KiB/s wr, 14 op/s 2023-05-08T07:47:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:01 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:47:02.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14559.734571 secs 2023-05-08T07:47:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:01 smithi096 ceph-mon[124666]: pgmap v7822: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 545 KiB/s wr, 14 op/s 2023-05-08T07:47:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:01 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:47:03.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:03 smithi186 ceph-mon[126480]: pgmap v7823: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 317 KiB/s wr, 9 op/s 2023-05-08T07:47:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14562.894059 secs 2023-05-08T07:47:03.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:03 smithi133 ceph-mon[125939]: pgmap v7823: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 317 KiB/s wr, 9 op/s 2023-05-08T07:47:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14562.894059 secs 2023-05-08T07:47:04.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:03 smithi096 ceph-mon[124666]: pgmap v7823: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 317 KiB/s wr, 9 op/s 2023-05-08T07:47:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14562.894059 secs 2023-05-08T07:47:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:04 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:47:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:04 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:47:04.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:04 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:47:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:04 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:47:05.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:04 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:47:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:04 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:47:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14563.451812 secs 2023-05-08T07:47:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:05 smithi186 ceph-mon[126480]: pgmap v7824: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 363 KiB/s wr, 27 op/s 2023-05-08T07:47:05.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14563.451812 secs 2023-05-08T07:47:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:05 smithi133 ceph-mon[125939]: pgmap v7824: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 363 KiB/s wr, 27 op/s 2023-05-08T07:47:06.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14563.451812 secs 2023-05-08T07:47:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:05 smithi096 ceph-mon[124666]: pgmap v7824: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 363 KiB/s wr, 27 op/s 2023-05-08T07:47:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14564.734739 secs 2023-05-08T07:47:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:06 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:47:06.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14564.734739 secs 2023-05-08T07:47:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:06 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:47:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14564.734739 secs 2023-05-08T07:47:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:06 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:47:07.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:07 smithi186 ceph-mon[126480]: pgmap v7825: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 259 KiB/s wr, 22 op/s 2023-05-08T07:47:07.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:07 smithi133 ceph-mon[125939]: pgmap v7825: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 259 KiB/s wr, 22 op/s 2023-05-08T07:47:08.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:07 smithi096 ceph-mon[124666]: pgmap v7825: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 259 KiB/s wr, 22 op/s 2023-05-08T07:47:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:47:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:47:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14567.894194 secs 2023-05-08T07:47:08.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:47:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:47:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14567.894194 secs 2023-05-08T07:47:09.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:47:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:47:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14567.894194 secs 2023-05-08T07:47:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:09 smithi186 ceph-mon[126480]: pgmap v7826: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 259 KiB/s wr, 22 op/s 2023-05-08T07:47:09.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:09 smithi133 ceph-mon[125939]: pgmap v7826: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 259 KiB/s wr, 22 op/s 2023-05-08T07:47:10.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:09 smithi096 ceph-mon[124666]: pgmap v7826: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 259 KiB/s wr, 22 op/s 2023-05-08T07:47:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14568.451915 secs 2023-05-08T07:47:10.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14568.451915 secs 2023-05-08T07:47:11.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14568.451915 secs 2023-05-08T07:47:11.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14569.734858 secs 2023-05-08T07:47:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:11 smithi186 ceph-mon[126480]: pgmap v7827: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 350 KiB/s wr, 26 op/s 2023-05-08T07:47:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:11 smithi186 ceph-mon[126480]: osdmap e566: 12 total, 12 up, 12 in 2023-05-08T07:47:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:11 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:47:11.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14569.734858 secs 2023-05-08T07:47:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:11 smithi133 ceph-mon[125939]: pgmap v7827: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 350 KiB/s wr, 26 op/s 2023-05-08T07:47:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:11 smithi133 ceph-mon[125939]: osdmap e566: 12 total, 12 up, 12 in 2023-05-08T07:47:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:11 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:47:12.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14569.734858 secs 2023-05-08T07:47:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:11 smithi096 ceph-mon[124666]: pgmap v7827: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 350 KiB/s wr, 26 op/s 2023-05-08T07:47:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:11 smithi096 ceph-mon[124666]: osdmap e566: 12 total, 12 up, 12 in 2023-05-08T07:47:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:11 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:47:13.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:13 smithi186 ceph-mon[126480]: pgmap v7829: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 164 KiB/s wr, 26 op/s 2023-05-08T07:47:13.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14572.894261 secs 2023-05-08T07:47:13.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:13 smithi133 ceph-mon[125939]: pgmap v7829: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 164 KiB/s wr, 26 op/s 2023-05-08T07:47:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14572.894261 secs 2023-05-08T07:47:14.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:13 smithi096 ceph-mon[124666]: pgmap v7829: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 164 KiB/s wr, 26 op/s 2023-05-08T07:47:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14572.894261 secs 2023-05-08T07:47:15.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14573.452065 secs 2023-05-08T07:47:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:15 smithi186 ceph-mon[126480]: pgmap v7830: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 169 KiB/s wr, 9 op/s 2023-05-08T07:47:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14573.452065 secs 2023-05-08T07:47:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:15 smithi133 ceph-mon[125939]: pgmap v7830: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 169 KiB/s wr, 9 op/s 2023-05-08T07:47:16.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14573.452065 secs 2023-05-08T07:47:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:15 smithi096 ceph-mon[124666]: pgmap v7830: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 169 KiB/s wr, 9 op/s 2023-05-08T07:47:16.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14574.734942 secs 2023-05-08T07:47:16.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14574.734942 secs 2023-05-08T07:47:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14574.734942 secs 2023-05-08T07:47:17.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:17 smithi186 ceph-mon[126480]: pgmap v7831: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 169 KiB/s wr, 9 op/s 2023-05-08T07:47:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:17 smithi133 ceph-mon[125939]: pgmap v7831: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 169 KiB/s wr, 9 op/s 2023-05-08T07:47:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:17 smithi096 ceph-mon[124666]: pgmap v7831: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 169 KiB/s wr, 9 op/s 2023-05-08T07:47:18.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14577.894412 secs 2023-05-08T07:47:18.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14577.894412 secs 2023-05-08T07:47:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14577.894412 secs 2023-05-08T07:47:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:19 smithi186 ceph-mon[126480]: pgmap v7832: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 169 KiB/s wr, 9 op/s 2023-05-08T07:47:19.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:19 smithi133 ceph-mon[125939]: pgmap v7832: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 169 KiB/s wr, 9 op/s 2023-05-08T07:47:20.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:19 smithi096 ceph-mon[124666]: pgmap v7832: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 169 KiB/s wr, 9 op/s 2023-05-08T07:47:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14578.452210 secs 2023-05-08T07:47:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14578.452210 secs 2023-05-08T07:47:21.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14578.452210 secs 2023-05-08T07:47:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14579.735056 secs 2023-05-08T07:47:21.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:21 smithi133 ceph-mon[125939]: pgmap v7833: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 91 KiB/s wr, 9 op/s 2023-05-08T07:47:21.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:21 smithi133 ceph-mon[125939]: osdmap e567: 12 total, 12 up, 12 in 2023-05-08T07:47:22.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14579.735056 secs 2023-05-08T07:47:22.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:21 smithi096 ceph-mon[124666]: pgmap v7833: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 91 KiB/s wr, 9 op/s 2023-05-08T07:47:22.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:21 smithi096 ceph-mon[124666]: osdmap e567: 12 total, 12 up, 12 in 2023-05-08T07:47:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14579.735056 secs 2023-05-08T07:47:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:21 smithi186 ceph-mon[126480]: pgmap v7833: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 91 KiB/s wr, 9 op/s 2023-05-08T07:47:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:21 smithi186 ceph-mon[126480]: osdmap e567: 12 total, 12 up, 12 in 2023-05-08T07:47:23.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:23 smithi133 ceph-mon[125939]: pgmap v7835: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 91 KiB/s wr, 8 op/s 2023-05-08T07:47:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14582.894545 secs 2023-05-08T07:47:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:23 smithi096 ceph-mon[124666]: pgmap v7835: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 91 KiB/s wr, 8 op/s 2023-05-08T07:47:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14582.894545 secs 2023-05-08T07:47:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:23 smithi186 ceph-mon[126480]: pgmap v7835: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 91 KiB/s wr, 8 op/s 2023-05-08T07:47:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14582.894545 secs 2023-05-08T07:47:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14583.452339 secs 2023-05-08T07:47:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:25 smithi133 ceph-mon[125939]: pgmap v7836: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 86 KiB/s wr, 8 op/s 2023-05-08T07:47:26.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14583.452339 secs 2023-05-08T07:47:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:25 smithi096 ceph-mon[124666]: pgmap v7836: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 86 KiB/s wr, 8 op/s 2023-05-08T07:47:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14583.452339 secs 2023-05-08T07:47:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:25 smithi186 ceph-mon[126480]: pgmap v7836: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 86 KiB/s wr, 8 op/s 2023-05-08T07:47:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14584.735184 secs 2023-05-08T07:47:27.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14584.735184 secs 2023-05-08T07:47:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14584.735184 secs 2023-05-08T07:47:27.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:27 smithi133 ceph-mon[125939]: pgmap v7837: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 86 KiB/s wr, 8 op/s 2023-05-08T07:47:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:27 smithi096 ceph-mon[124666]: pgmap v7837: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 86 KiB/s wr, 8 op/s 2023-05-08T07:47:28.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:27 smithi186 ceph-mon[126480]: pgmap v7837: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 86 KiB/s wr, 8 op/s 2023-05-08T07:47:28.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14587.894620 secs 2023-05-08T07:47:29.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14587.894620 secs 2023-05-08T07:47:29.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14587.894620 secs 2023-05-08T07:47:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:29 smithi133 ceph-mon[125939]: pgmap v7838: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 86 KiB/s wr, 8 op/s 2023-05-08T07:47:30.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:29 smithi096 ceph-mon[124666]: pgmap v7838: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 86 KiB/s wr, 8 op/s 2023-05-08T07:47:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:29 smithi186 ceph-mon[126480]: pgmap v7838: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 86 KiB/s wr, 8 op/s 2023-05-08T07:47:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14588.452431 secs 2023-05-08T07:47:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14588.452431 secs 2023-05-08T07:47:31.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14588.452431 secs 2023-05-08T07:47:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14589.735318 secs 2023-05-08T07:47:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:31 smithi133 ceph-mon[125939]: pgmap v7839: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 55 KiB/s wr, 8 op/s 2023-05-08T07:47:32.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14589.735318 secs 2023-05-08T07:47:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:31 smithi096 ceph-mon[124666]: pgmap v7839: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 55 KiB/s wr, 8 op/s 2023-05-08T07:47:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14589.735318 secs 2023-05-08T07:47:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:31 smithi186 ceph-mon[126480]: pgmap v7839: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 55 KiB/s wr, 8 op/s 2023-05-08T07:47:33.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:33 smithi133 ceph-mon[125939]: pgmap v7840: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 51 KiB/s wr, 7 op/s 2023-05-08T07:47:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14592.894743 secs 2023-05-08T07:47:34.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:33 smithi096 ceph-mon[124666]: pgmap v7840: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 51 KiB/s wr, 7 op/s 2023-05-08T07:47:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14592.894743 secs 2023-05-08T07:47:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:33 smithi186 ceph-mon[126480]: pgmap v7840: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 51 KiB/s wr, 7 op/s 2023-05-08T07:47:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14592.894743 secs 2023-05-08T07:47:35.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14593.452542 secs 2023-05-08T07:47:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:35 smithi133 ceph-mon[125939]: pgmap v7841: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 92 KiB/s wr, 9 op/s 2023-05-08T07:47:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14593.452542 secs 2023-05-08T07:47:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:35 smithi096 ceph-mon[124666]: pgmap v7841: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 92 KiB/s wr, 9 op/s 2023-05-08T07:47:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14593.452542 secs 2023-05-08T07:47:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:35 smithi186 ceph-mon[126480]: pgmap v7841: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 92 KiB/s wr, 9 op/s 2023-05-08T07:47:36.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14594.735404 secs 2023-05-08T07:47:37.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14594.735404 secs 2023-05-08T07:47:37.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14594.735404 secs 2023-05-08T07:47:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:37 smithi133 ceph-mon[125939]: pgmap v7842: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 46 KiB/s wr, 6 op/s 2023-05-08T07:47:38.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:37 smithi096 ceph-mon[124666]: pgmap v7842: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 46 KiB/s wr, 6 op/s 2023-05-08T07:47:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:37 smithi186 ceph-mon[126480]: pgmap v7842: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 46 KiB/s wr, 6 op/s 2023-05-08T07:47:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14597.894860 secs 2023-05-08T07:47:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14597.894860 secs 2023-05-08T07:47:39.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14597.894860 secs 2023-05-08T07:47:39.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:39 smithi133 ceph-mon[125939]: pgmap v7843: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 46 KiB/s wr, 6 op/s 2023-05-08T07:47:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:39 smithi096 ceph-mon[124666]: pgmap v7843: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 46 KiB/s wr, 6 op/s 2023-05-08T07:47:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:39 smithi186 ceph-mon[126480]: pgmap v7843: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 46 KiB/s wr, 6 op/s 2023-05-08T07:47:40.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14598.452659 secs 2023-05-08T07:47:41.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14598.452659 secs 2023-05-08T07:47:41.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14598.452659 secs 2023-05-08T07:47:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14599.735541 secs 2023-05-08T07:47:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:41 smithi133 ceph-mon[125939]: pgmap v7844: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 53 KiB/s wr, 10 op/s 2023-05-08T07:47:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14599.735541 secs 2023-05-08T07:47:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:41 smithi096 ceph-mon[124666]: pgmap v7844: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 53 KiB/s wr, 10 op/s 2023-05-08T07:47:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14599.735541 secs 2023-05-08T07:47:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:41 smithi186 ceph-mon[126480]: pgmap v7844: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 53 KiB/s wr, 10 op/s 2023-05-08T07:47:43.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:43 smithi133 ceph-mon[125939]: pgmap v7845: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 53 KiB/s wr, 6 op/s 2023-05-08T07:47:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14602.894945 secs 2023-05-08T07:47:44.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:43 smithi096 ceph-mon[124666]: pgmap v7845: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 53 KiB/s wr, 6 op/s 2023-05-08T07:47:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14602.894945 secs 2023-05-08T07:47:44.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:43 smithi186 ceph-mon[126480]: pgmap v7845: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 53 KiB/s wr, 6 op/s 2023-05-08T07:47:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14602.894945 secs 2023-05-08T07:47:44.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14603.452773 secs 2023-05-08T07:47:45.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14603.452773 secs 2023-05-08T07:47:45.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14603.452773 secs 2023-05-08T07:47:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:45 smithi133 ceph-mon[125939]: pgmap v7846: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 154 KiB/s wr, 10 op/s 2023-05-08T07:47:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:45 smithi096 ceph-mon[124666]: pgmap v7846: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 154 KiB/s wr, 10 op/s 2023-05-08T07:47:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:45 smithi186 ceph-mon[126480]: pgmap v7846: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 154 KiB/s wr, 10 op/s 2023-05-08T07:47:46.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14604.735652 secs 2023-05-08T07:47:47.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14604.735652 secs 2023-05-08T07:47:47.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14604.735652 secs 2023-05-08T07:47:47.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:47 smithi133 ceph-mon[125939]: pgmap v7847: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 109 KiB/s wr, 7 op/s 2023-05-08T07:47:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:47 smithi096 ceph-mon[124666]: pgmap v7847: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 109 KiB/s wr, 7 op/s 2023-05-08T07:47:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:47 smithi186 ceph-mon[126480]: pgmap v7847: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 109 KiB/s wr, 7 op/s 2023-05-08T07:47:48.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14607.895064 secs 2023-05-08T07:47:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:48 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:47:49.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14607.895064 secs 2023-05-08T07:47:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:48 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:47:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14607.895064 secs 2023-05-08T07:47:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:48 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:47:49.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:49 smithi133 ceph-mon[125939]: pgmap v7848: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 109 KiB/s wr, 7 op/s 2023-05-08T07:47:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:49 smithi096 ceph-mon[124666]: pgmap v7848: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 109 KiB/s wr, 7 op/s 2023-05-08T07:47:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:49 smithi186 ceph-mon[126480]: pgmap v7848: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 109 KiB/s wr, 7 op/s 2023-05-08T07:47:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:51 smithi133 ceph-mon[125939]: pgmap v7849: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 201 KiB/s wr, 11 op/s 2023-05-08T07:47:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:47:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:47:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:51 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:47:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:51 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:47:51.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:51 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:47:51.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:51 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:47:51.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:51 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:47:51.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:51 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:47:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:51 smithi096 ceph-mon[124666]: pgmap v7849: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 201 KiB/s wr, 11 op/s 2023-05-08T07:47:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:47:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:47:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:51 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:47:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:51 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:47:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:51 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:47:52.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:51 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:47:52.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:51 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:47:52.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:51 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:47:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:51 smithi186 ceph-mon[126480]: pgmap v7849: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 201 KiB/s wr, 11 op/s 2023-05-08T07:47:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:47:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:47:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:51 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:47:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:51 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:47:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:51 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:47:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:51 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:47:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:51 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:47:52.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:51 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:47:52.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:52 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:47:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:47:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:47:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:47:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:47:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:47:52.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:47:52.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:47:52.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:47:52.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:47:52.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:47:52.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:47:52.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:47:52.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:47:52.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:47:52.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:47:52.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:47:52.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:47:52.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:47:52.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:47:52.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:47:52.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:47:52.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:47:52.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:47:52.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:47:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:52 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:47:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:47:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:47:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:47:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:47:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:47:53.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:47:53.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:47:53.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:47:53.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:47:53.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:47:53.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:47:53.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:47:53.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:47:53.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:47:53.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:47:53.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:47:53.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:47:53.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:47:53.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:47:53.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:47:53.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:47:53.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:47:53.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:47:53.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:47:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:52 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:47:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:47:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:47:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:47:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:47:53.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:47:53.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:47:53.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:47:53.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:47:53.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:47:53.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:47:53.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:47:53.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:47:53.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:47:53.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:47:53.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:47:53.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:47:53.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:47:53.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:47:53.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:47:53.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:47:53.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:47:53.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:47:53.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:47:53.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:47:53.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:53 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T07:47:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:53 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T07:47:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:53 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T07:47:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:53 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T07:47:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:53 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi096 to 123.0M 2023-05-08T07:47:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:53 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi096 to 128994218: error parsing value: Value '128994218' is below minimum 939524096 2023-05-08T07:47:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:53 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:47:53.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:53 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T07:47:53.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:53 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T07:47:53.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:53 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:47:53.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:53 smithi133 ceph-mon[125939]: pgmap v7850: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 194 KiB/s wr, 7 op/s 2023-05-08T07:47:53.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14612.895202 secs 2023-05-08T07:47:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:53 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T07:47:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:53 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T07:47:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:53 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T07:47:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:53 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T07:47:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:53 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi096 to 123.0M 2023-05-08T07:47:54.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:53 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi096 to 128994218: error parsing value: Value '128994218' is below minimum 939524096 2023-05-08T07:47:54.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:53 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:47:54.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:53 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T07:47:54.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:53 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T07:47:54.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:53 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:47:54.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:53 smithi096 ceph-mon[124666]: pgmap v7850: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 194 KiB/s wr, 7 op/s 2023-05-08T07:47:54.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14612.895202 secs 2023-05-08T07:47:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:53 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T07:47:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:53 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T07:47:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:53 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T07:47:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:53 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T07:47:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:53 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi096 to 123.0M 2023-05-08T07:47:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:53 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi096 to 128994218: error parsing value: Value '128994218' is below minimum 939524096 2023-05-08T07:47:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:53 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:47:54.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:53 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T07:47:54.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:53 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T07:47:54.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:53 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:47:54.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:53 smithi186 ceph-mon[126480]: pgmap v7850: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 194 KiB/s wr, 7 op/s 2023-05-08T07:47:54.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14612.895202 secs 2023-05-08T07:47:55.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:55 smithi133 ceph-mon[125939]: pgmap v7851: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 326 KiB/s wr, 13 op/s 2023-05-08T07:47:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:55 smithi096 ceph-mon[124666]: pgmap v7851: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 326 KiB/s wr, 13 op/s 2023-05-08T07:47:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:55 smithi186 ceph-mon[126480]: pgmap v7851: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 326 KiB/s wr, 13 op/s 2023-05-08T07:47:57.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:57 smithi133 ceph-mon[125939]: pgmap v7852: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 225 KiB/s wr, 9 op/s 2023-05-08T07:47:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:57 smithi096 ceph-mon[124666]: pgmap v7852: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 225 KiB/s wr, 9 op/s 2023-05-08T07:47:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:57 smithi186 ceph-mon[126480]: pgmap v7852: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 225 KiB/s wr, 9 op/s 2023-05-08T07:47:58.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14617.895318 secs 2023-05-08T07:47:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14617.895318 secs 2023-05-08T07:47:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14617.895318 secs 2023-05-08T07:48:00.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:59 smithi096 ceph-mon[124666]: pgmap v7853: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 225 KiB/s wr, 9 op/s 2023-05-08T07:48:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:47:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14618.453051 secs 2023-05-08T07:48:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:59 smithi186 ceph-mon[126480]: pgmap v7853: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 225 KiB/s wr, 9 op/s 2023-05-08T07:48:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:47:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14618.453051 secs 2023-05-08T07:48:00.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:59 smithi133 ceph-mon[125939]: pgmap v7853: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 225 KiB/s wr, 9 op/s 2023-05-08T07:48:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:47:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14618.453051 secs 2023-05-08T07:48:01.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:00 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:48:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:48:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:48:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:00 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:48:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:48:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:48:01.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:00 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:48:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:48:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:48:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:01 smithi096 ceph-mon[124666]: pgmap v7854: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 346 KiB/s wr, 14 op/s 2023-05-08T07:48:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:01 smithi186 ceph-mon[126480]: pgmap v7854: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 346 KiB/s wr, 14 op/s 2023-05-08T07:48:02.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:01 smithi133 ceph-mon[125939]: pgmap v7854: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 346 KiB/s wr, 14 op/s 2023-05-08T07:48:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:03 smithi096 ceph-mon[124666]: pgmap v7855: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 254 KiB/s wr, 10 op/s 2023-05-08T07:48:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14622.895411 secs 2023-05-08T07:48:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:03 smithi186 ceph-mon[126480]: pgmap v7855: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 254 KiB/s wr, 10 op/s 2023-05-08T07:48:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14622.895411 secs 2023-05-08T07:48:04.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:03 smithi133 ceph-mon[125939]: pgmap v7855: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 254 KiB/s wr, 10 op/s 2023-05-08T07:48:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14622.895411 secs 2023-05-08T07:48:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14623.453169 secs 2023-05-08T07:48:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14623.453169 secs 2023-05-08T07:48:05.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14623.453169 secs 2023-05-08T07:48:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:05 smithi186 ceph-mon[126480]: pgmap v7856: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 409 KiB/s wr, 26 op/s 2023-05-08T07:48:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:05 smithi133 ceph-mon[125939]: pgmap v7856: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 409 KiB/s wr, 26 op/s 2023-05-08T07:48:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:05 smithi096 ceph-mon[124666]: pgmap v7856: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 409 KiB/s wr, 26 op/s 2023-05-08T07:48:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:07 smithi186 ceph-mon[126480]: pgmap v7857: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 276 KiB/s wr, 21 op/s 2023-05-08T07:48:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:07 smithi133 ceph-mon[125939]: pgmap v7857: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 276 KiB/s wr, 21 op/s 2023-05-08T07:48:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:07 smithi096 ceph-mon[124666]: pgmap v7857: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 276 KiB/s wr, 21 op/s 2023-05-08T07:48:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14627.895543 secs 2023-05-08T07:48:09.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14627.895543 secs 2023-05-08T07:48:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14627.895543 secs 2023-05-08T07:48:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:09 smithi186 ceph-mon[126480]: pgmap v7858: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 276 KiB/s wr, 21 op/s 2023-05-08T07:48:10.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:09 smithi133 ceph-mon[125939]: pgmap v7858: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 276 KiB/s wr, 21 op/s 2023-05-08T07:48:10.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:09 smithi096 ceph-mon[124666]: pgmap v7858: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 276 KiB/s wr, 21 op/s 2023-05-08T07:48:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:11 smithi186 ceph-mon[126480]: pgmap v7859: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 375 KiB/s wr, 26 op/s 2023-05-08T07:48:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:11 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:48:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:11 smithi133 ceph-mon[125939]: pgmap v7859: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 375 KiB/s wr, 26 op/s 2023-05-08T07:48:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:11 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:48:12.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:11 smithi096 ceph-mon[124666]: pgmap v7859: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 375 KiB/s wr, 26 op/s 2023-05-08T07:48:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:11 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:48:13.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:12 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:48:13.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:12 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:48:13.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:12 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:48:13.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:12 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:48:13.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:12 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:48:13.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:12 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:48:13.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:12 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:48:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:12 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:48:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:12 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:48:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:13 smithi186 ceph-mon[126480]: pgmap v7860: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 254 KiB/s wr, 21 op/s 2023-05-08T07:48:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14632.895666 secs 2023-05-08T07:48:14.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:13 smithi133 ceph-mon[125939]: pgmap v7860: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 254 KiB/s wr, 21 op/s 2023-05-08T07:48:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14632.895666 secs 2023-05-08T07:48:14.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:13 smithi096 ceph-mon[124666]: pgmap v7860: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 254 KiB/s wr, 21 op/s 2023-05-08T07:48:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14632.895666 secs 2023-05-08T07:48:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:15 smithi186 ceph-mon[126480]: pgmap v7861: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 285 KiB/s wr, 24 op/s 2023-05-08T07:48:16.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:15 smithi133 ceph-mon[125939]: pgmap v7861: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 285 KiB/s wr, 24 op/s 2023-05-08T07:48:16.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:15 smithi096 ceph-mon[124666]: pgmap v7861: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 285 KiB/s wr, 24 op/s 2023-05-08T07:48:18.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:17 smithi186 ceph-mon[126480]: pgmap v7862: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 131 KiB/s wr, 7 op/s 2023-05-08T07:48:18.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:17 smithi133 ceph-mon[125939]: pgmap v7862: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 131 KiB/s wr, 7 op/s 2023-05-08T07:48:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:17 smithi096 ceph-mon[124666]: pgmap v7862: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 131 KiB/s wr, 7 op/s 2023-05-08T07:48:19.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14637.895808 secs 2023-05-08T07:48:19.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14637.895808 secs 2023-05-08T07:48:19.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14637.895808 secs 2023-05-08T07:48:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:19 smithi186 ceph-mon[126480]: pgmap v7863: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 131 KiB/s wr, 7 op/s 2023-05-08T07:48:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:19 smithi133 ceph-mon[125939]: pgmap v7863: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 131 KiB/s wr, 7 op/s 2023-05-08T07:48:20.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:19 smithi096 ceph-mon[124666]: pgmap v7863: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 131 KiB/s wr, 7 op/s 2023-05-08T07:48:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:21 smithi186 ceph-mon[126480]: pgmap v7864: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 141 KiB/s wr, 10 op/s 2023-05-08T07:48:22.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:21 smithi133 ceph-mon[125939]: pgmap v7864: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 141 KiB/s wr, 10 op/s 2023-05-08T07:48:22.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:21 smithi096 ceph-mon[124666]: pgmap v7864: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 141 KiB/s wr, 10 op/s 2023-05-08T07:48:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:23 smithi186 ceph-mon[126480]: pgmap v7865: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 41 KiB/s wr, 6 op/s 2023-05-08T07:48:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14642.895914 secs 2023-05-08T07:48:24.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:23 smithi133 ceph-mon[125939]: pgmap v7865: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 41 KiB/s wr, 6 op/s 2023-05-08T07:48:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14642.895914 secs 2023-05-08T07:48:24.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:23 smithi096 ceph-mon[124666]: pgmap v7865: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 41 KiB/s wr, 6 op/s 2023-05-08T07:48:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14642.895914 secs 2023-05-08T07:48:25.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14643.453608 secs 2023-05-08T07:48:25.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14643.453608 secs 2023-05-08T07:48:25.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14643.453608 secs 2023-05-08T07:48:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:25 smithi186 ceph-mon[126480]: pgmap v7866: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 251 KiB/s wr, 13 op/s 2023-05-08T07:48:26.273 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:25 smithi096 ceph-mon[124666]: pgmap v7866: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 251 KiB/s wr, 13 op/s 2023-05-08T07:48:26.274 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:25 smithi133 ceph-mon[125939]: pgmap v7866: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 251 KiB/s wr, 13 op/s 2023-05-08T07:48:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14644.736607 secs 2023-05-08T07:48:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:26 smithi186 ceph-mon[126480]: osdmap e568: 12 total, 12 up, 12 in 2023-05-08T07:48:27.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14644.736607 secs 2023-05-08T07:48:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:26 smithi133 ceph-mon[125939]: osdmap e568: 12 total, 12 up, 12 in 2023-05-08T07:48:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14644.736607 secs 2023-05-08T07:48:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:26 smithi096 ceph-mon[124666]: osdmap e568: 12 total, 12 up, 12 in 2023-05-08T07:48:28.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:27 smithi186 ceph-mon[126480]: pgmap v7868: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 263 KiB/s wr, 12 op/s 2023-05-08T07:48:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:27 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:48:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:27 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:48:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:27 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:48:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:27 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:48:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:27 smithi133 ceph-mon[125939]: pgmap v7868: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 263 KiB/s wr, 12 op/s 2023-05-08T07:48:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:27 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:48:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:27 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:48:28.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:27 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:48:28.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:27 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:48:28.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:27 smithi096 ceph-mon[124666]: pgmap v7868: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 263 KiB/s wr, 12 op/s 2023-05-08T07:48:28.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:27 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:48:28.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:27 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:48:28.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:27 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:48:28.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:27 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:48:29.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14647.896032 secs 2023-05-08T07:48:29.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14647.896032 secs 2023-05-08T07:48:29.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14647.896032 secs 2023-05-08T07:48:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:29 smithi186 ceph-mon[126480]: pgmap v7869: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 263 KiB/s wr, 12 op/s 2023-05-08T07:48:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14648.453724 secs 2023-05-08T07:48:30.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:29 smithi133 ceph-mon[125939]: pgmap v7869: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 263 KiB/s wr, 12 op/s 2023-05-08T07:48:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14648.453724 secs 2023-05-08T07:48:30.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:29 smithi096 ceph-mon[124666]: pgmap v7869: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 263 KiB/s wr, 12 op/s 2023-05-08T07:48:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14648.453724 secs 2023-05-08T07:48:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14649.736680 secs 2023-05-08T07:48:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:31 smithi186 ceph-mon[126480]: pgmap v7870: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 369 KiB/s wr, 13 op/s 2023-05-08T07:48:32.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14649.736680 secs 2023-05-08T07:48:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:31 smithi133 ceph-mon[125939]: pgmap v7870: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 369 KiB/s wr, 13 op/s 2023-05-08T07:48:32.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14649.736680 secs 2023-05-08T07:48:32.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:31 smithi096 ceph-mon[124666]: pgmap v7870: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 369 KiB/s wr, 13 op/s 2023-05-08T07:48:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:33 smithi186 ceph-mon[126480]: pgmap v7871: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 369 KiB/s wr, 13 op/s 2023-05-08T07:48:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14652.896144 secs 2023-05-08T07:48:34.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:33 smithi133 ceph-mon[125939]: pgmap v7871: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 369 KiB/s wr, 13 op/s 2023-05-08T07:48:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14652.896144 secs 2023-05-08T07:48:34.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:33 smithi096 ceph-mon[124666]: pgmap v7871: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 369 KiB/s wr, 13 op/s 2023-05-08T07:48:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14652.896144 secs 2023-05-08T07:48:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14653.453840 secs 2023-05-08T07:48:35.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14653.453840 secs 2023-05-08T07:48:35.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14653.453840 secs 2023-05-08T07:48:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:35 smithi186 ceph-mon[126480]: pgmap v7872: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 119 KiB/s wr, 8 op/s 2023-05-08T07:48:36.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:35 smithi133 ceph-mon[125939]: pgmap v7872: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 119 KiB/s wr, 8 op/s 2023-05-08T07:48:36.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:35 smithi096 ceph-mon[124666]: pgmap v7872: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 119 KiB/s wr, 8 op/s 2023-05-08T07:48:37.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14654.736818 secs 2023-05-08T07:48:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:36 smithi186 ceph-mon[126480]: osdmap e569: 12 total, 12 up, 12 in 2023-05-08T07:48:37.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14654.736818 secs 2023-05-08T07:48:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:36 smithi133 ceph-mon[125939]: osdmap e569: 12 total, 12 up, 12 in 2023-05-08T07:48:37.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14654.736818 secs 2023-05-08T07:48:37.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:36 smithi096 ceph-mon[124666]: osdmap e569: 12 total, 12 up, 12 in 2023-05-08T07:48:38.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:37 smithi186 ceph-mon[126480]: pgmap v7873: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 112 KiB/s wr, 8 op/s 2023-05-08T07:48:38.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:37 smithi133 ceph-mon[125939]: pgmap v7873: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 112 KiB/s wr, 8 op/s 2023-05-08T07:48:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:37 smithi096 ceph-mon[124666]: pgmap v7873: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 112 KiB/s wr, 8 op/s 2023-05-08T07:48:39.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14657.896241 secs 2023-05-08T07:48:39.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14657.896241 secs 2023-05-08T07:48:39.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14657.896241 secs 2023-05-08T07:48:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:39 smithi186 ceph-mon[126480]: pgmap v7875: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 119 KiB/s wr, 8 op/s 2023-05-08T07:48:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14658.453973 secs 2023-05-08T07:48:40.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:39 smithi133 ceph-mon[125939]: pgmap v7875: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 119 KiB/s wr, 8 op/s 2023-05-08T07:48:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14658.453973 secs 2023-05-08T07:48:40.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:39 smithi096 ceph-mon[124666]: pgmap v7875: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 119 KiB/s wr, 8 op/s 2023-05-08T07:48:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14658.453973 secs 2023-05-08T07:48:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14659.736907 secs 2023-05-08T07:48:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:41 smithi186 ceph-mon[126480]: pgmap v7876: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 78 KiB/s wr, 7 op/s 2023-05-08T07:48:42.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14659.736907 secs 2023-05-08T07:48:42.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:41 smithi133 ceph-mon[125939]: pgmap v7876: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 78 KiB/s wr, 7 op/s 2023-05-08T07:48:42.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14659.736907 secs 2023-05-08T07:48:42.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:41 smithi096 ceph-mon[124666]: pgmap v7876: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 78 KiB/s wr, 7 op/s 2023-05-08T07:48:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:43 smithi186 ceph-mon[126480]: pgmap v7877: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 206 KiB/s wr, 8 op/s 2023-05-08T07:48:44.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14662.896374 secs 2023-05-08T07:48:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:43 smithi133 ceph-mon[125939]: pgmap v7877: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 206 KiB/s wr, 8 op/s 2023-05-08T07:48:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14662.896374 secs 2023-05-08T07:48:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:43 smithi096 ceph-mon[124666]: pgmap v7877: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 206 KiB/s wr, 8 op/s 2023-05-08T07:48:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14662.896374 secs 2023-05-08T07:48:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:45 smithi186 ceph-mon[126480]: pgmap v7878: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 214 KiB/s wr, 8 op/s 2023-05-08T07:48:46.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:45 smithi133 ceph-mon[125939]: pgmap v7878: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 214 KiB/s wr, 8 op/s 2023-05-08T07:48:46.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:45 smithi096 ceph-mon[124666]: pgmap v7878: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 214 KiB/s wr, 8 op/s 2023-05-08T07:48:47.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:47 smithi186 ceph-mon[126480]: pgmap v7879: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 318 KiB/s wr, 9 op/s 2023-05-08T07:48:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:48:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:48:47.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:47 smithi133 ceph-mon[125939]: pgmap v7879: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 318 KiB/s wr, 9 op/s 2023-05-08T07:48:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:48:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:48:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:47 smithi096 ceph-mon[124666]: pgmap v7879: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 318 KiB/s wr, 9 op/s 2023-05-08T07:48:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:48:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:48:48.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:48 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:48:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:48:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:48:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:48:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14667.896441 secs 2023-05-08T07:48:48.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:48 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:48:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:48:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:48:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:48:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14667.896441 secs 2023-05-08T07:48:49.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:48 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:48:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:48:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:48:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:48:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14667.896441 secs 2023-05-08T07:48:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:49 smithi186 ceph-mon[126480]: pgmap v7880: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 267 KiB/s wr, 8 op/s 2023-05-08T07:48:49.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:49 smithi133 ceph-mon[125939]: pgmap v7880: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 267 KiB/s wr, 8 op/s 2023-05-08T07:48:50.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:49 smithi096 ceph-mon[124666]: pgmap v7880: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 267 KiB/s wr, 8 op/s 2023-05-08T07:48:51.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:51 smithi186 ceph-mon[126480]: pgmap v7881: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 286 KiB/s rd, 272 KiB/s wr, 12 op/s 2023-05-08T07:48:51.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:51 smithi133 ceph-mon[125939]: pgmap v7881: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 286 KiB/s rd, 272 KiB/s wr, 12 op/s 2023-05-08T07:48:52.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:51 smithi096 ceph-mon[124666]: pgmap v7881: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 286 KiB/s rd, 272 KiB/s wr, 12 op/s 2023-05-08T07:48:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:48:52.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:48:53.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:48:53.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:53 smithi186 ceph-mon[126480]: pgmap v7882: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 297 KiB/s wr, 10 op/s 2023-05-08T07:48:53.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:53 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:48:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:53 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:48:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:53 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:48:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14672.896590 secs 2023-05-08T07:48:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:53 smithi133 ceph-mon[125939]: pgmap v7882: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 297 KiB/s wr, 10 op/s 2023-05-08T07:48:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:53 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:48:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:53 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:48:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:53 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:48:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14672.896590 secs 2023-05-08T07:48:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:53 smithi096 ceph-mon[124666]: pgmap v7882: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 297 KiB/s wr, 10 op/s 2023-05-08T07:48:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:53 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:48:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:53 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:48:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:53 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:48:54.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14672.896590 secs 2023-05-08T07:48:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:54 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:48:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:54 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T07:48:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:54 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T07:48:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:54 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:48:54.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:54 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:48:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:54 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T07:48:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:54 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T07:48:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:54 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:48:55.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:54 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:48:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:54 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T07:48:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:54 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T07:48:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:54 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:48:55.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14673.454323 secs 2023-05-08T07:48:55.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:55 smithi186 ceph-mon[126480]: pgmap v7883: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 225 KiB/s wr, 12 op/s 2023-05-08T07:48:55.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14673.454323 secs 2023-05-08T07:48:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:55 smithi133 ceph-mon[125939]: pgmap v7883: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 225 KiB/s wr, 12 op/s 2023-05-08T07:48:56.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14673.454323 secs 2023-05-08T07:48:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:55 smithi096 ceph-mon[124666]: pgmap v7883: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 225 KiB/s wr, 12 op/s 2023-05-08T07:48:56.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:56 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:48:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:48:56.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:48:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:56 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:48:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:48:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:48:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:56 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:48:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:48:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:48:57.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:57 smithi186 ceph-mon[126480]: pgmap v7884: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 290 KiB/s rd, 277 KiB/s wr, 9 op/s 2023-05-08T07:48:57.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:57 smithi133 ceph-mon[125939]: pgmap v7884: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 290 KiB/s rd, 277 KiB/s wr, 9 op/s 2023-05-08T07:48:58.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:57 smithi096 ceph-mon[124666]: pgmap v7884: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 290 KiB/s rd, 277 KiB/s wr, 9 op/s 2023-05-08T07:48:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14677.896708 secs 2023-05-08T07:48:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14677.896708 secs 2023-05-08T07:48:59.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14677.896708 secs 2023-05-08T07:48:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:59 smithi186 ceph-mon[126480]: pgmap v7885: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 191 KiB/s wr, 8 op/s 2023-05-08T07:48:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:48:59 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:48:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:59 smithi133 ceph-mon[125939]: pgmap v7885: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 191 KiB/s wr, 8 op/s 2023-05-08T07:48:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:48:59 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:49:00.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:59 smithi096 ceph-mon[124666]: pgmap v7885: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 191 KiB/s wr, 8 op/s 2023-05-08T07:49:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:48:59 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:49:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:49:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:49:00.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:49:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:49:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:49:01.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:49:01.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14679.737263 secs 2023-05-08T07:49:01.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:01 smithi186 ceph-mon[126480]: pgmap v7886: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 409 KiB/s wr, 14 op/s 2023-05-08T07:49:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:01 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:49:01.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14679.737263 secs 2023-05-08T07:49:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:01 smithi133 ceph-mon[125939]: pgmap v7886: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 409 KiB/s wr, 14 op/s 2023-05-08T07:49:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:01 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:49:02.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14679.737263 secs 2023-05-08T07:49:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:01 smithi096 ceph-mon[124666]: pgmap v7886: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 409 KiB/s wr, 14 op/s 2023-05-08T07:49:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:01 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:49:03.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:03 smithi186 ceph-mon[126480]: pgmap v7887: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 402 KiB/s wr, 10 op/s 2023-05-08T07:49:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14682.896820 secs 2023-05-08T07:49:03.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:03 smithi133 ceph-mon[125939]: pgmap v7887: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 402 KiB/s wr, 10 op/s 2023-05-08T07:49:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14682.896820 secs 2023-05-08T07:49:04.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:03 smithi096 ceph-mon[124666]: pgmap v7887: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 402 KiB/s wr, 10 op/s 2023-05-08T07:49:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14682.896820 secs 2023-05-08T07:49:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:04 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:49:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:04 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:49:04.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:04 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:49:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:04 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:49:05.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:04 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:49:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:04 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:49:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14683.454549 secs 2023-05-08T07:49:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:05 smithi186 ceph-mon[126480]: pgmap v7888: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 358 KiB/s wr, 27 op/s 2023-05-08T07:49:05.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14683.454549 secs 2023-05-08T07:49:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:05 smithi133 ceph-mon[125939]: pgmap v7888: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 358 KiB/s wr, 27 op/s 2023-05-08T07:49:06.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14683.454549 secs 2023-05-08T07:49:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:05 smithi096 ceph-mon[124666]: pgmap v7888: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 358 KiB/s wr, 27 op/s 2023-05-08T07:49:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14684.737381 secs 2023-05-08T07:49:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:06 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:49:06.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14684.737381 secs 2023-05-08T07:49:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:06 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:49:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14684.737381 secs 2023-05-08T07:49:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:06 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:49:07.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:07 smithi186 ceph-mon[126480]: pgmap v7889: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 324 KiB/s wr, 23 op/s 2023-05-08T07:49:07.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:07 smithi133 ceph-mon[125939]: pgmap v7889: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 324 KiB/s wr, 23 op/s 2023-05-08T07:49:08.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:07 smithi096 ceph-mon[124666]: pgmap v7889: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 324 KiB/s wr, 23 op/s 2023-05-08T07:49:08.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:49:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:49:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14687.896937 secs 2023-05-08T07:49:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:49:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:49:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14687.896937 secs 2023-05-08T07:49:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:49:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:49:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14687.896937 secs 2023-05-08T07:49:09.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:09 smithi133 ceph-mon[125939]: pgmap v7890: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 264 KiB/s wr, 23 op/s 2023-05-08T07:49:10.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:09 smithi096 ceph-mon[124666]: pgmap v7890: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 264 KiB/s wr, 23 op/s 2023-05-08T07:49:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:09 smithi186 ceph-mon[126480]: pgmap v7890: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 264 KiB/s wr, 23 op/s 2023-05-08T07:49:10.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14688.454612 secs 2023-05-08T07:49:11.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14688.454612 secs 2023-05-08T07:49:11.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14688.454612 secs 2023-05-08T07:49:11.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14689.737497 secs 2023-05-08T07:49:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:11 smithi133 ceph-mon[125939]: pgmap v7891: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 320 KiB/s wr, 27 op/s 2023-05-08T07:49:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:11 smithi133 ceph-mon[125939]: osdmap e570: 12 total, 12 up, 12 in 2023-05-08T07:49:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:11 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:49:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14689.737497 secs 2023-05-08T07:49:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:11 smithi096 ceph-mon[124666]: pgmap v7891: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 320 KiB/s wr, 27 op/s 2023-05-08T07:49:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:11 smithi096 ceph-mon[124666]: osdmap e570: 12 total, 12 up, 12 in 2023-05-08T07:49:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:11 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:49:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14689.737497 secs 2023-05-08T07:49:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:11 smithi186 ceph-mon[126480]: pgmap v7891: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 320 KiB/s wr, 27 op/s 2023-05-08T07:49:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:11 smithi186 ceph-mon[126480]: osdmap e570: 12 total, 12 up, 12 in 2023-05-08T07:49:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:11 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:49:13.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:13 smithi133 ceph-mon[125939]: pgmap v7893: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 122 KiB/s wr, 26 op/s 2023-05-08T07:49:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14692.897212 secs 2023-05-08T07:49:14.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:13 smithi096 ceph-mon[124666]: pgmap v7893: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 122 KiB/s wr, 26 op/s 2023-05-08T07:49:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14692.897212 secs 2023-05-08T07:49:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:13 smithi186 ceph-mon[126480]: pgmap v7893: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 122 KiB/s wr, 26 op/s 2023-05-08T07:49:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14692.897212 secs 2023-05-08T07:49:15.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14693.454728 secs 2023-05-08T07:49:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:15 smithi133 ceph-mon[125939]: pgmap v7894: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 128 KiB/s wr, 9 op/s 2023-05-08T07:49:16.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14693.454728 secs 2023-05-08T07:49:16.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:15 smithi096 ceph-mon[124666]: pgmap v7894: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 128 KiB/s wr, 9 op/s 2023-05-08T07:49:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14693.454728 secs 2023-05-08T07:49:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:15 smithi186 ceph-mon[126480]: pgmap v7894: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 128 KiB/s wr, 9 op/s 2023-05-08T07:49:16.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14694.737634 secs 2023-05-08T07:49:17.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14694.737634 secs 2023-05-08T07:49:17.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14694.737634 secs 2023-05-08T07:49:17.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:17 smithi133 ceph-mon[125939]: pgmap v7895: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 128 KiB/s wr, 9 op/s 2023-05-08T07:49:18.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:17 smithi096 ceph-mon[124666]: pgmap v7895: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 128 KiB/s wr, 9 op/s 2023-05-08T07:49:18.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:17 smithi186 ceph-mon[126480]: pgmap v7895: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 128 KiB/s wr, 9 op/s 2023-05-08T07:49:18.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14697.897351 secs 2023-05-08T07:49:19.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14697.897351 secs 2023-05-08T07:49:19.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14697.897351 secs 2023-05-08T07:49:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:19 smithi133 ceph-mon[125939]: pgmap v7896: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 128 KiB/s wr, 9 op/s 2023-05-08T07:49:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:19 smithi096 ceph-mon[124666]: pgmap v7896: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 128 KiB/s wr, 9 op/s 2023-05-08T07:49:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:19 smithi186 ceph-mon[126480]: pgmap v7896: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 128 KiB/s wr, 9 op/s 2023-05-08T07:49:20.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14698.454869 secs 2023-05-08T07:49:21.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14698.454869 secs 2023-05-08T07:49:21.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14698.454869 secs 2023-05-08T07:49:21.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14699.737770 secs 2023-05-08T07:49:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:21 smithi133 ceph-mon[125939]: pgmap v7897: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 93 KiB/s wr, 9 op/s 2023-05-08T07:49:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:21 smithi133 ceph-mon[125939]: osdmap e571: 12 total, 12 up, 12 in 2023-05-08T07:49:22.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14699.737770 secs 2023-05-08T07:49:22.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:21 smithi096 ceph-mon[124666]: pgmap v7897: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 93 KiB/s wr, 9 op/s 2023-05-08T07:49:22.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:21 smithi096 ceph-mon[124666]: osdmap e571: 12 total, 12 up, 12 in 2023-05-08T07:49:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14699.737770 secs 2023-05-08T07:49:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:21 smithi186 ceph-mon[126480]: pgmap v7897: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 93 KiB/s wr, 9 op/s 2023-05-08T07:49:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:21 smithi186 ceph-mon[126480]: osdmap e571: 12 total, 12 up, 12 in 2023-05-08T07:49:23.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:23 smithi133 ceph-mon[125939]: pgmap v7899: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 93 KiB/s wr, 9 op/s 2023-05-08T07:49:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14702.897467 secs 2023-05-08T07:49:24.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:23 smithi096 ceph-mon[124666]: pgmap v7899: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 93 KiB/s wr, 9 op/s 2023-05-08T07:49:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14702.897467 secs 2023-05-08T07:49:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:23 smithi186 ceph-mon[126480]: pgmap v7899: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 93 KiB/s wr, 9 op/s 2023-05-08T07:49:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14702.897467 secs 2023-05-08T07:49:25.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14703.454944 secs 2023-05-08T07:49:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:25 smithi133 ceph-mon[125939]: pgmap v7900: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 206 KiB/s wr, 9 op/s 2023-05-08T07:49:26.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14703.454944 secs 2023-05-08T07:49:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:25 smithi096 ceph-mon[124666]: pgmap v7900: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 206 KiB/s wr, 9 op/s 2023-05-08T07:49:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14703.454944 secs 2023-05-08T07:49:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:25 smithi186 ceph-mon[126480]: pgmap v7900: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 206 KiB/s wr, 9 op/s 2023-05-08T07:49:26.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14704.737882 secs 2023-05-08T07:49:27.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14704.737882 secs 2023-05-08T07:49:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14704.737882 secs 2023-05-08T07:49:27.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:27 smithi133 ceph-mon[125939]: pgmap v7901: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 206 KiB/s wr, 9 op/s 2023-05-08T07:49:28.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:27 smithi096 ceph-mon[124666]: pgmap v7901: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 206 KiB/s wr, 9 op/s 2023-05-08T07:49:28.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:27 smithi186 ceph-mon[126480]: pgmap v7901: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 206 KiB/s wr, 9 op/s 2023-05-08T07:49:28.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14707.897559 secs 2023-05-08T07:49:29.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14707.897559 secs 2023-05-08T07:49:29.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14707.897559 secs 2023-05-08T07:49:29.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:29 smithi133 ceph-mon[125939]: pgmap v7902: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 206 KiB/s wr, 9 op/s 2023-05-08T07:49:30.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:29 smithi096 ceph-mon[124666]: pgmap v7902: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 206 KiB/s wr, 9 op/s 2023-05-08T07:49:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:29 smithi186 ceph-mon[126480]: pgmap v7902: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 206 KiB/s wr, 9 op/s 2023-05-08T07:49:30.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14708.455081 secs 2023-05-08T07:49:31.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14708.455081 secs 2023-05-08T07:49:31.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14708.455081 secs 2023-05-08T07:49:31.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14709.737961 secs 2023-05-08T07:49:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:31 smithi133 ceph-mon[125939]: pgmap v7903: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 175 KiB/s wr, 9 op/s 2023-05-08T07:49:32.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14709.737961 secs 2023-05-08T07:49:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:31 smithi096 ceph-mon[124666]: pgmap v7903: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 175 KiB/s wr, 9 op/s 2023-05-08T07:49:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14709.737961 secs 2023-05-08T07:49:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:31 smithi186 ceph-mon[126480]: pgmap v7903: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 175 KiB/s wr, 9 op/s 2023-05-08T07:49:33.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:33 smithi133 ceph-mon[125939]: pgmap v7904: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 160 KiB/s wr, 8 op/s 2023-05-08T07:49:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14712.897693 secs 2023-05-08T07:49:34.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:33 smithi096 ceph-mon[124666]: pgmap v7904: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 160 KiB/s wr, 8 op/s 2023-05-08T07:49:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14712.897693 secs 2023-05-08T07:49:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:33 smithi186 ceph-mon[126480]: pgmap v7904: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 160 KiB/s wr, 8 op/s 2023-05-08T07:49:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14712.897693 secs 2023-05-08T07:49:35.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14713.455226 secs 2023-05-08T07:49:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:35 smithi133 ceph-mon[125939]: pgmap v7905: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 192 KiB/s wr, 10 op/s 2023-05-08T07:49:36.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14713.455226 secs 2023-05-08T07:49:36.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:35 smithi096 ceph-mon[124666]: pgmap v7905: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 192 KiB/s wr, 10 op/s 2023-05-08T07:49:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14713.455226 secs 2023-05-08T07:49:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:35 smithi186 ceph-mon[126480]: pgmap v7905: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 192 KiB/s wr, 10 op/s 2023-05-08T07:49:36.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14714.738080 secs 2023-05-08T07:49:37.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14714.738080 secs 2023-05-08T07:49:37.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14714.738080 secs 2023-05-08T07:49:37.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:37 smithi133 ceph-mon[125939]: pgmap v7906: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 47 KiB/s wr, 6 op/s 2023-05-08T07:49:38.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:37 smithi096 ceph-mon[124666]: pgmap v7906: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 47 KiB/s wr, 6 op/s 2023-05-08T07:49:38.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:37 smithi186 ceph-mon[126480]: pgmap v7906: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 47 KiB/s wr, 6 op/s 2023-05-08T07:49:38.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14717.897828 secs 2023-05-08T07:49:39.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14717.897828 secs 2023-05-08T07:49:39.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14717.897828 secs 2023-05-08T07:49:39.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:39 smithi133 ceph-mon[125939]: pgmap v7907: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 47 KiB/s wr, 6 op/s 2023-05-08T07:49:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14718.455353 secs 2023-05-08T07:49:40.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:39 smithi096 ceph-mon[124666]: pgmap v7907: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 47 KiB/s wr, 6 op/s 2023-05-08T07:49:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14718.455353 secs 2023-05-08T07:49:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:39 smithi186 ceph-mon[126480]: pgmap v7907: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 47 KiB/s wr, 6 op/s 2023-05-08T07:49:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14718.455353 secs 2023-05-08T07:49:41.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14719.738158 secs 2023-05-08T07:49:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:41 smithi133 ceph-mon[125939]: pgmap v7908: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 47 KiB/s wr, 9 op/s 2023-05-08T07:49:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14719.738158 secs 2023-05-08T07:49:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:41 smithi096 ceph-mon[124666]: pgmap v7908: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 47 KiB/s wr, 9 op/s 2023-05-08T07:49:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14719.738158 secs 2023-05-08T07:49:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:41 smithi186 ceph-mon[126480]: pgmap v7908: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 47 KiB/s wr, 9 op/s 2023-05-08T07:49:43.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:43 smithi133 ceph-mon[125939]: pgmap v7909: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 47 KiB/s wr, 6 op/s 2023-05-08T07:49:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14722.897894 secs 2023-05-08T07:49:44.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:43 smithi096 ceph-mon[124666]: pgmap v7909: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 47 KiB/s wr, 6 op/s 2023-05-08T07:49:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14722.897894 secs 2023-05-08T07:49:44.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:43 smithi186 ceph-mon[126480]: pgmap v7909: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 47 KiB/s wr, 6 op/s 2023-05-08T07:49:44.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14722.897894 secs 2023-05-08T07:49:44.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14723.455512 secs 2023-05-08T07:49:45.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14723.455512 secs 2023-05-08T07:49:45.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14723.455512 secs 2023-05-08T07:49:45.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:45 smithi133 ceph-mon[125939]: pgmap v7910: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 96 KiB/s wr, 9 op/s 2023-05-08T07:49:46.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:45 smithi096 ceph-mon[124666]: pgmap v7910: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 96 KiB/s wr, 9 op/s 2023-05-08T07:49:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:45 smithi186 ceph-mon[126480]: pgmap v7910: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 96 KiB/s wr, 9 op/s 2023-05-08T07:49:46.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14724.738256 secs 2023-05-08T07:49:47.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14724.738256 secs 2023-05-08T07:49:47.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14724.738256 secs 2023-05-08T07:49:47.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:47 smithi133 ceph-mon[125939]: pgmap v7911: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 50 KiB/s wr, 6 op/s 2023-05-08T07:49:48.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:47 smithi096 ceph-mon[124666]: pgmap v7911: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 50 KiB/s wr, 6 op/s 2023-05-08T07:49:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:47 smithi186 ceph-mon[126480]: pgmap v7911: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 50 KiB/s wr, 6 op/s 2023-05-08T07:49:48.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14727.898018 secs 2023-05-08T07:49:49.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14727.898018 secs 2023-05-08T07:49:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14727.898018 secs 2023-05-08T07:49:49.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:49 smithi133 ceph-mon[125939]: pgmap v7912: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 50 KiB/s wr, 6 op/s 2023-05-08T07:49:50.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:49 smithi096 ceph-mon[124666]: pgmap v7912: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 50 KiB/s wr, 6 op/s 2023-05-08T07:49:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:49 smithi186 ceph-mon[126480]: pgmap v7912: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 50 KiB/s wr, 6 op/s 2023-05-08T07:49:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14729.738363 secs 2023-05-08T07:49:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:51 smithi096 ceph-mon[124666]: pgmap v7913: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 151 KiB/s wr, 10 op/s 2023-05-08T07:49:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:49:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14729.738363 secs 2023-05-08T07:49:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:51 smithi186 ceph-mon[126480]: pgmap v7913: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 151 KiB/s wr, 10 op/s 2023-05-08T07:49:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:49:52.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14729.738363 secs 2023-05-08T07:49:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:51 smithi133 ceph-mon[125939]: pgmap v7913: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 151 KiB/s wr, 10 op/s 2023-05-08T07:49:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:49:53.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:52 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:49:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:49:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:49:53.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:52 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:49:53.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:49:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:49:53.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:52 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:49:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:49:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:49:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:53 smithi186 ceph-mon[126480]: pgmap v7914: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 150 KiB/s wr, 7 op/s 2023-05-08T07:49:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14732.898139 secs 2023-05-08T07:49:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:53 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:49:54.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:53 smithi133 ceph-mon[125939]: pgmap v7914: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 150 KiB/s wr, 7 op/s 2023-05-08T07:49:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14732.898139 secs 2023-05-08T07:49:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:53 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:49:54.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:53 smithi096 ceph-mon[124666]: pgmap v7914: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 150 KiB/s wr, 7 op/s 2023-05-08T07:49:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14732.898139 secs 2023-05-08T07:49:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:53 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:49:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:49:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:49:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:54 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:49:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:49:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:54 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T07:49:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:54 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T07:49:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:54 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:49:55.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:49:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:49:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:54 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:49:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:49:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:54 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T07:49:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:54 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T07:49:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:54 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:49:55.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:49:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:49:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:54 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:49:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:49:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:54 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T07:49:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:54 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T07:49:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:54 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:49:56.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:55 smithi133 ceph-mon[125939]: pgmap v7915: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 340 KiB/s wr, 12 op/s 2023-05-08T07:49:56.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:55 smithi096 ceph-mon[124666]: pgmap v7915: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 340 KiB/s wr, 12 op/s 2023-05-08T07:49:56.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:55 smithi186 ceph-mon[126480]: pgmap v7915: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 340 KiB/s wr, 12 op/s 2023-05-08T07:49:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:57 smithi133 ceph-mon[125939]: pgmap v7916: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 291 KiB/s wr, 9 op/s 2023-05-08T07:49:58.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:57 smithi096 ceph-mon[124666]: pgmap v7916: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 291 KiB/s wr, 9 op/s 2023-05-08T07:49:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:57 smithi186 ceph-mon[126480]: pgmap v7916: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 291 KiB/s wr, 9 op/s 2023-05-08T07:49:59.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14737.898253 secs 2023-05-08T07:49:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:58 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:49:59.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14737.898253 secs 2023-05-08T07:49:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:58 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:49:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14737.898253 secs 2023-05-08T07:49:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:58 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:50:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:59 smithi133 ceph-mon[125939]: pgmap v7917: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 291 KiB/s wr, 9 op/s 2023-05-08T07:50:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14738.455753 secs 2023-05-08T07:50:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:59 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:50:00.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:59 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:50:00.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:49:59 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:50:00.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:59 smithi096 ceph-mon[124666]: pgmap v7917: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 291 KiB/s wr, 9 op/s 2023-05-08T07:50:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14738.455753 secs 2023-05-08T07:50:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:59 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:50:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:59 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:50:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:49:59 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:50:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:59 smithi186 ceph-mon[126480]: pgmap v7917: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 291 KiB/s wr, 9 op/s 2023-05-08T07:50:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14738.455753 secs 2023-05-08T07:50:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:59 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:50:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:59 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:50:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:49:59 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:50:01.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:00 smithi133 ceph-mon[125939]: overall HEALTH_WARN 2 MDSs report slow requests 2023-05-08T07:50:01.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:00 smithi096 ceph-mon[124666]: overall HEALTH_WARN 2 MDSs report slow requests 2023-05-08T07:50:01.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:00 smithi186 ceph-mon[126480]: overall HEALTH_WARN 2 MDSs report slow requests 2023-05-08T07:50:02.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:01 smithi133 ceph-mon[125939]: pgmap v7918: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 354 KiB/s wr, 14 op/s 2023-05-08T07:50:02.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:01 smithi096 ceph-mon[124666]: pgmap v7918: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 354 KiB/s wr, 14 op/s 2023-05-08T07:50:02.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:01 smithi186 ceph-mon[126480]: pgmap v7918: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 354 KiB/s wr, 14 op/s 2023-05-08T07:50:04.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:03 smithi133 ceph-mon[125939]: pgmap v7919: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 253 KiB/s wr, 9 op/s 2023-05-08T07:50:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14742.898353 secs 2023-05-08T07:50:04.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:03 smithi096 ceph-mon[124666]: pgmap v7919: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 253 KiB/s wr, 9 op/s 2023-05-08T07:50:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14742.898353 secs 2023-05-08T07:50:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:03 smithi186 ceph-mon[126480]: pgmap v7919: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 253 KiB/s wr, 9 op/s 2023-05-08T07:50:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14742.898353 secs 2023-05-08T07:50:05.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14743.455870 secs 2023-05-08T07:50:05.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14743.455870 secs 2023-05-08T07:50:05.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14743.455870 secs 2023-05-08T07:50:06.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:05 smithi133 ceph-mon[125939]: pgmap v7920: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 472 KiB/s wr, 26 op/s 2023-05-08T07:50:06.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:05 smithi096 ceph-mon[124666]: pgmap v7920: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 472 KiB/s wr, 26 op/s 2023-05-08T07:50:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:05 smithi186 ceph-mon[126480]: pgmap v7920: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 472 KiB/s wr, 26 op/s 2023-05-08T07:50:08.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:07 smithi133 ceph-mon[125939]: pgmap v7921: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 281 KiB/s wr, 21 op/s 2023-05-08T07:50:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:07 smithi096 ceph-mon[124666]: pgmap v7921: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 281 KiB/s wr, 21 op/s 2023-05-08T07:50:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:07 smithi186 ceph-mon[126480]: pgmap v7921: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 281 KiB/s wr, 21 op/s 2023-05-08T07:50:09.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14747.898470 secs 2023-05-08T07:50:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:08 smithi133 ceph-mon[125939]: pgmap v7922: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 281 KiB/s wr, 21 op/s 2023-05-08T07:50:09.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14747.898470 secs 2023-05-08T07:50:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:08 smithi096 ceph-mon[124666]: pgmap v7922: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 281 KiB/s wr, 21 op/s 2023-05-08T07:50:09.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14747.898470 secs 2023-05-08T07:50:09.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:08 smithi186 ceph-mon[126480]: pgmap v7922: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 281 KiB/s wr, 21 op/s 2023-05-08T07:50:11.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:11 smithi186 ceph-mon[126480]: pgmap v7923: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 383 KiB/s wr, 25 op/s 2023-05-08T07:50:11.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:11 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:50:11.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:11 smithi133 ceph-mon[125939]: pgmap v7923: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 383 KiB/s wr, 25 op/s 2023-05-08T07:50:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:11 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:50:12.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:11 smithi096 ceph-mon[124666]: pgmap v7923: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 383 KiB/s wr, 25 op/s 2023-05-08T07:50:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:11 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:50:12.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:12 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:50:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:12 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:50:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:12 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:50:12.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:12 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:50:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:12 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:50:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:12 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:50:13.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:12 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:50:13.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:12 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:50:13.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:12 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:50:13.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:13 smithi186 ceph-mon[126480]: pgmap v7924: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 320 KiB/s wr, 21 op/s 2023-05-08T07:50:13.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14752.898591 secs 2023-05-08T07:50:13.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:13 smithi133 ceph-mon[125939]: pgmap v7924: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 320 KiB/s wr, 21 op/s 2023-05-08T07:50:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14752.898591 secs 2023-05-08T07:50:14.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:13 smithi096 ceph-mon[124666]: pgmap v7924: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 320 KiB/s wr, 21 op/s 2023-05-08T07:50:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14752.898591 secs 2023-05-08T07:50:15.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:15 smithi186 ceph-mon[126480]: pgmap v7925: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 340 KiB/s rd, 352 KiB/s wr, 24 op/s 2023-05-08T07:50:15.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:15 smithi133 ceph-mon[125939]: pgmap v7925: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 340 KiB/s rd, 352 KiB/s wr, 24 op/s 2023-05-08T07:50:16.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:15 smithi096 ceph-mon[124666]: pgmap v7925: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 340 KiB/s rd, 352 KiB/s wr, 24 op/s 2023-05-08T07:50:17.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:17 smithi186 ceph-mon[126480]: pgmap v7926: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 134 KiB/s wr, 7 op/s 2023-05-08T07:50:17.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:17 smithi133 ceph-mon[125939]: pgmap v7926: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 134 KiB/s wr, 7 op/s 2023-05-08T07:50:18.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:17 smithi096 ceph-mon[124666]: pgmap v7926: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 134 KiB/s wr, 7 op/s 2023-05-08T07:50:18.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14757.898700 secs 2023-05-08T07:50:18.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14757.898700 secs 2023-05-08T07:50:19.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14757.898700 secs 2023-05-08T07:50:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:19 smithi186 ceph-mon[126480]: pgmap v7927: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 134 KiB/s wr, 7 op/s 2023-05-08T07:50:19.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:19 smithi133 ceph-mon[125939]: pgmap v7927: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 134 KiB/s wr, 7 op/s 2023-05-08T07:50:20.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:19 smithi096 ceph-mon[124666]: pgmap v7927: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 134 KiB/s wr, 7 op/s 2023-05-08T07:50:21.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:21 smithi186 ceph-mon[126480]: pgmap v7928: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 134 KiB/s wr, 10 op/s 2023-05-08T07:50:21.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:21 smithi133 ceph-mon[125939]: pgmap v7928: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 134 KiB/s wr, 10 op/s 2023-05-08T07:50:22.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:21 smithi096 ceph-mon[124666]: pgmap v7928: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 134 KiB/s wr, 10 op/s 2023-05-08T07:50:23.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:23 smithi186 ceph-mon[126480]: pgmap v7929: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 5 op/s 2023-05-08T07:50:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14762.898817 secs 2023-05-08T07:50:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:23 smithi133 ceph-mon[125939]: pgmap v7929: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 5 op/s 2023-05-08T07:50:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14762.898817 secs 2023-05-08T07:50:24.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:23 smithi096 ceph-mon[124666]: pgmap v7929: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 5 op/s 2023-05-08T07:50:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14762.898817 secs 2023-05-08T07:50:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14763.456371 secs 2023-05-08T07:50:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:25 smithi186 ceph-mon[126480]: pgmap v7930: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 156 KiB/s wr, 11 op/s 2023-05-08T07:50:25.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14763.456371 secs 2023-05-08T07:50:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:25 smithi133 ceph-mon[125939]: pgmap v7930: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 156 KiB/s wr, 11 op/s 2023-05-08T07:50:26.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14763.456371 secs 2023-05-08T07:50:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:25 smithi096 ceph-mon[124666]: pgmap v7930: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 156 KiB/s wr, 11 op/s 2023-05-08T07:50:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14764.739207 secs 2023-05-08T07:50:26.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14764.739207 secs 2023-05-08T07:50:27.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14764.739207 secs 2023-05-08T07:50:27.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:27 smithi186 ceph-mon[126480]: pgmap v7931: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 124 KiB/s wr, 8 op/s 2023-05-08T07:50:27.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:27 smithi133 ceph-mon[125939]: pgmap v7931: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 124 KiB/s wr, 8 op/s 2023-05-08T07:50:28.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:27 smithi096 ceph-mon[124666]: pgmap v7931: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 124 KiB/s wr, 8 op/s 2023-05-08T07:50:28.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:28 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:50:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:28 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:50:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:28 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:50:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:28 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:50:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14767.898934 secs 2023-05-08T07:50:28.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:28 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:50:28.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:28 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:50:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:28 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:50:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:28 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:50:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14767.898934 secs 2023-05-08T07:50:29.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:28 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:50:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:28 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:50:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:28 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:50:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:28 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:50:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14767.898934 secs 2023-05-08T07:50:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:29 smithi186 ceph-mon[126480]: pgmap v7932: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 124 KiB/s wr, 8 op/s 2023-05-08T07:50:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:29 smithi133 ceph-mon[125939]: pgmap v7932: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 124 KiB/s wr, 8 op/s 2023-05-08T07:50:30.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:29 smithi096 ceph-mon[124666]: pgmap v7932: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 124 KiB/s wr, 8 op/s 2023-05-08T07:50:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14768.456507 secs 2023-05-08T07:50:30.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14768.456507 secs 2023-05-08T07:50:31.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14768.456507 secs 2023-05-08T07:50:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14769.739330 secs 2023-05-08T07:50:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:31 smithi186 ceph-mon[126480]: pgmap v7933: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 285 KiB/s wr, 13 op/s 2023-05-08T07:50:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:31 smithi186 ceph-mon[126480]: osdmap e572: 12 total, 12 up, 12 in 2023-05-08T07:50:31.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14769.739330 secs 2023-05-08T07:50:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:31 smithi133 ceph-mon[125939]: pgmap v7933: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 285 KiB/s wr, 13 op/s 2023-05-08T07:50:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:31 smithi133 ceph-mon[125939]: osdmap e572: 12 total, 12 up, 12 in 2023-05-08T07:50:32.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14769.739330 secs 2023-05-08T07:50:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:31 smithi096 ceph-mon[124666]: pgmap v7933: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 285 KiB/s wr, 13 op/s 2023-05-08T07:50:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:31 smithi096 ceph-mon[124666]: osdmap e572: 12 total, 12 up, 12 in 2023-05-08T07:50:33.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:33 smithi186 ceph-mon[126480]: pgmap v7935: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 342 KiB/s wr, 12 op/s 2023-05-08T07:50:33.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14772.899055 secs 2023-05-08T07:50:33.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:33 smithi133 ceph-mon[125939]: pgmap v7935: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 342 KiB/s wr, 12 op/s 2023-05-08T07:50:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14772.899055 secs 2023-05-08T07:50:34.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:33 smithi096 ceph-mon[124666]: pgmap v7935: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 342 KiB/s wr, 12 op/s 2023-05-08T07:50:34.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14772.899055 secs 2023-05-08T07:50:35.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14773.456605 secs 2023-05-08T07:50:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:35 smithi186 ceph-mon[126480]: pgmap v7936: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 196 KiB/s wr, 9 op/s 2023-05-08T07:50:35.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14773.456605 secs 2023-05-08T07:50:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:35 smithi133 ceph-mon[125939]: pgmap v7936: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 196 KiB/s wr, 9 op/s 2023-05-08T07:50:36.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14773.456605 secs 2023-05-08T07:50:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:35 smithi096 ceph-mon[124666]: pgmap v7936: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 196 KiB/s wr, 9 op/s 2023-05-08T07:50:36.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14774.739464 secs 2023-05-08T07:50:36.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14774.739464 secs 2023-05-08T07:50:37.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14774.739464 secs 2023-05-08T07:50:37.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:37 smithi186 ceph-mon[126480]: pgmap v7937: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 195 KiB/s wr, 9 op/s 2023-05-08T07:50:37.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:37 smithi133 ceph-mon[125939]: pgmap v7937: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 195 KiB/s wr, 9 op/s 2023-05-08T07:50:38.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:37 smithi096 ceph-mon[124666]: pgmap v7937: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 195 KiB/s wr, 9 op/s 2023-05-08T07:50:38.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14777.899174 secs 2023-05-08T07:50:39.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14777.899174 secs 2023-05-08T07:50:39.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14777.899174 secs 2023-05-08T07:50:39.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:39 smithi133 ceph-mon[125939]: pgmap v7938: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 195 KiB/s wr, 9 op/s 2023-05-08T07:50:40.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:39 smithi096 ceph-mon[124666]: pgmap v7938: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 195 KiB/s wr, 9 op/s 2023-05-08T07:50:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:39 smithi186 ceph-mon[126480]: pgmap v7938: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 195 KiB/s wr, 9 op/s 2023-05-08T07:50:40.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14778.456742 secs 2023-05-08T07:50:41.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14778.456742 secs 2023-05-08T07:50:41.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14778.456742 secs 2023-05-08T07:50:41.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14779.739599 secs 2023-05-08T07:50:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:41 smithi133 ceph-mon[125939]: pgmap v7939: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 122 KiB/s wr, 7 op/s 2023-05-08T07:50:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:41 smithi133 ceph-mon[125939]: osdmap e573: 12 total, 12 up, 12 in 2023-05-08T07:50:42.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14779.739599 secs 2023-05-08T07:50:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:41 smithi096 ceph-mon[124666]: pgmap v7939: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 122 KiB/s wr, 7 op/s 2023-05-08T07:50:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:41 smithi096 ceph-mon[124666]: osdmap e573: 12 total, 12 up, 12 in 2023-05-08T07:50:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14779.739599 secs 2023-05-08T07:50:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:41 smithi186 ceph-mon[126480]: pgmap v7939: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 122 KiB/s wr, 7 op/s 2023-05-08T07:50:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:41 smithi186 ceph-mon[126480]: osdmap e573: 12 total, 12 up, 12 in 2023-05-08T07:50:43.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:43 smithi133 ceph-mon[125939]: pgmap v7941: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 122 KiB/s wr, 7 op/s 2023-05-08T07:50:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14782.899311 secs 2023-05-08T07:50:44.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:43 smithi096 ceph-mon[124666]: pgmap v7941: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 122 KiB/s wr, 7 op/s 2023-05-08T07:50:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14782.899311 secs 2023-05-08T07:50:44.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:43 smithi186 ceph-mon[126480]: pgmap v7941: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 122 KiB/s wr, 7 op/s 2023-05-08T07:50:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14782.899311 secs 2023-05-08T07:50:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:45 smithi133 ceph-mon[125939]: pgmap v7942: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 144 KiB/s wr, 8 op/s 2023-05-08T07:50:46.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:45 smithi096 ceph-mon[124666]: pgmap v7942: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 144 KiB/s wr, 8 op/s 2023-05-08T07:50:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:45 smithi186 ceph-mon[126480]: pgmap v7942: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 144 KiB/s wr, 8 op/s 2023-05-08T07:50:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14784.739739 secs 2023-05-08T07:50:47.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14784.739739 secs 2023-05-08T07:50:47.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14784.739739 secs 2023-05-08T07:50:47.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:47 smithi133 ceph-mon[125939]: pgmap v7943: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 144 KiB/s wr, 8 op/s 2023-05-08T07:50:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:50:48.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:47 smithi096 ceph-mon[124666]: pgmap v7943: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 144 KiB/s wr, 8 op/s 2023-05-08T07:50:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:50:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:47 smithi186 ceph-mon[126480]: pgmap v7943: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 144 KiB/s wr, 8 op/s 2023-05-08T07:50:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:50:48.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:48 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:50:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:50:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:50:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14787.899379 secs 2023-05-08T07:50:49.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:48 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:50:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:50:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:50:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14787.899379 secs 2023-05-08T07:50:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:48 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:50:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:50:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:50:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14787.899379 secs 2023-05-08T07:50:49.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:49 smithi133 ceph-mon[125939]: pgmap v7944: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 144 KiB/s wr, 8 op/s 2023-05-08T07:50:50.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:49 smithi096 ceph-mon[124666]: pgmap v7944: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 144 KiB/s wr, 8 op/s 2023-05-08T07:50:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:49 smithi186 ceph-mon[126480]: pgmap v7944: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 144 KiB/s wr, 8 op/s 2023-05-08T07:50:51.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:51 smithi133 ceph-mon[125939]: pgmap v7945: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 308 KiB/s wr, 11 op/s 2023-05-08T07:50:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:50:52.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:51 smithi096 ceph-mon[124666]: pgmap v7945: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 308 KiB/s wr, 11 op/s 2023-05-08T07:50:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:50:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:51 smithi186 ceph-mon[126480]: pgmap v7945: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 308 KiB/s wr, 11 op/s 2023-05-08T07:50:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:50:52.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:50:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:50:53.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:50:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:50:53.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:50:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:50:53.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:53 smithi133 ceph-mon[125939]: pgmap v7946: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 282 KiB/s wr, 10 op/s 2023-05-08T07:50:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14792.899499 secs 2023-05-08T07:50:54.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:53 smithi096 ceph-mon[124666]: pgmap v7946: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 282 KiB/s wr, 10 op/s 2023-05-08T07:50:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14792.899499 secs 2023-05-08T07:50:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:53 smithi186 ceph-mon[126480]: pgmap v7946: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 282 KiB/s wr, 10 op/s 2023-05-08T07:50:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14792.899499 secs 2023-05-08T07:50:54.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:50:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:50:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:50:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:50:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:50:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:50:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:50:55.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:50:55.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:50:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:50:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:50:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:50:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:50:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:50:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:50:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:50:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:50:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:50:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:50:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:50:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:50:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14793.457094 secs 2023-05-08T07:50:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:55 smithi133 ceph-mon[125939]: pgmap v7947: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 365 KiB/s wr, 13 op/s 2023-05-08T07:50:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:55 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:50:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:55 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:50:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:55 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:50:56.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14793.457094 secs 2023-05-08T07:50:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:55 smithi096 ceph-mon[124666]: pgmap v7947: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 365 KiB/s wr, 13 op/s 2023-05-08T07:50:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:55 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:50:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:55 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:50:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:55 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:50:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14793.457094 secs 2023-05-08T07:50:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:55 smithi186 ceph-mon[126480]: pgmap v7947: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 365 KiB/s wr, 13 op/s 2023-05-08T07:50:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:55 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:50:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:55 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:50:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:55 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:50:56.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:56 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:50:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:56 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T07:50:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:56 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T07:50:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:56 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:50:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:56 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:50:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:50:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:50:57.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:56 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:50:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:56 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T07:50:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:56 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T07:50:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:56 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:50:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:56 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:50:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:50:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:50:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:56 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:50:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:56 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T07:50:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:56 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T07:50:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:56 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:50:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:56 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:50:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:50:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:50:57.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:57 smithi133 ceph-mon[125939]: pgmap v7948: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 345 KiB/s wr, 10 op/s 2023-05-08T07:50:58.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:57 smithi096 ceph-mon[124666]: pgmap v7948: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 345 KiB/s wr, 10 op/s 2023-05-08T07:50:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:57 smithi186 ceph-mon[126480]: pgmap v7948: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 345 KiB/s wr, 10 op/s 2023-05-08T07:50:58.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14797.899624 secs 2023-05-08T07:50:59.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14797.899624 secs 2023-05-08T07:50:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14797.899624 secs 2023-05-08T07:50:59.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:59 smithi133 ceph-mon[125939]: pgmap v7949: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 345 KiB/s wr, 10 op/s 2023-05-08T07:50:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:50:59 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:51:00.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:59 smithi096 ceph-mon[124666]: pgmap v7949: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 345 KiB/s wr, 10 op/s 2023-05-08T07:51:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:50:59 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:51:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:59 smithi186 ceph-mon[126480]: pgmap v7949: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 345 KiB/s wr, 10 op/s 2023-05-08T07:51:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:50:59 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:51:00.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:51:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:51:01.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:51:01.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:51:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:51:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:51:01.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14799.740025 secs 2023-05-08T07:51:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:01 smithi133 ceph-mon[125939]: pgmap v7950: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 568 KiB/s wr, 15 op/s 2023-05-08T07:51:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:01 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:51:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14799.740025 secs 2023-05-08T07:51:02.054 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:01 smithi096 ceph-mon[124666]: pgmap v7950: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 568 KiB/s wr, 15 op/s 2023-05-08T07:51:02.055 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:01 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:51:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14799.740025 secs 2023-05-08T07:51:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:01 smithi186 ceph-mon[126480]: pgmap v7950: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 568 KiB/s wr, 15 op/s 2023-05-08T07:51:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:01 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:51:03.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:03 smithi133 ceph-mon[125939]: pgmap v7951: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 331 KiB/s wr, 9 op/s 2023-05-08T07:51:03.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14802.899745 secs 2023-05-08T07:51:04.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:03 smithi096 ceph-mon[124666]: pgmap v7951: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 331 KiB/s wr, 9 op/s 2023-05-08T07:51:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14802.899745 secs 2023-05-08T07:51:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:03 smithi186 ceph-mon[126480]: pgmap v7951: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 331 KiB/s wr, 9 op/s 2023-05-08T07:51:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14802.899745 secs 2023-05-08T07:51:04.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:04 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:51:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:04 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:51:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14803.457299 secs 2023-05-08T07:51:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:04 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:51:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:04 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:51:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14803.457299 secs 2023-05-08T07:51:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:04 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:51:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:04 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:51:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14803.457299 secs 2023-05-08T07:51:05.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:05 smithi133 ceph-mon[125939]: pgmap v7952: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 377 KiB/s wr, 28 op/s 2023-05-08T07:51:06.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:05 smithi096 ceph-mon[124666]: pgmap v7952: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 377 KiB/s wr, 28 op/s 2023-05-08T07:51:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:05 smithi186 ceph-mon[126480]: pgmap v7952: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 377 KiB/s wr, 28 op/s 2023-05-08T07:51:06.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14804.740107 secs 2023-05-08T07:51:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:06 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:51:07.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14804.740107 secs 2023-05-08T07:51:07.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:06 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:51:07.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14804.740107 secs 2023-05-08T07:51:07.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:06 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:51:08.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:07 smithi096 ceph-mon[124666]: pgmap v7953: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 269 KiB/s wr, 23 op/s 2023-05-08T07:51:08.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:07 smithi186 ceph-mon[126480]: pgmap v7953: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 269 KiB/s wr, 23 op/s 2023-05-08T07:51:08.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:07 smithi133 ceph-mon[125939]: pgmap v7953: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 269 KiB/s wr, 23 op/s 2023-05-08T07:51:09.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:51:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:51:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14807.899864 secs 2023-05-08T07:51:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:51:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:51:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14807.899864 secs 2023-05-08T07:51:09.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:51:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:51:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14807.899864 secs 2023-05-08T07:51:10.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:09 smithi096 ceph-mon[124666]: pgmap v7954: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 269 KiB/s wr, 23 op/s 2023-05-08T07:51:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14808.457407 secs 2023-05-08T07:51:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:09 smithi186 ceph-mon[126480]: pgmap v7954: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 269 KiB/s wr, 23 op/s 2023-05-08T07:51:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14808.457407 secs 2023-05-08T07:51:10.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:09 smithi133 ceph-mon[125939]: pgmap v7954: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 269 KiB/s wr, 23 op/s 2023-05-08T07:51:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14808.457407 secs 2023-05-08T07:51:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14809.740226 secs 2023-05-08T07:51:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:11 smithi186 ceph-mon[126480]: pgmap v7955: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 292 KiB/s rd, 326 KiB/s wr, 27 op/s 2023-05-08T07:51:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:11 smithi186 ceph-mon[126480]: osdmap e574: 12 total, 12 up, 12 in 2023-05-08T07:51:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:11 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:51:12.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14809.740226 secs 2023-05-08T07:51:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:11 smithi133 ceph-mon[125939]: pgmap v7955: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 292 KiB/s rd, 326 KiB/s wr, 27 op/s 2023-05-08T07:51:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:11 smithi133 ceph-mon[125939]: osdmap e574: 12 total, 12 up, 12 in 2023-05-08T07:51:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:11 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:51:12.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14809.740226 secs 2023-05-08T07:51:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:11 smithi096 ceph-mon[124666]: pgmap v7955: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 292 KiB/s rd, 326 KiB/s wr, 27 op/s 2023-05-08T07:51:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:11 smithi096 ceph-mon[124666]: osdmap e574: 12 total, 12 up, 12 in 2023-05-08T07:51:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:11 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:51:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:13 smithi186 ceph-mon[126480]: pgmap v7957: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 123 KiB/s wr, 26 op/s 2023-05-08T07:51:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14812.899986 secs 2023-05-08T07:51:14.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:13 smithi133 ceph-mon[125939]: pgmap v7957: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 123 KiB/s wr, 26 op/s 2023-05-08T07:51:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14812.899986 secs 2023-05-08T07:51:14.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:13 smithi096 ceph-mon[124666]: pgmap v7957: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 123 KiB/s wr, 26 op/s 2023-05-08T07:51:14.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14812.899986 secs 2023-05-08T07:51:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14813.457521 secs 2023-05-08T07:51:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14813.457521 secs 2023-05-08T07:51:15.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14813.457521 secs 2023-05-08T07:51:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:15 smithi186 ceph-mon[126480]: pgmap v7958: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 158 KiB/s wr, 9 op/s 2023-05-08T07:51:16.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:15 smithi133 ceph-mon[125939]: pgmap v7958: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 158 KiB/s wr, 9 op/s 2023-05-08T07:51:16.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:15 smithi096 ceph-mon[124666]: pgmap v7958: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 158 KiB/s wr, 9 op/s 2023-05-08T07:51:17.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14814.740344 secs 2023-05-08T07:51:17.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14814.740344 secs 2023-05-08T07:51:17.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14814.740344 secs 2023-05-08T07:51:18.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:17 smithi186 ceph-mon[126480]: pgmap v7959: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 158 KiB/s wr, 9 op/s 2023-05-08T07:51:18.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:17 smithi133 ceph-mon[125939]: pgmap v7959: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 158 KiB/s wr, 9 op/s 2023-05-08T07:51:18.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:17 smithi096 ceph-mon[124666]: pgmap v7959: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 158 KiB/s wr, 9 op/s 2023-05-08T07:51:19.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14817.900104 secs 2023-05-08T07:51:19.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14817.900104 secs 2023-05-08T07:51:19.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14817.900104 secs 2023-05-08T07:51:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:19 smithi186 ceph-mon[126480]: pgmap v7960: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 158 KiB/s wr, 9 op/s 2023-05-08T07:51:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14818.457636 secs 2023-05-08T07:51:20.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:19 smithi133 ceph-mon[125939]: pgmap v7960: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 158 KiB/s wr, 9 op/s 2023-05-08T07:51:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14818.457636 secs 2023-05-08T07:51:20.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:19 smithi096 ceph-mon[124666]: pgmap v7960: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 158 KiB/s wr, 9 op/s 2023-05-08T07:51:20.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14818.457636 secs 2023-05-08T07:51:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14819.740464 secs 2023-05-08T07:51:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:21 smithi186 ceph-mon[126480]: pgmap v7961: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 128 KiB/s wr, 9 op/s 2023-05-08T07:51:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:21 smithi186 ceph-mon[126480]: osdmap e575: 12 total, 12 up, 12 in 2023-05-08T07:51:22.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14819.740464 secs 2023-05-08T07:51:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:21 smithi133 ceph-mon[125939]: pgmap v7961: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 128 KiB/s wr, 9 op/s 2023-05-08T07:51:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:21 smithi133 ceph-mon[125939]: osdmap e575: 12 total, 12 up, 12 in 2023-05-08T07:51:22.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14819.740464 secs 2023-05-08T07:51:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:21 smithi096 ceph-mon[124666]: pgmap v7961: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 128 KiB/s wr, 9 op/s 2023-05-08T07:51:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:21 smithi096 ceph-mon[124666]: osdmap e575: 12 total, 12 up, 12 in 2023-05-08T07:51:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:23 smithi186 ceph-mon[126480]: pgmap v7963: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 128 KiB/s wr, 9 op/s 2023-05-08T07:51:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14822.900227 secs 2023-05-08T07:51:24.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:23 smithi133 ceph-mon[125939]: pgmap v7963: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 128 KiB/s wr, 9 op/s 2023-05-08T07:51:24.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14822.900227 secs 2023-05-08T07:51:24.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:23 smithi096 ceph-mon[124666]: pgmap v7963: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 128 KiB/s wr, 9 op/s 2023-05-08T07:51:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14822.900227 secs 2023-05-08T07:51:25.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14823.457756 secs 2023-05-08T07:51:25.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14823.457756 secs 2023-05-08T07:51:25.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14823.457756 secs 2023-05-08T07:51:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:25 smithi186 ceph-mon[126480]: pgmap v7964: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 95 KiB/s wr, 8 op/s 2023-05-08T07:51:26.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:25 smithi133 ceph-mon[125939]: pgmap v7964: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 95 KiB/s wr, 8 op/s 2023-05-08T07:51:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:25 smithi096 ceph-mon[124666]: pgmap v7964: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 95 KiB/s wr, 8 op/s 2023-05-08T07:51:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14824.740578 secs 2023-05-08T07:51:27.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14824.740578 secs 2023-05-08T07:51:27.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14824.740578 secs 2023-05-08T07:51:28.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:27 smithi186 ceph-mon[126480]: pgmap v7965: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 95 KiB/s wr, 8 op/s 2023-05-08T07:51:28.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:27 smithi133 ceph-mon[125939]: pgmap v7965: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 95 KiB/s wr, 8 op/s 2023-05-08T07:51:28.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:27 smithi096 ceph-mon[124666]: pgmap v7965: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 95 KiB/s wr, 8 op/s 2023-05-08T07:51:29.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14827.900364 secs 2023-05-08T07:51:29.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14827.900364 secs 2023-05-08T07:51:29.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14827.900364 secs 2023-05-08T07:51:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:29 smithi186 ceph-mon[126480]: pgmap v7966: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 95 KiB/s wr, 8 op/s 2023-05-08T07:51:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14828.457876 secs 2023-05-08T07:51:30.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:29 smithi133 ceph-mon[125939]: pgmap v7966: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 95 KiB/s wr, 8 op/s 2023-05-08T07:51:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14828.457876 secs 2023-05-08T07:51:30.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:29 smithi096 ceph-mon[124666]: pgmap v7966: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 95 KiB/s wr, 8 op/s 2023-05-08T07:51:30.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14828.457876 secs 2023-05-08T07:51:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14829.740697 secs 2023-05-08T07:51:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:31 smithi186 ceph-mon[126480]: pgmap v7967: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 8 op/s 2023-05-08T07:51:32.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14829.740697 secs 2023-05-08T07:51:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:31 smithi133 ceph-mon[125939]: pgmap v7967: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 8 op/s 2023-05-08T07:51:32.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14829.740697 secs 2023-05-08T07:51:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:31 smithi096 ceph-mon[124666]: pgmap v7967: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 8 op/s 2023-05-08T07:51:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:33 smithi186 ceph-mon[126480]: pgmap v7968: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 53 KiB/s wr, 7 op/s 2023-05-08T07:51:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14832.900499 secs 2023-05-08T07:51:34.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:33 smithi133 ceph-mon[125939]: pgmap v7968: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 53 KiB/s wr, 7 op/s 2023-05-08T07:51:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14832.900499 secs 2023-05-08T07:51:34.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:33 smithi096 ceph-mon[124666]: pgmap v7968: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 53 KiB/s wr, 7 op/s 2023-05-08T07:51:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14832.900499 secs 2023-05-08T07:51:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14833.457993 secs 2023-05-08T07:51:35.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14833.457993 secs 2023-05-08T07:51:35.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14833.457993 secs 2023-05-08T07:51:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:35 smithi186 ceph-mon[126480]: pgmap v7969: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 95 KiB/s wr, 9 op/s 2023-05-08T07:51:36.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:35 smithi133 ceph-mon[125939]: pgmap v7969: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 95 KiB/s wr, 9 op/s 2023-05-08T07:51:36.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:35 smithi096 ceph-mon[124666]: pgmap v7969: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 95 KiB/s wr, 9 op/s 2023-05-08T07:51:37.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14834.740844 secs 2023-05-08T07:51:37.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14834.740844 secs 2023-05-08T07:51:37.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14834.740844 secs 2023-05-08T07:51:38.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:37 smithi186 ceph-mon[126480]: pgmap v7970: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 48 KiB/s wr, 6 op/s 2023-05-08T07:51:38.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:37 smithi133 ceph-mon[125939]: pgmap v7970: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 48 KiB/s wr, 6 op/s 2023-05-08T07:51:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:37 smithi096 ceph-mon[124666]: pgmap v7970: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 48 KiB/s wr, 6 op/s 2023-05-08T07:51:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:39 smithi186 ceph-mon[126480]: pgmap v7971: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 48 KiB/s wr, 6 op/s 2023-05-08T07:51:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14838.458114 secs 2023-05-08T07:51:40.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:39 smithi133 ceph-mon[125939]: pgmap v7971: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 48 KiB/s wr, 6 op/s 2023-05-08T07:51:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14838.458114 secs 2023-05-08T07:51:40.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:39 smithi096 ceph-mon[124666]: pgmap v7971: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 48 KiB/s wr, 6 op/s 2023-05-08T07:51:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14838.458114 secs 2023-05-08T07:51:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14839.740908 secs 2023-05-08T07:51:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:41 smithi186 ceph-mon[126480]: pgmap v7972: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 57 KiB/s wr, 9 op/s 2023-05-08T07:51:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:41 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:51:42.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14839.740908 secs 2023-05-08T07:51:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:41 smithi133 ceph-mon[125939]: pgmap v7972: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 57 KiB/s wr, 9 op/s 2023-05-08T07:51:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:41 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:51:42.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14839.740908 secs 2023-05-08T07:51:42.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:41 smithi096 ceph-mon[124666]: pgmap v7972: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 57 KiB/s wr, 9 op/s 2023-05-08T07:51:42.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:41 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:51:43.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:42 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:51:43.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:42 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T07:51:43.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:42 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:51:43.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:42 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:51:43.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:42 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T07:51:43.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:42 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:51:43.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:42 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:51:43.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:42 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T07:51:43.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:42 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:51:44.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:43 smithi186 ceph-mon[126480]: pgmap v7973: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 57 KiB/s wr, 6 op/s 2023-05-08T07:51:44.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:43 smithi133 ceph-mon[125939]: pgmap v7973: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 57 KiB/s wr, 6 op/s 2023-05-08T07:51:44.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:43 smithi096 ceph-mon[124666]: pgmap v7973: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 57 KiB/s wr, 6 op/s 2023-05-08T07:51:45.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14843.458251 secs 2023-05-08T07:51:45.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14843.458251 secs 2023-05-08T07:51:45.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14843.458251 secs 2023-05-08T07:51:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:45 smithi186 ceph-mon[126480]: pgmap v7974: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 160 KiB/s wr, 10 op/s 2023-05-08T07:51:46.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:45 smithi133 ceph-mon[125939]: pgmap v7974: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 160 KiB/s wr, 10 op/s 2023-05-08T07:51:46.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:45 smithi096 ceph-mon[124666]: pgmap v7974: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 160 KiB/s wr, 10 op/s 2023-05-08T07:51:47.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14844.741047 secs 2023-05-08T07:51:47.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14844.741047 secs 2023-05-08T07:51:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14844.741047 secs 2023-05-08T07:51:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:47 smithi186 ceph-mon[126480]: pgmap v7975: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 113 KiB/s wr, 7 op/s 2023-05-08T07:51:48.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:47 smithi133 ceph-mon[125939]: pgmap v7975: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 113 KiB/s wr, 7 op/s 2023-05-08T07:51:48.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:47 smithi096 ceph-mon[124666]: pgmap v7975: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 113 KiB/s wr, 7 op/s 2023-05-08T07:51:49.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14847.900847 secs 2023-05-08T07:51:49.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14847.900847 secs 2023-05-08T07:51:49.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14847.900847 secs 2023-05-08T07:51:50.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:49 smithi133 ceph-mon[125939]: pgmap v7976: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 113 KiB/s wr, 7 op/s 2023-05-08T07:51:50.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:49 smithi096 ceph-mon[124666]: pgmap v7976: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 113 KiB/s wr, 7 op/s 2023-05-08T07:51:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:49 smithi186 ceph-mon[126480]: pgmap v7976: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 113 KiB/s wr, 7 op/s 2023-05-08T07:51:51.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:50 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:51:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T07:51:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:51:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:50 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:51:51.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:50 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:51:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T07:51:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:51:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:50 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:51:51.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:50 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:51:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T07:51:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:51:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:50 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:51:52.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14849.741114 secs 2023-05-08T07:51:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:51 smithi133 ceph-mon[125939]: pgmap v7977: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 209 KiB/s wr, 11 op/s 2023-05-08T07:51:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:51:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:51:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14849.741114 secs 2023-05-08T07:51:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:51 smithi096 ceph-mon[124666]: pgmap v7977: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 209 KiB/s wr, 11 op/s 2023-05-08T07:51:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:51:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:51:52.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14849.741114 secs 2023-05-08T07:51:52.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:51 smithi186 ceph-mon[126480]: pgmap v7977: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 209 KiB/s wr, 11 op/s 2023-05-08T07:51:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:51:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:51:54.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:53 smithi133 ceph-mon[125939]: pgmap v7978: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 200 KiB/s wr, 7 op/s 2023-05-08T07:51:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14852.900964 secs 2023-05-08T07:51:54.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:53 smithi096 ceph-mon[124666]: pgmap v7978: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 200 KiB/s wr, 7 op/s 2023-05-08T07:51:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14852.900964 secs 2023-05-08T07:51:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:53 smithi186 ceph-mon[126480]: pgmap v7978: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 200 KiB/s wr, 7 op/s 2023-05-08T07:51:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14852.900964 secs 2023-05-08T07:51:56.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:55 smithi133 ceph-mon[125939]: pgmap v7979: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 338 KiB/s wr, 13 op/s 2023-05-08T07:51:56.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:55 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:51:56.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:55 smithi096 ceph-mon[124666]: pgmap v7979: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 338 KiB/s wr, 13 op/s 2023-05-08T07:51:56.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:55 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:51:56.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:55 smithi186 ceph-mon[126480]: pgmap v7979: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 338 KiB/s wr, 13 op/s 2023-05-08T07:51:56.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:55 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:51:57.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:51:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:51:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:51:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:56 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:51:57.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:51:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:51:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:51:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:56 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:51:57.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:51:57.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:51:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:51:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:56 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:51:58.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:57 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:51:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:57 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T07:51:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:57 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T07:51:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:57 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:51:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:57 smithi133 ceph-mon[125939]: pgmap v7980: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 234 KiB/s wr, 9 op/s 2023-05-08T07:51:58.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:57 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:51:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:57 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T07:51:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:57 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T07:51:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:57 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:51:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:57 smithi096 ceph-mon[124666]: pgmap v7980: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 234 KiB/s wr, 9 op/s 2023-05-08T07:51:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:57 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:51:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:57 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T07:51:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:57 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T07:51:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:57 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:51:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:57 smithi186 ceph-mon[126480]: pgmap v7980: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 234 KiB/s wr, 9 op/s 2023-05-08T07:51:59.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14857.901061 secs 2023-05-08T07:51:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:58 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:51:59.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14857.901061 secs 2023-05-08T07:51:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:58 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:51:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14857.901061 secs 2023-05-08T07:51:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:58 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:52:00.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:59 smithi133 ceph-mon[125939]: pgmap v7981: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 234 KiB/s wr, 9 op/s 2023-05-08T07:52:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14858.458578 secs 2023-05-08T07:52:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:59 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:52:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:59 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:52:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:51:59 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:52:00.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:59 smithi096 ceph-mon[124666]: pgmap v7981: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 234 KiB/s wr, 9 op/s 2023-05-08T07:52:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14858.458578 secs 2023-05-08T07:52:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:59 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:52:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:59 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:52:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:51:59 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:52:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:59 smithi186 ceph-mon[126480]: pgmap v7981: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 234 KiB/s wr, 9 op/s 2023-05-08T07:52:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14858.458578 secs 2023-05-08T07:52:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:59 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:52:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:59 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:52:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:51:59 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:52:02.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:01 smithi133 ceph-mon[125939]: pgmap v7982: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 361 KiB/s wr, 14 op/s 2023-05-08T07:52:02.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:01 smithi096 ceph-mon[124666]: pgmap v7982: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 361 KiB/s wr, 14 op/s 2023-05-08T07:52:02.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:01 smithi186 ceph-mon[126480]: pgmap v7982: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 361 KiB/s wr, 14 op/s 2023-05-08T07:52:04.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:03 smithi133 ceph-mon[125939]: pgmap v7983: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 265 KiB/s wr, 10 op/s 2023-05-08T07:52:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14862.901185 secs 2023-05-08T07:52:04.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:03 smithi096 ceph-mon[124666]: pgmap v7983: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 265 KiB/s wr, 10 op/s 2023-05-08T07:52:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14862.901185 secs 2023-05-08T07:52:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:03 smithi186 ceph-mon[126480]: pgmap v7983: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 265 KiB/s wr, 10 op/s 2023-05-08T07:52:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14862.901185 secs 2023-05-08T07:52:05.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14863.458656 secs 2023-05-08T07:52:05.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14863.458656 secs 2023-05-08T07:52:05.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14863.458656 secs 2023-05-08T07:52:06.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:05 smithi133 ceph-mon[125939]: pgmap v7984: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 425 KiB/s wr, 27 op/s 2023-05-08T07:52:06.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:05 smithi096 ceph-mon[124666]: pgmap v7984: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 425 KiB/s wr, 27 op/s 2023-05-08T07:52:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:05 smithi186 ceph-mon[126480]: pgmap v7984: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 425 KiB/s wr, 27 op/s 2023-05-08T07:52:08.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:07 smithi133 ceph-mon[125939]: pgmap v7985: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 287 KiB/s wr, 22 op/s 2023-05-08T07:52:08.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:07 smithi096 ceph-mon[124666]: pgmap v7985: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 287 KiB/s wr, 22 op/s 2023-05-08T07:52:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:07 smithi186 ceph-mon[126480]: pgmap v7985: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 287 KiB/s wr, 22 op/s 2023-05-08T07:52:09.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14867.901302 secs 2023-05-08T07:52:09.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14867.901302 secs 2023-05-08T07:52:09.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14867.901302 secs 2023-05-08T07:52:10.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:09 smithi133 ceph-mon[125939]: pgmap v7986: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 287 KiB/s wr, 22 op/s 2023-05-08T07:52:10.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:09 smithi096 ceph-mon[124666]: pgmap v7986: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 287 KiB/s wr, 22 op/s 2023-05-08T07:52:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:09 smithi186 ceph-mon[126480]: pgmap v7986: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 287 KiB/s wr, 22 op/s 2023-05-08T07:52:11.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:10 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:52:11.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:10 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:52:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:10 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:52:12.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:11 smithi133 ceph-mon[125939]: pgmap v7987: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 390 KiB/s wr, 26 op/s 2023-05-08T07:52:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:11 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:52:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:11 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:52:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:11 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:52:12.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:11 smithi096 ceph-mon[124666]: pgmap v7987: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 390 KiB/s wr, 26 op/s 2023-05-08T07:52:12.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:11 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:52:12.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:11 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:52:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:11 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:52:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:11 smithi186 ceph-mon[126480]: pgmap v7987: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 390 KiB/s wr, 26 op/s 2023-05-08T07:52:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:11 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:52:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:11 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:52:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:11 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:52:14.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:13 smithi133 ceph-mon[125939]: pgmap v7988: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 264 KiB/s wr, 21 op/s 2023-05-08T07:52:14.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14872.901398 secs 2023-05-08T07:52:14.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:13 smithi096 ceph-mon[124666]: pgmap v7988: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 264 KiB/s wr, 21 op/s 2023-05-08T07:52:14.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14872.901398 secs 2023-05-08T07:52:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:13 smithi186 ceph-mon[126480]: pgmap v7988: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 264 KiB/s wr, 21 op/s 2023-05-08T07:52:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14872.901398 secs 2023-05-08T07:52:16.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:15 smithi133 ceph-mon[125939]: pgmap v7989: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 296 KiB/s wr, 24 op/s 2023-05-08T07:52:16.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:15 smithi096 ceph-mon[124666]: pgmap v7989: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 296 KiB/s wr, 24 op/s 2023-05-08T07:52:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:15 smithi186 ceph-mon[126480]: pgmap v7989: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 296 KiB/s wr, 24 op/s 2023-05-08T07:52:18.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:17 smithi133 ceph-mon[125939]: pgmap v7990: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 136 KiB/s wr, 7 op/s 2023-05-08T07:52:18.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:17 smithi096 ceph-mon[124666]: pgmap v7990: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 136 KiB/s wr, 7 op/s 2023-05-08T07:52:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:17 smithi186 ceph-mon[126480]: pgmap v7990: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 136 KiB/s wr, 7 op/s 2023-05-08T07:52:19.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14877.901520 secs 2023-05-08T07:52:19.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14877.901520 secs 2023-05-08T07:52:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14877.901520 secs 2023-05-08T07:52:20.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:19 smithi133 ceph-mon[125939]: pgmap v7991: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 136 KiB/s wr, 7 op/s 2023-05-08T07:52:20.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:19 smithi096 ceph-mon[124666]: pgmap v7991: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 136 KiB/s wr, 7 op/s 2023-05-08T07:52:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:19 smithi186 ceph-mon[126480]: pgmap v7991: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 136 KiB/s wr, 7 op/s 2023-05-08T07:52:22.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:21 smithi133 ceph-mon[125939]: pgmap v7992: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 136 KiB/s wr, 10 op/s 2023-05-08T07:52:22.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:21 smithi096 ceph-mon[124666]: pgmap v7992: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 136 KiB/s wr, 10 op/s 2023-05-08T07:52:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:21 smithi186 ceph-mon[126480]: pgmap v7992: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 136 KiB/s wr, 10 op/s 2023-05-08T07:52:24.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:23 smithi133 ceph-mon[125939]: pgmap v7993: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T07:52:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14882.901637 secs 2023-05-08T07:52:24.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:23 smithi096 ceph-mon[124666]: pgmap v7993: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T07:52:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14882.901637 secs 2023-05-08T07:52:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:23 smithi186 ceph-mon[126480]: pgmap v7993: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 33 KiB/s wr, 6 op/s 2023-05-08T07:52:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14882.901637 secs 2023-05-08T07:52:25.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14883.459114 secs 2023-05-08T07:52:25.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14883.459114 secs 2023-05-08T07:52:25.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14883.459114 secs 2023-05-08T07:52:26.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:25 smithi133 ceph-mon[125939]: pgmap v7994: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 260 KiB/s wr, 13 op/s 2023-05-08T07:52:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14884.741895 secs 2023-05-08T07:52:26.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:25 smithi096 ceph-mon[124666]: pgmap v7994: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 260 KiB/s wr, 13 op/s 2023-05-08T07:52:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14884.741895 secs 2023-05-08T07:52:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:25 smithi186 ceph-mon[126480]: pgmap v7994: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 260 KiB/s wr, 13 op/s 2023-05-08T07:52:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14884.741895 secs 2023-05-08T07:52:27.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:26 smithi133 ceph-mon[125939]: osdmap e576: 12 total, 12 up, 12 in 2023-05-08T07:52:27.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:26 smithi096 ceph-mon[124666]: osdmap e576: 12 total, 12 up, 12 in 2023-05-08T07:52:27.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:26 smithi186 ceph-mon[126480]: osdmap e576: 12 total, 12 up, 12 in 2023-05-08T07:52:28.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:27 smithi133 ceph-mon[125939]: pgmap v7996: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 273 KiB/s wr, 11 op/s 2023-05-08T07:52:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:27 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:52:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:27 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:52:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:27 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:52:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:27 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:52:28.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:27 smithi096 ceph-mon[124666]: pgmap v7996: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 273 KiB/s wr, 11 op/s 2023-05-08T07:52:28.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:27 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:52:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:27 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:52:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:27 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:52:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:27 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:52:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:27 smithi186 ceph-mon[126480]: pgmap v7996: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 273 KiB/s wr, 11 op/s 2023-05-08T07:52:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:27 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:52:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:27 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:52:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:27 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:52:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:27 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:52:29.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14887.901760 secs 2023-05-08T07:52:29.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14887.901760 secs 2023-05-08T07:52:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14887.901760 secs 2023-05-08T07:52:30.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:29 smithi133 ceph-mon[125939]: pgmap v7997: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 273 KiB/s wr, 11 op/s 2023-05-08T07:52:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14888.459234 secs 2023-05-08T07:52:30.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:29 smithi096 ceph-mon[124666]: pgmap v7997: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 273 KiB/s wr, 11 op/s 2023-05-08T07:52:30.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14888.459234 secs 2023-05-08T07:52:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:29 smithi186 ceph-mon[126480]: pgmap v7997: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 273 KiB/s wr, 11 op/s 2023-05-08T07:52:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14888.459234 secs 2023-05-08T07:52:31.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14889.741994 secs 2023-05-08T07:52:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14889.741994 secs 2023-05-08T07:52:31.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14889.741994 secs 2023-05-08T07:52:32.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:31 smithi096 ceph-mon[124666]: pgmap v7998: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 395 KiB/s wr, 12 op/s 2023-05-08T07:52:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:31 smithi186 ceph-mon[126480]: pgmap v7998: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 395 KiB/s wr, 12 op/s 2023-05-08T07:52:32.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:31 smithi133 ceph-mon[125939]: pgmap v7998: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 395 KiB/s wr, 12 op/s 2023-05-08T07:52:33.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:32 smithi096 ceph-mon[124666]: pgmap v7999: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 395 KiB/s wr, 12 op/s 2023-05-08T07:52:33.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:32 smithi186 ceph-mon[126480]: pgmap v7999: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 395 KiB/s wr, 12 op/s 2023-05-08T07:52:33.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:32 smithi133 ceph-mon[125939]: pgmap v7999: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 395 KiB/s wr, 12 op/s 2023-05-08T07:52:34.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14892.901876 secs 2023-05-08T07:52:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14892.901876 secs 2023-05-08T07:52:34.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14892.901876 secs 2023-05-08T07:52:35.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14893.459309 secs 2023-05-08T07:52:35.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:35 smithi186 ceph-mon[126480]: pgmap v8000: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 123 KiB/s wr, 8 op/s 2023-05-08T07:52:35.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14893.459309 secs 2023-05-08T07:52:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:35 smithi133 ceph-mon[125939]: pgmap v8000: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 123 KiB/s wr, 8 op/s 2023-05-08T07:52:35.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14893.459309 secs 2023-05-08T07:52:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:35 smithi096 ceph-mon[124666]: pgmap v8000: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 123 KiB/s wr, 8 op/s 2023-05-08T07:52:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14894.742057 secs 2023-05-08T07:52:36.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14894.742057 secs 2023-05-08T07:52:36.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14894.742057 secs 2023-05-08T07:52:37.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:37 smithi186 ceph-mon[126480]: pgmap v8001: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 117 KiB/s wr, 8 op/s 2023-05-08T07:52:37.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:37 smithi186 ceph-mon[126480]: osdmap e577: 12 total, 12 up, 12 in 2023-05-08T07:52:37.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:37 smithi133 ceph-mon[125939]: pgmap v8001: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 117 KiB/s wr, 8 op/s 2023-05-08T07:52:37.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:37 smithi133 ceph-mon[125939]: osdmap e577: 12 total, 12 up, 12 in 2023-05-08T07:52:38.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:37 smithi096 ceph-mon[124666]: pgmap v8001: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 117 KiB/s wr, 8 op/s 2023-05-08T07:52:38.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:37 smithi096 ceph-mon[124666]: osdmap e577: 12 total, 12 up, 12 in 2023-05-08T07:52:38.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14897.902012 secs 2023-05-08T07:52:38.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14897.902012 secs 2023-05-08T07:52:39.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14897.902012 secs 2023-05-08T07:52:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:39 smithi186 ceph-mon[126480]: pgmap v8003: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 123 KiB/s wr, 8 op/s 2023-05-08T07:52:39.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:39 smithi133 ceph-mon[125939]: pgmap v8003: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 123 KiB/s wr, 8 op/s 2023-05-08T07:52:40.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:39 smithi096 ceph-mon[124666]: pgmap v8003: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 123 KiB/s wr, 8 op/s 2023-05-08T07:52:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14898.459450 secs 2023-05-08T07:52:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14899.742176 secs 2023-05-08T07:52:40.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14898.459450 secs 2023-05-08T07:52:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14899.742176 secs 2023-05-08T07:52:41.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14898.459450 secs 2023-05-08T07:52:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14899.742176 secs 2023-05-08T07:52:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:41 smithi186 ceph-mon[126480]: pgmap v8004: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 200 KiB/s wr, 7 op/s 2023-05-08T07:52:41.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:41 smithi133 ceph-mon[125939]: pgmap v8004: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 200 KiB/s wr, 7 op/s 2023-05-08T07:52:42.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:41 smithi096 ceph-mon[124666]: pgmap v8004: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 200 KiB/s wr, 7 op/s 2023-05-08T07:52:43.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:43 smithi186 ceph-mon[126480]: pgmap v8005: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 200 KiB/s wr, 7 op/s 2023-05-08T07:52:43.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14902.902124 secs 2023-05-08T07:52:43.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:43 smithi133 ceph-mon[125939]: pgmap v8005: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 200 KiB/s wr, 7 op/s 2023-05-08T07:52:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14902.902124 secs 2023-05-08T07:52:44.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:43 smithi096 ceph-mon[124666]: pgmap v8005: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 200 KiB/s wr, 7 op/s 2023-05-08T07:52:44.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14902.902124 secs 2023-05-08T07:52:45.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:45 smithi133 ceph-mon[125939]: pgmap v8006: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 223 KiB/s wr, 9 op/s 2023-05-08T07:52:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14904.742294 secs 2023-05-08T07:52:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:45 smithi096 ceph-mon[124666]: pgmap v8006: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 223 KiB/s wr, 9 op/s 2023-05-08T07:52:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14904.742294 secs 2023-05-08T07:52:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:45 smithi186 ceph-mon[126480]: pgmap v8006: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 223 KiB/s wr, 9 op/s 2023-05-08T07:52:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14904.742294 secs 2023-05-08T07:52:47.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:47 smithi133 ceph-mon[125939]: pgmap v8007: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 223 KiB/s wr, 9 op/s 2023-05-08T07:52:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:52:48.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:47 smithi096 ceph-mon[124666]: pgmap v8007: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 223 KiB/s wr, 9 op/s 2023-05-08T07:52:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:52:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:47 smithi186 ceph-mon[126480]: pgmap v8007: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 223 KiB/s wr, 9 op/s 2023-05-08T07:52:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:52:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:48 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:52:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:52:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:52:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14907.902277 secs 2023-05-08T07:52:49.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:48 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:52:49.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:52:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:52:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14907.902277 secs 2023-05-08T07:52:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:48 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:52:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:52:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:52:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14907.902277 secs 2023-05-08T07:52:49.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:49 smithi133 ceph-mon[125939]: pgmap v8008: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 187 KiB/s wr, 8 op/s 2023-05-08T07:52:50.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:49 smithi096 ceph-mon[124666]: pgmap v8008: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 187 KiB/s wr, 8 op/s 2023-05-08T07:52:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:49 smithi186 ceph-mon[126480]: pgmap v8008: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 187 KiB/s wr, 8 op/s 2023-05-08T07:52:51.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:51 smithi133 ceph-mon[125939]: pgmap v8009: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 364 KiB/s wr, 12 op/s 2023-05-08T07:52:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:52:52.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:51 smithi096 ceph-mon[124666]: pgmap v8009: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 364 KiB/s wr, 12 op/s 2023-05-08T07:52:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:52:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:51 smithi186 ceph-mon[126480]: pgmap v8009: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 364 KiB/s wr, 12 op/s 2023-05-08T07:52:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:52:52.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:52:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:52:53.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:52:53.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:52:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:52:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:52:53.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:53 smithi133 ceph-mon[125939]: pgmap v8010: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 199 KiB/s wr, 9 op/s 2023-05-08T07:52:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14912.902401 secs 2023-05-08T07:52:54.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:53 smithi096 ceph-mon[124666]: pgmap v8010: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 199 KiB/s wr, 9 op/s 2023-05-08T07:52:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14912.902401 secs 2023-05-08T07:52:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:53 smithi186 ceph-mon[126480]: pgmap v8010: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 199 KiB/s wr, 9 op/s 2023-05-08T07:52:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14912.902401 secs 2023-05-08T07:52:54.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14913.459796 secs 2023-05-08T07:52:55.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14913.459796 secs 2023-05-08T07:52:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14913.459796 secs 2023-05-08T07:52:55.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:55 smithi133 ceph-mon[125939]: pgmap v8011: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 372 KiB/s wr, 14 op/s 2023-05-08T07:52:56.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:55 smithi096 ceph-mon[124666]: pgmap v8011: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 372 KiB/s wr, 14 op/s 2023-05-08T07:52:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:55 smithi186 ceph-mon[126480]: pgmap v8011: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 372 KiB/s wr, 14 op/s 2023-05-08T07:52:56.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:56 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:52:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:52:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:52:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:52:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:56 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:52:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:52:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:52:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:52:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:56 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:52:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:52:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:52:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:52:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:57 smithi133 ceph-mon[125939]: pgmap v8012: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 352 KiB/s wr, 9 op/s 2023-05-08T07:52:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:52:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:52:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:57 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:52:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:52:57.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:57 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T07:52:57.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:57 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T07:52:57.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:57 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:52:58.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:57 smithi096 ceph-mon[124666]: pgmap v8012: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 352 KiB/s wr, 9 op/s 2023-05-08T07:52:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:52:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:52:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:57 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:52:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:52:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:57 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T07:52:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:57 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T07:52:58.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:57 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:52:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:57 smithi186 ceph-mon[126480]: pgmap v8012: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 352 KiB/s wr, 9 op/s 2023-05-08T07:52:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:52:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:52:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:57 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:52:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:52:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:57 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T07:52:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:57 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T07:52:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:57 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:52:58.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14917.902517 secs 2023-05-08T07:52:59.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14917.902517 secs 2023-05-08T07:52:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14917.902517 secs 2023-05-08T07:52:59.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:59 smithi133 ceph-mon[125939]: pgmap v8013: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 352 KiB/s wr, 9 op/s 2023-05-08T07:52:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:52:59 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:53:00.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:59 smithi096 ceph-mon[124666]: pgmap v8013: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 352 KiB/s wr, 9 op/s 2023-05-08T07:53:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:52:59 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:53:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:59 smithi186 ceph-mon[126480]: pgmap v8013: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 352 KiB/s wr, 9 op/s 2023-05-08T07:53:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:52:59 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:53:00.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:53:00.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:53:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14919.742659 secs 2023-05-08T07:53:01.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:53:01.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:53:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14919.742659 secs 2023-05-08T07:53:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:53:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:53:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14919.742659 secs 2023-05-08T07:53:01.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:01 smithi133 ceph-mon[125939]: pgmap v8014: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 516 KiB/s wr, 14 op/s 2023-05-08T07:53:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:01 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:53:02.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:01 smithi096 ceph-mon[124666]: pgmap v8014: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 516 KiB/s wr, 14 op/s 2023-05-08T07:53:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:01 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:53:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:01 smithi186 ceph-mon[126480]: pgmap v8014: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 516 KiB/s wr, 14 op/s 2023-05-08T07:53:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:01 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:53:03.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:03 smithi133 ceph-mon[125939]: pgmap v8015: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 338 KiB/s wr, 10 op/s 2023-05-08T07:53:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14922.902636 secs 2023-05-08T07:53:04.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:03 smithi096 ceph-mon[124666]: pgmap v8015: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 338 KiB/s wr, 10 op/s 2023-05-08T07:53:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14922.902636 secs 2023-05-08T07:53:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:03 smithi186 ceph-mon[126480]: pgmap v8015: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 338 KiB/s wr, 10 op/s 2023-05-08T07:53:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14922.902636 secs 2023-05-08T07:53:04.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:04 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:53:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:04 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:53:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14923.459974 secs 2023-05-08T07:53:05.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:04 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:53:05.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:04 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:53:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14923.459974 secs 2023-05-08T07:53:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:04 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:53:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:04 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:53:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14923.459974 secs 2023-05-08T07:53:05.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:05 smithi133 ceph-mon[125939]: pgmap v8016: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 384 KiB/s wr, 28 op/s 2023-05-08T07:53:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14924.742759 secs 2023-05-08T07:53:06.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:05 smithi096 ceph-mon[124666]: pgmap v8016: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 384 KiB/s wr, 28 op/s 2023-05-08T07:53:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14924.742759 secs 2023-05-08T07:53:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:05 smithi186 ceph-mon[126480]: pgmap v8016: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 384 KiB/s wr, 28 op/s 2023-05-08T07:53:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14924.742759 secs 2023-05-08T07:53:06.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:06 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:53:07.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:06 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:53:07.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:06 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:53:08.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:07 smithi096 ceph-mon[124666]: pgmap v8017: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 210 KiB/s wr, 23 op/s 2023-05-08T07:53:08.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:07 smithi186 ceph-mon[126480]: pgmap v8017: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 210 KiB/s wr, 23 op/s 2023-05-08T07:53:08.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:07 smithi133 ceph-mon[125939]: pgmap v8017: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 210 KiB/s wr, 23 op/s 2023-05-08T07:53:09.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:53:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:53:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14927.902759 secs 2023-05-08T07:53:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14928.460091 secs 2023-05-08T07:53:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:53:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:53:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14927.902759 secs 2023-05-08T07:53:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14928.460091 secs 2023-05-08T07:53:09.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:53:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:53:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14927.902759 secs 2023-05-08T07:53:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14928.460091 secs 2023-05-08T07:53:10.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:09 smithi096 ceph-mon[124666]: pgmap v8018: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 210 KiB/s wr, 23 op/s 2023-05-08T07:53:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:09 smithi186 ceph-mon[126480]: pgmap v8018: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 210 KiB/s wr, 23 op/s 2023-05-08T07:53:10.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:09 smithi133 ceph-mon[125939]: pgmap v8018: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 210 KiB/s wr, 23 op/s 2023-05-08T07:53:11.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14929.742881 secs 2023-05-08T07:53:11.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14929.742881 secs 2023-05-08T07:53:11.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14929.742881 secs 2023-05-08T07:53:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:11 smithi186 ceph-mon[126480]: pgmap v8019: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 377 KiB/s wr, 27 op/s 2023-05-08T07:53:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:11 smithi186 ceph-mon[126480]: osdmap e578: 12 total, 12 up, 12 in 2023-05-08T07:53:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:11 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:53:12.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:11 smithi133 ceph-mon[125939]: pgmap v8019: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 377 KiB/s wr, 27 op/s 2023-05-08T07:53:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:11 smithi133 ceph-mon[125939]: osdmap e578: 12 total, 12 up, 12 in 2023-05-08T07:53:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:11 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:53:12.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:11 smithi096 ceph-mon[124666]: pgmap v8019: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 377 KiB/s wr, 27 op/s 2023-05-08T07:53:12.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:11 smithi096 ceph-mon[124666]: osdmap e578: 12 total, 12 up, 12 in 2023-05-08T07:53:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:11 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:53:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:13 smithi186 ceph-mon[126480]: pgmap v8021: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 255 KiB/s wr, 27 op/s 2023-05-08T07:53:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14932.902873 secs 2023-05-08T07:53:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14933.460214 secs 2023-05-08T07:53:14.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:13 smithi133 ceph-mon[125939]: pgmap v8021: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 255 KiB/s wr, 27 op/s 2023-05-08T07:53:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14932.902873 secs 2023-05-08T07:53:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14933.460214 secs 2023-05-08T07:53:14.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:13 smithi096 ceph-mon[124666]: pgmap v8021: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 255 KiB/s wr, 27 op/s 2023-05-08T07:53:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14932.902873 secs 2023-05-08T07:53:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14933.460214 secs 2023-05-08T07:53:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:15 smithi186 ceph-mon[126480]: pgmap v8022: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 210 KiB/s wr, 10 op/s 2023-05-08T07:53:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14934.742963 secs 2023-05-08T07:53:16.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:15 smithi133 ceph-mon[125939]: pgmap v8022: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 210 KiB/s wr, 10 op/s 2023-05-08T07:53:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14934.742963 secs 2023-05-08T07:53:16.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:15 smithi096 ceph-mon[124666]: pgmap v8022: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 210 KiB/s wr, 10 op/s 2023-05-08T07:53:16.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14934.742963 secs 2023-05-08T07:53:18.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:17 smithi186 ceph-mon[126480]: pgmap v8023: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 210 KiB/s wr, 10 op/s 2023-05-08T07:53:18.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:17 smithi133 ceph-mon[125939]: pgmap v8023: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 210 KiB/s wr, 10 op/s 2023-05-08T07:53:18.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:17 smithi096 ceph-mon[124666]: pgmap v8023: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 210 KiB/s wr, 10 op/s 2023-05-08T07:53:19.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14937.902984 secs 2023-05-08T07:53:19.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14938.460354 secs 2023-05-08T07:53:19.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14937.902984 secs 2023-05-08T07:53:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14938.460354 secs 2023-05-08T07:53:19.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14937.902984 secs 2023-05-08T07:53:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14938.460354 secs 2023-05-08T07:53:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:19 smithi186 ceph-mon[126480]: pgmap v8024: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 210 KiB/s wr, 10 op/s 2023-05-08T07:53:20.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:19 smithi133 ceph-mon[125939]: pgmap v8024: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 210 KiB/s wr, 10 op/s 2023-05-08T07:53:20.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:19 smithi096 ceph-mon[124666]: pgmap v8024: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 210 KiB/s wr, 10 op/s 2023-05-08T07:53:21.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14939.743105 secs 2023-05-08T07:53:21.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14939.743105 secs 2023-05-08T07:53:21.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14939.743105 secs 2023-05-08T07:53:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:21 smithi186 ceph-mon[126480]: pgmap v8025: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 42 KiB/s wr, 8 op/s 2023-05-08T07:53:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:21 smithi186 ceph-mon[126480]: osdmap e579: 12 total, 12 up, 12 in 2023-05-08T07:53:22.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:21 smithi133 ceph-mon[125939]: pgmap v8025: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 42 KiB/s wr, 8 op/s 2023-05-08T07:53:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:21 smithi133 ceph-mon[125939]: osdmap e579: 12 total, 12 up, 12 in 2023-05-08T07:53:22.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:21 smithi096 ceph-mon[124666]: pgmap v8025: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 42 KiB/s wr, 8 op/s 2023-05-08T07:53:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:21 smithi096 ceph-mon[124666]: osdmap e579: 12 total, 12 up, 12 in 2023-05-08T07:53:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:23 smithi186 ceph-mon[126480]: pgmap v8027: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 42 KiB/s wr, 8 op/s 2023-05-08T07:53:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14942.903103 secs 2023-05-08T07:53:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14943.460493 secs 2023-05-08T07:53:24.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:23 smithi133 ceph-mon[125939]: pgmap v8027: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 42 KiB/s wr, 8 op/s 2023-05-08T07:53:24.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14942.903103 secs 2023-05-08T07:53:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14943.460493 secs 2023-05-08T07:53:24.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:23 smithi096 ceph-mon[124666]: pgmap v8027: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 42 KiB/s wr, 8 op/s 2023-05-08T07:53:24.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14942.903103 secs 2023-05-08T07:53:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14943.460493 secs 2023-05-08T07:53:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:25 smithi186 ceph-mon[126480]: pgmap v8028: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 137 KiB/s wr, 7 op/s 2023-05-08T07:53:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14944.743250 secs 2023-05-08T07:53:26.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:25 smithi133 ceph-mon[125939]: pgmap v8028: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 137 KiB/s wr, 7 op/s 2023-05-08T07:53:26.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14944.743250 secs 2023-05-08T07:53:26.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:25 smithi096 ceph-mon[124666]: pgmap v8028: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 137 KiB/s wr, 7 op/s 2023-05-08T07:53:26.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14944.743250 secs 2023-05-08T07:53:28.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:27 smithi186 ceph-mon[126480]: pgmap v8029: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 137 KiB/s wr, 7 op/s 2023-05-08T07:53:28.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:27 smithi133 ceph-mon[125939]: pgmap v8029: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 137 KiB/s wr, 7 op/s 2023-05-08T07:53:28.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:27 smithi096 ceph-mon[124666]: pgmap v8029: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 137 KiB/s wr, 7 op/s 2023-05-08T07:53:29.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14947.903224 secs 2023-05-08T07:53:29.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14948.460630 secs 2023-05-08T07:53:29.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14947.903224 secs 2023-05-08T07:53:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14948.460630 secs 2023-05-08T07:53:29.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14947.903224 secs 2023-05-08T07:53:29.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14948.460630 secs 2023-05-08T07:53:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:29 smithi186 ceph-mon[126480]: pgmap v8030: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 137 KiB/s wr, 7 op/s 2023-05-08T07:53:30.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:29 smithi133 ceph-mon[125939]: pgmap v8030: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 137 KiB/s wr, 7 op/s 2023-05-08T07:53:30.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:29 smithi096 ceph-mon[124666]: pgmap v8030: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 137 KiB/s wr, 7 op/s 2023-05-08T07:53:31.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14949.743376 secs 2023-05-08T07:53:31.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14949.743376 secs 2023-05-08T07:53:31.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14949.743376 secs 2023-05-08T07:53:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:31 smithi186 ceph-mon[126480]: pgmap v8031: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 105 KiB/s wr, 8 op/s 2023-05-08T07:53:32.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:31 smithi133 ceph-mon[125939]: pgmap v8031: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 105 KiB/s wr, 8 op/s 2023-05-08T07:53:32.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:31 smithi096 ceph-mon[124666]: pgmap v8031: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 105 KiB/s wr, 8 op/s 2023-05-08T07:53:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:33 smithi186 ceph-mon[126480]: pgmap v8032: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 96 KiB/s wr, 7 op/s 2023-05-08T07:53:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14952.903353 secs 2023-05-08T07:53:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14953.460706 secs 2023-05-08T07:53:34.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:33 smithi133 ceph-mon[125939]: pgmap v8032: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 96 KiB/s wr, 7 op/s 2023-05-08T07:53:34.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14952.903353 secs 2023-05-08T07:53:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14953.460706 secs 2023-05-08T07:53:34.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:33 smithi096 ceph-mon[124666]: pgmap v8032: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 96 KiB/s wr, 7 op/s 2023-05-08T07:53:34.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14952.903353 secs 2023-05-08T07:53:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14953.460706 secs 2023-05-08T07:53:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:35 smithi186 ceph-mon[126480]: pgmap v8033: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 135 KiB/s wr, 9 op/s 2023-05-08T07:53:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14954.743496 secs 2023-05-08T07:53:36.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:35 smithi133 ceph-mon[125939]: pgmap v8033: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 135 KiB/s wr, 9 op/s 2023-05-08T07:53:36.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14954.743496 secs 2023-05-08T07:53:36.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:35 smithi096 ceph-mon[124666]: pgmap v8033: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 135 KiB/s wr, 9 op/s 2023-05-08T07:53:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14954.743496 secs 2023-05-08T07:53:38.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:37 smithi186 ceph-mon[126480]: pgmap v8034: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 48 KiB/s wr, 6 op/s 2023-05-08T07:53:38.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:37 smithi133 ceph-mon[125939]: pgmap v8034: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 48 KiB/s wr, 6 op/s 2023-05-08T07:53:38.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:37 smithi096 ceph-mon[124666]: pgmap v8034: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 48 KiB/s wr, 6 op/s 2023-05-08T07:53:39.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14957.903468 secs 2023-05-08T07:53:39.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14958.460801 secs 2023-05-08T07:53:39.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14957.903468 secs 2023-05-08T07:53:39.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14958.460801 secs 2023-05-08T07:53:39.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14957.903468 secs 2023-05-08T07:53:39.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14958.460801 secs 2023-05-08T07:53:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:39 smithi186 ceph-mon[126480]: pgmap v8035: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 48 KiB/s wr, 6 op/s 2023-05-08T07:53:40.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:39 smithi133 ceph-mon[125939]: pgmap v8035: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 48 KiB/s wr, 6 op/s 2023-05-08T07:53:40.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:39 smithi096 ceph-mon[124666]: pgmap v8035: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 48 KiB/s wr, 6 op/s 2023-05-08T07:53:41.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14959.743616 secs 2023-05-08T07:53:41.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14959.743616 secs 2023-05-08T07:53:41.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14959.743616 secs 2023-05-08T07:53:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:41 smithi186 ceph-mon[126480]: pgmap v8036: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 49 KiB/s wr, 9 op/s 2023-05-08T07:53:42.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:41 smithi133 ceph-mon[125939]: pgmap v8036: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 49 KiB/s wr, 9 op/s 2023-05-08T07:53:42.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:41 smithi096 ceph-mon[124666]: pgmap v8036: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 49 KiB/s wr, 9 op/s 2023-05-08T07:53:44.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:43 smithi186 ceph-mon[126480]: pgmap v8037: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 48 KiB/s wr, 6 op/s 2023-05-08T07:53:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14962.903572 secs 2023-05-08T07:53:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14963.460917 secs 2023-05-08T07:53:44.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:43 smithi133 ceph-mon[125939]: pgmap v8037: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 48 KiB/s wr, 6 op/s 2023-05-08T07:53:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14962.903572 secs 2023-05-08T07:53:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14963.460917 secs 2023-05-08T07:53:44.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:43 smithi096 ceph-mon[124666]: pgmap v8037: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 48 KiB/s wr, 6 op/s 2023-05-08T07:53:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14962.903572 secs 2023-05-08T07:53:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14963.460917 secs 2023-05-08T07:53:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:45 smithi186 ceph-mon[126480]: pgmap v8038: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 117 KiB/s wr, 9 op/s 2023-05-08T07:53:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14964.743750 secs 2023-05-08T07:53:46.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:45 smithi133 ceph-mon[125939]: pgmap v8038: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 117 KiB/s wr, 9 op/s 2023-05-08T07:53:46.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14964.743750 secs 2023-05-08T07:53:46.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:45 smithi096 ceph-mon[124666]: pgmap v8038: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 117 KiB/s wr, 9 op/s 2023-05-08T07:53:46.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14964.743750 secs 2023-05-08T07:53:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:47 smithi186 ceph-mon[126480]: pgmap v8039: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 69 KiB/s wr, 6 op/s 2023-05-08T07:53:48.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:47 smithi133 ceph-mon[125939]: pgmap v8039: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 69 KiB/s wr, 6 op/s 2023-05-08T07:53:48.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:47 smithi096 ceph-mon[124666]: pgmap v8039: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 69 KiB/s wr, 6 op/s 2023-05-08T07:53:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14967.903710 secs 2023-05-08T07:53:49.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14967.903710 secs 2023-05-08T07:53:49.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14967.903710 secs 2023-05-08T07:53:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:49 smithi186 ceph-mon[126480]: pgmap v8040: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 69 KiB/s wr, 6 op/s 2023-05-08T07:53:50.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:49 smithi133 ceph-mon[125939]: pgmap v8040: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 69 KiB/s wr, 6 op/s 2023-05-08T07:53:50.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:49 smithi096 ceph-mon[124666]: pgmap v8040: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 69 KiB/s wr, 6 op/s 2023-05-08T07:53:51.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14969.743873 secs 2023-05-08T07:53:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:50 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:53:51.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14969.743873 secs 2023-05-08T07:53:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:50 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:53:51.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14969.743873 secs 2023-05-08T07:53:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:50 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:53:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:51 smithi186 ceph-mon[126480]: pgmap v8041: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 352 KiB/s rd, 213 KiB/s wr, 10 op/s 2023-05-08T07:53:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:51 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:53:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:53:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:53:52.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:51 smithi133 ceph-mon[125939]: pgmap v8041: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 352 KiB/s rd, 213 KiB/s wr, 10 op/s 2023-05-08T07:53:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:51 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:53:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:53:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:53:52.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:51 smithi096 ceph-mon[124666]: pgmap v8041: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 352 KiB/s rd, 213 KiB/s wr, 10 op/s 2023-05-08T07:53:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:51 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:53:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:53:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:53:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:53 smithi186 ceph-mon[126480]: pgmap v8042: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 213 KiB/s wr, 7 op/s 2023-05-08T07:53:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14972.903852 secs 2023-05-08T07:53:54.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:53 smithi133 ceph-mon[125939]: pgmap v8042: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 213 KiB/s wr, 7 op/s 2023-05-08T07:53:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14972.903852 secs 2023-05-08T07:53:54.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:53 smithi096 ceph-mon[124666]: pgmap v8042: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 213 KiB/s wr, 7 op/s 2023-05-08T07:53:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14972.903852 secs 2023-05-08T07:53:56.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:55 smithi133 ceph-mon[125939]: pgmap v8043: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 393 KiB/s rd, 354 KiB/s wr, 12 op/s 2023-05-08T07:53:56.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14974.744028 secs 2023-05-08T07:53:56.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:55 smithi096 ceph-mon[124666]: pgmap v8043: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 393 KiB/s rd, 354 KiB/s wr, 12 op/s 2023-05-08T07:53:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14974.744028 secs 2023-05-08T07:53:56.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:55 smithi186 ceph-mon[126480]: pgmap v8043: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 393 KiB/s rd, 354 KiB/s wr, 12 op/s 2023-05-08T07:53:56.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14974.744028 secs 2023-05-08T07:53:58.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:57 smithi133 ceph-mon[125939]: pgmap v8044: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 285 KiB/s wr, 9 op/s 2023-05-08T07:53:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:53:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:53:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:53:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:53:58.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:57 smithi096 ceph-mon[124666]: pgmap v8044: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 285 KiB/s wr, 9 op/s 2023-05-08T07:53:58.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:53:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:53:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:53:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:53:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:57 smithi186 ceph-mon[126480]: pgmap v8044: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 285 KiB/s wr, 9 op/s 2023-05-08T07:53:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:53:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:53:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:53:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:53:59.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:58 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:53:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:58 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T07:53:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:58 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T07:53:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:58 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:53:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14977.903978 secs 2023-05-08T07:53:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14978.461301 secs 2023-05-08T07:53:59.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:58 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:53:59.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:58 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T07:53:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:58 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T07:53:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:58 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:53:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14977.903978 secs 2023-05-08T07:53:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14978.461301 secs 2023-05-08T07:53:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:58 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:53:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:58 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T07:53:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:58 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T07:53:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:58 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:53:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14977.903978 secs 2023-05-08T07:53:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14978.461301 secs 2023-05-08T07:54:00.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:59 smithi133 ceph-mon[125939]: pgmap v8045: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 285 KiB/s wr, 9 op/s 2023-05-08T07:54:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:59 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:54:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:59 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:54:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:53:59 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:54:00.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:59 smithi096 ceph-mon[124666]: pgmap v8045: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 285 KiB/s wr, 9 op/s 2023-05-08T07:54:00.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:59 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:54:00.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:59 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:54:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:53:59 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:54:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:59 smithi186 ceph-mon[126480]: pgmap v8045: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 285 KiB/s wr, 9 op/s 2023-05-08T07:54:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:59 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:54:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:59 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:54:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:53:59 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:54:02.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:01 smithi133 ceph-mon[125939]: pgmap v8046: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 366 KiB/s wr, 14 op/s 2023-05-08T07:54:02.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:01 smithi096 ceph-mon[124666]: pgmap v8046: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 366 KiB/s wr, 14 op/s 2023-05-08T07:54:02.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:01 smithi186 ceph-mon[126480]: pgmap v8046: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 366 KiB/s wr, 14 op/s 2023-05-08T07:54:03.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:02 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:54:03.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:02 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:54:03.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:02 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:54:04.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:03 smithi133 ceph-mon[125939]: pgmap v8047: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 222 KiB/s wr, 10 op/s 2023-05-08T07:54:04.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:54:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:03 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:54:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14982.904111 secs 2023-05-08T07:54:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14983.461415 secs 2023-05-08T07:54:04.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:03 smithi096 ceph-mon[124666]: pgmap v8047: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 222 KiB/s wr, 10 op/s 2023-05-08T07:54:04.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:54:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:03 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:54:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14982.904111 secs 2023-05-08T07:54:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14983.461415 secs 2023-05-08T07:54:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:03 smithi186 ceph-mon[126480]: pgmap v8047: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 222 KiB/s wr, 10 op/s 2023-05-08T07:54:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:54:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:03 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:54:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14982.904111 secs 2023-05-08T07:54:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14983.461415 secs 2023-05-08T07:54:06.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:05 smithi133 ceph-mon[125939]: pgmap v8048: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 433 KiB/s wr, 27 op/s 2023-05-08T07:54:06.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:05 smithi096 ceph-mon[124666]: pgmap v8048: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 433 KiB/s wr, 27 op/s 2023-05-08T07:54:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:05 smithi186 ceph-mon[126480]: pgmap v8048: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 433 KiB/s wr, 27 op/s 2023-05-08T07:54:07.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:06 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:54:07.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:06 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:54:07.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:06 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:54:08.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:07 smithi133 ceph-mon[125939]: pgmap v8049: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 292 KiB/s wr, 21 op/s 2023-05-08T07:54:08.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:07 smithi096 ceph-mon[124666]: pgmap v8049: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 292 KiB/s wr, 21 op/s 2023-05-08T07:54:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:07 smithi186 ceph-mon[126480]: pgmap v8049: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 292 KiB/s wr, 21 op/s 2023-05-08T07:54:09.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14987.904227 secs 2023-05-08T07:54:09.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14987.904227 secs 2023-05-08T07:54:09.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14987.904227 secs 2023-05-08T07:54:10.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:09 smithi133 ceph-mon[125939]: pgmap v8050: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 292 KiB/s wr, 21 op/s 2023-05-08T07:54:10.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:09 smithi096 ceph-mon[124666]: pgmap v8050: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 292 KiB/s wr, 21 op/s 2023-05-08T07:54:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:09 smithi186 ceph-mon[126480]: pgmap v8050: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 292 KiB/s wr, 21 op/s 2023-05-08T07:54:11.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:10 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:54:11.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:10 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:54:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:10 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:54:12.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:11 smithi133 ceph-mon[125939]: pgmap v8051: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 397 KiB/s wr, 26 op/s 2023-05-08T07:54:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:11 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:54:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:11 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:54:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:11 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:54:12.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:11 smithi096 ceph-mon[124666]: pgmap v8051: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 397 KiB/s wr, 26 op/s 2023-05-08T07:54:12.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:11 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:54:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:11 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:54:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:11 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:54:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:11 smithi186 ceph-mon[126480]: pgmap v8051: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 397 KiB/s wr, 26 op/s 2023-05-08T07:54:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:11 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:54:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:11 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:54:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:11 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:54:14.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:13 smithi133 ceph-mon[125939]: pgmap v8052: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 316 KiB/s wr, 21 op/s 2023-05-08T07:54:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14992.904367 secs 2023-05-08T07:54:14.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:13 smithi096 ceph-mon[124666]: pgmap v8052: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 316 KiB/s wr, 21 op/s 2023-05-08T07:54:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14992.904367 secs 2023-05-08T07:54:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:13 smithi186 ceph-mon[126480]: pgmap v8052: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 316 KiB/s wr, 21 op/s 2023-05-08T07:54:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14992.904367 secs 2023-05-08T07:54:16.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:15 smithi133 ceph-mon[125939]: pgmap v8053: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 350 KiB/s wr, 24 op/s 2023-05-08T07:54:16.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:15 smithi096 ceph-mon[124666]: pgmap v8053: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 350 KiB/s wr, 24 op/s 2023-05-08T07:54:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:15 smithi186 ceph-mon[126480]: pgmap v8053: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 350 KiB/s wr, 24 op/s 2023-05-08T07:54:18.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:17 smithi133 ceph-mon[125939]: pgmap v8054: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 139 KiB/s wr, 7 op/s 2023-05-08T07:54:18.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:17 smithi096 ceph-mon[124666]: pgmap v8054: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 139 KiB/s wr, 7 op/s 2023-05-08T07:54:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:17 smithi186 ceph-mon[126480]: pgmap v8054: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 139 KiB/s wr, 7 op/s 2023-05-08T07:54:19.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 14997.904483 secs 2023-05-08T07:54:19.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 14997.904483 secs 2023-05-08T07:54:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 14997.904483 secs 2023-05-08T07:54:20.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:19 smithi133 ceph-mon[125939]: pgmap v8055: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 139 KiB/s wr, 7 op/s 2023-05-08T07:54:20.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:19 smithi096 ceph-mon[124666]: pgmap v8055: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 139 KiB/s wr, 7 op/s 2023-05-08T07:54:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:19 smithi186 ceph-mon[126480]: pgmap v8055: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 139 KiB/s wr, 7 op/s 2023-05-08T07:54:22.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:21 smithi133 ceph-mon[125939]: pgmap v8056: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 169 KiB/s wr, 10 op/s 2023-05-08T07:54:22.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:21 smithi096 ceph-mon[124666]: pgmap v8056: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 169 KiB/s wr, 10 op/s 2023-05-08T07:54:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:21 smithi186 ceph-mon[126480]: pgmap v8056: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 169 KiB/s wr, 10 op/s 2023-05-08T07:54:24.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:23 smithi133 ceph-mon[125939]: pgmap v8057: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 64 KiB/s wr, 6 op/s 2023-05-08T07:54:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15002.904607 secs 2023-05-08T07:54:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15003.461914 secs 2023-05-08T07:54:24.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:23 smithi096 ceph-mon[124666]: pgmap v8057: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 64 KiB/s wr, 6 op/s 2023-05-08T07:54:24.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15002.904607 secs 2023-05-08T07:54:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15003.461914 secs 2023-05-08T07:54:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:23 smithi186 ceph-mon[126480]: pgmap v8057: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 64 KiB/s wr, 6 op/s 2023-05-08T07:54:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15002.904607 secs 2023-05-08T07:54:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15003.461914 secs 2023-05-08T07:54:26.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:25 smithi133 ceph-mon[125939]: pgmap v8058: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 225 KiB/s wr, 12 op/s 2023-05-08T07:54:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15004.744790 secs 2023-05-08T07:54:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:25 smithi096 ceph-mon[124666]: pgmap v8058: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 225 KiB/s wr, 12 op/s 2023-05-08T07:54:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15004.744790 secs 2023-05-08T07:54:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:25 smithi186 ceph-mon[126480]: pgmap v8058: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 225 KiB/s wr, 12 op/s 2023-05-08T07:54:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15004.744790 secs 2023-05-08T07:54:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:27 smithi133 ceph-mon[125939]: pgmap v8059: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 192 KiB/s wr, 9 op/s 2023-05-08T07:54:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:27 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:54:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:27 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:54:28.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:27 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:54:28.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:27 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:54:28.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:27 smithi096 ceph-mon[124666]: pgmap v8059: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 192 KiB/s wr, 9 op/s 2023-05-08T07:54:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:27 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:54:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:27 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:54:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:27 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:54:28.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:27 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:54:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:27 smithi186 ceph-mon[126480]: pgmap v8059: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 192 KiB/s wr, 9 op/s 2023-05-08T07:54:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:27 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:54:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:27 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:54:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:27 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:54:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:27 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:54:29.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15007.904673 secs 2023-05-08T07:54:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15008.462064 secs 2023-05-08T07:54:29.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15007.904673 secs 2023-05-08T07:54:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15008.462064 secs 2023-05-08T07:54:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15007.904673 secs 2023-05-08T07:54:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15008.462064 secs 2023-05-08T07:54:30.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:29 smithi133 ceph-mon[125939]: pgmap v8060: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 192 KiB/s wr, 9 op/s 2023-05-08T07:54:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:29 smithi096 ceph-mon[124666]: pgmap v8060: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 192 KiB/s wr, 9 op/s 2023-05-08T07:54:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:29 smithi186 ceph-mon[126480]: pgmap v8060: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 192 KiB/s wr, 9 op/s 2023-05-08T07:54:31.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15009.744914 secs 2023-05-08T07:54:31.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15009.744914 secs 2023-05-08T07:54:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15009.744914 secs 2023-05-08T07:54:32.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:31 smithi133 ceph-mon[125939]: pgmap v8061: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 296 KiB/s wr, 13 op/s 2023-05-08T07:54:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:31 smithi133 ceph-mon[125939]: osdmap e580: 12 total, 12 up, 12 in 2023-05-08T07:54:32.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:31 smithi096 ceph-mon[124666]: pgmap v8061: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 296 KiB/s wr, 13 op/s 2023-05-08T07:54:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:31 smithi096 ceph-mon[124666]: osdmap e580: 12 total, 12 up, 12 in 2023-05-08T07:54:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:31 smithi186 ceph-mon[126480]: pgmap v8061: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 296 KiB/s wr, 13 op/s 2023-05-08T07:54:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:31 smithi186 ceph-mon[126480]: osdmap e580: 12 total, 12 up, 12 in 2023-05-08T07:54:34.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:33 smithi133 ceph-mon[125939]: pgmap v8063: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 291 KiB/s rd, 319 KiB/s wr, 13 op/s 2023-05-08T07:54:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15012.904797 secs 2023-05-08T07:54:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15013.462205 secs 2023-05-08T07:54:34.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:33 smithi096 ceph-mon[124666]: pgmap v8063: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 291 KiB/s rd, 319 KiB/s wr, 13 op/s 2023-05-08T07:54:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15012.904797 secs 2023-05-08T07:54:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15013.462205 secs 2023-05-08T07:54:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:33 smithi186 ceph-mon[126480]: pgmap v8063: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 291 KiB/s rd, 319 KiB/s wr, 13 op/s 2023-05-08T07:54:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15012.904797 secs 2023-05-08T07:54:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15013.462205 secs 2023-05-08T07:54:36.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:35 smithi133 ceph-mon[125939]: pgmap v8064: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 126 KiB/s wr, 9 op/s 2023-05-08T07:54:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15014.745031 secs 2023-05-08T07:54:36.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:35 smithi096 ceph-mon[124666]: pgmap v8064: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 126 KiB/s wr, 9 op/s 2023-05-08T07:54:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15014.745031 secs 2023-05-08T07:54:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:35 smithi186 ceph-mon[126480]: pgmap v8064: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 126 KiB/s wr, 9 op/s 2023-05-08T07:54:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15014.745031 secs 2023-05-08T07:54:38.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:37 smithi133 ceph-mon[125939]: pgmap v8065: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 126 KiB/s wr, 9 op/s 2023-05-08T07:54:38.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:37 smithi096 ceph-mon[124666]: pgmap v8065: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 126 KiB/s wr, 9 op/s 2023-05-08T07:54:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:37 smithi186 ceph-mon[126480]: pgmap v8065: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 126 KiB/s wr, 9 op/s 2023-05-08T07:54:39.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15017.904918 secs 2023-05-08T07:54:39.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15018.462303 secs 2023-05-08T07:54:39.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15017.904918 secs 2023-05-08T07:54:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15018.462303 secs 2023-05-08T07:54:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15017.904918 secs 2023-05-08T07:54:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15018.462303 secs 2023-05-08T07:54:40.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:39 smithi096 ceph-mon[124666]: pgmap v8066: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 126 KiB/s wr, 9 op/s 2023-05-08T07:54:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:39 smithi186 ceph-mon[126480]: pgmap v8066: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 126 KiB/s wr, 9 op/s 2023-05-08T07:54:40.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:39 smithi133 ceph-mon[125939]: pgmap v8066: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 126 KiB/s wr, 9 op/s 2023-05-08T07:54:41.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15019.745144 secs 2023-05-08T07:54:41.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15019.745144 secs 2023-05-08T07:54:41.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15019.745144 secs 2023-05-08T07:54:42.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:41 smithi096 ceph-mon[124666]: pgmap v8067: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 130 KiB/s wr, 8 op/s 2023-05-08T07:54:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:41 smithi096 ceph-mon[124666]: osdmap e581: 12 total, 12 up, 12 in 2023-05-08T07:54:42.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:41 smithi186 ceph-mon[126480]: pgmap v8067: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 130 KiB/s wr, 8 op/s 2023-05-08T07:54:42.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:41 smithi186 ceph-mon[126480]: osdmap e581: 12 total, 12 up, 12 in 2023-05-08T07:54:42.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:41 smithi133 ceph-mon[125939]: pgmap v8067: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 130 KiB/s wr, 8 op/s 2023-05-08T07:54:42.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:41 smithi133 ceph-mon[125939]: osdmap e581: 12 total, 12 up, 12 in 2023-05-08T07:54:44.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:43 smithi096 ceph-mon[124666]: pgmap v8069: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 219 KiB/s wr, 8 op/s 2023-05-08T07:54:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15022.904982 secs 2023-05-08T07:54:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:43 smithi186 ceph-mon[126480]: pgmap v8069: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 219 KiB/s wr, 8 op/s 2023-05-08T07:54:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15022.904982 secs 2023-05-08T07:54:44.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:43 smithi133 ceph-mon[125939]: pgmap v8069: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 219 KiB/s wr, 8 op/s 2023-05-08T07:54:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15022.904982 secs 2023-05-08T07:54:46.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:46 smithi096 ceph-mon[124666]: pgmap v8070: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 227 KiB/s wr, 8 op/s 2023-05-08T07:54:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15024.745213 secs 2023-05-08T07:54:46.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:46 smithi186 ceph-mon[126480]: pgmap v8070: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 227 KiB/s wr, 8 op/s 2023-05-08T07:54:46.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15024.745213 secs 2023-05-08T07:54:46.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:46 smithi133 ceph-mon[125939]: pgmap v8070: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 227 KiB/s wr, 8 op/s 2023-05-08T07:54:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15024.745213 secs 2023-05-08T07:54:47.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:47 smithi133 ceph-mon[125939]: pgmap v8071: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 337 KiB/s wr, 9 op/s 2023-05-08T07:54:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:54:48.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:47 smithi096 ceph-mon[124666]: pgmap v8071: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 337 KiB/s wr, 9 op/s 2023-05-08T07:54:48.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:54:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:47 smithi186 ceph-mon[126480]: pgmap v8071: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 337 KiB/s wr, 9 op/s 2023-05-08T07:54:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:54:48.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:48 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:54:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:54:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:54:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15027.905046 secs 2023-05-08T07:54:49.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:48 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:54:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:54:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:54:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15027.905046 secs 2023-05-08T07:54:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:48 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:54:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:54:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:54:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15027.905046 secs 2023-05-08T07:54:49.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:49 smithi133 ceph-mon[125939]: pgmap v8072: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 337 KiB/s wr, 9 op/s 2023-05-08T07:54:50.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:49 smithi096 ceph-mon[124666]: pgmap v8072: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 337 KiB/s wr, 9 op/s 2023-05-08T07:54:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:49 smithi186 ceph-mon[126480]: pgmap v8072: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 337 KiB/s wr, 9 op/s 2023-05-08T07:54:50.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15029.745366 secs 2023-05-08T07:54:51.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15029.745366 secs 2023-05-08T07:54:51.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15029.745366 secs 2023-05-08T07:54:51.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:51 smithi133 ceph-mon[125939]: pgmap v8073: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 332 KiB/s wr, 11 op/s 2023-05-08T07:54:52.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:51 smithi096 ceph-mon[124666]: pgmap v8073: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 332 KiB/s wr, 11 op/s 2023-05-08T07:54:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:51 smithi186 ceph-mon[126480]: pgmap v8073: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 332 KiB/s wr, 11 op/s 2023-05-08T07:54:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:53 smithi133 ceph-mon[125939]: pgmap v8074: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 223 KiB/s wr, 10 op/s 2023-05-08T07:54:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15032.905164 secs 2023-05-08T07:54:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:53 smithi096 ceph-mon[124666]: pgmap v8074: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 223 KiB/s wr, 10 op/s 2023-05-08T07:54:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15032.905164 secs 2023-05-08T07:54:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:53 smithi186 ceph-mon[126480]: pgmap v8074: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 223 KiB/s wr, 10 op/s 2023-05-08T07:54:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15032.905164 secs 2023-05-08T07:54:54.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15033.462656 secs 2023-05-08T07:54:55.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15033.462656 secs 2023-05-08T07:54:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15033.462656 secs 2023-05-08T07:54:55.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:55 smithi133 ceph-mon[125939]: pgmap v8075: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 211 KiB/s wr, 12 op/s 2023-05-08T07:54:56.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:55 smithi096 ceph-mon[124666]: pgmap v8075: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 211 KiB/s wr, 12 op/s 2023-05-08T07:54:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:55 smithi186 ceph-mon[126480]: pgmap v8075: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 211 KiB/s wr, 12 op/s 2023-05-08T07:54:56.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:56 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:54:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:54:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:54:57.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:56 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:54:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:54:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:54:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:56 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:54:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:54:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:54:57.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:57 smithi133 ceph-mon[125939]: pgmap v8076: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 430 KiB/s rd, 417 KiB/s wr, 11 op/s 2023-05-08T07:54:58.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:57 smithi096 ceph-mon[124666]: pgmap v8076: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 430 KiB/s rd, 417 KiB/s wr, 11 op/s 2023-05-08T07:54:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:57 smithi186 ceph-mon[126480]: pgmap v8076: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 430 KiB/s rd, 417 KiB/s wr, 11 op/s 2023-05-08T07:54:58.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:54:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15037.905235 secs 2023-05-08T07:54:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:54:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:54:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:54:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:54:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15037.905235 secs 2023-05-08T07:54:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:54:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:54:59.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:54:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:54:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15037.905235 secs 2023-05-08T07:54:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:54:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:54:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:54:59.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:59 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:54:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:59 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T07:54:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:59 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T07:54:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:59 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:54:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:59 smithi133 ceph-mon[125939]: pgmap v8077: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 325 KiB/s wr, 10 op/s 2023-05-08T07:54:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:59 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:54:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:54:59 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:55:00.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:59 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:55:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:59 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T07:55:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:59 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T07:55:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:59 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:55:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:59 smithi096 ceph-mon[124666]: pgmap v8077: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 325 KiB/s wr, 10 op/s 2023-05-08T07:55:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:59 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:55:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:54:59 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:55:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:59 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:55:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:59 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T07:55:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:59 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T07:55:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:59 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:55:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:59 smithi186 ceph-mon[126480]: pgmap v8077: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 325 KiB/s wr, 10 op/s 2023-05-08T07:55:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:59 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:55:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:54:59 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:55:00.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:55:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:55:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:55:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15039.745651 secs 2023-05-08T07:55:01.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:55:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:55:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:55:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15039.745651 secs 2023-05-08T07:55:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:55:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:55:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:55:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15039.745651 secs 2023-05-08T07:55:01.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:01 smithi133 ceph-mon[125939]: pgmap v8078: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 435 KiB/s wr, 14 op/s 2023-05-08T07:55:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:01 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:55:02.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:01 smithi096 ceph-mon[124666]: pgmap v8078: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 435 KiB/s wr, 14 op/s 2023-05-08T07:55:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:01 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:55:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:01 smithi186 ceph-mon[126480]: pgmap v8078: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 435 KiB/s wr, 14 op/s 2023-05-08T07:55:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:01 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:55:03.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:03 smithi133 ceph-mon[125939]: pgmap v8079: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 333 KiB/s rd, 332 KiB/s wr, 9 op/s 2023-05-08T07:55:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15042.905386 secs 2023-05-08T07:55:04.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:03 smithi096 ceph-mon[124666]: pgmap v8079: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 333 KiB/s rd, 332 KiB/s wr, 9 op/s 2023-05-08T07:55:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15042.905386 secs 2023-05-08T07:55:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:03 smithi186 ceph-mon[126480]: pgmap v8079: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 333 KiB/s rd, 332 KiB/s wr, 9 op/s 2023-05-08T07:55:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15042.905386 secs 2023-05-08T07:55:04.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:04 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:55:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:04 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:55:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15043.462873 secs 2023-05-08T07:55:05.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:04 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:55:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:04 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:55:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15043.462873 secs 2023-05-08T07:55:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:04 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:55:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:04 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:55:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15043.462873 secs 2023-05-08T07:55:05.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:05 smithi133 ceph-mon[125939]: pgmap v8080: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 376 KiB/s wr, 27 op/s 2023-05-08T07:55:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15044.745738 secs 2023-05-08T07:55:06.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:05 smithi096 ceph-mon[124666]: pgmap v8080: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 376 KiB/s wr, 27 op/s 2023-05-08T07:55:06.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15044.745738 secs 2023-05-08T07:55:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:05 smithi186 ceph-mon[126480]: pgmap v8080: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 376 KiB/s wr, 27 op/s 2023-05-08T07:55:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15044.745738 secs 2023-05-08T07:55:06.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:06 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:55:07.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:06 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:55:07.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:06 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:55:07.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:07 smithi133 ceph-mon[125939]: pgmap v8081: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 421 KiB/s wr, 24 op/s 2023-05-08T07:55:08.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:07 smithi096 ceph-mon[124666]: pgmap v8081: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 421 KiB/s wr, 24 op/s 2023-05-08T07:55:08.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:07 smithi186 ceph-mon[126480]: pgmap v8081: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 421 KiB/s wr, 24 op/s 2023-05-08T07:55:09.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:55:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:55:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15047.905506 secs 2023-05-08T07:55:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:55:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:55:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15047.905506 secs 2023-05-08T07:55:09.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:55:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:55:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15047.905506 secs 2023-05-08T07:55:10.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:09 smithi096 ceph-mon[124666]: pgmap v8082: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 207 KiB/s wr, 23 op/s 2023-05-08T07:55:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15048.462983 secs 2023-05-08T07:55:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:09 smithi186 ceph-mon[126480]: pgmap v8082: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 207 KiB/s wr, 23 op/s 2023-05-08T07:55:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15048.462983 secs 2023-05-08T07:55:10.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:09 smithi133 ceph-mon[125939]: pgmap v8082: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 207 KiB/s wr, 23 op/s 2023-05-08T07:55:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15048.462983 secs 2023-05-08T07:55:11.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15049.745870 secs 2023-05-08T07:55:11.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15049.745870 secs 2023-05-08T07:55:11.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15049.745870 secs 2023-05-08T07:55:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:11 smithi186 ceph-mon[126480]: pgmap v8083: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 261 KiB/s wr, 27 op/s 2023-05-08T07:55:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:11 smithi186 ceph-mon[126480]: osdmap e582: 12 total, 12 up, 12 in 2023-05-08T07:55:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:11 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:55:12.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:11 smithi133 ceph-mon[125939]: pgmap v8083: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 261 KiB/s wr, 27 op/s 2023-05-08T07:55:12.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:11 smithi133 ceph-mon[125939]: osdmap e582: 12 total, 12 up, 12 in 2023-05-08T07:55:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:11 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:55:12.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:11 smithi096 ceph-mon[124666]: pgmap v8083: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 261 KiB/s wr, 27 op/s 2023-05-08T07:55:12.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:11 smithi096 ceph-mon[124666]: osdmap e582: 12 total, 12 up, 12 in 2023-05-08T07:55:12.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:11 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:55:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:13 smithi186 ceph-mon[126480]: pgmap v8085: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 182 KiB/s wr, 26 op/s 2023-05-08T07:55:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15052.905616 secs 2023-05-08T07:55:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15053.463121 secs 2023-05-08T07:55:14.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:13 smithi133 ceph-mon[125939]: pgmap v8085: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 182 KiB/s wr, 26 op/s 2023-05-08T07:55:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15052.905616 secs 2023-05-08T07:55:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15053.463121 secs 2023-05-08T07:55:14.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:13 smithi096 ceph-mon[124666]: pgmap v8085: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 182 KiB/s wr, 26 op/s 2023-05-08T07:55:14.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15052.905616 secs 2023-05-08T07:55:14.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15053.463121 secs 2023-05-08T07:55:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:15 smithi186 ceph-mon[126480]: pgmap v8086: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 138 KiB/s wr, 9 op/s 2023-05-08T07:55:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15054.745953 secs 2023-05-08T07:55:16.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:15 smithi133 ceph-mon[125939]: pgmap v8086: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 138 KiB/s wr, 9 op/s 2023-05-08T07:55:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15054.745953 secs 2023-05-08T07:55:16.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:15 smithi096 ceph-mon[124666]: pgmap v8086: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 138 KiB/s wr, 9 op/s 2023-05-08T07:55:16.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15054.745953 secs 2023-05-08T07:55:18.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:17 smithi186 ceph-mon[126480]: pgmap v8087: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 107 KiB/s wr, 9 op/s 2023-05-08T07:55:18.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:17 smithi133 ceph-mon[125939]: pgmap v8087: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 107 KiB/s wr, 9 op/s 2023-05-08T07:55:18.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:17 smithi096 ceph-mon[124666]: pgmap v8087: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 107 KiB/s wr, 9 op/s 2023-05-08T07:55:19.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15057.905738 secs 2023-05-08T07:55:19.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15058.463228 secs 2023-05-08T07:55:19.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15057.905738 secs 2023-05-08T07:55:19.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15058.463228 secs 2023-05-08T07:55:19.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15057.905738 secs 2023-05-08T07:55:19.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15058.463228 secs 2023-05-08T07:55:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:19 smithi186 ceph-mon[126480]: pgmap v8088: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 107 KiB/s wr, 9 op/s 2023-05-08T07:55:20.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:19 smithi133 ceph-mon[125939]: pgmap v8088: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 107 KiB/s wr, 9 op/s 2023-05-08T07:55:20.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:19 smithi096 ceph-mon[124666]: pgmap v8088: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 107 KiB/s wr, 9 op/s 2023-05-08T07:55:21.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15059.746074 secs 2023-05-08T07:55:21.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15059.746074 secs 2023-05-08T07:55:21.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15059.746074 secs 2023-05-08T07:55:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:21 smithi186 ceph-mon[126480]: pgmap v8089: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 43 KiB/s wr, 9 op/s 2023-05-08T07:55:22.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:21 smithi186 ceph-mon[126480]: osdmap e583: 12 total, 12 up, 12 in 2023-05-08T07:55:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:21 smithi133 ceph-mon[125939]: pgmap v8089: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 43 KiB/s wr, 9 op/s 2023-05-08T07:55:22.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:21 smithi133 ceph-mon[125939]: osdmap e583: 12 total, 12 up, 12 in 2023-05-08T07:55:22.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:21 smithi096 ceph-mon[124666]: pgmap v8089: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 43 KiB/s wr, 9 op/s 2023-05-08T07:55:22.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:21 smithi096 ceph-mon[124666]: osdmap e583: 12 total, 12 up, 12 in 2023-05-08T07:55:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:23 smithi186 ceph-mon[126480]: pgmap v8091: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 43 KiB/s wr, 9 op/s 2023-05-08T07:55:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15062.905852 secs 2023-05-08T07:55:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15063.463341 secs 2023-05-08T07:55:24.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:23 smithi133 ceph-mon[125939]: pgmap v8091: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 43 KiB/s wr, 9 op/s 2023-05-08T07:55:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15062.905852 secs 2023-05-08T07:55:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15063.463341 secs 2023-05-08T07:55:24.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:23 smithi096 ceph-mon[124666]: pgmap v8091: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 43 KiB/s wr, 9 op/s 2023-05-08T07:55:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15062.905852 secs 2023-05-08T07:55:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15063.463341 secs 2023-05-08T07:55:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:25 smithi186 ceph-mon[126480]: pgmap v8092: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 8 op/s 2023-05-08T07:55:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15064.746140 secs 2023-05-08T07:55:26.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:25 smithi133 ceph-mon[125939]: pgmap v8092: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 8 op/s 2023-05-08T07:55:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15064.746140 secs 2023-05-08T07:55:26.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:25 smithi096 ceph-mon[124666]: pgmap v8092: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 8 op/s 2023-05-08T07:55:26.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15064.746140 secs 2023-05-08T07:55:28.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:27 smithi186 ceph-mon[126480]: pgmap v8093: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 137 KiB/s wr, 8 op/s 2023-05-08T07:55:28.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:27 smithi133 ceph-mon[125939]: pgmap v8093: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 137 KiB/s wr, 8 op/s 2023-05-08T07:55:28.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:27 smithi096 ceph-mon[124666]: pgmap v8093: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 137 KiB/s wr, 8 op/s 2023-05-08T07:55:29.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15067.905937 secs 2023-05-08T07:55:29.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15068.463483 secs 2023-05-08T07:55:29.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15067.905937 secs 2023-05-08T07:55:29.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15068.463483 secs 2023-05-08T07:55:29.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15067.905937 secs 2023-05-08T07:55:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15068.463483 secs 2023-05-08T07:55:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:29 smithi186 ceph-mon[126480]: pgmap v8094: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 137 KiB/s wr, 8 op/s 2023-05-08T07:55:30.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:29 smithi133 ceph-mon[125939]: pgmap v8094: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 137 KiB/s wr, 8 op/s 2023-05-08T07:55:30.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:29 smithi096 ceph-mon[124666]: pgmap v8094: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 137 KiB/s wr, 8 op/s 2023-05-08T07:55:31.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15069.746243 secs 2023-05-08T07:55:31.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15069.746243 secs 2023-05-08T07:55:31.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15069.746243 secs 2023-05-08T07:55:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:31 smithi186 ceph-mon[126480]: pgmap v8095: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 137 KiB/s wr, 8 op/s 2023-05-08T07:55:32.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:31 smithi133 ceph-mon[125939]: pgmap v8095: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 137 KiB/s wr, 8 op/s 2023-05-08T07:55:32.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:31 smithi096 ceph-mon[124666]: pgmap v8095: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 137 KiB/s wr, 8 op/s 2023-05-08T07:55:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:33 smithi186 ceph-mon[126480]: pgmap v8096: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 126 KiB/s wr, 7 op/s 2023-05-08T07:55:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15072.906052 secs 2023-05-08T07:55:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15073.463598 secs 2023-05-08T07:55:34.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:33 smithi133 ceph-mon[125939]: pgmap v8096: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 126 KiB/s wr, 7 op/s 2023-05-08T07:55:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15072.906052 secs 2023-05-08T07:55:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15073.463598 secs 2023-05-08T07:55:34.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:33 smithi096 ceph-mon[124666]: pgmap v8096: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 126 KiB/s wr, 7 op/s 2023-05-08T07:55:34.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15072.906052 secs 2023-05-08T07:55:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15073.463598 secs 2023-05-08T07:55:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:35 smithi186 ceph-mon[126480]: pgmap v8097: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 115 KiB/s wr, 9 op/s 2023-05-08T07:55:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15074.746381 secs 2023-05-08T07:55:36.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:35 smithi133 ceph-mon[125939]: pgmap v8097: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 115 KiB/s wr, 9 op/s 2023-05-08T07:55:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15074.746381 secs 2023-05-08T07:55:36.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:35 smithi096 ceph-mon[124666]: pgmap v8097: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 115 KiB/s wr, 9 op/s 2023-05-08T07:55:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15074.746381 secs 2023-05-08T07:55:38.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:37 smithi186 ceph-mon[126480]: pgmap v8098: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 163 KiB/s wr, 7 op/s 2023-05-08T07:55:38.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:37 smithi133 ceph-mon[125939]: pgmap v8098: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 163 KiB/s wr, 7 op/s 2023-05-08T07:55:38.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:37 smithi096 ceph-mon[124666]: pgmap v8098: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 163 KiB/s wr, 7 op/s 2023-05-08T07:55:39.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15077.906168 secs 2023-05-08T07:55:39.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15078.463682 secs 2023-05-08T07:55:39.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15077.906168 secs 2023-05-08T07:55:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15078.463682 secs 2023-05-08T07:55:39.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15077.906168 secs 2023-05-08T07:55:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15078.463682 secs 2023-05-08T07:55:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:39 smithi186 ceph-mon[126480]: pgmap v8099: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 49 KiB/s wr, 6 op/s 2023-05-08T07:55:40.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:39 smithi133 ceph-mon[125939]: pgmap v8099: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 49 KiB/s wr, 6 op/s 2023-05-08T07:55:40.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:39 smithi096 ceph-mon[124666]: pgmap v8099: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 49 KiB/s wr, 6 op/s 2023-05-08T07:55:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:41 smithi186 ceph-mon[126480]: pgmap v8100: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 102 KiB/s wr, 10 op/s 2023-05-08T07:55:42.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:41 smithi133 ceph-mon[125939]: pgmap v8100: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 102 KiB/s wr, 10 op/s 2023-05-08T07:55:42.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:41 smithi096 ceph-mon[124666]: pgmap v8100: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 102 KiB/s wr, 10 op/s 2023-05-08T07:55:43.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:55:43.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:55:43.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:55:44.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:43 smithi186 ceph-mon[126480]: pgmap v8101: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 101 KiB/s wr, 6 op/s 2023-05-08T07:55:44.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:43 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:55:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:55:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:55:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15082.906303 secs 2023-05-08T07:55:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15083.463794 secs 2023-05-08T07:55:44.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:43 smithi133 ceph-mon[125939]: pgmap v8101: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 101 KiB/s wr, 6 op/s 2023-05-08T07:55:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:43 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:55:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:55:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:55:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15082.906303 secs 2023-05-08T07:55:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15083.463794 secs 2023-05-08T07:55:44.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:43 smithi096 ceph-mon[124666]: pgmap v8101: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 101 KiB/s wr, 6 op/s 2023-05-08T07:55:44.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:43 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:55:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:55:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:55:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15082.906303 secs 2023-05-08T07:55:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15083.463794 secs 2023-05-08T07:55:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:45 smithi186 ceph-mon[126480]: pgmap v8102: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 102 KiB/s wr, 8 op/s 2023-05-08T07:55:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15084.746620 secs 2023-05-08T07:55:46.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:45 smithi133 ceph-mon[125939]: pgmap v8102: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 102 KiB/s wr, 8 op/s 2023-05-08T07:55:46.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15084.746620 secs 2023-05-08T07:55:46.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:45 smithi096 ceph-mon[124666]: pgmap v8102: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 102 KiB/s wr, 8 op/s 2023-05-08T07:55:46.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15084.746620 secs 2023-05-08T07:55:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:47 smithi186 ceph-mon[126480]: pgmap v8103: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 193 KiB/s wr, 7 op/s 2023-05-08T07:55:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:47 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:55:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:47 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:55:48.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:47 smithi133 ceph-mon[125939]: pgmap v8103: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 193 KiB/s wr, 7 op/s 2023-05-08T07:55:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:47 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:55:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:47 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:55:48.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:47 smithi096 ceph-mon[124666]: pgmap v8103: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 193 KiB/s wr, 7 op/s 2023-05-08T07:55:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:47 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:55:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:47 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:55:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15087.906422 secs 2023-05-08T07:55:49.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15087.906422 secs 2023-05-08T07:55:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15087.906422 secs 2023-05-08T07:55:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:49 smithi186 ceph-mon[126480]: pgmap v8104: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 145 KiB/s wr, 6 op/s 2023-05-08T07:55:50.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:49 smithi133 ceph-mon[125939]: pgmap v8104: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 145 KiB/s wr, 6 op/s 2023-05-08T07:55:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:49 smithi096 ceph-mon[124666]: pgmap v8104: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 145 KiB/s wr, 6 op/s 2023-05-08T07:55:51.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15089.746781 secs 2023-05-08T07:55:51.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15089.746781 secs 2023-05-08T07:55:51.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15089.746781 secs 2023-05-08T07:55:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:51 smithi186 ceph-mon[126480]: pgmap v8105: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 178 KiB/s wr, 10 op/s 2023-05-08T07:55:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:55:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:51 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:55:52.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:51 smithi133 ceph-mon[125939]: pgmap v8105: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 178 KiB/s wr, 10 op/s 2023-05-08T07:55:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:55:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:51 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:55:52.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:51 smithi096 ceph-mon[124666]: pgmap v8105: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 178 KiB/s wr, 10 op/s 2023-05-08T07:55:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:55:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:51 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:55:53.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:55:53.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:55:53.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:55:53.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:55:53.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:55:53.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:55:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:53 smithi186 ceph-mon[126480]: pgmap v8106: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 126 KiB/s wr, 6 op/s 2023-05-08T07:55:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15092.906539 secs 2023-05-08T07:55:54.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:53 smithi133 ceph-mon[125939]: pgmap v8106: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 126 KiB/s wr, 6 op/s 2023-05-08T07:55:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15092.906539 secs 2023-05-08T07:55:54.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:53 smithi096 ceph-mon[124666]: pgmap v8106: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 126 KiB/s wr, 6 op/s 2023-05-08T07:55:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15092.906539 secs 2023-05-08T07:55:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:55 smithi186 ceph-mon[126480]: pgmap v8107: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 309 KiB/s wr, 11 op/s 2023-05-08T07:55:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15094.746897 secs 2023-05-08T07:55:56.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:55 smithi133 ceph-mon[125939]: pgmap v8107: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 309 KiB/s wr, 11 op/s 2023-05-08T07:55:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15094.746897 secs 2023-05-08T07:55:56.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:55 smithi096 ceph-mon[124666]: pgmap v8107: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 309 KiB/s wr, 11 op/s 2023-05-08T07:55:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15094.746897 secs 2023-05-08T07:55:57.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:56 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:55:57.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:56 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:55:57.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:56 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:55:58.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:57 smithi133 ceph-mon[125939]: pgmap v8108: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 309 KiB/s wr, 9 op/s 2023-05-08T07:55:58.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:57 smithi096 ceph-mon[124666]: pgmap v8108: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 309 KiB/s wr, 9 op/s 2023-05-08T07:55:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:57 smithi186 ceph-mon[126480]: pgmap v8108: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 309 KiB/s wr, 9 op/s 2023-05-08T07:55:59.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15097.906657 secs 2023-05-08T07:55:59.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:55:59.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15098.464118 secs 2023-05-08T07:55:59.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15097.906657 secs 2023-05-08T07:55:59.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:55:59.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15098.464118 secs 2023-05-08T07:55:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15097.906657 secs 2023-05-08T07:55:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:55:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15098.464118 secs 2023-05-08T07:56:00.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:59 smithi133 ceph-mon[125939]: pgmap v8109: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 217 KiB/s wr, 8 op/s 2023-05-08T07:56:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:59 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:56:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:59 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:56:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:56:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:56:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:55:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:56:00.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:59 smithi096 ceph-mon[124666]: pgmap v8109: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 217 KiB/s wr, 8 op/s 2023-05-08T07:56:00.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:59 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:56:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:59 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:56:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:56:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:56:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:55:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:56:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:59 smithi186 ceph-mon[126480]: pgmap v8109: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 217 KiB/s wr, 8 op/s 2023-05-08T07:56:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:59 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:56:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:59 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:56:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:56:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:56:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:55:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:56:01.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:00 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:56:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:00 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T07:56:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:00 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T07:56:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:00 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:56:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15099.747025 secs 2023-05-08T07:56:01.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:00 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:56:01.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:00 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T07:56:01.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:00 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T07:56:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:00 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:56:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15099.747025 secs 2023-05-08T07:56:01.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:00 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:56:01.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:00 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T07:56:01.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:00 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T07:56:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:00 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:56:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15099.747025 secs 2023-05-08T07:56:02.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:01 smithi133 ceph-mon[125939]: pgmap v8110: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 284 KiB/s wr, 13 op/s 2023-05-08T07:56:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:01 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:56:02.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:01 smithi096 ceph-mon[124666]: pgmap v8110: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 284 KiB/s wr, 13 op/s 2023-05-08T07:56:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:01 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:56:02.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:01 smithi186 ceph-mon[126480]: pgmap v8110: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 284 KiB/s wr, 13 op/s 2023-05-08T07:56:02.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:01 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:56:04.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:03 smithi133 ceph-mon[125939]: pgmap v8111: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 250 KiB/s wr, 9 op/s 2023-05-08T07:56:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15102.906774 secs 2023-05-08T07:56:04.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:03 smithi096 ceph-mon[124666]: pgmap v8111: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 250 KiB/s wr, 9 op/s 2023-05-08T07:56:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15102.906774 secs 2023-05-08T07:56:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:03 smithi186 ceph-mon[126480]: pgmap v8111: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 250 KiB/s wr, 9 op/s 2023-05-08T07:56:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15102.906774 secs 2023-05-08T07:56:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:05 smithi133 ceph-mon[125939]: pgmap v8112: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 548 KiB/s wr, 25 op/s 2023-05-08T07:56:06.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:05 smithi096 ceph-mon[124666]: pgmap v8112: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 548 KiB/s wr, 25 op/s 2023-05-08T07:56:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:05 smithi186 ceph-mon[126480]: pgmap v8112: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 548 KiB/s wr, 25 op/s 2023-05-08T07:56:07.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:07 smithi133 ceph-mon[125939]: pgmap v8113: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 365 KiB/s wr, 21 op/s 2023-05-08T07:56:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:07 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:56:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:07 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:56:08.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:07 smithi096 ceph-mon[124666]: pgmap v8113: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 365 KiB/s wr, 21 op/s 2023-05-08T07:56:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:07 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:56:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:07 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:56:08.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:07 smithi186 ceph-mon[126480]: pgmap v8113: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 365 KiB/s wr, 21 op/s 2023-05-08T07:56:08.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:07 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:56:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:07 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:56:08.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:08 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:56:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:56:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:56:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:56:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15107.906884 secs 2023-05-08T07:56:09.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:08 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:56:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:56:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:56:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:56:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15107.906884 secs 2023-05-08T07:56:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:08 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:56:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:56:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:56:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:56:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15107.906884 secs 2023-05-08T07:56:09.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:09 smithi133 ceph-mon[125939]: pgmap v8114: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 365 KiB/s wr, 20 op/s 2023-05-08T07:56:10.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:09 smithi096 ceph-mon[124666]: pgmap v8114: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 365 KiB/s wr, 20 op/s 2023-05-08T07:56:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:09 smithi186 ceph-mon[126480]: pgmap v8114: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 365 KiB/s wr, 20 op/s 2023-05-08T07:56:11.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:11 smithi133 ceph-mon[125939]: pgmap v8115: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 466 KiB/s wr, 25 op/s 2023-05-08T07:56:12.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:11 smithi096 ceph-mon[124666]: pgmap v8115: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 466 KiB/s wr, 25 op/s 2023-05-08T07:56:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:11 smithi186 ceph-mon[126480]: pgmap v8115: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 466 KiB/s wr, 25 op/s 2023-05-08T07:56:13.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:13 smithi133 ceph-mon[125939]: pgmap v8116: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 399 KiB/s wr, 20 op/s 2023-05-08T07:56:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15112.907019 secs 2023-05-08T07:56:14.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:13 smithi096 ceph-mon[124666]: pgmap v8116: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 399 KiB/s wr, 20 op/s 2023-05-08T07:56:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15112.907019 secs 2023-05-08T07:56:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:13 smithi186 ceph-mon[126480]: pgmap v8116: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 399 KiB/s wr, 20 op/s 2023-05-08T07:56:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15112.907019 secs 2023-05-08T07:56:15.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:15 smithi133 ceph-mon[125939]: pgmap v8117: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 422 KiB/s rd, 433 KiB/s wr, 23 op/s 2023-05-08T07:56:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:15 smithi096 ceph-mon[124666]: pgmap v8117: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 422 KiB/s rd, 433 KiB/s wr, 23 op/s 2023-05-08T07:56:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:15 smithi186 ceph-mon[126480]: pgmap v8117: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 422 KiB/s rd, 433 KiB/s wr, 23 op/s 2023-05-08T07:56:17.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:17 smithi133 ceph-mon[125939]: pgmap v8118: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 135 KiB/s wr, 7 op/s 2023-05-08T07:56:18.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:17 smithi096 ceph-mon[124666]: pgmap v8118: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 135 KiB/s wr, 7 op/s 2023-05-08T07:56:18.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:17 smithi186 ceph-mon[126480]: pgmap v8118: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 135 KiB/s wr, 7 op/s 2023-05-08T07:56:18.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15117.907137 secs 2023-05-08T07:56:19.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15117.907137 secs 2023-05-08T07:56:19.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15117.907137 secs 2023-05-08T07:56:19.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:19 smithi133 ceph-mon[125939]: pgmap v8119: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 135 KiB/s wr, 7 op/s 2023-05-08T07:56:20.108 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:19 smithi096 ceph-mon[124666]: pgmap v8119: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 135 KiB/s wr, 7 op/s 2023-05-08T07:56:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:19 smithi186 ceph-mon[126480]: pgmap v8119: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 135 KiB/s wr, 7 op/s 2023-05-08T07:56:20.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15119.747451 secs 2023-05-08T07:56:21.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15119.747451 secs 2023-05-08T07:56:21.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15119.747451 secs 2023-05-08T07:56:21.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:21 smithi133 ceph-mon[125939]: pgmap v8120: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 349 KiB/s wr, 12 op/s 2023-05-08T07:56:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:21 smithi133 ceph-mon[125939]: osdmap e584: 12 total, 12 up, 12 in 2023-05-08T07:56:22.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:21 smithi096 ceph-mon[124666]: pgmap v8120: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 349 KiB/s wr, 12 op/s 2023-05-08T07:56:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:21 smithi096 ceph-mon[124666]: osdmap e584: 12 total, 12 up, 12 in 2023-05-08T07:56:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:21 smithi186 ceph-mon[126480]: pgmap v8120: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 349 KiB/s wr, 12 op/s 2023-05-08T07:56:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:21 smithi186 ceph-mon[126480]: osdmap e584: 12 total, 12 up, 12 in 2023-05-08T07:56:23.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:23 smithi133 ceph-mon[125939]: pgmap v8122: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 298 KiB/s wr, 10 op/s 2023-05-08T07:56:23.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15122.907274 secs 2023-05-08T07:56:24.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:23 smithi096 ceph-mon[124666]: pgmap v8122: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 298 KiB/s wr, 10 op/s 2023-05-08T07:56:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15122.907274 secs 2023-05-08T07:56:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:23 smithi186 ceph-mon[126480]: pgmap v8122: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 298 KiB/s wr, 10 op/s 2023-05-08T07:56:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15122.907274 secs 2023-05-08T07:56:24.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:24 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:56:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:24 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:56:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:24 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:56:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15123.464742 secs 2023-05-08T07:56:25.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:24 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:56:25.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:24 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:56:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:24 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:56:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15123.464742 secs 2023-05-08T07:56:25.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:24 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:56:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:24 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:56:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:24 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:56:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15123.464742 secs 2023-05-08T07:56:25.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:25 smithi133 ceph-mon[125939]: pgmap v8123: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 259 KiB/s wr, 12 op/s 2023-05-08T07:56:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15124.747569 secs 2023-05-08T07:56:26.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:25 smithi096 ceph-mon[124666]: pgmap v8123: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 259 KiB/s wr, 12 op/s 2023-05-08T07:56:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15124.747569 secs 2023-05-08T07:56:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:25 smithi186 ceph-mon[126480]: pgmap v8123: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 259 KiB/s wr, 12 op/s 2023-05-08T07:56:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15124.747569 secs 2023-05-08T07:56:27.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:27 smithi133 ceph-mon[125939]: pgmap v8124: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 259 KiB/s wr, 12 op/s 2023-05-08T07:56:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:27 smithi096 ceph-mon[124666]: pgmap v8124: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 259 KiB/s wr, 12 op/s 2023-05-08T07:56:28.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:27 smithi186 ceph-mon[126480]: pgmap v8124: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 259 KiB/s wr, 12 op/s 2023-05-08T07:56:28.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:28 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:56:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:28 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:56:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15127.907390 secs 2023-05-08T07:56:29.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:28 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:56:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:28 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:56:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15127.907390 secs 2023-05-08T07:56:29.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:28 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:56:29.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:28 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:56:29.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15127.907390 secs 2023-05-08T07:56:29.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:29 smithi133 ceph-mon[125939]: pgmap v8125: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 259 KiB/s wr, 12 op/s 2023-05-08T07:56:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15128.464810 secs 2023-05-08T07:56:30.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:29 smithi096 ceph-mon[124666]: pgmap v8125: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 259 KiB/s wr, 12 op/s 2023-05-08T07:56:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15128.464810 secs 2023-05-08T07:56:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:29 smithi186 ceph-mon[126480]: pgmap v8125: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 259 KiB/s wr, 12 op/s 2023-05-08T07:56:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15128.464810 secs 2023-05-08T07:56:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15129.747667 secs 2023-05-08T07:56:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15129.747667 secs 2023-05-08T07:56:31.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15129.747667 secs 2023-05-08T07:56:32.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:31 smithi096 ceph-mon[124666]: pgmap v8126: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 110 KiB/s wr, 9 op/s 2023-05-08T07:56:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:31 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:56:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:31 smithi096 ceph-mon[124666]: osdmap e585: 12 total, 12 up, 12 in 2023-05-08T07:56:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:31 smithi186 ceph-mon[126480]: pgmap v8126: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 110 KiB/s wr, 9 op/s 2023-05-08T07:56:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:31 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:56:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:31 smithi186 ceph-mon[126480]: osdmap e585: 12 total, 12 up, 12 in 2023-05-08T07:56:32.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:31 smithi133 ceph-mon[125939]: pgmap v8126: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 110 KiB/s wr, 9 op/s 2023-05-08T07:56:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:31 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:56:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:31 smithi133 ceph-mon[125939]: osdmap e585: 12 total, 12 up, 12 in 2023-05-08T07:56:34.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:33 smithi096 ceph-mon[124666]: pgmap v8128: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 110 KiB/s wr, 9 op/s 2023-05-08T07:56:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15132.907513 secs 2023-05-08T07:56:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:33 smithi186 ceph-mon[126480]: pgmap v8128: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 110 KiB/s wr, 9 op/s 2023-05-08T07:56:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15132.907513 secs 2023-05-08T07:56:34.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:33 smithi133 ceph-mon[125939]: pgmap v8128: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 110 KiB/s wr, 9 op/s 2023-05-08T07:56:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15132.907513 secs 2023-05-08T07:56:35.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15133.464923 secs 2023-05-08T07:56:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15133.464923 secs 2023-05-08T07:56:35.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15133.464923 secs 2023-05-08T07:56:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:35 smithi186 ceph-mon[126480]: pgmap v8129: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 109 KiB/s wr, 8 op/s 2023-05-08T07:56:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15134.747729 secs 2023-05-08T07:56:36.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:35 smithi133 ceph-mon[125939]: pgmap v8129: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 109 KiB/s wr, 8 op/s 2023-05-08T07:56:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15134.747729 secs 2023-05-08T07:56:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:35 smithi096 ceph-mon[124666]: pgmap v8129: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 109 KiB/s wr, 8 op/s 2023-05-08T07:56:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15134.747729 secs 2023-05-08T07:56:38.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:37 smithi186 ceph-mon[126480]: pgmap v8130: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 109 KiB/s wr, 8 op/s 2023-05-08T07:56:38.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:37 smithi133 ceph-mon[125939]: pgmap v8130: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 109 KiB/s wr, 8 op/s 2023-05-08T07:56:38.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:37 smithi096 ceph-mon[124666]: pgmap v8130: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 109 KiB/s wr, 8 op/s 2023-05-08T07:56:39.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15137.907625 secs 2023-05-08T07:56:39.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15137.907625 secs 2023-05-08T07:56:39.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15137.907625 secs 2023-05-08T07:56:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:39 smithi186 ceph-mon[126480]: pgmap v8131: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 109 KiB/s wr, 8 op/s 2023-05-08T07:56:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15138.465062 secs 2023-05-08T07:56:40.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:39 smithi133 ceph-mon[125939]: pgmap v8131: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 109 KiB/s wr, 8 op/s 2023-05-08T07:56:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15138.465062 secs 2023-05-08T07:56:40.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:39 smithi096 ceph-mon[124666]: pgmap v8131: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 109 KiB/s wr, 8 op/s 2023-05-08T07:56:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15138.465062 secs 2023-05-08T07:56:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:41 smithi186 ceph-mon[126480]: pgmap v8132: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 129 KiB/s wr, 7 op/s 2023-05-08T07:56:42.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:41 smithi133 ceph-mon[125939]: pgmap v8132: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 129 KiB/s wr, 7 op/s 2023-05-08T07:56:42.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:41 smithi096 ceph-mon[124666]: pgmap v8132: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 129 KiB/s wr, 7 op/s 2023-05-08T07:56:44.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:43 smithi186 ceph-mon[126480]: pgmap v8133: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 118 KiB/s wr, 7 op/s 2023-05-08T07:56:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:56:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15142.907704 secs 2023-05-08T07:56:44.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:43 smithi133 ceph-mon[125939]: pgmap v8133: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 118 KiB/s wr, 7 op/s 2023-05-08T07:56:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:56:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15142.907704 secs 2023-05-08T07:56:44.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:43 smithi096 ceph-mon[124666]: pgmap v8133: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 118 KiB/s wr, 7 op/s 2023-05-08T07:56:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:56:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15142.907704 secs 2023-05-08T07:56:45.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:56:45.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:56:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:56:45.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:56:45.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:56:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:56:45.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:56:45.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:56:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:56:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:45 smithi186 ceph-mon[126480]: pgmap v8134: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 133 KiB/s wr, 10 op/s 2023-05-08T07:56:46.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:45 smithi133 ceph-mon[125939]: pgmap v8134: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 133 KiB/s wr, 10 op/s 2023-05-08T07:56:46.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:45 smithi096 ceph-mon[124666]: pgmap v8134: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 133 KiB/s wr, 10 op/s 2023-05-08T07:56:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:47 smithi186 ceph-mon[126480]: pgmap v8135: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 132 KiB/s wr, 7 op/s 2023-05-08T07:56:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:56:48.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:47 smithi133 ceph-mon[125939]: pgmap v8135: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 132 KiB/s wr, 7 op/s 2023-05-08T07:56:48.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:56:48.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:47 smithi096 ceph-mon[124666]: pgmap v8135: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 132 KiB/s wr, 7 op/s 2023-05-08T07:56:48.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:56:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:56:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:56:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15147.907802 secs 2023-05-08T07:56:49.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:56:49.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:56:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15147.907802 secs 2023-05-08T07:56:49.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:56:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:56:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15147.907802 secs 2023-05-08T07:56:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:49 smithi186 ceph-mon[126480]: pgmap v8136: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 132 KiB/s wr, 7 op/s 2023-05-08T07:56:50.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:49 smithi133 ceph-mon[125939]: pgmap v8136: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 132 KiB/s wr, 7 op/s 2023-05-08T07:56:50.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:49 smithi096 ceph-mon[124666]: pgmap v8136: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 132 KiB/s wr, 7 op/s 2023-05-08T07:56:51.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15149.748092 secs 2023-05-08T07:56:51.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15149.748092 secs 2023-05-08T07:56:51.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15149.748092 secs 2023-05-08T07:56:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:51 smithi186 ceph-mon[126480]: pgmap v8137: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 379 KiB/s wr, 13 op/s 2023-05-08T07:56:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:51 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:56:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:56:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:56:52.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:51 smithi133 ceph-mon[125939]: pgmap v8137: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 379 KiB/s wr, 13 op/s 2023-05-08T07:56:52.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:51 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:56:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:56:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:56:52.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:51 smithi096 ceph-mon[124666]: pgmap v8137: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 379 KiB/s wr, 13 op/s 2023-05-08T07:56:52.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:51 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:56:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:56:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:56:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:53 smithi186 ceph-mon[126480]: pgmap v8138: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 294 KiB/s rd, 272 KiB/s wr, 9 op/s 2023-05-08T07:56:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15152.907923 secs 2023-05-08T07:56:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15153.465442 secs 2023-05-08T07:56:54.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:53 smithi133 ceph-mon[125939]: pgmap v8138: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 294 KiB/s rd, 272 KiB/s wr, 9 op/s 2023-05-08T07:56:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15152.907923 secs 2023-05-08T07:56:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15153.465442 secs 2023-05-08T07:56:54.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:53 smithi096 ceph-mon[124666]: pgmap v8138: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 294 KiB/s rd, 272 KiB/s wr, 9 op/s 2023-05-08T07:56:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15152.907923 secs 2023-05-08T07:56:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15153.465442 secs 2023-05-08T07:56:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:55 smithi186 ceph-mon[126480]: pgmap v8139: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 535 KiB/s wr, 16 op/s 2023-05-08T07:56:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15154.748209 secs 2023-05-08T07:56:56.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:55 smithi133 ceph-mon[125939]: pgmap v8139: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 535 KiB/s wr, 16 op/s 2023-05-08T07:56:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15154.748209 secs 2023-05-08T07:56:56.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:55 smithi096 ceph-mon[124666]: pgmap v8139: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 535 KiB/s wr, 16 op/s 2023-05-08T07:56:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15154.748209 secs 2023-05-08T07:56:57.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:56 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:56:57.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:56:57.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:56:57.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:56 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:56:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:56:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:56:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:56 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:56:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:56:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:56:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:57 smithi186 ceph-mon[126480]: pgmap v8140: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 510 KiB/s wr, 11 op/s 2023-05-08T07:56:58.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:57 smithi133 ceph-mon[125939]: pgmap v8140: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 510 KiB/s wr, 11 op/s 2023-05-08T07:56:58.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:57 smithi096 ceph-mon[124666]: pgmap v8140: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 510 KiB/s wr, 11 op/s 2023-05-08T07:56:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15157.908040 secs 2023-05-08T07:56:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15158.465558 secs 2023-05-08T07:56:59.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15157.908040 secs 2023-05-08T07:56:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15158.465558 secs 2023-05-08T07:56:59.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15157.908040 secs 2023-05-08T07:56:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15158.465558 secs 2023-05-08T07:57:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:59 smithi186 ceph-mon[126480]: pgmap v8141: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 510 KiB/s wr, 11 op/s 2023-05-08T07:57:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:56:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:57:00.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:59 smithi133 ceph-mon[125939]: pgmap v8141: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 510 KiB/s wr, 11 op/s 2023-05-08T07:57:00.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:56:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:57:00.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:59 smithi096 ceph-mon[124666]: pgmap v8141: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 510 KiB/s wr, 11 op/s 2023-05-08T07:57:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:56:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:57:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:57:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:57:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:00 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:57:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:57:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:00 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T07:57:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:00 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T07:57:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:00 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:57:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15159.748336 secs 2023-05-08T07:57:01.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:57:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:57:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:00 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:57:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:57:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:00 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T07:57:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:00 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T07:57:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:00 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:57:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15159.748336 secs 2023-05-08T07:57:01.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:57:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:57:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:00 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:57:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:57:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:00 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T07:57:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:00 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T07:57:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:00 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:57:01.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15159.748336 secs 2023-05-08T07:57:02.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:01 smithi133 ceph-mon[125939]: pgmap v8142: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 631 KiB/s rd, 621 KiB/s wr, 16 op/s 2023-05-08T07:57:02.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:01 smithi096 ceph-mon[124666]: pgmap v8142: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 631 KiB/s rd, 621 KiB/s wr, 16 op/s 2023-05-08T07:57:02.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:01 smithi186 ceph-mon[126480]: pgmap v8142: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 631 KiB/s rd, 621 KiB/s wr, 16 op/s 2023-05-08T07:57:04.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:03 smithi133 ceph-mon[125939]: pgmap v8143: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 374 KiB/s wr, 10 op/s 2023-05-08T07:57:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15162.908159 secs 2023-05-08T07:57:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15163.465645 secs 2023-05-08T07:57:04.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:03 smithi096 ceph-mon[124666]: pgmap v8143: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 374 KiB/s wr, 10 op/s 2023-05-08T07:57:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15162.908159 secs 2023-05-08T07:57:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15163.465645 secs 2023-05-08T07:57:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:03 smithi186 ceph-mon[126480]: pgmap v8143: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 374 KiB/s wr, 10 op/s 2023-05-08T07:57:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15162.908159 secs 2023-05-08T07:57:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15163.465645 secs 2023-05-08T07:57:06.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:05 smithi133 ceph-mon[125939]: pgmap v8144: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 386 KiB/s rd, 420 KiB/s wr, 27 op/s 2023-05-08T07:57:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15164.748474 secs 2023-05-08T07:57:06.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:05 smithi096 ceph-mon[124666]: pgmap v8144: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 386 KiB/s rd, 420 KiB/s wr, 27 op/s 2023-05-08T07:57:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15164.748474 secs 2023-05-08T07:57:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:05 smithi186 ceph-mon[126480]: pgmap v8144: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 386 KiB/s rd, 420 KiB/s wr, 27 op/s 2023-05-08T07:57:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15164.748474 secs 2023-05-08T07:57:08.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:07 smithi133 ceph-mon[125939]: pgmap v8145: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 157 KiB/s wr, 21 op/s 2023-05-08T07:57:08.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:07 smithi096 ceph-mon[124666]: pgmap v8145: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 157 KiB/s wr, 21 op/s 2023-05-08T07:57:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:07 smithi186 ceph-mon[126480]: pgmap v8145: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 157 KiB/s wr, 21 op/s 2023-05-08T07:57:09.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15167.908313 secs 2023-05-08T07:57:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15168.465707 secs 2023-05-08T07:57:09.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15167.908313 secs 2023-05-08T07:57:09.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15168.465707 secs 2023-05-08T07:57:09.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15167.908313 secs 2023-05-08T07:57:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15168.465707 secs 2023-05-08T07:57:10.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:09 smithi133 ceph-mon[125939]: pgmap v8146: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 157 KiB/s wr, 21 op/s 2023-05-08T07:57:10.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:09 smithi096 ceph-mon[124666]: pgmap v8146: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 157 KiB/s wr, 21 op/s 2023-05-08T07:57:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:09 smithi186 ceph-mon[126480]: pgmap v8146: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 157 KiB/s wr, 21 op/s 2023-05-08T07:57:11.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15169.748598 secs 2023-05-08T07:57:11.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15169.748598 secs 2023-05-08T07:57:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15169.748598 secs 2023-05-08T07:57:12.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:11 smithi133 ceph-mon[125939]: pgmap v8147: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 191 KiB/s wr, 24 op/s 2023-05-08T07:57:12.343 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:11 smithi133 ceph-mon[125939]: osdmap e586: 12 total, 12 up, 12 in 2023-05-08T07:57:12.344 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:11 smithi096 ceph-mon[124666]: pgmap v8147: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 191 KiB/s wr, 24 op/s 2023-05-08T07:57:12.344 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:11 smithi096 ceph-mon[124666]: osdmap e586: 12 total, 12 up, 12 in 2023-05-08T07:57:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:11 smithi186 ceph-mon[126480]: pgmap v8147: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 191 KiB/s wr, 24 op/s 2023-05-08T07:57:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:11 smithi186 ceph-mon[126480]: osdmap e586: 12 total, 12 up, 12 in 2023-05-08T07:57:14.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:13 smithi133 ceph-mon[125939]: pgmap v8149: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 95 KiB/s wr, 23 op/s 2023-05-08T07:57:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15172.908428 secs 2023-05-08T07:57:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15173.465811 secs 2023-05-08T07:57:14.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:13 smithi096 ceph-mon[124666]: pgmap v8149: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 95 KiB/s wr, 23 op/s 2023-05-08T07:57:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15172.908428 secs 2023-05-08T07:57:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15173.465811 secs 2023-05-08T07:57:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:13 smithi186 ceph-mon[126480]: pgmap v8149: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 95 KiB/s wr, 23 op/s 2023-05-08T07:57:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15172.908428 secs 2023-05-08T07:57:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15173.465811 secs 2023-05-08T07:57:16.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:15 smithi133 ceph-mon[125939]: pgmap v8150: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 KiB/s wr, 6 op/s 2023-05-08T07:57:16.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15174.748716 secs 2023-05-08T07:57:16.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:15 smithi096 ceph-mon[124666]: pgmap v8150: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 KiB/s wr, 6 op/s 2023-05-08T07:57:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15174.748716 secs 2023-05-08T07:57:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:15 smithi186 ceph-mon[126480]: pgmap v8150: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 KiB/s wr, 6 op/s 2023-05-08T07:57:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15174.748716 secs 2023-05-08T07:57:18.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:17 smithi133 ceph-mon[125939]: pgmap v8151: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 KiB/s wr, 6 op/s 2023-05-08T07:57:18.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:17 smithi096 ceph-mon[124666]: pgmap v8151: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 KiB/s wr, 6 op/s 2023-05-08T07:57:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:17 smithi186 ceph-mon[126480]: pgmap v8151: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 KiB/s wr, 6 op/s 2023-05-08T07:57:19.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15177.908546 secs 2023-05-08T07:57:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15178.465924 secs 2023-05-08T07:57:19.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15177.908546 secs 2023-05-08T07:57:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15178.465924 secs 2023-05-08T07:57:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15177.908546 secs 2023-05-08T07:57:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15178.465924 secs 2023-05-08T07:57:20.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:19 smithi133 ceph-mon[125939]: pgmap v8152: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 KiB/s wr, 6 op/s 2023-05-08T07:57:20.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:19 smithi096 ceph-mon[124666]: pgmap v8152: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 KiB/s wr, 6 op/s 2023-05-08T07:57:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:19 smithi186 ceph-mon[126480]: pgmap v8152: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 KiB/s wr, 6 op/s 2023-05-08T07:57:21.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15179.748839 secs 2023-05-08T07:57:21.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15179.748839 secs 2023-05-08T07:57:21.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15179.748839 secs 2023-05-08T07:57:22.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:21 smithi133 ceph-mon[125939]: pgmap v8153: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 KiB/s wr, 6 op/s 2023-05-08T07:57:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:21 smithi133 ceph-mon[125939]: osdmap e587: 12 total, 12 up, 12 in 2023-05-08T07:57:22.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:21 smithi096 ceph-mon[124666]: pgmap v8153: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 KiB/s wr, 6 op/s 2023-05-08T07:57:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:21 smithi096 ceph-mon[124666]: osdmap e587: 12 total, 12 up, 12 in 2023-05-08T07:57:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:21 smithi186 ceph-mon[126480]: pgmap v8153: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 KiB/s wr, 6 op/s 2023-05-08T07:57:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:21 smithi186 ceph-mon[126480]: osdmap e587: 12 total, 12 up, 12 in 2023-05-08T07:57:24.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:23 smithi096 ceph-mon[124666]: pgmap v8155: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 KiB/s wr, 6 op/s 2023-05-08T07:57:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15182.908661 secs 2023-05-08T07:57:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15183.466041 secs 2023-05-08T07:57:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:23 smithi186 ceph-mon[126480]: pgmap v8155: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 KiB/s wr, 6 op/s 2023-05-08T07:57:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15182.908661 secs 2023-05-08T07:57:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15183.466041 secs 2023-05-08T07:57:24.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:23 smithi133 ceph-mon[125939]: pgmap v8155: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 KiB/s wr, 6 op/s 2023-05-08T07:57:24.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15182.908661 secs 2023-05-08T07:57:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15183.466041 secs 2023-05-08T07:57:26.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:25 smithi096 ceph-mon[124666]: pgmap v8156: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 KiB/s wr, 6 op/s 2023-05-08T07:57:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15184.748915 secs 2023-05-08T07:57:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:25 smithi186 ceph-mon[126480]: pgmap v8156: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 KiB/s wr, 6 op/s 2023-05-08T07:57:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15184.748915 secs 2023-05-08T07:57:26.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:25 smithi133 ceph-mon[125939]: pgmap v8156: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 KiB/s wr, 6 op/s 2023-05-08T07:57:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15184.748915 secs 2023-05-08T07:57:28.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:27 smithi096 ceph-mon[124666]: pgmap v8157: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 KiB/s wr, 6 op/s 2023-05-08T07:57:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:28 smithi186 ceph-mon[126480]: pgmap v8157: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 KiB/s wr, 6 op/s 2023-05-08T07:57:28.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:28 smithi133 ceph-mon[125939]: pgmap v8157: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 KiB/s wr, 6 op/s 2023-05-08T07:57:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15187.908775 secs 2023-05-08T07:57:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15188.466136 secs 2023-05-08T07:57:29.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15187.908775 secs 2023-05-08T07:57:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15188.466136 secs 2023-05-08T07:57:29.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15187.908775 secs 2023-05-08T07:57:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15188.466136 secs 2023-05-08T07:57:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:30 smithi186 ceph-mon[126480]: pgmap v8158: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 KiB/s wr, 6 op/s 2023-05-08T07:57:30.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:30 smithi133 ceph-mon[125939]: pgmap v8158: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 KiB/s wr, 6 op/s 2023-05-08T07:57:30.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:30 smithi096 ceph-mon[124666]: pgmap v8158: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 KiB/s wr, 6 op/s 2023-05-08T07:57:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15189.748981 secs 2023-05-08T07:57:31.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15189.748981 secs 2023-05-08T07:57:31.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15189.748981 secs 2023-05-08T07:57:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:32 smithi186 ceph-mon[126480]: pgmap v8159: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T07:57:32.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:32 smithi133 ceph-mon[125939]: pgmap v8159: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T07:57:32.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:32 smithi096 ceph-mon[124666]: pgmap v8159: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T07:57:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:34 smithi186 ceph-mon[126480]: pgmap v8160: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 93 B/s wr, 6 op/s 2023-05-08T07:57:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15192.908892 secs 2023-05-08T07:57:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15193.466256 secs 2023-05-08T07:57:34.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:34 smithi133 ceph-mon[125939]: pgmap v8160: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 93 B/s wr, 6 op/s 2023-05-08T07:57:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15192.908892 secs 2023-05-08T07:57:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15193.466256 secs 2023-05-08T07:57:34.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:34 smithi096 ceph-mon[124666]: pgmap v8160: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 93 B/s wr, 6 op/s 2023-05-08T07:57:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15192.908892 secs 2023-05-08T07:57:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15193.466256 secs 2023-05-08T07:57:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:36 smithi186 ceph-mon[126480]: pgmap v8161: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 42 KiB/s wr, 9 op/s 2023-05-08T07:57:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15194.749090 secs 2023-05-08T07:57:36.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:36 smithi133 ceph-mon[125939]: pgmap v8161: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 42 KiB/s wr, 9 op/s 2023-05-08T07:57:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15194.749090 secs 2023-05-08T07:57:36.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:36 smithi096 ceph-mon[124666]: pgmap v8161: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 42 KiB/s wr, 9 op/s 2023-05-08T07:57:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15194.749090 secs 2023-05-08T07:57:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:38 smithi186 ceph-mon[126480]: pgmap v8162: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 42 KiB/s wr, 7 op/s 2023-05-08T07:57:38.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:38 smithi133 ceph-mon[125939]: pgmap v8162: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 42 KiB/s wr, 7 op/s 2023-05-08T07:57:38.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:38 smithi096 ceph-mon[124666]: pgmap v8162: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 42 KiB/s wr, 7 op/s 2023-05-08T07:57:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15197.908956 secs 2023-05-08T07:57:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15198.466370 secs 2023-05-08T07:57:39.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15197.908956 secs 2023-05-08T07:57:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15198.466370 secs 2023-05-08T07:57:39.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15197.908956 secs 2023-05-08T07:57:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15198.466370 secs 2023-05-08T07:57:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:40 smithi186 ceph-mon[126480]: pgmap v8163: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 42 KiB/s wr, 7 op/s 2023-05-08T07:57:40.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:40 smithi133 ceph-mon[125939]: pgmap v8163: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 42 KiB/s wr, 7 op/s 2023-05-08T07:57:40.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:40 smithi096 ceph-mon[124666]: pgmap v8163: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 42 KiB/s wr, 7 op/s 2023-05-08T07:57:42.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:42 smithi186 ceph-mon[126480]: pgmap v8164: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 224 KiB/s wr, 11 op/s 2023-05-08T07:57:42.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:42 smithi133 ceph-mon[125939]: pgmap v8164: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 224 KiB/s wr, 11 op/s 2023-05-08T07:57:42.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:42 smithi096 ceph-mon[124666]: pgmap v8164: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 224 KiB/s wr, 11 op/s 2023-05-08T07:57:43.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:57:43.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:57:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:57:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:44 smithi186 ceph-mon[126480]: pgmap v8165: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 224 KiB/s wr, 8 op/s 2023-05-08T07:57:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:57:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:57:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:57:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15202.909087 secs 2023-05-08T07:57:44.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:44 smithi133 ceph-mon[125939]: pgmap v8165: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 224 KiB/s wr, 8 op/s 2023-05-08T07:57:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:57:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:57:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:57:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15202.909087 secs 2023-05-08T07:57:44.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:44 smithi096 ceph-mon[124666]: pgmap v8165: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 224 KiB/s wr, 8 op/s 2023-05-08T07:57:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:57:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:57:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:57:44.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15202.909087 secs 2023-05-08T07:57:46.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:46 smithi186 ceph-mon[126480]: pgmap v8166: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 245 KiB/s wr, 12 op/s 2023-05-08T07:57:46.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:46 smithi133 ceph-mon[125939]: pgmap v8166: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 245 KiB/s wr, 12 op/s 2023-05-08T07:57:46.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:46 smithi096 ceph-mon[124666]: pgmap v8166: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 245 KiB/s wr, 12 op/s 2023-05-08T07:57:47.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:47 smithi133 ceph-mon[125939]: pgmap v8167: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 204 KiB/s wr, 8 op/s 2023-05-08T07:57:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:57:48.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:47 smithi096 ceph-mon[124666]: pgmap v8167: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 204 KiB/s wr, 8 op/s 2023-05-08T07:57:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:57:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:47 smithi186 ceph-mon[126480]: pgmap v8167: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 204 KiB/s wr, 8 op/s 2023-05-08T07:57:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:57:48.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:57:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:57:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15207.909202 secs 2023-05-08T07:57:49.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:57:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:57:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15207.909202 secs 2023-05-08T07:57:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:57:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:57:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15207.909202 secs 2023-05-08T07:57:49.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:49 smithi133 ceph-mon[125939]: pgmap v8168: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 204 KiB/s wr, 8 op/s 2023-05-08T07:57:50.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:49 smithi096 ceph-mon[124666]: pgmap v8168: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 204 KiB/s wr, 8 op/s 2023-05-08T07:57:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:49 smithi186 ceph-mon[126480]: pgmap v8168: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 204 KiB/s wr, 8 op/s 2023-05-08T07:57:50.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15209.749433 secs 2023-05-08T07:57:51.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15209.749433 secs 2023-05-08T07:57:51.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15209.749433 secs 2023-05-08T07:57:51.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:51 smithi133 ceph-mon[125939]: pgmap v8169: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 483 KiB/s rd, 470 KiB/s wr, 13 op/s 2023-05-08T07:57:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:51 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:57:52.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:51 smithi096 ceph-mon[124666]: pgmap v8169: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 483 KiB/s rd, 470 KiB/s wr, 13 op/s 2023-05-08T07:57:52.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:51 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:57:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:51 smithi186 ceph-mon[126480]: pgmap v8169: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 483 KiB/s rd, 470 KiB/s wr, 13 op/s 2023-05-08T07:57:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:51 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:57:52.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:57:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:57:53.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:57:53.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:57:53.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:57:53.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:57:53.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:53 smithi133 ceph-mon[125939]: pgmap v8170: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 287 KiB/s wr, 9 op/s 2023-05-08T07:57:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15212.909326 secs 2023-05-08T07:57:54.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:53 smithi096 ceph-mon[124666]: pgmap v8170: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 287 KiB/s wr, 9 op/s 2023-05-08T07:57:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15212.909326 secs 2023-05-08T07:57:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:53 smithi186 ceph-mon[126480]: pgmap v8170: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 287 KiB/s wr, 9 op/s 2023-05-08T07:57:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15212.909326 secs 2023-05-08T07:57:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:55 smithi133 ceph-mon[125939]: pgmap v8171: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 377 KiB/s wr, 15 op/s 2023-05-08T07:57:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15214.749515 secs 2023-05-08T07:57:56.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:55 smithi096 ceph-mon[124666]: pgmap v8171: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 377 KiB/s wr, 15 op/s 2023-05-08T07:57:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15214.749515 secs 2023-05-08T07:57:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:55 smithi186 ceph-mon[126480]: pgmap v8171: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 377 KiB/s wr, 15 op/s 2023-05-08T07:57:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15214.749515 secs 2023-05-08T07:57:57.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:56 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:57:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:56 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:57:57.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:56 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:57:58.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:57 smithi096 ceph-mon[124666]: pgmap v8172: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 355 KiB/s wr, 11 op/s 2023-05-08T07:57:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:57 smithi186 ceph-mon[126480]: pgmap v8172: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 355 KiB/s wr, 11 op/s 2023-05-08T07:57:58.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:57 smithi133 ceph-mon[125939]: pgmap v8172: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 355 KiB/s wr, 11 op/s 2023-05-08T07:57:59.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15217.909439 secs 2023-05-08T07:57:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15217.909439 secs 2023-05-08T07:57:59.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15217.909439 secs 2023-05-08T07:58:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:59 smithi096 ceph-mon[124666]: pgmap v8173: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 355 KiB/s wr, 10 op/s 2023-05-08T07:58:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:57:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15218.466822 secs 2023-05-08T07:58:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:59 smithi186 ceph-mon[126480]: pgmap v8173: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 355 KiB/s wr, 10 op/s 2023-05-08T07:58:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:57:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15218.466822 secs 2023-05-08T07:58:00.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:59 smithi133 ceph-mon[125939]: pgmap v8173: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 355 KiB/s wr, 10 op/s 2023-05-08T07:58:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:57:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15218.466822 secs 2023-05-08T07:58:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:58:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:58:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15219.749663 secs 2023-05-08T07:58:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:58:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:58:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:58:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15219.749663 secs 2023-05-08T07:58:01.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:58:01.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:58:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:58:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15219.749663 secs 2023-05-08T07:58:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:58:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:01 smithi186 ceph-mon[126480]: pgmap v8174: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 489 KiB/s wr, 15 op/s 2023-05-08T07:58:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:01 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:58:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:01 smithi133 ceph-mon[125939]: pgmap v8174: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 489 KiB/s wr, 15 op/s 2023-05-08T07:58:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:01 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:58:02.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:01 smithi096 ceph-mon[124666]: pgmap v8174: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 489 KiB/s wr, 15 op/s 2023-05-08T07:58:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:01 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:58:04.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:03 smithi186 ceph-mon[126480]: pgmap v8175: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 223 KiB/s wr, 10 op/s 2023-05-08T07:58:04.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:58:04.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:58:04.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:58:04.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:58:04.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:58:04.123 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:58:04.123 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15222.909508 secs 2023-05-08T07:58:04.124 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:58:04.124 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:58:04.128 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:58:04.129 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:58:04.129 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:58:04.130 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:58:04.130 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:58:04.132 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:58:04.132 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:58:04.132 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:58:04.132 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:58:04.133 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:58:04.133 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:58:04.133 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:58:04.133 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:58:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:03 smithi133 ceph-mon[125939]: pgmap v8175: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 223 KiB/s wr, 10 op/s 2023-05-08T07:58:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:58:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:58:04.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:58:04.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:58:04.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:58:04.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:58:04.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15222.909508 secs 2023-05-08T07:58:04.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:58:04.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:58:04.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:58:04.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:58:04.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:58:04.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:58:04.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:58:04.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:58:04.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:58:04.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:58:04.244 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:58:04.244 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:58:04.244 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:58:04.244 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:58:04.244 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:58:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:03 smithi096 ceph-mon[124666]: pgmap v8175: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 223 KiB/s wr, 10 op/s 2023-05-08T07:58:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:58:04.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:58:04.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:58:04.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:58:04.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:58:04.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:58:04.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15222.909508 secs 2023-05-08T07:58:04.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:58:04.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:58:04.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:58:04.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:58:04.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:58:04.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:58:04.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:58:04.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:58:04.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:58:04.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:58:04.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:58:04.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T07:58:04.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:58:04.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:58:04.259 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:58:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:04 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi096 to 110.2M 2023-05-08T07:58:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:04 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi096 to 115572445: error parsing value: Value '115572445' is below minimum 939524096 2023-05-08T07:58:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:04 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T07:58:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:04 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T07:58:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:04 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T07:58:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:04 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T07:58:05.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:04 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:58:05.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:04 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T07:58:05.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:04 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T07:58:05.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:04 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:58:05.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15223.466943 secs 2023-05-08T07:58:05.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:04 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi096 to 110.2M 2023-05-08T07:58:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:04 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi096 to 115572445: error parsing value: Value '115572445' is below minimum 939524096 2023-05-08T07:58:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:04 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T07:58:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:04 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T07:58:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:04 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T07:58:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:04 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T07:58:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:04 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:58:05.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:04 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T07:58:05.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:04 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T07:58:05.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:04 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:58:05.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15223.466943 secs 2023-05-08T07:58:05.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:04 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi096 to 110.2M 2023-05-08T07:58:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:04 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi096 to 115572445: error parsing value: Value '115572445' is below minimum 939524096 2023-05-08T07:58:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:04 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T07:58:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:04 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T07:58:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:04 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T07:58:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:04 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T07:58:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:04 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:58:05.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:04 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T07:58:05.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:04 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T07:58:05.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:04 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:58:05.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15223.466943 secs 2023-05-08T07:58:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:05 smithi186 ceph-mon[126480]: pgmap v8176: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 268 KiB/s wr, 27 op/s 2023-05-08T07:58:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15224.749759 secs 2023-05-08T07:58:06.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:05 smithi133 ceph-mon[125939]: pgmap v8176: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 268 KiB/s wr, 27 op/s 2023-05-08T07:58:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15224.749759 secs 2023-05-08T07:58:06.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:05 smithi096 ceph-mon[124666]: pgmap v8176: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 268 KiB/s wr, 27 op/s 2023-05-08T07:58:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15224.749759 secs 2023-05-08T07:58:08.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:07 smithi186 ceph-mon[126480]: pgmap v8177: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 178 KiB/s wr, 22 op/s 2023-05-08T07:58:08.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:07 smithi133 ceph-mon[125939]: pgmap v8177: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 178 KiB/s wr, 22 op/s 2023-05-08T07:58:08.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:07 smithi096 ceph-mon[124666]: pgmap v8177: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 178 KiB/s wr, 22 op/s 2023-05-08T07:58:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15227.909632 secs 2023-05-08T07:58:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15228.467056 secs 2023-05-08T07:58:09.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15227.909632 secs 2023-05-08T07:58:09.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15228.467056 secs 2023-05-08T07:58:09.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15227.909632 secs 2023-05-08T07:58:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15228.467056 secs 2023-05-08T07:58:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:09 smithi186 ceph-mon[126480]: pgmap v8178: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 178 KiB/s wr, 22 op/s 2023-05-08T07:58:10.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:09 smithi133 ceph-mon[125939]: pgmap v8178: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 178 KiB/s wr, 22 op/s 2023-05-08T07:58:10.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:09 smithi096 ceph-mon[124666]: pgmap v8178: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 178 KiB/s wr, 22 op/s 2023-05-08T07:58:11.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15229.749871 secs 2023-05-08T07:58:11.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15229.749871 secs 2023-05-08T07:58:11.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15229.749871 secs 2023-05-08T07:58:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:11 smithi186 ceph-mon[126480]: pgmap v8179: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 292 KiB/s wr, 25 op/s 2023-05-08T07:58:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:11 smithi186 ceph-mon[126480]: osdmap e588: 12 total, 12 up, 12 in 2023-05-08T07:58:12.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:11 smithi133 ceph-mon[125939]: pgmap v8179: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 292 KiB/s wr, 25 op/s 2023-05-08T07:58:12.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:11 smithi133 ceph-mon[125939]: osdmap e588: 12 total, 12 up, 12 in 2023-05-08T07:58:12.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:11 smithi096 ceph-mon[124666]: pgmap v8179: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 292 KiB/s wr, 25 op/s 2023-05-08T07:58:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:11 smithi096 ceph-mon[124666]: osdmap e588: 12 total, 12 up, 12 in 2023-05-08T07:58:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:13 smithi186 ceph-mon[126480]: pgmap v8181: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 190 KiB/s wr, 25 op/s 2023-05-08T07:58:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15232.909721 secs 2023-05-08T07:58:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15233.467179 secs 2023-05-08T07:58:14.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:13 smithi133 ceph-mon[125939]: pgmap v8181: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 190 KiB/s wr, 25 op/s 2023-05-08T07:58:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15232.909721 secs 2023-05-08T07:58:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15233.467179 secs 2023-05-08T07:58:14.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:13 smithi096 ceph-mon[124666]: pgmap v8181: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 190 KiB/s wr, 25 op/s 2023-05-08T07:58:14.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15232.909721 secs 2023-05-08T07:58:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15233.467179 secs 2023-05-08T07:58:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:15 smithi186 ceph-mon[126480]: pgmap v8182: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 137 KiB/s wr, 7 op/s 2023-05-08T07:58:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15234.749988 secs 2023-05-08T07:58:16.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:15 smithi133 ceph-mon[125939]: pgmap v8182: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 137 KiB/s wr, 7 op/s 2023-05-08T07:58:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15234.749988 secs 2023-05-08T07:58:16.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:15 smithi096 ceph-mon[124666]: pgmap v8182: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 137 KiB/s wr, 7 op/s 2023-05-08T07:58:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15234.749988 secs 2023-05-08T07:58:18.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:17 smithi186 ceph-mon[126480]: pgmap v8183: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 137 KiB/s wr, 7 op/s 2023-05-08T07:58:18.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:17 smithi133 ceph-mon[125939]: pgmap v8183: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 137 KiB/s wr, 7 op/s 2023-05-08T07:58:18.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:17 smithi096 ceph-mon[124666]: pgmap v8183: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 137 KiB/s wr, 7 op/s 2023-05-08T07:58:19.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15237.909859 secs 2023-05-08T07:58:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15238.467291 secs 2023-05-08T07:58:19.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15237.909859 secs 2023-05-08T07:58:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15238.467291 secs 2023-05-08T07:58:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15237.909859 secs 2023-05-08T07:58:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15238.467291 secs 2023-05-08T07:58:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:19 smithi186 ceph-mon[126480]: pgmap v8184: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 137 KiB/s wr, 7 op/s 2023-05-08T07:58:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:19 smithi133 ceph-mon[125939]: pgmap v8184: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 137 KiB/s wr, 7 op/s 2023-05-08T07:58:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:19 smithi096 ceph-mon[124666]: pgmap v8184: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 137 KiB/s wr, 7 op/s 2023-05-08T07:58:21.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15239.750080 secs 2023-05-08T07:58:21.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15239.750080 secs 2023-05-08T07:58:21.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15239.750080 secs 2023-05-08T07:58:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:21 smithi186 ceph-mon[126480]: pgmap v8185: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 KiB/s wr, 6 op/s 2023-05-08T07:58:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:21 smithi186 ceph-mon[126480]: osdmap e589: 12 total, 12 up, 12 in 2023-05-08T07:58:22.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:21 smithi133 ceph-mon[125939]: pgmap v8185: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 KiB/s wr, 6 op/s 2023-05-08T07:58:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:21 smithi133 ceph-mon[125939]: osdmap e589: 12 total, 12 up, 12 in 2023-05-08T07:58:22.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:21 smithi096 ceph-mon[124666]: pgmap v8185: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 KiB/s wr, 6 op/s 2023-05-08T07:58:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:21 smithi096 ceph-mon[124666]: osdmap e589: 12 total, 12 up, 12 in 2023-05-08T07:58:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:23 smithi186 ceph-mon[126480]: pgmap v8187: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 KiB/s wr, 6 op/s 2023-05-08T07:58:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15242.909911 secs 2023-05-08T07:58:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15243.467426 secs 2023-05-08T07:58:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:23 smithi133 ceph-mon[125939]: pgmap v8187: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 KiB/s wr, 6 op/s 2023-05-08T07:58:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15242.909911 secs 2023-05-08T07:58:24.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15243.467426 secs 2023-05-08T07:58:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:23 smithi096 ceph-mon[124666]: pgmap v8187: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 KiB/s wr, 6 op/s 2023-05-08T07:58:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15242.909911 secs 2023-05-08T07:58:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15243.467426 secs 2023-05-08T07:58:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:25 smithi186 ceph-mon[126480]: pgmap v8188: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 KiB/s wr, 6 op/s 2023-05-08T07:58:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15244.750200 secs 2023-05-08T07:58:26.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:25 smithi133 ceph-mon[125939]: pgmap v8188: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 KiB/s wr, 6 op/s 2023-05-08T07:58:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15244.750200 secs 2023-05-08T07:58:26.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:25 smithi096 ceph-mon[124666]: pgmap v8188: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 KiB/s wr, 6 op/s 2023-05-08T07:58:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15244.750200 secs 2023-05-08T07:58:28.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:27 smithi186 ceph-mon[126480]: pgmap v8189: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 KiB/s wr, 6 op/s 2023-05-08T07:58:28.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:27 smithi133 ceph-mon[125939]: pgmap v8189: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 KiB/s wr, 6 op/s 2023-05-08T07:58:28.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:27 smithi096 ceph-mon[124666]: pgmap v8189: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 KiB/s wr, 6 op/s 2023-05-08T07:58:29.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15247.910033 secs 2023-05-08T07:58:29.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15248.467560 secs 2023-05-08T07:58:29.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15247.910033 secs 2023-05-08T07:58:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15248.467560 secs 2023-05-08T07:58:29.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15247.910033 secs 2023-05-08T07:58:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15248.467560 secs 2023-05-08T07:58:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:29 smithi186 ceph-mon[126480]: pgmap v8190: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 KiB/s wr, 6 op/s 2023-05-08T07:58:30.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:29 smithi133 ceph-mon[125939]: pgmap v8190: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 KiB/s wr, 6 op/s 2023-05-08T07:58:30.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:29 smithi096 ceph-mon[124666]: pgmap v8190: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 KiB/s wr, 6 op/s 2023-05-08T07:58:31.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15249.750316 secs 2023-05-08T07:58:31.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15249.750316 secs 2023-05-08T07:58:31.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15249.750316 secs 2023-05-08T07:58:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:31 smithi186 ceph-mon[126480]: pgmap v8191: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T07:58:32.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:31 smithi133 ceph-mon[125939]: pgmap v8191: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T07:58:32.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:31 smithi096 ceph-mon[124666]: pgmap v8191: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T07:58:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:33 smithi186 ceph-mon[126480]: pgmap v8192: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 93 B/s wr, 6 op/s 2023-05-08T07:58:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15252.910174 secs 2023-05-08T07:58:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15253.467679 secs 2023-05-08T07:58:34.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:33 smithi133 ceph-mon[125939]: pgmap v8192: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 93 B/s wr, 6 op/s 2023-05-08T07:58:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15252.910174 secs 2023-05-08T07:58:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15253.467679 secs 2023-05-08T07:58:34.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:33 smithi096 ceph-mon[124666]: pgmap v8192: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 93 B/s wr, 6 op/s 2023-05-08T07:58:34.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15252.910174 secs 2023-05-08T07:58:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15253.467679 secs 2023-05-08T07:58:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:35 smithi186 ceph-mon[126480]: pgmap v8193: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 938 B/s wr, 8 op/s 2023-05-08T07:58:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15254.750466 secs 2023-05-08T07:58:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:35 smithi133 ceph-mon[125939]: pgmap v8193: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 938 B/s wr, 8 op/s 2023-05-08T07:58:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15254.750466 secs 2023-05-08T07:58:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:35 smithi096 ceph-mon[124666]: pgmap v8193: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 938 B/s wr, 8 op/s 2023-05-08T07:58:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15254.750466 secs 2023-05-08T07:58:38.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:37 smithi186 ceph-mon[126480]: pgmap v8194: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 853 B/s wr, 6 op/s 2023-05-08T07:58:38.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:37 smithi133 ceph-mon[125939]: pgmap v8194: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 853 B/s wr, 6 op/s 2023-05-08T07:58:38.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:37 smithi096 ceph-mon[124666]: pgmap v8194: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 853 B/s wr, 6 op/s 2023-05-08T07:58:39.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15257.910292 secs 2023-05-08T07:58:39.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15258.467793 secs 2023-05-08T07:58:39.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15257.910292 secs 2023-05-08T07:58:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15258.467793 secs 2023-05-08T07:58:39.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15257.910292 secs 2023-05-08T07:58:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15258.467793 secs 2023-05-08T07:58:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:39 smithi186 ceph-mon[126480]: pgmap v8195: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 853 B/s wr, 6 op/s 2023-05-08T07:58:40.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:39 smithi133 ceph-mon[125939]: pgmap v8195: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 853 B/s wr, 6 op/s 2023-05-08T07:58:40.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:39 smithi096 ceph-mon[124666]: pgmap v8195: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 853 B/s wr, 6 op/s 2023-05-08T07:58:42.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:41 smithi133 ceph-mon[125939]: pgmap v8196: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 104 KiB/s wr, 9 op/s 2023-05-08T07:58:42.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:41 smithi096 ceph-mon[124666]: pgmap v8196: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 104 KiB/s wr, 9 op/s 2023-05-08T07:58:42.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:41 smithi186 ceph-mon[126480]: pgmap v8196: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 104 KiB/s wr, 9 op/s 2023-05-08T07:58:43.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:58:43.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:58:43.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:58:44.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:43 smithi133 ceph-mon[125939]: pgmap v8197: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 104 KiB/s wr, 6 op/s 2023-05-08T07:58:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:43 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:58:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:58:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:58:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15262.910409 secs 2023-05-08T07:58:44.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:43 smithi096 ceph-mon[124666]: pgmap v8197: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 104 KiB/s wr, 6 op/s 2023-05-08T07:58:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:43 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:58:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:58:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:58:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15262.910409 secs 2023-05-08T07:58:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:43 smithi186 ceph-mon[126480]: pgmap v8197: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 104 KiB/s wr, 6 op/s 2023-05-08T07:58:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:43 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:58:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:58:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:58:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15262.910409 secs 2023-05-08T07:58:46.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:45 smithi133 ceph-mon[125939]: pgmap v8198: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 126 KiB/s wr, 10 op/s 2023-05-08T07:58:46.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:45 smithi096 ceph-mon[124666]: pgmap v8198: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 126 KiB/s wr, 10 op/s 2023-05-08T07:58:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:45 smithi186 ceph-mon[126480]: pgmap v8198: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 126 KiB/s wr, 10 op/s 2023-05-08T07:58:48.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:47 smithi133 ceph-mon[125939]: pgmap v8199: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 125 KiB/s wr, 7 op/s 2023-05-08T07:58:48.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:58:48.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:47 smithi096 ceph-mon[124666]: pgmap v8199: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 125 KiB/s wr, 7 op/s 2023-05-08T07:58:48.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:58:48.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:47 smithi186 ceph-mon[126480]: pgmap v8199: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 125 KiB/s wr, 7 op/s 2023-05-08T07:58:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:58:49.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:48 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:58:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:58:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:58:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15267.910473 secs 2023-05-08T07:58:49.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:48 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:58:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:58:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:58:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15267.910473 secs 2023-05-08T07:58:49.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:48 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:58:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:58:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:58:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15267.910473 secs 2023-05-08T07:58:50.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:49 smithi133 ceph-mon[125939]: pgmap v8200: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 125 KiB/s wr, 7 op/s 2023-05-08T07:58:50.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:49 smithi096 ceph-mon[124666]: pgmap v8200: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 125 KiB/s wr, 7 op/s 2023-05-08T07:58:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:49 smithi186 ceph-mon[126480]: pgmap v8200: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 125 KiB/s wr, 7 op/s 2023-05-08T07:58:51.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15269.750857 secs 2023-05-08T07:58:51.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15269.750857 secs 2023-05-08T07:58:51.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15269.750857 secs 2023-05-08T07:58:52.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:51 smithi133 ceph-mon[125939]: pgmap v8201: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 379 KiB/s wr, 12 op/s 2023-05-08T07:58:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:58:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:58:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:51 smithi096 ceph-mon[124666]: pgmap v8201: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 379 KiB/s wr, 12 op/s 2023-05-08T07:58:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:58:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:58:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:51 smithi186 ceph-mon[126480]: pgmap v8201: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 379 KiB/s wr, 12 op/s 2023-05-08T07:58:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:58:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:58:54.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:53 smithi133 ceph-mon[125939]: pgmap v8202: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 275 KiB/s wr, 9 op/s 2023-05-08T07:58:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15272.910584 secs 2023-05-08T07:58:54.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:53 smithi096 ceph-mon[124666]: pgmap v8202: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 275 KiB/s wr, 9 op/s 2023-05-08T07:58:54.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15272.910584 secs 2023-05-08T07:58:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:53 smithi186 ceph-mon[126480]: pgmap v8202: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 275 KiB/s wr, 9 op/s 2023-05-08T07:58:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15272.910584 secs 2023-05-08T07:58:56.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:55 smithi133 ceph-mon[125939]: pgmap v8203: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 365 KiB/s wr, 14 op/s 2023-05-08T07:58:56.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15274.750975 secs 2023-05-08T07:58:56.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:55 smithi096 ceph-mon[124666]: pgmap v8203: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 365 KiB/s wr, 14 op/s 2023-05-08T07:58:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15274.750975 secs 2023-05-08T07:58:56.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:55 smithi186 ceph-mon[126480]: pgmap v8203: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 365 KiB/s wr, 14 op/s 2023-05-08T07:58:56.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15274.750975 secs 2023-05-08T07:58:57.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:56 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:58:57.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:56 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:58:57.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:56 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:58:58.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:57 smithi133 ceph-mon[125939]: pgmap v8204: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 344 KiB/s wr, 11 op/s 2023-05-08T07:58:58.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:57 smithi096 ceph-mon[124666]: pgmap v8204: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 344 KiB/s wr, 11 op/s 2023-05-08T07:58:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:57 smithi186 ceph-mon[126480]: pgmap v8204: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 344 KiB/s wr, 11 op/s 2023-05-08T07:58:59.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15277.910683 secs 2023-05-08T07:58:59.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15278.468278 secs 2023-05-08T07:58:59.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15277.910683 secs 2023-05-08T07:58:59.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15278.468278 secs 2023-05-08T07:58:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15277.910683 secs 2023-05-08T07:58:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15278.468278 secs 2023-05-08T07:59:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:59 smithi133 ceph-mon[125939]: pgmap v8205: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 344 KiB/s wr, 10 op/s 2023-05-08T07:59:00.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:59 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:59:00.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:58:59 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:59:00.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:59 smithi096 ceph-mon[124666]: pgmap v8205: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 344 KiB/s wr, 10 op/s 2023-05-08T07:59:00.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:59 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:59:00.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:58:59 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:59:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:59 smithi186 ceph-mon[126480]: pgmap v8205: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 344 KiB/s wr, 10 op/s 2023-05-08T07:59:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:59 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:59:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:58:59 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:59:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15279.751092 secs 2023-05-08T07:59:01.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15279.751092 secs 2023-05-08T07:59:01.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15279.751092 secs 2023-05-08T07:59:02.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:01 smithi133 ceph-mon[125939]: pgmap v8206: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 503 KiB/s rd, 478 KiB/s wr, 15 op/s 2023-05-08T07:59:02.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:01 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:59:02.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:01 smithi096 ceph-mon[124666]: pgmap v8206: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 503 KiB/s rd, 478 KiB/s wr, 15 op/s 2023-05-08T07:59:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:01 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:59:02.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:01 smithi186 ceph-mon[126480]: pgmap v8206: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 503 KiB/s rd, 478 KiB/s wr, 15 op/s 2023-05-08T07:59:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:01 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:59:04.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:03 smithi133 ceph-mon[125939]: pgmap v8207: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 224 KiB/s wr, 10 op/s 2023-05-08T07:59:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15282.910795 secs 2023-05-08T07:59:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:59:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15283.468371 secs 2023-05-08T07:59:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:03 smithi096 ceph-mon[124666]: pgmap v8207: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 224 KiB/s wr, 10 op/s 2023-05-08T07:59:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15282.910795 secs 2023-05-08T07:59:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:59:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15283.468371 secs 2023-05-08T07:59:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:03 smithi186 ceph-mon[126480]: pgmap v8207: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 224 KiB/s wr, 10 op/s 2023-05-08T07:59:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15282.910795 secs 2023-05-08T07:59:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T07:59:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15283.468371 secs 2023-05-08T07:59:05.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:04 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:59:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:04 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:59:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:04 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:59:05.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:04 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:59:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:04 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:59:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:04 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:59:05.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:04 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T07:59:05.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:04 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T07:59:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:04 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T07:59:06.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:05 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:59:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:05 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T07:59:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:05 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T07:59:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:05 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T07:59:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:05 smithi133 ceph-mon[125939]: pgmap v8208: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 336 KiB/s wr, 28 op/s 2023-05-08T07:59:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15284.751225 secs 2023-05-08T07:59:06.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:05 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:59:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:05 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T07:59:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:05 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T07:59:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:05 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T07:59:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:05 smithi096 ceph-mon[124666]: pgmap v8208: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 336 KiB/s wr, 28 op/s 2023-05-08T07:59:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15284.751225 secs 2023-05-08T07:59:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:05 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:59:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:05 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T07:59:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:05 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T07:59:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:05 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T07:59:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:05 smithi186 ceph-mon[126480]: pgmap v8208: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 336 KiB/s wr, 28 op/s 2023-05-08T07:59:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15284.751225 secs 2023-05-08T07:59:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:07 smithi133 ceph-mon[125939]: pgmap v8209: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 245 KiB/s wr, 22 op/s 2023-05-08T07:59:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:07 smithi096 ceph-mon[124666]: pgmap v8209: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 245 KiB/s wr, 22 op/s 2023-05-08T07:59:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:07 smithi186 ceph-mon[126480]: pgmap v8209: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 245 KiB/s wr, 22 op/s 2023-05-08T07:59:09.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15287.910914 secs 2023-05-08T07:59:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15288.468483 secs 2023-05-08T07:59:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15287.910914 secs 2023-05-08T07:59:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15288.468483 secs 2023-05-08T07:59:09.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15287.910914 secs 2023-05-08T07:59:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15288.468483 secs 2023-05-08T07:59:10.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:09 smithi133 ceph-mon[125939]: pgmap v8210: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 245 KiB/s wr, 22 op/s 2023-05-08T07:59:10.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:09 smithi096 ceph-mon[124666]: pgmap v8210: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 245 KiB/s wr, 22 op/s 2023-05-08T07:59:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:09 smithi186 ceph-mon[126480]: pgmap v8210: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 245 KiB/s wr, 22 op/s 2023-05-08T07:59:11.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15289.751375 secs 2023-05-08T07:59:11.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15289.751375 secs 2023-05-08T07:59:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15289.751375 secs 2023-05-08T07:59:12.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:11 smithi133 ceph-mon[125939]: pgmap v8211: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 293 KiB/s wr, 26 op/s 2023-05-08T07:59:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:11 smithi133 ceph-mon[125939]: osdmap e590: 12 total, 12 up, 12 in 2023-05-08T07:59:12.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:11 smithi096 ceph-mon[124666]: pgmap v8211: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 293 KiB/s wr, 26 op/s 2023-05-08T07:59:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:11 smithi096 ceph-mon[124666]: osdmap e590: 12 total, 12 up, 12 in 2023-05-08T07:59:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:11 smithi186 ceph-mon[126480]: pgmap v8211: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 293 KiB/s wr, 26 op/s 2023-05-08T07:59:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:11 smithi186 ceph-mon[126480]: osdmap e590: 12 total, 12 up, 12 in 2023-05-08T07:59:14.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:13 smithi133 ceph-mon[125939]: pgmap v8213: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 191 KiB/s wr, 25 op/s 2023-05-08T07:59:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15292.911027 secs 2023-05-08T07:59:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15293.468614 secs 2023-05-08T07:59:14.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:13 smithi096 ceph-mon[124666]: pgmap v8213: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 191 KiB/s wr, 25 op/s 2023-05-08T07:59:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15292.911027 secs 2023-05-08T07:59:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15293.468614 secs 2023-05-08T07:59:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:13 smithi186 ceph-mon[126480]: pgmap v8213: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 191 KiB/s wr, 25 op/s 2023-05-08T07:59:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15292.911027 secs 2023-05-08T07:59:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15293.468614 secs 2023-05-08T07:59:16.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:15 smithi133 ceph-mon[125939]: pgmap v8214: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 57 KiB/s wr, 7 op/s 2023-05-08T07:59:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15294.751491 secs 2023-05-08T07:59:16.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:15 smithi096 ceph-mon[124666]: pgmap v8214: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 57 KiB/s wr, 7 op/s 2023-05-08T07:59:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15294.751491 secs 2023-05-08T07:59:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:15 smithi186 ceph-mon[126480]: pgmap v8214: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 57 KiB/s wr, 7 op/s 2023-05-08T07:59:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15294.751491 secs 2023-05-08T07:59:18.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:17 smithi133 ceph-mon[125939]: pgmap v8215: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 57 KiB/s wr, 7 op/s 2023-05-08T07:59:18.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:17 smithi096 ceph-mon[124666]: pgmap v8215: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 57 KiB/s wr, 7 op/s 2023-05-08T07:59:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:17 smithi186 ceph-mon[126480]: pgmap v8215: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 57 KiB/s wr, 7 op/s 2023-05-08T07:59:19.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15297.911167 secs 2023-05-08T07:59:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15298.468693 secs 2023-05-08T07:59:19.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15297.911167 secs 2023-05-08T07:59:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15298.468693 secs 2023-05-08T07:59:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15297.911167 secs 2023-05-08T07:59:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15298.468693 secs 2023-05-08T07:59:20.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:19 smithi133 ceph-mon[125939]: pgmap v8216: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 57 KiB/s wr, 7 op/s 2023-05-08T07:59:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:19 smithi096 ceph-mon[124666]: pgmap v8216: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 57 KiB/s wr, 7 op/s 2023-05-08T07:59:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:19 smithi186 ceph-mon[126480]: pgmap v8216: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 57 KiB/s wr, 7 op/s 2023-05-08T07:59:21.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15299.751610 secs 2023-05-08T07:59:21.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15299.751610 secs 2023-05-08T07:59:21.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15299.751610 secs 2023-05-08T07:59:22.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:21 smithi133 ceph-mon[125939]: pgmap v8217: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T07:59:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:21 smithi133 ceph-mon[125939]: osdmap e591: 12 total, 12 up, 12 in 2023-05-08T07:59:22.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:21 smithi096 ceph-mon[124666]: pgmap v8217: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T07:59:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:21 smithi096 ceph-mon[124666]: osdmap e591: 12 total, 12 up, 12 in 2023-05-08T07:59:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:21 smithi186 ceph-mon[126480]: pgmap v8217: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T07:59:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:21 smithi186 ceph-mon[126480]: osdmap e591: 12 total, 12 up, 12 in 2023-05-08T07:59:24.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:23 smithi133 ceph-mon[125939]: pgmap v8219: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T07:59:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15302.911281 secs 2023-05-08T07:59:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15303.468811 secs 2023-05-08T07:59:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:23 smithi096 ceph-mon[124666]: pgmap v8219: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T07:59:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15302.911281 secs 2023-05-08T07:59:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15303.468811 secs 2023-05-08T07:59:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:23 smithi186 ceph-mon[126480]: pgmap v8219: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T07:59:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15302.911281 secs 2023-05-08T07:59:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15303.468811 secs 2023-05-08T07:59:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:25 smithi133 ceph-mon[125939]: pgmap v8220: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T07:59:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15304.751707 secs 2023-05-08T07:59:26.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:25 smithi096 ceph-mon[124666]: pgmap v8220: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T07:59:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15304.751707 secs 2023-05-08T07:59:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:25 smithi186 ceph-mon[126480]: pgmap v8220: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T07:59:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15304.751707 secs 2023-05-08T07:59:28.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:27 smithi096 ceph-mon[124666]: pgmap v8221: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T07:59:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:27 smithi186 ceph-mon[126480]: pgmap v8221: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T07:59:28.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:27 smithi133 ceph-mon[125939]: pgmap v8221: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T07:59:29.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15307.911423 secs 2023-05-08T07:59:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15308.468918 secs 2023-05-08T07:59:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15307.911423 secs 2023-05-08T07:59:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15308.468918 secs 2023-05-08T07:59:29.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15307.911423 secs 2023-05-08T07:59:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15308.468918 secs 2023-05-08T07:59:30.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:29 smithi096 ceph-mon[124666]: pgmap v8222: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T07:59:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:29 smithi186 ceph-mon[126480]: pgmap v8222: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T07:59:30.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:29 smithi133 ceph-mon[125939]: pgmap v8222: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T07:59:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15309.751819 secs 2023-05-08T07:59:31.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15309.751819 secs 2023-05-08T07:59:31.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15309.751819 secs 2023-05-08T07:59:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:32 smithi186 ceph-mon[126480]: pgmap v8223: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T07:59:32.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:32 smithi133 ceph-mon[125939]: pgmap v8223: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T07:59:32.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:32 smithi096 ceph-mon[124666]: pgmap v8223: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T07:59:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:34 smithi186 ceph-mon[126480]: pgmap v8224: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 93 B/s wr, 6 op/s 2023-05-08T07:59:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15312.911543 secs 2023-05-08T07:59:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15313.469039 secs 2023-05-08T07:59:34.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:34 smithi133 ceph-mon[125939]: pgmap v8224: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 93 B/s wr, 6 op/s 2023-05-08T07:59:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15312.911543 secs 2023-05-08T07:59:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15313.469039 secs 2023-05-08T07:59:34.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:34 smithi096 ceph-mon[124666]: pgmap v8224: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 93 B/s wr, 6 op/s 2023-05-08T07:59:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15312.911543 secs 2023-05-08T07:59:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15313.469039 secs 2023-05-08T07:59:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:36 smithi186 ceph-mon[126480]: pgmap v8225: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 938 B/s wr, 8 op/s 2023-05-08T07:59:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15314.751893 secs 2023-05-08T07:59:36.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:36 smithi133 ceph-mon[125939]: pgmap v8225: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 938 B/s wr, 8 op/s 2023-05-08T07:59:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15314.751893 secs 2023-05-08T07:59:36.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:36 smithi096 ceph-mon[124666]: pgmap v8225: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 938 B/s wr, 8 op/s 2023-05-08T07:59:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15314.751893 secs 2023-05-08T07:59:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:38 smithi186 ceph-mon[126480]: pgmap v8226: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T07:59:38.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:38 smithi133 ceph-mon[125939]: pgmap v8226: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T07:59:38.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:38 smithi096 ceph-mon[124666]: pgmap v8226: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T07:59:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15317.911608 secs 2023-05-08T07:59:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15318.469169 secs 2023-05-08T07:59:39.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15317.911608 secs 2023-05-08T07:59:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15318.469169 secs 2023-05-08T07:59:39.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15317.911608 secs 2023-05-08T07:59:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15318.469169 secs 2023-05-08T07:59:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:40 smithi186 ceph-mon[126480]: pgmap v8227: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T07:59:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:40 smithi133 ceph-mon[125939]: pgmap v8227: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T07:59:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:40 smithi096 ceph-mon[124666]: pgmap v8227: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T07:59:42.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:42 smithi186 ceph-mon[126480]: pgmap v8228: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 105 KiB/s wr, 9 op/s 2023-05-08T07:59:42.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:42 smithi133 ceph-mon[125939]: pgmap v8228: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 105 KiB/s wr, 9 op/s 2023-05-08T07:59:42.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:42 smithi096 ceph-mon[124666]: pgmap v8228: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 105 KiB/s wr, 9 op/s 2023-05-08T07:59:43.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:59:43.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:59:43.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:59:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:44 smithi186 ceph-mon[126480]: pgmap v8229: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 105 KiB/s wr, 6 op/s 2023-05-08T07:59:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:59:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:59:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:59:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15322.911725 secs 2023-05-08T07:59:44.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:44 smithi133 ceph-mon[125939]: pgmap v8229: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 105 KiB/s wr, 6 op/s 2023-05-08T07:59:44.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:59:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:59:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:59:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15322.911725 secs 2023-05-08T07:59:44.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:44 smithi096 ceph-mon[124666]: pgmap v8229: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 105 KiB/s wr, 6 op/s 2023-05-08T07:59:44.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:59:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:59:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:59:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15322.911725 secs 2023-05-08T07:59:46.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:46 smithi186 ceph-mon[126480]: pgmap v8230: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 127 KiB/s wr, 10 op/s 2023-05-08T07:59:46.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:46 smithi133 ceph-mon[125939]: pgmap v8230: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 127 KiB/s wr, 10 op/s 2023-05-08T07:59:46.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:46 smithi096 ceph-mon[124666]: pgmap v8230: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 127 KiB/s wr, 10 op/s 2023-05-08T07:59:47.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:47 smithi133 ceph-mon[125939]: pgmap v8231: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 126 KiB/s wr, 7 op/s 2023-05-08T07:59:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:59:48.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:47 smithi096 ceph-mon[124666]: pgmap v8231: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 126 KiB/s wr, 7 op/s 2023-05-08T07:59:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:59:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:47 smithi186 ceph-mon[126480]: pgmap v8231: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 126 KiB/s wr, 7 op/s 2023-05-08T07:59:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T07:59:48.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:59:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:59:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15327.911816 secs 2023-05-08T07:59:49.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:59:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:59:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15327.911816 secs 2023-05-08T07:59:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T07:59:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:59:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15327.911816 secs 2023-05-08T07:59:49.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:49 smithi133 ceph-mon[125939]: pgmap v8232: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 126 KiB/s wr, 7 op/s 2023-05-08T07:59:50.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:49 smithi096 ceph-mon[124666]: pgmap v8232: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 126 KiB/s wr, 7 op/s 2023-05-08T07:59:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:49 smithi186 ceph-mon[126480]: pgmap v8232: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 126 KiB/s wr, 7 op/s 2023-05-08T07:59:51.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15329.752294 secs 2023-05-08T07:59:51.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15329.752294 secs 2023-05-08T07:59:51.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15329.752294 secs 2023-05-08T07:59:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:51 smithi096 ceph-mon[124666]: pgmap v8233: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 384 KiB/s wr, 13 op/s 2023-05-08T07:59:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:51 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:59:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:51 smithi186 ceph-mon[126480]: pgmap v8233: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 384 KiB/s wr, 13 op/s 2023-05-08T07:59:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:51 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:59:52.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:51 smithi133 ceph-mon[125939]: pgmap v8233: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 384 KiB/s wr, 13 op/s 2023-05-08T07:59:52.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:51 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:59:53.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:59:53.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:59:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:59:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:59:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T07:59:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T07:59:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:53 smithi186 ceph-mon[126480]: pgmap v8234: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 280 KiB/s wr, 9 op/s 2023-05-08T07:59:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15332.911936 secs 2023-05-08T07:59:54.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:53 smithi133 ceph-mon[125939]: pgmap v8234: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 280 KiB/s wr, 9 op/s 2023-05-08T07:59:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15332.911936 secs 2023-05-08T07:59:54.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:53 smithi096 ceph-mon[124666]: pgmap v8234: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 280 KiB/s wr, 9 op/s 2023-05-08T07:59:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15332.911936 secs 2023-05-08T07:59:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:55 smithi186 ceph-mon[126480]: pgmap v8235: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 370 KiB/s wr, 15 op/s 2023-05-08T07:59:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15334.752442 secs 2023-05-08T07:59:56.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:55 smithi133 ceph-mon[125939]: pgmap v8235: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 370 KiB/s wr, 15 op/s 2023-05-08T07:59:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15334.752442 secs 2023-05-08T07:59:56.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:55 smithi096 ceph-mon[124666]: pgmap v8235: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 370 KiB/s wr, 15 op/s 2023-05-08T07:59:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15334.752442 secs 2023-05-08T07:59:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:56 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:59:57.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:56 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:59:57.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:56 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T07:59:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:57 smithi186 ceph-mon[126480]: pgmap v8236: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 397 KiB/s rd, 348 KiB/s wr, 11 op/s 2023-05-08T07:59:58.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:57 smithi133 ceph-mon[125939]: pgmap v8236: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 397 KiB/s rd, 348 KiB/s wr, 11 op/s 2023-05-08T07:59:58.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:57 smithi096 ceph-mon[124666]: pgmap v8236: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 397 KiB/s rd, 348 KiB/s wr, 11 op/s 2023-05-08T07:59:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15337.912052 secs 2023-05-08T07:59:59.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15337.912052 secs 2023-05-08T07:59:59.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15337.912052 secs 2023-05-08T08:00:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:59 smithi186 ceph-mon[126480]: pgmap v8237: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 397 KiB/s rd, 348 KiB/s wr, 11 op/s 2023-05-08T08:00:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 07:59:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15338.469626 secs 2023-05-08T08:00:00.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:59 smithi133 ceph-mon[125939]: pgmap v8237: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 397 KiB/s rd, 348 KiB/s wr, 11 op/s 2023-05-08T08:00:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 07:59:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15338.469626 secs 2023-05-08T08:00:00.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:59 smithi096 ceph-mon[124666]: pgmap v8237: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 397 KiB/s rd, 348 KiB/s wr, 11 op/s 2023-05-08T08:00:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 07:59:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15338.469626 secs 2023-05-08T08:00:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:00:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:00:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:00 smithi186 ceph-mon[126480]: Health detail: HEALTH_WARN 3 MDSs report slow requests 2023-05-08T08:00:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:00 smithi186 ceph-mon[126480]: [WRN] MDS_SLOW_REQUEST: 3 MDSs report slow requests 2023-05-08T08:00:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:00 smithi186 ceph-mon[126480]: mds.c(mds.2): 1 slow requests are blocked > 180 secs 2023-05-08T08:00:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:00 smithi186 ceph-mon[126480]: mds.i(mds.1): 1 slow requests are blocked > 180 secs 2023-05-08T08:00:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:00 smithi186 ceph-mon[126480]: mds.b(mds.0): 1 slow requests are blocked > 180 secs 2023-05-08T08:00:01.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15339.752563 secs 2023-05-08T08:00:01.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:00:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:00:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:00 smithi133 ceph-mon[125939]: Health detail: HEALTH_WARN 3 MDSs report slow requests 2023-05-08T08:00:01.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:00 smithi133 ceph-mon[125939]: [WRN] MDS_SLOW_REQUEST: 3 MDSs report slow requests 2023-05-08T08:00:01.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:00 smithi133 ceph-mon[125939]: mds.c(mds.2): 1 slow requests are blocked > 180 secs 2023-05-08T08:00:01.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:00 smithi133 ceph-mon[125939]: mds.i(mds.1): 1 slow requests are blocked > 180 secs 2023-05-08T08:00:01.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:00 smithi133 ceph-mon[125939]: mds.b(mds.0): 1 slow requests are blocked > 180 secs 2023-05-08T08:00:01.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15339.752563 secs 2023-05-08T08:00:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:00:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:00:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:00 smithi096 ceph-mon[124666]: Health detail: HEALTH_WARN 3 MDSs report slow requests 2023-05-08T08:00:01.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:00 smithi096 ceph-mon[124666]: [WRN] MDS_SLOW_REQUEST: 3 MDSs report slow requests 2023-05-08T08:00:01.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:00 smithi096 ceph-mon[124666]: mds.c(mds.2): 1 slow requests are blocked > 180 secs 2023-05-08T08:00:01.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:00 smithi096 ceph-mon[124666]: mds.i(mds.1): 1 slow requests are blocked > 180 secs 2023-05-08T08:00:01.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:00 smithi096 ceph-mon[124666]: mds.b(mds.0): 1 slow requests are blocked > 180 secs 2023-05-08T08:00:01.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15339.752563 secs 2023-05-08T08:00:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:01 smithi186 ceph-mon[126480]: pgmap v8238: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 482 KiB/s wr, 16 op/s 2023-05-08T08:00:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:01 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:00:02.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:01 smithi133 ceph-mon[125939]: pgmap v8238: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 482 KiB/s wr, 16 op/s 2023-05-08T08:00:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:01 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:00:02.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:01 smithi096 ceph-mon[124666]: pgmap v8238: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 482 KiB/s wr, 16 op/s 2023-05-08T08:00:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:01 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:00:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:03 smithi186 ceph-mon[126480]: pgmap v8239: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 224 KiB/s wr, 10 op/s 2023-05-08T08:00:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15342.912167 secs 2023-05-08T08:00:04.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:03 smithi133 ceph-mon[125939]: pgmap v8239: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 224 KiB/s wr, 10 op/s 2023-05-08T08:00:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15342.912167 secs 2023-05-08T08:00:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:03 smithi096 ceph-mon[124666]: pgmap v8239: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 224 KiB/s wr, 10 op/s 2023-05-08T08:00:04.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15342.912167 secs 2023-05-08T08:00:04.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15343.469743 secs 2023-05-08T08:00:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:04 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:00:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15343.469743 secs 2023-05-08T08:00:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:04 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:00:05.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15343.469743 secs 2023-05-08T08:00:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:04 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:00:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:05 smithi186 ceph-mon[126480]: pgmap v8240: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 269 KiB/s wr, 27 op/s 2023-05-08T08:00:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15344.752688 secs 2023-05-08T08:00:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:05 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:00:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:05 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:00:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:05 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:00:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:05 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:00:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:05 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T08:00:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:05 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T08:00:06.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:05 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:00:06.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:05 smithi133 ceph-mon[125939]: pgmap v8240: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 269 KiB/s wr, 27 op/s 2023-05-08T08:00:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15344.752688 secs 2023-05-08T08:00:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:05 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:00:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:05 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:00:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:05 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:00:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:05 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:00:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:05 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T08:00:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:05 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T08:00:06.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:05 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:00:06.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:05 smithi096 ceph-mon[124666]: pgmap v8240: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 269 KiB/s wr, 27 op/s 2023-05-08T08:00:06.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15344.752688 secs 2023-05-08T08:00:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:05 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:00:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:05 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:00:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:05 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:00:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:05 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:00:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:05 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T08:00:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:05 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T08:00:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:05 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:00:08.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:07 smithi186 ceph-mon[126480]: pgmap v8241: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 179 KiB/s wr, 22 op/s 2023-05-08T08:00:08.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:07 smithi133 ceph-mon[125939]: pgmap v8241: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 179 KiB/s wr, 22 op/s 2023-05-08T08:00:08.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:07 smithi096 ceph-mon[124666]: pgmap v8241: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 179 KiB/s wr, 22 op/s 2023-05-08T08:00:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15347.912290 secs 2023-05-08T08:00:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15348.469860 secs 2023-05-08T08:00:09.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15347.912290 secs 2023-05-08T08:00:09.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15348.469860 secs 2023-05-08T08:00:09.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15347.912290 secs 2023-05-08T08:00:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15348.469860 secs 2023-05-08T08:00:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:09 smithi186 ceph-mon[126480]: pgmap v8242: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 179 KiB/s wr, 22 op/s 2023-05-08T08:00:10.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:09 smithi133 ceph-mon[125939]: pgmap v8242: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 179 KiB/s wr, 22 op/s 2023-05-08T08:00:10.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:09 smithi096 ceph-mon[124666]: pgmap v8242: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 179 KiB/s wr, 22 op/s 2023-05-08T08:00:11.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15349.752844 secs 2023-05-08T08:00:11.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15349.752844 secs 2023-05-08T08:00:11.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15349.752844 secs 2023-05-08T08:00:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:11 smithi186 ceph-mon[126480]: pgmap v8243: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 294 KiB/s wr, 25 op/s 2023-05-08T08:00:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:11 smithi186 ceph-mon[126480]: osdmap e592: 12 total, 12 up, 12 in 2023-05-08T08:00:12.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:11 smithi133 ceph-mon[125939]: pgmap v8243: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 294 KiB/s wr, 25 op/s 2023-05-08T08:00:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:11 smithi133 ceph-mon[125939]: osdmap e592: 12 total, 12 up, 12 in 2023-05-08T08:00:12.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:11 smithi096 ceph-mon[124666]: pgmap v8243: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 294 KiB/s wr, 25 op/s 2023-05-08T08:00:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:11 smithi096 ceph-mon[124666]: osdmap e592: 12 total, 12 up, 12 in 2023-05-08T08:00:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:13 smithi186 ceph-mon[126480]: pgmap v8245: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 192 KiB/s wr, 25 op/s 2023-05-08T08:00:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15352.912410 secs 2023-05-08T08:00:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15353.469981 secs 2023-05-08T08:00:14.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:13 smithi133 ceph-mon[125939]: pgmap v8245: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 192 KiB/s wr, 25 op/s 2023-05-08T08:00:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15352.912410 secs 2023-05-08T08:00:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15353.469981 secs 2023-05-08T08:00:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:13 smithi096 ceph-mon[124666]: pgmap v8245: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 192 KiB/s wr, 25 op/s 2023-05-08T08:00:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15352.912410 secs 2023-05-08T08:00:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15353.469981 secs 2023-05-08T08:00:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:15 smithi186 ceph-mon[126480]: pgmap v8246: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 138 KiB/s wr, 7 op/s 2023-05-08T08:00:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15354.752957 secs 2023-05-08T08:00:16.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:15 smithi133 ceph-mon[125939]: pgmap v8246: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 138 KiB/s wr, 7 op/s 2023-05-08T08:00:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15354.752957 secs 2023-05-08T08:00:16.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:15 smithi096 ceph-mon[124666]: pgmap v8246: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 138 KiB/s wr, 7 op/s 2023-05-08T08:00:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15354.752957 secs 2023-05-08T08:00:18.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:17 smithi186 ceph-mon[126480]: pgmap v8247: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 138 KiB/s wr, 7 op/s 2023-05-08T08:00:18.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:17 smithi133 ceph-mon[125939]: pgmap v8247: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 138 KiB/s wr, 7 op/s 2023-05-08T08:00:18.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:17 smithi096 ceph-mon[124666]: pgmap v8247: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 138 KiB/s wr, 7 op/s 2023-05-08T08:00:19.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15357.912530 secs 2023-05-08T08:00:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15358.470096 secs 2023-05-08T08:00:19.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15357.912530 secs 2023-05-08T08:00:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15358.470096 secs 2023-05-08T08:00:19.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15357.912530 secs 2023-05-08T08:00:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15358.470096 secs 2023-05-08T08:00:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:19 smithi186 ceph-mon[126480]: pgmap v8248: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 138 KiB/s wr, 7 op/s 2023-05-08T08:00:20.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:19 smithi133 ceph-mon[125939]: pgmap v8248: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 138 KiB/s wr, 7 op/s 2023-05-08T08:00:20.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:19 smithi096 ceph-mon[124666]: pgmap v8248: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 138 KiB/s wr, 7 op/s 2023-05-08T08:00:21.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15359.753088 secs 2023-05-08T08:00:21.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15359.753088 secs 2023-05-08T08:00:21.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15359.753088 secs 2023-05-08T08:00:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:21 smithi186 ceph-mon[126480]: pgmap v8249: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:00:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:21 smithi186 ceph-mon[126480]: osdmap e593: 12 total, 12 up, 12 in 2023-05-08T08:00:22.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:21 smithi133 ceph-mon[125939]: pgmap v8249: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:00:22.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:21 smithi133 ceph-mon[125939]: osdmap e593: 12 total, 12 up, 12 in 2023-05-08T08:00:22.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:21 smithi096 ceph-mon[124666]: pgmap v8249: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:00:22.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:21 smithi096 ceph-mon[124666]: osdmap e593: 12 total, 12 up, 12 in 2023-05-08T08:00:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:23 smithi186 ceph-mon[126480]: pgmap v8251: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:00:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15362.912650 secs 2023-05-08T08:00:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15363.470157 secs 2023-05-08T08:00:24.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:23 smithi133 ceph-mon[125939]: pgmap v8251: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:00:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15362.912650 secs 2023-05-08T08:00:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15363.470157 secs 2023-05-08T08:00:24.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:23 smithi096 ceph-mon[124666]: pgmap v8251: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:00:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15362.912650 secs 2023-05-08T08:00:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15363.470157 secs 2023-05-08T08:00:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:25 smithi186 ceph-mon[126480]: pgmap v8252: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:00:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15364.753187 secs 2023-05-08T08:00:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:25 smithi133 ceph-mon[125939]: pgmap v8252: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:00:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15364.753187 secs 2023-05-08T08:00:26.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:25 smithi096 ceph-mon[124666]: pgmap v8252: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:00:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15364.753187 secs 2023-05-08T08:00:28.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:27 smithi186 ceph-mon[126480]: pgmap v8253: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:00:28.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:27 smithi133 ceph-mon[125939]: pgmap v8253: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:00:28.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:27 smithi096 ceph-mon[124666]: pgmap v8253: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:00:29.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15367.912772 secs 2023-05-08T08:00:29.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15368.470279 secs 2023-05-08T08:00:29.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15367.912772 secs 2023-05-08T08:00:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15368.470279 secs 2023-05-08T08:00:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15367.912772 secs 2023-05-08T08:00:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15368.470279 secs 2023-05-08T08:00:30.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:29 smithi133 ceph-mon[125939]: pgmap v8254: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:00:30.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:29 smithi096 ceph-mon[124666]: pgmap v8254: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:00:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:29 smithi186 ceph-mon[126480]: pgmap v8254: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:00:31.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15369.753314 secs 2023-05-08T08:00:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15369.753314 secs 2023-05-08T08:00:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15369.753314 secs 2023-05-08T08:00:32.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:31 smithi133 ceph-mon[125939]: pgmap v8255: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:00:32.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:31 smithi096 ceph-mon[124666]: pgmap v8255: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:00:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:31 smithi186 ceph-mon[126480]: pgmap v8255: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:00:34.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:33 smithi133 ceph-mon[125939]: pgmap v8256: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 93 B/s wr, 5 op/s 2023-05-08T08:00:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15372.912898 secs 2023-05-08T08:00:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15373.470398 secs 2023-05-08T08:00:34.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:33 smithi096 ceph-mon[124666]: pgmap v8256: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 93 B/s wr, 5 op/s 2023-05-08T08:00:34.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15372.912898 secs 2023-05-08T08:00:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15373.470398 secs 2023-05-08T08:00:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:33 smithi186 ceph-mon[126480]: pgmap v8256: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 93 B/s wr, 5 op/s 2023-05-08T08:00:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15372.912898 secs 2023-05-08T08:00:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15373.470398 secs 2023-05-08T08:00:36.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:35 smithi133 ceph-mon[125939]: pgmap v8257: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 938 B/s wr, 8 op/s 2023-05-08T08:00:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15374.753434 secs 2023-05-08T08:00:36.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:35 smithi096 ceph-mon[124666]: pgmap v8257: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 938 B/s wr, 8 op/s 2023-05-08T08:00:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15374.753434 secs 2023-05-08T08:00:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:35 smithi186 ceph-mon[126480]: pgmap v8257: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 938 B/s wr, 8 op/s 2023-05-08T08:00:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15374.753434 secs 2023-05-08T08:00:38.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:37 smithi133 ceph-mon[125939]: pgmap v8258: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T08:00:38.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:37 smithi096 ceph-mon[124666]: pgmap v8258: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T08:00:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:37 smithi186 ceph-mon[126480]: pgmap v8258: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T08:00:39.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15377.913046 secs 2023-05-08T08:00:39.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15378.470494 secs 2023-05-08T08:00:39.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15377.913046 secs 2023-05-08T08:00:39.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15378.470494 secs 2023-05-08T08:00:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15377.913046 secs 2023-05-08T08:00:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15378.470494 secs 2023-05-08T08:00:40.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:39 smithi133 ceph-mon[125939]: pgmap v8259: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T08:00:40.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:39 smithi096 ceph-mon[124666]: pgmap v8259: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T08:00:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:39 smithi186 ceph-mon[126480]: pgmap v8259: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T08:00:42.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:41 smithi133 ceph-mon[125939]: pgmap v8260: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 106 KiB/s wr, 9 op/s 2023-05-08T08:00:42.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:41 smithi096 ceph-mon[124666]: pgmap v8260: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 106 KiB/s wr, 9 op/s 2023-05-08T08:00:42.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:41 smithi186 ceph-mon[126480]: pgmap v8260: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 106 KiB/s wr, 9 op/s 2023-05-08T08:00:43.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:00:43.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:00:43.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:00:44.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:43 smithi133 ceph-mon[125939]: pgmap v8261: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 106 KiB/s wr, 7 op/s 2023-05-08T08:00:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:43 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:00:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:00:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:00:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15382.913163 secs 2023-05-08T08:00:44.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:43 smithi096 ceph-mon[124666]: pgmap v8261: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 106 KiB/s wr, 7 op/s 2023-05-08T08:00:44.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:43 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:00:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:00:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:00:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15382.913163 secs 2023-05-08T08:00:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:43 smithi186 ceph-mon[126480]: pgmap v8261: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 106 KiB/s wr, 7 op/s 2023-05-08T08:00:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:43 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:00:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:00:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:00:44.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15382.913163 secs 2023-05-08T08:00:46.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:45 smithi133 ceph-mon[125939]: pgmap v8262: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 135 KiB/s wr, 11 op/s 2023-05-08T08:00:46.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:45 smithi096 ceph-mon[124666]: pgmap v8262: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 135 KiB/s wr, 11 op/s 2023-05-08T08:00:46.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:45 smithi186 ceph-mon[126480]: pgmap v8262: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 135 KiB/s wr, 11 op/s 2023-05-08T08:00:47.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:47 smithi133 ceph-mon[125939]: pgmap v8263: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 134 KiB/s wr, 8 op/s 2023-05-08T08:00:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:00:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:47 smithi096 ceph-mon[124666]: pgmap v8263: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 134 KiB/s wr, 8 op/s 2023-05-08T08:00:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:00:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:47 smithi186 ceph-mon[126480]: pgmap v8263: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 134 KiB/s wr, 8 op/s 2023-05-08T08:00:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:00:49.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:00:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:00:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15387.913303 secs 2023-05-08T08:00:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:00:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:00:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15387.913303 secs 2023-05-08T08:00:49.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:00:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:00:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15387.913303 secs 2023-05-08T08:00:50.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:49 smithi096 ceph-mon[124666]: pgmap v8264: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 134 KiB/s wr, 8 op/s 2023-05-08T08:00:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:49 smithi186 ceph-mon[126480]: pgmap v8264: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 134 KiB/s wr, 8 op/s 2023-05-08T08:00:50.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:49 smithi133 ceph-mon[125939]: pgmap v8264: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 134 KiB/s wr, 8 op/s 2023-05-08T08:00:51.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15389.753735 secs 2023-05-08T08:00:51.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15389.753735 secs 2023-05-08T08:00:51.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15389.753735 secs 2023-05-08T08:00:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:51 smithi186 ceph-mon[126480]: pgmap v8265: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 390 KiB/s wr, 13 op/s 2023-05-08T08:00:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:51 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:00:52.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:51 smithi133 ceph-mon[125939]: pgmap v8265: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 390 KiB/s wr, 13 op/s 2023-05-08T08:00:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:51 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:00:52.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:51 smithi096 ceph-mon[124666]: pgmap v8265: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 390 KiB/s wr, 13 op/s 2023-05-08T08:00:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:51 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:00:53.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:00:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:00:53.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:00:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:00:53.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:00:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:00:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:53 smithi186 ceph-mon[126480]: pgmap v8266: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 285 KiB/s wr, 10 op/s 2023-05-08T08:00:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15392.913386 secs 2023-05-08T08:00:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:53 smithi133 ceph-mon[125939]: pgmap v8266: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 285 KiB/s wr, 10 op/s 2023-05-08T08:00:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15392.913386 secs 2023-05-08T08:00:54.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:53 smithi096 ceph-mon[124666]: pgmap v8266: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 285 KiB/s wr, 10 op/s 2023-05-08T08:00:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15392.913386 secs 2023-05-08T08:00:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:55 smithi186 ceph-mon[126480]: pgmap v8267: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 397 KiB/s rd, 375 KiB/s wr, 15 op/s 2023-05-08T08:00:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15394.753838 secs 2023-05-08T08:00:56.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:55 smithi133 ceph-mon[125939]: pgmap v8267: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 397 KiB/s rd, 375 KiB/s wr, 15 op/s 2023-05-08T08:00:56.325 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15394.753838 secs 2023-05-08T08:00:56.325 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:55 smithi096 ceph-mon[124666]: pgmap v8267: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 397 KiB/s rd, 375 KiB/s wr, 15 op/s 2023-05-08T08:00:56.326 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15394.753838 secs 2023-05-08T08:00:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:56 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:00:57.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:56 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:00:57.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:56 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:00:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:57 smithi186 ceph-mon[126480]: pgmap v8268: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 346 KiB/s wr, 11 op/s 2023-05-08T08:00:58.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:57 smithi133 ceph-mon[125939]: pgmap v8268: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 346 KiB/s wr, 11 op/s 2023-05-08T08:00:58.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:57 smithi096 ceph-mon[124666]: pgmap v8268: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 346 KiB/s wr, 11 op/s 2023-05-08T08:00:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15397.913468 secs 2023-05-08T08:00:59.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15397.913468 secs 2023-05-08T08:00:59.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15397.913468 secs 2023-05-08T08:01:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:59 smithi186 ceph-mon[126480]: pgmap v8269: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 346 KiB/s wr, 11 op/s 2023-05-08T08:01:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:00:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15398.470827 secs 2023-05-08T08:01:00.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:59 smithi133 ceph-mon[125939]: pgmap v8269: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 346 KiB/s wr, 11 op/s 2023-05-08T08:01:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:00:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15398.470827 secs 2023-05-08T08:01:00.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:59 smithi096 ceph-mon[124666]: pgmap v8269: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 346 KiB/s wr, 11 op/s 2023-05-08T08:01:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:00:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15398.470827 secs 2023-05-08T08:01:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:01:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:01:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15399.753948 secs 2023-05-08T08:01:01.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:01:01.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:01:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15399.753948 secs 2023-05-08T08:01:01.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:01:01.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:01:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15399.753948 secs 2023-05-08T08:01:02.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:01 smithi096 ceph-mon[124666]: pgmap v8270: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 503 KiB/s rd, 481 KiB/s wr, 15 op/s 2023-05-08T08:01:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:01 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:01:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:01 smithi186 ceph-mon[126480]: pgmap v8270: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 503 KiB/s rd, 481 KiB/s wr, 15 op/s 2023-05-08T08:01:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:01 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:01:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:01 smithi133 ceph-mon[125939]: pgmap v8270: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 503 KiB/s rd, 481 KiB/s wr, 15 op/s 2023-05-08T08:01:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:01 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:01:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:03 smithi186 ceph-mon[126480]: pgmap v8271: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 225 KiB/s wr, 9 op/s 2023-05-08T08:01:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15402.913584 secs 2023-05-08T08:01:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15403.470956 secs 2023-05-08T08:01:04.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:03 smithi133 ceph-mon[125939]: pgmap v8271: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 225 KiB/s wr, 9 op/s 2023-05-08T08:01:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15402.913584 secs 2023-05-08T08:01:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15403.470956 secs 2023-05-08T08:01:04.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:03 smithi096 ceph-mon[124666]: pgmap v8271: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 225 KiB/s wr, 9 op/s 2023-05-08T08:01:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15402.913584 secs 2023-05-08T08:01:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15403.470956 secs 2023-05-08T08:01:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:05 smithi186 ceph-mon[126480]: pgmap v8272: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 270 KiB/s wr, 27 op/s 2023-05-08T08:01:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15404.754016 secs 2023-05-08T08:01:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:05 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:01:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:05 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:01:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:05 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:01:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:05 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:01:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:05 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:01:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:05 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:01:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:05 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:01:06.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:05 smithi133 ceph-mon[125939]: pgmap v8272: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 270 KiB/s wr, 27 op/s 2023-05-08T08:01:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15404.754016 secs 2023-05-08T08:01:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:05 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:01:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:05 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:01:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:05 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:01:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:05 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:01:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:05 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:01:06.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:05 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:01:06.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:05 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:01:06.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:05 smithi096 ceph-mon[124666]: pgmap v8272: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 270 KiB/s wr, 27 op/s 2023-05-08T08:01:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15404.754016 secs 2023-05-08T08:01:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:05 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:01:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:05 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:01:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:05 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:01:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:05 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:01:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:05 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:01:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:05 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:01:06.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:05 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:01:07.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:06 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:01:07.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:06 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:01:07.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:06 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:01:07.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:06 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:01:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:06 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:01:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:06 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:01:07.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:06 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:01:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:06 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:01:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:06 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:01:08.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:07 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:01:08.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:07 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T08:01:08.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:07 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T08:01:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:07 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:01:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:07 smithi186 ceph-mon[126480]: pgmap v8273: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 180 KiB/s wr, 22 op/s 2023-05-08T08:01:08.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:07 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:01:08.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:07 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T08:01:08.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:07 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T08:01:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:07 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:01:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:07 smithi133 ceph-mon[125939]: pgmap v8273: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 180 KiB/s wr, 22 op/s 2023-05-08T08:01:08.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:07 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:01:08.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:07 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T08:01:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:07 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T08:01:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:07 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:01:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:07 smithi096 ceph-mon[124666]: pgmap v8273: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 180 KiB/s wr, 22 op/s 2023-05-08T08:01:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15407.913693 secs 2023-05-08T08:01:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15408.471037 secs 2023-05-08T08:01:09.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15407.913693 secs 2023-05-08T08:01:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15408.471037 secs 2023-05-08T08:01:09.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15407.913693 secs 2023-05-08T08:01:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15408.471037 secs 2023-05-08T08:01:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:09 smithi186 ceph-mon[126480]: pgmap v8274: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 180 KiB/s wr, 22 op/s 2023-05-08T08:01:10.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:09 smithi133 ceph-mon[125939]: pgmap v8274: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 180 KiB/s wr, 22 op/s 2023-05-08T08:01:10.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:09 smithi096 ceph-mon[124666]: pgmap v8274: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 180 KiB/s wr, 22 op/s 2023-05-08T08:01:11.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15409.754134 secs 2023-05-08T08:01:11.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15409.754134 secs 2023-05-08T08:01:11.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15409.754134 secs 2023-05-08T08:01:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:11 smithi186 ceph-mon[126480]: pgmap v8275: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 295 KiB/s wr, 25 op/s 2023-05-08T08:01:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:11 smithi186 ceph-mon[126480]: osdmap e594: 12 total, 12 up, 12 in 2023-05-08T08:01:12.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:11 smithi133 ceph-mon[125939]: pgmap v8275: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 295 KiB/s wr, 25 op/s 2023-05-08T08:01:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:11 smithi133 ceph-mon[125939]: osdmap e594: 12 total, 12 up, 12 in 2023-05-08T08:01:12.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:11 smithi096 ceph-mon[124666]: pgmap v8275: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 295 KiB/s wr, 25 op/s 2023-05-08T08:01:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:11 smithi096 ceph-mon[124666]: osdmap e594: 12 total, 12 up, 12 in 2023-05-08T08:01:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:13 smithi186 ceph-mon[126480]: pgmap v8277: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 193 KiB/s wr, 24 op/s 2023-05-08T08:01:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15412.913815 secs 2023-05-08T08:01:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15413.471150 secs 2023-05-08T08:01:14.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:13 smithi133 ceph-mon[125939]: pgmap v8277: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 193 KiB/s wr, 24 op/s 2023-05-08T08:01:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15412.913815 secs 2023-05-08T08:01:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15413.471150 secs 2023-05-08T08:01:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:13 smithi096 ceph-mon[124666]: pgmap v8277: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 193 KiB/s wr, 24 op/s 2023-05-08T08:01:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15412.913815 secs 2023-05-08T08:01:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15413.471150 secs 2023-05-08T08:01:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:15 smithi186 ceph-mon[126480]: pgmap v8278: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 139 KiB/s wr, 7 op/s 2023-05-08T08:01:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15414.754270 secs 2023-05-08T08:01:16.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:15 smithi133 ceph-mon[125939]: pgmap v8278: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 139 KiB/s wr, 7 op/s 2023-05-08T08:01:16.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15414.754270 secs 2023-05-08T08:01:16.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:15 smithi096 ceph-mon[124666]: pgmap v8278: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 139 KiB/s wr, 7 op/s 2023-05-08T08:01:16.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15414.754270 secs 2023-05-08T08:01:18.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:17 smithi186 ceph-mon[126480]: pgmap v8279: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 139 KiB/s wr, 7 op/s 2023-05-08T08:01:18.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:17 smithi133 ceph-mon[125939]: pgmap v8279: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 139 KiB/s wr, 7 op/s 2023-05-08T08:01:18.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:17 smithi096 ceph-mon[124666]: pgmap v8279: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 139 KiB/s wr, 7 op/s 2023-05-08T08:01:19.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15417.914240 secs 2023-05-08T08:01:19.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15418.471268 secs 2023-05-08T08:01:19.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15417.914240 secs 2023-05-08T08:01:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15418.471268 secs 2023-05-08T08:01:19.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15417.914240 secs 2023-05-08T08:01:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15418.471268 secs 2023-05-08T08:01:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:19 smithi186 ceph-mon[126480]: pgmap v8280: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 139 KiB/s wr, 7 op/s 2023-05-08T08:01:20.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:19 smithi133 ceph-mon[125939]: pgmap v8280: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 139 KiB/s wr, 7 op/s 2023-05-08T08:01:20.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:19 smithi096 ceph-mon[124666]: pgmap v8280: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 139 KiB/s wr, 7 op/s 2023-05-08T08:01:21.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15419.754403 secs 2023-05-08T08:01:21.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15419.754403 secs 2023-05-08T08:01:21.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15419.754403 secs 2023-05-08T08:01:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:21 smithi186 ceph-mon[126480]: pgmap v8281: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 409 B/s wr, 6 op/s 2023-05-08T08:01:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:21 smithi186 ceph-mon[126480]: osdmap e595: 12 total, 12 up, 12 in 2023-05-08T08:01:22.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:21 smithi133 ceph-mon[125939]: pgmap v8281: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 409 B/s wr, 6 op/s 2023-05-08T08:01:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:21 smithi133 ceph-mon[125939]: osdmap e595: 12 total, 12 up, 12 in 2023-05-08T08:01:22.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:21 smithi096 ceph-mon[124666]: pgmap v8281: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 409 B/s wr, 6 op/s 2023-05-08T08:01:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:21 smithi096 ceph-mon[124666]: osdmap e595: 12 total, 12 up, 12 in 2023-05-08T08:01:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:23 smithi186 ceph-mon[126480]: pgmap v8283: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 409 B/s wr, 6 op/s 2023-05-08T08:01:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15422.914323 secs 2023-05-08T08:01:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15423.471408 secs 2023-05-08T08:01:24.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:23 smithi133 ceph-mon[125939]: pgmap v8283: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 409 B/s wr, 6 op/s 2023-05-08T08:01:24.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15422.914323 secs 2023-05-08T08:01:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15423.471408 secs 2023-05-08T08:01:24.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:23 smithi096 ceph-mon[124666]: pgmap v8283: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 409 B/s wr, 6 op/s 2023-05-08T08:01:24.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15422.914323 secs 2023-05-08T08:01:24.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15423.471408 secs 2023-05-08T08:01:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:25 smithi186 ceph-mon[126480]: pgmap v8284: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:01:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15424.754538 secs 2023-05-08T08:01:26.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:25 smithi133 ceph-mon[125939]: pgmap v8284: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:01:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15424.754538 secs 2023-05-08T08:01:26.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:25 smithi096 ceph-mon[124666]: pgmap v8284: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:01:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15424.754538 secs 2023-05-08T08:01:28.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:27 smithi133 ceph-mon[125939]: pgmap v8285: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:01:28.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:27 smithi096 ceph-mon[124666]: pgmap v8285: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:01:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:27 smithi186 ceph-mon[126480]: pgmap v8285: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:01:29.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15427.914439 secs 2023-05-08T08:01:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15428.471527 secs 2023-05-08T08:01:29.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15427.914439 secs 2023-05-08T08:01:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15428.471527 secs 2023-05-08T08:01:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15427.914439 secs 2023-05-08T08:01:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15428.471527 secs 2023-05-08T08:01:30.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:29 smithi133 ceph-mon[125939]: pgmap v8286: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:01:30.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:29 smithi096 ceph-mon[124666]: pgmap v8286: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:01:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:29 smithi186 ceph-mon[126480]: pgmap v8286: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:01:31.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15429.754867 secs 2023-05-08T08:01:31.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15429.754867 secs 2023-05-08T08:01:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15429.754867 secs 2023-05-08T08:01:32.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:31 smithi133 ceph-mon[125939]: pgmap v8287: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:01:32.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:31 smithi096 ceph-mon[124666]: pgmap v8287: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:01:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:31 smithi186 ceph-mon[126480]: pgmap v8287: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:01:34.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:33 smithi133 ceph-mon[125939]: pgmap v8288: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 93 B/s wr, 6 op/s 2023-05-08T08:01:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15432.914556 secs 2023-05-08T08:01:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15433.471593 secs 2023-05-08T08:01:34.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:33 smithi096 ceph-mon[124666]: pgmap v8288: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 93 B/s wr, 6 op/s 2023-05-08T08:01:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15432.914556 secs 2023-05-08T08:01:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15433.471593 secs 2023-05-08T08:01:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:33 smithi186 ceph-mon[126480]: pgmap v8288: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 93 B/s wr, 6 op/s 2023-05-08T08:01:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15432.914556 secs 2023-05-08T08:01:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15433.471593 secs 2023-05-08T08:01:36.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:35 smithi133 ceph-mon[125939]: pgmap v8289: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 938 B/s wr, 9 op/s 2023-05-08T08:01:36.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15434.754964 secs 2023-05-08T08:01:36.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:35 smithi096 ceph-mon[124666]: pgmap v8289: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 938 B/s wr, 9 op/s 2023-05-08T08:01:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15434.754964 secs 2023-05-08T08:01:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:35 smithi186 ceph-mon[126480]: pgmap v8289: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 938 B/s wr, 9 op/s 2023-05-08T08:01:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15434.754964 secs 2023-05-08T08:01:38.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:37 smithi133 ceph-mon[125939]: pgmap v8290: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T08:01:38.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:37 smithi096 ceph-mon[124666]: pgmap v8290: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T08:01:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:37 smithi186 ceph-mon[126480]: pgmap v8290: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T08:01:39.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15437.914675 secs 2023-05-08T08:01:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15438.471680 secs 2023-05-08T08:01:39.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15437.914675 secs 2023-05-08T08:01:39.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15438.471680 secs 2023-05-08T08:01:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15437.914675 secs 2023-05-08T08:01:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15438.471680 secs 2023-05-08T08:01:40.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:39 smithi133 ceph-mon[125939]: pgmap v8291: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T08:01:40.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:39 smithi096 ceph-mon[124666]: pgmap v8291: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T08:01:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:39 smithi186 ceph-mon[126480]: pgmap v8291: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T08:01:42.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:41 smithi133 ceph-mon[125939]: pgmap v8292: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 106 KiB/s wr, 9 op/s 2023-05-08T08:01:42.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:41 smithi096 ceph-mon[124666]: pgmap v8292: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 106 KiB/s wr, 9 op/s 2023-05-08T08:01:42.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:41 smithi186 ceph-mon[126480]: pgmap v8292: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 106 KiB/s wr, 9 op/s 2023-05-08T08:01:43.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:01:43.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:01:43.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:01:44.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:43 smithi133 ceph-mon[125939]: pgmap v8293: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 106 KiB/s wr, 6 op/s 2023-05-08T08:01:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:43 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:01:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:01:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:01:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15442.914770 secs 2023-05-08T08:01:44.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:43 smithi096 ceph-mon[124666]: pgmap v8293: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 106 KiB/s wr, 6 op/s 2023-05-08T08:01:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:43 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:01:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:01:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:01:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15442.914770 secs 2023-05-08T08:01:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:43 smithi186 ceph-mon[126480]: pgmap v8293: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 106 KiB/s wr, 6 op/s 2023-05-08T08:01:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:43 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:01:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:01:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:01:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15442.914770 secs 2023-05-08T08:01:46.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:45 smithi133 ceph-mon[125939]: pgmap v8294: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 127 KiB/s wr, 10 op/s 2023-05-08T08:01:46.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:45 smithi096 ceph-mon[124666]: pgmap v8294: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 127 KiB/s wr, 10 op/s 2023-05-08T08:01:46.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:45 smithi186 ceph-mon[126480]: pgmap v8294: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 127 KiB/s wr, 10 op/s 2023-05-08T08:01:48.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:47 smithi096 ceph-mon[124666]: pgmap v8295: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 127 KiB/s wr, 7 op/s 2023-05-08T08:01:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:01:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:47 smithi186 ceph-mon[126480]: pgmap v8295: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 127 KiB/s wr, 7 op/s 2023-05-08T08:01:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:01:48.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:47 smithi133 ceph-mon[125939]: pgmap v8295: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 127 KiB/s wr, 7 op/s 2023-05-08T08:01:48.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:01:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:01:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:01:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15447.914865 secs 2023-05-08T08:01:49.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:01:49.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:01:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15447.914865 secs 2023-05-08T08:01:49.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:01:49.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:01:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15447.914865 secs 2023-05-08T08:01:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:49 smithi186 ceph-mon[126480]: pgmap v8296: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 127 KiB/s wr, 7 op/s 2023-05-08T08:01:50.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:49 smithi133 ceph-mon[125939]: pgmap v8296: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 127 KiB/s wr, 7 op/s 2023-05-08T08:01:50.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:49 smithi096 ceph-mon[124666]: pgmap v8296: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 127 KiB/s wr, 7 op/s 2023-05-08T08:01:51.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15449.755286 secs 2023-05-08T08:01:51.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15449.755286 secs 2023-05-08T08:01:51.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15449.755286 secs 2023-05-08T08:01:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:51 smithi186 ceph-mon[126480]: pgmap v8297: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 384 KiB/s wr, 12 op/s 2023-05-08T08:01:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:51 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:01:52.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:51 smithi133 ceph-mon[125939]: pgmap v8297: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 384 KiB/s wr, 12 op/s 2023-05-08T08:01:52.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:51 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:01:52.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:51 smithi096 ceph-mon[124666]: pgmap v8297: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 384 KiB/s wr, 12 op/s 2023-05-08T08:01:52.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:51 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:01:53.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:01:53.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:01:53.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:01:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:01:53.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:01:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:01:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:53 smithi186 ceph-mon[126480]: pgmap v8298: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 279 KiB/s wr, 9 op/s 2023-05-08T08:01:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15452.914930 secs 2023-05-08T08:01:54.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:53 smithi133 ceph-mon[125939]: pgmap v8298: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 279 KiB/s wr, 9 op/s 2023-05-08T08:01:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15452.914930 secs 2023-05-08T08:01:54.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:53 smithi096 ceph-mon[124666]: pgmap v8298: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 279 KiB/s wr, 9 op/s 2023-05-08T08:01:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15452.914930 secs 2023-05-08T08:01:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:55 smithi186 ceph-mon[126480]: pgmap v8299: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 369 KiB/s wr, 14 op/s 2023-05-08T08:01:56.218 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15454.755416 secs 2023-05-08T08:01:56.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:55 smithi133 ceph-mon[125939]: pgmap v8299: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 369 KiB/s wr, 14 op/s 2023-05-08T08:01:56.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15454.755416 secs 2023-05-08T08:01:56.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:55 smithi096 ceph-mon[124666]: pgmap v8299: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 369 KiB/s wr, 14 op/s 2023-05-08T08:01:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15454.755416 secs 2023-05-08T08:01:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:56 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:01:57.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:56 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:01:57.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:56 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:01:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:57 smithi186 ceph-mon[126480]: pgmap v8300: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 348 KiB/s wr, 11 op/s 2023-05-08T08:01:58.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:57 smithi133 ceph-mon[125939]: pgmap v8300: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 348 KiB/s wr, 11 op/s 2023-05-08T08:01:58.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:57 smithi096 ceph-mon[124666]: pgmap v8300: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 348 KiB/s wr, 11 op/s 2023-05-08T08:01:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15457.914996 secs 2023-05-08T08:01:59.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15457.914996 secs 2023-05-08T08:01:59.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15457.914996 secs 2023-05-08T08:02:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:59 smithi186 ceph-mon[126480]: pgmap v8301: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 348 KiB/s wr, 10 op/s 2023-05-08T08:02:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:01:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15458.472185 secs 2023-05-08T08:02:00.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:59 smithi133 ceph-mon[125939]: pgmap v8301: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 348 KiB/s wr, 10 op/s 2023-05-08T08:02:00.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:01:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15458.472185 secs 2023-05-08T08:02:00.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:59 smithi096 ceph-mon[124666]: pgmap v8301: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 348 KiB/s wr, 10 op/s 2023-05-08T08:02:00.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:01:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15458.472185 secs 2023-05-08T08:02:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:02:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:02:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15459.755560 secs 2023-05-08T08:02:01.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:02:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:02:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15459.755560 secs 2023-05-08T08:02:01.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:02:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:02:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15459.755560 secs 2023-05-08T08:02:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:01 smithi186 ceph-mon[126480]: pgmap v8302: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 505 KiB/s rd, 484 KiB/s wr, 15 op/s 2023-05-08T08:02:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:01 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:02:02.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:01 smithi133 ceph-mon[125939]: pgmap v8302: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 505 KiB/s rd, 484 KiB/s wr, 15 op/s 2023-05-08T08:02:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:01 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:02:02.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:01 smithi096 ceph-mon[124666]: pgmap v8302: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 505 KiB/s rd, 484 KiB/s wr, 15 op/s 2023-05-08T08:02:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:01 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:02:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:03 smithi186 ceph-mon[126480]: pgmap v8303: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 226 KiB/s wr, 10 op/s 2023-05-08T08:02:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15462.915120 secs 2023-05-08T08:02:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15463.472305 secs 2023-05-08T08:02:04.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:03 smithi133 ceph-mon[125939]: pgmap v8303: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 226 KiB/s wr, 10 op/s 2023-05-08T08:02:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15462.915120 secs 2023-05-08T08:02:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15463.472305 secs 2023-05-08T08:02:04.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:03 smithi096 ceph-mon[124666]: pgmap v8303: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 226 KiB/s wr, 10 op/s 2023-05-08T08:02:04.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15462.915120 secs 2023-05-08T08:02:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15463.472305 secs 2023-05-08T08:02:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:05 smithi186 ceph-mon[126480]: pgmap v8304: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 271 KiB/s wr, 27 op/s 2023-05-08T08:02:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15464.755679 secs 2023-05-08T08:02:06.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:05 smithi133 ceph-mon[125939]: pgmap v8304: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 271 KiB/s wr, 27 op/s 2023-05-08T08:02:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15464.755679 secs 2023-05-08T08:02:06.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:05 smithi096 ceph-mon[124666]: pgmap v8304: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 271 KiB/s wr, 27 op/s 2023-05-08T08:02:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15464.755679 secs 2023-05-08T08:02:07.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:06 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:02:07.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:06 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:02:07.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:06 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:02:08.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:07 smithi186 ceph-mon[126480]: pgmap v8305: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 181 KiB/s wr, 22 op/s 2023-05-08T08:02:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:07 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:02:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:07 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:02:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:07 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:02:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:07 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:02:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:07 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T08:02:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:07 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T08:02:08.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:07 smithi133 ceph-mon[125939]: pgmap v8305: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 181 KiB/s wr, 22 op/s 2023-05-08T08:02:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:07 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:02:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:07 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:02:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:07 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:02:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:07 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:02:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:07 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T08:02:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:07 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T08:02:08.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:07 smithi096 ceph-mon[124666]: pgmap v8305: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 181 KiB/s wr, 22 op/s 2023-05-08T08:02:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:07 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:02:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:07 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:02:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:07 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:02:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:07 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:02:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:07 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T08:02:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:07 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T08:02:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:08 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:02:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15467.915232 secs 2023-05-08T08:02:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15468.472422 secs 2023-05-08T08:02:09.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:08 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:02:09.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15467.915232 secs 2023-05-08T08:02:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15468.472422 secs 2023-05-08T08:02:09.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:08 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:02:09.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15467.915232 secs 2023-05-08T08:02:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15468.472422 secs 2023-05-08T08:02:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:09 smithi186 ceph-mon[126480]: pgmap v8306: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 181 KiB/s wr, 22 op/s 2023-05-08T08:02:10.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:09 smithi133 ceph-mon[125939]: pgmap v8306: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 181 KiB/s wr, 22 op/s 2023-05-08T08:02:10.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:09 smithi096 ceph-mon[124666]: pgmap v8306: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 181 KiB/s wr, 22 op/s 2023-05-08T08:02:11.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15469.755788 secs 2023-05-08T08:02:11.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15469.755788 secs 2023-05-08T08:02:11.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15469.755788 secs 2023-05-08T08:02:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:11 smithi186 ceph-mon[126480]: pgmap v8307: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 297 KiB/s wr, 25 op/s 2023-05-08T08:02:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:11 smithi186 ceph-mon[126480]: osdmap e596: 12 total, 12 up, 12 in 2023-05-08T08:02:12.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:11 smithi133 ceph-mon[125939]: pgmap v8307: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 297 KiB/s wr, 25 op/s 2023-05-08T08:02:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:11 smithi133 ceph-mon[125939]: osdmap e596: 12 total, 12 up, 12 in 2023-05-08T08:02:12.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:11 smithi096 ceph-mon[124666]: pgmap v8307: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 297 KiB/s wr, 25 op/s 2023-05-08T08:02:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:11 smithi096 ceph-mon[124666]: osdmap e596: 12 total, 12 up, 12 in 2023-05-08T08:02:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:13 smithi186 ceph-mon[126480]: pgmap v8309: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 193 KiB/s wr, 25 op/s 2023-05-08T08:02:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15472.915371 secs 2023-05-08T08:02:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15473.472569 secs 2023-05-08T08:02:14.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:13 smithi133 ceph-mon[125939]: pgmap v8309: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 193 KiB/s wr, 25 op/s 2023-05-08T08:02:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15472.915371 secs 2023-05-08T08:02:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15473.472569 secs 2023-05-08T08:02:14.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:13 smithi096 ceph-mon[124666]: pgmap v8309: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 193 KiB/s wr, 25 op/s 2023-05-08T08:02:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15472.915371 secs 2023-05-08T08:02:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15473.472569 secs 2023-05-08T08:02:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:15 smithi186 ceph-mon[126480]: pgmap v8310: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 140 KiB/s wr, 7 op/s 2023-05-08T08:02:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15474.755903 secs 2023-05-08T08:02:16.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:15 smithi133 ceph-mon[125939]: pgmap v8310: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 140 KiB/s wr, 7 op/s 2023-05-08T08:02:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15474.755903 secs 2023-05-08T08:02:16.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:15 smithi096 ceph-mon[124666]: pgmap v8310: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 140 KiB/s wr, 7 op/s 2023-05-08T08:02:16.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15474.755903 secs 2023-05-08T08:02:18.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:17 smithi186 ceph-mon[126480]: pgmap v8311: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 140 KiB/s wr, 7 op/s 2023-05-08T08:02:18.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:17 smithi133 ceph-mon[125939]: pgmap v8311: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 140 KiB/s wr, 7 op/s 2023-05-08T08:02:18.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:17 smithi096 ceph-mon[124666]: pgmap v8311: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 140 KiB/s wr, 7 op/s 2023-05-08T08:02:19.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15477.915525 secs 2023-05-08T08:02:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15478.472678 secs 2023-05-08T08:02:19.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15477.915525 secs 2023-05-08T08:02:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15478.472678 secs 2023-05-08T08:02:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15477.915525 secs 2023-05-08T08:02:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15478.472678 secs 2023-05-08T08:02:20.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:19 smithi133 ceph-mon[125939]: pgmap v8312: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 140 KiB/s wr, 7 op/s 2023-05-08T08:02:20.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:19 smithi096 ceph-mon[124666]: pgmap v8312: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 140 KiB/s wr, 7 op/s 2023-05-08T08:02:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:19 smithi186 ceph-mon[126480]: pgmap v8312: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 140 KiB/s wr, 7 op/s 2023-05-08T08:02:21.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15479.756024 secs 2023-05-08T08:02:21.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15479.756024 secs 2023-05-08T08:02:21.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15479.756024 secs 2023-05-08T08:02:22.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:21 smithi133 ceph-mon[125939]: pgmap v8313: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 409 B/s wr, 6 op/s 2023-05-08T08:02:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:21 smithi133 ceph-mon[125939]: osdmap e597: 12 total, 12 up, 12 in 2023-05-08T08:02:22.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:21 smithi096 ceph-mon[124666]: pgmap v8313: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 409 B/s wr, 6 op/s 2023-05-08T08:02:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:21 smithi096 ceph-mon[124666]: osdmap e597: 12 total, 12 up, 12 in 2023-05-08T08:02:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:21 smithi186 ceph-mon[126480]: pgmap v8313: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 409 B/s wr, 6 op/s 2023-05-08T08:02:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:21 smithi186 ceph-mon[126480]: osdmap e597: 12 total, 12 up, 12 in 2023-05-08T08:02:24.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:23 smithi133 ceph-mon[125939]: pgmap v8315: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 409 B/s wr, 6 op/s 2023-05-08T08:02:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15482.915651 secs 2023-05-08T08:02:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15483.472796 secs 2023-05-08T08:02:24.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:23 smithi096 ceph-mon[124666]: pgmap v8315: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 409 B/s wr, 6 op/s 2023-05-08T08:02:24.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15482.915651 secs 2023-05-08T08:02:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15483.472796 secs 2023-05-08T08:02:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:23 smithi186 ceph-mon[126480]: pgmap v8315: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 409 B/s wr, 6 op/s 2023-05-08T08:02:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15482.915651 secs 2023-05-08T08:02:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15483.472796 secs 2023-05-08T08:02:26.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:25 smithi133 ceph-mon[125939]: pgmap v8316: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:02:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15484.756157 secs 2023-05-08T08:02:26.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:25 smithi096 ceph-mon[124666]: pgmap v8316: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:02:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15484.756157 secs 2023-05-08T08:02:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:25 smithi186 ceph-mon[126480]: pgmap v8316: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:02:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15484.756157 secs 2023-05-08T08:02:28.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:27 smithi133 ceph-mon[125939]: pgmap v8317: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:02:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:27 smithi186 ceph-mon[126480]: pgmap v8317: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:02:28.369 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:27 smithi096 ceph-mon[124666]: pgmap v8317: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:02:29.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15487.915769 secs 2023-05-08T08:02:29.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15488.472917 secs 2023-05-08T08:02:29.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15487.915769 secs 2023-05-08T08:02:29.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15488.472917 secs 2023-05-08T08:02:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15487.915769 secs 2023-05-08T08:02:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15488.472917 secs 2023-05-08T08:02:30.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:29 smithi133 ceph-mon[125939]: pgmap v8318: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:02:30.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:29 smithi096 ceph-mon[124666]: pgmap v8318: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:02:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:29 smithi186 ceph-mon[126480]: pgmap v8318: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:02:31.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15489.756294 secs 2023-05-08T08:02:31.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15489.756294 secs 2023-05-08T08:02:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15489.756294 secs 2023-05-08T08:02:32.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:31 smithi133 ceph-mon[125939]: pgmap v8319: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:02:32.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:31 smithi096 ceph-mon[124666]: pgmap v8319: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:02:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:31 smithi186 ceph-mon[126480]: pgmap v8319: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:02:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:33 smithi133 ceph-mon[125939]: pgmap v8320: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 93 B/s wr, 5 op/s 2023-05-08T08:02:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15492.915898 secs 2023-05-08T08:02:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15493.473041 secs 2023-05-08T08:02:34.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:33 smithi096 ceph-mon[124666]: pgmap v8320: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 93 B/s wr, 5 op/s 2023-05-08T08:02:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15492.915898 secs 2023-05-08T08:02:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15493.473041 secs 2023-05-08T08:02:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:33 smithi186 ceph-mon[126480]: pgmap v8320: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 93 B/s wr, 5 op/s 2023-05-08T08:02:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15492.915898 secs 2023-05-08T08:02:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15493.473041 secs 2023-05-08T08:02:36.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:35 smithi133 ceph-mon[125939]: pgmap v8321: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 938 B/s wr, 9 op/s 2023-05-08T08:02:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15494.756375 secs 2023-05-08T08:02:36.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:35 smithi096 ceph-mon[124666]: pgmap v8321: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 938 B/s wr, 9 op/s 2023-05-08T08:02:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15494.756375 secs 2023-05-08T08:02:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:35 smithi186 ceph-mon[126480]: pgmap v8321: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 938 B/s wr, 9 op/s 2023-05-08T08:02:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15494.756375 secs 2023-05-08T08:02:38.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:37 smithi133 ceph-mon[125939]: pgmap v8322: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T08:02:38.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:37 smithi096 ceph-mon[124666]: pgmap v8322: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T08:02:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:37 smithi186 ceph-mon[126480]: pgmap v8322: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T08:02:39.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15497.916027 secs 2023-05-08T08:02:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15498.473171 secs 2023-05-08T08:02:39.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15497.916027 secs 2023-05-08T08:02:39.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15498.473171 secs 2023-05-08T08:02:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15497.916027 secs 2023-05-08T08:02:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15498.473171 secs 2023-05-08T08:02:40.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:39 smithi133 ceph-mon[125939]: pgmap v8323: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T08:02:40.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:39 smithi096 ceph-mon[124666]: pgmap v8323: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T08:02:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:39 smithi186 ceph-mon[126480]: pgmap v8323: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T08:02:42.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:41 smithi133 ceph-mon[125939]: pgmap v8324: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 107 KiB/s wr, 9 op/s 2023-05-08T08:02:42.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:41 smithi096 ceph-mon[124666]: pgmap v8324: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 107 KiB/s wr, 9 op/s 2023-05-08T08:02:42.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:41 smithi186 ceph-mon[126480]: pgmap v8324: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 107 KiB/s wr, 9 op/s 2023-05-08T08:02:43.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:02:43.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:02:43.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:02:44.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:43 smithi133 ceph-mon[125939]: pgmap v8325: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 107 KiB/s wr, 7 op/s 2023-05-08T08:02:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:43 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:02:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:02:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:02:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15502.916155 secs 2023-05-08T08:02:44.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:43 smithi096 ceph-mon[124666]: pgmap v8325: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 107 KiB/s wr, 7 op/s 2023-05-08T08:02:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:43 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:02:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:02:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:02:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15502.916155 secs 2023-05-08T08:02:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:43 smithi186 ceph-mon[126480]: pgmap v8325: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 107 KiB/s wr, 7 op/s 2023-05-08T08:02:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:43 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:02:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:02:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:02:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15502.916155 secs 2023-05-08T08:02:46.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:45 smithi133 ceph-mon[125939]: pgmap v8326: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 128 KiB/s wr, 10 op/s 2023-05-08T08:02:46.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:45 smithi096 ceph-mon[124666]: pgmap v8326: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 128 KiB/s wr, 10 op/s 2023-05-08T08:02:46.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:45 smithi186 ceph-mon[126480]: pgmap v8326: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 128 KiB/s wr, 10 op/s 2023-05-08T08:02:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:47 smithi186 ceph-mon[126480]: pgmap v8327: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 128 KiB/s wr, 7 op/s 2023-05-08T08:02:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:02:48.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:47 smithi133 ceph-mon[125939]: pgmap v8327: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 128 KiB/s wr, 7 op/s 2023-05-08T08:02:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:02:48.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:47 smithi096 ceph-mon[124666]: pgmap v8327: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 128 KiB/s wr, 7 op/s 2023-05-08T08:02:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:02:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:02:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:02:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15507.916280 secs 2023-05-08T08:02:49.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:02:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:02:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15507.916280 secs 2023-05-08T08:02:49.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:02:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:02:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15507.916280 secs 2023-05-08T08:02:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:49 smithi186 ceph-mon[126480]: pgmap v8328: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 128 KiB/s wr, 7 op/s 2023-05-08T08:02:50.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:49 smithi133 ceph-mon[125939]: pgmap v8328: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 128 KiB/s wr, 7 op/s 2023-05-08T08:02:50.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:49 smithi096 ceph-mon[124666]: pgmap v8328: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 128 KiB/s wr, 7 op/s 2023-05-08T08:02:51.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15509.756740 secs 2023-05-08T08:02:51.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15509.756740 secs 2023-05-08T08:02:51.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15509.756740 secs 2023-05-08T08:02:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:51 smithi186 ceph-mon[126480]: pgmap v8329: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 387 KiB/s wr, 12 op/s 2023-05-08T08:02:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:51 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:02:52.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:51 smithi133 ceph-mon[125939]: pgmap v8329: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 387 KiB/s wr, 12 op/s 2023-05-08T08:02:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:51 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:02:52.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:51 smithi096 ceph-mon[124666]: pgmap v8329: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 387 KiB/s wr, 12 op/s 2023-05-08T08:02:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:51 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:02:53.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:02:53.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:02:53.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:02:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:02:53.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:02:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:02:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:53 smithi186 ceph-mon[126480]: pgmap v8330: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 281 KiB/s wr, 9 op/s 2023-05-08T08:02:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15512.916421 secs 2023-05-08T08:02:54.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:53 smithi133 ceph-mon[125939]: pgmap v8330: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 281 KiB/s wr, 9 op/s 2023-05-08T08:02:54.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15512.916421 secs 2023-05-08T08:02:54.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:53 smithi096 ceph-mon[124666]: pgmap v8330: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 281 KiB/s wr, 9 op/s 2023-05-08T08:02:54.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15512.916421 secs 2023-05-08T08:02:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15513.473532 secs 2023-05-08T08:02:55.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15513.473532 secs 2023-05-08T08:02:55.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15513.473532 secs 2023-05-08T08:02:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:55 smithi186 ceph-mon[126480]: pgmap v8331: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 302 KiB/s wr, 13 op/s 2023-05-08T08:02:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15514.756871 secs 2023-05-08T08:02:56.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:55 smithi133 ceph-mon[125939]: pgmap v8331: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 302 KiB/s wr, 13 op/s 2023-05-08T08:02:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15514.756871 secs 2023-05-08T08:02:56.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:55 smithi096 ceph-mon[124666]: pgmap v8331: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 302 KiB/s wr, 13 op/s 2023-05-08T08:02:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15514.756871 secs 2023-05-08T08:02:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:02:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:02:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:56 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:02:57.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:02:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:02:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:56 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:02:57.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:02:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:02:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:56 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:02:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:57 smithi186 ceph-mon[126480]: pgmap v8332: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 281 KiB/s wr, 9 op/s 2023-05-08T08:02:58.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:57 smithi133 ceph-mon[125939]: pgmap v8332: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 281 KiB/s wr, 9 op/s 2023-05-08T08:02:58.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:57 smithi096 ceph-mon[124666]: pgmap v8332: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 281 KiB/s wr, 9 op/s 2023-05-08T08:02:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15517.916537 secs 2023-05-08T08:02:59.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15517.916537 secs 2023-05-08T08:02:59.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15517.916537 secs 2023-05-08T08:03:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:59 smithi186 ceph-mon[126480]: pgmap v8333: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 281 KiB/s wr, 9 op/s 2023-05-08T08:03:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:02:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15518.473655 secs 2023-05-08T08:03:00.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:59 smithi133 ceph-mon[125939]: pgmap v8333: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 281 KiB/s wr, 9 op/s 2023-05-08T08:03:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:02:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15518.473655 secs 2023-05-08T08:03:00.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:59 smithi096 ceph-mon[124666]: pgmap v8333: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 281 KiB/s wr, 9 op/s 2023-05-08T08:03:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:02:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15518.473655 secs 2023-05-08T08:03:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15519.756944 secs 2023-05-08T08:03:01.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15519.756944 secs 2023-05-08T08:03:01.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15519.756944 secs 2023-05-08T08:03:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:01 smithi186 ceph-mon[126480]: pgmap v8334: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 478 KiB/s wr, 13 op/s 2023-05-08T08:03:02.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:01 smithi133 ceph-mon[125939]: pgmap v8334: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 478 KiB/s wr, 13 op/s 2023-05-08T08:03:02.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:01 smithi096 ceph-mon[124666]: pgmap v8334: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 478 KiB/s wr, 13 op/s 2023-05-08T08:03:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:03 smithi186 ceph-mon[126480]: pgmap v8335: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 219 KiB/s wr, 8 op/s 2023-05-08T08:03:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15522.916666 secs 2023-05-08T08:03:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15523.473737 secs 2023-05-08T08:03:04.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:03 smithi133 ceph-mon[125939]: pgmap v8335: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 219 KiB/s wr, 8 op/s 2023-05-08T08:03:04.285 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15522.916666 secs 2023-05-08T08:03:04.286 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15523.473737 secs 2023-05-08T08:03:04.286 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:03 smithi096 ceph-mon[124666]: pgmap v8335: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 219 KiB/s wr, 8 op/s 2023-05-08T08:03:04.287 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15522.916666 secs 2023-05-08T08:03:04.287 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15523.473737 secs 2023-05-08T08:03:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:05 smithi186 ceph-mon[126480]: pgmap v8336: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 402 KiB/s wr, 27 op/s 2023-05-08T08:03:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15524.757083 secs 2023-05-08T08:03:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:05 smithi133 ceph-mon[125939]: pgmap v8336: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 402 KiB/s wr, 27 op/s 2023-05-08T08:03:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15524.757083 secs 2023-05-08T08:03:06.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:05 smithi096 ceph-mon[124666]: pgmap v8336: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 402 KiB/s wr, 27 op/s 2023-05-08T08:03:06.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15524.757083 secs 2023-05-08T08:03:07.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:06 smithi186 ceph-mon[126480]: osdmap e598: 12 total, 12 up, 12 in 2023-05-08T08:03:07.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:06 smithi133 ceph-mon[125939]: osdmap e598: 12 total, 12 up, 12 in 2023-05-08T08:03:07.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:06 smithi096 ceph-mon[124666]: osdmap e598: 12 total, 12 up, 12 in 2023-05-08T08:03:08.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:07 smithi186 ceph-mon[126480]: pgmap v8338: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 457 KiB/s wr, 28 op/s 2023-05-08T08:03:08.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:07 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:03:08.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:07 smithi133 ceph-mon[125939]: pgmap v8338: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 457 KiB/s wr, 28 op/s 2023-05-08T08:03:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:07 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:03:08.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:07 smithi096 ceph-mon[124666]: pgmap v8338: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 457 KiB/s wr, 28 op/s 2023-05-08T08:03:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:07 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:03:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:08 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:03:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:08 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:03:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:08 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:03:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:08 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:03:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:08 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T08:03:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:08 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T08:03:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:08 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:03:09.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15527.916762 secs 2023-05-08T08:03:09.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15528.473845 secs 2023-05-08T08:03:09.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:08 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:03:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:08 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:03:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:08 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:03:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:08 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:03:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:08 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T08:03:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:08 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T08:03:09.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:08 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:03:09.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15527.916762 secs 2023-05-08T08:03:09.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15528.473845 secs 2023-05-08T08:03:09.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:08 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:03:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:08 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:03:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:08 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:03:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:08 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:03:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:08 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T08:03:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:08 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T08:03:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:08 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:03:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15527.916762 secs 2023-05-08T08:03:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15528.473845 secs 2023-05-08T08:03:10.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:09 smithi133 ceph-mon[125939]: pgmap v8339: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 457 KiB/s wr, 28 op/s 2023-05-08T08:03:10.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:09 smithi096 ceph-mon[124666]: pgmap v8339: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 457 KiB/s wr, 28 op/s 2023-05-08T08:03:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:09 smithi186 ceph-mon[126480]: pgmap v8339: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 457 KiB/s wr, 28 op/s 2023-05-08T08:03:11.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15529.757187 secs 2023-05-08T08:03:11.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15529.757187 secs 2023-05-08T08:03:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15529.757187 secs 2023-05-08T08:03:12.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:11 smithi133 ceph-mon[125939]: pgmap v8340: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 359 KiB/s rd, 360 KiB/s wr, 28 op/s 2023-05-08T08:03:12.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:11 smithi133 ceph-mon[125939]: osdmap e599: 12 total, 12 up, 12 in 2023-05-08T08:03:12.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:11 smithi096 ceph-mon[124666]: pgmap v8340: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 359 KiB/s rd, 360 KiB/s wr, 28 op/s 2023-05-08T08:03:12.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:11 smithi096 ceph-mon[124666]: osdmap e599: 12 total, 12 up, 12 in 2023-05-08T08:03:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:11 smithi186 ceph-mon[126480]: pgmap v8340: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 359 KiB/s rd, 360 KiB/s wr, 28 op/s 2023-05-08T08:03:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:11 smithi186 ceph-mon[126480]: osdmap e599: 12 total, 12 up, 12 in 2023-05-08T08:03:14.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:13 smithi133 ceph-mon[125939]: pgmap v8342: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 175 KiB/s wr, 7 op/s 2023-05-08T08:03:14.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15532.916895 secs 2023-05-08T08:03:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15533.473942 secs 2023-05-08T08:03:14.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:13 smithi096 ceph-mon[124666]: pgmap v8342: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 175 KiB/s wr, 7 op/s 2023-05-08T08:03:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15532.916895 secs 2023-05-08T08:03:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15533.473942 secs 2023-05-08T08:03:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:13 smithi186 ceph-mon[126480]: pgmap v8342: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 175 KiB/s wr, 7 op/s 2023-05-08T08:03:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15532.916895 secs 2023-05-08T08:03:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15533.473942 secs 2023-05-08T08:03:16.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:15 smithi133 ceph-mon[125939]: pgmap v8343: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 159 KiB/s wr, 10 op/s 2023-05-08T08:03:16.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15534.757316 secs 2023-05-08T08:03:16.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:15 smithi096 ceph-mon[124666]: pgmap v8343: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 159 KiB/s wr, 10 op/s 2023-05-08T08:03:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15534.757316 secs 2023-05-08T08:03:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:15 smithi186 ceph-mon[126480]: pgmap v8343: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 159 KiB/s wr, 10 op/s 2023-05-08T08:03:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15534.757316 secs 2023-05-08T08:03:18.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:17 smithi133 ceph-mon[125939]: pgmap v8344: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 140 KiB/s wr, 9 op/s 2023-05-08T08:03:18.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:17 smithi096 ceph-mon[124666]: pgmap v8344: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 140 KiB/s wr, 9 op/s 2023-05-08T08:03:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:17 smithi186 ceph-mon[126480]: pgmap v8344: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 140 KiB/s wr, 9 op/s 2023-05-08T08:03:19.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15537.917032 secs 2023-05-08T08:03:19.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15538.474051 secs 2023-05-08T08:03:19.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15537.917032 secs 2023-05-08T08:03:19.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15538.474051 secs 2023-05-08T08:03:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15537.917032 secs 2023-05-08T08:03:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15538.474051 secs 2023-05-08T08:03:20.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:19 smithi133 ceph-mon[125939]: pgmap v8345: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 140 KiB/s wr, 9 op/s 2023-05-08T08:03:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:19 smithi096 ceph-mon[124666]: pgmap v8345: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 140 KiB/s wr, 9 op/s 2023-05-08T08:03:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:19 smithi186 ceph-mon[126480]: pgmap v8345: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 140 KiB/s wr, 9 op/s 2023-05-08T08:03:21.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15539.757433 secs 2023-05-08T08:03:21.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15539.757433 secs 2023-05-08T08:03:21.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15539.757433 secs 2023-05-08T08:03:22.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:21 smithi133 ceph-mon[125939]: pgmap v8346: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 44 KiB/s wr, 7 op/s 2023-05-08T08:03:22.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:21 smithi096 ceph-mon[124666]: pgmap v8346: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 44 KiB/s wr, 7 op/s 2023-05-08T08:03:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:21 smithi186 ceph-mon[126480]: pgmap v8346: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 44 KiB/s wr, 7 op/s 2023-05-08T08:03:24.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:23 smithi133 ceph-mon[125939]: pgmap v8347: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 40 KiB/s wr, 7 op/s 2023-05-08T08:03:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15542.917159 secs 2023-05-08T08:03:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15543.474179 secs 2023-05-08T08:03:24.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:23 smithi096 ceph-mon[124666]: pgmap v8347: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 40 KiB/s wr, 7 op/s 2023-05-08T08:03:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15542.917159 secs 2023-05-08T08:03:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15543.474179 secs 2023-05-08T08:03:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:23 smithi186 ceph-mon[126480]: pgmap v8347: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 40 KiB/s wr, 7 op/s 2023-05-08T08:03:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15542.917159 secs 2023-05-08T08:03:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15543.474179 secs 2023-05-08T08:03:26.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:25 smithi133 ceph-mon[125939]: pgmap v8348: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 88 KiB/s wr, 9 op/s 2023-05-08T08:03:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15544.757553 secs 2023-05-08T08:03:26.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:25 smithi096 ceph-mon[124666]: pgmap v8348: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 88 KiB/s wr, 9 op/s 2023-05-08T08:03:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15544.757553 secs 2023-05-08T08:03:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:25 smithi186 ceph-mon[126480]: pgmap v8348: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 88 KiB/s wr, 9 op/s 2023-05-08T08:03:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15544.757553 secs 2023-05-08T08:03:28.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:27 smithi133 ceph-mon[125939]: pgmap v8349: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 87 KiB/s wr, 6 op/s 2023-05-08T08:03:28.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:27 smithi096 ceph-mon[124666]: pgmap v8349: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 87 KiB/s wr, 6 op/s 2023-05-08T08:03:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:27 smithi186 ceph-mon[126480]: pgmap v8349: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 87 KiB/s wr, 6 op/s 2023-05-08T08:03:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15547.917297 secs 2023-05-08T08:03:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15548.474310 secs 2023-05-08T08:03:29.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15547.917297 secs 2023-05-08T08:03:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15548.474310 secs 2023-05-08T08:03:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15547.917297 secs 2023-05-08T08:03:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15548.474310 secs 2023-05-08T08:03:30.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:29 smithi133 ceph-mon[125939]: pgmap v8350: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 87 KiB/s wr, 6 op/s 2023-05-08T08:03:30.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:29 smithi096 ceph-mon[124666]: pgmap v8350: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 87 KiB/s wr, 6 op/s 2023-05-08T08:03:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:29 smithi186 ceph-mon[126480]: pgmap v8350: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 87 KiB/s wr, 6 op/s 2023-05-08T08:03:31.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15549.757645 secs 2023-05-08T08:03:31.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15549.757645 secs 2023-05-08T08:03:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15549.757645 secs 2023-05-08T08:03:32.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:31 smithi133 ceph-mon[125939]: pgmap v8351: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 117 KiB/s wr, 10 op/s 2023-05-08T08:03:32.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:31 smithi096 ceph-mon[124666]: pgmap v8351: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 117 KiB/s wr, 10 op/s 2023-05-08T08:03:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:31 smithi186 ceph-mon[126480]: pgmap v8351: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 117 KiB/s wr, 10 op/s 2023-05-08T08:03:34.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:33 smithi133 ceph-mon[125939]: pgmap v8352: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 81 KiB/s wr, 7 op/s 2023-05-08T08:03:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15552.917412 secs 2023-05-08T08:03:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15553.474431 secs 2023-05-08T08:03:34.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:33 smithi096 ceph-mon[124666]: pgmap v8352: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 81 KiB/s wr, 7 op/s 2023-05-08T08:03:34.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15552.917412 secs 2023-05-08T08:03:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15553.474431 secs 2023-05-08T08:03:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:33 smithi186 ceph-mon[126480]: pgmap v8352: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 81 KiB/s wr, 7 op/s 2023-05-08T08:03:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15552.917412 secs 2023-05-08T08:03:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15553.474431 secs 2023-05-08T08:03:36.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:35 smithi133 ceph-mon[125939]: pgmap v8353: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 199 KiB/s wr, 10 op/s 2023-05-08T08:03:36.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15554.757798 secs 2023-05-08T08:03:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:35 smithi096 ceph-mon[124666]: pgmap v8353: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 199 KiB/s wr, 10 op/s 2023-05-08T08:03:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15554.757798 secs 2023-05-08T08:03:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:35 smithi186 ceph-mon[126480]: pgmap v8353: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 199 KiB/s wr, 10 op/s 2023-05-08T08:03:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15554.757798 secs 2023-05-08T08:03:38.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:37 smithi133 ceph-mon[125939]: pgmap v8354: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 147 KiB/s wr, 7 op/s 2023-05-08T08:03:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:37 smithi096 ceph-mon[124666]: pgmap v8354: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 147 KiB/s wr, 7 op/s 2023-05-08T08:03:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:37 smithi186 ceph-mon[126480]: pgmap v8354: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 147 KiB/s wr, 7 op/s 2023-05-08T08:03:39.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15557.917507 secs 2023-05-08T08:03:39.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15558.474533 secs 2023-05-08T08:03:39.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15557.917507 secs 2023-05-08T08:03:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15558.474533 secs 2023-05-08T08:03:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15557.917507 secs 2023-05-08T08:03:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15558.474533 secs 2023-05-08T08:03:40.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:39 smithi133 ceph-mon[125939]: pgmap v8355: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 147 KiB/s wr, 7 op/s 2023-05-08T08:03:40.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:39 smithi096 ceph-mon[124666]: pgmap v8355: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 147 KiB/s wr, 7 op/s 2023-05-08T08:03:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:39 smithi186 ceph-mon[126480]: pgmap v8355: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 147 KiB/s wr, 7 op/s 2023-05-08T08:03:42.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:41 smithi133 ceph-mon[125939]: pgmap v8356: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 254 KiB/s wr, 11 op/s 2023-05-08T08:03:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:41 smithi096 ceph-mon[124666]: pgmap v8356: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 254 KiB/s wr, 11 op/s 2023-05-08T08:03:42.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:41 smithi186 ceph-mon[126480]: pgmap v8356: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 254 KiB/s wr, 11 op/s 2023-05-08T08:03:43.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:03:43.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:03:43.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:03:44.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:43 smithi133 ceph-mon[125939]: pgmap v8357: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 224 KiB/s wr, 7 op/s 2023-05-08T08:03:44.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:43 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:03:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:03:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:03:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15562.917625 secs 2023-05-08T08:03:44.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:43 smithi096 ceph-mon[124666]: pgmap v8357: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 224 KiB/s wr, 7 op/s 2023-05-08T08:03:44.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:43 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:03:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:03:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:03:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15562.917625 secs 2023-05-08T08:03:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:43 smithi186 ceph-mon[126480]: pgmap v8357: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 224 KiB/s wr, 7 op/s 2023-05-08T08:03:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:43 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:03:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:03:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:03:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15562.917625 secs 2023-05-08T08:03:46.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:45 smithi133 ceph-mon[125939]: pgmap v8358: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 246 KiB/s wr, 11 op/s 2023-05-08T08:03:46.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:45 smithi096 ceph-mon[124666]: pgmap v8358: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 246 KiB/s wr, 11 op/s 2023-05-08T08:03:46.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:45 smithi186 ceph-mon[126480]: pgmap v8358: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 246 KiB/s wr, 11 op/s 2023-05-08T08:03:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:47 smithi186 ceph-mon[126480]: pgmap v8359: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 128 KiB/s wr, 7 op/s 2023-05-08T08:03:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:03:48.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:47 smithi133 ceph-mon[125939]: pgmap v8359: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 128 KiB/s wr, 7 op/s 2023-05-08T08:03:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:03:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:47 smithi096 ceph-mon[124666]: pgmap v8359: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 128 KiB/s wr, 7 op/s 2023-05-08T08:03:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:03:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:03:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:03:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15567.917702 secs 2023-05-08T08:03:49.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:03:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:03:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15567.917702 secs 2023-05-08T08:03:49.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:03:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:03:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15567.917702 secs 2023-05-08T08:03:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:49 smithi186 ceph-mon[126480]: pgmap v8360: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 128 KiB/s wr, 7 op/s 2023-05-08T08:03:50.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:49 smithi133 ceph-mon[125939]: pgmap v8360: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 128 KiB/s wr, 7 op/s 2023-05-08T08:03:50.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:49 smithi096 ceph-mon[124666]: pgmap v8360: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 128 KiB/s wr, 7 op/s 2023-05-08T08:03:51.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15569.758115 secs 2023-05-08T08:03:51.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15569.758115 secs 2023-05-08T08:03:51.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15569.758115 secs 2023-05-08T08:03:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:51 smithi186 ceph-mon[126480]: pgmap v8361: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 403 KiB/s wr, 13 op/s 2023-05-08T08:03:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:51 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:03:52.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:51 smithi133 ceph-mon[125939]: pgmap v8361: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 403 KiB/s wr, 13 op/s 2023-05-08T08:03:52.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:51 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:03:52.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:51 smithi096 ceph-mon[124666]: pgmap v8361: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 403 KiB/s wr, 13 op/s 2023-05-08T08:03:52.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:51 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:03:53.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:03:53.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:03:53.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:03:53.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:03:53.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:03:53.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:03:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:53 smithi186 ceph-mon[126480]: pgmap v8362: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 296 KiB/s wr, 9 op/s 2023-05-08T08:03:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15572.917819 secs 2023-05-08T08:03:54.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:53 smithi133 ceph-mon[125939]: pgmap v8362: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 296 KiB/s wr, 9 op/s 2023-05-08T08:03:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15572.917819 secs 2023-05-08T08:03:54.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:53 smithi096 ceph-mon[124666]: pgmap v8362: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 296 KiB/s wr, 9 op/s 2023-05-08T08:03:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15572.917819 secs 2023-05-08T08:03:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15573.474839 secs 2023-05-08T08:03:55.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15573.474839 secs 2023-05-08T08:03:55.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15573.474839 secs 2023-05-08T08:03:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:55 smithi186 ceph-mon[126480]: pgmap v8363: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 318 KiB/s wr, 13 op/s 2023-05-08T08:03:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15574.758232 secs 2023-05-08T08:03:56.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:55 smithi133 ceph-mon[125939]: pgmap v8363: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 318 KiB/s wr, 13 op/s 2023-05-08T08:03:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15574.758232 secs 2023-05-08T08:03:56.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:55 smithi096 ceph-mon[124666]: pgmap v8363: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 318 KiB/s wr, 13 op/s 2023-05-08T08:03:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15574.758232 secs 2023-05-08T08:03:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:03:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:03:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:56 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:03:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:03:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:03:57.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:56 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:03:57.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:03:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:03:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:56 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:03:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:57 smithi186 ceph-mon[126480]: pgmap v8364: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 296 KiB/s wr, 9 op/s 2023-05-08T08:03:58.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:57 smithi133 ceph-mon[125939]: pgmap v8364: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 296 KiB/s wr, 9 op/s 2023-05-08T08:03:58.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:57 smithi096 ceph-mon[124666]: pgmap v8364: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 296 KiB/s wr, 9 op/s 2023-05-08T08:03:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15577.917949 secs 2023-05-08T08:03:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15578.474950 secs 2023-05-08T08:03:59.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15577.917949 secs 2023-05-08T08:03:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15578.474950 secs 2023-05-08T08:03:59.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15577.917949 secs 2023-05-08T08:03:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15578.474950 secs 2023-05-08T08:04:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:03:59 smithi186 ceph-mon[126480]: pgmap v8365: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 296 KiB/s wr, 9 op/s 2023-05-08T08:04:00.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:03:59 smithi133 ceph-mon[125939]: pgmap v8365: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 296 KiB/s wr, 9 op/s 2023-05-08T08:04:00.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:03:59 smithi096 ceph-mon[124666]: pgmap v8365: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 296 KiB/s wr, 9 op/s 2023-05-08T08:04:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15579.758373 secs 2023-05-08T08:04:01.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15579.758373 secs 2023-05-08T08:04:01.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15579.758373 secs 2023-05-08T08:04:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:01 smithi186 ceph-mon[126480]: pgmap v8366: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 563 KiB/s wr, 14 op/s 2023-05-08T08:04:02.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:01 smithi133 ceph-mon[125939]: pgmap v8366: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 563 KiB/s wr, 14 op/s 2023-05-08T08:04:02.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:01 smithi096 ceph-mon[124666]: pgmap v8366: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 563 KiB/s wr, 14 op/s 2023-05-08T08:04:04.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:03 smithi133 ceph-mon[125939]: pgmap v8367: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 288 KiB/s wr, 8 op/s 2023-05-08T08:04:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15582.918097 secs 2023-05-08T08:04:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15583.475075 secs 2023-05-08T08:04:04.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:03 smithi096 ceph-mon[124666]: pgmap v8367: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 288 KiB/s wr, 8 op/s 2023-05-08T08:04:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15582.918097 secs 2023-05-08T08:04:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15583.475075 secs 2023-05-08T08:04:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:03 smithi186 ceph-mon[126480]: pgmap v8367: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 288 KiB/s wr, 8 op/s 2023-05-08T08:04:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15582.918097 secs 2023-05-08T08:04:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15583.475075 secs 2023-05-08T08:04:06.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:05 smithi133 ceph-mon[125939]: pgmap v8368: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 368 KiB/s wr, 27 op/s 2023-05-08T08:04:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15584.758493 secs 2023-05-08T08:04:06.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:05 smithi096 ceph-mon[124666]: pgmap v8368: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 368 KiB/s wr, 27 op/s 2023-05-08T08:04:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15584.758493 secs 2023-05-08T08:04:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:05 smithi186 ceph-mon[126480]: pgmap v8368: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 368 KiB/s wr, 27 op/s 2023-05-08T08:04:06.383 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15584.758493 secs 2023-05-08T08:04:08.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:07 smithi133 ceph-mon[125939]: pgmap v8369: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 346 KiB/s wr, 23 op/s 2023-05-08T08:04:08.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:07 smithi096 ceph-mon[124666]: pgmap v8369: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 346 KiB/s wr, 23 op/s 2023-05-08T08:04:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:07 smithi186 ceph-mon[126480]: pgmap v8369: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 346 KiB/s wr, 23 op/s 2023-05-08T08:04:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:08 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:04:09.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15587.918195 secs 2023-05-08T08:04:09.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:08 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:04:09.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:08 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:04:09.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:08 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:04:09.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15588.475213 secs 2023-05-08T08:04:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:08 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:04:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15587.918195 secs 2023-05-08T08:04:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:08 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:04:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:08 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:04:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:08 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:04:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15588.475213 secs 2023-05-08T08:04:09.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:08 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:04:09.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15587.918195 secs 2023-05-08T08:04:09.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:08 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:04:09.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:08 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:04:09.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:08 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:04:09.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15588.475213 secs 2023-05-08T08:04:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:09 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:04:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:09 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T08:04:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:09 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T08:04:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:09 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:04:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:09 smithi133 ceph-mon[125939]: pgmap v8370: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 346 KiB/s wr, 23 op/s 2023-05-08T08:04:10.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:09 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:04:10.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:09 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T08:04:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:09 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T08:04:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:09 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:04:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:09 smithi096 ceph-mon[124666]: pgmap v8370: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 346 KiB/s wr, 23 op/s 2023-05-08T08:04:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:09 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:04:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:09 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T08:04:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:09 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T08:04:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:09 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:04:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:09 smithi186 ceph-mon[126480]: pgmap v8370: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 346 KiB/s wr, 23 op/s 2023-05-08T08:04:11.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15589.758590 secs 2023-05-08T08:04:11.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15589.758590 secs 2023-05-08T08:04:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15589.758590 secs 2023-05-08T08:04:12.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:11 smithi133 ceph-mon[125939]: pgmap v8371: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 471 KiB/s wr, 27 op/s 2023-05-08T08:04:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:11 smithi133 ceph-mon[125939]: osdmap e600: 12 total, 12 up, 12 in 2023-05-08T08:04:12.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:11 smithi096 ceph-mon[124666]: pgmap v8371: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 471 KiB/s wr, 27 op/s 2023-05-08T08:04:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:11 smithi096 ceph-mon[124666]: osdmap e600: 12 total, 12 up, 12 in 2023-05-08T08:04:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:11 smithi186 ceph-mon[126480]: pgmap v8371: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 471 KiB/s wr, 27 op/s 2023-05-08T08:04:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:11 smithi186 ceph-mon[126480]: osdmap e600: 12 total, 12 up, 12 in 2023-05-08T08:04:14.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:13 smithi133 ceph-mon[125939]: pgmap v8373: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 245 KiB/s wr, 27 op/s 2023-05-08T08:04:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15592.918316 secs 2023-05-08T08:04:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15593.475346 secs 2023-05-08T08:04:14.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:13 smithi096 ceph-mon[124666]: pgmap v8373: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 245 KiB/s wr, 27 op/s 2023-05-08T08:04:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15592.918316 secs 2023-05-08T08:04:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15593.475346 secs 2023-05-08T08:04:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:13 smithi186 ceph-mon[126480]: pgmap v8373: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 245 KiB/s wr, 27 op/s 2023-05-08T08:04:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15592.918316 secs 2023-05-08T08:04:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15593.475346 secs 2023-05-08T08:04:16.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:15 smithi133 ceph-mon[125939]: pgmap v8374: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 159 KiB/s wr, 8 op/s 2023-05-08T08:04:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15594.758708 secs 2023-05-08T08:04:16.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:15 smithi096 ceph-mon[124666]: pgmap v8374: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 159 KiB/s wr, 8 op/s 2023-05-08T08:04:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15594.758708 secs 2023-05-08T08:04:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:15 smithi186 ceph-mon[126480]: pgmap v8374: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 159 KiB/s wr, 8 op/s 2023-05-08T08:04:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15594.758708 secs 2023-05-08T08:04:18.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:17 smithi133 ceph-mon[125939]: pgmap v8375: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 159 KiB/s wr, 8 op/s 2023-05-08T08:04:18.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:17 smithi096 ceph-mon[124666]: pgmap v8375: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 159 KiB/s wr, 8 op/s 2023-05-08T08:04:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:17 smithi186 ceph-mon[126480]: pgmap v8375: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 159 KiB/s wr, 8 op/s 2023-05-08T08:04:19.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15597.918451 secs 2023-05-08T08:04:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15598.475512 secs 2023-05-08T08:04:19.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15597.918451 secs 2023-05-08T08:04:19.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15598.475512 secs 2023-05-08T08:04:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15597.918451 secs 2023-05-08T08:04:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15598.475512 secs 2023-05-08T08:04:20.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:19 smithi133 ceph-mon[125939]: pgmap v8376: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 159 KiB/s wr, 8 op/s 2023-05-08T08:04:20.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:19 smithi096 ceph-mon[124666]: pgmap v8376: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 159 KiB/s wr, 8 op/s 2023-05-08T08:04:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:19 smithi186 ceph-mon[126480]: pgmap v8376: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 159 KiB/s wr, 8 op/s 2023-05-08T08:04:21.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15599.758830 secs 2023-05-08T08:04:21.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15599.758830 secs 2023-05-08T08:04:21.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15599.758830 secs 2023-05-08T08:04:22.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:21 smithi133 ceph-mon[125939]: pgmap v8377: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 53 KiB/s wr, 8 op/s 2023-05-08T08:04:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:21 smithi133 ceph-mon[125939]: osdmap e601: 12 total, 12 up, 12 in 2023-05-08T08:04:22.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:21 smithi096 ceph-mon[124666]: pgmap v8377: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 53 KiB/s wr, 8 op/s 2023-05-08T08:04:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:21 smithi096 ceph-mon[124666]: osdmap e601: 12 total, 12 up, 12 in 2023-05-08T08:04:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:21 smithi186 ceph-mon[126480]: pgmap v8377: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 53 KiB/s wr, 8 op/s 2023-05-08T08:04:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:21 smithi186 ceph-mon[126480]: osdmap e601: 12 total, 12 up, 12 in 2023-05-08T08:04:24.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:23 smithi133 ceph-mon[125939]: pgmap v8379: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 53 KiB/s wr, 8 op/s 2023-05-08T08:04:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15602.918574 secs 2023-05-08T08:04:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15603.475632 secs 2023-05-08T08:04:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:23 smithi096 ceph-mon[124666]: pgmap v8379: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 53 KiB/s wr, 8 op/s 2023-05-08T08:04:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15602.918574 secs 2023-05-08T08:04:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15603.475632 secs 2023-05-08T08:04:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:23 smithi186 ceph-mon[126480]: pgmap v8379: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 53 KiB/s wr, 8 op/s 2023-05-08T08:04:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15602.918574 secs 2023-05-08T08:04:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15603.475632 secs 2023-05-08T08:04:26.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:25 smithi133 ceph-mon[125939]: pgmap v8380: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 106 KiB/s wr, 8 op/s 2023-05-08T08:04:26.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15604.758943 secs 2023-05-08T08:04:26.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:25 smithi096 ceph-mon[124666]: pgmap v8380: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 106 KiB/s wr, 8 op/s 2023-05-08T08:04:26.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15604.758943 secs 2023-05-08T08:04:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:25 smithi186 ceph-mon[126480]: pgmap v8380: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 106 KiB/s wr, 8 op/s 2023-05-08T08:04:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15604.758943 secs 2023-05-08T08:04:28.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:27 smithi133 ceph-mon[125939]: pgmap v8381: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 106 KiB/s wr, 8 op/s 2023-05-08T08:04:28.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:27 smithi096 ceph-mon[124666]: pgmap v8381: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 106 KiB/s wr, 8 op/s 2023-05-08T08:04:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:27 smithi186 ceph-mon[126480]: pgmap v8381: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 106 KiB/s wr, 8 op/s 2023-05-08T08:04:29.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15607.918694 secs 2023-05-08T08:04:29.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15608.475698 secs 2023-05-08T08:04:29.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15607.918694 secs 2023-05-08T08:04:29.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15608.475698 secs 2023-05-08T08:04:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15607.918694 secs 2023-05-08T08:04:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15608.475698 secs 2023-05-08T08:04:30.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:29 smithi133 ceph-mon[125939]: pgmap v8382: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 106 KiB/s wr, 8 op/s 2023-05-08T08:04:30.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:29 smithi096 ceph-mon[124666]: pgmap v8382: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 106 KiB/s wr, 8 op/s 2023-05-08T08:04:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:29 smithi186 ceph-mon[126480]: pgmap v8382: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 106 KiB/s wr, 8 op/s 2023-05-08T08:04:31.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15609.759013 secs 2023-05-08T08:04:31.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15609.759013 secs 2023-05-08T08:04:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15609.759013 secs 2023-05-08T08:04:32.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:31 smithi133 ceph-mon[125939]: pgmap v8383: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 180 KiB/s wr, 8 op/s 2023-05-08T08:04:32.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:31 smithi096 ceph-mon[124666]: pgmap v8383: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 180 KiB/s wr, 8 op/s 2023-05-08T08:04:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:31 smithi186 ceph-mon[126480]: pgmap v8383: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 180 KiB/s wr, 8 op/s 2023-05-08T08:04:34.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:33 smithi133 ceph-mon[125939]: pgmap v8384: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 165 KiB/s wr, 8 op/s 2023-05-08T08:04:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15612.918787 secs 2023-05-08T08:04:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15613.475789 secs 2023-05-08T08:04:34.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:33 smithi096 ceph-mon[124666]: pgmap v8384: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 165 KiB/s wr, 8 op/s 2023-05-08T08:04:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15612.918787 secs 2023-05-08T08:04:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15613.475789 secs 2023-05-08T08:04:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:33 smithi186 ceph-mon[126480]: pgmap v8384: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 165 KiB/s wr, 8 op/s 2023-05-08T08:04:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15612.918787 secs 2023-05-08T08:04:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15613.475789 secs 2023-05-08T08:04:36.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:35 smithi133 ceph-mon[125939]: pgmap v8385: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 200 KiB/s wr, 10 op/s 2023-05-08T08:04:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15614.759088 secs 2023-05-08T08:04:36.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:35 smithi096 ceph-mon[124666]: pgmap v8385: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 200 KiB/s wr, 10 op/s 2023-05-08T08:04:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15614.759088 secs 2023-05-08T08:04:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:35 smithi186 ceph-mon[126480]: pgmap v8385: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 200 KiB/s wr, 10 op/s 2023-05-08T08:04:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15614.759088 secs 2023-05-08T08:04:38.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:37 smithi133 ceph-mon[125939]: pgmap v8386: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 148 KiB/s wr, 7 op/s 2023-05-08T08:04:38.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:37 smithi096 ceph-mon[124666]: pgmap v8386: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 148 KiB/s wr, 7 op/s 2023-05-08T08:04:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:37 smithi186 ceph-mon[126480]: pgmap v8386: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 148 KiB/s wr, 7 op/s 2023-05-08T08:04:39.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15617.918903 secs 2023-05-08T08:04:39.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15618.475907 secs 2023-05-08T08:04:39.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15617.918903 secs 2023-05-08T08:04:39.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15618.475907 secs 2023-05-08T08:04:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15617.918903 secs 2023-05-08T08:04:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15618.475907 secs 2023-05-08T08:04:40.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:39 smithi133 ceph-mon[125939]: pgmap v8387: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 148 KiB/s wr, 7 op/s 2023-05-08T08:04:40.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:39 smithi096 ceph-mon[124666]: pgmap v8387: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 148 KiB/s wr, 7 op/s 2023-05-08T08:04:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:39 smithi186 ceph-mon[126480]: pgmap v8387: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 148 KiB/s wr, 7 op/s 2023-05-08T08:04:42.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:41 smithi133 ceph-mon[125939]: pgmap v8388: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 255 KiB/s wr, 10 op/s 2023-05-08T08:04:42.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:41 smithi096 ceph-mon[124666]: pgmap v8388: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 255 KiB/s wr, 10 op/s 2023-05-08T08:04:42.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:41 smithi186 ceph-mon[126480]: pgmap v8388: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 255 KiB/s wr, 10 op/s 2023-05-08T08:04:43.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:04:43.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:04:43.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:04:44.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:43 smithi133 ceph-mon[125939]: pgmap v8389: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 157 KiB/s wr, 6 op/s 2023-05-08T08:04:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:43 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:04:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:04:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:04:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15622.919030 secs 2023-05-08T08:04:44.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:43 smithi096 ceph-mon[124666]: pgmap v8389: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 157 KiB/s wr, 6 op/s 2023-05-08T08:04:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:43 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:04:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:04:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:04:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15622.919030 secs 2023-05-08T08:04:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:43 smithi186 ceph-mon[126480]: pgmap v8389: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 157 KiB/s wr, 6 op/s 2023-05-08T08:04:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:43 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:04:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:04:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:04:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15622.919030 secs 2023-05-08T08:04:46.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:45 smithi133 ceph-mon[125939]: pgmap v8390: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 178 KiB/s wr, 10 op/s 2023-05-08T08:04:46.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:45 smithi096 ceph-mon[124666]: pgmap v8390: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 178 KiB/s wr, 10 op/s 2023-05-08T08:04:46.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:45 smithi186 ceph-mon[126480]: pgmap v8390: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 178 KiB/s wr, 10 op/s 2023-05-08T08:04:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:47 smithi186 ceph-mon[126480]: pgmap v8391: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 129 KiB/s wr, 7 op/s 2023-05-08T08:04:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:04:48.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:47 smithi133 ceph-mon[125939]: pgmap v8391: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 129 KiB/s wr, 7 op/s 2023-05-08T08:04:48.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:04:48.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:47 smithi096 ceph-mon[124666]: pgmap v8391: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 129 KiB/s wr, 7 op/s 2023-05-08T08:04:48.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:04:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:04:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:04:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15627.919149 secs 2023-05-08T08:04:49.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:04:49.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:04:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15627.919149 secs 2023-05-08T08:04:49.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:04:49.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:04:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15627.919149 secs 2023-05-08T08:04:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:49 smithi186 ceph-mon[126480]: pgmap v8392: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 129 KiB/s wr, 7 op/s 2023-05-08T08:04:50.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:49 smithi133 ceph-mon[125939]: pgmap v8392: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 129 KiB/s wr, 7 op/s 2023-05-08T08:04:50.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:49 smithi096 ceph-mon[124666]: pgmap v8392: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 129 KiB/s wr, 7 op/s 2023-05-08T08:04:51.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15629.759448 secs 2023-05-08T08:04:51.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15629.759448 secs 2023-05-08T08:04:51.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15629.759448 secs 2023-05-08T08:04:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:51 smithi186 ceph-mon[126480]: pgmap v8393: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 406 KiB/s wr, 12 op/s 2023-05-08T08:04:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:51 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:04:52.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:51 smithi133 ceph-mon[125939]: pgmap v8393: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 406 KiB/s wr, 12 op/s 2023-05-08T08:04:52.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:51 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:04:52.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:51 smithi096 ceph-mon[124666]: pgmap v8393: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 406 KiB/s wr, 12 op/s 2023-05-08T08:04:52.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:51 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:04:53.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:04:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:04:53.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:04:53.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:04:53.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:04:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:04:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:53 smithi186 ceph-mon[126480]: pgmap v8394: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 311 KiB/s rd, 299 KiB/s wr, 9 op/s 2023-05-08T08:04:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15632.919233 secs 2023-05-08T08:04:54.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:53 smithi133 ceph-mon[125939]: pgmap v8394: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 311 KiB/s rd, 299 KiB/s wr, 9 op/s 2023-05-08T08:04:54.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15632.919233 secs 2023-05-08T08:04:54.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:53 smithi096 ceph-mon[124666]: pgmap v8394: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 311 KiB/s rd, 299 KiB/s wr, 9 op/s 2023-05-08T08:04:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15632.919233 secs 2023-05-08T08:04:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15633.476300 secs 2023-05-08T08:04:55.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15633.476300 secs 2023-05-08T08:04:55.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15633.476300 secs 2023-05-08T08:04:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:55 smithi186 ceph-mon[126480]: pgmap v8395: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 321 KiB/s wr, 13 op/s 2023-05-08T08:04:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15634.759574 secs 2023-05-08T08:04:56.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:55 smithi133 ceph-mon[125939]: pgmap v8395: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 321 KiB/s wr, 13 op/s 2023-05-08T08:04:56.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15634.759574 secs 2023-05-08T08:04:56.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:55 smithi096 ceph-mon[124666]: pgmap v8395: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 321 KiB/s wr, 13 op/s 2023-05-08T08:04:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15634.759574 secs 2023-05-08T08:04:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:04:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:04:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:56 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:04:57.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:04:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:04:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:56 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:04:57.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:04:57.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:04:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:56 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:04:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:57 smithi186 ceph-mon[126480]: pgmap v8396: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 311 KiB/s rd, 299 KiB/s wr, 9 op/s 2023-05-08T08:04:58.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:57 smithi133 ceph-mon[125939]: pgmap v8396: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 311 KiB/s rd, 299 KiB/s wr, 9 op/s 2023-05-08T08:04:58.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:57 smithi096 ceph-mon[124666]: pgmap v8396: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 311 KiB/s rd, 299 KiB/s wr, 9 op/s 2023-05-08T08:04:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15637.919368 secs 2023-05-08T08:04:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15638.476426 secs 2023-05-08T08:04:59.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15637.919368 secs 2023-05-08T08:04:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15638.476426 secs 2023-05-08T08:04:59.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15637.919368 secs 2023-05-08T08:04:59.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15638.476426 secs 2023-05-08T08:05:00.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:04:59 smithi133 ceph-mon[125939]: pgmap v8397: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 311 KiB/s rd, 299 KiB/s wr, 9 op/s 2023-05-08T08:05:00.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:04:59 smithi096 ceph-mon[124666]: pgmap v8397: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 311 KiB/s rd, 299 KiB/s wr, 9 op/s 2023-05-08T08:05:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:04:59 smithi186 ceph-mon[126480]: pgmap v8397: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 311 KiB/s rd, 299 KiB/s wr, 9 op/s 2023-05-08T08:05:01.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15639.759697 secs 2023-05-08T08:05:01.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15639.759697 secs 2023-05-08T08:05:01.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15639.759697 secs 2023-05-08T08:05:02.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:01 smithi133 ceph-mon[125939]: pgmap v8398: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 573 KiB/s rd, 567 KiB/s wr, 14 op/s 2023-05-08T08:05:02.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:01 smithi096 ceph-mon[124666]: pgmap v8398: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 573 KiB/s rd, 567 KiB/s wr, 14 op/s 2023-05-08T08:05:02.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:01 smithi186 ceph-mon[126480]: pgmap v8398: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 573 KiB/s rd, 567 KiB/s wr, 14 op/s 2023-05-08T08:05:04.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:03 smithi133 ceph-mon[125939]: pgmap v8399: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 284 KiB/s rd, 290 KiB/s wr, 8 op/s 2023-05-08T08:05:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15642.919493 secs 2023-05-08T08:05:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15643.476565 secs 2023-05-08T08:05:04.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:03 smithi096 ceph-mon[124666]: pgmap v8399: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 284 KiB/s rd, 290 KiB/s wr, 8 op/s 2023-05-08T08:05:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15642.919493 secs 2023-05-08T08:05:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15643.476565 secs 2023-05-08T08:05:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:03 smithi186 ceph-mon[126480]: pgmap v8399: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 284 KiB/s rd, 290 KiB/s wr, 8 op/s 2023-05-08T08:05:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15642.919493 secs 2023-05-08T08:05:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15643.476565 secs 2023-05-08T08:05:06.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:05 smithi133 ceph-mon[125939]: pgmap v8400: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 324 KiB/s rd, 357 KiB/s wr, 27 op/s 2023-05-08T08:05:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15644.759815 secs 2023-05-08T08:05:06.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:05 smithi096 ceph-mon[124666]: pgmap v8400: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 324 KiB/s rd, 357 KiB/s wr, 27 op/s 2023-05-08T08:05:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15644.759815 secs 2023-05-08T08:05:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:05 smithi186 ceph-mon[126480]: pgmap v8400: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 324 KiB/s rd, 357 KiB/s wr, 27 op/s 2023-05-08T08:05:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15644.759815 secs 2023-05-08T08:05:08.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:07 smithi133 ceph-mon[125939]: pgmap v8401: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 335 KiB/s wr, 23 op/s 2023-05-08T08:05:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:07 smithi096 ceph-mon[124666]: pgmap v8401: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 335 KiB/s wr, 23 op/s 2023-05-08T08:05:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:07 smithi186 ceph-mon[126480]: pgmap v8401: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 335 KiB/s wr, 23 op/s 2023-05-08T08:05:09.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15647.919604 secs 2023-05-08T08:05:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15648.476691 secs 2023-05-08T08:05:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:08 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:05:09.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15647.919604 secs 2023-05-08T08:05:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15648.476691 secs 2023-05-08T08:05:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:08 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:05:09.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15647.919604 secs 2023-05-08T08:05:09.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15648.476691 secs 2023-05-08T08:05:09.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:08 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:05:10.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:09 smithi133 ceph-mon[125939]: pgmap v8402: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 335 KiB/s wr, 23 op/s 2023-05-08T08:05:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:09 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:05:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:09 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:05:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:09 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:05:10.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:09 smithi096 ceph-mon[124666]: pgmap v8402: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 335 KiB/s wr, 23 op/s 2023-05-08T08:05:10.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:09 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:05:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:09 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:05:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:09 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:05:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:09 smithi186 ceph-mon[126480]: pgmap v8402: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 335 KiB/s wr, 23 op/s 2023-05-08T08:05:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:09 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:05:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:09 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:05:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:09 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:05:11.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:10 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:05:11.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:10 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T08:05:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:10 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T08:05:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:10 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:05:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15649.759911 secs 2023-05-08T08:05:11.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:10 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:05:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:10 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T08:05:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:10 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T08:05:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:10 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:05:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15649.759911 secs 2023-05-08T08:05:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:10 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:05:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:10 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T08:05:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:10 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T08:05:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:10 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:05:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15649.759911 secs 2023-05-08T08:05:12.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:11 smithi133 ceph-mon[125939]: pgmap v8403: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 427 KiB/s rd, 460 KiB/s wr, 27 op/s 2023-05-08T08:05:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:11 smithi133 ceph-mon[125939]: osdmap e602: 12 total, 12 up, 12 in 2023-05-08T08:05:12.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:11 smithi096 ceph-mon[124666]: pgmap v8403: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 427 KiB/s rd, 460 KiB/s wr, 27 op/s 2023-05-08T08:05:12.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:11 smithi096 ceph-mon[124666]: osdmap e602: 12 total, 12 up, 12 in 2023-05-08T08:05:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:11 smithi186 ceph-mon[126480]: pgmap v8403: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 427 KiB/s rd, 460 KiB/s wr, 27 op/s 2023-05-08T08:05:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:11 smithi186 ceph-mon[126480]: osdmap e602: 12 total, 12 up, 12 in 2023-05-08T08:05:14.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:13 smithi133 ceph-mon[125939]: pgmap v8405: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 230 KiB/s wr, 27 op/s 2023-05-08T08:05:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15652.919721 secs 2023-05-08T08:05:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15653.476814 secs 2023-05-08T08:05:14.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:13 smithi096 ceph-mon[124666]: pgmap v8405: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 230 KiB/s wr, 27 op/s 2023-05-08T08:05:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15652.919721 secs 2023-05-08T08:05:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15653.476814 secs 2023-05-08T08:05:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:13 smithi186 ceph-mon[126480]: pgmap v8405: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 230 KiB/s wr, 27 op/s 2023-05-08T08:05:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15652.919721 secs 2023-05-08T08:05:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15653.476814 secs 2023-05-08T08:05:16.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:15 smithi133 ceph-mon[125939]: pgmap v8406: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 160 KiB/s wr, 8 op/s 2023-05-08T08:05:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15654.760057 secs 2023-05-08T08:05:16.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:15 smithi096 ceph-mon[124666]: pgmap v8406: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 160 KiB/s wr, 8 op/s 2023-05-08T08:05:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15654.760057 secs 2023-05-08T08:05:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:15 smithi186 ceph-mon[126480]: pgmap v8406: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 160 KiB/s wr, 8 op/s 2023-05-08T08:05:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15654.760057 secs 2023-05-08T08:05:18.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:17 smithi133 ceph-mon[125939]: pgmap v8407: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 160 KiB/s wr, 8 op/s 2023-05-08T08:05:18.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:17 smithi096 ceph-mon[124666]: pgmap v8407: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 160 KiB/s wr, 8 op/s 2023-05-08T08:05:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:17 smithi186 ceph-mon[126480]: pgmap v8407: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 160 KiB/s wr, 8 op/s 2023-05-08T08:05:19.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15657.919837 secs 2023-05-08T08:05:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15658.476918 secs 2023-05-08T08:05:19.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15657.919837 secs 2023-05-08T08:05:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15658.476918 secs 2023-05-08T08:05:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15657.919837 secs 2023-05-08T08:05:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15658.476918 secs 2023-05-08T08:05:20.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:19 smithi133 ceph-mon[125939]: pgmap v8408: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 160 KiB/s wr, 8 op/s 2023-05-08T08:05:20.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:19 smithi096 ceph-mon[124666]: pgmap v8408: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 160 KiB/s wr, 8 op/s 2023-05-08T08:05:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:19 smithi186 ceph-mon[126480]: pgmap v8408: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 160 KiB/s wr, 8 op/s 2023-05-08T08:05:21.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15659.760182 secs 2023-05-08T08:05:21.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15659.760182 secs 2023-05-08T08:05:21.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15659.760182 secs 2023-05-08T08:05:22.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:21 smithi133 ceph-mon[125939]: pgmap v8409: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 53 KiB/s wr, 8 op/s 2023-05-08T08:05:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:21 smithi133 ceph-mon[125939]: osdmap e603: 12 total, 12 up, 12 in 2023-05-08T08:05:22.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:21 smithi096 ceph-mon[124666]: pgmap v8409: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 53 KiB/s wr, 8 op/s 2023-05-08T08:05:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:21 smithi096 ceph-mon[124666]: osdmap e603: 12 total, 12 up, 12 in 2023-05-08T08:05:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:21 smithi186 ceph-mon[126480]: pgmap v8409: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 53 KiB/s wr, 8 op/s 2023-05-08T08:05:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:21 smithi186 ceph-mon[126480]: osdmap e603: 12 total, 12 up, 12 in 2023-05-08T08:05:24.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:23 smithi133 ceph-mon[125939]: pgmap v8411: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 53 KiB/s wr, 8 op/s 2023-05-08T08:05:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15662.919956 secs 2023-05-08T08:05:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15663.477066 secs 2023-05-08T08:05:24.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:23 smithi096 ceph-mon[124666]: pgmap v8411: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 53 KiB/s wr, 8 op/s 2023-05-08T08:05:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15662.919956 secs 2023-05-08T08:05:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15663.477066 secs 2023-05-08T08:05:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:23 smithi186 ceph-mon[126480]: pgmap v8411: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 53 KiB/s wr, 8 op/s 2023-05-08T08:05:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15662.919956 secs 2023-05-08T08:05:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15663.477066 secs 2023-05-08T08:05:26.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:25 smithi133 ceph-mon[125939]: pgmap v8412: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 106 KiB/s wr, 9 op/s 2023-05-08T08:05:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15664.760308 secs 2023-05-08T08:05:26.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:25 smithi096 ceph-mon[124666]: pgmap v8412: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 106 KiB/s wr, 9 op/s 2023-05-08T08:05:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15664.760308 secs 2023-05-08T08:05:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:25 smithi186 ceph-mon[126480]: pgmap v8412: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 106 KiB/s wr, 9 op/s 2023-05-08T08:05:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15664.760308 secs 2023-05-08T08:05:28.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:27 smithi133 ceph-mon[125939]: pgmap v8413: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 106 KiB/s wr, 9 op/s 2023-05-08T08:05:28.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:27 smithi096 ceph-mon[124666]: pgmap v8413: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 106 KiB/s wr, 9 op/s 2023-05-08T08:05:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:27 smithi186 ceph-mon[126480]: pgmap v8413: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 106 KiB/s wr, 9 op/s 2023-05-08T08:05:29.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15667.920080 secs 2023-05-08T08:05:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15668.477208 secs 2023-05-08T08:05:29.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15667.920080 secs 2023-05-08T08:05:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15668.477208 secs 2023-05-08T08:05:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15667.920080 secs 2023-05-08T08:05:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15668.477208 secs 2023-05-08T08:05:30.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:29 smithi133 ceph-mon[125939]: pgmap v8414: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 106 KiB/s wr, 9 op/s 2023-05-08T08:05:30.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:29 smithi096 ceph-mon[124666]: pgmap v8414: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 106 KiB/s wr, 9 op/s 2023-05-08T08:05:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:29 smithi186 ceph-mon[126480]: pgmap v8414: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 106 KiB/s wr, 9 op/s 2023-05-08T08:05:31.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15669.760402 secs 2023-05-08T08:05:31.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15669.760402 secs 2023-05-08T08:05:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15669.760402 secs 2023-05-08T08:05:32.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:31 smithi133 ceph-mon[125939]: pgmap v8415: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 182 KiB/s wr, 8 op/s 2023-05-08T08:05:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:31 smithi096 ceph-mon[124666]: pgmap v8415: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 182 KiB/s wr, 8 op/s 2023-05-08T08:05:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:31 smithi186 ceph-mon[126480]: pgmap v8415: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 182 KiB/s wr, 8 op/s 2023-05-08T08:05:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:33 smithi133 ceph-mon[125939]: pgmap v8416: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 166 KiB/s wr, 8 op/s 2023-05-08T08:05:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15672.920205 secs 2023-05-08T08:05:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15673.477311 secs 2023-05-08T08:05:34.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:33 smithi096 ceph-mon[124666]: pgmap v8416: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 166 KiB/s wr, 8 op/s 2023-05-08T08:05:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15672.920205 secs 2023-05-08T08:05:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15673.477311 secs 2023-05-08T08:05:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:33 smithi186 ceph-mon[126480]: pgmap v8416: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 166 KiB/s wr, 8 op/s 2023-05-08T08:05:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15672.920205 secs 2023-05-08T08:05:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15673.477311 secs 2023-05-08T08:05:36.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:35 smithi133 ceph-mon[125939]: pgmap v8417: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 201 KiB/s wr, 10 op/s 2023-05-08T08:05:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15674.760523 secs 2023-05-08T08:05:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:35 smithi096 ceph-mon[124666]: pgmap v8417: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 201 KiB/s wr, 10 op/s 2023-05-08T08:05:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15674.760523 secs 2023-05-08T08:05:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:35 smithi186 ceph-mon[126480]: pgmap v8417: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 201 KiB/s wr, 10 op/s 2023-05-08T08:05:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15674.760523 secs 2023-05-08T08:05:38.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:37 smithi133 ceph-mon[125939]: pgmap v8418: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 149 KiB/s wr, 7 op/s 2023-05-08T08:05:38.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:37 smithi096 ceph-mon[124666]: pgmap v8418: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 149 KiB/s wr, 7 op/s 2023-05-08T08:05:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:37 smithi186 ceph-mon[126480]: pgmap v8418: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 149 KiB/s wr, 7 op/s 2023-05-08T08:05:39.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15677.920301 secs 2023-05-08T08:05:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15678.477373 secs 2023-05-08T08:05:39.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15677.920301 secs 2023-05-08T08:05:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15678.477373 secs 2023-05-08T08:05:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15677.920301 secs 2023-05-08T08:05:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15678.477373 secs 2023-05-08T08:05:40.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:39 smithi133 ceph-mon[125939]: pgmap v8419: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 149 KiB/s wr, 7 op/s 2023-05-08T08:05:40.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:39 smithi096 ceph-mon[124666]: pgmap v8419: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 149 KiB/s wr, 7 op/s 2023-05-08T08:05:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:39 smithi186 ceph-mon[126480]: pgmap v8419: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 149 KiB/s wr, 7 op/s 2023-05-08T08:05:42.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:41 smithi133 ceph-mon[125939]: pgmap v8420: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 257 KiB/s wr, 10 op/s 2023-05-08T08:05:42.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:41 smithi096 ceph-mon[124666]: pgmap v8420: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 257 KiB/s wr, 10 op/s 2023-05-08T08:05:42.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:41 smithi186 ceph-mon[126480]: pgmap v8420: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 257 KiB/s wr, 10 op/s 2023-05-08T08:05:43.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:05:43.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:05:43.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:05:44.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:43 smithi133 ceph-mon[125939]: pgmap v8421: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 157 KiB/s wr, 6 op/s 2023-05-08T08:05:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:43 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:05:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:05:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:05:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15682.920385 secs 2023-05-08T08:05:44.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:43 smithi096 ceph-mon[124666]: pgmap v8421: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 157 KiB/s wr, 6 op/s 2023-05-08T08:05:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:43 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:05:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:05:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:05:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15682.920385 secs 2023-05-08T08:05:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:43 smithi186 ceph-mon[126480]: pgmap v8421: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 157 KiB/s wr, 6 op/s 2023-05-08T08:05:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:43 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:05:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:05:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:05:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15682.920385 secs 2023-05-08T08:05:46.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:45 smithi133 ceph-mon[125939]: pgmap v8422: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 179 KiB/s wr, 10 op/s 2023-05-08T08:05:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:45 smithi096 ceph-mon[124666]: pgmap v8422: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 179 KiB/s wr, 10 op/s 2023-05-08T08:05:46.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:45 smithi186 ceph-mon[126480]: pgmap v8422: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 179 KiB/s wr, 10 op/s 2023-05-08T08:05:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:47 smithi186 ceph-mon[126480]: pgmap v8423: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 130 KiB/s wr, 7 op/s 2023-05-08T08:05:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:05:48.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:47 smithi133 ceph-mon[125939]: pgmap v8423: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 130 KiB/s wr, 7 op/s 2023-05-08T08:05:48.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:05:48.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:47 smithi096 ceph-mon[124666]: pgmap v8423: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 130 KiB/s wr, 7 op/s 2023-05-08T08:05:48.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:05:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:05:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:05:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15687.920507 secs 2023-05-08T08:05:49.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:05:49.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:05:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15687.920507 secs 2023-05-08T08:05:49.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:05:49.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:05:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15687.920507 secs 2023-05-08T08:05:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:49 smithi186 ceph-mon[126480]: pgmap v8424: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 130 KiB/s wr, 7 op/s 2023-05-08T08:05:50.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:49 smithi133 ceph-mon[125939]: pgmap v8424: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 130 KiB/s wr, 7 op/s 2023-05-08T08:05:50.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:49 smithi096 ceph-mon[124666]: pgmap v8424: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 130 KiB/s wr, 7 op/s 2023-05-08T08:05:51.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15689.760917 secs 2023-05-08T08:05:51.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15689.760917 secs 2023-05-08T08:05:51.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15689.760917 secs 2023-05-08T08:05:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:51 smithi186 ceph-mon[126480]: pgmap v8425: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 470 KiB/s rd, 407 KiB/s wr, 13 op/s 2023-05-08T08:05:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:51 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:05:52.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:51 smithi133 ceph-mon[125939]: pgmap v8425: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 470 KiB/s rd, 407 KiB/s wr, 13 op/s 2023-05-08T08:05:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:51 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:05:52.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:51 smithi096 ceph-mon[124666]: pgmap v8425: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 470 KiB/s rd, 407 KiB/s wr, 13 op/s 2023-05-08T08:05:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:51 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:05:53.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:05:53.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:05:53.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:05:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:05:53.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:05:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:05:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:53 smithi186 ceph-mon[126480]: pgmap v8426: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 420 KiB/s rd, 299 KiB/s wr, 9 op/s 2023-05-08T08:05:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15692.920611 secs 2023-05-08T08:05:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15693.477689 secs 2023-05-08T08:05:54.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:53 smithi133 ceph-mon[125939]: pgmap v8426: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 420 KiB/s rd, 299 KiB/s wr, 9 op/s 2023-05-08T08:05:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15692.920611 secs 2023-05-08T08:05:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15693.477689 secs 2023-05-08T08:05:54.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:53 smithi096 ceph-mon[124666]: pgmap v8426: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 420 KiB/s rd, 299 KiB/s wr, 9 op/s 2023-05-08T08:05:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15692.920611 secs 2023-05-08T08:05:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15693.477689 secs 2023-05-08T08:05:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:55 smithi186 ceph-mon[126480]: pgmap v8427: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 322 KiB/s wr, 14 op/s 2023-05-08T08:05:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15694.761038 secs 2023-05-08T08:05:56.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:55 smithi133 ceph-mon[125939]: pgmap v8427: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 322 KiB/s wr, 14 op/s 2023-05-08T08:05:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15694.761038 secs 2023-05-08T08:05:56.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:55 smithi096 ceph-mon[124666]: pgmap v8427: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 322 KiB/s wr, 14 op/s 2023-05-08T08:05:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15694.761038 secs 2023-05-08T08:05:57.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:05:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:05:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:56 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:05:57.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:05:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:05:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:56 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:05:57.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:05:57.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:05:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:56 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:05:58.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:57 smithi133 ceph-mon[125939]: pgmap v8428: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 300 KiB/s wr, 10 op/s 2023-05-08T08:05:58.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:57 smithi096 ceph-mon[124666]: pgmap v8428: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 300 KiB/s wr, 10 op/s 2023-05-08T08:05:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:57 smithi186 ceph-mon[126480]: pgmap v8428: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 300 KiB/s wr, 10 op/s 2023-05-08T08:05:59.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15697.920753 secs 2023-05-08T08:05:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15698.477800 secs 2023-05-08T08:05:59.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15697.920753 secs 2023-05-08T08:05:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15698.477800 secs 2023-05-08T08:05:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15697.920753 secs 2023-05-08T08:05:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15698.477800 secs 2023-05-08T08:06:00.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:05:59 smithi133 ceph-mon[125939]: pgmap v8429: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 300 KiB/s wr, 10 op/s 2023-05-08T08:06:00.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:05:59 smithi096 ceph-mon[124666]: pgmap v8429: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 300 KiB/s wr, 10 op/s 2023-05-08T08:06:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:05:59 smithi186 ceph-mon[126480]: pgmap v8429: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 300 KiB/s wr, 10 op/s 2023-05-08T08:06:01.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15699.761150 secs 2023-05-08T08:06:01.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15699.761150 secs 2023-05-08T08:06:01.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15699.761150 secs 2023-05-08T08:06:02.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:01 smithi133 ceph-mon[125939]: pgmap v8430: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 570 KiB/s wr, 14 op/s 2023-05-08T08:06:02.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:01 smithi096 ceph-mon[124666]: pgmap v8430: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 570 KiB/s wr, 14 op/s 2023-05-08T08:06:02.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:01 smithi186 ceph-mon[126480]: pgmap v8430: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 570 KiB/s wr, 14 op/s 2023-05-08T08:06:04.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:03 smithi133 ceph-mon[125939]: pgmap v8431: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 292 KiB/s wr, 8 op/s 2023-05-08T08:06:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15702.920869 secs 2023-05-08T08:06:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15703.477927 secs 2023-05-08T08:06:04.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:03 smithi096 ceph-mon[124666]: pgmap v8431: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 292 KiB/s wr, 8 op/s 2023-05-08T08:06:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15702.920869 secs 2023-05-08T08:06:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15703.477927 secs 2023-05-08T08:06:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:03 smithi186 ceph-mon[126480]: pgmap v8431: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 292 KiB/s wr, 8 op/s 2023-05-08T08:06:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15702.920869 secs 2023-05-08T08:06:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15703.477927 secs 2023-05-08T08:06:06.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:05 smithi133 ceph-mon[125939]: pgmap v8432: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 410 KiB/s rd, 443 KiB/s wr, 27 op/s 2023-05-08T08:06:06.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15704.761271 secs 2023-05-08T08:06:06.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:05 smithi096 ceph-mon[124666]: pgmap v8432: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 410 KiB/s rd, 443 KiB/s wr, 27 op/s 2023-05-08T08:06:06.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15704.761271 secs 2023-05-08T08:06:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:05 smithi186 ceph-mon[126480]: pgmap v8432: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 410 KiB/s rd, 443 KiB/s wr, 27 op/s 2023-05-08T08:06:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15704.761271 secs 2023-05-08T08:06:08.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:07 smithi133 ceph-mon[125939]: pgmap v8433: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 421 KiB/s wr, 23 op/s 2023-05-08T08:06:08.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:07 smithi096 ceph-mon[124666]: pgmap v8433: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 421 KiB/s wr, 23 op/s 2023-05-08T08:06:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:07 smithi186 ceph-mon[126480]: pgmap v8433: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 421 KiB/s wr, 23 op/s 2023-05-08T08:06:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15707.921001 secs 2023-05-08T08:06:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15708.478064 secs 2023-05-08T08:06:09.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15707.921001 secs 2023-05-08T08:06:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15708.478064 secs 2023-05-08T08:06:09.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15707.921001 secs 2023-05-08T08:06:09.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15708.478064 secs 2023-05-08T08:06:10.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:09 smithi133 ceph-mon[125939]: pgmap v8434: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 421 KiB/s wr, 23 op/s 2023-05-08T08:06:10.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:09 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:06:10.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:09 smithi096 ceph-mon[124666]: pgmap v8434: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 421 KiB/s wr, 23 op/s 2023-05-08T08:06:10.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:09 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:06:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:09 smithi186 ceph-mon[126480]: pgmap v8434: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 421 KiB/s wr, 23 op/s 2023-05-08T08:06:10.423 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:09 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:06:11.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15709.761358 secs 2023-05-08T08:06:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:10 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:06:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:10 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:06:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:10 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:06:11.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15709.761358 secs 2023-05-08T08:06:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:10 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:06:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:10 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:06:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:10 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:06:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15709.761358 secs 2023-05-08T08:06:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:10 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:06:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:10 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:06:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:10 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:06:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:11 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:06:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:11 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T08:06:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:11 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T08:06:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:11 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:06:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:11 smithi133 ceph-mon[125939]: pgmap v8435: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 547 KiB/s wr, 27 op/s 2023-05-08T08:06:12.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:11 smithi133 ceph-mon[125939]: osdmap e604: 12 total, 12 up, 12 in 2023-05-08T08:06:12.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:11 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:06:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:11 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T08:06:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:11 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T08:06:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:11 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:06:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:11 smithi096 ceph-mon[124666]: pgmap v8435: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 547 KiB/s wr, 27 op/s 2023-05-08T08:06:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:11 smithi096 ceph-mon[124666]: osdmap e604: 12 total, 12 up, 12 in 2023-05-08T08:06:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:11 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:06:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:11 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T08:06:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:11 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T08:06:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:11 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:06:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:11 smithi186 ceph-mon[126480]: pgmap v8435: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 547 KiB/s wr, 27 op/s 2023-05-08T08:06:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:11 smithi186 ceph-mon[126480]: osdmap e604: 12 total, 12 up, 12 in 2023-05-08T08:06:14.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:13 smithi133 ceph-mon[125939]: pgmap v8437: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 333 KiB/s wr, 27 op/s 2023-05-08T08:06:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15712.921136 secs 2023-05-08T08:06:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15713.478181 secs 2023-05-08T08:06:14.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:13 smithi096 ceph-mon[124666]: pgmap v8437: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 333 KiB/s wr, 27 op/s 2023-05-08T08:06:14.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15712.921136 secs 2023-05-08T08:06:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15713.478181 secs 2023-05-08T08:06:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:13 smithi186 ceph-mon[126480]: pgmap v8437: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 333 KiB/s wr, 27 op/s 2023-05-08T08:06:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15712.921136 secs 2023-05-08T08:06:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15713.478181 secs 2023-05-08T08:06:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:15 smithi133 ceph-mon[125939]: pgmap v8438: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 161 KiB/s wr, 9 op/s 2023-05-08T08:06:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15714.761472 secs 2023-05-08T08:06:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:15 smithi096 ceph-mon[124666]: pgmap v8438: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 161 KiB/s wr, 9 op/s 2023-05-08T08:06:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15714.761472 secs 2023-05-08T08:06:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:15 smithi186 ceph-mon[126480]: pgmap v8438: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 161 KiB/s wr, 9 op/s 2023-05-08T08:06:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15714.761472 secs 2023-05-08T08:06:18.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:17 smithi133 ceph-mon[125939]: pgmap v8439: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 161 KiB/s wr, 9 op/s 2023-05-08T08:06:18.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:17 smithi096 ceph-mon[124666]: pgmap v8439: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 161 KiB/s wr, 9 op/s 2023-05-08T08:06:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:17 smithi186 ceph-mon[126480]: pgmap v8439: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 161 KiB/s wr, 9 op/s 2023-05-08T08:06:19.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15717.921278 secs 2023-05-08T08:06:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15718.478294 secs 2023-05-08T08:06:19.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15717.921278 secs 2023-05-08T08:06:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15718.478294 secs 2023-05-08T08:06:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15717.921278 secs 2023-05-08T08:06:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15718.478294 secs 2023-05-08T08:06:20.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:19 smithi133 ceph-mon[125939]: pgmap v8440: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 161 KiB/s wr, 9 op/s 2023-05-08T08:06:20.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:19 smithi096 ceph-mon[124666]: pgmap v8440: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 161 KiB/s wr, 9 op/s 2023-05-08T08:06:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:19 smithi186 ceph-mon[126480]: pgmap v8440: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 161 KiB/s wr, 9 op/s 2023-05-08T08:06:21.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15719.761614 secs 2023-05-08T08:06:21.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15719.761614 secs 2023-05-08T08:06:21.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15719.761614 secs 2023-05-08T08:06:22.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:21 smithi133 ceph-mon[125939]: pgmap v8441: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 137 KiB/s wr, 9 op/s 2023-05-08T08:06:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:21 smithi133 ceph-mon[125939]: osdmap e605: 12 total, 12 up, 12 in 2023-05-08T08:06:22.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:21 smithi096 ceph-mon[124666]: pgmap v8441: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 137 KiB/s wr, 9 op/s 2023-05-08T08:06:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:21 smithi096 ceph-mon[124666]: osdmap e605: 12 total, 12 up, 12 in 2023-05-08T08:06:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:21 smithi186 ceph-mon[126480]: pgmap v8441: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 137 KiB/s wr, 9 op/s 2023-05-08T08:06:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:21 smithi186 ceph-mon[126480]: osdmap e605: 12 total, 12 up, 12 in 2023-05-08T08:06:24.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:23 smithi133 ceph-mon[125939]: pgmap v8443: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 137 KiB/s wr, 9 op/s 2023-05-08T08:06:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15722.921420 secs 2023-05-08T08:06:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15723.478411 secs 2023-05-08T08:06:24.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:23 smithi096 ceph-mon[124666]: pgmap v8443: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 137 KiB/s wr, 9 op/s 2023-05-08T08:06:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15722.921420 secs 2023-05-08T08:06:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15723.478411 secs 2023-05-08T08:06:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:23 smithi186 ceph-mon[126480]: pgmap v8443: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 137 KiB/s wr, 9 op/s 2023-05-08T08:06:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15722.921420 secs 2023-05-08T08:06:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15723.478411 secs 2023-05-08T08:06:26.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:25 smithi133 ceph-mon[125939]: pgmap v8444: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 191 KiB/s wr, 9 op/s 2023-05-08T08:06:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15724.761752 secs 2023-05-08T08:06:26.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:25 smithi096 ceph-mon[124666]: pgmap v8444: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 191 KiB/s wr, 9 op/s 2023-05-08T08:06:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15724.761752 secs 2023-05-08T08:06:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:25 smithi186 ceph-mon[126480]: pgmap v8444: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 191 KiB/s wr, 9 op/s 2023-05-08T08:06:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15724.761752 secs 2023-05-08T08:06:28.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:27 smithi133 ceph-mon[125939]: pgmap v8445: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 191 KiB/s wr, 8 op/s 2023-05-08T08:06:28.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:27 smithi096 ceph-mon[124666]: pgmap v8445: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 191 KiB/s wr, 8 op/s 2023-05-08T08:06:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:27 smithi186 ceph-mon[126480]: pgmap v8445: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 191 KiB/s wr, 8 op/s 2023-05-08T08:06:29.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15727.921551 secs 2023-05-08T08:06:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15728.478522 secs 2023-05-08T08:06:29.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15727.921551 secs 2023-05-08T08:06:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15728.478522 secs 2023-05-08T08:06:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15727.921551 secs 2023-05-08T08:06:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15728.478522 secs 2023-05-08T08:06:30.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:29 smithi133 ceph-mon[125939]: pgmap v8446: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 191 KiB/s wr, 8 op/s 2023-05-08T08:06:30.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:29 smithi096 ceph-mon[124666]: pgmap v8446: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 191 KiB/s wr, 8 op/s 2023-05-08T08:06:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:29 smithi186 ceph-mon[126480]: pgmap v8446: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 191 KiB/s wr, 8 op/s 2023-05-08T08:06:31.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15729.761874 secs 2023-05-08T08:06:31.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15729.761874 secs 2023-05-08T08:06:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15729.761874 secs 2023-05-08T08:06:32.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:31 smithi133 ceph-mon[125939]: pgmap v8447: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 99 KiB/s wr, 8 op/s 2023-05-08T08:06:32.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:31 smithi096 ceph-mon[124666]: pgmap v8447: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 99 KiB/s wr, 8 op/s 2023-05-08T08:06:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:31 smithi186 ceph-mon[126480]: pgmap v8447: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 99 KiB/s wr, 8 op/s 2023-05-08T08:06:34.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:33 smithi133 ceph-mon[125939]: pgmap v8448: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 91 KiB/s wr, 7 op/s 2023-05-08T08:06:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15732.921692 secs 2023-05-08T08:06:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15733.478617 secs 2023-05-08T08:06:34.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:33 smithi096 ceph-mon[124666]: pgmap v8448: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 91 KiB/s wr, 7 op/s 2023-05-08T08:06:34.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15732.921692 secs 2023-05-08T08:06:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15733.478617 secs 2023-05-08T08:06:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:33 smithi186 ceph-mon[126480]: pgmap v8448: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 91 KiB/s wr, 7 op/s 2023-05-08T08:06:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15732.921692 secs 2023-05-08T08:06:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15733.478617 secs 2023-05-08T08:06:36.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:35 smithi133 ceph-mon[125939]: pgmap v8449: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 132 KiB/s wr, 10 op/s 2023-05-08T08:06:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15734.761987 secs 2023-05-08T08:06:36.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:35 smithi096 ceph-mon[124666]: pgmap v8449: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 132 KiB/s wr, 10 op/s 2023-05-08T08:06:36.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15734.761987 secs 2023-05-08T08:06:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:35 smithi186 ceph-mon[126480]: pgmap v8449: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 132 KiB/s wr, 10 op/s 2023-05-08T08:06:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15734.761987 secs 2023-05-08T08:06:38.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:37 smithi133 ceph-mon[125939]: pgmap v8450: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 80 KiB/s wr, 6 op/s 2023-05-08T08:06:38.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:37 smithi096 ceph-mon[124666]: pgmap v8450: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 80 KiB/s wr, 6 op/s 2023-05-08T08:06:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:37 smithi186 ceph-mon[126480]: pgmap v8450: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 80 KiB/s wr, 6 op/s 2023-05-08T08:06:39.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15737.921851 secs 2023-05-08T08:06:39.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15738.478693 secs 2023-05-08T08:06:39.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15737.921851 secs 2023-05-08T08:06:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15738.478693 secs 2023-05-08T08:06:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15737.921851 secs 2023-05-08T08:06:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15738.478693 secs 2023-05-08T08:06:40.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:39 smithi133 ceph-mon[125939]: pgmap v8451: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 80 KiB/s wr, 6 op/s 2023-05-08T08:06:40.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:39 smithi096 ceph-mon[124666]: pgmap v8451: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 80 KiB/s wr, 6 op/s 2023-05-08T08:06:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:39 smithi186 ceph-mon[126480]: pgmap v8451: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 80 KiB/s wr, 6 op/s 2023-05-08T08:06:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:41 smithi133 ceph-mon[125939]: pgmap v8452: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 188 KiB/s wr, 10 op/s 2023-05-08T08:06:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:41 smithi096 ceph-mon[124666]: pgmap v8452: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 188 KiB/s wr, 10 op/s 2023-05-08T08:06:42.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:41 smithi186 ceph-mon[126480]: pgmap v8452: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 188 KiB/s wr, 10 op/s 2023-05-08T08:06:43.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:06:43.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:06:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:06:44.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:43 smithi133 ceph-mon[125939]: pgmap v8453: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 158 KiB/s wr, 6 op/s 2023-05-08T08:06:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:43 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:06:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:06:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:06:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15742.921985 secs 2023-05-08T08:06:44.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:43 smithi096 ceph-mon[124666]: pgmap v8453: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 158 KiB/s wr, 6 op/s 2023-05-08T08:06:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:43 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:06:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:06:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:06:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15742.921985 secs 2023-05-08T08:06:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:43 smithi186 ceph-mon[126480]: pgmap v8453: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 158 KiB/s wr, 6 op/s 2023-05-08T08:06:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:43 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:06:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:06:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:06:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15742.921985 secs 2023-05-08T08:06:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:45 smithi096 ceph-mon[124666]: pgmap v8454: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 250 KiB/s wr, 10 op/s 2023-05-08T08:06:46.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:45 smithi186 ceph-mon[126480]: pgmap v8454: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 250 KiB/s wr, 10 op/s 2023-05-08T08:06:46.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:45 smithi133 ceph-mon[125939]: pgmap v8454: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 250 KiB/s wr, 10 op/s 2023-05-08T08:06:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:47 smithi186 ceph-mon[126480]: pgmap v8455: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 200 KiB/s wr, 7 op/s 2023-05-08T08:06:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:06:48.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:47 smithi133 ceph-mon[125939]: pgmap v8455: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 200 KiB/s wr, 7 op/s 2023-05-08T08:06:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:06:48.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:47 smithi096 ceph-mon[124666]: pgmap v8455: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 200 KiB/s wr, 7 op/s 2023-05-08T08:06:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:06:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:06:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:06:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15747.922107 secs 2023-05-08T08:06:49.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:06:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:06:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15747.922107 secs 2023-05-08T08:06:49.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:06:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:06:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15747.922107 secs 2023-05-08T08:06:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:49 smithi186 ceph-mon[126480]: pgmap v8456: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 200 KiB/s wr, 7 op/s 2023-05-08T08:06:50.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:49 smithi133 ceph-mon[125939]: pgmap v8456: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 200 KiB/s wr, 7 op/s 2023-05-08T08:06:50.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:49 smithi096 ceph-mon[124666]: pgmap v8456: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 200 KiB/s wr, 7 op/s 2023-05-08T08:06:51.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15749.762378 secs 2023-05-08T08:06:51.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15749.762378 secs 2023-05-08T08:06:51.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15749.762378 secs 2023-05-08T08:06:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:51 smithi186 ceph-mon[126480]: pgmap v8457: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 408 KiB/s rd, 411 KiB/s wr, 13 op/s 2023-05-08T08:06:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:51 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:06:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:06:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:06:52.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:51 smithi133 ceph-mon[125939]: pgmap v8457: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 408 KiB/s rd, 411 KiB/s wr, 13 op/s 2023-05-08T08:06:52.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:51 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:06:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:06:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:06:52.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:51 smithi096 ceph-mon[124666]: pgmap v8457: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 408 KiB/s rd, 411 KiB/s wr, 13 op/s 2023-05-08T08:06:52.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:51 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:06:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:06:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:06:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:53 smithi186 ceph-mon[126480]: pgmap v8458: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 407 KiB/s rd, 302 KiB/s wr, 9 op/s 2023-05-08T08:06:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15752.922241 secs 2023-05-08T08:06:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:53 smithi133 ceph-mon[125939]: pgmap v8458: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 407 KiB/s rd, 302 KiB/s wr, 9 op/s 2023-05-08T08:06:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15752.922241 secs 2023-05-08T08:06:54.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:53 smithi096 ceph-mon[124666]: pgmap v8458: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 407 KiB/s rd, 302 KiB/s wr, 9 op/s 2023-05-08T08:06:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15752.922241 secs 2023-05-08T08:06:56.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:55 smithi133 ceph-mon[125939]: pgmap v8459: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 586 KiB/s rd, 465 KiB/s wr, 15 op/s 2023-05-08T08:06:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15754.762499 secs 2023-05-08T08:06:56.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:55 smithi096 ceph-mon[124666]: pgmap v8459: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 586 KiB/s rd, 465 KiB/s wr, 15 op/s 2023-05-08T08:06:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15754.762499 secs 2023-05-08T08:06:56.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:55 smithi186 ceph-mon[126480]: pgmap v8459: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 586 KiB/s rd, 465 KiB/s wr, 15 op/s 2023-05-08T08:06:56.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15754.762499 secs 2023-05-08T08:06:58.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:57 smithi133 ceph-mon[125939]: pgmap v8460: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 386 KiB/s rd, 374 KiB/s wr, 11 op/s 2023-05-08T08:06:58.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:57 smithi096 ceph-mon[124666]: pgmap v8460: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 386 KiB/s rd, 374 KiB/s wr, 11 op/s 2023-05-08T08:06:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:57 smithi186 ceph-mon[126480]: pgmap v8460: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 386 KiB/s rd, 374 KiB/s wr, 11 op/s 2023-05-08T08:06:59.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15757.922382 secs 2023-05-08T08:06:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15758.479181 secs 2023-05-08T08:06:59.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15757.922382 secs 2023-05-08T08:06:59.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15758.479181 secs 2023-05-08T08:06:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15757.922382 secs 2023-05-08T08:06:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15758.479181 secs 2023-05-08T08:07:00.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:06:59 smithi133 ceph-mon[125939]: pgmap v8461: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 386 KiB/s rd, 374 KiB/s wr, 10 op/s 2023-05-08T08:07:00.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:06:59 smithi096 ceph-mon[124666]: pgmap v8461: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 386 KiB/s rd, 374 KiB/s wr, 10 op/s 2023-05-08T08:07:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:06:59 smithi186 ceph-mon[126480]: pgmap v8461: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 386 KiB/s rd, 374 KiB/s wr, 10 op/s 2023-05-08T08:07:01.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:00 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:07:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:07:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:07:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15759.762623 secs 2023-05-08T08:07:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:00 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:07:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:07:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:07:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15759.762623 secs 2023-05-08T08:07:01.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:00 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:07:01.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:07:01.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:07:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15759.762623 secs 2023-05-08T08:07:02.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:01 smithi133 ceph-mon[125939]: pgmap v8462: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 526 KiB/s rd, 514 KiB/s wr, 16 op/s 2023-05-08T08:07:02.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:01 smithi096 ceph-mon[124666]: pgmap v8462: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 526 KiB/s rd, 514 KiB/s wr, 16 op/s 2023-05-08T08:07:02.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:01 smithi186 ceph-mon[126480]: pgmap v8462: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 526 KiB/s rd, 514 KiB/s wr, 16 op/s 2023-05-08T08:07:04.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:03 smithi133 ceph-mon[125939]: pgmap v8463: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 303 KiB/s wr, 10 op/s 2023-05-08T08:07:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15762.922494 secs 2023-05-08T08:07:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15763.479310 secs 2023-05-08T08:07:04.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:03 smithi096 ceph-mon[124666]: pgmap v8463: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 303 KiB/s wr, 10 op/s 2023-05-08T08:07:04.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15762.922494 secs 2023-05-08T08:07:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15763.479310 secs 2023-05-08T08:07:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:03 smithi186 ceph-mon[126480]: pgmap v8463: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 303 KiB/s wr, 10 op/s 2023-05-08T08:07:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15762.922494 secs 2023-05-08T08:07:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15763.479310 secs 2023-05-08T08:07:06.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:05 smithi133 ceph-mon[125939]: pgmap v8464: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 349 KiB/s wr, 29 op/s 2023-05-08T08:07:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15764.762748 secs 2023-05-08T08:07:06.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:05 smithi096 ceph-mon[124666]: pgmap v8464: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 349 KiB/s wr, 29 op/s 2023-05-08T08:07:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15764.762748 secs 2023-05-08T08:07:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:05 smithi186 ceph-mon[126480]: pgmap v8464: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 349 KiB/s wr, 29 op/s 2023-05-08T08:07:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15764.762748 secs 2023-05-08T08:07:08.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:07 smithi133 ceph-mon[125939]: pgmap v8465: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 186 KiB/s wr, 23 op/s 2023-05-08T08:07:08.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:07 smithi096 ceph-mon[124666]: pgmap v8465: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 186 KiB/s wr, 23 op/s 2023-05-08T08:07:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:07 smithi186 ceph-mon[126480]: pgmap v8465: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 186 KiB/s wr, 23 op/s 2023-05-08T08:07:09.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15767.922586 secs 2023-05-08T08:07:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15768.479442 secs 2023-05-08T08:07:09.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15767.922586 secs 2023-05-08T08:07:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15768.479442 secs 2023-05-08T08:07:09.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15767.922586 secs 2023-05-08T08:07:09.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15768.479442 secs 2023-05-08T08:07:10.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:09 smithi133 ceph-mon[125939]: pgmap v8466: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 186 KiB/s wr, 23 op/s 2023-05-08T08:07:10.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:09 smithi096 ceph-mon[124666]: pgmap v8466: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 186 KiB/s wr, 23 op/s 2023-05-08T08:07:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:09 smithi186 ceph-mon[126480]: pgmap v8466: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 186 KiB/s wr, 23 op/s 2023-05-08T08:07:11.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15769.762895 secs 2023-05-08T08:07:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:10 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:07:11.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15769.762895 secs 2023-05-08T08:07:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:10 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:07:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15769.762895 secs 2023-05-08T08:07:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:10 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:07:12.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:11 smithi133 ceph-mon[125939]: pgmap v8467: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 235 KiB/s wr, 26 op/s 2023-05-08T08:07:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:11 smithi133 ceph-mon[125939]: osdmap e606: 12 total, 12 up, 12 in 2023-05-08T08:07:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:11 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:07:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:11 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:07:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:11 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:07:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:11 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:07:12.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:11 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T08:07:12.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:11 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T08:07:12.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:11 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:07:12.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:11 smithi096 ceph-mon[124666]: pgmap v8467: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 235 KiB/s wr, 26 op/s 2023-05-08T08:07:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:11 smithi096 ceph-mon[124666]: osdmap e606: 12 total, 12 up, 12 in 2023-05-08T08:07:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:11 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:07:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:11 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:07:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:11 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:07:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:11 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:07:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:11 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T08:07:12.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:11 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T08:07:12.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:11 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:07:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:11 smithi186 ceph-mon[126480]: pgmap v8467: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 235 KiB/s wr, 26 op/s 2023-05-08T08:07:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:11 smithi186 ceph-mon[126480]: osdmap e606: 12 total, 12 up, 12 in 2023-05-08T08:07:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:11 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:07:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:11 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:07:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:11 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:07:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:11 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:07:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:11 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T08:07:12.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:11 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T08:07:12.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:11 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:07:14.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:13 smithi133 ceph-mon[125939]: pgmap v8469: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 114 KiB/s wr, 25 op/s 2023-05-08T08:07:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15772.922666 secs 2023-05-08T08:07:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15773.479579 secs 2023-05-08T08:07:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:13 smithi096 ceph-mon[124666]: pgmap v8469: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 114 KiB/s wr, 25 op/s 2023-05-08T08:07:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15772.922666 secs 2023-05-08T08:07:14.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15773.479579 secs 2023-05-08T08:07:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:13 smithi186 ceph-mon[126480]: pgmap v8469: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 114 KiB/s wr, 25 op/s 2023-05-08T08:07:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15772.922666 secs 2023-05-08T08:07:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15773.479579 secs 2023-05-08T08:07:16.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:15 smithi133 ceph-mon[125939]: pgmap v8470: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 60 KiB/s wr, 6 op/s 2023-05-08T08:07:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15774.763048 secs 2023-05-08T08:07:16.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:15 smithi096 ceph-mon[124666]: pgmap v8470: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 60 KiB/s wr, 6 op/s 2023-05-08T08:07:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15774.763048 secs 2023-05-08T08:07:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:15 smithi186 ceph-mon[126480]: pgmap v8470: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 60 KiB/s wr, 6 op/s 2023-05-08T08:07:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15774.763048 secs 2023-05-08T08:07:18.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:17 smithi133 ceph-mon[125939]: pgmap v8471: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 60 KiB/s wr, 6 op/s 2023-05-08T08:07:18.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:17 smithi096 ceph-mon[124666]: pgmap v8471: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 60 KiB/s wr, 6 op/s 2023-05-08T08:07:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:17 smithi186 ceph-mon[126480]: pgmap v8471: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 60 KiB/s wr, 6 op/s 2023-05-08T08:07:19.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15777.922793 secs 2023-05-08T08:07:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15778.479687 secs 2023-05-08T08:07:19.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15777.922793 secs 2023-05-08T08:07:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15778.479687 secs 2023-05-08T08:07:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15777.922793 secs 2023-05-08T08:07:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15778.479687 secs 2023-05-08T08:07:20.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:19 smithi133 ceph-mon[125939]: pgmap v8472: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 60 KiB/s wr, 6 op/s 2023-05-08T08:07:20.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:19 smithi096 ceph-mon[124666]: pgmap v8472: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 60 KiB/s wr, 6 op/s 2023-05-08T08:07:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:19 smithi186 ceph-mon[126480]: pgmap v8472: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 60 KiB/s wr, 6 op/s 2023-05-08T08:07:21.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15779.763115 secs 2023-05-08T08:07:21.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15779.763115 secs 2023-05-08T08:07:21.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15779.763115 secs 2023-05-08T08:07:22.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:21 smithi133 ceph-mon[125939]: pgmap v8473: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:07:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:21 smithi133 ceph-mon[125939]: osdmap e607: 12 total, 12 up, 12 in 2023-05-08T08:07:22.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:21 smithi096 ceph-mon[124666]: pgmap v8473: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:07:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:21 smithi096 ceph-mon[124666]: osdmap e607: 12 total, 12 up, 12 in 2023-05-08T08:07:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:21 smithi186 ceph-mon[126480]: pgmap v8473: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:07:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:21 smithi186 ceph-mon[126480]: osdmap e607: 12 total, 12 up, 12 in 2023-05-08T08:07:24.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:23 smithi133 ceph-mon[125939]: pgmap v8475: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:07:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15782.922933 secs 2023-05-08T08:07:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15783.479814 secs 2023-05-08T08:07:24.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:23 smithi096 ceph-mon[124666]: pgmap v8475: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:07:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15782.922933 secs 2023-05-08T08:07:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15783.479814 secs 2023-05-08T08:07:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:23 smithi186 ceph-mon[126480]: pgmap v8475: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:07:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15782.922933 secs 2023-05-08T08:07:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15783.479814 secs 2023-05-08T08:07:26.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:25 smithi133 ceph-mon[125939]: pgmap v8476: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T08:07:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15784.763241 secs 2023-05-08T08:07:26.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:25 smithi096 ceph-mon[124666]: pgmap v8476: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T08:07:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15784.763241 secs 2023-05-08T08:07:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:25 smithi186 ceph-mon[126480]: pgmap v8476: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T08:07:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15784.763241 secs 2023-05-08T08:07:28.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:27 smithi133 ceph-mon[125939]: pgmap v8477: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T08:07:28.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:27 smithi096 ceph-mon[124666]: pgmap v8477: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T08:07:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:27 smithi186 ceph-mon[126480]: pgmap v8477: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T08:07:29.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15787.923071 secs 2023-05-08T08:07:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15788.479955 secs 2023-05-08T08:07:29.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15787.923071 secs 2023-05-08T08:07:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15788.479955 secs 2023-05-08T08:07:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15787.923071 secs 2023-05-08T08:07:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15788.479955 secs 2023-05-08T08:07:30.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:29 smithi133 ceph-mon[125939]: pgmap v8478: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T08:07:30.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:29 smithi096 ceph-mon[124666]: pgmap v8478: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T08:07:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:29 smithi186 ceph-mon[126480]: pgmap v8478: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T08:07:31.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15789.763362 secs 2023-05-08T08:07:31.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15789.763362 secs 2023-05-08T08:07:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15789.763362 secs 2023-05-08T08:07:32.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:31 smithi133 ceph-mon[125939]: pgmap v8479: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2023-05-08T08:07:32.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:31 smithi096 ceph-mon[124666]: pgmap v8479: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2023-05-08T08:07:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:31 smithi186 ceph-mon[126480]: pgmap v8479: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2023-05-08T08:07:34.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:33 smithi133 ceph-mon[125939]: pgmap v8480: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2023-05-08T08:07:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15792.923219 secs 2023-05-08T08:07:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15793.480103 secs 2023-05-08T08:07:34.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:33 smithi096 ceph-mon[124666]: pgmap v8480: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2023-05-08T08:07:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15792.923219 secs 2023-05-08T08:07:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15793.480103 secs 2023-05-08T08:07:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:33 smithi186 ceph-mon[126480]: pgmap v8480: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2023-05-08T08:07:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15792.923219 secs 2023-05-08T08:07:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15793.480103 secs 2023-05-08T08:07:36.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:35 smithi133 ceph-mon[125939]: pgmap v8481: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 67 KiB/s wr, 9 op/s 2023-05-08T08:07:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15794.763497 secs 2023-05-08T08:07:36.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:35 smithi096 ceph-mon[124666]: pgmap v8481: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 67 KiB/s wr, 9 op/s 2023-05-08T08:07:36.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15794.763497 secs 2023-05-08T08:07:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:35 smithi186 ceph-mon[126480]: pgmap v8481: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 67 KiB/s wr, 9 op/s 2023-05-08T08:07:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15794.763497 secs 2023-05-08T08:07:38.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:37 smithi096 ceph-mon[124666]: pgmap v8482: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 67 KiB/s wr, 6 op/s 2023-05-08T08:07:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:37 smithi186 ceph-mon[126480]: pgmap v8482: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 67 KiB/s wr, 6 op/s 2023-05-08T08:07:38.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:37 smithi133 ceph-mon[125939]: pgmap v8482: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 67 KiB/s wr, 6 op/s 2023-05-08T08:07:39.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15798.480234 secs 2023-05-08T08:07:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15798.480234 secs 2023-05-08T08:07:39.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15798.480234 secs 2023-05-08T08:07:40.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:39 smithi096 ceph-mon[124666]: pgmap v8483: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 67 KiB/s wr, 6 op/s 2023-05-08T08:07:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:39 smithi186 ceph-mon[126480]: pgmap v8483: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 67 KiB/s wr, 6 op/s 2023-05-08T08:07:40.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:39 smithi133 ceph-mon[125939]: pgmap v8483: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 67 KiB/s wr, 6 op/s 2023-05-08T08:07:42.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:42 smithi186 ceph-mon[126480]: pgmap v8484: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 68 KiB/s wr, 10 op/s 2023-05-08T08:07:42.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:07:42.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:42 smithi133 ceph-mon[125939]: pgmap v8484: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 68 KiB/s wr, 10 op/s 2023-05-08T08:07:42.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:07:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:42 smithi096 ceph-mon[124666]: pgmap v8484: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 68 KiB/s wr, 10 op/s 2023-05-08T08:07:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:07:43.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:43 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:07:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T08:07:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:07:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:07:43.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:43 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:07:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T08:07:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:07:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:07:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:43 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:07:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T08:07:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:07:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:07:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:44 smithi186 ceph-mon[126480]: pgmap v8485: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 67 KiB/s wr, 6 op/s 2023-05-08T08:07:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:07:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:07:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15803.480354 secs 2023-05-08T08:07:44.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:44 smithi133 ceph-mon[125939]: pgmap v8485: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 67 KiB/s wr, 6 op/s 2023-05-08T08:07:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:07:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:07:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15803.480354 secs 2023-05-08T08:07:44.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:44 smithi096 ceph-mon[124666]: pgmap v8485: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 67 KiB/s wr, 6 op/s 2023-05-08T08:07:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:07:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:07:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15803.480354 secs 2023-05-08T08:07:46.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:46 smithi186 ceph-mon[126480]: pgmap v8486: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 230 KiB/s wr, 10 op/s 2023-05-08T08:07:46.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:46 smithi133 ceph-mon[125939]: pgmap v8486: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 230 KiB/s wr, 10 op/s 2023-05-08T08:07:46.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:46 smithi096 ceph-mon[124666]: pgmap v8486: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 230 KiB/s wr, 10 op/s 2023-05-08T08:07:48.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:48 smithi186 ceph-mon[126480]: pgmap v8487: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 163 KiB/s wr, 6 op/s 2023-05-08T08:07:48.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:48 smithi133 ceph-mon[125939]: pgmap v8487: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 163 KiB/s wr, 6 op/s 2023-05-08T08:07:48.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:48 smithi096 ceph-mon[124666]: pgmap v8487: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 163 KiB/s wr, 6 op/s 2023-05-08T08:07:49.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15807.923585 secs 2023-05-08T08:07:49.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15807.923585 secs 2023-05-08T08:07:49.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15807.923585 secs 2023-05-08T08:07:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:50 smithi186 ceph-mon[126480]: pgmap v8488: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 163 KiB/s wr, 6 op/s 2023-05-08T08:07:50.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:50 smithi133 ceph-mon[125939]: pgmap v8488: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 163 KiB/s wr, 6 op/s 2023-05-08T08:07:50.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:50 smithi096 ceph-mon[124666]: pgmap v8488: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 163 KiB/s wr, 6 op/s 2023-05-08T08:07:51.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15809.763820 secs 2023-05-08T08:07:51.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:51 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:07:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T08:07:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:07:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:07:51.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15809.763820 secs 2023-05-08T08:07:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:51 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:07:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T08:07:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:07:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:07:51.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15809.763820 secs 2023-05-08T08:07:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:51 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:07:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T08:07:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:07:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:07:52.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:52 smithi186 ceph-mon[126480]: pgmap v8489: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 518 KiB/s wr, 11 op/s 2023-05-08T08:07:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:07:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:07:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:07:52.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:52 smithi133 ceph-mon[125939]: pgmap v8489: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 518 KiB/s wr, 11 op/s 2023-05-08T08:07:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:07:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:07:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:07:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:52 smithi096 ceph-mon[124666]: pgmap v8489: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 518 KiB/s wr, 11 op/s 2023-05-08T08:07:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:07:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:07:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:07:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:54 smithi186 ceph-mon[126480]: pgmap v8490: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 518 KiB/s wr, 8 op/s 2023-05-08T08:07:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15812.923722 secs 2023-05-08T08:07:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15813.480594 secs 2023-05-08T08:07:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:54 smithi133 ceph-mon[125939]: pgmap v8490: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 518 KiB/s wr, 8 op/s 2023-05-08T08:07:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15812.923722 secs 2023-05-08T08:07:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15813.480594 secs 2023-05-08T08:07:54.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:54 smithi096 ceph-mon[124666]: pgmap v8490: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 518 KiB/s wr, 8 op/s 2023-05-08T08:07:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15812.923722 secs 2023-05-08T08:07:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15813.480594 secs 2023-05-08T08:07:55.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:55 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:07:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:55 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:07:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:55 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:07:55.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:55 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:07:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:55 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:07:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:55 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:07:55.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:55 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:07:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:55 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:07:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:55 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:07:56.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:56 smithi186 ceph-mon[126480]: pgmap v8491: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 685 KiB/s rd, 672 KiB/s wr, 13 op/s 2023-05-08T08:07:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15814.763947 secs 2023-05-08T08:07:56.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:56 smithi133 ceph-mon[125939]: pgmap v8491: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 685 KiB/s rd, 672 KiB/s wr, 13 op/s 2023-05-08T08:07:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15814.763947 secs 2023-05-08T08:07:56.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:56 smithi096 ceph-mon[124666]: pgmap v8491: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 685 KiB/s rd, 672 KiB/s wr, 13 op/s 2023-05-08T08:07:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15814.763947 secs 2023-05-08T08:07:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:58 smithi186 ceph-mon[126480]: pgmap v8492: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 521 KiB/s rd, 509 KiB/s wr, 9 op/s 2023-05-08T08:07:58.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:58 smithi133 ceph-mon[125939]: pgmap v8492: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 521 KiB/s rd, 509 KiB/s wr, 9 op/s 2023-05-08T08:07:58.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:58 smithi096 ceph-mon[124666]: pgmap v8492: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 521 KiB/s rd, 509 KiB/s wr, 9 op/s 2023-05-08T08:07:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15817.923804 secs 2023-05-08T08:07:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:07:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15818.480700 secs 2023-05-08T08:07:59.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15817.923804 secs 2023-05-08T08:07:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:07:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15818.480700 secs 2023-05-08T08:07:59.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15817.923804 secs 2023-05-08T08:07:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:07:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15818.480700 secs 2023-05-08T08:08:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:00 smithi186 ceph-mon[126480]: pgmap v8493: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 521 KiB/s rd, 509 KiB/s wr, 9 op/s 2023-05-08T08:08:00.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:00 smithi133 ceph-mon[125939]: pgmap v8493: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 521 KiB/s rd, 509 KiB/s wr, 9 op/s 2023-05-08T08:08:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:00 smithi096 ceph-mon[124666]: pgmap v8493: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 521 KiB/s rd, 509 KiB/s wr, 9 op/s 2023-05-08T08:08:01.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15819.764060 secs 2023-05-08T08:08:01.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15819.764060 secs 2023-05-08T08:08:01.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15819.764060 secs 2023-05-08T08:08:02.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:02 smithi133 ceph-mon[125939]: pgmap v8494: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 580 KiB/s rd, 568 KiB/s wr, 14 op/s 2023-05-08T08:08:02.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:02 smithi096 ceph-mon[124666]: pgmap v8494: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 580 KiB/s rd, 568 KiB/s wr, 14 op/s 2023-05-08T08:08:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:02 smithi186 ceph-mon[126480]: pgmap v8494: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 580 KiB/s rd, 568 KiB/s wr, 14 op/s 2023-05-08T08:08:04.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:04 smithi133 ceph-mon[125939]: pgmap v8495: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 213 KiB/s wr, 10 op/s 2023-05-08T08:08:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15822.923912 secs 2023-05-08T08:08:04.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:04 smithi096 ceph-mon[124666]: pgmap v8495: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 213 KiB/s wr, 10 op/s 2023-05-08T08:08:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15822.923912 secs 2023-05-08T08:08:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:04 smithi186 ceph-mon[126480]: pgmap v8495: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 213 KiB/s wr, 10 op/s 2023-05-08T08:08:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15822.923912 secs 2023-05-08T08:08:06.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:06 smithi133 ceph-mon[125939]: pgmap v8496: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 671 KiB/s rd, 666 KiB/s wr, 29 op/s 2023-05-08T08:08:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15824.764149 secs 2023-05-08T08:08:06.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:06 smithi096 ceph-mon[124666]: pgmap v8496: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 671 KiB/s rd, 666 KiB/s wr, 29 op/s 2023-05-08T08:08:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15824.764149 secs 2023-05-08T08:08:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:06 smithi186 ceph-mon[126480]: pgmap v8496: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 671 KiB/s rd, 666 KiB/s wr, 29 op/s 2023-05-08T08:08:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15824.764149 secs 2023-05-08T08:08:08.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:07 smithi186 ceph-mon[126480]: pgmap v8497: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 290 KiB/s rd, 511 KiB/s wr, 24 op/s 2023-05-08T08:08:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:07 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:08:08.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:07 smithi133 ceph-mon[125939]: pgmap v8497: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 290 KiB/s rd, 511 KiB/s wr, 24 op/s 2023-05-08T08:08:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:07 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:08:08.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:07 smithi096 ceph-mon[124666]: pgmap v8497: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 290 KiB/s rd, 511 KiB/s wr, 24 op/s 2023-05-08T08:08:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:07 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:08:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:08 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:08:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:08:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:08:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15827.924049 secs 2023-05-08T08:08:09.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:08 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:08:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:08:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:08:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15827.924049 secs 2023-05-08T08:08:09.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:08 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:08:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:08:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:08:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15827.924049 secs 2023-05-08T08:08:10.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15828.480920 secs 2023-05-08T08:08:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:09 smithi133 ceph-mon[125939]: pgmap v8498: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 290 KiB/s rd, 511 KiB/s wr, 24 op/s 2023-05-08T08:08:10.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15828.480920 secs 2023-05-08T08:08:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:09 smithi096 ceph-mon[124666]: pgmap v8498: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 290 KiB/s rd, 511 KiB/s wr, 24 op/s 2023-05-08T08:08:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15828.480920 secs 2023-05-08T08:08:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:09 smithi186 ceph-mon[126480]: pgmap v8498: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 290 KiB/s rd, 511 KiB/s wr, 24 op/s 2023-05-08T08:08:11.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15829.764296 secs 2023-05-08T08:08:11.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15829.764296 secs 2023-05-08T08:08:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15829.764296 secs 2023-05-08T08:08:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:11 smithi133 ceph-mon[125939]: pgmap v8499: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 583 KiB/s rd, 616 KiB/s wr, 30 op/s 2023-05-08T08:08:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:11 smithi133 ceph-mon[125939]: osdmap e608: 12 total, 12 up, 12 in 2023-05-08T08:08:12.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:11 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:08:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:11 smithi096 ceph-mon[124666]: pgmap v8499: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 583 KiB/s rd, 616 KiB/s wr, 30 op/s 2023-05-08T08:08:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:11 smithi096 ceph-mon[124666]: osdmap e608: 12 total, 12 up, 12 in 2023-05-08T08:08:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:11 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:08:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:11 smithi186 ceph-mon[126480]: pgmap v8499: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 583 KiB/s rd, 616 KiB/s wr, 30 op/s 2023-05-08T08:08:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:11 smithi186 ceph-mon[126480]: osdmap e608: 12 total, 12 up, 12 in 2023-05-08T08:08:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:11 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:08:13.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:12 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:08:13.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:12 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:08:13.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:12 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:08:13.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:12 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:08:13.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:12 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:08:13.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:12 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:08:14.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:13 smithi133 ceph-mon[125939]: pgmap v8501: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 629 KiB/s rd, 670 KiB/s wr, 30 op/s 2023-05-08T08:08:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15832.924172 secs 2023-05-08T08:08:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15833.481040 secs 2023-05-08T08:08:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:13 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:08:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:13 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:08:14.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:13 smithi096 ceph-mon[124666]: pgmap v8501: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 629 KiB/s rd, 670 KiB/s wr, 30 op/s 2023-05-08T08:08:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15832.924172 secs 2023-05-08T08:08:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15833.481040 secs 2023-05-08T08:08:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:13 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:08:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:13 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:08:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:13 smithi186 ceph-mon[126480]: pgmap v8501: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 629 KiB/s rd, 670 KiB/s wr, 30 op/s 2023-05-08T08:08:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15832.924172 secs 2023-05-08T08:08:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15833.481040 secs 2023-05-08T08:08:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:13 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:08:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:13 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:08:15.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:08:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:08:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:08:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:08:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:08:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:08:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:08:15.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:08:15.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:08:15.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:08:15.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:08:15.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:08:15.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:08:15.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:08:15.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:08:15.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:08:15.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:08:15.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:08:15.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:08:15.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:08:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:08:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:08:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:08:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:08:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:08:15.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:08:15.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:08:15.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:08:15.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:08:15.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:08:15.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:08:15.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:08:15.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:08:15.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:08:15.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:08:15.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:08:15.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:08:15.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:08:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:08:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:08:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:08:15.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:08:15.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:08:15.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:08:15.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:08:15.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:08:15.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:08:15.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:08:15.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:08:15.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:08:15.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:08:15.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:08:15.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:08:15.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:08:15.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:08:15.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:08:15.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:08:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:15 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi096 to 97.67M 2023-05-08T08:08:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:15 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi096 to 102419107: error parsing value: Value '102419107' is below minimum 939524096 2023-05-08T08:08:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:15 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T08:08:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:15 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T08:08:16.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:15 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T08:08:16.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:15 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T08:08:16.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:15 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:08:16.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:15 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T08:08:16.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:15 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T08:08:16.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:15 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:08:16.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:15 smithi133 ceph-mon[125939]: pgmap v8502: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 405 KiB/s rd, 178 KiB/s wr, 10 op/s 2023-05-08T08:08:16.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15834.764437 secs 2023-05-08T08:08:16.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:15 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi096 to 97.67M 2023-05-08T08:08:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:15 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi096 to 102419107: error parsing value: Value '102419107' is below minimum 939524096 2023-05-08T08:08:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:15 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T08:08:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:15 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T08:08:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:15 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T08:08:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:15 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T08:08:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:15 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:08:16.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:15 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T08:08:16.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:15 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T08:08:16.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:15 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:08:16.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:15 smithi096 ceph-mon[124666]: pgmap v8502: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 405 KiB/s rd, 178 KiB/s wr, 10 op/s 2023-05-08T08:08:16.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15834.764437 secs 2023-05-08T08:08:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:15 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi096 to 97.67M 2023-05-08T08:08:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:15 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi096 to 102419107: error parsing value: Value '102419107' is below minimum 939524096 2023-05-08T08:08:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:15 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T08:08:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:15 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T08:08:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:15 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T08:08:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:15 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T08:08:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:15 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:08:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:15 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T08:08:16.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:15 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T08:08:16.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:15 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:08:16.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:15 smithi186 ceph-mon[126480]: pgmap v8502: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 405 KiB/s rd, 178 KiB/s wr, 10 op/s 2023-05-08T08:08:16.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15834.764437 secs 2023-05-08T08:08:17.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:16 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:08:17.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:16 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:08:17.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:16 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:08:18.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:17 smithi133 ceph-mon[125939]: pgmap v8503: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 405 KiB/s rd, 178 KiB/s wr, 10 op/s 2023-05-08T08:08:18.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:17 smithi096 ceph-mon[124666]: pgmap v8503: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 405 KiB/s rd, 178 KiB/s wr, 10 op/s 2023-05-08T08:08:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:17 smithi186 ceph-mon[126480]: pgmap v8503: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 405 KiB/s rd, 178 KiB/s wr, 10 op/s 2023-05-08T08:08:19.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15837.924299 secs 2023-05-08T08:08:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15838.481175 secs 2023-05-08T08:08:19.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15837.924299 secs 2023-05-08T08:08:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15838.481175 secs 2023-05-08T08:08:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15837.924299 secs 2023-05-08T08:08:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15838.481175 secs 2023-05-08T08:08:20.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:19 smithi133 ceph-mon[125939]: pgmap v8504: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 405 KiB/s rd, 178 KiB/s wr, 10 op/s 2023-05-08T08:08:20.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:19 smithi096 ceph-mon[124666]: pgmap v8504: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 405 KiB/s rd, 178 KiB/s wr, 10 op/s 2023-05-08T08:08:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:19 smithi186 ceph-mon[126480]: pgmap v8504: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 405 KiB/s rd, 178 KiB/s wr, 10 op/s 2023-05-08T08:08:21.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15839.764557 secs 2023-05-08T08:08:21.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15839.764557 secs 2023-05-08T08:08:21.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15839.764557 secs 2023-05-08T08:08:22.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:21 smithi133 ceph-mon[125939]: pgmap v8505: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 96 KiB/s wr, 6 op/s 2023-05-08T08:08:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:21 smithi133 ceph-mon[125939]: osdmap e609: 12 total, 12 up, 12 in 2023-05-08T08:08:22.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:21 smithi096 ceph-mon[124666]: pgmap v8505: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 96 KiB/s wr, 6 op/s 2023-05-08T08:08:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:21 smithi096 ceph-mon[124666]: osdmap e609: 12 total, 12 up, 12 in 2023-05-08T08:08:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:21 smithi186 ceph-mon[126480]: pgmap v8505: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 96 KiB/s wr, 6 op/s 2023-05-08T08:08:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:21 smithi186 ceph-mon[126480]: osdmap e609: 12 total, 12 up, 12 in 2023-05-08T08:08:24.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:23 smithi133 ceph-mon[125939]: pgmap v8507: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 96 KiB/s wr, 6 op/s 2023-05-08T08:08:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15842.924424 secs 2023-05-08T08:08:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15843.481295 secs 2023-05-08T08:08:24.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:23 smithi096 ceph-mon[124666]: pgmap v8507: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 96 KiB/s wr, 6 op/s 2023-05-08T08:08:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15842.924424 secs 2023-05-08T08:08:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15843.481295 secs 2023-05-08T08:08:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:23 smithi186 ceph-mon[126480]: pgmap v8507: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 96 KiB/s wr, 6 op/s 2023-05-08T08:08:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15842.924424 secs 2023-05-08T08:08:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15843.481295 secs 2023-05-08T08:08:26.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:25 smithi133 ceph-mon[125939]: pgmap v8508: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 44 KiB/s wr, 6 op/s 2023-05-08T08:08:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15844.764687 secs 2023-05-08T08:08:26.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:25 smithi096 ceph-mon[124666]: pgmap v8508: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 44 KiB/s wr, 6 op/s 2023-05-08T08:08:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15844.764687 secs 2023-05-08T08:08:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:25 smithi186 ceph-mon[126480]: pgmap v8508: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 44 KiB/s wr, 6 op/s 2023-05-08T08:08:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15844.764687 secs 2023-05-08T08:08:28.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:27 smithi133 ceph-mon[125939]: pgmap v8509: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 44 KiB/s wr, 6 op/s 2023-05-08T08:08:28.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:27 smithi096 ceph-mon[124666]: pgmap v8509: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 44 KiB/s wr, 6 op/s 2023-05-08T08:08:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:27 smithi186 ceph-mon[126480]: pgmap v8509: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 44 KiB/s wr, 6 op/s 2023-05-08T08:08:29.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15847.924525 secs 2023-05-08T08:08:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15848.481407 secs 2023-05-08T08:08:29.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15847.924525 secs 2023-05-08T08:08:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15848.481407 secs 2023-05-08T08:08:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15847.924525 secs 2023-05-08T08:08:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15848.481407 secs 2023-05-08T08:08:30.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:29 smithi133 ceph-mon[125939]: pgmap v8510: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 44 KiB/s wr, 6 op/s 2023-05-08T08:08:30.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:29 smithi096 ceph-mon[124666]: pgmap v8510: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 44 KiB/s wr, 6 op/s 2023-05-08T08:08:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:29 smithi186 ceph-mon[126480]: pgmap v8510: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 44 KiB/s wr, 6 op/s 2023-05-08T08:08:31.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15849.764812 secs 2023-05-08T08:08:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15849.764812 secs 2023-05-08T08:08:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15849.764812 secs 2023-05-08T08:08:32.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:31 smithi133 ceph-mon[125939]: pgmap v8511: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 61 KiB/s wr, 7 op/s 2023-05-08T08:08:32.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:31 smithi096 ceph-mon[124666]: pgmap v8511: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 61 KiB/s wr, 7 op/s 2023-05-08T08:08:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:31 smithi186 ceph-mon[126480]: pgmap v8511: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 61 KiB/s wr, 7 op/s 2023-05-08T08:08:34.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:33 smithi133 ceph-mon[125939]: pgmap v8512: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 55 KiB/s wr, 6 op/s 2023-05-08T08:08:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15852.924625 secs 2023-05-08T08:08:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15853.481550 secs 2023-05-08T08:08:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:33 smithi096 ceph-mon[124666]: pgmap v8512: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 55 KiB/s wr, 6 op/s 2023-05-08T08:08:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15852.924625 secs 2023-05-08T08:08:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15853.481550 secs 2023-05-08T08:08:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:33 smithi186 ceph-mon[126480]: pgmap v8512: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 55 KiB/s wr, 6 op/s 2023-05-08T08:08:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15852.924625 secs 2023-05-08T08:08:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15853.481550 secs 2023-05-08T08:08:36.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:35 smithi133 ceph-mon[125939]: pgmap v8513: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 8 op/s 2023-05-08T08:08:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15854.764938 secs 2023-05-08T08:08:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:35 smithi096 ceph-mon[124666]: pgmap v8513: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 8 op/s 2023-05-08T08:08:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15854.764938 secs 2023-05-08T08:08:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:35 smithi186 ceph-mon[126480]: pgmap v8513: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 8 op/s 2023-05-08T08:08:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15854.764938 secs 2023-05-08T08:08:38.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:37 smithi133 ceph-mon[125939]: pgmap v8514: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 50 KiB/s wr, 5 op/s 2023-05-08T08:08:38.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:37 smithi096 ceph-mon[124666]: pgmap v8514: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 50 KiB/s wr, 5 op/s 2023-05-08T08:08:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:37 smithi186 ceph-mon[126480]: pgmap v8514: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 50 KiB/s wr, 5 op/s 2023-05-08T08:08:39.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15857.924745 secs 2023-05-08T08:08:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15858.481641 secs 2023-05-08T08:08:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15857.924745 secs 2023-05-08T08:08:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15858.481641 secs 2023-05-08T08:08:39.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15857.924745 secs 2023-05-08T08:08:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15858.481641 secs 2023-05-08T08:08:40.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:39 smithi096 ceph-mon[124666]: pgmap v8515: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 50 KiB/s wr, 5 op/s 2023-05-08T08:08:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:39 smithi186 ceph-mon[126480]: pgmap v8515: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 50 KiB/s wr, 5 op/s 2023-05-08T08:08:40.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:39 smithi133 ceph-mon[125939]: pgmap v8515: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 50 KiB/s wr, 5 op/s 2023-05-08T08:08:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:41 smithi096 ceph-mon[124666]: pgmap v8516: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 79 KiB/s wr, 9 op/s 2023-05-08T08:08:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:41 smithi186 ceph-mon[126480]: pgmap v8516: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 79 KiB/s wr, 9 op/s 2023-05-08T08:08:42.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:41 smithi133 ceph-mon[125939]: pgmap v8516: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 79 KiB/s wr, 9 op/s 2023-05-08T08:08:43.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:08:43.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:08:43.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:08:44.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:44 smithi096 ceph-mon[124666]: pgmap v8517: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 29 KiB/s wr, 6 op/s 2023-05-08T08:08:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:08:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:08:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:08:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15862.924842 secs 2023-05-08T08:08:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:44 smithi186 ceph-mon[126480]: pgmap v8517: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 29 KiB/s wr, 6 op/s 2023-05-08T08:08:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:08:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:08:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:08:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15862.924842 secs 2023-05-08T08:08:44.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:44 smithi133 ceph-mon[125939]: pgmap v8517: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 29 KiB/s wr, 6 op/s 2023-05-08T08:08:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:08:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:08:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:08:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15862.924842 secs 2023-05-08T08:08:46.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:46 smithi186 ceph-mon[126480]: pgmap v8518: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 339 KiB/s wr, 10 op/s 2023-05-08T08:08:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15864.765123 secs 2023-05-08T08:08:46.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:46 smithi133 ceph-mon[125939]: pgmap v8518: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 339 KiB/s wr, 10 op/s 2023-05-08T08:08:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15864.765123 secs 2023-05-08T08:08:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:46 smithi096 ceph-mon[124666]: pgmap v8518: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 339 KiB/s wr, 10 op/s 2023-05-08T08:08:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15864.765123 secs 2023-05-08T08:08:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:47 smithi133 ceph-mon[125939]: pgmap v8519: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 452 KiB/s rd, 339 KiB/s wr, 8 op/s 2023-05-08T08:08:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:08:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:47 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:08:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:47 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:08:48.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:47 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:08:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:47 smithi096 ceph-mon[124666]: pgmap v8519: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 452 KiB/s rd, 339 KiB/s wr, 8 op/s 2023-05-08T08:08:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:08:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:47 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:08:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:47 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:08:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:47 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:08:48.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:47 smithi186 ceph-mon[126480]: pgmap v8519: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 452 KiB/s rd, 339 KiB/s wr, 8 op/s 2023-05-08T08:08:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:08:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:47 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:08:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:47 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:08:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:47 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:08:49.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15867.924966 secs 2023-05-08T08:08:49.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15867.924966 secs 2023-05-08T08:08:49.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15867.924966 secs 2023-05-08T08:08:50.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15868.481868 secs 2023-05-08T08:08:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:49 smithi133 ceph-mon[125939]: pgmap v8520: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 452 KiB/s rd, 339 KiB/s wr, 8 op/s 2023-05-08T08:08:50.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15868.481868 secs 2023-05-08T08:08:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:49 smithi096 ceph-mon[124666]: pgmap v8520: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 452 KiB/s rd, 339 KiB/s wr, 8 op/s 2023-05-08T08:08:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15868.481868 secs 2023-05-08T08:08:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:49 smithi186 ceph-mon[126480]: pgmap v8520: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 452 KiB/s rd, 339 KiB/s wr, 8 op/s 2023-05-08T08:08:51.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15869.765246 secs 2023-05-08T08:08:51.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15869.765246 secs 2023-05-08T08:08:51.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15869.765246 secs 2023-05-08T08:08:52.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:51 smithi133 ceph-mon[125939]: pgmap v8521: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 685 KiB/s rd, 560 KiB/s wr, 14 op/s 2023-05-08T08:08:52.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:51 smithi096 ceph-mon[124666]: pgmap v8521: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 685 KiB/s rd, 560 KiB/s wr, 14 op/s 2023-05-08T08:08:52.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:51 smithi186 ceph-mon[126480]: pgmap v8521: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 685 KiB/s rd, 560 KiB/s wr, 14 op/s 2023-05-08T08:08:53.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:52 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:08:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:08:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:08:53.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:52 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:08:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:08:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:08:53.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:52 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:08:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:08:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:08:54.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:53 smithi133 ceph-mon[125939]: pgmap v8522: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 532 KiB/s wr, 10 op/s 2023-05-08T08:08:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15872.925087 secs 2023-05-08T08:08:54.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:53 smithi096 ceph-mon[124666]: pgmap v8522: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 532 KiB/s wr, 10 op/s 2023-05-08T08:08:54.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15872.925087 secs 2023-05-08T08:08:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:53 smithi186 ceph-mon[126480]: pgmap v8522: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 532 KiB/s wr, 10 op/s 2023-05-08T08:08:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15872.925087 secs 2023-05-08T08:08:56.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:55 smithi133 ceph-mon[125939]: pgmap v8523: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 726 KiB/s rd, 696 KiB/s wr, 16 op/s 2023-05-08T08:08:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:55 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:08:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15874.765370 secs 2023-05-08T08:08:56.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:55 smithi096 ceph-mon[124666]: pgmap v8523: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 726 KiB/s rd, 696 KiB/s wr, 16 op/s 2023-05-08T08:08:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:55 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:08:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15874.765370 secs 2023-05-08T08:08:56.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:55 smithi186 ceph-mon[126480]: pgmap v8523: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 726 KiB/s rd, 696 KiB/s wr, 16 op/s 2023-05-08T08:08:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:55 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:08:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15874.765370 secs 2023-05-08T08:08:57.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:08:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:08:57.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:08:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:08:57.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:08:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:08:58.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:57 smithi133 ceph-mon[125939]: pgmap v8524: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 359 KiB/s rd, 386 KiB/s wr, 11 op/s 2023-05-08T08:08:58.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:57 smithi096 ceph-mon[124666]: pgmap v8524: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 359 KiB/s rd, 386 KiB/s wr, 11 op/s 2023-05-08T08:08:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:57 smithi186 ceph-mon[126480]: pgmap v8524: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 359 KiB/s rd, 386 KiB/s wr, 11 op/s 2023-05-08T08:08:59.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15877.925233 secs 2023-05-08T08:08:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15878.482068 secs 2023-05-08T08:08:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15877.925233 secs 2023-05-08T08:08:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15878.482068 secs 2023-05-08T08:08:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15877.925233 secs 2023-05-08T08:08:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15878.482068 secs 2023-05-08T08:09:00.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:08:59 smithi133 ceph-mon[125939]: pgmap v8525: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 359 KiB/s rd, 385 KiB/s wr, 11 op/s 2023-05-08T08:09:00.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:08:59 smithi096 ceph-mon[124666]: pgmap v8525: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 359 KiB/s rd, 385 KiB/s wr, 11 op/s 2023-05-08T08:09:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:08:59 smithi186 ceph-mon[126480]: pgmap v8525: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 359 KiB/s rd, 385 KiB/s wr, 11 op/s 2023-05-08T08:09:01.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:00 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:09:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:09:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:09:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15879.765521 secs 2023-05-08T08:09:01.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:00 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:09:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:09:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:09:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15879.765521 secs 2023-05-08T08:09:01.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:00 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:09:01.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:09:01.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:09:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15879.765521 secs 2023-05-08T08:09:02.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:01 smithi133 ceph-mon[125939]: pgmap v8526: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 449 KiB/s rd, 436 KiB/s wr, 16 op/s 2023-05-08T08:09:02.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:01 smithi096 ceph-mon[124666]: pgmap v8526: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 449 KiB/s rd, 436 KiB/s wr, 16 op/s 2023-05-08T08:09:02.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:01 smithi186 ceph-mon[126480]: pgmap v8526: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 449 KiB/s rd, 436 KiB/s wr, 16 op/s 2023-05-08T08:09:04.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:03 smithi133 ceph-mon[125939]: pgmap v8527: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 215 KiB/s wr, 10 op/s 2023-05-08T08:09:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15882.925355 secs 2023-05-08T08:09:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15883.482203 secs 2023-05-08T08:09:04.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:03 smithi096 ceph-mon[124666]: pgmap v8527: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 215 KiB/s wr, 10 op/s 2023-05-08T08:09:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15882.925355 secs 2023-05-08T08:09:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15883.482203 secs 2023-05-08T08:09:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:03 smithi186 ceph-mon[126480]: pgmap v8527: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 215 KiB/s wr, 10 op/s 2023-05-08T08:09:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15882.925355 secs 2023-05-08T08:09:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15883.482203 secs 2023-05-08T08:09:06.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:05 smithi133 ceph-mon[125939]: pgmap v8528: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 383 KiB/s wr, 28 op/s 2023-05-08T08:09:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15884.765620 secs 2023-05-08T08:09:06.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:05 smithi096 ceph-mon[124666]: pgmap v8528: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 383 KiB/s wr, 28 op/s 2023-05-08T08:09:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15884.765620 secs 2023-05-08T08:09:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:05 smithi186 ceph-mon[126480]: pgmap v8528: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 383 KiB/s wr, 28 op/s 2023-05-08T08:09:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15884.765620 secs 2023-05-08T08:09:07.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:06 smithi133 ceph-mon[125939]: osdmap e610: 12 total, 12 up, 12 in 2023-05-08T08:09:07.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:06 smithi096 ceph-mon[124666]: osdmap e610: 12 total, 12 up, 12 in 2023-05-08T08:09:07.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:06 smithi186 ceph-mon[126480]: osdmap e610: 12 total, 12 up, 12 in 2023-05-08T08:09:08.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:07 smithi133 ceph-mon[125939]: pgmap v8530: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 263 KiB/s wr, 27 op/s 2023-05-08T08:09:08.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:07 smithi096 ceph-mon[124666]: pgmap v8530: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 263 KiB/s wr, 27 op/s 2023-05-08T08:09:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:07 smithi186 ceph-mon[126480]: pgmap v8530: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 263 KiB/s wr, 27 op/s 2023-05-08T08:09:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15887.925482 secs 2023-05-08T08:09:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15888.482350 secs 2023-05-08T08:09:09.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15887.925482 secs 2023-05-08T08:09:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15888.482350 secs 2023-05-08T08:09:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15887.925482 secs 2023-05-08T08:09:09.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15888.482350 secs 2023-05-08T08:09:10.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:09 smithi133 ceph-mon[125939]: pgmap v8531: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 263 KiB/s wr, 27 op/s 2023-05-08T08:09:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:09 smithi096 ceph-mon[124666]: pgmap v8531: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 263 KiB/s wr, 27 op/s 2023-05-08T08:09:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:09 smithi186 ceph-mon[126480]: pgmap v8531: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 263 KiB/s wr, 27 op/s 2023-05-08T08:09:11.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15889.765738 secs 2023-05-08T08:09:11.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15889.765738 secs 2023-05-08T08:09:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15889.765738 secs 2023-05-08T08:09:12.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:11 smithi133 ceph-mon[125939]: pgmap v8532: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 203 KiB/s wr, 25 op/s 2023-05-08T08:09:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:11 smithi133 ceph-mon[125939]: osdmap e611: 12 total, 12 up, 12 in 2023-05-08T08:09:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:11 smithi096 ceph-mon[124666]: pgmap v8532: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 203 KiB/s wr, 25 op/s 2023-05-08T08:09:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:11 smithi096 ceph-mon[124666]: osdmap e611: 12 total, 12 up, 12 in 2023-05-08T08:09:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:11 smithi186 ceph-mon[126480]: pgmap v8532: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 203 KiB/s wr, 25 op/s 2023-05-08T08:09:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:11 smithi186 ceph-mon[126480]: osdmap e611: 12 total, 12 up, 12 in 2023-05-08T08:09:14.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:13 smithi133 ceph-mon[125939]: pgmap v8534: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 1023 B/s wr, 5 op/s 2023-05-08T08:09:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15892.925586 secs 2023-05-08T08:09:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15893.482464 secs 2023-05-08T08:09:14.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:13 smithi096 ceph-mon[124666]: pgmap v8534: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 1023 B/s wr, 5 op/s 2023-05-08T08:09:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15892.925586 secs 2023-05-08T08:09:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15893.482464 secs 2023-05-08T08:09:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:13 smithi186 ceph-mon[126480]: pgmap v8534: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 1023 B/s wr, 5 op/s 2023-05-08T08:09:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15892.925586 secs 2023-05-08T08:09:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15893.482464 secs 2023-05-08T08:09:15.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:09:15.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:09:15.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:09:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:15 smithi133 ceph-mon[125939]: pgmap v8535: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 1.0 KiB/s wr, 8 op/s 2023-05-08T08:09:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15894.765818 secs 2023-05-08T08:09:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:15 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:09:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:15 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:09:16.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:15 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:09:16.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:15 smithi096 ceph-mon[124666]: pgmap v8535: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 1.0 KiB/s wr, 8 op/s 2023-05-08T08:09:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15894.765818 secs 2023-05-08T08:09:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:15 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:09:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:15 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:09:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:15 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:09:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:15 smithi186 ceph-mon[126480]: pgmap v8535: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 1.0 KiB/s wr, 8 op/s 2023-05-08T08:09:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15894.765818 secs 2023-05-08T08:09:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:15 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:09:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:15 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:09:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:15 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:09:17.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:16 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:09:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:16 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T08:09:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:16 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T08:09:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:16 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:09:17.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:16 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:09:17.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:16 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T08:09:17.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:16 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T08:09:17.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:16 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:09:17.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:16 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:09:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:16 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T08:09:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:16 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T08:09:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:16 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:09:18.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:17 smithi096 ceph-mon[124666]: pgmap v8536: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 921 B/s wr, 7 op/s 2023-05-08T08:09:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:17 smithi186 ceph-mon[126480]: pgmap v8536: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 921 B/s wr, 7 op/s 2023-05-08T08:09:18.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:17 smithi133 ceph-mon[125939]: pgmap v8536: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 921 B/s wr, 7 op/s 2023-05-08T08:09:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15897.925707 secs 2023-05-08T08:09:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15898.482552 secs 2023-05-08T08:09:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15897.925707 secs 2023-05-08T08:09:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15898.482552 secs 2023-05-08T08:09:19.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15897.925707 secs 2023-05-08T08:09:19.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15898.482552 secs 2023-05-08T08:09:20.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:19 smithi096 ceph-mon[124666]: pgmap v8537: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 921 B/s wr, 7 op/s 2023-05-08T08:09:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:19 smithi186 ceph-mon[126480]: pgmap v8537: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 921 B/s wr, 7 op/s 2023-05-08T08:09:20.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:19 smithi133 ceph-mon[125939]: pgmap v8537: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 921 B/s wr, 7 op/s 2023-05-08T08:09:21.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15899.765856 secs 2023-05-08T08:09:21.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15899.765856 secs 2023-05-08T08:09:21.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15899.765856 secs 2023-05-08T08:09:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:22 smithi186 ceph-mon[126480]: pgmap v8538: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2023-05-08T08:09:22.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:22 smithi133 ceph-mon[125939]: pgmap v8538: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2023-05-08T08:09:22.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:22 smithi096 ceph-mon[124666]: pgmap v8538: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2023-05-08T08:09:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:24 smithi186 ceph-mon[126480]: pgmap v8539: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 93 B/s wr, 5 op/s 2023-05-08T08:09:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15902.925837 secs 2023-05-08T08:09:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15903.482653 secs 2023-05-08T08:09:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:24 smithi133 ceph-mon[125939]: pgmap v8539: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 93 B/s wr, 5 op/s 2023-05-08T08:09:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15902.925837 secs 2023-05-08T08:09:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15903.482653 secs 2023-05-08T08:09:24.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:24 smithi096 ceph-mon[124666]: pgmap v8539: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 93 B/s wr, 5 op/s 2023-05-08T08:09:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15902.925837 secs 2023-05-08T08:09:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15903.482653 secs 2023-05-08T08:09:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:26 smithi186 ceph-mon[126480]: pgmap v8540: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 8 op/s 2023-05-08T08:09:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15904.765952 secs 2023-05-08T08:09:26.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:26 smithi133 ceph-mon[125939]: pgmap v8540: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 8 op/s 2023-05-08T08:09:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15904.765952 secs 2023-05-08T08:09:26.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:26 smithi096 ceph-mon[124666]: pgmap v8540: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 8 op/s 2023-05-08T08:09:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15904.765952 secs 2023-05-08T08:09:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:28 smithi186 ceph-mon[126480]: pgmap v8541: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 682 B/s wr, 5 op/s 2023-05-08T08:09:28.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:28 smithi133 ceph-mon[125939]: pgmap v8541: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 682 B/s wr, 5 op/s 2023-05-08T08:09:28.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:28 smithi096 ceph-mon[124666]: pgmap v8541: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 682 B/s wr, 5 op/s 2023-05-08T08:09:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15907.925962 secs 2023-05-08T08:09:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15908.482769 secs 2023-05-08T08:09:29.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15907.925962 secs 2023-05-08T08:09:29.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15908.482769 secs 2023-05-08T08:09:29.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15907.925962 secs 2023-05-08T08:09:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15908.482769 secs 2023-05-08T08:09:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:30 smithi186 ceph-mon[126480]: pgmap v8542: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 682 B/s wr, 5 op/s 2023-05-08T08:09:30.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:30 smithi133 ceph-mon[125939]: pgmap v8542: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 682 B/s wr, 5 op/s 2023-05-08T08:09:30.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:30 smithi096 ceph-mon[124666]: pgmap v8542: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 682 B/s wr, 5 op/s 2023-05-08T08:09:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15909.766032 secs 2023-05-08T08:09:31.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15909.766032 secs 2023-05-08T08:09:31.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15909.766032 secs 2023-05-08T08:09:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:32 smithi186 ceph-mon[126480]: pgmap v8543: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 111 KiB/s wr, 9 op/s 2023-05-08T08:09:32.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:32 smithi133 ceph-mon[125939]: pgmap v8543: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 111 KiB/s wr, 9 op/s 2023-05-08T08:09:32.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:32 smithi096 ceph-mon[124666]: pgmap v8543: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 111 KiB/s wr, 9 op/s 2023-05-08T08:09:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:34 smithi186 ceph-mon[126480]: pgmap v8544: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 111 KiB/s wr, 6 op/s 2023-05-08T08:09:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15912.926063 secs 2023-05-08T08:09:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15913.482874 secs 2023-05-08T08:09:34.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:34 smithi133 ceph-mon[125939]: pgmap v8544: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 111 KiB/s wr, 6 op/s 2023-05-08T08:09:34.528 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15912.926063 secs 2023-05-08T08:09:34.529 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15913.482874 secs 2023-05-08T08:09:34.529 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:34 smithi096 ceph-mon[124666]: pgmap v8544: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 111 KiB/s wr, 6 op/s 2023-05-08T08:09:34.529 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15912.926063 secs 2023-05-08T08:09:34.529 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15913.482874 secs 2023-05-08T08:09:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:36 smithi186 ceph-mon[126480]: pgmap v8545: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 111 KiB/s wr, 9 op/s 2023-05-08T08:09:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15914.766168 secs 2023-05-08T08:09:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:36 smithi133 ceph-mon[125939]: pgmap v8545: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 111 KiB/s wr, 9 op/s 2023-05-08T08:09:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15914.766168 secs 2023-05-08T08:09:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:36 smithi096 ceph-mon[124666]: pgmap v8545: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 111 KiB/s wr, 9 op/s 2023-05-08T08:09:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15914.766168 secs 2023-05-08T08:09:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:38 smithi186 ceph-mon[126480]: pgmap v8546: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 111 KiB/s wr, 6 op/s 2023-05-08T08:09:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:38 smithi133 ceph-mon[125939]: pgmap v8546: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 111 KiB/s wr, 6 op/s 2023-05-08T08:09:38.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:38 smithi096 ceph-mon[124666]: pgmap v8546: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 111 KiB/s wr, 6 op/s 2023-05-08T08:09:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15917.926203 secs 2023-05-08T08:09:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15918.482997 secs 2023-05-08T08:09:39.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15917.926203 secs 2023-05-08T08:09:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15918.482997 secs 2023-05-08T08:09:39.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15917.926203 secs 2023-05-08T08:09:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15918.482997 secs 2023-05-08T08:09:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:40 smithi186 ceph-mon[126480]: pgmap v8547: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 111 KiB/s wr, 6 op/s 2023-05-08T08:09:40.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:40 smithi133 ceph-mon[125939]: pgmap v8547: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 111 KiB/s wr, 6 op/s 2023-05-08T08:09:40.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:40 smithi096 ceph-mon[124666]: pgmap v8547: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 111 KiB/s wr, 6 op/s 2023-05-08T08:09:42.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:42 smithi186 ceph-mon[126480]: pgmap v8548: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 199 KiB/s wr, 9 op/s 2023-05-08T08:09:42.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:42 smithi133 ceph-mon[125939]: pgmap v8548: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 199 KiB/s wr, 9 op/s 2023-05-08T08:09:42.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:42 smithi096 ceph-mon[124666]: pgmap v8548: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 199 KiB/s wr, 9 op/s 2023-05-08T08:09:43.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:09:43.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:09:43.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:09:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:44 smithi186 ceph-mon[126480]: pgmap v8549: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 88 KiB/s wr, 6 op/s 2023-05-08T08:09:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:09:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:09:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:09:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15922.926359 secs 2023-05-08T08:09:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15923.483105 secs 2023-05-08T08:09:44.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:44 smithi133 ceph-mon[125939]: pgmap v8549: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 88 KiB/s wr, 6 op/s 2023-05-08T08:09:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:09:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:09:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:09:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15922.926359 secs 2023-05-08T08:09:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15923.483105 secs 2023-05-08T08:09:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:44 smithi096 ceph-mon[124666]: pgmap v8549: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 88 KiB/s wr, 6 op/s 2023-05-08T08:09:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:09:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:09:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:09:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15922.926359 secs 2023-05-08T08:09:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15923.483105 secs 2023-05-08T08:09:46.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:46 smithi186 ceph-mon[126480]: pgmap v8550: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 377 KiB/s wr, 10 op/s 2023-05-08T08:09:46.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15924.766452 secs 2023-05-08T08:09:46.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:46 smithi133 ceph-mon[125939]: pgmap v8550: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 377 KiB/s wr, 10 op/s 2023-05-08T08:09:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15924.766452 secs 2023-05-08T08:09:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:46 smithi096 ceph-mon[124666]: pgmap v8550: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 377 KiB/s wr, 10 op/s 2023-05-08T08:09:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15924.766452 secs 2023-05-08T08:09:48.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:48 smithi186 ceph-mon[126480]: pgmap v8551: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 377 KiB/s wr, 7 op/s 2023-05-08T08:09:48.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:09:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:09:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:48 smithi133 ceph-mon[125939]: pgmap v8551: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 377 KiB/s wr, 7 op/s 2023-05-08T08:09:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:09:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:09:48.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:48 smithi096 ceph-mon[124666]: pgmap v8551: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 377 KiB/s wr, 7 op/s 2023-05-08T08:09:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:09:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:09:49.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15927.926479 secs 2023-05-08T08:09:49.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15927.926479 secs 2023-05-08T08:09:49.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15927.926479 secs 2023-05-08T08:09:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:50 smithi186 ceph-mon[126480]: pgmap v8552: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 377 KiB/s wr, 7 op/s 2023-05-08T08:09:50.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:50 smithi133 ceph-mon[125939]: pgmap v8552: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 377 KiB/s wr, 7 op/s 2023-05-08T08:09:50.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:50 smithi096 ceph-mon[124666]: pgmap v8552: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 377 KiB/s wr, 7 op/s 2023-05-08T08:09:51.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15929.766570 secs 2023-05-08T08:09:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:09:51.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15929.766570 secs 2023-05-08T08:09:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:09:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15929.766570 secs 2023-05-08T08:09:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:09:52.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:52 smithi186 ceph-mon[126480]: pgmap v8553: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 477 KiB/s rd, 447 KiB/s wr, 12 op/s 2023-05-08T08:09:52.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:52 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:09:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:09:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:09:52.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:52 smithi133 ceph-mon[125939]: pgmap v8553: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 477 KiB/s rd, 447 KiB/s wr, 12 op/s 2023-05-08T08:09:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:52 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:09:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:09:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:09:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:52 smithi096 ceph-mon[124666]: pgmap v8553: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 477 KiB/s rd, 447 KiB/s wr, 12 op/s 2023-05-08T08:09:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:52 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:09:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:09:52.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:09:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:54 smithi186 ceph-mon[126480]: pgmap v8554: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 359 KiB/s wr, 9 op/s 2023-05-08T08:09:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15932.926544 secs 2023-05-08T08:09:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:54 smithi133 ceph-mon[125939]: pgmap v8554: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 359 KiB/s wr, 9 op/s 2023-05-08T08:09:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15932.926544 secs 2023-05-08T08:09:54.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:54 smithi096 ceph-mon[124666]: pgmap v8554: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 359 KiB/s wr, 9 op/s 2023-05-08T08:09:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15932.926544 secs 2023-05-08T08:09:56.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:56 smithi186 ceph-mon[126480]: pgmap v8555: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 647 KiB/s rd, 640 KiB/s wr, 15 op/s 2023-05-08T08:09:56.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15934.766687 secs 2023-05-08T08:09:56.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:56 smithi133 ceph-mon[125939]: pgmap v8555: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 647 KiB/s rd, 640 KiB/s wr, 15 op/s 2023-05-08T08:09:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15934.766687 secs 2023-05-08T08:09:56.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:56 smithi096 ceph-mon[124666]: pgmap v8555: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 647 KiB/s rd, 640 KiB/s wr, 15 op/s 2023-05-08T08:09:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15934.766687 secs 2023-05-08T08:09:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:58 smithi186 ceph-mon[126480]: pgmap v8556: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 637 KiB/s rd, 352 KiB/s wr, 11 op/s 2023-05-08T08:09:58.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:58 smithi133 ceph-mon[125939]: pgmap v8556: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 637 KiB/s rd, 352 KiB/s wr, 11 op/s 2023-05-08T08:09:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:58 smithi096 ceph-mon[124666]: pgmap v8556: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 637 KiB/s rd, 352 KiB/s wr, 11 op/s 2023-05-08T08:09:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15937.926662 secs 2023-05-08T08:09:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:09:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15938.483394 secs 2023-05-08T08:09:59.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15937.926662 secs 2023-05-08T08:09:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:09:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15938.483394 secs 2023-05-08T08:09:59.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15937.926662 secs 2023-05-08T08:09:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:09:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15938.483394 secs 2023-05-08T08:10:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:00 smithi186 ceph-mon[126480]: pgmap v8557: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 637 KiB/s rd, 352 KiB/s wr, 11 op/s 2023-05-08T08:10:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:00 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:10:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:10:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:10:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:00 smithi186 ceph-mon[126480]: overall HEALTH_WARN 3 MDSs report slow requests 2023-05-08T08:10:00.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:00 smithi133 ceph-mon[125939]: pgmap v8557: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 637 KiB/s rd, 352 KiB/s wr, 11 op/s 2023-05-08T08:10:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:00 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:10:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:10:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:10:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:00 smithi133 ceph-mon[125939]: overall HEALTH_WARN 3 MDSs report slow requests 2023-05-08T08:10:00.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:00 smithi096 ceph-mon[124666]: pgmap v8557: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 637 KiB/s rd, 352 KiB/s wr, 11 op/s 2023-05-08T08:10:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:00 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:10:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:10:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:10:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:00 smithi096 ceph-mon[124666]: overall HEALTH_WARN 3 MDSs report slow requests 2023-05-08T08:10:01.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15939.766804 secs 2023-05-08T08:10:01.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15939.766804 secs 2023-05-08T08:10:01.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15939.766804 secs 2023-05-08T08:10:02.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:02 smithi186 ceph-mon[126480]: pgmap v8558: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 713 KiB/s rd, 403 KiB/s wr, 16 op/s 2023-05-08T08:10:02.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:02 smithi133 ceph-mon[125939]: pgmap v8558: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 713 KiB/s rd, 403 KiB/s wr, 16 op/s 2023-05-08T08:10:02.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:02 smithi096 ceph-mon[124666]: pgmap v8558: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 713 KiB/s rd, 403 KiB/s wr, 16 op/s 2023-05-08T08:10:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:04 smithi186 ceph-mon[126480]: pgmap v8559: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 332 KiB/s wr, 10 op/s 2023-05-08T08:10:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15942.926800 secs 2023-05-08T08:10:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15943.483493 secs 2023-05-08T08:10:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:04 smithi133 ceph-mon[125939]: pgmap v8559: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 332 KiB/s wr, 10 op/s 2023-05-08T08:10:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15942.926800 secs 2023-05-08T08:10:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15943.483493 secs 2023-05-08T08:10:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:04 smithi096 ceph-mon[124666]: pgmap v8559: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 332 KiB/s wr, 10 op/s 2023-05-08T08:10:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15942.926800 secs 2023-05-08T08:10:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15943.483493 secs 2023-05-08T08:10:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:06 smithi186 ceph-mon[126480]: pgmap v8560: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 431 KiB/s wr, 28 op/s 2023-05-08T08:10:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15944.766908 secs 2023-05-08T08:10:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:06 smithi186 ceph-mon[126480]: osdmap e612: 12 total, 12 up, 12 in 2023-05-08T08:10:06.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:06 smithi133 ceph-mon[125939]: pgmap v8560: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 431 KiB/s wr, 28 op/s 2023-05-08T08:10:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15944.766908 secs 2023-05-08T08:10:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:06 smithi133 ceph-mon[125939]: osdmap e612: 12 total, 12 up, 12 in 2023-05-08T08:10:06.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:06 smithi096 ceph-mon[124666]: pgmap v8560: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 431 KiB/s wr, 28 op/s 2023-05-08T08:10:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15944.766908 secs 2023-05-08T08:10:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:06 smithi096 ceph-mon[124666]: osdmap e612: 12 total, 12 up, 12 in 2023-05-08T08:10:08.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:08 smithi133 ceph-mon[125939]: pgmap v8562: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 179 KiB/s wr, 26 op/s 2023-05-08T08:10:08.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:08 smithi096 ceph-mon[124666]: pgmap v8562: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 179 KiB/s wr, 26 op/s 2023-05-08T08:10:08.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:08 smithi186 ceph-mon[126480]: pgmap v8562: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 179 KiB/s wr, 26 op/s 2023-05-08T08:10:09.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15947.926942 secs 2023-05-08T08:10:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15948.483587 secs 2023-05-08T08:10:09.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15947.926942 secs 2023-05-08T08:10:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15948.483587 secs 2023-05-08T08:10:09.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15947.926942 secs 2023-05-08T08:10:09.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15948.483587 secs 2023-05-08T08:10:10.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:10 smithi133 ceph-mon[125939]: pgmap v8563: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 179 KiB/s wr, 26 op/s 2023-05-08T08:10:10.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:10 smithi096 ceph-mon[124666]: pgmap v8563: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 179 KiB/s wr, 26 op/s 2023-05-08T08:10:10.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:10 smithi186 ceph-mon[126480]: pgmap v8563: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 179 KiB/s wr, 26 op/s 2023-05-08T08:10:11.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15949.767033 secs 2023-05-08T08:10:11.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15949.767033 secs 2023-05-08T08:10:11.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15949.767033 secs 2023-05-08T08:10:12.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:12 smithi133 ceph-mon[125939]: pgmap v8564: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 118 KiB/s wr, 25 op/s 2023-05-08T08:10:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:12 smithi133 ceph-mon[125939]: osdmap e613: 12 total, 12 up, 12 in 2023-05-08T08:10:12.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:12 smithi096 ceph-mon[124666]: pgmap v8564: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 118 KiB/s wr, 25 op/s 2023-05-08T08:10:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:12 smithi096 ceph-mon[124666]: osdmap e613: 12 total, 12 up, 12 in 2023-05-08T08:10:12.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:12 smithi186 ceph-mon[126480]: pgmap v8564: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 118 KiB/s wr, 25 op/s 2023-05-08T08:10:12.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:12 smithi186 ceph-mon[126480]: osdmap e613: 12 total, 12 up, 12 in 2023-05-08T08:10:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:14 smithi133 ceph-mon[125939]: pgmap v8566: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 895 B/s wr, 4 op/s 2023-05-08T08:10:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15952.927050 secs 2023-05-08T08:10:14.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15953.483708 secs 2023-05-08T08:10:14.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:14 smithi096 ceph-mon[124666]: pgmap v8566: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 895 B/s wr, 4 op/s 2023-05-08T08:10:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15952.927050 secs 2023-05-08T08:10:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15953.483708 secs 2023-05-08T08:10:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:14 smithi186 ceph-mon[126480]: pgmap v8566: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 895 B/s wr, 4 op/s 2023-05-08T08:10:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15952.927050 secs 2023-05-08T08:10:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15953.483708 secs 2023-05-08T08:10:16.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:16 smithi133 ceph-mon[125939]: pgmap v8567: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 89 KiB/s wr, 7 op/s 2023-05-08T08:10:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15954.767147 secs 2023-05-08T08:10:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:16 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:10:16.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:16 smithi096 ceph-mon[124666]: pgmap v8567: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 89 KiB/s wr, 7 op/s 2023-05-08T08:10:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15954.767147 secs 2023-05-08T08:10:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:16 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:10:16.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:16 smithi186 ceph-mon[126480]: pgmap v8567: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 89 KiB/s wr, 7 op/s 2023-05-08T08:10:16.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15954.767147 secs 2023-05-08T08:10:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:16 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:10:17.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:17 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:10:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:17 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:10:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:17 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:10:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:17 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:10:17.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:17 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:10:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:17 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:10:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:17 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:10:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:17 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:10:17.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:17 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:10:17.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:17 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:10:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:17 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:10:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:17 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:10:18.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:18 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T08:10:18.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:18 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T08:10:18.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:18 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:10:18.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:18 smithi133 ceph-mon[125939]: pgmap v8568: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 86 KiB/s wr, 7 op/s 2023-05-08T08:10:18.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:18 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T08:10:18.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:18 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T08:10:18.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:18 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:10:18.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:18 smithi096 ceph-mon[124666]: pgmap v8568: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 86 KiB/s wr, 7 op/s 2023-05-08T08:10:18.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:18 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T08:10:18.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:18 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T08:10:18.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:18 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:10:18.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:18 smithi186 ceph-mon[126480]: pgmap v8568: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 86 KiB/s wr, 7 op/s 2023-05-08T08:10:19.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15957.927204 secs 2023-05-08T08:10:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15958.483815 secs 2023-05-08T08:10:19.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15957.927204 secs 2023-05-08T08:10:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15958.483815 secs 2023-05-08T08:10:19.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15957.927204 secs 2023-05-08T08:10:19.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15958.483815 secs 2023-05-08T08:10:20.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:20 smithi133 ceph-mon[125939]: pgmap v8569: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 86 KiB/s wr, 7 op/s 2023-05-08T08:10:20.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:20 smithi096 ceph-mon[124666]: pgmap v8569: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 86 KiB/s wr, 7 op/s 2023-05-08T08:10:20.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:20 smithi186 ceph-mon[126480]: pgmap v8569: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 86 KiB/s wr, 7 op/s 2023-05-08T08:10:21.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15959.767270 secs 2023-05-08T08:10:21.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15959.767270 secs 2023-05-08T08:10:21.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15959.767270 secs 2023-05-08T08:10:22.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:22 smithi133 ceph-mon[125939]: pgmap v8570: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 86 KiB/s wr, 6 op/s 2023-05-08T08:10:22.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:22 smithi096 ceph-mon[124666]: pgmap v8570: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 86 KiB/s wr, 6 op/s 2023-05-08T08:10:22.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:22 smithi186 ceph-mon[126480]: pgmap v8570: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 86 KiB/s wr, 6 op/s 2023-05-08T08:10:24.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:24 smithi133 ceph-mon[125939]: pgmap v8571: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 78 KiB/s wr, 6 op/s 2023-05-08T08:10:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15962.927368 secs 2023-05-08T08:10:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15963.483956 secs 2023-05-08T08:10:24.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:24 smithi096 ceph-mon[124666]: pgmap v8571: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 78 KiB/s wr, 6 op/s 2023-05-08T08:10:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15962.927368 secs 2023-05-08T08:10:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15963.483956 secs 2023-05-08T08:10:24.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:24 smithi186 ceph-mon[126480]: pgmap v8571: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 78 KiB/s wr, 6 op/s 2023-05-08T08:10:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15962.927368 secs 2023-05-08T08:10:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15963.483956 secs 2023-05-08T08:10:26.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:26 smithi133 ceph-mon[125939]: pgmap v8572: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 72 KiB/s wr, 8 op/s 2023-05-08T08:10:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15964.767364 secs 2023-05-08T08:10:26.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:26 smithi096 ceph-mon[124666]: pgmap v8572: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 72 KiB/s wr, 8 op/s 2023-05-08T08:10:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15964.767364 secs 2023-05-08T08:10:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:26 smithi186 ceph-mon[126480]: pgmap v8572: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 72 KiB/s wr, 8 op/s 2023-05-08T08:10:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15964.767364 secs 2023-05-08T08:10:28.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:28 smithi133 ceph-mon[125939]: pgmap v8573: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T08:10:28.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:28 smithi096 ceph-mon[124666]: pgmap v8573: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T08:10:28.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:28 smithi186 ceph-mon[126480]: pgmap v8573: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T08:10:29.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15967.927463 secs 2023-05-08T08:10:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15968.484092 secs 2023-05-08T08:10:29.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15967.927463 secs 2023-05-08T08:10:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15968.484092 secs 2023-05-08T08:10:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15967.927463 secs 2023-05-08T08:10:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15968.484092 secs 2023-05-08T08:10:30.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:30 smithi133 ceph-mon[125939]: pgmap v8574: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T08:10:30.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:30 smithi096 ceph-mon[124666]: pgmap v8574: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T08:10:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:30 smithi186 ceph-mon[126480]: pgmap v8574: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T08:10:31.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15969.767462 secs 2023-05-08T08:10:31.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15969.767462 secs 2023-05-08T08:10:31.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15969.767462 secs 2023-05-08T08:10:32.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:32 smithi133 ceph-mon[125939]: pgmap v8575: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 54 KiB/s wr, 9 op/s 2023-05-08T08:10:32.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:32 smithi096 ceph-mon[124666]: pgmap v8575: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 54 KiB/s wr, 9 op/s 2023-05-08T08:10:32.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:32 smithi186 ceph-mon[126480]: pgmap v8575: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 54 KiB/s wr, 9 op/s 2023-05-08T08:10:33.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:33 smithi133 ceph-mon[125939]: pgmap v8576: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 6 op/s 2023-05-08T08:10:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:33 smithi096 ceph-mon[124666]: pgmap v8576: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 6 op/s 2023-05-08T08:10:33.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:33 smithi186 ceph-mon[126480]: pgmap v8576: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 6 op/s 2023-05-08T08:10:34.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15972.927530 secs 2023-05-08T08:10:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15973.484230 secs 2023-05-08T08:10:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15972.927530 secs 2023-05-08T08:10:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15973.484230 secs 2023-05-08T08:10:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15972.927530 secs 2023-05-08T08:10:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15973.484230 secs 2023-05-08T08:10:35.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:35 smithi133 ceph-mon[125939]: pgmap v8577: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 55 KiB/s wr, 9 op/s 2023-05-08T08:10:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15974.767583 secs 2023-05-08T08:10:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:35 smithi096 ceph-mon[124666]: pgmap v8577: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 55 KiB/s wr, 9 op/s 2023-05-08T08:10:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15974.767583 secs 2023-05-08T08:10:35.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:35 smithi186 ceph-mon[126480]: pgmap v8577: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 55 KiB/s wr, 9 op/s 2023-05-08T08:10:35.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15974.767583 secs 2023-05-08T08:10:38.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:37 smithi133 ceph-mon[125939]: pgmap v8578: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 6 op/s 2023-05-08T08:10:38.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:37 smithi096 ceph-mon[124666]: pgmap v8578: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 6 op/s 2023-05-08T08:10:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:37 smithi186 ceph-mon[126480]: pgmap v8578: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 6 op/s 2023-05-08T08:10:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15977.927654 secs 2023-05-08T08:10:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15978.484338 secs 2023-05-08T08:10:39.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15977.927654 secs 2023-05-08T08:10:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15978.484338 secs 2023-05-08T08:10:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15977.927654 secs 2023-05-08T08:10:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15978.484338 secs 2023-05-08T08:10:40.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:39 smithi133 ceph-mon[125939]: pgmap v8579: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 6 op/s 2023-05-08T08:10:40.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:39 smithi096 ceph-mon[124666]: pgmap v8579: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 6 op/s 2023-05-08T08:10:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:39 smithi186 ceph-mon[126480]: pgmap v8579: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 6 op/s 2023-05-08T08:10:42.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:41 smithi133 ceph-mon[125939]: pgmap v8580: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 54 KiB/s wr, 9 op/s 2023-05-08T08:10:42.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:41 smithi096 ceph-mon[124666]: pgmap v8580: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 54 KiB/s wr, 9 op/s 2023-05-08T08:10:42.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:41 smithi186 ceph-mon[126480]: pgmap v8580: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 54 KiB/s wr, 9 op/s 2023-05-08T08:10:43.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:10:43.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:10:43.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:10:44.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:43 smithi133 ceph-mon[125939]: pgmap v8581: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T08:10:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:43 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:10:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:10:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:10:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15982.927799 secs 2023-05-08T08:10:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15983.484488 secs 2023-05-08T08:10:44.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:43 smithi096 ceph-mon[124666]: pgmap v8581: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T08:10:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:43 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:10:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:10:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:10:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15982.927799 secs 2023-05-08T08:10:44.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15983.484488 secs 2023-05-08T08:10:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:43 smithi186 ceph-mon[126480]: pgmap v8581: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T08:10:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:43 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:10:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:10:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:10:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15982.927799 secs 2023-05-08T08:10:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15983.484488 secs 2023-05-08T08:10:46.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:45 smithi133 ceph-mon[125939]: pgmap v8582: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 58 KiB/s wr, 8 op/s 2023-05-08T08:10:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15984.767816 secs 2023-05-08T08:10:46.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:45 smithi096 ceph-mon[124666]: pgmap v8582: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 58 KiB/s wr, 8 op/s 2023-05-08T08:10:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15984.767816 secs 2023-05-08T08:10:46.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:45 smithi186 ceph-mon[126480]: pgmap v8582: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 58 KiB/s wr, 8 op/s 2023-05-08T08:10:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15984.767816 secs 2023-05-08T08:10:48.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:47 smithi133 ceph-mon[125939]: pgmap v8583: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 5 op/s 2023-05-08T08:10:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:47 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:10:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:47 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:10:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:47 smithi096 ceph-mon[124666]: pgmap v8583: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 5 op/s 2023-05-08T08:10:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:47 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:10:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:47 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:10:48.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:47 smithi186 ceph-mon[126480]: pgmap v8583: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 5 op/s 2023-05-08T08:10:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:47 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:10:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:47 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:10:49.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15987.927930 secs 2023-05-08T08:10:49.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15987.927930 secs 2023-05-08T08:10:49.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15987.927930 secs 2023-05-08T08:10:50.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:49 smithi133 ceph-mon[125939]: pgmap v8584: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 5 op/s 2023-05-08T08:10:50.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:49 smithi096 ceph-mon[124666]: pgmap v8584: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 5 op/s 2023-05-08T08:10:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:49 smithi186 ceph-mon[126480]: pgmap v8584: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 5 op/s 2023-05-08T08:10:51.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15989.767946 secs 2023-05-08T08:10:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15989.767946 secs 2023-05-08T08:10:51.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15989.767946 secs 2023-05-08T08:10:52.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:51 smithi133 ceph-mon[125939]: pgmap v8585: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 292 KiB/s rd, 289 KiB/s wr, 10 op/s 2023-05-08T08:10:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:10:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:51 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:10:52.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:51 smithi096 ceph-mon[124666]: pgmap v8585: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 292 KiB/s rd, 289 KiB/s wr, 10 op/s 2023-05-08T08:10:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:10:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:51 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:10:52.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:51 smithi186 ceph-mon[126480]: pgmap v8585: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 292 KiB/s rd, 289 KiB/s wr, 10 op/s 2023-05-08T08:10:52.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:10:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:51 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:10:53.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:10:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:10:53.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:10:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:10:53.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:10:53.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:10:54.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:53 smithi133 ceph-mon[125939]: pgmap v8586: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 290 KiB/s rd, 289 KiB/s wr, 7 op/s 2023-05-08T08:10:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15992.928060 secs 2023-05-08T08:10:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15993.484687 secs 2023-05-08T08:10:54.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:53 smithi096 ceph-mon[124666]: pgmap v8586: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 290 KiB/s rd, 289 KiB/s wr, 7 op/s 2023-05-08T08:10:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15992.928060 secs 2023-05-08T08:10:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15993.484687 secs 2023-05-08T08:10:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:53 smithi186 ceph-mon[126480]: pgmap v8586: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 290 KiB/s rd, 289 KiB/s wr, 7 op/s 2023-05-08T08:10:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15992.928060 secs 2023-05-08T08:10:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15993.484687 secs 2023-05-08T08:10:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:55 smithi133 ceph-mon[125939]: pgmap v8587: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 482 KiB/s rd, 468 KiB/s wr, 13 op/s 2023-05-08T08:10:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:55 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:10:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:55 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:10:56.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:55 smithi096 ceph-mon[124666]: pgmap v8587: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 482 KiB/s rd, 468 KiB/s wr, 13 op/s 2023-05-08T08:10:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:55 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:10:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:55 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:10:56.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:55 smithi186 ceph-mon[126480]: pgmap v8587: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 482 KiB/s rd, 468 KiB/s wr, 13 op/s 2023-05-08T08:10:56.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:55 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:10:56.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:55 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:10:58.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:57 smithi133 ceph-mon[125939]: pgmap v8588: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 411 KiB/s wr, 10 op/s 2023-05-08T08:10:58.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:57 smithi096 ceph-mon[124666]: pgmap v8588: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 411 KiB/s wr, 10 op/s 2023-05-08T08:10:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:57 smithi186 ceph-mon[126480]: pgmap v8588: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 411 KiB/s wr, 10 op/s 2023-05-08T08:10:59.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 15997.928181 secs 2023-05-08T08:10:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:58 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:10:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:58 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:10:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 15997.928181 secs 2023-05-08T08:10:59.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:58 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:10:59.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:58 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:10:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 15997.928181 secs 2023-05-08T08:10:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:58 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:10:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:58 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:11:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:59 smithi096 ceph-mon[124666]: pgmap v8589: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 411 KiB/s wr, 10 op/s 2023-05-08T08:11:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:59 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:11:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:59 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:11:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:59 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:11:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:10:59 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:11:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:59 smithi186 ceph-mon[126480]: pgmap v8589: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 411 KiB/s wr, 10 op/s 2023-05-08T08:11:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:59 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:11:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:59 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:11:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:59 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:11:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:10:59 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:11:00.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:59 smithi133 ceph-mon[125939]: pgmap v8589: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 411 KiB/s wr, 10 op/s 2023-05-08T08:11:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:59 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:11:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:59 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:11:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:59 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:11:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:10:59 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:11:02.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:01 smithi096 ceph-mon[124666]: pgmap v8590: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 505 KiB/s rd, 492 KiB/s wr, 15 op/s 2023-05-08T08:11:02.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:01 smithi186 ceph-mon[126480]: pgmap v8590: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 505 KiB/s rd, 492 KiB/s wr, 15 op/s 2023-05-08T08:11:02.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:01 smithi133 ceph-mon[125939]: pgmap v8590: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 505 KiB/s rd, 492 KiB/s wr, 15 op/s 2023-05-08T08:11:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:04 smithi096 ceph-mon[124666]: pgmap v8591: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 261 KiB/s wr, 10 op/s 2023-05-08T08:11:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16002.928316 secs 2023-05-08T08:11:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16003.484886 secs 2023-05-08T08:11:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:04 smithi186 ceph-mon[126480]: pgmap v8591: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 261 KiB/s wr, 10 op/s 2023-05-08T08:11:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16002.928316 secs 2023-05-08T08:11:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16003.484886 secs 2023-05-08T08:11:04.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:04 smithi133 ceph-mon[125939]: pgmap v8591: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 261 KiB/s wr, 10 op/s 2023-05-08T08:11:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16002.928316 secs 2023-05-08T08:11:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16003.484886 secs 2023-05-08T08:11:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:06 smithi186 ceph-mon[126480]: pgmap v8592: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 484 KiB/s wr, 30 op/s 2023-05-08T08:11:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16004.768276 secs 2023-05-08T08:11:06.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:06 smithi133 ceph-mon[125939]: pgmap v8592: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 484 KiB/s wr, 30 op/s 2023-05-08T08:11:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16004.768276 secs 2023-05-08T08:11:06.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:06 smithi096 ceph-mon[124666]: pgmap v8592: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 484 KiB/s wr, 30 op/s 2023-05-08T08:11:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16004.768276 secs 2023-05-08T08:11:07.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:07 smithi186 ceph-mon[126480]: osdmap e614: 12 total, 12 up, 12 in 2023-05-08T08:11:07.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:07 smithi133 ceph-mon[125939]: osdmap e614: 12 total, 12 up, 12 in 2023-05-08T08:11:07.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:07 smithi096 ceph-mon[124666]: osdmap e614: 12 total, 12 up, 12 in 2023-05-08T08:11:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:08 smithi186 ceph-mon[126480]: pgmap v8594: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 324 KiB/s rd, 365 KiB/s wr, 29 op/s 2023-05-08T08:11:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:08 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:11:08.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:11:08.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:11:08.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:11:08.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:08 smithi133 ceph-mon[125939]: pgmap v8594: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 324 KiB/s rd, 365 KiB/s wr, 29 op/s 2023-05-08T08:11:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:08 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:11:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:11:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:11:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:11:08.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:08 smithi096 ceph-mon[124666]: pgmap v8594: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 324 KiB/s rd, 365 KiB/s wr, 29 op/s 2023-05-08T08:11:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:08 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:11:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:11:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:11:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:11:09.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16007.928407 secs 2023-05-08T08:11:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16008.485035 secs 2023-05-08T08:11:09.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16007.928407 secs 2023-05-08T08:11:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16008.485035 secs 2023-05-08T08:11:09.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16007.928407 secs 2023-05-08T08:11:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16008.485035 secs 2023-05-08T08:11:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:10 smithi186 ceph-mon[126480]: pgmap v8595: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 324 KiB/s rd, 365 KiB/s wr, 29 op/s 2023-05-08T08:11:10.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:10 smithi133 ceph-mon[125939]: pgmap v8595: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 324 KiB/s rd, 365 KiB/s wr, 29 op/s 2023-05-08T08:11:10.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:10 smithi096 ceph-mon[124666]: pgmap v8595: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 324 KiB/s rd, 365 KiB/s wr, 29 op/s 2023-05-08T08:11:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16009.768408 secs 2023-05-08T08:11:11.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16009.768408 secs 2023-05-08T08:11:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16009.768408 secs 2023-05-08T08:11:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:12 smithi186 ceph-mon[126480]: pgmap v8596: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 288 KiB/s rd, 329 KiB/s wr, 28 op/s 2023-05-08T08:11:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:12 smithi186 ceph-mon[126480]: osdmap e615: 12 total, 12 up, 12 in 2023-05-08T08:11:12.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:12 smithi133 ceph-mon[125939]: pgmap v8596: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 288 KiB/s rd, 329 KiB/s wr, 28 op/s 2023-05-08T08:11:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:12 smithi133 ceph-mon[125939]: osdmap e615: 12 total, 12 up, 12 in 2023-05-08T08:11:12.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:12 smithi096 ceph-mon[124666]: pgmap v8596: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 288 KiB/s rd, 329 KiB/s wr, 28 op/s 2023-05-08T08:11:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:12 smithi096 ceph-mon[124666]: osdmap e615: 12 total, 12 up, 12 in 2023-05-08T08:11:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:14 smithi186 ceph-mon[126480]: pgmap v8598: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 77 KiB/s wr, 5 op/s 2023-05-08T08:11:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16012.928525 secs 2023-05-08T08:11:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16013.485155 secs 2023-05-08T08:11:14.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:14 smithi133 ceph-mon[125939]: pgmap v8598: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 77 KiB/s wr, 5 op/s 2023-05-08T08:11:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16012.928525 secs 2023-05-08T08:11:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16013.485155 secs 2023-05-08T08:11:14.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:14 smithi096 ceph-mon[124666]: pgmap v8598: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 77 KiB/s wr, 5 op/s 2023-05-08T08:11:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16012.928525 secs 2023-05-08T08:11:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16013.485155 secs 2023-05-08T08:11:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:16 smithi186 ceph-mon[126480]: pgmap v8599: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 120 KiB/s wr, 8 op/s 2023-05-08T08:11:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16014.768527 secs 2023-05-08T08:11:16.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:16 smithi133 ceph-mon[125939]: pgmap v8599: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 120 KiB/s wr, 8 op/s 2023-05-08T08:11:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16014.768527 secs 2023-05-08T08:11:16.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:16 smithi096 ceph-mon[124666]: pgmap v8599: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 120 KiB/s wr, 8 op/s 2023-05-08T08:11:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16014.768527 secs 2023-05-08T08:11:17.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:17 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:11:17.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:17 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:11:17.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:17 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:11:17.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:17 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:11:17.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:17 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:11:17.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:17 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:11:17.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:17 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:11:17.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:17 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:11:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:17 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:11:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:17 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:11:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:17 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:11:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:17 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:11:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:17 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:11:17.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:17 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:11:17.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:17 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:11:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:17 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:11:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:17 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:11:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:17 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:11:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:17 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:11:17.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:17 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:11:17.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:17 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:11:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:18 smithi186 ceph-mon[126480]: pgmap v8600: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 106 KiB/s wr, 7 op/s 2023-05-08T08:11:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:11:18.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:11:18.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:11:18.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:18 smithi133 ceph-mon[125939]: pgmap v8600: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 106 KiB/s wr, 7 op/s 2023-05-08T08:11:18.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:11:18.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:11:18.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:11:18.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:18 smithi096 ceph-mon[124666]: pgmap v8600: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 106 KiB/s wr, 7 op/s 2023-05-08T08:11:18.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:11:18.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:11:18.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:11:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:19 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:11:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:19 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T08:11:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:19 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T08:11:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:19 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:11:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16017.928661 secs 2023-05-08T08:11:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16018.485267 secs 2023-05-08T08:11:19.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:19 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:11:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:19 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T08:11:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:19 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T08:11:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:19 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:11:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16017.928661 secs 2023-05-08T08:11:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16018.485267 secs 2023-05-08T08:11:19.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:19 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:11:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:19 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T08:11:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:19 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T08:11:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:19 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:11:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16017.928661 secs 2023-05-08T08:11:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16018.485267 secs 2023-05-08T08:11:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:20 smithi186 ceph-mon[126480]: pgmap v8601: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 106 KiB/s wr, 7 op/s 2023-05-08T08:11:20.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:20 smithi133 ceph-mon[125939]: pgmap v8601: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 106 KiB/s wr, 7 op/s 2023-05-08T08:11:20.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:20 smithi096 ceph-mon[124666]: pgmap v8601: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 106 KiB/s wr, 7 op/s 2023-05-08T08:11:21.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16019.768645 secs 2023-05-08T08:11:21.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16019.768645 secs 2023-05-08T08:11:21.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16019.768645 secs 2023-05-08T08:11:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:22 smithi186 ceph-mon[126480]: pgmap v8602: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 44 KiB/s wr, 6 op/s 2023-05-08T08:11:22.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:22 smithi133 ceph-mon[125939]: pgmap v8602: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 44 KiB/s wr, 6 op/s 2023-05-08T08:11:22.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:22 smithi096 ceph-mon[124666]: pgmap v8602: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 44 KiB/s wr, 6 op/s 2023-05-08T08:11:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:24 smithi186 ceph-mon[126480]: pgmap v8603: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 41 KiB/s wr, 5 op/s 2023-05-08T08:11:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16022.928727 secs 2023-05-08T08:11:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16023.485416 secs 2023-05-08T08:11:24.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:24 smithi133 ceph-mon[125939]: pgmap v8603: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 41 KiB/s wr, 5 op/s 2023-05-08T08:11:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16022.928727 secs 2023-05-08T08:11:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16023.485416 secs 2023-05-08T08:11:24.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:24 smithi096 ceph-mon[124666]: pgmap v8603: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 41 KiB/s wr, 5 op/s 2023-05-08T08:11:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16022.928727 secs 2023-05-08T08:11:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16023.485416 secs 2023-05-08T08:11:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:26 smithi186 ceph-mon[126480]: pgmap v8604: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 37 KiB/s wr, 7 op/s 2023-05-08T08:11:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16024.768759 secs 2023-05-08T08:11:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:26 smithi133 ceph-mon[125939]: pgmap v8604: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 37 KiB/s wr, 7 op/s 2023-05-08T08:11:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16024.768759 secs 2023-05-08T08:11:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:26 smithi096 ceph-mon[124666]: pgmap v8604: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 37 KiB/s wr, 7 op/s 2023-05-08T08:11:26.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16024.768759 secs 2023-05-08T08:11:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:28 smithi186 ceph-mon[126480]: pgmap v8605: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T08:11:28.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:28 smithi133 ceph-mon[125939]: pgmap v8605: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T08:11:28.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:28 smithi096 ceph-mon[124666]: pgmap v8605: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T08:11:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16027.928846 secs 2023-05-08T08:11:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16028.485531 secs 2023-05-08T08:11:29.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16027.928846 secs 2023-05-08T08:11:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16028.485531 secs 2023-05-08T08:11:29.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16027.928846 secs 2023-05-08T08:11:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16028.485531 secs 2023-05-08T08:11:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:30 smithi186 ceph-mon[126480]: pgmap v8606: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T08:11:30.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:30 smithi133 ceph-mon[125939]: pgmap v8606: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T08:11:30.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:30 smithi096 ceph-mon[124666]: pgmap v8606: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T08:11:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16029.768822 secs 2023-05-08T08:11:31.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16029.768822 secs 2023-05-08T08:11:31.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16029.768822 secs 2023-05-08T08:11:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:32 smithi186 ceph-mon[126480]: pgmap v8607: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 426 B/s wr, 7 op/s 2023-05-08T08:11:32.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:32 smithi133 ceph-mon[125939]: pgmap v8607: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 426 B/s wr, 7 op/s 2023-05-08T08:11:32.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:32 smithi096 ceph-mon[124666]: pgmap v8607: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 426 B/s wr, 7 op/s 2023-05-08T08:11:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:34 smithi186 ceph-mon[126480]: pgmap v8608: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T08:11:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16032.928945 secs 2023-05-08T08:11:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16033.485623 secs 2023-05-08T08:11:34.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:34 smithi133 ceph-mon[125939]: pgmap v8608: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T08:11:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16032.928945 secs 2023-05-08T08:11:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16033.485623 secs 2023-05-08T08:11:34.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:34 smithi096 ceph-mon[124666]: pgmap v8608: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T08:11:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16032.928945 secs 2023-05-08T08:11:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16033.485623 secs 2023-05-08T08:11:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:36 smithi186 ceph-mon[126480]: pgmap v8609: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 98 KiB/s wr, 9 op/s 2023-05-08T08:11:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16034.768958 secs 2023-05-08T08:11:36.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:36 smithi133 ceph-mon[125939]: pgmap v8609: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 98 KiB/s wr, 9 op/s 2023-05-08T08:11:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16034.768958 secs 2023-05-08T08:11:36.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:36 smithi096 ceph-mon[124666]: pgmap v8609: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 98 KiB/s wr, 9 op/s 2023-05-08T08:11:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16034.768958 secs 2023-05-08T08:11:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:38 smithi186 ceph-mon[126480]: pgmap v8610: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 98 KiB/s wr, 6 op/s 2023-05-08T08:11:38.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:38 smithi133 ceph-mon[125939]: pgmap v8610: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 98 KiB/s wr, 6 op/s 2023-05-08T08:11:38.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:38 smithi096 ceph-mon[124666]: pgmap v8610: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 98 KiB/s wr, 6 op/s 2023-05-08T08:11:39.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16037.929068 secs 2023-05-08T08:11:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16038.485733 secs 2023-05-08T08:11:39.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16037.929068 secs 2023-05-08T08:11:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16038.485733 secs 2023-05-08T08:11:39.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16037.929068 secs 2023-05-08T08:11:39.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16038.485733 secs 2023-05-08T08:11:40.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:40 smithi133 ceph-mon[125939]: pgmap v8611: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 98 KiB/s wr, 6 op/s 2023-05-08T08:11:40.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:40 smithi096 ceph-mon[124666]: pgmap v8611: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 98 KiB/s wr, 6 op/s 2023-05-08T08:11:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:40 smithi186 ceph-mon[126480]: pgmap v8611: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 98 KiB/s wr, 6 op/s 2023-05-08T08:11:42.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:42 smithi133 ceph-mon[125939]: pgmap v8612: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 112 KiB/s wr, 10 op/s 2023-05-08T08:11:42.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:42 smithi096 ceph-mon[124666]: pgmap v8612: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 112 KiB/s wr, 10 op/s 2023-05-08T08:11:42.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:42 smithi186 ceph-mon[126480]: pgmap v8612: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 112 KiB/s wr, 10 op/s 2023-05-08T08:11:43.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:11:43.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:11:43.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:11:44.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:44 smithi133 ceph-mon[125939]: pgmap v8613: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 111 KiB/s wr, 7 op/s 2023-05-08T08:11:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:11:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:11:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:11:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16042.929188 secs 2023-05-08T08:11:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16043.485855 secs 2023-05-08T08:11:44.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:44 smithi096 ceph-mon[124666]: pgmap v8613: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 111 KiB/s wr, 7 op/s 2023-05-08T08:11:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:11:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:11:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:11:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16042.929188 secs 2023-05-08T08:11:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16043.485855 secs 2023-05-08T08:11:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:44 smithi186 ceph-mon[126480]: pgmap v8613: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 111 KiB/s wr, 7 op/s 2023-05-08T08:11:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:11:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:11:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:11:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16042.929188 secs 2023-05-08T08:11:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16043.485855 secs 2023-05-08T08:11:46.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:46 smithi133 ceph-mon[125939]: pgmap v8614: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 228 KiB/s wr, 10 op/s 2023-05-08T08:11:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16044.769179 secs 2023-05-08T08:11:46.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:46 smithi096 ceph-mon[124666]: pgmap v8614: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 228 KiB/s wr, 10 op/s 2023-05-08T08:11:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16044.769179 secs 2023-05-08T08:11:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:46 smithi186 ceph-mon[126480]: pgmap v8614: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 228 KiB/s wr, 10 op/s 2023-05-08T08:11:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16044.769179 secs 2023-05-08T08:11:48.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:48 smithi133 ceph-mon[125939]: pgmap v8615: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 130 KiB/s wr, 7 op/s 2023-05-08T08:11:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:11:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:11:48.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:48 smithi096 ceph-mon[124666]: pgmap v8615: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 130 KiB/s wr, 7 op/s 2023-05-08T08:11:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:11:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:11:48.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:48 smithi186 ceph-mon[126480]: pgmap v8615: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 130 KiB/s wr, 7 op/s 2023-05-08T08:11:48.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:11:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:11:49.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16047.929316 secs 2023-05-08T08:11:49.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16047.929316 secs 2023-05-08T08:11:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16047.929316 secs 2023-05-08T08:11:50.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:50 smithi133 ceph-mon[125939]: pgmap v8616: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 130 KiB/s wr, 7 op/s 2023-05-08T08:11:50.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:50 smithi096 ceph-mon[124666]: pgmap v8616: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 130 KiB/s wr, 7 op/s 2023-05-08T08:11:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:50 smithi186 ceph-mon[126480]: pgmap v8616: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 130 KiB/s wr, 7 op/s 2023-05-08T08:11:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16049.769299 secs 2023-05-08T08:11:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:11:51.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16049.769299 secs 2023-05-08T08:11:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:11:51.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16049.769299 secs 2023-05-08T08:11:51.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:11:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:52 smithi133 ceph-mon[125939]: pgmap v8617: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 333 KiB/s rd, 291 KiB/s wr, 11 op/s 2023-05-08T08:11:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:52 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:11:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:11:52.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:11:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:52 smithi096 ceph-mon[124666]: pgmap v8617: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 333 KiB/s rd, 291 KiB/s wr, 11 op/s 2023-05-08T08:11:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:52 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:11:52.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:11:52.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:11:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:52 smithi186 ceph-mon[126480]: pgmap v8617: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 333 KiB/s rd, 291 KiB/s wr, 11 op/s 2023-05-08T08:11:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:52 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:11:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:11:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:11:54.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:54 smithi133 ceph-mon[125939]: pgmap v8618: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 292 KiB/s rd, 277 KiB/s wr, 7 op/s 2023-05-08T08:11:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16052.929360 secs 2023-05-08T08:11:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16053.486094 secs 2023-05-08T08:11:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:54 smithi096 ceph-mon[124666]: pgmap v8618: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 292 KiB/s rd, 277 KiB/s wr, 7 op/s 2023-05-08T08:11:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16052.929360 secs 2023-05-08T08:11:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16053.486094 secs 2023-05-08T08:11:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:54 smithi186 ceph-mon[126480]: pgmap v8618: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 292 KiB/s rd, 277 KiB/s wr, 7 op/s 2023-05-08T08:11:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16052.929360 secs 2023-05-08T08:11:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16053.486094 secs 2023-05-08T08:11:56.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:56 smithi133 ceph-mon[125939]: pgmap v8619: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 557 KiB/s rd, 530 KiB/s wr, 14 op/s 2023-05-08T08:11:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:11:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:11:56.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:56 smithi096 ceph-mon[124666]: pgmap v8619: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 557 KiB/s rd, 530 KiB/s wr, 14 op/s 2023-05-08T08:11:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:11:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:11:56.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:56 smithi186 ceph-mon[126480]: pgmap v8619: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 557 KiB/s rd, 530 KiB/s wr, 14 op/s 2023-05-08T08:11:56.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:11:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:11:57.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:57 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:11:57.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:57 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:11:57.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:57 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:11:58.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:58 smithi133 ceph-mon[125939]: pgmap v8620: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 413 KiB/s wr, 11 op/s 2023-05-08T08:11:58.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:58 smithi096 ceph-mon[124666]: pgmap v8620: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 413 KiB/s wr, 11 op/s 2023-05-08T08:11:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:58 smithi186 ceph-mon[126480]: pgmap v8620: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 413 KiB/s wr, 11 op/s 2023-05-08T08:11:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16057.929485 secs 2023-05-08T08:11:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:59 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:11:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:11:59 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:11:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16057.929485 secs 2023-05-08T08:11:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:59 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:11:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:11:59 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:11:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16057.929485 secs 2023-05-08T08:11:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:59 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:11:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:11:59 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:12:00.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:00 smithi133 ceph-mon[125939]: pgmap v8621: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 413 KiB/s wr, 11 op/s 2023-05-08T08:12:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:12:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:12:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:12:00.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:00 smithi096 ceph-mon[124666]: pgmap v8621: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 413 KiB/s wr, 11 op/s 2023-05-08T08:12:00.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:12:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:12:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:12:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:00 smithi186 ceph-mon[126480]: pgmap v8621: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 413 KiB/s wr, 11 op/s 2023-05-08T08:12:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:12:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:12:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:12:02.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:02 smithi133 ceph-mon[125939]: pgmap v8622: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 494 KiB/s wr, 15 op/s 2023-05-08T08:12:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:02 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:12:02.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:02 smithi096 ceph-mon[124666]: pgmap v8622: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 494 KiB/s wr, 15 op/s 2023-05-08T08:12:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:02 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:12:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:02 smithi186 ceph-mon[126480]: pgmap v8622: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 494 KiB/s wr, 15 op/s 2023-05-08T08:12:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:02 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:12:04.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:04 smithi133 ceph-mon[125939]: pgmap v8623: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 333 KiB/s wr, 11 op/s 2023-05-08T08:12:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16062.929600 secs 2023-05-08T08:12:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16063.486274 secs 2023-05-08T08:12:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:04 smithi096 ceph-mon[124666]: pgmap v8623: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 333 KiB/s wr, 11 op/s 2023-05-08T08:12:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16062.929600 secs 2023-05-08T08:12:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16063.486274 secs 2023-05-08T08:12:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:04 smithi186 ceph-mon[126480]: pgmap v8623: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 333 KiB/s wr, 11 op/s 2023-05-08T08:12:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16062.929600 secs 2023-05-08T08:12:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16063.486274 secs 2023-05-08T08:12:06.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:06 smithi133 ceph-mon[125939]: pgmap v8624: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 601 KiB/s wr, 30 op/s 2023-05-08T08:12:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16064.769736 secs 2023-05-08T08:12:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:06 smithi133 ceph-mon[125939]: osdmap e616: 12 total, 12 up, 12 in 2023-05-08T08:12:06.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:06 smithi096 ceph-mon[124666]: pgmap v8624: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 601 KiB/s wr, 30 op/s 2023-05-08T08:12:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16064.769736 secs 2023-05-08T08:12:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:06 smithi096 ceph-mon[124666]: osdmap e616: 12 total, 12 up, 12 in 2023-05-08T08:12:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:06 smithi186 ceph-mon[126480]: pgmap v8624: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 601 KiB/s wr, 30 op/s 2023-05-08T08:12:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16064.769736 secs 2023-05-08T08:12:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:06 smithi186 ceph-mon[126480]: osdmap e616: 12 total, 12 up, 12 in 2023-05-08T08:12:08.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:07 smithi133 ceph-mon[125939]: pgmap v8626: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 419 KiB/s wr, 28 op/s 2023-05-08T08:12:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:07 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:12:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:07 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:12:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:07 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:12:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:07 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:12:08.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:07 smithi096 ceph-mon[124666]: pgmap v8626: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 419 KiB/s wr, 28 op/s 2023-05-08T08:12:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:07 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:12:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:07 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:12:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:07 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:12:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:07 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:12:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:07 smithi186 ceph-mon[126480]: pgmap v8626: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 419 KiB/s wr, 28 op/s 2023-05-08T08:12:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:07 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:12:08.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:07 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:12:08.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:07 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:12:08.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:07 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:12:09.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16067.929710 secs 2023-05-08T08:12:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16068.486375 secs 2023-05-08T08:12:09.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16067.929710 secs 2023-05-08T08:12:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16068.486375 secs 2023-05-08T08:12:09.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16067.929710 secs 2023-05-08T08:12:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16068.486375 secs 2023-05-08T08:12:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:09 smithi133 ceph-mon[125939]: pgmap v8627: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 419 KiB/s wr, 28 op/s 2023-05-08T08:12:10.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:09 smithi096 ceph-mon[124666]: pgmap v8627: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 419 KiB/s wr, 28 op/s 2023-05-08T08:12:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:09 smithi186 ceph-mon[126480]: pgmap v8627: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 419 KiB/s wr, 28 op/s 2023-05-08T08:12:11.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16069.769861 secs 2023-05-08T08:12:11.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16069.769861 secs 2023-05-08T08:12:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16069.769861 secs 2023-05-08T08:12:12.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:11 smithi133 ceph-mon[125939]: pgmap v8628: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 352 KiB/s rd, 384 KiB/s wr, 27 op/s 2023-05-08T08:12:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:11 smithi133 ceph-mon[125939]: osdmap e617: 12 total, 12 up, 12 in 2023-05-08T08:12:12.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:11 smithi096 ceph-mon[124666]: pgmap v8628: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 352 KiB/s rd, 384 KiB/s wr, 27 op/s 2023-05-08T08:12:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:11 smithi096 ceph-mon[124666]: osdmap e617: 12 total, 12 up, 12 in 2023-05-08T08:12:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:11 smithi186 ceph-mon[126480]: pgmap v8628: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 352 KiB/s rd, 384 KiB/s wr, 27 op/s 2023-05-08T08:12:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:11 smithi186 ceph-mon[126480]: osdmap e617: 12 total, 12 up, 12 in 2023-05-08T08:12:14.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:13 smithi133 ceph-mon[125939]: pgmap v8630: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 77 KiB/s wr, 5 op/s 2023-05-08T08:12:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16072.929839 secs 2023-05-08T08:12:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16073.486495 secs 2023-05-08T08:12:14.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:13 smithi096 ceph-mon[124666]: pgmap v8630: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 77 KiB/s wr, 5 op/s 2023-05-08T08:12:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16072.929839 secs 2023-05-08T08:12:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16073.486495 secs 2023-05-08T08:12:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:13 smithi186 ceph-mon[126480]: pgmap v8630: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 77 KiB/s wr, 5 op/s 2023-05-08T08:12:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16072.929839 secs 2023-05-08T08:12:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16073.486495 secs 2023-05-08T08:12:16.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:15 smithi133 ceph-mon[125939]: pgmap v8631: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 290 KiB/s rd, 110 KiB/s wr, 8 op/s 2023-05-08T08:12:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16074.769986 secs 2023-05-08T08:12:16.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:15 smithi096 ceph-mon[124666]: pgmap v8631: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 290 KiB/s rd, 110 KiB/s wr, 8 op/s 2023-05-08T08:12:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16074.769986 secs 2023-05-08T08:12:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:15 smithi186 ceph-mon[126480]: pgmap v8631: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 290 KiB/s rd, 110 KiB/s wr, 8 op/s 2023-05-08T08:12:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16074.769986 secs 2023-05-08T08:12:18.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:17 smithi133 ceph-mon[125939]: pgmap v8632: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 106 KiB/s wr, 8 op/s 2023-05-08T08:12:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:17 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:12:18.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:17 smithi096 ceph-mon[124666]: pgmap v8632: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 106 KiB/s wr, 8 op/s 2023-05-08T08:12:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:17 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:12:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:17 smithi186 ceph-mon[126480]: pgmap v8632: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 106 KiB/s wr, 8 op/s 2023-05-08T08:12:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:17 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:12:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16077.929987 secs 2023-05-08T08:12:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:12:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:12:19.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:12:19.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16078.486633 secs 2023-05-08T08:12:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16077.929987 secs 2023-05-08T08:12:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:12:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:12:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:12:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16078.486633 secs 2023-05-08T08:12:19.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16077.929987 secs 2023-05-08T08:12:19.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:12:19.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:12:19.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:12:19.373 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16078.486633 secs 2023-05-08T08:12:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:19 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:12:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:19 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T08:12:20.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:19 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T08:12:20.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:19 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:12:20.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:19 smithi133 ceph-mon[125939]: pgmap v8633: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 106 KiB/s wr, 8 op/s 2023-05-08T08:12:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:19 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:12:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:19 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T08:12:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:19 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T08:12:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:19 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:12:20.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:19 smithi096 ceph-mon[124666]: pgmap v8633: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 106 KiB/s wr, 8 op/s 2023-05-08T08:12:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:19 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:12:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:19 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T08:12:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:19 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T08:12:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:19 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:12:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:19 smithi186 ceph-mon[126480]: pgmap v8633: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 106 KiB/s wr, 8 op/s 2023-05-08T08:12:21.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16079.770073 secs 2023-05-08T08:12:21.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16079.770073 secs 2023-05-08T08:12:21.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16079.770073 secs 2023-05-08T08:12:22.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:21 smithi133 ceph-mon[125939]: pgmap v8634: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 45 KiB/s wr, 6 op/s 2023-05-08T08:12:22.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:21 smithi096 ceph-mon[124666]: pgmap v8634: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 45 KiB/s wr, 6 op/s 2023-05-08T08:12:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:21 smithi186 ceph-mon[126480]: pgmap v8634: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 45 KiB/s wr, 6 op/s 2023-05-08T08:12:24.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:23 smithi133 ceph-mon[125939]: pgmap v8635: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 41 KiB/s wr, 5 op/s 2023-05-08T08:12:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16082.930106 secs 2023-05-08T08:12:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16083.486786 secs 2023-05-08T08:12:24.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:23 smithi096 ceph-mon[124666]: pgmap v8635: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 41 KiB/s wr, 5 op/s 2023-05-08T08:12:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16082.930106 secs 2023-05-08T08:12:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16083.486786 secs 2023-05-08T08:12:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:23 smithi186 ceph-mon[126480]: pgmap v8635: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 41 KiB/s wr, 5 op/s 2023-05-08T08:12:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16082.930106 secs 2023-05-08T08:12:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16083.486786 secs 2023-05-08T08:12:26.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:25 smithi133 ceph-mon[125939]: pgmap v8636: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 37 KiB/s wr, 7 op/s 2023-05-08T08:12:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16084.770195 secs 2023-05-08T08:12:26.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:25 smithi096 ceph-mon[124666]: pgmap v8636: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 37 KiB/s wr, 7 op/s 2023-05-08T08:12:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16084.770195 secs 2023-05-08T08:12:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:25 smithi186 ceph-mon[126480]: pgmap v8636: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 37 KiB/s wr, 7 op/s 2023-05-08T08:12:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16084.770195 secs 2023-05-08T08:12:28.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:27 smithi133 ceph-mon[125939]: pgmap v8637: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T08:12:28.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:27 smithi096 ceph-mon[124666]: pgmap v8637: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T08:12:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:27 smithi186 ceph-mon[126480]: pgmap v8637: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T08:12:29.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16087.930245 secs 2023-05-08T08:12:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16088.486924 secs 2023-05-08T08:12:29.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16087.930245 secs 2023-05-08T08:12:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16088.486924 secs 2023-05-08T08:12:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16087.930245 secs 2023-05-08T08:12:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16088.486924 secs 2023-05-08T08:12:30.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:29 smithi133 ceph-mon[125939]: pgmap v8638: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T08:12:30.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:29 smithi096 ceph-mon[124666]: pgmap v8638: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T08:12:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:29 smithi186 ceph-mon[126480]: pgmap v8638: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T08:12:31.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16089.770301 secs 2023-05-08T08:12:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16089.770301 secs 2023-05-08T08:12:31.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16089.770301 secs 2023-05-08T08:12:32.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:31 smithi096 ceph-mon[124666]: pgmap v8639: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T08:12:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:31 smithi186 ceph-mon[126480]: pgmap v8639: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T08:12:32.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:31 smithi133 ceph-mon[125939]: pgmap v8639: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T08:12:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:34 smithi096 ceph-mon[124666]: pgmap v8640: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T08:12:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16092.930376 secs 2023-05-08T08:12:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16093.487037 secs 2023-05-08T08:12:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:34 smithi186 ceph-mon[126480]: pgmap v8640: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T08:12:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16092.930376 secs 2023-05-08T08:12:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16093.487037 secs 2023-05-08T08:12:34.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:34 smithi133 ceph-mon[125939]: pgmap v8640: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T08:12:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16092.930376 secs 2023-05-08T08:12:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16093.487037 secs 2023-05-08T08:12:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:36 smithi186 ceph-mon[126480]: pgmap v8641: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 597 B/s wr, 8 op/s 2023-05-08T08:12:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16094.770432 secs 2023-05-08T08:12:36.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:36 smithi133 ceph-mon[125939]: pgmap v8641: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 597 B/s wr, 8 op/s 2023-05-08T08:12:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16094.770432 secs 2023-05-08T08:12:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:36 smithi096 ceph-mon[124666]: pgmap v8641: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 597 B/s wr, 8 op/s 2023-05-08T08:12:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16094.770432 secs 2023-05-08T08:12:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:38 smithi186 ceph-mon[126480]: pgmap v8642: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 597 B/s wr, 5 op/s 2023-05-08T08:12:38.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:38 smithi133 ceph-mon[125939]: pgmap v8642: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 597 B/s wr, 5 op/s 2023-05-08T08:12:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:38 smithi096 ceph-mon[124666]: pgmap v8642: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 597 B/s wr, 5 op/s 2023-05-08T08:12:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16097.930491 secs 2023-05-08T08:12:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16098.487151 secs 2023-05-08T08:12:39.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16097.930491 secs 2023-05-08T08:12:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16098.487151 secs 2023-05-08T08:12:39.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16097.930491 secs 2023-05-08T08:12:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16098.487151 secs 2023-05-08T08:12:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:40 smithi186 ceph-mon[126480]: pgmap v8643: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 597 B/s wr, 5 op/s 2023-05-08T08:12:40.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:40 smithi133 ceph-mon[125939]: pgmap v8643: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 597 B/s wr, 5 op/s 2023-05-08T08:12:40.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:40 smithi096 ceph-mon[124666]: pgmap v8643: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 597 B/s wr, 5 op/s 2023-05-08T08:12:41.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16099.770558 secs 2023-05-08T08:12:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16099.770558 secs 2023-05-08T08:12:41.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16099.770558 secs 2023-05-08T08:12:42.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:42 smithi186 ceph-mon[126480]: pgmap v8644: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 113 KiB/s wr, 9 op/s 2023-05-08T08:12:42.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:42 smithi133 ceph-mon[125939]: pgmap v8644: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 113 KiB/s wr, 9 op/s 2023-05-08T08:12:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:42 smithi096 ceph-mon[124666]: pgmap v8644: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 113 KiB/s wr, 9 op/s 2023-05-08T08:12:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:44 smithi186 ceph-mon[126480]: pgmap v8645: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 113 KiB/s wr, 6 op/s 2023-05-08T08:12:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16102.930559 secs 2023-05-08T08:12:44.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:44 smithi133 ceph-mon[125939]: pgmap v8645: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 113 KiB/s wr, 6 op/s 2023-05-08T08:12:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16102.930559 secs 2023-05-08T08:12:44.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:44 smithi096 ceph-mon[124666]: pgmap v8645: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 113 KiB/s wr, 6 op/s 2023-05-08T08:12:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16102.930559 secs 2023-05-08T08:12:46.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:46 smithi186 ceph-mon[126480]: pgmap v8646: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 157 KiB/s wr, 10 op/s 2023-05-08T08:12:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16104.770713 secs 2023-05-08T08:12:46.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:46 smithi133 ceph-mon[125939]: pgmap v8646: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 157 KiB/s wr, 10 op/s 2023-05-08T08:12:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16104.770713 secs 2023-05-08T08:12:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:46 smithi096 ceph-mon[124666]: pgmap v8646: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 157 KiB/s wr, 10 op/s 2023-05-08T08:12:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16104.770713 secs 2023-05-08T08:12:48.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:47 smithi133 ceph-mon[125939]: pgmap v8647: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 156 KiB/s wr, 7 op/s 2023-05-08T08:12:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:12:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:47 smithi096 ceph-mon[124666]: pgmap v8647: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 156 KiB/s wr, 7 op/s 2023-05-08T08:12:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:12:48.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:47 smithi186 ceph-mon[126480]: pgmap v8647: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 156 KiB/s wr, 7 op/s 2023-05-08T08:12:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:12:49.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:48 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:12:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:12:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:12:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16107.930677 secs 2023-05-08T08:12:49.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:48 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:12:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:12:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:12:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16107.930677 secs 2023-05-08T08:12:49.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:48 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:12:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:12:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:12:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16107.930677 secs 2023-05-08T08:12:50.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:49 smithi133 ceph-mon[125939]: pgmap v8648: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 156 KiB/s wr, 7 op/s 2023-05-08T08:12:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:49 smithi096 ceph-mon[124666]: pgmap v8648: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 156 KiB/s wr, 7 op/s 2023-05-08T08:12:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:49 smithi186 ceph-mon[126480]: pgmap v8648: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 156 KiB/s wr, 7 op/s 2023-05-08T08:12:51.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16109.770840 secs 2023-05-08T08:12:51.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16109.770840 secs 2023-05-08T08:12:51.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16109.770840 secs 2023-05-08T08:12:52.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:51 smithi133 ceph-mon[125939]: pgmap v8649: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 413 KiB/s wr, 14 op/s 2023-05-08T08:12:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:51 smithi096 ceph-mon[124666]: pgmap v8649: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 413 KiB/s wr, 14 op/s 2023-05-08T08:12:52.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:51 smithi186 ceph-mon[126480]: pgmap v8649: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 413 KiB/s wr, 14 op/s 2023-05-08T08:12:54.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:53 smithi133 ceph-mon[125939]: pgmap v8650: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 301 KiB/s wr, 10 op/s 2023-05-08T08:12:54.244 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16112.930798 secs 2023-05-08T08:12:54.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:53 smithi096 ceph-mon[124666]: pgmap v8650: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 301 KiB/s wr, 10 op/s 2023-05-08T08:12:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16112.930798 secs 2023-05-08T08:12:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:53 smithi186 ceph-mon[126480]: pgmap v8650: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 301 KiB/s wr, 10 op/s 2023-05-08T08:12:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16112.930798 secs 2023-05-08T08:12:56.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:55 smithi133 ceph-mon[125939]: pgmap v8651: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 398 KiB/s wr, 16 op/s 2023-05-08T08:12:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16114.770991 secs 2023-05-08T08:12:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:55 smithi096 ceph-mon[124666]: pgmap v8651: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 398 KiB/s wr, 16 op/s 2023-05-08T08:12:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16114.770991 secs 2023-05-08T08:12:56.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:55 smithi186 ceph-mon[126480]: pgmap v8651: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 398 KiB/s wr, 16 op/s 2023-05-08T08:12:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16114.770991 secs 2023-05-08T08:12:58.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:57 smithi133 ceph-mon[125939]: pgmap v8652: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 408 KiB/s rd, 355 KiB/s wr, 12 op/s 2023-05-08T08:12:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:57 smithi096 ceph-mon[124666]: pgmap v8652: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 408 KiB/s rd, 355 KiB/s wr, 12 op/s 2023-05-08T08:12:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:57 smithi186 ceph-mon[126480]: pgmap v8652: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 408 KiB/s rd, 355 KiB/s wr, 12 op/s 2023-05-08T08:12:59.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16117.930922 secs 2023-05-08T08:12:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16118.487639 secs 2023-05-08T08:12:59.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16117.930922 secs 2023-05-08T08:12:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16118.487639 secs 2023-05-08T08:12:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16117.930922 secs 2023-05-08T08:12:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16118.487639 secs 2023-05-08T08:13:00.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:12:59 smithi133 ceph-mon[125939]: pgmap v8653: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 408 KiB/s rd, 355 KiB/s wr, 12 op/s 2023-05-08T08:13:00.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:12:59 smithi096 ceph-mon[124666]: pgmap v8653: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 408 KiB/s rd, 355 KiB/s wr, 12 op/s 2023-05-08T08:13:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:12:59 smithi186 ceph-mon[126480]: pgmap v8653: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 408 KiB/s rd, 355 KiB/s wr, 12 op/s 2023-05-08T08:13:01.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:00 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:13:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:13:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:13:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16119.771107 secs 2023-05-08T08:13:01.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:00 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:13:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:13:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:13:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16119.771107 secs 2023-05-08T08:13:01.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:00 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:13:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:13:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:13:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16119.771107 secs 2023-05-08T08:13:02.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:01 smithi133 ceph-mon[125939]: pgmap v8654: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 626 KiB/s rd, 571 KiB/s wr, 17 op/s 2023-05-08T08:13:02.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:01 smithi096 ceph-mon[124666]: pgmap v8654: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 626 KiB/s rd, 571 KiB/s wr, 17 op/s 2023-05-08T08:13:02.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:01 smithi186 ceph-mon[126480]: pgmap v8654: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 626 KiB/s rd, 571 KiB/s wr, 17 op/s 2023-05-08T08:13:04.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:03 smithi096 ceph-mon[124666]: pgmap v8655: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 314 KiB/s wr, 10 op/s 2023-05-08T08:13:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16122.931061 secs 2023-05-08T08:13:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16123.487716 secs 2023-05-08T08:13:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:03 smithi186 ceph-mon[126480]: pgmap v8655: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 314 KiB/s wr, 10 op/s 2023-05-08T08:13:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16122.931061 secs 2023-05-08T08:13:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16123.487716 secs 2023-05-08T08:13:04.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:03 smithi133 ceph-mon[125939]: pgmap v8655: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 314 KiB/s wr, 10 op/s 2023-05-08T08:13:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16122.931061 secs 2023-05-08T08:13:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16123.487716 secs 2023-05-08T08:13:06.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:05 smithi096 ceph-mon[124666]: pgmap v8656: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 359 KiB/s wr, 28 op/s 2023-05-08T08:13:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16124.771254 secs 2023-05-08T08:13:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:05 smithi186 ceph-mon[126480]: pgmap v8656: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 359 KiB/s wr, 28 op/s 2023-05-08T08:13:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16124.771254 secs 2023-05-08T08:13:06.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:05 smithi133 ceph-mon[125939]: pgmap v8656: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 359 KiB/s wr, 28 op/s 2023-05-08T08:13:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16124.771254 secs 2023-05-08T08:13:08.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:07 smithi096 ceph-mon[124666]: pgmap v8657: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 262 KiB/s wr, 23 op/s 2023-05-08T08:13:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:07 smithi186 ceph-mon[126480]: pgmap v8657: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 262 KiB/s wr, 23 op/s 2023-05-08T08:13:08.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:07 smithi133 ceph-mon[125939]: pgmap v8657: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 262 KiB/s wr, 23 op/s 2023-05-08T08:13:09.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16127.931206 secs 2023-05-08T08:13:09.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16128.487780 secs 2023-05-08T08:13:09.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16127.931206 secs 2023-05-08T08:13:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16128.487780 secs 2023-05-08T08:13:09.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16127.931206 secs 2023-05-08T08:13:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16128.487780 secs 2023-05-08T08:13:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:10 smithi186 ceph-mon[126480]: pgmap v8658: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 262 KiB/s wr, 22 op/s 2023-05-08T08:13:10.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:10 smithi133 ceph-mon[125939]: pgmap v8658: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 262 KiB/s wr, 22 op/s 2023-05-08T08:13:10.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:10 smithi096 ceph-mon[124666]: pgmap v8658: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 262 KiB/s wr, 22 op/s 2023-05-08T08:13:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16129.771361 secs 2023-05-08T08:13:11.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16129.771361 secs 2023-05-08T08:13:11.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16129.771361 secs 2023-05-08T08:13:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:12 smithi186 ceph-mon[126480]: pgmap v8659: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 313 KiB/s wr, 25 op/s 2023-05-08T08:13:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:12 smithi186 ceph-mon[126480]: osdmap e618: 12 total, 12 up, 12 in 2023-05-08T08:13:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:12 smithi133 ceph-mon[125939]: pgmap v8659: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 313 KiB/s wr, 25 op/s 2023-05-08T08:13:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:12 smithi133 ceph-mon[125939]: osdmap e618: 12 total, 12 up, 12 in 2023-05-08T08:13:12.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:12 smithi096 ceph-mon[124666]: pgmap v8659: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 313 KiB/s wr, 25 op/s 2023-05-08T08:13:12.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:12 smithi096 ceph-mon[124666]: osdmap e618: 12 total, 12 up, 12 in 2023-05-08T08:13:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:14 smithi186 ceph-mon[126480]: pgmap v8661: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 116 KiB/s wr, 25 op/s 2023-05-08T08:13:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16132.931328 secs 2023-05-08T08:13:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16133.487911 secs 2023-05-08T08:13:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:14 smithi133 ceph-mon[125939]: pgmap v8661: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 116 KiB/s wr, 25 op/s 2023-05-08T08:13:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16132.931328 secs 2023-05-08T08:13:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16133.487911 secs 2023-05-08T08:13:14.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:14 smithi096 ceph-mon[124666]: pgmap v8661: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 116 KiB/s wr, 25 op/s 2023-05-08T08:13:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16132.931328 secs 2023-05-08T08:13:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16133.487911 secs 2023-05-08T08:13:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:16 smithi186 ceph-mon[126480]: pgmap v8662: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T08:13:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16134.771486 secs 2023-05-08T08:13:16.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:16 smithi133 ceph-mon[125939]: pgmap v8662: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T08:13:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16134.771486 secs 2023-05-08T08:13:16.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:16 smithi096 ceph-mon[124666]: pgmap v8662: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T08:13:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16134.771486 secs 2023-05-08T08:13:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:18 smithi186 ceph-mon[126480]: pgmap v8663: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T08:13:18.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:18 smithi133 ceph-mon[125939]: pgmap v8663: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T08:13:18.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:18 smithi096 ceph-mon[124666]: pgmap v8663: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T08:13:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16137.931450 secs 2023-05-08T08:13:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:19 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:13:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16138.487995 secs 2023-05-08T08:13:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:19 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:13:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:19 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:13:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:19 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:13:19.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16137.931450 secs 2023-05-08T08:13:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:19 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:13:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16138.487995 secs 2023-05-08T08:13:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:19 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:13:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:19 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:13:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:19 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:13:19.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16137.931450 secs 2023-05-08T08:13:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:19 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:13:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16138.487995 secs 2023-05-08T08:13:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:19 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:13:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:19 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:13:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:19 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:13:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:20 smithi186 ceph-mon[126480]: pgmap v8664: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T08:13:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:20 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:13:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:20 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T08:13:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:20 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T08:13:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:20 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:13:20.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:20 smithi133 ceph-mon[125939]: pgmap v8664: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T08:13:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:20 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:13:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:20 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T08:13:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:20 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T08:13:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:20 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:13:20.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:20 smithi096 ceph-mon[124666]: pgmap v8664: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T08:13:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:20 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:13:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:20 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T08:13:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:20 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T08:13:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:20 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:13:21.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16139.771572 secs 2023-05-08T08:13:21.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16139.771572 secs 2023-05-08T08:13:21.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16139.771572 secs 2023-05-08T08:13:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:22 smithi186 ceph-mon[126480]: pgmap v8665: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:13:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:22 smithi186 ceph-mon[126480]: osdmap e619: 12 total, 12 up, 12 in 2023-05-08T08:13:22.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:22 smithi133 ceph-mon[125939]: pgmap v8665: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:13:22.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:22 smithi133 ceph-mon[125939]: osdmap e619: 12 total, 12 up, 12 in 2023-05-08T08:13:22.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:22 smithi096 ceph-mon[124666]: pgmap v8665: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:13:22.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:22 smithi096 ceph-mon[124666]: osdmap e619: 12 total, 12 up, 12 in 2023-05-08T08:13:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:24 smithi186 ceph-mon[126480]: pgmap v8667: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:13:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16142.931570 secs 2023-05-08T08:13:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16143.488139 secs 2023-05-08T08:13:24.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:24 smithi133 ceph-mon[125939]: pgmap v8667: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:13:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16142.931570 secs 2023-05-08T08:13:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16143.488139 secs 2023-05-08T08:13:24.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:24 smithi096 ceph-mon[124666]: pgmap v8667: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:13:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16142.931570 secs 2023-05-08T08:13:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16143.488139 secs 2023-05-08T08:13:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:26 smithi186 ceph-mon[126480]: pgmap v8668: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T08:13:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16144.771703 secs 2023-05-08T08:13:26.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:26 smithi133 ceph-mon[125939]: pgmap v8668: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T08:13:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16144.771703 secs 2023-05-08T08:13:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:26 smithi096 ceph-mon[124666]: pgmap v8668: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T08:13:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16144.771703 secs 2023-05-08T08:13:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:28 smithi186 ceph-mon[126480]: pgmap v8669: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T08:13:28.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:28 smithi133 ceph-mon[125939]: pgmap v8669: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T08:13:28.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:28 smithi096 ceph-mon[124666]: pgmap v8669: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T08:13:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16147.931687 secs 2023-05-08T08:13:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16148.488273 secs 2023-05-08T08:13:29.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16147.931687 secs 2023-05-08T08:13:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16148.488273 secs 2023-05-08T08:13:29.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16147.931687 secs 2023-05-08T08:13:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16148.488273 secs 2023-05-08T08:13:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:30 smithi186 ceph-mon[126480]: pgmap v8670: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T08:13:30.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:30 smithi133 ceph-mon[125939]: pgmap v8670: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T08:13:30.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:30 smithi096 ceph-mon[124666]: pgmap v8670: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T08:13:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16149.771838 secs 2023-05-08T08:13:31.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16149.771838 secs 2023-05-08T08:13:31.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16149.771838 secs 2023-05-08T08:13:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:32 smithi186 ceph-mon[126480]: pgmap v8671: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:13:32.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:32 smithi133 ceph-mon[125939]: pgmap v8671: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:13:32.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:32 smithi096 ceph-mon[124666]: pgmap v8671: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:13:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:34 smithi186 ceph-mon[126480]: pgmap v8672: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 93 B/s wr, 6 op/s 2023-05-08T08:13:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16152.931844 secs 2023-05-08T08:13:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16153.488390 secs 2023-05-08T08:13:34.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:34 smithi133 ceph-mon[125939]: pgmap v8672: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 93 B/s wr, 6 op/s 2023-05-08T08:13:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16152.931844 secs 2023-05-08T08:13:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16153.488390 secs 2023-05-08T08:13:34.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:34 smithi096 ceph-mon[124666]: pgmap v8672: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 93 B/s wr, 6 op/s 2023-05-08T08:13:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16152.931844 secs 2023-05-08T08:13:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16153.488390 secs 2023-05-08T08:13:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:36 smithi186 ceph-mon[126480]: pgmap v8673: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 45 KiB/s wr, 9 op/s 2023-05-08T08:13:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16154.771921 secs 2023-05-08T08:13:36.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:36 smithi133 ceph-mon[125939]: pgmap v8673: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 45 KiB/s wr, 9 op/s 2023-05-08T08:13:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16154.771921 secs 2023-05-08T08:13:36.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:36 smithi096 ceph-mon[124666]: pgmap v8673: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 45 KiB/s wr, 9 op/s 2023-05-08T08:13:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16154.771921 secs 2023-05-08T08:13:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:38 smithi186 ceph-mon[126480]: pgmap v8674: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 45 KiB/s wr, 6 op/s 2023-05-08T08:13:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:38 smithi133 ceph-mon[125939]: pgmap v8674: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 45 KiB/s wr, 6 op/s 2023-05-08T08:13:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:38 smithi096 ceph-mon[124666]: pgmap v8674: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 45 KiB/s wr, 6 op/s 2023-05-08T08:13:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16157.931955 secs 2023-05-08T08:13:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16158.488483 secs 2023-05-08T08:13:39.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16157.931955 secs 2023-05-08T08:13:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16158.488483 secs 2023-05-08T08:13:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16157.931955 secs 2023-05-08T08:13:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16158.488483 secs 2023-05-08T08:13:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:40 smithi186 ceph-mon[126480]: pgmap v8675: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 45 KiB/s wr, 6 op/s 2023-05-08T08:13:40.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:40 smithi133 ceph-mon[125939]: pgmap v8675: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 45 KiB/s wr, 6 op/s 2023-05-08T08:13:40.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:40 smithi096 ceph-mon[124666]: pgmap v8675: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 45 KiB/s wr, 6 op/s 2023-05-08T08:13:42.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:42 smithi186 ceph-mon[126480]: pgmap v8676: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 230 KiB/s wr, 10 op/s 2023-05-08T08:13:42.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:42 smithi133 ceph-mon[125939]: pgmap v8676: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 230 KiB/s wr, 10 op/s 2023-05-08T08:13:42.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:42 smithi096 ceph-mon[124666]: pgmap v8676: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 230 KiB/s wr, 10 op/s 2023-05-08T08:13:43.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:13:43.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:13:43.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:13:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:44 smithi186 ceph-mon[126480]: pgmap v8677: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 230 KiB/s wr, 7 op/s 2023-05-08T08:13:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:13:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:13:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:13:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16162.932072 secs 2023-05-08T08:13:44.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:44 smithi133 ceph-mon[125939]: pgmap v8677: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 230 KiB/s wr, 7 op/s 2023-05-08T08:13:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:13:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:13:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:13:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16162.932072 secs 2023-05-08T08:13:44.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:44 smithi096 ceph-mon[124666]: pgmap v8677: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 230 KiB/s wr, 7 op/s 2023-05-08T08:13:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:13:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:13:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:13:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16162.932072 secs 2023-05-08T08:13:46.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:46 smithi186 ceph-mon[126480]: pgmap v8678: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 253 KiB/s wr, 11 op/s 2023-05-08T08:13:46.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:46 smithi133 ceph-mon[125939]: pgmap v8678: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 253 KiB/s wr, 11 op/s 2023-05-08T08:13:46.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:46 smithi096 ceph-mon[124666]: pgmap v8678: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 253 KiB/s wr, 11 op/s 2023-05-08T08:13:48.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:47 smithi133 ceph-mon[125939]: pgmap v8679: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 208 KiB/s wr, 8 op/s 2023-05-08T08:13:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:13:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:47 smithi096 ceph-mon[124666]: pgmap v8679: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 208 KiB/s wr, 8 op/s 2023-05-08T08:13:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:13:48.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:47 smithi186 ceph-mon[126480]: pgmap v8679: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 208 KiB/s wr, 8 op/s 2023-05-08T08:13:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:13:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:13:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:13:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16167.932187 secs 2023-05-08T08:13:49.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:13:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:13:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16167.932187 secs 2023-05-08T08:13:49.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:13:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:13:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16167.932187 secs 2023-05-08T08:13:50.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:49 smithi133 ceph-mon[125939]: pgmap v8680: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 208 KiB/s wr, 8 op/s 2023-05-08T08:13:50.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:49 smithi096 ceph-mon[124666]: pgmap v8680: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 208 KiB/s wr, 8 op/s 2023-05-08T08:13:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:49 smithi186 ceph-mon[126480]: pgmap v8680: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 208 KiB/s wr, 8 op/s 2023-05-08T08:13:51.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16169.772258 secs 2023-05-08T08:13:51.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16169.772258 secs 2023-05-08T08:13:51.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16169.772258 secs 2023-05-08T08:13:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:51 smithi133 ceph-mon[125939]: pgmap v8681: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 415 KiB/s wr, 13 op/s 2023-05-08T08:13:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:51 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:13:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:13:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:13:52.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:51 smithi096 ceph-mon[124666]: pgmap v8681: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 415 KiB/s wr, 13 op/s 2023-05-08T08:13:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:51 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:13:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:13:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:13:52.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:51 smithi186 ceph-mon[126480]: pgmap v8681: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 415 KiB/s wr, 13 op/s 2023-05-08T08:13:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:51 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:13:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:13:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:13:54.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:53 smithi096 ceph-mon[124666]: pgmap v8682: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 230 KiB/s wr, 9 op/s 2023-05-08T08:13:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16172.932312 secs 2023-05-08T08:13:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:53 smithi186 ceph-mon[126480]: pgmap v8682: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 230 KiB/s wr, 9 op/s 2023-05-08T08:13:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16172.932312 secs 2023-05-08T08:13:54.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:53 smithi133 ceph-mon[125939]: pgmap v8682: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 230 KiB/s wr, 9 op/s 2023-05-08T08:13:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16172.932312 secs 2023-05-08T08:13:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:55 smithi096 ceph-mon[124666]: pgmap v8683: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 398 KiB/s wr, 15 op/s 2023-05-08T08:13:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16174.772365 secs 2023-05-08T08:13:56.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:55 smithi186 ceph-mon[126480]: pgmap v8683: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 398 KiB/s wr, 15 op/s 2023-05-08T08:13:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16174.772365 secs 2023-05-08T08:13:56.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:55 smithi133 ceph-mon[125939]: pgmap v8683: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 398 KiB/s wr, 15 op/s 2023-05-08T08:13:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16174.772365 secs 2023-05-08T08:13:58.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:57 smithi096 ceph-mon[124666]: pgmap v8684: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 375 KiB/s wr, 11 op/s 2023-05-08T08:13:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:57 smithi186 ceph-mon[126480]: pgmap v8684: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 375 KiB/s wr, 11 op/s 2023-05-08T08:13:58.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:57 smithi133 ceph-mon[125939]: pgmap v8684: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 375 KiB/s wr, 11 op/s 2023-05-08T08:13:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16177.932426 secs 2023-05-08T08:13:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:13:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16178.488824 secs 2023-05-08T08:13:59.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16177.932426 secs 2023-05-08T08:13:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:13:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16178.488824 secs 2023-05-08T08:13:59.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16177.932426 secs 2023-05-08T08:13:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:13:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16178.488824 secs 2023-05-08T08:14:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:00 smithi186 ceph-mon[126480]: pgmap v8685: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 374 KiB/s wr, 10 op/s 2023-05-08T08:14:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:00 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:14:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:14:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:14:00.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:00 smithi133 ceph-mon[125939]: pgmap v8685: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 374 KiB/s wr, 10 op/s 2023-05-08T08:14:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:00 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:14:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:14:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:14:00.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:00 smithi096 ceph-mon[124666]: pgmap v8685: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 374 KiB/s wr, 10 op/s 2023-05-08T08:14:00.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:00 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:14:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:14:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:14:01.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16179.772465 secs 2023-05-08T08:14:01.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16179.772465 secs 2023-05-08T08:14:01.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16179.772465 secs 2023-05-08T08:14:02.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:02 smithi186 ceph-mon[126480]: pgmap v8686: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 537 KiB/s rd, 520 KiB/s wr, 15 op/s 2023-05-08T08:14:02.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:02 smithi133 ceph-mon[125939]: pgmap v8686: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 537 KiB/s rd, 520 KiB/s wr, 15 op/s 2023-05-08T08:14:02.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:02 smithi096 ceph-mon[124666]: pgmap v8686: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 537 KiB/s rd, 520 KiB/s wr, 15 op/s 2023-05-08T08:14:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:04 smithi186 ceph-mon[126480]: pgmap v8687: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 319 KiB/s rd, 314 KiB/s wr, 10 op/s 2023-05-08T08:14:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16182.932522 secs 2023-05-08T08:14:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16183.488927 secs 2023-05-08T08:14:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:04 smithi133 ceph-mon[125939]: pgmap v8687: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 319 KiB/s rd, 314 KiB/s wr, 10 op/s 2023-05-08T08:14:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16182.932522 secs 2023-05-08T08:14:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16183.488927 secs 2023-05-08T08:14:04.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:04 smithi096 ceph-mon[124666]: pgmap v8687: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 319 KiB/s rd, 314 KiB/s wr, 10 op/s 2023-05-08T08:14:04.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16182.932522 secs 2023-05-08T08:14:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16183.488927 secs 2023-05-08T08:14:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:06 smithi186 ceph-mon[126480]: pgmap v8688: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 359 KiB/s wr, 28 op/s 2023-05-08T08:14:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16184.772591 secs 2023-05-08T08:14:06.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:06 smithi133 ceph-mon[125939]: pgmap v8688: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 359 KiB/s wr, 28 op/s 2023-05-08T08:14:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16184.772591 secs 2023-05-08T08:14:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:06 smithi096 ceph-mon[124666]: pgmap v8688: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 359 KiB/s wr, 28 op/s 2023-05-08T08:14:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16184.772591 secs 2023-05-08T08:14:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:08 smithi186 ceph-mon[126480]: pgmap v8689: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 191 KiB/s wr, 22 op/s 2023-05-08T08:14:08.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:08 smithi133 ceph-mon[125939]: pgmap v8689: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 191 KiB/s wr, 22 op/s 2023-05-08T08:14:08.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:08 smithi096 ceph-mon[124666]: pgmap v8689: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 191 KiB/s wr, 22 op/s 2023-05-08T08:14:09.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16187.932649 secs 2023-05-08T08:14:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16188.489043 secs 2023-05-08T08:14:09.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16187.932649 secs 2023-05-08T08:14:09.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16188.489043 secs 2023-05-08T08:14:09.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16187.932649 secs 2023-05-08T08:14:09.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16188.489043 secs 2023-05-08T08:14:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:10 smithi186 ceph-mon[126480]: pgmap v8690: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 191 KiB/s wr, 22 op/s 2023-05-08T08:14:10.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:10 smithi133 ceph-mon[125939]: pgmap v8690: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 191 KiB/s wr, 22 op/s 2023-05-08T08:14:10.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:10 smithi096 ceph-mon[124666]: pgmap v8690: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 191 KiB/s wr, 22 op/s 2023-05-08T08:14:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16189.772696 secs 2023-05-08T08:14:11.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16189.772696 secs 2023-05-08T08:14:11.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16189.772696 secs 2023-05-08T08:14:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:12 smithi186 ceph-mon[126480]: pgmap v8691: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 242 KiB/s wr, 25 op/s 2023-05-08T08:14:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:12 smithi186 ceph-mon[126480]: osdmap e620: 12 total, 12 up, 12 in 2023-05-08T08:14:12.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:12 smithi133 ceph-mon[125939]: pgmap v8691: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 242 KiB/s wr, 25 op/s 2023-05-08T08:14:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:12 smithi133 ceph-mon[125939]: osdmap e620: 12 total, 12 up, 12 in 2023-05-08T08:14:12.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:12 smithi096 ceph-mon[124666]: pgmap v8691: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 242 KiB/s wr, 25 op/s 2023-05-08T08:14:12.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:12 smithi096 ceph-mon[124666]: osdmap e620: 12 total, 12 up, 12 in 2023-05-08T08:14:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:14 smithi186 ceph-mon[126480]: pgmap v8693: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 116 KiB/s wr, 24 op/s 2023-05-08T08:14:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16192.932771 secs 2023-05-08T08:14:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16193.489159 secs 2023-05-08T08:14:14.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:14 smithi133 ceph-mon[125939]: pgmap v8693: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 116 KiB/s wr, 24 op/s 2023-05-08T08:14:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16192.932771 secs 2023-05-08T08:14:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16193.489159 secs 2023-05-08T08:14:14.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:14 smithi096 ceph-mon[124666]: pgmap v8693: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 116 KiB/s wr, 24 op/s 2023-05-08T08:14:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16192.932771 secs 2023-05-08T08:14:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16193.489159 secs 2023-05-08T08:14:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:16 smithi186 ceph-mon[126480]: pgmap v8694: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T08:14:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16194.772824 secs 2023-05-08T08:14:16.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:16 smithi133 ceph-mon[125939]: pgmap v8694: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T08:14:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16194.772824 secs 2023-05-08T08:14:16.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:16 smithi096 ceph-mon[124666]: pgmap v8694: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T08:14:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16194.772824 secs 2023-05-08T08:14:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:18 smithi186 ceph-mon[126480]: pgmap v8695: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T08:14:18.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:18 smithi133 ceph-mon[125939]: pgmap v8695: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T08:14:18.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:18 smithi096 ceph-mon[124666]: pgmap v8695: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T08:14:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16197.932885 secs 2023-05-08T08:14:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16198.489291 secs 2023-05-08T08:14:19.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16197.932885 secs 2023-05-08T08:14:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16198.489291 secs 2023-05-08T08:14:19.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16197.932885 secs 2023-05-08T08:14:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16198.489291 secs 2023-05-08T08:14:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:20 smithi186 ceph-mon[126480]: pgmap v8696: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T08:14:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:20 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:14:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:20 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:14:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:20 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:14:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:20 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:14:20.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:20 smithi133 ceph-mon[125939]: pgmap v8696: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T08:14:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:20 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:14:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:20 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:14:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:20 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:14:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:20 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:14:20.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:20 smithi096 ceph-mon[124666]: pgmap v8696: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T08:14:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:20 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:14:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:20 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:14:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:20 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:14:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:20 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:14:21.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:21 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:14:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:21 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T08:14:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:21 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T08:14:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:21 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:14:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16199.772979 secs 2023-05-08T08:14:21.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:21 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:14:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:21 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T08:14:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:21 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T08:14:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:21 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:14:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16199.772979 secs 2023-05-08T08:14:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:21 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:14:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:21 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T08:14:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:21 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T08:14:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:21 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:14:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16199.772979 secs 2023-05-08T08:14:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:22 smithi186 ceph-mon[126480]: pgmap v8697: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:14:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:22 smithi186 ceph-mon[126480]: osdmap e621: 12 total, 12 up, 12 in 2023-05-08T08:14:22.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:22 smithi133 ceph-mon[125939]: pgmap v8697: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:14:22.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:22 smithi133 ceph-mon[125939]: osdmap e621: 12 total, 12 up, 12 in 2023-05-08T08:14:22.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:22 smithi096 ceph-mon[124666]: pgmap v8697: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:14:22.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:22 smithi096 ceph-mon[124666]: osdmap e621: 12 total, 12 up, 12 in 2023-05-08T08:14:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:24 smithi186 ceph-mon[126480]: pgmap v8699: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:14:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16202.933003 secs 2023-05-08T08:14:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16203.489426 secs 2023-05-08T08:14:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:24 smithi133 ceph-mon[125939]: pgmap v8699: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:14:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16202.933003 secs 2023-05-08T08:14:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16203.489426 secs 2023-05-08T08:14:24.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:24 smithi096 ceph-mon[124666]: pgmap v8699: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:14:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16202.933003 secs 2023-05-08T08:14:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16203.489426 secs 2023-05-08T08:14:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:26 smithi186 ceph-mon[126480]: pgmap v8700: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:14:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16204.773102 secs 2023-05-08T08:14:26.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:26 smithi133 ceph-mon[125939]: pgmap v8700: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:14:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16204.773102 secs 2023-05-08T08:14:26.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:26 smithi096 ceph-mon[124666]: pgmap v8700: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:14:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16204.773102 secs 2023-05-08T08:14:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:28 smithi186 ceph-mon[126480]: pgmap v8701: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:14:28.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:28 smithi133 ceph-mon[125939]: pgmap v8701: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:14:28.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:28 smithi096 ceph-mon[124666]: pgmap v8701: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:14:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16207.933131 secs 2023-05-08T08:14:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16208.489542 secs 2023-05-08T08:14:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16207.933131 secs 2023-05-08T08:14:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16208.489542 secs 2023-05-08T08:14:29.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16207.933131 secs 2023-05-08T08:14:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16208.489542 secs 2023-05-08T08:14:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:30 smithi186 ceph-mon[126480]: pgmap v8702: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:14:30.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:30 smithi133 ceph-mon[125939]: pgmap v8702: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:14:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:30 smithi096 ceph-mon[124666]: pgmap v8702: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:14:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16209.773201 secs 2023-05-08T08:14:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16209.773201 secs 2023-05-08T08:14:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16209.773201 secs 2023-05-08T08:14:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:32 smithi186 ceph-mon[126480]: pgmap v8703: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:14:32.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:32 smithi133 ceph-mon[125939]: pgmap v8703: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:14:32.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:32 smithi096 ceph-mon[124666]: pgmap v8703: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:14:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:34 smithi186 ceph-mon[126480]: pgmap v8704: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 93 B/s wr, 6 op/s 2023-05-08T08:14:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16212.933247 secs 2023-05-08T08:14:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16213.489609 secs 2023-05-08T08:14:34.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:34 smithi133 ceph-mon[125939]: pgmap v8704: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 93 B/s wr, 6 op/s 2023-05-08T08:14:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16212.933247 secs 2023-05-08T08:14:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16213.489609 secs 2023-05-08T08:14:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:34 smithi096 ceph-mon[124666]: pgmap v8704: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 93 B/s wr, 6 op/s 2023-05-08T08:14:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16212.933247 secs 2023-05-08T08:14:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16213.489609 secs 2023-05-08T08:14:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:36 smithi186 ceph-mon[126480]: pgmap v8705: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 938 B/s wr, 8 op/s 2023-05-08T08:14:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16214.773326 secs 2023-05-08T08:14:36.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:36 smithi133 ceph-mon[125939]: pgmap v8705: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 938 B/s wr, 8 op/s 2023-05-08T08:14:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16214.773326 secs 2023-05-08T08:14:36.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:36 smithi096 ceph-mon[124666]: pgmap v8705: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 938 B/s wr, 8 op/s 2023-05-08T08:14:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16214.773326 secs 2023-05-08T08:14:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:38 smithi186 ceph-mon[126480]: pgmap v8706: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 853 B/s wr, 6 op/s 2023-05-08T08:14:38.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:38 smithi133 ceph-mon[125939]: pgmap v8706: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 853 B/s wr, 6 op/s 2023-05-08T08:14:38.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:38 smithi096 ceph-mon[124666]: pgmap v8706: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 853 B/s wr, 6 op/s 2023-05-08T08:14:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16217.933394 secs 2023-05-08T08:14:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16218.489727 secs 2023-05-08T08:14:39.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16217.933394 secs 2023-05-08T08:14:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16218.489727 secs 2023-05-08T08:14:39.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16217.933394 secs 2023-05-08T08:14:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16218.489727 secs 2023-05-08T08:14:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:40 smithi186 ceph-mon[126480]: pgmap v8707: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 853 B/s wr, 6 op/s 2023-05-08T08:14:40.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:40 smithi133 ceph-mon[125939]: pgmap v8707: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 853 B/s wr, 6 op/s 2023-05-08T08:14:40.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:40 smithi096 ceph-mon[124666]: pgmap v8707: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 853 B/s wr, 6 op/s 2023-05-08T08:14:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:42 smithi186 ceph-mon[126480]: pgmap v8708: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 187 KiB/s wr, 9 op/s 2023-05-08T08:14:42.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:42 smithi133 ceph-mon[125939]: pgmap v8708: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 187 KiB/s wr, 9 op/s 2023-05-08T08:14:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:42 smithi096 ceph-mon[124666]: pgmap v8708: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 187 KiB/s wr, 9 op/s 2023-05-08T08:14:43.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:14:43.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:14:43.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:14:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:44 smithi186 ceph-mon[126480]: pgmap v8709: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 187 KiB/s wr, 7 op/s 2023-05-08T08:14:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:14:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:14:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:14:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16222.933513 secs 2023-05-08T08:14:44.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:44 smithi133 ceph-mon[125939]: pgmap v8709: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 187 KiB/s wr, 7 op/s 2023-05-08T08:14:44.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:14:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:14:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:14:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16222.933513 secs 2023-05-08T08:14:44.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:44 smithi096 ceph-mon[124666]: pgmap v8709: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 187 KiB/s wr, 7 op/s 2023-05-08T08:14:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:14:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:14:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:14:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16222.933513 secs 2023-05-08T08:14:46.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:46 smithi133 ceph-mon[125939]: pgmap v8710: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 210 KiB/s wr, 11 op/s 2023-05-08T08:14:46.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:46 smithi096 ceph-mon[124666]: pgmap v8710: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 210 KiB/s wr, 11 op/s 2023-05-08T08:14:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:46 smithi186 ceph-mon[126480]: pgmap v8710: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 210 KiB/s wr, 11 op/s 2023-05-08T08:14:48.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:47 smithi133 ceph-mon[125939]: pgmap v8711: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 210 KiB/s wr, 7 op/s 2023-05-08T08:14:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:14:48.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:47 smithi096 ceph-mon[124666]: pgmap v8711: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 210 KiB/s wr, 7 op/s 2023-05-08T08:14:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:14:48.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:47 smithi186 ceph-mon[126480]: pgmap v8711: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 210 KiB/s wr, 7 op/s 2023-05-08T08:14:48.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:14:49.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:14:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:14:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16227.933629 secs 2023-05-08T08:14:49.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:14:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:14:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16227.933629 secs 2023-05-08T08:14:49.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:14:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:14:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16227.933629 secs 2023-05-08T08:14:50.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:49 smithi096 ceph-mon[124666]: pgmap v8712: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 210 KiB/s wr, 7 op/s 2023-05-08T08:14:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:49 smithi186 ceph-mon[126480]: pgmap v8712: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 210 KiB/s wr, 7 op/s 2023-05-08T08:14:50.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:49 smithi133 ceph-mon[125939]: pgmap v8712: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 210 KiB/s wr, 7 op/s 2023-05-08T08:14:51.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16229.773699 secs 2023-05-08T08:14:51.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16229.773699 secs 2023-05-08T08:14:51.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16229.773699 secs 2023-05-08T08:14:52.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:52 smithi096 ceph-mon[124666]: pgmap v8713: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 487 KiB/s wr, 13 op/s 2023-05-08T08:14:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:52 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:14:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:14:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:14:52.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:52 smithi186 ceph-mon[126480]: pgmap v8713: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 487 KiB/s wr, 13 op/s 2023-05-08T08:14:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:52 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:14:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:14:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:14:52.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:52 smithi133 ceph-mon[125939]: pgmap v8713: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 487 KiB/s wr, 13 op/s 2023-05-08T08:14:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:52 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:14:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:14:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:14:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:54 smithi186 ceph-mon[126480]: pgmap v8714: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 301 KiB/s wr, 9 op/s 2023-05-08T08:14:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16232.933752 secs 2023-05-08T08:14:54.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:54 smithi133 ceph-mon[125939]: pgmap v8714: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 301 KiB/s wr, 9 op/s 2023-05-08T08:14:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16232.933752 secs 2023-05-08T08:14:54.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:54 smithi096 ceph-mon[124666]: pgmap v8714: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 301 KiB/s wr, 9 op/s 2023-05-08T08:14:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16232.933752 secs 2023-05-08T08:14:56.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:56 smithi186 ceph-mon[126480]: pgmap v8715: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 400 KiB/s wr, 15 op/s 2023-05-08T08:14:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16234.773824 secs 2023-05-08T08:14:56.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:56 smithi133 ceph-mon[125939]: pgmap v8715: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 400 KiB/s wr, 15 op/s 2023-05-08T08:14:56.504 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16234.773824 secs 2023-05-08T08:14:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:56 smithi096 ceph-mon[124666]: pgmap v8715: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 400 KiB/s wr, 15 op/s 2023-05-08T08:14:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16234.773824 secs 2023-05-08T08:14:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:58 smithi186 ceph-mon[126480]: pgmap v8716: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 377 KiB/s wr, 11 op/s 2023-05-08T08:14:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:58 smithi133 ceph-mon[125939]: pgmap v8716: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 377 KiB/s wr, 11 op/s 2023-05-08T08:14:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:58 smithi096 ceph-mon[124666]: pgmap v8716: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 377 KiB/s wr, 11 op/s 2023-05-08T08:14:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16237.933866 secs 2023-05-08T08:14:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:14:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16238.490157 secs 2023-05-08T08:14:59.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16237.933866 secs 2023-05-08T08:14:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:14:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16238.490157 secs 2023-05-08T08:14:59.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16237.933866 secs 2023-05-08T08:14:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:14:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16238.490157 secs 2023-05-08T08:15:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:00 smithi186 ceph-mon[126480]: pgmap v8717: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 377 KiB/s wr, 11 op/s 2023-05-08T08:15:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:00 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:15:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:15:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:15:00.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:00 smithi133 ceph-mon[125939]: pgmap v8717: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 377 KiB/s wr, 11 op/s 2023-05-08T08:15:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:00 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:15:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:15:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:15:00.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:00 smithi096 ceph-mon[124666]: pgmap v8717: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 377 KiB/s wr, 11 op/s 2023-05-08T08:15:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:00 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:15:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:15:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:15:01.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16239.773931 secs 2023-05-08T08:15:01.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16239.773931 secs 2023-05-08T08:15:01.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16239.773931 secs 2023-05-08T08:15:02.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:02 smithi186 ceph-mon[126480]: pgmap v8718: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 535 KiB/s rd, 523 KiB/s wr, 15 op/s 2023-05-08T08:15:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:02 smithi133 ceph-mon[125939]: pgmap v8718: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 535 KiB/s rd, 523 KiB/s wr, 15 op/s 2023-05-08T08:15:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:02 smithi096 ceph-mon[124666]: pgmap v8718: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 535 KiB/s rd, 523 KiB/s wr, 15 op/s 2023-05-08T08:15:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:04 smithi186 ceph-mon[126480]: pgmap v8719: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 246 KiB/s wr, 10 op/s 2023-05-08T08:15:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16242.934007 secs 2023-05-08T08:15:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16243.490295 secs 2023-05-08T08:15:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:04 smithi133 ceph-mon[125939]: pgmap v8719: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 246 KiB/s wr, 10 op/s 2023-05-08T08:15:04.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16242.934007 secs 2023-05-08T08:15:04.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16243.490295 secs 2023-05-08T08:15:04.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:04 smithi096 ceph-mon[124666]: pgmap v8719: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 246 KiB/s wr, 10 op/s 2023-05-08T08:15:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16242.934007 secs 2023-05-08T08:15:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16243.490295 secs 2023-05-08T08:15:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:06 smithi186 ceph-mon[126480]: pgmap v8720: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 329 KiB/s rd, 363 KiB/s wr, 28 op/s 2023-05-08T08:15:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16244.774059 secs 2023-05-08T08:15:06.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:06 smithi133 ceph-mon[125939]: pgmap v8720: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 329 KiB/s rd, 363 KiB/s wr, 28 op/s 2023-05-08T08:15:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16244.774059 secs 2023-05-08T08:15:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:06 smithi096 ceph-mon[124666]: pgmap v8720: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 329 KiB/s rd, 363 KiB/s wr, 28 op/s 2023-05-08T08:15:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16244.774059 secs 2023-05-08T08:15:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:08 smithi186 ceph-mon[126480]: pgmap v8721: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 264 KiB/s wr, 22 op/s 2023-05-08T08:15:08.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:08 smithi133 ceph-mon[125939]: pgmap v8721: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 264 KiB/s wr, 22 op/s 2023-05-08T08:15:08.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:08 smithi096 ceph-mon[124666]: pgmap v8721: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 264 KiB/s wr, 22 op/s 2023-05-08T08:15:09.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16247.934131 secs 2023-05-08T08:15:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16248.490413 secs 2023-05-08T08:15:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16247.934131 secs 2023-05-08T08:15:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16248.490413 secs 2023-05-08T08:15:09.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16247.934131 secs 2023-05-08T08:15:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16248.490413 secs 2023-05-08T08:15:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:10 smithi186 ceph-mon[126480]: pgmap v8722: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 264 KiB/s wr, 22 op/s 2023-05-08T08:15:10.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:10 smithi133 ceph-mon[125939]: pgmap v8722: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 264 KiB/s wr, 22 op/s 2023-05-08T08:15:10.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:10 smithi096 ceph-mon[124666]: pgmap v8722: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 264 KiB/s wr, 22 op/s 2023-05-08T08:15:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16249.774130 secs 2023-05-08T08:15:11.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16249.774130 secs 2023-05-08T08:15:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16249.774130 secs 2023-05-08T08:15:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:12 smithi186 ceph-mon[126480]: pgmap v8723: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 284 KiB/s rd, 316 KiB/s wr, 25 op/s 2023-05-08T08:15:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:12 smithi186 ceph-mon[126480]: osdmap e622: 12 total, 12 up, 12 in 2023-05-08T08:15:12.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:12 smithi133 ceph-mon[125939]: pgmap v8723: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 284 KiB/s rd, 316 KiB/s wr, 25 op/s 2023-05-08T08:15:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:12 smithi133 ceph-mon[125939]: osdmap e622: 12 total, 12 up, 12 in 2023-05-08T08:15:12.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:12 smithi096 ceph-mon[124666]: pgmap v8723: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 284 KiB/s rd, 316 KiB/s wr, 25 op/s 2023-05-08T08:15:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:12 smithi096 ceph-mon[124666]: osdmap e622: 12 total, 12 up, 12 in 2023-05-08T08:15:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:14 smithi186 ceph-mon[126480]: pgmap v8725: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 204 KiB/s wr, 25 op/s 2023-05-08T08:15:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16252.934247 secs 2023-05-08T08:15:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16253.490533 secs 2023-05-08T08:15:14.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:14 smithi133 ceph-mon[125939]: pgmap v8725: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 204 KiB/s wr, 25 op/s 2023-05-08T08:15:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16252.934247 secs 2023-05-08T08:15:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16253.490533 secs 2023-05-08T08:15:14.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:14 smithi096 ceph-mon[124666]: pgmap v8725: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 204 KiB/s wr, 25 op/s 2023-05-08T08:15:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16252.934247 secs 2023-05-08T08:15:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16253.490533 secs 2023-05-08T08:15:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:16 smithi186 ceph-mon[126480]: pgmap v8726: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 63 KiB/s wr, 7 op/s 2023-05-08T08:15:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16254.774272 secs 2023-05-08T08:15:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:16 smithi133 ceph-mon[125939]: pgmap v8726: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 63 KiB/s wr, 7 op/s 2023-05-08T08:15:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16254.774272 secs 2023-05-08T08:15:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:16 smithi096 ceph-mon[124666]: pgmap v8726: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 63 KiB/s wr, 7 op/s 2023-05-08T08:15:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16254.774272 secs 2023-05-08T08:15:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:18 smithi186 ceph-mon[126480]: pgmap v8727: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 63 KiB/s wr, 7 op/s 2023-05-08T08:15:18.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:18 smithi133 ceph-mon[125939]: pgmap v8727: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 63 KiB/s wr, 7 op/s 2023-05-08T08:15:18.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:18 smithi096 ceph-mon[124666]: pgmap v8727: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 63 KiB/s wr, 7 op/s 2023-05-08T08:15:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16257.934365 secs 2023-05-08T08:15:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16258.490647 secs 2023-05-08T08:15:19.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16257.934365 secs 2023-05-08T08:15:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16258.490647 secs 2023-05-08T08:15:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16257.934365 secs 2023-05-08T08:15:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16258.490647 secs 2023-05-08T08:15:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:20 smithi186 ceph-mon[126480]: pgmap v8728: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 63 KiB/s wr, 7 op/s 2023-05-08T08:15:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:20 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:15:20.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:20 smithi133 ceph-mon[125939]: pgmap v8728: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 63 KiB/s wr, 7 op/s 2023-05-08T08:15:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:20 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:15:20.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:20 smithi096 ceph-mon[124666]: pgmap v8728: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 63 KiB/s wr, 7 op/s 2023-05-08T08:15:20.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:20 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:15:21.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16259.774367 secs 2023-05-08T08:15:21.422 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16259.774367 secs 2023-05-08T08:15:21.460 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16259.774367 secs 2023-05-08T08:15:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:22 smithi186 ceph-mon[126480]: pgmap v8729: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T08:15:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:22 smithi186 ceph-mon[126480]: osdmap e623: 12 total, 12 up, 12 in 2023-05-08T08:15:22.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:22 smithi133 ceph-mon[125939]: pgmap v8729: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T08:15:22.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:22 smithi133 ceph-mon[125939]: osdmap e623: 12 total, 12 up, 12 in 2023-05-08T08:15:22.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:22 smithi096 ceph-mon[124666]: pgmap v8729: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T08:15:22.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:22 smithi096 ceph-mon[124666]: osdmap e623: 12 total, 12 up, 12 in 2023-05-08T08:15:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:24 smithi133 ceph-mon[125939]: pgmap v8731: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T08:15:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:15:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:15:24.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16262.934512 secs 2023-05-08T08:15:24.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:15:24.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:15:24.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:15:24.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:15:24.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:15:24.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16263.490726 secs 2023-05-08T08:15:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:24 smithi096 ceph-mon[124666]: pgmap v8731: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T08:15:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:15:24.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:15:24.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16262.934512 secs 2023-05-08T08:15:24.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:15:24.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:15:24.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:15:24.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:15:24.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:15:24.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16263.490726 secs 2023-05-08T08:15:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:24 smithi186 ceph-mon[126480]: pgmap v8731: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T08:15:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:15:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:15:24.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16262.934512 secs 2023-05-08T08:15:24.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:15:24.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:15:24.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:15:24.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:15:24.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:15:24.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16263.490726 secs 2023-05-08T08:15:25.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:25 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:15:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:25 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T08:15:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:25 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T08:15:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:25 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:15:25.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:25 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:15:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:25 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T08:15:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:25 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T08:15:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:25 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:15:25.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:25 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:15:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:25 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T08:15:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:25 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T08:15:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:25 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:15:26.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:26 smithi133 ceph-mon[125939]: pgmap v8732: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:15:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16264.774477 secs 2023-05-08T08:15:26.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:26 smithi096 ceph-mon[124666]: pgmap v8732: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:15:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16264.774477 secs 2023-05-08T08:15:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:26 smithi186 ceph-mon[126480]: pgmap v8732: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:15:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16264.774477 secs 2023-05-08T08:15:28.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:28 smithi133 ceph-mon[125939]: pgmap v8733: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:15:28.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:28 smithi096 ceph-mon[124666]: pgmap v8733: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:15:28.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:28 smithi186 ceph-mon[126480]: pgmap v8733: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:15:29.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16267.934614 secs 2023-05-08T08:15:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16268.490848 secs 2023-05-08T08:15:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16267.934614 secs 2023-05-08T08:15:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16268.490848 secs 2023-05-08T08:15:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16267.934614 secs 2023-05-08T08:15:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16268.490848 secs 2023-05-08T08:15:30.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:30 smithi133 ceph-mon[125939]: pgmap v8734: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:15:30.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:30 smithi096 ceph-mon[124666]: pgmap v8734: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:15:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:30 smithi186 ceph-mon[126480]: pgmap v8734: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:15:31.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16269.774608 secs 2023-05-08T08:15:31.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16269.774608 secs 2023-05-08T08:15:31.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16269.774608 secs 2023-05-08T08:15:32.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:32 smithi133 ceph-mon[125939]: pgmap v8735: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:15:32.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:32 smithi096 ceph-mon[124666]: pgmap v8735: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:15:32.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:32 smithi186 ceph-mon[126480]: pgmap v8735: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:15:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:34 smithi133 ceph-mon[125939]: pgmap v8736: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 93 B/s wr, 6 op/s 2023-05-08T08:15:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16272.934736 secs 2023-05-08T08:15:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16273.491001 secs 2023-05-08T08:15:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:34 smithi096 ceph-mon[124666]: pgmap v8736: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 93 B/s wr, 6 op/s 2023-05-08T08:15:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16272.934736 secs 2023-05-08T08:15:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16273.491001 secs 2023-05-08T08:15:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:34 smithi186 ceph-mon[126480]: pgmap v8736: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 93 B/s wr, 6 op/s 2023-05-08T08:15:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16272.934736 secs 2023-05-08T08:15:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16273.491001 secs 2023-05-08T08:15:36.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:36 smithi133 ceph-mon[125939]: pgmap v8737: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 938 B/s wr, 9 op/s 2023-05-08T08:15:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16274.774732 secs 2023-05-08T08:15:36.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:36 smithi096 ceph-mon[124666]: pgmap v8737: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 938 B/s wr, 9 op/s 2023-05-08T08:15:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16274.774732 secs 2023-05-08T08:15:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:36 smithi186 ceph-mon[126480]: pgmap v8737: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 938 B/s wr, 9 op/s 2023-05-08T08:15:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16274.774732 secs 2023-05-08T08:15:38.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:38 smithi133 ceph-mon[125939]: pgmap v8738: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T08:15:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:38 smithi096 ceph-mon[124666]: pgmap v8738: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T08:15:38.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:38 smithi186 ceph-mon[126480]: pgmap v8738: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T08:15:39.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16277.934855 secs 2023-05-08T08:15:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16278.491134 secs 2023-05-08T08:15:39.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16277.934855 secs 2023-05-08T08:15:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16278.491134 secs 2023-05-08T08:15:39.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16277.934855 secs 2023-05-08T08:15:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16278.491134 secs 2023-05-08T08:15:40.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:40 smithi133 ceph-mon[125939]: pgmap v8739: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T08:15:40.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:40 smithi096 ceph-mon[124666]: pgmap v8739: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T08:15:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:40 smithi186 ceph-mon[126480]: pgmap v8739: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T08:15:42.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:42 smithi133 ceph-mon[125939]: pgmap v8740: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 115 KiB/s wr, 10 op/s 2023-05-08T08:15:42.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:42 smithi096 ceph-mon[124666]: pgmap v8740: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 115 KiB/s wr, 10 op/s 2023-05-08T08:15:42.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:42 smithi186 ceph-mon[126480]: pgmap v8740: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 115 KiB/s wr, 10 op/s 2023-05-08T08:15:43.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:15:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:15:43.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:15:44.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:44 smithi133 ceph-mon[125939]: pgmap v8741: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 115 KiB/s wr, 6 op/s 2023-05-08T08:15:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:15:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:15:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:15:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16282.934978 secs 2023-05-08T08:15:44.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:44 smithi096 ceph-mon[124666]: pgmap v8741: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 115 KiB/s wr, 6 op/s 2023-05-08T08:15:44.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:15:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:15:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:15:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16282.934978 secs 2023-05-08T08:15:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:44 smithi186 ceph-mon[126480]: pgmap v8741: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 115 KiB/s wr, 6 op/s 2023-05-08T08:15:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:15:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:15:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:15:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16282.934978 secs 2023-05-08T08:15:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:46 smithi133 ceph-mon[125939]: pgmap v8742: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 138 KiB/s wr, 10 op/s 2023-05-08T08:15:46.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:46 smithi096 ceph-mon[124666]: pgmap v8742: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 138 KiB/s wr, 10 op/s 2023-05-08T08:15:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:46 smithi186 ceph-mon[126480]: pgmap v8742: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 138 KiB/s wr, 10 op/s 2023-05-08T08:15:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:47 smithi096 ceph-mon[124666]: pgmap v8743: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 138 KiB/s wr, 7 op/s 2023-05-08T08:15:48.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:15:48.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:47 smithi186 ceph-mon[126480]: pgmap v8743: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 138 KiB/s wr, 7 op/s 2023-05-08T08:15:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:15:48.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:47 smithi133 ceph-mon[125939]: pgmap v8743: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 138 KiB/s wr, 7 op/s 2023-05-08T08:15:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:15:49.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:15:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:15:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16287.935097 secs 2023-05-08T08:15:49.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:15:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:15:49.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16287.935097 secs 2023-05-08T08:15:49.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:15:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:15:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16287.935097 secs 2023-05-08T08:15:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:50 smithi186 ceph-mon[126480]: pgmap v8744: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 138 KiB/s wr, 7 op/s 2023-05-08T08:15:50.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:50 smithi133 ceph-mon[125939]: pgmap v8744: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 138 KiB/s wr, 7 op/s 2023-05-08T08:15:50.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:50 smithi096 ceph-mon[124666]: pgmap v8744: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 138 KiB/s wr, 7 op/s 2023-05-08T08:15:51.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16289.775013 secs 2023-05-08T08:15:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16289.775013 secs 2023-05-08T08:15:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16289.775013 secs 2023-05-08T08:15:52.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:52 smithi186 ceph-mon[126480]: pgmap v8745: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 431 KiB/s rd, 417 KiB/s wr, 12 op/s 2023-05-08T08:15:52.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:52 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:15:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:15:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:15:52.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:52 smithi133 ceph-mon[125939]: pgmap v8745: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 431 KiB/s rd, 417 KiB/s wr, 12 op/s 2023-05-08T08:15:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:52 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:15:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:15:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:15:52.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:52 smithi096 ceph-mon[124666]: pgmap v8745: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 431 KiB/s rd, 417 KiB/s wr, 12 op/s 2023-05-08T08:15:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:52 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:15:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:15:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:15:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:54 smithi186 ceph-mon[126480]: pgmap v8746: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 303 KiB/s wr, 9 op/s 2023-05-08T08:15:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16292.935219 secs 2023-05-08T08:15:54.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:54 smithi133 ceph-mon[125939]: pgmap v8746: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 303 KiB/s wr, 9 op/s 2023-05-08T08:15:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16292.935219 secs 2023-05-08T08:15:54.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:54 smithi096 ceph-mon[124666]: pgmap v8746: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 303 KiB/s wr, 9 op/s 2023-05-08T08:15:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16292.935219 secs 2023-05-08T08:15:56.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:56 smithi186 ceph-mon[126480]: pgmap v8747: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 402 KiB/s wr, 14 op/s 2023-05-08T08:15:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16294.775138 secs 2023-05-08T08:15:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:56 smithi133 ceph-mon[125939]: pgmap v8747: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 402 KiB/s wr, 14 op/s 2023-05-08T08:15:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16294.775138 secs 2023-05-08T08:15:56.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:56 smithi096 ceph-mon[124666]: pgmap v8747: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 402 KiB/s wr, 14 op/s 2023-05-08T08:15:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16294.775138 secs 2023-05-08T08:15:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:58 smithi186 ceph-mon[126480]: pgmap v8748: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 379 KiB/s wr, 11 op/s 2023-05-08T08:15:58.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:58 smithi133 ceph-mon[125939]: pgmap v8748: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 379 KiB/s wr, 11 op/s 2023-05-08T08:15:58.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:58 smithi096 ceph-mon[124666]: pgmap v8748: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 379 KiB/s wr, 11 op/s 2023-05-08T08:15:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16297.935353 secs 2023-05-08T08:15:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:15:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16298.491513 secs 2023-05-08T08:15:59.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16297.935353 secs 2023-05-08T08:15:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:15:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16298.491513 secs 2023-05-08T08:15:59.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16297.935353 secs 2023-05-08T08:15:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:15:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16298.491513 secs 2023-05-08T08:16:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:00 smithi186 ceph-mon[126480]: pgmap v8749: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 379 KiB/s wr, 10 op/s 2023-05-08T08:16:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:00 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:16:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:16:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:16:00.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:00 smithi133 ceph-mon[125939]: pgmap v8749: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 379 KiB/s wr, 10 op/s 2023-05-08T08:16:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:00 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:16:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:16:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:16:00.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:00 smithi096 ceph-mon[124666]: pgmap v8749: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 379 KiB/s wr, 10 op/s 2023-05-08T08:16:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:00 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:16:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:16:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:16:01.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16299.775207 secs 2023-05-08T08:16:01.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16299.775207 secs 2023-05-08T08:16:01.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16299.775207 secs 2023-05-08T08:16:02.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:02 smithi186 ceph-mon[126480]: pgmap v8750: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 612 KiB/s rd, 599 KiB/s wr, 15 op/s 2023-05-08T08:16:02.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:02 smithi133 ceph-mon[125939]: pgmap v8750: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 612 KiB/s rd, 599 KiB/s wr, 15 op/s 2023-05-08T08:16:02.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:02 smithi096 ceph-mon[124666]: pgmap v8750: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 612 KiB/s rd, 599 KiB/s wr, 15 op/s 2023-05-08T08:16:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:04 smithi186 ceph-mon[126480]: pgmap v8751: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 319 KiB/s wr, 10 op/s 2023-05-08T08:16:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16302.935476 secs 2023-05-08T08:16:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16303.491638 secs 2023-05-08T08:16:04.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:04 smithi133 ceph-mon[125939]: pgmap v8751: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 319 KiB/s wr, 10 op/s 2023-05-08T08:16:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16302.935476 secs 2023-05-08T08:16:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16303.491638 secs 2023-05-08T08:16:04.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:04 smithi096 ceph-mon[124666]: pgmap v8751: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 319 KiB/s wr, 10 op/s 2023-05-08T08:16:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16302.935476 secs 2023-05-08T08:16:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16303.491638 secs 2023-05-08T08:16:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:06 smithi186 ceph-mon[126480]: pgmap v8752: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 364 KiB/s wr, 28 op/s 2023-05-08T08:16:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16304.775345 secs 2023-05-08T08:16:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:06 smithi133 ceph-mon[125939]: pgmap v8752: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 364 KiB/s wr, 28 op/s 2023-05-08T08:16:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16304.775345 secs 2023-05-08T08:16:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:06 smithi096 ceph-mon[124666]: pgmap v8752: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 364 KiB/s wr, 28 op/s 2023-05-08T08:16:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16304.775345 secs 2023-05-08T08:16:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:08 smithi186 ceph-mon[126480]: pgmap v8753: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 265 KiB/s wr, 22 op/s 2023-05-08T08:16:08.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:08 smithi133 ceph-mon[125939]: pgmap v8753: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 265 KiB/s wr, 22 op/s 2023-05-08T08:16:08.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:08 smithi096 ceph-mon[124666]: pgmap v8753: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 265 KiB/s wr, 22 op/s 2023-05-08T08:16:09.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16307.935591 secs 2023-05-08T08:16:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16308.491717 secs 2023-05-08T08:16:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16307.935591 secs 2023-05-08T08:16:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16308.491717 secs 2023-05-08T08:16:09.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16307.935591 secs 2023-05-08T08:16:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16308.491717 secs 2023-05-08T08:16:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:10 smithi186 ceph-mon[126480]: pgmap v8754: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 265 KiB/s wr, 22 op/s 2023-05-08T08:16:10.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:10 smithi133 ceph-mon[125939]: pgmap v8754: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 265 KiB/s wr, 22 op/s 2023-05-08T08:16:10.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:10 smithi096 ceph-mon[124666]: pgmap v8754: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 265 KiB/s wr, 22 op/s 2023-05-08T08:16:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16309.775483 secs 2023-05-08T08:16:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:11 smithi186 ceph-mon[126480]: osdmap e624: 12 total, 12 up, 12 in 2023-05-08T08:16:11.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16309.775483 secs 2023-05-08T08:16:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:11 smithi133 ceph-mon[125939]: osdmap e624: 12 total, 12 up, 12 in 2023-05-08T08:16:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16309.775483 secs 2023-05-08T08:16:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:11 smithi096 ceph-mon[124666]: osdmap e624: 12 total, 12 up, 12 in 2023-05-08T08:16:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:12 smithi186 ceph-mon[126480]: pgmap v8756: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 117 KiB/s wr, 24 op/s 2023-05-08T08:16:12.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:12 smithi133 ceph-mon[125939]: pgmap v8756: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 117 KiB/s wr, 24 op/s 2023-05-08T08:16:12.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:12 smithi096 ceph-mon[124666]: pgmap v8756: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 117 KiB/s wr, 24 op/s 2023-05-08T08:16:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:14 smithi186 ceph-mon[126480]: pgmap v8757: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 117 KiB/s wr, 24 op/s 2023-05-08T08:16:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16312.935713 secs 2023-05-08T08:16:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16313.491838 secs 2023-05-08T08:16:14.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:14 smithi133 ceph-mon[125939]: pgmap v8757: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 117 KiB/s wr, 24 op/s 2023-05-08T08:16:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16312.935713 secs 2023-05-08T08:16:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16313.491838 secs 2023-05-08T08:16:14.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:14 smithi096 ceph-mon[124666]: pgmap v8757: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 117 KiB/s wr, 24 op/s 2023-05-08T08:16:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16312.935713 secs 2023-05-08T08:16:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16313.491838 secs 2023-05-08T08:16:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:16 smithi186 ceph-mon[126480]: pgmap v8758: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 63 KiB/s wr, 6 op/s 2023-05-08T08:16:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16314.775598 secs 2023-05-08T08:16:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:16 smithi133 ceph-mon[125939]: pgmap v8758: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 63 KiB/s wr, 6 op/s 2023-05-08T08:16:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16314.775598 secs 2023-05-08T08:16:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:16 smithi096 ceph-mon[124666]: pgmap v8758: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 63 KiB/s wr, 6 op/s 2023-05-08T08:16:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16314.775598 secs 2023-05-08T08:16:18.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:17 smithi096 ceph-mon[124666]: pgmap v8759: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 63 KiB/s wr, 6 op/s 2023-05-08T08:16:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:17 smithi096 ceph-mon[124666]: osdmap e625: 12 total, 12 up, 12 in 2023-05-08T08:16:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:18 smithi186 ceph-mon[126480]: pgmap v8759: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 63 KiB/s wr, 6 op/s 2023-05-08T08:16:18.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:18 smithi186 ceph-mon[126480]: osdmap e625: 12 total, 12 up, 12 in 2023-05-08T08:16:18.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:17 smithi133 ceph-mon[125939]: pgmap v8759: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 63 KiB/s wr, 6 op/s 2023-05-08T08:16:18.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:18 smithi133 ceph-mon[125939]: osdmap e625: 12 total, 12 up, 12 in 2023-05-08T08:16:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16317.935817 secs 2023-05-08T08:16:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16318.491960 secs 2023-05-08T08:16:19.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16317.935817 secs 2023-05-08T08:16:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16318.491960 secs 2023-05-08T08:16:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16317.935817 secs 2023-05-08T08:16:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16318.491960 secs 2023-05-08T08:16:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:20 smithi186 ceph-mon[126480]: pgmap v8761: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 115 B/s wr, 3 op/s 2023-05-08T08:16:20.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:20 smithi133 ceph-mon[125939]: pgmap v8761: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 115 B/s wr, 3 op/s 2023-05-08T08:16:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:20 smithi096 ceph-mon[124666]: pgmap v8761: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 115 B/s wr, 3 op/s 2023-05-08T08:16:21.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16319.775696 secs 2023-05-08T08:16:21.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16319.775696 secs 2023-05-08T08:16:21.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16319.775696 secs 2023-05-08T08:16:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:22 smithi186 ceph-mon[126480]: pgmap v8762: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:16:22.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:22 smithi133 ceph-mon[125939]: pgmap v8762: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:16:22.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:22 smithi096 ceph-mon[124666]: pgmap v8762: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:16:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:24 smithi186 ceph-mon[126480]: pgmap v8763: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:16:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16322.935930 secs 2023-05-08T08:16:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:16:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16323.492109 secs 2023-05-08T08:16:24.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:24 smithi133 ceph-mon[125939]: pgmap v8763: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:16:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16322.935930 secs 2023-05-08T08:16:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:16:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16323.492109 secs 2023-05-08T08:16:24.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:24 smithi096 ceph-mon[124666]: pgmap v8763: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:16:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16322.935930 secs 2023-05-08T08:16:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:16:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16323.492109 secs 2023-05-08T08:16:26.364 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:26 smithi186 ceph-mon[126480]: pgmap v8764: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T08:16:26.365 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16324.775821 secs 2023-05-08T08:16:26.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:26 smithi133 ceph-mon[125939]: pgmap v8764: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T08:16:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16324.775821 secs 2023-05-08T08:16:26.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:26 smithi096 ceph-mon[124666]: pgmap v8764: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T08:16:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16324.775821 secs 2023-05-08T08:16:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:16:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:16:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:16:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:16:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:27 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:16:28.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:16:28.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:27 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T08:16:28.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:27 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T08:16:28.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:27 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:16:28.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:27 smithi186 ceph-mon[126480]: pgmap v8765: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T08:16:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:16:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:16:28.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:16:28.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:16:28.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:27 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:16:28.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:16:28.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:27 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T08:16:28.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:27 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T08:16:28.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:27 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:16:28.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:27 smithi133 ceph-mon[125939]: pgmap v8765: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T08:16:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:16:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:16:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:16:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:16:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:27 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:16:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:16:28.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:27 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T08:16:28.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:27 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T08:16:28.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:27 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:16:28.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:27 smithi096 ceph-mon[124666]: pgmap v8765: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T08:16:29.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16327.936055 secs 2023-05-08T08:16:29.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16327.936055 secs 2023-05-08T08:16:29.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16327.936055 secs 2023-05-08T08:16:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16328.492227 secs 2023-05-08T08:16:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:29 smithi186 ceph-mon[126480]: pgmap v8766: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 171 B/s wr, 5 op/s 2023-05-08T08:16:30.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16328.492227 secs 2023-05-08T08:16:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:29 smithi133 ceph-mon[125939]: pgmap v8766: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 171 B/s wr, 5 op/s 2023-05-08T08:16:30.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16328.492227 secs 2023-05-08T08:16:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:29 smithi096 ceph-mon[124666]: pgmap v8766: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 171 B/s wr, 5 op/s 2023-05-08T08:16:31.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16329.775953 secs 2023-05-08T08:16:31.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16329.775953 secs 2023-05-08T08:16:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16329.775953 secs 2023-05-08T08:16:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:31 smithi186 ceph-mon[126480]: pgmap v8767: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 7 op/s 2023-05-08T08:16:32.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:31 smithi133 ceph-mon[125939]: pgmap v8767: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 7 op/s 2023-05-08T08:16:32.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:31 smithi096 ceph-mon[124666]: pgmap v8767: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 7 op/s 2023-05-08T08:16:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:34 smithi186 ceph-mon[126480]: pgmap v8768: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T08:16:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16332.936174 secs 2023-05-08T08:16:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16333.492348 secs 2023-05-08T08:16:34.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:34 smithi133 ceph-mon[125939]: pgmap v8768: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T08:16:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16332.936174 secs 2023-05-08T08:16:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16333.492348 secs 2023-05-08T08:16:34.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:34 smithi096 ceph-mon[124666]: pgmap v8768: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T08:16:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16332.936174 secs 2023-05-08T08:16:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16333.492348 secs 2023-05-08T08:16:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:36 smithi186 ceph-mon[126480]: pgmap v8769: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 938 B/s wr, 8 op/s 2023-05-08T08:16:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16334.776092 secs 2023-05-08T08:16:36.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:36 smithi133 ceph-mon[125939]: pgmap v8769: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 938 B/s wr, 8 op/s 2023-05-08T08:16:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16334.776092 secs 2023-05-08T08:16:36.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:36 smithi096 ceph-mon[124666]: pgmap v8769: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 938 B/s wr, 8 op/s 2023-05-08T08:16:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16334.776092 secs 2023-05-08T08:16:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:38 smithi186 ceph-mon[126480]: pgmap v8770: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T08:16:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:38 smithi133 ceph-mon[125939]: pgmap v8770: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T08:16:38.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:38 smithi096 ceph-mon[124666]: pgmap v8770: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T08:16:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16337.936313 secs 2023-05-08T08:16:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16338.492501 secs 2023-05-08T08:16:39.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16337.936313 secs 2023-05-08T08:16:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16338.492501 secs 2023-05-08T08:16:39.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16337.936313 secs 2023-05-08T08:16:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16338.492501 secs 2023-05-08T08:16:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:40 smithi186 ceph-mon[126480]: pgmap v8771: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T08:16:40.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:40 smithi133 ceph-mon[125939]: pgmap v8771: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T08:16:40.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:40 smithi096 ceph-mon[124666]: pgmap v8771: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T08:16:42.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:42 smithi186 ceph-mon[126480]: pgmap v8772: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 116 KiB/s wr, 9 op/s 2023-05-08T08:16:42.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:42 smithi133 ceph-mon[125939]: pgmap v8772: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 116 KiB/s wr, 9 op/s 2023-05-08T08:16:42.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:42 smithi096 ceph-mon[124666]: pgmap v8772: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 116 KiB/s wr, 9 op/s 2023-05-08T08:16:43.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:16:43.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:16:43.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:16:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:44 smithi186 ceph-mon[126480]: pgmap v8773: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 115 KiB/s wr, 6 op/s 2023-05-08T08:16:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:16:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:16:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:16:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16342.936410 secs 2023-05-08T08:16:44.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:44 smithi133 ceph-mon[125939]: pgmap v8773: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 115 KiB/s wr, 6 op/s 2023-05-08T08:16:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:16:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:16:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:16:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16342.936410 secs 2023-05-08T08:16:44.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:44 smithi096 ceph-mon[124666]: pgmap v8773: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 115 KiB/s wr, 6 op/s 2023-05-08T08:16:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:16:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:16:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:16:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16342.936410 secs 2023-05-08T08:16:46.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:46 smithi186 ceph-mon[126480]: pgmap v8774: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 167 KiB/s wr, 11 op/s 2023-05-08T08:16:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:46 smithi133 ceph-mon[125939]: pgmap v8774: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 167 KiB/s wr, 11 op/s 2023-05-08T08:16:46.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:46 smithi096 ceph-mon[124666]: pgmap v8774: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 167 KiB/s wr, 11 op/s 2023-05-08T08:16:47.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:16:47.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:16:47.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:16:48.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:48 smithi186 ceph-mon[126480]: pgmap v8775: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 166 KiB/s wr, 7 op/s 2023-05-08T08:16:48.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:16:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:16:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:48 smithi133 ceph-mon[125939]: pgmap v8775: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 166 KiB/s wr, 7 op/s 2023-05-08T08:16:48.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:16:48.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:16:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:48 smithi096 ceph-mon[124666]: pgmap v8775: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 166 KiB/s wr, 7 op/s 2023-05-08T08:16:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:16:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:16:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16347.936530 secs 2023-05-08T08:16:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16347.936530 secs 2023-05-08T08:16:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16347.936530 secs 2023-05-08T08:16:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:50 smithi186 ceph-mon[126480]: pgmap v8776: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 166 KiB/s wr, 7 op/s 2023-05-08T08:16:50.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:50 smithi133 ceph-mon[125939]: pgmap v8776: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 166 KiB/s wr, 7 op/s 2023-05-08T08:16:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:50 smithi096 ceph-mon[124666]: pgmap v8776: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 166 KiB/s wr, 7 op/s 2023-05-08T08:16:51.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16349.776429 secs 2023-05-08T08:16:51.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16349.776429 secs 2023-05-08T08:16:51.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16349.776429 secs 2023-05-08T08:16:52.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:52 smithi186 ceph-mon[126480]: pgmap v8777: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 419 KiB/s wr, 13 op/s 2023-05-08T08:16:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:52 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:16:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:16:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:16:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:52 smithi133 ceph-mon[125939]: pgmap v8777: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 419 KiB/s wr, 13 op/s 2023-05-08T08:16:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:52 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:16:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:16:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:16:52.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:52 smithi096 ceph-mon[124666]: pgmap v8777: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 419 KiB/s wr, 13 op/s 2023-05-08T08:16:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:52 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:16:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:16:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:16:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:54 smithi186 ceph-mon[126480]: pgmap v8778: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 455 KiB/s rd, 304 KiB/s wr, 9 op/s 2023-05-08T08:16:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16352.936652 secs 2023-05-08T08:16:54.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:54 smithi133 ceph-mon[125939]: pgmap v8778: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 455 KiB/s rd, 304 KiB/s wr, 9 op/s 2023-05-08T08:16:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16352.936652 secs 2023-05-08T08:16:54.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:54 smithi096 ceph-mon[124666]: pgmap v8778: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 455 KiB/s rd, 304 KiB/s wr, 9 op/s 2023-05-08T08:16:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16352.936652 secs 2023-05-08T08:16:56.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:56 smithi186 ceph-mon[126480]: pgmap v8779: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 555 KiB/s rd, 404 KiB/s wr, 15 op/s 2023-05-08T08:16:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16354.776546 secs 2023-05-08T08:16:56.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:56 smithi133 ceph-mon[125939]: pgmap v8779: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 555 KiB/s rd, 404 KiB/s wr, 15 op/s 2023-05-08T08:16:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16354.776546 secs 2023-05-08T08:16:56.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:56 smithi096 ceph-mon[124666]: pgmap v8779: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 555 KiB/s rd, 404 KiB/s wr, 15 op/s 2023-05-08T08:16:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16354.776546 secs 2023-05-08T08:16:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:58 smithi186 ceph-mon[126480]: pgmap v8780: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 420 KiB/s rd, 353 KiB/s wr, 11 op/s 2023-05-08T08:16:58.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:58 smithi133 ceph-mon[125939]: pgmap v8780: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 420 KiB/s rd, 353 KiB/s wr, 11 op/s 2023-05-08T08:16:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:58 smithi096 ceph-mon[124666]: pgmap v8780: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 420 KiB/s rd, 353 KiB/s wr, 11 op/s 2023-05-08T08:16:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16357.936772 secs 2023-05-08T08:16:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:16:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16358.492924 secs 2023-05-08T08:16:59.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16357.936772 secs 2023-05-08T08:16:59.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:16:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16358.492924 secs 2023-05-08T08:16:59.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16357.936772 secs 2023-05-08T08:16:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:16:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16358.492924 secs 2023-05-08T08:17:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:00 smithi186 ceph-mon[126480]: pgmap v8781: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 420 KiB/s rd, 353 KiB/s wr, 11 op/s 2023-05-08T08:17:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:00 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:17:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:17:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:17:00.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:00 smithi133 ceph-mon[125939]: pgmap v8781: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 420 KiB/s rd, 353 KiB/s wr, 11 op/s 2023-05-08T08:17:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:00 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:17:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:17:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:17:00.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:00 smithi096 ceph-mon[124666]: pgmap v8781: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 420 KiB/s rd, 353 KiB/s wr, 11 op/s 2023-05-08T08:17:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:00 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:17:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:17:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:17:01.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16359.776608 secs 2023-05-08T08:17:01.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16359.776608 secs 2023-05-08T08:17:01.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16359.776608 secs 2023-05-08T08:17:02.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:02 smithi186 ceph-mon[126480]: pgmap v8782: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 642 KiB/s rd, 574 KiB/s wr, 16 op/s 2023-05-08T08:17:02.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:02 smithi133 ceph-mon[125939]: pgmap v8782: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 642 KiB/s rd, 574 KiB/s wr, 16 op/s 2023-05-08T08:17:02.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:02 smithi096 ceph-mon[124666]: pgmap v8782: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 642 KiB/s rd, 574 KiB/s wr, 16 op/s 2023-05-08T08:17:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:04 smithi186 ceph-mon[126480]: pgmap v8783: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 322 KiB/s rd, 321 KiB/s wr, 10 op/s 2023-05-08T08:17:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16362.936897 secs 2023-05-08T08:17:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16363.492988 secs 2023-05-08T08:17:04.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:04 smithi133 ceph-mon[125939]: pgmap v8783: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 322 KiB/s rd, 321 KiB/s wr, 10 op/s 2023-05-08T08:17:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16362.936897 secs 2023-05-08T08:17:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16363.492988 secs 2023-05-08T08:17:04.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:04 smithi096 ceph-mon[124666]: pgmap v8783: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 322 KiB/s rd, 321 KiB/s wr, 10 op/s 2023-05-08T08:17:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16362.936897 secs 2023-05-08T08:17:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16363.492988 secs 2023-05-08T08:17:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:06 smithi186 ceph-mon[126480]: pgmap v8784: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 333 KiB/s rd, 366 KiB/s wr, 28 op/s 2023-05-08T08:17:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16364.776759 secs 2023-05-08T08:17:06.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:06 smithi133 ceph-mon[125939]: pgmap v8784: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 333 KiB/s rd, 366 KiB/s wr, 28 op/s 2023-05-08T08:17:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16364.776759 secs 2023-05-08T08:17:06.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:06 smithi096 ceph-mon[124666]: pgmap v8784: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 333 KiB/s rd, 366 KiB/s wr, 28 op/s 2023-05-08T08:17:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16364.776759 secs 2023-05-08T08:17:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:08 smithi186 ceph-mon[126480]: pgmap v8785: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 267 KiB/s wr, 23 op/s 2023-05-08T08:17:08.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:08 smithi133 ceph-mon[125939]: pgmap v8785: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 267 KiB/s wr, 23 op/s 2023-05-08T08:17:08.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:08 smithi096 ceph-mon[124666]: pgmap v8785: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 267 KiB/s wr, 23 op/s 2023-05-08T08:17:09.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16367.937050 secs 2023-05-08T08:17:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16368.493129 secs 2023-05-08T08:17:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16367.937050 secs 2023-05-08T08:17:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16368.493129 secs 2023-05-08T08:17:09.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16367.937050 secs 2023-05-08T08:17:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16368.493129 secs 2023-05-08T08:17:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:10 smithi186 ceph-mon[126480]: pgmap v8786: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 267 KiB/s wr, 23 op/s 2023-05-08T08:17:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:10 smithi133 ceph-mon[125939]: pgmap v8786: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 267 KiB/s wr, 23 op/s 2023-05-08T08:17:10.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:10 smithi096 ceph-mon[124666]: pgmap v8786: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 267 KiB/s wr, 23 op/s 2023-05-08T08:17:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16369.776878 secs 2023-05-08T08:17:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:11 smithi186 ceph-mon[126480]: osdmap e626: 12 total, 12 up, 12 in 2023-05-08T08:17:11.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16369.776878 secs 2023-05-08T08:17:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:11 smithi133 ceph-mon[125939]: osdmap e626: 12 total, 12 up, 12 in 2023-05-08T08:17:11.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16369.776878 secs 2023-05-08T08:17:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:11 smithi096 ceph-mon[124666]: osdmap e626: 12 total, 12 up, 12 in 2023-05-08T08:17:12.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:12 smithi133 ceph-mon[125939]: pgmap v8788: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 117 KiB/s wr, 24 op/s 2023-05-08T08:17:12.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:12 smithi096 ceph-mon[124666]: pgmap v8788: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 117 KiB/s wr, 24 op/s 2023-05-08T08:17:12.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:12 smithi186 ceph-mon[126480]: pgmap v8788: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 117 KiB/s wr, 24 op/s 2023-05-08T08:17:14.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:14 smithi133 ceph-mon[125939]: pgmap v8789: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 117 KiB/s wr, 24 op/s 2023-05-08T08:17:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16372.937169 secs 2023-05-08T08:17:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16373.493301 secs 2023-05-08T08:17:14.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:14 smithi096 ceph-mon[124666]: pgmap v8789: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 117 KiB/s wr, 24 op/s 2023-05-08T08:17:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16372.937169 secs 2023-05-08T08:17:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16373.493301 secs 2023-05-08T08:17:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:14 smithi186 ceph-mon[126480]: pgmap v8789: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 117 KiB/s wr, 24 op/s 2023-05-08T08:17:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16372.937169 secs 2023-05-08T08:17:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16373.493301 secs 2023-05-08T08:17:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:16 smithi133 ceph-mon[125939]: pgmap v8790: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 63 KiB/s wr, 6 op/s 2023-05-08T08:17:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16374.776994 secs 2023-05-08T08:17:16.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:16 smithi096 ceph-mon[124666]: pgmap v8790: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 63 KiB/s wr, 6 op/s 2023-05-08T08:17:16.542 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16374.776994 secs 2023-05-08T08:17:16.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:16 smithi186 ceph-mon[126480]: pgmap v8790: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 63 KiB/s wr, 6 op/s 2023-05-08T08:17:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16374.776994 secs 2023-05-08T08:17:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:18 smithi186 ceph-mon[126480]: pgmap v8791: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 63 KiB/s wr, 6 op/s 2023-05-08T08:17:18.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:18 smithi186 ceph-mon[126480]: osdmap e627: 12 total, 12 up, 12 in 2023-05-08T08:17:18.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:18 smithi133 ceph-mon[125939]: pgmap v8791: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 63 KiB/s wr, 6 op/s 2023-05-08T08:17:18.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:18 smithi133 ceph-mon[125939]: osdmap e627: 12 total, 12 up, 12 in 2023-05-08T08:17:18.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:18 smithi096 ceph-mon[124666]: pgmap v8791: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 63 KiB/s wr, 6 op/s 2023-05-08T08:17:18.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:18 smithi096 ceph-mon[124666]: osdmap e627: 12 total, 12 up, 12 in 2023-05-08T08:17:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16377.937287 secs 2023-05-08T08:17:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16378.493396 secs 2023-05-08T08:17:19.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16377.937287 secs 2023-05-08T08:17:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16378.493396 secs 2023-05-08T08:17:19.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16377.937287 secs 2023-05-08T08:17:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16378.493396 secs 2023-05-08T08:17:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:20 smithi186 ceph-mon[126480]: pgmap v8793: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 115 B/s wr, 3 op/s 2023-05-08T08:17:20.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:20 smithi133 ceph-mon[125939]: pgmap v8793: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 115 B/s wr, 3 op/s 2023-05-08T08:17:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:20 smithi096 ceph-mon[124666]: pgmap v8793: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 115 B/s wr, 3 op/s 2023-05-08T08:17:21.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16379.777108 secs 2023-05-08T08:17:21.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16379.777108 secs 2023-05-08T08:17:21.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16379.777108 secs 2023-05-08T08:17:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:22 smithi186 ceph-mon[126480]: pgmap v8794: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:17:22.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:22 smithi133 ceph-mon[125939]: pgmap v8794: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:17:22.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:22 smithi096 ceph-mon[124666]: pgmap v8794: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:17:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:24 smithi186 ceph-mon[126480]: pgmap v8795: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:17:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16382.937402 secs 2023-05-08T08:17:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16383.493534 secs 2023-05-08T08:17:24.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:24 smithi133 ceph-mon[125939]: pgmap v8795: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:17:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16382.937402 secs 2023-05-08T08:17:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16383.493534 secs 2023-05-08T08:17:24.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:24 smithi096 ceph-mon[124666]: pgmap v8795: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:17:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16382.937402 secs 2023-05-08T08:17:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16383.493534 secs 2023-05-08T08:17:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:26 smithi186 ceph-mon[126480]: pgmap v8796: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T08:17:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16384.777178 secs 2023-05-08T08:17:26.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:26 smithi133 ceph-mon[125939]: pgmap v8796: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T08:17:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16384.777178 secs 2023-05-08T08:17:26.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:26 smithi096 ceph-mon[124666]: pgmap v8796: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T08:17:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16384.777178 secs 2023-05-08T08:17:27.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:17:27.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:17:27.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:17:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:28 smithi186 ceph-mon[126480]: pgmap v8797: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T08:17:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:28 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:17:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:28 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:17:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:28 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:17:28.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:28 smithi133 ceph-mon[125939]: pgmap v8797: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T08:17:28.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:28 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:17:28.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:28 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:17:28.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:28 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:17:28.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:28 smithi096 ceph-mon[124666]: pgmap v8797: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T08:17:28.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:28 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:17:28.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:28 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:17:28.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:28 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:17:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:29 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:17:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:29 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T08:17:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:29 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T08:17:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:29 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:17:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16387.937511 secs 2023-05-08T08:17:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16388.493610 secs 2023-05-08T08:17:29.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:29 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:17:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:29 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T08:17:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:29 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T08:17:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:29 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:17:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16387.937511 secs 2023-05-08T08:17:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16388.493610 secs 2023-05-08T08:17:29.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:29 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:17:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:29 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T08:17:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:29 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T08:17:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:29 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:17:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16387.937511 secs 2023-05-08T08:17:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16388.493610 secs 2023-05-08T08:17:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:30 smithi186 ceph-mon[126480]: pgmap v8798: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 171 B/s wr, 5 op/s 2023-05-08T08:17:30.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:30 smithi133 ceph-mon[125939]: pgmap v8798: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 171 B/s wr, 5 op/s 2023-05-08T08:17:30.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:30 smithi096 ceph-mon[124666]: pgmap v8798: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 171 B/s wr, 5 op/s 2023-05-08T08:17:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16389.777275 secs 2023-05-08T08:17:31.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16389.777275 secs 2023-05-08T08:17:31.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16389.777275 secs 2023-05-08T08:17:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:32 smithi186 ceph-mon[126480]: pgmap v8799: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 8 op/s 2023-05-08T08:17:32.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:32 smithi133 ceph-mon[125939]: pgmap v8799: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 8 op/s 2023-05-08T08:17:32.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:32 smithi096 ceph-mon[124666]: pgmap v8799: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 8 op/s 2023-05-08T08:17:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:34 smithi186 ceph-mon[126480]: pgmap v8800: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T08:17:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16392.937596 secs 2023-05-08T08:17:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16393.493711 secs 2023-05-08T08:17:34.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:34 smithi133 ceph-mon[125939]: pgmap v8800: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T08:17:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16392.937596 secs 2023-05-08T08:17:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16393.493711 secs 2023-05-08T08:17:34.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:34 smithi096 ceph-mon[124666]: pgmap v8800: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T08:17:34.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16392.937596 secs 2023-05-08T08:17:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16393.493711 secs 2023-05-08T08:17:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:36 smithi186 ceph-mon[126480]: pgmap v8801: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 938 B/s wr, 9 op/s 2023-05-08T08:17:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16394.777409 secs 2023-05-08T08:17:36.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:36 smithi133 ceph-mon[125939]: pgmap v8801: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 938 B/s wr, 9 op/s 2023-05-08T08:17:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16394.777409 secs 2023-05-08T08:17:36.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:36 smithi096 ceph-mon[124666]: pgmap v8801: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 938 B/s wr, 9 op/s 2023-05-08T08:17:36.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16394.777409 secs 2023-05-08T08:17:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:38 smithi186 ceph-mon[126480]: pgmap v8802: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T08:17:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:38 smithi133 ceph-mon[125939]: pgmap v8802: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T08:17:38.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:38 smithi096 ceph-mon[124666]: pgmap v8802: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T08:17:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16397.937701 secs 2023-05-08T08:17:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16398.493813 secs 2023-05-08T08:17:39.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16397.937701 secs 2023-05-08T08:17:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16398.493813 secs 2023-05-08T08:17:39.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16397.937701 secs 2023-05-08T08:17:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16398.493813 secs 2023-05-08T08:17:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:40 smithi186 ceph-mon[126480]: pgmap v8803: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T08:17:40.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:40 smithi133 ceph-mon[125939]: pgmap v8803: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T08:17:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:40 smithi096 ceph-mon[124666]: pgmap v8803: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T08:17:42.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:42 smithi186 ceph-mon[126480]: pgmap v8804: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 116 KiB/s wr, 10 op/s 2023-05-08T08:17:42.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:42 smithi133 ceph-mon[125939]: pgmap v8804: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 116 KiB/s wr, 10 op/s 2023-05-08T08:17:42.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:42 smithi096 ceph-mon[124666]: pgmap v8804: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 116 KiB/s wr, 10 op/s 2023-05-08T08:17:43.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:17:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:17:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:17:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:44 smithi186 ceph-mon[126480]: pgmap v8805: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 116 KiB/s wr, 7 op/s 2023-05-08T08:17:44.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:17:44.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:17:44.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:17:44.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16402.937822 secs 2023-05-08T08:17:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:44 smithi133 ceph-mon[125939]: pgmap v8805: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 116 KiB/s wr, 7 op/s 2023-05-08T08:17:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:17:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:17:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:17:44.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16402.937822 secs 2023-05-08T08:17:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:44 smithi096 ceph-mon[124666]: pgmap v8805: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 116 KiB/s wr, 7 op/s 2023-05-08T08:17:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:17:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:17:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:17:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16402.937822 secs 2023-05-08T08:17:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:46 smithi186 ceph-mon[126480]: pgmap v8806: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 214 KiB/s wr, 11 op/s 2023-05-08T08:17:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:46 smithi133 ceph-mon[125939]: pgmap v8806: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 214 KiB/s wr, 11 op/s 2023-05-08T08:17:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:46 smithi096 ceph-mon[124666]: pgmap v8806: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 214 KiB/s wr, 11 op/s 2023-05-08T08:17:47.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:17:47.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:17:47.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:17:48.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:48 smithi186 ceph-mon[126480]: pgmap v8807: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 213 KiB/s wr, 7 op/s 2023-05-08T08:17:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:17:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:17:48.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:48 smithi133 ceph-mon[125939]: pgmap v8807: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 213 KiB/s wr, 7 op/s 2023-05-08T08:17:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:17:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:17:48.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:48 smithi096 ceph-mon[124666]: pgmap v8807: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 213 KiB/s wr, 7 op/s 2023-05-08T08:17:48.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:17:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:17:49.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16407.937915 secs 2023-05-08T08:17:49.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16407.937915 secs 2023-05-08T08:17:49.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16407.937915 secs 2023-05-08T08:17:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:50 smithi186 ceph-mon[126480]: pgmap v8808: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 213 KiB/s wr, 7 op/s 2023-05-08T08:17:50.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:50 smithi133 ceph-mon[125939]: pgmap v8808: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 213 KiB/s wr, 7 op/s 2023-05-08T08:17:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:50 smithi096 ceph-mon[124666]: pgmap v8808: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 213 KiB/s wr, 7 op/s 2023-05-08T08:17:52.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:52 smithi186 ceph-mon[126480]: pgmap v8809: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 421 KiB/s wr, 12 op/s 2023-05-08T08:17:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:52 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:17:52.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:52 smithi133 ceph-mon[125939]: pgmap v8809: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 421 KiB/s wr, 12 op/s 2023-05-08T08:17:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:52 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:17:52.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:52 smithi096 ceph-mon[124666]: pgmap v8809: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 421 KiB/s wr, 12 op/s 2023-05-08T08:17:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:52 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:17:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:54 smithi186 ceph-mon[126480]: pgmap v8810: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 319 KiB/s rd, 306 KiB/s wr, 9 op/s 2023-05-08T08:17:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16412.938015 secs 2023-05-08T08:17:54.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:54 smithi133 ceph-mon[125939]: pgmap v8810: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 319 KiB/s rd, 306 KiB/s wr, 9 op/s 2023-05-08T08:17:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16412.938015 secs 2023-05-08T08:17:54.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:54 smithi096 ceph-mon[124666]: pgmap v8810: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 319 KiB/s rd, 306 KiB/s wr, 9 op/s 2023-05-08T08:17:54.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16412.938015 secs 2023-05-08T08:17:56.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:56 smithi186 ceph-mon[126480]: pgmap v8811: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 480 KiB/s wr, 14 op/s 2023-05-08T08:17:56.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16414.777921 secs 2023-05-08T08:17:56.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:56 smithi133 ceph-mon[125939]: pgmap v8811: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 480 KiB/s wr, 14 op/s 2023-05-08T08:17:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16414.777921 secs 2023-05-08T08:17:56.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:56 smithi096 ceph-mon[124666]: pgmap v8811: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 480 KiB/s wr, 14 op/s 2023-05-08T08:17:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16414.777921 secs 2023-05-08T08:17:58.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:58 smithi133 ceph-mon[125939]: pgmap v8812: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 383 KiB/s wr, 10 op/s 2023-05-08T08:17:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:58 smithi096 ceph-mon[124666]: pgmap v8812: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 383 KiB/s wr, 10 op/s 2023-05-08T08:17:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:58 smithi186 ceph-mon[126480]: pgmap v8812: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 383 KiB/s wr, 10 op/s 2023-05-08T08:17:59.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16417.938136 secs 2023-05-08T08:17:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:17:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16418.494328 secs 2023-05-08T08:17:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16417.938136 secs 2023-05-08T08:17:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:17:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16418.494328 secs 2023-05-08T08:17:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16417.938136 secs 2023-05-08T08:17:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:17:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16418.494328 secs 2023-05-08T08:18:00.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:00 smithi133 ceph-mon[125939]: pgmap v8813: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 382 KiB/s wr, 10 op/s 2023-05-08T08:18:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:00 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:18:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:18:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:18:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:18:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:00 smithi096 ceph-mon[124666]: pgmap v8813: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 382 KiB/s wr, 10 op/s 2023-05-08T08:18:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:00 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:18:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:18:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:18:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:18:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:00 smithi186 ceph-mon[126480]: pgmap v8813: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 382 KiB/s wr, 10 op/s 2023-05-08T08:18:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:00 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:18:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:18:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:18:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:18:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16419.778042 secs 2023-05-08T08:18:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16419.778042 secs 2023-05-08T08:18:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16419.778042 secs 2023-05-08T08:18:02.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:02 smithi133 ceph-mon[125939]: pgmap v8814: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 531 KiB/s wr, 15 op/s 2023-05-08T08:18:02.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:02 smithi096 ceph-mon[124666]: pgmap v8814: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 531 KiB/s wr, 15 op/s 2023-05-08T08:18:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:02 smithi186 ceph-mon[126480]: pgmap v8814: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 531 KiB/s wr, 15 op/s 2023-05-08T08:18:04.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:04 smithi133 ceph-mon[125939]: pgmap v8815: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 324 KiB/s rd, 323 KiB/s wr, 10 op/s 2023-05-08T08:18:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16422.938254 secs 2023-05-08T08:18:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16423.494491 secs 2023-05-08T08:18:04.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:04 smithi096 ceph-mon[124666]: pgmap v8815: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 324 KiB/s rd, 323 KiB/s wr, 10 op/s 2023-05-08T08:18:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16422.938254 secs 2023-05-08T08:18:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16423.494491 secs 2023-05-08T08:18:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:04 smithi186 ceph-mon[126480]: pgmap v8815: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 324 KiB/s rd, 323 KiB/s wr, 10 op/s 2023-05-08T08:18:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16422.938254 secs 2023-05-08T08:18:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16423.494491 secs 2023-05-08T08:18:06.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:06 smithi133 ceph-mon[125939]: pgmap v8816: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 368 KiB/s wr, 28 op/s 2023-05-08T08:18:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16424.778156 secs 2023-05-08T08:18:06.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:06 smithi096 ceph-mon[124666]: pgmap v8816: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 368 KiB/s wr, 28 op/s 2023-05-08T08:18:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16424.778156 secs 2023-05-08T08:18:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:06 smithi186 ceph-mon[126480]: pgmap v8816: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 368 KiB/s wr, 28 op/s 2023-05-08T08:18:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16424.778156 secs 2023-05-08T08:18:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:08 smithi133 ceph-mon[125939]: pgmap v8817: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 194 KiB/s wr, 22 op/s 2023-05-08T08:18:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:08 smithi096 ceph-mon[124666]: pgmap v8817: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 194 KiB/s wr, 22 op/s 2023-05-08T08:18:08.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:08 smithi186 ceph-mon[126480]: pgmap v8817: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 194 KiB/s wr, 22 op/s 2023-05-08T08:18:09.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16427.938377 secs 2023-05-08T08:18:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16428.494600 secs 2023-05-08T08:18:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16427.938377 secs 2023-05-08T08:18:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16428.494600 secs 2023-05-08T08:18:09.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16427.938377 secs 2023-05-08T08:18:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16428.494600 secs 2023-05-08T08:18:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:10 smithi133 ceph-mon[125939]: pgmap v8818: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 194 KiB/s wr, 22 op/s 2023-05-08T08:18:10.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:10 smithi096 ceph-mon[124666]: pgmap v8818: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 194 KiB/s wr, 22 op/s 2023-05-08T08:18:10.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:10 smithi186 ceph-mon[126480]: pgmap v8818: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 194 KiB/s wr, 22 op/s 2023-05-08T08:18:11.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16429.778273 secs 2023-05-08T08:18:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:11 smithi133 ceph-mon[125939]: osdmap e628: 12 total, 12 up, 12 in 2023-05-08T08:18:11.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16429.778273 secs 2023-05-08T08:18:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:11 smithi096 ceph-mon[124666]: osdmap e628: 12 total, 12 up, 12 in 2023-05-08T08:18:11.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16429.778273 secs 2023-05-08T08:18:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:11 smithi186 ceph-mon[126480]: osdmap e628: 12 total, 12 up, 12 in 2023-05-08T08:18:12.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:12 smithi133 ceph-mon[125939]: pgmap v8820: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 117 KiB/s wr, 24 op/s 2023-05-08T08:18:12.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:12 smithi096 ceph-mon[124666]: pgmap v8820: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 117 KiB/s wr, 24 op/s 2023-05-08T08:18:12.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:12 smithi186 ceph-mon[126480]: pgmap v8820: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 117 KiB/s wr, 24 op/s 2023-05-08T08:18:14.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:14 smithi133 ceph-mon[125939]: pgmap v8821: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 117 KiB/s wr, 24 op/s 2023-05-08T08:18:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16432.938485 secs 2023-05-08T08:18:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16433.494718 secs 2023-05-08T08:18:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:14 smithi096 ceph-mon[124666]: pgmap v8821: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 117 KiB/s wr, 24 op/s 2023-05-08T08:18:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16432.938485 secs 2023-05-08T08:18:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16433.494718 secs 2023-05-08T08:18:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:14 smithi186 ceph-mon[126480]: pgmap v8821: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 117 KiB/s wr, 24 op/s 2023-05-08T08:18:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16432.938485 secs 2023-05-08T08:18:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16433.494718 secs 2023-05-08T08:18:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:16 smithi133 ceph-mon[125939]: pgmap v8822: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 63 KiB/s wr, 6 op/s 2023-05-08T08:18:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16434.778397 secs 2023-05-08T08:18:16.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:16 smithi096 ceph-mon[124666]: pgmap v8822: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 63 KiB/s wr, 6 op/s 2023-05-08T08:18:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16434.778397 secs 2023-05-08T08:18:16.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:16 smithi186 ceph-mon[126480]: pgmap v8822: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 63 KiB/s wr, 6 op/s 2023-05-08T08:18:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16434.778397 secs 2023-05-08T08:18:18.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:18 smithi186 ceph-mon[126480]: pgmap v8823: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 63 KiB/s wr, 6 op/s 2023-05-08T08:18:18.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:18 smithi186 ceph-mon[126480]: osdmap e629: 12 total, 12 up, 12 in 2023-05-08T08:18:18.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:18 smithi133 ceph-mon[125939]: pgmap v8823: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 63 KiB/s wr, 6 op/s 2023-05-08T08:18:18.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:18 smithi133 ceph-mon[125939]: osdmap e629: 12 total, 12 up, 12 in 2023-05-08T08:18:18.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:18 smithi096 ceph-mon[124666]: pgmap v8823: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 63 KiB/s wr, 6 op/s 2023-05-08T08:18:18.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:18 smithi096 ceph-mon[124666]: osdmap e629: 12 total, 12 up, 12 in 2023-05-08T08:18:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16437.938572 secs 2023-05-08T08:18:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16438.494779 secs 2023-05-08T08:18:19.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16437.938572 secs 2023-05-08T08:18:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16438.494779 secs 2023-05-08T08:18:19.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16437.938572 secs 2023-05-08T08:18:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16438.494779 secs 2023-05-08T08:18:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:20 smithi186 ceph-mon[126480]: pgmap v8825: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 116 B/s wr, 3 op/s 2023-05-08T08:18:20.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:20 smithi133 ceph-mon[125939]: pgmap v8825: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 116 B/s wr, 3 op/s 2023-05-08T08:18:20.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:20 smithi096 ceph-mon[124666]: pgmap v8825: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 116 B/s wr, 3 op/s 2023-05-08T08:18:21.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16439.778491 secs 2023-05-08T08:18:21.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16439.778491 secs 2023-05-08T08:18:21.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16439.778491 secs 2023-05-08T08:18:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:22 smithi186 ceph-mon[126480]: pgmap v8826: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:18:22.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:22 smithi133 ceph-mon[125939]: pgmap v8826: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:18:22.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:22 smithi096 ceph-mon[124666]: pgmap v8826: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:18:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:24 smithi186 ceph-mon[126480]: pgmap v8827: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:18:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16442.938702 secs 2023-05-08T08:18:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16443.494932 secs 2023-05-08T08:18:24.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:24 smithi133 ceph-mon[125939]: pgmap v8827: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:18:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16442.938702 secs 2023-05-08T08:18:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16443.494932 secs 2023-05-08T08:18:24.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:24 smithi096 ceph-mon[124666]: pgmap v8827: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:18:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16442.938702 secs 2023-05-08T08:18:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16443.494932 secs 2023-05-08T08:18:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:26 smithi186 ceph-mon[126480]: pgmap v8828: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T08:18:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16444.778554 secs 2023-05-08T08:18:26.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:26 smithi133 ceph-mon[125939]: pgmap v8828: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T08:18:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16444.778554 secs 2023-05-08T08:18:26.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:26 smithi096 ceph-mon[124666]: pgmap v8828: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T08:18:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16444.778554 secs 2023-05-08T08:18:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:28 smithi186 ceph-mon[126480]: pgmap v8829: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T08:18:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:28 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:18:28.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:28 smithi133 ceph-mon[125939]: pgmap v8829: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T08:18:28.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:28 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:18:28.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:28 smithi096 ceph-mon[124666]: pgmap v8829: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T08:18:28.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:28 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:18:29.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16447.938823 secs 2023-05-08T08:18:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16448.495081 secs 2023-05-08T08:18:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16447.938823 secs 2023-05-08T08:18:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16448.495081 secs 2023-05-08T08:18:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16447.938823 secs 2023-05-08T08:18:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16448.495081 secs 2023-05-08T08:18:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:30 smithi186 ceph-mon[126480]: pgmap v8830: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 171 B/s wr, 5 op/s 2023-05-08T08:18:30.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:30 smithi133 ceph-mon[125939]: pgmap v8830: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 171 B/s wr, 5 op/s 2023-05-08T08:18:30.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:30 smithi096 ceph-mon[124666]: pgmap v8830: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 171 B/s wr, 5 op/s 2023-05-08T08:18:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16449.778651 secs 2023-05-08T08:18:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:31 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:18:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:31 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:18:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:31 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:18:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:31 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:18:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:31 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:18:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:31 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:18:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16449.778651 secs 2023-05-08T08:18:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:31 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:18:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:31 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:18:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:31 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:18:31.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:31 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:18:31.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:31 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:18:31.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:31 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:18:31.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16449.778651 secs 2023-05-08T08:18:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:31 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:18:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:31 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:18:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:31 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:18:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:31 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:18:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:31 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:18:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:31 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:18:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:32 smithi186 ceph-mon[126480]: pgmap v8831: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 8 op/s 2023-05-08T08:18:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:18:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:18:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:18:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:18:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:18:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:18:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:18:32.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:18:32.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:18:32.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:18:32.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:18:32.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:18:32.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:18:32.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:18:32.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:18:32.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:18:32.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:18:32.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:18:32.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:18:32.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:18:32.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:18:32.384 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:32 smithi096 ceph-mon[124666]: pgmap v8831: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 8 op/s 2023-05-08T08:18:32.384 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:18:32.384 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:18:32.384 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:18:32.384 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:18:32.385 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:18:32.385 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:18:32.385 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:18:32.385 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:18:32.385 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:18:32.385 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:18:32.385 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:18:32.386 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:18:32.386 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:18:32.386 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:18:32.386 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:18:32.386 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:18:32.386 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:18:32.386 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:18:32.386 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:18:32.387 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:18:32.387 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:18:32.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:32 smithi133 ceph-mon[125939]: pgmap v8831: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 8 op/s 2023-05-08T08:18:32.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:18:32.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:18:32.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:18:32.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:18:32.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:18:32.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:18:32.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:18:32.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:18:32.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:18:32.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:18:32.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:18:32.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:18:32.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:18:32.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:18:32.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:18:32.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:18:32.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:18:32.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:18:32.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:18:32.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:18:32.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:18:33.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:33 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi096 to 87697k 2023-05-08T08:18:33.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:33 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi096 to 89802641: error parsing value: Value '89802641' is below minimum 939524096 2023-05-08T08:18:33.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:33 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T08:18:33.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:33 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T08:18:33.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:33 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T08:18:33.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:33 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T08:18:33.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:33 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:18:33.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:33 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T08:18:33.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:33 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T08:18:33.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:33 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:18:33.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:33 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi096 to 87697k 2023-05-08T08:18:33.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:33 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi096 to 89802641: error parsing value: Value '89802641' is below minimum 939524096 2023-05-08T08:18:33.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:33 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T08:18:33.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:33 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T08:18:33.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:33 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T08:18:33.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:33 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T08:18:33.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:33 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:18:33.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:33 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T08:18:33.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:33 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T08:18:33.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:33 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:18:33.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:33 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi096 to 87697k 2023-05-08T08:18:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:33 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi096 to 89802641: error parsing value: Value '89802641' is below minimum 939524096 2023-05-08T08:18:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:33 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T08:18:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:33 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T08:18:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:33 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T08:18:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:33 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T08:18:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:33 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:18:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:33 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T08:18:33.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:33 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T08:18:33.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:33 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:18:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:34 smithi186 ceph-mon[126480]: pgmap v8832: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T08:18:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16452.938978 secs 2023-05-08T08:18:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16453.495184 secs 2023-05-08T08:18:34.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:34 smithi133 ceph-mon[125939]: pgmap v8832: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T08:18:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16452.938978 secs 2023-05-08T08:18:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16453.495184 secs 2023-05-08T08:18:34.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:34 smithi096 ceph-mon[124666]: pgmap v8832: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T08:18:34.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16452.938978 secs 2023-05-08T08:18:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16453.495184 secs 2023-05-08T08:18:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:36 smithi186 ceph-mon[126480]: pgmap v8833: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 938 B/s wr, 9 op/s 2023-05-08T08:18:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16454.778768 secs 2023-05-08T08:18:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:36 smithi133 ceph-mon[125939]: pgmap v8833: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 938 B/s wr, 9 op/s 2023-05-08T08:18:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16454.778768 secs 2023-05-08T08:18:36.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:36 smithi096 ceph-mon[124666]: pgmap v8833: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 938 B/s wr, 9 op/s 2023-05-08T08:18:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16454.778768 secs 2023-05-08T08:18:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:38 smithi186 ceph-mon[126480]: pgmap v8834: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T08:18:38.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:38 smithi133 ceph-mon[125939]: pgmap v8834: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T08:18:38.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:38 smithi096 ceph-mon[124666]: pgmap v8834: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T08:18:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16457.939095 secs 2023-05-08T08:18:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16458.495321 secs 2023-05-08T08:18:39.479 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16457.939095 secs 2023-05-08T08:18:39.479 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16458.495321 secs 2023-05-08T08:18:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16457.939095 secs 2023-05-08T08:18:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16458.495321 secs 2023-05-08T08:18:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:40 smithi186 ceph-mon[126480]: pgmap v8835: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T08:18:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:40 smithi133 ceph-mon[125939]: pgmap v8835: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T08:18:40.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:40 smithi096 ceph-mon[124666]: pgmap v8835: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T08:18:42.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:42 smithi186 ceph-mon[126480]: pgmap v8836: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 191 KiB/s wr, 10 op/s 2023-05-08T08:18:42.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:42 smithi133 ceph-mon[125939]: pgmap v8836: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 191 KiB/s wr, 10 op/s 2023-05-08T08:18:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:42 smithi096 ceph-mon[124666]: pgmap v8836: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 191 KiB/s wr, 10 op/s 2023-05-08T08:18:43.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:18:43.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:18:43.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:18:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:44 smithi186 ceph-mon[126480]: pgmap v8837: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 191 KiB/s wr, 7 op/s 2023-05-08T08:18:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:18:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:18:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:18:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16462.939207 secs 2023-05-08T08:18:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:44 smithi133 ceph-mon[125939]: pgmap v8837: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 191 KiB/s wr, 7 op/s 2023-05-08T08:18:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:18:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:18:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:18:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16462.939207 secs 2023-05-08T08:18:44.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:44 smithi096 ceph-mon[124666]: pgmap v8837: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 191 KiB/s wr, 7 op/s 2023-05-08T08:18:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:18:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:18:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:18:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16462.939207 secs 2023-05-08T08:18:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:46 smithi186 ceph-mon[126480]: pgmap v8838: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 215 KiB/s wr, 11 op/s 2023-05-08T08:18:46.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:46 smithi133 ceph-mon[125939]: pgmap v8838: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 215 KiB/s wr, 11 op/s 2023-05-08T08:18:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:46 smithi096 ceph-mon[124666]: pgmap v8838: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 215 KiB/s wr, 11 op/s 2023-05-08T08:18:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:18:47.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:18:47.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:18:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:48 smithi186 ceph-mon[126480]: pgmap v8839: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 214 KiB/s wr, 7 op/s 2023-05-08T08:18:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:18:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:18:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:48 smithi133 ceph-mon[125939]: pgmap v8839: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 214 KiB/s wr, 7 op/s 2023-05-08T08:18:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:18:48.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:18:48.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:48 smithi096 ceph-mon[124666]: pgmap v8839: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 214 KiB/s wr, 7 op/s 2023-05-08T08:18:48.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:18:48.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:18:49.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16467.939369 secs 2023-05-08T08:18:49.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16467.939369 secs 2023-05-08T08:18:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16467.939369 secs 2023-05-08T08:18:50.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:50 smithi133 ceph-mon[125939]: pgmap v8840: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 214 KiB/s wr, 7 op/s 2023-05-08T08:18:50.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:50 smithi096 ceph-mon[124666]: pgmap v8840: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 214 KiB/s wr, 7 op/s 2023-05-08T08:18:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:50 smithi186 ceph-mon[126480]: pgmap v8840: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 214 KiB/s wr, 7 op/s 2023-05-08T08:18:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16469.779119 secs 2023-05-08T08:18:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16469.779119 secs 2023-05-08T08:18:51.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16469.779119 secs 2023-05-08T08:18:52.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:52 smithi133 ceph-mon[125939]: pgmap v8841: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 499 KiB/s wr, 13 op/s 2023-05-08T08:18:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:52 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:18:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:18:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:18:52.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:52 smithi096 ceph-mon[124666]: pgmap v8841: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 499 KiB/s wr, 13 op/s 2023-05-08T08:18:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:52 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:18:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:18:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:18:52.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:52 smithi186 ceph-mon[126480]: pgmap v8841: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 499 KiB/s wr, 13 op/s 2023-05-08T08:18:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:52 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:18:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:18:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:18:54.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:54 smithi133 ceph-mon[125939]: pgmap v8842: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 308 KiB/s wr, 9 op/s 2023-05-08T08:18:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16472.939440 secs 2023-05-08T08:18:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:54 smithi096 ceph-mon[124666]: pgmap v8842: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 308 KiB/s wr, 9 op/s 2023-05-08T08:18:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16472.939440 secs 2023-05-08T08:18:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:54 smithi186 ceph-mon[126480]: pgmap v8842: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 308 KiB/s wr, 9 op/s 2023-05-08T08:18:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16472.939440 secs 2023-05-08T08:18:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:56 smithi133 ceph-mon[125939]: pgmap v8843: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 406 KiB/s wr, 14 op/s 2023-05-08T08:18:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16474.779216 secs 2023-05-08T08:18:56.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:56 smithi096 ceph-mon[124666]: pgmap v8843: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 406 KiB/s wr, 14 op/s 2023-05-08T08:18:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16474.779216 secs 2023-05-08T08:18:56.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:56 smithi186 ceph-mon[126480]: pgmap v8843: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 406 KiB/s wr, 14 op/s 2023-05-08T08:18:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16474.779216 secs 2023-05-08T08:18:58.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:58 smithi133 ceph-mon[125939]: pgmap v8844: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 391 KiB/s wr, 11 op/s 2023-05-08T08:18:58.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:58 smithi096 ceph-mon[124666]: pgmap v8844: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 391 KiB/s wr, 11 op/s 2023-05-08T08:18:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:58 smithi186 ceph-mon[126480]: pgmap v8844: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 391 KiB/s wr, 11 op/s 2023-05-08T08:18:59.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16477.939546 secs 2023-05-08T08:18:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:18:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16478.495689 secs 2023-05-08T08:18:59.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16477.939546 secs 2023-05-08T08:18:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:18:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16478.495689 secs 2023-05-08T08:18:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16477.939546 secs 2023-05-08T08:18:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:18:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16478.495689 secs 2023-05-08T08:19:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:00 smithi133 ceph-mon[125939]: pgmap v8845: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 391 KiB/s wr, 11 op/s 2023-05-08T08:19:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:00 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:19:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:19:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:19:00.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:00 smithi096 ceph-mon[124666]: pgmap v8845: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 391 KiB/s wr, 11 op/s 2023-05-08T08:19:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:00 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:19:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:19:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:19:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:00 smithi186 ceph-mon[126480]: pgmap v8845: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 391 KiB/s wr, 11 op/s 2023-05-08T08:19:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:00 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:19:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:19:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:19:01.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16479.779334 secs 2023-05-08T08:19:01.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16479.779334 secs 2023-05-08T08:19:01.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16479.779334 secs 2023-05-08T08:19:02.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:02 smithi133 ceph-mon[125939]: pgmap v8846: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 554 KiB/s rd, 541 KiB/s wr, 16 op/s 2023-05-08T08:19:02.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:02 smithi096 ceph-mon[124666]: pgmap v8846: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 554 KiB/s rd, 541 KiB/s wr, 16 op/s 2023-05-08T08:19:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:02 smithi186 ceph-mon[126480]: pgmap v8846: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 554 KiB/s rd, 541 KiB/s wr, 16 op/s 2023-05-08T08:19:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:04 smithi133 ceph-mon[125939]: pgmap v8847: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 257 KiB/s wr, 11 op/s 2023-05-08T08:19:04.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16482.939666 secs 2023-05-08T08:19:04.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16483.495810 secs 2023-05-08T08:19:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:04 smithi096 ceph-mon[124666]: pgmap v8847: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 257 KiB/s wr, 11 op/s 2023-05-08T08:19:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16482.939666 secs 2023-05-08T08:19:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16483.495810 secs 2023-05-08T08:19:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:04 smithi186 ceph-mon[126480]: pgmap v8847: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 257 KiB/s wr, 11 op/s 2023-05-08T08:19:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16482.939666 secs 2023-05-08T08:19:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16483.495810 secs 2023-05-08T08:19:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:06 smithi133 ceph-mon[125939]: pgmap v8848: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 302 KiB/s wr, 29 op/s 2023-05-08T08:19:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16484.779468 secs 2023-05-08T08:19:06.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:06 smithi096 ceph-mon[124666]: pgmap v8848: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 302 KiB/s wr, 29 op/s 2023-05-08T08:19:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16484.779468 secs 2023-05-08T08:19:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:06 smithi186 ceph-mon[126480]: pgmap v8848: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 302 KiB/s wr, 29 op/s 2023-05-08T08:19:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16484.779468 secs 2023-05-08T08:19:08.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:08 smithi133 ceph-mon[125939]: pgmap v8849: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 205 KiB/s wr, 24 op/s 2023-05-08T08:19:08.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:08 smithi096 ceph-mon[124666]: pgmap v8849: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 205 KiB/s wr, 24 op/s 2023-05-08T08:19:08.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:08 smithi186 ceph-mon[126480]: pgmap v8849: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 205 KiB/s wr, 24 op/s 2023-05-08T08:19:09.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16487.939788 secs 2023-05-08T08:19:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16488.495943 secs 2023-05-08T08:19:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16487.939788 secs 2023-05-08T08:19:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16488.495943 secs 2023-05-08T08:19:09.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16487.939788 secs 2023-05-08T08:19:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16488.495943 secs 2023-05-08T08:19:10.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:10 smithi133 ceph-mon[125939]: pgmap v8850: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 196 KiB/s wr, 23 op/s 2023-05-08T08:19:10.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:10 smithi096 ceph-mon[124666]: pgmap v8850: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 196 KiB/s wr, 23 op/s 2023-05-08T08:19:10.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:10 smithi186 ceph-mon[126480]: pgmap v8850: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 196 KiB/s wr, 23 op/s 2023-05-08T08:19:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16489.779560 secs 2023-05-08T08:19:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:11 smithi133 ceph-mon[125939]: osdmap e630: 12 total, 12 up, 12 in 2023-05-08T08:19:11.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16489.779560 secs 2023-05-08T08:19:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:11 smithi096 ceph-mon[124666]: osdmap e630: 12 total, 12 up, 12 in 2023-05-08T08:19:11.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16489.779560 secs 2023-05-08T08:19:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:11 smithi186 ceph-mon[126480]: osdmap e630: 12 total, 12 up, 12 in 2023-05-08T08:19:12.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:12 smithi133 ceph-mon[125939]: pgmap v8852: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 208 KiB/s wr, 26 op/s 2023-05-08T08:19:12.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:12 smithi096 ceph-mon[124666]: pgmap v8852: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 208 KiB/s wr, 26 op/s 2023-05-08T08:19:12.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:12 smithi186 ceph-mon[126480]: pgmap v8852: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 208 KiB/s wr, 26 op/s 2023-05-08T08:19:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:14 smithi133 ceph-mon[125939]: pgmap v8853: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 208 KiB/s wr, 26 op/s 2023-05-08T08:19:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16492.939907 secs 2023-05-08T08:19:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16493.496064 secs 2023-05-08T08:19:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:14 smithi096 ceph-mon[124666]: pgmap v8853: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 208 KiB/s wr, 26 op/s 2023-05-08T08:19:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16492.939907 secs 2023-05-08T08:19:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16493.496064 secs 2023-05-08T08:19:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:14 smithi186 ceph-mon[126480]: pgmap v8853: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 208 KiB/s wr, 26 op/s 2023-05-08T08:19:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16492.939907 secs 2023-05-08T08:19:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16493.496064 secs 2023-05-08T08:19:16.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:16 smithi133 ceph-mon[125939]: pgmap v8854: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 154 KiB/s wr, 8 op/s 2023-05-08T08:19:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16494.779686 secs 2023-05-08T08:19:16.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:16 smithi096 ceph-mon[124666]: pgmap v8854: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 154 KiB/s wr, 8 op/s 2023-05-08T08:19:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16494.779686 secs 2023-05-08T08:19:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:16 smithi186 ceph-mon[126480]: pgmap v8854: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 154 KiB/s wr, 8 op/s 2023-05-08T08:19:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16494.779686 secs 2023-05-08T08:19:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:18 smithi186 ceph-mon[126480]: pgmap v8855: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 153 KiB/s wr, 8 op/s 2023-05-08T08:19:18.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:18 smithi186 ceph-mon[126480]: osdmap e631: 12 total, 12 up, 12 in 2023-05-08T08:19:18.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:18 smithi133 ceph-mon[125939]: pgmap v8855: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 153 KiB/s wr, 8 op/s 2023-05-08T08:19:18.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:18 smithi133 ceph-mon[125939]: osdmap e631: 12 total, 12 up, 12 in 2023-05-08T08:19:18.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:18 smithi096 ceph-mon[124666]: pgmap v8855: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 153 KiB/s wr, 8 op/s 2023-05-08T08:19:18.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:18 smithi096 ceph-mon[124666]: osdmap e631: 12 total, 12 up, 12 in 2023-05-08T08:19:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16497.940030 secs 2023-05-08T08:19:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16498.496171 secs 2023-05-08T08:19:19.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16497.940030 secs 2023-05-08T08:19:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16498.496171 secs 2023-05-08T08:19:19.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16497.940030 secs 2023-05-08T08:19:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16498.496171 secs 2023-05-08T08:19:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:20 smithi186 ceph-mon[126480]: pgmap v8857: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 232 B/s wr, 5 op/s 2023-05-08T08:19:20.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:20 smithi133 ceph-mon[125939]: pgmap v8857: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 232 B/s wr, 5 op/s 2023-05-08T08:19:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:20 smithi096 ceph-mon[124666]: pgmap v8857: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 232 B/s wr, 5 op/s 2023-05-08T08:19:21.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16499.779839 secs 2023-05-08T08:19:21.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16499.779839 secs 2023-05-08T08:19:21.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16499.779839 secs 2023-05-08T08:19:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:22 smithi186 ceph-mon[126480]: pgmap v8858: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 7 op/s 2023-05-08T08:19:22.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:22 smithi133 ceph-mon[125939]: pgmap v8858: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 7 op/s 2023-05-08T08:19:22.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:22 smithi096 ceph-mon[124666]: pgmap v8858: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 7 op/s 2023-05-08T08:19:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:24 smithi186 ceph-mon[126480]: pgmap v8859: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 7 op/s 2023-05-08T08:19:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16502.940150 secs 2023-05-08T08:19:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16503.496266 secs 2023-05-08T08:19:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:24 smithi133 ceph-mon[125939]: pgmap v8859: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 7 op/s 2023-05-08T08:19:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16502.940150 secs 2023-05-08T08:19:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16503.496266 secs 2023-05-08T08:19:24.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:24 smithi096 ceph-mon[124666]: pgmap v8859: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 7 op/s 2023-05-08T08:19:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16502.940150 secs 2023-05-08T08:19:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16503.496266 secs 2023-05-08T08:19:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:26 smithi186 ceph-mon[126480]: pgmap v8860: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 7 op/s 2023-05-08T08:19:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16504.779980 secs 2023-05-08T08:19:26.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:26 smithi133 ceph-mon[125939]: pgmap v8860: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 7 op/s 2023-05-08T08:19:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16504.779980 secs 2023-05-08T08:19:26.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:26 smithi096 ceph-mon[124666]: pgmap v8860: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 7 op/s 2023-05-08T08:19:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16504.779980 secs 2023-05-08T08:19:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:28 smithi186 ceph-mon[126480]: pgmap v8861: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 7 op/s 2023-05-08T08:19:28.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:28 smithi133 ceph-mon[125939]: pgmap v8861: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 7 op/s 2023-05-08T08:19:28.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:28 smithi096 ceph-mon[124666]: pgmap v8861: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 7 op/s 2023-05-08T08:19:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16507.940278 secs 2023-05-08T08:19:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16508.496413 secs 2023-05-08T08:19:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16507.940278 secs 2023-05-08T08:19:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16508.496413 secs 2023-05-08T08:19:29.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16507.940278 secs 2023-05-08T08:19:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16508.496413 secs 2023-05-08T08:19:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:30 smithi186 ceph-mon[126480]: pgmap v8862: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 171 B/s wr, 6 op/s 2023-05-08T08:19:30.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:30 smithi133 ceph-mon[125939]: pgmap v8862: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 171 B/s wr, 6 op/s 2023-05-08T08:19:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:30 smithi096 ceph-mon[124666]: pgmap v8862: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 171 B/s wr, 6 op/s 2023-05-08T08:19:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16509.780125 secs 2023-05-08T08:19:31.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16509.780125 secs 2023-05-08T08:19:31.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16509.780125 secs 2023-05-08T08:19:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:32 smithi186 ceph-mon[126480]: pgmap v8863: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1023 B/s wr, 10 op/s 2023-05-08T08:19:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:19:32.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:32 smithi133 ceph-mon[125939]: pgmap v8863: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1023 B/s wr, 10 op/s 2023-05-08T08:19:32.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:19:32.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:32 smithi096 ceph-mon[124666]: pgmap v8863: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1023 B/s wr, 10 op/s 2023-05-08T08:19:32.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:19:33.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:33 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:19:33.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:33 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:19:33.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:33 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:19:33.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:33 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:19:33.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:33 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:19:33.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:33 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:19:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:33 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:19:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:33 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:19:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:33 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:19:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:34 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:19:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:34 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T08:19:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:34 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T08:19:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:34 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:19:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:34 smithi186 ceph-mon[126480]: pgmap v8864: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 938 B/s wr, 7 op/s 2023-05-08T08:19:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16512.940388 secs 2023-05-08T08:19:34.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16513.496556 secs 2023-05-08T08:19:34.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:34 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:19:34.502 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:34 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T08:19:34.502 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:34 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T08:19:34.502 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:34 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:19:34.502 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:34 smithi133 ceph-mon[125939]: pgmap v8864: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 938 B/s wr, 7 op/s 2023-05-08T08:19:34.502 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16512.940388 secs 2023-05-08T08:19:34.502 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16513.496556 secs 2023-05-08T08:19:34.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:34 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:19:34.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:34 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T08:19:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:34 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T08:19:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:34 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:19:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:34 smithi096 ceph-mon[124666]: pgmap v8864: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 938 B/s wr, 7 op/s 2023-05-08T08:19:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16512.940388 secs 2023-05-08T08:19:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16513.496556 secs 2023-05-08T08:19:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:36 smithi186 ceph-mon[126480]: pgmap v8865: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 103 KiB/s wr, 10 op/s 2023-05-08T08:19:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16514.780243 secs 2023-05-08T08:19:36.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:36 smithi133 ceph-mon[125939]: pgmap v8865: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 103 KiB/s wr, 10 op/s 2023-05-08T08:19:36.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16514.780243 secs 2023-05-08T08:19:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:36 smithi096 ceph-mon[124666]: pgmap v8865: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 103 KiB/s wr, 10 op/s 2023-05-08T08:19:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16514.780243 secs 2023-05-08T08:19:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:38 smithi186 ceph-mon[126480]: pgmap v8866: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 103 KiB/s wr, 7 op/s 2023-05-08T08:19:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:38 smithi133 ceph-mon[125939]: pgmap v8866: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 103 KiB/s wr, 7 op/s 2023-05-08T08:19:38.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:38 smithi096 ceph-mon[124666]: pgmap v8866: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 103 KiB/s wr, 7 op/s 2023-05-08T08:19:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16517.940521 secs 2023-05-08T08:19:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16518.496667 secs 2023-05-08T08:19:39.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16517.940521 secs 2023-05-08T08:19:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16518.496667 secs 2023-05-08T08:19:39.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16517.940521 secs 2023-05-08T08:19:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16518.496667 secs 2023-05-08T08:19:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:40 smithi186 ceph-mon[126480]: pgmap v8867: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 103 KiB/s wr, 7 op/s 2023-05-08T08:19:40.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:40 smithi133 ceph-mon[125939]: pgmap v8867: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 103 KiB/s wr, 7 op/s 2023-05-08T08:19:40.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:40 smithi096 ceph-mon[124666]: pgmap v8867: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 103 KiB/s wr, 7 op/s 2023-05-08T08:19:42.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:42 smithi186 ceph-mon[126480]: pgmap v8868: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 103 KiB/s wr, 10 op/s 2023-05-08T08:19:42.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:42 smithi133 ceph-mon[125939]: pgmap v8868: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 103 KiB/s wr, 10 op/s 2023-05-08T08:19:42.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:42 smithi096 ceph-mon[124666]: pgmap v8868: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 103 KiB/s wr, 10 op/s 2023-05-08T08:19:43.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:19:43.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:19:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:19:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:44 smithi186 ceph-mon[126480]: pgmap v8869: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 102 KiB/s wr, 6 op/s 2023-05-08T08:19:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:19:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:19:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:19:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16522.940594 secs 2023-05-08T08:19:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16523.496777 secs 2023-05-08T08:19:44.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:44 smithi133 ceph-mon[125939]: pgmap v8869: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 102 KiB/s wr, 6 op/s 2023-05-08T08:19:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:19:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:19:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:19:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16522.940594 secs 2023-05-08T08:19:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16523.496777 secs 2023-05-08T08:19:44.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:44 smithi096 ceph-mon[124666]: pgmap v8869: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 102 KiB/s wr, 6 op/s 2023-05-08T08:19:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:19:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:19:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:19:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16522.940594 secs 2023-05-08T08:19:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16523.496777 secs 2023-05-08T08:19:46.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:46 smithi186 ceph-mon[126480]: pgmap v8870: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 222 KiB/s wr, 9 op/s 2023-05-08T08:19:46.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:46 smithi133 ceph-mon[125939]: pgmap v8870: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 222 KiB/s wr, 9 op/s 2023-05-08T08:19:46.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:46 smithi096 ceph-mon[124666]: pgmap v8870: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 222 KiB/s wr, 9 op/s 2023-05-08T08:19:48.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:48 smithi133 ceph-mon[125939]: pgmap v8871: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 128 KiB/s wr, 6 op/s 2023-05-08T08:19:48.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:48 smithi096 ceph-mon[124666]: pgmap v8871: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 128 KiB/s wr, 6 op/s 2023-05-08T08:19:48.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:48 smithi186 ceph-mon[126480]: pgmap v8871: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 128 KiB/s wr, 6 op/s 2023-05-08T08:19:49.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16527.940711 secs 2023-05-08T08:19:49.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16527.940711 secs 2023-05-08T08:19:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16527.940711 secs 2023-05-08T08:19:50.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:50 smithi133 ceph-mon[125939]: pgmap v8872: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 128 KiB/s wr, 6 op/s 2023-05-08T08:19:50.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:50 smithi096 ceph-mon[124666]: pgmap v8872: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 128 KiB/s wr, 6 op/s 2023-05-08T08:19:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:50 smithi186 ceph-mon[126480]: pgmap v8872: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 128 KiB/s wr, 6 op/s 2023-05-08T08:19:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:19:51.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:19:51.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:19:52.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:52 smithi133 ceph-mon[125939]: pgmap v8873: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 381 KiB/s rd, 303 KiB/s wr, 11 op/s 2023-05-08T08:19:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:52 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:19:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:19:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:19:52.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:52 smithi096 ceph-mon[124666]: pgmap v8873: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 381 KiB/s rd, 303 KiB/s wr, 11 op/s 2023-05-08T08:19:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:52 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:19:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:19:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:19:52.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:52 smithi186 ceph-mon[126480]: pgmap v8873: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 381 KiB/s rd, 303 KiB/s wr, 11 op/s 2023-05-08T08:19:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:52 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:19:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:19:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:19:54.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:54 smithi133 ceph-mon[125939]: pgmap v8874: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 324 KiB/s rd, 303 KiB/s wr, 7 op/s 2023-05-08T08:19:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16532.940833 secs 2023-05-08T08:19:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16533.497012 secs 2023-05-08T08:19:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:54 smithi096 ceph-mon[124666]: pgmap v8874: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 324 KiB/s rd, 303 KiB/s wr, 7 op/s 2023-05-08T08:19:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16532.940833 secs 2023-05-08T08:19:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16533.497012 secs 2023-05-08T08:19:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:54 smithi186 ceph-mon[126480]: pgmap v8874: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 324 KiB/s rd, 303 KiB/s wr, 7 op/s 2023-05-08T08:19:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16532.940833 secs 2023-05-08T08:19:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16533.497012 secs 2023-05-08T08:19:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:56 smithi133 ceph-mon[125939]: pgmap v8875: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 452 KiB/s rd, 492 KiB/s wr, 12 op/s 2023-05-08T08:19:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16534.780771 secs 2023-05-08T08:19:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:19:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:19:56.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:56 smithi096 ceph-mon[124666]: pgmap v8875: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 452 KiB/s rd, 492 KiB/s wr, 12 op/s 2023-05-08T08:19:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16534.780771 secs 2023-05-08T08:19:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:19:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:19:56.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:56 smithi186 ceph-mon[126480]: pgmap v8875: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 452 KiB/s rd, 492 KiB/s wr, 12 op/s 2023-05-08T08:19:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16534.780771 secs 2023-05-08T08:19:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:19:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:19:57.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:57 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:19:57.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:57 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:19:57.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:57 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:19:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:58 smithi133 ceph-mon[125939]: pgmap v8876: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 333 KiB/s rd, 381 KiB/s wr, 11 op/s 2023-05-08T08:19:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:58 smithi096 ceph-mon[124666]: pgmap v8876: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 333 KiB/s rd, 381 KiB/s wr, 11 op/s 2023-05-08T08:19:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:58 smithi186 ceph-mon[126480]: pgmap v8876: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 333 KiB/s rd, 381 KiB/s wr, 11 op/s 2023-05-08T08:19:59.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16537.940977 secs 2023-05-08T08:19:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:19:59 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:19:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16537.940977 secs 2023-05-08T08:19:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:19:59 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:19:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16537.940977 secs 2023-05-08T08:19:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:19:59 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:20:00.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:00 smithi133 ceph-mon[125939]: pgmap v8877: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 373 KiB/s wr, 10 op/s 2023-05-08T08:20:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:20:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:20:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:20:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:00 smithi133 ceph-mon[125939]: Health detail: HEALTH_WARN 2 MDSs report slow requests 2023-05-08T08:20:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:00 smithi133 ceph-mon[125939]: [WRN] MDS_SLOW_REQUEST: 2 MDSs report slow requests 2023-05-08T08:20:00.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:00 smithi133 ceph-mon[125939]: mds.i(mds.1): 1 slow requests are blocked > 180 secs 2023-05-08T08:20:00.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:00 smithi133 ceph-mon[125939]: mds.b(mds.0): 1 slow requests are blocked > 180 secs 2023-05-08T08:20:00.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:00 smithi096 ceph-mon[124666]: pgmap v8877: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 373 KiB/s wr, 10 op/s 2023-05-08T08:20:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:20:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:20:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:20:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:00 smithi096 ceph-mon[124666]: Health detail: HEALTH_WARN 2 MDSs report slow requests 2023-05-08T08:20:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:00 smithi096 ceph-mon[124666]: [WRN] MDS_SLOW_REQUEST: 2 MDSs report slow requests 2023-05-08T08:20:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:00 smithi096 ceph-mon[124666]: mds.i(mds.1): 1 slow requests are blocked > 180 secs 2023-05-08T08:20:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:00 smithi096 ceph-mon[124666]: mds.b(mds.0): 1 slow requests are blocked > 180 secs 2023-05-08T08:20:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:00 smithi186 ceph-mon[126480]: pgmap v8877: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 373 KiB/s wr, 10 op/s 2023-05-08T08:20:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:20:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:20:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:20:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:00 smithi186 ceph-mon[126480]: Health detail: HEALTH_WARN 2 MDSs report slow requests 2023-05-08T08:20:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:00 smithi186 ceph-mon[126480]: [WRN] MDS_SLOW_REQUEST: 2 MDSs report slow requests 2023-05-08T08:20:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:00 smithi186 ceph-mon[126480]: mds.i(mds.1): 1 slow requests are blocked > 180 secs 2023-05-08T08:20:00.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:00 smithi186 ceph-mon[126480]: mds.b(mds.0): 1 slow requests are blocked > 180 secs 2023-05-08T08:20:01.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16539.780904 secs 2023-05-08T08:20:01.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16539.780904 secs 2023-05-08T08:20:01.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16539.780904 secs 2023-05-08T08:20:02.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:02 smithi133 ceph-mon[125939]: pgmap v8878: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 549 KiB/s rd, 524 KiB/s wr, 15 op/s 2023-05-08T08:20:02.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:02 smithi096 ceph-mon[124666]: pgmap v8878: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 549 KiB/s rd, 524 KiB/s wr, 15 op/s 2023-05-08T08:20:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:02 smithi186 ceph-mon[126480]: pgmap v8878: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 549 KiB/s rd, 524 KiB/s wr, 15 op/s 2023-05-08T08:20:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:04 smithi133 ceph-mon[125939]: pgmap v8879: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 349 KiB/s wr, 11 op/s 2023-05-08T08:20:04.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16542.941121 secs 2023-05-08T08:20:04.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16543.497218 secs 2023-05-08T08:20:04.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:04 smithi096 ceph-mon[124666]: pgmap v8879: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 349 KiB/s wr, 11 op/s 2023-05-08T08:20:04.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16542.941121 secs 2023-05-08T08:20:04.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16543.497218 secs 2023-05-08T08:20:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:04 smithi186 ceph-mon[126480]: pgmap v8879: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 349 KiB/s wr, 11 op/s 2023-05-08T08:20:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16542.941121 secs 2023-05-08T08:20:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16543.497218 secs 2023-05-08T08:20:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:06 smithi133 ceph-mon[125939]: pgmap v8880: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 483 KiB/s rd, 506 KiB/s wr, 29 op/s 2023-05-08T08:20:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16544.781037 secs 2023-05-08T08:20:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:06 smithi133 ceph-mon[125939]: osdmap e632: 12 total, 12 up, 12 in 2023-05-08T08:20:06.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:06 smithi096 ceph-mon[124666]: pgmap v8880: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 483 KiB/s rd, 506 KiB/s wr, 29 op/s 2023-05-08T08:20:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16544.781037 secs 2023-05-08T08:20:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:06 smithi096 ceph-mon[124666]: osdmap e632: 12 total, 12 up, 12 in 2023-05-08T08:20:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:06 smithi186 ceph-mon[126480]: pgmap v8880: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 483 KiB/s rd, 506 KiB/s wr, 29 op/s 2023-05-08T08:20:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16544.781037 secs 2023-05-08T08:20:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:06 smithi186 ceph-mon[126480]: osdmap e632: 12 total, 12 up, 12 in 2023-05-08T08:20:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:08 smithi186 ceph-mon[126480]: pgmap v8882: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 370 KiB/s wr, 29 op/s 2023-05-08T08:20:08.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:08 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:20:08.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:20:08.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:20:08.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:08 smithi133 ceph-mon[125939]: pgmap v8882: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 370 KiB/s wr, 29 op/s 2023-05-08T08:20:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:08 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:20:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:20:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:20:08.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:08 smithi096 ceph-mon[124666]: pgmap v8882: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 370 KiB/s wr, 29 op/s 2023-05-08T08:20:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:08 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:20:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:20:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:20:09.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16547.941264 secs 2023-05-08T08:20:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16548.497333 secs 2023-05-08T08:20:09.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16547.941264 secs 2023-05-08T08:20:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16548.497333 secs 2023-05-08T08:20:09.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16547.941264 secs 2023-05-08T08:20:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16548.497333 secs 2023-05-08T08:20:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:10 smithi186 ceph-mon[126480]: pgmap v8883: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 370 KiB/s wr, 29 op/s 2023-05-08T08:20:10.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:10 smithi133 ceph-mon[125939]: pgmap v8883: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 370 KiB/s wr, 29 op/s 2023-05-08T08:20:10.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:10 smithi096 ceph-mon[124666]: pgmap v8883: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 370 KiB/s wr, 29 op/s 2023-05-08T08:20:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16549.781141 secs 2023-05-08T08:20:11.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16549.781141 secs 2023-05-08T08:20:11.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16549.781141 secs 2023-05-08T08:20:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:12 smithi186 ceph-mon[126480]: pgmap v8884: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 262 KiB/s wr, 27 op/s 2023-05-08T08:20:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:12 smithi186 ceph-mon[126480]: osdmap e633: 12 total, 12 up, 12 in 2023-05-08T08:20:12.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:12 smithi133 ceph-mon[125939]: pgmap v8884: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 262 KiB/s wr, 27 op/s 2023-05-08T08:20:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:12 smithi133 ceph-mon[125939]: osdmap e633: 12 total, 12 up, 12 in 2023-05-08T08:20:12.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:12 smithi096 ceph-mon[124666]: pgmap v8884: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 262 KiB/s wr, 27 op/s 2023-05-08T08:20:12.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:12 smithi096 ceph-mon[124666]: osdmap e633: 12 total, 12 up, 12 in 2023-05-08T08:20:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:14 smithi186 ceph-mon[126480]: pgmap v8886: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 92 KiB/s wr, 6 op/s 2023-05-08T08:20:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16552.941417 secs 2023-05-08T08:20:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16553.497455 secs 2023-05-08T08:20:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:14 smithi133 ceph-mon[125939]: pgmap v8886: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 92 KiB/s wr, 6 op/s 2023-05-08T08:20:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16552.941417 secs 2023-05-08T08:20:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16553.497455 secs 2023-05-08T08:20:14.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:14 smithi096 ceph-mon[124666]: pgmap v8886: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 92 KiB/s wr, 6 op/s 2023-05-08T08:20:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16552.941417 secs 2023-05-08T08:20:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16553.497455 secs 2023-05-08T08:20:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:16 smithi186 ceph-mon[126480]: pgmap v8887: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 114 KiB/s wr, 8 op/s 2023-05-08T08:20:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16554.781265 secs 2023-05-08T08:20:16.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:16 smithi133 ceph-mon[125939]: pgmap v8887: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 114 KiB/s wr, 8 op/s 2023-05-08T08:20:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16554.781265 secs 2023-05-08T08:20:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:16 smithi096 ceph-mon[124666]: pgmap v8887: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 114 KiB/s wr, 8 op/s 2023-05-08T08:20:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16554.781265 secs 2023-05-08T08:20:18.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:18 smithi186 ceph-mon[126480]: pgmap v8888: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 111 KiB/s wr, 8 op/s 2023-05-08T08:20:18.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:18 smithi133 ceph-mon[125939]: pgmap v8888: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 111 KiB/s wr, 8 op/s 2023-05-08T08:20:18.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:18 smithi096 ceph-mon[124666]: pgmap v8888: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 111 KiB/s wr, 8 op/s 2023-05-08T08:20:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16557.941547 secs 2023-05-08T08:20:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16558.497571 secs 2023-05-08T08:20:19.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16557.941547 secs 2023-05-08T08:20:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16558.497571 secs 2023-05-08T08:20:19.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16557.941547 secs 2023-05-08T08:20:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16558.497571 secs 2023-05-08T08:20:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:20 smithi186 ceph-mon[126480]: pgmap v8889: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 111 KiB/s wr, 8 op/s 2023-05-08T08:20:20.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:20 smithi133 ceph-mon[125939]: pgmap v8889: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 111 KiB/s wr, 8 op/s 2023-05-08T08:20:20.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:20 smithi096 ceph-mon[124666]: pgmap v8889: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 111 KiB/s wr, 8 op/s 2023-05-08T08:20:21.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16559.781406 secs 2023-05-08T08:20:21.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16559.781406 secs 2023-05-08T08:20:21.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16559.781406 secs 2023-05-08T08:20:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:22 smithi186 ceph-mon[126480]: pgmap v8890: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 38 KiB/s wr, 7 op/s 2023-05-08T08:20:22.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:22 smithi133 ceph-mon[125939]: pgmap v8890: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 38 KiB/s wr, 7 op/s 2023-05-08T08:20:22.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:22 smithi096 ceph-mon[124666]: pgmap v8890: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 38 KiB/s wr, 7 op/s 2023-05-08T08:20:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:24 smithi186 ceph-mon[126480]: pgmap v8891: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 6 op/s 2023-05-08T08:20:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16562.941671 secs 2023-05-08T08:20:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16563.497688 secs 2023-05-08T08:20:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:24 smithi133 ceph-mon[125939]: pgmap v8891: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 6 op/s 2023-05-08T08:20:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16562.941671 secs 2023-05-08T08:20:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16563.497688 secs 2023-05-08T08:20:24.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:24 smithi096 ceph-mon[124666]: pgmap v8891: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 6 op/s 2023-05-08T08:20:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16562.941671 secs 2023-05-08T08:20:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16563.497688 secs 2023-05-08T08:20:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:26 smithi186 ceph-mon[126480]: pgmap v8892: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 8 op/s 2023-05-08T08:20:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16564.781536 secs 2023-05-08T08:20:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:26 smithi133 ceph-mon[125939]: pgmap v8892: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 8 op/s 2023-05-08T08:20:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16564.781536 secs 2023-05-08T08:20:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:26 smithi096 ceph-mon[124666]: pgmap v8892: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 8 op/s 2023-05-08T08:20:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16564.781536 secs 2023-05-08T08:20:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:28 smithi186 ceph-mon[126480]: pgmap v8893: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 6 op/s 2023-05-08T08:20:28.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:28 smithi133 ceph-mon[125939]: pgmap v8893: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 6 op/s 2023-05-08T08:20:28.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:28 smithi096 ceph-mon[124666]: pgmap v8893: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 6 op/s 2023-05-08T08:20:29.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16567.941815 secs 2023-05-08T08:20:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16568.497809 secs 2023-05-08T08:20:29.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16567.941815 secs 2023-05-08T08:20:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16568.497809 secs 2023-05-08T08:20:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16567.941815 secs 2023-05-08T08:20:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16568.497809 secs 2023-05-08T08:20:30.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:30 smithi133 ceph-mon[125939]: pgmap v8894: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2023-05-08T08:20:30.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:30 smithi096 ceph-mon[124666]: pgmap v8894: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2023-05-08T08:20:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:30 smithi186 ceph-mon[126480]: pgmap v8894: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2023-05-08T08:20:31.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16569.781665 secs 2023-05-08T08:20:31.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16569.781665 secs 2023-05-08T08:20:31.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16569.781665 secs 2023-05-08T08:20:32.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:32 smithi133 ceph-mon[125939]: pgmap v8895: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 9 op/s 2023-05-08T08:20:32.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:32 smithi096 ceph-mon[124666]: pgmap v8895: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 9 op/s 2023-05-08T08:20:32.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:32 smithi186 ceph-mon[126480]: pgmap v8895: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 9 op/s 2023-05-08T08:20:33.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:33 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:20:33.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:33 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:20:33.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:33 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:20:34.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:34 smithi133 ceph-mon[125939]: pgmap v8896: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T08:20:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16572.941990 secs 2023-05-08T08:20:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:34 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:20:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:34 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:20:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:34 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:20:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:34 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:20:34.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:34 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T08:20:34.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:34 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T08:20:34.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:34 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:20:34.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16573.497922 secs 2023-05-08T08:20:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:34 smithi096 ceph-mon[124666]: pgmap v8896: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T08:20:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16572.941990 secs 2023-05-08T08:20:34.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:34 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:20:34.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:34 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:20:34.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:34 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:20:34.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:34 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:20:34.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:34 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T08:20:34.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:34 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T08:20:34.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:34 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:20:34.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16573.497922 secs 2023-05-08T08:20:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:34 smithi186 ceph-mon[126480]: pgmap v8896: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T08:20:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16572.941990 secs 2023-05-08T08:20:34.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:34 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:20:34.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:34 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:20:34.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:34 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:20:34.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:34 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:20:34.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:34 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T08:20:34.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:34 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T08:20:34.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:34 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:20:34.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16573.497922 secs 2023-05-08T08:20:36.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:36 smithi133 ceph-mon[125939]: pgmap v8897: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 938 B/s wr, 9 op/s 2023-05-08T08:20:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16574.781813 secs 2023-05-08T08:20:36.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:36 smithi096 ceph-mon[124666]: pgmap v8897: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 938 B/s wr, 9 op/s 2023-05-08T08:20:36.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16574.781813 secs 2023-05-08T08:20:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:36 smithi186 ceph-mon[126480]: pgmap v8897: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 938 B/s wr, 9 op/s 2023-05-08T08:20:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16574.781813 secs 2023-05-08T08:20:38.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:38 smithi133 ceph-mon[125939]: pgmap v8898: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 132 KiB/s wr, 8 op/s 2023-05-08T08:20:38.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:38 smithi096 ceph-mon[124666]: pgmap v8898: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 132 KiB/s wr, 8 op/s 2023-05-08T08:20:38.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:38 smithi186 ceph-mon[126480]: pgmap v8898: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 132 KiB/s wr, 8 op/s 2023-05-08T08:20:39.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16577.942114 secs 2023-05-08T08:20:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16578.498059 secs 2023-05-08T08:20:39.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16577.942114 secs 2023-05-08T08:20:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16578.498059 secs 2023-05-08T08:20:39.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16577.942114 secs 2023-05-08T08:20:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16578.498059 secs 2023-05-08T08:20:40.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:40 smithi133 ceph-mon[125939]: pgmap v8899: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 132 KiB/s wr, 7 op/s 2023-05-08T08:20:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:40 smithi096 ceph-mon[124666]: pgmap v8899: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 132 KiB/s wr, 7 op/s 2023-05-08T08:20:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:40 smithi186 ceph-mon[126480]: pgmap v8899: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 132 KiB/s wr, 7 op/s 2023-05-08T08:20:42.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:42 smithi133 ceph-mon[125939]: pgmap v8900: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 193 KiB/s wr, 11 op/s 2023-05-08T08:20:42.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:42 smithi096 ceph-mon[124666]: pgmap v8900: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 193 KiB/s wr, 11 op/s 2023-05-08T08:20:42.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:42 smithi186 ceph-mon[126480]: pgmap v8900: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 193 KiB/s wr, 11 op/s 2023-05-08T08:20:43.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:20:43.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:20:43.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:20:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:44 smithi133 ceph-mon[125939]: pgmap v8901: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 193 KiB/s wr, 7 op/s 2023-05-08T08:20:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:20:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:20:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:20:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16582.942241 secs 2023-05-08T08:20:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16583.498125 secs 2023-05-08T08:20:44.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:44 smithi096 ceph-mon[124666]: pgmap v8901: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 193 KiB/s wr, 7 op/s 2023-05-08T08:20:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:20:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:20:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:20:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16582.942241 secs 2023-05-08T08:20:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16583.498125 secs 2023-05-08T08:20:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:44 smithi186 ceph-mon[126480]: pgmap v8901: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 193 KiB/s wr, 7 op/s 2023-05-08T08:20:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:20:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:20:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:20:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16582.942241 secs 2023-05-08T08:20:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16583.498125 secs 2023-05-08T08:20:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:46 smithi133 ceph-mon[125939]: pgmap v8902: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 193 KiB/s wr, 9 op/s 2023-05-08T08:20:46.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:46 smithi096 ceph-mon[124666]: pgmap v8902: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 193 KiB/s wr, 9 op/s 2023-05-08T08:20:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:46 smithi186 ceph-mon[126480]: pgmap v8902: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 193 KiB/s wr, 9 op/s 2023-05-08T08:20:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:48 smithi133 ceph-mon[125939]: pgmap v8903: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 343 KiB/s wr, 7 op/s 2023-05-08T08:20:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:48 smithi096 ceph-mon[124666]: pgmap v8903: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 343 KiB/s wr, 7 op/s 2023-05-08T08:20:48.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:48 smithi186 ceph-mon[126480]: pgmap v8903: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 343 KiB/s wr, 7 op/s 2023-05-08T08:20:49.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16587.942369 secs 2023-05-08T08:20:49.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16587.942369 secs 2023-05-08T08:20:49.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16587.942369 secs 2023-05-08T08:20:50.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:50 smithi133 ceph-mon[125939]: pgmap v8904: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 212 KiB/s wr, 6 op/s 2023-05-08T08:20:50.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:50 smithi096 ceph-mon[124666]: pgmap v8904: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 212 KiB/s wr, 6 op/s 2023-05-08T08:20:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:50 smithi186 ceph-mon[126480]: pgmap v8904: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 212 KiB/s wr, 6 op/s 2023-05-08T08:20:51.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:20:51.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:20:51.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:20:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:52 smithi133 ceph-mon[125939]: pgmap v8905: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 305 KiB/s wr, 11 op/s 2023-05-08T08:20:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:52 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:20:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:20:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:20:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:52 smithi096 ceph-mon[124666]: pgmap v8905: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 305 KiB/s wr, 11 op/s 2023-05-08T08:20:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:52 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:20:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:20:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:20:52.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:52 smithi186 ceph-mon[126480]: pgmap v8905: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 305 KiB/s wr, 11 op/s 2023-05-08T08:20:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:52 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:20:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:20:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:20:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:54 smithi133 ceph-mon[125939]: pgmap v8906: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 244 KiB/s wr, 7 op/s 2023-05-08T08:20:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16592.942431 secs 2023-05-08T08:20:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16593.498356 secs 2023-05-08T08:20:54.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:54 smithi096 ceph-mon[124666]: pgmap v8906: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 244 KiB/s wr, 7 op/s 2023-05-08T08:20:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16592.942431 secs 2023-05-08T08:20:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16593.498356 secs 2023-05-08T08:20:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:54 smithi186 ceph-mon[126480]: pgmap v8906: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 244 KiB/s wr, 7 op/s 2023-05-08T08:20:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16592.942431 secs 2023-05-08T08:20:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16593.498356 secs 2023-05-08T08:20:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:56 smithi133 ceph-mon[125939]: pgmap v8907: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 433 KiB/s wr, 11 op/s 2023-05-08T08:20:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16594.782318 secs 2023-05-08T08:20:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:20:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:20:56.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:56 smithi096 ceph-mon[124666]: pgmap v8907: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 433 KiB/s wr, 11 op/s 2023-05-08T08:20:56.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16594.782318 secs 2023-05-08T08:20:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:20:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:20:56.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:56 smithi186 ceph-mon[126480]: pgmap v8907: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 433 KiB/s wr, 11 op/s 2023-05-08T08:20:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16594.782318 secs 2023-05-08T08:20:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:20:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:20:57.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:57 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:20:57.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:57 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:20:57.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:57 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:20:58.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:58 smithi133 ceph-mon[125939]: pgmap v8908: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 441 KiB/s wr, 10 op/s 2023-05-08T08:20:58.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:58 smithi096 ceph-mon[124666]: pgmap v8908: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 441 KiB/s wr, 10 op/s 2023-05-08T08:20:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:58 smithi186 ceph-mon[126480]: pgmap v8908: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 441 KiB/s wr, 10 op/s 2023-05-08T08:20:59.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16597.942495 secs 2023-05-08T08:20:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:20:59 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:20:59.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16597.942495 secs 2023-05-08T08:20:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:20:59 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:20:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16597.942495 secs 2023-05-08T08:20:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:20:59 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:21:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:00 smithi133 ceph-mon[125939]: pgmap v8909: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 290 KiB/s wr, 9 op/s 2023-05-08T08:21:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:21:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:21:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:21:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:00 smithi096 ceph-mon[124666]: pgmap v8909: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 290 KiB/s wr, 9 op/s 2023-05-08T08:21:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:21:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:21:00.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:21:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:00 smithi186 ceph-mon[126480]: pgmap v8909: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 290 KiB/s wr, 9 op/s 2023-05-08T08:21:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:21:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:21:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:21:01.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16599.782473 secs 2023-05-08T08:21:01.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16599.782473 secs 2023-05-08T08:21:01.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16599.782473 secs 2023-05-08T08:21:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:02 smithi133 ceph-mon[125939]: pgmap v8910: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 393 KiB/s rd, 370 KiB/s wr, 14 op/s 2023-05-08T08:21:02.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:02 smithi096 ceph-mon[124666]: pgmap v8910: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 393 KiB/s rd, 370 KiB/s wr, 14 op/s 2023-05-08T08:21:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:02 smithi186 ceph-mon[126480]: pgmap v8910: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 393 KiB/s rd, 370 KiB/s wr, 14 op/s 2023-05-08T08:21:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:04 smithi133 ceph-mon[125939]: pgmap v8911: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 291 KiB/s rd, 278 KiB/s wr, 10 op/s 2023-05-08T08:21:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16602.942590 secs 2023-05-08T08:21:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16603.498593 secs 2023-05-08T08:21:04.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:04 smithi096 ceph-mon[124666]: pgmap v8911: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 291 KiB/s rd, 278 KiB/s wr, 10 op/s 2023-05-08T08:21:04.534 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16602.942590 secs 2023-05-08T08:21:04.534 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16603.498593 secs 2023-05-08T08:21:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:04 smithi186 ceph-mon[126480]: pgmap v8911: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 291 KiB/s rd, 278 KiB/s wr, 10 op/s 2023-05-08T08:21:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16602.942590 secs 2023-05-08T08:21:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16603.498593 secs 2023-05-08T08:21:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:06 smithi133 ceph-mon[125939]: pgmap v8912: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 499 KiB/s rd, 507 KiB/s wr, 29 op/s 2023-05-08T08:21:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16604.782602 secs 2023-05-08T08:21:06.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:06 smithi133 ceph-mon[125939]: osdmap e634: 12 total, 12 up, 12 in 2023-05-08T08:21:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:06 smithi096 ceph-mon[124666]: pgmap v8912: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 499 KiB/s rd, 507 KiB/s wr, 29 op/s 2023-05-08T08:21:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16604.782602 secs 2023-05-08T08:21:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:06 smithi096 ceph-mon[124666]: osdmap e634: 12 total, 12 up, 12 in 2023-05-08T08:21:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:06 smithi186 ceph-mon[126480]: pgmap v8912: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 499 KiB/s rd, 507 KiB/s wr, 29 op/s 2023-05-08T08:21:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16604.782602 secs 2023-05-08T08:21:06.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:06 smithi186 ceph-mon[126480]: osdmap e634: 12 total, 12 up, 12 in 2023-05-08T08:21:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:08 smithi186 ceph-mon[126480]: pgmap v8914: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 372 KiB/s wr, 29 op/s 2023-05-08T08:21:08.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:08 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:21:08.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:21:08.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:21:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:08 smithi133 ceph-mon[125939]: pgmap v8914: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 372 KiB/s wr, 29 op/s 2023-05-08T08:21:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:08 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:21:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:21:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:21:08.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:08 smithi096 ceph-mon[124666]: pgmap v8914: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 372 KiB/s wr, 29 op/s 2023-05-08T08:21:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:08 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:21:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:21:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:21:09.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16607.942708 secs 2023-05-08T08:21:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16608.498669 secs 2023-05-08T08:21:09.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16607.942708 secs 2023-05-08T08:21:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16608.498669 secs 2023-05-08T08:21:09.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16607.942708 secs 2023-05-08T08:21:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16608.498669 secs 2023-05-08T08:21:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:10 smithi186 ceph-mon[126480]: pgmap v8915: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 372 KiB/s wr, 29 op/s 2023-05-08T08:21:10.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:10 smithi133 ceph-mon[125939]: pgmap v8915: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 372 KiB/s wr, 29 op/s 2023-05-08T08:21:10.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:10 smithi096 ceph-mon[124666]: pgmap v8915: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 372 KiB/s wr, 29 op/s 2023-05-08T08:21:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16609.782734 secs 2023-05-08T08:21:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16609.782734 secs 2023-05-08T08:21:11.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16609.782734 secs 2023-05-08T08:21:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:12 smithi186 ceph-mon[126480]: pgmap v8916: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 341 KiB/s wr, 28 op/s 2023-05-08T08:21:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:12 smithi186 ceph-mon[126480]: osdmap e635: 12 total, 12 up, 12 in 2023-05-08T08:21:12.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:12 smithi133 ceph-mon[125939]: pgmap v8916: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 341 KiB/s wr, 28 op/s 2023-05-08T08:21:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:12 smithi133 ceph-mon[125939]: osdmap e635: 12 total, 12 up, 12 in 2023-05-08T08:21:12.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:12 smithi096 ceph-mon[124666]: pgmap v8916: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 341 KiB/s wr, 28 op/s 2023-05-08T08:21:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:12 smithi096 ceph-mon[124666]: osdmap e635: 12 total, 12 up, 12 in 2023-05-08T08:21:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:14 smithi186 ceph-mon[126480]: pgmap v8918: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 82 KiB/s wr, 7 op/s 2023-05-08T08:21:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16612.942827 secs 2023-05-08T08:21:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16613.498779 secs 2023-05-08T08:21:14.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:14 smithi133 ceph-mon[125939]: pgmap v8918: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 82 KiB/s wr, 7 op/s 2023-05-08T08:21:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16612.942827 secs 2023-05-08T08:21:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16613.498779 secs 2023-05-08T08:21:14.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:14 smithi096 ceph-mon[124666]: pgmap v8918: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 82 KiB/s wr, 7 op/s 2023-05-08T08:21:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16612.942827 secs 2023-05-08T08:21:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16613.498779 secs 2023-05-08T08:21:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:16 smithi186 ceph-mon[126480]: pgmap v8919: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 115 KiB/s wr, 9 op/s 2023-05-08T08:21:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16614.782863 secs 2023-05-08T08:21:16.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:16 smithi133 ceph-mon[125939]: pgmap v8919: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 115 KiB/s wr, 9 op/s 2023-05-08T08:21:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16614.782863 secs 2023-05-08T08:21:16.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:16 smithi096 ceph-mon[124666]: pgmap v8919: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 115 KiB/s wr, 9 op/s 2023-05-08T08:21:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16614.782863 secs 2023-05-08T08:21:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:18 smithi186 ceph-mon[126480]: pgmap v8920: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 112 KiB/s wr, 8 op/s 2023-05-08T08:21:18.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:18 smithi133 ceph-mon[125939]: pgmap v8920: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 112 KiB/s wr, 8 op/s 2023-05-08T08:21:18.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:18 smithi096 ceph-mon[124666]: pgmap v8920: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 112 KiB/s wr, 8 op/s 2023-05-08T08:21:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16617.942964 secs 2023-05-08T08:21:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16618.498866 secs 2023-05-08T08:21:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16617.942964 secs 2023-05-08T08:21:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16618.498866 secs 2023-05-08T08:21:19.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16617.942964 secs 2023-05-08T08:21:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16618.498866 secs 2023-05-08T08:21:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:20 smithi133 ceph-mon[125939]: pgmap v8921: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 112 KiB/s wr, 8 op/s 2023-05-08T08:21:20.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:20 smithi096 ceph-mon[124666]: pgmap v8921: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 112 KiB/s wr, 8 op/s 2023-05-08T08:21:20.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:20 smithi186 ceph-mon[126480]: pgmap v8921: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 112 KiB/s wr, 8 op/s 2023-05-08T08:21:21.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16619.782993 secs 2023-05-08T08:21:21.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16619.782993 secs 2023-05-08T08:21:21.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16619.782993 secs 2023-05-08T08:21:22.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:22 smithi133 ceph-mon[125939]: pgmap v8922: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 47 KiB/s wr, 6 op/s 2023-05-08T08:21:22.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:22 smithi096 ceph-mon[124666]: pgmap v8922: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 47 KiB/s wr, 6 op/s 2023-05-08T08:21:22.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:22 smithi186 ceph-mon[126480]: pgmap v8922: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 47 KiB/s wr, 6 op/s 2023-05-08T08:21:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:24 smithi133 ceph-mon[125939]: pgmap v8923: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 43 KiB/s wr, 6 op/s 2023-05-08T08:21:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16622.943098 secs 2023-05-08T08:21:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16623.499006 secs 2023-05-08T08:21:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:24 smithi096 ceph-mon[124666]: pgmap v8923: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 43 KiB/s wr, 6 op/s 2023-05-08T08:21:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16622.943098 secs 2023-05-08T08:21:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16623.499006 secs 2023-05-08T08:21:24.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:24 smithi186 ceph-mon[126480]: pgmap v8923: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 43 KiB/s wr, 6 op/s 2023-05-08T08:21:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16622.943098 secs 2023-05-08T08:21:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16623.499006 secs 2023-05-08T08:21:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:26 smithi133 ceph-mon[125939]: pgmap v8924: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 39 KiB/s wr, 7 op/s 2023-05-08T08:21:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16624.783119 secs 2023-05-08T08:21:26.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:26 smithi096 ceph-mon[124666]: pgmap v8924: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 39 KiB/s wr, 7 op/s 2023-05-08T08:21:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16624.783119 secs 2023-05-08T08:21:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:26 smithi186 ceph-mon[126480]: pgmap v8924: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 39 KiB/s wr, 7 op/s 2023-05-08T08:21:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16624.783119 secs 2023-05-08T08:21:28.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:28 smithi133 ceph-mon[125939]: pgmap v8925: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T08:21:28.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:28 smithi096 ceph-mon[124666]: pgmap v8925: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T08:21:28.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:28 smithi186 ceph-mon[126480]: pgmap v8925: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T08:21:29.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16627.943219 secs 2023-05-08T08:21:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16628.499117 secs 2023-05-08T08:21:29.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16627.943219 secs 2023-05-08T08:21:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16628.499117 secs 2023-05-08T08:21:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16627.943219 secs 2023-05-08T08:21:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16628.499117 secs 2023-05-08T08:21:30.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:30 smithi133 ceph-mon[125939]: pgmap v8926: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T08:21:30.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:30 smithi096 ceph-mon[124666]: pgmap v8926: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T08:21:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:30 smithi186 ceph-mon[126480]: pgmap v8926: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T08:21:31.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16629.783219 secs 2023-05-08T08:21:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16629.783219 secs 2023-05-08T08:21:31.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16629.783219 secs 2023-05-08T08:21:32.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:32 smithi133 ceph-mon[125939]: pgmap v8927: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T08:21:32.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:32 smithi096 ceph-mon[124666]: pgmap v8927: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T08:21:32.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:32 smithi186 ceph-mon[126480]: pgmap v8927: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T08:21:34.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:34 smithi133 ceph-mon[125939]: pgmap v8928: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T08:21:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16632.943373 secs 2023-05-08T08:21:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:34 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:21:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16633.499233 secs 2023-05-08T08:21:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:34 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:21:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:34 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:21:34.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:34 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:21:34.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:34 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:21:34.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:34 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:21:34.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:34 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:21:34.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:34 smithi096 ceph-mon[124666]: pgmap v8928: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T08:21:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16632.943373 secs 2023-05-08T08:21:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:34 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:21:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16633.499233 secs 2023-05-08T08:21:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:34 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:21:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:34 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:21:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:34 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:21:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:34 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:21:34.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:34 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:21:34.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:34 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:21:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:34 smithi186 ceph-mon[126480]: pgmap v8928: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T08:21:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16632.943373 secs 2023-05-08T08:21:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:34 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:21:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16633.499233 secs 2023-05-08T08:21:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:34 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:21:34.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:34 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:21:34.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:34 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:21:34.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:34 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:21:34.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:34 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:21:34.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:34 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:21:35.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:21:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:21:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:21:35.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:21:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:21:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:21:35.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:21:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:21:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:21:36.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:36 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:21:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:36 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T08:21:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:36 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T08:21:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:36 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:21:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:36 smithi133 ceph-mon[125939]: pgmap v8929: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 103 KiB/s wr, 8 op/s 2023-05-08T08:21:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16634.783331 secs 2023-05-08T08:21:36.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:36 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:21:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:36 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T08:21:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:36 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T08:21:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:36 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:21:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:36 smithi096 ceph-mon[124666]: pgmap v8929: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 103 KiB/s wr, 8 op/s 2023-05-08T08:21:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16634.783331 secs 2023-05-08T08:21:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:36 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:21:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:36 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T08:21:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:36 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T08:21:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:36 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:21:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:36 smithi186 ceph-mon[126480]: pgmap v8929: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 103 KiB/s wr, 8 op/s 2023-05-08T08:21:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16634.783331 secs 2023-05-08T08:21:38.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:38 smithi133 ceph-mon[125939]: pgmap v8930: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 103 KiB/s wr, 7 op/s 2023-05-08T08:21:38.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:38 smithi096 ceph-mon[124666]: pgmap v8930: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 103 KiB/s wr, 7 op/s 2023-05-08T08:21:38.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:38 smithi186 ceph-mon[126480]: pgmap v8930: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 103 KiB/s wr, 7 op/s 2023-05-08T08:21:39.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16637.943454 secs 2023-05-08T08:21:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16638.499350 secs 2023-05-08T08:21:39.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16637.943454 secs 2023-05-08T08:21:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16638.499350 secs 2023-05-08T08:21:39.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16637.943454 secs 2023-05-08T08:21:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16638.499350 secs 2023-05-08T08:21:40.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:40 smithi133 ceph-mon[125939]: pgmap v8931: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 103 KiB/s wr, 6 op/s 2023-05-08T08:21:40.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:40 smithi096 ceph-mon[124666]: pgmap v8931: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 103 KiB/s wr, 6 op/s 2023-05-08T08:21:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:40 smithi186 ceph-mon[126480]: pgmap v8931: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 103 KiB/s wr, 6 op/s 2023-05-08T08:21:42.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:42 smithi133 ceph-mon[125939]: pgmap v8932: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 104 KiB/s wr, 10 op/s 2023-05-08T08:21:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:42 smithi096 ceph-mon[124666]: pgmap v8932: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 104 KiB/s wr, 10 op/s 2023-05-08T08:21:42.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:42 smithi186 ceph-mon[126480]: pgmap v8932: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 104 KiB/s wr, 10 op/s 2023-05-08T08:21:43.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:21:43.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:21:43.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:21:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:44 smithi133 ceph-mon[125939]: pgmap v8933: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 103 KiB/s wr, 7 op/s 2023-05-08T08:21:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:21:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:21:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:21:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16642.943566 secs 2023-05-08T08:21:44.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16643.499496 secs 2023-05-08T08:21:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:44 smithi096 ceph-mon[124666]: pgmap v8933: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 103 KiB/s wr, 7 op/s 2023-05-08T08:21:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:21:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:21:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:21:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16642.943566 secs 2023-05-08T08:21:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16643.499496 secs 2023-05-08T08:21:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:44 smithi186 ceph-mon[126480]: pgmap v8933: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 103 KiB/s wr, 7 op/s 2023-05-08T08:21:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:21:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:21:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:21:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16642.943566 secs 2023-05-08T08:21:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16643.499496 secs 2023-05-08T08:21:46.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:46 smithi133 ceph-mon[125939]: pgmap v8934: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 240 KiB/s wr, 10 op/s 2023-05-08T08:21:46.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:46 smithi096 ceph-mon[124666]: pgmap v8934: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 240 KiB/s wr, 10 op/s 2023-05-08T08:21:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:46 smithi186 ceph-mon[126480]: pgmap v8934: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 240 KiB/s wr, 10 op/s 2023-05-08T08:21:48.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:48 smithi133 ceph-mon[125939]: pgmap v8935: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 145 KiB/s wr, 7 op/s 2023-05-08T08:21:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:48 smithi096 ceph-mon[124666]: pgmap v8935: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 145 KiB/s wr, 7 op/s 2023-05-08T08:21:48.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:48 smithi186 ceph-mon[126480]: pgmap v8935: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 145 KiB/s wr, 7 op/s 2023-05-08T08:21:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16647.943678 secs 2023-05-08T08:21:49.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16647.943678 secs 2023-05-08T08:21:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16647.943678 secs 2023-05-08T08:21:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:50 smithi133 ceph-mon[125939]: pgmap v8936: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 145 KiB/s wr, 7 op/s 2023-05-08T08:21:50.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:50 smithi096 ceph-mon[124666]: pgmap v8936: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 145 KiB/s wr, 7 op/s 2023-05-08T08:21:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:50 smithi186 ceph-mon[126480]: pgmap v8936: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 145 KiB/s wr, 7 op/s 2023-05-08T08:21:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:21:51.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:21:51.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:21:52.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:52 smithi133 ceph-mon[125939]: pgmap v8937: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 425 KiB/s rd, 321 KiB/s wr, 11 op/s 2023-05-08T08:21:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:52 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:21:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:21:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:21:52.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:52 smithi096 ceph-mon[124666]: pgmap v8937: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 425 KiB/s rd, 321 KiB/s wr, 11 op/s 2023-05-08T08:21:52.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:52 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:21:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:21:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:21:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:52 smithi186 ceph-mon[126480]: pgmap v8937: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 425 KiB/s rd, 321 KiB/s wr, 11 op/s 2023-05-08T08:21:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:52 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:21:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:21:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:21:54.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:54 smithi133 ceph-mon[125939]: pgmap v8938: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 321 KiB/s wr, 7 op/s 2023-05-08T08:21:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16652.943774 secs 2023-05-08T08:21:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16653.499695 secs 2023-05-08T08:21:54.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:54 smithi096 ceph-mon[124666]: pgmap v8938: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 321 KiB/s wr, 7 op/s 2023-05-08T08:21:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16652.943774 secs 2023-05-08T08:21:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16653.499695 secs 2023-05-08T08:21:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:54 smithi186 ceph-mon[126480]: pgmap v8938: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 321 KiB/s wr, 7 op/s 2023-05-08T08:21:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16652.943774 secs 2023-05-08T08:21:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16653.499695 secs 2023-05-08T08:21:56.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:56 smithi133 ceph-mon[125939]: pgmap v8939: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 660 KiB/s rd, 573 KiB/s wr, 13 op/s 2023-05-08T08:21:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16654.783837 secs 2023-05-08T08:21:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:21:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:21:56.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:56 smithi096 ceph-mon[124666]: pgmap v8939: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 660 KiB/s rd, 573 KiB/s wr, 13 op/s 2023-05-08T08:21:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16654.783837 secs 2023-05-08T08:21:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:21:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:21:56.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:56 smithi186 ceph-mon[126480]: pgmap v8939: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 660 KiB/s rd, 573 KiB/s wr, 13 op/s 2023-05-08T08:21:56.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16654.783837 secs 2023-05-08T08:21:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:21:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:21:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:57 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:21:57.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:57 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:21:57.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:57 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:21:58.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:58 smithi133 ceph-mon[125939]: pgmap v8940: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 445 KiB/s wr, 10 op/s 2023-05-08T08:21:58.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:58 smithi096 ceph-mon[124666]: pgmap v8940: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 445 KiB/s wr, 10 op/s 2023-05-08T08:21:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:58 smithi186 ceph-mon[126480]: pgmap v8940: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 445 KiB/s wr, 10 op/s 2023-05-08T08:21:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16657.943890 secs 2023-05-08T08:21:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:21:59 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:21:59.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16657.943890 secs 2023-05-08T08:21:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:21:59 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:21:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16657.943890 secs 2023-05-08T08:21:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:21:59 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:22:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:00 smithi133 ceph-mon[125939]: pgmap v8941: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 436 KiB/s wr, 10 op/s 2023-05-08T08:22:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:22:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:22:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:22:00.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:00 smithi096 ceph-mon[124666]: pgmap v8941: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 436 KiB/s wr, 10 op/s 2023-05-08T08:22:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:22:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:22:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:22:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:00 smithi186 ceph-mon[126480]: pgmap v8941: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 436 KiB/s wr, 10 op/s 2023-05-08T08:22:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:22:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:22:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:22:01.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16659.783965 secs 2023-05-08T08:22:01.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16659.783965 secs 2023-05-08T08:22:01.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16659.783965 secs 2023-05-08T08:22:02.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:02 smithi133 ceph-mon[125939]: pgmap v8942: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 601 KiB/s rd, 514 KiB/s wr, 15 op/s 2023-05-08T08:22:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:02 smithi096 ceph-mon[124666]: pgmap v8942: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 601 KiB/s rd, 514 KiB/s wr, 15 op/s 2023-05-08T08:22:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:02 smithi186 ceph-mon[126480]: pgmap v8942: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 601 KiB/s rd, 514 KiB/s wr, 15 op/s 2023-05-08T08:22:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:04 smithi133 ceph-mon[125939]: pgmap v8943: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 338 KiB/s wr, 10 op/s 2023-05-08T08:22:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16662.944022 secs 2023-05-08T08:22:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16663.499936 secs 2023-05-08T08:22:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:04 smithi096 ceph-mon[124666]: pgmap v8943: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 338 KiB/s wr, 10 op/s 2023-05-08T08:22:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16662.944022 secs 2023-05-08T08:22:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16663.499936 secs 2023-05-08T08:22:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:04 smithi186 ceph-mon[126480]: pgmap v8943: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 338 KiB/s wr, 10 op/s 2023-05-08T08:22:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16662.944022 secs 2023-05-08T08:22:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16663.499936 secs 2023-05-08T08:22:06.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:06 smithi096 ceph-mon[124666]: pgmap v8944: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 571 KiB/s wr, 29 op/s 2023-05-08T08:22:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16664.784075 secs 2023-05-08T08:22:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:06 smithi096 ceph-mon[124666]: osdmap e636: 12 total, 12 up, 12 in 2023-05-08T08:22:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:06 smithi186 ceph-mon[126480]: pgmap v8944: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 571 KiB/s wr, 29 op/s 2023-05-08T08:22:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16664.784075 secs 2023-05-08T08:22:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:06 smithi186 ceph-mon[126480]: osdmap e636: 12 total, 12 up, 12 in 2023-05-08T08:22:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:06 smithi133 ceph-mon[125939]: pgmap v8944: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 571 KiB/s wr, 29 op/s 2023-05-08T08:22:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16664.784075 secs 2023-05-08T08:22:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:06 smithi133 ceph-mon[125939]: osdmap e636: 12 total, 12 up, 12 in 2023-05-08T08:22:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:08 smithi186 ceph-mon[126480]: pgmap v8946: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 373 KiB/s wr, 29 op/s 2023-05-08T08:22:08.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:08 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:22:08.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:22:08.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:22:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:08 smithi133 ceph-mon[125939]: pgmap v8946: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 373 KiB/s wr, 29 op/s 2023-05-08T08:22:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:08 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:22:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:22:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:22:08.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:08 smithi096 ceph-mon[124666]: pgmap v8946: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 373 KiB/s wr, 29 op/s 2023-05-08T08:22:08.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:08 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:22:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:22:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:22:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16667.944120 secs 2023-05-08T08:22:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16668.500076 secs 2023-05-08T08:22:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16667.944120 secs 2023-05-08T08:22:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16668.500076 secs 2023-05-08T08:22:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16667.944120 secs 2023-05-08T08:22:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16668.500076 secs 2023-05-08T08:22:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:10 smithi186 ceph-mon[126480]: pgmap v8947: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 373 KiB/s wr, 29 op/s 2023-05-08T08:22:10.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:10 smithi133 ceph-mon[125939]: pgmap v8947: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 373 KiB/s wr, 29 op/s 2023-05-08T08:22:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:10 smithi096 ceph-mon[124666]: pgmap v8947: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 373 KiB/s wr, 29 op/s 2023-05-08T08:22:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16669.784189 secs 2023-05-08T08:22:11.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16669.784189 secs 2023-05-08T08:22:11.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16669.784189 secs 2023-05-08T08:22:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:12 smithi186 ceph-mon[126480]: pgmap v8948: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 346 KiB/s wr, 28 op/s 2023-05-08T08:22:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:12 smithi186 ceph-mon[126480]: osdmap e637: 12 total, 12 up, 12 in 2023-05-08T08:22:12.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:12 smithi133 ceph-mon[125939]: pgmap v8948: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 346 KiB/s wr, 28 op/s 2023-05-08T08:22:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:12 smithi133 ceph-mon[125939]: osdmap e637: 12 total, 12 up, 12 in 2023-05-08T08:22:12.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:12 smithi096 ceph-mon[124666]: pgmap v8948: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 346 KiB/s wr, 28 op/s 2023-05-08T08:22:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:12 smithi096 ceph-mon[124666]: osdmap e637: 12 total, 12 up, 12 in 2023-05-08T08:22:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:14 smithi133 ceph-mon[125939]: pgmap v8950: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 82 KiB/s wr, 7 op/s 2023-05-08T08:22:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16672.944242 secs 2023-05-08T08:22:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16673.500217 secs 2023-05-08T08:22:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:14 smithi096 ceph-mon[124666]: pgmap v8950: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 82 KiB/s wr, 7 op/s 2023-05-08T08:22:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16672.944242 secs 2023-05-08T08:22:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16673.500217 secs 2023-05-08T08:22:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:14 smithi186 ceph-mon[126480]: pgmap v8950: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 82 KiB/s wr, 7 op/s 2023-05-08T08:22:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16672.944242 secs 2023-05-08T08:22:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16673.500217 secs 2023-05-08T08:22:16.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:16 smithi133 ceph-mon[125939]: pgmap v8951: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 115 KiB/s wr, 9 op/s 2023-05-08T08:22:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16674.784305 secs 2023-05-08T08:22:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:16 smithi096 ceph-mon[124666]: pgmap v8951: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 115 KiB/s wr, 9 op/s 2023-05-08T08:22:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16674.784305 secs 2023-05-08T08:22:16.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:16 smithi186 ceph-mon[126480]: pgmap v8951: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 115 KiB/s wr, 9 op/s 2023-05-08T08:22:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16674.784305 secs 2023-05-08T08:22:18.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:18 smithi133 ceph-mon[125939]: pgmap v8952: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 113 KiB/s wr, 8 op/s 2023-05-08T08:22:18.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:18 smithi096 ceph-mon[124666]: pgmap v8952: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 113 KiB/s wr, 8 op/s 2023-05-08T08:22:18.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:18 smithi186 ceph-mon[126480]: pgmap v8952: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 113 KiB/s wr, 8 op/s 2023-05-08T08:22:19.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16677.944379 secs 2023-05-08T08:22:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16678.500340 secs 2023-05-08T08:22:19.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16677.944379 secs 2023-05-08T08:22:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16678.500340 secs 2023-05-08T08:22:19.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16677.944379 secs 2023-05-08T08:22:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16678.500340 secs 2023-05-08T08:22:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:20 smithi133 ceph-mon[125939]: pgmap v8953: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 113 KiB/s wr, 8 op/s 2023-05-08T08:22:20.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:20 smithi096 ceph-mon[124666]: pgmap v8953: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 113 KiB/s wr, 8 op/s 2023-05-08T08:22:20.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:20 smithi186 ceph-mon[126480]: pgmap v8953: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 113 KiB/s wr, 8 op/s 2023-05-08T08:22:21.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16679.784397 secs 2023-05-08T08:22:21.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16679.784397 secs 2023-05-08T08:22:21.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16679.784397 secs 2023-05-08T08:22:22.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:22 smithi133 ceph-mon[125939]: pgmap v8954: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 47 KiB/s wr, 6 op/s 2023-05-08T08:22:22.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:22 smithi096 ceph-mon[124666]: pgmap v8954: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 47 KiB/s wr, 6 op/s 2023-05-08T08:22:22.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:22 smithi186 ceph-mon[126480]: pgmap v8954: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 47 KiB/s wr, 6 op/s 2023-05-08T08:22:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:24 smithi133 ceph-mon[125939]: pgmap v8955: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 43 KiB/s wr, 6 op/s 2023-05-08T08:22:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16682.944506 secs 2023-05-08T08:22:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16683.500497 secs 2023-05-08T08:22:24.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:24 smithi096 ceph-mon[124666]: pgmap v8955: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 43 KiB/s wr, 6 op/s 2023-05-08T08:22:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16682.944506 secs 2023-05-08T08:22:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16683.500497 secs 2023-05-08T08:22:24.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:24 smithi186 ceph-mon[126480]: pgmap v8955: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 43 KiB/s wr, 6 op/s 2023-05-08T08:22:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16682.944506 secs 2023-05-08T08:22:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16683.500497 secs 2023-05-08T08:22:26.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:26 smithi133 ceph-mon[125939]: pgmap v8956: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 39 KiB/s wr, 7 op/s 2023-05-08T08:22:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16684.784522 secs 2023-05-08T08:22:26.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:26 smithi096 ceph-mon[124666]: pgmap v8956: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 39 KiB/s wr, 7 op/s 2023-05-08T08:22:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16684.784522 secs 2023-05-08T08:22:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:26 smithi186 ceph-mon[126480]: pgmap v8956: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 39 KiB/s wr, 7 op/s 2023-05-08T08:22:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16684.784522 secs 2023-05-08T08:22:28.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:28 smithi133 ceph-mon[125939]: pgmap v8957: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T08:22:28.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:28 smithi096 ceph-mon[124666]: pgmap v8957: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T08:22:28.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:28 smithi186 ceph-mon[126480]: pgmap v8957: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T08:22:29.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16687.944664 secs 2023-05-08T08:22:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16688.500612 secs 2023-05-08T08:22:29.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16687.944664 secs 2023-05-08T08:22:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16688.500612 secs 2023-05-08T08:22:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16687.944664 secs 2023-05-08T08:22:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16688.500612 secs 2023-05-08T08:22:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:30 smithi133 ceph-mon[125939]: pgmap v8958: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T08:22:30.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:30 smithi096 ceph-mon[124666]: pgmap v8958: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T08:22:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:30 smithi186 ceph-mon[126480]: pgmap v8958: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T08:22:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16689.784649 secs 2023-05-08T08:22:31.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16689.784649 secs 2023-05-08T08:22:31.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16689.784649 secs 2023-05-08T08:22:32.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:32 smithi133 ceph-mon[125939]: pgmap v8959: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T08:22:32.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:32 smithi096 ceph-mon[124666]: pgmap v8959: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T08:22:32.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:32 smithi186 ceph-mon[126480]: pgmap v8959: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T08:22:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:34 smithi133 ceph-mon[125939]: pgmap v8960: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T08:22:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16692.944783 secs 2023-05-08T08:22:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16693.500734 secs 2023-05-08T08:22:34.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:34 smithi096 ceph-mon[124666]: pgmap v8960: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T08:22:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16692.944783 secs 2023-05-08T08:22:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16693.500734 secs 2023-05-08T08:22:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:34 smithi186 ceph-mon[126480]: pgmap v8960: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T08:22:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16692.944783 secs 2023-05-08T08:22:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16693.500734 secs 2023-05-08T08:22:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:22:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:22:35.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:22:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:36 smithi133 ceph-mon[125939]: pgmap v8961: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 57 KiB/s wr, 8 op/s 2023-05-08T08:22:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16694.784801 secs 2023-05-08T08:22:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:22:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:22:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:36 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:22:36.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:22:36.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:36 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T08:22:36.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:36 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T08:22:36.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:36 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:22:36.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:36 smithi096 ceph-mon[124666]: pgmap v8961: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 57 KiB/s wr, 8 op/s 2023-05-08T08:22:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16694.784801 secs 2023-05-08T08:22:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:22:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:22:36.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:36 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:22:36.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:22:36.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:36 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T08:22:36.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:36 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T08:22:36.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:36 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:22:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:36 smithi186 ceph-mon[126480]: pgmap v8961: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 57 KiB/s wr, 8 op/s 2023-05-08T08:22:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16694.784801 secs 2023-05-08T08:22:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:22:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:22:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:36 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:22:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:22:36.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:36 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T08:22:36.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:36 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T08:22:36.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:36 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:22:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:38 smithi133 ceph-mon[125939]: pgmap v8962: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 57 KiB/s wr, 6 op/s 2023-05-08T08:22:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:38 smithi096 ceph-mon[124666]: pgmap v8962: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 57 KiB/s wr, 6 op/s 2023-05-08T08:22:38.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:38 smithi186 ceph-mon[126480]: pgmap v8962: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 57 KiB/s wr, 6 op/s 2023-05-08T08:22:39.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16697.944905 secs 2023-05-08T08:22:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16698.500842 secs 2023-05-08T08:22:39.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16697.944905 secs 2023-05-08T08:22:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16698.500842 secs 2023-05-08T08:22:39.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16697.944905 secs 2023-05-08T08:22:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16698.500842 secs 2023-05-08T08:22:40.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:40 smithi133 ceph-mon[125939]: pgmap v8963: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 57 KiB/s wr, 6 op/s 2023-05-08T08:22:40.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:40 smithi096 ceph-mon[124666]: pgmap v8963: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 57 KiB/s wr, 6 op/s 2023-05-08T08:22:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:40 smithi186 ceph-mon[126480]: pgmap v8963: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 57 KiB/s wr, 6 op/s 2023-05-08T08:22:42.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:42 smithi133 ceph-mon[125939]: pgmap v8964: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 102 KiB/s wr, 10 op/s 2023-05-08T08:22:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:42 smithi096 ceph-mon[124666]: pgmap v8964: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 102 KiB/s wr, 10 op/s 2023-05-08T08:22:42.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:42 smithi186 ceph-mon[126480]: pgmap v8964: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 102 KiB/s wr, 10 op/s 2023-05-08T08:22:43.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:22:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:22:43.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:22:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:44 smithi133 ceph-mon[125939]: pgmap v8965: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 101 KiB/s wr, 6 op/s 2023-05-08T08:22:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:22:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:22:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:22:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16702.945045 secs 2023-05-08T08:22:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16703.500960 secs 2023-05-08T08:22:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:44 smithi096 ceph-mon[124666]: pgmap v8965: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 101 KiB/s wr, 6 op/s 2023-05-08T08:22:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:22:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:22:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:22:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16702.945045 secs 2023-05-08T08:22:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16703.500960 secs 2023-05-08T08:22:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:44 smithi186 ceph-mon[126480]: pgmap v8965: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 101 KiB/s wr, 6 op/s 2023-05-08T08:22:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:22:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:22:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:22:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16702.945045 secs 2023-05-08T08:22:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16703.500960 secs 2023-05-08T08:22:46.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:46 smithi133 ceph-mon[125939]: pgmap v8966: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 195 KiB/s wr, 10 op/s 2023-05-08T08:22:46.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:46 smithi096 ceph-mon[124666]: pgmap v8966: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 195 KiB/s wr, 10 op/s 2023-05-08T08:22:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:46 smithi186 ceph-mon[126480]: pgmap v8966: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 195 KiB/s wr, 10 op/s 2023-05-08T08:22:48.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:48 smithi133 ceph-mon[125939]: pgmap v8967: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 146 KiB/s wr, 7 op/s 2023-05-08T08:22:48.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:48 smithi096 ceph-mon[124666]: pgmap v8967: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 146 KiB/s wr, 7 op/s 2023-05-08T08:22:48.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:48 smithi186 ceph-mon[126480]: pgmap v8967: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 146 KiB/s wr, 7 op/s 2023-05-08T08:22:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16707.945102 secs 2023-05-08T08:22:49.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16707.945102 secs 2023-05-08T08:22:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16707.945102 secs 2023-05-08T08:22:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:50 smithi133 ceph-mon[125939]: pgmap v8968: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 146 KiB/s wr, 7 op/s 2023-05-08T08:22:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:50 smithi096 ceph-mon[124666]: pgmap v8968: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 146 KiB/s wr, 7 op/s 2023-05-08T08:22:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:50 smithi186 ceph-mon[126480]: pgmap v8968: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 146 KiB/s wr, 7 op/s 2023-05-08T08:22:51.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:22:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:22:51.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:22:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:52 smithi133 ceph-mon[125939]: pgmap v8969: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 308 KiB/s wr, 11 op/s 2023-05-08T08:22:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:52 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:22:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:22:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:22:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:52 smithi096 ceph-mon[124666]: pgmap v8969: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 308 KiB/s wr, 11 op/s 2023-05-08T08:22:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:52 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:22:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:22:52.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:22:52.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:52 smithi186 ceph-mon[126480]: pgmap v8969: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 308 KiB/s wr, 11 op/s 2023-05-08T08:22:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:52 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:22:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:22:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:22:54.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:54 smithi133 ceph-mon[125939]: pgmap v8970: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 264 KiB/s wr, 7 op/s 2023-05-08T08:22:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16712.945233 secs 2023-05-08T08:22:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16713.501183 secs 2023-05-08T08:22:54.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:54 smithi096 ceph-mon[124666]: pgmap v8970: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 264 KiB/s wr, 7 op/s 2023-05-08T08:22:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16712.945233 secs 2023-05-08T08:22:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16713.501183 secs 2023-05-08T08:22:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:54 smithi186 ceph-mon[126480]: pgmap v8970: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 264 KiB/s wr, 7 op/s 2023-05-08T08:22:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16712.945233 secs 2023-05-08T08:22:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16713.501183 secs 2023-05-08T08:22:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:56 smithi133 ceph-mon[125939]: pgmap v8971: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 609 KiB/s rd, 507 KiB/s wr, 12 op/s 2023-05-08T08:22:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16714.785299 secs 2023-05-08T08:22:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:22:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:22:56.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:56 smithi096 ceph-mon[124666]: pgmap v8971: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 609 KiB/s rd, 507 KiB/s wr, 12 op/s 2023-05-08T08:22:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16714.785299 secs 2023-05-08T08:22:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:22:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:22:56.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:56 smithi186 ceph-mon[126480]: pgmap v8971: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 609 KiB/s rd, 507 KiB/s wr, 12 op/s 2023-05-08T08:22:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16714.785299 secs 2023-05-08T08:22:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:22:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:22:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:57 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:22:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:57 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:22:57.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:57 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:22:58.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:58 smithi133 ceph-mon[125939]: pgmap v8972: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 422 KiB/s wr, 10 op/s 2023-05-08T08:22:58.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:58 smithi096 ceph-mon[124666]: pgmap v8972: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 422 KiB/s wr, 10 op/s 2023-05-08T08:22:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:58 smithi186 ceph-mon[126480]: pgmap v8972: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 422 KiB/s wr, 10 op/s 2023-05-08T08:22:59.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16717.945373 secs 2023-05-08T08:22:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:22:59 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:22:59.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16717.945373 secs 2023-05-08T08:22:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:22:59 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:22:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16717.945373 secs 2023-05-08T08:22:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:22:59 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:23:00.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:00 smithi133 ceph-mon[125939]: pgmap v8973: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 414 KiB/s wr, 9 op/s 2023-05-08T08:23:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:23:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:23:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:23:00.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:00 smithi096 ceph-mon[124666]: pgmap v8973: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 414 KiB/s wr, 9 op/s 2023-05-08T08:23:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:23:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:23:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:23:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:00 smithi186 ceph-mon[126480]: pgmap v8973: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 414 KiB/s wr, 9 op/s 2023-05-08T08:23:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:23:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:23:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:23:01.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16719.785428 secs 2023-05-08T08:23:01.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16719.785428 secs 2023-05-08T08:23:01.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16719.785428 secs 2023-05-08T08:23:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:02 smithi096 ceph-mon[124666]: pgmap v8974: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 530 KiB/s wr, 15 op/s 2023-05-08T08:23:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:02 smithi186 ceph-mon[126480]: pgmap v8974: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 530 KiB/s wr, 15 op/s 2023-05-08T08:23:02.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:02 smithi133 ceph-mon[125939]: pgmap v8974: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 530 KiB/s wr, 15 op/s 2023-05-08T08:23:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:04 smithi096 ceph-mon[124666]: pgmap v8975: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 368 KiB/s wr, 11 op/s 2023-05-08T08:23:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16722.945471 secs 2023-05-08T08:23:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16723.501419 secs 2023-05-08T08:23:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:04 smithi186 ceph-mon[126480]: pgmap v8975: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 368 KiB/s wr, 11 op/s 2023-05-08T08:23:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16722.945471 secs 2023-05-08T08:23:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16723.501419 secs 2023-05-08T08:23:04.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:04 smithi133 ceph-mon[125939]: pgmap v8975: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 368 KiB/s wr, 11 op/s 2023-05-08T08:23:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16722.945471 secs 2023-05-08T08:23:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16723.501419 secs 2023-05-08T08:23:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16724.785563 secs 2023-05-08T08:23:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:06 smithi186 ceph-mon[126480]: pgmap v8976: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 489 KiB/s rd, 512 KiB/s wr, 30 op/s 2023-05-08T08:23:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:06 smithi186 ceph-mon[126480]: osdmap e638: 12 total, 12 up, 12 in 2023-05-08T08:23:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16724.785563 secs 2023-05-08T08:23:06.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:06 smithi133 ceph-mon[125939]: pgmap v8976: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 489 KiB/s rd, 512 KiB/s wr, 30 op/s 2023-05-08T08:23:06.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:06 smithi133 ceph-mon[125939]: osdmap e638: 12 total, 12 up, 12 in 2023-05-08T08:23:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16724.785563 secs 2023-05-08T08:23:06.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:06 smithi096 ceph-mon[124666]: pgmap v8976: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 489 KiB/s rd, 512 KiB/s wr, 30 op/s 2023-05-08T08:23:06.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:06 smithi096 ceph-mon[124666]: osdmap e638: 12 total, 12 up, 12 in 2023-05-08T08:23:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:08 smithi186 ceph-mon[126480]: pgmap v8978: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 313 KiB/s wr, 29 op/s 2023-05-08T08:23:08.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:08 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:23:08.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:23:08.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:23:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:08 smithi133 ceph-mon[125939]: pgmap v8978: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 313 KiB/s wr, 29 op/s 2023-05-08T08:23:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:08 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:23:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:23:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:23:08.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:08 smithi096 ceph-mon[124666]: pgmap v8978: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 313 KiB/s wr, 29 op/s 2023-05-08T08:23:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:08 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:23:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:23:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:23:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16727.945594 secs 2023-05-08T08:23:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16728.501543 secs 2023-05-08T08:23:09.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16727.945594 secs 2023-05-08T08:23:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16728.501543 secs 2023-05-08T08:23:09.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16727.945594 secs 2023-05-08T08:23:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16728.501543 secs 2023-05-08T08:23:10.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:10 smithi133 ceph-mon[125939]: pgmap v8979: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 313 KiB/s wr, 29 op/s 2023-05-08T08:23:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:10 smithi096 ceph-mon[124666]: pgmap v8979: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 313 KiB/s wr, 29 op/s 2023-05-08T08:23:10.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:10 smithi186 ceph-mon[126480]: pgmap v8979: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 313 KiB/s wr, 29 op/s 2023-05-08T08:23:11.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16729.785646 secs 2023-05-08T08:23:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16729.785646 secs 2023-05-08T08:23:11.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16729.785646 secs 2023-05-08T08:23:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:12 smithi133 ceph-mon[125939]: pgmap v8980: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 330 KiB/s wr, 28 op/s 2023-05-08T08:23:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:12 smithi133 ceph-mon[125939]: osdmap e639: 12 total, 12 up, 12 in 2023-05-08T08:23:12.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:12 smithi096 ceph-mon[124666]: pgmap v8980: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 330 KiB/s wr, 28 op/s 2023-05-08T08:23:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:12 smithi096 ceph-mon[124666]: osdmap e639: 12 total, 12 up, 12 in 2023-05-08T08:23:12.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:12 smithi186 ceph-mon[126480]: pgmap v8980: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 330 KiB/s wr, 28 op/s 2023-05-08T08:23:12.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:12 smithi186 ceph-mon[126480]: osdmap e639: 12 total, 12 up, 12 in 2023-05-08T08:23:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:14 smithi133 ceph-mon[125939]: pgmap v8982: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 197 KiB/s wr, 7 op/s 2023-05-08T08:23:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16732.945747 secs 2023-05-08T08:23:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16733.501688 secs 2023-05-08T08:23:14.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:14 smithi096 ceph-mon[124666]: pgmap v8982: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 197 KiB/s wr, 7 op/s 2023-05-08T08:23:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16732.945747 secs 2023-05-08T08:23:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16733.501688 secs 2023-05-08T08:23:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:14 smithi186 ceph-mon[126480]: pgmap v8982: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 197 KiB/s wr, 7 op/s 2023-05-08T08:23:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16732.945747 secs 2023-05-08T08:23:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16733.501688 secs 2023-05-08T08:23:16.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16734.785795 secs 2023-05-08T08:23:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:16 smithi133 ceph-mon[125939]: pgmap v8983: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 209 KiB/s wr, 9 op/s 2023-05-08T08:23:16.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16734.785795 secs 2023-05-08T08:23:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:16 smithi096 ceph-mon[124666]: pgmap v8983: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 209 KiB/s wr, 9 op/s 2023-05-08T08:23:16.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16734.785795 secs 2023-05-08T08:23:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:16 smithi186 ceph-mon[126480]: pgmap v8983: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 209 KiB/s wr, 9 op/s 2023-05-08T08:23:18.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:18 smithi133 ceph-mon[125939]: pgmap v8984: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 205 KiB/s wr, 9 op/s 2023-05-08T08:23:18.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:18 smithi096 ceph-mon[124666]: pgmap v8984: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 205 KiB/s wr, 9 op/s 2023-05-08T08:23:18.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:18 smithi186 ceph-mon[126480]: pgmap v8984: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 205 KiB/s wr, 9 op/s 2023-05-08T08:23:19.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16737.945892 secs 2023-05-08T08:23:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16738.501832 secs 2023-05-08T08:23:19.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16737.945892 secs 2023-05-08T08:23:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16738.501832 secs 2023-05-08T08:23:19.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16737.945892 secs 2023-05-08T08:23:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16738.501832 secs 2023-05-08T08:23:20.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:20 smithi133 ceph-mon[125939]: pgmap v8985: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 205 KiB/s wr, 9 op/s 2023-05-08T08:23:20.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:20 smithi096 ceph-mon[124666]: pgmap v8985: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 205 KiB/s wr, 9 op/s 2023-05-08T08:23:20.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:20 smithi186 ceph-mon[126480]: pgmap v8985: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 205 KiB/s wr, 9 op/s 2023-05-08T08:23:21.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16739.785915 secs 2023-05-08T08:23:21.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16739.785915 secs 2023-05-08T08:23:21.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16739.785915 secs 2023-05-08T08:23:22.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:22 smithi133 ceph-mon[125939]: pgmap v8986: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 47 KiB/s wr, 7 op/s 2023-05-08T08:23:22.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:22 smithi096 ceph-mon[124666]: pgmap v8986: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 47 KiB/s wr, 7 op/s 2023-05-08T08:23:22.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:22 smithi186 ceph-mon[126480]: pgmap v8986: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 47 KiB/s wr, 7 op/s 2023-05-08T08:23:24.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:24 smithi133 ceph-mon[125939]: pgmap v8987: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 43 KiB/s wr, 6 op/s 2023-05-08T08:23:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16742.946027 secs 2023-05-08T08:23:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16743.501977 secs 2023-05-08T08:23:24.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:24 smithi096 ceph-mon[124666]: pgmap v8987: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 43 KiB/s wr, 6 op/s 2023-05-08T08:23:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16742.946027 secs 2023-05-08T08:23:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16743.501977 secs 2023-05-08T08:23:24.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:24 smithi186 ceph-mon[126480]: pgmap v8987: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 43 KiB/s wr, 6 op/s 2023-05-08T08:23:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16742.946027 secs 2023-05-08T08:23:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16743.501977 secs 2023-05-08T08:23:26.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16744.785981 secs 2023-05-08T08:23:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:26 smithi133 ceph-mon[125939]: pgmap v8988: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 39 KiB/s wr, 7 op/s 2023-05-08T08:23:26.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16744.785981 secs 2023-05-08T08:23:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:26 smithi096 ceph-mon[124666]: pgmap v8988: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 39 KiB/s wr, 7 op/s 2023-05-08T08:23:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16744.785981 secs 2023-05-08T08:23:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:26 smithi186 ceph-mon[126480]: pgmap v8988: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 39 KiB/s wr, 7 op/s 2023-05-08T08:23:28.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:28 smithi133 ceph-mon[125939]: pgmap v8989: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T08:23:28.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:28 smithi096 ceph-mon[124666]: pgmap v8989: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T08:23:28.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:28 smithi186 ceph-mon[126480]: pgmap v8989: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T08:23:29.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16747.946158 secs 2023-05-08T08:23:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16748.502101 secs 2023-05-08T08:23:29.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16747.946158 secs 2023-05-08T08:23:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16748.502101 secs 2023-05-08T08:23:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16747.946158 secs 2023-05-08T08:23:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16748.502101 secs 2023-05-08T08:23:30.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:30 smithi133 ceph-mon[125939]: pgmap v8990: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T08:23:30.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:30 smithi096 ceph-mon[124666]: pgmap v8990: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T08:23:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:30 smithi186 ceph-mon[126480]: pgmap v8990: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T08:23:31.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16749.786109 secs 2023-05-08T08:23:31.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16749.786109 secs 2023-05-08T08:23:31.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16749.786109 secs 2023-05-08T08:23:32.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:32 smithi133 ceph-mon[125939]: pgmap v8991: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T08:23:32.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:32 smithi096 ceph-mon[124666]: pgmap v8991: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T08:23:32.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:32 smithi186 ceph-mon[126480]: pgmap v8991: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T08:23:34.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:34 smithi133 ceph-mon[125939]: pgmap v8992: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T08:23:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16752.946276 secs 2023-05-08T08:23:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16753.502199 secs 2023-05-08T08:23:34.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:34 smithi096 ceph-mon[124666]: pgmap v8992: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T08:23:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16752.946276 secs 2023-05-08T08:23:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16753.502199 secs 2023-05-08T08:23:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:34 smithi186 ceph-mon[126480]: pgmap v8992: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T08:23:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16752.946276 secs 2023-05-08T08:23:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16753.502199 secs 2023-05-08T08:23:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16754.786229 secs 2023-05-08T08:23:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:36 smithi133 ceph-mon[125939]: pgmap v8993: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 682 B/s wr, 8 op/s 2023-05-08T08:23:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:23:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:23:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:23:36.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:23:36.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16754.786229 secs 2023-05-08T08:23:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:36 smithi096 ceph-mon[124666]: pgmap v8993: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 682 B/s wr, 8 op/s 2023-05-08T08:23:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:23:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:23:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:23:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:23:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16754.786229 secs 2023-05-08T08:23:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:36 smithi186 ceph-mon[126480]: pgmap v8993: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 682 B/s wr, 8 op/s 2023-05-08T08:23:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:23:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:23:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:23:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:23:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:37 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:23:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:37 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T08:23:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:37 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T08:23:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:37 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:23:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:37 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:23:37.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:37 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T08:23:37.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:37 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T08:23:37.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:37 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:23:37.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:37 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:23:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:37 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T08:23:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:37 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T08:23:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:37 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:23:38.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:38 smithi133 ceph-mon[125939]: pgmap v8994: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T08:23:38.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:38 smithi096 ceph-mon[124666]: pgmap v8994: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T08:23:38.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:38 smithi186 ceph-mon[126480]: pgmap v8994: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T08:23:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16757.946415 secs 2023-05-08T08:23:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16758.502331 secs 2023-05-08T08:23:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16757.946415 secs 2023-05-08T08:23:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16758.502331 secs 2023-05-08T08:23:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16757.946415 secs 2023-05-08T08:23:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16758.502331 secs 2023-05-08T08:23:40.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:40 smithi133 ceph-mon[125939]: pgmap v8995: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T08:23:40.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:40 smithi096 ceph-mon[124666]: pgmap v8995: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T08:23:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:40 smithi186 ceph-mon[126480]: pgmap v8995: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T08:23:42.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:42 smithi133 ceph-mon[125939]: pgmap v8996: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 128 KiB/s wr, 9 op/s 2023-05-08T08:23:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:42 smithi096 ceph-mon[124666]: pgmap v8996: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 128 KiB/s wr, 9 op/s 2023-05-08T08:23:42.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:42 smithi186 ceph-mon[126480]: pgmap v8996: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 128 KiB/s wr, 9 op/s 2023-05-08T08:23:43.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:23:43.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:23:43.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:23:44.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:44 smithi133 ceph-mon[125939]: pgmap v8997: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 128 KiB/s wr, 7 op/s 2023-05-08T08:23:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:23:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16762.946476 secs 2023-05-08T08:23:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:23:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:23:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:44 smithi096 ceph-mon[124666]: pgmap v8997: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 128 KiB/s wr, 7 op/s 2023-05-08T08:23:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:23:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16762.946476 secs 2023-05-08T08:23:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:23:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:23:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:44 smithi186 ceph-mon[126480]: pgmap v8997: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 128 KiB/s wr, 7 op/s 2023-05-08T08:23:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:23:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16762.946476 secs 2023-05-08T08:23:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:23:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:23:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:46 smithi133 ceph-mon[125939]: pgmap v8998: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 181 KiB/s wr, 10 op/s 2023-05-08T08:23:46.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:46 smithi096 ceph-mon[124666]: pgmap v8998: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 181 KiB/s wr, 10 op/s 2023-05-08T08:23:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:46 smithi186 ceph-mon[126480]: pgmap v8998: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 181 KiB/s wr, 10 op/s 2023-05-08T08:23:47.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:23:47.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:23:47.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:23:48.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:48 smithi133 ceph-mon[125939]: pgmap v8999: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 328 KiB/s wr, 8 op/s 2023-05-08T08:23:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:23:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:23:48.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:48 smithi096 ceph-mon[124666]: pgmap v8999: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 328 KiB/s wr, 8 op/s 2023-05-08T08:23:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:23:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:23:48.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:48 smithi186 ceph-mon[126480]: pgmap v8999: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 328 KiB/s wr, 8 op/s 2023-05-08T08:23:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:23:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:23:49.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16767.946574 secs 2023-05-08T08:23:49.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16767.946574 secs 2023-05-08T08:23:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16767.946574 secs 2023-05-08T08:23:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:50 smithi133 ceph-mon[125939]: pgmap v9000: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 292 KiB/s rd, 328 KiB/s wr, 8 op/s 2023-05-08T08:23:50.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:50 smithi096 ceph-mon[124666]: pgmap v9000: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 292 KiB/s rd, 328 KiB/s wr, 8 op/s 2023-05-08T08:23:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:50 smithi186 ceph-mon[126480]: pgmap v9000: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 292 KiB/s rd, 328 KiB/s wr, 8 op/s 2023-05-08T08:23:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:52 smithi096 ceph-mon[124666]: pgmap v9001: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 632 KiB/s rd, 527 KiB/s wr, 13 op/s 2023-05-08T08:23:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:52 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:23:52.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:52 smithi186 ceph-mon[126480]: pgmap v9001: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 632 KiB/s rd, 527 KiB/s wr, 13 op/s 2023-05-08T08:23:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:52 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:23:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:52 smithi133 ceph-mon[125939]: pgmap v9001: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 632 KiB/s rd, 527 KiB/s wr, 13 op/s 2023-05-08T08:23:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:52 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:23:54.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:54 smithi096 ceph-mon[124666]: pgmap v9002: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 512 KiB/s rd, 400 KiB/s wr, 9 op/s 2023-05-08T08:23:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16772.946698 secs 2023-05-08T08:23:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:54 smithi186 ceph-mon[126480]: pgmap v9002: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 512 KiB/s rd, 400 KiB/s wr, 9 op/s 2023-05-08T08:23:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16772.946698 secs 2023-05-08T08:23:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:54 smithi133 ceph-mon[125939]: pgmap v9002: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 512 KiB/s rd, 400 KiB/s wr, 9 op/s 2023-05-08T08:23:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16772.946698 secs 2023-05-08T08:23:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16774.786606 secs 2023-05-08T08:23:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:56 smithi096 ceph-mon[124666]: pgmap v9003: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 410 KiB/s wr, 13 op/s 2023-05-08T08:23:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16774.786606 secs 2023-05-08T08:23:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:56 smithi186 ceph-mon[126480]: pgmap v9003: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 410 KiB/s wr, 13 op/s 2023-05-08T08:23:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16774.786606 secs 2023-05-08T08:23:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:56 smithi133 ceph-mon[125939]: pgmap v9003: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 410 KiB/s wr, 13 op/s 2023-05-08T08:23:58.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:58 smithi096 ceph-mon[124666]: pgmap v9004: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 452 KiB/s rd, 371 KiB/s wr, 11 op/s 2023-05-08T08:23:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:58 smithi186 ceph-mon[126480]: pgmap v9004: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 452 KiB/s rd, 371 KiB/s wr, 11 op/s 2023-05-08T08:23:58.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:58 smithi133 ceph-mon[125939]: pgmap v9004: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 452 KiB/s rd, 371 KiB/s wr, 11 op/s 2023-05-08T08:23:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16777.946823 secs 2023-05-08T08:23:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:23:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16778.502745 secs 2023-05-08T08:23:59.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16777.946823 secs 2023-05-08T08:23:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:23:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16778.502745 secs 2023-05-08T08:23:59.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16777.946823 secs 2023-05-08T08:23:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:23:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16778.502745 secs 2023-05-08T08:24:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:00 smithi186 ceph-mon[126480]: pgmap v9005: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 223 KiB/s wr, 10 op/s 2023-05-08T08:24:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:00 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:24:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:24:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:24:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:24:00.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:00 smithi133 ceph-mon[125939]: pgmap v9005: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 223 KiB/s wr, 10 op/s 2023-05-08T08:24:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:00 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:24:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:24:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:24:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:24:00.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:00 smithi096 ceph-mon[124666]: pgmap v9005: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 223 KiB/s wr, 10 op/s 2023-05-08T08:24:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:00 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:24:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:24:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:24:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:24:01.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16779.786743 secs 2023-05-08T08:24:01.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16779.786743 secs 2023-05-08T08:24:01.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16779.786743 secs 2023-05-08T08:24:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:02 smithi186 ceph-mon[126480]: pgmap v9006: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 674 KiB/s rd, 440 KiB/s wr, 15 op/s 2023-05-08T08:24:02.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:02 smithi133 ceph-mon[125939]: pgmap v9006: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 674 KiB/s rd, 440 KiB/s wr, 15 op/s 2023-05-08T08:24:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:02 smithi096 ceph-mon[124666]: pgmap v9006: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 674 KiB/s rd, 440 KiB/s wr, 15 op/s 2023-05-08T08:24:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:04 smithi186 ceph-mon[126480]: pgmap v9007: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 241 KiB/s wr, 10 op/s 2023-05-08T08:24:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16782.946978 secs 2023-05-08T08:24:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16783.502880 secs 2023-05-08T08:24:04.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:04 smithi133 ceph-mon[125939]: pgmap v9007: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 241 KiB/s wr, 10 op/s 2023-05-08T08:24:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16782.946978 secs 2023-05-08T08:24:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16783.502880 secs 2023-05-08T08:24:04.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:04 smithi096 ceph-mon[124666]: pgmap v9007: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 241 KiB/s wr, 10 op/s 2023-05-08T08:24:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16782.946978 secs 2023-05-08T08:24:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16783.502880 secs 2023-05-08T08:24:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16784.786874 secs 2023-05-08T08:24:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:06 smithi186 ceph-mon[126480]: pgmap v9008: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 286 KiB/s wr, 28 op/s 2023-05-08T08:24:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16784.786874 secs 2023-05-08T08:24:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:06 smithi133 ceph-mon[125939]: pgmap v9008: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 286 KiB/s wr, 28 op/s 2023-05-08T08:24:06.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16784.786874 secs 2023-05-08T08:24:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:06 smithi096 ceph-mon[124666]: pgmap v9008: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 286 KiB/s wr, 28 op/s 2023-05-08T08:24:08.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:08 smithi133 ceph-mon[125939]: pgmap v9009: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 276 KiB/s wr, 25 op/s 2023-05-08T08:24:08.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:08 smithi096 ceph-mon[124666]: pgmap v9009: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 276 KiB/s wr, 25 op/s 2023-05-08T08:24:09.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:08 smithi186 ceph-mon[126480]: pgmap v9009: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 276 KiB/s wr, 25 op/s 2023-05-08T08:24:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16787.947110 secs 2023-05-08T08:24:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16788.502948 secs 2023-05-08T08:24:09.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16787.947110 secs 2023-05-08T08:24:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16788.502948 secs 2023-05-08T08:24:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16787.947110 secs 2023-05-08T08:24:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16788.502948 secs 2023-05-08T08:24:10.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:10 smithi186 ceph-mon[126480]: pgmap v9010: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 263 KiB/s wr, 23 op/s 2023-05-08T08:24:10.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:10 smithi133 ceph-mon[125939]: pgmap v9010: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 263 KiB/s wr, 23 op/s 2023-05-08T08:24:10.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:10 smithi096 ceph-mon[124666]: pgmap v9010: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 263 KiB/s wr, 23 op/s 2023-05-08T08:24:11.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16789.786956 secs 2023-05-08T08:24:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:11 smithi186 ceph-mon[126480]: osdmap e640: 12 total, 12 up, 12 in 2023-05-08T08:24:11.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16789.786956 secs 2023-05-08T08:24:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:11 smithi133 ceph-mon[125939]: osdmap e640: 12 total, 12 up, 12 in 2023-05-08T08:24:11.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16789.786956 secs 2023-05-08T08:24:11.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:11 smithi096 ceph-mon[124666]: osdmap e640: 12 total, 12 up, 12 in 2023-05-08T08:24:12.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:12 smithi186 ceph-mon[126480]: pgmap v9012: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 120 KiB/s wr, 25 op/s 2023-05-08T08:24:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:12 smithi133 ceph-mon[125939]: pgmap v9012: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 120 KiB/s wr, 25 op/s 2023-05-08T08:24:12.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:12 smithi096 ceph-mon[124666]: pgmap v9012: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 120 KiB/s wr, 25 op/s 2023-05-08T08:24:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:14 smithi186 ceph-mon[126480]: pgmap v9013: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 120 KiB/s wr, 25 op/s 2023-05-08T08:24:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16792.947250 secs 2023-05-08T08:24:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16793.503065 secs 2023-05-08T08:24:14.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:14 smithi133 ceph-mon[125939]: pgmap v9013: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 120 KiB/s wr, 25 op/s 2023-05-08T08:24:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16792.947250 secs 2023-05-08T08:24:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16793.503065 secs 2023-05-08T08:24:14.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:14 smithi096 ceph-mon[124666]: pgmap v9013: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 120 KiB/s wr, 25 op/s 2023-05-08T08:24:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16792.947250 secs 2023-05-08T08:24:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16793.503065 secs 2023-05-08T08:24:16.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16794.787074 secs 2023-05-08T08:24:16.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:16 smithi186 ceph-mon[126480]: pgmap v9014: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 66 KiB/s wr, 6 op/s 2023-05-08T08:24:16.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16794.787074 secs 2023-05-08T08:24:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:16 smithi133 ceph-mon[125939]: pgmap v9014: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 66 KiB/s wr, 6 op/s 2023-05-08T08:24:16.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16794.787074 secs 2023-05-08T08:24:16.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:16 smithi096 ceph-mon[124666]: pgmap v9014: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 66 KiB/s wr, 6 op/s 2023-05-08T08:24:18.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:18 smithi186 ceph-mon[126480]: pgmap v9015: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 66 KiB/s wr, 6 op/s 2023-05-08T08:24:18.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:18 smithi133 ceph-mon[125939]: pgmap v9015: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 66 KiB/s wr, 6 op/s 2023-05-08T08:24:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:18 smithi096 ceph-mon[124666]: pgmap v9015: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 66 KiB/s wr, 6 op/s 2023-05-08T08:24:19.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16797.947401 secs 2023-05-08T08:24:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16798.503205 secs 2023-05-08T08:24:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16797.947401 secs 2023-05-08T08:24:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16798.503205 secs 2023-05-08T08:24:19.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16797.947401 secs 2023-05-08T08:24:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16798.503205 secs 2023-05-08T08:24:20.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:20 smithi186 ceph-mon[126480]: pgmap v9016: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 66 KiB/s wr, 6 op/s 2023-05-08T08:24:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16799.787198 secs 2023-05-08T08:24:20.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:20 smithi133 ceph-mon[125939]: pgmap v9016: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 66 KiB/s wr, 6 op/s 2023-05-08T08:24:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16799.787198 secs 2023-05-08T08:24:20.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:20 smithi096 ceph-mon[124666]: pgmap v9016: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 66 KiB/s wr, 6 op/s 2023-05-08T08:24:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16799.787198 secs 2023-05-08T08:24:22.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:22 smithi186 ceph-mon[126480]: pgmap v9017: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 284 B/s wr, 6 op/s 2023-05-08T08:24:22.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:22 smithi186 ceph-mon[126480]: osdmap e641: 12 total, 12 up, 12 in 2023-05-08T08:24:22.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:22 smithi133 ceph-mon[125939]: pgmap v9017: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 284 B/s wr, 6 op/s 2023-05-08T08:24:22.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:22 smithi133 ceph-mon[125939]: osdmap e641: 12 total, 12 up, 12 in 2023-05-08T08:24:22.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:22 smithi096 ceph-mon[124666]: pgmap v9017: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 284 B/s wr, 6 op/s 2023-05-08T08:24:22.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:22 smithi096 ceph-mon[124666]: osdmap e641: 12 total, 12 up, 12 in 2023-05-08T08:24:24.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:24 smithi186 ceph-mon[126480]: pgmap v9019: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:24:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16802.947526 secs 2023-05-08T08:24:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16803.503337 secs 2023-05-08T08:24:24.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:24 smithi133 ceph-mon[125939]: pgmap v9019: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:24:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16802.947526 secs 2023-05-08T08:24:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16803.503337 secs 2023-05-08T08:24:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:24 smithi096 ceph-mon[124666]: pgmap v9019: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:24:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16802.947526 secs 2023-05-08T08:24:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16803.503337 secs 2023-05-08T08:24:25.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16804.787316 secs 2023-05-08T08:24:25.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16804.787316 secs 2023-05-08T08:24:25.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16804.787316 secs 2023-05-08T08:24:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:26 smithi186 ceph-mon[126480]: pgmap v9020: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:24:26.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:26 smithi133 ceph-mon[125939]: pgmap v9020: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:24:26.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:26 smithi096 ceph-mon[124666]: pgmap v9020: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:24:28.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:28 smithi133 ceph-mon[125939]: pgmap v9021: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:24:28.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:28 smithi096 ceph-mon[124666]: pgmap v9021: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:24:28.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:28 smithi186 ceph-mon[126480]: pgmap v9021: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:24:29.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16807.947594 secs 2023-05-08T08:24:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16808.503464 secs 2023-05-08T08:24:29.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16807.947594 secs 2023-05-08T08:24:29.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16808.503464 secs 2023-05-08T08:24:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16807.947594 secs 2023-05-08T08:24:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16808.503464 secs 2023-05-08T08:24:30.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:30 smithi133 ceph-mon[125939]: pgmap v9022: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:24:30.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:30 smithi096 ceph-mon[124666]: pgmap v9022: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:24:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:30 smithi186 ceph-mon[126480]: pgmap v9022: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:24:31.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16809.787437 secs 2023-05-08T08:24:31.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16809.787437 secs 2023-05-08T08:24:31.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16809.787437 secs 2023-05-08T08:24:32.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:32 smithi133 ceph-mon[125939]: pgmap v9023: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2023-05-08T08:24:32.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:32 smithi096 ceph-mon[124666]: pgmap v9023: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2023-05-08T08:24:32.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:32 smithi186 ceph-mon[126480]: pgmap v9023: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2023-05-08T08:24:34.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:34 smithi133 ceph-mon[125939]: pgmap v9024: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.0 KiB/s wr, 7 op/s 2023-05-08T08:24:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16812.947702 secs 2023-05-08T08:24:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16813.503586 secs 2023-05-08T08:24:34.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:34 smithi096 ceph-mon[124666]: pgmap v9024: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.0 KiB/s wr, 7 op/s 2023-05-08T08:24:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16812.947702 secs 2023-05-08T08:24:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16813.503586 secs 2023-05-08T08:24:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:34 smithi186 ceph-mon[126480]: pgmap v9024: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.0 KiB/s wr, 7 op/s 2023-05-08T08:24:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16812.947702 secs 2023-05-08T08:24:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16813.503586 secs 2023-05-08T08:24:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16814.787557 secs 2023-05-08T08:24:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:36 smithi133 ceph-mon[125939]: pgmap v9025: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 105 KiB/s wr, 9 op/s 2023-05-08T08:24:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:24:36.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16814.787557 secs 2023-05-08T08:24:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:36 smithi096 ceph-mon[124666]: pgmap v9025: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 105 KiB/s wr, 9 op/s 2023-05-08T08:24:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:24:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16814.787557 secs 2023-05-08T08:24:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:36 smithi186 ceph-mon[126480]: pgmap v9025: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 105 KiB/s wr, 9 op/s 2023-05-08T08:24:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:24:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:37 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:24:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:37 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:24:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:37 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:24:37.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:37 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:24:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:37 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:24:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:37 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:24:37.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:37 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:24:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:37 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:24:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:37 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:24:38.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:38 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:24:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:38 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T08:24:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:38 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T08:24:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:38 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:24:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:38 smithi133 ceph-mon[125939]: pgmap v9026: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 105 KiB/s wr, 7 op/s 2023-05-08T08:24:38.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:38 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:24:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:38 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T08:24:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:38 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T08:24:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:38 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:24:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:38 smithi096 ceph-mon[124666]: pgmap v9026: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 105 KiB/s wr, 7 op/s 2023-05-08T08:24:38.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:38 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:24:38.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:38 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T08:24:38.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:38 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T08:24:38.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:38 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:24:38.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:38 smithi186 ceph-mon[126480]: pgmap v9026: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 105 KiB/s wr, 7 op/s 2023-05-08T08:24:39.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16818.503653 secs 2023-05-08T08:24:39.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16818.503653 secs 2023-05-08T08:24:39.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16818.503653 secs 2023-05-08T08:24:40.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:40 smithi133 ceph-mon[125939]: pgmap v9027: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 105 KiB/s wr, 7 op/s 2023-05-08T08:24:40.509 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:40 smithi096 ceph-mon[124666]: pgmap v9027: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 105 KiB/s wr, 7 op/s 2023-05-08T08:24:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:40 smithi186 ceph-mon[126480]: pgmap v9027: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 105 KiB/s wr, 7 op/s 2023-05-08T08:24:42.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:42 smithi133 ceph-mon[125939]: pgmap v9028: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 106 KiB/s wr, 10 op/s 2023-05-08T08:24:42.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:24:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:42 smithi096 ceph-mon[124666]: pgmap v9028: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 106 KiB/s wr, 10 op/s 2023-05-08T08:24:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:24:42.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:42 smithi186 ceph-mon[126480]: pgmap v9028: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 106 KiB/s wr, 10 op/s 2023-05-08T08:24:42.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:24:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:43 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:24:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T08:24:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:24:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:24:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:43 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:24:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T08:24:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:24:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:24:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:43 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:24:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T08:24:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:24:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:24:44.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:44 smithi133 ceph-mon[125939]: pgmap v9029: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 105 KiB/s wr, 7 op/s 2023-05-08T08:24:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:24:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:24:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16823.503776 secs 2023-05-08T08:24:44.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:44 smithi096 ceph-mon[124666]: pgmap v9029: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 105 KiB/s wr, 7 op/s 2023-05-08T08:24:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:24:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:24:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16823.503776 secs 2023-05-08T08:24:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:44 smithi186 ceph-mon[126480]: pgmap v9029: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 105 KiB/s wr, 7 op/s 2023-05-08T08:24:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:24:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:24:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16823.503776 secs 2023-05-08T08:24:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:46 smithi133 ceph-mon[125939]: pgmap v9030: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 243 KiB/s wr, 9 op/s 2023-05-08T08:24:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:46 smithi096 ceph-mon[124666]: pgmap v9030: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 243 KiB/s wr, 9 op/s 2023-05-08T08:24:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:46 smithi186 ceph-mon[126480]: pgmap v9030: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 243 KiB/s wr, 9 op/s 2023-05-08T08:24:48.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:48 smithi133 ceph-mon[125939]: pgmap v9031: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 147 KiB/s wr, 7 op/s 2023-05-08T08:24:48.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:48 smithi096 ceph-mon[124666]: pgmap v9031: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 147 KiB/s wr, 7 op/s 2023-05-08T08:24:48.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:48 smithi186 ceph-mon[126480]: pgmap v9031: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 147 KiB/s wr, 7 op/s 2023-05-08T08:24:49.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16827.948088 secs 2023-05-08T08:24:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16827.948088 secs 2023-05-08T08:24:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16827.948088 secs 2023-05-08T08:24:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:50 smithi133 ceph-mon[125939]: pgmap v9032: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 147 KiB/s wr, 6 op/s 2023-05-08T08:24:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:50 smithi096 ceph-mon[124666]: pgmap v9032: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 147 KiB/s wr, 6 op/s 2023-05-08T08:24:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:50 smithi186 ceph-mon[126480]: pgmap v9032: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 147 KiB/s wr, 6 op/s 2023-05-08T08:24:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:51 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:24:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T08:24:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:24:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:24:51.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:51 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:24:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T08:24:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:24:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:24:51.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:51 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:24:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T08:24:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:24:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:24:52.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:52 smithi133 ceph-mon[125939]: pgmap v9033: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 326 KiB/s wr, 10 op/s 2023-05-08T08:24:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:24:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:24:52.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:52 smithi096 ceph-mon[124666]: pgmap v9033: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 326 KiB/s wr, 10 op/s 2023-05-08T08:24:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:24:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:24:52.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:52 smithi186 ceph-mon[126480]: pgmap v9033: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 326 KiB/s wr, 10 op/s 2023-05-08T08:24:52.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:24:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:24:54.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:54 smithi133 ceph-mon[125939]: pgmap v9034: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 325 KiB/s wr, 7 op/s 2023-05-08T08:24:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16832.948190 secs 2023-05-08T08:24:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16833.504020 secs 2023-05-08T08:24:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:54 smithi096 ceph-mon[124666]: pgmap v9034: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 325 KiB/s wr, 7 op/s 2023-05-08T08:24:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16832.948190 secs 2023-05-08T08:24:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16833.504020 secs 2023-05-08T08:24:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:54 smithi186 ceph-mon[126480]: pgmap v9034: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 325 KiB/s wr, 7 op/s 2023-05-08T08:24:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16832.948190 secs 2023-05-08T08:24:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16833.504020 secs 2023-05-08T08:24:55.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:55 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:24:55.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:55 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:24:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:55 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:24:55.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:55 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:24:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:55 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:24:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:55 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:24:55.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:55 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:24:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:55 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:24:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:55 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:24:56.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16834.788088 secs 2023-05-08T08:24:56.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:56 smithi186 ceph-mon[126480]: pgmap v9035: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 653 KiB/s rd, 581 KiB/s wr, 12 op/s 2023-05-08T08:24:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16834.788088 secs 2023-05-08T08:24:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:56 smithi133 ceph-mon[125939]: pgmap v9035: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 653 KiB/s rd, 581 KiB/s wr, 12 op/s 2023-05-08T08:24:56.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16834.788088 secs 2023-05-08T08:24:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:56 smithi096 ceph-mon[124666]: pgmap v9035: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 653 KiB/s rd, 581 KiB/s wr, 12 op/s 2023-05-08T08:24:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:58 smithi186 ceph-mon[126480]: pgmap v9036: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 451 KiB/s wr, 10 op/s 2023-05-08T08:24:58.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:58 smithi133 ceph-mon[125939]: pgmap v9036: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 451 KiB/s wr, 10 op/s 2023-05-08T08:24:58.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:58 smithi096 ceph-mon[124666]: pgmap v9036: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 451 KiB/s wr, 10 op/s 2023-05-08T08:24:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16837.948307 secs 2023-05-08T08:24:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:24:59 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:24:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16837.948307 secs 2023-05-08T08:24:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:24:59 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:24:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16837.948307 secs 2023-05-08T08:24:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:24:59 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:25:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:00 smithi186 ceph-mon[126480]: pgmap v9037: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 443 KiB/s wr, 10 op/s 2023-05-08T08:25:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:25:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:25:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:25:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:00 smithi133 ceph-mon[125939]: pgmap v9037: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 443 KiB/s wr, 10 op/s 2023-05-08T08:25:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:25:00.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:25:00.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:25:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:00 smithi096 ceph-mon[124666]: pgmap v9037: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 443 KiB/s wr, 10 op/s 2023-05-08T08:25:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:25:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:25:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:25:01.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16839.788229 secs 2023-05-08T08:25:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16839.788229 secs 2023-05-08T08:25:01.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16839.788229 secs 2023-05-08T08:25:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:02 smithi186 ceph-mon[126480]: pgmap v9038: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 585 KiB/s rd, 522 KiB/s wr, 15 op/s 2023-05-08T08:25:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:02 smithi133 ceph-mon[125939]: pgmap v9038: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 585 KiB/s rd, 522 KiB/s wr, 15 op/s 2023-05-08T08:25:02.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:02 smithi096 ceph-mon[124666]: pgmap v9038: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 585 KiB/s rd, 522 KiB/s wr, 15 op/s 2023-05-08T08:25:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:04 smithi186 ceph-mon[126480]: pgmap v9039: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 344 KiB/s wr, 11 op/s 2023-05-08T08:25:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16842.948425 secs 2023-05-08T08:25:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16843.504241 secs 2023-05-08T08:25:04.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:04 smithi133 ceph-mon[125939]: pgmap v9039: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 344 KiB/s wr, 11 op/s 2023-05-08T08:25:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16842.948425 secs 2023-05-08T08:25:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16843.504241 secs 2023-05-08T08:25:04.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:04 smithi096 ceph-mon[124666]: pgmap v9039: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 344 KiB/s wr, 11 op/s 2023-05-08T08:25:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16842.948425 secs 2023-05-08T08:25:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16843.504241 secs 2023-05-08T08:25:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16844.788348 secs 2023-05-08T08:25:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:06 smithi186 ceph-mon[126480]: pgmap v9040: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 622 KiB/s rd, 630 KiB/s wr, 31 op/s 2023-05-08T08:25:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:06 smithi186 ceph-mon[126480]: osdmap e642: 12 total, 12 up, 12 in 2023-05-08T08:25:06.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16844.788348 secs 2023-05-08T08:25:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:06 smithi133 ceph-mon[125939]: pgmap v9040: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 622 KiB/s rd, 630 KiB/s wr, 31 op/s 2023-05-08T08:25:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:06 smithi133 ceph-mon[125939]: osdmap e642: 12 total, 12 up, 12 in 2023-05-08T08:25:06.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16844.788348 secs 2023-05-08T08:25:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:06 smithi096 ceph-mon[124666]: pgmap v9040: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 622 KiB/s rd, 630 KiB/s wr, 31 op/s 2023-05-08T08:25:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:06 smithi096 ceph-mon[124666]: osdmap e642: 12 total, 12 up, 12 in 2023-05-08T08:25:08.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:08 smithi133 ceph-mon[125939]: pgmap v9042: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 397 KiB/s rd, 438 KiB/s wr, 30 op/s 2023-05-08T08:25:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:08 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:25:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:25:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:25:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:08 smithi096 ceph-mon[124666]: pgmap v9042: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 397 KiB/s rd, 438 KiB/s wr, 30 op/s 2023-05-08T08:25:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:08 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:25:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:25:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:25:08.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:08 smithi186 ceph-mon[126480]: pgmap v9042: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 397 KiB/s rd, 438 KiB/s wr, 30 op/s 2023-05-08T08:25:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:08 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:25:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:25:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:25:09.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16847.948543 secs 2023-05-08T08:25:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16848.504389 secs 2023-05-08T08:25:09.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16847.948543 secs 2023-05-08T08:25:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16848.504389 secs 2023-05-08T08:25:09.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16847.948543 secs 2023-05-08T08:25:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16848.504389 secs 2023-05-08T08:25:10.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:10 smithi133 ceph-mon[125939]: pgmap v9043: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 397 KiB/s rd, 438 KiB/s wr, 30 op/s 2023-05-08T08:25:10.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:10 smithi096 ceph-mon[124666]: pgmap v9043: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 397 KiB/s rd, 438 KiB/s wr, 30 op/s 2023-05-08T08:25:10.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:10 smithi186 ceph-mon[126480]: pgmap v9043: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 397 KiB/s rd, 438 KiB/s wr, 30 op/s 2023-05-08T08:25:11.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16849.788468 secs 2023-05-08T08:25:11.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16849.788468 secs 2023-05-08T08:25:11.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16849.788468 secs 2023-05-08T08:25:12.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:12 smithi133 ceph-mon[125939]: pgmap v9044: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 410 KiB/s wr, 29 op/s 2023-05-08T08:25:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:12 smithi133 ceph-mon[125939]: osdmap e643: 12 total, 12 up, 12 in 2023-05-08T08:25:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:12 smithi096 ceph-mon[124666]: pgmap v9044: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 410 KiB/s wr, 29 op/s 2023-05-08T08:25:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:12 smithi096 ceph-mon[124666]: osdmap e643: 12 total, 12 up, 12 in 2023-05-08T08:25:12.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:12 smithi186 ceph-mon[126480]: pgmap v9044: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 410 KiB/s wr, 29 op/s 2023-05-08T08:25:12.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:12 smithi186 ceph-mon[126480]: osdmap e643: 12 total, 12 up, 12 in 2023-05-08T08:25:14.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:14 smithi133 ceph-mon[125939]: pgmap v9046: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 83 KiB/s wr, 6 op/s 2023-05-08T08:25:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16852.948653 secs 2023-05-08T08:25:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16853.504518 secs 2023-05-08T08:25:14.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:14 smithi096 ceph-mon[124666]: pgmap v9046: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 83 KiB/s wr, 6 op/s 2023-05-08T08:25:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16852.948653 secs 2023-05-08T08:25:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16853.504518 secs 2023-05-08T08:25:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:14 smithi186 ceph-mon[126480]: pgmap v9046: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 83 KiB/s wr, 6 op/s 2023-05-08T08:25:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16852.948653 secs 2023-05-08T08:25:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16853.504518 secs 2023-05-08T08:25:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16854.788588 secs 2023-05-08T08:25:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:16 smithi133 ceph-mon[125939]: pgmap v9047: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 116 KiB/s wr, 8 op/s 2023-05-08T08:25:16.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16854.788588 secs 2023-05-08T08:25:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:16 smithi096 ceph-mon[124666]: pgmap v9047: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 116 KiB/s wr, 8 op/s 2023-05-08T08:25:16.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16854.788588 secs 2023-05-08T08:25:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:16 smithi186 ceph-mon[126480]: pgmap v9047: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 116 KiB/s wr, 8 op/s 2023-05-08T08:25:18.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:18 smithi133 ceph-mon[125939]: pgmap v9048: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 114 KiB/s wr, 8 op/s 2023-05-08T08:25:18.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:18 smithi096 ceph-mon[124666]: pgmap v9048: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 114 KiB/s wr, 8 op/s 2023-05-08T08:25:18.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:18 smithi186 ceph-mon[126480]: pgmap v9048: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 114 KiB/s wr, 8 op/s 2023-05-08T08:25:19.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16857.948767 secs 2023-05-08T08:25:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16858.504637 secs 2023-05-08T08:25:19.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16857.948767 secs 2023-05-08T08:25:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16858.504637 secs 2023-05-08T08:25:19.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16857.948767 secs 2023-05-08T08:25:19.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16858.504637 secs 2023-05-08T08:25:20.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:20 smithi133 ceph-mon[125939]: pgmap v9049: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 114 KiB/s wr, 8 op/s 2023-05-08T08:25:20.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:20 smithi096 ceph-mon[124666]: pgmap v9049: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 114 KiB/s wr, 8 op/s 2023-05-08T08:25:20.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:20 smithi186 ceph-mon[126480]: pgmap v9049: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 114 KiB/s wr, 8 op/s 2023-05-08T08:25:21.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16859.788713 secs 2023-05-08T08:25:21.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16859.788713 secs 2023-05-08T08:25:22.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16859.788713 secs 2023-05-08T08:25:22.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:22 smithi133 ceph-mon[125939]: pgmap v9050: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 48 KiB/s wr, 7 op/s 2023-05-08T08:25:22.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:22 smithi096 ceph-mon[124666]: pgmap v9050: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 48 KiB/s wr, 7 op/s 2023-05-08T08:25:22.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:22 smithi186 ceph-mon[126480]: pgmap v9050: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 48 KiB/s wr, 7 op/s 2023-05-08T08:25:24.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:24 smithi133 ceph-mon[125939]: pgmap v9051: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 44 KiB/s wr, 6 op/s 2023-05-08T08:25:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16862.948831 secs 2023-05-08T08:25:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16863.504719 secs 2023-05-08T08:25:24.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:24 smithi096 ceph-mon[124666]: pgmap v9051: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 44 KiB/s wr, 6 op/s 2023-05-08T08:25:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16862.948831 secs 2023-05-08T08:25:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16863.504719 secs 2023-05-08T08:25:24.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:24 smithi186 ceph-mon[126480]: pgmap v9051: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 44 KiB/s wr, 6 op/s 2023-05-08T08:25:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16862.948831 secs 2023-05-08T08:25:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16863.504719 secs 2023-05-08T08:25:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16864.788807 secs 2023-05-08T08:25:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:26 smithi133 ceph-mon[125939]: pgmap v9052: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 40 KiB/s wr, 8 op/s 2023-05-08T08:25:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16864.788807 secs 2023-05-08T08:25:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:26 smithi096 ceph-mon[124666]: pgmap v9052: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 40 KiB/s wr, 8 op/s 2023-05-08T08:25:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16864.788807 secs 2023-05-08T08:25:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:26 smithi186 ceph-mon[126480]: pgmap v9052: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 40 KiB/s wr, 8 op/s 2023-05-08T08:25:28.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:28 smithi133 ceph-mon[125939]: pgmap v9053: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2023-05-08T08:25:28.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:28 smithi096 ceph-mon[124666]: pgmap v9053: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2023-05-08T08:25:28.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:28 smithi186 ceph-mon[126480]: pgmap v9053: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2023-05-08T08:25:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16867.948895 secs 2023-05-08T08:25:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16868.504838 secs 2023-05-08T08:25:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16867.948895 secs 2023-05-08T08:25:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16868.504838 secs 2023-05-08T08:25:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16867.948895 secs 2023-05-08T08:25:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16868.504838 secs 2023-05-08T08:25:30.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:30 smithi133 ceph-mon[125939]: pgmap v9054: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T08:25:30.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:30 smithi096 ceph-mon[124666]: pgmap v9054: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T08:25:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:30 smithi186 ceph-mon[126480]: pgmap v9054: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T08:25:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16869.788956 secs 2023-05-08T08:25:31.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16869.788956 secs 2023-05-08T08:25:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16869.788956 secs 2023-05-08T08:25:32.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:32 smithi133 ceph-mon[125939]: pgmap v9055: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 511 B/s wr, 9 op/s 2023-05-08T08:25:32.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:32 smithi096 ceph-mon[124666]: pgmap v9055: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 511 B/s wr, 9 op/s 2023-05-08T08:25:32.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:32 smithi186 ceph-mon[126480]: pgmap v9055: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 511 B/s wr, 9 op/s 2023-05-08T08:25:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:34 smithi133 ceph-mon[125939]: pgmap v9056: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T08:25:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16872.949019 secs 2023-05-08T08:25:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16873.504963 secs 2023-05-08T08:25:34.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:34 smithi096 ceph-mon[124666]: pgmap v9056: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T08:25:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16872.949019 secs 2023-05-08T08:25:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16873.504963 secs 2023-05-08T08:25:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:34 smithi186 ceph-mon[126480]: pgmap v9056: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T08:25:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16872.949019 secs 2023-05-08T08:25:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16873.504963 secs 2023-05-08T08:25:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16874.789076 secs 2023-05-08T08:25:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:36 smithi133 ceph-mon[125939]: pgmap v9057: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 58 KiB/s wr, 9 op/s 2023-05-08T08:25:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16874.789076 secs 2023-05-08T08:25:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:36 smithi096 ceph-mon[124666]: pgmap v9057: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 58 KiB/s wr, 9 op/s 2023-05-08T08:25:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16874.789076 secs 2023-05-08T08:25:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:36 smithi186 ceph-mon[126480]: pgmap v9057: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 58 KiB/s wr, 9 op/s 2023-05-08T08:25:37.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:37 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:25:37.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:37 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:25:37.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:37 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:25:38.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:38 smithi096 ceph-mon[124666]: pgmap v9058: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 58 KiB/s wr, 6 op/s 2023-05-08T08:25:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:25:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:25:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:25:38.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:38 smithi186 ceph-mon[126480]: pgmap v9058: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 58 KiB/s wr, 6 op/s 2023-05-08T08:25:38.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:25:38.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:25:38.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:25:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:38 smithi133 ceph-mon[125939]: pgmap v9058: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 58 KiB/s wr, 6 op/s 2023-05-08T08:25:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:25:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:25:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:25:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:39 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:25:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:39 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T08:25:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:39 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T08:25:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:39 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:25:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16877.949156 secs 2023-05-08T08:25:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16878.505083 secs 2023-05-08T08:25:39.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:39 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:25:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:39 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T08:25:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:39 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T08:25:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:39 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:25:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16877.949156 secs 2023-05-08T08:25:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16878.505083 secs 2023-05-08T08:25:39.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:39 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:25:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:39 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T08:25:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:39 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T08:25:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:39 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:25:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16877.949156 secs 2023-05-08T08:25:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16878.505083 secs 2023-05-08T08:25:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:40 smithi096 ceph-mon[124666]: pgmap v9059: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 58 KiB/s wr, 6 op/s 2023-05-08T08:25:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:40 smithi186 ceph-mon[126480]: pgmap v9059: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 58 KiB/s wr, 6 op/s 2023-05-08T08:25:40.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:40 smithi133 ceph-mon[125939]: pgmap v9059: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 58 KiB/s wr, 6 op/s 2023-05-08T08:25:42.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:42 smithi186 ceph-mon[126480]: pgmap v9060: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 59 KiB/s wr, 10 op/s 2023-05-08T08:25:42.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:42 smithi133 ceph-mon[125939]: pgmap v9060: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 59 KiB/s wr, 10 op/s 2023-05-08T08:25:42.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:42 smithi096 ceph-mon[124666]: pgmap v9060: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 59 KiB/s wr, 10 op/s 2023-05-08T08:25:43.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:25:43.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:25:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:25:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:44 smithi186 ceph-mon[126480]: pgmap v9061: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 6 op/s 2023-05-08T08:25:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16882.949270 secs 2023-05-08T08:25:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:25:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:25:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:25:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16883.505183 secs 2023-05-08T08:25:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:44 smithi133 ceph-mon[125939]: pgmap v9061: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 6 op/s 2023-05-08T08:25:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16882.949270 secs 2023-05-08T08:25:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:25:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:25:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:25:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16883.505183 secs 2023-05-08T08:25:44.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:44 smithi096 ceph-mon[124666]: pgmap v9061: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 6 op/s 2023-05-08T08:25:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16882.949270 secs 2023-05-08T08:25:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:25:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:25:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:25:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16883.505183 secs 2023-05-08T08:25:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:46 smithi186 ceph-mon[126480]: pgmap v9062: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 422 KiB/s wr, 9 op/s 2023-05-08T08:25:46.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:46 smithi133 ceph-mon[125939]: pgmap v9062: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 422 KiB/s wr, 9 op/s 2023-05-08T08:25:46.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:46 smithi096 ceph-mon[124666]: pgmap v9062: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 422 KiB/s wr, 9 op/s 2023-05-08T08:25:48.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:48 smithi186 ceph-mon[126480]: pgmap v9063: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 373 KiB/s wr, 7 op/s 2023-05-08T08:25:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:48 smithi133 ceph-mon[125939]: pgmap v9063: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 373 KiB/s wr, 7 op/s 2023-05-08T08:25:48.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:48 smithi096 ceph-mon[124666]: pgmap v9063: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 373 KiB/s wr, 7 op/s 2023-05-08T08:25:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16887.949405 secs 2023-05-08T08:25:49.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16887.949405 secs 2023-05-08T08:25:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16887.949405 secs 2023-05-08T08:25:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:50 smithi186 ceph-mon[126480]: pgmap v9064: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 373 KiB/s wr, 7 op/s 2023-05-08T08:25:50.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:50 smithi133 ceph-mon[125939]: pgmap v9064: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 373 KiB/s wr, 7 op/s 2023-05-08T08:25:50.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:50 smithi096 ceph-mon[124666]: pgmap v9064: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 373 KiB/s wr, 7 op/s 2023-05-08T08:25:51.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16889.789495 secs 2023-05-08T08:25:51.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:25:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16889.789495 secs 2023-05-08T08:25:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:25:51.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16889.789495 secs 2023-05-08T08:25:51.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:25:52.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:52 smithi186 ceph-mon[126480]: pgmap v9065: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 523 KiB/s wr, 12 op/s 2023-05-08T08:25:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:25:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:25:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:25:52.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:52 smithi133 ceph-mon[125939]: pgmap v9065: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 523 KiB/s wr, 12 op/s 2023-05-08T08:25:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:25:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:25:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:25:52.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:52 smithi096 ceph-mon[124666]: pgmap v9065: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 523 KiB/s wr, 12 op/s 2023-05-08T08:25:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:25:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:25:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:25:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:54 smithi186 ceph-mon[126480]: pgmap v9066: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 532 KiB/s rd, 522 KiB/s wr, 9 op/s 2023-05-08T08:25:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16892.949486 secs 2023-05-08T08:25:54.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:54 smithi133 ceph-mon[125939]: pgmap v9066: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 532 KiB/s rd, 522 KiB/s wr, 9 op/s 2023-05-08T08:25:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16892.949486 secs 2023-05-08T08:25:54.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:54 smithi096 ceph-mon[124666]: pgmap v9066: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 532 KiB/s rd, 522 KiB/s wr, 9 op/s 2023-05-08T08:25:54.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16892.949486 secs 2023-05-08T08:25:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16894.789620 secs 2023-05-08T08:25:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:56 smithi186 ceph-mon[126480]: pgmap v9067: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 765 KiB/s rd, 817 KiB/s wr, 14 op/s 2023-05-08T08:25:56.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16894.789620 secs 2023-05-08T08:25:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:56 smithi133 ceph-mon[125939]: pgmap v9067: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 765 KiB/s rd, 817 KiB/s wr, 14 op/s 2023-05-08T08:25:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16894.789620 secs 2023-05-08T08:25:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:56 smithi096 ceph-mon[124666]: pgmap v9067: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 765 KiB/s rd, 817 KiB/s wr, 14 op/s 2023-05-08T08:25:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:58 smithi186 ceph-mon[126480]: pgmap v9068: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 633 KiB/s rd, 462 KiB/s wr, 11 op/s 2023-05-08T08:25:58.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:58 smithi133 ceph-mon[125939]: pgmap v9068: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 633 KiB/s rd, 462 KiB/s wr, 11 op/s 2023-05-08T08:25:58.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:58 smithi096 ceph-mon[124666]: pgmap v9068: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 633 KiB/s rd, 462 KiB/s wr, 11 op/s 2023-05-08T08:25:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16897.949593 secs 2023-05-08T08:25:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:25:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16898.505540 secs 2023-05-08T08:25:59.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16897.949593 secs 2023-05-08T08:25:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:25:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16898.505540 secs 2023-05-08T08:25:59.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16897.949593 secs 2023-05-08T08:25:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:25:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16898.505540 secs 2023-05-08T08:26:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:00 smithi186 ceph-mon[126480]: pgmap v9069: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 624 KiB/s rd, 454 KiB/s wr, 11 op/s 2023-05-08T08:26:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:00 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:26:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:26:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:26:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:00 smithi133 ceph-mon[125939]: pgmap v9069: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 624 KiB/s rd, 454 KiB/s wr, 11 op/s 2023-05-08T08:26:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:00 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:26:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:26:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:26:00.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:00 smithi096 ceph-mon[124666]: pgmap v9069: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 624 KiB/s rd, 454 KiB/s wr, 11 op/s 2023-05-08T08:26:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:00 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:26:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:26:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:26:01.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16899.789710 secs 2023-05-08T08:26:01.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16899.789710 secs 2023-05-08T08:26:01.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16899.789710 secs 2023-05-08T08:26:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:02 smithi186 ceph-mon[126480]: pgmap v9070: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 743 KiB/s rd, 509 KiB/s wr, 15 op/s 2023-05-08T08:26:02.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:02 smithi133 ceph-mon[125939]: pgmap v9070: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 743 KiB/s rd, 509 KiB/s wr, 15 op/s 2023-05-08T08:26:02.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:02 smithi096 ceph-mon[124666]: pgmap v9070: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 743 KiB/s rd, 509 KiB/s wr, 15 op/s 2023-05-08T08:26:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:04 smithi186 ceph-mon[126480]: pgmap v9071: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 359 KiB/s wr, 10 op/s 2023-05-08T08:26:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16902.949710 secs 2023-05-08T08:26:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16903.505612 secs 2023-05-08T08:26:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:04 smithi133 ceph-mon[125939]: pgmap v9071: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 359 KiB/s wr, 10 op/s 2023-05-08T08:26:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16902.949710 secs 2023-05-08T08:26:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16903.505612 secs 2023-05-08T08:26:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:04 smithi096 ceph-mon[124666]: pgmap v9071: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 359 KiB/s wr, 10 op/s 2023-05-08T08:26:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16902.949710 secs 2023-05-08T08:26:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16903.505612 secs 2023-05-08T08:26:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16904.789813 secs 2023-05-08T08:26:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:06 smithi186 ceph-mon[126480]: pgmap v9072: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 462 KiB/s wr, 27 op/s 2023-05-08T08:26:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:06 smithi186 ceph-mon[126480]: osdmap e644: 12 total, 12 up, 12 in 2023-05-08T08:26:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16904.789813 secs 2023-05-08T08:26:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:06 smithi133 ceph-mon[125939]: pgmap v9072: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 462 KiB/s wr, 27 op/s 2023-05-08T08:26:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:06 smithi133 ceph-mon[125939]: osdmap e644: 12 total, 12 up, 12 in 2023-05-08T08:26:06.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16904.789813 secs 2023-05-08T08:26:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:06 smithi096 ceph-mon[124666]: pgmap v9072: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 462 KiB/s wr, 27 op/s 2023-05-08T08:26:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:06 smithi096 ceph-mon[124666]: osdmap e644: 12 total, 12 up, 12 in 2023-05-08T08:26:08.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:08 smithi186 ceph-mon[126480]: pgmap v9074: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 190 KiB/s wr, 26 op/s 2023-05-08T08:26:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:08 smithi133 ceph-mon[125939]: pgmap v9074: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 190 KiB/s wr, 26 op/s 2023-05-08T08:26:08.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:08 smithi096 ceph-mon[124666]: pgmap v9074: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 190 KiB/s wr, 26 op/s 2023-05-08T08:26:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16907.949825 secs 2023-05-08T08:26:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16908.505675 secs 2023-05-08T08:26:09.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16907.949825 secs 2023-05-08T08:26:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16908.505675 secs 2023-05-08T08:26:09.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16907.949825 secs 2023-05-08T08:26:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16908.505675 secs 2023-05-08T08:26:10.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:10 smithi186 ceph-mon[126480]: pgmap v9075: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 190 KiB/s wr, 26 op/s 2023-05-08T08:26:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16909.789939 secs 2023-05-08T08:26:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:10 smithi133 ceph-mon[125939]: pgmap v9075: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 190 KiB/s wr, 26 op/s 2023-05-08T08:26:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16909.789939 secs 2023-05-08T08:26:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:10 smithi096 ceph-mon[124666]: pgmap v9075: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 190 KiB/s wr, 26 op/s 2023-05-08T08:26:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16909.789939 secs 2023-05-08T08:26:12.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:12 smithi186 ceph-mon[126480]: pgmap v9076: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 124 KiB/s wr, 24 op/s 2023-05-08T08:26:12.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:12 smithi186 ceph-mon[126480]: osdmap e645: 12 total, 12 up, 12 in 2023-05-08T08:26:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:12 smithi133 ceph-mon[125939]: pgmap v9076: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 124 KiB/s wr, 24 op/s 2023-05-08T08:26:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:12 smithi133 ceph-mon[125939]: osdmap e645: 12 total, 12 up, 12 in 2023-05-08T08:26:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:12 smithi096 ceph-mon[124666]: pgmap v9076: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 124 KiB/s wr, 24 op/s 2023-05-08T08:26:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:12 smithi096 ceph-mon[124666]: osdmap e645: 12 total, 12 up, 12 in 2023-05-08T08:26:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:14 smithi186 ceph-mon[126480]: pgmap v9078: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 767 B/s wr, 5 op/s 2023-05-08T08:26:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16912.949942 secs 2023-05-08T08:26:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16913.505784 secs 2023-05-08T08:26:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:14 smithi133 ceph-mon[125939]: pgmap v9078: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 767 B/s wr, 5 op/s 2023-05-08T08:26:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16912.949942 secs 2023-05-08T08:26:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16913.505784 secs 2023-05-08T08:26:14.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:14 smithi096 ceph-mon[124666]: pgmap v9078: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 767 B/s wr, 5 op/s 2023-05-08T08:26:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16912.949942 secs 2023-05-08T08:26:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16913.505784 secs 2023-05-08T08:26:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16914.790058 secs 2023-05-08T08:26:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:15 smithi186 ceph-mon[126480]: pgmap v9079: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 837 B/s wr, 7 op/s 2023-05-08T08:26:15.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16914.790058 secs 2023-05-08T08:26:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:15 smithi133 ceph-mon[125939]: pgmap v9079: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 837 B/s wr, 7 op/s 2023-05-08T08:26:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16914.790058 secs 2023-05-08T08:26:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:15 smithi096 ceph-mon[124666]: pgmap v9079: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 837 B/s wr, 7 op/s 2023-05-08T08:26:18.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:18 smithi133 ceph-mon[125939]: pgmap v9080: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 818 B/s wr, 7 op/s 2023-05-08T08:26:18.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:18 smithi096 ceph-mon[124666]: pgmap v9080: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 818 B/s wr, 7 op/s 2023-05-08T08:26:18.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:18 smithi186 ceph-mon[126480]: pgmap v9080: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 818 B/s wr, 7 op/s 2023-05-08T08:26:19.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16917.950044 secs 2023-05-08T08:26:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16918.505847 secs 2023-05-08T08:26:19.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16917.950044 secs 2023-05-08T08:26:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16918.505847 secs 2023-05-08T08:26:19.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16917.950044 secs 2023-05-08T08:26:19.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16918.505847 secs 2023-05-08T08:26:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:20 smithi133 ceph-mon[125939]: pgmap v9081: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 818 B/s wr, 7 op/s 2023-05-08T08:26:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:20 smithi096 ceph-mon[124666]: pgmap v9081: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 818 B/s wr, 7 op/s 2023-05-08T08:26:20.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:20 smithi186 ceph-mon[126480]: pgmap v9081: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 818 B/s wr, 7 op/s 2023-05-08T08:26:21.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16919.790203 secs 2023-05-08T08:26:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16919.790203 secs 2023-05-08T08:26:21.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16919.790203 secs 2023-05-08T08:26:22.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:22 smithi133 ceph-mon[125939]: pgmap v9082: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T08:26:22.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:22 smithi096 ceph-mon[124666]: pgmap v9082: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T08:26:22.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:22 smithi186 ceph-mon[126480]: pgmap v9082: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T08:26:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:24 smithi133 ceph-mon[125939]: pgmap v9083: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 187 B/s wr, 5 op/s 2023-05-08T08:26:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16922.950165 secs 2023-05-08T08:26:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16923.505957 secs 2023-05-08T08:26:24.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:24 smithi096 ceph-mon[124666]: pgmap v9083: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 187 B/s wr, 5 op/s 2023-05-08T08:26:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16922.950165 secs 2023-05-08T08:26:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16923.505957 secs 2023-05-08T08:26:24.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:24 smithi186 ceph-mon[126480]: pgmap v9083: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 187 B/s wr, 5 op/s 2023-05-08T08:26:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16922.950165 secs 2023-05-08T08:26:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16923.505957 secs 2023-05-08T08:26:26.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16924.790328 secs 2023-05-08T08:26:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:26 smithi133 ceph-mon[125939]: pgmap v9084: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 597 B/s wr, 7 op/s 2023-05-08T08:26:26.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16924.790328 secs 2023-05-08T08:26:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:26 smithi096 ceph-mon[124666]: pgmap v9084: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 597 B/s wr, 7 op/s 2023-05-08T08:26:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16924.790328 secs 2023-05-08T08:26:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:26 smithi186 ceph-mon[126480]: pgmap v9084: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 597 B/s wr, 7 op/s 2023-05-08T08:26:28.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:28 smithi133 ceph-mon[125939]: pgmap v9085: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T08:26:28.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:28 smithi096 ceph-mon[124666]: pgmap v9085: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T08:26:28.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:28 smithi186 ceph-mon[126480]: pgmap v9085: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T08:26:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16927.950231 secs 2023-05-08T08:26:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16928.506077 secs 2023-05-08T08:26:29.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16927.950231 secs 2023-05-08T08:26:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16928.506077 secs 2023-05-08T08:26:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16927.950231 secs 2023-05-08T08:26:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16928.506077 secs 2023-05-08T08:26:30.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:30 smithi133 ceph-mon[125939]: pgmap v9086: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T08:26:30.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:30 smithi096 ceph-mon[124666]: pgmap v9086: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T08:26:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:30 smithi186 ceph-mon[126480]: pgmap v9086: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T08:26:31.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16929.790449 secs 2023-05-08T08:26:31.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16929.790449 secs 2023-05-08T08:26:31.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16929.790449 secs 2023-05-08T08:26:32.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:32 smithi133 ceph-mon[125939]: pgmap v9087: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 106 KiB/s wr, 9 op/s 2023-05-08T08:26:32.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:32 smithi096 ceph-mon[124666]: pgmap v9087: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 106 KiB/s wr, 9 op/s 2023-05-08T08:26:32.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:32 smithi186 ceph-mon[126480]: pgmap v9087: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 106 KiB/s wr, 9 op/s 2023-05-08T08:26:34.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:34 smithi133 ceph-mon[125939]: pgmap v9088: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 106 KiB/s wr, 6 op/s 2023-05-08T08:26:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16932.950372 secs 2023-05-08T08:26:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16933.506189 secs 2023-05-08T08:26:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:34 smithi096 ceph-mon[124666]: pgmap v9088: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 106 KiB/s wr, 6 op/s 2023-05-08T08:26:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16932.950372 secs 2023-05-08T08:26:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16933.506189 secs 2023-05-08T08:26:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:34 smithi186 ceph-mon[126480]: pgmap v9088: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 106 KiB/s wr, 6 op/s 2023-05-08T08:26:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16932.950372 secs 2023-05-08T08:26:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16933.506189 secs 2023-05-08T08:26:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16934.790577 secs 2023-05-08T08:26:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:36 smithi133 ceph-mon[125939]: pgmap v9089: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 107 KiB/s wr, 9 op/s 2023-05-08T08:26:36.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16934.790577 secs 2023-05-08T08:26:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:36 smithi096 ceph-mon[124666]: pgmap v9089: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 107 KiB/s wr, 9 op/s 2023-05-08T08:26:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16934.790577 secs 2023-05-08T08:26:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:36 smithi186 ceph-mon[126480]: pgmap v9089: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 107 KiB/s wr, 9 op/s 2023-05-08T08:26:38.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:38 smithi133 ceph-mon[125939]: pgmap v9090: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 106 KiB/s wr, 7 op/s 2023-05-08T08:26:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:26:38.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:38 smithi096 ceph-mon[124666]: pgmap v9090: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 106 KiB/s wr, 7 op/s 2023-05-08T08:26:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:26:38.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:38 smithi186 ceph-mon[126480]: pgmap v9090: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 106 KiB/s wr, 7 op/s 2023-05-08T08:26:38.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:26:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16937.950439 secs 2023-05-08T08:26:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:26:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:26:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:26:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16938.506300 secs 2023-05-08T08:26:39.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16937.950439 secs 2023-05-08T08:26:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:26:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:26:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:26:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16938.506300 secs 2023-05-08T08:26:39.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16937.950439 secs 2023-05-08T08:26:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:26:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:26:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:26:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16938.506300 secs 2023-05-08T08:26:40.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:40 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:26:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:40 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T08:26:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:40 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T08:26:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:40 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:26:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:40 smithi133 ceph-mon[125939]: pgmap v9091: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 106 KiB/s wr, 6 op/s 2023-05-08T08:26:40.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:40 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:26:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:40 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T08:26:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:40 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T08:26:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:40 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:26:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:40 smithi096 ceph-mon[124666]: pgmap v9091: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 106 KiB/s wr, 6 op/s 2023-05-08T08:26:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:40 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:26:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:40 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T08:26:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:40 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T08:26:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:40 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:26:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:40 smithi186 ceph-mon[126480]: pgmap v9091: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 106 KiB/s wr, 6 op/s 2023-05-08T08:26:42.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:42 smithi133 ceph-mon[125939]: pgmap v9092: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 125 KiB/s wr, 10 op/s 2023-05-08T08:26:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:42 smithi096 ceph-mon[124666]: pgmap v9092: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 125 KiB/s wr, 10 op/s 2023-05-08T08:26:42.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:42 smithi186 ceph-mon[126480]: pgmap v9092: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 125 KiB/s wr, 10 op/s 2023-05-08T08:26:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:26:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:26:43.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:26:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:44 smithi133 ceph-mon[125939]: pgmap v9093: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 19 KiB/s wr, 6 op/s 2023-05-08T08:26:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16942.950532 secs 2023-05-08T08:26:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:26:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:26:44.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:26:44.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16943.506450 secs 2023-05-08T08:26:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:44 smithi096 ceph-mon[124666]: pgmap v9093: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 19 KiB/s wr, 6 op/s 2023-05-08T08:26:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16942.950532 secs 2023-05-08T08:26:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:26:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:26:44.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:26:44.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16943.506450 secs 2023-05-08T08:26:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:44 smithi186 ceph-mon[126480]: pgmap v9093: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 19 KiB/s wr, 6 op/s 2023-05-08T08:26:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16942.950532 secs 2023-05-08T08:26:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:26:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:26:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:26:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16943.506450 secs 2023-05-08T08:26:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:46 smithi133 ceph-mon[125939]: pgmap v9094: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 141 KiB/s wr, 9 op/s 2023-05-08T08:26:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:46 smithi096 ceph-mon[124666]: pgmap v9094: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 141 KiB/s wr, 9 op/s 2023-05-08T08:26:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:46 smithi186 ceph-mon[126480]: pgmap v9094: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 141 KiB/s wr, 9 op/s 2023-05-08T08:26:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:48 smithi133 ceph-mon[125939]: pgmap v9095: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 149 KiB/s wr, 7 op/s 2023-05-08T08:26:48.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:48 smithi096 ceph-mon[124666]: pgmap v9095: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 149 KiB/s wr, 7 op/s 2023-05-08T08:26:48.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:48 smithi186 ceph-mon[126480]: pgmap v9095: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 149 KiB/s wr, 7 op/s 2023-05-08T08:26:49.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16947.950659 secs 2023-05-08T08:26:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16947.950659 secs 2023-05-08T08:26:49.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16947.950659 secs 2023-05-08T08:26:50.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:50 smithi096 ceph-mon[124666]: pgmap v9096: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 149 KiB/s wr, 7 op/s 2023-05-08T08:26:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:50 smithi186 ceph-mon[126480]: pgmap v9096: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 149 KiB/s wr, 7 op/s 2023-05-08T08:26:50.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:50 smithi133 ceph-mon[125939]: pgmap v9096: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 149 KiB/s wr, 7 op/s 2023-05-08T08:26:51.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:26:51.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:26:51.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:26:52.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:52 smithi096 ceph-mon[124666]: pgmap v9097: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 314 KiB/s wr, 11 op/s 2023-05-08T08:26:52.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:52 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:26:52.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:26:52.509 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:26:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:52 smithi186 ceph-mon[126480]: pgmap v9097: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 314 KiB/s wr, 11 op/s 2023-05-08T08:26:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:52 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:26:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:26:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:26:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:52 smithi133 ceph-mon[125939]: pgmap v9097: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 314 KiB/s wr, 11 op/s 2023-05-08T08:26:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:52 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:26:52.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:26:52.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:26:54.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:54 smithi096 ceph-mon[124666]: pgmap v9098: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 296 KiB/s wr, 7 op/s 2023-05-08T08:26:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16952.950757 secs 2023-05-08T08:26:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16953.506701 secs 2023-05-08T08:26:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:54 smithi186 ceph-mon[126480]: pgmap v9098: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 296 KiB/s wr, 7 op/s 2023-05-08T08:26:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16952.950757 secs 2023-05-08T08:26:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16953.506701 secs 2023-05-08T08:26:54.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:54 smithi133 ceph-mon[125939]: pgmap v9098: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 296 KiB/s wr, 7 op/s 2023-05-08T08:26:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16952.950757 secs 2023-05-08T08:26:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16953.506701 secs 2023-05-08T08:26:56.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16954.791064 secs 2023-05-08T08:26:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:56 smithi186 ceph-mon[126480]: pgmap v9099: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 619 KiB/s rd, 570 KiB/s wr, 13 op/s 2023-05-08T08:26:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:26:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:26:56.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16954.791064 secs 2023-05-08T08:26:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:56 smithi133 ceph-mon[125939]: pgmap v9099: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 619 KiB/s rd, 570 KiB/s wr, 13 op/s 2023-05-08T08:26:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:26:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:26:56.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16954.791064 secs 2023-05-08T08:26:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:56 smithi096 ceph-mon[124666]: pgmap v9099: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 619 KiB/s rd, 570 KiB/s wr, 13 op/s 2023-05-08T08:26:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:26:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:26:57.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:57 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:26:57.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:57 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:26:57.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:57 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:26:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:58 smithi186 ceph-mon[126480]: pgmap v9100: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 469 KiB/s rd, 457 KiB/s wr, 11 op/s 2023-05-08T08:26:58.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:58 smithi133 ceph-mon[125939]: pgmap v9100: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 469 KiB/s rd, 457 KiB/s wr, 11 op/s 2023-05-08T08:26:58.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:58 smithi096 ceph-mon[124666]: pgmap v9100: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 469 KiB/s rd, 457 KiB/s wr, 11 op/s 2023-05-08T08:26:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16957.950883 secs 2023-05-08T08:26:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:26:59 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:26:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16957.950883 secs 2023-05-08T08:26:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:26:59 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:26:59.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16957.950883 secs 2023-05-08T08:26:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:26:59 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:27:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:00 smithi186 ceph-mon[126480]: pgmap v9101: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 460 KiB/s rd, 448 KiB/s wr, 10 op/s 2023-05-08T08:27:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:27:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:27:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:27:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:00 smithi133 ceph-mon[125939]: pgmap v9101: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 460 KiB/s rd, 448 KiB/s wr, 10 op/s 2023-05-08T08:27:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:27:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:27:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:27:00.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:00 smithi096 ceph-mon[124666]: pgmap v9101: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 460 KiB/s rd, 448 KiB/s wr, 10 op/s 2023-05-08T08:27:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:27:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:27:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:27:01.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16959.791186 secs 2023-05-08T08:27:01.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16959.791186 secs 2023-05-08T08:27:01.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16959.791186 secs 2023-05-08T08:27:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:02 smithi186 ceph-mon[126480]: pgmap v9102: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 540 KiB/s rd, 527 KiB/s wr, 15 op/s 2023-05-08T08:27:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:02 smithi133 ceph-mon[125939]: pgmap v9102: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 540 KiB/s rd, 527 KiB/s wr, 15 op/s 2023-05-08T08:27:02.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:02 smithi096 ceph-mon[124666]: pgmap v9102: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 540 KiB/s rd, 527 KiB/s wr, 15 op/s 2023-05-08T08:27:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:04 smithi186 ceph-mon[126480]: pgmap v9103: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 362 KiB/s wr, 11 op/s 2023-05-08T08:27:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16962.951041 secs 2023-05-08T08:27:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16963.506948 secs 2023-05-08T08:27:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:04 smithi133 ceph-mon[125939]: pgmap v9103: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 362 KiB/s wr, 11 op/s 2023-05-08T08:27:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16962.951041 secs 2023-05-08T08:27:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16963.506948 secs 2023-05-08T08:27:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:04 smithi096 ceph-mon[124666]: pgmap v9103: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 362 KiB/s wr, 11 op/s 2023-05-08T08:27:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16962.951041 secs 2023-05-08T08:27:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16963.506948 secs 2023-05-08T08:27:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16964.791309 secs 2023-05-08T08:27:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:06 smithi186 ceph-mon[126480]: pgmap v9104: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 601 KiB/s wr, 31 op/s 2023-05-08T08:27:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:06 smithi186 ceph-mon[126480]: osdmap e646: 12 total, 12 up, 12 in 2023-05-08T08:27:06.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16964.791309 secs 2023-05-08T08:27:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:06 smithi133 ceph-mon[125939]: pgmap v9104: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 601 KiB/s wr, 31 op/s 2023-05-08T08:27:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:06 smithi133 ceph-mon[125939]: osdmap e646: 12 total, 12 up, 12 in 2023-05-08T08:27:06.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16964.791309 secs 2023-05-08T08:27:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:06 smithi096 ceph-mon[124666]: pgmap v9104: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 601 KiB/s wr, 31 op/s 2023-05-08T08:27:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:06 smithi096 ceph-mon[124666]: osdmap e646: 12 total, 12 up, 12 in 2023-05-08T08:27:08.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:08 smithi133 ceph-mon[125939]: pgmap v9106: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 382 KiB/s wr, 29 op/s 2023-05-08T08:27:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:08 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:27:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:27:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:27:08.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:08 smithi096 ceph-mon[124666]: pgmap v9106: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 382 KiB/s wr, 29 op/s 2023-05-08T08:27:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:08 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:27:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:27:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:27:08.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:08 smithi186 ceph-mon[126480]: pgmap v9106: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 382 KiB/s wr, 29 op/s 2023-05-08T08:27:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:08 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:27:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:27:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:27:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16967.951166 secs 2023-05-08T08:27:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16968.507063 secs 2023-05-08T08:27:09.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16967.951166 secs 2023-05-08T08:27:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16968.507063 secs 2023-05-08T08:27:09.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16967.951166 secs 2023-05-08T08:27:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16968.507063 secs 2023-05-08T08:27:10.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:10 smithi133 ceph-mon[125939]: pgmap v9107: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 382 KiB/s wr, 29 op/s 2023-05-08T08:27:10.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:10 smithi096 ceph-mon[124666]: pgmap v9107: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 382 KiB/s wr, 29 op/s 2023-05-08T08:27:10.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:10 smithi186 ceph-mon[126480]: pgmap v9107: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 382 KiB/s wr, 29 op/s 2023-05-08T08:27:11.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16969.791408 secs 2023-05-08T08:27:11.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16969.791408 secs 2023-05-08T08:27:11.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16969.791408 secs 2023-05-08T08:27:12.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:12 smithi133 ceph-mon[125939]: pgmap v9108: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 354 KiB/s wr, 28 op/s 2023-05-08T08:27:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:12 smithi133 ceph-mon[125939]: osdmap e647: 12 total, 12 up, 12 in 2023-05-08T08:27:12.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:12 smithi096 ceph-mon[124666]: pgmap v9108: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 354 KiB/s wr, 28 op/s 2023-05-08T08:27:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:12 smithi096 ceph-mon[124666]: osdmap e647: 12 total, 12 up, 12 in 2023-05-08T08:27:12.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:12 smithi186 ceph-mon[126480]: pgmap v9108: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 354 KiB/s wr, 28 op/s 2023-05-08T08:27:12.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:12 smithi186 ceph-mon[126480]: osdmap e647: 12 total, 12 up, 12 in 2023-05-08T08:27:14.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:14 smithi133 ceph-mon[125939]: pgmap v9110: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 84 KiB/s wr, 6 op/s 2023-05-08T08:27:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16972.951277 secs 2023-05-08T08:27:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16973.507179 secs 2023-05-08T08:27:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:14 smithi096 ceph-mon[124666]: pgmap v9110: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 84 KiB/s wr, 6 op/s 2023-05-08T08:27:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16972.951277 secs 2023-05-08T08:27:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16973.507179 secs 2023-05-08T08:27:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:14 smithi186 ceph-mon[126480]: pgmap v9110: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 84 KiB/s wr, 6 op/s 2023-05-08T08:27:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16972.951277 secs 2023-05-08T08:27:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16973.507179 secs 2023-05-08T08:27:16.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16974.791508 secs 2023-05-08T08:27:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:16 smithi133 ceph-mon[125939]: pgmap v9111: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 117 KiB/s wr, 8 op/s 2023-05-08T08:27:16.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16974.791508 secs 2023-05-08T08:27:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:16 smithi096 ceph-mon[124666]: pgmap v9111: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 117 KiB/s wr, 8 op/s 2023-05-08T08:27:16.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16974.791508 secs 2023-05-08T08:27:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:16 smithi186 ceph-mon[126480]: pgmap v9111: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 117 KiB/s wr, 8 op/s 2023-05-08T08:27:18.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:18 smithi133 ceph-mon[125939]: pgmap v9112: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 115 KiB/s wr, 7 op/s 2023-05-08T08:27:18.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:18 smithi096 ceph-mon[124666]: pgmap v9112: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 115 KiB/s wr, 7 op/s 2023-05-08T08:27:18.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:18 smithi186 ceph-mon[126480]: pgmap v9112: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 115 KiB/s wr, 7 op/s 2023-05-08T08:27:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16977.951368 secs 2023-05-08T08:27:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16978.507313 secs 2023-05-08T08:27:19.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16977.951368 secs 2023-05-08T08:27:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16978.507313 secs 2023-05-08T08:27:19.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16977.951368 secs 2023-05-08T08:27:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16978.507313 secs 2023-05-08T08:27:20.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:20 smithi133 ceph-mon[125939]: pgmap v9113: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 115 KiB/s wr, 8 op/s 2023-05-08T08:27:20.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:20 smithi096 ceph-mon[124666]: pgmap v9113: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 115 KiB/s wr, 8 op/s 2023-05-08T08:27:20.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:20 smithi186 ceph-mon[126480]: pgmap v9113: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 115 KiB/s wr, 8 op/s 2023-05-08T08:27:21.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16979.791636 secs 2023-05-08T08:27:21.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16979.791636 secs 2023-05-08T08:27:21.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16979.791636 secs 2023-05-08T08:27:22.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:22 smithi133 ceph-mon[125939]: pgmap v9114: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 48 KiB/s wr, 6 op/s 2023-05-08T08:27:22.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:22 smithi096 ceph-mon[124666]: pgmap v9114: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 48 KiB/s wr, 6 op/s 2023-05-08T08:27:22.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:22 smithi186 ceph-mon[126480]: pgmap v9114: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 48 KiB/s wr, 6 op/s 2023-05-08T08:27:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:24 smithi133 ceph-mon[125939]: pgmap v9115: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 44 KiB/s wr, 5 op/s 2023-05-08T08:27:24.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16982.951417 secs 2023-05-08T08:27:24.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16983.507460 secs 2023-05-08T08:27:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:24 smithi096 ceph-mon[124666]: pgmap v9115: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 44 KiB/s wr, 5 op/s 2023-05-08T08:27:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16982.951417 secs 2023-05-08T08:27:24.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16983.507460 secs 2023-05-08T08:27:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:24 smithi186 ceph-mon[126480]: pgmap v9115: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 44 KiB/s wr, 5 op/s 2023-05-08T08:27:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16982.951417 secs 2023-05-08T08:27:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16983.507460 secs 2023-05-08T08:27:26.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16984.791756 secs 2023-05-08T08:27:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:26 smithi133 ceph-mon[125939]: pgmap v9116: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 40 KiB/s wr, 7 op/s 2023-05-08T08:27:26.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16984.791756 secs 2023-05-08T08:27:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:26 smithi096 ceph-mon[124666]: pgmap v9116: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 40 KiB/s wr, 7 op/s 2023-05-08T08:27:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16984.791756 secs 2023-05-08T08:27:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:26 smithi186 ceph-mon[126480]: pgmap v9116: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 40 KiB/s wr, 7 op/s 2023-05-08T08:27:28.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:28 smithi133 ceph-mon[125939]: pgmap v9117: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2023-05-08T08:27:28.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:28 smithi096 ceph-mon[124666]: pgmap v9117: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2023-05-08T08:27:28.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:28 smithi186 ceph-mon[126480]: pgmap v9117: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2023-05-08T08:27:29.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16987.951536 secs 2023-05-08T08:27:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16988.507572 secs 2023-05-08T08:27:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16987.951536 secs 2023-05-08T08:27:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16988.507572 secs 2023-05-08T08:27:29.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16987.951536 secs 2023-05-08T08:27:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16988.507572 secs 2023-05-08T08:27:30.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:30 smithi096 ceph-mon[124666]: pgmap v9118: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 341 B/s wr, 6 op/s 2023-05-08T08:27:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:30 smithi186 ceph-mon[126480]: pgmap v9118: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 341 B/s wr, 6 op/s 2023-05-08T08:27:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:30 smithi133 ceph-mon[125939]: pgmap v9118: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 341 B/s wr, 6 op/s 2023-05-08T08:27:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16989.791881 secs 2023-05-08T08:27:31.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16989.791881 secs 2023-05-08T08:27:31.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16989.791881 secs 2023-05-08T08:27:32.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:32 smithi096 ceph-mon[124666]: pgmap v9119: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 426 B/s wr, 6 op/s 2023-05-08T08:27:32.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:32 smithi186 ceph-mon[126480]: pgmap v9119: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 426 B/s wr, 6 op/s 2023-05-08T08:27:32.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:32 smithi133 ceph-mon[125939]: pgmap v9119: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 426 B/s wr, 6 op/s 2023-05-08T08:27:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:34 smithi096 ceph-mon[124666]: pgmap v9120: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T08:27:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16992.951655 secs 2023-05-08T08:27:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16993.507685 secs 2023-05-08T08:27:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:34 smithi186 ceph-mon[126480]: pgmap v9120: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T08:27:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16992.951655 secs 2023-05-08T08:27:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16993.507685 secs 2023-05-08T08:27:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:34 smithi133 ceph-mon[125939]: pgmap v9120: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T08:27:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16992.951655 secs 2023-05-08T08:27:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16993.507685 secs 2023-05-08T08:27:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16994.792006 secs 2023-05-08T08:27:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:36 smithi186 ceph-mon[126480]: pgmap v9121: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 59 KiB/s wr, 8 op/s 2023-05-08T08:27:36.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16994.792006 secs 2023-05-08T08:27:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:36 smithi133 ceph-mon[125939]: pgmap v9121: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 59 KiB/s wr, 8 op/s 2023-05-08T08:27:36.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16994.792006 secs 2023-05-08T08:27:36.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:36 smithi096 ceph-mon[124666]: pgmap v9121: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 59 KiB/s wr, 8 op/s 2023-05-08T08:27:38.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:38 smithi186 ceph-mon[126480]: pgmap v9122: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 59 KiB/s wr, 6 op/s 2023-05-08T08:27:38.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:38 smithi133 ceph-mon[125939]: pgmap v9122: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 59 KiB/s wr, 6 op/s 2023-05-08T08:27:38.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:38 smithi096 ceph-mon[124666]: pgmap v9122: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 59 KiB/s wr, 6 op/s 2023-05-08T08:27:39.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16997.951780 secs 2023-05-08T08:27:39.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:27:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 16998.507791 secs 2023-05-08T08:27:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:27:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:27:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:27:39.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16997.951780 secs 2023-05-08T08:27:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:27:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 16998.507791 secs 2023-05-08T08:27:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:27:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:27:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:27:39.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16997.951780 secs 2023-05-08T08:27:39.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:27:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 16998.507791 secs 2023-05-08T08:27:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:27:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:27:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:27:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:40 smithi186 ceph-mon[126480]: pgmap v9123: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 59 KiB/s wr, 7 op/s 2023-05-08T08:27:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:40 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:27:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:40 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T08:27:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:40 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T08:27:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:40 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:27:40.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:40 smithi133 ceph-mon[125939]: pgmap v9123: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 59 KiB/s wr, 7 op/s 2023-05-08T08:27:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:40 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:27:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:40 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T08:27:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:40 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T08:27:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:40 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:27:40.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:40 smithi096 ceph-mon[124666]: pgmap v9123: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 59 KiB/s wr, 7 op/s 2023-05-08T08:27:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:40 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:27:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:40 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T08:27:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:40 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T08:27:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:40 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:27:42.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:42 smithi186 ceph-mon[126480]: pgmap v9124: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 59 KiB/s wr, 8 op/s 2023-05-08T08:27:42.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:42 smithi133 ceph-mon[125939]: pgmap v9124: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 59 KiB/s wr, 8 op/s 2023-05-08T08:27:42.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:42 smithi096 ceph-mon[124666]: pgmap v9124: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 59 KiB/s wr, 8 op/s 2023-05-08T08:27:43.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:27:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:27:43.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:27:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:44 smithi186 ceph-mon[126480]: pgmap v9125: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 59 KiB/s wr, 6 op/s 2023-05-08T08:27:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17002.951910 secs 2023-05-08T08:27:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:27:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:27:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:27:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17003.507919 secs 2023-05-08T08:27:44.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:44 smithi133 ceph-mon[125939]: pgmap v9125: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 59 KiB/s wr, 6 op/s 2023-05-08T08:27:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17002.951910 secs 2023-05-08T08:27:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:27:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:27:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:27:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17003.507919 secs 2023-05-08T08:27:44.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:44 smithi096 ceph-mon[124666]: pgmap v9125: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 59 KiB/s wr, 6 op/s 2023-05-08T08:27:44.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17002.951910 secs 2023-05-08T08:27:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:27:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:27:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:27:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17003.507919 secs 2023-05-08T08:27:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:46 smithi186 ceph-mon[126480]: pgmap v9126: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 126 KiB/s wr, 9 op/s 2023-05-08T08:27:46.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:46 smithi133 ceph-mon[125939]: pgmap v9126: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 126 KiB/s wr, 9 op/s 2023-05-08T08:27:46.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:46 smithi096 ceph-mon[124666]: pgmap v9126: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 126 KiB/s wr, 9 op/s 2023-05-08T08:27:48.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:48 smithi186 ceph-mon[126480]: pgmap v9127: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 76 KiB/s wr, 7 op/s 2023-05-08T08:27:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:48 smithi133 ceph-mon[125939]: pgmap v9127: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 76 KiB/s wr, 7 op/s 2023-05-08T08:27:48.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:48 smithi096 ceph-mon[124666]: pgmap v9127: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 76 KiB/s wr, 7 op/s 2023-05-08T08:27:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17007.952015 secs 2023-05-08T08:27:49.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17007.952015 secs 2023-05-08T08:27:49.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17007.952015 secs 2023-05-08T08:27:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:50 smithi186 ceph-mon[126480]: pgmap v9128: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 398 KiB/s rd, 316 KiB/s wr, 9 op/s 2023-05-08T08:27:50.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:50 smithi133 ceph-mon[125939]: pgmap v9128: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 398 KiB/s rd, 316 KiB/s wr, 9 op/s 2023-05-08T08:27:50.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:50 smithi096 ceph-mon[124666]: pgmap v9128: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 398 KiB/s rd, 316 KiB/s wr, 9 op/s 2023-05-08T08:27:51.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:27:51.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:27:51.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:27:52.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:52 smithi186 ceph-mon[126480]: pgmap v9129: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 340 KiB/s rd, 316 KiB/s wr, 9 op/s 2023-05-08T08:27:52.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:52 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:27:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:27:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:27:52.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:52 smithi133 ceph-mon[125939]: pgmap v9129: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 340 KiB/s rd, 316 KiB/s wr, 9 op/s 2023-05-08T08:27:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:52 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:27:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:27:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:27:52.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:52 smithi096 ceph-mon[124666]: pgmap v9129: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 340 KiB/s rd, 316 KiB/s wr, 9 op/s 2023-05-08T08:27:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:52 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:27:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:27:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:27:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:54 smithi186 ceph-mon[126480]: pgmap v9130: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 316 KiB/s wr, 7 op/s 2023-05-08T08:27:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17012.952119 secs 2023-05-08T08:27:54.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17013.508097 secs 2023-05-08T08:27:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:54 smithi133 ceph-mon[125939]: pgmap v9130: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 316 KiB/s wr, 7 op/s 2023-05-08T08:27:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17012.952119 secs 2023-05-08T08:27:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17013.508097 secs 2023-05-08T08:27:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:54 smithi096 ceph-mon[124666]: pgmap v9130: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 316 KiB/s wr, 7 op/s 2023-05-08T08:27:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17012.952119 secs 2023-05-08T08:27:54.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17013.508097 secs 2023-05-08T08:27:56.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17014.792431 secs 2023-05-08T08:27:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:56 smithi186 ceph-mon[126480]: pgmap v9131: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 628 KiB/s rd, 591 KiB/s wr, 14 op/s 2023-05-08T08:27:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:27:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:27:56.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17014.792431 secs 2023-05-08T08:27:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:56 smithi133 ceph-mon[125939]: pgmap v9131: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 628 KiB/s rd, 591 KiB/s wr, 14 op/s 2023-05-08T08:27:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:27:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:27:56.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17014.792431 secs 2023-05-08T08:27:56.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:56 smithi096 ceph-mon[124666]: pgmap v9131: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 628 KiB/s rd, 591 KiB/s wr, 14 op/s 2023-05-08T08:27:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:27:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:27:57.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:57 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:27:57.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:57 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:27:57.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:57 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:27:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:58 smithi186 ceph-mon[126480]: pgmap v9132: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 546 KiB/s rd, 532 KiB/s wr, 11 op/s 2023-05-08T08:27:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:58 smithi133 ceph-mon[125939]: pgmap v9132: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 546 KiB/s rd, 532 KiB/s wr, 11 op/s 2023-05-08T08:27:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:58 smithi096 ceph-mon[124666]: pgmap v9132: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 546 KiB/s rd, 532 KiB/s wr, 11 op/s 2023-05-08T08:27:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17017.952261 secs 2023-05-08T08:27:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:27:59 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:27:59.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17017.952261 secs 2023-05-08T08:27:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:27:59 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:27:59.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17017.952261 secs 2023-05-08T08:27:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:27:59 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:28:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:00 smithi186 ceph-mon[126480]: pgmap v9133: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 609 KiB/s rd, 603 KiB/s wr, 14 op/s 2023-05-08T08:28:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:28:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:28:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:28:00.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:00 smithi133 ceph-mon[125939]: pgmap v9133: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 609 KiB/s rd, 603 KiB/s wr, 14 op/s 2023-05-08T08:28:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:28:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:28:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:28:00.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:00 smithi096 ceph-mon[124666]: pgmap v9133: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 609 KiB/s rd, 603 KiB/s wr, 14 op/s 2023-05-08T08:28:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:28:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:28:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:28:01.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17019.792568 secs 2023-05-08T08:28:01.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17019.792568 secs 2023-05-08T08:28:01.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17019.792568 secs 2023-05-08T08:28:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:02 smithi186 ceph-mon[126480]: pgmap v9134: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 364 KiB/s wr, 13 op/s 2023-05-08T08:28:02.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:02 smithi133 ceph-mon[125939]: pgmap v9134: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 364 KiB/s wr, 13 op/s 2023-05-08T08:28:02.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:02 smithi096 ceph-mon[124666]: pgmap v9134: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 364 KiB/s wr, 13 op/s 2023-05-08T08:28:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:04 smithi186 ceph-mon[126480]: pgmap v9135: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 363 KiB/s wr, 11 op/s 2023-05-08T08:28:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17022.952380 secs 2023-05-08T08:28:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17023.508354 secs 2023-05-08T08:28:04.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:04 smithi133 ceph-mon[125939]: pgmap v9135: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 363 KiB/s wr, 11 op/s 2023-05-08T08:28:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17022.952380 secs 2023-05-08T08:28:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17023.508354 secs 2023-05-08T08:28:04.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:04 smithi096 ceph-mon[124666]: pgmap v9135: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 363 KiB/s wr, 11 op/s 2023-05-08T08:28:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17022.952380 secs 2023-05-08T08:28:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17023.508354 secs 2023-05-08T08:28:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17024.792709 secs 2023-05-08T08:28:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:06 smithi186 ceph-mon[126480]: pgmap v9136: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 505 KiB/s rd, 525 KiB/s wr, 30 op/s 2023-05-08T08:28:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:06 smithi186 ceph-mon[126480]: osdmap e648: 12 total, 12 up, 12 in 2023-05-08T08:28:06.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17024.792709 secs 2023-05-08T08:28:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:06 smithi133 ceph-mon[125939]: pgmap v9136: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 505 KiB/s rd, 525 KiB/s wr, 30 op/s 2023-05-08T08:28:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:06 smithi133 ceph-mon[125939]: osdmap e648: 12 total, 12 up, 12 in 2023-05-08T08:28:06.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17024.792709 secs 2023-05-08T08:28:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:06 smithi096 ceph-mon[124666]: pgmap v9136: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 505 KiB/s rd, 525 KiB/s wr, 30 op/s 2023-05-08T08:28:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:06 smithi096 ceph-mon[124666]: osdmap e648: 12 total, 12 up, 12 in 2023-05-08T08:28:08.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:08 smithi133 ceph-mon[125939]: pgmap v9138: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 290 KiB/s wr, 28 op/s 2023-05-08T08:28:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:08 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:28:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:28:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:28:08.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:08 smithi096 ceph-mon[124666]: pgmap v9138: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 290 KiB/s wr, 28 op/s 2023-05-08T08:28:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:08 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:28:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:28:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:28:08.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:08 smithi186 ceph-mon[126480]: pgmap v9138: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 290 KiB/s wr, 28 op/s 2023-05-08T08:28:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:08 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:28:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:28:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:28:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17027.952478 secs 2023-05-08T08:28:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17028.508499 secs 2023-05-08T08:28:09.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17027.952478 secs 2023-05-08T08:28:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17028.508499 secs 2023-05-08T08:28:09.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17027.952478 secs 2023-05-08T08:28:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17028.508499 secs 2023-05-08T08:28:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:10 smithi133 ceph-mon[125939]: pgmap v9139: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 355 KiB/s wr, 28 op/s 2023-05-08T08:28:10.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:10 smithi096 ceph-mon[124666]: pgmap v9139: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 355 KiB/s wr, 28 op/s 2023-05-08T08:28:10.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:10 smithi186 ceph-mon[126480]: pgmap v9139: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 355 KiB/s wr, 28 op/s 2023-05-08T08:28:11.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17029.792805 secs 2023-05-08T08:28:11.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17029.792805 secs 2023-05-08T08:28:11.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17029.792805 secs 2023-05-08T08:28:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:12 smithi133 ceph-mon[125939]: pgmap v9140: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 324 KiB/s rd, 355 KiB/s wr, 27 op/s 2023-05-08T08:28:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:12 smithi133 ceph-mon[125939]: osdmap e649: 12 total, 12 up, 12 in 2023-05-08T08:28:12.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:12 smithi096 ceph-mon[124666]: pgmap v9140: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 324 KiB/s rd, 355 KiB/s wr, 27 op/s 2023-05-08T08:28:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:12 smithi096 ceph-mon[124666]: osdmap e649: 12 total, 12 up, 12 in 2023-05-08T08:28:12.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:12 smithi186 ceph-mon[126480]: pgmap v9140: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 324 KiB/s rd, 355 KiB/s wr, 27 op/s 2023-05-08T08:28:12.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:12 smithi186 ceph-mon[126480]: osdmap e649: 12 total, 12 up, 12 in 2023-05-08T08:28:14.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:14 smithi133 ceph-mon[125939]: pgmap v9142: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 201 KiB/s wr, 6 op/s 2023-05-08T08:28:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17032.952565 secs 2023-05-08T08:28:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17033.508647 secs 2023-05-08T08:28:14.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:14 smithi096 ceph-mon[124666]: pgmap v9142: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 201 KiB/s wr, 6 op/s 2023-05-08T08:28:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17032.952565 secs 2023-05-08T08:28:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17033.508647 secs 2023-05-08T08:28:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:14 smithi186 ceph-mon[126480]: pgmap v9142: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 201 KiB/s wr, 6 op/s 2023-05-08T08:28:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17032.952565 secs 2023-05-08T08:28:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17033.508647 secs 2023-05-08T08:28:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17034.792902 secs 2023-05-08T08:28:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:16 smithi133 ceph-mon[125939]: pgmap v9143: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 214 KiB/s wr, 8 op/s 2023-05-08T08:28:16.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17034.792902 secs 2023-05-08T08:28:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:16 smithi096 ceph-mon[124666]: pgmap v9143: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 214 KiB/s wr, 8 op/s 2023-05-08T08:28:16.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17034.792902 secs 2023-05-08T08:28:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:16 smithi186 ceph-mon[126480]: pgmap v9143: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 214 KiB/s wr, 8 op/s 2023-05-08T08:28:18.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:18 smithi133 ceph-mon[125939]: pgmap v9144: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 209 KiB/s wr, 8 op/s 2023-05-08T08:28:18.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:18 smithi096 ceph-mon[124666]: pgmap v9144: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 209 KiB/s wr, 8 op/s 2023-05-08T08:28:18.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:18 smithi186 ceph-mon[126480]: pgmap v9144: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 209 KiB/s wr, 8 op/s 2023-05-08T08:28:19.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17037.952689 secs 2023-05-08T08:28:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17038.508768 secs 2023-05-08T08:28:19.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17037.952689 secs 2023-05-08T08:28:19.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17038.508768 secs 2023-05-08T08:28:19.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17037.952689 secs 2023-05-08T08:28:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17038.508768 secs 2023-05-08T08:28:20.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:20 smithi096 ceph-mon[124666]: pgmap v9145: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 49 KiB/s wr, 7 op/s 2023-05-08T08:28:20.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:20 smithi186 ceph-mon[126480]: pgmap v9145: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 49 KiB/s wr, 7 op/s 2023-05-08T08:28:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:20 smithi133 ceph-mon[125939]: pgmap v9145: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 49 KiB/s wr, 7 op/s 2023-05-08T08:28:21.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17039.793024 secs 2023-05-08T08:28:21.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17039.793024 secs 2023-05-08T08:28:21.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17039.793024 secs 2023-05-08T08:28:22.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:22 smithi096 ceph-mon[124666]: pgmap v9146: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 49 KiB/s wr, 6 op/s 2023-05-08T08:28:22.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:22 smithi186 ceph-mon[126480]: pgmap v9146: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 49 KiB/s wr, 6 op/s 2023-05-08T08:28:22.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:22 smithi133 ceph-mon[125939]: pgmap v9146: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 49 KiB/s wr, 6 op/s 2023-05-08T08:28:24.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:24 smithi186 ceph-mon[126480]: pgmap v9147: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 44 KiB/s wr, 6 op/s 2023-05-08T08:28:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17042.952809 secs 2023-05-08T08:28:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17043.508898 secs 2023-05-08T08:28:24.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:24 smithi133 ceph-mon[125939]: pgmap v9147: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 44 KiB/s wr, 6 op/s 2023-05-08T08:28:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17042.952809 secs 2023-05-08T08:28:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17043.508898 secs 2023-05-08T08:28:24.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:24 smithi096 ceph-mon[124666]: pgmap v9147: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 44 KiB/s wr, 6 op/s 2023-05-08T08:28:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17042.952809 secs 2023-05-08T08:28:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17043.508898 secs 2023-05-08T08:28:26.638 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17044.793152 secs 2023-05-08T08:28:26.638 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:26 smithi186 ceph-mon[126480]: pgmap v9148: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 KiB/s wr, 7 op/s 2023-05-08T08:28:26.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17044.793152 secs 2023-05-08T08:28:26.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:26 smithi133 ceph-mon[125939]: pgmap v9148: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 KiB/s wr, 7 op/s 2023-05-08T08:28:26.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17044.793152 secs 2023-05-08T08:28:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:26 smithi096 ceph-mon[124666]: pgmap v9148: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 KiB/s wr, 7 op/s 2023-05-08T08:28:28.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:28 smithi186 ceph-mon[126480]: pgmap v9149: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T08:28:28.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:28 smithi133 ceph-mon[125939]: pgmap v9149: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T08:28:28.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:28 smithi096 ceph-mon[124666]: pgmap v9149: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T08:28:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17047.952913 secs 2023-05-08T08:28:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17048.508960 secs 2023-05-08T08:28:29.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17047.952913 secs 2023-05-08T08:28:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17048.508960 secs 2023-05-08T08:28:29.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17047.952913 secs 2023-05-08T08:28:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17048.508960 secs 2023-05-08T08:28:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:30 smithi186 ceph-mon[126480]: pgmap v9150: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T08:28:30.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:30 smithi133 ceph-mon[125939]: pgmap v9150: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T08:28:30.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:30 smithi096 ceph-mon[124666]: pgmap v9150: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T08:28:31.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17049.793299 secs 2023-05-08T08:28:31.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17049.793299 secs 2023-05-08T08:28:31.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17049.793299 secs 2023-05-08T08:28:32.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:32 smithi186 ceph-mon[126480]: pgmap v9151: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T08:28:32.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:32 smithi133 ceph-mon[125939]: pgmap v9151: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T08:28:32.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:32 smithi096 ceph-mon[124666]: pgmap v9151: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T08:28:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:34 smithi186 ceph-mon[126480]: pgmap v9152: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T08:28:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17052.953033 secs 2023-05-08T08:28:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17053.509062 secs 2023-05-08T08:28:34.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:34 smithi133 ceph-mon[125939]: pgmap v9152: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T08:28:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17052.953033 secs 2023-05-08T08:28:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17053.509062 secs 2023-05-08T08:28:34.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:34 smithi096 ceph-mon[124666]: pgmap v9152: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T08:28:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17052.953033 secs 2023-05-08T08:28:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17053.509062 secs 2023-05-08T08:28:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17054.793415 secs 2023-05-08T08:28:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:36 smithi186 ceph-mon[126480]: pgmap v9153: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 48 KiB/s wr, 8 op/s 2023-05-08T08:28:36.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17054.793415 secs 2023-05-08T08:28:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:36 smithi133 ceph-mon[125939]: pgmap v9153: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 48 KiB/s wr, 8 op/s 2023-05-08T08:28:36.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17054.793415 secs 2023-05-08T08:28:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:36 smithi096 ceph-mon[124666]: pgmap v9153: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 48 KiB/s wr, 8 op/s 2023-05-08T08:28:38.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:38 smithi186 ceph-mon[126480]: pgmap v9154: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 48 KiB/s wr, 6 op/s 2023-05-08T08:28:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:38 smithi133 ceph-mon[125939]: pgmap v9154: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 48 KiB/s wr, 6 op/s 2023-05-08T08:28:38.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:38 smithi096 ceph-mon[124666]: pgmap v9154: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 48 KiB/s wr, 6 op/s 2023-05-08T08:28:39.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17057.953160 secs 2023-05-08T08:28:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17058.509188 secs 2023-05-08T08:28:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:28:39.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17057.953160 secs 2023-05-08T08:28:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17058.509188 secs 2023-05-08T08:28:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:28:39.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17057.953160 secs 2023-05-08T08:28:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17058.509188 secs 2023-05-08T08:28:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:28:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:40 smithi186 ceph-mon[126480]: pgmap v9155: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 171 KiB/s wr, 8 op/s 2023-05-08T08:28:40.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:40 smithi133 ceph-mon[125939]: pgmap v9155: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 171 KiB/s wr, 8 op/s 2023-05-08T08:28:40.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:40 smithi096 ceph-mon[124666]: pgmap v9155: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 171 KiB/s wr, 8 op/s 2023-05-08T08:28:42.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:42 smithi186 ceph-mon[126480]: pgmap v9156: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 180 KiB/s wr, 7 op/s 2023-05-08T08:28:42.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:28:42.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:28:42.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:28:42.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:28:42.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:28:42.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:28:42.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:42 smithi133 ceph-mon[125939]: pgmap v9156: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 180 KiB/s wr, 7 op/s 2023-05-08T08:28:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:28:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:28:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:28:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:28:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:28:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:28:42.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:42 smithi096 ceph-mon[124666]: pgmap v9156: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 180 KiB/s wr, 7 op/s 2023-05-08T08:28:42.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:28:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:28:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:28:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:28:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:28:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:28:43.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:43 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:28:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:43 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:28:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:43 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:28:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:43 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:28:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:43 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:28:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:43 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:28:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:43 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:28:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:43 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:28:43.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:43 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:28:43.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:43 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:28:43.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:43 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:28:43.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:43 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:28:43.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:43 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:28:43.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:43 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:28:43.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:43 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:28:43.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:28:43.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:43 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:28:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:43 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:28:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:43 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:28:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:43 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:28:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:43 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:28:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:43 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:28:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:43 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:28:43.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:43 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:28:43.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:43 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:28:43.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:43 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:28:43.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:43 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:28:43.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:43 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:28:43.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:43 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:28:43.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:43 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:28:43.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:43 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:28:43.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:28:43.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:43 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:28:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:43 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:28:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:43 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:28:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:43 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:28:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:43 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:28:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:43 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:28:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:43 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:28:43.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:43 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:28:43.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:43 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:28:43.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:43 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:28:43.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:43 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:28:43.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:43 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:28:43.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:43 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:28:43.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:43 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:28:43.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:43 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:28:43.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:28:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:44 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T08:28:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:44 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T08:28:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:44 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi096 to 75114k 2023-05-08T08:28:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:44 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T08:28:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:44 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi096 to 76917739: error parsing value: Value '76917739' is below minimum 939524096 2023-05-08T08:28:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:44 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T08:28:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:44 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:28:44.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:44 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T08:28:44.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:44 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T08:28:44.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:44 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:28:44.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:44 smithi186 ceph-mon[126480]: pgmap v9157: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 180 KiB/s wr, 6 op/s 2023-05-08T08:28:44.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17062.953277 secs 2023-05-08T08:28:44.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:28:44.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:28:44.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:28:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:44 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T08:28:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:44 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T08:28:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:44 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi096 to 75114k 2023-05-08T08:28:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:44 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T08:28:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:44 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi096 to 76917739: error parsing value: Value '76917739' is below minimum 939524096 2023-05-08T08:28:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:44 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T08:28:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:44 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:28:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:44 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T08:28:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:44 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T08:28:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:44 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:28:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:44 smithi133 ceph-mon[125939]: pgmap v9157: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 180 KiB/s wr, 6 op/s 2023-05-08T08:28:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17062.953277 secs 2023-05-08T08:28:44.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:28:44.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:28:44.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:28:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:44 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T08:28:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:44 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T08:28:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:44 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi096 to 75114k 2023-05-08T08:28:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:44 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T08:28:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:44 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi096 to 76917739: error parsing value: Value '76917739' is below minimum 939524096 2023-05-08T08:28:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:44 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T08:28:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:44 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:28:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:44 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T08:28:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:44 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T08:28:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:44 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:28:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:44 smithi096 ceph-mon[124666]: pgmap v9157: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 180 KiB/s wr, 6 op/s 2023-05-08T08:28:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17062.953277 secs 2023-05-08T08:28:44.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:28:44.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:28:44.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:28:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:46 smithi186 ceph-mon[126480]: pgmap v9158: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 273 KiB/s wr, 10 op/s 2023-05-08T08:28:46.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:46 smithi133 ceph-mon[125939]: pgmap v9158: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 273 KiB/s wr, 10 op/s 2023-05-08T08:28:46.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:46 smithi096 ceph-mon[124666]: pgmap v9158: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 273 KiB/s wr, 10 op/s 2023-05-08T08:28:47.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:28:47.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:28:47.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:28:48.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:48 smithi186 ceph-mon[126480]: pgmap v9159: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 225 KiB/s wr, 7 op/s 2023-05-08T08:28:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:28:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:28:48.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:48 smithi133 ceph-mon[125939]: pgmap v9159: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 225 KiB/s wr, 7 op/s 2023-05-08T08:28:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:28:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:28:48.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:48 smithi096 ceph-mon[124666]: pgmap v9159: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 225 KiB/s wr, 7 op/s 2023-05-08T08:28:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:28:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:28:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17067.953398 secs 2023-05-08T08:28:49.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17067.953398 secs 2023-05-08T08:28:49.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17067.953398 secs 2023-05-08T08:28:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:50 smithi186 ceph-mon[126480]: pgmap v9160: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 447 KiB/s wr, 12 op/s 2023-05-08T08:28:50.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:50 smithi133 ceph-mon[125939]: pgmap v9160: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 447 KiB/s wr, 12 op/s 2023-05-08T08:28:50.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:50 smithi096 ceph-mon[124666]: pgmap v9160: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 447 KiB/s wr, 12 op/s 2023-05-08T08:28:51.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17069.793745 secs 2023-05-08T08:28:51.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17069.793745 secs 2023-05-08T08:28:51.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17069.793745 secs 2023-05-08T08:28:52.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:52 smithi186 ceph-mon[126480]: pgmap v9161: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 324 KiB/s wr, 10 op/s 2023-05-08T08:28:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:52 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:28:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:28:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:28:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:52 smithi133 ceph-mon[125939]: pgmap v9161: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 324 KiB/s wr, 10 op/s 2023-05-08T08:28:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:52 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:28:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:28:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:28:52.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:52 smithi096 ceph-mon[124666]: pgmap v9161: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 324 KiB/s wr, 10 op/s 2023-05-08T08:28:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:52 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:28:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:28:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:28:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:54 smithi186 ceph-mon[126480]: pgmap v9162: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 315 KiB/s wr, 10 op/s 2023-05-08T08:28:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17072.953520 secs 2023-05-08T08:28:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:54 smithi133 ceph-mon[125939]: pgmap v9162: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 315 KiB/s wr, 10 op/s 2023-05-08T08:28:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17072.953520 secs 2023-05-08T08:28:54.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:54 smithi096 ceph-mon[124666]: pgmap v9162: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 315 KiB/s wr, 10 op/s 2023-05-08T08:28:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17072.953520 secs 2023-05-08T08:28:56.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17074.793868 secs 2023-05-08T08:28:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:56 smithi186 ceph-mon[126480]: pgmap v9163: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 635 KiB/s rd, 490 KiB/s wr, 14 op/s 2023-05-08T08:28:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17074.793868 secs 2023-05-08T08:28:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:56 smithi133 ceph-mon[125939]: pgmap v9163: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 635 KiB/s rd, 490 KiB/s wr, 14 op/s 2023-05-08T08:28:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17074.793868 secs 2023-05-08T08:28:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:56 smithi096 ceph-mon[124666]: pgmap v9163: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 635 KiB/s rd, 490 KiB/s wr, 14 op/s 2023-05-08T08:28:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:58 smithi186 ceph-mon[126480]: pgmap v9164: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 427 KiB/s rd, 406 KiB/s wr, 12 op/s 2023-05-08T08:28:58.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:58 smithi133 ceph-mon[125939]: pgmap v9164: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 427 KiB/s rd, 406 KiB/s wr, 12 op/s 2023-05-08T08:28:58.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:58 smithi096 ceph-mon[124666]: pgmap v9164: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 427 KiB/s rd, 406 KiB/s wr, 12 op/s 2023-05-08T08:28:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17077.953662 secs 2023-05-08T08:28:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:28:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17078.509701 secs 2023-05-08T08:28:59.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17077.953662 secs 2023-05-08T08:28:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:28:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17078.509701 secs 2023-05-08T08:28:59.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17077.953662 secs 2023-05-08T08:28:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:28:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17078.509701 secs 2023-05-08T08:29:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:00 smithi186 ceph-mon[126480]: pgmap v9165: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 592 KiB/s rd, 579 KiB/s wr, 15 op/s 2023-05-08T08:29:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:00 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:29:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:29:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:29:00.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:00 smithi133 ceph-mon[125939]: pgmap v9165: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 592 KiB/s rd, 579 KiB/s wr, 15 op/s 2023-05-08T08:29:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:00 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:29:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:29:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:29:00.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:00 smithi096 ceph-mon[124666]: pgmap v9165: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 592 KiB/s rd, 579 KiB/s wr, 15 op/s 2023-05-08T08:29:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:00 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:29:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:29:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:29:01.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17079.794020 secs 2023-05-08T08:29:01.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17079.794020 secs 2023-05-08T08:29:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17079.794020 secs 2023-05-08T08:29:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:02 smithi186 ceph-mon[126480]: pgmap v9166: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 357 KiB/s wr, 11 op/s 2023-05-08T08:29:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:02 smithi133 ceph-mon[125939]: pgmap v9166: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 357 KiB/s wr, 11 op/s 2023-05-08T08:29:02.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:02 smithi096 ceph-mon[124666]: pgmap v9166: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 357 KiB/s wr, 11 op/s 2023-05-08T08:29:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:04 smithi186 ceph-mon[126480]: pgmap v9167: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 357 KiB/s wr, 10 op/s 2023-05-08T08:29:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17082.953721 secs 2023-05-08T08:29:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17083.509829 secs 2023-05-08T08:29:04.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:04 smithi133 ceph-mon[125939]: pgmap v9167: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 357 KiB/s wr, 10 op/s 2023-05-08T08:29:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17082.953721 secs 2023-05-08T08:29:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17083.509829 secs 2023-05-08T08:29:04.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:04 smithi096 ceph-mon[124666]: pgmap v9167: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 357 KiB/s wr, 10 op/s 2023-05-08T08:29:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17082.953721 secs 2023-05-08T08:29:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17083.509829 secs 2023-05-08T08:29:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17084.794147 secs 2023-05-08T08:29:05.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17084.794147 secs 2023-05-08T08:29:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17084.794147 secs 2023-05-08T08:29:06.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:06 smithi133 ceph-mon[125939]: pgmap v9168: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 402 KiB/s wr, 27 op/s 2023-05-08T08:29:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:06 smithi096 ceph-mon[124666]: pgmap v9168: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 402 KiB/s wr, 27 op/s 2023-05-08T08:29:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:06 smithi186 ceph-mon[126480]: pgmap v9168: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 402 KiB/s wr, 27 op/s 2023-05-08T08:29:08.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:08 smithi133 ceph-mon[125939]: pgmap v9169: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 227 KiB/s wr, 23 op/s 2023-05-08T08:29:08.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:08 smithi096 ceph-mon[124666]: pgmap v9169: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 227 KiB/s wr, 23 op/s 2023-05-08T08:29:08.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:08 smithi186 ceph-mon[126480]: pgmap v9169: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 227 KiB/s wr, 23 op/s 2023-05-08T08:29:09.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17087.953803 secs 2023-05-08T08:29:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17088.509960 secs 2023-05-08T08:29:09.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17087.953803 secs 2023-05-08T08:29:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17088.509960 secs 2023-05-08T08:29:09.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17087.953803 secs 2023-05-08T08:29:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17088.509960 secs 2023-05-08T08:29:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:10 smithi133 ceph-mon[125939]: pgmap v9170: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 274 KiB/s wr, 25 op/s 2023-05-08T08:29:10.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:10 smithi096 ceph-mon[124666]: pgmap v9170: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 274 KiB/s wr, 25 op/s 2023-05-08T08:29:10.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:10 smithi186 ceph-mon[126480]: pgmap v9170: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 274 KiB/s wr, 25 op/s 2023-05-08T08:29:11.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17089.794274 secs 2023-05-08T08:29:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:11 smithi133 ceph-mon[125939]: osdmap e650: 12 total, 12 up, 12 in 2023-05-08T08:29:11.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17089.794274 secs 2023-05-08T08:29:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:11 smithi096 ceph-mon[124666]: osdmap e650: 12 total, 12 up, 12 in 2023-05-08T08:29:11.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17089.794274 secs 2023-05-08T08:29:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:11 smithi186 ceph-mon[126480]: osdmap e650: 12 total, 12 up, 12 in 2023-05-08T08:29:12.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:12 smithi133 ceph-mon[125939]: pgmap v9172: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 121 KiB/s wr, 25 op/s 2023-05-08T08:29:12.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:12 smithi096 ceph-mon[124666]: pgmap v9172: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 121 KiB/s wr, 25 op/s 2023-05-08T08:29:12.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:12 smithi186 ceph-mon[126480]: pgmap v9172: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 121 KiB/s wr, 25 op/s 2023-05-08T08:29:14.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:14 smithi133 ceph-mon[125939]: pgmap v9173: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 121 KiB/s wr, 25 op/s 2023-05-08T08:29:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17092.953887 secs 2023-05-08T08:29:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17093.510095 secs 2023-05-08T08:29:14.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:14 smithi096 ceph-mon[124666]: pgmap v9173: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 121 KiB/s wr, 25 op/s 2023-05-08T08:29:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17092.953887 secs 2023-05-08T08:29:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17093.510095 secs 2023-05-08T08:29:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:14 smithi186 ceph-mon[126480]: pgmap v9173: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 121 KiB/s wr, 25 op/s 2023-05-08T08:29:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17092.953887 secs 2023-05-08T08:29:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17093.510095 secs 2023-05-08T08:29:16.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17094.794398 secs 2023-05-08T08:29:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:16 smithi096 ceph-mon[124666]: pgmap v9174: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 68 KiB/s wr, 7 op/s 2023-05-08T08:29:16.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17094.794398 secs 2023-05-08T08:29:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:16 smithi186 ceph-mon[126480]: pgmap v9174: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 68 KiB/s wr, 7 op/s 2023-05-08T08:29:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17094.794398 secs 2023-05-08T08:29:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:16 smithi133 ceph-mon[125939]: pgmap v9174: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 68 KiB/s wr, 7 op/s 2023-05-08T08:29:18.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:18 smithi133 ceph-mon[125939]: pgmap v9175: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 67 KiB/s wr, 7 op/s 2023-05-08T08:29:18.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:18 smithi133 ceph-mon[125939]: osdmap e651: 12 total, 12 up, 12 in 2023-05-08T08:29:18.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:18 smithi096 ceph-mon[124666]: pgmap v9175: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 67 KiB/s wr, 7 op/s 2023-05-08T08:29:18.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:18 smithi096 ceph-mon[124666]: osdmap e651: 12 total, 12 up, 12 in 2023-05-08T08:29:18.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:18 smithi186 ceph-mon[126480]: pgmap v9175: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 67 KiB/s wr, 7 op/s 2023-05-08T08:29:18.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:18 smithi186 ceph-mon[126480]: osdmap e651: 12 total, 12 up, 12 in 2023-05-08T08:29:19.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17097.954010 secs 2023-05-08T08:29:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17098.510218 secs 2023-05-08T08:29:19.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17097.954010 secs 2023-05-08T08:29:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17098.510218 secs 2023-05-08T08:29:19.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17097.954010 secs 2023-05-08T08:29:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17098.510218 secs 2023-05-08T08:29:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:20 smithi133 ceph-mon[125939]: pgmap v9177: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 160 KiB/s wr, 7 op/s 2023-05-08T08:29:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:20 smithi096 ceph-mon[124666]: pgmap v9177: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 160 KiB/s wr, 7 op/s 2023-05-08T08:29:20.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:20 smithi186 ceph-mon[126480]: pgmap v9177: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 160 KiB/s wr, 7 op/s 2023-05-08T08:29:21.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17099.794515 secs 2023-05-08T08:29:21.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17099.794515 secs 2023-05-08T08:29:21.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17099.794515 secs 2023-05-08T08:29:22.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:22 smithi133 ceph-mon[125939]: pgmap v9178: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 143 KiB/s wr, 7 op/s 2023-05-08T08:29:22.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:22 smithi096 ceph-mon[124666]: pgmap v9178: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 143 KiB/s wr, 7 op/s 2023-05-08T08:29:22.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:22 smithi186 ceph-mon[126480]: pgmap v9178: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 143 KiB/s wr, 7 op/s 2023-05-08T08:29:24.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:24 smithi096 ceph-mon[124666]: pgmap v9179: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 143 KiB/s wr, 7 op/s 2023-05-08T08:29:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17102.954135 secs 2023-05-08T08:29:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17103.510359 secs 2023-05-08T08:29:24.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:24 smithi186 ceph-mon[126480]: pgmap v9179: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 143 KiB/s wr, 7 op/s 2023-05-08T08:29:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17102.954135 secs 2023-05-08T08:29:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17103.510359 secs 2023-05-08T08:29:24.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:24 smithi133 ceph-mon[125939]: pgmap v9179: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 143 KiB/s wr, 7 op/s 2023-05-08T08:29:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17102.954135 secs 2023-05-08T08:29:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17103.510359 secs 2023-05-08T08:29:26.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17104.794610 secs 2023-05-08T08:29:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:26 smithi096 ceph-mon[124666]: pgmap v9180: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 142 KiB/s wr, 6 op/s 2023-05-08T08:29:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17104.794610 secs 2023-05-08T08:29:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:26 smithi186 ceph-mon[126480]: pgmap v9180: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 142 KiB/s wr, 6 op/s 2023-05-08T08:29:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17104.794610 secs 2023-05-08T08:29:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:26 smithi133 ceph-mon[125939]: pgmap v9180: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 142 KiB/s wr, 6 op/s 2023-05-08T08:29:28.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:28 smithi096 ceph-mon[124666]: pgmap v9181: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 142 KiB/s wr, 6 op/s 2023-05-08T08:29:28.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:28 smithi186 ceph-mon[126480]: pgmap v9181: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 142 KiB/s wr, 6 op/s 2023-05-08T08:29:28.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:28 smithi133 ceph-mon[125939]: pgmap v9181: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 142 KiB/s wr, 6 op/s 2023-05-08T08:29:29.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17107.954259 secs 2023-05-08T08:29:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17108.510409 secs 2023-05-08T08:29:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17107.954259 secs 2023-05-08T08:29:29.652 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17108.510409 secs 2023-05-08T08:29:29.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17107.954259 secs 2023-05-08T08:29:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17108.510409 secs 2023-05-08T08:29:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:30 smithi186 ceph-mon[126480]: pgmap v9182: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 119 KiB/s wr, 8 op/s 2023-05-08T08:29:30.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:30 smithi133 ceph-mon[125939]: pgmap v9182: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 119 KiB/s wr, 8 op/s 2023-05-08T08:29:30.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:30 smithi096 ceph-mon[124666]: pgmap v9182: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 119 KiB/s wr, 8 op/s 2023-05-08T08:29:31.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17109.794733 secs 2023-05-08T08:29:31.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17109.794733 secs 2023-05-08T08:29:31.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17109.794733 secs 2023-05-08T08:29:32.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:32 smithi186 ceph-mon[126480]: pgmap v9183: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T08:29:32.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:32 smithi133 ceph-mon[125939]: pgmap v9183: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T08:29:32.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:32 smithi096 ceph-mon[124666]: pgmap v9183: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T08:29:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:34 smithi186 ceph-mon[126480]: pgmap v9184: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T08:29:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17112.954397 secs 2023-05-08T08:29:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17113.510537 secs 2023-05-08T08:29:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:34 smithi133 ceph-mon[125939]: pgmap v9184: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T08:29:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17112.954397 secs 2023-05-08T08:29:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17113.510537 secs 2023-05-08T08:29:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:34 smithi096 ceph-mon[124666]: pgmap v9184: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T08:29:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17112.954397 secs 2023-05-08T08:29:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17113.510537 secs 2023-05-08T08:29:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17114.794852 secs 2023-05-08T08:29:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:36 smithi186 ceph-mon[126480]: pgmap v9185: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 682 B/s wr, 8 op/s 2023-05-08T08:29:36.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17114.794852 secs 2023-05-08T08:29:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:36 smithi133 ceph-mon[125939]: pgmap v9185: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 682 B/s wr, 8 op/s 2023-05-08T08:29:36.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17114.794852 secs 2023-05-08T08:29:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:36 smithi096 ceph-mon[124666]: pgmap v9185: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 682 B/s wr, 8 op/s 2023-05-08T08:29:38.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:38 smithi186 ceph-mon[126480]: pgmap v9186: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T08:29:38.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:38 smithi133 ceph-mon[125939]: pgmap v9186: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T08:29:38.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:38 smithi096 ceph-mon[124666]: pgmap v9186: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T08:29:39.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17117.954496 secs 2023-05-08T08:29:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17118.510635 secs 2023-05-08T08:29:39.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17117.954496 secs 2023-05-08T08:29:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17118.510635 secs 2023-05-08T08:29:39.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17117.954496 secs 2023-05-08T08:29:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17118.510635 secs 2023-05-08T08:29:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:40 smithi186 ceph-mon[126480]: pgmap v9187: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 123 KiB/s wr, 9 op/s 2023-05-08T08:29:40.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:40 smithi133 ceph-mon[125939]: pgmap v9187: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 123 KiB/s wr, 9 op/s 2023-05-08T08:29:40.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:40 smithi096 ceph-mon[124666]: pgmap v9187: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 123 KiB/s wr, 9 op/s 2023-05-08T08:29:42.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:42 smithi186 ceph-mon[126480]: pgmap v9188: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 132 KiB/s wr, 7 op/s 2023-05-08T08:29:42.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:42 smithi133 ceph-mon[125939]: pgmap v9188: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 132 KiB/s wr, 7 op/s 2023-05-08T08:29:42.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:42 smithi096 ceph-mon[124666]: pgmap v9188: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 132 KiB/s wr, 7 op/s 2023-05-08T08:29:43.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:43 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:29:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:29:43.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:43 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:29:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:29:43.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:43 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:29:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:29:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:44 smithi186 ceph-mon[126480]: pgmap v9189: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 132 KiB/s wr, 6 op/s 2023-05-08T08:29:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17122.954615 secs 2023-05-08T08:29:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:29:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:29:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:29:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:44 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:29:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:44 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:29:44.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:44 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:29:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:44 smithi133 ceph-mon[125939]: pgmap v9189: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 132 KiB/s wr, 6 op/s 2023-05-08T08:29:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17122.954615 secs 2023-05-08T08:29:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:29:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:29:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:29:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:44 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:29:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:44 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:29:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:44 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:29:44.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:44 smithi096 ceph-mon[124666]: pgmap v9189: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 132 KiB/s wr, 6 op/s 2023-05-08T08:29:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17122.954615 secs 2023-05-08T08:29:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:29:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:29:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:29:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:44 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:29:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:44 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:29:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:44 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:29:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:45 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:29:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:45 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T08:29:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:45 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T08:29:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:45 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:29:45.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:45 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:29:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:45 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T08:29:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:45 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T08:29:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:45 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:29:45.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:45 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:29:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:45 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T08:29:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:45 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T08:29:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:45 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:29:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:46 smithi186 ceph-mon[126480]: pgmap v9190: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 148 KiB/s wr, 10 op/s 2023-05-08T08:29:46.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:46 smithi133 ceph-mon[125939]: pgmap v9190: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 148 KiB/s wr, 10 op/s 2023-05-08T08:29:46.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:46 smithi096 ceph-mon[124666]: pgmap v9190: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 148 KiB/s wr, 10 op/s 2023-05-08T08:29:47.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:29:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:29:47.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:29:48.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:48 smithi186 ceph-mon[126480]: pgmap v9191: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 148 KiB/s wr, 8 op/s 2023-05-08T08:29:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:29:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:29:48.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:48 smithi133 ceph-mon[125939]: pgmap v9191: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 148 KiB/s wr, 8 op/s 2023-05-08T08:29:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:29:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:29:48.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:48 smithi096 ceph-mon[124666]: pgmap v9191: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 148 KiB/s wr, 8 op/s 2023-05-08T08:29:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:29:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:29:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17127.954728 secs 2023-05-08T08:29:49.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17127.954728 secs 2023-05-08T08:29:49.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17127.954728 secs 2023-05-08T08:29:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:50 smithi186 ceph-mon[126480]: pgmap v9192: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 448 KiB/s wr, 12 op/s 2023-05-08T08:29:50.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:50 smithi133 ceph-mon[125939]: pgmap v9192: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 448 KiB/s wr, 12 op/s 2023-05-08T08:29:50.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:50 smithi096 ceph-mon[124666]: pgmap v9192: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 448 KiB/s wr, 12 op/s 2023-05-08T08:29:51.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17129.795207 secs 2023-05-08T08:29:51.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17129.795207 secs 2023-05-08T08:29:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17129.795207 secs 2023-05-08T08:29:52.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:52 smithi186 ceph-mon[126480]: pgmap v9193: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 334 KiB/s wr, 9 op/s 2023-05-08T08:29:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:52 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:29:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:29:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:29:52.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:52 smithi133 ceph-mon[125939]: pgmap v9193: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 334 KiB/s wr, 9 op/s 2023-05-08T08:29:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:52 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:29:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:29:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:29:52.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:52 smithi096 ceph-mon[124666]: pgmap v9193: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 334 KiB/s wr, 9 op/s 2023-05-08T08:29:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:52 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:29:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:29:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:29:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:54 smithi186 ceph-mon[126480]: pgmap v9194: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 326 KiB/s wr, 9 op/s 2023-05-08T08:29:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17132.954828 secs 2023-05-08T08:29:54.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:54 smithi133 ceph-mon[125939]: pgmap v9194: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 326 KiB/s wr, 9 op/s 2023-05-08T08:29:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17132.954828 secs 2023-05-08T08:29:54.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:54 smithi096 ceph-mon[124666]: pgmap v9194: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 326 KiB/s wr, 9 op/s 2023-05-08T08:29:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17132.954828 secs 2023-05-08T08:29:56.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17134.795325 secs 2023-05-08T08:29:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:56 smithi186 ceph-mon[126480]: pgmap v9195: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 423 KiB/s wr, 14 op/s 2023-05-08T08:29:56.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17134.795325 secs 2023-05-08T08:29:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:56 smithi133 ceph-mon[125939]: pgmap v9195: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 423 KiB/s wr, 14 op/s 2023-05-08T08:29:56.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17134.795325 secs 2023-05-08T08:29:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:56 smithi096 ceph-mon[124666]: pgmap v9195: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 423 KiB/s wr, 14 op/s 2023-05-08T08:29:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:58 smithi186 ceph-mon[126480]: pgmap v9196: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 407 KiB/s wr, 11 op/s 2023-05-08T08:29:58.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:58 smithi133 ceph-mon[125939]: pgmap v9196: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 407 KiB/s wr, 11 op/s 2023-05-08T08:29:58.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:58 smithi096 ceph-mon[124666]: pgmap v9196: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 407 KiB/s wr, 11 op/s 2023-05-08T08:29:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17137.954973 secs 2023-05-08T08:29:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:29:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17138.511085 secs 2023-05-08T08:29:59.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17137.954973 secs 2023-05-08T08:29:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:29:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17138.511085 secs 2023-05-08T08:29:59.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17137.954973 secs 2023-05-08T08:29:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:29:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17138.511085 secs 2023-05-08T08:30:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:00 smithi186 ceph-mon[126480]: pgmap v9197: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 656 KiB/s rd, 644 KiB/s wr, 15 op/s 2023-05-08T08:30:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:00 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:30:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:30:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:30:00.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:00 smithi186 ceph-mon[126480]: Health detail: HEALTH_WARN 3 MDSs report slow requests 2023-05-08T08:30:00.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:00 smithi186 ceph-mon[126480]: [WRN] MDS_SLOW_REQUEST: 3 MDSs report slow requests 2023-05-08T08:30:00.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:00 smithi186 ceph-mon[126480]: mds.c(mds.2): 1 slow requests are blocked > 180 secs 2023-05-08T08:30:00.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:00 smithi186 ceph-mon[126480]: mds.i(mds.1): 1 slow requests are blocked > 180 secs 2023-05-08T08:30:00.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:00 smithi186 ceph-mon[126480]: mds.b(mds.0): 1 slow requests are blocked > 180 secs 2023-05-08T08:30:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:00 smithi133 ceph-mon[125939]: pgmap v9197: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 656 KiB/s rd, 644 KiB/s wr, 15 op/s 2023-05-08T08:30:00.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:00 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:30:00.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:30:00.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:30:00.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:00 smithi133 ceph-mon[125939]: Health detail: HEALTH_WARN 3 MDSs report slow requests 2023-05-08T08:30:00.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:00 smithi133 ceph-mon[125939]: [WRN] MDS_SLOW_REQUEST: 3 MDSs report slow requests 2023-05-08T08:30:00.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:00 smithi133 ceph-mon[125939]: mds.c(mds.2): 1 slow requests are blocked > 180 secs 2023-05-08T08:30:00.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:00 smithi133 ceph-mon[125939]: mds.i(mds.1): 1 slow requests are blocked > 180 secs 2023-05-08T08:30:00.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:00 smithi133 ceph-mon[125939]: mds.b(mds.0): 1 slow requests are blocked > 180 secs 2023-05-08T08:30:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:00 smithi096 ceph-mon[124666]: pgmap v9197: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 656 KiB/s rd, 644 KiB/s wr, 15 op/s 2023-05-08T08:30:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:00 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:30:00.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:30:00.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:30:00.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:00 smithi096 ceph-mon[124666]: Health detail: HEALTH_WARN 3 MDSs report slow requests 2023-05-08T08:30:00.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:00 smithi096 ceph-mon[124666]: [WRN] MDS_SLOW_REQUEST: 3 MDSs report slow requests 2023-05-08T08:30:00.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:00 smithi096 ceph-mon[124666]: mds.c(mds.2): 1 slow requests are blocked > 180 secs 2023-05-08T08:30:00.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:00 smithi096 ceph-mon[124666]: mds.i(mds.1): 1 slow requests are blocked > 180 secs 2023-05-08T08:30:00.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:00 smithi096 ceph-mon[124666]: mds.b(mds.0): 1 slow requests are blocked > 180 secs 2023-05-08T08:30:01.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17139.795420 secs 2023-05-08T08:30:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17139.795420 secs 2023-05-08T08:30:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17139.795420 secs 2023-05-08T08:30:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:02 smithi186 ceph-mon[126480]: pgmap v9198: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 344 KiB/s wr, 10 op/s 2023-05-08T08:30:02.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:02 smithi133 ceph-mon[125939]: pgmap v9198: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 344 KiB/s wr, 10 op/s 2023-05-08T08:30:02.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:02 smithi096 ceph-mon[124666]: pgmap v9198: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 344 KiB/s wr, 10 op/s 2023-05-08T08:30:04.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:04 smithi133 ceph-mon[125939]: pgmap v9199: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 335 KiB/s wr, 10 op/s 2023-05-08T08:30:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17142.955113 secs 2023-05-08T08:30:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17143.511216 secs 2023-05-08T08:30:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:04 smithi096 ceph-mon[124666]: pgmap v9199: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 335 KiB/s wr, 10 op/s 2023-05-08T08:30:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17142.955113 secs 2023-05-08T08:30:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17143.511216 secs 2023-05-08T08:30:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:04 smithi186 ceph-mon[126480]: pgmap v9199: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 335 KiB/s wr, 10 op/s 2023-05-08T08:30:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17142.955113 secs 2023-05-08T08:30:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17143.511216 secs 2023-05-08T08:30:05.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17144.795554 secs 2023-05-08T08:30:05.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17144.795554 secs 2023-05-08T08:30:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17144.795554 secs 2023-05-08T08:30:06.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:06 smithi133 ceph-mon[125939]: pgmap v9200: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 355 KiB/s rd, 380 KiB/s wr, 27 op/s 2023-05-08T08:30:06.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:06 smithi096 ceph-mon[124666]: pgmap v9200: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 355 KiB/s rd, 380 KiB/s wr, 27 op/s 2023-05-08T08:30:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:06 smithi186 ceph-mon[126480]: pgmap v9200: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 355 KiB/s rd, 380 KiB/s wr, 27 op/s 2023-05-08T08:30:08.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:08 smithi133 ceph-mon[125939]: pgmap v9201: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 282 KiB/s wr, 23 op/s 2023-05-08T08:30:08.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:08 smithi096 ceph-mon[124666]: pgmap v9201: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 282 KiB/s wr, 23 op/s 2023-05-08T08:30:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:08 smithi186 ceph-mon[126480]: pgmap v9201: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 282 KiB/s wr, 23 op/s 2023-05-08T08:30:09.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17147.955236 secs 2023-05-08T08:30:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17148.511349 secs 2023-05-08T08:30:09.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17147.955236 secs 2023-05-08T08:30:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17148.511349 secs 2023-05-08T08:30:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17147.955236 secs 2023-05-08T08:30:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17148.511349 secs 2023-05-08T08:30:10.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:10 smithi133 ceph-mon[125939]: pgmap v9202: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 338 KiB/s wr, 25 op/s 2023-05-08T08:30:10.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17149.795676 secs 2023-05-08T08:30:10.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:10 smithi096 ceph-mon[124666]: pgmap v9202: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 338 KiB/s wr, 25 op/s 2023-05-08T08:30:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17149.795676 secs 2023-05-08T08:30:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:10 smithi186 ceph-mon[126480]: pgmap v9202: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 338 KiB/s wr, 25 op/s 2023-05-08T08:30:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17149.795676 secs 2023-05-08T08:30:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:11 smithi133 ceph-mon[125939]: osdmap e652: 12 total, 12 up, 12 in 2023-05-08T08:30:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:11 smithi133 ceph-mon[125939]: pgmap v9204: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 122 KiB/s wr, 25 op/s 2023-05-08T08:30:11.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:11 smithi096 ceph-mon[124666]: osdmap e652: 12 total, 12 up, 12 in 2023-05-08T08:30:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:11 smithi096 ceph-mon[124666]: pgmap v9204: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 122 KiB/s wr, 25 op/s 2023-05-08T08:30:11.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:11 smithi186 ceph-mon[126480]: osdmap e652: 12 total, 12 up, 12 in 2023-05-08T08:30:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:11 smithi186 ceph-mon[126480]: pgmap v9204: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 122 KiB/s wr, 25 op/s 2023-05-08T08:30:14.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:14 smithi133 ceph-mon[125939]: pgmap v9205: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 122 KiB/s wr, 25 op/s 2023-05-08T08:30:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17152.955383 secs 2023-05-08T08:30:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17153.511496 secs 2023-05-08T08:30:14.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:14 smithi096 ceph-mon[124666]: pgmap v9205: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 122 KiB/s wr, 25 op/s 2023-05-08T08:30:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17152.955383 secs 2023-05-08T08:30:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17153.511496 secs 2023-05-08T08:30:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:14 smithi186 ceph-mon[126480]: pgmap v9205: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 122 KiB/s wr, 25 op/s 2023-05-08T08:30:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17152.955383 secs 2023-05-08T08:30:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17153.511496 secs 2023-05-08T08:30:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17154.795782 secs 2023-05-08T08:30:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:16 smithi133 ceph-mon[125939]: pgmap v9206: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 68 KiB/s wr, 6 op/s 2023-05-08T08:30:16.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17154.795782 secs 2023-05-08T08:30:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:16 smithi096 ceph-mon[124666]: pgmap v9206: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 68 KiB/s wr, 6 op/s 2023-05-08T08:30:16.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17154.795782 secs 2023-05-08T08:30:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:16 smithi186 ceph-mon[126480]: pgmap v9206: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 68 KiB/s wr, 6 op/s 2023-05-08T08:30:18.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:18 smithi096 ceph-mon[124666]: pgmap v9207: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 68 KiB/s wr, 6 op/s 2023-05-08T08:30:18.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:18 smithi186 ceph-mon[126480]: pgmap v9207: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 68 KiB/s wr, 6 op/s 2023-05-08T08:30:18.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:18 smithi133 ceph-mon[125939]: pgmap v9207: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 68 KiB/s wr, 6 op/s 2023-05-08T08:30:19.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17157.955540 secs 2023-05-08T08:30:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17158.511603 secs 2023-05-08T08:30:19.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17157.955540 secs 2023-05-08T08:30:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17158.511603 secs 2023-05-08T08:30:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17157.955540 secs 2023-05-08T08:30:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17158.511603 secs 2023-05-08T08:30:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:20 smithi096 ceph-mon[124666]: pgmap v9208: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:30:20.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:20 smithi186 ceph-mon[126480]: pgmap v9208: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:30:20.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:20 smithi133 ceph-mon[125939]: pgmap v9208: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:30:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17159.795917 secs 2023-05-08T08:30:21.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17159.795917 secs 2023-05-08T08:30:21.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17159.795917 secs 2023-05-08T08:30:22.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:22 smithi096 ceph-mon[124666]: pgmap v9209: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 284 B/s wr, 6 op/s 2023-05-08T08:30:22.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:22 smithi096 ceph-mon[124666]: osdmap e653: 12 total, 12 up, 12 in 2023-05-08T08:30:22.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:22 smithi186 ceph-mon[126480]: pgmap v9209: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 284 B/s wr, 6 op/s 2023-05-08T08:30:22.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:22 smithi186 ceph-mon[126480]: osdmap e653: 12 total, 12 up, 12 in 2023-05-08T08:30:22.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:22 smithi133 ceph-mon[125939]: pgmap v9209: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 284 B/s wr, 6 op/s 2023-05-08T08:30:22.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:22 smithi133 ceph-mon[125939]: osdmap e653: 12 total, 12 up, 12 in 2023-05-08T08:30:24.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:24 smithi186 ceph-mon[126480]: pgmap v9211: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:30:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17162.955665 secs 2023-05-08T08:30:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17163.511698 secs 2023-05-08T08:30:24.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:24 smithi133 ceph-mon[125939]: pgmap v9211: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:30:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17162.955665 secs 2023-05-08T08:30:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17163.511698 secs 2023-05-08T08:30:24.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:24 smithi096 ceph-mon[124666]: pgmap v9211: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:30:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17162.955665 secs 2023-05-08T08:30:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17163.511698 secs 2023-05-08T08:30:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17164.796041 secs 2023-05-08T08:30:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:26 smithi186 ceph-mon[126480]: pgmap v9212: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:30:26.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17164.796041 secs 2023-05-08T08:30:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:26 smithi133 ceph-mon[125939]: pgmap v9212: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:30:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17164.796041 secs 2023-05-08T08:30:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:26 smithi096 ceph-mon[124666]: pgmap v9212: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:30:28.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:28 smithi186 ceph-mon[126480]: pgmap v9213: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:30:28.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:28 smithi133 ceph-mon[125939]: pgmap v9213: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:30:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:28 smithi096 ceph-mon[124666]: pgmap v9213: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:30:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17167.955798 secs 2023-05-08T08:30:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17168.511793 secs 2023-05-08T08:30:29.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17167.955798 secs 2023-05-08T08:30:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17168.511793 secs 2023-05-08T08:30:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17167.955798 secs 2023-05-08T08:30:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17168.511793 secs 2023-05-08T08:30:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:30 smithi186 ceph-mon[126480]: pgmap v9214: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:30:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:30 smithi133 ceph-mon[125939]: pgmap v9214: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:30:30.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:30 smithi096 ceph-mon[124666]: pgmap v9214: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:30:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17169.796165 secs 2023-05-08T08:30:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17169.796165 secs 2023-05-08T08:30:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17169.796165 secs 2023-05-08T08:30:32.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:32 smithi186 ceph-mon[126480]: pgmap v9215: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:30:32.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:32 smithi133 ceph-mon[125939]: pgmap v9215: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:30:32.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:32 smithi096 ceph-mon[124666]: pgmap v9215: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:30:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:34 smithi186 ceph-mon[126480]: pgmap v9216: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 93 B/s wr, 6 op/s 2023-05-08T08:30:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17172.955913 secs 2023-05-08T08:30:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17173.511903 secs 2023-05-08T08:30:34.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:34 smithi133 ceph-mon[125939]: pgmap v9216: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 93 B/s wr, 6 op/s 2023-05-08T08:30:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17172.955913 secs 2023-05-08T08:30:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17173.511903 secs 2023-05-08T08:30:34.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:34 smithi096 ceph-mon[124666]: pgmap v9216: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 93 B/s wr, 6 op/s 2023-05-08T08:30:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17172.955913 secs 2023-05-08T08:30:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17173.511903 secs 2023-05-08T08:30:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17174.796325 secs 2023-05-08T08:30:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:36 smithi186 ceph-mon[126480]: pgmap v9217: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 49 KiB/s wr, 8 op/s 2023-05-08T08:30:36.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17174.796325 secs 2023-05-08T08:30:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:36 smithi133 ceph-mon[125939]: pgmap v9217: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 49 KiB/s wr, 8 op/s 2023-05-08T08:30:36.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17174.796325 secs 2023-05-08T08:30:36.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:36 smithi096 ceph-mon[124666]: pgmap v9217: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 49 KiB/s wr, 8 op/s 2023-05-08T08:30:38.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:38 smithi186 ceph-mon[126480]: pgmap v9218: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 49 KiB/s wr, 7 op/s 2023-05-08T08:30:38.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:38 smithi133 ceph-mon[125939]: pgmap v9218: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 49 KiB/s wr, 7 op/s 2023-05-08T08:30:38.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:38 smithi096 ceph-mon[124666]: pgmap v9218: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 49 KiB/s wr, 7 op/s 2023-05-08T08:30:39.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17177.956028 secs 2023-05-08T08:30:39.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17178.512016 secs 2023-05-08T08:30:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17177.956028 secs 2023-05-08T08:30:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17178.512016 secs 2023-05-08T08:30:39.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17177.956028 secs 2023-05-08T08:30:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17178.512016 secs 2023-05-08T08:30:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:40 smithi186 ceph-mon[126480]: pgmap v9219: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 251 KiB/s wr, 9 op/s 2023-05-08T08:30:40.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:40 smithi133 ceph-mon[125939]: pgmap v9219: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 251 KiB/s wr, 9 op/s 2023-05-08T08:30:40.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:40 smithi096 ceph-mon[124666]: pgmap v9219: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 251 KiB/s wr, 9 op/s 2023-05-08T08:30:42.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:42 smithi186 ceph-mon[126480]: pgmap v9220: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 260 KiB/s wr, 7 op/s 2023-05-08T08:30:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:42 smithi133 ceph-mon[125939]: pgmap v9220: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 260 KiB/s wr, 7 op/s 2023-05-08T08:30:42.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:42 smithi096 ceph-mon[124666]: pgmap v9220: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 260 KiB/s wr, 7 op/s 2023-05-08T08:30:43.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:30:43.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:30:43.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:30:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:44 smithi186 ceph-mon[126480]: pgmap v9221: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 260 KiB/s wr, 7 op/s 2023-05-08T08:30:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17182.956168 secs 2023-05-08T08:30:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:30:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:30:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:30:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:44 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:30:44.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:44 smithi133 ceph-mon[125939]: pgmap v9221: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 260 KiB/s wr, 7 op/s 2023-05-08T08:30:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17182.956168 secs 2023-05-08T08:30:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:30:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:30:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:30:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:44 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:30:44.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:44 smithi096 ceph-mon[124666]: pgmap v9221: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 260 KiB/s wr, 7 op/s 2023-05-08T08:30:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17182.956168 secs 2023-05-08T08:30:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:30:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:30:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:30:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:44 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:30:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:30:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:30:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:45 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:30:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:30:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:45 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T08:30:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:45 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T08:30:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:45 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:30:45.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:30:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:30:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:45 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:30:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:30:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:45 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T08:30:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:45 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T08:30:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:45 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:30:45.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:30:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:30:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:45 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:30:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:30:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:45 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T08:30:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:45 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T08:30:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:45 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:30:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:46 smithi186 ceph-mon[126480]: pgmap v9222: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 276 KiB/s wr, 11 op/s 2023-05-08T08:30:46.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:46 smithi133 ceph-mon[125939]: pgmap v9222: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 276 KiB/s wr, 11 op/s 2023-05-08T08:30:46.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:46 smithi096 ceph-mon[124666]: pgmap v9222: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 276 KiB/s wr, 11 op/s 2023-05-08T08:30:47.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:30:47.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:30:47.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:30:48.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:48 smithi186 ceph-mon[126480]: pgmap v9223: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 227 KiB/s wr, 8 op/s 2023-05-08T08:30:48.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:30:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:30:48.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:48 smithi133 ceph-mon[125939]: pgmap v9223: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 227 KiB/s wr, 8 op/s 2023-05-08T08:30:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:30:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:30:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:48 smithi096 ceph-mon[124666]: pgmap v9223: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 227 KiB/s wr, 8 op/s 2023-05-08T08:30:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:30:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:30:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17187.956246 secs 2023-05-08T08:30:49.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17187.956246 secs 2023-05-08T08:30:49.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17187.956246 secs 2023-05-08T08:30:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:50 smithi186 ceph-mon[126480]: pgmap v9224: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 651 KiB/s rd, 529 KiB/s wr, 12 op/s 2023-05-08T08:30:50.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:50 smithi133 ceph-mon[125939]: pgmap v9224: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 651 KiB/s rd, 529 KiB/s wr, 12 op/s 2023-05-08T08:30:50.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:50 smithi096 ceph-mon[124666]: pgmap v9224: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 651 KiB/s rd, 529 KiB/s wr, 12 op/s 2023-05-08T08:30:51.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17189.796684 secs 2023-05-08T08:30:51.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17189.796684 secs 2023-05-08T08:30:51.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17189.796684 secs 2023-05-08T08:30:52.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:52 smithi186 ceph-mon[126480]: pgmap v9225: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 340 KiB/s rd, 337 KiB/s wr, 10 op/s 2023-05-08T08:30:52.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:52 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:30:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:30:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:30:52.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:52 smithi133 ceph-mon[125939]: pgmap v9225: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 340 KiB/s rd, 337 KiB/s wr, 10 op/s 2023-05-08T08:30:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:52 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:30:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:30:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:30:52.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:52 smithi096 ceph-mon[124666]: pgmap v9225: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 340 KiB/s rd, 337 KiB/s wr, 10 op/s 2023-05-08T08:30:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:52 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:30:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:30:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:30:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:54 smithi186 ceph-mon[126480]: pgmap v9226: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 340 KiB/s rd, 328 KiB/s wr, 9 op/s 2023-05-08T08:30:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17192.956375 secs 2023-05-08T08:30:54.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:54 smithi133 ceph-mon[125939]: pgmap v9226: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 340 KiB/s rd, 328 KiB/s wr, 9 op/s 2023-05-08T08:30:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17192.956375 secs 2023-05-08T08:30:54.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:54 smithi096 ceph-mon[124666]: pgmap v9226: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 340 KiB/s rd, 328 KiB/s wr, 9 op/s 2023-05-08T08:30:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17192.956375 secs 2023-05-08T08:30:56.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17194.796809 secs 2023-05-08T08:30:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:56 smithi186 ceph-mon[126480]: pgmap v9227: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 426 KiB/s wr, 14 op/s 2023-05-08T08:30:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17194.796809 secs 2023-05-08T08:30:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:56 smithi133 ceph-mon[125939]: pgmap v9227: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 426 KiB/s wr, 14 op/s 2023-05-08T08:30:56.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17194.796809 secs 2023-05-08T08:30:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:56 smithi096 ceph-mon[124666]: pgmap v9227: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 426 KiB/s wr, 14 op/s 2023-05-08T08:30:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:58 smithi186 ceph-mon[126480]: pgmap v9228: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 431 KiB/s rd, 410 KiB/s wr, 11 op/s 2023-05-08T08:30:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:58 smithi133 ceph-mon[125939]: pgmap v9228: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 431 KiB/s rd, 410 KiB/s wr, 11 op/s 2023-05-08T08:30:58.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:58 smithi096 ceph-mon[124666]: pgmap v9228: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 431 KiB/s rd, 410 KiB/s wr, 11 op/s 2023-05-08T08:30:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17197.956505 secs 2023-05-08T08:30:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:30:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17198.512511 secs 2023-05-08T08:30:59.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17197.956505 secs 2023-05-08T08:30:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:30:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17198.512511 secs 2023-05-08T08:30:59.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17197.956505 secs 2023-05-08T08:30:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:30:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17198.512511 secs 2023-05-08T08:31:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:00 smithi186 ceph-mon[126480]: pgmap v9229: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 676 KiB/s rd, 663 KiB/s wr, 15 op/s 2023-05-08T08:31:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:00 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:31:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:31:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:31:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:00 smithi133 ceph-mon[125939]: pgmap v9229: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 676 KiB/s rd, 663 KiB/s wr, 15 op/s 2023-05-08T08:31:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:00 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:31:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:31:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:31:00.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:00 smithi096 ceph-mon[124666]: pgmap v9229: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 676 KiB/s rd, 663 KiB/s wr, 15 op/s 2023-05-08T08:31:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:00 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:31:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:31:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:31:01.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17199.796860 secs 2023-05-08T08:31:01.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17199.796860 secs 2023-05-08T08:31:01.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17199.796860 secs 2023-05-08T08:31:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:02 smithi186 ceph-mon[126480]: pgmap v9230: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 361 KiB/s wr, 10 op/s 2023-05-08T08:31:02.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:02 smithi133 ceph-mon[125939]: pgmap v9230: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 361 KiB/s wr, 10 op/s 2023-05-08T08:31:02.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:02 smithi096 ceph-mon[124666]: pgmap v9230: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 361 KiB/s wr, 10 op/s 2023-05-08T08:31:04.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:04 smithi133 ceph-mon[125939]: pgmap v9231: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 352 KiB/s wr, 10 op/s 2023-05-08T08:31:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17202.956626 secs 2023-05-08T08:31:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17203.512642 secs 2023-05-08T08:31:04.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:04 smithi096 ceph-mon[124666]: pgmap v9231: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 352 KiB/s wr, 10 op/s 2023-05-08T08:31:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17202.956626 secs 2023-05-08T08:31:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17203.512642 secs 2023-05-08T08:31:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:04 smithi186 ceph-mon[126480]: pgmap v9231: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 352 KiB/s wr, 10 op/s 2023-05-08T08:31:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17202.956626 secs 2023-05-08T08:31:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17203.512642 secs 2023-05-08T08:31:06.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17204.796942 secs 2023-05-08T08:31:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:06 smithi133 ceph-mon[125939]: pgmap v9232: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 397 KiB/s wr, 27 op/s 2023-05-08T08:31:06.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17204.796942 secs 2023-05-08T08:31:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:06 smithi096 ceph-mon[124666]: pgmap v9232: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 397 KiB/s wr, 27 op/s 2023-05-08T08:31:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17204.796942 secs 2023-05-08T08:31:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:06 smithi186 ceph-mon[126480]: pgmap v9232: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 397 KiB/s wr, 27 op/s 2023-05-08T08:31:08.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:08 smithi133 ceph-mon[125939]: pgmap v9233: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 299 KiB/s wr, 23 op/s 2023-05-08T08:31:08.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:08 smithi096 ceph-mon[124666]: pgmap v9233: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 299 KiB/s wr, 23 op/s 2023-05-08T08:31:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:08 smithi186 ceph-mon[126480]: pgmap v9233: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 299 KiB/s wr, 23 op/s 2023-05-08T08:31:09.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17207.956746 secs 2023-05-08T08:31:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17208.512764 secs 2023-05-08T08:31:09.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17207.956746 secs 2023-05-08T08:31:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17208.512764 secs 2023-05-08T08:31:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17207.956746 secs 2023-05-08T08:31:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17208.512764 secs 2023-05-08T08:31:10.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:10 smithi133 ceph-mon[125939]: pgmap v9234: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 355 KiB/s wr, 25 op/s 2023-05-08T08:31:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17209.797023 secs 2023-05-08T08:31:10.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:10 smithi096 ceph-mon[124666]: pgmap v9234: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 355 KiB/s wr, 25 op/s 2023-05-08T08:31:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17209.797023 secs 2023-05-08T08:31:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:10 smithi186 ceph-mon[126480]: pgmap v9234: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 355 KiB/s wr, 25 op/s 2023-05-08T08:31:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17209.797023 secs 2023-05-08T08:31:11.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:11 smithi133 ceph-mon[125939]: osdmap e654: 12 total, 12 up, 12 in 2023-05-08T08:31:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:11 smithi133 ceph-mon[125939]: pgmap v9236: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 122 KiB/s wr, 24 op/s 2023-05-08T08:31:11.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:11 smithi096 ceph-mon[124666]: osdmap e654: 12 total, 12 up, 12 in 2023-05-08T08:31:11.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:11 smithi096 ceph-mon[124666]: pgmap v9236: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 122 KiB/s wr, 24 op/s 2023-05-08T08:31:11.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:11 smithi186 ceph-mon[126480]: osdmap e654: 12 total, 12 up, 12 in 2023-05-08T08:31:11.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:11 smithi186 ceph-mon[126480]: pgmap v9236: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 122 KiB/s wr, 24 op/s 2023-05-08T08:31:14.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:14 smithi096 ceph-mon[124666]: pgmap v9237: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 122 KiB/s wr, 24 op/s 2023-05-08T08:31:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17212.956867 secs 2023-05-08T08:31:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17213.512898 secs 2023-05-08T08:31:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:14 smithi186 ceph-mon[126480]: pgmap v9237: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 122 KiB/s wr, 24 op/s 2023-05-08T08:31:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17212.956867 secs 2023-05-08T08:31:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17213.512898 secs 2023-05-08T08:31:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:14 smithi133 ceph-mon[125939]: pgmap v9237: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 122 KiB/s wr, 24 op/s 2023-05-08T08:31:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17212.956867 secs 2023-05-08T08:31:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17213.512898 secs 2023-05-08T08:31:16.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17214.797146 secs 2023-05-08T08:31:16.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:16 smithi186 ceph-mon[126480]: pgmap v9238: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 68 KiB/s wr, 6 op/s 2023-05-08T08:31:16.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17214.797146 secs 2023-05-08T08:31:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:16 smithi133 ceph-mon[125939]: pgmap v9238: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 68 KiB/s wr, 6 op/s 2023-05-08T08:31:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17214.797146 secs 2023-05-08T08:31:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:16 smithi096 ceph-mon[124666]: pgmap v9238: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 68 KiB/s wr, 6 op/s 2023-05-08T08:31:18.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:18 smithi096 ceph-mon[124666]: pgmap v9239: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 68 KiB/s wr, 6 op/s 2023-05-08T08:31:18.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:18 smithi096 ceph-mon[124666]: osdmap e655: 12 total, 12 up, 12 in 2023-05-08T08:31:18.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:18 smithi186 ceph-mon[126480]: pgmap v9239: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 68 KiB/s wr, 6 op/s 2023-05-08T08:31:18.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:18 smithi186 ceph-mon[126480]: osdmap e655: 12 total, 12 up, 12 in 2023-05-08T08:31:18.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:18 smithi133 ceph-mon[125939]: pgmap v9239: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 68 KiB/s wr, 6 op/s 2023-05-08T08:31:18.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:18 smithi133 ceph-mon[125939]: osdmap e655: 12 total, 12 up, 12 in 2023-05-08T08:31:19.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17217.956990 secs 2023-05-08T08:31:19.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17218.513014 secs 2023-05-08T08:31:19.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17217.956990 secs 2023-05-08T08:31:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17218.513014 secs 2023-05-08T08:31:19.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17217.956990 secs 2023-05-08T08:31:19.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17218.513014 secs 2023-05-08T08:31:20.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:20 smithi186 ceph-mon[126480]: pgmap v9241: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 56 KiB/s wr, 7 op/s 2023-05-08T08:31:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:20 smithi133 ceph-mon[125939]: pgmap v9241: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 56 KiB/s wr, 7 op/s 2023-05-08T08:31:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:20 smithi096 ceph-mon[124666]: pgmap v9241: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 56 KiB/s wr, 7 op/s 2023-05-08T08:31:21.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17219.797233 secs 2023-05-08T08:31:21.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17219.797233 secs 2023-05-08T08:31:21.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17219.797233 secs 2023-05-08T08:31:22.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:22 smithi186 ceph-mon[126480]: pgmap v9242: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 49 KiB/s wr, 6 op/s 2023-05-08T08:31:22.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:22 smithi133 ceph-mon[125939]: pgmap v9242: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 49 KiB/s wr, 6 op/s 2023-05-08T08:31:22.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:22 smithi096 ceph-mon[124666]: pgmap v9242: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 49 KiB/s wr, 6 op/s 2023-05-08T08:31:24.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:24 smithi186 ceph-mon[126480]: pgmap v9243: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 49 KiB/s wr, 6 op/s 2023-05-08T08:31:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17222.957106 secs 2023-05-08T08:31:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17223.513135 secs 2023-05-08T08:31:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:24 smithi133 ceph-mon[125939]: pgmap v9243: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 49 KiB/s wr, 6 op/s 2023-05-08T08:31:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17222.957106 secs 2023-05-08T08:31:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17223.513135 secs 2023-05-08T08:31:24.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:24 smithi096 ceph-mon[124666]: pgmap v9243: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 49 KiB/s wr, 6 op/s 2023-05-08T08:31:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17222.957106 secs 2023-05-08T08:31:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17223.513135 secs 2023-05-08T08:31:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17224.797305 secs 2023-05-08T08:31:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:26 smithi186 ceph-mon[126480]: pgmap v9244: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 49 KiB/s wr, 6 op/s 2023-05-08T08:31:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17224.797305 secs 2023-05-08T08:31:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:26 smithi133 ceph-mon[125939]: pgmap v9244: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 49 KiB/s wr, 6 op/s 2023-05-08T08:31:26.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17224.797305 secs 2023-05-08T08:31:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:26 smithi096 ceph-mon[124666]: pgmap v9244: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 49 KiB/s wr, 6 op/s 2023-05-08T08:31:28.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:28 smithi186 ceph-mon[126480]: pgmap v9245: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 49 KiB/s wr, 6 op/s 2023-05-08T08:31:28.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:28 smithi133 ceph-mon[125939]: pgmap v9245: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 49 KiB/s wr, 6 op/s 2023-05-08T08:31:28.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:28 smithi096 ceph-mon[124666]: pgmap v9245: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 49 KiB/s wr, 6 op/s 2023-05-08T08:31:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17227.957223 secs 2023-05-08T08:31:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17228.513277 secs 2023-05-08T08:31:29.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17227.957223 secs 2023-05-08T08:31:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17228.513277 secs 2023-05-08T08:31:29.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17227.957223 secs 2023-05-08T08:31:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17228.513277 secs 2023-05-08T08:31:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:30 smithi186 ceph-mon[126480]: pgmap v9246: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 41 KiB/s wr, 7 op/s 2023-05-08T08:31:30.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:30 smithi133 ceph-mon[125939]: pgmap v9246: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 41 KiB/s wr, 7 op/s 2023-05-08T08:31:30.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:30 smithi096 ceph-mon[124666]: pgmap v9246: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 41 KiB/s wr, 7 op/s 2023-05-08T08:31:31.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17229.797440 secs 2023-05-08T08:31:31.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17229.797440 secs 2023-05-08T08:31:31.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17229.797440 secs 2023-05-08T08:31:32.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:32 smithi186 ceph-mon[126480]: pgmap v9247: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T08:31:32.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:32 smithi133 ceph-mon[125939]: pgmap v9247: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T08:31:32.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:32 smithi096 ceph-mon[124666]: pgmap v9247: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T08:31:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:34 smithi186 ceph-mon[126480]: pgmap v9248: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T08:31:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17232.957368 secs 2023-05-08T08:31:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17233.513430 secs 2023-05-08T08:31:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:34 smithi133 ceph-mon[125939]: pgmap v9248: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T08:31:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17232.957368 secs 2023-05-08T08:31:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17233.513430 secs 2023-05-08T08:31:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:34 smithi096 ceph-mon[124666]: pgmap v9248: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T08:31:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17232.957368 secs 2023-05-08T08:31:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17233.513430 secs 2023-05-08T08:31:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17234.797544 secs 2023-05-08T08:31:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:36 smithi186 ceph-mon[126480]: pgmap v9249: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 767 B/s wr, 8 op/s 2023-05-08T08:31:36.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17234.797544 secs 2023-05-08T08:31:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:36 smithi133 ceph-mon[125939]: pgmap v9249: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 767 B/s wr, 8 op/s 2023-05-08T08:31:36.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17234.797544 secs 2023-05-08T08:31:36.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:36 smithi096 ceph-mon[124666]: pgmap v9249: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 767 B/s wr, 8 op/s 2023-05-08T08:31:38.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:38 smithi186 ceph-mon[126480]: pgmap v9250: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1023 B/s wr, 7 op/s 2023-05-08T08:31:38.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:38 smithi133 ceph-mon[125939]: pgmap v9250: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1023 B/s wr, 7 op/s 2023-05-08T08:31:38.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:38 smithi096 ceph-mon[124666]: pgmap v9250: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1023 B/s wr, 7 op/s 2023-05-08T08:31:39.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17237.957481 secs 2023-05-08T08:31:39.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17238.513561 secs 2023-05-08T08:31:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17237.957481 secs 2023-05-08T08:31:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17238.513561 secs 2023-05-08T08:31:39.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17237.957481 secs 2023-05-08T08:31:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17238.513561 secs 2023-05-08T08:31:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:40 smithi186 ceph-mon[126480]: pgmap v9251: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 125 KiB/s wr, 9 op/s 2023-05-08T08:31:40.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:40 smithi133 ceph-mon[125939]: pgmap v9251: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 125 KiB/s wr, 9 op/s 2023-05-08T08:31:40.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:40 smithi096 ceph-mon[124666]: pgmap v9251: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 125 KiB/s wr, 9 op/s 2023-05-08T08:31:42.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:42 smithi186 ceph-mon[126480]: pgmap v9252: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 134 KiB/s wr, 7 op/s 2023-05-08T08:31:42.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:42 smithi133 ceph-mon[125939]: pgmap v9252: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 134 KiB/s wr, 7 op/s 2023-05-08T08:31:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:42 smithi096 ceph-mon[124666]: pgmap v9252: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 134 KiB/s wr, 7 op/s 2023-05-08T08:31:43.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:31:43.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:31:43.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:31:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:44 smithi186 ceph-mon[126480]: pgmap v9253: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 134 KiB/s wr, 7 op/s 2023-05-08T08:31:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17242.957580 secs 2023-05-08T08:31:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:31:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:31:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:31:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:44 smithi133 ceph-mon[125939]: pgmap v9253: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 134 KiB/s wr, 7 op/s 2023-05-08T08:31:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17242.957580 secs 2023-05-08T08:31:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:31:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:31:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:31:44.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:44 smithi096 ceph-mon[124666]: pgmap v9253: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 134 KiB/s wr, 7 op/s 2023-05-08T08:31:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17242.957580 secs 2023-05-08T08:31:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:31:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:31:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:31:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:31:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:31:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:31:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:31:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:31:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:31:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:31:45.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:31:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:31:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:31:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:31:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:31:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:31:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:31:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:31:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:31:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:31:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:31:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:31:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:31:45.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:31:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:46 smithi186 ceph-mon[126480]: pgmap v9254: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 152 KiB/s wr, 10 op/s 2023-05-08T08:31:46.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:46 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:31:46.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:46 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:31:46.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:46 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:31:46.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:46 smithi133 ceph-mon[125939]: pgmap v9254: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 152 KiB/s wr, 10 op/s 2023-05-08T08:31:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:46 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:31:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:46 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:31:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:46 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:31:46.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:46 smithi096 ceph-mon[124666]: pgmap v9254: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 152 KiB/s wr, 10 op/s 2023-05-08T08:31:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:46 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:31:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:46 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:31:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:46 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:31:47.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:47 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:31:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:47 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T08:31:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:47 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T08:31:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:47 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:31:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:31:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:47 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:31:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:47 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T08:31:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:47 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T08:31:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:47 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:31:47.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:31:47.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:47 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:31:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:47 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T08:31:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:47 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T08:31:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:47 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:31:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:31:48.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:48 smithi186 ceph-mon[126480]: pgmap v9255: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 151 KiB/s wr, 8 op/s 2023-05-08T08:31:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:31:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:31:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:48 smithi133 ceph-mon[125939]: pgmap v9255: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 151 KiB/s wr, 8 op/s 2023-05-08T08:31:48.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:31:48.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:31:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:48 smithi096 ceph-mon[124666]: pgmap v9255: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 151 KiB/s wr, 8 op/s 2023-05-08T08:31:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:31:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:31:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17247.957711 secs 2023-05-08T08:31:49.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17247.957711 secs 2023-05-08T08:31:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17247.957711 secs 2023-05-08T08:31:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:50 smithi186 ceph-mon[126480]: pgmap v9256: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 477 KiB/s rd, 453 KiB/s wr, 12 op/s 2023-05-08T08:31:50.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:50 smithi133 ceph-mon[125939]: pgmap v9256: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 477 KiB/s rd, 453 KiB/s wr, 12 op/s 2023-05-08T08:31:50.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:50 smithi096 ceph-mon[124666]: pgmap v9256: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 477 KiB/s rd, 453 KiB/s wr, 12 op/s 2023-05-08T08:31:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17249.797857 secs 2023-05-08T08:31:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17249.797857 secs 2023-05-08T08:31:51.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17249.797857 secs 2023-05-08T08:31:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:52 smithi186 ceph-mon[126480]: pgmap v9257: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 339 KiB/s wr, 10 op/s 2023-05-08T08:31:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:52 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:31:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:31:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:31:52.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:52 smithi133 ceph-mon[125939]: pgmap v9257: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 339 KiB/s wr, 10 op/s 2023-05-08T08:31:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:52 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:31:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:31:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:31:52.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:52 smithi096 ceph-mon[124666]: pgmap v9257: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 339 KiB/s wr, 10 op/s 2023-05-08T08:31:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:52 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:31:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:31:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:31:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:54 smithi186 ceph-mon[126480]: pgmap v9258: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 330 KiB/s wr, 10 op/s 2023-05-08T08:31:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17252.957840 secs 2023-05-08T08:31:54.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:54 smithi133 ceph-mon[125939]: pgmap v9258: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 330 KiB/s wr, 10 op/s 2023-05-08T08:31:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17252.957840 secs 2023-05-08T08:31:54.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:54 smithi096 ceph-mon[124666]: pgmap v9258: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 330 KiB/s wr, 10 op/s 2023-05-08T08:31:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17252.957840 secs 2023-05-08T08:31:56.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17254.797976 secs 2023-05-08T08:31:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:56 smithi186 ceph-mon[126480]: pgmap v9259: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 508 KiB/s wr, 15 op/s 2023-05-08T08:31:56.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17254.797976 secs 2023-05-08T08:31:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:56 smithi133 ceph-mon[125939]: pgmap v9259: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 508 KiB/s wr, 15 op/s 2023-05-08T08:31:56.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17254.797976 secs 2023-05-08T08:31:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:56 smithi096 ceph-mon[124666]: pgmap v9259: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 508 KiB/s wr, 15 op/s 2023-05-08T08:31:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:58 smithi186 ceph-mon[126480]: pgmap v9260: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 490 KiB/s wr, 12 op/s 2023-05-08T08:31:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:58 smithi133 ceph-mon[125939]: pgmap v9260: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 490 KiB/s wr, 12 op/s 2023-05-08T08:31:58.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:58 smithi096 ceph-mon[124666]: pgmap v9260: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 490 KiB/s wr, 12 op/s 2023-05-08T08:31:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17257.957982 secs 2023-05-08T08:31:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:31:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17258.514090 secs 2023-05-08T08:31:59.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17257.957982 secs 2023-05-08T08:31:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:31:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17258.514090 secs 2023-05-08T08:31:59.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17257.957982 secs 2023-05-08T08:31:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:31:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17258.514090 secs 2023-05-08T08:32:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:00 smithi186 ceph-mon[126480]: pgmap v9261: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 622 KiB/s rd, 649 KiB/s wr, 15 op/s 2023-05-08T08:32:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:00 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:32:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:32:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:32:00.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:00 smithi133 ceph-mon[125939]: pgmap v9261: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 622 KiB/s rd, 649 KiB/s wr, 15 op/s 2023-05-08T08:32:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:00 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:32:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:32:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:32:00.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:00 smithi096 ceph-mon[124666]: pgmap v9261: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 622 KiB/s rd, 649 KiB/s wr, 15 op/s 2023-05-08T08:32:00.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:00 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:32:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:32:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:32:01.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17259.798060 secs 2023-05-08T08:32:01.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17259.798060 secs 2023-05-08T08:32:01.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17259.798060 secs 2023-05-08T08:32:02.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:02 smithi133 ceph-mon[125939]: pgmap v9262: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 347 KiB/s wr, 11 op/s 2023-05-08T08:32:02.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:02 smithi096 ceph-mon[124666]: pgmap v9262: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 347 KiB/s wr, 11 op/s 2023-05-08T08:32:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:02 smithi186 ceph-mon[126480]: pgmap v9262: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 347 KiB/s wr, 11 op/s 2023-05-08T08:32:04.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:04 smithi133 ceph-mon[125939]: pgmap v9263: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 338 KiB/s wr, 10 op/s 2023-05-08T08:32:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17262.958097 secs 2023-05-08T08:32:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17263.514219 secs 2023-05-08T08:32:04.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:04 smithi096 ceph-mon[124666]: pgmap v9263: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 338 KiB/s wr, 10 op/s 2023-05-08T08:32:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17262.958097 secs 2023-05-08T08:32:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17263.514219 secs 2023-05-08T08:32:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:04 smithi186 ceph-mon[126480]: pgmap v9263: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 338 KiB/s wr, 10 op/s 2023-05-08T08:32:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17262.958097 secs 2023-05-08T08:32:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17263.514219 secs 2023-05-08T08:32:06.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17264.798134 secs 2023-05-08T08:32:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:06 smithi133 ceph-mon[125939]: pgmap v9264: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 393 KiB/s rd, 383 KiB/s wr, 27 op/s 2023-05-08T08:32:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17264.798134 secs 2023-05-08T08:32:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:06 smithi096 ceph-mon[124666]: pgmap v9264: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 393 KiB/s rd, 383 KiB/s wr, 27 op/s 2023-05-08T08:32:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17264.798134 secs 2023-05-08T08:32:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:06 smithi186 ceph-mon[126480]: pgmap v9264: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 393 KiB/s rd, 383 KiB/s wr, 27 op/s 2023-05-08T08:32:08.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:08 smithi133 ceph-mon[125939]: pgmap v9265: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 205 KiB/s wr, 23 op/s 2023-05-08T08:32:08.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:08 smithi096 ceph-mon[124666]: pgmap v9265: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 205 KiB/s wr, 23 op/s 2023-05-08T08:32:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:08 smithi186 ceph-mon[126480]: pgmap v9265: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 205 KiB/s wr, 23 op/s 2023-05-08T08:32:09.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17267.958221 secs 2023-05-08T08:32:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17268.514349 secs 2023-05-08T08:32:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17267.958221 secs 2023-05-08T08:32:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17268.514349 secs 2023-05-08T08:32:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17267.958221 secs 2023-05-08T08:32:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17268.514349 secs 2023-05-08T08:32:10.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:10 smithi133 ceph-mon[125939]: pgmap v9266: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 262 KiB/s wr, 24 op/s 2023-05-08T08:32:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17269.798227 secs 2023-05-08T08:32:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:10 smithi096 ceph-mon[124666]: pgmap v9266: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 262 KiB/s wr, 24 op/s 2023-05-08T08:32:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17269.798227 secs 2023-05-08T08:32:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:10 smithi186 ceph-mon[126480]: pgmap v9266: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 262 KiB/s wr, 24 op/s 2023-05-08T08:32:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17269.798227 secs 2023-05-08T08:32:11.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:11 smithi133 ceph-mon[125939]: osdmap e656: 12 total, 12 up, 12 in 2023-05-08T08:32:11.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:11 smithi096 ceph-mon[124666]: osdmap e656: 12 total, 12 up, 12 in 2023-05-08T08:32:11.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:11 smithi186 ceph-mon[126480]: osdmap e656: 12 total, 12 up, 12 in 2023-05-08T08:32:12.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:12 smithi133 ceph-mon[125939]: pgmap v9268: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 122 KiB/s wr, 24 op/s 2023-05-08T08:32:12.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:12 smithi096 ceph-mon[124666]: pgmap v9268: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 122 KiB/s wr, 24 op/s 2023-05-08T08:32:12.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:12 smithi186 ceph-mon[126480]: pgmap v9268: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 122 KiB/s wr, 24 op/s 2023-05-08T08:32:13.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:13 smithi133 ceph-mon[125939]: pgmap v9269: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 122 KiB/s wr, 24 op/s 2023-05-08T08:32:13.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:13 smithi096 ceph-mon[124666]: pgmap v9269: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 122 KiB/s wr, 24 op/s 2023-05-08T08:32:13.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:13 smithi186 ceph-mon[126480]: pgmap v9269: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 122 KiB/s wr, 24 op/s 2023-05-08T08:32:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17272.958323 secs 2023-05-08T08:32:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17273.514510 secs 2023-05-08T08:32:14.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17272.958323 secs 2023-05-08T08:32:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17273.514510 secs 2023-05-08T08:32:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17272.958323 secs 2023-05-08T08:32:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17273.514510 secs 2023-05-08T08:32:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17274.798291 secs 2023-05-08T08:32:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:15 smithi133 ceph-mon[125939]: pgmap v9270: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 68 KiB/s wr, 6 op/s 2023-05-08T08:32:15.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17274.798291 secs 2023-05-08T08:32:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:15 smithi096 ceph-mon[124666]: pgmap v9270: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 68 KiB/s wr, 6 op/s 2023-05-08T08:32:15.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17274.798291 secs 2023-05-08T08:32:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:15 smithi186 ceph-mon[126480]: pgmap v9270: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 68 KiB/s wr, 6 op/s 2023-05-08T08:32:18.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:18 smithi186 ceph-mon[126480]: pgmap v9271: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 68 KiB/s wr, 6 op/s 2023-05-08T08:32:18.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:18 smithi133 ceph-mon[125939]: pgmap v9271: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 68 KiB/s wr, 6 op/s 2023-05-08T08:32:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:18 smithi096 ceph-mon[124666]: pgmap v9271: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 68 KiB/s wr, 6 op/s 2023-05-08T08:32:19.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17277.958458 secs 2023-05-08T08:32:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17278.514627 secs 2023-05-08T08:32:19.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17277.958458 secs 2023-05-08T08:32:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17278.514627 secs 2023-05-08T08:32:19.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17277.958458 secs 2023-05-08T08:32:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17278.514627 secs 2023-05-08T08:32:20.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:20 smithi186 ceph-mon[126480]: pgmap v9272: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:32:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:20 smithi133 ceph-mon[125939]: pgmap v9272: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:32:20.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:20 smithi096 ceph-mon[124666]: pgmap v9272: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:32:21.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17279.798438 secs 2023-05-08T08:32:21.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17279.798438 secs 2023-05-08T08:32:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17279.798438 secs 2023-05-08T08:32:22.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:22 smithi186 ceph-mon[126480]: pgmap v9273: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 283 B/s wr, 6 op/s 2023-05-08T08:32:22.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:22 smithi186 ceph-mon[126480]: osdmap e657: 12 total, 12 up, 12 in 2023-05-08T08:32:22.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:22 smithi133 ceph-mon[125939]: pgmap v9273: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 283 B/s wr, 6 op/s 2023-05-08T08:32:22.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:22 smithi133 ceph-mon[125939]: osdmap e657: 12 total, 12 up, 12 in 2023-05-08T08:32:22.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:22 smithi096 ceph-mon[124666]: pgmap v9273: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 283 B/s wr, 6 op/s 2023-05-08T08:32:22.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:22 smithi096 ceph-mon[124666]: osdmap e657: 12 total, 12 up, 12 in 2023-05-08T08:32:24.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17282.958586 secs 2023-05-08T08:32:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:24 smithi186 ceph-mon[126480]: pgmap v9275: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:32:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17283.514693 secs 2023-05-08T08:32:24.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17282.958586 secs 2023-05-08T08:32:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:24 smithi133 ceph-mon[125939]: pgmap v9275: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:32:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17283.514693 secs 2023-05-08T08:32:24.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17282.958586 secs 2023-05-08T08:32:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:24 smithi096 ceph-mon[124666]: pgmap v9275: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:32:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17283.514693 secs 2023-05-08T08:32:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17284.798581 secs 2023-05-08T08:32:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:26 smithi186 ceph-mon[126480]: pgmap v9276: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T08:32:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17284.798581 secs 2023-05-08T08:32:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:26 smithi133 ceph-mon[125939]: pgmap v9276: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T08:32:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17284.798581 secs 2023-05-08T08:32:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:26 smithi096 ceph-mon[124666]: pgmap v9276: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T08:32:28.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:28 smithi186 ceph-mon[126480]: pgmap v9277: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T08:32:28.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:28 smithi133 ceph-mon[125939]: pgmap v9277: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T08:32:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:28 smithi096 ceph-mon[124666]: pgmap v9277: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T08:32:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17287.958687 secs 2023-05-08T08:32:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17288.514785 secs 2023-05-08T08:32:29.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17287.958687 secs 2023-05-08T08:32:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17288.514785 secs 2023-05-08T08:32:29.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17287.958687 secs 2023-05-08T08:32:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17288.514785 secs 2023-05-08T08:32:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:30 smithi186 ceph-mon[126480]: pgmap v9278: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:32:30.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:30 smithi133 ceph-mon[125939]: pgmap v9278: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:32:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:30 smithi096 ceph-mon[124666]: pgmap v9278: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:32:31.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17289.798726 secs 2023-05-08T08:32:31.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17289.798726 secs 2023-05-08T08:32:31.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17289.798726 secs 2023-05-08T08:32:32.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:32 smithi186 ceph-mon[126480]: pgmap v9279: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:32:32.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:32 smithi133 ceph-mon[125939]: pgmap v9279: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:32:32.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:32 smithi096 ceph-mon[124666]: pgmap v9279: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:32:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17292.958822 secs 2023-05-08T08:32:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:34 smithi186 ceph-mon[126480]: pgmap v9280: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 93 B/s wr, 5 op/s 2023-05-08T08:32:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17293.514905 secs 2023-05-08T08:32:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17292.958822 secs 2023-05-08T08:32:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:34 smithi133 ceph-mon[125939]: pgmap v9280: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 93 B/s wr, 5 op/s 2023-05-08T08:32:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17293.514905 secs 2023-05-08T08:32:34.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17292.958822 secs 2023-05-08T08:32:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:34 smithi096 ceph-mon[124666]: pgmap v9280: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 93 B/s wr, 5 op/s 2023-05-08T08:32:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17293.514905 secs 2023-05-08T08:32:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17294.798820 secs 2023-05-08T08:32:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:36 smithi186 ceph-mon[126480]: pgmap v9281: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 18 KiB/s wr, 8 op/s 2023-05-08T08:32:36.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17294.798820 secs 2023-05-08T08:32:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:36 smithi133 ceph-mon[125939]: pgmap v9281: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 18 KiB/s wr, 8 op/s 2023-05-08T08:32:36.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17294.798820 secs 2023-05-08T08:32:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:36 smithi096 ceph-mon[124666]: pgmap v9281: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 18 KiB/s wr, 8 op/s 2023-05-08T08:32:38.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:38 smithi186 ceph-mon[126480]: pgmap v9282: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 18 KiB/s wr, 7 op/s 2023-05-08T08:32:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:38 smithi133 ceph-mon[125939]: pgmap v9282: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 18 KiB/s wr, 7 op/s 2023-05-08T08:32:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:38 smithi096 ceph-mon[124666]: pgmap v9282: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 18 KiB/s wr, 7 op/s 2023-05-08T08:32:39.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17297.958946 secs 2023-05-08T08:32:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17298.515019 secs 2023-05-08T08:32:39.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17297.958946 secs 2023-05-08T08:32:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17298.515019 secs 2023-05-08T08:32:39.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17297.958946 secs 2023-05-08T08:32:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17298.515019 secs 2023-05-08T08:32:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:40 smithi186 ceph-mon[126480]: pgmap v9283: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 254 KiB/s wr, 10 op/s 2023-05-08T08:32:40.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:40 smithi133 ceph-mon[125939]: pgmap v9283: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 254 KiB/s wr, 10 op/s 2023-05-08T08:32:40.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:40 smithi096 ceph-mon[124666]: pgmap v9283: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 254 KiB/s wr, 10 op/s 2023-05-08T08:32:42.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:42 smithi186 ceph-mon[126480]: pgmap v9284: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 262 KiB/s wr, 8 op/s 2023-05-08T08:32:42.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:42 smithi133 ceph-mon[125939]: pgmap v9284: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 262 KiB/s wr, 8 op/s 2023-05-08T08:32:42.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:42 smithi096 ceph-mon[124666]: pgmap v9284: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 262 KiB/s wr, 8 op/s 2023-05-08T08:32:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:32:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:32:43.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:32:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17302.959083 secs 2023-05-08T08:32:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:44 smithi186 ceph-mon[126480]: pgmap v9285: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 262 KiB/s wr, 8 op/s 2023-05-08T08:32:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:32:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:32:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:32:44.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17303.515144 secs 2023-05-08T08:32:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17302.959083 secs 2023-05-08T08:32:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:44 smithi133 ceph-mon[125939]: pgmap v9285: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 262 KiB/s wr, 8 op/s 2023-05-08T08:32:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:32:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:32:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:32:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17303.515144 secs 2023-05-08T08:32:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17302.959083 secs 2023-05-08T08:32:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:44 smithi096 ceph-mon[124666]: pgmap v9285: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 262 KiB/s wr, 8 op/s 2023-05-08T08:32:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:32:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:32:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:32:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17303.515144 secs 2023-05-08T08:32:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:46 smithi186 ceph-mon[126480]: pgmap v9286: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 279 KiB/s wr, 11 op/s 2023-05-08T08:32:46.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:46 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:32:46.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:46 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:32:46.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:46 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:32:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:46 smithi133 ceph-mon[125939]: pgmap v9286: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 279 KiB/s wr, 11 op/s 2023-05-08T08:32:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:46 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:32:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:46 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:32:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:46 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:32:46.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:46 smithi096 ceph-mon[124666]: pgmap v9286: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 279 KiB/s wr, 11 op/s 2023-05-08T08:32:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:46 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:32:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:46 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:32:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:46 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:32:47.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:47 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:32:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:47 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:32:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:47 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T08:32:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:47 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T08:32:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:47 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:32:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:47 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:32:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:47 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:32:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:47 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T08:32:47.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:47 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T08:32:47.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:47 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:32:47.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:47 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:32:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:47 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:32:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:47 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T08:32:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:47 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T08:32:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:47 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:32:48.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:48 smithi186 ceph-mon[126480]: pgmap v9287: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 262 KiB/s wr, 9 op/s 2023-05-08T08:32:48.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:48 smithi133 ceph-mon[125939]: pgmap v9287: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 262 KiB/s wr, 9 op/s 2023-05-08T08:32:48.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:48 smithi096 ceph-mon[124666]: pgmap v9287: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 262 KiB/s wr, 9 op/s 2023-05-08T08:32:49.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17307.959224 secs 2023-05-08T08:32:49.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17307.959224 secs 2023-05-08T08:32:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17307.959224 secs 2023-05-08T08:32:50.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:50 smithi133 ceph-mon[125939]: pgmap v9288: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 596 KiB/s rd, 567 KiB/s wr, 14 op/s 2023-05-08T08:32:50.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:50 smithi096 ceph-mon[124666]: pgmap v9288: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 596 KiB/s rd, 567 KiB/s wr, 14 op/s 2023-05-08T08:32:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:50 smithi186 ceph-mon[126480]: pgmap v9288: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 596 KiB/s rd, 567 KiB/s wr, 14 op/s 2023-05-08T08:32:51.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17309.799175 secs 2023-05-08T08:32:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:32:51.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17309.799175 secs 2023-05-08T08:32:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:32:51.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17309.799175 secs 2023-05-08T08:32:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:32:52.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:52 smithi133 ceph-mon[125939]: pgmap v9289: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 384 KiB/s rd, 340 KiB/s wr, 10 op/s 2023-05-08T08:32:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:32:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:32:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:32:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:52 smithi096 ceph-mon[124666]: pgmap v9289: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 384 KiB/s rd, 340 KiB/s wr, 10 op/s 2023-05-08T08:32:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:32:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:32:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:32:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:52 smithi186 ceph-mon[126480]: pgmap v9289: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 384 KiB/s rd, 340 KiB/s wr, 10 op/s 2023-05-08T08:32:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:32:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:32:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:32:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17312.959369 secs 2023-05-08T08:32:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:54 smithi133 ceph-mon[125939]: pgmap v9290: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 384 KiB/s rd, 331 KiB/s wr, 10 op/s 2023-05-08T08:32:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17312.959369 secs 2023-05-08T08:32:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:54 smithi096 ceph-mon[124666]: pgmap v9290: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 384 KiB/s rd, 331 KiB/s wr, 10 op/s 2023-05-08T08:32:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17312.959369 secs 2023-05-08T08:32:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:54 smithi186 ceph-mon[126480]: pgmap v9290: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 384 KiB/s rd, 331 KiB/s wr, 10 op/s 2023-05-08T08:32:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17314.799298 secs 2023-05-08T08:32:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:56 smithi133 ceph-mon[125939]: pgmap v9291: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 502 KiB/s rd, 430 KiB/s wr, 14 op/s 2023-05-08T08:32:56.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17314.799298 secs 2023-05-08T08:32:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:56 smithi096 ceph-mon[124666]: pgmap v9291: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 502 KiB/s rd, 430 KiB/s wr, 14 op/s 2023-05-08T08:32:56.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17314.799298 secs 2023-05-08T08:32:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:56 smithi186 ceph-mon[126480]: pgmap v9291: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 502 KiB/s rd, 430 KiB/s wr, 14 op/s 2023-05-08T08:32:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:58 smithi133 ceph-mon[125939]: pgmap v9292: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 553 KiB/s rd, 532 KiB/s wr, 12 op/s 2023-05-08T08:32:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:58 smithi096 ceph-mon[124666]: pgmap v9292: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 553 KiB/s rd, 532 KiB/s wr, 12 op/s 2023-05-08T08:32:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:58 smithi186 ceph-mon[126480]: pgmap v9292: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 553 KiB/s rd, 532 KiB/s wr, 12 op/s 2023-05-08T08:32:59.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17317.959489 secs 2023-05-08T08:32:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:32:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17318.515421 secs 2023-05-08T08:32:59.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17317.959489 secs 2023-05-08T08:32:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:32:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17318.515421 secs 2023-05-08T08:32:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17317.959489 secs 2023-05-08T08:32:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:32:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17318.515421 secs 2023-05-08T08:33:00.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:00 smithi133 ceph-mon[125939]: pgmap v9293: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 605 KiB/s rd, 592 KiB/s wr, 15 op/s 2023-05-08T08:33:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:00 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:33:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:33:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:33:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17319.799425 secs 2023-05-08T08:33:00.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:00 smithi096 ceph-mon[124666]: pgmap v9293: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 605 KiB/s rd, 592 KiB/s wr, 15 op/s 2023-05-08T08:33:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:00 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:33:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:33:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:33:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17319.799425 secs 2023-05-08T08:33:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:00 smithi186 ceph-mon[126480]: pgmap v9293: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 605 KiB/s rd, 592 KiB/s wr, 15 op/s 2023-05-08T08:33:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:00 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:33:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:33:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:33:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17319.799425 secs 2023-05-08T08:33:02.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:02 smithi133 ceph-mon[125939]: pgmap v9294: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 366 KiB/s wr, 11 op/s 2023-05-08T08:33:02.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:02 smithi096 ceph-mon[124666]: pgmap v9294: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 366 KiB/s wr, 11 op/s 2023-05-08T08:33:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:02 smithi186 ceph-mon[126480]: pgmap v9294: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 366 KiB/s wr, 11 op/s 2023-05-08T08:33:04.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17322.959566 secs 2023-05-08T08:33:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:04 smithi133 ceph-mon[125939]: pgmap v9295: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 356 KiB/s wr, 11 op/s 2023-05-08T08:33:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17323.515558 secs 2023-05-08T08:33:04.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17322.959566 secs 2023-05-08T08:33:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:04 smithi096 ceph-mon[124666]: pgmap v9295: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 356 KiB/s wr, 11 op/s 2023-05-08T08:33:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17323.515558 secs 2023-05-08T08:33:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17322.959566 secs 2023-05-08T08:33:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:04 smithi186 ceph-mon[126480]: pgmap v9295: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 356 KiB/s wr, 11 op/s 2023-05-08T08:33:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17323.515558 secs 2023-05-08T08:33:05.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17324.799570 secs 2023-05-08T08:33:05.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17324.799570 secs 2023-05-08T08:33:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17324.799570 secs 2023-05-08T08:33:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:06 smithi133 ceph-mon[125939]: pgmap v9296: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 394 KiB/s rd, 400 KiB/s wr, 27 op/s 2023-05-08T08:33:06.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:06 smithi096 ceph-mon[124666]: pgmap v9296: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 394 KiB/s rd, 400 KiB/s wr, 27 op/s 2023-05-08T08:33:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:06 smithi186 ceph-mon[126480]: pgmap v9296: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 394 KiB/s rd, 400 KiB/s wr, 27 op/s 2023-05-08T08:33:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:08 smithi186 ceph-mon[126480]: pgmap v9297: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 358 KiB/s wr, 24 op/s 2023-05-08T08:33:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:08 smithi133 ceph-mon[125939]: pgmap v9297: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 358 KiB/s wr, 24 op/s 2023-05-08T08:33:08.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:08 smithi096 ceph-mon[124666]: pgmap v9297: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 358 KiB/s wr, 24 op/s 2023-05-08T08:33:09.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17327.959697 secs 2023-05-08T08:33:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17328.515704 secs 2023-05-08T08:33:09.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17327.959697 secs 2023-05-08T08:33:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17328.515704 secs 2023-05-08T08:33:09.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17327.959697 secs 2023-05-08T08:33:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17328.515704 secs 2023-05-08T08:33:10.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:10 smithi186 ceph-mon[126480]: pgmap v9298: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 240 KiB/s wr, 24 op/s 2023-05-08T08:33:10.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:10 smithi133 ceph-mon[125939]: pgmap v9298: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 240 KiB/s wr, 24 op/s 2023-05-08T08:33:10.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:10 smithi096 ceph-mon[124666]: pgmap v9298: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 240 KiB/s wr, 24 op/s 2023-05-08T08:33:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17329.799695 secs 2023-05-08T08:33:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:11 smithi186 ceph-mon[126480]: osdmap e658: 12 total, 12 up, 12 in 2023-05-08T08:33:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17329.799695 secs 2023-05-08T08:33:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:11 smithi133 ceph-mon[125939]: osdmap e658: 12 total, 12 up, 12 in 2023-05-08T08:33:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17329.799695 secs 2023-05-08T08:33:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:11 smithi096 ceph-mon[124666]: osdmap e658: 12 total, 12 up, 12 in 2023-05-08T08:33:12.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:12 smithi186 ceph-mon[126480]: pgmap v9300: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 121 KiB/s wr, 24 op/s 2023-05-08T08:33:12.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:12 smithi133 ceph-mon[125939]: pgmap v9300: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 121 KiB/s wr, 24 op/s 2023-05-08T08:33:12.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:12 smithi096 ceph-mon[124666]: pgmap v9300: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 121 KiB/s wr, 24 op/s 2023-05-08T08:33:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17332.959831 secs 2023-05-08T08:33:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:14 smithi186 ceph-mon[126480]: pgmap v9301: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 121 KiB/s wr, 24 op/s 2023-05-08T08:33:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17333.515849 secs 2023-05-08T08:33:14.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17332.959831 secs 2023-05-08T08:33:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:14 smithi133 ceph-mon[125939]: pgmap v9301: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 121 KiB/s wr, 24 op/s 2023-05-08T08:33:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17333.515849 secs 2023-05-08T08:33:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17332.959831 secs 2023-05-08T08:33:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:14 smithi096 ceph-mon[124666]: pgmap v9301: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 121 KiB/s wr, 24 op/s 2023-05-08T08:33:14.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17333.515849 secs 2023-05-08T08:33:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17334.799819 secs 2023-05-08T08:33:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:16 smithi186 ceph-mon[126480]: pgmap v9302: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 69 KiB/s wr, 6 op/s 2023-05-08T08:33:16.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17334.799819 secs 2023-05-08T08:33:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:16 smithi133 ceph-mon[125939]: pgmap v9302: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 69 KiB/s wr, 6 op/s 2023-05-08T08:33:16.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17334.799819 secs 2023-05-08T08:33:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:16 smithi096 ceph-mon[124666]: pgmap v9302: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 69 KiB/s wr, 6 op/s 2023-05-08T08:33:18.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:18 smithi186 ceph-mon[126480]: pgmap v9303: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 50 KiB/s wr, 6 op/s 2023-05-08T08:33:18.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:18 smithi186 ceph-mon[126480]: osdmap e659: 12 total, 12 up, 12 in 2023-05-08T08:33:18.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:18 smithi133 ceph-mon[125939]: pgmap v9303: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 50 KiB/s wr, 6 op/s 2023-05-08T08:33:18.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:18 smithi133 ceph-mon[125939]: osdmap e659: 12 total, 12 up, 12 in 2023-05-08T08:33:18.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:18 smithi096 ceph-mon[124666]: pgmap v9303: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 50 KiB/s wr, 6 op/s 2023-05-08T08:33:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:18 smithi096 ceph-mon[124666]: osdmap e659: 12 total, 12 up, 12 in 2023-05-08T08:33:19.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17337.959936 secs 2023-05-08T08:33:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17338.515965 secs 2023-05-08T08:33:19.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17337.959936 secs 2023-05-08T08:33:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17338.515965 secs 2023-05-08T08:33:19.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17337.959936 secs 2023-05-08T08:33:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17338.515965 secs 2023-05-08T08:33:20.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:20 smithi186 ceph-mon[126480]: pgmap v9305: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 56 KiB/s wr, 7 op/s 2023-05-08T08:33:20.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:20 smithi133 ceph-mon[125939]: pgmap v9305: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 56 KiB/s wr, 7 op/s 2023-05-08T08:33:20.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:20 smithi096 ceph-mon[124666]: pgmap v9305: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 56 KiB/s wr, 7 op/s 2023-05-08T08:33:21.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17339.800001 secs 2023-05-08T08:33:21.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17339.800001 secs 2023-05-08T08:33:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17339.800001 secs 2023-05-08T08:33:22.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:22 smithi186 ceph-mon[126480]: pgmap v9306: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 50 KiB/s wr, 6 op/s 2023-05-08T08:33:22.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:22 smithi133 ceph-mon[125939]: pgmap v9306: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 50 KiB/s wr, 6 op/s 2023-05-08T08:33:22.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:22 smithi096 ceph-mon[124666]: pgmap v9306: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 50 KiB/s wr, 6 op/s 2023-05-08T08:33:24.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17342.960060 secs 2023-05-08T08:33:24.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:24 smithi186 ceph-mon[126480]: pgmap v9307: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 50 KiB/s wr, 6 op/s 2023-05-08T08:33:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17343.516106 secs 2023-05-08T08:33:24.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17342.960060 secs 2023-05-08T08:33:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:24 smithi133 ceph-mon[125939]: pgmap v9307: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 50 KiB/s wr, 6 op/s 2023-05-08T08:33:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17343.516106 secs 2023-05-08T08:33:24.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17342.960060 secs 2023-05-08T08:33:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:24 smithi096 ceph-mon[124666]: pgmap v9307: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 50 KiB/s wr, 6 op/s 2023-05-08T08:33:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17343.516106 secs 2023-05-08T08:33:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17344.800091 secs 2023-05-08T08:33:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:26 smithi186 ceph-mon[126480]: pgmap v9308: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 50 KiB/s wr, 6 op/s 2023-05-08T08:33:26.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17344.800091 secs 2023-05-08T08:33:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:26 smithi133 ceph-mon[125939]: pgmap v9308: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 50 KiB/s wr, 6 op/s 2023-05-08T08:33:26.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17344.800091 secs 2023-05-08T08:33:26.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:26 smithi096 ceph-mon[124666]: pgmap v9308: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 50 KiB/s wr, 6 op/s 2023-05-08T08:33:28.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:28 smithi186 ceph-mon[126480]: pgmap v9309: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:33:28.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:28 smithi133 ceph-mon[125939]: pgmap v9309: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:33:28.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:28 smithi096 ceph-mon[124666]: pgmap v9309: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:33:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17347.960177 secs 2023-05-08T08:33:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17348.516224 secs 2023-05-08T08:33:29.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17347.960177 secs 2023-05-08T08:33:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17348.516224 secs 2023-05-08T08:33:29.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17347.960177 secs 2023-05-08T08:33:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17348.516224 secs 2023-05-08T08:33:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:30 smithi186 ceph-mon[126480]: pgmap v9310: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 171 B/s wr, 7 op/s 2023-05-08T08:33:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:30 smithi133 ceph-mon[125939]: pgmap v9310: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 171 B/s wr, 7 op/s 2023-05-08T08:33:30.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:30 smithi096 ceph-mon[124666]: pgmap v9310: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 171 B/s wr, 7 op/s 2023-05-08T08:33:31.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17349.800271 secs 2023-05-08T08:33:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17349.800271 secs 2023-05-08T08:33:31.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17349.800271 secs 2023-05-08T08:33:32.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:32 smithi186 ceph-mon[126480]: pgmap v9311: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 6 op/s 2023-05-08T08:33:32.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:32 smithi133 ceph-mon[125939]: pgmap v9311: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 6 op/s 2023-05-08T08:33:32.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:32 smithi096 ceph-mon[124666]: pgmap v9311: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 6 op/s 2023-05-08T08:33:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17352.960276 secs 2023-05-08T08:33:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:34 smithi186 ceph-mon[126480]: pgmap v9312: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T08:33:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17353.516349 secs 2023-05-08T08:33:34.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17352.960276 secs 2023-05-08T08:33:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:34 smithi133 ceph-mon[125939]: pgmap v9312: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T08:33:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17353.516349 secs 2023-05-08T08:33:34.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17352.960276 secs 2023-05-08T08:33:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:34 smithi096 ceph-mon[124666]: pgmap v9312: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T08:33:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17353.516349 secs 2023-05-08T08:33:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17354.800378 secs 2023-05-08T08:33:36.677 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:36 smithi186 ceph-mon[126480]: pgmap v9313: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 682 B/s wr, 8 op/s 2023-05-08T08:33:36.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17354.800378 secs 2023-05-08T08:33:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:36 smithi133 ceph-mon[125939]: pgmap v9313: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 682 B/s wr, 8 op/s 2023-05-08T08:33:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17354.800378 secs 2023-05-08T08:33:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:36 smithi096 ceph-mon[124666]: pgmap v9313: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 682 B/s wr, 8 op/s 2023-05-08T08:33:38.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:38 smithi186 ceph-mon[126480]: pgmap v9314: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 938 B/s wr, 7 op/s 2023-05-08T08:33:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:38 smithi133 ceph-mon[125939]: pgmap v9314: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 938 B/s wr, 7 op/s 2023-05-08T08:33:38.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:38 smithi096 ceph-mon[124666]: pgmap v9314: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 938 B/s wr, 7 op/s 2023-05-08T08:33:39.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17357.960393 secs 2023-05-08T08:33:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17358.516465 secs 2023-05-08T08:33:39.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17357.960393 secs 2023-05-08T08:33:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17358.516465 secs 2023-05-08T08:33:39.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17357.960393 secs 2023-05-08T08:33:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17358.516465 secs 2023-05-08T08:33:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:40 smithi186 ceph-mon[126480]: pgmap v9315: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 160 KiB/s wr, 9 op/s 2023-05-08T08:33:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:40 smithi133 ceph-mon[125939]: pgmap v9315: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 160 KiB/s wr, 9 op/s 2023-05-08T08:33:40.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:40 smithi096 ceph-mon[124666]: pgmap v9315: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 160 KiB/s wr, 9 op/s 2023-05-08T08:33:42.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:42 smithi186 ceph-mon[126480]: pgmap v9316: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 215 KiB/s wr, 8 op/s 2023-05-08T08:33:42.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:42 smithi133 ceph-mon[125939]: pgmap v9316: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 215 KiB/s wr, 8 op/s 2023-05-08T08:33:42.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:42 smithi096 ceph-mon[124666]: pgmap v9316: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 215 KiB/s wr, 8 op/s 2023-05-08T08:33:43.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:33:43.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:33:43.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:33:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17362.960513 secs 2023-05-08T08:33:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:44 smithi186 ceph-mon[126480]: pgmap v9317: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 215 KiB/s wr, 7 op/s 2023-05-08T08:33:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:33:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:33:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:33:44.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17362.960513 secs 2023-05-08T08:33:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:44 smithi133 ceph-mon[125939]: pgmap v9317: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 215 KiB/s wr, 7 op/s 2023-05-08T08:33:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:33:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:33:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:33:44.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17362.960513 secs 2023-05-08T08:33:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:44 smithi096 ceph-mon[124666]: pgmap v9317: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 215 KiB/s wr, 7 op/s 2023-05-08T08:33:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:33:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:33:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:33:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:46 smithi186 ceph-mon[126480]: pgmap v9318: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 231 KiB/s wr, 10 op/s 2023-05-08T08:33:46.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:46 smithi133 ceph-mon[125939]: pgmap v9318: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 231 KiB/s wr, 10 op/s 2023-05-08T08:33:46.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:46 smithi096 ceph-mon[124666]: pgmap v9318: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 231 KiB/s wr, 10 op/s 2023-05-08T08:33:47.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:47 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:33:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:33:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:47 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:33:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:47 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:33:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:47 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:33:47.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:47 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:33:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:33:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:47 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:33:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:47 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:33:47.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:47 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:33:47.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:47 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:33:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:33:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:47 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:33:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:47 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:33:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:47 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:33:48.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:48 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:33:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:48 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T08:33:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:48 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T08:33:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:48 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:33:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:48 smithi186 ceph-mon[126480]: pgmap v9319: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 231 KiB/s wr, 8 op/s 2023-05-08T08:33:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:33:48.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:33:48.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:48 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:33:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:48 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T08:33:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:48 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T08:33:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:48 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:33:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:48 smithi133 ceph-mon[125939]: pgmap v9319: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 231 KiB/s wr, 8 op/s 2023-05-08T08:33:48.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:33:48.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:33:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:48 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:33:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:48 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T08:33:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:48 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T08:33:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:48 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:33:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:48 smithi096 ceph-mon[124666]: pgmap v9319: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 231 KiB/s wr, 8 op/s 2023-05-08T08:33:48.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:33:48.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:33:49.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17367.960659 secs 2023-05-08T08:33:49.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17367.960659 secs 2023-05-08T08:33:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17367.960659 secs 2023-05-08T08:33:50.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:50 smithi133 ceph-mon[125939]: pgmap v9320: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 597 KiB/s rd, 538 KiB/s wr, 12 op/s 2023-05-08T08:33:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:50 smithi096 ceph-mon[124666]: pgmap v9320: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 597 KiB/s rd, 538 KiB/s wr, 12 op/s 2023-05-08T08:33:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:50 smithi186 ceph-mon[126480]: pgmap v9320: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 597 KiB/s rd, 538 KiB/s wr, 12 op/s 2023-05-08T08:33:51.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17369.800805 secs 2023-05-08T08:33:51.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17369.800805 secs 2023-05-08T08:33:51.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17369.800805 secs 2023-05-08T08:33:52.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:52 smithi133 ceph-mon[125939]: pgmap v9321: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 379 KiB/s wr, 10 op/s 2023-05-08T08:33:52.781 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:52 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:33:52.781 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:33:52.781 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:33:52.782 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:52 smithi096 ceph-mon[124666]: pgmap v9321: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 379 KiB/s wr, 10 op/s 2023-05-08T08:33:52.782 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:52 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:33:52.782 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:33:52.782 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:33:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:52 smithi186 ceph-mon[126480]: pgmap v9321: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 379 KiB/s wr, 10 op/s 2023-05-08T08:33:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:52 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:33:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:33:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:33:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17372.960772 secs 2023-05-08T08:33:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:54 smithi133 ceph-mon[125939]: pgmap v9322: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 336 KiB/s rd, 324 KiB/s wr, 9 op/s 2023-05-08T08:33:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17372.960772 secs 2023-05-08T08:33:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:54 smithi096 ceph-mon[124666]: pgmap v9322: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 336 KiB/s rd, 324 KiB/s wr, 9 op/s 2023-05-08T08:33:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17372.960772 secs 2023-05-08T08:33:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:54 smithi186 ceph-mon[126480]: pgmap v9322: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 336 KiB/s rd, 324 KiB/s wr, 9 op/s 2023-05-08T08:33:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17374.800918 secs 2023-05-08T08:33:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:56 smithi133 ceph-mon[125939]: pgmap v9323: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 424 KiB/s wr, 14 op/s 2023-05-08T08:33:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17374.800918 secs 2023-05-08T08:33:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:56 smithi096 ceph-mon[124666]: pgmap v9323: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 424 KiB/s wr, 14 op/s 2023-05-08T08:33:56.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17374.800918 secs 2023-05-08T08:33:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:56 smithi186 ceph-mon[126480]: pgmap v9323: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 424 KiB/s wr, 14 op/s 2023-05-08T08:33:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:58 smithi133 ceph-mon[125939]: pgmap v9324: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 416 KiB/s wr, 11 op/s 2023-05-08T08:33:58.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:58 smithi096 ceph-mon[124666]: pgmap v9324: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 416 KiB/s wr, 11 op/s 2023-05-08T08:33:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:58 smithi186 ceph-mon[126480]: pgmap v9324: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 416 KiB/s wr, 11 op/s 2023-05-08T08:33:59.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17377.960897 secs 2023-05-08T08:33:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:33:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17378.516886 secs 2023-05-08T08:33:59.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17377.960897 secs 2023-05-08T08:33:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:33:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17378.516886 secs 2023-05-08T08:33:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17377.960897 secs 2023-05-08T08:33:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:33:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17378.516886 secs 2023-05-08T08:34:00.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:00 smithi133 ceph-mon[125939]: pgmap v9325: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 670 KiB/s rd, 658 KiB/s wr, 15 op/s 2023-05-08T08:34:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:00 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:34:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:34:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:34:00.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:00 smithi096 ceph-mon[124666]: pgmap v9325: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 670 KiB/s rd, 658 KiB/s wr, 15 op/s 2023-05-08T08:34:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:00 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:34:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:34:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:34:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:00 smithi186 ceph-mon[126480]: pgmap v9325: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 670 KiB/s rd, 658 KiB/s wr, 15 op/s 2023-05-08T08:34:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:00 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:34:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:34:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:34:01.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17379.801033 secs 2023-05-08T08:34:01.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17379.801033 secs 2023-05-08T08:34:01.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17379.801033 secs 2023-05-08T08:34:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:02 smithi133 ceph-mon[125939]: pgmap v9326: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 351 KiB/s wr, 10 op/s 2023-05-08T08:34:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:02 smithi096 ceph-mon[124666]: pgmap v9326: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 351 KiB/s wr, 10 op/s 2023-05-08T08:34:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:02 smithi186 ceph-mon[126480]: pgmap v9326: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 351 KiB/s wr, 10 op/s 2023-05-08T08:34:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17382.961049 secs 2023-05-08T08:34:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:04 smithi133 ceph-mon[125939]: pgmap v9327: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 351 KiB/s wr, 10 op/s 2023-05-08T08:34:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17383.517012 secs 2023-05-08T08:34:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17382.961049 secs 2023-05-08T08:34:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:04 smithi096 ceph-mon[124666]: pgmap v9327: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 351 KiB/s wr, 10 op/s 2023-05-08T08:34:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17383.517012 secs 2023-05-08T08:34:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17382.961049 secs 2023-05-08T08:34:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:04 smithi186 ceph-mon[126480]: pgmap v9327: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 351 KiB/s wr, 10 op/s 2023-05-08T08:34:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17383.517012 secs 2023-05-08T08:34:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17384.801160 secs 2023-05-08T08:34:05.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17384.801160 secs 2023-05-08T08:34:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17384.801160 secs 2023-05-08T08:34:06.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:06 smithi133 ceph-mon[125939]: pgmap v9328: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 396 KiB/s wr, 27 op/s 2023-05-08T08:34:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:06 smithi096 ceph-mon[124666]: pgmap v9328: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 396 KiB/s wr, 27 op/s 2023-05-08T08:34:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:06 smithi186 ceph-mon[126480]: pgmap v9328: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 396 KiB/s wr, 27 op/s 2023-05-08T08:34:08.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:08 smithi133 ceph-mon[125939]: pgmap v9329: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 296 KiB/s wr, 23 op/s 2023-05-08T08:34:08.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:08 smithi096 ceph-mon[124666]: pgmap v9329: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 296 KiB/s wr, 23 op/s 2023-05-08T08:34:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:08 smithi186 ceph-mon[126480]: pgmap v9329: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 296 KiB/s wr, 23 op/s 2023-05-08T08:34:09.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17387.961175 secs 2023-05-08T08:34:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17388.517139 secs 2023-05-08T08:34:09.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17387.961175 secs 2023-05-08T08:34:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17388.517139 secs 2023-05-08T08:34:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17387.961175 secs 2023-05-08T08:34:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17388.517139 secs 2023-05-08T08:34:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:10 smithi133 ceph-mon[125939]: pgmap v9330: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 311 KiB/s rd, 344 KiB/s wr, 24 op/s 2023-05-08T08:34:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17389.801260 secs 2023-05-08T08:34:10.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:10 smithi096 ceph-mon[124666]: pgmap v9330: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 311 KiB/s rd, 344 KiB/s wr, 24 op/s 2023-05-08T08:34:10.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17389.801260 secs 2023-05-08T08:34:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:10 smithi186 ceph-mon[126480]: pgmap v9330: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 311 KiB/s rd, 344 KiB/s wr, 24 op/s 2023-05-08T08:34:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17389.801260 secs 2023-05-08T08:34:11.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:11 smithi133 ceph-mon[125939]: osdmap e660: 12 total, 12 up, 12 in 2023-05-08T08:34:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:11 smithi133 ceph-mon[125939]: pgmap v9332: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 123 KiB/s wr, 24 op/s 2023-05-08T08:34:11.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:11 smithi096 ceph-mon[124666]: osdmap e660: 12 total, 12 up, 12 in 2023-05-08T08:34:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:11 smithi096 ceph-mon[124666]: pgmap v9332: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 123 KiB/s wr, 24 op/s 2023-05-08T08:34:11.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:11 smithi186 ceph-mon[126480]: osdmap e660: 12 total, 12 up, 12 in 2023-05-08T08:34:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:11 smithi186 ceph-mon[126480]: pgmap v9332: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 123 KiB/s wr, 24 op/s 2023-05-08T08:34:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17392.961307 secs 2023-05-08T08:34:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:14 smithi186 ceph-mon[126480]: pgmap v9333: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 123 KiB/s wr, 24 op/s 2023-05-08T08:34:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17393.517265 secs 2023-05-08T08:34:14.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17392.961307 secs 2023-05-08T08:34:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:14 smithi133 ceph-mon[125939]: pgmap v9333: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 123 KiB/s wr, 24 op/s 2023-05-08T08:34:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17393.517265 secs 2023-05-08T08:34:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17392.961307 secs 2023-05-08T08:34:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:14 smithi096 ceph-mon[124666]: pgmap v9333: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 123 KiB/s wr, 24 op/s 2023-05-08T08:34:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17393.517265 secs 2023-05-08T08:34:16.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17394.801356 secs 2023-05-08T08:34:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:16 smithi186 ceph-mon[126480]: pgmap v9334: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 69 KiB/s wr, 6 op/s 2023-05-08T08:34:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17394.801356 secs 2023-05-08T08:34:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:16 smithi133 ceph-mon[125939]: pgmap v9334: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 69 KiB/s wr, 6 op/s 2023-05-08T08:34:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17394.801356 secs 2023-05-08T08:34:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:16 smithi096 ceph-mon[124666]: pgmap v9334: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 69 KiB/s wr, 6 op/s 2023-05-08T08:34:18.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:18 smithi186 ceph-mon[126480]: pgmap v9335: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 69 KiB/s wr, 6 op/s 2023-05-08T08:34:18.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:18 smithi186 ceph-mon[126480]: osdmap e661: 12 total, 12 up, 12 in 2023-05-08T08:34:18.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:18 smithi133 ceph-mon[125939]: pgmap v9335: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 69 KiB/s wr, 6 op/s 2023-05-08T08:34:18.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:18 smithi133 ceph-mon[125939]: osdmap e661: 12 total, 12 up, 12 in 2023-05-08T08:34:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:18 smithi096 ceph-mon[124666]: pgmap v9335: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 69 KiB/s wr, 6 op/s 2023-05-08T08:34:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:18 smithi096 ceph-mon[124666]: osdmap e661: 12 total, 12 up, 12 in 2023-05-08T08:34:19.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17397.961437 secs 2023-05-08T08:34:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17398.517381 secs 2023-05-08T08:34:19.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17397.961437 secs 2023-05-08T08:34:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17398.517381 secs 2023-05-08T08:34:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17397.961437 secs 2023-05-08T08:34:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17398.517381 secs 2023-05-08T08:34:20.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:20 smithi186 ceph-mon[126480]: pgmap v9337: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 348 B/s wr, 7 op/s 2023-05-08T08:34:20.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:20 smithi133 ceph-mon[125939]: pgmap v9337: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 348 B/s wr, 7 op/s 2023-05-08T08:34:20.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:20 smithi096 ceph-mon[124666]: pgmap v9337: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 348 B/s wr, 7 op/s 2023-05-08T08:34:21.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17399.801471 secs 2023-05-08T08:34:21.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17399.801471 secs 2023-05-08T08:34:21.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17399.801471 secs 2023-05-08T08:34:22.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:22 smithi186 ceph-mon[126480]: pgmap v9338: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:34:22.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:22 smithi133 ceph-mon[125939]: pgmap v9338: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:34:22.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:22 smithi096 ceph-mon[124666]: pgmap v9338: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:34:24.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17402.961557 secs 2023-05-08T08:34:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:24 smithi186 ceph-mon[126480]: pgmap v9339: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:34:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17403.517502 secs 2023-05-08T08:34:24.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17402.961557 secs 2023-05-08T08:34:24.776 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:24 smithi133 ceph-mon[125939]: pgmap v9339: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:34:24.776 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17403.517502 secs 2023-05-08T08:34:24.777 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17402.961557 secs 2023-05-08T08:34:24.777 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:24 smithi096 ceph-mon[124666]: pgmap v9339: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:34:24.778 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17403.517502 secs 2023-05-08T08:34:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17404.801611 secs 2023-05-08T08:34:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:26 smithi186 ceph-mon[126480]: pgmap v9340: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T08:34:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17404.801611 secs 2023-05-08T08:34:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:26 smithi133 ceph-mon[125939]: pgmap v9340: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T08:34:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17404.801611 secs 2023-05-08T08:34:26.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:26 smithi096 ceph-mon[124666]: pgmap v9340: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T08:34:28.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:28 smithi186 ceph-mon[126480]: pgmap v9341: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T08:34:28.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:28 smithi133 ceph-mon[125939]: pgmap v9341: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T08:34:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:28 smithi096 ceph-mon[124666]: pgmap v9341: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T08:34:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17407.961679 secs 2023-05-08T08:34:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17408.517618 secs 2023-05-08T08:34:29.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17407.961679 secs 2023-05-08T08:34:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17408.517618 secs 2023-05-08T08:34:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17407.961679 secs 2023-05-08T08:34:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17408.517618 secs 2023-05-08T08:34:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:30 smithi186 ceph-mon[126480]: pgmap v9342: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 256 B/s wr, 7 op/s 2023-05-08T08:34:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:30 smithi133 ceph-mon[125939]: pgmap v9342: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 256 B/s wr, 7 op/s 2023-05-08T08:34:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:30 smithi096 ceph-mon[124666]: pgmap v9342: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 256 B/s wr, 7 op/s 2023-05-08T08:34:31.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17409.801725 secs 2023-05-08T08:34:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17409.801725 secs 2023-05-08T08:34:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17409.801725 secs 2023-05-08T08:34:32.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:32 smithi186 ceph-mon[126480]: pgmap v9343: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T08:34:32.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:32 smithi133 ceph-mon[125939]: pgmap v9343: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T08:34:32.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:32 smithi096 ceph-mon[124666]: pgmap v9343: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T08:34:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17412.961793 secs 2023-05-08T08:34:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:34 smithi186 ceph-mon[126480]: pgmap v9344: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T08:34:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17413.517743 secs 2023-05-08T08:34:34.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17412.961793 secs 2023-05-08T08:34:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:34 smithi133 ceph-mon[125939]: pgmap v9344: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T08:34:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17413.517743 secs 2023-05-08T08:34:34.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17412.961793 secs 2023-05-08T08:34:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:34 smithi096 ceph-mon[124666]: pgmap v9344: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T08:34:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17413.517743 secs 2023-05-08T08:34:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17414.801840 secs 2023-05-08T08:34:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:36 smithi186 ceph-mon[126480]: pgmap v9345: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 682 B/s wr, 8 op/s 2023-05-08T08:34:36.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17414.801840 secs 2023-05-08T08:34:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:36 smithi133 ceph-mon[125939]: pgmap v9345: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 682 B/s wr, 8 op/s 2023-05-08T08:34:36.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17414.801840 secs 2023-05-08T08:34:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:36 smithi096 ceph-mon[124666]: pgmap v9345: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 682 B/s wr, 8 op/s 2023-05-08T08:34:38.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:38 smithi186 ceph-mon[126480]: pgmap v9346: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T08:34:38.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:38 smithi133 ceph-mon[125939]: pgmap v9346: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T08:34:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:38 smithi096 ceph-mon[124666]: pgmap v9346: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T08:34:39.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17417.961916 secs 2023-05-08T08:34:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17418.517841 secs 2023-05-08T08:34:39.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17417.961916 secs 2023-05-08T08:34:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17418.517841 secs 2023-05-08T08:34:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17417.961916 secs 2023-05-08T08:34:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17418.517841 secs 2023-05-08T08:34:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:40 smithi186 ceph-mon[126480]: pgmap v9347: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 177 KiB/s wr, 9 op/s 2023-05-08T08:34:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:40 smithi133 ceph-mon[125939]: pgmap v9347: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 177 KiB/s wr, 9 op/s 2023-05-08T08:34:40.782 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:40 smithi096 ceph-mon[124666]: pgmap v9347: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 177 KiB/s wr, 9 op/s 2023-05-08T08:34:42.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:42 smithi186 ceph-mon[126480]: pgmap v9348: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 186 KiB/s wr, 8 op/s 2023-05-08T08:34:42.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:42 smithi133 ceph-mon[125939]: pgmap v9348: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 186 KiB/s wr, 8 op/s 2023-05-08T08:34:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:42 smithi096 ceph-mon[124666]: pgmap v9348: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 186 KiB/s wr, 8 op/s 2023-05-08T08:34:43.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:34:43.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:34:43.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:34:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17422.961988 secs 2023-05-08T08:34:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:44 smithi186 ceph-mon[126480]: pgmap v9349: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 186 KiB/s wr, 7 op/s 2023-05-08T08:34:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:34:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:34:44.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:34:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17422.961988 secs 2023-05-08T08:34:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:44 smithi133 ceph-mon[125939]: pgmap v9349: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 186 KiB/s wr, 7 op/s 2023-05-08T08:34:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:34:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:34:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:34:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17422.961988 secs 2023-05-08T08:34:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:44 smithi096 ceph-mon[124666]: pgmap v9349: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 186 KiB/s wr, 7 op/s 2023-05-08T08:34:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:34:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:34:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:34:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:46 smithi133 ceph-mon[125939]: pgmap v9350: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 286 KiB/s rd, 282 KiB/s wr, 11 op/s 2023-05-08T08:34:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:46 smithi096 ceph-mon[124666]: pgmap v9350: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 286 KiB/s rd, 282 KiB/s wr, 11 op/s 2023-05-08T08:34:46.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:46 smithi186 ceph-mon[126480]: pgmap v9350: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 286 KiB/s rd, 282 KiB/s wr, 11 op/s 2023-05-08T08:34:47.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:34:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:47 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:34:47.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:34:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:47 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:34:47.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:34:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:47 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:34:48.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:48 smithi133 ceph-mon[125939]: pgmap v9351: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 281 KiB/s wr, 8 op/s 2023-05-08T08:34:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:34:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:34:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:48 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:34:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:48 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:34:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:48 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:34:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:48 smithi096 ceph-mon[124666]: pgmap v9351: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 281 KiB/s wr, 8 op/s 2023-05-08T08:34:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:34:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:34:48.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:48 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:34:48.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:48 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:34:48.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:48 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:34:48.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:48 smithi186 ceph-mon[126480]: pgmap v9351: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 281 KiB/s wr, 8 op/s 2023-05-08T08:34:48.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:34:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:34:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:48 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:34:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:48 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:34:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:48 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:34:49.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:49 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:34:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:49 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T08:34:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:49 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T08:34:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:49 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:34:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17427.962103 secs 2023-05-08T08:34:49.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:49 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:34:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:49 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T08:34:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:49 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T08:34:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:49 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:34:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17427.962103 secs 2023-05-08T08:34:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:49 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:34:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:49 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T08:34:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:49 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T08:34:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:49 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:34:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17427.962103 secs 2023-05-08T08:34:50.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:50 smithi133 ceph-mon[125939]: pgmap v9352: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 525 KiB/s rd, 509 KiB/s wr, 13 op/s 2023-05-08T08:34:50.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:50 smithi096 ceph-mon[124666]: pgmap v9352: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 525 KiB/s rd, 509 KiB/s wr, 13 op/s 2023-05-08T08:34:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:50 smithi186 ceph-mon[126480]: pgmap v9352: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 525 KiB/s rd, 509 KiB/s wr, 13 op/s 2023-05-08T08:34:51.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17429.802226 secs 2023-05-08T08:34:51.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17429.802226 secs 2023-05-08T08:34:51.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17429.802226 secs 2023-05-08T08:34:52.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:52 smithi133 ceph-mon[125939]: pgmap v9353: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 348 KiB/s rd, 342 KiB/s wr, 10 op/s 2023-05-08T08:34:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:52 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:34:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:34:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:34:52.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:52 smithi096 ceph-mon[124666]: pgmap v9353: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 348 KiB/s rd, 342 KiB/s wr, 10 op/s 2023-05-08T08:34:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:52 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:34:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:34:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:34:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:52 smithi186 ceph-mon[126480]: pgmap v9353: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 348 KiB/s rd, 342 KiB/s wr, 10 op/s 2023-05-08T08:34:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:52 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:34:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:34:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:34:54.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17432.962221 secs 2023-05-08T08:34:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:54 smithi133 ceph-mon[125939]: pgmap v9354: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 333 KiB/s wr, 9 op/s 2023-05-08T08:34:54.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17432.962221 secs 2023-05-08T08:34:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:54 smithi096 ceph-mon[124666]: pgmap v9354: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 333 KiB/s wr, 9 op/s 2023-05-08T08:34:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17432.962221 secs 2023-05-08T08:34:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:54 smithi186 ceph-mon[126480]: pgmap v9354: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 333 KiB/s wr, 9 op/s 2023-05-08T08:34:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17434.802311 secs 2023-05-08T08:34:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:56 smithi133 ceph-mon[125939]: pgmap v9355: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 513 KiB/s wr, 14 op/s 2023-05-08T08:34:56.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17434.802311 secs 2023-05-08T08:34:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:56 smithi096 ceph-mon[124666]: pgmap v9355: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 513 KiB/s wr, 14 op/s 2023-05-08T08:34:56.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17434.802311 secs 2023-05-08T08:34:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:56 smithi186 ceph-mon[126480]: pgmap v9355: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 513 KiB/s wr, 14 op/s 2023-05-08T08:34:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:58 smithi133 ceph-mon[125939]: pgmap v9356: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 430 KiB/s rd, 418 KiB/s wr, 11 op/s 2023-05-08T08:34:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:58 smithi096 ceph-mon[124666]: pgmap v9356: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 430 KiB/s rd, 418 KiB/s wr, 11 op/s 2023-05-08T08:34:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:58 smithi186 ceph-mon[126480]: pgmap v9356: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 430 KiB/s rd, 418 KiB/s wr, 11 op/s 2023-05-08T08:34:59.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17437.962352 secs 2023-05-08T08:34:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:34:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17438.518368 secs 2023-05-08T08:34:59.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17437.962352 secs 2023-05-08T08:34:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:34:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17438.518368 secs 2023-05-08T08:34:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17437.962352 secs 2023-05-08T08:34:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:34:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17438.518368 secs 2023-05-08T08:35:00.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:00 smithi133 ceph-mon[125939]: pgmap v9357: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 609 KiB/s rd, 596 KiB/s wr, 15 op/s 2023-05-08T08:35:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:00 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:35:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:35:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:35:00.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:00 smithi096 ceph-mon[124666]: pgmap v9357: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 609 KiB/s rd, 596 KiB/s wr, 15 op/s 2023-05-08T08:35:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:00 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:35:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:35:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:35:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:00 smithi186 ceph-mon[126480]: pgmap v9357: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 609 KiB/s rd, 596 KiB/s wr, 15 op/s 2023-05-08T08:35:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:00 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:35:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:35:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:35:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17439.802430 secs 2023-05-08T08:35:01.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17439.802430 secs 2023-05-08T08:35:01.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17439.802430 secs 2023-05-08T08:35:02.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:02 smithi133 ceph-mon[125939]: pgmap v9358: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 368 KiB/s wr, 10 op/s 2023-05-08T08:35:02.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:02 smithi096 ceph-mon[124666]: pgmap v9358: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 368 KiB/s wr, 10 op/s 2023-05-08T08:35:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:02 smithi186 ceph-mon[126480]: pgmap v9358: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 368 KiB/s wr, 10 op/s 2023-05-08T08:35:04.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17442.962448 secs 2023-05-08T08:35:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:04 smithi133 ceph-mon[125939]: pgmap v9359: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 359 KiB/s wr, 10 op/s 2023-05-08T08:35:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17443.518511 secs 2023-05-08T08:35:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17442.962448 secs 2023-05-08T08:35:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:04 smithi096 ceph-mon[124666]: pgmap v9359: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 359 KiB/s wr, 10 op/s 2023-05-08T08:35:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17443.518511 secs 2023-05-08T08:35:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17442.962448 secs 2023-05-08T08:35:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:04 smithi186 ceph-mon[126480]: pgmap v9359: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 359 KiB/s wr, 10 op/s 2023-05-08T08:35:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17443.518511 secs 2023-05-08T08:35:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17444.802568 secs 2023-05-08T08:35:05.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17444.802568 secs 2023-05-08T08:35:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17444.802568 secs 2023-05-08T08:35:06.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:06 smithi133 ceph-mon[125939]: pgmap v9360: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 404 KiB/s wr, 27 op/s 2023-05-08T08:35:06.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:06 smithi096 ceph-mon[124666]: pgmap v9360: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 404 KiB/s wr, 27 op/s 2023-05-08T08:35:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:06 smithi186 ceph-mon[126480]: pgmap v9360: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 404 KiB/s wr, 27 op/s 2023-05-08T08:35:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:08 smithi133 ceph-mon[125939]: pgmap v9361: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 224 KiB/s wr, 23 op/s 2023-05-08T08:35:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:08 smithi096 ceph-mon[124666]: pgmap v9361: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 224 KiB/s wr, 23 op/s 2023-05-08T08:35:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:08 smithi186 ceph-mon[126480]: pgmap v9361: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 224 KiB/s wr, 23 op/s 2023-05-08T08:35:09.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17447.962563 secs 2023-05-08T08:35:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17448.518628 secs 2023-05-08T08:35:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17447.962563 secs 2023-05-08T08:35:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17448.518628 secs 2023-05-08T08:35:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17447.962563 secs 2023-05-08T08:35:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17448.518628 secs 2023-05-08T08:35:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:10 smithi133 ceph-mon[125939]: pgmap v9362: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 329 KiB/s rd, 362 KiB/s wr, 26 op/s 2023-05-08T08:35:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17449.802706 secs 2023-05-08T08:35:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:10 smithi096 ceph-mon[124666]: pgmap v9362: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 329 KiB/s rd, 362 KiB/s wr, 26 op/s 2023-05-08T08:35:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17449.802706 secs 2023-05-08T08:35:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:10 smithi186 ceph-mon[126480]: pgmap v9362: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 329 KiB/s rd, 362 KiB/s wr, 26 op/s 2023-05-08T08:35:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17449.802706 secs 2023-05-08T08:35:11.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:11 smithi133 ceph-mon[125939]: osdmap e662: 12 total, 12 up, 12 in 2023-05-08T08:35:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:11 smithi133 ceph-mon[125939]: pgmap v9364: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 220 KiB/s wr, 25 op/s 2023-05-08T08:35:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:11 smithi096 ceph-mon[124666]: osdmap e662: 12 total, 12 up, 12 in 2023-05-08T08:35:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:11 smithi096 ceph-mon[124666]: pgmap v9364: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 220 KiB/s wr, 25 op/s 2023-05-08T08:35:11.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:11 smithi186 ceph-mon[126480]: osdmap e662: 12 total, 12 up, 12 in 2023-05-08T08:35:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:11 smithi186 ceph-mon[126480]: pgmap v9364: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 220 KiB/s wr, 25 op/s 2023-05-08T08:35:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17452.962681 secs 2023-05-08T08:35:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:14 smithi186 ceph-mon[126480]: pgmap v9365: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 220 KiB/s wr, 25 op/s 2023-05-08T08:35:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17453.518760 secs 2023-05-08T08:35:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17452.962681 secs 2023-05-08T08:35:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:14 smithi133 ceph-mon[125939]: pgmap v9365: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 220 KiB/s wr, 25 op/s 2023-05-08T08:35:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17453.518760 secs 2023-05-08T08:35:14.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17452.962681 secs 2023-05-08T08:35:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:14 smithi096 ceph-mon[124666]: pgmap v9365: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 220 KiB/s wr, 25 op/s 2023-05-08T08:35:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17453.518760 secs 2023-05-08T08:35:16.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17454.802846 secs 2023-05-08T08:35:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:16 smithi186 ceph-mon[126480]: pgmap v9366: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 166 KiB/s wr, 7 op/s 2023-05-08T08:35:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17454.802846 secs 2023-05-08T08:35:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:16 smithi133 ceph-mon[125939]: pgmap v9366: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 166 KiB/s wr, 7 op/s 2023-05-08T08:35:16.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17454.802846 secs 2023-05-08T08:35:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:16 smithi096 ceph-mon[124666]: pgmap v9366: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 166 KiB/s wr, 7 op/s 2023-05-08T08:35:18.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:18 smithi186 ceph-mon[126480]: pgmap v9367: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 166 KiB/s wr, 7 op/s 2023-05-08T08:35:18.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:18 smithi133 ceph-mon[125939]: pgmap v9367: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 166 KiB/s wr, 7 op/s 2023-05-08T08:35:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:18 smithi096 ceph-mon[124666]: pgmap v9367: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 166 KiB/s wr, 7 op/s 2023-05-08T08:35:19.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17457.962746 secs 2023-05-08T08:35:19.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17458.518908 secs 2023-05-08T08:35:19.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17457.962746 secs 2023-05-08T08:35:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17458.518908 secs 2023-05-08T08:35:19.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17457.962746 secs 2023-05-08T08:35:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17458.518908 secs 2023-05-08T08:35:20.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:20 smithi186 ceph-mon[126480]: pgmap v9368: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 50 KiB/s wr, 6 op/s 2023-05-08T08:35:20.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:20 smithi133 ceph-mon[125939]: pgmap v9368: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 50 KiB/s wr, 6 op/s 2023-05-08T08:35:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:20 smithi096 ceph-mon[124666]: pgmap v9368: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 50 KiB/s wr, 6 op/s 2023-05-08T08:35:21.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17459.802932 secs 2023-05-08T08:35:21.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17459.802932 secs 2023-05-08T08:35:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17459.802932 secs 2023-05-08T08:35:22.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:22 smithi186 ceph-mon[126480]: pgmap v9369: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 46 KiB/s wr, 6 op/s 2023-05-08T08:35:22.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:22 smithi186 ceph-mon[126480]: osdmap e663: 12 total, 12 up, 12 in 2023-05-08T08:35:22.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:22 smithi133 ceph-mon[125939]: pgmap v9369: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 46 KiB/s wr, 6 op/s 2023-05-08T08:35:22.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:22 smithi133 ceph-mon[125939]: osdmap e663: 12 total, 12 up, 12 in 2023-05-08T08:35:22.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:22 smithi096 ceph-mon[124666]: pgmap v9369: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 46 KiB/s wr, 6 op/s 2023-05-08T08:35:22.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:22 smithi096 ceph-mon[124666]: osdmap e663: 12 total, 12 up, 12 in 2023-05-08T08:35:24.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17462.962845 secs 2023-05-08T08:35:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:24 smithi186 ceph-mon[126480]: pgmap v9371: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 50 KiB/s wr, 6 op/s 2023-05-08T08:35:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17463.518985 secs 2023-05-08T08:35:24.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17462.962845 secs 2023-05-08T08:35:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:24 smithi133 ceph-mon[125939]: pgmap v9371: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 50 KiB/s wr, 6 op/s 2023-05-08T08:35:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17463.518985 secs 2023-05-08T08:35:24.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17462.962845 secs 2023-05-08T08:35:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:24 smithi096 ceph-mon[124666]: pgmap v9371: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 50 KiB/s wr, 6 op/s 2023-05-08T08:35:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17463.518985 secs 2023-05-08T08:35:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17464.803046 secs 2023-05-08T08:35:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:26 smithi186 ceph-mon[126480]: pgmap v9372: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 50 KiB/s wr, 6 op/s 2023-05-08T08:35:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17464.803046 secs 2023-05-08T08:35:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:26 smithi133 ceph-mon[125939]: pgmap v9372: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 50 KiB/s wr, 6 op/s 2023-05-08T08:35:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17464.803046 secs 2023-05-08T08:35:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:26 smithi096 ceph-mon[124666]: pgmap v9372: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 50 KiB/s wr, 6 op/s 2023-05-08T08:35:28.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:28 smithi186 ceph-mon[126480]: pgmap v9373: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 50 KiB/s wr, 6 op/s 2023-05-08T08:35:28.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:28 smithi133 ceph-mon[125939]: pgmap v9373: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 50 KiB/s wr, 6 op/s 2023-05-08T08:35:28.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:28 smithi096 ceph-mon[124666]: pgmap v9373: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 50 KiB/s wr, 6 op/s 2023-05-08T08:35:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17467.962963 secs 2023-05-08T08:35:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17468.519111 secs 2023-05-08T08:35:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17467.962963 secs 2023-05-08T08:35:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17468.519111 secs 2023-05-08T08:35:29.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17467.962963 secs 2023-05-08T08:35:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17468.519111 secs 2023-05-08T08:35:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:30 smithi186 ceph-mon[126480]: pgmap v9374: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 818 B/s wr, 7 op/s 2023-05-08T08:35:30.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:30 smithi133 ceph-mon[125939]: pgmap v9374: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 818 B/s wr, 7 op/s 2023-05-08T08:35:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:30 smithi096 ceph-mon[124666]: pgmap v9374: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 818 B/s wr, 7 op/s 2023-05-08T08:35:31.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17469.803114 secs 2023-05-08T08:35:31.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17469.803114 secs 2023-05-08T08:35:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17469.803114 secs 2023-05-08T08:35:32.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:32 smithi133 ceph-mon[125939]: pgmap v9375: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2023-05-08T08:35:32.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:32 smithi096 ceph-mon[124666]: pgmap v9375: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2023-05-08T08:35:32.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:32 smithi186 ceph-mon[126480]: pgmap v9375: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2023-05-08T08:35:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17472.963084 secs 2023-05-08T08:35:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:34 smithi133 ceph-mon[125939]: pgmap v9376: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.0 KiB/s wr, 7 op/s 2023-05-08T08:35:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17473.519249 secs 2023-05-08T08:35:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17472.963084 secs 2023-05-08T08:35:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:34 smithi096 ceph-mon[124666]: pgmap v9376: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.0 KiB/s wr, 7 op/s 2023-05-08T08:35:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17473.519249 secs 2023-05-08T08:35:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17472.963084 secs 2023-05-08T08:35:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:34 smithi186 ceph-mon[126480]: pgmap v9376: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.0 KiB/s wr, 7 op/s 2023-05-08T08:35:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17473.519249 secs 2023-05-08T08:35:36.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17474.803254 secs 2023-05-08T08:35:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:36 smithi133 ceph-mon[125939]: pgmap v9377: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 61 KiB/s wr, 8 op/s 2023-05-08T08:35:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17474.803254 secs 2023-05-08T08:35:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:36 smithi096 ceph-mon[124666]: pgmap v9377: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 61 KiB/s wr, 8 op/s 2023-05-08T08:35:36.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17474.803254 secs 2023-05-08T08:35:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:36 smithi186 ceph-mon[126480]: pgmap v9377: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 61 KiB/s wr, 8 op/s 2023-05-08T08:35:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:38 smithi133 ceph-mon[125939]: pgmap v9378: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 61 KiB/s wr, 6 op/s 2023-05-08T08:35:38.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:38 smithi096 ceph-mon[124666]: pgmap v9378: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 61 KiB/s wr, 6 op/s 2023-05-08T08:35:38.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:38 smithi186 ceph-mon[126480]: pgmap v9378: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 61 KiB/s wr, 6 op/s 2023-05-08T08:35:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17477.963228 secs 2023-05-08T08:35:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17478.519381 secs 2023-05-08T08:35:39.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17477.963228 secs 2023-05-08T08:35:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17478.519381 secs 2023-05-08T08:35:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17477.963228 secs 2023-05-08T08:35:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17478.519381 secs 2023-05-08T08:35:40.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:40 smithi133 ceph-mon[125939]: pgmap v9379: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 9 op/s 2023-05-08T08:35:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:40 smithi096 ceph-mon[124666]: pgmap v9379: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 9 op/s 2023-05-08T08:35:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:40 smithi186 ceph-mon[126480]: pgmap v9379: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 9 op/s 2023-05-08T08:35:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:42 smithi133 ceph-mon[125939]: pgmap v9380: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 61 KiB/s wr, 6 op/s 2023-05-08T08:35:42.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:42 smithi096 ceph-mon[124666]: pgmap v9380: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 61 KiB/s wr, 6 op/s 2023-05-08T08:35:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:42 smithi186 ceph-mon[126480]: pgmap v9380: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 61 KiB/s wr, 6 op/s 2023-05-08T08:35:43.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:35:43.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:35:43.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:35:44.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17482.963366 secs 2023-05-08T08:35:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:44 smithi133 ceph-mon[125939]: pgmap v9381: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 61 KiB/s wr, 6 op/s 2023-05-08T08:35:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:35:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:35:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:35:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17483.519484 secs 2023-05-08T08:35:44.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17482.963366 secs 2023-05-08T08:35:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:44 smithi096 ceph-mon[124666]: pgmap v9381: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 61 KiB/s wr, 6 op/s 2023-05-08T08:35:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:35:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:35:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:35:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17483.519484 secs 2023-05-08T08:35:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17482.963366 secs 2023-05-08T08:35:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:44 smithi186 ceph-mon[126480]: pgmap v9381: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 61 KiB/s wr, 6 op/s 2023-05-08T08:35:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:35:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:35:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:35:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17483.519484 secs 2023-05-08T08:35:46.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:46 smithi133 ceph-mon[125939]: pgmap v9382: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 195 KiB/s wr, 8 op/s 2023-05-08T08:35:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:46 smithi096 ceph-mon[124666]: pgmap v9382: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 195 KiB/s wr, 8 op/s 2023-05-08T08:35:46.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:46 smithi186 ceph-mon[126480]: pgmap v9382: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 195 KiB/s wr, 8 op/s 2023-05-08T08:35:48.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:48 smithi133 ceph-mon[125939]: pgmap v9383: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 144 KiB/s wr, 6 op/s 2023-05-08T08:35:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:48 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:35:48.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:48 smithi096 ceph-mon[124666]: pgmap v9383: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 144 KiB/s wr, 6 op/s 2023-05-08T08:35:48.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:48 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:35:48.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:48 smithi186 ceph-mon[126480]: pgmap v9383: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 144 KiB/s wr, 6 op/s 2023-05-08T08:35:48.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:48 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:35:49.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17487.963462 secs 2023-05-08T08:35:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:49 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:35:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:49 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:35:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:49 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:35:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17488.519552 secs 2023-05-08T08:35:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17487.963462 secs 2023-05-08T08:35:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:49 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:35:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:49 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:35:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:49 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:35:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17488.519552 secs 2023-05-08T08:35:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17487.963462 secs 2023-05-08T08:35:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:49 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:35:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:49 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:35:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:49 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:35:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17488.519552 secs 2023-05-08T08:35:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:50 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:35:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:50 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T08:35:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:50 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T08:35:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:50 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:35:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:50 smithi133 ceph-mon[125939]: pgmap v9384: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 329 KiB/s wr, 10 op/s 2023-05-08T08:35:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:50 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:35:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:50 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T08:35:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:50 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T08:35:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:50 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:35:50.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:50 smithi096 ceph-mon[124666]: pgmap v9384: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 329 KiB/s wr, 10 op/s 2023-05-08T08:35:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:50 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:35:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:50 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T08:35:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:50 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T08:35:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:50 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:35:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:50 smithi186 ceph-mon[126480]: pgmap v9384: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 329 KiB/s wr, 10 op/s 2023-05-08T08:35:52.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:52 smithi133 ceph-mon[125939]: pgmap v9385: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 329 KiB/s wr, 8 op/s 2023-05-08T08:35:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:52 smithi096 ceph-mon[124666]: pgmap v9385: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 329 KiB/s wr, 8 op/s 2023-05-08T08:35:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:52 smithi186 ceph-mon[126480]: pgmap v9385: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 329 KiB/s wr, 8 op/s 2023-05-08T08:35:54.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17492.963580 secs 2023-05-08T08:35:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:54 smithi133 ceph-mon[125939]: pgmap v9386: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 329 KiB/s wr, 8 op/s 2023-05-08T08:35:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17493.519678 secs 2023-05-08T08:35:54.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17492.963580 secs 2023-05-08T08:35:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:54 smithi096 ceph-mon[124666]: pgmap v9386: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 329 KiB/s wr, 8 op/s 2023-05-08T08:35:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17493.519678 secs 2023-05-08T08:35:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17492.963580 secs 2023-05-08T08:35:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:54 smithi186 ceph-mon[126480]: pgmap v9386: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 329 KiB/s wr, 8 op/s 2023-05-08T08:35:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17493.519678 secs 2023-05-08T08:35:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17494.803815 secs 2023-05-08T08:35:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17494.803815 secs 2023-05-08T08:35:55.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17494.803815 secs 2023-05-08T08:35:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:56 smithi133 ceph-mon[125939]: pgmap v9387: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 545 KiB/s rd, 498 KiB/s wr, 12 op/s 2023-05-08T08:35:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:56 smithi096 ceph-mon[124666]: pgmap v9387: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 545 KiB/s rd, 498 KiB/s wr, 12 op/s 2023-05-08T08:35:56.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:56 smithi186 ceph-mon[126480]: pgmap v9387: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 545 KiB/s rd, 498 KiB/s wr, 12 op/s 2023-05-08T08:35:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:58 smithi133 ceph-mon[125939]: pgmap v9388: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 525 KiB/s rd, 565 KiB/s wr, 11 op/s 2023-05-08T08:35:58.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:58 smithi096 ceph-mon[124666]: pgmap v9388: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 525 KiB/s rd, 565 KiB/s wr, 11 op/s 2023-05-08T08:35:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:58 smithi186 ceph-mon[126480]: pgmap v9388: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 525 KiB/s rd, 565 KiB/s wr, 11 op/s 2023-05-08T08:35:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17497.963700 secs 2023-05-08T08:35:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:35:59 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:35:59.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17497.963700 secs 2023-05-08T08:35:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:35:59 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:35:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17497.963700 secs 2023-05-08T08:35:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:35:59 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:36:00.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:00 smithi133 ceph-mon[125939]: pgmap v9389: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 565 KiB/s wr, 15 op/s 2023-05-08T08:36:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:36:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:36:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:36:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17499.803923 secs 2023-05-08T08:36:00.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:00 smithi096 ceph-mon[124666]: pgmap v9389: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 565 KiB/s wr, 15 op/s 2023-05-08T08:36:00.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:36:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:36:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:36:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17499.803923 secs 2023-05-08T08:36:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:00 smithi186 ceph-mon[126480]: pgmap v9389: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 565 KiB/s wr, 15 op/s 2023-05-08T08:36:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:36:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:36:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:36:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17499.803923 secs 2023-05-08T08:36:01.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:01 smithi133 ceph-mon[125939]: pgmap v9390: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 412 KiB/s wr, 12 op/s 2023-05-08T08:36:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:01 smithi096 ceph-mon[124666]: pgmap v9390: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 412 KiB/s wr, 12 op/s 2023-05-08T08:36:01.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:01 smithi186 ceph-mon[126480]: pgmap v9390: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 412 KiB/s wr, 12 op/s 2023-05-08T08:36:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17502.963852 secs 2023-05-08T08:36:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:04 smithi186 ceph-mon[126480]: pgmap v9391: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 412 KiB/s wr, 11 op/s 2023-05-08T08:36:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17503.519889 secs 2023-05-08T08:36:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17502.963852 secs 2023-05-08T08:36:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:04 smithi133 ceph-mon[125939]: pgmap v9391: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 412 KiB/s wr, 11 op/s 2023-05-08T08:36:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17503.519889 secs 2023-05-08T08:36:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17502.963852 secs 2023-05-08T08:36:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:04 smithi096 ceph-mon[124666]: pgmap v9391: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 412 KiB/s wr, 11 op/s 2023-05-08T08:36:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17503.519889 secs 2023-05-08T08:36:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17504.803998 secs 2023-05-08T08:36:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:06 smithi186 ceph-mon[126480]: pgmap v9392: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 411 KiB/s rd, 466 KiB/s wr, 28 op/s 2023-05-08T08:36:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:06 smithi186 ceph-mon[126480]: osdmap e664: 12 total, 12 up, 12 in 2023-05-08T08:36:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17504.803998 secs 2023-05-08T08:36:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:06 smithi133 ceph-mon[125939]: pgmap v9392: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 411 KiB/s rd, 466 KiB/s wr, 28 op/s 2023-05-08T08:36:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:06 smithi133 ceph-mon[125939]: osdmap e664: 12 total, 12 up, 12 in 2023-05-08T08:36:06.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17504.803998 secs 2023-05-08T08:36:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:06 smithi096 ceph-mon[124666]: pgmap v9392: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 411 KiB/s rd, 466 KiB/s wr, 28 op/s 2023-05-08T08:36:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:06 smithi096 ceph-mon[124666]: osdmap e664: 12 total, 12 up, 12 in 2023-05-08T08:36:08.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:08 smithi186 ceph-mon[126480]: pgmap v9394: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 259 KiB/s wr, 29 op/s 2023-05-08T08:36:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:08 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:36:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:36:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:36:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:08 smithi133 ceph-mon[125939]: pgmap v9394: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 259 KiB/s wr, 29 op/s 2023-05-08T08:36:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:08 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:36:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:36:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:36:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:08 smithi096 ceph-mon[124666]: pgmap v9394: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 259 KiB/s wr, 29 op/s 2023-05-08T08:36:08.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:08 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:36:08.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:36:08.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:36:09.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17507.963938 secs 2023-05-08T08:36:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17508.520021 secs 2023-05-08T08:36:09.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17507.963938 secs 2023-05-08T08:36:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17508.520021 secs 2023-05-08T08:36:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17507.963938 secs 2023-05-08T08:36:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17508.520021 secs 2023-05-08T08:36:10.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:10 smithi186 ceph-mon[126480]: pgmap v9395: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 281 KiB/s wr, 28 op/s 2023-05-08T08:36:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:10 smithi133 ceph-mon[125939]: pgmap v9395: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 281 KiB/s wr, 28 op/s 2023-05-08T08:36:10.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:10 smithi096 ceph-mon[124666]: pgmap v9395: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 281 KiB/s wr, 28 op/s 2023-05-08T08:36:11.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17509.804152 secs 2023-05-08T08:36:11.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17509.804152 secs 2023-05-08T08:36:11.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17509.804152 secs 2023-05-08T08:36:12.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:12 smithi186 ceph-mon[126480]: pgmap v9396: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 243 KiB/s wr, 27 op/s 2023-05-08T08:36:12.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:12 smithi186 ceph-mon[126480]: osdmap e665: 12 total, 12 up, 12 in 2023-05-08T08:36:12.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:12 smithi133 ceph-mon[125939]: pgmap v9396: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 243 KiB/s wr, 27 op/s 2023-05-08T08:36:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:12 smithi133 ceph-mon[125939]: osdmap e665: 12 total, 12 up, 12 in 2023-05-08T08:36:12.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:12 smithi096 ceph-mon[124666]: pgmap v9396: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 243 KiB/s wr, 27 op/s 2023-05-08T08:36:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:12 smithi096 ceph-mon[124666]: osdmap e665: 12 total, 12 up, 12 in 2023-05-08T08:36:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17512.964057 secs 2023-05-08T08:36:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:14 smithi186 ceph-mon[126480]: pgmap v9398: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 222 KiB/s wr, 8 op/s 2023-05-08T08:36:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17513.520141 secs 2023-05-08T08:36:14.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17512.964057 secs 2023-05-08T08:36:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:14 smithi133 ceph-mon[125939]: pgmap v9398: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 222 KiB/s wr, 8 op/s 2023-05-08T08:36:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17513.520141 secs 2023-05-08T08:36:14.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17512.964057 secs 2023-05-08T08:36:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:14 smithi096 ceph-mon[124666]: pgmap v9398: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 222 KiB/s wr, 8 op/s 2023-05-08T08:36:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17513.520141 secs 2023-05-08T08:36:16.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17514.804280 secs 2023-05-08T08:36:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:16 smithi186 ceph-mon[126480]: pgmap v9399: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 327 KiB/s wr, 10 op/s 2023-05-08T08:36:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17514.804280 secs 2023-05-08T08:36:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:16 smithi133 ceph-mon[125939]: pgmap v9399: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 327 KiB/s wr, 10 op/s 2023-05-08T08:36:16.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17514.804280 secs 2023-05-08T08:36:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:16 smithi096 ceph-mon[124666]: pgmap v9399: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 327 KiB/s wr, 10 op/s 2023-05-08T08:36:18.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:18 smithi186 ceph-mon[126480]: pgmap v9400: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 181 KiB/s wr, 8 op/s 2023-05-08T08:36:18.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:18 smithi133 ceph-mon[125939]: pgmap v9400: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 181 KiB/s wr, 8 op/s 2023-05-08T08:36:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:18 smithi096 ceph-mon[124666]: pgmap v9400: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 181 KiB/s wr, 8 op/s 2023-05-08T08:36:19.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17517.964154 secs 2023-05-08T08:36:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17518.520286 secs 2023-05-08T08:36:19.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17517.964154 secs 2023-05-08T08:36:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17518.520286 secs 2023-05-08T08:36:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17517.964154 secs 2023-05-08T08:36:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17518.520286 secs 2023-05-08T08:36:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:20 smithi133 ceph-mon[125939]: pgmap v9401: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 148 KiB/s wr, 7 op/s 2023-05-08T08:36:20.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:20 smithi096 ceph-mon[124666]: pgmap v9401: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 148 KiB/s wr, 7 op/s 2023-05-08T08:36:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:20 smithi186 ceph-mon[126480]: pgmap v9401: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 148 KiB/s wr, 7 op/s 2023-05-08T08:36:21.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17519.804411 secs 2023-05-08T08:36:21.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17519.804411 secs 2023-05-08T08:36:21.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17519.804411 secs 2023-05-08T08:36:22.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:22 smithi133 ceph-mon[125939]: pgmap v9402: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 148 KiB/s wr, 6 op/s 2023-05-08T08:36:22.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:22 smithi096 ceph-mon[124666]: pgmap v9402: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 148 KiB/s wr, 6 op/s 2023-05-08T08:36:22.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:22 smithi186 ceph-mon[126480]: pgmap v9402: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 148 KiB/s wr, 6 op/s 2023-05-08T08:36:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17522.964273 secs 2023-05-08T08:36:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:24 smithi133 ceph-mon[125939]: pgmap v9403: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 135 KiB/s wr, 6 op/s 2023-05-08T08:36:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17523.520413 secs 2023-05-08T08:36:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17522.964273 secs 2023-05-08T08:36:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:24 smithi096 ceph-mon[124666]: pgmap v9403: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 135 KiB/s wr, 6 op/s 2023-05-08T08:36:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17523.520413 secs 2023-05-08T08:36:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17522.964273 secs 2023-05-08T08:36:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:24 smithi186 ceph-mon[126480]: pgmap v9403: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 135 KiB/s wr, 6 op/s 2023-05-08T08:36:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17523.520413 secs 2023-05-08T08:36:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17524.804534 secs 2023-05-08T08:36:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:26 smithi133 ceph-mon[125939]: pgmap v9404: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 123 KiB/s wr, 7 op/s 2023-05-08T08:36:26.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17524.804534 secs 2023-05-08T08:36:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:26 smithi096 ceph-mon[124666]: pgmap v9404: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 123 KiB/s wr, 7 op/s 2023-05-08T08:36:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17524.804534 secs 2023-05-08T08:36:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:26 smithi186 ceph-mon[126480]: pgmap v9404: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 123 KiB/s wr, 7 op/s 2023-05-08T08:36:28.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:28 smithi133 ceph-mon[125939]: pgmap v9405: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T08:36:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:28 smithi096 ceph-mon[124666]: pgmap v9405: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T08:36:28.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:28 smithi186 ceph-mon[126480]: pgmap v9405: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T08:36:29.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17527.964411 secs 2023-05-08T08:36:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17528.520552 secs 2023-05-08T08:36:29.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17527.964411 secs 2023-05-08T08:36:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17528.520552 secs 2023-05-08T08:36:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17527.964411 secs 2023-05-08T08:36:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17528.520552 secs 2023-05-08T08:36:30.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:30 smithi133 ceph-mon[125939]: pgmap v9406: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 7 op/s 2023-05-08T08:36:30.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:30 smithi096 ceph-mon[124666]: pgmap v9406: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 7 op/s 2023-05-08T08:36:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:30 smithi186 ceph-mon[126480]: pgmap v9406: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 7 op/s 2023-05-08T08:36:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17529.804662 secs 2023-05-08T08:36:31.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17529.804662 secs 2023-05-08T08:36:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17529.804662 secs 2023-05-08T08:36:32.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:32 smithi133 ceph-mon[125939]: pgmap v9407: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T08:36:32.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:32 smithi096 ceph-mon[124666]: pgmap v9407: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T08:36:32.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:32 smithi186 ceph-mon[126480]: pgmap v9407: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T08:36:34.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17532.964492 secs 2023-05-08T08:36:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:34 smithi133 ceph-mon[125939]: pgmap v9408: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T08:36:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17533.520640 secs 2023-05-08T08:36:34.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17532.964492 secs 2023-05-08T08:36:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:34 smithi096 ceph-mon[124666]: pgmap v9408: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T08:36:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17533.520640 secs 2023-05-08T08:36:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17532.964492 secs 2023-05-08T08:36:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:34 smithi186 ceph-mon[126480]: pgmap v9408: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T08:36:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17533.520640 secs 2023-05-08T08:36:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17534.804804 secs 2023-05-08T08:36:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:36 smithi133 ceph-mon[125939]: pgmap v9409: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 111 KiB/s wr, 8 op/s 2023-05-08T08:36:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17534.804804 secs 2023-05-08T08:36:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:36 smithi096 ceph-mon[124666]: pgmap v9409: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 111 KiB/s wr, 8 op/s 2023-05-08T08:36:36.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17534.804804 secs 2023-05-08T08:36:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:36 smithi186 ceph-mon[126480]: pgmap v9409: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 111 KiB/s wr, 8 op/s 2023-05-08T08:36:38.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:38 smithi133 ceph-mon[125939]: pgmap v9410: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 111 KiB/s wr, 6 op/s 2023-05-08T08:36:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:38 smithi096 ceph-mon[124666]: pgmap v9410: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 111 KiB/s wr, 6 op/s 2023-05-08T08:36:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:38 smithi186 ceph-mon[126480]: pgmap v9410: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 111 KiB/s wr, 6 op/s 2023-05-08T08:36:39.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17537.964612 secs 2023-05-08T08:36:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17538.520719 secs 2023-05-08T08:36:39.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17537.964612 secs 2023-05-08T08:36:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17538.520719 secs 2023-05-08T08:36:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17537.964612 secs 2023-05-08T08:36:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17538.520719 secs 2023-05-08T08:36:40.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:40 smithi133 ceph-mon[125939]: pgmap v9411: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 112 KiB/s wr, 9 op/s 2023-05-08T08:36:40.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:40 smithi096 ceph-mon[124666]: pgmap v9411: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 112 KiB/s wr, 9 op/s 2023-05-08T08:36:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:40 smithi186 ceph-mon[126480]: pgmap v9411: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 112 KiB/s wr, 9 op/s 2023-05-08T08:36:42.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:42 smithi133 ceph-mon[125939]: pgmap v9412: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 111 KiB/s wr, 7 op/s 2023-05-08T08:36:42.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:42 smithi096 ceph-mon[124666]: pgmap v9412: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 111 KiB/s wr, 7 op/s 2023-05-08T08:36:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:42 smithi186 ceph-mon[126480]: pgmap v9412: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 111 KiB/s wr, 7 op/s 2023-05-08T08:36:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:36:43.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:36:43.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:36:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17542.964735 secs 2023-05-08T08:36:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:44 smithi133 ceph-mon[125939]: pgmap v9413: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 111 KiB/s wr, 6 op/s 2023-05-08T08:36:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:36:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:36:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:36:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17543.520846 secs 2023-05-08T08:36:44.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17542.964735 secs 2023-05-08T08:36:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:44 smithi096 ceph-mon[124666]: pgmap v9413: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 111 KiB/s wr, 6 op/s 2023-05-08T08:36:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:36:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:36:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:36:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17543.520846 secs 2023-05-08T08:36:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17542.964735 secs 2023-05-08T08:36:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:44 smithi186 ceph-mon[126480]: pgmap v9413: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 111 KiB/s wr, 6 op/s 2023-05-08T08:36:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:36:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:36:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:36:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17543.520846 secs 2023-05-08T08:36:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:46 smithi133 ceph-mon[125939]: pgmap v9414: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 192 KiB/s wr, 9 op/s 2023-05-08T08:36:46.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:46 smithi096 ceph-mon[124666]: pgmap v9414: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 192 KiB/s wr, 9 op/s 2023-05-08T08:36:46.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:46 smithi186 ceph-mon[126480]: pgmap v9414: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 192 KiB/s wr, 9 op/s 2023-05-08T08:36:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:48 smithi133 ceph-mon[125939]: pgmap v9415: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 91 KiB/s wr, 7 op/s 2023-05-08T08:36:48.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:48 smithi096 ceph-mon[124666]: pgmap v9415: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 91 KiB/s wr, 7 op/s 2023-05-08T08:36:48.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:48 smithi186 ceph-mon[126480]: pgmap v9415: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 91 KiB/s wr, 7 op/s 2023-05-08T08:36:49.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17547.964827 secs 2023-05-08T08:36:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:49 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:36:49.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17547.964827 secs 2023-05-08T08:36:49.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:49 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:36:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17547.964827 secs 2023-05-08T08:36:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:49 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:36:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:50 smithi133 ceph-mon[125939]: pgmap v9416: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 460 KiB/s rd, 331 KiB/s wr, 10 op/s 2023-05-08T08:36:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:36:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:36:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:36:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:50 smithi096 ceph-mon[124666]: pgmap v9416: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 460 KiB/s rd, 331 KiB/s wr, 10 op/s 2023-05-08T08:36:50.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:36:50.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:36:50.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:36:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:50 smithi186 ceph-mon[126480]: pgmap v9416: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 460 KiB/s rd, 331 KiB/s wr, 10 op/s 2023-05-08T08:36:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:36:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:36:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:36:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:51 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:36:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:51 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T08:36:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:51 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T08:36:51.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:51 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:36:51.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:36:51.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:51 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:36:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:51 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T08:36:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:51 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T08:36:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:51 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:36:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:36:51.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:51 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:36:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:51 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T08:36:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:51 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T08:36:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:51 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:36:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:36:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:52 smithi133 ceph-mon[125939]: pgmap v9417: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 407 KiB/s rd, 331 KiB/s wr, 8 op/s 2023-05-08T08:36:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:52 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:36:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:36:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:36:52.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:52 smithi096 ceph-mon[124666]: pgmap v9417: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 407 KiB/s rd, 331 KiB/s wr, 8 op/s 2023-05-08T08:36:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:52 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:36:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:36:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:36:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:52 smithi186 ceph-mon[126480]: pgmap v9417: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 407 KiB/s rd, 331 KiB/s wr, 8 op/s 2023-05-08T08:36:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:52 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:36:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:36:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:36:53.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:53 smithi133 ceph-mon[125939]: pgmap v9418: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 407 KiB/s rd, 331 KiB/s wr, 8 op/s 2023-05-08T08:36:53.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:53 smithi096 ceph-mon[124666]: pgmap v9418: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 407 KiB/s rd, 331 KiB/s wr, 8 op/s 2023-05-08T08:36:53.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:53 smithi186 ceph-mon[126480]: pgmap v9418: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 407 KiB/s rd, 331 KiB/s wr, 8 op/s 2023-05-08T08:36:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17552.964952 secs 2023-05-08T08:36:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17553.521074 secs 2023-05-08T08:36:54.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17552.964952 secs 2023-05-08T08:36:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17553.521074 secs 2023-05-08T08:36:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17552.964952 secs 2023-05-08T08:36:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17553.521074 secs 2023-05-08T08:36:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17554.805321 secs 2023-05-08T08:36:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:55 smithi133 ceph-mon[125939]: pgmap v9419: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 706 KiB/s rd, 618 KiB/s wr, 13 op/s 2023-05-08T08:36:55.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17554.805321 secs 2023-05-08T08:36:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:55 smithi096 ceph-mon[124666]: pgmap v9419: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 706 KiB/s rd, 618 KiB/s wr, 13 op/s 2023-05-08T08:36:55.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17554.805321 secs 2023-05-08T08:36:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:55 smithi186 ceph-mon[126480]: pgmap v9419: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 706 KiB/s rd, 618 KiB/s wr, 13 op/s 2023-05-08T08:36:56.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:36:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:36:56.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:36:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:36:56.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:36:56.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:36:57.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:57 smithi133 ceph-mon[125939]: pgmap v9420: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 579 KiB/s rd, 547 KiB/s wr, 11 op/s 2023-05-08T08:36:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:57 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:36:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:57 smithi096 ceph-mon[124666]: pgmap v9420: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 579 KiB/s rd, 547 KiB/s wr, 11 op/s 2023-05-08T08:36:57.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:57 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:36:57.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:57 smithi186 ceph-mon[126480]: pgmap v9420: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 579 KiB/s rd, 547 KiB/s wr, 11 op/s 2023-05-08T08:36:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:57 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:36:58.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17557.965053 secs 2023-05-08T08:36:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17557.965053 secs 2023-05-08T08:36:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17557.965053 secs 2023-05-08T08:36:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:59 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:36:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:36:59 smithi133 ceph-mon[125939]: pgmap v9421: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 655 KiB/s rd, 621 KiB/s wr, 15 op/s 2023-05-08T08:37:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:59 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:37:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:36:59 smithi096 ceph-mon[124666]: pgmap v9421: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 655 KiB/s rd, 621 KiB/s wr, 15 op/s 2023-05-08T08:37:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:59 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:37:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:36:59 smithi186 ceph-mon[126480]: pgmap v9421: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 655 KiB/s rd, 621 KiB/s wr, 15 op/s 2023-05-08T08:37:00.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:37:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:37:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:37:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17559.805470 secs 2023-05-08T08:37:01.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:37:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:37:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:37:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17559.805470 secs 2023-05-08T08:37:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:37:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:37:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:37:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17559.805470 secs 2023-05-08T08:37:02.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:01 smithi096 ceph-mon[124666]: pgmap v9422: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 394 KiB/s rd, 381 KiB/s wr, 12 op/s 2023-05-08T08:37:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:01 smithi186 ceph-mon[126480]: pgmap v9422: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 394 KiB/s rd, 381 KiB/s wr, 12 op/s 2023-05-08T08:37:02.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:01 smithi133 ceph-mon[125939]: pgmap v9422: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 394 KiB/s rd, 381 KiB/s wr, 12 op/s 2023-05-08T08:37:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17562.965173 secs 2023-05-08T08:37:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:04 smithi186 ceph-mon[126480]: pgmap v9423: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 381 KiB/s wr, 11 op/s 2023-05-08T08:37:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17563.521332 secs 2023-05-08T08:37:04.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17562.965173 secs 2023-05-08T08:37:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:04 smithi133 ceph-mon[125939]: pgmap v9423: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 381 KiB/s wr, 11 op/s 2023-05-08T08:37:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17563.521332 secs 2023-05-08T08:37:04.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17562.965173 secs 2023-05-08T08:37:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:04 smithi096 ceph-mon[124666]: pgmap v9423: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 381 KiB/s wr, 11 op/s 2023-05-08T08:37:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17563.521332 secs 2023-05-08T08:37:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17564.805590 secs 2023-05-08T08:37:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:06 smithi186 ceph-mon[126480]: pgmap v9424: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 658 KiB/s rd, 681 KiB/s wr, 30 op/s 2023-05-08T08:37:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:06 smithi186 ceph-mon[126480]: osdmap e666: 12 total, 12 up, 12 in 2023-05-08T08:37:06.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17564.805590 secs 2023-05-08T08:37:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:06 smithi133 ceph-mon[125939]: pgmap v9424: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 658 KiB/s rd, 681 KiB/s wr, 30 op/s 2023-05-08T08:37:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:06 smithi133 ceph-mon[125939]: osdmap e666: 12 total, 12 up, 12 in 2023-05-08T08:37:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17564.805590 secs 2023-05-08T08:37:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:06 smithi096 ceph-mon[124666]: pgmap v9424: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 658 KiB/s rd, 681 KiB/s wr, 30 op/s 2023-05-08T08:37:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:06 smithi096 ceph-mon[124666]: osdmap e666: 12 total, 12 up, 12 in 2023-05-08T08:37:08.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:08 smithi186 ceph-mon[126480]: pgmap v9426: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 431 KiB/s rd, 461 KiB/s wr, 30 op/s 2023-05-08T08:37:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:08 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:37:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:37:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:37:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:08 smithi133 ceph-mon[125939]: pgmap v9426: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 431 KiB/s rd, 461 KiB/s wr, 30 op/s 2023-05-08T08:37:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:08 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:37:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:37:08.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:37:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:08 smithi096 ceph-mon[124666]: pgmap v9426: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 431 KiB/s rd, 461 KiB/s wr, 30 op/s 2023-05-08T08:37:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:08 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:37:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:37:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:37:09.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17567.965271 secs 2023-05-08T08:37:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17568.521450 secs 2023-05-08T08:37:09.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17567.965271 secs 2023-05-08T08:37:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17568.521450 secs 2023-05-08T08:37:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17567.965271 secs 2023-05-08T08:37:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17568.521450 secs 2023-05-08T08:37:10.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:10 smithi186 ceph-mon[126480]: pgmap v9427: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 411 KiB/s rd, 433 KiB/s wr, 29 op/s 2023-05-08T08:37:10.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:10 smithi133 ceph-mon[125939]: pgmap v9427: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 411 KiB/s rd, 433 KiB/s wr, 29 op/s 2023-05-08T08:37:10.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:10 smithi096 ceph-mon[124666]: pgmap v9427: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 411 KiB/s rd, 433 KiB/s wr, 29 op/s 2023-05-08T08:37:11.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17569.805716 secs 2023-05-08T08:37:11.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17569.805716 secs 2023-05-08T08:37:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17569.805716 secs 2023-05-08T08:37:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:12 smithi133 ceph-mon[125939]: pgmap v9428: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 433 KiB/s wr, 29 op/s 2023-05-08T08:37:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:12 smithi133 ceph-mon[125939]: osdmap e667: 12 total, 12 up, 12 in 2023-05-08T08:37:12.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:12 smithi096 ceph-mon[124666]: pgmap v9428: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 433 KiB/s wr, 29 op/s 2023-05-08T08:37:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:12 smithi096 ceph-mon[124666]: osdmap e667: 12 total, 12 up, 12 in 2023-05-08T08:37:12.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:12 smithi186 ceph-mon[126480]: pgmap v9428: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 433 KiB/s wr, 29 op/s 2023-05-08T08:37:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:12 smithi186 ceph-mon[126480]: osdmap e667: 12 total, 12 up, 12 in 2023-05-08T08:37:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17572.965418 secs 2023-05-08T08:37:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:14 smithi133 ceph-mon[125939]: pgmap v9430: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 91 KiB/s wr, 7 op/s 2023-05-08T08:37:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17573.521575 secs 2023-05-08T08:37:14.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17572.965418 secs 2023-05-08T08:37:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:14 smithi096 ceph-mon[124666]: pgmap v9430: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 91 KiB/s wr, 7 op/s 2023-05-08T08:37:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17573.521575 secs 2023-05-08T08:37:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17572.965418 secs 2023-05-08T08:37:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:14 smithi186 ceph-mon[126480]: pgmap v9430: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 91 KiB/s wr, 7 op/s 2023-05-08T08:37:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17573.521575 secs 2023-05-08T08:37:16.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17574.805861 secs 2023-05-08T08:37:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:16 smithi133 ceph-mon[125939]: pgmap v9431: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 124 KiB/s wr, 9 op/s 2023-05-08T08:37:16.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17574.805861 secs 2023-05-08T08:37:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:16 smithi096 ceph-mon[124666]: pgmap v9431: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 124 KiB/s wr, 9 op/s 2023-05-08T08:37:16.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17574.805861 secs 2023-05-08T08:37:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:16 smithi186 ceph-mon[126480]: pgmap v9431: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 124 KiB/s wr, 9 op/s 2023-05-08T08:37:18.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:18 smithi133 ceph-mon[125939]: pgmap v9432: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 123 KiB/s wr, 9 op/s 2023-05-08T08:37:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:18 smithi096 ceph-mon[124666]: pgmap v9432: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 123 KiB/s wr, 9 op/s 2023-05-08T08:37:18.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:18 smithi186 ceph-mon[126480]: pgmap v9432: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 123 KiB/s wr, 9 op/s 2023-05-08T08:37:19.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17577.965533 secs 2023-05-08T08:37:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17578.521693 secs 2023-05-08T08:37:19.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17577.965533 secs 2023-05-08T08:37:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17578.521693 secs 2023-05-08T08:37:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17577.965533 secs 2023-05-08T08:37:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17578.521693 secs 2023-05-08T08:37:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:20 smithi133 ceph-mon[125939]: pgmap v9433: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 51 KiB/s wr, 6 op/s 2023-05-08T08:37:20.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:20 smithi096 ceph-mon[124666]: pgmap v9433: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 51 KiB/s wr, 6 op/s 2023-05-08T08:37:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:20 smithi186 ceph-mon[126480]: pgmap v9433: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 51 KiB/s wr, 6 op/s 2023-05-08T08:37:21.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17579.805984 secs 2023-05-08T08:37:21.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17579.805984 secs 2023-05-08T08:37:21.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17579.805984 secs 2023-05-08T08:37:22.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:22 smithi133 ceph-mon[125939]: pgmap v9434: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 50 KiB/s wr, 6 op/s 2023-05-08T08:37:22.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:22 smithi096 ceph-mon[124666]: pgmap v9434: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 50 KiB/s wr, 6 op/s 2023-05-08T08:37:22.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:22 smithi186 ceph-mon[126480]: pgmap v9434: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 50 KiB/s wr, 6 op/s 2023-05-08T08:37:24.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17582.965658 secs 2023-05-08T08:37:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:24 smithi133 ceph-mon[125939]: pgmap v9435: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 46 KiB/s wr, 6 op/s 2023-05-08T08:37:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17583.521806 secs 2023-05-08T08:37:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17582.965658 secs 2023-05-08T08:37:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:24 smithi096 ceph-mon[124666]: pgmap v9435: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 46 KiB/s wr, 6 op/s 2023-05-08T08:37:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17583.521806 secs 2023-05-08T08:37:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17582.965658 secs 2023-05-08T08:37:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:24 smithi186 ceph-mon[126480]: pgmap v9435: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 46 KiB/s wr, 6 op/s 2023-05-08T08:37:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17583.521806 secs 2023-05-08T08:37:26.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17584.806109 secs 2023-05-08T08:37:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:26 smithi133 ceph-mon[125939]: pgmap v9436: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 42 KiB/s wr, 7 op/s 2023-05-08T08:37:26.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17584.806109 secs 2023-05-08T08:37:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:26 smithi096 ceph-mon[124666]: pgmap v9436: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 42 KiB/s wr, 7 op/s 2023-05-08T08:37:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17584.806109 secs 2023-05-08T08:37:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:26 smithi186 ceph-mon[126480]: pgmap v9436: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 42 KiB/s wr, 7 op/s 2023-05-08T08:37:28.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:28 smithi133 ceph-mon[125939]: pgmap v9437: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T08:37:28.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:28 smithi096 ceph-mon[124666]: pgmap v9437: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T08:37:28.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:28 smithi186 ceph-mon[126480]: pgmap v9437: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T08:37:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17587.965783 secs 2023-05-08T08:37:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17588.521929 secs 2023-05-08T08:37:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17587.965783 secs 2023-05-08T08:37:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17588.521929 secs 2023-05-08T08:37:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17587.965783 secs 2023-05-08T08:37:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17588.521929 secs 2023-05-08T08:37:30.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:30 smithi133 ceph-mon[125939]: pgmap v9438: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 7 op/s 2023-05-08T08:37:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:30 smithi096 ceph-mon[124666]: pgmap v9438: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 7 op/s 2023-05-08T08:37:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:30 smithi186 ceph-mon[126480]: pgmap v9438: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 7 op/s 2023-05-08T08:37:31.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17589.806211 secs 2023-05-08T08:37:31.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17589.806211 secs 2023-05-08T08:37:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17589.806211 secs 2023-05-08T08:37:32.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:32 smithi133 ceph-mon[125939]: pgmap v9439: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T08:37:32.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:32 smithi096 ceph-mon[124666]: pgmap v9439: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T08:37:32.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:32 smithi186 ceph-mon[126480]: pgmap v9439: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T08:37:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17592.965924 secs 2023-05-08T08:37:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:34 smithi133 ceph-mon[125939]: pgmap v9440: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T08:37:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17593.522078 secs 2023-05-08T08:37:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17592.965924 secs 2023-05-08T08:37:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:34 smithi096 ceph-mon[124666]: pgmap v9440: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T08:37:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17593.522078 secs 2023-05-08T08:37:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17592.965924 secs 2023-05-08T08:37:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:34 smithi186 ceph-mon[126480]: pgmap v9440: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T08:37:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17593.522078 secs 2023-05-08T08:37:36.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17594.806338 secs 2023-05-08T08:37:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:36 smithi133 ceph-mon[125939]: pgmap v9441: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 8 op/s 2023-05-08T08:37:36.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17594.806338 secs 2023-05-08T08:37:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:36 smithi096 ceph-mon[124666]: pgmap v9441: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 8 op/s 2023-05-08T08:37:36.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17594.806338 secs 2023-05-08T08:37:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:36 smithi186 ceph-mon[126480]: pgmap v9441: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 8 op/s 2023-05-08T08:37:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:38 smithi133 ceph-mon[125939]: pgmap v9442: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T08:37:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:38 smithi096 ceph-mon[124666]: pgmap v9442: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T08:37:38.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:38 smithi186 ceph-mon[126480]: pgmap v9442: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T08:37:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17597.966044 secs 2023-05-08T08:37:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17598.522198 secs 2023-05-08T08:37:39.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17597.966044 secs 2023-05-08T08:37:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17598.522198 secs 2023-05-08T08:37:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17597.966044 secs 2023-05-08T08:37:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17598.522198 secs 2023-05-08T08:37:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:40 smithi133 ceph-mon[125939]: pgmap v9443: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 93 KiB/s wr, 9 op/s 2023-05-08T08:37:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:40 smithi096 ceph-mon[124666]: pgmap v9443: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 93 KiB/s wr, 9 op/s 2023-05-08T08:37:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:40 smithi186 ceph-mon[126480]: pgmap v9443: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 93 KiB/s wr, 9 op/s 2023-05-08T08:37:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:42 smithi133 ceph-mon[125939]: pgmap v9444: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 92 KiB/s wr, 7 op/s 2023-05-08T08:37:42.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:42 smithi096 ceph-mon[124666]: pgmap v9444: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 92 KiB/s wr, 7 op/s 2023-05-08T08:37:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:42 smithi186 ceph-mon[126480]: pgmap v9444: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 92 KiB/s wr, 7 op/s 2023-05-08T08:37:43.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:37:43.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:37:43.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:37:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17602.966171 secs 2023-05-08T08:37:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:44 smithi133 ceph-mon[125939]: pgmap v9445: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 92 KiB/s wr, 6 op/s 2023-05-08T08:37:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:37:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:37:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:37:44.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17603.522304 secs 2023-05-08T08:37:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17602.966171 secs 2023-05-08T08:37:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:44 smithi096 ceph-mon[124666]: pgmap v9445: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 92 KiB/s wr, 6 op/s 2023-05-08T08:37:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:37:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:37:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:37:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17603.522304 secs 2023-05-08T08:37:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17602.966171 secs 2023-05-08T08:37:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:44 smithi186 ceph-mon[126480]: pgmap v9445: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 92 KiB/s wr, 6 op/s 2023-05-08T08:37:44.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:37:44.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:37:44.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:37:44.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17603.522304 secs 2023-05-08T08:37:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:46 smithi133 ceph-mon[125939]: pgmap v9446: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 210 KiB/s wr, 10 op/s 2023-05-08T08:37:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:46 smithi096 ceph-mon[124666]: pgmap v9446: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 210 KiB/s wr, 10 op/s 2023-05-08T08:37:46.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:46 smithi186 ceph-mon[126480]: pgmap v9446: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 210 KiB/s wr, 10 op/s 2023-05-08T08:37:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:48 smithi133 ceph-mon[125939]: pgmap v9447: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 158 KiB/s wr, 7 op/s 2023-05-08T08:37:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:48 smithi096 ceph-mon[124666]: pgmap v9447: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 158 KiB/s wr, 7 op/s 2023-05-08T08:37:48.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:48 smithi186 ceph-mon[126480]: pgmap v9447: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 158 KiB/s wr, 7 op/s 2023-05-08T08:37:49.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17607.966293 secs 2023-05-08T08:37:49.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17607.966293 secs 2023-05-08T08:37:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17607.966293 secs 2023-05-08T08:37:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:50 smithi133 ceph-mon[125939]: pgmap v9448: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 449 KiB/s rd, 332 KiB/s wr, 10 op/s 2023-05-08T08:37:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:37:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:37:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:37:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:37:50.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:50 smithi096 ceph-mon[124666]: pgmap v9448: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 449 KiB/s rd, 332 KiB/s wr, 10 op/s 2023-05-08T08:37:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:37:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:37:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:37:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:37:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:50 smithi186 ceph-mon[126480]: pgmap v9448: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 449 KiB/s rd, 332 KiB/s wr, 10 op/s 2023-05-08T08:37:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:37:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:37:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:37:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:37:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:51 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:37:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:51 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T08:37:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:51 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T08:37:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:51 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:37:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:37:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:51 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:37:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:51 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T08:37:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:51 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T08:37:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:51 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:37:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:37:51.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:51 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:37:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:51 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T08:37:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:51 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T08:37:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:51 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:37:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:37:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:52 smithi133 ceph-mon[125939]: pgmap v9449: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 302 KiB/s wr, 8 op/s 2023-05-08T08:37:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:52 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:37:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:37:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:37:52.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:52 smithi096 ceph-mon[124666]: pgmap v9449: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 302 KiB/s wr, 8 op/s 2023-05-08T08:37:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:52 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:37:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:37:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:37:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:52 smithi186 ceph-mon[126480]: pgmap v9449: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 302 KiB/s wr, 8 op/s 2023-05-08T08:37:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:52 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:37:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:37:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:37:54.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17612.966430 secs 2023-05-08T08:37:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:54 smithi133 ceph-mon[125939]: pgmap v9450: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 301 KiB/s wr, 7 op/s 2023-05-08T08:37:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17613.522543 secs 2023-05-08T08:37:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17612.966430 secs 2023-05-08T08:37:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:54 smithi096 ceph-mon[124666]: pgmap v9450: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 301 KiB/s wr, 7 op/s 2023-05-08T08:37:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17613.522543 secs 2023-05-08T08:37:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17612.966430 secs 2023-05-08T08:37:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:54 smithi186 ceph-mon[126480]: pgmap v9450: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 301 KiB/s wr, 7 op/s 2023-05-08T08:37:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17613.522543 secs 2023-05-08T08:37:55.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17614.806802 secs 2023-05-08T08:37:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17614.806802 secs 2023-05-08T08:37:55.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17614.806802 secs 2023-05-08T08:37:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:56 smithi133 ceph-mon[125939]: pgmap v9451: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 666 KiB/s rd, 591 KiB/s wr, 13 op/s 2023-05-08T08:37:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:37:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:37:56.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:56 smithi096 ceph-mon[124666]: pgmap v9451: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 666 KiB/s rd, 591 KiB/s wr, 13 op/s 2023-05-08T08:37:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:37:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:37:56.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:56 smithi186 ceph-mon[126480]: pgmap v9451: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 666 KiB/s rd, 591 KiB/s wr, 13 op/s 2023-05-08T08:37:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:37:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:37:57.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:57 smithi133 ceph-mon[125939]: pgmap v9452: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 487 KiB/s rd, 476 KiB/s wr, 11 op/s 2023-05-08T08:37:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:57 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:37:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:57 smithi096 ceph-mon[124666]: pgmap v9452: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 487 KiB/s rd, 476 KiB/s wr, 11 op/s 2023-05-08T08:37:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:57 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:37:57.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:57 smithi186 ceph-mon[126480]: pgmap v9452: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 487 KiB/s rd, 476 KiB/s wr, 11 op/s 2023-05-08T08:37:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:57 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:37:58.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17617.966553 secs 2023-05-08T08:37:59.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17617.966553 secs 2023-05-08T08:37:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17617.966553 secs 2023-05-08T08:38:00.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:59 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:38:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:37:59 smithi096 ceph-mon[124666]: pgmap v9453: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 577 KiB/s rd, 564 KiB/s wr, 15 op/s 2023-05-08T08:38:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:59 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:38:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:37:59 smithi186 ceph-mon[126480]: pgmap v9453: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 577 KiB/s rd, 564 KiB/s wr, 15 op/s 2023-05-08T08:38:00.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:59 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:38:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:37:59 smithi133 ceph-mon[125939]: pgmap v9453: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 577 KiB/s rd, 564 KiB/s wr, 15 op/s 2023-05-08T08:38:01.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:38:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:38:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:38:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17619.806887 secs 2023-05-08T08:38:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:38:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:38:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:38:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17619.806887 secs 2023-05-08T08:38:01.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:38:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:38:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:38:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17619.806887 secs 2023-05-08T08:38:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:01 smithi096 ceph-mon[124666]: pgmap v9454: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 390 KiB/s wr, 12 op/s 2023-05-08T08:38:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:01 smithi186 ceph-mon[126480]: pgmap v9454: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 390 KiB/s wr, 12 op/s 2023-05-08T08:38:02.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:01 smithi133 ceph-mon[125939]: pgmap v9454: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 390 KiB/s wr, 12 op/s 2023-05-08T08:38:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17622.966672 secs 2023-05-08T08:38:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:04 smithi133 ceph-mon[125939]: pgmap v9455: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 394 KiB/s rd, 390 KiB/s wr, 12 op/s 2023-05-08T08:38:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17623.522733 secs 2023-05-08T08:38:04.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17622.966672 secs 2023-05-08T08:38:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:04 smithi096 ceph-mon[124666]: pgmap v9455: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 394 KiB/s rd, 390 KiB/s wr, 12 op/s 2023-05-08T08:38:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17623.522733 secs 2023-05-08T08:38:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17622.966672 secs 2023-05-08T08:38:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:04 smithi186 ceph-mon[126480]: pgmap v9455: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 394 KiB/s rd, 390 KiB/s wr, 12 op/s 2023-05-08T08:38:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17623.522733 secs 2023-05-08T08:38:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17624.807010 secs 2023-05-08T08:38:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:06 smithi133 ceph-mon[125939]: pgmap v9456: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 640 KiB/s wr, 31 op/s 2023-05-08T08:38:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:06 smithi133 ceph-mon[125939]: osdmap e668: 12 total, 12 up, 12 in 2023-05-08T08:38:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17624.807010 secs 2023-05-08T08:38:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:06 smithi096 ceph-mon[124666]: pgmap v9456: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 640 KiB/s wr, 31 op/s 2023-05-08T08:38:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:06 smithi096 ceph-mon[124666]: osdmap e668: 12 total, 12 up, 12 in 2023-05-08T08:38:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17624.807010 secs 2023-05-08T08:38:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:06 smithi186 ceph-mon[126480]: pgmap v9456: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 640 KiB/s wr, 31 op/s 2023-05-08T08:38:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:06 smithi186 ceph-mon[126480]: osdmap e668: 12 total, 12 up, 12 in 2023-05-08T08:38:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:08 smithi133 ceph-mon[125939]: pgmap v9458: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 418 KiB/s wr, 30 op/s 2023-05-08T08:38:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:08 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:38:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:38:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:38:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:08 smithi096 ceph-mon[124666]: pgmap v9458: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 418 KiB/s wr, 30 op/s 2023-05-08T08:38:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:08 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:38:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:38:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:38:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:08 smithi186 ceph-mon[126480]: pgmap v9458: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 418 KiB/s wr, 30 op/s 2023-05-08T08:38:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:08 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:38:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:38:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:38:09.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17627.966790 secs 2023-05-08T08:38:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17628.522872 secs 2023-05-08T08:38:09.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17627.966790 secs 2023-05-08T08:38:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17628.522872 secs 2023-05-08T08:38:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17627.966790 secs 2023-05-08T08:38:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17628.522872 secs 2023-05-08T08:38:10.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:10 smithi133 ceph-mon[125939]: pgmap v9459: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 372 KiB/s wr, 29 op/s 2023-05-08T08:38:10.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:10 smithi096 ceph-mon[124666]: pgmap v9459: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 372 KiB/s wr, 29 op/s 2023-05-08T08:38:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:10 smithi186 ceph-mon[126480]: pgmap v9459: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 372 KiB/s wr, 29 op/s 2023-05-08T08:38:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17629.807134 secs 2023-05-08T08:38:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17629.807134 secs 2023-05-08T08:38:11.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17629.807134 secs 2023-05-08T08:38:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:12 smithi133 ceph-mon[125939]: pgmap v9460: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 372 KiB/s wr, 29 op/s 2023-05-08T08:38:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:12 smithi133 ceph-mon[125939]: osdmap e669: 12 total, 12 up, 12 in 2023-05-08T08:38:12.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:12 smithi096 ceph-mon[124666]: pgmap v9460: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 372 KiB/s wr, 29 op/s 2023-05-08T08:38:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:12 smithi096 ceph-mon[124666]: osdmap e669: 12 total, 12 up, 12 in 2023-05-08T08:38:12.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:12 smithi186 ceph-mon[126480]: pgmap v9460: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 372 KiB/s wr, 29 op/s 2023-05-08T08:38:12.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:12 smithi186 ceph-mon[126480]: osdmap e669: 12 total, 12 up, 12 in 2023-05-08T08:38:14.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17632.966912 secs 2023-05-08T08:38:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:14 smithi133 ceph-mon[125939]: pgmap v9462: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 89 KiB/s wr, 7 op/s 2023-05-08T08:38:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17633.522998 secs 2023-05-08T08:38:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17632.966912 secs 2023-05-08T08:38:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:14 smithi096 ceph-mon[124666]: pgmap v9462: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 89 KiB/s wr, 7 op/s 2023-05-08T08:38:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17633.522998 secs 2023-05-08T08:38:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17632.966912 secs 2023-05-08T08:38:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:14 smithi186 ceph-mon[126480]: pgmap v9462: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 89 KiB/s wr, 7 op/s 2023-05-08T08:38:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17633.522998 secs 2023-05-08T08:38:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17634.807250 secs 2023-05-08T08:38:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:16 smithi133 ceph-mon[125939]: pgmap v9463: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 311 KiB/s rd, 123 KiB/s wr, 9 op/s 2023-05-08T08:38:16.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17634.807250 secs 2023-05-08T08:38:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:16 smithi096 ceph-mon[124666]: pgmap v9463: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 311 KiB/s rd, 123 KiB/s wr, 9 op/s 2023-05-08T08:38:16.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17634.807250 secs 2023-05-08T08:38:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:16 smithi186 ceph-mon[126480]: pgmap v9463: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 311 KiB/s rd, 123 KiB/s wr, 9 op/s 2023-05-08T08:38:18.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:18 smithi133 ceph-mon[125939]: pgmap v9464: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 122 KiB/s wr, 9 op/s 2023-05-08T08:38:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:18 smithi096 ceph-mon[124666]: pgmap v9464: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 122 KiB/s wr, 9 op/s 2023-05-08T08:38:18.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:18 smithi186 ceph-mon[126480]: pgmap v9464: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 122 KiB/s wr, 9 op/s 2023-05-08T08:38:19.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17637.967052 secs 2023-05-08T08:38:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17638.523119 secs 2023-05-08T08:38:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17637.967052 secs 2023-05-08T08:38:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17638.523119 secs 2023-05-08T08:38:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17637.967052 secs 2023-05-08T08:38:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17638.523119 secs 2023-05-08T08:38:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:20 smithi133 ceph-mon[125939]: pgmap v9465: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 6 op/s 2023-05-08T08:38:20.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:20 smithi096 ceph-mon[124666]: pgmap v9465: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 6 op/s 2023-05-08T08:38:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:20 smithi186 ceph-mon[126480]: pgmap v9465: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 6 op/s 2023-05-08T08:38:21.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17639.807368 secs 2023-05-08T08:38:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17639.807368 secs 2023-05-08T08:38:21.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17639.807368 secs 2023-05-08T08:38:22.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:22 smithi133 ceph-mon[125939]: pgmap v9466: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 6 op/s 2023-05-08T08:38:22.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:22 smithi096 ceph-mon[124666]: pgmap v9466: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 6 op/s 2023-05-08T08:38:22.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:22 smithi186 ceph-mon[126480]: pgmap v9466: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 6 op/s 2023-05-08T08:38:24.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17642.967177 secs 2023-05-08T08:38:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:24 smithi133 ceph-mon[125939]: pgmap v9467: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 46 KiB/s wr, 6 op/s 2023-05-08T08:38:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17643.523228 secs 2023-05-08T08:38:24.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17642.967177 secs 2023-05-08T08:38:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:24 smithi096 ceph-mon[124666]: pgmap v9467: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 46 KiB/s wr, 6 op/s 2023-05-08T08:38:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17643.523228 secs 2023-05-08T08:38:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17642.967177 secs 2023-05-08T08:38:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:24 smithi186 ceph-mon[126480]: pgmap v9467: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 46 KiB/s wr, 6 op/s 2023-05-08T08:38:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17643.523228 secs 2023-05-08T08:38:26.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17644.807485 secs 2023-05-08T08:38:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:26 smithi133 ceph-mon[125939]: pgmap v9468: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 42 KiB/s wr, 7 op/s 2023-05-08T08:38:26.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17644.807485 secs 2023-05-08T08:38:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:26 smithi096 ceph-mon[124666]: pgmap v9468: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 42 KiB/s wr, 7 op/s 2023-05-08T08:38:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17644.807485 secs 2023-05-08T08:38:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:26 smithi186 ceph-mon[126480]: pgmap v9468: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 42 KiB/s wr, 7 op/s 2023-05-08T08:38:28.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:28 smithi133 ceph-mon[125939]: pgmap v9469: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T08:38:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:28 smithi096 ceph-mon[124666]: pgmap v9469: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T08:38:28.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:28 smithi186 ceph-mon[126480]: pgmap v9469: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T08:38:29.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17647.967297 secs 2023-05-08T08:38:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17648.523370 secs 2023-05-08T08:38:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17647.967297 secs 2023-05-08T08:38:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17648.523370 secs 2023-05-08T08:38:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17647.967297 secs 2023-05-08T08:38:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17648.523370 secs 2023-05-08T08:38:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:30 smithi133 ceph-mon[125939]: pgmap v9470: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T08:38:30.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:30 smithi096 ceph-mon[124666]: pgmap v9470: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T08:38:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:30 smithi186 ceph-mon[126480]: pgmap v9470: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T08:38:31.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17649.807607 secs 2023-05-08T08:38:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17649.807607 secs 2023-05-08T08:38:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17649.807607 secs 2023-05-08T08:38:32.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:32 smithi133 ceph-mon[125939]: pgmap v9471: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T08:38:32.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:32 smithi096 ceph-mon[124666]: pgmap v9471: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T08:38:32.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:32 smithi186 ceph-mon[126480]: pgmap v9471: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T08:38:34.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17652.967409 secs 2023-05-08T08:38:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:34 smithi133 ceph-mon[125939]: pgmap v9472: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T08:38:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17653.523516 secs 2023-05-08T08:38:34.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17652.967409 secs 2023-05-08T08:38:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:34 smithi096 ceph-mon[124666]: pgmap v9472: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T08:38:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17653.523516 secs 2023-05-08T08:38:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17652.967409 secs 2023-05-08T08:38:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:34 smithi186 ceph-mon[126480]: pgmap v9472: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T08:38:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17653.523516 secs 2023-05-08T08:38:35.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17654.807723 secs 2023-05-08T08:38:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17654.807723 secs 2023-05-08T08:38:35.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17654.807723 secs 2023-05-08T08:38:36.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:36 smithi133 ceph-mon[125939]: pgmap v9473: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 112 KiB/s wr, 9 op/s 2023-05-08T08:38:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:36 smithi096 ceph-mon[124666]: pgmap v9473: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 112 KiB/s wr, 9 op/s 2023-05-08T08:38:36.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:36 smithi186 ceph-mon[126480]: pgmap v9473: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 112 KiB/s wr, 9 op/s 2023-05-08T08:38:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:38 smithi133 ceph-mon[125939]: pgmap v9474: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 112 KiB/s wr, 6 op/s 2023-05-08T08:38:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:38 smithi096 ceph-mon[124666]: pgmap v9474: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 112 KiB/s wr, 6 op/s 2023-05-08T08:38:38.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:38 smithi186 ceph-mon[126480]: pgmap v9474: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 112 KiB/s wr, 6 op/s 2023-05-08T08:38:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17657.967528 secs 2023-05-08T08:38:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17658.523623 secs 2023-05-08T08:38:39.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17657.967528 secs 2023-05-08T08:38:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17658.523623 secs 2023-05-08T08:38:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17657.967528 secs 2023-05-08T08:38:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17658.523623 secs 2023-05-08T08:38:40.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:40 smithi133 ceph-mon[125939]: pgmap v9475: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 113 KiB/s wr, 10 op/s 2023-05-08T08:38:40.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:40 smithi096 ceph-mon[124666]: pgmap v9475: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 113 KiB/s wr, 10 op/s 2023-05-08T08:38:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:40 smithi186 ceph-mon[126480]: pgmap v9475: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 113 KiB/s wr, 10 op/s 2023-05-08T08:38:41.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:41 smithi133 ceph-mon[125939]: pgmap v9476: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 112 KiB/s wr, 7 op/s 2023-05-08T08:38:41.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:41 smithi096 ceph-mon[124666]: pgmap v9476: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 112 KiB/s wr, 7 op/s 2023-05-08T08:38:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:41 smithi186 ceph-mon[126480]: pgmap v9476: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 112 KiB/s wr, 7 op/s 2023-05-08T08:38:43.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:38:43.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:38:43.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:38:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17662.967620 secs 2023-05-08T08:38:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:44 smithi133 ceph-mon[125939]: pgmap v9477: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 112 KiB/s wr, 7 op/s 2023-05-08T08:38:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:38:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:38:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:38:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17663.523752 secs 2023-05-08T08:38:44.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17662.967620 secs 2023-05-08T08:38:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:44 smithi096 ceph-mon[124666]: pgmap v9477: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 112 KiB/s wr, 7 op/s 2023-05-08T08:38:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:38:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:38:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:38:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17663.523752 secs 2023-05-08T08:38:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17662.967620 secs 2023-05-08T08:38:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:44 smithi186 ceph-mon[126480]: pgmap v9477: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 112 KiB/s wr, 7 op/s 2023-05-08T08:38:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:38:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:38:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:38:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17663.523752 secs 2023-05-08T08:38:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:46 smithi133 ceph-mon[125939]: pgmap v9478: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 261 KiB/s wr, 10 op/s 2023-05-08T08:38:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:46 smithi096 ceph-mon[124666]: pgmap v9478: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 261 KiB/s wr, 10 op/s 2023-05-08T08:38:46.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:46 smithi186 ceph-mon[126480]: pgmap v9478: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 261 KiB/s wr, 10 op/s 2023-05-08T08:38:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:48 smithi133 ceph-mon[125939]: pgmap v9479: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 149 KiB/s wr, 6 op/s 2023-05-08T08:38:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:48 smithi096 ceph-mon[124666]: pgmap v9479: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 149 KiB/s wr, 6 op/s 2023-05-08T08:38:48.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:48 smithi186 ceph-mon[126480]: pgmap v9479: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 149 KiB/s wr, 6 op/s 2023-05-08T08:38:49.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17667.967749 secs 2023-05-08T08:38:49.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17667.967749 secs 2023-05-08T08:38:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17667.967749 secs 2023-05-08T08:38:50.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:50 smithi133 ceph-mon[125939]: pgmap v9480: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 455 KiB/s rd, 415 KiB/s wr, 11 op/s 2023-05-08T08:38:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:38:50.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:50 smithi096 ceph-mon[124666]: pgmap v9480: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 455 KiB/s rd, 415 KiB/s wr, 11 op/s 2023-05-08T08:38:50.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:38:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:50 smithi186 ceph-mon[126480]: pgmap v9480: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 455 KiB/s rd, 415 KiB/s wr, 11 op/s 2023-05-08T08:38:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:38:51.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:38:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:38:51.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:38:52.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:52 smithi133 ceph-mon[125939]: pgmap v9481: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 415 KiB/s wr, 7 op/s 2023-05-08T08:38:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:52 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:38:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:38:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:38:52.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:52 smithi096 ceph-mon[124666]: pgmap v9481: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 415 KiB/s wr, 7 op/s 2023-05-08T08:38:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:52 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:38:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:38:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:38:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:52 smithi186 ceph-mon[126480]: pgmap v9481: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 415 KiB/s wr, 7 op/s 2023-05-08T08:38:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:52 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:38:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:38:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:38:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:38:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:38:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:38:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:38:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:38:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:38:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17672.967834 secs 2023-05-08T08:38:54.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:54 smithi186 ceph-mon[126480]: pgmap v9482: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 415 KiB/s wr, 7 op/s 2023-05-08T08:38:54.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:38:54.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:38:54.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:38:54.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:38:54.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:38:54.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:38:54.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:38:54.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:38:54.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:38:54.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:38:54.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:38:54.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:38:54.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:38:54.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:38:54.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:38:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:38:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:38:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:38:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:38:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:38:54.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:38:54.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17672.967834 secs 2023-05-08T08:38:54.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:54 smithi133 ceph-mon[125939]: pgmap v9482: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 415 KiB/s wr, 7 op/s 2023-05-08T08:38:54.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:38:54.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:38:54.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:38:54.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:38:54.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:38:54.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:38:54.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:38:54.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:38:54.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:38:54.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:38:54.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:38:54.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:38:54.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:38:54.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:38:54.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:38:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:38:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:38:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:38:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:38:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:38:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:38:54.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17672.967834 secs 2023-05-08T08:38:54.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:54 smithi096 ceph-mon[124666]: pgmap v9482: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 415 KiB/s wr, 7 op/s 2023-05-08T08:38:54.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:38:54.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:38:54.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:38:54.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:38:54.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:38:54.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:38:54.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:38:54.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:38:54.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:38:54.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:38:54.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:38:54.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:38:54.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:38:54.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:38:54.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:38:55.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:55 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi096 to 62794k 2023-05-08T08:38:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:55 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi096 to 64301273: error parsing value: Value '64301273' is below minimum 939524096 2023-05-08T08:38:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:55 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T08:38:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:55 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T08:38:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17673.523934 secs 2023-05-08T08:38:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:55 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T08:38:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:55 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T08:38:55.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:55 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:38:55.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:55 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T08:38:55.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:55 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T08:38:55.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:55 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:38:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:55 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi096 to 62794k 2023-05-08T08:38:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:55 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi096 to 64301273: error parsing value: Value '64301273' is below minimum 939524096 2023-05-08T08:38:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:55 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T08:38:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:55 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T08:38:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17673.523934 secs 2023-05-08T08:38:55.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:55 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T08:38:55.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:55 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T08:38:55.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:55 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:38:55.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:55 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T08:38:55.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:55 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T08:38:55.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:55 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:38:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:55 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi096 to 62794k 2023-05-08T08:38:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:55 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi096 to 64301273: error parsing value: Value '64301273' is below minimum 939524096 2023-05-08T08:38:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:55 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T08:38:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:55 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T08:38:55.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17673.523934 secs 2023-05-08T08:38:55.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:55 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T08:38:55.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:55 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T08:38:55.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:55 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:38:55.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:55 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T08:38:55.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:55 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T08:38:55.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:55 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:38:56.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17674.808226 secs 2023-05-08T08:38:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:56 smithi186 ceph-mon[126480]: pgmap v9483: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 631 KiB/s wr, 13 op/s 2023-05-08T08:38:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17674.808226 secs 2023-05-08T08:38:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:56 smithi133 ceph-mon[125939]: pgmap v9483: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 631 KiB/s wr, 13 op/s 2023-05-08T08:38:56.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17674.808226 secs 2023-05-08T08:38:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:56 smithi096 ceph-mon[124666]: pgmap v9483: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 631 KiB/s wr, 13 op/s 2023-05-08T08:38:57.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:38:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:38:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:38:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:38:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:38:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:38:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:58 smithi186 ceph-mon[126480]: pgmap v9484: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 483 KiB/s wr, 10 op/s 2023-05-08T08:38:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:58 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:38:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:58 smithi133 ceph-mon[125939]: pgmap v9484: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 483 KiB/s wr, 10 op/s 2023-05-08T08:38:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:58 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:38:58.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:58 smithi096 ceph-mon[124666]: pgmap v9484: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 483 KiB/s wr, 10 op/s 2023-05-08T08:38:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:58 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:38:59.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:38:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17677.967951 secs 2023-05-08T08:38:59.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:38:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17677.967951 secs 2023-05-08T08:38:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:38:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17677.967951 secs 2023-05-08T08:39:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:39:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:39:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:00 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:39:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:00 smithi133 ceph-mon[125939]: pgmap v9485: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 662 KiB/s rd, 658 KiB/s wr, 16 op/s 2023-05-08T08:39:00.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:39:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:39:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:00 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:39:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:00 smithi096 ceph-mon[124666]: pgmap v9485: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 662 KiB/s rd, 658 KiB/s wr, 16 op/s 2023-05-08T08:39:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:39:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:39:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:00 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:39:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:00 smithi186 ceph-mon[126480]: pgmap v9485: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 662 KiB/s rd, 658 KiB/s wr, 16 op/s 2023-05-08T08:39:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17679.808338 secs 2023-05-08T08:39:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:39:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:39:01.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17679.808338 secs 2023-05-08T08:39:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:39:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:39:01.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17679.808338 secs 2023-05-08T08:39:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:39:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:39:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:02 smithi133 ceph-mon[125939]: pgmap v9486: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 392 KiB/s wr, 12 op/s 2023-05-08T08:39:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:02 smithi096 ceph-mon[124666]: pgmap v9486: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 392 KiB/s wr, 12 op/s 2023-05-08T08:39:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:02 smithi186 ceph-mon[126480]: pgmap v9486: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 392 KiB/s wr, 12 op/s 2023-05-08T08:39:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17682.968047 secs 2023-05-08T08:39:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:04 smithi133 ceph-mon[125939]: pgmap v9487: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 391 KiB/s wr, 12 op/s 2023-05-08T08:39:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17683.524130 secs 2023-05-08T08:39:04.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17682.968047 secs 2023-05-08T08:39:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:04 smithi096 ceph-mon[124666]: pgmap v9487: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 391 KiB/s wr, 12 op/s 2023-05-08T08:39:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17683.524130 secs 2023-05-08T08:39:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17682.968047 secs 2023-05-08T08:39:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:04 smithi186 ceph-mon[126480]: pgmap v9487: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 391 KiB/s wr, 12 op/s 2023-05-08T08:39:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17683.524130 secs 2023-05-08T08:39:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17684.808453 secs 2023-05-08T08:39:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:06 smithi133 ceph-mon[125939]: pgmap v9488: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 623 KiB/s wr, 31 op/s 2023-05-08T08:39:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:06 smithi133 ceph-mon[125939]: osdmap e670: 12 total, 12 up, 12 in 2023-05-08T08:39:06.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17684.808453 secs 2023-05-08T08:39:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:06 smithi096 ceph-mon[124666]: pgmap v9488: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 623 KiB/s wr, 31 op/s 2023-05-08T08:39:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:06 smithi096 ceph-mon[124666]: osdmap e670: 12 total, 12 up, 12 in 2023-05-08T08:39:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17684.808453 secs 2023-05-08T08:39:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:06 smithi186 ceph-mon[126480]: pgmap v9488: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 623 KiB/s wr, 31 op/s 2023-05-08T08:39:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:06 smithi186 ceph-mon[126480]: osdmap e670: 12 total, 12 up, 12 in 2023-05-08T08:39:08.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:08 smithi133 ceph-mon[125939]: pgmap v9490: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 488 KiB/s wr, 30 op/s 2023-05-08T08:39:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:08 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:39:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:39:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:39:08.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:08 smithi096 ceph-mon[124666]: pgmap v9490: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 488 KiB/s wr, 30 op/s 2023-05-08T08:39:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:08 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:39:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:39:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:39:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:08 smithi186 ceph-mon[126480]: pgmap v9490: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 488 KiB/s wr, 30 op/s 2023-05-08T08:39:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:08 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:39:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:39:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:39:09.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17687.968193 secs 2023-05-08T08:39:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17688.524251 secs 2023-05-08T08:39:09.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17687.968193 secs 2023-05-08T08:39:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17688.524251 secs 2023-05-08T08:39:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17687.968193 secs 2023-05-08T08:39:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17688.524251 secs 2023-05-08T08:39:10.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:10 smithi133 ceph-mon[125939]: pgmap v9491: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 319 KiB/s rd, 349 KiB/s wr, 29 op/s 2023-05-08T08:39:10.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:10 smithi096 ceph-mon[124666]: pgmap v9491: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 319 KiB/s rd, 349 KiB/s wr, 29 op/s 2023-05-08T08:39:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:10 smithi186 ceph-mon[126480]: pgmap v9491: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 319 KiB/s rd, 349 KiB/s wr, 29 op/s 2023-05-08T08:39:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17689.808572 secs 2023-05-08T08:39:11.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17689.808572 secs 2023-05-08T08:39:11.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17689.808572 secs 2023-05-08T08:39:12.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:12 smithi133 ceph-mon[125939]: pgmap v9492: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 319 KiB/s rd, 349 KiB/s wr, 29 op/s 2023-05-08T08:39:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:12 smithi133 ceph-mon[125939]: osdmap e671: 12 total, 12 up, 12 in 2023-05-08T08:39:12.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:12 smithi096 ceph-mon[124666]: pgmap v9492: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 319 KiB/s rd, 349 KiB/s wr, 29 op/s 2023-05-08T08:39:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:12 smithi096 ceph-mon[124666]: osdmap e671: 12 total, 12 up, 12 in 2023-05-08T08:39:12.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:12 smithi186 ceph-mon[126480]: pgmap v9492: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 319 KiB/s rd, 349 KiB/s wr, 29 op/s 2023-05-08T08:39:12.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:12 smithi186 ceph-mon[126480]: osdmap e671: 12 total, 12 up, 12 in 2023-05-08T08:39:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17692.968257 secs 2023-05-08T08:39:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:14 smithi133 ceph-mon[125939]: pgmap v9494: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 89 KiB/s wr, 6 op/s 2023-05-08T08:39:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17693.524380 secs 2023-05-08T08:39:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17692.968257 secs 2023-05-08T08:39:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:14 smithi096 ceph-mon[124666]: pgmap v9494: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 89 KiB/s wr, 6 op/s 2023-05-08T08:39:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17693.524380 secs 2023-05-08T08:39:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17692.968257 secs 2023-05-08T08:39:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:14 smithi186 ceph-mon[126480]: pgmap v9494: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 89 KiB/s wr, 6 op/s 2023-05-08T08:39:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17693.524380 secs 2023-05-08T08:39:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17694.808695 secs 2023-05-08T08:39:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:16 smithi133 ceph-mon[125939]: pgmap v9495: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 322 KiB/s rd, 222 KiB/s wr, 9 op/s 2023-05-08T08:39:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17694.808695 secs 2023-05-08T08:39:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:16 smithi096 ceph-mon[124666]: pgmap v9495: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 322 KiB/s rd, 222 KiB/s wr, 9 op/s 2023-05-08T08:39:16.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17694.808695 secs 2023-05-08T08:39:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:16 smithi186 ceph-mon[126480]: pgmap v9495: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 322 KiB/s rd, 222 KiB/s wr, 9 op/s 2023-05-08T08:39:18.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:18 smithi133 ceph-mon[125939]: pgmap v9496: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 221 KiB/s wr, 9 op/s 2023-05-08T08:39:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:18 smithi096 ceph-mon[124666]: pgmap v9496: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 221 KiB/s wr, 9 op/s 2023-05-08T08:39:18.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:18 smithi186 ceph-mon[126480]: pgmap v9496: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 221 KiB/s wr, 9 op/s 2023-05-08T08:39:19.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17697.968322 secs 2023-05-08T08:39:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17698.524499 secs 2023-05-08T08:39:19.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17697.968322 secs 2023-05-08T08:39:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17698.524499 secs 2023-05-08T08:39:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17697.968322 secs 2023-05-08T08:39:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17698.524499 secs 2023-05-08T08:39:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:20 smithi133 ceph-mon[125939]: pgmap v9497: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 150 KiB/s wr, 6 op/s 2023-05-08T08:39:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:20 smithi096 ceph-mon[124666]: pgmap v9497: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 150 KiB/s wr, 6 op/s 2023-05-08T08:39:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:20 smithi186 ceph-mon[126480]: pgmap v9497: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 150 KiB/s wr, 6 op/s 2023-05-08T08:39:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17699.808822 secs 2023-05-08T08:39:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17699.808822 secs 2023-05-08T08:39:21.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17699.808822 secs 2023-05-08T08:39:22.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:22 smithi133 ceph-mon[125939]: pgmap v9498: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 150 KiB/s wr, 6 op/s 2023-05-08T08:39:22.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:22 smithi096 ceph-mon[124666]: pgmap v9498: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 150 KiB/s wr, 6 op/s 2023-05-08T08:39:22.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:22 smithi186 ceph-mon[126480]: pgmap v9498: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 150 KiB/s wr, 6 op/s 2023-05-08T08:39:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17702.968413 secs 2023-05-08T08:39:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:24 smithi133 ceph-mon[125939]: pgmap v9499: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 137 KiB/s wr, 6 op/s 2023-05-08T08:39:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17703.524548 secs 2023-05-08T08:39:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17702.968413 secs 2023-05-08T08:39:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:24 smithi096 ceph-mon[124666]: pgmap v9499: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 137 KiB/s wr, 6 op/s 2023-05-08T08:39:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17703.524548 secs 2023-05-08T08:39:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17702.968413 secs 2023-05-08T08:39:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:24 smithi186 ceph-mon[126480]: pgmap v9499: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 137 KiB/s wr, 6 op/s 2023-05-08T08:39:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17703.524548 secs 2023-05-08T08:39:26.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17704.808898 secs 2023-05-08T08:39:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:26 smithi133 ceph-mon[125939]: pgmap v9500: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 138 KiB/s wr, 8 op/s 2023-05-08T08:39:26.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17704.808898 secs 2023-05-08T08:39:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:26 smithi096 ceph-mon[124666]: pgmap v9500: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 138 KiB/s wr, 8 op/s 2023-05-08T08:39:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17704.808898 secs 2023-05-08T08:39:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:26 smithi186 ceph-mon[126480]: pgmap v9500: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 138 KiB/s wr, 8 op/s 2023-05-08T08:39:28.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:28 smithi133 ceph-mon[125939]: pgmap v9501: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 5 op/s 2023-05-08T08:39:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:28 smithi096 ceph-mon[124666]: pgmap v9501: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 5 op/s 2023-05-08T08:39:28.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:28 smithi186 ceph-mon[126480]: pgmap v9501: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 5 op/s 2023-05-08T08:39:29.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17707.968522 secs 2023-05-08T08:39:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17708.524667 secs 2023-05-08T08:39:29.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17707.968522 secs 2023-05-08T08:39:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17708.524667 secs 2023-05-08T08:39:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17707.968522 secs 2023-05-08T08:39:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17708.524667 secs 2023-05-08T08:39:30.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:30 smithi133 ceph-mon[125939]: pgmap v9502: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 8 op/s 2023-05-08T08:39:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:30 smithi096 ceph-mon[124666]: pgmap v9502: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 8 op/s 2023-05-08T08:39:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:30 smithi186 ceph-mon[126480]: pgmap v9502: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 8 op/s 2023-05-08T08:39:31.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17709.809016 secs 2023-05-08T08:39:31.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17709.809016 secs 2023-05-08T08:39:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17709.809016 secs 2023-05-08T08:39:32.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:32 smithi133 ceph-mon[125939]: pgmap v9503: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 5 op/s 2023-05-08T08:39:32.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:32 smithi096 ceph-mon[124666]: pgmap v9503: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 5 op/s 2023-05-08T08:39:32.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:32 smithi186 ceph-mon[126480]: pgmap v9503: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 5 op/s 2023-05-08T08:39:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17712.968644 secs 2023-05-08T08:39:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:34 smithi133 ceph-mon[125939]: pgmap v9504: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 5 op/s 2023-05-08T08:39:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17713.524760 secs 2023-05-08T08:39:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17712.968644 secs 2023-05-08T08:39:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:34 smithi096 ceph-mon[124666]: pgmap v9504: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 5 op/s 2023-05-08T08:39:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17713.524760 secs 2023-05-08T08:39:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17712.968644 secs 2023-05-08T08:39:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:34 smithi186 ceph-mon[126480]: pgmap v9504: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 5 op/s 2023-05-08T08:39:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17713.524760 secs 2023-05-08T08:39:35.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17714.809138 secs 2023-05-08T08:39:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17714.809138 secs 2023-05-08T08:39:35.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17714.809138 secs 2023-05-08T08:39:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:36 smithi133 ceph-mon[125939]: pgmap v9505: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 75 KiB/s wr, 9 op/s 2023-05-08T08:39:36.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:36 smithi096 ceph-mon[124666]: pgmap v9505: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 75 KiB/s wr, 9 op/s 2023-05-08T08:39:36.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:36 smithi186 ceph-mon[126480]: pgmap v9505: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 75 KiB/s wr, 9 op/s 2023-05-08T08:39:38.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:38 smithi133 ceph-mon[125939]: pgmap v9506: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T08:39:38.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:38 smithi096 ceph-mon[124666]: pgmap v9506: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T08:39:38.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:38 smithi186 ceph-mon[126480]: pgmap v9506: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T08:39:39.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17717.968784 secs 2023-05-08T08:39:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17718.524904 secs 2023-05-08T08:39:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17717.968784 secs 2023-05-08T08:39:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17718.524904 secs 2023-05-08T08:39:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17717.968784 secs 2023-05-08T08:39:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17718.524904 secs 2023-05-08T08:39:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:40 smithi133 ceph-mon[125939]: pgmap v9507: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 63 KiB/s wr, 9 op/s 2023-05-08T08:39:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:40 smithi096 ceph-mon[124666]: pgmap v9507: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 63 KiB/s wr, 9 op/s 2023-05-08T08:39:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:40 smithi186 ceph-mon[126480]: pgmap v9507: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 63 KiB/s wr, 9 op/s 2023-05-08T08:39:41.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:41 smithi133 ceph-mon[125939]: pgmap v9508: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T08:39:41.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:41 smithi096 ceph-mon[124666]: pgmap v9508: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T08:39:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:41 smithi186 ceph-mon[126480]: pgmap v9508: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T08:39:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:39:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:39:43.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:39:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17722.968901 secs 2023-05-08T08:39:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:44 smithi133 ceph-mon[125939]: pgmap v9509: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T08:39:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:39:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:39:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:39:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17723.525045 secs 2023-05-08T08:39:44.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17722.968901 secs 2023-05-08T08:39:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:44 smithi096 ceph-mon[124666]: pgmap v9509: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T08:39:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:39:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:39:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:39:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17723.525045 secs 2023-05-08T08:39:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17722.968901 secs 2023-05-08T08:39:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:44 smithi186 ceph-mon[126480]: pgmap v9509: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T08:39:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:39:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:39:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:39:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17723.525045 secs 2023-05-08T08:39:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:46 smithi133 ceph-mon[125939]: pgmap v9510: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 205 KiB/s wr, 9 op/s 2023-05-08T08:39:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:46 smithi096 ceph-mon[124666]: pgmap v9510: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 205 KiB/s wr, 9 op/s 2023-05-08T08:39:46.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:46 smithi186 ceph-mon[126480]: pgmap v9510: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 205 KiB/s wr, 9 op/s 2023-05-08T08:39:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:48 smithi133 ceph-mon[125939]: pgmap v9511: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 326 KiB/s wr, 7 op/s 2023-05-08T08:39:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:48 smithi096 ceph-mon[124666]: pgmap v9511: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 326 KiB/s wr, 7 op/s 2023-05-08T08:39:48.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:48 smithi186 ceph-mon[126480]: pgmap v9511: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 326 KiB/s wr, 7 op/s 2023-05-08T08:39:49.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17727.969045 secs 2023-05-08T08:39:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17727.969045 secs 2023-05-08T08:39:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17727.969045 secs 2023-05-08T08:39:50.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:50 smithi133 ceph-mon[125939]: pgmap v9512: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 335 KiB/s wr, 10 op/s 2023-05-08T08:39:50.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:50 smithi096 ceph-mon[124666]: pgmap v9512: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 335 KiB/s wr, 10 op/s 2023-05-08T08:39:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:50 smithi186 ceph-mon[126480]: pgmap v9512: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 335 KiB/s wr, 10 op/s 2023-05-08T08:39:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:39:51.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:39:51.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:39:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:52 smithi133 ceph-mon[125939]: pgmap v9513: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 443 KiB/s wr, 8 op/s 2023-05-08T08:39:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:52 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:39:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:39:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:39:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:52 smithi096 ceph-mon[124666]: pgmap v9513: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 443 KiB/s wr, 8 op/s 2023-05-08T08:39:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:52 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:39:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:39:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:39:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:52 smithi186 ceph-mon[126480]: pgmap v9513: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 443 KiB/s wr, 8 op/s 2023-05-08T08:39:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:52 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:39:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:39:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:39:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17732.969157 secs 2023-05-08T08:39:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:54 smithi133 ceph-mon[125939]: pgmap v9514: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 443 KiB/s wr, 8 op/s 2023-05-08T08:39:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17733.525277 secs 2023-05-08T08:39:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:39:54.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17732.969157 secs 2023-05-08T08:39:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:54 smithi096 ceph-mon[124666]: pgmap v9514: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 443 KiB/s wr, 8 op/s 2023-05-08T08:39:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17733.525277 secs 2023-05-08T08:39:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:39:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17732.969157 secs 2023-05-08T08:39:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:54 smithi186 ceph-mon[126480]: pgmap v9514: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 443 KiB/s wr, 8 op/s 2023-05-08T08:39:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17733.525277 secs 2023-05-08T08:39:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:39:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:55 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:39:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:55 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:39:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:55 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:39:55.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:55 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:39:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:55 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:39:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:55 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:39:55.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:55 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:39:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:55 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:39:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:55 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:39:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:56 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:39:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:56 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T08:39:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:56 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T08:39:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:56 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:39:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17734.809664 secs 2023-05-08T08:39:56.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:56 smithi133 ceph-mon[125939]: pgmap v9515: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 575 KiB/s wr, 12 op/s 2023-05-08T08:39:56.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:39:56.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:39:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:56 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:39:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:56 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T08:39:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:56 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T08:39:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:56 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:39:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17734.809664 secs 2023-05-08T08:39:56.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:56 smithi096 ceph-mon[124666]: pgmap v9515: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 575 KiB/s wr, 12 op/s 2023-05-08T08:39:56.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:39:56.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:39:56.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:56 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:39:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:56 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T08:39:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:56 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T08:39:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:56 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:39:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17734.809664 secs 2023-05-08T08:39:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:56 smithi186 ceph-mon[126480]: pgmap v9515: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 575 KiB/s wr, 12 op/s 2023-05-08T08:39:56.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:39:56.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:39:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:57 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:39:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:57 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:39:57.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:57 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:39:58.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:58 smithi133 ceph-mon[125939]: pgmap v9516: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 530 KiB/s rd, 484 KiB/s wr, 10 op/s 2023-05-08T08:39:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:58 smithi096 ceph-mon[124666]: pgmap v9516: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 530 KiB/s rd, 484 KiB/s wr, 10 op/s 2023-05-08T08:39:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:58 smithi186 ceph-mon[126480]: pgmap v9516: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 530 KiB/s rd, 484 KiB/s wr, 10 op/s 2023-05-08T08:39:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17737.969312 secs 2023-05-08T08:39:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:39:59 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:39:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17737.969312 secs 2023-05-08T08:39:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:39:59 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:39:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17737.969312 secs 2023-05-08T08:39:59.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:39:59 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:40:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:00 smithi133 ceph-mon[125939]: pgmap v9517: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 395 KiB/s wr, 15 op/s 2023-05-08T08:40:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:40:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:40:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:40:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:00 smithi133 ceph-mon[125939]: Health detail: HEALTH_WARN 2 MDSs report slow requests 2023-05-08T08:40:00.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:00 smithi133 ceph-mon[125939]: [WRN] MDS_SLOW_REQUEST: 2 MDSs report slow requests 2023-05-08T08:40:00.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:00 smithi133 ceph-mon[125939]: mds.i(mds.1): 1 slow requests are blocked > 180 secs 2023-05-08T08:40:00.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:00 smithi133 ceph-mon[125939]: mds.b(mds.0): 1 slow requests are blocked > 180 secs 2023-05-08T08:40:00.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:00 smithi096 ceph-mon[124666]: pgmap v9517: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 395 KiB/s wr, 15 op/s 2023-05-08T08:40:00.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:40:00.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:40:00.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:40:00.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:00 smithi096 ceph-mon[124666]: Health detail: HEALTH_WARN 2 MDSs report slow requests 2023-05-08T08:40:00.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:00 smithi096 ceph-mon[124666]: [WRN] MDS_SLOW_REQUEST: 2 MDSs report slow requests 2023-05-08T08:40:00.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:00 smithi096 ceph-mon[124666]: mds.i(mds.1): 1 slow requests are blocked > 180 secs 2023-05-08T08:40:00.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:00 smithi096 ceph-mon[124666]: mds.b(mds.0): 1 slow requests are blocked > 180 secs 2023-05-08T08:40:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:00 smithi186 ceph-mon[126480]: pgmap v9517: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 395 KiB/s wr, 15 op/s 2023-05-08T08:40:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:40:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:40:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:40:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:00 smithi186 ceph-mon[126480]: Health detail: HEALTH_WARN 2 MDSs report slow requests 2023-05-08T08:40:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:00 smithi186 ceph-mon[126480]: [WRN] MDS_SLOW_REQUEST: 2 MDSs report slow requests 2023-05-08T08:40:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:00 smithi186 ceph-mon[126480]: mds.i(mds.1): 1 slow requests are blocked > 180 secs 2023-05-08T08:40:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:00 smithi186 ceph-mon[126480]: mds.b(mds.0): 1 slow requests are blocked > 180 secs 2023-05-08T08:40:01.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17739.809789 secs 2023-05-08T08:40:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17739.809789 secs 2023-05-08T08:40:01.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17739.809789 secs 2023-05-08T08:40:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:02 smithi133 ceph-mon[125939]: pgmap v9518: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 389 KiB/s rd, 386 KiB/s wr, 11 op/s 2023-05-08T08:40:02.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:02 smithi096 ceph-mon[124666]: pgmap v9518: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 389 KiB/s rd, 386 KiB/s wr, 11 op/s 2023-05-08T08:40:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:02 smithi186 ceph-mon[126480]: pgmap v9518: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 389 KiB/s rd, 386 KiB/s wr, 11 op/s 2023-05-08T08:40:04.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17742.969406 secs 2023-05-08T08:40:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:04 smithi133 ceph-mon[125939]: pgmap v9519: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 278 KiB/s wr, 10 op/s 2023-05-08T08:40:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17743.525521 secs 2023-05-08T08:40:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17742.969406 secs 2023-05-08T08:40:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:04 smithi096 ceph-mon[124666]: pgmap v9519: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 278 KiB/s wr, 10 op/s 2023-05-08T08:40:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17743.525521 secs 2023-05-08T08:40:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17742.969406 secs 2023-05-08T08:40:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:04 smithi186 ceph-mon[126480]: pgmap v9519: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 278 KiB/s wr, 10 op/s 2023-05-08T08:40:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17743.525521 secs 2023-05-08T08:40:06.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17744.809881 secs 2023-05-08T08:40:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:06 smithi133 ceph-mon[125939]: pgmap v9520: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 447 KiB/s wr, 29 op/s 2023-05-08T08:40:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:06 smithi133 ceph-mon[125939]: osdmap e672: 12 total, 12 up, 12 in 2023-05-08T08:40:06.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17744.809881 secs 2023-05-08T08:40:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:06 smithi096 ceph-mon[124666]: pgmap v9520: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 447 KiB/s wr, 29 op/s 2023-05-08T08:40:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:06 smithi096 ceph-mon[124666]: osdmap e672: 12 total, 12 up, 12 in 2023-05-08T08:40:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17744.809881 secs 2023-05-08T08:40:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:06 smithi186 ceph-mon[126480]: pgmap v9520: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 447 KiB/s wr, 29 op/s 2023-05-08T08:40:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:06 smithi186 ceph-mon[126480]: osdmap e672: 12 total, 12 up, 12 in 2023-05-08T08:40:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:08 smithi133 ceph-mon[125939]: pgmap v9522: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 316 KiB/s wr, 29 op/s 2023-05-08T08:40:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:08 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:40:08.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:40:08.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:40:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:08 smithi096 ceph-mon[124666]: pgmap v9522: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 316 KiB/s wr, 29 op/s 2023-05-08T08:40:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:08 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:40:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:40:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:40:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:08 smithi186 ceph-mon[126480]: pgmap v9522: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 316 KiB/s wr, 29 op/s 2023-05-08T08:40:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:08 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:40:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:40:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:40:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17747.969484 secs 2023-05-08T08:40:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17748.525645 secs 2023-05-08T08:40:09.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17747.969484 secs 2023-05-08T08:40:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17748.525645 secs 2023-05-08T08:40:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17747.969484 secs 2023-05-08T08:40:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17748.525645 secs 2023-05-08T08:40:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:10 smithi133 ceph-mon[125939]: pgmap v9523: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 275 KiB/s wr, 28 op/s 2023-05-08T08:40:10.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:10 smithi096 ceph-mon[124666]: pgmap v9523: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 275 KiB/s wr, 28 op/s 2023-05-08T08:40:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:10 smithi186 ceph-mon[126480]: pgmap v9523: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 275 KiB/s wr, 28 op/s 2023-05-08T08:40:11.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17749.809949 secs 2023-05-08T08:40:11.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17749.809949 secs 2023-05-08T08:40:11.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17749.809949 secs 2023-05-08T08:40:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:12 smithi133 ceph-mon[125939]: pgmap v9524: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 275 KiB/s wr, 28 op/s 2023-05-08T08:40:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:12 smithi133 ceph-mon[125939]: osdmap e673: 12 total, 12 up, 12 in 2023-05-08T08:40:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:12 smithi096 ceph-mon[124666]: pgmap v9524: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 275 KiB/s wr, 28 op/s 2023-05-08T08:40:12.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:12 smithi096 ceph-mon[124666]: osdmap e673: 12 total, 12 up, 12 in 2023-05-08T08:40:12.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:12 smithi186 ceph-mon[126480]: pgmap v9524: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 275 KiB/s wr, 28 op/s 2023-05-08T08:40:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:12 smithi186 ceph-mon[126480]: osdmap e673: 12 total, 12 up, 12 in 2023-05-08T08:40:14.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17752.969548 secs 2023-05-08T08:40:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:14 smithi133 ceph-mon[125939]: pgmap v9526: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 90 KiB/s wr, 6 op/s 2023-05-08T08:40:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17753.525767 secs 2023-05-08T08:40:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17752.969548 secs 2023-05-08T08:40:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:14 smithi096 ceph-mon[124666]: pgmap v9526: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 90 KiB/s wr, 6 op/s 2023-05-08T08:40:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17753.525767 secs 2023-05-08T08:40:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17752.969548 secs 2023-05-08T08:40:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:14 smithi186 ceph-mon[126480]: pgmap v9526: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 90 KiB/s wr, 6 op/s 2023-05-08T08:40:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17753.525767 secs 2023-05-08T08:40:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17754.810086 secs 2023-05-08T08:40:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:16 smithi133 ceph-mon[125939]: pgmap v9527: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 224 KiB/s wr, 9 op/s 2023-05-08T08:40:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17754.810086 secs 2023-05-08T08:40:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:16 smithi096 ceph-mon[124666]: pgmap v9527: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 224 KiB/s wr, 9 op/s 2023-05-08T08:40:16.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17754.810086 secs 2023-05-08T08:40:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:16 smithi186 ceph-mon[126480]: pgmap v9527: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 224 KiB/s wr, 9 op/s 2023-05-08T08:40:18.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:18 smithi133 ceph-mon[125939]: pgmap v9528: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 222 KiB/s wr, 9 op/s 2023-05-08T08:40:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:18 smithi096 ceph-mon[124666]: pgmap v9528: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 222 KiB/s wr, 9 op/s 2023-05-08T08:40:18.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:18 smithi186 ceph-mon[126480]: pgmap v9528: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 222 KiB/s wr, 9 op/s 2023-05-08T08:40:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17757.969673 secs 2023-05-08T08:40:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17758.525882 secs 2023-05-08T08:40:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17757.969673 secs 2023-05-08T08:40:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17758.525882 secs 2023-05-08T08:40:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17757.969673 secs 2023-05-08T08:40:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17758.525882 secs 2023-05-08T08:40:20.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:20 smithi133 ceph-mon[125939]: pgmap v9529: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 150 KiB/s wr, 7 op/s 2023-05-08T08:40:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:20 smithi096 ceph-mon[124666]: pgmap v9529: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 150 KiB/s wr, 7 op/s 2023-05-08T08:40:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:20 smithi186 ceph-mon[126480]: pgmap v9529: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 150 KiB/s wr, 7 op/s 2023-05-08T08:40:21.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17759.810212 secs 2023-05-08T08:40:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17759.810212 secs 2023-05-08T08:40:21.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17759.810212 secs 2023-05-08T08:40:22.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:22 smithi133 ceph-mon[125939]: pgmap v9530: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 150 KiB/s wr, 7 op/s 2023-05-08T08:40:22.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:22 smithi096 ceph-mon[124666]: pgmap v9530: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 150 KiB/s wr, 7 op/s 2023-05-08T08:40:22.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:22 smithi186 ceph-mon[126480]: pgmap v9530: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 150 KiB/s wr, 7 op/s 2023-05-08T08:40:24.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17762.969793 secs 2023-05-08T08:40:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:24 smithi133 ceph-mon[125939]: pgmap v9531: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 137 KiB/s wr, 6 op/s 2023-05-08T08:40:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17763.526016 secs 2023-05-08T08:40:24.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17762.969793 secs 2023-05-08T08:40:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:24 smithi096 ceph-mon[124666]: pgmap v9531: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 137 KiB/s wr, 6 op/s 2023-05-08T08:40:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17763.526016 secs 2023-05-08T08:40:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17762.969793 secs 2023-05-08T08:40:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:24 smithi186 ceph-mon[126480]: pgmap v9531: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 137 KiB/s wr, 6 op/s 2023-05-08T08:40:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17763.526016 secs 2023-05-08T08:40:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17764.810328 secs 2023-05-08T08:40:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:26 smithi133 ceph-mon[125939]: pgmap v9532: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 125 KiB/s wr, 8 op/s 2023-05-08T08:40:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17764.810328 secs 2023-05-08T08:40:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:26 smithi096 ceph-mon[124666]: pgmap v9532: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 125 KiB/s wr, 8 op/s 2023-05-08T08:40:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17764.810328 secs 2023-05-08T08:40:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:26 smithi186 ceph-mon[126480]: pgmap v9532: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 125 KiB/s wr, 8 op/s 2023-05-08T08:40:28.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:28 smithi133 ceph-mon[125939]: pgmap v9533: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T08:40:28.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:28 smithi096 ceph-mon[124666]: pgmap v9533: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T08:40:28.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:28 smithi186 ceph-mon[126480]: pgmap v9533: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T08:40:29.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17767.969910 secs 2023-05-08T08:40:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17768.526172 secs 2023-05-08T08:40:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17767.969910 secs 2023-05-08T08:40:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17768.526172 secs 2023-05-08T08:40:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17767.969910 secs 2023-05-08T08:40:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17768.526172 secs 2023-05-08T08:40:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:30 smithi133 ceph-mon[125939]: pgmap v9534: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 597 B/s wr, 8 op/s 2023-05-08T08:40:30.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:30 smithi096 ceph-mon[124666]: pgmap v9534: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 597 B/s wr, 8 op/s 2023-05-08T08:40:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:30 smithi186 ceph-mon[126480]: pgmap v9534: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 597 B/s wr, 8 op/s 2023-05-08T08:40:31.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17769.810468 secs 2023-05-08T08:40:31.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17769.810468 secs 2023-05-08T08:40:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17769.810468 secs 2023-05-08T08:40:32.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:32 smithi133 ceph-mon[125939]: pgmap v9535: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 597 B/s wr, 5 op/s 2023-05-08T08:40:32.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:32 smithi096 ceph-mon[124666]: pgmap v9535: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 597 B/s wr, 5 op/s 2023-05-08T08:40:32.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:32 smithi186 ceph-mon[126480]: pgmap v9535: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 597 B/s wr, 5 op/s 2023-05-08T08:40:34.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17772.970023 secs 2023-05-08T08:40:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:34 smithi133 ceph-mon[125939]: pgmap v9536: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 597 B/s wr, 5 op/s 2023-05-08T08:40:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17773.526317 secs 2023-05-08T08:40:34.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17772.970023 secs 2023-05-08T08:40:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:34 smithi096 ceph-mon[124666]: pgmap v9536: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 597 B/s wr, 5 op/s 2023-05-08T08:40:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17773.526317 secs 2023-05-08T08:40:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17772.970023 secs 2023-05-08T08:40:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:34 smithi186 ceph-mon[126480]: pgmap v9536: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 597 B/s wr, 5 op/s 2023-05-08T08:40:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17773.526317 secs 2023-05-08T08:40:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17774.810533 secs 2023-05-08T08:40:35.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17774.810533 secs 2023-05-08T08:40:35.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17774.810533 secs 2023-05-08T08:40:36.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:36 smithi133 ceph-mon[125939]: pgmap v9537: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 113 KiB/s wr, 8 op/s 2023-05-08T08:40:36.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:36 smithi096 ceph-mon[124666]: pgmap v9537: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 113 KiB/s wr, 8 op/s 2023-05-08T08:40:36.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:36 smithi186 ceph-mon[126480]: pgmap v9537: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 113 KiB/s wr, 8 op/s 2023-05-08T08:40:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:38 smithi133 ceph-mon[125939]: pgmap v9538: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 113 KiB/s wr, 6 op/s 2023-05-08T08:40:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:38 smithi096 ceph-mon[124666]: pgmap v9538: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 113 KiB/s wr, 6 op/s 2023-05-08T08:40:38.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:38 smithi186 ceph-mon[126480]: pgmap v9538: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 113 KiB/s wr, 6 op/s 2023-05-08T08:40:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17777.970138 secs 2023-05-08T08:40:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17778.526441 secs 2023-05-08T08:40:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17777.970138 secs 2023-05-08T08:40:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17778.526441 secs 2023-05-08T08:40:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17777.970138 secs 2023-05-08T08:40:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17778.526441 secs 2023-05-08T08:40:40.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:40 smithi096 ceph-mon[124666]: pgmap v9539: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 114 KiB/s wr, 9 op/s 2023-05-08T08:40:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:40 smithi186 ceph-mon[126480]: pgmap v9539: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 114 KiB/s wr, 9 op/s 2023-05-08T08:40:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:40 smithi133 ceph-mon[125939]: pgmap v9539: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 114 KiB/s wr, 9 op/s 2023-05-08T08:40:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:41 smithi096 ceph-mon[124666]: pgmap v9540: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 113 KiB/s wr, 6 op/s 2023-05-08T08:40:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:41 smithi186 ceph-mon[126480]: pgmap v9540: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 113 KiB/s wr, 6 op/s 2023-05-08T08:40:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:41 smithi133 ceph-mon[125939]: pgmap v9540: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 113 KiB/s wr, 6 op/s 2023-05-08T08:40:43.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:40:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:40:43.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:40:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17782.970248 secs 2023-05-08T08:40:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:44 smithi133 ceph-mon[125939]: pgmap v9541: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 113 KiB/s wr, 6 op/s 2023-05-08T08:40:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:40:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:40:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:40:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17783.526584 secs 2023-05-08T08:40:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17782.970248 secs 2023-05-08T08:40:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:44 smithi096 ceph-mon[124666]: pgmap v9541: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 113 KiB/s wr, 6 op/s 2023-05-08T08:40:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:40:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:40:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:40:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17783.526584 secs 2023-05-08T08:40:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17782.970248 secs 2023-05-08T08:40:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:44 smithi186 ceph-mon[126480]: pgmap v9541: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 113 KiB/s wr, 6 op/s 2023-05-08T08:40:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:40:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:40:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:40:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17783.526584 secs 2023-05-08T08:40:46.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:46 smithi133 ceph-mon[125939]: pgmap v9542: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 191 KiB/s wr, 9 op/s 2023-05-08T08:40:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:46 smithi096 ceph-mon[124666]: pgmap v9542: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 191 KiB/s wr, 9 op/s 2023-05-08T08:40:46.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:46 smithi186 ceph-mon[126480]: pgmap v9542: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 191 KiB/s wr, 9 op/s 2023-05-08T08:40:48.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:48 smithi133 ceph-mon[125939]: pgmap v9543: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 78 KiB/s wr, 6 op/s 2023-05-08T08:40:48.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:48 smithi096 ceph-mon[124666]: pgmap v9543: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 78 KiB/s wr, 6 op/s 2023-05-08T08:40:48.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:48 smithi186 ceph-mon[126480]: pgmap v9543: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 78 KiB/s wr, 6 op/s 2023-05-08T08:40:49.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17787.970365 secs 2023-05-08T08:40:49.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17787.970365 secs 2023-05-08T08:40:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17787.970365 secs 2023-05-08T08:40:50.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:50 smithi133 ceph-mon[125939]: pgmap v9544: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 667 KiB/s rd, 429 KiB/s wr, 11 op/s 2023-05-08T08:40:50.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:50 smithi096 ceph-mon[124666]: pgmap v9544: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 667 KiB/s rd, 429 KiB/s wr, 11 op/s 2023-05-08T08:40:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:50 smithi186 ceph-mon[126480]: pgmap v9544: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 667 KiB/s rd, 429 KiB/s wr, 11 op/s 2023-05-08T08:40:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:40:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:40:51.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:40:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:52 smithi133 ceph-mon[125939]: pgmap v9545: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 604 KiB/s rd, 428 KiB/s wr, 8 op/s 2023-05-08T08:40:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:52 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:40:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:40:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:40:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:52 smithi096 ceph-mon[124666]: pgmap v9545: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 604 KiB/s rd, 428 KiB/s wr, 8 op/s 2023-05-08T08:40:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:52 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:40:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:40:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:40:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:52 smithi186 ceph-mon[126480]: pgmap v9545: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 604 KiB/s rd, 428 KiB/s wr, 8 op/s 2023-05-08T08:40:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:52 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:40:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:40:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:40:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17792.970487 secs 2023-05-08T08:40:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:54 smithi133 ceph-mon[125939]: pgmap v9546: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 604 KiB/s rd, 428 KiB/s wr, 8 op/s 2023-05-08T08:40:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17793.526809 secs 2023-05-08T08:40:54.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17792.970487 secs 2023-05-08T08:40:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:54 smithi096 ceph-mon[124666]: pgmap v9546: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 604 KiB/s rd, 428 KiB/s wr, 8 op/s 2023-05-08T08:40:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17793.526809 secs 2023-05-08T08:40:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17792.970487 secs 2023-05-08T08:40:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:54 smithi186 ceph-mon[126480]: pgmap v9546: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 604 KiB/s rd, 428 KiB/s wr, 8 op/s 2023-05-08T08:40:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17793.526809 secs 2023-05-08T08:40:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:55 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:40:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:55 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:40:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:55 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:40:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:55 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:40:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:55 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:40:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:55 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:40:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:55 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:40:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:55 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:40:55.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:55 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:40:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:55 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:40:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:55 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:40:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:55 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:40:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17794.810911 secs 2023-05-08T08:40:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:56 smithi133 ceph-mon[125939]: pgmap v9547: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 993 KiB/s rd, 723 KiB/s wr, 14 op/s 2023-05-08T08:40:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:56 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:40:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:56 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T08:40:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:56 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T08:40:56.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:56 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:40:56.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:40:56.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:40:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17794.810911 secs 2023-05-08T08:40:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:56 smithi096 ceph-mon[124666]: pgmap v9547: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 993 KiB/s rd, 723 KiB/s wr, 14 op/s 2023-05-08T08:40:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:56 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:40:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:56 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T08:40:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:56 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T08:40:56.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:56 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:40:56.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:40:56.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:40:56.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17794.810911 secs 2023-05-08T08:40:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:56 smithi186 ceph-mon[126480]: pgmap v9547: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 993 KiB/s rd, 723 KiB/s wr, 14 op/s 2023-05-08T08:40:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:56 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:40:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:56 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T08:40:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:56 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T08:40:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:56 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:40:56.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:40:56.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:40:57.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:57 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:40:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:57 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:40:57.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:57 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:40:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:58 smithi133 ceph-mon[125939]: pgmap v9548: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 885 KiB/s rd, 646 KiB/s wr, 11 op/s 2023-05-08T08:40:58.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:58 smithi096 ceph-mon[124666]: pgmap v9548: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 885 KiB/s rd, 646 KiB/s wr, 11 op/s 2023-05-08T08:40:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:58 smithi186 ceph-mon[126480]: pgmap v9548: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 885 KiB/s rd, 646 KiB/s wr, 11 op/s 2023-05-08T08:40:59.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17797.970554 secs 2023-05-08T08:40:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:40:59 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:40:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17797.970554 secs 2023-05-08T08:40:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:40:59 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:40:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17797.970554 secs 2023-05-08T08:40:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:40:59 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:41:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:00 smithi133 ceph-mon[125939]: pgmap v9549: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 724 KiB/s wr, 16 op/s 2023-05-08T08:41:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:41:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:41:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:41:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:00 smithi096 ceph-mon[124666]: pgmap v9549: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 724 KiB/s wr, 16 op/s 2023-05-08T08:41:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:41:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:41:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:41:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:00 smithi186 ceph-mon[126480]: pgmap v9549: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 724 KiB/s wr, 16 op/s 2023-05-08T08:41:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:41:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:41:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:41:01.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17799.811027 secs 2023-05-08T08:41:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17799.811027 secs 2023-05-08T08:41:01.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17799.811027 secs 2023-05-08T08:41:02.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:02 smithi133 ceph-mon[125939]: pgmap v9550: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 598 KiB/s rd, 374 KiB/s wr, 12 op/s 2023-05-08T08:41:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:02 smithi096 ceph-mon[124666]: pgmap v9550: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 598 KiB/s rd, 374 KiB/s wr, 12 op/s 2023-05-08T08:41:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:02 smithi186 ceph-mon[126480]: pgmap v9550: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 598 KiB/s rd, 374 KiB/s wr, 12 op/s 2023-05-08T08:41:04.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17802.970636 secs 2023-05-08T08:41:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:04 smithi133 ceph-mon[125939]: pgmap v9551: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 598 KiB/s rd, 374 KiB/s wr, 12 op/s 2023-05-08T08:41:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17803.527072 secs 2023-05-08T08:41:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17802.970636 secs 2023-05-08T08:41:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:04 smithi096 ceph-mon[124666]: pgmap v9551: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 598 KiB/s rd, 374 KiB/s wr, 12 op/s 2023-05-08T08:41:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17803.527072 secs 2023-05-08T08:41:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17802.970636 secs 2023-05-08T08:41:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:04 smithi186 ceph-mon[126480]: pgmap v9551: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 598 KiB/s rd, 374 KiB/s wr, 12 op/s 2023-05-08T08:41:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17803.527072 secs 2023-05-08T08:41:05.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17804.811148 secs 2023-05-08T08:41:05.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17804.811148 secs 2023-05-08T08:41:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17804.811148 secs 2023-05-08T08:41:06.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:06 smithi133 ceph-mon[125939]: pgmap v9552: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 968 KiB/s rd, 693 KiB/s wr, 31 op/s 2023-05-08T08:41:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:06 smithi133 ceph-mon[125939]: osdmap e674: 12 total, 12 up, 12 in 2023-05-08T08:41:06.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:06 smithi096 ceph-mon[124666]: pgmap v9552: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 968 KiB/s rd, 693 KiB/s wr, 31 op/s 2023-05-08T08:41:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:06 smithi096 ceph-mon[124666]: osdmap e674: 12 total, 12 up, 12 in 2023-05-08T08:41:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:06 smithi186 ceph-mon[126480]: pgmap v9552: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 968 KiB/s rd, 693 KiB/s wr, 31 op/s 2023-05-08T08:41:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:06 smithi186 ceph-mon[126480]: osdmap e674: 12 total, 12 up, 12 in 2023-05-08T08:41:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:08 smithi133 ceph-mon[125939]: pgmap v9554: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 695 KiB/s rd, 477 KiB/s wr, 30 op/s 2023-05-08T08:41:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:08 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:41:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:41:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:41:08.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:08 smithi096 ceph-mon[124666]: pgmap v9554: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 695 KiB/s rd, 477 KiB/s wr, 30 op/s 2023-05-08T08:41:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:08 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:41:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:41:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:41:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:08 smithi186 ceph-mon[126480]: pgmap v9554: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 695 KiB/s rd, 477 KiB/s wr, 30 op/s 2023-05-08T08:41:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:08 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:41:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:41:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:41:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17807.970724 secs 2023-05-08T08:41:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17808.527165 secs 2023-05-08T08:41:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17807.970724 secs 2023-05-08T08:41:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17808.527165 secs 2023-05-08T08:41:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17807.970724 secs 2023-05-08T08:41:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17808.527165 secs 2023-05-08T08:41:10.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:10 smithi133 ceph-mon[125939]: pgmap v9555: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 384 KiB/s wr, 28 op/s 2023-05-08T08:41:10.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:10 smithi096 ceph-mon[124666]: pgmap v9555: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 384 KiB/s wr, 28 op/s 2023-05-08T08:41:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:10 smithi186 ceph-mon[126480]: pgmap v9555: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 384 KiB/s wr, 28 op/s 2023-05-08T08:41:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17809.811289 secs 2023-05-08T08:41:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17809.811289 secs 2023-05-08T08:41:11.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17809.811289 secs 2023-05-08T08:41:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:12 smithi133 ceph-mon[125939]: pgmap v9556: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 383 KiB/s wr, 27 op/s 2023-05-08T08:41:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:12 smithi133 ceph-mon[125939]: osdmap e675: 12 total, 12 up, 12 in 2023-05-08T08:41:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:12 smithi096 ceph-mon[124666]: pgmap v9556: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 383 KiB/s wr, 27 op/s 2023-05-08T08:41:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:12 smithi096 ceph-mon[124666]: osdmap e675: 12 total, 12 up, 12 in 2023-05-08T08:41:12.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:12 smithi186 ceph-mon[126480]: pgmap v9556: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 383 KiB/s wr, 27 op/s 2023-05-08T08:41:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:12 smithi186 ceph-mon[126480]: osdmap e675: 12 total, 12 up, 12 in 2023-05-08T08:41:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17812.970864 secs 2023-05-08T08:41:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:14 smithi133 ceph-mon[125939]: pgmap v9558: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 895 B/s wr, 5 op/s 2023-05-08T08:41:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17813.527316 secs 2023-05-08T08:41:14.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17812.970864 secs 2023-05-08T08:41:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:14 smithi096 ceph-mon[124666]: pgmap v9558: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 895 B/s wr, 5 op/s 2023-05-08T08:41:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17813.527316 secs 2023-05-08T08:41:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17812.970864 secs 2023-05-08T08:41:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:14 smithi186 ceph-mon[126480]: pgmap v9558: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 895 B/s wr, 5 op/s 2023-05-08T08:41:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17813.527316 secs 2023-05-08T08:41:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17814.811409 secs 2023-05-08T08:41:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:16 smithi133 ceph-mon[125939]: pgmap v9559: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 73 KiB/s wr, 7 op/s 2023-05-08T08:41:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17814.811409 secs 2023-05-08T08:41:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:16 smithi096 ceph-mon[124666]: pgmap v9559: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 73 KiB/s wr, 7 op/s 2023-05-08T08:41:16.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17814.811409 secs 2023-05-08T08:41:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:16 smithi186 ceph-mon[126480]: pgmap v9559: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 73 KiB/s wr, 7 op/s 2023-05-08T08:41:18.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:18 smithi133 ceph-mon[125939]: pgmap v9560: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 72 KiB/s wr, 7 op/s 2023-05-08T08:41:18.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:18 smithi096 ceph-mon[124666]: pgmap v9560: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 72 KiB/s wr, 7 op/s 2023-05-08T08:41:18.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:18 smithi186 ceph-mon[126480]: pgmap v9560: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 72 KiB/s wr, 7 op/s 2023-05-08T08:41:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17817.970952 secs 2023-05-08T08:41:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17818.527424 secs 2023-05-08T08:41:19.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17817.970952 secs 2023-05-08T08:41:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17818.527424 secs 2023-05-08T08:41:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17817.970952 secs 2023-05-08T08:41:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17818.527424 secs 2023-05-08T08:41:20.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:20 smithi133 ceph-mon[125939]: pgmap v9561: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 71 KiB/s wr, 6 op/s 2023-05-08T08:41:20.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:20 smithi096 ceph-mon[124666]: pgmap v9561: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 71 KiB/s wr, 6 op/s 2023-05-08T08:41:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:20 smithi186 ceph-mon[126480]: pgmap v9561: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 71 KiB/s wr, 6 op/s 2023-05-08T08:41:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17819.811531 secs 2023-05-08T08:41:21.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17819.811531 secs 2023-05-08T08:41:21.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17819.811531 secs 2023-05-08T08:41:22.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:22 smithi133 ceph-mon[125939]: pgmap v9562: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 71 KiB/s wr, 6 op/s 2023-05-08T08:41:22.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:22 smithi096 ceph-mon[124666]: pgmap v9562: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 71 KiB/s wr, 6 op/s 2023-05-08T08:41:22.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:22 smithi186 ceph-mon[126480]: pgmap v9562: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 71 KiB/s wr, 6 op/s 2023-05-08T08:41:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17822.971067 secs 2023-05-08T08:41:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:24 smithi133 ceph-mon[125939]: pgmap v9563: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 65 KiB/s wr, 5 op/s 2023-05-08T08:41:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17823.527549 secs 2023-05-08T08:41:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17822.971067 secs 2023-05-08T08:41:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:24 smithi096 ceph-mon[124666]: pgmap v9563: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 65 KiB/s wr, 5 op/s 2023-05-08T08:41:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17823.527549 secs 2023-05-08T08:41:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17822.971067 secs 2023-05-08T08:41:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:24 smithi186 ceph-mon[126480]: pgmap v9563: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 65 KiB/s wr, 5 op/s 2023-05-08T08:41:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17823.527549 secs 2023-05-08T08:41:25.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17824.811644 secs 2023-05-08T08:41:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17824.811644 secs 2023-05-08T08:41:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17824.811644 secs 2023-05-08T08:41:26.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:26 smithi133 ceph-mon[125939]: pgmap v9564: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 102 KiB/s wr, 8 op/s 2023-05-08T08:41:26.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:26 smithi096 ceph-mon[124666]: pgmap v9564: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 102 KiB/s wr, 8 op/s 2023-05-08T08:41:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:26 smithi186 ceph-mon[126480]: pgmap v9564: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 102 KiB/s wr, 8 op/s 2023-05-08T08:41:28.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:28 smithi096 ceph-mon[124666]: pgmap v9565: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 43 KiB/s wr, 5 op/s 2023-05-08T08:41:28.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:28 smithi186 ceph-mon[126480]: pgmap v9565: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 43 KiB/s wr, 5 op/s 2023-05-08T08:41:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:28 smithi133 ceph-mon[125939]: pgmap v9565: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 43 KiB/s wr, 5 op/s 2023-05-08T08:41:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17827.971184 secs 2023-05-08T08:41:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17828.527669 secs 2023-05-08T08:41:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17827.971184 secs 2023-05-08T08:41:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17828.527669 secs 2023-05-08T08:41:29.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17827.971184 secs 2023-05-08T08:41:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17828.527669 secs 2023-05-08T08:41:30.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:30 smithi096 ceph-mon[124666]: pgmap v9566: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 43 KiB/s wr, 9 op/s 2023-05-08T08:41:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17829.811809 secs 2023-05-08T08:41:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:30 smithi186 ceph-mon[126480]: pgmap v9566: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 43 KiB/s wr, 9 op/s 2023-05-08T08:41:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17829.811809 secs 2023-05-08T08:41:30.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:30 smithi133 ceph-mon[125939]: pgmap v9566: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 43 KiB/s wr, 9 op/s 2023-05-08T08:41:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17829.811809 secs 2023-05-08T08:41:32.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:32 smithi096 ceph-mon[124666]: pgmap v9567: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 43 KiB/s wr, 6 op/s 2023-05-08T08:41:32.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:32 smithi186 ceph-mon[126480]: pgmap v9567: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 43 KiB/s wr, 6 op/s 2023-05-08T08:41:32.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:32 smithi133 ceph-mon[125939]: pgmap v9567: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 43 KiB/s wr, 6 op/s 2023-05-08T08:41:33.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:33 smithi186 ceph-mon[126480]: pgmap v9568: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 43 KiB/s wr, 6 op/s 2023-05-08T08:41:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:33 smithi133 ceph-mon[125939]: pgmap v9568: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 43 KiB/s wr, 6 op/s 2023-05-08T08:41:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:33 smithi096 ceph-mon[124666]: pgmap v9568: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 43 KiB/s wr, 6 op/s 2023-05-08T08:41:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17832.971247 secs 2023-05-08T08:41:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17833.527811 secs 2023-05-08T08:41:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17832.971247 secs 2023-05-08T08:41:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17833.527811 secs 2023-05-08T08:41:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17832.971247 secs 2023-05-08T08:41:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17833.527811 secs 2023-05-08T08:41:35.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17834.811919 secs 2023-05-08T08:41:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:35 smithi186 ceph-mon[126480]: pgmap v9569: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 188 KiB/s wr, 10 op/s 2023-05-08T08:41:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17834.811919 secs 2023-05-08T08:41:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:35 smithi133 ceph-mon[125939]: pgmap v9569: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 188 KiB/s wr, 10 op/s 2023-05-08T08:41:36.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17834.811919 secs 2023-05-08T08:41:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:35 smithi096 ceph-mon[124666]: pgmap v9569: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 188 KiB/s wr, 10 op/s 2023-05-08T08:41:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:38 smithi133 ceph-mon[125939]: pgmap v9570: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 145 KiB/s wr, 6 op/s 2023-05-08T08:41:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:38 smithi096 ceph-mon[124666]: pgmap v9570: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 145 KiB/s wr, 6 op/s 2023-05-08T08:41:38.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:38 smithi186 ceph-mon[126480]: pgmap v9570: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 145 KiB/s wr, 6 op/s 2023-05-08T08:41:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17837.971391 secs 2023-05-08T08:41:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17838.527930 secs 2023-05-08T08:41:39.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17837.971391 secs 2023-05-08T08:41:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17838.527930 secs 2023-05-08T08:41:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17837.971391 secs 2023-05-08T08:41:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17838.527930 secs 2023-05-08T08:41:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:40 smithi133 ceph-mon[125939]: pgmap v9571: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 146 KiB/s wr, 10 op/s 2023-05-08T08:41:40.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:40 smithi096 ceph-mon[124666]: pgmap v9571: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 146 KiB/s wr, 10 op/s 2023-05-08T08:41:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:40 smithi186 ceph-mon[126480]: pgmap v9571: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 146 KiB/s wr, 10 op/s 2023-05-08T08:41:42.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:42 smithi133 ceph-mon[125939]: pgmap v9572: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 145 KiB/s wr, 6 op/s 2023-05-08T08:41:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:42 smithi096 ceph-mon[124666]: pgmap v9572: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 145 KiB/s wr, 6 op/s 2023-05-08T08:41:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:42 smithi186 ceph-mon[126480]: pgmap v9572: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 145 KiB/s wr, 6 op/s 2023-05-08T08:41:43.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:41:43.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:41:43.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:41:44.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17842.971509 secs 2023-05-08T08:41:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:44 smithi133 ceph-mon[125939]: pgmap v9573: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 145 KiB/s wr, 6 op/s 2023-05-08T08:41:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:41:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:41:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:41:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17843.528044 secs 2023-05-08T08:41:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17842.971509 secs 2023-05-08T08:41:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:44 smithi096 ceph-mon[124666]: pgmap v9573: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 145 KiB/s wr, 6 op/s 2023-05-08T08:41:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:41:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:41:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:41:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17843.528044 secs 2023-05-08T08:41:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17842.971509 secs 2023-05-08T08:41:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:44 smithi186 ceph-mon[126480]: pgmap v9573: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 145 KiB/s wr, 6 op/s 2023-05-08T08:41:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:41:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:41:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:41:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17843.528044 secs 2023-05-08T08:41:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:46 smithi133 ceph-mon[125939]: pgmap v9574: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 545 KiB/s wr, 10 op/s 2023-05-08T08:41:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:46 smithi096 ceph-mon[124666]: pgmap v9574: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 545 KiB/s wr, 10 op/s 2023-05-08T08:41:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:46 smithi186 ceph-mon[126480]: pgmap v9574: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 545 KiB/s wr, 10 op/s 2023-05-08T08:41:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:48 smithi133 ceph-mon[125939]: pgmap v9575: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 400 KiB/s wr, 7 op/s 2023-05-08T08:41:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:48 smithi096 ceph-mon[124666]: pgmap v9575: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 400 KiB/s wr, 7 op/s 2023-05-08T08:41:48.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:48 smithi186 ceph-mon[126480]: pgmap v9575: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 400 KiB/s wr, 7 op/s 2023-05-08T08:41:49.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17847.971629 secs 2023-05-08T08:41:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17847.971629 secs 2023-05-08T08:41:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17847.971629 secs 2023-05-08T08:41:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:50 smithi133 ceph-mon[125939]: pgmap v9576: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 728 KiB/s rd, 479 KiB/s wr, 12 op/s 2023-05-08T08:41:50.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:50 smithi096 ceph-mon[124666]: pgmap v9576: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 728 KiB/s rd, 479 KiB/s wr, 12 op/s 2023-05-08T08:41:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:50 smithi186 ceph-mon[126480]: pgmap v9576: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 728 KiB/s rd, 479 KiB/s wr, 12 op/s 2023-05-08T08:41:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:41:51.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:41:51.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:41:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:52 smithi133 ceph-mon[125939]: pgmap v9577: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 581 KiB/s rd, 478 KiB/s wr, 8 op/s 2023-05-08T08:41:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:52 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:41:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:41:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:41:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:52 smithi096 ceph-mon[124666]: pgmap v9577: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 581 KiB/s rd, 478 KiB/s wr, 8 op/s 2023-05-08T08:41:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:52 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:41:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:41:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:41:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:52 smithi186 ceph-mon[126480]: pgmap v9577: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 581 KiB/s rd, 478 KiB/s wr, 8 op/s 2023-05-08T08:41:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:52 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:41:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:41:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:41:54.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17852.971739 secs 2023-05-08T08:41:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:54 smithi133 ceph-mon[125939]: pgmap v9578: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 581 KiB/s rd, 478 KiB/s wr, 8 op/s 2023-05-08T08:41:54.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17852.971739 secs 2023-05-08T08:41:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:54 smithi096 ceph-mon[124666]: pgmap v9578: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 581 KiB/s rd, 478 KiB/s wr, 8 op/s 2023-05-08T08:41:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17852.971739 secs 2023-05-08T08:41:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:54 smithi186 ceph-mon[126480]: pgmap v9578: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 581 KiB/s rd, 478 KiB/s wr, 8 op/s 2023-05-08T08:41:55.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17854.812439 secs 2023-05-08T08:41:55.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17854.812439 secs 2023-05-08T08:41:55.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17854.812439 secs 2023-05-08T08:41:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:56 smithi096 ceph-mon[124666]: pgmap v9579: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 875 KiB/s rd, 807 KiB/s wr, 15 op/s 2023-05-08T08:41:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:41:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:41:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:41:56.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:41:56.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:41:56.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:41:56.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:41:56.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:56 smithi186 ceph-mon[126480]: pgmap v9579: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 875 KiB/s rd, 807 KiB/s wr, 15 op/s 2023-05-08T08:41:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:41:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:41:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:41:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:41:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:41:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:41:56.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:41:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:56 smithi133 ceph-mon[125939]: pgmap v9579: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 875 KiB/s rd, 807 KiB/s wr, 15 op/s 2023-05-08T08:41:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:41:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:41:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:41:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:41:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:41:56.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:41:56.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:41:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:41:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:41:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:41:57.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:41:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:41:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:41:57.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:41:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:41:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:41:58.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:58 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:41:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:58 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T08:41:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:58 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T08:41:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:58 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:41:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:58 smithi096 ceph-mon[124666]: pgmap v9580: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 647 KiB/s rd, 408 KiB/s wr, 11 op/s 2023-05-08T08:41:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:58 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:41:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:58 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T08:41:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:58 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T08:41:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:58 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:41:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:58 smithi186 ceph-mon[126480]: pgmap v9580: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 647 KiB/s rd, 408 KiB/s wr, 11 op/s 2023-05-08T08:41:58.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:58 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:41:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:58 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T08:41:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:58 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T08:41:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:58 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:41:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:58 smithi133 ceph-mon[125939]: pgmap v9580: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 647 KiB/s rd, 408 KiB/s wr, 11 op/s 2023-05-08T08:41:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17857.971856 secs 2023-05-08T08:41:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:41:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17858.528370 secs 2023-05-08T08:41:59.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17857.971856 secs 2023-05-08T08:41:59.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:41:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17858.528370 secs 2023-05-08T08:42:00.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17857.971856 secs 2023-05-08T08:42:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:41:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17858.528370 secs 2023-05-08T08:42:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:00 smithi186 ceph-mon[126480]: pgmap v9581: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 744 KiB/s rd, 468 KiB/s wr, 15 op/s 2023-05-08T08:42:00.916 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:00 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:42:00.917 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:42:00.917 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:42:00.917 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:42:00.917 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17859.812574 secs 2023-05-08T08:42:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:00 smithi133 ceph-mon[125939]: pgmap v9581: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 744 KiB/s rd, 468 KiB/s wr, 15 op/s 2023-05-08T08:42:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:00 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:42:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:42:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:42:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:42:00.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17859.812574 secs 2023-05-08T08:42:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:00 smithi096 ceph-mon[124666]: pgmap v9581: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 744 KiB/s rd, 468 KiB/s wr, 15 op/s 2023-05-08T08:42:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:00 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:42:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:42:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:42:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:42:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17859.812574 secs 2023-05-08T08:42:01.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:01 smithi186 ceph-mon[126480]: pgmap v9582: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 389 KiB/s wr, 10 op/s 2023-05-08T08:42:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:01 smithi133 ceph-mon[125939]: pgmap v9582: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 389 KiB/s wr, 10 op/s 2023-05-08T08:42:02.030 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:01 smithi096 ceph-mon[124666]: pgmap v9582: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 389 KiB/s wr, 10 op/s 2023-05-08T08:42:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17862.971978 secs 2023-05-08T08:42:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:04 smithi133 ceph-mon[125939]: pgmap v9583: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 389 KiB/s wr, 10 op/s 2023-05-08T08:42:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17863.528510 secs 2023-05-08T08:42:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17862.971978 secs 2023-05-08T08:42:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:04 smithi096 ceph-mon[124666]: pgmap v9583: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 389 KiB/s wr, 10 op/s 2023-05-08T08:42:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17863.528510 secs 2023-05-08T08:42:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17862.971978 secs 2023-05-08T08:42:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:04 smithi186 ceph-mon[126480]: pgmap v9583: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 389 KiB/s wr, 10 op/s 2023-05-08T08:42:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17863.528510 secs 2023-05-08T08:42:06.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17864.812713 secs 2023-05-08T08:42:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:06 smithi133 ceph-mon[125939]: pgmap v9584: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 496 KiB/s wr, 28 op/s 2023-05-08T08:42:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:06 smithi133 ceph-mon[125939]: osdmap e676: 12 total, 12 up, 12 in 2023-05-08T08:42:06.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17864.812713 secs 2023-05-08T08:42:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:06 smithi096 ceph-mon[124666]: pgmap v9584: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 496 KiB/s wr, 28 op/s 2023-05-08T08:42:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:06 smithi096 ceph-mon[124666]: osdmap e676: 12 total, 12 up, 12 in 2023-05-08T08:42:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17864.812713 secs 2023-05-08T08:42:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:06 smithi186 ceph-mon[126480]: pgmap v9584: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 496 KiB/s wr, 28 op/s 2023-05-08T08:42:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:06 smithi186 ceph-mon[126480]: osdmap e676: 12 total, 12 up, 12 in 2023-05-08T08:42:08.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:08 smithi133 ceph-mon[125939]: pgmap v9586: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 201 KiB/s wr, 26 op/s 2023-05-08T08:42:08.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:08 smithi096 ceph-mon[124666]: pgmap v9586: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 201 KiB/s wr, 26 op/s 2023-05-08T08:42:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:08 smithi186 ceph-mon[126480]: pgmap v9586: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 201 KiB/s wr, 26 op/s 2023-05-08T08:42:09.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17867.972113 secs 2023-05-08T08:42:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17868.528625 secs 2023-05-08T08:42:09.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17867.972113 secs 2023-05-08T08:42:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17868.528625 secs 2023-05-08T08:42:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17867.972113 secs 2023-05-08T08:42:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17868.528625 secs 2023-05-08T08:42:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:10 smithi133 ceph-mon[125939]: pgmap v9587: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 129 KiB/s wr, 25 op/s 2023-05-08T08:42:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:10 smithi096 ceph-mon[124666]: pgmap v9587: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 129 KiB/s wr, 25 op/s 2023-05-08T08:42:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:10 smithi186 ceph-mon[126480]: pgmap v9587: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 129 KiB/s wr, 25 op/s 2023-05-08T08:42:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17869.812839 secs 2023-05-08T08:42:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17869.812839 secs 2023-05-08T08:42:11.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17869.812839 secs 2023-05-08T08:42:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:12 smithi133 ceph-mon[125939]: pgmap v9588: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 129 KiB/s wr, 24 op/s 2023-05-08T08:42:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:12 smithi133 ceph-mon[125939]: osdmap e677: 12 total, 12 up, 12 in 2023-05-08T08:42:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:12 smithi096 ceph-mon[124666]: pgmap v9588: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 129 KiB/s wr, 24 op/s 2023-05-08T08:42:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:12 smithi096 ceph-mon[124666]: osdmap e677: 12 total, 12 up, 12 in 2023-05-08T08:42:12.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:12 smithi186 ceph-mon[126480]: pgmap v9588: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 129 KiB/s wr, 24 op/s 2023-05-08T08:42:12.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:12 smithi186 ceph-mon[126480]: osdmap e677: 12 total, 12 up, 12 in 2023-05-08T08:42:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17872.972261 secs 2023-05-08T08:42:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:14 smithi133 ceph-mon[125939]: pgmap v9590: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 895 B/s wr, 5 op/s 2023-05-08T08:42:14.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17873.528707 secs 2023-05-08T08:42:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17872.972261 secs 2023-05-08T08:42:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:14 smithi096 ceph-mon[124666]: pgmap v9590: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 895 B/s wr, 5 op/s 2023-05-08T08:42:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17873.528707 secs 2023-05-08T08:42:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17872.972261 secs 2023-05-08T08:42:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:14 smithi186 ceph-mon[126480]: pgmap v9590: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 895 B/s wr, 5 op/s 2023-05-08T08:42:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17873.528707 secs 2023-05-08T08:42:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17874.812956 secs 2023-05-08T08:42:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:16 smithi133 ceph-mon[125939]: pgmap v9591: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 101 KiB/s wr, 7 op/s 2023-05-08T08:42:16.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17874.812956 secs 2023-05-08T08:42:16.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:16 smithi096 ceph-mon[124666]: pgmap v9591: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 101 KiB/s wr, 7 op/s 2023-05-08T08:42:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17874.812956 secs 2023-05-08T08:42:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:16 smithi186 ceph-mon[126480]: pgmap v9591: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 101 KiB/s wr, 7 op/s 2023-05-08T08:42:18.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:18 smithi133 ceph-mon[125939]: pgmap v9592: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 101 KiB/s wr, 7 op/s 2023-05-08T08:42:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:18 smithi096 ceph-mon[124666]: pgmap v9592: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 101 KiB/s wr, 7 op/s 2023-05-08T08:42:18.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:18 smithi186 ceph-mon[126480]: pgmap v9592: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 101 KiB/s wr, 7 op/s 2023-05-08T08:42:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17877.972352 secs 2023-05-08T08:42:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17878.528819 secs 2023-05-08T08:42:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17877.972352 secs 2023-05-08T08:42:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17878.528819 secs 2023-05-08T08:42:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17877.972352 secs 2023-05-08T08:42:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17878.528819 secs 2023-05-08T08:42:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:20 smithi133 ceph-mon[125939]: pgmap v9593: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 100 KiB/s wr, 6 op/s 2023-05-08T08:42:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:20 smithi096 ceph-mon[124666]: pgmap v9593: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 100 KiB/s wr, 6 op/s 2023-05-08T08:42:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:20 smithi186 ceph-mon[126480]: pgmap v9593: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 100 KiB/s wr, 6 op/s 2023-05-08T08:42:21.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17879.813074 secs 2023-05-08T08:42:21.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17879.813074 secs 2023-05-08T08:42:21.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17879.813074 secs 2023-05-08T08:42:22.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:22 smithi133 ceph-mon[125939]: pgmap v9594: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 100 KiB/s wr, 6 op/s 2023-05-08T08:42:22.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:22 smithi096 ceph-mon[124666]: pgmap v9594: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 100 KiB/s wr, 6 op/s 2023-05-08T08:42:22.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:22 smithi186 ceph-mon[126480]: pgmap v9594: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 100 KiB/s wr, 6 op/s 2023-05-08T08:42:24.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17882.972470 secs 2023-05-08T08:42:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:24 smithi133 ceph-mon[125939]: pgmap v9595: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 91 KiB/s wr, 5 op/s 2023-05-08T08:42:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17883.528970 secs 2023-05-08T08:42:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17882.972470 secs 2023-05-08T08:42:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:24 smithi096 ceph-mon[124666]: pgmap v9595: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 91 KiB/s wr, 5 op/s 2023-05-08T08:42:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17883.528970 secs 2023-05-08T08:42:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17882.972470 secs 2023-05-08T08:42:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:24 smithi186 ceph-mon[126480]: pgmap v9595: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 91 KiB/s wr, 5 op/s 2023-05-08T08:42:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17883.528970 secs 2023-05-08T08:42:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17884.813195 secs 2023-05-08T08:42:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17884.813195 secs 2023-05-08T08:42:25.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17884.813195 secs 2023-05-08T08:42:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:26 smithi096 ceph-mon[124666]: pgmap v9596: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 84 KiB/s wr, 8 op/s 2023-05-08T08:42:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:26 smithi186 ceph-mon[126480]: pgmap v9596: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 84 KiB/s wr, 8 op/s 2023-05-08T08:42:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:26 smithi133 ceph-mon[125939]: pgmap v9596: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 84 KiB/s wr, 8 op/s 2023-05-08T08:42:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:28 smithi096 ceph-mon[124666]: pgmap v9597: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T08:42:28.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:28 smithi186 ceph-mon[126480]: pgmap v9597: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T08:42:28.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:28 smithi133 ceph-mon[125939]: pgmap v9597: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T08:42:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17887.972585 secs 2023-05-08T08:42:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17888.529091 secs 2023-05-08T08:42:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17887.972585 secs 2023-05-08T08:42:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17888.529091 secs 2023-05-08T08:42:29.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17887.972585 secs 2023-05-08T08:42:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17888.529091 secs 2023-05-08T08:42:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:30 smithi096 ceph-mon[124666]: pgmap v9598: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 115 KiB/s wr, 9 op/s 2023-05-08T08:42:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17889.813317 secs 2023-05-08T08:42:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:30 smithi186 ceph-mon[126480]: pgmap v9598: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 115 KiB/s wr, 9 op/s 2023-05-08T08:42:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17889.813317 secs 2023-05-08T08:42:30.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:30 smithi133 ceph-mon[125939]: pgmap v9598: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 115 KiB/s wr, 9 op/s 2023-05-08T08:42:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17889.813317 secs 2023-05-08T08:42:32.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:32 smithi186 ceph-mon[126480]: pgmap v9599: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 115 KiB/s wr, 6 op/s 2023-05-08T08:42:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:32 smithi133 ceph-mon[125939]: pgmap v9599: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 115 KiB/s wr, 6 op/s 2023-05-08T08:42:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:32 smithi096 ceph-mon[124666]: pgmap v9599: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 115 KiB/s wr, 6 op/s 2023-05-08T08:42:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17892.972700 secs 2023-05-08T08:42:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:34 smithi186 ceph-mon[126480]: pgmap v9600: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 115 KiB/s wr, 6 op/s 2023-05-08T08:42:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17893.529209 secs 2023-05-08T08:42:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17892.972700 secs 2023-05-08T08:42:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:34 smithi133 ceph-mon[125939]: pgmap v9600: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 115 KiB/s wr, 6 op/s 2023-05-08T08:42:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17893.529209 secs 2023-05-08T08:42:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17892.972700 secs 2023-05-08T08:42:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:34 smithi096 ceph-mon[124666]: pgmap v9600: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 115 KiB/s wr, 6 op/s 2023-05-08T08:42:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17893.529209 secs 2023-05-08T08:42:35.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17894.813449 secs 2023-05-08T08:42:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:35 smithi186 ceph-mon[126480]: pgmap v9601: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 115 KiB/s wr, 9 op/s 2023-05-08T08:42:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17894.813449 secs 2023-05-08T08:42:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:35 smithi133 ceph-mon[125939]: pgmap v9601: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 115 KiB/s wr, 9 op/s 2023-05-08T08:42:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17894.813449 secs 2023-05-08T08:42:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:35 smithi096 ceph-mon[124666]: pgmap v9601: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 115 KiB/s wr, 9 op/s 2023-05-08T08:42:38.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:38 smithi133 ceph-mon[125939]: pgmap v9602: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 115 KiB/s wr, 6 op/s 2023-05-08T08:42:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:38 smithi096 ceph-mon[124666]: pgmap v9602: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 115 KiB/s wr, 6 op/s 2023-05-08T08:42:38.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:38 smithi186 ceph-mon[126480]: pgmap v9602: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 115 KiB/s wr, 6 op/s 2023-05-08T08:42:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17897.972818 secs 2023-05-08T08:42:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17898.529318 secs 2023-05-08T08:42:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17897.972818 secs 2023-05-08T08:42:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17898.529318 secs 2023-05-08T08:42:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17897.972818 secs 2023-05-08T08:42:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17898.529318 secs 2023-05-08T08:42:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:40 smithi133 ceph-mon[125939]: pgmap v9603: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 115 KiB/s wr, 9 op/s 2023-05-08T08:42:40.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:40 smithi096 ceph-mon[124666]: pgmap v9603: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 115 KiB/s wr, 9 op/s 2023-05-08T08:42:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:40 smithi186 ceph-mon[126480]: pgmap v9603: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 115 KiB/s wr, 9 op/s 2023-05-08T08:42:42.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:42 smithi133 ceph-mon[125939]: pgmap v9604: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T08:42:42.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:42 smithi096 ceph-mon[124666]: pgmap v9604: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T08:42:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:42 smithi186 ceph-mon[126480]: pgmap v9604: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T08:42:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:42:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:42:43.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:42:44.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17902.972938 secs 2023-05-08T08:42:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:44 smithi133 ceph-mon[125939]: pgmap v9605: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T08:42:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:42:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:42:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:42:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17903.529438 secs 2023-05-08T08:42:44.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17902.972938 secs 2023-05-08T08:42:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:44 smithi096 ceph-mon[124666]: pgmap v9605: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T08:42:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:42:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:42:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:42:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17903.529438 secs 2023-05-08T08:42:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17902.972938 secs 2023-05-08T08:42:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:44 smithi186 ceph-mon[126480]: pgmap v9605: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T08:42:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:42:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:42:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:42:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17903.529438 secs 2023-05-08T08:42:46.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:46 smithi133 ceph-mon[125939]: pgmap v9606: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 122 KiB/s wr, 9 op/s 2023-05-08T08:42:46.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:46 smithi096 ceph-mon[124666]: pgmap v9606: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 122 KiB/s wr, 9 op/s 2023-05-08T08:42:46.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:46 smithi186 ceph-mon[126480]: pgmap v9606: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 122 KiB/s wr, 9 op/s 2023-05-08T08:42:48.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:48 smithi133 ceph-mon[125939]: pgmap v9607: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 122 KiB/s wr, 6 op/s 2023-05-08T08:42:48.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:48 smithi096 ceph-mon[124666]: pgmap v9607: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 122 KiB/s wr, 6 op/s 2023-05-08T08:42:48.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:48 smithi186 ceph-mon[126480]: pgmap v9607: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 122 KiB/s wr, 6 op/s 2023-05-08T08:42:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17907.973035 secs 2023-05-08T08:42:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17907.973035 secs 2023-05-08T08:42:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17907.973035 secs 2023-05-08T08:42:50.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:50 smithi096 ceph-mon[124666]: pgmap v9608: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 611 KiB/s rd, 340 KiB/s wr, 10 op/s 2023-05-08T08:42:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:50 smithi186 ceph-mon[126480]: pgmap v9608: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 611 KiB/s rd, 340 KiB/s wr, 10 op/s 2023-05-08T08:42:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:50 smithi133 ceph-mon[125939]: pgmap v9608: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 611 KiB/s rd, 340 KiB/s wr, 10 op/s 2023-05-08T08:42:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:42:51.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:42:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:42:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:52 smithi096 ceph-mon[124666]: pgmap v9609: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 610 KiB/s rd, 340 KiB/s wr, 8 op/s 2023-05-08T08:42:52.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:52 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:42:52.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:42:52.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:42:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:52 smithi186 ceph-mon[126480]: pgmap v9609: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 610 KiB/s rd, 340 KiB/s wr, 8 op/s 2023-05-08T08:42:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:52 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:42:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:42:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:42:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:52 smithi133 ceph-mon[125939]: pgmap v9609: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 610 KiB/s rd, 340 KiB/s wr, 8 op/s 2023-05-08T08:42:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:52 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:42:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:42:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:42:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:54 smithi096 ceph-mon[124666]: pgmap v9610: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 609 KiB/s rd, 340 KiB/s wr, 7 op/s 2023-05-08T08:42:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17913.529694 secs 2023-05-08T08:42:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:54 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:42:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:54 smithi186 ceph-mon[126480]: pgmap v9610: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 609 KiB/s rd, 340 KiB/s wr, 7 op/s 2023-05-08T08:42:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17913.529694 secs 2023-05-08T08:42:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:54 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:42:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:54 smithi133 ceph-mon[125939]: pgmap v9610: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 609 KiB/s rd, 340 KiB/s wr, 7 op/s 2023-05-08T08:42:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17913.529694 secs 2023-05-08T08:42:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:54 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:42:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:55 smithi096 ceph-mon[124666]: Health check cleared: MDS_SLOW_REQUEST (was: 1 MDSs report slow requests) 2023-05-08T08:42:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:55 smithi096 ceph-mon[124666]: Cluster is now healthy 2023-05-08T08:42:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:55 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T08:42:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:55 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:42:55.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:55 smithi186 ceph-mon[126480]: Health check cleared: MDS_SLOW_REQUEST (was: 1 MDSs report slow requests) 2023-05-08T08:42:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:55 smithi186 ceph-mon[126480]: Cluster is now healthy 2023-05-08T08:42:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:55 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T08:42:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:55 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:42:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:55 smithi133 ceph-mon[125939]: Health check cleared: MDS_SLOW_REQUEST (was: 1 MDSs report slow requests) 2023-05-08T08:42:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:55 smithi133 ceph-mon[125939]: Cluster is now healthy 2023-05-08T08:42:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:55 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T08:42:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:55 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:42:56.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:56 smithi186 ceph-mon[126480]: pgmap v9611: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 918 KiB/s rd, 636 KiB/s wr, 13 op/s 2023-05-08T08:42:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:56 smithi186 ceph-mon[126480]: Health check failed: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:42:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:42:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:42:56.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:56 smithi133 ceph-mon[125939]: pgmap v9611: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 918 KiB/s rd, 636 KiB/s wr, 13 op/s 2023-05-08T08:42:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:56 smithi133 ceph-mon[125939]: Health check failed: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:42:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:42:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:42:57.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:56 smithi096 ceph-mon[124666]: pgmap v9611: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 918 KiB/s rd, 636 KiB/s wr, 13 op/s 2023-05-08T08:42:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:56 smithi096 ceph-mon[124666]: Health check failed: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:42:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:42:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:42:57.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:42:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:42:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:42:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:42:57.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:42:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:42:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:42:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:42:58.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:42:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:42:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:42:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:42:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:58 smithi186 ceph-mon[126480]: pgmap v9612: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 515 KiB/s wr, 10 op/s 2023-05-08T08:42:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:58 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:42:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:58 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T08:42:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:58 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T08:42:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:58 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:42:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:58 smithi133 ceph-mon[125939]: pgmap v9612: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 515 KiB/s wr, 10 op/s 2023-05-08T08:42:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:58 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:42:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:58 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T08:42:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:58 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T08:42:58.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:58 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:42:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:58 smithi096 ceph-mon[124666]: pgmap v9612: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 515 KiB/s wr, 10 op/s 2023-05-08T08:42:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:58 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:42:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:58 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T08:42:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:58 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T08:42:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:58 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:42:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17917.973304 secs 2023-05-08T08:42:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:59 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:42:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:42:59 smithi186 ceph-mon[126480]: pgmap v9613: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 730 KiB/s rd, 610 KiB/s wr, 15 op/s 2023-05-08T08:42:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17917.973304 secs 2023-05-08T08:42:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:59 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:42:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:42:59 smithi133 ceph-mon[125939]: pgmap v9613: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 730 KiB/s rd, 610 KiB/s wr, 15 op/s 2023-05-08T08:43:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17917.973304 secs 2023-05-08T08:43:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:59 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:43:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:42:59 smithi096 ceph-mon[124666]: pgmap v9613: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 730 KiB/s rd, 610 KiB/s wr, 15 op/s 2023-05-08T08:43:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:00 smithi186 ceph-mon[126480]: Health check cleared: MDS_SLOW_REQUEST (was: 1 MDSs report slow requests) 2023-05-08T08:43:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:00 smithi186 ceph-mon[126480]: Cluster is now healthy 2023-05-08T08:43:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:43:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:43:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17919.813950 secs 2023-05-08T08:43:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:00 smithi133 ceph-mon[125939]: Health check cleared: MDS_SLOW_REQUEST (was: 1 MDSs report slow requests) 2023-05-08T08:43:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:00 smithi133 ceph-mon[125939]: Cluster is now healthy 2023-05-08T08:43:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:43:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:43:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17919.813950 secs 2023-05-08T08:43:01.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:00 smithi096 ceph-mon[124666]: Health check cleared: MDS_SLOW_REQUEST (was: 1 MDSs report slow requests) 2023-05-08T08:43:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:00 smithi096 ceph-mon[124666]: Cluster is now healthy 2023-05-08T08:43:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:43:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:43:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17919.813950 secs 2023-05-08T08:43:01.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:01 smithi186 ceph-mon[126480]: pgmap v9614: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 404 KiB/s rd, 392 KiB/s wr, 11 op/s 2023-05-08T08:43:01.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:01 smithi133 ceph-mon[125939]: pgmap v9614: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 404 KiB/s rd, 392 KiB/s wr, 11 op/s 2023-05-08T08:43:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:01 smithi096 ceph-mon[124666]: pgmap v9614: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 404 KiB/s rd, 392 KiB/s wr, 11 op/s 2023-05-08T08:43:03.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:03 smithi133 ceph-mon[125939]: Health check failed: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:43:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T08:43:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:03 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:43:03.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:03 smithi096 ceph-mon[124666]: Health check failed: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:43:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T08:43:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:03 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:43:03.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:03 smithi186 ceph-mon[126480]: Health check failed: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:43:03.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T08:43:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:03 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:43:04.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17922.973443 secs 2023-05-08T08:43:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:04 smithi133 ceph-mon[125939]: pgmap v9615: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 404 KiB/s rd, 392 KiB/s wr, 11 op/s 2023-05-08T08:43:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:04 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:43:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:04 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:43:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17923.529915 secs 2023-05-08T08:43:04.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17922.973443 secs 2023-05-08T08:43:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:04 smithi096 ceph-mon[124666]: pgmap v9615: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 404 KiB/s rd, 392 KiB/s wr, 11 op/s 2023-05-08T08:43:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:04 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:43:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:04 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:43:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17923.529915 secs 2023-05-08T08:43:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17922.973443 secs 2023-05-08T08:43:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:04 smithi186 ceph-mon[126480]: pgmap v9615: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 404 KiB/s rd, 392 KiB/s wr, 11 op/s 2023-05-08T08:43:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:04 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:43:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:04 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:43:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17923.529915 secs 2023-05-08T08:43:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17924.814013 secs 2023-05-08T08:43:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:06 smithi133 ceph-mon[125939]: pgmap v9616: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 541 KiB/s rd, 563 KiB/s wr, 30 op/s 2023-05-08T08:43:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:06 smithi133 ceph-mon[125939]: osdmap e678: 12 total, 12 up, 12 in 2023-05-08T08:43:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17924.814013 secs 2023-05-08T08:43:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:06 smithi096 ceph-mon[124666]: pgmap v9616: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 541 KiB/s rd, 563 KiB/s wr, 30 op/s 2023-05-08T08:43:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:06 smithi096 ceph-mon[124666]: osdmap e678: 12 total, 12 up, 12 in 2023-05-08T08:43:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17924.814013 secs 2023-05-08T08:43:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:06 smithi186 ceph-mon[126480]: pgmap v9616: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 541 KiB/s rd, 563 KiB/s wr, 30 op/s 2023-05-08T08:43:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:06 smithi186 ceph-mon[126480]: osdmap e678: 12 total, 12 up, 12 in 2023-05-08T08:43:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:08 smithi133 ceph-mon[125939]: pgmap v9618: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 320 KiB/s wr, 30 op/s 2023-05-08T08:43:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:43:08.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:43:08.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:08 smithi096 ceph-mon[124666]: pgmap v9618: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 320 KiB/s wr, 30 op/s 2023-05-08T08:43:08.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:43:08.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:43:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:08 smithi186 ceph-mon[126480]: pgmap v9618: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 320 KiB/s wr, 30 op/s 2023-05-08T08:43:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:43:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:43:09.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17927.973580 secs 2023-05-08T08:43:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17928.530041 secs 2023-05-08T08:43:09.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17927.973580 secs 2023-05-08T08:43:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17928.530041 secs 2023-05-08T08:43:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17927.973580 secs 2023-05-08T08:43:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17928.530041 secs 2023-05-08T08:43:10.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:10 smithi133 ceph-mon[125939]: pgmap v9619: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 378 KiB/s wr, 28 op/s 2023-05-08T08:43:10.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:10 smithi096 ceph-mon[124666]: pgmap v9619: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 378 KiB/s wr, 28 op/s 2023-05-08T08:43:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:10 smithi186 ceph-mon[126480]: pgmap v9619: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 378 KiB/s wr, 28 op/s 2023-05-08T08:43:11.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17929.814133 secs 2023-05-08T08:43:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17929.814133 secs 2023-05-08T08:43:11.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17929.814133 secs 2023-05-08T08:43:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:12 smithi096 ceph-mon[124666]: pgmap v9620: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 378 KiB/s wr, 28 op/s 2023-05-08T08:43:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:12 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:43:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:12 smithi096 ceph-mon[124666]: osdmap e679: 12 total, 12 up, 12 in 2023-05-08T08:43:12.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:12 smithi186 ceph-mon[126480]: pgmap v9620: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 378 KiB/s wr, 28 op/s 2023-05-08T08:43:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:12 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:43:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:12 smithi186 ceph-mon[126480]: osdmap e679: 12 total, 12 up, 12 in 2023-05-08T08:43:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:12 smithi133 ceph-mon[125939]: pgmap v9620: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 378 KiB/s wr, 28 op/s 2023-05-08T08:43:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:12 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:43:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:12 smithi133 ceph-mon[125939]: osdmap e679: 12 total, 12 up, 12 in 2023-05-08T08:43:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17932.973658 secs 2023-05-08T08:43:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:14 smithi096 ceph-mon[124666]: pgmap v9622: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 216 KiB/s wr, 5 op/s 2023-05-08T08:43:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17933.530120 secs 2023-05-08T08:43:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17932.973658 secs 2023-05-08T08:43:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:14 smithi186 ceph-mon[126480]: pgmap v9622: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 216 KiB/s wr, 5 op/s 2023-05-08T08:43:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17933.530120 secs 2023-05-08T08:43:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17932.973658 secs 2023-05-08T08:43:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:14 smithi133 ceph-mon[125939]: pgmap v9622: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 216 KiB/s wr, 5 op/s 2023-05-08T08:43:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17933.530120 secs 2023-05-08T08:43:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17934.814253 secs 2023-05-08T08:43:15.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17934.814253 secs 2023-05-08T08:43:15.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17934.814253 secs 2023-05-08T08:43:16.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:16 smithi096 ceph-mon[124666]: pgmap v9623: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 227 KiB/s wr, 9 op/s 2023-05-08T08:43:16.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:16 smithi186 ceph-mon[126480]: pgmap v9623: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 227 KiB/s wr, 9 op/s 2023-05-08T08:43:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:16 smithi133 ceph-mon[125939]: pgmap v9623: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 227 KiB/s wr, 9 op/s 2023-05-08T08:43:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:18 smithi096 ceph-mon[124666]: pgmap v9624: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 226 KiB/s wr, 9 op/s 2023-05-08T08:43:18.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:18 smithi186 ceph-mon[126480]: pgmap v9624: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 226 KiB/s wr, 9 op/s 2023-05-08T08:43:18.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:18 smithi133 ceph-mon[125939]: pgmap v9624: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 226 KiB/s wr, 9 op/s 2023-05-08T08:43:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17937.973755 secs 2023-05-08T08:43:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17938.530233 secs 2023-05-08T08:43:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17937.973755 secs 2023-05-08T08:43:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17938.530233 secs 2023-05-08T08:43:20.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17937.973755 secs 2023-05-08T08:43:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17938.530233 secs 2023-05-08T08:43:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:20 smithi186 ceph-mon[126480]: pgmap v9625: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 54 KiB/s wr, 7 op/s 2023-05-08T08:43:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17939.814387 secs 2023-05-08T08:43:20.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:20 smithi133 ceph-mon[125939]: pgmap v9625: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 54 KiB/s wr, 7 op/s 2023-05-08T08:43:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17939.814387 secs 2023-05-08T08:43:21.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:20 smithi096 ceph-mon[124666]: pgmap v9625: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 54 KiB/s wr, 7 op/s 2023-05-08T08:43:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17939.814387 secs 2023-05-08T08:43:22.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:22 smithi186 ceph-mon[126480]: pgmap v9626: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 54 KiB/s wr, 7 op/s 2023-05-08T08:43:22.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:22 smithi133 ceph-mon[125939]: pgmap v9626: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 54 KiB/s wr, 7 op/s 2023-05-08T08:43:23.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:22 smithi096 ceph-mon[124666]: pgmap v9626: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 54 KiB/s wr, 7 op/s 2023-05-08T08:43:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17942.973869 secs 2023-05-08T08:43:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:24 smithi186 ceph-mon[126480]: pgmap v9627: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 49 KiB/s wr, 6 op/s 2023-05-08T08:43:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17943.530348 secs 2023-05-08T08:43:24.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17942.973869 secs 2023-05-08T08:43:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:24 smithi133 ceph-mon[125939]: pgmap v9627: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 49 KiB/s wr, 6 op/s 2023-05-08T08:43:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17943.530348 secs 2023-05-08T08:43:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17942.973869 secs 2023-05-08T08:43:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:24 smithi096 ceph-mon[124666]: pgmap v9627: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 49 KiB/s wr, 6 op/s 2023-05-08T08:43:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17943.530348 secs 2023-05-08T08:43:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17944.814504 secs 2023-05-08T08:43:25.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17944.814504 secs 2023-05-08T08:43:26.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17944.814504 secs 2023-05-08T08:43:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:26 smithi186 ceph-mon[126480]: pgmap v9628: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 45 KiB/s wr, 8 op/s 2023-05-08T08:43:26.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:26 smithi133 ceph-mon[125939]: pgmap v9628: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 45 KiB/s wr, 8 op/s 2023-05-08T08:43:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:26 smithi096 ceph-mon[124666]: pgmap v9628: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 45 KiB/s wr, 8 op/s 2023-05-08T08:43:28.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:28 smithi133 ceph-mon[125939]: pgmap v9629: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T08:43:28.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:28 smithi096 ceph-mon[124666]: pgmap v9629: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T08:43:28.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:28 smithi186 ceph-mon[126480]: pgmap v9629: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T08:43:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17947.973978 secs 2023-05-08T08:43:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17948.530480 secs 2023-05-08T08:43:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17947.973978 secs 2023-05-08T08:43:29.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17948.530480 secs 2023-05-08T08:43:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17947.973978 secs 2023-05-08T08:43:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17948.530480 secs 2023-05-08T08:43:30.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:30 smithi133 ceph-mon[125939]: pgmap v9630: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 7 op/s 2023-05-08T08:43:30.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:30 smithi096 ceph-mon[124666]: pgmap v9630: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 7 op/s 2023-05-08T08:43:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:30 smithi186 ceph-mon[126480]: pgmap v9630: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 7 op/s 2023-05-08T08:43:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17949.814643 secs 2023-05-08T08:43:31.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17949.814643 secs 2023-05-08T08:43:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17949.814643 secs 2023-05-08T08:43:32.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:32 smithi133 ceph-mon[125939]: pgmap v9631: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T08:43:32.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:32 smithi096 ceph-mon[124666]: pgmap v9631: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T08:43:32.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:32 smithi186 ceph-mon[126480]: pgmap v9631: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T08:43:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17952.974096 secs 2023-05-08T08:43:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:34 smithi133 ceph-mon[125939]: pgmap v9632: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T08:43:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17953.530604 secs 2023-05-08T08:43:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17952.974096 secs 2023-05-08T08:43:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:34 smithi096 ceph-mon[124666]: pgmap v9632: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T08:43:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17953.530604 secs 2023-05-08T08:43:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17952.974096 secs 2023-05-08T08:43:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:34 smithi186 ceph-mon[126480]: pgmap v9632: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T08:43:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17953.530604 secs 2023-05-08T08:43:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17954.814753 secs 2023-05-08T08:43:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:36 smithi133 ceph-mon[125939]: pgmap v9633: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 56 KiB/s wr, 8 op/s 2023-05-08T08:43:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17954.814753 secs 2023-05-08T08:43:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:36 smithi096 ceph-mon[124666]: pgmap v9633: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 56 KiB/s wr, 8 op/s 2023-05-08T08:43:36.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17954.814753 secs 2023-05-08T08:43:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:36 smithi186 ceph-mon[126480]: pgmap v9633: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 56 KiB/s wr, 8 op/s 2023-05-08T08:43:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:38 smithi096 ceph-mon[124666]: pgmap v9634: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 6 op/s 2023-05-08T08:43:38.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:38 smithi186 ceph-mon[126480]: pgmap v9634: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 6 op/s 2023-05-08T08:43:38.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:38 smithi133 ceph-mon[125939]: pgmap v9634: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 6 op/s 2023-05-08T08:43:39.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17957.974216 secs 2023-05-08T08:43:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17958.530704 secs 2023-05-08T08:43:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17957.974216 secs 2023-05-08T08:43:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17958.530704 secs 2023-05-08T08:43:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17957.974216 secs 2023-05-08T08:43:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17958.530704 secs 2023-05-08T08:43:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:40 smithi096 ceph-mon[124666]: pgmap v9635: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 56 KiB/s wr, 9 op/s 2023-05-08T08:43:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:40 smithi186 ceph-mon[126480]: pgmap v9635: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 56 KiB/s wr, 9 op/s 2023-05-08T08:43:40.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:40 smithi133 ceph-mon[125939]: pgmap v9635: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 56 KiB/s wr, 9 op/s 2023-05-08T08:43:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:42 smithi096 ceph-mon[124666]: pgmap v9636: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 6 op/s 2023-05-08T08:43:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:42 smithi186 ceph-mon[126480]: pgmap v9636: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 6 op/s 2023-05-08T08:43:42.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:42 smithi133 ceph-mon[125939]: pgmap v9636: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 6 op/s 2023-05-08T08:43:43.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:43:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:43:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:43:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17962.974368 secs 2023-05-08T08:43:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:44 smithi186 ceph-mon[126480]: pgmap v9637: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 6 op/s 2023-05-08T08:43:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:43:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:43:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:43:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17963.530771 secs 2023-05-08T08:43:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17962.974368 secs 2023-05-08T08:43:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:44 smithi133 ceph-mon[125939]: pgmap v9637: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 6 op/s 2023-05-08T08:43:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:43:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:43:44.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:43:44.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17963.530771 secs 2023-05-08T08:43:45.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17962.974368 secs 2023-05-08T08:43:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:44 smithi096 ceph-mon[124666]: pgmap v9637: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 6 op/s 2023-05-08T08:43:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:43:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:43:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:43:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17963.530771 secs 2023-05-08T08:43:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:46 smithi186 ceph-mon[126480]: pgmap v9638: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 155 KiB/s wr, 10 op/s 2023-05-08T08:43:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:46 smithi133 ceph-mon[125939]: pgmap v9638: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 155 KiB/s wr, 10 op/s 2023-05-08T08:43:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:46 smithi096 ceph-mon[124666]: pgmap v9638: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 155 KiB/s wr, 10 op/s 2023-05-08T08:43:48.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:48 smithi186 ceph-mon[126480]: pgmap v9639: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 100 KiB/s wr, 6 op/s 2023-05-08T08:43:48.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:48 smithi133 ceph-mon[125939]: pgmap v9639: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 100 KiB/s wr, 6 op/s 2023-05-08T08:43:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:48 smithi096 ceph-mon[124666]: pgmap v9639: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 100 KiB/s wr, 6 op/s 2023-05-08T08:43:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17967.974485 secs 2023-05-08T08:43:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17967.974485 secs 2023-05-08T08:43:50.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17967.974485 secs 2023-05-08T08:43:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:50 smithi186 ceph-mon[126480]: pgmap v9640: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 508 KiB/s rd, 273 KiB/s wr, 11 op/s 2023-05-08T08:43:50.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:50 smithi133 ceph-mon[125939]: pgmap v9640: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 508 KiB/s rd, 273 KiB/s wr, 11 op/s 2023-05-08T08:43:51.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:50 smithi096 ceph-mon[124666]: pgmap v9640: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 508 KiB/s rd, 273 KiB/s wr, 11 op/s 2023-05-08T08:43:51.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:43:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:51 smithi186 ceph-mon[126480]: pgmap v9641: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 272 KiB/s wr, 8 op/s 2023-05-08T08:43:51.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:43:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:51 smithi133 ceph-mon[125939]: pgmap v9641: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 272 KiB/s wr, 8 op/s 2023-05-08T08:43:52.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:43:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:51 smithi096 ceph-mon[124666]: pgmap v9641: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 272 KiB/s wr, 8 op/s 2023-05-08T08:43:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:52 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:43:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:43:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:43:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:52 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:43:52.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:43:52.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:43:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:52 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:43:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:43:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:43:53.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:53 smithi186 ceph-mon[126480]: pgmap v9642: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 272 KiB/s wr, 8 op/s 2023-05-08T08:43:53.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:53 smithi133 ceph-mon[125939]: pgmap v9642: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 272 KiB/s wr, 8 op/s 2023-05-08T08:43:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:53 smithi096 ceph-mon[124666]: pgmap v9642: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 272 KiB/s wr, 8 op/s 2023-05-08T08:43:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17972.974609 secs 2023-05-08T08:43:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17973.531024 secs 2023-05-08T08:43:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17972.974609 secs 2023-05-08T08:43:54.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17973.531024 secs 2023-05-08T08:43:55.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17972.974609 secs 2023-05-08T08:43:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17973.531024 secs 2023-05-08T08:43:55.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:55 smithi186 ceph-mon[126480]: pgmap v9643: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 662 KiB/s rd, 417 KiB/s wr, 14 op/s 2023-05-08T08:43:55.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:55 smithi133 ceph-mon[125939]: pgmap v9643: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 662 KiB/s rd, 417 KiB/s wr, 14 op/s 2023-05-08T08:43:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:55 smithi096 ceph-mon[124666]: pgmap v9643: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 662 KiB/s rd, 417 KiB/s wr, 14 op/s 2023-05-08T08:43:56.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:43:56.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:43:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:43:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:43:57.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:43:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:43:57.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:57 smithi186 ceph-mon[126480]: pgmap v9644: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 422 KiB/s rd, 317 KiB/s wr, 10 op/s 2023-05-08T08:43:57.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:57 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:43:57.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:57 smithi133 ceph-mon[125939]: pgmap v9644: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 422 KiB/s rd, 317 KiB/s wr, 10 op/s 2023-05-08T08:43:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:57 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:43:58.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:57 smithi096 ceph-mon[124666]: pgmap v9644: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 422 KiB/s rd, 317 KiB/s wr, 10 op/s 2023-05-08T08:43:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:57 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:43:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:43:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:43:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:43:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:58 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:43:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:43:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:58 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T08:43:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:58 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T08:43:58.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:58 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:43:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:43:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:43:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:43:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:58 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:43:58.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:43:58.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:58 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T08:43:58.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:58 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T08:43:58.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:58 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:43:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:43:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:43:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:43:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:58 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:43:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:43:59.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:58 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T08:43:59.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:58 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T08:43:59.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:58 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:43:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17977.974677 secs 2023-05-08T08:43:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17978.531145 secs 2023-05-08T08:43:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:43:59 smithi186 ceph-mon[126480]: pgmap v9645: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 451 KiB/s wr, 16 op/s 2023-05-08T08:43:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17977.974677 secs 2023-05-08T08:43:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17978.531145 secs 2023-05-08T08:43:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:43:59 smithi133 ceph-mon[125939]: pgmap v9645: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 451 KiB/s wr, 16 op/s 2023-05-08T08:44:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17977.974677 secs 2023-05-08T08:44:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17978.531145 secs 2023-05-08T08:44:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:43:59 smithi096 ceph-mon[124666]: pgmap v9645: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 451 KiB/s wr, 16 op/s 2023-05-08T08:44:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:44:02 smithi096 ceph-mon[124666]: pgmap v9646: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 278 KiB/s wr, 11 op/s 2023-05-08T08:44:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:44:02 smithi186 ceph-mon[126480]: pgmap v9646: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 278 KiB/s wr, 11 op/s 2023-05-08T08:44:02.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:44:02 smithi133 ceph-mon[125939]: pgmap v9646: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 278 KiB/s wr, 11 op/s 2023-05-08T08:44:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:44:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17982.974802 secs 2023-05-08T08:44:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:44:04 smithi096 ceph-mon[124666]: pgmap v9647: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 278 KiB/s wr, 11 op/s 2023-05-08T08:44:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:44:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17983.531296 secs 2023-05-08T08:44:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:44:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17982.974802 secs 2023-05-08T08:44:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:44:04 smithi186 ceph-mon[126480]: pgmap v9647: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 278 KiB/s wr, 11 op/s 2023-05-08T08:44:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:44:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17983.531296 secs 2023-05-08T08:44:04.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:44:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17982.974802 secs 2023-05-08T08:44:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:44:04 smithi133 ceph-mon[125939]: pgmap v9647: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 278 KiB/s wr, 11 op/s 2023-05-08T08:44:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:44:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17983.531296 secs 2023-05-08T08:44:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:44:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17984.815417 secs 2023-05-08T08:44:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:44:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17984.815417 secs 2023-05-08T08:44:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:44:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17984.815417 secs 2023-05-08T08:44:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:44:06 smithi096 ceph-mon[124666]: pgmap v9648: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 329 KiB/s rd, 419 KiB/s wr, 30 op/s 2023-05-08T08:44:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:44:06 smithi096 ceph-mon[124666]: osdmap e680: 12 total, 12 up, 12 in 2023-05-08T08:44:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:44:06 smithi186 ceph-mon[126480]: pgmap v9648: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 329 KiB/s rd, 419 KiB/s wr, 30 op/s 2023-05-08T08:44:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:44:06 smithi186 ceph-mon[126480]: osdmap e680: 12 total, 12 up, 12 in 2023-05-08T08:44:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:44:06 smithi133 ceph-mon[125939]: pgmap v9648: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 329 KiB/s rd, 419 KiB/s wr, 30 op/s 2023-05-08T08:44:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:44:06 smithi133 ceph-mon[125939]: osdmap e680: 12 total, 12 up, 12 in 2023-05-08T08:44:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:44:08 smithi133 ceph-mon[125939]: pgmap v9650: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 329 KiB/s wr, 29 op/s 2023-05-08T08:44:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:44:08 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:44:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:44:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:44:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:44:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:44:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:44:08 smithi096 ceph-mon[124666]: pgmap v9650: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 329 KiB/s wr, 29 op/s 2023-05-08T08:44:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:44:08 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:44:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:44:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:44:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:44:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:44:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:44:08 smithi186 ceph-mon[126480]: pgmap v9650: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 329 KiB/s wr, 29 op/s 2023-05-08T08:44:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:44:08 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:44:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:44:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:44:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:44:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:44:09.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:44:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17987.974898 secs 2023-05-08T08:44:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:44:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17988.531411 secs 2023-05-08T08:44:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:44:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17987.974898 secs 2023-05-08T08:44:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:44:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17988.531411 secs 2023-05-08T08:44:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:44:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17987.974898 secs 2023-05-08T08:44:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:44:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17988.531411 secs 2023-05-08T08:44:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:44:10 smithi133 ceph-mon[125939]: pgmap v9651: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 242 KiB/s wr, 27 op/s 2023-05-08T08:44:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:44:10 smithi096 ceph-mon[124666]: pgmap v9651: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 242 KiB/s wr, 27 op/s 2023-05-08T08:44:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:44:10 smithi186 ceph-mon[126480]: pgmap v9651: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 242 KiB/s wr, 27 op/s 2023-05-08T08:44:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:44:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17989.815537 secs 2023-05-08T08:44:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:44:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17989.815537 secs 2023-05-08T08:44:11.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:44:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17989.815537 secs 2023-05-08T08:44:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:44:12 smithi096 ceph-mon[124666]: pgmap v9652: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 242 KiB/s wr, 27 op/s 2023-05-08T08:44:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:44:12 smithi096 ceph-mon[124666]: osdmap e681: 12 total, 12 up, 12 in 2023-05-08T08:44:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:44:12 smithi186 ceph-mon[126480]: pgmap v9652: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 242 KiB/s wr, 27 op/s 2023-05-08T08:44:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:44:12 smithi186 ceph-mon[126480]: osdmap e681: 12 total, 12 up, 12 in 2023-05-08T08:44:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:44:12 smithi133 ceph-mon[125939]: pgmap v9652: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 242 KiB/s wr, 27 op/s 2023-05-08T08:44:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:44:12 smithi133 ceph-mon[125939]: osdmap e681: 12 total, 12 up, 12 in 2023-05-08T08:44:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:44:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17992.975051 secs 2023-05-08T08:44:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:44:14 smithi096 ceph-mon[124666]: pgmap v9654: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 91 KiB/s wr, 5 op/s 2023-05-08T08:44:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:44:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17993.531538 secs 2023-05-08T08:44:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:44:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17992.975051 secs 2023-05-08T08:44:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:44:14 smithi186 ceph-mon[126480]: pgmap v9654: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 91 KiB/s wr, 5 op/s 2023-05-08T08:44:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:44:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17993.531538 secs 2023-05-08T08:44:14.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:44:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17992.975051 secs 2023-05-08T08:44:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:44:14 smithi133 ceph-mon[125939]: pgmap v9654: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 91 KiB/s wr, 5 op/s 2023-05-08T08:44:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:44:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17993.531538 secs 2023-05-08T08:44:16.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:44:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17994.815656 secs 2023-05-08T08:44:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:44:16 smithi096 ceph-mon[124666]: pgmap v9655: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 126 KiB/s wr, 7 op/s 2023-05-08T08:44:16.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:44:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17994.815656 secs 2023-05-08T08:44:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:44:16 smithi186 ceph-mon[126480]: pgmap v9655: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 126 KiB/s wr, 7 op/s 2023-05-08T08:44:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:44:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17994.815656 secs 2023-05-08T08:44:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:44:16 smithi133 ceph-mon[125939]: pgmap v9655: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 126 KiB/s wr, 7 op/s 2023-05-08T08:44:18.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:44:18 smithi096 ceph-mon[124666]: pgmap v9656: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 125 KiB/s wr, 7 op/s 2023-05-08T08:44:18.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:44:18 smithi186 ceph-mon[126480]: pgmap v9656: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 125 KiB/s wr, 7 op/s 2023-05-08T08:44:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:44:18 smithi133 ceph-mon[125939]: pgmap v9656: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 125 KiB/s wr, 7 op/s 2023-05-08T08:44:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:44:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17997.975173 secs 2023-05-08T08:44:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:44:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17998.531625 secs 2023-05-08T08:44:19.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:44:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17997.975173 secs 2023-05-08T08:44:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:44:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17998.531625 secs 2023-05-08T08:44:20.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:44:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17997.975173 secs 2023-05-08T08:44:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:44:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17998.531625 secs 2023-05-08T08:44:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:44:20 smithi186 ceph-mon[126480]: pgmap v9657: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 52 KiB/s wr, 6 op/s 2023-05-08T08:44:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:44:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 17999.815741 secs 2023-05-08T08:44:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:44:20 smithi133 ceph-mon[125939]: pgmap v9657: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 52 KiB/s wr, 6 op/s 2023-05-08T08:44:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:44:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 17999.815741 secs 2023-05-08T08:44:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:44:20 smithi096 ceph-mon[124666]: pgmap v9657: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 52 KiB/s wr, 6 op/s 2023-05-08T08:44:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:44:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 17999.815741 secs 2023-05-08T08:44:22.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:44:22 smithi186 ceph-mon[126480]: pgmap v9658: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 52 KiB/s wr, 6 op/s 2023-05-08T08:44:22.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:44:22 smithi133 ceph-mon[125939]: pgmap v9658: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 52 KiB/s wr, 6 op/s 2023-05-08T08:44:23.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:44:22 smithi096 ceph-mon[124666]: pgmap v9658: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 52 KiB/s wr, 6 op/s 2023-05-08T08:44:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:44:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18002.975308 secs 2023-05-08T08:44:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:44:24 smithi186 ceph-mon[126480]: pgmap v9659: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 48 KiB/s wr, 5 op/s 2023-05-08T08:44:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:44:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18003.531751 secs 2023-05-08T08:44:24.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:44:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18002.975308 secs 2023-05-08T08:44:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:44:24 smithi133 ceph-mon[125939]: pgmap v9659: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 48 KiB/s wr, 5 op/s 2023-05-08T08:44:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:44:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18003.531751 secs 2023-05-08T08:44:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:44:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18002.975308 secs 2023-05-08T08:44:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:44:24 smithi096 ceph-mon[124666]: pgmap v9659: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 48 KiB/s wr, 5 op/s 2023-05-08T08:44:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:44:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18003.531751 secs 2023-05-08T08:44:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:44:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18004.815856 secs 2023-05-08T08:44:25.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:44:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18004.815856 secs 2023-05-08T08:44:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:44:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18004.815856 secs 2023-05-08T08:44:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:44:26 smithi186 ceph-mon[126480]: pgmap v9660: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 43 KiB/s wr, 7 op/s 2023-05-08T08:44:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:44:26 smithi133 ceph-mon[125939]: pgmap v9660: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 43 KiB/s wr, 7 op/s 2023-05-08T08:44:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:44:26 smithi096 ceph-mon[124666]: pgmap v9660: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 43 KiB/s wr, 7 op/s 2023-05-08T08:44:28.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:44:28 smithi186 ceph-mon[126480]: pgmap v9661: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T08:44:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:44:28 smithi133 ceph-mon[125939]: pgmap v9661: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T08:44:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:44:28 smithi096 ceph-mon[124666]: pgmap v9661: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T08:44:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:44:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18007.975417 secs 2023-05-08T08:44:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:44:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18008.531895 secs 2023-05-08T08:44:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:44:29 smithi186 ceph-mon[126480]: pgmap v9662: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T08:44:29.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:44:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18007.975417 secs 2023-05-08T08:44:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:44:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18008.531895 secs 2023-05-08T08:44:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:44:29 smithi133 ceph-mon[125939]: pgmap v9662: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T08:44:30.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:44:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18007.975417 secs 2023-05-08T08:44:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:44:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18008.531895 secs 2023-05-08T08:44:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:44:29 smithi096 ceph-mon[124666]: pgmap v9662: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T08:44:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:44:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18009.815989 secs 2023-05-08T08:44:30.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:44:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18009.815989 secs 2023-05-08T08:44:31.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:44:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18009.815989 secs 2023-05-08T08:44:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:44:31 smithi186 ceph-mon[126480]: pgmap v9663: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T08:44:31.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:44:31 smithi133 ceph-mon[125939]: pgmap v9663: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T08:44:32.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:44:31 smithi096 ceph-mon[124666]: pgmap v9663: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T08:44:34.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:44:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18012.975538 secs 2023-05-08T08:44:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:44:34 smithi133 ceph-mon[125939]: pgmap v9664: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T08:44:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:44:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18013.531991 secs 2023-05-08T08:44:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:44:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18012.975538 secs 2023-05-08T08:44:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:44:34 smithi096 ceph-mon[124666]: pgmap v9664: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T08:44:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:44:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18013.531991 secs 2023-05-08T08:44:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:44:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18012.975538 secs 2023-05-08T08:44:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:44:34 smithi186 ceph-mon[126480]: pgmap v9664: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T08:44:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:44:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18013.531991 secs 2023-05-08T08:44:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:44:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18014.816095 secs 2023-05-08T08:44:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:44:36 smithi133 ceph-mon[125939]: pgmap v9665: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 52 KiB/s wr, 8 op/s 2023-05-08T08:44:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:44:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18014.816095 secs 2023-05-08T08:44:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:44:36 smithi096 ceph-mon[124666]: pgmap v9665: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 52 KiB/s wr, 8 op/s 2023-05-08T08:44:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:44:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18014.816095 secs 2023-05-08T08:44:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:44:36 smithi186 ceph-mon[126480]: pgmap v9665: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 52 KiB/s wr, 8 op/s 2023-05-08T08:44:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:44:38 smithi096 ceph-mon[124666]: pgmap v9666: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 KiB/s wr, 6 op/s 2023-05-08T08:44:38.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:44:38 smithi186 ceph-mon[126480]: pgmap v9666: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 KiB/s wr, 6 op/s 2023-05-08T08:44:38.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:44:38 smithi133 ceph-mon[125939]: pgmap v9666: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 KiB/s wr, 6 op/s 2023-05-08T08:44:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:44:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18017.975658 secs 2023-05-08T08:44:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:44:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18018.532109 secs 2023-05-08T08:44:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:44:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18017.975658 secs 2023-05-08T08:44:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:44:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18018.532109 secs 2023-05-08T08:44:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:44:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18017.975658 secs 2023-05-08T08:44:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:44:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18018.532109 secs 2023-05-08T08:44:40.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:44:40 smithi096 ceph-mon[124666]: pgmap v9667: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 215 KiB/s wr, 9 op/s 2023-05-08T08:44:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:44:40 smithi186 ceph-mon[126480]: pgmap v9667: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 215 KiB/s wr, 9 op/s 2023-05-08T08:44:40.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:44:40 smithi133 ceph-mon[125939]: pgmap v9667: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 215 KiB/s wr, 9 op/s 2023-05-08T08:44:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:44:42 smithi096 ceph-mon[124666]: pgmap v9668: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 215 KiB/s wr, 7 op/s 2023-05-08T08:44:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:44:42 smithi186 ceph-mon[126480]: pgmap v9668: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 215 KiB/s wr, 7 op/s 2023-05-08T08:44:42.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:44:42 smithi133 ceph-mon[125939]: pgmap v9668: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 215 KiB/s wr, 7 op/s 2023-05-08T08:44:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:44:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:44:43.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:44:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:44:43.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:44:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:44:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:44:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18022.975750 secs 2023-05-08T08:44:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:44:44 smithi096 ceph-mon[124666]: pgmap v9669: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 215 KiB/s wr, 7 op/s 2023-05-08T08:44:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:44:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:44:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:44:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:44:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:44:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:44:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:44:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18022.975750 secs 2023-05-08T08:44:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:44:44 smithi186 ceph-mon[126480]: pgmap v9669: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 215 KiB/s wr, 7 op/s 2023-05-08T08:44:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:44:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:44:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:44:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:44:44.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:44:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:44:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:44:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18022.975750 secs 2023-05-08T08:44:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:44:44 smithi133 ceph-mon[125939]: pgmap v9669: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 215 KiB/s wr, 7 op/s 2023-05-08T08:44:44.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:44:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:44:44.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:44:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:44:44.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:44:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:44:46.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:44:46 smithi186 ceph-mon[126480]: pgmap v9670: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 226 KiB/s wr, 11 op/s 2023-05-08T08:44:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:44:46 smithi133 ceph-mon[125939]: pgmap v9670: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 226 KiB/s wr, 11 op/s 2023-05-08T08:44:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:44:46 smithi096 ceph-mon[124666]: pgmap v9670: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 226 KiB/s wr, 11 op/s 2023-05-08T08:44:47.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:44:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:44:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:44:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:44:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:44:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:44:48.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:44:48 smithi186 ceph-mon[126480]: pgmap v9671: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 174 KiB/s wr, 7 op/s 2023-05-08T08:44:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:44:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:44:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:44:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:44:48.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:44:48 smithi133 ceph-mon[125939]: pgmap v9671: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 174 KiB/s wr, 7 op/s 2023-05-08T08:44:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:44:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:44:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:44:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:44:49.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:44:48 smithi096 ceph-mon[124666]: pgmap v9671: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 174 KiB/s wr, 7 op/s 2023-05-08T08:44:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:44:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:44:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:44:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:44:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:44:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18027.975847 secs 2023-05-08T08:44:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:44:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18027.975847 secs 2023-05-08T08:44:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:44:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18027.975847 secs 2023-05-08T08:44:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:44:50 smithi186 ceph-mon[126480]: pgmap v9672: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 367 KiB/s wr, 13 op/s 2023-05-08T08:44:50.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:44:50 smithi133 ceph-mon[125939]: pgmap v9672: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 367 KiB/s wr, 13 op/s 2023-05-08T08:44:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:44:50 smithi096 ceph-mon[124666]: pgmap v9672: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 367 KiB/s wr, 13 op/s 2023-05-08T08:44:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:44:52 smithi186 ceph-mon[126480]: pgmap v9673: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 205 KiB/s wr, 9 op/s 2023-05-08T08:44:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:44:52 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:44:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:44:52 smithi133 ceph-mon[125939]: pgmap v9673: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 205 KiB/s wr, 9 op/s 2023-05-08T08:44:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:44:52 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:44:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:44:52 smithi096 ceph-mon[124666]: pgmap v9673: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 205 KiB/s wr, 9 op/s 2023-05-08T08:44:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:44:52 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:44:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:44:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18032.975967 secs 2023-05-08T08:44:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:44:54 smithi186 ceph-mon[126480]: pgmap v9674: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 205 KiB/s wr, 9 op/s 2023-05-08T08:44:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:44:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18032.975967 secs 2023-05-08T08:44:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:44:54 smithi133 ceph-mon[125939]: pgmap v9674: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 205 KiB/s wr, 9 op/s 2023-05-08T08:44:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:44:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18032.975967 secs 2023-05-08T08:44:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:44:54 smithi096 ceph-mon[124666]: pgmap v9674: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 205 KiB/s wr, 9 op/s 2023-05-08T08:44:56.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:44:56 smithi186 ceph-mon[126480]: pgmap v9675: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 334 KiB/s wr, 15 op/s 2023-05-08T08:44:56.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:44:56 smithi133 ceph-mon[125939]: pgmap v9675: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 334 KiB/s wr, 15 op/s 2023-05-08T08:44:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:44:56 smithi096 ceph-mon[124666]: pgmap v9675: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 334 KiB/s wr, 15 op/s 2023-05-08T08:44:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:44:58 smithi096 ceph-mon[124666]: pgmap v9676: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 323 KiB/s wr, 11 op/s 2023-05-08T08:44:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:44:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:44:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:44:58 smithi186 ceph-mon[126480]: pgmap v9676: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 323 KiB/s wr, 11 op/s 2023-05-08T08:44:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:44:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:44:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:44:58 smithi133 ceph-mon[125939]: pgmap v9676: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 323 KiB/s wr, 11 op/s 2023-05-08T08:44:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:44:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:44:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:44:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18037.976063 secs 2023-05-08T08:44:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:44:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18038.532591 secs 2023-05-08T08:44:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:44:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:44:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:44:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:44:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:44:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:44:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:44:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18037.976063 secs 2023-05-08T08:44:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:44:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18038.532591 secs 2023-05-08T08:44:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:44:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:44:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:44:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:44:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:44:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:44:59.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:44:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18037.976063 secs 2023-05-08T08:44:59.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:44:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18038.532591 secs 2023-05-08T08:44:59.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:44:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:44:59.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:44:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:44:59.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:44:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:45:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:00 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:45:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:00 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T08:45:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:00 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T08:45:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:00 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:45:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:00 smithi096 ceph-mon[124666]: pgmap v9677: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 480 KiB/s wr, 16 op/s 2023-05-08T08:45:00.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:00 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:45:00.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:45:00.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:45:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:00 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:45:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:00 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T08:45:00.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:00 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T08:45:00.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:00 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:45:00.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:00 smithi186 ceph-mon[126480]: pgmap v9677: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 480 KiB/s wr, 16 op/s 2023-05-08T08:45:00.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:00 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:45:00.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:45:00.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:45:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:00 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:45:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:00 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T08:45:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:00 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T08:45:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:00 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:45:00.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:00 smithi133 ceph-mon[125939]: pgmap v9677: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 480 KiB/s wr, 16 op/s 2023-05-08T08:45:00.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:00 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:45:00.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:45:00.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:45:01.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18039.816715 secs 2023-05-08T08:45:01.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18039.816715 secs 2023-05-08T08:45:01.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18039.816715 secs 2023-05-08T08:45:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:02 smithi186 ceph-mon[126480]: pgmap v9678: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 384 KiB/s rd, 287 KiB/s wr, 10 op/s 2023-05-08T08:45:02.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:02 smithi133 ceph-mon[125939]: pgmap v9678: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 384 KiB/s rd, 287 KiB/s wr, 10 op/s 2023-05-08T08:45:03.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:02 smithi096 ceph-mon[124666]: pgmap v9678: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 384 KiB/s rd, 287 KiB/s wr, 10 op/s 2023-05-08T08:45:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18042.976189 secs 2023-05-08T08:45:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:04 smithi186 ceph-mon[126480]: pgmap v9679: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 384 KiB/s rd, 287 KiB/s wr, 10 op/s 2023-05-08T08:45:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:04 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:45:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:04 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:45:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18043.532712 secs 2023-05-08T08:45:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18042.976189 secs 2023-05-08T08:45:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:04 smithi133 ceph-mon[125939]: pgmap v9679: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 384 KiB/s rd, 287 KiB/s wr, 10 op/s 2023-05-08T08:45:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:04 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:45:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:04 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:45:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18043.532712 secs 2023-05-08T08:45:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18042.976189 secs 2023-05-08T08:45:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:04 smithi096 ceph-mon[124666]: pgmap v9679: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 384 KiB/s rd, 287 KiB/s wr, 10 op/s 2023-05-08T08:45:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:04 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:45:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:04 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:45:05.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18043.532712 secs 2023-05-08T08:45:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18044.816843 secs 2023-05-08T08:45:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18044.816843 secs 2023-05-08T08:45:06.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18044.816843 secs 2023-05-08T08:45:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:06 smithi186 ceph-mon[126480]: pgmap v9680: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 332 KiB/s wr, 28 op/s 2023-05-08T08:45:06.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:06 smithi133 ceph-mon[125939]: pgmap v9680: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 332 KiB/s wr, 28 op/s 2023-05-08T08:45:07.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:06 smithi096 ceph-mon[124666]: pgmap v9680: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 332 KiB/s wr, 28 op/s 2023-05-08T08:45:07.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:07 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:45:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:07 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:45:08.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:07 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:45:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:08 smithi186 ceph-mon[126480]: pgmap v9681: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 202 KiB/s wr, 22 op/s 2023-05-08T08:45:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:08 smithi133 ceph-mon[125939]: pgmap v9681: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 202 KiB/s wr, 22 op/s 2023-05-08T08:45:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:08 smithi096 ceph-mon[124666]: pgmap v9681: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 202 KiB/s wr, 22 op/s 2023-05-08T08:45:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18047.976306 secs 2023-05-08T08:45:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18048.532800 secs 2023-05-08T08:45:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18047.976306 secs 2023-05-08T08:45:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18048.532800 secs 2023-05-08T08:45:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18047.976306 secs 2023-05-08T08:45:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18048.532800 secs 2023-05-08T08:45:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:10 smithi186 ceph-mon[126480]: pgmap v9682: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 262 KiB/s wr, 25 op/s 2023-05-08T08:45:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18049.816943 secs 2023-05-08T08:45:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:10 smithi133 ceph-mon[125939]: pgmap v9682: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 262 KiB/s wr, 25 op/s 2023-05-08T08:45:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18049.816943 secs 2023-05-08T08:45:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:10 smithi096 ceph-mon[124666]: pgmap v9682: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 262 KiB/s wr, 25 op/s 2023-05-08T08:45:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18049.816943 secs 2023-05-08T08:45:11.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:11 smithi186 ceph-mon[126480]: osdmap e682: 12 total, 12 up, 12 in 2023-05-08T08:45:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:11 smithi186 ceph-mon[126480]: pgmap v9684: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 127 KiB/s wr, 24 op/s 2023-05-08T08:45:11.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:11 smithi133 ceph-mon[125939]: osdmap e682: 12 total, 12 up, 12 in 2023-05-08T08:45:12.226 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:11 smithi133 ceph-mon[125939]: pgmap v9684: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 127 KiB/s wr, 24 op/s 2023-05-08T08:45:12.226 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:11 smithi096 ceph-mon[124666]: osdmap e682: 12 total, 12 up, 12 in 2023-05-08T08:45:12.227 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:11 smithi096 ceph-mon[124666]: pgmap v9684: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 127 KiB/s wr, 24 op/s 2023-05-08T08:45:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18052.976429 secs 2023-05-08T08:45:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:14 smithi096 ceph-mon[124666]: pgmap v9685: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 127 KiB/s wr, 24 op/s 2023-05-08T08:45:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18053.532955 secs 2023-05-08T08:45:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18052.976429 secs 2023-05-08T08:45:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:14 smithi186 ceph-mon[126480]: pgmap v9685: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 127 KiB/s wr, 24 op/s 2023-05-08T08:45:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18053.532955 secs 2023-05-08T08:45:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18052.976429 secs 2023-05-08T08:45:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:14 smithi133 ceph-mon[125939]: pgmap v9685: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 127 KiB/s wr, 24 op/s 2023-05-08T08:45:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18053.532955 secs 2023-05-08T08:45:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18054.817061 secs 2023-05-08T08:45:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:16 smithi096 ceph-mon[124666]: pgmap v9686: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 73 KiB/s wr, 6 op/s 2023-05-08T08:45:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18054.817061 secs 2023-05-08T08:45:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:16 smithi186 ceph-mon[126480]: pgmap v9686: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 73 KiB/s wr, 6 op/s 2023-05-08T08:45:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18054.817061 secs 2023-05-08T08:45:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:16 smithi133 ceph-mon[125939]: pgmap v9686: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 73 KiB/s wr, 6 op/s 2023-05-08T08:45:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:18 smithi096 ceph-mon[124666]: pgmap v9687: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 73 KiB/s wr, 6 op/s 2023-05-08T08:45:18.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:18 smithi186 ceph-mon[126480]: pgmap v9687: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 73 KiB/s wr, 6 op/s 2023-05-08T08:45:18.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:18 smithi133 ceph-mon[125939]: pgmap v9687: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 73 KiB/s wr, 6 op/s 2023-05-08T08:45:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18057.976510 secs 2023-05-08T08:45:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18058.533069 secs 2023-05-08T08:45:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18057.976510 secs 2023-05-08T08:45:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18058.533069 secs 2023-05-08T08:45:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18057.976510 secs 2023-05-08T08:45:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18058.533069 secs 2023-05-08T08:45:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:20 smithi186 ceph-mon[126480]: pgmap v9688: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 53 KiB/s wr, 6 op/s 2023-05-08T08:45:20.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:20 smithi133 ceph-mon[125939]: pgmap v9688: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 53 KiB/s wr, 6 op/s 2023-05-08T08:45:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:20 smithi096 ceph-mon[124666]: pgmap v9688: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 53 KiB/s wr, 6 op/s 2023-05-08T08:45:21.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18059.817157 secs 2023-05-08T08:45:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18059.817157 secs 2023-05-08T08:45:22.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18059.817157 secs 2023-05-08T08:45:22.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:22 smithi186 ceph-mon[126480]: pgmap v9689: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 48 KiB/s wr, 6 op/s 2023-05-08T08:45:22.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:22 smithi186 ceph-mon[126480]: osdmap e683: 12 total, 12 up, 12 in 2023-05-08T08:45:22.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:22 smithi133 ceph-mon[125939]: pgmap v9689: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 48 KiB/s wr, 6 op/s 2023-05-08T08:45:22.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:22 smithi133 ceph-mon[125939]: osdmap e683: 12 total, 12 up, 12 in 2023-05-08T08:45:23.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:22 smithi096 ceph-mon[124666]: pgmap v9689: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 48 KiB/s wr, 6 op/s 2023-05-08T08:45:23.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:22 smithi096 ceph-mon[124666]: osdmap e683: 12 total, 12 up, 12 in 2023-05-08T08:45:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18062.976596 secs 2023-05-08T08:45:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:24 smithi186 ceph-mon[126480]: pgmap v9691: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 53 KiB/s wr, 6 op/s 2023-05-08T08:45:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18063.533191 secs 2023-05-08T08:45:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18062.976596 secs 2023-05-08T08:45:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:24 smithi133 ceph-mon[125939]: pgmap v9691: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 53 KiB/s wr, 6 op/s 2023-05-08T08:45:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18063.533191 secs 2023-05-08T08:45:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18062.976596 secs 2023-05-08T08:45:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:24 smithi096 ceph-mon[124666]: pgmap v9691: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 53 KiB/s wr, 6 op/s 2023-05-08T08:45:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18063.533191 secs 2023-05-08T08:45:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18064.817250 secs 2023-05-08T08:45:25.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18064.817250 secs 2023-05-08T08:45:26.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18064.817250 secs 2023-05-08T08:45:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:26 smithi186 ceph-mon[126480]: pgmap v9692: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 52 KiB/s wr, 6 op/s 2023-05-08T08:45:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:26 smithi133 ceph-mon[125939]: pgmap v9692: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 52 KiB/s wr, 6 op/s 2023-05-08T08:45:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:26 smithi096 ceph-mon[124666]: pgmap v9692: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 52 KiB/s wr, 6 op/s 2023-05-08T08:45:28.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:28 smithi186 ceph-mon[126480]: pgmap v9693: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 52 KiB/s wr, 6 op/s 2023-05-08T08:45:28.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:28 smithi133 ceph-mon[125939]: pgmap v9693: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 52 KiB/s wr, 6 op/s 2023-05-08T08:45:29.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:28 smithi096 ceph-mon[124666]: pgmap v9693: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 52 KiB/s wr, 6 op/s 2023-05-08T08:45:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18067.976707 secs 2023-05-08T08:45:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18068.533306 secs 2023-05-08T08:45:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18067.976707 secs 2023-05-08T08:45:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18068.533306 secs 2023-05-08T08:45:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18067.976707 secs 2023-05-08T08:45:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18068.533306 secs 2023-05-08T08:45:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:30 smithi186 ceph-mon[126480]: pgmap v9694: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:45:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18069.817377 secs 2023-05-08T08:45:30.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:30 smithi133 ceph-mon[125939]: pgmap v9694: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:45:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18069.817377 secs 2023-05-08T08:45:31.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:30 smithi096 ceph-mon[124666]: pgmap v9694: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:45:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18069.817377 secs 2023-05-08T08:45:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:31 smithi186 ceph-mon[126480]: pgmap v9695: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:45:31.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:31 smithi133 ceph-mon[125939]: pgmap v9695: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:45:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:31 smithi096 ceph-mon[124666]: pgmap v9695: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:45:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18072.976839 secs 2023-05-08T08:45:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:34 smithi096 ceph-mon[124666]: pgmap v9696: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 93 B/s wr, 6 op/s 2023-05-08T08:45:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18073.533458 secs 2023-05-08T08:45:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18072.976839 secs 2023-05-08T08:45:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:34 smithi186 ceph-mon[126480]: pgmap v9696: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 93 B/s wr, 6 op/s 2023-05-08T08:45:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18073.533458 secs 2023-05-08T08:45:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18072.976839 secs 2023-05-08T08:45:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:34 smithi133 ceph-mon[125939]: pgmap v9696: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 93 B/s wr, 6 op/s 2023-05-08T08:45:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18073.533458 secs 2023-05-08T08:45:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18074.817509 secs 2023-05-08T08:45:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:36 smithi096 ceph-mon[124666]: pgmap v9697: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 938 B/s wr, 8 op/s 2023-05-08T08:45:36.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18074.817509 secs 2023-05-08T08:45:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:36 smithi186 ceph-mon[126480]: pgmap v9697: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 938 B/s wr, 8 op/s 2023-05-08T08:45:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18074.817509 secs 2023-05-08T08:45:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:36 smithi133 ceph-mon[125939]: pgmap v9697: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 938 B/s wr, 8 op/s 2023-05-08T08:45:38.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:38 smithi186 ceph-mon[126480]: pgmap v9698: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T08:45:38.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:38 smithi133 ceph-mon[125939]: pgmap v9698: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T08:45:39.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:38 smithi096 ceph-mon[124666]: pgmap v9698: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T08:45:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18077.976941 secs 2023-05-08T08:45:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18078.533562 secs 2023-05-08T08:45:39.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18077.976941 secs 2023-05-08T08:45:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18078.533562 secs 2023-05-08T08:45:40.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18077.976941 secs 2023-05-08T08:45:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18078.533562 secs 2023-05-08T08:45:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:40 smithi186 ceph-mon[126480]: pgmap v9699: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 164 KiB/s wr, 10 op/s 2023-05-08T08:45:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:40 smithi133 ceph-mon[125939]: pgmap v9699: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 164 KiB/s wr, 10 op/s 2023-05-08T08:45:41.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:40 smithi096 ceph-mon[124666]: pgmap v9699: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 164 KiB/s wr, 10 op/s 2023-05-08T08:45:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:42 smithi186 ceph-mon[126480]: pgmap v9700: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 164 KiB/s wr, 7 op/s 2023-05-08T08:45:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:42 smithi133 ceph-mon[125939]: pgmap v9700: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 164 KiB/s wr, 7 op/s 2023-05-08T08:45:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:42 smithi096 ceph-mon[124666]: pgmap v9700: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 164 KiB/s wr, 7 op/s 2023-05-08T08:45:43.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:45:43.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:45:44.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:45:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18082.977077 secs 2023-05-08T08:45:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:44 smithi186 ceph-mon[126480]: pgmap v9701: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 164 KiB/s wr, 7 op/s 2023-05-08T08:45:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:45:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:45:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:45:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18082.977077 secs 2023-05-08T08:45:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:44 smithi133 ceph-mon[125939]: pgmap v9701: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 164 KiB/s wr, 7 op/s 2023-05-08T08:45:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:45:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:45:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:45:45.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18082.977077 secs 2023-05-08T08:45:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:44 smithi096 ceph-mon[124666]: pgmap v9701: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 164 KiB/s wr, 7 op/s 2023-05-08T08:45:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:45:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:45:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:45:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:46 smithi186 ceph-mon[126480]: pgmap v9702: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 176 KiB/s wr, 11 op/s 2023-05-08T08:45:46.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:46 smithi133 ceph-mon[125939]: pgmap v9702: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 176 KiB/s wr, 11 op/s 2023-05-08T08:45:47.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:46 smithi096 ceph-mon[124666]: pgmap v9702: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 176 KiB/s wr, 11 op/s 2023-05-08T08:45:47.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:45:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:45:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:45:48.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:48 smithi186 ceph-mon[126480]: pgmap v9703: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 175 KiB/s wr, 8 op/s 2023-05-08T08:45:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:45:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:45:48.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:48 smithi133 ceph-mon[125939]: pgmap v9703: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 175 KiB/s wr, 8 op/s 2023-05-08T08:45:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:45:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:45:49.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:48 smithi096 ceph-mon[124666]: pgmap v9703: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 175 KiB/s wr, 8 op/s 2023-05-08T08:45:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:45:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:45:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18087.977195 secs 2023-05-08T08:45:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18087.977195 secs 2023-05-08T08:45:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18087.977195 secs 2023-05-08T08:45:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:50 smithi186 ceph-mon[126480]: pgmap v9704: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 396 KiB/s rd, 369 KiB/s wr, 13 op/s 2023-05-08T08:45:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:50 smithi133 ceph-mon[125939]: pgmap v9704: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 396 KiB/s rd, 369 KiB/s wr, 13 op/s 2023-05-08T08:45:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:50 smithi096 ceph-mon[124666]: pgmap v9704: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 396 KiB/s rd, 369 KiB/s wr, 13 op/s 2023-05-08T08:45:51.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:51 smithi186 ceph-mon[126480]: pgmap v9705: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 307 KiB/s wr, 9 op/s 2023-05-08T08:45:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:51 smithi133 ceph-mon[125939]: pgmap v9705: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 307 KiB/s wr, 9 op/s 2023-05-08T08:45:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:51 smithi096 ceph-mon[124666]: pgmap v9705: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 307 KiB/s wr, 9 op/s 2023-05-08T08:45:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:52 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:45:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:52 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:45:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:52 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:45:53.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:53 smithi186 ceph-mon[126480]: pgmap v9706: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 307 KiB/s wr, 9 op/s 2023-05-08T08:45:53.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:53 smithi133 ceph-mon[125939]: pgmap v9706: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 307 KiB/s wr, 9 op/s 2023-05-08T08:45:54.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:53 smithi096 ceph-mon[124666]: pgmap v9706: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 307 KiB/s wr, 9 op/s 2023-05-08T08:45:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18092.977317 secs 2023-05-08T08:45:54.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18092.977317 secs 2023-05-08T08:45:55.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18092.977317 secs 2023-05-08T08:45:55.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:55 smithi186 ceph-mon[126480]: pgmap v9707: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 337 KiB/s wr, 14 op/s 2023-05-08T08:45:55.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:55 smithi133 ceph-mon[125939]: pgmap v9707: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 337 KiB/s wr, 14 op/s 2023-05-08T08:45:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:55 smithi096 ceph-mon[124666]: pgmap v9707: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 337 KiB/s wr, 14 op/s 2023-05-08T08:45:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:58 smithi186 ceph-mon[126480]: pgmap v9708: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 387 KiB/s wr, 11 op/s 2023-05-08T08:45:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:58 smithi133 ceph-mon[125939]: pgmap v9708: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 387 KiB/s wr, 11 op/s 2023-05-08T08:45:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:58 smithi096 ceph-mon[124666]: pgmap v9708: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 387 KiB/s wr, 11 op/s 2023-05-08T08:45:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18097.977433 secs 2023-05-08T08:45:59.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18098.534010 secs 2023-05-08T08:45:59.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:45:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:45:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18097.977433 secs 2023-05-08T08:45:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18098.534010 secs 2023-05-08T08:45:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:45:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:46:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18097.977433 secs 2023-05-08T08:46:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18098.534010 secs 2023-05-08T08:46:00.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:45:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:46:00.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:00 smithi133 ceph-mon[125939]: pgmap v9709: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 418 KiB/s rd, 399 KiB/s wr, 15 op/s 2023-05-08T08:46:00.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:00 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:46:00.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:46:00.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:46:00.794 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18099.818698 secs 2023-05-08T08:46:00.806 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:00 smithi096 ceph-mon[124666]: pgmap v9709: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 418 KiB/s rd, 399 KiB/s wr, 15 op/s 2023-05-08T08:46:00.806 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:00 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:46:00.806 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:46:00.807 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:46:00.807 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18099.818698 secs 2023-05-08T08:46:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:00 smithi186 ceph-mon[126480]: pgmap v9709: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 418 KiB/s rd, 399 KiB/s wr, 15 op/s 2023-05-08T08:46:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:00 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:46:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:46:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:46:00.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18099.818698 secs 2023-05-08T08:46:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:02 smithi133 ceph-mon[125939]: pgmap v9710: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 272 KiB/s wr, 10 op/s 2023-05-08T08:46:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:02 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:46:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:02 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:46:02.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:02 smithi096 ceph-mon[124666]: pgmap v9710: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 272 KiB/s wr, 10 op/s 2023-05-08T08:46:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:02 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:46:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:02 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:46:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:02 smithi186 ceph-mon[126480]: pgmap v9710: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 272 KiB/s wr, 10 op/s 2023-05-08T08:46:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:02 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:46:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:02 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:46:03.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:46:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:46:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:46:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:46:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:03 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:46:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:46:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:03 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T08:46:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:03 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T08:46:03.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:03 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:46:03.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:03 smithi186 ceph-mon[126480]: pgmap v9711: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 171 KiB/s wr, 10 op/s 2023-05-08T08:46:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:46:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:46:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:46:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:46:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:03 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:46:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:46:03.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:03 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T08:46:03.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:03 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T08:46:03.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:03 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:46:03.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:03 smithi133 ceph-mon[125939]: pgmap v9711: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 171 KiB/s wr, 10 op/s 2023-05-08T08:46:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:46:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:46:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:46:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:46:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:03 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:46:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:46:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:03 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T08:46:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:03 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T08:46:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:03 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:46:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:03 smithi096 ceph-mon[124666]: pgmap v9711: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 171 KiB/s wr, 10 op/s 2023-05-08T08:46:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18102.977569 secs 2023-05-08T08:46:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:04 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:46:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:04 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:46:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18103.534127 secs 2023-05-08T08:46:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18102.977569 secs 2023-05-08T08:46:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:04 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:46:04.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:04 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:46:04.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18103.534127 secs 2023-05-08T08:46:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18102.977569 secs 2023-05-08T08:46:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:04 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:46:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:04 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:46:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18103.534127 secs 2023-05-08T08:46:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18104.818839 secs 2023-05-08T08:46:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:05 smithi186 ceph-mon[126480]: pgmap v9712: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 290 KiB/s rd, 215 KiB/s wr, 27 op/s 2023-05-08T08:46:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18104.818839 secs 2023-05-08T08:46:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:05 smithi133 ceph-mon[125939]: pgmap v9712: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 290 KiB/s rd, 215 KiB/s wr, 27 op/s 2023-05-08T08:46:06.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18104.818839 secs 2023-05-08T08:46:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:05 smithi096 ceph-mon[124666]: pgmap v9712: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 290 KiB/s rd, 215 KiB/s wr, 27 op/s 2023-05-08T08:46:07.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:07 smithi186 ceph-mon[126480]: pgmap v9713: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 247 KiB/s wr, 23 op/s 2023-05-08T08:46:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:07 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:46:07.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:07 smithi133 ceph-mon[125939]: pgmap v9713: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 247 KiB/s wr, 23 op/s 2023-05-08T08:46:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:07 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:46:08.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:07 smithi096 ceph-mon[124666]: pgmap v9713: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 247 KiB/s wr, 23 op/s 2023-05-08T08:46:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:07 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:46:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18107.977689 secs 2023-05-08T08:46:09.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18107.977689 secs 2023-05-08T08:46:09.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18107.977689 secs 2023-05-08T08:46:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18108.534261 secs 2023-05-08T08:46:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:09 smithi186 ceph-mon[126480]: pgmap v9714: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 184 KiB/s wr, 24 op/s 2023-05-08T08:46:10.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18108.534261 secs 2023-05-08T08:46:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:09 smithi133 ceph-mon[125939]: pgmap v9714: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 184 KiB/s wr, 24 op/s 2023-05-08T08:46:10.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18108.534261 secs 2023-05-08T08:46:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:09 smithi096 ceph-mon[124666]: pgmap v9714: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 184 KiB/s wr, 24 op/s 2023-05-08T08:46:11.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18109.818963 secs 2023-05-08T08:46:11.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18109.818963 secs 2023-05-08T08:46:11.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18109.818963 secs 2023-05-08T08:46:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:11 smithi186 ceph-mon[126480]: osdmap e684: 12 total, 12 up, 12 in 2023-05-08T08:46:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:11 smithi186 ceph-mon[126480]: pgmap v9716: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 127 KiB/s wr, 24 op/s 2023-05-08T08:46:12.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:11 smithi133 ceph-mon[125939]: osdmap e684: 12 total, 12 up, 12 in 2023-05-08T08:46:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:11 smithi133 ceph-mon[125939]: pgmap v9716: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 127 KiB/s wr, 24 op/s 2023-05-08T08:46:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:11 smithi096 ceph-mon[124666]: osdmap e684: 12 total, 12 up, 12 in 2023-05-08T08:46:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:11 smithi096 ceph-mon[124666]: pgmap v9716: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 127 KiB/s wr, 24 op/s 2023-05-08T08:46:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18112.977755 secs 2023-05-08T08:46:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:14 smithi186 ceph-mon[126480]: pgmap v9717: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 127 KiB/s wr, 24 op/s 2023-05-08T08:46:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18113.534394 secs 2023-05-08T08:46:14.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18112.977755 secs 2023-05-08T08:46:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:14 smithi133 ceph-mon[125939]: pgmap v9717: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 127 KiB/s wr, 24 op/s 2023-05-08T08:46:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18113.534394 secs 2023-05-08T08:46:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18112.977755 secs 2023-05-08T08:46:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:14 smithi096 ceph-mon[124666]: pgmap v9717: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 127 KiB/s wr, 24 op/s 2023-05-08T08:46:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18113.534394 secs 2023-05-08T08:46:15.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18114.819092 secs 2023-05-08T08:46:15.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:15 smithi186 ceph-mon[126480]: pgmap v9718: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 74 KiB/s wr, 7 op/s 2023-05-08T08:46:15.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18114.819092 secs 2023-05-08T08:46:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:15 smithi133 ceph-mon[125939]: pgmap v9718: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 74 KiB/s wr, 7 op/s 2023-05-08T08:46:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18114.819092 secs 2023-05-08T08:46:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:15 smithi096 ceph-mon[124666]: pgmap v9718: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 74 KiB/s wr, 7 op/s 2023-05-08T08:46:18.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:18 smithi186 ceph-mon[126480]: pgmap v9719: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T08:46:18.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:18 smithi133 ceph-mon[125939]: pgmap v9719: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T08:46:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:18 smithi096 ceph-mon[124666]: pgmap v9719: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T08:46:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18117.977861 secs 2023-05-08T08:46:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18118.534538 secs 2023-05-08T08:46:19.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18117.977861 secs 2023-05-08T08:46:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18118.534538 secs 2023-05-08T08:46:20.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18117.977861 secs 2023-05-08T08:46:20.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18118.534538 secs 2023-05-08T08:46:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:20 smithi186 ceph-mon[126480]: pgmap v9720: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:46:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18119.819222 secs 2023-05-08T08:46:20.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:20 smithi133 ceph-mon[125939]: pgmap v9720: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:46:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18119.819222 secs 2023-05-08T08:46:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:20 smithi096 ceph-mon[124666]: pgmap v9720: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:46:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18119.819222 secs 2023-05-08T08:46:22.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:22 smithi186 ceph-mon[126480]: pgmap v9721: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 192 B/s wr, 5 op/s 2023-05-08T08:46:22.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:22 smithi186 ceph-mon[126480]: osdmap e685: 12 total, 12 up, 12 in 2023-05-08T08:46:22.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:22 smithi133 ceph-mon[125939]: pgmap v9721: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 192 B/s wr, 5 op/s 2023-05-08T08:46:22.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:22 smithi133 ceph-mon[125939]: osdmap e685: 12 total, 12 up, 12 in 2023-05-08T08:46:23.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:22 smithi096 ceph-mon[124666]: pgmap v9721: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 192 B/s wr, 5 op/s 2023-05-08T08:46:23.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:22 smithi096 ceph-mon[124666]: osdmap e685: 12 total, 12 up, 12 in 2023-05-08T08:46:23.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:23 smithi186 ceph-mon[126480]: pgmap v9723: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T08:46:23.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:23 smithi133 ceph-mon[125939]: pgmap v9723: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T08:46:24.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:23 smithi096 ceph-mon[124666]: pgmap v9723: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T08:46:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18122.977980 secs 2023-05-08T08:46:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18123.534621 secs 2023-05-08T08:46:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18122.977980 secs 2023-05-08T08:46:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18123.534621 secs 2023-05-08T08:46:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18122.977980 secs 2023-05-08T08:46:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18123.534621 secs 2023-05-08T08:46:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18124.819322 secs 2023-05-08T08:46:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:25 smithi186 ceph-mon[126480]: pgmap v9724: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:46:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18124.819322 secs 2023-05-08T08:46:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:25 smithi133 ceph-mon[125939]: pgmap v9724: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:46:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18124.819322 secs 2023-05-08T08:46:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:25 smithi096 ceph-mon[124666]: pgmap v9724: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T08:46:28.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:28 smithi186 ceph-mon[126480]: pgmap v9725: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T08:46:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:28 smithi133 ceph-mon[125939]: pgmap v9725: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T08:46:29.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:28 smithi096 ceph-mon[124666]: pgmap v9725: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T08:46:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18127.978120 secs 2023-05-08T08:46:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18128.534737 secs 2023-05-08T08:46:29.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18127.978120 secs 2023-05-08T08:46:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18128.534737 secs 2023-05-08T08:46:30.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18127.978120 secs 2023-05-08T08:46:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18128.534737 secs 2023-05-08T08:46:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:30 smithi186 ceph-mon[126480]: pgmap v9726: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:46:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18129.819444 secs 2023-05-08T08:46:30.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:30 smithi133 ceph-mon[125939]: pgmap v9726: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:46:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18129.819444 secs 2023-05-08T08:46:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:30 smithi096 ceph-mon[124666]: pgmap v9726: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:46:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18129.819444 secs 2023-05-08T08:46:32.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:32 smithi186 ceph-mon[126480]: pgmap v9727: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 60 KiB/s wr, 6 op/s 2023-05-08T08:46:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:32 smithi133 ceph-mon[125939]: pgmap v9727: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 60 KiB/s wr, 6 op/s 2023-05-08T08:46:33.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:32 smithi096 ceph-mon[124666]: pgmap v9727: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 60 KiB/s wr, 6 op/s 2023-05-08T08:46:33.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:33 smithi186 ceph-mon[126480]: pgmap v9728: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 55 KiB/s wr, 6 op/s 2023-05-08T08:46:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:33 smithi133 ceph-mon[125939]: pgmap v9728: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 55 KiB/s wr, 6 op/s 2023-05-08T08:46:34.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:33 smithi096 ceph-mon[124666]: pgmap v9728: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 55 KiB/s wr, 6 op/s 2023-05-08T08:46:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18132.978239 secs 2023-05-08T08:46:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18133.534878 secs 2023-05-08T08:46:34.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18132.978239 secs 2023-05-08T08:46:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18133.534878 secs 2023-05-08T08:46:35.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18132.978239 secs 2023-05-08T08:46:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18133.534878 secs 2023-05-08T08:46:35.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18134.819567 secs 2023-05-08T08:46:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:35 smithi186 ceph-mon[126480]: pgmap v9729: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 53 KiB/s wr, 9 op/s 2023-05-08T08:46:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18134.819567 secs 2023-05-08T08:46:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:35 smithi133 ceph-mon[125939]: pgmap v9729: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 53 KiB/s wr, 9 op/s 2023-05-08T08:46:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18134.819567 secs 2023-05-08T08:46:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:35 smithi096 ceph-mon[124666]: pgmap v9729: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 53 KiB/s wr, 9 op/s 2023-05-08T08:46:38.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:38 smithi186 ceph-mon[126480]: pgmap v9730: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 53 KiB/s wr, 7 op/s 2023-05-08T08:46:38.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:38 smithi133 ceph-mon[125939]: pgmap v9730: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 53 KiB/s wr, 7 op/s 2023-05-08T08:46:39.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:38 smithi096 ceph-mon[124666]: pgmap v9730: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 53 KiB/s wr, 7 op/s 2023-05-08T08:46:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18137.978372 secs 2023-05-08T08:46:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18138.534990 secs 2023-05-08T08:46:39.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18137.978372 secs 2023-05-08T08:46:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18138.534990 secs 2023-05-08T08:46:40.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18137.978372 secs 2023-05-08T08:46:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18138.534990 secs 2023-05-08T08:46:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:40 smithi186 ceph-mon[126480]: pgmap v9731: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 217 KiB/s wr, 10 op/s 2023-05-08T08:46:40.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:40 smithi133 ceph-mon[125939]: pgmap v9731: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 217 KiB/s wr, 10 op/s 2023-05-08T08:46:41.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:40 smithi096 ceph-mon[124666]: pgmap v9731: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 217 KiB/s wr, 10 op/s 2023-05-08T08:46:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:41 smithi186 ceph-mon[126480]: pgmap v9732: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 217 KiB/s wr, 8 op/s 2023-05-08T08:46:41.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:41 smithi133 ceph-mon[125939]: pgmap v9732: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 217 KiB/s wr, 8 op/s 2023-05-08T08:46:42.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:41 smithi096 ceph-mon[124666]: pgmap v9732: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 217 KiB/s wr, 8 op/s 2023-05-08T08:46:43.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:46:43.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:46:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:46:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18142.978488 secs 2023-05-08T08:46:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:44 smithi186 ceph-mon[126480]: pgmap v9733: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 167 KiB/s wr, 7 op/s 2023-05-08T08:46:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:46:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:46:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:46:44.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18142.978488 secs 2023-05-08T08:46:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:44 smithi133 ceph-mon[125939]: pgmap v9733: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 167 KiB/s wr, 7 op/s 2023-05-08T08:46:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:46:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:46:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:46:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18142.978488 secs 2023-05-08T08:46:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:44 smithi096 ceph-mon[124666]: pgmap v9733: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 167 KiB/s wr, 7 op/s 2023-05-08T08:46:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:46:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:46:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:46:46.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:46 smithi186 ceph-mon[126480]: pgmap v9734: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 179 KiB/s wr, 11 op/s 2023-05-08T08:46:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:46 smithi133 ceph-mon[125939]: pgmap v9734: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 179 KiB/s wr, 11 op/s 2023-05-08T08:46:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:46 smithi096 ceph-mon[124666]: pgmap v9734: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 179 KiB/s wr, 11 op/s 2023-05-08T08:46:47.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:46:47.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:46:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:46:48.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:48 smithi186 ceph-mon[126480]: pgmap v9735: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 176 KiB/s wr, 8 op/s 2023-05-08T08:46:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:46:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:46:48.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:48 smithi133 ceph-mon[125939]: pgmap v9735: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 176 KiB/s wr, 8 op/s 2023-05-08T08:46:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:46:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:46:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:48 smithi096 ceph-mon[124666]: pgmap v9735: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 176 KiB/s wr, 8 op/s 2023-05-08T08:46:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:46:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:46:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18147.978557 secs 2023-05-08T08:46:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18148.535233 secs 2023-05-08T08:46:49.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18147.978557 secs 2023-05-08T08:46:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18148.535233 secs 2023-05-08T08:46:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18147.978557 secs 2023-05-08T08:46:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18148.535233 secs 2023-05-08T08:46:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:50 smithi186 ceph-mon[126480]: pgmap v9736: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 371 KiB/s wr, 13 op/s 2023-05-08T08:46:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:50 smithi133 ceph-mon[125939]: pgmap v9736: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 371 KiB/s wr, 13 op/s 2023-05-08T08:46:51.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:50 smithi096 ceph-mon[124666]: pgmap v9736: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 371 KiB/s wr, 13 op/s 2023-05-08T08:46:51.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:51 smithi186 ceph-mon[126480]: pgmap v9737: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 207 KiB/s wr, 9 op/s 2023-05-08T08:46:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:51 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:46:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:46:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:46:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:51 smithi133 ceph-mon[125939]: pgmap v9737: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 207 KiB/s wr, 9 op/s 2023-05-08T08:46:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:51 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:46:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:46:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:46:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:51 smithi096 ceph-mon[124666]: pgmap v9737: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 207 KiB/s wr, 9 op/s 2023-05-08T08:46:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:51 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:46:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:46:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:46:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18152.978671 secs 2023-05-08T08:46:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:54 smithi186 ceph-mon[126480]: pgmap v9738: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 207 KiB/s wr, 9 op/s 2023-05-08T08:46:54.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18152.978671 secs 2023-05-08T08:46:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:54 smithi133 ceph-mon[125939]: pgmap v9738: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 207 KiB/s wr, 9 op/s 2023-05-08T08:46:55.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18152.978671 secs 2023-05-08T08:46:55.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:54 smithi096 ceph-mon[124666]: pgmap v9738: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 207 KiB/s wr, 9 op/s 2023-05-08T08:46:55.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:55 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:46:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:55 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:46:56.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:55 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:46:56.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:56 smithi186 ceph-mon[126480]: pgmap v9739: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 352 KiB/s rd, 339 KiB/s wr, 14 op/s 2023-05-08T08:46:56.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:46:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:46:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:56 smithi133 ceph-mon[125939]: pgmap v9739: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 352 KiB/s rd, 339 KiB/s wr, 14 op/s 2023-05-08T08:46:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:46:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:46:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:56 smithi096 ceph-mon[124666]: pgmap v9739: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 352 KiB/s rd, 339 KiB/s wr, 14 op/s 2023-05-08T08:46:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:46:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:46:57.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:57 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:46:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:57 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:46:58.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:57 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:46:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:58 smithi186 ceph-mon[126480]: pgmap v9740: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 327 KiB/s wr, 10 op/s 2023-05-08T08:46:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:58 smithi133 ceph-mon[125939]: pgmap v9740: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 327 KiB/s wr, 10 op/s 2023-05-08T08:46:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:58 smithi096 ceph-mon[124666]: pgmap v9740: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 327 KiB/s wr, 10 op/s 2023-05-08T08:46:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18157.978745 secs 2023-05-08T08:46:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:46:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18158.535501 secs 2023-05-08T08:46:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18157.978745 secs 2023-05-08T08:46:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:46:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18158.535501 secs 2023-05-08T08:47:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18157.978745 secs 2023-05-08T08:47:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:46:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18158.535501 secs 2023-05-08T08:47:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:00 smithi186 ceph-mon[126480]: pgmap v9741: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 485 KiB/s wr, 15 op/s 2023-05-08T08:47:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:47:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:47:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18159.820172 secs 2023-05-08T08:47:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:00 smithi133 ceph-mon[125939]: pgmap v9741: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 485 KiB/s wr, 15 op/s 2023-05-08T08:47:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:47:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:47:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18159.820172 secs 2023-05-08T08:47:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:00 smithi096 ceph-mon[124666]: pgmap v9741: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 485 KiB/s wr, 15 op/s 2023-05-08T08:47:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:47:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:47:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18159.820172 secs 2023-05-08T08:47:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:02 smithi186 ceph-mon[126480]: pgmap v9742: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 291 KiB/s rd, 290 KiB/s wr, 10 op/s 2023-05-08T08:47:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:02 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:47:02.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:02 smithi133 ceph-mon[125939]: pgmap v9742: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 291 KiB/s rd, 290 KiB/s wr, 10 op/s 2023-05-08T08:47:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:02 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:47:03.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:02 smithi096 ceph-mon[124666]: pgmap v9742: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 291 KiB/s rd, 290 KiB/s wr, 10 op/s 2023-05-08T08:47:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:02 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:47:03.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:47:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:47:04.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:47:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18162.978832 secs 2023-05-08T08:47:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:04 smithi186 ceph-mon[126480]: pgmap v9743: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 291 KiB/s rd, 290 KiB/s wr, 10 op/s 2023-05-08T08:47:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:04 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:47:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:04 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:47:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18163.535566 secs 2023-05-08T08:47:04.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18162.978832 secs 2023-05-08T08:47:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:04 smithi133 ceph-mon[125939]: pgmap v9743: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 291 KiB/s rd, 290 KiB/s wr, 10 op/s 2023-05-08T08:47:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:04 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:47:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:04 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:47:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18163.535566 secs 2023-05-08T08:47:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18162.978832 secs 2023-05-08T08:47:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:04 smithi096 ceph-mon[124666]: pgmap v9743: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 291 KiB/s rd, 290 KiB/s wr, 10 op/s 2023-05-08T08:47:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:04 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:47:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:04 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:47:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18163.535566 secs 2023-05-08T08:47:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18164.820282 secs 2023-05-08T08:47:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18164.820282 secs 2023-05-08T08:47:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18164.820282 secs 2023-05-08T08:47:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:06 smithi186 ceph-mon[126480]: pgmap v9744: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 335 KiB/s wr, 27 op/s 2023-05-08T08:47:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:06 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:47:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:06 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:47:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:06 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:47:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:06 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:47:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:06 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:47:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:06 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:47:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:06 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T08:47:06.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:06 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T08:47:06.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:06 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:47:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:06 smithi133 ceph-mon[125939]: pgmap v9744: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 335 KiB/s wr, 27 op/s 2023-05-08T08:47:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:06 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:47:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:06 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:47:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:06 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:47:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:06 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:47:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:06 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:47:06.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:06 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:47:06.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:06 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T08:47:06.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:06 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T08:47:06.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:06 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:47:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:06 smithi096 ceph-mon[124666]: pgmap v9744: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 335 KiB/s wr, 27 op/s 2023-05-08T08:47:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:06 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:47:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:06 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:47:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:06 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:47:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:06 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:47:07.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:06 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:47:07.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:06 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:47:07.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:06 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T08:47:07.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:06 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T08:47:07.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:06 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:47:07.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:07 smithi186 ceph-mon[126480]: pgmap v9745: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 203 KiB/s wr, 22 op/s 2023-05-08T08:47:07.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:07 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:47:07.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:07 smithi133 ceph-mon[125939]: pgmap v9745: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 203 KiB/s wr, 22 op/s 2023-05-08T08:47:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:07 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:47:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:07 smithi096 ceph-mon[124666]: pgmap v9745: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 203 KiB/s wr, 22 op/s 2023-05-08T08:47:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:07 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:47:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18167.978971 secs 2023-05-08T08:47:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18167.978971 secs 2023-05-08T08:47:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18167.978971 secs 2023-05-08T08:47:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18168.535684 secs 2023-05-08T08:47:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:09 smithi186 ceph-mon[126480]: pgmap v9746: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 265 KiB/s wr, 25 op/s 2023-05-08T08:47:10.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18168.535684 secs 2023-05-08T08:47:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:09 smithi133 ceph-mon[125939]: pgmap v9746: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 265 KiB/s wr, 25 op/s 2023-05-08T08:47:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18168.535684 secs 2023-05-08T08:47:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:09 smithi096 ceph-mon[124666]: pgmap v9746: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 265 KiB/s wr, 25 op/s 2023-05-08T08:47:11.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18169.820405 secs 2023-05-08T08:47:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18169.820405 secs 2023-05-08T08:47:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18169.820405 secs 2023-05-08T08:47:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:11 smithi186 ceph-mon[126480]: osdmap e686: 12 total, 12 up, 12 in 2023-05-08T08:47:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:11 smithi186 ceph-mon[126480]: pgmap v9748: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 128 KiB/s wr, 24 op/s 2023-05-08T08:47:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:11 smithi133 ceph-mon[125939]: osdmap e686: 12 total, 12 up, 12 in 2023-05-08T08:47:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:11 smithi133 ceph-mon[125939]: pgmap v9748: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 128 KiB/s wr, 24 op/s 2023-05-08T08:47:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:11 smithi096 ceph-mon[124666]: osdmap e686: 12 total, 12 up, 12 in 2023-05-08T08:47:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:11 smithi096 ceph-mon[124666]: pgmap v9748: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 128 KiB/s wr, 24 op/s 2023-05-08T08:47:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18172.979070 secs 2023-05-08T08:47:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:14 smithi186 ceph-mon[126480]: pgmap v9749: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 128 KiB/s wr, 24 op/s 2023-05-08T08:47:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18173.535808 secs 2023-05-08T08:47:14.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18172.979070 secs 2023-05-08T08:47:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:14 smithi133 ceph-mon[125939]: pgmap v9749: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 128 KiB/s wr, 24 op/s 2023-05-08T08:47:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18173.535808 secs 2023-05-08T08:47:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18172.979070 secs 2023-05-08T08:47:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:14 smithi096 ceph-mon[124666]: pgmap v9749: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 128 KiB/s wr, 24 op/s 2023-05-08T08:47:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18173.535808 secs 2023-05-08T08:47:15.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18174.820523 secs 2023-05-08T08:47:15.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18174.820523 secs 2023-05-08T08:47:16.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18174.820523 secs 2023-05-08T08:47:16.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:16 smithi186 ceph-mon[126480]: pgmap v9750: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 74 KiB/s wr, 6 op/s 2023-05-08T08:47:16.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:16 smithi133 ceph-mon[125939]: pgmap v9750: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 74 KiB/s wr, 6 op/s 2023-05-08T08:47:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:16 smithi096 ceph-mon[124666]: pgmap v9750: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 74 KiB/s wr, 6 op/s 2023-05-08T08:47:18.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:18 smithi186 ceph-mon[126480]: pgmap v9751: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 74 KiB/s wr, 6 op/s 2023-05-08T08:47:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:18 smithi133 ceph-mon[125939]: pgmap v9751: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 74 KiB/s wr, 6 op/s 2023-05-08T08:47:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:18 smithi096 ceph-mon[124666]: pgmap v9751: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 74 KiB/s wr, 6 op/s 2023-05-08T08:47:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18177.979183 secs 2023-05-08T08:47:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18178.535881 secs 2023-05-08T08:47:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18177.979183 secs 2023-05-08T08:47:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18178.535881 secs 2023-05-08T08:47:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18177.979183 secs 2023-05-08T08:47:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18178.535881 secs 2023-05-08T08:47:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:20 smithi186 ceph-mon[126480]: pgmap v9752: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 53 KiB/s wr, 7 op/s 2023-05-08T08:47:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18179.820641 secs 2023-05-08T08:47:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:20 smithi133 ceph-mon[125939]: pgmap v9752: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 53 KiB/s wr, 7 op/s 2023-05-08T08:47:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18179.820641 secs 2023-05-08T08:47:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:20 smithi096 ceph-mon[124666]: pgmap v9752: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 53 KiB/s wr, 7 op/s 2023-05-08T08:47:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18179.820641 secs 2023-05-08T08:47:22.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:22 smithi186 ceph-mon[126480]: pgmap v9753: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 50 KiB/s wr, 6 op/s 2023-05-08T08:47:22.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:22 smithi186 ceph-mon[126480]: osdmap e687: 12 total, 12 up, 12 in 2023-05-08T08:47:22.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:22 smithi133 ceph-mon[125939]: pgmap v9753: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 50 KiB/s wr, 6 op/s 2023-05-08T08:47:22.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:22 smithi133 ceph-mon[125939]: osdmap e687: 12 total, 12 up, 12 in 2023-05-08T08:47:23.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:22 smithi096 ceph-mon[124666]: pgmap v9753: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 50 KiB/s wr, 6 op/s 2023-05-08T08:47:23.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:22 smithi096 ceph-mon[124666]: osdmap e687: 12 total, 12 up, 12 in 2023-05-08T08:47:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18182.979313 secs 2023-05-08T08:47:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:24 smithi186 ceph-mon[126480]: pgmap v9755: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 53 KiB/s wr, 7 op/s 2023-05-08T08:47:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18183.536008 secs 2023-05-08T08:47:24.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18182.979313 secs 2023-05-08T08:47:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:24 smithi133 ceph-mon[125939]: pgmap v9755: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 53 KiB/s wr, 7 op/s 2023-05-08T08:47:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18183.536008 secs 2023-05-08T08:47:25.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18182.979313 secs 2023-05-08T08:47:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:24 smithi096 ceph-mon[124666]: pgmap v9755: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 53 KiB/s wr, 7 op/s 2023-05-08T08:47:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18183.536008 secs 2023-05-08T08:47:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18184.820751 secs 2023-05-08T08:47:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18184.820751 secs 2023-05-08T08:47:26.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18184.820751 secs 2023-05-08T08:47:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:26 smithi186 ceph-mon[126480]: pgmap v9756: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 53 KiB/s wr, 7 op/s 2023-05-08T08:47:26.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:26 smithi133 ceph-mon[125939]: pgmap v9756: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 53 KiB/s wr, 7 op/s 2023-05-08T08:47:27.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:26 smithi096 ceph-mon[124666]: pgmap v9756: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 53 KiB/s wr, 7 op/s 2023-05-08T08:47:28.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:28 smithi186 ceph-mon[126480]: pgmap v9757: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 53 KiB/s wr, 7 op/s 2023-05-08T08:47:28.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:28 smithi133 ceph-mon[125939]: pgmap v9757: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 53 KiB/s wr, 7 op/s 2023-05-08T08:47:29.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:28 smithi096 ceph-mon[124666]: pgmap v9757: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 53 KiB/s wr, 7 op/s 2023-05-08T08:47:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18187.979416 secs 2023-05-08T08:47:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18188.536128 secs 2023-05-08T08:47:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18187.979416 secs 2023-05-08T08:47:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18188.536128 secs 2023-05-08T08:47:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18187.979416 secs 2023-05-08T08:47:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18188.536128 secs 2023-05-08T08:47:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:30 smithi186 ceph-mon[126480]: pgmap v9758: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 7 op/s 2023-05-08T08:47:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18189.820846 secs 2023-05-08T08:47:30.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:30 smithi133 ceph-mon[125939]: pgmap v9758: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 7 op/s 2023-05-08T08:47:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18189.820846 secs 2023-05-08T08:47:31.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:30 smithi096 ceph-mon[124666]: pgmap v9758: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 7 op/s 2023-05-08T08:47:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18189.820846 secs 2023-05-08T08:47:32.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:32 smithi186 ceph-mon[126480]: pgmap v9759: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 7 op/s 2023-05-08T08:47:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:32 smithi133 ceph-mon[125939]: pgmap v9759: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 7 op/s 2023-05-08T08:47:33.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:32 smithi096 ceph-mon[124666]: pgmap v9759: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 7 op/s 2023-05-08T08:47:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18192.979567 secs 2023-05-08T08:47:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:34 smithi186 ceph-mon[126480]: pgmap v9760: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 93 B/s wr, 7 op/s 2023-05-08T08:47:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18193.536271 secs 2023-05-08T08:47:34.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18192.979567 secs 2023-05-08T08:47:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:34 smithi133 ceph-mon[125939]: pgmap v9760: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 93 B/s wr, 7 op/s 2023-05-08T08:47:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18193.536271 secs 2023-05-08T08:47:35.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18192.979567 secs 2023-05-08T08:47:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:34 smithi096 ceph-mon[124666]: pgmap v9760: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 93 B/s wr, 7 op/s 2023-05-08T08:47:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18193.536271 secs 2023-05-08T08:47:35.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18194.820964 secs 2023-05-08T08:47:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18194.820964 secs 2023-05-08T08:47:36.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18194.820964 secs 2023-05-08T08:47:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:36 smithi186 ceph-mon[126480]: pgmap v9761: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 938 B/s wr, 10 op/s 2023-05-08T08:47:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:36 smithi133 ceph-mon[125939]: pgmap v9761: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 938 B/s wr, 10 op/s 2023-05-08T08:47:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:36 smithi096 ceph-mon[124666]: pgmap v9761: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 938 B/s wr, 10 op/s 2023-05-08T08:47:38.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:38 smithi186 ceph-mon[126480]: pgmap v9762: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 7 op/s 2023-05-08T08:47:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:38 smithi133 ceph-mon[125939]: pgmap v9762: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 7 op/s 2023-05-08T08:47:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:38 smithi096 ceph-mon[124666]: pgmap v9762: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 7 op/s 2023-05-08T08:47:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18197.979694 secs 2023-05-08T08:47:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18198.536361 secs 2023-05-08T08:47:39.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18197.979694 secs 2023-05-08T08:47:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18198.536361 secs 2023-05-08T08:47:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18197.979694 secs 2023-05-08T08:47:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18198.536361 secs 2023-05-08T08:47:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:40 smithi186 ceph-mon[126480]: pgmap v9763: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 166 KiB/s wr, 11 op/s 2023-05-08T08:47:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:40 smithi133 ceph-mon[125939]: pgmap v9763: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 166 KiB/s wr, 11 op/s 2023-05-08T08:47:41.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:40 smithi096 ceph-mon[124666]: pgmap v9763: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 166 KiB/s wr, 11 op/s 2023-05-08T08:47:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:41 smithi186 ceph-mon[126480]: pgmap v9764: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 166 KiB/s wr, 7 op/s 2023-05-08T08:47:41.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:41 smithi133 ceph-mon[125939]: pgmap v9764: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 166 KiB/s wr, 7 op/s 2023-05-08T08:47:42.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:41 smithi096 ceph-mon[124666]: pgmap v9764: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 166 KiB/s wr, 7 op/s 2023-05-08T08:47:43.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:47:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:47:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:47:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18202.979814 secs 2023-05-08T08:47:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:44 smithi186 ceph-mon[126480]: pgmap v9765: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 166 KiB/s wr, 7 op/s 2023-05-08T08:47:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:47:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:47:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:47:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18202.979814 secs 2023-05-08T08:47:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:44 smithi133 ceph-mon[125939]: pgmap v9765: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 166 KiB/s wr, 7 op/s 2023-05-08T08:47:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:47:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:47:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:47:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18202.979814 secs 2023-05-08T08:47:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:44 smithi096 ceph-mon[124666]: pgmap v9765: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 166 KiB/s wr, 7 op/s 2023-05-08T08:47:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:47:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:47:45.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:47:46.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:46 smithi186 ceph-mon[126480]: pgmap v9766: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 178 KiB/s wr, 11 op/s 2023-05-08T08:47:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:46 smithi133 ceph-mon[125939]: pgmap v9766: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 178 KiB/s wr, 11 op/s 2023-05-08T08:47:47.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:46 smithi096 ceph-mon[124666]: pgmap v9766: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 178 KiB/s wr, 11 op/s 2023-05-08T08:47:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:47:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:47:48.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:47:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:48 smithi186 ceph-mon[126480]: pgmap v9767: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 177 KiB/s wr, 7 op/s 2023-05-08T08:47:48.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:47:48.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:47:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:48 smithi133 ceph-mon[125939]: pgmap v9767: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 177 KiB/s wr, 7 op/s 2023-05-08T08:47:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:47:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:47:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:48 smithi096 ceph-mon[124666]: pgmap v9767: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 177 KiB/s wr, 7 op/s 2023-05-08T08:47:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:47:49.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:47:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18207.979919 secs 2023-05-08T08:47:49.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18207.979919 secs 2023-05-08T08:47:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18207.979919 secs 2023-05-08T08:47:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:50 smithi186 ceph-mon[126480]: pgmap v9768: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 431 KiB/s wr, 13 op/s 2023-05-08T08:47:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:50 smithi133 ceph-mon[125939]: pgmap v9768: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 431 KiB/s wr, 13 op/s 2023-05-08T08:47:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:50 smithi096 ceph-mon[124666]: pgmap v9768: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 431 KiB/s wr, 13 op/s 2023-05-08T08:47:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:52 smithi186 ceph-mon[126480]: pgmap v9769: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 266 KiB/s wr, 9 op/s 2023-05-08T08:47:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:52 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:47:52.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:52 smithi133 ceph-mon[125939]: pgmap v9769: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 266 KiB/s wr, 9 op/s 2023-05-08T08:47:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:52 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:47:53.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:52 smithi096 ceph-mon[124666]: pgmap v9769: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 266 KiB/s wr, 9 op/s 2023-05-08T08:47:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:52 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:47:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18212.980044 secs 2023-05-08T08:47:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:54 smithi186 ceph-mon[126480]: pgmap v9770: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 266 KiB/s wr, 9 op/s 2023-05-08T08:47:54.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18212.980044 secs 2023-05-08T08:47:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:54 smithi133 ceph-mon[125939]: pgmap v9770: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 266 KiB/s wr, 9 op/s 2023-05-08T08:47:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18212.980044 secs 2023-05-08T08:47:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:54 smithi096 ceph-mon[124666]: pgmap v9770: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 266 KiB/s wr, 9 op/s 2023-05-08T08:47:55.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:55 smithi186 ceph-mon[126480]: pgmap v9771: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 345 KiB/s wr, 15 op/s 2023-05-08T08:47:55.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:55 smithi133 ceph-mon[125939]: pgmap v9771: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 345 KiB/s wr, 15 op/s 2023-05-08T08:47:56.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:55 smithi096 ceph-mon[124666]: pgmap v9771: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 345 KiB/s wr, 15 op/s 2023-05-08T08:47:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:58 smithi186 ceph-mon[126480]: pgmap v9772: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 333 KiB/s wr, 11 op/s 2023-05-08T08:47:58.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:58 smithi133 ceph-mon[125939]: pgmap v9772: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 333 KiB/s wr, 11 op/s 2023-05-08T08:47:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:58 smithi096 ceph-mon[124666]: pgmap v9772: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 333 KiB/s wr, 11 op/s 2023-05-08T08:47:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18217.980188 secs 2023-05-08T08:47:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:47:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18218.536823 secs 2023-05-08T08:47:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18217.980188 secs 2023-05-08T08:47:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:47:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18218.536823 secs 2023-05-08T08:48:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18217.980188 secs 2023-05-08T08:48:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:47:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18218.536823 secs 2023-05-08T08:48:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:00 smithi186 ceph-mon[126480]: pgmap v9773: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 487 KiB/s rd, 474 KiB/s wr, 15 op/s 2023-05-08T08:48:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:00 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:48:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:48:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:48:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18219.821539 secs 2023-05-08T08:48:00.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:00 smithi133 ceph-mon[125939]: pgmap v9773: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 487 KiB/s rd, 474 KiB/s wr, 15 op/s 2023-05-08T08:48:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:00 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:48:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:48:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:48:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18219.821539 secs 2023-05-08T08:48:01.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:00 smithi096 ceph-mon[124666]: pgmap v9773: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 487 KiB/s rd, 474 KiB/s wr, 15 op/s 2023-05-08T08:48:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:00 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:48:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:48:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:48:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18219.821539 secs 2023-05-08T08:48:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:02 smithi186 ceph-mon[126480]: pgmap v9774: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 220 KiB/s wr, 10 op/s 2023-05-08T08:48:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:02 smithi133 ceph-mon[125939]: pgmap v9774: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 220 KiB/s wr, 10 op/s 2023-05-08T08:48:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:02 smithi096 ceph-mon[124666]: pgmap v9774: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 220 KiB/s wr, 10 op/s 2023-05-08T08:48:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18222.980297 secs 2023-05-08T08:48:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:04 smithi186 ceph-mon[126480]: pgmap v9775: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 220 KiB/s wr, 10 op/s 2023-05-08T08:48:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:04 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:48:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:04 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:48:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18223.536888 secs 2023-05-08T08:48:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18222.980297 secs 2023-05-08T08:48:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:04 smithi133 ceph-mon[125939]: pgmap v9775: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 220 KiB/s wr, 10 op/s 2023-05-08T08:48:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:04 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:48:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:04 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:48:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18223.536888 secs 2023-05-08T08:48:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18222.980297 secs 2023-05-08T08:48:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:04 smithi096 ceph-mon[124666]: pgmap v9775: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 220 KiB/s wr, 10 op/s 2023-05-08T08:48:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:04 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:48:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:04 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:48:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18223.536888 secs 2023-05-08T08:48:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18224.821652 secs 2023-05-08T08:48:05.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18224.821652 secs 2023-05-08T08:48:06.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18224.821652 secs 2023-05-08T08:48:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:06 smithi186 ceph-mon[126480]: pgmap v9776: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 265 KiB/s wr, 27 op/s 2023-05-08T08:48:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:06 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:48:06.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:06 smithi133 ceph-mon[125939]: pgmap v9776: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 265 KiB/s wr, 27 op/s 2023-05-08T08:48:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:06 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:48:07.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:06 smithi096 ceph-mon[124666]: pgmap v9776: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 265 KiB/s wr, 27 op/s 2023-05-08T08:48:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:06 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:48:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:07 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:48:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:07 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:48:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:07 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:48:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:07 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:48:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:07 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T08:48:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:07 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T08:48:07.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:07 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:48:07.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:07 smithi186 ceph-mon[126480]: pgmap v9777: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 186 KiB/s wr, 22 op/s 2023-05-08T08:48:07.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:07 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:48:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:07 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:48:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:07 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:48:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:07 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:48:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:07 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:48:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:07 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T08:48:07.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:07 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T08:48:07.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:07 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:48:07.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:07 smithi133 ceph-mon[125939]: pgmap v9777: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 186 KiB/s wr, 22 op/s 2023-05-08T08:48:07.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:07 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:48:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:07 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:48:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:07 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:48:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:07 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:48:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:07 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:48:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:07 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T08:48:08.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:07 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T08:48:08.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:07 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:48:08.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:07 smithi096 ceph-mon[124666]: pgmap v9777: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 186 KiB/s wr, 22 op/s 2023-05-08T08:48:08.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:07 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:48:09.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18227.980364 secs 2023-05-08T08:48:09.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18227.980364 secs 2023-05-08T08:48:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18227.980364 secs 2023-05-08T08:48:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18228.537017 secs 2023-05-08T08:48:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:10 smithi186 ceph-mon[126480]: pgmap v9778: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 248 KiB/s wr, 25 op/s 2023-05-08T08:48:10.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18228.537017 secs 2023-05-08T08:48:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:10 smithi133 ceph-mon[125939]: pgmap v9778: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 248 KiB/s wr, 25 op/s 2023-05-08T08:48:10.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18228.537017 secs 2023-05-08T08:48:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:10 smithi096 ceph-mon[124666]: pgmap v9778: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 248 KiB/s wr, 25 op/s 2023-05-08T08:48:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18229.821784 secs 2023-05-08T08:48:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18229.821784 secs 2023-05-08T08:48:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18229.821784 secs 2023-05-08T08:48:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:12 smithi186 ceph-mon[126480]: osdmap e688: 12 total, 12 up, 12 in 2023-05-08T08:48:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:12 smithi186 ceph-mon[126480]: pgmap v9780: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 128 KiB/s wr, 25 op/s 2023-05-08T08:48:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:12 smithi133 ceph-mon[125939]: osdmap e688: 12 total, 12 up, 12 in 2023-05-08T08:48:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:12 smithi133 ceph-mon[125939]: pgmap v9780: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 128 KiB/s wr, 25 op/s 2023-05-08T08:48:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:12 smithi096 ceph-mon[124666]: osdmap e688: 12 total, 12 up, 12 in 2023-05-08T08:48:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:12 smithi096 ceph-mon[124666]: pgmap v9780: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 128 KiB/s wr, 25 op/s 2023-05-08T08:48:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18232.980490 secs 2023-05-08T08:48:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:14 smithi186 ceph-mon[126480]: pgmap v9781: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 128 KiB/s wr, 25 op/s 2023-05-08T08:48:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18233.537137 secs 2023-05-08T08:48:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18232.980490 secs 2023-05-08T08:48:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:14 smithi133 ceph-mon[125939]: pgmap v9781: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 128 KiB/s wr, 25 op/s 2023-05-08T08:48:14.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18233.537137 secs 2023-05-08T08:48:15.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18232.980490 secs 2023-05-08T08:48:15.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:14 smithi096 ceph-mon[124666]: pgmap v9781: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 128 KiB/s wr, 25 op/s 2023-05-08T08:48:15.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18233.537137 secs 2023-05-08T08:48:15.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18234.821800 secs 2023-05-08T08:48:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18234.821800 secs 2023-05-08T08:48:16.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18234.821800 secs 2023-05-08T08:48:16.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:16 smithi186 ceph-mon[126480]: pgmap v9782: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 74 KiB/s wr, 7 op/s 2023-05-08T08:48:16.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:16 smithi133 ceph-mon[125939]: pgmap v9782: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 74 KiB/s wr, 7 op/s 2023-05-08T08:48:17.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:16 smithi096 ceph-mon[124666]: pgmap v9782: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 74 KiB/s wr, 7 op/s 2023-05-08T08:48:18.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:18 smithi186 ceph-mon[126480]: pgmap v9783: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 74 KiB/s wr, 7 op/s 2023-05-08T08:48:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:18 smithi133 ceph-mon[125939]: pgmap v9783: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 74 KiB/s wr, 7 op/s 2023-05-08T08:48:19.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:18 smithi096 ceph-mon[124666]: pgmap v9783: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 74 KiB/s wr, 7 op/s 2023-05-08T08:48:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18237.980616 secs 2023-05-08T08:48:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18238.537261 secs 2023-05-08T08:48:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18237.980616 secs 2023-05-08T08:48:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18238.537261 secs 2023-05-08T08:48:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18237.980616 secs 2023-05-08T08:48:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18238.537261 secs 2023-05-08T08:48:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:20 smithi186 ceph-mon[126480]: pgmap v9784: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 66 KiB/s wr, 7 op/s 2023-05-08T08:48:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18239.821943 secs 2023-05-08T08:48:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:20 smithi133 ceph-mon[125939]: pgmap v9784: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 66 KiB/s wr, 7 op/s 2023-05-08T08:48:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18239.821943 secs 2023-05-08T08:48:21.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:20 smithi096 ceph-mon[124666]: pgmap v9784: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 66 KiB/s wr, 7 op/s 2023-05-08T08:48:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18239.821943 secs 2023-05-08T08:48:22.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:22 smithi186 ceph-mon[126480]: pgmap v9785: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 64 KiB/s wr, 6 op/s 2023-05-08T08:48:22.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:22 smithi186 ceph-mon[126480]: osdmap e689: 12 total, 12 up, 12 in 2023-05-08T08:48:22.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:22 smithi133 ceph-mon[125939]: pgmap v9785: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 64 KiB/s wr, 6 op/s 2023-05-08T08:48:22.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:22 smithi133 ceph-mon[125939]: osdmap e689: 12 total, 12 up, 12 in 2023-05-08T08:48:23.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:22 smithi096 ceph-mon[124666]: pgmap v9785: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 64 KiB/s wr, 6 op/s 2023-05-08T08:48:23.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:22 smithi096 ceph-mon[124666]: osdmap e689: 12 total, 12 up, 12 in 2023-05-08T08:48:23.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:23 smithi186 ceph-mon[126480]: pgmap v9787: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 66 KiB/s wr, 7 op/s 2023-05-08T08:48:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:23 smithi133 ceph-mon[125939]: pgmap v9787: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 66 KiB/s wr, 7 op/s 2023-05-08T08:48:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:23 smithi096 ceph-mon[124666]: pgmap v9787: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 66 KiB/s wr, 7 op/s 2023-05-08T08:48:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18242.980679 secs 2023-05-08T08:48:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18243.537394 secs 2023-05-08T08:48:24.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18242.980679 secs 2023-05-08T08:48:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18243.537394 secs 2023-05-08T08:48:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18242.980679 secs 2023-05-08T08:48:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18243.537394 secs 2023-05-08T08:48:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18244.822064 secs 2023-05-08T08:48:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:25 smithi186 ceph-mon[126480]: pgmap v9788: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 66 KiB/s wr, 6 op/s 2023-05-08T08:48:25.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18244.822064 secs 2023-05-08T08:48:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:25 smithi133 ceph-mon[125939]: pgmap v9788: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 66 KiB/s wr, 6 op/s 2023-05-08T08:48:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18244.822064 secs 2023-05-08T08:48:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:25 smithi096 ceph-mon[124666]: pgmap v9788: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 66 KiB/s wr, 6 op/s 2023-05-08T08:48:28.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:28 smithi186 ceph-mon[126480]: pgmap v9789: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 66 KiB/s wr, 6 op/s 2023-05-08T08:48:28.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:28 smithi133 ceph-mon[125939]: pgmap v9789: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 66 KiB/s wr, 6 op/s 2023-05-08T08:48:29.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:28 smithi096 ceph-mon[124666]: pgmap v9789: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 66 KiB/s wr, 6 op/s 2023-05-08T08:48:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18247.980800 secs 2023-05-08T08:48:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18248.537544 secs 2023-05-08T08:48:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18247.980800 secs 2023-05-08T08:48:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18248.537544 secs 2023-05-08T08:48:30.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18247.980800 secs 2023-05-08T08:48:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18248.537544 secs 2023-05-08T08:48:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:30 smithi186 ceph-mon[126480]: pgmap v9790: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:48:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18249.822181 secs 2023-05-08T08:48:30.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:30 smithi133 ceph-mon[125939]: pgmap v9790: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:48:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18249.822181 secs 2023-05-08T08:48:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:30 smithi096 ceph-mon[124666]: pgmap v9790: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:48:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18249.822181 secs 2023-05-08T08:48:32.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:32 smithi186 ceph-mon[126480]: pgmap v9791: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:48:32.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:32 smithi133 ceph-mon[125939]: pgmap v9791: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:48:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:32 smithi096 ceph-mon[124666]: pgmap v9791: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:48:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18252.980903 secs 2023-05-08T08:48:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:34 smithi186 ceph-mon[126480]: pgmap v9792: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 93 B/s wr, 5 op/s 2023-05-08T08:48:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18253.537608 secs 2023-05-08T08:48:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18252.980903 secs 2023-05-08T08:48:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:34 smithi133 ceph-mon[125939]: pgmap v9792: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 93 B/s wr, 5 op/s 2023-05-08T08:48:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18253.537608 secs 2023-05-08T08:48:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18252.980903 secs 2023-05-08T08:48:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:34 smithi096 ceph-mon[124666]: pgmap v9792: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 93 B/s wr, 5 op/s 2023-05-08T08:48:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18253.537608 secs 2023-05-08T08:48:35.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18254.822241 secs 2023-05-08T08:48:35.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18254.822241 secs 2023-05-08T08:48:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18254.822241 secs 2023-05-08T08:48:36.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:36 smithi186 ceph-mon[126480]: pgmap v9793: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 938 B/s wr, 8 op/s 2023-05-08T08:48:36.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:36 smithi133 ceph-mon[125939]: pgmap v9793: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 938 B/s wr, 8 op/s 2023-05-08T08:48:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:36 smithi096 ceph-mon[124666]: pgmap v9793: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 938 B/s wr, 8 op/s 2023-05-08T08:48:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:38 smithi186 ceph-mon[126480]: pgmap v9794: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T08:48:38.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:38 smithi133 ceph-mon[125939]: pgmap v9794: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T08:48:39.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:38 smithi096 ceph-mon[124666]: pgmap v9794: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T08:48:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18257.981043 secs 2023-05-08T08:48:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18258.537680 secs 2023-05-08T08:48:39.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18257.981043 secs 2023-05-08T08:48:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18258.537680 secs 2023-05-08T08:48:40.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18257.981043 secs 2023-05-08T08:48:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18258.537680 secs 2023-05-08T08:48:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:40 smithi186 ceph-mon[126480]: pgmap v9795: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 165 KiB/s wr, 10 op/s 2023-05-08T08:48:40.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:40 smithi133 ceph-mon[125939]: pgmap v9795: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 165 KiB/s wr, 10 op/s 2023-05-08T08:48:41.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:40 smithi096 ceph-mon[124666]: pgmap v9795: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 165 KiB/s wr, 10 op/s 2023-05-08T08:48:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:42 smithi186 ceph-mon[126480]: pgmap v9796: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 164 KiB/s wr, 7 op/s 2023-05-08T08:48:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:42 smithi133 ceph-mon[125939]: pgmap v9796: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 164 KiB/s wr, 7 op/s 2023-05-08T08:48:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:42 smithi096 ceph-mon[124666]: pgmap v9796: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 164 KiB/s wr, 7 op/s 2023-05-08T08:48:43.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:48:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:48:44.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:48:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18262.981184 secs 2023-05-08T08:48:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:44 smithi186 ceph-mon[126480]: pgmap v9797: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 164 KiB/s wr, 7 op/s 2023-05-08T08:48:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:48:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:48:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:48:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18262.981184 secs 2023-05-08T08:48:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:44 smithi133 ceph-mon[125939]: pgmap v9797: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 164 KiB/s wr, 7 op/s 2023-05-08T08:48:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:48:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:48:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:48:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18262.981184 secs 2023-05-08T08:48:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:44 smithi096 ceph-mon[124666]: pgmap v9797: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 164 KiB/s wr, 7 op/s 2023-05-08T08:48:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:48:45.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:48:45.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:48:46.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:46 smithi186 ceph-mon[126480]: pgmap v9798: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 176 KiB/s wr, 11 op/s 2023-05-08T08:48:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:46 smithi133 ceph-mon[125939]: pgmap v9798: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 176 KiB/s wr, 11 op/s 2023-05-08T08:48:47.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:46 smithi096 ceph-mon[124666]: pgmap v9798: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 176 KiB/s wr, 11 op/s 2023-05-08T08:48:47.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:48:47.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:48:48.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:48:48.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:48 smithi186 ceph-mon[126480]: pgmap v9799: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 176 KiB/s wr, 7 op/s 2023-05-08T08:48:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:48:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:48:48.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:48 smithi133 ceph-mon[125939]: pgmap v9799: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 176 KiB/s wr, 7 op/s 2023-05-08T08:48:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:48:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:48:49.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:48 smithi096 ceph-mon[124666]: pgmap v9799: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 176 KiB/s wr, 7 op/s 2023-05-08T08:48:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:48:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:48:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18267.981306 secs 2023-05-08T08:48:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:49 smithi186 ceph-mon[126480]: pgmap v9800: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 427 KiB/s wr, 13 op/s 2023-05-08T08:48:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18267.981306 secs 2023-05-08T08:48:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:49 smithi133 ceph-mon[125939]: pgmap v9800: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 427 KiB/s wr, 13 op/s 2023-05-08T08:48:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18267.981306 secs 2023-05-08T08:48:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:49 smithi096 ceph-mon[124666]: pgmap v9800: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 427 KiB/s wr, 13 op/s 2023-05-08T08:48:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:51 smithi133 ceph-mon[125939]: pgmap v9801: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 264 KiB/s wr, 9 op/s 2023-05-08T08:48:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:51 smithi096 ceph-mon[124666]: pgmap v9801: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 264 KiB/s wr, 9 op/s 2023-05-08T08:48:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:51 smithi186 ceph-mon[126480]: pgmap v9801: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 264 KiB/s wr, 9 op/s 2023-05-08T08:48:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:52 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:48:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:52 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:48:53.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:52 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:48:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:53 smithi133 ceph-mon[125939]: pgmap v9802: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 264 KiB/s wr, 9 op/s 2023-05-08T08:48:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:53 smithi096 ceph-mon[124666]: pgmap v9802: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 264 KiB/s wr, 9 op/s 2023-05-08T08:48:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:53 smithi186 ceph-mon[126480]: pgmap v9802: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 264 KiB/s wr, 9 op/s 2023-05-08T08:48:54.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18272.981432 secs 2023-05-08T08:48:55.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18272.981432 secs 2023-05-08T08:48:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18272.981432 secs 2023-05-08T08:48:55.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:55 smithi133 ceph-mon[125939]: pgmap v9803: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 355 KiB/s rd, 342 KiB/s wr, 14 op/s 2023-05-08T08:48:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:55 smithi096 ceph-mon[124666]: pgmap v9803: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 355 KiB/s rd, 342 KiB/s wr, 14 op/s 2023-05-08T08:48:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:55 smithi186 ceph-mon[126480]: pgmap v9803: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 355 KiB/s rd, 342 KiB/s wr, 14 op/s 2023-05-08T08:48:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:58 smithi186 ceph-mon[126480]: pgmap v9804: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 330 KiB/s wr, 11 op/s 2023-05-08T08:48:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:58 smithi133 ceph-mon[125939]: pgmap v9804: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 330 KiB/s wr, 11 op/s 2023-05-08T08:48:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:58 smithi096 ceph-mon[124666]: pgmap v9804: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 330 KiB/s wr, 11 op/s 2023-05-08T08:48:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18277.981557 secs 2023-05-08T08:48:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:48:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18278.538026 secs 2023-05-08T08:48:59.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18277.981557 secs 2023-05-08T08:48:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:48:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18278.538026 secs 2023-05-08T08:49:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18277.981557 secs 2023-05-08T08:49:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:48:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18278.538026 secs 2023-05-08T08:49:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:00 smithi186 ceph-mon[126480]: pgmap v9805: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 502 KiB/s rd, 489 KiB/s wr, 15 op/s 2023-05-08T08:49:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:00 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:49:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:49:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:49:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18279.822834 secs 2023-05-08T08:49:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:00 smithi133 ceph-mon[125939]: pgmap v9805: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 502 KiB/s rd, 489 KiB/s wr, 15 op/s 2023-05-08T08:49:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:00 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:49:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:49:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:49:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18279.822834 secs 2023-05-08T08:49:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:00 smithi096 ceph-mon[124666]: pgmap v9805: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 502 KiB/s rd, 489 KiB/s wr, 15 op/s 2023-05-08T08:49:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:00 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:49:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:49:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:49:01.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18279.822834 secs 2023-05-08T08:49:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:02 smithi186 ceph-mon[126480]: pgmap v9806: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 238 KiB/s wr, 10 op/s 2023-05-08T08:49:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:02 smithi133 ceph-mon[125939]: pgmap v9806: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 238 KiB/s wr, 10 op/s 2023-05-08T08:49:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:02 smithi096 ceph-mon[124666]: pgmap v9806: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 238 KiB/s wr, 10 op/s 2023-05-08T08:49:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18282.981680 secs 2023-05-08T08:49:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:04 smithi186 ceph-mon[126480]: pgmap v9807: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 238 KiB/s wr, 10 op/s 2023-05-08T08:49:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:04 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:49:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:04 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:49:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18283.538128 secs 2023-05-08T08:49:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18282.981680 secs 2023-05-08T08:49:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:04 smithi133 ceph-mon[125939]: pgmap v9807: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 238 KiB/s wr, 10 op/s 2023-05-08T08:49:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:04 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:49:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:04 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:49:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18283.538128 secs 2023-05-08T08:49:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18282.981680 secs 2023-05-08T08:49:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:04 smithi096 ceph-mon[124666]: pgmap v9807: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 238 KiB/s wr, 10 op/s 2023-05-08T08:49:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:04 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:49:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:04 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:49:05.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18283.538128 secs 2023-05-08T08:49:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18284.822953 secs 2023-05-08T08:49:05.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18284.822953 secs 2023-05-08T08:49:06.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18284.822953 secs 2023-05-08T08:49:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:06 smithi186 ceph-mon[126480]: pgmap v9808: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 283 KiB/s wr, 28 op/s 2023-05-08T08:49:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:06 smithi133 ceph-mon[125939]: pgmap v9808: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 283 KiB/s wr, 28 op/s 2023-05-08T08:49:07.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:06 smithi096 ceph-mon[124666]: pgmap v9808: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 283 KiB/s wr, 28 op/s 2023-05-08T08:49:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:07 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:49:07.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:07 smithi186 ceph-mon[126480]: pgmap v9809: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 205 KiB/s wr, 22 op/s 2023-05-08T08:49:07.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:07 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:49:07.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:07 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:49:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:07 smithi133 ceph-mon[125939]: pgmap v9809: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 205 KiB/s wr, 22 op/s 2023-05-08T08:49:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:07 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:49:08.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:07 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:49:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:07 smithi096 ceph-mon[124666]: pgmap v9809: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 205 KiB/s wr, 22 op/s 2023-05-08T08:49:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:07 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:49:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18287.981801 secs 2023-05-08T08:49:09.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18287.981801 secs 2023-05-08T08:49:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18287.981801 secs 2023-05-08T08:49:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18288.538253 secs 2023-05-08T08:49:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:09 smithi186 ceph-mon[126480]: pgmap v9810: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 322 KiB/s wr, 25 op/s 2023-05-08T08:49:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18288.538253 secs 2023-05-08T08:49:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:09 smithi133 ceph-mon[125939]: pgmap v9810: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 322 KiB/s wr, 25 op/s 2023-05-08T08:49:10.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18288.538253 secs 2023-05-08T08:49:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:09 smithi096 ceph-mon[124666]: pgmap v9810: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 322 KiB/s wr, 25 op/s 2023-05-08T08:49:11.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:10 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:49:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:10 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:49:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:10 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:49:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:10 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:49:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:10 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:49:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:10 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:49:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18289.823026 secs 2023-05-08T08:49:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:10 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:49:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:10 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:49:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:10 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:49:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:10 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:49:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:10 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:49:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:10 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:49:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18289.823026 secs 2023-05-08T08:49:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:10 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:49:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:10 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:49:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:10 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:49:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:10 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:49:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:10 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:49:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:10 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:49:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18289.823026 secs 2023-05-08T08:49:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:11 smithi096 ceph-mon[124666]: osdmap e690: 12 total, 12 up, 12 in 2023-05-08T08:49:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:11 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:49:12.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:11 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:49:12.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:11 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:49:12.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:11 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:49:12.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:11 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:49:12.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:11 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:49:12.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:11 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:49:12.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:11 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:49:12.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:11 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:49:12.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:11 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:49:12.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:11 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:49:12.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:11 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:49:12.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:11 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:49:12.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:11 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi096 to 49687k 2023-05-08T08:49:12.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:11 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:49:12.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:11 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:49:12.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:11 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi096 to 50879500: error parsing value: Value '50879500' is below minimum 939524096 2023-05-08T08:49:12.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:11 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:49:12.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:11 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:49:12.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:11 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T08:49:12.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:11 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:49:12.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:11 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T08:49:12.259 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:11 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T08:49:12.259 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:11 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T08:49:12.259 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:11 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:49:12.259 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:11 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:49:12.259 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:11 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:49:12.259 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:11 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:49:12.259 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:11 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T08:49:12.260 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:11 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T08:49:12.260 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:11 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:49:12.260 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:11 smithi096 ceph-mon[124666]: pgmap v9812: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 195 KiB/s wr, 25 op/s 2023-05-08T08:49:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:11 smithi186 ceph-mon[126480]: osdmap e690: 12 total, 12 up, 12 in 2023-05-08T08:49:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:11 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:49:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:11 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:49:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:11 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:49:12.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:11 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:49:12.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:11 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:49:12.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:11 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:49:12.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:11 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:49:12.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:11 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:49:12.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:11 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:49:12.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:11 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:49:12.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:11 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:49:12.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:11 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:49:12.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:11 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:49:12.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:11 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi096 to 49687k 2023-05-08T08:49:12.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:11 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:49:12.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:11 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:49:12.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:11 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi096 to 50879500: error parsing value: Value '50879500' is below minimum 939524096 2023-05-08T08:49:12.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:11 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:49:12.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:11 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:49:12.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:11 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T08:49:12.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:11 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:49:12.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:11 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T08:49:12.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:11 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T08:49:12.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:11 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T08:49:12.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:11 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:49:12.373 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:11 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:49:12.373 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:11 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:49:12.373 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:11 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:49:12.373 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:11 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T08:49:12.373 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:11 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T08:49:12.373 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:11 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:49:12.373 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:11 smithi186 ceph-mon[126480]: pgmap v9812: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 195 KiB/s wr, 25 op/s 2023-05-08T08:49:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:11 smithi133 ceph-mon[125939]: osdmap e690: 12 total, 12 up, 12 in 2023-05-08T08:49:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:11 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:49:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:11 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:49:12.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:11 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:49:12.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:11 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:49:12.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:11 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:49:12.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:11 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:49:12.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:11 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:49:12.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:11 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:49:12.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:11 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:49:12.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:11 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:49:12.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:11 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:49:12.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:11 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:49:12.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:11 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:49:12.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:11 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi096 to 49687k 2023-05-08T08:49:12.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:11 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:49:12.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:11 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:49:12.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:11 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi096 to 50879500: error parsing value: Value '50879500' is below minimum 939524096 2023-05-08T08:49:12.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:11 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:49:12.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:11 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:49:12.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:11 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T08:49:12.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:11 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:49:12.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:11 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T08:49:12.494 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:11 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T08:49:12.494 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:11 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T08:49:12.494 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:11 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:49:12.494 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:11 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:49:12.494 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:11 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:49:12.494 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:11 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:49:12.494 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:11 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T08:49:12.494 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:11 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T08:49:12.495 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:11 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:49:12.495 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:11 smithi133 ceph-mon[125939]: pgmap v9812: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 195 KiB/s wr, 25 op/s 2023-05-08T08:49:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18292.981923 secs 2023-05-08T08:49:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:14 smithi186 ceph-mon[126480]: pgmap v9813: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 195 KiB/s wr, 25 op/s 2023-05-08T08:49:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18293.538368 secs 2023-05-08T08:49:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18292.981923 secs 2023-05-08T08:49:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:14 smithi133 ceph-mon[125939]: pgmap v9813: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 195 KiB/s wr, 25 op/s 2023-05-08T08:49:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18293.538368 secs 2023-05-08T08:49:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18292.981923 secs 2023-05-08T08:49:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:14 smithi096 ceph-mon[124666]: pgmap v9813: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 195 KiB/s wr, 25 op/s 2023-05-08T08:49:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18293.538368 secs 2023-05-08T08:49:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18294.823143 secs 2023-05-08T08:49:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18294.823143 secs 2023-05-08T08:49:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18294.823143 secs 2023-05-08T08:49:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:16 smithi186 ceph-mon[126480]: pgmap v9814: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 141 KiB/s wr, 7 op/s 2023-05-08T08:49:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:16 smithi133 ceph-mon[125939]: pgmap v9814: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 141 KiB/s wr, 7 op/s 2023-05-08T08:49:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:16 smithi096 ceph-mon[124666]: pgmap v9814: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 141 KiB/s wr, 7 op/s 2023-05-08T08:49:18.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:18 smithi186 ceph-mon[126480]: pgmap v9815: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 141 KiB/s wr, 7 op/s 2023-05-08T08:49:18.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:18 smithi133 ceph-mon[125939]: pgmap v9815: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 141 KiB/s wr, 7 op/s 2023-05-08T08:49:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:18 smithi096 ceph-mon[124666]: pgmap v9815: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 141 KiB/s wr, 7 op/s 2023-05-08T08:49:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18297.982051 secs 2023-05-08T08:49:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18298.538462 secs 2023-05-08T08:49:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18297.982051 secs 2023-05-08T08:49:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18298.538462 secs 2023-05-08T08:49:20.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18297.982051 secs 2023-05-08T08:49:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18298.538462 secs 2023-05-08T08:49:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:20 smithi186 ceph-mon[126480]: pgmap v9816: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 6 op/s 2023-05-08T08:49:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18299.823268 secs 2023-05-08T08:49:20.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:20 smithi133 ceph-mon[125939]: pgmap v9816: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 6 op/s 2023-05-08T08:49:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18299.823268 secs 2023-05-08T08:49:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:20 smithi096 ceph-mon[124666]: pgmap v9816: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 6 op/s 2023-05-08T08:49:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18299.823268 secs 2023-05-08T08:49:21.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:21 smithi186 ceph-mon[126480]: pgmap v9817: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 51 KiB/s wr, 6 op/s 2023-05-08T08:49:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:21 smithi133 ceph-mon[125939]: pgmap v9817: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 51 KiB/s wr, 6 op/s 2023-05-08T08:49:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:21 smithi096 ceph-mon[124666]: pgmap v9817: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 51 KiB/s wr, 6 op/s 2023-05-08T08:49:23.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:23 smithi186 ceph-mon[126480]: osdmap e691: 12 total, 12 up, 12 in 2023-05-08T08:49:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:23 smithi133 ceph-mon[125939]: osdmap e691: 12 total, 12 up, 12 in 2023-05-08T08:49:24.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:23 smithi096 ceph-mon[124666]: osdmap e691: 12 total, 12 up, 12 in 2023-05-08T08:49:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18302.982190 secs 2023-05-08T08:49:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:24 smithi186 ceph-mon[126480]: pgmap v9819: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 6 op/s 2023-05-08T08:49:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18303.538585 secs 2023-05-08T08:49:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18302.982190 secs 2023-05-08T08:49:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:24 smithi133 ceph-mon[125939]: pgmap v9819: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 6 op/s 2023-05-08T08:49:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18303.538585 secs 2023-05-08T08:49:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18302.982190 secs 2023-05-08T08:49:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:24 smithi096 ceph-mon[124666]: pgmap v9819: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 6 op/s 2023-05-08T08:49:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18303.538585 secs 2023-05-08T08:49:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18304.823416 secs 2023-05-08T08:49:25.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18304.823416 secs 2023-05-08T08:49:26.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18304.823416 secs 2023-05-08T08:49:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:26 smithi186 ceph-mon[126480]: pgmap v9820: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 53 KiB/s wr, 6 op/s 2023-05-08T08:49:26.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:26 smithi133 ceph-mon[125939]: pgmap v9820: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 53 KiB/s wr, 6 op/s 2023-05-08T08:49:27.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:26 smithi096 ceph-mon[124666]: pgmap v9820: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 53 KiB/s wr, 6 op/s 2023-05-08T08:49:28.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:28 smithi186 ceph-mon[126480]: pgmap v9821: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 53 KiB/s wr, 6 op/s 2023-05-08T08:49:28.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:28 smithi133 ceph-mon[125939]: pgmap v9821: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 53 KiB/s wr, 6 op/s 2023-05-08T08:49:29.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:28 smithi096 ceph-mon[124666]: pgmap v9821: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 53 KiB/s wr, 6 op/s 2023-05-08T08:49:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18307.982316 secs 2023-05-08T08:49:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18308.538694 secs 2023-05-08T08:49:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18307.982316 secs 2023-05-08T08:49:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18308.538694 secs 2023-05-08T08:49:30.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18307.982316 secs 2023-05-08T08:49:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18308.538694 secs 2023-05-08T08:49:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:30 smithi186 ceph-mon[126480]: pgmap v9822: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:49:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18309.823540 secs 2023-05-08T08:49:30.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:30 smithi133 ceph-mon[125939]: pgmap v9822: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:49:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18309.823540 secs 2023-05-08T08:49:31.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:30 smithi096 ceph-mon[124666]: pgmap v9822: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:49:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18309.823540 secs 2023-05-08T08:49:32.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:32 smithi186 ceph-mon[126480]: pgmap v9823: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:49:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:32 smithi133 ceph-mon[125939]: pgmap v9823: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:49:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:32 smithi096 ceph-mon[124666]: pgmap v9823: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:49:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18312.982411 secs 2023-05-08T08:49:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:34 smithi186 ceph-mon[126480]: pgmap v9824: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 93 B/s wr, 5 op/s 2023-05-08T08:49:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18313.538839 secs 2023-05-08T08:49:34.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18312.982411 secs 2023-05-08T08:49:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:34 smithi133 ceph-mon[125939]: pgmap v9824: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 93 B/s wr, 5 op/s 2023-05-08T08:49:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18313.538839 secs 2023-05-08T08:49:35.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18312.982411 secs 2023-05-08T08:49:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:34 smithi096 ceph-mon[124666]: pgmap v9824: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 93 B/s wr, 5 op/s 2023-05-08T08:49:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18313.538839 secs 2023-05-08T08:49:35.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18314.823680 secs 2023-05-08T08:49:35.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18314.823680 secs 2023-05-08T08:49:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18314.823680 secs 2023-05-08T08:49:36.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:36 smithi186 ceph-mon[126480]: pgmap v9825: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 938 B/s wr, 8 op/s 2023-05-08T08:49:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:36 smithi133 ceph-mon[125939]: pgmap v9825: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 938 B/s wr, 8 op/s 2023-05-08T08:49:37.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:36 smithi096 ceph-mon[124666]: pgmap v9825: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 938 B/s wr, 8 op/s 2023-05-08T08:49:38.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:38 smithi186 ceph-mon[126480]: pgmap v9826: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T08:49:38.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:38 smithi133 ceph-mon[125939]: pgmap v9826: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T08:49:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:38 smithi096 ceph-mon[124666]: pgmap v9826: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T08:49:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18317.982506 secs 2023-05-08T08:49:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18318.538952 secs 2023-05-08T08:49:39.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18317.982506 secs 2023-05-08T08:49:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18318.538952 secs 2023-05-08T08:49:40.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18317.982506 secs 2023-05-08T08:49:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18318.538952 secs 2023-05-08T08:49:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:40 smithi186 ceph-mon[126480]: pgmap v9827: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 68 KiB/s wr, 9 op/s 2023-05-08T08:49:40.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:40 smithi133 ceph-mon[125939]: pgmap v9827: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 68 KiB/s wr, 9 op/s 2023-05-08T08:49:41.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:40 smithi096 ceph-mon[124666]: pgmap v9827: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 68 KiB/s wr, 9 op/s 2023-05-08T08:49:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:42 smithi186 ceph-mon[126480]: pgmap v9828: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 68 KiB/s wr, 6 op/s 2023-05-08T08:49:42.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:42 smithi133 ceph-mon[125939]: pgmap v9828: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 68 KiB/s wr, 6 op/s 2023-05-08T08:49:43.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:42 smithi096 ceph-mon[124666]: pgmap v9828: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 68 KiB/s wr, 6 op/s 2023-05-08T08:49:43.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:49:43.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:49:44.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:49:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18322.982627 secs 2023-05-08T08:49:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:44 smithi186 ceph-mon[126480]: pgmap v9829: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 68 KiB/s wr, 6 op/s 2023-05-08T08:49:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:49:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:49:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:49:44.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18322.982627 secs 2023-05-08T08:49:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:44 smithi133 ceph-mon[125939]: pgmap v9829: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 68 KiB/s wr, 6 op/s 2023-05-08T08:49:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:49:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:49:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:49:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18322.982627 secs 2023-05-08T08:49:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:44 smithi096 ceph-mon[124666]: pgmap v9829: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 68 KiB/s wr, 6 op/s 2023-05-08T08:49:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:49:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:49:45.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:49:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:45 smithi186 ceph-mon[126480]: pgmap v9830: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 80 KiB/s wr, 10 op/s 2023-05-08T08:49:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:45 smithi133 ceph-mon[125939]: pgmap v9830: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 80 KiB/s wr, 10 op/s 2023-05-08T08:49:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:45 smithi096 ceph-mon[124666]: pgmap v9830: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 80 KiB/s wr, 10 op/s 2023-05-08T08:49:47.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:49:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:49:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:49:48.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:49:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:49:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:48 smithi186 ceph-mon[126480]: pgmap v9831: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 79 KiB/s wr, 7 op/s 2023-05-08T08:49:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:49:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:49:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:48 smithi133 ceph-mon[125939]: pgmap v9831: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 79 KiB/s wr, 7 op/s 2023-05-08T08:49:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:49:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:49:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:48 smithi096 ceph-mon[124666]: pgmap v9831: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 79 KiB/s wr, 7 op/s 2023-05-08T08:49:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18327.982731 secs 2023-05-08T08:49:49.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18327.982731 secs 2023-05-08T08:49:49.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18327.982731 secs 2023-05-08T08:49:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:50 smithi186 ceph-mon[126480]: pgmap v9832: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 389 KiB/s rd, 350 KiB/s wr, 13 op/s 2023-05-08T08:49:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:50 smithi133 ceph-mon[125939]: pgmap v9832: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 389 KiB/s rd, 350 KiB/s wr, 13 op/s 2023-05-08T08:49:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:50 smithi096 ceph-mon[124666]: pgmap v9832: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 389 KiB/s rd, 350 KiB/s wr, 13 op/s 2023-05-08T08:49:51.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:51 smithi133 ceph-mon[125939]: pgmap v9833: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 283 KiB/s wr, 9 op/s 2023-05-08T08:49:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:51 smithi096 ceph-mon[124666]: pgmap v9833: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 283 KiB/s wr, 9 op/s 2023-05-08T08:49:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:51 smithi186 ceph-mon[126480]: pgmap v9833: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 283 KiB/s wr, 9 op/s 2023-05-08T08:49:52.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:52 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:49:53.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:52 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:49:53.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:52 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:49:53.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:53 smithi133 ceph-mon[125939]: pgmap v9834: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 283 KiB/s wr, 9 op/s 2023-05-08T08:49:54.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:53 smithi096 ceph-mon[124666]: pgmap v9834: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 283 KiB/s wr, 9 op/s 2023-05-08T08:49:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:53 smithi186 ceph-mon[126480]: pgmap v9834: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 283 KiB/s wr, 9 op/s 2023-05-08T08:49:54.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18332.982844 secs 2023-05-08T08:49:55.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18332.982844 secs 2023-05-08T08:49:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18332.982844 secs 2023-05-08T08:49:55.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:55 smithi133 ceph-mon[125939]: pgmap v9835: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 362 KiB/s wr, 14 op/s 2023-05-08T08:49:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:55 smithi096 ceph-mon[124666]: pgmap v9835: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 362 KiB/s wr, 14 op/s 2023-05-08T08:49:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:55 smithi186 ceph-mon[126480]: pgmap v9835: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 362 KiB/s wr, 14 op/s 2023-05-08T08:49:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:58 smithi186 ceph-mon[126480]: pgmap v9836: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 350 KiB/s wr, 11 op/s 2023-05-08T08:49:58.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:58 smithi133 ceph-mon[125939]: pgmap v9836: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 350 KiB/s wr, 11 op/s 2023-05-08T08:49:59.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:58 smithi096 ceph-mon[124666]: pgmap v9836: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 350 KiB/s wr, 11 op/s 2023-05-08T08:49:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18337.982975 secs 2023-05-08T08:49:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:49:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18338.539425 secs 2023-05-08T08:49:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18337.982975 secs 2023-05-08T08:49:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:49:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18338.539425 secs 2023-05-08T08:50:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18337.982975 secs 2023-05-08T08:50:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:49:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18338.539425 secs 2023-05-08T08:50:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:00 smithi186 ceph-mon[126480]: pgmap v9837: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 493 KiB/s wr, 15 op/s 2023-05-08T08:50:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:00 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:50:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:50:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:50:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:00 smithi186 ceph-mon[126480]: overall HEALTH_WARN 2 MDSs report slow requests 2023-05-08T08:50:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18339.824256 secs 2023-05-08T08:50:00.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:00 smithi133 ceph-mon[125939]: pgmap v9837: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 493 KiB/s wr, 15 op/s 2023-05-08T08:50:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:00 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:50:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:50:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:50:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:00 smithi133 ceph-mon[125939]: overall HEALTH_WARN 2 MDSs report slow requests 2023-05-08T08:50:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18339.824256 secs 2023-05-08T08:50:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:00 smithi096 ceph-mon[124666]: pgmap v9837: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 493 KiB/s wr, 15 op/s 2023-05-08T08:50:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:00 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:50:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:50:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:50:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:00 smithi096 ceph-mon[124666]: overall HEALTH_WARN 2 MDSs report slow requests 2023-05-08T08:50:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18339.824256 secs 2023-05-08T08:50:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:02 smithi186 ceph-mon[126480]: pgmap v9838: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 222 KiB/s wr, 10 op/s 2023-05-08T08:50:02.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:02 smithi133 ceph-mon[125939]: pgmap v9838: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 222 KiB/s wr, 10 op/s 2023-05-08T08:50:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:02 smithi096 ceph-mon[124666]: pgmap v9838: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 222 KiB/s wr, 10 op/s 2023-05-08T08:50:03.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:03 smithi133 ceph-mon[125939]: pgmap v9839: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 222 KiB/s wr, 10 op/s 2023-05-08T08:50:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:50:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:03 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:50:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:03 smithi096 ceph-mon[124666]: pgmap v9839: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 222 KiB/s wr, 10 op/s 2023-05-08T08:50:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:50:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:03 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:50:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:03 smithi186 ceph-mon[126480]: pgmap v9839: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 222 KiB/s wr, 10 op/s 2023-05-08T08:50:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:50:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:03 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:50:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18342.983039 secs 2023-05-08T08:50:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18343.539544 secs 2023-05-08T08:50:05.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18342.983039 secs 2023-05-08T08:50:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18343.539544 secs 2023-05-08T08:50:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18342.983039 secs 2023-05-08T08:50:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18343.539544 secs 2023-05-08T08:50:05.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18344.824382 secs 2023-05-08T08:50:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:05 smithi133 ceph-mon[125939]: pgmap v9840: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 267 KiB/s wr, 27 op/s 2023-05-08T08:50:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18344.824382 secs 2023-05-08T08:50:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:05 smithi096 ceph-mon[124666]: pgmap v9840: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 267 KiB/s wr, 27 op/s 2023-05-08T08:50:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18344.824382 secs 2023-05-08T08:50:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:05 smithi186 ceph-mon[126480]: pgmap v9840: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 267 KiB/s wr, 27 op/s 2023-05-08T08:50:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:07 smithi133 ceph-mon[125939]: pgmap v9841: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 188 KiB/s wr, 22 op/s 2023-05-08T08:50:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:07 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:50:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:07 smithi096 ceph-mon[124666]: pgmap v9841: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 188 KiB/s wr, 22 op/s 2023-05-08T08:50:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:07 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:50:08.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:07 smithi186 ceph-mon[126480]: pgmap v9841: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 188 KiB/s wr, 22 op/s 2023-05-08T08:50:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:07 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:50:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18347.983166 secs 2023-05-08T08:50:09.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18347.983166 secs 2023-05-08T08:50:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18347.983166 secs 2023-05-08T08:50:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18348.539615 secs 2023-05-08T08:50:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:09 smithi186 ceph-mon[126480]: pgmap v9842: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 306 KiB/s wr, 25 op/s 2023-05-08T08:50:10.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18348.539615 secs 2023-05-08T08:50:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:09 smithi133 ceph-mon[125939]: pgmap v9842: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 306 KiB/s wr, 25 op/s 2023-05-08T08:50:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18348.539615 secs 2023-05-08T08:50:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:09 smithi096 ceph-mon[124666]: pgmap v9842: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 306 KiB/s wr, 25 op/s 2023-05-08T08:50:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18349.824504 secs 2023-05-08T08:50:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18349.824504 secs 2023-05-08T08:50:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18349.824504 secs 2023-05-08T08:50:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:11 smithi133 ceph-mon[125939]: osdmap e692: 12 total, 12 up, 12 in 2023-05-08T08:50:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:11 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:50:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:11 smithi133 ceph-mon[125939]: pgmap v9844: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 196 KiB/s wr, 25 op/s 2023-05-08T08:50:12.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:11 smithi096 ceph-mon[124666]: osdmap e692: 12 total, 12 up, 12 in 2023-05-08T08:50:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:11 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:50:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:11 smithi096 ceph-mon[124666]: pgmap v9844: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 196 KiB/s wr, 25 op/s 2023-05-08T08:50:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:11 smithi186 ceph-mon[126480]: osdmap e692: 12 total, 12 up, 12 in 2023-05-08T08:50:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:11 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:50:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:11 smithi186 ceph-mon[126480]: pgmap v9844: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 196 KiB/s wr, 25 op/s 2023-05-08T08:50:13.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:12 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:50:13.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:12 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:50:13.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:12 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:50:13.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:12 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:50:13.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:12 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T08:50:13.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:12 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T08:50:13.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:12 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:50:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:12 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:50:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:12 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:50:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:12 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:50:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:12 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:50:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:12 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T08:50:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:12 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T08:50:13.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:12 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:50:13.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:12 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:50:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:12 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:50:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:12 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:50:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:12 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:50:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:12 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T08:50:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:12 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T08:50:13.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:12 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:50:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18352.983230 secs 2023-05-08T08:50:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:13 smithi133 ceph-mon[125939]: pgmap v9845: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 196 KiB/s wr, 25 op/s 2023-05-08T08:50:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18352.983230 secs 2023-05-08T08:50:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:13 smithi096 ceph-mon[124666]: pgmap v9845: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 196 KiB/s wr, 25 op/s 2023-05-08T08:50:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18352.983230 secs 2023-05-08T08:50:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:13 smithi186 ceph-mon[126480]: pgmap v9845: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 196 KiB/s wr, 25 op/s 2023-05-08T08:50:15.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18353.539719 secs 2023-05-08T08:50:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18353.539719 secs 2023-05-08T08:50:15.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18353.539719 secs 2023-05-08T08:50:16.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18354.824586 secs 2023-05-08T08:50:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:15 smithi133 ceph-mon[125939]: pgmap v9846: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 142 KiB/s wr, 7 op/s 2023-05-08T08:50:16.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18354.824586 secs 2023-05-08T08:50:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:15 smithi096 ceph-mon[124666]: pgmap v9846: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 142 KiB/s wr, 7 op/s 2023-05-08T08:50:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18354.824586 secs 2023-05-08T08:50:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:15 smithi186 ceph-mon[126480]: pgmap v9846: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 142 KiB/s wr, 7 op/s 2023-05-08T08:50:18.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:18 smithi186 ceph-mon[126480]: pgmap v9847: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 142 KiB/s wr, 7 op/s 2023-05-08T08:50:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:18 smithi133 ceph-mon[125939]: pgmap v9847: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 142 KiB/s wr, 7 op/s 2023-05-08T08:50:19.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:18 smithi096 ceph-mon[124666]: pgmap v9847: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 142 KiB/s wr, 7 op/s 2023-05-08T08:50:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18357.983366 secs 2023-05-08T08:50:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18358.539839 secs 2023-05-08T08:50:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18357.983366 secs 2023-05-08T08:50:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18358.539839 secs 2023-05-08T08:50:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18357.983366 secs 2023-05-08T08:50:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18358.539839 secs 2023-05-08T08:50:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:20 smithi186 ceph-mon[126480]: pgmap v9848: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 6 op/s 2023-05-08T08:50:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18359.824676 secs 2023-05-08T08:50:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:20 smithi133 ceph-mon[125939]: pgmap v9848: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 6 op/s 2023-05-08T08:50:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18359.824676 secs 2023-05-08T08:50:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:20 smithi096 ceph-mon[124666]: pgmap v9848: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 6 op/s 2023-05-08T08:50:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18359.824676 secs 2023-05-08T08:50:21.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:21 smithi133 ceph-mon[125939]: pgmap v9849: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 50 KiB/s wr, 6 op/s 2023-05-08T08:50:22.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:21 smithi096 ceph-mon[124666]: pgmap v9849: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 50 KiB/s wr, 6 op/s 2023-05-08T08:50:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:21 smithi186 ceph-mon[126480]: pgmap v9849: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 50 KiB/s wr, 6 op/s 2023-05-08T08:50:23.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:23 smithi186 ceph-mon[126480]: osdmap e693: 12 total, 12 up, 12 in 2023-05-08T08:50:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:23 smithi133 ceph-mon[125939]: osdmap e693: 12 total, 12 up, 12 in 2023-05-08T08:50:24.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:23 smithi096 ceph-mon[124666]: osdmap e693: 12 total, 12 up, 12 in 2023-05-08T08:50:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18362.983426 secs 2023-05-08T08:50:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:24 smithi186 ceph-mon[126480]: pgmap v9851: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 6 op/s 2023-05-08T08:50:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18363.539945 secs 2023-05-08T08:50:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18362.983426 secs 2023-05-08T08:50:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:24 smithi133 ceph-mon[125939]: pgmap v9851: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 6 op/s 2023-05-08T08:50:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18363.539945 secs 2023-05-08T08:50:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18362.983426 secs 2023-05-08T08:50:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:24 smithi096 ceph-mon[124666]: pgmap v9851: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 6 op/s 2023-05-08T08:50:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18363.539945 secs 2023-05-08T08:50:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18364.824766 secs 2023-05-08T08:50:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18364.824766 secs 2023-05-08T08:50:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18364.824766 secs 2023-05-08T08:50:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:26 smithi186 ceph-mon[126480]: pgmap v9852: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 6 op/s 2023-05-08T08:50:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:26 smithi133 ceph-mon[125939]: pgmap v9852: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 6 op/s 2023-05-08T08:50:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:26 smithi096 ceph-mon[124666]: pgmap v9852: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 6 op/s 2023-05-08T08:50:28.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:28 smithi186 ceph-mon[126480]: pgmap v9853: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 6 op/s 2023-05-08T08:50:28.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:28 smithi133 ceph-mon[125939]: pgmap v9853: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 6 op/s 2023-05-08T08:50:29.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:28 smithi096 ceph-mon[124666]: pgmap v9853: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 6 op/s 2023-05-08T08:50:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18367.983558 secs 2023-05-08T08:50:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18368.540070 secs 2023-05-08T08:50:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18367.983558 secs 2023-05-08T08:50:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18368.540070 secs 2023-05-08T08:50:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18367.983558 secs 2023-05-08T08:50:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18368.540070 secs 2023-05-08T08:50:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:30 smithi186 ceph-mon[126480]: pgmap v9854: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:50:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18369.824880 secs 2023-05-08T08:50:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:30 smithi133 ceph-mon[125939]: pgmap v9854: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:50:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18369.824880 secs 2023-05-08T08:50:31.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:30 smithi096 ceph-mon[124666]: pgmap v9854: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:50:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18369.824880 secs 2023-05-08T08:50:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:31 smithi186 ceph-mon[126480]: pgmap v9855: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:50:31.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:31 smithi133 ceph-mon[125939]: pgmap v9855: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:50:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:31 smithi096 ceph-mon[124666]: pgmap v9855: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T08:50:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18372.983653 secs 2023-05-08T08:50:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:34 smithi186 ceph-mon[126480]: pgmap v9856: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 93 B/s wr, 5 op/s 2023-05-08T08:50:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18373.540190 secs 2023-05-08T08:50:34.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18372.983653 secs 2023-05-08T08:50:34.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:34 smithi133 ceph-mon[125939]: pgmap v9856: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 93 B/s wr, 5 op/s 2023-05-08T08:50:34.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18373.540190 secs 2023-05-08T08:50:35.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18372.983653 secs 2023-05-08T08:50:35.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:34 smithi096 ceph-mon[124666]: pgmap v9856: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 93 B/s wr, 5 op/s 2023-05-08T08:50:35.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18373.540190 secs 2023-05-08T08:50:35.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18374.824998 secs 2023-05-08T08:50:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18374.824998 secs 2023-05-08T08:50:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18374.824998 secs 2023-05-08T08:50:36.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:36 smithi186 ceph-mon[126480]: pgmap v9857: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 938 B/s wr, 8 op/s 2023-05-08T08:50:36.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:36 smithi133 ceph-mon[125939]: pgmap v9857: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 938 B/s wr, 8 op/s 2023-05-08T08:50:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:36 smithi096 ceph-mon[124666]: pgmap v9857: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 938 B/s wr, 8 op/s 2023-05-08T08:50:38.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:38 smithi186 ceph-mon[126480]: pgmap v9858: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T08:50:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:38 smithi133 ceph-mon[125939]: pgmap v9858: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T08:50:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:38 smithi096 ceph-mon[124666]: pgmap v9858: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T08:50:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18377.983769 secs 2023-05-08T08:50:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18378.540321 secs 2023-05-08T08:50:39.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18377.983769 secs 2023-05-08T08:50:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18378.540321 secs 2023-05-08T08:50:40.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18377.983769 secs 2023-05-08T08:50:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18378.540321 secs 2023-05-08T08:50:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:40 smithi186 ceph-mon[126480]: pgmap v9859: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 122 KiB/s wr, 10 op/s 2023-05-08T08:50:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:40 smithi133 ceph-mon[125939]: pgmap v9859: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 122 KiB/s wr, 10 op/s 2023-05-08T08:50:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:40 smithi096 ceph-mon[124666]: pgmap v9859: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 122 KiB/s wr, 10 op/s 2023-05-08T08:50:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:41 smithi186 ceph-mon[126480]: pgmap v9860: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 122 KiB/s wr, 7 op/s 2023-05-08T08:50:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:41 smithi133 ceph-mon[125939]: pgmap v9860: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 122 KiB/s wr, 7 op/s 2023-05-08T08:50:42.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:41 smithi096 ceph-mon[124666]: pgmap v9860: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 122 KiB/s wr, 7 op/s 2023-05-08T08:50:43.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:50:43.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:50:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:50:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18382.983882 secs 2023-05-08T08:50:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:44 smithi186 ceph-mon[126480]: pgmap v9861: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 122 KiB/s wr, 7 op/s 2023-05-08T08:50:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:50:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:50:44.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:50:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18382.983882 secs 2023-05-08T08:50:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:44 smithi133 ceph-mon[125939]: pgmap v9861: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 122 KiB/s wr, 7 op/s 2023-05-08T08:50:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:50:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:50:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:50:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18382.983882 secs 2023-05-08T08:50:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:44 smithi096 ceph-mon[124666]: pgmap v9861: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 122 KiB/s wr, 7 op/s 2023-05-08T08:50:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:50:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:50:45.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:50:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:45 smithi186 ceph-mon[126480]: pgmap v9862: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 134 KiB/s wr, 11 op/s 2023-05-08T08:50:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:45 smithi133 ceph-mon[125939]: pgmap v9862: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 134 KiB/s wr, 11 op/s 2023-05-08T08:50:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:45 smithi096 ceph-mon[124666]: pgmap v9862: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 134 KiB/s wr, 11 op/s 2023-05-08T08:50:47.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:50:47.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:50:47.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:50:48.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:50:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:50:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:48 smithi186 ceph-mon[126480]: pgmap v9863: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 133 KiB/s wr, 7 op/s 2023-05-08T08:50:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:50:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:50:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:48 smithi133 ceph-mon[125939]: pgmap v9863: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 133 KiB/s wr, 7 op/s 2023-05-08T08:50:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:50:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:50:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:48 smithi096 ceph-mon[124666]: pgmap v9863: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 133 KiB/s wr, 7 op/s 2023-05-08T08:50:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18387.983967 secs 2023-05-08T08:50:49.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18387.983967 secs 2023-05-08T08:50:49.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18387.983967 secs 2023-05-08T08:50:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:50 smithi186 ceph-mon[126480]: pgmap v9864: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 420 KiB/s rd, 406 KiB/s wr, 13 op/s 2023-05-08T08:50:50.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:50 smithi133 ceph-mon[125939]: pgmap v9864: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 420 KiB/s rd, 406 KiB/s wr, 13 op/s 2023-05-08T08:50:50.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:50 smithi096 ceph-mon[124666]: pgmap v9864: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 420 KiB/s rd, 406 KiB/s wr, 13 op/s 2023-05-08T08:50:51.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:51 smithi133 ceph-mon[125939]: pgmap v9865: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 285 KiB/s wr, 9 op/s 2023-05-08T08:50:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:51 smithi096 ceph-mon[124666]: pgmap v9865: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 285 KiB/s wr, 9 op/s 2023-05-08T08:50:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:51 smithi186 ceph-mon[126480]: pgmap v9865: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 285 KiB/s wr, 9 op/s 2023-05-08T08:50:52.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:52 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:50:53.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:52 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:50:53.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:52 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:50:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:53 smithi133 ceph-mon[125939]: pgmap v9866: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 285 KiB/s wr, 9 op/s 2023-05-08T08:50:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:53 smithi096 ceph-mon[124666]: pgmap v9866: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 285 KiB/s wr, 9 op/s 2023-05-08T08:50:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:53 smithi186 ceph-mon[126480]: pgmap v9866: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 285 KiB/s wr, 9 op/s 2023-05-08T08:50:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18392.984031 secs 2023-05-08T08:50:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18392.984031 secs 2023-05-08T08:50:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18392.984031 secs 2023-05-08T08:50:55.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:55 smithi133 ceph-mon[125939]: pgmap v9867: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 444 KiB/s rd, 364 KiB/s wr, 15 op/s 2023-05-08T08:50:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:55 smithi096 ceph-mon[124666]: pgmap v9867: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 444 KiB/s rd, 364 KiB/s wr, 15 op/s 2023-05-08T08:50:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:55 smithi186 ceph-mon[126480]: pgmap v9867: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 444 KiB/s rd, 364 KiB/s wr, 15 op/s 2023-05-08T08:50:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:58 smithi186 ceph-mon[126480]: pgmap v9868: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 352 KiB/s wr, 11 op/s 2023-05-08T08:50:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:58 smithi133 ceph-mon[125939]: pgmap v9868: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 352 KiB/s wr, 11 op/s 2023-05-08T08:50:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:58 smithi096 ceph-mon[124666]: pgmap v9868: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 352 KiB/s wr, 11 op/s 2023-05-08T08:50:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18397.984169 secs 2023-05-08T08:50:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:50:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18398.540717 secs 2023-05-08T08:50:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18397.984169 secs 2023-05-08T08:50:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:50:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18398.540717 secs 2023-05-08T08:51:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18397.984169 secs 2023-05-08T08:51:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:50:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18398.540717 secs 2023-05-08T08:51:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:00 smithi186 ceph-mon[126480]: pgmap v9869: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 590 KiB/s rd, 577 KiB/s wr, 16 op/s 2023-05-08T08:51:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:00 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:51:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:51:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:51:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18399.825577 secs 2023-05-08T08:51:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:00 smithi133 ceph-mon[125939]: pgmap v9869: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 590 KiB/s rd, 577 KiB/s wr, 16 op/s 2023-05-08T08:51:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:00 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:51:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:51:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:51:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18399.825577 secs 2023-05-08T08:51:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:00 smithi096 ceph-mon[124666]: pgmap v9869: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 590 KiB/s rd, 577 KiB/s wr, 16 op/s 2023-05-08T08:51:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:00 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:51:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:51:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:51:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18399.825577 secs 2023-05-08T08:51:01.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:01 smithi186 ceph-mon[126480]: pgmap v9870: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 304 KiB/s wr, 10 op/s 2023-05-08T08:51:01.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:01 smithi133 ceph-mon[125939]: pgmap v9870: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 304 KiB/s wr, 10 op/s 2023-05-08T08:51:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:01 smithi096 ceph-mon[124666]: pgmap v9870: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 304 KiB/s wr, 10 op/s 2023-05-08T08:51:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18402.984291 secs 2023-05-08T08:51:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:04 smithi186 ceph-mon[126480]: pgmap v9871: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 304 KiB/s wr, 10 op/s 2023-05-08T08:51:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:04 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:51:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:04 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:51:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18403.540782 secs 2023-05-08T08:51:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18402.984291 secs 2023-05-08T08:51:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:04 smithi133 ceph-mon[125939]: pgmap v9871: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 304 KiB/s wr, 10 op/s 2023-05-08T08:51:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:04 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:51:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:04 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:51:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18403.540782 secs 2023-05-08T08:51:05.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18402.984291 secs 2023-05-08T08:51:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:04 smithi096 ceph-mon[124666]: pgmap v9871: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 304 KiB/s wr, 10 op/s 2023-05-08T08:51:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:04 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:51:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:04 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:51:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18403.540782 secs 2023-05-08T08:51:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18404.825712 secs 2023-05-08T08:51:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18404.825712 secs 2023-05-08T08:51:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18404.825712 secs 2023-05-08T08:51:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:06 smithi186 ceph-mon[126480]: pgmap v9872: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 350 KiB/s wr, 28 op/s 2023-05-08T08:51:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:06 smithi133 ceph-mon[125939]: pgmap v9872: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 350 KiB/s wr, 28 op/s 2023-05-08T08:51:07.118 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:06 smithi096 ceph-mon[124666]: pgmap v9872: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 350 KiB/s wr, 28 op/s 2023-05-08T08:51:07.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:07 smithi186 ceph-mon[126480]: pgmap v9873: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 270 KiB/s wr, 23 op/s 2023-05-08T08:51:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:07 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:51:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:07 smithi133 ceph-mon[125939]: pgmap v9873: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 270 KiB/s wr, 23 op/s 2023-05-08T08:51:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:07 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:51:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:07 smithi096 ceph-mon[124666]: pgmap v9873: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 270 KiB/s wr, 23 op/s 2023-05-08T08:51:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:07 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:51:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18407.984407 secs 2023-05-08T08:51:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18407.984407 secs 2023-05-08T08:51:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18407.984407 secs 2023-05-08T08:51:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18408.540896 secs 2023-05-08T08:51:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:09 smithi133 ceph-mon[125939]: pgmap v9874: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 340 KiB/s wr, 26 op/s 2023-05-08T08:51:10.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18408.540896 secs 2023-05-08T08:51:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:09 smithi096 ceph-mon[124666]: pgmap v9874: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 340 KiB/s wr, 26 op/s 2023-05-08T08:51:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18408.540896 secs 2023-05-08T08:51:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:09 smithi186 ceph-mon[126480]: pgmap v9874: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 340 KiB/s wr, 26 op/s 2023-05-08T08:51:11.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18409.825859 secs 2023-05-08T08:51:11.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18409.825859 secs 2023-05-08T08:51:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18409.825859 secs 2023-05-08T08:51:12.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:11 smithi133 ceph-mon[125939]: osdmap e694: 12 total, 12 up, 12 in 2023-05-08T08:51:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:11 smithi133 ceph-mon[125939]: pgmap v9876: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 139 KiB/s wr, 25 op/s 2023-05-08T08:51:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:11 smithi096 ceph-mon[124666]: osdmap e694: 12 total, 12 up, 12 in 2023-05-08T08:51:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:11 smithi096 ceph-mon[124666]: pgmap v9876: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 139 KiB/s wr, 25 op/s 2023-05-08T08:51:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:11 smithi186 ceph-mon[126480]: osdmap e694: 12 total, 12 up, 12 in 2023-05-08T08:51:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:11 smithi186 ceph-mon[126480]: pgmap v9876: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 139 KiB/s wr, 25 op/s 2023-05-08T08:51:13.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:12 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:51:13.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:12 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:51:13.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:12 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:51:13.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:12 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:51:13.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:12 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:51:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:12 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:51:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:12 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:51:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:12 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:51:13.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:12 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:51:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:12 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:51:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:12 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:51:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:12 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:51:14.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:13 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:51:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:13 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T08:51:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:13 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T08:51:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:13 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:51:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18412.984481 secs 2023-05-08T08:51:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:13 smithi133 ceph-mon[125939]: pgmap v9877: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 139 KiB/s wr, 25 op/s 2023-05-08T08:51:14.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:13 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:51:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:13 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T08:51:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:13 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T08:51:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:13 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:51:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18412.984481 secs 2023-05-08T08:51:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:13 smithi096 ceph-mon[124666]: pgmap v9877: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 139 KiB/s wr, 25 op/s 2023-05-08T08:51:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:13 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:51:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:13 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T08:51:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:13 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T08:51:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:13 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:51:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18412.984481 secs 2023-05-08T08:51:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:13 smithi186 ceph-mon[126480]: pgmap v9877: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 139 KiB/s wr, 25 op/s 2023-05-08T08:51:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18413.541020 secs 2023-05-08T08:51:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18413.541020 secs 2023-05-08T08:51:15.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18413.541020 secs 2023-05-08T08:51:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18414.825978 secs 2023-05-08T08:51:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:15 smithi133 ceph-mon[125939]: pgmap v9878: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 84 KiB/s wr, 6 op/s 2023-05-08T08:51:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18414.825978 secs 2023-05-08T08:51:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:15 smithi096 ceph-mon[124666]: pgmap v9878: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 84 KiB/s wr, 6 op/s 2023-05-08T08:51:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18414.825978 secs 2023-05-08T08:51:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:15 smithi186 ceph-mon[126480]: pgmap v9878: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 84 KiB/s wr, 6 op/s 2023-05-08T08:51:18.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:18 smithi186 ceph-mon[126480]: pgmap v9879: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 84 KiB/s wr, 6 op/s 2023-05-08T08:51:18.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:18 smithi133 ceph-mon[125939]: pgmap v9879: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 84 KiB/s wr, 6 op/s 2023-05-08T08:51:19.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:18 smithi096 ceph-mon[124666]: pgmap v9879: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 84 KiB/s wr, 6 op/s 2023-05-08T08:51:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18417.984595 secs 2023-05-08T08:51:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18418.541141 secs 2023-05-08T08:51:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:19 smithi186 ceph-mon[126480]: pgmap v9880: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 54 KiB/s wr, 6 op/s 2023-05-08T08:51:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18417.984595 secs 2023-05-08T08:51:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18418.541141 secs 2023-05-08T08:51:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:19 smithi133 ceph-mon[125939]: pgmap v9880: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 54 KiB/s wr, 6 op/s 2023-05-08T08:51:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18417.984595 secs 2023-05-08T08:51:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18418.541141 secs 2023-05-08T08:51:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:19 smithi096 ceph-mon[124666]: pgmap v9880: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 54 KiB/s wr, 6 op/s 2023-05-08T08:51:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18419.826055 secs 2023-05-08T08:51:20.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18419.826055 secs 2023-05-08T08:51:21.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18419.826055 secs 2023-05-08T08:51:21.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:21 smithi186 ceph-mon[126480]: pgmap v9881: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 50 KiB/s wr, 6 op/s 2023-05-08T08:51:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:21 smithi133 ceph-mon[125939]: pgmap v9881: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 50 KiB/s wr, 6 op/s 2023-05-08T08:51:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:21 smithi096 ceph-mon[124666]: pgmap v9881: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 50 KiB/s wr, 6 op/s 2023-05-08T08:51:23.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:23 smithi186 ceph-mon[126480]: osdmap e695: 12 total, 12 up, 12 in 2023-05-08T08:51:23.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:23 smithi133 ceph-mon[125939]: osdmap e695: 12 total, 12 up, 12 in 2023-05-08T08:51:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:23 smithi096 ceph-mon[124666]: osdmap e695: 12 total, 12 up, 12 in 2023-05-08T08:51:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18422.984722 secs 2023-05-08T08:51:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:24 smithi186 ceph-mon[126480]: pgmap v9883: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 54 KiB/s wr, 6 op/s 2023-05-08T08:51:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18423.541262 secs 2023-05-08T08:51:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18422.984722 secs 2023-05-08T08:51:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:24 smithi133 ceph-mon[125939]: pgmap v9883: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 54 KiB/s wr, 6 op/s 2023-05-08T08:51:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18423.541262 secs 2023-05-08T08:51:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18422.984722 secs 2023-05-08T08:51:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:24 smithi096 ceph-mon[124666]: pgmap v9883: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 54 KiB/s wr, 6 op/s 2023-05-08T08:51:25.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18423.541262 secs 2023-05-08T08:51:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18424.826180 secs 2023-05-08T08:51:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:25 smithi186 ceph-mon[126480]: pgmap v9884: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 54 KiB/s wr, 6 op/s 2023-05-08T08:51:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18424.826180 secs 2023-05-08T08:51:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:25 smithi133 ceph-mon[125939]: pgmap v9884: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 54 KiB/s wr, 6 op/s 2023-05-08T08:51:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18424.826180 secs 2023-05-08T08:51:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:25 smithi096 ceph-mon[124666]: pgmap v9884: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 54 KiB/s wr, 6 op/s 2023-05-08T08:51:28.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:28 smithi186 ceph-mon[126480]: pgmap v9885: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 54 KiB/s wr, 6 op/s 2023-05-08T08:51:28.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:28 smithi133 ceph-mon[125939]: pgmap v9885: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 54 KiB/s wr, 6 op/s 2023-05-08T08:51:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:28 smithi096 ceph-mon[124666]: pgmap v9885: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 54 KiB/s wr, 6 op/s 2023-05-08T08:51:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18427.984849 secs 2023-05-08T08:51:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18428.541382 secs 2023-05-08T08:51:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:29 smithi186 ceph-mon[126480]: pgmap v9886: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2023-05-08T08:51:29.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18427.984849 secs 2023-05-08T08:51:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18428.541382 secs 2023-05-08T08:51:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:29 smithi133 ceph-mon[125939]: pgmap v9886: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2023-05-08T08:51:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18427.984849 secs 2023-05-08T08:51:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18428.541382 secs 2023-05-08T08:51:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:29 smithi096 ceph-mon[124666]: pgmap v9886: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2023-05-08T08:51:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18429.826304 secs 2023-05-08T08:51:30.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18429.826304 secs 2023-05-08T08:51:31.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18429.826304 secs 2023-05-08T08:51:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:31 smithi186 ceph-mon[126480]: pgmap v9887: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2023-05-08T08:51:31.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:31 smithi133 ceph-mon[125939]: pgmap v9887: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2023-05-08T08:51:32.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:31 smithi096 ceph-mon[124666]: pgmap v9887: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2023-05-08T08:51:33.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:33 smithi133 ceph-mon[125939]: pgmap v9888: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.0 KiB/s wr, 7 op/s 2023-05-08T08:51:34.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:33 smithi096 ceph-mon[124666]: pgmap v9888: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.0 KiB/s wr, 7 op/s 2023-05-08T08:51:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:33 smithi186 ceph-mon[126480]: pgmap v9888: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.0 KiB/s wr, 7 op/s 2023-05-08T08:51:34.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18432.984912 secs 2023-05-08T08:51:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18433.541522 secs 2023-05-08T08:51:35.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18432.984912 secs 2023-05-08T08:51:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18433.541522 secs 2023-05-08T08:51:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18432.984912 secs 2023-05-08T08:51:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18433.541522 secs 2023-05-08T08:51:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18434.826429 secs 2023-05-08T08:51:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:35 smithi133 ceph-mon[125939]: pgmap v9889: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 58 KiB/s wr, 9 op/s 2023-05-08T08:51:36.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18434.826429 secs 2023-05-08T08:51:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:35 smithi096 ceph-mon[124666]: pgmap v9889: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 58 KiB/s wr, 9 op/s 2023-05-08T08:51:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18434.826429 secs 2023-05-08T08:51:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:35 smithi186 ceph-mon[126480]: pgmap v9889: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 58 KiB/s wr, 9 op/s 2023-05-08T08:51:37.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:37 smithi133 ceph-mon[125939]: pgmap v9890: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 58 KiB/s wr, 6 op/s 2023-05-08T08:51:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:37 smithi096 ceph-mon[124666]: pgmap v9890: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 58 KiB/s wr, 6 op/s 2023-05-08T08:51:38.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:37 smithi186 ceph-mon[126480]: pgmap v9890: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 58 KiB/s wr, 6 op/s 2023-05-08T08:51:39.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18437.985058 secs 2023-05-08T08:51:39.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18437.985058 secs 2023-05-08T08:51:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18437.985058 secs 2023-05-08T08:51:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18438.541594 secs 2023-05-08T08:51:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:39 smithi133 ceph-mon[125939]: pgmap v9891: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 110 KiB/s wr, 9 op/s 2023-05-08T08:51:40.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18438.541594 secs 2023-05-08T08:51:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:39 smithi096 ceph-mon[124666]: pgmap v9891: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 110 KiB/s wr, 9 op/s 2023-05-08T08:51:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18438.541594 secs 2023-05-08T08:51:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:39 smithi186 ceph-mon[126480]: pgmap v9891: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 110 KiB/s wr, 9 op/s 2023-05-08T08:51:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:41 smithi133 ceph-mon[125939]: pgmap v9892: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 109 KiB/s wr, 5 op/s 2023-05-08T08:51:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:41 smithi096 ceph-mon[124666]: pgmap v9892: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 109 KiB/s wr, 5 op/s 2023-05-08T08:51:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:41 smithi186 ceph-mon[126480]: pgmap v9892: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 109 KiB/s wr, 5 op/s 2023-05-08T08:51:43.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:51:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:43 smithi186 ceph-mon[126480]: pgmap v9893: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 109 KiB/s wr, 5 op/s 2023-05-08T08:51:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:51:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:43 smithi133 ceph-mon[125939]: pgmap v9893: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 109 KiB/s wr, 5 op/s 2023-05-08T08:51:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:51:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:43 smithi096 ceph-mon[124666]: pgmap v9893: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 109 KiB/s wr, 5 op/s 2023-05-08T08:51:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18442.985180 secs 2023-05-08T08:51:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:51:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:51:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:51:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18443.541712 secs 2023-05-08T08:51:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18442.985180 secs 2023-05-08T08:51:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:51:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:51:44.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:51:44.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18443.541712 secs 2023-05-08T08:51:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18442.985180 secs 2023-05-08T08:51:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:51:45.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:51:45.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:51:45.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18443.541712 secs 2023-05-08T08:51:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:45 smithi186 ceph-mon[126480]: pgmap v9894: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 170 KiB/s wr, 9 op/s 2023-05-08T08:51:45.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:45 smithi133 ceph-mon[125939]: pgmap v9894: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 170 KiB/s wr, 9 op/s 2023-05-08T08:51:46.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:45 smithi096 ceph-mon[124666]: pgmap v9894: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 170 KiB/s wr, 9 op/s 2023-05-08T08:51:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:47 smithi133 ceph-mon[125939]: pgmap v9895: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 112 KiB/s wr, 6 op/s 2023-05-08T08:51:48.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:47 smithi096 ceph-mon[124666]: pgmap v9895: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 112 KiB/s wr, 6 op/s 2023-05-08T08:51:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:47 smithi186 ceph-mon[126480]: pgmap v9895: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 112 KiB/s wr, 6 op/s 2023-05-08T08:51:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18447.985322 secs 2023-05-08T08:51:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18447.985322 secs 2023-05-08T08:51:49.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18447.985322 secs 2023-05-08T08:51:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:49 smithi133 ceph-mon[125939]: pgmap v9896: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 286 KiB/s wr, 10 op/s 2023-05-08T08:51:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:49 smithi096 ceph-mon[124666]: pgmap v9896: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 286 KiB/s wr, 10 op/s 2023-05-08T08:51:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:49 smithi186 ceph-mon[126480]: pgmap v9896: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 286 KiB/s wr, 10 op/s 2023-05-08T08:51:51.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:51:51.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:51:51.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:51:52.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:52 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:51:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:51:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:51:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:52 smithi186 ceph-mon[126480]: pgmap v9897: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 234 KiB/s wr, 7 op/s 2023-05-08T08:51:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:52 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:51:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:51:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:51:52.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:52 smithi133 ceph-mon[125939]: pgmap v9897: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 234 KiB/s wr, 7 op/s 2023-05-08T08:51:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:52 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:51:52.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:51:52.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:51:52.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:52 smithi096 ceph-mon[124666]: pgmap v9897: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 234 KiB/s wr, 7 op/s 2023-05-08T08:51:53.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:53 smithi186 ceph-mon[126480]: pgmap v9898: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 234 KiB/s wr, 7 op/s 2023-05-08T08:51:53.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:53 smithi133 ceph-mon[125939]: pgmap v9898: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 234 KiB/s wr, 7 op/s 2023-05-08T08:51:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:53 smithi096 ceph-mon[124666]: pgmap v9898: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 234 KiB/s wr, 7 op/s 2023-05-08T08:51:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18453.541969 secs 2023-05-08T08:51:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:54 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:51:54.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18453.541969 secs 2023-05-08T08:51:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:54 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:51:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18453.541969 secs 2023-05-08T08:51:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:54 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:51:55.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:55 smithi186 ceph-mon[126480]: Health check cleared: MDS_SLOW_REQUEST (was: 1 MDSs report slow requests) 2023-05-08T08:51:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:55 smithi186 ceph-mon[126480]: Cluster is now healthy 2023-05-08T08:51:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:55 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T08:51:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:55 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:51:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18454.826951 secs 2023-05-08T08:51:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:55 smithi186 ceph-mon[126480]: pgmap v9899: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 444 KiB/s wr, 13 op/s 2023-05-08T08:51:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:55 smithi133 ceph-mon[125939]: Health check cleared: MDS_SLOW_REQUEST (was: 1 MDSs report slow requests) 2023-05-08T08:51:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:55 smithi133 ceph-mon[125939]: Cluster is now healthy 2023-05-08T08:51:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:55 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T08:51:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:55 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:51:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18454.826951 secs 2023-05-08T08:51:55.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:55 smithi133 ceph-mon[125939]: pgmap v9899: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 444 KiB/s wr, 13 op/s 2023-05-08T08:51:56.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:55 smithi096 ceph-mon[124666]: Health check cleared: MDS_SLOW_REQUEST (was: 1 MDSs report slow requests) 2023-05-08T08:51:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:55 smithi096 ceph-mon[124666]: Cluster is now healthy 2023-05-08T08:51:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:55 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T08:51:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:55 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:51:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18454.826951 secs 2023-05-08T08:51:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:55 smithi096 ceph-mon[124666]: pgmap v9899: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 444 KiB/s wr, 13 op/s 2023-05-08T08:51:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:56 smithi186 ceph-mon[126480]: Health check failed: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:51:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:51:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:51:56.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:51:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:56 smithi133 ceph-mon[125939]: Health check failed: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:51:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:51:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:51:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:51:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:56 smithi096 ceph-mon[124666]: Health check failed: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:51:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:51:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:51:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:51:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:57 smithi133 ceph-mon[125939]: pgmap v9900: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 394 KiB/s rd, 383 KiB/s wr, 10 op/s 2023-05-08T08:51:58.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:57 smithi096 ceph-mon[124666]: pgmap v9900: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 394 KiB/s rd, 383 KiB/s wr, 10 op/s 2023-05-08T08:51:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:57 smithi186 ceph-mon[126480]: pgmap v9900: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 394 KiB/s rd, 383 KiB/s wr, 10 op/s 2023-05-08T08:51:59.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18457.985572 secs 2023-05-08T08:51:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18457.985572 secs 2023-05-08T08:51:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18457.985572 secs 2023-05-08T08:52:00.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:59 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:52:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:51:59 smithi133 ceph-mon[125939]: pgmap v9901: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 467 KiB/s wr, 15 op/s 2023-05-08T08:52:00.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:59 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:52:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:51:59 smithi096 ceph-mon[124666]: pgmap v9901: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 467 KiB/s wr, 15 op/s 2023-05-08T08:52:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:59 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:52:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:51:59 smithi186 ceph-mon[126480]: pgmap v9901: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 467 KiB/s wr, 15 op/s 2023-05-08T08:52:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:52:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:52:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18459.827045 secs 2023-05-08T08:52:01.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:52:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:52:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18459.827045 secs 2023-05-08T08:52:01.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:52:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:52:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18459.827045 secs 2023-05-08T08:52:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:01 smithi133 ceph-mon[125939]: pgmap v9902: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 293 KiB/s wr, 11 op/s 2023-05-08T08:52:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:01 smithi096 ceph-mon[124666]: pgmap v9902: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 293 KiB/s wr, 11 op/s 2023-05-08T08:52:02.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:01 smithi186 ceph-mon[126480]: pgmap v9902: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 293 KiB/s wr, 11 op/s 2023-05-08T08:52:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:02 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:52:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:02 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:52:03.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:02 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:52:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T08:52:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:03 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:52:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18462.985713 secs 2023-05-08T08:52:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:03 smithi133 ceph-mon[125939]: pgmap v9903: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 293 KiB/s wr, 11 op/s 2023-05-08T08:52:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T08:52:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:03 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:52:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18462.985713 secs 2023-05-08T08:52:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:03 smithi096 ceph-mon[124666]: pgmap v9903: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 293 KiB/s wr, 11 op/s 2023-05-08T08:52:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T08:52:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:03 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:52:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18462.985713 secs 2023-05-08T08:52:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:03 smithi186 ceph-mon[126480]: pgmap v9903: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 293 KiB/s wr, 11 op/s 2023-05-08T08:52:05.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18463.542204 secs 2023-05-08T08:52:05.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18463.542204 secs 2023-05-08T08:52:05.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18463.542204 secs 2023-05-08T08:52:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18464.827164 secs 2023-05-08T08:52:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:05 smithi133 ceph-mon[125939]: pgmap v9904: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 425 KiB/s rd, 447 KiB/s wr, 30 op/s 2023-05-08T08:52:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18464.827164 secs 2023-05-08T08:52:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:05 smithi096 ceph-mon[124666]: pgmap v9904: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 425 KiB/s rd, 447 KiB/s wr, 30 op/s 2023-05-08T08:52:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18464.827164 secs 2023-05-08T08:52:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:05 smithi186 ceph-mon[126480]: pgmap v9904: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 425 KiB/s rd, 447 KiB/s wr, 30 op/s 2023-05-08T08:52:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:06 smithi133 ceph-mon[125939]: osdmap e696: 12 total, 12 up, 12 in 2023-05-08T08:52:07.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:06 smithi096 ceph-mon[124666]: osdmap e696: 12 total, 12 up, 12 in 2023-05-08T08:52:07.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:06 smithi186 ceph-mon[126480]: osdmap e696: 12 total, 12 up, 12 in 2023-05-08T08:52:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:07 smithi133 ceph-mon[125939]: pgmap v9906: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 286 KiB/s wr, 29 op/s 2023-05-08T08:52:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:07 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:52:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:07 smithi096 ceph-mon[124666]: pgmap v9906: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 286 KiB/s wr, 29 op/s 2023-05-08T08:52:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:07 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:52:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:07 smithi186 ceph-mon[126480]: pgmap v9906: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 286 KiB/s wr, 29 op/s 2023-05-08T08:52:08.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:07 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:52:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:52:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:52:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18467.985837 secs 2023-05-08T08:52:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:52:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:52:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18467.985837 secs 2023-05-08T08:52:09.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:52:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:52:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18467.985837 secs 2023-05-08T08:52:10.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18468.542268 secs 2023-05-08T08:52:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:09 smithi133 ceph-mon[125939]: pgmap v9907: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 260 KiB/s wr, 27 op/s 2023-05-08T08:52:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18468.542268 secs 2023-05-08T08:52:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:09 smithi096 ceph-mon[124666]: pgmap v9907: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 260 KiB/s wr, 27 op/s 2023-05-08T08:52:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18468.542268 secs 2023-05-08T08:52:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:09 smithi186 ceph-mon[126480]: pgmap v9907: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 260 KiB/s wr, 27 op/s 2023-05-08T08:52:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18469.827302 secs 2023-05-08T08:52:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18469.827302 secs 2023-05-08T08:52:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18469.827302 secs 2023-05-08T08:52:12.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:11 smithi133 ceph-mon[125939]: pgmap v9908: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 260 KiB/s wr, 27 op/s 2023-05-08T08:52:12.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:11 smithi096 ceph-mon[124666]: pgmap v9908: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 260 KiB/s wr, 27 op/s 2023-05-08T08:52:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:11 smithi186 ceph-mon[126480]: pgmap v9908: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 260 KiB/s wr, 27 op/s 2023-05-08T08:52:13.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:12 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:52:13.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:12 smithi133 ceph-mon[125939]: osdmap e697: 12 total, 12 up, 12 in 2023-05-08T08:52:13.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:12 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:52:13.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:12 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:52:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:12 smithi096 ceph-mon[124666]: osdmap e697: 12 total, 12 up, 12 in 2023-05-08T08:52:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:12 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:52:13.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:12 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:52:13.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:12 smithi186 ceph-mon[126480]: osdmap e697: 12 total, 12 up, 12 in 2023-05-08T08:52:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:12 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:52:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18472.985900 secs 2023-05-08T08:52:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:52:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:52:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:52:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:52:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:52:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:52:14.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:14 smithi186 ceph-mon[126480]: pgmap v9910: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 94 KiB/s wr, 5 op/s 2023-05-08T08:52:14.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:52:14.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:52:14.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:52:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18472.985900 secs 2023-05-08T08:52:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:52:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:52:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:52:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:52:14.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:52:14.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:52:14.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:14 smithi133 ceph-mon[125939]: pgmap v9910: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 94 KiB/s wr, 5 op/s 2023-05-08T08:52:14.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:52:14.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:52:14.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:52:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18472.985900 secs 2023-05-08T08:52:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:52:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:52:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:52:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:52:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:52:14.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:52:14.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:14 smithi096 ceph-mon[124666]: pgmap v9910: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 94 KiB/s wr, 5 op/s 2023-05-08T08:52:14.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:52:14.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:52:14.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:52:15.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18473.542398 secs 2023-05-08T08:52:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:15 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:52:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:15 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T08:52:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:15 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T08:52:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:15 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:52:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18473.542398 secs 2023-05-08T08:52:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:15 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:52:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:15 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T08:52:15.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:15 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T08:52:15.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:15 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:52:15.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18473.542398 secs 2023-05-08T08:52:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:15 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:52:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:15 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T08:52:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:15 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T08:52:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:15 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:52:16.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18474.827419 secs 2023-05-08T08:52:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:16 smithi186 ceph-mon[126480]: pgmap v9911: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 134 KiB/s wr, 8 op/s 2023-05-08T08:52:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18474.827419 secs 2023-05-08T08:52:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:16 smithi133 ceph-mon[125939]: pgmap v9911: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 134 KiB/s wr, 8 op/s 2023-05-08T08:52:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18474.827419 secs 2023-05-08T08:52:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:16 smithi096 ceph-mon[124666]: pgmap v9911: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 134 KiB/s wr, 8 op/s 2023-05-08T08:52:17.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:17 smithi133 ceph-mon[125939]: pgmap v9912: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 130 KiB/s wr, 8 op/s 2023-05-08T08:52:18.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:17 smithi096 ceph-mon[124666]: pgmap v9912: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 130 KiB/s wr, 8 op/s 2023-05-08T08:52:18.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:17 smithi186 ceph-mon[126480]: pgmap v9912: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 130 KiB/s wr, 8 op/s 2023-05-08T08:52:19.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18477.986024 secs 2023-05-08T08:52:19.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18477.986024 secs 2023-05-08T08:52:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18477.986024 secs 2023-05-08T08:52:20.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18478.542549 secs 2023-05-08T08:52:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:19 smithi133 ceph-mon[125939]: pgmap v9913: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 54 KiB/s wr, 7 op/s 2023-05-08T08:52:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18478.542549 secs 2023-05-08T08:52:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:19 smithi096 ceph-mon[124666]: pgmap v9913: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 54 KiB/s wr, 7 op/s 2023-05-08T08:52:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18478.542549 secs 2023-05-08T08:52:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:19 smithi186 ceph-mon[126480]: pgmap v9913: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 54 KiB/s wr, 7 op/s 2023-05-08T08:52:21.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18479.827561 secs 2023-05-08T08:52:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18479.827561 secs 2023-05-08T08:52:21.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18479.827561 secs 2023-05-08T08:52:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:21 smithi133 ceph-mon[125939]: pgmap v9914: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 54 KiB/s wr, 7 op/s 2023-05-08T08:52:22.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:21 smithi096 ceph-mon[124666]: pgmap v9914: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 54 KiB/s wr, 7 op/s 2023-05-08T08:52:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:21 smithi186 ceph-mon[126480]: pgmap v9914: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 54 KiB/s wr, 7 op/s 2023-05-08T08:52:23.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:23 smithi133 ceph-mon[125939]: pgmap v9915: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 49 KiB/s wr, 6 op/s 2023-05-08T08:52:24.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:23 smithi096 ceph-mon[124666]: pgmap v9915: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 49 KiB/s wr, 6 op/s 2023-05-08T08:52:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:23 smithi186 ceph-mon[126480]: pgmap v9915: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 49 KiB/s wr, 6 op/s 2023-05-08T08:52:24.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18482.986089 secs 2023-05-08T08:52:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18483.542645 secs 2023-05-08T08:52:25.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18482.986089 secs 2023-05-08T08:52:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18483.542645 secs 2023-05-08T08:52:25.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18482.986089 secs 2023-05-08T08:52:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18483.542645 secs 2023-05-08T08:52:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18484.827678 secs 2023-05-08T08:52:26.005 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:25 smithi133 ceph-mon[125939]: pgmap v9916: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 45 KiB/s wr, 9 op/s 2023-05-08T08:52:26.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18484.827678 secs 2023-05-08T08:52:26.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:25 smithi096 ceph-mon[124666]: pgmap v9916: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 45 KiB/s wr, 9 op/s 2023-05-08T08:52:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18484.827678 secs 2023-05-08T08:52:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:25 smithi186 ceph-mon[126480]: pgmap v9916: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 45 KiB/s wr, 9 op/s 2023-05-08T08:52:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:27 smithi133 ceph-mon[125939]: pgmap v9917: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T08:52:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:27 smithi096 ceph-mon[124666]: pgmap v9917: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T08:52:28.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:27 smithi186 ceph-mon[126480]: pgmap v9917: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T08:52:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18487.986233 secs 2023-05-08T08:52:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18487.986233 secs 2023-05-08T08:52:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18487.986233 secs 2023-05-08T08:52:30.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18488.542720 secs 2023-05-08T08:52:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:29 smithi133 ceph-mon[125939]: pgmap v9918: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 9 op/s 2023-05-08T08:52:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18488.542720 secs 2023-05-08T08:52:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:29 smithi096 ceph-mon[124666]: pgmap v9918: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 9 op/s 2023-05-08T08:52:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18488.542720 secs 2023-05-08T08:52:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:29 smithi186 ceph-mon[126480]: pgmap v9918: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 9 op/s 2023-05-08T08:52:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18489.827791 secs 2023-05-08T08:52:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18489.827791 secs 2023-05-08T08:52:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18489.827791 secs 2023-05-08T08:52:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:31 smithi133 ceph-mon[125939]: pgmap v9919: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T08:52:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:31 smithi096 ceph-mon[124666]: pgmap v9919: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T08:52:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:31 smithi186 ceph-mon[126480]: pgmap v9919: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T08:52:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:33 smithi133 ceph-mon[125939]: pgmap v9920: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T08:52:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:33 smithi096 ceph-mon[124666]: pgmap v9920: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T08:52:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:33 smithi186 ceph-mon[126480]: pgmap v9920: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T08:52:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18492.986313 secs 2023-05-08T08:52:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18493.542812 secs 2023-05-08T08:52:35.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18492.986313 secs 2023-05-08T08:52:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18493.542812 secs 2023-05-08T08:52:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18492.986313 secs 2023-05-08T08:52:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18493.542812 secs 2023-05-08T08:52:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18494.827918 secs 2023-05-08T08:52:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:35 smithi133 ceph-mon[125939]: pgmap v9921: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 169 KiB/s wr, 10 op/s 2023-05-08T08:52:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18494.827918 secs 2023-05-08T08:52:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:35 smithi096 ceph-mon[124666]: pgmap v9921: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 169 KiB/s wr, 10 op/s 2023-05-08T08:52:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18494.827918 secs 2023-05-08T08:52:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:35 smithi186 ceph-mon[126480]: pgmap v9921: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 169 KiB/s wr, 10 op/s 2023-05-08T08:52:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:37 smithi133 ceph-mon[125939]: pgmap v9922: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 169 KiB/s wr, 7 op/s 2023-05-08T08:52:38.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:37 smithi096 ceph-mon[124666]: pgmap v9922: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 169 KiB/s wr, 7 op/s 2023-05-08T08:52:38.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:37 smithi186 ceph-mon[126480]: pgmap v9922: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 169 KiB/s wr, 7 op/s 2023-05-08T08:52:39.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18497.986425 secs 2023-05-08T08:52:39.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18497.986425 secs 2023-05-08T08:52:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18497.986425 secs 2023-05-08T08:52:40.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18498.542931 secs 2023-05-08T08:52:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:39 smithi133 ceph-mon[125939]: pgmap v9923: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 169 KiB/s wr, 10 op/s 2023-05-08T08:52:40.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18498.542931 secs 2023-05-08T08:52:40.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:39 smithi096 ceph-mon[124666]: pgmap v9923: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 169 KiB/s wr, 10 op/s 2023-05-08T08:52:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18498.542931 secs 2023-05-08T08:52:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:39 smithi186 ceph-mon[126480]: pgmap v9923: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 169 KiB/s wr, 10 op/s 2023-05-08T08:52:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:41 smithi133 ceph-mon[125939]: pgmap v9924: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 169 KiB/s wr, 7 op/s 2023-05-08T08:52:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:41 smithi096 ceph-mon[124666]: pgmap v9924: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 169 KiB/s wr, 7 op/s 2023-05-08T08:52:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:41 smithi186 ceph-mon[126480]: pgmap v9924: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 169 KiB/s wr, 7 op/s 2023-05-08T08:52:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:52:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:43 smithi133 ceph-mon[125939]: pgmap v9925: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 169 KiB/s wr, 7 op/s 2023-05-08T08:52:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:52:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:43 smithi096 ceph-mon[124666]: pgmap v9925: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 169 KiB/s wr, 7 op/s 2023-05-08T08:52:44.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:52:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:43 smithi186 ceph-mon[126480]: pgmap v9925: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 169 KiB/s wr, 7 op/s 2023-05-08T08:52:44.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18502.986550 secs 2023-05-08T08:52:44.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:52:44.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:52:44.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:52:44.994 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18503.543056 secs 2023-05-08T08:52:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18502.986550 secs 2023-05-08T08:52:45.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:52:45.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:52:45.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:52:45.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18503.543056 secs 2023-05-08T08:52:45.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18502.986550 secs 2023-05-08T08:52:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:52:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:52:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:52:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18503.543056 secs 2023-05-08T08:52:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:45 smithi133 ceph-mon[125939]: pgmap v9926: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 225 KiB/s wr, 10 op/s 2023-05-08T08:52:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:45 smithi096 ceph-mon[124666]: pgmap v9926: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 225 KiB/s wr, 10 op/s 2023-05-08T08:52:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:45 smithi186 ceph-mon[126480]: pgmap v9926: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 225 KiB/s wr, 10 op/s 2023-05-08T08:52:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:47 smithi133 ceph-mon[125939]: pgmap v9927: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 56 KiB/s wr, 6 op/s 2023-05-08T08:52:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:47 smithi096 ceph-mon[124666]: pgmap v9927: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 56 KiB/s wr, 6 op/s 2023-05-08T08:52:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:47 smithi186 ceph-mon[126480]: pgmap v9927: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 56 KiB/s wr, 6 op/s 2023-05-08T08:52:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18507.986634 secs 2023-05-08T08:52:49.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18507.986634 secs 2023-05-08T08:52:49.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18507.986634 secs 2023-05-08T08:52:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:49 smithi133 ceph-mon[125939]: pgmap v9928: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 348 KiB/s rd, 287 KiB/s wr, 10 op/s 2023-05-08T08:52:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:49 smithi096 ceph-mon[124666]: pgmap v9928: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 348 KiB/s rd, 287 KiB/s wr, 10 op/s 2023-05-08T08:52:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:49 smithi186 ceph-mon[126480]: pgmap v9928: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 348 KiB/s rd, 287 KiB/s wr, 10 op/s 2023-05-08T08:52:51.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:52:51.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:52:51.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:52:52.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:52 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:52:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:52:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:52:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:52 smithi186 ceph-mon[126480]: pgmap v9929: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 287 KiB/s wr, 7 op/s 2023-05-08T08:52:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:52 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:52:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:52:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:52:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:52 smithi133 ceph-mon[125939]: pgmap v9929: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 287 KiB/s wr, 7 op/s 2023-05-08T08:52:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:52 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:52:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:52:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:52:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:52 smithi096 ceph-mon[124666]: pgmap v9929: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 287 KiB/s wr, 7 op/s 2023-05-08T08:52:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:53 smithi133 ceph-mon[125939]: pgmap v9930: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 287 KiB/s wr, 7 op/s 2023-05-08T08:52:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:53 smithi096 ceph-mon[124666]: pgmap v9930: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 287 KiB/s wr, 7 op/s 2023-05-08T08:52:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:53 smithi186 ceph-mon[126480]: pgmap v9930: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 287 KiB/s wr, 7 op/s 2023-05-08T08:52:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18512.986732 secs 2023-05-08T08:52:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18513.543310 secs 2023-05-08T08:52:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18512.986732 secs 2023-05-08T08:52:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18513.543310 secs 2023-05-08T08:52:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18512.986732 secs 2023-05-08T08:52:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18513.543310 secs 2023-05-08T08:52:55.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18514.828454 secs 2023-05-08T08:52:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:55 smithi133 ceph-mon[125939]: pgmap v9931: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 439 KiB/s wr, 12 op/s 2023-05-08T08:52:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18514.828454 secs 2023-05-08T08:52:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:55 smithi096 ceph-mon[124666]: pgmap v9931: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 439 KiB/s wr, 12 op/s 2023-05-08T08:52:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18514.828454 secs 2023-05-08T08:52:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:55 smithi186 ceph-mon[126480]: pgmap v9931: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 439 KiB/s wr, 12 op/s 2023-05-08T08:52:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:52:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:52:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:52:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:52:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:52:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:52:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:52:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:52:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:52:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:57 smithi133 ceph-mon[125939]: pgmap v9932: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 396 KiB/s rd, 384 KiB/s wr, 10 op/s 2023-05-08T08:52:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:57 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:52:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:57 smithi096 ceph-mon[124666]: pgmap v9932: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 396 KiB/s rd, 384 KiB/s wr, 10 op/s 2023-05-08T08:52:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:57 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:52:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:57 smithi186 ceph-mon[126480]: pgmap v9932: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 396 KiB/s rd, 384 KiB/s wr, 10 op/s 2023-05-08T08:52:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:57 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:52:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18517.986846 secs 2023-05-08T08:52:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18517.986846 secs 2023-05-08T08:52:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18517.986846 secs 2023-05-08T08:53:00.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:59 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:53:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:52:59 smithi133 ceph-mon[125939]: pgmap v9933: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 468 KiB/s wr, 15 op/s 2023-05-08T08:53:00.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:59 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:53:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:52:59 smithi096 ceph-mon[124666]: pgmap v9933: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 468 KiB/s wr, 15 op/s 2023-05-08T08:53:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:59 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:53:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:52:59 smithi186 ceph-mon[126480]: pgmap v9933: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 468 KiB/s wr, 15 op/s 2023-05-08T08:53:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:53:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:53:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18519.828548 secs 2023-05-08T08:53:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:53:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:53:01.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18519.828548 secs 2023-05-08T08:53:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:53:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:53:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18519.828548 secs 2023-05-08T08:53:02.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:01 smithi133 ceph-mon[125939]: pgmap v9934: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 237 KiB/s wr, 10 op/s 2023-05-08T08:53:02.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:01 smithi096 ceph-mon[124666]: pgmap v9934: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 237 KiB/s wr, 10 op/s 2023-05-08T08:53:02.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:01 smithi186 ceph-mon[126480]: pgmap v9934: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 237 KiB/s wr, 10 op/s 2023-05-08T08:53:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:02 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:53:03.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:02 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:53:03.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:02 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:53:04.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18522.986956 secs 2023-05-08T08:53:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:03 smithi133 ceph-mon[125939]: pgmap v9935: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 237 KiB/s wr, 10 op/s 2023-05-08T08:53:04.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18522.986956 secs 2023-05-08T08:53:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:03 smithi096 ceph-mon[124666]: pgmap v9935: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 237 KiB/s wr, 10 op/s 2023-05-08T08:53:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18522.986956 secs 2023-05-08T08:53:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:03 smithi186 ceph-mon[126480]: pgmap v9935: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 237 KiB/s wr, 10 op/s 2023-05-08T08:53:05.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18523.543564 secs 2023-05-08T08:53:05.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18523.543564 secs 2023-05-08T08:53:05.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18523.543564 secs 2023-05-08T08:53:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18524.828676 secs 2023-05-08T08:53:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:05 smithi133 ceph-mon[125939]: pgmap v9936: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 494 KiB/s wr, 30 op/s 2023-05-08T08:53:06.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18524.828676 secs 2023-05-08T08:53:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:05 smithi096 ceph-mon[124666]: pgmap v9936: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 494 KiB/s wr, 30 op/s 2023-05-08T08:53:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18524.828676 secs 2023-05-08T08:53:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:05 smithi186 ceph-mon[126480]: pgmap v9936: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 494 KiB/s wr, 30 op/s 2023-05-08T08:53:07.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:06 smithi133 ceph-mon[125939]: osdmap e698: 12 total, 12 up, 12 in 2023-05-08T08:53:07.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:06 smithi096 ceph-mon[124666]: osdmap e698: 12 total, 12 up, 12 in 2023-05-08T08:53:07.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:06 smithi186 ceph-mon[126480]: osdmap e698: 12 total, 12 up, 12 in 2023-05-08T08:53:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:07 smithi133 ceph-mon[125939]: pgmap v9938: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 410 KiB/s wr, 29 op/s 2023-05-08T08:53:08.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:07 smithi096 ceph-mon[124666]: pgmap v9938: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 410 KiB/s wr, 29 op/s 2023-05-08T08:53:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:07 smithi186 ceph-mon[126480]: pgmap v9938: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 410 KiB/s wr, 29 op/s 2023-05-08T08:53:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:08 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:53:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:53:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:53:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18527.987092 secs 2023-05-08T08:53:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:08 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:53:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:53:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:53:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18527.987092 secs 2023-05-08T08:53:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:08 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:53:09.394 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:53:09.395 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:53:09.395 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18527.987092 secs 2023-05-08T08:53:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18528.543673 secs 2023-05-08T08:53:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:09 smithi133 ceph-mon[125939]: pgmap v9939: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 355 KiB/s rd, 385 KiB/s wr, 28 op/s 2023-05-08T08:53:10.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18528.543673 secs 2023-05-08T08:53:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:09 smithi096 ceph-mon[124666]: pgmap v9939: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 355 KiB/s rd, 385 KiB/s wr, 28 op/s 2023-05-08T08:53:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18528.543673 secs 2023-05-08T08:53:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:09 smithi186 ceph-mon[126480]: pgmap v9939: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 355 KiB/s rd, 385 KiB/s wr, 28 op/s 2023-05-08T08:53:11.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18529.828810 secs 2023-05-08T08:53:11.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18529.828810 secs 2023-05-08T08:53:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18529.828810 secs 2023-05-08T08:53:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:11 smithi133 ceph-mon[125939]: pgmap v9940: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 355 KiB/s rd, 385 KiB/s wr, 28 op/s 2023-05-08T08:53:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:11 smithi096 ceph-mon[124666]: pgmap v9940: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 355 KiB/s rd, 385 KiB/s wr, 28 op/s 2023-05-08T08:53:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:11 smithi186 ceph-mon[126480]: pgmap v9940: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 355 KiB/s rd, 385 KiB/s wr, 28 op/s 2023-05-08T08:53:13.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:13 smithi133 ceph-mon[125939]: osdmap e699: 12 total, 12 up, 12 in 2023-05-08T08:53:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:13 smithi133 ceph-mon[125939]: pgmap v9942: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 96 KiB/s wr, 6 op/s 2023-05-08T08:53:14.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:13 smithi096 ceph-mon[124666]: osdmap e699: 12 total, 12 up, 12 in 2023-05-08T08:53:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:13 smithi096 ceph-mon[124666]: pgmap v9942: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 96 KiB/s wr, 6 op/s 2023-05-08T08:53:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:13 smithi186 ceph-mon[126480]: osdmap e699: 12 total, 12 up, 12 in 2023-05-08T08:53:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:13 smithi186 ceph-mon[126480]: pgmap v9942: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 96 KiB/s wr, 6 op/s 2023-05-08T08:53:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18532.987236 secs 2023-05-08T08:53:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18533.543791 secs 2023-05-08T08:53:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:53:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18532.987236 secs 2023-05-08T08:53:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18533.543791 secs 2023-05-08T08:53:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:53:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18532.987236 secs 2023-05-08T08:53:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18533.543791 secs 2023-05-08T08:53:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:53:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:15 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:53:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:15 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:53:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:15 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:53:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:15 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:53:15.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:15 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T08:53:15.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:15 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T08:53:15.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:15 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:53:15.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18534.828925 secs 2023-05-08T08:53:15.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:15 smithi133 ceph-mon[125939]: pgmap v9943: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 136 KiB/s wr, 9 op/s 2023-05-08T08:53:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:15 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:53:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:15 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:53:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:15 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:53:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:15 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:53:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:15 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T08:53:16.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:15 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T08:53:16.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:15 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:53:16.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18534.828925 secs 2023-05-08T08:53:16.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:15 smithi096 ceph-mon[124666]: pgmap v9943: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 136 KiB/s wr, 9 op/s 2023-05-08T08:53:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:15 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:53:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:15 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:53:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:15 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:53:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:15 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:53:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:15 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T08:53:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:15 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T08:53:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:15 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:53:16.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18534.828925 secs 2023-05-08T08:53:16.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:15 smithi186 ceph-mon[126480]: pgmap v9943: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 136 KiB/s wr, 9 op/s 2023-05-08T08:53:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:17 smithi133 ceph-mon[125939]: pgmap v9944: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 131 KiB/s wr, 8 op/s 2023-05-08T08:53:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:17 smithi096 ceph-mon[124666]: pgmap v9944: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 131 KiB/s wr, 8 op/s 2023-05-08T08:53:18.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:17 smithi186 ceph-mon[126480]: pgmap v9944: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 131 KiB/s wr, 8 op/s 2023-05-08T08:53:19.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18537.987331 secs 2023-05-08T08:53:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18537.987331 secs 2023-05-08T08:53:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18537.987331 secs 2023-05-08T08:53:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18538.543904 secs 2023-05-08T08:53:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:19 smithi133 ceph-mon[125939]: pgmap v9945: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 55 KiB/s wr, 6 op/s 2023-05-08T08:53:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18538.543904 secs 2023-05-08T08:53:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:19 smithi096 ceph-mon[124666]: pgmap v9945: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 55 KiB/s wr, 6 op/s 2023-05-08T08:53:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18538.543904 secs 2023-05-08T08:53:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:19 smithi186 ceph-mon[126480]: pgmap v9945: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 55 KiB/s wr, 6 op/s 2023-05-08T08:53:21.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18539.829046 secs 2023-05-08T08:53:21.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18539.829046 secs 2023-05-08T08:53:21.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18539.829046 secs 2023-05-08T08:53:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:21 smithi133 ceph-mon[125939]: pgmap v9946: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 55 KiB/s wr, 6 op/s 2023-05-08T08:53:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:21 smithi096 ceph-mon[124666]: pgmap v9946: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 55 KiB/s wr, 6 op/s 2023-05-08T08:53:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:21 smithi186 ceph-mon[126480]: pgmap v9946: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 55 KiB/s wr, 6 op/s 2023-05-08T08:53:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:23 smithi133 ceph-mon[125939]: pgmap v9947: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 50 KiB/s wr, 6 op/s 2023-05-08T08:53:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:23 smithi096 ceph-mon[124666]: pgmap v9947: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 50 KiB/s wr, 6 op/s 2023-05-08T08:53:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:23 smithi186 ceph-mon[126480]: pgmap v9947: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 50 KiB/s wr, 6 op/s 2023-05-08T08:53:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18542.987441 secs 2023-05-08T08:53:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18543.544021 secs 2023-05-08T08:53:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18542.987441 secs 2023-05-08T08:53:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18543.544021 secs 2023-05-08T08:53:25.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18542.987441 secs 2023-05-08T08:53:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18543.544021 secs 2023-05-08T08:53:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18544.829112 secs 2023-05-08T08:53:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:25 smithi133 ceph-mon[125939]: pgmap v9948: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 45 KiB/s wr, 7 op/s 2023-05-08T08:53:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18544.829112 secs 2023-05-08T08:53:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:25 smithi096 ceph-mon[124666]: pgmap v9948: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 45 KiB/s wr, 7 op/s 2023-05-08T08:53:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18544.829112 secs 2023-05-08T08:53:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:25 smithi186 ceph-mon[126480]: pgmap v9948: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 45 KiB/s wr, 7 op/s 2023-05-08T08:53:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:27 smithi133 ceph-mon[125939]: pgmap v9949: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T08:53:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:27 smithi096 ceph-mon[124666]: pgmap v9949: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T08:53:28.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:27 smithi186 ceph-mon[126480]: pgmap v9949: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T08:53:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18547.987583 secs 2023-05-08T08:53:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18547.987583 secs 2023-05-08T08:53:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18547.987583 secs 2023-05-08T08:53:30.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18548.544169 secs 2023-05-08T08:53:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:29 smithi133 ceph-mon[125939]: pgmap v9950: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T08:53:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18548.544169 secs 2023-05-08T08:53:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:29 smithi096 ceph-mon[124666]: pgmap v9950: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T08:53:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18548.544169 secs 2023-05-08T08:53:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:29 smithi186 ceph-mon[126480]: pgmap v9950: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T08:53:31.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18549.829233 secs 2023-05-08T08:53:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18549.829233 secs 2023-05-08T08:53:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18549.829233 secs 2023-05-08T08:53:32.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:31 smithi133 ceph-mon[125939]: pgmap v9951: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T08:53:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:31 smithi096 ceph-mon[124666]: pgmap v9951: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T08:53:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:31 smithi186 ceph-mon[126480]: pgmap v9951: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T08:53:33.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:33 smithi133 ceph-mon[125939]: pgmap v9952: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T08:53:34.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:33 smithi096 ceph-mon[124666]: pgmap v9952: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T08:53:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:33 smithi186 ceph-mon[126480]: pgmap v9952: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T08:53:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18552.987663 secs 2023-05-08T08:53:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18553.544267 secs 2023-05-08T08:53:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18552.987663 secs 2023-05-08T08:53:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18553.544267 secs 2023-05-08T08:53:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18552.987663 secs 2023-05-08T08:53:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18553.544267 secs 2023-05-08T08:53:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18554.829353 secs 2023-05-08T08:53:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:35 smithi133 ceph-mon[125939]: pgmap v9953: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 59 KiB/s wr, 8 op/s 2023-05-08T08:53:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18554.829353 secs 2023-05-08T08:53:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:35 smithi096 ceph-mon[124666]: pgmap v9953: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 59 KiB/s wr, 8 op/s 2023-05-08T08:53:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18554.829353 secs 2023-05-08T08:53:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:35 smithi186 ceph-mon[126480]: pgmap v9953: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 59 KiB/s wr, 8 op/s 2023-05-08T08:53:37.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:37 smithi133 ceph-mon[125939]: pgmap v9954: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 59 KiB/s wr, 6 op/s 2023-05-08T08:53:38.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:37 smithi096 ceph-mon[124666]: pgmap v9954: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 59 KiB/s wr, 6 op/s 2023-05-08T08:53:38.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:37 smithi186 ceph-mon[126480]: pgmap v9954: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 59 KiB/s wr, 6 op/s 2023-05-08T08:53:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18557.987780 secs 2023-05-08T08:53:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18557.987780 secs 2023-05-08T08:53:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18557.987780 secs 2023-05-08T08:53:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18558.544379 secs 2023-05-08T08:53:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:39 smithi133 ceph-mon[125939]: pgmap v9955: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 62 KiB/s wr, 9 op/s 2023-05-08T08:53:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18558.544379 secs 2023-05-08T08:53:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:39 smithi096 ceph-mon[124666]: pgmap v9955: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 62 KiB/s wr, 9 op/s 2023-05-08T08:53:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18558.544379 secs 2023-05-08T08:53:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:39 smithi186 ceph-mon[126480]: pgmap v9955: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 62 KiB/s wr, 9 op/s 2023-05-08T08:53:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:41 smithi133 ceph-mon[125939]: pgmap v9956: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T08:53:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:41 smithi096 ceph-mon[124666]: pgmap v9956: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T08:53:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:41 smithi186 ceph-mon[126480]: pgmap v9956: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T08:53:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:53:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:43 smithi133 ceph-mon[125939]: pgmap v9957: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T08:53:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:53:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:43 smithi096 ceph-mon[124666]: pgmap v9957: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T08:53:44.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:53:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:43 smithi186 ceph-mon[126480]: pgmap v9957: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T08:53:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18562.987873 secs 2023-05-08T08:53:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:53:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:53:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:53:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18563.544518 secs 2023-05-08T08:53:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18562.987873 secs 2023-05-08T08:53:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:53:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:53:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:53:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18563.544518 secs 2023-05-08T08:53:45.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18562.987873 secs 2023-05-08T08:53:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:53:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:53:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:53:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18563.544518 secs 2023-05-08T08:53:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:46 smithi133 ceph-mon[125939]: pgmap v9958: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 173 KiB/s wr, 10 op/s 2023-05-08T08:53:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:46 smithi096 ceph-mon[124666]: pgmap v9958: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 173 KiB/s wr, 10 op/s 2023-05-08T08:53:47.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:46 smithi186 ceph-mon[126480]: pgmap v9958: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 173 KiB/s wr, 10 op/s 2023-05-08T08:53:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:48 smithi133 ceph-mon[125939]: pgmap v9959: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 114 KiB/s wr, 7 op/s 2023-05-08T08:53:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:48 smithi096 ceph-mon[124666]: pgmap v9959: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 114 KiB/s wr, 7 op/s 2023-05-08T08:53:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:48 smithi186 ceph-mon[126480]: pgmap v9959: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 114 KiB/s wr, 7 op/s 2023-05-08T08:53:49.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18567.987988 secs 2023-05-08T08:53:50.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18567.987988 secs 2023-05-08T08:53:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18567.987988 secs 2023-05-08T08:53:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:50 smithi133 ceph-mon[125939]: pgmap v9960: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 290 KiB/s wr, 11 op/s 2023-05-08T08:53:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:50 smithi096 ceph-mon[124666]: pgmap v9960: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 290 KiB/s wr, 11 op/s 2023-05-08T08:53:51.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:50 smithi186 ceph-mon[126480]: pgmap v9960: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 290 KiB/s wr, 11 op/s 2023-05-08T08:53:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:53:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:53:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:53:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:52 smithi133 ceph-mon[125939]: pgmap v9961: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 287 KiB/s wr, 8 op/s 2023-05-08T08:53:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:52 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:53:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:53:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:53:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:52 smithi096 ceph-mon[124666]: pgmap v9961: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 287 KiB/s wr, 8 op/s 2023-05-08T08:53:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:52 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:53:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:53:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:53:53.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:52 smithi186 ceph-mon[126480]: pgmap v9961: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 287 KiB/s wr, 8 op/s 2023-05-08T08:53:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:52 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:53:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:53:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:53:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18572.988092 secs 2023-05-08T08:53:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:54 smithi133 ceph-mon[125939]: pgmap v9962: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 287 KiB/s wr, 8 op/s 2023-05-08T08:53:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18572.988092 secs 2023-05-08T08:53:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:54 smithi096 ceph-mon[124666]: pgmap v9962: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 287 KiB/s wr, 8 op/s 2023-05-08T08:53:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18572.988092 secs 2023-05-08T08:53:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:54 smithi186 ceph-mon[126480]: pgmap v9962: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 287 KiB/s wr, 8 op/s 2023-05-08T08:53:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18574.829831 secs 2023-05-08T08:53:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18574.829831 secs 2023-05-08T08:53:56.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18574.829831 secs 2023-05-08T08:53:56.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:56 smithi133 ceph-mon[125939]: pgmap v9963: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 676 KiB/s rd, 494 KiB/s wr, 14 op/s 2023-05-08T08:53:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:53:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:53:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:56 smithi096 ceph-mon[124666]: pgmap v9963: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 676 KiB/s rd, 494 KiB/s wr, 14 op/s 2023-05-08T08:53:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:53:57.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:53:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:56 smithi186 ceph-mon[126480]: pgmap v9963: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 676 KiB/s rd, 494 KiB/s wr, 14 op/s 2023-05-08T08:53:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:53:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:53:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:57 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:53:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:57 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:53:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:57 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:53:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:58 smithi133 ceph-mon[125939]: pgmap v9964: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 383 KiB/s wr, 10 op/s 2023-05-08T08:53:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:58 smithi096 ceph-mon[124666]: pgmap v9964: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 383 KiB/s wr, 10 op/s 2023-05-08T08:53:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:58 smithi186 ceph-mon[126480]: pgmap v9964: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 383 KiB/s wr, 10 op/s 2023-05-08T08:53:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18577.988209 secs 2023-05-08T08:53:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:53:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18578.544732 secs 2023-05-08T08:54:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18577.988209 secs 2023-05-08T08:54:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:53:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18578.544732 secs 2023-05-08T08:54:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18577.988209 secs 2023-05-08T08:54:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:53:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18578.544732 secs 2023-05-08T08:54:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:00 smithi133 ceph-mon[125939]: pgmap v9965: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 635 KiB/s rd, 459 KiB/s wr, 14 op/s 2023-05-08T08:54:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:54:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:54:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18579.829950 secs 2023-05-08T08:54:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:00 smithi096 ceph-mon[124666]: pgmap v9965: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 635 KiB/s rd, 459 KiB/s wr, 14 op/s 2023-05-08T08:54:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:54:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:54:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18579.829950 secs 2023-05-08T08:54:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:00 smithi186 ceph-mon[126480]: pgmap v9965: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 635 KiB/s rd, 459 KiB/s wr, 14 op/s 2023-05-08T08:54:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:54:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:54:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18579.829950 secs 2023-05-08T08:54:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:02 smithi133 ceph-mon[125939]: pgmap v9966: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 284 KiB/s wr, 10 op/s 2023-05-08T08:54:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:02 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:54:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:02 smithi096 ceph-mon[124666]: pgmap v9966: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 284 KiB/s wr, 10 op/s 2023-05-08T08:54:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:02 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:54:03.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:02 smithi186 ceph-mon[126480]: pgmap v9966: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 284 KiB/s wr, 10 op/s 2023-05-08T08:54:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:02 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:54:04.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18582.988328 secs 2023-05-08T08:54:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:04 smithi133 ceph-mon[125939]: pgmap v9967: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 283 KiB/s wr, 10 op/s 2023-05-08T08:54:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18583.544851 secs 2023-05-08T08:54:05.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18582.988328 secs 2023-05-08T08:54:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:04 smithi096 ceph-mon[124666]: pgmap v9967: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 283 KiB/s wr, 10 op/s 2023-05-08T08:54:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18583.544851 secs 2023-05-08T08:54:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18582.988328 secs 2023-05-08T08:54:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:04 smithi186 ceph-mon[126480]: pgmap v9967: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 283 KiB/s wr, 10 op/s 2023-05-08T08:54:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18583.544851 secs 2023-05-08T08:54:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:06 smithi133 ceph-mon[125939]: pgmap v9968: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 486 KiB/s rd, 463 KiB/s wr, 27 op/s 2023-05-08T08:54:07.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:06 smithi096 ceph-mon[124666]: pgmap v9968: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 486 KiB/s rd, 463 KiB/s wr, 27 op/s 2023-05-08T08:54:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:06 smithi186 ceph-mon[126480]: pgmap v9968: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 486 KiB/s rd, 463 KiB/s wr, 27 op/s 2023-05-08T08:54:07.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:07 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:54:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:07 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:54:08.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:07 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:54:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:08 smithi133 ceph-mon[125939]: pgmap v9969: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 256 KiB/s wr, 21 op/s 2023-05-08T08:54:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:08 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:54:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:54:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:54:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:08 smithi096 ceph-mon[124666]: pgmap v9969: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 256 KiB/s wr, 21 op/s 2023-05-08T08:54:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:08 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:54:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:54:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:54:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:08 smithi186 ceph-mon[126480]: pgmap v9969: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 256 KiB/s wr, 21 op/s 2023-05-08T08:54:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:08 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:54:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:54:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:54:09.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18587.988438 secs 2023-05-08T08:54:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18587.988438 secs 2023-05-08T08:54:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18587.988438 secs 2023-05-08T08:54:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:10 smithi133 ceph-mon[125939]: pgmap v9970: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 431 KiB/s rd, 442 KiB/s wr, 26 op/s 2023-05-08T08:54:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:10 smithi096 ceph-mon[124666]: pgmap v9970: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 431 KiB/s rd, 442 KiB/s wr, 26 op/s 2023-05-08T08:54:11.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:10 smithi186 ceph-mon[126480]: pgmap v9970: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 431 KiB/s rd, 442 KiB/s wr, 26 op/s 2023-05-08T08:54:11.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:11 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:54:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:11 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:54:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:11 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:54:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:12 smithi133 ceph-mon[125939]: pgmap v9971: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 353 KiB/s rd, 366 KiB/s wr, 22 op/s 2023-05-08T08:54:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:12 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:54:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:12 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:54:13.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:12 smithi096 ceph-mon[124666]: pgmap v9971: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 353 KiB/s rd, 366 KiB/s wr, 22 op/s 2023-05-08T08:54:13.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:12 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:54:13.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:12 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:54:13.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:12 smithi186 ceph-mon[126480]: pgmap v9971: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 353 KiB/s rd, 366 KiB/s wr, 22 op/s 2023-05-08T08:54:13.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:12 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:54:13.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:12 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:54:14.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18592.988555 secs 2023-05-08T08:54:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:14 smithi133 ceph-mon[125939]: pgmap v9972: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 353 KiB/s rd, 366 KiB/s wr, 22 op/s 2023-05-08T08:54:15.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18592.988555 secs 2023-05-08T08:54:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:14 smithi096 ceph-mon[124666]: pgmap v9972: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 353 KiB/s rd, 366 KiB/s wr, 22 op/s 2023-05-08T08:54:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18592.988555 secs 2023-05-08T08:54:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:14 smithi186 ceph-mon[126480]: pgmap v9972: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 353 KiB/s rd, 366 KiB/s wr, 22 op/s 2023-05-08T08:54:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:16 smithi133 ceph-mon[125939]: pgmap v9973: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 413 KiB/s wr, 25 op/s 2023-05-08T08:54:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:16 smithi096 ceph-mon[124666]: pgmap v9973: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 413 KiB/s wr, 25 op/s 2023-05-08T08:54:17.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:16 smithi186 ceph-mon[126480]: pgmap v9973: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 413 KiB/s wr, 25 op/s 2023-05-08T08:54:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:17 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:54:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:17 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:54:18.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:17 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:54:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:18 smithi133 ceph-mon[125939]: pgmap v9974: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 233 KiB/s wr, 8 op/s 2023-05-08T08:54:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:18 smithi096 ceph-mon[124666]: pgmap v9974: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 233 KiB/s wr, 8 op/s 2023-05-08T08:54:19.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:18 smithi186 ceph-mon[126480]: pgmap v9974: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 233 KiB/s wr, 8 op/s 2023-05-08T08:54:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18597.988652 secs 2023-05-08T08:54:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18597.988652 secs 2023-05-08T08:54:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18597.988652 secs 2023-05-08T08:54:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:20 smithi133 ceph-mon[125939]: pgmap v9975: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 234 KiB/s wr, 11 op/s 2023-05-08T08:54:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:20 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:54:21.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:20 smithi096 ceph-mon[124666]: pgmap v9975: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 234 KiB/s wr, 11 op/s 2023-05-08T08:54:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:20 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:54:21.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:20 smithi186 ceph-mon[126480]: pgmap v9975: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 234 KiB/s wr, 11 op/s 2023-05-08T08:54:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:20 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:54:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:54:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:54:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:21 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:54:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:54:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:21 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T08:54:21.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:21 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T08:54:21.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:21 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:54:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:54:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:54:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:21 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:54:22.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:54:22.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:21 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T08:54:22.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:21 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T08:54:22.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:21 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:54:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:54:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:54:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:21 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:54:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:54:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:21 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T08:54:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:21 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T08:54:22.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:21 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:54:23.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:22 smithi186 ceph-mon[126480]: pgmap v9976: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 47 KiB/s wr, 6 op/s 2023-05-08T08:54:23.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:22 smithi133 ceph-mon[125939]: pgmap v9976: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 47 KiB/s wr, 6 op/s 2023-05-08T08:54:23.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:22 smithi096 ceph-mon[124666]: pgmap v9976: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 47 KiB/s wr, 6 op/s 2023-05-08T08:54:25.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18602.988717 secs 2023-05-08T08:54:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:24 smithi186 ceph-mon[126480]: pgmap v9977: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 47 KiB/s wr, 6 op/s 2023-05-08T08:54:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18603.545369 secs 2023-05-08T08:54:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18602.988717 secs 2023-05-08T08:54:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:24 smithi133 ceph-mon[125939]: pgmap v9977: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 47 KiB/s wr, 6 op/s 2023-05-08T08:54:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18603.545369 secs 2023-05-08T08:54:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18602.988717 secs 2023-05-08T08:54:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:24 smithi096 ceph-mon[124666]: pgmap v9977: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 47 KiB/s wr, 6 op/s 2023-05-08T08:54:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18603.545369 secs 2023-05-08T08:54:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18604.830546 secs 2023-05-08T08:54:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18604.830546 secs 2023-05-08T08:54:26.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18604.830546 secs 2023-05-08T08:54:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:26 smithi186 ceph-mon[126480]: pgmap v9978: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 361 KiB/s wr, 14 op/s 2023-05-08T08:54:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:26 smithi186 ceph-mon[126480]: osdmap e700: 12 total, 12 up, 12 in 2023-05-08T08:54:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:26 smithi133 ceph-mon[125939]: pgmap v9978: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 361 KiB/s wr, 14 op/s 2023-05-08T08:54:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:26 smithi133 ceph-mon[125939]: osdmap e700: 12 total, 12 up, 12 in 2023-05-08T08:54:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:26 smithi096 ceph-mon[124666]: pgmap v9978: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 361 KiB/s wr, 14 op/s 2023-05-08T08:54:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:26 smithi096 ceph-mon[124666]: osdmap e700: 12 total, 12 up, 12 in 2023-05-08T08:54:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:28 smithi133 ceph-mon[125939]: pgmap v9980: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 377 KiB/s wr, 12 op/s 2023-05-08T08:54:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:28 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:54:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:28 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:54:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:28 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:54:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:28 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:54:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:28 smithi096 ceph-mon[124666]: pgmap v9980: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 377 KiB/s wr, 12 op/s 2023-05-08T08:54:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:28 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:54:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:28 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:54:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:28 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:54:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:28 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:54:29.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:28 smithi186 ceph-mon[126480]: pgmap v9980: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 377 KiB/s wr, 12 op/s 2023-05-08T08:54:29.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:28 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:54:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:28 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:54:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:28 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:54:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:28 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:54:29.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18607.988831 secs 2023-05-08T08:54:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18608.545495 secs 2023-05-08T08:54:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18607.988831 secs 2023-05-08T08:54:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18608.545495 secs 2023-05-08T08:54:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18607.988831 secs 2023-05-08T08:54:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18608.545495 secs 2023-05-08T08:54:30.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:30 smithi133 ceph-mon[125939]: pgmap v9981: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 529 KiB/s wr, 14 op/s 2023-05-08T08:54:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18609.830664 secs 2023-05-08T08:54:31.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:30 smithi096 ceph-mon[124666]: pgmap v9981: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 529 KiB/s wr, 14 op/s 2023-05-08T08:54:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18609.830664 secs 2023-05-08T08:54:31.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:30 smithi186 ceph-mon[126480]: pgmap v9981: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 529 KiB/s wr, 14 op/s 2023-05-08T08:54:31.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18609.830664 secs 2023-05-08T08:54:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:32 smithi133 ceph-mon[125939]: pgmap v9982: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 529 KiB/s wr, 14 op/s 2023-05-08T08:54:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:32 smithi133 ceph-mon[125939]: osdmap e701: 12 total, 12 up, 12 in 2023-05-08T08:54:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:32 smithi096 ceph-mon[124666]: pgmap v9982: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 529 KiB/s wr, 14 op/s 2023-05-08T08:54:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:32 smithi096 ceph-mon[124666]: osdmap e701: 12 total, 12 up, 12 in 2023-05-08T08:54:33.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:32 smithi186 ceph-mon[126480]: pgmap v9982: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 529 KiB/s wr, 14 op/s 2023-05-08T08:54:33.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:32 smithi186 ceph-mon[126480]: osdmap e701: 12 total, 12 up, 12 in 2023-05-08T08:54:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18612.988950 secs 2023-05-08T08:54:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:34 smithi133 ceph-mon[125939]: pgmap v9984: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 191 KiB/s wr, 6 op/s 2023-05-08T08:54:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18613.545558 secs 2023-05-08T08:54:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18612.988950 secs 2023-05-08T08:54:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:34 smithi096 ceph-mon[124666]: pgmap v9984: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 191 KiB/s wr, 6 op/s 2023-05-08T08:54:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18613.545558 secs 2023-05-08T08:54:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18612.988950 secs 2023-05-08T08:54:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:34 smithi186 ceph-mon[126480]: pgmap v9984: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 191 KiB/s wr, 6 op/s 2023-05-08T08:54:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18613.545558 secs 2023-05-08T08:54:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18614.830800 secs 2023-05-08T08:54:36.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18614.830800 secs 2023-05-08T08:54:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18614.830800 secs 2023-05-08T08:54:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:36 smithi133 ceph-mon[125939]: pgmap v9985: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 157 KiB/s wr, 9 op/s 2023-05-08T08:54:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:36 smithi096 ceph-mon[124666]: pgmap v9985: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 157 KiB/s wr, 9 op/s 2023-05-08T08:54:37.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:36 smithi186 ceph-mon[126480]: pgmap v9985: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 157 KiB/s wr, 9 op/s 2023-05-08T08:54:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:38 smithi133 ceph-mon[125939]: pgmap v9986: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 154 KiB/s wr, 8 op/s 2023-05-08T08:54:39.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:38 smithi096 ceph-mon[124666]: pgmap v9986: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 154 KiB/s wr, 8 op/s 2023-05-08T08:54:39.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:38 smithi186 ceph-mon[126480]: pgmap v9986: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 154 KiB/s wr, 8 op/s 2023-05-08T08:54:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18617.989066 secs 2023-05-08T08:54:39.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18618.545703 secs 2023-05-08T08:54:40.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18617.989066 secs 2023-05-08T08:54:40.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18618.545703 secs 2023-05-08T08:54:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18617.989066 secs 2023-05-08T08:54:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18618.545703 secs 2023-05-08T08:54:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:40 smithi133 ceph-mon[125939]: pgmap v9987: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 217 KiB/s wr, 8 op/s 2023-05-08T08:54:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:40 smithi096 ceph-mon[124666]: pgmap v9987: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 217 KiB/s wr, 8 op/s 2023-05-08T08:54:41.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:40 smithi186 ceph-mon[126480]: pgmap v9987: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 217 KiB/s wr, 8 op/s 2023-05-08T08:54:42.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:42 smithi133 ceph-mon[125939]: pgmap v9988: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 217 KiB/s wr, 8 op/s 2023-05-08T08:54:43.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:42 smithi096 ceph-mon[124666]: pgmap v9988: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 217 KiB/s wr, 8 op/s 2023-05-08T08:54:43.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:42 smithi186 ceph-mon[126480]: pgmap v9988: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 217 KiB/s wr, 8 op/s 2023-05-08T08:54:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:54:44.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:54:44.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:54:44.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18622.989207 secs 2023-05-08T08:54:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:44 smithi133 ceph-mon[125939]: pgmap v9989: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 198 KiB/s wr, 7 op/s 2023-05-08T08:54:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:54:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:54:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:54:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18622.989207 secs 2023-05-08T08:54:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:44 smithi096 ceph-mon[124666]: pgmap v9989: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 198 KiB/s wr, 7 op/s 2023-05-08T08:54:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:54:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:54:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:54:45.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18622.989207 secs 2023-05-08T08:54:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:44 smithi186 ceph-mon[126480]: pgmap v9989: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 198 KiB/s wr, 7 op/s 2023-05-08T08:54:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:54:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:54:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:54:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:46 smithi133 ceph-mon[125939]: pgmap v9990: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 194 KiB/s wr, 11 op/s 2023-05-08T08:54:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:46 smithi096 ceph-mon[124666]: pgmap v9990: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 194 KiB/s wr, 11 op/s 2023-05-08T08:54:47.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:46 smithi186 ceph-mon[126480]: pgmap v9990: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 194 KiB/s wr, 11 op/s 2023-05-08T08:54:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:54:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:54:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:54:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:48 smithi133 ceph-mon[125939]: pgmap v9991: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 194 KiB/s wr, 7 op/s 2023-05-08T08:54:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:54:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:54:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:48 smithi096 ceph-mon[124666]: pgmap v9991: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 194 KiB/s wr, 7 op/s 2023-05-08T08:54:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:54:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:54:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:48 smithi186 ceph-mon[126480]: pgmap v9991: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 194 KiB/s wr, 7 op/s 2023-05-08T08:54:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:54:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:54:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18627.989310 secs 2023-05-08T08:54:50.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18627.989310 secs 2023-05-08T08:54:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18627.989310 secs 2023-05-08T08:54:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:50 smithi133 ceph-mon[125939]: pgmap v9992: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 431 KiB/s rd, 417 KiB/s wr, 13 op/s 2023-05-08T08:54:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18629.831182 secs 2023-05-08T08:54:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:50 smithi096 ceph-mon[124666]: pgmap v9992: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 431 KiB/s rd, 417 KiB/s wr, 13 op/s 2023-05-08T08:54:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18629.831182 secs 2023-05-08T08:54:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:50 smithi186 ceph-mon[126480]: pgmap v9992: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 431 KiB/s rd, 417 KiB/s wr, 13 op/s 2023-05-08T08:54:51.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18629.831182 secs 2023-05-08T08:54:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:51 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:54:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:54:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:54:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:51 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:54:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:54:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:54:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:51 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:54:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:54:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:54:53.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:52 smithi186 ceph-mon[126480]: pgmap v9993: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 237 KiB/s wr, 9 op/s 2023-05-08T08:54:53.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:52 smithi133 ceph-mon[125939]: pgmap v9993: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 237 KiB/s wr, 9 op/s 2023-05-08T08:54:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:52 smithi096 ceph-mon[124666]: pgmap v9993: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 237 KiB/s wr, 9 op/s 2023-05-08T08:54:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18632.989444 secs 2023-05-08T08:54:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:54 smithi186 ceph-mon[126480]: pgmap v9994: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 237 KiB/s wr, 9 op/s 2023-05-08T08:54:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18633.546084 secs 2023-05-08T08:54:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18632.989444 secs 2023-05-08T08:54:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:54 smithi133 ceph-mon[125939]: pgmap v9994: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 237 KiB/s wr, 9 op/s 2023-05-08T08:54:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18633.546084 secs 2023-05-08T08:54:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18632.989444 secs 2023-05-08T08:54:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:54 smithi096 ceph-mon[124666]: pgmap v9994: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 237 KiB/s wr, 9 op/s 2023-05-08T08:54:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18633.546084 secs 2023-05-08T08:54:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18634.831300 secs 2023-05-08T08:54:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18634.831300 secs 2023-05-08T08:54:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18634.831300 secs 2023-05-08T08:54:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:56 smithi186 ceph-mon[126480]: pgmap v9995: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 420 KiB/s wr, 14 op/s 2023-05-08T08:54:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:54:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:54:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:56 smithi133 ceph-mon[125939]: pgmap v9995: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 420 KiB/s wr, 14 op/s 2023-05-08T08:54:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:54:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:54:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:56 smithi096 ceph-mon[124666]: pgmap v9995: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 420 KiB/s wr, 14 op/s 2023-05-08T08:54:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:54:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:54:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:57 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:54:58.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:57 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:54:58.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:57 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:54:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:58 smithi186 ceph-mon[126480]: pgmap v9996: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 407 KiB/s wr, 10 op/s 2023-05-08T08:54:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:58 smithi133 ceph-mon[125939]: pgmap v9996: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 407 KiB/s wr, 10 op/s 2023-05-08T08:54:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:58 smithi096 ceph-mon[124666]: pgmap v9996: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 407 KiB/s wr, 10 op/s 2023-05-08T08:55:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18637.989571 secs 2023-05-08T08:55:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:54:59 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:55:00.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18637.989571 secs 2023-05-08T08:55:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:54:59 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:55:00.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18637.989571 secs 2023-05-08T08:55:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:54:59 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:55:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:00 smithi186 ceph-mon[126480]: pgmap v9997: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 503 KiB/s rd, 599 KiB/s wr, 15 op/s 2023-05-08T08:55:01.189 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:55:01.189 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:55:01.189 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18639.831418 secs 2023-05-08T08:55:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:00 smithi133 ceph-mon[125939]: pgmap v9997: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 503 KiB/s rd, 599 KiB/s wr, 15 op/s 2023-05-08T08:55:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:55:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:55:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18639.831418 secs 2023-05-08T08:55:01.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:00 smithi096 ceph-mon[124666]: pgmap v9997: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 503 KiB/s rd, 599 KiB/s wr, 15 op/s 2023-05-08T08:55:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:55:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:55:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18639.831418 secs 2023-05-08T08:55:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:02 smithi186 ceph-mon[126480]: pgmap v9998: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 376 KiB/s wr, 10 op/s 2023-05-08T08:55:03.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:02 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:55:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:02 smithi133 ceph-mon[125939]: pgmap v9998: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 376 KiB/s wr, 10 op/s 2023-05-08T08:55:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:02 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:55:03.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:02 smithi096 ceph-mon[124666]: pgmap v9998: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 376 KiB/s wr, 10 op/s 2023-05-08T08:55:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:02 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:55:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18642.989682 secs 2023-05-08T08:55:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:04 smithi186 ceph-mon[126480]: pgmap v9999: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 376 KiB/s wr, 10 op/s 2023-05-08T08:55:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18643.546299 secs 2023-05-08T08:55:05.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18642.989682 secs 2023-05-08T08:55:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:04 smithi133 ceph-mon[125939]: pgmap v9999: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 376 KiB/s wr, 10 op/s 2023-05-08T08:55:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18643.546299 secs 2023-05-08T08:55:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18642.989682 secs 2023-05-08T08:55:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:04 smithi096 ceph-mon[124666]: pgmap v9999: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 376 KiB/s wr, 10 op/s 2023-05-08T08:55:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18643.546299 secs 2023-05-08T08:55:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18644.831556 secs 2023-05-08T08:55:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18644.831556 secs 2023-05-08T08:55:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18644.831556 secs 2023-05-08T08:55:07.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:06 smithi186 ceph-mon[126480]: pgmap v10000: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 480 KiB/s wr, 28 op/s 2023-05-08T08:55:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:06 smithi133 ceph-mon[125939]: pgmap v10000: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 480 KiB/s wr, 28 op/s 2023-05-08T08:55:07.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:06 smithi096 ceph-mon[124666]: pgmap v10000: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 480 KiB/s wr, 28 op/s 2023-05-08T08:55:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:08 smithi133 ceph-mon[125939]: pgmap v10001: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 297 KiB/s wr, 24 op/s 2023-05-08T08:55:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:08 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:55:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:55:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:55:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:08 smithi096 ceph-mon[124666]: pgmap v10001: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 297 KiB/s wr, 24 op/s 2023-05-08T08:55:09.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:08 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:55:09.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:55:09.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:55:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:08 smithi186 ceph-mon[126480]: pgmap v10001: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 297 KiB/s wr, 24 op/s 2023-05-08T08:55:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:08 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:55:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:55:09.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:55:09.672 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18647.989782 secs 2023-05-08T08:55:09.673 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18648.546415 secs 2023-05-08T08:55:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18647.989782 secs 2023-05-08T08:55:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18648.546415 secs 2023-05-08T08:55:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18647.989782 secs 2023-05-08T08:55:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18648.546415 secs 2023-05-08T08:55:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:10 smithi133 ceph-mon[125939]: pgmap v10002: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 336 KiB/s rd, 369 KiB/s wr, 27 op/s 2023-05-08T08:55:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18649.831672 secs 2023-05-08T08:55:11.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:10 smithi096 ceph-mon[124666]: pgmap v10002: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 336 KiB/s rd, 369 KiB/s wr, 27 op/s 2023-05-08T08:55:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18649.831672 secs 2023-05-08T08:55:11.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:10 smithi186 ceph-mon[126480]: pgmap v10002: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 336 KiB/s rd, 369 KiB/s wr, 27 op/s 2023-05-08T08:55:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18649.831672 secs 2023-05-08T08:55:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:11 smithi133 ceph-mon[125939]: osdmap e702: 12 total, 12 up, 12 in 2023-05-08T08:55:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:11 smithi096 ceph-mon[124666]: osdmap e702: 12 total, 12 up, 12 in 2023-05-08T08:55:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:11 smithi186 ceph-mon[126480]: osdmap e702: 12 total, 12 up, 12 in 2023-05-08T08:55:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:12 smithi133 ceph-mon[125939]: pgmap v10004: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 212 KiB/s wr, 26 op/s 2023-05-08T08:55:13.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:12 smithi096 ceph-mon[124666]: pgmap v10004: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 212 KiB/s wr, 26 op/s 2023-05-08T08:55:13.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:12 smithi186 ceph-mon[126480]: pgmap v10004: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 212 KiB/s wr, 26 op/s 2023-05-08T08:55:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18652.989862 secs 2023-05-08T08:55:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:14 smithi133 ceph-mon[125939]: pgmap v10005: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 212 KiB/s wr, 26 op/s 2023-05-08T08:55:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18653.546558 secs 2023-05-08T08:55:15.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18652.989862 secs 2023-05-08T08:55:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:14 smithi096 ceph-mon[124666]: pgmap v10005: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 212 KiB/s wr, 26 op/s 2023-05-08T08:55:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18653.546558 secs 2023-05-08T08:55:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18652.989862 secs 2023-05-08T08:55:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:14 smithi186 ceph-mon[126480]: pgmap v10005: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 212 KiB/s wr, 26 op/s 2023-05-08T08:55:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18653.546558 secs 2023-05-08T08:55:15.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18654.831809 secs 2023-05-08T08:55:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18654.831809 secs 2023-05-08T08:55:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18654.831809 secs 2023-05-08T08:55:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:16 smithi133 ceph-mon[125939]: pgmap v10006: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 179 KiB/s wr, 9 op/s 2023-05-08T08:55:17.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:16 smithi096 ceph-mon[124666]: pgmap v10006: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 179 KiB/s wr, 9 op/s 2023-05-08T08:55:17.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:16 smithi186 ceph-mon[126480]: pgmap v10006: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 179 KiB/s wr, 9 op/s 2023-05-08T08:55:18.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:18 smithi133 ceph-mon[125939]: pgmap v10007: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 179 KiB/s wr, 9 op/s 2023-05-08T08:55:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:18 smithi096 ceph-mon[124666]: pgmap v10007: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 179 KiB/s wr, 9 op/s 2023-05-08T08:55:19.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:18 smithi186 ceph-mon[126480]: pgmap v10007: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 179 KiB/s wr, 9 op/s 2023-05-08T08:55:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18657.989976 secs 2023-05-08T08:55:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18658.546696 secs 2023-05-08T08:55:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18657.989976 secs 2023-05-08T08:55:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18658.546696 secs 2023-05-08T08:55:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18657.989976 secs 2023-05-08T08:55:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18658.546696 secs 2023-05-08T08:55:20.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:20 smithi133 ceph-mon[125939]: pgmap v10008: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 138 KiB/s wr, 9 op/s 2023-05-08T08:55:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18659.831929 secs 2023-05-08T08:55:21.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:20 smithi096 ceph-mon[124666]: pgmap v10008: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 138 KiB/s wr, 9 op/s 2023-05-08T08:55:21.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18659.831929 secs 2023-05-08T08:55:21.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:20 smithi186 ceph-mon[126480]: pgmap v10008: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 138 KiB/s wr, 9 op/s 2023-05-08T08:55:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18659.831929 secs 2023-05-08T08:55:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:55:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:55:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:55:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:21 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:55:21.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:55:21.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:21 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T08:55:21.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:21 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T08:55:21.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:21 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:55:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:55:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:55:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:55:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:21 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:55:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:55:22.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:21 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T08:55:22.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:21 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T08:55:22.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:21 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:55:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:55:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:55:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:55:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:21 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:55:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:55:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:21 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T08:55:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:21 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T08:55:22.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:21 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:55:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:23 smithi186 ceph-mon[126480]: pgmap v10009: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 125 KiB/s wr, 8 op/s 2023-05-08T08:55:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:23 smithi186 ceph-mon[126480]: osdmap e703: 12 total, 12 up, 12 in 2023-05-08T08:55:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:23 smithi133 ceph-mon[125939]: pgmap v10009: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 125 KiB/s wr, 8 op/s 2023-05-08T08:55:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:23 smithi133 ceph-mon[125939]: osdmap e703: 12 total, 12 up, 12 in 2023-05-08T08:55:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:23 smithi096 ceph-mon[124666]: pgmap v10009: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 125 KiB/s wr, 8 op/s 2023-05-08T08:55:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:23 smithi096 ceph-mon[124666]: osdmap e703: 12 total, 12 up, 12 in 2023-05-08T08:55:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18662.990101 secs 2023-05-08T08:55:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18663.546813 secs 2023-05-08T08:55:24.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18662.990101 secs 2023-05-08T08:55:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18663.546813 secs 2023-05-08T08:55:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18662.990101 secs 2023-05-08T08:55:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18663.546813 secs 2023-05-08T08:55:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:25 smithi186 ceph-mon[126480]: pgmap v10011: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 138 KiB/s wr, 9 op/s 2023-05-08T08:55:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18664.832045 secs 2023-05-08T08:55:25.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:25 smithi133 ceph-mon[125939]: pgmap v10011: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 138 KiB/s wr, 9 op/s 2023-05-08T08:55:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18664.832045 secs 2023-05-08T08:55:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:25 smithi096 ceph-mon[124666]: pgmap v10011: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 138 KiB/s wr, 9 op/s 2023-05-08T08:55:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18664.832045 secs 2023-05-08T08:55:27.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:27 smithi133 ceph-mon[125939]: pgmap v10012: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 182 KiB/s wr, 8 op/s 2023-05-08T08:55:28.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:27 smithi096 ceph-mon[124666]: pgmap v10012: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 182 KiB/s wr, 8 op/s 2023-05-08T08:55:28.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:27 smithi186 ceph-mon[126480]: pgmap v10012: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 182 KiB/s wr, 8 op/s 2023-05-08T08:55:29.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:29 smithi133 ceph-mon[125939]: pgmap v10013: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 182 KiB/s wr, 8 op/s 2023-05-08T08:55:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18667.990224 secs 2023-05-08T08:55:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18668.546933 secs 2023-05-08T08:55:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:29 smithi096 ceph-mon[124666]: pgmap v10013: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 182 KiB/s wr, 8 op/s 2023-05-08T08:55:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18667.990224 secs 2023-05-08T08:55:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18668.546933 secs 2023-05-08T08:55:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:29 smithi186 ceph-mon[126480]: pgmap v10013: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 182 KiB/s wr, 8 op/s 2023-05-08T08:55:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18667.990224 secs 2023-05-08T08:55:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18668.546933 secs 2023-05-08T08:55:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18669.832166 secs 2023-05-08T08:55:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18669.832166 secs 2023-05-08T08:55:31.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18669.832166 secs 2023-05-08T08:55:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:31 smithi133 ceph-mon[125939]: pgmap v10014: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 138 KiB/s wr, 8 op/s 2023-05-08T08:55:32.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:31 smithi096 ceph-mon[124666]: pgmap v10014: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 138 KiB/s wr, 8 op/s 2023-05-08T08:55:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:31 smithi186 ceph-mon[126480]: pgmap v10014: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 138 KiB/s wr, 8 op/s 2023-05-08T08:55:33.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:33 smithi133 ceph-mon[125939]: pgmap v10015: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 138 KiB/s wr, 8 op/s 2023-05-08T08:55:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:33 smithi096 ceph-mon[124666]: pgmap v10015: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 138 KiB/s wr, 8 op/s 2023-05-08T08:55:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:33 smithi186 ceph-mon[126480]: pgmap v10015: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 138 KiB/s wr, 8 op/s 2023-05-08T08:55:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18672.990361 secs 2023-05-08T08:55:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18673.546999 secs 2023-05-08T08:55:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18672.990361 secs 2023-05-08T08:55:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18673.546999 secs 2023-05-08T08:55:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18672.990361 secs 2023-05-08T08:55:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18673.546999 secs 2023-05-08T08:55:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:35 smithi133 ceph-mon[125939]: pgmap v10016: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 125 KiB/s wr, 7 op/s 2023-05-08T08:55:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18674.832243 secs 2023-05-08T08:55:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:35 smithi096 ceph-mon[124666]: pgmap v10016: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 125 KiB/s wr, 7 op/s 2023-05-08T08:55:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18674.832243 secs 2023-05-08T08:55:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:35 smithi186 ceph-mon[126480]: pgmap v10016: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 125 KiB/s wr, 7 op/s 2023-05-08T08:55:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18674.832243 secs 2023-05-08T08:55:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:36 smithi133 ceph-mon[125939]: pgmap v10017: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 174 KiB/s wr, 10 op/s 2023-05-08T08:55:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:36 smithi096 ceph-mon[124666]: pgmap v10017: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 174 KiB/s wr, 10 op/s 2023-05-08T08:55:37.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:36 smithi186 ceph-mon[126480]: pgmap v10017: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 174 KiB/s wr, 10 op/s 2023-05-08T08:55:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:38 smithi133 ceph-mon[125939]: pgmap v10018: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 59 KiB/s wr, 6 op/s 2023-05-08T08:55:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:38 smithi096 ceph-mon[124666]: pgmap v10018: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 59 KiB/s wr, 6 op/s 2023-05-08T08:55:39.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:38 smithi186 ceph-mon[126480]: pgmap v10018: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 59 KiB/s wr, 6 op/s 2023-05-08T08:55:39.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18677.990481 secs 2023-05-08T08:55:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18678.547185 secs 2023-05-08T08:55:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18677.990481 secs 2023-05-08T08:55:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18678.547185 secs 2023-05-08T08:55:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18677.990481 secs 2023-05-08T08:55:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18678.547185 secs 2023-05-08T08:55:40.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:40 smithi133 ceph-mon[125939]: pgmap v10019: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 60 KiB/s wr, 10 op/s 2023-05-08T08:55:41.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:40 smithi096 ceph-mon[124666]: pgmap v10019: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 60 KiB/s wr, 10 op/s 2023-05-08T08:55:41.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:40 smithi186 ceph-mon[126480]: pgmap v10019: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 60 KiB/s wr, 10 op/s 2023-05-08T08:55:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:42 smithi133 ceph-mon[125939]: pgmap v10020: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 59 KiB/s wr, 6 op/s 2023-05-08T08:55:43.094 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:42 smithi096 ceph-mon[124666]: pgmap v10020: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 59 KiB/s wr, 6 op/s 2023-05-08T08:55:43.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:42 smithi186 ceph-mon[126480]: pgmap v10020: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 59 KiB/s wr, 6 op/s 2023-05-08T08:55:43.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:55:44.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:55:44.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:55:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18682.990601 secs 2023-05-08T08:55:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:44 smithi133 ceph-mon[125939]: pgmap v10021: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 59 KiB/s wr, 6 op/s 2023-05-08T08:55:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:55:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:55:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:55:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18683.547303 secs 2023-05-08T08:55:45.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18682.990601 secs 2023-05-08T08:55:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:44 smithi096 ceph-mon[124666]: pgmap v10021: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 59 KiB/s wr, 6 op/s 2023-05-08T08:55:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:55:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:55:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:55:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18683.547303 secs 2023-05-08T08:55:45.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18682.990601 secs 2023-05-08T08:55:45.166 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:44 smithi186 ceph-mon[126480]: pgmap v10021: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 59 KiB/s wr, 6 op/s 2023-05-08T08:55:45.167 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:55:45.167 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:55:45.167 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:55:45.167 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18683.547303 secs 2023-05-08T08:55:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:46 smithi133 ceph-mon[125939]: pgmap v10022: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 176 KiB/s wr, 9 op/s 2023-05-08T08:55:47.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:46 smithi096 ceph-mon[124666]: pgmap v10022: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 176 KiB/s wr, 9 op/s 2023-05-08T08:55:47.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:46 smithi186 ceph-mon[126480]: pgmap v10022: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 176 KiB/s wr, 9 op/s 2023-05-08T08:55:48.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:48 smithi133 ceph-mon[125939]: pgmap v10023: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 117 KiB/s wr, 6 op/s 2023-05-08T08:55:49.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:48 smithi096 ceph-mon[124666]: pgmap v10023: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 117 KiB/s wr, 6 op/s 2023-05-08T08:55:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:48 smithi186 ceph-mon[126480]: pgmap v10023: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 117 KiB/s wr, 6 op/s 2023-05-08T08:55:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18687.990721 secs 2023-05-08T08:55:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18687.990721 secs 2023-05-08T08:55:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18687.990721 secs 2023-05-08T08:55:50.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:50 smithi133 ceph-mon[125939]: pgmap v10024: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 240 KiB/s wr, 10 op/s 2023-05-08T08:55:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:50 smithi096 ceph-mon[124666]: pgmap v10024: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 240 KiB/s wr, 10 op/s 2023-05-08T08:55:51.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:50 smithi186 ceph-mon[126480]: pgmap v10024: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 240 KiB/s wr, 10 op/s 2023-05-08T08:55:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:55:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:55:52.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:55:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:52 smithi096 ceph-mon[124666]: pgmap v10025: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 240 KiB/s wr, 7 op/s 2023-05-08T08:55:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:52 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:55:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:55:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:55:53.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:52 smithi186 ceph-mon[126480]: pgmap v10025: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 240 KiB/s wr, 7 op/s 2023-05-08T08:55:53.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:52 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:55:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:55:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:55:53.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:52 smithi133 ceph-mon[125939]: pgmap v10025: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 240 KiB/s wr, 7 op/s 2023-05-08T08:55:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:52 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:55:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:55:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:55:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18692.990831 secs 2023-05-08T08:55:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:54 smithi096 ceph-mon[124666]: pgmap v10026: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 240 KiB/s wr, 7 op/s 2023-05-08T08:55:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18692.990831 secs 2023-05-08T08:55:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:54 smithi186 ceph-mon[126480]: pgmap v10026: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 240 KiB/s wr, 7 op/s 2023-05-08T08:55:55.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18692.990831 secs 2023-05-08T08:55:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:54 smithi133 ceph-mon[125939]: pgmap v10026: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 240 KiB/s wr, 7 op/s 2023-05-08T08:55:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18694.832721 secs 2023-05-08T08:55:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18694.832721 secs 2023-05-08T08:55:56.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18694.832721 secs 2023-05-08T08:55:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:56 smithi096 ceph-mon[124666]: pgmap v10027: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 465 KiB/s rd, 451 KiB/s wr, 12 op/s 2023-05-08T08:55:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:55:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:55:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:56 smithi186 ceph-mon[126480]: pgmap v10027: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 465 KiB/s rd, 451 KiB/s wr, 12 op/s 2023-05-08T08:55:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:55:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:55:57.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:56 smithi133 ceph-mon[125939]: pgmap v10027: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 465 KiB/s rd, 451 KiB/s wr, 12 op/s 2023-05-08T08:55:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:55:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:55:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:57 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:55:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:57 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:55:58.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:57 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:55:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:58 smithi186 ceph-mon[126480]: pgmap v10028: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 335 KiB/s wr, 9 op/s 2023-05-08T08:55:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:58 smithi133 ceph-mon[125939]: pgmap v10028: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 335 KiB/s wr, 9 op/s 2023-05-08T08:55:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:58 smithi096 ceph-mon[124666]: pgmap v10028: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 335 KiB/s wr, 9 op/s 2023-05-08T08:56:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18697.990954 secs 2023-05-08T08:56:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:55:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18698.547690 secs 2023-05-08T08:56:00.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18697.990954 secs 2023-05-08T08:56:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:55:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18698.547690 secs 2023-05-08T08:56:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18697.990954 secs 2023-05-08T08:56:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:55:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18698.547690 secs 2023-05-08T08:56:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:00 smithi186 ceph-mon[126480]: pgmap v10029: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 413 KiB/s wr, 14 op/s 2023-05-08T08:56:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:56:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:56:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18699.832861 secs 2023-05-08T08:56:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:00 smithi133 ceph-mon[125939]: pgmap v10029: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 413 KiB/s wr, 14 op/s 2023-05-08T08:56:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:56:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:56:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18699.832861 secs 2023-05-08T08:56:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:00 smithi096 ceph-mon[124666]: pgmap v10029: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 413 KiB/s wr, 14 op/s 2023-05-08T08:56:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:56:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:56:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18699.832861 secs 2023-05-08T08:56:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:02 smithi186 ceph-mon[126480]: pgmap v10030: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 289 KiB/s wr, 10 op/s 2023-05-08T08:56:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:02 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:56:03.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:02 smithi133 ceph-mon[125939]: pgmap v10030: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 289 KiB/s wr, 10 op/s 2023-05-08T08:56:03.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:02 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:56:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:02 smithi096 ceph-mon[124666]: pgmap v10030: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 289 KiB/s wr, 10 op/s 2023-05-08T08:56:03.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:02 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:56:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18702.991073 secs 2023-05-08T08:56:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:04 smithi186 ceph-mon[126480]: pgmap v10031: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 289 KiB/s wr, 10 op/s 2023-05-08T08:56:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18703.547787 secs 2023-05-08T08:56:05.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18702.991073 secs 2023-05-08T08:56:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:04 smithi133 ceph-mon[125939]: pgmap v10031: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 289 KiB/s wr, 10 op/s 2023-05-08T08:56:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18703.547787 secs 2023-05-08T08:56:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18702.991073 secs 2023-05-08T08:56:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:04 smithi096 ceph-mon[124666]: pgmap v10031: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 289 KiB/s wr, 10 op/s 2023-05-08T08:56:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18703.547787 secs 2023-05-08T08:56:07.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:06 smithi186 ceph-mon[126480]: pgmap v10032: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 455 KiB/s wr, 26 op/s 2023-05-08T08:56:07.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:06 smithi133 ceph-mon[125939]: pgmap v10032: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 455 KiB/s wr, 26 op/s 2023-05-08T08:56:07.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:06 smithi096 ceph-mon[124666]: pgmap v10032: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 455 KiB/s wr, 26 op/s 2023-05-08T08:56:08.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:07 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:56:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:07 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:56:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:07 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:56:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:08 smithi186 ceph-mon[126480]: pgmap v10033: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 383 KiB/s wr, 21 op/s 2023-05-08T08:56:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:08 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:56:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:56:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:56:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:08 smithi133 ceph-mon[125939]: pgmap v10033: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 383 KiB/s wr, 21 op/s 2023-05-08T08:56:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:08 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:56:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:56:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:56:09.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:08 smithi096 ceph-mon[124666]: pgmap v10033: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 383 KiB/s wr, 21 op/s 2023-05-08T08:56:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:08 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:56:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:56:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:56:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18707.991206 secs 2023-05-08T08:56:10.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18707.991206 secs 2023-05-08T08:56:10.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18707.991206 secs 2023-05-08T08:56:11.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:10 smithi186 ceph-mon[126480]: pgmap v10034: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 384 KiB/s wr, 25 op/s 2023-05-08T08:56:11.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:10 smithi133 ceph-mon[125939]: pgmap v10034: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 384 KiB/s wr, 25 op/s 2023-05-08T08:56:11.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:10 smithi096 ceph-mon[124666]: pgmap v10034: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 384 KiB/s wr, 25 op/s 2023-05-08T08:56:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:11 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:56:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:11 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:56:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:11 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:56:13.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:12 smithi186 ceph-mon[126480]: pgmap v10035: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 409 KiB/s wr, 21 op/s 2023-05-08T08:56:13.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:12 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:56:13.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:12 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:56:13.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:12 smithi133 ceph-mon[125939]: pgmap v10035: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 409 KiB/s wr, 21 op/s 2023-05-08T08:56:13.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:12 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:56:13.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:12 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:56:13.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:12 smithi096 ceph-mon[124666]: pgmap v10035: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 409 KiB/s wr, 21 op/s 2023-05-08T08:56:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:12 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:56:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:12 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:56:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18712.991322 secs 2023-05-08T08:56:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:14 smithi186 ceph-mon[126480]: pgmap v10036: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 409 KiB/s wr, 21 op/s 2023-05-08T08:56:15.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18712.991322 secs 2023-05-08T08:56:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:14 smithi133 ceph-mon[125939]: pgmap v10036: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 409 KiB/s wr, 21 op/s 2023-05-08T08:56:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18712.991322 secs 2023-05-08T08:56:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:14 smithi096 ceph-mon[124666]: pgmap v10036: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 409 KiB/s wr, 21 op/s 2023-05-08T08:56:17.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:16 smithi186 ceph-mon[126480]: pgmap v10037: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 419 KiB/s wr, 23 op/s 2023-05-08T08:56:17.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:16 smithi133 ceph-mon[125939]: pgmap v10037: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 419 KiB/s wr, 23 op/s 2023-05-08T08:56:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:16 smithi096 ceph-mon[124666]: pgmap v10037: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 419 KiB/s wr, 23 op/s 2023-05-08T08:56:18.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:17 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:56:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:17 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:56:18.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:17 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:56:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:18 smithi186 ceph-mon[126480]: pgmap v10038: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 255 KiB/s rd, 353 KiB/s wr, 8 op/s 2023-05-08T08:56:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:18 smithi133 ceph-mon[125939]: pgmap v10038: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 255 KiB/s rd, 353 KiB/s wr, 8 op/s 2023-05-08T08:56:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:18 smithi096 ceph-mon[124666]: pgmap v10038: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 255 KiB/s rd, 353 KiB/s wr, 8 op/s 2023-05-08T08:56:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18717.991444 secs 2023-05-08T08:56:20.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18717.991444 secs 2023-05-08T08:56:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18717.991444 secs 2023-05-08T08:56:21.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:20 smithi186 ceph-mon[126480]: pgmap v10039: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 213 KiB/s wr, 9 op/s 2023-05-08T08:56:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:20 smithi133 ceph-mon[125939]: pgmap v10039: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 213 KiB/s wr, 9 op/s 2023-05-08T08:56:21.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:20 smithi096 ceph-mon[124666]: pgmap v10039: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 213 KiB/s wr, 9 op/s 2023-05-08T08:56:21.837 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:56:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:56:22.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:56:23.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:22 smithi186 ceph-mon[126480]: pgmap v10040: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 213 KiB/s wr, 7 op/s 2023-05-08T08:56:23.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:22 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:56:23.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:22 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:56:23.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:22 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:56:23.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:22 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:56:23.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:22 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T08:56:23.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:22 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T08:56:23.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:22 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:56:23.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:22 smithi133 ceph-mon[125939]: pgmap v10040: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 213 KiB/s wr, 7 op/s 2023-05-08T08:56:23.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:22 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:56:23.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:22 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:56:23.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:22 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:56:23.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:22 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:56:23.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:22 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T08:56:23.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:22 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T08:56:23.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:22 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:56:23.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:22 smithi096 ceph-mon[124666]: pgmap v10040: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 213 KiB/s wr, 7 op/s 2023-05-08T08:56:23.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:22 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:56:23.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:22 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:56:23.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:22 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:56:23.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:22 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:56:23.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:22 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T08:56:23.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:22 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T08:56:23.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:22 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:56:25.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18722.991509 secs 2023-05-08T08:56:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:24 smithi186 ceph-mon[126480]: pgmap v10041: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 110 KiB/s wr, 6 op/s 2023-05-08T08:56:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18723.548342 secs 2023-05-08T08:56:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18722.991509 secs 2023-05-08T08:56:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:24 smithi133 ceph-mon[125939]: pgmap v10041: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 110 KiB/s wr, 6 op/s 2023-05-08T08:56:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18723.548342 secs 2023-05-08T08:56:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18722.991509 secs 2023-05-08T08:56:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:24 smithi096 ceph-mon[124666]: pgmap v10041: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 110 KiB/s wr, 6 op/s 2023-05-08T08:56:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18723.548342 secs 2023-05-08T08:56:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18724.833380 secs 2023-05-08T08:56:26.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18724.833380 secs 2023-05-08T08:56:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18724.833380 secs 2023-05-08T08:56:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:26 smithi186 ceph-mon[126480]: pgmap v10042: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 533 KiB/s rd, 329 KiB/s wr, 13 op/s 2023-05-08T08:56:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:26 smithi133 ceph-mon[125939]: pgmap v10042: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 533 KiB/s rd, 329 KiB/s wr, 13 op/s 2023-05-08T08:56:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:26 smithi096 ceph-mon[124666]: pgmap v10042: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 533 KiB/s rd, 329 KiB/s wr, 13 op/s 2023-05-08T08:56:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:28 smithi133 ceph-mon[125939]: pgmap v10043: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 566 KiB/s rd, 318 KiB/s wr, 10 op/s 2023-05-08T08:56:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:28 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:56:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:28 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:56:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:28 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:56:28.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:28 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:56:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:28 smithi096 ceph-mon[124666]: pgmap v10043: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 566 KiB/s rd, 318 KiB/s wr, 10 op/s 2023-05-08T08:56:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:28 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:56:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:28 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:56:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:28 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:56:29.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:28 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:56:29.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:28 smithi186 ceph-mon[126480]: pgmap v10043: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 566 KiB/s rd, 318 KiB/s wr, 10 op/s 2023-05-08T08:56:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:28 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:56:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:28 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:56:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:28 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:56:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:28 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:56:29.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18727.991617 secs 2023-05-08T08:56:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18728.548509 secs 2023-05-08T08:56:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18727.991617 secs 2023-05-08T08:56:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18728.548509 secs 2023-05-08T08:56:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18727.991617 secs 2023-05-08T08:56:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18728.548509 secs 2023-05-08T08:56:30.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:30 smithi133 ceph-mon[125939]: pgmap v10044: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 648 KiB/s rd, 347 KiB/s wr, 14 op/s 2023-05-08T08:56:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18729.833531 secs 2023-05-08T08:56:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:30 smithi096 ceph-mon[124666]: pgmap v10044: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 648 KiB/s rd, 347 KiB/s wr, 14 op/s 2023-05-08T08:56:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18729.833531 secs 2023-05-08T08:56:31.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:30 smithi186 ceph-mon[126480]: pgmap v10044: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 648 KiB/s rd, 347 KiB/s wr, 14 op/s 2023-05-08T08:56:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18729.833531 secs 2023-05-08T08:56:31.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:31 smithi133 ceph-mon[125939]: osdmap e704: 12 total, 12 up, 12 in 2023-05-08T08:56:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:31 smithi096 ceph-mon[124666]: osdmap e704: 12 total, 12 up, 12 in 2023-05-08T08:56:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:31 smithi186 ceph-mon[126480]: osdmap e704: 12 total, 12 up, 12 in 2023-05-08T08:56:32.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:32 smithi133 ceph-mon[125939]: pgmap v10046: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 416 KiB/s wr, 13 op/s 2023-05-08T08:56:33.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:32 smithi096 ceph-mon[124666]: pgmap v10046: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 416 KiB/s wr, 13 op/s 2023-05-08T08:56:33.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:32 smithi186 ceph-mon[126480]: pgmap v10046: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 416 KiB/s wr, 13 op/s 2023-05-08T08:56:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18732.991734 secs 2023-05-08T08:56:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:34 smithi133 ceph-mon[125939]: pgmap v10047: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 416 KiB/s wr, 13 op/s 2023-05-08T08:56:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18733.548637 secs 2023-05-08T08:56:35.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18732.991734 secs 2023-05-08T08:56:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:34 smithi096 ceph-mon[124666]: pgmap v10047: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 416 KiB/s wr, 13 op/s 2023-05-08T08:56:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18733.548637 secs 2023-05-08T08:56:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18732.991734 secs 2023-05-08T08:56:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:34 smithi186 ceph-mon[126480]: pgmap v10047: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 416 KiB/s wr, 13 op/s 2023-05-08T08:56:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18733.548637 secs 2023-05-08T08:56:35.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18734.833649 secs 2023-05-08T08:56:36.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18734.833649 secs 2023-05-08T08:56:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18734.833649 secs 2023-05-08T08:56:36.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:36 smithi133 ceph-mon[125939]: pgmap v10048: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 155 KiB/s wr, 9 op/s 2023-05-08T08:56:37.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:36 smithi096 ceph-mon[124666]: pgmap v10048: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 155 KiB/s wr, 9 op/s 2023-05-08T08:56:37.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:36 smithi186 ceph-mon[126480]: pgmap v10048: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 155 KiB/s wr, 9 op/s 2023-05-08T08:56:38.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:38 smithi133 ceph-mon[125939]: pgmap v10049: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 155 KiB/s wr, 9 op/s 2023-05-08T08:56:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:38 smithi096 ceph-mon[124666]: pgmap v10049: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 155 KiB/s wr, 9 op/s 2023-05-08T08:56:39.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:38 smithi186 ceph-mon[126480]: pgmap v10049: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 155 KiB/s wr, 9 op/s 2023-05-08T08:56:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18737.991846 secs 2023-05-08T08:56:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18738.548746 secs 2023-05-08T08:56:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18737.991846 secs 2023-05-08T08:56:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18738.548746 secs 2023-05-08T08:56:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18737.991846 secs 2023-05-08T08:56:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18738.548746 secs 2023-05-08T08:56:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:40 smithi133 ceph-mon[125939]: pgmap v10050: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 214 KiB/s wr, 8 op/s 2023-05-08T08:56:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18739.833747 secs 2023-05-08T08:56:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:40 smithi096 ceph-mon[124666]: pgmap v10050: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 214 KiB/s wr, 8 op/s 2023-05-08T08:56:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18739.833747 secs 2023-05-08T08:56:41.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:40 smithi186 ceph-mon[126480]: pgmap v10050: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 214 KiB/s wr, 8 op/s 2023-05-08T08:56:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18739.833747 secs 2023-05-08T08:56:42.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:42 smithi133 ceph-mon[125939]: pgmap v10051: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 195 KiB/s wr, 8 op/s 2023-05-08T08:56:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:42 smithi133 ceph-mon[125939]: osdmap e705: 12 total, 12 up, 12 in 2023-05-08T08:56:43.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:42 smithi096 ceph-mon[124666]: pgmap v10051: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 195 KiB/s wr, 8 op/s 2023-05-08T08:56:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:42 smithi096 ceph-mon[124666]: osdmap e705: 12 total, 12 up, 12 in 2023-05-08T08:56:43.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:42 smithi186 ceph-mon[126480]: pgmap v10051: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 195 KiB/s wr, 8 op/s 2023-05-08T08:56:43.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:42 smithi186 ceph-mon[126480]: osdmap e705: 12 total, 12 up, 12 in 2023-05-08T08:56:44.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18742.991968 secs 2023-05-08T08:56:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:44 smithi133 ceph-mon[125939]: pgmap v10053: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 214 KiB/s wr, 8 op/s 2023-05-08T08:56:45.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18742.991968 secs 2023-05-08T08:56:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:44 smithi096 ceph-mon[124666]: pgmap v10053: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 214 KiB/s wr, 8 op/s 2023-05-08T08:56:45.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18742.991968 secs 2023-05-08T08:56:45.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:44 smithi186 ceph-mon[126480]: pgmap v10053: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 214 KiB/s wr, 8 op/s 2023-05-08T08:56:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18744.833864 secs 2023-05-08T08:56:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18744.833864 secs 2023-05-08T08:56:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18744.833864 secs 2023-05-08T08:56:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:46 smithi096 ceph-mon[124666]: pgmap v10054: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 488 KiB/s rd, 472 KiB/s wr, 11 op/s 2023-05-08T08:56:47.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:46 smithi186 ceph-mon[126480]: pgmap v10054: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 488 KiB/s rd, 472 KiB/s wr, 11 op/s 2023-05-08T08:56:47.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:46 smithi133 ceph-mon[125939]: pgmap v10054: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 488 KiB/s rd, 472 KiB/s wr, 11 op/s 2023-05-08T08:56:48.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:56:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:56:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:56:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:48 smithi096 ceph-mon[124666]: pgmap v10055: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 488 KiB/s rd, 472 KiB/s wr, 11 op/s 2023-05-08T08:56:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:48 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:56:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:56:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:56:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:48 smithi186 ceph-mon[126480]: pgmap v10055: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 488 KiB/s rd, 472 KiB/s wr, 11 op/s 2023-05-08T08:56:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:48 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:56:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:56:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:56:49.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:48 smithi133 ceph-mon[125939]: pgmap v10055: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 488 KiB/s rd, 472 KiB/s wr, 11 op/s 2023-05-08T08:56:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:48 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:56:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:56:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:56:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18747.992071 secs 2023-05-08T08:56:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18748.548966 secs 2023-05-08T08:56:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18747.992071 secs 2023-05-08T08:56:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18748.548966 secs 2023-05-08T08:56:50.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18747.992071 secs 2023-05-08T08:56:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18748.548966 secs 2023-05-08T08:56:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:50 smithi096 ceph-mon[124666]: pgmap v10056: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 577 KiB/s wr, 12 op/s 2023-05-08T08:56:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18749.833990 secs 2023-05-08T08:56:51.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:50 smithi186 ceph-mon[126480]: pgmap v10056: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 577 KiB/s wr, 12 op/s 2023-05-08T08:56:51.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18749.833990 secs 2023-05-08T08:56:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:50 smithi133 ceph-mon[125939]: pgmap v10056: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 577 KiB/s wr, 12 op/s 2023-05-08T08:56:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18749.833990 secs 2023-05-08T08:56:53.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:52 smithi186 ceph-mon[126480]: pgmap v10057: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 577 KiB/s wr, 12 op/s 2023-05-08T08:56:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:56:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:56:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:52 smithi133 ceph-mon[125939]: pgmap v10057: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 577 KiB/s wr, 12 op/s 2023-05-08T08:56:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:56:53.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:56:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:52 smithi096 ceph-mon[124666]: pgmap v10057: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 577 KiB/s wr, 12 op/s 2023-05-08T08:56:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:56:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:56:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18752.992194 secs 2023-05-08T08:56:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:54 smithi186 ceph-mon[126480]: pgmap v10058: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 526 KiB/s wr, 11 op/s 2023-05-08T08:56:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18753.549030 secs 2023-05-08T08:56:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18752.992194 secs 2023-05-08T08:56:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:54 smithi133 ceph-mon[125939]: pgmap v10058: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 526 KiB/s wr, 11 op/s 2023-05-08T08:56:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18753.549030 secs 2023-05-08T08:56:55.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18752.992194 secs 2023-05-08T08:56:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:54 smithi096 ceph-mon[124666]: pgmap v10058: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 526 KiB/s wr, 11 op/s 2023-05-08T08:56:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18753.549030 secs 2023-05-08T08:56:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18754.834054 secs 2023-05-08T08:56:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18754.834054 secs 2023-05-08T08:56:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18754.834054 secs 2023-05-08T08:56:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:56 smithi186 ceph-mon[126480]: pgmap v10059: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 483 KiB/s wr, 14 op/s 2023-05-08T08:56:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:56 smithi133 ceph-mon[125939]: pgmap v10059: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 483 KiB/s wr, 14 op/s 2023-05-08T08:56:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:56 smithi096 ceph-mon[124666]: pgmap v10059: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 483 KiB/s wr, 14 op/s 2023-05-08T08:56:58.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:57 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:56:58.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:57 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:56:58.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:57 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:56:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:58 smithi186 ceph-mon[126480]: pgmap v10060: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 290 KiB/s rd, 267 KiB/s wr, 8 op/s 2023-05-08T08:56:59.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:58 smithi133 ceph-mon[125939]: pgmap v10060: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 290 KiB/s rd, 267 KiB/s wr, 8 op/s 2023-05-08T08:56:59.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:58 smithi096 ceph-mon[124666]: pgmap v10060: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 290 KiB/s rd, 267 KiB/s wr, 8 op/s 2023-05-08T08:57:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18757.992309 secs 2023-05-08T08:57:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:56:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18758.549149 secs 2023-05-08T08:57:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18757.992309 secs 2023-05-08T08:57:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:56:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18758.549149 secs 2023-05-08T08:57:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18757.992309 secs 2023-05-08T08:57:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:56:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18758.549149 secs 2023-05-08T08:57:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:00 smithi186 ceph-mon[126480]: pgmap v10061: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 635 KiB/s rd, 611 KiB/s wr, 14 op/s 2023-05-08T08:57:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18759.834186 secs 2023-05-08T08:57:01.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:00 smithi133 ceph-mon[125939]: pgmap v10061: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 635 KiB/s rd, 611 KiB/s wr, 14 op/s 2023-05-08T08:57:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18759.834186 secs 2023-05-08T08:57:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:00 smithi096 ceph-mon[124666]: pgmap v10061: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 635 KiB/s rd, 611 KiB/s wr, 14 op/s 2023-05-08T08:57:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18759.834186 secs 2023-05-08T08:57:03.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:02 smithi186 ceph-mon[126480]: pgmap v10062: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 346 KiB/s wr, 9 op/s 2023-05-08T08:57:03.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:02 smithi133 ceph-mon[125939]: pgmap v10062: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 346 KiB/s wr, 9 op/s 2023-05-08T08:57:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:02 smithi096 ceph-mon[124666]: pgmap v10062: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 346 KiB/s wr, 9 op/s 2023-05-08T08:57:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18762.992412 secs 2023-05-08T08:57:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:04 smithi186 ceph-mon[126480]: pgmap v10063: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 346 KiB/s wr, 9 op/s 2023-05-08T08:57:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18763.549264 secs 2023-05-08T08:57:05.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18762.992412 secs 2023-05-08T08:57:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:04 smithi133 ceph-mon[125939]: pgmap v10063: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 346 KiB/s wr, 9 op/s 2023-05-08T08:57:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18763.549264 secs 2023-05-08T08:57:05.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18762.992412 secs 2023-05-08T08:57:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:04 smithi096 ceph-mon[124666]: pgmap v10063: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 346 KiB/s wr, 9 op/s 2023-05-08T08:57:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18763.549264 secs 2023-05-08T08:57:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18764.834289 secs 2023-05-08T08:57:06.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18764.834289 secs 2023-05-08T08:57:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18764.834289 secs 2023-05-08T08:57:07.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:06 smithi186 ceph-mon[126480]: pgmap v10064: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 464 KiB/s wr, 27 op/s 2023-05-08T08:57:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:06 smithi186 ceph-mon[126480]: osdmap e706: 12 total, 12 up, 12 in 2023-05-08T08:57:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:06 smithi133 ceph-mon[125939]: pgmap v10064: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 464 KiB/s wr, 27 op/s 2023-05-08T08:57:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:06 smithi133 ceph-mon[125939]: osdmap e706: 12 total, 12 up, 12 in 2023-05-08T08:57:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:06 smithi096 ceph-mon[124666]: pgmap v10064: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 464 KiB/s wr, 27 op/s 2023-05-08T08:57:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:06 smithi096 ceph-mon[124666]: osdmap e706: 12 total, 12 up, 12 in 2023-05-08T08:57:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:08 smithi186 ceph-mon[126480]: pgmap v10066: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 555 KiB/s wr, 28 op/s 2023-05-08T08:57:09.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:08 smithi133 ceph-mon[125939]: pgmap v10066: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 555 KiB/s wr, 28 op/s 2023-05-08T08:57:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:08 smithi096 ceph-mon[124666]: pgmap v10066: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 555 KiB/s wr, 28 op/s 2023-05-08T08:57:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18767.992550 secs 2023-05-08T08:57:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18768.549364 secs 2023-05-08T08:57:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18767.992550 secs 2023-05-08T08:57:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18768.549364 secs 2023-05-08T08:57:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18767.992550 secs 2023-05-08T08:57:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18768.549364 secs 2023-05-08T08:57:11.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:10 smithi186 ceph-mon[126480]: pgmap v10067: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 219 KiB/s wr, 26 op/s 2023-05-08T08:57:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18769.834436 secs 2023-05-08T08:57:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:10 smithi133 ceph-mon[125939]: pgmap v10067: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 219 KiB/s wr, 26 op/s 2023-05-08T08:57:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18769.834436 secs 2023-05-08T08:57:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:10 smithi096 ceph-mon[124666]: pgmap v10067: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 219 KiB/s wr, 26 op/s 2023-05-08T08:57:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18769.834436 secs 2023-05-08T08:57:13.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:12 smithi186 ceph-mon[126480]: pgmap v10068: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 219 KiB/s wr, 26 op/s 2023-05-08T08:57:13.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:12 smithi186 ceph-mon[126480]: osdmap e707: 12 total, 12 up, 12 in 2023-05-08T08:57:13.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:12 smithi133 ceph-mon[125939]: pgmap v10068: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 219 KiB/s wr, 26 op/s 2023-05-08T08:57:13.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:12 smithi133 ceph-mon[125939]: osdmap e707: 12 total, 12 up, 12 in 2023-05-08T08:57:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:12 smithi096 ceph-mon[124666]: pgmap v10068: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 219 KiB/s wr, 26 op/s 2023-05-08T08:57:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:12 smithi096 ceph-mon[124666]: osdmap e707: 12 total, 12 up, 12 in 2023-05-08T08:57:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18772.992641 secs 2023-05-08T08:57:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:14 smithi186 ceph-mon[126480]: pgmap v10070: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 96 KiB/s wr, 5 op/s 2023-05-08T08:57:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18773.549450 secs 2023-05-08T08:57:15.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18772.992641 secs 2023-05-08T08:57:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:14 smithi133 ceph-mon[125939]: pgmap v10070: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 96 KiB/s wr, 5 op/s 2023-05-08T08:57:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18773.549450 secs 2023-05-08T08:57:15.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18772.992641 secs 2023-05-08T08:57:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:14 smithi096 ceph-mon[124666]: pgmap v10070: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 96 KiB/s wr, 5 op/s 2023-05-08T08:57:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18773.549450 secs 2023-05-08T08:57:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18774.834571 secs 2023-05-08T08:57:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18774.834571 secs 2023-05-08T08:57:16.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18774.834571 secs 2023-05-08T08:57:17.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:16 smithi186 ceph-mon[126480]: pgmap v10071: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 236 KiB/s wr, 10 op/s 2023-05-08T08:57:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:16 smithi133 ceph-mon[125939]: pgmap v10071: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 236 KiB/s wr, 10 op/s 2023-05-08T08:57:17.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:16 smithi096 ceph-mon[124666]: pgmap v10071: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 236 KiB/s wr, 10 op/s 2023-05-08T08:57:19.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:18 smithi186 ceph-mon[126480]: pgmap v10072: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 233 KiB/s wr, 9 op/s 2023-05-08T08:57:19.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:18 smithi133 ceph-mon[125939]: pgmap v10072: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 233 KiB/s wr, 9 op/s 2023-05-08T08:57:19.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:18 smithi096 ceph-mon[124666]: pgmap v10072: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 233 KiB/s wr, 9 op/s 2023-05-08T08:57:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18777.992729 secs 2023-05-08T08:57:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18778.549536 secs 2023-05-08T08:57:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18777.992729 secs 2023-05-08T08:57:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18778.549536 secs 2023-05-08T08:57:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18777.992729 secs 2023-05-08T08:57:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18778.549536 secs 2023-05-08T08:57:21.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:20 smithi186 ceph-mon[126480]: pgmap v10073: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 275 KiB/s wr, 10 op/s 2023-05-08T08:57:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18779.834708 secs 2023-05-08T08:57:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:20 smithi133 ceph-mon[125939]: pgmap v10073: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 275 KiB/s wr, 10 op/s 2023-05-08T08:57:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18779.834708 secs 2023-05-08T08:57:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:20 smithi096 ceph-mon[124666]: pgmap v10073: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 275 KiB/s wr, 10 op/s 2023-05-08T08:57:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18779.834708 secs 2023-05-08T08:57:23.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:22 smithi186 ceph-mon[126480]: pgmap v10074: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 275 KiB/s wr, 10 op/s 2023-05-08T08:57:23.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:22 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:57:23.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:22 smithi133 ceph-mon[125939]: pgmap v10074: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 275 KiB/s wr, 10 op/s 2023-05-08T08:57:23.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:22 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:57:23.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:22 smithi096 ceph-mon[124666]: pgmap v10074: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 275 KiB/s wr, 10 op/s 2023-05-08T08:57:23.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:22 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:57:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:57:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:57:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:23 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:57:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:57:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:23 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T08:57:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:23 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T08:57:24.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:23 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:57:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:57:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:57:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:23 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:57:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:57:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:23 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T08:57:24.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:23 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T08:57:24.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:23 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:57:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:57:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:57:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:23 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:57:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:57:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:23 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T08:57:24.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:23 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T08:57:24.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:23 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:57:25.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18782.992799 secs 2023-05-08T08:57:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:24 smithi186 ceph-mon[126480]: pgmap v10075: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 250 KiB/s wr, 9 op/s 2023-05-08T08:57:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18783.549646 secs 2023-05-08T08:57:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18782.992799 secs 2023-05-08T08:57:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:24 smithi133 ceph-mon[125939]: pgmap v10075: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 250 KiB/s wr, 9 op/s 2023-05-08T08:57:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18783.549646 secs 2023-05-08T08:57:25.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18782.992799 secs 2023-05-08T08:57:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:24 smithi096 ceph-mon[124666]: pgmap v10075: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 250 KiB/s wr, 9 op/s 2023-05-08T08:57:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18783.549646 secs 2023-05-08T08:57:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18784.834824 secs 2023-05-08T08:57:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18784.834824 secs 2023-05-08T08:57:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18784.834824 secs 2023-05-08T08:57:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:26 smithi186 ceph-mon[126480]: pgmap v10076: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 230 KiB/s wr, 12 op/s 2023-05-08T08:57:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:26 smithi133 ceph-mon[125939]: pgmap v10076: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 230 KiB/s wr, 12 op/s 2023-05-08T08:57:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:26 smithi096 ceph-mon[124666]: pgmap v10076: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 230 KiB/s wr, 12 op/s 2023-05-08T08:57:29.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:28 smithi186 ceph-mon[126480]: pgmap v10077: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 100 KiB/s wr, 8 op/s 2023-05-08T08:57:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:28 smithi133 ceph-mon[125939]: pgmap v10077: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 100 KiB/s wr, 8 op/s 2023-05-08T08:57:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:28 smithi096 ceph-mon[124666]: pgmap v10077: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 100 KiB/s wr, 8 op/s 2023-05-08T08:57:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18787.992954 secs 2023-05-08T08:57:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18788.549768 secs 2023-05-08T08:57:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18787.992954 secs 2023-05-08T08:57:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18788.549768 secs 2023-05-08T08:57:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18787.992954 secs 2023-05-08T08:57:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18788.549768 secs 2023-05-08T08:57:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:30 smithi133 ceph-mon[125939]: pgmap v10078: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 100 KiB/s wr, 11 op/s 2023-05-08T08:57:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18789.834948 secs 2023-05-08T08:57:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:30 smithi096 ceph-mon[124666]: pgmap v10078: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 100 KiB/s wr, 11 op/s 2023-05-08T08:57:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18789.834948 secs 2023-05-08T08:57:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:30 smithi186 ceph-mon[126480]: pgmap v10078: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 100 KiB/s wr, 11 op/s 2023-05-08T08:57:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18789.834948 secs 2023-05-08T08:57:33.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:32 smithi133 ceph-mon[125939]: pgmap v10079: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2023-05-08T08:57:33.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:32 smithi096 ceph-mon[124666]: pgmap v10079: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2023-05-08T08:57:33.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:32 smithi186 ceph-mon[126480]: pgmap v10079: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2023-05-08T08:57:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18792.993078 secs 2023-05-08T08:57:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18792.993078 secs 2023-05-08T08:57:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18792.993078 secs 2023-05-08T08:57:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:34 smithi133 ceph-mon[125939]: pgmap v10080: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2023-05-08T08:57:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18793.549913 secs 2023-05-08T08:57:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:34 smithi096 ceph-mon[124666]: pgmap v10080: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2023-05-08T08:57:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18793.549913 secs 2023-05-08T08:57:35.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:34 smithi186 ceph-mon[126480]: pgmap v10080: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2023-05-08T08:57:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18793.549913 secs 2023-05-08T08:57:36.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18794.835043 secs 2023-05-08T08:57:36.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18794.835043 secs 2023-05-08T08:57:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18794.835043 secs 2023-05-08T08:57:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:36 smithi133 ceph-mon[125939]: pgmap v10081: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 71 KiB/s wr, 10 op/s 2023-05-08T08:57:37.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:36 smithi096 ceph-mon[124666]: pgmap v10081: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 71 KiB/s wr, 10 op/s 2023-05-08T08:57:37.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:36 smithi186 ceph-mon[126480]: pgmap v10081: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 71 KiB/s wr, 10 op/s 2023-05-08T08:57:39.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:38 smithi133 ceph-mon[125939]: pgmap v10082: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 70 KiB/s wr, 6 op/s 2023-05-08T08:57:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18797.993181 secs 2023-05-08T08:57:39.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:38 smithi096 ceph-mon[124666]: pgmap v10082: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 70 KiB/s wr, 6 op/s 2023-05-08T08:57:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18797.993181 secs 2023-05-08T08:57:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:38 smithi186 ceph-mon[126480]: pgmap v10082: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 70 KiB/s wr, 6 op/s 2023-05-08T08:57:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18797.993181 secs 2023-05-08T08:57:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18798.550043 secs 2023-05-08T08:57:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18798.550043 secs 2023-05-08T08:57:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18798.550043 secs 2023-05-08T08:57:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:40 smithi133 ceph-mon[125939]: pgmap v10083: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 108 KiB/s wr, 9 op/s 2023-05-08T08:57:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:40 smithi096 ceph-mon[124666]: pgmap v10083: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 108 KiB/s wr, 9 op/s 2023-05-08T08:57:41.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:40 smithi186 ceph-mon[126480]: pgmap v10083: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 108 KiB/s wr, 9 op/s 2023-05-08T08:57:43.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:42 smithi133 ceph-mon[125939]: pgmap v10084: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 108 KiB/s wr, 6 op/s 2023-05-08T08:57:43.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:42 smithi096 ceph-mon[124666]: pgmap v10084: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 108 KiB/s wr, 6 op/s 2023-05-08T08:57:43.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:42 smithi186 ceph-mon[126480]: pgmap v10084: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 108 KiB/s wr, 6 op/s 2023-05-08T08:57:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:57:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18802.993284 secs 2023-05-08T08:57:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:57:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18802.993284 secs 2023-05-08T08:57:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:57:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18802.993284 secs 2023-05-08T08:57:45.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:44 smithi133 ceph-mon[125939]: pgmap v10085: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 108 KiB/s wr, 6 op/s 2023-05-08T08:57:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18803.550164 secs 2023-05-08T08:57:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:57:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:57:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:57:45.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:44 smithi096 ceph-mon[124666]: pgmap v10085: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 108 KiB/s wr, 6 op/s 2023-05-08T08:57:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18803.550164 secs 2023-05-08T08:57:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:57:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:57:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:57:45.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:44 smithi186 ceph-mon[126480]: pgmap v10085: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 108 KiB/s wr, 6 op/s 2023-05-08T08:57:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18803.550164 secs 2023-05-08T08:57:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:57:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:57:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:57:47.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:46 smithi133 ceph-mon[125939]: pgmap v10086: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 236 KiB/s wr, 10 op/s 2023-05-08T08:57:47.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:46 smithi096 ceph-mon[124666]: pgmap v10086: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 236 KiB/s wr, 10 op/s 2023-05-08T08:57:47.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:46 smithi186 ceph-mon[126480]: pgmap v10086: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 236 KiB/s wr, 10 op/s 2023-05-08T08:57:49.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:48 smithi133 ceph-mon[125939]: pgmap v10087: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 166 KiB/s wr, 7 op/s 2023-05-08T08:57:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18807.993402 secs 2023-05-08T08:57:49.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:48 smithi096 ceph-mon[124666]: pgmap v10087: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 166 KiB/s wr, 7 op/s 2023-05-08T08:57:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18807.993402 secs 2023-05-08T08:57:49.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:48 smithi186 ceph-mon[126480]: pgmap v10087: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 166 KiB/s wr, 7 op/s 2023-05-08T08:57:49.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18807.993402 secs 2023-05-08T08:57:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:50 smithi133 ceph-mon[125939]: pgmap v10088: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 553 KiB/s rd, 402 KiB/s wr, 19 op/s 2023-05-08T08:57:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18809.835367 secs 2023-05-08T08:57:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:50 smithi096 ceph-mon[124666]: pgmap v10088: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 553 KiB/s rd, 402 KiB/s wr, 19 op/s 2023-05-08T08:57:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18809.835367 secs 2023-05-08T08:57:51.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:50 smithi186 ceph-mon[126480]: pgmap v10088: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 553 KiB/s rd, 402 KiB/s wr, 19 op/s 2023-05-08T08:57:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18809.835367 secs 2023-05-08T08:57:52.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:57:52.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:57:52.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:57:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:52 smithi133 ceph-mon[125939]: pgmap v10089: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 444 KiB/s rd, 364 KiB/s wr, 15 op/s 2023-05-08T08:57:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:57:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:57:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:57:53.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:52 smithi096 ceph-mon[124666]: pgmap v10089: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 444 KiB/s rd, 364 KiB/s wr, 15 op/s 2023-05-08T08:57:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:57:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:57:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:57:53.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:52 smithi186 ceph-mon[126480]: pgmap v10089: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 444 KiB/s rd, 364 KiB/s wr, 15 op/s 2023-05-08T08:57:53.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:57:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:57:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:57:54.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18812.993519 secs 2023-05-08T08:57:54.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18812.993519 secs 2023-05-08T08:57:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18812.993519 secs 2023-05-08T08:57:55.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:54 smithi133 ceph-mon[125939]: pgmap v10090: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 444 KiB/s rd, 364 KiB/s wr, 15 op/s 2023-05-08T08:57:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18813.550374 secs 2023-05-08T08:57:55.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:54 smithi096 ceph-mon[124666]: pgmap v10090: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 444 KiB/s rd, 364 KiB/s wr, 15 op/s 2023-05-08T08:57:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18813.550374 secs 2023-05-08T08:57:55.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:54 smithi186 ceph-mon[126480]: pgmap v10090: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 444 KiB/s rd, 364 KiB/s wr, 15 op/s 2023-05-08T08:57:55.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18813.550374 secs 2023-05-08T08:57:56.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:55 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:57:56.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:55 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:57:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:55 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:57:57.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:56 smithi096 ceph-mon[124666]: pgmap v10091: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 736 KiB/s rd, 620 KiB/s wr, 30 op/s 2023-05-08T08:57:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:57:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:57:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:57:57.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:56 smithi186 ceph-mon[126480]: pgmap v10091: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 736 KiB/s rd, 620 KiB/s wr, 30 op/s 2023-05-08T08:57:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:57:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:57:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:57:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:56 smithi133 ceph-mon[125939]: pgmap v10091: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 736 KiB/s rd, 620 KiB/s wr, 30 op/s 2023-05-08T08:57:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:57:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:57:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:57:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:59 smithi096 ceph-mon[124666]: pgmap v10092: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 533 KiB/s rd, 492 KiB/s wr, 26 op/s 2023-05-08T08:57:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:57:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18817.993602 secs 2023-05-08T08:57:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:59 smithi186 ceph-mon[126480]: pgmap v10092: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 533 KiB/s rd, 492 KiB/s wr, 26 op/s 2023-05-08T08:57:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:57:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18817.993602 secs 2023-05-08T08:57:59.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:59 smithi133 ceph-mon[125939]: pgmap v10092: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 533 KiB/s rd, 492 KiB/s wr, 26 op/s 2023-05-08T08:57:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:57:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18817.993602 secs 2023-05-08T08:58:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18818.550435 secs 2023-05-08T08:58:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18818.550435 secs 2023-05-08T08:58:00.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18818.550435 secs 2023-05-08T08:58:01.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:01 smithi186 ceph-mon[126480]: pgmap v10093: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 559 KiB/s wr, 31 op/s 2023-05-08T08:58:01.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:01 smithi133 ceph-mon[125939]: pgmap v10093: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 559 KiB/s wr, 31 op/s 2023-05-08T08:58:01.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:01 smithi096 ceph-mon[124666]: pgmap v10093: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 559 KiB/s wr, 31 op/s 2023-05-08T08:58:03.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:03 smithi186 ceph-mon[126480]: pgmap v10094: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 359 KiB/s rd, 322 KiB/s wr, 19 op/s 2023-05-08T08:58:03.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:03 smithi133 ceph-mon[125939]: pgmap v10094: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 359 KiB/s rd, 322 KiB/s wr, 19 op/s 2023-05-08T08:58:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:03 smithi096 ceph-mon[124666]: pgmap v10094: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 359 KiB/s rd, 322 KiB/s wr, 19 op/s 2023-05-08T08:58:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18822.993727 secs 2023-05-08T08:58:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18822.993727 secs 2023-05-08T08:58:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18822.993727 secs 2023-05-08T08:58:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:05 smithi186 ceph-mon[126480]: pgmap v10095: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 359 KiB/s rd, 322 KiB/s wr, 19 op/s 2023-05-08T08:58:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18823.550548 secs 2023-05-08T08:58:05.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:05 smithi133 ceph-mon[125939]: pgmap v10095: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 359 KiB/s rd, 322 KiB/s wr, 19 op/s 2023-05-08T08:58:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18823.550548 secs 2023-05-08T08:58:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:05 smithi096 ceph-mon[124666]: pgmap v10095: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 359 KiB/s rd, 322 KiB/s wr, 19 op/s 2023-05-08T08:58:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18823.550548 secs 2023-05-08T08:58:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18824.835726 secs 2023-05-08T08:58:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18824.835726 secs 2023-05-08T08:58:06.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18824.835726 secs 2023-05-08T08:58:07.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:07 smithi186 ceph-mon[126480]: pgmap v10096: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 657 KiB/s rd, 666 KiB/s wr, 38 op/s 2023-05-08T08:58:07.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:07 smithi133 ceph-mon[125939]: pgmap v10096: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 657 KiB/s rd, 666 KiB/s wr, 38 op/s 2023-05-08T08:58:07.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:07 smithi096 ceph-mon[124666]: pgmap v10096: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 657 KiB/s rd, 666 KiB/s wr, 38 op/s 2023-05-08T08:58:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:08 smithi133 ceph-mon[125939]: pgmap v10097: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 410 KiB/s wr, 24 op/s 2023-05-08T08:58:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:08 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:58:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:58:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:58:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:08 smithi096 ceph-mon[124666]: pgmap v10097: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 410 KiB/s wr, 24 op/s 2023-05-08T08:58:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:08 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:58:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:58:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:58:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:08 smithi186 ceph-mon[126480]: pgmap v10097: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 410 KiB/s wr, 24 op/s 2023-05-08T08:58:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:08 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:58:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:58:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:58:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18827.993847 secs 2023-05-08T08:58:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18828.550639 secs 2023-05-08T08:58:10.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18827.993847 secs 2023-05-08T08:58:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18828.550639 secs 2023-05-08T08:58:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18827.993847 secs 2023-05-08T08:58:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18828.550639 secs 2023-05-08T08:58:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:10 smithi133 ceph-mon[125939]: pgmap v10098: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 602 KiB/s wr, 29 op/s 2023-05-08T08:58:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18829.835874 secs 2023-05-08T08:58:11.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:10 smithi096 ceph-mon[124666]: pgmap v10098: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 602 KiB/s wr, 29 op/s 2023-05-08T08:58:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18829.835874 secs 2023-05-08T08:58:11.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:10 smithi186 ceph-mon[126480]: pgmap v10098: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 602 KiB/s wr, 29 op/s 2023-05-08T08:58:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18829.835874 secs 2023-05-08T08:58:11.731 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:11 smithi096 ceph-mon[124666]: osdmap e708: 12 total, 12 up, 12 in 2023-05-08T08:58:11.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:11 smithi133 ceph-mon[125939]: osdmap e708: 12 total, 12 up, 12 in 2023-05-08T08:58:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:11 smithi186 ceph-mon[126480]: osdmap e708: 12 total, 12 up, 12 in 2023-05-08T08:58:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:12 smithi133 ceph-mon[125939]: pgmap v10100: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 588 KiB/s rd, 643 KiB/s wr, 30 op/s 2023-05-08T08:58:13.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:12 smithi096 ceph-mon[124666]: pgmap v10100: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 588 KiB/s rd, 643 KiB/s wr, 30 op/s 2023-05-08T08:58:13.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:12 smithi186 ceph-mon[126480]: pgmap v10100: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 588 KiB/s rd, 643 KiB/s wr, 30 op/s 2023-05-08T08:58:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18832.993996 secs 2023-05-08T08:58:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:14 smithi133 ceph-mon[125939]: pgmap v10101: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 588 KiB/s rd, 643 KiB/s wr, 30 op/s 2023-05-08T08:58:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18833.550757 secs 2023-05-08T08:58:15.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18832.993996 secs 2023-05-08T08:58:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:14 smithi096 ceph-mon[124666]: pgmap v10101: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 588 KiB/s rd, 643 KiB/s wr, 30 op/s 2023-05-08T08:58:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18833.550757 secs 2023-05-08T08:58:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18832.993996 secs 2023-05-08T08:58:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:14 smithi186 ceph-mon[126480]: pgmap v10101: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 588 KiB/s rd, 643 KiB/s wr, 30 op/s 2023-05-08T08:58:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18833.550757 secs 2023-05-08T08:58:16.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18834.835986 secs 2023-05-08T08:58:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18834.835986 secs 2023-05-08T08:58:16.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18834.835986 secs 2023-05-08T08:58:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:16 smithi096 ceph-mon[124666]: pgmap v10102: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 298 KiB/s wr, 11 op/s 2023-05-08T08:58:17.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:16 smithi186 ceph-mon[126480]: pgmap v10102: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 298 KiB/s wr, 11 op/s 2023-05-08T08:58:17.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:16 smithi133 ceph-mon[125939]: pgmap v10102: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 298 KiB/s wr, 11 op/s 2023-05-08T08:58:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:18 smithi133 ceph-mon[125939]: pgmap v10103: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 298 KiB/s wr, 11 op/s 2023-05-08T08:58:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:18 smithi133 ceph-mon[125939]: osdmap e709: 12 total, 12 up, 12 in 2023-05-08T08:58:19.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:18 smithi096 ceph-mon[124666]: pgmap v10103: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 298 KiB/s wr, 11 op/s 2023-05-08T08:58:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:18 smithi096 ceph-mon[124666]: osdmap e709: 12 total, 12 up, 12 in 2023-05-08T08:58:19.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:18 smithi186 ceph-mon[126480]: pgmap v10103: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 298 KiB/s wr, 11 op/s 2023-05-08T08:58:19.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:18 smithi186 ceph-mon[126480]: osdmap e709: 12 total, 12 up, 12 in 2023-05-08T08:58:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18837.994119 secs 2023-05-08T08:58:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18838.550867 secs 2023-05-08T08:58:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18837.994119 secs 2023-05-08T08:58:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18838.550867 secs 2023-05-08T08:58:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18837.994119 secs 2023-05-08T08:58:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18838.550867 secs 2023-05-08T08:58:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:20 smithi133 ceph-mon[125939]: pgmap v10105: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 138 KiB/s wr, 9 op/s 2023-05-08T08:58:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18839.836105 secs 2023-05-08T08:58:21.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:20 smithi096 ceph-mon[124666]: pgmap v10105: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 138 KiB/s wr, 9 op/s 2023-05-08T08:58:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18839.836105 secs 2023-05-08T08:58:21.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:20 smithi186 ceph-mon[126480]: pgmap v10105: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 138 KiB/s wr, 9 op/s 2023-05-08T08:58:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18839.836105 secs 2023-05-08T08:58:22.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:22 smithi133 ceph-mon[125939]: pgmap v10106: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 124 KiB/s wr, 8 op/s 2023-05-08T08:58:23.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:22 smithi096 ceph-mon[124666]: pgmap v10106: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 124 KiB/s wr, 8 op/s 2023-05-08T08:58:23.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:22 smithi186 ceph-mon[126480]: pgmap v10106: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 124 KiB/s wr, 8 op/s 2023-05-08T08:58:23.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:58:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:58:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:58:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18842.994215 secs 2023-05-08T08:58:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:24 smithi133 ceph-mon[125939]: pgmap v10107: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 124 KiB/s wr, 8 op/s 2023-05-08T08:58:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18843.551014 secs 2023-05-08T08:58:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:58:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:58:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:24 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:58:24.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:58:24.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:24 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T08:58:24.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:24 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T08:58:24.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:24 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:58:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18842.994215 secs 2023-05-08T08:58:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:24 smithi096 ceph-mon[124666]: pgmap v10107: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 124 KiB/s wr, 8 op/s 2023-05-08T08:58:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18843.551014 secs 2023-05-08T08:58:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:58:25.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:58:25.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:24 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:58:25.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:58:25.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:24 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T08:58:25.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:24 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T08:58:25.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:24 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:58:25.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18842.994215 secs 2023-05-08T08:58:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:24 smithi186 ceph-mon[126480]: pgmap v10107: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 124 KiB/s wr, 8 op/s 2023-05-08T08:58:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18843.551014 secs 2023-05-08T08:58:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:58:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:58:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:24 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:58:25.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:58:25.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:24 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T08:58:25.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:24 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T08:58:25.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:24 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:58:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18844.836181 secs 2023-05-08T08:58:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18844.836181 secs 2023-05-08T08:58:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18844.836181 secs 2023-05-08T08:58:26.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:26 smithi133 ceph-mon[125939]: pgmap v10108: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 155 KiB/s wr, 7 op/s 2023-05-08T08:58:27.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:26 smithi096 ceph-mon[124666]: pgmap v10108: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 155 KiB/s wr, 7 op/s 2023-05-08T08:58:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:26 smithi186 ceph-mon[126480]: pgmap v10108: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 155 KiB/s wr, 7 op/s 2023-05-08T08:58:29.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:28 smithi096 ceph-mon[124666]: pgmap v10109: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 155 KiB/s wr, 7 op/s 2023-05-08T08:58:29.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:28 smithi186 ceph-mon[126480]: pgmap v10109: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 155 KiB/s wr, 7 op/s 2023-05-08T08:58:29.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:28 smithi133 ceph-mon[125939]: pgmap v10109: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 155 KiB/s wr, 7 op/s 2023-05-08T08:58:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18847.994362 secs 2023-05-08T08:58:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18848.551151 secs 2023-05-08T08:58:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18847.994362 secs 2023-05-08T08:58:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18848.551151 secs 2023-05-08T08:58:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18847.994362 secs 2023-05-08T08:58:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18848.551151 secs 2023-05-08T08:58:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:30 smithi096 ceph-mon[124666]: pgmap v10110: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 167 KiB/s wr, 9 op/s 2023-05-08T08:58:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18849.836316 secs 2023-05-08T08:58:31.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:30 smithi186 ceph-mon[126480]: pgmap v10110: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 167 KiB/s wr, 9 op/s 2023-05-08T08:58:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18849.836316 secs 2023-05-08T08:58:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:30 smithi133 ceph-mon[125939]: pgmap v10110: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 167 KiB/s wr, 9 op/s 2023-05-08T08:58:31.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18849.836316 secs 2023-05-08T08:58:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:32 smithi096 ceph-mon[124666]: pgmap v10111: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 120 KiB/s wr, 6 op/s 2023-05-08T08:58:33.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:32 smithi186 ceph-mon[126480]: pgmap v10111: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 120 KiB/s wr, 6 op/s 2023-05-08T08:58:33.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:32 smithi133 ceph-mon[125939]: pgmap v10111: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 120 KiB/s wr, 6 op/s 2023-05-08T08:58:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18852.994436 secs 2023-05-08T08:58:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:34 smithi186 ceph-mon[126480]: pgmap v10112: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 120 KiB/s wr, 6 op/s 2023-05-08T08:58:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18853.551289 secs 2023-05-08T08:58:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18852.994436 secs 2023-05-08T08:58:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:34 smithi133 ceph-mon[125939]: pgmap v10112: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 120 KiB/s wr, 6 op/s 2023-05-08T08:58:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18853.551289 secs 2023-05-08T08:58:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18852.994436 secs 2023-05-08T08:58:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:34 smithi096 ceph-mon[124666]: pgmap v10112: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 120 KiB/s wr, 6 op/s 2023-05-08T08:58:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18853.551289 secs 2023-05-08T08:58:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18854.836472 secs 2023-05-08T08:58:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18854.836472 secs 2023-05-08T08:58:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18854.836472 secs 2023-05-08T08:58:37.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:36 smithi186 ceph-mon[126480]: pgmap v10113: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 120 KiB/s wr, 9 op/s 2023-05-08T08:58:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:36 smithi133 ceph-mon[125939]: pgmap v10113: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 120 KiB/s wr, 9 op/s 2023-05-08T08:58:37.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:36 smithi096 ceph-mon[124666]: pgmap v10113: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 120 KiB/s wr, 9 op/s 2023-05-08T08:58:39.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:38 smithi186 ceph-mon[126480]: pgmap v10114: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 38 KiB/s wr, 6 op/s 2023-05-08T08:58:39.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:38 smithi133 ceph-mon[125939]: pgmap v10114: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 38 KiB/s wr, 6 op/s 2023-05-08T08:58:39.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:38 smithi096 ceph-mon[124666]: pgmap v10114: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 38 KiB/s wr, 6 op/s 2023-05-08T08:58:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18857.994502 secs 2023-05-08T08:58:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18858.551403 secs 2023-05-08T08:58:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18857.994502 secs 2023-05-08T08:58:40.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18858.551403 secs 2023-05-08T08:58:40.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18857.994502 secs 2023-05-08T08:58:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18858.551403 secs 2023-05-08T08:58:41.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:40 smithi186 ceph-mon[126480]: pgmap v10115: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 73 KiB/s wr, 10 op/s 2023-05-08T08:58:41.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:40 smithi133 ceph-mon[125939]: pgmap v10115: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 73 KiB/s wr, 10 op/s 2023-05-08T08:58:41.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:40 smithi096 ceph-mon[124666]: pgmap v10115: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 73 KiB/s wr, 10 op/s 2023-05-08T08:58:43.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:42 smithi186 ceph-mon[126480]: pgmap v10116: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 120 KiB/s wr, 6 op/s 2023-05-08T08:58:43.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:42 smithi133 ceph-mon[125939]: pgmap v10116: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 120 KiB/s wr, 6 op/s 2023-05-08T08:58:43.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:42 smithi096 ceph-mon[124666]: pgmap v10116: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 120 KiB/s wr, 6 op/s 2023-05-08T08:58:44.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:58:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:58:44.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:58:45.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18862.994584 secs 2023-05-08T08:58:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:44 smithi186 ceph-mon[126480]: pgmap v10117: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 120 KiB/s wr, 6 op/s 2023-05-08T08:58:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:58:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:58:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:58:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18862.994584 secs 2023-05-08T08:58:45.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:44 smithi133 ceph-mon[125939]: pgmap v10117: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 120 KiB/s wr, 6 op/s 2023-05-08T08:58:45.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:58:45.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:58:45.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:58:45.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18862.994584 secs 2023-05-08T08:58:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:44 smithi096 ceph-mon[124666]: pgmap v10117: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 120 KiB/s wr, 6 op/s 2023-05-08T08:58:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:58:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:58:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:58:47.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:46 smithi186 ceph-mon[126480]: pgmap v10118: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 399 KiB/s wr, 13 op/s 2023-05-08T08:58:47.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:46 smithi133 ceph-mon[125939]: pgmap v10118: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 399 KiB/s wr, 13 op/s 2023-05-08T08:58:47.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:46 smithi096 ceph-mon[124666]: pgmap v10118: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 399 KiB/s wr, 13 op/s 2023-05-08T08:58:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:58:48.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:58:48.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:58:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:48 smithi186 ceph-mon[126480]: pgmap v10119: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 398 KiB/s wr, 10 op/s 2023-05-08T08:58:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:58:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:58:49.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:48 smithi133 ceph-mon[125939]: pgmap v10119: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 398 KiB/s wr, 10 op/s 2023-05-08T08:58:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:58:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:58:49.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:48 smithi096 ceph-mon[124666]: pgmap v10119: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 398 KiB/s wr, 10 op/s 2023-05-08T08:58:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:58:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:58:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18867.994664 secs 2023-05-08T08:58:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18867.994664 secs 2023-05-08T08:58:50.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18867.994664 secs 2023-05-08T08:58:51.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:50 smithi186 ceph-mon[126480]: pgmap v10120: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 550 KiB/s rd, 444 KiB/s wr, 51 op/s 2023-05-08T08:58:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18869.836858 secs 2023-05-08T08:58:51.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:50 smithi133 ceph-mon[125939]: pgmap v10120: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 550 KiB/s rd, 444 KiB/s wr, 51 op/s 2023-05-08T08:58:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18869.836858 secs 2023-05-08T08:58:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:50 smithi096 ceph-mon[124666]: pgmap v10120: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 550 KiB/s rd, 444 KiB/s wr, 51 op/s 2023-05-08T08:58:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18869.836858 secs 2023-05-08T08:58:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:51 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:58:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:58:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:58:52.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:51 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:58:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:58:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:58:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:51 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:58:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:58:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:58:53.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:52 smithi186 ceph-mon[126480]: pgmap v10121: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 528 KiB/s rd, 409 KiB/s wr, 48 op/s 2023-05-08T08:58:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:52 smithi133 ceph-mon[125939]: pgmap v10121: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 528 KiB/s rd, 409 KiB/s wr, 48 op/s 2023-05-08T08:58:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:52 smithi096 ceph-mon[124666]: pgmap v10121: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 528 KiB/s rd, 409 KiB/s wr, 48 op/s 2023-05-08T08:58:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18872.994794 secs 2023-05-08T08:58:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:54 smithi186 ceph-mon[126480]: pgmap v10122: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 324 KiB/s wr, 48 op/s 2023-05-08T08:58:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18873.551680 secs 2023-05-08T08:58:55.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18872.994794 secs 2023-05-08T08:58:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:54 smithi133 ceph-mon[125939]: pgmap v10122: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 324 KiB/s wr, 48 op/s 2023-05-08T08:58:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18873.551680 secs 2023-05-08T08:58:55.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18872.994794 secs 2023-05-08T08:58:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:54 smithi096 ceph-mon[124666]: pgmap v10122: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 324 KiB/s wr, 48 op/s 2023-05-08T08:58:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18873.551680 secs 2023-05-08T08:58:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18874.836975 secs 2023-05-08T08:58:56.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18874.836975 secs 2023-05-08T08:58:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18874.836975 secs 2023-05-08T08:58:57.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:56 smithi133 ceph-mon[125939]: pgmap v10123: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 654 KiB/s rd, 560 KiB/s wr, 52 op/s 2023-05-08T08:58:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:58:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:58:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:56 smithi096 ceph-mon[124666]: pgmap v10123: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 654 KiB/s rd, 560 KiB/s wr, 52 op/s 2023-05-08T08:58:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:58:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:58:57.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:56 smithi186 ceph-mon[126480]: pgmap v10123: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 654 KiB/s rd, 560 KiB/s wr, 52 op/s 2023-05-08T08:58:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:58:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:58:58.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:57 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:58:58.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:57 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:58:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:57 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:58:59.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:58 smithi133 ceph-mon[125939]: pgmap v10124: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 281 KiB/s wr, 46 op/s 2023-05-08T08:58:59.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:58 smithi096 ceph-mon[124666]: pgmap v10124: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 281 KiB/s wr, 46 op/s 2023-05-08T08:58:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:58 smithi186 ceph-mon[126480]: pgmap v10124: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 281 KiB/s wr, 46 op/s 2023-05-08T08:59:00.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18877.994953 secs 2023-05-08T08:59:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:58:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18878.551773 secs 2023-05-08T08:59:00.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18877.994953 secs 2023-05-08T08:59:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:58:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18878.551773 secs 2023-05-08T08:59:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18877.994953 secs 2023-05-08T08:59:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:58:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18878.551773 secs 2023-05-08T08:59:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:00 smithi133 ceph-mon[125939]: pgmap v10125: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 352 KiB/s wr, 50 op/s 2023-05-08T08:59:01.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18879.837094 secs 2023-05-08T08:59:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:00 smithi096 ceph-mon[124666]: pgmap v10125: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 352 KiB/s wr, 50 op/s 2023-05-08T08:59:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18879.837094 secs 2023-05-08T08:59:01.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:00 smithi186 ceph-mon[126480]: pgmap v10125: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 352 KiB/s wr, 50 op/s 2023-05-08T08:59:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18879.837094 secs 2023-05-08T08:59:03.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:02 smithi133 ceph-mon[125939]: pgmap v10126: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 307 KiB/s wr, 9 op/s 2023-05-08T08:59:03.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:02 smithi096 ceph-mon[124666]: pgmap v10126: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 307 KiB/s wr, 9 op/s 2023-05-08T08:59:03.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:02 smithi186 ceph-mon[126480]: pgmap v10126: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 307 KiB/s wr, 9 op/s 2023-05-08T08:59:05.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18882.995094 secs 2023-05-08T08:59:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:04 smithi133 ceph-mon[125939]: pgmap v10127: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 307 KiB/s wr, 9 op/s 2023-05-08T08:59:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18883.551889 secs 2023-05-08T08:59:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18882.995094 secs 2023-05-08T08:59:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:04 smithi096 ceph-mon[124666]: pgmap v10127: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 307 KiB/s wr, 9 op/s 2023-05-08T08:59:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18883.551889 secs 2023-05-08T08:59:05.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18882.995094 secs 2023-05-08T08:59:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:04 smithi186 ceph-mon[126480]: pgmap v10127: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 307 KiB/s wr, 9 op/s 2023-05-08T08:59:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18883.551889 secs 2023-05-08T08:59:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18884.837214 secs 2023-05-08T08:59:06.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18884.837214 secs 2023-05-08T08:59:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18884.837214 secs 2023-05-08T08:59:07.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:06 smithi133 ceph-mon[125939]: pgmap v10128: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 532 KiB/s rd, 578 KiB/s wr, 29 op/s 2023-05-08T08:59:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:06 smithi133 ceph-mon[125939]: osdmap e710: 12 total, 12 up, 12 in 2023-05-08T08:59:07.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:06 smithi096 ceph-mon[124666]: pgmap v10128: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 532 KiB/s rd, 578 KiB/s wr, 29 op/s 2023-05-08T08:59:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:06 smithi096 ceph-mon[124666]: osdmap e710: 12 total, 12 up, 12 in 2023-05-08T08:59:07.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:06 smithi186 ceph-mon[126480]: pgmap v10128: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 532 KiB/s rd, 578 KiB/s wr, 29 op/s 2023-05-08T08:59:07.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:06 smithi186 ceph-mon[126480]: osdmap e710: 12 total, 12 up, 12 in 2023-05-08T08:59:09.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:08 smithi133 ceph-mon[125939]: pgmap v10130: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 410 KiB/s wr, 29 op/s 2023-05-08T08:59:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18887.995222 secs 2023-05-08T08:59:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:08 smithi096 ceph-mon[124666]: pgmap v10130: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 410 KiB/s wr, 29 op/s 2023-05-08T08:59:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18887.995222 secs 2023-05-08T08:59:09.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:08 smithi186 ceph-mon[126480]: pgmap v10130: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 410 KiB/s wr, 29 op/s 2023-05-08T08:59:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18887.995222 secs 2023-05-08T08:59:10.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18888.551986 secs 2023-05-08T08:59:10.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18888.551986 secs 2023-05-08T08:59:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18888.551986 secs 2023-05-08T08:59:11.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:10 smithi133 ceph-mon[125939]: pgmap v10131: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 395 KiB/s wr, 28 op/s 2023-05-08T08:59:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18889.837353 secs 2023-05-08T08:59:11.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:10 smithi096 ceph-mon[124666]: pgmap v10131: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 395 KiB/s wr, 28 op/s 2023-05-08T08:59:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18889.837353 secs 2023-05-08T08:59:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:10 smithi186 ceph-mon[126480]: pgmap v10131: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 395 KiB/s wr, 28 op/s 2023-05-08T08:59:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18889.837353 secs 2023-05-08T08:59:13.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:12 smithi133 ceph-mon[125939]: pgmap v10132: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 395 KiB/s wr, 28 op/s 2023-05-08T08:59:13.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:12 smithi133 ceph-mon[125939]: osdmap e711: 12 total, 12 up, 12 in 2023-05-08T08:59:13.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:12 smithi096 ceph-mon[124666]: pgmap v10132: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 395 KiB/s wr, 28 op/s 2023-05-08T08:59:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:12 smithi096 ceph-mon[124666]: osdmap e711: 12 total, 12 up, 12 in 2023-05-08T08:59:13.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:12 smithi186 ceph-mon[126480]: pgmap v10132: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 395 KiB/s wr, 28 op/s 2023-05-08T08:59:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:12 smithi186 ceph-mon[126480]: osdmap e711: 12 total, 12 up, 12 in 2023-05-08T08:59:14.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18892.995362 secs 2023-05-08T08:59:14.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18892.995362 secs 2023-05-08T08:59:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18892.995362 secs 2023-05-08T08:59:15.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:14 smithi133 ceph-mon[125939]: pgmap v10134: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 87 KiB/s wr, 5 op/s 2023-05-08T08:59:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18893.552098 secs 2023-05-08T08:59:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:14 smithi096 ceph-mon[124666]: pgmap v10134: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 87 KiB/s wr, 5 op/s 2023-05-08T08:59:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18893.552098 secs 2023-05-08T08:59:15.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:14 smithi186 ceph-mon[126480]: pgmap v10134: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 87 KiB/s wr, 5 op/s 2023-05-08T08:59:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18893.552098 secs 2023-05-08T08:59:16.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18894.837470 secs 2023-05-08T08:59:16.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18894.837470 secs 2023-05-08T08:59:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18894.837470 secs 2023-05-08T08:59:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:16 smithi133 ceph-mon[125939]: pgmap v10135: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 161 KiB/s wr, 9 op/s 2023-05-08T08:59:17.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:16 smithi096 ceph-mon[124666]: pgmap v10135: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 161 KiB/s wr, 9 op/s 2023-05-08T08:59:17.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:16 smithi186 ceph-mon[126480]: pgmap v10135: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 161 KiB/s wr, 9 op/s 2023-05-08T08:59:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:18 smithi133 ceph-mon[125939]: pgmap v10136: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 158 KiB/s wr, 8 op/s 2023-05-08T08:59:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18897.995483 secs 2023-05-08T08:59:19.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:18 smithi096 ceph-mon[124666]: pgmap v10136: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 158 KiB/s wr, 8 op/s 2023-05-08T08:59:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18897.995483 secs 2023-05-08T08:59:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:18 smithi186 ceph-mon[126480]: pgmap v10136: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 158 KiB/s wr, 8 op/s 2023-05-08T08:59:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18897.995483 secs 2023-05-08T08:59:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18898.552213 secs 2023-05-08T08:59:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18898.552213 secs 2023-05-08T08:59:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18898.552213 secs 2023-05-08T08:59:21.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:20 smithi133 ceph-mon[125939]: pgmap v10137: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 89 KiB/s wr, 7 op/s 2023-05-08T08:59:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18899.837548 secs 2023-05-08T08:59:21.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:20 smithi096 ceph-mon[124666]: pgmap v10137: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 89 KiB/s wr, 7 op/s 2023-05-08T08:59:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18899.837548 secs 2023-05-08T08:59:21.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:20 smithi186 ceph-mon[126480]: pgmap v10137: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 89 KiB/s wr, 7 op/s 2023-05-08T08:59:21.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18899.837548 secs 2023-05-08T08:59:23.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:22 smithi133 ceph-mon[125939]: pgmap v10138: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 89 KiB/s wr, 7 op/s 2023-05-08T08:59:23.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:22 smithi096 ceph-mon[124666]: pgmap v10138: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 89 KiB/s wr, 7 op/s 2023-05-08T08:59:23.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:22 smithi186 ceph-mon[126480]: pgmap v10138: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 89 KiB/s wr, 7 op/s 2023-05-08T08:59:24.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18902.995605 secs 2023-05-08T08:59:24.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18902.995605 secs 2023-05-08T08:59:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18902.995605 secs 2023-05-08T08:59:25.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:24 smithi133 ceph-mon[125939]: pgmap v10139: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 81 KiB/s wr, 7 op/s 2023-05-08T08:59:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18903.552325 secs 2023-05-08T08:59:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:59:25.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:24 smithi096 ceph-mon[124666]: pgmap v10139: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 81 KiB/s wr, 7 op/s 2023-05-08T08:59:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18903.552325 secs 2023-05-08T08:59:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:59:25.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:24 smithi186 ceph-mon[126480]: pgmap v10139: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 81 KiB/s wr, 7 op/s 2023-05-08T08:59:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18903.552325 secs 2023-05-08T08:59:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T08:59:26.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18904.837681 secs 2023-05-08T08:59:26.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18904.837681 secs 2023-05-08T08:59:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18904.837681 secs 2023-05-08T08:59:27.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:26 smithi133 ceph-mon[125939]: pgmap v10140: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 113 KiB/s wr, 10 op/s 2023-05-08T08:59:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:59:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:59:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:59:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:59:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:59:27.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:59:27.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:26 smithi096 ceph-mon[124666]: pgmap v10140: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 113 KiB/s wr, 10 op/s 2023-05-08T08:59:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:59:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:59:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:59:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:59:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:59:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:59:27.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:26 smithi186 ceph-mon[126480]: pgmap v10140: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 113 KiB/s wr, 10 op/s 2023-05-08T08:59:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:59:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:59:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:59:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:59:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:59:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:59:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:59:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:59:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:59:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:59:28.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:27 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T08:59:28.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:27 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T08:59:28.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:59:28.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:59:28.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:59:28.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:59:28.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:27 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi096 to 36579k 2023-05-08T08:59:28.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:27 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi096 to 37457727: error parsing value: Value '37457727' is below minimum 939524096 2023-05-08T08:59:28.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:59:28.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:59:28.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:59:28.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:59:28.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:27 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T08:59:28.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:27 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T08:59:28.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:59:28.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:59:28.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:27 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:59:28.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:59:28.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:27 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T08:59:28.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:27 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T08:59:28.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:27 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T08:59:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:59:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:59:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:59:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:59:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:27 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T08:59:28.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:27 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T08:59:28.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:59:28.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:59:28.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:59:28.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:59:28.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:27 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi096 to 36579k 2023-05-08T08:59:28.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:27 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi096 to 37457727: error parsing value: Value '37457727' is below minimum 939524096 2023-05-08T08:59:28.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:59:28.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:59:28.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:59:28.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:59:28.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:27 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T08:59:28.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:27 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T08:59:28.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:59:28.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:59:28.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:27 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:59:28.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:59:28.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:27 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T08:59:28.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:27 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T08:59:28.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:27 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T08:59:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:59:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:59:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:59:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:59:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:27 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T08:59:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:27 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T08:59:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:59:28.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:59:28.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:59:28.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:59:28.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:27 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi096 to 36579k 2023-05-08T08:59:28.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:27 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi096 to 37457727: error parsing value: Value '37457727' is below minimum 939524096 2023-05-08T08:59:28.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:59:28.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:59:28.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:59:28.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T08:59:28.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:27 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T08:59:28.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:27 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T08:59:28.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T08:59:28.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T08:59:28.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:27 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:59:28.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T08:59:28.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:27 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T08:59:28.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:27 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T08:59:28.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:27 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T08:59:29.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:29 smithi133 ceph-mon[125939]: pgmap v10141: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 39 KiB/s wr, 6 op/s 2023-05-08T08:59:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18907.995719 secs 2023-05-08T08:59:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18908.552440 secs 2023-05-08T08:59:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:29 smithi096 ceph-mon[124666]: pgmap v10141: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 39 KiB/s wr, 6 op/s 2023-05-08T08:59:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18907.995719 secs 2023-05-08T08:59:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18908.552440 secs 2023-05-08T08:59:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:29 smithi186 ceph-mon[126480]: pgmap v10141: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 39 KiB/s wr, 6 op/s 2023-05-08T08:59:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18907.995719 secs 2023-05-08T08:59:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18908.552440 secs 2023-05-08T08:59:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:31 smithi133 ceph-mon[125939]: pgmap v10142: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 160 KiB/s wr, 10 op/s 2023-05-08T08:59:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18909.837821 secs 2023-05-08T08:59:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:31 smithi096 ceph-mon[124666]: pgmap v10142: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 160 KiB/s wr, 10 op/s 2023-05-08T08:59:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18909.837821 secs 2023-05-08T08:59:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:31 smithi186 ceph-mon[126480]: pgmap v10142: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 160 KiB/s wr, 10 op/s 2023-05-08T08:59:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18909.837821 secs 2023-05-08T08:59:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:33 smithi133 ceph-mon[125939]: pgmap v10143: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 160 KiB/s wr, 7 op/s 2023-05-08T08:59:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:33 smithi096 ceph-mon[124666]: pgmap v10143: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 160 KiB/s wr, 7 op/s 2023-05-08T08:59:33.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:33 smithi186 ceph-mon[126480]: pgmap v10143: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 160 KiB/s wr, 7 op/s 2023-05-08T08:59:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18912.995829 secs 2023-05-08T08:59:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18913.552575 secs 2023-05-08T08:59:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18912.995829 secs 2023-05-08T08:59:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18913.552575 secs 2023-05-08T08:59:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18912.995829 secs 2023-05-08T08:59:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18913.552575 secs 2023-05-08T08:59:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:35 smithi096 ceph-mon[124666]: pgmap v10144: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 160 KiB/s wr, 7 op/s 2023-05-08T08:59:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:35 smithi186 ceph-mon[126480]: pgmap v10144: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 160 KiB/s wr, 7 op/s 2023-05-08T08:59:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:35 smithi133 ceph-mon[125939]: pgmap v10144: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 160 KiB/s wr, 7 op/s 2023-05-08T08:59:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18914.837885 secs 2023-05-08T08:59:36.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18914.837885 secs 2023-05-08T08:59:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18914.837885 secs 2023-05-08T08:59:37.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:37 smithi186 ceph-mon[126480]: pgmap v10145: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 160 KiB/s wr, 11 op/s 2023-05-08T08:59:37.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:37 smithi133 ceph-mon[125939]: pgmap v10145: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 160 KiB/s wr, 11 op/s 2023-05-08T08:59:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:37 smithi096 ceph-mon[124666]: pgmap v10145: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 160 KiB/s wr, 11 op/s 2023-05-08T08:59:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:39 smithi186 ceph-mon[126480]: pgmap v10146: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 122 KiB/s wr, 7 op/s 2023-05-08T08:59:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18917.995919 secs 2023-05-08T08:59:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18918.552708 secs 2023-05-08T08:59:39.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:39 smithi133 ceph-mon[125939]: pgmap v10146: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 122 KiB/s wr, 7 op/s 2023-05-08T08:59:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18917.995919 secs 2023-05-08T08:59:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18918.552708 secs 2023-05-08T08:59:40.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:39 smithi096 ceph-mon[124666]: pgmap v10146: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 122 KiB/s wr, 7 op/s 2023-05-08T08:59:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18917.995919 secs 2023-05-08T08:59:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18918.552708 secs 2023-05-08T08:59:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:41 smithi186 ceph-mon[126480]: pgmap v10147: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 122 KiB/s wr, 10 op/s 2023-05-08T08:59:41.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:41 smithi133 ceph-mon[125939]: pgmap v10147: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 122 KiB/s wr, 10 op/s 2023-05-08T08:59:42.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:41 smithi096 ceph-mon[124666]: pgmap v10147: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 122 KiB/s wr, 10 op/s 2023-05-08T08:59:43.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:43 smithi186 ceph-mon[126480]: pgmap v10148: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 767 B/s wr, 6 op/s 2023-05-08T08:59:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:59:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:43 smithi133 ceph-mon[125939]: pgmap v10148: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 767 B/s wr, 6 op/s 2023-05-08T08:59:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:59:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:43 smithi096 ceph-mon[124666]: pgmap v10148: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 767 B/s wr, 6 op/s 2023-05-08T08:59:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:59:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18922.996017 secs 2023-05-08T08:59:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:59:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:59:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:59:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18923.552770 secs 2023-05-08T08:59:44.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18922.996017 secs 2023-05-08T08:59:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:59:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:59:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:59:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18923.552770 secs 2023-05-08T08:59:45.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18922.996017 secs 2023-05-08T08:59:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:59:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:59:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:59:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18923.552770 secs 2023-05-08T08:59:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:45 smithi186 ceph-mon[126480]: pgmap v10149: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 767 B/s wr, 6 op/s 2023-05-08T08:59:45.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:45 smithi133 ceph-mon[125939]: pgmap v10149: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 767 B/s wr, 6 op/s 2023-05-08T08:59:46.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:45 smithi096 ceph-mon[124666]: pgmap v10149: 97 pgs: 97 active+clean; 6.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 767 B/s wr, 6 op/s 2023-05-08T08:59:47.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:47 smithi186 ceph-mon[126480]: pgmap v10150: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 60 KiB/s wr, 9 op/s 2023-05-08T08:59:47.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:47 smithi133 ceph-mon[125939]: pgmap v10150: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 60 KiB/s wr, 9 op/s 2023-05-08T08:59:48.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:47 smithi096 ceph-mon[124666]: pgmap v10150: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 60 KiB/s wr, 9 op/s 2023-05-08T08:59:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:49 smithi186 ceph-mon[126480]: pgmap v10151: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 59 KiB/s wr, 5 op/s 2023-05-08T08:59:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18927.996103 secs 2023-05-08T08:59:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:49 smithi133 ceph-mon[125939]: pgmap v10151: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 59 KiB/s wr, 5 op/s 2023-05-08T08:59:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18927.996103 secs 2023-05-08T08:59:50.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:49 smithi096 ceph-mon[124666]: pgmap v10151: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 59 KiB/s wr, 5 op/s 2023-05-08T08:59:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18927.996103 secs 2023-05-08T08:59:51.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:51 smithi186 ceph-mon[126480]: pgmap v10152: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 185 KiB/s wr, 9 op/s 2023-05-08T08:59:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:59:51.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:51 smithi133 ceph-mon[125939]: pgmap v10152: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 185 KiB/s wr, 9 op/s 2023-05-08T08:59:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:59:52.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:51 smithi096 ceph-mon[124666]: pgmap v10152: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 185 KiB/s wr, 9 op/s 2023-05-08T08:59:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T08:59:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:52 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:59:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:59:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:59:52.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:52 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:59:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:59:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:59:53.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:52 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:59:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T08:59:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:59:53.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:53 smithi186 ceph-mon[126480]: pgmap v10153: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 185 KiB/s wr, 7 op/s 2023-05-08T08:59:53.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:53 smithi133 ceph-mon[125939]: pgmap v10153: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 185 KiB/s wr, 7 op/s 2023-05-08T08:59:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:53 smithi096 ceph-mon[124666]: pgmap v10153: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 185 KiB/s wr, 7 op/s 2023-05-08T08:59:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18932.996242 secs 2023-05-08T08:59:54.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18932.996242 secs 2023-05-08T08:59:55.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18932.996242 secs 2023-05-08T08:59:55.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:55 smithi186 ceph-mon[126480]: pgmap v10154: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 185 KiB/s wr, 7 op/s 2023-05-08T08:59:55.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:55 smithi133 ceph-mon[125939]: pgmap v10154: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 185 KiB/s wr, 7 op/s 2023-05-08T08:59:56.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:55 smithi096 ceph-mon[124666]: pgmap v10154: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 185 KiB/s wr, 7 op/s 2023-05-08T08:59:56.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18934.838344 secs 2023-05-08T08:59:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:59:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:59:56.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18934.838344 secs 2023-05-08T08:59:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:59:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:59:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18934.838344 secs 2023-05-08T08:59:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T08:59:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T08:59:57.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:57 smithi186 ceph-mon[126480]: pgmap v10155: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 402 KiB/s wr, 12 op/s 2023-05-08T08:59:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:57 smithi133 ceph-mon[125939]: pgmap v10155: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 402 KiB/s wr, 12 op/s 2023-05-08T08:59:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:57 smithi096 ceph-mon[124666]: pgmap v10155: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 402 KiB/s wr, 12 op/s 2023-05-08T08:59:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:58 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:59:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:58 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:59:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:58 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T08:59:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:59 smithi186 ceph-mon[126480]: pgmap v10156: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 343 KiB/s wr, 9 op/s 2023-05-08T08:59:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18937.996377 secs 2023-05-08T08:59:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 08:59:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18938.553145 secs 2023-05-08T08:59:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:59 smithi133 ceph-mon[125939]: pgmap v10156: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 343 KiB/s wr, 9 op/s 2023-05-08T08:59:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18937.996377 secs 2023-05-08T08:59:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 08:59:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18938.553145 secs 2023-05-08T09:00:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:59 smithi096 ceph-mon[124666]: pgmap v10156: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 343 KiB/s wr, 9 op/s 2023-05-08T09:00:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18937.996377 secs 2023-05-08T09:00:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 08:59:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18938.553145 secs 2023-05-08T09:00:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:00:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:00:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:00 smithi186 ceph-mon[126480]: Health detail: HEALTH_WARN 3 MDSs report slow requests 2023-05-08T09:00:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:00 smithi186 ceph-mon[126480]: [WRN] MDS_SLOW_REQUEST: 3 MDSs report slow requests 2023-05-08T09:00:00.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:00 smithi186 ceph-mon[126480]: mds.c(mds.2): 1 slow requests are blocked > 180 secs 2023-05-08T09:00:00.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:00 smithi186 ceph-mon[126480]: mds.i(mds.1): 1 slow requests are blocked > 180 secs 2023-05-08T09:00:00.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:00 smithi186 ceph-mon[126480]: mds.b(mds.0): 1 slow requests are blocked > 180 secs 2023-05-08T09:00:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:00:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:00:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:00 smithi133 ceph-mon[125939]: Health detail: HEALTH_WARN 3 MDSs report slow requests 2023-05-08T09:00:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:00 smithi133 ceph-mon[125939]: [WRN] MDS_SLOW_REQUEST: 3 MDSs report slow requests 2023-05-08T09:00:00.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:00 smithi133 ceph-mon[125939]: mds.c(mds.2): 1 slow requests are blocked > 180 secs 2023-05-08T09:00:00.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:00 smithi133 ceph-mon[125939]: mds.i(mds.1): 1 slow requests are blocked > 180 secs 2023-05-08T09:00:00.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:00 smithi133 ceph-mon[125939]: mds.b(mds.0): 1 slow requests are blocked > 180 secs 2023-05-08T09:00:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:00:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:00:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:00 smithi096 ceph-mon[124666]: Health detail: HEALTH_WARN 3 MDSs report slow requests 2023-05-08T09:00:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:00 smithi096 ceph-mon[124666]: [WRN] MDS_SLOW_REQUEST: 3 MDSs report slow requests 2023-05-08T09:00:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:00 smithi096 ceph-mon[124666]: mds.c(mds.2): 1 slow requests are blocked > 180 secs 2023-05-08T09:00:01.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:00 smithi096 ceph-mon[124666]: mds.i(mds.1): 1 slow requests are blocked > 180 secs 2023-05-08T09:00:01.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:00 smithi096 ceph-mon[124666]: mds.b(mds.0): 1 slow requests are blocked > 180 secs 2023-05-08T09:00:01.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:01 smithi186 ceph-mon[126480]: pgmap v10157: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 423 KiB/s wr, 14 op/s 2023-05-08T09:00:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18939.838437 secs 2023-05-08T09:00:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:01 smithi133 ceph-mon[125939]: pgmap v10157: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 423 KiB/s wr, 14 op/s 2023-05-08T09:00:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18939.838437 secs 2023-05-08T09:00:02.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:01 smithi096 ceph-mon[124666]: pgmap v10157: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 423 KiB/s wr, 14 op/s 2023-05-08T09:00:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18939.838437 secs 2023-05-08T09:00:03.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:03 smithi186 ceph-mon[126480]: pgmap v10158: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 296 KiB/s wr, 10 op/s 2023-05-08T09:00:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:03 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:00:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:03 smithi133 ceph-mon[125939]: pgmap v10158: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 296 KiB/s wr, 10 op/s 2023-05-08T09:00:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:03 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:00:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:03 smithi096 ceph-mon[124666]: pgmap v10158: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 296 KiB/s wr, 10 op/s 2023-05-08T09:00:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:03 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:00:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18942.996455 secs 2023-05-08T09:00:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18943.553260 secs 2023-05-08T09:00:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18942.996455 secs 2023-05-08T09:00:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18943.553260 secs 2023-05-08T09:00:05.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18942.996455 secs 2023-05-08T09:00:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18943.553260 secs 2023-05-08T09:00:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:05 smithi186 ceph-mon[126480]: pgmap v10159: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 296 KiB/s wr, 9 op/s 2023-05-08T09:00:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:05 smithi133 ceph-mon[125939]: pgmap v10159: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 296 KiB/s wr, 9 op/s 2023-05-08T09:00:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:05 smithi096 ceph-mon[124666]: pgmap v10159: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 296 KiB/s wr, 9 op/s 2023-05-08T09:00:07.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:07 smithi133 ceph-mon[125939]: pgmap v10160: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 543 KiB/s wr, 26 op/s 2023-05-08T09:00:07.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:07 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:00:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:07 smithi096 ceph-mon[124666]: pgmap v10160: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 543 KiB/s wr, 26 op/s 2023-05-08T09:00:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:07 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:00:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:07 smithi186 ceph-mon[126480]: pgmap v10160: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 543 KiB/s wr, 26 op/s 2023-05-08T09:00:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:07 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:00:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:00:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:00:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:08 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:00:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:00:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:00:09.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:08 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:00:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:00:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:00:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:08 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:00:09.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:09 smithi133 ceph-mon[125939]: pgmap v10161: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 326 KiB/s wr, 21 op/s 2023-05-08T09:00:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18947.996574 secs 2023-05-08T09:00:10.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:09 smithi096 ceph-mon[124666]: pgmap v10161: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 326 KiB/s wr, 21 op/s 2023-05-08T09:00:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18947.996574 secs 2023-05-08T09:00:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:09 smithi186 ceph-mon[126480]: pgmap v10161: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 326 KiB/s wr, 21 op/s 2023-05-08T09:00:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18947.996574 secs 2023-05-08T09:00:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:11 smithi133 ceph-mon[125939]: pgmap v10162: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 463 KiB/s wr, 25 op/s 2023-05-08T09:00:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:11 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:00:12.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:11 smithi096 ceph-mon[124666]: pgmap v10162: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 463 KiB/s wr, 25 op/s 2023-05-08T09:00:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:11 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:00:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:11 smithi186 ceph-mon[126480]: pgmap v10162: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 463 KiB/s wr, 25 op/s 2023-05-08T09:00:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:11 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:00:12.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:12 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:00:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:12 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:00:13.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:12 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:00:13.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:12 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:00:13.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:12 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:00:13.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:12 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:00:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:13 smithi133 ceph-mon[125939]: pgmap v10163: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 359 KiB/s rd, 384 KiB/s wr, 21 op/s 2023-05-08T09:00:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:13 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:00:14.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:13 smithi096 ceph-mon[124666]: pgmap v10163: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 359 KiB/s rd, 384 KiB/s wr, 21 op/s 2023-05-08T09:00:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:13 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:00:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:13 smithi186 ceph-mon[126480]: pgmap v10163: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 359 KiB/s rd, 384 KiB/s wr, 21 op/s 2023-05-08T09:00:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:13 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:00:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18952.996684 secs 2023-05-08T09:00:15.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18952.996684 secs 2023-05-08T09:00:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18952.996684 secs 2023-05-08T09:00:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:15 smithi133 ceph-mon[125939]: pgmap v10164: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 359 KiB/s rd, 384 KiB/s wr, 21 op/s 2023-05-08T09:00:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:15 smithi096 ceph-mon[124666]: pgmap v10164: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 359 KiB/s rd, 384 KiB/s wr, 21 op/s 2023-05-08T09:00:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:15 smithi186 ceph-mon[126480]: pgmap v10164: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 359 KiB/s rd, 384 KiB/s wr, 21 op/s 2023-05-08T09:00:17.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:17 smithi133 ceph-mon[125939]: pgmap v10165: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 431 KiB/s wr, 24 op/s 2023-05-08T09:00:18.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:17 smithi096 ceph-mon[124666]: pgmap v10165: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 431 KiB/s wr, 24 op/s 2023-05-08T09:00:18.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:17 smithi186 ceph-mon[126480]: pgmap v10165: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 431 KiB/s wr, 24 op/s 2023-05-08T09:00:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:19 smithi133 ceph-mon[125939]: pgmap v10166: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 185 KiB/s wr, 8 op/s 2023-05-08T09:00:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18957.996801 secs 2023-05-08T09:00:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18958.553627 secs 2023-05-08T09:00:20.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:19 smithi096 ceph-mon[124666]: pgmap v10166: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 185 KiB/s wr, 8 op/s 2023-05-08T09:00:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18957.996801 secs 2023-05-08T09:00:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18958.553627 secs 2023-05-08T09:00:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:19 smithi186 ceph-mon[126480]: pgmap v10166: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 185 KiB/s wr, 8 op/s 2023-05-08T09:00:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18957.996801 secs 2023-05-08T09:00:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18958.553627 secs 2023-05-08T09:00:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:20 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:00:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:20 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:00:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:20 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:00:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18959.838979 secs 2023-05-08T09:00:21.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:20 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:00:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:20 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:00:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:20 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:00:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18959.838979 secs 2023-05-08T09:00:21.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:20 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:00:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:20 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:00:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:20 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:00:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18959.838979 secs 2023-05-08T09:00:21.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:21 smithi133 ceph-mon[125939]: pgmap v10167: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 795 KiB/s rd, 453 KiB/s wr, 14 op/s 2023-05-08T09:00:22.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:21 smithi096 ceph-mon[124666]: pgmap v10167: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 795 KiB/s rd, 453 KiB/s wr, 14 op/s 2023-05-08T09:00:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:21 smithi186 ceph-mon[126480]: pgmap v10167: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 795 KiB/s rd, 453 KiB/s wr, 14 op/s 2023-05-08T09:00:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:23 smithi133 ceph-mon[125939]: pgmap v10168: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 316 KiB/s wr, 9 op/s 2023-05-08T09:00:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:23 smithi096 ceph-mon[124666]: pgmap v10168: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 316 KiB/s wr, 9 op/s 2023-05-08T09:00:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:23 smithi186 ceph-mon[126480]: pgmap v10168: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 316 KiB/s wr, 9 op/s 2023-05-08T09:00:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18962.996937 secs 2023-05-08T09:00:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:24 smithi096 ceph-mon[124666]: pgmap v10169: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 316 KiB/s wr, 9 op/s 2023-05-08T09:00:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:24 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:00:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:24 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:00:25.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18963.553742 secs 2023-05-08T09:00:25.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18962.996937 secs 2023-05-08T09:00:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:24 smithi186 ceph-mon[126480]: pgmap v10169: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 316 KiB/s wr, 9 op/s 2023-05-08T09:00:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:24 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:00:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:24 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:00:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18963.553742 secs 2023-05-08T09:00:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18962.996937 secs 2023-05-08T09:00:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:24 smithi133 ceph-mon[125939]: pgmap v10169: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 316 KiB/s wr, 9 op/s 2023-05-08T09:00:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:24 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:00:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:24 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:00:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18963.553742 secs 2023-05-08T09:00:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18964.839103 secs 2023-05-08T09:00:26.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18964.839103 secs 2023-05-08T09:00:26.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18964.839103 secs 2023-05-08T09:00:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:26 smithi186 ceph-mon[126480]: pgmap v10170: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 392 KiB/s wr, 13 op/s 2023-05-08T09:00:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:26 smithi186 ceph-mon[126480]: osdmap e712: 12 total, 12 up, 12 in 2023-05-08T09:00:27.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:26 smithi133 ceph-mon[125939]: pgmap v10170: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 392 KiB/s wr, 13 op/s 2023-05-08T09:00:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:26 smithi133 ceph-mon[125939]: osdmap e712: 12 total, 12 up, 12 in 2023-05-08T09:00:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:26 smithi096 ceph-mon[124666]: pgmap v10170: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 392 KiB/s wr, 13 op/s 2023-05-08T09:00:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:26 smithi096 ceph-mon[124666]: osdmap e712: 12 total, 12 up, 12 in 2023-05-08T09:00:28.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:00:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:27 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:00:28.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:00:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:27 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:00:28.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:00:28.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:27 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:00:29.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:28 smithi186 ceph-mon[126480]: pgmap v10172: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 487 KiB/s rd, 414 KiB/s wr, 12 op/s 2023-05-08T09:00:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:28 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:00:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:28 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:00:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:28 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:00:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:28 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:00:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:28 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T09:00:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:28 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T09:00:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:28 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:00:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:28 smithi133 ceph-mon[125939]: pgmap v10172: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 487 KiB/s rd, 414 KiB/s wr, 12 op/s 2023-05-08T09:00:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:28 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:00:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:28 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:00:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:28 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:00:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:28 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:00:29.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:28 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T09:00:29.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:28 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T09:00:29.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:28 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:00:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:28 smithi096 ceph-mon[124666]: pgmap v10172: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 487 KiB/s rd, 414 KiB/s wr, 12 op/s 2023-05-08T09:00:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:28 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:00:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:28 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:00:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:28 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:00:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:28 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:00:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:28 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T09:00:29.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:28 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T09:00:29.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:28 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:00:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18967.997051 secs 2023-05-08T09:00:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18968.553834 secs 2023-05-08T09:00:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18967.997051 secs 2023-05-08T09:00:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18968.553834 secs 2023-05-08T09:00:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18967.997051 secs 2023-05-08T09:00:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18968.553834 secs 2023-05-08T09:00:31.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:30 smithi186 ceph-mon[126480]: pgmap v10173: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 160 KiB/s wr, 9 op/s 2023-05-08T09:00:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18969.839218 secs 2023-05-08T09:00:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:30 smithi133 ceph-mon[125939]: pgmap v10173: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 160 KiB/s wr, 9 op/s 2023-05-08T09:00:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18969.839218 secs 2023-05-08T09:00:31.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:30 smithi096 ceph-mon[124666]: pgmap v10173: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 160 KiB/s wr, 9 op/s 2023-05-08T09:00:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18969.839218 secs 2023-05-08T09:00:33.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:32 smithi186 ceph-mon[126480]: pgmap v10174: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 160 KiB/s wr, 9 op/s 2023-05-08T09:00:33.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:32 smithi186 ceph-mon[126480]: osdmap e713: 12 total, 12 up, 12 in 2023-05-08T09:00:33.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:32 smithi133 ceph-mon[125939]: pgmap v10174: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 160 KiB/s wr, 9 op/s 2023-05-08T09:00:33.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:32 smithi133 ceph-mon[125939]: osdmap e713: 12 total, 12 up, 12 in 2023-05-08T09:00:33.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:32 smithi096 ceph-mon[124666]: pgmap v10174: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 160 KiB/s wr, 9 op/s 2023-05-08T09:00:33.360 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:32 smithi096 ceph-mon[124666]: osdmap e713: 12 total, 12 up, 12 in 2023-05-08T09:00:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18972.997172 secs 2023-05-08T09:00:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:34 smithi186 ceph-mon[126480]: pgmap v10176: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 86 KiB/s wr, 5 op/s 2023-05-08T09:00:35.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18973.553979 secs 2023-05-08T09:00:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18972.997172 secs 2023-05-08T09:00:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:34 smithi133 ceph-mon[125939]: pgmap v10176: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 86 KiB/s wr, 5 op/s 2023-05-08T09:00:35.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18973.553979 secs 2023-05-08T09:00:35.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18972.997172 secs 2023-05-08T09:00:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:34 smithi096 ceph-mon[124666]: pgmap v10176: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 86 KiB/s wr, 5 op/s 2023-05-08T09:00:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18973.553979 secs 2023-05-08T09:00:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18974.839334 secs 2023-05-08T09:00:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18974.839334 secs 2023-05-08T09:00:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18974.839334 secs 2023-05-08T09:00:37.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:36 smithi186 ceph-mon[126480]: pgmap v10177: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 285 KiB/s wr, 9 op/s 2023-05-08T09:00:37.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:36 smithi133 ceph-mon[125939]: pgmap v10177: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 285 KiB/s wr, 9 op/s 2023-05-08T09:00:37.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:36 smithi096 ceph-mon[124666]: pgmap v10177: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 285 KiB/s wr, 9 op/s 2023-05-08T09:00:39.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:38 smithi186 ceph-mon[126480]: pgmap v10178: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 285 KiB/s wr, 9 op/s 2023-05-08T09:00:39.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:38 smithi133 ceph-mon[125939]: pgmap v10178: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 285 KiB/s wr, 9 op/s 2023-05-08T09:00:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:38 smithi096 ceph-mon[124666]: pgmap v10178: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 285 KiB/s wr, 9 op/s 2023-05-08T09:00:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18977.997277 secs 2023-05-08T09:00:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18978.554112 secs 2023-05-08T09:00:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18977.997277 secs 2023-05-08T09:00:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18978.554112 secs 2023-05-08T09:00:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18977.997277 secs 2023-05-08T09:00:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18978.554112 secs 2023-05-08T09:00:41.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:40 smithi186 ceph-mon[126480]: pgmap v10179: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 217 KiB/s wr, 8 op/s 2023-05-08T09:00:41.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:40 smithi133 ceph-mon[125939]: pgmap v10179: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 217 KiB/s wr, 8 op/s 2023-05-08T09:00:41.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:40 smithi096 ceph-mon[124666]: pgmap v10179: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 217 KiB/s wr, 8 op/s 2023-05-08T09:00:43.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:42 smithi186 ceph-mon[126480]: pgmap v10180: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 217 KiB/s wr, 8 op/s 2023-05-08T09:00:43.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:42 smithi133 ceph-mon[125939]: pgmap v10180: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 217 KiB/s wr, 8 op/s 2023-05-08T09:00:43.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:42 smithi096 ceph-mon[124666]: pgmap v10180: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 217 KiB/s wr, 8 op/s 2023-05-08T09:00:44.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:00:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:00:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:00:45.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18982.997400 secs 2023-05-08T09:00:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:44 smithi186 ceph-mon[126480]: pgmap v10181: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 197 KiB/s wr, 8 op/s 2023-05-08T09:00:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:00:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:00:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:00:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18982.997400 secs 2023-05-08T09:00:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:44 smithi133 ceph-mon[125939]: pgmap v10181: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 197 KiB/s wr, 8 op/s 2023-05-08T09:00:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:00:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:00:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:00:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18982.997400 secs 2023-05-08T09:00:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:44 smithi096 ceph-mon[124666]: pgmap v10181: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 197 KiB/s wr, 8 op/s 2023-05-08T09:00:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:00:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:00:45.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:00:47.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:46 smithi186 ceph-mon[126480]: pgmap v10182: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 496 KiB/s wr, 11 op/s 2023-05-08T09:00:47.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:46 smithi133 ceph-mon[125939]: pgmap v10182: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 496 KiB/s wr, 11 op/s 2023-05-08T09:00:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:46 smithi096 ceph-mon[124666]: pgmap v10182: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 496 KiB/s wr, 11 op/s 2023-05-08T09:00:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:00:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:00:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:00:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:48 smithi186 ceph-mon[126480]: pgmap v10183: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 317 KiB/s wr, 7 op/s 2023-05-08T09:00:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:00:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:00:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:48 smithi133 ceph-mon[125939]: pgmap v10183: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 317 KiB/s wr, 7 op/s 2023-05-08T09:00:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:00:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:00:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:48 smithi096 ceph-mon[124666]: pgmap v10183: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 317 KiB/s wr, 7 op/s 2023-05-08T09:00:49.296 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:00:49.297 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:00:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18987.997507 secs 2023-05-08T09:00:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18987.997507 secs 2023-05-08T09:00:50.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18987.997507 secs 2023-05-08T09:00:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:50 smithi186 ceph-mon[126480]: pgmap v10184: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 460 KiB/s rd, 444 KiB/s wr, 12 op/s 2023-05-08T09:00:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:50 smithi133 ceph-mon[125939]: pgmap v10184: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 460 KiB/s rd, 444 KiB/s wr, 12 op/s 2023-05-08T09:00:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:50 smithi096 ceph-mon[124666]: pgmap v10184: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 460 KiB/s rd, 444 KiB/s wr, 12 op/s 2023-05-08T09:00:53.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:52 smithi186 ceph-mon[126480]: pgmap v10185: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 443 KiB/s wr, 8 op/s 2023-05-08T09:00:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:52 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:00:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:52 smithi133 ceph-mon[125939]: pgmap v10185: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 443 KiB/s wr, 8 op/s 2023-05-08T09:00:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:52 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:00:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:52 smithi096 ceph-mon[124666]: pgmap v10185: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 443 KiB/s wr, 8 op/s 2023-05-08T09:00:53.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:52 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:00:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18992.997629 secs 2023-05-08T09:00:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:54 smithi186 ceph-mon[126480]: pgmap v10186: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 443 KiB/s wr, 8 op/s 2023-05-08T09:00:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18993.554417 secs 2023-05-08T09:00:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18992.997629 secs 2023-05-08T09:00:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:54 smithi133 ceph-mon[125939]: pgmap v10186: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 443 KiB/s wr, 8 op/s 2023-05-08T09:00:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18993.554417 secs 2023-05-08T09:00:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18992.997629 secs 2023-05-08T09:00:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:54 smithi096 ceph-mon[124666]: pgmap v10186: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 443 KiB/s wr, 8 op/s 2023-05-08T09:00:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18993.554417 secs 2023-05-08T09:00:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18994.839811 secs 2023-05-08T09:00:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18994.839811 secs 2023-05-08T09:00:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18994.839811 secs 2023-05-08T09:00:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:56 smithi186 ceph-mon[126480]: pgmap v10187: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 673 KiB/s rd, 671 KiB/s wr, 13 op/s 2023-05-08T09:00:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:00:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:00:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:00:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:56 smithi133 ceph-mon[125939]: pgmap v10187: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 673 KiB/s rd, 671 KiB/s wr, 13 op/s 2023-05-08T09:00:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:00:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:00:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:00:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:56 smithi096 ceph-mon[124666]: pgmap v10187: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 673 KiB/s rd, 671 KiB/s wr, 13 op/s 2023-05-08T09:00:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:00:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:00:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:00:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:57 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:00:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:57 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:00:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:57 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:00:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:58 smithi186 ceph-mon[126480]: pgmap v10188: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 355 KiB/s wr, 9 op/s 2023-05-08T09:00:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:58 smithi133 ceph-mon[125939]: pgmap v10188: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 355 KiB/s wr, 9 op/s 2023-05-08T09:00:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:58 smithi096 ceph-mon[124666]: pgmap v10188: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 355 KiB/s wr, 9 op/s 2023-05-08T09:01:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:00:59 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:01:00.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:00:59 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:01:00.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:00:59 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:01:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:00 smithi186 ceph-mon[126480]: pgmap v10189: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 747 KiB/s rd, 745 KiB/s wr, 14 op/s 2023-05-08T09:01:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:01:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:01:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 18999.839911 secs 2023-05-08T09:01:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:00 smithi133 ceph-mon[125939]: pgmap v10189: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 747 KiB/s rd, 745 KiB/s wr, 14 op/s 2023-05-08T09:01:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:01:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:01:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 18999.839911 secs 2023-05-08T09:01:01.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:00 smithi096 ceph-mon[124666]: pgmap v10189: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 747 KiB/s rd, 745 KiB/s wr, 14 op/s 2023-05-08T09:01:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:01:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:01:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 18999.839911 secs 2023-05-08T09:01:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:02 smithi133 ceph-mon[125939]: pgmap v10190: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 618 KiB/s rd, 617 KiB/s wr, 9 op/s 2023-05-08T09:01:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:02 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:01:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:02 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:01:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:02 smithi096 ceph-mon[124666]: pgmap v10190: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 618 KiB/s rd, 617 KiB/s wr, 9 op/s 2023-05-08T09:01:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:02 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:01:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:02 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:01:03.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:02 smithi186 ceph-mon[126480]: pgmap v10190: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 618 KiB/s rd, 617 KiB/s wr, 9 op/s 2023-05-08T09:01:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:02 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:01:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:02 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:01:04.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T09:01:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:03 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:01:04.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T09:01:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:03 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:01:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T09:01:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:03 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:01:05.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19002.997862 secs 2023-05-08T09:01:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:04 smithi133 ceph-mon[125939]: pgmap v10191: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 618 KiB/s rd, 617 KiB/s wr, 9 op/s 2023-05-08T09:01:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19003.554618 secs 2023-05-08T09:01:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19002.997862 secs 2023-05-08T09:01:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:04 smithi096 ceph-mon[124666]: pgmap v10191: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 618 KiB/s rd, 617 KiB/s wr, 9 op/s 2023-05-08T09:01:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19003.554618 secs 2023-05-08T09:01:05.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19002.997862 secs 2023-05-08T09:01:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:04 smithi186 ceph-mon[126480]: pgmap v10191: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 618 KiB/s rd, 617 KiB/s wr, 9 op/s 2023-05-08T09:01:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19003.554618 secs 2023-05-08T09:01:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19004.840033 secs 2023-05-08T09:01:06.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19004.840033 secs 2023-05-08T09:01:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19004.840033 secs 2023-05-08T09:01:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:06 smithi133 ceph-mon[125939]: pgmap v10192: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 673 KiB/s rd, 718 KiB/s wr, 29 op/s 2023-05-08T09:01:07.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:06 smithi096 ceph-mon[124666]: pgmap v10192: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 673 KiB/s rd, 718 KiB/s wr, 29 op/s 2023-05-08T09:01:07.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:06 smithi186 ceph-mon[126480]: pgmap v10192: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 673 KiB/s rd, 718 KiB/s wr, 29 op/s 2023-05-08T09:01:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:07 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T09:01:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:07 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:01:08.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:07 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T09:01:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:07 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:01:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:07 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T09:01:08.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:07 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:01:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:08 smithi133 ceph-mon[125939]: pgmap v10193: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 491 KiB/s wr, 24 op/s 2023-05-08T09:01:09.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:08 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:01:09.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:01:09.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:01:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:08 smithi096 ceph-mon[124666]: pgmap v10193: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 491 KiB/s wr, 24 op/s 2023-05-08T09:01:09.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:08 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:01:09.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:01:09.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:01:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:08 smithi186 ceph-mon[126480]: pgmap v10193: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 491 KiB/s wr, 24 op/s 2023-05-08T09:01:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:08 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:01:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:01:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:01:10.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19007.997990 secs 2023-05-08T09:01:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19008.554749 secs 2023-05-08T09:01:10.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19007.997990 secs 2023-05-08T09:01:10.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19008.554749 secs 2023-05-08T09:01:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19007.997990 secs 2023-05-08T09:01:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19008.554749 secs 2023-05-08T09:01:11.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:10 smithi133 ceph-mon[125939]: pgmap v10194: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 599 KiB/s rd, 634 KiB/s wr, 29 op/s 2023-05-08T09:01:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19009.840152 secs 2023-05-08T09:01:11.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:10 smithi096 ceph-mon[124666]: pgmap v10194: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 599 KiB/s rd, 634 KiB/s wr, 29 op/s 2023-05-08T09:01:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19009.840152 secs 2023-05-08T09:01:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:10 smithi186 ceph-mon[126480]: pgmap v10194: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 599 KiB/s rd, 634 KiB/s wr, 29 op/s 2023-05-08T09:01:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19009.840152 secs 2023-05-08T09:01:12.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:11 smithi133 ceph-mon[125939]: osdmap e714: 12 total, 12 up, 12 in 2023-05-08T09:01:12.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:11 smithi096 ceph-mon[124666]: osdmap e714: 12 total, 12 up, 12 in 2023-05-08T09:01:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:11 smithi186 ceph-mon[126480]: osdmap e714: 12 total, 12 up, 12 in 2023-05-08T09:01:13.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:12 smithi133 ceph-mon[125939]: pgmap v10196: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 293 KiB/s wr, 29 op/s 2023-05-08T09:01:13.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:12 smithi096 ceph-mon[124666]: pgmap v10196: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 293 KiB/s wr, 29 op/s 2023-05-08T09:01:13.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:12 smithi186 ceph-mon[126480]: pgmap v10196: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 293 KiB/s wr, 29 op/s 2023-05-08T09:01:14.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19012.998098 secs 2023-05-08T09:01:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19012.998098 secs 2023-05-08T09:01:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19012.998098 secs 2023-05-08T09:01:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:14 smithi133 ceph-mon[125939]: pgmap v10197: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 293 KiB/s wr, 29 op/s 2023-05-08T09:01:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19013.554862 secs 2023-05-08T09:01:15.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:14 smithi096 ceph-mon[124666]: pgmap v10197: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 293 KiB/s wr, 29 op/s 2023-05-08T09:01:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19013.554862 secs 2023-05-08T09:01:15.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:14 smithi186 ceph-mon[126480]: pgmap v10197: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 293 KiB/s wr, 29 op/s 2023-05-08T09:01:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19013.554862 secs 2023-05-08T09:01:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19014.840277 secs 2023-05-08T09:01:16.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19014.840277 secs 2023-05-08T09:01:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19014.840277 secs 2023-05-08T09:01:17.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:16 smithi133 ceph-mon[125939]: pgmap v10198: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 242 KiB/s wr, 9 op/s 2023-05-08T09:01:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:16 smithi096 ceph-mon[124666]: pgmap v10198: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 242 KiB/s wr, 9 op/s 2023-05-08T09:01:17.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:16 smithi186 ceph-mon[126480]: pgmap v10198: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 242 KiB/s wr, 9 op/s 2023-05-08T09:01:19.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:18 smithi186 ceph-mon[126480]: pgmap v10199: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 242 KiB/s wr, 9 op/s 2023-05-08T09:01:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:18 smithi186 ceph-mon[126480]: osdmap e715: 12 total, 12 up, 12 in 2023-05-08T09:01:19.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:18 smithi133 ceph-mon[125939]: pgmap v10199: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 242 KiB/s wr, 9 op/s 2023-05-08T09:01:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:18 smithi133 ceph-mon[125939]: osdmap e715: 12 total, 12 up, 12 in 2023-05-08T09:01:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:18 smithi096 ceph-mon[124666]: pgmap v10199: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 242 KiB/s wr, 9 op/s 2023-05-08T09:01:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:18 smithi096 ceph-mon[124666]: osdmap e715: 12 total, 12 up, 12 in 2023-05-08T09:01:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19017.998243 secs 2023-05-08T09:01:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19018.554973 secs 2023-05-08T09:01:20.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19017.998243 secs 2023-05-08T09:01:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19018.554973 secs 2023-05-08T09:01:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19017.998243 secs 2023-05-08T09:01:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19018.554973 secs 2023-05-08T09:01:21.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:20 smithi186 ceph-mon[126480]: pgmap v10201: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 229 KiB/s wr, 8 op/s 2023-05-08T09:01:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19019.840418 secs 2023-05-08T09:01:21.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:20 smithi133 ceph-mon[125939]: pgmap v10201: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 229 KiB/s wr, 8 op/s 2023-05-08T09:01:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19019.840418 secs 2023-05-08T09:01:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:20 smithi096 ceph-mon[124666]: pgmap v10201: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 229 KiB/s wr, 8 op/s 2023-05-08T09:01:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19019.840418 secs 2023-05-08T09:01:23.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:22 smithi186 ceph-mon[126480]: pgmap v10202: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 202 KiB/s wr, 7 op/s 2023-05-08T09:01:23.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:22 smithi133 ceph-mon[125939]: pgmap v10202: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 202 KiB/s wr, 7 op/s 2023-05-08T09:01:23.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:22 smithi096 ceph-mon[124666]: pgmap v10202: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 202 KiB/s wr, 7 op/s 2023-05-08T09:01:25.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19022.998394 secs 2023-05-08T09:01:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:24 smithi186 ceph-mon[126480]: pgmap v10203: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 202 KiB/s wr, 7 op/s 2023-05-08T09:01:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19023.555092 secs 2023-05-08T09:01:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19022.998394 secs 2023-05-08T09:01:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:24 smithi133 ceph-mon[125939]: pgmap v10203: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 202 KiB/s wr, 7 op/s 2023-05-08T09:01:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19023.555092 secs 2023-05-08T09:01:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19022.998394 secs 2023-05-08T09:01:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:24 smithi096 ceph-mon[124666]: pgmap v10203: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 202 KiB/s wr, 7 op/s 2023-05-08T09:01:25.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19023.555092 secs 2023-05-08T09:01:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19024.840561 secs 2023-05-08T09:01:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19024.840561 secs 2023-05-08T09:01:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19024.840561 secs 2023-05-08T09:01:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:26 smithi186 ceph-mon[126480]: pgmap v10204: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 133 KiB/s wr, 7 op/s 2023-05-08T09:01:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:26 smithi133 ceph-mon[125939]: pgmap v10204: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 133 KiB/s wr, 7 op/s 2023-05-08T09:01:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:26 smithi096 ceph-mon[124666]: pgmap v10204: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 133 KiB/s wr, 7 op/s 2023-05-08T09:01:29.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:28 smithi186 ceph-mon[126480]: pgmap v10205: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 133 KiB/s wr, 7 op/s 2023-05-08T09:01:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:28 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:01:29.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:28 smithi133 ceph-mon[125939]: pgmap v10205: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 133 KiB/s wr, 7 op/s 2023-05-08T09:01:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:28 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:01:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:28 smithi096 ceph-mon[124666]: pgmap v10205: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 133 KiB/s wr, 7 op/s 2023-05-08T09:01:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:28 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:01:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19027.998519 secs 2023-05-08T09:01:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19028.555226 secs 2023-05-08T09:01:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:29 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:01:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:29 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:01:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:29 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:01:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:29 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:01:30.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:29 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T09:01:30.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:29 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T09:01:30.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:29 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:01:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19027.998519 secs 2023-05-08T09:01:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19028.555226 secs 2023-05-08T09:01:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:29 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:01:30.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:29 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:01:30.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:29 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:01:30.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:29 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:01:30.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:29 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T09:01:30.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:29 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T09:01:30.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:29 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:01:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19027.998519 secs 2023-05-08T09:01:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19028.555226 secs 2023-05-08T09:01:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:29 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:01:30.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:29 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:01:30.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:29 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:01:30.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:29 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:01:30.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:29 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T09:01:30.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:29 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T09:01:30.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:29 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:01:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:31 smithi186 ceph-mon[126480]: pgmap v10206: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 216 KiB/s wr, 9 op/s 2023-05-08T09:01:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19029.840686 secs 2023-05-08T09:01:31.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:31 smithi133 ceph-mon[125939]: pgmap v10206: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 216 KiB/s wr, 9 op/s 2023-05-08T09:01:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19029.840686 secs 2023-05-08T09:01:31.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:31 smithi096 ceph-mon[124666]: pgmap v10206: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 216 KiB/s wr, 9 op/s 2023-05-08T09:01:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19029.840686 secs 2023-05-08T09:01:33.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:33 smithi186 ceph-mon[126480]: pgmap v10207: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 106 KiB/s wr, 6 op/s 2023-05-08T09:01:33.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:33 smithi133 ceph-mon[125939]: pgmap v10207: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 106 KiB/s wr, 6 op/s 2023-05-08T09:01:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:33 smithi096 ceph-mon[124666]: pgmap v10207: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 106 KiB/s wr, 6 op/s 2023-05-08T09:01:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19032.998646 secs 2023-05-08T09:01:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19032.998646 secs 2023-05-08T09:01:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19032.998646 secs 2023-05-08T09:01:35.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:35 smithi186 ceph-mon[126480]: pgmap v10208: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 106 KiB/s wr, 6 op/s 2023-05-08T09:01:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19033.555373 secs 2023-05-08T09:01:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:35 smithi133 ceph-mon[125939]: pgmap v10208: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 106 KiB/s wr, 6 op/s 2023-05-08T09:01:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19033.555373 secs 2023-05-08T09:01:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:35 smithi096 ceph-mon[124666]: pgmap v10208: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 106 KiB/s wr, 6 op/s 2023-05-08T09:01:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19033.555373 secs 2023-05-08T09:01:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19034.840813 secs 2023-05-08T09:01:36.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19034.840813 secs 2023-05-08T09:01:36.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19034.840813 secs 2023-05-08T09:01:37.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:37 smithi186 ceph-mon[126480]: pgmap v10209: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 106 KiB/s wr, 9 op/s 2023-05-08T09:01:37.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:37 smithi133 ceph-mon[125939]: pgmap v10209: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 106 KiB/s wr, 9 op/s 2023-05-08T09:01:37.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:37 smithi096 ceph-mon[124666]: pgmap v10209: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 106 KiB/s wr, 9 op/s 2023-05-08T09:01:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:39 smithi186 ceph-mon[126480]: pgmap v10210: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 106 KiB/s wr, 5 op/s 2023-05-08T09:01:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19037.998767 secs 2023-05-08T09:01:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:39 smithi133 ceph-mon[125939]: pgmap v10210: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 106 KiB/s wr, 5 op/s 2023-05-08T09:01:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19037.998767 secs 2023-05-08T09:01:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:39 smithi096 ceph-mon[124666]: pgmap v10210: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 106 KiB/s wr, 5 op/s 2023-05-08T09:01:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19037.998767 secs 2023-05-08T09:01:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19038.555517 secs 2023-05-08T09:01:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19038.555517 secs 2023-05-08T09:01:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19038.555517 secs 2023-05-08T09:01:41.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:41 smithi186 ceph-mon[126480]: pgmap v10211: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 106 KiB/s wr, 8 op/s 2023-05-08T09:01:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:41 smithi133 ceph-mon[125939]: pgmap v10211: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 106 KiB/s wr, 8 op/s 2023-05-08T09:01:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:41 smithi096 ceph-mon[124666]: pgmap v10211: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 106 KiB/s wr, 8 op/s 2023-05-08T09:01:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:43 smithi186 ceph-mon[126480]: pgmap v10212: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2023-05-08T09:01:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:43 smithi133 ceph-mon[125939]: pgmap v10212: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2023-05-08T09:01:43.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:43 smithi096 ceph-mon[124666]: pgmap v10212: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2023-05-08T09:01:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:44 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:01:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19042.998890 secs 2023-05-08T09:01:44.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:44 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:01:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19042.998890 secs 2023-05-08T09:01:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:44 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:01:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19042.998890 secs 2023-05-08T09:01:45.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:45 smithi186 ceph-mon[126480]: pgmap v10213: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2023-05-08T09:01:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19043.555617 secs 2023-05-08T09:01:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:45 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:01:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:45 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:01:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:45 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:01:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:45 smithi133 ceph-mon[125939]: pgmap v10213: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2023-05-08T09:01:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19043.555617 secs 2023-05-08T09:01:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:45 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:01:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:45 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:01:45.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:45 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:01:45.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:45 smithi096 ceph-mon[124666]: pgmap v10213: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2023-05-08T09:01:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19043.555617 secs 2023-05-08T09:01:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:45 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:01:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:45 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:01:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:45 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:01:47.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:47 smithi186 ceph-mon[126480]: pgmap v10214: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 102 KiB/s wr, 8 op/s 2023-05-08T09:01:47.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:47 smithi133 ceph-mon[125939]: pgmap v10214: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 102 KiB/s wr, 8 op/s 2023-05-08T09:01:47.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:47 smithi096 ceph-mon[124666]: pgmap v10214: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 102 KiB/s wr, 8 op/s 2023-05-08T09:01:49.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:49 smithi186 ceph-mon[126480]: pgmap v10215: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 102 KiB/s wr, 6 op/s 2023-05-08T09:01:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19047.999039 secs 2023-05-08T09:01:49.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:49 smithi133 ceph-mon[125939]: pgmap v10215: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 102 KiB/s wr, 6 op/s 2023-05-08T09:01:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19047.999039 secs 2023-05-08T09:01:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:49 smithi096 ceph-mon[124666]: pgmap v10215: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 102 KiB/s wr, 6 op/s 2023-05-08T09:01:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19047.999039 secs 2023-05-08T09:01:51.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:51 smithi186 ceph-mon[126480]: pgmap v10216: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 309 KiB/s wr, 10 op/s 2023-05-08T09:01:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:51 smithi133 ceph-mon[125939]: pgmap v10216: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 309 KiB/s wr, 10 op/s 2023-05-08T09:01:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:51 smithi096 ceph-mon[124666]: pgmap v10216: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 309 KiB/s wr, 10 op/s 2023-05-08T09:01:52.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:01:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:01:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:01:53.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:53 smithi186 ceph-mon[126480]: pgmap v10217: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 521 KiB/s rd, 309 KiB/s wr, 8 op/s 2023-05-08T09:01:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:53 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:01:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:01:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:01:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:53 smithi133 ceph-mon[125939]: pgmap v10217: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 521 KiB/s rd, 309 KiB/s wr, 8 op/s 2023-05-08T09:01:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:53 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:01:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:01:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:01:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:53 smithi096 ceph-mon[124666]: pgmap v10217: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 521 KiB/s rd, 309 KiB/s wr, 8 op/s 2023-05-08T09:01:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:53 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:01:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:01:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:01:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19052.999179 secs 2023-05-08T09:01:54.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19052.999179 secs 2023-05-08T09:01:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19052.999179 secs 2023-05-08T09:01:55.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:55 smithi186 ceph-mon[126480]: pgmap v10218: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 521 KiB/s rd, 309 KiB/s wr, 7 op/s 2023-05-08T09:01:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19053.555773 secs 2023-05-08T09:01:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:55 smithi133 ceph-mon[125939]: pgmap v10218: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 521 KiB/s rd, 309 KiB/s wr, 7 op/s 2023-05-08T09:01:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19053.555773 secs 2023-05-08T09:01:55.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:55 smithi096 ceph-mon[124666]: pgmap v10218: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 521 KiB/s rd, 309 KiB/s wr, 7 op/s 2023-05-08T09:01:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19053.555773 secs 2023-05-08T09:01:56.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19054.841242 secs 2023-05-08T09:01:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19054.841242 secs 2023-05-08T09:01:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19054.841242 secs 2023-05-08T09:01:57.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:57 smithi186 ceph-mon[126480]: pgmap v10219: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 693 KiB/s rd, 474 KiB/s wr, 14 op/s 2023-05-08T09:01:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:01:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:01:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:01:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:57 smithi133 ceph-mon[125939]: pgmap v10219: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 693 KiB/s rd, 474 KiB/s wr, 14 op/s 2023-05-08T09:01:57.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:01:57.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:01:57.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:01:57.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:57 smithi096 ceph-mon[124666]: pgmap v10219: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 693 KiB/s rd, 474 KiB/s wr, 14 op/s 2023-05-08T09:01:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:01:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:01:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:01:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:58 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:01:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:58 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:01:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:58 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:01:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:59 smithi186 ceph-mon[126480]: pgmap v10220: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 463 KiB/s rd, 372 KiB/s wr, 10 op/s 2023-05-08T09:01:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:01:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19057.999302 secs 2023-05-08T09:01:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:59 smithi133 ceph-mon[125939]: pgmap v10220: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 463 KiB/s rd, 372 KiB/s wr, 10 op/s 2023-05-08T09:01:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:01:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19057.999302 secs 2023-05-08T09:01:59.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:59 smithi096 ceph-mon[124666]: pgmap v10220: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 463 KiB/s rd, 372 KiB/s wr, 10 op/s 2023-05-08T09:01:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:01:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19057.999302 secs 2023-05-08T09:02:00.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:00 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:02:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:00 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:02:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:00 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:02:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:01 smithi133 ceph-mon[125939]: pgmap v10221: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 612 KiB/s rd, 524 KiB/s wr, 15 op/s 2023-05-08T09:02:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19059.841353 secs 2023-05-08T09:02:01.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:02:01.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:02:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:01 smithi096 ceph-mon[124666]: pgmap v10221: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 612 KiB/s rd, 524 KiB/s wr, 15 op/s 2023-05-08T09:02:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19059.841353 secs 2023-05-08T09:02:01.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:02:01.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:02:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:01 smithi186 ceph-mon[126480]: pgmap v10221: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 612 KiB/s rd, 524 KiB/s wr, 15 op/s 2023-05-08T09:02:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19059.841353 secs 2023-05-08T09:02:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:02:01.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:02:03.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:03 smithi133 ceph-mon[125939]: pgmap v10222: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 318 KiB/s wr, 11 op/s 2023-05-08T09:02:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:03 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:02:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:03 smithi096 ceph-mon[124666]: pgmap v10222: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 318 KiB/s wr, 11 op/s 2023-05-08T09:02:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:03 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:02:03.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:03 smithi186 ceph-mon[126480]: pgmap v10222: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 318 KiB/s wr, 11 op/s 2023-05-08T09:02:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:03 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:02:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19062.999360 secs 2023-05-08T09:02:04.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19062.999360 secs 2023-05-08T09:02:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19062.999360 secs 2023-05-08T09:02:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:05 smithi133 ceph-mon[125939]: pgmap v10223: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 318 KiB/s wr, 11 op/s 2023-05-08T09:02:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19063.556029 secs 2023-05-08T09:02:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:05 smithi096 ceph-mon[124666]: pgmap v10223: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 318 KiB/s wr, 11 op/s 2023-05-08T09:02:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19063.556029 secs 2023-05-08T09:02:05.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:05 smithi186 ceph-mon[126480]: pgmap v10223: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 318 KiB/s wr, 11 op/s 2023-05-08T09:02:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19063.556029 secs 2023-05-08T09:02:06.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19064.841448 secs 2023-05-08T09:02:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:06 smithi133 ceph-mon[125939]: osdmap e716: 12 total, 12 up, 12 in 2023-05-08T09:02:06.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19064.841448 secs 2023-05-08T09:02:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:06 smithi096 ceph-mon[124666]: osdmap e716: 12 total, 12 up, 12 in 2023-05-08T09:02:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19064.841448 secs 2023-05-08T09:02:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:06 smithi186 ceph-mon[126480]: osdmap e716: 12 total, 12 up, 12 in 2023-05-08T09:02:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:07 smithi133 ceph-mon[125939]: pgmap v10225: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 366 KiB/s wr, 28 op/s 2023-05-08T09:02:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:07 smithi096 ceph-mon[124666]: pgmap v10225: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 366 KiB/s wr, 28 op/s 2023-05-08T09:02:07.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:07 smithi186 ceph-mon[126480]: pgmap v10225: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 366 KiB/s wr, 28 op/s 2023-05-08T09:02:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:08 smithi186 ceph-mon[126480]: pgmap v10226: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 366 KiB/s wr, 28 op/s 2023-05-08T09:02:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:08 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:02:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:02:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:02:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:08 smithi133 ceph-mon[125939]: pgmap v10226: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 366 KiB/s wr, 28 op/s 2023-05-08T09:02:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:08 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:02:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:02:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:02:09.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:08 smithi096 ceph-mon[124666]: pgmap v10226: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 366 KiB/s wr, 28 op/s 2023-05-08T09:02:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:08 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:02:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:02:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:02:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19067.999482 secs 2023-05-08T09:02:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19068.556114 secs 2023-05-08T09:02:10.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19067.999482 secs 2023-05-08T09:02:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19068.556114 secs 2023-05-08T09:02:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19067.999482 secs 2023-05-08T09:02:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19068.556114 secs 2023-05-08T09:02:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:10 smithi186 ceph-mon[126480]: pgmap v10227: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 264 KiB/s wr, 27 op/s 2023-05-08T09:02:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19069.841586 secs 2023-05-08T09:02:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:10 smithi133 ceph-mon[125939]: pgmap v10227: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 264 KiB/s wr, 27 op/s 2023-05-08T09:02:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19069.841586 secs 2023-05-08T09:02:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:10 smithi096 ceph-mon[124666]: pgmap v10227: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 264 KiB/s wr, 27 op/s 2023-05-08T09:02:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19069.841586 secs 2023-05-08T09:02:13.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:12 smithi186 ceph-mon[126480]: pgmap v10228: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 263 KiB/s wr, 27 op/s 2023-05-08T09:02:13.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:12 smithi186 ceph-mon[126480]: osdmap e717: 12 total, 12 up, 12 in 2023-05-08T09:02:13.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:12 smithi133 ceph-mon[125939]: pgmap v10228: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 263 KiB/s wr, 27 op/s 2023-05-08T09:02:13.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:12 smithi133 ceph-mon[125939]: osdmap e717: 12 total, 12 up, 12 in 2023-05-08T09:02:13.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:12 smithi096 ceph-mon[124666]: pgmap v10228: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 263 KiB/s wr, 27 op/s 2023-05-08T09:02:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:12 smithi096 ceph-mon[124666]: osdmap e717: 12 total, 12 up, 12 in 2023-05-08T09:02:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19072.999615 secs 2023-05-08T09:02:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:14 smithi186 ceph-mon[126480]: pgmap v10230: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 93 KiB/s wr, 5 op/s 2023-05-08T09:02:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19073.556263 secs 2023-05-08T09:02:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19072.999615 secs 2023-05-08T09:02:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:14 smithi133 ceph-mon[125939]: pgmap v10230: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 93 KiB/s wr, 5 op/s 2023-05-08T09:02:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19073.556263 secs 2023-05-08T09:02:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19072.999615 secs 2023-05-08T09:02:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:14 smithi096 ceph-mon[124666]: pgmap v10230: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 93 KiB/s wr, 5 op/s 2023-05-08T09:02:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19073.556263 secs 2023-05-08T09:02:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19074.841707 secs 2023-05-08T09:02:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19074.841707 secs 2023-05-08T09:02:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19074.841707 secs 2023-05-08T09:02:17.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:16 smithi186 ceph-mon[126480]: pgmap v10231: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 138 KiB/s wr, 8 op/s 2023-05-08T09:02:17.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:16 smithi133 ceph-mon[125939]: pgmap v10231: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 138 KiB/s wr, 8 op/s 2023-05-08T09:02:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:16 smithi096 ceph-mon[124666]: pgmap v10231: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 138 KiB/s wr, 8 op/s 2023-05-08T09:02:19.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:18 smithi186 ceph-mon[126480]: pgmap v10232: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 138 KiB/s wr, 8 op/s 2023-05-08T09:02:19.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:18 smithi133 ceph-mon[125939]: pgmap v10232: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 138 KiB/s wr, 8 op/s 2023-05-08T09:02:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:18 smithi096 ceph-mon[124666]: pgmap v10232: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 138 KiB/s wr, 8 op/s 2023-05-08T09:02:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19077.999739 secs 2023-05-08T09:02:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19078.556408 secs 2023-05-08T09:02:20.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19077.999739 secs 2023-05-08T09:02:20.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19078.556408 secs 2023-05-08T09:02:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19077.999739 secs 2023-05-08T09:02:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19078.556408 secs 2023-05-08T09:02:21.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:20 smithi186 ceph-mon[126480]: pgmap v10233: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 7 op/s 2023-05-08T09:02:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19079.841828 secs 2023-05-08T09:02:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:20 smithi133 ceph-mon[125939]: pgmap v10233: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 7 op/s 2023-05-08T09:02:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19079.841828 secs 2023-05-08T09:02:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:20 smithi096 ceph-mon[124666]: pgmap v10233: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 7 op/s 2023-05-08T09:02:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19079.841828 secs 2023-05-08T09:02:23.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:22 smithi186 ceph-mon[126480]: pgmap v10234: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 7 op/s 2023-05-08T09:02:23.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:22 smithi133 ceph-mon[125939]: pgmap v10234: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 7 op/s 2023-05-08T09:02:23.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:22 smithi096 ceph-mon[124666]: pgmap v10234: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 7 op/s 2023-05-08T09:02:25.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19082.999856 secs 2023-05-08T09:02:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:24 smithi186 ceph-mon[126480]: pgmap v10235: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 52 KiB/s wr, 6 op/s 2023-05-08T09:02:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19083.556504 secs 2023-05-08T09:02:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19082.999856 secs 2023-05-08T09:02:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:24 smithi133 ceph-mon[125939]: pgmap v10235: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 52 KiB/s wr, 6 op/s 2023-05-08T09:02:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19083.556504 secs 2023-05-08T09:02:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19082.999856 secs 2023-05-08T09:02:25.270 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:24 smithi096 ceph-mon[124666]: pgmap v10235: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 52 KiB/s wr, 6 op/s 2023-05-08T09:02:25.270 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19083.556504 secs 2023-05-08T09:02:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19084.841902 secs 2023-05-08T09:02:26.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19084.841902 secs 2023-05-08T09:02:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19084.841902 secs 2023-05-08T09:02:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:26 smithi186 ceph-mon[126480]: pgmap v10236: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 48 KiB/s wr, 9 op/s 2023-05-08T09:02:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:26 smithi133 ceph-mon[125939]: pgmap v10236: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 48 KiB/s wr, 9 op/s 2023-05-08T09:02:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:26 smithi096 ceph-mon[124666]: pgmap v10236: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 48 KiB/s wr, 9 op/s 2023-05-08T09:02:29.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:28 smithi186 ceph-mon[126480]: pgmap v10237: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2023-05-08T09:02:29.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:28 smithi133 ceph-mon[125939]: pgmap v10237: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2023-05-08T09:02:29.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:28 smithi096 ceph-mon[124666]: pgmap v10237: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2023-05-08T09:02:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19087.999972 secs 2023-05-08T09:02:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19088.556581 secs 2023-05-08T09:02:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:29 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:02:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:29 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:02:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:29 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:02:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:29 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:02:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:29 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:02:30.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:29 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:02:30.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:29 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:02:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19087.999972 secs 2023-05-08T09:02:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19088.556581 secs 2023-05-08T09:02:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:29 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:02:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:29 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:02:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:29 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:02:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:29 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:02:30.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:29 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:02:30.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:29 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:02:30.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:29 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:02:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19087.999972 secs 2023-05-08T09:02:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19088.556581 secs 2023-05-08T09:02:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:29 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:02:30.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:29 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:02:30.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:29 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:02:30.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:29 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:02:30.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:29 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:02:30.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:29 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:02:30.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:29 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:02:31.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:30 smithi186 ceph-mon[126480]: pgmap v10238: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T09:02:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19089.841969 secs 2023-05-08T09:02:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:02:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:02:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:30 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:02:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:02:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:30 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T09:02:31.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:30 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T09:02:31.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:30 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:02:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:30 smithi133 ceph-mon[125939]: pgmap v10238: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T09:02:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19089.841969 secs 2023-05-08T09:02:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:02:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:02:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:30 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:02:31.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:02:31.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:30 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T09:02:31.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:30 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T09:02:31.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:30 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:02:31.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:30 smithi096 ceph-mon[124666]: pgmap v10238: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T09:02:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19089.841969 secs 2023-05-08T09:02:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:02:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:02:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:30 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:02:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:02:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:30 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T09:02:31.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:30 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T09:02:31.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:30 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:02:33.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:32 smithi186 ceph-mon[126480]: pgmap v10239: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2023-05-08T09:02:33.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:32 smithi133 ceph-mon[125939]: pgmap v10239: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2023-05-08T09:02:33.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:32 smithi096 ceph-mon[124666]: pgmap v10239: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2023-05-08T09:02:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19093.000096 secs 2023-05-08T09:02:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:34 smithi186 ceph-mon[126480]: pgmap v10240: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2023-05-08T09:02:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19093.556711 secs 2023-05-08T09:02:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19093.000096 secs 2023-05-08T09:02:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:34 smithi133 ceph-mon[125939]: pgmap v10240: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2023-05-08T09:02:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19093.556711 secs 2023-05-08T09:02:35.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19093.000096 secs 2023-05-08T09:02:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:34 smithi096 ceph-mon[124666]: pgmap v10240: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2023-05-08T09:02:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19093.556711 secs 2023-05-08T09:02:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19094.842117 secs 2023-05-08T09:02:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19094.842117 secs 2023-05-08T09:02:36.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19094.842117 secs 2023-05-08T09:02:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:36 smithi186 ceph-mon[126480]: pgmap v10241: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 121 KiB/s wr, 9 op/s 2023-05-08T09:02:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:36 smithi133 ceph-mon[125939]: pgmap v10241: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 121 KiB/s wr, 9 op/s 2023-05-08T09:02:37.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:36 smithi096 ceph-mon[124666]: pgmap v10241: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 121 KiB/s wr, 9 op/s 2023-05-08T09:02:39.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:38 smithi186 ceph-mon[126480]: pgmap v10242: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 121 KiB/s wr, 6 op/s 2023-05-08T09:02:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:38 smithi133 ceph-mon[125939]: pgmap v10242: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 121 KiB/s wr, 6 op/s 2023-05-08T09:02:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:38 smithi096 ceph-mon[124666]: pgmap v10242: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 121 KiB/s wr, 6 op/s 2023-05-08T09:02:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19098.000198 secs 2023-05-08T09:02:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19098.556831 secs 2023-05-08T09:02:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19098.000198 secs 2023-05-08T09:02:40.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19098.556831 secs 2023-05-08T09:02:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19098.000198 secs 2023-05-08T09:02:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19098.556831 secs 2023-05-08T09:02:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:40 smithi133 ceph-mon[125939]: pgmap v10243: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 267 KiB/s wr, 10 op/s 2023-05-08T09:02:41.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:40 smithi096 ceph-mon[124666]: pgmap v10243: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 267 KiB/s wr, 10 op/s 2023-05-08T09:02:41.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:40 smithi186 ceph-mon[126480]: pgmap v10243: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 267 KiB/s wr, 10 op/s 2023-05-08T09:02:43.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:42 smithi133 ceph-mon[125939]: pgmap v10244: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 267 KiB/s wr, 7 op/s 2023-05-08T09:02:43.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:42 smithi096 ceph-mon[124666]: pgmap v10244: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 267 KiB/s wr, 7 op/s 2023-05-08T09:02:43.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:42 smithi186 ceph-mon[126480]: pgmap v10244: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 267 KiB/s wr, 7 op/s 2023-05-08T09:02:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:02:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:02:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:02:45.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19103.000313 secs 2023-05-08T09:02:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:44 smithi133 ceph-mon[125939]: pgmap v10245: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 267 KiB/s wr, 7 op/s 2023-05-08T09:02:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19103.556950 secs 2023-05-08T09:02:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:02:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:02:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:02:45.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19103.000313 secs 2023-05-08T09:02:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:44 smithi096 ceph-mon[124666]: pgmap v10245: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 267 KiB/s wr, 7 op/s 2023-05-08T09:02:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19103.556950 secs 2023-05-08T09:02:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:02:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:02:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:02:45.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19103.000313 secs 2023-05-08T09:02:45.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:44 smithi186 ceph-mon[126480]: pgmap v10245: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 267 KiB/s wr, 7 op/s 2023-05-08T09:02:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19103.556950 secs 2023-05-08T09:02:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:02:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:02:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:02:46.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19104.842376 secs 2023-05-08T09:02:46.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19104.842376 secs 2023-05-08T09:02:46.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19104.842376 secs 2023-05-08T09:02:47.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:46 smithi133 ceph-mon[125939]: pgmap v10246: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 476 KiB/s wr, 13 op/s 2023-05-08T09:02:47.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:46 smithi096 ceph-mon[124666]: pgmap v10246: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 476 KiB/s wr, 13 op/s 2023-05-08T09:02:47.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:46 smithi186 ceph-mon[126480]: pgmap v10246: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 476 KiB/s wr, 13 op/s 2023-05-08T09:02:49.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:48 smithi133 ceph-mon[125939]: pgmap v10247: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 356 KiB/s wr, 9 op/s 2023-05-08T09:02:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:02:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:02:49.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:48 smithi096 ceph-mon[124666]: pgmap v10247: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 356 KiB/s wr, 9 op/s 2023-05-08T09:02:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:02:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:02:49.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:48 smithi186 ceph-mon[126480]: pgmap v10247: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 356 KiB/s wr, 9 op/s 2023-05-08T09:02:49.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:02:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:02:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19108.000425 secs 2023-05-08T09:02:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19108.557042 secs 2023-05-08T09:02:50.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19108.000425 secs 2023-05-08T09:02:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19108.557042 secs 2023-05-08T09:02:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19108.000425 secs 2023-05-08T09:02:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19108.557042 secs 2023-05-08T09:02:51.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:50 smithi133 ceph-mon[125939]: pgmap v10248: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 460 KiB/s rd, 547 KiB/s wr, 15 op/s 2023-05-08T09:02:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19109.842475 secs 2023-05-08T09:02:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:50 smithi096 ceph-mon[124666]: pgmap v10248: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 460 KiB/s rd, 547 KiB/s wr, 15 op/s 2023-05-08T09:02:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19109.842475 secs 2023-05-08T09:02:51.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:50 smithi186 ceph-mon[126480]: pgmap v10248: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 460 KiB/s rd, 547 KiB/s wr, 15 op/s 2023-05-08T09:02:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19109.842475 secs 2023-05-08T09:02:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:52 smithi133 ceph-mon[125939]: pgmap v10249: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 400 KiB/s wr, 11 op/s 2023-05-08T09:02:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:52 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:02:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:52 smithi096 ceph-mon[124666]: pgmap v10249: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 400 KiB/s wr, 11 op/s 2023-05-08T09:02:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:52 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:02:53.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:52 smithi186 ceph-mon[126480]: pgmap v10249: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 400 KiB/s wr, 11 op/s 2023-05-08T09:02:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:52 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:02:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19113.000524 secs 2023-05-08T09:02:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:54 smithi133 ceph-mon[125939]: pgmap v10250: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 400 KiB/s wr, 11 op/s 2023-05-08T09:02:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19113.557145 secs 2023-05-08T09:02:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19113.000524 secs 2023-05-08T09:02:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:54 smithi096 ceph-mon[124666]: pgmap v10250: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 400 KiB/s wr, 11 op/s 2023-05-08T09:02:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19113.557145 secs 2023-05-08T09:02:55.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19113.000524 secs 2023-05-08T09:02:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:54 smithi186 ceph-mon[126480]: pgmap v10250: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 400 KiB/s wr, 11 op/s 2023-05-08T09:02:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19113.557145 secs 2023-05-08T09:02:56.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19114.842615 secs 2023-05-08T09:02:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19114.842615 secs 2023-05-08T09:02:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19114.842615 secs 2023-05-08T09:02:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:56 smithi133 ceph-mon[125939]: pgmap v10251: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 476 KiB/s wr, 16 op/s 2023-05-08T09:02:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:56 smithi096 ceph-mon[124666]: pgmap v10251: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 476 KiB/s wr, 16 op/s 2023-05-08T09:02:57.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:56 smithi186 ceph-mon[126480]: pgmap v10251: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 476 KiB/s wr, 16 op/s 2023-05-08T09:02:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:58 smithi133 ceph-mon[125939]: pgmap v10252: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 267 KiB/s wr, 10 op/s 2023-05-08T09:02:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:58 smithi096 ceph-mon[124666]: pgmap v10252: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 267 KiB/s wr, 10 op/s 2023-05-08T09:02:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:58 smithi186 ceph-mon[126480]: pgmap v10252: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 267 KiB/s wr, 10 op/s 2023-05-08T09:03:00.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19118.000642 secs 2023-05-08T09:03:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:02:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19118.557206 secs 2023-05-08T09:03:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19118.000642 secs 2023-05-08T09:03:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:02:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19118.557206 secs 2023-05-08T09:03:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19118.000642 secs 2023-05-08T09:03:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:02:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19118.557206 secs 2023-05-08T09:03:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:00 smithi133 ceph-mon[125939]: pgmap v10253: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 398 KiB/s rd, 396 KiB/s wr, 13 op/s 2023-05-08T09:03:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19119.842755 secs 2023-05-08T09:03:01.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:00 smithi096 ceph-mon[124666]: pgmap v10253: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 398 KiB/s rd, 396 KiB/s wr, 13 op/s 2023-05-08T09:03:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19119.842755 secs 2023-05-08T09:03:01.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:00 smithi186 ceph-mon[126480]: pgmap v10253: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 398 KiB/s rd, 396 KiB/s wr, 13 op/s 2023-05-08T09:03:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19119.842755 secs 2023-05-08T09:03:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:02 smithi133 ceph-mon[125939]: pgmap v10254: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 205 KiB/s wr, 8 op/s 2023-05-08T09:03:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:02 smithi096 ceph-mon[124666]: pgmap v10254: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 205 KiB/s wr, 8 op/s 2023-05-08T09:03:03.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:02 smithi186 ceph-mon[126480]: pgmap v10254: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 205 KiB/s wr, 8 op/s 2023-05-08T09:03:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19123.000790 secs 2023-05-08T09:03:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19123.000790 secs 2023-05-08T09:03:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19123.000790 secs 2023-05-08T09:03:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:04 smithi133 ceph-mon[125939]: pgmap v10255: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 205 KiB/s wr, 8 op/s 2023-05-08T09:03:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19123.557281 secs 2023-05-08T09:03:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:04 smithi096 ceph-mon[124666]: pgmap v10255: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 205 KiB/s wr, 8 op/s 2023-05-08T09:03:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19123.557281 secs 2023-05-08T09:03:05.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:04 smithi186 ceph-mon[126480]: pgmap v10255: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 205 KiB/s wr, 8 op/s 2023-05-08T09:03:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19123.557281 secs 2023-05-08T09:03:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19124.842886 secs 2023-05-08T09:03:06.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19124.842886 secs 2023-05-08T09:03:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19124.842886 secs 2023-05-08T09:03:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:06 smithi133 ceph-mon[125939]: pgmap v10256: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 250 KiB/s wr, 25 op/s 2023-05-08T09:03:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:06 smithi096 ceph-mon[124666]: pgmap v10256: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 250 KiB/s wr, 25 op/s 2023-05-08T09:03:07.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:06 smithi186 ceph-mon[126480]: pgmap v10256: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 250 KiB/s wr, 25 op/s 2023-05-08T09:03:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:08 smithi133 ceph-mon[125939]: pgmap v10257: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 174 KiB/s wr, 21 op/s 2023-05-08T09:03:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19128.000940 secs 2023-05-08T09:03:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:08 smithi096 ceph-mon[124666]: pgmap v10257: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 174 KiB/s wr, 21 op/s 2023-05-08T09:03:09.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19128.000940 secs 2023-05-08T09:03:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:08 smithi186 ceph-mon[126480]: pgmap v10257: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 174 KiB/s wr, 21 op/s 2023-05-08T09:03:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19128.000940 secs 2023-05-08T09:03:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19128.557391 secs 2023-05-08T09:03:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19128.557391 secs 2023-05-08T09:03:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19128.557391 secs 2023-05-08T09:03:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:10 smithi133 ceph-mon[125939]: pgmap v10258: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 265 KiB/s rd, 222 KiB/s wr, 23 op/s 2023-05-08T09:03:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19129.842983 secs 2023-05-08T09:03:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:10 smithi096 ceph-mon[124666]: pgmap v10258: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 265 KiB/s rd, 222 KiB/s wr, 23 op/s 2023-05-08T09:03:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19129.842983 secs 2023-05-08T09:03:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:10 smithi186 ceph-mon[126480]: pgmap v10258: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 265 KiB/s rd, 222 KiB/s wr, 23 op/s 2023-05-08T09:03:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19129.842983 secs 2023-05-08T09:03:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:11 smithi133 ceph-mon[125939]: osdmap e718: 12 total, 12 up, 12 in 2023-05-08T09:03:12.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:11 smithi096 ceph-mon[124666]: osdmap e718: 12 total, 12 up, 12 in 2023-05-08T09:03:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:11 smithi186 ceph-mon[126480]: osdmap e718: 12 total, 12 up, 12 in 2023-05-08T09:03:13.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:12 smithi133 ceph-mon[125939]: pgmap v10260: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 111 KiB/s wr, 24 op/s 2023-05-08T09:03:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:12 smithi096 ceph-mon[124666]: pgmap v10260: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 111 KiB/s wr, 24 op/s 2023-05-08T09:03:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:12 smithi186 ceph-mon[126480]: pgmap v10260: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 111 KiB/s wr, 24 op/s 2023-05-08T09:03:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19133.001084 secs 2023-05-08T09:03:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19133.001084 secs 2023-05-08T09:03:14.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19133.001084 secs 2023-05-08T09:03:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:14 smithi096 ceph-mon[124666]: pgmap v10261: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 111 KiB/s wr, 24 op/s 2023-05-08T09:03:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19133.557548 secs 2023-05-08T09:03:15.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:14 smithi186 ceph-mon[126480]: pgmap v10261: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 111 KiB/s wr, 24 op/s 2023-05-08T09:03:15.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19133.557548 secs 2023-05-08T09:03:15.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:14 smithi133 ceph-mon[125939]: pgmap v10261: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 111 KiB/s wr, 24 op/s 2023-05-08T09:03:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19133.557548 secs 2023-05-08T09:03:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19134.843102 secs 2023-05-08T09:03:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19134.843102 secs 2023-05-08T09:03:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19134.843102 secs 2023-05-08T09:03:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:16 smithi096 ceph-mon[124666]: pgmap v10262: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 58 KiB/s wr, 6 op/s 2023-05-08T09:03:17.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:17 smithi186 ceph-mon[126480]: pgmap v10262: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 58 KiB/s wr, 6 op/s 2023-05-08T09:03:17.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:17 smithi133 ceph-mon[125939]: pgmap v10262: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 58 KiB/s wr, 6 op/s 2023-05-08T09:03:19.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:18 smithi186 ceph-mon[126480]: pgmap v10263: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 58 KiB/s wr, 6 op/s 2023-05-08T09:03:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:18 smithi186 ceph-mon[126480]: osdmap e719: 12 total, 12 up, 12 in 2023-05-08T09:03:19.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:18 smithi133 ceph-mon[125939]: pgmap v10263: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 58 KiB/s wr, 6 op/s 2023-05-08T09:03:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:18 smithi133 ceph-mon[125939]: osdmap e719: 12 total, 12 up, 12 in 2023-05-08T09:03:19.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:18 smithi096 ceph-mon[124666]: pgmap v10263: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 58 KiB/s wr, 6 op/s 2023-05-08T09:03:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:18 smithi096 ceph-mon[124666]: osdmap e719: 12 total, 12 up, 12 in 2023-05-08T09:03:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19138.001212 secs 2023-05-08T09:03:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19138.557675 secs 2023-05-08T09:03:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19138.001212 secs 2023-05-08T09:03:20.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19138.557675 secs 2023-05-08T09:03:20.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19138.001212 secs 2023-05-08T09:03:20.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19138.557675 secs 2023-05-08T09:03:21.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:20 smithi186 ceph-mon[126480]: pgmap v10265: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 348 B/s wr, 7 op/s 2023-05-08T09:03:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19139.843220 secs 2023-05-08T09:03:21.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:20 smithi133 ceph-mon[125939]: pgmap v10265: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 348 B/s wr, 7 op/s 2023-05-08T09:03:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19139.843220 secs 2023-05-08T09:03:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:20 smithi096 ceph-mon[124666]: pgmap v10265: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 348 B/s wr, 7 op/s 2023-05-08T09:03:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19139.843220 secs 2023-05-08T09:03:23.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:22 smithi186 ceph-mon[126480]: pgmap v10266: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T09:03:23.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:22 smithi133 ceph-mon[125939]: pgmap v10266: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T09:03:23.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:22 smithi096 ceph-mon[124666]: pgmap v10266: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T09:03:25.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19143.001357 secs 2023-05-08T09:03:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:24 smithi186 ceph-mon[126480]: pgmap v10267: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T09:03:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19143.557801 secs 2023-05-08T09:03:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19143.001357 secs 2023-05-08T09:03:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:24 smithi133 ceph-mon[125939]: pgmap v10267: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T09:03:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19143.557801 secs 2023-05-08T09:03:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19143.001357 secs 2023-05-08T09:03:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:24 smithi096 ceph-mon[124666]: pgmap v10267: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2023-05-08T09:03:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19143.557801 secs 2023-05-08T09:03:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19144.843351 secs 2023-05-08T09:03:26.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19144.843351 secs 2023-05-08T09:03:26.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19144.843351 secs 2023-05-08T09:03:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:26 smithi186 ceph-mon[126480]: pgmap v10268: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2023-05-08T09:03:27.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:26 smithi133 ceph-mon[125939]: pgmap v10268: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2023-05-08T09:03:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:26 smithi096 ceph-mon[124666]: pgmap v10268: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2023-05-08T09:03:29.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:28 smithi186 ceph-mon[126480]: pgmap v10269: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2023-05-08T09:03:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:28 smithi133 ceph-mon[125939]: pgmap v10269: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2023-05-08T09:03:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:28 smithi096 ceph-mon[124666]: pgmap v10269: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2023-05-08T09:03:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19148.001413 secs 2023-05-08T09:03:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19148.557916 secs 2023-05-08T09:03:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19148.001413 secs 2023-05-08T09:03:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19148.557916 secs 2023-05-08T09:03:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19148.001413 secs 2023-05-08T09:03:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19148.557916 secs 2023-05-08T09:03:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:30 smithi186 ceph-mon[126480]: pgmap v10270: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 63 KiB/s wr, 9 op/s 2023-05-08T09:03:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19149.843505 secs 2023-05-08T09:03:31.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:03:31.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:30 smithi133 ceph-mon[125939]: pgmap v10270: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 63 KiB/s wr, 9 op/s 2023-05-08T09:03:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19149.843505 secs 2023-05-08T09:03:31.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:03:31.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:30 smithi096 ceph-mon[124666]: pgmap v10270: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 63 KiB/s wr, 9 op/s 2023-05-08T09:03:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19149.843505 secs 2023-05-08T09:03:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:03:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:31 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:03:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:31 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:03:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:31 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:03:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:31 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:03:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:31 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T09:03:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:31 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T09:03:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:31 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:03:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:31 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:03:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:31 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:03:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:31 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:03:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:31 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:03:32.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:31 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T09:03:32.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:31 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T09:03:32.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:31 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:03:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:31 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:03:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:31 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:03:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:31 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:03:32.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:31 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:03:32.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:31 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T09:03:32.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:31 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T09:03:32.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:31 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:03:33.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:33 smithi186 ceph-mon[126480]: pgmap v10271: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 63 KiB/s wr, 6 op/s 2023-05-08T09:03:33.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:33 smithi133 ceph-mon[125939]: pgmap v10271: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 63 KiB/s wr, 6 op/s 2023-05-08T09:03:33.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:33 smithi096 ceph-mon[124666]: pgmap v10271: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 63 KiB/s wr, 6 op/s 2023-05-08T09:03:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19153.001523 secs 2023-05-08T09:03:34.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19153.001523 secs 2023-05-08T09:03:34.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19153.001523 secs 2023-05-08T09:03:35.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:35 smithi186 ceph-mon[126480]: pgmap v10272: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 63 KiB/s wr, 6 op/s 2023-05-08T09:03:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19153.558044 secs 2023-05-08T09:03:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:35 smithi133 ceph-mon[125939]: pgmap v10272: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 63 KiB/s wr, 6 op/s 2023-05-08T09:03:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19153.558044 secs 2023-05-08T09:03:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:35 smithi096 ceph-mon[124666]: pgmap v10272: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 63 KiB/s wr, 6 op/s 2023-05-08T09:03:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19153.558044 secs 2023-05-08T09:03:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19154.843611 secs 2023-05-08T09:03:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19154.843611 secs 2023-05-08T09:03:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19154.843611 secs 2023-05-08T09:03:37.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:37 smithi186 ceph-mon[126480]: pgmap v10273: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 63 KiB/s wr, 9 op/s 2023-05-08T09:03:37.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:37 smithi133 ceph-mon[125939]: pgmap v10273: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 63 KiB/s wr, 9 op/s 2023-05-08T09:03:37.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:37 smithi096 ceph-mon[124666]: pgmap v10273: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 63 KiB/s wr, 9 op/s 2023-05-08T09:03:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:39 smithi186 ceph-mon[126480]: pgmap v10274: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T09:03:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19158.001647 secs 2023-05-08T09:03:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:39 smithi133 ceph-mon[125939]: pgmap v10274: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T09:03:39.502 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19158.001647 secs 2023-05-08T09:03:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:39 smithi096 ceph-mon[124666]: pgmap v10274: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T09:03:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19158.001647 secs 2023-05-08T09:03:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19158.558189 secs 2023-05-08T09:03:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19158.558189 secs 2023-05-08T09:03:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19158.558189 secs 2023-05-08T09:03:41.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:41 smithi186 ceph-mon[126480]: pgmap v10275: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 62 KiB/s wr, 8 op/s 2023-05-08T09:03:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:41 smithi133 ceph-mon[125939]: pgmap v10275: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 62 KiB/s wr, 8 op/s 2023-05-08T09:03:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:41 smithi096 ceph-mon[124666]: pgmap v10275: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 62 KiB/s wr, 8 op/s 2023-05-08T09:03:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:43 smithi133 ceph-mon[125939]: pgmap v10276: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 255 B/s wr, 5 op/s 2023-05-08T09:03:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:43 smithi096 ceph-mon[124666]: pgmap v10276: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 255 B/s wr, 5 op/s 2023-05-08T09:03:43.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:43 smithi186 ceph-mon[126480]: pgmap v10276: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 255 B/s wr, 5 op/s 2023-05-08T09:03:44.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:44 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:03:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19163.001770 secs 2023-05-08T09:03:44.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:44 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:03:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19163.001770 secs 2023-05-08T09:03:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:44 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:03:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19163.001770 secs 2023-05-08T09:03:45.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:45 smithi133 ceph-mon[125939]: pgmap v10277: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 255 B/s wr, 5 op/s 2023-05-08T09:03:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19163.558315 secs 2023-05-08T09:03:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:45 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:03:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:45 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:03:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:45 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:03:45.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:45 smithi096 ceph-mon[124666]: pgmap v10277: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 255 B/s wr, 5 op/s 2023-05-08T09:03:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19163.558315 secs 2023-05-08T09:03:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:45 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:03:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:45 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:03:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:45 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:03:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:45 smithi186 ceph-mon[126480]: pgmap v10277: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 255 B/s wr, 5 op/s 2023-05-08T09:03:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19163.558315 secs 2023-05-08T09:03:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:45 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:03:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:45 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:03:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:45 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:03:47.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:47 smithi133 ceph-mon[125939]: pgmap v10278: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 96 KiB/s wr, 8 op/s 2023-05-08T09:03:47.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:47 smithi096 ceph-mon[124666]: pgmap v10278: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 96 KiB/s wr, 8 op/s 2023-05-08T09:03:47.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:47 smithi186 ceph-mon[126480]: pgmap v10278: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 96 KiB/s wr, 8 op/s 2023-05-08T09:03:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:49 smithi133 ceph-mon[125939]: pgmap v10279: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 96 KiB/s wr, 6 op/s 2023-05-08T09:03:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19168.001869 secs 2023-05-08T09:03:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:49 smithi096 ceph-mon[124666]: pgmap v10279: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 96 KiB/s wr, 6 op/s 2023-05-08T09:03:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19168.001869 secs 2023-05-08T09:03:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:49 smithi186 ceph-mon[126480]: pgmap v10279: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 96 KiB/s wr, 6 op/s 2023-05-08T09:03:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19168.001869 secs 2023-05-08T09:03:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:51 smithi133 ceph-mon[125939]: pgmap v10280: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 460 KiB/s wr, 12 op/s 2023-05-08T09:03:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:51 smithi096 ceph-mon[124666]: pgmap v10280: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 460 KiB/s wr, 12 op/s 2023-05-08T09:03:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:51 smithi186 ceph-mon[126480]: pgmap v10280: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 460 KiB/s wr, 12 op/s 2023-05-08T09:03:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:03:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:03:52.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:03:53.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:53 smithi133 ceph-mon[125939]: pgmap v10281: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 512 KiB/s rd, 460 KiB/s wr, 9 op/s 2023-05-08T09:03:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:53 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:03:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:03:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:03:53.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:53 smithi096 ceph-mon[124666]: pgmap v10281: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 512 KiB/s rd, 460 KiB/s wr, 9 op/s 2023-05-08T09:03:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:53 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:03:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:03:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:03:53.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:53 smithi186 ceph-mon[126480]: pgmap v10281: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 512 KiB/s rd, 460 KiB/s wr, 9 op/s 2023-05-08T09:03:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:53 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:03:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:03:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:03:54.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19173.001990 secs 2023-05-08T09:03:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19173.001990 secs 2023-05-08T09:03:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19173.001990 secs 2023-05-08T09:03:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:55 smithi133 ceph-mon[125939]: pgmap v10282: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 512 KiB/s rd, 460 KiB/s wr, 9 op/s 2023-05-08T09:03:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19173.558523 secs 2023-05-08T09:03:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:55 smithi096 ceph-mon[124666]: pgmap v10282: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 512 KiB/s rd, 460 KiB/s wr, 9 op/s 2023-05-08T09:03:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19173.558523 secs 2023-05-08T09:03:55.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:55 smithi186 ceph-mon[126480]: pgmap v10282: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 512 KiB/s rd, 460 KiB/s wr, 9 op/s 2023-05-08T09:03:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19173.558523 secs 2023-05-08T09:03:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:57 smithi133 ceph-mon[125939]: pgmap v10283: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 920 KiB/s rd, 722 KiB/s wr, 14 op/s 2023-05-08T09:03:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:03:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:03:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:57 smithi096 ceph-mon[124666]: pgmap v10283: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 920 KiB/s rd, 722 KiB/s wr, 14 op/s 2023-05-08T09:03:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:03:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:03:57.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:57 smithi186 ceph-mon[126480]: pgmap v10283: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 920 KiB/s rd, 722 KiB/s wr, 14 op/s 2023-05-08T09:03:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:03:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:03:58.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:58 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:03:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:58 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:03:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:58 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:03:59.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:59 smithi133 ceph-mon[125939]: pgmap v10284: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 626 KiB/s wr, 11 op/s 2023-05-08T09:03:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:03:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19178.002120 secs 2023-05-08T09:03:59.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:59 smithi096 ceph-mon[124666]: pgmap v10284: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 626 KiB/s wr, 11 op/s 2023-05-08T09:03:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:03:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19178.002120 secs 2023-05-08T09:03:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:59 smithi186 ceph-mon[126480]: pgmap v10284: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 626 KiB/s wr, 11 op/s 2023-05-08T09:03:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:03:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19178.002120 secs 2023-05-08T09:04:00.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19178.558647 secs 2023-05-08T09:04:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19178.558647 secs 2023-05-08T09:04:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19178.558647 secs 2023-05-08T09:04:01.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:01 smithi133 ceph-mon[125939]: pgmap v10285: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 788 KiB/s rd, 719 KiB/s wr, 15 op/s 2023-05-08T09:04:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:01 smithi096 ceph-mon[124666]: pgmap v10285: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 788 KiB/s rd, 719 KiB/s wr, 15 op/s 2023-05-08T09:04:01.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:01 smithi186 ceph-mon[126480]: pgmap v10285: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 788 KiB/s rd, 719 KiB/s wr, 15 op/s 2023-05-08T09:04:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:03 smithi133 ceph-mon[125939]: pgmap v10286: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 355 KiB/s wr, 10 op/s 2023-05-08T09:04:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:03 smithi096 ceph-mon[124666]: pgmap v10286: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 355 KiB/s wr, 10 op/s 2023-05-08T09:04:03.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:03 smithi186 ceph-mon[126480]: pgmap v10286: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 355 KiB/s wr, 10 op/s 2023-05-08T09:04:04.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19183.002240 secs 2023-05-08T09:04:04.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19183.002240 secs 2023-05-08T09:04:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19183.002240 secs 2023-05-08T09:04:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:05 smithi133 ceph-mon[125939]: pgmap v10287: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 355 KiB/s wr, 10 op/s 2023-05-08T09:04:05.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:05 smithi096 ceph-mon[124666]: pgmap v10287: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 355 KiB/s wr, 10 op/s 2023-05-08T09:04:05.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:05 smithi186 ceph-mon[126480]: pgmap v10287: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 355 KiB/s wr, 10 op/s 2023-05-08T09:04:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19184.844313 secs 2023-05-08T09:04:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19184.844313 secs 2023-05-08T09:04:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19184.844313 secs 2023-05-08T09:04:07.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:07 smithi133 ceph-mon[125939]: pgmap v10288: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 697 KiB/s rd, 544 KiB/s wr, 16 op/s 2023-05-08T09:04:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:07 smithi096 ceph-mon[124666]: pgmap v10288: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 697 KiB/s rd, 544 KiB/s wr, 16 op/s 2023-05-08T09:04:07.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:07 smithi186 ceph-mon[126480]: pgmap v10288: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 697 KiB/s rd, 544 KiB/s wr, 16 op/s 2023-05-08T09:04:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:08 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:04:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:04:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:04:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:08 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:04:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:08 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:04:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:04:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:04:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:08 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:04:08.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:08 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:04:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:04:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:04:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:08 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:04:09.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:09 smithi133 ceph-mon[125939]: pgmap v10289: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 288 KiB/s rd, 282 KiB/s wr, 11 op/s 2023-05-08T09:04:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:04:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:04:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19188.002364 secs 2023-05-08T09:04:09.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:09 smithi096 ceph-mon[124666]: pgmap v10289: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 288 KiB/s rd, 282 KiB/s wr, 11 op/s 2023-05-08T09:04:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:04:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:04:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19188.002364 secs 2023-05-08T09:04:09.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:09 smithi186 ceph-mon[126480]: pgmap v10289: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 288 KiB/s rd, 282 KiB/s wr, 11 op/s 2023-05-08T09:04:09.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:04:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:04:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19188.002364 secs 2023-05-08T09:04:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19188.558862 secs 2023-05-08T09:04:10.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19188.558862 secs 2023-05-08T09:04:10.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19188.558862 secs 2023-05-08T09:04:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:11 smithi133 ceph-mon[125939]: pgmap v10290: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 588 KiB/s wr, 29 op/s 2023-05-08T09:04:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19189.844379 secs 2023-05-08T09:04:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:11 smithi133 ceph-mon[125939]: osdmap e720: 12 total, 12 up, 12 in 2023-05-08T09:04:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:11 smithi096 ceph-mon[124666]: pgmap v10290: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 588 KiB/s wr, 29 op/s 2023-05-08T09:04:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19189.844379 secs 2023-05-08T09:04:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:11 smithi096 ceph-mon[124666]: osdmap e720: 12 total, 12 up, 12 in 2023-05-08T09:04:11.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:11 smithi186 ceph-mon[126480]: pgmap v10290: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 588 KiB/s wr, 29 op/s 2023-05-08T09:04:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19189.844379 secs 2023-05-08T09:04:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:11 smithi186 ceph-mon[126480]: osdmap e720: 12 total, 12 up, 12 in 2023-05-08T09:04:12.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:12 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:04:12.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:12 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:04:12.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:12 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:04:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:12 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:04:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:12 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:04:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:12 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:04:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:12 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:04:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:12 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:04:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:12 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:04:13.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:13 smithi186 ceph-mon[126480]: pgmap v10292: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 585 KiB/s rd, 594 KiB/s wr, 29 op/s 2023-05-08T09:04:13.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:13 smithi133 ceph-mon[125939]: pgmap v10292: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 585 KiB/s rd, 594 KiB/s wr, 29 op/s 2023-05-08T09:04:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:13 smithi096 ceph-mon[124666]: pgmap v10292: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 585 KiB/s rd, 594 KiB/s wr, 29 op/s 2023-05-08T09:04:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19193.002456 secs 2023-05-08T09:04:14.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19193.002456 secs 2023-05-08T09:04:14.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19193.002456 secs 2023-05-08T09:04:15.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:15 smithi186 ceph-mon[126480]: pgmap v10293: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 585 KiB/s rd, 594 KiB/s wr, 29 op/s 2023-05-08T09:04:15.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19193.558980 secs 2023-05-08T09:04:15.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:15 smithi133 ceph-mon[125939]: pgmap v10293: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 585 KiB/s rd, 594 KiB/s wr, 29 op/s 2023-05-08T09:04:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19193.558980 secs 2023-05-08T09:04:15.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:15 smithi096 ceph-mon[124666]: pgmap v10293: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 585 KiB/s rd, 594 KiB/s wr, 29 op/s 2023-05-08T09:04:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19193.558980 secs 2023-05-08T09:04:16.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19194.844473 secs 2023-05-08T09:04:16.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19194.844473 secs 2023-05-08T09:04:16.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19194.844473 secs 2023-05-08T09:04:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:17 smithi186 ceph-mon[126480]: pgmap v10294: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 442 KiB/s wr, 26 op/s 2023-05-08T09:04:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:17 smithi133 ceph-mon[125939]: pgmap v10294: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 442 KiB/s wr, 26 op/s 2023-05-08T09:04:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:17 smithi096 ceph-mon[124666]: pgmap v10294: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 442 KiB/s wr, 26 op/s 2023-05-08T09:04:19.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:18 smithi186 ceph-mon[126480]: pgmap v10295: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 442 KiB/s wr, 26 op/s 2023-05-08T09:04:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:18 smithi186 ceph-mon[126480]: osdmap e721: 12 total, 12 up, 12 in 2023-05-08T09:04:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:18 smithi133 ceph-mon[125939]: pgmap v10295: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 442 KiB/s wr, 26 op/s 2023-05-08T09:04:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:18 smithi133 ceph-mon[125939]: osdmap e721: 12 total, 12 up, 12 in 2023-05-08T09:04:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:18 smithi096 ceph-mon[124666]: pgmap v10295: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 442 KiB/s wr, 26 op/s 2023-05-08T09:04:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:18 smithi096 ceph-mon[124666]: osdmap e721: 12 total, 12 up, 12 in 2023-05-08T09:04:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19198.002583 secs 2023-05-08T09:04:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19198.559114 secs 2023-05-08T09:04:20.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19198.002583 secs 2023-05-08T09:04:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19198.559114 secs 2023-05-08T09:04:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19198.002583 secs 2023-05-08T09:04:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19198.559114 secs 2023-05-08T09:04:21.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:20 smithi186 ceph-mon[126480]: pgmap v10297: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 162 KiB/s wr, 8 op/s 2023-05-08T09:04:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19199.844612 secs 2023-05-08T09:04:21.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:20 smithi133 ceph-mon[125939]: pgmap v10297: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 162 KiB/s wr, 8 op/s 2023-05-08T09:04:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19199.844612 secs 2023-05-08T09:04:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:20 smithi096 ceph-mon[124666]: pgmap v10297: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 162 KiB/s wr, 8 op/s 2023-05-08T09:04:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19199.844612 secs 2023-05-08T09:04:23.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:22 smithi186 ceph-mon[126480]: pgmap v10298: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 156 KiB/s wr, 8 op/s 2023-05-08T09:04:23.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:22 smithi133 ceph-mon[125939]: pgmap v10298: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 156 KiB/s wr, 8 op/s 2023-05-08T09:04:23.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:22 smithi096 ceph-mon[124666]: pgmap v10298: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 156 KiB/s wr, 8 op/s 2023-05-08T09:04:25.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19203.002681 secs 2023-05-08T09:04:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:24 smithi186 ceph-mon[126480]: pgmap v10299: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 156 KiB/s wr, 8 op/s 2023-05-08T09:04:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19203.559205 secs 2023-05-08T09:04:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19203.002681 secs 2023-05-08T09:04:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:24 smithi133 ceph-mon[125939]: pgmap v10299: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 156 KiB/s wr, 8 op/s 2023-05-08T09:04:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19203.559205 secs 2023-05-08T09:04:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19203.002681 secs 2023-05-08T09:04:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:24 smithi096 ceph-mon[124666]: pgmap v10299: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 156 KiB/s wr, 8 op/s 2023-05-08T09:04:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19203.559205 secs 2023-05-08T09:04:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19204.844733 secs 2023-05-08T09:04:26.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19204.844733 secs 2023-05-08T09:04:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19204.844733 secs 2023-05-08T09:04:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:26 smithi186 ceph-mon[126480]: pgmap v10300: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 81 KiB/s wr, 7 op/s 2023-05-08T09:04:27.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:26 smithi133 ceph-mon[125939]: pgmap v10300: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 81 KiB/s wr, 7 op/s 2023-05-08T09:04:27.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:26 smithi096 ceph-mon[124666]: pgmap v10300: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 81 KiB/s wr, 7 op/s 2023-05-08T09:04:29.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:28 smithi186 ceph-mon[126480]: pgmap v10301: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 81 KiB/s wr, 7 op/s 2023-05-08T09:04:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:28 smithi133 ceph-mon[125939]: pgmap v10301: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 81 KiB/s wr, 7 op/s 2023-05-08T09:04:29.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:28 smithi096 ceph-mon[124666]: pgmap v10301: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 81 KiB/s wr, 7 op/s 2023-05-08T09:04:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19208.002806 secs 2023-05-08T09:04:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19208.559345 secs 2023-05-08T09:04:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19208.002806 secs 2023-05-08T09:04:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19208.559345 secs 2023-05-08T09:04:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19208.002806 secs 2023-05-08T09:04:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19208.559345 secs 2023-05-08T09:04:31.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:30 smithi186 ceph-mon[126480]: pgmap v10302: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 127 KiB/s wr, 9 op/s 2023-05-08T09:04:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19209.844861 secs 2023-05-08T09:04:31.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:30 smithi133 ceph-mon[125939]: pgmap v10302: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 127 KiB/s wr, 9 op/s 2023-05-08T09:04:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19209.844861 secs 2023-05-08T09:04:31.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:30 smithi096 ceph-mon[124666]: pgmap v10302: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 127 KiB/s wr, 9 op/s 2023-05-08T09:04:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19209.844861 secs 2023-05-08T09:04:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:31 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:04:32.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:31 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:04:32.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:31 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:04:33.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:32 smithi186 ceph-mon[126480]: pgmap v10303: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 60 KiB/s wr, 6 op/s 2023-05-08T09:04:33.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:04:33.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:04:33.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:32 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:04:33.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:04:33.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:32 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T09:04:33.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:32 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T09:04:33.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:32 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:04:33.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:32 smithi133 ceph-mon[125939]: pgmap v10303: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 60 KiB/s wr, 6 op/s 2023-05-08T09:04:33.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:04:33.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:04:33.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:32 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:04:33.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:04:33.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:32 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T09:04:33.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:32 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T09:04:33.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:32 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:04:33.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:32 smithi096 ceph-mon[124666]: pgmap v10303: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 60 KiB/s wr, 6 op/s 2023-05-08T09:04:33.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:04:33.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:04:33.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:32 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:04:33.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:04:33.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:32 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T09:04:33.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:32 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T09:04:33.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:32 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:04:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19213.002874 secs 2023-05-08T09:04:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:34 smithi186 ceph-mon[126480]: pgmap v10304: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 60 KiB/s wr, 6 op/s 2023-05-08T09:04:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19213.559500 secs 2023-05-08T09:04:35.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19213.002874 secs 2023-05-08T09:04:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:34 smithi133 ceph-mon[125939]: pgmap v10304: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 60 KiB/s wr, 6 op/s 2023-05-08T09:04:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19213.559500 secs 2023-05-08T09:04:35.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19213.002874 secs 2023-05-08T09:04:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:34 smithi096 ceph-mon[124666]: pgmap v10304: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 60 KiB/s wr, 6 op/s 2023-05-08T09:04:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19213.559500 secs 2023-05-08T09:04:36.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19214.844998 secs 2023-05-08T09:04:36.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19214.844998 secs 2023-05-08T09:04:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19214.844998 secs 2023-05-08T09:04:37.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:36 smithi133 ceph-mon[125939]: pgmap v10305: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 122 KiB/s wr, 9 op/s 2023-05-08T09:04:37.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:36 smithi096 ceph-mon[124666]: pgmap v10305: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 122 KiB/s wr, 9 op/s 2023-05-08T09:04:37.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:36 smithi186 ceph-mon[126480]: pgmap v10305: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 122 KiB/s wr, 9 op/s 2023-05-08T09:04:39.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:38 smithi133 ceph-mon[125939]: pgmap v10306: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 122 KiB/s wr, 6 op/s 2023-05-08T09:04:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:38 smithi096 ceph-mon[124666]: pgmap v10306: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 122 KiB/s wr, 6 op/s 2023-05-08T09:04:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:38 smithi186 ceph-mon[126480]: pgmap v10306: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 122 KiB/s wr, 6 op/s 2023-05-08T09:04:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19218.003023 secs 2023-05-08T09:04:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19218.559635 secs 2023-05-08T09:04:40.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19218.003023 secs 2023-05-08T09:04:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19218.559635 secs 2023-05-08T09:04:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19218.003023 secs 2023-05-08T09:04:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19218.559635 secs 2023-05-08T09:04:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:40 smithi133 ceph-mon[125939]: pgmap v10307: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 128 KiB/s wr, 9 op/s 2023-05-08T09:04:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:40 smithi096 ceph-mon[124666]: pgmap v10307: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 128 KiB/s wr, 9 op/s 2023-05-08T09:04:41.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:40 smithi186 ceph-mon[126480]: pgmap v10307: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 128 KiB/s wr, 9 op/s 2023-05-08T09:04:43.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:42 smithi133 ceph-mon[125939]: pgmap v10308: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 69 KiB/s wr, 6 op/s 2023-05-08T09:04:43.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:42 smithi096 ceph-mon[124666]: pgmap v10308: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 69 KiB/s wr, 6 op/s 2023-05-08T09:04:43.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:42 smithi186 ceph-mon[126480]: pgmap v10308: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 69 KiB/s wr, 6 op/s 2023-05-08T09:04:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:04:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:04:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:04:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19223.003159 secs 2023-05-08T09:04:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:44 smithi133 ceph-mon[125939]: pgmap v10309: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 69 KiB/s wr, 6 op/s 2023-05-08T09:04:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19223.559758 secs 2023-05-08T09:04:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:04:45.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:04:45.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:04:45.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19223.003159 secs 2023-05-08T09:04:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:44 smithi096 ceph-mon[124666]: pgmap v10309: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 69 KiB/s wr, 6 op/s 2023-05-08T09:04:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19223.559758 secs 2023-05-08T09:04:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:04:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:04:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:04:45.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19223.003159 secs 2023-05-08T09:04:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:44 smithi186 ceph-mon[126480]: pgmap v10309: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 69 KiB/s wr, 6 op/s 2023-05-08T09:04:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19223.559758 secs 2023-05-08T09:04:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:04:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:04:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:04:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:46 smithi133 ceph-mon[125939]: pgmap v10310: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 187 KiB/s wr, 10 op/s 2023-05-08T09:04:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:46 smithi096 ceph-mon[124666]: pgmap v10310: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 187 KiB/s wr, 10 op/s 2023-05-08T09:04:47.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:46 smithi186 ceph-mon[126480]: pgmap v10310: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 187 KiB/s wr, 10 op/s 2023-05-08T09:04:49.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:48 smithi133 ceph-mon[125939]: pgmap v10311: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 125 KiB/s wr, 6 op/s 2023-05-08T09:04:49.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:48 smithi096 ceph-mon[124666]: pgmap v10311: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 125 KiB/s wr, 6 op/s 2023-05-08T09:04:49.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:48 smithi186 ceph-mon[126480]: pgmap v10311: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 125 KiB/s wr, 6 op/s 2023-05-08T09:04:50.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19228.003288 secs 2023-05-08T09:04:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19228.003288 secs 2023-05-08T09:04:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19228.003288 secs 2023-05-08T09:04:51.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:50 smithi133 ceph-mon[125939]: pgmap v10312: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 314 KiB/s wr, 11 op/s 2023-05-08T09:04:51.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:50 smithi096 ceph-mon[124666]: pgmap v10312: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 314 KiB/s wr, 11 op/s 2023-05-08T09:04:51.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:50 smithi186 ceph-mon[126480]: pgmap v10312: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 314 KiB/s wr, 11 op/s 2023-05-08T09:04:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:04:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:04:52.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:04:53.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:52 smithi133 ceph-mon[125939]: pgmap v10313: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 322 KiB/s rd, 307 KiB/s wr, 8 op/s 2023-05-08T09:04:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:52 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:04:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:04:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:04:53.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:52 smithi096 ceph-mon[124666]: pgmap v10313: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 322 KiB/s rd, 307 KiB/s wr, 8 op/s 2023-05-08T09:04:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:52 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:04:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:04:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:04:53.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:52 smithi186 ceph-mon[126480]: pgmap v10313: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 322 KiB/s rd, 307 KiB/s wr, 8 op/s 2023-05-08T09:04:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:52 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:04:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:04:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:04:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19233.003412 secs 2023-05-08T09:04:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:54 smithi133 ceph-mon[125939]: pgmap v10314: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 322 KiB/s rd, 307 KiB/s wr, 8 op/s 2023-05-08T09:04:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19233.560022 secs 2023-05-08T09:04:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19233.003412 secs 2023-05-08T09:04:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:54 smithi096 ceph-mon[124666]: pgmap v10314: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 322 KiB/s rd, 307 KiB/s wr, 8 op/s 2023-05-08T09:04:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19233.560022 secs 2023-05-08T09:04:55.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19233.003412 secs 2023-05-08T09:04:55.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:54 smithi186 ceph-mon[126480]: pgmap v10314: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 322 KiB/s rd, 307 KiB/s wr, 8 op/s 2023-05-08T09:04:55.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19233.560022 secs 2023-05-08T09:04:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19234.845494 secs 2023-05-08T09:04:56.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19234.845494 secs 2023-05-08T09:04:56.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19234.845494 secs 2023-05-08T09:04:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:56 smithi133 ceph-mon[125939]: pgmap v10315: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 538 KiB/s wr, 14 op/s 2023-05-08T09:04:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:04:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:04:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:04:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:56 smithi096 ceph-mon[124666]: pgmap v10315: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 538 KiB/s wr, 14 op/s 2023-05-08T09:04:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:04:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:04:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:04:57.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:56 smithi186 ceph-mon[126480]: pgmap v10315: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 538 KiB/s wr, 14 op/s 2023-05-08T09:04:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:04:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:04:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:04:58.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:57 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:04:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:57 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:04:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:57 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:04:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:58 smithi133 ceph-mon[125939]: pgmap v10316: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 420 KiB/s wr, 11 op/s 2023-05-08T09:04:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:58 smithi096 ceph-mon[124666]: pgmap v10316: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 420 KiB/s wr, 11 op/s 2023-05-08T09:04:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:58 smithi186 ceph-mon[126480]: pgmap v10316: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 420 KiB/s wr, 11 op/s 2023-05-08T09:05:00.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19238.003530 secs 2023-05-08T09:05:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:04:59 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:05:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19238.003530 secs 2023-05-08T09:05:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:04:59 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:05:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19238.003530 secs 2023-05-08T09:05:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:04:59 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:05:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:00 smithi133 ceph-mon[125939]: pgmap v10317: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 525 KiB/s rd, 512 KiB/s wr, 15 op/s 2023-05-08T09:05:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:05:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:05:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19239.845604 secs 2023-05-08T09:05:01.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:00 smithi096 ceph-mon[124666]: pgmap v10317: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 525 KiB/s rd, 512 KiB/s wr, 15 op/s 2023-05-08T09:05:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:05:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:05:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19239.845604 secs 2023-05-08T09:05:01.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:00 smithi186 ceph-mon[126480]: pgmap v10317: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 525 KiB/s rd, 512 KiB/s wr, 15 op/s 2023-05-08T09:05:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:05:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:05:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19239.845604 secs 2023-05-08T09:05:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:02 smithi133 ceph-mon[125939]: pgmap v10318: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 323 KiB/s wr, 11 op/s 2023-05-08T09:05:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:02 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:05:03.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:02 smithi096 ceph-mon[124666]: pgmap v10318: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 323 KiB/s wr, 11 op/s 2023-05-08T09:05:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:02 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:05:03.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:02 smithi186 ceph-mon[126480]: pgmap v10318: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 323 KiB/s wr, 11 op/s 2023-05-08T09:05:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:02 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:05:04.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19243.003695 secs 2023-05-08T09:05:04.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19243.003695 secs 2023-05-08T09:05:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19243.003695 secs 2023-05-08T09:05:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:04 smithi133 ceph-mon[125939]: pgmap v10319: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 323 KiB/s wr, 11 op/s 2023-05-08T09:05:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19243.560253 secs 2023-05-08T09:05:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:04 smithi096 ceph-mon[124666]: pgmap v10319: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 323 KiB/s wr, 11 op/s 2023-05-08T09:05:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19243.560253 secs 2023-05-08T09:05:05.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:04 smithi186 ceph-mon[126480]: pgmap v10319: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 323 KiB/s wr, 11 op/s 2023-05-08T09:05:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19243.560253 secs 2023-05-08T09:05:06.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19244.845722 secs 2023-05-08T09:05:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19244.845722 secs 2023-05-08T09:05:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19244.845722 secs 2023-05-08T09:05:07.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:06 smithi133 ceph-mon[125939]: pgmap v10320: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 455 KiB/s rd, 478 KiB/s wr, 30 op/s 2023-05-08T09:05:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:06 smithi133 ceph-mon[125939]: osdmap e722: 12 total, 12 up, 12 in 2023-05-08T09:05:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:06 smithi096 ceph-mon[124666]: pgmap v10320: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 455 KiB/s rd, 478 KiB/s wr, 30 op/s 2023-05-08T09:05:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:06 smithi096 ceph-mon[124666]: osdmap e722: 12 total, 12 up, 12 in 2023-05-08T09:05:07.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:06 smithi186 ceph-mon[126480]: pgmap v10320: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 455 KiB/s rd, 478 KiB/s wr, 30 op/s 2023-05-08T09:05:07.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:06 smithi186 ceph-mon[126480]: osdmap e722: 12 total, 12 up, 12 in 2023-05-08T09:05:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:08 smithi186 ceph-mon[126480]: pgmap v10322: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 255 KiB/s rd, 296 KiB/s wr, 28 op/s 2023-05-08T09:05:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:08 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:05:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:05:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:05:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:08 smithi133 ceph-mon[125939]: pgmap v10322: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 255 KiB/s rd, 296 KiB/s wr, 28 op/s 2023-05-08T09:05:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:08 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:05:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:05:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:05:09.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:08 smithi096 ceph-mon[124666]: pgmap v10322: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 255 KiB/s rd, 296 KiB/s wr, 28 op/s 2023-05-08T09:05:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:08 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:05:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:05:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:05:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19248.003802 secs 2023-05-08T09:05:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19248.560368 secs 2023-05-08T09:05:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19248.003802 secs 2023-05-08T09:05:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19248.560368 secs 2023-05-08T09:05:10.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19248.003802 secs 2023-05-08T09:05:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19248.560368 secs 2023-05-08T09:05:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:10 smithi186 ceph-mon[126480]: pgmap v10323: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 343 KiB/s wr, 27 op/s 2023-05-08T09:05:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19249.845846 secs 2023-05-08T09:05:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:10 smithi133 ceph-mon[125939]: pgmap v10323: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 343 KiB/s wr, 27 op/s 2023-05-08T09:05:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19249.845846 secs 2023-05-08T09:05:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:10 smithi096 ceph-mon[124666]: pgmap v10323: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 343 KiB/s wr, 27 op/s 2023-05-08T09:05:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19249.845846 secs 2023-05-08T09:05:13.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:12 smithi186 ceph-mon[126480]: pgmap v10324: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 343 KiB/s wr, 27 op/s 2023-05-08T09:05:13.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:12 smithi186 ceph-mon[126480]: osdmap e723: 12 total, 12 up, 12 in 2023-05-08T09:05:13.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:12 smithi133 ceph-mon[125939]: pgmap v10324: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 343 KiB/s wr, 27 op/s 2023-05-08T09:05:13.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:12 smithi133 ceph-mon[125939]: osdmap e723: 12 total, 12 up, 12 in 2023-05-08T09:05:13.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:12 smithi096 ceph-mon[124666]: pgmap v10324: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 343 KiB/s wr, 27 op/s 2023-05-08T09:05:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:12 smithi096 ceph-mon[124666]: osdmap e723: 12 total, 12 up, 12 in 2023-05-08T09:05:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19253.003896 secs 2023-05-08T09:05:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:14 smithi186 ceph-mon[126480]: pgmap v10326: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 197 KiB/s wr, 6 op/s 2023-05-08T09:05:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19253.560501 secs 2023-05-08T09:05:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19253.003896 secs 2023-05-08T09:05:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:14 smithi133 ceph-mon[125939]: pgmap v10326: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 197 KiB/s wr, 6 op/s 2023-05-08T09:05:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19253.560501 secs 2023-05-08T09:05:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19253.003896 secs 2023-05-08T09:05:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:14 smithi096 ceph-mon[124666]: pgmap v10326: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 197 KiB/s wr, 6 op/s 2023-05-08T09:05:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19253.560501 secs 2023-05-08T09:05:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19254.845956 secs 2023-05-08T09:05:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19254.845956 secs 2023-05-08T09:05:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19254.845956 secs 2023-05-08T09:05:17.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:16 smithi186 ceph-mon[126480]: pgmap v10327: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 219 KiB/s wr, 9 op/s 2023-05-08T09:05:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:16 smithi133 ceph-mon[125939]: pgmap v10327: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 219 KiB/s wr, 9 op/s 2023-05-08T09:05:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:16 smithi096 ceph-mon[124666]: pgmap v10327: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 219 KiB/s wr, 9 op/s 2023-05-08T09:05:19.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:18 smithi186 ceph-mon[126480]: pgmap v10328: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 216 KiB/s wr, 8 op/s 2023-05-08T09:05:19.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:18 smithi133 ceph-mon[125939]: pgmap v10328: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 216 KiB/s wr, 8 op/s 2023-05-08T09:05:19.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:18 smithi096 ceph-mon[124666]: pgmap v10328: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 216 KiB/s wr, 8 op/s 2023-05-08T09:05:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19258.004037 secs 2023-05-08T09:05:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19258.560611 secs 2023-05-08T09:05:20.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19258.004037 secs 2023-05-08T09:05:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19258.560611 secs 2023-05-08T09:05:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19258.004037 secs 2023-05-08T09:05:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19258.560611 secs 2023-05-08T09:05:21.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:20 smithi186 ceph-mon[126480]: pgmap v10329: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 58 KiB/s wr, 7 op/s 2023-05-08T09:05:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19259.846082 secs 2023-05-08T09:05:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:20 smithi133 ceph-mon[125939]: pgmap v10329: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 58 KiB/s wr, 7 op/s 2023-05-08T09:05:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19259.846082 secs 2023-05-08T09:05:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:20 smithi096 ceph-mon[124666]: pgmap v10329: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 58 KiB/s wr, 7 op/s 2023-05-08T09:05:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19259.846082 secs 2023-05-08T09:05:23.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:22 smithi186 ceph-mon[126480]: pgmap v10330: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 58 KiB/s wr, 7 op/s 2023-05-08T09:05:23.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:22 smithi133 ceph-mon[125939]: pgmap v10330: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 58 KiB/s wr, 7 op/s 2023-05-08T09:05:23.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:22 smithi096 ceph-mon[124666]: pgmap v10330: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 58 KiB/s wr, 7 op/s 2023-05-08T09:05:25.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19263.004157 secs 2023-05-08T09:05:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:24 smithi133 ceph-mon[125939]: pgmap v10331: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 53 KiB/s wr, 6 op/s 2023-05-08T09:05:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19263.560728 secs 2023-05-08T09:05:25.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19263.004157 secs 2023-05-08T09:05:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:24 smithi096 ceph-mon[124666]: pgmap v10331: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 53 KiB/s wr, 6 op/s 2023-05-08T09:05:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19263.560728 secs 2023-05-08T09:05:25.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19263.004157 secs 2023-05-08T09:05:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:24 smithi186 ceph-mon[126480]: pgmap v10331: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 53 KiB/s wr, 6 op/s 2023-05-08T09:05:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19263.560728 secs 2023-05-08T09:05:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19264.846204 secs 2023-05-08T09:05:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19264.846204 secs 2023-05-08T09:05:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19264.846204 secs 2023-05-08T09:05:27.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:26 smithi133 ceph-mon[125939]: pgmap v10332: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 49 KiB/s wr, 8 op/s 2023-05-08T09:05:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:26 smithi096 ceph-mon[124666]: pgmap v10332: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 49 KiB/s wr, 8 op/s 2023-05-08T09:05:27.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:26 smithi186 ceph-mon[126480]: pgmap v10332: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 49 KiB/s wr, 8 op/s 2023-05-08T09:05:29.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:28 smithi133 ceph-mon[125939]: pgmap v10333: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:05:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:28 smithi096 ceph-mon[124666]: pgmap v10333: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:05:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:28 smithi186 ceph-mon[126480]: pgmap v10333: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:05:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19268.004283 secs 2023-05-08T09:05:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19268.560835 secs 2023-05-08T09:05:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19268.004283 secs 2023-05-08T09:05:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19268.560835 secs 2023-05-08T09:05:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19268.004283 secs 2023-05-08T09:05:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19268.560835 secs 2023-05-08T09:05:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:30 smithi133 ceph-mon[125939]: pgmap v10334: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T09:05:31.248 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19269.846322 secs 2023-05-08T09:05:31.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:30 smithi096 ceph-mon[124666]: pgmap v10334: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T09:05:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19269.846322 secs 2023-05-08T09:05:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:30 smithi186 ceph-mon[126480]: pgmap v10334: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T09:05:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19269.846322 secs 2023-05-08T09:05:33.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:32 smithi133 ceph-mon[125939]: pgmap v10335: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:05:33.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:05:33.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:05:33.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:05:33.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:32 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:05:33.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:05:33.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:32 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T09:05:33.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:32 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T09:05:33.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:32 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:05:33.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:32 smithi096 ceph-mon[124666]: pgmap v10335: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:05:33.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:05:33.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:05:33.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:05:33.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:32 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:05:33.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:05:33.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:32 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T09:05:33.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:32 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T09:05:33.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:32 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:05:33.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:32 smithi186 ceph-mon[126480]: pgmap v10335: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:05:33.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:05:33.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:05:33.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:05:33.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:32 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:05:33.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:05:33.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:32 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T09:05:33.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:32 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T09:05:33.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:32 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:05:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19273.004366 secs 2023-05-08T09:05:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:34 smithi133 ceph-mon[125939]: pgmap v10336: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:05:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19273.560972 secs 2023-05-08T09:05:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19273.004366 secs 2023-05-08T09:05:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:34 smithi096 ceph-mon[124666]: pgmap v10336: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:05:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19273.560972 secs 2023-05-08T09:05:35.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19273.004366 secs 2023-05-08T09:05:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:34 smithi186 ceph-mon[126480]: pgmap v10336: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:05:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19273.560972 secs 2023-05-08T09:05:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19274.846438 secs 2023-05-08T09:05:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19274.846438 secs 2023-05-08T09:05:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19274.846438 secs 2023-05-08T09:05:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:36 smithi133 ceph-mon[125939]: pgmap v10337: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 8 op/s 2023-05-08T09:05:37.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:36 smithi096 ceph-mon[124666]: pgmap v10337: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 8 op/s 2023-05-08T09:05:37.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:36 smithi186 ceph-mon[126480]: pgmap v10337: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 8 op/s 2023-05-08T09:05:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:38 smithi133 ceph-mon[125939]: pgmap v10338: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 767 B/s wr, 5 op/s 2023-05-08T09:05:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:38 smithi096 ceph-mon[124666]: pgmap v10338: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 767 B/s wr, 5 op/s 2023-05-08T09:05:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:38 smithi186 ceph-mon[126480]: pgmap v10338: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 767 B/s wr, 5 op/s 2023-05-08T09:05:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19278.004490 secs 2023-05-08T09:05:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19278.561083 secs 2023-05-08T09:05:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19278.004490 secs 2023-05-08T09:05:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19278.561083 secs 2023-05-08T09:05:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19278.004490 secs 2023-05-08T09:05:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19278.561083 secs 2023-05-08T09:05:41.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:40 smithi133 ceph-mon[125939]: pgmap v10339: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 208 KiB/s wr, 10 op/s 2023-05-08T09:05:41.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:40 smithi096 ceph-mon[124666]: pgmap v10339: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 208 KiB/s wr, 10 op/s 2023-05-08T09:05:41.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:40 smithi186 ceph-mon[126480]: pgmap v10339: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 208 KiB/s wr, 10 op/s 2023-05-08T09:05:43.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:42 smithi133 ceph-mon[125939]: pgmap v10340: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 208 KiB/s wr, 7 op/s 2023-05-08T09:05:43.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:42 smithi096 ceph-mon[124666]: pgmap v10340: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 208 KiB/s wr, 7 op/s 2023-05-08T09:05:43.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:42 smithi186 ceph-mon[126480]: pgmap v10340: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 208 KiB/s wr, 7 op/s 2023-05-08T09:05:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:05:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:05:44.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:05:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19283.004570 secs 2023-05-08T09:05:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19283.561197 secs 2023-05-08T09:05:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:44 smithi133 ceph-mon[125939]: pgmap v10341: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 208 KiB/s wr, 7 op/s 2023-05-08T09:05:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:05:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:05:45.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:05:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19283.004570 secs 2023-05-08T09:05:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19283.561197 secs 2023-05-08T09:05:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:44 smithi096 ceph-mon[124666]: pgmap v10341: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 208 KiB/s wr, 7 op/s 2023-05-08T09:05:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:05:45.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:05:45.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:05:45.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19283.004570 secs 2023-05-08T09:05:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19283.561197 secs 2023-05-08T09:05:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:44 smithi186 ceph-mon[126480]: pgmap v10341: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 208 KiB/s wr, 7 op/s 2023-05-08T09:05:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:05:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:05:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:05:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:46 smithi133 ceph-mon[125939]: pgmap v10342: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 422 KiB/s wr, 13 op/s 2023-05-08T09:05:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:46 smithi096 ceph-mon[124666]: pgmap v10342: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 422 KiB/s wr, 13 op/s 2023-05-08T09:05:47.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:46 smithi186 ceph-mon[126480]: pgmap v10342: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 422 KiB/s wr, 13 op/s 2023-05-08T09:05:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:48 smithi133 ceph-mon[125939]: pgmap v10343: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 421 KiB/s wr, 10 op/s 2023-05-08T09:05:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:48 smithi096 ceph-mon[124666]: pgmap v10343: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 421 KiB/s wr, 10 op/s 2023-05-08T09:05:49.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:48 smithi186 ceph-mon[126480]: pgmap v10343: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 421 KiB/s wr, 10 op/s 2023-05-08T09:05:50.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19288.004693 secs 2023-05-08T09:05:50.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19288.004693 secs 2023-05-08T09:05:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19288.004693 secs 2023-05-08T09:05:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:50 smithi133 ceph-mon[125939]: pgmap v10344: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 794 KiB/s rd, 781 KiB/s wr, 15 op/s 2023-05-08T09:05:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19289.846816 secs 2023-05-08T09:05:51.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:50 smithi096 ceph-mon[124666]: pgmap v10344: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 794 KiB/s rd, 781 KiB/s wr, 15 op/s 2023-05-08T09:05:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19289.846816 secs 2023-05-08T09:05:51.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:50 smithi186 ceph-mon[126480]: pgmap v10344: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 794 KiB/s rd, 781 KiB/s wr, 15 op/s 2023-05-08T09:05:51.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19289.846816 secs 2023-05-08T09:05:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:05:52.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:05:52.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:05:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:52 smithi133 ceph-mon[125939]: pgmap v10345: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 651 KiB/s rd, 574 KiB/s wr, 10 op/s 2023-05-08T09:05:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:05:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:05:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:05:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:52 smithi096 ceph-mon[124666]: pgmap v10345: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 651 KiB/s rd, 574 KiB/s wr, 10 op/s 2023-05-08T09:05:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:05:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:05:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:05:53.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:52 smithi186 ceph-mon[126480]: pgmap v10345: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 651 KiB/s rd, 574 KiB/s wr, 10 op/s 2023-05-08T09:05:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:05:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:05:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:05:55.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19293.004756 secs 2023-05-08T09:05:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19293.561420 secs 2023-05-08T09:05:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:54 smithi133 ceph-mon[125939]: pgmap v10346: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 651 KiB/s rd, 574 KiB/s wr, 10 op/s 2023-05-08T09:05:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19293.004756 secs 2023-05-08T09:05:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19293.561420 secs 2023-05-08T09:05:55.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:54 smithi096 ceph-mon[124666]: pgmap v10346: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 651 KiB/s rd, 574 KiB/s wr, 10 op/s 2023-05-08T09:05:55.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19293.004756 secs 2023-05-08T09:05:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19293.561420 secs 2023-05-08T09:05:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:54 smithi186 ceph-mon[126480]: pgmap v10346: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 651 KiB/s rd, 574 KiB/s wr, 10 op/s 2023-05-08T09:05:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19294.846916 secs 2023-05-08T09:05:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19294.846916 secs 2023-05-08T09:05:56.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19294.846916 secs 2023-05-08T09:05:57.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:56 smithi133 ceph-mon[125939]: pgmap v10347: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 735 KiB/s rd, 831 KiB/s wr, 16 op/s 2023-05-08T09:05:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:56 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:05:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:05:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:05:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:56 smithi096 ceph-mon[124666]: pgmap v10347: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 735 KiB/s rd, 831 KiB/s wr, 16 op/s 2023-05-08T09:05:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:56 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:05:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:05:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:05:57.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:56 smithi186 ceph-mon[126480]: pgmap v10347: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 735 KiB/s rd, 831 KiB/s wr, 16 op/s 2023-05-08T09:05:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:56 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:05:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:05:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:05:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:58 smithi133 ceph-mon[125939]: pgmap v10348: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 618 KiB/s wr, 10 op/s 2023-05-08T09:05:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19298.004874 secs 2023-05-08T09:05:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:58 smithi096 ceph-mon[124666]: pgmap v10348: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 618 KiB/s wr, 10 op/s 2023-05-08T09:05:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19298.004874 secs 2023-05-08T09:05:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:58 smithi186 ceph-mon[126480]: pgmap v10348: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 618 KiB/s wr, 10 op/s 2023-05-08T09:05:59.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19298.004874 secs 2023-05-08T09:06:00.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:05:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19298.561532 secs 2023-05-08T09:06:00.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:05:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19298.561532 secs 2023-05-08T09:06:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:05:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19298.561532 secs 2023-05-08T09:06:01.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:00 smithi133 ceph-mon[125939]: pgmap v10349: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 618 KiB/s wr, 13 op/s 2023-05-08T09:06:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19299.847036 secs 2023-05-08T09:06:01.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:00 smithi096 ceph-mon[124666]: pgmap v10349: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 618 KiB/s wr, 13 op/s 2023-05-08T09:06:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19299.847036 secs 2023-05-08T09:06:01.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:00 smithi186 ceph-mon[126480]: pgmap v10349: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 618 KiB/s wr, 13 op/s 2023-05-08T09:06:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19299.847036 secs 2023-05-08T09:06:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:02 smithi133 ceph-mon[125939]: pgmap v10350: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 320 KiB/s wr, 9 op/s 2023-05-08T09:06:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:02 smithi096 ceph-mon[124666]: pgmap v10350: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 320 KiB/s wr, 9 op/s 2023-05-08T09:06:03.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:02 smithi186 ceph-mon[126480]: pgmap v10350: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 320 KiB/s wr, 9 op/s 2023-05-08T09:06:04.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19303.004948 secs 2023-05-08T09:06:04.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19303.004948 secs 2023-05-08T09:06:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19303.004948 secs 2023-05-08T09:06:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19303.561643 secs 2023-05-08T09:06:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:04 smithi133 ceph-mon[125939]: pgmap v10351: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 320 KiB/s wr, 9 op/s 2023-05-08T09:06:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19303.561643 secs 2023-05-08T09:06:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:04 smithi096 ceph-mon[124666]: pgmap v10351: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 320 KiB/s wr, 9 op/s 2023-05-08T09:06:05.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19303.561643 secs 2023-05-08T09:06:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:04 smithi186 ceph-mon[126480]: pgmap v10351: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 320 KiB/s wr, 9 op/s 2023-05-08T09:06:06.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19304.847100 secs 2023-05-08T09:06:06.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19304.847100 secs 2023-05-08T09:06:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19304.847100 secs 2023-05-08T09:06:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:06 smithi133 ceph-mon[125939]: pgmap v10352: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 414 KiB/s wr, 27 op/s 2023-05-08T09:06:07.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:06 smithi096 ceph-mon[124666]: pgmap v10352: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 414 KiB/s wr, 27 op/s 2023-05-08T09:06:07.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:06 smithi186 ceph-mon[126480]: pgmap v10352: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 414 KiB/s wr, 27 op/s 2023-05-08T09:06:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:08 smithi133 ceph-mon[125939]: pgmap v10353: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 156 KiB/s wr, 21 op/s 2023-05-08T09:06:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19308.005063 secs 2023-05-08T09:06:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:08 smithi096 ceph-mon[124666]: pgmap v10353: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 156 KiB/s wr, 21 op/s 2023-05-08T09:06:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19308.005063 secs 2023-05-08T09:06:09.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:08 smithi186 ceph-mon[126480]: pgmap v10353: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 156 KiB/s wr, 21 op/s 2023-05-08T09:06:09.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19308.005063 secs 2023-05-08T09:06:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19308.561744 secs 2023-05-08T09:06:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19308.561744 secs 2023-05-08T09:06:10.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19308.561744 secs 2023-05-08T09:06:11.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:10 smithi096 ceph-mon[124666]: pgmap v10354: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 156 KiB/s wr, 23 op/s 2023-05-08T09:06:11.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19309.847223 secs 2023-05-08T09:06:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:10 smithi186 ceph-mon[126480]: pgmap v10354: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 156 KiB/s wr, 23 op/s 2023-05-08T09:06:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19309.847223 secs 2023-05-08T09:06:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:10 smithi133 ceph-mon[125939]: pgmap v10354: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 156 KiB/s wr, 23 op/s 2023-05-08T09:06:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19309.847223 secs 2023-05-08T09:06:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:12 smithi186 ceph-mon[126480]: osdmap e724: 12 total, 12 up, 12 in 2023-05-08T09:06:12.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:12 smithi133 ceph-mon[125939]: osdmap e724: 12 total, 12 up, 12 in 2023-05-08T09:06:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:12 smithi096 ceph-mon[124666]: osdmap e724: 12 total, 12 up, 12 in 2023-05-08T09:06:13.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:13 smithi186 ceph-mon[126480]: pgmap v10356: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 112 KiB/s wr, 24 op/s 2023-05-08T09:06:13.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:13 smithi133 ceph-mon[125939]: pgmap v10356: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 112 KiB/s wr, 24 op/s 2023-05-08T09:06:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:13 smithi096 ceph-mon[124666]: pgmap v10356: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 112 KiB/s wr, 24 op/s 2023-05-08T09:06:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19313.005160 secs 2023-05-08T09:06:14.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19313.005160 secs 2023-05-08T09:06:14.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19313.005160 secs 2023-05-08T09:06:15.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19313.561809 secs 2023-05-08T09:06:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:15 smithi186 ceph-mon[126480]: pgmap v10357: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 112 KiB/s wr, 24 op/s 2023-05-08T09:06:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19313.561809 secs 2023-05-08T09:06:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:15 smithi133 ceph-mon[125939]: pgmap v10357: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 112 KiB/s wr, 24 op/s 2023-05-08T09:06:15.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19313.561809 secs 2023-05-08T09:06:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:15 smithi096 ceph-mon[124666]: pgmap v10357: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 112 KiB/s wr, 24 op/s 2023-05-08T09:06:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19314.847343 secs 2023-05-08T09:06:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19314.847343 secs 2023-05-08T09:06:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19314.847343 secs 2023-05-08T09:06:17.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:17 smithi186 ceph-mon[126480]: pgmap v10358: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 58 KiB/s wr, 6 op/s 2023-05-08T09:06:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:17 smithi133 ceph-mon[125939]: pgmap v10358: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 58 KiB/s wr, 6 op/s 2023-05-08T09:06:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:17 smithi096 ceph-mon[124666]: pgmap v10358: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 58 KiB/s wr, 6 op/s 2023-05-08T09:06:18.851 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:18 smithi096 ceph-mon[124666]: pgmap v10359: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 58 KiB/s wr, 6 op/s 2023-05-08T09:06:19.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:18 smithi186 ceph-mon[126480]: pgmap v10359: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 58 KiB/s wr, 6 op/s 2023-05-08T09:06:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:18 smithi186 ceph-mon[126480]: osdmap e725: 12 total, 12 up, 12 in 2023-05-08T09:06:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:18 smithi133 ceph-mon[125939]: pgmap v10359: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 58 KiB/s wr, 6 op/s 2023-05-08T09:06:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:18 smithi133 ceph-mon[125939]: osdmap e725: 12 total, 12 up, 12 in 2023-05-08T09:06:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19318.005272 secs 2023-05-08T09:06:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19318.561900 secs 2023-05-08T09:06:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19318.005272 secs 2023-05-08T09:06:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19318.561900 secs 2023-05-08T09:06:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:18 smithi096 ceph-mon[124666]: osdmap e725: 12 total, 12 up, 12 in 2023-05-08T09:06:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19318.005272 secs 2023-05-08T09:06:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19318.561900 secs 2023-05-08T09:06:21.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:20 smithi186 ceph-mon[126480]: pgmap v10361: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 66 KiB/s wr, 6 op/s 2023-05-08T09:06:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19319.847482 secs 2023-05-08T09:06:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:20 smithi133 ceph-mon[125939]: pgmap v10361: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 66 KiB/s wr, 6 op/s 2023-05-08T09:06:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19319.847482 secs 2023-05-08T09:06:21.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:20 smithi096 ceph-mon[124666]: pgmap v10361: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 66 KiB/s wr, 6 op/s 2023-05-08T09:06:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19319.847482 secs 2023-05-08T09:06:23.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:22 smithi186 ceph-mon[126480]: pgmap v10362: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 58 KiB/s wr, 6 op/s 2023-05-08T09:06:23.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:22 smithi133 ceph-mon[125939]: pgmap v10362: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 58 KiB/s wr, 6 op/s 2023-05-08T09:06:23.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:22 smithi096 ceph-mon[124666]: pgmap v10362: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 58 KiB/s wr, 6 op/s 2023-05-08T09:06:25.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19323.005395 secs 2023-05-08T09:06:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19323.561970 secs 2023-05-08T09:06:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:24 smithi186 ceph-mon[126480]: pgmap v10363: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 58 KiB/s wr, 6 op/s 2023-05-08T09:06:25.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19323.005395 secs 2023-05-08T09:06:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19323.561970 secs 2023-05-08T09:06:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:24 smithi133 ceph-mon[125939]: pgmap v10363: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 58 KiB/s wr, 6 op/s 2023-05-08T09:06:25.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19323.005395 secs 2023-05-08T09:06:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19323.561970 secs 2023-05-08T09:06:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:24 smithi096 ceph-mon[124666]: pgmap v10363: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 58 KiB/s wr, 6 op/s 2023-05-08T09:06:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19324.847577 secs 2023-05-08T09:06:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19324.847577 secs 2023-05-08T09:06:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19324.847577 secs 2023-05-08T09:06:27.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:26 smithi133 ceph-mon[125939]: pgmap v10364: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 716 B/s wr, 6 op/s 2023-05-08T09:06:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:26 smithi096 ceph-mon[124666]: pgmap v10364: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 716 B/s wr, 6 op/s 2023-05-08T09:06:27.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:26 smithi186 ceph-mon[126480]: pgmap v10364: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 716 B/s wr, 6 op/s 2023-05-08T09:06:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:28 smithi133 ceph-mon[125939]: pgmap v10365: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 716 B/s wr, 6 op/s 2023-05-08T09:06:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:28 smithi096 ceph-mon[124666]: pgmap v10365: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 716 B/s wr, 6 op/s 2023-05-08T09:06:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:28 smithi186 ceph-mon[126480]: pgmap v10365: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 716 B/s wr, 6 op/s 2023-05-08T09:06:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19328.005541 secs 2023-05-08T09:06:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19328.562078 secs 2023-05-08T09:06:30.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19328.005541 secs 2023-05-08T09:06:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19328.562078 secs 2023-05-08T09:06:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19328.005541 secs 2023-05-08T09:06:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19328.562078 secs 2023-05-08T09:06:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:30 smithi133 ceph-mon[125939]: pgmap v10366: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 14 KiB/s wr, 8 op/s 2023-05-08T09:06:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19329.847699 secs 2023-05-08T09:06:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:30 smithi096 ceph-mon[124666]: pgmap v10366: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 14 KiB/s wr, 8 op/s 2023-05-08T09:06:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19329.847699 secs 2023-05-08T09:06:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:30 smithi186 ceph-mon[126480]: pgmap v10366: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 14 KiB/s wr, 8 op/s 2023-05-08T09:06:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19329.847699 secs 2023-05-08T09:06:33.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:32 smithi133 ceph-mon[125939]: pgmap v10367: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 63 KiB/s wr, 6 op/s 2023-05-08T09:06:33.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:06:33.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:32 smithi096 ceph-mon[124666]: pgmap v10367: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 63 KiB/s wr, 6 op/s 2023-05-08T09:06:33.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:06:33.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:32 smithi186 ceph-mon[126480]: pgmap v10367: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 63 KiB/s wr, 6 op/s 2023-05-08T09:06:33.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:06:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:33 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:06:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:33 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:06:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:33 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:06:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:33 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:06:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:33 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T09:06:34.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:33 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T09:06:34.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:33 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:06:34.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:33 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:06:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:33 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:06:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:33 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:06:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:33 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:06:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:33 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T09:06:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:33 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T09:06:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:33 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:06:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:33 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:06:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:33 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:06:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:33 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:06:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:33 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:06:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:33 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T09:06:34.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:33 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T09:06:34.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:33 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:06:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19333.005611 secs 2023-05-08T09:06:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19333.562212 secs 2023-05-08T09:06:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:34 smithi133 ceph-mon[125939]: pgmap v10368: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 63 KiB/s wr, 6 op/s 2023-05-08T09:06:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19333.005611 secs 2023-05-08T09:06:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19333.562212 secs 2023-05-08T09:06:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:34 smithi096 ceph-mon[124666]: pgmap v10368: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 63 KiB/s wr, 6 op/s 2023-05-08T09:06:35.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19333.005611 secs 2023-05-08T09:06:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19333.562212 secs 2023-05-08T09:06:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:34 smithi186 ceph-mon[126480]: pgmap v10368: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 63 KiB/s wr, 6 op/s 2023-05-08T09:06:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19334.847837 secs 2023-05-08T09:06:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19334.847837 secs 2023-05-08T09:06:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19334.847837 secs 2023-05-08T09:06:37.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:36 smithi133 ceph-mon[125939]: pgmap v10369: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 64 KiB/s wr, 9 op/s 2023-05-08T09:06:37.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:36 smithi096 ceph-mon[124666]: pgmap v10369: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 64 KiB/s wr, 9 op/s 2023-05-08T09:06:37.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:36 smithi186 ceph-mon[126480]: pgmap v10369: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 64 KiB/s wr, 9 op/s 2023-05-08T09:06:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:38 smithi133 ceph-mon[125939]: pgmap v10370: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 63 KiB/s wr, 6 op/s 2023-05-08T09:06:39.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:38 smithi096 ceph-mon[124666]: pgmap v10370: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 63 KiB/s wr, 6 op/s 2023-05-08T09:06:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:38 smithi186 ceph-mon[126480]: pgmap v10370: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 63 KiB/s wr, 6 op/s 2023-05-08T09:06:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19338.005728 secs 2023-05-08T09:06:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19338.562326 secs 2023-05-08T09:06:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19338.005728 secs 2023-05-08T09:06:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19338.562326 secs 2023-05-08T09:06:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19338.005728 secs 2023-05-08T09:06:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19338.562326 secs 2023-05-08T09:06:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:40 smithi133 ceph-mon[125939]: pgmap v10371: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 63 KiB/s wr, 9 op/s 2023-05-08T09:06:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:40 smithi096 ceph-mon[124666]: pgmap v10371: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 63 KiB/s wr, 9 op/s 2023-05-08T09:06:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:40 smithi186 ceph-mon[126480]: pgmap v10371: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 63 KiB/s wr, 9 op/s 2023-05-08T09:06:43.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:42 smithi133 ceph-mon[125939]: pgmap v10372: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 50 KiB/s wr, 7 op/s 2023-05-08T09:06:43.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:42 smithi096 ceph-mon[124666]: pgmap v10372: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 50 KiB/s wr, 7 op/s 2023-05-08T09:06:43.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:42 smithi186 ceph-mon[126480]: pgmap v10372: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 50 KiB/s wr, 7 op/s 2023-05-08T09:06:44.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:06:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:06:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:06:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19343.005850 secs 2023-05-08T09:06:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19343.562420 secs 2023-05-08T09:06:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:44 smithi133 ceph-mon[125939]: pgmap v10373: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 426 B/s wr, 6 op/s 2023-05-08T09:06:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:06:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:06:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:06:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19343.005850 secs 2023-05-08T09:06:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19343.562420 secs 2023-05-08T09:06:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:44 smithi096 ceph-mon[124666]: pgmap v10373: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 426 B/s wr, 6 op/s 2023-05-08T09:06:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:06:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:06:45.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:06:45.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19343.005850 secs 2023-05-08T09:06:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19343.562420 secs 2023-05-08T09:06:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:44 smithi186 ceph-mon[126480]: pgmap v10373: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 426 B/s wr, 6 op/s 2023-05-08T09:06:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:06:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:06:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:06:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:46 smithi133 ceph-mon[125939]: pgmap v10374: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 126 KiB/s wr, 9 op/s 2023-05-08T09:06:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:46 smithi096 ceph-mon[124666]: pgmap v10374: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 126 KiB/s wr, 9 op/s 2023-05-08T09:06:47.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:46 smithi186 ceph-mon[126480]: pgmap v10374: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 126 KiB/s wr, 9 op/s 2023-05-08T09:06:49.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:48 smithi133 ceph-mon[125939]: pgmap v10375: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 126 KiB/s wr, 6 op/s 2023-05-08T09:06:49.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:48 smithi096 ceph-mon[124666]: pgmap v10375: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 126 KiB/s wr, 6 op/s 2023-05-08T09:06:49.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:48 smithi186 ceph-mon[126480]: pgmap v10375: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 126 KiB/s wr, 6 op/s 2023-05-08T09:06:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19348.005967 secs 2023-05-08T09:06:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19348.005967 secs 2023-05-08T09:06:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19348.005967 secs 2023-05-08T09:06:51.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:50 smithi133 ceph-mon[125939]: pgmap v10376: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 266 KiB/s wr, 10 op/s 2023-05-08T09:06:51.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:50 smithi096 ceph-mon[124666]: pgmap v10376: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 266 KiB/s wr, 10 op/s 2023-05-08T09:06:51.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:50 smithi186 ceph-mon[126480]: pgmap v10376: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 266 KiB/s wr, 10 op/s 2023-05-08T09:06:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:06:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:06:52.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:06:53.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:52 smithi133 ceph-mon[125939]: pgmap v10377: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 266 KiB/s wr, 7 op/s 2023-05-08T09:06:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:52 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:06:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:06:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:06:53.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:52 smithi096 ceph-mon[124666]: pgmap v10377: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 266 KiB/s wr, 7 op/s 2023-05-08T09:06:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:52 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:06:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:06:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:06:53.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:52 smithi186 ceph-mon[126480]: pgmap v10377: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 266 KiB/s wr, 7 op/s 2023-05-08T09:06:53.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:52 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:06:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:06:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:06:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19353.006113 secs 2023-05-08T09:06:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19353.562654 secs 2023-05-08T09:06:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:54 smithi133 ceph-mon[125939]: pgmap v10378: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 266 KiB/s wr, 7 op/s 2023-05-08T09:06:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19353.006113 secs 2023-05-08T09:06:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19353.562654 secs 2023-05-08T09:06:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:54 smithi096 ceph-mon[124666]: pgmap v10378: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 266 KiB/s wr, 7 op/s 2023-05-08T09:06:55.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19353.006113 secs 2023-05-08T09:06:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19353.562654 secs 2023-05-08T09:06:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:54 smithi186 ceph-mon[126480]: pgmap v10378: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 266 KiB/s wr, 7 op/s 2023-05-08T09:06:56.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19354.848316 secs 2023-05-08T09:06:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19354.848316 secs 2023-05-08T09:06:56.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19354.848316 secs 2023-05-08T09:06:57.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:56 smithi133 ceph-mon[125939]: pgmap v10379: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 500 KiB/s wr, 13 op/s 2023-05-08T09:06:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:06:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:06:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:06:57.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:56 smithi096 ceph-mon[124666]: pgmap v10379: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 500 KiB/s wr, 13 op/s 2023-05-08T09:06:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:06:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:06:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:06:57.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:56 smithi186 ceph-mon[126480]: pgmap v10379: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 500 KiB/s wr, 13 op/s 2023-05-08T09:06:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:06:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:06:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:06:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:57 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:06:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:57 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:06:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:57 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:06:59.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:58 smithi133 ceph-mon[125939]: pgmap v10380: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 386 KiB/s rd, 374 KiB/s wr, 10 op/s 2023-05-08T09:06:59.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:58 smithi096 ceph-mon[124666]: pgmap v10380: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 386 KiB/s rd, 374 KiB/s wr, 10 op/s 2023-05-08T09:06:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:58 smithi186 ceph-mon[126480]: pgmap v10380: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 386 KiB/s rd, 374 KiB/s wr, 10 op/s 2023-05-08T09:07:00.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19358.006231 secs 2023-05-08T09:07:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:06:59 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:07:00.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19358.006231 secs 2023-05-08T09:07:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:06:59 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:07:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19358.006231 secs 2023-05-08T09:07:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:06:59 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:07:01.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:00 smithi133 ceph-mon[125939]: pgmap v10381: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 469 KiB/s wr, 15 op/s 2023-05-08T09:07:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:07:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:07:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19359.848429 secs 2023-05-08T09:07:01.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:00 smithi096 ceph-mon[124666]: pgmap v10381: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 469 KiB/s wr, 15 op/s 2023-05-08T09:07:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:07:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:07:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19359.848429 secs 2023-05-08T09:07:01.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:00 smithi186 ceph-mon[126480]: pgmap v10381: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 469 KiB/s wr, 15 op/s 2023-05-08T09:07:01.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:07:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:07:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19359.848429 secs 2023-05-08T09:07:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:02 smithi133 ceph-mon[125939]: pgmap v10382: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 340 KiB/s rd, 329 KiB/s wr, 11 op/s 2023-05-08T09:07:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:02 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:07:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:02 smithi096 ceph-mon[124666]: pgmap v10382: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 340 KiB/s rd, 329 KiB/s wr, 11 op/s 2023-05-08T09:07:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:02 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:07:03.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:02 smithi186 ceph-mon[126480]: pgmap v10382: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 340 KiB/s rd, 329 KiB/s wr, 11 op/s 2023-05-08T09:07:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:02 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:07:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19363.006362 secs 2023-05-08T09:07:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19363.006362 secs 2023-05-08T09:07:04.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19363.006362 secs 2023-05-08T09:07:05.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19363.562891 secs 2023-05-08T09:07:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:05 smithi186 ceph-mon[126480]: pgmap v10383: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 340 KiB/s rd, 329 KiB/s wr, 11 op/s 2023-05-08T09:07:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19363.562891 secs 2023-05-08T09:07:05.506 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:05 smithi133 ceph-mon[125939]: pgmap v10383: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 340 KiB/s rd, 329 KiB/s wr, 11 op/s 2023-05-08T09:07:05.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19363.562891 secs 2023-05-08T09:07:05.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:05 smithi096 ceph-mon[124666]: pgmap v10383: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 340 KiB/s rd, 329 KiB/s wr, 11 op/s 2023-05-08T09:07:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19364.848546 secs 2023-05-08T09:07:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19364.848546 secs 2023-05-08T09:07:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19364.848546 secs 2023-05-08T09:07:07.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:07 smithi186 ceph-mon[126480]: pgmap v10384: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 470 KiB/s rd, 487 KiB/s wr, 30 op/s 2023-05-08T09:07:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:07 smithi186 ceph-mon[126480]: osdmap e726: 12 total, 12 up, 12 in 2023-05-08T09:07:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:07 smithi133 ceph-mon[125939]: pgmap v10384: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 470 KiB/s rd, 487 KiB/s wr, 30 op/s 2023-05-08T09:07:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:07 smithi133 ceph-mon[125939]: osdmap e726: 12 total, 12 up, 12 in 2023-05-08T09:07:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:07 smithi096 ceph-mon[124666]: pgmap v10384: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 470 KiB/s rd, 487 KiB/s wr, 30 op/s 2023-05-08T09:07:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:07 smithi096 ceph-mon[124666]: osdmap e726: 12 total, 12 up, 12 in 2023-05-08T09:07:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:08 smithi186 ceph-mon[126480]: pgmap v10386: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 303 KiB/s wr, 29 op/s 2023-05-08T09:07:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:08 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:07:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:07:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:07:09.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:08 smithi133 ceph-mon[125939]: pgmap v10386: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 303 KiB/s wr, 29 op/s 2023-05-08T09:07:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:08 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:07:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:07:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:07:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:08 smithi096 ceph-mon[124666]: pgmap v10386: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 303 KiB/s wr, 29 op/s 2023-05-08T09:07:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:08 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:07:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:07:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:07:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19368.006424 secs 2023-05-08T09:07:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19368.563010 secs 2023-05-08T09:07:10.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19368.006424 secs 2023-05-08T09:07:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19368.563010 secs 2023-05-08T09:07:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19368.006424 secs 2023-05-08T09:07:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19368.563010 secs 2023-05-08T09:07:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:10 smithi133 ceph-mon[125939]: pgmap v10387: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 273 KiB/s wr, 29 op/s 2023-05-08T09:07:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19369.848687 secs 2023-05-08T09:07:11.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:10 smithi096 ceph-mon[124666]: pgmap v10387: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 273 KiB/s wr, 29 op/s 2023-05-08T09:07:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19369.848687 secs 2023-05-08T09:07:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:10 smithi186 ceph-mon[126480]: pgmap v10387: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 273 KiB/s wr, 29 op/s 2023-05-08T09:07:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19369.848687 secs 2023-05-08T09:07:13.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:12 smithi133 ceph-mon[125939]: pgmap v10388: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 273 KiB/s wr, 29 op/s 2023-05-08T09:07:13.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:12 smithi133 ceph-mon[125939]: osdmap e727: 12 total, 12 up, 12 in 2023-05-08T09:07:13.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:12 smithi096 ceph-mon[124666]: pgmap v10388: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 273 KiB/s wr, 29 op/s 2023-05-08T09:07:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:12 smithi096 ceph-mon[124666]: osdmap e727: 12 total, 12 up, 12 in 2023-05-08T09:07:13.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:12 smithi186 ceph-mon[126480]: pgmap v10388: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 273 KiB/s wr, 29 op/s 2023-05-08T09:07:13.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:12 smithi186 ceph-mon[126480]: osdmap e727: 12 total, 12 up, 12 in 2023-05-08T09:07:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19373.006566 secs 2023-05-08T09:07:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19373.563112 secs 2023-05-08T09:07:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:14 smithi133 ceph-mon[125939]: pgmap v10390: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 105 KiB/s wr, 7 op/s 2023-05-08T09:07:15.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19373.006566 secs 2023-05-08T09:07:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19373.563112 secs 2023-05-08T09:07:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:14 smithi096 ceph-mon[124666]: pgmap v10390: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 105 KiB/s wr, 7 op/s 2023-05-08T09:07:15.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19373.006566 secs 2023-05-08T09:07:15.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19373.563112 secs 2023-05-08T09:07:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:14 smithi186 ceph-mon[126480]: pgmap v10390: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 105 KiB/s wr, 7 op/s 2023-05-08T09:07:16.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19374.848804 secs 2023-05-08T09:07:16.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19374.848804 secs 2023-05-08T09:07:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19374.848804 secs 2023-05-08T09:07:17.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:16 smithi133 ceph-mon[125939]: pgmap v10391: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 224 KiB/s wr, 9 op/s 2023-05-08T09:07:17.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:16 smithi096 ceph-mon[124666]: pgmap v10391: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 224 KiB/s wr, 9 op/s 2023-05-08T09:07:17.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:16 smithi186 ceph-mon[126480]: pgmap v10391: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 224 KiB/s wr, 9 op/s 2023-05-08T09:07:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:18 smithi133 ceph-mon[125939]: pgmap v10392: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 220 KiB/s wr, 9 op/s 2023-05-08T09:07:19.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:18 smithi096 ceph-mon[124666]: pgmap v10392: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 220 KiB/s wr, 9 op/s 2023-05-08T09:07:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:18 smithi186 ceph-mon[126480]: pgmap v10392: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 220 KiB/s wr, 9 op/s 2023-05-08T09:07:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19378.006698 secs 2023-05-08T09:07:20.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19378.563224 secs 2023-05-08T09:07:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19378.006698 secs 2023-05-08T09:07:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19378.563224 secs 2023-05-08T09:07:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19378.006698 secs 2023-05-08T09:07:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19378.563224 secs 2023-05-08T09:07:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:20 smithi133 ceph-mon[125939]: pgmap v10393: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 136 KiB/s wr, 7 op/s 2023-05-08T09:07:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19379.848922 secs 2023-05-08T09:07:21.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:20 smithi096 ceph-mon[124666]: pgmap v10393: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 136 KiB/s wr, 7 op/s 2023-05-08T09:07:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19379.848922 secs 2023-05-08T09:07:21.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:20 smithi186 ceph-mon[126480]: pgmap v10393: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 136 KiB/s wr, 7 op/s 2023-05-08T09:07:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19379.848922 secs 2023-05-08T09:07:23.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:22 smithi133 ceph-mon[125939]: pgmap v10394: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 136 KiB/s wr, 7 op/s 2023-05-08T09:07:23.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:22 smithi096 ceph-mon[124666]: pgmap v10394: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 136 KiB/s wr, 7 op/s 2023-05-08T09:07:23.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:22 smithi186 ceph-mon[126480]: pgmap v10394: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 136 KiB/s wr, 7 op/s 2023-05-08T09:07:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19383.006843 secs 2023-05-08T09:07:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19383.563326 secs 2023-05-08T09:07:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:24 smithi133 ceph-mon[125939]: pgmap v10395: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 124 KiB/s wr, 6 op/s 2023-05-08T09:07:25.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19383.006843 secs 2023-05-08T09:07:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19383.563326 secs 2023-05-08T09:07:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:24 smithi096 ceph-mon[124666]: pgmap v10395: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 124 KiB/s wr, 6 op/s 2023-05-08T09:07:25.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19383.006843 secs 2023-05-08T09:07:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19383.563326 secs 2023-05-08T09:07:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:24 smithi186 ceph-mon[126480]: pgmap v10395: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 124 KiB/s wr, 6 op/s 2023-05-08T09:07:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19384.849041 secs 2023-05-08T09:07:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19384.849041 secs 2023-05-08T09:07:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19384.849041 secs 2023-05-08T09:07:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:26 smithi133 ceph-mon[125939]: pgmap v10396: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 114 KiB/s wr, 8 op/s 2023-05-08T09:07:27.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:26 smithi096 ceph-mon[124666]: pgmap v10396: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 114 KiB/s wr, 8 op/s 2023-05-08T09:07:27.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:26 smithi186 ceph-mon[126480]: pgmap v10396: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 114 KiB/s wr, 8 op/s 2023-05-08T09:07:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:28 smithi133 ceph-mon[125939]: pgmap v10397: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:07:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:28 smithi096 ceph-mon[124666]: pgmap v10397: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:07:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:28 smithi186 ceph-mon[126480]: pgmap v10397: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:07:30.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19388.006950 secs 2023-05-08T09:07:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19388.563466 secs 2023-05-08T09:07:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19388.006950 secs 2023-05-08T09:07:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19388.563466 secs 2023-05-08T09:07:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19388.006950 secs 2023-05-08T09:07:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19388.563466 secs 2023-05-08T09:07:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:30 smithi133 ceph-mon[125939]: pgmap v10398: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T09:07:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19389.849151 secs 2023-05-08T09:07:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:30 smithi096 ceph-mon[124666]: pgmap v10398: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T09:07:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19389.849151 secs 2023-05-08T09:07:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:30 smithi186 ceph-mon[126480]: pgmap v10398: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T09:07:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19389.849151 secs 2023-05-08T09:07:33.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:32 smithi133 ceph-mon[125939]: pgmap v10399: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T09:07:33.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:32 smithi096 ceph-mon[124666]: pgmap v10399: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T09:07:33.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:32 smithi186 ceph-mon[126480]: pgmap v10399: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T09:07:34.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:33 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:07:34.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:33 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:07:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:33 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:07:35.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19393.007017 secs 2023-05-08T09:07:35.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19393.563494 secs 2023-05-08T09:07:35.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:34 smithi133 ceph-mon[125939]: pgmap v10400: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T09:07:35.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:34 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:07:35.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:34 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:07:35.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:34 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:07:35.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:34 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:07:35.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:34 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T09:07:35.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:34 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T09:07:35.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:34 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:07:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19393.007017 secs 2023-05-08T09:07:35.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19393.563494 secs 2023-05-08T09:07:35.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:34 smithi096 ceph-mon[124666]: pgmap v10400: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T09:07:35.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:34 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:07:35.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:34 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:07:35.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:34 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:07:35.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:34 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:07:35.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:34 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T09:07:35.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:34 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T09:07:35.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:34 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:07:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19393.007017 secs 2023-05-08T09:07:35.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19393.563494 secs 2023-05-08T09:07:35.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:34 smithi186 ceph-mon[126480]: pgmap v10400: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T09:07:35.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:34 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:07:35.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:34 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:07:35.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:34 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:07:35.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:34 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:07:35.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:34 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T09:07:35.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:34 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T09:07:35.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:34 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:07:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19394.849270 secs 2023-05-08T09:07:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19394.849270 secs 2023-05-08T09:07:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19394.849270 secs 2023-05-08T09:07:37.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:36 smithi133 ceph-mon[125939]: pgmap v10401: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 122 KiB/s wr, 9 op/s 2023-05-08T09:07:37.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:36 smithi096 ceph-mon[124666]: pgmap v10401: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 122 KiB/s wr, 9 op/s 2023-05-08T09:07:37.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:36 smithi186 ceph-mon[126480]: pgmap v10401: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 122 KiB/s wr, 9 op/s 2023-05-08T09:07:39.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:38 smithi133 ceph-mon[125939]: pgmap v10402: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 122 KiB/s wr, 6 op/s 2023-05-08T09:07:39.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:38 smithi096 ceph-mon[124666]: pgmap v10402: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 122 KiB/s wr, 6 op/s 2023-05-08T09:07:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:38 smithi186 ceph-mon[126480]: pgmap v10402: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 122 KiB/s wr, 6 op/s 2023-05-08T09:07:40.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19398.007141 secs 2023-05-08T09:07:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19398.563609 secs 2023-05-08T09:07:40.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19398.007141 secs 2023-05-08T09:07:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19398.563609 secs 2023-05-08T09:07:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19398.007141 secs 2023-05-08T09:07:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19398.563609 secs 2023-05-08T09:07:41.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:40 smithi133 ceph-mon[125939]: pgmap v10403: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 123 KiB/s wr, 10 op/s 2023-05-08T09:07:41.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:40 smithi096 ceph-mon[124666]: pgmap v10403: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 123 KiB/s wr, 10 op/s 2023-05-08T09:07:41.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:40 smithi186 ceph-mon[126480]: pgmap v10403: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 123 KiB/s wr, 10 op/s 2023-05-08T09:07:43.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:42 smithi133 ceph-mon[125939]: pgmap v10404: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 122 KiB/s wr, 7 op/s 2023-05-08T09:07:43.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:42 smithi096 ceph-mon[124666]: pgmap v10404: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 122 KiB/s wr, 7 op/s 2023-05-08T09:07:43.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:42 smithi186 ceph-mon[126480]: pgmap v10404: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 122 KiB/s wr, 7 op/s 2023-05-08T09:07:44.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:07:44.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:07:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:07:45.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19403.007288 secs 2023-05-08T09:07:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19403.563724 secs 2023-05-08T09:07:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:44 smithi133 ceph-mon[125939]: pgmap v10405: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 122 KiB/s wr, 7 op/s 2023-05-08T09:07:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:07:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:07:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:07:45.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19403.007288 secs 2023-05-08T09:07:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19403.563724 secs 2023-05-08T09:07:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:44 smithi096 ceph-mon[124666]: pgmap v10405: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 122 KiB/s wr, 7 op/s 2023-05-08T09:07:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:07:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:07:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:07:45.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19403.007288 secs 2023-05-08T09:07:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19403.563724 secs 2023-05-08T09:07:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:44 smithi186 ceph-mon[126480]: pgmap v10405: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 122 KiB/s wr, 7 op/s 2023-05-08T09:07:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:07:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:07:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:07:47.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:46 smithi133 ceph-mon[125939]: pgmap v10406: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 195 KiB/s wr, 10 op/s 2023-05-08T09:07:47.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:46 smithi096 ceph-mon[124666]: pgmap v10406: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 195 KiB/s wr, 10 op/s 2023-05-08T09:07:47.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:46 smithi186 ceph-mon[126480]: pgmap v10406: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 195 KiB/s wr, 10 op/s 2023-05-08T09:07:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:48 smithi133 ceph-mon[125939]: pgmap v10407: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 74 KiB/s wr, 6 op/s 2023-05-08T09:07:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:48 smithi096 ceph-mon[124666]: pgmap v10407: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 74 KiB/s wr, 6 op/s 2023-05-08T09:07:49.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:48 smithi186 ceph-mon[126480]: pgmap v10407: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 74 KiB/s wr, 6 op/s 2023-05-08T09:07:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19408.007413 secs 2023-05-08T09:07:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19408.007413 secs 2023-05-08T09:07:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19408.007413 secs 2023-05-08T09:07:51.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:50 smithi133 ceph-mon[125939]: pgmap v10408: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 379 KiB/s rd, 319 KiB/s wr, 11 op/s 2023-05-08T09:07:51.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:50 smithi096 ceph-mon[124666]: pgmap v10408: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 379 KiB/s rd, 319 KiB/s wr, 11 op/s 2023-05-08T09:07:51.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:50 smithi186 ceph-mon[126480]: pgmap v10408: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 379 KiB/s rd, 319 KiB/s wr, 11 op/s 2023-05-08T09:07:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:07:52.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:07:52.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:07:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:52 smithi133 ceph-mon[125939]: pgmap v10409: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 318 KiB/s wr, 8 op/s 2023-05-08T09:07:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:52 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:07:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:07:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:07:53.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:52 smithi096 ceph-mon[124666]: pgmap v10409: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 318 KiB/s wr, 8 op/s 2023-05-08T09:07:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:52 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:07:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:07:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:07:53.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:52 smithi186 ceph-mon[126480]: pgmap v10409: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 318 KiB/s wr, 8 op/s 2023-05-08T09:07:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:52 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:07:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:07:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:07:54.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19413.007513 secs 2023-05-08T09:07:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19413.007513 secs 2023-05-08T09:07:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19413.007513 secs 2023-05-08T09:07:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19413.563861 secs 2023-05-08T09:07:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:54 smithi133 ceph-mon[125939]: pgmap v10410: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 318 KiB/s wr, 8 op/s 2023-05-08T09:07:55.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19413.563861 secs 2023-05-08T09:07:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:54 smithi096 ceph-mon[124666]: pgmap v10410: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 318 KiB/s wr, 8 op/s 2023-05-08T09:07:55.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19413.563861 secs 2023-05-08T09:07:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:54 smithi186 ceph-mon[126480]: pgmap v10410: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 318 KiB/s wr, 8 op/s 2023-05-08T09:07:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19414.849813 secs 2023-05-08T09:07:56.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19414.849813 secs 2023-05-08T09:07:56.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19414.849813 secs 2023-05-08T09:07:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:56 smithi096 ceph-mon[124666]: pgmap v10411: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 624 KiB/s rd, 554 KiB/s wr, 14 op/s 2023-05-08T09:07:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:07:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:07:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:07:57.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:56 smithi186 ceph-mon[126480]: pgmap v10411: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 624 KiB/s rd, 554 KiB/s wr, 14 op/s 2023-05-08T09:07:57.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:07:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:07:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:07:57.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:56 smithi133 ceph-mon[125939]: pgmap v10411: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 624 KiB/s rd, 554 KiB/s wr, 14 op/s 2023-05-08T09:07:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:07:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:07:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:07:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:58 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:07:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:58 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:07:58.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:58 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:07:59.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:59 smithi096 ceph-mon[124666]: pgmap v10412: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 515 KiB/s rd, 480 KiB/s wr, 10 op/s 2023-05-08T09:07:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:07:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19418.007638 secs 2023-05-08T09:07:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:59 smithi186 ceph-mon[126480]: pgmap v10412: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 515 KiB/s rd, 480 KiB/s wr, 10 op/s 2023-05-08T09:07:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:07:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19418.007638 secs 2023-05-08T09:07:59.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:59 smithi133 ceph-mon[125939]: pgmap v10412: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 515 KiB/s rd, 480 KiB/s wr, 10 op/s 2023-05-08T09:07:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:07:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19418.007638 secs 2023-05-08T09:08:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:00 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:08:00.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:00 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:08:00.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:00 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:08:01.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:01 smithi186 ceph-mon[126480]: pgmap v10413: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 574 KiB/s wr, 15 op/s 2023-05-08T09:08:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:08:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:08:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19419.849900 secs 2023-05-08T09:08:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:01 smithi133 ceph-mon[125939]: pgmap v10413: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 574 KiB/s wr, 15 op/s 2023-05-08T09:08:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:08:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:08:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19419.849900 secs 2023-05-08T09:08:01.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:01 smithi096 ceph-mon[124666]: pgmap v10413: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 574 KiB/s wr, 15 op/s 2023-05-08T09:08:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:08:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:08:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19419.849900 secs 2023-05-08T09:08:03.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:03 smithi186 ceph-mon[126480]: pgmap v10414: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 329 KiB/s wr, 11 op/s 2023-05-08T09:08:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:03 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:08:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:03 smithi133 ceph-mon[125939]: pgmap v10414: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 329 KiB/s wr, 11 op/s 2023-05-08T09:08:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:03 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:08:03.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:03 smithi096 ceph-mon[124666]: pgmap v10414: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 329 KiB/s wr, 11 op/s 2023-05-08T09:08:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:03 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:08:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19423.007768 secs 2023-05-08T09:08:04.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19423.007768 secs 2023-05-08T09:08:04.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19423.007768 secs 2023-05-08T09:08:05.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19423.564094 secs 2023-05-08T09:08:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:05 smithi186 ceph-mon[126480]: pgmap v10415: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 329 KiB/s wr, 11 op/s 2023-05-08T09:08:05.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19423.564094 secs 2023-05-08T09:08:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:05 smithi133 ceph-mon[125939]: pgmap v10415: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 329 KiB/s wr, 11 op/s 2023-05-08T09:08:05.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19423.564094 secs 2023-05-08T09:08:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:05 smithi096 ceph-mon[124666]: pgmap v10415: 97 pgs: 97 active+clean; 6.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 329 KiB/s wr, 11 op/s 2023-05-08T09:08:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19424.849998 secs 2023-05-08T09:08:06.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19424.849998 secs 2023-05-08T09:08:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19424.849998 secs 2023-05-08T09:08:07.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:07 smithi186 ceph-mon[126480]: pgmap v10416: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 497 KiB/s wr, 30 op/s 2023-05-08T09:08:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:07 smithi186 ceph-mon[126480]: osdmap e728: 12 total, 12 up, 12 in 2023-05-08T09:08:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:07 smithi133 ceph-mon[125939]: pgmap v10416: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 497 KiB/s wr, 30 op/s 2023-05-08T09:08:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:07 smithi133 ceph-mon[125939]: osdmap e728: 12 total, 12 up, 12 in 2023-05-08T09:08:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:07 smithi096 ceph-mon[124666]: pgmap v10416: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 497 KiB/s wr, 30 op/s 2023-05-08T09:08:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:07 smithi096 ceph-mon[124666]: osdmap e728: 12 total, 12 up, 12 in 2023-05-08T09:08:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:08 smithi133 ceph-mon[125939]: pgmap v10418: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 314 KiB/s wr, 29 op/s 2023-05-08T09:08:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:08 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:08:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:08:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:08:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:08 smithi096 ceph-mon[124666]: pgmap v10418: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 314 KiB/s wr, 29 op/s 2023-05-08T09:08:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:08 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:08:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:08:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:08:09.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:08 smithi186 ceph-mon[126480]: pgmap v10418: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 314 KiB/s wr, 29 op/s 2023-05-08T09:08:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:08 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:08:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:08:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:08:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19428.007939 secs 2023-05-08T09:08:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19428.564208 secs 2023-05-08T09:08:10.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19428.007939 secs 2023-05-08T09:08:10.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19428.564208 secs 2023-05-08T09:08:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19428.007939 secs 2023-05-08T09:08:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19428.564208 secs 2023-05-08T09:08:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:10 smithi133 ceph-mon[125939]: pgmap v10419: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 270 KiB/s wr, 27 op/s 2023-05-08T09:08:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19429.850149 secs 2023-05-08T09:08:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:10 smithi096 ceph-mon[124666]: pgmap v10419: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 270 KiB/s wr, 27 op/s 2023-05-08T09:08:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19429.850149 secs 2023-05-08T09:08:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:10 smithi186 ceph-mon[126480]: pgmap v10419: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 270 KiB/s wr, 27 op/s 2023-05-08T09:08:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19429.850149 secs 2023-05-08T09:08:13.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:12 smithi133 ceph-mon[125939]: pgmap v10420: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 319 KiB/s rd, 406 KiB/s wr, 28 op/s 2023-05-08T09:08:13.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:12 smithi133 ceph-mon[125939]: osdmap e729: 12 total, 12 up, 12 in 2023-05-08T09:08:13.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:12 smithi096 ceph-mon[124666]: pgmap v10420: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 319 KiB/s rd, 406 KiB/s wr, 28 op/s 2023-05-08T09:08:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:12 smithi096 ceph-mon[124666]: osdmap e729: 12 total, 12 up, 12 in 2023-05-08T09:08:13.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:12 smithi186 ceph-mon[126480]: pgmap v10420: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 319 KiB/s rd, 406 KiB/s wr, 28 op/s 2023-05-08T09:08:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:12 smithi186 ceph-mon[126480]: osdmap e729: 12 total, 12 up, 12 in 2023-05-08T09:08:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19433.008082 secs 2023-05-08T09:08:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19433.564329 secs 2023-05-08T09:08:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:14 smithi133 ceph-mon[125939]: pgmap v10422: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 256 KiB/s wr, 7 op/s 2023-05-08T09:08:15.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19433.008082 secs 2023-05-08T09:08:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19433.564329 secs 2023-05-08T09:08:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:14 smithi096 ceph-mon[124666]: pgmap v10422: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 256 KiB/s wr, 7 op/s 2023-05-08T09:08:15.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19433.008082 secs 2023-05-08T09:08:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19433.564329 secs 2023-05-08T09:08:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:14 smithi186 ceph-mon[126480]: pgmap v10422: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 256 KiB/s wr, 7 op/s 2023-05-08T09:08:16.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19434.850280 secs 2023-05-08T09:08:16.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19434.850280 secs 2023-05-08T09:08:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19434.850280 secs 2023-05-08T09:08:17.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:16 smithi133 ceph-mon[125939]: pgmap v10423: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 212 KiB/s wr, 9 op/s 2023-05-08T09:08:17.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:16 smithi096 ceph-mon[124666]: pgmap v10423: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 212 KiB/s wr, 9 op/s 2023-05-08T09:08:17.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:16 smithi186 ceph-mon[126480]: pgmap v10423: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 212 KiB/s wr, 9 op/s 2023-05-08T09:08:19.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:18 smithi133 ceph-mon[125939]: pgmap v10424: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 209 KiB/s wr, 9 op/s 2023-05-08T09:08:19.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:18 smithi096 ceph-mon[124666]: pgmap v10424: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 209 KiB/s wr, 9 op/s 2023-05-08T09:08:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:18 smithi186 ceph-mon[126480]: pgmap v10424: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 209 KiB/s wr, 9 op/s 2023-05-08T09:08:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19438.008201 secs 2023-05-08T09:08:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19438.564436 secs 2023-05-08T09:08:20.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19438.008201 secs 2023-05-08T09:08:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19438.564436 secs 2023-05-08T09:08:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19438.008201 secs 2023-05-08T09:08:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19438.564436 secs 2023-05-08T09:08:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:20 smithi133 ceph-mon[125939]: pgmap v10425: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 140 KiB/s wr, 7 op/s 2023-05-08T09:08:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19439.850405 secs 2023-05-08T09:08:21.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:20 smithi096 ceph-mon[124666]: pgmap v10425: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 140 KiB/s wr, 7 op/s 2023-05-08T09:08:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19439.850405 secs 2023-05-08T09:08:21.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:20 smithi186 ceph-mon[126480]: pgmap v10425: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 140 KiB/s wr, 7 op/s 2023-05-08T09:08:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19439.850405 secs 2023-05-08T09:08:23.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:22 smithi133 ceph-mon[125939]: pgmap v10426: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 3.7 KiB/s wr, 6 op/s 2023-05-08T09:08:23.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:22 smithi096 ceph-mon[124666]: pgmap v10426: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 3.7 KiB/s wr, 6 op/s 2023-05-08T09:08:23.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:22 smithi186 ceph-mon[126480]: pgmap v10426: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 3.7 KiB/s wr, 6 op/s 2023-05-08T09:08:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19443.008283 secs 2023-05-08T09:08:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19443.564533 secs 2023-05-08T09:08:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:24 smithi133 ceph-mon[125939]: pgmap v10427: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 3.4 KiB/s wr, 6 op/s 2023-05-08T09:08:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19443.008283 secs 2023-05-08T09:08:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19443.564533 secs 2023-05-08T09:08:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:24 smithi096 ceph-mon[124666]: pgmap v10427: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 3.4 KiB/s wr, 6 op/s 2023-05-08T09:08:25.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19443.008283 secs 2023-05-08T09:08:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19443.564533 secs 2023-05-08T09:08:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:24 smithi186 ceph-mon[126480]: pgmap v10427: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 3.4 KiB/s wr, 6 op/s 2023-05-08T09:08:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19444.850531 secs 2023-05-08T09:08:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19444.850531 secs 2023-05-08T09:08:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19444.850531 secs 2023-05-08T09:08:27.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:26 smithi133 ceph-mon[125939]: pgmap v10428: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 3.1 KiB/s wr, 8 op/s 2023-05-08T09:08:27.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:26 smithi096 ceph-mon[124666]: pgmap v10428: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 3.1 KiB/s wr, 8 op/s 2023-05-08T09:08:27.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:26 smithi186 ceph-mon[126480]: pgmap v10428: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 3.1 KiB/s wr, 8 op/s 2023-05-08T09:08:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:28 smithi133 ceph-mon[125939]: pgmap v10429: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:08:29.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:28 smithi096 ceph-mon[124666]: pgmap v10429: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:08:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:28 smithi186 ceph-mon[126480]: pgmap v10429: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:08:30.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19448.008414 secs 2023-05-08T09:08:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19448.564648 secs 2023-05-08T09:08:30.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19448.008414 secs 2023-05-08T09:08:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19448.564648 secs 2023-05-08T09:08:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19448.008414 secs 2023-05-08T09:08:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19448.564648 secs 2023-05-08T09:08:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:30 smithi133 ceph-mon[125939]: pgmap v10430: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 7 op/s 2023-05-08T09:08:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19449.850606 secs 2023-05-08T09:08:31.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:30 smithi096 ceph-mon[124666]: pgmap v10430: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 7 op/s 2023-05-08T09:08:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19449.850606 secs 2023-05-08T09:08:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:30 smithi186 ceph-mon[126480]: pgmap v10430: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 7 op/s 2023-05-08T09:08:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19449.850606 secs 2023-05-08T09:08:33.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:32 smithi133 ceph-mon[125939]: pgmap v10431: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T09:08:33.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:32 smithi096 ceph-mon[124666]: pgmap v10431: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T09:08:33.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:32 smithi186 ceph-mon[126480]: pgmap v10431: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T09:08:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19453.008493 secs 2023-05-08T09:08:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19453.564763 secs 2023-05-08T09:08:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:34 smithi133 ceph-mon[125939]: pgmap v10432: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T09:08:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:34 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:08:35.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19453.008493 secs 2023-05-08T09:08:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19453.564763 secs 2023-05-08T09:08:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:34 smithi096 ceph-mon[124666]: pgmap v10432: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T09:08:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:34 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:08:35.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19453.008493 secs 2023-05-08T09:08:35.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19453.564763 secs 2023-05-08T09:08:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:34 smithi186 ceph-mon[126480]: pgmap v10432: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T09:08:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:34 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:08:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:08:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:08:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:35 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:08:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:08:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:35 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T09:08:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:35 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T09:08:36.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:35 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:08:36.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19454.850711 secs 2023-05-08T09:08:36.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:08:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:08:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:35 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:08:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:08:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:35 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T09:08:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:35 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T09:08:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:35 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:08:36.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19454.850711 secs 2023-05-08T09:08:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:08:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:08:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:35 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:08:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:08:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:35 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T09:08:36.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:35 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T09:08:36.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:35 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:08:36.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19454.850711 secs 2023-05-08T09:08:37.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:36 smithi096 ceph-mon[124666]: pgmap v10433: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 64 KiB/s wr, 8 op/s 2023-05-08T09:08:37.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:36 smithi186 ceph-mon[126480]: pgmap v10433: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 64 KiB/s wr, 8 op/s 2023-05-08T09:08:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:36 smithi133 ceph-mon[125939]: pgmap v10433: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 64 KiB/s wr, 8 op/s 2023-05-08T09:08:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:38 smithi096 ceph-mon[124666]: pgmap v10434: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 64 KiB/s wr, 6 op/s 2023-05-08T09:08:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19458.008637 secs 2023-05-08T09:08:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:38 smithi186 ceph-mon[126480]: pgmap v10434: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 64 KiB/s wr, 6 op/s 2023-05-08T09:08:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19458.008637 secs 2023-05-08T09:08:39.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:38 smithi133 ceph-mon[125939]: pgmap v10434: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 64 KiB/s wr, 6 op/s 2023-05-08T09:08:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19458.008637 secs 2023-05-08T09:08:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19458.564887 secs 2023-05-08T09:08:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19458.564887 secs 2023-05-08T09:08:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19458.564887 secs 2023-05-08T09:08:41.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:41 smithi186 ceph-mon[126480]: pgmap v10435: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 64 KiB/s wr, 9 op/s 2023-05-08T09:08:41.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:41 smithi133 ceph-mon[125939]: pgmap v10435: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 64 KiB/s wr, 9 op/s 2023-05-08T09:08:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:41 smithi096 ceph-mon[124666]: pgmap v10435: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 64 KiB/s wr, 9 op/s 2023-05-08T09:08:43.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:43 smithi186 ceph-mon[126480]: pgmap v10436: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 126 KiB/s wr, 7 op/s 2023-05-08T09:08:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:43 smithi133 ceph-mon[125939]: pgmap v10436: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 126 KiB/s wr, 7 op/s 2023-05-08T09:08:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:43 smithi096 ceph-mon[124666]: pgmap v10436: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 126 KiB/s wr, 7 op/s 2023-05-08T09:08:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:44 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:08:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19463.008740 secs 2023-05-08T09:08:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:44 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:08:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19463.008740 secs 2023-05-08T09:08:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:44 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:08:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19463.008740 secs 2023-05-08T09:08:45.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19463.565001 secs 2023-05-08T09:08:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:45 smithi186 ceph-mon[126480]: pgmap v10437: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 126 KiB/s wr, 6 op/s 2023-05-08T09:08:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:45 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:08:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:45 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:08:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:45 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:08:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19463.565001 secs 2023-05-08T09:08:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:45 smithi133 ceph-mon[125939]: pgmap v10437: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 126 KiB/s wr, 6 op/s 2023-05-08T09:08:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:45 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:08:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:45 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:08:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:45 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:08:45.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19463.565001 secs 2023-05-08T09:08:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:45 smithi096 ceph-mon[124666]: pgmap v10437: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 126 KiB/s wr, 6 op/s 2023-05-08T09:08:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:45 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:08:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:45 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:08:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:45 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:08:47.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:47 smithi186 ceph-mon[126480]: pgmap v10438: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 217 KiB/s wr, 9 op/s 2023-05-08T09:08:47.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:47 smithi133 ceph-mon[125939]: pgmap v10438: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 217 KiB/s wr, 9 op/s 2023-05-08T09:08:47.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:47 smithi096 ceph-mon[124666]: pgmap v10438: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 217 KiB/s wr, 9 op/s 2023-05-08T09:08:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:49 smithi186 ceph-mon[126480]: pgmap v10439: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 153 KiB/s wr, 6 op/s 2023-05-08T09:08:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19468.008795 secs 2023-05-08T09:08:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:49 smithi133 ceph-mon[125939]: pgmap v10439: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 153 KiB/s wr, 6 op/s 2023-05-08T09:08:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19468.008795 secs 2023-05-08T09:08:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:49 smithi096 ceph-mon[124666]: pgmap v10439: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 153 KiB/s wr, 6 op/s 2023-05-08T09:08:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19468.008795 secs 2023-05-08T09:08:51.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:51 smithi186 ceph-mon[126480]: pgmap v10440: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 320 KiB/s wr, 10 op/s 2023-05-08T09:08:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:51 smithi133 ceph-mon[125939]: pgmap v10440: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 320 KiB/s wr, 10 op/s 2023-05-08T09:08:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:51 smithi096 ceph-mon[124666]: pgmap v10440: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 320 KiB/s wr, 10 op/s 2023-05-08T09:08:52.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:08:52.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:08:52.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:08:53.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:53 smithi186 ceph-mon[126480]: pgmap v10441: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 320 KiB/s wr, 7 op/s 2023-05-08T09:08:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:53 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:08:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:08:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:08:53.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:53 smithi133 ceph-mon[125939]: pgmap v10441: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 320 KiB/s wr, 7 op/s 2023-05-08T09:08:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:53 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:08:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:08:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:08:53.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:53 smithi096 ceph-mon[124666]: pgmap v10441: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 320 KiB/s wr, 7 op/s 2023-05-08T09:08:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:53 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:08:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:08:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:08:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19473.008894 secs 2023-05-08T09:08:54.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19473.008894 secs 2023-05-08T09:08:54.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19473.008894 secs 2023-05-08T09:08:55.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19473.565250 secs 2023-05-08T09:08:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:55 smithi186 ceph-mon[126480]: pgmap v10442: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 258 KiB/s wr, 7 op/s 2023-05-08T09:08:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19473.565250 secs 2023-05-08T09:08:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:55 smithi133 ceph-mon[125939]: pgmap v10442: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 258 KiB/s wr, 7 op/s 2023-05-08T09:08:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19473.565250 secs 2023-05-08T09:08:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:55 smithi096 ceph-mon[124666]: pgmap v10442: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 258 KiB/s wr, 7 op/s 2023-05-08T09:08:56.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19474.851144 secs 2023-05-08T09:08:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19474.851144 secs 2023-05-08T09:08:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19474.851144 secs 2023-05-08T09:08:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:57 smithi186 ceph-mon[126480]: pgmap v10443: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 425 KiB/s rd, 429 KiB/s wr, 12 op/s 2023-05-08T09:08:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:08:57.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:08:57.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:08:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:57 smithi133 ceph-mon[125939]: pgmap v10443: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 425 KiB/s rd, 429 KiB/s wr, 12 op/s 2023-05-08T09:08:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:08:57.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:08:57.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:08:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:57 smithi096 ceph-mon[124666]: pgmap v10443: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 425 KiB/s rd, 429 KiB/s wr, 12 op/s 2023-05-08T09:08:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:08:57.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:08:57.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:08:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:58 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:08:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:58 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:08:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:58 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:08:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:59 smithi186 ceph-mon[126480]: pgmap v10444: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 338 KiB/s wr, 9 op/s 2023-05-08T09:08:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:08:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19478.008983 secs 2023-05-08T09:08:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:59 smithi133 ceph-mon[125939]: pgmap v10444: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 338 KiB/s wr, 9 op/s 2023-05-08T09:08:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:08:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19478.008983 secs 2023-05-08T09:08:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:59 smithi096 ceph-mon[124666]: pgmap v10444: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 338 KiB/s wr, 9 op/s 2023-05-08T09:08:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:08:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19478.008983 secs 2023-05-08T09:09:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:00 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:09:00.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:00 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:09:00.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:00 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:09:01.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:01 smithi186 ceph-mon[126480]: pgmap v10445: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 497 KiB/s wr, 15 op/s 2023-05-08T09:09:01.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:09:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:09:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19479.851273 secs 2023-05-08T09:09:01.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:01 smithi133 ceph-mon[125939]: pgmap v10445: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 497 KiB/s wr, 15 op/s 2023-05-08T09:09:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:09:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:09:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19479.851273 secs 2023-05-08T09:09:01.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:01 smithi096 ceph-mon[124666]: pgmap v10445: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 497 KiB/s wr, 15 op/s 2023-05-08T09:09:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:09:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:09:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19479.851273 secs 2023-05-08T09:09:03.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:03 smithi186 ceph-mon[126480]: pgmap v10446: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 330 KiB/s wr, 11 op/s 2023-05-08T09:09:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:03 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:09:03.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:03 smithi133 ceph-mon[125939]: pgmap v10446: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 330 KiB/s wr, 11 op/s 2023-05-08T09:09:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:03 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:09:03.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:03 smithi096 ceph-mon[124666]: pgmap v10446: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 330 KiB/s wr, 11 op/s 2023-05-08T09:09:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:03 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:09:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19483.009093 secs 2023-05-08T09:09:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19483.009093 secs 2023-05-08T09:09:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19483.009093 secs 2023-05-08T09:09:05.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19483.565502 secs 2023-05-08T09:09:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:05 smithi186 ceph-mon[126480]: pgmap v10447: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 330 KiB/s wr, 11 op/s 2023-05-08T09:09:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19483.565502 secs 2023-05-08T09:09:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:05 smithi133 ceph-mon[125939]: pgmap v10447: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 330 KiB/s wr, 11 op/s 2023-05-08T09:09:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19483.565502 secs 2023-05-08T09:09:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:05 smithi096 ceph-mon[124666]: pgmap v10447: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 330 KiB/s wr, 11 op/s 2023-05-08T09:09:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19484.851401 secs 2023-05-08T09:09:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19484.851401 secs 2023-05-08T09:09:06.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19484.851401 secs 2023-05-08T09:09:07.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:07 smithi186 ceph-mon[126480]: pgmap v10448: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 386 KiB/s rd, 487 KiB/s wr, 30 op/s 2023-05-08T09:09:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:07 smithi186 ceph-mon[126480]: osdmap e730: 12 total, 12 up, 12 in 2023-05-08T09:09:07.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:07 smithi133 ceph-mon[125939]: pgmap v10448: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 386 KiB/s rd, 487 KiB/s wr, 30 op/s 2023-05-08T09:09:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:07 smithi133 ceph-mon[125939]: osdmap e730: 12 total, 12 up, 12 in 2023-05-08T09:09:07.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:07 smithi096 ceph-mon[124666]: pgmap v10448: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 386 KiB/s rd, 487 KiB/s wr, 30 op/s 2023-05-08T09:09:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:07 smithi096 ceph-mon[124666]: osdmap e730: 12 total, 12 up, 12 in 2023-05-08T09:09:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:08 smithi133 ceph-mon[125939]: pgmap v10450: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 379 KiB/s wr, 29 op/s 2023-05-08T09:09:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:08 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:09:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:09:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:09:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:08 smithi096 ceph-mon[124666]: pgmap v10450: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 379 KiB/s wr, 29 op/s 2023-05-08T09:09:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:08 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:09:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:09:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:09:09.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:08 smithi186 ceph-mon[126480]: pgmap v10450: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 379 KiB/s wr, 29 op/s 2023-05-08T09:09:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:08 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:09:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:09:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:09:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19488.009213 secs 2023-05-08T09:09:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19488.565623 secs 2023-05-08T09:09:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19488.009213 secs 2023-05-08T09:09:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19488.565623 secs 2023-05-08T09:09:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19488.009213 secs 2023-05-08T09:09:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19488.565623 secs 2023-05-08T09:09:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:10 smithi133 ceph-mon[125939]: pgmap v10451: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 271 KiB/s wr, 28 op/s 2023-05-08T09:09:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19489.851534 secs 2023-05-08T09:09:11.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:10 smithi096 ceph-mon[124666]: pgmap v10451: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 271 KiB/s wr, 28 op/s 2023-05-08T09:09:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19489.851534 secs 2023-05-08T09:09:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:10 smithi186 ceph-mon[126480]: pgmap v10451: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 271 KiB/s wr, 28 op/s 2023-05-08T09:09:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19489.851534 secs 2023-05-08T09:09:13.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:12 smithi133 ceph-mon[125939]: pgmap v10452: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 271 KiB/s wr, 28 op/s 2023-05-08T09:09:13.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:12 smithi133 ceph-mon[125939]: osdmap e731: 12 total, 12 up, 12 in 2023-05-08T09:09:13.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:12 smithi096 ceph-mon[124666]: pgmap v10452: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 271 KiB/s wr, 28 op/s 2023-05-08T09:09:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:12 smithi096 ceph-mon[124666]: osdmap e731: 12 total, 12 up, 12 in 2023-05-08T09:09:13.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:12 smithi186 ceph-mon[126480]: pgmap v10452: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 271 KiB/s wr, 28 op/s 2023-05-08T09:09:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:12 smithi186 ceph-mon[126480]: osdmap e731: 12 total, 12 up, 12 in 2023-05-08T09:09:15.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19493.009356 secs 2023-05-08T09:09:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19493.565704 secs 2023-05-08T09:09:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:14 smithi133 ceph-mon[125939]: pgmap v10454: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 104 KiB/s wr, 6 op/s 2023-05-08T09:09:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19493.009356 secs 2023-05-08T09:09:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19493.565704 secs 2023-05-08T09:09:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:14 smithi096 ceph-mon[124666]: pgmap v10454: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 104 KiB/s wr, 6 op/s 2023-05-08T09:09:15.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19493.009356 secs 2023-05-08T09:09:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19493.565704 secs 2023-05-08T09:09:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:14 smithi186 ceph-mon[126480]: pgmap v10454: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 104 KiB/s wr, 6 op/s 2023-05-08T09:09:16.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19494.851676 secs 2023-05-08T09:09:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19494.851676 secs 2023-05-08T09:09:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19494.851676 secs 2023-05-08T09:09:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:16 smithi133 ceph-mon[125939]: pgmap v10455: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 145 KiB/s wr, 8 op/s 2023-05-08T09:09:17.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:16 smithi096 ceph-mon[124666]: pgmap v10455: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 145 KiB/s wr, 8 op/s 2023-05-08T09:09:17.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:16 smithi186 ceph-mon[126480]: pgmap v10455: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 145 KiB/s wr, 8 op/s 2023-05-08T09:09:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:18 smithi133 ceph-mon[125939]: pgmap v10456: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 142 KiB/s wr, 8 op/s 2023-05-08T09:09:19.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:18 smithi096 ceph-mon[124666]: pgmap v10456: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 142 KiB/s wr, 8 op/s 2023-05-08T09:09:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:18 smithi186 ceph-mon[126480]: pgmap v10456: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 142 KiB/s wr, 8 op/s 2023-05-08T09:09:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19498.009435 secs 2023-05-08T09:09:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19498.565800 secs 2023-05-08T09:09:20.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19498.009435 secs 2023-05-08T09:09:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19498.565800 secs 2023-05-08T09:09:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19498.009435 secs 2023-05-08T09:09:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19498.565800 secs 2023-05-08T09:09:21.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:20 smithi133 ceph-mon[125939]: pgmap v10457: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 59 KiB/s wr, 6 op/s 2023-05-08T09:09:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19499.851818 secs 2023-05-08T09:09:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:20 smithi096 ceph-mon[124666]: pgmap v10457: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 59 KiB/s wr, 6 op/s 2023-05-08T09:09:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19499.851818 secs 2023-05-08T09:09:21.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:20 smithi186 ceph-mon[126480]: pgmap v10457: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 59 KiB/s wr, 6 op/s 2023-05-08T09:09:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19499.851818 secs 2023-05-08T09:09:23.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:22 smithi133 ceph-mon[125939]: pgmap v10458: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 59 KiB/s wr, 6 op/s 2023-05-08T09:09:23.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:22 smithi096 ceph-mon[124666]: pgmap v10458: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 59 KiB/s wr, 6 op/s 2023-05-08T09:09:23.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:22 smithi186 ceph-mon[126480]: pgmap v10458: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 59 KiB/s wr, 6 op/s 2023-05-08T09:09:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19503.009517 secs 2023-05-08T09:09:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19503.565921 secs 2023-05-08T09:09:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:24 smithi133 ceph-mon[125939]: pgmap v10459: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 5 op/s 2023-05-08T09:09:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19503.009517 secs 2023-05-08T09:09:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19503.565921 secs 2023-05-08T09:09:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:24 smithi096 ceph-mon[124666]: pgmap v10459: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 5 op/s 2023-05-08T09:09:25.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19503.009517 secs 2023-05-08T09:09:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19503.565921 secs 2023-05-08T09:09:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:24 smithi186 ceph-mon[126480]: pgmap v10459: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 5 op/s 2023-05-08T09:09:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19504.851927 secs 2023-05-08T09:09:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19504.851927 secs 2023-05-08T09:09:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19504.851927 secs 2023-05-08T09:09:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:26 smithi133 ceph-mon[125939]: pgmap v10460: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 49 KiB/s wr, 7 op/s 2023-05-08T09:09:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:26 smithi096 ceph-mon[124666]: pgmap v10460: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 49 KiB/s wr, 7 op/s 2023-05-08T09:09:27.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:26 smithi186 ceph-mon[126480]: pgmap v10460: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 49 KiB/s wr, 7 op/s 2023-05-08T09:09:29.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:28 smithi133 ceph-mon[125939]: pgmap v10461: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:09:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:28 smithi096 ceph-mon[124666]: pgmap v10461: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:09:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:28 smithi186 ceph-mon[126480]: pgmap v10461: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:09:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19508.009579 secs 2023-05-08T09:09:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19508.566042 secs 2023-05-08T09:09:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19508.009579 secs 2023-05-08T09:09:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19508.566042 secs 2023-05-08T09:09:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19508.009579 secs 2023-05-08T09:09:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19508.566042 secs 2023-05-08T09:09:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:30 smithi133 ceph-mon[125939]: pgmap v10462: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 15 KiB/s wr, 8 op/s 2023-05-08T09:09:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19509.852056 secs 2023-05-08T09:09:31.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:30 smithi096 ceph-mon[124666]: pgmap v10462: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 15 KiB/s wr, 8 op/s 2023-05-08T09:09:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19509.852056 secs 2023-05-08T09:09:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:30 smithi186 ceph-mon[126480]: pgmap v10462: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 15 KiB/s wr, 8 op/s 2023-05-08T09:09:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19509.852056 secs 2023-05-08T09:09:33.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:32 smithi133 ceph-mon[125939]: pgmap v10463: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 15 KiB/s wr, 5 op/s 2023-05-08T09:09:33.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:32 smithi096 ceph-mon[124666]: pgmap v10463: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 15 KiB/s wr, 5 op/s 2023-05-08T09:09:33.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:32 smithi186 ceph-mon[126480]: pgmap v10463: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 15 KiB/s wr, 5 op/s 2023-05-08T09:09:35.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19513.009703 secs 2023-05-08T09:09:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19513.566171 secs 2023-05-08T09:09:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:34 smithi133 ceph-mon[125939]: pgmap v10464: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 15 KiB/s wr, 5 op/s 2023-05-08T09:09:35.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19513.009703 secs 2023-05-08T09:09:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19513.566171 secs 2023-05-08T09:09:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:34 smithi096 ceph-mon[124666]: pgmap v10464: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 15 KiB/s wr, 5 op/s 2023-05-08T09:09:35.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19513.009703 secs 2023-05-08T09:09:35.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19513.566171 secs 2023-05-08T09:09:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:34 smithi186 ceph-mon[126480]: pgmap v10464: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 15 KiB/s wr, 5 op/s 2023-05-08T09:09:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:09:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19514.852151 secs 2023-05-08T09:09:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:09:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19514.852151 secs 2023-05-08T09:09:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:09:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19514.852151 secs 2023-05-08T09:09:37.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:36 smithi133 ceph-mon[125939]: pgmap v10465: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 188 KiB/s wr, 9 op/s 2023-05-08T09:09:37.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:36 smithi096 ceph-mon[124666]: pgmap v10465: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 188 KiB/s wr, 9 op/s 2023-05-08T09:09:37.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:36 smithi186 ceph-mon[126480]: pgmap v10465: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 188 KiB/s wr, 9 op/s 2023-05-08T09:09:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:09:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:09:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:09:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:09:39.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:38 smithi186 ceph-mon[126480]: pgmap v10466: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 188 KiB/s wr, 7 op/s 2023-05-08T09:09:39.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:09:39.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:09:39.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:09:39.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:09:39.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:09:39.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:09:39.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:09:39.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:09:39.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:09:39.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:38 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi096 to 24521k 2023-05-08T09:09:39.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:38 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi096 to 25109696: error parsing value: Value '25109696' is below minimum 939524096 2023-05-08T09:09:39.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:09:39.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:38 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T09:09:39.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:38 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T09:09:39.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:09:39.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:09:39.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:09:39.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:09:39.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:38 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T09:09:39.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:38 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T09:09:39.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:09:39.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:09:39.123 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:38 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:09:39.123 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:09:39.123 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:38 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T09:09:39.123 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:38 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T09:09:39.123 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:38 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:09:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:09:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:09:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:09:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:09:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:38 smithi133 ceph-mon[125939]: pgmap v10466: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 188 KiB/s wr, 7 op/s 2023-05-08T09:09:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:09:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:09:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:09:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:09:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:09:39.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:09:39.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:09:39.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:09:39.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:09:39.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:38 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi096 to 24521k 2023-05-08T09:09:39.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:38 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi096 to 25109696: error parsing value: Value '25109696' is below minimum 939524096 2023-05-08T09:09:39.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:09:39.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:38 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T09:09:39.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:38 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T09:09:39.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:09:39.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:09:39.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:09:39.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:09:39.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:38 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T09:09:39.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:38 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T09:09:39.244 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:09:39.244 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:09:39.244 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:38 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:09:39.244 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:09:39.244 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:38 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T09:09:39.244 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:38 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T09:09:39.244 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:38 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:09:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:09:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:09:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:09:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:09:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:38 smithi096 ceph-mon[124666]: pgmap v10466: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 188 KiB/s wr, 7 op/s 2023-05-08T09:09:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:09:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:09:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:09:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:09:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:09:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:09:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:09:39.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:09:39.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:09:39.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:38 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi096 to 24521k 2023-05-08T09:09:39.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:38 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi096 to 25109696: error parsing value: Value '25109696' is below minimum 939524096 2023-05-08T09:09:39.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:09:39.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:38 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T09:09:39.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:38 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T09:09:39.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:09:39.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:09:39.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:09:39.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:09:39.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:38 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T09:09:39.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:38 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T09:09:39.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:09:39.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:09:39.259 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:38 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:09:39.259 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:09:39.259 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:38 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T09:09:39.259 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:38 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T09:09:39.259 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:38 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:09:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19518.566233 secs 2023-05-08T09:09:40.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19518.566233 secs 2023-05-08T09:09:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19518.566233 secs 2023-05-08T09:09:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:40 smithi186 ceph-mon[126480]: pgmap v10467: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 189 KiB/s wr, 11 op/s 2023-05-08T09:09:41.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:40 smithi133 ceph-mon[125939]: pgmap v10467: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 189 KiB/s wr, 11 op/s 2023-05-08T09:09:41.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:40 smithi096 ceph-mon[124666]: pgmap v10467: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 189 KiB/s wr, 11 op/s 2023-05-08T09:09:43.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:42 smithi133 ceph-mon[125939]: pgmap v10468: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 174 KiB/s wr, 7 op/s 2023-05-08T09:09:43.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:42 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:09:43.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:42 smithi096 ceph-mon[124666]: pgmap v10468: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 174 KiB/s wr, 7 op/s 2023-05-08T09:09:43.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:42 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:09:43.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:42 smithi186 ceph-mon[126480]: pgmap v10468: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 174 KiB/s wr, 7 op/s 2023-05-08T09:09:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:42 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:09:44.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:43 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:09:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T09:09:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:09:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:09:44.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:43 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:09:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T09:09:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:09:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:09:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:43 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:09:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T09:09:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:09:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:09:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19523.566379 secs 2023-05-08T09:09:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:44 smithi133 ceph-mon[125939]: pgmap v10469: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 174 KiB/s wr, 7 op/s 2023-05-08T09:09:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:09:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:09:45.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19523.566379 secs 2023-05-08T09:09:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:44 smithi096 ceph-mon[124666]: pgmap v10469: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 174 KiB/s wr, 7 op/s 2023-05-08T09:09:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:09:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:09:45.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19523.566379 secs 2023-05-08T09:09:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:44 smithi186 ceph-mon[126480]: pgmap v10469: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 174 KiB/s wr, 7 op/s 2023-05-08T09:09:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:09:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:09:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:46 smithi133 ceph-mon[125939]: pgmap v10470: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 343 KiB/s wr, 10 op/s 2023-05-08T09:09:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:46 smithi096 ceph-mon[124666]: pgmap v10470: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 343 KiB/s wr, 10 op/s 2023-05-08T09:09:47.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:46 smithi186 ceph-mon[126480]: pgmap v10470: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 343 KiB/s wr, 10 op/s 2023-05-08T09:09:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:48 smithi133 ceph-mon[125939]: pgmap v10471: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 170 KiB/s wr, 7 op/s 2023-05-08T09:09:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:48 smithi096 ceph-mon[124666]: pgmap v10471: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 170 KiB/s wr, 7 op/s 2023-05-08T09:09:49.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:48 smithi186 ceph-mon[126480]: pgmap v10471: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 170 KiB/s wr, 7 op/s 2023-05-08T09:09:50.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19528.010089 secs 2023-05-08T09:09:50.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19528.010089 secs 2023-05-08T09:09:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19528.010089 secs 2023-05-08T09:09:51.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:50 smithi096 ceph-mon[124666]: pgmap v10472: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 545 KiB/s rd, 322 KiB/s wr, 11 op/s 2023-05-08T09:09:51.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:50 smithi186 ceph-mon[126480]: pgmap v10472: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 545 KiB/s rd, 322 KiB/s wr, 11 op/s 2023-05-08T09:09:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:50 smithi133 ceph-mon[125939]: pgmap v10472: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 545 KiB/s rd, 322 KiB/s wr, 11 op/s 2023-05-08T09:09:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:52 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:09:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T09:09:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:09:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:09:52.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:52 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:09:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T09:09:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:09:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:09:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:52 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:09:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T09:09:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:09:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:09:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:53 smithi096 ceph-mon[124666]: pgmap v10473: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 321 KiB/s wr, 7 op/s 2023-05-08T09:09:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:09:53.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:09:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:53 smithi186 ceph-mon[126480]: pgmap v10473: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 321 KiB/s wr, 7 op/s 2023-05-08T09:09:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:09:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:09:53.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:53 smithi133 ceph-mon[125939]: pgmap v10473: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 321 KiB/s wr, 7 op/s 2023-05-08T09:09:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:09:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:09:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19533.010231 secs 2023-05-08T09:09:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19533.010231 secs 2023-05-08T09:09:54.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19533.010231 secs 2023-05-08T09:09:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19533.566623 secs 2023-05-08T09:09:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:55 smithi186 ceph-mon[126480]: pgmap v10474: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 321 KiB/s wr, 7 op/s 2023-05-08T09:09:55.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19533.566623 secs 2023-05-08T09:09:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:55 smithi133 ceph-mon[125939]: pgmap v10474: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 321 KiB/s wr, 7 op/s 2023-05-08T09:09:55.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19533.566623 secs 2023-05-08T09:09:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:55 smithi096 ceph-mon[124666]: pgmap v10474: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 321 KiB/s wr, 7 op/s 2023-05-08T09:09:56.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19534.852690 secs 2023-05-08T09:09:56.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19534.852690 secs 2023-05-08T09:09:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19534.852690 secs 2023-05-08T09:09:57.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:57 smithi186 ceph-mon[126480]: pgmap v10475: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 599 KiB/s rd, 494 KiB/s wr, 13 op/s 2023-05-08T09:09:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:57 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:09:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:09:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:09:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:09:57.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:57 smithi133 ceph-mon[125939]: pgmap v10475: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 599 KiB/s rd, 494 KiB/s wr, 13 op/s 2023-05-08T09:09:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:57 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:09:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:09:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:09:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:09:57.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:57 smithi096 ceph-mon[124666]: pgmap v10475: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 599 KiB/s rd, 494 KiB/s wr, 13 op/s 2023-05-08T09:09:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:57 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:09:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:09:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:09:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:09:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:59 smithi186 ceph-mon[126480]: pgmap v10476: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 325 KiB/s wr, 10 op/s 2023-05-08T09:09:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:09:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19538.010375 secs 2023-05-08T09:09:59.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:59 smithi133 ceph-mon[125939]: pgmap v10476: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 325 KiB/s wr, 10 op/s 2023-05-08T09:09:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:09:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19538.010375 secs 2023-05-08T09:09:59.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:59 smithi096 ceph-mon[124666]: pgmap v10476: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 325 KiB/s wr, 10 op/s 2023-05-08T09:09:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:09:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19538.010375 secs 2023-05-08T09:10:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:00 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:10:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:00 smithi186 ceph-mon[126480]: overall HEALTH_WARN 3 MDSs report slow requests 2023-05-08T09:10:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:00 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:10:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:00 smithi133 ceph-mon[125939]: overall HEALTH_WARN 3 MDSs report slow requests 2023-05-08T09:10:00.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:00 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:10:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:00 smithi096 ceph-mon[124666]: overall HEALTH_WARN 3 MDSs report slow requests 2023-05-08T09:10:01.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:01 smithi186 ceph-mon[126480]: pgmap v10477: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 579 KiB/s rd, 484 KiB/s wr, 15 op/s 2023-05-08T09:10:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:10:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:10:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19539.852819 secs 2023-05-08T09:10:01.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:01 smithi133 ceph-mon[125939]: pgmap v10477: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 579 KiB/s rd, 484 KiB/s wr, 15 op/s 2023-05-08T09:10:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:10:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:10:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19539.852819 secs 2023-05-08T09:10:01.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:01 smithi096 ceph-mon[124666]: pgmap v10477: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 579 KiB/s rd, 484 KiB/s wr, 15 op/s 2023-05-08T09:10:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:10:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:10:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19539.852819 secs 2023-05-08T09:10:03.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:03 smithi186 ceph-mon[126480]: pgmap v10478: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 332 KiB/s wr, 11 op/s 2023-05-08T09:10:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:03 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:10:03.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:03 smithi133 ceph-mon[125939]: pgmap v10478: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 332 KiB/s wr, 11 op/s 2023-05-08T09:10:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:03 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:10:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:03 smithi096 ceph-mon[124666]: pgmap v10478: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 332 KiB/s wr, 11 op/s 2023-05-08T09:10:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:03 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:10:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19543.010509 secs 2023-05-08T09:10:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19543.010509 secs 2023-05-08T09:10:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19543.010509 secs 2023-05-08T09:10:05.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19543.566880 secs 2023-05-08T09:10:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:05 smithi186 ceph-mon[126480]: pgmap v10479: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 332 KiB/s wr, 11 op/s 2023-05-08T09:10:05.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19543.566880 secs 2023-05-08T09:10:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:05 smithi133 ceph-mon[125939]: pgmap v10479: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 332 KiB/s wr, 11 op/s 2023-05-08T09:10:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19543.566880 secs 2023-05-08T09:10:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:05 smithi096 ceph-mon[124666]: pgmap v10479: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 332 KiB/s wr, 11 op/s 2023-05-08T09:10:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19544.852934 secs 2023-05-08T09:10:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19544.852934 secs 2023-05-08T09:10:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19544.852934 secs 2023-05-08T09:10:07.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:07 smithi186 ceph-mon[126480]: pgmap v10480: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 489 KiB/s wr, 30 op/s 2023-05-08T09:10:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:07 smithi186 ceph-mon[126480]: osdmap e732: 12 total, 12 up, 12 in 2023-05-08T09:10:07.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:07 smithi133 ceph-mon[125939]: pgmap v10480: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 489 KiB/s wr, 30 op/s 2023-05-08T09:10:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:07 smithi133 ceph-mon[125939]: osdmap e732: 12 total, 12 up, 12 in 2023-05-08T09:10:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:07 smithi096 ceph-mon[124666]: pgmap v10480: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 489 KiB/s wr, 30 op/s 2023-05-08T09:10:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:07 smithi096 ceph-mon[124666]: osdmap e732: 12 total, 12 up, 12 in 2023-05-08T09:10:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:08 smithi133 ceph-mon[125939]: pgmap v10482: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 380 KiB/s wr, 29 op/s 2023-05-08T09:10:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:08 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:10:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:10:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:10:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:08 smithi096 ceph-mon[124666]: pgmap v10482: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 380 KiB/s wr, 29 op/s 2023-05-08T09:10:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:08 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:10:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:10:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:10:09.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:08 smithi186 ceph-mon[126480]: pgmap v10482: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 380 KiB/s wr, 29 op/s 2023-05-08T09:10:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:08 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:10:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:10:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:10:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19548.010619 secs 2023-05-08T09:10:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19548.567000 secs 2023-05-08T09:10:10.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19548.010619 secs 2023-05-08T09:10:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19548.567000 secs 2023-05-08T09:10:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19548.010619 secs 2023-05-08T09:10:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19548.567000 secs 2023-05-08T09:10:11.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:10 smithi133 ceph-mon[125939]: pgmap v10483: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 272 KiB/s wr, 28 op/s 2023-05-08T09:10:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19549.853068 secs 2023-05-08T09:10:11.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:10 smithi096 ceph-mon[124666]: pgmap v10483: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 272 KiB/s wr, 28 op/s 2023-05-08T09:10:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19549.853068 secs 2023-05-08T09:10:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:10 smithi186 ceph-mon[126480]: pgmap v10483: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 272 KiB/s wr, 28 op/s 2023-05-08T09:10:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19549.853068 secs 2023-05-08T09:10:13.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:12 smithi133 ceph-mon[125939]: pgmap v10484: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 272 KiB/s wr, 28 op/s 2023-05-08T09:10:13.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:12 smithi133 ceph-mon[125939]: osdmap e733: 12 total, 12 up, 12 in 2023-05-08T09:10:13.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:12 smithi096 ceph-mon[124666]: pgmap v10484: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 272 KiB/s wr, 28 op/s 2023-05-08T09:10:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:12 smithi096 ceph-mon[124666]: osdmap e733: 12 total, 12 up, 12 in 2023-05-08T09:10:13.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:12 smithi186 ceph-mon[126480]: pgmap v10484: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 272 KiB/s wr, 28 op/s 2023-05-08T09:10:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:12 smithi186 ceph-mon[126480]: osdmap e733: 12 total, 12 up, 12 in 2023-05-08T09:10:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19553.010759 secs 2023-05-08T09:10:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19553.567126 secs 2023-05-08T09:10:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:14 smithi133 ceph-mon[125939]: pgmap v10486: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 104 KiB/s wr, 6 op/s 2023-05-08T09:10:15.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19553.010759 secs 2023-05-08T09:10:15.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19553.567126 secs 2023-05-08T09:10:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:14 smithi096 ceph-mon[124666]: pgmap v10486: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 104 KiB/s wr, 6 op/s 2023-05-08T09:10:15.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19553.010759 secs 2023-05-08T09:10:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19553.567126 secs 2023-05-08T09:10:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:14 smithi186 ceph-mon[126480]: pgmap v10486: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 104 KiB/s wr, 6 op/s 2023-05-08T09:10:16.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19554.853203 secs 2023-05-08T09:10:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19554.853203 secs 2023-05-08T09:10:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19554.853203 secs 2023-05-08T09:10:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:16 smithi133 ceph-mon[125939]: pgmap v10487: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 144 KiB/s wr, 8 op/s 2023-05-08T09:10:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:16 smithi096 ceph-mon[124666]: pgmap v10487: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 144 KiB/s wr, 8 op/s 2023-05-08T09:10:17.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:16 smithi186 ceph-mon[126480]: pgmap v10487: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 144 KiB/s wr, 8 op/s 2023-05-08T09:10:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:18 smithi133 ceph-mon[125939]: pgmap v10488: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 143 KiB/s wr, 8 op/s 2023-05-08T09:10:19.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:18 smithi096 ceph-mon[124666]: pgmap v10488: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 143 KiB/s wr, 8 op/s 2023-05-08T09:10:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:18 smithi186 ceph-mon[126480]: pgmap v10488: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 143 KiB/s wr, 8 op/s 2023-05-08T09:10:20.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19558.010885 secs 2023-05-08T09:10:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19558.567265 secs 2023-05-08T09:10:20.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19558.010885 secs 2023-05-08T09:10:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19558.567265 secs 2023-05-08T09:10:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19558.010885 secs 2023-05-08T09:10:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19558.567265 secs 2023-05-08T09:10:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:20 smithi133 ceph-mon[125939]: pgmap v10489: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 59 KiB/s wr, 6 op/s 2023-05-08T09:10:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19559.853316 secs 2023-05-08T09:10:21.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:20 smithi096 ceph-mon[124666]: pgmap v10489: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 59 KiB/s wr, 6 op/s 2023-05-08T09:10:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19559.853316 secs 2023-05-08T09:10:21.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:20 smithi186 ceph-mon[126480]: pgmap v10489: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 59 KiB/s wr, 6 op/s 2023-05-08T09:10:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19559.853316 secs 2023-05-08T09:10:23.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:22 smithi133 ceph-mon[125939]: pgmap v10490: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 59 KiB/s wr, 6 op/s 2023-05-08T09:10:23.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:22 smithi096 ceph-mon[124666]: pgmap v10490: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 59 KiB/s wr, 6 op/s 2023-05-08T09:10:23.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:22 smithi186 ceph-mon[126480]: pgmap v10490: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 59 KiB/s wr, 6 op/s 2023-05-08T09:10:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19563.011012 secs 2023-05-08T09:10:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19563.567405 secs 2023-05-08T09:10:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:24 smithi133 ceph-mon[125939]: pgmap v10491: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 54 KiB/s wr, 5 op/s 2023-05-08T09:10:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19563.011012 secs 2023-05-08T09:10:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19563.567405 secs 2023-05-08T09:10:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:24 smithi096 ceph-mon[124666]: pgmap v10491: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 54 KiB/s wr, 5 op/s 2023-05-08T09:10:25.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19563.011012 secs 2023-05-08T09:10:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19563.567405 secs 2023-05-08T09:10:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:24 smithi186 ceph-mon[126480]: pgmap v10491: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 54 KiB/s wr, 5 op/s 2023-05-08T09:10:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19564.853447 secs 2023-05-08T09:10:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19564.853447 secs 2023-05-08T09:10:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19564.853447 secs 2023-05-08T09:10:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:26 smithi133 ceph-mon[125939]: pgmap v10492: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 49 KiB/s wr, 7 op/s 2023-05-08T09:10:27.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:26 smithi096 ceph-mon[124666]: pgmap v10492: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 49 KiB/s wr, 7 op/s 2023-05-08T09:10:27.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:26 smithi186 ceph-mon[126480]: pgmap v10492: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 49 KiB/s wr, 7 op/s 2023-05-08T09:10:29.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:28 smithi133 ceph-mon[125939]: pgmap v10493: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:10:29.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:28 smithi096 ceph-mon[124666]: pgmap v10493: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:10:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:28 smithi186 ceph-mon[126480]: pgmap v10493: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:10:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19568.011146 secs 2023-05-08T09:10:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19568.567527 secs 2023-05-08T09:10:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19568.011146 secs 2023-05-08T09:10:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19568.567527 secs 2023-05-08T09:10:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19568.011146 secs 2023-05-08T09:10:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19568.567527 secs 2023-05-08T09:10:31.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:30 smithi133 ceph-mon[125939]: pgmap v10494: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T09:10:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19569.853589 secs 2023-05-08T09:10:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:30 smithi096 ceph-mon[124666]: pgmap v10494: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T09:10:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19569.853589 secs 2023-05-08T09:10:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:30 smithi186 ceph-mon[126480]: pgmap v10494: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T09:10:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19569.853589 secs 2023-05-08T09:10:33.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:32 smithi133 ceph-mon[125939]: pgmap v10495: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T09:10:33.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:32 smithi096 ceph-mon[124666]: pgmap v10495: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T09:10:33.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:32 smithi186 ceph-mon[126480]: pgmap v10495: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T09:10:35.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19573.011271 secs 2023-05-08T09:10:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19573.567658 secs 2023-05-08T09:10:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:34 smithi096 ceph-mon[124666]: pgmap v10496: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T09:10:35.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19573.011271 secs 2023-05-08T09:10:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19573.567658 secs 2023-05-08T09:10:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:34 smithi186 ceph-mon[126480]: pgmap v10496: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T09:10:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19573.011271 secs 2023-05-08T09:10:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19573.567658 secs 2023-05-08T09:10:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:34 smithi133 ceph-mon[125939]: pgmap v10496: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T09:10:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19574.853736 secs 2023-05-08T09:10:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19574.853736 secs 2023-05-08T09:10:36.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19574.853736 secs 2023-05-08T09:10:37.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:37 smithi096 ceph-mon[124666]: pgmap v10497: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 64 KiB/s wr, 8 op/s 2023-05-08T09:10:37.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:37 smithi186 ceph-mon[126480]: pgmap v10497: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 64 KiB/s wr, 8 op/s 2023-05-08T09:10:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:37 smithi133 ceph-mon[125939]: pgmap v10497: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 64 KiB/s wr, 8 op/s 2023-05-08T09:10:39.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:39 smithi096 ceph-mon[124666]: pgmap v10498: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 64 KiB/s wr, 6 op/s 2023-05-08T09:10:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19578.011404 secs 2023-05-08T09:10:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:10:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:39 smithi186 ceph-mon[126480]: pgmap v10498: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 64 KiB/s wr, 6 op/s 2023-05-08T09:10:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19578.011404 secs 2023-05-08T09:10:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:10:39.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:39 smithi133 ceph-mon[125939]: pgmap v10498: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 64 KiB/s wr, 6 op/s 2023-05-08T09:10:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19578.011404 secs 2023-05-08T09:10:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:10:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19578.567756 secs 2023-05-08T09:10:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:40 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:10:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:40 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:10:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:40 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:10:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:40 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:10:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:40 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T09:10:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:40 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T09:10:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:40 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:10:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19578.567756 secs 2023-05-08T09:10:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:40 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:10:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:40 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:10:40.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:40 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:10:40.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:40 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:10:40.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:40 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T09:10:40.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:40 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T09:10:40.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:40 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:10:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19578.567756 secs 2023-05-08T09:10:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:40 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:10:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:40 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:10:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:40 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:10:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:40 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:10:40.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:40 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T09:10:40.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:40 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T09:10:40.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:40 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:10:41.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:41 smithi186 ceph-mon[126480]: pgmap v10499: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 65 KiB/s wr, 10 op/s 2023-05-08T09:10:41.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:41 smithi133 ceph-mon[125939]: pgmap v10499: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 65 KiB/s wr, 10 op/s 2023-05-08T09:10:41.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:41 smithi096 ceph-mon[124666]: pgmap v10499: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 65 KiB/s wr, 10 op/s 2023-05-08T09:10:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:43 smithi186 ceph-mon[126480]: pgmap v10500: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 64 KiB/s wr, 7 op/s 2023-05-08T09:10:43.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:10:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:43 smithi133 ceph-mon[125939]: pgmap v10500: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 64 KiB/s wr, 7 op/s 2023-05-08T09:10:43.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:10:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:43 smithi096 ceph-mon[124666]: pgmap v10500: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 64 KiB/s wr, 7 op/s 2023-05-08T09:10:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:10:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19583.011545 secs 2023-05-08T09:10:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:10:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:10:44.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:10:44.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19583.011545 secs 2023-05-08T09:10:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:10:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:10:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:10:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19583.011545 secs 2023-05-08T09:10:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:10:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:10:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:10:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19583.567875 secs 2023-05-08T09:10:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:45 smithi186 ceph-mon[126480]: pgmap v10501: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 64 KiB/s wr, 7 op/s 2023-05-08T09:10:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19583.567875 secs 2023-05-08T09:10:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:45 smithi133 ceph-mon[125939]: pgmap v10501: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 64 KiB/s wr, 7 op/s 2023-05-08T09:10:45.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19583.567875 secs 2023-05-08T09:10:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:45 smithi096 ceph-mon[124666]: pgmap v10501: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 64 KiB/s wr, 7 op/s 2023-05-08T09:10:47.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:47 smithi186 ceph-mon[126480]: pgmap v10502: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 193 KiB/s wr, 10 op/s 2023-05-08T09:10:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:47 smithi133 ceph-mon[125939]: pgmap v10502: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 193 KiB/s wr, 10 op/s 2023-05-08T09:10:47.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:47 smithi096 ceph-mon[124666]: pgmap v10502: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 193 KiB/s wr, 10 op/s 2023-05-08T09:10:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:49 smithi186 ceph-mon[126480]: pgmap v10503: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 129 KiB/s wr, 6 op/s 2023-05-08T09:10:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19588.011673 secs 2023-05-08T09:10:49.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:49 smithi133 ceph-mon[125939]: pgmap v10503: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 129 KiB/s wr, 6 op/s 2023-05-08T09:10:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19588.011673 secs 2023-05-08T09:10:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:49 smithi096 ceph-mon[124666]: pgmap v10503: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 129 KiB/s wr, 6 op/s 2023-05-08T09:10:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19588.011673 secs 2023-05-08T09:10:51.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:51 smithi186 ceph-mon[126480]: pgmap v10504: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 456 KiB/s rd, 389 KiB/s wr, 11 op/s 2023-05-08T09:10:51.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:51 smithi133 ceph-mon[125939]: pgmap v10504: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 456 KiB/s rd, 389 KiB/s wr, 11 op/s 2023-05-08T09:10:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:51 smithi096 ceph-mon[124666]: pgmap v10504: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 456 KiB/s rd, 389 KiB/s wr, 11 op/s 2023-05-08T09:10:52.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:10:52.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:10:52.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:10:53.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:53 smithi186 ceph-mon[126480]: pgmap v10505: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 389 KiB/s wr, 7 op/s 2023-05-08T09:10:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:53 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:10:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:10:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:10:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:53 smithi133 ceph-mon[125939]: pgmap v10505: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 389 KiB/s wr, 7 op/s 2023-05-08T09:10:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:53 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:10:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:10:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:10:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:53 smithi096 ceph-mon[124666]: pgmap v10505: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 389 KiB/s wr, 7 op/s 2023-05-08T09:10:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:53 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:10:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:10:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:10:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19593.011797 secs 2023-05-08T09:10:54.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19593.011797 secs 2023-05-08T09:10:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19593.011797 secs 2023-05-08T09:10:55.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19593.568118 secs 2023-05-08T09:10:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:55 smithi186 ceph-mon[126480]: pgmap v10506: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 389 KiB/s wr, 7 op/s 2023-05-08T09:10:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19593.568118 secs 2023-05-08T09:10:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:55 smithi133 ceph-mon[125939]: pgmap v10506: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 389 KiB/s wr, 7 op/s 2023-05-08T09:10:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19593.568118 secs 2023-05-08T09:10:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:55 smithi096 ceph-mon[124666]: pgmap v10506: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 389 KiB/s wr, 7 op/s 2023-05-08T09:10:56.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19594.854251 secs 2023-05-08T09:10:56.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:10:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:10:56.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19594.854251 secs 2023-05-08T09:10:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:10:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:10:56.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19594.854251 secs 2023-05-08T09:10:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:10:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:10:57.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:57 smithi186 ceph-mon[126480]: pgmap v10507: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 575 KiB/s rd, 562 KiB/s wr, 13 op/s 2023-05-08T09:10:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:10:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:10:57.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:57 smithi133 ceph-mon[125939]: pgmap v10507: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 575 KiB/s rd, 562 KiB/s wr, 13 op/s 2023-05-08T09:10:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:10:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:10:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:57 smithi096 ceph-mon[124666]: pgmap v10507: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 575 KiB/s rd, 562 KiB/s wr, 13 op/s 2023-05-08T09:10:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:10:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:10:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:58 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:10:58.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:58 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:10:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:58 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:10:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:59 smithi186 ceph-mon[126480]: pgmap v10508: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 434 KiB/s wr, 9 op/s 2023-05-08T09:10:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19598.011931 secs 2023-05-08T09:10:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:10:59 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:10:59.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:59 smithi133 ceph-mon[125939]: pgmap v10508: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 434 KiB/s wr, 9 op/s 2023-05-08T09:10:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19598.011931 secs 2023-05-08T09:10:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:10:59 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:10:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:59 smithi096 ceph-mon[124666]: pgmap v10508: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 434 KiB/s wr, 9 op/s 2023-05-08T09:10:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19598.011931 secs 2023-05-08T09:10:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:10:59 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:11:00.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:11:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:11:00.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:11:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:11:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:11:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:11:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:01 smithi133 ceph-mon[125939]: pgmap v10509: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 529 KiB/s wr, 14 op/s 2023-05-08T09:11:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19599.854400 secs 2023-05-08T09:11:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:01 smithi096 ceph-mon[124666]: pgmap v10509: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 529 KiB/s wr, 14 op/s 2023-05-08T09:11:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19599.854400 secs 2023-05-08T09:11:01.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:01 smithi186 ceph-mon[126480]: pgmap v10509: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 529 KiB/s wr, 14 op/s 2023-05-08T09:11:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19599.854400 secs 2023-05-08T09:11:03.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:03 smithi133 ceph-mon[125939]: pgmap v10510: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 269 KiB/s wr, 10 op/s 2023-05-08T09:11:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:03 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:11:03.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:03 smithi096 ceph-mon[124666]: pgmap v10510: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 269 KiB/s wr, 10 op/s 2023-05-08T09:11:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:03 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:11:03.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:03 smithi186 ceph-mon[126480]: pgmap v10510: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 269 KiB/s wr, 10 op/s 2023-05-08T09:11:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:03 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:11:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19603.012065 secs 2023-05-08T09:11:04.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19603.012065 secs 2023-05-08T09:11:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19603.012065 secs 2023-05-08T09:11:05.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19603.568351 secs 2023-05-08T09:11:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:05 smithi133 ceph-mon[125939]: pgmap v10511: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 269 KiB/s wr, 10 op/s 2023-05-08T09:11:05.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19603.568351 secs 2023-05-08T09:11:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:05 smithi096 ceph-mon[124666]: pgmap v10511: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 269 KiB/s wr, 10 op/s 2023-05-08T09:11:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19603.568351 secs 2023-05-08T09:11:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:05 smithi186 ceph-mon[126480]: pgmap v10511: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 269 KiB/s wr, 10 op/s 2023-05-08T09:11:06.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19604.854543 secs 2023-05-08T09:11:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:06 smithi133 ceph-mon[125939]: osdmap e734: 12 total, 12 up, 12 in 2023-05-08T09:11:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19604.854543 secs 2023-05-08T09:11:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:06 smithi096 ceph-mon[124666]: osdmap e734: 12 total, 12 up, 12 in 2023-05-08T09:11:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19604.854543 secs 2023-05-08T09:11:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:06 smithi186 ceph-mon[126480]: osdmap e734: 12 total, 12 up, 12 in 2023-05-08T09:11:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:07 smithi133 ceph-mon[125939]: pgmap v10513: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 383 KiB/s wr, 29 op/s 2023-05-08T09:11:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:07 smithi096 ceph-mon[124666]: pgmap v10513: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 383 KiB/s wr, 29 op/s 2023-05-08T09:11:07.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:07 smithi186 ceph-mon[126480]: pgmap v10513: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 383 KiB/s wr, 29 op/s 2023-05-08T09:11:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:11:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:11:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:08 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:11:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:11:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:11:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:08 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:11:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:11:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:11:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:08 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:11:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:09 smithi133 ceph-mon[125939]: pgmap v10514: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 383 KiB/s wr, 29 op/s 2023-05-08T09:11:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19608.012208 secs 2023-05-08T09:11:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:09 smithi096 ceph-mon[124666]: pgmap v10514: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 383 KiB/s wr, 29 op/s 2023-05-08T09:11:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19608.012208 secs 2023-05-08T09:11:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:09 smithi186 ceph-mon[126480]: pgmap v10514: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 383 KiB/s wr, 29 op/s 2023-05-08T09:11:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19608.012208 secs 2023-05-08T09:11:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19608.568462 secs 2023-05-08T09:11:10.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19608.568462 secs 2023-05-08T09:11:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19608.568462 secs 2023-05-08T09:11:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:11 smithi133 ceph-mon[125939]: pgmap v10515: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 353 KiB/s wr, 28 op/s 2023-05-08T09:11:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19609.854665 secs 2023-05-08T09:11:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:11 smithi096 ceph-mon[124666]: pgmap v10515: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 353 KiB/s wr, 28 op/s 2023-05-08T09:11:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19609.854665 secs 2023-05-08T09:11:11.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:11 smithi186 ceph-mon[126480]: pgmap v10515: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 353 KiB/s wr, 28 op/s 2023-05-08T09:11:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19609.854665 secs 2023-05-08T09:11:13.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:13 smithi133 ceph-mon[125939]: pgmap v10516: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 353 KiB/s wr, 28 op/s 2023-05-08T09:11:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:13 smithi133 ceph-mon[125939]: osdmap e735: 12 total, 12 up, 12 in 2023-05-08T09:11:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:13 smithi096 ceph-mon[124666]: pgmap v10516: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 353 KiB/s wr, 28 op/s 2023-05-08T09:11:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:13 smithi096 ceph-mon[124666]: osdmap e735: 12 total, 12 up, 12 in 2023-05-08T09:11:13.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:13 smithi186 ceph-mon[126480]: pgmap v10516: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 353 KiB/s wr, 28 op/s 2023-05-08T09:11:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:13 smithi186 ceph-mon[126480]: osdmap e735: 12 total, 12 up, 12 in 2023-05-08T09:11:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19613.012319 secs 2023-05-08T09:11:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19613.012319 secs 2023-05-08T09:11:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19613.012319 secs 2023-05-08T09:11:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19613.568580 secs 2023-05-08T09:11:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:15 smithi133 ceph-mon[125939]: pgmap v10518: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 98 KiB/s wr, 6 op/s 2023-05-08T09:11:15.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19613.568580 secs 2023-05-08T09:11:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:15 smithi096 ceph-mon[124666]: pgmap v10518: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 98 KiB/s wr, 6 op/s 2023-05-08T09:11:15.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19613.568580 secs 2023-05-08T09:11:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:15 smithi186 ceph-mon[126480]: pgmap v10518: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 98 KiB/s wr, 6 op/s 2023-05-08T09:11:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19614.854814 secs 2023-05-08T09:11:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19614.854814 secs 2023-05-08T09:11:16.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19614.854814 secs 2023-05-08T09:11:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:17 smithi133 ceph-mon[125939]: pgmap v10519: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 143 KiB/s wr, 8 op/s 2023-05-08T09:11:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:17 smithi096 ceph-mon[124666]: pgmap v10519: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 143 KiB/s wr, 8 op/s 2023-05-08T09:11:17.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:17 smithi186 ceph-mon[126480]: pgmap v10519: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 143 KiB/s wr, 8 op/s 2023-05-08T09:11:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:19 smithi133 ceph-mon[125939]: pgmap v10520: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 143 KiB/s wr, 8 op/s 2023-05-08T09:11:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19618.012465 secs 2023-05-08T09:11:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:19 smithi096 ceph-mon[124666]: pgmap v10520: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 143 KiB/s wr, 8 op/s 2023-05-08T09:11:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19618.012465 secs 2023-05-08T09:11:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:19 smithi186 ceph-mon[126480]: pgmap v10520: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 143 KiB/s wr, 8 op/s 2023-05-08T09:11:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19618.012465 secs 2023-05-08T09:11:20.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19618.568689 secs 2023-05-08T09:11:20.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19618.568689 secs 2023-05-08T09:11:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19618.568689 secs 2023-05-08T09:11:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:21 smithi133 ceph-mon[125939]: pgmap v10521: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 59 KiB/s wr, 6 op/s 2023-05-08T09:11:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19619.854916 secs 2023-05-08T09:11:21.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:21 smithi096 ceph-mon[124666]: pgmap v10521: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 59 KiB/s wr, 6 op/s 2023-05-08T09:11:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19619.854916 secs 2023-05-08T09:11:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:21 smithi186 ceph-mon[126480]: pgmap v10521: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 59 KiB/s wr, 6 op/s 2023-05-08T09:11:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19619.854916 secs 2023-05-08T09:11:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:23 smithi133 ceph-mon[125939]: pgmap v10522: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 59 KiB/s wr, 6 op/s 2023-05-08T09:11:23.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:23 smithi096 ceph-mon[124666]: pgmap v10522: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 59 KiB/s wr, 6 op/s 2023-05-08T09:11:23.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:23 smithi186 ceph-mon[126480]: pgmap v10522: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 59 KiB/s wr, 6 op/s 2023-05-08T09:11:24.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19623.012544 secs 2023-05-08T09:11:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19623.012544 secs 2023-05-08T09:11:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19623.012544 secs 2023-05-08T09:11:25.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19623.568811 secs 2023-05-08T09:11:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:25 smithi133 ceph-mon[125939]: pgmap v10523: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 54 KiB/s wr, 5 op/s 2023-05-08T09:11:25.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19623.568811 secs 2023-05-08T09:11:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:25 smithi096 ceph-mon[124666]: pgmap v10523: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 54 KiB/s wr, 5 op/s 2023-05-08T09:11:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19623.568811 secs 2023-05-08T09:11:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:25 smithi186 ceph-mon[126480]: pgmap v10523: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 54 KiB/s wr, 5 op/s 2023-05-08T09:11:26.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19624.855041 secs 2023-05-08T09:11:26.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19624.855041 secs 2023-05-08T09:11:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19624.855041 secs 2023-05-08T09:11:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:27 smithi133 ceph-mon[125939]: pgmap v10524: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 50 KiB/s wr, 7 op/s 2023-05-08T09:11:27.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:27 smithi096 ceph-mon[124666]: pgmap v10524: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 50 KiB/s wr, 7 op/s 2023-05-08T09:11:27.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:27 smithi186 ceph-mon[126480]: pgmap v10524: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 50 KiB/s wr, 7 op/s 2023-05-08T09:11:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:29 smithi133 ceph-mon[125939]: pgmap v10525: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:11:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19628.012662 secs 2023-05-08T09:11:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19628.568926 secs 2023-05-08T09:11:29.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:29 smithi096 ceph-mon[124666]: pgmap v10525: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:11:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19628.012662 secs 2023-05-08T09:11:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19628.568926 secs 2023-05-08T09:11:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:29 smithi186 ceph-mon[126480]: pgmap v10525: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:11:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19628.012662 secs 2023-05-08T09:11:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19628.568926 secs 2023-05-08T09:11:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:31 smithi133 ceph-mon[125939]: pgmap v10526: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T09:11:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19629.855177 secs 2023-05-08T09:11:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:31 smithi096 ceph-mon[124666]: pgmap v10526: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T09:11:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19629.855177 secs 2023-05-08T09:11:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:31 smithi186 ceph-mon[126480]: pgmap v10526: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T09:11:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19629.855177 secs 2023-05-08T09:11:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:33 smithi133 ceph-mon[125939]: pgmap v10527: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T09:11:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:33 smithi096 ceph-mon[124666]: pgmap v10527: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T09:11:33.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:33 smithi186 ceph-mon[126480]: pgmap v10527: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T09:11:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19633.012775 secs 2023-05-08T09:11:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19633.569031 secs 2023-05-08T09:11:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19633.012775 secs 2023-05-08T09:11:34.792 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19633.569031 secs 2023-05-08T09:11:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19633.012775 secs 2023-05-08T09:11:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19633.569031 secs 2023-05-08T09:11:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:35 smithi133 ceph-mon[125939]: pgmap v10528: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T09:11:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:35 smithi096 ceph-mon[124666]: pgmap v10528: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T09:11:35.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:35 smithi186 ceph-mon[126480]: pgmap v10528: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T09:11:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19634.855307 secs 2023-05-08T09:11:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19634.855307 secs 2023-05-08T09:11:36.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19634.855307 secs 2023-05-08T09:11:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:37 smithi133 ceph-mon[125939]: pgmap v10529: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 124 KiB/s wr, 9 op/s 2023-05-08T09:11:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:37 smithi096 ceph-mon[124666]: pgmap v10529: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 124 KiB/s wr, 9 op/s 2023-05-08T09:11:37.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:37 smithi186 ceph-mon[126480]: pgmap v10529: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 124 KiB/s wr, 9 op/s 2023-05-08T09:11:39.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:39 smithi133 ceph-mon[125939]: pgmap v10530: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 124 KiB/s wr, 6 op/s 2023-05-08T09:11:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19638.012909 secs 2023-05-08T09:11:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19638.569174 secs 2023-05-08T09:11:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:11:39.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:39 smithi096 ceph-mon[124666]: pgmap v10530: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 124 KiB/s wr, 6 op/s 2023-05-08T09:11:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19638.012909 secs 2023-05-08T09:11:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19638.569174 secs 2023-05-08T09:11:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:11:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:39 smithi186 ceph-mon[126480]: pgmap v10530: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 124 KiB/s wr, 6 op/s 2023-05-08T09:11:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19638.012909 secs 2023-05-08T09:11:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19638.569174 secs 2023-05-08T09:11:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:11:40.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:40 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:11:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:40 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:11:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:40 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:11:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:40 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:11:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:40 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:11:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:40 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:11:40.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:40 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:11:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:40 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:11:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:40 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:11:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:41 smithi096 ceph-mon[124666]: pgmap v10531: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 124 KiB/s wr, 10 op/s 2023-05-08T09:11:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:41 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:11:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:41 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T09:11:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:41 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T09:11:41.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:41 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:11:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:41 smithi186 ceph-mon[126480]: pgmap v10531: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 124 KiB/s wr, 10 op/s 2023-05-08T09:11:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:41 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:11:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:41 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T09:11:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:41 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T09:11:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:41 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:11:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:41 smithi133 ceph-mon[125939]: pgmap v10531: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 124 KiB/s wr, 10 op/s 2023-05-08T09:11:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:41 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:11:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:41 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T09:11:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:41 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T09:11:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:41 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:11:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:43 smithi096 ceph-mon[124666]: pgmap v10532: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 124 KiB/s wr, 7 op/s 2023-05-08T09:11:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:11:43.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:43 smithi186 ceph-mon[126480]: pgmap v10532: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 124 KiB/s wr, 7 op/s 2023-05-08T09:11:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:11:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:43 smithi133 ceph-mon[125939]: pgmap v10532: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 124 KiB/s wr, 7 op/s 2023-05-08T09:11:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:11:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19643.013025 secs 2023-05-08T09:11:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19643.569277 secs 2023-05-08T09:11:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:11:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:11:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:11:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19643.013025 secs 2023-05-08T09:11:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19643.569277 secs 2023-05-08T09:11:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:11:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:11:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:11:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19643.013025 secs 2023-05-08T09:11:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19643.569277 secs 2023-05-08T09:11:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:11:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:11:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:11:45.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:45 smithi096 ceph-mon[124666]: pgmap v10533: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 124 KiB/s wr, 7 op/s 2023-05-08T09:11:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:45 smithi186 ceph-mon[126480]: pgmap v10533: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 124 KiB/s wr, 7 op/s 2023-05-08T09:11:45.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:45 smithi133 ceph-mon[125939]: pgmap v10533: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 124 KiB/s wr, 7 op/s 2023-05-08T09:11:47.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:47 smithi186 ceph-mon[126480]: pgmap v10534: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 253 KiB/s wr, 10 op/s 2023-05-08T09:11:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:47 smithi133 ceph-mon[125939]: pgmap v10534: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 253 KiB/s wr, 10 op/s 2023-05-08T09:11:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:47 smithi096 ceph-mon[124666]: pgmap v10534: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 253 KiB/s wr, 10 op/s 2023-05-08T09:11:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:49 smithi186 ceph-mon[126480]: pgmap v10535: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 130 KiB/s wr, 6 op/s 2023-05-08T09:11:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19648.013142 secs 2023-05-08T09:11:49.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:49 smithi133 ceph-mon[125939]: pgmap v10535: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 130 KiB/s wr, 6 op/s 2023-05-08T09:11:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19648.013142 secs 2023-05-08T09:11:50.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:49 smithi096 ceph-mon[124666]: pgmap v10535: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 130 KiB/s wr, 6 op/s 2023-05-08T09:11:50.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19648.013142 secs 2023-05-08T09:11:51.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:51 smithi186 ceph-mon[126480]: pgmap v10536: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 391 KiB/s wr, 11 op/s 2023-05-08T09:11:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:11:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:51 smithi133 ceph-mon[125939]: pgmap v10536: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 391 KiB/s wr, 11 op/s 2023-05-08T09:11:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:11:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:51 smithi096 ceph-mon[124666]: pgmap v10536: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 391 KiB/s wr, 11 op/s 2023-05-08T09:11:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:11:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:52 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:11:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:11:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:11:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:52 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:11:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:11:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:11:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:52 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:11:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:11:53.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:11:53.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:53 smithi186 ceph-mon[126480]: pgmap v10537: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 393 KiB/s rd, 391 KiB/s wr, 7 op/s 2023-05-08T09:11:53.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:53 smithi133 ceph-mon[125939]: pgmap v10537: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 393 KiB/s rd, 391 KiB/s wr, 7 op/s 2023-05-08T09:11:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:53 smithi096 ceph-mon[124666]: pgmap v10537: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 393 KiB/s rd, 391 KiB/s wr, 7 op/s 2023-05-08T09:11:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19653.013277 secs 2023-05-08T09:11:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19653.569519 secs 2023-05-08T09:11:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19653.013277 secs 2023-05-08T09:11:54.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19653.569519 secs 2023-05-08T09:11:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19653.013277 secs 2023-05-08T09:11:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19653.569519 secs 2023-05-08T09:11:55.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:55 smithi186 ceph-mon[126480]: pgmap v10538: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 393 KiB/s rd, 391 KiB/s wr, 7 op/s 2023-05-08T09:11:55.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:55 smithi133 ceph-mon[125939]: pgmap v10538: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 393 KiB/s rd, 391 KiB/s wr, 7 op/s 2023-05-08T09:11:56.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:55 smithi096 ceph-mon[124666]: pgmap v10538: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 393 KiB/s rd, 391 KiB/s wr, 7 op/s 2023-05-08T09:11:56.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19654.855690 secs 2023-05-08T09:11:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:11:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:11:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:11:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19654.855690 secs 2023-05-08T09:11:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:11:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:11:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:11:57.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19654.855690 secs 2023-05-08T09:11:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:11:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:11:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:11:57.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:57 smithi186 ceph-mon[126480]: pgmap v10539: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 565 KiB/s wr, 13 op/s 2023-05-08T09:11:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:57 smithi133 ceph-mon[125939]: pgmap v10539: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 565 KiB/s wr, 13 op/s 2023-05-08T09:11:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:57 smithi096 ceph-mon[124666]: pgmap v10539: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 565 KiB/s wr, 13 op/s 2023-05-08T09:11:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:58 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:11:58.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:58 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:11:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:58 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:11:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:59 smithi186 ceph-mon[126480]: pgmap v10540: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 436 KiB/s wr, 9 op/s 2023-05-08T09:11:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19658.013385 secs 2023-05-08T09:11:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:11:59 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:11:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:59 smithi133 ceph-mon[125939]: pgmap v10540: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 436 KiB/s wr, 9 op/s 2023-05-08T09:11:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19658.013385 secs 2023-05-08T09:11:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:11:59 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:12:00.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:59 smithi096 ceph-mon[124666]: pgmap v10540: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 436 KiB/s wr, 9 op/s 2023-05-08T09:12:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19658.013385 secs 2023-05-08T09:12:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:11:59 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:12:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:12:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:12:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:12:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:12:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:12:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:12:01.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:01 smithi186 ceph-mon[126480]: pgmap v10541: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 534 KiB/s rd, 531 KiB/s wr, 14 op/s 2023-05-08T09:12:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19659.855824 secs 2023-05-08T09:12:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:01 smithi133 ceph-mon[125939]: pgmap v10541: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 534 KiB/s rd, 531 KiB/s wr, 14 op/s 2023-05-08T09:12:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19659.855824 secs 2023-05-08T09:12:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:01 smithi096 ceph-mon[124666]: pgmap v10541: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 534 KiB/s rd, 531 KiB/s wr, 14 op/s 2023-05-08T09:12:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19659.855824 secs 2023-05-08T09:12:03.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:03 smithi186 ceph-mon[126480]: pgmap v10542: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 270 KiB/s wr, 10 op/s 2023-05-08T09:12:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:03 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:12:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:03 smithi133 ceph-mon[125939]: pgmap v10542: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 270 KiB/s wr, 10 op/s 2023-05-08T09:12:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:03 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:12:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:03 smithi096 ceph-mon[124666]: pgmap v10542: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 270 KiB/s wr, 10 op/s 2023-05-08T09:12:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:03 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:12:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19663.013504 secs 2023-05-08T09:12:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19663.569729 secs 2023-05-08T09:12:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19663.013504 secs 2023-05-08T09:12:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19663.569729 secs 2023-05-08T09:12:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19663.013504 secs 2023-05-08T09:12:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19663.569729 secs 2023-05-08T09:12:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:05 smithi186 ceph-mon[126480]: pgmap v10543: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 270 KiB/s wr, 10 op/s 2023-05-08T09:12:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:05 smithi133 ceph-mon[125939]: pgmap v10543: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 270 KiB/s wr, 10 op/s 2023-05-08T09:12:06.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:05 smithi096 ceph-mon[124666]: pgmap v10543: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 270 KiB/s wr, 10 op/s 2023-05-08T09:12:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19664.855944 secs 2023-05-08T09:12:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:06 smithi186 ceph-mon[126480]: osdmap e736: 12 total, 12 up, 12 in 2023-05-08T09:12:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19664.855944 secs 2023-05-08T09:12:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:06 smithi133 ceph-mon[125939]: osdmap e736: 12 total, 12 up, 12 in 2023-05-08T09:12:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19664.855944 secs 2023-05-08T09:12:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:06 smithi096 ceph-mon[124666]: osdmap e736: 12 total, 12 up, 12 in 2023-05-08T09:12:07.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:07 smithi186 ceph-mon[126480]: pgmap v10545: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 384 KiB/s wr, 29 op/s 2023-05-08T09:12:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:07 smithi133 ceph-mon[125939]: pgmap v10545: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 384 KiB/s wr, 29 op/s 2023-05-08T09:12:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:07 smithi096 ceph-mon[124666]: pgmap v10545: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 384 KiB/s wr, 29 op/s 2023-05-08T09:12:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:12:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:12:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:08 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:12:08.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:12:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:12:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:08 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:12:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:12:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:12:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:08 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:12:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:09 smithi186 ceph-mon[126480]: pgmap v10546: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 384 KiB/s wr, 29 op/s 2023-05-08T09:12:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19668.013606 secs 2023-05-08T09:12:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19668.569814 secs 2023-05-08T09:12:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:09 smithi133 ceph-mon[125939]: pgmap v10546: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 384 KiB/s wr, 29 op/s 2023-05-08T09:12:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19668.013606 secs 2023-05-08T09:12:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19668.569814 secs 2023-05-08T09:12:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:09 smithi096 ceph-mon[124666]: pgmap v10546: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 384 KiB/s wr, 29 op/s 2023-05-08T09:12:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19668.013606 secs 2023-05-08T09:12:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19668.569814 secs 2023-05-08T09:12:11.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:11 smithi186 ceph-mon[126480]: pgmap v10547: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 354 KiB/s wr, 28 op/s 2023-05-08T09:12:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19669.856063 secs 2023-05-08T09:12:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:11 smithi133 ceph-mon[125939]: pgmap v10547: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 354 KiB/s wr, 28 op/s 2023-05-08T09:12:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19669.856063 secs 2023-05-08T09:12:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:11 smithi096 ceph-mon[124666]: pgmap v10547: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 354 KiB/s wr, 28 op/s 2023-05-08T09:12:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19669.856063 secs 2023-05-08T09:12:13.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:13 smithi186 ceph-mon[126480]: pgmap v10548: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 354 KiB/s wr, 28 op/s 2023-05-08T09:12:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:13 smithi186 ceph-mon[126480]: osdmap e737: 12 total, 12 up, 12 in 2023-05-08T09:12:13.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:13 smithi133 ceph-mon[125939]: pgmap v10548: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 354 KiB/s wr, 28 op/s 2023-05-08T09:12:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:13 smithi133 ceph-mon[125939]: osdmap e737: 12 total, 12 up, 12 in 2023-05-08T09:12:14.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:13 smithi096 ceph-mon[124666]: pgmap v10548: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 354 KiB/s wr, 28 op/s 2023-05-08T09:12:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:13 smithi096 ceph-mon[124666]: osdmap e737: 12 total, 12 up, 12 in 2023-05-08T09:12:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19673.013725 secs 2023-05-08T09:12:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19673.569899 secs 2023-05-08T09:12:14.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19673.013725 secs 2023-05-08T09:12:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19673.569899 secs 2023-05-08T09:12:15.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19673.013725 secs 2023-05-08T09:12:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19673.569899 secs 2023-05-08T09:12:15.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:15 smithi186 ceph-mon[126480]: pgmap v10550: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 101 KiB/s wr, 6 op/s 2023-05-08T09:12:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:15 smithi133 ceph-mon[125939]: pgmap v10550: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 101 KiB/s wr, 6 op/s 2023-05-08T09:12:16.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:15 smithi096 ceph-mon[124666]: pgmap v10550: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 101 KiB/s wr, 6 op/s 2023-05-08T09:12:16.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19674.856180 secs 2023-05-08T09:12:16.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19674.856180 secs 2023-05-08T09:12:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19674.856180 secs 2023-05-08T09:12:17.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:17 smithi186 ceph-mon[126480]: pgmap v10551: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 144 KiB/s wr, 8 op/s 2023-05-08T09:12:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:17 smithi133 ceph-mon[125939]: pgmap v10551: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 144 KiB/s wr, 8 op/s 2023-05-08T09:12:18.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:17 smithi096 ceph-mon[124666]: pgmap v10551: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 144 KiB/s wr, 8 op/s 2023-05-08T09:12:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:19 smithi133 ceph-mon[125939]: pgmap v10552: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 144 KiB/s wr, 8 op/s 2023-05-08T09:12:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19678.013820 secs 2023-05-08T09:12:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19678.570035 secs 2023-05-08T09:12:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:19 smithi096 ceph-mon[124666]: pgmap v10552: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 144 KiB/s wr, 8 op/s 2023-05-08T09:12:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19678.013820 secs 2023-05-08T09:12:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19678.570035 secs 2023-05-08T09:12:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:19 smithi186 ceph-mon[126480]: pgmap v10552: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 144 KiB/s wr, 8 op/s 2023-05-08T09:12:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19678.013820 secs 2023-05-08T09:12:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19678.570035 secs 2023-05-08T09:12:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:21 smithi133 ceph-mon[125939]: pgmap v10553: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 60 KiB/s wr, 6 op/s 2023-05-08T09:12:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19679.856326 secs 2023-05-08T09:12:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:21 smithi096 ceph-mon[124666]: pgmap v10553: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 60 KiB/s wr, 6 op/s 2023-05-08T09:12:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19679.856326 secs 2023-05-08T09:12:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:21 smithi186 ceph-mon[126480]: pgmap v10553: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 60 KiB/s wr, 6 op/s 2023-05-08T09:12:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19679.856326 secs 2023-05-08T09:12:23.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:23 smithi133 ceph-mon[125939]: pgmap v10554: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 60 KiB/s wr, 6 op/s 2023-05-08T09:12:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:23 smithi096 ceph-mon[124666]: pgmap v10554: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 60 KiB/s wr, 6 op/s 2023-05-08T09:12:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:23 smithi186 ceph-mon[126480]: pgmap v10554: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 60 KiB/s wr, 6 op/s 2023-05-08T09:12:24.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19683.013947 secs 2023-05-08T09:12:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19683.570127 secs 2023-05-08T09:12:25.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19683.013947 secs 2023-05-08T09:12:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19683.570127 secs 2023-05-08T09:12:25.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19683.013947 secs 2023-05-08T09:12:25.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19683.570127 secs 2023-05-08T09:12:25.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:25 smithi133 ceph-mon[125939]: pgmap v10555: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 54 KiB/s wr, 5 op/s 2023-05-08T09:12:26.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:25 smithi096 ceph-mon[124666]: pgmap v10555: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 54 KiB/s wr, 5 op/s 2023-05-08T09:12:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:25 smithi186 ceph-mon[126480]: pgmap v10555: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 54 KiB/s wr, 5 op/s 2023-05-08T09:12:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19684.856448 secs 2023-05-08T09:12:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19684.856448 secs 2023-05-08T09:12:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19684.856448 secs 2023-05-08T09:12:27.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:27 smithi133 ceph-mon[125939]: pgmap v10556: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 50 KiB/s wr, 7 op/s 2023-05-08T09:12:28.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:27 smithi096 ceph-mon[124666]: pgmap v10556: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 50 KiB/s wr, 7 op/s 2023-05-08T09:12:28.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:27 smithi186 ceph-mon[126480]: pgmap v10556: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 50 KiB/s wr, 7 op/s 2023-05-08T09:12:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:29 smithi133 ceph-mon[125939]: pgmap v10557: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:12:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19688.014065 secs 2023-05-08T09:12:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19688.570249 secs 2023-05-08T09:12:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:29 smithi096 ceph-mon[124666]: pgmap v10557: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:12:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19688.014065 secs 2023-05-08T09:12:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19688.570249 secs 2023-05-08T09:12:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:29 smithi186 ceph-mon[126480]: pgmap v10557: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:12:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19688.014065 secs 2023-05-08T09:12:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19688.570249 secs 2023-05-08T09:12:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:31 smithi133 ceph-mon[125939]: pgmap v10558: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T09:12:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19689.856573 secs 2023-05-08T09:12:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:31 smithi096 ceph-mon[124666]: pgmap v10558: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T09:12:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19689.856573 secs 2023-05-08T09:12:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:31 smithi186 ceph-mon[126480]: pgmap v10558: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T09:12:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19689.856573 secs 2023-05-08T09:12:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:33 smithi133 ceph-mon[125939]: pgmap v10559: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T09:12:34.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:33 smithi096 ceph-mon[124666]: pgmap v10559: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T09:12:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:33 smithi186 ceph-mon[126480]: pgmap v10559: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T09:12:34.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19693.014194 secs 2023-05-08T09:12:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19693.570369 secs 2023-05-08T09:12:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19693.014194 secs 2023-05-08T09:12:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19693.570369 secs 2023-05-08T09:12:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19693.014194 secs 2023-05-08T09:12:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19693.570369 secs 2023-05-08T09:12:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:35 smithi133 ceph-mon[125939]: pgmap v10560: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T09:12:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:35 smithi096 ceph-mon[124666]: pgmap v10560: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T09:12:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:35 smithi186 ceph-mon[126480]: pgmap v10560: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T09:12:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19694.856689 secs 2023-05-08T09:12:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19694.856689 secs 2023-05-08T09:12:37.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19694.856689 secs 2023-05-08T09:12:37.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:37 smithi133 ceph-mon[125939]: pgmap v10561: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 65 KiB/s wr, 8 op/s 2023-05-08T09:12:38.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:37 smithi096 ceph-mon[124666]: pgmap v10561: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 65 KiB/s wr, 8 op/s 2023-05-08T09:12:38.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:37 smithi186 ceph-mon[126480]: pgmap v10561: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 65 KiB/s wr, 8 op/s 2023-05-08T09:12:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:39 smithi133 ceph-mon[125939]: pgmap v10562: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 65 KiB/s wr, 6 op/s 2023-05-08T09:12:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19698.014308 secs 2023-05-08T09:12:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19698.570487 secs 2023-05-08T09:12:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:39 smithi096 ceph-mon[124666]: pgmap v10562: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 65 KiB/s wr, 6 op/s 2023-05-08T09:12:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19698.014308 secs 2023-05-08T09:12:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19698.570487 secs 2023-05-08T09:12:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:39 smithi186 ceph-mon[126480]: pgmap v10562: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 65 KiB/s wr, 6 op/s 2023-05-08T09:12:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19698.014308 secs 2023-05-08T09:12:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19698.570487 secs 2023-05-08T09:12:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:40 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:12:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:40 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:12:40.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:40 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:12:40.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:40 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:12:40.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:40 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:12:41.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:40 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:12:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:40 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:12:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:40 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:12:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:40 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:12:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:40 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:12:41.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:40 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:12:41.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:40 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:12:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:40 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:12:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:40 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:12:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:40 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:12:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:41 smithi133 ceph-mon[125939]: pgmap v10563: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 94 KiB/s wr, 9 op/s 2023-05-08T09:12:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:12:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:12:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:12:41.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:12:41.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:12:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:41 smithi096 ceph-mon[124666]: pgmap v10563: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 94 KiB/s wr, 9 op/s 2023-05-08T09:12:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:12:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:12:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:12:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:12:42.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:12:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:41 smithi186 ceph-mon[126480]: pgmap v10563: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 94 KiB/s wr, 9 op/s 2023-05-08T09:12:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:12:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:12:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:12:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:12:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:12:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:42 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:12:42.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:42 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T09:12:42.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:42 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T09:12:42.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:42 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:12:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:42 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:12:43.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:42 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T09:12:43.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:42 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T09:12:43.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:42 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:12:43.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:42 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:12:43.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:42 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T09:12:43.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:42 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T09:12:43.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:42 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:12:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:43 smithi133 ceph-mon[125939]: pgmap v10564: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 93 KiB/s wr, 6 op/s 2023-05-08T09:12:43.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:12:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:43 smithi096 ceph-mon[124666]: pgmap v10564: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 93 KiB/s wr, 6 op/s 2023-05-08T09:12:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:12:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:43 smithi186 ceph-mon[126480]: pgmap v10564: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 93 KiB/s wr, 6 op/s 2023-05-08T09:12:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:12:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19703.014424 secs 2023-05-08T09:12:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19703.570542 secs 2023-05-08T09:12:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:12:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:12:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:12:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19703.014424 secs 2023-05-08T09:12:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19703.570542 secs 2023-05-08T09:12:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:12:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:12:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:12:45.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19703.014424 secs 2023-05-08T09:12:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19703.570542 secs 2023-05-08T09:12:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:12:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:12:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:12:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:45 smithi133 ceph-mon[125939]: pgmap v10565: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 93 KiB/s wr, 6 op/s 2023-05-08T09:12:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:45 smithi096 ceph-mon[124666]: pgmap v10565: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 93 KiB/s wr, 6 op/s 2023-05-08T09:12:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:45 smithi186 ceph-mon[126480]: pgmap v10565: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 93 KiB/s wr, 6 op/s 2023-05-08T09:12:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:47 smithi133 ceph-mon[125939]: pgmap v10566: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 255 KiB/s rd, 195 KiB/s wr, 10 op/s 2023-05-08T09:12:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:47 smithi096 ceph-mon[124666]: pgmap v10566: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 255 KiB/s rd, 195 KiB/s wr, 10 op/s 2023-05-08T09:12:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:47 smithi186 ceph-mon[126480]: pgmap v10566: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 255 KiB/s rd, 195 KiB/s wr, 10 op/s 2023-05-08T09:12:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:49 smithi133 ceph-mon[125939]: pgmap v10567: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 130 KiB/s wr, 6 op/s 2023-05-08T09:12:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19708.014543 secs 2023-05-08T09:12:50.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:49 smithi096 ceph-mon[124666]: pgmap v10567: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 130 KiB/s wr, 6 op/s 2023-05-08T09:12:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19708.014543 secs 2023-05-08T09:12:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:49 smithi186 ceph-mon[126480]: pgmap v10567: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 130 KiB/s wr, 6 op/s 2023-05-08T09:12:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19708.014543 secs 2023-05-08T09:12:51.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:51 smithi133 ceph-mon[125939]: pgmap v10568: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 327 KiB/s wr, 11 op/s 2023-05-08T09:12:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:12:52.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:51 smithi096 ceph-mon[124666]: pgmap v10568: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 327 KiB/s wr, 11 op/s 2023-05-08T09:12:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:12:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:51 smithi186 ceph-mon[126480]: pgmap v10568: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 327 KiB/s wr, 11 op/s 2023-05-08T09:12:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:12:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:52 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:12:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:12:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:12:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:52 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:12:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:12:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:12:53.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:52 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:12:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:12:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:12:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:53 smithi096 ceph-mon[124666]: pgmap v10569: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 298 KiB/s wr, 7 op/s 2023-05-08T09:12:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:53 smithi186 ceph-mon[126480]: pgmap v10569: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 298 KiB/s wr, 7 op/s 2023-05-08T09:12:54.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:53 smithi133 ceph-mon[125939]: pgmap v10569: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 298 KiB/s wr, 7 op/s 2023-05-08T09:12:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19713.014681 secs 2023-05-08T09:12:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19713.570804 secs 2023-05-08T09:12:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19713.014681 secs 2023-05-08T09:12:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19713.570804 secs 2023-05-08T09:12:55.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19713.014681 secs 2023-05-08T09:12:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19713.570804 secs 2023-05-08T09:12:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:55 smithi096 ceph-mon[124666]: pgmap v10570: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 298 KiB/s wr, 7 op/s 2023-05-08T09:12:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:55 smithi186 ceph-mon[126480]: pgmap v10570: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 298 KiB/s wr, 7 op/s 2023-05-08T09:12:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:55 smithi133 ceph-mon[125939]: pgmap v10570: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 298 KiB/s wr, 7 op/s 2023-05-08T09:12:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19714.857157 secs 2023-05-08T09:12:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:12:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:12:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:12:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19714.857157 secs 2023-05-08T09:12:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:12:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:12:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:12:57.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19714.857157 secs 2023-05-08T09:12:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:12:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:12:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:12:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:57 smithi186 ceph-mon[126480]: pgmap v10571: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 610 KiB/s rd, 540 KiB/s wr, 14 op/s 2023-05-08T09:12:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:57 smithi133 ceph-mon[125939]: pgmap v10571: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 610 KiB/s rd, 540 KiB/s wr, 14 op/s 2023-05-08T09:12:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:57 smithi096 ceph-mon[124666]: pgmap v10571: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 610 KiB/s rd, 540 KiB/s wr, 14 op/s 2023-05-08T09:12:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:58 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:12:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:58 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:12:59.263 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:58 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:13:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:59 smithi186 ceph-mon[126480]: pgmap v10572: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 438 KiB/s wr, 10 op/s 2023-05-08T09:13:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19718.014814 secs 2023-05-08T09:13:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:12:59 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:13:00.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:59 smithi133 ceph-mon[125939]: pgmap v10572: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 438 KiB/s wr, 10 op/s 2023-05-08T09:13:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19718.014814 secs 2023-05-08T09:13:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:12:59 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:13:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:59 smithi096 ceph-mon[124666]: pgmap v10572: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 438 KiB/s wr, 10 op/s 2023-05-08T09:13:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19718.014814 secs 2023-05-08T09:13:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:12:59 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:13:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:13:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:13:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19719.857276 secs 2023-05-08T09:13:01.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:13:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:13:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19719.857276 secs 2023-05-08T09:13:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:13:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:13:01.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19719.857276 secs 2023-05-08T09:13:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:01 smithi186 ceph-mon[126480]: pgmap v10573: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 534 KiB/s wr, 15 op/s 2023-05-08T09:13:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:01 smithi133 ceph-mon[125939]: pgmap v10573: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 534 KiB/s wr, 15 op/s 2023-05-08T09:13:02.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:01 smithi096 ceph-mon[124666]: pgmap v10573: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 534 KiB/s wr, 15 op/s 2023-05-08T09:13:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:03 smithi186 ceph-mon[126480]: pgmap v10574: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 338 KiB/s wr, 12 op/s 2023-05-08T09:13:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:03 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:13:04.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:03 smithi133 ceph-mon[125939]: pgmap v10574: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 338 KiB/s wr, 12 op/s 2023-05-08T09:13:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:03 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:13:04.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:03 smithi096 ceph-mon[124666]: pgmap v10574: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 338 KiB/s wr, 12 op/s 2023-05-08T09:13:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:03 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:13:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19723.014950 secs 2023-05-08T09:13:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19723.571032 secs 2023-05-08T09:13:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19723.014950 secs 2023-05-08T09:13:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19723.571032 secs 2023-05-08T09:13:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19723.014950 secs 2023-05-08T09:13:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19723.571032 secs 2023-05-08T09:13:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:05 smithi186 ceph-mon[126480]: pgmap v10575: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 338 KiB/s wr, 11 op/s 2023-05-08T09:13:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19724.857422 secs 2023-05-08T09:13:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:05 smithi133 ceph-mon[125939]: pgmap v10575: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 338 KiB/s wr, 11 op/s 2023-05-08T09:13:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19724.857422 secs 2023-05-08T09:13:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:05 smithi096 ceph-mon[124666]: pgmap v10575: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 338 KiB/s wr, 11 op/s 2023-05-08T09:13:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19724.857422 secs 2023-05-08T09:13:07.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:06 smithi186 ceph-mon[126480]: osdmap e738: 12 total, 12 up, 12 in 2023-05-08T09:13:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:06 smithi133 ceph-mon[125939]: osdmap e738: 12 total, 12 up, 12 in 2023-05-08T09:13:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:06 smithi096 ceph-mon[124666]: osdmap e738: 12 total, 12 up, 12 in 2023-05-08T09:13:08.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:07 smithi186 ceph-mon[126480]: pgmap v10577: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 265 KiB/s rd, 306 KiB/s wr, 29 op/s 2023-05-08T09:13:08.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:07 smithi133 ceph-mon[125939]: pgmap v10577: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 265 KiB/s rd, 306 KiB/s wr, 29 op/s 2023-05-08T09:13:08.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:07 smithi096 ceph-mon[124666]: pgmap v10577: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 265 KiB/s rd, 306 KiB/s wr, 29 op/s 2023-05-08T09:13:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:13:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:13:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:08 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:13:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:13:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:13:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:08 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:13:09.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:13:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:13:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:08 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:13:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:09 smithi186 ceph-mon[126480]: pgmap v10578: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 265 KiB/s rd, 306 KiB/s wr, 29 op/s 2023-05-08T09:13:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19728.015065 secs 2023-05-08T09:13:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19728.571154 secs 2023-05-08T09:13:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:09 smithi133 ceph-mon[125939]: pgmap v10578: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 265 KiB/s rd, 306 KiB/s wr, 29 op/s 2023-05-08T09:13:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19728.015065 secs 2023-05-08T09:13:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19728.571154 secs 2023-05-08T09:13:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:09 smithi096 ceph-mon[124666]: pgmap v10578: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 265 KiB/s rd, 306 KiB/s wr, 29 op/s 2023-05-08T09:13:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19728.015065 secs 2023-05-08T09:13:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19728.571154 secs 2023-05-08T09:13:11.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:10 smithi186 ceph-mon[126480]: pgmap v10579: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 355 KiB/s wr, 27 op/s 2023-05-08T09:13:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19729.857568 secs 2023-05-08T09:13:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:10 smithi133 ceph-mon[125939]: pgmap v10579: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 355 KiB/s wr, 27 op/s 2023-05-08T09:13:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19729.857568 secs 2023-05-08T09:13:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:10 smithi096 ceph-mon[124666]: pgmap v10579: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 355 KiB/s wr, 27 op/s 2023-05-08T09:13:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19729.857568 secs 2023-05-08T09:13:13.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:13 smithi186 ceph-mon[126480]: pgmap v10580: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 355 KiB/s wr, 27 op/s 2023-05-08T09:13:13.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:13 smithi186 ceph-mon[126480]: osdmap e739: 12 total, 12 up, 12 in 2023-05-08T09:13:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:13 smithi133 ceph-mon[125939]: pgmap v10580: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 355 KiB/s wr, 27 op/s 2023-05-08T09:13:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:13 smithi133 ceph-mon[125939]: osdmap e739: 12 total, 12 up, 12 in 2023-05-08T09:13:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:13 smithi096 ceph-mon[124666]: pgmap v10580: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 355 KiB/s wr, 27 op/s 2023-05-08T09:13:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:13 smithi096 ceph-mon[124666]: osdmap e739: 12 total, 12 up, 12 in 2023-05-08T09:13:15.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19733.015200 secs 2023-05-08T09:13:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19733.571283 secs 2023-05-08T09:13:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:15 smithi186 ceph-mon[126480]: pgmap v10582: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 201 KiB/s wr, 5 op/s 2023-05-08T09:13:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19733.015200 secs 2023-05-08T09:13:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19733.571283 secs 2023-05-08T09:13:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:15 smithi133 ceph-mon[125939]: pgmap v10582: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 201 KiB/s wr, 5 op/s 2023-05-08T09:13:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19733.015200 secs 2023-05-08T09:13:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19733.571283 secs 2023-05-08T09:13:15.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:15 smithi096 ceph-mon[124666]: pgmap v10582: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 201 KiB/s wr, 5 op/s 2023-05-08T09:13:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19734.857707 secs 2023-05-08T09:13:16.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19734.857707 secs 2023-05-08T09:13:16.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19734.857707 secs 2023-05-08T09:13:17.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:17 smithi186 ceph-mon[126480]: pgmap v10583: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 224 KiB/s wr, 8 op/s 2023-05-08T09:13:17.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:17 smithi133 ceph-mon[125939]: pgmap v10583: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 224 KiB/s wr, 8 op/s 2023-05-08T09:13:17.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:17 smithi096 ceph-mon[124666]: pgmap v10583: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 224 KiB/s wr, 8 op/s 2023-05-08T09:13:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:19 smithi186 ceph-mon[126480]: pgmap v10584: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 224 KiB/s wr, 8 op/s 2023-05-08T09:13:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19738.015323 secs 2023-05-08T09:13:19.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:19 smithi133 ceph-mon[125939]: pgmap v10584: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 224 KiB/s wr, 8 op/s 2023-05-08T09:13:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19738.015323 secs 2023-05-08T09:13:19.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:19 smithi096 ceph-mon[124666]: pgmap v10584: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 224 KiB/s wr, 8 op/s 2023-05-08T09:13:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19738.015323 secs 2023-05-08T09:13:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19738.571437 secs 2023-05-08T09:13:20.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19738.571437 secs 2023-05-08T09:13:20.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19738.571437 secs 2023-05-08T09:13:21.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:21 smithi186 ceph-mon[126480]: pgmap v10585: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 60 KiB/s wr, 6 op/s 2023-05-08T09:13:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19739.857823 secs 2023-05-08T09:13:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:21 smithi133 ceph-mon[125939]: pgmap v10585: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 60 KiB/s wr, 6 op/s 2023-05-08T09:13:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19739.857823 secs 2023-05-08T09:13:21.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:21 smithi096 ceph-mon[124666]: pgmap v10585: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 60 KiB/s wr, 6 op/s 2023-05-08T09:13:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19739.857823 secs 2023-05-08T09:13:23.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:23 smithi186 ceph-mon[126480]: pgmap v10586: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 60 KiB/s wr, 6 op/s 2023-05-08T09:13:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:23 smithi133 ceph-mon[125939]: pgmap v10586: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 60 KiB/s wr, 6 op/s 2023-05-08T09:13:23.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:23 smithi096 ceph-mon[124666]: pgmap v10586: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 60 KiB/s wr, 6 op/s 2023-05-08T09:13:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19743.015420 secs 2023-05-08T09:13:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19743.015420 secs 2023-05-08T09:13:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19743.015420 secs 2023-05-08T09:13:25.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19743.571557 secs 2023-05-08T09:13:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:25 smithi186 ceph-mon[126480]: pgmap v10587: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 55 KiB/s wr, 6 op/s 2023-05-08T09:13:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19743.571557 secs 2023-05-08T09:13:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:25 smithi133 ceph-mon[125939]: pgmap v10587: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 55 KiB/s wr, 6 op/s 2023-05-08T09:13:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19743.571557 secs 2023-05-08T09:13:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:25 smithi096 ceph-mon[124666]: pgmap v10587: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 55 KiB/s wr, 6 op/s 2023-05-08T09:13:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19744.857924 secs 2023-05-08T09:13:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19744.857924 secs 2023-05-08T09:13:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19744.857924 secs 2023-05-08T09:13:27.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:27 smithi186 ceph-mon[126480]: pgmap v10588: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 50 KiB/s wr, 8 op/s 2023-05-08T09:13:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:27 smithi133 ceph-mon[125939]: pgmap v10588: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 50 KiB/s wr, 8 op/s 2023-05-08T09:13:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:27 smithi096 ceph-mon[124666]: pgmap v10588: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 50 KiB/s wr, 8 op/s 2023-05-08T09:13:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:29 smithi186 ceph-mon[126480]: pgmap v10589: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:13:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19748.015540 secs 2023-05-08T09:13:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:29 smithi133 ceph-mon[125939]: pgmap v10589: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:13:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19748.015540 secs 2023-05-08T09:13:29.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:29 smithi096 ceph-mon[124666]: pgmap v10589: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:13:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19748.015540 secs 2023-05-08T09:13:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19748.571677 secs 2023-05-08T09:13:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19748.571677 secs 2023-05-08T09:13:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19748.571677 secs 2023-05-08T09:13:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:31 smithi186 ceph-mon[126480]: pgmap v10590: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T09:13:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19749.858058 secs 2023-05-08T09:13:31.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:31 smithi133 ceph-mon[125939]: pgmap v10590: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T09:13:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19749.858058 secs 2023-05-08T09:13:31.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:31 smithi096 ceph-mon[124666]: pgmap v10590: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T09:13:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19749.858058 secs 2023-05-08T09:13:33.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:33 smithi186 ceph-mon[126480]: pgmap v10591: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T09:13:33.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:33 smithi133 ceph-mon[125939]: pgmap v10591: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T09:13:33.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:33 smithi096 ceph-mon[124666]: pgmap v10591: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T09:13:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19753.015689 secs 2023-05-08T09:13:34.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19753.015689 secs 2023-05-08T09:13:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19753.015689 secs 2023-05-08T09:13:35.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19753.571758 secs 2023-05-08T09:13:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:35 smithi186 ceph-mon[126480]: pgmap v10592: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T09:13:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19753.571758 secs 2023-05-08T09:13:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:35 smithi133 ceph-mon[125939]: pgmap v10592: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T09:13:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19753.571758 secs 2023-05-08T09:13:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:35 smithi096 ceph-mon[124666]: pgmap v10592: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T09:13:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19754.858181 secs 2023-05-08T09:13:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19754.858181 secs 2023-05-08T09:13:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19754.858181 secs 2023-05-08T09:13:37.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:37 smithi186 ceph-mon[126480]: pgmap v10593: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 125 KiB/s wr, 8 op/s 2023-05-08T09:13:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:37 smithi133 ceph-mon[125939]: pgmap v10593: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 125 KiB/s wr, 8 op/s 2023-05-08T09:13:37.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:37 smithi096 ceph-mon[124666]: pgmap v10593: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 125 KiB/s wr, 8 op/s 2023-05-08T09:13:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:39 smithi186 ceph-mon[126480]: pgmap v10594: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 125 KiB/s wr, 6 op/s 2023-05-08T09:13:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19758.015805 secs 2023-05-08T09:13:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:39 smithi133 ceph-mon[125939]: pgmap v10594: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 125 KiB/s wr, 6 op/s 2023-05-08T09:13:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19758.015805 secs 2023-05-08T09:13:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:39 smithi096 ceph-mon[124666]: pgmap v10594: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 125 KiB/s wr, 6 op/s 2023-05-08T09:13:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19758.015805 secs 2023-05-08T09:13:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19758.571838 secs 2023-05-08T09:13:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19758.571838 secs 2023-05-08T09:13:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19758.571838 secs 2023-05-08T09:13:41.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:41 smithi186 ceph-mon[126480]: pgmap v10595: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 149 KiB/s wr, 9 op/s 2023-05-08T09:13:41.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:41 smithi133 ceph-mon[125939]: pgmap v10595: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 149 KiB/s wr, 9 op/s 2023-05-08T09:13:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:41 smithi096 ceph-mon[124666]: pgmap v10595: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 149 KiB/s wr, 9 op/s 2023-05-08T09:13:42.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:13:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:13:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:13:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:13:42.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:13:42.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:13:42.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:13:42.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:13:42.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:13:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:13:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:13:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:13:43.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:43 smithi186 ceph-mon[126480]: pgmap v10596: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 148 KiB/s wr, 6 op/s 2023-05-08T09:13:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:43 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:13:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:43 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T09:13:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:43 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T09:13:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:43 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:13:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:43 smithi133 ceph-mon[125939]: pgmap v10596: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 148 KiB/s wr, 6 op/s 2023-05-08T09:13:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:43 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:13:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:43 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T09:13:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:43 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T09:13:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:43 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:13:43.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:43 smithi096 ceph-mon[124666]: pgmap v10596: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 148 KiB/s wr, 6 op/s 2023-05-08T09:13:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:43 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:13:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:43 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T09:13:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:43 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T09:13:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:43 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:13:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:44 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:13:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19763.015924 secs 2023-05-08T09:13:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:44 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:13:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19763.015924 secs 2023-05-08T09:13:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:44 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:13:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19763.015924 secs 2023-05-08T09:13:45.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19763.571929 secs 2023-05-08T09:13:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:45 smithi186 ceph-mon[126480]: pgmap v10597: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 148 KiB/s wr, 6 op/s 2023-05-08T09:13:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:45 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:13:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:45 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:13:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:45 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:13:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19763.571929 secs 2023-05-08T09:13:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:45 smithi133 ceph-mon[125939]: pgmap v10597: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 148 KiB/s wr, 6 op/s 2023-05-08T09:13:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:45 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:13:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:45 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:13:45.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:45 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:13:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19763.571929 secs 2023-05-08T09:13:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:45 smithi096 ceph-mon[124666]: pgmap v10597: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 148 KiB/s wr, 6 op/s 2023-05-08T09:13:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:45 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:13:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:45 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:13:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:45 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:13:47.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:47 smithi133 ceph-mon[125939]: pgmap v10598: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 567 KiB/s rd, 517 KiB/s wr, 11 op/s 2023-05-08T09:13:47.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:47 smithi096 ceph-mon[124666]: pgmap v10598: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 567 KiB/s rd, 517 KiB/s wr, 11 op/s 2023-05-08T09:13:47.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:47 smithi186 ceph-mon[126480]: pgmap v10598: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 567 KiB/s rd, 517 KiB/s wr, 11 op/s 2023-05-08T09:13:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:49 smithi133 ceph-mon[125939]: pgmap v10599: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 393 KiB/s wr, 7 op/s 2023-05-08T09:13:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19768.016059 secs 2023-05-08T09:13:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:49 smithi096 ceph-mon[124666]: pgmap v10599: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 393 KiB/s wr, 7 op/s 2023-05-08T09:13:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19768.016059 secs 2023-05-08T09:13:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:49 smithi186 ceph-mon[126480]: pgmap v10599: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 393 KiB/s wr, 7 op/s 2023-05-08T09:13:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19768.016059 secs 2023-05-08T09:13:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:51 smithi133 ceph-mon[125939]: pgmap v10600: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 596 KiB/s rd, 535 KiB/s wr, 12 op/s 2023-05-08T09:13:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19769.858548 secs 2023-05-08T09:13:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:51 smithi096 ceph-mon[124666]: pgmap v10600: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 596 KiB/s rd, 535 KiB/s wr, 12 op/s 2023-05-08T09:13:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19769.858548 secs 2023-05-08T09:13:51.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:51 smithi186 ceph-mon[126480]: pgmap v10600: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 596 KiB/s rd, 535 KiB/s wr, 12 op/s 2023-05-08T09:13:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19769.858548 secs 2023-05-08T09:13:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:13:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:13:52.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:13:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:53 smithi133 ceph-mon[125939]: pgmap v10601: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 511 KiB/s wr, 9 op/s 2023-05-08T09:13:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:13:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:13:53.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:13:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:53 smithi096 ceph-mon[124666]: pgmap v10601: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 511 KiB/s wr, 9 op/s 2023-05-08T09:13:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:13:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:13:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:13:53.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:53 smithi186 ceph-mon[126480]: pgmap v10601: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 511 KiB/s wr, 9 op/s 2023-05-08T09:13:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:13:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:13:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:13:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19773.016176 secs 2023-05-08T09:13:54.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19773.016176 secs 2023-05-08T09:13:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19773.016176 secs 2023-05-08T09:13:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:55 smithi133 ceph-mon[125939]: pgmap v10602: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 511 KiB/s wr, 9 op/s 2023-05-08T09:13:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:55 smithi096 ceph-mon[124666]: pgmap v10602: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 511 KiB/s wr, 9 op/s 2023-05-08T09:13:55.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:55 smithi186 ceph-mon[126480]: pgmap v10602: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 511 KiB/s wr, 9 op/s 2023-05-08T09:13:56.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19774.858678 secs 2023-05-08T09:13:56.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19774.858678 secs 2023-05-08T09:13:56.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19774.858678 secs 2023-05-08T09:13:57.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:57 smithi133 ceph-mon[125939]: pgmap v10603: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 783 KiB/s rd, 723 KiB/s wr, 15 op/s 2023-05-08T09:13:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:57 smithi096 ceph-mon[124666]: pgmap v10603: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 783 KiB/s rd, 723 KiB/s wr, 15 op/s 2023-05-08T09:13:57.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:57 smithi186 ceph-mon[126480]: pgmap v10603: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 783 KiB/s rd, 723 KiB/s wr, 15 op/s 2023-05-08T09:13:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:59 smithi133 ceph-mon[125939]: pgmap v10604: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 355 KiB/s wr, 10 op/s 2023-05-08T09:13:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:13:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19778.016290 secs 2023-05-08T09:13:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:59 smithi096 ceph-mon[124666]: pgmap v10604: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 355 KiB/s wr, 10 op/s 2023-05-08T09:13:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:13:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19778.016290 secs 2023-05-08T09:13:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:59 smithi186 ceph-mon[126480]: pgmap v10604: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 355 KiB/s wr, 10 op/s 2023-05-08T09:13:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:13:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19778.016290 secs 2023-05-08T09:14:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19778.572311 secs 2023-05-08T09:14:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19778.572311 secs 2023-05-08T09:14:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19778.572311 secs 2023-05-08T09:14:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:01 smithi133 ceph-mon[125939]: pgmap v10605: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 425 KiB/s wr, 15 op/s 2023-05-08T09:14:01.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19779.858791 secs 2023-05-08T09:14:01.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:01 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:14:01.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:14:01.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:14:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:01 smithi096 ceph-mon[124666]: pgmap v10605: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 425 KiB/s wr, 15 op/s 2023-05-08T09:14:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19779.858791 secs 2023-05-08T09:14:01.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:01 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:14:01.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:14:01.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:14:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:01 smithi186 ceph-mon[126480]: pgmap v10605: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 425 KiB/s wr, 15 op/s 2023-05-08T09:14:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19779.858791 secs 2023-05-08T09:14:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:01 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:14:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:14:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:14:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:03 smithi133 ceph-mon[125939]: pgmap v10606: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 283 KiB/s wr, 10 op/s 2023-05-08T09:14:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:03 smithi096 ceph-mon[124666]: pgmap v10606: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 283 KiB/s wr, 10 op/s 2023-05-08T09:14:03.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:03 smithi186 ceph-mon[126480]: pgmap v10606: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 283 KiB/s wr, 10 op/s 2023-05-08T09:14:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19783.016449 secs 2023-05-08T09:14:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19783.016449 secs 2023-05-08T09:14:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19783.016449 secs 2023-05-08T09:14:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19783.572433 secs 2023-05-08T09:14:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:05 smithi133 ceph-mon[125939]: pgmap v10607: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 283 KiB/s wr, 10 op/s 2023-05-08T09:14:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19783.572433 secs 2023-05-08T09:14:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:05 smithi096 ceph-mon[124666]: pgmap v10607: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 283 KiB/s wr, 10 op/s 2023-05-08T09:14:05.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19783.572433 secs 2023-05-08T09:14:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:05 smithi186 ceph-mon[126480]: pgmap v10607: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 283 KiB/s wr, 10 op/s 2023-05-08T09:14:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19784.858887 secs 2023-05-08T09:14:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:06 smithi133 ceph-mon[125939]: osdmap e740: 12 total, 12 up, 12 in 2023-05-08T09:14:06.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19784.858887 secs 2023-05-08T09:14:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:06 smithi096 ceph-mon[124666]: osdmap e740: 12 total, 12 up, 12 in 2023-05-08T09:14:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19784.858887 secs 2023-05-08T09:14:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:06 smithi186 ceph-mon[126480]: osdmap e740: 12 total, 12 up, 12 in 2023-05-08T09:14:07.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:07 smithi133 ceph-mon[125939]: pgmap v10609: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 296 KiB/s wr, 26 op/s 2023-05-08T09:14:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:07 smithi096 ceph-mon[124666]: pgmap v10609: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 296 KiB/s wr, 26 op/s 2023-05-08T09:14:07.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:07 smithi186 ceph-mon[126480]: pgmap v10609: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 296 KiB/s wr, 26 op/s 2023-05-08T09:14:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:09 smithi133 ceph-mon[125939]: pgmap v10610: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 296 KiB/s wr, 26 op/s 2023-05-08T09:14:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19788.016539 secs 2023-05-08T09:14:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:09 smithi096 ceph-mon[124666]: pgmap v10610: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 296 KiB/s wr, 26 op/s 2023-05-08T09:14:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19788.016539 secs 2023-05-08T09:14:09.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:09 smithi186 ceph-mon[126480]: pgmap v10610: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 296 KiB/s wr, 26 op/s 2023-05-08T09:14:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19788.016539 secs 2023-05-08T09:14:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19788.572574 secs 2023-05-08T09:14:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19788.572574 secs 2023-05-08T09:14:10.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19788.572574 secs 2023-05-08T09:14:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:11 smithi133 ceph-mon[125939]: pgmap v10611: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 213 KiB/s wr, 24 op/s 2023-05-08T09:14:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19789.858954 secs 2023-05-08T09:14:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:11 smithi096 ceph-mon[124666]: pgmap v10611: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 213 KiB/s wr, 24 op/s 2023-05-08T09:14:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19789.858954 secs 2023-05-08T09:14:11.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:11 smithi186 ceph-mon[126480]: pgmap v10611: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 213 KiB/s wr, 24 op/s 2023-05-08T09:14:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19789.858954 secs 2023-05-08T09:14:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:13 smithi133 ceph-mon[125939]: pgmap v10612: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 212 KiB/s wr, 24 op/s 2023-05-08T09:14:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:13 smithi133 ceph-mon[125939]: osdmap e741: 12 total, 12 up, 12 in 2023-05-08T09:14:13.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:13 smithi096 ceph-mon[124666]: pgmap v10612: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 212 KiB/s wr, 24 op/s 2023-05-08T09:14:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:13 smithi096 ceph-mon[124666]: osdmap e741: 12 total, 12 up, 12 in 2023-05-08T09:14:13.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:13 smithi186 ceph-mon[126480]: pgmap v10612: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 212 KiB/s wr, 24 op/s 2023-05-08T09:14:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:13 smithi186 ceph-mon[126480]: osdmap e741: 12 total, 12 up, 12 in 2023-05-08T09:14:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19793.016664 secs 2023-05-08T09:14:14.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19793.016664 secs 2023-05-08T09:14:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19793.016664 secs 2023-05-08T09:14:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19793.572701 secs 2023-05-08T09:14:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:15 smithi133 ceph-mon[125939]: pgmap v10614: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 930 B/s wr, 4 op/s 2023-05-08T09:14:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19793.572701 secs 2023-05-08T09:14:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:15 smithi096 ceph-mon[124666]: pgmap v10614: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 930 B/s wr, 4 op/s 2023-05-08T09:14:15.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19793.572701 secs 2023-05-08T09:14:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:15 smithi186 ceph-mon[126480]: pgmap v10614: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 930 B/s wr, 4 op/s 2023-05-08T09:14:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19794.859050 secs 2023-05-08T09:14:16.525 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19794.859050 secs 2023-05-08T09:14:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19794.859050 secs 2023-05-08T09:14:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:17 smithi133 ceph-mon[125939]: pgmap v10615: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 921 B/s wr, 7 op/s 2023-05-08T09:14:17.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:17 smithi096 ceph-mon[124666]: pgmap v10615: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 921 B/s wr, 7 op/s 2023-05-08T09:14:17.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:17 smithi186 ceph-mon[126480]: pgmap v10615: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 921 B/s wr, 7 op/s 2023-05-08T09:14:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:19 smithi133 ceph-mon[125939]: pgmap v10616: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 921 B/s wr, 7 op/s 2023-05-08T09:14:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19798.016786 secs 2023-05-08T09:14:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:19 smithi096 ceph-mon[124666]: pgmap v10616: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 921 B/s wr, 7 op/s 2023-05-08T09:14:19.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19798.016786 secs 2023-05-08T09:14:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:19 smithi186 ceph-mon[126480]: pgmap v10616: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 921 B/s wr, 7 op/s 2023-05-08T09:14:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19798.016786 secs 2023-05-08T09:14:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19798.572822 secs 2023-05-08T09:14:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19798.572822 secs 2023-05-08T09:14:20.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19798.572822 secs 2023-05-08T09:14:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:21 smithi133 ceph-mon[125939]: pgmap v10617: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T09:14:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19799.859172 secs 2023-05-08T09:14:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:21 smithi096 ceph-mon[124666]: pgmap v10617: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T09:14:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19799.859172 secs 2023-05-08T09:14:21.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:21 smithi186 ceph-mon[126480]: pgmap v10617: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T09:14:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19799.859172 secs 2023-05-08T09:14:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:23 smithi133 ceph-mon[125939]: pgmap v10618: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T09:14:23.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:23 smithi096 ceph-mon[124666]: pgmap v10618: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T09:14:23.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:23 smithi186 ceph-mon[126480]: pgmap v10618: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T09:14:24.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19803.016899 secs 2023-05-08T09:14:24.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19803.016899 secs 2023-05-08T09:14:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19803.016899 secs 2023-05-08T09:14:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19803.572941 secs 2023-05-08T09:14:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:25 smithi096 ceph-mon[124666]: pgmap v10619: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 93 B/s wr, 5 op/s 2023-05-08T09:14:25.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19803.572941 secs 2023-05-08T09:14:25.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:25 smithi186 ceph-mon[126480]: pgmap v10619: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 93 B/s wr, 5 op/s 2023-05-08T09:14:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19803.572941 secs 2023-05-08T09:14:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:25 smithi133 ceph-mon[125939]: pgmap v10619: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 93 B/s wr, 5 op/s 2023-05-08T09:14:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19804.859238 secs 2023-05-08T09:14:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19804.859238 secs 2023-05-08T09:14:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19804.859238 secs 2023-05-08T09:14:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:27 smithi096 ceph-mon[124666]: pgmap v10620: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T09:14:27.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:27 smithi186 ceph-mon[126480]: pgmap v10620: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T09:14:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:27 smithi133 ceph-mon[125939]: pgmap v10620: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T09:14:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:29 smithi096 ceph-mon[124666]: pgmap v10621: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T09:14:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19808.017034 secs 2023-05-08T09:14:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:29 smithi186 ceph-mon[126480]: pgmap v10621: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T09:14:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19808.017034 secs 2023-05-08T09:14:29.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:29 smithi133 ceph-mon[125939]: pgmap v10621: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T09:14:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19808.017034 secs 2023-05-08T09:14:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19808.573064 secs 2023-05-08T09:14:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19808.573064 secs 2023-05-08T09:14:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19808.573064 secs 2023-05-08T09:14:31.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:31 smithi186 ceph-mon[126480]: pgmap v10622: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 66 KiB/s wr, 9 op/s 2023-05-08T09:14:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19809.859386 secs 2023-05-08T09:14:31.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:31 smithi133 ceph-mon[125939]: pgmap v10622: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 66 KiB/s wr, 9 op/s 2023-05-08T09:14:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19809.859386 secs 2023-05-08T09:14:31.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:31 smithi096 ceph-mon[124666]: pgmap v10622: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 66 KiB/s wr, 9 op/s 2023-05-08T09:14:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19809.859386 secs 2023-05-08T09:14:33.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:33 smithi186 ceph-mon[126480]: pgmap v10623: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 66 KiB/s wr, 6 op/s 2023-05-08T09:14:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:33 smithi133 ceph-mon[125939]: pgmap v10623: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 66 KiB/s wr, 6 op/s 2023-05-08T09:14:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:33 smithi096 ceph-mon[124666]: pgmap v10623: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 66 KiB/s wr, 6 op/s 2023-05-08T09:14:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19813.017152 secs 2023-05-08T09:14:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19813.017152 secs 2023-05-08T09:14:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19813.017152 secs 2023-05-08T09:14:35.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19813.573192 secs 2023-05-08T09:14:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:35 smithi186 ceph-mon[126480]: pgmap v10624: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 66 KiB/s wr, 6 op/s 2023-05-08T09:14:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19813.573192 secs 2023-05-08T09:14:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:35 smithi133 ceph-mon[125939]: pgmap v10624: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 66 KiB/s wr, 6 op/s 2023-05-08T09:14:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19813.573192 secs 2023-05-08T09:14:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:35 smithi096 ceph-mon[124666]: pgmap v10624: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 66 KiB/s wr, 6 op/s 2023-05-08T09:14:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19814.859495 secs 2023-05-08T09:14:36.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19814.859495 secs 2023-05-08T09:14:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19814.859495 secs 2023-05-08T09:14:37.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:37 smithi186 ceph-mon[126480]: pgmap v10625: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 66 KiB/s wr, 9 op/s 2023-05-08T09:14:37.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:37 smithi133 ceph-mon[125939]: pgmap v10625: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 66 KiB/s wr, 9 op/s 2023-05-08T09:14:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:37 smithi096 ceph-mon[124666]: pgmap v10625: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 66 KiB/s wr, 9 op/s 2023-05-08T09:14:39.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:39 smithi186 ceph-mon[126480]: pgmap v10626: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 66 KiB/s wr, 6 op/s 2023-05-08T09:14:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19818.017246 secs 2023-05-08T09:14:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:39 smithi133 ceph-mon[125939]: pgmap v10626: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 66 KiB/s wr, 6 op/s 2023-05-08T09:14:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19818.017246 secs 2023-05-08T09:14:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:39 smithi096 ceph-mon[124666]: pgmap v10626: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 66 KiB/s wr, 6 op/s 2023-05-08T09:14:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19818.017246 secs 2023-05-08T09:14:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19818.573259 secs 2023-05-08T09:14:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19818.573259 secs 2023-05-08T09:14:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19818.573259 secs 2023-05-08T09:14:41.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:41 smithi186 ceph-mon[126480]: pgmap v10627: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 66 KiB/s wr, 9 op/s 2023-05-08T09:14:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:41 smithi133 ceph-mon[125939]: pgmap v10627: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 66 KiB/s wr, 9 op/s 2023-05-08T09:14:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:41 smithi096 ceph-mon[124666]: pgmap v10627: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 66 KiB/s wr, 9 op/s 2023-05-08T09:14:42.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:14:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:14:42.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:14:43.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:43 smithi186 ceph-mon[126480]: pgmap v10628: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T09:14:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:43 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:14:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:43 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:14:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:43 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:14:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:14:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:43 smithi133 ceph-mon[125939]: pgmap v10628: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T09:14:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:43 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:14:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:43 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:14:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:43 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:14:43.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:14:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:43 smithi096 ceph-mon[124666]: pgmap v10628: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T09:14:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:43 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:14:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:43 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:14:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:43 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:14:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:14:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:44 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:14:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:44 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T09:14:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:44 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T09:14:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:44 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:14:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19823.017400 secs 2023-05-08T09:14:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:14:44.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:14:44.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:14:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:44 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:14:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:44 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T09:14:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:44 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T09:14:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:44 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:14:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19823.017400 secs 2023-05-08T09:14:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:14:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:14:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:14:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:44 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:14:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:44 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T09:14:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:44 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T09:14:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:44 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:14:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19823.017400 secs 2023-05-08T09:14:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:14:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:14:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:14:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19823.573377 secs 2023-05-08T09:14:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:45 smithi186 ceph-mon[126480]: pgmap v10629: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T09:14:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19823.573377 secs 2023-05-08T09:14:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:45 smithi133 ceph-mon[125939]: pgmap v10629: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T09:14:45.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19823.573377 secs 2023-05-08T09:14:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:45 smithi096 ceph-mon[124666]: pgmap v10629: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T09:14:47.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:47 smithi186 ceph-mon[126480]: pgmap v10630: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 95 KiB/s wr, 9 op/s 2023-05-08T09:14:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:47 smithi133 ceph-mon[125939]: pgmap v10630: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 95 KiB/s wr, 9 op/s 2023-05-08T09:14:47.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:47 smithi096 ceph-mon[124666]: pgmap v10630: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 95 KiB/s wr, 9 op/s 2023-05-08T09:14:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:49 smithi186 ceph-mon[126480]: pgmap v10631: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 95 KiB/s wr, 6 op/s 2023-05-08T09:14:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19828.017478 secs 2023-05-08T09:14:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:49 smithi133 ceph-mon[125939]: pgmap v10631: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 95 KiB/s wr, 6 op/s 2023-05-08T09:14:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19828.017478 secs 2023-05-08T09:14:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:49 smithi096 ceph-mon[124666]: pgmap v10631: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 95 KiB/s wr, 6 op/s 2023-05-08T09:14:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19828.017478 secs 2023-05-08T09:14:51.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:51 smithi186 ceph-mon[126480]: pgmap v10632: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 349 KiB/s wr, 10 op/s 2023-05-08T09:14:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:51 smithi133 ceph-mon[125939]: pgmap v10632: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 349 KiB/s wr, 10 op/s 2023-05-08T09:14:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:51 smithi096 ceph-mon[124666]: pgmap v10632: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 349 KiB/s wr, 10 op/s 2023-05-08T09:14:52.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:14:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:14:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:14:53.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:53 smithi186 ceph-mon[126480]: pgmap v10633: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 349 KiB/s wr, 7 op/s 2023-05-08T09:14:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:53 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:14:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:14:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:14:53.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:53 smithi133 ceph-mon[125939]: pgmap v10633: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 349 KiB/s wr, 7 op/s 2023-05-08T09:14:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:53 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:14:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:14:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:14:53.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:53 smithi096 ceph-mon[124666]: pgmap v10633: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 349 KiB/s wr, 7 op/s 2023-05-08T09:14:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:53 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:14:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:14:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:14:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19833.017544 secs 2023-05-08T09:14:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19833.017544 secs 2023-05-08T09:14:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19833.017544 secs 2023-05-08T09:14:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19833.573615 secs 2023-05-08T09:14:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:55 smithi186 ceph-mon[126480]: pgmap v10634: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 349 KiB/s wr, 7 op/s 2023-05-08T09:14:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19833.573615 secs 2023-05-08T09:14:55.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:55 smithi133 ceph-mon[125939]: pgmap v10634: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 349 KiB/s wr, 7 op/s 2023-05-08T09:14:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19833.573615 secs 2023-05-08T09:14:55.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:55 smithi096 ceph-mon[124666]: pgmap v10634: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 349 KiB/s wr, 7 op/s 2023-05-08T09:14:56.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19834.859935 secs 2023-05-08T09:14:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:14:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:14:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19834.859935 secs 2023-05-08T09:14:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:14:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:14:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19834.859935 secs 2023-05-08T09:14:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:14:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:14:57.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:57 smithi186 ceph-mon[126480]: pgmap v10635: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 732 KiB/s rd, 644 KiB/s wr, 14 op/s 2023-05-08T09:14:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:14:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:14:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:57 smithi133 ceph-mon[125939]: pgmap v10635: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 732 KiB/s rd, 644 KiB/s wr, 14 op/s 2023-05-08T09:14:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:14:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:14:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:57 smithi096 ceph-mon[124666]: pgmap v10635: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 732 KiB/s rd, 644 KiB/s wr, 14 op/s 2023-05-08T09:14:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:14:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:14:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:58 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:14:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:58 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:14:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:58 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:14:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:59 smithi186 ceph-mon[126480]: pgmap v10636: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 576 KiB/s rd, 550 KiB/s wr, 11 op/s 2023-05-08T09:14:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:14:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19838.017590 secs 2023-05-08T09:14:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:59 smithi133 ceph-mon[125939]: pgmap v10636: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 576 KiB/s rd, 550 KiB/s wr, 11 op/s 2023-05-08T09:14:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:14:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19838.017590 secs 2023-05-08T09:14:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:59 smithi096 ceph-mon[124666]: pgmap v10636: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 576 KiB/s rd, 550 KiB/s wr, 11 op/s 2023-05-08T09:14:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:14:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19838.017590 secs 2023-05-08T09:15:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:00 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:15:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:00 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:15:00.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:00 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:15:01.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:01 smithi186 ceph-mon[126480]: pgmap v10637: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 715 KiB/s rd, 617 KiB/s wr, 16 op/s 2023-05-08T09:15:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19839.860060 secs 2023-05-08T09:15:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:15:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:15:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:01 smithi133 ceph-mon[125939]: pgmap v10637: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 715 KiB/s rd, 617 KiB/s wr, 16 op/s 2023-05-08T09:15:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19839.860060 secs 2023-05-08T09:15:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:15:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:15:01.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:01 smithi096 ceph-mon[124666]: pgmap v10637: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 715 KiB/s rd, 617 KiB/s wr, 16 op/s 2023-05-08T09:15:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19839.860060 secs 2023-05-08T09:15:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:15:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:15:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:03 smithi186 ceph-mon[126480]: pgmap v10638: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 363 KiB/s wr, 11 op/s 2023-05-08T09:15:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:03 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:15:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:03 smithi133 ceph-mon[125939]: pgmap v10638: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 363 KiB/s wr, 11 op/s 2023-05-08T09:15:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:03 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:15:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:03 smithi096 ceph-mon[124666]: pgmap v10638: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 363 KiB/s wr, 11 op/s 2023-05-08T09:15:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:03 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:15:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19843.017671 secs 2023-05-08T09:15:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19843.017671 secs 2023-05-08T09:15:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19843.017671 secs 2023-05-08T09:15:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19843.573841 secs 2023-05-08T09:15:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:05 smithi133 ceph-mon[125939]: pgmap v10639: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 362 KiB/s wr, 11 op/s 2023-05-08T09:15:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19843.573841 secs 2023-05-08T09:15:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:05 smithi096 ceph-mon[124666]: pgmap v10639: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 362 KiB/s wr, 11 op/s 2023-05-08T09:15:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19843.573841 secs 2023-05-08T09:15:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:05 smithi186 ceph-mon[126480]: pgmap v10639: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 362 KiB/s wr, 11 op/s 2023-05-08T09:15:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19844.860200 secs 2023-05-08T09:15:06.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:06 smithi133 ceph-mon[125939]: osdmap e742: 12 total, 12 up, 12 in 2023-05-08T09:15:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19844.860200 secs 2023-05-08T09:15:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:06 smithi096 ceph-mon[124666]: osdmap e742: 12 total, 12 up, 12 in 2023-05-08T09:15:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19844.860200 secs 2023-05-08T09:15:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:06 smithi186 ceph-mon[126480]: osdmap e742: 12 total, 12 up, 12 in 2023-05-08T09:15:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:07 smithi133 ceph-mon[125939]: pgmap v10641: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 329 KiB/s rd, 450 KiB/s wr, 30 op/s 2023-05-08T09:15:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:07 smithi096 ceph-mon[124666]: pgmap v10641: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 329 KiB/s rd, 450 KiB/s wr, 30 op/s 2023-05-08T09:15:07.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:07 smithi186 ceph-mon[126480]: pgmap v10641: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 329 KiB/s rd, 450 KiB/s wr, 30 op/s 2023-05-08T09:15:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:15:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:15:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:08 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:15:08.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:15:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:15:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:08 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:15:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:15:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:15:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:08 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:15:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:09 smithi133 ceph-mon[125939]: pgmap v10642: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 329 KiB/s rd, 450 KiB/s wr, 30 op/s 2023-05-08T09:15:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19848.017738 secs 2023-05-08T09:15:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:09 smithi096 ceph-mon[124666]: pgmap v10642: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 329 KiB/s rd, 450 KiB/s wr, 30 op/s 2023-05-08T09:15:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19848.017738 secs 2023-05-08T09:15:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:09 smithi186 ceph-mon[126480]: pgmap v10642: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 329 KiB/s rd, 450 KiB/s wr, 30 op/s 2023-05-08T09:15:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19848.017738 secs 2023-05-08T09:15:10.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19848.573958 secs 2023-05-08T09:15:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19848.573958 secs 2023-05-08T09:15:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19848.573958 secs 2023-05-08T09:15:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:11 smithi133 ceph-mon[125939]: pgmap v10643: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 407 KiB/s wr, 28 op/s 2023-05-08T09:15:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19849.860359 secs 2023-05-08T09:15:11.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:11 smithi096 ceph-mon[124666]: pgmap v10643: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 407 KiB/s wr, 28 op/s 2023-05-08T09:15:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19849.860359 secs 2023-05-08T09:15:11.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:11 smithi186 ceph-mon[126480]: pgmap v10643: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 407 KiB/s wr, 28 op/s 2023-05-08T09:15:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19849.860359 secs 2023-05-08T09:15:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:13 smithi133 ceph-mon[125939]: pgmap v10644: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 407 KiB/s wr, 28 op/s 2023-05-08T09:15:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:13 smithi133 ceph-mon[125939]: osdmap e743: 12 total, 12 up, 12 in 2023-05-08T09:15:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:13 smithi096 ceph-mon[124666]: pgmap v10644: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 407 KiB/s wr, 28 op/s 2023-05-08T09:15:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:13 smithi096 ceph-mon[124666]: osdmap e743: 12 total, 12 up, 12 in 2023-05-08T09:15:13.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:13 smithi186 ceph-mon[126480]: pgmap v10644: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 407 KiB/s wr, 28 op/s 2023-05-08T09:15:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:13 smithi186 ceph-mon[126480]: osdmap e743: 12 total, 12 up, 12 in 2023-05-08T09:15:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19853.017866 secs 2023-05-08T09:15:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19853.017866 secs 2023-05-08T09:15:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19853.017866 secs 2023-05-08T09:15:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19853.574032 secs 2023-05-08T09:15:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:15 smithi133 ceph-mon[125939]: pgmap v10646: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 45 KiB/s wr, 5 op/s 2023-05-08T09:15:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19853.574032 secs 2023-05-08T09:15:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:15 smithi096 ceph-mon[124666]: pgmap v10646: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 45 KiB/s wr, 5 op/s 2023-05-08T09:15:15.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19853.574032 secs 2023-05-08T09:15:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:15 smithi186 ceph-mon[126480]: pgmap v10646: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 45 KiB/s wr, 5 op/s 2023-05-08T09:15:16.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19854.860482 secs 2023-05-08T09:15:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19854.860482 secs 2023-05-08T09:15:16.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19854.860482 secs 2023-05-08T09:15:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:17 smithi133 ceph-mon[125939]: pgmap v10647: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 123 KiB/s wr, 7 op/s 2023-05-08T09:15:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:17 smithi096 ceph-mon[124666]: pgmap v10647: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 123 KiB/s wr, 7 op/s 2023-05-08T09:15:17.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:17 smithi186 ceph-mon[126480]: pgmap v10647: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 123 KiB/s wr, 7 op/s 2023-05-08T09:15:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:19 smithi133 ceph-mon[125939]: pgmap v10648: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 123 KiB/s wr, 7 op/s 2023-05-08T09:15:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19858.017962 secs 2023-05-08T09:15:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:19 smithi096 ceph-mon[124666]: pgmap v10648: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 123 KiB/s wr, 7 op/s 2023-05-08T09:15:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19858.017962 secs 2023-05-08T09:15:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:19 smithi186 ceph-mon[126480]: pgmap v10648: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 123 KiB/s wr, 7 op/s 2023-05-08T09:15:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19858.017962 secs 2023-05-08T09:15:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19858.574144 secs 2023-05-08T09:15:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19858.574144 secs 2023-05-08T09:15:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19858.574144 secs 2023-05-08T09:15:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:21 smithi133 ceph-mon[125939]: pgmap v10649: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 84 KiB/s wr, 6 op/s 2023-05-08T09:15:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19859.860594 secs 2023-05-08T09:15:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:21 smithi096 ceph-mon[124666]: pgmap v10649: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 84 KiB/s wr, 6 op/s 2023-05-08T09:15:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19859.860594 secs 2023-05-08T09:15:21.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:21 smithi186 ceph-mon[126480]: pgmap v10649: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 84 KiB/s wr, 6 op/s 2023-05-08T09:15:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19859.860594 secs 2023-05-08T09:15:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:23 smithi133 ceph-mon[125939]: pgmap v10650: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 84 KiB/s wr, 6 op/s 2023-05-08T09:15:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:23 smithi096 ceph-mon[124666]: pgmap v10650: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 84 KiB/s wr, 6 op/s 2023-05-08T09:15:23.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:23 smithi186 ceph-mon[126480]: pgmap v10650: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 84 KiB/s wr, 6 op/s 2023-05-08T09:15:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19863.018080 secs 2023-05-08T09:15:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19863.018080 secs 2023-05-08T09:15:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19863.018080 secs 2023-05-08T09:15:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19863.574259 secs 2023-05-08T09:15:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:25 smithi133 ceph-mon[125939]: pgmap v10651: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 77 KiB/s wr, 5 op/s 2023-05-08T09:15:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19863.574259 secs 2023-05-08T09:15:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:25 smithi096 ceph-mon[124666]: pgmap v10651: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 77 KiB/s wr, 5 op/s 2023-05-08T09:15:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19863.574259 secs 2023-05-08T09:15:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:25 smithi186 ceph-mon[126480]: pgmap v10651: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 77 KiB/s wr, 5 op/s 2023-05-08T09:15:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19864.860720 secs 2023-05-08T09:15:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19864.860720 secs 2023-05-08T09:15:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19864.860720 secs 2023-05-08T09:15:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:27 smithi133 ceph-mon[125939]: pgmap v10652: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 70 KiB/s wr, 7 op/s 2023-05-08T09:15:27.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:27 smithi096 ceph-mon[124666]: pgmap v10652: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 70 KiB/s wr, 7 op/s 2023-05-08T09:15:27.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:27 smithi186 ceph-mon[126480]: pgmap v10652: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 70 KiB/s wr, 7 op/s 2023-05-08T09:15:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:29 smithi133 ceph-mon[125939]: pgmap v10653: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:15:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19868.018219 secs 2023-05-08T09:15:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:29 smithi096 ceph-mon[124666]: pgmap v10653: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:15:29.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19868.018219 secs 2023-05-08T09:15:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:29 smithi186 ceph-mon[126480]: pgmap v10653: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:15:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19868.018219 secs 2023-05-08T09:15:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19868.574374 secs 2023-05-08T09:15:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19868.574374 secs 2023-05-08T09:15:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19868.574374 secs 2023-05-08T09:15:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:31 smithi133 ceph-mon[125939]: pgmap v10654: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 7 op/s 2023-05-08T09:15:31.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19869.860842 secs 2023-05-08T09:15:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:31 smithi096 ceph-mon[124666]: pgmap v10654: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 7 op/s 2023-05-08T09:15:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19869.860842 secs 2023-05-08T09:15:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:31 smithi186 ceph-mon[126480]: pgmap v10654: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 7 op/s 2023-05-08T09:15:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19869.860842 secs 2023-05-08T09:15:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:33 smithi133 ceph-mon[125939]: pgmap v10655: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T09:15:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:33 smithi096 ceph-mon[124666]: pgmap v10655: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T09:15:33.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:33 smithi186 ceph-mon[126480]: pgmap v10655: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T09:15:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19873.018357 secs 2023-05-08T09:15:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19873.018357 secs 2023-05-08T09:15:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19873.018357 secs 2023-05-08T09:15:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19873.574493 secs 2023-05-08T09:15:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:35 smithi133 ceph-mon[125939]: pgmap v10656: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T09:15:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19873.574493 secs 2023-05-08T09:15:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:35 smithi096 ceph-mon[124666]: pgmap v10656: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T09:15:35.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19873.574493 secs 2023-05-08T09:15:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:35 smithi186 ceph-mon[126480]: pgmap v10656: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T09:15:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19874.860965 secs 2023-05-08T09:15:36.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19874.860965 secs 2023-05-08T09:15:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19874.860965 secs 2023-05-08T09:15:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:37 smithi096 ceph-mon[124666]: pgmap v10657: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 76 KiB/s wr, 8 op/s 2023-05-08T09:15:37.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:37 smithi186 ceph-mon[126480]: pgmap v10657: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 76 KiB/s wr, 8 op/s 2023-05-08T09:15:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:37 smithi133 ceph-mon[125939]: pgmap v10657: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 76 KiB/s wr, 8 op/s 2023-05-08T09:15:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:39 smithi096 ceph-mon[124666]: pgmap v10658: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 76 KiB/s wr, 6 op/s 2023-05-08T09:15:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19878.018456 secs 2023-05-08T09:15:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:39 smithi186 ceph-mon[126480]: pgmap v10658: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 76 KiB/s wr, 6 op/s 2023-05-08T09:15:39.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19878.018456 secs 2023-05-08T09:15:39.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:39 smithi133 ceph-mon[125939]: pgmap v10658: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 76 KiB/s wr, 6 op/s 2023-05-08T09:15:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19878.018456 secs 2023-05-08T09:15:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19878.574613 secs 2023-05-08T09:15:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19878.574613 secs 2023-05-08T09:15:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19878.574613 secs 2023-05-08T09:15:41.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:41 smithi186 ceph-mon[126480]: pgmap v10659: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 105 KiB/s wr, 9 op/s 2023-05-08T09:15:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:41 smithi133 ceph-mon[125939]: pgmap v10659: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 105 KiB/s wr, 9 op/s 2023-05-08T09:15:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:41 smithi096 ceph-mon[124666]: pgmap v10659: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 105 KiB/s wr, 9 op/s 2023-05-08T09:15:43.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:43 smithi186 ceph-mon[126480]: pgmap v10660: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 105 KiB/s wr, 6 op/s 2023-05-08T09:15:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:43 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:15:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:15:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:43 smithi133 ceph-mon[125939]: pgmap v10660: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 105 KiB/s wr, 6 op/s 2023-05-08T09:15:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:43 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:15:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:15:44.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:43 smithi096 ceph-mon[124666]: pgmap v10660: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 105 KiB/s wr, 6 op/s 2023-05-08T09:15:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:43 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:15:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:15:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19883.018524 secs 2023-05-08T09:15:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:44 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:15:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:44 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:15:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:44 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:15:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:44 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:15:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:44 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T09:15:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:44 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T09:15:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:44 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:15:44.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19883.574690 secs 2023-05-08T09:15:44.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:15:44.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:15:44.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:15:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19883.018524 secs 2023-05-08T09:15:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:44 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:15:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:44 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:15:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:44 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:15:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:44 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:15:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:44 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T09:15:44.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:44 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T09:15:44.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:44 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:15:44.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19883.574690 secs 2023-05-08T09:15:44.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:15:44.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:15:44.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:15:45.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19883.018524 secs 2023-05-08T09:15:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:44 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:15:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:44 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:15:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:44 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:15:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:44 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:15:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:44 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T09:15:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:44 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T09:15:45.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:44 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:15:45.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19883.574690 secs 2023-05-08T09:15:45.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:15:45.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:15:45.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:15:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:45 smithi133 ceph-mon[125939]: pgmap v10661: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 105 KiB/s wr, 6 op/s 2023-05-08T09:15:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:45 smithi096 ceph-mon[124666]: pgmap v10661: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 105 KiB/s wr, 6 op/s 2023-05-08T09:15:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:45 smithi186 ceph-mon[126480]: pgmap v10661: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 105 KiB/s wr, 6 op/s 2023-05-08T09:15:47.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:47 smithi133 ceph-mon[125939]: pgmap v10662: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 258 KiB/s wr, 10 op/s 2023-05-08T09:15:48.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:47 smithi096 ceph-mon[124666]: pgmap v10662: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 258 KiB/s wr, 10 op/s 2023-05-08T09:15:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:47 smithi186 ceph-mon[126480]: pgmap v10662: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 258 KiB/s wr, 10 op/s 2023-05-08T09:15:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:49 smithi133 ceph-mon[125939]: pgmap v10663: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 183 KiB/s wr, 7 op/s 2023-05-08T09:15:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19888.018591 secs 2023-05-08T09:15:50.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:49 smithi096 ceph-mon[124666]: pgmap v10663: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 183 KiB/s wr, 7 op/s 2023-05-08T09:15:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19888.018591 secs 2023-05-08T09:15:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:49 smithi186 ceph-mon[126480]: pgmap v10663: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 183 KiB/s wr, 7 op/s 2023-05-08T09:15:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19888.018591 secs 2023-05-08T09:15:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:51 smithi133 ceph-mon[125939]: pgmap v10664: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 342 KiB/s wr, 11 op/s 2023-05-08T09:15:51.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:15:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:51 smithi096 ceph-mon[124666]: pgmap v10664: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 342 KiB/s wr, 11 op/s 2023-05-08T09:15:52.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:15:52.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:51 smithi186 ceph-mon[126480]: pgmap v10664: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 342 KiB/s wr, 11 op/s 2023-05-08T09:15:52.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:15:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:52 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:15:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:15:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:15:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:52 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:15:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:15:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:15:53.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:52 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:15:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:15:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:15:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:53 smithi133 ceph-mon[125939]: pgmap v10665: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 312 KiB/s wr, 8 op/s 2023-05-08T09:15:54.010 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:53 smithi096 ceph-mon[124666]: pgmap v10665: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 312 KiB/s wr, 8 op/s 2023-05-08T09:15:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:53 smithi186 ceph-mon[126480]: pgmap v10665: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 312 KiB/s wr, 8 op/s 2023-05-08T09:15:54.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19893.018681 secs 2023-05-08T09:15:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19893.574935 secs 2023-05-08T09:15:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19893.018681 secs 2023-05-08T09:15:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19893.574935 secs 2023-05-08T09:15:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19893.018681 secs 2023-05-08T09:15:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19893.574935 secs 2023-05-08T09:15:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:55 smithi133 ceph-mon[125939]: pgmap v10666: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 312 KiB/s wr, 8 op/s 2023-05-08T09:15:56.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:55 smithi096 ceph-mon[124666]: pgmap v10666: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 312 KiB/s wr, 8 op/s 2023-05-08T09:15:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:55 smithi186 ceph-mon[126480]: pgmap v10666: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 312 KiB/s wr, 8 op/s 2023-05-08T09:15:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19894.861455 secs 2023-05-08T09:15:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:15:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:15:56.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:15:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19894.861455 secs 2023-05-08T09:15:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:15:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:15:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:15:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19894.861455 secs 2023-05-08T09:15:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:15:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:15:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:15:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:57 smithi133 ceph-mon[125939]: pgmap v10667: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 639 KiB/s rd, 567 KiB/s wr, 14 op/s 2023-05-08T09:15:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:57 smithi096 ceph-mon[124666]: pgmap v10667: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 639 KiB/s rd, 567 KiB/s wr, 14 op/s 2023-05-08T09:15:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:57 smithi186 ceph-mon[126480]: pgmap v10667: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 639 KiB/s rd, 567 KiB/s wr, 14 op/s 2023-05-08T09:15:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:58 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:15:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:58 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:15:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:58 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:15:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:59 smithi133 ceph-mon[125939]: pgmap v10668: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 414 KiB/s wr, 11 op/s 2023-05-08T09:15:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19898.018825 secs 2023-05-08T09:15:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:15:59 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:16:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:59 smithi096 ceph-mon[124666]: pgmap v10668: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 414 KiB/s wr, 11 op/s 2023-05-08T09:16:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19898.018825 secs 2023-05-08T09:16:00.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:15:59 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:16:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:59 smithi186 ceph-mon[126480]: pgmap v10668: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 414 KiB/s wr, 11 op/s 2023-05-08T09:16:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19898.018825 secs 2023-05-08T09:16:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:15:59 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:16:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:16:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:16:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:16:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:16:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:16:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:16:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:01 smithi133 ceph-mon[125939]: pgmap v10669: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 511 KiB/s wr, 16 op/s 2023-05-08T09:16:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19899.861532 secs 2023-05-08T09:16:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:01 smithi096 ceph-mon[124666]: pgmap v10669: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 511 KiB/s wr, 16 op/s 2023-05-08T09:16:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19899.861532 secs 2023-05-08T09:16:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:01 smithi186 ceph-mon[126480]: pgmap v10669: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 511 KiB/s wr, 16 op/s 2023-05-08T09:16:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19899.861532 secs 2023-05-08T09:16:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:03 smithi133 ceph-mon[125939]: pgmap v10670: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 353 KiB/s wr, 12 op/s 2023-05-08T09:16:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:03 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:16:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:03 smithi096 ceph-mon[124666]: pgmap v10670: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 353 KiB/s wr, 12 op/s 2023-05-08T09:16:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:03 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:16:04.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:03 smithi186 ceph-mon[126480]: pgmap v10670: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 353 KiB/s wr, 12 op/s 2023-05-08T09:16:04.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:03 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:16:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19903.018944 secs 2023-05-08T09:16:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19903.575175 secs 2023-05-08T09:16:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19903.018944 secs 2023-05-08T09:16:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19903.575175 secs 2023-05-08T09:16:05.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19903.018944 secs 2023-05-08T09:16:05.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19903.575175 secs 2023-05-08T09:16:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:05 smithi133 ceph-mon[125939]: pgmap v10671: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 353 KiB/s wr, 11 op/s 2023-05-08T09:16:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:05 smithi096 ceph-mon[124666]: pgmap v10671: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 353 KiB/s wr, 11 op/s 2023-05-08T09:16:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:05 smithi186 ceph-mon[126480]: pgmap v10671: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 353 KiB/s wr, 11 op/s 2023-05-08T09:16:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19904.861657 secs 2023-05-08T09:16:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:06 smithi133 ceph-mon[125939]: osdmap e744: 12 total, 12 up, 12 in 2023-05-08T09:16:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19904.861657 secs 2023-05-08T09:16:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:06 smithi096 ceph-mon[124666]: osdmap e744: 12 total, 12 up, 12 in 2023-05-08T09:16:07.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19904.861657 secs 2023-05-08T09:16:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:06 smithi186 ceph-mon[126480]: osdmap e744: 12 total, 12 up, 12 in 2023-05-08T09:16:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:07 smithi133 ceph-mon[125939]: pgmap v10673: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 474 KiB/s wr, 30 op/s 2023-05-08T09:16:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:07 smithi096 ceph-mon[124666]: pgmap v10673: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 474 KiB/s wr, 30 op/s 2023-05-08T09:16:08.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:07 smithi186 ceph-mon[126480]: pgmap v10673: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 474 KiB/s wr, 30 op/s 2023-05-08T09:16:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:16:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:16:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:08 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:16:09.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:16:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:16:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:08 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:16:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:16:09.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:16:09.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:08 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:16:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:09 smithi133 ceph-mon[125939]: pgmap v10674: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 474 KiB/s wr, 30 op/s 2023-05-08T09:16:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19908.019049 secs 2023-05-08T09:16:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19908.575300 secs 2023-05-08T09:16:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:09 smithi096 ceph-mon[124666]: pgmap v10674: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 474 KiB/s wr, 30 op/s 2023-05-08T09:16:10.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19908.019049 secs 2023-05-08T09:16:10.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19908.575300 secs 2023-05-08T09:16:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:09 smithi186 ceph-mon[126480]: pgmap v10674: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 474 KiB/s wr, 30 op/s 2023-05-08T09:16:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19908.019049 secs 2023-05-08T09:16:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19908.575300 secs 2023-05-08T09:16:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:11 smithi133 ceph-mon[125939]: pgmap v10675: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 442 KiB/s wr, 28 op/s 2023-05-08T09:16:11.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19909.861792 secs 2023-05-08T09:16:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:11 smithi096 ceph-mon[124666]: pgmap v10675: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 442 KiB/s wr, 28 op/s 2023-05-08T09:16:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19909.861792 secs 2023-05-08T09:16:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:11 smithi186 ceph-mon[126480]: pgmap v10675: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 442 KiB/s wr, 28 op/s 2023-05-08T09:16:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19909.861792 secs 2023-05-08T09:16:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:13 smithi133 ceph-mon[125939]: pgmap v10676: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 442 KiB/s wr, 28 op/s 2023-05-08T09:16:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:13 smithi133 ceph-mon[125939]: osdmap e745: 12 total, 12 up, 12 in 2023-05-08T09:16:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:13 smithi096 ceph-mon[124666]: pgmap v10676: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 442 KiB/s wr, 28 op/s 2023-05-08T09:16:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:13 smithi096 ceph-mon[124666]: osdmap e745: 12 total, 12 up, 12 in 2023-05-08T09:16:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:13 smithi186 ceph-mon[126480]: pgmap v10676: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 442 KiB/s wr, 28 op/s 2023-05-08T09:16:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:13 smithi186 ceph-mon[126480]: osdmap e745: 12 total, 12 up, 12 in 2023-05-08T09:16:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19913.019173 secs 2023-05-08T09:16:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19913.575418 secs 2023-05-08T09:16:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19913.019173 secs 2023-05-08T09:16:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19913.575418 secs 2023-05-08T09:16:15.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19913.019173 secs 2023-05-08T09:16:15.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19913.575418 secs 2023-05-08T09:16:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:15 smithi133 ceph-mon[125939]: pgmap v10678: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 102 KiB/s wr, 5 op/s 2023-05-08T09:16:16.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:15 smithi096 ceph-mon[124666]: pgmap v10678: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 102 KiB/s wr, 5 op/s 2023-05-08T09:16:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:15 smithi186 ceph-mon[126480]: pgmap v10678: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 102 KiB/s wr, 5 op/s 2023-05-08T09:16:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19914.861896 secs 2023-05-08T09:16:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19914.861896 secs 2023-05-08T09:16:17.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19914.861896 secs 2023-05-08T09:16:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:17 smithi096 ceph-mon[124666]: pgmap v10679: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 146 KiB/s wr, 7 op/s 2023-05-08T09:16:18.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:17 smithi186 ceph-mon[126480]: pgmap v10679: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 146 KiB/s wr, 7 op/s 2023-05-08T09:16:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:17 smithi133 ceph-mon[125939]: pgmap v10679: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 146 KiB/s wr, 7 op/s 2023-05-08T09:16:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:19 smithi096 ceph-mon[124666]: pgmap v10680: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 146 KiB/s wr, 7 op/s 2023-05-08T09:16:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19918.019248 secs 2023-05-08T09:16:20.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19918.575520 secs 2023-05-08T09:16:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:19 smithi186 ceph-mon[126480]: pgmap v10680: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 146 KiB/s wr, 7 op/s 2023-05-08T09:16:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19918.019248 secs 2023-05-08T09:16:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19918.575520 secs 2023-05-08T09:16:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:19 smithi133 ceph-mon[125939]: pgmap v10680: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 146 KiB/s wr, 7 op/s 2023-05-08T09:16:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19918.019248 secs 2023-05-08T09:16:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19918.575520 secs 2023-05-08T09:16:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:21 smithi096 ceph-mon[124666]: pgmap v10681: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 61 KiB/s wr, 6 op/s 2023-05-08T09:16:22.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19919.862025 secs 2023-05-08T09:16:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:21 smithi186 ceph-mon[126480]: pgmap v10681: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 61 KiB/s wr, 6 op/s 2023-05-08T09:16:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19919.862025 secs 2023-05-08T09:16:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:21 smithi133 ceph-mon[125939]: pgmap v10681: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 61 KiB/s wr, 6 op/s 2023-05-08T09:16:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19919.862025 secs 2023-05-08T09:16:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:23 smithi096 ceph-mon[124666]: pgmap v10682: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 61 KiB/s wr, 6 op/s 2023-05-08T09:16:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:23 smithi186 ceph-mon[126480]: pgmap v10682: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 61 KiB/s wr, 6 op/s 2023-05-08T09:16:24.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:23 smithi133 ceph-mon[125939]: pgmap v10682: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 61 KiB/s wr, 6 op/s 2023-05-08T09:16:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19923.019415 secs 2023-05-08T09:16:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19923.575585 secs 2023-05-08T09:16:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19923.019415 secs 2023-05-08T09:16:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19923.575585 secs 2023-05-08T09:16:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19923.019415 secs 2023-05-08T09:16:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19923.575585 secs 2023-05-08T09:16:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:25 smithi186 ceph-mon[126480]: pgmap v10683: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 55 KiB/s wr, 5 op/s 2023-05-08T09:16:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:25 smithi133 ceph-mon[125939]: pgmap v10683: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 55 KiB/s wr, 5 op/s 2023-05-08T09:16:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:25 smithi096 ceph-mon[124666]: pgmap v10683: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 55 KiB/s wr, 5 op/s 2023-05-08T09:16:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19924.862150 secs 2023-05-08T09:16:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19924.862150 secs 2023-05-08T09:16:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19924.862150 secs 2023-05-08T09:16:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:27 smithi186 ceph-mon[126480]: pgmap v10684: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 83 KiB/s wr, 8 op/s 2023-05-08T09:16:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:27 smithi133 ceph-mon[125939]: pgmap v10684: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 83 KiB/s wr, 8 op/s 2023-05-08T09:16:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:27 smithi096 ceph-mon[124666]: pgmap v10684: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 83 KiB/s wr, 8 op/s 2023-05-08T09:16:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:29 smithi186 ceph-mon[126480]: pgmap v10685: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 KiB/s wr, 5 op/s 2023-05-08T09:16:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19928.019467 secs 2023-05-08T09:16:30.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19928.575711 secs 2023-05-08T09:16:30.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:29 smithi133 ceph-mon[125939]: pgmap v10685: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 KiB/s wr, 5 op/s 2023-05-08T09:16:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19928.019467 secs 2023-05-08T09:16:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19928.575711 secs 2023-05-08T09:16:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:29 smithi096 ceph-mon[124666]: pgmap v10685: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 KiB/s wr, 5 op/s 2023-05-08T09:16:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19928.019467 secs 2023-05-08T09:16:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19928.575711 secs 2023-05-08T09:16:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:31 smithi186 ceph-mon[126480]: pgmap v10686: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 32 KiB/s wr, 7 op/s 2023-05-08T09:16:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19929.862212 secs 2023-05-08T09:16:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:31 smithi133 ceph-mon[125939]: pgmap v10686: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 32 KiB/s wr, 7 op/s 2023-05-08T09:16:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19929.862212 secs 2023-05-08T09:16:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:31 smithi096 ceph-mon[124666]: pgmap v10686: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 32 KiB/s wr, 7 op/s 2023-05-08T09:16:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19929.862212 secs 2023-05-08T09:16:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:33 smithi186 ceph-mon[126480]: pgmap v10687: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 KiB/s wr, 5 op/s 2023-05-08T09:16:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:33 smithi133 ceph-mon[125939]: pgmap v10687: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 KiB/s wr, 5 op/s 2023-05-08T09:16:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:33 smithi096 ceph-mon[124666]: pgmap v10687: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 KiB/s wr, 5 op/s 2023-05-08T09:16:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19933.019562 secs 2023-05-08T09:16:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19933.575838 secs 2023-05-08T09:16:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19933.019562 secs 2023-05-08T09:16:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19933.575838 secs 2023-05-08T09:16:35.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19933.019562 secs 2023-05-08T09:16:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19933.575838 secs 2023-05-08T09:16:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:35 smithi186 ceph-mon[126480]: pgmap v10688: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 KiB/s wr, 5 op/s 2023-05-08T09:16:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:35 smithi133 ceph-mon[125939]: pgmap v10688: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 KiB/s wr, 5 op/s 2023-05-08T09:16:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:35 smithi096 ceph-mon[124666]: pgmap v10688: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 KiB/s wr, 5 op/s 2023-05-08T09:16:37.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19934.862279 secs 2023-05-08T09:16:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19934.862279 secs 2023-05-08T09:16:37.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19934.862279 secs 2023-05-08T09:16:38.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:37 smithi186 ceph-mon[126480]: pgmap v10689: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 32 KiB/s wr, 8 op/s 2023-05-08T09:16:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:37 smithi133 ceph-mon[125939]: pgmap v10689: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 32 KiB/s wr, 8 op/s 2023-05-08T09:16:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:37 smithi096 ceph-mon[124666]: pgmap v10689: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 32 KiB/s wr, 8 op/s 2023-05-08T09:16:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:39 smithi186 ceph-mon[126480]: pgmap v10690: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T09:16:39.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:39 smithi133 ceph-mon[125939]: pgmap v10690: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T09:16:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:39 smithi096 ceph-mon[124666]: pgmap v10690: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T09:16:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19938.019638 secs 2023-05-08T09:16:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19938.575957 secs 2023-05-08T09:16:40.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19938.019638 secs 2023-05-08T09:16:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19938.575957 secs 2023-05-08T09:16:40.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19938.019638 secs 2023-05-08T09:16:40.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19938.575957 secs 2023-05-08T09:16:41.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:41 smithi186 ceph-mon[126480]: pgmap v10691: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 148 KiB/s wr, 9 op/s 2023-05-08T09:16:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19939.862411 secs 2023-05-08T09:16:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:41 smithi133 ceph-mon[125939]: pgmap v10691: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 148 KiB/s wr, 9 op/s 2023-05-08T09:16:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19939.862411 secs 2023-05-08T09:16:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:41 smithi096 ceph-mon[124666]: pgmap v10691: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 148 KiB/s wr, 9 op/s 2023-05-08T09:16:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19939.862411 secs 2023-05-08T09:16:43.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:43 smithi186 ceph-mon[126480]: pgmap v10692: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 148 KiB/s wr, 6 op/s 2023-05-08T09:16:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:43 smithi133 ceph-mon[125939]: pgmap v10692: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 148 KiB/s wr, 6 op/s 2023-05-08T09:16:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:43 smithi096 ceph-mon[124666]: pgmap v10692: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 148 KiB/s wr, 6 op/s 2023-05-08T09:16:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:44 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:16:44.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:44 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:16:44.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:44 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:16:45.299 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19943.019752 secs 2023-05-08T09:16:45.299 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:45 smithi133 ceph-mon[125939]: pgmap v10693: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 148 KiB/s wr, 6 op/s 2023-05-08T09:16:45.319 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19943.019752 secs 2023-05-08T09:16:45.319 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:45 smithi096 ceph-mon[124666]: pgmap v10693: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 148 KiB/s wr, 6 op/s 2023-05-08T09:16:45.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19943.019752 secs 2023-05-08T09:16:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:45 smithi186 ceph-mon[126480]: pgmap v10693: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 148 KiB/s wr, 6 op/s 2023-05-08T09:16:46.071 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19944.862560 secs 2023-05-08T09:16:46.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19944.862560 secs 2023-05-08T09:16:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19944.862560 secs 2023-05-08T09:16:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:47 smithi133 ceph-mon[125939]: pgmap v10694: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 166 KiB/s wr, 10 op/s 2023-05-08T09:16:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:47 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:16:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:47 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:16:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:47 smithi096 ceph-mon[124666]: pgmap v10694: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 166 KiB/s wr, 10 op/s 2023-05-08T09:16:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:47 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:16:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:47 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:16:47.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:47 smithi186 ceph-mon[126480]: pgmap v10694: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 166 KiB/s wr, 10 op/s 2023-05-08T09:16:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:47 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:16:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:47 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:16:48.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:48 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:16:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:48 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:16:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:48 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:16:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:48 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:16:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:48 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:16:48.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:48 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:16:48.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:48 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T09:16:48.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:48 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T09:16:48.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:48 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:16:48.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:16:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:48 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:16:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:48 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:16:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:48 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:16:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:48 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:16:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:48 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:16:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:48 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:16:48.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:48 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T09:16:48.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:48 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T09:16:48.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:48 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:16:48.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:16:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:48 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:16:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:48 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:16:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:48 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:16:48.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:48 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:16:48.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:48 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:16:48.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:48 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:16:48.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:48 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T09:16:48.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:48 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T09:16:48.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:48 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:16:48.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:16:49.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:49 smithi186 ceph-mon[126480]: pgmap v10695: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 165 KiB/s wr, 7 op/s 2023-05-08T09:16:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:16:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:16:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:16:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19948.019883 secs 2023-05-08T09:16:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:49 smithi133 ceph-mon[125939]: pgmap v10695: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 165 KiB/s wr, 7 op/s 2023-05-08T09:16:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:16:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:16:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:16:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19948.019883 secs 2023-05-08T09:16:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:49 smithi096 ceph-mon[124666]: pgmap v10695: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 165 KiB/s wr, 7 op/s 2023-05-08T09:16:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:16:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:16:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:16:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19948.019883 secs 2023-05-08T09:16:51.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:51 smithi186 ceph-mon[126480]: pgmap v10696: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 485 KiB/s wr, 13 op/s 2023-05-08T09:16:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:51 smithi133 ceph-mon[125939]: pgmap v10696: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 485 KiB/s wr, 13 op/s 2023-05-08T09:16:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:51 smithi096 ceph-mon[124666]: pgmap v10696: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 485 KiB/s wr, 13 op/s 2023-05-08T09:16:52.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:16:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:16:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:16:53.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:53 smithi186 ceph-mon[126480]: pgmap v10697: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 497 KiB/s rd, 337 KiB/s wr, 10 op/s 2023-05-08T09:16:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:16:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:16:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:53 smithi133 ceph-mon[125939]: pgmap v10697: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 497 KiB/s rd, 337 KiB/s wr, 10 op/s 2023-05-08T09:16:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:16:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:16:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:53 smithi096 ceph-mon[124666]: pgmap v10697: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 497 KiB/s rd, 337 KiB/s wr, 10 op/s 2023-05-08T09:16:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:16:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:16:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19953.020001 secs 2023-05-08T09:16:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19953.020001 secs 2023-05-08T09:16:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19953.020001 secs 2023-05-08T09:16:55.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:55 smithi186 ceph-mon[126480]: pgmap v10698: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 497 KiB/s rd, 337 KiB/s wr, 10 op/s 2023-05-08T09:16:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:55 smithi133 ceph-mon[125939]: pgmap v10698: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 497 KiB/s rd, 337 KiB/s wr, 10 op/s 2023-05-08T09:16:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:55 smithi096 ceph-mon[124666]: pgmap v10698: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 497 KiB/s rd, 337 KiB/s wr, 10 op/s 2023-05-08T09:16:57.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:57 smithi186 ceph-mon[126480]: pgmap v10699: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 593 KiB/s rd, 434 KiB/s wr, 16 op/s 2023-05-08T09:16:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:57 smithi133 ceph-mon[125939]: pgmap v10699: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 593 KiB/s rd, 434 KiB/s wr, 16 op/s 2023-05-08T09:16:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:57 smithi096 ceph-mon[124666]: pgmap v10699: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 593 KiB/s rd, 434 KiB/s wr, 16 op/s 2023-05-08T09:16:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:58 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:16:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:58 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:16:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:58 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:16:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:59 smithi186 ceph-mon[126480]: pgmap v10700: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 416 KiB/s wr, 11 op/s 2023-05-08T09:16:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:16:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19958.020118 secs 2023-05-08T09:16:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:59 smithi133 ceph-mon[125939]: pgmap v10700: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 416 KiB/s wr, 11 op/s 2023-05-08T09:16:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:16:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19958.020118 secs 2023-05-08T09:16:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:59 smithi096 ceph-mon[124666]: pgmap v10700: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 416 KiB/s wr, 11 op/s 2023-05-08T09:16:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:16:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19958.020118 secs 2023-05-08T09:17:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19958.576437 secs 2023-05-08T09:17:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19958.576437 secs 2023-05-08T09:17:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19958.576437 secs 2023-05-08T09:17:01.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:01 smithi186 ceph-mon[126480]: pgmap v10701: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 596 KiB/s rd, 586 KiB/s wr, 16 op/s 2023-05-08T09:17:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:17:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:17:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19959.862909 secs 2023-05-08T09:17:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:01 smithi133 ceph-mon[125939]: pgmap v10701: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 596 KiB/s rd, 586 KiB/s wr, 16 op/s 2023-05-08T09:17:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:17:01.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:17:01.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19959.862909 secs 2023-05-08T09:17:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:01 smithi096 ceph-mon[124666]: pgmap v10701: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 596 KiB/s rd, 586 KiB/s wr, 16 op/s 2023-05-08T09:17:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:17:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:17:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19959.862909 secs 2023-05-08T09:17:03.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:03 smithi186 ceph-mon[126480]: pgmap v10702: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 266 KiB/s wr, 10 op/s 2023-05-08T09:17:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:03 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:17:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:03 smithi133 ceph-mon[125939]: pgmap v10702: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 266 KiB/s wr, 10 op/s 2023-05-08T09:17:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:03 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:17:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:03 smithi096 ceph-mon[124666]: pgmap v10702: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 266 KiB/s wr, 10 op/s 2023-05-08T09:17:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:03 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:17:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19963.020239 secs 2023-05-08T09:17:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19963.020239 secs 2023-05-08T09:17:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19963.020239 secs 2023-05-08T09:17:05.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19963.576569 secs 2023-05-08T09:17:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:05 smithi186 ceph-mon[126480]: pgmap v10703: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 266 KiB/s wr, 10 op/s 2023-05-08T09:17:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:17:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:17:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19963.576569 secs 2023-05-08T09:17:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:05 smithi133 ceph-mon[125939]: pgmap v10703: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 266 KiB/s wr, 10 op/s 2023-05-08T09:17:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:17:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:17:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19963.576569 secs 2023-05-08T09:17:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:05 smithi096 ceph-mon[124666]: pgmap v10703: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 266 KiB/s wr, 10 op/s 2023-05-08T09:17:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:17:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:17:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19964.863036 secs 2023-05-08T09:17:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19964.863036 secs 2023-05-08T09:17:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19964.863036 secs 2023-05-08T09:17:07.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:07 smithi133 ceph-mon[125939]: pgmap v10704: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 311 KiB/s wr, 28 op/s 2023-05-08T09:17:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:07 smithi096 ceph-mon[124666]: pgmap v10704: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 311 KiB/s wr, 28 op/s 2023-05-08T09:17:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:07 smithi186 ceph-mon[126480]: pgmap v10704: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 311 KiB/s wr, 28 op/s 2023-05-08T09:17:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:08 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:17:08.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:08 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:17:08.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:08 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:17:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:09 smithi133 ceph-mon[125939]: pgmap v10705: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 215 KiB/s wr, 23 op/s 2023-05-08T09:17:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19968.020375 secs 2023-05-08T09:17:09.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:09 smithi096 ceph-mon[124666]: pgmap v10705: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 215 KiB/s wr, 23 op/s 2023-05-08T09:17:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19968.020375 secs 2023-05-08T09:17:09.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:09 smithi186 ceph-mon[126480]: pgmap v10705: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 215 KiB/s wr, 23 op/s 2023-05-08T09:17:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19968.020375 secs 2023-05-08T09:17:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19968.576698 secs 2023-05-08T09:17:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19968.576698 secs 2023-05-08T09:17:10.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19968.576698 secs 2023-05-08T09:17:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:11 smithi133 ceph-mon[125939]: pgmap v10706: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 354 KiB/s wr, 27 op/s 2023-05-08T09:17:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19969.863107 secs 2023-05-08T09:17:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:11 smithi096 ceph-mon[124666]: pgmap v10706: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 354 KiB/s wr, 27 op/s 2023-05-08T09:17:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19969.863107 secs 2023-05-08T09:17:11.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:11 smithi186 ceph-mon[126480]: pgmap v10706: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 354 KiB/s wr, 27 op/s 2023-05-08T09:17:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19969.863107 secs 2023-05-08T09:17:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:12 smithi133 ceph-mon[125939]: osdmap e746: 12 total, 12 up, 12 in 2023-05-08T09:17:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:12 smithi096 ceph-mon[124666]: osdmap e746: 12 total, 12 up, 12 in 2023-05-08T09:17:12.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:12 smithi186 ceph-mon[126480]: osdmap e746: 12 total, 12 up, 12 in 2023-05-08T09:17:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:13 smithi133 ceph-mon[125939]: pgmap v10708: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 221 KiB/s wr, 26 op/s 2023-05-08T09:17:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:13 smithi096 ceph-mon[124666]: pgmap v10708: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 221 KiB/s wr, 26 op/s 2023-05-08T09:17:13.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:13 smithi186 ceph-mon[126480]: pgmap v10708: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 221 KiB/s wr, 26 op/s 2023-05-08T09:17:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19973.020498 secs 2023-05-08T09:17:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19973.020498 secs 2023-05-08T09:17:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19973.020498 secs 2023-05-08T09:17:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19973.576813 secs 2023-05-08T09:17:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:15 smithi133 ceph-mon[125939]: pgmap v10709: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 221 KiB/s wr, 26 op/s 2023-05-08T09:17:15.510 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19973.576813 secs 2023-05-08T09:17:15.510 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:15 smithi096 ceph-mon[124666]: pgmap v10709: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 221 KiB/s wr, 26 op/s 2023-05-08T09:17:15.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19973.576813 secs 2023-05-08T09:17:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:15 smithi186 ceph-mon[126480]: pgmap v10709: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 221 KiB/s wr, 26 op/s 2023-05-08T09:17:16.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19974.863231 secs 2023-05-08T09:17:16.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19974.863231 secs 2023-05-08T09:17:16.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19974.863231 secs 2023-05-08T09:17:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:17 smithi133 ceph-mon[125939]: pgmap v10710: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 167 KiB/s wr, 8 op/s 2023-05-08T09:17:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:17 smithi096 ceph-mon[124666]: pgmap v10710: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 167 KiB/s wr, 8 op/s 2023-05-08T09:17:17.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:17 smithi186 ceph-mon[126480]: pgmap v10710: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 167 KiB/s wr, 8 op/s 2023-05-08T09:17:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:19 smithi186 ceph-mon[126480]: pgmap v10711: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 167 KiB/s wr, 8 op/s 2023-05-08T09:17:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:19 smithi186 ceph-mon[126480]: osdmap e747: 12 total, 12 up, 12 in 2023-05-08T09:17:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:19 smithi133 ceph-mon[125939]: pgmap v10711: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 167 KiB/s wr, 8 op/s 2023-05-08T09:17:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:19 smithi133 ceph-mon[125939]: osdmap e747: 12 total, 12 up, 12 in 2023-05-08T09:17:19.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:19 smithi096 ceph-mon[124666]: pgmap v10711: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 167 KiB/s wr, 8 op/s 2023-05-08T09:17:19.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:19 smithi096 ceph-mon[124666]: osdmap e747: 12 total, 12 up, 12 in 2023-05-08T09:17:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19978.020616 secs 2023-05-08T09:17:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19978.576941 secs 2023-05-08T09:17:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19978.020616 secs 2023-05-08T09:17:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19978.576941 secs 2023-05-08T09:17:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19978.020616 secs 2023-05-08T09:17:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19978.576941 secs 2023-05-08T09:17:21.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:21 smithi186 ceph-mon[126480]: pgmap v10713: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 69 KiB/s wr, 8 op/s 2023-05-08T09:17:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19979.863356 secs 2023-05-08T09:17:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:21 smithi133 ceph-mon[125939]: pgmap v10713: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 69 KiB/s wr, 8 op/s 2023-05-08T09:17:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19979.863356 secs 2023-05-08T09:17:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:21 smithi096 ceph-mon[124666]: pgmap v10713: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 69 KiB/s wr, 8 op/s 2023-05-08T09:17:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19979.863356 secs 2023-05-08T09:17:23.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:23 smithi186 ceph-mon[126480]: pgmap v10714: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 61 KiB/s wr, 7 op/s 2023-05-08T09:17:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:23 smithi133 ceph-mon[125939]: pgmap v10714: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 61 KiB/s wr, 7 op/s 2023-05-08T09:17:23.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:23 smithi096 ceph-mon[124666]: pgmap v10714: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 61 KiB/s wr, 7 op/s 2023-05-08T09:17:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19983.020696 secs 2023-05-08T09:17:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19983.577084 secs 2023-05-08T09:17:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:25 smithi186 ceph-mon[126480]: pgmap v10715: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 61 KiB/s wr, 7 op/s 2023-05-08T09:17:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19983.020696 secs 2023-05-08T09:17:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19983.577084 secs 2023-05-08T09:17:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:25 smithi133 ceph-mon[125939]: pgmap v10715: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 61 KiB/s wr, 7 op/s 2023-05-08T09:17:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19983.020696 secs 2023-05-08T09:17:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19983.577084 secs 2023-05-08T09:17:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:25 smithi096 ceph-mon[124666]: pgmap v10715: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 61 KiB/s wr, 7 op/s 2023-05-08T09:17:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19984.863431 secs 2023-05-08T09:17:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19984.863431 secs 2023-05-08T09:17:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19984.863431 secs 2023-05-08T09:17:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:27 smithi186 ceph-mon[126480]: pgmap v10716: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 61 KiB/s wr, 7 op/s 2023-05-08T09:17:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:27 smithi133 ceph-mon[125939]: pgmap v10716: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 61 KiB/s wr, 7 op/s 2023-05-08T09:17:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:27 smithi096 ceph-mon[124666]: pgmap v10716: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 61 KiB/s wr, 7 op/s 2023-05-08T09:17:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:29 smithi186 ceph-mon[126480]: pgmap v10717: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 61 KiB/s wr, 7 op/s 2023-05-08T09:17:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:29 smithi133 ceph-mon[125939]: pgmap v10717: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 61 KiB/s wr, 7 op/s 2023-05-08T09:17:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:29 smithi096 ceph-mon[124666]: pgmap v10717: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 61 KiB/s wr, 7 op/s 2023-05-08T09:17:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19988.020846 secs 2023-05-08T09:17:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19988.577190 secs 2023-05-08T09:17:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19988.020846 secs 2023-05-08T09:17:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19988.577190 secs 2023-05-08T09:17:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19988.020846 secs 2023-05-08T09:17:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19988.577190 secs 2023-05-08T09:17:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:31 smithi186 ceph-mon[126480]: pgmap v10718: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 9 op/s 2023-05-08T09:17:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19989.863505 secs 2023-05-08T09:17:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:31 smithi133 ceph-mon[125939]: pgmap v10718: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 9 op/s 2023-05-08T09:17:31.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19989.863505 secs 2023-05-08T09:17:31.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:31 smithi096 ceph-mon[124666]: pgmap v10718: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 9 op/s 2023-05-08T09:17:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19989.863505 secs 2023-05-08T09:17:33.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:33 smithi186 ceph-mon[126480]: pgmap v10719: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 6 op/s 2023-05-08T09:17:33.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:33 smithi133 ceph-mon[125939]: pgmap v10719: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 6 op/s 2023-05-08T09:17:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:33 smithi096 ceph-mon[124666]: pgmap v10719: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 6 op/s 2023-05-08T09:17:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19993.020911 secs 2023-05-08T09:17:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19993.020911 secs 2023-05-08T09:17:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19993.020911 secs 2023-05-08T09:17:35.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19993.577302 secs 2023-05-08T09:17:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:35 smithi186 ceph-mon[126480]: pgmap v10720: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 6 op/s 2023-05-08T09:17:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19993.577302 secs 2023-05-08T09:17:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:35 smithi133 ceph-mon[125939]: pgmap v10720: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 6 op/s 2023-05-08T09:17:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19993.577302 secs 2023-05-08T09:17:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:35 smithi096 ceph-mon[124666]: pgmap v10720: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 6 op/s 2023-05-08T09:17:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19994.863571 secs 2023-05-08T09:17:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19994.863571 secs 2023-05-08T09:17:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19994.863571 secs 2023-05-08T09:17:37.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:37 smithi186 ceph-mon[126480]: pgmap v10721: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 10 op/s 2023-05-08T09:17:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:37 smithi133 ceph-mon[125939]: pgmap v10721: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 10 op/s 2023-05-08T09:17:37.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:37 smithi096 ceph-mon[124666]: pgmap v10721: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 10 op/s 2023-05-08T09:17:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:39 smithi186 ceph-mon[126480]: pgmap v10722: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 62 KiB/s wr, 7 op/s 2023-05-08T09:17:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19998.021033 secs 2023-05-08T09:17:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:39 smithi133 ceph-mon[125939]: pgmap v10722: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 62 KiB/s wr, 7 op/s 2023-05-08T09:17:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19998.021033 secs 2023-05-08T09:17:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:39 smithi096 ceph-mon[124666]: pgmap v10722: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 62 KiB/s wr, 7 op/s 2023-05-08T09:17:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19998.021033 secs 2023-05-08T09:17:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19998.577425 secs 2023-05-08T09:17:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19998.577425 secs 2023-05-08T09:17:40.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19998.577425 secs 2023-05-08T09:17:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:41 smithi186 ceph-mon[126480]: pgmap v10723: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 142 KiB/s wr, 10 op/s 2023-05-08T09:17:41.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 19999.863714 secs 2023-05-08T09:17:41.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:41 smithi133 ceph-mon[125939]: pgmap v10723: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 142 KiB/s wr, 10 op/s 2023-05-08T09:17:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 19999.863714 secs 2023-05-08T09:17:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:41 smithi096 ceph-mon[124666]: pgmap v10723: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 142 KiB/s wr, 10 op/s 2023-05-08T09:17:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 19999.863714 secs 2023-05-08T09:17:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:43 smithi186 ceph-mon[126480]: pgmap v10724: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 142 KiB/s wr, 7 op/s 2023-05-08T09:17:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:43 smithi133 ceph-mon[125939]: pgmap v10724: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 142 KiB/s wr, 7 op/s 2023-05-08T09:17:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:43 smithi096 ceph-mon[124666]: pgmap v10724: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 142 KiB/s wr, 7 op/s 2023-05-08T09:17:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20003.021170 secs 2023-05-08T09:17:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20003.021170 secs 2023-05-08T09:17:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20003.021170 secs 2023-05-08T09:17:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:45 smithi133 ceph-mon[125939]: pgmap v10725: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 142 KiB/s wr, 7 op/s 2023-05-08T09:17:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:45 smithi096 ceph-mon[124666]: pgmap v10725: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 142 KiB/s wr, 7 op/s 2023-05-08T09:17:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:45 smithi186 ceph-mon[126480]: pgmap v10725: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 142 KiB/s wr, 7 op/s 2023-05-08T09:17:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20004.863843 secs 2023-05-08T09:17:46.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20004.863843 secs 2023-05-08T09:17:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20004.863843 secs 2023-05-08T09:17:47.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:47 smithi133 ceph-mon[125939]: pgmap v10726: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 179 KiB/s wr, 11 op/s 2023-05-08T09:17:47.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:47 smithi096 ceph-mon[124666]: pgmap v10726: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 179 KiB/s wr, 11 op/s 2023-05-08T09:17:47.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:47 smithi186 ceph-mon[126480]: pgmap v10726: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 179 KiB/s wr, 11 op/s 2023-05-08T09:17:48.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:48 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:17:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:17:48.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:48 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:17:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:17:48.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:48 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:17:48.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:17:49.140 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:49 smithi186 ceph-mon[126480]: pgmap v10727: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 117 KiB/s wr, 7 op/s 2023-05-08T09:17:49.434 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:17:49.434 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:17:49.434 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:17:49.434 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20008.021262 secs 2023-05-08T09:17:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:49 smithi133 ceph-mon[125939]: pgmap v10727: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 117 KiB/s wr, 7 op/s 2023-05-08T09:17:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:17:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:17:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:17:49.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20008.021262 secs 2023-05-08T09:17:49.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:49 smithi096 ceph-mon[124666]: pgmap v10727: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 117 KiB/s wr, 7 op/s 2023-05-08T09:17:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:17:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:17:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:17:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20008.021262 secs 2023-05-08T09:17:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:51 smithi133 ceph-mon[125939]: pgmap v10728: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 532 KiB/s rd, 420 KiB/s wr, 13 op/s 2023-05-08T09:17:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:51 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:17:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:51 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:17:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:51 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:17:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:51 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:17:51.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:51 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:17:51.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:51 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:17:51.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:51 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T09:17:51.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:51 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T09:17:51.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:51 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:17:51.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:17:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:51 smithi096 ceph-mon[124666]: pgmap v10728: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 532 KiB/s rd, 420 KiB/s wr, 13 op/s 2023-05-08T09:17:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:51 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:17:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:51 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:17:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:51 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:17:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:51 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:17:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:51 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:17:52.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:51 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:17:52.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:51 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T09:17:52.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:51 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T09:17:52.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:51 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:17:52.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:17:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:51 smithi186 ceph-mon[126480]: pgmap v10728: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 532 KiB/s rd, 420 KiB/s wr, 13 op/s 2023-05-08T09:17:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:51 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:17:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:51 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:17:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:51 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:17:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:51 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:17:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:51 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:17:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:51 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:17:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:51 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T09:17:52.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:51 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T09:17:52.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:51 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:17:52.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:17:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:17:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:17:53.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:17:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:17:53.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:17:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:17:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:53 smithi133 ceph-mon[125939]: pgmap v10729: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 340 KiB/s wr, 10 op/s 2023-05-08T09:17:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:53 smithi096 ceph-mon[124666]: pgmap v10729: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 340 KiB/s wr, 10 op/s 2023-05-08T09:17:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:53 smithi186 ceph-mon[126480]: pgmap v10729: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 340 KiB/s wr, 10 op/s 2023-05-08T09:17:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20013.021384 secs 2023-05-08T09:17:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20013.021384 secs 2023-05-08T09:17:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20013.021384 secs 2023-05-08T09:17:55.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:55 smithi133 ceph-mon[125939]: pgmap v10730: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 340 KiB/s wr, 10 op/s 2023-05-08T09:17:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:55 smithi096 ceph-mon[124666]: pgmap v10730: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 340 KiB/s wr, 10 op/s 2023-05-08T09:17:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:55 smithi186 ceph-mon[126480]: pgmap v10730: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 340 KiB/s wr, 10 op/s 2023-05-08T09:17:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:57 smithi133 ceph-mon[125939]: pgmap v10731: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 505 KiB/s wr, 16 op/s 2023-05-08T09:17:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:57 smithi096 ceph-mon[124666]: pgmap v10731: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 505 KiB/s wr, 16 op/s 2023-05-08T09:17:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:57 smithi186 ceph-mon[126480]: pgmap v10731: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 505 KiB/s wr, 16 op/s 2023-05-08T09:17:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:58 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:17:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:58 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:17:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:58 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:17:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:59 smithi133 ceph-mon[125939]: pgmap v10732: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 467 KiB/s wr, 11 op/s 2023-05-08T09:17:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20018.021521 secs 2023-05-08T09:17:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:17:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20018.577830 secs 2023-05-08T09:18:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:59 smithi096 ceph-mon[124666]: pgmap v10732: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 467 KiB/s wr, 11 op/s 2023-05-08T09:18:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20018.021521 secs 2023-05-08T09:18:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:17:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20018.577830 secs 2023-05-08T09:18:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:59 smithi186 ceph-mon[126480]: pgmap v10732: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 467 KiB/s wr, 11 op/s 2023-05-08T09:18:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20018.021521 secs 2023-05-08T09:18:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:17:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20018.577830 secs 2023-05-08T09:18:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:18:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:18:01.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:18:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:18:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:18:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:18:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:01 smithi133 ceph-mon[125939]: pgmap v10733: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 635 KiB/s wr, 16 op/s 2023-05-08T09:18:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20019.864212 secs 2023-05-08T09:18:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:01 smithi096 ceph-mon[124666]: pgmap v10733: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 635 KiB/s wr, 16 op/s 2023-05-08T09:18:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20019.864212 secs 2023-05-08T09:18:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:01 smithi186 ceph-mon[126480]: pgmap v10733: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 635 KiB/s wr, 16 op/s 2023-05-08T09:18:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20019.864212 secs 2023-05-08T09:18:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:03 smithi133 ceph-mon[125939]: pgmap v10734: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 333 KiB/s rd, 333 KiB/s wr, 10 op/s 2023-05-08T09:18:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:03 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:18:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:03 smithi096 ceph-mon[124666]: pgmap v10734: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 333 KiB/s rd, 333 KiB/s wr, 10 op/s 2023-05-08T09:18:04.144 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:03 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:18:04.146 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:03 smithi186 ceph-mon[126480]: pgmap v10734: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 333 KiB/s rd, 333 KiB/s wr, 10 op/s 2023-05-08T09:18:04.146 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:03 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:18:05.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20023.021638 secs 2023-05-08T09:18:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20023.577948 secs 2023-05-08T09:18:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:05 smithi186 ceph-mon[126480]: pgmap v10735: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 333 KiB/s rd, 333 KiB/s wr, 10 op/s 2023-05-08T09:18:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:18:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:18:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20023.021638 secs 2023-05-08T09:18:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20023.577948 secs 2023-05-08T09:18:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:05 smithi133 ceph-mon[125939]: pgmap v10735: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 333 KiB/s rd, 333 KiB/s wr, 10 op/s 2023-05-08T09:18:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:18:05.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:18:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20023.021638 secs 2023-05-08T09:18:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20023.577948 secs 2023-05-08T09:18:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:05 smithi096 ceph-mon[124666]: pgmap v10735: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 333 KiB/s rd, 333 KiB/s wr, 10 op/s 2023-05-08T09:18:05.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:18:05.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:18:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20024.864331 secs 2023-05-08T09:18:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20024.864331 secs 2023-05-08T09:18:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20024.864331 secs 2023-05-08T09:18:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:07 smithi186 ceph-mon[126480]: pgmap v10736: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 378 KiB/s wr, 28 op/s 2023-05-08T09:18:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:07 smithi133 ceph-mon[125939]: pgmap v10736: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 378 KiB/s wr, 28 op/s 2023-05-08T09:18:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:07 smithi096 ceph-mon[124666]: pgmap v10736: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 378 KiB/s wr, 28 op/s 2023-05-08T09:18:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:08 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:18:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:08 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:18:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:08 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:18:09.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:09 smithi186 ceph-mon[126480]: pgmap v10737: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 213 KiB/s wr, 22 op/s 2023-05-08T09:18:09.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:09 smithi133 ceph-mon[125939]: pgmap v10737: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 213 KiB/s wr, 22 op/s 2023-05-08T09:18:09.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:09 smithi096 ceph-mon[124666]: pgmap v10737: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 213 KiB/s wr, 22 op/s 2023-05-08T09:18:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20028.021757 secs 2023-05-08T09:18:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20028.578082 secs 2023-05-08T09:18:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20028.021757 secs 2023-05-08T09:18:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20028.578082 secs 2023-05-08T09:18:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20028.021757 secs 2023-05-08T09:18:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20028.578082 secs 2023-05-08T09:18:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:11 smithi186 ceph-mon[126480]: pgmap v10738: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 284 KiB/s wr, 25 op/s 2023-05-08T09:18:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20029.864488 secs 2023-05-08T09:18:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:11 smithi133 ceph-mon[125939]: pgmap v10738: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 284 KiB/s wr, 25 op/s 2023-05-08T09:18:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20029.864488 secs 2023-05-08T09:18:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:11 smithi096 ceph-mon[124666]: pgmap v10738: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 284 KiB/s wr, 25 op/s 2023-05-08T09:18:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20029.864488 secs 2023-05-08T09:18:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:12 smithi186 ceph-mon[126480]: osdmap e748: 12 total, 12 up, 12 in 2023-05-08T09:18:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:12 smithi133 ceph-mon[125939]: osdmap e748: 12 total, 12 up, 12 in 2023-05-08T09:18:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:12 smithi096 ceph-mon[124666]: osdmap e748: 12 total, 12 up, 12 in 2023-05-08T09:18:13.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:13 smithi186 ceph-mon[126480]: pgmap v10740: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 139 KiB/s wr, 24 op/s 2023-05-08T09:18:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:13 smithi133 ceph-mon[125939]: pgmap v10740: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 139 KiB/s wr, 24 op/s 2023-05-08T09:18:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:13 smithi096 ceph-mon[124666]: pgmap v10740: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 139 KiB/s wr, 24 op/s 2023-05-08T09:18:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20033.021880 secs 2023-05-08T09:18:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20033.021880 secs 2023-05-08T09:18:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20033.021880 secs 2023-05-08T09:18:15.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20033.578201 secs 2023-05-08T09:18:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:15 smithi186 ceph-mon[126480]: pgmap v10741: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 139 KiB/s wr, 24 op/s 2023-05-08T09:18:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20033.578201 secs 2023-05-08T09:18:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:15 smithi133 ceph-mon[125939]: pgmap v10741: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 139 KiB/s wr, 24 op/s 2023-05-08T09:18:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20033.578201 secs 2023-05-08T09:18:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:15 smithi096 ceph-mon[124666]: pgmap v10741: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 139 KiB/s wr, 24 op/s 2023-05-08T09:18:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20034.864608 secs 2023-05-08T09:18:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20034.864608 secs 2023-05-08T09:18:16.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20034.864608 secs 2023-05-08T09:18:17.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:17 smithi186 ceph-mon[126480]: pgmap v10742: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 85 KiB/s wr, 6 op/s 2023-05-08T09:18:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:17 smithi133 ceph-mon[125939]: pgmap v10742: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 85 KiB/s wr, 6 op/s 2023-05-08T09:18:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:17 smithi096 ceph-mon[124666]: pgmap v10742: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 85 KiB/s wr, 6 op/s 2023-05-08T09:18:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:19 smithi186 ceph-mon[126480]: pgmap v10743: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 85 KiB/s wr, 6 op/s 2023-05-08T09:18:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:19 smithi186 ceph-mon[126480]: osdmap e749: 12 total, 12 up, 12 in 2023-05-08T09:18:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:19 smithi133 ceph-mon[125939]: pgmap v10743: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 85 KiB/s wr, 6 op/s 2023-05-08T09:18:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:19 smithi133 ceph-mon[125939]: osdmap e749: 12 total, 12 up, 12 in 2023-05-08T09:18:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:19 smithi096 ceph-mon[124666]: pgmap v10743: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 85 KiB/s wr, 6 op/s 2023-05-08T09:18:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:19 smithi096 ceph-mon[124666]: osdmap e749: 12 total, 12 up, 12 in 2023-05-08T09:18:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20038.022008 secs 2023-05-08T09:18:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20038.578316 secs 2023-05-08T09:18:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20038.022008 secs 2023-05-08T09:18:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20038.578316 secs 2023-05-08T09:18:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20038.022008 secs 2023-05-08T09:18:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20038.578316 secs 2023-05-08T09:18:21.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:21 smithi186 ceph-mon[126480]: pgmap v10745: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 68 KiB/s wr, 7 op/s 2023-05-08T09:18:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20039.864751 secs 2023-05-08T09:18:21.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:21 smithi133 ceph-mon[125939]: pgmap v10745: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 68 KiB/s wr, 7 op/s 2023-05-08T09:18:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20039.864751 secs 2023-05-08T09:18:21.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:21 smithi096 ceph-mon[124666]: pgmap v10745: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 68 KiB/s wr, 7 op/s 2023-05-08T09:18:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20039.864751 secs 2023-05-08T09:18:23.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:23 smithi186 ceph-mon[126480]: pgmap v10746: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 61 KiB/s wr, 6 op/s 2023-05-08T09:18:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:23 smithi133 ceph-mon[125939]: pgmap v10746: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 61 KiB/s wr, 6 op/s 2023-05-08T09:18:23.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:23 smithi096 ceph-mon[124666]: pgmap v10746: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 61 KiB/s wr, 6 op/s 2023-05-08T09:18:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20043.022108 secs 2023-05-08T09:18:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20043.578424 secs 2023-05-08T09:18:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:25 smithi186 ceph-mon[126480]: pgmap v10747: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 61 KiB/s wr, 6 op/s 2023-05-08T09:18:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20043.022108 secs 2023-05-08T09:18:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20043.578424 secs 2023-05-08T09:18:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:25 smithi133 ceph-mon[125939]: pgmap v10747: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 61 KiB/s wr, 6 op/s 2023-05-08T09:18:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20043.022108 secs 2023-05-08T09:18:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20043.578424 secs 2023-05-08T09:18:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:25 smithi096 ceph-mon[124666]: pgmap v10747: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 61 KiB/s wr, 6 op/s 2023-05-08T09:18:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20044.864847 secs 2023-05-08T09:18:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20044.864847 secs 2023-05-08T09:18:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20044.864847 secs 2023-05-08T09:18:27.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:27 smithi186 ceph-mon[126480]: pgmap v10748: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 61 KiB/s wr, 7 op/s 2023-05-08T09:18:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:27 smithi133 ceph-mon[125939]: pgmap v10748: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 61 KiB/s wr, 7 op/s 2023-05-08T09:18:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:27 smithi096 ceph-mon[124666]: pgmap v10748: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 61 KiB/s wr, 7 op/s 2023-05-08T09:18:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:29 smithi186 ceph-mon[126480]: pgmap v10749: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 61 KiB/s wr, 7 op/s 2023-05-08T09:18:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:29 smithi133 ceph-mon[125939]: pgmap v10749: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 61 KiB/s wr, 7 op/s 2023-05-08T09:18:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:29 smithi096 ceph-mon[124666]: pgmap v10749: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 61 KiB/s wr, 7 op/s 2023-05-08T09:18:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20048.022224 secs 2023-05-08T09:18:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20048.578515 secs 2023-05-08T09:18:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20048.022224 secs 2023-05-08T09:18:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20048.578515 secs 2023-05-08T09:18:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20048.022224 secs 2023-05-08T09:18:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20048.578515 secs 2023-05-08T09:18:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:31 smithi186 ceph-mon[126480]: pgmap v10750: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 51 KiB/s wr, 9 op/s 2023-05-08T09:18:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20049.864925 secs 2023-05-08T09:18:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:31 smithi133 ceph-mon[125939]: pgmap v10750: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 51 KiB/s wr, 9 op/s 2023-05-08T09:18:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20049.864925 secs 2023-05-08T09:18:31.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:31 smithi096 ceph-mon[124666]: pgmap v10750: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 51 KiB/s wr, 9 op/s 2023-05-08T09:18:31.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20049.864925 secs 2023-05-08T09:18:33.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:33 smithi186 ceph-mon[126480]: pgmap v10751: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 6 op/s 2023-05-08T09:18:33.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:33 smithi133 ceph-mon[125939]: pgmap v10751: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 6 op/s 2023-05-08T09:18:33.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:33 smithi096 ceph-mon[124666]: pgmap v10751: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 6 op/s 2023-05-08T09:18:34.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20053.022349 secs 2023-05-08T09:18:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20053.022349 secs 2023-05-08T09:18:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20053.022349 secs 2023-05-08T09:18:35.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20053.578598 secs 2023-05-08T09:18:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:35 smithi186 ceph-mon[126480]: pgmap v10752: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 6 op/s 2023-05-08T09:18:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20053.578598 secs 2023-05-08T09:18:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:35 smithi133 ceph-mon[125939]: pgmap v10752: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 6 op/s 2023-05-08T09:18:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20053.578598 secs 2023-05-08T09:18:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:35 smithi096 ceph-mon[124666]: pgmap v10752: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 6 op/s 2023-05-08T09:18:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20054.865046 secs 2023-05-08T09:18:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20054.865046 secs 2023-05-08T09:18:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20054.865046 secs 2023-05-08T09:18:37.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:37 smithi186 ceph-mon[126480]: pgmap v10753: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 938 B/s wr, 10 op/s 2023-05-08T09:18:37.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:37 smithi133 ceph-mon[125939]: pgmap v10753: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 938 B/s wr, 10 op/s 2023-05-08T09:18:37.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:37 smithi096 ceph-mon[124666]: pgmap v10753: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 938 B/s wr, 10 op/s 2023-05-08T09:18:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:39 smithi186 ceph-mon[126480]: pgmap v10754: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 853 B/s wr, 7 op/s 2023-05-08T09:18:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:39 smithi133 ceph-mon[125939]: pgmap v10754: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 853 B/s wr, 7 op/s 2023-05-08T09:18:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:39 smithi096 ceph-mon[124666]: pgmap v10754: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 853 B/s wr, 7 op/s 2023-05-08T09:18:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20058.022445 secs 2023-05-08T09:18:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20058.578691 secs 2023-05-08T09:18:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20058.022445 secs 2023-05-08T09:18:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20058.578691 secs 2023-05-08T09:18:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20058.022445 secs 2023-05-08T09:18:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20058.578691 secs 2023-05-08T09:18:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:41 smithi186 ceph-mon[126480]: pgmap v10755: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 150 KiB/s wr, 10 op/s 2023-05-08T09:18:41.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20059.865164 secs 2023-05-08T09:18:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:41 smithi133 ceph-mon[125939]: pgmap v10755: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 150 KiB/s wr, 10 op/s 2023-05-08T09:18:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20059.865164 secs 2023-05-08T09:18:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:41 smithi096 ceph-mon[124666]: pgmap v10755: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 150 KiB/s wr, 10 op/s 2023-05-08T09:18:41.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20059.865164 secs 2023-05-08T09:18:43.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:43 smithi186 ceph-mon[126480]: pgmap v10756: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 150 KiB/s wr, 7 op/s 2023-05-08T09:18:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:43 smithi133 ceph-mon[125939]: pgmap v10756: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 150 KiB/s wr, 7 op/s 2023-05-08T09:18:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:43 smithi096 ceph-mon[124666]: pgmap v10756: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 150 KiB/s wr, 7 op/s 2023-05-08T09:18:45.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20063.022569 secs 2023-05-08T09:18:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:45 smithi186 ceph-mon[126480]: pgmap v10757: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 150 KiB/s wr, 7 op/s 2023-05-08T09:18:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20063.022569 secs 2023-05-08T09:18:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:45 smithi133 ceph-mon[125939]: pgmap v10757: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 150 KiB/s wr, 7 op/s 2023-05-08T09:18:45.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20063.022569 secs 2023-05-08T09:18:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:45 smithi096 ceph-mon[124666]: pgmap v10757: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 150 KiB/s wr, 7 op/s 2023-05-08T09:18:46.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20064.865285 secs 2023-05-08T09:18:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20064.865285 secs 2023-05-08T09:18:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20064.865285 secs 2023-05-08T09:18:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:47 smithi186 ceph-mon[126480]: pgmap v10758: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 168 KiB/s wr, 11 op/s 2023-05-08T09:18:47.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:47 smithi133 ceph-mon[125939]: pgmap v10758: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 168 KiB/s wr, 11 op/s 2023-05-08T09:18:47.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:47 smithi096 ceph-mon[124666]: pgmap v10758: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 168 KiB/s wr, 11 op/s 2023-05-08T09:18:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:18:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:18:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:18:49.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:49 smithi186 ceph-mon[126480]: pgmap v10759: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 167 KiB/s wr, 7 op/s 2023-05-08T09:18:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:18:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:18:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:18:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20068.022679 secs 2023-05-08T09:18:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:49 smithi133 ceph-mon[125939]: pgmap v10759: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 167 KiB/s wr, 7 op/s 2023-05-08T09:18:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:18:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:18:49.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:18:49.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20068.022679 secs 2023-05-08T09:18:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:49 smithi096 ceph-mon[124666]: pgmap v10759: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 167 KiB/s wr, 7 op/s 2023-05-08T09:18:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:18:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:18:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:18:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20068.022679 secs 2023-05-08T09:18:51.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:51 smithi186 ceph-mon[126480]: pgmap v10760: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 503 KiB/s rd, 489 KiB/s wr, 13 op/s 2023-05-08T09:18:51.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20069.865406 secs 2023-05-08T09:18:51.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:51 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:18:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:51 smithi133 ceph-mon[125939]: pgmap v10760: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 503 KiB/s rd, 489 KiB/s wr, 13 op/s 2023-05-08T09:18:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20069.865406 secs 2023-05-08T09:18:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:51 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:18:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:51 smithi096 ceph-mon[124666]: pgmap v10760: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 503 KiB/s rd, 489 KiB/s wr, 13 op/s 2023-05-08T09:18:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20069.865406 secs 2023-05-08T09:18:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:51 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:18:52.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:18:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:18:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:52 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:18:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:18:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:52 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T09:18:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:52 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T09:18:52.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:52 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:18:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:18:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:18:52.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:52 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:18:52.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:18:52.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:52 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T09:18:52.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:52 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T09:18:52.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:52 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:18:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:18:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:18:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:52 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:18:52.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:18:52.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:52 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T09:18:52.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:52 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T09:18:52.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:52 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:18:53.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:53 smithi186 ceph-mon[126480]: pgmap v10761: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 352 KiB/s rd, 340 KiB/s wr, 9 op/s 2023-05-08T09:18:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:53 smithi133 ceph-mon[125939]: pgmap v10761: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 352 KiB/s rd, 340 KiB/s wr, 9 op/s 2023-05-08T09:18:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:53 smithi096 ceph-mon[124666]: pgmap v10761: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 352 KiB/s rd, 340 KiB/s wr, 9 op/s 2023-05-08T09:18:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20073.022794 secs 2023-05-08T09:18:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20073.579054 secs 2023-05-08T09:18:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20073.022794 secs 2023-05-08T09:18:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20073.579054 secs 2023-05-08T09:18:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20073.022794 secs 2023-05-08T09:18:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20073.579054 secs 2023-05-08T09:18:55.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:55 smithi186 ceph-mon[126480]: pgmap v10762: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 352 KiB/s rd, 340 KiB/s wr, 9 op/s 2023-05-08T09:18:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:55 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:18:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:55 smithi133 ceph-mon[125939]: pgmap v10762: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 352 KiB/s rd, 340 KiB/s wr, 9 op/s 2023-05-08T09:18:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:55 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:18:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:55 smithi096 ceph-mon[124666]: pgmap v10762: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 352 KiB/s rd, 340 KiB/s wr, 9 op/s 2023-05-08T09:18:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:55 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:18:56.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:18:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:18:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:18:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:18:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:18:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:18:57.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:18:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:18:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:18:57.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:57 smithi186 ceph-mon[126480]: pgmap v10763: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 450 KiB/s rd, 437 KiB/s wr, 15 op/s 2023-05-08T09:18:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:57 smithi133 ceph-mon[125939]: pgmap v10763: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 450 KiB/s rd, 437 KiB/s wr, 15 op/s 2023-05-08T09:18:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:57 smithi096 ceph-mon[124666]: pgmap v10763: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 450 KiB/s rd, 437 KiB/s wr, 15 op/s 2023-05-08T09:18:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:59 smithi186 ceph-mon[126480]: pgmap v10764: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 431 KiB/s rd, 420 KiB/s wr, 10 op/s 2023-05-08T09:18:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20078.022919 secs 2023-05-08T09:18:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:18:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20078.579167 secs 2023-05-08T09:18:59.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:59 smithi133 ceph-mon[125939]: pgmap v10764: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 431 KiB/s rd, 420 KiB/s wr, 10 op/s 2023-05-08T09:19:00.206 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20078.022919 secs 2023-05-08T09:19:00.207 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:18:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20078.579167 secs 2023-05-08T09:19:00.209 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:59 smithi096 ceph-mon[124666]: pgmap v10764: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 431 KiB/s rd, 420 KiB/s wr, 10 op/s 2023-05-08T09:19:00.209 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20078.022919 secs 2023-05-08T09:19:00.209 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:18:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20078.579167 secs 2023-05-08T09:19:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:01 smithi186 ceph-mon[126480]: pgmap v10765: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 669 KiB/s rd, 657 KiB/s wr, 15 op/s 2023-05-08T09:19:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20079.865662 secs 2023-05-08T09:19:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:01 smithi133 ceph-mon[125939]: pgmap v10765: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 669 KiB/s rd, 657 KiB/s wr, 15 op/s 2023-05-08T09:19:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20079.865662 secs 2023-05-08T09:19:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:01 smithi096 ceph-mon[124666]: pgmap v10765: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 669 KiB/s rd, 657 KiB/s wr, 15 op/s 2023-05-08T09:19:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20079.865662 secs 2023-05-08T09:19:03.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:03 smithi186 ceph-mon[126480]: pgmap v10766: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 334 KiB/s wr, 10 op/s 2023-05-08T09:19:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:03 smithi133 ceph-mon[125939]: pgmap v10766: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 334 KiB/s wr, 10 op/s 2023-05-08T09:19:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:03 smithi096 ceph-mon[124666]: pgmap v10766: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 334 KiB/s wr, 10 op/s 2023-05-08T09:19:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20083.023035 secs 2023-05-08T09:19:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20083.579283 secs 2023-05-08T09:19:04.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:04 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:19:04.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:04 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:19:04.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:04 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:19:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20083.023035 secs 2023-05-08T09:19:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20083.579283 secs 2023-05-08T09:19:04.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:04 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:19:04.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:04 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:19:04.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:04 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:19:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20083.023035 secs 2023-05-08T09:19:05.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20083.579283 secs 2023-05-08T09:19:05.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:04 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:19:05.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:04 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:19:05.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:04 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:19:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:05 smithi186 ceph-mon[126480]: pgmap v10767: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 334 KiB/s wr, 10 op/s 2023-05-08T09:19:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:05 smithi133 ceph-mon[125939]: pgmap v10767: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 334 KiB/s wr, 10 op/s 2023-05-08T09:19:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:05 smithi096 ceph-mon[124666]: pgmap v10767: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 334 KiB/s wr, 10 op/s 2023-05-08T09:19:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20084.865750 secs 2023-05-08T09:19:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20084.865750 secs 2023-05-08T09:19:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20084.865750 secs 2023-05-08T09:19:07.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:07 smithi186 ceph-mon[126480]: pgmap v10768: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 379 KiB/s wr, 28 op/s 2023-05-08T09:19:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:07 smithi133 ceph-mon[125939]: pgmap v10768: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 379 KiB/s wr, 28 op/s 2023-05-08T09:19:08.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:07 smithi096 ceph-mon[124666]: pgmap v10768: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 379 KiB/s wr, 28 op/s 2023-05-08T09:19:09.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:09 smithi186 ceph-mon[126480]: pgmap v10769: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 282 KiB/s wr, 22 op/s 2023-05-08T09:19:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:09 smithi133 ceph-mon[125939]: pgmap v10769: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 282 KiB/s wr, 22 op/s 2023-05-08T09:19:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:09 smithi096 ceph-mon[124666]: pgmap v10769: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 282 KiB/s wr, 22 op/s 2023-05-08T09:19:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20088.023152 secs 2023-05-08T09:19:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20088.579398 secs 2023-05-08T09:19:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20088.023152 secs 2023-05-08T09:19:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20088.579398 secs 2023-05-08T09:19:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20088.023152 secs 2023-05-08T09:19:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20088.579398 secs 2023-05-08T09:19:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:11 smithi186 ceph-mon[126480]: pgmap v10770: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 353 KiB/s wr, 25 op/s 2023-05-08T09:19:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20089.865864 secs 2023-05-08T09:19:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:11 smithi133 ceph-mon[125939]: pgmap v10770: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 353 KiB/s wr, 25 op/s 2023-05-08T09:19:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20089.865864 secs 2023-05-08T09:19:11.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:11 smithi096 ceph-mon[124666]: pgmap v10770: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 353 KiB/s wr, 25 op/s 2023-05-08T09:19:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20089.865864 secs 2023-05-08T09:19:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:12 smithi186 ceph-mon[126480]: osdmap e750: 12 total, 12 up, 12 in 2023-05-08T09:19:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:12 smithi133 ceph-mon[125939]: osdmap e750: 12 total, 12 up, 12 in 2023-05-08T09:19:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:12 smithi096 ceph-mon[124666]: osdmap e750: 12 total, 12 up, 12 in 2023-05-08T09:19:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:13 smithi186 ceph-mon[126480]: pgmap v10772: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 140 KiB/s wr, 24 op/s 2023-05-08T09:19:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:13 smithi133 ceph-mon[125939]: pgmap v10772: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 140 KiB/s wr, 24 op/s 2023-05-08T09:19:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:13 smithi096 ceph-mon[124666]: pgmap v10772: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 140 KiB/s wr, 24 op/s 2023-05-08T09:19:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20093.023296 secs 2023-05-08T09:19:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20093.023296 secs 2023-05-08T09:19:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20093.023296 secs 2023-05-08T09:19:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20093.579518 secs 2023-05-08T09:19:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:15 smithi186 ceph-mon[126480]: pgmap v10773: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 140 KiB/s wr, 24 op/s 2023-05-08T09:19:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20093.579518 secs 2023-05-08T09:19:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:15 smithi133 ceph-mon[125939]: pgmap v10773: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 140 KiB/s wr, 24 op/s 2023-05-08T09:19:15.509 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20093.579518 secs 2023-05-08T09:19:15.509 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:15 smithi096 ceph-mon[124666]: pgmap v10773: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 140 KiB/s wr, 24 op/s 2023-05-08T09:19:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20094.865983 secs 2023-05-08T09:19:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20094.865983 secs 2023-05-08T09:19:16.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20094.865983 secs 2023-05-08T09:19:17.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:17 smithi186 ceph-mon[126480]: pgmap v10774: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 86 KiB/s wr, 6 op/s 2023-05-08T09:19:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:17 smithi133 ceph-mon[125939]: pgmap v10774: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 86 KiB/s wr, 6 op/s 2023-05-08T09:19:17.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:17 smithi096 ceph-mon[124666]: pgmap v10774: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 86 KiB/s wr, 6 op/s 2023-05-08T09:19:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:19 smithi186 ceph-mon[126480]: pgmap v10775: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 86 KiB/s wr, 6 op/s 2023-05-08T09:19:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:19 smithi186 ceph-mon[126480]: osdmap e751: 12 total, 12 up, 12 in 2023-05-08T09:19:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:19 smithi133 ceph-mon[125939]: pgmap v10775: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 86 KiB/s wr, 6 op/s 2023-05-08T09:19:19.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:19 smithi133 ceph-mon[125939]: osdmap e751: 12 total, 12 up, 12 in 2023-05-08T09:19:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:19 smithi096 ceph-mon[124666]: pgmap v10775: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 86 KiB/s wr, 6 op/s 2023-05-08T09:19:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:19 smithi096 ceph-mon[124666]: osdmap e751: 12 total, 12 up, 12 in 2023-05-08T09:19:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20098.023415 secs 2023-05-08T09:19:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20098.579668 secs 2023-05-08T09:19:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20098.023415 secs 2023-05-08T09:19:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20098.579668 secs 2023-05-08T09:19:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20098.023415 secs 2023-05-08T09:19:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20098.579668 secs 2023-05-08T09:19:21.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:21 smithi186 ceph-mon[126480]: pgmap v10777: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 69 KiB/s wr, 7 op/s 2023-05-08T09:19:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20099.866102 secs 2023-05-08T09:19:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:21 smithi133 ceph-mon[125939]: pgmap v10777: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 69 KiB/s wr, 7 op/s 2023-05-08T09:19:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20099.866102 secs 2023-05-08T09:19:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:21 smithi096 ceph-mon[124666]: pgmap v10777: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 69 KiB/s wr, 7 op/s 2023-05-08T09:19:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20099.866102 secs 2023-05-08T09:19:23.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:23 smithi186 ceph-mon[126480]: pgmap v10778: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T09:19:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:23 smithi133 ceph-mon[125939]: pgmap v10778: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T09:19:23.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:23 smithi096 ceph-mon[124666]: pgmap v10778: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T09:19:25.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20103.023527 secs 2023-05-08T09:19:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20103.579758 secs 2023-05-08T09:19:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:25 smithi186 ceph-mon[126480]: pgmap v10779: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 8 op/s 2023-05-08T09:19:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20103.023527 secs 2023-05-08T09:19:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20103.579758 secs 2023-05-08T09:19:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:25 smithi133 ceph-mon[125939]: pgmap v10779: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 8 op/s 2023-05-08T09:19:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20103.023527 secs 2023-05-08T09:19:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20103.579758 secs 2023-05-08T09:19:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:25 smithi096 ceph-mon[124666]: pgmap v10779: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 8 op/s 2023-05-08T09:19:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20104.866250 secs 2023-05-08T09:19:26.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20104.866250 secs 2023-05-08T09:19:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20104.866250 secs 2023-05-08T09:19:27.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:27 smithi186 ceph-mon[126480]: pgmap v10780: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 61 KiB/s wr, 6 op/s 2023-05-08T09:19:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:27 smithi133 ceph-mon[125939]: pgmap v10780: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 61 KiB/s wr, 6 op/s 2023-05-08T09:19:27.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:27 smithi096 ceph-mon[124666]: pgmap v10780: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 61 KiB/s wr, 6 op/s 2023-05-08T09:19:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:29 smithi186 ceph-mon[126480]: pgmap v10781: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 61 KiB/s wr, 6 op/s 2023-05-08T09:19:29.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20108.023643 secs 2023-05-08T09:19:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:29 smithi133 ceph-mon[125939]: pgmap v10781: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 61 KiB/s wr, 6 op/s 2023-05-08T09:19:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20108.023643 secs 2023-05-08T09:19:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:29 smithi096 ceph-mon[124666]: pgmap v10781: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 61 KiB/s wr, 6 op/s 2023-05-08T09:19:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20108.023643 secs 2023-05-08T09:19:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20108.579871 secs 2023-05-08T09:19:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20108.579871 secs 2023-05-08T09:19:30.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20108.579871 secs 2023-05-08T09:19:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:31 smithi186 ceph-mon[126480]: pgmap v10782: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 51 KiB/s wr, 8 op/s 2023-05-08T09:19:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20109.866367 secs 2023-05-08T09:19:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:31 smithi133 ceph-mon[125939]: pgmap v10782: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 51 KiB/s wr, 8 op/s 2023-05-08T09:19:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20109.866367 secs 2023-05-08T09:19:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:31 smithi096 ceph-mon[124666]: pgmap v10782: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 51 KiB/s wr, 8 op/s 2023-05-08T09:19:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20109.866367 secs 2023-05-08T09:19:33.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:33 smithi186 ceph-mon[126480]: pgmap v10783: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T09:19:33.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:33 smithi133 ceph-mon[125939]: pgmap v10783: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T09:19:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:33 smithi096 ceph-mon[124666]: pgmap v10783: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T09:19:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20113.023731 secs 2023-05-08T09:19:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20113.023731 secs 2023-05-08T09:19:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20113.023731 secs 2023-05-08T09:19:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20113.580013 secs 2023-05-08T09:19:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:35 smithi133 ceph-mon[125939]: pgmap v10784: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 426 B/s wr, 6 op/s 2023-05-08T09:19:35.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20113.580013 secs 2023-05-08T09:19:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:35 smithi096 ceph-mon[124666]: pgmap v10784: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 426 B/s wr, 6 op/s 2023-05-08T09:19:35.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20113.580013 secs 2023-05-08T09:19:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:35 smithi186 ceph-mon[126480]: pgmap v10784: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 426 B/s wr, 6 op/s 2023-05-08T09:19:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20114.866441 secs 2023-05-08T09:19:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20114.866441 secs 2023-05-08T09:19:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20114.866441 secs 2023-05-08T09:19:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:37 smithi133 ceph-mon[125939]: pgmap v10785: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 938 B/s wr, 7 op/s 2023-05-08T09:19:37.513 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:37 smithi096 ceph-mon[124666]: pgmap v10785: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 938 B/s wr, 7 op/s 2023-05-08T09:19:37.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:37 smithi186 ceph-mon[126480]: pgmap v10785: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 938 B/s wr, 7 op/s 2023-05-08T09:19:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:39 smithi133 ceph-mon[125939]: pgmap v10786: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T09:19:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20118.023881 secs 2023-05-08T09:19:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:39 smithi096 ceph-mon[124666]: pgmap v10786: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T09:19:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20118.023881 secs 2023-05-08T09:19:39.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:39 smithi186 ceph-mon[126480]: pgmap v10786: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T09:19:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20118.023881 secs 2023-05-08T09:19:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20118.580129 secs 2023-05-08T09:19:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20118.580129 secs 2023-05-08T09:19:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20118.580129 secs 2023-05-08T09:19:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:41 smithi133 ceph-mon[125939]: pgmap v10787: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 82 KiB/s wr, 9 op/s 2023-05-08T09:19:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20119.866560 secs 2023-05-08T09:19:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:41 smithi096 ceph-mon[124666]: pgmap v10787: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 82 KiB/s wr, 9 op/s 2023-05-08T09:19:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20119.866560 secs 2023-05-08T09:19:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:41 smithi186 ceph-mon[126480]: pgmap v10787: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 82 KiB/s wr, 9 op/s 2023-05-08T09:19:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20119.866560 secs 2023-05-08T09:19:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:43 smithi133 ceph-mon[125939]: pgmap v10788: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 82 KiB/s wr, 6 op/s 2023-05-08T09:19:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:43 smithi096 ceph-mon[124666]: pgmap v10788: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 82 KiB/s wr, 6 op/s 2023-05-08T09:19:43.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:43 smithi186 ceph-mon[126480]: pgmap v10788: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 82 KiB/s wr, 6 op/s 2023-05-08T09:19:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20123.024017 secs 2023-05-08T09:19:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20123.024017 secs 2023-05-08T09:19:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20123.024017 secs 2023-05-08T09:19:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:45 smithi133 ceph-mon[125939]: pgmap v10789: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 117 KiB/s wr, 9 op/s 2023-05-08T09:19:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:45 smithi096 ceph-mon[124666]: pgmap v10789: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 117 KiB/s wr, 9 op/s 2023-05-08T09:19:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:45 smithi186 ceph-mon[126480]: pgmap v10789: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 117 KiB/s wr, 9 op/s 2023-05-08T09:19:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20124.866678 secs 2023-05-08T09:19:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20124.866678 secs 2023-05-08T09:19:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20124.866678 secs 2023-05-08T09:19:47.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:47 smithi133 ceph-mon[125939]: pgmap v10790: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 130 KiB/s wr, 9 op/s 2023-05-08T09:19:47.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:47 smithi096 ceph-mon[124666]: pgmap v10790: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 130 KiB/s wr, 9 op/s 2023-05-08T09:19:47.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:47 smithi186 ceph-mon[126480]: pgmap v10790: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 130 KiB/s wr, 9 op/s 2023-05-08T09:19:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:19:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:19:48.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:19:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:49 smithi133 ceph-mon[125939]: pgmap v10791: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 129 KiB/s wr, 7 op/s 2023-05-08T09:19:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:19:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:19:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:19:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20128.024134 secs 2023-05-08T09:19:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:49 smithi096 ceph-mon[124666]: pgmap v10791: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 129 KiB/s wr, 7 op/s 2023-05-08T09:19:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:19:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:19:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:19:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20128.024134 secs 2023-05-08T09:19:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:49 smithi186 ceph-mon[126480]: pgmap v10791: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 129 KiB/s wr, 7 op/s 2023-05-08T09:19:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:19:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:19:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:19:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20128.024134 secs 2023-05-08T09:19:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:51 smithi133 ceph-mon[125939]: pgmap v10792: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 423 KiB/s wr, 13 op/s 2023-05-08T09:19:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20129.866798 secs 2023-05-08T09:19:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:51 smithi096 ceph-mon[124666]: pgmap v10792: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 423 KiB/s wr, 13 op/s 2023-05-08T09:19:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20129.866798 secs 2023-05-08T09:19:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:51 smithi186 ceph-mon[126480]: pgmap v10792: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 423 KiB/s wr, 13 op/s 2023-05-08T09:19:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20129.866798 secs 2023-05-08T09:19:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:19:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:19:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:19:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:53 smithi133 ceph-mon[125939]: pgmap v10793: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 342 KiB/s wr, 10 op/s 2023-05-08T09:19:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:53 smithi096 ceph-mon[124666]: pgmap v10793: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 342 KiB/s wr, 10 op/s 2023-05-08T09:19:53.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:53 smithi186 ceph-mon[126480]: pgmap v10793: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 342 KiB/s wr, 10 op/s 2023-05-08T09:19:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20133.024255 secs 2023-05-08T09:19:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20133.024255 secs 2023-05-08T09:19:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20133.024255 secs 2023-05-08T09:19:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:55 smithi133 ceph-mon[125939]: pgmap v10794: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 580 KiB/s rd, 414 KiB/s wr, 12 op/s 2023-05-08T09:19:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:55 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:19:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:55 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:19:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:55 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:19:55.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:55 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:19:55.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:55 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:19:55.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:55 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:19:55.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:55 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:19:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:55 smithi096 ceph-mon[124666]: pgmap v10794: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 580 KiB/s rd, 414 KiB/s wr, 12 op/s 2023-05-08T09:19:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:55 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:19:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:55 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:19:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:55 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:19:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:55 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:19:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:55 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:19:55.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:55 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:19:55.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:55 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:19:55.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:55 smithi186 ceph-mon[126480]: pgmap v10794: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 580 KiB/s rd, 414 KiB/s wr, 12 op/s 2023-05-08T09:19:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:55 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:19:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:55 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:19:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:55 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:19:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:55 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:19:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:55 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:19:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:55 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:19:55.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:55 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:19:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:56 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:19:56.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:19:56.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:19:56.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:19:56.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:19:56.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:19:56.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:19:56.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:19:56.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:19:56.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:19:56.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:19:56.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:19:56.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:19:56.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:19:56.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:56 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T09:19:56.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:19:56.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:19:56.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:56 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T09:19:56.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:19:56.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:19:56.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:19:56.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:19:56.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:56 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T09:19:56.744 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:19:56.744 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:56 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T09:19:56.744 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:56 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi096 to 11413k 2023-05-08T09:19:56.744 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:56 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi096 to 11687923: error parsing value: Value '11687923' is below minimum 939524096 2023-05-08T09:19:56.744 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:19:56.744 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:19:56.744 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:56 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:19:56.745 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:19:56.745 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:56 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T09:19:56.745 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:56 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T09:19:56.745 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:56 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:19:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:56 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:19:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:19:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:19:56.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:19:56.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:19:56.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:19:56.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:19:56.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:19:56.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:19:56.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:19:56.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:19:56.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:19:56.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:19:56.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:19:56.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:56 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T09:19:56.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:19:56.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:19:56.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:56 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T09:19:56.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:19:56.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:19:56.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:19:56.759 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:19:56.759 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:56 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T09:19:56.759 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:19:56.759 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:56 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T09:19:56.759 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:56 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi096 to 11413k 2023-05-08T09:19:56.760 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:56 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi096 to 11687923: error parsing value: Value '11687923' is below minimum 939524096 2023-05-08T09:19:56.760 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:19:56.760 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:19:56.760 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:56 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:19:56.760 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:19:56.761 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:56 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T09:19:56.761 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:56 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T09:19:56.761 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:56 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:19:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:56 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:19:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:19:56.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:19:56.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:19:56.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:19:56.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:19:56.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:19:56.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:19:56.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:19:56.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:19:56.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:19:56.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:19:56.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:19:56.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:19:56.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:56 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T09:19:56.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:19:56.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:19:56.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:56 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T09:19:56.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:19:56.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:19:56.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:19:56.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:19:56.873 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:56 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T09:19:56.873 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:19:56.873 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:56 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T09:19:56.873 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:56 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi096 to 11413k 2023-05-08T09:19:56.873 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:56 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi096 to 11687923: error parsing value: Value '11687923' is below minimum 939524096 2023-05-08T09:19:56.873 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:19:56.874 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:19:56.874 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:56 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:19:56.874 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:19:56.874 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:56 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T09:19:56.874 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:56 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T09:19:56.874 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:56 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:19:57.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:57 smithi186 ceph-mon[126480]: pgmap v10795: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 473 KiB/s wr, 13 op/s 2023-05-08T09:19:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:57 smithi133 ceph-mon[125939]: pgmap v10795: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 473 KiB/s wr, 13 op/s 2023-05-08T09:19:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:57 smithi096 ceph-mon[124666]: pgmap v10795: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 473 KiB/s wr, 13 op/s 2023-05-08T09:19:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:59 smithi186 ceph-mon[126480]: pgmap v10796: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 534 KiB/s rd, 460 KiB/s wr, 11 op/s 2023-05-08T09:19:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20138.024381 secs 2023-05-08T09:19:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:19:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20138.580586 secs 2023-05-08T09:19:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:59 smithi133 ceph-mon[125939]: pgmap v10796: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 534 KiB/s rd, 460 KiB/s wr, 11 op/s 2023-05-08T09:19:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20138.024381 secs 2023-05-08T09:19:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:19:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20138.580586 secs 2023-05-08T09:20:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:59 smithi096 ceph-mon[124666]: pgmap v10796: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 534 KiB/s rd, 460 KiB/s wr, 11 op/s 2023-05-08T09:20:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20138.024381 secs 2023-05-08T09:20:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:19:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20138.580586 secs 2023-05-08T09:20:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:20:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:20:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:00 smithi186 ceph-mon[126480]: Health detail: HEALTH_WARN 2 MDSs report slow requests 2023-05-08T09:20:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:00 smithi186 ceph-mon[126480]: [WRN] MDS_SLOW_REQUEST: 2 MDSs report slow requests 2023-05-08T09:20:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:00 smithi186 ceph-mon[126480]: mds.c(mds.2): 1 slow requests are blocked > 180 secs 2023-05-08T09:20:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:00 smithi186 ceph-mon[126480]: mds.i(mds.1): 1 slow requests are blocked > 180 secs 2023-05-08T09:20:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:20:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:20:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:00 smithi133 ceph-mon[125939]: Health detail: HEALTH_WARN 2 MDSs report slow requests 2023-05-08T09:20:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:00 smithi133 ceph-mon[125939]: [WRN] MDS_SLOW_REQUEST: 2 MDSs report slow requests 2023-05-08T09:20:00.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:00 smithi133 ceph-mon[125939]: mds.c(mds.2): 1 slow requests are blocked > 180 secs 2023-05-08T09:20:00.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:00 smithi133 ceph-mon[125939]: mds.i(mds.1): 1 slow requests are blocked > 180 secs 2023-05-08T09:20:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:20:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:20:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:00 smithi096 ceph-mon[124666]: Health detail: HEALTH_WARN 2 MDSs report slow requests 2023-05-08T09:20:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:00 smithi096 ceph-mon[124666]: [WRN] MDS_SLOW_REQUEST: 2 MDSs report slow requests 2023-05-08T09:20:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:00 smithi096 ceph-mon[124666]: mds.c(mds.2): 1 slow requests are blocked > 180 secs 2023-05-08T09:20:01.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:00 smithi096 ceph-mon[124666]: mds.i(mds.1): 1 slow requests are blocked > 180 secs 2023-05-08T09:20:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:01 smithi133 ceph-mon[125939]: pgmap v10797: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 703 KiB/s rd, 630 KiB/s wr, 16 op/s 2023-05-08T09:20:01.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20139.866961 secs 2023-05-08T09:20:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:01 smithi096 ceph-mon[124666]: pgmap v10797: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 703 KiB/s rd, 630 KiB/s wr, 16 op/s 2023-05-08T09:20:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20139.866961 secs 2023-05-08T09:20:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:01 smithi186 ceph-mon[126480]: pgmap v10797: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 703 KiB/s rd, 630 KiB/s wr, 16 op/s 2023-05-08T09:20:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20139.866961 secs 2023-05-08T09:20:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:03 smithi133 ceph-mon[125939]: pgmap v10798: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 336 KiB/s wr, 10 op/s 2023-05-08T09:20:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:03 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:20:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:03 smithi096 ceph-mon[124666]: pgmap v10798: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 336 KiB/s wr, 10 op/s 2023-05-08T09:20:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:03 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:20:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:03 smithi186 ceph-mon[126480]: pgmap v10798: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 336 KiB/s wr, 10 op/s 2023-05-08T09:20:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:03 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:20:05.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20143.024497 secs 2023-05-08T09:20:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20143.580692 secs 2023-05-08T09:20:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:05 smithi186 ceph-mon[126480]: pgmap v10799: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 357 KiB/s wr, 23 op/s 2023-05-08T09:20:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:20:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:20:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20143.024497 secs 2023-05-08T09:20:05.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20143.580692 secs 2023-05-08T09:20:05.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:05 smithi133 ceph-mon[125939]: pgmap v10799: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 357 KiB/s wr, 23 op/s 2023-05-08T09:20:05.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:20:05.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:20:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20143.024497 secs 2023-05-08T09:20:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20143.580692 secs 2023-05-08T09:20:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:05 smithi096 ceph-mon[124666]: pgmap v10799: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 357 KiB/s wr, 23 op/s 2023-05-08T09:20:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:20:05.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:20:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20144.867080 secs 2023-05-08T09:20:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20144.867080 secs 2023-05-08T09:20:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20144.867080 secs 2023-05-08T09:20:07.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:07 smithi186 ceph-mon[126480]: pgmap v10800: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 309 KiB/s wr, 25 op/s 2023-05-08T09:20:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:07 smithi133 ceph-mon[125939]: pgmap v10800: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 309 KiB/s wr, 25 op/s 2023-05-08T09:20:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:07 smithi096 ceph-mon[124666]: pgmap v10800: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 309 KiB/s wr, 25 op/s 2023-05-08T09:20:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:08 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:20:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:08 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:20:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:08 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:20:09.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:09 smithi186 ceph-mon[126480]: pgmap v10801: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 214 KiB/s wr, 22 op/s 2023-05-08T09:20:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20148.024611 secs 2023-05-08T09:20:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:09 smithi133 ceph-mon[125939]: pgmap v10801: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 214 KiB/s wr, 22 op/s 2023-05-08T09:20:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20148.024611 secs 2023-05-08T09:20:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:09 smithi096 ceph-mon[124666]: pgmap v10801: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 214 KiB/s wr, 22 op/s 2023-05-08T09:20:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20148.024611 secs 2023-05-08T09:20:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20148.580816 secs 2023-05-08T09:20:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20148.580816 secs 2023-05-08T09:20:10.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20148.580816 secs 2023-05-08T09:20:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:11 smithi186 ceph-mon[126480]: pgmap v10802: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 286 KiB/s wr, 25 op/s 2023-05-08T09:20:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20149.867212 secs 2023-05-08T09:20:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:11 smithi133 ceph-mon[125939]: pgmap v10802: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 286 KiB/s wr, 25 op/s 2023-05-08T09:20:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20149.867212 secs 2023-05-08T09:20:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:11 smithi096 ceph-mon[124666]: pgmap v10802: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 286 KiB/s wr, 25 op/s 2023-05-08T09:20:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20149.867212 secs 2023-05-08T09:20:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:12 smithi133 ceph-mon[125939]: osdmap e752: 12 total, 12 up, 12 in 2023-05-08T09:20:12.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:12 smithi096 ceph-mon[124666]: osdmap e752: 12 total, 12 up, 12 in 2023-05-08T09:20:12.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:12 smithi186 ceph-mon[126480]: osdmap e752: 12 total, 12 up, 12 in 2023-05-08T09:20:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:13 smithi133 ceph-mon[125939]: pgmap v10804: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 140 KiB/s wr, 24 op/s 2023-05-08T09:20:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:13 smithi096 ceph-mon[124666]: pgmap v10804: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 140 KiB/s wr, 24 op/s 2023-05-08T09:20:13.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:13 smithi186 ceph-mon[126480]: pgmap v10804: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 140 KiB/s wr, 24 op/s 2023-05-08T09:20:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20153.024722 secs 2023-05-08T09:20:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20153.024722 secs 2023-05-08T09:20:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20153.024722 secs 2023-05-08T09:20:15.136 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20153.580947 secs 2023-05-08T09:20:15.136 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:15 smithi133 ceph-mon[125939]: pgmap v10805: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 114 KiB/s wr, 10 op/s 2023-05-08T09:20:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20153.580947 secs 2023-05-08T09:20:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:15 smithi096 ceph-mon[124666]: pgmap v10805: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 114 KiB/s wr, 10 op/s 2023-05-08T09:20:15.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20153.580947 secs 2023-05-08T09:20:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:15 smithi186 ceph-mon[126480]: pgmap v10805: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 114 KiB/s wr, 10 op/s 2023-05-08T09:20:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20154.867305 secs 2023-05-08T09:20:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20154.867305 secs 2023-05-08T09:20:16.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20154.867305 secs 2023-05-08T09:20:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:17 smithi133 ceph-mon[125939]: pgmap v10806: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 111 KiB/s wr, 6 op/s 2023-05-08T09:20:17.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:17 smithi096 ceph-mon[124666]: pgmap v10806: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 111 KiB/s wr, 6 op/s 2023-05-08T09:20:17.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:17 smithi186 ceph-mon[126480]: pgmap v10806: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 111 KiB/s wr, 6 op/s 2023-05-08T09:20:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:19 smithi186 ceph-mon[126480]: pgmap v10807: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 111 KiB/s wr, 6 op/s 2023-05-08T09:20:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:19 smithi186 ceph-mon[126480]: osdmap e753: 12 total, 12 up, 12 in 2023-05-08T09:20:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:19 smithi133 ceph-mon[125939]: pgmap v10807: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 111 KiB/s wr, 6 op/s 2023-05-08T09:20:19.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:19 smithi133 ceph-mon[125939]: osdmap e753: 12 total, 12 up, 12 in 2023-05-08T09:20:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:19 smithi096 ceph-mon[124666]: pgmap v10807: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 111 KiB/s wr, 6 op/s 2023-05-08T09:20:19.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:19 smithi096 ceph-mon[124666]: osdmap e753: 12 total, 12 up, 12 in 2023-05-08T09:20:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20158.024840 secs 2023-05-08T09:20:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20158.581060 secs 2023-05-08T09:20:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20158.024840 secs 2023-05-08T09:20:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20158.581060 secs 2023-05-08T09:20:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20158.024840 secs 2023-05-08T09:20:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20158.581060 secs 2023-05-08T09:20:21.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:21 smithi186 ceph-mon[126480]: pgmap v10809: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 69 KiB/s wr, 7 op/s 2023-05-08T09:20:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20159.867381 secs 2023-05-08T09:20:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:21 smithi133 ceph-mon[125939]: pgmap v10809: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 69 KiB/s wr, 7 op/s 2023-05-08T09:20:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20159.867381 secs 2023-05-08T09:20:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:21 smithi096 ceph-mon[124666]: pgmap v10809: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 69 KiB/s wr, 7 op/s 2023-05-08T09:20:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20159.867381 secs 2023-05-08T09:20:23.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:23 smithi186 ceph-mon[126480]: pgmap v10810: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 7 op/s 2023-05-08T09:20:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:23 smithi133 ceph-mon[125939]: pgmap v10810: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 7 op/s 2023-05-08T09:20:23.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:23 smithi096 ceph-mon[124666]: pgmap v10810: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 7 op/s 2023-05-08T09:20:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20163.024953 secs 2023-05-08T09:20:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20163.024953 secs 2023-05-08T09:20:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20163.024953 secs 2023-05-08T09:20:25.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20163.581185 secs 2023-05-08T09:20:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:25 smithi186 ceph-mon[126480]: pgmap v10811: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 7 op/s 2023-05-08T09:20:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20163.581185 secs 2023-05-08T09:20:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:25 smithi133 ceph-mon[125939]: pgmap v10811: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 7 op/s 2023-05-08T09:20:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20163.581185 secs 2023-05-08T09:20:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:25 smithi096 ceph-mon[124666]: pgmap v10811: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 7 op/s 2023-05-08T09:20:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20164.867545 secs 2023-05-08T09:20:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20164.867545 secs 2023-05-08T09:20:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20164.867545 secs 2023-05-08T09:20:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:27 smithi133 ceph-mon[125939]: pgmap v10812: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 37 KiB/s wr, 7 op/s 2023-05-08T09:20:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:27 smithi096 ceph-mon[124666]: pgmap v10812: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 37 KiB/s wr, 7 op/s 2023-05-08T09:20:27.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:27 smithi186 ceph-mon[126480]: pgmap v10812: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 37 KiB/s wr, 7 op/s 2023-05-08T09:20:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:29 smithi133 ceph-mon[125939]: pgmap v10813: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 37 KiB/s wr, 7 op/s 2023-05-08T09:20:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20168.025084 secs 2023-05-08T09:20:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:29 smithi096 ceph-mon[124666]: pgmap v10813: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 37 KiB/s wr, 7 op/s 2023-05-08T09:20:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20168.025084 secs 2023-05-08T09:20:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:29 smithi186 ceph-mon[126480]: pgmap v10813: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 37 KiB/s wr, 7 op/s 2023-05-08T09:20:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20168.025084 secs 2023-05-08T09:20:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20168.581299 secs 2023-05-08T09:20:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20168.581299 secs 2023-05-08T09:20:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20168.581299 secs 2023-05-08T09:20:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:31 smithi133 ceph-mon[125939]: pgmap v10814: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 31 KiB/s wr, 9 op/s 2023-05-08T09:20:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20169.867596 secs 2023-05-08T09:20:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:31 smithi096 ceph-mon[124666]: pgmap v10814: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 31 KiB/s wr, 9 op/s 2023-05-08T09:20:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20169.867596 secs 2023-05-08T09:20:31.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:31 smithi186 ceph-mon[126480]: pgmap v10814: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 31 KiB/s wr, 9 op/s 2023-05-08T09:20:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20169.867596 secs 2023-05-08T09:20:33.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:33 smithi133 ceph-mon[125939]: pgmap v10815: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 85 B/s wr, 6 op/s 2023-05-08T09:20:33.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:33 smithi096 ceph-mon[124666]: pgmap v10815: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 85 B/s wr, 6 op/s 2023-05-08T09:20:33.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:33 smithi186 ceph-mon[126480]: pgmap v10815: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 85 B/s wr, 6 op/s 2023-05-08T09:20:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20173.025218 secs 2023-05-08T09:20:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20173.025218 secs 2023-05-08T09:20:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20173.025218 secs 2023-05-08T09:20:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20173.581438 secs 2023-05-08T09:20:35.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:35 smithi133 ceph-mon[125939]: pgmap v10816: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 426 B/s wr, 7 op/s 2023-05-08T09:20:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20173.581438 secs 2023-05-08T09:20:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:35 smithi096 ceph-mon[124666]: pgmap v10816: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 426 B/s wr, 7 op/s 2023-05-08T09:20:35.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20173.581438 secs 2023-05-08T09:20:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:35 smithi186 ceph-mon[126480]: pgmap v10816: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 426 B/s wr, 7 op/s 2023-05-08T09:20:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20174.867694 secs 2023-05-08T09:20:36.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20174.867694 secs 2023-05-08T09:20:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20174.867694 secs 2023-05-08T09:20:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:37 smithi133 ceph-mon[125939]: pgmap v10817: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 938 B/s wr, 9 op/s 2023-05-08T09:20:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:37 smithi096 ceph-mon[124666]: pgmap v10817: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 938 B/s wr, 9 op/s 2023-05-08T09:20:37.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:37 smithi186 ceph-mon[126480]: pgmap v10817: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 938 B/s wr, 9 op/s 2023-05-08T09:20:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:39 smithi133 ceph-mon[125939]: pgmap v10818: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 938 B/s wr, 7 op/s 2023-05-08T09:20:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20178.025321 secs 2023-05-08T09:20:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:39 smithi096 ceph-mon[124666]: pgmap v10818: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 938 B/s wr, 7 op/s 2023-05-08T09:20:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20178.025321 secs 2023-05-08T09:20:39.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:39 smithi186 ceph-mon[126480]: pgmap v10818: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 938 B/s wr, 7 op/s 2023-05-08T09:20:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20178.025321 secs 2023-05-08T09:20:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20178.581501 secs 2023-05-08T09:20:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20178.581501 secs 2023-05-08T09:20:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20178.581501 secs 2023-05-08T09:20:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:41 smithi133 ceph-mon[125939]: pgmap v10819: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2023-05-08T09:20:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20179.867816 secs 2023-05-08T09:20:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:41 smithi096 ceph-mon[124666]: pgmap v10819: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2023-05-08T09:20:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20179.867816 secs 2023-05-08T09:20:41.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:41 smithi186 ceph-mon[126480]: pgmap v10819: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2023-05-08T09:20:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20179.867816 secs 2023-05-08T09:20:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:43 smithi133 ceph-mon[125939]: pgmap v10820: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 156 KiB/s wr, 8 op/s 2023-05-08T09:20:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:43 smithi096 ceph-mon[124666]: pgmap v10820: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 156 KiB/s wr, 8 op/s 2023-05-08T09:20:43.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:43 smithi186 ceph-mon[126480]: pgmap v10820: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 156 KiB/s wr, 8 op/s 2023-05-08T09:20:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20183.025407 secs 2023-05-08T09:20:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20183.025407 secs 2023-05-08T09:20:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20183.025407 secs 2023-05-08T09:20:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:45 smithi133 ceph-mon[125939]: pgmap v10821: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 162 KiB/s wr, 10 op/s 2023-05-08T09:20:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:45 smithi096 ceph-mon[124666]: pgmap v10821: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 162 KiB/s wr, 10 op/s 2023-05-08T09:20:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:45 smithi186 ceph-mon[126480]: pgmap v10821: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 162 KiB/s wr, 10 op/s 2023-05-08T09:20:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20184.867914 secs 2023-05-08T09:20:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20184.867914 secs 2023-05-08T09:20:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20184.867914 secs 2023-05-08T09:20:47.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:47 smithi133 ceph-mon[125939]: pgmap v10822: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 315 KiB/s wr, 11 op/s 2023-05-08T09:20:47.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:47 smithi096 ceph-mon[124666]: pgmap v10822: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 315 KiB/s wr, 11 op/s 2023-05-08T09:20:47.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:47 smithi186 ceph-mon[126480]: pgmap v10822: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 315 KiB/s wr, 11 op/s 2023-05-08T09:20:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:20:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:20:48.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:20:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:49 smithi133 ceph-mon[125939]: pgmap v10823: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 315 KiB/s wr, 8 op/s 2023-05-08T09:20:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:20:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:20:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:20:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20188.025532 secs 2023-05-08T09:20:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:49 smithi096 ceph-mon[124666]: pgmap v10823: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 315 KiB/s wr, 8 op/s 2023-05-08T09:20:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:20:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:20:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:20:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20188.025532 secs 2023-05-08T09:20:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:49 smithi186 ceph-mon[126480]: pgmap v10823: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 315 KiB/s wr, 8 op/s 2023-05-08T09:20:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:20:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:20:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:20:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20188.025532 secs 2023-05-08T09:20:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:51 smithi133 ceph-mon[125939]: pgmap v10824: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 475 KiB/s wr, 13 op/s 2023-05-08T09:20:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20189.867997 secs 2023-05-08T09:20:51.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:51 smithi096 ceph-mon[124666]: pgmap v10824: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 475 KiB/s wr, 13 op/s 2023-05-08T09:20:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20189.867997 secs 2023-05-08T09:20:51.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:51 smithi186 ceph-mon[126480]: pgmap v10824: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 475 KiB/s wr, 13 op/s 2023-05-08T09:20:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20189.867997 secs 2023-05-08T09:20:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:53 smithi133 ceph-mon[125939]: pgmap v10825: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 515 KiB/s rd, 503 KiB/s wr, 11 op/s 2023-05-08T09:20:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:53 smithi096 ceph-mon[124666]: pgmap v10825: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 515 KiB/s rd, 503 KiB/s wr, 11 op/s 2023-05-08T09:20:53.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:53 smithi186 ceph-mon[126480]: pgmap v10825: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 515 KiB/s rd, 503 KiB/s wr, 11 op/s 2023-05-08T09:20:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20193.025650 secs 2023-05-08T09:20:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20193.025650 secs 2023-05-08T09:20:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20193.025650 secs 2023-05-08T09:20:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:55 smithi133 ceph-mon[125939]: pgmap v10826: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 359 KiB/s wr, 13 op/s 2023-05-08T09:20:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:55 smithi096 ceph-mon[124666]: pgmap v10826: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 359 KiB/s wr, 13 op/s 2023-05-08T09:20:55.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:55 smithi186 ceph-mon[126480]: pgmap v10826: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 359 KiB/s wr, 13 op/s 2023-05-08T09:20:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:20:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:20:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:20:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:20:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:20:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:20:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:57 smithi133 ceph-mon[125939]: pgmap v10827: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 441 KiB/s wr, 12 op/s 2023-05-08T09:20:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:57 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:20:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:20:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:20:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:20:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:20:57.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:57 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:20:57.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:20:57.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:57 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T09:20:57.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:57 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T09:20:57.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:57 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:20:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:57 smithi096 ceph-mon[124666]: pgmap v10827: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 441 KiB/s wr, 12 op/s 2023-05-08T09:20:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:57 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:20:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:20:57.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:20:57.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:20:57.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:20:57.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:57 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:20:57.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:20:57.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:57 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T09:20:57.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:57 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T09:20:57.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:57 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:20:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:57 smithi186 ceph-mon[126480]: pgmap v10827: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 441 KiB/s wr, 12 op/s 2023-05-08T09:20:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:57 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:20:57.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:20:57.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:20:57.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:20:57.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:20:57.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:57 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:20:57.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:20:57.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:57 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T09:20:57.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:57 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T09:20:57.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:57 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:20:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:59 smithi133 ceph-mon[125939]: pgmap v10828: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 287 KiB/s wr, 10 op/s 2023-05-08T09:20:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:20:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20198.025766 secs 2023-05-08T09:20:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:59 smithi096 ceph-mon[124666]: pgmap v10828: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 287 KiB/s wr, 10 op/s 2023-05-08T09:20:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:20:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20198.025766 secs 2023-05-08T09:20:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:59 smithi186 ceph-mon[126480]: pgmap v10828: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 287 KiB/s wr, 10 op/s 2023-05-08T09:20:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:20:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20198.025766 secs 2023-05-08T09:21:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20198.581971 secs 2023-05-08T09:21:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20198.581971 secs 2023-05-08T09:21:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20198.581971 secs 2023-05-08T09:21:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:01 smithi133 ceph-mon[125939]: pgmap v10829: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 526 KiB/s wr, 15 op/s 2023-05-08T09:21:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20199.868255 secs 2023-05-08T09:21:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:21:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:21:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:01 smithi096 ceph-mon[124666]: pgmap v10829: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 526 KiB/s wr, 15 op/s 2023-05-08T09:21:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20199.868255 secs 2023-05-08T09:21:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:21:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:21:01.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:01 smithi186 ceph-mon[126480]: pgmap v10829: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 526 KiB/s wr, 15 op/s 2023-05-08T09:21:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20199.868255 secs 2023-05-08T09:21:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:21:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:21:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:03 smithi133 ceph-mon[125939]: pgmap v10830: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 366 KiB/s wr, 10 op/s 2023-05-08T09:21:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:03 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:21:03.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:03 smithi096 ceph-mon[124666]: pgmap v10830: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 366 KiB/s wr, 10 op/s 2023-05-08T09:21:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:03 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:21:03.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:03 smithi186 ceph-mon[126480]: pgmap v10830: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 366 KiB/s wr, 10 op/s 2023-05-08T09:21:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:03 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:21:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20203.025917 secs 2023-05-08T09:21:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20203.025917 secs 2023-05-08T09:21:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20203.025917 secs 2023-05-08T09:21:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20203.582092 secs 2023-05-08T09:21:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:05 smithi133 ceph-mon[125939]: pgmap v10831: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 361 KiB/s wr, 25 op/s 2023-05-08T09:21:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:21:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:21:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20203.582092 secs 2023-05-08T09:21:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:05 smithi096 ceph-mon[124666]: pgmap v10831: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 361 KiB/s wr, 25 op/s 2023-05-08T09:21:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:21:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:21:05.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20203.582092 secs 2023-05-08T09:21:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:05 smithi186 ceph-mon[126480]: pgmap v10831: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 361 KiB/s wr, 25 op/s 2023-05-08T09:21:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:21:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:21:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20204.868383 secs 2023-05-08T09:21:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20204.868383 secs 2023-05-08T09:21:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20204.868383 secs 2023-05-08T09:21:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:07 smithi133 ceph-mon[125939]: pgmap v10832: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 372 KiB/s wr, 25 op/s 2023-05-08T09:21:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:07 smithi096 ceph-mon[124666]: pgmap v10832: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 372 KiB/s wr, 25 op/s 2023-05-08T09:21:07.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:07 smithi186 ceph-mon[126480]: pgmap v10832: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 372 KiB/s wr, 25 op/s 2023-05-08T09:21:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:08 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:21:08.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:08 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:21:08.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:08 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:21:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:09 smithi133 ceph-mon[125939]: pgmap v10833: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 285 KiB/s wr, 22 op/s 2023-05-08T09:21:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20208.026040 secs 2023-05-08T09:21:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:09 smithi096 ceph-mon[124666]: pgmap v10833: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 285 KiB/s wr, 22 op/s 2023-05-08T09:21:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20208.026040 secs 2023-05-08T09:21:09.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:09 smithi186 ceph-mon[126480]: pgmap v10833: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 285 KiB/s wr, 22 op/s 2023-05-08T09:21:09.639 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20208.026040 secs 2023-05-08T09:21:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20208.582206 secs 2023-05-08T09:21:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20208.582206 secs 2023-05-08T09:21:10.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20208.582206 secs 2023-05-08T09:21:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:11 smithi133 ceph-mon[125939]: pgmap v10834: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 324 KiB/s rd, 357 KiB/s wr, 25 op/s 2023-05-08T09:21:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20209.868501 secs 2023-05-08T09:21:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:11 smithi133 ceph-mon[125939]: osdmap e754: 12 total, 12 up, 12 in 2023-05-08T09:21:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:11 smithi096 ceph-mon[124666]: pgmap v10834: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 324 KiB/s rd, 357 KiB/s wr, 25 op/s 2023-05-08T09:21:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20209.868501 secs 2023-05-08T09:21:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:11 smithi096 ceph-mon[124666]: osdmap e754: 12 total, 12 up, 12 in 2023-05-08T09:21:11.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:11 smithi186 ceph-mon[126480]: pgmap v10834: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 324 KiB/s rd, 357 KiB/s wr, 25 op/s 2023-05-08T09:21:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20209.868501 secs 2023-05-08T09:21:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:11 smithi186 ceph-mon[126480]: osdmap e754: 12 total, 12 up, 12 in 2023-05-08T09:21:13.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:13 smithi096 ceph-mon[124666]: pgmap v10836: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 141 KiB/s wr, 25 op/s 2023-05-08T09:21:13.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:13 smithi186 ceph-mon[126480]: pgmap v10836: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 141 KiB/s wr, 25 op/s 2023-05-08T09:21:13.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:13 smithi133 ceph-mon[125939]: pgmap v10836: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 141 KiB/s wr, 25 op/s 2023-05-08T09:21:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20213.026172 secs 2023-05-08T09:21:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20213.026172 secs 2023-05-08T09:21:14.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20213.026172 secs 2023-05-08T09:21:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20213.582348 secs 2023-05-08T09:21:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:15 smithi096 ceph-mon[124666]: pgmap v10837: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 113 KiB/s wr, 9 op/s 2023-05-08T09:21:15.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20213.582348 secs 2023-05-08T09:21:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:15 smithi186 ceph-mon[126480]: pgmap v10837: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 113 KiB/s wr, 9 op/s 2023-05-08T09:21:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20213.582348 secs 2023-05-08T09:21:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:15 smithi133 ceph-mon[125939]: pgmap v10837: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 113 KiB/s wr, 9 op/s 2023-05-08T09:21:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20214.868605 secs 2023-05-08T09:21:16.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20214.868605 secs 2023-05-08T09:21:16.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20214.868605 secs 2023-05-08T09:21:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:17 smithi096 ceph-mon[124666]: pgmap v10838: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 86 KiB/s wr, 6 op/s 2023-05-08T09:21:17.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:17 smithi186 ceph-mon[126480]: pgmap v10838: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 86 KiB/s wr, 6 op/s 2023-05-08T09:21:17.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:17 smithi133 ceph-mon[125939]: pgmap v10838: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 86 KiB/s wr, 6 op/s 2023-05-08T09:21:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:19 smithi186 ceph-mon[126480]: pgmap v10839: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 86 KiB/s wr, 6 op/s 2023-05-08T09:21:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:19 smithi186 ceph-mon[126480]: osdmap e755: 12 total, 12 up, 12 in 2023-05-08T09:21:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20218.026299 secs 2023-05-08T09:21:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:19 smithi133 ceph-mon[125939]: pgmap v10839: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 86 KiB/s wr, 6 op/s 2023-05-08T09:21:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:19 smithi133 ceph-mon[125939]: osdmap e755: 12 total, 12 up, 12 in 2023-05-08T09:21:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20218.026299 secs 2023-05-08T09:21:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:19 smithi096 ceph-mon[124666]: pgmap v10839: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 86 KiB/s wr, 6 op/s 2023-05-08T09:21:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:19 smithi096 ceph-mon[124666]: osdmap e755: 12 total, 12 up, 12 in 2023-05-08T09:21:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20218.026299 secs 2023-05-08T09:21:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20218.582499 secs 2023-05-08T09:21:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20218.582499 secs 2023-05-08T09:21:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20218.582499 secs 2023-05-08T09:21:21.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:21 smithi186 ceph-mon[126480]: pgmap v10841: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 63 KiB/s wr, 6 op/s 2023-05-08T09:21:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20219.868724 secs 2023-05-08T09:21:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:21 smithi133 ceph-mon[125939]: pgmap v10841: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 63 KiB/s wr, 6 op/s 2023-05-08T09:21:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20219.868724 secs 2023-05-08T09:21:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:21 smithi096 ceph-mon[124666]: pgmap v10841: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 63 KiB/s wr, 6 op/s 2023-05-08T09:21:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20219.868724 secs 2023-05-08T09:21:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:23 smithi133 ceph-mon[125939]: pgmap v10842: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T09:21:23.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:23 smithi096 ceph-mon[124666]: pgmap v10842: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T09:21:23.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:23 smithi186 ceph-mon[126480]: pgmap v10842: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T09:21:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20223.026418 secs 2023-05-08T09:21:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20223.026418 secs 2023-05-08T09:21:24.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20223.026418 secs 2023-05-08T09:21:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20223.582611 secs 2023-05-08T09:21:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:25 smithi133 ceph-mon[125939]: pgmap v10843: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T09:21:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20223.582611 secs 2023-05-08T09:21:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:25 smithi096 ceph-mon[124666]: pgmap v10843: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T09:21:25.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20223.582611 secs 2023-05-08T09:21:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:25 smithi186 ceph-mon[126480]: pgmap v10843: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T09:21:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20224.868792 secs 2023-05-08T09:21:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20224.868792 secs 2023-05-08T09:21:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20224.868792 secs 2023-05-08T09:21:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:27 smithi133 ceph-mon[125939]: pgmap v10844: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T09:21:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:27 smithi096 ceph-mon[124666]: pgmap v10844: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T09:21:27.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:27 smithi186 ceph-mon[126480]: pgmap v10844: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T09:21:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:29 smithi133 ceph-mon[125939]: pgmap v10845: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T09:21:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20228.026525 secs 2023-05-08T09:21:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:29 smithi096 ceph-mon[124666]: pgmap v10845: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T09:21:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20228.026525 secs 2023-05-08T09:21:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:29 smithi186 ceph-mon[126480]: pgmap v10845: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T09:21:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20228.026525 secs 2023-05-08T09:21:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20228.582734 secs 2023-05-08T09:21:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20228.582734 secs 2023-05-08T09:21:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20228.582734 secs 2023-05-08T09:21:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:31 smithi133 ceph-mon[125939]: pgmap v10846: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 52 KiB/s wr, 8 op/s 2023-05-08T09:21:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20229.868916 secs 2023-05-08T09:21:31.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:31 smithi096 ceph-mon[124666]: pgmap v10846: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 52 KiB/s wr, 8 op/s 2023-05-08T09:21:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20229.868916 secs 2023-05-08T09:21:31.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:31 smithi186 ceph-mon[126480]: pgmap v10846: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 52 KiB/s wr, 8 op/s 2023-05-08T09:21:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20229.868916 secs 2023-05-08T09:21:33.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:33 smithi133 ceph-mon[125939]: pgmap v10847: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T09:21:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:33 smithi096 ceph-mon[124666]: pgmap v10847: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T09:21:33.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:33 smithi186 ceph-mon[126480]: pgmap v10847: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T09:21:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20233.026598 secs 2023-05-08T09:21:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20233.026598 secs 2023-05-08T09:21:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20233.026598 secs 2023-05-08T09:21:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20233.582821 secs 2023-05-08T09:21:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:35 smithi133 ceph-mon[125939]: pgmap v10848: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 8 op/s 2023-05-08T09:21:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20233.582821 secs 2023-05-08T09:21:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:35 smithi096 ceph-mon[124666]: pgmap v10848: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 8 op/s 2023-05-08T09:21:35.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20233.582821 secs 2023-05-08T09:21:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:35 smithi186 ceph-mon[126480]: pgmap v10848: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 8 op/s 2023-05-08T09:21:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20234.869031 secs 2023-05-08T09:21:36.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20234.869031 secs 2023-05-08T09:21:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20234.869031 secs 2023-05-08T09:21:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:37 smithi133 ceph-mon[125939]: pgmap v10849: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T09:21:37.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:37 smithi096 ceph-mon[124666]: pgmap v10849: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T09:21:37.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:37 smithi186 ceph-mon[126480]: pgmap v10849: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T09:21:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:39 smithi133 ceph-mon[125939]: pgmap v10850: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T09:21:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20238.026660 secs 2023-05-08T09:21:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:39 smithi096 ceph-mon[124666]: pgmap v10850: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T09:21:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20238.026660 secs 2023-05-08T09:21:39.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:39 smithi186 ceph-mon[126480]: pgmap v10850: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T09:21:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20238.026660 secs 2023-05-08T09:21:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20238.582939 secs 2023-05-08T09:21:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20238.582939 secs 2023-05-08T09:21:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20238.582939 secs 2023-05-08T09:21:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:41 smithi133 ceph-mon[125939]: pgmap v10851: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 80 KiB/s wr, 9 op/s 2023-05-08T09:21:41.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:41 smithi096 ceph-mon[124666]: pgmap v10851: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 80 KiB/s wr, 9 op/s 2023-05-08T09:21:41.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:41 smithi186 ceph-mon[126480]: pgmap v10851: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 80 KiB/s wr, 9 op/s 2023-05-08T09:21:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:43 smithi133 ceph-mon[125939]: pgmap v10852: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 80 KiB/s wr, 6 op/s 2023-05-08T09:21:43.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:43 smithi096 ceph-mon[124666]: pgmap v10852: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 80 KiB/s wr, 6 op/s 2023-05-08T09:21:43.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:43 smithi186 ceph-mon[126480]: pgmap v10852: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 80 KiB/s wr, 6 op/s 2023-05-08T09:21:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:44 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:21:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20243.026812 secs 2023-05-08T09:21:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:44 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:21:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20243.026812 secs 2023-05-08T09:21:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:44 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:21:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20243.026812 secs 2023-05-08T09:21:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20243.583037 secs 2023-05-08T09:21:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:45 smithi133 ceph-mon[125939]: pgmap v10853: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 112 KiB/s wr, 9 op/s 2023-05-08T09:21:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:45 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:21:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:45 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:21:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:45 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:21:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20243.583037 secs 2023-05-08T09:21:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:45 smithi096 ceph-mon[124666]: pgmap v10853: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 112 KiB/s wr, 9 op/s 2023-05-08T09:21:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:45 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:21:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:45 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:21:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:45 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:21:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20243.583037 secs 2023-05-08T09:21:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:45 smithi186 ceph-mon[126480]: pgmap v10853: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 112 KiB/s wr, 9 op/s 2023-05-08T09:21:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:45 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:21:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:45 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:21:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:45 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:21:47.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:47 smithi133 ceph-mon[125939]: pgmap v10854: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 112 KiB/s wr, 7 op/s 2023-05-08T09:21:47.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:47 smithi096 ceph-mon[124666]: pgmap v10854: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 112 KiB/s wr, 7 op/s 2023-05-08T09:21:47.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:47 smithi186 ceph-mon[126480]: pgmap v10854: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 112 KiB/s wr, 7 op/s 2023-05-08T09:21:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:49 smithi133 ceph-mon[125939]: pgmap v10855: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 112 KiB/s wr, 6 op/s 2023-05-08T09:21:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20248.026947 secs 2023-05-08T09:21:49.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:49 smithi096 ceph-mon[124666]: pgmap v10855: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 112 KiB/s wr, 6 op/s 2023-05-08T09:21:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20248.026947 secs 2023-05-08T09:21:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:49 smithi186 ceph-mon[126480]: pgmap v10855: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 112 KiB/s wr, 6 op/s 2023-05-08T09:21:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20248.026947 secs 2023-05-08T09:21:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:51 smithi133 ceph-mon[125939]: pgmap v10856: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 356 KiB/s wr, 11 op/s 2023-05-08T09:21:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20249.869319 secs 2023-05-08T09:21:51.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:51 smithi096 ceph-mon[124666]: pgmap v10856: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 356 KiB/s wr, 11 op/s 2023-05-08T09:21:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20249.869319 secs 2023-05-08T09:21:51.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:51 smithi186 ceph-mon[126480]: pgmap v10856: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 356 KiB/s wr, 11 op/s 2023-05-08T09:21:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20249.869319 secs 2023-05-08T09:21:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:21:52.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:21:52.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:21:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:53 smithi133 ceph-mon[125939]: pgmap v10857: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 505 KiB/s rd, 277 KiB/s wr, 8 op/s 2023-05-08T09:21:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:21:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:21:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:21:53.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:53 smithi096 ceph-mon[124666]: pgmap v10857: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 505 KiB/s rd, 277 KiB/s wr, 8 op/s 2023-05-08T09:21:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:21:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:21:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:21:53.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:53 smithi186 ceph-mon[126480]: pgmap v10857: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 505 KiB/s rd, 277 KiB/s wr, 8 op/s 2023-05-08T09:21:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:21:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:21:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:21:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20253.027068 secs 2023-05-08T09:21:54.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20253.027068 secs 2023-05-08T09:21:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20253.027068 secs 2023-05-08T09:21:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20253.583281 secs 2023-05-08T09:21:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:55 smithi133 ceph-mon[125939]: pgmap v10858: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 820 KiB/s rd, 665 KiB/s wr, 14 op/s 2023-05-08T09:21:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20253.583281 secs 2023-05-08T09:21:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:55 smithi096 ceph-mon[124666]: pgmap v10858: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 820 KiB/s rd, 665 KiB/s wr, 14 op/s 2023-05-08T09:21:55.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20253.583281 secs 2023-05-08T09:21:55.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:55 smithi186 ceph-mon[126480]: pgmap v10858: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 820 KiB/s rd, 665 KiB/s wr, 14 op/s 2023-05-08T09:21:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20254.869429 secs 2023-05-08T09:21:56.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20254.869429 secs 2023-05-08T09:21:56.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20254.869429 secs 2023-05-08T09:21:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:57 smithi133 ceph-mon[125939]: pgmap v10859: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 621 KiB/s rd, 634 KiB/s wr, 12 op/s 2023-05-08T09:21:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:57 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:21:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:21:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:21:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:21:57.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:21:57.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:21:57.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:21:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:57 smithi096 ceph-mon[124666]: pgmap v10859: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 621 KiB/s rd, 634 KiB/s wr, 12 op/s 2023-05-08T09:21:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:57 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:21:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:21:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:21:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:21:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:21:57.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:21:57.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:21:57.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:57 smithi186 ceph-mon[126480]: pgmap v10859: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 621 KiB/s rd, 634 KiB/s wr, 12 op/s 2023-05-08T09:21:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:57 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:21:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:21:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:21:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:21:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:21:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:21:57.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:21:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:58 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:21:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:58 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T09:21:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:58 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T09:21:58.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:58 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:21:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:58 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:21:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:58 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T09:21:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:58 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T09:21:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:58 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:21:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:58 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:21:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:58 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T09:21:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:58 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T09:21:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:58 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:21:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:59 smithi133 ceph-mon[125939]: pgmap v10860: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 621 KiB/s rd, 634 KiB/s wr, 12 op/s 2023-05-08T09:21:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:21:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20258.027198 secs 2023-05-08T09:21:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:59 smithi096 ceph-mon[124666]: pgmap v10860: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 621 KiB/s rd, 634 KiB/s wr, 12 op/s 2023-05-08T09:21:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:21:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20258.027198 secs 2023-05-08T09:21:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:59 smithi186 ceph-mon[126480]: pgmap v10860: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 621 KiB/s rd, 634 KiB/s wr, 12 op/s 2023-05-08T09:21:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:21:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20258.027198 secs 2023-05-08T09:22:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:00 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:22:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:00 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:22:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:00 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:22:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:01 smithi133 ceph-mon[125939]: pgmap v10861: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 806 KiB/s rd, 734 KiB/s wr, 17 op/s 2023-05-08T09:22:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20259.869548 secs 2023-05-08T09:22:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:22:01.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:22:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:01 smithi096 ceph-mon[124666]: pgmap v10861: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 806 KiB/s rd, 734 KiB/s wr, 17 op/s 2023-05-08T09:22:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20259.869548 secs 2023-05-08T09:22:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:22:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:22:01.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:01 smithi186 ceph-mon[126480]: pgmap v10861: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 806 KiB/s rd, 734 KiB/s wr, 17 op/s 2023-05-08T09:22:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20259.869548 secs 2023-05-08T09:22:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:22:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:22:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:03 smithi133 ceph-mon[125939]: pgmap v10862: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 502 KiB/s rd, 489 KiB/s wr, 12 op/s 2023-05-08T09:22:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:03 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:22:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:03 smithi096 ceph-mon[124666]: pgmap v10862: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 502 KiB/s rd, 489 KiB/s wr, 12 op/s 2023-05-08T09:22:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:03 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:22:03.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:03 smithi186 ceph-mon[126480]: pgmap v10862: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 502 KiB/s rd, 489 KiB/s wr, 12 op/s 2023-05-08T09:22:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:03 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:22:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20263.027331 secs 2023-05-08T09:22:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20263.027331 secs 2023-05-08T09:22:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20263.027331 secs 2023-05-08T09:22:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20263.583524 secs 2023-05-08T09:22:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:05 smithi133 ceph-mon[125939]: pgmap v10863: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 690 KiB/s rd, 720 KiB/s wr, 29 op/s 2023-05-08T09:22:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20263.583524 secs 2023-05-08T09:22:05.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:05 smithi096 ceph-mon[124666]: pgmap v10863: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 690 KiB/s rd, 720 KiB/s wr, 29 op/s 2023-05-08T09:22:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20263.583524 secs 2023-05-08T09:22:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:05 smithi186 ceph-mon[126480]: pgmap v10863: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 690 KiB/s rd, 720 KiB/s wr, 29 op/s 2023-05-08T09:22:06.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20264.869663 secs 2023-05-08T09:22:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:06 smithi096 ceph-mon[124666]: osdmap e756: 12 total, 12 up, 12 in 2023-05-08T09:22:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20264.869663 secs 2023-05-08T09:22:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:06 smithi186 ceph-mon[126480]: osdmap e756: 12 total, 12 up, 12 in 2023-05-08T09:22:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20264.869663 secs 2023-05-08T09:22:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:06 smithi133 ceph-mon[125939]: osdmap e756: 12 total, 12 up, 12 in 2023-05-08T09:22:07.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:07 smithi096 ceph-mon[124666]: pgmap v10865: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 449 KiB/s rd, 424 KiB/s wr, 29 op/s 2023-05-08T09:22:07.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:07 smithi186 ceph-mon[126480]: pgmap v10865: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 449 KiB/s rd, 424 KiB/s wr, 29 op/s 2023-05-08T09:22:07.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:07 smithi133 ceph-mon[125939]: pgmap v10865: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 449 KiB/s rd, 424 KiB/s wr, 29 op/s 2023-05-08T09:22:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:09 smithi133 ceph-mon[125939]: pgmap v10866: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 449 KiB/s rd, 424 KiB/s wr, 29 op/s 2023-05-08T09:22:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:09 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:22:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:22:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:22:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20268.027432 secs 2023-05-08T09:22:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:09 smithi096 ceph-mon[124666]: pgmap v10866: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 449 KiB/s rd, 424 KiB/s wr, 29 op/s 2023-05-08T09:22:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:09 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:22:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:22:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:22:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20268.027432 secs 2023-05-08T09:22:09.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:09 smithi186 ceph-mon[126480]: pgmap v10866: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 449 KiB/s rd, 424 KiB/s wr, 29 op/s 2023-05-08T09:22:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:09 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:22:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:22:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:22:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20268.027432 secs 2023-05-08T09:22:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20268.583628 secs 2023-05-08T09:22:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20268.583628 secs 2023-05-08T09:22:10.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20268.583628 secs 2023-05-08T09:22:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:11 smithi133 ceph-mon[125939]: pgmap v10867: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 390 KiB/s wr, 28 op/s 2023-05-08T09:22:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20269.869762 secs 2023-05-08T09:22:11.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:11 smithi096 ceph-mon[124666]: pgmap v10867: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 390 KiB/s wr, 28 op/s 2023-05-08T09:22:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20269.869762 secs 2023-05-08T09:22:11.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:11 smithi186 ceph-mon[126480]: pgmap v10867: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 390 KiB/s wr, 28 op/s 2023-05-08T09:22:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20269.869762 secs 2023-05-08T09:22:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:13 smithi133 ceph-mon[125939]: pgmap v10868: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 390 KiB/s wr, 28 op/s 2023-05-08T09:22:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:13 smithi133 ceph-mon[125939]: osdmap e757: 12 total, 12 up, 12 in 2023-05-08T09:22:13.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:13 smithi096 ceph-mon[124666]: pgmap v10868: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 390 KiB/s wr, 28 op/s 2023-05-08T09:22:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:13 smithi096 ceph-mon[124666]: osdmap e757: 12 total, 12 up, 12 in 2023-05-08T09:22:13.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:13 smithi186 ceph-mon[126480]: pgmap v10868: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 390 KiB/s wr, 28 op/s 2023-05-08T09:22:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:13 smithi186 ceph-mon[126480]: osdmap e757: 12 total, 12 up, 12 in 2023-05-08T09:22:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20273.027525 secs 2023-05-08T09:22:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20273.027525 secs 2023-05-08T09:22:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20273.027525 secs 2023-05-08T09:22:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20273.583743 secs 2023-05-08T09:22:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:15 smithi133 ceph-mon[125939]: pgmap v10870: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 97 KiB/s wr, 8 op/s 2023-05-08T09:22:15.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20273.583743 secs 2023-05-08T09:22:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:15 smithi096 ceph-mon[124666]: pgmap v10870: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 97 KiB/s wr, 8 op/s 2023-05-08T09:22:15.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20273.583743 secs 2023-05-08T09:22:15.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:15 smithi186 ceph-mon[126480]: pgmap v10870: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 97 KiB/s wr, 8 op/s 2023-05-08T09:22:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20274.869878 secs 2023-05-08T09:22:16.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20274.869878 secs 2023-05-08T09:22:16.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20274.869878 secs 2023-05-08T09:22:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:17 smithi133 ceph-mon[125939]: pgmap v10871: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 86 KiB/s wr, 8 op/s 2023-05-08T09:22:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:17 smithi096 ceph-mon[124666]: pgmap v10871: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 86 KiB/s wr, 8 op/s 2023-05-08T09:22:17.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:17 smithi186 ceph-mon[126480]: pgmap v10871: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 86 KiB/s wr, 8 op/s 2023-05-08T09:22:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:19 smithi133 ceph-mon[125939]: pgmap v10872: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 86 KiB/s wr, 8 op/s 2023-05-08T09:22:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20278.027636 secs 2023-05-08T09:22:19.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:19 smithi096 ceph-mon[124666]: pgmap v10872: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 86 KiB/s wr, 8 op/s 2023-05-08T09:22:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20278.027636 secs 2023-05-08T09:22:19.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:19 smithi186 ceph-mon[126480]: pgmap v10872: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 86 KiB/s wr, 8 op/s 2023-05-08T09:22:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20278.027636 secs 2023-05-08T09:22:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20278.583862 secs 2023-05-08T09:22:20.515 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20278.583862 secs 2023-05-08T09:22:20.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20278.583862 secs 2023-05-08T09:22:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:21 smithi133 ceph-mon[125939]: pgmap v10873: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 74 KiB/s wr, 6 op/s 2023-05-08T09:22:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20279.870002 secs 2023-05-08T09:22:21.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:21 smithi096 ceph-mon[124666]: pgmap v10873: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 74 KiB/s wr, 6 op/s 2023-05-08T09:22:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20279.870002 secs 2023-05-08T09:22:21.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:21 smithi186 ceph-mon[126480]: pgmap v10873: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 74 KiB/s wr, 6 op/s 2023-05-08T09:22:21.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20279.870002 secs 2023-05-08T09:22:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:23 smithi133 ceph-mon[125939]: pgmap v10874: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 74 KiB/s wr, 6 op/s 2023-05-08T09:22:23.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:23 smithi096 ceph-mon[124666]: pgmap v10874: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 74 KiB/s wr, 6 op/s 2023-05-08T09:22:23.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:23 smithi186 ceph-mon[126480]: pgmap v10874: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 74 KiB/s wr, 6 op/s 2023-05-08T09:22:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20283.027752 secs 2023-05-08T09:22:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20283.027752 secs 2023-05-08T09:22:24.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20283.027752 secs 2023-05-08T09:22:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20283.583986 secs 2023-05-08T09:22:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:25 smithi133 ceph-mon[125939]: pgmap v10875: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 68 KiB/s wr, 8 op/s 2023-05-08T09:22:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20283.583986 secs 2023-05-08T09:22:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:25 smithi096 ceph-mon[124666]: pgmap v10875: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 68 KiB/s wr, 8 op/s 2023-05-08T09:22:25.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20283.583986 secs 2023-05-08T09:22:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:25 smithi186 ceph-mon[126480]: pgmap v10875: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 68 KiB/s wr, 8 op/s 2023-05-08T09:22:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20284.870116 secs 2023-05-08T09:22:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20284.870116 secs 2023-05-08T09:22:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20284.870116 secs 2023-05-08T09:22:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:27 smithi133 ceph-mon[125939]: pgmap v10876: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 62 KiB/s wr, 5 op/s 2023-05-08T09:22:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:27 smithi096 ceph-mon[124666]: pgmap v10876: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 62 KiB/s wr, 5 op/s 2023-05-08T09:22:27.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:27 smithi186 ceph-mon[126480]: pgmap v10876: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 62 KiB/s wr, 5 op/s 2023-05-08T09:22:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:29 smithi133 ceph-mon[125939]: pgmap v10877: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 62 KiB/s wr, 5 op/s 2023-05-08T09:22:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20288.027878 secs 2023-05-08T09:22:29.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:29 smithi096 ceph-mon[124666]: pgmap v10877: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 62 KiB/s wr, 5 op/s 2023-05-08T09:22:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20288.027878 secs 2023-05-08T09:22:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:29 smithi186 ceph-mon[126480]: pgmap v10877: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 62 KiB/s wr, 5 op/s 2023-05-08T09:22:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20288.027878 secs 2023-05-08T09:22:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20288.584115 secs 2023-05-08T09:22:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20288.584115 secs 2023-05-08T09:22:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20288.584115 secs 2023-05-08T09:22:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:31 smithi133 ceph-mon[125939]: pgmap v10878: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 7 op/s 2023-05-08T09:22:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20289.870254 secs 2023-05-08T09:22:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:31 smithi096 ceph-mon[124666]: pgmap v10878: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 7 op/s 2023-05-08T09:22:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20289.870254 secs 2023-05-08T09:22:31.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:31 smithi186 ceph-mon[126480]: pgmap v10878: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 7 op/s 2023-05-08T09:22:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20289.870254 secs 2023-05-08T09:22:33.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:33 smithi133 ceph-mon[125939]: pgmap v10879: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T09:22:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:33 smithi096 ceph-mon[124666]: pgmap v10879: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T09:22:33.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:33 smithi186 ceph-mon[126480]: pgmap v10879: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T09:22:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20293.027986 secs 2023-05-08T09:22:34.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20293.027986 secs 2023-05-08T09:22:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20293.027986 secs 2023-05-08T09:22:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20293.584236 secs 2023-05-08T09:22:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:35 smithi133 ceph-mon[125939]: pgmap v10880: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 597 B/s wr, 7 op/s 2023-05-08T09:22:35.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20293.584236 secs 2023-05-08T09:22:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:35 smithi096 ceph-mon[124666]: pgmap v10880: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 597 B/s wr, 7 op/s 2023-05-08T09:22:35.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20293.584236 secs 2023-05-08T09:22:35.629 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:35 smithi186 ceph-mon[126480]: pgmap v10880: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 597 B/s wr, 7 op/s 2023-05-08T09:22:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20294.870368 secs 2023-05-08T09:22:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20294.870368 secs 2023-05-08T09:22:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20294.870368 secs 2023-05-08T09:22:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:37 smithi133 ceph-mon[125939]: pgmap v10881: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 682 B/s wr, 5 op/s 2023-05-08T09:22:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:37 smithi096 ceph-mon[124666]: pgmap v10881: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 682 B/s wr, 5 op/s 2023-05-08T09:22:37.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:37 smithi186 ceph-mon[126480]: pgmap v10881: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 682 B/s wr, 5 op/s 2023-05-08T09:22:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:39 smithi133 ceph-mon[125939]: pgmap v10882: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 682 B/s wr, 5 op/s 2023-05-08T09:22:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20298.028121 secs 2023-05-08T09:22:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:39 smithi096 ceph-mon[124666]: pgmap v10882: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 682 B/s wr, 5 op/s 2023-05-08T09:22:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20298.028121 secs 2023-05-08T09:22:39.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:39 smithi186 ceph-mon[126480]: pgmap v10882: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 682 B/s wr, 5 op/s 2023-05-08T09:22:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20298.028121 secs 2023-05-08T09:22:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20298.584346 secs 2023-05-08T09:22:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20298.584346 secs 2023-05-08T09:22:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20298.584346 secs 2023-05-08T09:22:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:41 smithi133 ceph-mon[125939]: pgmap v10883: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 153 KiB/s wr, 8 op/s 2023-05-08T09:22:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:41 smithi096 ceph-mon[124666]: pgmap v10883: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 153 KiB/s wr, 8 op/s 2023-05-08T09:22:41.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:41 smithi186 ceph-mon[126480]: pgmap v10883: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 153 KiB/s wr, 8 op/s 2023-05-08T09:22:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:43 smithi133 ceph-mon[125939]: pgmap v10884: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 153 KiB/s wr, 6 op/s 2023-05-08T09:22:43.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:43 smithi096 ceph-mon[124666]: pgmap v10884: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 153 KiB/s wr, 6 op/s 2023-05-08T09:22:43.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:43 smithi186 ceph-mon[126480]: pgmap v10884: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 153 KiB/s wr, 6 op/s 2023-05-08T09:22:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20303.028241 secs 2023-05-08T09:22:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:44 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:22:44.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20303.028241 secs 2023-05-08T09:22:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:44 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:22:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20303.028241 secs 2023-05-08T09:22:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:44 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:22:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:45 smithi133 ceph-mon[125939]: pgmap v10885: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 154 KiB/s wr, 9 op/s 2023-05-08T09:22:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:45 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:22:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:45 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:22:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:45 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:22:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:45 smithi096 ceph-mon[124666]: pgmap v10885: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 154 KiB/s wr, 9 op/s 2023-05-08T09:22:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:45 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:22:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:45 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:22:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:45 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:22:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:45 smithi186 ceph-mon[126480]: pgmap v10885: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 154 KiB/s wr, 9 op/s 2023-05-08T09:22:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:45 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:22:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:45 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:22:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:45 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:22:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20304.870620 secs 2023-05-08T09:22:46.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20304.870620 secs 2023-05-08T09:22:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20304.870620 secs 2023-05-08T09:22:47.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:47 smithi096 ceph-mon[124666]: pgmap v10886: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 170 KiB/s wr, 8 op/s 2023-05-08T09:22:47.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:47 smithi186 ceph-mon[126480]: pgmap v10886: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 170 KiB/s wr, 8 op/s 2023-05-08T09:22:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:47 smithi133 ceph-mon[125939]: pgmap v10886: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 170 KiB/s wr, 8 op/s 2023-05-08T09:22:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:22:48.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:22:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:22:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:49 smithi096 ceph-mon[124666]: pgmap v10887: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 170 KiB/s wr, 8 op/s 2023-05-08T09:22:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:22:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:22:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:22:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20308.028375 secs 2023-05-08T09:22:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:49 smithi186 ceph-mon[126480]: pgmap v10887: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 170 KiB/s wr, 8 op/s 2023-05-08T09:22:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:22:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:22:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:22:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20308.028375 secs 2023-05-08T09:22:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:49 smithi133 ceph-mon[125939]: pgmap v10887: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 170 KiB/s wr, 8 op/s 2023-05-08T09:22:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:22:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:22:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:22:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20308.028375 secs 2023-05-08T09:22:51.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:51 smithi096 ceph-mon[124666]: pgmap v10888: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 500 KiB/s wr, 13 op/s 2023-05-08T09:22:51.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20309.870712 secs 2023-05-08T09:22:51.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:51 smithi186 ceph-mon[126480]: pgmap v10888: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 500 KiB/s wr, 13 op/s 2023-05-08T09:22:51.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20309.870712 secs 2023-05-08T09:22:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:51 smithi133 ceph-mon[125939]: pgmap v10888: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 500 KiB/s wr, 13 op/s 2023-05-08T09:22:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20309.870712 secs 2023-05-08T09:22:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:53 smithi096 ceph-mon[124666]: pgmap v10889: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 511 KiB/s rd, 347 KiB/s wr, 10 op/s 2023-05-08T09:22:53.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:53 smithi186 ceph-mon[126480]: pgmap v10889: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 511 KiB/s rd, 347 KiB/s wr, 10 op/s 2023-05-08T09:22:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:53 smithi133 ceph-mon[125939]: pgmap v10889: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 511 KiB/s rd, 347 KiB/s wr, 10 op/s 2023-05-08T09:22:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20313.028510 secs 2023-05-08T09:22:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20313.028510 secs 2023-05-08T09:22:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20313.028510 secs 2023-05-08T09:22:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:55 smithi186 ceph-mon[126480]: pgmap v10890: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 598 KiB/s rd, 434 KiB/s wr, 14 op/s 2023-05-08T09:22:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:55 smithi133 ceph-mon[125939]: pgmap v10890: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 598 KiB/s rd, 434 KiB/s wr, 14 op/s 2023-05-08T09:22:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:55 smithi096 ceph-mon[124666]: pgmap v10890: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 598 KiB/s rd, 434 KiB/s wr, 14 op/s 2023-05-08T09:22:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:22:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:22:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:22:57.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:57 smithi186 ceph-mon[126480]: pgmap v10891: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 597 KiB/s rd, 445 KiB/s wr, 12 op/s 2023-05-08T09:22:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:57 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:22:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:22:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:22:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:57 smithi133 ceph-mon[125939]: pgmap v10891: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 597 KiB/s rd, 445 KiB/s wr, 12 op/s 2023-05-08T09:22:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:57 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:22:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:22:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:22:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:57 smithi096 ceph-mon[124666]: pgmap v10891: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 597 KiB/s rd, 445 KiB/s wr, 12 op/s 2023-05-08T09:22:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:57 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:22:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:22:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:22:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:22:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:22:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:22:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:22:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:22:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:22:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:22:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:22:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:22:58.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:22:58.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:22:58.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:22:58.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:22:58.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:22:58.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:22:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:22:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:22:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:22:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:22:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:22:58.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:22:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:59 smithi186 ceph-mon[126480]: pgmap v10892: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 428 KiB/s wr, 10 op/s 2023-05-08T09:22:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20318.028623 secs 2023-05-08T09:22:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:22:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:22:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:59 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:22:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:22:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:59 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T09:22:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:59 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T09:22:59.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:22:59 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:22:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:59 smithi133 ceph-mon[125939]: pgmap v10892: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 428 KiB/s wr, 10 op/s 2023-05-08T09:22:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20318.028623 secs 2023-05-08T09:22:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:22:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:22:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:59 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:22:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:22:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:59 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T09:22:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:59 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T09:22:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:22:59 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:22:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:59 smithi096 ceph-mon[124666]: pgmap v10892: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 428 KiB/s wr, 10 op/s 2023-05-08T09:22:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20318.028623 secs 2023-05-08T09:22:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:22:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:22:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:59 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:22:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:22:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:59 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T09:22:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:59 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T09:22:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:22:59 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:23:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20318.584741 secs 2023-05-08T09:23:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20318.584741 secs 2023-05-08T09:23:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20318.584741 secs 2023-05-08T09:23:01.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20319.870990 secs 2023-05-08T09:23:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:01 smithi186 ceph-mon[126480]: pgmap v10893: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 613 KiB/s rd, 600 KiB/s wr, 16 op/s 2023-05-08T09:23:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:23:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:23:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20319.870990 secs 2023-05-08T09:23:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:01 smithi133 ceph-mon[125939]: pgmap v10893: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 613 KiB/s rd, 600 KiB/s wr, 16 op/s 2023-05-08T09:23:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:23:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:23:01.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20319.870990 secs 2023-05-08T09:23:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:01 smithi096 ceph-mon[124666]: pgmap v10893: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 613 KiB/s rd, 600 KiB/s wr, 16 op/s 2023-05-08T09:23:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:23:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:23:03.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:03 smithi186 ceph-mon[126480]: pgmap v10894: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 271 KiB/s wr, 10 op/s 2023-05-08T09:23:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:03 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:23:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:03 smithi133 ceph-mon[125939]: pgmap v10894: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 271 KiB/s wr, 10 op/s 2023-05-08T09:23:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:03 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:23:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:03 smithi096 ceph-mon[124666]: pgmap v10894: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 271 KiB/s wr, 10 op/s 2023-05-08T09:23:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:03 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:23:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20323.028771 secs 2023-05-08T09:23:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20323.028771 secs 2023-05-08T09:23:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20323.028771 secs 2023-05-08T09:23:05.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20323.584823 secs 2023-05-08T09:23:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:05 smithi186 ceph-mon[126480]: pgmap v10895: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 352 KiB/s rd, 363 KiB/s wr, 25 op/s 2023-05-08T09:23:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:23:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:23:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20323.584823 secs 2023-05-08T09:23:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:05 smithi133 ceph-mon[125939]: pgmap v10895: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 352 KiB/s rd, 363 KiB/s wr, 25 op/s 2023-05-08T09:23:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:23:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:23:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20323.584823 secs 2023-05-08T09:23:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:05 smithi096 ceph-mon[124666]: pgmap v10895: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 352 KiB/s rd, 363 KiB/s wr, 25 op/s 2023-05-08T09:23:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:23:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:23:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20324.871106 secs 2023-05-08T09:23:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20324.871106 secs 2023-05-08T09:23:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20324.871106 secs 2023-05-08T09:23:07.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:07 smithi186 ceph-mon[126480]: pgmap v10896: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 299 KiB/s wr, 24 op/s 2023-05-08T09:23:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:07 smithi133 ceph-mon[125939]: pgmap v10896: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 299 KiB/s wr, 24 op/s 2023-05-08T09:23:07.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:07 smithi096 ceph-mon[124666]: pgmap v10896: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 299 KiB/s wr, 24 op/s 2023-05-08T09:23:08.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:08 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:23:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:08 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:23:08.819 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:08 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:23:09.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:09 smithi186 ceph-mon[126480]: pgmap v10897: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 287 KiB/s wr, 23 op/s 2023-05-08T09:23:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20328.028890 secs 2023-05-08T09:23:09.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:09 smithi133 ceph-mon[125939]: pgmap v10897: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 287 KiB/s wr, 23 op/s 2023-05-08T09:23:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20328.028890 secs 2023-05-08T09:23:09.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:09 smithi096 ceph-mon[124666]: pgmap v10897: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 287 KiB/s wr, 23 op/s 2023-05-08T09:23:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20328.028890 secs 2023-05-08T09:23:10.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20328.584932 secs 2023-05-08T09:23:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20328.584932 secs 2023-05-08T09:23:10.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20328.584932 secs 2023-05-08T09:23:11.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20329.871224 secs 2023-05-08T09:23:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:11 smithi186 ceph-mon[126480]: pgmap v10898: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 360 KiB/s wr, 26 op/s 2023-05-08T09:23:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:11 smithi186 ceph-mon[126480]: osdmap e758: 12 total, 12 up, 12 in 2023-05-08T09:23:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20329.871224 secs 2023-05-08T09:23:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:11 smithi133 ceph-mon[125939]: pgmap v10898: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 360 KiB/s wr, 26 op/s 2023-05-08T09:23:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:11 smithi133 ceph-mon[125939]: osdmap e758: 12 total, 12 up, 12 in 2023-05-08T09:23:11.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20329.871224 secs 2023-05-08T09:23:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:11 smithi096 ceph-mon[124666]: pgmap v10898: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 360 KiB/s wr, 26 op/s 2023-05-08T09:23:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:11 smithi096 ceph-mon[124666]: osdmap e758: 12 total, 12 up, 12 in 2023-05-08T09:23:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:13 smithi186 ceph-mon[126480]: pgmap v10900: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 225 KiB/s wr, 25 op/s 2023-05-08T09:23:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:13 smithi133 ceph-mon[125939]: pgmap v10900: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 225 KiB/s wr, 25 op/s 2023-05-08T09:23:13.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:13 smithi096 ceph-mon[124666]: pgmap v10900: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 225 KiB/s wr, 25 op/s 2023-05-08T09:23:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20333.029008 secs 2023-05-08T09:23:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20333.029008 secs 2023-05-08T09:23:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20333.029008 secs 2023-05-08T09:23:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20333.585050 secs 2023-05-08T09:23:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:15 smithi186 ceph-mon[126480]: pgmap v10901: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 114 KiB/s wr, 9 op/s 2023-05-08T09:23:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20333.585050 secs 2023-05-08T09:23:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:15 smithi133 ceph-mon[125939]: pgmap v10901: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 114 KiB/s wr, 9 op/s 2023-05-08T09:23:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20333.585050 secs 2023-05-08T09:23:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:15 smithi096 ceph-mon[124666]: pgmap v10901: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 114 KiB/s wr, 9 op/s 2023-05-08T09:23:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20334.871341 secs 2023-05-08T09:23:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20334.871341 secs 2023-05-08T09:23:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20334.871341 secs 2023-05-08T09:23:17.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:17 smithi186 ceph-mon[126480]: pgmap v10902: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 87 KiB/s wr, 6 op/s 2023-05-08T09:23:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:17 smithi133 ceph-mon[125939]: pgmap v10902: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 87 KiB/s wr, 6 op/s 2023-05-08T09:23:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:17 smithi096 ceph-mon[124666]: pgmap v10902: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 87 KiB/s wr, 6 op/s 2023-05-08T09:23:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:19 smithi133 ceph-mon[125939]: pgmap v10903: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 87 KiB/s wr, 6 op/s 2023-05-08T09:23:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:19 smithi133 ceph-mon[125939]: osdmap e759: 12 total, 12 up, 12 in 2023-05-08T09:23:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20338.029075 secs 2023-05-08T09:23:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:19 smithi096 ceph-mon[124666]: pgmap v10903: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 87 KiB/s wr, 6 op/s 2023-05-08T09:23:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:19 smithi096 ceph-mon[124666]: osdmap e759: 12 total, 12 up, 12 in 2023-05-08T09:23:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20338.029075 secs 2023-05-08T09:23:19.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:19 smithi186 ceph-mon[126480]: pgmap v10903: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 87 KiB/s wr, 6 op/s 2023-05-08T09:23:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:19 smithi186 ceph-mon[126480]: osdmap e759: 12 total, 12 up, 12 in 2023-05-08T09:23:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20338.029075 secs 2023-05-08T09:23:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20338.585159 secs 2023-05-08T09:23:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20338.585159 secs 2023-05-08T09:23:20.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20338.585159 secs 2023-05-08T09:23:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20339.871451 secs 2023-05-08T09:23:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:21 smithi133 ceph-mon[125939]: pgmap v10905: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 64 KiB/s wr, 6 op/s 2023-05-08T09:23:21.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20339.871451 secs 2023-05-08T09:23:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:21 smithi096 ceph-mon[124666]: pgmap v10905: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 64 KiB/s wr, 6 op/s 2023-05-08T09:23:21.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20339.871451 secs 2023-05-08T09:23:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:21 smithi186 ceph-mon[126480]: pgmap v10905: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 64 KiB/s wr, 6 op/s 2023-05-08T09:23:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:23 smithi133 ceph-mon[125939]: pgmap v10906: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T09:23:23.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:23 smithi096 ceph-mon[124666]: pgmap v10906: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T09:23:23.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:23 smithi186 ceph-mon[126480]: pgmap v10906: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T09:23:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20343.029143 secs 2023-05-08T09:23:24.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20343.029143 secs 2023-05-08T09:23:24.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20343.029143 secs 2023-05-08T09:23:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20343.585275 secs 2023-05-08T09:23:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:25 smithi133 ceph-mon[125939]: pgmap v10907: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T09:23:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20343.585275 secs 2023-05-08T09:23:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:25 smithi096 ceph-mon[124666]: pgmap v10907: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T09:23:25.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20343.585275 secs 2023-05-08T09:23:25.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:25 smithi186 ceph-mon[126480]: pgmap v10907: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T09:23:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20344.871568 secs 2023-05-08T09:23:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20344.871568 secs 2023-05-08T09:23:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20344.871568 secs 2023-05-08T09:23:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:27 smithi133 ceph-mon[125939]: pgmap v10908: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T09:23:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:27 smithi096 ceph-mon[124666]: pgmap v10908: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T09:23:27.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:27 smithi186 ceph-mon[126480]: pgmap v10908: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T09:23:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:29 smithi133 ceph-mon[125939]: pgmap v10909: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T09:23:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20348.029283 secs 2023-05-08T09:23:29.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:29 smithi096 ceph-mon[124666]: pgmap v10909: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T09:23:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20348.029283 secs 2023-05-08T09:23:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:29 smithi186 ceph-mon[126480]: pgmap v10909: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T09:23:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20348.029283 secs 2023-05-08T09:23:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20348.585419 secs 2023-05-08T09:23:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20348.585419 secs 2023-05-08T09:23:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20348.585419 secs 2023-05-08T09:23:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20349.871642 secs 2023-05-08T09:23:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:31 smithi133 ceph-mon[125939]: pgmap v10910: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 53 KiB/s wr, 9 op/s 2023-05-08T09:23:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20349.871642 secs 2023-05-08T09:23:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:31 smithi096 ceph-mon[124666]: pgmap v10910: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 53 KiB/s wr, 9 op/s 2023-05-08T09:23:31.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20349.871642 secs 2023-05-08T09:23:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:31 smithi186 ceph-mon[126480]: pgmap v10910: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 53 KiB/s wr, 9 op/s 2023-05-08T09:23:33.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:33 smithi133 ceph-mon[125939]: pgmap v10911: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T09:23:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:33 smithi096 ceph-mon[124666]: pgmap v10911: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T09:23:33.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:33 smithi186 ceph-mon[126480]: pgmap v10911: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T09:23:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20353.029399 secs 2023-05-08T09:23:34.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20353.029399 secs 2023-05-08T09:23:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20353.029399 secs 2023-05-08T09:23:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20353.585534 secs 2023-05-08T09:23:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:35 smithi133 ceph-mon[125939]: pgmap v10912: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 131 KiB/s wr, 9 op/s 2023-05-08T09:23:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20353.585534 secs 2023-05-08T09:23:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:35 smithi096 ceph-mon[124666]: pgmap v10912: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 131 KiB/s wr, 9 op/s 2023-05-08T09:23:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20353.585534 secs 2023-05-08T09:23:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:35 smithi186 ceph-mon[126480]: pgmap v10912: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 131 KiB/s wr, 9 op/s 2023-05-08T09:23:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20354.871763 secs 2023-05-08T09:23:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20354.871763 secs 2023-05-08T09:23:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20354.871763 secs 2023-05-08T09:23:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:37 smithi133 ceph-mon[125939]: pgmap v10913: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 131 KiB/s wr, 7 op/s 2023-05-08T09:23:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:37 smithi096 ceph-mon[124666]: pgmap v10913: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 131 KiB/s wr, 7 op/s 2023-05-08T09:23:37.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:37 smithi186 ceph-mon[126480]: pgmap v10913: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 131 KiB/s wr, 7 op/s 2023-05-08T09:23:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:39 smithi133 ceph-mon[125939]: pgmap v10914: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 131 KiB/s wr, 6 op/s 2023-05-08T09:23:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20358.029462 secs 2023-05-08T09:23:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:39 smithi096 ceph-mon[124666]: pgmap v10914: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 131 KiB/s wr, 6 op/s 2023-05-08T09:23:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20358.029462 secs 2023-05-08T09:23:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:39 smithi186 ceph-mon[126480]: pgmap v10914: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 131 KiB/s wr, 6 op/s 2023-05-08T09:23:39.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20358.029462 secs 2023-05-08T09:23:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20358.585644 secs 2023-05-08T09:23:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20358.585644 secs 2023-05-08T09:23:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20358.585644 secs 2023-05-08T09:23:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:41 smithi133 ceph-mon[125939]: pgmap v10915: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 135 KiB/s wr, 9 op/s 2023-05-08T09:23:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:41 smithi096 ceph-mon[124666]: pgmap v10915: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 135 KiB/s wr, 9 op/s 2023-05-08T09:23:41.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:41 smithi186 ceph-mon[126480]: pgmap v10915: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 135 KiB/s wr, 9 op/s 2023-05-08T09:23:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:43 smithi133 ceph-mon[125939]: pgmap v10916: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 134 KiB/s wr, 6 op/s 2023-05-08T09:23:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:43 smithi096 ceph-mon[124666]: pgmap v10916: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 134 KiB/s wr, 6 op/s 2023-05-08T09:23:43.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:43 smithi186 ceph-mon[126480]: pgmap v10916: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 134 KiB/s wr, 6 op/s 2023-05-08T09:23:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20363.029590 secs 2023-05-08T09:23:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:44 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:23:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20363.029590 secs 2023-05-08T09:23:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:44 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:23:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20363.029590 secs 2023-05-08T09:23:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:44 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:23:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20363.585764 secs 2023-05-08T09:23:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:45 smithi133 ceph-mon[125939]: pgmap v10917: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 268 KiB/s wr, 9 op/s 2023-05-08T09:23:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:45 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:23:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:45 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:23:45.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:45 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:23:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20363.585764 secs 2023-05-08T09:23:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:45 smithi096 ceph-mon[124666]: pgmap v10917: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 268 KiB/s wr, 9 op/s 2023-05-08T09:23:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:45 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:23:45.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:45 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:23:45.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:45 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:23:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20363.585764 secs 2023-05-08T09:23:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:45 smithi186 ceph-mon[126480]: pgmap v10917: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 268 KiB/s wr, 9 op/s 2023-05-08T09:23:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:45 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:23:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:45 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:23:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:45 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:23:47.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:47 smithi133 ceph-mon[125939]: pgmap v10918: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 138 KiB/s wr, 7 op/s 2023-05-08T09:23:47.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:47 smithi096 ceph-mon[124666]: pgmap v10918: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 138 KiB/s wr, 7 op/s 2023-05-08T09:23:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:47 smithi186 ceph-mon[126480]: pgmap v10918: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 138 KiB/s wr, 7 op/s 2023-05-08T09:23:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:49 smithi096 ceph-mon[124666]: pgmap v10919: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 138 KiB/s wr, 6 op/s 2023-05-08T09:23:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20368.029711 secs 2023-05-08T09:23:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:49 smithi186 ceph-mon[126480]: pgmap v10919: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 138 KiB/s wr, 6 op/s 2023-05-08T09:23:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20368.029711 secs 2023-05-08T09:23:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:49 smithi133 ceph-mon[125939]: pgmap v10919: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 138 KiB/s wr, 6 op/s 2023-05-08T09:23:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20368.029711 secs 2023-05-08T09:23:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20369.872129 secs 2023-05-08T09:23:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:51 smithi096 ceph-mon[124666]: pgmap v10920: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 344 KiB/s wr, 11 op/s 2023-05-08T09:23:51.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20369.872129 secs 2023-05-08T09:23:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:51 smithi186 ceph-mon[126480]: pgmap v10920: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 344 KiB/s wr, 11 op/s 2023-05-08T09:23:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20369.872129 secs 2023-05-08T09:23:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:51 smithi133 ceph-mon[125939]: pgmap v10920: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 344 KiB/s wr, 11 op/s 2023-05-08T09:23:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:23:52.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:23:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:23:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:53 smithi186 ceph-mon[126480]: pgmap v10921: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 339 KiB/s wr, 8 op/s 2023-05-08T09:23:53.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:23:53.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:23:53.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:23:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:53 smithi133 ceph-mon[125939]: pgmap v10921: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 339 KiB/s wr, 8 op/s 2023-05-08T09:23:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:23:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:23:53.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:23:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:53 smithi096 ceph-mon[124666]: pgmap v10921: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 339 KiB/s wr, 8 op/s 2023-05-08T09:23:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:23:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:23:53.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:23:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20373.029859 secs 2023-05-08T09:23:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20373.029859 secs 2023-05-08T09:23:54.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20373.029859 secs 2023-05-08T09:23:55.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20373.585967 secs 2023-05-08T09:23:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:55 smithi186 ceph-mon[126480]: pgmap v10922: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 368 KiB/s wr, 12 op/s 2023-05-08T09:23:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20373.585967 secs 2023-05-08T09:23:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:55 smithi133 ceph-mon[125939]: pgmap v10922: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 368 KiB/s wr, 12 op/s 2023-05-08T09:23:55.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20373.585967 secs 2023-05-08T09:23:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:55 smithi096 ceph-mon[124666]: pgmap v10922: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 368 KiB/s wr, 12 op/s 2023-05-08T09:23:56.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20374.872246 secs 2023-05-08T09:23:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20374.872246 secs 2023-05-08T09:23:56.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20374.872246 secs 2023-05-08T09:23:57.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:57 smithi186 ceph-mon[126480]: pgmap v10923: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 463 KiB/s wr, 10 op/s 2023-05-08T09:23:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:57 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:23:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:23:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:23:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:57 smithi133 ceph-mon[125939]: pgmap v10923: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 463 KiB/s wr, 10 op/s 2023-05-08T09:23:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:57 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:23:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:23:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:23:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:57 smithi096 ceph-mon[124666]: pgmap v10923: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 463 KiB/s wr, 10 op/s 2023-05-08T09:23:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:57 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:23:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:23:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:23:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:59 smithi133 ceph-mon[125939]: pgmap v10924: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 463 KiB/s wr, 10 op/s 2023-05-08T09:23:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20378.029999 secs 2023-05-08T09:23:59.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:23:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:23:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:59 smithi096 ceph-mon[124666]: pgmap v10924: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 463 KiB/s wr, 10 op/s 2023-05-08T09:23:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20378.029999 secs 2023-05-08T09:23:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:23:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:23:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:59 smithi186 ceph-mon[126480]: pgmap v10924: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 463 KiB/s wr, 10 op/s 2023-05-08T09:23:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20378.029999 secs 2023-05-08T09:23:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:23:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:24:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:24:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:24:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:00 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:24:00.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:24:00.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:00 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T09:24:00.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:00 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T09:24:00.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:00 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:24:00.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:00 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:24:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:24:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:24:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:00 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:24:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:24:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:00 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T09:24:00.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:00 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T09:24:00.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:00 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:24:00.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:00 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:24:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:24:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:24:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:00 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:24:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:24:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:00 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T09:24:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:00 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T09:24:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:00 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:24:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:00 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:24:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:01 smithi133 ceph-mon[125939]: pgmap v10925: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 566 KiB/s rd, 564 KiB/s wr, 15 op/s 2023-05-08T09:24:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:24:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:24:01.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:01 smithi096 ceph-mon[124666]: pgmap v10925: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 566 KiB/s rd, 564 KiB/s wr, 15 op/s 2023-05-08T09:24:01.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:24:01.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:24:01.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:01 smithi186 ceph-mon[126480]: pgmap v10925: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 566 KiB/s rd, 564 KiB/s wr, 15 op/s 2023-05-08T09:24:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:24:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:24:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:03 smithi133 ceph-mon[125939]: pgmap v10926: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 358 KiB/s wr, 11 op/s 2023-05-08T09:24:03.494 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:03 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:24:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:03 smithi096 ceph-mon[124666]: pgmap v10926: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 358 KiB/s wr, 11 op/s 2023-05-08T09:24:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:03 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:24:03.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:03 smithi186 ceph-mon[126480]: pgmap v10926: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 358 KiB/s wr, 11 op/s 2023-05-08T09:24:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:03 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:24:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20383.030105 secs 2023-05-08T09:24:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:04 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:24:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20383.030105 secs 2023-05-08T09:24:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:04 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:24:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20383.030105 secs 2023-05-08T09:24:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:04 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:24:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20383.586246 secs 2023-05-08T09:24:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:05 smithi133 ceph-mon[125939]: pgmap v10927: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 597 KiB/s rd, 599 KiB/s wr, 27 op/s 2023-05-08T09:24:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:24:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:24:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20383.586246 secs 2023-05-08T09:24:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:05 smithi096 ceph-mon[124666]: pgmap v10927: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 597 KiB/s rd, 599 KiB/s wr, 27 op/s 2023-05-08T09:24:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:24:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:24:05.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20383.586246 secs 2023-05-08T09:24:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:05 smithi186 ceph-mon[126480]: pgmap v10927: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 597 KiB/s rd, 599 KiB/s wr, 27 op/s 2023-05-08T09:24:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:24:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:24:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20384.872483 secs 2023-05-08T09:24:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:06 smithi133 ceph-mon[125939]: osdmap e760: 12 total, 12 up, 12 in 2023-05-08T09:24:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20384.872483 secs 2023-05-08T09:24:06.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:06 smithi096 ceph-mon[124666]: osdmap e760: 12 total, 12 up, 12 in 2023-05-08T09:24:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20384.872483 secs 2023-05-08T09:24:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:06 smithi186 ceph-mon[126480]: osdmap e760: 12 total, 12 up, 12 in 2023-05-08T09:24:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:07 smithi133 ceph-mon[125939]: pgmap v10929: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 480 KiB/s wr, 30 op/s 2023-05-08T09:24:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:07 smithi096 ceph-mon[124666]: pgmap v10929: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 480 KiB/s wr, 30 op/s 2023-05-08T09:24:07.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:07 smithi186 ceph-mon[126480]: pgmap v10929: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 480 KiB/s wr, 30 op/s 2023-05-08T09:24:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:08 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:24:08.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:08 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:24:08.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:08 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:24:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:09 smithi096 ceph-mon[124666]: pgmap v10930: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 480 KiB/s wr, 30 op/s 2023-05-08T09:24:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:24:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:24:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:24:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20388.030249 secs 2023-05-08T09:24:09.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:09 smithi186 ceph-mon[126480]: pgmap v10930: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 480 KiB/s wr, 30 op/s 2023-05-08T09:24:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:24:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:24:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:24:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20388.030249 secs 2023-05-08T09:24:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:09 smithi133 ceph-mon[125939]: pgmap v10930: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 480 KiB/s wr, 30 op/s 2023-05-08T09:24:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:24:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:24:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:24:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20388.030249 secs 2023-05-08T09:24:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20388.586362 secs 2023-05-08T09:24:10.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20388.586362 secs 2023-05-08T09:24:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20388.586362 secs 2023-05-08T09:24:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20389.872621 secs 2023-05-08T09:24:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:11 smithi096 ceph-mon[124666]: pgmap v10931: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 448 KiB/s wr, 28 op/s 2023-05-08T09:24:11.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20389.872621 secs 2023-05-08T09:24:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:11 smithi186 ceph-mon[126480]: pgmap v10931: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 448 KiB/s wr, 28 op/s 2023-05-08T09:24:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20389.872621 secs 2023-05-08T09:24:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:11 smithi133 ceph-mon[125939]: pgmap v10931: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 448 KiB/s wr, 28 op/s 2023-05-08T09:24:13.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:13 smithi186 ceph-mon[126480]: pgmap v10932: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 448 KiB/s wr, 28 op/s 2023-05-08T09:24:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:13 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:24:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:13 smithi186 ceph-mon[126480]: osdmap e761: 12 total, 12 up, 12 in 2023-05-08T09:24:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:13 smithi133 ceph-mon[125939]: pgmap v10932: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 448 KiB/s wr, 28 op/s 2023-05-08T09:24:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:13 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:24:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:13 smithi133 ceph-mon[125939]: osdmap e761: 12 total, 12 up, 12 in 2023-05-08T09:24:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:13 smithi096 ceph-mon[124666]: pgmap v10932: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 448 KiB/s wr, 28 op/s 2023-05-08T09:24:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:13 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:24:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:13 smithi096 ceph-mon[124666]: osdmap e761: 12 total, 12 up, 12 in 2023-05-08T09:24:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20393.030394 secs 2023-05-08T09:24:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20393.030394 secs 2023-05-08T09:24:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20393.030394 secs 2023-05-08T09:24:15.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20393.586491 secs 2023-05-08T09:24:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:15 smithi186 ceph-mon[126480]: pgmap v10934: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 170 KiB/s wr, 9 op/s 2023-05-08T09:24:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20393.586491 secs 2023-05-08T09:24:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:15 smithi133 ceph-mon[125939]: pgmap v10934: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 170 KiB/s wr, 9 op/s 2023-05-08T09:24:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20393.586491 secs 2023-05-08T09:24:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:15 smithi096 ceph-mon[124666]: pgmap v10934: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 170 KiB/s wr, 9 op/s 2023-05-08T09:24:16.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20394.872758 secs 2023-05-08T09:24:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20394.872758 secs 2023-05-08T09:24:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20394.872758 secs 2023-05-08T09:24:17.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:17 smithi186 ceph-mon[126480]: pgmap v10935: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 151 KiB/s wr, 8 op/s 2023-05-08T09:24:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:17 smithi133 ceph-mon[125939]: pgmap v10935: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 151 KiB/s wr, 8 op/s 2023-05-08T09:24:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:17 smithi096 ceph-mon[124666]: pgmap v10935: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 151 KiB/s wr, 8 op/s 2023-05-08T09:24:19.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:19 smithi186 ceph-mon[126480]: pgmap v10936: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 151 KiB/s wr, 8 op/s 2023-05-08T09:24:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20398.030487 secs 2023-05-08T09:24:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:19 smithi133 ceph-mon[125939]: pgmap v10936: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 151 KiB/s wr, 8 op/s 2023-05-08T09:24:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20398.030487 secs 2023-05-08T09:24:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:19 smithi096 ceph-mon[124666]: pgmap v10936: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 151 KiB/s wr, 8 op/s 2023-05-08T09:24:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20398.030487 secs 2023-05-08T09:24:20.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20398.586606 secs 2023-05-08T09:24:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20398.586606 secs 2023-05-08T09:24:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20398.586606 secs 2023-05-08T09:24:21.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20399.872894 secs 2023-05-08T09:24:21.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:21 smithi186 ceph-mon[126480]: pgmap v10937: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 63 KiB/s wr, 6 op/s 2023-05-08T09:24:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20399.872894 secs 2023-05-08T09:24:21.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:21 smithi133 ceph-mon[125939]: pgmap v10937: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 63 KiB/s wr, 6 op/s 2023-05-08T09:24:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20399.872894 secs 2023-05-08T09:24:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:21 smithi096 ceph-mon[124666]: pgmap v10937: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 63 KiB/s wr, 6 op/s 2023-05-08T09:24:23.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:23 smithi186 ceph-mon[126480]: pgmap v10938: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 63 KiB/s wr, 6 op/s 2023-05-08T09:24:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:23 smithi133 ceph-mon[125939]: pgmap v10938: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 63 KiB/s wr, 6 op/s 2023-05-08T09:24:23.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:23 smithi096 ceph-mon[124666]: pgmap v10938: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 63 KiB/s wr, 6 op/s 2023-05-08T09:24:24.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20403.030613 secs 2023-05-08T09:24:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20403.030613 secs 2023-05-08T09:24:24.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20403.030613 secs 2023-05-08T09:24:25.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20403.586725 secs 2023-05-08T09:24:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:25 smithi186 ceph-mon[126480]: pgmap v10939: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 57 KiB/s wr, 8 op/s 2023-05-08T09:24:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20403.586725 secs 2023-05-08T09:24:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:25 smithi133 ceph-mon[125939]: pgmap v10939: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 57 KiB/s wr, 8 op/s 2023-05-08T09:24:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20403.586725 secs 2023-05-08T09:24:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:25 smithi096 ceph-mon[124666]: pgmap v10939: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 57 KiB/s wr, 8 op/s 2023-05-08T09:24:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20404.873017 secs 2023-05-08T09:24:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20404.873017 secs 2023-05-08T09:24:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20404.873017 secs 2023-05-08T09:24:27.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:27 smithi186 ceph-mon[126480]: pgmap v10940: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-05-08T09:24:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:27 smithi133 ceph-mon[125939]: pgmap v10940: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-05-08T09:24:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:27 smithi096 ceph-mon[124666]: pgmap v10940: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-05-08T09:24:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:29 smithi186 ceph-mon[126480]: pgmap v10941: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:24:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20408.030728 secs 2023-05-08T09:24:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:29 smithi133 ceph-mon[125939]: pgmap v10941: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:24:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20408.030728 secs 2023-05-08T09:24:29.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:29 smithi096 ceph-mon[124666]: pgmap v10941: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:24:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20408.030728 secs 2023-05-08T09:24:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20408.586839 secs 2023-05-08T09:24:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20408.586839 secs 2023-05-08T09:24:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20408.586839 secs 2023-05-08T09:24:31.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20409.873136 secs 2023-05-08T09:24:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:31 smithi186 ceph-mon[126480]: pgmap v10942: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T09:24:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20409.873136 secs 2023-05-08T09:24:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:31 smithi133 ceph-mon[125939]: pgmap v10942: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T09:24:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20409.873136 secs 2023-05-08T09:24:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:31 smithi096 ceph-mon[124666]: pgmap v10942: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T09:24:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:33 smithi186 ceph-mon[126480]: pgmap v10943: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T09:24:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:33 smithi133 ceph-mon[125939]: pgmap v10943: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T09:24:33.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:33 smithi096 ceph-mon[124666]: pgmap v10943: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T09:24:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20413.030890 secs 2023-05-08T09:24:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20413.030890 secs 2023-05-08T09:24:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20413.030890 secs 2023-05-08T09:24:35.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20413.586980 secs 2023-05-08T09:24:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:35 smithi186 ceph-mon[126480]: pgmap v10944: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 10 KiB/s wr, 8 op/s 2023-05-08T09:24:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20413.586980 secs 2023-05-08T09:24:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:35 smithi133 ceph-mon[125939]: pgmap v10944: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 10 KiB/s wr, 8 op/s 2023-05-08T09:24:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20413.586980 secs 2023-05-08T09:24:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:35 smithi096 ceph-mon[124666]: pgmap v10944: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 10 KiB/s wr, 8 op/s 2023-05-08T09:24:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20414.873279 secs 2023-05-08T09:24:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20414.873279 secs 2023-05-08T09:24:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20414.873279 secs 2023-05-08T09:24:37.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:37 smithi186 ceph-mon[126480]: pgmap v10945: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 69 KiB/s wr, 6 op/s 2023-05-08T09:24:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:37 smithi133 ceph-mon[125939]: pgmap v10945: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 69 KiB/s wr, 6 op/s 2023-05-08T09:24:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:37 smithi096 ceph-mon[124666]: pgmap v10945: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 69 KiB/s wr, 6 op/s 2023-05-08T09:24:39.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:39 smithi186 ceph-mon[126480]: pgmap v10946: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 69 KiB/s wr, 6 op/s 2023-05-08T09:24:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20418.031005 secs 2023-05-08T09:24:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:39 smithi133 ceph-mon[125939]: pgmap v10946: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 69 KiB/s wr, 6 op/s 2023-05-08T09:24:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20418.031005 secs 2023-05-08T09:24:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:39 smithi096 ceph-mon[124666]: pgmap v10946: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 69 KiB/s wr, 6 op/s 2023-05-08T09:24:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20418.031005 secs 2023-05-08T09:24:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20418.587080 secs 2023-05-08T09:24:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20418.587080 secs 2023-05-08T09:24:40.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20418.587080 secs 2023-05-08T09:24:41.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:41 smithi186 ceph-mon[126480]: pgmap v10947: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 69 KiB/s wr, 10 op/s 2023-05-08T09:24:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:41 smithi133 ceph-mon[125939]: pgmap v10947: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 69 KiB/s wr, 10 op/s 2023-05-08T09:24:41.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:41 smithi096 ceph-mon[124666]: pgmap v10947: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 69 KiB/s wr, 10 op/s 2023-05-08T09:24:43.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:43 smithi186 ceph-mon[126480]: pgmap v10948: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 69 KiB/s wr, 7 op/s 2023-05-08T09:24:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:24:43.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:43 smithi133 ceph-mon[125939]: pgmap v10948: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 69 KiB/s wr, 7 op/s 2023-05-08T09:24:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:24:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:43 smithi096 ceph-mon[124666]: pgmap v10948: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 69 KiB/s wr, 7 op/s 2023-05-08T09:24:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:24:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20423.031123 secs 2023-05-08T09:24:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:24:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:24:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:24:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20423.031123 secs 2023-05-08T09:24:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:24:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:24:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:24:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20423.031123 secs 2023-05-08T09:24:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:24:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:24:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:24:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20423.587197 secs 2023-05-08T09:24:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:45 smithi133 ceph-mon[125939]: pgmap v10949: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 69 KiB/s wr, 9 op/s 2023-05-08T09:24:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20423.587197 secs 2023-05-08T09:24:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:45 smithi096 ceph-mon[124666]: pgmap v10949: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 69 KiB/s wr, 9 op/s 2023-05-08T09:24:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20423.587197 secs 2023-05-08T09:24:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:45 smithi186 ceph-mon[126480]: pgmap v10949: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 69 KiB/s wr, 9 op/s 2023-05-08T09:24:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:47 smithi133 ceph-mon[125939]: pgmap v10950: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 198 KiB/s wr, 7 op/s 2023-05-08T09:24:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:47 smithi096 ceph-mon[124666]: pgmap v10950: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 198 KiB/s wr, 7 op/s 2023-05-08T09:24:47.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:47 smithi186 ceph-mon[126480]: pgmap v10950: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 198 KiB/s wr, 7 op/s 2023-05-08T09:24:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:49 smithi133 ceph-mon[125939]: pgmap v10951: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 139 KiB/s wr, 7 op/s 2023-05-08T09:24:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20428.031277 secs 2023-05-08T09:24:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:49 smithi096 ceph-mon[124666]: pgmap v10951: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 139 KiB/s wr, 7 op/s 2023-05-08T09:24:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20428.031277 secs 2023-05-08T09:24:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:49 smithi186 ceph-mon[126480]: pgmap v10951: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 139 KiB/s wr, 7 op/s 2023-05-08T09:24:49.885 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20428.031277 secs 2023-05-08T09:24:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:51 smithi133 ceph-mon[125939]: pgmap v10952: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 489 KiB/s rd, 418 KiB/s wr, 11 op/s 2023-05-08T09:24:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:51 smithi096 ceph-mon[124666]: pgmap v10952: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 489 KiB/s rd, 418 KiB/s wr, 11 op/s 2023-05-08T09:24:51.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:51 smithi186 ceph-mon[126480]: pgmap v10952: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 489 KiB/s rd, 418 KiB/s wr, 11 op/s 2023-05-08T09:24:52.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:24:52.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:24:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:24:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:53 smithi133 ceph-mon[125939]: pgmap v10953: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 420 KiB/s rd, 418 KiB/s wr, 7 op/s 2023-05-08T09:24:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:53 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:24:53.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:24:53.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:24:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:53 smithi096 ceph-mon[124666]: pgmap v10953: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 420 KiB/s rd, 418 KiB/s wr, 7 op/s 2023-05-08T09:24:53.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:53 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:24:53.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:24:53.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:24:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:53 smithi186 ceph-mon[126480]: pgmap v10953: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 420 KiB/s rd, 418 KiB/s wr, 7 op/s 2023-05-08T09:24:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:53 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:24:53.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:24:53.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:24:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20433.031401 secs 2023-05-08T09:24:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20433.031401 secs 2023-05-08T09:24:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20433.031401 secs 2023-05-08T09:24:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20433.587425 secs 2023-05-08T09:24:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:55 smithi133 ceph-mon[125939]: pgmap v10954: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 619 KiB/s rd, 606 KiB/s wr, 12 op/s 2023-05-08T09:24:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20433.587425 secs 2023-05-08T09:24:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:55 smithi096 ceph-mon[124666]: pgmap v10954: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 619 KiB/s rd, 606 KiB/s wr, 12 op/s 2023-05-08T09:24:55.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20433.587425 secs 2023-05-08T09:24:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:55 smithi186 ceph-mon[126480]: pgmap v10954: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 619 KiB/s rd, 606 KiB/s wr, 12 op/s 2023-05-08T09:24:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20434.873817 secs 2023-05-08T09:24:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:24:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:24:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20434.873817 secs 2023-05-08T09:24:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:24:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:24:56.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20434.873817 secs 2023-05-08T09:24:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:24:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:24:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:57 smithi133 ceph-mon[125939]: pgmap v10955: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 618 KiB/s rd, 606 KiB/s wr, 11 op/s 2023-05-08T09:24:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:24:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:24:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:57 smithi096 ceph-mon[124666]: pgmap v10955: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 618 KiB/s rd, 606 KiB/s wr, 11 op/s 2023-05-08T09:24:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:24:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:24:57.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:57 smithi186 ceph-mon[126480]: pgmap v10955: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 618 KiB/s rd, 606 KiB/s wr, 11 op/s 2023-05-08T09:24:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:24:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:24:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:58 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:24:58.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:58 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:24:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:58 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:24:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:59 smithi133 ceph-mon[125939]: pgmap v10956: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 467 KiB/s wr, 9 op/s 2023-05-08T09:24:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20438.031547 secs 2023-05-08T09:24:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:24:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:24:59.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:59 smithi096 ceph-mon[124666]: pgmap v10956: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 467 KiB/s wr, 9 op/s 2023-05-08T09:24:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20438.031547 secs 2023-05-08T09:24:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:24:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:24:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:59 smithi186 ceph-mon[126480]: pgmap v10956: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 467 KiB/s wr, 9 op/s 2023-05-08T09:24:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20438.031547 secs 2023-05-08T09:24:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:24:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:25:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:00 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:25:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:25:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:25:00.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:25:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:00 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:25:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:25:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:25:00.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:25:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:00 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:25:00.941 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:25:00.941 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:25:00.942 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:25:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:01 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:25:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:01 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T09:25:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:01 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T09:25:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:01 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:25:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20439.873876 secs 2023-05-08T09:25:01.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:01 smithi133 ceph-mon[125939]: pgmap v10957: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 642 KiB/s rd, 640 KiB/s wr, 15 op/s 2023-05-08T09:25:01.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:25:01.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:25:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:01 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:25:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:01 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T09:25:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:01 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T09:25:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:01 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:25:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20439.873876 secs 2023-05-08T09:25:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:01 smithi096 ceph-mon[124666]: pgmap v10957: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 642 KiB/s rd, 640 KiB/s wr, 15 op/s 2023-05-08T09:25:01.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:25:01.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:25:01.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:01 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:25:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:01 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T09:25:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:01 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T09:25:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:01 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:25:01.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20439.873876 secs 2023-05-08T09:25:01.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:01 smithi186 ceph-mon[126480]: pgmap v10957: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 642 KiB/s rd, 640 KiB/s wr, 15 op/s 2023-05-08T09:25:01.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:25:01.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:25:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:03 smithi133 ceph-mon[125939]: pgmap v10958: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 361 KiB/s wr, 11 op/s 2023-05-08T09:25:03.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:03 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:25:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:03 smithi096 ceph-mon[124666]: pgmap v10958: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 361 KiB/s wr, 11 op/s 2023-05-08T09:25:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:03 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:25:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:03 smithi186 ceph-mon[126480]: pgmap v10958: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 361 KiB/s wr, 11 op/s 2023-05-08T09:25:03.873 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:03 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:25:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20443.031662 secs 2023-05-08T09:25:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20443.031662 secs 2023-05-08T09:25:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20443.031662 secs 2023-05-08T09:25:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20443.587664 secs 2023-05-08T09:25:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:05 smithi133 ceph-mon[125939]: pgmap v10959: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 506 KiB/s wr, 27 op/s 2023-05-08T09:25:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20443.587664 secs 2023-05-08T09:25:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:05 smithi096 ceph-mon[124666]: pgmap v10959: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 506 KiB/s wr, 27 op/s 2023-05-08T09:25:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20443.587664 secs 2023-05-08T09:25:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:05 smithi186 ceph-mon[126480]: pgmap v10959: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 506 KiB/s wr, 27 op/s 2023-05-08T09:25:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20444.873943 secs 2023-05-08T09:25:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:06 smithi133 ceph-mon[125939]: osdmap e762: 12 total, 12 up, 12 in 2023-05-08T09:25:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20444.873943 secs 2023-05-08T09:25:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:06 smithi096 ceph-mon[124666]: osdmap e762: 12 total, 12 up, 12 in 2023-05-08T09:25:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20444.873943 secs 2023-05-08T09:25:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:06 smithi186 ceph-mon[126480]: osdmap e762: 12 total, 12 up, 12 in 2023-05-08T09:25:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:07 smithi133 ceph-mon[125939]: pgmap v10961: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 366 KiB/s rd, 407 KiB/s wr, 29 op/s 2023-05-08T09:25:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:07 smithi096 ceph-mon[124666]: pgmap v10961: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 366 KiB/s rd, 407 KiB/s wr, 29 op/s 2023-05-08T09:25:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:07 smithi186 ceph-mon[126480]: pgmap v10961: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 366 KiB/s rd, 407 KiB/s wr, 29 op/s 2023-05-08T09:25:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:25:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:25:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:08 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:25:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:25:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:25:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:08 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:25:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:25:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:25:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:08 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:25:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:09 smithi133 ceph-mon[125939]: pgmap v10962: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 366 KiB/s rd, 408 KiB/s wr, 29 op/s 2023-05-08T09:25:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20448.031791 secs 2023-05-08T09:25:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:09 smithi096 ceph-mon[124666]: pgmap v10962: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 366 KiB/s rd, 408 KiB/s wr, 29 op/s 2023-05-08T09:25:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20448.031791 secs 2023-05-08T09:25:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:09 smithi186 ceph-mon[126480]: pgmap v10962: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 366 KiB/s rd, 408 KiB/s wr, 29 op/s 2023-05-08T09:25:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20448.031791 secs 2023-05-08T09:25:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20448.587762 secs 2023-05-08T09:25:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20448.587762 secs 2023-05-08T09:25:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20448.587762 secs 2023-05-08T09:25:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20449.874024 secs 2023-05-08T09:25:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:11 smithi133 ceph-mon[125939]: pgmap v10963: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 289 KiB/s wr, 28 op/s 2023-05-08T09:25:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20449.874024 secs 2023-05-08T09:25:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:11 smithi096 ceph-mon[124666]: pgmap v10963: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 289 KiB/s wr, 28 op/s 2023-05-08T09:25:11.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20449.874024 secs 2023-05-08T09:25:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:11 smithi186 ceph-mon[126480]: pgmap v10963: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 289 KiB/s wr, 28 op/s 2023-05-08T09:25:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:13 smithi133 ceph-mon[125939]: pgmap v10964: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 289 KiB/s wr, 28 op/s 2023-05-08T09:25:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:13 smithi133 ceph-mon[125939]: osdmap e763: 12 total, 12 up, 12 in 2023-05-08T09:25:13.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:13 smithi096 ceph-mon[124666]: pgmap v10964: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 289 KiB/s wr, 28 op/s 2023-05-08T09:25:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:13 smithi096 ceph-mon[124666]: osdmap e763: 12 total, 12 up, 12 in 2023-05-08T09:25:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:13 smithi186 ceph-mon[126480]: pgmap v10964: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 289 KiB/s wr, 28 op/s 2023-05-08T09:25:13.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:13 smithi186 ceph-mon[126480]: osdmap e763: 12 total, 12 up, 12 in 2023-05-08T09:25:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20453.031940 secs 2023-05-08T09:25:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20453.031940 secs 2023-05-08T09:25:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20453.031940 secs 2023-05-08T09:25:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20453.587878 secs 2023-05-08T09:25:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:15 smithi133 ceph-mon[125939]: pgmap v10966: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 174 KiB/s wr, 9 op/s 2023-05-08T09:25:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20453.587878 secs 2023-05-08T09:25:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:15 smithi096 ceph-mon[124666]: pgmap v10966: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 174 KiB/s wr, 9 op/s 2023-05-08T09:25:15.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20453.587878 secs 2023-05-08T09:25:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:15 smithi186 ceph-mon[126480]: pgmap v10966: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 174 KiB/s wr, 9 op/s 2023-05-08T09:25:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20454.874124 secs 2023-05-08T09:25:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20454.874124 secs 2023-05-08T09:25:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20454.874124 secs 2023-05-08T09:25:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:17 smithi096 ceph-mon[124666]: pgmap v10967: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 152 KiB/s wr, 8 op/s 2023-05-08T09:25:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:17 smithi186 ceph-mon[126480]: pgmap v10967: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 152 KiB/s wr, 8 op/s 2023-05-08T09:25:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:17 smithi133 ceph-mon[125939]: pgmap v10967: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 152 KiB/s wr, 8 op/s 2023-05-08T09:25:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:19 smithi096 ceph-mon[124666]: pgmap v10968: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 152 KiB/s wr, 8 op/s 2023-05-08T09:25:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20458.032003 secs 2023-05-08T09:25:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:19 smithi186 ceph-mon[126480]: pgmap v10968: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 152 KiB/s wr, 8 op/s 2023-05-08T09:25:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20458.032003 secs 2023-05-08T09:25:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:19 smithi133 ceph-mon[125939]: pgmap v10968: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 152 KiB/s wr, 8 op/s 2023-05-08T09:25:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20458.032003 secs 2023-05-08T09:25:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20458.588012 secs 2023-05-08T09:25:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20458.588012 secs 2023-05-08T09:25:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20458.588012 secs 2023-05-08T09:25:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20459.874187 secs 2023-05-08T09:25:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:21 smithi096 ceph-mon[124666]: pgmap v10969: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 63 KiB/s wr, 6 op/s 2023-05-08T09:25:21.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20459.874187 secs 2023-05-08T09:25:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:21 smithi186 ceph-mon[126480]: pgmap v10969: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 63 KiB/s wr, 6 op/s 2023-05-08T09:25:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20459.874187 secs 2023-05-08T09:25:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:21 smithi133 ceph-mon[125939]: pgmap v10969: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 63 KiB/s wr, 6 op/s 2023-05-08T09:25:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:23 smithi096 ceph-mon[124666]: pgmap v10970: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 63 KiB/s wr, 6 op/s 2023-05-08T09:25:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:23 smithi186 ceph-mon[126480]: pgmap v10970: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 63 KiB/s wr, 6 op/s 2023-05-08T09:25:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:23 smithi133 ceph-mon[125939]: pgmap v10970: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 63 KiB/s wr, 6 op/s 2023-05-08T09:25:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20463.032124 secs 2023-05-08T09:25:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20463.032124 secs 2023-05-08T09:25:25.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20463.032124 secs 2023-05-08T09:25:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20463.588132 secs 2023-05-08T09:25:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:25 smithi186 ceph-mon[126480]: pgmap v10971: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 57 KiB/s wr, 8 op/s 2023-05-08T09:25:25.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20463.588132 secs 2023-05-08T09:25:25.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:25 smithi133 ceph-mon[125939]: pgmap v10971: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 57 KiB/s wr, 8 op/s 2023-05-08T09:25:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20463.588132 secs 2023-05-08T09:25:26.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:25 smithi096 ceph-mon[124666]: pgmap v10971: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 57 KiB/s wr, 8 op/s 2023-05-08T09:25:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20464.874307 secs 2023-05-08T09:25:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20464.874307 secs 2023-05-08T09:25:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20464.874307 secs 2023-05-08T09:25:27.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:27 smithi186 ceph-mon[126480]: pgmap v10972: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T09:25:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:27 smithi133 ceph-mon[125939]: pgmap v10972: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T09:25:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:27 smithi096 ceph-mon[124666]: pgmap v10972: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T09:25:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:29 smithi186 ceph-mon[126480]: pgmap v10973: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:25:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20468.032244 secs 2023-05-08T09:25:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:29 smithi133 ceph-mon[125939]: pgmap v10973: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:25:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20468.032244 secs 2023-05-08T09:25:30.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:29 smithi096 ceph-mon[124666]: pgmap v10973: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:25:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20468.032244 secs 2023-05-08T09:25:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20468.588244 secs 2023-05-08T09:25:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20468.588244 secs 2023-05-08T09:25:31.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20468.588244 secs 2023-05-08T09:25:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20469.874426 secs 2023-05-08T09:25:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:31 smithi186 ceph-mon[126480]: pgmap v10974: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 2.2 KiB/s wr, 8 op/s 2023-05-08T09:25:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20469.874426 secs 2023-05-08T09:25:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:31 smithi133 ceph-mon[125939]: pgmap v10974: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 2.2 KiB/s wr, 8 op/s 2023-05-08T09:25:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20469.874426 secs 2023-05-08T09:25:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:31 smithi096 ceph-mon[124666]: pgmap v10974: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 2.2 KiB/s wr, 8 op/s 2023-05-08T09:25:33.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:33 smithi186 ceph-mon[126480]: pgmap v10975: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 2.2 KiB/s wr, 5 op/s 2023-05-08T09:25:33.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:33 smithi133 ceph-mon[125939]: pgmap v10975: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 2.2 KiB/s wr, 5 op/s 2023-05-08T09:25:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:33 smithi096 ceph-mon[124666]: pgmap v10975: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 2.2 KiB/s wr, 5 op/s 2023-05-08T09:25:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20473.032387 secs 2023-05-08T09:25:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20473.032387 secs 2023-05-08T09:25:35.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20473.032387 secs 2023-05-08T09:25:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20473.588357 secs 2023-05-08T09:25:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:35 smithi186 ceph-mon[126480]: pgmap v10976: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 2.7 KiB/s wr, 8 op/s 2023-05-08T09:25:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20473.588357 secs 2023-05-08T09:25:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:35 smithi133 ceph-mon[125939]: pgmap v10976: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 2.7 KiB/s wr, 8 op/s 2023-05-08T09:25:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20473.588357 secs 2023-05-08T09:25:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:35 smithi096 ceph-mon[124666]: pgmap v10976: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 2.7 KiB/s wr, 8 op/s 2023-05-08T09:25:36.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20474.874504 secs 2023-05-08T09:25:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20474.874504 secs 2023-05-08T09:25:37.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20474.874504 secs 2023-05-08T09:25:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:37 smithi186 ceph-mon[126480]: pgmap v10977: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 203 KiB/s wr, 7 op/s 2023-05-08T09:25:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:37 smithi133 ceph-mon[125939]: pgmap v10977: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 203 KiB/s wr, 7 op/s 2023-05-08T09:25:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:37 smithi096 ceph-mon[124666]: pgmap v10977: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 203 KiB/s wr, 7 op/s 2023-05-08T09:25:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:39 smithi186 ceph-mon[126480]: pgmap v10978: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 203 KiB/s wr, 7 op/s 2023-05-08T09:25:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20478.032452 secs 2023-05-08T09:25:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:39 smithi133 ceph-mon[125939]: pgmap v10978: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 203 KiB/s wr, 7 op/s 2023-05-08T09:25:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20478.032452 secs 2023-05-08T09:25:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:39 smithi096 ceph-mon[124666]: pgmap v10978: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 203 KiB/s wr, 7 op/s 2023-05-08T09:25:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20478.032452 secs 2023-05-08T09:25:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20478.588482 secs 2023-05-08T09:25:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20478.588482 secs 2023-05-08T09:25:41.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20478.588482 secs 2023-05-08T09:25:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:41 smithi186 ceph-mon[126480]: pgmap v10979: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 204 KiB/s wr, 10 op/s 2023-05-08T09:25:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:41 smithi133 ceph-mon[125939]: pgmap v10979: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 204 KiB/s wr, 10 op/s 2023-05-08T09:25:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:41 smithi096 ceph-mon[124666]: pgmap v10979: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 204 KiB/s wr, 10 op/s 2023-05-08T09:25:43.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:43 smithi186 ceph-mon[126480]: pgmap v10980: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 202 KiB/s wr, 7 op/s 2023-05-08T09:25:43.887 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:25:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:43 smithi133 ceph-mon[125939]: pgmap v10980: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 202 KiB/s wr, 7 op/s 2023-05-08T09:25:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:25:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:43 smithi096 ceph-mon[124666]: pgmap v10980: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 202 KiB/s wr, 7 op/s 2023-05-08T09:25:44.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:25:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20483.032588 secs 2023-05-08T09:25:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:25:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:25:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:25:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20483.032588 secs 2023-05-08T09:25:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:25:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:25:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:25:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20483.032588 secs 2023-05-08T09:25:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:25:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:25:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:25:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20483.588591 secs 2023-05-08T09:25:45.913 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:45 smithi186 ceph-mon[126480]: pgmap v10981: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 202 KiB/s wr, 9 op/s 2023-05-08T09:25:45.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20483.588591 secs 2023-05-08T09:25:45.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:45 smithi133 ceph-mon[125939]: pgmap v10981: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 202 KiB/s wr, 9 op/s 2023-05-08T09:25:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20483.588591 secs 2023-05-08T09:25:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:45 smithi096 ceph-mon[124666]: pgmap v10981: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 202 KiB/s wr, 9 op/s 2023-05-08T09:25:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:47 smithi186 ceph-mon[126480]: pgmap v10982: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 342 KiB/s wr, 7 op/s 2023-05-08T09:25:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:47 smithi133 ceph-mon[125939]: pgmap v10982: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 342 KiB/s wr, 7 op/s 2023-05-08T09:25:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:47 smithi096 ceph-mon[124666]: pgmap v10982: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 342 KiB/s wr, 7 op/s 2023-05-08T09:25:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:49 smithi186 ceph-mon[126480]: pgmap v10983: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 141 KiB/s wr, 6 op/s 2023-05-08T09:25:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20488.032704 secs 2023-05-08T09:25:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:49 smithi133 ceph-mon[125939]: pgmap v10983: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 141 KiB/s wr, 6 op/s 2023-05-08T09:25:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20488.032704 secs 2023-05-08T09:25:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:49 smithi096 ceph-mon[124666]: pgmap v10983: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 141 KiB/s wr, 6 op/s 2023-05-08T09:25:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20488.032704 secs 2023-05-08T09:25:51.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:51 smithi186 ceph-mon[126480]: pgmap v10984: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 348 KiB/s wr, 11 op/s 2023-05-08T09:25:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:25:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:51 smithi133 ceph-mon[125939]: pgmap v10984: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 348 KiB/s wr, 11 op/s 2023-05-08T09:25:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:25:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:51 smithi096 ceph-mon[124666]: pgmap v10984: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 348 KiB/s wr, 11 op/s 2023-05-08T09:25:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:25:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:52 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:25:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:25:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:25:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:52 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:25:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:25:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:25:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:52 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:25:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:25:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:25:53.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:53 smithi186 ceph-mon[126480]: pgmap v10985: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 348 KiB/s wr, 7 op/s 2023-05-08T09:25:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:53 smithi133 ceph-mon[125939]: pgmap v10985: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 348 KiB/s wr, 7 op/s 2023-05-08T09:25:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:53 smithi096 ceph-mon[124666]: pgmap v10985: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 348 KiB/s wr, 7 op/s 2023-05-08T09:25:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20493.032820 secs 2023-05-08T09:25:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20493.032820 secs 2023-05-08T09:25:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20493.032820 secs 2023-05-08T09:25:55.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:55 smithi186 ceph-mon[126480]: pgmap v10986: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 361 KiB/s wr, 11 op/s 2023-05-08T09:25:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:55 smithi133 ceph-mon[125939]: pgmap v10986: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 361 KiB/s wr, 11 op/s 2023-05-08T09:25:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:55 smithi096 ceph-mon[124666]: pgmap v10986: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 361 KiB/s wr, 11 op/s 2023-05-08T09:25:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20494.874990 secs 2023-05-08T09:25:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:25:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:25:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20494.874990 secs 2023-05-08T09:25:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:25:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:25:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20494.874990 secs 2023-05-08T09:25:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:25:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:25:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:57 smithi133 ceph-mon[125939]: pgmap v10987: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 628 KiB/s rd, 707 KiB/s wr, 12 op/s 2023-05-08T09:25:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:57 smithi096 ceph-mon[124666]: pgmap v10987: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 628 KiB/s rd, 707 KiB/s wr, 12 op/s 2023-05-08T09:25:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:57 smithi186 ceph-mon[126480]: pgmap v10987: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 628 KiB/s rd, 707 KiB/s wr, 12 op/s 2023-05-08T09:25:58.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:58 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:25:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:58 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:25:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:58 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:25:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:59 smithi133 ceph-mon[125939]: pgmap v10988: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 487 KiB/s rd, 566 KiB/s wr, 11 op/s 2023-05-08T09:25:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:25:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20498.032886 secs 2023-05-08T09:26:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:59 smithi096 ceph-mon[124666]: pgmap v10988: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 487 KiB/s rd, 566 KiB/s wr, 11 op/s 2023-05-08T09:26:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:25:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20498.032886 secs 2023-05-08T09:26:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:59 smithi186 ceph-mon[126480]: pgmap v10988: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 487 KiB/s rd, 566 KiB/s wr, 11 op/s 2023-05-08T09:26:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:25:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20498.032886 secs 2023-05-08T09:26:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:26:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:26:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:26:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:01 smithi133 ceph-mon[125939]: pgmap v10989: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 512 KiB/s rd, 591 KiB/s wr, 15 op/s 2023-05-08T09:26:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:01 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:26:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:01 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:26:01.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:01 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:26:01.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:01 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:26:01.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:01 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T09:26:01.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:01 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T09:26:01.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:01 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:26:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:01 smithi096 ceph-mon[124666]: pgmap v10989: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 512 KiB/s rd, 591 KiB/s wr, 15 op/s 2023-05-08T09:26:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:01 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:26:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:01 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:26:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:01 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:26:02.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:01 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:26:02.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:01 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T09:26:02.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:01 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T09:26:02.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:01 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:26:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:01 smithi186 ceph-mon[126480]: pgmap v10989: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 512 KiB/s rd, 591 KiB/s wr, 15 op/s 2023-05-08T09:26:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:01 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:26:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:01 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:26:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:01 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:26:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:01 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:26:02.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:01 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T09:26:02.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:01 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T09:26:02.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:01 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:26:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:03 smithi133 ceph-mon[125939]: pgmap v10990: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 396 KiB/s rd, 453 KiB/s wr, 12 op/s 2023-05-08T09:26:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:03 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:26:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:03 smithi096 ceph-mon[124666]: pgmap v10990: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 396 KiB/s rd, 453 KiB/s wr, 12 op/s 2023-05-08T09:26:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:03 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:26:04.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:03 smithi186 ceph-mon[126480]: pgmap v10990: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 396 KiB/s rd, 453 KiB/s wr, 12 op/s 2023-05-08T09:26:04.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:03 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:26:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20503.033006 secs 2023-05-08T09:26:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20503.589064 secs 2023-05-08T09:26:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:04 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:26:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:04 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:26:04.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:04 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:26:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20503.033006 secs 2023-05-08T09:26:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20503.589064 secs 2023-05-08T09:26:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:04 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:26:05.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:04 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:26:05.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:04 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:26:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20503.033006 secs 2023-05-08T09:26:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20503.589064 secs 2023-05-08T09:26:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:04 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:26:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:04 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:26:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:04 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:26:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:05 smithi133 ceph-mon[125939]: pgmap v10991: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 427 KiB/s rd, 497 KiB/s wr, 27 op/s 2023-05-08T09:26:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:05 smithi096 ceph-mon[124666]: pgmap v10991: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 427 KiB/s rd, 497 KiB/s wr, 27 op/s 2023-05-08T09:26:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:05 smithi186 ceph-mon[126480]: pgmap v10991: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 427 KiB/s rd, 497 KiB/s wr, 27 op/s 2023-05-08T09:26:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20504.875192 secs 2023-05-08T09:26:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:06 smithi133 ceph-mon[125939]: osdmap e764: 12 total, 12 up, 12 in 2023-05-08T09:26:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20504.875192 secs 2023-05-08T09:26:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:06 smithi096 ceph-mon[124666]: osdmap e764: 12 total, 12 up, 12 in 2023-05-08T09:26:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20504.875192 secs 2023-05-08T09:26:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:06 smithi186 ceph-mon[126480]: osdmap e764: 12 total, 12 up, 12 in 2023-05-08T09:26:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:07 smithi133 ceph-mon[125939]: pgmap v10993: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 281 KiB/s wr, 28 op/s 2023-05-08T09:26:08.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:07 smithi096 ceph-mon[124666]: pgmap v10993: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 281 KiB/s wr, 28 op/s 2023-05-08T09:26:08.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:07 smithi186 ceph-mon[126480]: pgmap v10993: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 281 KiB/s wr, 28 op/s 2023-05-08T09:26:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:26:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:26:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:26:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:26:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:26:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:26:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:26:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:26:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:26:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:09 smithi133 ceph-mon[125939]: pgmap v10994: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 281 KiB/s wr, 28 op/s 2023-05-08T09:26:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20508.033145 secs 2023-05-08T09:26:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20508.589183 secs 2023-05-08T09:26:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:09 smithi096 ceph-mon[124666]: pgmap v10994: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 281 KiB/s wr, 28 op/s 2023-05-08T09:26:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20508.033145 secs 2023-05-08T09:26:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20508.589183 secs 2023-05-08T09:26:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:09 smithi186 ceph-mon[126480]: pgmap v10994: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 281 KiB/s wr, 28 op/s 2023-05-08T09:26:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20508.033145 secs 2023-05-08T09:26:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20508.589183 secs 2023-05-08T09:26:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20509.875312 secs 2023-05-08T09:26:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:11 smithi133 ceph-mon[125939]: pgmap v10995: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 427 KiB/s wr, 29 op/s 2023-05-08T09:26:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20509.875312 secs 2023-05-08T09:26:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:11 smithi096 ceph-mon[124666]: pgmap v10995: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 427 KiB/s wr, 29 op/s 2023-05-08T09:26:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20509.875312 secs 2023-05-08T09:26:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:11 smithi186 ceph-mon[126480]: pgmap v10995: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 427 KiB/s wr, 29 op/s 2023-05-08T09:26:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:13 smithi133 ceph-mon[125939]: pgmap v10996: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 386 KiB/s rd, 344 KiB/s wr, 28 op/s 2023-05-08T09:26:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:13 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:26:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:13 smithi133 ceph-mon[125939]: osdmap e765: 12 total, 12 up, 12 in 2023-05-08T09:26:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:13 smithi096 ceph-mon[124666]: pgmap v10996: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 386 KiB/s rd, 344 KiB/s wr, 28 op/s 2023-05-08T09:26:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:13 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:26:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:13 smithi096 ceph-mon[124666]: osdmap e765: 12 total, 12 up, 12 in 2023-05-08T09:26:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:13 smithi186 ceph-mon[126480]: pgmap v10996: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 386 KiB/s rd, 344 KiB/s wr, 28 op/s 2023-05-08T09:26:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:13 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:26:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:13 smithi186 ceph-mon[126480]: osdmap e765: 12 total, 12 up, 12 in 2023-05-08T09:26:14.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20513.033284 secs 2023-05-08T09:26:14.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20513.589301 secs 2023-05-08T09:26:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20513.033284 secs 2023-05-08T09:26:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20513.589301 secs 2023-05-08T09:26:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20513.033284 secs 2023-05-08T09:26:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20513.589301 secs 2023-05-08T09:26:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:15 smithi133 ceph-mon[125939]: pgmap v10998: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 483 KiB/s rd, 384 KiB/s wr, 11 op/s 2023-05-08T09:26:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:15 smithi096 ceph-mon[124666]: pgmap v10998: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 483 KiB/s rd, 384 KiB/s wr, 11 op/s 2023-05-08T09:26:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:15 smithi186 ceph-mon[126480]: pgmap v10998: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 483 KiB/s rd, 384 KiB/s wr, 11 op/s 2023-05-08T09:26:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20514.875429 secs 2023-05-08T09:26:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20514.875429 secs 2023-05-08T09:26:17.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20514.875429 secs 2023-05-08T09:26:17.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:17 smithi133 ceph-mon[125939]: pgmap v10999: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 239 KiB/s wr, 9 op/s 2023-05-08T09:26:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:17 smithi096 ceph-mon[124666]: pgmap v10999: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 239 KiB/s wr, 9 op/s 2023-05-08T09:26:18.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:17 smithi186 ceph-mon[126480]: pgmap v10999: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 239 KiB/s wr, 9 op/s 2023-05-08T09:26:19.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:19 smithi133 ceph-mon[125939]: pgmap v11000: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 239 KiB/s wr, 9 op/s 2023-05-08T09:26:19.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20518.033423 secs 2023-05-08T09:26:19.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20518.589437 secs 2023-05-08T09:26:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:19 smithi096 ceph-mon[124666]: pgmap v11000: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 239 KiB/s wr, 9 op/s 2023-05-08T09:26:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20518.033423 secs 2023-05-08T09:26:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20518.589437 secs 2023-05-08T09:26:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:19 smithi186 ceph-mon[126480]: pgmap v11000: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 239 KiB/s wr, 9 op/s 2023-05-08T09:26:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20518.033423 secs 2023-05-08T09:26:20.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20518.589437 secs 2023-05-08T09:26:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20519.875552 secs 2023-05-08T09:26:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:21 smithi133 ceph-mon[125939]: pgmap v11001: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 63 KiB/s wr, 7 op/s 2023-05-08T09:26:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20519.875552 secs 2023-05-08T09:26:22.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:21 smithi096 ceph-mon[124666]: pgmap v11001: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 63 KiB/s wr, 7 op/s 2023-05-08T09:26:22.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20519.875552 secs 2023-05-08T09:26:22.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:21 smithi186 ceph-mon[126480]: pgmap v11001: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 63 KiB/s wr, 7 op/s 2023-05-08T09:26:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:23 smithi133 ceph-mon[125939]: pgmap v11002: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 63 KiB/s wr, 6 op/s 2023-05-08T09:26:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:23 smithi096 ceph-mon[124666]: pgmap v11002: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 63 KiB/s wr, 6 op/s 2023-05-08T09:26:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:23 smithi186 ceph-mon[126480]: pgmap v11002: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 63 KiB/s wr, 6 op/s 2023-05-08T09:26:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20523.033542 secs 2023-05-08T09:26:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20523.589535 secs 2023-05-08T09:26:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20523.033542 secs 2023-05-08T09:26:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20523.589535 secs 2023-05-08T09:26:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20523.033542 secs 2023-05-08T09:26:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20523.589535 secs 2023-05-08T09:26:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:25 smithi133 ceph-mon[125939]: pgmap v11003: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 58 KiB/s wr, 8 op/s 2023-05-08T09:26:26.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:25 smithi096 ceph-mon[124666]: pgmap v11003: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 58 KiB/s wr, 8 op/s 2023-05-08T09:26:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:25 smithi186 ceph-mon[126480]: pgmap v11003: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 58 KiB/s wr, 8 op/s 2023-05-08T09:26:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20524.875673 secs 2023-05-08T09:26:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20524.875673 secs 2023-05-08T09:26:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20524.875673 secs 2023-05-08T09:26:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:27 smithi133 ceph-mon[125939]: pgmap v11004: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T09:26:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:27 smithi096 ceph-mon[124666]: pgmap v11004: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T09:26:28.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:27 smithi186 ceph-mon[126480]: pgmap v11004: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T09:26:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:29 smithi133 ceph-mon[125939]: pgmap v11005: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:26:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20528.033664 secs 2023-05-08T09:26:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20528.589596 secs 2023-05-08T09:26:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:29 smithi096 ceph-mon[124666]: pgmap v11005: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:26:30.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20528.033664 secs 2023-05-08T09:26:30.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20528.589596 secs 2023-05-08T09:26:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:29 smithi186 ceph-mon[126480]: pgmap v11005: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:26:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20528.033664 secs 2023-05-08T09:26:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20528.589596 secs 2023-05-08T09:26:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20529.875803 secs 2023-05-08T09:26:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:31 smithi133 ceph-mon[125939]: pgmap v11006: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T09:26:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20529.875803 secs 2023-05-08T09:26:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:31 smithi096 ceph-mon[124666]: pgmap v11006: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T09:26:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20529.875803 secs 2023-05-08T09:26:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:31 smithi186 ceph-mon[126480]: pgmap v11006: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T09:26:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:33 smithi133 ceph-mon[125939]: pgmap v11007: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T09:26:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:33 smithi096 ceph-mon[124666]: pgmap v11007: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T09:26:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:33 smithi186 ceph-mon[126480]: pgmap v11007: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T09:26:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20533.033789 secs 2023-05-08T09:26:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20533.589735 secs 2023-05-08T09:26:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20533.033789 secs 2023-05-08T09:26:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20533.589735 secs 2023-05-08T09:26:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20533.033789 secs 2023-05-08T09:26:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20533.589735 secs 2023-05-08T09:26:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:35 smithi096 ceph-mon[124666]: pgmap v11008: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 597 B/s wr, 8 op/s 2023-05-08T09:26:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:35 smithi186 ceph-mon[126480]: pgmap v11008: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 597 B/s wr, 8 op/s 2023-05-08T09:26:36.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:35 smithi133 ceph-mon[125939]: pgmap v11008: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 597 B/s wr, 8 op/s 2023-05-08T09:26:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20534.875923 secs 2023-05-08T09:26:37.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20534.875923 secs 2023-05-08T09:26:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20534.875923 secs 2023-05-08T09:26:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:37 smithi096 ceph-mon[124666]: pgmap v11009: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T09:26:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:37 smithi186 ceph-mon[126480]: pgmap v11009: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T09:26:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:37 smithi133 ceph-mon[125939]: pgmap v11009: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T09:26:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:39 smithi096 ceph-mon[124666]: pgmap v11010: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T09:26:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20538.033903 secs 2023-05-08T09:26:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20538.589850 secs 2023-05-08T09:26:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:39 smithi186 ceph-mon[126480]: pgmap v11010: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T09:26:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20538.033903 secs 2023-05-08T09:26:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20538.589850 secs 2023-05-08T09:26:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:39 smithi133 ceph-mon[125939]: pgmap v11010: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T09:26:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20538.033903 secs 2023-05-08T09:26:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20538.589850 secs 2023-05-08T09:26:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:41 smithi186 ceph-mon[126480]: pgmap v11011: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 70 KiB/s wr, 9 op/s 2023-05-08T09:26:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:41 smithi133 ceph-mon[125939]: pgmap v11011: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 70 KiB/s wr, 9 op/s 2023-05-08T09:26:42.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:41 smithi096 ceph-mon[124666]: pgmap v11011: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 70 KiB/s wr, 9 op/s 2023-05-08T09:26:44.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:43 smithi186 ceph-mon[126480]: pgmap v11012: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 69 KiB/s wr, 6 op/s 2023-05-08T09:26:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:26:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:43 smithi133 ceph-mon[125939]: pgmap v11012: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 69 KiB/s wr, 6 op/s 2023-05-08T09:26:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:26:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:43 smithi096 ceph-mon[124666]: pgmap v11012: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 69 KiB/s wr, 6 op/s 2023-05-08T09:26:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:26:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20543.034018 secs 2023-05-08T09:26:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20543.589972 secs 2023-05-08T09:26:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:26:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:26:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:26:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20543.034018 secs 2023-05-08T09:26:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20543.589972 secs 2023-05-08T09:26:45.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:26:45.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:26:45.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:26:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20543.034018 secs 2023-05-08T09:26:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20543.589972 secs 2023-05-08T09:26:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:26:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:26:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:26:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:45 smithi186 ceph-mon[126480]: pgmap v11013: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 134 KiB/s wr, 9 op/s 2023-05-08T09:26:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:45 smithi133 ceph-mon[125939]: pgmap v11013: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 134 KiB/s wr, 9 op/s 2023-05-08T09:26:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:45 smithi096 ceph-mon[124666]: pgmap v11013: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 134 KiB/s wr, 9 op/s 2023-05-08T09:26:47.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20544.876126 secs 2023-05-08T09:26:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20544.876126 secs 2023-05-08T09:26:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20544.876126 secs 2023-05-08T09:26:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:47 smithi186 ceph-mon[126480]: pgmap v11014: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 134 KiB/s wr, 7 op/s 2023-05-08T09:26:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:47 smithi133 ceph-mon[125939]: pgmap v11014: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 134 KiB/s wr, 7 op/s 2023-05-08T09:26:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:47 smithi096 ceph-mon[124666]: pgmap v11014: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 134 KiB/s wr, 7 op/s 2023-05-08T09:26:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:26:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:26:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:26:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:26:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:26:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:26:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:49 smithi186 ceph-mon[126480]: pgmap v11015: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 134 KiB/s wr, 6 op/s 2023-05-08T09:26:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20548.034104 secs 2023-05-08T09:26:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:49 smithi133 ceph-mon[125939]: pgmap v11015: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 134 KiB/s wr, 6 op/s 2023-05-08T09:26:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20548.034104 secs 2023-05-08T09:26:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:49 smithi096 ceph-mon[124666]: pgmap v11015: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 134 KiB/s wr, 6 op/s 2023-05-08T09:26:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20548.034104 secs 2023-05-08T09:26:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20549.876255 secs 2023-05-08T09:26:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:51 smithi186 ceph-mon[126480]: pgmap v11016: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 656 KiB/s rd, 356 KiB/s wr, 11 op/s 2023-05-08T09:26:52.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:26:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20549.876255 secs 2023-05-08T09:26:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:51 smithi133 ceph-mon[125939]: pgmap v11016: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 656 KiB/s rd, 356 KiB/s wr, 11 op/s 2023-05-08T09:26:52.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:26:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20549.876255 secs 2023-05-08T09:26:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:51 smithi096 ceph-mon[124666]: pgmap v11016: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 656 KiB/s rd, 356 KiB/s wr, 11 op/s 2023-05-08T09:26:52.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:26:53.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:52 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:26:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:26:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:26:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:52 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:26:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:26:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:26:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:52 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:26:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:26:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:26:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:53 smithi186 ceph-mon[126480]: pgmap v11017: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 586 KiB/s rd, 287 KiB/s wr, 8 op/s 2023-05-08T09:26:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:53 smithi133 ceph-mon[125939]: pgmap v11017: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 586 KiB/s rd, 287 KiB/s wr, 8 op/s 2023-05-08T09:26:54.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:53 smithi096 ceph-mon[124666]: pgmap v11017: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 586 KiB/s rd, 287 KiB/s wr, 8 op/s 2023-05-08T09:26:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20553.034202 secs 2023-05-08T09:26:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20553.590209 secs 2023-05-08T09:26:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20553.034202 secs 2023-05-08T09:26:55.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20553.590209 secs 2023-05-08T09:26:55.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20553.034202 secs 2023-05-08T09:26:55.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20553.590209 secs 2023-05-08T09:26:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:55 smithi186 ceph-mon[126480]: pgmap v11018: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 860 KiB/s rd, 549 KiB/s wr, 13 op/s 2023-05-08T09:26:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:55 smithi133 ceph-mon[125939]: pgmap v11018: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 860 KiB/s rd, 549 KiB/s wr, 13 op/s 2023-05-08T09:26:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:55 smithi096 ceph-mon[124666]: pgmap v11018: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 860 KiB/s rd, 549 KiB/s wr, 13 op/s 2023-05-08T09:26:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20554.876382 secs 2023-05-08T09:26:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:26:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:26:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20554.876382 secs 2023-05-08T09:26:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:26:57.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:26:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20554.876382 secs 2023-05-08T09:26:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:26:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:26:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:57 smithi186 ceph-mon[126480]: pgmap v11019: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 615 KiB/s rd, 485 KiB/s wr, 11 op/s 2023-05-08T09:26:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:57 smithi133 ceph-mon[125939]: pgmap v11019: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 615 KiB/s rd, 485 KiB/s wr, 11 op/s 2023-05-08T09:26:58.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:57 smithi096 ceph-mon[124666]: pgmap v11019: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 615 KiB/s rd, 485 KiB/s wr, 11 op/s 2023-05-08T09:26:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:58 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:26:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:58 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:26:59.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:58 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:27:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:59 smithi186 ceph-mon[126480]: pgmap v11020: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 615 KiB/s rd, 484 KiB/s wr, 10 op/s 2023-05-08T09:27:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20558.034319 secs 2023-05-08T09:27:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:26:59 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:27:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:59 smithi133 ceph-mon[125939]: pgmap v11020: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 615 KiB/s rd, 484 KiB/s wr, 10 op/s 2023-05-08T09:27:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20558.034319 secs 2023-05-08T09:27:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:26:59 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:27:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:59 smithi096 ceph-mon[124666]: pgmap v11020: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 615 KiB/s rd, 484 KiB/s wr, 10 op/s 2023-05-08T09:27:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20558.034319 secs 2023-05-08T09:27:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:26:59 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:27:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:27:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:27:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:27:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:27:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:27:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:27:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20559.876501 secs 2023-05-08T09:27:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:01 smithi186 ceph-mon[126480]: pgmap v11021: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 708 KiB/s rd, 587 KiB/s wr, 15 op/s 2023-05-08T09:27:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:01 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:27:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:01 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:27:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:01 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:27:02.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:01 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:27:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20559.876501 secs 2023-05-08T09:27:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:01 smithi133 ceph-mon[125939]: pgmap v11021: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 708 KiB/s rd, 587 KiB/s wr, 15 op/s 2023-05-08T09:27:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:01 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:27:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:01 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:27:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:01 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:27:02.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:01 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:27:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20559.876501 secs 2023-05-08T09:27:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:01 smithi096 ceph-mon[124666]: pgmap v11021: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 708 KiB/s rd, 587 KiB/s wr, 15 op/s 2023-05-08T09:27:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:01 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:27:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:01 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:27:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:01 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:27:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:01 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:27:03.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:02 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:27:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:02 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T09:27:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:02 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T09:27:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:02 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:27:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:02 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:27:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:02 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T09:27:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:02 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T09:27:03.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:02 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:27:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:02 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:27:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:02 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T09:27:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:02 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T09:27:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:02 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:27:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:03 smithi186 ceph-mon[126480]: pgmap v11022: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 366 KiB/s rd, 365 KiB/s wr, 11 op/s 2023-05-08T09:27:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:03 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:27:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:03 smithi133 ceph-mon[125939]: pgmap v11022: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 366 KiB/s rd, 365 KiB/s wr, 11 op/s 2023-05-08T09:27:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:03 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:27:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:03 smithi096 ceph-mon[124666]: pgmap v11022: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 366 KiB/s rd, 365 KiB/s wr, 11 op/s 2023-05-08T09:27:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:03 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:27:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20563.034455 secs 2023-05-08T09:27:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20563.590488 secs 2023-05-08T09:27:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20563.034455 secs 2023-05-08T09:27:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20563.590488 secs 2023-05-08T09:27:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20563.034455 secs 2023-05-08T09:27:05.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20563.590488 secs 2023-05-08T09:27:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:05 smithi133 ceph-mon[125939]: pgmap v11023: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 488 KiB/s rd, 499 KiB/s wr, 27 op/s 2023-05-08T09:27:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:05 smithi096 ceph-mon[124666]: pgmap v11023: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 488 KiB/s rd, 499 KiB/s wr, 27 op/s 2023-05-08T09:27:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:05 smithi186 ceph-mon[126480]: pgmap v11023: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 488 KiB/s rd, 499 KiB/s wr, 27 op/s 2023-05-08T09:27:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20564.876642 secs 2023-05-08T09:27:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:06 smithi133 ceph-mon[125939]: osdmap e766: 12 total, 12 up, 12 in 2023-05-08T09:27:07.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20564.876642 secs 2023-05-08T09:27:07.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:06 smithi096 ceph-mon[124666]: osdmap e766: 12 total, 12 up, 12 in 2023-05-08T09:27:07.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20564.876642 secs 2023-05-08T09:27:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:06 smithi186 ceph-mon[126480]: osdmap e766: 12 total, 12 up, 12 in 2023-05-08T09:27:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:07 smithi133 ceph-mon[125939]: pgmap v11025: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 327 KiB/s wr, 30 op/s 2023-05-08T09:27:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:07 smithi096 ceph-mon[124666]: pgmap v11025: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 327 KiB/s wr, 30 op/s 2023-05-08T09:27:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:07 smithi186 ceph-mon[126480]: pgmap v11025: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 327 KiB/s wr, 30 op/s 2023-05-08T09:27:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:27:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:27:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:08 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:27:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:27:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:27:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:08 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:27:09.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:27:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:27:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:08 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:27:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:09 smithi133 ceph-mon[125939]: pgmap v11026: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 327 KiB/s wr, 30 op/s 2023-05-08T09:27:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20568.034595 secs 2023-05-08T09:27:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20568.590579 secs 2023-05-08T09:27:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:09 smithi096 ceph-mon[124666]: pgmap v11026: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 327 KiB/s wr, 30 op/s 2023-05-08T09:27:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20568.034595 secs 2023-05-08T09:27:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20568.590579 secs 2023-05-08T09:27:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:09 smithi186 ceph-mon[126480]: pgmap v11026: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 327 KiB/s wr, 30 op/s 2023-05-08T09:27:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20568.034595 secs 2023-05-08T09:27:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20568.590579 secs 2023-05-08T09:27:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20569.876759 secs 2023-05-08T09:27:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:11 smithi133 ceph-mon[125939]: pgmap v11027: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 265 KiB/s rd, 295 KiB/s wr, 29 op/s 2023-05-08T09:27:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20569.876759 secs 2023-05-08T09:27:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:11 smithi096 ceph-mon[124666]: pgmap v11027: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 265 KiB/s rd, 295 KiB/s wr, 29 op/s 2023-05-08T09:27:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20569.876759 secs 2023-05-08T09:27:12.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:11 smithi186 ceph-mon[126480]: pgmap v11027: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 265 KiB/s rd, 295 KiB/s wr, 29 op/s 2023-05-08T09:27:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:13 smithi133 ceph-mon[125939]: pgmap v11028: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 265 KiB/s rd, 295 KiB/s wr, 29 op/s 2023-05-08T09:27:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:13 smithi133 ceph-mon[125939]: osdmap e767: 12 total, 12 up, 12 in 2023-05-08T09:27:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:13 smithi096 ceph-mon[124666]: pgmap v11028: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 265 KiB/s rd, 295 KiB/s wr, 29 op/s 2023-05-08T09:27:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:13 smithi096 ceph-mon[124666]: osdmap e767: 12 total, 12 up, 12 in 2023-05-08T09:27:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:13 smithi186 ceph-mon[126480]: pgmap v11028: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 265 KiB/s rd, 295 KiB/s wr, 29 op/s 2023-05-08T09:27:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:13 smithi186 ceph-mon[126480]: osdmap e767: 12 total, 12 up, 12 in 2023-05-08T09:27:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20573.034669 secs 2023-05-08T09:27:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20573.590703 secs 2023-05-08T09:27:15.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20573.034669 secs 2023-05-08T09:27:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20573.590703 secs 2023-05-08T09:27:15.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20573.034669 secs 2023-05-08T09:27:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20573.590703 secs 2023-05-08T09:27:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:15 smithi133 ceph-mon[125939]: pgmap v11030: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 109 KiB/s wr, 9 op/s 2023-05-08T09:27:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20574.876848 secs 2023-05-08T09:27:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:15 smithi096 ceph-mon[124666]: pgmap v11030: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 109 KiB/s wr, 9 op/s 2023-05-08T09:27:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20574.876848 secs 2023-05-08T09:27:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:15 smithi186 ceph-mon[126480]: pgmap v11030: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 109 KiB/s wr, 9 op/s 2023-05-08T09:27:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20574.876848 secs 2023-05-08T09:27:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:17 smithi133 ceph-mon[125939]: pgmap v11031: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 241 KiB/s wr, 9 op/s 2023-05-08T09:27:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:17 smithi096 ceph-mon[124666]: pgmap v11031: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 241 KiB/s wr, 9 op/s 2023-05-08T09:27:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:17 smithi186 ceph-mon[126480]: pgmap v11031: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 241 KiB/s wr, 9 op/s 2023-05-08T09:27:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:19 smithi133 ceph-mon[125939]: pgmap v11032: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 241 KiB/s wr, 9 op/s 2023-05-08T09:27:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20578.034787 secs 2023-05-08T09:27:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20578.590781 secs 2023-05-08T09:27:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:19 smithi096 ceph-mon[124666]: pgmap v11032: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 241 KiB/s wr, 9 op/s 2023-05-08T09:27:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20578.034787 secs 2023-05-08T09:27:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20578.590781 secs 2023-05-08T09:27:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:19 smithi186 ceph-mon[126480]: pgmap v11032: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 241 KiB/s wr, 9 op/s 2023-05-08T09:27:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20578.034787 secs 2023-05-08T09:27:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20578.590781 secs 2023-05-08T09:27:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20579.876971 secs 2023-05-08T09:27:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20579.876971 secs 2023-05-08T09:27:21.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20579.876971 secs 2023-05-08T09:27:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:21 smithi133 ceph-mon[125939]: pgmap v11033: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 150 KiB/s wr, 7 op/s 2023-05-08T09:27:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:21 smithi096 ceph-mon[124666]: pgmap v11033: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 150 KiB/s wr, 7 op/s 2023-05-08T09:27:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:21 smithi186 ceph-mon[126480]: pgmap v11033: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 150 KiB/s wr, 7 op/s 2023-05-08T09:27:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:23 smithi133 ceph-mon[125939]: pgmap v11034: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 150 KiB/s wr, 7 op/s 2023-05-08T09:27:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:23 smithi096 ceph-mon[124666]: pgmap v11034: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 150 KiB/s wr, 7 op/s 2023-05-08T09:27:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:23 smithi186 ceph-mon[126480]: pgmap v11034: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 150 KiB/s wr, 7 op/s 2023-05-08T09:27:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20583.034849 secs 2023-05-08T09:27:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20583.590899 secs 2023-05-08T09:27:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20583.034849 secs 2023-05-08T09:27:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20583.590899 secs 2023-05-08T09:27:25.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20583.034849 secs 2023-05-08T09:27:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20583.590899 secs 2023-05-08T09:27:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:25 smithi133 ceph-mon[125939]: pgmap v11035: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 137 KiB/s wr, 9 op/s 2023-05-08T09:27:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20584.877120 secs 2023-05-08T09:27:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:25 smithi096 ceph-mon[124666]: pgmap v11035: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 137 KiB/s wr, 9 op/s 2023-05-08T09:27:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20584.877120 secs 2023-05-08T09:27:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:25 smithi186 ceph-mon[126480]: pgmap v11035: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 137 KiB/s wr, 9 op/s 2023-05-08T09:27:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20584.877120 secs 2023-05-08T09:27:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:27 smithi133 ceph-mon[125939]: pgmap v11036: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 125 KiB/s wr, 6 op/s 2023-05-08T09:27:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:27 smithi096 ceph-mon[124666]: pgmap v11036: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 125 KiB/s wr, 6 op/s 2023-05-08T09:27:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:27 smithi186 ceph-mon[126480]: pgmap v11036: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 125 KiB/s wr, 6 op/s 2023-05-08T09:27:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:29 smithi133 ceph-mon[125939]: pgmap v11037: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:27:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20588.034965 secs 2023-05-08T09:27:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20588.591011 secs 2023-05-08T09:27:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:29 smithi096 ceph-mon[124666]: pgmap v11037: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:27:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20588.034965 secs 2023-05-08T09:27:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20588.591011 secs 2023-05-08T09:27:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:29 smithi186 ceph-mon[126480]: pgmap v11037: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:27:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20588.034965 secs 2023-05-08T09:27:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20588.591011 secs 2023-05-08T09:27:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20589.877283 secs 2023-05-08T09:27:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20589.877283 secs 2023-05-08T09:27:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20589.877283 secs 2023-05-08T09:27:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:31 smithi133 ceph-mon[125939]: pgmap v11038: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T09:27:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:31 smithi096 ceph-mon[124666]: pgmap v11038: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T09:27:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:31 smithi186 ceph-mon[126480]: pgmap v11038: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T09:27:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:33 smithi133 ceph-mon[125939]: pgmap v11039: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T09:27:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:33 smithi096 ceph-mon[124666]: pgmap v11039: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T09:27:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:33 smithi186 ceph-mon[126480]: pgmap v11039: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T09:27:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20593.035089 secs 2023-05-08T09:27:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20593.591143 secs 2023-05-08T09:27:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20593.035089 secs 2023-05-08T09:27:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20593.591143 secs 2023-05-08T09:27:35.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20593.035089 secs 2023-05-08T09:27:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20593.591143 secs 2023-05-08T09:27:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:35 smithi133 ceph-mon[125939]: pgmap v11040: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 133 KiB/s wr, 9 op/s 2023-05-08T09:27:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20594.877428 secs 2023-05-08T09:27:36.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:35 smithi096 ceph-mon[124666]: pgmap v11040: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 133 KiB/s wr, 9 op/s 2023-05-08T09:27:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20594.877428 secs 2023-05-08T09:27:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:35 smithi186 ceph-mon[126480]: pgmap v11040: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 133 KiB/s wr, 9 op/s 2023-05-08T09:27:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20594.877428 secs 2023-05-08T09:27:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:37 smithi133 ceph-mon[125939]: pgmap v11041: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 133 KiB/s wr, 6 op/s 2023-05-08T09:27:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:37 smithi096 ceph-mon[124666]: pgmap v11041: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 133 KiB/s wr, 6 op/s 2023-05-08T09:27:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:37 smithi186 ceph-mon[126480]: pgmap v11041: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 133 KiB/s wr, 6 op/s 2023-05-08T09:27:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:39 smithi133 ceph-mon[125939]: pgmap v11042: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 133 KiB/s wr, 6 op/s 2023-05-08T09:27:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20598.035193 secs 2023-05-08T09:27:39.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:39 smithi096 ceph-mon[124666]: pgmap v11042: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 133 KiB/s wr, 6 op/s 2023-05-08T09:27:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20598.035193 secs 2023-05-08T09:27:39.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:39 smithi186 ceph-mon[126480]: pgmap v11042: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 133 KiB/s wr, 6 op/s 2023-05-08T09:27:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20598.035193 secs 2023-05-08T09:27:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20598.591255 secs 2023-05-08T09:27:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20598.591255 secs 2023-05-08T09:27:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20598.591255 secs 2023-05-08T09:27:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:41 smithi133 ceph-mon[125939]: pgmap v11043: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 180 KiB/s wr, 9 op/s 2023-05-08T09:27:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:41 smithi096 ceph-mon[124666]: pgmap v11043: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 180 KiB/s wr, 9 op/s 2023-05-08T09:27:41.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:41 smithi186 ceph-mon[126480]: pgmap v11043: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 180 KiB/s wr, 9 op/s 2023-05-08T09:27:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:43 smithi133 ceph-mon[125939]: pgmap v11044: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 179 KiB/s wr, 6 op/s 2023-05-08T09:27:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:43 smithi096 ceph-mon[124666]: pgmap v11044: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 179 KiB/s wr, 6 op/s 2023-05-08T09:27:43.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:43 smithi186 ceph-mon[126480]: pgmap v11044: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 179 KiB/s wr, 6 op/s 2023-05-08T09:27:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20603.035301 secs 2023-05-08T09:27:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:44 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:27:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20603.035301 secs 2023-05-08T09:27:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:44 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:27:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20603.035301 secs 2023-05-08T09:27:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:44 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:27:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20603.591389 secs 2023-05-08T09:27:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:45 smithi133 ceph-mon[125939]: pgmap v11045: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 324 KiB/s rd, 274 KiB/s wr, 10 op/s 2023-05-08T09:27:45.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:45 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:27:45.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:45 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:27:45.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:45 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:27:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20603.591389 secs 2023-05-08T09:27:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:45 smithi096 ceph-mon[124666]: pgmap v11045: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 324 KiB/s rd, 274 KiB/s wr, 10 op/s 2023-05-08T09:27:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:45 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:27:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:45 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:27:45.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:45 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:27:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20603.591389 secs 2023-05-08T09:27:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:45 smithi186 ceph-mon[126480]: pgmap v11045: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 324 KiB/s rd, 274 KiB/s wr, 10 op/s 2023-05-08T09:27:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:45 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:27:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:45 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:27:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:45 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:27:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20604.877673 secs 2023-05-08T09:27:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20604.877673 secs 2023-05-08T09:27:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20604.877673 secs 2023-05-08T09:27:47.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:47 smithi096 ceph-mon[124666]: pgmap v11046: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 142 KiB/s wr, 7 op/s 2023-05-08T09:27:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:47 smithi186 ceph-mon[126480]: pgmap v11046: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 142 KiB/s wr, 7 op/s 2023-05-08T09:27:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:47 smithi133 ceph-mon[125939]: pgmap v11046: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 142 KiB/s wr, 7 op/s 2023-05-08T09:27:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:49 smithi096 ceph-mon[124666]: pgmap v11047: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 142 KiB/s wr, 7 op/s 2023-05-08T09:27:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:27:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:27:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20608.035434 secs 2023-05-08T09:27:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:49 smithi186 ceph-mon[126480]: pgmap v11047: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 142 KiB/s wr, 7 op/s 2023-05-08T09:27:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:27:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:27:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20608.035434 secs 2023-05-08T09:27:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:49 smithi133 ceph-mon[125939]: pgmap v11047: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 142 KiB/s wr, 7 op/s 2023-05-08T09:27:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:27:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:27:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20608.035434 secs 2023-05-08T09:27:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20609.877794 secs 2023-05-08T09:27:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:51 smithi096 ceph-mon[124666]: pgmap v11048: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 470 KiB/s rd, 352 KiB/s wr, 11 op/s 2023-05-08T09:27:51.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20609.877794 secs 2023-05-08T09:27:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:51 smithi186 ceph-mon[126480]: pgmap v11048: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 470 KiB/s rd, 352 KiB/s wr, 11 op/s 2023-05-08T09:27:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20609.877794 secs 2023-05-08T09:27:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:51 smithi133 ceph-mon[125939]: pgmap v11048: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 470 KiB/s rd, 352 KiB/s wr, 11 op/s 2023-05-08T09:27:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:27:52.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:27:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:27:53.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:53 smithi186 ceph-mon[126480]: pgmap v11049: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 305 KiB/s wr, 7 op/s 2023-05-08T09:27:53.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:53 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:27:53.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:27:53.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:27:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:53 smithi133 ceph-mon[125939]: pgmap v11049: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 305 KiB/s wr, 7 op/s 2023-05-08T09:27:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:53 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:27:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:27:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:27:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:53 smithi096 ceph-mon[124666]: pgmap v11049: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 305 KiB/s wr, 7 op/s 2023-05-08T09:27:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:53 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:27:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:27:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:27:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20613.035556 secs 2023-05-08T09:27:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20613.035556 secs 2023-05-08T09:27:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20613.035556 secs 2023-05-08T09:27:55.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20613.591618 secs 2023-05-08T09:27:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:55 smithi186 ceph-mon[126480]: pgmap v11050: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 623 KiB/s rd, 569 KiB/s wr, 14 op/s 2023-05-08T09:27:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20613.591618 secs 2023-05-08T09:27:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:55 smithi133 ceph-mon[125939]: pgmap v11050: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 623 KiB/s rd, 569 KiB/s wr, 14 op/s 2023-05-08T09:27:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20613.591618 secs 2023-05-08T09:27:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:55 smithi096 ceph-mon[124666]: pgmap v11050: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 623 KiB/s rd, 569 KiB/s wr, 14 op/s 2023-05-08T09:27:56.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:27:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:27:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:27:57.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:57 smithi186 ceph-mon[126480]: pgmap v11051: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 434 KiB/s rd, 475 KiB/s wr, 10 op/s 2023-05-08T09:27:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:27:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:27:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:27:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:57 smithi133 ceph-mon[125939]: pgmap v11051: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 434 KiB/s rd, 475 KiB/s wr, 10 op/s 2023-05-08T09:27:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:27:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:27:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:27:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:57 smithi096 ceph-mon[124666]: pgmap v11051: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 434 KiB/s rd, 475 KiB/s wr, 10 op/s 2023-05-08T09:27:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:27:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:27:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:27:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:59 smithi186 ceph-mon[126480]: pgmap v11052: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 434 KiB/s rd, 475 KiB/s wr, 10 op/s 2023-05-08T09:27:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:27:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20618.035650 secs 2023-05-08T09:27:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:59 smithi133 ceph-mon[125939]: pgmap v11052: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 434 KiB/s rd, 475 KiB/s wr, 10 op/s 2023-05-08T09:27:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:27:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20618.035650 secs 2023-05-08T09:27:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:59 smithi096 ceph-mon[124666]: pgmap v11052: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 434 KiB/s rd, 475 KiB/s wr, 10 op/s 2023-05-08T09:27:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:27:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20618.035650 secs 2023-05-08T09:28:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:00 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:28:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:00 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:28:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:00 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:28:01.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:01 smithi186 ceph-mon[126480]: pgmap v11053: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 614 KiB/s rd, 577 KiB/s wr, 16 op/s 2023-05-08T09:28:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:01 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:28:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:28:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:28:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:01 smithi133 ceph-mon[125939]: pgmap v11053: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 614 KiB/s rd, 577 KiB/s wr, 16 op/s 2023-05-08T09:28:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:01 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:28:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:28:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:28:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:01 smithi096 ceph-mon[124666]: pgmap v11053: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 614 KiB/s rd, 577 KiB/s wr, 16 op/s 2023-05-08T09:28:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:01 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:28:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:28:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:28:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:02 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:28:02.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:02 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:28:02.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:02 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:28:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:03 smithi186 ceph-mon[126480]: pgmap v11054: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 367 KiB/s wr, 11 op/s 2023-05-08T09:28:03.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:28:03.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:28:03.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:03 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:28:03.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:28:03.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:03 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T09:28:03.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:03 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T09:28:03.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:03 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:28:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:03 smithi133 ceph-mon[125939]: pgmap v11054: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 367 KiB/s wr, 11 op/s 2023-05-08T09:28:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:28:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:28:03.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:03 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:28:03.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:28:03.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:03 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T09:28:03.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:03 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T09:28:03.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:03 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:28:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:03 smithi096 ceph-mon[124666]: pgmap v11054: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 367 KiB/s wr, 11 op/s 2023-05-08T09:28:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:28:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:28:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:03 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:28:03.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:28:03.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:03 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T09:28:03.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:03 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T09:28:03.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:03 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:28:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20623.035716 secs 2023-05-08T09:28:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20623.035716 secs 2023-05-08T09:28:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20623.035716 secs 2023-05-08T09:28:05.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20623.591837 secs 2023-05-08T09:28:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:05 smithi186 ceph-mon[126480]: pgmap v11055: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 598 KiB/s rd, 671 KiB/s wr, 31 op/s 2023-05-08T09:28:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20623.591837 secs 2023-05-08T09:28:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:05 smithi133 ceph-mon[125939]: pgmap v11055: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 598 KiB/s rd, 671 KiB/s wr, 31 op/s 2023-05-08T09:28:05.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20623.591837 secs 2023-05-08T09:28:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:05 smithi096 ceph-mon[124666]: pgmap v11055: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 598 KiB/s rd, 671 KiB/s wr, 31 op/s 2023-05-08T09:28:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20624.878200 secs 2023-05-08T09:28:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:06 smithi186 ceph-mon[126480]: osdmap e768: 12 total, 12 up, 12 in 2023-05-08T09:28:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20624.878200 secs 2023-05-08T09:28:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:06 smithi133 ceph-mon[125939]: osdmap e768: 12 total, 12 up, 12 in 2023-05-08T09:28:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20624.878200 secs 2023-05-08T09:28:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:06 smithi096 ceph-mon[124666]: osdmap e768: 12 total, 12 up, 12 in 2023-05-08T09:28:07.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:07 smithi186 ceph-mon[126480]: pgmap v11057: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 450 KiB/s rd, 488 KiB/s wr, 30 op/s 2023-05-08T09:28:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:07 smithi133 ceph-mon[125939]: pgmap v11057: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 450 KiB/s rd, 488 KiB/s wr, 30 op/s 2023-05-08T09:28:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:07 smithi096 ceph-mon[124666]: pgmap v11057: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 450 KiB/s rd, 488 KiB/s wr, 30 op/s 2023-05-08T09:28:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:09 smithi133 ceph-mon[125939]: pgmap v11058: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 450 KiB/s rd, 488 KiB/s wr, 30 op/s 2023-05-08T09:28:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20628.035844 secs 2023-05-08T09:28:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:09 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:28:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:28:09.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:28:09.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:28:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:09 smithi096 ceph-mon[124666]: pgmap v11058: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 450 KiB/s rd, 488 KiB/s wr, 30 op/s 2023-05-08T09:28:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20628.035844 secs 2023-05-08T09:28:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:09 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:28:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:28:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:28:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:28:09.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:09 smithi186 ceph-mon[126480]: pgmap v11058: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 450 KiB/s rd, 488 KiB/s wr, 30 op/s 2023-05-08T09:28:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20628.035844 secs 2023-05-08T09:28:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:09 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:28:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:28:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:28:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:28:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20628.591953 secs 2023-05-08T09:28:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20628.591953 secs 2023-05-08T09:28:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20628.591953 secs 2023-05-08T09:28:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20629.878345 secs 2023-05-08T09:28:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:11 smithi133 ceph-mon[125939]: pgmap v11059: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 455 KiB/s wr, 28 op/s 2023-05-08T09:28:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20629.878345 secs 2023-05-08T09:28:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:11 smithi096 ceph-mon[124666]: pgmap v11059: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 455 KiB/s wr, 28 op/s 2023-05-08T09:28:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20629.878345 secs 2023-05-08T09:28:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:11 smithi186 ceph-mon[126480]: pgmap v11059: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 455 KiB/s wr, 28 op/s 2023-05-08T09:28:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:13 smithi096 ceph-mon[124666]: pgmap v11060: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 455 KiB/s wr, 28 op/s 2023-05-08T09:28:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:13 smithi096 ceph-mon[124666]: osdmap e769: 12 total, 12 up, 12 in 2023-05-08T09:28:13.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:13 smithi186 ceph-mon[126480]: pgmap v11060: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 455 KiB/s wr, 28 op/s 2023-05-08T09:28:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:13 smithi186 ceph-mon[126480]: osdmap e769: 12 total, 12 up, 12 in 2023-05-08T09:28:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:13 smithi133 ceph-mon[125939]: pgmap v11060: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 455 KiB/s wr, 28 op/s 2023-05-08T09:28:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:13 smithi133 ceph-mon[125939]: osdmap e769: 12 total, 12 up, 12 in 2023-05-08T09:28:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20633.035965 secs 2023-05-08T09:28:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20633.035965 secs 2023-05-08T09:28:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20633.035965 secs 2023-05-08T09:28:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20633.592068 secs 2023-05-08T09:28:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:15 smithi096 ceph-mon[124666]: pgmap v11062: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 173 KiB/s wr, 10 op/s 2023-05-08T09:28:15.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20633.592068 secs 2023-05-08T09:28:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:15 smithi186 ceph-mon[126480]: pgmap v11062: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 173 KiB/s wr, 10 op/s 2023-05-08T09:28:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20633.592068 secs 2023-05-08T09:28:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:15 smithi133 ceph-mon[125939]: pgmap v11062: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 173 KiB/s wr, 10 op/s 2023-05-08T09:28:16.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20634.878468 secs 2023-05-08T09:28:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20634.878468 secs 2023-05-08T09:28:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20634.878468 secs 2023-05-08T09:28:17.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:17 smithi186 ceph-mon[126480]: pgmap v11063: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 154 KiB/s wr, 8 op/s 2023-05-08T09:28:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:17 smithi133 ceph-mon[125939]: pgmap v11063: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 154 KiB/s wr, 8 op/s 2023-05-08T09:28:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:17 smithi096 ceph-mon[124666]: pgmap v11063: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 154 KiB/s wr, 8 op/s 2023-05-08T09:28:19.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:19 smithi186 ceph-mon[126480]: pgmap v11064: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 154 KiB/s wr, 8 op/s 2023-05-08T09:28:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20638.036059 secs 2023-05-08T09:28:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:19 smithi133 ceph-mon[125939]: pgmap v11064: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 154 KiB/s wr, 8 op/s 2023-05-08T09:28:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20638.036059 secs 2023-05-08T09:28:19.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:19 smithi096 ceph-mon[124666]: pgmap v11064: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 154 KiB/s wr, 8 op/s 2023-05-08T09:28:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20638.036059 secs 2023-05-08T09:28:20.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20638.592191 secs 2023-05-08T09:28:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20638.592191 secs 2023-05-08T09:28:20.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20638.592191 secs 2023-05-08T09:28:21.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20639.878588 secs 2023-05-08T09:28:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:21 smithi186 ceph-mon[126480]: pgmap v11065: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 64 KiB/s wr, 6 op/s 2023-05-08T09:28:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20639.878588 secs 2023-05-08T09:28:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:21 smithi133 ceph-mon[125939]: pgmap v11065: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 64 KiB/s wr, 6 op/s 2023-05-08T09:28:21.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20639.878588 secs 2023-05-08T09:28:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:21 smithi096 ceph-mon[124666]: pgmap v11065: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 64 KiB/s wr, 6 op/s 2023-05-08T09:28:23.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:23 smithi186 ceph-mon[126480]: pgmap v11066: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 64 KiB/s wr, 6 op/s 2023-05-08T09:28:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:23 smithi133 ceph-mon[125939]: pgmap v11066: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 64 KiB/s wr, 6 op/s 2023-05-08T09:28:23.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:23 smithi096 ceph-mon[124666]: pgmap v11066: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 64 KiB/s wr, 6 op/s 2023-05-08T09:28:24.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20643.036173 secs 2023-05-08T09:28:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20643.036173 secs 2023-05-08T09:28:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20643.036173 secs 2023-05-08T09:28:25.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20643.592302 secs 2023-05-08T09:28:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:25 smithi186 ceph-mon[126480]: pgmap v11067: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 58 KiB/s wr, 8 op/s 2023-05-08T09:28:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20643.592302 secs 2023-05-08T09:28:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:25 smithi133 ceph-mon[125939]: pgmap v11067: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 58 KiB/s wr, 8 op/s 2023-05-08T09:28:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20643.592302 secs 2023-05-08T09:28:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:25 smithi096 ceph-mon[124666]: pgmap v11067: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 58 KiB/s wr, 8 op/s 2023-05-08T09:28:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20644.878711 secs 2023-05-08T09:28:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20644.878711 secs 2023-05-08T09:28:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20644.878711 secs 2023-05-08T09:28:27.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:27 smithi186 ceph-mon[126480]: pgmap v11068: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:28:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:27 smithi133 ceph-mon[125939]: pgmap v11068: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:28:27.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:27 smithi096 ceph-mon[124666]: pgmap v11068: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:28:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:29 smithi186 ceph-mon[126480]: pgmap v11069: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:28:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20648.036261 secs 2023-05-08T09:28:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:29 smithi133 ceph-mon[125939]: pgmap v11069: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:28:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20648.036261 secs 2023-05-08T09:28:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:29 smithi096 ceph-mon[124666]: pgmap v11069: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:28:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20648.036261 secs 2023-05-08T09:28:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20648.592438 secs 2023-05-08T09:28:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20648.592438 secs 2023-05-08T09:28:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20648.592438 secs 2023-05-08T09:28:31.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20649.878838 secs 2023-05-08T09:28:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:31 smithi186 ceph-mon[126480]: pgmap v11070: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T09:28:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20649.878838 secs 2023-05-08T09:28:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:31 smithi133 ceph-mon[125939]: pgmap v11070: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T09:28:31.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20649.878838 secs 2023-05-08T09:28:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:31 smithi096 ceph-mon[124666]: pgmap v11070: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T09:28:33.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:33 smithi186 ceph-mon[126480]: pgmap v11071: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T09:28:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:33 smithi133 ceph-mon[125939]: pgmap v11071: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T09:28:33.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:33 smithi096 ceph-mon[124666]: pgmap v11071: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T09:28:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20653.036403 secs 2023-05-08T09:28:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20653.036403 secs 2023-05-08T09:28:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20653.036403 secs 2023-05-08T09:28:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20653.592557 secs 2023-05-08T09:28:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:35 smithi186 ceph-mon[126480]: pgmap v11072: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 70 KiB/s wr, 8 op/s 2023-05-08T09:28:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20653.592557 secs 2023-05-08T09:28:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:35 smithi133 ceph-mon[125939]: pgmap v11072: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 70 KiB/s wr, 8 op/s 2023-05-08T09:28:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20653.592557 secs 2023-05-08T09:28:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:35 smithi096 ceph-mon[124666]: pgmap v11072: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 70 KiB/s wr, 8 op/s 2023-05-08T09:28:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20654.878965 secs 2023-05-08T09:28:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20654.878965 secs 2023-05-08T09:28:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20654.878965 secs 2023-05-08T09:28:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:37 smithi186 ceph-mon[126480]: pgmap v11073: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 70 KiB/s wr, 6 op/s 2023-05-08T09:28:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:37 smithi133 ceph-mon[125939]: pgmap v11073: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 70 KiB/s wr, 6 op/s 2023-05-08T09:28:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:37 smithi096 ceph-mon[124666]: pgmap v11073: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 70 KiB/s wr, 6 op/s 2023-05-08T09:28:39.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:39 smithi186 ceph-mon[126480]: pgmap v11074: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 70 KiB/s wr, 6 op/s 2023-05-08T09:28:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20658.036522 secs 2023-05-08T09:28:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:39 smithi133 ceph-mon[125939]: pgmap v11074: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 70 KiB/s wr, 6 op/s 2023-05-08T09:28:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20658.036522 secs 2023-05-08T09:28:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:39 smithi096 ceph-mon[124666]: pgmap v11074: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 70 KiB/s wr, 6 op/s 2023-05-08T09:28:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20658.036522 secs 2023-05-08T09:28:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20658.592649 secs 2023-05-08T09:28:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20658.592649 secs 2023-05-08T09:28:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20658.592649 secs 2023-05-08T09:28:41.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20659.879026 secs 2023-05-08T09:28:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:41 smithi186 ceph-mon[126480]: pgmap v11075: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 70 KiB/s wr, 10 op/s 2023-05-08T09:28:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20659.879026 secs 2023-05-08T09:28:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:41 smithi133 ceph-mon[125939]: pgmap v11075: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 70 KiB/s wr, 10 op/s 2023-05-08T09:28:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20659.879026 secs 2023-05-08T09:28:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:41 smithi096 ceph-mon[124666]: pgmap v11075: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 70 KiB/s wr, 10 op/s 2023-05-08T09:28:43.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:43 smithi186 ceph-mon[126480]: pgmap v11076: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 70 KiB/s wr, 7 op/s 2023-05-08T09:28:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:43 smithi133 ceph-mon[125939]: pgmap v11076: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 70 KiB/s wr, 7 op/s 2023-05-08T09:28:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:43 smithi096 ceph-mon[124666]: pgmap v11076: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 70 KiB/s wr, 7 op/s 2023-05-08T09:28:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20663.036668 secs 2023-05-08T09:28:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20663.036668 secs 2023-05-08T09:28:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20663.036668 secs 2023-05-08T09:28:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20663.592741 secs 2023-05-08T09:28:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:45 smithi186 ceph-mon[126480]: pgmap v11077: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 212 KiB/s wr, 10 op/s 2023-05-08T09:28:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20663.592741 secs 2023-05-08T09:28:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:45 smithi133 ceph-mon[125939]: pgmap v11077: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 212 KiB/s wr, 10 op/s 2023-05-08T09:28:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20663.592741 secs 2023-05-08T09:28:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:45 smithi096 ceph-mon[124666]: pgmap v11077: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 212 KiB/s wr, 10 op/s 2023-05-08T09:28:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20664.879153 secs 2023-05-08T09:28:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20664.879153 secs 2023-05-08T09:28:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20664.879153 secs 2023-05-08T09:28:47.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:47 smithi186 ceph-mon[126480]: pgmap v11078: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 142 KiB/s wr, 7 op/s 2023-05-08T09:28:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:47 smithi133 ceph-mon[125939]: pgmap v11078: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 142 KiB/s wr, 7 op/s 2023-05-08T09:28:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:47 smithi096 ceph-mon[124666]: pgmap v11078: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 142 KiB/s wr, 7 op/s 2023-05-08T09:28:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:49 smithi186 ceph-mon[126480]: pgmap v11079: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 142 KiB/s wr, 7 op/s 2023-05-08T09:28:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20668.036776 secs 2023-05-08T09:28:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:49 smithi133 ceph-mon[125939]: pgmap v11079: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 142 KiB/s wr, 7 op/s 2023-05-08T09:28:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20668.036776 secs 2023-05-08T09:28:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:49 smithi096 ceph-mon[124666]: pgmap v11079: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 142 KiB/s wr, 7 op/s 2023-05-08T09:28:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20668.036776 secs 2023-05-08T09:28:51.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20669.879295 secs 2023-05-08T09:28:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:51 smithi186 ceph-mon[126480]: pgmap v11080: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 426 KiB/s wr, 11 op/s 2023-05-08T09:28:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20669.879295 secs 2023-05-08T09:28:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:51 smithi133 ceph-mon[125939]: pgmap v11080: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 426 KiB/s wr, 11 op/s 2023-05-08T09:28:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20669.879295 secs 2023-05-08T09:28:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:51 smithi096 ceph-mon[124666]: pgmap v11080: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 426 KiB/s wr, 11 op/s 2023-05-08T09:28:52.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:28:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:28:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:28:53.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:53 smithi133 ceph-mon[125939]: pgmap v11081: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 425 KiB/s wr, 7 op/s 2023-05-08T09:28:53.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:53 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:28:53.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:28:53.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:28:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:53 smithi096 ceph-mon[124666]: pgmap v11081: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 425 KiB/s wr, 7 op/s 2023-05-08T09:28:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:53 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:28:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:28:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:28:53.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:53 smithi186 ceph-mon[126480]: pgmap v11081: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 425 KiB/s wr, 7 op/s 2023-05-08T09:28:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:53 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:28:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:28:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:28:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20673.036886 secs 2023-05-08T09:28:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20673.036886 secs 2023-05-08T09:28:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20673.036886 secs 2023-05-08T09:28:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20673.592998 secs 2023-05-08T09:28:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:55 smithi133 ceph-mon[125939]: pgmap v11082: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 631 KiB/s rd, 618 KiB/s wr, 13 op/s 2023-05-08T09:28:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:55 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:28:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20673.592998 secs 2023-05-08T09:28:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:55 smithi096 ceph-mon[124666]: pgmap v11082: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 631 KiB/s rd, 618 KiB/s wr, 13 op/s 2023-05-08T09:28:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:55 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:28:55.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20673.592998 secs 2023-05-08T09:28:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:55 smithi186 ceph-mon[126480]: pgmap v11082: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 631 KiB/s rd, 618 KiB/s wr, 13 op/s 2023-05-08T09:28:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:55 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:28:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:28:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:28:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:28:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:28:56.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:28:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:28:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:57 smithi133 ceph-mon[125939]: pgmap v11083: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 488 KiB/s rd, 476 KiB/s wr, 10 op/s 2023-05-08T09:28:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:28:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:28:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:57 smithi096 ceph-mon[124666]: pgmap v11083: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 488 KiB/s rd, 476 KiB/s wr, 10 op/s 2023-05-08T09:28:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:28:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:28:57.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:57 smithi186 ceph-mon[126480]: pgmap v11083: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 488 KiB/s rd, 476 KiB/s wr, 10 op/s 2023-05-08T09:28:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:28:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:28:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:59 smithi133 ceph-mon[125939]: pgmap v11084: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 488 KiB/s rd, 476 KiB/s wr, 10 op/s 2023-05-08T09:28:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:28:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20678.037015 secs 2023-05-08T09:28:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:59 smithi096 ceph-mon[124666]: pgmap v11084: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 488 KiB/s rd, 476 KiB/s wr, 10 op/s 2023-05-08T09:28:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:28:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20678.037015 secs 2023-05-08T09:28:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:59 smithi186 ceph-mon[126480]: pgmap v11084: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 488 KiB/s rd, 476 KiB/s wr, 10 op/s 2023-05-08T09:28:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:28:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20678.037015 secs 2023-05-08T09:29:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:00 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:29:00.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:00 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:29:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:00 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:29:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:01 smithi133 ceph-mon[125939]: pgmap v11085: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 665 KiB/s rd, 652 KiB/s wr, 15 op/s 2023-05-08T09:29:01.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:01 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:29:01.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:29:01.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:29:01.766 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:01 smithi096 ceph-mon[124666]: pgmap v11085: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 665 KiB/s rd, 652 KiB/s wr, 15 op/s 2023-05-08T09:29:01.766 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:01 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:29:01.767 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:29:01.767 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:29:01.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:01 smithi186 ceph-mon[126480]: pgmap v11085: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 665 KiB/s rd, 652 KiB/s wr, 15 op/s 2023-05-08T09:29:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:01 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:29:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:29:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:29:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:03 smithi133 ceph-mon[125939]: pgmap v11086: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 368 KiB/s wr, 11 op/s 2023-05-08T09:29:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:29:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:29:03.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:29:03.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:29:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:03 smithi096 ceph-mon[124666]: pgmap v11086: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 368 KiB/s wr, 11 op/s 2023-05-08T09:29:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:29:03.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:29:03.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:29:03.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:29:03.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:03 smithi186 ceph-mon[126480]: pgmap v11086: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 368 KiB/s wr, 11 op/s 2023-05-08T09:29:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:29:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:29:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:29:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:29:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:04 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:29:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:04 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T09:29:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:04 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T09:29:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:04 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:29:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20683.037133 secs 2023-05-08T09:29:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:04 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:29:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:04 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T09:29:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:04 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T09:29:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:04 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:29:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20683.037133 secs 2023-05-08T09:29:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:04 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:29:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:04 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T09:29:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:04 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T09:29:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:04 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:29:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20683.037133 secs 2023-05-08T09:29:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20683.593206 secs 2023-05-08T09:29:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:05 smithi133 ceph-mon[125939]: pgmap v11087: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 537 KiB/s wr, 30 op/s 2023-05-08T09:29:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20683.593206 secs 2023-05-08T09:29:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:05 smithi096 ceph-mon[124666]: pgmap v11087: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 537 KiB/s wr, 30 op/s 2023-05-08T09:29:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20683.593206 secs 2023-05-08T09:29:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:05 smithi186 ceph-mon[126480]: pgmap v11087: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 537 KiB/s wr, 30 op/s 2023-05-08T09:29:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20684.879603 secs 2023-05-08T09:29:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:06 smithi133 ceph-mon[125939]: osdmap e770: 12 total, 12 up, 12 in 2023-05-08T09:29:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20684.879603 secs 2023-05-08T09:29:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:06 smithi096 ceph-mon[124666]: osdmap e770: 12 total, 12 up, 12 in 2023-05-08T09:29:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20684.879603 secs 2023-05-08T09:29:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:06 smithi186 ceph-mon[126480]: osdmap e770: 12 total, 12 up, 12 in 2023-05-08T09:29:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:07 smithi133 ceph-mon[125939]: pgmap v11089: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 414 KiB/s wr, 30 op/s 2023-05-08T09:29:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:07 smithi096 ceph-mon[124666]: pgmap v11089: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 414 KiB/s wr, 30 op/s 2023-05-08T09:29:07.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:07 smithi186 ceph-mon[126480]: pgmap v11089: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 414 KiB/s wr, 30 op/s 2023-05-08T09:29:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:08 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:29:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:29:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:29:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:08 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:29:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:29:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:29:08.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:08 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:29:08.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:29:08.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:29:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:09 smithi133 ceph-mon[125939]: pgmap v11090: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 414 KiB/s wr, 30 op/s 2023-05-08T09:29:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20688.037261 secs 2023-05-08T09:29:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:29:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:29:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:09 smithi096 ceph-mon[124666]: pgmap v11090: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 414 KiB/s wr, 30 op/s 2023-05-08T09:29:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20688.037261 secs 2023-05-08T09:29:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:29:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:29:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:09 smithi186 ceph-mon[126480]: pgmap v11090: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 414 KiB/s wr, 30 op/s 2023-05-08T09:29:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20688.037261 secs 2023-05-08T09:29:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:29:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:29:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20688.593323 secs 2023-05-08T09:29:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20688.593323 secs 2023-05-08T09:29:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20688.593323 secs 2023-05-08T09:29:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20689.879734 secs 2023-05-08T09:29:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:11 smithi133 ceph-mon[125939]: pgmap v11091: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 293 KiB/s wr, 27 op/s 2023-05-08T09:29:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20689.879734 secs 2023-05-08T09:29:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:11 smithi096 ceph-mon[124666]: pgmap v11091: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 293 KiB/s wr, 27 op/s 2023-05-08T09:29:11.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20689.879734 secs 2023-05-08T09:29:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:11 smithi186 ceph-mon[126480]: pgmap v11091: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 293 KiB/s wr, 27 op/s 2023-05-08T09:29:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:13 smithi133 ceph-mon[125939]: pgmap v11092: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 292 KiB/s wr, 27 op/s 2023-05-08T09:29:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:13 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:29:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:13 smithi133 ceph-mon[125939]: osdmap e771: 12 total, 12 up, 12 in 2023-05-08T09:29:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:13 smithi096 ceph-mon[124666]: pgmap v11092: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 292 KiB/s wr, 27 op/s 2023-05-08T09:29:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:13 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:29:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:13 smithi096 ceph-mon[124666]: osdmap e771: 12 total, 12 up, 12 in 2023-05-08T09:29:13.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:13 smithi186 ceph-mon[126480]: pgmap v11092: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 292 KiB/s wr, 27 op/s 2023-05-08T09:29:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:13 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:29:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:13 smithi186 ceph-mon[126480]: osdmap e771: 12 total, 12 up, 12 in 2023-05-08T09:29:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20693.037379 secs 2023-05-08T09:29:14.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20693.037379 secs 2023-05-08T09:29:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20693.037379 secs 2023-05-08T09:29:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20693.593448 secs 2023-05-08T09:29:15.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:15 smithi133 ceph-mon[125939]: pgmap v11094: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 174 KiB/s wr, 8 op/s 2023-05-08T09:29:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20693.593448 secs 2023-05-08T09:29:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:15 smithi096 ceph-mon[124666]: pgmap v11094: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 174 KiB/s wr, 8 op/s 2023-05-08T09:29:15.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20693.593448 secs 2023-05-08T09:29:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:15 smithi186 ceph-mon[126480]: pgmap v11094: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 174 KiB/s wr, 8 op/s 2023-05-08T09:29:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20694.879857 secs 2023-05-08T09:29:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20694.879857 secs 2023-05-08T09:29:16.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20694.879857 secs 2023-05-08T09:29:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:17 smithi133 ceph-mon[125939]: pgmap v11095: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 154 KiB/s wr, 7 op/s 2023-05-08T09:29:17.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:17 smithi096 ceph-mon[124666]: pgmap v11095: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 154 KiB/s wr, 7 op/s 2023-05-08T09:29:17.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:17 smithi186 ceph-mon[126480]: pgmap v11095: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 154 KiB/s wr, 7 op/s 2023-05-08T09:29:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:19 smithi133 ceph-mon[125939]: pgmap v11096: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 154 KiB/s wr, 7 op/s 2023-05-08T09:29:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20698.037507 secs 2023-05-08T09:29:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:19 smithi096 ceph-mon[124666]: pgmap v11096: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 154 KiB/s wr, 7 op/s 2023-05-08T09:29:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20698.037507 secs 2023-05-08T09:29:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:19 smithi186 ceph-mon[126480]: pgmap v11096: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 154 KiB/s wr, 7 op/s 2023-05-08T09:29:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20698.037507 secs 2023-05-08T09:29:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20698.593539 secs 2023-05-08T09:29:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20698.593539 secs 2023-05-08T09:29:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20698.593539 secs 2023-05-08T09:29:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20699.879980 secs 2023-05-08T09:29:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:21 smithi133 ceph-mon[125939]: pgmap v11097: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 64 KiB/s wr, 6 op/s 2023-05-08T09:29:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20699.879980 secs 2023-05-08T09:29:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:21 smithi096 ceph-mon[124666]: pgmap v11097: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 64 KiB/s wr, 6 op/s 2023-05-08T09:29:21.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20699.879980 secs 2023-05-08T09:29:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:21 smithi186 ceph-mon[126480]: pgmap v11097: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 64 KiB/s wr, 6 op/s 2023-05-08T09:29:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:23 smithi096 ceph-mon[124666]: pgmap v11098: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 64 KiB/s wr, 6 op/s 2023-05-08T09:29:23.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:23 smithi186 ceph-mon[126480]: pgmap v11098: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 64 KiB/s wr, 6 op/s 2023-05-08T09:29:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:23 smithi133 ceph-mon[125939]: pgmap v11098: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 64 KiB/s wr, 6 op/s 2023-05-08T09:29:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20703.037628 secs 2023-05-08T09:29:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20703.037628 secs 2023-05-08T09:29:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20703.037628 secs 2023-05-08T09:29:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20703.593606 secs 2023-05-08T09:29:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:25 smithi096 ceph-mon[124666]: pgmap v11099: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 58 KiB/s wr, 8 op/s 2023-05-08T09:29:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20703.593606 secs 2023-05-08T09:29:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:25 smithi186 ceph-mon[126480]: pgmap v11099: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 58 KiB/s wr, 8 op/s 2023-05-08T09:29:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20703.593606 secs 2023-05-08T09:29:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:25 smithi133 ceph-mon[125939]: pgmap v11099: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 58 KiB/s wr, 8 op/s 2023-05-08T09:29:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20704.880111 secs 2023-05-08T09:29:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20704.880111 secs 2023-05-08T09:29:27.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20704.880111 secs 2023-05-08T09:29:27.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:27 smithi186 ceph-mon[126480]: pgmap v11100: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:29:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:27 smithi133 ceph-mon[125939]: pgmap v11100: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:29:28.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:27 smithi096 ceph-mon[124666]: pgmap v11100: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:29:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:29 smithi186 ceph-mon[126480]: pgmap v11101: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:29:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20708.037747 secs 2023-05-08T09:29:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:29 smithi133 ceph-mon[125939]: pgmap v11101: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:29:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20708.037747 secs 2023-05-08T09:29:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:29 smithi096 ceph-mon[124666]: pgmap v11101: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:29:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20708.037747 secs 2023-05-08T09:29:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20708.593668 secs 2023-05-08T09:29:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20708.593668 secs 2023-05-08T09:29:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20708.593668 secs 2023-05-08T09:29:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20709.880238 secs 2023-05-08T09:29:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:31 smithi186 ceph-mon[126480]: pgmap v11102: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.2 KiB/s wr, 8 op/s 2023-05-08T09:29:31.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20709.880238 secs 2023-05-08T09:29:31.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:31 smithi133 ceph-mon[125939]: pgmap v11102: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.2 KiB/s wr, 8 op/s 2023-05-08T09:29:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20709.880238 secs 2023-05-08T09:29:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:31 smithi096 ceph-mon[124666]: pgmap v11102: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.2 KiB/s wr, 8 op/s 2023-05-08T09:29:33.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:33 smithi186 ceph-mon[126480]: pgmap v11103: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 3.2 KiB/s wr, 5 op/s 2023-05-08T09:29:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:33 smithi133 ceph-mon[125939]: pgmap v11103: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 3.2 KiB/s wr, 5 op/s 2023-05-08T09:29:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:33 smithi096 ceph-mon[124666]: pgmap v11103: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 3.2 KiB/s wr, 5 op/s 2023-05-08T09:29:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20713.037846 secs 2023-05-08T09:29:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20713.037846 secs 2023-05-08T09:29:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20713.037846 secs 2023-05-08T09:29:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20713.593782 secs 2023-05-08T09:29:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:35 smithi186 ceph-mon[126480]: pgmap v11104: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 207 KiB/s wr, 9 op/s 2023-05-08T09:29:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20713.593782 secs 2023-05-08T09:29:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:35 smithi133 ceph-mon[125939]: pgmap v11104: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 207 KiB/s wr, 9 op/s 2023-05-08T09:29:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20713.593782 secs 2023-05-08T09:29:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:35 smithi096 ceph-mon[124666]: pgmap v11104: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 207 KiB/s wr, 9 op/s 2023-05-08T09:29:36.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20714.880362 secs 2023-05-08T09:29:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20714.880362 secs 2023-05-08T09:29:37.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20714.880362 secs 2023-05-08T09:29:37.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:37 smithi186 ceph-mon[126480]: pgmap v11105: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 207 KiB/s wr, 6 op/s 2023-05-08T09:29:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:37 smithi133 ceph-mon[125939]: pgmap v11105: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 207 KiB/s wr, 6 op/s 2023-05-08T09:29:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:37 smithi096 ceph-mon[124666]: pgmap v11105: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 207 KiB/s wr, 6 op/s 2023-05-08T09:29:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:39 smithi186 ceph-mon[126480]: pgmap v11106: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 207 KiB/s wr, 6 op/s 2023-05-08T09:29:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20718.037992 secs 2023-05-08T09:29:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:39 smithi133 ceph-mon[125939]: pgmap v11106: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 207 KiB/s wr, 6 op/s 2023-05-08T09:29:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20718.037992 secs 2023-05-08T09:29:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:39 smithi096 ceph-mon[124666]: pgmap v11106: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 207 KiB/s wr, 6 op/s 2023-05-08T09:29:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20718.037992 secs 2023-05-08T09:29:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20718.593918 secs 2023-05-08T09:29:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20718.593918 secs 2023-05-08T09:29:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20718.593918 secs 2023-05-08T09:29:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20719.880514 secs 2023-05-08T09:29:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:41 smithi186 ceph-mon[126480]: pgmap v11107: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 207 KiB/s wr, 10 op/s 2023-05-08T09:29:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20719.880514 secs 2023-05-08T09:29:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:41 smithi133 ceph-mon[125939]: pgmap v11107: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 207 KiB/s wr, 10 op/s 2023-05-08T09:29:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20719.880514 secs 2023-05-08T09:29:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:41 smithi096 ceph-mon[124666]: pgmap v11107: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 207 KiB/s wr, 10 op/s 2023-05-08T09:29:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:43 smithi186 ceph-mon[126480]: pgmap v11108: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 204 KiB/s wr, 7 op/s 2023-05-08T09:29:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:43 smithi133 ceph-mon[125939]: pgmap v11108: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 204 KiB/s wr, 7 op/s 2023-05-08T09:29:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:43 smithi096 ceph-mon[124666]: pgmap v11108: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 204 KiB/s wr, 7 op/s 2023-05-08T09:29:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20723.038117 secs 2023-05-08T09:29:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20723.038117 secs 2023-05-08T09:29:45.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20723.038117 secs 2023-05-08T09:29:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20723.594061 secs 2023-05-08T09:29:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:45 smithi186 ceph-mon[126480]: pgmap v11109: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 294 KiB/s rd, 627 KiB/s wr, 10 op/s 2023-05-08T09:29:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20723.594061 secs 2023-05-08T09:29:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:45 smithi133 ceph-mon[125939]: pgmap v11109: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 294 KiB/s rd, 627 KiB/s wr, 10 op/s 2023-05-08T09:29:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20723.594061 secs 2023-05-08T09:29:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:45 smithi096 ceph-mon[124666]: pgmap v11109: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 294 KiB/s rd, 627 KiB/s wr, 10 op/s 2023-05-08T09:29:46.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20724.880647 secs 2023-05-08T09:29:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20724.880647 secs 2023-05-08T09:29:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20724.880647 secs 2023-05-08T09:29:47.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:47 smithi186 ceph-mon[126480]: pgmap v11110: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 424 KiB/s wr, 7 op/s 2023-05-08T09:29:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:47 smithi133 ceph-mon[125939]: pgmap v11110: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 424 KiB/s wr, 7 op/s 2023-05-08T09:29:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:47 smithi096 ceph-mon[124666]: pgmap v11110: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 424 KiB/s wr, 7 op/s 2023-05-08T09:29:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:49 smithi186 ceph-mon[126480]: pgmap v11111: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 424 KiB/s wr, 7 op/s 2023-05-08T09:29:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20728.038231 secs 2023-05-08T09:29:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:49 smithi133 ceph-mon[125939]: pgmap v11111: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 424 KiB/s wr, 7 op/s 2023-05-08T09:29:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20728.038231 secs 2023-05-08T09:29:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:49 smithi096 ceph-mon[124666]: pgmap v11111: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 424 KiB/s wr, 7 op/s 2023-05-08T09:29:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20728.038231 secs 2023-05-08T09:29:51.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:51 smithi186 ceph-mon[126480]: pgmap v11112: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 735 KiB/s rd, 579 KiB/s wr, 12 op/s 2023-05-08T09:29:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:51 smithi133 ceph-mon[125939]: pgmap v11112: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 735 KiB/s rd, 579 KiB/s wr, 12 op/s 2023-05-08T09:29:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:51 smithi096 ceph-mon[124666]: pgmap v11112: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 735 KiB/s rd, 579 KiB/s wr, 12 op/s 2023-05-08T09:29:52.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:29:52.737 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:29:52.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:29:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:29:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:29:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:29:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:53 smithi186 ceph-mon[126480]: pgmap v11113: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 591 KiB/s rd, 578 KiB/s wr, 9 op/s 2023-05-08T09:29:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:53 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:29:53.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:29:53.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:29:53.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:29:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:53 smithi133 ceph-mon[125939]: pgmap v11113: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 591 KiB/s rd, 578 KiB/s wr, 9 op/s 2023-05-08T09:29:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:53 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:29:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:29:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:29:53.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:29:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:53 smithi096 ceph-mon[124666]: pgmap v11113: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 591 KiB/s rd, 578 KiB/s wr, 9 op/s 2023-05-08T09:29:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:53 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:29:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:29:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:29:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:29:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20733.038372 secs 2023-05-08T09:29:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20733.038372 secs 2023-05-08T09:29:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20733.038372 secs 2023-05-08T09:29:55.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:55 smithi186 ceph-mon[126480]: pgmap v11114: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 792 KiB/s rd, 800 KiB/s wr, 15 op/s 2023-05-08T09:29:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:55 smithi133 ceph-mon[125939]: pgmap v11114: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 792 KiB/s rd, 800 KiB/s wr, 15 op/s 2023-05-08T09:29:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:55 smithi096 ceph-mon[124666]: pgmap v11114: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 792 KiB/s rd, 800 KiB/s wr, 15 op/s 2023-05-08T09:29:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20734.880869 secs 2023-05-08T09:29:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20734.880869 secs 2023-05-08T09:29:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20734.880869 secs 2023-05-08T09:29:57.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:57 smithi186 ceph-mon[126480]: pgmap v11115: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 709 KiB/s rd, 377 KiB/s wr, 11 op/s 2023-05-08T09:29:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:29:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:29:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:57 smithi133 ceph-mon[125939]: pgmap v11115: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 709 KiB/s rd, 377 KiB/s wr, 11 op/s 2023-05-08T09:29:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:29:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:29:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:57 smithi096 ceph-mon[124666]: pgmap v11115: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 709 KiB/s rd, 377 KiB/s wr, 11 op/s 2023-05-08T09:29:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:29:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:29:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:58 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:29:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:58 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:29:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:58 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:29:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:59 smithi186 ceph-mon[126480]: pgmap v11116: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 709 KiB/s rd, 377 KiB/s wr, 11 op/s 2023-05-08T09:29:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:29:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20738.038516 secs 2023-05-08T09:29:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:59 smithi133 ceph-mon[125939]: pgmap v11116: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 709 KiB/s rd, 377 KiB/s wr, 11 op/s 2023-05-08T09:29:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:29:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20738.038516 secs 2023-05-08T09:29:59.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:59 smithi096 ceph-mon[124666]: pgmap v11116: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 709 KiB/s rd, 377 KiB/s wr, 11 op/s 2023-05-08T09:29:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:29:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20738.038516 secs 2023-05-08T09:30:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20738.594406 secs 2023-05-08T09:30:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:00 smithi186 ceph-mon[126480]: overall HEALTH_WARN 2 MDSs report slow requests 2023-05-08T09:30:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20738.594406 secs 2023-05-08T09:30:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:00 smithi133 ceph-mon[125939]: overall HEALTH_WARN 2 MDSs report slow requests 2023-05-08T09:30:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20738.594406 secs 2023-05-08T09:30:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:00 smithi096 ceph-mon[124666]: overall HEALTH_WARN 2 MDSs report slow requests 2023-05-08T09:30:01.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20739.880993 secs 2023-05-08T09:30:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:01 smithi186 ceph-mon[126480]: pgmap v11117: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 807 KiB/s rd, 452 KiB/s wr, 16 op/s 2023-05-08T09:30:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:30:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:30:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20739.880993 secs 2023-05-08T09:30:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:01 smithi133 ceph-mon[125939]: pgmap v11117: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 807 KiB/s rd, 452 KiB/s wr, 16 op/s 2023-05-08T09:30:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:30:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:30:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20739.880993 secs 2023-05-08T09:30:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:01 smithi096 ceph-mon[124666]: pgmap v11117: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 807 KiB/s rd, 452 KiB/s wr, 16 op/s 2023-05-08T09:30:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:30:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:30:03.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:03 smithi186 ceph-mon[126480]: pgmap v11118: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 297 KiB/s wr, 10 op/s 2023-05-08T09:30:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:30:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:03 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:30:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:03 smithi133 ceph-mon[125939]: pgmap v11118: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 297 KiB/s wr, 10 op/s 2023-05-08T09:30:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:30:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:03 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:30:03.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:03 smithi096 ceph-mon[124666]: pgmap v11118: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 297 KiB/s wr, 10 op/s 2023-05-08T09:30:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:30:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:03 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:30:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20743.038588 secs 2023-05-08T09:30:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20743.038588 secs 2023-05-08T09:30:04.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20743.038588 secs 2023-05-08T09:30:05.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20743.594514 secs 2023-05-08T09:30:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:05 smithi186 ceph-mon[126480]: pgmap v11119: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 412 KiB/s wr, 28 op/s 2023-05-08T09:30:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20743.594514 secs 2023-05-08T09:30:05.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:05 smithi133 ceph-mon[125939]: pgmap v11119: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 412 KiB/s wr, 28 op/s 2023-05-08T09:30:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20743.594514 secs 2023-05-08T09:30:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:05 smithi096 ceph-mon[124666]: pgmap v11119: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 412 KiB/s wr, 28 op/s 2023-05-08T09:30:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20744.881065 secs 2023-05-08T09:30:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:06 smithi186 ceph-mon[126480]: osdmap e772: 12 total, 12 up, 12 in 2023-05-08T09:30:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:06 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:30:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:06 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:30:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:06 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:30:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:06 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:30:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:06 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:30:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:06 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:30:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20744.881065 secs 2023-05-08T09:30:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:06 smithi133 ceph-mon[125939]: osdmap e772: 12 total, 12 up, 12 in 2023-05-08T09:30:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:06 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:30:06.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:06 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:30:06.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:06 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:30:06.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:06 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:30:06.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:06 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:30:06.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:06 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:30:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20744.881065 secs 2023-05-08T09:30:06.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:06 smithi096 ceph-mon[124666]: osdmap e772: 12 total, 12 up, 12 in 2023-05-08T09:30:06.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:06 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:30:06.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:06 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:30:06.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:06 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:30:06.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:06 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:30:06.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:06 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:30:06.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:06 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:30:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:07 smithi186 ceph-mon[126480]: pgmap v11121: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 228 KiB/s wr, 26 op/s 2023-05-08T09:30:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:07 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:30:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:07 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:30:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:07 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:30:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:07 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:30:07.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:07 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T09:30:07.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:07 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T09:30:07.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:07 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:30:07.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:07 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:30:07.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:07 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:30:07.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:07 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:30:07.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:07 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T09:30:07.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:07 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T09:30:07.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:07 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:30:07.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:07 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd='[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]': finished 2023-05-08T09:30:07.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:07 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:30:07.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:07 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:30:07.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:07 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:30:07.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:07 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:30:07.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:07 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T09:30:07.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:07 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T09:30:07.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:07 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:30:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:07 smithi133 ceph-mon[125939]: pgmap v11121: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 228 KiB/s wr, 26 op/s 2023-05-08T09:30:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:07 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:30:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:07 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:30:07.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:07 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:30:07.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:07 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:30:07.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:07 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T09:30:07.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:07 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T09:30:07.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:07 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:30:07.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:07 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:30:07.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:07 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:30:07.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:07 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:30:07.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:07 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T09:30:07.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:07 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T09:30:07.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:07 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:30:07.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:07 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd='[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]': finished 2023-05-08T09:30:07.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:07 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:30:07.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:07 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:30:07.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:07 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:30:07.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:07 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:30:07.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:07 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T09:30:07.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:07 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T09:30:07.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:07 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:30:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:07 smithi096 ceph-mon[124666]: pgmap v11121: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 228 KiB/s wr, 26 op/s 2023-05-08T09:30:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:07 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:30:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:07 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:30:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:07 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:30:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:07 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:30:07.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:07 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T09:30:07.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:07 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T09:30:07.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:07 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:30:07.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:07 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:30:07.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:07 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:30:07.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:07 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:30:07.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:07 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T09:30:07.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:07 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T09:30:07.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:07 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:30:07.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:07 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd='[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]': finished 2023-05-08T09:30:07.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:07 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:30:07.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:07 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:30:07.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:07 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:30:07.759 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:07 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:30:07.759 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:07 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T09:30:07.759 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:07 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T09:30:07.759 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:07 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:30:09.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:09 smithi186 ceph-mon[126480]: pgmap v11122: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 228 KiB/s wr, 26 op/s 2023-05-08T09:30:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20748.038718 secs 2023-05-08T09:30:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:09 smithi133 ceph-mon[125939]: pgmap v11122: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 228 KiB/s wr, 26 op/s 2023-05-08T09:30:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20748.038718 secs 2023-05-08T09:30:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:09 smithi096 ceph-mon[124666]: pgmap v11122: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 228 KiB/s wr, 26 op/s 2023-05-08T09:30:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20748.038718 secs 2023-05-08T09:30:10.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20748.594631 secs 2023-05-08T09:30:10.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20748.594631 secs 2023-05-08T09:30:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20748.594631 secs 2023-05-08T09:30:11.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20749.881140 secs 2023-05-08T09:30:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:11 smithi186 ceph-mon[126480]: pgmap v11123: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 138 KiB/s wr, 25 op/s 2023-05-08T09:30:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20749.881140 secs 2023-05-08T09:30:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:11 smithi133 ceph-mon[125939]: pgmap v11123: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 138 KiB/s wr, 25 op/s 2023-05-08T09:30:11.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20749.881140 secs 2023-05-08T09:30:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:11 smithi096 ceph-mon[124666]: pgmap v11123: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 138 KiB/s wr, 25 op/s 2023-05-08T09:30:13.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:13 smithi186 ceph-mon[126480]: pgmap v11124: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 138 KiB/s wr, 24 op/s 2023-05-08T09:30:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:13 smithi186 ceph-mon[126480]: osdmap e773: 12 total, 12 up, 12 in 2023-05-08T09:30:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:13 smithi133 ceph-mon[125939]: pgmap v11124: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 138 KiB/s wr, 24 op/s 2023-05-08T09:30:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:13 smithi133 ceph-mon[125939]: osdmap e773: 12 total, 12 up, 12 in 2023-05-08T09:30:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:13 smithi096 ceph-mon[124666]: pgmap v11124: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 138 KiB/s wr, 24 op/s 2023-05-08T09:30:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:13 smithi096 ceph-mon[124666]: osdmap e773: 12 total, 12 up, 12 in 2023-05-08T09:30:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20753.038781 secs 2023-05-08T09:30:14.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20753.038781 secs 2023-05-08T09:30:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20753.038781 secs 2023-05-08T09:30:15.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20753.594758 secs 2023-05-08T09:30:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:15 smithi186 ceph-mon[126480]: pgmap v11126: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 99 KiB/s wr, 8 op/s 2023-05-08T09:30:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20753.594758 secs 2023-05-08T09:30:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:15 smithi133 ceph-mon[125939]: pgmap v11126: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 99 KiB/s wr, 8 op/s 2023-05-08T09:30:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20753.594758 secs 2023-05-08T09:30:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:15 smithi096 ceph-mon[124666]: pgmap v11126: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 99 KiB/s wr, 8 op/s 2023-05-08T09:30:16.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20754.881253 secs 2023-05-08T09:30:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20754.881253 secs 2023-05-08T09:30:16.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20754.881253 secs 2023-05-08T09:30:17.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:17 smithi186 ceph-mon[126480]: pgmap v11127: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 89 KiB/s wr, 7 op/s 2023-05-08T09:30:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:17 smithi133 ceph-mon[125939]: pgmap v11127: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 89 KiB/s wr, 7 op/s 2023-05-08T09:30:17.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:17 smithi096 ceph-mon[124666]: pgmap v11127: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 89 KiB/s wr, 7 op/s 2023-05-08T09:30:19.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:19 smithi186 ceph-mon[126480]: pgmap v11128: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 89 KiB/s wr, 7 op/s 2023-05-08T09:30:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20758.038946 secs 2023-05-08T09:30:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:19 smithi133 ceph-mon[125939]: pgmap v11128: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 89 KiB/s wr, 7 op/s 2023-05-08T09:30:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20758.038946 secs 2023-05-08T09:30:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:19 smithi096 ceph-mon[124666]: pgmap v11128: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 89 KiB/s wr, 7 op/s 2023-05-08T09:30:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20758.038946 secs 2023-05-08T09:30:20.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20758.594826 secs 2023-05-08T09:30:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20758.594826 secs 2023-05-08T09:30:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20758.594826 secs 2023-05-08T09:30:21.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20759.881405 secs 2023-05-08T09:30:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:21 smithi186 ceph-mon[126480]: pgmap v11129: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 88 KiB/s wr, 6 op/s 2023-05-08T09:30:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20759.881405 secs 2023-05-08T09:30:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:21 smithi133 ceph-mon[125939]: pgmap v11129: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 88 KiB/s wr, 6 op/s 2023-05-08T09:30:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20759.881405 secs 2023-05-08T09:30:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:21 smithi096 ceph-mon[124666]: pgmap v11129: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 88 KiB/s wr, 6 op/s 2023-05-08T09:30:23.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:23 smithi186 ceph-mon[126480]: pgmap v11130: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 88 KiB/s wr, 6 op/s 2023-05-08T09:30:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:23 smithi133 ceph-mon[125939]: pgmap v11130: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 88 KiB/s wr, 6 op/s 2023-05-08T09:30:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:23 smithi096 ceph-mon[124666]: pgmap v11130: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 88 KiB/s wr, 6 op/s 2023-05-08T09:30:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20763.039019 secs 2023-05-08T09:30:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20763.039019 secs 2023-05-08T09:30:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20763.039019 secs 2023-05-08T09:30:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20763.594948 secs 2023-05-08T09:30:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:25 smithi133 ceph-mon[125939]: pgmap v11131: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 81 KiB/s wr, 8 op/s 2023-05-08T09:30:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20763.594948 secs 2023-05-08T09:30:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:25 smithi096 ceph-mon[124666]: pgmap v11131: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 81 KiB/s wr, 8 op/s 2023-05-08T09:30:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20763.594948 secs 2023-05-08T09:30:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:25 smithi186 ceph-mon[126480]: pgmap v11131: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 81 KiB/s wr, 8 op/s 2023-05-08T09:30:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20764.881511 secs 2023-05-08T09:30:26.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20764.881511 secs 2023-05-08T09:30:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20764.881511 secs 2023-05-08T09:30:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:27 smithi133 ceph-mon[125939]: pgmap v11132: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T09:30:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:27 smithi096 ceph-mon[124666]: pgmap v11132: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T09:30:27.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:27 smithi186 ceph-mon[126480]: pgmap v11132: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T09:30:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:29 smithi133 ceph-mon[125939]: pgmap v11133: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T09:30:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20768.039136 secs 2023-05-08T09:30:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:29 smithi096 ceph-mon[124666]: pgmap v11133: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T09:30:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20768.039136 secs 2023-05-08T09:30:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:29 smithi186 ceph-mon[126480]: pgmap v11133: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T09:30:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20768.039136 secs 2023-05-08T09:30:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20768.595070 secs 2023-05-08T09:30:30.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20768.595070 secs 2023-05-08T09:30:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20768.595070 secs 2023-05-08T09:30:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20769.881633 secs 2023-05-08T09:30:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:31 smithi133 ceph-mon[125939]: pgmap v11134: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 71 KiB/s wr, 8 op/s 2023-05-08T09:30:31.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20769.881633 secs 2023-05-08T09:30:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:31 smithi096 ceph-mon[124666]: pgmap v11134: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 71 KiB/s wr, 8 op/s 2023-05-08T09:30:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20769.881633 secs 2023-05-08T09:30:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:31 smithi186 ceph-mon[126480]: pgmap v11134: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 71 KiB/s wr, 8 op/s 2023-05-08T09:30:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:33 smithi133 ceph-mon[125939]: pgmap v11135: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 71 KiB/s wr, 6 op/s 2023-05-08T09:30:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:33 smithi096 ceph-mon[124666]: pgmap v11135: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 71 KiB/s wr, 6 op/s 2023-05-08T09:30:33.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:33 smithi186 ceph-mon[126480]: pgmap v11135: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 71 KiB/s wr, 6 op/s 2023-05-08T09:30:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20773.039280 secs 2023-05-08T09:30:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20773.039280 secs 2023-05-08T09:30:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20773.039280 secs 2023-05-08T09:30:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20773.595146 secs 2023-05-08T09:30:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:35 smithi133 ceph-mon[125939]: pgmap v11136: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 71 KiB/s wr, 9 op/s 2023-05-08T09:30:35.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20773.595146 secs 2023-05-08T09:30:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:35 smithi096 ceph-mon[124666]: pgmap v11136: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 71 KiB/s wr, 9 op/s 2023-05-08T09:30:35.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20773.595146 secs 2023-05-08T09:30:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:35 smithi186 ceph-mon[126480]: pgmap v11136: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 71 KiB/s wr, 9 op/s 2023-05-08T09:30:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20774.881763 secs 2023-05-08T09:30:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20774.881763 secs 2023-05-08T09:30:36.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20774.881763 secs 2023-05-08T09:30:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:37 smithi133 ceph-mon[125939]: pgmap v11137: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 71 KiB/s wr, 6 op/s 2023-05-08T09:30:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:37 smithi096 ceph-mon[124666]: pgmap v11137: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 71 KiB/s wr, 6 op/s 2023-05-08T09:30:37.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:37 smithi186 ceph-mon[126480]: pgmap v11137: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 71 KiB/s wr, 6 op/s 2023-05-08T09:30:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:39 smithi133 ceph-mon[125939]: pgmap v11138: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 71 KiB/s wr, 6 op/s 2023-05-08T09:30:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20778.039395 secs 2023-05-08T09:30:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:39 smithi096 ceph-mon[124666]: pgmap v11138: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 71 KiB/s wr, 6 op/s 2023-05-08T09:30:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20778.039395 secs 2023-05-08T09:30:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:39 smithi186 ceph-mon[126480]: pgmap v11138: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 71 KiB/s wr, 6 op/s 2023-05-08T09:30:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20778.039395 secs 2023-05-08T09:30:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20778.595267 secs 2023-05-08T09:30:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20778.595267 secs 2023-05-08T09:30:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20778.595267 secs 2023-05-08T09:30:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20779.881903 secs 2023-05-08T09:30:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:41 smithi133 ceph-mon[125939]: pgmap v11139: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 71 KiB/s wr, 9 op/s 2023-05-08T09:30:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20779.881903 secs 2023-05-08T09:30:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:41 smithi096 ceph-mon[124666]: pgmap v11139: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 71 KiB/s wr, 9 op/s 2023-05-08T09:30:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20779.881903 secs 2023-05-08T09:30:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:41 smithi186 ceph-mon[126480]: pgmap v11139: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 71 KiB/s wr, 9 op/s 2023-05-08T09:30:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:43 smithi133 ceph-mon[125939]: pgmap v11140: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T09:30:43.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:43 smithi096 ceph-mon[124666]: pgmap v11140: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T09:30:43.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:43 smithi186 ceph-mon[126480]: pgmap v11140: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T09:30:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20783.039520 secs 2023-05-08T09:30:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20783.039520 secs 2023-05-08T09:30:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20783.039520 secs 2023-05-08T09:30:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20783.595389 secs 2023-05-08T09:30:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:45 smithi133 ceph-mon[125939]: pgmap v11141: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 138 KiB/s wr, 9 op/s 2023-05-08T09:30:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20783.595389 secs 2023-05-08T09:30:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:45 smithi096 ceph-mon[124666]: pgmap v11141: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 138 KiB/s wr, 9 op/s 2023-05-08T09:30:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20783.595389 secs 2023-05-08T09:30:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:45 smithi186 ceph-mon[126480]: pgmap v11141: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 138 KiB/s wr, 9 op/s 2023-05-08T09:30:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20784.882047 secs 2023-05-08T09:30:46.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20784.882047 secs 2023-05-08T09:30:46.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20784.882047 secs 2023-05-08T09:30:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:47 smithi133 ceph-mon[125939]: pgmap v11142: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 138 KiB/s wr, 6 op/s 2023-05-08T09:30:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:47 smithi096 ceph-mon[124666]: pgmap v11142: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 138 KiB/s wr, 6 op/s 2023-05-08T09:30:47.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:47 smithi186 ceph-mon[126480]: pgmap v11142: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 138 KiB/s wr, 6 op/s 2023-05-08T09:30:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:49 smithi133 ceph-mon[125939]: pgmap v11143: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 138 KiB/s wr, 6 op/s 2023-05-08T09:30:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20788.039583 secs 2023-05-08T09:30:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:49 smithi096 ceph-mon[124666]: pgmap v11143: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 138 KiB/s wr, 6 op/s 2023-05-08T09:30:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20788.039583 secs 2023-05-08T09:30:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:49 smithi186 ceph-mon[126480]: pgmap v11143: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 138 KiB/s wr, 6 op/s 2023-05-08T09:30:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20788.039583 secs 2023-05-08T09:30:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20789.882148 secs 2023-05-08T09:30:51.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:51 smithi133 ceph-mon[125939]: pgmap v11144: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 356 KiB/s wr, 10 op/s 2023-05-08T09:30:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20789.882148 secs 2023-05-08T09:30:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:51 smithi096 ceph-mon[124666]: pgmap v11144: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 356 KiB/s wr, 10 op/s 2023-05-08T09:30:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20789.882148 secs 2023-05-08T09:30:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:51 smithi186 ceph-mon[126480]: pgmap v11144: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 356 KiB/s wr, 10 op/s 2023-05-08T09:30:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:30:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:30:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:30:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:53 smithi133 ceph-mon[125939]: pgmap v11145: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 356 KiB/s wr, 7 op/s 2023-05-08T09:30:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:53 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:30:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:30:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:30:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:53 smithi096 ceph-mon[124666]: pgmap v11145: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 356 KiB/s wr, 7 op/s 2023-05-08T09:30:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:53 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:30:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:30:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:30:53.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:53 smithi186 ceph-mon[126480]: pgmap v11145: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 356 KiB/s wr, 7 op/s 2023-05-08T09:30:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:53 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:30:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:30:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:30:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20793.039700 secs 2023-05-08T09:30:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20793.039700 secs 2023-05-08T09:30:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20793.039700 secs 2023-05-08T09:30:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20793.595778 secs 2023-05-08T09:30:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:55 smithi133 ceph-mon[125939]: pgmap v11146: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 640 KiB/s rd, 624 KiB/s wr, 13 op/s 2023-05-08T09:30:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:55 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:30:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20793.595778 secs 2023-05-08T09:30:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:55 smithi096 ceph-mon[124666]: pgmap v11146: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 640 KiB/s rd, 624 KiB/s wr, 13 op/s 2023-05-08T09:30:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:55 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:30:55.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20793.595778 secs 2023-05-08T09:30:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:55 smithi186 ceph-mon[126480]: pgmap v11146: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 640 KiB/s rd, 624 KiB/s wr, 13 op/s 2023-05-08T09:30:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:55 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:30:56.744 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:30:56.745 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:30:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:30:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:30:56.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:30:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:30:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:57 smithi133 ceph-mon[125939]: pgmap v11147: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 487 KiB/s wr, 10 op/s 2023-05-08T09:30:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:57 smithi096 ceph-mon[124666]: pgmap v11147: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 487 KiB/s wr, 10 op/s 2023-05-08T09:30:57.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:57 smithi186 ceph-mon[126480]: pgmap v11147: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 487 KiB/s wr, 10 op/s 2023-05-08T09:30:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:58 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:30:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:58 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:30:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:58 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:30:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:59 smithi133 ceph-mon[125939]: pgmap v11148: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 487 KiB/s wr, 10 op/s 2023-05-08T09:30:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:30:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20798.039792 secs 2023-05-08T09:30:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:59 smithi096 ceph-mon[124666]: pgmap v11148: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 487 KiB/s wr, 10 op/s 2023-05-08T09:30:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:30:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20798.039792 secs 2023-05-08T09:30:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:59 smithi186 ceph-mon[126480]: pgmap v11148: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 487 KiB/s wr, 10 op/s 2023-05-08T09:30:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:30:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20798.039792 secs 2023-05-08T09:31:01.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:01 smithi133 ceph-mon[125939]: pgmap v11149: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 595 KiB/s rd, 591 KiB/s wr, 15 op/s 2023-05-08T09:31:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:01 smithi096 ceph-mon[124666]: pgmap v11149: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 595 KiB/s rd, 591 KiB/s wr, 15 op/s 2023-05-08T09:31:01.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:01 smithi186 ceph-mon[126480]: pgmap v11149: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 595 KiB/s rd, 591 KiB/s wr, 15 op/s 2023-05-08T09:31:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:03 smithi096 ceph-mon[124666]: pgmap v11150: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 373 KiB/s wr, 11 op/s 2023-05-08T09:31:03.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:03 smithi186 ceph-mon[126480]: pgmap v11150: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 373 KiB/s wr, 11 op/s 2023-05-08T09:31:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:03 smithi133 ceph-mon[125939]: pgmap v11150: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 373 KiB/s wr, 11 op/s 2023-05-08T09:31:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20803.039926 secs 2023-05-08T09:31:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20803.039926 secs 2023-05-08T09:31:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20803.039926 secs 2023-05-08T09:31:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20803.595948 secs 2023-05-08T09:31:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:05 smithi096 ceph-mon[124666]: pgmap v11151: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 520 KiB/s rd, 543 KiB/s wr, 30 op/s 2023-05-08T09:31:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20803.595948 secs 2023-05-08T09:31:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:05 smithi186 ceph-mon[126480]: pgmap v11151: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 520 KiB/s rd, 543 KiB/s wr, 30 op/s 2023-05-08T09:31:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20803.595948 secs 2023-05-08T09:31:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:05 smithi133 ceph-mon[125939]: pgmap v11151: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 520 KiB/s rd, 543 KiB/s wr, 30 op/s 2023-05-08T09:31:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20804.882417 secs 2023-05-08T09:31:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:06 smithi186 ceph-mon[126480]: osdmap e774: 12 total, 12 up, 12 in 2023-05-08T09:31:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20804.882417 secs 2023-05-08T09:31:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:06 smithi133 ceph-mon[125939]: osdmap e774: 12 total, 12 up, 12 in 2023-05-08T09:31:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20804.882417 secs 2023-05-08T09:31:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:06 smithi096 ceph-mon[124666]: osdmap e774: 12 total, 12 up, 12 in 2023-05-08T09:31:07.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:07 smithi186 ceph-mon[126480]: pgmap v11153: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 330 KiB/s wr, 29 op/s 2023-05-08T09:31:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:07 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:31:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:07 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:31:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:07 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:31:07.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:07 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:31:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:07 smithi133 ceph-mon[125939]: pgmap v11153: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 330 KiB/s wr, 29 op/s 2023-05-08T09:31:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:07 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:31:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:07 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:31:07.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:07 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:31:07.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:07 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:31:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:07 smithi096 ceph-mon[124666]: pgmap v11153: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 330 KiB/s wr, 29 op/s 2023-05-08T09:31:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:07 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:31:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:07 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:31:08.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:07 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:31:08.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:07 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:31:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:08 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:31:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:08 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T09:31:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:08 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T09:31:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:08 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:31:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:08 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:31:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:31:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:31:08.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:31:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:08 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:31:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:08 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T09:31:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:08 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T09:31:08.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:08 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:31:08.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:08 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:31:08.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:31:08.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:31:08.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:31:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:08 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:31:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:08 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T09:31:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:08 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T09:31:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:08 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:31:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:08 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:31:09.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:31:09.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:31:09.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:31:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:09 smithi186 ceph-mon[126480]: pgmap v11154: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 330 KiB/s wr, 29 op/s 2023-05-08T09:31:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20808.040053 secs 2023-05-08T09:31:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:09 smithi133 ceph-mon[125939]: pgmap v11154: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 330 KiB/s wr, 29 op/s 2023-05-08T09:31:09.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20808.040053 secs 2023-05-08T09:31:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:09 smithi096 ceph-mon[124666]: pgmap v11154: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 330 KiB/s wr, 29 op/s 2023-05-08T09:31:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20808.040053 secs 2023-05-08T09:31:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20808.596018 secs 2023-05-08T09:31:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20808.596018 secs 2023-05-08T09:31:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20808.596018 secs 2023-05-08T09:31:11.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20809.882541 secs 2023-05-08T09:31:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:11 smithi186 ceph-mon[126480]: pgmap v11155: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 295 KiB/s wr, 28 op/s 2023-05-08T09:31:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20809.882541 secs 2023-05-08T09:31:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:11 smithi133 ceph-mon[125939]: pgmap v11155: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 295 KiB/s wr, 28 op/s 2023-05-08T09:31:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20809.882541 secs 2023-05-08T09:31:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:11 smithi096 ceph-mon[124666]: pgmap v11155: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 295 KiB/s wr, 28 op/s 2023-05-08T09:31:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:13 smithi186 ceph-mon[126480]: pgmap v11156: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 295 KiB/s wr, 28 op/s 2023-05-08T09:31:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:13 smithi186 ceph-mon[126480]: osdmap e775: 12 total, 12 up, 12 in 2023-05-08T09:31:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:13 smithi133 ceph-mon[125939]: pgmap v11156: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 295 KiB/s wr, 28 op/s 2023-05-08T09:31:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:13 smithi133 ceph-mon[125939]: osdmap e775: 12 total, 12 up, 12 in 2023-05-08T09:31:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:13 smithi096 ceph-mon[124666]: pgmap v11156: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 295 KiB/s wr, 28 op/s 2023-05-08T09:31:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:13 smithi096 ceph-mon[124666]: osdmap e775: 12 total, 12 up, 12 in 2023-05-08T09:31:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20813.040175 secs 2023-05-08T09:31:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20813.040175 secs 2023-05-08T09:31:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20813.040175 secs 2023-05-08T09:31:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20813.596114 secs 2023-05-08T09:31:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:15 smithi186 ceph-mon[126480]: pgmap v11158: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 278 KiB/s wr, 9 op/s 2023-05-08T09:31:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20813.596114 secs 2023-05-08T09:31:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:15 smithi133 ceph-mon[125939]: pgmap v11158: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 278 KiB/s wr, 9 op/s 2023-05-08T09:31:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20813.596114 secs 2023-05-08T09:31:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:15 smithi096 ceph-mon[124666]: pgmap v11158: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 278 KiB/s wr, 9 op/s 2023-05-08T09:31:16.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20814.882701 secs 2023-05-08T09:31:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20814.882701 secs 2023-05-08T09:31:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20814.882701 secs 2023-05-08T09:31:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:17 smithi186 ceph-mon[126480]: pgmap v11159: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 244 KiB/s wr, 8 op/s 2023-05-08T09:31:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:17 smithi133 ceph-mon[125939]: pgmap v11159: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 244 KiB/s wr, 8 op/s 2023-05-08T09:31:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:17 smithi096 ceph-mon[124666]: pgmap v11159: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 244 KiB/s wr, 8 op/s 2023-05-08T09:31:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:19 smithi186 ceph-mon[126480]: pgmap v11160: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 244 KiB/s wr, 8 op/s 2023-05-08T09:31:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20818.040366 secs 2023-05-08T09:31:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:19 smithi133 ceph-mon[125939]: pgmap v11160: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 244 KiB/s wr, 8 op/s 2023-05-08T09:31:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20818.040366 secs 2023-05-08T09:31:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:19 smithi096 ceph-mon[124666]: pgmap v11160: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 244 KiB/s wr, 8 op/s 2023-05-08T09:31:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20818.040366 secs 2023-05-08T09:31:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20818.596251 secs 2023-05-08T09:31:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20818.596251 secs 2023-05-08T09:31:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20818.596251 secs 2023-05-08T09:31:21.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20819.882847 secs 2023-05-08T09:31:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:21 smithi186 ceph-mon[126480]: pgmap v11161: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 153 KiB/s wr, 6 op/s 2023-05-08T09:31:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20819.882847 secs 2023-05-08T09:31:21.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:21 smithi133 ceph-mon[125939]: pgmap v11161: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 153 KiB/s wr, 6 op/s 2023-05-08T09:31:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20819.882847 secs 2023-05-08T09:31:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:21 smithi096 ceph-mon[124666]: pgmap v11161: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 153 KiB/s wr, 6 op/s 2023-05-08T09:31:23.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:23 smithi186 ceph-mon[126480]: pgmap v11162: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 153 KiB/s wr, 6 op/s 2023-05-08T09:31:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:23 smithi133 ceph-mon[125939]: pgmap v11162: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 153 KiB/s wr, 6 op/s 2023-05-08T09:31:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:23 smithi096 ceph-mon[124666]: pgmap v11162: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 153 KiB/s wr, 6 op/s 2023-05-08T09:31:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20823.040460 secs 2023-05-08T09:31:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20823.040460 secs 2023-05-08T09:31:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20823.040460 secs 2023-05-08T09:31:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20823.596370 secs 2023-05-08T09:31:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:25 smithi186 ceph-mon[126480]: pgmap v11163: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 139 KiB/s wr, 9 op/s 2023-05-08T09:31:25.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20823.596370 secs 2023-05-08T09:31:25.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:25 smithi133 ceph-mon[125939]: pgmap v11163: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 139 KiB/s wr, 9 op/s 2023-05-08T09:31:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20823.596370 secs 2023-05-08T09:31:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:25 smithi096 ceph-mon[124666]: pgmap v11163: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 139 KiB/s wr, 9 op/s 2023-05-08T09:31:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20824.882981 secs 2023-05-08T09:31:26.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20824.882981 secs 2023-05-08T09:31:27.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20824.882981 secs 2023-05-08T09:31:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:27 smithi186 ceph-mon[126480]: pgmap v11164: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:31:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:27 smithi133 ceph-mon[125939]: pgmap v11164: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:31:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:27 smithi096 ceph-mon[124666]: pgmap v11164: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:31:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:29 smithi186 ceph-mon[126480]: pgmap v11165: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:31:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20828.040535 secs 2023-05-08T09:31:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:29 smithi133 ceph-mon[125939]: pgmap v11165: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:31:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20828.040535 secs 2023-05-08T09:31:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:29 smithi096 ceph-mon[124666]: pgmap v11165: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:31:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20828.040535 secs 2023-05-08T09:31:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20828.596504 secs 2023-05-08T09:31:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20828.596504 secs 2023-05-08T09:31:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20828.596504 secs 2023-05-08T09:31:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20829.883083 secs 2023-05-08T09:31:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:31 smithi186 ceph-mon[126480]: pgmap v11166: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 7 op/s 2023-05-08T09:31:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20829.883083 secs 2023-05-08T09:31:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:31 smithi133 ceph-mon[125939]: pgmap v11166: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 7 op/s 2023-05-08T09:31:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20829.883083 secs 2023-05-08T09:31:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:31 smithi096 ceph-mon[124666]: pgmap v11166: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 7 op/s 2023-05-08T09:31:33.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:33 smithi186 ceph-mon[126480]: pgmap v11167: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T09:31:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:33 smithi133 ceph-mon[125939]: pgmap v11167: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T09:31:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:33 smithi096 ceph-mon[124666]: pgmap v11167: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T09:31:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20833.040692 secs 2023-05-08T09:31:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20833.040692 secs 2023-05-08T09:31:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20833.040692 secs 2023-05-08T09:31:35.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20833.596561 secs 2023-05-08T09:31:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:35 smithi186 ceph-mon[126480]: pgmap v11168: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 71 KiB/s wr, 8 op/s 2023-05-08T09:31:35.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20833.596561 secs 2023-05-08T09:31:35.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:35 smithi133 ceph-mon[125939]: pgmap v11168: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 71 KiB/s wr, 8 op/s 2023-05-08T09:31:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20833.596561 secs 2023-05-08T09:31:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:35 smithi096 ceph-mon[124666]: pgmap v11168: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 71 KiB/s wr, 8 op/s 2023-05-08T09:31:36.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20834.883205 secs 2023-05-08T09:31:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20834.883205 secs 2023-05-08T09:31:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20834.883205 secs 2023-05-08T09:31:37.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:37 smithi186 ceph-mon[126480]: pgmap v11169: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 71 KiB/s wr, 6 op/s 2023-05-08T09:31:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:37 smithi133 ceph-mon[125939]: pgmap v11169: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 71 KiB/s wr, 6 op/s 2023-05-08T09:31:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:37 smithi096 ceph-mon[124666]: pgmap v11169: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 71 KiB/s wr, 6 op/s 2023-05-08T09:31:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:39 smithi186 ceph-mon[126480]: pgmap v11170: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 71 KiB/s wr, 6 op/s 2023-05-08T09:31:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20838.040832 secs 2023-05-08T09:31:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:39 smithi133 ceph-mon[125939]: pgmap v11170: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 71 KiB/s wr, 6 op/s 2023-05-08T09:31:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20838.040832 secs 2023-05-08T09:31:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:39 smithi096 ceph-mon[124666]: pgmap v11170: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 71 KiB/s wr, 6 op/s 2023-05-08T09:31:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20838.040832 secs 2023-05-08T09:31:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20838.596619 secs 2023-05-08T09:31:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20838.596619 secs 2023-05-08T09:31:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20838.596619 secs 2023-05-08T09:31:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20839.883331 secs 2023-05-08T09:31:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:41 smithi186 ceph-mon[126480]: pgmap v11171: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 71 KiB/s wr, 9 op/s 2023-05-08T09:31:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20839.883331 secs 2023-05-08T09:31:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:41 smithi133 ceph-mon[125939]: pgmap v11171: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 71 KiB/s wr, 9 op/s 2023-05-08T09:31:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20839.883331 secs 2023-05-08T09:31:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:41 smithi096 ceph-mon[124666]: pgmap v11171: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 71 KiB/s wr, 9 op/s 2023-05-08T09:31:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:43 smithi186 ceph-mon[126480]: pgmap v11172: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 71 KiB/s wr, 6 op/s 2023-05-08T09:31:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:43 smithi133 ceph-mon[125939]: pgmap v11172: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 71 KiB/s wr, 6 op/s 2023-05-08T09:31:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:43 smithi096 ceph-mon[124666]: pgmap v11172: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 71 KiB/s wr, 6 op/s 2023-05-08T09:31:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20843.040961 secs 2023-05-08T09:31:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20843.040961 secs 2023-05-08T09:31:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20843.040961 secs 2023-05-08T09:31:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20843.596706 secs 2023-05-08T09:31:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:45 smithi133 ceph-mon[125939]: pgmap v11173: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 170 KiB/s wr, 9 op/s 2023-05-08T09:31:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20843.596706 secs 2023-05-08T09:31:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:45 smithi096 ceph-mon[124666]: pgmap v11173: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 170 KiB/s wr, 9 op/s 2023-05-08T09:31:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20843.596706 secs 2023-05-08T09:31:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:45 smithi186 ceph-mon[126480]: pgmap v11173: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 170 KiB/s wr, 9 op/s 2023-05-08T09:31:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20844.883431 secs 2023-05-08T09:31:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20844.883431 secs 2023-05-08T09:31:47.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20844.883431 secs 2023-05-08T09:31:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:47 smithi133 ceph-mon[125939]: pgmap v11174: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 345 KiB/s wr, 6 op/s 2023-05-08T09:31:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:47 smithi096 ceph-mon[124666]: pgmap v11174: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 345 KiB/s wr, 6 op/s 2023-05-08T09:31:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:47 smithi186 ceph-mon[126480]: pgmap v11174: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 345 KiB/s wr, 6 op/s 2023-05-08T09:31:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:49 smithi133 ceph-mon[125939]: pgmap v11175: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 345 KiB/s wr, 6 op/s 2023-05-08T09:31:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20848.041087 secs 2023-05-08T09:31:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:49 smithi096 ceph-mon[124666]: pgmap v11175: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 345 KiB/s wr, 6 op/s 2023-05-08T09:31:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20848.041087 secs 2023-05-08T09:31:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:49 smithi186 ceph-mon[126480]: pgmap v11175: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 345 KiB/s wr, 6 op/s 2023-05-08T09:31:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20848.041087 secs 2023-05-08T09:31:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20849.883560 secs 2023-05-08T09:31:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:51 smithi133 ceph-mon[125939]: pgmap v11176: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 358 KiB/s wr, 10 op/s 2023-05-08T09:31:51.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:31:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20849.883560 secs 2023-05-08T09:31:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:51 smithi096 ceph-mon[124666]: pgmap v11176: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 358 KiB/s wr, 10 op/s 2023-05-08T09:31:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:31:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20849.883560 secs 2023-05-08T09:31:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:51 smithi186 ceph-mon[126480]: pgmap v11176: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 358 KiB/s wr, 10 op/s 2023-05-08T09:31:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:31:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:52 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:31:52.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:31:52.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:31:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:52 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:31:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:31:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:31:53.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:52 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:31:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:31:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:31:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:53 smithi133 ceph-mon[125939]: pgmap v11177: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 509 KiB/s rd, 374 KiB/s wr, 8 op/s 2023-05-08T09:31:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:53 smithi096 ceph-mon[124666]: pgmap v11177: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 509 KiB/s rd, 374 KiB/s wr, 8 op/s 2023-05-08T09:31:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:53 smithi186 ceph-mon[126480]: pgmap v11177: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 509 KiB/s rd, 374 KiB/s wr, 8 op/s 2023-05-08T09:31:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20853.041218 secs 2023-05-08T09:31:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20853.596959 secs 2023-05-08T09:31:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20853.041218 secs 2023-05-08T09:31:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20853.596959 secs 2023-05-08T09:31:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20853.041218 secs 2023-05-08T09:31:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20853.596959 secs 2023-05-08T09:31:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:55 smithi133 ceph-mon[125939]: pgmap v11178: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 692 KiB/s rd, 546 KiB/s wr, 13 op/s 2023-05-08T09:31:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:55 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:31:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:55 smithi096 ceph-mon[124666]: pgmap v11178: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 692 KiB/s rd, 546 KiB/s wr, 13 op/s 2023-05-08T09:31:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:55 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:31:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:55 smithi186 ceph-mon[126480]: pgmap v11178: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 692 KiB/s rd, 546 KiB/s wr, 13 op/s 2023-05-08T09:31:56.199 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:55 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:31:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:31:56.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:31:56.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:31:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:31:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:31:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:31:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:31:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:31:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:31:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:57 smithi133 ceph-mon[125939]: pgmap v11179: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 599 KiB/s rd, 527 KiB/s wr, 10 op/s 2023-05-08T09:31:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:57 smithi096 ceph-mon[124666]: pgmap v11179: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 599 KiB/s rd, 527 KiB/s wr, 10 op/s 2023-05-08T09:31:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:57 smithi186 ceph-mon[126480]: pgmap v11179: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 599 KiB/s rd, 527 KiB/s wr, 10 op/s 2023-05-08T09:31:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:59 smithi133 ceph-mon[125939]: pgmap v11180: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 599 KiB/s rd, 282 KiB/s wr, 10 op/s 2023-05-08T09:31:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20858.041352 secs 2023-05-08T09:31:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:31:59 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:32:00.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:59 smithi096 ceph-mon[124666]: pgmap v11180: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 599 KiB/s rd, 282 KiB/s wr, 10 op/s 2023-05-08T09:32:00.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20858.041352 secs 2023-05-08T09:32:00.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:31:59 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:32:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:59 smithi186 ceph-mon[126480]: pgmap v11180: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 599 KiB/s rd, 282 KiB/s wr, 10 op/s 2023-05-08T09:32:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20858.041352 secs 2023-05-08T09:32:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:31:59 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:32:00.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:00 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:32:00.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:32:00.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:32:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:00 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:32:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:32:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:32:01.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:00 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:32:01.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:32:01.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:32:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:01 smithi133 ceph-mon[125939]: pgmap v11181: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 693 KiB/s rd, 387 KiB/s wr, 15 op/s 2023-05-08T09:32:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:01 smithi096 ceph-mon[124666]: pgmap v11181: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 693 KiB/s rd, 387 KiB/s wr, 15 op/s 2023-05-08T09:32:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:01 smithi186 ceph-mon[126480]: pgmap v11181: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 693 KiB/s rd, 387 KiB/s wr, 15 op/s 2023-05-08T09:32:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:03 smithi133 ceph-mon[125939]: pgmap v11182: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 620 KiB/s rd, 374 KiB/s wr, 12 op/s 2023-05-08T09:32:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:03 smithi096 ceph-mon[124666]: pgmap v11182: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 620 KiB/s rd, 374 KiB/s wr, 12 op/s 2023-05-08T09:32:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:03 smithi186 ceph-mon[126480]: pgmap v11182: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 620 KiB/s rd, 374 KiB/s wr, 12 op/s 2023-05-08T09:32:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20863.041446 secs 2023-05-08T09:32:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20863.597165 secs 2023-05-08T09:32:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20863.041446 secs 2023-05-08T09:32:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20863.597165 secs 2023-05-08T09:32:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20863.041446 secs 2023-05-08T09:32:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20863.597165 secs 2023-05-08T09:32:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:05 smithi133 ceph-mon[125939]: pgmap v11183: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 528 KiB/s wr, 30 op/s 2023-05-08T09:32:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:05 smithi096 ceph-mon[124666]: pgmap v11183: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 528 KiB/s wr, 30 op/s 2023-05-08T09:32:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:05 smithi186 ceph-mon[126480]: pgmap v11183: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 528 KiB/s wr, 30 op/s 2023-05-08T09:32:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20864.883956 secs 2023-05-08T09:32:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:06 smithi133 ceph-mon[125939]: osdmap e776: 12 total, 12 up, 12 in 2023-05-08T09:32:07.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20864.883956 secs 2023-05-08T09:32:07.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:06 smithi096 ceph-mon[124666]: osdmap e776: 12 total, 12 up, 12 in 2023-05-08T09:32:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20864.883956 secs 2023-05-08T09:32:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:06 smithi186 ceph-mon[126480]: osdmap e776: 12 total, 12 up, 12 in 2023-05-08T09:32:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:07 smithi133 ceph-mon[125939]: pgmap v11185: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 290 KiB/s rd, 331 KiB/s wr, 29 op/s 2023-05-08T09:32:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:07 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:32:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:07 smithi096 ceph-mon[124666]: pgmap v11185: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 290 KiB/s rd, 331 KiB/s wr, 29 op/s 2023-05-08T09:32:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:07 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:32:08.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:07 smithi186 ceph-mon[126480]: pgmap v11185: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 290 KiB/s rd, 331 KiB/s wr, 29 op/s 2023-05-08T09:32:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:07 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:32:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:08 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:32:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:32:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:32:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:32:08.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:08 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:32:08.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:08 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:32:08.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:08 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:32:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:08 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:32:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:32:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:32:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:32:09.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:08 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:32:09.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:08 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:32:09.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:08 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:32:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:08 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:32:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:32:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:32:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:32:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:08 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:32:09.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:08 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:32:09.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:08 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:32:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:09 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:32:09.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:09 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T09:32:09.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:09 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T09:32:09.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:09 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:32:09.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:09 smithi133 ceph-mon[125939]: pgmap v11186: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 290 KiB/s rd, 331 KiB/s wr, 29 op/s 2023-05-08T09:32:09.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20868.041515 secs 2023-05-08T09:32:09.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20868.597278 secs 2023-05-08T09:32:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:09 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:32:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:09 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T09:32:10.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:09 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T09:32:10.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:09 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:32:10.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:09 smithi096 ceph-mon[124666]: pgmap v11186: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 290 KiB/s rd, 331 KiB/s wr, 29 op/s 2023-05-08T09:32:10.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20868.041515 secs 2023-05-08T09:32:10.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20868.597278 secs 2023-05-08T09:32:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:09 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:32:10.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:09 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T09:32:10.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:09 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T09:32:10.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:09 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:32:10.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:09 smithi186 ceph-mon[126480]: pgmap v11186: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 290 KiB/s rd, 331 KiB/s wr, 29 op/s 2023-05-08T09:32:10.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20868.041515 secs 2023-05-08T09:32:10.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20868.597278 secs 2023-05-08T09:32:11.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20869.884021 secs 2023-05-08T09:32:11.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:11 smithi133 ceph-mon[125939]: pgmap v11187: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 385 KiB/s wr, 27 op/s 2023-05-08T09:32:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20869.884021 secs 2023-05-08T09:32:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:11 smithi096 ceph-mon[124666]: pgmap v11187: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 385 KiB/s wr, 27 op/s 2023-05-08T09:32:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20869.884021 secs 2023-05-08T09:32:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:11 smithi186 ceph-mon[126480]: pgmap v11187: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 385 KiB/s wr, 27 op/s 2023-05-08T09:32:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:13 smithi133 ceph-mon[125939]: pgmap v11188: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 384 KiB/s wr, 27 op/s 2023-05-08T09:32:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:13 smithi133 ceph-mon[125939]: osdmap e777: 12 total, 12 up, 12 in 2023-05-08T09:32:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:13 smithi096 ceph-mon[124666]: pgmap v11188: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 384 KiB/s wr, 27 op/s 2023-05-08T09:32:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:13 smithi096 ceph-mon[124666]: osdmap e777: 12 total, 12 up, 12 in 2023-05-08T09:32:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:13 smithi186 ceph-mon[126480]: pgmap v11188: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 384 KiB/s wr, 27 op/s 2023-05-08T09:32:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:13 smithi186 ceph-mon[126480]: osdmap e777: 12 total, 12 up, 12 in 2023-05-08T09:32:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20873.041588 secs 2023-05-08T09:32:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20873.597412 secs 2023-05-08T09:32:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20873.041588 secs 2023-05-08T09:32:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20873.597412 secs 2023-05-08T09:32:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20873.041588 secs 2023-05-08T09:32:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20873.597412 secs 2023-05-08T09:32:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:15 smithi133 ceph-mon[125939]: pgmap v11190: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 288 KiB/s rd, 285 KiB/s wr, 9 op/s 2023-05-08T09:32:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:15 smithi096 ceph-mon[124666]: pgmap v11190: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 288 KiB/s rd, 285 KiB/s wr, 9 op/s 2023-05-08T09:32:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:15 smithi186 ceph-mon[126480]: pgmap v11190: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 288 KiB/s rd, 285 KiB/s wr, 9 op/s 2023-05-08T09:32:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20874.884149 secs 2023-05-08T09:32:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20874.884149 secs 2023-05-08T09:32:17.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20874.884149 secs 2023-05-08T09:32:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:17 smithi133 ceph-mon[125939]: pgmap v11191: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 245 KiB/s wr, 8 op/s 2023-05-08T09:32:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:17 smithi096 ceph-mon[124666]: pgmap v11191: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 245 KiB/s wr, 8 op/s 2023-05-08T09:32:18.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:17 smithi186 ceph-mon[126480]: pgmap v11191: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 245 KiB/s wr, 8 op/s 2023-05-08T09:32:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:19 smithi133 ceph-mon[125939]: pgmap v11192: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 245 KiB/s wr, 8 op/s 2023-05-08T09:32:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20878.041685 secs 2023-05-08T09:32:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20878.597520 secs 2023-05-08T09:32:20.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:19 smithi096 ceph-mon[124666]: pgmap v11192: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 245 KiB/s wr, 8 op/s 2023-05-08T09:32:20.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20878.041685 secs 2023-05-08T09:32:20.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20878.597520 secs 2023-05-08T09:32:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:19 smithi186 ceph-mon[126480]: pgmap v11192: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 245 KiB/s wr, 8 op/s 2023-05-08T09:32:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20878.041685 secs 2023-05-08T09:32:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20878.597520 secs 2023-05-08T09:32:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20879.884280 secs 2023-05-08T09:32:21.994 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:21 smithi133 ceph-mon[125939]: pgmap v11193: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 65 KiB/s wr, 6 op/s 2023-05-08T09:32:22.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20879.884280 secs 2023-05-08T09:32:22.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:21 smithi096 ceph-mon[124666]: pgmap v11193: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 65 KiB/s wr, 6 op/s 2023-05-08T09:32:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20879.884280 secs 2023-05-08T09:32:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:21 smithi186 ceph-mon[126480]: pgmap v11193: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 65 KiB/s wr, 6 op/s 2023-05-08T09:32:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:23 smithi096 ceph-mon[124666]: pgmap v11194: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 65 KiB/s wr, 6 op/s 2023-05-08T09:32:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:23 smithi186 ceph-mon[126480]: pgmap v11194: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 65 KiB/s wr, 6 op/s 2023-05-08T09:32:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:23 smithi133 ceph-mon[125939]: pgmap v11194: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 65 KiB/s wr, 6 op/s 2023-05-08T09:32:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20883.041788 secs 2023-05-08T09:32:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20883.597636 secs 2023-05-08T09:32:25.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20883.041788 secs 2023-05-08T09:32:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20883.597636 secs 2023-05-08T09:32:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20883.041788 secs 2023-05-08T09:32:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20883.597636 secs 2023-05-08T09:32:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:25 smithi096 ceph-mon[124666]: pgmap v11195: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 59 KiB/s wr, 9 op/s 2023-05-08T09:32:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:25 smithi186 ceph-mon[126480]: pgmap v11195: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 59 KiB/s wr, 9 op/s 2023-05-08T09:32:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:25 smithi133 ceph-mon[125939]: pgmap v11195: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 59 KiB/s wr, 9 op/s 2023-05-08T09:32:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20884.884408 secs 2023-05-08T09:32:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20884.884408 secs 2023-05-08T09:32:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20884.884408 secs 2023-05-08T09:32:28.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:27 smithi186 ceph-mon[126480]: pgmap v11196: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:32:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:27 smithi133 ceph-mon[125939]: pgmap v11196: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:32:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:27 smithi096 ceph-mon[124666]: pgmap v11196: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:32:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:29 smithi186 ceph-mon[126480]: pgmap v11197: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:32:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20888.041928 secs 2023-05-08T09:32:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20888.597757 secs 2023-05-08T09:32:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:29 smithi133 ceph-mon[125939]: pgmap v11197: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:32:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20888.041928 secs 2023-05-08T09:32:30.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20888.597757 secs 2023-05-08T09:32:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:29 smithi096 ceph-mon[124666]: pgmap v11197: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:32:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20888.041928 secs 2023-05-08T09:32:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20888.597757 secs 2023-05-08T09:32:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20889.884541 secs 2023-05-08T09:32:32.366 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:31 smithi186 ceph-mon[126480]: pgmap v11198: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T09:32:32.366 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20889.884541 secs 2023-05-08T09:32:32.367 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:31 smithi096 ceph-mon[124666]: pgmap v11198: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T09:32:32.367 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20889.884541 secs 2023-05-08T09:32:32.367 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:31 smithi133 ceph-mon[125939]: pgmap v11198: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T09:32:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:33 smithi186 ceph-mon[126480]: pgmap v11199: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:32:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:33 smithi133 ceph-mon[125939]: pgmap v11199: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:32:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:33 smithi096 ceph-mon[124666]: pgmap v11199: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:32:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20893.041994 secs 2023-05-08T09:32:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20893.597844 secs 2023-05-08T09:32:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20893.041994 secs 2023-05-08T09:32:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20893.597844 secs 2023-05-08T09:32:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20893.041994 secs 2023-05-08T09:32:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20893.597844 secs 2023-05-08T09:32:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:35 smithi186 ceph-mon[126480]: pgmap v11200: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T09:32:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:35 smithi133 ceph-mon[125939]: pgmap v11200: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T09:32:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:35 smithi096 ceph-mon[124666]: pgmap v11200: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T09:32:37.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20894.884668 secs 2023-05-08T09:32:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20894.884668 secs 2023-05-08T09:32:37.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20894.884668 secs 2023-05-08T09:32:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:37 smithi186 ceph-mon[126480]: pgmap v11201: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T09:32:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:37 smithi133 ceph-mon[125939]: pgmap v11201: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T09:32:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:37 smithi096 ceph-mon[124666]: pgmap v11201: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T09:32:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:39 smithi186 ceph-mon[126480]: pgmap v11202: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T09:32:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20898.042059 secs 2023-05-08T09:32:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20898.597901 secs 2023-05-08T09:32:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:39 smithi133 ceph-mon[125939]: pgmap v11202: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T09:32:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20898.042059 secs 2023-05-08T09:32:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20898.597901 secs 2023-05-08T09:32:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:39 smithi096 ceph-mon[124666]: pgmap v11202: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T09:32:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20898.042059 secs 2023-05-08T09:32:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20898.597901 secs 2023-05-08T09:32:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20899.884816 secs 2023-05-08T09:32:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:41 smithi186 ceph-mon[126480]: pgmap v11203: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 87 KiB/s wr, 9 op/s 2023-05-08T09:32:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20899.884816 secs 2023-05-08T09:32:42.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:41 smithi133 ceph-mon[125939]: pgmap v11203: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 87 KiB/s wr, 9 op/s 2023-05-08T09:32:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20899.884816 secs 2023-05-08T09:32:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:41 smithi096 ceph-mon[124666]: pgmap v11203: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 87 KiB/s wr, 9 op/s 2023-05-08T09:32:44.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:43 smithi186 ceph-mon[126480]: pgmap v11204: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 87 KiB/s wr, 6 op/s 2023-05-08T09:32:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:43 smithi133 ceph-mon[125939]: pgmap v11204: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 87 KiB/s wr, 6 op/s 2023-05-08T09:32:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:43 smithi096 ceph-mon[124666]: pgmap v11204: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 87 KiB/s wr, 6 op/s 2023-05-08T09:32:45.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20903.042136 secs 2023-05-08T09:32:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20903.042136 secs 2023-05-08T09:32:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20903.042136 secs 2023-05-08T09:32:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:45 smithi186 ceph-mon[126480]: pgmap v11205: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 142 KiB/s wr, 10 op/s 2023-05-08T09:32:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:45 smithi133 ceph-mon[125939]: pgmap v11205: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 142 KiB/s wr, 10 op/s 2023-05-08T09:32:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:45 smithi096 ceph-mon[124666]: pgmap v11205: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 142 KiB/s wr, 10 op/s 2023-05-08T09:32:47.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20904.884936 secs 2023-05-08T09:32:47.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20904.884936 secs 2023-05-08T09:32:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20904.884936 secs 2023-05-08T09:32:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:47 smithi186 ceph-mon[126480]: pgmap v11206: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 141 KiB/s wr, 7 op/s 2023-05-08T09:32:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:32:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:47 smithi133 ceph-mon[125939]: pgmap v11206: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 141 KiB/s wr, 7 op/s 2023-05-08T09:32:48.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:32:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:47 smithi096 ceph-mon[124666]: pgmap v11206: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 141 KiB/s wr, 7 op/s 2023-05-08T09:32:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:32:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:48 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:32:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:32:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:32:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:48 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:32:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:32:49.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:32:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:48 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:32:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:32:49.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:32:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:49 smithi186 ceph-mon[126480]: pgmap v11207: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 141 KiB/s wr, 7 op/s 2023-05-08T09:32:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20908.042225 secs 2023-05-08T09:32:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:49 smithi133 ceph-mon[125939]: pgmap v11207: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 141 KiB/s wr, 7 op/s 2023-05-08T09:32:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20908.042225 secs 2023-05-08T09:32:50.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:49 smithi096 ceph-mon[124666]: pgmap v11207: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 141 KiB/s wr, 7 op/s 2023-05-08T09:32:50.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20908.042225 secs 2023-05-08T09:32:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:51 smithi186 ceph-mon[126480]: pgmap v11208: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 641 KiB/s rd, 452 KiB/s wr, 13 op/s 2023-05-08T09:32:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:32:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:51 smithi133 ceph-mon[125939]: pgmap v11208: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 641 KiB/s rd, 452 KiB/s wr, 13 op/s 2023-05-08T09:32:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:32:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:51 smithi096 ceph-mon[124666]: pgmap v11208: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 641 KiB/s rd, 452 KiB/s wr, 13 op/s 2023-05-08T09:32:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:32:53.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:32:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:32:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:32:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:32:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:32:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:32:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:53 smithi186 ceph-mon[126480]: pgmap v11209: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 553 KiB/s rd, 365 KiB/s wr, 10 op/s 2023-05-08T09:32:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:53 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:32:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:53 smithi133 ceph-mon[125939]: pgmap v11209: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 553 KiB/s rd, 365 KiB/s wr, 10 op/s 2023-05-08T09:32:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:53 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:32:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:53 smithi096 ceph-mon[124666]: pgmap v11209: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 553 KiB/s rd, 365 KiB/s wr, 10 op/s 2023-05-08T09:32:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:53 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:32:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20913.042319 secs 2023-05-08T09:32:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20913.042319 secs 2023-05-08T09:32:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20913.042319 secs 2023-05-08T09:32:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:55 smithi186 ceph-mon[126480]: pgmap v11210: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 732 KiB/s rd, 544 KiB/s wr, 16 op/s 2023-05-08T09:32:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:55 smithi133 ceph-mon[125939]: pgmap v11210: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 732 KiB/s rd, 544 KiB/s wr, 16 op/s 2023-05-08T09:32:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:55 smithi096 ceph-mon[124666]: pgmap v11210: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 732 KiB/s rd, 544 KiB/s wr, 16 op/s 2023-05-08T09:32:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:57 smithi186 ceph-mon[126480]: pgmap v11211: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 572 KiB/s rd, 490 KiB/s wr, 11 op/s 2023-05-08T09:32:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:57 smithi133 ceph-mon[125939]: pgmap v11211: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 572 KiB/s rd, 490 KiB/s wr, 11 op/s 2023-05-08T09:32:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:57 smithi096 ceph-mon[124666]: pgmap v11211: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 572 KiB/s rd, 490 KiB/s wr, 11 op/s 2023-05-08T09:33:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20918.042440 secs 2023-05-08T09:33:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:59 smithi186 ceph-mon[126480]: pgmap v11212: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 572 KiB/s rd, 490 KiB/s wr, 11 op/s 2023-05-08T09:33:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:32:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20918.598352 secs 2023-05-08T09:33:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20918.042440 secs 2023-05-08T09:33:00.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:59 smithi133 ceph-mon[125939]: pgmap v11212: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 572 KiB/s rd, 490 KiB/s wr, 11 op/s 2023-05-08T09:33:00.247 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:32:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20918.598352 secs 2023-05-08T09:33:00.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20918.042440 secs 2023-05-08T09:33:00.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:59 smithi096 ceph-mon[124666]: pgmap v11212: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 572 KiB/s rd, 490 KiB/s wr, 11 op/s 2023-05-08T09:33:00.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:32:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20918.598352 secs 2023-05-08T09:33:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:00 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:33:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:33:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:33:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:00 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:33:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:33:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:33:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:00 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:33:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:33:01.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:33:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20919.885240 secs 2023-05-08T09:33:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:01 smithi186 ceph-mon[126480]: pgmap v11213: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 666 KiB/s rd, 670 KiB/s wr, 16 op/s 2023-05-08T09:33:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20919.885240 secs 2023-05-08T09:33:02.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:01 smithi133 ceph-mon[125939]: pgmap v11213: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 666 KiB/s rd, 670 KiB/s wr, 16 op/s 2023-05-08T09:33:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20919.885240 secs 2023-05-08T09:33:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:01 smithi096 ceph-mon[124666]: pgmap v11213: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 666 KiB/s rd, 670 KiB/s wr, 16 op/s 2023-05-08T09:33:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:03 smithi186 ceph-mon[126480]: pgmap v11214: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 359 KiB/s wr, 10 op/s 2023-05-08T09:33:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:03 smithi133 ceph-mon[125939]: pgmap v11214: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 359 KiB/s wr, 10 op/s 2023-05-08T09:33:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:03 smithi096 ceph-mon[124666]: pgmap v11214: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 359 KiB/s wr, 10 op/s 2023-05-08T09:33:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20923.042563 secs 2023-05-08T09:33:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20923.598416 secs 2023-05-08T09:33:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:04 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:33:05.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:04 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:33:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20923.042563 secs 2023-05-08T09:33:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20923.598416 secs 2023-05-08T09:33:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:04 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:33:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:04 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:33:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20923.042563 secs 2023-05-08T09:33:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20923.598416 secs 2023-05-08T09:33:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:04 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:33:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:04 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:33:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:05 smithi133 ceph-mon[125939]: pgmap v11215: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 404 KiB/s wr, 28 op/s 2023-05-08T09:33:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:05 smithi096 ceph-mon[124666]: pgmap v11215: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 404 KiB/s wr, 28 op/s 2023-05-08T09:33:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:05 smithi186 ceph-mon[126480]: pgmap v11215: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 404 KiB/s wr, 28 op/s 2023-05-08T09:33:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20924.885359 secs 2023-05-08T09:33:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20924.885359 secs 2023-05-08T09:33:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20924.885359 secs 2023-05-08T09:33:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:07 smithi133 ceph-mon[125939]: pgmap v11216: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 225 KiB/s wr, 22 op/s 2023-05-08T09:33:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:07 smithi096 ceph-mon[124666]: pgmap v11216: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 225 KiB/s wr, 22 op/s 2023-05-08T09:33:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:07 smithi186 ceph-mon[126480]: pgmap v11216: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 225 KiB/s wr, 22 op/s 2023-05-08T09:33:09.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:08 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:33:09.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:08 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:33:09.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:08 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:33:09.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:08 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:33:09.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:08 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:33:09.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:08 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:33:09.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:08 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:33:09.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:08 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:33:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:08 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:33:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:08 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:33:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:08 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:33:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:08 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:33:09.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:08 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:33:09.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:08 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:33:09.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:08 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:33:09.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:08 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:33:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:08 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:33:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:08 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:33:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:08 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:33:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:08 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:33:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:08 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:33:09.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:08 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:33:09.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:08 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:33:09.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:08 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:33:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20928.042631 secs 2023-05-08T09:33:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:09 smithi133 ceph-mon[125939]: pgmap v11217: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 225 KiB/s wr, 22 op/s 2023-05-08T09:33:10.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20928.598493 secs 2023-05-08T09:33:10.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:09 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:33:10.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:09 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:33:10.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:09 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:33:10.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20928.042631 secs 2023-05-08T09:33:10.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:09 smithi096 ceph-mon[124666]: pgmap v11217: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 225 KiB/s wr, 22 op/s 2023-05-08T09:33:10.259 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20928.598493 secs 2023-05-08T09:33:10.259 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:09 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:33:10.259 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:09 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:33:10.259 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:09 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:33:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20928.042631 secs 2023-05-08T09:33:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:09 smithi186 ceph-mon[126480]: pgmap v11217: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 225 KiB/s wr, 22 op/s 2023-05-08T09:33:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20928.598493 secs 2023-05-08T09:33:10.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:09 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:33:10.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:09 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:33:10.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:09 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:33:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:10 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:33:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:10 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T09:33:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:10 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T09:33:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:10 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:33:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:10 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:33:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:10 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T09:33:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:10 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T09:33:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:10 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:33:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:10 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:33:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:10 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T09:33:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:10 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T09:33:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:10 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:33:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20929.885474 secs 2023-05-08T09:33:12.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:11 smithi133 ceph-mon[125939]: pgmap v11218: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 301 KiB/s wr, 25 op/s 2023-05-08T09:33:12.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:11 smithi133 ceph-mon[125939]: osdmap e778: 12 total, 12 up, 12 in 2023-05-08T09:33:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20929.885474 secs 2023-05-08T09:33:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:11 smithi096 ceph-mon[124666]: pgmap v11218: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 301 KiB/s wr, 25 op/s 2023-05-08T09:33:12.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:11 smithi096 ceph-mon[124666]: osdmap e778: 12 total, 12 up, 12 in 2023-05-08T09:33:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20929.885474 secs 2023-05-08T09:33:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:11 smithi186 ceph-mon[126480]: pgmap v11218: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 301 KiB/s wr, 25 op/s 2023-05-08T09:33:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:11 smithi186 ceph-mon[126480]: osdmap e778: 12 total, 12 up, 12 in 2023-05-08T09:33:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:13 smithi133 ceph-mon[125939]: pgmap v11220: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 145 KiB/s wr, 25 op/s 2023-05-08T09:33:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:13 smithi096 ceph-mon[124666]: pgmap v11220: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 145 KiB/s wr, 25 op/s 2023-05-08T09:33:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:13 smithi186 ceph-mon[126480]: pgmap v11220: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 145 KiB/s wr, 25 op/s 2023-05-08T09:33:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20933.042748 secs 2023-05-08T09:33:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20933.598617 secs 2023-05-08T09:33:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20933.042748 secs 2023-05-08T09:33:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20933.598617 secs 2023-05-08T09:33:15.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20933.042748 secs 2023-05-08T09:33:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20933.598617 secs 2023-05-08T09:33:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:15 smithi133 ceph-mon[125939]: pgmap v11221: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 91 KiB/s wr, 7 op/s 2023-05-08T09:33:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:15 smithi096 ceph-mon[124666]: pgmap v11221: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 91 KiB/s wr, 7 op/s 2023-05-08T09:33:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:15 smithi186 ceph-mon[126480]: pgmap v11221: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 91 KiB/s wr, 7 op/s 2023-05-08T09:33:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20934.885543 secs 2023-05-08T09:33:17.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20934.885543 secs 2023-05-08T09:33:17.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20934.885543 secs 2023-05-08T09:33:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:17 smithi133 ceph-mon[125939]: pgmap v11222: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 91 KiB/s wr, 7 op/s 2023-05-08T09:33:18.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:17 smithi096 ceph-mon[124666]: pgmap v11222: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 91 KiB/s wr, 7 op/s 2023-05-08T09:33:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:17 smithi186 ceph-mon[126480]: pgmap v11222: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 91 KiB/s wr, 7 op/s 2023-05-08T09:33:19.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20938.042873 secs 2023-05-08T09:33:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:19 smithi186 ceph-mon[126480]: pgmap v11223: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 91 KiB/s wr, 7 op/s 2023-05-08T09:33:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:19 smithi186 ceph-mon[126480]: osdmap e779: 12 total, 12 up, 12 in 2023-05-08T09:33:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20938.042873 secs 2023-05-08T09:33:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:19 smithi133 ceph-mon[125939]: pgmap v11223: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 91 KiB/s wr, 7 op/s 2023-05-08T09:33:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:19 smithi133 ceph-mon[125939]: osdmap e779: 12 total, 12 up, 12 in 2023-05-08T09:33:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20938.042873 secs 2023-05-08T09:33:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:19 smithi096 ceph-mon[124666]: pgmap v11223: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 91 KiB/s wr, 7 op/s 2023-05-08T09:33:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:19 smithi096 ceph-mon[124666]: osdmap e779: 12 total, 12 up, 12 in 2023-05-08T09:33:20.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20938.598731 secs 2023-05-08T09:33:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20938.598731 secs 2023-05-08T09:33:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20938.598731 secs 2023-05-08T09:33:21.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20939.885669 secs 2023-05-08T09:33:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:21 smithi186 ceph-mon[126480]: pgmap v11225: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 164 KiB/s wr, 7 op/s 2023-05-08T09:33:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20939.885669 secs 2023-05-08T09:33:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:21 smithi133 ceph-mon[125939]: pgmap v11225: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 164 KiB/s wr, 7 op/s 2023-05-08T09:33:21.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20939.885669 secs 2023-05-08T09:33:21.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:21 smithi096 ceph-mon[124666]: pgmap v11225: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 164 KiB/s wr, 7 op/s 2023-05-08T09:33:23.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:23 smithi186 ceph-mon[126480]: pgmap v11226: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 154 KiB/s wr, 7 op/s 2023-05-08T09:33:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:23 smithi133 ceph-mon[125939]: pgmap v11226: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 154 KiB/s wr, 7 op/s 2023-05-08T09:33:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:23 smithi096 ceph-mon[124666]: pgmap v11226: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 154 KiB/s wr, 7 op/s 2023-05-08T09:33:24.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20943.042992 secs 2023-05-08T09:33:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20943.042992 secs 2023-05-08T09:33:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20943.042992 secs 2023-05-08T09:33:25.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20943.598809 secs 2023-05-08T09:33:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:25 smithi186 ceph-mon[126480]: pgmap v11227: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 154 KiB/s wr, 7 op/s 2023-05-08T09:33:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20943.598809 secs 2023-05-08T09:33:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:25 smithi133 ceph-mon[125939]: pgmap v11227: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 154 KiB/s wr, 7 op/s 2023-05-08T09:33:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20943.598809 secs 2023-05-08T09:33:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:25 smithi096 ceph-mon[124666]: pgmap v11227: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 154 KiB/s wr, 7 op/s 2023-05-08T09:33:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20944.885805 secs 2023-05-08T09:33:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20944.885805 secs 2023-05-08T09:33:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20944.885805 secs 2023-05-08T09:33:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:27 smithi186 ceph-mon[126480]: pgmap v11228: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 154 KiB/s wr, 7 op/s 2023-05-08T09:33:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:27 smithi133 ceph-mon[125939]: pgmap v11228: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 154 KiB/s wr, 7 op/s 2023-05-08T09:33:27.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:27 smithi096 ceph-mon[124666]: pgmap v11228: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 154 KiB/s wr, 7 op/s 2023-05-08T09:33:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20948.043109 secs 2023-05-08T09:33:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:29 smithi186 ceph-mon[126480]: pgmap v11229: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 154 KiB/s wr, 7 op/s 2023-05-08T09:33:29.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20948.043109 secs 2023-05-08T09:33:29.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:29 smithi133 ceph-mon[125939]: pgmap v11229: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 154 KiB/s wr, 7 op/s 2023-05-08T09:33:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20948.043109 secs 2023-05-08T09:33:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:29 smithi096 ceph-mon[124666]: pgmap v11229: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 154 KiB/s wr, 7 op/s 2023-05-08T09:33:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20948.598908 secs 2023-05-08T09:33:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20948.598908 secs 2023-05-08T09:33:30.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20948.598908 secs 2023-05-08T09:33:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20949.885872 secs 2023-05-08T09:33:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:31 smithi186 ceph-mon[126480]: pgmap v11230: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 129 KiB/s wr, 8 op/s 2023-05-08T09:33:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20949.885872 secs 2023-05-08T09:33:31.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:31 smithi133 ceph-mon[125939]: pgmap v11230: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 129 KiB/s wr, 8 op/s 2023-05-08T09:33:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20949.885872 secs 2023-05-08T09:33:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:31 smithi096 ceph-mon[124666]: pgmap v11230: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 129 KiB/s wr, 8 op/s 2023-05-08T09:33:33.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:33 smithi186 ceph-mon[126480]: pgmap v11231: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T09:33:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:33 smithi133 ceph-mon[125939]: pgmap v11231: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T09:33:33.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:33 smithi096 ceph-mon[124666]: pgmap v11231: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T09:33:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20953.043229 secs 2023-05-08T09:33:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20953.043229 secs 2023-05-08T09:33:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20953.043229 secs 2023-05-08T09:33:35.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20953.599027 secs 2023-05-08T09:33:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:35 smithi186 ceph-mon[126480]: pgmap v11232: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 66 KiB/s wr, 9 op/s 2023-05-08T09:33:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20953.599027 secs 2023-05-08T09:33:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:35 smithi133 ceph-mon[125939]: pgmap v11232: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 66 KiB/s wr, 9 op/s 2023-05-08T09:33:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20953.599027 secs 2023-05-08T09:33:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:35 smithi096 ceph-mon[124666]: pgmap v11232: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 66 KiB/s wr, 9 op/s 2023-05-08T09:33:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20954.885985 secs 2023-05-08T09:33:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20954.885985 secs 2023-05-08T09:33:36.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20954.885985 secs 2023-05-08T09:33:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:37 smithi133 ceph-mon[125939]: pgmap v11233: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 66 KiB/s wr, 6 op/s 2023-05-08T09:33:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:37 smithi096 ceph-mon[124666]: pgmap v11233: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 66 KiB/s wr, 6 op/s 2023-05-08T09:33:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:37 smithi186 ceph-mon[126480]: pgmap v11233: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 66 KiB/s wr, 6 op/s 2023-05-08T09:33:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20958.043343 secs 2023-05-08T09:33:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:39 smithi133 ceph-mon[125939]: pgmap v11234: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 66 KiB/s wr, 6 op/s 2023-05-08T09:33:39.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20958.043343 secs 2023-05-08T09:33:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:39 smithi096 ceph-mon[124666]: pgmap v11234: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 66 KiB/s wr, 6 op/s 2023-05-08T09:33:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20958.043343 secs 2023-05-08T09:33:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:39 smithi186 ceph-mon[126480]: pgmap v11234: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 66 KiB/s wr, 6 op/s 2023-05-08T09:33:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20958.599099 secs 2023-05-08T09:33:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20958.599099 secs 2023-05-08T09:33:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20958.599099 secs 2023-05-08T09:33:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20959.886106 secs 2023-05-08T09:33:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:41 smithi133 ceph-mon[125939]: pgmap v11235: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 136 KiB/s wr, 9 op/s 2023-05-08T09:33:41.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20959.886106 secs 2023-05-08T09:33:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:41 smithi096 ceph-mon[124666]: pgmap v11235: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 136 KiB/s wr, 9 op/s 2023-05-08T09:33:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20959.886106 secs 2023-05-08T09:33:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:41 smithi186 ceph-mon[126480]: pgmap v11235: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 136 KiB/s wr, 9 op/s 2023-05-08T09:33:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:43 smithi133 ceph-mon[125939]: pgmap v11236: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 136 KiB/s wr, 6 op/s 2023-05-08T09:33:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:43 smithi096 ceph-mon[124666]: pgmap v11236: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 136 KiB/s wr, 6 op/s 2023-05-08T09:33:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:43 smithi186 ceph-mon[126480]: pgmap v11236: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 136 KiB/s wr, 6 op/s 2023-05-08T09:33:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20963.043445 secs 2023-05-08T09:33:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20963.043445 secs 2023-05-08T09:33:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20963.043445 secs 2023-05-08T09:33:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20963.599237 secs 2023-05-08T09:33:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:45 smithi133 ceph-mon[125939]: pgmap v11237: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 389 KiB/s rd, 203 KiB/s wr, 10 op/s 2023-05-08T09:33:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20963.599237 secs 2023-05-08T09:33:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:45 smithi096 ceph-mon[124666]: pgmap v11237: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 389 KiB/s rd, 203 KiB/s wr, 10 op/s 2023-05-08T09:33:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20963.599237 secs 2023-05-08T09:33:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:45 smithi186 ceph-mon[126480]: pgmap v11237: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 389 KiB/s rd, 203 KiB/s wr, 10 op/s 2023-05-08T09:33:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20964.886213 secs 2023-05-08T09:33:46.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20964.886213 secs 2023-05-08T09:33:46.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20964.886213 secs 2023-05-08T09:33:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:47 smithi133 ceph-mon[125939]: pgmap v11238: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 322 KiB/s rd, 138 KiB/s wr, 6 op/s 2023-05-08T09:33:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:47 smithi096 ceph-mon[124666]: pgmap v11238: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 322 KiB/s rd, 138 KiB/s wr, 6 op/s 2023-05-08T09:33:47.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:47 smithi186 ceph-mon[126480]: pgmap v11238: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 322 KiB/s rd, 138 KiB/s wr, 6 op/s 2023-05-08T09:33:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20968.043559 secs 2023-05-08T09:33:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:49 smithi186 ceph-mon[126480]: pgmap v11239: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 322 KiB/s rd, 138 KiB/s wr, 6 op/s 2023-05-08T09:33:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20968.043559 secs 2023-05-08T09:33:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:49 smithi133 ceph-mon[125939]: pgmap v11239: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 322 KiB/s rd, 138 KiB/s wr, 6 op/s 2023-05-08T09:33:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20968.043559 secs 2023-05-08T09:33:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:49 smithi096 ceph-mon[124666]: pgmap v11239: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 322 KiB/s rd, 138 KiB/s wr, 6 op/s 2023-05-08T09:33:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20969.886334 secs 2023-05-08T09:33:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:51 smithi186 ceph-mon[126480]: pgmap v11240: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 674 KiB/s rd, 367 KiB/s wr, 11 op/s 2023-05-08T09:33:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20969.886334 secs 2023-05-08T09:33:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:51 smithi133 ceph-mon[125939]: pgmap v11240: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 674 KiB/s rd, 367 KiB/s wr, 11 op/s 2023-05-08T09:33:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20969.886334 secs 2023-05-08T09:33:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:51 smithi096 ceph-mon[124666]: pgmap v11240: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 674 KiB/s rd, 367 KiB/s wr, 11 op/s 2023-05-08T09:33:52.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:33:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:33:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:33:53.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:53 smithi186 ceph-mon[126480]: pgmap v11241: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 673 KiB/s rd, 297 KiB/s wr, 8 op/s 2023-05-08T09:33:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:53 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:33:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:33:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:33:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:53 smithi133 ceph-mon[125939]: pgmap v11241: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 673 KiB/s rd, 297 KiB/s wr, 8 op/s 2023-05-08T09:33:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:53 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:33:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:33:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:33:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:53 smithi096 ceph-mon[124666]: pgmap v11241: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 673 KiB/s rd, 297 KiB/s wr, 8 op/s 2023-05-08T09:33:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:53 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:33:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:33:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:33:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20973.043697 secs 2023-05-08T09:33:54.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20973.043697 secs 2023-05-08T09:33:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20973.043697 secs 2023-05-08T09:33:55.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20973.599476 secs 2023-05-08T09:33:55.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:55 smithi186 ceph-mon[126480]: pgmap v11242: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 793 KiB/s rd, 569 KiB/s wr, 15 op/s 2023-05-08T09:33:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20973.599476 secs 2023-05-08T09:33:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:55 smithi133 ceph-mon[125939]: pgmap v11242: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 793 KiB/s rd, 569 KiB/s wr, 15 op/s 2023-05-08T09:33:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20973.599476 secs 2023-05-08T09:33:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:55 smithi096 ceph-mon[124666]: pgmap v11242: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 793 KiB/s rd, 569 KiB/s wr, 15 op/s 2023-05-08T09:33:56.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:33:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:33:56.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:33:57.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:57 smithi186 ceph-mon[126480]: pgmap v11243: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 502 KiB/s wr, 11 op/s 2023-05-08T09:33:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:33:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:33:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:33:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:57 smithi133 ceph-mon[125939]: pgmap v11243: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 502 KiB/s wr, 11 op/s 2023-05-08T09:33:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:33:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:33:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:33:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:57 smithi096 ceph-mon[124666]: pgmap v11243: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 502 KiB/s wr, 11 op/s 2023-05-08T09:33:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:33:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:33:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:33:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20978.043815 secs 2023-05-08T09:33:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:33:59 smithi186 ceph-mon[126480]: pgmap v11244: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 502 KiB/s wr, 11 op/s 2023-05-08T09:33:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20978.043815 secs 2023-05-08T09:33:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:33:59 smithi133 ceph-mon[125939]: pgmap v11244: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 502 KiB/s wr, 11 op/s 2023-05-08T09:33:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20978.043815 secs 2023-05-08T09:33:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:33:59 smithi096 ceph-mon[124666]: pgmap v11244: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 502 KiB/s wr, 11 op/s 2023-05-08T09:34:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:00 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:34:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:00 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:34:00.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:00 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:34:01.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:01 smithi186 ceph-mon[126480]: pgmap v11245: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 740 KiB/s rd, 616 KiB/s wr, 16 op/s 2023-05-08T09:34:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:01 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:34:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:34:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:34:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:01 smithi133 ceph-mon[125939]: pgmap v11245: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 740 KiB/s rd, 616 KiB/s wr, 16 op/s 2023-05-08T09:34:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:01 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:34:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:34:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:34:01.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:01 smithi096 ceph-mon[124666]: pgmap v11245: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 740 KiB/s rd, 616 KiB/s wr, 16 op/s 2023-05-08T09:34:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:01 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:34:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:34:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:34:03.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:03 smithi186 ceph-mon[126480]: pgmap v11246: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 387 KiB/s wr, 11 op/s 2023-05-08T09:34:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:03 smithi133 ceph-mon[125939]: pgmap v11246: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 387 KiB/s wr, 11 op/s 2023-05-08T09:34:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:03 smithi096 ceph-mon[124666]: pgmap v11246: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 387 KiB/s wr, 11 op/s 2023-05-08T09:34:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20983.043950 secs 2023-05-08T09:34:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20983.043950 secs 2023-05-08T09:34:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20983.043950 secs 2023-05-08T09:34:05.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20983.599662 secs 2023-05-08T09:34:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:05 smithi186 ceph-mon[126480]: pgmap v11247: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 698 KiB/s wr, 31 op/s 2023-05-08T09:34:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20983.599662 secs 2023-05-08T09:34:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:05 smithi133 ceph-mon[125939]: pgmap v11247: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 698 KiB/s wr, 31 op/s 2023-05-08T09:34:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20983.599662 secs 2023-05-08T09:34:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:05 smithi096 ceph-mon[124666]: pgmap v11247: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 698 KiB/s wr, 31 op/s 2023-05-08T09:34:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20984.886704 secs 2023-05-08T09:34:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:06 smithi133 ceph-mon[125939]: osdmap e780: 12 total, 12 up, 12 in 2023-05-08T09:34:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20984.886704 secs 2023-05-08T09:34:06.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:06 smithi096 ceph-mon[124666]: osdmap e780: 12 total, 12 up, 12 in 2023-05-08T09:34:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20984.886704 secs 2023-05-08T09:34:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:06 smithi186 ceph-mon[126480]: osdmap e780: 12 total, 12 up, 12 in 2023-05-08T09:34:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:07 smithi133 ceph-mon[125939]: pgmap v11249: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 511 KiB/s wr, 29 op/s 2023-05-08T09:34:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:07 smithi096 ceph-mon[124666]: pgmap v11249: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 511 KiB/s wr, 29 op/s 2023-05-08T09:34:07.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:07 smithi186 ceph-mon[126480]: pgmap v11249: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 511 KiB/s wr, 29 op/s 2023-05-08T09:34:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:08 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:34:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:34:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:34:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:08 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:34:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:34:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:34:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:08 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:34:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:34:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:34:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20988.044066 secs 2023-05-08T09:34:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:09 smithi133 ceph-mon[125939]: pgmap v11250: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 511 KiB/s wr, 29 op/s 2023-05-08T09:34:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:34:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:34:09.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20988.044066 secs 2023-05-08T09:34:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:09 smithi096 ceph-mon[124666]: pgmap v11250: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 511 KiB/s wr, 29 op/s 2023-05-08T09:34:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:34:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:34:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20988.044066 secs 2023-05-08T09:34:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:09 smithi186 ceph-mon[126480]: pgmap v11250: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 511 KiB/s wr, 29 op/s 2023-05-08T09:34:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:34:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:34:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20988.599741 secs 2023-05-08T09:34:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:10 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:34:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:10 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:34:10.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:10 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:34:10.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:10 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:34:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20988.599741 secs 2023-05-08T09:34:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:10 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:34:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:10 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:34:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:10 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:34:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:10 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:34:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20988.599741 secs 2023-05-08T09:34:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:10 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:34:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:10 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:34:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:10 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:34:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:10 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:34:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20989.886770 secs 2023-05-08T09:34:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:11 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:34:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:11 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T09:34:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:11 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T09:34:11.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:11 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:34:11.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:11 smithi133 ceph-mon[125939]: pgmap v11251: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 466 KiB/s wr, 28 op/s 2023-05-08T09:34:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20989.886770 secs 2023-05-08T09:34:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:11 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:34:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:11 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T09:34:11.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:11 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T09:34:11.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:11 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:34:11.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:11 smithi096 ceph-mon[124666]: pgmap v11251: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 466 KiB/s wr, 28 op/s 2023-05-08T09:34:11.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20989.886770 secs 2023-05-08T09:34:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:11 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:34:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:11 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T09:34:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:11 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T09:34:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:11 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:34:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:11 smithi186 ceph-mon[126480]: pgmap v11251: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 466 KiB/s wr, 28 op/s 2023-05-08T09:34:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:13 smithi133 ceph-mon[125939]: pgmap v11252: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 466 KiB/s wr, 28 op/s 2023-05-08T09:34:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:13 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:34:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:13 smithi133 ceph-mon[125939]: osdmap e781: 12 total, 12 up, 12 in 2023-05-08T09:34:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:13 smithi096 ceph-mon[124666]: pgmap v11252: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 466 KiB/s wr, 28 op/s 2023-05-08T09:34:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:13 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:34:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:13 smithi096 ceph-mon[124666]: osdmap e781: 12 total, 12 up, 12 in 2023-05-08T09:34:13.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:13 smithi186 ceph-mon[126480]: pgmap v11252: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 466 KiB/s wr, 28 op/s 2023-05-08T09:34:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:13 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:34:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:13 smithi186 ceph-mon[126480]: osdmap e781: 12 total, 12 up, 12 in 2023-05-08T09:34:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20993.044186 secs 2023-05-08T09:34:14.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20993.044186 secs 2023-05-08T09:34:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20993.044186 secs 2023-05-08T09:34:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20993.599833 secs 2023-05-08T09:34:15.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:15 smithi133 ceph-mon[125939]: pgmap v11254: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 175 KiB/s wr, 9 op/s 2023-05-08T09:34:15.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20993.599833 secs 2023-05-08T09:34:15.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:15 smithi096 ceph-mon[124666]: pgmap v11254: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 175 KiB/s wr, 9 op/s 2023-05-08T09:34:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20993.599833 secs 2023-05-08T09:34:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:15 smithi186 ceph-mon[126480]: pgmap v11254: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 175 KiB/s wr, 9 op/s 2023-05-08T09:34:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20994.886883 secs 2023-05-08T09:34:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20994.886883 secs 2023-05-08T09:34:16.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20994.886883 secs 2023-05-08T09:34:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:17 smithi133 ceph-mon[125939]: pgmap v11255: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 157 KiB/s wr, 8 op/s 2023-05-08T09:34:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:17 smithi096 ceph-mon[124666]: pgmap v11255: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 157 KiB/s wr, 8 op/s 2023-05-08T09:34:17.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:17 smithi186 ceph-mon[126480]: pgmap v11255: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 157 KiB/s wr, 8 op/s 2023-05-08T09:34:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20998.044303 secs 2023-05-08T09:34:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:19 smithi133 ceph-mon[125939]: pgmap v11256: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 157 KiB/s wr, 8 op/s 2023-05-08T09:34:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20998.044303 secs 2023-05-08T09:34:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:19 smithi096 ceph-mon[124666]: pgmap v11256: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 157 KiB/s wr, 8 op/s 2023-05-08T09:34:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20998.044303 secs 2023-05-08T09:34:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:19 smithi186 ceph-mon[126480]: pgmap v11256: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 157 KiB/s wr, 8 op/s 2023-05-08T09:34:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20998.599932 secs 2023-05-08T09:34:20.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20998.599932 secs 2023-05-08T09:34:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20998.599932 secs 2023-05-08T09:34:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 20999.886998 secs 2023-05-08T09:34:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:21 smithi133 ceph-mon[125939]: pgmap v11257: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 65 KiB/s wr, 6 op/s 2023-05-08T09:34:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 20999.886998 secs 2023-05-08T09:34:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:21 smithi096 ceph-mon[124666]: pgmap v11257: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 65 KiB/s wr, 6 op/s 2023-05-08T09:34:21.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 20999.886998 secs 2023-05-08T09:34:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:21 smithi186 ceph-mon[126480]: pgmap v11257: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 65 KiB/s wr, 6 op/s 2023-05-08T09:34:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:23 smithi133 ceph-mon[125939]: pgmap v11258: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 65 KiB/s wr, 6 op/s 2023-05-08T09:34:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:23 smithi096 ceph-mon[124666]: pgmap v11258: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 65 KiB/s wr, 6 op/s 2023-05-08T09:34:23.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:23 smithi186 ceph-mon[126480]: pgmap v11258: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 65 KiB/s wr, 6 op/s 2023-05-08T09:34:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21003.044418 secs 2023-05-08T09:34:24.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21003.044418 secs 2023-05-08T09:34:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21003.044418 secs 2023-05-08T09:34:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21003.600011 secs 2023-05-08T09:34:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:25 smithi133 ceph-mon[125939]: pgmap v11259: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 59 KiB/s wr, 8 op/s 2023-05-08T09:34:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21003.600011 secs 2023-05-08T09:34:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:25 smithi096 ceph-mon[124666]: pgmap v11259: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 59 KiB/s wr, 8 op/s 2023-05-08T09:34:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21003.600011 secs 2023-05-08T09:34:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:25 smithi186 ceph-mon[126480]: pgmap v11259: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 59 KiB/s wr, 8 op/s 2023-05-08T09:34:26.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21004.887113 secs 2023-05-08T09:34:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21004.887113 secs 2023-05-08T09:34:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21004.887113 secs 2023-05-08T09:34:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:27 smithi133 ceph-mon[125939]: pgmap v11260: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:34:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:27 smithi096 ceph-mon[124666]: pgmap v11260: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:34:27.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:27 smithi186 ceph-mon[126480]: pgmap v11260: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:34:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21008.044530 secs 2023-05-08T09:34:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:29 smithi133 ceph-mon[125939]: pgmap v11261: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:34:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21008.044530 secs 2023-05-08T09:34:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:29 smithi096 ceph-mon[124666]: pgmap v11261: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:34:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21008.044530 secs 2023-05-08T09:34:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:29 smithi186 ceph-mon[126480]: pgmap v11261: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:34:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21008.600144 secs 2023-05-08T09:34:30.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21008.600144 secs 2023-05-08T09:34:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21008.600144 secs 2023-05-08T09:34:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21009.887212 secs 2023-05-08T09:34:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:31 smithi133 ceph-mon[125939]: pgmap v11262: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T09:34:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21009.887212 secs 2023-05-08T09:34:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:31 smithi096 ceph-mon[124666]: pgmap v11262: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T09:34:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21009.887212 secs 2023-05-08T09:34:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:31 smithi186 ceph-mon[126480]: pgmap v11262: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T09:34:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:33 smithi133 ceph-mon[125939]: pgmap v11263: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:34:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:33 smithi096 ceph-mon[124666]: pgmap v11263: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:34:33.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:33 smithi186 ceph-mon[126480]: pgmap v11263: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:34:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21013.044645 secs 2023-05-08T09:34:34.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21013.044645 secs 2023-05-08T09:34:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21013.044645 secs 2023-05-08T09:34:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21013.600210 secs 2023-05-08T09:34:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:35 smithi133 ceph-mon[125939]: pgmap v11264: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T09:34:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21013.600210 secs 2023-05-08T09:34:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:35 smithi096 ceph-mon[124666]: pgmap v11264: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T09:34:35.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21013.600210 secs 2023-05-08T09:34:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:35 smithi186 ceph-mon[126480]: pgmap v11264: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T09:34:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21014.887350 secs 2023-05-08T09:34:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21014.887350 secs 2023-05-08T09:34:36.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21014.887350 secs 2023-05-08T09:34:37.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:37 smithi133 ceph-mon[125939]: pgmap v11265: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T09:34:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:37 smithi096 ceph-mon[124666]: pgmap v11265: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T09:34:37.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:37 smithi186 ceph-mon[126480]: pgmap v11265: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T09:34:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21018.044763 secs 2023-05-08T09:34:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:39 smithi133 ceph-mon[125939]: pgmap v11266: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T09:34:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21018.044763 secs 2023-05-08T09:34:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:39 smithi096 ceph-mon[124666]: pgmap v11266: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T09:34:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21018.044763 secs 2023-05-08T09:34:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:39 smithi186 ceph-mon[126480]: pgmap v11266: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T09:34:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21018.600275 secs 2023-05-08T09:34:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21018.600275 secs 2023-05-08T09:34:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21018.600275 secs 2023-05-08T09:34:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21019.887502 secs 2023-05-08T09:34:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:41 smithi133 ceph-mon[125939]: pgmap v11267: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 88 KiB/s wr, 9 op/s 2023-05-08T09:34:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21019.887502 secs 2023-05-08T09:34:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:41 smithi096 ceph-mon[124666]: pgmap v11267: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 88 KiB/s wr, 9 op/s 2023-05-08T09:34:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21019.887502 secs 2023-05-08T09:34:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:41 smithi186 ceph-mon[126480]: pgmap v11267: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 88 KiB/s wr, 9 op/s 2023-05-08T09:34:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:43 smithi096 ceph-mon[124666]: pgmap v11268: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 88 KiB/s wr, 6 op/s 2023-05-08T09:34:43.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:43 smithi186 ceph-mon[126480]: pgmap v11268: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 88 KiB/s wr, 6 op/s 2023-05-08T09:34:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:43 smithi133 ceph-mon[125939]: pgmap v11268: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 88 KiB/s wr, 6 op/s 2023-05-08T09:34:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21023.044860 secs 2023-05-08T09:34:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21023.044860 secs 2023-05-08T09:34:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21023.044860 secs 2023-05-08T09:34:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:45 smithi096 ceph-mon[124666]: pgmap v11269: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 183 KiB/s wr, 11 op/s 2023-05-08T09:34:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:45 smithi186 ceph-mon[126480]: pgmap v11269: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 183 KiB/s wr, 11 op/s 2023-05-08T09:34:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:45 smithi133 ceph-mon[125939]: pgmap v11269: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 183 KiB/s wr, 11 op/s 2023-05-08T09:34:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21024.887618 secs 2023-05-08T09:34:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21024.887618 secs 2023-05-08T09:34:47.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21024.887618 secs 2023-05-08T09:34:47.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:47 smithi186 ceph-mon[126480]: pgmap v11270: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 183 KiB/s wr, 8 op/s 2023-05-08T09:34:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:34:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:47 smithi133 ceph-mon[125939]: pgmap v11270: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 183 KiB/s wr, 8 op/s 2023-05-08T09:34:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:34:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:47 smithi096 ceph-mon[124666]: pgmap v11270: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 183 KiB/s wr, 8 op/s 2023-05-08T09:34:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:34:48.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:48 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:34:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:34:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:34:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:48 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:34:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:34:48.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:34:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:48 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:34:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:34:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:34:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21028.044996 secs 2023-05-08T09:34:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:49 smithi186 ceph-mon[126480]: pgmap v11271: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 183 KiB/s wr, 8 op/s 2023-05-08T09:34:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21028.044996 secs 2023-05-08T09:34:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:49 smithi133 ceph-mon[125939]: pgmap v11271: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 183 KiB/s wr, 8 op/s 2023-05-08T09:34:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21028.044996 secs 2023-05-08T09:34:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:49 smithi096 ceph-mon[124666]: pgmap v11271: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 183 KiB/s wr, 8 op/s 2023-05-08T09:34:51.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:51 smithi186 ceph-mon[126480]: pgmap v11272: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 470 KiB/s rd, 457 KiB/s wr, 13 op/s 2023-05-08T09:34:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:34:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:51 smithi133 ceph-mon[125939]: pgmap v11272: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 470 KiB/s rd, 457 KiB/s wr, 13 op/s 2023-05-08T09:34:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:34:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:51 smithi096 ceph-mon[124666]: pgmap v11272: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 470 KiB/s rd, 457 KiB/s wr, 13 op/s 2023-05-08T09:34:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:34:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:34:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:34:52.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:34:52.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:34:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:34:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:34:53.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:53 smithi186 ceph-mon[126480]: pgmap v11273: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 469 KiB/s rd, 369 KiB/s wr, 10 op/s 2023-05-08T09:34:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:53 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:34:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:53 smithi133 ceph-mon[125939]: pgmap v11273: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 469 KiB/s rd, 369 KiB/s wr, 10 op/s 2023-05-08T09:34:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:53 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:34:54.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:53 smithi096 ceph-mon[124666]: pgmap v11273: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 469 KiB/s rd, 369 KiB/s wr, 10 op/s 2023-05-08T09:34:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:53 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:34:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21033.045131 secs 2023-05-08T09:34:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21033.045131 secs 2023-05-08T09:34:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21033.045131 secs 2023-05-08T09:34:55.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:55 smithi186 ceph-mon[126480]: pgmap v11274: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 649 KiB/s rd, 549 KiB/s wr, 16 op/s 2023-05-08T09:34:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:55 smithi133 ceph-mon[125939]: pgmap v11274: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 649 KiB/s rd, 549 KiB/s wr, 16 op/s 2023-05-08T09:34:56.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:55 smithi096 ceph-mon[124666]: pgmap v11274: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 649 KiB/s rd, 549 KiB/s wr, 16 op/s 2023-05-08T09:34:57.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:57 smithi186 ceph-mon[126480]: pgmap v11275: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 455 KiB/s wr, 11 op/s 2023-05-08T09:34:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:57 smithi133 ceph-mon[125939]: pgmap v11275: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 455 KiB/s wr, 11 op/s 2023-05-08T09:34:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:57 smithi096 ceph-mon[124666]: pgmap v11275: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 455 KiB/s wr, 11 op/s 2023-05-08T09:34:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21038.045247 secs 2023-05-08T09:34:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:34:59 smithi186 ceph-mon[126480]: pgmap v11276: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 455 KiB/s wr, 11 op/s 2023-05-08T09:34:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21038.045247 secs 2023-05-08T09:34:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:34:59 smithi133 ceph-mon[125939]: pgmap v11276: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 455 KiB/s wr, 11 op/s 2023-05-08T09:34:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21038.045247 secs 2023-05-08T09:34:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:34:59 smithi096 ceph-mon[124666]: pgmap v11276: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 455 KiB/s wr, 11 op/s 2023-05-08T09:35:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21038.600739 secs 2023-05-08T09:35:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21038.600739 secs 2023-05-08T09:35:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21038.600739 secs 2023-05-08T09:35:01.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21039.888042 secs 2023-05-08T09:35:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:01 smithi186 ceph-mon[126480]: pgmap v11277: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 648 KiB/s rd, 636 KiB/s wr, 15 op/s 2023-05-08T09:35:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:01 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:35:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:35:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:35:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21039.888042 secs 2023-05-08T09:35:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:01 smithi133 ceph-mon[125939]: pgmap v11277: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 648 KiB/s rd, 636 KiB/s wr, 15 op/s 2023-05-08T09:35:01.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:01 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:35:01.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:35:01.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:35:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21039.888042 secs 2023-05-08T09:35:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:01 smithi096 ceph-mon[124666]: pgmap v11277: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 648 KiB/s rd, 636 KiB/s wr, 15 op/s 2023-05-08T09:35:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:01 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:35:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:35:01.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:35:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:03 smithi186 ceph-mon[126480]: pgmap v11278: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 362 KiB/s wr, 10 op/s 2023-05-08T09:35:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:03 smithi133 ceph-mon[125939]: pgmap v11278: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 362 KiB/s wr, 10 op/s 2023-05-08T09:35:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:03 smithi096 ceph-mon[124666]: pgmap v11278: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 362 KiB/s wr, 10 op/s 2023-05-08T09:35:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21043.045385 secs 2023-05-08T09:35:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21043.045385 secs 2023-05-08T09:35:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21043.045385 secs 2023-05-08T09:35:05.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21043.600851 secs 2023-05-08T09:35:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:05 smithi186 ceph-mon[126480]: pgmap v11279: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 407 KiB/s wr, 28 op/s 2023-05-08T09:35:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:35:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:35:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21043.600851 secs 2023-05-08T09:35:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:05 smithi133 ceph-mon[125939]: pgmap v11279: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 407 KiB/s wr, 28 op/s 2023-05-08T09:35:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:35:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:35:05.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21043.600851 secs 2023-05-08T09:35:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:05 smithi096 ceph-mon[124666]: pgmap v11279: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 407 KiB/s wr, 28 op/s 2023-05-08T09:35:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:35:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:35:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21044.888176 secs 2023-05-08T09:35:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21044.888176 secs 2023-05-08T09:35:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21044.888176 secs 2023-05-08T09:35:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:07 smithi133 ceph-mon[125939]: pgmap v11280: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 405 KiB/s rd, 439 KiB/s wr, 22 op/s 2023-05-08T09:35:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:07 smithi096 ceph-mon[124666]: pgmap v11280: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 405 KiB/s rd, 439 KiB/s wr, 22 op/s 2023-05-08T09:35:07.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:07 smithi186 ceph-mon[126480]: pgmap v11280: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 405 KiB/s rd, 439 KiB/s wr, 22 op/s 2023-05-08T09:35:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:08 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:35:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:08 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:35:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:08 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:35:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21048.045466 secs 2023-05-08T09:35:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:09 smithi133 ceph-mon[125939]: pgmap v11281: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 405 KiB/s rd, 439 KiB/s wr, 22 op/s 2023-05-08T09:35:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21048.045466 secs 2023-05-08T09:35:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:09 smithi096 ceph-mon[124666]: pgmap v11281: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 405 KiB/s rd, 439 KiB/s wr, 22 op/s 2023-05-08T09:35:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21048.045466 secs 2023-05-08T09:35:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:09 smithi186 ceph-mon[126480]: pgmap v11281: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 405 KiB/s rd, 439 KiB/s wr, 22 op/s 2023-05-08T09:35:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21048.600992 secs 2023-05-08T09:35:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:10 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:35:10.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21048.600992 secs 2023-05-08T09:35:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:10 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:35:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21048.600992 secs 2023-05-08T09:35:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:10 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:35:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21049.888318 secs 2023-05-08T09:35:11.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:11 smithi133 ceph-mon[125939]: pgmap v11282: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 421 KiB/s rd, 453 KiB/s wr, 25 op/s 2023-05-08T09:35:11.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:11 smithi133 ceph-mon[125939]: osdmap e782: 12 total, 12 up, 12 in 2023-05-08T09:35:11.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:11 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:35:11.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:11 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:35:11.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:11 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:35:11.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:11 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:35:11.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:11 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T09:35:11.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:11 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T09:35:11.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:11 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:35:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21049.888318 secs 2023-05-08T09:35:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:11 smithi096 ceph-mon[124666]: pgmap v11282: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 421 KiB/s rd, 453 KiB/s wr, 25 op/s 2023-05-08T09:35:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:11 smithi096 ceph-mon[124666]: osdmap e782: 12 total, 12 up, 12 in 2023-05-08T09:35:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:11 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:35:11.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:11 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:35:11.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:11 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:35:11.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:11 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:35:11.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:11 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T09:35:11.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:11 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T09:35:11.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:11 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:35:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21049.888318 secs 2023-05-08T09:35:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:11 smithi186 ceph-mon[126480]: pgmap v11282: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 421 KiB/s rd, 453 KiB/s wr, 25 op/s 2023-05-08T09:35:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:11 smithi186 ceph-mon[126480]: osdmap e782: 12 total, 12 up, 12 in 2023-05-08T09:35:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:11 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:35:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:11 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:35:11.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:11 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:35:11.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:11 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:35:11.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:11 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T09:35:11.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:11 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T09:35:11.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:11 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:35:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:13 smithi133 ceph-mon[125939]: pgmap v11284: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 286 KiB/s rd, 326 KiB/s wr, 25 op/s 2023-05-08T09:35:13.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:13 smithi096 ceph-mon[124666]: pgmap v11284: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 286 KiB/s rd, 326 KiB/s wr, 25 op/s 2023-05-08T09:35:13.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:13 smithi186 ceph-mon[126480]: pgmap v11284: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 286 KiB/s rd, 326 KiB/s wr, 25 op/s 2023-05-08T09:35:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21053.045584 secs 2023-05-08T09:35:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21053.045584 secs 2023-05-08T09:35:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21053.045584 secs 2023-05-08T09:35:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21053.601126 secs 2023-05-08T09:35:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:15 smithi133 ceph-mon[125939]: pgmap v11285: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 272 KiB/s wr, 7 op/s 2023-05-08T09:35:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21053.601126 secs 2023-05-08T09:35:15.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:15 smithi096 ceph-mon[124666]: pgmap v11285: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 272 KiB/s wr, 7 op/s 2023-05-08T09:35:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21053.601126 secs 2023-05-08T09:35:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:15 smithi186 ceph-mon[126480]: pgmap v11285: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 272 KiB/s wr, 7 op/s 2023-05-08T09:35:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21054.888435 secs 2023-05-08T09:35:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21054.888435 secs 2023-05-08T09:35:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21054.888435 secs 2023-05-08T09:35:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:17 smithi133 ceph-mon[125939]: pgmap v11286: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 83 KiB/s wr, 7 op/s 2023-05-08T09:35:17.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:17 smithi096 ceph-mon[124666]: pgmap v11286: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 83 KiB/s wr, 7 op/s 2023-05-08T09:35:17.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:17 smithi186 ceph-mon[126480]: pgmap v11286: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 83 KiB/s wr, 7 op/s 2023-05-08T09:35:19.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21058.045702 secs 2023-05-08T09:35:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:19 smithi186 ceph-mon[126480]: pgmap v11287: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 83 KiB/s wr, 7 op/s 2023-05-08T09:35:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:19 smithi186 ceph-mon[126480]: osdmap e783: 12 total, 12 up, 12 in 2023-05-08T09:35:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21058.045702 secs 2023-05-08T09:35:19.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:19 smithi133 ceph-mon[125939]: pgmap v11287: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 83 KiB/s wr, 7 op/s 2023-05-08T09:35:19.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:19 smithi133 ceph-mon[125939]: osdmap e783: 12 total, 12 up, 12 in 2023-05-08T09:35:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21058.045702 secs 2023-05-08T09:35:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:19 smithi096 ceph-mon[124666]: pgmap v11287: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 83 KiB/s wr, 7 op/s 2023-05-08T09:35:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:19 smithi096 ceph-mon[124666]: osdmap e783: 12 total, 12 up, 12 in 2023-05-08T09:35:20.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21058.601262 secs 2023-05-08T09:35:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21058.601262 secs 2023-05-08T09:35:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21058.601262 secs 2023-05-08T09:35:21.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21059.888561 secs 2023-05-08T09:35:21.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:21 smithi186 ceph-mon[126480]: pgmap v11289: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 66 KiB/s wr, 6 op/s 2023-05-08T09:35:21.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21059.888561 secs 2023-05-08T09:35:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:21 smithi133 ceph-mon[125939]: pgmap v11289: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 66 KiB/s wr, 6 op/s 2023-05-08T09:35:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21059.888561 secs 2023-05-08T09:35:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:21 smithi096 ceph-mon[124666]: pgmap v11289: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 66 KiB/s wr, 6 op/s 2023-05-08T09:35:23.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:23 smithi186 ceph-mon[126480]: pgmap v11290: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 66 KiB/s wr, 6 op/s 2023-05-08T09:35:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:23 smithi133 ceph-mon[125939]: pgmap v11290: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 66 KiB/s wr, 6 op/s 2023-05-08T09:35:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:23 smithi096 ceph-mon[124666]: pgmap v11290: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 66 KiB/s wr, 6 op/s 2023-05-08T09:35:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21063.045820 secs 2023-05-08T09:35:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21063.045820 secs 2023-05-08T09:35:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21063.045820 secs 2023-05-08T09:35:25.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21063.601585 secs 2023-05-08T09:35:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:25 smithi186 ceph-mon[126480]: pgmap v11291: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 65 KiB/s wr, 6 op/s 2023-05-08T09:35:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21063.601585 secs 2023-05-08T09:35:25.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:25 smithi133 ceph-mon[125939]: pgmap v11291: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 65 KiB/s wr, 6 op/s 2023-05-08T09:35:25.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21063.601585 secs 2023-05-08T09:35:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:25 smithi096 ceph-mon[124666]: pgmap v11291: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 65 KiB/s wr, 6 op/s 2023-05-08T09:35:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21064.888680 secs 2023-05-08T09:35:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21064.888680 secs 2023-05-08T09:35:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21064.888680 secs 2023-05-08T09:35:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:27 smithi133 ceph-mon[125939]: pgmap v11292: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T09:35:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:27 smithi096 ceph-mon[124666]: pgmap v11292: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T09:35:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:27 smithi186 ceph-mon[126480]: pgmap v11292: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T09:35:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21068.045941 secs 2023-05-08T09:35:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:29 smithi133 ceph-mon[125939]: pgmap v11293: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T09:35:29.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21068.045941 secs 2023-05-08T09:35:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:29 smithi096 ceph-mon[124666]: pgmap v11293: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T09:35:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21068.045941 secs 2023-05-08T09:35:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:29 smithi186 ceph-mon[126480]: pgmap v11293: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T09:35:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21068.601696 secs 2023-05-08T09:35:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21068.601696 secs 2023-05-08T09:35:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21068.601696 secs 2023-05-08T09:35:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21069.888787 secs 2023-05-08T09:35:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:31 smithi133 ceph-mon[125939]: pgmap v11294: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T09:35:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21069.888787 secs 2023-05-08T09:35:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:31 smithi096 ceph-mon[124666]: pgmap v11294: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T09:35:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21069.888787 secs 2023-05-08T09:35:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:31 smithi186 ceph-mon[126480]: pgmap v11294: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T09:35:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:33 smithi133 ceph-mon[125939]: pgmap v11295: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 65 KiB/s wr, 5 op/s 2023-05-08T09:35:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:33 smithi096 ceph-mon[124666]: pgmap v11295: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 65 KiB/s wr, 5 op/s 2023-05-08T09:35:33.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:33 smithi186 ceph-mon[126480]: pgmap v11295: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 65 KiB/s wr, 5 op/s 2023-05-08T09:35:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21073.046041 secs 2023-05-08T09:35:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21073.046041 secs 2023-05-08T09:35:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21073.046041 secs 2023-05-08T09:35:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21073.601778 secs 2023-05-08T09:35:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:35 smithi133 ceph-mon[125939]: pgmap v11296: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 66 KiB/s wr, 8 op/s 2023-05-08T09:35:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21073.601778 secs 2023-05-08T09:35:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:35 smithi096 ceph-mon[124666]: pgmap v11296: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 66 KiB/s wr, 8 op/s 2023-05-08T09:35:35.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21073.601778 secs 2023-05-08T09:35:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:35 smithi186 ceph-mon[126480]: pgmap v11296: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 66 KiB/s wr, 8 op/s 2023-05-08T09:35:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21074.888906 secs 2023-05-08T09:35:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21074.888906 secs 2023-05-08T09:35:36.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21074.888906 secs 2023-05-08T09:35:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:37 smithi133 ceph-mon[125939]: pgmap v11297: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 66 KiB/s wr, 7 op/s 2023-05-08T09:35:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:37 smithi096 ceph-mon[124666]: pgmap v11297: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 66 KiB/s wr, 7 op/s 2023-05-08T09:35:37.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:37 smithi186 ceph-mon[126480]: pgmap v11297: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 66 KiB/s wr, 7 op/s 2023-05-08T09:35:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21078.046157 secs 2023-05-08T09:35:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:39 smithi133 ceph-mon[125939]: pgmap v11298: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 66 KiB/s wr, 6 op/s 2023-05-08T09:35:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21078.046157 secs 2023-05-08T09:35:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:39 smithi096 ceph-mon[124666]: pgmap v11298: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 66 KiB/s wr, 6 op/s 2023-05-08T09:35:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21078.046157 secs 2023-05-08T09:35:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:39 smithi186 ceph-mon[126480]: pgmap v11298: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 66 KiB/s wr, 6 op/s 2023-05-08T09:35:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21078.601887 secs 2023-05-08T09:35:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21078.601887 secs 2023-05-08T09:35:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21078.601887 secs 2023-05-08T09:35:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21079.888984 secs 2023-05-08T09:35:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:41 smithi133 ceph-mon[125939]: pgmap v11299: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 128 KiB/s wr, 9 op/s 2023-05-08T09:35:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21079.888984 secs 2023-05-08T09:35:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:41 smithi096 ceph-mon[124666]: pgmap v11299: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 128 KiB/s wr, 9 op/s 2023-05-08T09:35:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21079.888984 secs 2023-05-08T09:35:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:41 smithi186 ceph-mon[126480]: pgmap v11299: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 128 KiB/s wr, 9 op/s 2023-05-08T09:35:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:43 smithi133 ceph-mon[125939]: pgmap v11300: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 137 KiB/s wr, 7 op/s 2023-05-08T09:35:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:43 smithi096 ceph-mon[124666]: pgmap v11300: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 137 KiB/s wr, 7 op/s 2023-05-08T09:35:43.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:43 smithi186 ceph-mon[126480]: pgmap v11300: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 137 KiB/s wr, 7 op/s 2023-05-08T09:35:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21083.601973 secs 2023-05-08T09:35:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:45 smithi133 ceph-mon[125939]: pgmap v11301: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 154 KiB/s wr, 10 op/s 2023-05-08T09:35:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21083.601973 secs 2023-05-08T09:35:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:45 smithi096 ceph-mon[124666]: pgmap v11301: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 154 KiB/s wr, 10 op/s 2023-05-08T09:35:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21083.601973 secs 2023-05-08T09:35:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:45 smithi186 ceph-mon[126480]: pgmap v11301: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 154 KiB/s wr, 10 op/s 2023-05-08T09:35:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21084.889093 secs 2023-05-08T09:35:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:46 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:35:46.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21084.889093 secs 2023-05-08T09:35:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:46 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:35:46.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21084.889093 secs 2023-05-08T09:35:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:46 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:35:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:47 smithi133 ceph-mon[125939]: pgmap v11302: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 153 KiB/s wr, 7 op/s 2023-05-08T09:35:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:47 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:35:47.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:47 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T09:35:47.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:47 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:35:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:47 smithi096 ceph-mon[124666]: pgmap v11302: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 153 KiB/s wr, 7 op/s 2023-05-08T09:35:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:47 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:35:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:47 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T09:35:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:47 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:35:47.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:47 smithi186 ceph-mon[126480]: pgmap v11302: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 153 KiB/s wr, 7 op/s 2023-05-08T09:35:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:47 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:35:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:47 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T09:35:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:47 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:35:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21088.046408 secs 2023-05-08T09:35:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:49 smithi133 ceph-mon[125939]: pgmap v11303: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 153 KiB/s wr, 6 op/s 2023-05-08T09:35:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21088.046408 secs 2023-05-08T09:35:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:49 smithi096 ceph-mon[124666]: pgmap v11303: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 153 KiB/s wr, 6 op/s 2023-05-08T09:35:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21088.046408 secs 2023-05-08T09:35:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:49 smithi186 ceph-mon[126480]: pgmap v11303: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 153 KiB/s wr, 6 op/s 2023-05-08T09:35:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21089.889207 secs 2023-05-08T09:35:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:51 smithi133 ceph-mon[125939]: pgmap v11304: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 445 KiB/s wr, 11 op/s 2023-05-08T09:35:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T09:35:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:35:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21089.889207 secs 2023-05-08T09:35:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:51 smithi096 ceph-mon[124666]: pgmap v11304: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 445 KiB/s wr, 11 op/s 2023-05-08T09:35:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T09:35:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:35:51.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21089.889207 secs 2023-05-08T09:35:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:51 smithi186 ceph-mon[126480]: pgmap v11304: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 445 KiB/s wr, 11 op/s 2023-05-08T09:35:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T09:35:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:35:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:35:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:35:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:35:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:53 smithi133 ceph-mon[125939]: pgmap v11305: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 384 KiB/s wr, 8 op/s 2023-05-08T09:35:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:53 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:35:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:35:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:35:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:53 smithi096 ceph-mon[124666]: pgmap v11305: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 384 KiB/s wr, 8 op/s 2023-05-08T09:35:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:53 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:35:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:35:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:35:53.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:53 smithi186 ceph-mon[126480]: pgmap v11305: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 384 KiB/s wr, 8 op/s 2023-05-08T09:35:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:53 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:35:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:35:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:35:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21093.046545 secs 2023-05-08T09:35:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21093.046545 secs 2023-05-08T09:35:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21093.046545 secs 2023-05-08T09:35:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21093.602197 secs 2023-05-08T09:35:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:55 smithi133 ceph-mon[125939]: pgmap v11306: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 587 KiB/s rd, 574 KiB/s wr, 13 op/s 2023-05-08T09:35:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:55 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:35:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21093.602197 secs 2023-05-08T09:35:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:55 smithi096 ceph-mon[124666]: pgmap v11306: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 587 KiB/s rd, 574 KiB/s wr, 13 op/s 2023-05-08T09:35:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:55 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:35:55.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21093.602197 secs 2023-05-08T09:35:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:55 smithi186 ceph-mon[126480]: pgmap v11306: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 587 KiB/s rd, 574 KiB/s wr, 13 op/s 2023-05-08T09:35:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:55 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:35:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:35:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:35:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:35:56.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:35:56.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:35:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:35:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:57 smithi133 ceph-mon[125939]: pgmap v11307: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 493 KiB/s wr, 10 op/s 2023-05-08T09:35:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:35:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:35:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:57 smithi096 ceph-mon[124666]: pgmap v11307: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 493 KiB/s wr, 10 op/s 2023-05-08T09:35:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:35:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:35:57.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:57 smithi186 ceph-mon[126480]: pgmap v11307: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 493 KiB/s wr, 10 op/s 2023-05-08T09:35:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:35:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:35:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21098.046644 secs 2023-05-08T09:35:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:35:59 smithi133 ceph-mon[125939]: pgmap v11308: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 493 KiB/s wr, 10 op/s 2023-05-08T09:35:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21098.046644 secs 2023-05-08T09:35:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:35:59 smithi096 ceph-mon[124666]: pgmap v11308: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 493 KiB/s wr, 10 op/s 2023-05-08T09:35:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21098.046644 secs 2023-05-08T09:35:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:35:59 smithi186 ceph-mon[126480]: pgmap v11308: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 493 KiB/s wr, 10 op/s 2023-05-08T09:36:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:00 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:36:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:00 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:36:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:00 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:36:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:01 smithi133 ceph-mon[125939]: pgmap v11309: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 675 KiB/s rd, 673 KiB/s wr, 15 op/s 2023-05-08T09:36:01.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:01 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:36:01.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:36:01.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:36:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:01 smithi096 ceph-mon[124666]: pgmap v11309: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 675 KiB/s rd, 673 KiB/s wr, 15 op/s 2023-05-08T09:36:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:01 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:36:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:36:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:36:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:01 smithi186 ceph-mon[126480]: pgmap v11309: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 675 KiB/s rd, 673 KiB/s wr, 15 op/s 2023-05-08T09:36:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:01 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:36:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:36:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:36:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:03 smithi133 ceph-mon[125939]: pgmap v11310: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 381 KiB/s wr, 11 op/s 2023-05-08T09:36:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:03 smithi096 ceph-mon[124666]: pgmap v11310: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 381 KiB/s wr, 11 op/s 2023-05-08T09:36:03.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:03 smithi186 ceph-mon[126480]: pgmap v11310: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 381 KiB/s wr, 11 op/s 2023-05-08T09:36:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21103.046764 secs 2023-05-08T09:36:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21103.046764 secs 2023-05-08T09:36:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21103.046764 secs 2023-05-08T09:36:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21103.602437 secs 2023-05-08T09:36:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:05 smithi096 ceph-mon[124666]: pgmap v11311: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 533 KiB/s rd, 556 KiB/s wr, 30 op/s 2023-05-08T09:36:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21103.602437 secs 2023-05-08T09:36:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:05 smithi186 ceph-mon[126480]: pgmap v11311: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 533 KiB/s rd, 556 KiB/s wr, 30 op/s 2023-05-08T09:36:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21103.602437 secs 2023-05-08T09:36:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:05 smithi133 ceph-mon[125939]: pgmap v11311: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 533 KiB/s rd, 556 KiB/s wr, 30 op/s 2023-05-08T09:36:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21104.889495 secs 2023-05-08T09:36:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:06 smithi096 ceph-mon[124666]: osdmap e784: 12 total, 12 up, 12 in 2023-05-08T09:36:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21104.889495 secs 2023-05-08T09:36:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:06 smithi186 ceph-mon[126480]: osdmap e784: 12 total, 12 up, 12 in 2023-05-08T09:36:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21104.889495 secs 2023-05-08T09:36:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:06 smithi133 ceph-mon[125939]: osdmap e784: 12 total, 12 up, 12 in 2023-05-08T09:36:07.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:07 smithi186 ceph-mon[126480]: pgmap v11313: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 386 KiB/s rd, 427 KiB/s wr, 29 op/s 2023-05-08T09:36:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:07 smithi133 ceph-mon[125939]: pgmap v11313: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 386 KiB/s rd, 427 KiB/s wr, 29 op/s 2023-05-08T09:36:08.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:07 smithi096 ceph-mon[124666]: pgmap v11313: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 386 KiB/s rd, 427 KiB/s wr, 29 op/s 2023-05-08T09:36:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:08 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:36:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:36:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:36:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:36:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:08 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:36:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:36:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:36:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:36:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:08 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:36:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:36:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:36:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:36:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21108.046894 secs 2023-05-08T09:36:09.889 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:09 smithi186 ceph-mon[126480]: pgmap v11314: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 386 KiB/s rd, 427 KiB/s wr, 29 op/s 2023-05-08T09:36:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21108.046894 secs 2023-05-08T09:36:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:09 smithi133 ceph-mon[125939]: pgmap v11314: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 386 KiB/s rd, 427 KiB/s wr, 29 op/s 2023-05-08T09:36:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21108.046894 secs 2023-05-08T09:36:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:09 smithi096 ceph-mon[124666]: pgmap v11314: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 386 KiB/s rd, 427 KiB/s wr, 29 op/s 2023-05-08T09:36:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21108.602541 secs 2023-05-08T09:36:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21108.602541 secs 2023-05-08T09:36:11.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21108.602541 secs 2023-05-08T09:36:11.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21109.889637 secs 2023-05-08T09:36:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:11 smithi186 ceph-mon[126480]: pgmap v11315: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 304 KiB/s wr, 28 op/s 2023-05-08T09:36:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:11 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:36:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21109.889637 secs 2023-05-08T09:36:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:11 smithi133 ceph-mon[125939]: pgmap v11315: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 304 KiB/s wr, 28 op/s 2023-05-08T09:36:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:11 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:36:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21109.889637 secs 2023-05-08T09:36:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:11 smithi096 ceph-mon[124666]: pgmap v11315: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 304 KiB/s wr, 28 op/s 2023-05-08T09:36:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:11 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:36:12.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:12 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:36:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:12 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:36:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:12 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:36:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:12 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:36:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:12 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T09:36:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:12 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T09:36:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:12 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:36:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:12 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:36:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:12 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:36:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:12 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:36:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:12 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:36:12.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:12 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T09:36:12.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:12 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T09:36:12.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:12 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:36:13.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:12 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:36:13.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:12 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:36:13.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:12 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:36:13.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:12 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:36:13.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:12 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T09:36:13.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:12 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T09:36:13.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:12 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:36:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:13 smithi186 ceph-mon[126480]: pgmap v11316: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 304 KiB/s wr, 28 op/s 2023-05-08T09:36:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:13 smithi186 ceph-mon[126480]: osdmap e785: 12 total, 12 up, 12 in 2023-05-08T09:36:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:13 smithi133 ceph-mon[125939]: pgmap v11316: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 304 KiB/s wr, 28 op/s 2023-05-08T09:36:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:13 smithi133 ceph-mon[125939]: osdmap e785: 12 total, 12 up, 12 in 2023-05-08T09:36:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:13 smithi096 ceph-mon[124666]: pgmap v11316: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 304 KiB/s wr, 28 op/s 2023-05-08T09:36:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:13 smithi096 ceph-mon[124666]: osdmap e785: 12 total, 12 up, 12 in 2023-05-08T09:36:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21113.047039 secs 2023-05-08T09:36:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21113.602640 secs 2023-05-08T09:36:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21113.047039 secs 2023-05-08T09:36:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21113.602640 secs 2023-05-08T09:36:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21113.047039 secs 2023-05-08T09:36:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21113.602640 secs 2023-05-08T09:36:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:15 smithi186 ceph-mon[126480]: pgmap v11318: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 180 KiB/s wr, 9 op/s 2023-05-08T09:36:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:15 smithi133 ceph-mon[125939]: pgmap v11318: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 180 KiB/s wr, 9 op/s 2023-05-08T09:36:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:15 smithi096 ceph-mon[124666]: pgmap v11318: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 180 KiB/s wr, 9 op/s 2023-05-08T09:36:17.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21114.889752 secs 2023-05-08T09:36:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21114.889752 secs 2023-05-08T09:36:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21114.889752 secs 2023-05-08T09:36:18.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:17 smithi186 ceph-mon[126480]: pgmap v11319: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 159 KiB/s wr, 8 op/s 2023-05-08T09:36:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:17 smithi133 ceph-mon[125939]: pgmap v11319: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 159 KiB/s wr, 8 op/s 2023-05-08T09:36:18.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:17 smithi096 ceph-mon[124666]: pgmap v11319: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 159 KiB/s wr, 8 op/s 2023-05-08T09:36:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21118.047190 secs 2023-05-08T09:36:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:19 smithi186 ceph-mon[126480]: pgmap v11320: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 159 KiB/s wr, 8 op/s 2023-05-08T09:36:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21118.602766 secs 2023-05-08T09:36:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21118.047190 secs 2023-05-08T09:36:20.272 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:19 smithi133 ceph-mon[125939]: pgmap v11320: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 159 KiB/s wr, 8 op/s 2023-05-08T09:36:20.272 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21118.602766 secs 2023-05-08T09:36:20.273 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21118.047190 secs 2023-05-08T09:36:20.274 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:19 smithi096 ceph-mon[124666]: pgmap v11320: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 159 KiB/s wr, 8 op/s 2023-05-08T09:36:20.275 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21118.602766 secs 2023-05-08T09:36:22.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21119.889893 secs 2023-05-08T09:36:22.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:21 smithi186 ceph-mon[126480]: pgmap v11321: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 66 KiB/s wr, 6 op/s 2023-05-08T09:36:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21119.889893 secs 2023-05-08T09:36:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:21 smithi133 ceph-mon[125939]: pgmap v11321: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 66 KiB/s wr, 6 op/s 2023-05-08T09:36:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21119.889893 secs 2023-05-08T09:36:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:21 smithi096 ceph-mon[124666]: pgmap v11321: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 66 KiB/s wr, 6 op/s 2023-05-08T09:36:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:23 smithi186 ceph-mon[126480]: pgmap v11322: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 66 KiB/s wr, 6 op/s 2023-05-08T09:36:24.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:23 smithi133 ceph-mon[125939]: pgmap v11322: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 66 KiB/s wr, 6 op/s 2023-05-08T09:36:24.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:23 smithi096 ceph-mon[124666]: pgmap v11322: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 66 KiB/s wr, 6 op/s 2023-05-08T09:36:25.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21123.047323 secs 2023-05-08T09:36:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21123.602912 secs 2023-05-08T09:36:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21123.047323 secs 2023-05-08T09:36:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21123.602912 secs 2023-05-08T09:36:25.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21123.047323 secs 2023-05-08T09:36:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21123.602912 secs 2023-05-08T09:36:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:25 smithi186 ceph-mon[126480]: pgmap v11323: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 60 KiB/s wr, 9 op/s 2023-05-08T09:36:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:25 smithi133 ceph-mon[125939]: pgmap v11323: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 60 KiB/s wr, 9 op/s 2023-05-08T09:36:26.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:25 smithi096 ceph-mon[124666]: pgmap v11323: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 60 KiB/s wr, 9 op/s 2023-05-08T09:36:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21124.890009 secs 2023-05-08T09:36:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21124.890009 secs 2023-05-08T09:36:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21124.890009 secs 2023-05-08T09:36:28.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:27 smithi186 ceph-mon[126480]: pgmap v11324: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2023-05-08T09:36:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:27 smithi133 ceph-mon[125939]: pgmap v11324: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2023-05-08T09:36:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:27 smithi096 ceph-mon[124666]: pgmap v11324: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2023-05-08T09:36:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21128.047439 secs 2023-05-08T09:36:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:29 smithi186 ceph-mon[126480]: pgmap v11325: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2023-05-08T09:36:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21128.603053 secs 2023-05-08T09:36:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21128.047439 secs 2023-05-08T09:36:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:29 smithi133 ceph-mon[125939]: pgmap v11325: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2023-05-08T09:36:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21128.603053 secs 2023-05-08T09:36:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21128.047439 secs 2023-05-08T09:36:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:29 smithi096 ceph-mon[124666]: pgmap v11325: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2023-05-08T09:36:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21128.603053 secs 2023-05-08T09:36:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21129.890128 secs 2023-05-08T09:36:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:31 smithi186 ceph-mon[126480]: pgmap v11326: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 72 KiB/s wr, 9 op/s 2023-05-08T09:36:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21129.890128 secs 2023-05-08T09:36:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:31 smithi133 ceph-mon[125939]: pgmap v11326: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 72 KiB/s wr, 9 op/s 2023-05-08T09:36:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21129.890128 secs 2023-05-08T09:36:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:31 smithi096 ceph-mon[124666]: pgmap v11326: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 72 KiB/s wr, 9 op/s 2023-05-08T09:36:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:33 smithi186 ceph-mon[126480]: pgmap v11327: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 72 KiB/s wr, 6 op/s 2023-05-08T09:36:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:33 smithi133 ceph-mon[125939]: pgmap v11327: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 72 KiB/s wr, 6 op/s 2023-05-08T09:36:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:33 smithi096 ceph-mon[124666]: pgmap v11327: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 72 KiB/s wr, 6 op/s 2023-05-08T09:36:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21133.047503 secs 2023-05-08T09:36:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21133.603188 secs 2023-05-08T09:36:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21133.047503 secs 2023-05-08T09:36:35.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21133.603188 secs 2023-05-08T09:36:35.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21133.047503 secs 2023-05-08T09:36:35.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21133.603188 secs 2023-05-08T09:36:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:35 smithi186 ceph-mon[126480]: pgmap v11328: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 73 KiB/s wr, 10 op/s 2023-05-08T09:36:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:35 smithi133 ceph-mon[125939]: pgmap v11328: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 73 KiB/s wr, 10 op/s 2023-05-08T09:36:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:35 smithi096 ceph-mon[124666]: pgmap v11328: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 73 KiB/s wr, 10 op/s 2023-05-08T09:36:37.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21134.890248 secs 2023-05-08T09:36:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21134.890248 secs 2023-05-08T09:36:37.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21134.890248 secs 2023-05-08T09:36:38.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:37 smithi186 ceph-mon[126480]: pgmap v11329: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 72 KiB/s wr, 7 op/s 2023-05-08T09:36:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:37 smithi133 ceph-mon[125939]: pgmap v11329: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 72 KiB/s wr, 7 op/s 2023-05-08T09:36:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:37 smithi096 ceph-mon[124666]: pgmap v11329: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 72 KiB/s wr, 7 op/s 2023-05-08T09:36:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21138.047631 secs 2023-05-08T09:36:40.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:39 smithi133 ceph-mon[125939]: pgmap v11330: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 72 KiB/s wr, 7 op/s 2023-05-08T09:36:40.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21138.603318 secs 2023-05-08T09:36:40.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21138.047631 secs 2023-05-08T09:36:40.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:39 smithi096 ceph-mon[124666]: pgmap v11330: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 72 KiB/s wr, 7 op/s 2023-05-08T09:36:40.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21138.603318 secs 2023-05-08T09:36:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21138.047631 secs 2023-05-08T09:36:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:39 smithi186 ceph-mon[126480]: pgmap v11330: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 72 KiB/s wr, 7 op/s 2023-05-08T09:36:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21138.603318 secs 2023-05-08T09:36:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21139.890383 secs 2023-05-08T09:36:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:41 smithi133 ceph-mon[125939]: pgmap v11331: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 236 KiB/s wr, 10 op/s 2023-05-08T09:36:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21139.890383 secs 2023-05-08T09:36:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:41 smithi096 ceph-mon[124666]: pgmap v11331: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 236 KiB/s wr, 10 op/s 2023-05-08T09:36:42.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21139.890383 secs 2023-05-08T09:36:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:41 smithi186 ceph-mon[126480]: pgmap v11331: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 236 KiB/s wr, 10 op/s 2023-05-08T09:36:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:43 smithi133 ceph-mon[125939]: pgmap v11332: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 164 KiB/s wr, 7 op/s 2023-05-08T09:36:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:43 smithi096 ceph-mon[124666]: pgmap v11332: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 164 KiB/s wr, 7 op/s 2023-05-08T09:36:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:43 smithi186 ceph-mon[126480]: pgmap v11332: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 164 KiB/s wr, 7 op/s 2023-05-08T09:36:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21143.047751 secs 2023-05-08T09:36:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21143.047751 secs 2023-05-08T09:36:45.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21143.047751 secs 2023-05-08T09:36:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:45 smithi133 ceph-mon[125939]: pgmap v11333: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 183 KiB/s wr, 11 op/s 2023-05-08T09:36:46.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:45 smithi096 ceph-mon[124666]: pgmap v11333: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 183 KiB/s wr, 11 op/s 2023-05-08T09:36:46.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:45 smithi186 ceph-mon[126480]: pgmap v11333: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 183 KiB/s wr, 11 op/s 2023-05-08T09:36:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21144.890507 secs 2023-05-08T09:36:47.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21144.890507 secs 2023-05-08T09:36:47.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21144.890507 secs 2023-05-08T09:36:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:47 smithi133 ceph-mon[125939]: pgmap v11334: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 183 KiB/s wr, 8 op/s 2023-05-08T09:36:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:36:48.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:47 smithi096 ceph-mon[124666]: pgmap v11334: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 183 KiB/s wr, 8 op/s 2023-05-08T09:36:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:36:48.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:47 smithi186 ceph-mon[126480]: pgmap v11334: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 183 KiB/s wr, 8 op/s 2023-05-08T09:36:48.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:36:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:48 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:36:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:36:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:36:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:48 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:36:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:36:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:36:49.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:48 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:36:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:36:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:36:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21148.047878 secs 2023-05-08T09:36:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:49 smithi133 ceph-mon[125939]: pgmap v11335: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 183 KiB/s wr, 8 op/s 2023-05-08T09:36:50.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21148.047878 secs 2023-05-08T09:36:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:49 smithi096 ceph-mon[124666]: pgmap v11335: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 183 KiB/s wr, 8 op/s 2023-05-08T09:36:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21148.047878 secs 2023-05-08T09:36:50.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:49 smithi186 ceph-mon[126480]: pgmap v11335: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 183 KiB/s wr, 8 op/s 2023-05-08T09:36:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:51 smithi133 ceph-mon[125939]: pgmap v11336: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 549 KiB/s rd, 535 KiB/s wr, 13 op/s 2023-05-08T09:36:52.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:36:52.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:51 smithi096 ceph-mon[124666]: pgmap v11336: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 549 KiB/s rd, 535 KiB/s wr, 13 op/s 2023-05-08T09:36:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:36:52.373 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:51 smithi186 ceph-mon[126480]: pgmap v11336: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 549 KiB/s rd, 535 KiB/s wr, 13 op/s 2023-05-08T09:36:52.373 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:36:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:36:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:36:53.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:36:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:36:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:36:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:36:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:53 smithi133 ceph-mon[125939]: pgmap v11337: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 372 KiB/s wr, 10 op/s 2023-05-08T09:36:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:53 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:36:54.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:53 smithi096 ceph-mon[124666]: pgmap v11337: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 372 KiB/s wr, 10 op/s 2023-05-08T09:36:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:53 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:36:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:53 smithi186 ceph-mon[126480]: pgmap v11337: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 372 KiB/s wr, 10 op/s 2023-05-08T09:36:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:53 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:36:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21153.048001 secs 2023-05-08T09:36:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21153.603629 secs 2023-05-08T09:36:55.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21153.048001 secs 2023-05-08T09:36:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21153.603629 secs 2023-05-08T09:36:55.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21153.048001 secs 2023-05-08T09:36:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21153.603629 secs 2023-05-08T09:36:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:55 smithi133 ceph-mon[125939]: pgmap v11338: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 719 KiB/s rd, 500 KiB/s wr, 14 op/s 2023-05-08T09:36:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:55 smithi096 ceph-mon[124666]: pgmap v11338: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 719 KiB/s rd, 500 KiB/s wr, 14 op/s 2023-05-08T09:36:56.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:55 smithi186 ceph-mon[126480]: pgmap v11338: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 719 KiB/s rd, 500 KiB/s wr, 14 op/s 2023-05-08T09:36:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:36:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:36:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:36:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:36:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:36:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:36:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:57 smithi133 ceph-mon[125939]: pgmap v11339: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 535 KiB/s rd, 481 KiB/s wr, 10 op/s 2023-05-08T09:36:58.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:57 smithi096 ceph-mon[124666]: pgmap v11339: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 535 KiB/s rd, 481 KiB/s wr, 10 op/s 2023-05-08T09:36:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:57 smithi186 ceph-mon[126480]: pgmap v11339: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 535 KiB/s rd, 481 KiB/s wr, 10 op/s 2023-05-08T09:36:59.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:58 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:36:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:58 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:36:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:58 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:37:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21158.048112 secs 2023-05-08T09:37:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:59 smithi133 ceph-mon[125939]: pgmap v11340: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 481 KiB/s wr, 10 op/s 2023-05-08T09:37:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:36:59 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:37:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21158.048112 secs 2023-05-08T09:37:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:59 smithi096 ceph-mon[124666]: pgmap v11340: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 481 KiB/s wr, 10 op/s 2023-05-08T09:37:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:36:59 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:37:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21158.048112 secs 2023-05-08T09:37:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:59 smithi186 ceph-mon[126480]: pgmap v11340: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 481 KiB/s wr, 10 op/s 2023-05-08T09:37:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:36:59 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:37:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:37:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:37:01.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:37:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:37:01.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:37:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:37:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21159.890929 secs 2023-05-08T09:37:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:01 smithi133 ceph-mon[125939]: pgmap v11341: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 812 KiB/s rd, 813 KiB/s wr, 15 op/s 2023-05-08T09:37:02.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21159.890929 secs 2023-05-08T09:37:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:01 smithi096 ceph-mon[124666]: pgmap v11341: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 812 KiB/s rd, 813 KiB/s wr, 15 op/s 2023-05-08T09:37:02.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21159.890929 secs 2023-05-08T09:37:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:01 smithi186 ceph-mon[126480]: pgmap v11341: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 812 KiB/s rd, 813 KiB/s wr, 15 op/s 2023-05-08T09:37:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:03 smithi133 ceph-mon[125939]: pgmap v11342: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 460 KiB/s wr, 9 op/s 2023-05-08T09:37:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:03 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:37:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:03 smithi096 ceph-mon[124666]: pgmap v11342: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 460 KiB/s wr, 9 op/s 2023-05-08T09:37:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:03 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:37:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:03 smithi186 ceph-mon[126480]: pgmap v11342: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 460 KiB/s wr, 9 op/s 2023-05-08T09:37:04.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:03 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:37:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21163.048233 secs 2023-05-08T09:37:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21163.603852 secs 2023-05-08T09:37:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:04 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:37:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:04 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:37:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21163.048233 secs 2023-05-08T09:37:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21163.603852 secs 2023-05-08T09:37:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:04 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:37:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:04 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:37:05.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21163.048233 secs 2023-05-08T09:37:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21163.603852 secs 2023-05-08T09:37:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:04 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:37:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:04 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:37:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:05 smithi133 ceph-mon[125939]: pgmap v11343: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 597 KiB/s rd, 506 KiB/s wr, 28 op/s 2023-05-08T09:37:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:05 smithi096 ceph-mon[124666]: pgmap v11343: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 597 KiB/s rd, 506 KiB/s wr, 28 op/s 2023-05-08T09:37:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:05 smithi186 ceph-mon[126480]: pgmap v11343: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 597 KiB/s rd, 506 KiB/s wr, 28 op/s 2023-05-08T09:37:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21164.891065 secs 2023-05-08T09:37:07.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21164.891065 secs 2023-05-08T09:37:07.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21164.891065 secs 2023-05-08T09:37:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:07 smithi133 ceph-mon[125939]: pgmap v11344: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 425 KiB/s rd, 377 KiB/s wr, 23 op/s 2023-05-08T09:37:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:07 smithi096 ceph-mon[124666]: pgmap v11344: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 425 KiB/s rd, 377 KiB/s wr, 23 op/s 2023-05-08T09:37:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:07 smithi186 ceph-mon[126480]: pgmap v11344: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 425 KiB/s rd, 377 KiB/s wr, 23 op/s 2023-05-08T09:37:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:37:09.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:37:09.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:08 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:37:09.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:37:09.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:37:09.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:08 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:37:09.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:37:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:37:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:08 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:37:10.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21168.048297 secs 2023-05-08T09:37:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:09 smithi096 ceph-mon[124666]: pgmap v11345: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 425 KiB/s rd, 377 KiB/s wr, 23 op/s 2023-05-08T09:37:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21168.603967 secs 2023-05-08T09:37:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21168.048297 secs 2023-05-08T09:37:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:09 smithi186 ceph-mon[126480]: pgmap v11345: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 425 KiB/s rd, 377 KiB/s wr, 23 op/s 2023-05-08T09:37:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21168.603967 secs 2023-05-08T09:37:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21168.048297 secs 2023-05-08T09:37:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:09 smithi133 ceph-mon[125939]: pgmap v11345: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 425 KiB/s rd, 377 KiB/s wr, 23 op/s 2023-05-08T09:37:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21168.603967 secs 2023-05-08T09:37:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21169.891206 secs 2023-05-08T09:37:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:11 smithi096 ceph-mon[124666]: pgmap v11346: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 590 KiB/s rd, 541 KiB/s wr, 26 op/s 2023-05-08T09:37:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:11 smithi096 ceph-mon[124666]: osdmap e786: 12 total, 12 up, 12 in 2023-05-08T09:37:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:11 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:37:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21169.891206 secs 2023-05-08T09:37:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:11 smithi186 ceph-mon[126480]: pgmap v11346: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 590 KiB/s rd, 541 KiB/s wr, 26 op/s 2023-05-08T09:37:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:11 smithi186 ceph-mon[126480]: osdmap e786: 12 total, 12 up, 12 in 2023-05-08T09:37:12.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:11 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:37:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21169.891206 secs 2023-05-08T09:37:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:11 smithi133 ceph-mon[125939]: pgmap v11346: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 590 KiB/s rd, 541 KiB/s wr, 26 op/s 2023-05-08T09:37:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:11 smithi133 ceph-mon[125939]: osdmap e786: 12 total, 12 up, 12 in 2023-05-08T09:37:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:11 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:37:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:13 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:37:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:13 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:37:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:13 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:37:13.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:13 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:37:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:13 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:37:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:13 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:37:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:13 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:37:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:13 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:37:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:13 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:37:14.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:14 smithi186 ceph-mon[126480]: pgmap v11348: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 377 KiB/s rd, 251 KiB/s wr, 25 op/s 2023-05-08T09:37:14.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:14 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:37:14.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:14 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T09:37:14.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:14 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T09:37:14.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:14 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:37:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:14 smithi133 ceph-mon[125939]: pgmap v11348: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 377 KiB/s rd, 251 KiB/s wr, 25 op/s 2023-05-08T09:37:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:14 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:37:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:14 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T09:37:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:14 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T09:37:14.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:14 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:37:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:14 smithi096 ceph-mon[124666]: pgmap v11348: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 377 KiB/s rd, 251 KiB/s wr, 25 op/s 2023-05-08T09:37:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:14 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:37:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:14 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T09:37:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:14 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T09:37:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:14 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:37:15.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21173.048389 secs 2023-05-08T09:37:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21173.604083 secs 2023-05-08T09:37:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21173.048389 secs 2023-05-08T09:37:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21173.604083 secs 2023-05-08T09:37:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21173.048389 secs 2023-05-08T09:37:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21173.604083 secs 2023-05-08T09:37:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:16 smithi186 ceph-mon[126480]: pgmap v11349: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 211 KiB/s wr, 8 op/s 2023-05-08T09:37:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21174.891361 secs 2023-05-08T09:37:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:16 smithi133 ceph-mon[125939]: pgmap v11349: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 211 KiB/s wr, 8 op/s 2023-05-08T09:37:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21174.891361 secs 2023-05-08T09:37:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:16 smithi096 ceph-mon[124666]: pgmap v11349: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 211 KiB/s wr, 8 op/s 2023-05-08T09:37:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21174.891361 secs 2023-05-08T09:37:18.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:18 smithi186 ceph-mon[126480]: pgmap v11350: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 211 KiB/s wr, 8 op/s 2023-05-08T09:37:18.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:18 smithi133 ceph-mon[125939]: pgmap v11350: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 211 KiB/s wr, 8 op/s 2023-05-08T09:37:18.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:18 smithi096 ceph-mon[124666]: pgmap v11350: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 211 KiB/s wr, 8 op/s 2023-05-08T09:37:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21178.048532 secs 2023-05-08T09:37:19.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:19 smithi133 ceph-mon[125939]: pgmap v11351: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 211 KiB/s wr, 8 op/s 2023-05-08T09:37:19.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:19 smithi133 ceph-mon[125939]: osdmap e787: 12 total, 12 up, 12 in 2023-05-08T09:37:19.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21178.048532 secs 2023-05-08T09:37:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:19 smithi096 ceph-mon[124666]: pgmap v11351: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 211 KiB/s wr, 8 op/s 2023-05-08T09:37:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:19 smithi096 ceph-mon[124666]: osdmap e787: 12 total, 12 up, 12 in 2023-05-08T09:37:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21178.048532 secs 2023-05-08T09:37:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:19 smithi186 ceph-mon[126480]: pgmap v11351: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 211 KiB/s wr, 8 op/s 2023-05-08T09:37:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:19 smithi186 ceph-mon[126480]: osdmap e787: 12 total, 12 up, 12 in 2023-05-08T09:37:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21178.604197 secs 2023-05-08T09:37:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21178.604197 secs 2023-05-08T09:37:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21178.604197 secs 2023-05-08T09:37:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21179.891497 secs 2023-05-08T09:37:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:21 smithi133 ceph-mon[125939]: pgmap v11353: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 88 KiB/s wr, 9 op/s 2023-05-08T09:37:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21179.891497 secs 2023-05-08T09:37:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:21 smithi096 ceph-mon[124666]: pgmap v11353: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 88 KiB/s wr, 9 op/s 2023-05-08T09:37:21.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21179.891497 secs 2023-05-08T09:37:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:21 smithi186 ceph-mon[126480]: pgmap v11353: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 88 KiB/s wr, 9 op/s 2023-05-08T09:37:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:23 smithi133 ceph-mon[125939]: pgmap v11354: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 82 KiB/s wr, 9 op/s 2023-05-08T09:37:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:23 smithi096 ceph-mon[124666]: pgmap v11354: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 82 KiB/s wr, 9 op/s 2023-05-08T09:37:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:23 smithi186 ceph-mon[126480]: pgmap v11354: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 82 KiB/s wr, 9 op/s 2023-05-08T09:37:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21183.048657 secs 2023-05-08T09:37:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21183.048657 secs 2023-05-08T09:37:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21183.048657 secs 2023-05-08T09:37:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21183.604335 secs 2023-05-08T09:37:25.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:25 smithi133 ceph-mon[125939]: pgmap v11355: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 68 KiB/s wr, 8 op/s 2023-05-08T09:37:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21183.604335 secs 2023-05-08T09:37:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:25 smithi096 ceph-mon[124666]: pgmap v11355: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 68 KiB/s wr, 8 op/s 2023-05-08T09:37:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21183.604335 secs 2023-05-08T09:37:25.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:25 smithi186 ceph-mon[126480]: pgmap v11355: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 68 KiB/s wr, 8 op/s 2023-05-08T09:37:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21184.891597 secs 2023-05-08T09:37:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21184.891597 secs 2023-05-08T09:37:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21184.891597 secs 2023-05-08T09:37:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:27 smithi133 ceph-mon[125939]: pgmap v11356: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 68 KiB/s wr, 8 op/s 2023-05-08T09:37:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:27 smithi096 ceph-mon[124666]: pgmap v11356: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 68 KiB/s wr, 8 op/s 2023-05-08T09:37:27.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:27 smithi186 ceph-mon[126480]: pgmap v11356: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 68 KiB/s wr, 8 op/s 2023-05-08T09:37:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21188.048770 secs 2023-05-08T09:37:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:29 smithi133 ceph-mon[125939]: pgmap v11357: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 68 KiB/s wr, 8 op/s 2023-05-08T09:37:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21188.048770 secs 2023-05-08T09:37:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:29 smithi096 ceph-mon[124666]: pgmap v11357: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 68 KiB/s wr, 8 op/s 2023-05-08T09:37:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21188.048770 secs 2023-05-08T09:37:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:29 smithi186 ceph-mon[126480]: pgmap v11357: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 68 KiB/s wr, 8 op/s 2023-05-08T09:37:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21188.604483 secs 2023-05-08T09:37:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21188.604483 secs 2023-05-08T09:37:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21188.604483 secs 2023-05-08T09:37:31.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21189.891738 secs 2023-05-08T09:37:31.744 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:31 smithi133 ceph-mon[125939]: pgmap v11358: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 126 KiB/s wr, 10 op/s 2023-05-08T09:37:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21189.891738 secs 2023-05-08T09:37:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:31 smithi096 ceph-mon[124666]: pgmap v11358: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 126 KiB/s wr, 10 op/s 2023-05-08T09:37:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21189.891738 secs 2023-05-08T09:37:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:31 smithi186 ceph-mon[126480]: pgmap v11358: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 126 KiB/s wr, 10 op/s 2023-05-08T09:37:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:33 smithi133 ceph-mon[125939]: pgmap v11359: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 70 KiB/s wr, 6 op/s 2023-05-08T09:37:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:33 smithi096 ceph-mon[124666]: pgmap v11359: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 70 KiB/s wr, 6 op/s 2023-05-08T09:37:33.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:33 smithi186 ceph-mon[126480]: pgmap v11359: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 70 KiB/s wr, 6 op/s 2023-05-08T09:37:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21193.048891 secs 2023-05-08T09:37:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21193.048891 secs 2023-05-08T09:37:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21193.048891 secs 2023-05-08T09:37:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21193.604556 secs 2023-05-08T09:37:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:35 smithi133 ceph-mon[125939]: pgmap v11360: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 70 KiB/s wr, 9 op/s 2023-05-08T09:37:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21193.604556 secs 2023-05-08T09:37:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:35 smithi096 ceph-mon[124666]: pgmap v11360: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 70 KiB/s wr, 9 op/s 2023-05-08T09:37:35.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21193.604556 secs 2023-05-08T09:37:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:35 smithi186 ceph-mon[126480]: pgmap v11360: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 70 KiB/s wr, 9 op/s 2023-05-08T09:37:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21194.891865 secs 2023-05-08T09:37:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21194.891865 secs 2023-05-08T09:37:36.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21194.891865 secs 2023-05-08T09:37:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:37 smithi133 ceph-mon[125939]: pgmap v11361: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 70 KiB/s wr, 6 op/s 2023-05-08T09:37:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:37 smithi096 ceph-mon[124666]: pgmap v11361: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 70 KiB/s wr, 6 op/s 2023-05-08T09:37:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:37 smithi186 ceph-mon[126480]: pgmap v11361: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 70 KiB/s wr, 6 op/s 2023-05-08T09:37:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21198.049006 secs 2023-05-08T09:37:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:39 smithi133 ceph-mon[125939]: pgmap v11362: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 70 KiB/s wr, 6 op/s 2023-05-08T09:37:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21198.049006 secs 2023-05-08T09:37:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:39 smithi096 ceph-mon[124666]: pgmap v11362: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 70 KiB/s wr, 6 op/s 2023-05-08T09:37:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21198.049006 secs 2023-05-08T09:37:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:39 smithi186 ceph-mon[126480]: pgmap v11362: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 70 KiB/s wr, 6 op/s 2023-05-08T09:37:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21198.604629 secs 2023-05-08T09:37:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21198.604629 secs 2023-05-08T09:37:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21198.604629 secs 2023-05-08T09:37:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21199.892018 secs 2023-05-08T09:37:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:41 smithi133 ceph-mon[125939]: pgmap v11363: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 151 KiB/s wr, 9 op/s 2023-05-08T09:37:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21199.892018 secs 2023-05-08T09:37:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:41 smithi096 ceph-mon[124666]: pgmap v11363: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 151 KiB/s wr, 9 op/s 2023-05-08T09:37:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21199.892018 secs 2023-05-08T09:37:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:41 smithi186 ceph-mon[126480]: pgmap v11363: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 151 KiB/s wr, 9 op/s 2023-05-08T09:37:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:43 smithi133 ceph-mon[125939]: pgmap v11364: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 82 KiB/s wr, 6 op/s 2023-05-08T09:37:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:43 smithi096 ceph-mon[124666]: pgmap v11364: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 82 KiB/s wr, 6 op/s 2023-05-08T09:37:43.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:43 smithi186 ceph-mon[126480]: pgmap v11364: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 82 KiB/s wr, 6 op/s 2023-05-08T09:37:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21203.049121 secs 2023-05-08T09:37:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21203.049121 secs 2023-05-08T09:37:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21203.049121 secs 2023-05-08T09:37:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:45 smithi133 ceph-mon[125939]: pgmap v11365: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 113 KiB/s wr, 10 op/s 2023-05-08T09:37:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:45 smithi096 ceph-mon[124666]: pgmap v11365: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 113 KiB/s wr, 10 op/s 2023-05-08T09:37:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:45 smithi186 ceph-mon[126480]: pgmap v11365: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 113 KiB/s wr, 10 op/s 2023-05-08T09:37:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21204.892160 secs 2023-05-08T09:37:46.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21204.892160 secs 2023-05-08T09:37:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21204.892160 secs 2023-05-08T09:37:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:47 smithi133 ceph-mon[125939]: pgmap v11366: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 307 KiB/s wr, 7 op/s 2023-05-08T09:37:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:47 smithi096 ceph-mon[124666]: pgmap v11366: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 307 KiB/s wr, 7 op/s 2023-05-08T09:37:47.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:47 smithi186 ceph-mon[126480]: pgmap v11366: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 307 KiB/s wr, 7 op/s 2023-05-08T09:37:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:37:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:37:48.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:37:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21208.049239 secs 2023-05-08T09:37:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:49 smithi096 ceph-mon[124666]: pgmap v11367: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 307 KiB/s wr, 7 op/s 2023-05-08T09:37:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:37:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:37:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:37:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21208.049239 secs 2023-05-08T09:37:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:49 smithi186 ceph-mon[126480]: pgmap v11367: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 307 KiB/s wr, 7 op/s 2023-05-08T09:37:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:37:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:37:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:37:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21208.049239 secs 2023-05-08T09:37:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:49 smithi133 ceph-mon[125939]: pgmap v11367: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 307 KiB/s wr, 7 op/s 2023-05-08T09:37:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:37:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:37:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:37:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:51 smithi096 ceph-mon[124666]: pgmap v11368: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 320 KiB/s wr, 12 op/s 2023-05-08T09:37:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:37:51.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:51 smithi186 ceph-mon[126480]: pgmap v11368: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 320 KiB/s wr, 12 op/s 2023-05-08T09:37:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:37:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:51 smithi133 ceph-mon[125939]: pgmap v11368: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 320 KiB/s wr, 12 op/s 2023-05-08T09:37:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:37:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:37:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:37:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:37:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:37:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:37:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:37:53.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:53 smithi096 ceph-mon[124666]: pgmap v11369: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 386 KiB/s wr, 10 op/s 2023-05-08T09:37:53.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:53 smithi186 ceph-mon[126480]: pgmap v11369: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 386 KiB/s wr, 10 op/s 2023-05-08T09:37:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:53 smithi133 ceph-mon[125939]: pgmap v11369: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 386 KiB/s wr, 10 op/s 2023-05-08T09:37:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21213.049378 secs 2023-05-08T09:37:55.063 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21213.049378 secs 2023-05-08T09:37:55.064 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21213.049378 secs 2023-05-08T09:37:55.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21213.604853 secs 2023-05-08T09:37:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:55 smithi186 ceph-mon[126480]: pgmap v11370: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 537 KiB/s rd, 398 KiB/s wr, 14 op/s 2023-05-08T09:37:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21213.604853 secs 2023-05-08T09:37:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:55 smithi133 ceph-mon[125939]: pgmap v11370: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 537 KiB/s rd, 398 KiB/s wr, 14 op/s 2023-05-08T09:37:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21213.604853 secs 2023-05-08T09:37:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:55 smithi096 ceph-mon[124666]: pgmap v11370: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 537 KiB/s rd, 398 KiB/s wr, 14 op/s 2023-05-08T09:37:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:56 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:37:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:37:56.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:37:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:56 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:37:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:37:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:37:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:56 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:37:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:37:57.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:37:57.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:57 smithi186 ceph-mon[126480]: pgmap v11371: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 539 KiB/s wr, 10 op/s 2023-05-08T09:37:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:57 smithi133 ceph-mon[125939]: pgmap v11371: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 539 KiB/s wr, 10 op/s 2023-05-08T09:37:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:57 smithi096 ceph-mon[124666]: pgmap v11371: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 539 KiB/s wr, 10 op/s 2023-05-08T09:37:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21218.049454 secs 2023-05-08T09:37:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:37:59 smithi186 ceph-mon[126480]: pgmap v11372: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 344 KiB/s wr, 10 op/s 2023-05-08T09:37:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21218.049454 secs 2023-05-08T09:37:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:37:59 smithi133 ceph-mon[125939]: pgmap v11372: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 344 KiB/s wr, 10 op/s 2023-05-08T09:38:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21218.049454 secs 2023-05-08T09:38:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:37:59 smithi096 ceph-mon[124666]: pgmap v11372: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 344 KiB/s wr, 10 op/s 2023-05-08T09:38:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21218.604965 secs 2023-05-08T09:38:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21218.604965 secs 2023-05-08T09:38:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21218.604965 secs 2023-05-08T09:38:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:01 smithi186 ceph-mon[126480]: pgmap v11373: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 584 KiB/s rd, 357 KiB/s wr, 13 op/s 2023-05-08T09:38:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:01 smithi133 ceph-mon[125939]: pgmap v11373: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 584 KiB/s rd, 357 KiB/s wr, 13 op/s 2023-05-08T09:38:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:01 smithi096 ceph-mon[124666]: pgmap v11373: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 584 KiB/s rd, 357 KiB/s wr, 13 op/s 2023-05-08T09:38:03.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:03 smithi186 ceph-mon[126480]: pgmap v11374: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 852 KiB/s rd, 463 KiB/s wr, 10 op/s 2023-05-08T09:38:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:03 smithi133 ceph-mon[125939]: pgmap v11374: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 852 KiB/s rd, 463 KiB/s wr, 10 op/s 2023-05-08T09:38:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:03 smithi096 ceph-mon[124666]: pgmap v11374: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 852 KiB/s rd, 463 KiB/s wr, 10 op/s 2023-05-08T09:38:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21223.049568 secs 2023-05-08T09:38:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21223.049568 secs 2023-05-08T09:38:05.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21223.049568 secs 2023-05-08T09:38:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21223.605096 secs 2023-05-08T09:38:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:05 smithi186 ceph-mon[126480]: pgmap v11375: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 588 KiB/s rd, 387 KiB/s wr, 27 op/s 2023-05-08T09:38:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21223.605096 secs 2023-05-08T09:38:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:05 smithi133 ceph-mon[125939]: pgmap v11375: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 588 KiB/s rd, 387 KiB/s wr, 27 op/s 2023-05-08T09:38:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21223.605096 secs 2023-05-08T09:38:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:05 smithi096 ceph-mon[124666]: pgmap v11375: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 588 KiB/s rd, 387 KiB/s wr, 27 op/s 2023-05-08T09:38:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21224.892663 secs 2023-05-08T09:38:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:06 smithi186 ceph-mon[126480]: osdmap e788: 12 total, 12 up, 12 in 2023-05-08T09:38:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21224.892663 secs 2023-05-08T09:38:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:06 smithi133 ceph-mon[125939]: osdmap e788: 12 total, 12 up, 12 in 2023-05-08T09:38:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21224.892663 secs 2023-05-08T09:38:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:06 smithi096 ceph-mon[124666]: osdmap e788: 12 total, 12 up, 12 in 2023-05-08T09:38:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:07 smithi186 ceph-mon[126480]: pgmap v11377: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 306 KiB/s wr, 28 op/s 2023-05-08T09:38:07.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:07 smithi133 ceph-mon[125939]: pgmap v11377: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 306 KiB/s wr, 28 op/s 2023-05-08T09:38:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:07 smithi096 ceph-mon[124666]: pgmap v11377: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 306 KiB/s wr, 28 op/s 2023-05-08T09:38:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:08 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:38:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:38:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:38:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:08 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:38:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:38:08.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:38:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:08 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:38:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:38:09.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:38:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21228.049683 secs 2023-05-08T09:38:09.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:09 smithi186 ceph-mon[126480]: pgmap v11378: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 306 KiB/s wr, 28 op/s 2023-05-08T09:38:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21228.049683 secs 2023-05-08T09:38:09.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:09 smithi133 ceph-mon[125939]: pgmap v11378: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 306 KiB/s wr, 28 op/s 2023-05-08T09:38:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21228.049683 secs 2023-05-08T09:38:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:09 smithi096 ceph-mon[124666]: pgmap v11378: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 306 KiB/s wr, 28 op/s 2023-05-08T09:38:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21228.605229 secs 2023-05-08T09:38:11.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21228.605229 secs 2023-05-08T09:38:11.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21228.605229 secs 2023-05-08T09:38:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21229.892796 secs 2023-05-08T09:38:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:11 smithi133 ceph-mon[125939]: pgmap v11379: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 789 KiB/s rd, 577 KiB/s wr, 29 op/s 2023-05-08T09:38:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21229.892796 secs 2023-05-08T09:38:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:11 smithi096 ceph-mon[124666]: pgmap v11379: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 789 KiB/s rd, 577 KiB/s wr, 29 op/s 2023-05-08T09:38:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21229.892796 secs 2023-05-08T09:38:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:11 smithi186 ceph-mon[126480]: pgmap v11379: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 789 KiB/s rd, 577 KiB/s wr, 29 op/s 2023-05-08T09:38:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:13 smithi133 ceph-mon[125939]: pgmap v11380: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 397 KiB/s rd, 435 KiB/s wr, 27 op/s 2023-05-08T09:38:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:13 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:38:13.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:13 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:38:13.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:13 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:38:13.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:13 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:38:13.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:13 smithi133 ceph-mon[125939]: osdmap e789: 12 total, 12 up, 12 in 2023-05-08T09:38:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:13 smithi096 ceph-mon[124666]: pgmap v11380: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 397 KiB/s rd, 435 KiB/s wr, 27 op/s 2023-05-08T09:38:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:13 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:38:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:13 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:38:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:13 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:38:14.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:13 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:38:14.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:13 smithi096 ceph-mon[124666]: osdmap e789: 12 total, 12 up, 12 in 2023-05-08T09:38:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:13 smithi186 ceph-mon[126480]: pgmap v11380: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 397 KiB/s rd, 435 KiB/s wr, 27 op/s 2023-05-08T09:38:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:13 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:38:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:13 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:38:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:13 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:38:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:13 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:38:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:13 smithi186 ceph-mon[126480]: osdmap e789: 12 total, 12 up, 12 in 2023-05-08T09:38:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21233.049797 secs 2023-05-08T09:38:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:14 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:38:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:14 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T09:38:14.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:14 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T09:38:14.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:14 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:38:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21233.049797 secs 2023-05-08T09:38:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:14 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:38:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:14 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T09:38:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:14 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T09:38:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:14 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:38:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21233.049797 secs 2023-05-08T09:38:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:14 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:38:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:14 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T09:38:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:14 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T09:38:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:14 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:38:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21233.605376 secs 2023-05-08T09:38:15.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:15 smithi133 ceph-mon[125939]: pgmap v11382: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 343 KiB/s wr, 10 op/s 2023-05-08T09:38:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21233.605376 secs 2023-05-08T09:38:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:15 smithi096 ceph-mon[124666]: pgmap v11382: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 343 KiB/s wr, 10 op/s 2023-05-08T09:38:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21233.605376 secs 2023-05-08T09:38:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:15 smithi186 ceph-mon[126480]: pgmap v11382: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 343 KiB/s wr, 10 op/s 2023-05-08T09:38:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21234.892917 secs 2023-05-08T09:38:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21234.892917 secs 2023-05-08T09:38:17.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21234.892917 secs 2023-05-08T09:38:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:17 smithi133 ceph-mon[125939]: pgmap v11383: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 302 KiB/s wr, 9 op/s 2023-05-08T09:38:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:17 smithi096 ceph-mon[124666]: pgmap v11383: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 302 KiB/s wr, 9 op/s 2023-05-08T09:38:18.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:17 smithi186 ceph-mon[126480]: pgmap v11383: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 302 KiB/s wr, 9 op/s 2023-05-08T09:38:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21238.049944 secs 2023-05-08T09:38:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:19 smithi133 ceph-mon[125939]: pgmap v11384: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 302 KiB/s wr, 9 op/s 2023-05-08T09:38:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21238.049944 secs 2023-05-08T09:38:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:19 smithi096 ceph-mon[124666]: pgmap v11384: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 302 KiB/s wr, 9 op/s 2023-05-08T09:38:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21238.049944 secs 2023-05-08T09:38:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:19 smithi186 ceph-mon[126480]: pgmap v11384: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 302 KiB/s wr, 9 op/s 2023-05-08T09:38:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21238.605516 secs 2023-05-08T09:38:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21238.605516 secs 2023-05-08T09:38:21.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21238.605516 secs 2023-05-08T09:38:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21239.893033 secs 2023-05-08T09:38:21.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:21 smithi133 ceph-mon[125939]: pgmap v11385: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 96 KiB/s wr, 9 op/s 2023-05-08T09:38:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21239.893033 secs 2023-05-08T09:38:22.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:21 smithi096 ceph-mon[124666]: pgmap v11385: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 96 KiB/s wr, 9 op/s 2023-05-08T09:38:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21239.893033 secs 2023-05-08T09:38:22.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:21 smithi186 ceph-mon[126480]: pgmap v11385: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 96 KiB/s wr, 9 op/s 2023-05-08T09:38:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:23 smithi133 ceph-mon[125939]: pgmap v11386: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 96 KiB/s wr, 9 op/s 2023-05-08T09:38:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:23 smithi096 ceph-mon[124666]: pgmap v11386: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 96 KiB/s wr, 9 op/s 2023-05-08T09:38:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:23 smithi186 ceph-mon[126480]: pgmap v11386: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 96 KiB/s wr, 9 op/s 2023-05-08T09:38:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21243.050080 secs 2023-05-08T09:38:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21243.050080 secs 2023-05-08T09:38:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21243.050080 secs 2023-05-08T09:38:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21243.605634 secs 2023-05-08T09:38:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:25 smithi133 ceph-mon[125939]: pgmap v11387: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 88 KiB/s wr, 11 op/s 2023-05-08T09:38:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21243.605634 secs 2023-05-08T09:38:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:25 smithi096 ceph-mon[124666]: pgmap v11387: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 88 KiB/s wr, 11 op/s 2023-05-08T09:38:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21243.605634 secs 2023-05-08T09:38:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:25 smithi186 ceph-mon[126480]: pgmap v11387: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 88 KiB/s wr, 11 op/s 2023-05-08T09:38:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21244.893121 secs 2023-05-08T09:38:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21244.893121 secs 2023-05-08T09:38:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21244.893121 secs 2023-05-08T09:38:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:27 smithi133 ceph-mon[125939]: pgmap v11388: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 68 KiB/s wr, 7 op/s 2023-05-08T09:38:28.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:27 smithi096 ceph-mon[124666]: pgmap v11388: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 68 KiB/s wr, 7 op/s 2023-05-08T09:38:28.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:27 smithi186 ceph-mon[126480]: pgmap v11388: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 68 KiB/s wr, 7 op/s 2023-05-08T09:38:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21248.050173 secs 2023-05-08T09:38:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:29 smithi133 ceph-mon[125939]: pgmap v11389: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 68 KiB/s wr, 6 op/s 2023-05-08T09:38:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21248.050173 secs 2023-05-08T09:38:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:29 smithi096 ceph-mon[124666]: pgmap v11389: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 68 KiB/s wr, 6 op/s 2023-05-08T09:38:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21248.050173 secs 2023-05-08T09:38:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:29 smithi186 ceph-mon[126480]: pgmap v11389: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 68 KiB/s wr, 6 op/s 2023-05-08T09:38:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21248.605738 secs 2023-05-08T09:38:31.011 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21248.605738 secs 2023-05-08T09:38:31.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21248.605738 secs 2023-05-08T09:38:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21249.893240 secs 2023-05-08T09:38:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:31 smithi133 ceph-mon[125939]: pgmap v11390: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 261 KiB/s wr, 10 op/s 2023-05-08T09:38:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21249.893240 secs 2023-05-08T09:38:32.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:31 smithi096 ceph-mon[124666]: pgmap v11390: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 261 KiB/s wr, 10 op/s 2023-05-08T09:38:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21249.893240 secs 2023-05-08T09:38:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:31 smithi186 ceph-mon[126480]: pgmap v11390: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 261 KiB/s wr, 10 op/s 2023-05-08T09:38:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:33 smithi133 ceph-mon[125939]: pgmap v11391: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 193 KiB/s wr, 7 op/s 2023-05-08T09:38:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:33 smithi096 ceph-mon[124666]: pgmap v11391: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 193 KiB/s wr, 7 op/s 2023-05-08T09:38:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:33 smithi186 ceph-mon[126480]: pgmap v11391: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 193 KiB/s wr, 7 op/s 2023-05-08T09:38:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21253.050250 secs 2023-05-08T09:38:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21253.050250 secs 2023-05-08T09:38:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21253.050250 secs 2023-05-08T09:38:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21253.605858 secs 2023-05-08T09:38:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:35 smithi133 ceph-mon[125939]: pgmap v11392: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 195 KiB/s wr, 10 op/s 2023-05-08T09:38:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21253.605858 secs 2023-05-08T09:38:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:35 smithi096 ceph-mon[124666]: pgmap v11392: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 195 KiB/s wr, 10 op/s 2023-05-08T09:38:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21253.605858 secs 2023-05-08T09:38:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:35 smithi186 ceph-mon[126480]: pgmap v11392: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 195 KiB/s wr, 10 op/s 2023-05-08T09:38:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21254.893358 secs 2023-05-08T09:38:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21254.893358 secs 2023-05-08T09:38:37.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21254.893358 secs 2023-05-08T09:38:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:37 smithi133 ceph-mon[125939]: pgmap v11393: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 194 KiB/s wr, 7 op/s 2023-05-08T09:38:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:37 smithi096 ceph-mon[124666]: pgmap v11393: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 194 KiB/s wr, 7 op/s 2023-05-08T09:38:38.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:37 smithi186 ceph-mon[126480]: pgmap v11393: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 194 KiB/s wr, 7 op/s 2023-05-08T09:38:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21258.050382 secs 2023-05-08T09:38:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:39 smithi133 ceph-mon[125939]: pgmap v11394: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 194 KiB/s wr, 7 op/s 2023-05-08T09:38:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21258.605930 secs 2023-05-08T09:38:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21258.050382 secs 2023-05-08T09:38:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:39 smithi096 ceph-mon[124666]: pgmap v11394: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 194 KiB/s wr, 7 op/s 2023-05-08T09:38:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21258.605930 secs 2023-05-08T09:38:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21258.050382 secs 2023-05-08T09:38:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:39 smithi186 ceph-mon[126480]: pgmap v11394: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 194 KiB/s wr, 7 op/s 2023-05-08T09:38:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21258.605930 secs 2023-05-08T09:38:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21259.893500 secs 2023-05-08T09:38:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:41 smithi133 ceph-mon[125939]: pgmap v11395: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 277 KiB/s wr, 10 op/s 2023-05-08T09:38:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21259.893500 secs 2023-05-08T09:38:42.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:41 smithi096 ceph-mon[124666]: pgmap v11395: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 277 KiB/s wr, 10 op/s 2023-05-08T09:38:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21259.893500 secs 2023-05-08T09:38:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:41 smithi186 ceph-mon[126480]: pgmap v11395: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 277 KiB/s wr, 10 op/s 2023-05-08T09:38:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:43 smithi133 ceph-mon[125939]: pgmap v11396: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 84 KiB/s wr, 6 op/s 2023-05-08T09:38:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:43 smithi096 ceph-mon[124666]: pgmap v11396: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 84 KiB/s wr, 6 op/s 2023-05-08T09:38:44.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:43 smithi186 ceph-mon[126480]: pgmap v11396: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 84 KiB/s wr, 6 op/s 2023-05-08T09:38:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21263.050498 secs 2023-05-08T09:38:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21263.050498 secs 2023-05-08T09:38:45.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21263.050498 secs 2023-05-08T09:38:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:45 smithi133 ceph-mon[125939]: pgmap v11397: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 98 KiB/s wr, 10 op/s 2023-05-08T09:38:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:45 smithi096 ceph-mon[124666]: pgmap v11397: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 98 KiB/s wr, 10 op/s 2023-05-08T09:38:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:45 smithi186 ceph-mon[126480]: pgmap v11397: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 98 KiB/s wr, 10 op/s 2023-05-08T09:38:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21264.893615 secs 2023-05-08T09:38:47.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21264.893615 secs 2023-05-08T09:38:47.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21264.893615 secs 2023-05-08T09:38:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:47 smithi096 ceph-mon[124666]: pgmap v11398: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 97 KiB/s wr, 7 op/s 2023-05-08T09:38:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:38:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:47 smithi186 ceph-mon[126480]: pgmap v11398: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 97 KiB/s wr, 7 op/s 2023-05-08T09:38:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:38:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:47 smithi133 ceph-mon[125939]: pgmap v11398: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 97 KiB/s wr, 7 op/s 2023-05-08T09:38:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:38:49.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:48 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:38:49.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:38:49.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:38:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:48 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:38:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:38:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:38:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:48 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:38:49.331 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:38:49.331 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:38:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21268.050580 secs 2023-05-08T09:38:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:49 smithi186 ceph-mon[126480]: pgmap v11399: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 97 KiB/s wr, 7 op/s 2023-05-08T09:38:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21268.050580 secs 2023-05-08T09:38:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:49 smithi133 ceph-mon[125939]: pgmap v11399: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 97 KiB/s wr, 7 op/s 2023-05-08T09:38:50.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21268.050580 secs 2023-05-08T09:38:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:49 smithi096 ceph-mon[124666]: pgmap v11399: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 97 KiB/s wr, 7 op/s 2023-05-08T09:38:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:51 smithi186 ceph-mon[126480]: pgmap v11400: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 430 KiB/s wr, 13 op/s 2023-05-08T09:38:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:38:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:51 smithi133 ceph-mon[125939]: pgmap v11400: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 430 KiB/s wr, 13 op/s 2023-05-08T09:38:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:38:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:51 smithi096 ceph-mon[124666]: pgmap v11400: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 430 KiB/s wr, 13 op/s 2023-05-08T09:38:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:38:53.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:38:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:38:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:38:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:38:53.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:38:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:38:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:53 smithi186 ceph-mon[126480]: pgmap v11401: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 347 KiB/s wr, 10 op/s 2023-05-08T09:38:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:53 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:38:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:53 smithi133 ceph-mon[125939]: pgmap v11401: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 347 KiB/s wr, 10 op/s 2023-05-08T09:38:54.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:53 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:38:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:53 smithi096 ceph-mon[124666]: pgmap v11401: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 347 KiB/s wr, 10 op/s 2023-05-08T09:38:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:53 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:38:55.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21273.050658 secs 2023-05-08T09:38:55.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21273.606310 secs 2023-05-08T09:38:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21273.050658 secs 2023-05-08T09:38:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21273.606310 secs 2023-05-08T09:38:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21273.050658 secs 2023-05-08T09:38:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21273.606310 secs 2023-05-08T09:38:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:55 smithi186 ceph-mon[126480]: pgmap v11402: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 495 KiB/s wr, 14 op/s 2023-05-08T09:38:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:55 smithi133 ceph-mon[125939]: pgmap v11402: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 495 KiB/s wr, 14 op/s 2023-05-08T09:38:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:55 smithi096 ceph-mon[124666]: pgmap v11402: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 495 KiB/s wr, 14 op/s 2023-05-08T09:38:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:38:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:38:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:38:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:38:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:38:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:38:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:57 smithi186 ceph-mon[126480]: pgmap v11403: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 480 KiB/s wr, 10 op/s 2023-05-08T09:38:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:57 smithi133 ceph-mon[125939]: pgmap v11403: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 480 KiB/s wr, 10 op/s 2023-05-08T09:38:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:57 smithi096 ceph-mon[124666]: pgmap v11403: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 480 KiB/s wr, 10 op/s 2023-05-08T09:38:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:58 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:38:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:58 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:38:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:58 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:39:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21278.050769 secs 2023-05-08T09:39:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:59 smithi186 ceph-mon[126480]: pgmap v11404: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 480 KiB/s wr, 10 op/s 2023-05-08T09:39:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:38:59 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:39:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21278.050769 secs 2023-05-08T09:39:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:59 smithi133 ceph-mon[125939]: pgmap v11404: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 480 KiB/s wr, 10 op/s 2023-05-08T09:39:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:38:59 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:39:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21278.050769 secs 2023-05-08T09:39:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:59 smithi096 ceph-mon[124666]: pgmap v11404: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 480 KiB/s wr, 10 op/s 2023-05-08T09:39:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:38:59 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:39:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:39:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:39:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:39:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:39:01.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:39:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:39:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21279.893967 secs 2023-05-08T09:39:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:01 smithi186 ceph-mon[126480]: pgmap v11405: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 665 KiB/s rd, 768 KiB/s wr, 15 op/s 2023-05-08T09:39:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21279.893967 secs 2023-05-08T09:39:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:01 smithi133 ceph-mon[125939]: pgmap v11405: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 665 KiB/s rd, 768 KiB/s wr, 15 op/s 2023-05-08T09:39:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21279.893967 secs 2023-05-08T09:39:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:01 smithi096 ceph-mon[124666]: pgmap v11405: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 665 KiB/s rd, 768 KiB/s wr, 15 op/s 2023-05-08T09:39:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:03 smithi186 ceph-mon[126480]: pgmap v11406: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 436 KiB/s wr, 9 op/s 2023-05-08T09:39:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:03 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:39:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:03 smithi133 ceph-mon[125939]: pgmap v11406: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 436 KiB/s wr, 9 op/s 2023-05-08T09:39:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:03 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:39:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:03 smithi096 ceph-mon[124666]: pgmap v11406: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 436 KiB/s wr, 9 op/s 2023-05-08T09:39:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:03 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:39:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21283.050916 secs 2023-05-08T09:39:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:04 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:39:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:04 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:39:05.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21283.606563 secs 2023-05-08T09:39:05.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21283.050916 secs 2023-05-08T09:39:05.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:04 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:39:05.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:04 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:39:05.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21283.606563 secs 2023-05-08T09:39:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21283.050916 secs 2023-05-08T09:39:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:04 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:39:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:04 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:39:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21283.606563 secs 2023-05-08T09:39:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:05 smithi186 ceph-mon[126480]: pgmap v11407: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 481 KiB/s wr, 27 op/s 2023-05-08T09:39:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:05 smithi133 ceph-mon[125939]: pgmap v11407: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 481 KiB/s wr, 27 op/s 2023-05-08T09:39:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:05 smithi096 ceph-mon[124666]: pgmap v11407: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 481 KiB/s wr, 27 op/s 2023-05-08T09:39:07.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21284.894092 secs 2023-05-08T09:39:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21284.894092 secs 2023-05-08T09:39:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21284.894092 secs 2023-05-08T09:39:08.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:07 smithi186 ceph-mon[126480]: pgmap v11408: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 334 KiB/s wr, 23 op/s 2023-05-08T09:39:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:07 smithi133 ceph-mon[125939]: pgmap v11408: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 334 KiB/s wr, 23 op/s 2023-05-08T09:39:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:07 smithi096 ceph-mon[124666]: pgmap v11408: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 334 KiB/s wr, 23 op/s 2023-05-08T09:39:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:39:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:39:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:08 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:39:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:39:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:39:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:08 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:39:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:39:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:39:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:08 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:39:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21288.051001 secs 2023-05-08T09:39:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:09 smithi186 ceph-mon[126480]: pgmap v11409: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 334 KiB/s wr, 23 op/s 2023-05-08T09:39:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21288.606683 secs 2023-05-08T09:39:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21288.051001 secs 2023-05-08T09:39:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:09 smithi133 ceph-mon[125939]: pgmap v11409: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 334 KiB/s wr, 23 op/s 2023-05-08T09:39:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21288.606683 secs 2023-05-08T09:39:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21288.051001 secs 2023-05-08T09:39:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:09 smithi096 ceph-mon[124666]: pgmap v11409: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 334 KiB/s wr, 23 op/s 2023-05-08T09:39:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21288.606683 secs 2023-05-08T09:39:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21289.894192 secs 2023-05-08T09:39:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:11 smithi133 ceph-mon[125939]: pgmap v11410: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 557 KiB/s wr, 27 op/s 2023-05-08T09:39:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:11 smithi133 ceph-mon[125939]: osdmap e790: 12 total, 12 up, 12 in 2023-05-08T09:39:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21289.894192 secs 2023-05-08T09:39:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:11 smithi096 ceph-mon[124666]: pgmap v11410: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 557 KiB/s wr, 27 op/s 2023-05-08T09:39:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:11 smithi096 ceph-mon[124666]: osdmap e790: 12 total, 12 up, 12 in 2023-05-08T09:39:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21289.894192 secs 2023-05-08T09:39:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:11 smithi186 ceph-mon[126480]: pgmap v11410: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 557 KiB/s wr, 27 op/s 2023-05-08T09:39:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:11 smithi186 ceph-mon[126480]: osdmap e790: 12 total, 12 up, 12 in 2023-05-08T09:39:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:13 smithi133 ceph-mon[125939]: pgmap v11412: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 322 KiB/s wr, 26 op/s 2023-05-08T09:39:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:13 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:39:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:13 smithi096 ceph-mon[124666]: pgmap v11412: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 322 KiB/s wr, 26 op/s 2023-05-08T09:39:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:13 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:39:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:13 smithi186 ceph-mon[126480]: pgmap v11412: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 322 KiB/s wr, 26 op/s 2023-05-08T09:39:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:13 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:39:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21293.051117 secs 2023-05-08T09:39:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21293.606756 secs 2023-05-08T09:39:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:39:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:39:15.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:39:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21293.051117 secs 2023-05-08T09:39:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21293.606756 secs 2023-05-08T09:39:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:39:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:39:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:39:15.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21293.051117 secs 2023-05-08T09:39:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21293.606756 secs 2023-05-08T09:39:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:39:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:39:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:39:16.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:15 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:39:16.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:15 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T09:39:16.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:15 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T09:39:16.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:15 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:39:16.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:15 smithi133 ceph-mon[125939]: pgmap v11413: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 362 KiB/s wr, 9 op/s 2023-05-08T09:39:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:15 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:39:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:15 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T09:39:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:15 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T09:39:16.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:15 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:39:16.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:15 smithi096 ceph-mon[124666]: pgmap v11413: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 362 KiB/s wr, 9 op/s 2023-05-08T09:39:16.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:15 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:39:16.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:15 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T09:39:16.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:15 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T09:39:16.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:15 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:39:16.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:15 smithi186 ceph-mon[126480]: pgmap v11413: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 362 KiB/s wr, 9 op/s 2023-05-08T09:39:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21294.894312 secs 2023-05-08T09:39:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21294.894312 secs 2023-05-08T09:39:17.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21294.894312 secs 2023-05-08T09:39:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:17 smithi133 ceph-mon[125939]: pgmap v11414: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 362 KiB/s wr, 9 op/s 2023-05-08T09:39:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:17 smithi096 ceph-mon[124666]: pgmap v11414: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 362 KiB/s wr, 9 op/s 2023-05-08T09:39:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:17 smithi186 ceph-mon[126480]: pgmap v11414: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 362 KiB/s wr, 9 op/s 2023-05-08T09:39:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21298.051232 secs 2023-05-08T09:39:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:19 smithi133 ceph-mon[125939]: pgmap v11415: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 362 KiB/s wr, 9 op/s 2023-05-08T09:39:19.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:19 smithi133 ceph-mon[125939]: osdmap e791: 12 total, 12 up, 12 in 2023-05-08T09:39:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21298.051232 secs 2023-05-08T09:39:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:19 smithi096 ceph-mon[124666]: pgmap v11415: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 362 KiB/s wr, 9 op/s 2023-05-08T09:39:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:19 smithi096 ceph-mon[124666]: osdmap e791: 12 total, 12 up, 12 in 2023-05-08T09:39:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21298.051232 secs 2023-05-08T09:39:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:19 smithi186 ceph-mon[126480]: pgmap v11415: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 362 KiB/s wr, 9 op/s 2023-05-08T09:39:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:19 smithi186 ceph-mon[126480]: osdmap e791: 12 total, 12 up, 12 in 2023-05-08T09:39:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21298.606858 secs 2023-05-08T09:39:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21298.606858 secs 2023-05-08T09:39:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21298.606858 secs 2023-05-08T09:39:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21299.894373 secs 2023-05-08T09:39:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:21 smithi133 ceph-mon[125939]: pgmap v11417: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 155 KiB/s wr, 8 op/s 2023-05-08T09:39:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21299.894373 secs 2023-05-08T09:39:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:21 smithi096 ceph-mon[124666]: pgmap v11417: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 155 KiB/s wr, 8 op/s 2023-05-08T09:39:21.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21299.894373 secs 2023-05-08T09:39:21.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:21 smithi186 ceph-mon[126480]: pgmap v11417: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 155 KiB/s wr, 8 op/s 2023-05-08T09:39:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:23 smithi133 ceph-mon[125939]: pgmap v11418: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 148 KiB/s wr, 8 op/s 2023-05-08T09:39:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:23 smithi096 ceph-mon[124666]: pgmap v11418: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 148 KiB/s wr, 8 op/s 2023-05-08T09:39:23.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:23 smithi186 ceph-mon[126480]: pgmap v11418: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 148 KiB/s wr, 8 op/s 2023-05-08T09:39:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21303.051366 secs 2023-05-08T09:39:24.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21303.051366 secs 2023-05-08T09:39:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21303.051366 secs 2023-05-08T09:39:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21303.606981 secs 2023-05-08T09:39:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:25 smithi133 ceph-mon[125939]: pgmap v11419: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 7 op/s 2023-05-08T09:39:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21303.606981 secs 2023-05-08T09:39:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:25 smithi096 ceph-mon[124666]: pgmap v11419: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 7 op/s 2023-05-08T09:39:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21303.606981 secs 2023-05-08T09:39:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:25 smithi186 ceph-mon[126480]: pgmap v11419: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 7 op/s 2023-05-08T09:39:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21304.894471 secs 2023-05-08T09:39:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21304.894471 secs 2023-05-08T09:39:26.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21304.894471 secs 2023-05-08T09:39:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:27 smithi133 ceph-mon[125939]: pgmap v11420: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 7 op/s 2023-05-08T09:39:27.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:27 smithi096 ceph-mon[124666]: pgmap v11420: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 7 op/s 2023-05-08T09:39:27.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:27 smithi186 ceph-mon[126480]: pgmap v11420: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 7 op/s 2023-05-08T09:39:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21308.051453 secs 2023-05-08T09:39:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:29 smithi133 ceph-mon[125939]: pgmap v11421: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 7 op/s 2023-05-08T09:39:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21308.051453 secs 2023-05-08T09:39:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:29 smithi096 ceph-mon[124666]: pgmap v11421: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 7 op/s 2023-05-08T09:39:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21308.051453 secs 2023-05-08T09:39:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:29 smithi186 ceph-mon[126480]: pgmap v11421: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 7 op/s 2023-05-08T09:39:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21308.607102 secs 2023-05-08T09:39:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21308.607102 secs 2023-05-08T09:39:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21308.607102 secs 2023-05-08T09:39:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21309.894561 secs 2023-05-08T09:39:31.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:31 smithi133 ceph-mon[125939]: pgmap v11422: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 115 KiB/s wr, 9 op/s 2023-05-08T09:39:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21309.894561 secs 2023-05-08T09:39:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:31 smithi096 ceph-mon[124666]: pgmap v11422: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 115 KiB/s wr, 9 op/s 2023-05-08T09:39:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21309.894561 secs 2023-05-08T09:39:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:31 smithi186 ceph-mon[126480]: pgmap v11422: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 115 KiB/s wr, 9 op/s 2023-05-08T09:39:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:33 smithi133 ceph-mon[125939]: pgmap v11423: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 71 KiB/s wr, 6 op/s 2023-05-08T09:39:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:33 smithi096 ceph-mon[124666]: pgmap v11423: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 71 KiB/s wr, 6 op/s 2023-05-08T09:39:33.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:33 smithi186 ceph-mon[126480]: pgmap v11423: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 71 KiB/s wr, 6 op/s 2023-05-08T09:39:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21313.051517 secs 2023-05-08T09:39:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21313.051517 secs 2023-05-08T09:39:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21313.051517 secs 2023-05-08T09:39:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21313.607221 secs 2023-05-08T09:39:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:35 smithi133 ceph-mon[125939]: pgmap v11424: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 71 KiB/s wr, 9 op/s 2023-05-08T09:39:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21313.607221 secs 2023-05-08T09:39:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:35 smithi096 ceph-mon[124666]: pgmap v11424: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 71 KiB/s wr, 9 op/s 2023-05-08T09:39:35.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21313.607221 secs 2023-05-08T09:39:35.920 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:35 smithi186 ceph-mon[126480]: pgmap v11424: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 71 KiB/s wr, 9 op/s 2023-05-08T09:39:36.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21314.894699 secs 2023-05-08T09:39:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21314.894699 secs 2023-05-08T09:39:36.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21314.894699 secs 2023-05-08T09:39:37.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:37 smithi133 ceph-mon[125939]: pgmap v11425: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 71 KiB/s wr, 6 op/s 2023-05-08T09:39:37.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:37 smithi096 ceph-mon[124666]: pgmap v11425: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 71 KiB/s wr, 6 op/s 2023-05-08T09:39:37.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:37 smithi186 ceph-mon[126480]: pgmap v11425: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 71 KiB/s wr, 6 op/s 2023-05-08T09:39:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21318.051655 secs 2023-05-08T09:39:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:39 smithi133 ceph-mon[125939]: pgmap v11426: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 71 KiB/s wr, 6 op/s 2023-05-08T09:39:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21318.051655 secs 2023-05-08T09:39:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:39 smithi096 ceph-mon[124666]: pgmap v11426: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 71 KiB/s wr, 6 op/s 2023-05-08T09:39:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21318.051655 secs 2023-05-08T09:39:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:39 smithi186 ceph-mon[126480]: pgmap v11426: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 71 KiB/s wr, 6 op/s 2023-05-08T09:39:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21318.607378 secs 2023-05-08T09:39:40.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21318.607378 secs 2023-05-08T09:39:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21318.607378 secs 2023-05-08T09:39:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21319.894840 secs 2023-05-08T09:39:41.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:41 smithi133 ceph-mon[125939]: pgmap v11427: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 221 KiB/s wr, 9 op/s 2023-05-08T09:39:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21319.894840 secs 2023-05-08T09:39:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:41 smithi096 ceph-mon[124666]: pgmap v11427: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 221 KiB/s wr, 9 op/s 2023-05-08T09:39:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21319.894840 secs 2023-05-08T09:39:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:41 smithi186 ceph-mon[126480]: pgmap v11427: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 221 KiB/s wr, 9 op/s 2023-05-08T09:39:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:43 smithi133 ceph-mon[125939]: pgmap v11428: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 151 KiB/s wr, 6 op/s 2023-05-08T09:39:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:43 smithi096 ceph-mon[124666]: pgmap v11428: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 151 KiB/s wr, 6 op/s 2023-05-08T09:39:43.873 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:43 smithi186 ceph-mon[126480]: pgmap v11428: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 151 KiB/s wr, 6 op/s 2023-05-08T09:39:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21323.051769 secs 2023-05-08T09:39:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21323.051769 secs 2023-05-08T09:39:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21323.051769 secs 2023-05-08T09:39:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:45 smithi096 ceph-mon[124666]: pgmap v11429: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 166 KiB/s wr, 10 op/s 2023-05-08T09:39:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:45 smithi186 ceph-mon[126480]: pgmap v11429: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 166 KiB/s wr, 10 op/s 2023-05-08T09:39:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:45 smithi133 ceph-mon[125939]: pgmap v11429: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 166 KiB/s wr, 10 op/s 2023-05-08T09:39:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21324.894978 secs 2023-05-08T09:39:46.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21324.894978 secs 2023-05-08T09:39:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21324.894978 secs 2023-05-08T09:39:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:47 smithi096 ceph-mon[124666]: pgmap v11430: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 165 KiB/s wr, 7 op/s 2023-05-08T09:39:47.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:47 smithi186 ceph-mon[126480]: pgmap v11430: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 165 KiB/s wr, 7 op/s 2023-05-08T09:39:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:47 smithi133 ceph-mon[125939]: pgmap v11430: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 165 KiB/s wr, 7 op/s 2023-05-08T09:39:48.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:39:48.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:39:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:39:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21328.051898 secs 2023-05-08T09:39:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:49 smithi186 ceph-mon[126480]: pgmap v11431: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 165 KiB/s wr, 7 op/s 2023-05-08T09:39:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:39:49.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:39:49.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:39:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21328.051898 secs 2023-05-08T09:39:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:49 smithi133 ceph-mon[125939]: pgmap v11431: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 165 KiB/s wr, 7 op/s 2023-05-08T09:39:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:39:49.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:39:49.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:39:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21328.051898 secs 2023-05-08T09:39:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:49 smithi096 ceph-mon[124666]: pgmap v11431: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 165 KiB/s wr, 7 op/s 2023-05-08T09:39:50.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:39:50.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:39:50.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:39:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:51 smithi186 ceph-mon[126480]: pgmap v11432: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 499 KiB/s wr, 12 op/s 2023-05-08T09:39:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:39:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:51 smithi133 ceph-mon[125939]: pgmap v11432: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 499 KiB/s wr, 12 op/s 2023-05-08T09:39:51.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:39:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:51 smithi096 ceph-mon[124666]: pgmap v11432: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 499 KiB/s wr, 12 op/s 2023-05-08T09:39:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:39:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:39:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:39:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:39:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:39:53.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:39:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:39:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:53 smithi186 ceph-mon[126480]: pgmap v11433: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 349 KiB/s wr, 9 op/s 2023-05-08T09:39:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:53 smithi133 ceph-mon[125939]: pgmap v11433: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 349 KiB/s wr, 9 op/s 2023-05-08T09:39:54.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:53 smithi096 ceph-mon[124666]: pgmap v11433: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 349 KiB/s wr, 9 op/s 2023-05-08T09:39:54.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21333.052004 secs 2023-05-08T09:39:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21333.052004 secs 2023-05-08T09:39:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21333.052004 secs 2023-05-08T09:39:55.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21333.607666 secs 2023-05-08T09:39:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:55 smithi186 ceph-mon[126480]: pgmap v11434: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 363 KiB/s wr, 13 op/s 2023-05-08T09:39:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21333.607666 secs 2023-05-08T09:39:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:55 smithi133 ceph-mon[125939]: pgmap v11434: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 363 KiB/s wr, 13 op/s 2023-05-08T09:39:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21333.607666 secs 2023-05-08T09:39:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:55 smithi096 ceph-mon[124666]: pgmap v11434: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 363 KiB/s wr, 13 op/s 2023-05-08T09:39:56.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:56 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:39:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:39:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:39:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:56 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:39:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:39:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:39:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:56 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:39:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:39:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:39:57.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:57 smithi186 ceph-mon[126480]: pgmap v11435: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 348 KiB/s wr, 9 op/s 2023-05-08T09:39:57.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:57 smithi133 ceph-mon[125939]: pgmap v11435: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 348 KiB/s wr, 9 op/s 2023-05-08T09:39:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:57 smithi096 ceph-mon[124666]: pgmap v11435: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 348 KiB/s wr, 9 op/s 2023-05-08T09:39:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21338.052090 secs 2023-05-08T09:39:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:39:59 smithi186 ceph-mon[126480]: pgmap v11436: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 348 KiB/s wr, 9 op/s 2023-05-08T09:39:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21338.052090 secs 2023-05-08T09:39:59.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:39:59 smithi133 ceph-mon[125939]: pgmap v11436: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 348 KiB/s wr, 9 op/s 2023-05-08T09:40:00.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21338.052090 secs 2023-05-08T09:40:00.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:39:59 smithi096 ceph-mon[124666]: pgmap v11436: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 348 KiB/s wr, 9 op/s 2023-05-08T09:40:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21338.607782 secs 2023-05-08T09:40:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:00 smithi186 ceph-mon[126480]: overall HEALTH_WARN 2 MDSs report slow requests 2023-05-08T09:40:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21338.607782 secs 2023-05-08T09:40:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:00 smithi133 ceph-mon[125939]: overall HEALTH_WARN 2 MDSs report slow requests 2023-05-08T09:40:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21338.607782 secs 2023-05-08T09:40:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:00 smithi096 ceph-mon[124666]: overall HEALTH_WARN 2 MDSs report slow requests 2023-05-08T09:40:01.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:01 smithi186 ceph-mon[126480]: pgmap v11437: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 702 KiB/s wr, 13 op/s 2023-05-08T09:40:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:01 smithi133 ceph-mon[125939]: pgmap v11437: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 702 KiB/s wr, 13 op/s 2023-05-08T09:40:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:01 smithi096 ceph-mon[124666]: pgmap v11437: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 702 KiB/s wr, 13 op/s 2023-05-08T09:40:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:03 smithi186 ceph-mon[126480]: pgmap v11438: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 368 KiB/s wr, 8 op/s 2023-05-08T09:40:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:03 smithi133 ceph-mon[125939]: pgmap v11438: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 368 KiB/s wr, 8 op/s 2023-05-08T09:40:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:03 smithi096 ceph-mon[124666]: pgmap v11438: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 368 KiB/s wr, 8 op/s 2023-05-08T09:40:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21343.052207 secs 2023-05-08T09:40:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21343.052207 secs 2023-05-08T09:40:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21343.052207 secs 2023-05-08T09:40:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21343.607912 secs 2023-05-08T09:40:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:05 smithi186 ceph-mon[126480]: pgmap v11439: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 495 KiB/s wr, 28 op/s 2023-05-08T09:40:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21343.607912 secs 2023-05-08T09:40:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:05 smithi133 ceph-mon[125939]: pgmap v11439: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 495 KiB/s wr, 28 op/s 2023-05-08T09:40:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21343.607912 secs 2023-05-08T09:40:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:05 smithi096 ceph-mon[124666]: pgmap v11439: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 495 KiB/s wr, 28 op/s 2023-05-08T09:40:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21344.895477 secs 2023-05-08T09:40:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:06 smithi186 ceph-mon[126480]: osdmap e792: 12 total, 12 up, 12 in 2023-05-08T09:40:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21344.895477 secs 2023-05-08T09:40:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:06 smithi133 ceph-mon[125939]: osdmap e792: 12 total, 12 up, 12 in 2023-05-08T09:40:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21344.895477 secs 2023-05-08T09:40:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:06 smithi096 ceph-mon[124666]: osdmap e792: 12 total, 12 up, 12 in 2023-05-08T09:40:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:07 smithi186 ceph-mon[126480]: pgmap v11441: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 455 KiB/s rd, 577 KiB/s wr, 28 op/s 2023-05-08T09:40:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:07 smithi133 ceph-mon[125939]: pgmap v11441: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 455 KiB/s rd, 577 KiB/s wr, 28 op/s 2023-05-08T09:40:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:07 smithi096 ceph-mon[124666]: pgmap v11441: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 455 KiB/s rd, 577 KiB/s wr, 28 op/s 2023-05-08T09:40:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:08 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:40:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:40:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:40:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:08 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:40:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:40:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:40:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:08 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:40:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:40:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:40:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21348.052355 secs 2023-05-08T09:40:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:09 smithi186 ceph-mon[126480]: pgmap v11442: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 455 KiB/s rd, 577 KiB/s wr, 28 op/s 2023-05-08T09:40:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21348.052355 secs 2023-05-08T09:40:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:09 smithi133 ceph-mon[125939]: pgmap v11442: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 455 KiB/s rd, 577 KiB/s wr, 28 op/s 2023-05-08T09:40:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21348.052355 secs 2023-05-08T09:40:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:09 smithi096 ceph-mon[124666]: pgmap v11442: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 455 KiB/s rd, 577 KiB/s wr, 28 op/s 2023-05-08T09:40:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21348.608037 secs 2023-05-08T09:40:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21348.608037 secs 2023-05-08T09:40:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21348.608037 secs 2023-05-08T09:40:11.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21349.895604 secs 2023-05-08T09:40:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:11 smithi186 ceph-mon[126480]: pgmap v11443: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 321 KiB/s wr, 27 op/s 2023-05-08T09:40:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21349.895604 secs 2023-05-08T09:40:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:11 smithi133 ceph-mon[125939]: pgmap v11443: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 321 KiB/s wr, 27 op/s 2023-05-08T09:40:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21349.895604 secs 2023-05-08T09:40:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:11 smithi096 ceph-mon[124666]: pgmap v11443: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 321 KiB/s wr, 27 op/s 2023-05-08T09:40:13.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:13 smithi186 ceph-mon[126480]: pgmap v11444: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 611 KiB/s rd, 453 KiB/s wr, 28 op/s 2023-05-08T09:40:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:13 smithi186 ceph-mon[126480]: osdmap e793: 12 total, 12 up, 12 in 2023-05-08T09:40:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:13 smithi133 ceph-mon[125939]: pgmap v11444: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 611 KiB/s rd, 453 KiB/s wr, 28 op/s 2023-05-08T09:40:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:13 smithi133 ceph-mon[125939]: osdmap e793: 12 total, 12 up, 12 in 2023-05-08T09:40:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:13 smithi096 ceph-mon[124666]: pgmap v11444: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 611 KiB/s rd, 453 KiB/s wr, 28 op/s 2023-05-08T09:40:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:13 smithi096 ceph-mon[124666]: osdmap e793: 12 total, 12 up, 12 in 2023-05-08T09:40:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21353.052472 secs 2023-05-08T09:40:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:40:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21353.052472 secs 2023-05-08T09:40:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:40:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21353.052472 secs 2023-05-08T09:40:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:40:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21353.608174 secs 2023-05-08T09:40:15.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:15 smithi186 ceph-mon[126480]: pgmap v11446: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 434 KiB/s rd, 357 KiB/s wr, 10 op/s 2023-05-08T09:40:15.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21353.608174 secs 2023-05-08T09:40:15.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:15 smithi133 ceph-mon[125939]: pgmap v11446: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 434 KiB/s rd, 357 KiB/s wr, 10 op/s 2023-05-08T09:40:16.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21353.608174 secs 2023-05-08T09:40:16.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:15 smithi096 ceph-mon[124666]: pgmap v11446: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 434 KiB/s rd, 357 KiB/s wr, 10 op/s 2023-05-08T09:40:16.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21354.895700 secs 2023-05-08T09:40:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21354.895700 secs 2023-05-08T09:40:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21354.895700 secs 2023-05-08T09:40:18.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:18 smithi186 ceph-mon[126480]: pgmap v11447: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 383 KiB/s wr, 9 op/s 2023-05-08T09:40:18.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:40:18.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:40:18.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:40:18.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:40:18.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:40:18.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:40:18.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:40:18.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:40:18.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:40:18.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:40:18.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:40:18.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:40:18.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:40:18.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:40:18.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:40:18.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:40:18.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:40:18.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:40:18.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:18 smithi133 ceph-mon[125939]: pgmap v11447: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 383 KiB/s wr, 9 op/s 2023-05-08T09:40:18.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:40:18.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:40:18.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:40:18.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:40:18.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:40:18.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:40:18.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:40:18.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:40:18.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:40:18.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:40:18.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:40:18.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:40:18.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:40:18.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:40:18.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:40:18.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:40:18.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:40:18.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:40:18.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:18 smithi096 ceph-mon[124666]: pgmap v11447: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 383 KiB/s wr, 9 op/s 2023-05-08T09:40:18.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:40:18.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:40:18.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:40:18.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:40:18.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:40:18.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:40:18.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:40:18.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:40:18.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:40:18.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:40:18.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:40:18.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:40:18.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:40:18.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:40:18.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:40:18.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:40:18.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:40:18.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:40:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:19 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T09:40:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:19 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T09:40:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:19 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T09:40:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:19 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T09:40:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:19 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:40:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:19 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T09:40:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:19 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T09:40:19.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:19 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:40:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:19 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T09:40:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:19 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T09:40:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:19 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T09:40:19.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:19 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T09:40:19.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:19 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:40:19.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:19 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T09:40:19.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:19 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T09:40:19.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:19 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:40:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:19 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T09:40:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:19 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T09:40:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:19 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T09:40:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:19 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T09:40:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:19 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:40:19.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:19 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T09:40:19.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:19 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T09:40:19.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:19 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:40:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21358.052593 secs 2023-05-08T09:40:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:20 smithi186 ceph-mon[126480]: pgmap v11448: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 383 KiB/s wr, 9 op/s 2023-05-08T09:40:20.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21358.608313 secs 2023-05-08T09:40:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21358.052593 secs 2023-05-08T09:40:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:20 smithi133 ceph-mon[125939]: pgmap v11448: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 383 KiB/s wr, 9 op/s 2023-05-08T09:40:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21358.608313 secs 2023-05-08T09:40:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21358.052593 secs 2023-05-08T09:40:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:20 smithi096 ceph-mon[124666]: pgmap v11448: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 383 KiB/s wr, 9 op/s 2023-05-08T09:40:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21358.608313 secs 2023-05-08T09:40:21.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21359.895841 secs 2023-05-08T09:40:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21359.895841 secs 2023-05-08T09:40:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21359.895841 secs 2023-05-08T09:40:22.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:22 smithi186 ceph-mon[126480]: pgmap v11449: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 229 KiB/s wr, 9 op/s 2023-05-08T09:40:22.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:22 smithi133 ceph-mon[125939]: pgmap v11449: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 229 KiB/s wr, 9 op/s 2023-05-08T09:40:22.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:22 smithi096 ceph-mon[124666]: pgmap v11449: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 229 KiB/s wr, 9 op/s 2023-05-08T09:40:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:24 smithi186 ceph-mon[126480]: pgmap v11450: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 97 KiB/s wr, 9 op/s 2023-05-08T09:40:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:24 smithi133 ceph-mon[125939]: pgmap v11450: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 97 KiB/s wr, 9 op/s 2023-05-08T09:40:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:24 smithi096 ceph-mon[124666]: pgmap v11450: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 97 KiB/s wr, 9 op/s 2023-05-08T09:40:25.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21363.052678 secs 2023-05-08T09:40:25.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21363.608426 secs 2023-05-08T09:40:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21363.052678 secs 2023-05-08T09:40:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21363.608426 secs 2023-05-08T09:40:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21363.052678 secs 2023-05-08T09:40:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21363.608426 secs 2023-05-08T09:40:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:26 smithi186 ceph-mon[126480]: pgmap v11451: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 89 KiB/s wr, 11 op/s 2023-05-08T09:40:26.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21364.895980 secs 2023-05-08T09:40:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:26 smithi133 ceph-mon[125939]: pgmap v11451: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 89 KiB/s wr, 11 op/s 2023-05-08T09:40:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21364.895980 secs 2023-05-08T09:40:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:26 smithi096 ceph-mon[124666]: pgmap v11451: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 89 KiB/s wr, 11 op/s 2023-05-08T09:40:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21364.895980 secs 2023-05-08T09:40:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:27 smithi186 ceph-mon[126480]: pgmap v11452: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 113 KiB/s wr, 7 op/s 2023-05-08T09:40:27.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:27 smithi133 ceph-mon[125939]: pgmap v11452: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 113 KiB/s wr, 7 op/s 2023-05-08T09:40:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:27 smithi096 ceph-mon[124666]: pgmap v11452: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 113 KiB/s wr, 7 op/s 2023-05-08T09:40:29.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21368.052745 secs 2023-05-08T09:40:29.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:29 smithi133 ceph-mon[125939]: pgmap v11453: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 57 KiB/s wr, 7 op/s 2023-05-08T09:40:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21368.052745 secs 2023-05-08T09:40:29.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:29 smithi096 ceph-mon[124666]: pgmap v11453: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 57 KiB/s wr, 7 op/s 2023-05-08T09:40:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21368.052745 secs 2023-05-08T09:40:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:29 smithi186 ceph-mon[126480]: pgmap v11453: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 57 KiB/s wr, 7 op/s 2023-05-08T09:40:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21368.608539 secs 2023-05-08T09:40:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21368.608539 secs 2023-05-08T09:40:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21368.608539 secs 2023-05-08T09:40:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21369.896103 secs 2023-05-08T09:40:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:31 smithi096 ceph-mon[124666]: pgmap v11454: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 58 KiB/s wr, 9 op/s 2023-05-08T09:40:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21369.896103 secs 2023-05-08T09:40:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:31 smithi186 ceph-mon[126480]: pgmap v11454: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 58 KiB/s wr, 9 op/s 2023-05-08T09:40:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21369.896103 secs 2023-05-08T09:40:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:31 smithi133 ceph-mon[125939]: pgmap v11454: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 58 KiB/s wr, 9 op/s 2023-05-08T09:40:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:33 smithi096 ceph-mon[124666]: pgmap v11455: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 115 KiB/s wr, 7 op/s 2023-05-08T09:40:33.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:33 smithi186 ceph-mon[126480]: pgmap v11455: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 115 KiB/s wr, 7 op/s 2023-05-08T09:40:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:33 smithi133 ceph-mon[125939]: pgmap v11455: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 115 KiB/s wr, 7 op/s 2023-05-08T09:40:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21373.052856 secs 2023-05-08T09:40:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21373.052856 secs 2023-05-08T09:40:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21373.052856 secs 2023-05-08T09:40:35.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21373.608618 secs 2023-05-08T09:40:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:35 smithi186 ceph-mon[126480]: pgmap v11456: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 116 KiB/s wr, 9 op/s 2023-05-08T09:40:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21373.608618 secs 2023-05-08T09:40:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:35 smithi133 ceph-mon[125939]: pgmap v11456: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 116 KiB/s wr, 9 op/s 2023-05-08T09:40:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21373.608618 secs 2023-05-08T09:40:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:35 smithi096 ceph-mon[124666]: pgmap v11456: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 116 KiB/s wr, 9 op/s 2023-05-08T09:40:36.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21374.896198 secs 2023-05-08T09:40:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21374.896198 secs 2023-05-08T09:40:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21374.896198 secs 2023-05-08T09:40:37.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:37 smithi186 ceph-mon[126480]: pgmap v11457: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 116 KiB/s wr, 7 op/s 2023-05-08T09:40:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:37 smithi133 ceph-mon[125939]: pgmap v11457: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 116 KiB/s wr, 7 op/s 2023-05-08T09:40:38.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:37 smithi096 ceph-mon[124666]: pgmap v11457: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 116 KiB/s wr, 7 op/s 2023-05-08T09:40:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21378.052969 secs 2023-05-08T09:40:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:39 smithi186 ceph-mon[126480]: pgmap v11458: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 71 KiB/s wr, 6 op/s 2023-05-08T09:40:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21378.052969 secs 2023-05-08T09:40:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:39 smithi133 ceph-mon[125939]: pgmap v11458: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 71 KiB/s wr, 6 op/s 2023-05-08T09:40:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21378.052969 secs 2023-05-08T09:40:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:39 smithi096 ceph-mon[124666]: pgmap v11458: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 71 KiB/s wr, 6 op/s 2023-05-08T09:40:40.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21378.608694 secs 2023-05-08T09:40:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21378.608694 secs 2023-05-08T09:40:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21378.608694 secs 2023-05-08T09:40:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21379.896328 secs 2023-05-08T09:40:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:41 smithi186 ceph-mon[126480]: pgmap v11459: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 162 KiB/s wr, 9 op/s 2023-05-08T09:40:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21379.896328 secs 2023-05-08T09:40:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:41 smithi133 ceph-mon[125939]: pgmap v11459: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 162 KiB/s wr, 9 op/s 2023-05-08T09:40:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21379.896328 secs 2023-05-08T09:40:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:41 smithi096 ceph-mon[124666]: pgmap v11459: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 162 KiB/s wr, 9 op/s 2023-05-08T09:40:43.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:43 smithi186 ceph-mon[126480]: pgmap v11460: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 224 KiB/s wr, 7 op/s 2023-05-08T09:40:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:43 smithi133 ceph-mon[125939]: pgmap v11460: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 224 KiB/s wr, 7 op/s 2023-05-08T09:40:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:43 smithi096 ceph-mon[124666]: pgmap v11460: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 224 KiB/s wr, 7 op/s 2023-05-08T09:40:44.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21383.053122 secs 2023-05-08T09:40:45.184 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21383.053122 secs 2023-05-08T09:40:45.185 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21383.053122 secs 2023-05-08T09:40:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:45 smithi186 ceph-mon[126480]: pgmap v11461: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 169 KiB/s wr, 10 op/s 2023-05-08T09:40:45.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:45 smithi133 ceph-mon[125939]: pgmap v11461: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 169 KiB/s wr, 10 op/s 2023-05-08T09:40:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:45 smithi096 ceph-mon[124666]: pgmap v11461: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 169 KiB/s wr, 10 op/s 2023-05-08T09:40:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21384.896470 secs 2023-05-08T09:40:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21384.896470 secs 2023-05-08T09:40:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21384.896470 secs 2023-05-08T09:40:47.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:47 smithi186 ceph-mon[126480]: pgmap v11462: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 168 KiB/s wr, 7 op/s 2023-05-08T09:40:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:40:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:47 smithi133 ceph-mon[125939]: pgmap v11462: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 168 KiB/s wr, 7 op/s 2023-05-08T09:40:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:40:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:47 smithi096 ceph-mon[124666]: pgmap v11462: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 168 KiB/s wr, 7 op/s 2023-05-08T09:40:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:40:48.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:48 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:40:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:40:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:40:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:48 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:40:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:40:48.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:40:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:48 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:40:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:40:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:40:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21388.053185 secs 2023-05-08T09:40:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:49 smithi186 ceph-mon[126480]: pgmap v11463: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 168 KiB/s wr, 7 op/s 2023-05-08T09:40:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21388.053185 secs 2023-05-08T09:40:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:49 smithi133 ceph-mon[125939]: pgmap v11463: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 168 KiB/s wr, 7 op/s 2023-05-08T09:40:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21388.053185 secs 2023-05-08T09:40:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:49 smithi096 ceph-mon[124666]: pgmap v11463: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 168 KiB/s wr, 7 op/s 2023-05-08T09:40:51.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:51 smithi186 ceph-mon[126480]: pgmap v11464: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 434 KiB/s wr, 13 op/s 2023-05-08T09:40:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:40:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:51 smithi133 ceph-mon[125939]: pgmap v11464: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 434 KiB/s wr, 13 op/s 2023-05-08T09:40:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:40:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:51 smithi096 ceph-mon[124666]: pgmap v11464: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 434 KiB/s wr, 13 op/s 2023-05-08T09:40:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:40:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:40:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:40:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:40:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:40:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:40:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:40:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:53 smithi186 ceph-mon[126480]: pgmap v11465: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 343 KiB/s wr, 10 op/s 2023-05-08T09:40:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:53 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:40:53.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:53 smithi133 ceph-mon[125939]: pgmap v11465: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 343 KiB/s wr, 10 op/s 2023-05-08T09:40:53.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:53 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:40:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:53 smithi096 ceph-mon[124666]: pgmap v11465: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 343 KiB/s wr, 10 op/s 2023-05-08T09:40:54.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:53 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:40:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21393.053304 secs 2023-05-08T09:40:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21393.053304 secs 2023-05-08T09:40:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21393.053304 secs 2023-05-08T09:40:55.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21393.608984 secs 2023-05-08T09:40:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:55 smithi186 ceph-mon[126480]: pgmap v11466: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 598 KiB/s rd, 500 KiB/s wr, 14 op/s 2023-05-08T09:40:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21393.608984 secs 2023-05-08T09:40:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:55 smithi133 ceph-mon[125939]: pgmap v11466: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 598 KiB/s rd, 500 KiB/s wr, 14 op/s 2023-05-08T09:40:56.012 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21393.608984 secs 2023-05-08T09:40:56.012 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:55 smithi096 ceph-mon[124666]: pgmap v11466: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 598 KiB/s rd, 500 KiB/s wr, 14 op/s 2023-05-08T09:40:56.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:40:56.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:40:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:40:56.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:40:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:40:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:40:57.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:57 smithi186 ceph-mon[126480]: pgmap v11467: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 485 KiB/s wr, 9 op/s 2023-05-08T09:40:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:57 smithi133 ceph-mon[125939]: pgmap v11467: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 485 KiB/s wr, 9 op/s 2023-05-08T09:40:58.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:57 smithi096 ceph-mon[124666]: pgmap v11467: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 485 KiB/s wr, 9 op/s 2023-05-08T09:40:58.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:58 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:40:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:58 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:40:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:58 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:40:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21398.053442 secs 2023-05-08T09:40:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:59 smithi133 ceph-mon[125939]: pgmap v11468: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 485 KiB/s wr, 9 op/s 2023-05-08T09:40:59.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:40:59 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:41:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21398.053442 secs 2023-05-08T09:41:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:59 smithi096 ceph-mon[124666]: pgmap v11468: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 485 KiB/s wr, 9 op/s 2023-05-08T09:41:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:40:59 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:41:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21398.053442 secs 2023-05-08T09:41:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:59 smithi186 ceph-mon[126480]: pgmap v11468: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 485 KiB/s wr, 9 op/s 2023-05-08T09:41:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:40:59 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:41:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:41:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:41:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:41:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:41:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:41:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:41:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21399.896828 secs 2023-05-08T09:41:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:01 smithi133 ceph-mon[125939]: pgmap v11469: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 590 KiB/s rd, 776 KiB/s wr, 14 op/s 2023-05-08T09:41:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21399.896828 secs 2023-05-08T09:41:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:01 smithi096 ceph-mon[124666]: pgmap v11469: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 590 KiB/s rd, 776 KiB/s wr, 14 op/s 2023-05-08T09:41:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21399.896828 secs 2023-05-08T09:41:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:01 smithi186 ceph-mon[126480]: pgmap v11469: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 590 KiB/s rd, 776 KiB/s wr, 14 op/s 2023-05-08T09:41:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:03 smithi133 ceph-mon[125939]: pgmap v11470: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 509 KiB/s wr, 9 op/s 2023-05-08T09:41:04.013 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:03 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:41:04.014 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:03 smithi096 ceph-mon[124666]: pgmap v11470: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 509 KiB/s wr, 9 op/s 2023-05-08T09:41:04.014 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:03 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:41:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:03 smithi186 ceph-mon[126480]: pgmap v11470: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 509 KiB/s wr, 9 op/s 2023-05-08T09:41:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:03 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:41:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21403.053554 secs 2023-05-08T09:41:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:04 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:41:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:04 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:41:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21403.053554 secs 2023-05-08T09:41:05.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:04 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:41:05.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:04 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:41:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21403.053554 secs 2023-05-08T09:41:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:04 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:41:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:04 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:41:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21403.609212 secs 2023-05-08T09:41:05.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:05 smithi133 ceph-mon[125939]: pgmap v11471: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 555 KiB/s wr, 27 op/s 2023-05-08T09:41:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21403.609212 secs 2023-05-08T09:41:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:05 smithi096 ceph-mon[124666]: pgmap v11471: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 555 KiB/s wr, 27 op/s 2023-05-08T09:41:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21403.609212 secs 2023-05-08T09:41:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:05 smithi186 ceph-mon[126480]: pgmap v11471: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 555 KiB/s wr, 27 op/s 2023-05-08T09:41:06.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21404.896880 secs 2023-05-08T09:41:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21404.896880 secs 2023-05-08T09:41:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21404.896880 secs 2023-05-08T09:41:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:07 smithi133 ceph-mon[125939]: pgmap v11472: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 337 KiB/s wr, 23 op/s 2023-05-08T09:41:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:07 smithi096 ceph-mon[124666]: pgmap v11472: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 337 KiB/s wr, 23 op/s 2023-05-08T09:41:08.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:07 smithi186 ceph-mon[126480]: pgmap v11472: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 337 KiB/s wr, 23 op/s 2023-05-08T09:41:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:41:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:41:08.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:08 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:41:09.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:41:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:41:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:08 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:41:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:41:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:41:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:08 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:41:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21408.053633 secs 2023-05-08T09:41:09.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:09 smithi133 ceph-mon[125939]: pgmap v11473: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 337 KiB/s wr, 23 op/s 2023-05-08T09:41:10.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21408.053633 secs 2023-05-08T09:41:10.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:09 smithi096 ceph-mon[124666]: pgmap v11473: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 337 KiB/s wr, 23 op/s 2023-05-08T09:41:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21408.053633 secs 2023-05-08T09:41:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:09 smithi186 ceph-mon[126480]: pgmap v11473: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 337 KiB/s wr, 23 op/s 2023-05-08T09:41:10.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21408.609347 secs 2023-05-08T09:41:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21408.609347 secs 2023-05-08T09:41:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21408.609347 secs 2023-05-08T09:41:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21409.897018 secs 2023-05-08T09:41:11.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:11 smithi133 ceph-mon[125939]: pgmap v11474: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 469 KiB/s rd, 502 KiB/s wr, 26 op/s 2023-05-08T09:41:11.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:11 smithi133 ceph-mon[125939]: osdmap e794: 12 total, 12 up, 12 in 2023-05-08T09:41:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21409.897018 secs 2023-05-08T09:41:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:11 smithi096 ceph-mon[124666]: pgmap v11474: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 469 KiB/s rd, 502 KiB/s wr, 26 op/s 2023-05-08T09:41:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:11 smithi096 ceph-mon[124666]: osdmap e794: 12 total, 12 up, 12 in 2023-05-08T09:41:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21409.897018 secs 2023-05-08T09:41:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:11 smithi186 ceph-mon[126480]: pgmap v11474: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 469 KiB/s rd, 502 KiB/s wr, 26 op/s 2023-05-08T09:41:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:11 smithi186 ceph-mon[126480]: osdmap e794: 12 total, 12 up, 12 in 2023-05-08T09:41:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:13 smithi133 ceph-mon[125939]: pgmap v11476: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 253 KiB/s wr, 26 op/s 2023-05-08T09:41:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:13 smithi096 ceph-mon[124666]: pgmap v11476: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 253 KiB/s wr, 26 op/s 2023-05-08T09:41:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:13 smithi186 ceph-mon[126480]: pgmap v11476: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 253 KiB/s wr, 26 op/s 2023-05-08T09:41:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21413.053768 secs 2023-05-08T09:41:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21413.053768 secs 2023-05-08T09:41:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21413.053768 secs 2023-05-08T09:41:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21413.609482 secs 2023-05-08T09:41:15.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:15 smithi133 ceph-mon[125939]: pgmap v11477: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 213 KiB/s wr, 7 op/s 2023-05-08T09:41:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21413.609482 secs 2023-05-08T09:41:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:15 smithi096 ceph-mon[124666]: pgmap v11477: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 213 KiB/s wr, 7 op/s 2023-05-08T09:41:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21413.609482 secs 2023-05-08T09:41:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:15 smithi186 ceph-mon[126480]: pgmap v11477: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 213 KiB/s wr, 7 op/s 2023-05-08T09:41:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21414.897130 secs 2023-05-08T09:41:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21414.897130 secs 2023-05-08T09:41:17.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21414.897130 secs 2023-05-08T09:41:17.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:17 smithi133 ceph-mon[125939]: pgmap v11478: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 213 KiB/s wr, 7 op/s 2023-05-08T09:41:18.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:17 smithi096 ceph-mon[124666]: pgmap v11478: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 213 KiB/s wr, 7 op/s 2023-05-08T09:41:18.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:17 smithi186 ceph-mon[126480]: pgmap v11478: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 213 KiB/s wr, 7 op/s 2023-05-08T09:41:18.995 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:41:19.605 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:18 smithi133 ceph-mon[125939]: osdmap e795: 12 total, 12 up, 12 in 2023-05-08T09:41:19.606 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:41:19.606 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:41:19.606 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:41:19.607 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:41:19.607 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:18 smithi186 ceph-mon[126480]: osdmap e795: 12 total, 12 up, 12 in 2023-05-08T09:41:19.607 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:41:19.607 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:41:19.608 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:41:19.608 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:41:19.608 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:18 smithi096 ceph-mon[124666]: osdmap e795: 12 total, 12 up, 12 in 2023-05-08T09:41:19.608 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:41:19.608 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:41:19.608 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:41:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21418.053916 secs 2023-05-08T09:41:19.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:19 smithi133 ceph-mon[125939]: pgmap v11479: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 213 KiB/s wr, 7 op/s 2023-05-08T09:41:19.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:19 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:41:19.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:19 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T09:41:19.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:19 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T09:41:19.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:19 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:41:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21418.053916 secs 2023-05-08T09:41:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:19 smithi096 ceph-mon[124666]: pgmap v11479: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 213 KiB/s wr, 7 op/s 2023-05-08T09:41:20.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:19 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:41:20.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:19 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T09:41:20.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:19 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T09:41:20.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:19 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:41:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21418.053916 secs 2023-05-08T09:41:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:19 smithi186 ceph-mon[126480]: pgmap v11479: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 213 KiB/s wr, 7 op/s 2023-05-08T09:41:20.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:19 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:41:20.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:19 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T09:41:20.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:19 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T09:41:20.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:19 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:41:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21418.609580 secs 2023-05-08T09:41:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21418.609580 secs 2023-05-08T09:41:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21418.609580 secs 2023-05-08T09:41:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21419.897245 secs 2023-05-08T09:41:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:21 smithi096 ceph-mon[124666]: pgmap v11481: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 74 KiB/s wr, 8 op/s 2023-05-08T09:41:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21419.897245 secs 2023-05-08T09:41:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:21 smithi186 ceph-mon[126480]: pgmap v11481: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 74 KiB/s wr, 8 op/s 2023-05-08T09:41:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21419.897245 secs 2023-05-08T09:41:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:21 smithi133 ceph-mon[125939]: pgmap v11481: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 74 KiB/s wr, 8 op/s 2023-05-08T09:41:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:23 smithi096 ceph-mon[124666]: pgmap v11482: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 72 KiB/s wr, 8 op/s 2023-05-08T09:41:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:23 smithi186 ceph-mon[126480]: pgmap v11482: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 72 KiB/s wr, 8 op/s 2023-05-08T09:41:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:23 smithi133 ceph-mon[125939]: pgmap v11482: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 72 KiB/s wr, 8 op/s 2023-05-08T09:41:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21423.054049 secs 2023-05-08T09:41:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21423.609702 secs 2023-05-08T09:41:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21423.054049 secs 2023-05-08T09:41:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21423.609702 secs 2023-05-08T09:41:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21423.054049 secs 2023-05-08T09:41:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21423.609702 secs 2023-05-08T09:41:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:25 smithi186 ceph-mon[126480]: pgmap v11483: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 58 KiB/s wr, 8 op/s 2023-05-08T09:41:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:25 smithi133 ceph-mon[125939]: pgmap v11483: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 58 KiB/s wr, 8 op/s 2023-05-08T09:41:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:25 smithi096 ceph-mon[124666]: pgmap v11483: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 58 KiB/s wr, 8 op/s 2023-05-08T09:41:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21424.897341 secs 2023-05-08T09:41:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21424.897341 secs 2023-05-08T09:41:27.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21424.897341 secs 2023-05-08T09:41:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:27 smithi186 ceph-mon[126480]: pgmap v11484: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 57 KiB/s wr, 8 op/s 2023-05-08T09:41:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:27 smithi133 ceph-mon[125939]: pgmap v11484: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 57 KiB/s wr, 8 op/s 2023-05-08T09:41:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:27 smithi096 ceph-mon[124666]: pgmap v11484: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 57 KiB/s wr, 8 op/s 2023-05-08T09:41:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21428.054171 secs 2023-05-08T09:41:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:29 smithi186 ceph-mon[126480]: pgmap v11485: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 57 KiB/s wr, 8 op/s 2023-05-08T09:41:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21428.609778 secs 2023-05-08T09:41:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21428.054171 secs 2023-05-08T09:41:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:29 smithi133 ceph-mon[125939]: pgmap v11485: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 57 KiB/s wr, 8 op/s 2023-05-08T09:41:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21428.609778 secs 2023-05-08T09:41:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21428.054171 secs 2023-05-08T09:41:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:29 smithi096 ceph-mon[124666]: pgmap v11485: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 57 KiB/s wr, 8 op/s 2023-05-08T09:41:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21428.609778 secs 2023-05-08T09:41:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21429.897458 secs 2023-05-08T09:41:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:31 smithi186 ceph-mon[126480]: pgmap v11486: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 119 KiB/s wr, 10 op/s 2023-05-08T09:41:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21429.897458 secs 2023-05-08T09:41:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:31 smithi133 ceph-mon[125939]: pgmap v11486: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 119 KiB/s wr, 10 op/s 2023-05-08T09:41:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21429.897458 secs 2023-05-08T09:41:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:31 smithi096 ceph-mon[124666]: pgmap v11486: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 119 KiB/s wr, 10 op/s 2023-05-08T09:41:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:33 smithi186 ceph-mon[126480]: pgmap v11487: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 71 KiB/s wr, 6 op/s 2023-05-08T09:41:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:33 smithi133 ceph-mon[125939]: pgmap v11487: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 71 KiB/s wr, 6 op/s 2023-05-08T09:41:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:33 smithi096 ceph-mon[124666]: pgmap v11487: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 71 KiB/s wr, 6 op/s 2023-05-08T09:41:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21433.054309 secs 2023-05-08T09:41:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21433.609866 secs 2023-05-08T09:41:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21433.054309 secs 2023-05-08T09:41:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21433.609866 secs 2023-05-08T09:41:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21433.054309 secs 2023-05-08T09:41:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21433.609866 secs 2023-05-08T09:41:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:35 smithi186 ceph-mon[126480]: pgmap v11488: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 72 KiB/s wr, 10 op/s 2023-05-08T09:41:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:35 smithi133 ceph-mon[125939]: pgmap v11488: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 72 KiB/s wr, 10 op/s 2023-05-08T09:41:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:35 smithi096 ceph-mon[124666]: pgmap v11488: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 72 KiB/s wr, 10 op/s 2023-05-08T09:41:37.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21434.897574 secs 2023-05-08T09:41:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21434.897574 secs 2023-05-08T09:41:37.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21434.897574 secs 2023-05-08T09:41:38.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:37 smithi186 ceph-mon[126480]: pgmap v11489: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 71 KiB/s wr, 7 op/s 2023-05-08T09:41:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:37 smithi133 ceph-mon[125939]: pgmap v11489: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 71 KiB/s wr, 7 op/s 2023-05-08T09:41:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:37 smithi096 ceph-mon[124666]: pgmap v11489: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 71 KiB/s wr, 7 op/s 2023-05-08T09:41:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21438.054470 secs 2023-05-08T09:41:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:39 smithi186 ceph-mon[126480]: pgmap v11490: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 71 KiB/s wr, 7 op/s 2023-05-08T09:41:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21438.609984 secs 2023-05-08T09:41:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21438.054470 secs 2023-05-08T09:41:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:39 smithi133 ceph-mon[125939]: pgmap v11490: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 71 KiB/s wr, 7 op/s 2023-05-08T09:41:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21438.609984 secs 2023-05-08T09:41:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21438.054470 secs 2023-05-08T09:41:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:39 smithi096 ceph-mon[124666]: pgmap v11490: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 71 KiB/s wr, 7 op/s 2023-05-08T09:41:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21438.609984 secs 2023-05-08T09:41:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21439.897686 secs 2023-05-08T09:41:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:41 smithi186 ceph-mon[126480]: pgmap v11491: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 211 KiB/s wr, 10 op/s 2023-05-08T09:41:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21439.897686 secs 2023-05-08T09:41:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:41 smithi133 ceph-mon[125939]: pgmap v11491: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 211 KiB/s wr, 10 op/s 2023-05-08T09:41:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21439.897686 secs 2023-05-08T09:41:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:41 smithi096 ceph-mon[124666]: pgmap v11491: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 211 KiB/s wr, 10 op/s 2023-05-08T09:41:44.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:43 smithi186 ceph-mon[126480]: pgmap v11492: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 140 KiB/s wr, 6 op/s 2023-05-08T09:41:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:43 smithi133 ceph-mon[125939]: pgmap v11492: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 140 KiB/s wr, 6 op/s 2023-05-08T09:41:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:43 smithi096 ceph-mon[124666]: pgmap v11492: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 140 KiB/s wr, 6 op/s 2023-05-08T09:41:45.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21443.054584 secs 2023-05-08T09:41:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21443.610079 secs 2023-05-08T09:41:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21443.054584 secs 2023-05-08T09:41:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21443.610079 secs 2023-05-08T09:41:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21443.054584 secs 2023-05-08T09:41:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21443.610079 secs 2023-05-08T09:41:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:45 smithi186 ceph-mon[126480]: pgmap v11493: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 143 KiB/s wr, 10 op/s 2023-05-08T09:41:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:45 smithi133 ceph-mon[125939]: pgmap v11493: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 143 KiB/s wr, 10 op/s 2023-05-08T09:41:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:45 smithi096 ceph-mon[124666]: pgmap v11493: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 143 KiB/s wr, 10 op/s 2023-05-08T09:41:47.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21444.897841 secs 2023-05-08T09:41:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21444.897841 secs 2023-05-08T09:41:47.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21444.897841 secs 2023-05-08T09:41:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:47 smithi186 ceph-mon[126480]: pgmap v11494: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 142 KiB/s wr, 6 op/s 2023-05-08T09:41:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:47 smithi133 ceph-mon[125939]: pgmap v11494: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 142 KiB/s wr, 6 op/s 2023-05-08T09:41:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:47 smithi096 ceph-mon[124666]: pgmap v11494: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 142 KiB/s wr, 6 op/s 2023-05-08T09:41:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21448.054696 secs 2023-05-08T09:41:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:49 smithi186 ceph-mon[126480]: pgmap v11495: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 142 KiB/s wr, 6 op/s 2023-05-08T09:41:50.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21448.054696 secs 2023-05-08T09:41:50.281 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:49 smithi133 ceph-mon[125939]: pgmap v11495: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 142 KiB/s wr, 6 op/s 2023-05-08T09:41:50.283 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21448.054696 secs 2023-05-08T09:41:50.283 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:49 smithi096 ceph-mon[124666]: pgmap v11495: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 142 KiB/s wr, 6 op/s 2023-05-08T09:41:52.129 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21449.897961 secs 2023-05-08T09:41:52.130 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:51 smithi186 ceph-mon[126480]: pgmap v11496: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 292 KiB/s wr, 11 op/s 2023-05-08T09:41:52.130 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:41:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21449.897961 secs 2023-05-08T09:41:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:51 smithi133 ceph-mon[125939]: pgmap v11496: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 292 KiB/s wr, 11 op/s 2023-05-08T09:41:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:41:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21449.897961 secs 2023-05-08T09:41:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:51 smithi096 ceph-mon[124666]: pgmap v11496: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 292 KiB/s wr, 11 op/s 2023-05-08T09:41:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:41:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:52 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:41:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:41:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:41:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:52 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:41:53.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:41:53.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:41:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:52 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:41:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:41:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:41:54.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:53 smithi186 ceph-mon[126480]: pgmap v11497: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 152 KiB/s wr, 7 op/s 2023-05-08T09:41:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:53 smithi133 ceph-mon[125939]: pgmap v11497: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 152 KiB/s wr, 7 op/s 2023-05-08T09:41:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:53 smithi096 ceph-mon[124666]: pgmap v11497: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 152 KiB/s wr, 7 op/s 2023-05-08T09:41:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21453.054838 secs 2023-05-08T09:41:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21453.054838 secs 2023-05-08T09:41:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21453.054838 secs 2023-05-08T09:41:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:55 smithi186 ceph-mon[126480]: pgmap v11498: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 561 KiB/s rd, 400 KiB/s wr, 13 op/s 2023-05-08T09:41:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:55 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:41:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:55 smithi133 ceph-mon[125939]: pgmap v11498: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 561 KiB/s rd, 400 KiB/s wr, 13 op/s 2023-05-08T09:41:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:55 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:41:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:55 smithi096 ceph-mon[124666]: pgmap v11498: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 561 KiB/s rd, 400 KiB/s wr, 13 op/s 2023-05-08T09:41:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:55 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:41:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:41:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:41:57.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:41:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:41:57.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:41:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:41:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:57 smithi186 ceph-mon[126480]: pgmap v11499: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 418 KiB/s rd, 398 KiB/s wr, 10 op/s 2023-05-08T09:41:58.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:57 smithi133 ceph-mon[125939]: pgmap v11499: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 418 KiB/s rd, 398 KiB/s wr, 10 op/s 2023-05-08T09:41:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:57 smithi096 ceph-mon[124666]: pgmap v11499: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 418 KiB/s rd, 398 KiB/s wr, 10 op/s 2023-05-08T09:41:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:58 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:41:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:58 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:41:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:58 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:42:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21458.054931 secs 2023-05-08T09:42:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:59 smithi133 ceph-mon[125939]: pgmap v11500: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 418 KiB/s rd, 398 KiB/s wr, 10 op/s 2023-05-08T09:42:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:41:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21458.610410 secs 2023-05-08T09:42:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21458.054931 secs 2023-05-08T09:42:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:59 smithi096 ceph-mon[124666]: pgmap v11500: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 418 KiB/s rd, 398 KiB/s wr, 10 op/s 2023-05-08T09:42:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:41:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21458.610410 secs 2023-05-08T09:42:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21458.054931 secs 2023-05-08T09:42:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:59 smithi186 ceph-mon[126480]: pgmap v11500: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 418 KiB/s rd, 398 KiB/s wr, 10 op/s 2023-05-08T09:42:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:41:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21458.610410 secs 2023-05-08T09:42:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:42:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:42:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:42:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:42:01.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:42:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:42:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:01 smithi133 ceph-mon[125939]: pgmap v11501: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 490 KiB/s wr, 14 op/s 2023-05-08T09:42:02.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:01 smithi096 ceph-mon[124666]: pgmap v11501: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 490 KiB/s wr, 14 op/s 2023-05-08T09:42:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:01 smithi186 ceph-mon[126480]: pgmap v11501: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 490 KiB/s wr, 14 op/s 2023-05-08T09:42:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:03 smithi133 ceph-mon[125939]: pgmap v11502: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 341 KiB/s wr, 10 op/s 2023-05-08T09:42:04.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:03 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:42:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:03 smithi096 ceph-mon[124666]: pgmap v11502: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 341 KiB/s wr, 10 op/s 2023-05-08T09:42:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:03 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:42:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:03 smithi186 ceph-mon[126480]: pgmap v11502: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 341 KiB/s wr, 10 op/s 2023-05-08T09:42:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:03 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:42:05.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21463.055047 secs 2023-05-08T09:42:05.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21463.610552 secs 2023-05-08T09:42:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21463.055047 secs 2023-05-08T09:42:05.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21463.610552 secs 2023-05-08T09:42:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21463.055047 secs 2023-05-08T09:42:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21463.610552 secs 2023-05-08T09:42:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:05 smithi133 ceph-mon[125939]: pgmap v11503: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 837 KiB/s rd, 885 KiB/s wr, 31 op/s 2023-05-08T09:42:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:05 smithi096 ceph-mon[124666]: pgmap v11503: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 837 KiB/s rd, 885 KiB/s wr, 31 op/s 2023-05-08T09:42:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:05 smithi186 ceph-mon[126480]: pgmap v11503: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 837 KiB/s rd, 885 KiB/s wr, 31 op/s 2023-05-08T09:42:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21464.898319 secs 2023-05-08T09:42:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:06 smithi133 ceph-mon[125939]: osdmap e796: 12 total, 12 up, 12 in 2023-05-08T09:42:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21464.898319 secs 2023-05-08T09:42:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:06 smithi096 ceph-mon[124666]: osdmap e796: 12 total, 12 up, 12 in 2023-05-08T09:42:07.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21464.898319 secs 2023-05-08T09:42:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:06 smithi186 ceph-mon[126480]: osdmap e796: 12 total, 12 up, 12 in 2023-05-08T09:42:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:07 smithi133 ceph-mon[125939]: pgmap v11505: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 690 KiB/s rd, 765 KiB/s wr, 30 op/s 2023-05-08T09:42:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:07 smithi096 ceph-mon[124666]: pgmap v11505: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 690 KiB/s rd, 765 KiB/s wr, 30 op/s 2023-05-08T09:42:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:07 smithi186 ceph-mon[126480]: pgmap v11505: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 690 KiB/s rd, 765 KiB/s wr, 30 op/s 2023-05-08T09:42:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:42:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:42:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:08 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:42:09.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:42:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:42:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:08 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:42:09.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:42:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:42:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:08 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:42:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21468.055164 secs 2023-05-08T09:42:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:09 smithi133 ceph-mon[125939]: pgmap v11506: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 690 KiB/s rd, 765 KiB/s wr, 30 op/s 2023-05-08T09:42:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21468.610674 secs 2023-05-08T09:42:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21468.055164 secs 2023-05-08T09:42:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:09 smithi096 ceph-mon[124666]: pgmap v11506: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 690 KiB/s rd, 765 KiB/s wr, 30 op/s 2023-05-08T09:42:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21468.610674 secs 2023-05-08T09:42:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21468.055164 secs 2023-05-08T09:42:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:09 smithi186 ceph-mon[126480]: pgmap v11506: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 690 KiB/s rd, 765 KiB/s wr, 30 op/s 2023-05-08T09:42:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21468.610674 secs 2023-05-08T09:42:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21469.898420 secs 2023-05-08T09:42:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:11 smithi133 ceph-mon[125939]: pgmap v11507: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 707 KiB/s rd, 750 KiB/s wr, 29 op/s 2023-05-08T09:42:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21469.898420 secs 2023-05-08T09:42:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:11 smithi096 ceph-mon[124666]: pgmap v11507: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 707 KiB/s rd, 750 KiB/s wr, 29 op/s 2023-05-08T09:42:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21469.898420 secs 2023-05-08T09:42:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:11 smithi186 ceph-mon[126480]: pgmap v11507: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 707 KiB/s rd, 750 KiB/s wr, 29 op/s 2023-05-08T09:42:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:13 smithi133 ceph-mon[125939]: pgmap v11508: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 707 KiB/s rd, 750 KiB/s wr, 29 op/s 2023-05-08T09:42:14.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:13 smithi133 ceph-mon[125939]: osdmap e797: 12 total, 12 up, 12 in 2023-05-08T09:42:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:13 smithi096 ceph-mon[124666]: pgmap v11508: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 707 KiB/s rd, 750 KiB/s wr, 29 op/s 2023-05-08T09:42:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:13 smithi096 ceph-mon[124666]: osdmap e797: 12 total, 12 up, 12 in 2023-05-08T09:42:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:13 smithi186 ceph-mon[126480]: pgmap v11508: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 707 KiB/s rd, 750 KiB/s wr, 29 op/s 2023-05-08T09:42:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:13 smithi186 ceph-mon[126480]: osdmap e797: 12 total, 12 up, 12 in 2023-05-08T09:42:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21473.055280 secs 2023-05-08T09:42:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21473.610772 secs 2023-05-08T09:42:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21473.055280 secs 2023-05-08T09:42:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21473.610772 secs 2023-05-08T09:42:15.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21473.055280 secs 2023-05-08T09:42:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21473.610772 secs 2023-05-08T09:42:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:15 smithi133 ceph-mon[125939]: pgmap v11510: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 209 KiB/s wr, 10 op/s 2023-05-08T09:42:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:15 smithi096 ceph-mon[124666]: pgmap v11510: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 209 KiB/s wr, 10 op/s 2023-05-08T09:42:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:15 smithi186 ceph-mon[126480]: pgmap v11510: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 209 KiB/s wr, 10 op/s 2023-05-08T09:42:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21474.898547 secs 2023-05-08T09:42:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21474.898547 secs 2023-05-08T09:42:17.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21474.898547 secs 2023-05-08T09:42:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:17 smithi133 ceph-mon[125939]: pgmap v11511: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 179 KiB/s wr, 9 op/s 2023-05-08T09:42:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:17 smithi096 ceph-mon[124666]: pgmap v11511: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 179 KiB/s wr, 9 op/s 2023-05-08T09:42:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:17 smithi186 ceph-mon[126480]: pgmap v11511: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 179 KiB/s wr, 9 op/s 2023-05-08T09:42:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21478.055398 secs 2023-05-08T09:42:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:19 smithi133 ceph-mon[125939]: pgmap v11512: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 179 KiB/s wr, 9 op/s 2023-05-08T09:42:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:19 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:42:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:19 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:42:19.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:19 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:42:19.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:19 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:42:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21478.055398 secs 2023-05-08T09:42:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:19 smithi096 ceph-mon[124666]: pgmap v11512: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 179 KiB/s wr, 9 op/s 2023-05-08T09:42:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:19 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:42:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:19 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:42:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:19 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:42:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:19 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:42:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21478.055398 secs 2023-05-08T09:42:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:19 smithi186 ceph-mon[126480]: pgmap v11512: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 179 KiB/s wr, 9 op/s 2023-05-08T09:42:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:19 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:42:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:19 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:42:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:19 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:42:19.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:19 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:42:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21478.610863 secs 2023-05-08T09:42:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:20 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:42:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:20 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T09:42:20.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:20 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T09:42:20.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:20 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:42:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21478.610863 secs 2023-05-08T09:42:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:20 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:42:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:20 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T09:42:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:20 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T09:42:20.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:20 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:42:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21478.610863 secs 2023-05-08T09:42:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:20 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:42:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:20 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T09:42:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:20 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T09:42:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:20 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:42:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21479.898685 secs 2023-05-08T09:42:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:21 smithi133 ceph-mon[125939]: pgmap v11513: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 164 KiB/s wr, 8 op/s 2023-05-08T09:42:21.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21479.898685 secs 2023-05-08T09:42:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:21 smithi096 ceph-mon[124666]: pgmap v11513: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 164 KiB/s wr, 8 op/s 2023-05-08T09:42:21.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21479.898685 secs 2023-05-08T09:42:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:21 smithi186 ceph-mon[126480]: pgmap v11513: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 164 KiB/s wr, 8 op/s 2023-05-08T09:42:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:23 smithi133 ceph-mon[125939]: pgmap v11514: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 164 KiB/s wr, 8 op/s 2023-05-08T09:42:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:23 smithi096 ceph-mon[124666]: pgmap v11514: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 164 KiB/s wr, 8 op/s 2023-05-08T09:42:23.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:23 smithi186 ceph-mon[126480]: pgmap v11514: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 164 KiB/s wr, 8 op/s 2023-05-08T09:42:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21483.055480 secs 2023-05-08T09:42:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21483.055480 secs 2023-05-08T09:42:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21483.055480 secs 2023-05-08T09:42:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21483.610999 secs 2023-05-08T09:42:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:25 smithi133 ceph-mon[125939]: pgmap v11515: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 163 KiB/s wr, 10 op/s 2023-05-08T09:42:25.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21483.610999 secs 2023-05-08T09:42:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:25 smithi096 ceph-mon[124666]: pgmap v11515: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 163 KiB/s wr, 10 op/s 2023-05-08T09:42:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21483.610999 secs 2023-05-08T09:42:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:25 smithi186 ceph-mon[126480]: pgmap v11515: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 163 KiB/s wr, 10 op/s 2023-05-08T09:42:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21484.898832 secs 2023-05-08T09:42:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21484.898832 secs 2023-05-08T09:42:26.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21484.898832 secs 2023-05-08T09:42:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:27 smithi096 ceph-mon[124666]: pgmap v11516: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 80 KiB/s wr, 6 op/s 2023-05-08T09:42:27.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:27 smithi186 ceph-mon[126480]: pgmap v11516: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 80 KiB/s wr, 6 op/s 2023-05-08T09:42:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:27 smithi133 ceph-mon[125939]: pgmap v11516: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 80 KiB/s wr, 6 op/s 2023-05-08T09:42:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21488.055600 secs 2023-05-08T09:42:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:29 smithi096 ceph-mon[124666]: pgmap v11517: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 80 KiB/s wr, 6 op/s 2023-05-08T09:42:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21488.055600 secs 2023-05-08T09:42:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:29 smithi186 ceph-mon[126480]: pgmap v11517: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 80 KiB/s wr, 6 op/s 2023-05-08T09:42:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21488.055600 secs 2023-05-08T09:42:29.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:29 smithi133 ceph-mon[125939]: pgmap v11517: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 80 KiB/s wr, 6 op/s 2023-05-08T09:42:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21488.611113 secs 2023-05-08T09:42:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21488.611113 secs 2023-05-08T09:42:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21488.611113 secs 2023-05-08T09:42:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21489.898952 secs 2023-05-08T09:42:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:31 smithi096 ceph-mon[124666]: pgmap v11518: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 81 KiB/s wr, 9 op/s 2023-05-08T09:42:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21489.898952 secs 2023-05-08T09:42:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:31 smithi186 ceph-mon[126480]: pgmap v11518: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 81 KiB/s wr, 9 op/s 2023-05-08T09:42:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21489.898952 secs 2023-05-08T09:42:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:31 smithi133 ceph-mon[125939]: pgmap v11518: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 81 KiB/s wr, 9 op/s 2023-05-08T09:42:33.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:33 smithi186 ceph-mon[126480]: pgmap v11519: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 6 op/s 2023-05-08T09:42:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:33 smithi133 ceph-mon[125939]: pgmap v11519: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 6 op/s 2023-05-08T09:42:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:33 smithi096 ceph-mon[124666]: pgmap v11519: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 6 op/s 2023-05-08T09:42:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21493.055714 secs 2023-05-08T09:42:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21493.055714 secs 2023-05-08T09:42:35.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21493.055714 secs 2023-05-08T09:42:35.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21493.611252 secs 2023-05-08T09:42:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:35 smithi186 ceph-mon[126480]: pgmap v11520: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 84 KiB/s wr, 10 op/s 2023-05-08T09:42:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21493.611252 secs 2023-05-08T09:42:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:35 smithi133 ceph-mon[125939]: pgmap v11520: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 84 KiB/s wr, 10 op/s 2023-05-08T09:42:36.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21493.611252 secs 2023-05-08T09:42:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:35 smithi096 ceph-mon[124666]: pgmap v11520: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 84 KiB/s wr, 10 op/s 2023-05-08T09:42:36.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21494.899070 secs 2023-05-08T09:42:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21494.899070 secs 2023-05-08T09:42:37.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21494.899070 secs 2023-05-08T09:42:37.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:37 smithi186 ceph-mon[126480]: pgmap v11521: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 72 KiB/s wr, 7 op/s 2023-05-08T09:42:37.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:37 smithi133 ceph-mon[125939]: pgmap v11521: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 72 KiB/s wr, 7 op/s 2023-05-08T09:42:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:37 smithi096 ceph-mon[124666]: pgmap v11521: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 72 KiB/s wr, 7 op/s 2023-05-08T09:42:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21498.055810 secs 2023-05-08T09:42:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:39 smithi186 ceph-mon[126480]: pgmap v11522: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 72 KiB/s wr, 7 op/s 2023-05-08T09:42:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21498.055810 secs 2023-05-08T09:42:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:39 smithi133 ceph-mon[125939]: pgmap v11522: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 72 KiB/s wr, 7 op/s 2023-05-08T09:42:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21498.055810 secs 2023-05-08T09:42:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:39 smithi096 ceph-mon[124666]: pgmap v11522: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 72 KiB/s wr, 7 op/s 2023-05-08T09:42:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21498.611386 secs 2023-05-08T09:42:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21498.611386 secs 2023-05-08T09:42:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21498.611386 secs 2023-05-08T09:42:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21499.899193 secs 2023-05-08T09:42:41.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:41 smithi186 ceph-mon[126480]: pgmap v11523: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 72 KiB/s wr, 10 op/s 2023-05-08T09:42:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21499.899193 secs 2023-05-08T09:42:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:41 smithi133 ceph-mon[125939]: pgmap v11523: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 72 KiB/s wr, 10 op/s 2023-05-08T09:42:42.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21499.899193 secs 2023-05-08T09:42:42.009 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:41 smithi096 ceph-mon[124666]: pgmap v11523: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 72 KiB/s wr, 10 op/s 2023-05-08T09:42:43.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:43 smithi186 ceph-mon[126480]: pgmap v11524: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 72 KiB/s wr, 7 op/s 2023-05-08T09:42:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:43 smithi133 ceph-mon[125939]: pgmap v11524: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 72 KiB/s wr, 7 op/s 2023-05-08T09:42:44.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:43 smithi096 ceph-mon[124666]: pgmap v11524: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 72 KiB/s wr, 7 op/s 2023-05-08T09:42:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21503.055927 secs 2023-05-08T09:42:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21503.055927 secs 2023-05-08T09:42:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21503.055927 secs 2023-05-08T09:42:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21503.611538 secs 2023-05-08T09:42:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:45 smithi186 ceph-mon[126480]: pgmap v11525: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 363 KiB/s wr, 11 op/s 2023-05-08T09:42:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21503.611538 secs 2023-05-08T09:42:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:45 smithi133 ceph-mon[125939]: pgmap v11525: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 363 KiB/s wr, 11 op/s 2023-05-08T09:42:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21503.611538 secs 2023-05-08T09:42:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:45 smithi096 ceph-mon[124666]: pgmap v11525: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 363 KiB/s wr, 11 op/s 2023-05-08T09:42:46.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21504.899309 secs 2023-05-08T09:42:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21504.899309 secs 2023-05-08T09:42:47.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21504.899309 secs 2023-05-08T09:42:47.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:47 smithi186 ceph-mon[126480]: pgmap v11526: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 292 KiB/s wr, 7 op/s 2023-05-08T09:42:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:47 smithi133 ceph-mon[125939]: pgmap v11526: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 292 KiB/s wr, 7 op/s 2023-05-08T09:42:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:47 smithi096 ceph-mon[124666]: pgmap v11526: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 292 KiB/s wr, 7 op/s 2023-05-08T09:42:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21508.056062 secs 2023-05-08T09:42:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:49 smithi186 ceph-mon[126480]: pgmap v11527: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 292 KiB/s wr, 7 op/s 2023-05-08T09:42:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21508.056062 secs 2023-05-08T09:42:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:49 smithi133 ceph-mon[125939]: pgmap v11527: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 292 KiB/s wr, 7 op/s 2023-05-08T09:42:50.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21508.056062 secs 2023-05-08T09:42:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:49 smithi096 ceph-mon[124666]: pgmap v11527: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 292 KiB/s wr, 7 op/s 2023-05-08T09:42:51.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:51 smithi186 ceph-mon[126480]: pgmap v11528: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 529 KiB/s rd, 445 KiB/s wr, 13 op/s 2023-05-08T09:42:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:42:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:42:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:51 smithi133 ceph-mon[125939]: pgmap v11528: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 529 KiB/s rd, 445 KiB/s wr, 13 op/s 2023-05-08T09:42:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:42:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:42:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:51 smithi096 ceph-mon[124666]: pgmap v11528: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 529 KiB/s rd, 445 KiB/s wr, 13 op/s 2023-05-08T09:42:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:42:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:42:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:52 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:42:52.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:42:52.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:42:52.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:42:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:52 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:42:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:42:52.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:42:52.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:42:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:52 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:42:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:42:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:42:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:42:53.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:53 smithi186 ceph-mon[126480]: pgmap v11529: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 444 KiB/s wr, 9 op/s 2023-05-08T09:42:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:53 smithi133 ceph-mon[125939]: pgmap v11529: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 444 KiB/s wr, 9 op/s 2023-05-08T09:42:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:53 smithi096 ceph-mon[124666]: pgmap v11529: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 444 KiB/s wr, 9 op/s 2023-05-08T09:42:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21513.056200 secs 2023-05-08T09:42:54.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21513.056200 secs 2023-05-08T09:42:55.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21513.056200 secs 2023-05-08T09:42:55.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21513.611791 secs 2023-05-08T09:42:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:55 smithi186 ceph-mon[126480]: pgmap v11530: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 623 KiB/s rd, 625 KiB/s wr, 14 op/s 2023-05-08T09:42:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21513.611791 secs 2023-05-08T09:42:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:55 smithi133 ceph-mon[125939]: pgmap v11530: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 623 KiB/s rd, 625 KiB/s wr, 14 op/s 2023-05-08T09:42:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21513.611791 secs 2023-05-08T09:42:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:55 smithi096 ceph-mon[124666]: pgmap v11530: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 623 KiB/s rd, 625 KiB/s wr, 14 op/s 2023-05-08T09:42:56.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:42:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:42:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:42:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:42:57.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:42:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:42:57.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:57 smithi186 ceph-mon[126480]: pgmap v11531: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 483 KiB/s rd, 334 KiB/s wr, 10 op/s 2023-05-08T09:42:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:57 smithi133 ceph-mon[125939]: pgmap v11531: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 483 KiB/s rd, 334 KiB/s wr, 10 op/s 2023-05-08T09:42:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:57 smithi096 ceph-mon[124666]: pgmap v11531: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 483 KiB/s rd, 334 KiB/s wr, 10 op/s 2023-05-08T09:42:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:58 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:42:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:58 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:42:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:58 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:42:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21518.056353 secs 2023-05-08T09:42:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:59 smithi186 ceph-mon[126480]: pgmap v11532: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 483 KiB/s rd, 334 KiB/s wr, 10 op/s 2023-05-08T09:42:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:42:59 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:42:59.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21518.056353 secs 2023-05-08T09:42:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:59 smithi133 ceph-mon[125939]: pgmap v11532: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 483 KiB/s rd, 334 KiB/s wr, 10 op/s 2023-05-08T09:42:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:42:59 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:43:00.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21518.056353 secs 2023-05-08T09:43:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:59 smithi096 ceph-mon[124666]: pgmap v11532: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 483 KiB/s rd, 334 KiB/s wr, 10 op/s 2023-05-08T09:43:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:42:59 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:43:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:43:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:43:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:43:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:43:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:43:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:43:01.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:01 smithi186 ceph-mon[126480]: pgmap v11533: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 663 KiB/s rd, 497 KiB/s wr, 15 op/s 2023-05-08T09:43:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:01 smithi133 ceph-mon[125939]: pgmap v11533: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 663 KiB/s rd, 497 KiB/s wr, 15 op/s 2023-05-08T09:43:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:01 smithi096 ceph-mon[124666]: pgmap v11533: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 663 KiB/s rd, 497 KiB/s wr, 15 op/s 2023-05-08T09:43:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:03 smithi133 ceph-mon[125939]: pgmap v11534: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 345 KiB/s wr, 9 op/s 2023-05-08T09:43:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:03 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:43:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:03 smithi096 ceph-mon[124666]: pgmap v11534: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 345 KiB/s wr, 9 op/s 2023-05-08T09:43:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:03 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:43:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:03 smithi186 ceph-mon[126480]: pgmap v11534: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 345 KiB/s wr, 9 op/s 2023-05-08T09:43:04.188 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:03 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:43:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21523.056463 secs 2023-05-08T09:43:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21523.056463 secs 2023-05-08T09:43:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21523.056463 secs 2023-05-08T09:43:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21523.612073 secs 2023-05-08T09:43:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:05 smithi133 ceph-mon[125939]: pgmap v11535: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 513 KiB/s wr, 28 op/s 2023-05-08T09:43:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21523.612073 secs 2023-05-08T09:43:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:05 smithi096 ceph-mon[124666]: pgmap v11535: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 513 KiB/s wr, 28 op/s 2023-05-08T09:43:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21523.612073 secs 2023-05-08T09:43:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:05 smithi186 ceph-mon[126480]: pgmap v11535: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 513 KiB/s wr, 28 op/s 2023-05-08T09:43:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21524.899801 secs 2023-05-08T09:43:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:06 smithi133 ceph-mon[125939]: osdmap e798: 12 total, 12 up, 12 in 2023-05-08T09:43:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21524.899801 secs 2023-05-08T09:43:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:06 smithi096 ceph-mon[124666]: osdmap e798: 12 total, 12 up, 12 in 2023-05-08T09:43:07.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21524.899801 secs 2023-05-08T09:43:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:06 smithi186 ceph-mon[126480]: osdmap e798: 12 total, 12 up, 12 in 2023-05-08T09:43:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:07 smithi133 ceph-mon[125939]: pgmap v11537: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 398 KiB/s wr, 28 op/s 2023-05-08T09:43:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:07 smithi096 ceph-mon[124666]: pgmap v11537: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 398 KiB/s wr, 28 op/s 2023-05-08T09:43:08.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:07 smithi186 ceph-mon[126480]: pgmap v11537: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 398 KiB/s wr, 28 op/s 2023-05-08T09:43:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:43:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:43:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:43:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:08 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:43:09.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:43:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:43:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:43:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:08 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:43:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:43:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:43:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:43:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:08 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:43:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21528.056585 secs 2023-05-08T09:43:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:09 smithi133 ceph-mon[125939]: pgmap v11538: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 398 KiB/s wr, 28 op/s 2023-05-08T09:43:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21528.056585 secs 2023-05-08T09:43:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:09 smithi096 ceph-mon[124666]: pgmap v11538: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 398 KiB/s wr, 28 op/s 2023-05-08T09:43:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21528.056585 secs 2023-05-08T09:43:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:09 smithi186 ceph-mon[126480]: pgmap v11538: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 398 KiB/s wr, 28 op/s 2023-05-08T09:43:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21528.612216 secs 2023-05-08T09:43:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21528.612216 secs 2023-05-08T09:43:11.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21528.612216 secs 2023-05-08T09:43:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21529.899862 secs 2023-05-08T09:43:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:11 smithi133 ceph-mon[125939]: pgmap v11539: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 296 KiB/s wr, 26 op/s 2023-05-08T09:43:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21529.899862 secs 2023-05-08T09:43:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:11 smithi096 ceph-mon[124666]: pgmap v11539: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 296 KiB/s wr, 26 op/s 2023-05-08T09:43:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21529.899862 secs 2023-05-08T09:43:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:11 smithi186 ceph-mon[126480]: pgmap v11539: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 296 KiB/s wr, 26 op/s 2023-05-08T09:43:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:13 smithi133 ceph-mon[125939]: pgmap v11540: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 296 KiB/s wr, 26 op/s 2023-05-08T09:43:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:13 smithi133 ceph-mon[125939]: osdmap e799: 12 total, 12 up, 12 in 2023-05-08T09:43:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:13 smithi096 ceph-mon[124666]: pgmap v11540: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 296 KiB/s wr, 26 op/s 2023-05-08T09:43:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:13 smithi096 ceph-mon[124666]: osdmap e799: 12 total, 12 up, 12 in 2023-05-08T09:43:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:13 smithi186 ceph-mon[126480]: pgmap v11540: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 296 KiB/s wr, 26 op/s 2023-05-08T09:43:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:13 smithi186 ceph-mon[126480]: osdmap e799: 12 total, 12 up, 12 in 2023-05-08T09:43:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21533.056695 secs 2023-05-08T09:43:15.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21533.056695 secs 2023-05-08T09:43:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21533.056695 secs 2023-05-08T09:43:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21533.612370 secs 2023-05-08T09:43:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:15 smithi133 ceph-mon[125939]: pgmap v11542: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 216 KiB/s wr, 10 op/s 2023-05-08T09:43:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21533.612370 secs 2023-05-08T09:43:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:15 smithi096 ceph-mon[124666]: pgmap v11542: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 216 KiB/s wr, 10 op/s 2023-05-08T09:43:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21533.612370 secs 2023-05-08T09:43:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:15 smithi186 ceph-mon[126480]: pgmap v11542: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 216 KiB/s wr, 10 op/s 2023-05-08T09:43:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21534.899946 secs 2023-05-08T09:43:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21534.899946 secs 2023-05-08T09:43:17.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21534.899946 secs 2023-05-08T09:43:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:17 smithi133 ceph-mon[125939]: pgmap v11543: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 191 KiB/s wr, 8 op/s 2023-05-08T09:43:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:17 smithi096 ceph-mon[124666]: pgmap v11543: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 191 KiB/s wr, 8 op/s 2023-05-08T09:43:18.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:17 smithi186 ceph-mon[126480]: pgmap v11543: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 191 KiB/s wr, 8 op/s 2023-05-08T09:43:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21538.056815 secs 2023-05-08T09:43:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:19 smithi133 ceph-mon[125939]: pgmap v11544: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 191 KiB/s wr, 8 op/s 2023-05-08T09:43:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:19 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:43:20.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21538.056815 secs 2023-05-08T09:43:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:19 smithi096 ceph-mon[124666]: pgmap v11544: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 191 KiB/s wr, 8 op/s 2023-05-08T09:43:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:19 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:43:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21538.056815 secs 2023-05-08T09:43:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:19 smithi186 ceph-mon[126480]: pgmap v11544: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 191 KiB/s wr, 8 op/s 2023-05-08T09:43:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:19 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:43:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21538.612523 secs 2023-05-08T09:43:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:20 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:43:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:20 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:43:20.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:20 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:43:20.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:20 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:43:20.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:20 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:43:20.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:20 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:43:20.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:20 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:43:20.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:20 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:43:20.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:20 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:43:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21538.612523 secs 2023-05-08T09:43:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:20 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:43:21.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:20 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:43:21.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:20 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:43:21.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:20 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:43:21.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:20 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:43:21.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:20 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:43:21.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:20 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:43:21.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:20 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:43:21.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:20 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:43:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21538.612523 secs 2023-05-08T09:43:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:20 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:43:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:20 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:43:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:20 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:43:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:20 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:43:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:20 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:43:21.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:20 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:43:21.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:20 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:43:21.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:20 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:43:21.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:20 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:43:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:22 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21539.900015 secs 2023-05-08T09:43:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:22 smithi096 ceph-mon[124666]: pgmap v11545: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 111 KiB/s wr, 9 op/s 2023-05-08T09:43:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:22 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:43:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:22 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T09:43:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:22 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T09:43:22.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:22 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:43:22.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:22 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21539.900015 secs 2023-05-08T09:43:22.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:22 smithi186 ceph-mon[126480]: pgmap v11545: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 111 KiB/s wr, 9 op/s 2023-05-08T09:43:22.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:22 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:43:22.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:22 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T09:43:22.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:22 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T09:43:22.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:22 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:43:22.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:22 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21539.900015 secs 2023-05-08T09:43:22.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:22 smithi133 ceph-mon[125939]: pgmap v11545: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 111 KiB/s wr, 9 op/s 2023-05-08T09:43:22.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:22 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:43:22.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:22 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T09:43:22.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:22 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T09:43:22.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:22 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:43:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:24 smithi186 ceph-mon[126480]: pgmap v11546: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 111 KiB/s wr, 9 op/s 2023-05-08T09:43:24.547 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:24 smithi096 ceph-mon[124666]: pgmap v11546: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 111 KiB/s wr, 9 op/s 2023-05-08T09:43:24.547 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:24 smithi133 ceph-mon[125939]: pgmap v11546: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 111 KiB/s wr, 9 op/s 2023-05-08T09:43:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21543.056882 secs 2023-05-08T09:43:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21543.612622 secs 2023-05-08T09:43:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21543.056882 secs 2023-05-08T09:43:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21543.612622 secs 2023-05-08T09:43:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21543.056882 secs 2023-05-08T09:43:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21543.612622 secs 2023-05-08T09:43:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:26 smithi186 ceph-mon[126480]: pgmap v11547: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 104 KiB/s wr, 13 op/s 2023-05-08T09:43:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:26 smithi133 ceph-mon[125939]: pgmap v11547: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 104 KiB/s wr, 13 op/s 2023-05-08T09:43:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:26 smithi096 ceph-mon[124666]: pgmap v11547: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 104 KiB/s wr, 13 op/s 2023-05-08T09:43:27.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:27 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21544.900154 secs 2023-05-08T09:43:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:27 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21544.900154 secs 2023-05-08T09:43:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:27 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21544.900154 secs 2023-05-08T09:43:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:28 smithi186 ceph-mon[126480]: pgmap v11548: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 15 KiB/s wr, 8 op/s 2023-05-08T09:43:28.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:28 smithi133 ceph-mon[125939]: pgmap v11548: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 15 KiB/s wr, 8 op/s 2023-05-08T09:43:28.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:28 smithi096 ceph-mon[124666]: pgmap v11548: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 15 KiB/s wr, 8 op/s 2023-05-08T09:43:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21548.057021 secs 2023-05-08T09:43:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:30 smithi186 ceph-mon[126480]: pgmap v11549: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 15 KiB/s wr, 8 op/s 2023-05-08T09:43:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21548.612752 secs 2023-05-08T09:43:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21548.057021 secs 2023-05-08T09:43:30.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:30 smithi133 ceph-mon[125939]: pgmap v11549: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 15 KiB/s wr, 8 op/s 2023-05-08T09:43:30.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21548.612752 secs 2023-05-08T09:43:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21548.057021 secs 2023-05-08T09:43:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:30 smithi096 ceph-mon[124666]: pgmap v11549: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 15 KiB/s wr, 8 op/s 2023-05-08T09:43:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21548.612752 secs 2023-05-08T09:43:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:32 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21549.900228 secs 2023-05-08T09:43:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:32 smithi186 ceph-mon[126480]: pgmap v11550: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 157 KiB/s wr, 12 op/s 2023-05-08T09:43:32.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:32 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21549.900228 secs 2023-05-08T09:43:32.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:32 smithi133 ceph-mon[125939]: pgmap v11550: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 157 KiB/s wr, 12 op/s 2023-05-08T09:43:32.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:32 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21549.900228 secs 2023-05-08T09:43:32.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:32 smithi096 ceph-mon[124666]: pgmap v11550: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 157 KiB/s wr, 12 op/s 2023-05-08T09:43:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:34 smithi186 ceph-mon[126480]: pgmap v11551: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 144 KiB/s wr, 8 op/s 2023-05-08T09:43:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21553.057157 secs 2023-05-08T09:43:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:34 smithi133 ceph-mon[125939]: pgmap v11551: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 144 KiB/s wr, 8 op/s 2023-05-08T09:43:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21553.057157 secs 2023-05-08T09:43:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:34 smithi096 ceph-mon[124666]: pgmap v11551: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 144 KiB/s wr, 8 op/s 2023-05-08T09:43:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21553.057157 secs 2023-05-08T09:43:35.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21553.612897 secs 2023-05-08T09:43:35.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21553.612897 secs 2023-05-08T09:43:35.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21553.612897 secs 2023-05-08T09:43:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:36 smithi186 ceph-mon[126480]: pgmap v11552: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 145 KiB/s wr, 12 op/s 2023-05-08T09:43:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:36 smithi133 ceph-mon[125939]: pgmap v11552: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 145 KiB/s wr, 12 op/s 2023-05-08T09:43:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:36 smithi096 ceph-mon[124666]: pgmap v11552: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 145 KiB/s wr, 12 op/s 2023-05-08T09:43:37.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:37 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21554.900343 secs 2023-05-08T09:43:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:37 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21554.900343 secs 2023-05-08T09:43:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:37 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21554.900343 secs 2023-05-08T09:43:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:38 smithi186 ceph-mon[126480]: pgmap v11553: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 143 KiB/s wr, 8 op/s 2023-05-08T09:43:38.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:38 smithi133 ceph-mon[125939]: pgmap v11553: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 143 KiB/s wr, 8 op/s 2023-05-08T09:43:38.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:38 smithi096 ceph-mon[124666]: pgmap v11553: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 143 KiB/s wr, 8 op/s 2023-05-08T09:43:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21558.057308 secs 2023-05-08T09:43:39.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21558.057308 secs 2023-05-08T09:43:39.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21558.057308 secs 2023-05-08T09:43:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:40 smithi186 ceph-mon[126480]: pgmap v11554: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 143 KiB/s wr, 8 op/s 2023-05-08T09:43:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21558.613042 secs 2023-05-08T09:43:40.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:40 smithi133 ceph-mon[125939]: pgmap v11554: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 143 KiB/s wr, 8 op/s 2023-05-08T09:43:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21558.613042 secs 2023-05-08T09:43:40.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:40 smithi096 ceph-mon[124666]: pgmap v11554: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 143 KiB/s wr, 8 op/s 2023-05-08T09:43:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21558.613042 secs 2023-05-08T09:43:42.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:42 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21559.900477 secs 2023-05-08T09:43:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:42 smithi186 ceph-mon[126480]: pgmap v11555: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 214 KiB/s wr, 11 op/s 2023-05-08T09:43:42.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:42 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21559.900477 secs 2023-05-08T09:43:42.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:42 smithi133 ceph-mon[125939]: pgmap v11555: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 214 KiB/s wr, 11 op/s 2023-05-08T09:43:42.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:42 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21559.900477 secs 2023-05-08T09:43:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:42 smithi096 ceph-mon[124666]: pgmap v11555: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 214 KiB/s wr, 11 op/s 2023-05-08T09:43:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:44 smithi186 ceph-mon[126480]: pgmap v11556: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 72 KiB/s wr, 6 op/s 2023-05-08T09:43:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21563.057429 secs 2023-05-08T09:43:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:44 smithi133 ceph-mon[125939]: pgmap v11556: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 72 KiB/s wr, 6 op/s 2023-05-08T09:43:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21563.057429 secs 2023-05-08T09:43:44.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:44 smithi096 ceph-mon[124666]: pgmap v11556: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 72 KiB/s wr, 6 op/s 2023-05-08T09:43:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21563.057429 secs 2023-05-08T09:43:45.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21563.613180 secs 2023-05-08T09:43:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21563.613180 secs 2023-05-08T09:43:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21563.613180 secs 2023-05-08T09:43:46.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:46 smithi186 ceph-mon[126480]: pgmap v11557: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 74 KiB/s wr, 10 op/s 2023-05-08T09:43:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21564.900620 secs 2023-05-08T09:43:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:46 smithi133 ceph-mon[125939]: pgmap v11557: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 74 KiB/s wr, 10 op/s 2023-05-08T09:43:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21564.900620 secs 2023-05-08T09:43:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:46 smithi096 ceph-mon[124666]: pgmap v11557: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 74 KiB/s wr, 10 op/s 2023-05-08T09:43:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21564.900620 secs 2023-05-08T09:43:48.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:48 smithi186 ceph-mon[126480]: pgmap v11558: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 73 KiB/s wr, 6 op/s 2023-05-08T09:43:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:48 smithi133 ceph-mon[125939]: pgmap v11558: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 73 KiB/s wr, 6 op/s 2023-05-08T09:43:48.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:48 smithi096 ceph-mon[124666]: pgmap v11558: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 73 KiB/s wr, 6 op/s 2023-05-08T09:43:49.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21568.057548 secs 2023-05-08T09:43:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21568.057548 secs 2023-05-08T09:43:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21568.057548 secs 2023-05-08T09:43:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:50 smithi186 ceph-mon[126480]: pgmap v11559: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 73 KiB/s wr, 6 op/s 2023-05-08T09:43:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:50 smithi133 ceph-mon[125939]: pgmap v11559: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 73 KiB/s wr, 6 op/s 2023-05-08T09:43:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:50 smithi096 ceph-mon[124666]: pgmap v11559: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 73 KiB/s wr, 6 op/s 2023-05-08T09:43:52.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:52 smithi186 ceph-mon[126480]: pgmap v11560: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 301 KiB/s wr, 11 op/s 2023-05-08T09:43:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:43:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:43:52.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:52 smithi133 ceph-mon[125939]: pgmap v11560: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 301 KiB/s wr, 11 op/s 2023-05-08T09:43:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:43:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:43:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:52 smithi096 ceph-mon[124666]: pgmap v11560: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 301 KiB/s wr, 11 op/s 2023-05-08T09:43:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:43:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:43:53.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:53 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:43:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:43:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:43:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:43:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:53 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:43:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:43:53.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:43:53.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:43:53.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:53 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:43:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:43:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:43:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:43:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:54 smithi186 ceph-mon[126480]: pgmap v11561: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 230 KiB/s wr, 8 op/s 2023-05-08T09:43:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21573.057678 secs 2023-05-08T09:43:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:54 smithi133 ceph-mon[125939]: pgmap v11561: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 230 KiB/s wr, 8 op/s 2023-05-08T09:43:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21573.057678 secs 2023-05-08T09:43:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:54 smithi096 ceph-mon[124666]: pgmap v11561: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 230 KiB/s wr, 8 op/s 2023-05-08T09:43:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21573.057678 secs 2023-05-08T09:43:56.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:56 smithi186 ceph-mon[126480]: pgmap v11562: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 427 KiB/s rd, 413 KiB/s wr, 14 op/s 2023-05-08T09:43:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:56 smithi133 ceph-mon[125939]: pgmap v11562: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 427 KiB/s rd, 413 KiB/s wr, 14 op/s 2023-05-08T09:43:56.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:56 smithi096 ceph-mon[124666]: pgmap v11562: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 427 KiB/s rd, 413 KiB/s wr, 14 op/s 2023-05-08T09:43:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:58 smithi186 ceph-mon[126480]: pgmap v11563: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 424 KiB/s rd, 411 KiB/s wr, 10 op/s 2023-05-08T09:43:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:58 smithi133 ceph-mon[125939]: pgmap v11563: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 424 KiB/s rd, 411 KiB/s wr, 10 op/s 2023-05-08T09:43:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:58 smithi096 ceph-mon[124666]: pgmap v11563: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 424 KiB/s rd, 411 KiB/s wr, 10 op/s 2023-05-08T09:43:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:43:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21578.057775 secs 2023-05-08T09:43:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:43:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21578.057775 secs 2023-05-08T09:43:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:43:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21578.057775 secs 2023-05-08T09:44:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:00 smithi186 ceph-mon[126480]: pgmap v11564: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 424 KiB/s rd, 411 KiB/s wr, 10 op/s 2023-05-08T09:44:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21578.613583 secs 2023-05-08T09:44:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:00 smithi133 ceph-mon[125939]: pgmap v11564: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 424 KiB/s rd, 411 KiB/s wr, 10 op/s 2023-05-08T09:44:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21578.613583 secs 2023-05-08T09:44:00.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:00 smithi096 ceph-mon[124666]: pgmap v11564: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 424 KiB/s rd, 411 KiB/s wr, 10 op/s 2023-05-08T09:44:00.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21578.613583 secs 2023-05-08T09:44:01.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:01 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:44:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:44:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:44:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:01 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:44:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:44:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:44:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:01 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:44:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:44:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:44:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:02 smithi133 ceph-mon[125939]: pgmap v11565: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 512 KiB/s wr, 15 op/s 2023-05-08T09:44:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:02 smithi096 ceph-mon[124666]: pgmap v11565: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 512 KiB/s wr, 15 op/s 2023-05-08T09:44:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:02 smithi186 ceph-mon[126480]: pgmap v11565: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 512 KiB/s wr, 15 op/s 2023-05-08T09:44:04.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:04 smithi133 ceph-mon[125939]: pgmap v11566: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 319 KiB/s rd, 284 KiB/s wr, 10 op/s 2023-05-08T09:44:04.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:04 smithi096 ceph-mon[124666]: pgmap v11566: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 319 KiB/s rd, 284 KiB/s wr, 10 op/s 2023-05-08T09:44:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:04 smithi186 ceph-mon[126480]: pgmap v11566: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 319 KiB/s rd, 284 KiB/s wr, 10 op/s 2023-05-08T09:44:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21583.613713 secs 2023-05-08T09:44:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21583.613713 secs 2023-05-08T09:44:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21583.613713 secs 2023-05-08T09:44:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:06 smithi133 ceph-mon[125939]: pgmap v11567: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 582 KiB/s rd, 562 KiB/s wr, 24 op/s 2023-05-08T09:44:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:06 smithi096 ceph-mon[124666]: pgmap v11567: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 582 KiB/s rd, 562 KiB/s wr, 24 op/s 2023-05-08T09:44:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:06 smithi186 ceph-mon[126480]: pgmap v11567: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 582 KiB/s rd, 562 KiB/s wr, 24 op/s 2023-05-08T09:44:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:07 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:44:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:07 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:44:07.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:07 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:44:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:08 smithi133 ceph-mon[125939]: pgmap v11568: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 378 KiB/s wr, 18 op/s 2023-05-08T09:44:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:08 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:44:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T09:44:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:44:08.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:08 smithi096 ceph-mon[124666]: pgmap v11568: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 378 KiB/s wr, 18 op/s 2023-05-08T09:44:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:08 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:44:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T09:44:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:44:08.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:08 smithi186 ceph-mon[126480]: pgmap v11568: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 378 KiB/s wr, 18 op/s 2023-05-08T09:44:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:08 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:44:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T09:44:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:44:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21588.058022 secs 2023-05-08T09:44:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:09 smithi133 ceph-mon[125939]: pgmap v11569: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 378 KiB/s wr, 18 op/s 2023-05-08T09:44:09.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21588.058022 secs 2023-05-08T09:44:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:09 smithi096 ceph-mon[124666]: pgmap v11569: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 378 KiB/s wr, 18 op/s 2023-05-08T09:44:09.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21588.058022 secs 2023-05-08T09:44:09.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:09 smithi186 ceph-mon[126480]: pgmap v11569: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 378 KiB/s wr, 18 op/s 2023-05-08T09:44:11.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:11 smithi186 ceph-mon[126480]: pgmap v11570: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 553 KiB/s rd, 528 KiB/s wr, 26 op/s 2023-05-08T09:44:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:11 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T09:44:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:11 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:44:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:11 smithi133 ceph-mon[125939]: pgmap v11570: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 553 KiB/s rd, 528 KiB/s wr, 26 op/s 2023-05-08T09:44:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:11 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T09:44:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:11 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:44:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:11 smithi096 ceph-mon[124666]: pgmap v11570: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 553 KiB/s rd, 528 KiB/s wr, 26 op/s 2023-05-08T09:44:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:11 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T09:44:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:11 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:44:12.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:12 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:44:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:12 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:44:13.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:12 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:44:13.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:13 smithi186 ceph-mon[126480]: pgmap v11571: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 427 KiB/s wr, 21 op/s 2023-05-08T09:44:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:13 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:44:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:44:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:13 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:44:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21593.058136 secs 2023-05-08T09:44:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:13 smithi133 ceph-mon[125939]: pgmap v11571: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 427 KiB/s wr, 21 op/s 2023-05-08T09:44:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:13 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:44:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:44:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:13 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:44:13.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21593.058136 secs 2023-05-08T09:44:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:13 smithi096 ceph-mon[124666]: pgmap v11571: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 427 KiB/s wr, 21 op/s 2023-05-08T09:44:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:13 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:44:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:44:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:13 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:44:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21593.058136 secs 2023-05-08T09:44:15.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:15 smithi186 ceph-mon[126480]: pgmap v11572: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 570 KiB/s rd, 567 KiB/s wr, 25 op/s 2023-05-08T09:44:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:15 smithi133 ceph-mon[125939]: pgmap v11572: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 570 KiB/s rd, 567 KiB/s wr, 25 op/s 2023-05-08T09:44:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:15 smithi096 ceph-mon[124666]: pgmap v11572: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 570 KiB/s rd, 567 KiB/s wr, 25 op/s 2023-05-08T09:44:17.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:17 smithi186 ceph-mon[126480]: pgmap v11573: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 290 KiB/s wr, 12 op/s 2023-05-08T09:44:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:17 smithi133 ceph-mon[125939]: pgmap v11573: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 290 KiB/s wr, 12 op/s 2023-05-08T09:44:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:17 smithi096 ceph-mon[124666]: pgmap v11573: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 290 KiB/s wr, 12 op/s 2023-05-08T09:44:18.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21598.058257 secs 2023-05-08T09:44:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21598.058257 secs 2023-05-08T09:44:19.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21598.058257 secs 2023-05-08T09:44:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:19 smithi186 ceph-mon[126480]: pgmap v11574: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 290 KiB/s wr, 12 op/s 2023-05-08T09:44:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:19 smithi133 ceph-mon[125939]: pgmap v11574: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 290 KiB/s wr, 12 op/s 2023-05-08T09:44:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:19 smithi096 ceph-mon[124666]: pgmap v11574: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 290 KiB/s wr, 12 op/s 2023-05-08T09:44:21.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:21 smithi186 ceph-mon[126480]: pgmap v11575: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 359 KiB/s wr, 16 op/s 2023-05-08T09:44:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:44:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:44:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:44:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:44:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:21 smithi133 ceph-mon[125939]: pgmap v11575: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 359 KiB/s wr, 16 op/s 2023-05-08T09:44:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:44:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:44:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:44:21.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:44:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:21 smithi096 ceph-mon[124666]: pgmap v11575: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 359 KiB/s wr, 16 op/s 2023-05-08T09:44:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:44:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:44:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:44:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:44:22.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:22 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:44:22.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:22 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T09:44:22.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:22 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T09:44:22.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:22 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:44:22.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:22 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:44:22.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:22 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T09:44:22.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:22 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T09:44:22.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:22 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:44:23.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:22 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:44:23.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:22 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T09:44:23.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:22 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T09:44:23.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:22 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:44:23.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:23 smithi186 ceph-mon[126480]: pgmap v11576: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 210 KiB/s wr, 7 op/s 2023-05-08T09:44:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21603.058412 secs 2023-05-08T09:44:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:23 smithi133 ceph-mon[125939]: pgmap v11576: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 210 KiB/s wr, 7 op/s 2023-05-08T09:44:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21603.058412 secs 2023-05-08T09:44:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:23 smithi096 ceph-mon[124666]: pgmap v11576: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 210 KiB/s wr, 7 op/s 2023-05-08T09:44:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21603.058412 secs 2023-05-08T09:44:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21603.614286 secs 2023-05-08T09:44:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:25 smithi186 ceph-mon[126480]: pgmap v11577: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 503 KiB/s rd, 522 KiB/s wr, 14 op/s 2023-05-08T09:44:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21603.614286 secs 2023-05-08T09:44:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:25 smithi133 ceph-mon[125939]: pgmap v11577: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 503 KiB/s rd, 522 KiB/s wr, 14 op/s 2023-05-08T09:44:26.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21603.614286 secs 2023-05-08T09:44:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:25 smithi096 ceph-mon[124666]: pgmap v11577: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 503 KiB/s rd, 522 KiB/s wr, 14 op/s 2023-05-08T09:44:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21604.901620 secs 2023-05-08T09:44:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21604.901620 secs 2023-05-08T09:44:27.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21604.901620 secs 2023-05-08T09:44:27.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:27 smithi186 ceph-mon[126480]: pgmap v11578: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 382 KiB/s wr, 10 op/s 2023-05-08T09:44:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:27 smithi133 ceph-mon[125939]: pgmap v11578: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 382 KiB/s wr, 10 op/s 2023-05-08T09:44:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:27 smithi096 ceph-mon[124666]: pgmap v11578: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 382 KiB/s wr, 10 op/s 2023-05-08T09:44:28.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:28 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:44:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:28 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:44:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:28 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:44:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21608.058477 secs 2023-05-08T09:44:28.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:28 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:44:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:28 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:44:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:28 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:44:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21608.058477 secs 2023-05-08T09:44:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:28 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:44:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:28 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:44:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:28 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:44:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21608.058477 secs 2023-05-08T09:44:29.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:29 smithi186 ceph-mon[126480]: pgmap v11579: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 382 KiB/s wr, 10 op/s 2023-05-08T09:44:29.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:29 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:44:29.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:29 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:44:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:29 smithi133 ceph-mon[125939]: pgmap v11579: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 382 KiB/s wr, 10 op/s 2023-05-08T09:44:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:29 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:44:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:29 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:44:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:29 smithi096 ceph-mon[124666]: pgmap v11579: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 382 KiB/s wr, 10 op/s 2023-05-08T09:44:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:29 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:44:30.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:29 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:44:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21608.614397 secs 2023-05-08T09:44:30.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21608.614397 secs 2023-05-08T09:44:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21608.614397 secs 2023-05-08T09:44:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21609.901744 secs 2023-05-08T09:44:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:31 smithi186 ceph-mon[126480]: pgmap v11580: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 550 KiB/s wr, 15 op/s 2023-05-08T09:44:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:31 smithi186 ceph-mon[126480]: osdmap e800: 12 total, 12 up, 12 in 2023-05-08T09:44:31.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21609.901744 secs 2023-05-08T09:44:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:31 smithi133 ceph-mon[125939]: pgmap v11580: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 550 KiB/s wr, 15 op/s 2023-05-08T09:44:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:31 smithi133 ceph-mon[125939]: osdmap e800: 12 total, 12 up, 12 in 2023-05-08T09:44:32.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21609.901744 secs 2023-05-08T09:44:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:31 smithi096 ceph-mon[124666]: pgmap v11580: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 550 KiB/s wr, 15 op/s 2023-05-08T09:44:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:31 smithi096 ceph-mon[124666]: osdmap e800: 12 total, 12 up, 12 in 2023-05-08T09:44:33.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:33 smithi186 ceph-mon[126480]: pgmap v11582: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 577 KiB/s wr, 14 op/s 2023-05-08T09:44:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21613.058599 secs 2023-05-08T09:44:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:33 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:44:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:33 smithi133 ceph-mon[125939]: pgmap v11582: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 577 KiB/s wr, 14 op/s 2023-05-08T09:44:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21613.058599 secs 2023-05-08T09:44:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:33 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:44:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:33 smithi096 ceph-mon[124666]: pgmap v11582: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 577 KiB/s wr, 14 op/s 2023-05-08T09:44:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21613.058599 secs 2023-05-08T09:44:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:33 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:44:35.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21613.614578 secs 2023-05-08T09:44:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:35 smithi186 ceph-mon[126480]: pgmap v11583: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 204 KiB/s wr, 10 op/s 2023-05-08T09:44:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21613.614578 secs 2023-05-08T09:44:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:35 smithi133 ceph-mon[125939]: pgmap v11583: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 204 KiB/s wr, 10 op/s 2023-05-08T09:44:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21613.614578 secs 2023-05-08T09:44:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:35 smithi096 ceph-mon[124666]: pgmap v11583: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 204 KiB/s wr, 10 op/s 2023-05-08T09:44:36.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21614.901862 secs 2023-05-08T09:44:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21614.901862 secs 2023-05-08T09:44:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21614.901862 secs 2023-05-08T09:44:37.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:37 smithi186 ceph-mon[126480]: pgmap v11584: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 204 KiB/s wr, 10 op/s 2023-05-08T09:44:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:37 smithi133 ceph-mon[125939]: pgmap v11584: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 204 KiB/s wr, 10 op/s 2023-05-08T09:44:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:37 smithi096 ceph-mon[124666]: pgmap v11584: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 204 KiB/s wr, 10 op/s 2023-05-08T09:44:38.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21618.058719 secs 2023-05-08T09:44:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:38 smithi186 ceph-mon[126480]: osdmap e801: 12 total, 12 up, 12 in 2023-05-08T09:44:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21618.058719 secs 2023-05-08T09:44:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:38 smithi133 ceph-mon[125939]: osdmap e801: 12 total, 12 up, 12 in 2023-05-08T09:44:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21618.058719 secs 2023-05-08T09:44:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:38 smithi096 ceph-mon[124666]: osdmap e801: 12 total, 12 up, 12 in 2023-05-08T09:44:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:39 smithi186 ceph-mon[126480]: pgmap v11585: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 204 KiB/s wr, 10 op/s 2023-05-08T09:44:39.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:39 smithi133 ceph-mon[125939]: pgmap v11585: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 204 KiB/s wr, 10 op/s 2023-05-08T09:44:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:39 smithi096 ceph-mon[124666]: pgmap v11585: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 204 KiB/s wr, 10 op/s 2023-05-08T09:44:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21618.614646 secs 2023-05-08T09:44:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21618.614646 secs 2023-05-08T09:44:41.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21618.614646 secs 2023-05-08T09:44:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:41 smithi186 ceph-mon[126480]: pgmap v11587: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 254 KiB/s wr, 8 op/s 2023-05-08T09:44:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:41 smithi133 ceph-mon[125939]: pgmap v11587: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 254 KiB/s wr, 8 op/s 2023-05-08T09:44:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:41 smithi096 ceph-mon[124666]: pgmap v11587: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 254 KiB/s wr, 8 op/s 2023-05-08T09:44:43.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:43 smithi186 ceph-mon[126480]: pgmap v11588: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 252 KiB/s wr, 8 op/s 2023-05-08T09:44:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21623.058847 secs 2023-05-08T09:44:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:44:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:43 smithi133 ceph-mon[125939]: pgmap v11588: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 252 KiB/s wr, 8 op/s 2023-05-08T09:44:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21623.058847 secs 2023-05-08T09:44:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:44:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:43 smithi096 ceph-mon[124666]: pgmap v11588: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 252 KiB/s wr, 8 op/s 2023-05-08T09:44:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21623.058847 secs 2023-05-08T09:44:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:44:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:44:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:44:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:44:44.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:44:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:44:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:44:45.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:44:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:44:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:44:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21623.614749 secs 2023-05-08T09:44:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:45 smithi186 ceph-mon[126480]: pgmap v11589: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 254 KiB/s wr, 7 op/s 2023-05-08T09:44:45.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21623.614749 secs 2023-05-08T09:44:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:45 smithi133 ceph-mon[125939]: pgmap v11589: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 254 KiB/s wr, 7 op/s 2023-05-08T09:44:46.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21623.614749 secs 2023-05-08T09:44:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:45 smithi096 ceph-mon[124666]: pgmap v11589: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 254 KiB/s wr, 7 op/s 2023-05-08T09:44:47.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:47 smithi186 ceph-mon[126480]: pgmap v11590: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 354 KiB/s wr, 8 op/s 2023-05-08T09:44:47.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:47 smithi133 ceph-mon[125939]: pgmap v11590: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 354 KiB/s wr, 8 op/s 2023-05-08T09:44:48.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:47 smithi096 ceph-mon[124666]: pgmap v11590: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 354 KiB/s wr, 8 op/s 2023-05-08T09:44:48.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21628.058974 secs 2023-05-08T09:44:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21628.058974 secs 2023-05-08T09:44:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21628.058974 secs 2023-05-08T09:44:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:49 smithi133 ceph-mon[125939]: pgmap v11591: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 354 KiB/s wr, 8 op/s 2023-05-08T09:44:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:49 smithi096 ceph-mon[124666]: pgmap v11591: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 354 KiB/s wr, 8 op/s 2023-05-08T09:44:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:49 smithi186 ceph-mon[126480]: pgmap v11591: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 354 KiB/s wr, 8 op/s 2023-05-08T09:44:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:51 smithi133 ceph-mon[125939]: pgmap v11592: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 458 KiB/s wr, 11 op/s 2023-05-08T09:44:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:44:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:51 smithi096 ceph-mon[124666]: pgmap v11592: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 458 KiB/s wr, 11 op/s 2023-05-08T09:44:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:44:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:51 smithi186 ceph-mon[126480]: pgmap v11592: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 458 KiB/s wr, 11 op/s 2023-05-08T09:44:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:44:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:52 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:44:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:44:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:44:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:52 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:44:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:44:53.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:44:53.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:52 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:44:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:44:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:44:53.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:53 smithi133 ceph-mon[125939]: pgmap v11593: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 249 KiB/s wr, 7 op/s 2023-05-08T09:44:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21633.059090 secs 2023-05-08T09:44:54.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:53 smithi096 ceph-mon[124666]: pgmap v11593: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 249 KiB/s wr, 7 op/s 2023-05-08T09:44:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21633.059090 secs 2023-05-08T09:44:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:53 smithi186 ceph-mon[126480]: pgmap v11593: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 249 KiB/s wr, 7 op/s 2023-05-08T09:44:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21633.059090 secs 2023-05-08T09:44:55.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:55 smithi133 ceph-mon[125939]: pgmap v11594: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 262 KiB/s wr, 11 op/s 2023-05-08T09:44:56.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:55 smithi096 ceph-mon[124666]: pgmap v11594: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 262 KiB/s wr, 11 op/s 2023-05-08T09:44:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:55 smithi186 ceph-mon[126480]: pgmap v11594: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 262 KiB/s wr, 11 op/s 2023-05-08T09:44:57.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:57 smithi133 ceph-mon[125939]: pgmap v11595: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 493 KiB/s wr, 10 op/s 2023-05-08T09:44:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:57 smithi096 ceph-mon[124666]: pgmap v11595: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 493 KiB/s wr, 10 op/s 2023-05-08T09:44:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:57 smithi186 ceph-mon[126480]: pgmap v11595: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 493 KiB/s wr, 10 op/s 2023-05-08T09:44:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21638.059208 secs 2023-05-08T09:44:59.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21638.059208 secs 2023-05-08T09:44:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21638.059208 secs 2023-05-08T09:44:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:44:59 smithi133 ceph-mon[125939]: pgmap v11596: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 409 KiB/s wr, 9 op/s 2023-05-08T09:45:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:44:59 smithi096 ceph-mon[124666]: pgmap v11596: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 409 KiB/s wr, 9 op/s 2023-05-08T09:45:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:44:59 smithi186 ceph-mon[126480]: pgmap v11596: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 409 KiB/s wr, 9 op/s 2023-05-08T09:45:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21638.615152 secs 2023-05-08T09:45:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:00 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:45:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:45:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:45:01.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21638.615152 secs 2023-05-08T09:45:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:00 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:45:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:45:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:45:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21638.615152 secs 2023-05-08T09:45:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:00 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:45:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:45:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:45:01.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:01 smithi133 ceph-mon[125939]: pgmap v11597: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 607 KiB/s rd, 510 KiB/s wr, 14 op/s 2023-05-08T09:45:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:01 smithi096 ceph-mon[124666]: pgmap v11597: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 607 KiB/s rd, 510 KiB/s wr, 14 op/s 2023-05-08T09:45:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:01 smithi186 ceph-mon[126480]: pgmap v11597: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 607 KiB/s rd, 510 KiB/s wr, 14 op/s 2023-05-08T09:45:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:03 smithi133 ceph-mon[125939]: pgmap v11598: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 348 KiB/s wr, 10 op/s 2023-05-08T09:45:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21643.059324 secs 2023-05-08T09:45:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:03 smithi096 ceph-mon[124666]: pgmap v11598: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 348 KiB/s wr, 10 op/s 2023-05-08T09:45:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21643.059324 secs 2023-05-08T09:45:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:03 smithi186 ceph-mon[126480]: pgmap v11598: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 348 KiB/s wr, 10 op/s 2023-05-08T09:45:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21643.059324 secs 2023-05-08T09:45:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21643.615294 secs 2023-05-08T09:45:05.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:05 smithi133 ceph-mon[125939]: pgmap v11599: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 497 KiB/s rd, 484 KiB/s wr, 25 op/s 2023-05-08T09:45:06.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21643.615294 secs 2023-05-08T09:45:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:05 smithi096 ceph-mon[124666]: pgmap v11599: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 497 KiB/s rd, 484 KiB/s wr, 25 op/s 2023-05-08T09:45:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21643.615294 secs 2023-05-08T09:45:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:05 smithi186 ceph-mon[126480]: pgmap v11599: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 497 KiB/s rd, 484 KiB/s wr, 25 op/s 2023-05-08T09:45:07.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:07 smithi133 ceph-mon[125939]: pgmap v11600: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 472 KiB/s wr, 21 op/s 2023-05-08T09:45:08.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:07 smithi096 ceph-mon[124666]: pgmap v11600: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 472 KiB/s wr, 21 op/s 2023-05-08T09:45:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:07 smithi186 ceph-mon[126480]: pgmap v11600: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 472 KiB/s wr, 21 op/s 2023-05-08T09:45:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21648.059445 secs 2023-05-08T09:45:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21648.059445 secs 2023-05-08T09:45:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21648.059445 secs 2023-05-08T09:45:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:09 smithi133 ceph-mon[125939]: pgmap v11601: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 238 KiB/s wr, 20 op/s 2023-05-08T09:45:10.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:09 smithi096 ceph-mon[124666]: pgmap v11601: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 238 KiB/s wr, 20 op/s 2023-05-08T09:45:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:09 smithi186 ceph-mon[126480]: pgmap v11601: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 238 KiB/s wr, 20 op/s 2023-05-08T09:45:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21648.615412 secs 2023-05-08T09:45:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21648.615412 secs 2023-05-08T09:45:11.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21648.615412 secs 2023-05-08T09:45:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:11 smithi133 ceph-mon[125939]: pgmap v11602: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 317 KiB/s wr, 23 op/s 2023-05-08T09:45:12.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:11 smithi096 ceph-mon[124666]: pgmap v11602: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 317 KiB/s wr, 23 op/s 2023-05-08T09:45:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:11 smithi186 ceph-mon[126480]: pgmap v11602: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 317 KiB/s wr, 23 op/s 2023-05-08T09:45:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:13 smithi133 ceph-mon[125939]: pgmap v11603: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 215 KiB/s wr, 18 op/s 2023-05-08T09:45:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21653.059563 secs 2023-05-08T09:45:14.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:13 smithi096 ceph-mon[124666]: pgmap v11603: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 215 KiB/s wr, 18 op/s 2023-05-08T09:45:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21653.059563 secs 2023-05-08T09:45:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:13 smithi186 ceph-mon[126480]: pgmap v11603: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 215 KiB/s wr, 18 op/s 2023-05-08T09:45:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21653.059563 secs 2023-05-08T09:45:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21653.615558 secs 2023-05-08T09:45:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:15 smithi133 ceph-mon[125939]: pgmap v11604: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 216 KiB/s wr, 21 op/s 2023-05-08T09:45:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21653.615558 secs 2023-05-08T09:45:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:15 smithi096 ceph-mon[124666]: pgmap v11604: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 216 KiB/s wr, 21 op/s 2023-05-08T09:45:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21653.615558 secs 2023-05-08T09:45:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:15 smithi186 ceph-mon[126480]: pgmap v11604: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 216 KiB/s wr, 21 op/s 2023-05-08T09:45:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:17 smithi133 ceph-mon[125939]: pgmap v11605: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 79 KiB/s wr, 6 op/s 2023-05-08T09:45:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:17 smithi096 ceph-mon[124666]: pgmap v11605: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 79 KiB/s wr, 6 op/s 2023-05-08T09:45:18.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:17 smithi186 ceph-mon[126480]: pgmap v11605: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 79 KiB/s wr, 6 op/s 2023-05-08T09:45:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21658.059682 secs 2023-05-08T09:45:19.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21658.059682 secs 2023-05-08T09:45:19.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21658.059682 secs 2023-05-08T09:45:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:19 smithi133 ceph-mon[125939]: pgmap v11606: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 79 KiB/s wr, 6 op/s 2023-05-08T09:45:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:19 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:45:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:19 smithi096 ceph-mon[124666]: pgmap v11606: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 79 KiB/s wr, 6 op/s 2023-05-08T09:45:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:19 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:45:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:19 smithi186 ceph-mon[126480]: pgmap v11606: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 79 KiB/s wr, 6 op/s 2023-05-08T09:45:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:19 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:45:20.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:20 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:45:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:20 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:45:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:20 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:45:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:20 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:45:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:20 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:45:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:20 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:45:21.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:20 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:45:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:20 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:45:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:20 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:45:21.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21659.902796 secs 2023-05-08T09:45:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:21 smithi133 ceph-mon[125939]: pgmap v11607: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 309 KiB/s wr, 13 op/s 2023-05-08T09:45:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:45:22.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21659.902796 secs 2023-05-08T09:45:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:21 smithi096 ceph-mon[124666]: pgmap v11607: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 309 KiB/s wr, 13 op/s 2023-05-08T09:45:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:45:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21659.902796 secs 2023-05-08T09:45:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:21 smithi186 ceph-mon[126480]: pgmap v11607: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 309 KiB/s wr, 13 op/s 2023-05-08T09:45:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:45:22.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:22 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:45:22.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:22 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:45:22.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:22 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:45:23.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:22 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:45:23.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:22 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:45:23.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:22 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:45:23.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:22 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:45:23.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:22 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:45:23.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:22 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:45:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:23 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:45:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:23 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T09:45:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:23 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T09:45:23.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:23 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:45:23.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:23 smithi133 ceph-mon[125939]: pgmap v11608: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 230 KiB/s wr, 10 op/s 2023-05-08T09:45:23.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21663.059823 secs 2023-05-08T09:45:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:23 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:45:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:23 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T09:45:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:23 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T09:45:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:23 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:45:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:23 smithi096 ceph-mon[124666]: pgmap v11608: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 230 KiB/s wr, 10 op/s 2023-05-08T09:45:24.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21663.059823 secs 2023-05-08T09:45:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:23 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:45:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:23 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T09:45:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:23 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T09:45:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:23 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:45:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:23 smithi186 ceph-mon[126480]: pgmap v11608: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 230 KiB/s wr, 10 op/s 2023-05-08T09:45:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21663.059823 secs 2023-05-08T09:45:25.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:25 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:45:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:25 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:45:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:25 smithi133 ceph-mon[125939]: pgmap v11609: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 244 KiB/s wr, 13 op/s 2023-05-08T09:45:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:25 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:45:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:25 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:45:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:25 smithi096 ceph-mon[124666]: pgmap v11609: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 244 KiB/s wr, 13 op/s 2023-05-08T09:45:25.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:25 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:45:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:25 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:45:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:25 smithi186 ceph-mon[126480]: pgmap v11609: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 244 KiB/s wr, 13 op/s 2023-05-08T09:45:26.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21664.902916 secs 2023-05-08T09:45:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:26 smithi133 ceph-mon[125939]: osdmap e802: 12 total, 12 up, 12 in 2023-05-08T09:45:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21664.902916 secs 2023-05-08T09:45:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:26 smithi096 ceph-mon[124666]: osdmap e802: 12 total, 12 up, 12 in 2023-05-08T09:45:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21664.902916 secs 2023-05-08T09:45:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:26 smithi186 ceph-mon[126480]: osdmap e802: 12 total, 12 up, 12 in 2023-05-08T09:45:27.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:27 smithi133 ceph-mon[125939]: pgmap v11611: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 292 KiB/s wr, 13 op/s 2023-05-08T09:45:27.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:27 smithi096 ceph-mon[124666]: pgmap v11611: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 292 KiB/s wr, 13 op/s 2023-05-08T09:45:27.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:27 smithi186 ceph-mon[126480]: pgmap v11611: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 292 KiB/s wr, 13 op/s 2023-05-08T09:45:28.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21668.059931 secs 2023-05-08T09:45:28.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21668.059931 secs 2023-05-08T09:45:28.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21668.059931 secs 2023-05-08T09:45:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:29 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:45:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:29 smithi133 ceph-mon[125939]: pgmap v11612: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 292 KiB/s wr, 13 op/s 2023-05-08T09:45:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:29 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:45:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:29 smithi096 ceph-mon[124666]: pgmap v11612: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 292 KiB/s wr, 13 op/s 2023-05-08T09:45:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:29 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:45:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:29 smithi186 ceph-mon[126480]: pgmap v11612: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 292 KiB/s wr, 13 op/s 2023-05-08T09:45:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21669.903035 secs 2023-05-08T09:45:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:31 smithi186 ceph-mon[126480]: pgmap v11613: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 197 KiB/s wr, 9 op/s 2023-05-08T09:45:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21669.903035 secs 2023-05-08T09:45:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:31 smithi133 ceph-mon[125939]: pgmap v11613: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 197 KiB/s wr, 9 op/s 2023-05-08T09:45:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21669.903035 secs 2023-05-08T09:45:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:31 smithi096 ceph-mon[124666]: pgmap v11613: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 197 KiB/s wr, 9 op/s 2023-05-08T09:45:33.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:33 smithi186 ceph-mon[126480]: pgmap v11614: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 197 KiB/s wr, 9 op/s 2023-05-08T09:45:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21673.060047 secs 2023-05-08T09:45:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:33 smithi186 ceph-mon[126480]: osdmap e803: 12 total, 12 up, 12 in 2023-05-08T09:45:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:33 smithi133 ceph-mon[125939]: pgmap v11614: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 197 KiB/s wr, 9 op/s 2023-05-08T09:45:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21673.060047 secs 2023-05-08T09:45:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:33 smithi133 ceph-mon[125939]: osdmap e803: 12 total, 12 up, 12 in 2023-05-08T09:45:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:33 smithi096 ceph-mon[124666]: pgmap v11614: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 197 KiB/s wr, 9 op/s 2023-05-08T09:45:34.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21673.060047 secs 2023-05-08T09:45:34.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:33 smithi096 ceph-mon[124666]: osdmap e803: 12 total, 12 up, 12 in 2023-05-08T09:45:35.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:35 smithi186 ceph-mon[126480]: pgmap v11616: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 578 KiB/s wr, 10 op/s 2023-05-08T09:45:35.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:35 smithi133 ceph-mon[125939]: pgmap v11616: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 578 KiB/s wr, 10 op/s 2023-05-08T09:45:36.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:35 smithi096 ceph-mon[124666]: pgmap v11616: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 578 KiB/s wr, 10 op/s 2023-05-08T09:45:36.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21674.903122 secs 2023-05-08T09:45:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21674.903122 secs 2023-05-08T09:45:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21674.903122 secs 2023-05-08T09:45:37.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:37 smithi186 ceph-mon[126480]: pgmap v11617: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 538 KiB/s wr, 10 op/s 2023-05-08T09:45:37.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:37 smithi133 ceph-mon[125939]: pgmap v11617: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 538 KiB/s wr, 10 op/s 2023-05-08T09:45:38.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:37 smithi096 ceph-mon[124666]: pgmap v11617: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 538 KiB/s wr, 10 op/s 2023-05-08T09:45:38.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21678.060145 secs 2023-05-08T09:45:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21678.060145 secs 2023-05-08T09:45:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21678.060145 secs 2023-05-08T09:45:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:39 smithi186 ceph-mon[126480]: pgmap v11618: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 538 KiB/s wr, 10 op/s 2023-05-08T09:45:39.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:39 smithi133 ceph-mon[125939]: pgmap v11618: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 538 KiB/s wr, 10 op/s 2023-05-08T09:45:40.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:39 smithi096 ceph-mon[124666]: pgmap v11618: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 538 KiB/s wr, 10 op/s 2023-05-08T09:45:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21678.616203 secs 2023-05-08T09:45:40.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21678.616203 secs 2023-05-08T09:45:41.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21678.616203 secs 2023-05-08T09:45:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21679.903228 secs 2023-05-08T09:45:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:41 smithi186 ceph-mon[126480]: pgmap v11619: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 706 KiB/s rd, 611 KiB/s wr, 10 op/s 2023-05-08T09:45:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:41 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:45:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:41 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:45:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:41 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:45:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21679.903228 secs 2023-05-08T09:45:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:41 smithi133 ceph-mon[125939]: pgmap v11619: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 706 KiB/s rd, 611 KiB/s wr, 10 op/s 2023-05-08T09:45:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:41 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:45:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:41 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:45:41.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:41 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:45:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21679.903228 secs 2023-05-08T09:45:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:41 smithi096 ceph-mon[124666]: pgmap v11619: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 706 KiB/s rd, 611 KiB/s wr, 10 op/s 2023-05-08T09:45:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:41 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:45:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:41 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:45:42.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:41 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:45:43.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:43 smithi186 ceph-mon[126480]: pgmap v11620: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 706 KiB/s rd, 611 KiB/s wr, 10 op/s 2023-05-08T09:45:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21683.060303 secs 2023-05-08T09:45:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:43 smithi133 ceph-mon[125939]: pgmap v11620: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 706 KiB/s rd, 611 KiB/s wr, 10 op/s 2023-05-08T09:45:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21683.060303 secs 2023-05-08T09:45:44.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:43 smithi096 ceph-mon[124666]: pgmap v11620: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 706 KiB/s rd, 611 KiB/s wr, 10 op/s 2023-05-08T09:45:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21683.060303 secs 2023-05-08T09:45:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21683.616277 secs 2023-05-08T09:45:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:45 smithi186 ceph-mon[126480]: pgmap v11621: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 888 KiB/s rd, 742 KiB/s wr, 14 op/s 2023-05-08T09:45:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21683.616277 secs 2023-05-08T09:45:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:45 smithi133 ceph-mon[125939]: pgmap v11621: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 888 KiB/s rd, 742 KiB/s wr, 14 op/s 2023-05-08T09:45:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21683.616277 secs 2023-05-08T09:45:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:45 smithi096 ceph-mon[124666]: pgmap v11621: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 888 KiB/s rd, 742 KiB/s wr, 14 op/s 2023-05-08T09:45:47.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:47 smithi186 ceph-mon[126480]: pgmap v11622: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 581 KiB/s rd, 382 KiB/s wr, 9 op/s 2023-05-08T09:45:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:45:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:47 smithi133 ceph-mon[125939]: pgmap v11622: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 581 KiB/s rd, 382 KiB/s wr, 9 op/s 2023-05-08T09:45:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:45:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:47 smithi096 ceph-mon[124666]: pgmap v11622: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 581 KiB/s rd, 382 KiB/s wr, 9 op/s 2023-05-08T09:45:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:45:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:48 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:45:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:45:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:45:48.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21688.060425 secs 2023-05-08T09:45:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:48 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:45:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:45:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:45:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21688.060425 secs 2023-05-08T09:45:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:48 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:45:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:45:49.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:45:49.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21688.060425 secs 2023-05-08T09:45:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:49 smithi186 ceph-mon[126480]: pgmap v11623: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 581 KiB/s rd, 382 KiB/s wr, 9 op/s 2023-05-08T09:45:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:49 smithi133 ceph-mon[125939]: pgmap v11623: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 581 KiB/s rd, 382 KiB/s wr, 9 op/s 2023-05-08T09:45:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:49 smithi096 ceph-mon[124666]: pgmap v11623: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 581 KiB/s rd, 382 KiB/s wr, 9 op/s 2023-05-08T09:45:51.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:51 smithi186 ceph-mon[126480]: pgmap v11624: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 765 KiB/s rd, 552 KiB/s wr, 14 op/s 2023-05-08T09:45:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:45:51.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:51 smithi133 ceph-mon[125939]: pgmap v11624: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 765 KiB/s rd, 552 KiB/s wr, 14 op/s 2023-05-08T09:45:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:45:52.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:51 smithi096 ceph-mon[124666]: pgmap v11624: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 765 KiB/s rd, 552 KiB/s wr, 14 op/s 2023-05-08T09:45:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:45:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:45:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:45:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:45:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:45:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:45:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:45:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:53 smithi186 ceph-mon[126480]: pgmap v11625: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 410 KiB/s rd, 341 KiB/s wr, 10 op/s 2023-05-08T09:45:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21693.060535 secs 2023-05-08T09:45:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:53 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:45:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:53 smithi133 ceph-mon[125939]: pgmap v11625: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 410 KiB/s rd, 341 KiB/s wr, 10 op/s 2023-05-08T09:45:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21693.060535 secs 2023-05-08T09:45:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:53 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:45:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:53 smithi096 ceph-mon[124666]: pgmap v11625: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 410 KiB/s rd, 341 KiB/s wr, 10 op/s 2023-05-08T09:45:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21693.060535 secs 2023-05-08T09:45:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:53 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:45:55.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21693.616533 secs 2023-05-08T09:45:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:55 smithi186 ceph-mon[126480]: pgmap v11626: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 770 KiB/s rd, 621 KiB/s wr, 15 op/s 2023-05-08T09:45:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21693.616533 secs 2023-05-08T09:45:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:55 smithi133 ceph-mon[125939]: pgmap v11626: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 770 KiB/s rd, 621 KiB/s wr, 15 op/s 2023-05-08T09:45:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21693.616533 secs 2023-05-08T09:45:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:55 smithi096 ceph-mon[124666]: pgmap v11626: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 770 KiB/s rd, 621 KiB/s wr, 15 op/s 2023-05-08T09:45:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:45:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:45:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:45:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:45:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:45:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:45:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:57 smithi133 ceph-mon[125939]: pgmap v11627: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 449 KiB/s wr, 10 op/s 2023-05-08T09:45:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:57 smithi096 ceph-mon[124666]: pgmap v11627: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 449 KiB/s wr, 10 op/s 2023-05-08T09:45:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:57 smithi186 ceph-mon[126480]: pgmap v11627: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 449 KiB/s wr, 10 op/s 2023-05-08T09:45:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21698.060655 secs 2023-05-08T09:45:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:58 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:45:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21698.060655 secs 2023-05-08T09:45:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:58 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:45:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21698.060655 secs 2023-05-08T09:45:59.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:58 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:45:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:45:59 smithi133 ceph-mon[125939]: pgmap v11628: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 449 KiB/s wr, 10 op/s 2023-05-08T09:46:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:45:59 smithi096 ceph-mon[124666]: pgmap v11628: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 449 KiB/s wr, 10 op/s 2023-05-08T09:46:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:45:59 smithi186 ceph-mon[126480]: pgmap v11628: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 449 KiB/s wr, 10 op/s 2023-05-08T09:46:00.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21698.616633 secs 2023-05-08T09:46:01.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21698.616633 secs 2023-05-08T09:46:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21698.616633 secs 2023-05-08T09:46:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21699.903595 secs 2023-05-08T09:46:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:01 smithi133 ceph-mon[125939]: pgmap v11629: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 728 KiB/s rd, 688 KiB/s wr, 15 op/s 2023-05-08T09:46:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21699.903595 secs 2023-05-08T09:46:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:01 smithi096 ceph-mon[124666]: pgmap v11629: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 728 KiB/s rd, 688 KiB/s wr, 15 op/s 2023-05-08T09:46:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21699.903595 secs 2023-05-08T09:46:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:01 smithi186 ceph-mon[126480]: pgmap v11629: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 728 KiB/s rd, 688 KiB/s wr, 15 op/s 2023-05-08T09:46:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:03 smithi133 ceph-mon[125939]: pgmap v11630: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 518 KiB/s wr, 10 op/s 2023-05-08T09:46:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21703.060791 secs 2023-05-08T09:46:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:03 smithi096 ceph-mon[124666]: pgmap v11630: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 518 KiB/s wr, 10 op/s 2023-05-08T09:46:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21703.060791 secs 2023-05-08T09:46:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:03 smithi186 ceph-mon[126480]: pgmap v11630: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 518 KiB/s wr, 10 op/s 2023-05-08T09:46:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21703.060791 secs 2023-05-08T09:46:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:04 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:46:04.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:04 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:46:04.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:04 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:46:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:04 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:46:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:04 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:46:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:04 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:46:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:04 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:46:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:04 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:46:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:04 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:46:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21703.616764 secs 2023-05-08T09:46:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:05 smithi133 ceph-mon[125939]: pgmap v11631: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 707 KiB/s rd, 716 KiB/s wr, 29 op/s 2023-05-08T09:46:06.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21703.616764 secs 2023-05-08T09:46:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:05 smithi096 ceph-mon[124666]: pgmap v11631: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 707 KiB/s rd, 716 KiB/s wr, 29 op/s 2023-05-08T09:46:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21703.616764 secs 2023-05-08T09:46:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:05 smithi186 ceph-mon[126480]: pgmap v11631: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 707 KiB/s rd, 716 KiB/s wr, 29 op/s 2023-05-08T09:46:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21704.903711 secs 2023-05-08T09:46:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:06 smithi133 ceph-mon[125939]: osdmap e804: 12 total, 12 up, 12 in 2023-05-08T09:46:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21704.903711 secs 2023-05-08T09:46:07.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:06 smithi096 ceph-mon[124666]: osdmap e804: 12 total, 12 up, 12 in 2023-05-08T09:46:07.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21704.903711 secs 2023-05-08T09:46:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:06 smithi186 ceph-mon[126480]: osdmap e804: 12 total, 12 up, 12 in 2023-05-08T09:46:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:07 smithi133 ceph-mon[125939]: pgmap v11633: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 523 KiB/s wr, 28 op/s 2023-05-08T09:46:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:07 smithi096 ceph-mon[124666]: pgmap v11633: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 523 KiB/s wr, 28 op/s 2023-05-08T09:46:08.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:07 smithi186 ceph-mon[126480]: pgmap v11633: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 523 KiB/s wr, 28 op/s 2023-05-08T09:46:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21708.060932 secs 2023-05-08T09:46:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21708.060932 secs 2023-05-08T09:46:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21708.060932 secs 2023-05-08T09:46:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:09 smithi133 ceph-mon[125939]: pgmap v11634: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 523 KiB/s wr, 28 op/s 2023-05-08T09:46:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:09 smithi096 ceph-mon[124666]: pgmap v11634: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 523 KiB/s wr, 28 op/s 2023-05-08T09:46:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:09 smithi186 ceph-mon[126480]: pgmap v11634: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 523 KiB/s wr, 28 op/s 2023-05-08T09:46:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21708.616903 secs 2023-05-08T09:46:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21708.616903 secs 2023-05-08T09:46:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21708.616903 secs 2023-05-08T09:46:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21709.903859 secs 2023-05-08T09:46:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:11 smithi133 ceph-mon[125939]: pgmap v11635: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 452 KiB/s wr, 27 op/s 2023-05-08T09:46:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21709.903859 secs 2023-05-08T09:46:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:11 smithi096 ceph-mon[124666]: pgmap v11635: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 452 KiB/s wr, 27 op/s 2023-05-08T09:46:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21709.903859 secs 2023-05-08T09:46:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:11 smithi186 ceph-mon[126480]: pgmap v11635: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 452 KiB/s wr, 27 op/s 2023-05-08T09:46:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:13 smithi133 ceph-mon[125939]: pgmap v11636: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 452 KiB/s wr, 27 op/s 2023-05-08T09:46:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21713.061069 secs 2023-05-08T09:46:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:13 smithi133 ceph-mon[125939]: osdmap e805: 12 total, 12 up, 12 in 2023-05-08T09:46:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:13 smithi096 ceph-mon[124666]: pgmap v11636: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 452 KiB/s wr, 27 op/s 2023-05-08T09:46:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21713.061069 secs 2023-05-08T09:46:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:13 smithi096 ceph-mon[124666]: osdmap e805: 12 total, 12 up, 12 in 2023-05-08T09:46:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:13 smithi186 ceph-mon[126480]: pgmap v11636: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 452 KiB/s wr, 27 op/s 2023-05-08T09:46:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21713.061069 secs 2023-05-08T09:46:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:13 smithi186 ceph-mon[126480]: osdmap e805: 12 total, 12 up, 12 in 2023-05-08T09:46:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21713.617029 secs 2023-05-08T09:46:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:15 smithi133 ceph-mon[125939]: pgmap v11638: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 359 KiB/s rd, 259 KiB/s wr, 9 op/s 2023-05-08T09:46:16.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21713.617029 secs 2023-05-08T09:46:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:15 smithi096 ceph-mon[124666]: pgmap v11638: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 359 KiB/s rd, 259 KiB/s wr, 9 op/s 2023-05-08T09:46:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21713.617029 secs 2023-05-08T09:46:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:15 smithi186 ceph-mon[126480]: pgmap v11638: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 359 KiB/s rd, 259 KiB/s wr, 9 op/s 2023-05-08T09:46:16.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21714.903974 secs 2023-05-08T09:46:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21714.903974 secs 2023-05-08T09:46:17.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21714.903974 secs 2023-05-08T09:46:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:17 smithi133 ceph-mon[125939]: pgmap v11639: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 319 KiB/s rd, 230 KiB/s wr, 8 op/s 2023-05-08T09:46:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:17 smithi096 ceph-mon[124666]: pgmap v11639: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 319 KiB/s rd, 230 KiB/s wr, 8 op/s 2023-05-08T09:46:18.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:17 smithi186 ceph-mon[126480]: pgmap v11639: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 319 KiB/s rd, 230 KiB/s wr, 8 op/s 2023-05-08T09:46:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21718.061188 secs 2023-05-08T09:46:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21718.061188 secs 2023-05-08T09:46:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21718.061188 secs 2023-05-08T09:46:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:19 smithi133 ceph-mon[125939]: pgmap v11640: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 319 KiB/s rd, 230 KiB/s wr, 8 op/s 2023-05-08T09:46:20.015 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:19 smithi096 ceph-mon[124666]: pgmap v11640: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 319 KiB/s rd, 230 KiB/s wr, 8 op/s 2023-05-08T09:46:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:19 smithi186 ceph-mon[126480]: pgmap v11640: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 319 KiB/s rd, 230 KiB/s wr, 8 op/s 2023-05-08T09:46:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21718.617143 secs 2023-05-08T09:46:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21718.617143 secs 2023-05-08T09:46:21.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21718.617143 secs 2023-05-08T09:46:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21719.904095 secs 2023-05-08T09:46:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:21 smithi133 ceph-mon[125939]: pgmap v11641: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 8 op/s 2023-05-08T09:46:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21719.904095 secs 2023-05-08T09:46:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:21 smithi096 ceph-mon[124666]: pgmap v11641: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 8 op/s 2023-05-08T09:46:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21719.904095 secs 2023-05-08T09:46:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:21 smithi186 ceph-mon[126480]: pgmap v11641: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 8 op/s 2023-05-08T09:46:22.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:22 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:46:23.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:22 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:46:23.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:22 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:46:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:23 smithi133 ceph-mon[125939]: pgmap v11642: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 8 op/s 2023-05-08T09:46:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:46:23.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:46:23.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:23 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:46:23.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:46:23.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:23 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T09:46:23.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:23 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T09:46:23.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:23 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:46:23.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21723.061309 secs 2023-05-08T09:46:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:23 smithi096 ceph-mon[124666]: pgmap v11642: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 8 op/s 2023-05-08T09:46:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:46:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:46:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:23 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:46:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:46:24.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:23 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T09:46:24.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:23 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T09:46:24.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:23 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:46:24.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21723.061309 secs 2023-05-08T09:46:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:23 smithi186 ceph-mon[126480]: pgmap v11642: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 8 op/s 2023-05-08T09:46:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:46:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:46:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:23 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:46:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:46:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:23 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T09:46:24.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:23 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T09:46:24.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:23 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:46:24.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21723.061309 secs 2023-05-08T09:46:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21723.617280 secs 2023-05-08T09:46:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:25 smithi133 ceph-mon[125939]: pgmap v11643: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 107 KiB/s wr, 11 op/s 2023-05-08T09:46:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21723.617280 secs 2023-05-08T09:46:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:25 smithi096 ceph-mon[124666]: pgmap v11643: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 107 KiB/s wr, 11 op/s 2023-05-08T09:46:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21723.617280 secs 2023-05-08T09:46:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:25 smithi186 ceph-mon[126480]: pgmap v11643: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 107 KiB/s wr, 11 op/s 2023-05-08T09:46:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21724.904197 secs 2023-05-08T09:46:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21724.904197 secs 2023-05-08T09:46:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21724.904197 secs 2023-05-08T09:46:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:27 smithi133 ceph-mon[125939]: pgmap v11644: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 86 KiB/s wr, 6 op/s 2023-05-08T09:46:28.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:27 smithi096 ceph-mon[124666]: pgmap v11644: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 86 KiB/s wr, 6 op/s 2023-05-08T09:46:28.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:27 smithi186 ceph-mon[126480]: pgmap v11644: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 86 KiB/s wr, 6 op/s 2023-05-08T09:46:28.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21728.061419 secs 2023-05-08T09:46:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21728.061419 secs 2023-05-08T09:46:29.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21728.061419 secs 2023-05-08T09:46:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:29 smithi133 ceph-mon[125939]: pgmap v11645: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 86 KiB/s wr, 6 op/s 2023-05-08T09:46:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:29 smithi096 ceph-mon[124666]: pgmap v11645: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 86 KiB/s wr, 6 op/s 2023-05-08T09:46:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:29 smithi186 ceph-mon[126480]: pgmap v11645: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 86 KiB/s wr, 6 op/s 2023-05-08T09:46:31.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21728.617410 secs 2023-05-08T09:46:31.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21728.617410 secs 2023-05-08T09:46:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21728.617410 secs 2023-05-08T09:46:32.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21729.904296 secs 2023-05-08T09:46:32.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:31 smithi096 ceph-mon[124666]: pgmap v11646: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 86 KiB/s wr, 10 op/s 2023-05-08T09:46:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21729.904296 secs 2023-05-08T09:46:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:31 smithi186 ceph-mon[126480]: pgmap v11646: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 86 KiB/s wr, 10 op/s 2023-05-08T09:46:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21729.904296 secs 2023-05-08T09:46:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:31 smithi133 ceph-mon[125939]: pgmap v11646: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 86 KiB/s wr, 10 op/s 2023-05-08T09:46:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:33 smithi096 ceph-mon[124666]: pgmap v11647: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 73 KiB/s wr, 6 op/s 2023-05-08T09:46:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21733.061542 secs 2023-05-08T09:46:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:33 smithi186 ceph-mon[126480]: pgmap v11647: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 73 KiB/s wr, 6 op/s 2023-05-08T09:46:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21733.061542 secs 2023-05-08T09:46:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:33 smithi133 ceph-mon[125939]: pgmap v11647: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 73 KiB/s wr, 6 op/s 2023-05-08T09:46:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21733.061542 secs 2023-05-08T09:46:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21733.617520 secs 2023-05-08T09:46:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:35 smithi186 ceph-mon[126480]: pgmap v11648: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 146 KiB/s wr, 9 op/s 2023-05-08T09:46:36.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21733.617520 secs 2023-05-08T09:46:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:35 smithi133 ceph-mon[125939]: pgmap v11648: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 146 KiB/s wr, 9 op/s 2023-05-08T09:46:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21733.617520 secs 2023-05-08T09:46:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:35 smithi096 ceph-mon[124666]: pgmap v11648: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 146 KiB/s wr, 9 op/s 2023-05-08T09:46:37.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21734.904419 secs 2023-05-08T09:46:37.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21734.904419 secs 2023-05-08T09:46:37.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21734.904419 secs 2023-05-08T09:46:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:37 smithi186 ceph-mon[126480]: pgmap v11649: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 73 KiB/s wr, 6 op/s 2023-05-08T09:46:38.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:37 smithi133 ceph-mon[125939]: pgmap v11649: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 73 KiB/s wr, 6 op/s 2023-05-08T09:46:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:37 smithi096 ceph-mon[124666]: pgmap v11649: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 73 KiB/s wr, 6 op/s 2023-05-08T09:46:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21738.061660 secs 2023-05-08T09:46:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21738.061660 secs 2023-05-08T09:46:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21738.061660 secs 2023-05-08T09:46:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:39 smithi186 ceph-mon[126480]: pgmap v11650: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 73 KiB/s wr, 6 op/s 2023-05-08T09:46:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:39 smithi133 ceph-mon[125939]: pgmap v11650: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 73 KiB/s wr, 6 op/s 2023-05-08T09:46:40.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:39 smithi096 ceph-mon[124666]: pgmap v11650: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 73 KiB/s wr, 6 op/s 2023-05-08T09:46:41.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21738.617642 secs 2023-05-08T09:46:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21738.617642 secs 2023-05-08T09:46:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21738.617642 secs 2023-05-08T09:46:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21739.904542 secs 2023-05-08T09:46:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:41 smithi186 ceph-mon[126480]: pgmap v11651: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 144 KiB/s wr, 9 op/s 2023-05-08T09:46:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21739.904542 secs 2023-05-08T09:46:42.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:41 smithi133 ceph-mon[125939]: pgmap v11651: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 144 KiB/s wr, 9 op/s 2023-05-08T09:46:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21739.904542 secs 2023-05-08T09:46:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:41 smithi096 ceph-mon[124666]: pgmap v11651: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 144 KiB/s wr, 9 op/s 2023-05-08T09:46:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:43 smithi186 ceph-mon[126480]: pgmap v11652: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 144 KiB/s wr, 6 op/s 2023-05-08T09:46:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21743.061777 secs 2023-05-08T09:46:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:43 smithi133 ceph-mon[125939]: pgmap v11652: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 144 KiB/s wr, 6 op/s 2023-05-08T09:46:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21743.061777 secs 2023-05-08T09:46:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:43 smithi096 ceph-mon[124666]: pgmap v11652: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 144 KiB/s wr, 6 op/s 2023-05-08T09:46:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21743.061777 secs 2023-05-08T09:46:45.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21743.617727 secs 2023-05-08T09:46:45.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21743.617727 secs 2023-05-08T09:46:45.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21743.617727 secs 2023-05-08T09:46:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:45 smithi186 ceph-mon[126480]: pgmap v11653: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 144 KiB/s wr, 9 op/s 2023-05-08T09:46:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:45 smithi133 ceph-mon[125939]: pgmap v11653: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 144 KiB/s wr, 9 op/s 2023-05-08T09:46:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:45 smithi096 ceph-mon[124666]: pgmap v11653: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 144 KiB/s wr, 9 op/s 2023-05-08T09:46:47.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21744.904655 secs 2023-05-08T09:46:47.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21744.904655 secs 2023-05-08T09:46:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21744.904655 secs 2023-05-08T09:46:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:47 smithi186 ceph-mon[126480]: pgmap v11654: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 284 KiB/s wr, 7 op/s 2023-05-08T09:46:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:47 smithi133 ceph-mon[125939]: pgmap v11654: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 284 KiB/s wr, 7 op/s 2023-05-08T09:46:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:47 smithi096 ceph-mon[124666]: pgmap v11654: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 284 KiB/s wr, 7 op/s 2023-05-08T09:46:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21748.061876 secs 2023-05-08T09:46:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21748.061876 secs 2023-05-08T09:46:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21748.061876 secs 2023-05-08T09:46:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:49 smithi186 ceph-mon[126480]: pgmap v11655: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 284 KiB/s wr, 7 op/s 2023-05-08T09:46:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:49 smithi133 ceph-mon[125939]: pgmap v11655: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 284 KiB/s wr, 7 op/s 2023-05-08T09:46:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:49 smithi096 ceph-mon[124666]: pgmap v11655: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 284 KiB/s wr, 7 op/s 2023-05-08T09:46:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21749.904771 secs 2023-05-08T09:46:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:51 smithi186 ceph-mon[126480]: pgmap v11656: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 357 KiB/s wr, 11 op/s 2023-05-08T09:46:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:46:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21749.904771 secs 2023-05-08T09:46:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:51 smithi133 ceph-mon[125939]: pgmap v11656: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 357 KiB/s wr, 11 op/s 2023-05-08T09:46:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:46:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21749.904771 secs 2023-05-08T09:46:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:51 smithi096 ceph-mon[124666]: pgmap v11656: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 357 KiB/s wr, 11 op/s 2023-05-08T09:46:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:46:53.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:52 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:46:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:46:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:46:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:52 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:46:53.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:46:53.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:46:53.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:52 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:46:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:46:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:46:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:53 smithi186 ceph-mon[126480]: pgmap v11657: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 285 KiB/s wr, 7 op/s 2023-05-08T09:46:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21753.062001 secs 2023-05-08T09:46:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:53 smithi133 ceph-mon[125939]: pgmap v11657: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 285 KiB/s wr, 7 op/s 2023-05-08T09:46:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21753.062001 secs 2023-05-08T09:46:54.262 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:53 smithi096 ceph-mon[124666]: pgmap v11657: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 285 KiB/s wr, 7 op/s 2023-05-08T09:46:54.263 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21753.062001 secs 2023-05-08T09:46:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:55 smithi186 ceph-mon[126480]: pgmap v11658: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 484 KiB/s wr, 12 op/s 2023-05-08T09:46:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:55 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:46:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:55 smithi133 ceph-mon[125939]: pgmap v11658: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 484 KiB/s wr, 12 op/s 2023-05-08T09:46:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:55 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:46:56.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:55 smithi096 ceph-mon[124666]: pgmap v11658: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 484 KiB/s wr, 12 op/s 2023-05-08T09:46:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:55 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:46:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:46:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:46:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:46:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:46:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:46:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:46:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:57 smithi186 ceph-mon[126480]: pgmap v11659: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 633 KiB/s rd, 483 KiB/s wr, 9 op/s 2023-05-08T09:46:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:57 smithi133 ceph-mon[125939]: pgmap v11659: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 633 KiB/s rd, 483 KiB/s wr, 9 op/s 2023-05-08T09:46:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:57 smithi096 ceph-mon[124666]: pgmap v11659: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 633 KiB/s rd, 483 KiB/s wr, 9 op/s 2023-05-08T09:46:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21758.062118 secs 2023-05-08T09:46:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:58 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:46:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21758.062118 secs 2023-05-08T09:46:59.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:58 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:46:59.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21758.062118 secs 2023-05-08T09:46:59.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:58 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:47:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:59 smithi186 ceph-mon[126480]: pgmap v11660: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 633 KiB/s rd, 271 KiB/s wr, 9 op/s 2023-05-08T09:47:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:46:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21758.618103 secs 2023-05-08T09:47:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:59 smithi133 ceph-mon[125939]: pgmap v11660: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 633 KiB/s rd, 271 KiB/s wr, 9 op/s 2023-05-08T09:47:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:46:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21758.618103 secs 2023-05-08T09:47:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:59 smithi096 ceph-mon[124666]: pgmap v11660: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 633 KiB/s rd, 271 KiB/s wr, 9 op/s 2023-05-08T09:47:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:46:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21758.618103 secs 2023-05-08T09:47:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:47:01.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:47:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:47:01.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:47:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:47:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:47:02.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:01 smithi133 ceph-mon[125939]: pgmap v11661: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 729 KiB/s rd, 367 KiB/s wr, 13 op/s 2023-05-08T09:47:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:01 smithi096 ceph-mon[124666]: pgmap v11661: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 729 KiB/s rd, 367 KiB/s wr, 13 op/s 2023-05-08T09:47:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:01 smithi186 ceph-mon[126480]: pgmap v11661: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 729 KiB/s rd, 367 KiB/s wr, 13 op/s 2023-05-08T09:47:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:03 smithi133 ceph-mon[125939]: pgmap v11662: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 294 KiB/s wr, 9 op/s 2023-05-08T09:47:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21763.062254 secs 2023-05-08T09:47:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:03 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:47:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:03 smithi096 ceph-mon[124666]: pgmap v11662: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 294 KiB/s wr, 9 op/s 2023-05-08T09:47:04.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21763.062254 secs 2023-05-08T09:47:04.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:03 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:47:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:03 smithi186 ceph-mon[126480]: pgmap v11662: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 294 KiB/s wr, 9 op/s 2023-05-08T09:47:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21763.062254 secs 2023-05-08T09:47:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:03 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:47:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21763.618239 secs 2023-05-08T09:47:05.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21763.618239 secs 2023-05-08T09:47:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21763.618239 secs 2023-05-08T09:47:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:05 smithi133 ceph-mon[125939]: pgmap v11663: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 747 KiB/s rd, 607 KiB/s wr, 22 op/s 2023-05-08T09:47:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:05 smithi096 ceph-mon[124666]: pgmap v11663: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 747 KiB/s rd, 607 KiB/s wr, 22 op/s 2023-05-08T09:47:06.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:05 smithi186 ceph-mon[126480]: pgmap v11663: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 747 KiB/s rd, 607 KiB/s wr, 22 op/s 2023-05-08T09:47:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:07 smithi133 ceph-mon[125939]: pgmap v11664: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 409 KiB/s wr, 18 op/s 2023-05-08T09:47:08.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:07 smithi096 ceph-mon[124666]: pgmap v11664: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 409 KiB/s wr, 18 op/s 2023-05-08T09:47:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:07 smithi186 ceph-mon[126480]: pgmap v11664: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 409 KiB/s wr, 18 op/s 2023-05-08T09:47:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21768.062371 secs 2023-05-08T09:47:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21768.062371 secs 2023-05-08T09:47:09.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21768.062371 secs 2023-05-08T09:47:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:09 smithi133 ceph-mon[125939]: pgmap v11665: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 409 KiB/s wr, 17 op/s 2023-05-08T09:47:10.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:09 smithi096 ceph-mon[124666]: pgmap v11665: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 409 KiB/s wr, 17 op/s 2023-05-08T09:47:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:09 smithi186 ceph-mon[126480]: pgmap v11665: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 409 KiB/s wr, 17 op/s 2023-05-08T09:47:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:11 smithi133 ceph-mon[125939]: pgmap v11666: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 749 KiB/s rd, 561 KiB/s wr, 25 op/s 2023-05-08T09:47:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:11 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:47:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:11 smithi096 ceph-mon[124666]: pgmap v11666: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 749 KiB/s rd, 561 KiB/s wr, 25 op/s 2023-05-08T09:47:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:11 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:47:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:11 smithi186 ceph-mon[126480]: pgmap v11666: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 749 KiB/s rd, 561 KiB/s wr, 25 op/s 2023-05-08T09:47:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:11 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:47:13.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:12 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:47:13.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:12 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:47:13.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:12 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:47:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:12 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:47:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:12 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:47:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:12 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:47:13.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:12 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:47:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:12 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:47:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:12 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:47:14.248 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:13 smithi133 ceph-mon[125939]: pgmap v11667: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 653 KiB/s rd, 466 KiB/s wr, 21 op/s 2023-05-08T09:47:14.248 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21773.062489 secs 2023-05-08T09:47:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:13 smithi096 ceph-mon[124666]: pgmap v11667: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 653 KiB/s rd, 466 KiB/s wr, 21 op/s 2023-05-08T09:47:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21773.062489 secs 2023-05-08T09:47:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:13 smithi186 ceph-mon[126480]: pgmap v11667: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 653 KiB/s rd, 466 KiB/s wr, 21 op/s 2023-05-08T09:47:14.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21773.062489 secs 2023-05-08T09:47:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:15 smithi133 ceph-mon[125939]: pgmap v11668: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 785 KiB/s rd, 609 KiB/s wr, 24 op/s 2023-05-08T09:47:16.350 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:15 smithi096 ceph-mon[124666]: pgmap v11668: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 785 KiB/s rd, 609 KiB/s wr, 24 op/s 2023-05-08T09:47:16.374 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:15 smithi186 ceph-mon[126480]: pgmap v11668: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 785 KiB/s rd, 609 KiB/s wr, 24 op/s 2023-05-08T09:47:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:17 smithi133 ceph-mon[125939]: pgmap v11669: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 542 KiB/s rd, 296 KiB/s wr, 11 op/s 2023-05-08T09:47:18.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:17 smithi096 ceph-mon[124666]: pgmap v11669: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 542 KiB/s rd, 296 KiB/s wr, 11 op/s 2023-05-08T09:47:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:17 smithi186 ceph-mon[126480]: pgmap v11669: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 542 KiB/s rd, 296 KiB/s wr, 11 op/s 2023-05-08T09:47:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21778.062553 secs 2023-05-08T09:47:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21778.062553 secs 2023-05-08T09:47:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21778.062553 secs 2023-05-08T09:47:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:19 smithi133 ceph-mon[125939]: pgmap v11670: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 542 KiB/s rd, 296 KiB/s wr, 11 op/s 2023-05-08T09:47:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:19 smithi096 ceph-mon[124666]: pgmap v11670: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 542 KiB/s rd, 296 KiB/s wr, 11 op/s 2023-05-08T09:47:20.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:19 smithi186 ceph-mon[126480]: pgmap v11670: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 542 KiB/s rd, 296 KiB/s wr, 11 op/s 2023-05-08T09:47:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:21 smithi133 ceph-mon[125939]: pgmap v11671: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 296 KiB/s wr, 14 op/s 2023-05-08T09:47:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:21 smithi096 ceph-mon[124666]: pgmap v11671: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 296 KiB/s wr, 14 op/s 2023-05-08T09:47:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:21 smithi186 ceph-mon[126480]: pgmap v11671: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 296 KiB/s wr, 14 op/s 2023-05-08T09:47:24.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:23 smithi133 ceph-mon[125939]: pgmap v11672: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 144 KiB/s wr, 6 op/s 2023-05-08T09:47:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:47:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21783.062667 secs 2023-05-08T09:47:24.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:23 smithi096 ceph-mon[124666]: pgmap v11672: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 144 KiB/s wr, 6 op/s 2023-05-08T09:47:24.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:47:24.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21783.062667 secs 2023-05-08T09:47:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:23 smithi186 ceph-mon[126480]: pgmap v11672: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 144 KiB/s wr, 6 op/s 2023-05-08T09:47:24.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:47:24.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21783.062667 secs 2023-05-08T09:47:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21783.618762 secs 2023-05-08T09:47:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21783.618762 secs 2023-05-08T09:47:25.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21783.618762 secs 2023-05-08T09:47:26.196 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:25 smithi096 ceph-mon[124666]: pgmap v11673: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 389 KiB/s wr, 13 op/s 2023-05-08T09:47:26.226 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:25 smithi133 ceph-mon[125939]: pgmap v11673: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 389 KiB/s wr, 13 op/s 2023-05-08T09:47:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:25 smithi186 ceph-mon[126480]: pgmap v11673: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 389 KiB/s wr, 13 op/s 2023-05-08T09:47:27.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21784.905657 secs 2023-05-08T09:47:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:26 smithi133 ceph-mon[125939]: osdmap e806: 12 total, 12 up, 12 in 2023-05-08T09:47:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:47:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:47:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:47:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:47:27.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:47:27.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:47:27.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:47:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21784.905657 secs 2023-05-08T09:47:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:26 smithi096 ceph-mon[124666]: osdmap e806: 12 total, 12 up, 12 in 2023-05-08T09:47:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:47:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:47:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:47:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:47:27.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:47:27.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:47:27.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:47:27.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21784.905657 secs 2023-05-08T09:47:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:26 smithi186 ceph-mon[126480]: osdmap e806: 12 total, 12 up, 12 in 2023-05-08T09:47:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:47:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:47:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:47:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:47:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:47:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:47:27.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:47:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:27 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:47:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:27 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T09:47:28.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:27 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T09:47:28.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:27 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:47:28.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:27 smithi133 ceph-mon[125939]: pgmap v11675: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 295 KiB/s wr, 11 op/s 2023-05-08T09:47:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:27 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:47:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:27 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T09:47:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:27 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T09:47:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:27 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:47:28.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:27 smithi096 ceph-mon[124666]: pgmap v11675: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 295 KiB/s wr, 11 op/s 2023-05-08T09:47:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:27 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:47:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:27 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T09:47:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:27 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T09:47:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:27 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:47:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:27 smithi186 ceph-mon[126480]: pgmap v11675: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 295 KiB/s wr, 11 op/s 2023-05-08T09:47:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21788.062750 secs 2023-05-08T09:47:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:28 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:47:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:28 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:47:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:28 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:47:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:28 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:47:29.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21788.062750 secs 2023-05-08T09:47:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:28 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:47:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:28 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:47:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:28 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:47:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:28 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:47:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21788.062750 secs 2023-05-08T09:47:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:28 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:47:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:28 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:47:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:28 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:47:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:28 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:47:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:29 smithi133 ceph-mon[125939]: pgmap v11676: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 295 KiB/s wr, 11 op/s 2023-05-08T09:47:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21788.618876 secs 2023-05-08T09:47:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:29 smithi096 ceph-mon[124666]: pgmap v11676: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 295 KiB/s wr, 11 op/s 2023-05-08T09:47:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21788.618876 secs 2023-05-08T09:47:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:29 smithi186 ceph-mon[126480]: pgmap v11676: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 295 KiB/s wr, 11 op/s 2023-05-08T09:47:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21788.618876 secs 2023-05-08T09:47:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21789.905819 secs 2023-05-08T09:47:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:31 smithi133 ceph-mon[125939]: pgmap v11677: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 577 KiB/s wr, 13 op/s 2023-05-08T09:47:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21789.905819 secs 2023-05-08T09:47:32.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:31 smithi096 ceph-mon[124666]: pgmap v11677: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 577 KiB/s wr, 13 op/s 2023-05-08T09:47:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21789.905819 secs 2023-05-08T09:47:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:31 smithi186 ceph-mon[126480]: pgmap v11677: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 577 KiB/s wr, 13 op/s 2023-05-08T09:47:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:33 smithi133 ceph-mon[125939]: pgmap v11678: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 577 KiB/s wr, 13 op/s 2023-05-08T09:47:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21793.062865 secs 2023-05-08T09:47:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:33 smithi133 ceph-mon[125939]: osdmap e807: 12 total, 12 up, 12 in 2023-05-08T09:47:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:33 smithi096 ceph-mon[124666]: pgmap v11678: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 577 KiB/s wr, 13 op/s 2023-05-08T09:47:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21793.062865 secs 2023-05-08T09:47:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:33 smithi096 ceph-mon[124666]: osdmap e807: 12 total, 12 up, 12 in 2023-05-08T09:47:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:33 smithi186 ceph-mon[126480]: pgmap v11678: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 577 KiB/s wr, 13 op/s 2023-05-08T09:47:34.442 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21793.062865 secs 2023-05-08T09:47:34.442 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:33 smithi186 ceph-mon[126480]: osdmap e807: 12 total, 12 up, 12 in 2023-05-08T09:47:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21793.618942 secs 2023-05-08T09:47:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21793.618942 secs 2023-05-08T09:47:35.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21793.618942 secs 2023-05-08T09:47:36.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:35 smithi133 ceph-mon[125939]: pgmap v11680: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 329 KiB/s wr, 10 op/s 2023-05-08T09:47:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:35 smithi096 ceph-mon[124666]: pgmap v11680: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 329 KiB/s wr, 10 op/s 2023-05-08T09:47:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:35 smithi186 ceph-mon[126480]: pgmap v11680: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 329 KiB/s wr, 10 op/s 2023-05-08T09:47:37.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21794.905867 secs 2023-05-08T09:47:37.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21794.905867 secs 2023-05-08T09:47:37.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21794.905867 secs 2023-05-08T09:47:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:37 smithi133 ceph-mon[125939]: pgmap v11681: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 283 KiB/s wr, 9 op/s 2023-05-08T09:47:38.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:37 smithi096 ceph-mon[124666]: pgmap v11681: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 283 KiB/s wr, 9 op/s 2023-05-08T09:47:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:37 smithi186 ceph-mon[126480]: pgmap v11681: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 283 KiB/s wr, 9 op/s 2023-05-08T09:47:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21798.062937 secs 2023-05-08T09:47:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21798.062937 secs 2023-05-08T09:47:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21798.062937 secs 2023-05-08T09:47:40.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:39 smithi133 ceph-mon[125939]: pgmap v11682: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 283 KiB/s wr, 9 op/s 2023-05-08T09:47:40.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21798.619073 secs 2023-05-08T09:47:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:39 smithi096 ceph-mon[124666]: pgmap v11682: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 283 KiB/s wr, 9 op/s 2023-05-08T09:47:40.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21798.619073 secs 2023-05-08T09:47:40.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:39 smithi186 ceph-mon[126480]: pgmap v11682: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 283 KiB/s wr, 9 op/s 2023-05-08T09:47:40.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21798.619073 secs 2023-05-08T09:47:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21799.905994 secs 2023-05-08T09:47:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:41 smithi096 ceph-mon[124666]: pgmap v11683: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 159 KiB/s wr, 8 op/s 2023-05-08T09:47:42.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21799.905994 secs 2023-05-08T09:47:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:41 smithi186 ceph-mon[126480]: pgmap v11683: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 159 KiB/s wr, 8 op/s 2023-05-08T09:47:42.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21799.905994 secs 2023-05-08T09:47:42.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:41 smithi133 ceph-mon[125939]: pgmap v11683: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 159 KiB/s wr, 8 op/s 2023-05-08T09:47:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:43 smithi096 ceph-mon[124666]: pgmap v11684: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 159 KiB/s wr, 8 op/s 2023-05-08T09:47:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21803.063007 secs 2023-05-08T09:47:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:43 smithi186 ceph-mon[126480]: pgmap v11684: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 159 KiB/s wr, 8 op/s 2023-05-08T09:47:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21803.063007 secs 2023-05-08T09:47:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:43 smithi133 ceph-mon[125939]: pgmap v11684: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 159 KiB/s wr, 8 op/s 2023-05-08T09:47:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21803.063007 secs 2023-05-08T09:47:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:45 smithi096 ceph-mon[124666]: pgmap v11685: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 579 KiB/s rd, 493 KiB/s wr, 12 op/s 2023-05-08T09:47:46.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:45 smithi186 ceph-mon[126480]: pgmap v11685: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 579 KiB/s rd, 493 KiB/s wr, 12 op/s 2023-05-08T09:47:46.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:45 smithi133 ceph-mon[125939]: pgmap v11685: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 579 KiB/s rd, 493 KiB/s wr, 12 op/s 2023-05-08T09:47:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:47 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21804.906058 secs 2023-05-08T09:47:47.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:47 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21804.906058 secs 2023-05-08T09:47:47.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:47 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21804.906058 secs 2023-05-08T09:47:48.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:48 smithi186 ceph-mon[126480]: pgmap v11686: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 451 KiB/s wr, 7 op/s 2023-05-08T09:47:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:47:48.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:48 smithi133 ceph-mon[125939]: pgmap v11686: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 451 KiB/s wr, 7 op/s 2023-05-08T09:47:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:47:48.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:48 smithi096 ceph-mon[124666]: pgmap v11686: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 451 KiB/s wr, 7 op/s 2023-05-08T09:47:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:47:49.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:47:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:47:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:47:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21808.063053 secs 2023-05-08T09:47:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:47:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:47:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:47:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21808.063053 secs 2023-05-08T09:47:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:47:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:47:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:47:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21808.063053 secs 2023-05-08T09:47:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:50 smithi186 ceph-mon[126480]: pgmap v11687: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 451 KiB/s wr, 7 op/s 2023-05-08T09:47:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:50 smithi133 ceph-mon[125939]: pgmap v11687: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 451 KiB/s wr, 7 op/s 2023-05-08T09:47:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:50 smithi096 ceph-mon[124666]: pgmap v11687: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 451 KiB/s wr, 7 op/s 2023-05-08T09:47:52.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:52 smithi186 ceph-mon[126480]: pgmap v11688: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 712 KiB/s rd, 659 KiB/s wr, 13 op/s 2023-05-08T09:47:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:47:52.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:52 smithi133 ceph-mon[125939]: pgmap v11688: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 712 KiB/s rd, 659 KiB/s wr, 13 op/s 2023-05-08T09:47:52.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:47:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:52 smithi096 ceph-mon[124666]: pgmap v11688: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 712 KiB/s rd, 659 KiB/s wr, 13 op/s 2023-05-08T09:47:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:47:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:47:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:47:53.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:47:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:47:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:47:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:47:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:54 smithi186 ceph-mon[126480]: pgmap v11689: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 580 KiB/s rd, 527 KiB/s wr, 9 op/s 2023-05-08T09:47:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21813.063164 secs 2023-05-08T09:47:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:54 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:47:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:54 smithi133 ceph-mon[125939]: pgmap v11689: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 580 KiB/s rd, 527 KiB/s wr, 9 op/s 2023-05-08T09:47:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21813.063164 secs 2023-05-08T09:47:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:54 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:47:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:54 smithi096 ceph-mon[124666]: pgmap v11689: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 580 KiB/s rd, 527 KiB/s wr, 9 op/s 2023-05-08T09:47:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21813.063164 secs 2023-05-08T09:47:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:54 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:47:55.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21813.619423 secs 2023-05-08T09:47:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21813.619423 secs 2023-05-08T09:47:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21813.619423 secs 2023-05-08T09:47:56.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:56 smithi186 ceph-mon[126480]: pgmap v11690: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 828 KiB/s rd, 788 KiB/s wr, 14 op/s 2023-05-08T09:47:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:56 smithi133 ceph-mon[125939]: pgmap v11690: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 828 KiB/s rd, 788 KiB/s wr, 14 op/s 2023-05-08T09:47:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:56 smithi096 ceph-mon[124666]: pgmap v11690: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 828 KiB/s rd, 788 KiB/s wr, 14 op/s 2023-05-08T09:47:57.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:47:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:47:57.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:47:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:47:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:47:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:47:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:58 smithi186 ceph-mon[126480]: pgmap v11691: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 521 KiB/s rd, 468 KiB/s wr, 10 op/s 2023-05-08T09:47:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:58 smithi133 ceph-mon[125939]: pgmap v11691: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 521 KiB/s rd, 468 KiB/s wr, 10 op/s 2023-05-08T09:47:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:58 smithi096 ceph-mon[124666]: pgmap v11691: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 521 KiB/s rd, 468 KiB/s wr, 10 op/s 2023-05-08T09:47:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21818.063301 secs 2023-05-08T09:47:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:47:59 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:47:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21818.063301 secs 2023-05-08T09:47:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:47:59 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:47:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21818.063301 secs 2023-05-08T09:47:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:47:59 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:48:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:00 smithi186 ceph-mon[126480]: pgmap v11692: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 521 KiB/s rd, 468 KiB/s wr, 10 op/s 2023-05-08T09:48:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:00 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:48:00.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:00 smithi133 ceph-mon[125939]: pgmap v11692: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 521 KiB/s rd, 468 KiB/s wr, 10 op/s 2023-05-08T09:48:00.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:00 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:48:00.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:00 smithi096 ceph-mon[124666]: pgmap v11692: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 521 KiB/s rd, 468 KiB/s wr, 10 op/s 2023-05-08T09:48:00.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:00 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:48:01.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:48:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:48:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:48:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:48:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:48:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:48:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:02 smithi186 ceph-mon[126480]: pgmap v11693: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 776 KiB/s rd, 723 KiB/s wr, 15 op/s 2023-05-08T09:48:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:02 smithi133 ceph-mon[125939]: pgmap v11693: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 776 KiB/s rd, 723 KiB/s wr, 15 op/s 2023-05-08T09:48:02.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:02 smithi096 ceph-mon[124666]: pgmap v11693: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 776 KiB/s rd, 723 KiB/s wr, 15 op/s 2023-05-08T09:48:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:04 smithi186 ceph-mon[126480]: pgmap v11694: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 515 KiB/s wr, 9 op/s 2023-05-08T09:48:04.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21823.063424 secs 2023-05-08T09:48:04.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:04 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:48:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:04 smithi133 ceph-mon[125939]: pgmap v11694: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 515 KiB/s wr, 9 op/s 2023-05-08T09:48:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21823.063424 secs 2023-05-08T09:48:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:04 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:48:04.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:04 smithi096 ceph-mon[124666]: pgmap v11694: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 515 KiB/s wr, 9 op/s 2023-05-08T09:48:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21823.063424 secs 2023-05-08T09:48:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:04 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:48:05.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21823.619652 secs 2023-05-08T09:48:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21823.619652 secs 2023-05-08T09:48:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21823.619652 secs 2023-05-08T09:48:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:06 smithi186 ceph-mon[126480]: pgmap v11695: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 691 KiB/s rd, 712 KiB/s wr, 28 op/s 2023-05-08T09:48:06.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:06 smithi133 ceph-mon[125939]: pgmap v11695: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 691 KiB/s rd, 712 KiB/s wr, 28 op/s 2023-05-08T09:48:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:06 smithi096 ceph-mon[124666]: pgmap v11695: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 691 KiB/s rd, 712 KiB/s wr, 28 op/s 2023-05-08T09:48:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:07 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21824.906449 secs 2023-05-08T09:48:07.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:07 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21824.906449 secs 2023-05-08T09:48:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:07 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21824.906449 secs 2023-05-08T09:48:08.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:08 smithi186 ceph-mon[126480]: pgmap v11696: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 451 KiB/s wr, 23 op/s 2023-05-08T09:48:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:08 smithi133 ceph-mon[125939]: pgmap v11696: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 451 KiB/s wr, 23 op/s 2023-05-08T09:48:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:08 smithi096 ceph-mon[124666]: pgmap v11696: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 451 KiB/s wr, 23 op/s 2023-05-08T09:48:09.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:48:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:48:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:48:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21828.063505 secs 2023-05-08T09:48:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:09 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:48:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:48:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:48:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:48:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21828.063505 secs 2023-05-08T09:48:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:09 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:48:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:48:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:48:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:48:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21828.063505 secs 2023-05-08T09:48:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:09 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:48:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:10 smithi186 ceph-mon[126480]: pgmap v11697: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 451 KiB/s wr, 23 op/s 2023-05-08T09:48:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21828.619760 secs 2023-05-08T09:48:10.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:10 smithi133 ceph-mon[125939]: pgmap v11697: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 451 KiB/s wr, 23 op/s 2023-05-08T09:48:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21828.619760 secs 2023-05-08T09:48:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:10 smithi096 ceph-mon[124666]: pgmap v11697: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 451 KiB/s wr, 23 op/s 2023-05-08T09:48:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21828.619760 secs 2023-05-08T09:48:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:12 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21829.906567 secs 2023-05-08T09:48:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:12 smithi186 ceph-mon[126480]: pgmap v11698: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 590 KiB/s rd, 599 KiB/s wr, 27 op/s 2023-05-08T09:48:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:12 smithi186 ceph-mon[126480]: osdmap e808: 12 total, 12 up, 12 in 2023-05-08T09:48:12.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:12 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21829.906567 secs 2023-05-08T09:48:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:12 smithi133 ceph-mon[125939]: pgmap v11698: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 590 KiB/s rd, 599 KiB/s wr, 27 op/s 2023-05-08T09:48:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:12 smithi133 ceph-mon[125939]: osdmap e808: 12 total, 12 up, 12 in 2023-05-08T09:48:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:12 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21829.906567 secs 2023-05-08T09:48:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:12 smithi096 ceph-mon[124666]: pgmap v11698: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 590 KiB/s rd, 599 KiB/s wr, 27 op/s 2023-05-08T09:48:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:12 smithi096 ceph-mon[124666]: osdmap e808: 12 total, 12 up, 12 in 2023-05-08T09:48:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:14 smithi186 ceph-mon[126480]: pgmap v11700: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 413 KiB/s wr, 27 op/s 2023-05-08T09:48:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21833.063569 secs 2023-05-08T09:48:14.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:14 smithi133 ceph-mon[125939]: pgmap v11700: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 413 KiB/s wr, 27 op/s 2023-05-08T09:48:14.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21833.063569 secs 2023-05-08T09:48:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:14 smithi096 ceph-mon[124666]: pgmap v11700: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 413 KiB/s wr, 27 op/s 2023-05-08T09:48:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21833.063569 secs 2023-05-08T09:48:15.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21833.619862 secs 2023-05-08T09:48:15.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21833.619862 secs 2023-05-08T09:48:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21833.619862 secs 2023-05-08T09:48:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:16 smithi186 ceph-mon[126480]: pgmap v11701: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 275 KiB/s wr, 8 op/s 2023-05-08T09:48:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21834.906687 secs 2023-05-08T09:48:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:16 smithi133 ceph-mon[125939]: pgmap v11701: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 275 KiB/s wr, 8 op/s 2023-05-08T09:48:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21834.906687 secs 2023-05-08T09:48:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:16 smithi096 ceph-mon[124666]: pgmap v11701: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 275 KiB/s wr, 8 op/s 2023-05-08T09:48:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21834.906687 secs 2023-05-08T09:48:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:18 smithi186 ceph-mon[126480]: pgmap v11702: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 275 KiB/s wr, 9 op/s 2023-05-08T09:48:18.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:18 smithi133 ceph-mon[125939]: pgmap v11702: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 275 KiB/s wr, 9 op/s 2023-05-08T09:48:18.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:18 smithi096 ceph-mon[124666]: pgmap v11702: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 275 KiB/s wr, 9 op/s 2023-05-08T09:48:19.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21838.063708 secs 2023-05-08T09:48:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:19 smithi133 ceph-mon[125939]: osdmap e809: 12 total, 12 up, 12 in 2023-05-08T09:48:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21838.063708 secs 2023-05-08T09:48:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:19 smithi096 ceph-mon[124666]: osdmap e809: 12 total, 12 up, 12 in 2023-05-08T09:48:19.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21838.063708 secs 2023-05-08T09:48:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:19 smithi186 ceph-mon[126480]: osdmap e809: 12 total, 12 up, 12 in 2023-05-08T09:48:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:20 smithi133 ceph-mon[125939]: pgmap v11703: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 275 KiB/s wr, 9 op/s 2023-05-08T09:48:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21838.619983 secs 2023-05-08T09:48:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:20 smithi096 ceph-mon[124666]: pgmap v11703: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 275 KiB/s wr, 9 op/s 2023-05-08T09:48:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21838.619983 secs 2023-05-08T09:48:20.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:20 smithi186 ceph-mon[126480]: pgmap v11703: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 275 KiB/s wr, 9 op/s 2023-05-08T09:48:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21838.619983 secs 2023-05-08T09:48:21.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21839.906810 secs 2023-05-08T09:48:21.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21839.906810 secs 2023-05-08T09:48:21.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21839.906810 secs 2023-05-08T09:48:22.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:22 smithi133 ceph-mon[125939]: pgmap v11705: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 288 KiB/s wr, 9 op/s 2023-05-08T09:48:22.547 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:22 smithi096 ceph-mon[124666]: pgmap v11705: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 288 KiB/s wr, 9 op/s 2023-05-08T09:48:22.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:22 smithi186 ceph-mon[126480]: pgmap v11705: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 288 KiB/s wr, 9 op/s 2023-05-08T09:48:24.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:24 smithi133 ceph-mon[125939]: pgmap v11706: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 272 KiB/s wr, 9 op/s 2023-05-08T09:48:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21843.063839 secs 2023-05-08T09:48:24.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:24 smithi096 ceph-mon[124666]: pgmap v11706: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 272 KiB/s wr, 9 op/s 2023-05-08T09:48:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21843.063839 secs 2023-05-08T09:48:24.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:24 smithi186 ceph-mon[126480]: pgmap v11706: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 272 KiB/s wr, 9 op/s 2023-05-08T09:48:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21843.063839 secs 2023-05-08T09:48:25.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21843.620119 secs 2023-05-08T09:48:25.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21843.620119 secs 2023-05-08T09:48:25.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21843.620119 secs 2023-05-08T09:48:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:26 smithi133 ceph-mon[125939]: pgmap v11707: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 262 KiB/s wr, 9 op/s 2023-05-08T09:48:26.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21844.906913 secs 2023-05-08T09:48:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:26 smithi096 ceph-mon[124666]: pgmap v11707: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 262 KiB/s wr, 9 op/s 2023-05-08T09:48:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21844.906913 secs 2023-05-08T09:48:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:26 smithi186 ceph-mon[126480]: pgmap v11707: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 262 KiB/s wr, 9 op/s 2023-05-08T09:48:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21844.906913 secs 2023-05-08T09:48:27.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:48:27.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:48:27.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:48:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:28 smithi186 ceph-mon[126480]: pgmap v11708: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 262 KiB/s wr, 8 op/s 2023-05-08T09:48:28.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:28 smithi133 ceph-mon[125939]: pgmap v11708: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 262 KiB/s wr, 8 op/s 2023-05-08T09:48:28.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:28 smithi096 ceph-mon[124666]: pgmap v11708: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 262 KiB/s wr, 8 op/s 2023-05-08T09:48:29.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21848.063991 secs 2023-05-08T09:48:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21848.063991 secs 2023-05-08T09:48:29.537 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21848.063991 secs 2023-05-08T09:48:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:30 smithi133 ceph-mon[125939]: pgmap v11709: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 262 KiB/s wr, 8 op/s 2023-05-08T09:48:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21848.620256 secs 2023-05-08T09:48:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:48:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:48:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:48:30.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:48:30.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:48:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:30 smithi096 ceph-mon[124666]: pgmap v11709: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 262 KiB/s wr, 8 op/s 2023-05-08T09:48:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21848.620256 secs 2023-05-08T09:48:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:48:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:48:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:48:30.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:48:30.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:48:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:30 smithi186 ceph-mon[126480]: pgmap v11709: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 262 KiB/s wr, 8 op/s 2023-05-08T09:48:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21848.620256 secs 2023-05-08T09:48:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:48:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:48:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:48:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:48:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:48:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:31 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:48:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:31 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T09:48:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:31 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T09:48:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:31 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:48:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21849.907037 secs 2023-05-08T09:48:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:31 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:48:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:31 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T09:48:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:31 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T09:48:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:31 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:48:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21849.907037 secs 2023-05-08T09:48:31.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:31 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:48:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:31 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T09:48:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:31 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T09:48:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:31 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:48:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21849.907037 secs 2023-05-08T09:48:32.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:32 smithi133 ceph-mon[125939]: pgmap v11710: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 231 KiB/s wr, 11 op/s 2023-05-08T09:48:32.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:32 smithi096 ceph-mon[124666]: pgmap v11710: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 231 KiB/s wr, 11 op/s 2023-05-08T09:48:32.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:32 smithi186 ceph-mon[126480]: pgmap v11710: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 231 KiB/s wr, 11 op/s 2023-05-08T09:48:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:34 smithi133 ceph-mon[125939]: pgmap v11711: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 86 KiB/s wr, 7 op/s 2023-05-08T09:48:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21853.064124 secs 2023-05-08T09:48:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:34 smithi096 ceph-mon[124666]: pgmap v11711: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 86 KiB/s wr, 7 op/s 2023-05-08T09:48:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21853.064124 secs 2023-05-08T09:48:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:34 smithi186 ceph-mon[126480]: pgmap v11711: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 86 KiB/s wr, 7 op/s 2023-05-08T09:48:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21853.064124 secs 2023-05-08T09:48:35.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21853.620376 secs 2023-05-08T09:48:35.510 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21853.620376 secs 2023-05-08T09:48:35.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21853.620376 secs 2023-05-08T09:48:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:36 smithi133 ceph-mon[125939]: pgmap v11712: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 197 KiB/s wr, 10 op/s 2023-05-08T09:48:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21854.907100 secs 2023-05-08T09:48:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:36 smithi096 ceph-mon[124666]: pgmap v11712: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 197 KiB/s wr, 10 op/s 2023-05-08T09:48:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21854.907100 secs 2023-05-08T09:48:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:36 smithi186 ceph-mon[126480]: pgmap v11712: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 197 KiB/s wr, 10 op/s 2023-05-08T09:48:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21854.907100 secs 2023-05-08T09:48:38.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:38 smithi133 ceph-mon[125939]: pgmap v11713: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 231 KiB/s wr, 7 op/s 2023-05-08T09:48:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:38 smithi096 ceph-mon[124666]: pgmap v11713: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 231 KiB/s wr, 7 op/s 2023-05-08T09:48:38.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:38 smithi186 ceph-mon[126480]: pgmap v11713: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 231 KiB/s wr, 7 op/s 2023-05-08T09:48:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21858.064257 secs 2023-05-08T09:48:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21858.064257 secs 2023-05-08T09:48:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21858.064257 secs 2023-05-08T09:48:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:40 smithi133 ceph-mon[125939]: pgmap v11714: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 231 KiB/s wr, 7 op/s 2023-05-08T09:48:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21858.620489 secs 2023-05-08T09:48:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:40 smithi096 ceph-mon[124666]: pgmap v11714: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 231 KiB/s wr, 7 op/s 2023-05-08T09:48:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21858.620489 secs 2023-05-08T09:48:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:40 smithi186 ceph-mon[126480]: pgmap v11714: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 231 KiB/s wr, 7 op/s 2023-05-08T09:48:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21858.620489 secs 2023-05-08T09:48:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21859.907165 secs 2023-05-08T09:48:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:41 smithi133 ceph-mon[125939]: pgmap v11715: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 361 KiB/s wr, 11 op/s 2023-05-08T09:48:41.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21859.907165 secs 2023-05-08T09:48:41.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:41 smithi096 ceph-mon[124666]: pgmap v11715: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 361 KiB/s wr, 11 op/s 2023-05-08T09:48:41.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21859.907165 secs 2023-05-08T09:48:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:41 smithi186 ceph-mon[126480]: pgmap v11715: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 361 KiB/s wr, 11 op/s 2023-05-08T09:48:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:43 smithi133 ceph-mon[125939]: pgmap v11716: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 348 KiB/s wr, 7 op/s 2023-05-08T09:48:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21863.064371 secs 2023-05-08T09:48:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:43 smithi096 ceph-mon[124666]: pgmap v11716: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 348 KiB/s wr, 7 op/s 2023-05-08T09:48:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21863.064371 secs 2023-05-08T09:48:44.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:43 smithi186 ceph-mon[126480]: pgmap v11716: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 348 KiB/s wr, 7 op/s 2023-05-08T09:48:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21863.064371 secs 2023-05-08T09:48:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21863.620610 secs 2023-05-08T09:48:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:45 smithi133 ceph-mon[125939]: pgmap v11717: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 349 KiB/s wr, 10 op/s 2023-05-08T09:48:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21863.620610 secs 2023-05-08T09:48:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:45 smithi096 ceph-mon[124666]: pgmap v11717: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 349 KiB/s wr, 10 op/s 2023-05-08T09:48:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21863.620610 secs 2023-05-08T09:48:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:45 smithi186 ceph-mon[126480]: pgmap v11717: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 349 KiB/s wr, 10 op/s 2023-05-08T09:48:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21864.907290 secs 2023-05-08T09:48:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21864.907290 secs 2023-05-08T09:48:47.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21864.907290 secs 2023-05-08T09:48:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:47 smithi133 ceph-mon[125939]: pgmap v11718: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 342 KiB/s wr, 7 op/s 2023-05-08T09:48:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:47 smithi096 ceph-mon[124666]: pgmap v11718: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 342 KiB/s wr, 7 op/s 2023-05-08T09:48:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:47 smithi186 ceph-mon[126480]: pgmap v11718: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 342 KiB/s wr, 7 op/s 2023-05-08T09:48:48.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21868.064487 secs 2023-05-08T09:48:49.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21868.064487 secs 2023-05-08T09:48:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21868.064487 secs 2023-05-08T09:48:49.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:49 smithi133 ceph-mon[125939]: pgmap v11719: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 235 KiB/s wr, 6 op/s 2023-05-08T09:48:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:49 smithi096 ceph-mon[124666]: pgmap v11719: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 235 KiB/s wr, 6 op/s 2023-05-08T09:48:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:49 smithi186 ceph-mon[126480]: pgmap v11719: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 235 KiB/s wr, 6 op/s 2023-05-08T09:48:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:51 smithi133 ceph-mon[125939]: pgmap v11720: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 579 KiB/s rd, 549 KiB/s wr, 12 op/s 2023-05-08T09:48:51.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:48:51.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:48:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:51 smithi096 ceph-mon[124666]: pgmap v11720: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 579 KiB/s rd, 549 KiB/s wr, 12 op/s 2023-05-08T09:48:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:48:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:48:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:51 smithi186 ceph-mon[126480]: pgmap v11720: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 579 KiB/s rd, 549 KiB/s wr, 12 op/s 2023-05-08T09:48:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:48:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:48:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:52 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:48:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:48:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:48:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:48:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:52 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:48:53.067 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:48:53.067 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:48:53.067 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:48:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:52 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:48:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:48:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:48:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:48:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:53 smithi133 ceph-mon[125939]: pgmap v11721: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 577 KiB/s rd, 419 KiB/s wr, 8 op/s 2023-05-08T09:48:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21873.064603 secs 2023-05-08T09:48:54.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:53 smithi096 ceph-mon[124666]: pgmap v11721: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 577 KiB/s rd, 419 KiB/s wr, 8 op/s 2023-05-08T09:48:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21873.064603 secs 2023-05-08T09:48:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:53 smithi186 ceph-mon[126480]: pgmap v11721: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 577 KiB/s rd, 419 KiB/s wr, 8 op/s 2023-05-08T09:48:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21873.064603 secs 2023-05-08T09:48:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21873.620816 secs 2023-05-08T09:48:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:55 smithi133 ceph-mon[125939]: pgmap v11722: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 658 KiB/s rd, 486 KiB/s wr, 13 op/s 2023-05-08T09:48:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21873.620816 secs 2023-05-08T09:48:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:55 smithi096 ceph-mon[124666]: pgmap v11722: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 658 KiB/s rd, 486 KiB/s wr, 13 op/s 2023-05-08T09:48:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21873.620816 secs 2023-05-08T09:48:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:55 smithi186 ceph-mon[126480]: pgmap v11722: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 658 KiB/s rd, 486 KiB/s wr, 13 op/s 2023-05-08T09:48:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:48:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:48:57.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:48:57.009 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:48:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:48:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:48:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:57 smithi133 ceph-mon[125939]: pgmap v11723: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 850 KiB/s rd, 762 KiB/s wr, 11 op/s 2023-05-08T09:48:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:57 smithi096 ceph-mon[124666]: pgmap v11723: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 850 KiB/s rd, 762 KiB/s wr, 11 op/s 2023-05-08T09:48:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:57 smithi186 ceph-mon[126480]: pgmap v11723: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 850 KiB/s rd, 762 KiB/s wr, 11 op/s 2023-05-08T09:48:58.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21878.064701 secs 2023-05-08T09:48:58.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:58 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:48:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21878.064701 secs 2023-05-08T09:48:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:58 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:48:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21878.064701 secs 2023-05-08T09:48:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:58 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:48:59.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:48:59 smithi133 ceph-mon[125939]: pgmap v11724: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 721 KiB/s rd, 657 KiB/s wr, 10 op/s 2023-05-08T09:49:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:48:59 smithi096 ceph-mon[124666]: pgmap v11724: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 721 KiB/s rd, 657 KiB/s wr, 10 op/s 2023-05-08T09:49:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:48:59 smithi186 ceph-mon[126480]: pgmap v11724: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 721 KiB/s rd, 657 KiB/s wr, 10 op/s 2023-05-08T09:49:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21878.620950 secs 2023-05-08T09:49:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21878.620950 secs 2023-05-08T09:49:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21878.620950 secs 2023-05-08T09:49:01.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:01 smithi133 ceph-mon[125939]: pgmap v11725: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 817 KiB/s rd, 724 KiB/s wr, 15 op/s 2023-05-08T09:49:02.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:01 smithi096 ceph-mon[124666]: pgmap v11725: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 817 KiB/s rd, 724 KiB/s wr, 15 op/s 2023-05-08T09:49:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:01 smithi186 ceph-mon[126480]: pgmap v11725: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 817 KiB/s rd, 724 KiB/s wr, 15 op/s 2023-05-08T09:49:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:03 smithi133 ceph-mon[125939]: pgmap v11726: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 410 KiB/s wr, 10 op/s 2023-05-08T09:49:03.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21883.064825 secs 2023-05-08T09:49:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:03 smithi096 ceph-mon[124666]: pgmap v11726: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 410 KiB/s wr, 10 op/s 2023-05-08T09:49:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21883.064825 secs 2023-05-08T09:49:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:03 smithi186 ceph-mon[126480]: pgmap v11726: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 410 KiB/s wr, 10 op/s 2023-05-08T09:49:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21883.064825 secs 2023-05-08T09:49:05.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21883.621057 secs 2023-05-08T09:49:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:05 smithi133 ceph-mon[125939]: pgmap v11727: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 639 KiB/s rd, 725 KiB/s wr, 28 op/s 2023-05-08T09:49:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21883.621057 secs 2023-05-08T09:49:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:05 smithi096 ceph-mon[124666]: pgmap v11727: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 639 KiB/s rd, 725 KiB/s wr, 28 op/s 2023-05-08T09:49:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21883.621057 secs 2023-05-08T09:49:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:05 smithi186 ceph-mon[126480]: pgmap v11727: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 639 KiB/s rd, 725 KiB/s wr, 28 op/s 2023-05-08T09:49:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21884.907752 secs 2023-05-08T09:49:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21884.907752 secs 2023-05-08T09:49:07.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21884.907752 secs 2023-05-08T09:49:07.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:07 smithi133 ceph-mon[125939]: pgmap v11728: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 669 KiB/s rd, 658 KiB/s wr, 24 op/s 2023-05-08T09:49:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:07 smithi096 ceph-mon[124666]: pgmap v11728: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 669 KiB/s rd, 658 KiB/s wr, 24 op/s 2023-05-08T09:49:08.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:07 smithi186 ceph-mon[126480]: pgmap v11728: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 669 KiB/s rd, 658 KiB/s wr, 24 op/s 2023-05-08T09:49:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:08 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:49:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:49:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:49:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21888.064940 secs 2023-05-08T09:49:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:08 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:49:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:49:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:49:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21888.064940 secs 2023-05-08T09:49:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:08 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:49:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:49:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:49:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21888.064940 secs 2023-05-08T09:49:09.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:09 smithi133 ceph-mon[125939]: pgmap v11729: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 381 KiB/s wr, 23 op/s 2023-05-08T09:49:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:09 smithi096 ceph-mon[124666]: pgmap v11729: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 381 KiB/s wr, 23 op/s 2023-05-08T09:49:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:09 smithi186 ceph-mon[126480]: pgmap v11729: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 381 KiB/s wr, 23 op/s 2023-05-08T09:49:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21888.621172 secs 2023-05-08T09:49:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21888.621172 secs 2023-05-08T09:49:11.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21888.621172 secs 2023-05-08T09:49:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21889.907809 secs 2023-05-08T09:49:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:11 smithi133 ceph-mon[125939]: pgmap v11730: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 710 KiB/s rd, 604 KiB/s wr, 27 op/s 2023-05-08T09:49:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:11 smithi133 ceph-mon[125939]: osdmap e810: 12 total, 12 up, 12 in 2023-05-08T09:49:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21889.907809 secs 2023-05-08T09:49:12.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:11 smithi096 ceph-mon[124666]: pgmap v11730: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 710 KiB/s rd, 604 KiB/s wr, 27 op/s 2023-05-08T09:49:12.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:11 smithi096 ceph-mon[124666]: osdmap e810: 12 total, 12 up, 12 in 2023-05-08T09:49:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21889.907809 secs 2023-05-08T09:49:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:11 smithi186 ceph-mon[126480]: pgmap v11730: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 710 KiB/s rd, 604 KiB/s wr, 27 op/s 2023-05-08T09:49:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:11 smithi186 ceph-mon[126480]: osdmap e810: 12 total, 12 up, 12 in 2023-05-08T09:49:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:13 smithi133 ceph-mon[125939]: pgmap v11732: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 737 KiB/s rd, 645 KiB/s wr, 27 op/s 2023-05-08T09:49:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21893.065057 secs 2023-05-08T09:49:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:13 smithi096 ceph-mon[124666]: pgmap v11732: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 737 KiB/s rd, 645 KiB/s wr, 27 op/s 2023-05-08T09:49:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21893.065057 secs 2023-05-08T09:49:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:13 smithi186 ceph-mon[126480]: pgmap v11732: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 737 KiB/s rd, 645 KiB/s wr, 27 op/s 2023-05-08T09:49:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21893.065057 secs 2023-05-08T09:49:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21893.621290 secs 2023-05-08T09:49:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:15 smithi096 ceph-mon[124666]: pgmap v11733: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 378 KiB/s wr, 10 op/s 2023-05-08T09:49:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21893.621290 secs 2023-05-08T09:49:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:15 smithi186 ceph-mon[126480]: pgmap v11733: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 378 KiB/s wr, 10 op/s 2023-05-08T09:49:16.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21893.621290 secs 2023-05-08T09:49:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:15 smithi133 ceph-mon[125939]: pgmap v11733: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 378 KiB/s wr, 10 op/s 2023-05-08T09:49:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21894.907920 secs 2023-05-08T09:49:17.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21894.907920 secs 2023-05-08T09:49:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21894.907920 secs 2023-05-08T09:49:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:17 smithi096 ceph-mon[124666]: pgmap v11734: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 378 KiB/s wr, 9 op/s 2023-05-08T09:49:18.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:17 smithi186 ceph-mon[126480]: pgmap v11734: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 378 KiB/s wr, 9 op/s 2023-05-08T09:49:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:17 smithi133 ceph-mon[125939]: pgmap v11734: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 378 KiB/s wr, 9 op/s 2023-05-08T09:49:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21898.065172 secs 2023-05-08T09:49:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:18 smithi096 ceph-mon[124666]: osdmap e811: 12 total, 12 up, 12 in 2023-05-08T09:49:19.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21898.065172 secs 2023-05-08T09:49:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:18 smithi186 ceph-mon[126480]: osdmap e811: 12 total, 12 up, 12 in 2023-05-08T09:49:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21898.065172 secs 2023-05-08T09:49:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:18 smithi133 ceph-mon[125939]: osdmap e811: 12 total, 12 up, 12 in 2023-05-08T09:49:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:19 smithi096 ceph-mon[124666]: pgmap v11735: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 378 KiB/s wr, 9 op/s 2023-05-08T09:49:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:19 smithi186 ceph-mon[126480]: pgmap v11735: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 378 KiB/s wr, 9 op/s 2023-05-08T09:49:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:19 smithi133 ceph-mon[125939]: pgmap v11735: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 378 KiB/s wr, 9 op/s 2023-05-08T09:49:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21898.621405 secs 2023-05-08T09:49:21.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21898.621405 secs 2023-05-08T09:49:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21898.621405 secs 2023-05-08T09:49:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21899.908075 secs 2023-05-08T09:49:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:21 smithi186 ceph-mon[126480]: pgmap v11737: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 184 KiB/s wr, 8 op/s 2023-05-08T09:49:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21899.908075 secs 2023-05-08T09:49:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:21 smithi133 ceph-mon[125939]: pgmap v11737: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 184 KiB/s wr, 8 op/s 2023-05-08T09:49:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21899.908075 secs 2023-05-08T09:49:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:21 smithi096 ceph-mon[124666]: pgmap v11737: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 184 KiB/s wr, 8 op/s 2023-05-08T09:49:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:23 smithi186 ceph-mon[126480]: pgmap v11738: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 181 KiB/s wr, 8 op/s 2023-05-08T09:49:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21903.065299 secs 2023-05-08T09:49:24.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:23 smithi133 ceph-mon[125939]: pgmap v11738: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 181 KiB/s wr, 8 op/s 2023-05-08T09:49:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21903.065299 secs 2023-05-08T09:49:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:23 smithi096 ceph-mon[124666]: pgmap v11738: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 181 KiB/s wr, 8 op/s 2023-05-08T09:49:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21903.065299 secs 2023-05-08T09:49:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21903.621544 secs 2023-05-08T09:49:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:25 smithi186 ceph-mon[126480]: pgmap v11739: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 85 KiB/s wr, 7 op/s 2023-05-08T09:49:26.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21903.621544 secs 2023-05-08T09:49:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:25 smithi133 ceph-mon[125939]: pgmap v11739: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 85 KiB/s wr, 7 op/s 2023-05-08T09:49:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21903.621544 secs 2023-05-08T09:49:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:25 smithi096 ceph-mon[124666]: pgmap v11739: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 85 KiB/s wr, 7 op/s 2023-05-08T09:49:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21904.908163 secs 2023-05-08T09:49:27.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21904.908163 secs 2023-05-08T09:49:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21904.908163 secs 2023-05-08T09:49:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:27 smithi186 ceph-mon[126480]: pgmap v11740: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 85 KiB/s wr, 7 op/s 2023-05-08T09:49:28.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:27 smithi133 ceph-mon[125939]: pgmap v11740: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 85 KiB/s wr, 7 op/s 2023-05-08T09:49:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:27 smithi096 ceph-mon[124666]: pgmap v11740: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 85 KiB/s wr, 7 op/s 2023-05-08T09:49:29.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21908.065366 secs 2023-05-08T09:49:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21908.065366 secs 2023-05-08T09:49:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21908.065366 secs 2023-05-08T09:49:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:29 smithi186 ceph-mon[126480]: pgmap v11741: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 85 KiB/s wr, 7 op/s 2023-05-08T09:49:30.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:29 smithi133 ceph-mon[125939]: pgmap v11741: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 85 KiB/s wr, 7 op/s 2023-05-08T09:49:30.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:29 smithi096 ceph-mon[124666]: pgmap v11741: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 85 KiB/s wr, 7 op/s 2023-05-08T09:49:31.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21908.621676 secs 2023-05-08T09:49:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:49:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:49:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:49:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:49:31.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21908.621676 secs 2023-05-08T09:49:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:49:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:49:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:49:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:49:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21908.621676 secs 2023-05-08T09:49:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:49:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:49:31.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:49:31.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:49:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21909.908257 secs 2023-05-08T09:49:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:31 smithi186 ceph-mon[126480]: pgmap v11742: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 145 KiB/s wr, 10 op/s 2023-05-08T09:49:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:31 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:49:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:31 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T09:49:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:31 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T09:49:32.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:31 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:49:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21909.908257 secs 2023-05-08T09:49:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:31 smithi133 ceph-mon[125939]: pgmap v11742: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 145 KiB/s wr, 10 op/s 2023-05-08T09:49:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:31 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:49:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:31 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T09:49:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:31 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T09:49:32.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:31 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:49:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21909.908257 secs 2023-05-08T09:49:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:31 smithi096 ceph-mon[124666]: pgmap v11742: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 145 KiB/s wr, 10 op/s 2023-05-08T09:49:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:31 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:49:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:31 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T09:49:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:31 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T09:49:32.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:31 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:49:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:33 smithi186 ceph-mon[126480]: pgmap v11743: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 87 KiB/s wr, 6 op/s 2023-05-08T09:49:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21913.065477 secs 2023-05-08T09:49:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:33 smithi133 ceph-mon[125939]: pgmap v11743: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 87 KiB/s wr, 6 op/s 2023-05-08T09:49:34.307 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21913.065477 secs 2023-05-08T09:49:34.308 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:33 smithi096 ceph-mon[124666]: pgmap v11743: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 87 KiB/s wr, 6 op/s 2023-05-08T09:49:34.308 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21913.065477 secs 2023-05-08T09:49:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21913.621814 secs 2023-05-08T09:49:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:35 smithi186 ceph-mon[126480]: pgmap v11744: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 88 KiB/s wr, 10 op/s 2023-05-08T09:49:36.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21913.621814 secs 2023-05-08T09:49:36.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:35 smithi133 ceph-mon[125939]: pgmap v11744: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 88 KiB/s wr, 10 op/s 2023-05-08T09:49:36.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21913.621814 secs 2023-05-08T09:49:36.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:35 smithi096 ceph-mon[124666]: pgmap v11744: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 88 KiB/s wr, 10 op/s 2023-05-08T09:49:37.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21914.908371 secs 2023-05-08T09:49:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21914.908371 secs 2023-05-08T09:49:37.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21914.908371 secs 2023-05-08T09:49:38.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:37 smithi186 ceph-mon[126480]: pgmap v11745: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 75 KiB/s wr, 7 op/s 2023-05-08T09:49:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:37 smithi133 ceph-mon[125939]: pgmap v11745: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 75 KiB/s wr, 7 op/s 2023-05-08T09:49:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:37 smithi096 ceph-mon[124666]: pgmap v11745: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 75 KiB/s wr, 7 op/s 2023-05-08T09:49:39.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21918.065577 secs 2023-05-08T09:49:39.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21918.065577 secs 2023-05-08T09:49:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21918.065577 secs 2023-05-08T09:49:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:39 smithi186 ceph-mon[126480]: pgmap v11746: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 75 KiB/s wr, 7 op/s 2023-05-08T09:49:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21918.621937 secs 2023-05-08T09:49:40.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:39 smithi133 ceph-mon[125939]: pgmap v11746: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 75 KiB/s wr, 7 op/s 2023-05-08T09:49:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21918.621937 secs 2023-05-08T09:49:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:39 smithi096 ceph-mon[124666]: pgmap v11746: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 75 KiB/s wr, 7 op/s 2023-05-08T09:49:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21918.621937 secs 2023-05-08T09:49:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21919.908497 secs 2023-05-08T09:49:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:41 smithi186 ceph-mon[126480]: pgmap v11747: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 236 KiB/s wr, 10 op/s 2023-05-08T09:49:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21919.908497 secs 2023-05-08T09:49:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:41 smithi133 ceph-mon[125939]: pgmap v11747: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 236 KiB/s wr, 10 op/s 2023-05-08T09:49:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21919.908497 secs 2023-05-08T09:49:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:41 smithi096 ceph-mon[124666]: pgmap v11747: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 236 KiB/s wr, 10 op/s 2023-05-08T09:49:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:43 smithi186 ceph-mon[126480]: pgmap v11748: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 162 KiB/s wr, 6 op/s 2023-05-08T09:49:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21923.065690 secs 2023-05-08T09:49:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:43 smithi133 ceph-mon[125939]: pgmap v11748: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 162 KiB/s wr, 6 op/s 2023-05-08T09:49:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21923.065690 secs 2023-05-08T09:49:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:43 smithi096 ceph-mon[124666]: pgmap v11748: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 162 KiB/s wr, 6 op/s 2023-05-08T09:49:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21923.065690 secs 2023-05-08T09:49:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21923.622057 secs 2023-05-08T09:49:45.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21923.622057 secs 2023-05-08T09:49:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21923.622057 secs 2023-05-08T09:49:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:45 smithi186 ceph-mon[126480]: pgmap v11749: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 165 KiB/s wr, 10 op/s 2023-05-08T09:49:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:45 smithi133 ceph-mon[125939]: pgmap v11749: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 165 KiB/s wr, 10 op/s 2023-05-08T09:49:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:45 smithi096 ceph-mon[124666]: pgmap v11749: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 165 KiB/s wr, 10 op/s 2023-05-08T09:49:47.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21924.908645 secs 2023-05-08T09:49:47.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21924.908645 secs 2023-05-08T09:49:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21924.908645 secs 2023-05-08T09:49:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:47 smithi186 ceph-mon[126480]: pgmap v11750: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 164 KiB/s wr, 6 op/s 2023-05-08T09:49:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:47 smithi133 ceph-mon[125939]: pgmap v11750: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 164 KiB/s wr, 6 op/s 2023-05-08T09:49:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:47 smithi096 ceph-mon[124666]: pgmap v11750: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 164 KiB/s wr, 6 op/s 2023-05-08T09:49:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21928.065824 secs 2023-05-08T09:49:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21928.065824 secs 2023-05-08T09:49:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21928.065824 secs 2023-05-08T09:49:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:49 smithi186 ceph-mon[126480]: pgmap v11751: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 164 KiB/s wr, 6 op/s 2023-05-08T09:49:50.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:49 smithi133 ceph-mon[125939]: pgmap v11751: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 164 KiB/s wr, 6 op/s 2023-05-08T09:49:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:49 smithi096 ceph-mon[124666]: pgmap v11751: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 164 KiB/s wr, 6 op/s 2023-05-08T09:49:52.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21929.908789 secs 2023-05-08T09:49:52.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:51 smithi186 ceph-mon[126480]: pgmap v11752: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 319 KiB/s wr, 10 op/s 2023-05-08T09:49:52.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:49:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21929.908789 secs 2023-05-08T09:49:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:51 smithi133 ceph-mon[125939]: pgmap v11752: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 319 KiB/s wr, 10 op/s 2023-05-08T09:49:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:49:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21929.908789 secs 2023-05-08T09:49:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:51 smithi096 ceph-mon[124666]: pgmap v11752: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 319 KiB/s wr, 10 op/s 2023-05-08T09:49:52.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:49:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:52 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:49:53.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:49:53.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:49:53.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:52 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:49:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:49:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:49:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:52 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:49:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:49:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:49:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:53 smithi186 ceph-mon[126480]: pgmap v11753: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 159 KiB/s wr, 7 op/s 2023-05-08T09:49:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21933.065972 secs 2023-05-08T09:49:54.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:53 smithi133 ceph-mon[125939]: pgmap v11753: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 159 KiB/s wr, 7 op/s 2023-05-08T09:49:54.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21933.065972 secs 2023-05-08T09:49:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:53 smithi096 ceph-mon[124666]: pgmap v11753: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 159 KiB/s wr, 7 op/s 2023-05-08T09:49:54.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21933.065972 secs 2023-05-08T09:49:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:55 smithi186 ceph-mon[126480]: pgmap v11754: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 446 KiB/s wr, 12 op/s 2023-05-08T09:49:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:55 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:49:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:55 smithi133 ceph-mon[125939]: pgmap v11754: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 446 KiB/s wr, 12 op/s 2023-05-08T09:49:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:55 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:49:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:55 smithi096 ceph-mon[124666]: pgmap v11754: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 446 KiB/s wr, 12 op/s 2023-05-08T09:49:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:55 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:49:57.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:49:57.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:49:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:49:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:49:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:49:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:49:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:57 smithi186 ceph-mon[126480]: pgmap v11755: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 443 KiB/s wr, 9 op/s 2023-05-08T09:49:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:57 smithi133 ceph-mon[125939]: pgmap v11755: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 443 KiB/s wr, 9 op/s 2023-05-08T09:49:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:57 smithi096 ceph-mon[124666]: pgmap v11755: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 443 KiB/s wr, 9 op/s 2023-05-08T09:49:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21938.066110 secs 2023-05-08T09:49:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:58 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:49:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21938.066110 secs 2023-05-08T09:49:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:58 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:49:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21938.066110 secs 2023-05-08T09:49:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:58 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:50:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:59 smithi133 ceph-mon[125939]: pgmap v11756: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 443 KiB/s wr, 9 op/s 2023-05-08T09:50:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:49:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21938.622389 secs 2023-05-08T09:50:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:59 smithi096 ceph-mon[124666]: pgmap v11756: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 443 KiB/s wr, 9 op/s 2023-05-08T09:50:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:49:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21938.622389 secs 2023-05-08T09:50:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:59 smithi186 ceph-mon[126480]: pgmap v11756: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 443 KiB/s wr, 9 op/s 2023-05-08T09:50:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:49:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21938.622389 secs 2023-05-08T09:50:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:50:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:50:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:00 smithi133 ceph-mon[125939]: overall HEALTH_WARN 2 MDSs report slow requests 2023-05-08T09:50:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:50:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:50:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:00 smithi096 ceph-mon[124666]: overall HEALTH_WARN 2 MDSs report slow requests 2023-05-08T09:50:01.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:50:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:50:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:00 smithi186 ceph-mon[126480]: overall HEALTH_WARN 2 MDSs report slow requests 2023-05-08T09:50:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:01 smithi133 ceph-mon[125939]: pgmap v11757: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 671 KiB/s rd, 575 KiB/s wr, 14 op/s 2023-05-08T09:50:02.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:01 smithi096 ceph-mon[124666]: pgmap v11757: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 671 KiB/s rd, 575 KiB/s wr, 14 op/s 2023-05-08T09:50:02.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:01 smithi186 ceph-mon[126480]: pgmap v11757: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 671 KiB/s rd, 575 KiB/s wr, 14 op/s 2023-05-08T09:50:04.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:03 smithi133 ceph-mon[125939]: pgmap v11758: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 515 KiB/s rd, 420 KiB/s wr, 10 op/s 2023-05-08T09:50:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21943.066227 secs 2023-05-08T09:50:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:03 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:50:04.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:03 smithi096 ceph-mon[124666]: pgmap v11758: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 515 KiB/s rd, 420 KiB/s wr, 10 op/s 2023-05-08T09:50:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21943.066227 secs 2023-05-08T09:50:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:03 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:50:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:03 smithi186 ceph-mon[126480]: pgmap v11758: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 515 KiB/s rd, 420 KiB/s wr, 10 op/s 2023-05-08T09:50:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21943.066227 secs 2023-05-08T09:50:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:03 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:50:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21943.622478 secs 2023-05-08T09:50:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21943.622478 secs 2023-05-08T09:50:05.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21943.622478 secs 2023-05-08T09:50:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:05 smithi133 ceph-mon[125939]: pgmap v11759: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 595 KiB/s rd, 574 KiB/s wr, 23 op/s 2023-05-08T09:50:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:05 smithi096 ceph-mon[124666]: pgmap v11759: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 595 KiB/s rd, 574 KiB/s wr, 23 op/s 2023-05-08T09:50:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:05 smithi186 ceph-mon[126480]: pgmap v11759: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 595 KiB/s rd, 574 KiB/s wr, 23 op/s 2023-05-08T09:50:08.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:07 smithi133 ceph-mon[125939]: pgmap v11760: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 840 KiB/s rd, 617 KiB/s wr, 19 op/s 2023-05-08T09:50:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:07 smithi096 ceph-mon[124666]: pgmap v11760: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 840 KiB/s rd, 617 KiB/s wr, 19 op/s 2023-05-08T09:50:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:07 smithi186 ceph-mon[126480]: pgmap v11760: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 840 KiB/s rd, 617 KiB/s wr, 19 op/s 2023-05-08T09:50:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21948.066371 secs 2023-05-08T09:50:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21948.066371 secs 2023-05-08T09:50:09.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21948.066371 secs 2023-05-08T09:50:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:09 smithi133 ceph-mon[125939]: pgmap v11761: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 840 KiB/s rd, 617 KiB/s wr, 19 op/s 2023-05-08T09:50:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21948.622547 secs 2023-05-08T09:50:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:09 smithi096 ceph-mon[124666]: pgmap v11761: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 840 KiB/s rd, 617 KiB/s wr, 19 op/s 2023-05-08T09:50:10.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21948.622547 secs 2023-05-08T09:50:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:09 smithi186 ceph-mon[126480]: pgmap v11761: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 840 KiB/s rd, 617 KiB/s wr, 19 op/s 2023-05-08T09:50:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21948.622547 secs 2023-05-08T09:50:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21949.909285 secs 2023-05-08T09:50:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:11 smithi133 ceph-mon[125939]: pgmap v11762: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 766 KiB/s wr, 30 op/s 2023-05-08T09:50:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21949.909285 secs 2023-05-08T09:50:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:11 smithi096 ceph-mon[124666]: pgmap v11762: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 766 KiB/s wr, 30 op/s 2023-05-08T09:50:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21949.909285 secs 2023-05-08T09:50:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:11 smithi186 ceph-mon[126480]: pgmap v11762: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 766 KiB/s wr, 30 op/s 2023-05-08T09:50:13.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:12 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:50:13.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:12 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:50:13.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:12 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:50:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:12 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:50:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:12 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:50:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:12 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:50:13.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:12 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:50:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:12 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:50:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:12 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:50:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:13 smithi133 ceph-mon[125939]: pgmap v11763: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 681 KiB/s rd, 634 KiB/s wr, 25 op/s 2023-05-08T09:50:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21953.066498 secs 2023-05-08T09:50:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:13 smithi096 ceph-mon[124666]: pgmap v11763: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 681 KiB/s rd, 634 KiB/s wr, 25 op/s 2023-05-08T09:50:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21953.066498 secs 2023-05-08T09:50:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:13 smithi186 ceph-mon[126480]: pgmap v11763: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 681 KiB/s rd, 634 KiB/s wr, 25 op/s 2023-05-08T09:50:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21953.066498 secs 2023-05-08T09:50:15.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21953.622689 secs 2023-05-08T09:50:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21953.622689 secs 2023-05-08T09:50:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21953.622689 secs 2023-05-08T09:50:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:15 smithi133 ceph-mon[125939]: pgmap v11764: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 695 KiB/s rd, 749 KiB/s wr, 29 op/s 2023-05-08T09:50:16.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:15 smithi096 ceph-mon[124666]: pgmap v11764: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 695 KiB/s rd, 749 KiB/s wr, 29 op/s 2023-05-08T09:50:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:15 smithi186 ceph-mon[126480]: pgmap v11764: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 695 KiB/s rd, 749 KiB/s wr, 29 op/s 2023-05-08T09:50:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21954.909406 secs 2023-05-08T09:50:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:16 smithi133 ceph-mon[125939]: osdmap e812: 12 total, 12 up, 12 in 2023-05-08T09:50:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21954.909406 secs 2023-05-08T09:50:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:16 smithi096 ceph-mon[124666]: osdmap e812: 12 total, 12 up, 12 in 2023-05-08T09:50:17.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21954.909406 secs 2023-05-08T09:50:17.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:16 smithi186 ceph-mon[126480]: osdmap e812: 12 total, 12 up, 12 in 2023-05-08T09:50:18.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:17 smithi133 ceph-mon[125939]: pgmap v11766: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 329 KiB/s rd, 317 KiB/s wr, 18 op/s 2023-05-08T09:50:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:17 smithi096 ceph-mon[124666]: pgmap v11766: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 329 KiB/s rd, 317 KiB/s wr, 18 op/s 2023-05-08T09:50:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:17 smithi186 ceph-mon[126480]: pgmap v11766: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 329 KiB/s rd, 317 KiB/s wr, 18 op/s 2023-05-08T09:50:19.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21958.066623 secs 2023-05-08T09:50:19.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21958.066623 secs 2023-05-08T09:50:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21958.066623 secs 2023-05-08T09:50:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:19 smithi133 ceph-mon[125939]: pgmap v11767: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 329 KiB/s rd, 317 KiB/s wr, 18 op/s 2023-05-08T09:50:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21958.622802 secs 2023-05-08T09:50:20.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:19 smithi096 ceph-mon[124666]: pgmap v11767: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 329 KiB/s rd, 317 KiB/s wr, 18 op/s 2023-05-08T09:50:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21958.622802 secs 2023-05-08T09:50:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:19 smithi186 ceph-mon[126480]: pgmap v11767: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 329 KiB/s rd, 317 KiB/s wr, 18 op/s 2023-05-08T09:50:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21958.622802 secs 2023-05-08T09:50:22.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21959.909527 secs 2023-05-08T09:50:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:21 smithi133 ceph-mon[125939]: pgmap v11768: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 412 KiB/s wr, 9 op/s 2023-05-08T09:50:22.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21959.909527 secs 2023-05-08T09:50:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:21 smithi096 ceph-mon[124666]: pgmap v11768: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 412 KiB/s wr, 9 op/s 2023-05-08T09:50:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21959.909527 secs 2023-05-08T09:50:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:21 smithi186 ceph-mon[126480]: pgmap v11768: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 412 KiB/s wr, 9 op/s 2023-05-08T09:50:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:23 smithi133 ceph-mon[125939]: pgmap v11769: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 412 KiB/s wr, 9 op/s 2023-05-08T09:50:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21963.066750 secs 2023-05-08T09:50:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:23 smithi133 ceph-mon[125939]: osdmap e813: 12 total, 12 up, 12 in 2023-05-08T09:50:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:23 smithi096 ceph-mon[124666]: pgmap v11769: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 412 KiB/s wr, 9 op/s 2023-05-08T09:50:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21963.066750 secs 2023-05-08T09:50:24.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:23 smithi096 ceph-mon[124666]: osdmap e813: 12 total, 12 up, 12 in 2023-05-08T09:50:24.373 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:23 smithi186 ceph-mon[126480]: pgmap v11769: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 412 KiB/s wr, 9 op/s 2023-05-08T09:50:24.374 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21963.066750 secs 2023-05-08T09:50:24.374 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:23 smithi186 ceph-mon[126480]: osdmap e813: 12 total, 12 up, 12 in 2023-05-08T09:50:25.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21963.622918 secs 2023-05-08T09:50:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21963.622918 secs 2023-05-08T09:50:25.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21963.622918 secs 2023-05-08T09:50:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:25 smithi133 ceph-mon[125939]: pgmap v11771: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 316 KiB/s wr, 10 op/s 2023-05-08T09:50:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:25 smithi096 ceph-mon[124666]: pgmap v11771: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 316 KiB/s wr, 10 op/s 2023-05-08T09:50:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:25 smithi186 ceph-mon[126480]: pgmap v11771: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 316 KiB/s wr, 10 op/s 2023-05-08T09:50:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21964.909668 secs 2023-05-08T09:50:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21964.909668 secs 2023-05-08T09:50:27.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21964.909668 secs 2023-05-08T09:50:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:27 smithi133 ceph-mon[125939]: pgmap v11772: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 274 KiB/s wr, 8 op/s 2023-05-08T09:50:28.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:27 smithi096 ceph-mon[124666]: pgmap v11772: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 274 KiB/s wr, 8 op/s 2023-05-08T09:50:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:27 smithi186 ceph-mon[126480]: pgmap v11772: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 274 KiB/s wr, 8 op/s 2023-05-08T09:50:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21968.066868 secs 2023-05-08T09:50:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21968.066868 secs 2023-05-08T09:50:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21968.066868 secs 2023-05-08T09:50:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:29 smithi133 ceph-mon[125939]: pgmap v11773: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 274 KiB/s wr, 8 op/s 2023-05-08T09:50:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21968.623038 secs 2023-05-08T09:50:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:29 smithi096 ceph-mon[124666]: pgmap v11773: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 274 KiB/s wr, 8 op/s 2023-05-08T09:50:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21968.623038 secs 2023-05-08T09:50:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:29 smithi186 ceph-mon[126480]: pgmap v11773: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 274 KiB/s wr, 8 op/s 2023-05-08T09:50:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21968.623038 secs 2023-05-08T09:50:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:50:31.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:50:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:50:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21969.909820 secs 2023-05-08T09:50:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:31 smithi096 ceph-mon[124666]: pgmap v11774: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 70 KiB/s wr, 6 op/s 2023-05-08T09:50:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21969.909820 secs 2023-05-08T09:50:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:31 smithi186 ceph-mon[126480]: pgmap v11774: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 70 KiB/s wr, 6 op/s 2023-05-08T09:50:32.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21969.909820 secs 2023-05-08T09:50:32.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:31 smithi133 ceph-mon[125939]: pgmap v11774: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 70 KiB/s wr, 6 op/s 2023-05-08T09:50:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:33 smithi096 ceph-mon[124666]: pgmap v11775: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 70 KiB/s wr, 6 op/s 2023-05-08T09:50:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21973.067015 secs 2023-05-08T09:50:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:33 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:50:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:33 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:50:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:33 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:50:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:33 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:50:34.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:33 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:50:34.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:33 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:50:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:33 smithi186 ceph-mon[126480]: pgmap v11775: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 70 KiB/s wr, 6 op/s 2023-05-08T09:50:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21973.067015 secs 2023-05-08T09:50:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:33 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:50:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:33 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:50:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:33 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:50:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:33 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:50:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:33 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:50:34.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:33 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:50:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:33 smithi133 ceph-mon[125939]: pgmap v11775: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 70 KiB/s wr, 6 op/s 2023-05-08T09:50:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21973.067015 secs 2023-05-08T09:50:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:33 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:50:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:33 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:50:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:33 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:50:34.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:33 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:50:34.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:33 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:50:34.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:33 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:50:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21973.623126 secs 2023-05-08T09:50:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:50:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:50:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:50:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:50:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:50:35.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:50:35.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:50:35.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:50:35.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:50:35.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:35 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T09:50:35.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:35 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T09:50:35.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:35 smithi186 ceph-mon[126480]: pgmap v11776: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 64 KiB/s wr, 9 op/s 2023-05-08T09:50:35.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:50:35.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:50:35.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:50:35.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:50:35.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:50:35.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:50:35.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:35 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T09:50:35.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:35 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T09:50:35.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:50:35.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:50:35.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:35 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:50:35.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:50:35.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:35 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T09:50:35.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:35 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T09:50:35.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:35 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:50:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21973.623126 secs 2023-05-08T09:50:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:50:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:50:35.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:50:35.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:50:35.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:50:35.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:50:35.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:50:35.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:50:35.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:50:35.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:35 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T09:50:35.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:35 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T09:50:35.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:35 smithi133 ceph-mon[125939]: pgmap v11776: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 64 KiB/s wr, 9 op/s 2023-05-08T09:50:35.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:50:35.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:50:35.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:50:35.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:50:35.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:50:35.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:50:35.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:35 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T09:50:35.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:35 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T09:50:35.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:50:35.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:50:35.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:35 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:50:35.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:50:35.994 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:35 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T09:50:35.994 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:35 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T09:50:35.994 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:35 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:50:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21973.623126 secs 2023-05-08T09:50:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:50:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:50:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:50:36.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:50:36.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:50:36.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:50:36.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:50:36.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:50:36.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:50:36.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:35 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T09:50:36.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:35 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T09:50:36.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:35 smithi096 ceph-mon[124666]: pgmap v11776: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 64 KiB/s wr, 9 op/s 2023-05-08T09:50:36.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:50:36.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:50:36.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:50:36.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:50:36.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:50:36.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T09:50:36.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:35 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T09:50:36.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:35 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T09:50:36.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:50:36.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:50:36.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:35 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:50:36.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:50:36.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:35 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T09:50:36.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:35 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T09:50:36.009 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:35 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:50:36.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21974.909969 secs 2023-05-08T09:50:36.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21974.909969 secs 2023-05-08T09:50:37.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21974.909969 secs 2023-05-08T09:50:37.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:37 smithi186 ceph-mon[126480]: pgmap v11777: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 58 KiB/s wr, 5 op/s 2023-05-08T09:50:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:37 smithi133 ceph-mon[125939]: pgmap v11777: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 58 KiB/s wr, 5 op/s 2023-05-08T09:50:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:37 smithi096 ceph-mon[124666]: pgmap v11777: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 58 KiB/s wr, 5 op/s 2023-05-08T09:50:38.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21978.067153 secs 2023-05-08T09:50:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21978.067153 secs 2023-05-08T09:50:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21978.067153 secs 2023-05-08T09:50:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:39 smithi186 ceph-mon[126480]: pgmap v11778: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 58 KiB/s wr, 5 op/s 2023-05-08T09:50:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:39 smithi133 ceph-mon[125939]: pgmap v11778: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 58 KiB/s wr, 5 op/s 2023-05-08T09:50:40.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:39 smithi096 ceph-mon[124666]: pgmap v11778: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 58 KiB/s wr, 5 op/s 2023-05-08T09:50:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21978.623240 secs 2023-05-08T09:50:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21978.623240 secs 2023-05-08T09:50:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21978.623240 secs 2023-05-08T09:50:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21979.910100 secs 2023-05-08T09:50:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:41 smithi186 ceph-mon[126480]: pgmap v11779: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 125 KiB/s wr, 7 op/s 2023-05-08T09:50:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21979.910100 secs 2023-05-08T09:50:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:41 smithi133 ceph-mon[125939]: pgmap v11779: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 125 KiB/s wr, 7 op/s 2023-05-08T09:50:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21979.910100 secs 2023-05-08T09:50:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:41 smithi096 ceph-mon[124666]: pgmap v11779: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 125 KiB/s wr, 7 op/s 2023-05-08T09:50:43.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:43 smithi186 ceph-mon[126480]: pgmap v11780: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 66 KiB/s wr, 5 op/s 2023-05-08T09:50:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21983.067279 secs 2023-05-08T09:50:43.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:43 smithi133 ceph-mon[125939]: pgmap v11780: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 66 KiB/s wr, 5 op/s 2023-05-08T09:50:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21983.067279 secs 2023-05-08T09:50:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:43 smithi096 ceph-mon[124666]: pgmap v11780: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 66 KiB/s wr, 5 op/s 2023-05-08T09:50:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21983.067279 secs 2023-05-08T09:50:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21983.623335 secs 2023-05-08T09:50:45.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:45 smithi133 ceph-mon[125939]: pgmap v11781: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 73 KiB/s wr, 9 op/s 2023-05-08T09:50:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21983.623335 secs 2023-05-08T09:50:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:45 smithi096 ceph-mon[124666]: pgmap v11781: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 73 KiB/s wr, 9 op/s 2023-05-08T09:50:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21983.623335 secs 2023-05-08T09:50:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:45 smithi186 ceph-mon[126480]: pgmap v11781: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 73 KiB/s wr, 9 op/s 2023-05-08T09:50:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21984.910230 secs 2023-05-08T09:50:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21984.910230 secs 2023-05-08T09:50:47.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21984.910230 secs 2023-05-08T09:50:47.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:47 smithi133 ceph-mon[125939]: pgmap v11782: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 73 KiB/s wr, 6 op/s 2023-05-08T09:50:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:47 smithi096 ceph-mon[124666]: pgmap v11782: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 73 KiB/s wr, 6 op/s 2023-05-08T09:50:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:47 smithi186 ceph-mon[126480]: pgmap v11782: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 73 KiB/s wr, 6 op/s 2023-05-08T09:50:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21988.067395 secs 2023-05-08T09:50:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21988.067395 secs 2023-05-08T09:50:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21988.067395 secs 2023-05-08T09:50:49.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:49 smithi133 ceph-mon[125939]: pgmap v11783: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 73 KiB/s wr, 6 op/s 2023-05-08T09:50:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:49 smithi096 ceph-mon[124666]: pgmap v11783: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 73 KiB/s wr, 6 op/s 2023-05-08T09:50:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:49 smithi186 ceph-mon[126480]: pgmap v11783: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 73 KiB/s wr, 6 op/s 2023-05-08T09:50:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21989.910354 secs 2023-05-08T09:50:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:51 smithi133 ceph-mon[125939]: pgmap v11784: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 568 KiB/s rd, 635 KiB/s wr, 12 op/s 2023-05-08T09:50:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:50:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21989.910354 secs 2023-05-08T09:50:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:51 smithi096 ceph-mon[124666]: pgmap v11784: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 568 KiB/s rd, 635 KiB/s wr, 12 op/s 2023-05-08T09:50:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:50:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21989.910354 secs 2023-05-08T09:50:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:51 smithi186 ceph-mon[126480]: pgmap v11784: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 568 KiB/s rd, 635 KiB/s wr, 12 op/s 2023-05-08T09:50:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:50:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:52 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:50:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:50:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:50:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:52 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:50:53.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:50:53.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:50:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:52 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:50:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:50:53.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:50:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:53 smithi133 ceph-mon[125939]: pgmap v11785: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 567 KiB/s rd, 569 KiB/s wr, 9 op/s 2023-05-08T09:50:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21993.067515 secs 2023-05-08T09:50:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:53 smithi096 ceph-mon[124666]: pgmap v11785: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 567 KiB/s rd, 569 KiB/s wr, 9 op/s 2023-05-08T09:50:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21993.067515 secs 2023-05-08T09:50:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:53 smithi186 ceph-mon[126480]: pgmap v11785: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 567 KiB/s rd, 569 KiB/s wr, 9 op/s 2023-05-08T09:50:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21993.067515 secs 2023-05-08T09:50:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21993.623569 secs 2023-05-08T09:50:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:55 smithi133 ceph-mon[125939]: pgmap v11786: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 819 KiB/s rd, 733 KiB/s wr, 14 op/s 2023-05-08T09:50:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:55 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:50:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21993.623569 secs 2023-05-08T09:50:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:55 smithi096 ceph-mon[124666]: pgmap v11786: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 819 KiB/s rd, 733 KiB/s wr, 14 op/s 2023-05-08T09:50:56.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:55 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:50:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21993.623569 secs 2023-05-08T09:50:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:55 smithi186 ceph-mon[126480]: pgmap v11786: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 819 KiB/s rd, 733 KiB/s wr, 14 op/s 2023-05-08T09:50:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:55 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:50:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:50:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:50:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:50:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:50:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:50:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:50:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:50:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:50:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:50:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:57 smithi133 ceph-mon[125939]: pgmap v11787: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 726 KiB/s wr, 10 op/s 2023-05-08T09:50:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:57 smithi096 ceph-mon[124666]: pgmap v11787: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 726 KiB/s wr, 10 op/s 2023-05-08T09:50:58.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:57 smithi186 ceph-mon[126480]: pgmap v11787: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 726 KiB/s wr, 10 op/s 2023-05-08T09:50:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21998.067660 secs 2023-05-08T09:50:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21998.067660 secs 2023-05-08T09:50:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21998.067660 secs 2023-05-08T09:50:59.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:50:59 smithi133 ceph-mon[125939]: pgmap v11788: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 726 KiB/s wr, 10 op/s 2023-05-08T09:51:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:50:59 smithi096 ceph-mon[124666]: pgmap v11788: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 726 KiB/s wr, 10 op/s 2023-05-08T09:51:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:50:59 smithi186 ceph-mon[126480]: pgmap v11788: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 726 KiB/s wr, 10 op/s 2023-05-08T09:51:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 21998.623638 secs 2023-05-08T09:51:01.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 21998.623638 secs 2023-05-08T09:51:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 21998.623638 secs 2023-05-08T09:51:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:01 smithi133 ceph-mon[125939]: pgmap v11789: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 974 KiB/s rd, 1.1 MiB/s wr, 15 op/s 2023-05-08T09:51:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:01 smithi096 ceph-mon[124666]: pgmap v11789: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 974 KiB/s rd, 1.1 MiB/s wr, 15 op/s 2023-05-08T09:51:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:01 smithi186 ceph-mon[126480]: pgmap v11789: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 974 KiB/s rd, 1.1 MiB/s wr, 15 op/s 2023-05-08T09:51:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:03 smithi133 ceph-mon[125939]: pgmap v11790: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 554 KiB/s wr, 9 op/s 2023-05-08T09:51:03.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22003.067781 secs 2023-05-08T09:51:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:03 smithi096 ceph-mon[124666]: pgmap v11790: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 554 KiB/s wr, 9 op/s 2023-05-08T09:51:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22003.067781 secs 2023-05-08T09:51:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:03 smithi186 ceph-mon[126480]: pgmap v11790: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 554 KiB/s wr, 9 op/s 2023-05-08T09:51:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22003.067781 secs 2023-05-08T09:51:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22003.623754 secs 2023-05-08T09:51:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:05 smithi133 ceph-mon[125939]: pgmap v11791: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 963 KiB/s rd, 763 KiB/s wr, 29 op/s 2023-05-08T09:51:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22003.623754 secs 2023-05-08T09:51:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:05 smithi096 ceph-mon[124666]: pgmap v11791: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 963 KiB/s rd, 763 KiB/s wr, 29 op/s 2023-05-08T09:51:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22003.623754 secs 2023-05-08T09:51:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:05 smithi186 ceph-mon[126480]: pgmap v11791: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 963 KiB/s rd, 763 KiB/s wr, 29 op/s 2023-05-08T09:51:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22004.910734 secs 2023-05-08T09:51:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22004.910734 secs 2023-05-08T09:51:07.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22004.910734 secs 2023-05-08T09:51:07.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:07 smithi133 ceph-mon[125939]: pgmap v11792: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 710 KiB/s rd, 599 KiB/s wr, 24 op/s 2023-05-08T09:51:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:07 smithi096 ceph-mon[124666]: pgmap v11792: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 710 KiB/s rd, 599 KiB/s wr, 24 op/s 2023-05-08T09:51:08.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:07 smithi186 ceph-mon[126480]: pgmap v11792: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 710 KiB/s rd, 599 KiB/s wr, 24 op/s 2023-05-08T09:51:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:08 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:51:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:51:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:51:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22008.067904 secs 2023-05-08T09:51:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:08 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:51:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:51:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:51:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22008.067904 secs 2023-05-08T09:51:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:08 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:51:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:51:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:51:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22008.067904 secs 2023-05-08T09:51:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:09 smithi133 ceph-mon[125939]: pgmap v11793: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 710 KiB/s rd, 599 KiB/s wr, 24 op/s 2023-05-08T09:51:10.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:09 smithi096 ceph-mon[124666]: pgmap v11793: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 710 KiB/s rd, 599 KiB/s wr, 24 op/s 2023-05-08T09:51:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:09 smithi186 ceph-mon[126480]: pgmap v11793: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 710 KiB/s rd, 599 KiB/s wr, 24 op/s 2023-05-08T09:51:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22008.623853 secs 2023-05-08T09:51:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22008.623853 secs 2023-05-08T09:51:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22008.623853 secs 2023-05-08T09:51:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22009.910877 secs 2023-05-08T09:51:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:11 smithi133 ceph-mon[125939]: pgmap v11794: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 859 KiB/s rd, 763 KiB/s wr, 29 op/s 2023-05-08T09:51:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:11 smithi133 ceph-mon[125939]: osdmap e814: 12 total, 12 up, 12 in 2023-05-08T09:51:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22009.910877 secs 2023-05-08T09:51:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:11 smithi096 ceph-mon[124666]: pgmap v11794: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 859 KiB/s rd, 763 KiB/s wr, 29 op/s 2023-05-08T09:51:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:11 smithi096 ceph-mon[124666]: osdmap e814: 12 total, 12 up, 12 in 2023-05-08T09:51:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22009.910877 secs 2023-05-08T09:51:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:11 smithi186 ceph-mon[126480]: pgmap v11794: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 859 KiB/s rd, 763 KiB/s wr, 29 op/s 2023-05-08T09:51:12.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:11 smithi186 ceph-mon[126480]: osdmap e814: 12 total, 12 up, 12 in 2023-05-08T09:51:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:13 smithi133 ceph-mon[125939]: pgmap v11796: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 676 KiB/s rd, 447 KiB/s wr, 30 op/s 2023-05-08T09:51:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22013.068028 secs 2023-05-08T09:51:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:13 smithi096 ceph-mon[124666]: pgmap v11796: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 676 KiB/s rd, 447 KiB/s wr, 30 op/s 2023-05-08T09:51:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22013.068028 secs 2023-05-08T09:51:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:13 smithi186 ceph-mon[126480]: pgmap v11796: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 676 KiB/s rd, 447 KiB/s wr, 30 op/s 2023-05-08T09:51:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22013.068028 secs 2023-05-08T09:51:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22013.623970 secs 2023-05-08T09:51:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:15 smithi133 ceph-mon[125939]: pgmap v11797: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 374 KiB/s wr, 11 op/s 2023-05-08T09:51:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22013.623970 secs 2023-05-08T09:51:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:15 smithi096 ceph-mon[124666]: pgmap v11797: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 374 KiB/s wr, 11 op/s 2023-05-08T09:51:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22013.623970 secs 2023-05-08T09:51:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:15 smithi186 ceph-mon[126480]: pgmap v11797: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 374 KiB/s wr, 11 op/s 2023-05-08T09:51:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22014.910998 secs 2023-05-08T09:51:17.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22014.910998 secs 2023-05-08T09:51:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22014.910998 secs 2023-05-08T09:51:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:17 smithi096 ceph-mon[124666]: pgmap v11798: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 374 KiB/s wr, 11 op/s 2023-05-08T09:51:18.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:17 smithi186 ceph-mon[126480]: pgmap v11798: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 374 KiB/s wr, 11 op/s 2023-05-08T09:51:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:17 smithi133 ceph-mon[125939]: pgmap v11798: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 374 KiB/s wr, 11 op/s 2023-05-08T09:51:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22018.068168 secs 2023-05-08T09:51:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:18 smithi096 ceph-mon[124666]: osdmap e815: 12 total, 12 up, 12 in 2023-05-08T09:51:19.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22018.068168 secs 2023-05-08T09:51:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:18 smithi186 ceph-mon[126480]: osdmap e815: 12 total, 12 up, 12 in 2023-05-08T09:51:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22018.068168 secs 2023-05-08T09:51:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:18 smithi133 ceph-mon[125939]: osdmap e815: 12 total, 12 up, 12 in 2023-05-08T09:51:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:19 smithi096 ceph-mon[124666]: pgmap v11799: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 374 KiB/s wr, 11 op/s 2023-05-08T09:51:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:19 smithi186 ceph-mon[126480]: pgmap v11799: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 374 KiB/s wr, 11 op/s 2023-05-08T09:51:20.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:19 smithi133 ceph-mon[125939]: pgmap v11799: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 374 KiB/s wr, 11 op/s 2023-05-08T09:51:21.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22018.624085 secs 2023-05-08T09:51:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22018.624085 secs 2023-05-08T09:51:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22018.624085 secs 2023-05-08T09:51:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22019.911121 secs 2023-05-08T09:51:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:21 smithi186 ceph-mon[126480]: pgmap v11801: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 252 KiB/s wr, 9 op/s 2023-05-08T09:51:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22019.911121 secs 2023-05-08T09:51:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:21 smithi133 ceph-mon[125939]: pgmap v11801: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 252 KiB/s wr, 9 op/s 2023-05-08T09:51:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22019.911121 secs 2023-05-08T09:51:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:21 smithi096 ceph-mon[124666]: pgmap v11801: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 252 KiB/s wr, 9 op/s 2023-05-08T09:51:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:23 smithi186 ceph-mon[126480]: pgmap v11802: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 249 KiB/s wr, 9 op/s 2023-05-08T09:51:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22023.068288 secs 2023-05-08T09:51:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:23 smithi133 ceph-mon[125939]: pgmap v11802: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 249 KiB/s wr, 9 op/s 2023-05-08T09:51:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22023.068288 secs 2023-05-08T09:51:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:23 smithi096 ceph-mon[124666]: pgmap v11802: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 249 KiB/s wr, 9 op/s 2023-05-08T09:51:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22023.068288 secs 2023-05-08T09:51:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22023.624222 secs 2023-05-08T09:51:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:25 smithi186 ceph-mon[126480]: pgmap v11803: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 71 KiB/s wr, 7 op/s 2023-05-08T09:51:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22023.624222 secs 2023-05-08T09:51:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:25 smithi133 ceph-mon[125939]: pgmap v11803: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 71 KiB/s wr, 7 op/s 2023-05-08T09:51:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22023.624222 secs 2023-05-08T09:51:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:25 smithi096 ceph-mon[124666]: pgmap v11803: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 71 KiB/s wr, 7 op/s 2023-05-08T09:51:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22024.911240 secs 2023-05-08T09:51:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22024.911240 secs 2023-05-08T09:51:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22024.911240 secs 2023-05-08T09:51:28.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:27 smithi186 ceph-mon[126480]: pgmap v11804: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 71 KiB/s wr, 7 op/s 2023-05-08T09:51:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:27 smithi133 ceph-mon[125939]: pgmap v11804: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 71 KiB/s wr, 7 op/s 2023-05-08T09:51:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:27 smithi096 ceph-mon[124666]: pgmap v11804: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 71 KiB/s wr, 7 op/s 2023-05-08T09:51:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22028.068416 secs 2023-05-08T09:51:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22028.068416 secs 2023-05-08T09:51:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22028.068416 secs 2023-05-08T09:51:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:29 smithi186 ceph-mon[126480]: pgmap v11805: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 71 KiB/s wr, 7 op/s 2023-05-08T09:51:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:29 smithi133 ceph-mon[125939]: pgmap v11805: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 71 KiB/s wr, 7 op/s 2023-05-08T09:51:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:29 smithi096 ceph-mon[124666]: pgmap v11805: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 71 KiB/s wr, 7 op/s 2023-05-08T09:51:31.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22028.624339 secs 2023-05-08T09:51:31.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22028.624339 secs 2023-05-08T09:51:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22028.624339 secs 2023-05-08T09:51:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22029.911386 secs 2023-05-08T09:51:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:31 smithi186 ceph-mon[126480]: pgmap v11806: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 119 KiB/s wr, 9 op/s 2023-05-08T09:51:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22029.911386 secs 2023-05-08T09:51:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:31 smithi133 ceph-mon[125939]: pgmap v11806: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 119 KiB/s wr, 9 op/s 2023-05-08T09:51:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22029.911386 secs 2023-05-08T09:51:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:31 smithi096 ceph-mon[124666]: pgmap v11806: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 119 KiB/s wr, 9 op/s 2023-05-08T09:51:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:33 smithi186 ceph-mon[126480]: pgmap v11807: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 59 KiB/s wr, 5 op/s 2023-05-08T09:51:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22033.068508 secs 2023-05-08T09:51:34.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:33 smithi133 ceph-mon[125939]: pgmap v11807: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 59 KiB/s wr, 5 op/s 2023-05-08T09:51:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22033.068508 secs 2023-05-08T09:51:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:33 smithi096 ceph-mon[124666]: pgmap v11807: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 59 KiB/s wr, 5 op/s 2023-05-08T09:51:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22033.068508 secs 2023-05-08T09:51:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:34 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:51:35.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:34 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:51:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:34 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:51:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22033.624513 secs 2023-05-08T09:51:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:35 smithi186 ceph-mon[126480]: pgmap v11808: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 134 KiB/s wr, 8 op/s 2023-05-08T09:51:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:51:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:51:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:51:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22033.624513 secs 2023-05-08T09:51:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:35 smithi133 ceph-mon[125939]: pgmap v11808: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 134 KiB/s wr, 8 op/s 2023-05-08T09:51:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:51:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:51:36.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:51:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22033.624513 secs 2023-05-08T09:51:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:35 smithi096 ceph-mon[124666]: pgmap v11808: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 134 KiB/s wr, 8 op/s 2023-05-08T09:51:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:51:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:51:36.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:51:37.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22034.911507 secs 2023-05-08T09:51:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:36 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:51:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:36 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T09:51:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:36 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T09:51:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:36 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:51:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22034.911507 secs 2023-05-08T09:51:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:36 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:51:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:36 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T09:51:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:36 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T09:51:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:36 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:51:37.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22034.911507 secs 2023-05-08T09:51:37.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:36 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:51:37.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:36 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T09:51:37.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:36 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T09:51:37.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:36 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:51:38.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:37 smithi186 ceph-mon[126480]: pgmap v11809: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 134 KiB/s wr, 6 op/s 2023-05-08T09:51:38.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:37 smithi133 ceph-mon[125939]: pgmap v11809: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 134 KiB/s wr, 6 op/s 2023-05-08T09:51:38.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:37 smithi096 ceph-mon[124666]: pgmap v11809: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 134 KiB/s wr, 6 op/s 2023-05-08T09:51:39.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22038.068629 secs 2023-05-08T09:51:39.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22038.068629 secs 2023-05-08T09:51:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22038.068629 secs 2023-05-08T09:51:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:39 smithi186 ceph-mon[126480]: pgmap v11810: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 134 KiB/s wr, 6 op/s 2023-05-08T09:51:40.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:39 smithi133 ceph-mon[125939]: pgmap v11810: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 134 KiB/s wr, 6 op/s 2023-05-08T09:51:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:39 smithi096 ceph-mon[124666]: pgmap v11810: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 134 KiB/s wr, 6 op/s 2023-05-08T09:51:41.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22038.624638 secs 2023-05-08T09:51:41.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22038.624638 secs 2023-05-08T09:51:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22038.624638 secs 2023-05-08T09:51:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:41 smithi186 ceph-mon[126480]: pgmap v11811: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 135 KiB/s wr, 10 op/s 2023-05-08T09:51:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:41 smithi133 ceph-mon[125939]: pgmap v11811: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 135 KiB/s wr, 10 op/s 2023-05-08T09:51:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:41 smithi096 ceph-mon[124666]: pgmap v11811: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 135 KiB/s wr, 10 op/s 2023-05-08T09:51:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:43 smithi186 ceph-mon[126480]: pgmap v11812: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 75 KiB/s wr, 6 op/s 2023-05-08T09:51:44.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22043.068754 secs 2023-05-08T09:51:44.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:51:44.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:43 smithi133 ceph-mon[125939]: pgmap v11812: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 75 KiB/s wr, 6 op/s 2023-05-08T09:51:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22043.068754 secs 2023-05-08T09:51:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:51:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:43 smithi096 ceph-mon[124666]: pgmap v11812: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 75 KiB/s wr, 6 op/s 2023-05-08T09:51:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22043.068754 secs 2023-05-08T09:51:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:51:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:51:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:51:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:51:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22043.624734 secs 2023-05-08T09:51:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:51:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:51:45.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:51:45.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22043.624734 secs 2023-05-08T09:51:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:51:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:51:45.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:51:45.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22043.624734 secs 2023-05-08T09:51:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:45 smithi186 ceph-mon[126480]: pgmap v11813: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 386 KiB/s wr, 10 op/s 2023-05-08T09:51:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:45 smithi133 ceph-mon[125939]: pgmap v11813: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 386 KiB/s wr, 10 op/s 2023-05-08T09:51:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:45 smithi096 ceph-mon[124666]: pgmap v11813: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 386 KiB/s wr, 10 op/s 2023-05-08T09:51:47.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22044.911751 secs 2023-05-08T09:51:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22044.911751 secs 2023-05-08T09:51:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22044.911751 secs 2023-05-08T09:51:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:47 smithi186 ceph-mon[126480]: pgmap v11814: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 311 KiB/s wr, 7 op/s 2023-05-08T09:51:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:47 smithi133 ceph-mon[125939]: pgmap v11814: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 311 KiB/s wr, 7 op/s 2023-05-08T09:51:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:47 smithi096 ceph-mon[124666]: pgmap v11814: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 311 KiB/s wr, 7 op/s 2023-05-08T09:51:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:51:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:51:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22048.068851 secs 2023-05-08T09:51:49.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:51:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:51:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22048.068851 secs 2023-05-08T09:51:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:51:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:51:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22048.068851 secs 2023-05-08T09:51:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:49 smithi186 ceph-mon[126480]: pgmap v11815: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 311 KiB/s wr, 7 op/s 2023-05-08T09:51:50.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:49 smithi133 ceph-mon[125939]: pgmap v11815: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 311 KiB/s wr, 7 op/s 2023-05-08T09:51:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:49 smithi096 ceph-mon[124666]: pgmap v11815: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 311 KiB/s wr, 7 op/s 2023-05-08T09:51:52.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22049.911877 secs 2023-05-08T09:51:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:51 smithi133 ceph-mon[125939]: pgmap v11816: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 564 KiB/s rd, 476 KiB/s wr, 13 op/s 2023-05-08T09:51:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:51:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22049.911877 secs 2023-05-08T09:51:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:51 smithi096 ceph-mon[124666]: pgmap v11816: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 564 KiB/s rd, 476 KiB/s wr, 13 op/s 2023-05-08T09:51:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:51:52.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22049.911877 secs 2023-05-08T09:51:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:51 smithi186 ceph-mon[126480]: pgmap v11816: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 564 KiB/s rd, 476 KiB/s wr, 13 op/s 2023-05-08T09:51:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:51:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:52 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:51:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:51:53.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:51:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:52 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:51:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:51:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:51:53.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:52 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:51:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:51:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:51:54.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:53 smithi133 ceph-mon[125939]: pgmap v11817: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 488 KiB/s rd, 475 KiB/s wr, 9 op/s 2023-05-08T09:51:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22053.068994 secs 2023-05-08T09:51:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:53 smithi096 ceph-mon[124666]: pgmap v11817: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 488 KiB/s rd, 475 KiB/s wr, 9 op/s 2023-05-08T09:51:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22053.068994 secs 2023-05-08T09:51:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:53 smithi186 ceph-mon[126480]: pgmap v11817: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 488 KiB/s rd, 475 KiB/s wr, 9 op/s 2023-05-08T09:51:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22053.068994 secs 2023-05-08T09:51:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22053.624991 secs 2023-05-08T09:51:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22053.624991 secs 2023-05-08T09:51:55.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22053.624991 secs 2023-05-08T09:51:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:55 smithi133 ceph-mon[125939]: pgmap v11818: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 682 KiB/s rd, 669 KiB/s wr, 14 op/s 2023-05-08T09:51:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:55 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:51:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:55 smithi096 ceph-mon[124666]: pgmap v11818: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 682 KiB/s rd, 669 KiB/s wr, 14 op/s 2023-05-08T09:51:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:55 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:51:56.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:55 smithi186 ceph-mon[126480]: pgmap v11818: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 682 KiB/s rd, 669 KiB/s wr, 14 op/s 2023-05-08T09:51:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:55 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:51:57.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:51:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:51:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:51:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:51:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:51:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:51:57.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:51:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:51:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:51:58.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:57 smithi133 ceph-mon[125939]: pgmap v11819: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 358 KiB/s wr, 10 op/s 2023-05-08T09:51:58.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:57 smithi096 ceph-mon[124666]: pgmap v11819: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 358 KiB/s wr, 10 op/s 2023-05-08T09:51:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:57 smithi186 ceph-mon[126480]: pgmap v11819: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 358 KiB/s wr, 10 op/s 2023-05-08T09:51:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22058.069120 secs 2023-05-08T09:51:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22058.069120 secs 2023-05-08T09:51:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22058.069120 secs 2023-05-08T09:52:00.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:59 smithi133 ceph-mon[125939]: pgmap v11820: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 358 KiB/s wr, 10 op/s 2023-05-08T09:52:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:51:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22058.625107 secs 2023-05-08T09:52:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:59 smithi096 ceph-mon[124666]: pgmap v11820: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 358 KiB/s wr, 10 op/s 2023-05-08T09:52:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:51:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22058.625107 secs 2023-05-08T09:52:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:59 smithi186 ceph-mon[126480]: pgmap v11820: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 358 KiB/s wr, 10 op/s 2023-05-08T09:52:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:51:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22058.625107 secs 2023-05-08T09:52:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:01 smithi133 ceph-mon[125939]: pgmap v11821: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 617 KiB/s rd, 443 KiB/s wr, 14 op/s 2023-05-08T09:52:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:01 smithi096 ceph-mon[124666]: pgmap v11821: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 617 KiB/s rd, 443 KiB/s wr, 14 op/s 2023-05-08T09:52:02.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:01 smithi186 ceph-mon[126480]: pgmap v11821: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 617 KiB/s rd, 443 KiB/s wr, 14 op/s 2023-05-08T09:52:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:03 smithi133 ceph-mon[125939]: pgmap v11822: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 278 KiB/s wr, 8 op/s 2023-05-08T09:52:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22063.069252 secs 2023-05-08T09:52:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:03 smithi096 ceph-mon[124666]: pgmap v11822: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 278 KiB/s wr, 8 op/s 2023-05-08T09:52:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22063.069252 secs 2023-05-08T09:52:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:03 smithi186 ceph-mon[126480]: pgmap v11822: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 278 KiB/s wr, 8 op/s 2023-05-08T09:52:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22063.069252 secs 2023-05-08T09:52:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22063.625226 secs 2023-05-08T09:52:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22063.625226 secs 2023-05-08T09:52:05.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22063.625226 secs 2023-05-08T09:52:06.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:05 smithi133 ceph-mon[125939]: pgmap v11823: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 789 KiB/s rd, 650 KiB/s wr, 28 op/s 2023-05-08T09:52:06.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:05 smithi096 ceph-mon[124666]: pgmap v11823: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 789 KiB/s rd, 650 KiB/s wr, 28 op/s 2023-05-08T09:52:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:05 smithi186 ceph-mon[126480]: pgmap v11823: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 789 KiB/s rd, 650 KiB/s wr, 28 op/s 2023-05-08T09:52:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22064.912237 secs 2023-05-08T09:52:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22064.912237 secs 2023-05-08T09:52:07.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22064.912237 secs 2023-05-08T09:52:08.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:07 smithi133 ceph-mon[125939]: pgmap v11824: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 830 KiB/s rd, 740 KiB/s wr, 24 op/s 2023-05-08T09:52:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:07 smithi096 ceph-mon[124666]: pgmap v11824: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 830 KiB/s rd, 740 KiB/s wr, 24 op/s 2023-05-08T09:52:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:07 smithi186 ceph-mon[126480]: pgmap v11824: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 830 KiB/s rd, 740 KiB/s wr, 24 op/s 2023-05-08T09:52:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:08 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:52:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:52:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:52:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22068.069408 secs 2023-05-08T09:52:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:08 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:52:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:52:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:52:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22068.069408 secs 2023-05-08T09:52:09.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:08 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:52:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:52:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:52:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22068.069408 secs 2023-05-08T09:52:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:09 smithi133 ceph-mon[125939]: pgmap v11825: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 830 KiB/s rd, 740 KiB/s wr, 24 op/s 2023-05-08T09:52:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22068.625304 secs 2023-05-08T09:52:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:09 smithi096 ceph-mon[124666]: pgmap v11825: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 830 KiB/s rd, 740 KiB/s wr, 24 op/s 2023-05-08T09:52:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22068.625304 secs 2023-05-08T09:52:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:09 smithi186 ceph-mon[126480]: pgmap v11825: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 830 KiB/s rd, 740 KiB/s wr, 24 op/s 2023-05-08T09:52:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22068.625304 secs 2023-05-08T09:52:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22069.912380 secs 2023-05-08T09:52:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:11 smithi133 ceph-mon[125939]: pgmap v11826: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 908 KiB/s wr, 30 op/s 2023-05-08T09:52:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:11 smithi133 ceph-mon[125939]: osdmap e816: 12 total, 12 up, 12 in 2023-05-08T09:52:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22069.912380 secs 2023-05-08T09:52:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:11 smithi096 ceph-mon[124666]: pgmap v11826: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 908 KiB/s wr, 30 op/s 2023-05-08T09:52:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:11 smithi096 ceph-mon[124666]: osdmap e816: 12 total, 12 up, 12 in 2023-05-08T09:52:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22069.912380 secs 2023-05-08T09:52:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:11 smithi186 ceph-mon[126480]: pgmap v11826: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 908 KiB/s wr, 30 op/s 2023-05-08T09:52:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:11 smithi186 ceph-mon[126480]: osdmap e816: 12 total, 12 up, 12 in 2023-05-08T09:52:14.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:13 smithi133 ceph-mon[125939]: pgmap v11828: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 988 KiB/s wr, 30 op/s 2023-05-08T09:52:14.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22073.069497 secs 2023-05-08T09:52:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:13 smithi096 ceph-mon[124666]: pgmap v11828: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 988 KiB/s wr, 30 op/s 2023-05-08T09:52:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22073.069497 secs 2023-05-08T09:52:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:13 smithi186 ceph-mon[126480]: pgmap v11828: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 988 KiB/s wr, 30 op/s 2023-05-08T09:52:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22073.069497 secs 2023-05-08T09:52:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22073.625452 secs 2023-05-08T09:52:15.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22073.625452 secs 2023-05-08T09:52:15.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22073.625452 secs 2023-05-08T09:52:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:15 smithi133 ceph-mon[125939]: pgmap v11829: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 542 KiB/s wr, 11 op/s 2023-05-08T09:52:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:15 smithi096 ceph-mon[124666]: pgmap v11829: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 542 KiB/s wr, 11 op/s 2023-05-08T09:52:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:15 smithi186 ceph-mon[126480]: pgmap v11829: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 542 KiB/s wr, 11 op/s 2023-05-08T09:52:17.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22074.912523 secs 2023-05-08T09:52:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22074.912523 secs 2023-05-08T09:52:17.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22074.912523 secs 2023-05-08T09:52:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:17 smithi133 ceph-mon[125939]: pgmap v11830: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 261 KiB/s rd, 202 KiB/s wr, 9 op/s 2023-05-08T09:52:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:17 smithi096 ceph-mon[124666]: pgmap v11830: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 261 KiB/s rd, 202 KiB/s wr, 9 op/s 2023-05-08T09:52:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:17 smithi186 ceph-mon[126480]: pgmap v11830: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 261 KiB/s rd, 202 KiB/s wr, 9 op/s 2023-05-08T09:52:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22078.069636 secs 2023-05-08T09:52:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:18 smithi096 ceph-mon[124666]: osdmap e817: 12 total, 12 up, 12 in 2023-05-08T09:52:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22078.069636 secs 2023-05-08T09:52:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:18 smithi186 ceph-mon[126480]: osdmap e817: 12 total, 12 up, 12 in 2023-05-08T09:52:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22078.069636 secs 2023-05-08T09:52:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:18 smithi133 ceph-mon[125939]: osdmap e817: 12 total, 12 up, 12 in 2023-05-08T09:52:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:19 smithi096 ceph-mon[124666]: pgmap v11831: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 261 KiB/s rd, 202 KiB/s wr, 9 op/s 2023-05-08T09:52:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22078.625548 secs 2023-05-08T09:52:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:19 smithi186 ceph-mon[126480]: pgmap v11831: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 261 KiB/s rd, 202 KiB/s wr, 9 op/s 2023-05-08T09:52:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22078.625548 secs 2023-05-08T09:52:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:19 smithi133 ceph-mon[125939]: pgmap v11831: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 261 KiB/s rd, 202 KiB/s wr, 9 op/s 2023-05-08T09:52:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22078.625548 secs 2023-05-08T09:52:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22079.912623 secs 2023-05-08T09:52:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:21 smithi096 ceph-mon[124666]: pgmap v11833: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 74 KiB/s wr, 7 op/s 2023-05-08T09:52:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22079.912623 secs 2023-05-08T09:52:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:21 smithi186 ceph-mon[126480]: pgmap v11833: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 74 KiB/s wr, 7 op/s 2023-05-08T09:52:22.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22079.912623 secs 2023-05-08T09:52:22.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:21 smithi133 ceph-mon[125939]: pgmap v11833: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 74 KiB/s wr, 7 op/s 2023-05-08T09:52:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:23 smithi096 ceph-mon[124666]: pgmap v11834: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 72 KiB/s wr, 7 op/s 2023-05-08T09:52:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22083.069766 secs 2023-05-08T09:52:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:23 smithi186 ceph-mon[126480]: pgmap v11834: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 72 KiB/s wr, 7 op/s 2023-05-08T09:52:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22083.069766 secs 2023-05-08T09:52:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:23 smithi133 ceph-mon[125939]: pgmap v11834: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 72 KiB/s wr, 7 op/s 2023-05-08T09:52:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22083.069766 secs 2023-05-08T09:52:25.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22083.625625 secs 2023-05-08T09:52:25.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22083.625625 secs 2023-05-08T09:52:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22083.625625 secs 2023-05-08T09:52:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:26 smithi186 ceph-mon[126480]: pgmap v11835: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 158 KiB/s wr, 6 op/s 2023-05-08T09:52:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:26 smithi133 ceph-mon[125939]: pgmap v11835: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 158 KiB/s wr, 6 op/s 2023-05-08T09:52:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:26 smithi096 ceph-mon[124666]: pgmap v11835: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 158 KiB/s wr, 6 op/s 2023-05-08T09:52:27.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:27 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22084.912742 secs 2023-05-08T09:52:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:27 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22084.912742 secs 2023-05-08T09:52:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:27 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22084.912742 secs 2023-05-08T09:52:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:28 smithi186 ceph-mon[126480]: pgmap v11836: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 158 KiB/s wr, 6 op/s 2023-05-08T09:52:28.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:28 smithi133 ceph-mon[125939]: pgmap v11836: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 158 KiB/s wr, 6 op/s 2023-05-08T09:52:28.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:28 smithi096 ceph-mon[124666]: pgmap v11836: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 158 KiB/s wr, 6 op/s 2023-05-08T09:52:29.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22088.069901 secs 2023-05-08T09:52:29.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22088.069901 secs 2023-05-08T09:52:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22088.069901 secs 2023-05-08T09:52:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:30 smithi186 ceph-mon[126480]: pgmap v11837: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 158 KiB/s wr, 6 op/s 2023-05-08T09:52:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22088.625745 secs 2023-05-08T09:52:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:30 smithi133 ceph-mon[125939]: pgmap v11837: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 158 KiB/s wr, 6 op/s 2023-05-08T09:52:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22088.625745 secs 2023-05-08T09:52:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:30 smithi096 ceph-mon[124666]: pgmap v11837: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 158 KiB/s wr, 6 op/s 2023-05-08T09:52:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22088.625745 secs 2023-05-08T09:52:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:32 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22089.912866 secs 2023-05-08T09:52:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:32 smithi186 ceph-mon[126480]: pgmap v11838: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 132 KiB/s wr, 8 op/s 2023-05-08T09:52:32.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:32 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22089.912866 secs 2023-05-08T09:52:32.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:32 smithi133 ceph-mon[125939]: pgmap v11838: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 132 KiB/s wr, 8 op/s 2023-05-08T09:52:32.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:32 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22089.912866 secs 2023-05-08T09:52:32.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:32 smithi096 ceph-mon[124666]: pgmap v11838: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 132 KiB/s wr, 8 op/s 2023-05-08T09:52:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:34 smithi186 ceph-mon[126480]: pgmap v11839: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 72 KiB/s wr, 5 op/s 2023-05-08T09:52:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22093.070046 secs 2023-05-08T09:52:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:34 smithi133 ceph-mon[125939]: pgmap v11839: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 72 KiB/s wr, 5 op/s 2023-05-08T09:52:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22093.070046 secs 2023-05-08T09:52:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:34 smithi096 ceph-mon[124666]: pgmap v11839: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 72 KiB/s wr, 5 op/s 2023-05-08T09:52:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22093.070046 secs 2023-05-08T09:52:35.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22093.625865 secs 2023-05-08T09:52:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22093.625865 secs 2023-05-08T09:52:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22093.625865 secs 2023-05-08T09:52:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:36 smithi186 ceph-mon[126480]: pgmap v11840: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 72 KiB/s wr, 7 op/s 2023-05-08T09:52:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:52:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:36 smithi133 ceph-mon[125939]: pgmap v11840: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 72 KiB/s wr, 7 op/s 2023-05-08T09:52:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:52:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:36 smithi096 ceph-mon[124666]: pgmap v11840: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 72 KiB/s wr, 7 op/s 2023-05-08T09:52:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:52:37.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:37 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22094.912966 secs 2023-05-08T09:52:37.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:37 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:52:37.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:37 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:52:37.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:37 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:52:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:37 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22094.912966 secs 2023-05-08T09:52:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:37 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:52:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:37 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:52:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:37 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:52:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:37 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22094.912966 secs 2023-05-08T09:52:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:37 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:52:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:37 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:52:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:37 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:52:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:38 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:52:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:38 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T09:52:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:38 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T09:52:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:38 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:52:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:38 smithi186 ceph-mon[126480]: pgmap v11841: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2023-05-08T09:52:38.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:38 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:52:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:38 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T09:52:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:38 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T09:52:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:38 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:52:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:38 smithi133 ceph-mon[125939]: pgmap v11841: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2023-05-08T09:52:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:38 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:52:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:38 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T09:52:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:38 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T09:52:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:38 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:52:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:38 smithi096 ceph-mon[124666]: pgmap v11841: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2023-05-08T09:52:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22098.070193 secs 2023-05-08T09:52:39.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22098.070193 secs 2023-05-08T09:52:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22098.070193 secs 2023-05-08T09:52:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:40 smithi186 ceph-mon[126480]: pgmap v11842: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2023-05-08T09:52:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22098.625979 secs 2023-05-08T09:52:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:40 smithi133 ceph-mon[125939]: pgmap v11842: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2023-05-08T09:52:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22098.625979 secs 2023-05-08T09:52:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:40 smithi096 ceph-mon[124666]: pgmap v11842: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2023-05-08T09:52:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22098.625979 secs 2023-05-08T09:52:42.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:42 smithi186 ceph-mon[126480]: pgmap v11843: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 597 B/s wr, 8 op/s 2023-05-08T09:52:42.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:42 smithi133 ceph-mon[125939]: pgmap v11843: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 597 B/s wr, 8 op/s 2023-05-08T09:52:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:42 smithi096 ceph-mon[124666]: pgmap v11843: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 597 B/s wr, 8 op/s 2023-05-08T09:52:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:44 smithi186 ceph-mon[126480]: pgmap v11844: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T09:52:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22103.070346 secs 2023-05-08T09:52:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:44 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:52:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:44 smithi133 ceph-mon[125939]: pgmap v11844: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T09:52:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22103.070346 secs 2023-05-08T09:52:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:44 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:52:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:44 smithi096 ceph-mon[124666]: pgmap v11844: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T09:52:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22103.070346 secs 2023-05-08T09:52:44.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:44 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:52:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:45 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:52:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:45 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:52:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:45 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:52:45.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:45 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:52:45.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:45 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:52:45.494 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:45 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:52:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:45 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:52:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:45 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:52:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:45 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:52:46.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:46 smithi186 ceph-mon[126480]: pgmap v11845: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 313 KiB/s wr, 10 op/s 2023-05-08T09:52:46.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:46 smithi133 ceph-mon[125939]: pgmap v11845: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 313 KiB/s wr, 10 op/s 2023-05-08T09:52:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:46 smithi096 ceph-mon[124666]: pgmap v11845: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 313 KiB/s wr, 10 op/s 2023-05-08T09:52:47.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:47 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22104.913202 secs 2023-05-08T09:52:47.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:47 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22104.913202 secs 2023-05-08T09:52:47.509 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:47 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22104.913202 secs 2023-05-08T09:52:48.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:48 smithi186 ceph-mon[126480]: pgmap v11846: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 313 KiB/s wr, 8 op/s 2023-05-08T09:52:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:52:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:48 smithi133 ceph-mon[125939]: pgmap v11846: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 313 KiB/s wr, 8 op/s 2023-05-08T09:52:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:52:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:48 smithi096 ceph-mon[124666]: pgmap v11846: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 313 KiB/s wr, 8 op/s 2023-05-08T09:52:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:52:49.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:52:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:52:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:52:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22108.070459 secs 2023-05-08T09:52:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:52:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:52:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:52:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22108.070459 secs 2023-05-08T09:52:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:52:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:52:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:52:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22108.070459 secs 2023-05-08T09:52:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:50 smithi186 ceph-mon[126480]: pgmap v11847: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 313 KiB/s wr, 8 op/s 2023-05-08T09:52:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:50 smithi133 ceph-mon[125939]: pgmap v11847: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 313 KiB/s wr, 8 op/s 2023-05-08T09:52:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:50 smithi096 ceph-mon[124666]: pgmap v11847: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 313 KiB/s wr, 8 op/s 2023-05-08T09:52:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:52 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22109.913299 secs 2023-05-08T09:52:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:52 smithi186 ceph-mon[126480]: pgmap v11848: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 400 KiB/s wr, 12 op/s 2023-05-08T09:52:52.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:52 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22109.913299 secs 2023-05-08T09:52:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:52 smithi133 ceph-mon[125939]: pgmap v11848: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 400 KiB/s wr, 12 op/s 2023-05-08T09:52:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:52 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22109.913299 secs 2023-05-08T09:52:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:52 smithi096 ceph-mon[124666]: pgmap v11848: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 400 KiB/s wr, 12 op/s 2023-05-08T09:52:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:54 smithi186 ceph-mon[126480]: pgmap v11849: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 497 KiB/s rd, 400 KiB/s wr, 9 op/s 2023-05-08T09:52:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22113.070586 secs 2023-05-08T09:52:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:54 smithi133 ceph-mon[125939]: pgmap v11849: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 497 KiB/s rd, 400 KiB/s wr, 9 op/s 2023-05-08T09:52:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22113.070586 secs 2023-05-08T09:52:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:54 smithi096 ceph-mon[124666]: pgmap v11849: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 497 KiB/s rd, 400 KiB/s wr, 9 op/s 2023-05-08T09:52:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22113.070586 secs 2023-05-08T09:52:55.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22113.626384 secs 2023-05-08T09:52:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22113.626384 secs 2023-05-08T09:52:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22113.626384 secs 2023-05-08T09:52:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:56 smithi186 ceph-mon[126480]: pgmap v11850: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 937 KiB/s rd, 671 KiB/s wr, 14 op/s 2023-05-08T09:52:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:56 smithi133 ceph-mon[125939]: pgmap v11850: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 937 KiB/s rd, 671 KiB/s wr, 14 op/s 2023-05-08T09:52:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:56 smithi096 ceph-mon[124666]: pgmap v11850: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 937 KiB/s rd, 671 KiB/s wr, 14 op/s 2023-05-08T09:52:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:57 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22114.913422 secs 2023-05-08T09:52:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:57 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:52:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:52:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:52:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:57 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22114.913422 secs 2023-05-08T09:52:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:57 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:52:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:52:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:52:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:57 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22114.913422 secs 2023-05-08T09:52:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:57 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:52:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:52:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:52:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:58 smithi186 ceph-mon[126480]: pgmap v11851: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 540 KiB/s rd, 358 KiB/s wr, 9 op/s 2023-05-08T09:52:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:58 smithi133 ceph-mon[125939]: pgmap v11851: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 540 KiB/s rd, 358 KiB/s wr, 9 op/s 2023-05-08T09:52:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:58 smithi096 ceph-mon[124666]: pgmap v11851: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 540 KiB/s rd, 358 KiB/s wr, 9 op/s 2023-05-08T09:52:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:52:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22118.070715 secs 2023-05-08T09:52:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:52:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22118.070715 secs 2023-05-08T09:52:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:52:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22118.070715 secs 2023-05-08T09:53:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:00 smithi133 ceph-mon[125939]: pgmap v11852: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 540 KiB/s rd, 358 KiB/s wr, 9 op/s 2023-05-08T09:53:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22118.626502 secs 2023-05-08T09:53:00.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:00 smithi096 ceph-mon[124666]: pgmap v11852: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 540 KiB/s rd, 358 KiB/s wr, 9 op/s 2023-05-08T09:53:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22118.626502 secs 2023-05-08T09:53:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:00 smithi186 ceph-mon[126480]: pgmap v11852: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 540 KiB/s rd, 358 KiB/s wr, 9 op/s 2023-05-08T09:53:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22118.626502 secs 2023-05-08T09:53:02.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:02 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22119.913552 secs 2023-05-08T09:53:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:02 smithi133 ceph-mon[125939]: pgmap v11853: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 626 KiB/s rd, 677 KiB/s wr, 14 op/s 2023-05-08T09:53:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:02 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22119.913552 secs 2023-05-08T09:53:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:02 smithi096 ceph-mon[124666]: pgmap v11853: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 626 KiB/s rd, 677 KiB/s wr, 14 op/s 2023-05-08T09:53:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:02 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22119.913552 secs 2023-05-08T09:53:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:02 smithi186 ceph-mon[126480]: pgmap v11853: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 626 KiB/s rd, 677 KiB/s wr, 14 op/s 2023-05-08T09:53:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:04 smithi133 ceph-mon[125939]: pgmap v11854: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 526 KiB/s rd, 590 KiB/s wr, 9 op/s 2023-05-08T09:53:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22123.070864 secs 2023-05-08T09:53:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:04 smithi096 ceph-mon[124666]: pgmap v11854: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 526 KiB/s rd, 590 KiB/s wr, 9 op/s 2023-05-08T09:53:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22123.070864 secs 2023-05-08T09:53:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:04 smithi186 ceph-mon[126480]: pgmap v11854: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 526 KiB/s rd, 590 KiB/s wr, 9 op/s 2023-05-08T09:53:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22123.070864 secs 2023-05-08T09:53:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:06 smithi133 ceph-mon[125939]: pgmap v11855: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 678 KiB/s rd, 610 KiB/s wr, 14 op/s 2023-05-08T09:53:06.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:06 smithi096 ceph-mon[124666]: pgmap v11855: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 678 KiB/s rd, 610 KiB/s wr, 14 op/s 2023-05-08T09:53:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:06 smithi186 ceph-mon[126480]: pgmap v11855: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 678 KiB/s rd, 610 KiB/s wr, 14 op/s 2023-05-08T09:53:08.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:08 smithi133 ceph-mon[125939]: pgmap v11856: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 474 KiB/s wr, 11 op/s 2023-05-08T09:53:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:08 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:53:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:08 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:53:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:08 smithi096 ceph-mon[124666]: pgmap v11856: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 474 KiB/s wr, 11 op/s 2023-05-08T09:53:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:08 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:53:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:08 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:53:08.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:08 smithi186 ceph-mon[126480]: pgmap v11856: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 474 KiB/s wr, 11 op/s 2023-05-08T09:53:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:08 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:53:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:08 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:53:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:09 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:53:09.557 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:53:09.558 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:53:09.558 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:53:09.558 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22128.070989 secs 2023-05-08T09:53:09.559 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:09 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:53:09.559 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:53:09.559 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:53:09.559 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:53:09.560 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22128.070989 secs 2023-05-08T09:53:09.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:09 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:53:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:53:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:53:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:53:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22128.070989 secs 2023-05-08T09:53:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:10 smithi133 ceph-mon[125939]: pgmap v11857: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 474 KiB/s wr, 11 op/s 2023-05-08T09:53:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22128.626691 secs 2023-05-08T09:53:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:10 smithi096 ceph-mon[124666]: pgmap v11857: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 474 KiB/s wr, 11 op/s 2023-05-08T09:53:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22128.626691 secs 2023-05-08T09:53:10.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:10 smithi186 ceph-mon[126480]: pgmap v11857: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 474 KiB/s wr, 11 op/s 2023-05-08T09:53:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22128.626691 secs 2023-05-08T09:53:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:12 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22129.913824 secs 2023-05-08T09:53:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:12 smithi133 ceph-mon[125939]: pgmap v11858: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 739 KiB/s rd, 714 KiB/s wr, 30 op/s 2023-05-08T09:53:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:12 smithi133 ceph-mon[125939]: osdmap e818: 12 total, 12 up, 12 in 2023-05-08T09:53:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:12 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22129.913824 secs 2023-05-08T09:53:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:12 smithi096 ceph-mon[124666]: pgmap v11858: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 739 KiB/s rd, 714 KiB/s wr, 30 op/s 2023-05-08T09:53:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:12 smithi096 ceph-mon[124666]: osdmap e818: 12 total, 12 up, 12 in 2023-05-08T09:53:12.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:12 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22129.913824 secs 2023-05-08T09:53:12.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:12 smithi186 ceph-mon[126480]: pgmap v11858: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 739 KiB/s rd, 714 KiB/s wr, 30 op/s 2023-05-08T09:53:12.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:12 smithi186 ceph-mon[126480]: osdmap e818: 12 total, 12 up, 12 in 2023-05-08T09:53:13.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:53:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:53:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:13 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:53:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:53:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:53:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:13 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:53:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:53:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:53:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:13 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:53:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:14 smithi133 ceph-mon[125939]: pgmap v11860: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 784 KiB/s rd, 474 KiB/s wr, 30 op/s 2023-05-08T09:53:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22133.071126 secs 2023-05-08T09:53:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:14 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:53:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:14 smithi096 ceph-mon[124666]: pgmap v11860: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 784 KiB/s rd, 474 KiB/s wr, 30 op/s 2023-05-08T09:53:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22133.071126 secs 2023-05-08T09:53:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:14 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:53:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:14 smithi186 ceph-mon[126480]: pgmap v11860: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 784 KiB/s rd, 474 KiB/s wr, 30 op/s 2023-05-08T09:53:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22133.071126 secs 2023-05-08T09:53:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:14 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:53:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22133.626808 secs 2023-05-08T09:53:15.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22133.626808 secs 2023-05-08T09:53:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22133.626808 secs 2023-05-08T09:53:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:16 smithi133 ceph-mon[125939]: pgmap v11861: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 603 KiB/s rd, 450 KiB/s wr, 28 op/s 2023-05-08T09:53:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22134.913889 secs 2023-05-08T09:53:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:16 smithi096 ceph-mon[124666]: pgmap v11861: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 603 KiB/s rd, 450 KiB/s wr, 28 op/s 2023-05-08T09:53:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22134.913889 secs 2023-05-08T09:53:16.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:16 smithi186 ceph-mon[126480]: pgmap v11861: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 603 KiB/s rd, 450 KiB/s wr, 28 op/s 2023-05-08T09:53:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22134.913889 secs 2023-05-08T09:53:18.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:18 smithi133 ceph-mon[125939]: pgmap v11862: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 408 KiB/s rd, 289 KiB/s wr, 26 op/s 2023-05-08T09:53:18.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:18 smithi096 ceph-mon[124666]: pgmap v11862: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 408 KiB/s rd, 289 KiB/s wr, 26 op/s 2023-05-08T09:53:18.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:18 smithi186 ceph-mon[126480]: pgmap v11862: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 408 KiB/s rd, 289 KiB/s wr, 26 op/s 2023-05-08T09:53:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22138.071242 secs 2023-05-08T09:53:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:19 smithi133 ceph-mon[125939]: osdmap e819: 12 total, 12 up, 12 in 2023-05-08T09:53:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22138.071242 secs 2023-05-08T09:53:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:19 smithi096 ceph-mon[124666]: osdmap e819: 12 total, 12 up, 12 in 2023-05-08T09:53:19.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22138.071242 secs 2023-05-08T09:53:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:19 smithi186 ceph-mon[126480]: osdmap e819: 12 total, 12 up, 12 in 2023-05-08T09:53:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:20 smithi133 ceph-mon[125939]: pgmap v11863: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 408 KiB/s rd, 289 KiB/s wr, 26 op/s 2023-05-08T09:53:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22138.626935 secs 2023-05-08T09:53:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:20 smithi096 ceph-mon[124666]: pgmap v11863: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 408 KiB/s rd, 289 KiB/s wr, 26 op/s 2023-05-08T09:53:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22138.626935 secs 2023-05-08T09:53:20.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:20 smithi186 ceph-mon[126480]: pgmap v11863: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 408 KiB/s rd, 289 KiB/s wr, 26 op/s 2023-05-08T09:53:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22138.626935 secs 2023-05-08T09:53:21.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22139.913973 secs 2023-05-08T09:53:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22139.913973 secs 2023-05-08T09:53:21.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22139.913973 secs 2023-05-08T09:53:22.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:22 smithi133 ceph-mon[125939]: pgmap v11865: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 106 KiB/s wr, 8 op/s 2023-05-08T09:53:22.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:22 smithi096 ceph-mon[124666]: pgmap v11865: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 106 KiB/s wr, 8 op/s 2023-05-08T09:53:22.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:22 smithi186 ceph-mon[126480]: pgmap v11865: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 106 KiB/s wr, 8 op/s 2023-05-08T09:53:24.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:24 smithi133 ceph-mon[125939]: pgmap v11866: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 100 KiB/s wr, 8 op/s 2023-05-08T09:53:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22143.071378 secs 2023-05-08T09:53:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:24 smithi096 ceph-mon[124666]: pgmap v11866: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 100 KiB/s wr, 8 op/s 2023-05-08T09:53:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22143.071378 secs 2023-05-08T09:53:24.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:24 smithi186 ceph-mon[126480]: pgmap v11866: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 100 KiB/s wr, 8 op/s 2023-05-08T09:53:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22143.071378 secs 2023-05-08T09:53:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22143.627064 secs 2023-05-08T09:53:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22143.627064 secs 2023-05-08T09:53:25.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22143.627064 secs 2023-05-08T09:53:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:26 smithi133 ceph-mon[125939]: pgmap v11867: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 187 KiB/s wr, 7 op/s 2023-05-08T09:53:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22144.914089 secs 2023-05-08T09:53:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:26 smithi096 ceph-mon[124666]: pgmap v11867: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 187 KiB/s wr, 7 op/s 2023-05-08T09:53:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22144.914089 secs 2023-05-08T09:53:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:26 smithi186 ceph-mon[126480]: pgmap v11867: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 187 KiB/s wr, 7 op/s 2023-05-08T09:53:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22144.914089 secs 2023-05-08T09:53:28.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:28 smithi133 ceph-mon[125939]: pgmap v11868: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 187 KiB/s wr, 7 op/s 2023-05-08T09:53:28.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:28 smithi096 ceph-mon[124666]: pgmap v11868: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 187 KiB/s wr, 7 op/s 2023-05-08T09:53:28.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:28 smithi186 ceph-mon[126480]: pgmap v11868: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 187 KiB/s wr, 7 op/s 2023-05-08T09:53:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22148.071515 secs 2023-05-08T09:53:29.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22148.071515 secs 2023-05-08T09:53:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22148.071515 secs 2023-05-08T09:53:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:30 smithi133 ceph-mon[125939]: pgmap v11869: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 187 KiB/s wr, 7 op/s 2023-05-08T09:53:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22148.627174 secs 2023-05-08T09:53:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:30 smithi096 ceph-mon[124666]: pgmap v11869: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 187 KiB/s wr, 7 op/s 2023-05-08T09:53:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22148.627174 secs 2023-05-08T09:53:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:30 smithi186 ceph-mon[126480]: pgmap v11869: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 187 KiB/s wr, 7 op/s 2023-05-08T09:53:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22148.627174 secs 2023-05-08T09:53:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22149.914212 secs 2023-05-08T09:53:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:31 smithi133 ceph-mon[125939]: pgmap v11870: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 156 KiB/s wr, 9 op/s 2023-05-08T09:53:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22149.914212 secs 2023-05-08T09:53:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:31 smithi096 ceph-mon[124666]: pgmap v11870: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 156 KiB/s wr, 9 op/s 2023-05-08T09:53:31.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22149.914212 secs 2023-05-08T09:53:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:31 smithi186 ceph-mon[126480]: pgmap v11870: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 156 KiB/s wr, 9 op/s 2023-05-08T09:53:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:33 smithi133 ceph-mon[125939]: pgmap v11871: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 73 KiB/s wr, 5 op/s 2023-05-08T09:53:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22153.071649 secs 2023-05-08T09:53:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:33 smithi096 ceph-mon[124666]: pgmap v11871: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 73 KiB/s wr, 5 op/s 2023-05-08T09:53:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22153.071649 secs 2023-05-08T09:53:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:33 smithi186 ceph-mon[126480]: pgmap v11871: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 73 KiB/s wr, 5 op/s 2023-05-08T09:53:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22153.071649 secs 2023-05-08T09:53:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22153.627293 secs 2023-05-08T09:53:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:35 smithi133 ceph-mon[125939]: pgmap v11872: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 73 KiB/s wr, 8 op/s 2023-05-08T09:53:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22153.627293 secs 2023-05-08T09:53:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:35 smithi096 ceph-mon[124666]: pgmap v11872: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 73 KiB/s wr, 8 op/s 2023-05-08T09:53:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22153.627293 secs 2023-05-08T09:53:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:35 smithi186 ceph-mon[126480]: pgmap v11872: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 73 KiB/s wr, 8 op/s 2023-05-08T09:53:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22154.914351 secs 2023-05-08T09:53:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:53:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22154.914351 secs 2023-05-08T09:53:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:53:37.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22154.914351 secs 2023-05-08T09:53:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:53:38.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:37 smithi186 ceph-mon[126480]: pgmap v11873: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T09:53:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:37 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:53:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:37 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:53:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:37 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:53:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:37 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:53:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:37 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:53:38.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:37 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:53:38.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:37 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:53:38.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:37 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:53:38.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:37 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:53:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:37 smithi133 ceph-mon[125939]: pgmap v11873: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T09:53:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:37 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:53:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:37 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:53:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:37 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:53:38.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:37 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:53:38.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:37 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:53:38.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:37 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:53:38.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:37 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:53:38.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:37 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:53:38.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:37 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:53:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:37 smithi096 ceph-mon[124666]: pgmap v11873: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T09:53:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:37 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:53:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:37 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:53:38.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:37 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:53:38.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:37 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:53:38.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:37 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:53:38.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:37 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:53:38.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:37 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:53:38.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:37 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:53:38.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:37 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:53:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:38 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:53:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:38 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T09:53:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:38 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T09:53:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:38 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:53:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22158.071726 secs 2023-05-08T09:53:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:38 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:53:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:38 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T09:53:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:38 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T09:53:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:38 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:53:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22158.071726 secs 2023-05-08T09:53:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:38 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:53:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:38 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T09:53:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:38 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T09:53:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:38 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:53:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22158.071726 secs 2023-05-08T09:53:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:39 smithi186 ceph-mon[126480]: pgmap v11874: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T09:53:40.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:39 smithi133 ceph-mon[125939]: pgmap v11874: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T09:53:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:39 smithi096 ceph-mon[124666]: pgmap v11874: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T09:53:41.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22158.627360 secs 2023-05-08T09:53:41.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22158.627360 secs 2023-05-08T09:53:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22158.627360 secs 2023-05-08T09:53:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:41 smithi186 ceph-mon[126480]: pgmap v11875: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 76 KiB/s wr, 9 op/s 2023-05-08T09:53:42.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:41 smithi133 ceph-mon[125939]: pgmap v11875: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 76 KiB/s wr, 9 op/s 2023-05-08T09:53:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:41 smithi096 ceph-mon[124666]: pgmap v11875: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 76 KiB/s wr, 9 op/s 2023-05-08T09:53:44.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:43 smithi186 ceph-mon[126480]: pgmap v11876: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 76 KiB/s wr, 6 op/s 2023-05-08T09:53:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22163.071869 secs 2023-05-08T09:53:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:53:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:43 smithi133 ceph-mon[125939]: pgmap v11876: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 76 KiB/s wr, 6 op/s 2023-05-08T09:53:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22163.071869 secs 2023-05-08T09:53:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:53:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:43 smithi096 ceph-mon[124666]: pgmap v11876: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 76 KiB/s wr, 6 op/s 2023-05-08T09:53:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22163.071869 secs 2023-05-08T09:53:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:53:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:53:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:53:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:53:45.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:53:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:53:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:53:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:53:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:53:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:53:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22163.627461 secs 2023-05-08T09:53:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:45 smithi186 ceph-mon[126480]: pgmap v11877: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 156 KiB/s wr, 10 op/s 2023-05-08T09:53:46.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22163.627461 secs 2023-05-08T09:53:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:45 smithi133 ceph-mon[125939]: pgmap v11877: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 156 KiB/s wr, 10 op/s 2023-05-08T09:53:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22163.627461 secs 2023-05-08T09:53:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:45 smithi096 ceph-mon[124666]: pgmap v11877: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 156 KiB/s wr, 10 op/s 2023-05-08T09:53:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:47 smithi186 ceph-mon[126480]: pgmap v11878: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 156 KiB/s wr, 7 op/s 2023-05-08T09:53:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:47 smithi133 ceph-mon[125939]: pgmap v11878: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 156 KiB/s wr, 7 op/s 2023-05-08T09:53:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:47 smithi096 ceph-mon[124666]: pgmap v11878: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 156 KiB/s wr, 7 op/s 2023-05-08T09:53:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22168.071990 secs 2023-05-08T09:53:49.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22168.071990 secs 2023-05-08T09:53:49.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22168.071990 secs 2023-05-08T09:53:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:49 smithi186 ceph-mon[126480]: pgmap v11879: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 156 KiB/s wr, 7 op/s 2023-05-08T09:53:50.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:49 smithi133 ceph-mon[125939]: pgmap v11879: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 156 KiB/s wr, 7 op/s 2023-05-08T09:53:50.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:49 smithi096 ceph-mon[124666]: pgmap v11879: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 156 KiB/s wr, 7 op/s 2023-05-08T09:53:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22169.914747 secs 2023-05-08T09:53:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:51 smithi133 ceph-mon[125939]: pgmap v11880: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 491 KiB/s rd, 488 KiB/s wr, 11 op/s 2023-05-08T09:53:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:53:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22169.914747 secs 2023-05-08T09:53:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:51 smithi096 ceph-mon[124666]: pgmap v11880: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 491 KiB/s rd, 488 KiB/s wr, 11 op/s 2023-05-08T09:53:52.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:53:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22169.914747 secs 2023-05-08T09:53:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:51 smithi186 ceph-mon[126480]: pgmap v11880: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 491 KiB/s rd, 488 KiB/s wr, 11 op/s 2023-05-08T09:53:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:53:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:53:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:53:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:53:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:53:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:53:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:53:53.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:53:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:53:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:53:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:53 smithi133 ceph-mon[125939]: pgmap v11881: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 412 KiB/s wr, 8 op/s 2023-05-08T09:53:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22173.072094 secs 2023-05-08T09:53:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:53 smithi096 ceph-mon[124666]: pgmap v11881: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 412 KiB/s wr, 8 op/s 2023-05-08T09:53:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22173.072094 secs 2023-05-08T09:53:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:53 smithi186 ceph-mon[126480]: pgmap v11881: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 412 KiB/s wr, 8 op/s 2023-05-08T09:53:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22173.072094 secs 2023-05-08T09:53:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22173.627691 secs 2023-05-08T09:53:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22173.627691 secs 2023-05-08T09:53:55.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22173.627691 secs 2023-05-08T09:53:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:55 smithi133 ceph-mon[125939]: pgmap v11882: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 685 KiB/s rd, 672 KiB/s wr, 13 op/s 2023-05-08T09:53:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:55 smithi096 ceph-mon[124666]: pgmap v11882: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 685 KiB/s rd, 672 KiB/s wr, 13 op/s 2023-05-08T09:53:56.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:55 smithi186 ceph-mon[126480]: pgmap v11882: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 685 KiB/s rd, 672 KiB/s wr, 13 op/s 2023-05-08T09:53:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22174.914856 secs 2023-05-08T09:53:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:56 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:53:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:53:57.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:53:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22174.914856 secs 2023-05-08T09:53:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:56 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:53:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:53:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:53:57.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22174.914856 secs 2023-05-08T09:53:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:56 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:53:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:53:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:53:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:57 smithi133 ceph-mon[125939]: pgmap v11883: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 604 KiB/s rd, 592 KiB/s wr, 10 op/s 2023-05-08T09:53:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:57 smithi096 ceph-mon[124666]: pgmap v11883: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 604 KiB/s rd, 592 KiB/s wr, 10 op/s 2023-05-08T09:53:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:57 smithi186 ceph-mon[126480]: pgmap v11883: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 604 KiB/s rd, 592 KiB/s wr, 10 op/s 2023-05-08T09:53:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22178.072272 secs 2023-05-08T09:53:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22178.072272 secs 2023-05-08T09:53:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22178.072272 secs 2023-05-08T09:54:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:59 smithi133 ceph-mon[125939]: pgmap v11884: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 604 KiB/s rd, 592 KiB/s wr, 9 op/s 2023-05-08T09:54:00.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:53:59 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:54:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:59 smithi096 ceph-mon[124666]: pgmap v11884: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 604 KiB/s rd, 592 KiB/s wr, 9 op/s 2023-05-08T09:54:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:53:59 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:54:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:59 smithi186 ceph-mon[126480]: pgmap v11884: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 604 KiB/s rd, 592 KiB/s wr, 9 op/s 2023-05-08T09:54:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:53:59 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:54:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:54:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:54:01.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:54:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:54:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:54:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:54:02.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22179.914976 secs 2023-05-08T09:54:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:01 smithi133 ceph-mon[125939]: pgmap v11885: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 746 KiB/s rd, 744 KiB/s wr, 15 op/s 2023-05-08T09:54:02.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22179.914976 secs 2023-05-08T09:54:02.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:01 smithi096 ceph-mon[124666]: pgmap v11885: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 746 KiB/s rd, 744 KiB/s wr, 15 op/s 2023-05-08T09:54:02.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22179.914976 secs 2023-05-08T09:54:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:01 smithi186 ceph-mon[126480]: pgmap v11885: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 746 KiB/s rd, 744 KiB/s wr, 15 op/s 2023-05-08T09:54:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:03 smithi133 ceph-mon[125939]: pgmap v11886: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 413 KiB/s wr, 11 op/s 2023-05-08T09:54:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22183.072407 secs 2023-05-08T09:54:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:03 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:54:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:03 smithi096 ceph-mon[124666]: pgmap v11886: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 413 KiB/s wr, 11 op/s 2023-05-08T09:54:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22183.072407 secs 2023-05-08T09:54:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:03 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:54:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:03 smithi186 ceph-mon[126480]: pgmap v11886: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 413 KiB/s wr, 11 op/s 2023-05-08T09:54:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22183.072407 secs 2023-05-08T09:54:04.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:03 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:54:05.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22183.627950 secs 2023-05-08T09:54:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22183.627950 secs 2023-05-08T09:54:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22183.627950 secs 2023-05-08T09:54:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:05 smithi133 ceph-mon[125939]: pgmap v11887: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 660 KiB/s rd, 683 KiB/s wr, 30 op/s 2023-05-08T09:54:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:05 smithi096 ceph-mon[124666]: pgmap v11887: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 660 KiB/s rd, 683 KiB/s wr, 30 op/s 2023-05-08T09:54:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:05 smithi186 ceph-mon[126480]: pgmap v11887: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 660 KiB/s rd, 683 KiB/s wr, 30 op/s 2023-05-08T09:54:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22184.915095 secs 2023-05-08T09:54:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:06 smithi133 ceph-mon[125939]: osdmap e820: 12 total, 12 up, 12 in 2023-05-08T09:54:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22184.915095 secs 2023-05-08T09:54:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:06 smithi096 ceph-mon[124666]: osdmap e820: 12 total, 12 up, 12 in 2023-05-08T09:54:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22184.915095 secs 2023-05-08T09:54:07.411 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:06 smithi186 ceph-mon[126480]: osdmap e820: 12 total, 12 up, 12 in 2023-05-08T09:54:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:07 smithi133 ceph-mon[125939]: pgmap v11889: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 508 KiB/s wr, 30 op/s 2023-05-08T09:54:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:07 smithi096 ceph-mon[124666]: pgmap v11889: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 508 KiB/s wr, 30 op/s 2023-05-08T09:54:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:07 smithi186 ceph-mon[126480]: pgmap v11889: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 508 KiB/s wr, 30 op/s 2023-05-08T09:54:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:54:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:54:09.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22188.072505 secs 2023-05-08T09:54:09.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:08 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:54:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:54:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:54:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22188.072505 secs 2023-05-08T09:54:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:08 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:54:09.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:54:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:54:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22188.072505 secs 2023-05-08T09:54:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:08 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:54:10.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:09 smithi133 ceph-mon[125939]: pgmap v11890: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 508 KiB/s wr, 30 op/s 2023-05-08T09:54:10.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22188.628086 secs 2023-05-08T09:54:10.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:09 smithi096 ceph-mon[124666]: pgmap v11890: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 508 KiB/s wr, 30 op/s 2023-05-08T09:54:10.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22188.628086 secs 2023-05-08T09:54:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:09 smithi186 ceph-mon[126480]: pgmap v11890: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 508 KiB/s wr, 30 op/s 2023-05-08T09:54:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22188.628086 secs 2023-05-08T09:54:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22189.915219 secs 2023-05-08T09:54:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:11 smithi133 ceph-mon[125939]: pgmap v11891: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 370 KiB/s wr, 28 op/s 2023-05-08T09:54:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22189.915219 secs 2023-05-08T09:54:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:11 smithi096 ceph-mon[124666]: pgmap v11891: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 370 KiB/s wr, 28 op/s 2023-05-08T09:54:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22189.915219 secs 2023-05-08T09:54:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:11 smithi186 ceph-mon[126480]: pgmap v11891: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 370 KiB/s wr, 28 op/s 2023-05-08T09:54:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:13 smithi133 ceph-mon[125939]: pgmap v11892: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 370 KiB/s wr, 28 op/s 2023-05-08T09:54:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22193.072661 secs 2023-05-08T09:54:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:13 smithi133 ceph-mon[125939]: osdmap e821: 12 total, 12 up, 12 in 2023-05-08T09:54:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:13 smithi096 ceph-mon[124666]: pgmap v11892: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 370 KiB/s wr, 28 op/s 2023-05-08T09:54:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22193.072661 secs 2023-05-08T09:54:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:13 smithi096 ceph-mon[124666]: osdmap e821: 12 total, 12 up, 12 in 2023-05-08T09:54:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:13 smithi186 ceph-mon[126480]: pgmap v11892: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 370 KiB/s wr, 28 op/s 2023-05-08T09:54:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22193.072661 secs 2023-05-08T09:54:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:13 smithi186 ceph-mon[126480]: osdmap e821: 12 total, 12 up, 12 in 2023-05-08T09:54:15.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22193.628214 secs 2023-05-08T09:54:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22193.628214 secs 2023-05-08T09:54:15.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22193.628214 secs 2023-05-08T09:54:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:15 smithi133 ceph-mon[125939]: pgmap v11894: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 273 KiB/s wr, 10 op/s 2023-05-08T09:54:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:15 smithi096 ceph-mon[124666]: pgmap v11894: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 273 KiB/s wr, 10 op/s 2023-05-08T09:54:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:15 smithi186 ceph-mon[126480]: pgmap v11894: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 273 KiB/s wr, 10 op/s 2023-05-08T09:54:17.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22194.915341 secs 2023-05-08T09:54:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22194.915341 secs 2023-05-08T09:54:17.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22194.915341 secs 2023-05-08T09:54:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:17 smithi133 ceph-mon[125939]: pgmap v11895: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 238 KiB/s wr, 9 op/s 2023-05-08T09:54:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:17 smithi096 ceph-mon[124666]: pgmap v11895: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 238 KiB/s wr, 9 op/s 2023-05-08T09:54:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:17 smithi186 ceph-mon[126480]: pgmap v11895: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 238 KiB/s wr, 9 op/s 2023-05-08T09:54:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22198.072791 secs 2023-05-08T09:54:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22198.072791 secs 2023-05-08T09:54:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22198.072791 secs 2023-05-08T09:54:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:19 smithi133 ceph-mon[125939]: pgmap v11896: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 238 KiB/s wr, 9 op/s 2023-05-08T09:54:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22198.628346 secs 2023-05-08T09:54:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:19 smithi096 ceph-mon[124666]: pgmap v11896: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 238 KiB/s wr, 9 op/s 2023-05-08T09:54:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22198.628346 secs 2023-05-08T09:54:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:19 smithi186 ceph-mon[126480]: pgmap v11896: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 238 KiB/s wr, 9 op/s 2023-05-08T09:54:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22198.628346 secs 2023-05-08T09:54:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22199.915477 secs 2023-05-08T09:54:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:21 smithi096 ceph-mon[124666]: pgmap v11897: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 192 KiB/s wr, 7 op/s 2023-05-08T09:54:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22199.915477 secs 2023-05-08T09:54:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:21 smithi186 ceph-mon[126480]: pgmap v11897: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 192 KiB/s wr, 7 op/s 2023-05-08T09:54:22.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22199.915477 secs 2023-05-08T09:54:22.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:21 smithi133 ceph-mon[125939]: pgmap v11897: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 192 KiB/s wr, 7 op/s 2023-05-08T09:54:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:23 smithi096 ceph-mon[124666]: pgmap v11898: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 192 KiB/s wr, 7 op/s 2023-05-08T09:54:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22203.072926 secs 2023-05-08T09:54:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:23 smithi186 ceph-mon[126480]: pgmap v11898: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 192 KiB/s wr, 7 op/s 2023-05-08T09:54:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22203.072926 secs 2023-05-08T09:54:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:23 smithi133 ceph-mon[125939]: pgmap v11898: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 192 KiB/s wr, 7 op/s 2023-05-08T09:54:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22203.072926 secs 2023-05-08T09:54:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22203.628504 secs 2023-05-08T09:54:25.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22203.628504 secs 2023-05-08T09:54:25.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22203.628504 secs 2023-05-08T09:54:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:26 smithi096 ceph-mon[124666]: pgmap v11899: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 175 KiB/s wr, 9 op/s 2023-05-08T09:54:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:26 smithi186 ceph-mon[126480]: pgmap v11899: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 175 KiB/s wr, 9 op/s 2023-05-08T09:54:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:26 smithi133 ceph-mon[125939]: pgmap v11899: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 175 KiB/s wr, 9 op/s 2023-05-08T09:54:27.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:27 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22204.915595 secs 2023-05-08T09:54:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:27 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22204.915595 secs 2023-05-08T09:54:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:27 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22204.915595 secs 2023-05-08T09:54:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:28 smithi186 ceph-mon[126480]: pgmap v11900: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:54:28.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:28 smithi133 ceph-mon[125939]: pgmap v11900: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:54:28.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:28 smithi096 ceph-mon[124666]: pgmap v11900: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:54:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22208.073086 secs 2023-05-08T09:54:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22208.073086 secs 2023-05-08T09:54:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22208.073086 secs 2023-05-08T09:54:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:30 smithi186 ceph-mon[126480]: pgmap v11901: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:54:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22208.628596 secs 2023-05-08T09:54:30.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:30 smithi133 ceph-mon[125939]: pgmap v11901: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:54:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22208.628596 secs 2023-05-08T09:54:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:30 smithi096 ceph-mon[124666]: pgmap v11901: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:54:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22208.628596 secs 2023-05-08T09:54:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:32 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22209.915713 secs 2023-05-08T09:54:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:32 smithi186 ceph-mon[126480]: pgmap v11902: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 767 B/s wr, 8 op/s 2023-05-08T09:54:32.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:32 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22209.915713 secs 2023-05-08T09:54:32.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:32 smithi133 ceph-mon[125939]: pgmap v11902: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 767 B/s wr, 8 op/s 2023-05-08T09:54:32.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:32 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22209.915713 secs 2023-05-08T09:54:32.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:32 smithi096 ceph-mon[124666]: pgmap v11902: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 767 B/s wr, 8 op/s 2023-05-08T09:54:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:34 smithi186 ceph-mon[126480]: pgmap v11903: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 767 B/s wr, 5 op/s 2023-05-08T09:54:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22213.073257 secs 2023-05-08T09:54:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:34 smithi133 ceph-mon[125939]: pgmap v11903: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 767 B/s wr, 5 op/s 2023-05-08T09:54:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22213.073257 secs 2023-05-08T09:54:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:34 smithi096 ceph-mon[124666]: pgmap v11903: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 767 B/s wr, 5 op/s 2023-05-08T09:54:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22213.073257 secs 2023-05-08T09:54:35.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22213.628678 secs 2023-05-08T09:54:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22213.628678 secs 2023-05-08T09:54:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22213.628678 secs 2023-05-08T09:54:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:36 smithi186 ceph-mon[126480]: pgmap v11904: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 161 KiB/s wr, 9 op/s 2023-05-08T09:54:36.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:36 smithi133 ceph-mon[125939]: pgmap v11904: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 161 KiB/s wr, 9 op/s 2023-05-08T09:54:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:36 smithi096 ceph-mon[124666]: pgmap v11904: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 161 KiB/s wr, 9 op/s 2023-05-08T09:54:37.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:37 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22214.915837 secs 2023-05-08T09:54:37.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:37 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22214.915837 secs 2023-05-08T09:54:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:37 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22214.915837 secs 2023-05-08T09:54:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:38 smithi186 ceph-mon[126480]: pgmap v11905: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 161 KiB/s wr, 6 op/s 2023-05-08T09:54:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:54:38.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:38 smithi133 ceph-mon[125939]: pgmap v11905: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 161 KiB/s wr, 6 op/s 2023-05-08T09:54:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:54:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:38 smithi096 ceph-mon[124666]: pgmap v11905: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 161 KiB/s wr, 6 op/s 2023-05-08T09:54:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:54:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:54:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:54:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:54:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22218.073339 secs 2023-05-08T09:54:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:54:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:54:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:54:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22218.073339 secs 2023-05-08T09:54:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:54:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:54:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:54:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22218.073339 secs 2023-05-08T09:54:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:40 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:54:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:40 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T09:54:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:40 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T09:54:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:40 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:54:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:40 smithi186 ceph-mon[126480]: pgmap v11906: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 161 KiB/s wr, 6 op/s 2023-05-08T09:54:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22218.628821 secs 2023-05-08T09:54:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:40 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:54:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:40 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T09:54:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:40 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T09:54:40.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:40 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:54:40.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:40 smithi133 ceph-mon[125939]: pgmap v11906: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 161 KiB/s wr, 6 op/s 2023-05-08T09:54:40.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22218.628821 secs 2023-05-08T09:54:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:40 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:54:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:40 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T09:54:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:40 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T09:54:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:40 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:54:40.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:40 smithi096 ceph-mon[124666]: pgmap v11906: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 161 KiB/s wr, 6 op/s 2023-05-08T09:54:40.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22218.628821 secs 2023-05-08T09:54:42.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:42 smithi186 ceph-mon[126480]: pgmap v11907: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 162 KiB/s wr, 9 op/s 2023-05-08T09:54:42.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:42 smithi133 ceph-mon[125939]: pgmap v11907: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 162 KiB/s wr, 9 op/s 2023-05-08T09:54:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:42 smithi096 ceph-mon[124666]: pgmap v11907: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 162 KiB/s wr, 9 op/s 2023-05-08T09:54:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:44 smithi186 ceph-mon[126480]: pgmap v11908: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 161 KiB/s wr, 6 op/s 2023-05-08T09:54:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22223.073475 secs 2023-05-08T09:54:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:44 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:54:44.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:44 smithi133 ceph-mon[125939]: pgmap v11908: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 161 KiB/s wr, 6 op/s 2023-05-08T09:54:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22223.073475 secs 2023-05-08T09:54:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:44 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:54:44.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:44 smithi096 ceph-mon[124666]: pgmap v11908: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 161 KiB/s wr, 6 op/s 2023-05-08T09:54:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22223.073475 secs 2023-05-08T09:54:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:44 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:54:45.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22223.628940 secs 2023-05-08T09:54:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:45 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:54:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:45 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:54:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:45 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:54:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22223.628940 secs 2023-05-08T09:54:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:45 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:54:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:45 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:54:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:45 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:54:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22223.628940 secs 2023-05-08T09:54:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:45 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:54:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:45 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:54:45.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:45 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:54:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:46 smithi186 ceph-mon[126480]: pgmap v11909: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 372 KiB/s wr, 10 op/s 2023-05-08T09:54:46.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:46 smithi133 ceph-mon[125939]: pgmap v11909: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 372 KiB/s wr, 10 op/s 2023-05-08T09:54:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:46 smithi096 ceph-mon[124666]: pgmap v11909: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 372 KiB/s wr, 10 op/s 2023-05-08T09:54:48.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:48 smithi186 ceph-mon[126480]: pgmap v11910: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 211 KiB/s wr, 6 op/s 2023-05-08T09:54:48.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:48 smithi133 ceph-mon[125939]: pgmap v11910: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 211 KiB/s wr, 6 op/s 2023-05-08T09:54:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:48 smithi096 ceph-mon[124666]: pgmap v11910: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 211 KiB/s wr, 6 op/s 2023-05-08T09:54:49.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22228.073577 secs 2023-05-08T09:54:49.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22228.073577 secs 2023-05-08T09:54:49.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22228.073577 secs 2023-05-08T09:54:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:50 smithi186 ceph-mon[126480]: pgmap v11911: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 211 KiB/s wr, 6 op/s 2023-05-08T09:54:50.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:50 smithi133 ceph-mon[125939]: pgmap v11911: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 211 KiB/s wr, 6 op/s 2023-05-08T09:54:50.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:50 smithi096 ceph-mon[124666]: pgmap v11911: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 211 KiB/s wr, 6 op/s 2023-05-08T09:54:52.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:52 smithi186 ceph-mon[126480]: pgmap v11912: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 502 KiB/s rd, 496 KiB/s wr, 11 op/s 2023-05-08T09:54:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:54:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:52 smithi133 ceph-mon[125939]: pgmap v11912: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 502 KiB/s rd, 496 KiB/s wr, 11 op/s 2023-05-08T09:54:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:54:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:52 smithi096 ceph-mon[124666]: pgmap v11912: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 502 KiB/s rd, 496 KiB/s wr, 11 op/s 2023-05-08T09:54:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:54:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:53 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:54:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:54:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:54:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:53 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:54:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:54:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:54:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:53 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:54:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:54:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:54:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:54 smithi186 ceph-mon[126480]: pgmap v11913: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 496 KiB/s wr, 8 op/s 2023-05-08T09:54:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22233.073714 secs 2023-05-08T09:54:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:54 smithi133 ceph-mon[125939]: pgmap v11913: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 496 KiB/s wr, 8 op/s 2023-05-08T09:54:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22233.073714 secs 2023-05-08T09:54:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:54 smithi096 ceph-mon[124666]: pgmap v11913: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 496 KiB/s wr, 8 op/s 2023-05-08T09:54:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22233.073714 secs 2023-05-08T09:54:55.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22233.629182 secs 2023-05-08T09:54:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22233.629182 secs 2023-05-08T09:54:55.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22233.629182 secs 2023-05-08T09:54:56.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:56 smithi186 ceph-mon[126480]: pgmap v11914: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 861 KiB/s rd, 845 KiB/s wr, 14 op/s 2023-05-08T09:54:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:56 smithi133 ceph-mon[125939]: pgmap v11914: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 861 KiB/s rd, 845 KiB/s wr, 14 op/s 2023-05-08T09:54:56.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:56 smithi096 ceph-mon[124666]: pgmap v11914: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 861 KiB/s rd, 845 KiB/s wr, 14 op/s 2023-05-08T09:54:57.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:57 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22234.916284 secs 2023-05-08T09:54:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:54:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:54:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:54:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:57 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22234.916284 secs 2023-05-08T09:54:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:54:57.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:54:57.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:54:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:57 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22234.916284 secs 2023-05-08T09:54:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:54:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:54:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:54:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:58 smithi186 ceph-mon[126480]: pgmap v11915: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 646 KiB/s rd, 634 KiB/s wr, 10 op/s 2023-05-08T09:54:58.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:58 smithi133 ceph-mon[125939]: pgmap v11915: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 646 KiB/s rd, 634 KiB/s wr, 10 op/s 2023-05-08T09:54:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:58 smithi096 ceph-mon[124666]: pgmap v11915: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 646 KiB/s rd, 634 KiB/s wr, 10 op/s 2023-05-08T09:54:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22238.073815 secs 2023-05-08T09:54:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:54:59 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:54:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22238.073815 secs 2023-05-08T09:54:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:54:59 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:54:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22238.073815 secs 2023-05-08T09:54:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:54:59 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:55:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:00 smithi186 ceph-mon[126480]: pgmap v11916: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 646 KiB/s rd, 634 KiB/s wr, 10 op/s 2023-05-08T09:55:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:00 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:55:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:00 smithi133 ceph-mon[125939]: pgmap v11916: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 646 KiB/s rd, 634 KiB/s wr, 10 op/s 2023-05-08T09:55:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:00 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:55:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:00 smithi096 ceph-mon[124666]: pgmap v11916: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 646 KiB/s rd, 634 KiB/s wr, 10 op/s 2023-05-08T09:55:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:00 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:55:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:55:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:55:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:55:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:55:01.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:55:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:55:02.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:02 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22239.916406 secs 2023-05-08T09:55:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:02 smithi133 ceph-mon[125939]: pgmap v11917: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 676 KiB/s rd, 663 KiB/s wr, 16 op/s 2023-05-08T09:55:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:02 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22239.916406 secs 2023-05-08T09:55:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:02 smithi096 ceph-mon[124666]: pgmap v11917: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 676 KiB/s rd, 663 KiB/s wr, 16 op/s 2023-05-08T09:55:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:02 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22239.916406 secs 2023-05-08T09:55:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:02 smithi186 ceph-mon[126480]: pgmap v11917: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 676 KiB/s rd, 663 KiB/s wr, 16 op/s 2023-05-08T09:55:04.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:04 smithi133 ceph-mon[125939]: pgmap v11918: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 378 KiB/s wr, 11 op/s 2023-05-08T09:55:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22243.073938 secs 2023-05-08T09:55:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:04 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:55:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:04 smithi096 ceph-mon[124666]: pgmap v11918: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 378 KiB/s wr, 11 op/s 2023-05-08T09:55:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22243.073938 secs 2023-05-08T09:55:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:04 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:55:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:04 smithi186 ceph-mon[126480]: pgmap v11918: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 378 KiB/s wr, 11 op/s 2023-05-08T09:55:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22243.073938 secs 2023-05-08T09:55:04.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:04 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:55:05.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22243.629420 secs 2023-05-08T09:55:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22243.629420 secs 2023-05-08T09:55:05.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22243.629420 secs 2023-05-08T09:55:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:06 smithi133 ceph-mon[125939]: pgmap v11919: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 764 KiB/s rd, 787 KiB/s wr, 30 op/s 2023-05-08T09:55:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:06 smithi096 ceph-mon[124666]: pgmap v11919: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 764 KiB/s rd, 787 KiB/s wr, 30 op/s 2023-05-08T09:55:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:06 smithi186 ceph-mon[126480]: pgmap v11919: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 764 KiB/s rd, 787 KiB/s wr, 30 op/s 2023-05-08T09:55:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:07 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22244.916530 secs 2023-05-08T09:55:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:07 smithi133 ceph-mon[125939]: osdmap e822: 12 total, 12 up, 12 in 2023-05-08T09:55:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:07 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22244.916530 secs 2023-05-08T09:55:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:07 smithi096 ceph-mon[124666]: osdmap e822: 12 total, 12 up, 12 in 2023-05-08T09:55:07.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:07 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22244.916530 secs 2023-05-08T09:55:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:07 smithi186 ceph-mon[126480]: osdmap e822: 12 total, 12 up, 12 in 2023-05-08T09:55:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:08 smithi133 ceph-mon[125939]: pgmap v11921: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 485 KiB/s rd, 526 KiB/s wr, 29 op/s 2023-05-08T09:55:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:08 smithi096 ceph-mon[124666]: pgmap v11921: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 485 KiB/s rd, 526 KiB/s wr, 29 op/s 2023-05-08T09:55:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:08 smithi186 ceph-mon[126480]: pgmap v11921: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 485 KiB/s rd, 526 KiB/s wr, 29 op/s 2023-05-08T09:55:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:55:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:55:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22248.074069 secs 2023-05-08T09:55:09.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:09 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:55:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:55:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:55:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22248.074069 secs 2023-05-08T09:55:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:09 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:55:09.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:55:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:55:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22248.074069 secs 2023-05-08T09:55:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:09 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:55:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:10 smithi133 ceph-mon[125939]: pgmap v11922: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 485 KiB/s rd, 526 KiB/s wr, 29 op/s 2023-05-08T09:55:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22248.629539 secs 2023-05-08T09:55:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:10 smithi096 ceph-mon[124666]: pgmap v11922: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 485 KiB/s rd, 526 KiB/s wr, 29 op/s 2023-05-08T09:55:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22248.629539 secs 2023-05-08T09:55:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:10 smithi186 ceph-mon[126480]: pgmap v11922: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 485 KiB/s rd, 526 KiB/s wr, 29 op/s 2023-05-08T09:55:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22248.629539 secs 2023-05-08T09:55:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:12 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22249.916668 secs 2023-05-08T09:55:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:12 smithi133 ceph-mon[125939]: pgmap v11923: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 492 KiB/s wr, 27 op/s 2023-05-08T09:55:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:12 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22249.916668 secs 2023-05-08T09:55:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:12 smithi096 ceph-mon[124666]: pgmap v11923: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 492 KiB/s wr, 27 op/s 2023-05-08T09:55:12.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:12 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22249.916668 secs 2023-05-08T09:55:12.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:12 smithi186 ceph-mon[126480]: pgmap v11923: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 492 KiB/s wr, 27 op/s 2023-05-08T09:55:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:14 smithi133 ceph-mon[125939]: pgmap v11924: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 492 KiB/s wr, 27 op/s 2023-05-08T09:55:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22253.074213 secs 2023-05-08T09:55:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:14 smithi133 ceph-mon[125939]: osdmap e823: 12 total, 12 up, 12 in 2023-05-08T09:55:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:14 smithi096 ceph-mon[124666]: pgmap v11924: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 492 KiB/s wr, 27 op/s 2023-05-08T09:55:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22253.074213 secs 2023-05-08T09:55:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:14 smithi096 ceph-mon[124666]: osdmap e823: 12 total, 12 up, 12 in 2023-05-08T09:55:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:14 smithi186 ceph-mon[126480]: pgmap v11924: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 492 KiB/s wr, 27 op/s 2023-05-08T09:55:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22253.074213 secs 2023-05-08T09:55:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:14 smithi186 ceph-mon[126480]: osdmap e823: 12 total, 12 up, 12 in 2023-05-08T09:55:15.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22253.629642 secs 2023-05-08T09:55:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22253.629642 secs 2023-05-08T09:55:15.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22253.629642 secs 2023-05-08T09:55:16.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:16 smithi133 ceph-mon[125939]: pgmap v11926: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 118 KiB/s wr, 9 op/s 2023-05-08T09:55:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:16 smithi096 ceph-mon[124666]: pgmap v11926: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 118 KiB/s wr, 9 op/s 2023-05-08T09:55:16.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:16 smithi186 ceph-mon[126480]: pgmap v11926: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 118 KiB/s wr, 9 op/s 2023-05-08T09:55:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:17 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22254.916757 secs 2023-05-08T09:55:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:17 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22254.916757 secs 2023-05-08T09:55:17.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:17 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22254.916757 secs 2023-05-08T09:55:18.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:18 smithi133 ceph-mon[125939]: pgmap v11927: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 101 KiB/s wr, 7 op/s 2023-05-08T09:55:18.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:18 smithi096 ceph-mon[124666]: pgmap v11927: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 101 KiB/s wr, 7 op/s 2023-05-08T09:55:18.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:18 smithi186 ceph-mon[126480]: pgmap v11927: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 101 KiB/s wr, 7 op/s 2023-05-08T09:55:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22258.074364 secs 2023-05-08T09:55:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22258.074364 secs 2023-05-08T09:55:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22258.074364 secs 2023-05-08T09:55:20.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:20 smithi133 ceph-mon[125939]: pgmap v11928: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 101 KiB/s wr, 7 op/s 2023-05-08T09:55:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22258.629718 secs 2023-05-08T09:55:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:20 smithi096 ceph-mon[124666]: pgmap v11928: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 101 KiB/s wr, 7 op/s 2023-05-08T09:55:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22258.629718 secs 2023-05-08T09:55:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:20 smithi186 ceph-mon[126480]: pgmap v11928: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 101 KiB/s wr, 7 op/s 2023-05-08T09:55:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22258.629718 secs 2023-05-08T09:55:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22259.916863 secs 2023-05-08T09:55:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22259.916863 secs 2023-05-08T09:55:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22259.916863 secs 2023-05-08T09:55:22.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:22 smithi133 ceph-mon[125939]: pgmap v11929: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 100 KiB/s wr, 6 op/s 2023-05-08T09:55:22.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:22 smithi096 ceph-mon[124666]: pgmap v11929: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 100 KiB/s wr, 6 op/s 2023-05-08T09:55:22.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:22 smithi186 ceph-mon[126480]: pgmap v11929: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 100 KiB/s wr, 6 op/s 2023-05-08T09:55:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:24 smithi133 ceph-mon[125939]: pgmap v11930: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 100 KiB/s wr, 6 op/s 2023-05-08T09:55:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22263.074445 secs 2023-05-08T09:55:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:24 smithi096 ceph-mon[124666]: pgmap v11930: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 100 KiB/s wr, 6 op/s 2023-05-08T09:55:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22263.074445 secs 2023-05-08T09:55:24.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:24 smithi186 ceph-mon[126480]: pgmap v11930: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 100 KiB/s wr, 6 op/s 2023-05-08T09:55:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22263.074445 secs 2023-05-08T09:55:25.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22263.629812 secs 2023-05-08T09:55:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22263.629812 secs 2023-05-08T09:55:25.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22263.629812 secs 2023-05-08T09:55:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:26 smithi133 ceph-mon[125939]: pgmap v11931: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 168 KiB/s wr, 8 op/s 2023-05-08T09:55:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22264.916984 secs 2023-05-08T09:55:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:26 smithi096 ceph-mon[124666]: pgmap v11931: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 168 KiB/s wr, 8 op/s 2023-05-08T09:55:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22264.916984 secs 2023-05-08T09:55:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:26 smithi186 ceph-mon[126480]: pgmap v11931: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 168 KiB/s wr, 8 op/s 2023-05-08T09:55:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22264.916984 secs 2023-05-08T09:55:28.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:28 smithi133 ceph-mon[125939]: pgmap v11932: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 70 KiB/s wr, 5 op/s 2023-05-08T09:55:28.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:28 smithi096 ceph-mon[124666]: pgmap v11932: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 70 KiB/s wr, 5 op/s 2023-05-08T09:55:28.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:28 smithi186 ceph-mon[126480]: pgmap v11932: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 70 KiB/s wr, 5 op/s 2023-05-08T09:55:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22268.074555 secs 2023-05-08T09:55:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22268.074555 secs 2023-05-08T09:55:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22268.074555 secs 2023-05-08T09:55:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:30 smithi133 ceph-mon[125939]: pgmap v11933: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 70 KiB/s wr, 5 op/s 2023-05-08T09:55:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22268.629944 secs 2023-05-08T09:55:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:30 smithi096 ceph-mon[124666]: pgmap v11933: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 70 KiB/s wr, 5 op/s 2023-05-08T09:55:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22268.629944 secs 2023-05-08T09:55:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:30 smithi186 ceph-mon[126480]: pgmap v11933: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 70 KiB/s wr, 5 op/s 2023-05-08T09:55:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22268.629944 secs 2023-05-08T09:55:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22269.917101 secs 2023-05-08T09:55:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22269.917101 secs 2023-05-08T09:55:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22269.917101 secs 2023-05-08T09:55:32.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:32 smithi133 ceph-mon[125939]: pgmap v11934: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 71 KiB/s wr, 8 op/s 2023-05-08T09:55:32.533 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:32 smithi096 ceph-mon[124666]: pgmap v11934: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 71 KiB/s wr, 8 op/s 2023-05-08T09:55:32.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:32 smithi186 ceph-mon[126480]: pgmap v11934: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 71 KiB/s wr, 8 op/s 2023-05-08T09:55:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:34 smithi133 ceph-mon[125939]: pgmap v11935: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 71 KiB/s wr, 6 op/s 2023-05-08T09:55:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22273.074657 secs 2023-05-08T09:55:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:34 smithi096 ceph-mon[124666]: pgmap v11935: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 71 KiB/s wr, 6 op/s 2023-05-08T09:55:34.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22273.074657 secs 2023-05-08T09:55:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:34 smithi186 ceph-mon[126480]: pgmap v11935: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 71 KiB/s wr, 6 op/s 2023-05-08T09:55:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22273.074657 secs 2023-05-08T09:55:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22273.630069 secs 2023-05-08T09:55:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22273.630069 secs 2023-05-08T09:55:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22273.630069 secs 2023-05-08T09:55:36.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:36 smithi133 ceph-mon[125939]: pgmap v11936: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 272 KiB/s wr, 9 op/s 2023-05-08T09:55:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22274.917217 secs 2023-05-08T09:55:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:36 smithi096 ceph-mon[124666]: pgmap v11936: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 272 KiB/s wr, 9 op/s 2023-05-08T09:55:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22274.917217 secs 2023-05-08T09:55:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:36 smithi186 ceph-mon[126480]: pgmap v11936: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 272 KiB/s wr, 9 op/s 2023-05-08T09:55:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22274.917217 secs 2023-05-08T09:55:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:37 smithi096 ceph-mon[124666]: pgmap v11937: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 202 KiB/s wr, 6 op/s 2023-05-08T09:55:37.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:37 smithi186 ceph-mon[126480]: pgmap v11937: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 202 KiB/s wr, 6 op/s 2023-05-08T09:55:37.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:37 smithi133 ceph-mon[125939]: pgmap v11937: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 202 KiB/s wr, 6 op/s 2023-05-08T09:55:38.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:55:38.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:55:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:55:39.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22278.074752 secs 2023-05-08T09:55:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:39 smithi133 ceph-mon[125939]: pgmap v11938: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 202 KiB/s wr, 6 op/s 2023-05-08T09:55:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:55:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:55:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:39 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:55:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:55:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:39 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T09:55:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:39 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T09:55:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:39 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:55:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22278.074752 secs 2023-05-08T09:55:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:39 smithi096 ceph-mon[124666]: pgmap v11938: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 202 KiB/s wr, 6 op/s 2023-05-08T09:55:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:55:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:55:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:39 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:55:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:55:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:39 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T09:55:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:39 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T09:55:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:39 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:55:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22278.074752 secs 2023-05-08T09:55:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:39 smithi186 ceph-mon[126480]: pgmap v11938: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 202 KiB/s wr, 6 op/s 2023-05-08T09:55:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:55:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:55:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:39 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:55:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:55:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:39 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T09:55:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:39 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T09:55:39.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:39 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:55:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22278.630210 secs 2023-05-08T09:55:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22278.630210 secs 2023-05-08T09:55:41.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22278.630210 secs 2023-05-08T09:55:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:41 smithi133 ceph-mon[125939]: pgmap v11939: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 202 KiB/s wr, 10 op/s 2023-05-08T09:55:42.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:41 smithi096 ceph-mon[124666]: pgmap v11939: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 202 KiB/s wr, 10 op/s 2023-05-08T09:55:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:41 smithi186 ceph-mon[126480]: pgmap v11939: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 202 KiB/s wr, 10 op/s 2023-05-08T09:55:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:43 smithi133 ceph-mon[125939]: pgmap v11940: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 202 KiB/s wr, 7 op/s 2023-05-08T09:55:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22283.074885 secs 2023-05-08T09:55:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:55:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:43 smithi096 ceph-mon[124666]: pgmap v11940: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 202 KiB/s wr, 7 op/s 2023-05-08T09:55:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22283.074885 secs 2023-05-08T09:55:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:55:44.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:43 smithi186 ceph-mon[126480]: pgmap v11940: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 202 KiB/s wr, 7 op/s 2023-05-08T09:55:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22283.074885 secs 2023-05-08T09:55:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:55:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:55:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:55:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:55:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:55:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:55:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:55:45.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:55:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:55:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:55:45.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22283.630333 secs 2023-05-08T09:55:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:45 smithi133 ceph-mon[125939]: pgmap v11941: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 277 KiB/s wr, 10 op/s 2023-05-08T09:55:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22283.630333 secs 2023-05-08T09:55:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:45 smithi096 ceph-mon[124666]: pgmap v11941: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 277 KiB/s wr, 10 op/s 2023-05-08T09:55:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22283.630333 secs 2023-05-08T09:55:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:45 smithi186 ceph-mon[126480]: pgmap v11941: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 277 KiB/s wr, 10 op/s 2023-05-08T09:55:47.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:47 smithi133 ceph-mon[125939]: pgmap v11942: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 75 KiB/s wr, 6 op/s 2023-05-08T09:55:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:47 smithi096 ceph-mon[124666]: pgmap v11942: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 75 KiB/s wr, 6 op/s 2023-05-08T09:55:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:47 smithi186 ceph-mon[126480]: pgmap v11942: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 75 KiB/s wr, 6 op/s 2023-05-08T09:55:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22288.075023 secs 2023-05-08T09:55:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22288.075023 secs 2023-05-08T09:55:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22288.075023 secs 2023-05-08T09:55:49.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:49 smithi133 ceph-mon[125939]: pgmap v11943: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 75 KiB/s wr, 6 op/s 2023-05-08T09:55:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:49 smithi096 ceph-mon[124666]: pgmap v11943: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 75 KiB/s wr, 6 op/s 2023-05-08T09:55:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:49 smithi186 ceph-mon[126480]: pgmap v11943: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 75 KiB/s wr, 6 op/s 2023-05-08T09:55:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22289.917532 secs 2023-05-08T09:55:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:51 smithi133 ceph-mon[125939]: pgmap v11944: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 494 KiB/s rd, 338 KiB/s wr, 10 op/s 2023-05-08T09:55:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:55:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22289.917532 secs 2023-05-08T09:55:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:51 smithi096 ceph-mon[124666]: pgmap v11944: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 494 KiB/s rd, 338 KiB/s wr, 10 op/s 2023-05-08T09:55:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:55:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22289.917532 secs 2023-05-08T09:55:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:51 smithi186 ceph-mon[126480]: pgmap v11944: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 494 KiB/s rd, 338 KiB/s wr, 10 op/s 2023-05-08T09:55:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:55:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:55:53.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:55:53.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:55:53.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:55:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:55:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:55:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:55:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:55:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:55:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:53 smithi096 ceph-mon[124666]: pgmap v11945: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 337 KiB/s wr, 7 op/s 2023-05-08T09:55:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22293.075169 secs 2023-05-08T09:55:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:53 smithi186 ceph-mon[126480]: pgmap v11945: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 337 KiB/s wr, 7 op/s 2023-05-08T09:55:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22293.075169 secs 2023-05-08T09:55:54.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:53 smithi133 ceph-mon[125939]: pgmap v11945: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 337 KiB/s wr, 7 op/s 2023-05-08T09:55:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22293.075169 secs 2023-05-08T09:55:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22293.630530 secs 2023-05-08T09:55:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:55 smithi096 ceph-mon[124666]: pgmap v11946: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 528 KiB/s wr, 13 op/s 2023-05-08T09:55:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22293.630530 secs 2023-05-08T09:55:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:55 smithi186 ceph-mon[126480]: pgmap v11946: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 528 KiB/s wr, 13 op/s 2023-05-08T09:55:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22293.630530 secs 2023-05-08T09:55:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:55 smithi133 ceph-mon[125939]: pgmap v11946: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 528 KiB/s wr, 13 op/s 2023-05-08T09:55:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22294.917680 secs 2023-05-08T09:55:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:56 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:55:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:55:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:55:57.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22294.917680 secs 2023-05-08T09:55:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:56 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:55:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:55:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:55:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22294.917680 secs 2023-05-08T09:55:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:56 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:55:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:55:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:55:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:57 smithi186 ceph-mon[126480]: pgmap v11947: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 453 KiB/s wr, 10 op/s 2023-05-08T09:55:58.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:57 smithi133 ceph-mon[125939]: pgmap v11947: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 453 KiB/s wr, 10 op/s 2023-05-08T09:55:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:57 smithi096 ceph-mon[124666]: pgmap v11947: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 453 KiB/s wr, 10 op/s 2023-05-08T09:55:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22298.075312 secs 2023-05-08T09:55:59.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22298.075312 secs 2023-05-08T09:55:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22298.075312 secs 2023-05-08T09:56:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:59 smithi186 ceph-mon[126480]: pgmap v11948: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 453 KiB/s wr, 10 op/s 2023-05-08T09:56:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:55:59 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:56:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:59 smithi133 ceph-mon[125939]: pgmap v11948: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 453 KiB/s wr, 10 op/s 2023-05-08T09:56:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:55:59 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:56:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:59 smithi096 ceph-mon[124666]: pgmap v11948: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 453 KiB/s wr, 10 op/s 2023-05-08T09:56:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:55:59 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:56:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:56:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:56:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22299.917814 secs 2023-05-08T09:56:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:56:01.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:56:01.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22299.917814 secs 2023-05-08T09:56:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:56:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:56:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22299.917814 secs 2023-05-08T09:56:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:01 smithi186 ceph-mon[126480]: pgmap v11949: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 644 KiB/s rd, 632 KiB/s wr, 16 op/s 2023-05-08T09:56:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:01 smithi133 ceph-mon[125939]: pgmap v11949: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 644 KiB/s rd, 632 KiB/s wr, 16 op/s 2023-05-08T09:56:02.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:01 smithi096 ceph-mon[124666]: pgmap v11949: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 644 KiB/s rd, 632 KiB/s wr, 16 op/s 2023-05-08T09:56:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:03 smithi186 ceph-mon[126480]: pgmap v11950: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 381 KiB/s rd, 369 KiB/s wr, 11 op/s 2023-05-08T09:56:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22303.075409 secs 2023-05-08T09:56:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:03 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:56:04.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:03 smithi133 ceph-mon[125939]: pgmap v11950: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 381 KiB/s rd, 369 KiB/s wr, 11 op/s 2023-05-08T09:56:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22303.075409 secs 2023-05-08T09:56:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:03 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:56:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:03 smithi096 ceph-mon[124666]: pgmap v11950: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 381 KiB/s rd, 369 KiB/s wr, 11 op/s 2023-05-08T09:56:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22303.075409 secs 2023-05-08T09:56:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:03 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:56:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22303.630760 secs 2023-05-08T09:56:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:05 smithi186 ceph-mon[126480]: pgmap v11951: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 595 KiB/s wr, 31 op/s 2023-05-08T09:56:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22304.917927 secs 2023-05-08T09:56:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22303.630760 secs 2023-05-08T09:56:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:05 smithi133 ceph-mon[125939]: pgmap v11951: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 595 KiB/s wr, 31 op/s 2023-05-08T09:56:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22304.917927 secs 2023-05-08T09:56:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22303.630760 secs 2023-05-08T09:56:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:05 smithi096 ceph-mon[124666]: pgmap v11951: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 595 KiB/s wr, 31 op/s 2023-05-08T09:56:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22304.917927 secs 2023-05-08T09:56:07.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:06 smithi186 ceph-mon[126480]: osdmap e824: 12 total, 12 up, 12 in 2023-05-08T09:56:07.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:06 smithi133 ceph-mon[125939]: osdmap e824: 12 total, 12 up, 12 in 2023-05-08T09:56:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:06 smithi096 ceph-mon[124666]: osdmap e824: 12 total, 12 up, 12 in 2023-05-08T09:56:08.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:07 smithi186 ceph-mon[126480]: pgmap v11953: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 512 KiB/s wr, 30 op/s 2023-05-08T09:56:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:07 smithi133 ceph-mon[125939]: pgmap v11953: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 512 KiB/s wr, 30 op/s 2023-05-08T09:56:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:07 smithi096 ceph-mon[124666]: pgmap v11953: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 512 KiB/s wr, 30 op/s 2023-05-08T09:56:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:56:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:56:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22308.075484 secs 2023-05-08T09:56:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:08 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:56:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:56:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:56:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22308.075484 secs 2023-05-08T09:56:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:08 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:56:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:56:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:56:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22308.075484 secs 2023-05-08T09:56:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:08 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:56:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:09 smithi186 ceph-mon[126480]: pgmap v11954: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 512 KiB/s wr, 30 op/s 2023-05-08T09:56:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:09 smithi133 ceph-mon[125939]: pgmap v11954: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 512 KiB/s wr, 30 op/s 2023-05-08T09:56:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:09 smithi096 ceph-mon[124666]: pgmap v11954: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 512 KiB/s wr, 30 op/s 2023-05-08T09:56:11.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22308.630865 secs 2023-05-08T09:56:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22309.918063 secs 2023-05-08T09:56:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22308.630865 secs 2023-05-08T09:56:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22309.918063 secs 2023-05-08T09:56:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22308.630865 secs 2023-05-08T09:56:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22309.918063 secs 2023-05-08T09:56:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:11 smithi186 ceph-mon[126480]: pgmap v11955: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 482 KiB/s rd, 523 KiB/s wr, 28 op/s 2023-05-08T09:56:12.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:11 smithi133 ceph-mon[125939]: pgmap v11955: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 482 KiB/s rd, 523 KiB/s wr, 28 op/s 2023-05-08T09:56:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:11 smithi096 ceph-mon[124666]: pgmap v11955: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 482 KiB/s rd, 523 KiB/s wr, 28 op/s 2023-05-08T09:56:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:13 smithi186 ceph-mon[126480]: pgmap v11956: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 482 KiB/s rd, 523 KiB/s wr, 28 op/s 2023-05-08T09:56:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22313.075548 secs 2023-05-08T09:56:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:13 smithi186 ceph-mon[126480]: osdmap e825: 12 total, 12 up, 12 in 2023-05-08T09:56:14.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:13 smithi133 ceph-mon[125939]: pgmap v11956: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 482 KiB/s rd, 523 KiB/s wr, 28 op/s 2023-05-08T09:56:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22313.075548 secs 2023-05-08T09:56:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:13 smithi133 ceph-mon[125939]: osdmap e825: 12 total, 12 up, 12 in 2023-05-08T09:56:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:13 smithi096 ceph-mon[124666]: pgmap v11956: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 482 KiB/s rd, 523 KiB/s wr, 28 op/s 2023-05-08T09:56:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22313.075548 secs 2023-05-08T09:56:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:13 smithi096 ceph-mon[124666]: osdmap e825: 12 total, 12 up, 12 in 2023-05-08T09:56:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22313.630957 secs 2023-05-08T09:56:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:15 smithi186 ceph-mon[126480]: pgmap v11958: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 252 KiB/s wr, 9 op/s 2023-05-08T09:56:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22314.918179 secs 2023-05-08T09:56:16.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22313.630957 secs 2023-05-08T09:56:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:15 smithi133 ceph-mon[125939]: pgmap v11958: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 252 KiB/s wr, 9 op/s 2023-05-08T09:56:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22314.918179 secs 2023-05-08T09:56:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22313.630957 secs 2023-05-08T09:56:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:15 smithi096 ceph-mon[124666]: pgmap v11958: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 252 KiB/s wr, 9 op/s 2023-05-08T09:56:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22314.918179 secs 2023-05-08T09:56:18.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:17 smithi186 ceph-mon[126480]: pgmap v11959: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 282 KiB/s wr, 8 op/s 2023-05-08T09:56:18.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:17 smithi133 ceph-mon[125939]: pgmap v11959: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 282 KiB/s wr, 8 op/s 2023-05-08T09:56:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:17 smithi096 ceph-mon[124666]: pgmap v11959: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 282 KiB/s wr, 8 op/s 2023-05-08T09:56:19.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22318.075629 secs 2023-05-08T09:56:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22318.075629 secs 2023-05-08T09:56:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22318.075629 secs 2023-05-08T09:56:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:19 smithi186 ceph-mon[126480]: pgmap v11960: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 282 KiB/s wr, 8 op/s 2023-05-08T09:56:20.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:19 smithi133 ceph-mon[125939]: pgmap v11960: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 282 KiB/s wr, 8 op/s 2023-05-08T09:56:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:19 smithi096 ceph-mon[124666]: pgmap v11960: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 282 KiB/s wr, 8 op/s 2023-05-08T09:56:21.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22318.631047 secs 2023-05-08T09:56:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22319.918312 secs 2023-05-08T09:56:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22318.631047 secs 2023-05-08T09:56:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22319.918312 secs 2023-05-08T09:56:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22318.631047 secs 2023-05-08T09:56:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22319.918312 secs 2023-05-08T09:56:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:21 smithi186 ceph-mon[126480]: pgmap v11961: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 6 op/s 2023-05-08T09:56:22.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:21 smithi133 ceph-mon[125939]: pgmap v11961: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 6 op/s 2023-05-08T09:56:22.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:21 smithi096 ceph-mon[124666]: pgmap v11961: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 6 op/s 2023-05-08T09:56:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:23 smithi186 ceph-mon[126480]: pgmap v11962: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 6 op/s 2023-05-08T09:56:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22323.075749 secs 2023-05-08T09:56:24.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:23 smithi133 ceph-mon[125939]: pgmap v11962: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 6 op/s 2023-05-08T09:56:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22323.075749 secs 2023-05-08T09:56:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:23 smithi096 ceph-mon[124666]: pgmap v11962: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 6 op/s 2023-05-08T09:56:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22323.075749 secs 2023-05-08T09:56:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22323.631143 secs 2023-05-08T09:56:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:25 smithi186 ceph-mon[126480]: pgmap v11963: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 52 KiB/s wr, 8 op/s 2023-05-08T09:56:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22324.918430 secs 2023-05-08T09:56:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22323.631143 secs 2023-05-08T09:56:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:25 smithi133 ceph-mon[125939]: pgmap v11963: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 52 KiB/s wr, 8 op/s 2023-05-08T09:56:26.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22324.918430 secs 2023-05-08T09:56:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22323.631143 secs 2023-05-08T09:56:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:25 smithi096 ceph-mon[124666]: pgmap v11963: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 52 KiB/s wr, 8 op/s 2023-05-08T09:56:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22324.918430 secs 2023-05-08T09:56:28.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:27 smithi186 ceph-mon[126480]: pgmap v11964: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 48 KiB/s wr, 5 op/s 2023-05-08T09:56:28.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:27 smithi133 ceph-mon[125939]: pgmap v11964: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 48 KiB/s wr, 5 op/s 2023-05-08T09:56:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:27 smithi096 ceph-mon[124666]: pgmap v11964: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 48 KiB/s wr, 5 op/s 2023-05-08T09:56:29.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22328.075900 secs 2023-05-08T09:56:29.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22328.075900 secs 2023-05-08T09:56:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22328.075900 secs 2023-05-08T09:56:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:29 smithi186 ceph-mon[126480]: pgmap v11965: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:56:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:29 smithi133 ceph-mon[125939]: pgmap v11965: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:56:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:29 smithi096 ceph-mon[124666]: pgmap v11965: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T09:56:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22328.631278 secs 2023-05-08T09:56:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22329.918568 secs 2023-05-08T09:56:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22328.631278 secs 2023-05-08T09:56:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22329.918568 secs 2023-05-08T09:56:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22328.631278 secs 2023-05-08T09:56:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22329.918568 secs 2023-05-08T09:56:32.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:31 smithi133 ceph-mon[125939]: pgmap v11966: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 72 KiB/s wr, 8 op/s 2023-05-08T09:56:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:31 smithi096 ceph-mon[124666]: pgmap v11966: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 72 KiB/s wr, 8 op/s 2023-05-08T09:56:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:31 smithi186 ceph-mon[126480]: pgmap v11966: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 72 KiB/s wr, 8 op/s 2023-05-08T09:56:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:33 smithi133 ceph-mon[125939]: pgmap v11967: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 72 KiB/s wr, 5 op/s 2023-05-08T09:56:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22333.076039 secs 2023-05-08T09:56:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:33 smithi096 ceph-mon[124666]: pgmap v11967: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 72 KiB/s wr, 5 op/s 2023-05-08T09:56:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22333.076039 secs 2023-05-08T09:56:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:33 smithi186 ceph-mon[126480]: pgmap v11967: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 72 KiB/s wr, 5 op/s 2023-05-08T09:56:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22333.076039 secs 2023-05-08T09:56:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22333.631424 secs 2023-05-08T09:56:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:35 smithi133 ceph-mon[125939]: pgmap v11968: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 87 KiB/s wr, 8 op/s 2023-05-08T09:56:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22334.918681 secs 2023-05-08T09:56:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22333.631424 secs 2023-05-08T09:56:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:35 smithi096 ceph-mon[124666]: pgmap v11968: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 87 KiB/s wr, 8 op/s 2023-05-08T09:56:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22334.918681 secs 2023-05-08T09:56:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22333.631424 secs 2023-05-08T09:56:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:35 smithi186 ceph-mon[126480]: pgmap v11968: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 87 KiB/s wr, 8 op/s 2023-05-08T09:56:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22334.918681 secs 2023-05-08T09:56:38.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:37 smithi133 ceph-mon[125939]: pgmap v11969: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 149 KiB/s wr, 7 op/s 2023-05-08T09:56:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:37 smithi096 ceph-mon[124666]: pgmap v11969: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 149 KiB/s wr, 7 op/s 2023-05-08T09:56:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:37 smithi186 ceph-mon[126480]: pgmap v11969: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 149 KiB/s wr, 7 op/s 2023-05-08T09:56:39.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22338.076147 secs 2023-05-08T09:56:39.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22338.076147 secs 2023-05-08T09:56:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22338.076147 secs 2023-05-08T09:56:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:39 smithi133 ceph-mon[125939]: pgmap v11970: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 149 KiB/s wr, 6 op/s 2023-05-08T09:56:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22338.631545 secs 2023-05-08T09:56:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:56:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:56:40.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:56:40.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:56:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:39 smithi096 ceph-mon[124666]: pgmap v11970: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 149 KiB/s wr, 6 op/s 2023-05-08T09:56:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22338.631545 secs 2023-05-08T09:56:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:56:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:56:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:56:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:56:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:39 smithi186 ceph-mon[126480]: pgmap v11970: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 149 KiB/s wr, 6 op/s 2023-05-08T09:56:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22338.631545 secs 2023-05-08T09:56:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:56:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:56:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:56:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:56:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:40 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:56:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:40 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T09:56:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:40 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T09:56:41.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:40 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:56:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:40 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:56:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:40 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T09:56:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:40 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T09:56:41.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:40 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:56:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:40 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:56:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:40 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T09:56:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:40 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T09:56:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:40 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:56:42.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:41 smithi133 ceph-mon[125939]: pgmap v11971: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 149 KiB/s wr, 10 op/s 2023-05-08T09:56:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:41 smithi096 ceph-mon[124666]: pgmap v11971: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 149 KiB/s wr, 10 op/s 2023-05-08T09:56:42.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:41 smithi186 ceph-mon[126480]: pgmap v11971: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 149 KiB/s wr, 10 op/s 2023-05-08T09:56:44.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:43 smithi133 ceph-mon[125939]: pgmap v11972: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 77 KiB/s wr, 6 op/s 2023-05-08T09:56:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22343.076284 secs 2023-05-08T09:56:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:56:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:43 smithi096 ceph-mon[124666]: pgmap v11972: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 77 KiB/s wr, 6 op/s 2023-05-08T09:56:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22343.076284 secs 2023-05-08T09:56:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:56:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:43 smithi186 ceph-mon[126480]: pgmap v11972: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 77 KiB/s wr, 6 op/s 2023-05-08T09:56:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22343.076284 secs 2023-05-08T09:56:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:56:45.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:56:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:56:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:56:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22343.631616 secs 2023-05-08T09:56:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:56:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:56:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:56:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22343.631616 secs 2023-05-08T09:56:45.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:56:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:56:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:56:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22343.631616 secs 2023-05-08T09:56:46.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:45 smithi133 ceph-mon[125939]: pgmap v11973: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 230 KiB/s wr, 9 op/s 2023-05-08T09:56:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:45 smithi096 ceph-mon[124666]: pgmap v11973: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 230 KiB/s wr, 9 op/s 2023-05-08T09:56:46.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:45 smithi186 ceph-mon[126480]: pgmap v11973: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 230 KiB/s wr, 9 op/s 2023-05-08T09:56:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:47 smithi133 ceph-mon[125939]: pgmap v11974: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 215 KiB/s wr, 7 op/s 2023-05-08T09:56:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:47 smithi096 ceph-mon[124666]: pgmap v11974: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 215 KiB/s wr, 7 op/s 2023-05-08T09:56:48.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:47 smithi186 ceph-mon[126480]: pgmap v11974: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 215 KiB/s wr, 7 op/s 2023-05-08T09:56:49.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22348.076402 secs 2023-05-08T09:56:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22348.076402 secs 2023-05-08T09:56:49.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22348.076402 secs 2023-05-08T09:56:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:49 smithi133 ceph-mon[125939]: pgmap v11975: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 153 KiB/s wr, 6 op/s 2023-05-08T09:56:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:49 smithi096 ceph-mon[124666]: pgmap v11975: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 153 KiB/s wr, 6 op/s 2023-05-08T09:56:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:49 smithi186 ceph-mon[126480]: pgmap v11975: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 153 KiB/s wr, 6 op/s 2023-05-08T09:56:52.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:51 smithi133 ceph-mon[125939]: pgmap v11976: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 488 KiB/s wr, 10 op/s 2023-05-08T09:56:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:56:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:51 smithi096 ceph-mon[124666]: pgmap v11976: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 488 KiB/s wr, 10 op/s 2023-05-08T09:56:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:56:52.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:51 smithi186 ceph-mon[126480]: pgmap v11976: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 488 KiB/s wr, 10 op/s 2023-05-08T09:56:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:56:53.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:52 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:56:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:56:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:56:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:52 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:56:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:56:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:56:53.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:52 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:56:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:56:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:56:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:53 smithi133 ceph-mon[125939]: pgmap v11977: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 488 KiB/s wr, 7 op/s 2023-05-08T09:56:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22353.076474 secs 2023-05-08T09:56:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:53 smithi096 ceph-mon[124666]: pgmap v11977: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 488 KiB/s wr, 7 op/s 2023-05-08T09:56:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22353.076474 secs 2023-05-08T09:56:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:53 smithi186 ceph-mon[126480]: pgmap v11977: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 488 KiB/s wr, 7 op/s 2023-05-08T09:56:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22353.076474 secs 2023-05-08T09:56:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22353.631862 secs 2023-05-08T09:56:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22353.631862 secs 2023-05-08T09:56:55.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22353.631862 secs 2023-05-08T09:56:56.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:55 smithi133 ceph-mon[125939]: pgmap v11978: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 843 KiB/s rd, 830 KiB/s wr, 13 op/s 2023-05-08T09:56:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22354.919134 secs 2023-05-08T09:56:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:55 smithi096 ceph-mon[124666]: pgmap v11978: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 843 KiB/s rd, 830 KiB/s wr, 13 op/s 2023-05-08T09:56:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22354.919134 secs 2023-05-08T09:56:56.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:55 smithi186 ceph-mon[126480]: pgmap v11978: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 843 KiB/s rd, 830 KiB/s wr, 13 op/s 2023-05-08T09:56:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22354.919134 secs 2023-05-08T09:56:57.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:56:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:56:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:56:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:56:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:56:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:56:57.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:56:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:56:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:56:58.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:57 smithi133 ceph-mon[125939]: pgmap v11979: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 689 KiB/s rd, 677 KiB/s wr, 9 op/s 2023-05-08T09:56:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:57 smithi096 ceph-mon[124666]: pgmap v11979: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 689 KiB/s rd, 677 KiB/s wr, 9 op/s 2023-05-08T09:56:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:57 smithi186 ceph-mon[126480]: pgmap v11979: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 689 KiB/s rd, 677 KiB/s wr, 9 op/s 2023-05-08T09:56:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22358.076598 secs 2023-05-08T09:56:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:58 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:56:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22358.076598 secs 2023-05-08T09:56:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:58 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:56:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22358.076598 secs 2023-05-08T09:56:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:58 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:57:00.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:59 smithi133 ceph-mon[125939]: pgmap v11980: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 689 KiB/s rd, 677 KiB/s wr, 9 op/s 2023-05-08T09:57:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:56:59 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:57:00.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:59 smithi096 ceph-mon[124666]: pgmap v11980: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 689 KiB/s rd, 677 KiB/s wr, 9 op/s 2023-05-08T09:57:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:56:59 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:57:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:59 smithi186 ceph-mon[126480]: pgmap v11980: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 689 KiB/s rd, 677 KiB/s wr, 9 op/s 2023-05-08T09:57:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:56:59 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:57:01.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:57:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:57:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22359.919275 secs 2023-05-08T09:57:01.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:57:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:57:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22359.919275 secs 2023-05-08T09:57:01.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:57:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:57:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22359.919275 secs 2023-05-08T09:57:02.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:01 smithi133 ceph-mon[125939]: pgmap v11981: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 755 KiB/s rd, 754 KiB/s wr, 15 op/s 2023-05-08T09:57:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:01 smithi096 ceph-mon[124666]: pgmap v11981: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 755 KiB/s rd, 754 KiB/s wr, 15 op/s 2023-05-08T09:57:02.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:01 smithi186 ceph-mon[126480]: pgmap v11981: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 755 KiB/s rd, 754 KiB/s wr, 15 op/s 2023-05-08T09:57:04.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:03 smithi133 ceph-mon[125939]: pgmap v11982: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 419 KiB/s wr, 11 op/s 2023-05-08T09:57:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22363.076748 secs 2023-05-08T09:57:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:03 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:57:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:03 smithi096 ceph-mon[124666]: pgmap v11982: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 419 KiB/s wr, 11 op/s 2023-05-08T09:57:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22363.076748 secs 2023-05-08T09:57:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:03 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:57:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:03 smithi186 ceph-mon[126480]: pgmap v11982: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 419 KiB/s wr, 11 op/s 2023-05-08T09:57:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22363.076748 secs 2023-05-08T09:57:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:03 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:57:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22363.632125 secs 2023-05-08T09:57:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22363.632125 secs 2023-05-08T09:57:05.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22363.632125 secs 2023-05-08T09:57:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:05 smithi096 ceph-mon[124666]: pgmap v11983: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 771 KiB/s rd, 794 KiB/s wr, 30 op/s 2023-05-08T09:57:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22364.919403 secs 2023-05-08T09:57:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:05 smithi186 ceph-mon[126480]: pgmap v11983: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 771 KiB/s rd, 794 KiB/s wr, 30 op/s 2023-05-08T09:57:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22364.919403 secs 2023-05-08T09:57:06.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:05 smithi133 ceph-mon[125939]: pgmap v11983: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 771 KiB/s rd, 794 KiB/s wr, 30 op/s 2023-05-08T09:57:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22364.919403 secs 2023-05-08T09:57:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:07 smithi096 ceph-mon[124666]: osdmap e826: 12 total, 12 up, 12 in 2023-05-08T09:57:07.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:07 smithi186 ceph-mon[126480]: osdmap e826: 12 total, 12 up, 12 in 2023-05-08T09:57:07.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:07 smithi133 ceph-mon[125939]: osdmap e826: 12 total, 12 up, 12 in 2023-05-08T09:57:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:08 smithi186 ceph-mon[126480]: pgmap v11985: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 502 KiB/s rd, 543 KiB/s wr, 29 op/s 2023-05-08T09:57:08.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:08 smithi133 ceph-mon[125939]: pgmap v11985: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 502 KiB/s rd, 543 KiB/s wr, 29 op/s 2023-05-08T09:57:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:08 smithi096 ceph-mon[124666]: pgmap v11985: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 502 KiB/s rd, 543 KiB/s wr, 29 op/s 2023-05-08T09:57:09.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:57:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:57:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22368.076862 secs 2023-05-08T09:57:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:09 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:57:09.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:57:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:57:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22368.076862 secs 2023-05-08T09:57:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:09 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:57:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:57:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:57:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22368.076862 secs 2023-05-08T09:57:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:09 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:57:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:10 smithi186 ceph-mon[126480]: pgmap v11986: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 502 KiB/s rd, 543 KiB/s wr, 29 op/s 2023-05-08T09:57:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22368.632189 secs 2023-05-08T09:57:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:10 smithi133 ceph-mon[125939]: pgmap v11986: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 502 KiB/s rd, 543 KiB/s wr, 29 op/s 2023-05-08T09:57:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22368.632189 secs 2023-05-08T09:57:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:10 smithi096 ceph-mon[124666]: pgmap v11986: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 502 KiB/s rd, 543 KiB/s wr, 29 op/s 2023-05-08T09:57:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22368.632189 secs 2023-05-08T09:57:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22369.919474 secs 2023-05-08T09:57:11.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22369.919474 secs 2023-05-08T09:57:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22369.919474 secs 2023-05-08T09:57:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:12 smithi186 ceph-mon[126480]: pgmap v11987: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 469 KiB/s rd, 496 KiB/s wr, 27 op/s 2023-05-08T09:57:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:12 smithi133 ceph-mon[125939]: pgmap v11987: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 469 KiB/s rd, 496 KiB/s wr, 27 op/s 2023-05-08T09:57:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:12 smithi096 ceph-mon[124666]: pgmap v11987: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 469 KiB/s rd, 496 KiB/s wr, 27 op/s 2023-05-08T09:57:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:14 smithi186 ceph-mon[126480]: pgmap v11988: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 469 KiB/s rd, 496 KiB/s wr, 27 op/s 2023-05-08T09:57:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22373.076984 secs 2023-05-08T09:57:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:14 smithi186 ceph-mon[126480]: osdmap e827: 12 total, 12 up, 12 in 2023-05-08T09:57:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:14 smithi133 ceph-mon[125939]: pgmap v11988: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 469 KiB/s rd, 496 KiB/s wr, 27 op/s 2023-05-08T09:57:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22373.076984 secs 2023-05-08T09:57:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:14 smithi133 ceph-mon[125939]: osdmap e827: 12 total, 12 up, 12 in 2023-05-08T09:57:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:14 smithi096 ceph-mon[124666]: pgmap v11988: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 469 KiB/s rd, 496 KiB/s wr, 27 op/s 2023-05-08T09:57:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22373.076984 secs 2023-05-08T09:57:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:14 smithi096 ceph-mon[124666]: osdmap e827: 12 total, 12 up, 12 in 2023-05-08T09:57:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22373.632283 secs 2023-05-08T09:57:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22373.632283 secs 2023-05-08T09:57:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22373.632283 secs 2023-05-08T09:57:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:16 smithi186 ceph-mon[126480]: pgmap v11990: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 168 KiB/s wr, 9 op/s 2023-05-08T09:57:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22374.919595 secs 2023-05-08T09:57:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:16 smithi133 ceph-mon[125939]: pgmap v11990: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 168 KiB/s wr, 9 op/s 2023-05-08T09:57:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22374.919595 secs 2023-05-08T09:57:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:16 smithi096 ceph-mon[124666]: pgmap v11990: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 168 KiB/s wr, 9 op/s 2023-05-08T09:57:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22374.919595 secs 2023-05-08T09:57:18.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:18 smithi186 ceph-mon[126480]: pgmap v11991: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 147 KiB/s wr, 7 op/s 2023-05-08T09:57:18.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:18 smithi133 ceph-mon[125939]: pgmap v11991: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 147 KiB/s wr, 7 op/s 2023-05-08T09:57:18.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:18 smithi096 ceph-mon[124666]: pgmap v11991: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 147 KiB/s wr, 7 op/s 2023-05-08T09:57:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22378.077109 secs 2023-05-08T09:57:19.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22378.077109 secs 2023-05-08T09:57:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22378.077109 secs 2023-05-08T09:57:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:20 smithi186 ceph-mon[126480]: pgmap v11992: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 147 KiB/s wr, 7 op/s 2023-05-08T09:57:20.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22378.632381 secs 2023-05-08T09:57:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:20 smithi133 ceph-mon[125939]: pgmap v11992: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 147 KiB/s wr, 7 op/s 2023-05-08T09:57:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22378.632381 secs 2023-05-08T09:57:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:20 smithi096 ceph-mon[124666]: pgmap v11992: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 147 KiB/s wr, 7 op/s 2023-05-08T09:57:20.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22378.632381 secs 2023-05-08T09:57:21.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22379.919709 secs 2023-05-08T09:57:21.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22379.919709 secs 2023-05-08T09:57:21.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22379.919709 secs 2023-05-08T09:57:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:22 smithi186 ceph-mon[126480]: pgmap v11993: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 101 KiB/s wr, 6 op/s 2023-05-08T09:57:22.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:22 smithi133 ceph-mon[125939]: pgmap v11993: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 101 KiB/s wr, 6 op/s 2023-05-08T09:57:22.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:22 smithi096 ceph-mon[124666]: pgmap v11993: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 101 KiB/s wr, 6 op/s 2023-05-08T09:57:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:24 smithi186 ceph-mon[126480]: pgmap v11994: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 101 KiB/s wr, 6 op/s 2023-05-08T09:57:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22383.077245 secs 2023-05-08T09:57:24.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:24 smithi133 ceph-mon[125939]: pgmap v11994: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 101 KiB/s wr, 6 op/s 2023-05-08T09:57:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22383.077245 secs 2023-05-08T09:57:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:24 smithi096 ceph-mon[124666]: pgmap v11994: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 101 KiB/s wr, 6 op/s 2023-05-08T09:57:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22383.077245 secs 2023-05-08T09:57:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22383.632516 secs 2023-05-08T09:57:25.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22383.632516 secs 2023-05-08T09:57:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22383.632516 secs 2023-05-08T09:57:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:26 smithi186 ceph-mon[126480]: pgmap v11995: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 157 KiB/s wr, 8 op/s 2023-05-08T09:57:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22384.919851 secs 2023-05-08T09:57:26.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:26 smithi133 ceph-mon[125939]: pgmap v11995: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 157 KiB/s wr, 8 op/s 2023-05-08T09:57:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22384.919851 secs 2023-05-08T09:57:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:26 smithi096 ceph-mon[124666]: pgmap v11995: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 157 KiB/s wr, 8 op/s 2023-05-08T09:57:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22384.919851 secs 2023-05-08T09:57:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:28 smithi186 ceph-mon[126480]: pgmap v11996: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 60 KiB/s wr, 5 op/s 2023-05-08T09:57:28.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:28 smithi133 ceph-mon[125939]: pgmap v11996: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 60 KiB/s wr, 5 op/s 2023-05-08T09:57:28.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:28 smithi096 ceph-mon[124666]: pgmap v11996: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 60 KiB/s wr, 5 op/s 2023-05-08T09:57:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22388.077360 secs 2023-05-08T09:57:29.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22388.077360 secs 2023-05-08T09:57:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22388.077360 secs 2023-05-08T09:57:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:30 smithi186 ceph-mon[126480]: pgmap v11997: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 60 KiB/s wr, 5 op/s 2023-05-08T09:57:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22388.632656 secs 2023-05-08T09:57:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:30 smithi133 ceph-mon[125939]: pgmap v11997: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 60 KiB/s wr, 5 op/s 2023-05-08T09:57:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22388.632656 secs 2023-05-08T09:57:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:30 smithi096 ceph-mon[124666]: pgmap v11997: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 60 KiB/s wr, 5 op/s 2023-05-08T09:57:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22388.632656 secs 2023-05-08T09:57:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22389.919972 secs 2023-05-08T09:57:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22389.919972 secs 2023-05-08T09:57:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22389.919972 secs 2023-05-08T09:57:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:32 smithi186 ceph-mon[126480]: pgmap v11998: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 60 KiB/s wr, 8 op/s 2023-05-08T09:57:32.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:32 smithi133 ceph-mon[125939]: pgmap v11998: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 60 KiB/s wr, 8 op/s 2023-05-08T09:57:32.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:32 smithi096 ceph-mon[124666]: pgmap v11998: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 60 KiB/s wr, 8 op/s 2023-05-08T09:57:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:34 smithi186 ceph-mon[126480]: pgmap v11999: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 60 KiB/s wr, 5 op/s 2023-05-08T09:57:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22393.077482 secs 2023-05-08T09:57:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:34 smithi133 ceph-mon[125939]: pgmap v11999: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 60 KiB/s wr, 5 op/s 2023-05-08T09:57:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22393.077482 secs 2023-05-08T09:57:34.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:34 smithi096 ceph-mon[124666]: pgmap v11999: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 60 KiB/s wr, 5 op/s 2023-05-08T09:57:34.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22393.077482 secs 2023-05-08T09:57:35.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22393.632769 secs 2023-05-08T09:57:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22393.632769 secs 2023-05-08T09:57:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22393.632769 secs 2023-05-08T09:57:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:36 smithi186 ceph-mon[126480]: pgmap v12000: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 137 KiB/s wr, 9 op/s 2023-05-08T09:57:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22394.920094 secs 2023-05-08T09:57:36.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:36 smithi133 ceph-mon[125939]: pgmap v12000: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 137 KiB/s wr, 9 op/s 2023-05-08T09:57:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22394.920094 secs 2023-05-08T09:57:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:36 smithi096 ceph-mon[124666]: pgmap v12000: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 137 KiB/s wr, 9 op/s 2023-05-08T09:57:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22394.920094 secs 2023-05-08T09:57:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:38 smithi186 ceph-mon[126480]: pgmap v12001: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 77 KiB/s wr, 6 op/s 2023-05-08T09:57:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:38 smithi133 ceph-mon[125939]: pgmap v12001: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 77 KiB/s wr, 6 op/s 2023-05-08T09:57:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:38 smithi096 ceph-mon[124666]: pgmap v12001: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 77 KiB/s wr, 6 op/s 2023-05-08T09:57:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22398.077571 secs 2023-05-08T09:57:39.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22398.077571 secs 2023-05-08T09:57:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22398.077571 secs 2023-05-08T09:57:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:40 smithi186 ceph-mon[126480]: pgmap v12002: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 77 KiB/s wr, 6 op/s 2023-05-08T09:57:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22398.632915 secs 2023-05-08T09:57:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:40 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:57:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:40 smithi133 ceph-mon[125939]: pgmap v12002: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 77 KiB/s wr, 6 op/s 2023-05-08T09:57:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22398.632915 secs 2023-05-08T09:57:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:40 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:57:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:40 smithi096 ceph-mon[124666]: pgmap v12002: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 77 KiB/s wr, 6 op/s 2023-05-08T09:57:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22398.632915 secs 2023-05-08T09:57:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:40 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:57:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:57:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:57:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:57:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:57:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:57:41.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:57:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:57:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:57:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:57:42.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:42 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:57:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:42 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T09:57:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:42 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T09:57:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:42 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:57:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:42 smithi186 ceph-mon[126480]: pgmap v12003: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 78 KiB/s wr, 9 op/s 2023-05-08T09:57:42.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:42 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:57:42.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:42 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T09:57:42.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:42 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T09:57:42.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:42 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:57:42.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:42 smithi133 ceph-mon[125939]: pgmap v12003: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 78 KiB/s wr, 9 op/s 2023-05-08T09:57:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:42 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:57:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:42 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T09:57:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:42 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T09:57:42.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:42 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:57:42.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:42 smithi096 ceph-mon[124666]: pgmap v12003: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 78 KiB/s wr, 9 op/s 2023-05-08T09:57:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:44 smithi186 ceph-mon[126480]: pgmap v12004: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 77 KiB/s wr, 6 op/s 2023-05-08T09:57:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22403.077688 secs 2023-05-08T09:57:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:44 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:57:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:44 smithi133 ceph-mon[125939]: pgmap v12004: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 77 KiB/s wr, 6 op/s 2023-05-08T09:57:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22403.077688 secs 2023-05-08T09:57:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:44 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:57:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:44 smithi096 ceph-mon[124666]: pgmap v12004: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 77 KiB/s wr, 6 op/s 2023-05-08T09:57:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22403.077688 secs 2023-05-08T09:57:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:44 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:57:45.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22403.633051 secs 2023-05-08T09:57:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:45 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:57:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:45 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:57:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:45 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:57:45.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22403.633051 secs 2023-05-08T09:57:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:45 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:57:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:45 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:57:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:45 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:57:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22403.633051 secs 2023-05-08T09:57:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:45 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:57:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:45 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:57:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:45 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:57:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:46 smithi133 ceph-mon[125939]: pgmap v12005: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 231 KiB/s wr, 10 op/s 2023-05-08T09:57:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:46 smithi096 ceph-mon[124666]: pgmap v12005: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 231 KiB/s wr, 10 op/s 2023-05-08T09:57:46.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:46 smithi186 ceph-mon[126480]: pgmap v12005: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 231 KiB/s wr, 10 op/s 2023-05-08T09:57:48.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:48 smithi133 ceph-mon[125939]: pgmap v12006: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 154 KiB/s wr, 7 op/s 2023-05-08T09:57:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:48 smithi096 ceph-mon[124666]: pgmap v12006: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 154 KiB/s wr, 7 op/s 2023-05-08T09:57:48.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:48 smithi186 ceph-mon[126480]: pgmap v12006: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 154 KiB/s wr, 7 op/s 2023-05-08T09:57:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22408.077808 secs 2023-05-08T09:57:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22408.077808 secs 2023-05-08T09:57:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22408.077808 secs 2023-05-08T09:57:50.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:50 smithi133 ceph-mon[125939]: pgmap v12007: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 154 KiB/s wr, 7 op/s 2023-05-08T09:57:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:50 smithi096 ceph-mon[124666]: pgmap v12007: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 154 KiB/s wr, 7 op/s 2023-05-08T09:57:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:50 smithi186 ceph-mon[126480]: pgmap v12007: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 154 KiB/s wr, 7 op/s 2023-05-08T09:57:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:52 smithi133 ceph-mon[125939]: pgmap v12008: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 348 KiB/s rd, 269 KiB/s wr, 11 op/s 2023-05-08T09:57:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:57:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:52 smithi096 ceph-mon[124666]: pgmap v12008: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 348 KiB/s rd, 269 KiB/s wr, 11 op/s 2023-05-08T09:57:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:57:52.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:52 smithi186 ceph-mon[126480]: pgmap v12008: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 348 KiB/s rd, 269 KiB/s wr, 11 op/s 2023-05-08T09:57:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:57:53.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:53 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:57:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:57:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:57:53.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:53 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:57:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:57:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:57:53.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:53 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:57:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:57:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:57:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:54 smithi133 ceph-mon[125939]: pgmap v12009: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 269 KiB/s wr, 7 op/s 2023-05-08T09:57:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22413.077947 secs 2023-05-08T09:57:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:54 smithi096 ceph-mon[124666]: pgmap v12009: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 269 KiB/s wr, 7 op/s 2023-05-08T09:57:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22413.077947 secs 2023-05-08T09:57:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:54 smithi186 ceph-mon[126480]: pgmap v12009: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 269 KiB/s wr, 7 op/s 2023-05-08T09:57:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22413.077947 secs 2023-05-08T09:57:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22413.633271 secs 2023-05-08T09:57:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22413.633271 secs 2023-05-08T09:57:55.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22413.633271 secs 2023-05-08T09:57:56.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:56 smithi133 ceph-mon[125939]: pgmap v12010: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 561 KiB/s rd, 540 KiB/s wr, 13 op/s 2023-05-08T09:57:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22414.920534 secs 2023-05-08T09:57:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:56 smithi096 ceph-mon[124666]: pgmap v12010: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 561 KiB/s rd, 540 KiB/s wr, 13 op/s 2023-05-08T09:57:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22414.920534 secs 2023-05-08T09:57:56.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:56 smithi186 ceph-mon[126480]: pgmap v12010: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 561 KiB/s rd, 540 KiB/s wr, 13 op/s 2023-05-08T09:57:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22414.920534 secs 2023-05-08T09:57:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:57:57.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:57:57.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:57:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:57:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:57:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:57:57.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:57:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:57:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:57:58.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:58 smithi133 ceph-mon[125939]: pgmap v12011: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 386 KiB/s wr, 10 op/s 2023-05-08T09:57:58.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:58 smithi096 ceph-mon[124666]: pgmap v12011: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 386 KiB/s wr, 10 op/s 2023-05-08T09:57:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:58 smithi186 ceph-mon[126480]: pgmap v12011: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 386 KiB/s wr, 10 op/s 2023-05-08T09:57:59.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22418.078037 secs 2023-05-08T09:57:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:57:59 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:57:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22418.078037 secs 2023-05-08T09:57:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:57:59 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:57:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22418.078037 secs 2023-05-08T09:57:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:57:59 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:58:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:00 smithi133 ceph-mon[125939]: pgmap v12012: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 386 KiB/s wr, 10 op/s 2023-05-08T09:58:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:00 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:58:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:00 smithi096 ceph-mon[124666]: pgmap v12012: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 386 KiB/s wr, 10 op/s 2023-05-08T09:58:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:00 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:58:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:00 smithi186 ceph-mon[126480]: pgmap v12012: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 386 KiB/s wr, 10 op/s 2023-05-08T09:58:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:00 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:58:01.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22419.920631 secs 2023-05-08T09:58:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:58:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:58:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22419.920631 secs 2023-05-08T09:58:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:58:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:58:01.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22419.920631 secs 2023-05-08T09:58:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:58:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:58:02.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:02 smithi133 ceph-mon[125939]: pgmap v12013: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 496 KiB/s rd, 487 KiB/s wr, 15 op/s 2023-05-08T09:58:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:02 smithi096 ceph-mon[124666]: pgmap v12013: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 496 KiB/s rd, 487 KiB/s wr, 15 op/s 2023-05-08T09:58:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:02 smithi186 ceph-mon[126480]: pgmap v12013: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 496 KiB/s rd, 487 KiB/s wr, 15 op/s 2023-05-08T09:58:04.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:04 smithi133 ceph-mon[125939]: pgmap v12014: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 381 KiB/s rd, 373 KiB/s wr, 11 op/s 2023-05-08T09:58:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22423.078136 secs 2023-05-08T09:58:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:04 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:58:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:04 smithi096 ceph-mon[124666]: pgmap v12014: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 381 KiB/s rd, 373 KiB/s wr, 11 op/s 2023-05-08T09:58:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22423.078136 secs 2023-05-08T09:58:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:04 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:58:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:04 smithi186 ceph-mon[126480]: pgmap v12014: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 381 KiB/s rd, 373 KiB/s wr, 11 op/s 2023-05-08T09:58:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22423.078136 secs 2023-05-08T09:58:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:04 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:58:05.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22423.633511 secs 2023-05-08T09:58:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22423.633511 secs 2023-05-08T09:58:05.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22423.633511 secs 2023-05-08T09:58:06.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:06 smithi133 ceph-mon[125939]: pgmap v12015: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 663 KiB/s rd, 678 KiB/s wr, 30 op/s 2023-05-08T09:58:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22424.920748 secs 2023-05-08T09:58:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:06 smithi133 ceph-mon[125939]: osdmap e828: 12 total, 12 up, 12 in 2023-05-08T09:58:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:06 smithi096 ceph-mon[124666]: pgmap v12015: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 663 KiB/s rd, 678 KiB/s wr, 30 op/s 2023-05-08T09:58:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22424.920748 secs 2023-05-08T09:58:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:06 smithi096 ceph-mon[124666]: osdmap e828: 12 total, 12 up, 12 in 2023-05-08T09:58:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:06 smithi186 ceph-mon[126480]: pgmap v12015: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 663 KiB/s rd, 678 KiB/s wr, 30 op/s 2023-05-08T09:58:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22424.920748 secs 2023-05-08T09:58:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:06 smithi186 ceph-mon[126480]: osdmap e828: 12 total, 12 up, 12 in 2023-05-08T09:58:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:08 smithi133 ceph-mon[125939]: pgmap v12017: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 489 KiB/s wr, 29 op/s 2023-05-08T09:58:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:08 smithi096 ceph-mon[124666]: pgmap v12017: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 489 KiB/s wr, 29 op/s 2023-05-08T09:58:08.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:08 smithi186 ceph-mon[126480]: pgmap v12017: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 489 KiB/s wr, 29 op/s 2023-05-08T09:58:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:58:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:58:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22428.078271 secs 2023-05-08T09:58:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:09 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:58:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:58:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:58:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22428.078271 secs 2023-05-08T09:58:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:09 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:58:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:58:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:58:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22428.078271 secs 2023-05-08T09:58:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:09 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:58:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:10 smithi133 ceph-mon[125939]: pgmap v12018: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 489 KiB/s wr, 29 op/s 2023-05-08T09:58:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22428.633627 secs 2023-05-08T09:58:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22429.920866 secs 2023-05-08T09:58:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:10 smithi096 ceph-mon[124666]: pgmap v12018: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 489 KiB/s wr, 29 op/s 2023-05-08T09:58:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22428.633627 secs 2023-05-08T09:58:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22429.920866 secs 2023-05-08T09:58:10.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:10 smithi186 ceph-mon[126480]: pgmap v12018: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 489 KiB/s wr, 29 op/s 2023-05-08T09:58:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22428.633627 secs 2023-05-08T09:58:10.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22429.920866 secs 2023-05-08T09:58:12.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:12 smithi133 ceph-mon[125939]: pgmap v12019: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 427 KiB/s rd, 454 KiB/s wr, 28 op/s 2023-05-08T09:58:12.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:12 smithi096 ceph-mon[124666]: pgmap v12019: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 427 KiB/s rd, 454 KiB/s wr, 28 op/s 2023-05-08T09:58:12.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:12 smithi186 ceph-mon[126480]: pgmap v12019: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 427 KiB/s rd, 454 KiB/s wr, 28 op/s 2023-05-08T09:58:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:14 smithi133 ceph-mon[125939]: pgmap v12020: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 427 KiB/s rd, 454 KiB/s wr, 28 op/s 2023-05-08T09:58:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22433.078387 secs 2023-05-08T09:58:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:14 smithi133 ceph-mon[125939]: osdmap e829: 12 total, 12 up, 12 in 2023-05-08T09:58:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:14 smithi096 ceph-mon[124666]: pgmap v12020: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 427 KiB/s rd, 454 KiB/s wr, 28 op/s 2023-05-08T09:58:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22433.078387 secs 2023-05-08T09:58:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:14 smithi096 ceph-mon[124666]: osdmap e829: 12 total, 12 up, 12 in 2023-05-08T09:58:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:14 smithi186 ceph-mon[126480]: pgmap v12020: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 427 KiB/s rd, 454 KiB/s wr, 28 op/s 2023-05-08T09:58:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22433.078387 secs 2023-05-08T09:58:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:14 smithi186 ceph-mon[126480]: osdmap e829: 12 total, 12 up, 12 in 2023-05-08T09:58:15.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22433.633745 secs 2023-05-08T09:58:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22434.920997 secs 2023-05-08T09:58:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22433.633745 secs 2023-05-08T09:58:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22434.920997 secs 2023-05-08T09:58:15.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22433.633745 secs 2023-05-08T09:58:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22434.920997 secs 2023-05-08T09:58:16.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:16 smithi133 ceph-mon[125939]: pgmap v12022: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 168 KiB/s wr, 9 op/s 2023-05-08T09:58:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:16 smithi096 ceph-mon[124666]: pgmap v12022: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 168 KiB/s wr, 9 op/s 2023-05-08T09:58:16.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:16 smithi186 ceph-mon[126480]: pgmap v12022: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 168 KiB/s wr, 9 op/s 2023-05-08T09:58:18.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:18 smithi096 ceph-mon[124666]: pgmap v12023: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 160 KiB/s wr, 8 op/s 2023-05-08T09:58:18.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:18 smithi186 ceph-mon[126480]: pgmap v12023: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 160 KiB/s wr, 8 op/s 2023-05-08T09:58:18.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:18 smithi133 ceph-mon[125939]: pgmap v12023: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 160 KiB/s wr, 8 op/s 2023-05-08T09:58:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22438.078442 secs 2023-05-08T09:58:19.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22438.078442 secs 2023-05-08T09:58:19.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22438.078442 secs 2023-05-08T09:58:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:20 smithi096 ceph-mon[124666]: pgmap v12024: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 160 KiB/s wr, 8 op/s 2023-05-08T09:58:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22438.633893 secs 2023-05-08T09:58:20.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22439.921121 secs 2023-05-08T09:58:20.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:20 smithi186 ceph-mon[126480]: pgmap v12024: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 160 KiB/s wr, 8 op/s 2023-05-08T09:58:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22438.633893 secs 2023-05-08T09:58:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22439.921121 secs 2023-05-08T09:58:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:20 smithi133 ceph-mon[125939]: pgmap v12024: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 160 KiB/s wr, 8 op/s 2023-05-08T09:58:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22438.633893 secs 2023-05-08T09:58:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22439.921121 secs 2023-05-08T09:58:22.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:22 smithi096 ceph-mon[124666]: pgmap v12025: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 224 KiB/s wr, 7 op/s 2023-05-08T09:58:22.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:22 smithi186 ceph-mon[126480]: pgmap v12025: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 224 KiB/s wr, 7 op/s 2023-05-08T09:58:22.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:22 smithi133 ceph-mon[125939]: pgmap v12025: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 224 KiB/s wr, 7 op/s 2023-05-08T09:58:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:24 smithi096 ceph-mon[124666]: pgmap v12026: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 224 KiB/s wr, 7 op/s 2023-05-08T09:58:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22443.078542 secs 2023-05-08T09:58:24.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:24 smithi186 ceph-mon[126480]: pgmap v12026: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 224 KiB/s wr, 7 op/s 2023-05-08T09:58:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22443.078542 secs 2023-05-08T09:58:24.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:24 smithi133 ceph-mon[125939]: pgmap v12026: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 224 KiB/s wr, 7 op/s 2023-05-08T09:58:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22443.078542 secs 2023-05-08T09:58:25.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22443.634027 secs 2023-05-08T09:58:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22444.921230 secs 2023-05-08T09:58:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22443.634027 secs 2023-05-08T09:58:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22444.921230 secs 2023-05-08T09:58:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22443.634027 secs 2023-05-08T09:58:25.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22444.921230 secs 2023-05-08T09:58:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:26 smithi186 ceph-mon[126480]: pgmap v12027: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 204 KiB/s wr, 10 op/s 2023-05-08T09:58:26.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:26 smithi133 ceph-mon[125939]: pgmap v12027: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 204 KiB/s wr, 10 op/s 2023-05-08T09:58:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:26 smithi096 ceph-mon[124666]: pgmap v12027: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 204 KiB/s wr, 10 op/s 2023-05-08T09:58:27.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:27 smithi186 ceph-mon[126480]: pgmap v12028: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 127 KiB/s wr, 5 op/s 2023-05-08T09:58:27.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:27 smithi133 ceph-mon[125939]: pgmap v12028: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 127 KiB/s wr, 5 op/s 2023-05-08T09:58:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:27 smithi096 ceph-mon[124666]: pgmap v12028: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 127 KiB/s wr, 5 op/s 2023-05-08T09:58:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22448.078664 secs 2023-05-08T09:58:28.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22448.078664 secs 2023-05-08T09:58:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22448.078664 secs 2023-05-08T09:58:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:29 smithi096 ceph-mon[124666]: pgmap v12029: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 127 KiB/s wr, 5 op/s 2023-05-08T09:58:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:29 smithi186 ceph-mon[126480]: pgmap v12029: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 127 KiB/s wr, 5 op/s 2023-05-08T09:58:30.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:29 smithi133 ceph-mon[125939]: pgmap v12029: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 127 KiB/s wr, 5 op/s 2023-05-08T09:58:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22448.634149 secs 2023-05-08T09:58:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22449.921375 secs 2023-05-08T09:58:31.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22448.634149 secs 2023-05-08T09:58:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22449.921375 secs 2023-05-08T09:58:31.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22448.634149 secs 2023-05-08T09:58:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22449.921375 secs 2023-05-08T09:58:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:31 smithi096 ceph-mon[124666]: pgmap v12030: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 127 KiB/s wr, 8 op/s 2023-05-08T09:58:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:31 smithi186 ceph-mon[126480]: pgmap v12030: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 127 KiB/s wr, 8 op/s 2023-05-08T09:58:32.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:31 smithi133 ceph-mon[125939]: pgmap v12030: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 127 KiB/s wr, 8 op/s 2023-05-08T09:58:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:33 smithi096 ceph-mon[124666]: pgmap v12031: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T09:58:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22453.078787 secs 2023-05-08T09:58:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:33 smithi186 ceph-mon[126480]: pgmap v12031: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T09:58:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22453.078787 secs 2023-05-08T09:58:34.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:33 smithi133 ceph-mon[125939]: pgmap v12031: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T09:58:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22453.078787 secs 2023-05-08T09:58:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22453.634266 secs 2023-05-08T09:58:36.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:35 smithi096 ceph-mon[124666]: pgmap v12032: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 150 KiB/s wr, 9 op/s 2023-05-08T09:58:36.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22454.921493 secs 2023-05-08T09:58:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22453.634266 secs 2023-05-08T09:58:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:35 smithi186 ceph-mon[126480]: pgmap v12032: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 150 KiB/s wr, 9 op/s 2023-05-08T09:58:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22454.921493 secs 2023-05-08T09:58:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22453.634266 secs 2023-05-08T09:58:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:35 smithi133 ceph-mon[125939]: pgmap v12032: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 150 KiB/s wr, 9 op/s 2023-05-08T09:58:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22454.921493 secs 2023-05-08T09:58:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:37 smithi186 ceph-mon[126480]: pgmap v12033: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 150 KiB/s wr, 6 op/s 2023-05-08T09:58:38.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:37 smithi133 ceph-mon[125939]: pgmap v12033: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 150 KiB/s wr, 6 op/s 2023-05-08T09:58:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:37 smithi096 ceph-mon[124666]: pgmap v12033: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 150 KiB/s wr, 6 op/s 2023-05-08T09:58:39.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22458.078875 secs 2023-05-08T09:58:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22458.078875 secs 2023-05-08T09:58:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22458.078875 secs 2023-05-08T09:58:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:39 smithi186 ceph-mon[126480]: pgmap v12034: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 150 KiB/s wr, 6 op/s 2023-05-08T09:58:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:39 smithi133 ceph-mon[125939]: pgmap v12034: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 150 KiB/s wr, 6 op/s 2023-05-08T09:58:40.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:39 smithi096 ceph-mon[124666]: pgmap v12034: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 150 KiB/s wr, 6 op/s 2023-05-08T09:58:41.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22458.634382 secs 2023-05-08T09:58:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:40 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:58:41.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22458.634382 secs 2023-05-08T09:58:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:40 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:58:41.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22458.634382 secs 2023-05-08T09:58:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:40 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:58:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:41 smithi186 ceph-mon[126480]: pgmap v12035: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 150 KiB/s wr, 9 op/s 2023-05-08T09:58:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:58:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:58:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:58:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:41 smithi133 ceph-mon[125939]: pgmap v12035: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 150 KiB/s wr, 9 op/s 2023-05-08T09:58:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:58:42.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:58:42.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:58:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:41 smithi096 ceph-mon[124666]: pgmap v12035: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 150 KiB/s wr, 9 op/s 2023-05-08T09:58:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:58:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:58:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:58:43.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:42 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:58:43.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:42 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T09:58:43.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:42 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T09:58:43.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:42 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:58:43.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:42 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:58:43.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:42 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T09:58:43.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:42 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T09:58:43.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:42 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:58:43.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:42 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:58:43.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:42 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T09:58:43.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:42 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T09:58:43.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:42 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:58:44.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:43 smithi186 ceph-mon[126480]: pgmap v12036: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 150 KiB/s wr, 6 op/s 2023-05-08T09:58:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22463.079005 secs 2023-05-08T09:58:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:58:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:43 smithi133 ceph-mon[125939]: pgmap v12036: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 150 KiB/s wr, 6 op/s 2023-05-08T09:58:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22463.079005 secs 2023-05-08T09:58:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:58:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:43 smithi096 ceph-mon[124666]: pgmap v12036: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 150 KiB/s wr, 6 op/s 2023-05-08T09:58:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22463.079005 secs 2023-05-08T09:58:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:58:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:58:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:58:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:58:45.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:58:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:58:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:58:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:58:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:58:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:58:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22463.634498 secs 2023-05-08T09:58:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:45 smithi186 ceph-mon[126480]: pgmap v12037: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 226 KiB/s wr, 10 op/s 2023-05-08T09:58:46.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22463.634498 secs 2023-05-08T09:58:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:45 smithi133 ceph-mon[125939]: pgmap v12037: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 226 KiB/s wr, 10 op/s 2023-05-08T09:58:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22463.634498 secs 2023-05-08T09:58:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:45 smithi096 ceph-mon[124666]: pgmap v12037: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 226 KiB/s wr, 10 op/s 2023-05-08T09:58:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:47 smithi186 ceph-mon[126480]: pgmap v12038: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 76 KiB/s wr, 6 op/s 2023-05-08T09:58:48.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:47 smithi133 ceph-mon[125939]: pgmap v12038: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 76 KiB/s wr, 6 op/s 2023-05-08T09:58:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:47 smithi096 ceph-mon[124666]: pgmap v12038: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 76 KiB/s wr, 6 op/s 2023-05-08T09:58:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22468.079111 secs 2023-05-08T09:58:49.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22468.079111 secs 2023-05-08T09:58:49.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22468.079111 secs 2023-05-08T09:58:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:49 smithi186 ceph-mon[126480]: pgmap v12039: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 76 KiB/s wr, 6 op/s 2023-05-08T09:58:50.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:49 smithi133 ceph-mon[125939]: pgmap v12039: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 76 KiB/s wr, 6 op/s 2023-05-08T09:58:50.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:49 smithi096 ceph-mon[124666]: pgmap v12039: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 76 KiB/s wr, 6 op/s 2023-05-08T09:58:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:51 smithi186 ceph-mon[126480]: pgmap v12040: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 727 KiB/s rd, 406 KiB/s wr, 11 op/s 2023-05-08T09:58:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:58:52.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:51 smithi133 ceph-mon[125939]: pgmap v12040: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 727 KiB/s rd, 406 KiB/s wr, 11 op/s 2023-05-08T09:58:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:58:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:51 smithi096 ceph-mon[124666]: pgmap v12040: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 727 KiB/s rd, 406 KiB/s wr, 11 op/s 2023-05-08T09:58:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:58:53.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:52 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:58:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:58:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:58:53.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:52 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:58:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:58:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:58:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:52 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:58:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:58:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:58:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:53 smithi186 ceph-mon[126480]: pgmap v12041: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 649 KiB/s rd, 406 KiB/s wr, 8 op/s 2023-05-08T09:58:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:53 smithi133 ceph-mon[125939]: pgmap v12041: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 649 KiB/s rd, 406 KiB/s wr, 8 op/s 2023-05-08T09:58:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:53 smithi096 ceph-mon[124666]: pgmap v12041: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 649 KiB/s rd, 406 KiB/s wr, 8 op/s 2023-05-08T09:58:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:54 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:58:55.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:54 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:58:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:54 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:58:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22473.634695 secs 2023-05-08T09:58:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:55 smithi186 ceph-mon[126480]: pgmap v12042: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 686 KiB/s wr, 14 op/s 2023-05-08T09:58:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:55 smithi186 ceph-mon[126480]: Health check cleared: MDS_SLOW_REQUEST (was: 1 MDSs report slow requests) 2023-05-08T09:58:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:55 smithi186 ceph-mon[126480]: Cluster is now healthy 2023-05-08T09:58:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:55 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T09:58:56.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:55 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:58:56.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22474.921990 secs 2023-05-08T09:58:56.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22473.634695 secs 2023-05-08T09:58:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:55 smithi133 ceph-mon[125939]: pgmap v12042: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 686 KiB/s wr, 14 op/s 2023-05-08T09:58:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:55 smithi133 ceph-mon[125939]: Health check cleared: MDS_SLOW_REQUEST (was: 1 MDSs report slow requests) 2023-05-08T09:58:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:55 smithi133 ceph-mon[125939]: Cluster is now healthy 2023-05-08T09:58:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:55 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T09:58:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:55 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:58:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22474.921990 secs 2023-05-08T09:58:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22473.634695 secs 2023-05-08T09:58:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:55 smithi096 ceph-mon[124666]: pgmap v12042: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 686 KiB/s wr, 14 op/s 2023-05-08T09:58:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:55 smithi096 ceph-mon[124666]: Health check cleared: MDS_SLOW_REQUEST (was: 1 MDSs report slow requests) 2023-05-08T09:58:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:55 smithi096 ceph-mon[124666]: Cluster is now healthy 2023-05-08T09:58:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:55 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T09:58:56.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:55 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:58:56.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22474.921990 secs 2023-05-08T09:58:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:56 smithi186 ceph-mon[126480]: Health check failed: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:58:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:58:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:58:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:58:57.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:56 smithi133 ceph-mon[125939]: Health check failed: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:58:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:58:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:58:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:58:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:56 smithi096 ceph-mon[124666]: Health check failed: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:58:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:58:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:58:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:58:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:57 smithi186 ceph-mon[126480]: pgmap v12043: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 942 KiB/s rd, 610 KiB/s wr, 10 op/s 2023-05-08T09:58:58.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:57 smithi133 ceph-mon[125939]: pgmap v12043: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 942 KiB/s rd, 610 KiB/s wr, 10 op/s 2023-05-08T09:58:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:57 smithi096 ceph-mon[124666]: pgmap v12043: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 942 KiB/s rd, 610 KiB/s wr, 10 op/s 2023-05-08T09:58:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22478.079359 secs 2023-05-08T09:58:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22478.079359 secs 2023-05-08T09:58:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22478.079359 secs 2023-05-08T09:59:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:59 smithi186 ceph-mon[126480]: pgmap v12044: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 942 KiB/s rd, 610 KiB/s wr, 10 op/s 2023-05-08T09:59:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:59 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T09:59:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:59 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:59:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:58:59 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:59:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:59 smithi133 ceph-mon[125939]: pgmap v12044: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 942 KiB/s rd, 610 KiB/s wr, 10 op/s 2023-05-08T09:59:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:59 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T09:59:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:59 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:59:00.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:58:59 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:59:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:59 smithi096 ceph-mon[124666]: pgmap v12044: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 942 KiB/s rd, 610 KiB/s wr, 10 op/s 2023-05-08T09:59:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:59 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T09:59:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:59 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:59:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:58:59 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:59:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:59:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:59:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22479.922108 secs 2023-05-08T09:59:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:59:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:59:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22479.922108 secs 2023-05-08T09:59:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:59:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:59:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22479.922108 secs 2023-05-08T09:59:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:01 smithi186 ceph-mon[126480]: pgmap v12045: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 714 KiB/s wr, 16 op/s 2023-05-08T09:59:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:01 smithi133 ceph-mon[125939]: pgmap v12045: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 714 KiB/s wr, 16 op/s 2023-05-08T09:59:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:01 smithi096 ceph-mon[124666]: pgmap v12045: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 714 KiB/s wr, 16 op/s 2023-05-08T09:59:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:03 smithi186 ceph-mon[126480]: pgmap v12046: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 588 KiB/s rd, 384 KiB/s wr, 11 op/s 2023-05-08T09:59:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22483.079465 secs 2023-05-08T09:59:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:03 smithi133 ceph-mon[125939]: pgmap v12046: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 588 KiB/s rd, 384 KiB/s wr, 11 op/s 2023-05-08T09:59:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22483.079465 secs 2023-05-08T09:59:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:03 smithi096 ceph-mon[124666]: pgmap v12046: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 588 KiB/s rd, 384 KiB/s wr, 11 op/s 2023-05-08T09:59:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22483.079465 secs 2023-05-08T09:59:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22483.634914 secs 2023-05-08T09:59:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:05 smithi133 ceph-mon[125939]: pgmap v12047: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 969 KiB/s rd, 737 KiB/s wr, 31 op/s 2023-05-08T09:59:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22484.922228 secs 2023-05-08T09:59:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22483.634914 secs 2023-05-08T09:59:06.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:05 smithi096 ceph-mon[124666]: pgmap v12047: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 969 KiB/s rd, 737 KiB/s wr, 31 op/s 2023-05-08T09:59:06.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22484.922228 secs 2023-05-08T09:59:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22483.634914 secs 2023-05-08T09:59:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:05 smithi186 ceph-mon[126480]: pgmap v12047: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 969 KiB/s rd, 737 KiB/s wr, 31 op/s 2023-05-08T09:59:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22484.922228 secs 2023-05-08T09:59:07.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:06 smithi133 ceph-mon[125939]: osdmap e830: 12 total, 12 up, 12 in 2023-05-08T09:59:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:06 smithi096 ceph-mon[124666]: osdmap e830: 12 total, 12 up, 12 in 2023-05-08T09:59:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:06 smithi186 ceph-mon[126480]: osdmap e830: 12 total, 12 up, 12 in 2023-05-08T09:59:08.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:07 smithi133 ceph-mon[125939]: pgmap v12049: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 659 KiB/s rd, 547 KiB/s wr, 29 op/s 2023-05-08T09:59:08.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:07 smithi096 ceph-mon[124666]: pgmap v12049: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 659 KiB/s rd, 547 KiB/s wr, 29 op/s 2023-05-08T09:59:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:07 smithi186 ceph-mon[126480]: pgmap v12049: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 659 KiB/s rd, 547 KiB/s wr, 29 op/s 2023-05-08T09:59:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:08 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:59:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:59:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:59:09.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22488.079539 secs 2023-05-08T09:59:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:08 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:59:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:59:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:59:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22488.079539 secs 2023-05-08T09:59:09.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:08 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:59:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:59:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:59:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22488.079539 secs 2023-05-08T09:59:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:09 smithi133 ceph-mon[125939]: pgmap v12050: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 659 KiB/s rd, 547 KiB/s wr, 29 op/s 2023-05-08T09:59:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:09 smithi096 ceph-mon[124666]: pgmap v12050: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 659 KiB/s rd, 547 KiB/s wr, 29 op/s 2023-05-08T09:59:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:09 smithi186 ceph-mon[126480]: pgmap v12050: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 659 KiB/s rd, 547 KiB/s wr, 29 op/s 2023-05-08T09:59:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22488.635032 secs 2023-05-08T09:59:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22489.922389 secs 2023-05-08T09:59:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22488.635032 secs 2023-05-08T09:59:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22489.922389 secs 2023-05-08T09:59:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22488.635032 secs 2023-05-08T09:59:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22489.922389 secs 2023-05-08T09:59:12.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:11 smithi133 ceph-mon[125939]: pgmap v12051: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 503 KiB/s rd, 469 KiB/s wr, 27 op/s 2023-05-08T09:59:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:11 smithi096 ceph-mon[124666]: pgmap v12051: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 503 KiB/s rd, 469 KiB/s wr, 27 op/s 2023-05-08T09:59:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:11 smithi186 ceph-mon[126480]: pgmap v12051: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 503 KiB/s rd, 469 KiB/s wr, 27 op/s 2023-05-08T09:59:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:13 smithi133 ceph-mon[125939]: pgmap v12052: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 503 KiB/s rd, 469 KiB/s wr, 27 op/s 2023-05-08T09:59:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22493.079673 secs 2023-05-08T09:59:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:13 smithi133 ceph-mon[125939]: osdmap e831: 12 total, 12 up, 12 in 2023-05-08T09:59:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:13 smithi096 ceph-mon[124666]: pgmap v12052: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 503 KiB/s rd, 469 KiB/s wr, 27 op/s 2023-05-08T09:59:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22493.079673 secs 2023-05-08T09:59:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:13 smithi096 ceph-mon[124666]: osdmap e831: 12 total, 12 up, 12 in 2023-05-08T09:59:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:13 smithi186 ceph-mon[126480]: pgmap v12052: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 503 KiB/s rd, 469 KiB/s wr, 27 op/s 2023-05-08T09:59:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22493.079673 secs 2023-05-08T09:59:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:13 smithi186 ceph-mon[126480]: osdmap e831: 12 total, 12 up, 12 in 2023-05-08T09:59:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22493.635153 secs 2023-05-08T09:59:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:15 smithi133 ceph-mon[125939]: pgmap v12054: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 273 KiB/s wr, 9 op/s 2023-05-08T09:59:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22494.922499 secs 2023-05-08T09:59:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22493.635153 secs 2023-05-08T09:59:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:15 smithi096 ceph-mon[124666]: pgmap v12054: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 273 KiB/s wr, 9 op/s 2023-05-08T09:59:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22494.922499 secs 2023-05-08T09:59:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22493.635153 secs 2023-05-08T09:59:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:15 smithi186 ceph-mon[126480]: pgmap v12054: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 273 KiB/s wr, 9 op/s 2023-05-08T09:59:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22494.922499 secs 2023-05-08T09:59:18.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:17 smithi133 ceph-mon[125939]: pgmap v12055: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 242 KiB/s wr, 8 op/s 2023-05-08T09:59:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:17 smithi096 ceph-mon[124666]: pgmap v12055: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 242 KiB/s wr, 8 op/s 2023-05-08T09:59:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:17 smithi186 ceph-mon[126480]: pgmap v12055: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 242 KiB/s wr, 8 op/s 2023-05-08T09:59:19.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22498.079805 secs 2023-05-08T09:59:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22498.079805 secs 2023-05-08T09:59:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22498.079805 secs 2023-05-08T09:59:20.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:19 smithi133 ceph-mon[125939]: pgmap v12056: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 242 KiB/s wr, 8 op/s 2023-05-08T09:59:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22498.635271 secs 2023-05-08T09:59:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:19 smithi096 ceph-mon[124666]: pgmap v12056: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 242 KiB/s wr, 8 op/s 2023-05-08T09:59:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22498.635271 secs 2023-05-08T09:59:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:19 smithi186 ceph-mon[126480]: pgmap v12056: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 242 KiB/s wr, 8 op/s 2023-05-08T09:59:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22498.635271 secs 2023-05-08T09:59:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22499.922627 secs 2023-05-08T09:59:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22499.922627 secs 2023-05-08T09:59:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22499.922627 secs 2023-05-08T09:59:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:21 smithi133 ceph-mon[125939]: pgmap v12057: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 197 KiB/s wr, 7 op/s 2023-05-08T09:59:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:21 smithi096 ceph-mon[124666]: pgmap v12057: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 197 KiB/s wr, 7 op/s 2023-05-08T09:59:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:21 smithi186 ceph-mon[126480]: pgmap v12057: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 197 KiB/s wr, 7 op/s 2023-05-08T09:59:24.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:23 smithi133 ceph-mon[125939]: pgmap v12058: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 197 KiB/s wr, 7 op/s 2023-05-08T09:59:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22503.079920 secs 2023-05-08T09:59:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:23 smithi096 ceph-mon[124666]: pgmap v12058: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 197 KiB/s wr, 7 op/s 2023-05-08T09:59:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22503.079920 secs 2023-05-08T09:59:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:23 smithi186 ceph-mon[126480]: pgmap v12058: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 197 KiB/s wr, 7 op/s 2023-05-08T09:59:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22503.079920 secs 2023-05-08T09:59:25.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22503.635355 secs 2023-05-08T09:59:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22503.635355 secs 2023-05-08T09:59:25.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22503.635355 secs 2023-05-08T09:59:26.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:25 smithi133 ceph-mon[125939]: pgmap v12059: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 245 KiB/s wr, 9 op/s 2023-05-08T09:59:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22504.922767 secs 2023-05-08T09:59:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:25 smithi096 ceph-mon[124666]: pgmap v12059: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 245 KiB/s wr, 9 op/s 2023-05-08T09:59:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22504.922767 secs 2023-05-08T09:59:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:25 smithi186 ceph-mon[126480]: pgmap v12059: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 245 KiB/s wr, 9 op/s 2023-05-08T09:59:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22504.922767 secs 2023-05-08T09:59:28.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:27 smithi133 ceph-mon[125939]: pgmap v12060: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 60 KiB/s wr, 5 op/s 2023-05-08T09:59:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:27 smithi096 ceph-mon[124666]: pgmap v12060: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 60 KiB/s wr, 5 op/s 2023-05-08T09:59:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:27 smithi186 ceph-mon[126480]: pgmap v12060: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 60 KiB/s wr, 5 op/s 2023-05-08T09:59:29.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22508.080037 secs 2023-05-08T09:59:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22508.080037 secs 2023-05-08T09:59:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22508.080037 secs 2023-05-08T09:59:30.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:29 smithi133 ceph-mon[125939]: pgmap v12061: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 60 KiB/s wr, 5 op/s 2023-05-08T09:59:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22508.635499 secs 2023-05-08T09:59:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:29 smithi096 ceph-mon[124666]: pgmap v12061: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 60 KiB/s wr, 5 op/s 2023-05-08T09:59:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22508.635499 secs 2023-05-08T09:59:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:29 smithi186 ceph-mon[126480]: pgmap v12061: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 60 KiB/s wr, 5 op/s 2023-05-08T09:59:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22508.635499 secs 2023-05-08T09:59:31.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22509.922883 secs 2023-05-08T09:59:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22509.922883 secs 2023-05-08T09:59:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22509.922883 secs 2023-05-08T09:59:32.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:31 smithi133 ceph-mon[125939]: pgmap v12062: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 60 KiB/s wr, 7 op/s 2023-05-08T09:59:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:31 smithi096 ceph-mon[124666]: pgmap v12062: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 60 KiB/s wr, 7 op/s 2023-05-08T09:59:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:31 smithi186 ceph-mon[126480]: pgmap v12062: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 60 KiB/s wr, 7 op/s 2023-05-08T09:59:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:33 smithi133 ceph-mon[125939]: pgmap v12063: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 60 KiB/s wr, 5 op/s 2023-05-08T09:59:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22513.080101 secs 2023-05-08T09:59:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:33 smithi096 ceph-mon[124666]: pgmap v12063: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 60 KiB/s wr, 5 op/s 2023-05-08T09:59:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22513.080101 secs 2023-05-08T09:59:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:33 smithi186 ceph-mon[126480]: pgmap v12063: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 60 KiB/s wr, 5 op/s 2023-05-08T09:59:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22513.080101 secs 2023-05-08T09:59:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22513.635618 secs 2023-05-08T09:59:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22513.635618 secs 2023-05-08T09:59:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22513.635618 secs 2023-05-08T09:59:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:35 smithi133 ceph-mon[125939]: pgmap v12064: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 61 KiB/s wr, 8 op/s 2023-05-08T09:59:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22514.923005 secs 2023-05-08T09:59:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:35 smithi096 ceph-mon[124666]: pgmap v12064: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 61 KiB/s wr, 8 op/s 2023-05-08T09:59:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22514.923005 secs 2023-05-08T09:59:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:35 smithi186 ceph-mon[126480]: pgmap v12064: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 61 KiB/s wr, 8 op/s 2023-05-08T09:59:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22514.923005 secs 2023-05-08T09:59:38.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:37 smithi133 ceph-mon[125939]: pgmap v12065: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T09:59:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:37 smithi096 ceph-mon[124666]: pgmap v12065: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T09:59:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:37 smithi186 ceph-mon[126480]: pgmap v12065: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T09:59:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22518.080222 secs 2023-05-08T09:59:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22518.080222 secs 2023-05-08T09:59:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22518.080222 secs 2023-05-08T09:59:40.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:39 smithi133 ceph-mon[125939]: pgmap v12066: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T09:59:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22518.635735 secs 2023-05-08T09:59:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:39 smithi096 ceph-mon[124666]: pgmap v12066: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T09:59:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22518.635735 secs 2023-05-08T09:59:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:39 smithi186 ceph-mon[126480]: pgmap v12066: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T09:59:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22518.635735 secs 2023-05-08T09:59:42.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:41 smithi133 ceph-mon[125939]: pgmap v12067: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 78 KiB/s wr, 8 op/s 2023-05-08T09:59:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:59:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:41 smithi096 ceph-mon[124666]: pgmap v12067: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 78 KiB/s wr, 8 op/s 2023-05-08T09:59:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:59:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:41 smithi186 ceph-mon[126480]: pgmap v12067: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 78 KiB/s wr, 8 op/s 2023-05-08T09:59:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T09:59:43.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:59:43.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:59:43.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:42 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:59:43.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:59:43.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:42 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T09:59:43.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:42 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T09:59:43.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:42 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T09:59:43.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:59:43.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:59:43.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:42 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:59:43.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:59:43.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:42 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T09:59:43.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:42 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T09:59:43.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:42 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T09:59:43.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T09:59:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T09:59:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:42 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:59:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T09:59:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:42 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T09:59:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:42 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T09:59:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:42 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T09:59:44.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:44 smithi133 ceph-mon[125939]: pgmap v12068: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 78 KiB/s wr, 6 op/s 2023-05-08T09:59:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22523.080350 secs 2023-05-08T09:59:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:44 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:59:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:44 smithi096 ceph-mon[124666]: pgmap v12068: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 78 KiB/s wr, 6 op/s 2023-05-08T09:59:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22523.080350 secs 2023-05-08T09:59:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:44 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:59:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:44 smithi186 ceph-mon[126480]: pgmap v12068: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 78 KiB/s wr, 6 op/s 2023-05-08T09:59:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22523.080350 secs 2023-05-08T09:59:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:44 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:59:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22523.635837 secs 2023-05-08T09:59:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:45 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:59:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:45 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:59:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:45 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:59:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22523.635837 secs 2023-05-08T09:59:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:45 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:59:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:45 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:59:45.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:45 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:59:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22523.635837 secs 2023-05-08T09:59:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:45 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:59:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:45 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:59:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:45 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:59:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:46 smithi133 ceph-mon[125939]: pgmap v12069: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 128 KiB/s wr, 10 op/s 2023-05-08T09:59:46.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:46 smithi096 ceph-mon[124666]: pgmap v12069: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 128 KiB/s wr, 10 op/s 2023-05-08T09:59:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:46 smithi186 ceph-mon[126480]: pgmap v12069: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 128 KiB/s wr, 10 op/s 2023-05-08T09:59:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:48 smithi133 ceph-mon[125939]: pgmap v12070: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 128 KiB/s wr, 7 op/s 2023-05-08T09:59:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:48 smithi096 ceph-mon[124666]: pgmap v12070: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 128 KiB/s wr, 7 op/s 2023-05-08T09:59:48.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:48 smithi186 ceph-mon[126480]: pgmap v12070: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 128 KiB/s wr, 7 op/s 2023-05-08T09:59:49.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22528.080461 secs 2023-05-08T09:59:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22528.080461 secs 2023-05-08T09:59:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22528.080461 secs 2023-05-08T09:59:50.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:50 smithi133 ceph-mon[125939]: pgmap v12071: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 128 KiB/s wr, 7 op/s 2023-05-08T09:59:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:50 smithi096 ceph-mon[124666]: pgmap v12071: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 128 KiB/s wr, 7 op/s 2023-05-08T09:59:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:50 smithi186 ceph-mon[126480]: pgmap v12071: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 128 KiB/s wr, 7 op/s 2023-05-08T09:59:52.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:52 smithi133 ceph-mon[125939]: pgmap v12072: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 901 KiB/s rd, 487 KiB/s wr, 12 op/s 2023-05-08T09:59:52.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:59:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:52 smithi096 ceph-mon[124666]: pgmap v12072: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 901 KiB/s rd, 487 KiB/s wr, 12 op/s 2023-05-08T09:59:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:59:52.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:52 smithi186 ceph-mon[126480]: pgmap v12072: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 901 KiB/s rd, 487 KiB/s wr, 12 op/s 2023-05-08T09:59:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T09:59:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:53 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:59:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:59:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:59:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:53 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:59:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:59:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:59:53.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:53 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:59:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:59:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:59:54.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:54 smithi133 ceph-mon[125939]: pgmap v12073: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 900 KiB/s rd, 410 KiB/s wr, 9 op/s 2023-05-08T09:59:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22533.080528 secs 2023-05-08T09:59:54.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:54 smithi096 ceph-mon[124666]: pgmap v12073: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 900 KiB/s rd, 410 KiB/s wr, 9 op/s 2023-05-08T09:59:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22533.080528 secs 2023-05-08T09:59:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:54 smithi186 ceph-mon[126480]: pgmap v12073: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 900 KiB/s rd, 410 KiB/s wr, 9 op/s 2023-05-08T09:59:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22533.080528 secs 2023-05-08T09:59:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22533.636105 secs 2023-05-08T09:59:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22533.636105 secs 2023-05-08T09:59:55.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22533.636105 secs 2023-05-08T09:59:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:56 smithi133 ceph-mon[125939]: pgmap v12074: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 691 KiB/s wr, 16 op/s 2023-05-08T09:59:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22534.923462 secs 2023-05-08T09:59:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:56 smithi096 ceph-mon[124666]: pgmap v12074: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 691 KiB/s wr, 16 op/s 2023-05-08T09:59:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22534.923462 secs 2023-05-08T09:59:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:56 smithi186 ceph-mon[126480]: pgmap v12074: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 691 KiB/s wr, 16 op/s 2023-05-08T09:59:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22534.923462 secs 2023-05-08T09:59:57.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:59:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:59:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:59:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:59:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:59:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:59:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T09:59:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T09:59:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T09:59:58.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:58 smithi133 ceph-mon[125939]: pgmap v12075: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 645 KiB/s wr, 12 op/s 2023-05-08T09:59:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:58 smithi096 ceph-mon[124666]: pgmap v12075: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 645 KiB/s wr, 12 op/s 2023-05-08T09:59:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:58 smithi186 ceph-mon[126480]: pgmap v12075: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 645 KiB/s wr, 12 op/s 2023-05-08T09:59:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22538.080647 secs 2023-05-08T09:59:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 09:59:59 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:59:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22538.080647 secs 2023-05-08T09:59:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 09:59:59 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T09:59:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22538.080647 secs 2023-05-08T09:59:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 09:59:59 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:00:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:00 smithi133 ceph-mon[125939]: pgmap v12076: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 645 KiB/s wr, 12 op/s 2023-05-08T10:00:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:00 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:00:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:00 smithi133 ceph-mon[125939]: Health detail: HEALTH_WARN 3 MDSs report slow requests 2023-05-08T10:00:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:00 smithi133 ceph-mon[125939]: [WRN] MDS_SLOW_REQUEST: 3 MDSs report slow requests 2023-05-08T10:00:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:00 smithi133 ceph-mon[125939]: mds.c(mds.2): 1 slow requests are blocked > 180 secs 2023-05-08T10:00:00.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:00 smithi133 ceph-mon[125939]: mds.i(mds.1): 1 slow requests are blocked > 180 secs 2023-05-08T10:00:00.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:00 smithi133 ceph-mon[125939]: mds.b(mds.0): 1 slow requests are blocked > 180 secs 2023-05-08T10:00:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:00 smithi096 ceph-mon[124666]: pgmap v12076: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 645 KiB/s wr, 12 op/s 2023-05-08T10:00:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:00 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:00:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:00 smithi096 ceph-mon[124666]: Health detail: HEALTH_WARN 3 MDSs report slow requests 2023-05-08T10:00:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:00 smithi096 ceph-mon[124666]: [WRN] MDS_SLOW_REQUEST: 3 MDSs report slow requests 2023-05-08T10:00:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:00 smithi096 ceph-mon[124666]: mds.c(mds.2): 1 slow requests are blocked > 180 secs 2023-05-08T10:00:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:00 smithi096 ceph-mon[124666]: mds.i(mds.1): 1 slow requests are blocked > 180 secs 2023-05-08T10:00:00.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:00 smithi096 ceph-mon[124666]: mds.b(mds.0): 1 slow requests are blocked > 180 secs 2023-05-08T10:00:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:00 smithi186 ceph-mon[126480]: pgmap v12076: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 645 KiB/s wr, 12 op/s 2023-05-08T10:00:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:00 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:00:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:00 smithi186 ceph-mon[126480]: Health detail: HEALTH_WARN 3 MDSs report slow requests 2023-05-08T10:00:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:00 smithi186 ceph-mon[126480]: [WRN] MDS_SLOW_REQUEST: 3 MDSs report slow requests 2023-05-08T10:00:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:00 smithi186 ceph-mon[126480]: mds.c(mds.2): 1 slow requests are blocked > 180 secs 2023-05-08T10:00:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:00 smithi186 ceph-mon[126480]: mds.i(mds.1): 1 slow requests are blocked > 180 secs 2023-05-08T10:00:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:00 smithi186 ceph-mon[126480]: mds.b(mds.0): 1 slow requests are blocked > 180 secs 2023-05-08T10:00:01.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:00:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:00:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:00:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:00:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:00:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:00:02.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:02 smithi133 ceph-mon[125939]: pgmap v12077: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 758 KiB/s wr, 18 op/s 2023-05-08T10:00:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:02 smithi096 ceph-mon[124666]: pgmap v12077: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 758 KiB/s wr, 18 op/s 2023-05-08T10:00:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:02 smithi186 ceph-mon[126480]: pgmap v12077: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 758 KiB/s wr, 18 op/s 2023-05-08T10:00:04.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:04 smithi133 ceph-mon[125939]: pgmap v12078: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 587 KiB/s rd, 398 KiB/s wr, 13 op/s 2023-05-08T10:00:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22543.080716 secs 2023-05-08T10:00:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:04 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:00:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:04 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:00:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:04 smithi096 ceph-mon[124666]: pgmap v12078: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 587 KiB/s rd, 398 KiB/s wr, 13 op/s 2023-05-08T10:00:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22543.080716 secs 2023-05-08T10:00:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:04 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:00:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:04 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:00:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:04 smithi186 ceph-mon[126480]: pgmap v12078: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 587 KiB/s rd, 398 KiB/s wr, 13 op/s 2023-05-08T10:00:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22543.080716 secs 2023-05-08T10:00:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:04 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:00:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:04 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:00:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22543.636342 secs 2023-05-08T10:00:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:00:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:00:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22544.923716 secs 2023-05-08T10:00:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22543.636342 secs 2023-05-08T10:00:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:00:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:00:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22544.923716 secs 2023-05-08T10:00:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22543.636342 secs 2023-05-08T10:00:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:00:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:00:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22544.923716 secs 2023-05-08T10:00:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:06 smithi133 ceph-mon[125939]: pgmap v12079: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 915 KiB/s rd, 719 KiB/s wr, 32 op/s 2023-05-08T10:00:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:06 smithi133 ceph-mon[125939]: osdmap e832: 12 total, 12 up, 12 in 2023-05-08T10:00:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:06 smithi096 ceph-mon[124666]: pgmap v12079: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 915 KiB/s rd, 719 KiB/s wr, 32 op/s 2023-05-08T10:00:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:06 smithi096 ceph-mon[124666]: osdmap e832: 12 total, 12 up, 12 in 2023-05-08T10:00:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:06 smithi186 ceph-mon[126480]: pgmap v12079: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 915 KiB/s rd, 719 KiB/s wr, 32 op/s 2023-05-08T10:00:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:06 smithi186 ceph-mon[126480]: osdmap e832: 12 total, 12 up, 12 in 2023-05-08T10:00:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:08 smithi096 ceph-mon[124666]: pgmap v12081: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 605 KiB/s rd, 520 KiB/s wr, 30 op/s 2023-05-08T10:00:08.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:08 smithi186 ceph-mon[126480]: pgmap v12081: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 605 KiB/s rd, 520 KiB/s wr, 30 op/s 2023-05-08T10:00:08.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:08 smithi133 ceph-mon[125939]: pgmap v12081: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 605 KiB/s rd, 520 KiB/s wr, 30 op/s 2023-05-08T10:00:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:00:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:00:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:00:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22548.080832 secs 2023-05-08T10:00:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:09 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:00:09.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:00:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:00:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:00:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22548.080832 secs 2023-05-08T10:00:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:09 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:00:09.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:00:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:00:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:00:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22548.080832 secs 2023-05-08T10:00:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:09 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:00:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:10 smithi096 ceph-mon[124666]: pgmap v12082: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 605 KiB/s rd, 520 KiB/s wr, 30 op/s 2023-05-08T10:00:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22548.636492 secs 2023-05-08T10:00:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22549.923855 secs 2023-05-08T10:00:10.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:10 smithi186 ceph-mon[126480]: pgmap v12082: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 605 KiB/s rd, 520 KiB/s wr, 30 op/s 2023-05-08T10:00:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22548.636492 secs 2023-05-08T10:00:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22549.923855 secs 2023-05-08T10:00:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:10 smithi133 ceph-mon[125939]: pgmap v12082: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 605 KiB/s rd, 520 KiB/s wr, 30 op/s 2023-05-08T10:00:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22548.636492 secs 2023-05-08T10:00:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22549.923855 secs 2023-05-08T10:00:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:12 smithi096 ceph-mon[124666]: pgmap v12083: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 431 KiB/s wr, 28 op/s 2023-05-08T10:00:12.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:12 smithi186 ceph-mon[126480]: pgmap v12083: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 431 KiB/s wr, 28 op/s 2023-05-08T10:00:12.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:12 smithi133 ceph-mon[125939]: pgmap v12083: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 431 KiB/s wr, 28 op/s 2023-05-08T10:00:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:14 smithi096 ceph-mon[124666]: pgmap v12084: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 431 KiB/s wr, 28 op/s 2023-05-08T10:00:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22553.080960 secs 2023-05-08T10:00:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:14 smithi096 ceph-mon[124666]: osdmap e833: 12 total, 12 up, 12 in 2023-05-08T10:00:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:14 smithi186 ceph-mon[126480]: pgmap v12084: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 431 KiB/s wr, 28 op/s 2023-05-08T10:00:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22553.080960 secs 2023-05-08T10:00:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:14 smithi186 ceph-mon[126480]: osdmap e833: 12 total, 12 up, 12 in 2023-05-08T10:00:14.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:14 smithi133 ceph-mon[125939]: pgmap v12084: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 431 KiB/s wr, 28 op/s 2023-05-08T10:00:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22553.080960 secs 2023-05-08T10:00:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:14 smithi133 ceph-mon[125939]: osdmap e833: 12 total, 12 up, 12 in 2023-05-08T10:00:15.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22553.636543 secs 2023-05-08T10:00:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22554.923995 secs 2023-05-08T10:00:15.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22553.636543 secs 2023-05-08T10:00:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22554.923995 secs 2023-05-08T10:00:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22553.636543 secs 2023-05-08T10:00:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22554.923995 secs 2023-05-08T10:00:16.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:16 smithi186 ceph-mon[126480]: pgmap v12086: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 155 KiB/s wr, 9 op/s 2023-05-08T10:00:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:16 smithi133 ceph-mon[125939]: pgmap v12086: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 155 KiB/s wr, 9 op/s 2023-05-08T10:00:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:16 smithi096 ceph-mon[124666]: pgmap v12086: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 155 KiB/s wr, 9 op/s 2023-05-08T10:00:18.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:18 smithi186 ceph-mon[126480]: pgmap v12087: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 148 KiB/s wr, 9 op/s 2023-05-08T10:00:18.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:18 smithi133 ceph-mon[125939]: pgmap v12087: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 148 KiB/s wr, 9 op/s 2023-05-08T10:00:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:18 smithi096 ceph-mon[124666]: pgmap v12087: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 148 KiB/s wr, 9 op/s 2023-05-08T10:00:19.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22558.081101 secs 2023-05-08T10:00:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22558.081101 secs 2023-05-08T10:00:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22558.081101 secs 2023-05-08T10:00:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:20 smithi186 ceph-mon[126480]: pgmap v12088: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 148 KiB/s wr, 9 op/s 2023-05-08T10:00:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22558.636617 secs 2023-05-08T10:00:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22559.924108 secs 2023-05-08T10:00:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:20 smithi133 ceph-mon[125939]: pgmap v12088: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 148 KiB/s wr, 9 op/s 2023-05-08T10:00:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22558.636617 secs 2023-05-08T10:00:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22559.924108 secs 2023-05-08T10:00:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:20 smithi096 ceph-mon[124666]: pgmap v12088: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 148 KiB/s wr, 9 op/s 2023-05-08T10:00:20.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22558.636617 secs 2023-05-08T10:00:20.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22559.924108 secs 2023-05-08T10:00:22.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:22 smithi186 ceph-mon[126480]: pgmap v12089: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 102 KiB/s wr, 8 op/s 2023-05-08T10:00:22.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:22 smithi133 ceph-mon[125939]: pgmap v12089: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 102 KiB/s wr, 8 op/s 2023-05-08T10:00:22.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:22 smithi096 ceph-mon[124666]: pgmap v12089: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 102 KiB/s wr, 8 op/s 2023-05-08T10:00:23.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:23 smithi186 ceph-mon[126480]: pgmap v12090: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 102 KiB/s wr, 8 op/s 2023-05-08T10:00:23.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:23 smithi133 ceph-mon[125939]: pgmap v12090: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 102 KiB/s wr, 8 op/s 2023-05-08T10:00:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:23 smithi096 ceph-mon[124666]: pgmap v12090: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 102 KiB/s wr, 8 op/s 2023-05-08T10:00:24.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22563.081225 secs 2023-05-08T10:00:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22563.636752 secs 2023-05-08T10:00:24.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22563.081225 secs 2023-05-08T10:00:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22563.636752 secs 2023-05-08T10:00:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22563.081225 secs 2023-05-08T10:00:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22563.636752 secs 2023-05-08T10:00:25.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:25 smithi186 ceph-mon[126480]: pgmap v12091: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 93 KiB/s wr, 10 op/s 2023-05-08T10:00:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22564.924226 secs 2023-05-08T10:00:25.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:25 smithi133 ceph-mon[125939]: pgmap v12091: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 93 KiB/s wr, 10 op/s 2023-05-08T10:00:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22564.924226 secs 2023-05-08T10:00:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:25 smithi096 ceph-mon[124666]: pgmap v12091: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 93 KiB/s wr, 10 op/s 2023-05-08T10:00:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22564.924226 secs 2023-05-08T10:00:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:27 smithi186 ceph-mon[126480]: pgmap v12092: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 7 op/s 2023-05-08T10:00:28.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:27 smithi133 ceph-mon[125939]: pgmap v12092: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 7 op/s 2023-05-08T10:00:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:27 smithi096 ceph-mon[124666]: pgmap v12092: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 7 op/s 2023-05-08T10:00:29.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22568.081388 secs 2023-05-08T10:00:29.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22568.081388 secs 2023-05-08T10:00:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22568.081388 secs 2023-05-08T10:00:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:29 smithi186 ceph-mon[126480]: pgmap v12093: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2023-05-08T10:00:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22568.636821 secs 2023-05-08T10:00:30.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:29 smithi133 ceph-mon[125939]: pgmap v12093: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2023-05-08T10:00:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22568.636821 secs 2023-05-08T10:00:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:29 smithi096 ceph-mon[124666]: pgmap v12093: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2023-05-08T10:00:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22568.636821 secs 2023-05-08T10:00:31.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22569.924366 secs 2023-05-08T10:00:31.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22569.924366 secs 2023-05-08T10:00:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22569.924366 secs 2023-05-08T10:00:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:31 smithi186 ceph-mon[126480]: pgmap v12094: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2023-05-08T10:00:32.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:31 smithi133 ceph-mon[125939]: pgmap v12094: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2023-05-08T10:00:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:31 smithi096 ceph-mon[124666]: pgmap v12094: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2023-05-08T10:00:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:33 smithi186 ceph-mon[126480]: pgmap v12095: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2023-05-08T10:00:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22573.081504 secs 2023-05-08T10:00:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:33 smithi133 ceph-mon[125939]: pgmap v12095: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2023-05-08T10:00:34.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22573.081504 secs 2023-05-08T10:00:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:33 smithi096 ceph-mon[124666]: pgmap v12095: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2023-05-08T10:00:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22573.081504 secs 2023-05-08T10:00:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22573.636952 secs 2023-05-08T10:00:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22573.636952 secs 2023-05-08T10:00:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22573.636952 secs 2023-05-08T10:00:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:35 smithi186 ceph-mon[126480]: pgmap v12096: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 153 KiB/s wr, 10 op/s 2023-05-08T10:00:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22574.924487 secs 2023-05-08T10:00:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:35 smithi133 ceph-mon[125939]: pgmap v12096: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 153 KiB/s wr, 10 op/s 2023-05-08T10:00:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22574.924487 secs 2023-05-08T10:00:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:35 smithi096 ceph-mon[124666]: pgmap v12096: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 153 KiB/s wr, 10 op/s 2023-05-08T10:00:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22574.924487 secs 2023-05-08T10:00:38.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:37 smithi186 ceph-mon[126480]: pgmap v12097: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 153 KiB/s wr, 8 op/s 2023-05-08T10:00:38.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:37 smithi133 ceph-mon[125939]: pgmap v12097: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 153 KiB/s wr, 8 op/s 2023-05-08T10:00:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:37 smithi096 ceph-mon[124666]: pgmap v12097: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 153 KiB/s wr, 8 op/s 2023-05-08T10:00:39.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22578.081616 secs 2023-05-08T10:00:39.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22578.081616 secs 2023-05-08T10:00:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22578.081616 secs 2023-05-08T10:00:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:39 smithi186 ceph-mon[126480]: pgmap v12098: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 153 KiB/s wr, 7 op/s 2023-05-08T10:00:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22578.637074 secs 2023-05-08T10:00:40.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:39 smithi133 ceph-mon[125939]: pgmap v12098: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 153 KiB/s wr, 7 op/s 2023-05-08T10:00:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22578.637074 secs 2023-05-08T10:00:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:39 smithi096 ceph-mon[124666]: pgmap v12098: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 153 KiB/s wr, 7 op/s 2023-05-08T10:00:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22578.637074 secs 2023-05-08T10:00:42.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:41 smithi133 ceph-mon[125939]: pgmap v12099: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 230 KiB/s wr, 10 op/s 2023-05-08T10:00:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:41 smithi096 ceph-mon[124666]: pgmap v12099: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 230 KiB/s wr, 10 op/s 2023-05-08T10:00:42.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:41 smithi186 ceph-mon[126480]: pgmap v12099: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 230 KiB/s wr, 10 op/s 2023-05-08T10:00:43.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:00:43.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:00:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:00:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:43 smithi133 ceph-mon[125939]: pgmap v12100: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 230 KiB/s wr, 7 op/s 2023-05-08T10:00:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22583.081702 secs 2023-05-08T10:00:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:00:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:43 smithi096 ceph-mon[124666]: pgmap v12100: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 230 KiB/s wr, 7 op/s 2023-05-08T10:00:44.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22583.081702 secs 2023-05-08T10:00:44.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:00:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:43 smithi186 ceph-mon[126480]: pgmap v12100: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 230 KiB/s wr, 7 op/s 2023-05-08T10:00:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22583.081702 secs 2023-05-08T10:00:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:00:45.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:00:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:00:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:00:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22583.637183 secs 2023-05-08T10:00:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:00:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:00:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:00:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22583.637183 secs 2023-05-08T10:00:45.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:00:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:00:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:00:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22583.637183 secs 2023-05-08T10:00:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:45 smithi133 ceph-mon[125939]: pgmap v12101: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 285 KiB/s wr, 10 op/s 2023-05-08T10:00:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:00:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:00:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:00:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:00:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:00:46.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:00:46.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22584.924699 secs 2023-05-08T10:00:46.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:00:46.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:00:46.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:00:46.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:00:46.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:00:46.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:00:46.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:00:46.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:00:46.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:00:46.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:00:46.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:00:46.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:00:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:45 smithi096 ceph-mon[124666]: pgmap v12101: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 285 KiB/s wr, 10 op/s 2023-05-08T10:00:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:00:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:00:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:00:46.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:00:46.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:00:46.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:00:46.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22584.924699 secs 2023-05-08T10:00:46.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:00:46.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:00:46.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:00:46.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:00:46.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:00:46.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:00:46.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:00:46.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:00:46.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:00:46.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:00:46.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:00:46.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:00:46.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:45 smithi186 ceph-mon[126480]: pgmap v12101: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 285 KiB/s wr, 10 op/s 2023-05-08T10:00:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:00:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:00:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:00:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:00:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:00:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:00:46.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22584.924699 secs 2023-05-08T10:00:46.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:00:46.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:00:46.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:00:46.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:00:46.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:00:46.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:00:46.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:00:46.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:00:46.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:00:46.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:00:46.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:00:46.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:00:47.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:46 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T10:00:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:46 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T10:00:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:46 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T10:00:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:46 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T10:00:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:46 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:00:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:46 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T10:00:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:46 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T10:00:47.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:46 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:00:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:46 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T10:00:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:46 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T10:00:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:46 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T10:00:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:46 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T10:00:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:46 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:00:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:46 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T10:00:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:46 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T10:00:47.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:46 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:00:47.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:46 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T10:00:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:46 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T10:00:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:46 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T10:00:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:46 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T10:00:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:46 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:00:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:46 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T10:00:47.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:46 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T10:00:47.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:46 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:00:48.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:47 smithi133 ceph-mon[125939]: pgmap v12102: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 133 KiB/s wr, 7 op/s 2023-05-08T10:00:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:47 smithi096 ceph-mon[124666]: pgmap v12102: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 133 KiB/s wr, 7 op/s 2023-05-08T10:00:48.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:47 smithi186 ceph-mon[126480]: pgmap v12102: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 133 KiB/s wr, 7 op/s 2023-05-08T10:00:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:00:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:00:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22588.081816 secs 2023-05-08T10:00:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:00:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:00:49.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22588.081816 secs 2023-05-08T10:00:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:00:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:00:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22588.081816 secs 2023-05-08T10:00:50.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:49 smithi133 ceph-mon[125939]: pgmap v12103: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 133 KiB/s wr, 6 op/s 2023-05-08T10:00:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:49 smithi096 ceph-mon[124666]: pgmap v12103: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 133 KiB/s wr, 6 op/s 2023-05-08T10:00:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:49 smithi186 ceph-mon[126480]: pgmap v12103: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 133 KiB/s wr, 6 op/s 2023-05-08T10:00:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22589.924858 secs 2023-05-08T10:00:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22589.924858 secs 2023-05-08T10:00:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22589.924858 secs 2023-05-08T10:00:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:52 smithi096 ceph-mon[124666]: pgmap v12104: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 875 KiB/s rd, 503 KiB/s wr, 11 op/s 2023-05-08T10:00:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:00:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:52 smithi186 ceph-mon[126480]: pgmap v12104: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 875 KiB/s rd, 503 KiB/s wr, 11 op/s 2023-05-08T10:00:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:00:52.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:52 smithi133 ceph-mon[125939]: pgmap v12104: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 875 KiB/s rd, 503 KiB/s wr, 11 op/s 2023-05-08T10:00:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:00:53.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:53 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:00:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:00:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:00:53.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:53 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:00:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:00:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:00:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:53 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:00:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:00:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:00:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:54 smithi186 ceph-mon[126480]: pgmap v12105: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 874 KiB/s rd, 426 KiB/s wr, 9 op/s 2023-05-08T10:00:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22593.081958 secs 2023-05-08T10:00:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22593.637403 secs 2023-05-08T10:00:54.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:54 smithi133 ceph-mon[125939]: pgmap v12105: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 874 KiB/s rd, 426 KiB/s wr, 9 op/s 2023-05-08T10:00:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22593.081958 secs 2023-05-08T10:00:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22593.637403 secs 2023-05-08T10:00:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:54 smithi096 ceph-mon[124666]: pgmap v12105: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 874 KiB/s rd, 426 KiB/s wr, 9 op/s 2023-05-08T10:00:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22593.081958 secs 2023-05-08T10:00:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22593.637403 secs 2023-05-08T10:00:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:56 smithi186 ceph-mon[126480]: pgmap v12106: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 694 KiB/s wr, 14 op/s 2023-05-08T10:00:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22594.924971 secs 2023-05-08T10:00:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:56 smithi133 ceph-mon[125939]: pgmap v12106: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 694 KiB/s wr, 14 op/s 2023-05-08T10:00:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22594.924971 secs 2023-05-08T10:00:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:56 smithi096 ceph-mon[124666]: pgmap v12106: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 694 KiB/s wr, 14 op/s 2023-05-08T10:00:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22594.924971 secs 2023-05-08T10:00:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:00:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:00:57.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:00:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:00:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:00:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:00:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:58 smithi186 ceph-mon[126480]: pgmap v12107: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 640 KiB/s wr, 12 op/s 2023-05-08T10:00:58.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:58 smithi133 ceph-mon[125939]: pgmap v12107: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 640 KiB/s wr, 12 op/s 2023-05-08T10:00:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:58 smithi096 ceph-mon[124666]: pgmap v12107: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 640 KiB/s wr, 12 op/s 2023-05-08T10:00:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22598.082076 secs 2023-05-08T10:00:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:00:59 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:00:59.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22598.082076 secs 2023-05-08T10:00:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:00:59 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:00:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22598.082076 secs 2023-05-08T10:00:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:00:59 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:01:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:00 smithi186 ceph-mon[126480]: pgmap v12108: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 640 KiB/s wr, 11 op/s 2023-05-08T10:01:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:00 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:01:00.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:00 smithi133 ceph-mon[125939]: pgmap v12108: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 640 KiB/s wr, 11 op/s 2023-05-08T10:01:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:00 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:01:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:00 smithi096 ceph-mon[124666]: pgmap v12108: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 640 KiB/s wr, 11 op/s 2023-05-08T10:01:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:00 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:01:01.348 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:01:01.348 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:01:01.348 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22599.925074 secs 2023-05-08T10:01:01.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:01:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:01:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22599.925074 secs 2023-05-08T10:01:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:01:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:01:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22599.925074 secs 2023-05-08T10:01:02.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:02 smithi186 ceph-mon[126480]: pgmap v12109: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 754 KiB/s wr, 17 op/s 2023-05-08T10:01:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:02 smithi133 ceph-mon[125939]: pgmap v12109: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 754 KiB/s wr, 17 op/s 2023-05-08T10:01:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:02 smithi096 ceph-mon[124666]: pgmap v12109: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 754 KiB/s wr, 17 op/s 2023-05-08T10:01:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:04 smithi186 ceph-mon[126480]: pgmap v12110: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 636 KiB/s rd, 383 KiB/s wr, 11 op/s 2023-05-08T10:01:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22603.082203 secs 2023-05-08T10:01:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:04 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:01:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22603.637624 secs 2023-05-08T10:01:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:04 smithi133 ceph-mon[125939]: pgmap v12110: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 636 KiB/s rd, 383 KiB/s wr, 11 op/s 2023-05-08T10:01:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22603.082203 secs 2023-05-08T10:01:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:04 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:01:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22603.637624 secs 2023-05-08T10:01:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:04 smithi096 ceph-mon[124666]: pgmap v12110: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 636 KiB/s rd, 383 KiB/s wr, 11 op/s 2023-05-08T10:01:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22603.082203 secs 2023-05-08T10:01:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:04 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:01:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22603.637624 secs 2023-05-08T10:01:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:06 smithi186 ceph-mon[126480]: pgmap v12111: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 919 KiB/s rd, 728 KiB/s wr, 30 op/s 2023-05-08T10:01:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22604.925194 secs 2023-05-08T10:01:06.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:06 smithi133 ceph-mon[125939]: pgmap v12111: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 919 KiB/s rd, 728 KiB/s wr, 30 op/s 2023-05-08T10:01:06.557 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22604.925194 secs 2023-05-08T10:01:06.558 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:06 smithi096 ceph-mon[124666]: pgmap v12111: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 919 KiB/s rd, 728 KiB/s wr, 30 op/s 2023-05-08T10:01:06.558 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22604.925194 secs 2023-05-08T10:01:07.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:07 smithi186 ceph-mon[126480]: osdmap e834: 12 total, 12 up, 12 in 2023-05-08T10:01:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:07 smithi133 ceph-mon[125939]: osdmap e834: 12 total, 12 up, 12 in 2023-05-08T10:01:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:07 smithi096 ceph-mon[124666]: osdmap e834: 12 total, 12 up, 12 in 2023-05-08T10:01:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:08 smithi186 ceph-mon[126480]: pgmap v12113: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 645 KiB/s rd, 552 KiB/s wr, 30 op/s 2023-05-08T10:01:08.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:08 smithi133 ceph-mon[125939]: pgmap v12113: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 645 KiB/s rd, 552 KiB/s wr, 30 op/s 2023-05-08T10:01:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:08 smithi096 ceph-mon[124666]: pgmap v12113: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 645 KiB/s rd, 552 KiB/s wr, 30 op/s 2023-05-08T10:01:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:01:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:01:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22608.082374 secs 2023-05-08T10:01:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:09 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:01:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22608.637743 secs 2023-05-08T10:01:09.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:01:09.494 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:01:09.494 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22608.082374 secs 2023-05-08T10:01:09.494 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:09 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:01:09.494 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22608.637743 secs 2023-05-08T10:01:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:01:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:01:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22608.082374 secs 2023-05-08T10:01:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:09 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:01:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22608.637743 secs 2023-05-08T10:01:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:10 smithi186 ceph-mon[126480]: pgmap v12114: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 645 KiB/s rd, 552 KiB/s wr, 30 op/s 2023-05-08T10:01:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:10 smithi133 ceph-mon[125939]: pgmap v12114: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 645 KiB/s rd, 552 KiB/s wr, 30 op/s 2023-05-08T10:01:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:10 smithi096 ceph-mon[124666]: pgmap v12114: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 645 KiB/s rd, 552 KiB/s wr, 30 op/s 2023-05-08T10:01:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22609.925314 secs 2023-05-08T10:01:11.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22609.925314 secs 2023-05-08T10:01:11.509 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22609.925314 secs 2023-05-08T10:01:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:12 smithi186 ceph-mon[126480]: pgmap v12115: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 516 KiB/s rd, 460 KiB/s wr, 27 op/s 2023-05-08T10:01:12.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:12 smithi133 ceph-mon[125939]: pgmap v12115: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 516 KiB/s rd, 460 KiB/s wr, 27 op/s 2023-05-08T10:01:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:12 smithi096 ceph-mon[124666]: pgmap v12115: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 516 KiB/s rd, 460 KiB/s wr, 27 op/s 2023-05-08T10:01:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:14 smithi186 ceph-mon[126480]: pgmap v12116: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 516 KiB/s rd, 460 KiB/s wr, 27 op/s 2023-05-08T10:01:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22613.082434 secs 2023-05-08T10:01:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:14 smithi186 ceph-mon[126480]: osdmap e835: 12 total, 12 up, 12 in 2023-05-08T10:01:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22613.637860 secs 2023-05-08T10:01:14.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:14 smithi133 ceph-mon[125939]: pgmap v12116: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 516 KiB/s rd, 460 KiB/s wr, 27 op/s 2023-05-08T10:01:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22613.082434 secs 2023-05-08T10:01:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:14 smithi133 ceph-mon[125939]: osdmap e835: 12 total, 12 up, 12 in 2023-05-08T10:01:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22613.637860 secs 2023-05-08T10:01:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:14 smithi096 ceph-mon[124666]: pgmap v12116: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 516 KiB/s rd, 460 KiB/s wr, 27 op/s 2023-05-08T10:01:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22613.082434 secs 2023-05-08T10:01:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:14 smithi096 ceph-mon[124666]: osdmap e835: 12 total, 12 up, 12 in 2023-05-08T10:01:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22613.637860 secs 2023-05-08T10:01:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:16 smithi186 ceph-mon[126480]: pgmap v12118: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 280 KiB/s wr, 9 op/s 2023-05-08T10:01:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22614.925430 secs 2023-05-08T10:01:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:16 smithi133 ceph-mon[125939]: pgmap v12118: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 280 KiB/s wr, 9 op/s 2023-05-08T10:01:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22614.925430 secs 2023-05-08T10:01:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:16 smithi096 ceph-mon[124666]: pgmap v12118: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 280 KiB/s wr, 9 op/s 2023-05-08T10:01:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22614.925430 secs 2023-05-08T10:01:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:18 smithi186 ceph-mon[126480]: pgmap v12119: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 244 KiB/s wr, 8 op/s 2023-05-08T10:01:18.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:18 smithi133 ceph-mon[125939]: pgmap v12119: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 244 KiB/s wr, 8 op/s 2023-05-08T10:01:18.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:18 smithi096 ceph-mon[124666]: pgmap v12119: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 244 KiB/s wr, 8 op/s 2023-05-08T10:01:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22618.082533 secs 2023-05-08T10:01:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22618.637977 secs 2023-05-08T10:01:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22618.082533 secs 2023-05-08T10:01:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22618.637977 secs 2023-05-08T10:01:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22618.082533 secs 2023-05-08T10:01:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22618.637977 secs 2023-05-08T10:01:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:20 smithi186 ceph-mon[126480]: pgmap v12120: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 244 KiB/s wr, 8 op/s 2023-05-08T10:01:20.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:20 smithi133 ceph-mon[125939]: pgmap v12120: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 244 KiB/s wr, 8 op/s 2023-05-08T10:01:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:20 smithi096 ceph-mon[124666]: pgmap v12120: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 244 KiB/s wr, 8 op/s 2023-05-08T10:01:21.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22619.925545 secs 2023-05-08T10:01:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22619.925545 secs 2023-05-08T10:01:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22619.925545 secs 2023-05-08T10:01:22.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:22 smithi133 ceph-mon[125939]: pgmap v12121: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 198 KiB/s wr, 7 op/s 2023-05-08T10:01:22.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:22 smithi096 ceph-mon[124666]: pgmap v12121: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 198 KiB/s wr, 7 op/s 2023-05-08T10:01:22.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:22 smithi186 ceph-mon[126480]: pgmap v12121: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 198 KiB/s wr, 7 op/s 2023-05-08T10:01:24.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:24 smithi133 ceph-mon[125939]: pgmap v12122: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 198 KiB/s wr, 7 op/s 2023-05-08T10:01:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22623.082659 secs 2023-05-08T10:01:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22623.638115 secs 2023-05-08T10:01:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:24 smithi096 ceph-mon[124666]: pgmap v12122: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 198 KiB/s wr, 7 op/s 2023-05-08T10:01:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22623.082659 secs 2023-05-08T10:01:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22623.638115 secs 2023-05-08T10:01:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:24 smithi186 ceph-mon[126480]: pgmap v12122: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 198 KiB/s wr, 7 op/s 2023-05-08T10:01:24.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22623.082659 secs 2023-05-08T10:01:24.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22623.638115 secs 2023-05-08T10:01:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:26 smithi133 ceph-mon[125939]: pgmap v12123: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 247 KiB/s wr, 9 op/s 2023-05-08T10:01:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22624.925667 secs 2023-05-08T10:01:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:26 smithi096 ceph-mon[124666]: pgmap v12123: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 247 KiB/s wr, 9 op/s 2023-05-08T10:01:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22624.925667 secs 2023-05-08T10:01:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:26 smithi186 ceph-mon[126480]: pgmap v12123: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 247 KiB/s wr, 9 op/s 2023-05-08T10:01:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22624.925667 secs 2023-05-08T10:01:28.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:28 smithi133 ceph-mon[125939]: pgmap v12124: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 61 KiB/s wr, 5 op/s 2023-05-08T10:01:28.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:28 smithi096 ceph-mon[124666]: pgmap v12124: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 61 KiB/s wr, 5 op/s 2023-05-08T10:01:28.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:28 smithi186 ceph-mon[126480]: pgmap v12124: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 61 KiB/s wr, 5 op/s 2023-05-08T10:01:29.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22628.082813 secs 2023-05-08T10:01:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22628.638234 secs 2023-05-08T10:01:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22628.082813 secs 2023-05-08T10:01:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22628.638234 secs 2023-05-08T10:01:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22628.082813 secs 2023-05-08T10:01:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22628.638234 secs 2023-05-08T10:01:30.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:30 smithi133 ceph-mon[125939]: pgmap v12125: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 61 KiB/s wr, 5 op/s 2023-05-08T10:01:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:30 smithi096 ceph-mon[124666]: pgmap v12125: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 61 KiB/s wr, 5 op/s 2023-05-08T10:01:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:30 smithi186 ceph-mon[126480]: pgmap v12125: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 61 KiB/s wr, 5 op/s 2023-05-08T10:01:31.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22629.925805 secs 2023-05-08T10:01:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22629.925805 secs 2023-05-08T10:01:31.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22629.925805 secs 2023-05-08T10:01:32.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:32 smithi133 ceph-mon[125939]: pgmap v12126: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 61 KiB/s wr, 8 op/s 2023-05-08T10:01:32.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:32 smithi096 ceph-mon[124666]: pgmap v12126: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 61 KiB/s wr, 8 op/s 2023-05-08T10:01:32.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:32 smithi186 ceph-mon[126480]: pgmap v12126: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 61 KiB/s wr, 8 op/s 2023-05-08T10:01:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:34 smithi133 ceph-mon[125939]: pgmap v12127: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 61 KiB/s wr, 5 op/s 2023-05-08T10:01:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22633.082958 secs 2023-05-08T10:01:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22633.638370 secs 2023-05-08T10:01:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:34 smithi096 ceph-mon[124666]: pgmap v12127: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 61 KiB/s wr, 5 op/s 2023-05-08T10:01:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22633.082958 secs 2023-05-08T10:01:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22633.638370 secs 2023-05-08T10:01:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:34 smithi186 ceph-mon[126480]: pgmap v12127: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 61 KiB/s wr, 5 op/s 2023-05-08T10:01:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22633.082958 secs 2023-05-08T10:01:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22633.638370 secs 2023-05-08T10:01:36.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:36 smithi133 ceph-mon[125939]: pgmap v12128: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 61 KiB/s wr, 7 op/s 2023-05-08T10:01:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22634.925914 secs 2023-05-08T10:01:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:36 smithi096 ceph-mon[124666]: pgmap v12128: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 61 KiB/s wr, 7 op/s 2023-05-08T10:01:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22634.925914 secs 2023-05-08T10:01:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:36 smithi186 ceph-mon[126480]: pgmap v12128: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 61 KiB/s wr, 7 op/s 2023-05-08T10:01:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22634.925914 secs 2023-05-08T10:01:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:38 smithi133 ceph-mon[125939]: pgmap v12129: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T10:01:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:38 smithi096 ceph-mon[124666]: pgmap v12129: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T10:01:38.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:38 smithi186 ceph-mon[126480]: pgmap v12129: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T10:01:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22638.083088 secs 2023-05-08T10:01:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22638.638491 secs 2023-05-08T10:01:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22638.083088 secs 2023-05-08T10:01:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22638.638491 secs 2023-05-08T10:01:39.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22638.083088 secs 2023-05-08T10:01:39.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22638.638491 secs 2023-05-08T10:01:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:40 smithi133 ceph-mon[125939]: pgmap v12130: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T10:01:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:40 smithi096 ceph-mon[124666]: pgmap v12130: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T10:01:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:40 smithi186 ceph-mon[126480]: pgmap v12130: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T10:01:42.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:42 smithi133 ceph-mon[125939]: pgmap v12131: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 78 KiB/s wr, 8 op/s 2023-05-08T10:01:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:42 smithi096 ceph-mon[124666]: pgmap v12131: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 78 KiB/s wr, 8 op/s 2023-05-08T10:01:42.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:42 smithi186 ceph-mon[126480]: pgmap v12131: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 78 KiB/s wr, 8 op/s 2023-05-08T10:01:44.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:44 smithi133 ceph-mon[125939]: pgmap v12132: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 78 KiB/s wr, 6 op/s 2023-05-08T10:01:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22643.083233 secs 2023-05-08T10:01:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:44 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:01:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22643.638629 secs 2023-05-08T10:01:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:44 smithi096 ceph-mon[124666]: pgmap v12132: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 78 KiB/s wr, 6 op/s 2023-05-08T10:01:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22643.083233 secs 2023-05-08T10:01:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:44 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:01:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22643.638629 secs 2023-05-08T10:01:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:44 smithi186 ceph-mon[126480]: pgmap v12132: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 78 KiB/s wr, 6 op/s 2023-05-08T10:01:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22643.083233 secs 2023-05-08T10:01:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:44 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:01:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22643.638629 secs 2023-05-08T10:01:45.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:45 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:01:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:45 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:01:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:45 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:01:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:45 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:01:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:45 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:01:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:45 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:01:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:45 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:01:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:45 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:01:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:45 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:01:46.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:46 smithi133 ceph-mon[125939]: pgmap v12133: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 120 KiB/s wr, 9 op/s 2023-05-08T10:01:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:46 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:01:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:46 smithi096 ceph-mon[124666]: pgmap v12133: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 120 KiB/s wr, 9 op/s 2023-05-08T10:01:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:46 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:01:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:46 smithi186 ceph-mon[126480]: pgmap v12133: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 120 KiB/s wr, 9 op/s 2023-05-08T10:01:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:46 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:01:47.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:47 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:01:47.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:47 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:01:47.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:47 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:01:47.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:47 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:01:47.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:47 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:01:47.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:47 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:01:47.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:47 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:01:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:47 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:01:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:47 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:01:48.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:48 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:01:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:48 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T10:01:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:48 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T10:01:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:48 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:01:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:48 smithi133 ceph-mon[125939]: pgmap v12134: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 120 KiB/s wr, 7 op/s 2023-05-08T10:01:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:48 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:01:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:48 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T10:01:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:48 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T10:01:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:48 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:01:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:48 smithi096 ceph-mon[124666]: pgmap v12134: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 120 KiB/s wr, 7 op/s 2023-05-08T10:01:48.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:48 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:01:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:48 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T10:01:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:48 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T10:01:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:48 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:01:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:48 smithi186 ceph-mon[126480]: pgmap v12134: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 120 KiB/s wr, 7 op/s 2023-05-08T10:01:49.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22648.083365 secs 2023-05-08T10:01:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22648.083365 secs 2023-05-08T10:01:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22648.083365 secs 2023-05-08T10:01:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:50 smithi133 ceph-mon[125939]: pgmap v12135: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 120 KiB/s wr, 7 op/s 2023-05-08T10:01:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:50 smithi096 ceph-mon[124666]: pgmap v12135: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 120 KiB/s wr, 7 op/s 2023-05-08T10:01:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:50 smithi186 ceph-mon[126480]: pgmap v12135: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 120 KiB/s wr, 7 op/s 2023-05-08T10:01:51.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22649.926213 secs 2023-05-08T10:01:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22649.926213 secs 2023-05-08T10:01:51.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22649.926213 secs 2023-05-08T10:01:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:52 smithi133 ceph-mon[125939]: pgmap v12136: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 814 KiB/s rd, 490 KiB/s wr, 12 op/s 2023-05-08T10:01:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:01:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:52 smithi096 ceph-mon[124666]: pgmap v12136: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 814 KiB/s rd, 490 KiB/s wr, 12 op/s 2023-05-08T10:01:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:01:52.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:52 smithi186 ceph-mon[126480]: pgmap v12136: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 814 KiB/s rd, 490 KiB/s wr, 12 op/s 2023-05-08T10:01:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:01:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:01:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:01:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:01:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:01:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:01:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:01:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:01:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:01:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:01:54.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:54 smithi133 ceph-mon[125939]: pgmap v12137: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 812 KiB/s rd, 412 KiB/s wr, 9 op/s 2023-05-08T10:01:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22653.083389 secs 2023-05-08T10:01:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22653.638886 secs 2023-05-08T10:01:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:54 smithi096 ceph-mon[124666]: pgmap v12137: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 812 KiB/s rd, 412 KiB/s wr, 9 op/s 2023-05-08T10:01:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22653.083389 secs 2023-05-08T10:01:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22653.638886 secs 2023-05-08T10:01:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:54 smithi186 ceph-mon[126480]: pgmap v12137: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 812 KiB/s rd, 412 KiB/s wr, 9 op/s 2023-05-08T10:01:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22653.083389 secs 2023-05-08T10:01:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22653.638886 secs 2023-05-08T10:01:56.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:56 smithi133 ceph-mon[125939]: pgmap v12138: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 697 KiB/s wr, 15 op/s 2023-05-08T10:01:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22654.926359 secs 2023-05-08T10:01:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:56 smithi096 ceph-mon[124666]: pgmap v12138: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 697 KiB/s wr, 15 op/s 2023-05-08T10:01:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22654.926359 secs 2023-05-08T10:01:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:56 smithi186 ceph-mon[126480]: pgmap v12138: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 697 KiB/s wr, 15 op/s 2023-05-08T10:01:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22654.926359 secs 2023-05-08T10:01:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:57 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:01:57.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:01:57.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:01:57.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:57 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:01:57.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:01:57.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:01:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:57 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:01:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:01:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:01:58.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:58 smithi133 ceph-mon[125939]: pgmap v12139: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 896 KiB/s rd, 656 KiB/s wr, 12 op/s 2023-05-08T10:01:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:58 smithi096 ceph-mon[124666]: pgmap v12139: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 896 KiB/s rd, 656 KiB/s wr, 12 op/s 2023-05-08T10:01:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:58 smithi186 ceph-mon[126480]: pgmap v12139: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 896 KiB/s rd, 656 KiB/s wr, 12 op/s 2023-05-08T10:01:59.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:01:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22658.083478 secs 2023-05-08T10:01:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:01:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22658.083478 secs 2023-05-08T10:01:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:01:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22658.083478 secs 2023-05-08T10:02:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:00 smithi096 ceph-mon[124666]: pgmap v12140: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 895 KiB/s rd, 655 KiB/s wr, 11 op/s 2023-05-08T10:02:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:00 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:02:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22659.926475 secs 2023-05-08T10:02:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:00 smithi186 ceph-mon[126480]: pgmap v12140: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 895 KiB/s rd, 655 KiB/s wr, 11 op/s 2023-05-08T10:02:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:00 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:02:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22659.926475 secs 2023-05-08T10:02:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:00 smithi133 ceph-mon[125939]: pgmap v12140: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 895 KiB/s rd, 655 KiB/s wr, 11 op/s 2023-05-08T10:02:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:00 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:02:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22659.926475 secs 2023-05-08T10:02:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:02:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:02:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:02:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:02:01.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:02:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:02:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:02 smithi186 ceph-mon[126480]: pgmap v12141: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 754 KiB/s wr, 16 op/s 2023-05-08T10:02:02.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:02 smithi133 ceph-mon[125939]: pgmap v12141: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 754 KiB/s wr, 16 op/s 2023-05-08T10:02:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:02 smithi096 ceph-mon[124666]: pgmap v12141: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 754 KiB/s wr, 16 op/s 2023-05-08T10:02:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:04 smithi186 ceph-mon[126480]: pgmap v12142: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 383 KiB/s wr, 11 op/s 2023-05-08T10:02:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22663.083591 secs 2023-05-08T10:02:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:04 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:02:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22663.639116 secs 2023-05-08T10:02:04.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:04 smithi133 ceph-mon[125939]: pgmap v12142: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 383 KiB/s wr, 11 op/s 2023-05-08T10:02:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22663.083591 secs 2023-05-08T10:02:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:04 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:02:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22663.639116 secs 2023-05-08T10:02:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:04 smithi096 ceph-mon[124666]: pgmap v12142: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 383 KiB/s wr, 11 op/s 2023-05-08T10:02:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22663.083591 secs 2023-05-08T10:02:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:04 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:02:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22663.639116 secs 2023-05-08T10:02:05.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22664.926598 secs 2023-05-08T10:02:05.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22664.926598 secs 2023-05-08T10:02:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22664.926598 secs 2023-05-08T10:02:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:06 smithi186 ceph-mon[126480]: pgmap v12143: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 829 KiB/s rd, 721 KiB/s wr, 30 op/s 2023-05-08T10:02:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:06 smithi186 ceph-mon[126480]: osdmap e836: 12 total, 12 up, 12 in 2023-05-08T10:02:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:06 smithi133 ceph-mon[125939]: pgmap v12143: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 829 KiB/s rd, 721 KiB/s wr, 30 op/s 2023-05-08T10:02:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:06 smithi133 ceph-mon[125939]: osdmap e836: 12 total, 12 up, 12 in 2023-05-08T10:02:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:06 smithi096 ceph-mon[124666]: pgmap v12143: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 829 KiB/s rd, 721 KiB/s wr, 30 op/s 2023-05-08T10:02:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:06 smithi096 ceph-mon[124666]: osdmap e836: 12 total, 12 up, 12 in 2023-05-08T10:02:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:08 smithi186 ceph-mon[126480]: pgmap v12145: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 524 KiB/s wr, 29 op/s 2023-05-08T10:02:08.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:08 smithi133 ceph-mon[125939]: pgmap v12145: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 524 KiB/s wr, 29 op/s 2023-05-08T10:02:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:08 smithi096 ceph-mon[124666]: pgmap v12145: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 524 KiB/s wr, 29 op/s 2023-05-08T10:02:09.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:02:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:02:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22668.083711 secs 2023-05-08T10:02:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:09 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:02:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22668.639222 secs 2023-05-08T10:02:09.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:02:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:02:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22668.083711 secs 2023-05-08T10:02:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:09 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:02:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22668.639222 secs 2023-05-08T10:02:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:02:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:02:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22668.083711 secs 2023-05-08T10:02:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:09 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:02:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22668.639222 secs 2023-05-08T10:02:10.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:10 smithi186 ceph-mon[126480]: pgmap v12146: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 524 KiB/s wr, 29 op/s 2023-05-08T10:02:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22669.926732 secs 2023-05-08T10:02:10.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:10 smithi133 ceph-mon[125939]: pgmap v12146: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 524 KiB/s wr, 29 op/s 2023-05-08T10:02:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22669.926732 secs 2023-05-08T10:02:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:10 smithi096 ceph-mon[124666]: pgmap v12146: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 524 KiB/s wr, 29 op/s 2023-05-08T10:02:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22669.926732 secs 2023-05-08T10:02:12.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:12 smithi186 ceph-mon[126480]: pgmap v12147: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 629 KiB/s rd, 639 KiB/s wr, 28 op/s 2023-05-08T10:02:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:12 smithi133 ceph-mon[125939]: pgmap v12147: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 629 KiB/s rd, 639 KiB/s wr, 28 op/s 2023-05-08T10:02:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:12 smithi096 ceph-mon[124666]: pgmap v12147: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 629 KiB/s rd, 639 KiB/s wr, 28 op/s 2023-05-08T10:02:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:14 smithi186 ceph-mon[126480]: pgmap v12148: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 629 KiB/s rd, 639 KiB/s wr, 28 op/s 2023-05-08T10:02:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22673.083816 secs 2023-05-08T10:02:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:14 smithi186 ceph-mon[126480]: osdmap e837: 12 total, 12 up, 12 in 2023-05-08T10:02:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22673.639355 secs 2023-05-08T10:02:14.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:14 smithi133 ceph-mon[125939]: pgmap v12148: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 629 KiB/s rd, 639 KiB/s wr, 28 op/s 2023-05-08T10:02:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22673.083816 secs 2023-05-08T10:02:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:14 smithi133 ceph-mon[125939]: osdmap e837: 12 total, 12 up, 12 in 2023-05-08T10:02:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22673.639355 secs 2023-05-08T10:02:14.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:14 smithi096 ceph-mon[124666]: pgmap v12148: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 629 KiB/s rd, 639 KiB/s wr, 28 op/s 2023-05-08T10:02:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22673.083816 secs 2023-05-08T10:02:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:14 smithi096 ceph-mon[124666]: osdmap e837: 12 total, 12 up, 12 in 2023-05-08T10:02:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22673.639355 secs 2023-05-08T10:02:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22674.926839 secs 2023-05-08T10:02:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22674.926839 secs 2023-05-08T10:02:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22674.926839 secs 2023-05-08T10:02:16.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:16 smithi186 ceph-mon[126480]: pgmap v12150: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 257 KiB/s wr, 8 op/s 2023-05-08T10:02:16.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:16 smithi133 ceph-mon[125939]: pgmap v12150: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 257 KiB/s wr, 8 op/s 2023-05-08T10:02:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:16 smithi096 ceph-mon[124666]: pgmap v12150: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 257 KiB/s wr, 8 op/s 2023-05-08T10:02:17.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:17 smithi186 ceph-mon[126480]: pgmap v12151: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 245 KiB/s wr, 8 op/s 2023-05-08T10:02:17.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:17 smithi133 ceph-mon[125939]: pgmap v12151: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 245 KiB/s wr, 8 op/s 2023-05-08T10:02:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:17 smithi096 ceph-mon[124666]: pgmap v12151: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 245 KiB/s wr, 8 op/s 2023-05-08T10:02:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22678.083936 secs 2023-05-08T10:02:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22678.083936 secs 2023-05-08T10:02:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22678.083936 secs 2023-05-08T10:02:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:19 smithi186 ceph-mon[126480]: pgmap v12152: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 245 KiB/s wr, 8 op/s 2023-05-08T10:02:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22678.639464 secs 2023-05-08T10:02:20.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:19 smithi133 ceph-mon[125939]: pgmap v12152: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 245 KiB/s wr, 8 op/s 2023-05-08T10:02:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22678.639464 secs 2023-05-08T10:02:20.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:19 smithi096 ceph-mon[124666]: pgmap v12152: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 245 KiB/s wr, 8 op/s 2023-05-08T10:02:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22678.639464 secs 2023-05-08T10:02:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22679.926936 secs 2023-05-08T10:02:21.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22679.926936 secs 2023-05-08T10:02:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22679.926936 secs 2023-05-08T10:02:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:21 smithi186 ceph-mon[126480]: pgmap v12153: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 7 op/s 2023-05-08T10:02:22.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:21 smithi133 ceph-mon[125939]: pgmap v12153: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 7 op/s 2023-05-08T10:02:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:21 smithi096 ceph-mon[124666]: pgmap v12153: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 7 op/s 2023-05-08T10:02:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:23 smithi186 ceph-mon[126480]: pgmap v12154: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 7 op/s 2023-05-08T10:02:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22683.084089 secs 2023-05-08T10:02:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:23 smithi133 ceph-mon[125939]: pgmap v12154: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 7 op/s 2023-05-08T10:02:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22683.084089 secs 2023-05-08T10:02:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:23 smithi096 ceph-mon[124666]: pgmap v12154: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 7 op/s 2023-05-08T10:02:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22683.084089 secs 2023-05-08T10:02:25.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22683.639583 secs 2023-05-08T10:02:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22683.639583 secs 2023-05-08T10:02:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22683.639583 secs 2023-05-08T10:02:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:25 smithi186 ceph-mon[126480]: pgmap v12155: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 8 op/s 2023-05-08T10:02:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22684.927052 secs 2023-05-08T10:02:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:25 smithi133 ceph-mon[125939]: pgmap v12155: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 8 op/s 2023-05-08T10:02:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22684.927052 secs 2023-05-08T10:02:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:25 smithi096 ceph-mon[124666]: pgmap v12155: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 8 op/s 2023-05-08T10:02:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22684.927052 secs 2023-05-08T10:02:28.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:27 smithi186 ceph-mon[126480]: pgmap v12156: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 6 op/s 2023-05-08T10:02:28.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:27 smithi133 ceph-mon[125939]: pgmap v12156: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 6 op/s 2023-05-08T10:02:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:27 smithi096 ceph-mon[124666]: pgmap v12156: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 6 op/s 2023-05-08T10:02:29.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22688.084228 secs 2023-05-08T10:02:29.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22688.084228 secs 2023-05-08T10:02:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22688.084228 secs 2023-05-08T10:02:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:29 smithi186 ceph-mon[126480]: pgmap v12157: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T10:02:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22688.639695 secs 2023-05-08T10:02:30.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:29 smithi133 ceph-mon[125939]: pgmap v12157: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T10:02:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22688.639695 secs 2023-05-08T10:02:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:29 smithi096 ceph-mon[124666]: pgmap v12157: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T10:02:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22688.639695 secs 2023-05-08T10:02:31.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22689.927156 secs 2023-05-08T10:02:31.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22689.927156 secs 2023-05-08T10:02:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22689.927156 secs 2023-05-08T10:02:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:31 smithi186 ceph-mon[126480]: pgmap v12158: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 73 KiB/s wr, 7 op/s 2023-05-08T10:02:32.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:31 smithi133 ceph-mon[125939]: pgmap v12158: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 73 KiB/s wr, 7 op/s 2023-05-08T10:02:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:31 smithi096 ceph-mon[124666]: pgmap v12158: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 73 KiB/s wr, 7 op/s 2023-05-08T10:02:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:33 smithi186 ceph-mon[126480]: pgmap v12159: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 73 KiB/s wr, 5 op/s 2023-05-08T10:02:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22693.084370 secs 2023-05-08T10:02:34.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:33 smithi133 ceph-mon[125939]: pgmap v12159: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 73 KiB/s wr, 5 op/s 2023-05-08T10:02:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22693.084370 secs 2023-05-08T10:02:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:33 smithi096 ceph-mon[124666]: pgmap v12159: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 73 KiB/s wr, 5 op/s 2023-05-08T10:02:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22693.084370 secs 2023-05-08T10:02:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22693.639798 secs 2023-05-08T10:02:35.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22693.639798 secs 2023-05-08T10:02:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22693.639798 secs 2023-05-08T10:02:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:35 smithi186 ceph-mon[126480]: pgmap v12160: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 74 KiB/s wr, 7 op/s 2023-05-08T10:02:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22694.927273 secs 2023-05-08T10:02:36.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:35 smithi133 ceph-mon[125939]: pgmap v12160: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 74 KiB/s wr, 7 op/s 2023-05-08T10:02:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22694.927273 secs 2023-05-08T10:02:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:35 smithi096 ceph-mon[124666]: pgmap v12160: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 74 KiB/s wr, 7 op/s 2023-05-08T10:02:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22694.927273 secs 2023-05-08T10:02:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:37 smithi133 ceph-mon[125939]: pgmap v12161: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 74 KiB/s wr, 6 op/s 2023-05-08T10:02:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:37 smithi096 ceph-mon[124666]: pgmap v12161: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 74 KiB/s wr, 6 op/s 2023-05-08T10:02:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:37 smithi186 ceph-mon[126480]: pgmap v12161: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 74 KiB/s wr, 6 op/s 2023-05-08T10:02:39.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22698.084477 secs 2023-05-08T10:02:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22698.084477 secs 2023-05-08T10:02:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22698.084477 secs 2023-05-08T10:02:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:39 smithi133 ceph-mon[125939]: pgmap v12162: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 74 KiB/s wr, 6 op/s 2023-05-08T10:02:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22698.639921 secs 2023-05-08T10:02:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:39 smithi096 ceph-mon[124666]: pgmap v12162: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 74 KiB/s wr, 6 op/s 2023-05-08T10:02:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22698.639921 secs 2023-05-08T10:02:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:39 smithi186 ceph-mon[126480]: pgmap v12162: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 74 KiB/s wr, 6 op/s 2023-05-08T10:02:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22698.639921 secs 2023-05-08T10:02:42.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:41 smithi133 ceph-mon[125939]: pgmap v12163: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 186 KiB/s wr, 9 op/s 2023-05-08T10:02:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:41 smithi096 ceph-mon[124666]: pgmap v12163: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 186 KiB/s wr, 9 op/s 2023-05-08T10:02:42.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:41 smithi186 ceph-mon[126480]: pgmap v12163: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 186 KiB/s wr, 9 op/s 2023-05-08T10:02:44.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:43 smithi133 ceph-mon[125939]: pgmap v12164: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 113 KiB/s wr, 6 op/s 2023-05-08T10:02:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22703.084592 secs 2023-05-08T10:02:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:43 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:02:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:43 smithi096 ceph-mon[124666]: pgmap v12164: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 113 KiB/s wr, 6 op/s 2023-05-08T10:02:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22703.084592 secs 2023-05-08T10:02:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:43 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:02:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:43 smithi186 ceph-mon[126480]: pgmap v12164: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 113 KiB/s wr, 6 op/s 2023-05-08T10:02:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22703.084592 secs 2023-05-08T10:02:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:43 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:02:45.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:44 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:02:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:44 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:02:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:44 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:02:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22703.640039 secs 2023-05-08T10:02:45.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:44 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:02:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:44 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:02:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:44 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:02:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22703.640039 secs 2023-05-08T10:02:45.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:44 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:02:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:44 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:02:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:44 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:02:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22703.640039 secs 2023-05-08T10:02:46.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:45 smithi133 ceph-mon[125939]: pgmap v12165: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 113 KiB/s wr, 9 op/s 2023-05-08T10:02:46.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:45 smithi096 ceph-mon[124666]: pgmap v12165: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 113 KiB/s wr, 9 op/s 2023-05-08T10:02:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:45 smithi186 ceph-mon[126480]: pgmap v12165: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 113 KiB/s wr, 9 op/s 2023-05-08T10:02:47.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:46 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:02:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:46 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:02:47.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:46 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:02:48.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:47 smithi133 ceph-mon[125939]: pgmap v12166: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 455 KiB/s wr, 8 op/s 2023-05-08T10:02:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:47 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:02:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:47 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:02:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:47 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:02:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:47 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:02:48.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:47 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T10:02:48.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:47 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T10:02:48.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:47 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:02:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:47 smithi096 ceph-mon[124666]: pgmap v12166: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 455 KiB/s wr, 8 op/s 2023-05-08T10:02:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:47 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:02:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:47 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:02:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:47 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:02:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:47 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:02:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:47 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T10:02:48.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:47 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T10:02:48.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:47 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:02:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:47 smithi186 ceph-mon[126480]: pgmap v12166: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 455 KiB/s wr, 8 op/s 2023-05-08T10:02:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:47 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:02:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:47 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:02:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:47 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:02:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:47 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:02:48.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:47 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T10:02:48.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:47 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T10:02:48.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:47 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:02:49.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22708.084700 secs 2023-05-08T10:02:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22708.084700 secs 2023-05-08T10:02:49.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22708.084700 secs 2023-05-08T10:02:50.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:49 smithi133 ceph-mon[125939]: pgmap v12167: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 455 KiB/s wr, 7 op/s 2023-05-08T10:02:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:49 smithi096 ceph-mon[124666]: pgmap v12167: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 455 KiB/s wr, 7 op/s 2023-05-08T10:02:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:49 smithi186 ceph-mon[126480]: pgmap v12167: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 455 KiB/s wr, 7 op/s 2023-05-08T10:02:51.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22709.927642 secs 2023-05-08T10:02:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22709.927642 secs 2023-05-08T10:02:51.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22709.927642 secs 2023-05-08T10:02:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:51 smithi133 ceph-mon[125939]: pgmap v12168: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 792 KiB/s rd, 482 KiB/s wr, 12 op/s 2023-05-08T10:02:52.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:02:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:51 smithi096 ceph-mon[124666]: pgmap v12168: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 792 KiB/s rd, 482 KiB/s wr, 12 op/s 2023-05-08T10:02:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:02:52.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:51 smithi186 ceph-mon[126480]: pgmap v12168: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 792 KiB/s rd, 482 KiB/s wr, 12 op/s 2023-05-08T10:02:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:02:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:02:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:02:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:02:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:02:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:02:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:02:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:02:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:02:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:02:54.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:53 smithi133 ceph-mon[125939]: pgmap v12169: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 370 KiB/s wr, 8 op/s 2023-05-08T10:02:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22713.084838 secs 2023-05-08T10:02:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:53 smithi096 ceph-mon[124666]: pgmap v12169: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 370 KiB/s wr, 8 op/s 2023-05-08T10:02:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22713.084838 secs 2023-05-08T10:02:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:53 smithi186 ceph-mon[126480]: pgmap v12169: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 370 KiB/s wr, 8 op/s 2023-05-08T10:02:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22713.084838 secs 2023-05-08T10:02:55.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22713.640303 secs 2023-05-08T10:02:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22713.640303 secs 2023-05-08T10:02:55.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22713.640303 secs 2023-05-08T10:02:56.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:55 smithi133 ceph-mon[125939]: pgmap v12170: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 985 KiB/s rd, 664 KiB/s wr, 13 op/s 2023-05-08T10:02:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22714.927746 secs 2023-05-08T10:02:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:55 smithi096 ceph-mon[124666]: pgmap v12170: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 985 KiB/s rd, 664 KiB/s wr, 13 op/s 2023-05-08T10:02:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22714.927746 secs 2023-05-08T10:02:56.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:55 smithi186 ceph-mon[126480]: pgmap v12170: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 985 KiB/s rd, 664 KiB/s wr, 13 op/s 2023-05-08T10:02:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22714.927746 secs 2023-05-08T10:02:57.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:56 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:02:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:02:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:02:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:56 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:02:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:02:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:02:57.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:56 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:02:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:02:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:02:58.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:57 smithi133 ceph-mon[125939]: pgmap v12171: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 666 KiB/s wr, 13 op/s 2023-05-08T10:02:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:57 smithi096 ceph-mon[124666]: pgmap v12171: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 666 KiB/s wr, 13 op/s 2023-05-08T10:02:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:57 smithi186 ceph-mon[126480]: pgmap v12171: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 666 KiB/s wr, 13 op/s 2023-05-08T10:02:59.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22718.084939 secs 2023-05-08T10:02:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22718.084939 secs 2023-05-08T10:02:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22718.084939 secs 2023-05-08T10:03:00.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:59 smithi133 ceph-mon[125939]: pgmap v12172: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 918 KiB/s rd, 324 KiB/s wr, 11 op/s 2023-05-08T10:03:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:02:59 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:03:00.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:59 smithi096 ceph-mon[124666]: pgmap v12172: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 918 KiB/s rd, 324 KiB/s wr, 11 op/s 2023-05-08T10:03:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:02:59 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:03:00.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:59 smithi186 ceph-mon[126480]: pgmap v12172: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 918 KiB/s rd, 324 KiB/s wr, 11 op/s 2023-05-08T10:03:00.373 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:02:59 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:03:01.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:03:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:03:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22719.927886 secs 2023-05-08T10:03:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:03:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:03:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22719.927886 secs 2023-05-08T10:03:01.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:03:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:03:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22719.927886 secs 2023-05-08T10:03:02.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:01 smithi133 ceph-mon[125939]: pgmap v12173: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 497 KiB/s wr, 16 op/s 2023-05-08T10:03:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:01 smithi096 ceph-mon[124666]: pgmap v12173: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 497 KiB/s wr, 16 op/s 2023-05-08T10:03:02.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:01 smithi186 ceph-mon[126480]: pgmap v12173: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 497 KiB/s wr, 16 op/s 2023-05-08T10:03:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:03 smithi133 ceph-mon[125939]: pgmap v12174: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 469 KiB/s wr, 11 op/s 2023-05-08T10:03:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22723.085056 secs 2023-05-08T10:03:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:03 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:03:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22723.640544 secs 2023-05-08T10:03:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:03 smithi096 ceph-mon[124666]: pgmap v12174: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 469 KiB/s wr, 11 op/s 2023-05-08T10:03:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22723.085056 secs 2023-05-08T10:03:04.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:03 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:03:04.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22723.640544 secs 2023-05-08T10:03:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:03 smithi186 ceph-mon[126480]: pgmap v12174: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 469 KiB/s wr, 11 op/s 2023-05-08T10:03:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22723.085056 secs 2023-05-08T10:03:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:03 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:03:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22723.640544 secs 2023-05-08T10:03:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:05 smithi133 ceph-mon[125939]: pgmap v12175: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 778 KiB/s rd, 760 KiB/s wr, 30 op/s 2023-05-08T10:03:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22724.927977 secs 2023-05-08T10:03:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:05 smithi096 ceph-mon[124666]: pgmap v12175: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 778 KiB/s rd, 760 KiB/s wr, 30 op/s 2023-05-08T10:03:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22724.927977 secs 2023-05-08T10:03:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:05 smithi186 ceph-mon[126480]: pgmap v12175: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 778 KiB/s rd, 760 KiB/s wr, 30 op/s 2023-05-08T10:03:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22724.927977 secs 2023-05-08T10:03:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:06 smithi096 ceph-mon[124666]: osdmap e838: 12 total, 12 up, 12 in 2023-05-08T10:03:07.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:06 smithi186 ceph-mon[126480]: osdmap e838: 12 total, 12 up, 12 in 2023-05-08T10:03:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:06 smithi133 ceph-mon[125939]: osdmap e838: 12 total, 12 up, 12 in 2023-05-08T10:03:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:07 smithi096 ceph-mon[124666]: pgmap v12177: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 556 KiB/s wr, 29 op/s 2023-05-08T10:03:08.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:07 smithi186 ceph-mon[126480]: pgmap v12177: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 556 KiB/s wr, 29 op/s 2023-05-08T10:03:08.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:07 smithi133 ceph-mon[125939]: pgmap v12177: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 556 KiB/s wr, 29 op/s 2023-05-08T10:03:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:03:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:03:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22728.085190 secs 2023-05-08T10:03:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:09 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:03:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22728.640656 secs 2023-05-08T10:03:09.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:03:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:03:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22728.085190 secs 2023-05-08T10:03:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:09 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:03:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22728.640656 secs 2023-05-08T10:03:09.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:03:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:03:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22728.085190 secs 2023-05-08T10:03:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:09 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:03:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22728.640656 secs 2023-05-08T10:03:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:10 smithi096 ceph-mon[124666]: pgmap v12178: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 556 KiB/s wr, 29 op/s 2023-05-08T10:03:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:10 smithi186 ceph-mon[126480]: pgmap v12178: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 556 KiB/s wr, 29 op/s 2023-05-08T10:03:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:10 smithi133 ceph-mon[125939]: pgmap v12178: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 556 KiB/s wr, 29 op/s 2023-05-08T10:03:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22729.928072 secs 2023-05-08T10:03:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22729.928072 secs 2023-05-08T10:03:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22729.928072 secs 2023-05-08T10:03:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:12 smithi186 ceph-mon[126480]: pgmap v12179: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 395 KiB/s wr, 28 op/s 2023-05-08T10:03:12.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:12 smithi133 ceph-mon[125939]: pgmap v12179: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 395 KiB/s wr, 28 op/s 2023-05-08T10:03:12.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:12 smithi096 ceph-mon[124666]: pgmap v12179: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 395 KiB/s wr, 28 op/s 2023-05-08T10:03:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:14 smithi186 ceph-mon[126480]: pgmap v12180: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 395 KiB/s wr, 28 op/s 2023-05-08T10:03:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22733.085359 secs 2023-05-08T10:03:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:14 smithi186 ceph-mon[126480]: osdmap e839: 12 total, 12 up, 12 in 2023-05-08T10:03:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22733.640739 secs 2023-05-08T10:03:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:14 smithi133 ceph-mon[125939]: pgmap v12180: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 395 KiB/s wr, 28 op/s 2023-05-08T10:03:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22733.085359 secs 2023-05-08T10:03:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:14 smithi133 ceph-mon[125939]: osdmap e839: 12 total, 12 up, 12 in 2023-05-08T10:03:14.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22733.640739 secs 2023-05-08T10:03:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:14 smithi096 ceph-mon[124666]: pgmap v12180: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 395 KiB/s wr, 28 op/s 2023-05-08T10:03:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22733.085359 secs 2023-05-08T10:03:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:14 smithi096 ceph-mon[124666]: osdmap e839: 12 total, 12 up, 12 in 2023-05-08T10:03:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22733.640739 secs 2023-05-08T10:03:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:16 smithi186 ceph-mon[126480]: pgmap v12182: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 278 KiB/s wr, 9 op/s 2023-05-08T10:03:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22734.928193 secs 2023-05-08T10:03:16.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:16 smithi133 ceph-mon[125939]: pgmap v12182: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 278 KiB/s wr, 9 op/s 2023-05-08T10:03:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22734.928193 secs 2023-05-08T10:03:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:16 smithi096 ceph-mon[124666]: pgmap v12182: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 278 KiB/s wr, 9 op/s 2023-05-08T10:03:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22734.928193 secs 2023-05-08T10:03:18.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:18 smithi186 ceph-mon[126480]: pgmap v12183: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 246 KiB/s wr, 8 op/s 2023-05-08T10:03:18.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:18 smithi133 ceph-mon[125939]: pgmap v12183: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 246 KiB/s wr, 8 op/s 2023-05-08T10:03:18.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:18 smithi096 ceph-mon[124666]: pgmap v12183: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 246 KiB/s wr, 8 op/s 2023-05-08T10:03:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22738.085412 secs 2023-05-08T10:03:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22738.640828 secs 2023-05-08T10:03:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22738.085412 secs 2023-05-08T10:03:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22738.640828 secs 2023-05-08T10:03:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22738.085412 secs 2023-05-08T10:03:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22738.640828 secs 2023-05-08T10:03:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:20 smithi186 ceph-mon[126480]: pgmap v12184: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 246 KiB/s wr, 8 op/s 2023-05-08T10:03:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:20 smithi133 ceph-mon[125939]: pgmap v12184: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 246 KiB/s wr, 8 op/s 2023-05-08T10:03:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:20 smithi096 ceph-mon[124666]: pgmap v12184: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 246 KiB/s wr, 8 op/s 2023-05-08T10:03:21.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22739.928303 secs 2023-05-08T10:03:21.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22739.928303 secs 2023-05-08T10:03:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22739.928303 secs 2023-05-08T10:03:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:22 smithi186 ceph-mon[126480]: pgmap v12185: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 200 KiB/s wr, 6 op/s 2023-05-08T10:03:22.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:22 smithi133 ceph-mon[125939]: pgmap v12185: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 200 KiB/s wr, 6 op/s 2023-05-08T10:03:22.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:22 smithi096 ceph-mon[124666]: pgmap v12185: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 200 KiB/s wr, 6 op/s 2023-05-08T10:03:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:24 smithi186 ceph-mon[126480]: pgmap v12186: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 200 KiB/s wr, 6 op/s 2023-05-08T10:03:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22743.085546 secs 2023-05-08T10:03:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22743.640926 secs 2023-05-08T10:03:24.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:24 smithi133 ceph-mon[125939]: pgmap v12186: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 200 KiB/s wr, 6 op/s 2023-05-08T10:03:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22743.085546 secs 2023-05-08T10:03:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22743.640926 secs 2023-05-08T10:03:24.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:24 smithi096 ceph-mon[124666]: pgmap v12186: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 200 KiB/s wr, 6 op/s 2023-05-08T10:03:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22743.085546 secs 2023-05-08T10:03:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22743.640926 secs 2023-05-08T10:03:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:26 smithi186 ceph-mon[126480]: pgmap v12187: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 248 KiB/s wr, 8 op/s 2023-05-08T10:03:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22744.928442 secs 2023-05-08T10:03:26.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:26 smithi133 ceph-mon[125939]: pgmap v12187: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 248 KiB/s wr, 8 op/s 2023-05-08T10:03:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22744.928442 secs 2023-05-08T10:03:26.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:26 smithi096 ceph-mon[124666]: pgmap v12187: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 248 KiB/s wr, 8 op/s 2023-05-08T10:03:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22744.928442 secs 2023-05-08T10:03:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:28 smithi186 ceph-mon[126480]: pgmap v12188: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 61 KiB/s wr, 5 op/s 2023-05-08T10:03:28.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:28 smithi133 ceph-mon[125939]: pgmap v12188: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 61 KiB/s wr, 5 op/s 2023-05-08T10:03:28.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:28 smithi096 ceph-mon[124666]: pgmap v12188: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 61 KiB/s wr, 5 op/s 2023-05-08T10:03:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22748.085674 secs 2023-05-08T10:03:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22748.641059 secs 2023-05-08T10:03:29.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22748.085674 secs 2023-05-08T10:03:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22748.641059 secs 2023-05-08T10:03:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22748.085674 secs 2023-05-08T10:03:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22748.641059 secs 2023-05-08T10:03:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:30 smithi186 ceph-mon[126480]: pgmap v12189: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 61 KiB/s wr, 5 op/s 2023-05-08T10:03:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:30 smithi133 ceph-mon[125939]: pgmap v12189: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 61 KiB/s wr, 5 op/s 2023-05-08T10:03:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:30 smithi096 ceph-mon[124666]: pgmap v12189: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 61 KiB/s wr, 5 op/s 2023-05-08T10:03:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22749.928522 secs 2023-05-08T10:03:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22749.928522 secs 2023-05-08T10:03:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22749.928522 secs 2023-05-08T10:03:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:32 smithi186 ceph-mon[126480]: pgmap v12190: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 61 KiB/s wr, 7 op/s 2023-05-08T10:03:32.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:32 smithi133 ceph-mon[125939]: pgmap v12190: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 61 KiB/s wr, 7 op/s 2023-05-08T10:03:32.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:32 smithi096 ceph-mon[124666]: pgmap v12190: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 61 KiB/s wr, 7 op/s 2023-05-08T10:03:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:34 smithi186 ceph-mon[126480]: pgmap v12191: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 61 KiB/s wr, 5 op/s 2023-05-08T10:03:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22753.085747 secs 2023-05-08T10:03:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22753.641198 secs 2023-05-08T10:03:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:34 smithi133 ceph-mon[125939]: pgmap v12191: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 61 KiB/s wr, 5 op/s 2023-05-08T10:03:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22753.085747 secs 2023-05-08T10:03:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22753.641198 secs 2023-05-08T10:03:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:34 smithi096 ceph-mon[124666]: pgmap v12191: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 61 KiB/s wr, 5 op/s 2023-05-08T10:03:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22753.085747 secs 2023-05-08T10:03:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22753.641198 secs 2023-05-08T10:03:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:36 smithi186 ceph-mon[126480]: pgmap v12192: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 61 KiB/s wr, 7 op/s 2023-05-08T10:03:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22754.928659 secs 2023-05-08T10:03:36.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:36 smithi133 ceph-mon[125939]: pgmap v12192: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 61 KiB/s wr, 7 op/s 2023-05-08T10:03:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22754.928659 secs 2023-05-08T10:03:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:36 smithi096 ceph-mon[124666]: pgmap v12192: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 61 KiB/s wr, 7 op/s 2023-05-08T10:03:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22754.928659 secs 2023-05-08T10:03:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:38 smithi186 ceph-mon[126480]: pgmap v12193: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 682 B/s wr, 6 op/s 2023-05-08T10:03:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:38 smithi133 ceph-mon[125939]: pgmap v12193: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 682 B/s wr, 6 op/s 2023-05-08T10:03:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:38 smithi096 ceph-mon[124666]: pgmap v12193: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 682 B/s wr, 6 op/s 2023-05-08T10:03:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22758.085881 secs 2023-05-08T10:03:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22758.641316 secs 2023-05-08T10:03:39.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22758.085881 secs 2023-05-08T10:03:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22758.641316 secs 2023-05-08T10:03:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22758.085881 secs 2023-05-08T10:03:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22758.641316 secs 2023-05-08T10:03:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:40 smithi186 ceph-mon[126480]: pgmap v12194: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 682 B/s wr, 5 op/s 2023-05-08T10:03:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:40 smithi133 ceph-mon[125939]: pgmap v12194: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 682 B/s wr, 5 op/s 2023-05-08T10:03:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:40 smithi096 ceph-mon[124666]: pgmap v12194: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 682 B/s wr, 5 op/s 2023-05-08T10:03:42.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:42 smithi186 ceph-mon[126480]: pgmap v12195: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 79 KiB/s wr, 8 op/s 2023-05-08T10:03:42.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:42 smithi133 ceph-mon[125939]: pgmap v12195: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 79 KiB/s wr, 8 op/s 2023-05-08T10:03:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:42 smithi096 ceph-mon[124666]: pgmap v12195: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 79 KiB/s wr, 8 op/s 2023-05-08T10:03:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:44 smithi186 ceph-mon[126480]: pgmap v12196: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 79 KiB/s wr, 6 op/s 2023-05-08T10:03:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22763.086011 secs 2023-05-08T10:03:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:44 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:03:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22763.641415 secs 2023-05-08T10:03:44.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:44 smithi133 ceph-mon[125939]: pgmap v12196: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 79 KiB/s wr, 6 op/s 2023-05-08T10:03:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22763.086011 secs 2023-05-08T10:03:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:44 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:03:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22763.641415 secs 2023-05-08T10:03:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:44 smithi096 ceph-mon[124666]: pgmap v12196: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 79 KiB/s wr, 6 op/s 2023-05-08T10:03:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22763.086011 secs 2023-05-08T10:03:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:44 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:03:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22763.641415 secs 2023-05-08T10:03:45.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:45 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:03:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:45 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:03:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:45 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:03:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:45 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:03:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:45 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:03:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:45 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:03:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:45 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:03:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:45 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:03:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:45 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:03:46.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:46 smithi186 ceph-mon[126480]: pgmap v12197: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 89 KiB/s wr, 9 op/s 2023-05-08T10:03:46.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:46 smithi133 ceph-mon[125939]: pgmap v12197: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 89 KiB/s wr, 9 op/s 2023-05-08T10:03:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:46 smithi096 ceph-mon[124666]: pgmap v12197: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 89 KiB/s wr, 9 op/s 2023-05-08T10:03:48.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:48 smithi186 ceph-mon[126480]: pgmap v12198: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 89 KiB/s wr, 7 op/s 2023-05-08T10:03:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:48 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:03:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:48 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:03:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:48 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:03:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:48 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:03:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:48 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:03:48.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:48 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:03:48.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:48 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:03:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:48 smithi133 ceph-mon[125939]: pgmap v12198: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 89 KiB/s wr, 7 op/s 2023-05-08T10:03:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:48 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:03:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:48 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:03:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:48 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:03:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:48 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:03:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:48 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:03:48.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:48 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:03:48.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:48 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:03:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:48 smithi096 ceph-mon[124666]: pgmap v12198: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 89 KiB/s wr, 7 op/s 2023-05-08T10:03:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:48 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:03:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:48 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:03:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:48 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:03:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:48 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:03:48.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:48 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:03:48.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:48 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:03:48.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:48 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:03:49.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22768.086082 secs 2023-05-08T10:03:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:49 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:03:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:49 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:03:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:49 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:03:49.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22768.086082 secs 2023-05-08T10:03:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:49 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:03:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:49 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:03:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:49 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:03:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22768.086082 secs 2023-05-08T10:03:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:49 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:03:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:49 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:03:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:49 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:03:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:50 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:03:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:50 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T10:03:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:50 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T10:03:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:50 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:03:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:50 smithi186 ceph-mon[126480]: pgmap v12199: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 88 KiB/s wr, 6 op/s 2023-05-08T10:03:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:50 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:03:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:50 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T10:03:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:50 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T10:03:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:50 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:03:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:50 smithi133 ceph-mon[125939]: pgmap v12199: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 88 KiB/s wr, 6 op/s 2023-05-08T10:03:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:50 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:03:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:50 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T10:03:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:50 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T10:03:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:50 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:03:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:50 smithi096 ceph-mon[124666]: pgmap v12199: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 88 KiB/s wr, 6 op/s 2023-05-08T10:03:52.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:52 smithi133 ceph-mon[125939]: pgmap v12200: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 457 KiB/s wr, 12 op/s 2023-05-08T10:03:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:03:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:52 smithi096 ceph-mon[124666]: pgmap v12200: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 457 KiB/s wr, 12 op/s 2023-05-08T10:03:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:03:52.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:52 smithi186 ceph-mon[126480]: pgmap v12200: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 457 KiB/s wr, 12 op/s 2023-05-08T10:03:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:03:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:53 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:03:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:03:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:03:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:53 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:03:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:03:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:03:53.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:53 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:03:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:03:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:03:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:54 smithi133 ceph-mon[125939]: pgmap v12201: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 379 KiB/s wr, 9 op/s 2023-05-08T10:03:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22773.086202 secs 2023-05-08T10:03:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22773.641653 secs 2023-05-08T10:03:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:54 smithi096 ceph-mon[124666]: pgmap v12201: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 379 KiB/s wr, 9 op/s 2023-05-08T10:03:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22773.086202 secs 2023-05-08T10:03:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22773.641653 secs 2023-05-08T10:03:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:54 smithi186 ceph-mon[126480]: pgmap v12201: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 379 KiB/s wr, 9 op/s 2023-05-08T10:03:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22773.086202 secs 2023-05-08T10:03:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22773.641653 secs 2023-05-08T10:03:56.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:56 smithi133 ceph-mon[125939]: pgmap v12202: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 883 KiB/s rd, 701 KiB/s wr, 15 op/s 2023-05-08T10:03:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22774.929046 secs 2023-05-08T10:03:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:56 smithi096 ceph-mon[124666]: pgmap v12202: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 883 KiB/s rd, 701 KiB/s wr, 15 op/s 2023-05-08T10:03:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22774.929046 secs 2023-05-08T10:03:56.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:56 smithi186 ceph-mon[126480]: pgmap v12202: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 883 KiB/s rd, 701 KiB/s wr, 15 op/s 2023-05-08T10:03:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22774.929046 secs 2023-05-08T10:03:57.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:03:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:03:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:03:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:03:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:03:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:03:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:03:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:03:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:03:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:58 smithi133 ceph-mon[125939]: pgmap v12203: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 793 KiB/s rd, 694 KiB/s wr, 12 op/s 2023-05-08T10:03:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:58 smithi096 ceph-mon[124666]: pgmap v12203: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 793 KiB/s rd, 694 KiB/s wr, 12 op/s 2023-05-08T10:03:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:58 smithi186 ceph-mon[126480]: pgmap v12203: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 793 KiB/s rd, 694 KiB/s wr, 12 op/s 2023-05-08T10:03:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22778.086325 secs 2023-05-08T10:03:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:03:59 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:03:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22778.086325 secs 2023-05-08T10:03:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:03:59 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:03:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22778.086325 secs 2023-05-08T10:03:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:03:59 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:04:00.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:00 smithi133 ceph-mon[125939]: pgmap v12204: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 793 KiB/s rd, 693 KiB/s wr, 11 op/s 2023-05-08T10:04:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:00 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:04:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:00 smithi096 ceph-mon[124666]: pgmap v12204: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 793 KiB/s rd, 693 KiB/s wr, 11 op/s 2023-05-08T10:04:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:00 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:04:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:00 smithi186 ceph-mon[126480]: pgmap v12204: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 793 KiB/s rd, 693 KiB/s wr, 11 op/s 2023-05-08T10:04:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:00 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:04:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:04:01.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:04:01.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22779.929166 secs 2023-05-08T10:04:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:04:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:04:01.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22779.929166 secs 2023-05-08T10:04:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:04:01.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:04:01.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22779.929166 secs 2023-05-08T10:04:02.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:02 smithi133 ceph-mon[125939]: pgmap v12205: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 954 KiB/s rd, 867 KiB/s wr, 17 op/s 2023-05-08T10:04:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:02 smithi096 ceph-mon[124666]: pgmap v12205: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 954 KiB/s rd, 867 KiB/s wr, 17 op/s 2023-05-08T10:04:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:02 smithi186 ceph-mon[126480]: pgmap v12205: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 954 KiB/s rd, 867 KiB/s wr, 17 op/s 2023-05-08T10:04:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:04 smithi133 ceph-mon[125939]: pgmap v12206: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 541 KiB/s rd, 498 KiB/s wr, 11 op/s 2023-05-08T10:04:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22783.086450 secs 2023-05-08T10:04:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:04 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:04:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22783.641888 secs 2023-05-08T10:04:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:04 smithi096 ceph-mon[124666]: pgmap v12206: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 541 KiB/s rd, 498 KiB/s wr, 11 op/s 2023-05-08T10:04:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22783.086450 secs 2023-05-08T10:04:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:04 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:04:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22783.641888 secs 2023-05-08T10:04:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:04 smithi186 ceph-mon[126480]: pgmap v12206: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 541 KiB/s rd, 498 KiB/s wr, 11 op/s 2023-05-08T10:04:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22783.086450 secs 2023-05-08T10:04:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:04 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:04:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22783.641888 secs 2023-05-08T10:04:06.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:06 smithi133 ceph-mon[125939]: pgmap v12207: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 772 KiB/s rd, 764 KiB/s wr, 30 op/s 2023-05-08T10:04:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22784.929278 secs 2023-05-08T10:04:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:06 smithi096 ceph-mon[124666]: pgmap v12207: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 772 KiB/s rd, 764 KiB/s wr, 30 op/s 2023-05-08T10:04:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22784.929278 secs 2023-05-08T10:04:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:06 smithi186 ceph-mon[126480]: pgmap v12207: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 772 KiB/s rd, 764 KiB/s wr, 30 op/s 2023-05-08T10:04:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22784.929278 secs 2023-05-08T10:04:07.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:07 smithi133 ceph-mon[125939]: osdmap e840: 12 total, 12 up, 12 in 2023-05-08T10:04:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:07 smithi096 ceph-mon[124666]: osdmap e840: 12 total, 12 up, 12 in 2023-05-08T10:04:07.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:07 smithi186 ceph-mon[126480]: osdmap e840: 12 total, 12 up, 12 in 2023-05-08T10:04:08.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:08 smithi133 ceph-mon[125939]: pgmap v12209: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 487 KiB/s rd, 528 KiB/s wr, 29 op/s 2023-05-08T10:04:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:08 smithi096 ceph-mon[124666]: pgmap v12209: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 487 KiB/s rd, 528 KiB/s wr, 29 op/s 2023-05-08T10:04:08.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:08 smithi186 ceph-mon[126480]: pgmap v12209: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 487 KiB/s rd, 528 KiB/s wr, 29 op/s 2023-05-08T10:04:09.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:04:09.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:04:09.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22788.086560 secs 2023-05-08T10:04:09.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:09 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:04:09.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22788.642007 secs 2023-05-08T10:04:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:04:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:04:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22788.086560 secs 2023-05-08T10:04:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:09 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:04:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22788.642007 secs 2023-05-08T10:04:09.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:04:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:04:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22788.086560 secs 2023-05-08T10:04:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:09 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:04:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22788.642007 secs 2023-05-08T10:04:10.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:10 smithi133 ceph-mon[125939]: pgmap v12210: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 487 KiB/s rd, 528 KiB/s wr, 29 op/s 2023-05-08T10:04:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:10 smithi096 ceph-mon[124666]: pgmap v12210: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 487 KiB/s rd, 528 KiB/s wr, 29 op/s 2023-05-08T10:04:10.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:10 smithi186 ceph-mon[126480]: pgmap v12210: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 487 KiB/s rd, 528 KiB/s wr, 29 op/s 2023-05-08T10:04:11.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22789.929413 secs 2023-05-08T10:04:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22789.929413 secs 2023-05-08T10:04:11.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22789.929413 secs 2023-05-08T10:04:12.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:12 smithi133 ceph-mon[125939]: pgmap v12211: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 366 KiB/s wr, 27 op/s 2023-05-08T10:04:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:12 smithi096 ceph-mon[124666]: pgmap v12211: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 366 KiB/s wr, 27 op/s 2023-05-08T10:04:12.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:12 smithi186 ceph-mon[126480]: pgmap v12211: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 366 KiB/s wr, 27 op/s 2023-05-08T10:04:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:14 smithi133 ceph-mon[125939]: pgmap v12212: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 366 KiB/s wr, 27 op/s 2023-05-08T10:04:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22793.086690 secs 2023-05-08T10:04:14.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:14 smithi133 ceph-mon[125939]: osdmap e841: 12 total, 12 up, 12 in 2023-05-08T10:04:14.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22793.642132 secs 2023-05-08T10:04:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:14 smithi096 ceph-mon[124666]: pgmap v12212: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 366 KiB/s wr, 27 op/s 2023-05-08T10:04:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22793.086690 secs 2023-05-08T10:04:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:14 smithi096 ceph-mon[124666]: osdmap e841: 12 total, 12 up, 12 in 2023-05-08T10:04:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22793.642132 secs 2023-05-08T10:04:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:14 smithi186 ceph-mon[126480]: pgmap v12212: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 366 KiB/s wr, 27 op/s 2023-05-08T10:04:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22793.086690 secs 2023-05-08T10:04:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:14 smithi186 ceph-mon[126480]: osdmap e841: 12 total, 12 up, 12 in 2023-05-08T10:04:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22793.642132 secs 2023-05-08T10:04:16.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:16 smithi133 ceph-mon[125939]: pgmap v12214: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 288 KiB/s rd, 286 KiB/s wr, 9 op/s 2023-05-08T10:04:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22794.929535 secs 2023-05-08T10:04:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:16 smithi096 ceph-mon[124666]: pgmap v12214: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 288 KiB/s rd, 286 KiB/s wr, 9 op/s 2023-05-08T10:04:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22794.929535 secs 2023-05-08T10:04:16.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:16 smithi186 ceph-mon[126480]: pgmap v12214: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 288 KiB/s rd, 286 KiB/s wr, 9 op/s 2023-05-08T10:04:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22794.929535 secs 2023-05-08T10:04:18.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:18 smithi133 ceph-mon[125939]: pgmap v12215: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 247 KiB/s wr, 9 op/s 2023-05-08T10:04:18.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:18 smithi096 ceph-mon[124666]: pgmap v12215: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 247 KiB/s wr, 9 op/s 2023-05-08T10:04:18.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:18 smithi186 ceph-mon[126480]: pgmap v12215: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 247 KiB/s wr, 9 op/s 2023-05-08T10:04:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22798.086825 secs 2023-05-08T10:04:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22798.642231 secs 2023-05-08T10:04:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22798.086825 secs 2023-05-08T10:04:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22798.642231 secs 2023-05-08T10:04:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22798.086825 secs 2023-05-08T10:04:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22798.642231 secs 2023-05-08T10:04:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:20 smithi133 ceph-mon[125939]: pgmap v12216: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 247 KiB/s wr, 9 op/s 2023-05-08T10:04:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:20 smithi096 ceph-mon[124666]: pgmap v12216: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 247 KiB/s wr, 9 op/s 2023-05-08T10:04:20.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:20 smithi186 ceph-mon[126480]: pgmap v12216: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 247 KiB/s wr, 9 op/s 2023-05-08T10:04:21.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22799.929613 secs 2023-05-08T10:04:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22799.929613 secs 2023-05-08T10:04:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22799.929613 secs 2023-05-08T10:04:22.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:22 smithi133 ceph-mon[125939]: pgmap v12217: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 201 KiB/s wr, 7 op/s 2023-05-08T10:04:22.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:22 smithi096 ceph-mon[124666]: pgmap v12217: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 201 KiB/s wr, 7 op/s 2023-05-08T10:04:22.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:22 smithi186 ceph-mon[126480]: pgmap v12217: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 201 KiB/s wr, 7 op/s 2023-05-08T10:04:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:24 smithi096 ceph-mon[124666]: pgmap v12218: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 201 KiB/s wr, 7 op/s 2023-05-08T10:04:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22803.086966 secs 2023-05-08T10:04:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22803.642356 secs 2023-05-08T10:04:24.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:24 smithi186 ceph-mon[126480]: pgmap v12218: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 201 KiB/s wr, 7 op/s 2023-05-08T10:04:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22803.086966 secs 2023-05-08T10:04:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22803.642356 secs 2023-05-08T10:04:24.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:24 smithi133 ceph-mon[125939]: pgmap v12218: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 201 KiB/s wr, 7 op/s 2023-05-08T10:04:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22803.086966 secs 2023-05-08T10:04:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22803.642356 secs 2023-05-08T10:04:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:26 smithi096 ceph-mon[124666]: pgmap v12219: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 182 KiB/s wr, 8 op/s 2023-05-08T10:04:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22804.929727 secs 2023-05-08T10:04:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:26 smithi186 ceph-mon[126480]: pgmap v12219: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 182 KiB/s wr, 8 op/s 2023-05-08T10:04:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22804.929727 secs 2023-05-08T10:04:26.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:26 smithi133 ceph-mon[125939]: pgmap v12219: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 182 KiB/s wr, 8 op/s 2023-05-08T10:04:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22804.929727 secs 2023-05-08T10:04:28.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:28 smithi096 ceph-mon[124666]: pgmap v12220: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:04:28.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:28 smithi186 ceph-mon[126480]: pgmap v12220: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:04:28.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:28 smithi133 ceph-mon[125939]: pgmap v12220: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:04:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22808.087081 secs 2023-05-08T10:04:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22808.642502 secs 2023-05-08T10:04:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22808.087081 secs 2023-05-08T10:04:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22808.642502 secs 2023-05-08T10:04:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22808.087081 secs 2023-05-08T10:04:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22808.642502 secs 2023-05-08T10:04:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:30 smithi186 ceph-mon[126480]: pgmap v12221: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:04:30.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:30 smithi133 ceph-mon[125939]: pgmap v12221: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:04:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:30 smithi096 ceph-mon[124666]: pgmap v12221: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:04:31.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22809.929861 secs 2023-05-08T10:04:31.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22809.929861 secs 2023-05-08T10:04:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22809.929861 secs 2023-05-08T10:04:32.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:32 smithi186 ceph-mon[126480]: pgmap v12222: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T10:04:32.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:32 smithi133 ceph-mon[125939]: pgmap v12222: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T10:04:32.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:32 smithi096 ceph-mon[124666]: pgmap v12222: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T10:04:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:34 smithi186 ceph-mon[126480]: pgmap v12223: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:04:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22813.087221 secs 2023-05-08T10:04:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22813.642624 secs 2023-05-08T10:04:34.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:34 smithi133 ceph-mon[125939]: pgmap v12223: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:04:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22813.087221 secs 2023-05-08T10:04:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22813.642624 secs 2023-05-08T10:04:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:34 smithi096 ceph-mon[124666]: pgmap v12223: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:04:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22813.087221 secs 2023-05-08T10:04:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22813.642624 secs 2023-05-08T10:04:35.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22814.929985 secs 2023-05-08T10:04:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22814.929985 secs 2023-05-08T10:04:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22814.929985 secs 2023-05-08T10:04:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:36 smithi186 ceph-mon[126480]: pgmap v12224: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 7 op/s 2023-05-08T10:04:36.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:36 smithi133 ceph-mon[125939]: pgmap v12224: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 7 op/s 2023-05-08T10:04:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:36 smithi096 ceph-mon[124666]: pgmap v12224: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 7 op/s 2023-05-08T10:04:38.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:38 smithi186 ceph-mon[126480]: pgmap v12225: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 682 B/s wr, 6 op/s 2023-05-08T10:04:38.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:38 smithi133 ceph-mon[125939]: pgmap v12225: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 682 B/s wr, 6 op/s 2023-05-08T10:04:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:38 smithi096 ceph-mon[124666]: pgmap v12225: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 682 B/s wr, 6 op/s 2023-05-08T10:04:39.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22818.087319 secs 2023-05-08T10:04:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22818.642723 secs 2023-05-08T10:04:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22818.087319 secs 2023-05-08T10:04:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22818.642723 secs 2023-05-08T10:04:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22818.087319 secs 2023-05-08T10:04:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22818.642723 secs 2023-05-08T10:04:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:40 smithi186 ceph-mon[126480]: pgmap v12226: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 682 B/s wr, 5 op/s 2023-05-08T10:04:40.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:40 smithi133 ceph-mon[125939]: pgmap v12226: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 682 B/s wr, 5 op/s 2023-05-08T10:04:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:40 smithi096 ceph-mon[124666]: pgmap v12226: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 682 B/s wr, 5 op/s 2023-05-08T10:04:42.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:42 smithi186 ceph-mon[126480]: pgmap v12227: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 153 KiB/s wr, 8 op/s 2023-05-08T10:04:42.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:42 smithi133 ceph-mon[125939]: pgmap v12227: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 153 KiB/s wr, 8 op/s 2023-05-08T10:04:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:42 smithi096 ceph-mon[124666]: pgmap v12227: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 153 KiB/s wr, 8 op/s 2023-05-08T10:04:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:44 smithi186 ceph-mon[126480]: pgmap v12228: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 153 KiB/s wr, 6 op/s 2023-05-08T10:04:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22823.087447 secs 2023-05-08T10:04:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:44 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:04:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22823.642868 secs 2023-05-08T10:04:44.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:44 smithi133 ceph-mon[125939]: pgmap v12228: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 153 KiB/s wr, 6 op/s 2023-05-08T10:04:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22823.087447 secs 2023-05-08T10:04:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:44 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:04:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22823.642868 secs 2023-05-08T10:04:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:44 smithi096 ceph-mon[124666]: pgmap v12228: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 153 KiB/s wr, 6 op/s 2023-05-08T10:04:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22823.087447 secs 2023-05-08T10:04:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:44 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:04:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22823.642868 secs 2023-05-08T10:04:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:45 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:04:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:45 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:04:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:45 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:04:45.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:45 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:04:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:45 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:04:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:45 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:04:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:45 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:04:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:45 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:04:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:45 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:04:46.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:46 smithi186 ceph-mon[126480]: pgmap v12229: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 238 KiB/s wr, 9 op/s 2023-05-08T10:04:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:46 smithi133 ceph-mon[125939]: pgmap v12229: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 238 KiB/s wr, 9 op/s 2023-05-08T10:04:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:46 smithi096 ceph-mon[124666]: pgmap v12229: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 238 KiB/s wr, 9 op/s 2023-05-08T10:04:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:48 smithi186 ceph-mon[126480]: pgmap v12230: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 238 KiB/s wr, 7 op/s 2023-05-08T10:04:48.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:48 smithi133 ceph-mon[125939]: pgmap v12230: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 238 KiB/s wr, 7 op/s 2023-05-08T10:04:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:48 smithi096 ceph-mon[124666]: pgmap v12230: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 238 KiB/s wr, 7 op/s 2023-05-08T10:04:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22828.087564 secs 2023-05-08T10:04:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:49 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:04:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:49 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:04:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:49 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:04:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:49 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:04:49.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22828.087564 secs 2023-05-08T10:04:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:49 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:04:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:49 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:04:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:49 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:04:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:49 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:04:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22828.087564 secs 2023-05-08T10:04:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:49 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:04:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:49 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:04:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:49 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:04:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:49 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:04:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:50 smithi186 ceph-mon[126480]: pgmap v12231: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 238 KiB/s wr, 7 op/s 2023-05-08T10:04:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:50 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:04:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:50 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T10:04:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:50 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T10:04:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:50 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:04:50.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:50 smithi133 ceph-mon[125939]: pgmap v12231: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 238 KiB/s wr, 7 op/s 2023-05-08T10:04:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:50 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:04:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:50 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T10:04:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:50 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T10:04:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:50 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:04:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:50 smithi096 ceph-mon[124666]: pgmap v12231: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 238 KiB/s wr, 7 op/s 2023-05-08T10:04:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:50 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:04:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:50 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T10:04:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:50 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T10:04:50.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:50 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:04:52.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:52 smithi186 ceph-mon[126480]: pgmap v12232: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 588 KiB/s rd, 598 KiB/s wr, 11 op/s 2023-05-08T10:04:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:04:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:52 smithi133 ceph-mon[125939]: pgmap v12232: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 588 KiB/s rd, 598 KiB/s wr, 11 op/s 2023-05-08T10:04:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:04:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:52 smithi096 ceph-mon[124666]: pgmap v12232: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 588 KiB/s rd, 598 KiB/s wr, 11 op/s 2023-05-08T10:04:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:04:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:53 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:04:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:04:53.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:04:53.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:53 smithi186 ceph-mon[126480]: pgmap v12233: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 512 KiB/s rd, 446 KiB/s wr, 8 op/s 2023-05-08T10:04:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:53 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:04:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:04:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:04:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:53 smithi133 ceph-mon[125939]: pgmap v12233: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 512 KiB/s rd, 446 KiB/s wr, 8 op/s 2023-05-08T10:04:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:53 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:04:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:04:53.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:04:53.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:53 smithi096 ceph-mon[124666]: pgmap v12233: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 512 KiB/s rd, 446 KiB/s wr, 8 op/s 2023-05-08T10:04:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22833.087685 secs 2023-05-08T10:04:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22833.643173 secs 2023-05-08T10:04:54.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22833.087685 secs 2023-05-08T10:04:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22833.643173 secs 2023-05-08T10:04:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22833.087685 secs 2023-05-08T10:04:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22833.643173 secs 2023-05-08T10:04:55.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:55 smithi186 ceph-mon[126480]: pgmap v12234: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 783 KiB/s rd, 705 KiB/s wr, 14 op/s 2023-05-08T10:04:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22834.930492 secs 2023-05-08T10:04:55.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:55 smithi133 ceph-mon[125939]: pgmap v12234: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 783 KiB/s rd, 705 KiB/s wr, 14 op/s 2023-05-08T10:04:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22834.930492 secs 2023-05-08T10:04:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:55 smithi096 ceph-mon[124666]: pgmap v12234: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 783 KiB/s rd, 705 KiB/s wr, 14 op/s 2023-05-08T10:04:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22834.930492 secs 2023-05-08T10:04:57.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:04:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:04:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:04:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:57 smithi186 ceph-mon[126480]: pgmap v12235: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 622 KiB/s wr, 11 op/s 2023-05-08T10:04:57.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:04:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:04:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:04:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:57 smithi133 ceph-mon[125939]: pgmap v12235: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 622 KiB/s wr, 11 op/s 2023-05-08T10:04:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:04:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:04:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:04:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:57 smithi096 ceph-mon[124666]: pgmap v12235: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 622 KiB/s wr, 11 op/s 2023-05-08T10:04:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22838.087841 secs 2023-05-08T10:04:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22838.087841 secs 2023-05-08T10:04:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22838.087841 secs 2023-05-08T10:04:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:59 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:04:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:04:59 smithi186 ceph-mon[126480]: pgmap v12236: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 621 KiB/s wr, 10 op/s 2023-05-08T10:04:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:59 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:04:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:04:59 smithi133 ceph-mon[125939]: pgmap v12236: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 621 KiB/s wr, 10 op/s 2023-05-08T10:05:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:59 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:05:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:04:59 smithi096 ceph-mon[124666]: pgmap v12236: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 621 KiB/s wr, 10 op/s 2023-05-08T10:05:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:00 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:05:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22839.930619 secs 2023-05-08T10:05:00.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:00 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:05:00.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22839.930619 secs 2023-05-08T10:05:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:00 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:05:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22839.930619 secs 2023-05-08T10:05:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:05:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:05:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:01 smithi186 ceph-mon[126480]: pgmap v12237: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 795 KiB/s rd, 803 KiB/s wr, 15 op/s 2023-05-08T10:05:01.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:05:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:05:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:01 smithi133 ceph-mon[125939]: pgmap v12237: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 795 KiB/s rd, 803 KiB/s wr, 15 op/s 2023-05-08T10:05:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:05:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:05:02.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:01 smithi096 ceph-mon[124666]: pgmap v12237: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 795 KiB/s rd, 803 KiB/s wr, 15 op/s 2023-05-08T10:05:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:03 smithi133 ceph-mon[125939]: pgmap v12238: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 443 KiB/s wr, 11 op/s 2023-05-08T10:05:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22843.087974 secs 2023-05-08T10:05:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:03 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:05:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:03 smithi096 ceph-mon[124666]: pgmap v12238: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 443 KiB/s wr, 11 op/s 2023-05-08T10:05:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22843.087974 secs 2023-05-08T10:05:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:03 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:05:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:03 smithi186 ceph-mon[126480]: pgmap v12238: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 443 KiB/s wr, 11 op/s 2023-05-08T10:05:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22843.087974 secs 2023-05-08T10:05:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:03 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:05:05.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22843.643400 secs 2023-05-08T10:05:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22843.643400 secs 2023-05-08T10:05:05.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22843.643400 secs 2023-05-08T10:05:06.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:05 smithi133 ceph-mon[125939]: pgmap v12239: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 793 KiB/s rd, 818 KiB/s wr, 30 op/s 2023-05-08T10:05:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22844.930741 secs 2023-05-08T10:05:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:05 smithi096 ceph-mon[124666]: pgmap v12239: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 793 KiB/s rd, 818 KiB/s wr, 30 op/s 2023-05-08T10:05:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22844.930741 secs 2023-05-08T10:05:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:05 smithi186 ceph-mon[126480]: pgmap v12239: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 793 KiB/s rd, 818 KiB/s wr, 30 op/s 2023-05-08T10:05:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22844.930741 secs 2023-05-08T10:05:07.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:06 smithi133 ceph-mon[125939]: osdmap e842: 12 total, 12 up, 12 in 2023-05-08T10:05:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:06 smithi096 ceph-mon[124666]: osdmap e842: 12 total, 12 up, 12 in 2023-05-08T10:05:07.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:06 smithi186 ceph-mon[126480]: osdmap e842: 12 total, 12 up, 12 in 2023-05-08T10:05:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:07 smithi133 ceph-mon[125939]: pgmap v12241: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 625 KiB/s rd, 669 KiB/s wr, 29 op/s 2023-05-08T10:05:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:07 smithi096 ceph-mon[124666]: pgmap v12241: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 625 KiB/s rd, 669 KiB/s wr, 29 op/s 2023-05-08T10:05:08.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:07 smithi186 ceph-mon[126480]: pgmap v12241: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 625 KiB/s rd, 669 KiB/s wr, 29 op/s 2023-05-08T10:05:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:05:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:05:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22848.088124 secs 2023-05-08T10:05:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:08 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:05:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:05:09.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:05:09.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22848.088124 secs 2023-05-08T10:05:09.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:08 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:05:09.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:05:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:05:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22848.088124 secs 2023-05-08T10:05:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:08 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:05:10.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:09 smithi133 ceph-mon[125939]: pgmap v12242: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 625 KiB/s rd, 669 KiB/s wr, 29 op/s 2023-05-08T10:05:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22848.643476 secs 2023-05-08T10:05:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:09 smithi096 ceph-mon[124666]: pgmap v12242: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 625 KiB/s rd, 669 KiB/s wr, 29 op/s 2023-05-08T10:05:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22848.643476 secs 2023-05-08T10:05:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:09 smithi186 ceph-mon[126480]: pgmap v12242: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 625 KiB/s rd, 669 KiB/s wr, 29 op/s 2023-05-08T10:05:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22848.643476 secs 2023-05-08T10:05:11.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22849.930845 secs 2023-05-08T10:05:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22849.930845 secs 2023-05-08T10:05:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22849.930845 secs 2023-05-08T10:05:12.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:11 smithi133 ceph-mon[125939]: pgmap v12243: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 481 KiB/s rd, 497 KiB/s wr, 27 op/s 2023-05-08T10:05:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:11 smithi096 ceph-mon[124666]: pgmap v12243: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 481 KiB/s rd, 497 KiB/s wr, 27 op/s 2023-05-08T10:05:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:11 smithi186 ceph-mon[126480]: pgmap v12243: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 481 KiB/s rd, 497 KiB/s wr, 27 op/s 2023-05-08T10:05:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:13 smithi133 ceph-mon[125939]: pgmap v12244: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 481 KiB/s rd, 497 KiB/s wr, 27 op/s 2023-05-08T10:05:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22853.088260 secs 2023-05-08T10:05:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:13 smithi133 ceph-mon[125939]: osdmap e843: 12 total, 12 up, 12 in 2023-05-08T10:05:14.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22853.643576 secs 2023-05-08T10:05:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:13 smithi096 ceph-mon[124666]: pgmap v12244: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 481 KiB/s rd, 497 KiB/s wr, 27 op/s 2023-05-08T10:05:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22853.088260 secs 2023-05-08T10:05:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:13 smithi096 ceph-mon[124666]: osdmap e843: 12 total, 12 up, 12 in 2023-05-08T10:05:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22853.643576 secs 2023-05-08T10:05:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:13 smithi186 ceph-mon[126480]: pgmap v12244: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 481 KiB/s rd, 497 KiB/s wr, 27 op/s 2023-05-08T10:05:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22853.088260 secs 2023-05-08T10:05:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:13 smithi186 ceph-mon[126480]: osdmap e843: 12 total, 12 up, 12 in 2023-05-08T10:05:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22853.643576 secs 2023-05-08T10:05:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:15 smithi133 ceph-mon[125939]: pgmap v12246: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 169 KiB/s wr, 8 op/s 2023-05-08T10:05:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22854.930989 secs 2023-05-08T10:05:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:15 smithi096 ceph-mon[124666]: pgmap v12246: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 169 KiB/s wr, 8 op/s 2023-05-08T10:05:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22854.930989 secs 2023-05-08T10:05:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:15 smithi186 ceph-mon[126480]: pgmap v12246: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 169 KiB/s wr, 8 op/s 2023-05-08T10:05:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22854.930989 secs 2023-05-08T10:05:18.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:17 smithi133 ceph-mon[125939]: pgmap v12247: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 151 KiB/s wr, 7 op/s 2023-05-08T10:05:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:17 smithi096 ceph-mon[124666]: pgmap v12247: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 151 KiB/s wr, 7 op/s 2023-05-08T10:05:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:17 smithi186 ceph-mon[126480]: pgmap v12247: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 151 KiB/s wr, 7 op/s 2023-05-08T10:05:19.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22858.088384 secs 2023-05-08T10:05:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22858.643695 secs 2023-05-08T10:05:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22858.088384 secs 2023-05-08T10:05:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22858.643695 secs 2023-05-08T10:05:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22858.088384 secs 2023-05-08T10:05:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22858.643695 secs 2023-05-08T10:05:20.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:19 smithi133 ceph-mon[125939]: pgmap v12248: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 151 KiB/s wr, 7 op/s 2023-05-08T10:05:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:19 smithi096 ceph-mon[124666]: pgmap v12248: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 151 KiB/s wr, 7 op/s 2023-05-08T10:05:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:19 smithi186 ceph-mon[126480]: pgmap v12248: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 151 KiB/s wr, 7 op/s 2023-05-08T10:05:21.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22859.931108 secs 2023-05-08T10:05:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22859.931108 secs 2023-05-08T10:05:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22859.931108 secs 2023-05-08T10:05:22.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:21 smithi133 ceph-mon[125939]: pgmap v12249: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 104 KiB/s wr, 6 op/s 2023-05-08T10:05:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:21 smithi096 ceph-mon[124666]: pgmap v12249: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 104 KiB/s wr, 6 op/s 2023-05-08T10:05:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:21 smithi186 ceph-mon[126480]: pgmap v12249: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 104 KiB/s wr, 6 op/s 2023-05-08T10:05:24.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:23 smithi133 ceph-mon[125939]: pgmap v12250: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 104 KiB/s wr, 6 op/s 2023-05-08T10:05:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22863.088528 secs 2023-05-08T10:05:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22863.643760 secs 2023-05-08T10:05:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:23 smithi096 ceph-mon[124666]: pgmap v12250: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 104 KiB/s wr, 6 op/s 2023-05-08T10:05:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22863.088528 secs 2023-05-08T10:05:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22863.643760 secs 2023-05-08T10:05:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:23 smithi186 ceph-mon[126480]: pgmap v12250: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 104 KiB/s wr, 6 op/s 2023-05-08T10:05:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22863.088528 secs 2023-05-08T10:05:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22863.643760 secs 2023-05-08T10:05:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:25 smithi133 ceph-mon[125939]: pgmap v12251: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 162 KiB/s wr, 8 op/s 2023-05-08T10:05:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22864.931233 secs 2023-05-08T10:05:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:25 smithi096 ceph-mon[124666]: pgmap v12251: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 162 KiB/s wr, 8 op/s 2023-05-08T10:05:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22864.931233 secs 2023-05-08T10:05:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:25 smithi186 ceph-mon[126480]: pgmap v12251: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 162 KiB/s wr, 8 op/s 2023-05-08T10:05:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22864.931233 secs 2023-05-08T10:05:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:27 smithi096 ceph-mon[124666]: pgmap v12252: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 62 KiB/s wr, 5 op/s 2023-05-08T10:05:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:27 smithi186 ceph-mon[126480]: pgmap v12252: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 62 KiB/s wr, 5 op/s 2023-05-08T10:05:28.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:27 smithi133 ceph-mon[125939]: pgmap v12252: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 62 KiB/s wr, 5 op/s 2023-05-08T10:05:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22868.088612 secs 2023-05-08T10:05:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22868.643869 secs 2023-05-08T10:05:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22868.088612 secs 2023-05-08T10:05:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22868.643869 secs 2023-05-08T10:05:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22868.088612 secs 2023-05-08T10:05:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22868.643869 secs 2023-05-08T10:05:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:29 smithi096 ceph-mon[124666]: pgmap v12253: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 62 KiB/s wr, 5 op/s 2023-05-08T10:05:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:29 smithi186 ceph-mon[126480]: pgmap v12253: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 62 KiB/s wr, 5 op/s 2023-05-08T10:05:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:29 smithi133 ceph-mon[125939]: pgmap v12253: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 62 KiB/s wr, 5 op/s 2023-05-08T10:05:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22869.931358 secs 2023-05-08T10:05:31.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22869.931358 secs 2023-05-08T10:05:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22869.931358 secs 2023-05-08T10:05:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:32 smithi186 ceph-mon[126480]: pgmap v12254: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 7 op/s 2023-05-08T10:05:32.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:32 smithi133 ceph-mon[125939]: pgmap v12254: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 7 op/s 2023-05-08T10:05:32.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:32 smithi096 ceph-mon[124666]: pgmap v12254: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 7 op/s 2023-05-08T10:05:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:34 smithi186 ceph-mon[126480]: pgmap v12255: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 62 KiB/s wr, 5 op/s 2023-05-08T10:05:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22873.088736 secs 2023-05-08T10:05:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22873.643992 secs 2023-05-08T10:05:34.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:34 smithi133 ceph-mon[125939]: pgmap v12255: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 62 KiB/s wr, 5 op/s 2023-05-08T10:05:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22873.088736 secs 2023-05-08T10:05:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22873.643992 secs 2023-05-08T10:05:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:34 smithi096 ceph-mon[124666]: pgmap v12255: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 62 KiB/s wr, 5 op/s 2023-05-08T10:05:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22873.088736 secs 2023-05-08T10:05:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22873.643992 secs 2023-05-08T10:05:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:36 smithi186 ceph-mon[126480]: pgmap v12256: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 7 op/s 2023-05-08T10:05:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22874.931481 secs 2023-05-08T10:05:36.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:36 smithi133 ceph-mon[125939]: pgmap v12256: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 7 op/s 2023-05-08T10:05:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22874.931481 secs 2023-05-08T10:05:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:36 smithi096 ceph-mon[124666]: pgmap v12256: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 7 op/s 2023-05-08T10:05:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22874.931481 secs 2023-05-08T10:05:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:38 smithi186 ceph-mon[126480]: pgmap v12257: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 682 B/s wr, 6 op/s 2023-05-08T10:05:38.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:38 smithi133 ceph-mon[125939]: pgmap v12257: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 682 B/s wr, 6 op/s 2023-05-08T10:05:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:38 smithi096 ceph-mon[124666]: pgmap v12257: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 682 B/s wr, 6 op/s 2023-05-08T10:05:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22878.088869 secs 2023-05-08T10:05:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22878.644081 secs 2023-05-08T10:05:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22878.088869 secs 2023-05-08T10:05:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22878.644081 secs 2023-05-08T10:05:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22878.088869 secs 2023-05-08T10:05:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22878.644081 secs 2023-05-08T10:05:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:40 smithi186 ceph-mon[126480]: pgmap v12258: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 682 B/s wr, 5 op/s 2023-05-08T10:05:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:40 smithi133 ceph-mon[125939]: pgmap v12258: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 682 B/s wr, 5 op/s 2023-05-08T10:05:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:40 smithi096 ceph-mon[124666]: pgmap v12258: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 682 B/s wr, 5 op/s 2023-05-08T10:05:42.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:42 smithi186 ceph-mon[126480]: pgmap v12259: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 80 KiB/s wr, 8 op/s 2023-05-08T10:05:42.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:42 smithi133 ceph-mon[125939]: pgmap v12259: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 80 KiB/s wr, 8 op/s 2023-05-08T10:05:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:42 smithi096 ceph-mon[124666]: pgmap v12259: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 80 KiB/s wr, 8 op/s 2023-05-08T10:05:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:44 smithi186 ceph-mon[126480]: pgmap v12260: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 80 KiB/s wr, 6 op/s 2023-05-08T10:05:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22883.089015 secs 2023-05-08T10:05:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:44 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:05:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22883.644204 secs 2023-05-08T10:05:44.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:44 smithi133 ceph-mon[125939]: pgmap v12260: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 80 KiB/s wr, 6 op/s 2023-05-08T10:05:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22883.089015 secs 2023-05-08T10:05:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:44 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:05:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22883.644204 secs 2023-05-08T10:05:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:44 smithi096 ceph-mon[124666]: pgmap v12260: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 80 KiB/s wr, 6 op/s 2023-05-08T10:05:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22883.089015 secs 2023-05-08T10:05:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:44 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:05:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22883.644204 secs 2023-05-08T10:05:45.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:45 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:05:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:45 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:05:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:45 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:05:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:45 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:05:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:45 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:05:45.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:45 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:05:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:45 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:05:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:45 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:05:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:45 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:05:46.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:46 smithi186 ceph-mon[126480]: pgmap v12261: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 165 KiB/s wr, 9 op/s 2023-05-08T10:05:46.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:46 smithi133 ceph-mon[125939]: pgmap v12261: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 165 KiB/s wr, 9 op/s 2023-05-08T10:05:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:46 smithi096 ceph-mon[124666]: pgmap v12261: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 165 KiB/s wr, 9 op/s 2023-05-08T10:05:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:48 smithi186 ceph-mon[126480]: pgmap v12262: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 165 KiB/s wr, 7 op/s 2023-05-08T10:05:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:48 smithi133 ceph-mon[125939]: pgmap v12262: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 165 KiB/s wr, 7 op/s 2023-05-08T10:05:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:48 smithi096 ceph-mon[124666]: pgmap v12262: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 165 KiB/s wr, 7 op/s 2023-05-08T10:05:49.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22888.089145 secs 2023-05-08T10:05:49.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22888.089145 secs 2023-05-08T10:05:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22888.089145 secs 2023-05-08T10:05:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:50 smithi186 ceph-mon[126480]: pgmap v12263: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 165 KiB/s wr, 6 op/s 2023-05-08T10:05:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:05:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:05:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:05:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:05:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:50 smithi133 ceph-mon[125939]: pgmap v12263: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 165 KiB/s wr, 6 op/s 2023-05-08T10:05:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:05:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:05:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:05:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:05:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:50 smithi096 ceph-mon[124666]: pgmap v12263: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 165 KiB/s wr, 6 op/s 2023-05-08T10:05:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:05:50.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:05:50.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:05:50.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:05:51.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:51 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:05:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:51 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T10:05:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:51 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T10:05:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:51 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:05:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22889.931861 secs 2023-05-08T10:05:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:51 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:05:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:51 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T10:05:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:51 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T10:05:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:51 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:05:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22889.931861 secs 2023-05-08T10:05:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:51 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:05:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:51 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T10:05:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:51 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T10:05:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:51 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:05:51.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22889.931861 secs 2023-05-08T10:05:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:52 smithi186 ceph-mon[126480]: pgmap v12264: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 530 KiB/s wr, 11 op/s 2023-05-08T10:05:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:05:52.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:52 smithi133 ceph-mon[125939]: pgmap v12264: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 530 KiB/s wr, 11 op/s 2023-05-08T10:05:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:05:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:52 smithi096 ceph-mon[124666]: pgmap v12264: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 530 KiB/s wr, 11 op/s 2023-05-08T10:05:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:05:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:05:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:05:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:05:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:05:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:05:53.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:05:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:05:53.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:05:53.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:05:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:54 smithi186 ceph-mon[126480]: pgmap v12265: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 451 KiB/s wr, 8 op/s 2023-05-08T10:05:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22893.089247 secs 2023-05-08T10:05:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22893.644431 secs 2023-05-08T10:05:54.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:54 smithi133 ceph-mon[125939]: pgmap v12265: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 451 KiB/s wr, 8 op/s 2023-05-08T10:05:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22893.089247 secs 2023-05-08T10:05:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22893.644431 secs 2023-05-08T10:05:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:54 smithi096 ceph-mon[124666]: pgmap v12265: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 451 KiB/s wr, 8 op/s 2023-05-08T10:05:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22893.089247 secs 2023-05-08T10:05:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22893.644431 secs 2023-05-08T10:05:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:56 smithi186 ceph-mon[126480]: pgmap v12266: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 803 KiB/s rd, 792 KiB/s wr, 14 op/s 2023-05-08T10:05:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:05:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:56 smithi133 ceph-mon[125939]: pgmap v12266: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 803 KiB/s rd, 792 KiB/s wr, 14 op/s 2023-05-08T10:05:56.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:05:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:56 smithi096 ceph-mon[124666]: pgmap v12266: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 803 KiB/s rd, 792 KiB/s wr, 14 op/s 2023-05-08T10:05:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:05:57.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:05:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:05:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:05:57.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:05:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:05:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:05:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:05:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:05:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:05:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:58 smithi186 ceph-mon[126480]: pgmap v12267: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 719 KiB/s rd, 706 KiB/s wr, 12 op/s 2023-05-08T10:05:58.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:58 smithi133 ceph-mon[125939]: pgmap v12267: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 719 KiB/s rd, 706 KiB/s wr, 12 op/s 2023-05-08T10:05:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:58 smithi096 ceph-mon[124666]: pgmap v12267: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 719 KiB/s rd, 706 KiB/s wr, 12 op/s 2023-05-08T10:05:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:05:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22898.089364 secs 2023-05-08T10:05:59.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:05:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22898.089364 secs 2023-05-08T10:05:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:05:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22898.089364 secs 2023-05-08T10:06:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:00 smithi186 ceph-mon[126480]: pgmap v12268: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 719 KiB/s rd, 706 KiB/s wr, 11 op/s 2023-05-08T10:06:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:00 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:06:00.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:00 smithi133 ceph-mon[125939]: pgmap v12268: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 719 KiB/s rd, 706 KiB/s wr, 11 op/s 2023-05-08T10:06:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:00 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:06:00.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:00 smithi096 ceph-mon[124666]: pgmap v12268: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 719 KiB/s rd, 706 KiB/s wr, 11 op/s 2023-05-08T10:06:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:00 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:06:01.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:01 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:06:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:06:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:06:01.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:01 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:06:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:06:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:06:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:01 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:06:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:06:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:06:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:02 smithi186 ceph-mon[126480]: pgmap v12269: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 812 KiB/s rd, 800 KiB/s wr, 16 op/s 2023-05-08T10:06:02.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:02 smithi133 ceph-mon[125939]: pgmap v12269: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 812 KiB/s rd, 800 KiB/s wr, 16 op/s 2023-05-08T10:06:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:02 smithi096 ceph-mon[124666]: pgmap v12269: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 812 KiB/s rd, 800 KiB/s wr, 16 op/s 2023-05-08T10:06:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:04 smithi186 ceph-mon[126480]: pgmap v12270: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 449 KiB/s rd, 435 KiB/s wr, 11 op/s 2023-05-08T10:06:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22903.089488 secs 2023-05-08T10:06:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22903.644662 secs 2023-05-08T10:06:04.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:04 smithi133 ceph-mon[125939]: pgmap v12270: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 449 KiB/s rd, 435 KiB/s wr, 11 op/s 2023-05-08T10:06:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22903.089488 secs 2023-05-08T10:06:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22903.644662 secs 2023-05-08T10:06:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:04 smithi096 ceph-mon[124666]: pgmap v12270: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 449 KiB/s rd, 435 KiB/s wr, 11 op/s 2023-05-08T10:06:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22903.089488 secs 2023-05-08T10:06:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22903.644662 secs 2023-05-08T10:06:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:06 smithi186 ceph-mon[126480]: pgmap v12271: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 764 KiB/s rd, 785 KiB/s wr, 30 op/s 2023-05-08T10:06:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22904.932186 secs 2023-05-08T10:06:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:06 smithi133 ceph-mon[125939]: pgmap v12271: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 764 KiB/s rd, 785 KiB/s wr, 30 op/s 2023-05-08T10:06:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22904.932186 secs 2023-05-08T10:06:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:06 smithi096 ceph-mon[124666]: pgmap v12271: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 764 KiB/s rd, 785 KiB/s wr, 30 op/s 2023-05-08T10:06:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22904.932186 secs 2023-05-08T10:06:07.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:07 smithi133 ceph-mon[125939]: osdmap e844: 12 total, 12 up, 12 in 2023-05-08T10:06:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:07 smithi096 ceph-mon[124666]: osdmap e844: 12 total, 12 up, 12 in 2023-05-08T10:06:07.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:07 smithi186 ceph-mon[126480]: osdmap e844: 12 total, 12 up, 12 in 2023-05-08T10:06:08.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:08 smithi133 ceph-mon[125939]: pgmap v12273: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 491 KiB/s rd, 532 KiB/s wr, 29 op/s 2023-05-08T10:06:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:08 smithi096 ceph-mon[124666]: pgmap v12273: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 491 KiB/s rd, 532 KiB/s wr, 29 op/s 2023-05-08T10:06:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:08 smithi186 ceph-mon[126480]: pgmap v12273: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 491 KiB/s rd, 532 KiB/s wr, 29 op/s 2023-05-08T10:06:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:09 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:06:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:06:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:06:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:06:09.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22908.089608 secs 2023-05-08T10:06:09.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22908.644784 secs 2023-05-08T10:06:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:09 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:06:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:06:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:06:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:06:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22908.089608 secs 2023-05-08T10:06:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22908.644784 secs 2023-05-08T10:06:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:09 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:06:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:06:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:06:09.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:06:09.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22908.089608 secs 2023-05-08T10:06:09.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22908.644784 secs 2023-05-08T10:06:10.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:10 smithi133 ceph-mon[125939]: pgmap v12274: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 491 KiB/s rd, 532 KiB/s wr, 29 op/s 2023-05-08T10:06:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:10 smithi096 ceph-mon[124666]: pgmap v12274: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 491 KiB/s rd, 532 KiB/s wr, 29 op/s 2023-05-08T10:06:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:10 smithi186 ceph-mon[126480]: pgmap v12274: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 491 KiB/s rd, 532 KiB/s wr, 29 op/s 2023-05-08T10:06:11.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22909.932318 secs 2023-05-08T10:06:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22909.932318 secs 2023-05-08T10:06:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22909.932318 secs 2023-05-08T10:06:12.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:12 smithi133 ceph-mon[125939]: pgmap v12275: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 467 KiB/s wr, 27 op/s 2023-05-08T10:06:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:12 smithi096 ceph-mon[124666]: pgmap v12275: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 467 KiB/s wr, 27 op/s 2023-05-08T10:06:12.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:12 smithi186 ceph-mon[126480]: pgmap v12275: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 467 KiB/s wr, 27 op/s 2023-05-08T10:06:14.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:14 smithi133 ceph-mon[125939]: pgmap v12276: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 467 KiB/s wr, 27 op/s 2023-05-08T10:06:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22913.089722 secs 2023-05-08T10:06:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:14 smithi133 ceph-mon[125939]: osdmap e845: 12 total, 12 up, 12 in 2023-05-08T10:06:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22913.644924 secs 2023-05-08T10:06:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:14 smithi096 ceph-mon[124666]: pgmap v12276: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 467 KiB/s wr, 27 op/s 2023-05-08T10:06:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22913.089722 secs 2023-05-08T10:06:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:14 smithi096 ceph-mon[124666]: osdmap e845: 12 total, 12 up, 12 in 2023-05-08T10:06:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22913.644924 secs 2023-05-08T10:06:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:14 smithi186 ceph-mon[126480]: pgmap v12276: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 467 KiB/s wr, 27 op/s 2023-05-08T10:06:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22913.089722 secs 2023-05-08T10:06:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:14 smithi186 ceph-mon[126480]: osdmap e845: 12 total, 12 up, 12 in 2023-05-08T10:06:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22913.644924 secs 2023-05-08T10:06:16.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:16 smithi133 ceph-mon[125939]: pgmap v12278: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 173 KiB/s wr, 8 op/s 2023-05-08T10:06:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22914.932472 secs 2023-05-08T10:06:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:16 smithi096 ceph-mon[124666]: pgmap v12278: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 173 KiB/s wr, 8 op/s 2023-05-08T10:06:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22914.932472 secs 2023-05-08T10:06:16.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:16 smithi186 ceph-mon[126480]: pgmap v12278: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 173 KiB/s wr, 8 op/s 2023-05-08T10:06:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22914.932472 secs 2023-05-08T10:06:18.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:18 smithi133 ceph-mon[125939]: pgmap v12279: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 151 KiB/s wr, 7 op/s 2023-05-08T10:06:18.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:18 smithi096 ceph-mon[124666]: pgmap v12279: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 151 KiB/s wr, 7 op/s 2023-05-08T10:06:18.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:18 smithi186 ceph-mon[126480]: pgmap v12279: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 151 KiB/s wr, 7 op/s 2023-05-08T10:06:19.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22918.089863 secs 2023-05-08T10:06:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22918.645050 secs 2023-05-08T10:06:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22918.089863 secs 2023-05-08T10:06:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22918.645050 secs 2023-05-08T10:06:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22918.089863 secs 2023-05-08T10:06:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22918.645050 secs 2023-05-08T10:06:20.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:20 smithi133 ceph-mon[125939]: pgmap v12280: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 151 KiB/s wr, 7 op/s 2023-05-08T10:06:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:20 smithi096 ceph-mon[124666]: pgmap v12280: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 151 KiB/s wr, 7 op/s 2023-05-08T10:06:20.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:20 smithi186 ceph-mon[126480]: pgmap v12280: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 151 KiB/s wr, 7 op/s 2023-05-08T10:06:21.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22919.932603 secs 2023-05-08T10:06:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22919.932603 secs 2023-05-08T10:06:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22919.932603 secs 2023-05-08T10:06:22.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:22 smithi133 ceph-mon[125939]: pgmap v12281: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 104 KiB/s wr, 6 op/s 2023-05-08T10:06:22.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:22 smithi096 ceph-mon[124666]: pgmap v12281: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 104 KiB/s wr, 6 op/s 2023-05-08T10:06:22.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:22 smithi186 ceph-mon[126480]: pgmap v12281: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 104 KiB/s wr, 6 op/s 2023-05-08T10:06:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:24 smithi133 ceph-mon[125939]: pgmap v12282: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 104 KiB/s wr, 6 op/s 2023-05-08T10:06:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22923.090000 secs 2023-05-08T10:06:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22923.645194 secs 2023-05-08T10:06:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:24 smithi096 ceph-mon[124666]: pgmap v12282: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 104 KiB/s wr, 6 op/s 2023-05-08T10:06:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22923.090000 secs 2023-05-08T10:06:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22923.645194 secs 2023-05-08T10:06:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:24 smithi186 ceph-mon[126480]: pgmap v12282: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 104 KiB/s wr, 6 op/s 2023-05-08T10:06:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22923.090000 secs 2023-05-08T10:06:24.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22923.645194 secs 2023-05-08T10:06:26.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:26 smithi133 ceph-mon[125939]: pgmap v12283: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 95 KiB/s wr, 8 op/s 2023-05-08T10:06:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22924.932717 secs 2023-05-08T10:06:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:26 smithi096 ceph-mon[124666]: pgmap v12283: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 95 KiB/s wr, 8 op/s 2023-05-08T10:06:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22924.932717 secs 2023-05-08T10:06:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:26 smithi186 ceph-mon[126480]: pgmap v12283: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 95 KiB/s wr, 8 op/s 2023-05-08T10:06:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22924.932717 secs 2023-05-08T10:06:28.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:28 smithi133 ceph-mon[125939]: pgmap v12284: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:06:28.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:28 smithi096 ceph-mon[124666]: pgmap v12284: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:06:28.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:28 smithi186 ceph-mon[126480]: pgmap v12284: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:06:29.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22928.090163 secs 2023-05-08T10:06:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22928.645322 secs 2023-05-08T10:06:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22928.090163 secs 2023-05-08T10:06:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22928.645322 secs 2023-05-08T10:06:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22928.090163 secs 2023-05-08T10:06:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22928.645322 secs 2023-05-08T10:06:30.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:30 smithi133 ceph-mon[125939]: pgmap v12285: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:06:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:30 smithi096 ceph-mon[124666]: pgmap v12285: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:06:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:30 smithi186 ceph-mon[126480]: pgmap v12285: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:06:31.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22929.932846 secs 2023-05-08T10:06:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22929.932846 secs 2023-05-08T10:06:31.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22929.932846 secs 2023-05-08T10:06:32.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:32 smithi133 ceph-mon[125939]: pgmap v12286: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T10:06:32.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:32 smithi096 ceph-mon[124666]: pgmap v12286: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T10:06:32.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:32 smithi186 ceph-mon[126480]: pgmap v12286: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T10:06:34.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:34 smithi133 ceph-mon[125939]: pgmap v12287: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T10:06:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22933.090319 secs 2023-05-08T10:06:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22933.645463 secs 2023-05-08T10:06:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:34 smithi096 ceph-mon[124666]: pgmap v12287: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T10:06:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22933.090319 secs 2023-05-08T10:06:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22933.645463 secs 2023-05-08T10:06:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:34 smithi186 ceph-mon[126480]: pgmap v12287: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T10:06:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22933.090319 secs 2023-05-08T10:06:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22933.645463 secs 2023-05-08T10:06:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:36 smithi133 ceph-mon[125939]: pgmap v12288: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 154 KiB/s wr, 8 op/s 2023-05-08T10:06:36.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22934.932971 secs 2023-05-08T10:06:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:36 smithi096 ceph-mon[124666]: pgmap v12288: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 154 KiB/s wr, 8 op/s 2023-05-08T10:06:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22934.932971 secs 2023-05-08T10:06:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:36 smithi186 ceph-mon[126480]: pgmap v12288: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 154 KiB/s wr, 8 op/s 2023-05-08T10:06:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22934.932971 secs 2023-05-08T10:06:38.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:38 smithi133 ceph-mon[125939]: pgmap v12289: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 154 KiB/s wr, 7 op/s 2023-05-08T10:06:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:38 smithi096 ceph-mon[124666]: pgmap v12289: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 154 KiB/s wr, 7 op/s 2023-05-08T10:06:38.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:38 smithi186 ceph-mon[126480]: pgmap v12289: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 154 KiB/s wr, 7 op/s 2023-05-08T10:06:39.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22938.090440 secs 2023-05-08T10:06:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22938.645567 secs 2023-05-08T10:06:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22938.090440 secs 2023-05-08T10:06:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22938.645567 secs 2023-05-08T10:06:39.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22938.090440 secs 2023-05-08T10:06:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22938.645567 secs 2023-05-08T10:06:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:40 smithi133 ceph-mon[125939]: pgmap v12290: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 154 KiB/s wr, 6 op/s 2023-05-08T10:06:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:40 smithi096 ceph-mon[124666]: pgmap v12290: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 154 KiB/s wr, 6 op/s 2023-05-08T10:06:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:40 smithi186 ceph-mon[126480]: pgmap v12290: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 154 KiB/s wr, 6 op/s 2023-05-08T10:06:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22939.933068 secs 2023-05-08T10:06:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22939.933068 secs 2023-05-08T10:06:41.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22939.933068 secs 2023-05-08T10:06:42.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:42 smithi133 ceph-mon[125939]: pgmap v12291: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 155 KiB/s wr, 10 op/s 2023-05-08T10:06:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:42 smithi096 ceph-mon[124666]: pgmap v12291: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 155 KiB/s wr, 10 op/s 2023-05-08T10:06:42.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:42 smithi186 ceph-mon[126480]: pgmap v12291: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 155 KiB/s wr, 10 op/s 2023-05-08T10:06:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:44 smithi133 ceph-mon[125939]: pgmap v12292: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 154 KiB/s wr, 6 op/s 2023-05-08T10:06:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22943.090570 secs 2023-05-08T10:06:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22943.645702 secs 2023-05-08T10:06:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:44 smithi096 ceph-mon[124666]: pgmap v12292: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 154 KiB/s wr, 6 op/s 2023-05-08T10:06:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22943.090570 secs 2023-05-08T10:06:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22943.645702 secs 2023-05-08T10:06:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:44 smithi186 ceph-mon[126480]: pgmap v12292: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 154 KiB/s wr, 6 op/s 2023-05-08T10:06:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22943.090570 secs 2023-05-08T10:06:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22943.645702 secs 2023-05-08T10:06:46.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:46 smithi133 ceph-mon[125939]: pgmap v12293: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 314 KiB/s wr, 9 op/s 2023-05-08T10:06:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22944.933218 secs 2023-05-08T10:06:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:46 smithi096 ceph-mon[124666]: pgmap v12293: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 314 KiB/s wr, 9 op/s 2023-05-08T10:06:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22944.933218 secs 2023-05-08T10:06:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:46 smithi186 ceph-mon[126480]: pgmap v12293: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 314 KiB/s wr, 9 op/s 2023-05-08T10:06:46.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22944.933218 secs 2023-05-08T10:06:48.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:48 smithi133 ceph-mon[125939]: pgmap v12294: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 161 KiB/s wr, 7 op/s 2023-05-08T10:06:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:48 smithi096 ceph-mon[124666]: pgmap v12294: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 161 KiB/s wr, 7 op/s 2023-05-08T10:06:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:48 smithi186 ceph-mon[126480]: pgmap v12294: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 161 KiB/s wr, 7 op/s 2023-05-08T10:06:49.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22948.090648 secs 2023-05-08T10:06:49.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22948.090648 secs 2023-05-08T10:06:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22948.090648 secs 2023-05-08T10:06:50.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:50 smithi133 ceph-mon[125939]: pgmap v12295: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 161 KiB/s wr, 6 op/s 2023-05-08T10:06:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:06:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:50 smithi096 ceph-mon[124666]: pgmap v12295: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 161 KiB/s wr, 6 op/s 2023-05-08T10:06:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:06:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:50 smithi186 ceph-mon[126480]: pgmap v12295: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 161 KiB/s wr, 6 op/s 2023-05-08T10:06:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:06:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22949.933313 secs 2023-05-08T10:06:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:51 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:06:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:51 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:06:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:51 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:06:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22949.933313 secs 2023-05-08T10:06:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:51 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:06:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:51 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:06:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:51 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:06:51.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22949.933313 secs 2023-05-08T10:06:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:51 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:06:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:51 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:06:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:51 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:06:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:52 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:06:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:52 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T10:06:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:52 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T10:06:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:52 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:06:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:52 smithi133 ceph-mon[125939]: pgmap v12296: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 532 KiB/s rd, 452 KiB/s wr, 11 op/s 2023-05-08T10:06:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:06:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:52 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:06:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:52 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T10:06:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:52 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T10:06:52.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:52 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:06:52.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:52 smithi096 ceph-mon[124666]: pgmap v12296: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 532 KiB/s rd, 452 KiB/s wr, 11 op/s 2023-05-08T10:06:52.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:06:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:52 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:06:52.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:52 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T10:06:52.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:52 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T10:06:52.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:52 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:06:52.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:52 smithi186 ceph-mon[126480]: pgmap v12296: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 532 KiB/s rd, 452 KiB/s wr, 11 op/s 2023-05-08T10:06:52.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:06:53.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:53 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:06:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:06:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:06:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:53 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:06:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:06:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:06:53.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:53 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:06:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:06:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:06:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:54 smithi133 ceph-mon[125939]: pgmap v12297: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 451 KiB/s wr, 8 op/s 2023-05-08T10:06:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22953.090794 secs 2023-05-08T10:06:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22953.645935 secs 2023-05-08T10:06:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:54 smithi096 ceph-mon[124666]: pgmap v12297: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 451 KiB/s wr, 8 op/s 2023-05-08T10:06:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22953.090794 secs 2023-05-08T10:06:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22953.645935 secs 2023-05-08T10:06:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:54 smithi186 ceph-mon[126480]: pgmap v12297: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 451 KiB/s wr, 8 op/s 2023-05-08T10:06:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22953.090794 secs 2023-05-08T10:06:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22953.645935 secs 2023-05-08T10:06:56.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:56 smithi133 ceph-mon[125939]: pgmap v12298: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 628 KiB/s rd, 794 KiB/s wr, 12 op/s 2023-05-08T10:06:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:06:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:56 smithi096 ceph-mon[124666]: pgmap v12298: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 628 KiB/s rd, 794 KiB/s wr, 12 op/s 2023-05-08T10:06:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:06:56.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:56 smithi186 ceph-mon[126480]: pgmap v12298: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 628 KiB/s rd, 794 KiB/s wr, 12 op/s 2023-05-08T10:06:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:06:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:06:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:06:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:06:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:06:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:06:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:06:57.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:06:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:06:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:06:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:58 smithi096 ceph-mon[124666]: pgmap v12299: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 467 KiB/s rd, 634 KiB/s wr, 10 op/s 2023-05-08T10:06:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:58 smithi186 ceph-mon[126480]: pgmap v12299: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 467 KiB/s rd, 634 KiB/s wr, 10 op/s 2023-05-08T10:06:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:58 smithi133 ceph-mon[125939]: pgmap v12299: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 467 KiB/s rd, 634 KiB/s wr, 10 op/s 2023-05-08T10:06:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:06:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22958.090920 secs 2023-05-08T10:06:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:06:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22958.090920 secs 2023-05-08T10:06:59.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:06:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22958.090920 secs 2023-05-08T10:07:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:00 smithi096 ceph-mon[124666]: pgmap v12300: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 467 KiB/s rd, 634 KiB/s wr, 10 op/s 2023-05-08T10:07:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:00 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:07:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:00 smithi186 ceph-mon[126480]: pgmap v12300: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 467 KiB/s rd, 634 KiB/s wr, 10 op/s 2023-05-08T10:07:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:00 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:07:00.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:00 smithi133 ceph-mon[125939]: pgmap v12300: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 467 KiB/s rd, 634 KiB/s wr, 10 op/s 2023-05-08T10:07:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:00 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:07:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:01 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:07:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:07:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:07:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:01 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:07:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:07:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:07:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:01 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:07:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:07:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:07:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:02 smithi186 ceph-mon[126480]: pgmap v12301: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 741 KiB/s rd, 728 KiB/s wr, 15 op/s 2023-05-08T10:07:02.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:02 smithi133 ceph-mon[125939]: pgmap v12301: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 741 KiB/s rd, 728 KiB/s wr, 15 op/s 2023-05-08T10:07:02.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:02 smithi096 ceph-mon[124666]: pgmap v12301: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 741 KiB/s rd, 728 KiB/s wr, 15 op/s 2023-05-08T10:07:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:04 smithi186 ceph-mon[126480]: pgmap v12302: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 449 KiB/s rd, 437 KiB/s wr, 10 op/s 2023-05-08T10:07:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22963.091046 secs 2023-05-08T10:07:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22963.646201 secs 2023-05-08T10:07:04.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:04 smithi133 ceph-mon[125939]: pgmap v12302: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 449 KiB/s rd, 437 KiB/s wr, 10 op/s 2023-05-08T10:07:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22963.091046 secs 2023-05-08T10:07:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22963.646201 secs 2023-05-08T10:07:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:04 smithi096 ceph-mon[124666]: pgmap v12302: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 449 KiB/s rd, 437 KiB/s wr, 10 op/s 2023-05-08T10:07:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22963.091046 secs 2023-05-08T10:07:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22963.646201 secs 2023-05-08T10:07:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:06 smithi186 ceph-mon[126480]: pgmap v12303: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 694 KiB/s rd, 813 KiB/s wr, 29 op/s 2023-05-08T10:07:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22964.933729 secs 2023-05-08T10:07:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:06 smithi186 ceph-mon[126480]: osdmap e846: 12 total, 12 up, 12 in 2023-05-08T10:07:06.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:06 smithi133 ceph-mon[125939]: pgmap v12303: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 694 KiB/s rd, 813 KiB/s wr, 29 op/s 2023-05-08T10:07:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22964.933729 secs 2023-05-08T10:07:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:06 smithi133 ceph-mon[125939]: osdmap e846: 12 total, 12 up, 12 in 2023-05-08T10:07:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:06 smithi096 ceph-mon[124666]: pgmap v12303: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 694 KiB/s rd, 813 KiB/s wr, 29 op/s 2023-05-08T10:07:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22964.933729 secs 2023-05-08T10:07:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:06 smithi096 ceph-mon[124666]: osdmap e846: 12 total, 12 up, 12 in 2023-05-08T10:07:08.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:08 smithi186 ceph-mon[126480]: pgmap v12305: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 623 KiB/s rd, 564 KiB/s wr, 29 op/s 2023-05-08T10:07:08.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:08 smithi133 ceph-mon[125939]: pgmap v12305: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 623 KiB/s rd, 564 KiB/s wr, 29 op/s 2023-05-08T10:07:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:08 smithi096 ceph-mon[124666]: pgmap v12305: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 623 KiB/s rd, 564 KiB/s wr, 29 op/s 2023-05-08T10:07:09.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:09 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:07:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:07:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:07:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:07:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22968.091169 secs 2023-05-08T10:07:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22968.646329 secs 2023-05-08T10:07:09.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:09 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:07:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:07:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:07:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:07:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22968.091169 secs 2023-05-08T10:07:09.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22968.646329 secs 2023-05-08T10:07:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:09 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:07:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:07:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:07:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:07:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22968.091169 secs 2023-05-08T10:07:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22968.646329 secs 2023-05-08T10:07:10.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:10 smithi186 ceph-mon[126480]: pgmap v12306: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 623 KiB/s rd, 564 KiB/s wr, 29 op/s 2023-05-08T10:07:10.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:10 smithi133 ceph-mon[125939]: pgmap v12306: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 623 KiB/s rd, 564 KiB/s wr, 29 op/s 2023-05-08T10:07:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:10 smithi096 ceph-mon[124666]: pgmap v12306: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 623 KiB/s rd, 564 KiB/s wr, 29 op/s 2023-05-08T10:07:11.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22969.933830 secs 2023-05-08T10:07:11.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22969.933830 secs 2023-05-08T10:07:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22969.933830 secs 2023-05-08T10:07:12.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:12 smithi186 ceph-mon[126480]: pgmap v12307: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 499 KiB/s wr, 28 op/s 2023-05-08T10:07:12.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:12 smithi133 ceph-mon[125939]: pgmap v12307: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 499 KiB/s wr, 28 op/s 2023-05-08T10:07:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:12 smithi096 ceph-mon[124666]: pgmap v12307: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 499 KiB/s wr, 28 op/s 2023-05-08T10:07:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:14 smithi186 ceph-mon[126480]: pgmap v12308: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 499 KiB/s wr, 28 op/s 2023-05-08T10:07:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22973.091301 secs 2023-05-08T10:07:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:14 smithi186 ceph-mon[126480]: osdmap e847: 12 total, 12 up, 12 in 2023-05-08T10:07:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22973.646398 secs 2023-05-08T10:07:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:14 smithi133 ceph-mon[125939]: pgmap v12308: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 499 KiB/s wr, 28 op/s 2023-05-08T10:07:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22973.091301 secs 2023-05-08T10:07:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:14 smithi133 ceph-mon[125939]: osdmap e847: 12 total, 12 up, 12 in 2023-05-08T10:07:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22973.646398 secs 2023-05-08T10:07:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:14 smithi096 ceph-mon[124666]: pgmap v12308: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 499 KiB/s wr, 28 op/s 2023-05-08T10:07:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22973.091301 secs 2023-05-08T10:07:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:14 smithi096 ceph-mon[124666]: osdmap e847: 12 total, 12 up, 12 in 2023-05-08T10:07:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22973.646398 secs 2023-05-08T10:07:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:16 smithi186 ceph-mon[126480]: pgmap v12310: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 158 KiB/s wr, 9 op/s 2023-05-08T10:07:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22974.933948 secs 2023-05-08T10:07:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:16 smithi133 ceph-mon[125939]: pgmap v12310: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 158 KiB/s wr, 9 op/s 2023-05-08T10:07:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22974.933948 secs 2023-05-08T10:07:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:16 smithi096 ceph-mon[124666]: pgmap v12310: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 158 KiB/s wr, 9 op/s 2023-05-08T10:07:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22974.933948 secs 2023-05-08T10:07:18.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:18 smithi186 ceph-mon[126480]: pgmap v12311: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 152 KiB/s wr, 8 op/s 2023-05-08T10:07:18.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:18 smithi133 ceph-mon[125939]: pgmap v12311: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 152 KiB/s wr, 8 op/s 2023-05-08T10:07:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:18 smithi096 ceph-mon[124666]: pgmap v12311: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 152 KiB/s wr, 8 op/s 2023-05-08T10:07:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22978.091416 secs 2023-05-08T10:07:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22978.646517 secs 2023-05-08T10:07:19.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22978.091416 secs 2023-05-08T10:07:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22978.646517 secs 2023-05-08T10:07:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22978.091416 secs 2023-05-08T10:07:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22978.646517 secs 2023-05-08T10:07:20.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:20 smithi186 ceph-mon[126480]: pgmap v12312: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 152 KiB/s wr, 8 op/s 2023-05-08T10:07:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22979.934065 secs 2023-05-08T10:07:20.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:20 smithi133 ceph-mon[125939]: pgmap v12312: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 152 KiB/s wr, 8 op/s 2023-05-08T10:07:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22979.934065 secs 2023-05-08T10:07:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:20 smithi096 ceph-mon[124666]: pgmap v12312: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 152 KiB/s wr, 8 op/s 2023-05-08T10:07:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22979.934065 secs 2023-05-08T10:07:22.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:22 smithi186 ceph-mon[126480]: pgmap v12313: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 105 KiB/s wr, 6 op/s 2023-05-08T10:07:22.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:22 smithi133 ceph-mon[125939]: pgmap v12313: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 105 KiB/s wr, 6 op/s 2023-05-08T10:07:22.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:22 smithi096 ceph-mon[124666]: pgmap v12313: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 105 KiB/s wr, 6 op/s 2023-05-08T10:07:24.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:24 smithi186 ceph-mon[126480]: pgmap v12314: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 105 KiB/s wr, 6 op/s 2023-05-08T10:07:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22983.091528 secs 2023-05-08T10:07:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22983.646629 secs 2023-05-08T10:07:24.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:24 smithi133 ceph-mon[125939]: pgmap v12314: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 105 KiB/s wr, 6 op/s 2023-05-08T10:07:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22983.091528 secs 2023-05-08T10:07:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22983.646629 secs 2023-05-08T10:07:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:24 smithi096 ceph-mon[124666]: pgmap v12314: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 105 KiB/s wr, 6 op/s 2023-05-08T10:07:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22983.091528 secs 2023-05-08T10:07:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22983.646629 secs 2023-05-08T10:07:25.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22984.934173 secs 2023-05-08T10:07:25.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22984.934173 secs 2023-05-08T10:07:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22984.934173 secs 2023-05-08T10:07:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:26 smithi186 ceph-mon[126480]: pgmap v12315: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 163 KiB/s wr, 9 op/s 2023-05-08T10:07:26.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:26 smithi133 ceph-mon[125939]: pgmap v12315: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 163 KiB/s wr, 9 op/s 2023-05-08T10:07:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:26 smithi096 ceph-mon[124666]: pgmap v12315: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 163 KiB/s wr, 9 op/s 2023-05-08T10:07:28.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:28 smithi186 ceph-mon[126480]: pgmap v12316: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T10:07:28.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:28 smithi133 ceph-mon[125939]: pgmap v12316: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T10:07:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:28 smithi096 ceph-mon[124666]: pgmap v12316: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T10:07:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22988.091627 secs 2023-05-08T10:07:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22988.646765 secs 2023-05-08T10:07:29.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22988.091627 secs 2023-05-08T10:07:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22988.646765 secs 2023-05-08T10:07:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22988.091627 secs 2023-05-08T10:07:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22988.646765 secs 2023-05-08T10:07:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:30 smithi186 ceph-mon[126480]: pgmap v12317: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T10:07:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22989.934300 secs 2023-05-08T10:07:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:30 smithi133 ceph-mon[125939]: pgmap v12317: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T10:07:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22989.934300 secs 2023-05-08T10:07:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:30 smithi096 ceph-mon[124666]: pgmap v12317: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T10:07:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22989.934300 secs 2023-05-08T10:07:32.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:32 smithi186 ceph-mon[126480]: pgmap v12318: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 225 KiB/s wr, 10 op/s 2023-05-08T10:07:32.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:32 smithi133 ceph-mon[125939]: pgmap v12318: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 225 KiB/s wr, 10 op/s 2023-05-08T10:07:32.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:32 smithi096 ceph-mon[124666]: pgmap v12318: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 225 KiB/s wr, 10 op/s 2023-05-08T10:07:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:34 smithi186 ceph-mon[126480]: pgmap v12319: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 225 KiB/s wr, 7 op/s 2023-05-08T10:07:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22993.091751 secs 2023-05-08T10:07:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22993.646831 secs 2023-05-08T10:07:34.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:34 smithi133 ceph-mon[125939]: pgmap v12319: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 225 KiB/s wr, 7 op/s 2023-05-08T10:07:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22993.091751 secs 2023-05-08T10:07:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22993.646831 secs 2023-05-08T10:07:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:34 smithi096 ceph-mon[124666]: pgmap v12319: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 225 KiB/s wr, 7 op/s 2023-05-08T10:07:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22993.091751 secs 2023-05-08T10:07:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22993.646831 secs 2023-05-08T10:07:35.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22994.934452 secs 2023-05-08T10:07:35.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22994.934452 secs 2023-05-08T10:07:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22994.934452 secs 2023-05-08T10:07:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:36 smithi186 ceph-mon[126480]: pgmap v12320: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 225 KiB/s wr, 10 op/s 2023-05-08T10:07:36.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:36 smithi133 ceph-mon[125939]: pgmap v12320: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 225 KiB/s wr, 10 op/s 2023-05-08T10:07:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:36 smithi096 ceph-mon[124666]: pgmap v12320: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 225 KiB/s wr, 10 op/s 2023-05-08T10:07:38.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:38 smithi186 ceph-mon[126480]: pgmap v12321: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 162 KiB/s wr, 7 op/s 2023-05-08T10:07:38.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:38 smithi133 ceph-mon[125939]: pgmap v12321: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 162 KiB/s wr, 7 op/s 2023-05-08T10:07:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:38 smithi096 ceph-mon[124666]: pgmap v12321: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 162 KiB/s wr, 7 op/s 2023-05-08T10:07:39.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22998.091881 secs 2023-05-08T10:07:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22998.646973 secs 2023-05-08T10:07:39.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22998.091881 secs 2023-05-08T10:07:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22998.646973 secs 2023-05-08T10:07:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22998.091881 secs 2023-05-08T10:07:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22998.646973 secs 2023-05-08T10:07:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:40 smithi186 ceph-mon[126480]: pgmap v12322: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 162 KiB/s wr, 7 op/s 2023-05-08T10:07:40.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 22999.934576 secs 2023-05-08T10:07:40.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:40 smithi133 ceph-mon[125939]: pgmap v12322: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 162 KiB/s wr, 7 op/s 2023-05-08T10:07:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 22999.934576 secs 2023-05-08T10:07:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:40 smithi096 ceph-mon[124666]: pgmap v12322: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 162 KiB/s wr, 7 op/s 2023-05-08T10:07:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 22999.934576 secs 2023-05-08T10:07:42.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:42 smithi186 ceph-mon[126480]: pgmap v12323: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 162 KiB/s wr, 9 op/s 2023-05-08T10:07:42.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:42 smithi133 ceph-mon[125939]: pgmap v12323: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 162 KiB/s wr, 9 op/s 2023-05-08T10:07:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:42 smithi096 ceph-mon[124666]: pgmap v12323: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 162 KiB/s wr, 9 op/s 2023-05-08T10:07:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:44 smithi186 ceph-mon[126480]: pgmap v12324: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 255 B/s wr, 5 op/s 2023-05-08T10:07:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23003.092013 secs 2023-05-08T10:07:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23003.647093 secs 2023-05-08T10:07:44.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:44 smithi133 ceph-mon[125939]: pgmap v12324: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 255 B/s wr, 5 op/s 2023-05-08T10:07:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23003.092013 secs 2023-05-08T10:07:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23003.647093 secs 2023-05-08T10:07:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:44 smithi096 ceph-mon[124666]: pgmap v12324: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 255 B/s wr, 5 op/s 2023-05-08T10:07:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23003.092013 secs 2023-05-08T10:07:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23003.647093 secs 2023-05-08T10:07:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23004.934708 secs 2023-05-08T10:07:45.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23004.934708 secs 2023-05-08T10:07:45.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23004.934708 secs 2023-05-08T10:07:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:46 smithi186 ceph-mon[126480]: pgmap v12325: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 79 KiB/s wr, 8 op/s 2023-05-08T10:07:46.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:46 smithi133 ceph-mon[125939]: pgmap v12325: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 79 KiB/s wr, 8 op/s 2023-05-08T10:07:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:46 smithi096 ceph-mon[124666]: pgmap v12325: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 79 KiB/s wr, 8 op/s 2023-05-08T10:07:47.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:47 smithi186 ceph-mon[126480]: pgmap v12326: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 79 KiB/s wr, 6 op/s 2023-05-08T10:07:47.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:47 smithi133 ceph-mon[125939]: pgmap v12326: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 79 KiB/s wr, 6 op/s 2023-05-08T10:07:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:47 smithi096 ceph-mon[124666]: pgmap v12326: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 79 KiB/s wr, 6 op/s 2023-05-08T10:07:48.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23008.092141 secs 2023-05-08T10:07:48.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23008.092141 secs 2023-05-08T10:07:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23008.092141 secs 2023-05-08T10:07:50.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:49 smithi133 ceph-mon[125939]: pgmap v12327: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 79 KiB/s wr, 5 op/s 2023-05-08T10:07:50.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:49 smithi096 ceph-mon[124666]: pgmap v12327: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 79 KiB/s wr, 5 op/s 2023-05-08T10:07:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:49 smithi186 ceph-mon[126480]: pgmap v12327: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 79 KiB/s wr, 5 op/s 2023-05-08T10:07:51.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23009.934857 secs 2023-05-08T10:07:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23009.934857 secs 2023-05-08T10:07:51.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23009.934857 secs 2023-05-08T10:07:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:51 smithi133 ceph-mon[125939]: pgmap v12328: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 267 KiB/s wr, 10 op/s 2023-05-08T10:07:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:51 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:07:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:51 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:07:52.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:51 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:07:52.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:51 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:07:52.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:51 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:07:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:51 smithi096 ceph-mon[124666]: pgmap v12328: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 267 KiB/s wr, 10 op/s 2023-05-08T10:07:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:51 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:07:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:51 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:07:52.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:51 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:07:52.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:51 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:07:52.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:51 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:07:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:51 smithi186 ceph-mon[126480]: pgmap v12328: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 267 KiB/s wr, 10 op/s 2023-05-08T10:07:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:51 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:07:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:51 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:07:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:51 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:07:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:51 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:07:52.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:51 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:07:53.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:52 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:07:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:52 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T10:07:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:52 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T10:07:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:52 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:07:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:52 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:07:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:07:53.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:07:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:52 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:07:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:52 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T10:07:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:52 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T10:07:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:52 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:07:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:52 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:07:53.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:07:53.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:07:53.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:52 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:07:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:52 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T10:07:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:52 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T10:07:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:52 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:07:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:52 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:07:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:07:53.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:07:54.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:53 smithi133 ceph-mon[125939]: pgmap v12329: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 267 KiB/s wr, 7 op/s 2023-05-08T10:07:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23013.092275 secs 2023-05-08T10:07:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:53 smithi096 ceph-mon[124666]: pgmap v12329: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 267 KiB/s wr, 7 op/s 2023-05-08T10:07:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23013.092275 secs 2023-05-08T10:07:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:53 smithi186 ceph-mon[126480]: pgmap v12329: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 267 KiB/s wr, 7 op/s 2023-05-08T10:07:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23013.092275 secs 2023-05-08T10:07:56.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:55 smithi133 ceph-mon[125939]: pgmap v12330: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 463 KiB/s wr, 12 op/s 2023-05-08T10:07:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23014.935013 secs 2023-05-08T10:07:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:55 smithi096 ceph-mon[124666]: pgmap v12330: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 463 KiB/s wr, 12 op/s 2023-05-08T10:07:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23014.935013 secs 2023-05-08T10:07:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:55 smithi186 ceph-mon[126480]: pgmap v12330: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 463 KiB/s wr, 12 op/s 2023-05-08T10:07:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23014.935013 secs 2023-05-08T10:07:58.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:57 smithi133 ceph-mon[125939]: pgmap v12331: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 384 KiB/s wr, 10 op/s 2023-05-08T10:07:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:57 smithi096 ceph-mon[124666]: pgmap v12331: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 384 KiB/s wr, 10 op/s 2023-05-08T10:07:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:57 smithi186 ceph-mon[126480]: pgmap v12331: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 384 KiB/s wr, 10 op/s 2023-05-08T10:07:59.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:58 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:07:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:58 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:07:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:58 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:08:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:59 smithi133 ceph-mon[125939]: pgmap v12332: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 384 KiB/s wr, 10 op/s 2023-05-08T10:08:00.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23018.647487 secs 2023-05-08T10:08:00.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:59 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:08:00.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:59 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T10:08:00.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:07:59 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:08:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:59 smithi096 ceph-mon[124666]: pgmap v12332: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 384 KiB/s wr, 10 op/s 2023-05-08T10:08:00.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23018.647487 secs 2023-05-08T10:08:00.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:59 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:08:00.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:59 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T10:08:00.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:07:59 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:08:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:59 smithi186 ceph-mon[126480]: pgmap v12332: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 384 KiB/s wr, 10 op/s 2023-05-08T10:08:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23018.647487 secs 2023-05-08T10:08:00.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:59 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:08:00.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:59 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T10:08:00.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:07:59 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:08:01.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:08:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:08:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23019.935138 secs 2023-05-08T10:08:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:08:01.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:08:01.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23019.935138 secs 2023-05-08T10:08:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:08:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:08:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23019.935138 secs 2023-05-08T10:08:02.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:01 smithi133 ceph-mon[125939]: pgmap v12333: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 575 KiB/s wr, 15 op/s 2023-05-08T10:08:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:01 smithi096 ceph-mon[124666]: pgmap v12333: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 575 KiB/s wr, 15 op/s 2023-05-08T10:08:02.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:01 smithi186 ceph-mon[126480]: pgmap v12333: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 575 KiB/s wr, 15 op/s 2023-05-08T10:08:04.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:03 smithi133 ceph-mon[125939]: pgmap v12334: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 387 KiB/s wr, 10 op/s 2023-05-08T10:08:04.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:03 smithi096 ceph-mon[124666]: pgmap v12334: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 387 KiB/s wr, 10 op/s 2023-05-08T10:08:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:03 smithi186 ceph-mon[126480]: pgmap v12334: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 387 KiB/s wr, 10 op/s 2023-05-08T10:08:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23023.647547 secs 2023-05-08T10:08:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23023.647547 secs 2023-05-08T10:08:05.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23023.647547 secs 2023-05-08T10:08:06.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:05 smithi133 ceph-mon[125939]: pgmap v12335: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 626 KiB/s wr, 24 op/s 2023-05-08T10:08:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:05 smithi096 ceph-mon[124666]: pgmap v12335: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 626 KiB/s wr, 24 op/s 2023-05-08T10:08:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:05 smithi186 ceph-mon[126480]: pgmap v12335: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 626 KiB/s wr, 24 op/s 2023-05-08T10:08:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:07 smithi133 ceph-mon[125939]: pgmap v12336: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 431 KiB/s wr, 20 op/s 2023-05-08T10:08:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:07 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:08:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:07 smithi096 ceph-mon[124666]: pgmap v12336: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 431 KiB/s wr, 20 op/s 2023-05-08T10:08:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:07 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:08:08.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:07 smithi186 ceph-mon[126480]: pgmap v12336: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 431 KiB/s wr, 20 op/s 2023-05-08T10:08:08.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:07 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:08:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:08 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:08:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:08:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:08:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23028.092641 secs 2023-05-08T10:08:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:08 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:08:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:08:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:08:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23028.092641 secs 2023-05-08T10:08:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:08 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:08:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:08:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:08:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23028.092641 secs 2023-05-08T10:08:10.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:09 smithi133 ceph-mon[125939]: pgmap v12337: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 431 KiB/s wr, 19 op/s 2023-05-08T10:08:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:09 smithi096 ceph-mon[124666]: pgmap v12337: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 431 KiB/s wr, 19 op/s 2023-05-08T10:08:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:09 smithi186 ceph-mon[126480]: pgmap v12337: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 431 KiB/s wr, 19 op/s 2023-05-08T10:08:12.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:11 smithi133 ceph-mon[125939]: pgmap v12338: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 682 KiB/s rd, 692 KiB/s wr, 27 op/s 2023-05-08T10:08:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:11 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T10:08:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:11 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:08:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:11 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:08:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:11 smithi096 ceph-mon[124666]: pgmap v12338: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 682 KiB/s rd, 692 KiB/s wr, 27 op/s 2023-05-08T10:08:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:11 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T10:08:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:11 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:08:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:11 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:08:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:11 smithi186 ceph-mon[126480]: pgmap v12338: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 682 KiB/s rd, 692 KiB/s wr, 27 op/s 2023-05-08T10:08:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:11 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T10:08:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:11 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:08:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:11 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:08:13.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:12 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:08:13.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:12 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:08:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:12 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:08:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:12 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:08:13.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:12 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:08:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:12 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:08:14.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:13 smithi133 ceph-mon[125939]: pgmap v12339: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 488 KiB/s rd, 501 KiB/s wr, 22 op/s 2023-05-08T10:08:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23033.092764 secs 2023-05-08T10:08:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:13 smithi096 ceph-mon[124666]: pgmap v12339: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 488 KiB/s rd, 501 KiB/s wr, 22 op/s 2023-05-08T10:08:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23033.092764 secs 2023-05-08T10:08:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:13 smithi186 ceph-mon[126480]: pgmap v12339: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 488 KiB/s rd, 501 KiB/s wr, 22 op/s 2023-05-08T10:08:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23033.092764 secs 2023-05-08T10:08:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:15 smithi096 ceph-mon[124666]: pgmap v12340: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 577 KiB/s wr, 26 op/s 2023-05-08T10:08:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:15 smithi186 ceph-mon[126480]: pgmap v12340: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 577 KiB/s wr, 26 op/s 2023-05-08T10:08:16.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:15 smithi133 ceph-mon[125939]: pgmap v12340: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 577 KiB/s wr, 26 op/s 2023-05-08T10:08:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:17 smithi096 ceph-mon[124666]: pgmap v12341: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 530 KiB/s rd, 337 KiB/s wr, 12 op/s 2023-05-08T10:08:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:17 smithi186 ceph-mon[126480]: pgmap v12341: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 530 KiB/s rd, 337 KiB/s wr, 12 op/s 2023-05-08T10:08:18.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:17 smithi133 ceph-mon[125939]: pgmap v12341: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 530 KiB/s rd, 337 KiB/s wr, 12 op/s 2023-05-08T10:08:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23038.092916 secs 2023-05-08T10:08:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23038.092916 secs 2023-05-08T10:08:19.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23038.092916 secs 2023-05-08T10:08:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:19 smithi096 ceph-mon[124666]: pgmap v12342: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 530 KiB/s rd, 337 KiB/s wr, 11 op/s 2023-05-08T10:08:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:19 smithi186 ceph-mon[126480]: pgmap v12342: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 530 KiB/s rd, 337 KiB/s wr, 11 op/s 2023-05-08T10:08:20.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:20 smithi133 ceph-mon[125939]: pgmap v12342: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 530 KiB/s rd, 337 KiB/s wr, 11 op/s 2023-05-08T10:08:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:22 smithi096 ceph-mon[124666]: pgmap v12343: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 363 KiB/s wr, 16 op/s 2023-05-08T10:08:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:22 smithi186 ceph-mon[126480]: pgmap v12343: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 363 KiB/s wr, 16 op/s 2023-05-08T10:08:22.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:22 smithi133 ceph-mon[125939]: pgmap v12343: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 363 KiB/s wr, 16 op/s 2023-05-08T10:08:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:24 smithi186 ceph-mon[126480]: pgmap v12344: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 102 KiB/s wr, 8 op/s 2023-05-08T10:08:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:24 smithi186 ceph-mon[126480]: 1 slow requests, 1 included below; oldest blocked for > 23043.093038 secs 2023-05-08T10:08:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:24 smithi186 ceph-mon[126480]: slow request 23043.093037 seconds old, received at 2023-05-08T03:44:20.260233+0000: client_request(client.15258:3163 link #0x10000000007/0000000100000000000000F2 #0x10000000007/0000000100000000000000C5 2023-05-08T03:44:20.259302+0000 caller_uid=26, caller_gid=26{26,}) currently acquired locks 2023-05-08T10:08:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:24 smithi186 ceph-mon[126480]: 1 slow requests, 1 included below; oldest blocked for > 23043.648001 secs 2023-05-08T10:08:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:24 smithi186 ceph-mon[126480]: slow request 23043.648001 seconds old, received at 2023-05-08T03:44:20.272100+0000: peer_request:client.15258:3163 currently acquired locks 2023-05-08T10:08:24.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:24 smithi133 ceph-mon[125939]: pgmap v12344: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 102 KiB/s wr, 8 op/s 2023-05-08T10:08:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:24 smithi133 ceph-mon[125939]: 1 slow requests, 1 included below; oldest blocked for > 23043.093038 secs 2023-05-08T10:08:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:24 smithi133 ceph-mon[125939]: slow request 23043.093037 seconds old, received at 2023-05-08T03:44:20.260233+0000: client_request(client.15258:3163 link #0x10000000007/0000000100000000000000F2 #0x10000000007/0000000100000000000000C5 2023-05-08T03:44:20.259302+0000 caller_uid=26, caller_gid=26{26,}) currently acquired locks 2023-05-08T10:08:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:24 smithi133 ceph-mon[125939]: 1 slow requests, 1 included below; oldest blocked for > 23043.648001 secs 2023-05-08T10:08:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:24 smithi133 ceph-mon[125939]: slow request 23043.648001 seconds old, received at 2023-05-08T03:44:20.272100+0000: peer_request:client.15258:3163 currently acquired locks 2023-05-08T10:08:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:24 smithi096 ceph-mon[124666]: pgmap v12344: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 102 KiB/s wr, 8 op/s 2023-05-08T10:08:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:24 smithi096 ceph-mon[124666]: 1 slow requests, 1 included below; oldest blocked for > 23043.093038 secs 2023-05-08T10:08:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:24 smithi096 ceph-mon[124666]: slow request 23043.093037 seconds old, received at 2023-05-08T03:44:20.260233+0000: client_request(client.15258:3163 link #0x10000000007/0000000100000000000000F2 #0x10000000007/0000000100000000000000C5 2023-05-08T03:44:20.259302+0000 caller_uid=26, caller_gid=26{26,}) currently acquired locks 2023-05-08T10:08:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:24 smithi096 ceph-mon[124666]: 1 slow requests, 1 included below; oldest blocked for > 23043.648001 secs 2023-05-08T10:08:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:24 smithi096 ceph-mon[124666]: slow request 23043.648001 seconds old, received at 2023-05-08T03:44:20.272100+0000: peer_request:client.15258:3163 currently acquired locks 2023-05-08T10:08:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:26 smithi186 ceph-mon[126480]: pgmap v12345: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 537 KiB/s rd, 427 KiB/s wr, 15 op/s 2023-05-08T10:08:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:26 smithi186 ceph-mon[126480]: 1 slow requests, 1 included below; oldest blocked for > 23044.935763 secs 2023-05-08T10:08:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:26 smithi186 ceph-mon[126480]: slow request 23044.935762 seconds old, received at 2023-05-08T03:44:20.261840+0000: peer_request:client.15258:3163 currently dispatched 2023-05-08T10:08:26.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:26 smithi133 ceph-mon[125939]: pgmap v12345: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 537 KiB/s rd, 427 KiB/s wr, 15 op/s 2023-05-08T10:08:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:26 smithi133 ceph-mon[125939]: 1 slow requests, 1 included below; oldest blocked for > 23044.935763 secs 2023-05-08T10:08:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:26 smithi133 ceph-mon[125939]: slow request 23044.935762 seconds old, received at 2023-05-08T03:44:20.261840+0000: peer_request:client.15258:3163 currently dispatched 2023-05-08T10:08:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:26 smithi096 ceph-mon[124666]: pgmap v12345: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 537 KiB/s rd, 427 KiB/s wr, 15 op/s 2023-05-08T10:08:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:26 smithi096 ceph-mon[124666]: 1 slow requests, 1 included below; oldest blocked for > 23044.935763 secs 2023-05-08T10:08:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:26 smithi096 ceph-mon[124666]: slow request 23044.935762 seconds old, received at 2023-05-08T03:44:20.261840+0000: peer_request:client.15258:3163 currently dispatched 2023-05-08T10:08:27.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:27 smithi186 ceph-mon[126480]: osdmap e848: 12 total, 12 up, 12 in 2023-05-08T10:08:27.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:27 smithi133 ceph-mon[125939]: osdmap e848: 12 total, 12 up, 12 in 2023-05-08T10:08:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:27 smithi096 ceph-mon[124666]: osdmap e848: 12 total, 12 up, 12 in 2023-05-08T10:08:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:28 smithi186 ceph-mon[126480]: pgmap v12347: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 422 KiB/s wr, 13 op/s 2023-05-08T10:08:28.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:28 smithi133 ceph-mon[125939]: pgmap v12347: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 422 KiB/s wr, 13 op/s 2023-05-08T10:08:28.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:28 smithi096 ceph-mon[124666]: pgmap v12347: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 422 KiB/s wr, 13 op/s 2023-05-08T10:08:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:29 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:08:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:29 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:08:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:29 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:08:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:29 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:08:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23048.093152 secs 2023-05-08T10:08:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23048.648125 secs 2023-05-08T10:08:29.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:29 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:08:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:29 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:08:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:29 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:08:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:29 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:08:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23048.093152 secs 2023-05-08T10:08:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23048.648125 secs 2023-05-08T10:08:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:29 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:08:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:29 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:08:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:29 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:08:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:29 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:08:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23048.093152 secs 2023-05-08T10:08:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23048.648125 secs 2023-05-08T10:08:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:30 smithi186 ceph-mon[126480]: pgmap v12348: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 422 KiB/s wr, 13 op/s 2023-05-08T10:08:30.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:30 smithi133 ceph-mon[125939]: pgmap v12348: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 422 KiB/s wr, 13 op/s 2023-05-08T10:08:30.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:30 smithi096 ceph-mon[124666]: pgmap v12348: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 422 KiB/s wr, 13 op/s 2023-05-08T10:08:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23049.935813 secs 2023-05-08T10:08:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23049.935813 secs 2023-05-08T10:08:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23049.935813 secs 2023-05-08T10:08:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:32 smithi186 ceph-mon[126480]: pgmap v12349: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 698 KiB/s wr, 14 op/s 2023-05-08T10:08:32.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:32 smithi133 ceph-mon[125939]: pgmap v12349: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 698 KiB/s wr, 14 op/s 2023-05-08T10:08:32.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:32 smithi096 ceph-mon[124666]: pgmap v12349: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 698 KiB/s wr, 14 op/s 2023-05-08T10:08:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:34 smithi186 ceph-mon[126480]: pgmap v12350: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 698 KiB/s wr, 14 op/s 2023-05-08T10:08:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23053.093259 secs 2023-05-08T10:08:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:34 smithi186 ceph-mon[126480]: osdmap e849: 12 total, 12 up, 12 in 2023-05-08T10:08:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23053.648193 secs 2023-05-08T10:08:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:34 smithi133 ceph-mon[125939]: pgmap v12350: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 698 KiB/s wr, 14 op/s 2023-05-08T10:08:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23053.093259 secs 2023-05-08T10:08:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:34 smithi133 ceph-mon[125939]: osdmap e849: 12 total, 12 up, 12 in 2023-05-08T10:08:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23053.648193 secs 2023-05-08T10:08:34.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:34 smithi096 ceph-mon[124666]: pgmap v12350: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 698 KiB/s wr, 14 op/s 2023-05-08T10:08:34.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23053.093259 secs 2023-05-08T10:08:34.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:34 smithi096 ceph-mon[124666]: osdmap e849: 12 total, 12 up, 12 in 2023-05-08T10:08:34.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23053.648193 secs 2023-05-08T10:08:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:36 smithi186 ceph-mon[126480]: pgmap v12352: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 346 KiB/s wr, 10 op/s 2023-05-08T10:08:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23054.935952 secs 2023-05-08T10:08:36.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:36 smithi133 ceph-mon[125939]: pgmap v12352: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 346 KiB/s wr, 10 op/s 2023-05-08T10:08:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23054.935952 secs 2023-05-08T10:08:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:36 smithi096 ceph-mon[124666]: pgmap v12352: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 346 KiB/s wr, 10 op/s 2023-05-08T10:08:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23054.935952 secs 2023-05-08T10:08:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:38 smithi186 ceph-mon[126480]: pgmap v12353: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 308 KiB/s wr, 9 op/s 2023-05-08T10:08:38.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:38 smithi133 ceph-mon[125939]: pgmap v12353: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 308 KiB/s wr, 9 op/s 2023-05-08T10:08:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:38 smithi096 ceph-mon[124666]: pgmap v12353: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 308 KiB/s wr, 9 op/s 2023-05-08T10:08:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23058.093366 secs 2023-05-08T10:08:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23058.648287 secs 2023-05-08T10:08:39.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23058.093366 secs 2023-05-08T10:08:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23058.648287 secs 2023-05-08T10:08:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23058.093366 secs 2023-05-08T10:08:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23058.648287 secs 2023-05-08T10:08:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:40 smithi186 ceph-mon[126480]: pgmap v12354: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 308 KiB/s wr, 9 op/s 2023-05-08T10:08:40.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:40 smithi133 ceph-mon[125939]: pgmap v12354: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 308 KiB/s wr, 9 op/s 2023-05-08T10:08:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:40 smithi096 ceph-mon[124666]: pgmap v12354: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 308 KiB/s wr, 9 op/s 2023-05-08T10:08:42.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:42 smithi186 ceph-mon[126480]: pgmap v12355: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 168 KiB/s wr, 7 op/s 2023-05-08T10:08:42.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:42 smithi133 ceph-mon[125939]: pgmap v12355: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 168 KiB/s wr, 7 op/s 2023-05-08T10:08:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:42 smithi096 ceph-mon[124666]: pgmap v12355: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 168 KiB/s wr, 7 op/s 2023-05-08T10:08:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:44 smithi186 ceph-mon[126480]: pgmap v12356: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 168 KiB/s wr, 7 op/s 2023-05-08T10:08:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23063.093484 secs 2023-05-08T10:08:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:44 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:08:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23063.648353 secs 2023-05-08T10:08:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:44 smithi133 ceph-mon[125939]: pgmap v12356: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 168 KiB/s wr, 7 op/s 2023-05-08T10:08:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23063.093484 secs 2023-05-08T10:08:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:44 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:08:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23063.648353 secs 2023-05-08T10:08:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:44 smithi096 ceph-mon[124666]: pgmap v12356: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 168 KiB/s wr, 7 op/s 2023-05-08T10:08:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23063.093484 secs 2023-05-08T10:08:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:44 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:08:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23063.648353 secs 2023-05-08T10:08:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:45 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:08:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:45 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:08:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:45 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:08:45.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:45 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:08:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:45 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:08:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:45 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:08:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:45 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:08:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:45 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:08:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:45 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:08:46.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:46 smithi186 ceph-mon[126480]: pgmap v12357: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 530 KiB/s rd, 330 KiB/s wr, 10 op/s 2023-05-08T10:08:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23064.936139 secs 2023-05-08T10:08:46.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:46 smithi133 ceph-mon[125939]: pgmap v12357: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 530 KiB/s rd, 330 KiB/s wr, 10 op/s 2023-05-08T10:08:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23064.936139 secs 2023-05-08T10:08:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:46 smithi096 ceph-mon[124666]: pgmap v12357: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 530 KiB/s rd, 330 KiB/s wr, 10 op/s 2023-05-08T10:08:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23064.936139 secs 2023-05-08T10:08:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:48 smithi186 ceph-mon[126480]: pgmap v12358: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 302 KiB/s wr, 6 op/s 2023-05-08T10:08:48.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:48 smithi133 ceph-mon[125939]: pgmap v12358: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 302 KiB/s wr, 6 op/s 2023-05-08T10:08:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:48 smithi096 ceph-mon[124666]: pgmap v12358: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 302 KiB/s wr, 6 op/s 2023-05-08T10:08:49.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:08:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:08:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23068.093626 secs 2023-05-08T10:08:49.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:08:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:08:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23068.093626 secs 2023-05-08T10:08:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:08:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:08:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23068.093626 secs 2023-05-08T10:08:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:50 smithi186 ceph-mon[126480]: pgmap v12359: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 302 KiB/s wr, 6 op/s 2023-05-08T10:08:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:50 smithi133 ceph-mon[125939]: pgmap v12359: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 302 KiB/s wr, 6 op/s 2023-05-08T10:08:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:50 smithi096 ceph-mon[124666]: pgmap v12359: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 302 KiB/s wr, 6 op/s 2023-05-08T10:08:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23069.936257 secs 2023-05-08T10:08:51.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23069.936257 secs 2023-05-08T10:08:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23069.936257 secs 2023-05-08T10:08:52.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:52 smithi186 ceph-mon[126480]: pgmap v12360: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 396 KiB/s wr, 10 op/s 2023-05-08T10:08:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:08:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:08:52.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:52 smithi133 ceph-mon[125939]: pgmap v12360: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 396 KiB/s wr, 10 op/s 2023-05-08T10:08:52.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:08:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:08:52.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:52 smithi096 ceph-mon[124666]: pgmap v12360: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 396 KiB/s wr, 10 op/s 2023-05-08T10:08:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:08:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:08:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:53 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:08:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:08:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:08:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:53 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:08:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:53 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:08:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:53 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:08:53.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:53 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:08:53.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:08:53.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:08:53.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:53 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:08:53.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:53 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:08:53.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:53 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:08:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:53 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:08:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:08:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:08:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:53 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:08:53.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:53 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:08:53.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:53 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:08:54.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:54 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:08:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:54 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T10:08:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:54 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T10:08:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:54 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:08:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:54 smithi133 ceph-mon[125939]: pgmap v12361: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 256 KiB/s wr, 7 op/s 2023-05-08T10:08:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23073.093767 secs 2023-05-08T10:08:54.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:54 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:08:54.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:54 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T10:08:54.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:54 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T10:08:54.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:54 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:08:54.509 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:54 smithi096 ceph-mon[124666]: pgmap v12361: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 256 KiB/s wr, 7 op/s 2023-05-08T10:08:54.509 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23073.093767 secs 2023-05-08T10:08:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:54 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:08:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:54 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T10:08:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:54 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T10:08:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:54 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:08:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:54 smithi186 ceph-mon[126480]: pgmap v12361: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 256 KiB/s wr, 7 op/s 2023-05-08T10:08:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23073.093767 secs 2023-05-08T10:08:56.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:56 smithi133 ceph-mon[125939]: pgmap v12362: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 576 KiB/s rd, 563 KiB/s wr, 12 op/s 2023-05-08T10:08:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23074.936394 secs 2023-05-08T10:08:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:56 smithi096 ceph-mon[124666]: pgmap v12362: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 576 KiB/s rd, 563 KiB/s wr, 12 op/s 2023-05-08T10:08:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23074.936394 secs 2023-05-08T10:08:56.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:56 smithi186 ceph-mon[126480]: pgmap v12362: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 576 KiB/s rd, 563 KiB/s wr, 12 op/s 2023-05-08T10:08:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23074.936394 secs 2023-05-08T10:08:58.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:58 smithi133 ceph-mon[125939]: pgmap v12363: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 400 KiB/s wr, 9 op/s 2023-05-08T10:08:58.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:58 smithi096 ceph-mon[124666]: pgmap v12363: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 400 KiB/s wr, 9 op/s 2023-05-08T10:08:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:58 smithi186 ceph-mon[126480]: pgmap v12363: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 400 KiB/s wr, 9 op/s 2023-05-08T10:08:59.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23078.093909 secs 2023-05-08T10:08:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:08:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23078.648611 secs 2023-05-08T10:08:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23078.093909 secs 2023-05-08T10:08:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:08:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23078.648611 secs 2023-05-08T10:08:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23078.093909 secs 2023-05-08T10:08:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:08:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23078.648611 secs 2023-05-08T10:09:00.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:00 smithi133 ceph-mon[125939]: pgmap v12364: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 400 KiB/s wr, 9 op/s 2023-05-08T10:09:00.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:00 smithi096 ceph-mon[124666]: pgmap v12364: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 400 KiB/s wr, 9 op/s 2023-05-08T10:09:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:00 smithi186 ceph-mon[126480]: pgmap v12364: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 400 KiB/s wr, 9 op/s 2023-05-08T10:09:01.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:01 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:09:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:09:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:09:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:01 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:09:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:09:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:09:01.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:01 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:09:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:09:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:09:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:02 smithi133 ceph-mon[125939]: pgmap v12365: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 521 KiB/s rd, 507 KiB/s wr, 13 op/s 2023-05-08T10:09:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:02 smithi096 ceph-mon[124666]: pgmap v12365: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 521 KiB/s rd, 507 KiB/s wr, 13 op/s 2023-05-08T10:09:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:02 smithi186 ceph-mon[126480]: pgmap v12365: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 521 KiB/s rd, 507 KiB/s wr, 13 op/s 2023-05-08T10:09:04.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:04 smithi133 ceph-mon[125939]: pgmap v12366: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 414 KiB/s wr, 9 op/s 2023-05-08T10:09:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23083.094019 secs 2023-05-08T10:09:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:04 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:09:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23083.648726 secs 2023-05-08T10:09:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:04 smithi096 ceph-mon[124666]: pgmap v12366: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 414 KiB/s wr, 9 op/s 2023-05-08T10:09:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23083.094019 secs 2023-05-08T10:09:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:04 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:09:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23083.648726 secs 2023-05-08T10:09:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:04 smithi186 ceph-mon[126480]: pgmap v12366: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 414 KiB/s wr, 9 op/s 2023-05-08T10:09:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23083.094019 secs 2023-05-08T10:09:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:04 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:09:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23083.648726 secs 2023-05-08T10:09:05.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:09:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:09:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:09:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:09:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:09:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:09:06.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:06 smithi133 ceph-mon[125939]: pgmap v12367: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 624 KiB/s rd, 625 KiB/s wr, 26 op/s 2023-05-08T10:09:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:06 smithi096 ceph-mon[124666]: pgmap v12367: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 624 KiB/s rd, 625 KiB/s wr, 26 op/s 2023-05-08T10:09:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:06 smithi186 ceph-mon[126480]: pgmap v12367: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 624 KiB/s rd, 625 KiB/s wr, 26 op/s 2023-05-08T10:09:08.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:08 smithi133 ceph-mon[125939]: pgmap v12368: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 318 KiB/s wr, 20 op/s 2023-05-08T10:09:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:08 smithi096 ceph-mon[124666]: pgmap v12368: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 318 KiB/s wr, 20 op/s 2023-05-08T10:09:08.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:08 smithi186 ceph-mon[126480]: pgmap v12368: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 318 KiB/s wr, 20 op/s 2023-05-08T10:09:09.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23088.094142 secs 2023-05-08T10:09:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:09 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:09:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23088.648844 secs 2023-05-08T10:09:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23088.094142 secs 2023-05-08T10:09:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:09 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:09:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23088.648844 secs 2023-05-08T10:09:09.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23088.094142 secs 2023-05-08T10:09:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:09 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:09:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23088.648844 secs 2023-05-08T10:09:10.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:10 smithi133 ceph-mon[125939]: pgmap v12369: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 318 KiB/s wr, 20 op/s 2023-05-08T10:09:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:10 smithi096 ceph-mon[124666]: pgmap v12369: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 318 KiB/s wr, 20 op/s 2023-05-08T10:09:10.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:10 smithi186 ceph-mon[126480]: pgmap v12369: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 318 KiB/s wr, 20 op/s 2023-05-08T10:09:12.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:12 smithi133 ceph-mon[125939]: pgmap v12370: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 406 KiB/s wr, 24 op/s 2023-05-08T10:09:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:12 smithi096 ceph-mon[124666]: pgmap v12370: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 406 KiB/s wr, 24 op/s 2023-05-08T10:09:12.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:12 smithi186 ceph-mon[126480]: pgmap v12370: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 406 KiB/s wr, 24 op/s 2023-05-08T10:09:14.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:14 smithi133 ceph-mon[125939]: pgmap v12371: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 299 KiB/s wr, 19 op/s 2023-05-08T10:09:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23093.094258 secs 2023-05-08T10:09:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23093.648961 secs 2023-05-08T10:09:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:14 smithi096 ceph-mon[124666]: pgmap v12371: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 299 KiB/s wr, 19 op/s 2023-05-08T10:09:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23093.094258 secs 2023-05-08T10:09:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23093.648961 secs 2023-05-08T10:09:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:14 smithi186 ceph-mon[126480]: pgmap v12371: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 299 KiB/s wr, 19 op/s 2023-05-08T10:09:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23093.094258 secs 2023-05-08T10:09:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23093.648961 secs 2023-05-08T10:09:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:16 smithi133 ceph-mon[125939]: pgmap v12372: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 288 KiB/s rd, 300 KiB/s wr, 23 op/s 2023-05-08T10:09:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:16 smithi096 ceph-mon[124666]: pgmap v12372: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 288 KiB/s rd, 300 KiB/s wr, 23 op/s 2023-05-08T10:09:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:16 smithi186 ceph-mon[126480]: pgmap v12372: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 288 KiB/s rd, 300 KiB/s wr, 23 op/s 2023-05-08T10:09:18.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:18 smithi133 ceph-mon[125939]: pgmap v12373: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 88 KiB/s wr, 6 op/s 2023-05-08T10:09:18.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:18 smithi096 ceph-mon[124666]: pgmap v12373: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 88 KiB/s wr, 6 op/s 2023-05-08T10:09:18.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:18 smithi186 ceph-mon[126480]: pgmap v12373: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 88 KiB/s wr, 6 op/s 2023-05-08T10:09:19.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23098.094345 secs 2023-05-08T10:09:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23098.094345 secs 2023-05-08T10:09:19.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23098.094345 secs 2023-05-08T10:09:20.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:20 smithi133 ceph-mon[125939]: pgmap v12374: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 88 KiB/s wr, 6 op/s 2023-05-08T10:09:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:20 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:09:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:20 smithi096 ceph-mon[124666]: pgmap v12374: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 88 KiB/s wr, 6 op/s 2023-05-08T10:09:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:20 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:09:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:20 smithi186 ceph-mon[126480]: pgmap v12374: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 88 KiB/s wr, 6 op/s 2023-05-08T10:09:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:20 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:09:21.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:21 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:09:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:21 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:09:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:21 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:09:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:21 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:09:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:21 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:09:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:21 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:09:21.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:21 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:09:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:21 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:09:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:21 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:09:22.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:22 smithi133 ceph-mon[125939]: pgmap v12375: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 226 KiB/s wr, 13 op/s 2023-05-08T10:09:22.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:22 smithi096 ceph-mon[124666]: pgmap v12375: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 226 KiB/s wr, 13 op/s 2023-05-08T10:09:22.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:22 smithi186 ceph-mon[126480]: pgmap v12375: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 226 KiB/s wr, 13 op/s 2023-05-08T10:09:24.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:24 smithi133 ceph-mon[125939]: pgmap v12376: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 138 KiB/s wr, 10 op/s 2023-05-08T10:09:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23103.094383 secs 2023-05-08T10:09:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:24 smithi096 ceph-mon[124666]: pgmap v12376: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 138 KiB/s wr, 10 op/s 2023-05-08T10:09:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23103.094383 secs 2023-05-08T10:09:24.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:24 smithi186 ceph-mon[126480]: pgmap v12376: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 138 KiB/s wr, 10 op/s 2023-05-08T10:09:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23103.094383 secs 2023-05-08T10:09:26.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:26 smithi133 ceph-mon[125939]: pgmap v12377: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 173 KiB/s wr, 13 op/s 2023-05-08T10:09:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:26 smithi133 ceph-mon[125939]: osdmap e850: 12 total, 12 up, 12 in 2023-05-08T10:09:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:26 smithi096 ceph-mon[124666]: pgmap v12377: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 173 KiB/s wr, 13 op/s 2023-05-08T10:09:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:26 smithi096 ceph-mon[124666]: osdmap e850: 12 total, 12 up, 12 in 2023-05-08T10:09:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:26 smithi186 ceph-mon[126480]: pgmap v12377: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 173 KiB/s wr, 13 op/s 2023-05-08T10:09:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:26 smithi186 ceph-mon[126480]: osdmap e850: 12 total, 12 up, 12 in 2023-05-08T10:09:28.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:28 smithi133 ceph-mon[125939]: pgmap v12379: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 207 KiB/s wr, 12 op/s 2023-05-08T10:09:28.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:28 smithi096 ceph-mon[124666]: pgmap v12379: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 207 KiB/s wr, 12 op/s 2023-05-08T10:09:28.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:28 smithi186 ceph-mon[126480]: pgmap v12379: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 207 KiB/s wr, 12 op/s 2023-05-08T10:09:29.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23108.094504 secs 2023-05-08T10:09:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23108.094504 secs 2023-05-08T10:09:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23108.094504 secs 2023-05-08T10:09:30.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:30 smithi133 ceph-mon[125939]: pgmap v12380: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 207 KiB/s wr, 12 op/s 2023-05-08T10:09:30.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:30 smithi096 ceph-mon[124666]: pgmap v12380: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 207 KiB/s wr, 12 op/s 2023-05-08T10:09:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:30 smithi186 ceph-mon[126480]: pgmap v12380: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 207 KiB/s wr, 12 op/s 2023-05-08T10:09:32.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:32 smithi133 ceph-mon[125939]: pgmap v12381: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 410 KiB/s wr, 9 op/s 2023-05-08T10:09:32.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:32 smithi096 ceph-mon[124666]: pgmap v12381: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 410 KiB/s wr, 9 op/s 2023-05-08T10:09:32.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:32 smithi186 ceph-mon[126480]: pgmap v12381: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 410 KiB/s wr, 9 op/s 2023-05-08T10:09:34.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:34 smithi133 ceph-mon[125939]: pgmap v12382: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 410 KiB/s wr, 9 op/s 2023-05-08T10:09:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23113.094605 secs 2023-05-08T10:09:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:34 smithi133 ceph-mon[125939]: osdmap e851: 12 total, 12 up, 12 in 2023-05-08T10:09:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:34 smithi096 ceph-mon[124666]: pgmap v12382: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 410 KiB/s wr, 9 op/s 2023-05-08T10:09:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23113.094605 secs 2023-05-08T10:09:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:34 smithi096 ceph-mon[124666]: osdmap e851: 12 total, 12 up, 12 in 2023-05-08T10:09:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:34 smithi186 ceph-mon[126480]: pgmap v12382: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 410 KiB/s wr, 9 op/s 2023-05-08T10:09:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23113.094605 secs 2023-05-08T10:09:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:34 smithi186 ceph-mon[126480]: osdmap e851: 12 total, 12 up, 12 in 2023-05-08T10:09:36.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:36 smithi133 ceph-mon[125939]: pgmap v12384: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 713 KiB/s wr, 10 op/s 2023-05-08T10:09:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23114.937263 secs 2023-05-08T10:09:36.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:36 smithi096 ceph-mon[124666]: pgmap v12384: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 713 KiB/s wr, 10 op/s 2023-05-08T10:09:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23114.937263 secs 2023-05-08T10:09:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:36 smithi186 ceph-mon[126480]: pgmap v12384: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 713 KiB/s wr, 10 op/s 2023-05-08T10:09:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23114.937263 secs 2023-05-08T10:09:37.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:37 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:09:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:37 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:09:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:37 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:09:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:37 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:09:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:37 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:09:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:37 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:09:37.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:37 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:09:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:37 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:09:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:37 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:09:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:38 smithi096 ceph-mon[124666]: pgmap v12385: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 693 KiB/s wr, 10 op/s 2023-05-08T10:09:38.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:38 smithi186 ceph-mon[126480]: pgmap v12385: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 693 KiB/s wr, 10 op/s 2023-05-08T10:09:38.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:38 smithi133 ceph-mon[125939]: pgmap v12385: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 693 KiB/s wr, 10 op/s 2023-05-08T10:09:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23118.094706 secs 2023-05-08T10:09:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23118.649581 secs 2023-05-08T10:09:39.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23118.094706 secs 2023-05-08T10:09:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23118.649581 secs 2023-05-08T10:09:39.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23118.094706 secs 2023-05-08T10:09:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23118.649581 secs 2023-05-08T10:09:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:40 smithi096 ceph-mon[124666]: pgmap v12386: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 693 KiB/s wr, 10 op/s 2023-05-08T10:09:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:40 smithi186 ceph-mon[126480]: pgmap v12386: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 693 KiB/s wr, 10 op/s 2023-05-08T10:09:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:40 smithi133 ceph-mon[125939]: pgmap v12386: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 693 KiB/s wr, 10 op/s 2023-05-08T10:09:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:41 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:09:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:41 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:09:41.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:41 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:09:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:41 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:09:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:41 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:09:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:41 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:09:42.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:42 smithi186 ceph-mon[126480]: pgmap v12387: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 529 KiB/s rd, 435 KiB/s wr, 10 op/s 2023-05-08T10:09:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:42 smithi133 ceph-mon[125939]: pgmap v12387: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 529 KiB/s rd, 435 KiB/s wr, 10 op/s 2023-05-08T10:09:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:42 smithi096 ceph-mon[124666]: pgmap v12387: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 529 KiB/s rd, 435 KiB/s wr, 10 op/s 2023-05-08T10:09:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:44 smithi186 ceph-mon[126480]: pgmap v12388: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 529 KiB/s rd, 435 KiB/s wr, 10 op/s 2023-05-08T10:09:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23123.094848 secs 2023-05-08T10:09:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:44 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:09:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23123.649725 secs 2023-05-08T10:09:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:44 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:09:44.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:44 smithi133 ceph-mon[125939]: pgmap v12388: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 529 KiB/s rd, 435 KiB/s wr, 10 op/s 2023-05-08T10:09:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23123.094848 secs 2023-05-08T10:09:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:44 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:09:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23123.649725 secs 2023-05-08T10:09:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:44 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:09:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:44 smithi096 ceph-mon[124666]: pgmap v12388: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 529 KiB/s rd, 435 KiB/s wr, 10 op/s 2023-05-08T10:09:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23123.094848 secs 2023-05-08T10:09:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:44 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:09:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23123.649725 secs 2023-05-08T10:09:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:44 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:09:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:45 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:09:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:45 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:09:45.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:45 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:09:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:45 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:09:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:45 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:09:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:45 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:09:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:46 smithi186 ceph-mon[126480]: pgmap v12389: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 750 KiB/s rd, 757 KiB/s wr, 15 op/s 2023-05-08T10:09:46.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23124.937493 secs 2023-05-08T10:09:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:46 smithi133 ceph-mon[125939]: pgmap v12389: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 750 KiB/s rd, 757 KiB/s wr, 15 op/s 2023-05-08T10:09:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23124.937493 secs 2023-05-08T10:09:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:46 smithi096 ceph-mon[124666]: pgmap v12389: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 750 KiB/s rd, 757 KiB/s wr, 15 op/s 2023-05-08T10:09:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23124.937493 secs 2023-05-08T10:09:48.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:48 smithi186 ceph-mon[126480]: pgmap v12390: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 423 KiB/s wr, 9 op/s 2023-05-08T10:09:48.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:48 smithi133 ceph-mon[125939]: pgmap v12390: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 423 KiB/s wr, 9 op/s 2023-05-08T10:09:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:48 smithi096 ceph-mon[124666]: pgmap v12390: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 423 KiB/s wr, 9 op/s 2023-05-08T10:09:49.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:09:49.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:09:49.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23128.094965 secs 2023-05-08T10:09:49.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:09:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:09:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23128.094965 secs 2023-05-08T10:09:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:09:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:09:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23128.094965 secs 2023-05-08T10:09:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:50 smithi186 ceph-mon[126480]: pgmap v12391: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 423 KiB/s wr, 9 op/s 2023-05-08T10:09:50.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:50 smithi133 ceph-mon[125939]: pgmap v12391: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 423 KiB/s wr, 9 op/s 2023-05-08T10:09:50.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:50 smithi096 ceph-mon[124666]: pgmap v12391: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 423 KiB/s wr, 9 op/s 2023-05-08T10:09:51.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23129.937611 secs 2023-05-08T10:09:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23129.937611 secs 2023-05-08T10:09:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23129.937611 secs 2023-05-08T10:09:52.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:52 smithi186 ceph-mon[126480]: pgmap v12392: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 967 KiB/s rd, 496 KiB/s wr, 14 op/s 2023-05-08T10:09:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:09:52.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:52 smithi133 ceph-mon[125939]: pgmap v12392: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 967 KiB/s rd, 496 KiB/s wr, 14 op/s 2023-05-08T10:09:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:09:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:52 smithi096 ceph-mon[124666]: pgmap v12392: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 967 KiB/s rd, 496 KiB/s wr, 14 op/s 2023-05-08T10:09:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:09:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:53 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:09:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:09:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:09:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:53 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:09:53.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:53 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:09:53.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:53 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:09:53.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:53 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:09:53.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:53 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:09:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:09:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:09:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:53 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:09:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:53 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:09:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:53 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:09:53.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:53 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:09:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:53 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:09:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:09:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:09:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:53 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:09:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:53 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:09:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:53 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:09:53.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:53 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:09:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:54 smithi186 ceph-mon[126480]: pgmap v12393: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 606 KiB/s rd, 404 KiB/s wr, 9 op/s 2023-05-08T10:09:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:54 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:09:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:54 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T10:09:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:54 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T10:09:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:54 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:09:54.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23133.095052 secs 2023-05-08T10:09:54.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23133.649997 secs 2023-05-08T10:09:54.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:54 smithi133 ceph-mon[125939]: pgmap v12393: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 606 KiB/s rd, 404 KiB/s wr, 9 op/s 2023-05-08T10:09:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:54 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:09:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:54 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T10:09:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:54 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T10:09:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:54 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:09:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23133.095052 secs 2023-05-08T10:09:54.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23133.649997 secs 2023-05-08T10:09:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:54 smithi096 ceph-mon[124666]: pgmap v12393: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 606 KiB/s rd, 404 KiB/s wr, 9 op/s 2023-05-08T10:09:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:54 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:09:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:54 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T10:09:54.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:54 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T10:09:54.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:54 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:09:54.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23133.095052 secs 2023-05-08T10:09:54.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23133.649997 secs 2023-05-08T10:09:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23134.937728 secs 2023-05-08T10:09:55.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23134.937728 secs 2023-05-08T10:09:55.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23134.937728 secs 2023-05-08T10:09:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:56 smithi186 ceph-mon[126480]: pgmap v12394: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1000 KiB/s wr, 15 op/s 2023-05-08T10:09:56.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:56 smithi133 ceph-mon[125939]: pgmap v12394: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1000 KiB/s wr, 15 op/s 2023-05-08T10:09:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:56 smithi096 ceph-mon[124666]: pgmap v12394: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1000 KiB/s wr, 15 op/s 2023-05-08T10:09:57.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:09:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:09:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:09:57.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:09:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:09:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:09:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:58 smithi186 ceph-mon[126480]: pgmap v12395: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 946 KiB/s rd, 668 KiB/s wr, 11 op/s 2023-05-08T10:09:58.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:58 smithi133 ceph-mon[125939]: pgmap v12395: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 946 KiB/s rd, 668 KiB/s wr, 11 op/s 2023-05-08T10:09:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:58 smithi096 ceph-mon[124666]: pgmap v12395: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 946 KiB/s rd, 668 KiB/s wr, 11 op/s 2023-05-08T10:09:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23138.095170 secs 2023-05-08T10:09:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:09:59 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:09:59.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23138.095170 secs 2023-05-08T10:09:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:09:59 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:09:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23138.095170 secs 2023-05-08T10:09:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:09:59 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:10:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:00 smithi186 ceph-mon[126480]: pgmap v12396: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 946 KiB/s rd, 668 KiB/s wr, 11 op/s 2023-05-08T10:10:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:00 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:10:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:00 smithi186 ceph-mon[126480]: overall HEALTH_WARN 3 MDSs report slow requests 2023-05-08T10:10:00.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:00 smithi133 ceph-mon[125939]: pgmap v12396: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 946 KiB/s rd, 668 KiB/s wr, 11 op/s 2023-05-08T10:10:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:00 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:10:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:00 smithi133 ceph-mon[125939]: overall HEALTH_WARN 3 MDSs report slow requests 2023-05-08T10:10:00.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:00 smithi096 ceph-mon[124666]: pgmap v12396: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 946 KiB/s rd, 668 KiB/s wr, 11 op/s 2023-05-08T10:10:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:00 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:10:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:00 smithi096 ceph-mon[124666]: overall HEALTH_WARN 3 MDSs report slow requests 2023-05-08T10:10:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:10:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:10:01.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:10:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:10:01.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:10:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:10:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:02 smithi186 ceph-mon[126480]: pgmap v12397: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 701 KiB/s wr, 16 op/s 2023-05-08T10:10:02.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:02 smithi133 ceph-mon[125939]: pgmap v12397: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 701 KiB/s wr, 16 op/s 2023-05-08T10:10:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:02 smithi096 ceph-mon[124666]: pgmap v12397: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 701 KiB/s wr, 16 op/s 2023-05-08T10:10:04.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:04 smithi186 ceph-mon[126480]: pgmap v12398: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 734 KiB/s rd, 629 KiB/s wr, 11 op/s 2023-05-08T10:10:04.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23143.095261 secs 2023-05-08T10:10:04.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:04 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:10:04.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23143.650247 secs 2023-05-08T10:10:04.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:04 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:10:04.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:04 smithi133 ceph-mon[125939]: pgmap v12398: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 734 KiB/s rd, 629 KiB/s wr, 11 op/s 2023-05-08T10:10:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23143.095261 secs 2023-05-08T10:10:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:04 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:10:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23143.650247 secs 2023-05-08T10:10:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:04 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:10:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:04 smithi096 ceph-mon[124666]: pgmap v12398: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 734 KiB/s rd, 629 KiB/s wr, 11 op/s 2023-05-08T10:10:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23143.095261 secs 2023-05-08T10:10:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:04 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:10:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23143.650247 secs 2023-05-08T10:10:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:04 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:10:05.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:10:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:10:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:05 smithi133 ceph-mon[125939]: pgmap v12399: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 31 op/s 2023-05-08T10:10:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23144.937905 secs 2023-05-08T10:10:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:10:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:10:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:05 smithi096 ceph-mon[124666]: pgmap v12399: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 31 op/s 2023-05-08T10:10:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23144.937905 secs 2023-05-08T10:10:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:10:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:10:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:05 smithi186 ceph-mon[126480]: pgmap v12399: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 31 op/s 2023-05-08T10:10:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23144.937905 secs 2023-05-08T10:10:06.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:06 smithi133 ceph-mon[125939]: osdmap e852: 12 total, 12 up, 12 in 2023-05-08T10:10:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:06 smithi096 ceph-mon[124666]: osdmap e852: 12 total, 12 up, 12 in 2023-05-08T10:10:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:06 smithi186 ceph-mon[126480]: osdmap e852: 12 total, 12 up, 12 in 2023-05-08T10:10:07.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:07 smithi133 ceph-mon[125939]: pgmap v12401: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 612 KiB/s rd, 518 KiB/s wr, 30 op/s 2023-05-08T10:10:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:07 smithi096 ceph-mon[124666]: pgmap v12401: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 612 KiB/s rd, 518 KiB/s wr, 30 op/s 2023-05-08T10:10:07.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:07 smithi186 ceph-mon[126480]: pgmap v12401: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 612 KiB/s rd, 518 KiB/s wr, 30 op/s 2023-05-08T10:10:09.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23148.095398 secs 2023-05-08T10:10:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:10:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:10:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:10:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23148.650367 secs 2023-05-08T10:10:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:09 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:10:09.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:09 smithi133 ceph-mon[125939]: pgmap v12402: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 612 KiB/s rd, 518 KiB/s wr, 30 op/s 2023-05-08T10:10:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23148.095398 secs 2023-05-08T10:10:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:10:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:10:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:10:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23148.650367 secs 2023-05-08T10:10:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:09 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:10:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:09 smithi096 ceph-mon[124666]: pgmap v12402: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 612 KiB/s rd, 518 KiB/s wr, 30 op/s 2023-05-08T10:10:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23148.095398 secs 2023-05-08T10:10:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:10:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:10:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:10:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23148.650367 secs 2023-05-08T10:10:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:09 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:10:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:09 smithi186 ceph-mon[126480]: pgmap v12402: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 612 KiB/s rd, 518 KiB/s wr, 30 op/s 2023-05-08T10:10:11.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23149.937998 secs 2023-05-08T10:10:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23149.937998 secs 2023-05-08T10:10:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23149.937998 secs 2023-05-08T10:10:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:11 smithi133 ceph-mon[125939]: pgmap v12403: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 479 KiB/s wr, 28 op/s 2023-05-08T10:10:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:11 smithi096 ceph-mon[124666]: pgmap v12403: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 479 KiB/s wr, 28 op/s 2023-05-08T10:10:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:11 smithi186 ceph-mon[126480]: pgmap v12403: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 479 KiB/s wr, 28 op/s 2023-05-08T10:10:14.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:13 smithi133 ceph-mon[125939]: pgmap v12404: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 479 KiB/s wr, 28 op/s 2023-05-08T10:10:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23153.095516 secs 2023-05-08T10:10:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:13 smithi133 ceph-mon[125939]: osdmap e853: 12 total, 12 up, 12 in 2023-05-08T10:10:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:13 smithi096 ceph-mon[124666]: pgmap v12404: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 479 KiB/s wr, 28 op/s 2023-05-08T10:10:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23153.095516 secs 2023-05-08T10:10:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:13 smithi096 ceph-mon[124666]: osdmap e853: 12 total, 12 up, 12 in 2023-05-08T10:10:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:13 smithi186 ceph-mon[126480]: pgmap v12404: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 479 KiB/s wr, 28 op/s 2023-05-08T10:10:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23153.095516 secs 2023-05-08T10:10:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:13 smithi186 ceph-mon[126480]: osdmap e853: 12 total, 12 up, 12 in 2023-05-08T10:10:15.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23153.650512 secs 2023-05-08T10:10:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23153.650512 secs 2023-05-08T10:10:15.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23153.650512 secs 2023-05-08T10:10:16.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:15 smithi133 ceph-mon[125939]: pgmap v12406: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 194 KiB/s wr, 9 op/s 2023-05-08T10:10:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23154.938070 secs 2023-05-08T10:10:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:15 smithi096 ceph-mon[124666]: pgmap v12406: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 194 KiB/s wr, 9 op/s 2023-05-08T10:10:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23154.938070 secs 2023-05-08T10:10:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:15 smithi186 ceph-mon[126480]: pgmap v12406: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 194 KiB/s wr, 9 op/s 2023-05-08T10:10:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23154.938070 secs 2023-05-08T10:10:18.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:17 smithi133 ceph-mon[125939]: pgmap v12407: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 185 KiB/s wr, 9 op/s 2023-05-08T10:10:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:17 smithi096 ceph-mon[124666]: pgmap v12407: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 185 KiB/s wr, 9 op/s 2023-05-08T10:10:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:17 smithi186 ceph-mon[126480]: pgmap v12407: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 185 KiB/s wr, 9 op/s 2023-05-08T10:10:19.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23158.095625 secs 2023-05-08T10:10:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23158.095625 secs 2023-05-08T10:10:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23158.095625 secs 2023-05-08T10:10:20.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23158.650637 secs 2023-05-08T10:10:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:19 smithi133 ceph-mon[125939]: pgmap v12408: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 185 KiB/s wr, 9 op/s 2023-05-08T10:10:20.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23158.650637 secs 2023-05-08T10:10:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:19 smithi096 ceph-mon[124666]: pgmap v12408: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 185 KiB/s wr, 9 op/s 2023-05-08T10:10:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23158.650637 secs 2023-05-08T10:10:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:19 smithi186 ceph-mon[126480]: pgmap v12408: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 185 KiB/s wr, 9 op/s 2023-05-08T10:10:21.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23159.938189 secs 2023-05-08T10:10:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23159.938189 secs 2023-05-08T10:10:21.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23159.938189 secs 2023-05-08T10:10:22.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:21 smithi133 ceph-mon[125939]: pgmap v12409: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 184 KiB/s wr, 8 op/s 2023-05-08T10:10:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:21 smithi096 ceph-mon[124666]: pgmap v12409: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 184 KiB/s wr, 8 op/s 2023-05-08T10:10:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:21 smithi186 ceph-mon[126480]: pgmap v12409: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 184 KiB/s wr, 8 op/s 2023-05-08T10:10:24.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:23 smithi133 ceph-mon[125939]: pgmap v12410: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 184 KiB/s wr, 8 op/s 2023-05-08T10:10:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23163.095726 secs 2023-05-08T10:10:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:23 smithi096 ceph-mon[124666]: pgmap v12410: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 184 KiB/s wr, 8 op/s 2023-05-08T10:10:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23163.095726 secs 2023-05-08T10:10:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:23 smithi186 ceph-mon[126480]: pgmap v12410: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 184 KiB/s wr, 8 op/s 2023-05-08T10:10:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23163.095726 secs 2023-05-08T10:10:25.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23163.650737 secs 2023-05-08T10:10:25.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23163.650737 secs 2023-05-08T10:10:25.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23163.650737 secs 2023-05-08T10:10:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:25 smithi133 ceph-mon[125939]: pgmap v12411: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 328 KiB/s wr, 10 op/s 2023-05-08T10:10:26.405 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23164.938280 secs 2023-05-08T10:10:26.406 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:25 smithi186 ceph-mon[126480]: pgmap v12411: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 328 KiB/s wr, 10 op/s 2023-05-08T10:10:26.406 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23164.938280 secs 2023-05-08T10:10:26.406 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:25 smithi096 ceph-mon[124666]: pgmap v12411: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 328 KiB/s wr, 10 op/s 2023-05-08T10:10:26.406 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23164.938280 secs 2023-05-08T10:10:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:27 smithi133 ceph-mon[125939]: pgmap v12412: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 147 KiB/s wr, 6 op/s 2023-05-08T10:10:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:27 smithi096 ceph-mon[124666]: pgmap v12412: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 147 KiB/s wr, 6 op/s 2023-05-08T10:10:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:27 smithi186 ceph-mon[126480]: pgmap v12412: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 147 KiB/s wr, 6 op/s 2023-05-08T10:10:29.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23168.095841 secs 2023-05-08T10:10:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23168.095841 secs 2023-05-08T10:10:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23168.095841 secs 2023-05-08T10:10:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23168.650862 secs 2023-05-08T10:10:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:29 smithi096 ceph-mon[124666]: pgmap v12413: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 147 KiB/s wr, 6 op/s 2023-05-08T10:10:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23168.650862 secs 2023-05-08T10:10:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:29 smithi186 ceph-mon[126480]: pgmap v12413: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 147 KiB/s wr, 6 op/s 2023-05-08T10:10:30.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23168.650862 secs 2023-05-08T10:10:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:29 smithi133 ceph-mon[125939]: pgmap v12413: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 147 KiB/s wr, 6 op/s 2023-05-08T10:10:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23169.938402 secs 2023-05-08T10:10:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23169.938402 secs 2023-05-08T10:10:31.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23169.938402 secs 2023-05-08T10:10:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:31 smithi096 ceph-mon[124666]: pgmap v12414: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 148 KiB/s wr, 8 op/s 2023-05-08T10:10:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:31 smithi186 ceph-mon[126480]: pgmap v12414: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 148 KiB/s wr, 8 op/s 2023-05-08T10:10:32.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:31 smithi133 ceph-mon[125939]: pgmap v12414: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 148 KiB/s wr, 8 op/s 2023-05-08T10:10:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:33 smithi096 ceph-mon[124666]: pgmap v12415: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 147 KiB/s wr, 5 op/s 2023-05-08T10:10:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23173.095983 secs 2023-05-08T10:10:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:33 smithi186 ceph-mon[126480]: pgmap v12415: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 147 KiB/s wr, 5 op/s 2023-05-08T10:10:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23173.095983 secs 2023-05-08T10:10:34.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:34 smithi133 ceph-mon[125939]: pgmap v12415: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 147 KiB/s wr, 5 op/s 2023-05-08T10:10:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23173.095983 secs 2023-05-08T10:10:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23173.650982 secs 2023-05-08T10:10:35.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23173.650982 secs 2023-05-08T10:10:35.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23173.650982 secs 2023-05-08T10:10:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:36 smithi186 ceph-mon[126480]: pgmap v12416: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 198 KiB/s wr, 8 op/s 2023-05-08T10:10:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23174.938538 secs 2023-05-08T10:10:36.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:36 smithi133 ceph-mon[125939]: pgmap v12416: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 198 KiB/s wr, 8 op/s 2023-05-08T10:10:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23174.938538 secs 2023-05-08T10:10:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:36 smithi096 ceph-mon[124666]: pgmap v12416: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 198 KiB/s wr, 8 op/s 2023-05-08T10:10:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23174.938538 secs 2023-05-08T10:10:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:38 smithi186 ceph-mon[126480]: pgmap v12417: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 50 KiB/s wr, 5 op/s 2023-05-08T10:10:38.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:38 smithi133 ceph-mon[125939]: pgmap v12417: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 50 KiB/s wr, 5 op/s 2023-05-08T10:10:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:38 smithi096 ceph-mon[124666]: pgmap v12417: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 50 KiB/s wr, 5 op/s 2023-05-08T10:10:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23178.096110 secs 2023-05-08T10:10:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23178.651113 secs 2023-05-08T10:10:39.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23178.096110 secs 2023-05-08T10:10:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23178.651113 secs 2023-05-08T10:10:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23178.096110 secs 2023-05-08T10:10:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23178.651113 secs 2023-05-08T10:10:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:40 smithi186 ceph-mon[126480]: pgmap v12418: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 50 KiB/s wr, 5 op/s 2023-05-08T10:10:40.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:40 smithi133 ceph-mon[125939]: pgmap v12418: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 50 KiB/s wr, 5 op/s 2023-05-08T10:10:40.556 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:40 smithi096 ceph-mon[124666]: pgmap v12418: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 50 KiB/s wr, 5 op/s 2023-05-08T10:10:42.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:42 smithi186 ceph-mon[126480]: pgmap v12419: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 8 op/s 2023-05-08T10:10:42.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:42 smithi133 ceph-mon[125939]: pgmap v12419: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 8 op/s 2023-05-08T10:10:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:42 smithi096 ceph-mon[124666]: pgmap v12419: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 8 op/s 2023-05-08T10:10:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:44 smithi186 ceph-mon[126480]: pgmap v12420: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 51 KiB/s wr, 5 op/s 2023-05-08T10:10:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23183.096230 secs 2023-05-08T10:10:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:44 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:10:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23183.651180 secs 2023-05-08T10:10:44.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:44 smithi133 ceph-mon[125939]: pgmap v12420: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 51 KiB/s wr, 5 op/s 2023-05-08T10:10:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23183.096230 secs 2023-05-08T10:10:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:44 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:10:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23183.651180 secs 2023-05-08T10:10:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:44 smithi096 ceph-mon[124666]: pgmap v12420: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 51 KiB/s wr, 5 op/s 2023-05-08T10:10:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23183.096230 secs 2023-05-08T10:10:44.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:44 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:10:44.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23183.651180 secs 2023-05-08T10:10:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:45 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:10:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:45 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:10:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:45 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:10:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:45 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:10:45.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:45 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:10:45.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:45 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:10:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:45 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:10:45.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:45 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:10:45.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:45 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:10:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:46 smithi186 ceph-mon[126480]: pgmap v12421: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 391 KiB/s wr, 10 op/s 2023-05-08T10:10:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23184.938802 secs 2023-05-08T10:10:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:46 smithi133 ceph-mon[125939]: pgmap v12421: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 391 KiB/s wr, 10 op/s 2023-05-08T10:10:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23184.938802 secs 2023-05-08T10:10:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:46 smithi096 ceph-mon[124666]: pgmap v12421: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 391 KiB/s wr, 10 op/s 2023-05-08T10:10:46.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23184.938802 secs 2023-05-08T10:10:48.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:48 smithi186 ceph-mon[126480]: pgmap v12422: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 341 KiB/s wr, 7 op/s 2023-05-08T10:10:48.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:48 smithi133 ceph-mon[125939]: pgmap v12422: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 341 KiB/s wr, 7 op/s 2023-05-08T10:10:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:48 smithi096 ceph-mon[124666]: pgmap v12422: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 341 KiB/s wr, 7 op/s 2023-05-08T10:10:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:10:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:10:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23188.096367 secs 2023-05-08T10:10:49.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:10:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:10:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23188.096367 secs 2023-05-08T10:10:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:10:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:10:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23188.096367 secs 2023-05-08T10:10:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:50 smithi186 ceph-mon[126480]: pgmap v12423: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 341 KiB/s wr, 7 op/s 2023-05-08T10:10:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:50 smithi133 ceph-mon[125939]: pgmap v12423: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 341 KiB/s wr, 7 op/s 2023-05-08T10:10:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:50 smithi096 ceph-mon[124666]: pgmap v12423: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 341 KiB/s wr, 7 op/s 2023-05-08T10:10:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23189.938915 secs 2023-05-08T10:10:51.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23189.938915 secs 2023-05-08T10:10:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23189.938915 secs 2023-05-08T10:10:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:52 smithi186 ceph-mon[126480]: pgmap v12424: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 495 KiB/s rd, 449 KiB/s wr, 12 op/s 2023-05-08T10:10:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:10:52.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:52 smithi133 ceph-mon[125939]: pgmap v12424: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 495 KiB/s rd, 449 KiB/s wr, 12 op/s 2023-05-08T10:10:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:10:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:52 smithi096 ceph-mon[124666]: pgmap v12424: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 495 KiB/s rd, 449 KiB/s wr, 12 op/s 2023-05-08T10:10:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:10:53.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:53 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:10:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:10:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:10:53.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:53 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:10:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:10:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:10:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:53 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:10:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:10:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:10:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:54 smithi186 ceph-mon[126480]: pgmap v12425: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 449 KiB/s wr, 9 op/s 2023-05-08T10:10:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:10:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23193.096437 secs 2023-05-08T10:10:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23193.651439 secs 2023-05-08T10:10:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:54 smithi133 ceph-mon[125939]: pgmap v12425: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 449 KiB/s wr, 9 op/s 2023-05-08T10:10:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:10:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23193.096437 secs 2023-05-08T10:10:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23193.651439 secs 2023-05-08T10:10:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:54 smithi096 ceph-mon[124666]: pgmap v12425: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 449 KiB/s wr, 9 op/s 2023-05-08T10:10:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:10:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23193.096437 secs 2023-05-08T10:10:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23193.651439 secs 2023-05-08T10:10:56.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:56 smithi186 ceph-mon[126480]: pgmap v12426: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 805 KiB/s rd, 735 KiB/s wr, 15 op/s 2023-05-08T10:10:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23194.939021 secs 2023-05-08T10:10:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:10:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:10:56.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:56 smithi133 ceph-mon[125939]: pgmap v12426: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 805 KiB/s rd, 735 KiB/s wr, 15 op/s 2023-05-08T10:10:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23194.939021 secs 2023-05-08T10:10:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:10:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:10:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:56 smithi096 ceph-mon[124666]: pgmap v12426: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 805 KiB/s rd, 735 KiB/s wr, 15 op/s 2023-05-08T10:10:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23194.939021 secs 2023-05-08T10:10:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:10:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:10:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:10:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:10:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:10:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:10:57.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:10:57.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:10:57.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:10:57.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:10:57.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:10:57.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:10:57.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:10:57.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:10:57.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:10:57.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:10:57.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:10:57.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:10:57.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:10:57.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:10:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:10:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:10:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:10:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:10:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:10:57.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:10:57.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:10:57.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:10:57.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:10:57.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:10:57.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:10:57.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:10:57.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:10:57.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:10:57.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:10:57.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:10:57.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:10:57.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:10:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:10:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:10:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:10:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:10:57.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:10:57.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:10:57.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:10:57.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:10:57.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:10:57.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:10:57.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:10:57.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:10:57.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:10:57.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:10:57.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:10:57.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:10:57.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:10:57.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:10:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:58 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T10:10:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:58 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T10:10:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:58 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T10:10:58.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:58 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T10:10:58.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:58 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:10:58.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:58 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T10:10:58.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:58 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T10:10:58.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:58 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:10:58.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:58 smithi186 ceph-mon[126480]: pgmap v12427: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 395 KiB/s wr, 10 op/s 2023-05-08T10:10:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:58 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T10:10:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:58 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T10:10:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:58 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T10:10:58.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:58 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T10:10:58.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:58 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:10:58.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:58 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T10:10:58.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:58 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T10:10:58.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:58 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:10:58.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:58 smithi133 ceph-mon[125939]: pgmap v12427: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 395 KiB/s wr, 10 op/s 2023-05-08T10:10:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:58 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T10:10:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:58 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T10:10:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:58 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T10:10:58.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:58 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T10:10:58.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:58 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:10:58.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:58 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T10:10:58.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:58 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T10:10:58.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:58 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:10:58.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:58 smithi096 ceph-mon[124666]: pgmap v12427: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 395 KiB/s wr, 10 op/s 2023-05-08T10:10:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23198.096551 secs 2023-05-08T10:10:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23198.651563 secs 2023-05-08T10:10:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:10:59 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:10:59.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23198.096551 secs 2023-05-08T10:10:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23198.651563 secs 2023-05-08T10:10:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:10:59 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:10:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23198.096551 secs 2023-05-08T10:10:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23198.651563 secs 2023-05-08T10:10:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:10:59 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:11:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:00 smithi186 ceph-mon[126480]: pgmap v12428: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 395 KiB/s wr, 10 op/s 2023-05-08T10:11:00.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:00 smithi133 ceph-mon[125939]: pgmap v12428: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 395 KiB/s wr, 10 op/s 2023-05-08T10:11:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:00 smithi096 ceph-mon[124666]: pgmap v12428: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 395 KiB/s wr, 10 op/s 2023-05-08T10:11:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23199.939100 secs 2023-05-08T10:11:01.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23199.939100 secs 2023-05-08T10:11:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23199.939100 secs 2023-05-08T10:11:02.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:02 smithi186 ceph-mon[126480]: pgmap v12429: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 487 KiB/s wr, 15 op/s 2023-05-08T10:11:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:02 smithi133 ceph-mon[125939]: pgmap v12429: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 487 KiB/s wr, 15 op/s 2023-05-08T10:11:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:02 smithi096 ceph-mon[124666]: pgmap v12429: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 487 KiB/s wr, 15 op/s 2023-05-08T10:11:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:04 smithi186 ceph-mon[126480]: pgmap v12430: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 405 KiB/s rd, 378 KiB/s wr, 10 op/s 2023-05-08T10:11:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23203.096622 secs 2023-05-08T10:11:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23203.651684 secs 2023-05-08T10:11:04.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:04 smithi133 ceph-mon[125939]: pgmap v12430: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 405 KiB/s rd, 378 KiB/s wr, 10 op/s 2023-05-08T10:11:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23203.096622 secs 2023-05-08T10:11:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23203.651684 secs 2023-05-08T10:11:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:04 smithi096 ceph-mon[124666]: pgmap v12430: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 405 KiB/s rd, 378 KiB/s wr, 10 op/s 2023-05-08T10:11:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23203.096622 secs 2023-05-08T10:11:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23203.651684 secs 2023-05-08T10:11:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:06 smithi186 ceph-mon[126480]: pgmap v12431: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 777 KiB/s rd, 786 KiB/s wr, 29 op/s 2023-05-08T10:11:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23204.939243 secs 2023-05-08T10:11:06.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:06 smithi133 ceph-mon[125939]: pgmap v12431: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 777 KiB/s rd, 786 KiB/s wr, 29 op/s 2023-05-08T10:11:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23204.939243 secs 2023-05-08T10:11:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:06 smithi096 ceph-mon[124666]: pgmap v12431: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 777 KiB/s rd, 786 KiB/s wr, 29 op/s 2023-05-08T10:11:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23204.939243 secs 2023-05-08T10:11:08.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:08 smithi186 ceph-mon[126480]: pgmap v12432: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 704 KiB/s rd, 803 KiB/s wr, 25 op/s 2023-05-08T10:11:08.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:08 smithi133 ceph-mon[125939]: pgmap v12432: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 704 KiB/s rd, 803 KiB/s wr, 25 op/s 2023-05-08T10:11:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:08 smithi096 ceph-mon[124666]: pgmap v12432: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 704 KiB/s rd, 803 KiB/s wr, 25 op/s 2023-05-08T10:11:09.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23208.096756 secs 2023-05-08T10:11:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23208.651823 secs 2023-05-08T10:11:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23208.096756 secs 2023-05-08T10:11:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23208.651823 secs 2023-05-08T10:11:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23208.096756 secs 2023-05-08T10:11:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23208.651823 secs 2023-05-08T10:11:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:10 smithi186 ceph-mon[126480]: pgmap v12433: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 704 KiB/s rd, 802 KiB/s wr, 25 op/s 2023-05-08T10:11:10.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:10 smithi133 ceph-mon[125939]: pgmap v12433: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 704 KiB/s rd, 802 KiB/s wr, 25 op/s 2023-05-08T10:11:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:10 smithi096 ceph-mon[124666]: pgmap v12433: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 704 KiB/s rd, 802 KiB/s wr, 25 op/s 2023-05-08T10:11:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23209.939364 secs 2023-05-08T10:11:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23209.939364 secs 2023-05-08T10:11:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23209.939364 secs 2023-05-08T10:11:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:12 smithi186 ceph-mon[126480]: pgmap v12434: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 953 KiB/s rd, 987 KiB/s wr, 29 op/s 2023-05-08T10:11:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:12 smithi186 ceph-mon[126480]: osdmap e854: 12 total, 12 up, 12 in 2023-05-08T10:11:12.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:12 smithi133 ceph-mon[125939]: pgmap v12434: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 953 KiB/s rd, 987 KiB/s wr, 29 op/s 2023-05-08T10:11:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:12 smithi133 ceph-mon[125939]: osdmap e854: 12 total, 12 up, 12 in 2023-05-08T10:11:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:12 smithi096 ceph-mon[124666]: pgmap v12434: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 953 KiB/s rd, 987 KiB/s wr, 29 op/s 2023-05-08T10:11:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:12 smithi096 ceph-mon[124666]: osdmap e854: 12 total, 12 up, 12 in 2023-05-08T10:11:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:14 smithi186 ceph-mon[126480]: pgmap v12436: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 29 op/s 2023-05-08T10:11:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23213.096870 secs 2023-05-08T10:11:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23213.651901 secs 2023-05-08T10:11:14.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:14 smithi133 ceph-mon[125939]: pgmap v12436: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 29 op/s 2023-05-08T10:11:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23213.096870 secs 2023-05-08T10:11:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23213.651901 secs 2023-05-08T10:11:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:14 smithi096 ceph-mon[124666]: pgmap v12436: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 29 op/s 2023-05-08T10:11:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23213.096870 secs 2023-05-08T10:11:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23213.651901 secs 2023-05-08T10:11:16.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:16 smithi133 ceph-mon[125939]: pgmap v12437: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 586 KiB/s rd, 585 KiB/s wr, 10 op/s 2023-05-08T10:11:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23214.939482 secs 2023-05-08T10:11:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:16 smithi096 ceph-mon[124666]: pgmap v12437: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 586 KiB/s rd, 585 KiB/s wr, 10 op/s 2023-05-08T10:11:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23214.939482 secs 2023-05-08T10:11:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:16 smithi186 ceph-mon[126480]: pgmap v12437: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 586 KiB/s rd, 585 KiB/s wr, 10 op/s 2023-05-08T10:11:16.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23214.939482 secs 2023-05-08T10:11:18.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:18 smithi133 ceph-mon[125939]: pgmap v12438: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 222 KiB/s wr, 9 op/s 2023-05-08T10:11:18.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:18 smithi096 ceph-mon[124666]: pgmap v12438: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 222 KiB/s wr, 9 op/s 2023-05-08T10:11:18.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:18 smithi186 ceph-mon[126480]: pgmap v12438: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 222 KiB/s wr, 9 op/s 2023-05-08T10:11:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23218.096990 secs 2023-05-08T10:11:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23218.652009 secs 2023-05-08T10:11:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:19 smithi133 ceph-mon[125939]: osdmap e855: 12 total, 12 up, 12 in 2023-05-08T10:11:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23218.096990 secs 2023-05-08T10:11:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23218.652009 secs 2023-05-08T10:11:19.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:19 smithi096 ceph-mon[124666]: osdmap e855: 12 total, 12 up, 12 in 2023-05-08T10:11:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23218.096990 secs 2023-05-08T10:11:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23218.652009 secs 2023-05-08T10:11:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:19 smithi186 ceph-mon[126480]: osdmap e855: 12 total, 12 up, 12 in 2023-05-08T10:11:20.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:20 smithi133 ceph-mon[125939]: pgmap v12440: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 383 B/s wr, 4 op/s 2023-05-08T10:11:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:20 smithi096 ceph-mon[124666]: pgmap v12440: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 383 B/s wr, 4 op/s 2023-05-08T10:11:20.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:20 smithi186 ceph-mon[126480]: pgmap v12440: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 383 B/s wr, 4 op/s 2023-05-08T10:11:21.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23219.939621 secs 2023-05-08T10:11:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23219.939621 secs 2023-05-08T10:11:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23219.939621 secs 2023-05-08T10:11:22.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:22 smithi133 ceph-mon[125939]: pgmap v12441: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 78 KiB/s wr, 7 op/s 2023-05-08T10:11:22.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:22 smithi096 ceph-mon[124666]: pgmap v12441: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 78 KiB/s wr, 7 op/s 2023-05-08T10:11:22.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:22 smithi186 ceph-mon[126480]: pgmap v12441: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 78 KiB/s wr, 7 op/s 2023-05-08T10:11:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:24 smithi133 ceph-mon[125939]: pgmap v12442: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 77 KiB/s wr, 7 op/s 2023-05-08T10:11:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23223.097121 secs 2023-05-08T10:11:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23223.652135 secs 2023-05-08T10:11:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:24 smithi096 ceph-mon[124666]: pgmap v12442: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 77 KiB/s wr, 7 op/s 2023-05-08T10:11:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23223.097121 secs 2023-05-08T10:11:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23223.652135 secs 2023-05-08T10:11:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:24 smithi186 ceph-mon[126480]: pgmap v12442: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 77 KiB/s wr, 7 op/s 2023-05-08T10:11:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23223.097121 secs 2023-05-08T10:11:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23223.652135 secs 2023-05-08T10:11:26.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:26 smithi133 ceph-mon[125939]: pgmap v12443: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 170 KiB/s wr, 7 op/s 2023-05-08T10:11:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23224.939723 secs 2023-05-08T10:11:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:26 smithi096 ceph-mon[124666]: pgmap v12443: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 170 KiB/s wr, 7 op/s 2023-05-08T10:11:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23224.939723 secs 2023-05-08T10:11:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:26 smithi186 ceph-mon[126480]: pgmap v12443: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 170 KiB/s wr, 7 op/s 2023-05-08T10:11:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23224.939723 secs 2023-05-08T10:11:28.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:28 smithi133 ceph-mon[125939]: pgmap v12444: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 170 KiB/s wr, 7 op/s 2023-05-08T10:11:28.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:28 smithi096 ceph-mon[124666]: pgmap v12444: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 170 KiB/s wr, 7 op/s 2023-05-08T10:11:28.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:28 smithi186 ceph-mon[126480]: pgmap v12444: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 170 KiB/s wr, 7 op/s 2023-05-08T10:11:29.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23228.097228 secs 2023-05-08T10:11:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23228.652275 secs 2023-05-08T10:11:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23228.097228 secs 2023-05-08T10:11:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23228.652275 secs 2023-05-08T10:11:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23228.097228 secs 2023-05-08T10:11:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23228.652275 secs 2023-05-08T10:11:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:30 smithi133 ceph-mon[125939]: pgmap v12445: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 170 KiB/s wr, 7 op/s 2023-05-08T10:11:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:30 smithi096 ceph-mon[124666]: pgmap v12445: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 170 KiB/s wr, 7 op/s 2023-05-08T10:11:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:30 smithi186 ceph-mon[126480]: pgmap v12445: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 170 KiB/s wr, 7 op/s 2023-05-08T10:11:31.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23229.939873 secs 2023-05-08T10:11:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23229.939873 secs 2023-05-08T10:11:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23229.939873 secs 2023-05-08T10:11:32.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:32 smithi133 ceph-mon[125939]: pgmap v12446: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 142 KiB/s wr, 8 op/s 2023-05-08T10:11:32.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:32 smithi096 ceph-mon[124666]: pgmap v12446: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 142 KiB/s wr, 8 op/s 2023-05-08T10:11:32.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:32 smithi186 ceph-mon[126480]: pgmap v12446: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 142 KiB/s wr, 8 op/s 2023-05-08T10:11:34.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:34 smithi133 ceph-mon[125939]: pgmap v12447: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 78 KiB/s wr, 5 op/s 2023-05-08T10:11:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23233.097330 secs 2023-05-08T10:11:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23233.652392 secs 2023-05-08T10:11:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:34 smithi096 ceph-mon[124666]: pgmap v12447: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 78 KiB/s wr, 5 op/s 2023-05-08T10:11:34.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23233.097330 secs 2023-05-08T10:11:34.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23233.652392 secs 2023-05-08T10:11:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:34 smithi186 ceph-mon[126480]: pgmap v12447: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 78 KiB/s wr, 5 op/s 2023-05-08T10:11:34.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23233.097330 secs 2023-05-08T10:11:34.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23233.652392 secs 2023-05-08T10:11:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:36 smithi133 ceph-mon[125939]: pgmap v12448: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 78 KiB/s wr, 8 op/s 2023-05-08T10:11:36.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23234.939965 secs 2023-05-08T10:11:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:36 smithi096 ceph-mon[124666]: pgmap v12448: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 78 KiB/s wr, 8 op/s 2023-05-08T10:11:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23234.939965 secs 2023-05-08T10:11:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:36 smithi186 ceph-mon[126480]: pgmap v12448: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 78 KiB/s wr, 8 op/s 2023-05-08T10:11:36.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23234.939965 secs 2023-05-08T10:11:38.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:38 smithi133 ceph-mon[125939]: pgmap v12449: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T10:11:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:38 smithi096 ceph-mon[124666]: pgmap v12449: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T10:11:38.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:38 smithi186 ceph-mon[126480]: pgmap v12449: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T10:11:39.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23238.097446 secs 2023-05-08T10:11:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23238.652498 secs 2023-05-08T10:11:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23238.097446 secs 2023-05-08T10:11:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23238.652498 secs 2023-05-08T10:11:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23238.097446 secs 2023-05-08T10:11:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23238.652498 secs 2023-05-08T10:11:40.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:40 smithi133 ceph-mon[125939]: pgmap v12450: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T10:11:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:40 smithi096 ceph-mon[124666]: pgmap v12450: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T10:11:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:40 smithi186 ceph-mon[126480]: pgmap v12450: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T10:11:42.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:42 smithi133 ceph-mon[125939]: pgmap v12451: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 82 KiB/s wr, 9 op/s 2023-05-08T10:11:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:42 smithi096 ceph-mon[124666]: pgmap v12451: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 82 KiB/s wr, 9 op/s 2023-05-08T10:11:42.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:42 smithi186 ceph-mon[126480]: pgmap v12451: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 82 KiB/s wr, 9 op/s 2023-05-08T10:11:44.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:44 smithi133 ceph-mon[125939]: pgmap v12452: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 82 KiB/s wr, 6 op/s 2023-05-08T10:11:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23243.097572 secs 2023-05-08T10:11:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:44 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:11:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23243.652595 secs 2023-05-08T10:11:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:44 smithi096 ceph-mon[124666]: pgmap v12452: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 82 KiB/s wr, 6 op/s 2023-05-08T10:11:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23243.097572 secs 2023-05-08T10:11:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:44 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:11:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23243.652595 secs 2023-05-08T10:11:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:44 smithi186 ceph-mon[126480]: pgmap v12452: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 82 KiB/s wr, 6 op/s 2023-05-08T10:11:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23243.097572 secs 2023-05-08T10:11:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:44 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:11:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23243.652595 secs 2023-05-08T10:11:45.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:45 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:11:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:45 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:11:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:45 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:11:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:45 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:11:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:45 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:11:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:45 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:11:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:45 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:11:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:45 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:11:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:45 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:11:46.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:46 smithi133 ceph-mon[125939]: pgmap v12453: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 247 KiB/s wr, 9 op/s 2023-05-08T10:11:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:46 smithi096 ceph-mon[124666]: pgmap v12453: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 247 KiB/s wr, 9 op/s 2023-05-08T10:11:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:46 smithi186 ceph-mon[126480]: pgmap v12453: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 247 KiB/s wr, 9 op/s 2023-05-08T10:11:48.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:48 smithi133 ceph-mon[125939]: pgmap v12454: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 247 KiB/s wr, 6 op/s 2023-05-08T10:11:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:48 smithi096 ceph-mon[124666]: pgmap v12454: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 247 KiB/s wr, 6 op/s 2023-05-08T10:11:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:48 smithi186 ceph-mon[126480]: pgmap v12454: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 247 KiB/s wr, 6 op/s 2023-05-08T10:11:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23248.097697 secs 2023-05-08T10:11:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23248.097697 secs 2023-05-08T10:11:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23248.097697 secs 2023-05-08T10:11:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:50 smithi133 ceph-mon[125939]: pgmap v12455: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 247 KiB/s wr, 6 op/s 2023-05-08T10:11:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:50 smithi096 ceph-mon[124666]: pgmap v12455: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 247 KiB/s wr, 6 op/s 2023-05-08T10:11:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:50 smithi186 ceph-mon[126480]: pgmap v12455: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 247 KiB/s wr, 6 op/s 2023-05-08T10:11:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23249.940261 secs 2023-05-08T10:11:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23249.940261 secs 2023-05-08T10:11:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23249.940261 secs 2023-05-08T10:11:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:52 smithi133 ceph-mon[125939]: pgmap v12456: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 533 KiB/s rd, 530 KiB/s wr, 11 op/s 2023-05-08T10:11:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:11:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:52 smithi096 ceph-mon[124666]: pgmap v12456: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 533 KiB/s rd, 530 KiB/s wr, 11 op/s 2023-05-08T10:11:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:11:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:52 smithi186 ceph-mon[126480]: pgmap v12456: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 533 KiB/s rd, 530 KiB/s wr, 11 op/s 2023-05-08T10:11:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:11:53.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:11:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:11:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:11:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:11:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:11:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:11:53.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:11:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:11:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:11:54.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:54 smithi133 ceph-mon[125939]: pgmap v12457: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 449 KiB/s wr, 7 op/s 2023-05-08T10:11:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23253.097815 secs 2023-05-08T10:11:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23253.652851 secs 2023-05-08T10:11:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:54 smithi096 ceph-mon[124666]: pgmap v12457: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 449 KiB/s wr, 7 op/s 2023-05-08T10:11:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23253.097815 secs 2023-05-08T10:11:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23253.652851 secs 2023-05-08T10:11:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:54 smithi186 ceph-mon[126480]: pgmap v12457: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 449 KiB/s wr, 7 op/s 2023-05-08T10:11:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23253.097815 secs 2023-05-08T10:11:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23253.652851 secs 2023-05-08T10:11:56.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:56 smithi133 ceph-mon[125939]: pgmap v12458: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 647 KiB/s rd, 819 KiB/s wr, 13 op/s 2023-05-08T10:11:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23254.940371 secs 2023-05-08T10:11:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:56 smithi096 ceph-mon[124666]: pgmap v12458: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 647 KiB/s rd, 819 KiB/s wr, 13 op/s 2023-05-08T10:11:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23254.940371 secs 2023-05-08T10:11:56.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:56 smithi186 ceph-mon[126480]: pgmap v12458: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 647 KiB/s rd, 819 KiB/s wr, 13 op/s 2023-05-08T10:11:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23254.940371 secs 2023-05-08T10:11:57.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:57 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:11:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:11:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:11:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:11:57.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:57 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:11:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:11:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:11:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:11:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:57 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:11:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:11:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:11:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:11:58.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:58 smithi133 ceph-mon[125939]: pgmap v12459: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 654 KiB/s wr, 9 op/s 2023-05-08T10:11:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:11:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:11:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:11:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:58 smithi096 ceph-mon[124666]: pgmap v12459: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 654 KiB/s wr, 9 op/s 2023-05-08T10:11:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:11:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:11:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:11:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:58 smithi186 ceph-mon[126480]: pgmap v12459: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 654 KiB/s wr, 9 op/s 2023-05-08T10:11:58.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:11:58.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:11:58.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:11:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:59 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:11:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:59 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T10:11:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:59 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T10:11:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:59 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:11:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:11:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23258.097949 secs 2023-05-08T10:11:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:59 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:11:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:59 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T10:11:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:59 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T10:11:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:59 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:11:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:11:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23258.097949 secs 2023-05-08T10:11:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:59 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:11:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:59 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T10:11:59.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:59 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T10:11:59.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:59 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:11:59.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:11:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23258.097949 secs 2023-05-08T10:12:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:00 smithi096 ceph-mon[124666]: pgmap v12460: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 654 KiB/s wr, 9 op/s 2023-05-08T10:12:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:00 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:12:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:00 smithi186 ceph-mon[126480]: pgmap v12460: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 654 KiB/s wr, 9 op/s 2023-05-08T10:12:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:00 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:12:00.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:00 smithi133 ceph-mon[125939]: pgmap v12460: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 654 KiB/s wr, 9 op/s 2023-05-08T10:12:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:00 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:12:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23259.940505 secs 2023-05-08T10:12:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:12:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:12:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23259.940505 secs 2023-05-08T10:12:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:12:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:12:01.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23259.940505 secs 2023-05-08T10:12:01.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:12:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:12:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:02 smithi096 ceph-mon[124666]: pgmap v12461: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 749 KiB/s rd, 736 KiB/s wr, 15 op/s 2023-05-08T10:12:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:02 smithi186 ceph-mon[126480]: pgmap v12461: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 749 KiB/s rd, 736 KiB/s wr, 15 op/s 2023-05-08T10:12:02.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:02 smithi133 ceph-mon[125939]: pgmap v12461: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 749 KiB/s rd, 736 KiB/s wr, 15 op/s 2023-05-08T10:12:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:04 smithi186 ceph-mon[126480]: pgmap v12462: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 465 KiB/s rd, 453 KiB/s wr, 11 op/s 2023-05-08T10:12:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23263.098074 secs 2023-05-08T10:12:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23263.653045 secs 2023-05-08T10:12:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:04 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:12:04.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:04 smithi133 ceph-mon[125939]: pgmap v12462: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 465 KiB/s rd, 453 KiB/s wr, 11 op/s 2023-05-08T10:12:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23263.098074 secs 2023-05-08T10:12:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23263.653045 secs 2023-05-08T10:12:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:04 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:12:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:04 smithi096 ceph-mon[124666]: pgmap v12462: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 465 KiB/s rd, 453 KiB/s wr, 11 op/s 2023-05-08T10:12:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23263.098074 secs 2023-05-08T10:12:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23263.653045 secs 2023-05-08T10:12:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:04 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:12:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:06 smithi186 ceph-mon[126480]: pgmap v12463: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 621 KiB/s rd, 828 KiB/s wr, 30 op/s 2023-05-08T10:12:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23264.940629 secs 2023-05-08T10:12:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:06 smithi186 ceph-mon[126480]: osdmap e856: 12 total, 12 up, 12 in 2023-05-08T10:12:06.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:06 smithi133 ceph-mon[125939]: pgmap v12463: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 621 KiB/s rd, 828 KiB/s wr, 30 op/s 2023-05-08T10:12:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23264.940629 secs 2023-05-08T10:12:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:06 smithi133 ceph-mon[125939]: osdmap e856: 12 total, 12 up, 12 in 2023-05-08T10:12:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:06 smithi096 ceph-mon[124666]: pgmap v12463: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 621 KiB/s rd, 828 KiB/s wr, 30 op/s 2023-05-08T10:12:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23264.940629 secs 2023-05-08T10:12:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:06 smithi096 ceph-mon[124666]: osdmap e856: 12 total, 12 up, 12 in 2023-05-08T10:12:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:08 smithi186 ceph-mon[126480]: pgmap v12465: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 509 KiB/s rd, 549 KiB/s wr, 29 op/s 2023-05-08T10:12:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:08 smithi133 ceph-mon[125939]: pgmap v12465: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 509 KiB/s rd, 549 KiB/s wr, 29 op/s 2023-05-08T10:12:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:08 smithi096 ceph-mon[124666]: pgmap v12465: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 509 KiB/s rd, 549 KiB/s wr, 29 op/s 2023-05-08T10:12:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:12:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:12:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23268.098228 secs 2023-05-08T10:12:09.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23268.653166 secs 2023-05-08T10:12:09.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:09 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:12:09.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:12:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:12:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23268.098228 secs 2023-05-08T10:12:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23268.653166 secs 2023-05-08T10:12:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:09 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:12:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:12:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:12:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23268.098228 secs 2023-05-08T10:12:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23268.653166 secs 2023-05-08T10:12:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:09 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:12:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:10 smithi186 ceph-mon[126480]: pgmap v12466: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 509 KiB/s rd, 549 KiB/s wr, 29 op/s 2023-05-08T10:12:10.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:10 smithi133 ceph-mon[125939]: pgmap v12466: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 509 KiB/s rd, 549 KiB/s wr, 29 op/s 2023-05-08T10:12:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:10 smithi096 ceph-mon[124666]: pgmap v12466: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 509 KiB/s rd, 549 KiB/s wr, 29 op/s 2023-05-08T10:12:11.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23269.940769 secs 2023-05-08T10:12:11.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23269.940769 secs 2023-05-08T10:12:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23269.940769 secs 2023-05-08T10:12:12.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:12 smithi186 ceph-mon[126480]: pgmap v12467: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 497 KiB/s wr, 27 op/s 2023-05-08T10:12:12.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:12 smithi133 ceph-mon[125939]: pgmap v12467: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 497 KiB/s wr, 27 op/s 2023-05-08T10:12:12.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:12 smithi096 ceph-mon[124666]: pgmap v12467: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 497 KiB/s wr, 27 op/s 2023-05-08T10:12:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:14 smithi186 ceph-mon[126480]: pgmap v12468: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 497 KiB/s wr, 27 op/s 2023-05-08T10:12:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23273.098360 secs 2023-05-08T10:12:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23273.653298 secs 2023-05-08T10:12:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:14 smithi186 ceph-mon[126480]: osdmap e857: 12 total, 12 up, 12 in 2023-05-08T10:12:14.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:14 smithi133 ceph-mon[125939]: pgmap v12468: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 497 KiB/s wr, 27 op/s 2023-05-08T10:12:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23273.098360 secs 2023-05-08T10:12:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23273.653298 secs 2023-05-08T10:12:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:14 smithi133 ceph-mon[125939]: osdmap e857: 12 total, 12 up, 12 in 2023-05-08T10:12:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:14 smithi096 ceph-mon[124666]: pgmap v12468: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 497 KiB/s wr, 27 op/s 2023-05-08T10:12:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23273.098360 secs 2023-05-08T10:12:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23273.653298 secs 2023-05-08T10:12:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:14 smithi096 ceph-mon[124666]: osdmap e857: 12 total, 12 up, 12 in 2023-05-08T10:12:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:16 smithi186 ceph-mon[126480]: pgmap v12470: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 389 KiB/s rd, 159 KiB/s wr, 8 op/s 2023-05-08T10:12:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23274.940852 secs 2023-05-08T10:12:16.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:16 smithi133 ceph-mon[125939]: pgmap v12470: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 389 KiB/s rd, 159 KiB/s wr, 8 op/s 2023-05-08T10:12:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23274.940852 secs 2023-05-08T10:12:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:16 smithi096 ceph-mon[124666]: pgmap v12470: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 389 KiB/s rd, 159 KiB/s wr, 8 op/s 2023-05-08T10:12:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23274.940852 secs 2023-05-08T10:12:18.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:18 smithi186 ceph-mon[126480]: pgmap v12471: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 155 KiB/s wr, 7 op/s 2023-05-08T10:12:18.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:18 smithi133 ceph-mon[125939]: pgmap v12471: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 155 KiB/s wr, 7 op/s 2023-05-08T10:12:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:18 smithi096 ceph-mon[124666]: pgmap v12471: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 155 KiB/s wr, 7 op/s 2023-05-08T10:12:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23278.098510 secs 2023-05-08T10:12:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23278.653390 secs 2023-05-08T10:12:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23278.098510 secs 2023-05-08T10:12:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23278.653390 secs 2023-05-08T10:12:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23278.098510 secs 2023-05-08T10:12:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23278.653390 secs 2023-05-08T10:12:20.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:20 smithi186 ceph-mon[126480]: pgmap v12472: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 155 KiB/s wr, 7 op/s 2023-05-08T10:12:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:20 smithi133 ceph-mon[125939]: pgmap v12472: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 155 KiB/s wr, 7 op/s 2023-05-08T10:12:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:20 smithi096 ceph-mon[124666]: pgmap v12472: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 155 KiB/s wr, 7 op/s 2023-05-08T10:12:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23279.940940 secs 2023-05-08T10:12:21.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23279.940940 secs 2023-05-08T10:12:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23279.940940 secs 2023-05-08T10:12:22.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:22 smithi186 ceph-mon[126480]: pgmap v12473: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 107 KiB/s wr, 6 op/s 2023-05-08T10:12:22.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:22 smithi133 ceph-mon[125939]: pgmap v12473: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 107 KiB/s wr, 6 op/s 2023-05-08T10:12:22.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:22 smithi096 ceph-mon[124666]: pgmap v12473: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 107 KiB/s wr, 6 op/s 2023-05-08T10:12:24.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:24 smithi186 ceph-mon[126480]: pgmap v12474: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 107 KiB/s wr, 6 op/s 2023-05-08T10:12:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23283.098611 secs 2023-05-08T10:12:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23283.653512 secs 2023-05-08T10:12:24.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:24 smithi133 ceph-mon[125939]: pgmap v12474: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 107 KiB/s wr, 6 op/s 2023-05-08T10:12:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23283.098611 secs 2023-05-08T10:12:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23283.653512 secs 2023-05-08T10:12:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:24 smithi096 ceph-mon[124666]: pgmap v12474: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 107 KiB/s wr, 6 op/s 2023-05-08T10:12:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23283.098611 secs 2023-05-08T10:12:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23283.653512 secs 2023-05-08T10:12:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:26 smithi186 ceph-mon[126480]: pgmap v12475: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 97 KiB/s wr, 8 op/s 2023-05-08T10:12:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23284.941029 secs 2023-05-08T10:12:26.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:26 smithi133 ceph-mon[125939]: pgmap v12475: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 97 KiB/s wr, 8 op/s 2023-05-08T10:12:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23284.941029 secs 2023-05-08T10:12:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:26 smithi096 ceph-mon[124666]: pgmap v12475: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 97 KiB/s wr, 8 op/s 2023-05-08T10:12:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23284.941029 secs 2023-05-08T10:12:28.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:28 smithi186 ceph-mon[126480]: pgmap v12476: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T10:12:28.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:28 smithi133 ceph-mon[125939]: pgmap v12476: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T10:12:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:28 smithi096 ceph-mon[124666]: pgmap v12476: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T10:12:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23288.098696 secs 2023-05-08T10:12:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23288.653638 secs 2023-05-08T10:12:29.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23288.098696 secs 2023-05-08T10:12:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23288.653638 secs 2023-05-08T10:12:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23288.098696 secs 2023-05-08T10:12:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23288.653638 secs 2023-05-08T10:12:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:30 smithi186 ceph-mon[126480]: pgmap v12477: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T10:12:30.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:30 smithi133 ceph-mon[125939]: pgmap v12477: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T10:12:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:30 smithi096 ceph-mon[124666]: pgmap v12477: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T10:12:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23289.941118 secs 2023-05-08T10:12:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23289.941118 secs 2023-05-08T10:12:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23289.941118 secs 2023-05-08T10:12:32.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:32 smithi186 ceph-mon[126480]: pgmap v12478: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 56 KiB/s wr, 8 op/s 2023-05-08T10:12:32.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:32 smithi133 ceph-mon[125939]: pgmap v12478: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 56 KiB/s wr, 8 op/s 2023-05-08T10:12:32.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:32 smithi096 ceph-mon[124666]: pgmap v12478: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 56 KiB/s wr, 8 op/s 2023-05-08T10:12:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:34 smithi186 ceph-mon[126480]: pgmap v12479: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 56 KiB/s wr, 5 op/s 2023-05-08T10:12:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23293.098814 secs 2023-05-08T10:12:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23293.653775 secs 2023-05-08T10:12:34.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:34 smithi133 ceph-mon[125939]: pgmap v12479: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 56 KiB/s wr, 5 op/s 2023-05-08T10:12:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23293.098814 secs 2023-05-08T10:12:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23293.653775 secs 2023-05-08T10:12:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:34 smithi096 ceph-mon[124666]: pgmap v12479: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 56 KiB/s wr, 5 op/s 2023-05-08T10:12:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23293.098814 secs 2023-05-08T10:12:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23293.653775 secs 2023-05-08T10:12:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:36 smithi186 ceph-mon[126480]: pgmap v12480: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 353 KiB/s rd, 259 KiB/s wr, 10 op/s 2023-05-08T10:12:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23294.941243 secs 2023-05-08T10:12:36.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:36 smithi133 ceph-mon[125939]: pgmap v12480: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 353 KiB/s rd, 259 KiB/s wr, 10 op/s 2023-05-08T10:12:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23294.941243 secs 2023-05-08T10:12:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:36 smithi096 ceph-mon[124666]: pgmap v12480: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 353 KiB/s rd, 259 KiB/s wr, 10 op/s 2023-05-08T10:12:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23294.941243 secs 2023-05-08T10:12:38.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:38 smithi186 ceph-mon[126480]: pgmap v12481: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 352 KiB/s rd, 259 KiB/s wr, 7 op/s 2023-05-08T10:12:38.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:38 smithi133 ceph-mon[125939]: pgmap v12481: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 352 KiB/s rd, 259 KiB/s wr, 7 op/s 2023-05-08T10:12:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:38 smithi096 ceph-mon[124666]: pgmap v12481: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 352 KiB/s rd, 259 KiB/s wr, 7 op/s 2023-05-08T10:12:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23298.098960 secs 2023-05-08T10:12:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23298.653916 secs 2023-05-08T10:12:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23298.098960 secs 2023-05-08T10:12:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23298.653916 secs 2023-05-08T10:12:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23298.098960 secs 2023-05-08T10:12:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23298.653916 secs 2023-05-08T10:12:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:40 smithi186 ceph-mon[126480]: pgmap v12482: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 352 KiB/s rd, 259 KiB/s wr, 7 op/s 2023-05-08T10:12:40.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:40 smithi133 ceph-mon[125939]: pgmap v12482: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 352 KiB/s rd, 259 KiB/s wr, 7 op/s 2023-05-08T10:12:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:40 smithi096 ceph-mon[124666]: pgmap v12482: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 352 KiB/s rd, 259 KiB/s wr, 7 op/s 2023-05-08T10:12:42.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:42 smithi186 ceph-mon[126480]: pgmap v12483: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 259 KiB/s wr, 10 op/s 2023-05-08T10:12:42.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:42 smithi133 ceph-mon[125939]: pgmap v12483: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 259 KiB/s wr, 10 op/s 2023-05-08T10:12:42.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:42 smithi096 ceph-mon[124666]: pgmap v12483: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 259 KiB/s wr, 10 op/s 2023-05-08T10:12:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:44 smithi186 ceph-mon[126480]: pgmap v12484: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 203 KiB/s wr, 7 op/s 2023-05-08T10:12:44.668 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23303.099100 secs 2023-05-08T10:12:44.668 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:44 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:12:44.669 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23303.654059 secs 2023-05-08T10:12:44.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:44 smithi133 ceph-mon[125939]: pgmap v12484: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 203 KiB/s wr, 7 op/s 2023-05-08T10:12:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23303.099100 secs 2023-05-08T10:12:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:44 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:12:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23303.654059 secs 2023-05-08T10:12:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:44 smithi096 ceph-mon[124666]: pgmap v12484: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 203 KiB/s wr, 7 op/s 2023-05-08T10:12:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23303.099100 secs 2023-05-08T10:12:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:44 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:12:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23303.654059 secs 2023-05-08T10:12:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:45 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:12:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:45 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:12:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:45 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:12:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23304.941449 secs 2023-05-08T10:12:45.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:45 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:12:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:45 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:12:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:45 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:12:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23304.941449 secs 2023-05-08T10:12:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:45 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:12:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:45 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:12:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:45 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:12:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23304.941449 secs 2023-05-08T10:12:46.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:46 smithi186 ceph-mon[126480]: pgmap v12485: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 422 KiB/s rd, 309 KiB/s wr, 10 op/s 2023-05-08T10:12:46.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:46 smithi133 ceph-mon[125939]: pgmap v12485: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 422 KiB/s rd, 309 KiB/s wr, 10 op/s 2023-05-08T10:12:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:46 smithi096 ceph-mon[124666]: pgmap v12485: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 422 KiB/s rd, 309 KiB/s wr, 10 op/s 2023-05-08T10:12:48.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:48 smithi133 ceph-mon[125939]: pgmap v12486: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 106 KiB/s wr, 6 op/s 2023-05-08T10:12:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:48 smithi096 ceph-mon[124666]: pgmap v12486: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 106 KiB/s wr, 6 op/s 2023-05-08T10:12:48.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:48 smithi186 ceph-mon[126480]: pgmap v12486: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 106 KiB/s wr, 6 op/s 2023-05-08T10:12:49.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23308.099231 secs 2023-05-08T10:12:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:12:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:12:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23308.099231 secs 2023-05-08T10:12:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:12:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:12:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23308.099231 secs 2023-05-08T10:12:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:12:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:12:50.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:50 smithi133 ceph-mon[125939]: pgmap v12487: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 106 KiB/s wr, 6 op/s 2023-05-08T10:12:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23309.941576 secs 2023-05-08T10:12:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:50 smithi096 ceph-mon[124666]: pgmap v12487: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 106 KiB/s wr, 6 op/s 2023-05-08T10:12:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23309.941576 secs 2023-05-08T10:12:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:50 smithi186 ceph-mon[126480]: pgmap v12487: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 106 KiB/s wr, 6 op/s 2023-05-08T10:12:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23309.941576 secs 2023-05-08T10:12:52.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:52 smithi133 ceph-mon[125939]: pgmap v12488: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 314 KiB/s wr, 10 op/s 2023-05-08T10:12:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:12:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:52 smithi096 ceph-mon[124666]: pgmap v12488: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 314 KiB/s wr, 10 op/s 2023-05-08T10:12:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:12:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:52 smithi186 ceph-mon[126480]: pgmap v12488: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 314 KiB/s wr, 10 op/s 2023-05-08T10:12:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:12:53.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:53 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:12:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:12:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:12:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:53 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:12:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:12:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:12:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:53 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:12:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:12:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:12:54.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:54 smithi133 ceph-mon[125939]: pgmap v12489: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 314 KiB/s wr, 7 op/s 2023-05-08T10:12:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23313.099289 secs 2023-05-08T10:12:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23313.654281 secs 2023-05-08T10:12:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:54 smithi096 ceph-mon[124666]: pgmap v12489: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 314 KiB/s wr, 7 op/s 2023-05-08T10:12:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23313.099289 secs 2023-05-08T10:12:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23313.654281 secs 2023-05-08T10:12:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:54 smithi186 ceph-mon[126480]: pgmap v12489: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 314 KiB/s wr, 7 op/s 2023-05-08T10:12:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23313.099289 secs 2023-05-08T10:12:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23313.654281 secs 2023-05-08T10:12:55.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23314.941695 secs 2023-05-08T10:12:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23314.941695 secs 2023-05-08T10:12:55.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23314.941695 secs 2023-05-08T10:12:56.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:56 smithi133 ceph-mon[125939]: pgmap v12490: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 635 KiB/s rd, 622 KiB/s wr, 13 op/s 2023-05-08T10:12:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:56 smithi096 ceph-mon[124666]: pgmap v12490: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 635 KiB/s rd, 622 KiB/s wr, 13 op/s 2023-05-08T10:12:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:56 smithi186 ceph-mon[126480]: pgmap v12490: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 635 KiB/s rd, 622 KiB/s wr, 13 op/s 2023-05-08T10:12:57.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:12:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:12:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:57 smithi133 ceph-mon[125939]: pgmap v12491: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 528 KiB/s rd, 516 KiB/s wr, 10 op/s 2023-05-08T10:12:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:12:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:12:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:57 smithi096 ceph-mon[124666]: pgmap v12491: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 528 KiB/s rd, 516 KiB/s wr, 10 op/s 2023-05-08T10:12:57.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:12:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:12:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:57 smithi186 ceph-mon[126480]: pgmap v12491: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 528 KiB/s rd, 516 KiB/s wr, 10 op/s 2023-05-08T10:12:58.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:12:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:12:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:12:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:58 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:12:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:12:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:58 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T10:12:58.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:58 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T10:12:58.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:58 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:12:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:12:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:12:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:12:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:58 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:12:58.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:12:58.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:58 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T10:12:58.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:58 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T10:12:58.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:58 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:12:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:12:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:12:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:12:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:58 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:12:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:12:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:58 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T10:12:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:58 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T10:12:58.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:58 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:12:59.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23318.099422 secs 2023-05-08T10:12:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:59 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:12:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:12:59 smithi133 ceph-mon[125939]: pgmap v12492: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 528 KiB/s rd, 516 KiB/s wr, 10 op/s 2023-05-08T10:12:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23318.099422 secs 2023-05-08T10:12:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:59 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:12:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:12:59 smithi096 ceph-mon[124666]: pgmap v12492: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 528 KiB/s rd, 516 KiB/s wr, 10 op/s 2023-05-08T10:12:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23318.099422 secs 2023-05-08T10:12:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:59 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:12:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:12:59 smithi186 ceph-mon[126480]: pgmap v12492: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 528 KiB/s rd, 516 KiB/s wr, 10 op/s 2023-05-08T10:13:00.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:00 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:13:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23319.941849 secs 2023-05-08T10:13:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:00 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:13:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23319.941849 secs 2023-05-08T10:13:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:00 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:13:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23319.941849 secs 2023-05-08T10:13:01.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:13:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:13:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:01 smithi133 ceph-mon[125939]: pgmap v12493: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 625 KiB/s rd, 626 KiB/s wr, 16 op/s 2023-05-08T10:13:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:13:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:13:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:01 smithi096 ceph-mon[124666]: pgmap v12493: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 625 KiB/s rd, 626 KiB/s wr, 16 op/s 2023-05-08T10:13:01.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:13:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:13:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:01 smithi186 ceph-mon[126480]: pgmap v12493: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 625 KiB/s rd, 626 KiB/s wr, 16 op/s 2023-05-08T10:13:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:04 smithi186 ceph-mon[126480]: pgmap v12494: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 417 KiB/s wr, 11 op/s 2023-05-08T10:13:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23323.099563 secs 2023-05-08T10:13:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23323.654542 secs 2023-05-08T10:13:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:04 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:13:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:04 smithi133 ceph-mon[125939]: pgmap v12494: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 417 KiB/s wr, 11 op/s 2023-05-08T10:13:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23323.099563 secs 2023-05-08T10:13:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23323.654542 secs 2023-05-08T10:13:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:04 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:13:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:04 smithi096 ceph-mon[124666]: pgmap v12494: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 417 KiB/s wr, 11 op/s 2023-05-08T10:13:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23323.099563 secs 2023-05-08T10:13:04.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23323.654542 secs 2023-05-08T10:13:04.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:04 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:13:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:06 smithi186 ceph-mon[126480]: pgmap v12495: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 720 KiB/s rd, 743 KiB/s wr, 31 op/s 2023-05-08T10:13:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23324.941981 secs 2023-05-08T10:13:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:06 smithi133 ceph-mon[125939]: pgmap v12495: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 720 KiB/s rd, 743 KiB/s wr, 31 op/s 2023-05-08T10:13:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23324.941981 secs 2023-05-08T10:13:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:06 smithi096 ceph-mon[124666]: pgmap v12495: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 720 KiB/s rd, 743 KiB/s wr, 31 op/s 2023-05-08T10:13:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23324.941981 secs 2023-05-08T10:13:07.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:07 smithi186 ceph-mon[126480]: osdmap e858: 12 total, 12 up, 12 in 2023-05-08T10:13:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:07 smithi133 ceph-mon[125939]: osdmap e858: 12 total, 12 up, 12 in 2023-05-08T10:13:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:07 smithi096 ceph-mon[124666]: osdmap e858: 12 total, 12 up, 12 in 2023-05-08T10:13:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:08 smithi186 ceph-mon[126480]: pgmap v12497: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 481 KiB/s rd, 523 KiB/s wr, 30 op/s 2023-05-08T10:13:08.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:08 smithi133 ceph-mon[125939]: pgmap v12497: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 481 KiB/s rd, 523 KiB/s wr, 30 op/s 2023-05-08T10:13:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:08 smithi096 ceph-mon[124666]: pgmap v12497: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 481 KiB/s rd, 523 KiB/s wr, 30 op/s 2023-05-08T10:13:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:13:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:13:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23328.099645 secs 2023-05-08T10:13:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23328.654661 secs 2023-05-08T10:13:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:09 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:13:09.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:13:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:13:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23328.099645 secs 2023-05-08T10:13:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23328.654661 secs 2023-05-08T10:13:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:09 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:13:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:13:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:13:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23328.099645 secs 2023-05-08T10:13:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23328.654661 secs 2023-05-08T10:13:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:09 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:13:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:10 smithi186 ceph-mon[126480]: pgmap v12498: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 481 KiB/s rd, 523 KiB/s wr, 30 op/s 2023-05-08T10:13:10.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:10 smithi133 ceph-mon[125939]: pgmap v12498: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 481 KiB/s rd, 523 KiB/s wr, 30 op/s 2023-05-08T10:13:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:10 smithi096 ceph-mon[124666]: pgmap v12498: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 481 KiB/s rd, 523 KiB/s wr, 30 op/s 2023-05-08T10:13:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23329.942114 secs 2023-05-08T10:13:11.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23329.942114 secs 2023-05-08T10:13:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23329.942114 secs 2023-05-08T10:13:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:12 smithi186 ceph-mon[126480]: pgmap v12499: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 484 KiB/s wr, 27 op/s 2023-05-08T10:13:12.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:12 smithi133 ceph-mon[125939]: pgmap v12499: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 484 KiB/s wr, 27 op/s 2023-05-08T10:13:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:12 smithi096 ceph-mon[124666]: pgmap v12499: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 484 KiB/s wr, 27 op/s 2023-05-08T10:13:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:14 smithi186 ceph-mon[126480]: pgmap v12500: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 484 KiB/s wr, 27 op/s 2023-05-08T10:13:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23333.099772 secs 2023-05-08T10:13:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23333.654770 secs 2023-05-08T10:13:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:14 smithi186 ceph-mon[126480]: osdmap e859: 12 total, 12 up, 12 in 2023-05-08T10:13:14.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:14 smithi133 ceph-mon[125939]: pgmap v12500: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 484 KiB/s wr, 27 op/s 2023-05-08T10:13:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23333.099772 secs 2023-05-08T10:13:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23333.654770 secs 2023-05-08T10:13:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:14 smithi133 ceph-mon[125939]: osdmap e859: 12 total, 12 up, 12 in 2023-05-08T10:13:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:14 smithi096 ceph-mon[124666]: pgmap v12500: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 484 KiB/s wr, 27 op/s 2023-05-08T10:13:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23333.099772 secs 2023-05-08T10:13:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23333.654770 secs 2023-05-08T10:13:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:14 smithi096 ceph-mon[124666]: osdmap e859: 12 total, 12 up, 12 in 2023-05-08T10:13:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:16 smithi186 ceph-mon[126480]: pgmap v12502: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 189 KiB/s wr, 9 op/s 2023-05-08T10:13:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23334.942215 secs 2023-05-08T10:13:16.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:16 smithi133 ceph-mon[125939]: pgmap v12502: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 189 KiB/s wr, 9 op/s 2023-05-08T10:13:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23334.942215 secs 2023-05-08T10:13:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:16 smithi096 ceph-mon[124666]: pgmap v12502: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 189 KiB/s wr, 9 op/s 2023-05-08T10:13:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23334.942215 secs 2023-05-08T10:13:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:18 smithi186 ceph-mon[126480]: pgmap v12503: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 169 KiB/s wr, 8 op/s 2023-05-08T10:13:18.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:18 smithi133 ceph-mon[125939]: pgmap v12503: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 169 KiB/s wr, 8 op/s 2023-05-08T10:13:18.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:18 smithi096 ceph-mon[124666]: pgmap v12503: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 169 KiB/s wr, 8 op/s 2023-05-08T10:13:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23338.099896 secs 2023-05-08T10:13:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23338.654869 secs 2023-05-08T10:13:19.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23338.099896 secs 2023-05-08T10:13:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23338.654869 secs 2023-05-08T10:13:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23338.099896 secs 2023-05-08T10:13:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23338.654869 secs 2023-05-08T10:13:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:20 smithi186 ceph-mon[126480]: pgmap v12504: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 169 KiB/s wr, 8 op/s 2023-05-08T10:13:20.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:20 smithi133 ceph-mon[125939]: pgmap v12504: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 169 KiB/s wr, 8 op/s 2023-05-08T10:13:20.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:20 smithi096 ceph-mon[124666]: pgmap v12504: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 169 KiB/s wr, 8 op/s 2023-05-08T10:13:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23339.942363 secs 2023-05-08T10:13:21.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23339.942363 secs 2023-05-08T10:13:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23339.942363 secs 2023-05-08T10:13:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:22 smithi186 ceph-mon[126480]: pgmap v12505: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 138 KiB/s wr, 6 op/s 2023-05-08T10:13:22.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:22 smithi133 ceph-mon[125939]: pgmap v12505: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 138 KiB/s wr, 6 op/s 2023-05-08T10:13:22.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:22 smithi096 ceph-mon[124666]: pgmap v12505: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 138 KiB/s wr, 6 op/s 2023-05-08T10:13:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:24 smithi186 ceph-mon[126480]: pgmap v12506: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 138 KiB/s wr, 6 op/s 2023-05-08T10:13:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23343.100025 secs 2023-05-08T10:13:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23343.655010 secs 2023-05-08T10:13:24.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:24 smithi133 ceph-mon[125939]: pgmap v12506: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 138 KiB/s wr, 6 op/s 2023-05-08T10:13:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23343.100025 secs 2023-05-08T10:13:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23343.655010 secs 2023-05-08T10:13:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:24 smithi096 ceph-mon[124666]: pgmap v12506: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 138 KiB/s wr, 6 op/s 2023-05-08T10:13:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23343.100025 secs 2023-05-08T10:13:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23343.655010 secs 2023-05-08T10:13:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:26 smithi186 ceph-mon[126480]: pgmap v12507: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 156 KiB/s wr, 8 op/s 2023-05-08T10:13:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23344.942506 secs 2023-05-08T10:13:26.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:26 smithi133 ceph-mon[125939]: pgmap v12507: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 156 KiB/s wr, 8 op/s 2023-05-08T10:13:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23344.942506 secs 2023-05-08T10:13:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:26 smithi096 ceph-mon[124666]: pgmap v12507: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 156 KiB/s wr, 8 op/s 2023-05-08T10:13:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23344.942506 secs 2023-05-08T10:13:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:28 smithi186 ceph-mon[126480]: pgmap v12508: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 79 KiB/s wr, 5 op/s 2023-05-08T10:13:28.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:28 smithi133 ceph-mon[125939]: pgmap v12508: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 79 KiB/s wr, 5 op/s 2023-05-08T10:13:28.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:28 smithi096 ceph-mon[124666]: pgmap v12508: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 79 KiB/s wr, 5 op/s 2023-05-08T10:13:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23348.100135 secs 2023-05-08T10:13:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23348.655162 secs 2023-05-08T10:13:29.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23348.100135 secs 2023-05-08T10:13:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23348.655162 secs 2023-05-08T10:13:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23348.100135 secs 2023-05-08T10:13:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23348.655162 secs 2023-05-08T10:13:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:30 smithi186 ceph-mon[126480]: pgmap v12509: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 79 KiB/s wr, 5 op/s 2023-05-08T10:13:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:30 smithi133 ceph-mon[125939]: pgmap v12509: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 79 KiB/s wr, 5 op/s 2023-05-08T10:13:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:30 smithi096 ceph-mon[124666]: pgmap v12509: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 79 KiB/s wr, 5 op/s 2023-05-08T10:13:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23349.942635 secs 2023-05-08T10:13:31.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23349.942635 secs 2023-05-08T10:13:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23349.942635 secs 2023-05-08T10:13:32.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:32 smithi133 ceph-mon[125939]: pgmap v12510: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 79 KiB/s wr, 8 op/s 2023-05-08T10:13:32.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:32 smithi096 ceph-mon[124666]: pgmap v12510: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 79 KiB/s wr, 8 op/s 2023-05-08T10:13:32.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:32 smithi186 ceph-mon[126480]: pgmap v12510: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 79 KiB/s wr, 8 op/s 2023-05-08T10:13:34.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:34 smithi133 ceph-mon[125939]: pgmap v12511: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 5 op/s 2023-05-08T10:13:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23353.100263 secs 2023-05-08T10:13:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23353.655304 secs 2023-05-08T10:13:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:34 smithi096 ceph-mon[124666]: pgmap v12511: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 5 op/s 2023-05-08T10:13:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23353.100263 secs 2023-05-08T10:13:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23353.655304 secs 2023-05-08T10:13:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:34 smithi186 ceph-mon[126480]: pgmap v12511: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 5 op/s 2023-05-08T10:13:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23353.100263 secs 2023-05-08T10:13:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23353.655304 secs 2023-05-08T10:13:36.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:36 smithi133 ceph-mon[125939]: pgmap v12512: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 111 KiB/s wr, 9 op/s 2023-05-08T10:13:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23354.942759 secs 2023-05-08T10:13:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:36 smithi096 ceph-mon[124666]: pgmap v12512: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 111 KiB/s wr, 9 op/s 2023-05-08T10:13:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23354.942759 secs 2023-05-08T10:13:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:36 smithi186 ceph-mon[126480]: pgmap v12512: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 111 KiB/s wr, 9 op/s 2023-05-08T10:13:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23354.942759 secs 2023-05-08T10:13:38.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:38 smithi133 ceph-mon[125939]: pgmap v12513: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 83 KiB/s wr, 6 op/s 2023-05-08T10:13:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:38 smithi096 ceph-mon[124666]: pgmap v12513: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 83 KiB/s wr, 6 op/s 2023-05-08T10:13:38.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:38 smithi186 ceph-mon[126480]: pgmap v12513: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 83 KiB/s wr, 6 op/s 2023-05-08T10:13:39.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23358.100406 secs 2023-05-08T10:13:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23358.655427 secs 2023-05-08T10:13:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23358.100406 secs 2023-05-08T10:13:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23358.655427 secs 2023-05-08T10:13:39.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23358.100406 secs 2023-05-08T10:13:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23358.655427 secs 2023-05-08T10:13:40.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:40 smithi133 ceph-mon[125939]: pgmap v12514: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 83 KiB/s wr, 6 op/s 2023-05-08T10:13:40.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:40 smithi096 ceph-mon[124666]: pgmap v12514: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 83 KiB/s wr, 6 op/s 2023-05-08T10:13:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:40 smithi186 ceph-mon[126480]: pgmap v12514: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 83 KiB/s wr, 6 op/s 2023-05-08T10:13:42.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:42 smithi133 ceph-mon[125939]: pgmap v12515: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 83 KiB/s wr, 9 op/s 2023-05-08T10:13:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:42 smithi096 ceph-mon[124666]: pgmap v12515: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 83 KiB/s wr, 9 op/s 2023-05-08T10:13:42.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:42 smithi186 ceph-mon[126480]: pgmap v12515: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 83 KiB/s wr, 9 op/s 2023-05-08T10:13:44.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:44 smithi133 ceph-mon[125939]: pgmap v12516: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 82 KiB/s wr, 6 op/s 2023-05-08T10:13:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23363.100487 secs 2023-05-08T10:13:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:44 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:13:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23363.655564 secs 2023-05-08T10:13:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:44 smithi096 ceph-mon[124666]: pgmap v12516: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 82 KiB/s wr, 6 op/s 2023-05-08T10:13:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23363.100487 secs 2023-05-08T10:13:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:44 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:13:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23363.655564 secs 2023-05-08T10:13:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:44 smithi186 ceph-mon[126480]: pgmap v12516: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 82 KiB/s wr, 6 op/s 2023-05-08T10:13:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23363.100487 secs 2023-05-08T10:13:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:44 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:13:44.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23363.655564 secs 2023-05-08T10:13:45.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:45 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:13:45.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:45 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:13:45.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:45 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:13:45.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:45 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:13:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:45 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:13:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:45 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:13:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:45 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:13:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:45 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:13:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:45 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:13:46.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:46 smithi133 ceph-mon[125939]: pgmap v12517: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 249 KiB/s wr, 10 op/s 2023-05-08T10:13:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:46 smithi096 ceph-mon[124666]: pgmap v12517: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 249 KiB/s wr, 10 op/s 2023-05-08T10:13:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:46 smithi186 ceph-mon[126480]: pgmap v12517: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 249 KiB/s wr, 10 op/s 2023-05-08T10:13:48.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:48 smithi133 ceph-mon[125939]: pgmap v12518: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 167 KiB/s wr, 7 op/s 2023-05-08T10:13:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:48 smithi096 ceph-mon[124666]: pgmap v12518: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 167 KiB/s wr, 7 op/s 2023-05-08T10:13:48.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:48 smithi186 ceph-mon[126480]: pgmap v12518: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 167 KiB/s wr, 7 op/s 2023-05-08T10:13:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23368.100561 secs 2023-05-08T10:13:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23368.100561 secs 2023-05-08T10:13:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23368.100561 secs 2023-05-08T10:13:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:50 smithi133 ceph-mon[125939]: pgmap v12519: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 167 KiB/s wr, 7 op/s 2023-05-08T10:13:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:50 smithi096 ceph-mon[124666]: pgmap v12519: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 167 KiB/s wr, 7 op/s 2023-05-08T10:13:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:50 smithi186 ceph-mon[126480]: pgmap v12519: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 167 KiB/s wr, 7 op/s 2023-05-08T10:13:52.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:52 smithi133 ceph-mon[125939]: pgmap v12520: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 538 KiB/s rd, 453 KiB/s wr, 11 op/s 2023-05-08T10:13:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:13:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:52 smithi096 ceph-mon[124666]: pgmap v12520: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 538 KiB/s rd, 453 KiB/s wr, 11 op/s 2023-05-08T10:13:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:13:52.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:52 smithi186 ceph-mon[126480]: pgmap v12520: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 538 KiB/s rd, 453 KiB/s wr, 11 op/s 2023-05-08T10:13:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:13:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:53 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:13:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:13:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:13:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:53 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:13:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:13:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:13:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:53 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:13:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:13:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:13:54.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:54 smithi133 ceph-mon[125939]: pgmap v12521: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 455 KiB/s rd, 453 KiB/s wr, 8 op/s 2023-05-08T10:13:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23373.100644 secs 2023-05-08T10:13:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23373.655790 secs 2023-05-08T10:13:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:54 smithi096 ceph-mon[124666]: pgmap v12521: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 455 KiB/s rd, 453 KiB/s wr, 8 op/s 2023-05-08T10:13:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23373.100644 secs 2023-05-08T10:13:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23373.655790 secs 2023-05-08T10:13:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:54 smithi186 ceph-mon[126480]: pgmap v12521: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 455 KiB/s rd, 453 KiB/s wr, 8 op/s 2023-05-08T10:13:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23373.100644 secs 2023-05-08T10:13:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23373.655790 secs 2023-05-08T10:13:56.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:56 smithi133 ceph-mon[125939]: pgmap v12522: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 840 KiB/s rd, 826 KiB/s wr, 14 op/s 2023-05-08T10:13:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23374.943154 secs 2023-05-08T10:13:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:56 smithi096 ceph-mon[124666]: pgmap v12522: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 840 KiB/s rd, 826 KiB/s wr, 14 op/s 2023-05-08T10:13:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23374.943154 secs 2023-05-08T10:13:56.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:56 smithi186 ceph-mon[126480]: pgmap v12522: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 840 KiB/s rd, 826 KiB/s wr, 14 op/s 2023-05-08T10:13:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23374.943154 secs 2023-05-08T10:13:57.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:13:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:13:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:13:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:13:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:13:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:13:57.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:13:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:13:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:13:58.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:58 smithi133 ceph-mon[125939]: pgmap v12523: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 671 KiB/s rd, 659 KiB/s wr, 10 op/s 2023-05-08T10:13:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:58 smithi096 ceph-mon[124666]: pgmap v12523: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 671 KiB/s rd, 659 KiB/s wr, 10 op/s 2023-05-08T10:13:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:58 smithi186 ceph-mon[126480]: pgmap v12523: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 671 KiB/s rd, 659 KiB/s wr, 10 op/s 2023-05-08T10:13:59.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:13:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23378.100760 secs 2023-05-08T10:13:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:13:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:13:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:13:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:13:59.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:13:59.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:13:59.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:13:59 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:13:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:13:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23378.100760 secs 2023-05-08T10:13:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:13:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:13:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:13:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:13:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:13:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:13:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:13:59 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:13:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:13:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23378.100760 secs 2023-05-08T10:13:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:13:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:13:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:13:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:13:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:13:59.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:13:59.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:13:59 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:14:00.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:00 smithi133 ceph-mon[125939]: pgmap v12524: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 671 KiB/s rd, 659 KiB/s wr, 10 op/s 2023-05-08T10:14:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:14:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:14:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:14:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:00 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:14:00.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:00 smithi096 ceph-mon[124666]: pgmap v12524: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 671 KiB/s rd, 659 KiB/s wr, 10 op/s 2023-05-08T10:14:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:14:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:14:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:14:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:00 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:14:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:00 smithi186 ceph-mon[126480]: pgmap v12524: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 671 KiB/s rd, 659 KiB/s wr, 10 op/s 2023-05-08T10:14:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:14:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:14:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:14:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:00 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:14:01.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:01 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:14:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:01 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T10:14:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:01 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T10:14:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:01 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:14:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23379.943275 secs 2023-05-08T10:14:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:14:01.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:14:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:01 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:14:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:01 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T10:14:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:01 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T10:14:01.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:01 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:14:01.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23379.943275 secs 2023-05-08T10:14:01.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:14:01.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:14:01.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:01 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:14:01.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:01 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T10:14:01.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:01 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T10:14:01.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:01 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:14:01.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23379.943275 secs 2023-05-08T10:14:01.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:14:01.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:14:02.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:02 smithi133 ceph-mon[125939]: pgmap v12525: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 743 KiB/s rd, 743 KiB/s wr, 15 op/s 2023-05-08T10:14:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:02 smithi096 ceph-mon[124666]: pgmap v12525: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 743 KiB/s rd, 743 KiB/s wr, 15 op/s 2023-05-08T10:14:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:02 smithi186 ceph-mon[126480]: pgmap v12525: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 743 KiB/s rd, 743 KiB/s wr, 15 op/s 2023-05-08T10:14:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:04 smithi133 ceph-mon[125939]: pgmap v12526: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 456 KiB/s rd, 457 KiB/s wr, 11 op/s 2023-05-08T10:14:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23383.100899 secs 2023-05-08T10:14:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23383.656021 secs 2023-05-08T10:14:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:04 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:14:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:04 smithi096 ceph-mon[124666]: pgmap v12526: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 456 KiB/s rd, 457 KiB/s wr, 11 op/s 2023-05-08T10:14:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23383.100899 secs 2023-05-08T10:14:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23383.656021 secs 2023-05-08T10:14:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:04 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:14:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:04 smithi186 ceph-mon[126480]: pgmap v12526: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 456 KiB/s rd, 457 KiB/s wr, 11 op/s 2023-05-08T10:14:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23383.100899 secs 2023-05-08T10:14:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23383.656021 secs 2023-05-08T10:14:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:04 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:14:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:06 smithi133 ceph-mon[125939]: pgmap v12527: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 811 KiB/s rd, 834 KiB/s wr, 30 op/s 2023-05-08T10:14:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23384.943369 secs 2023-05-08T10:14:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:06 smithi096 ceph-mon[124666]: pgmap v12527: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 811 KiB/s rd, 834 KiB/s wr, 30 op/s 2023-05-08T10:14:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23384.943369 secs 2023-05-08T10:14:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:06 smithi186 ceph-mon[126480]: pgmap v12527: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 811 KiB/s rd, 834 KiB/s wr, 30 op/s 2023-05-08T10:14:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23384.943369 secs 2023-05-08T10:14:07.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:07 smithi133 ceph-mon[125939]: osdmap e860: 12 total, 12 up, 12 in 2023-05-08T10:14:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:07 smithi096 ceph-mon[124666]: osdmap e860: 12 total, 12 up, 12 in 2023-05-08T10:14:07.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:07 smithi186 ceph-mon[126480]: osdmap e860: 12 total, 12 up, 12 in 2023-05-08T10:14:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:08 smithi133 ceph-mon[125939]: pgmap v12529: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 511 KiB/s rd, 552 KiB/s wr, 29 op/s 2023-05-08T10:14:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:08 smithi096 ceph-mon[124666]: pgmap v12529: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 511 KiB/s rd, 552 KiB/s wr, 29 op/s 2023-05-08T10:14:08.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:08 smithi186 ceph-mon[126480]: pgmap v12529: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 511 KiB/s rd, 552 KiB/s wr, 29 op/s 2023-05-08T10:14:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:14:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:14:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23388.101037 secs 2023-05-08T10:14:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23388.656151 secs 2023-05-08T10:14:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:09 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:14:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:14:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:14:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23388.101037 secs 2023-05-08T10:14:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23388.656151 secs 2023-05-08T10:14:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:09 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:14:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:14:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:14:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23388.101037 secs 2023-05-08T10:14:09.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23388.656151 secs 2023-05-08T10:14:09.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:09 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:14:10.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:10 smithi133 ceph-mon[125939]: pgmap v12530: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 511 KiB/s rd, 552 KiB/s wr, 29 op/s 2023-05-08T10:14:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:10 smithi096 ceph-mon[124666]: pgmap v12530: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 511 KiB/s rd, 552 KiB/s wr, 29 op/s 2023-05-08T10:14:10.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:10 smithi186 ceph-mon[126480]: pgmap v12530: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 511 KiB/s rd, 552 KiB/s wr, 29 op/s 2023-05-08T10:14:11.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23389.943500 secs 2023-05-08T10:14:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23389.943500 secs 2023-05-08T10:14:11.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23389.943500 secs 2023-05-08T10:14:12.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:12 smithi133 ceph-mon[125939]: pgmap v12531: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 500 KiB/s wr, 28 op/s 2023-05-08T10:14:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:12 smithi096 ceph-mon[124666]: pgmap v12531: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 500 KiB/s wr, 28 op/s 2023-05-08T10:14:12.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:12 smithi186 ceph-mon[126480]: pgmap v12531: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 500 KiB/s wr, 28 op/s 2023-05-08T10:14:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:14 smithi096 ceph-mon[124666]: pgmap v12532: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 500 KiB/s wr, 28 op/s 2023-05-08T10:14:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23393.101173 secs 2023-05-08T10:14:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23393.656283 secs 2023-05-08T10:14:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:14 smithi096 ceph-mon[124666]: osdmap e861: 12 total, 12 up, 12 in 2023-05-08T10:14:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:14 smithi186 ceph-mon[126480]: pgmap v12532: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 500 KiB/s wr, 28 op/s 2023-05-08T10:14:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23393.101173 secs 2023-05-08T10:14:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23393.656283 secs 2023-05-08T10:14:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:14 smithi186 ceph-mon[126480]: osdmap e861: 12 total, 12 up, 12 in 2023-05-08T10:14:14.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:14 smithi133 ceph-mon[125939]: pgmap v12532: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 500 KiB/s wr, 28 op/s 2023-05-08T10:14:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23393.101173 secs 2023-05-08T10:14:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23393.656283 secs 2023-05-08T10:14:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:14 smithi133 ceph-mon[125939]: osdmap e861: 12 total, 12 up, 12 in 2023-05-08T10:14:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:16 smithi096 ceph-mon[124666]: pgmap v12534: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 177 KiB/s wr, 9 op/s 2023-05-08T10:14:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23394.943620 secs 2023-05-08T10:14:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:16 smithi186 ceph-mon[126480]: pgmap v12534: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 177 KiB/s wr, 9 op/s 2023-05-08T10:14:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23394.943620 secs 2023-05-08T10:14:16.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:16 smithi133 ceph-mon[125939]: pgmap v12534: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 177 KiB/s wr, 9 op/s 2023-05-08T10:14:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23394.943620 secs 2023-05-08T10:14:18.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:18 smithi096 ceph-mon[124666]: pgmap v12535: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 156 KiB/s wr, 8 op/s 2023-05-08T10:14:18.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:18 smithi186 ceph-mon[126480]: pgmap v12535: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 156 KiB/s wr, 8 op/s 2023-05-08T10:14:18.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:18 smithi133 ceph-mon[125939]: pgmap v12535: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 156 KiB/s wr, 8 op/s 2023-05-08T10:14:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23398.101317 secs 2023-05-08T10:14:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23398.656410 secs 2023-05-08T10:14:19.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23398.101317 secs 2023-05-08T10:14:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23398.656410 secs 2023-05-08T10:14:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23398.101317 secs 2023-05-08T10:14:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23398.656410 secs 2023-05-08T10:14:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:20 smithi096 ceph-mon[124666]: pgmap v12536: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 156 KiB/s wr, 8 op/s 2023-05-08T10:14:20.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:20 smithi186 ceph-mon[126480]: pgmap v12536: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 156 KiB/s wr, 8 op/s 2023-05-08T10:14:20.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:20 smithi133 ceph-mon[125939]: pgmap v12536: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 156 KiB/s wr, 8 op/s 2023-05-08T10:14:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23399.943727 secs 2023-05-08T10:14:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23399.943727 secs 2023-05-08T10:14:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23399.943727 secs 2023-05-08T10:14:22.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:22 smithi186 ceph-mon[126480]: pgmap v12537: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 108 KiB/s wr, 7 op/s 2023-05-08T10:14:22.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:22 smithi133 ceph-mon[125939]: pgmap v12537: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 108 KiB/s wr, 7 op/s 2023-05-08T10:14:22.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:22 smithi096 ceph-mon[124666]: pgmap v12537: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 108 KiB/s wr, 7 op/s 2023-05-08T10:14:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:24 smithi186 ceph-mon[126480]: pgmap v12538: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 108 KiB/s wr, 7 op/s 2023-05-08T10:14:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23403.101431 secs 2023-05-08T10:14:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23403.656558 secs 2023-05-08T10:14:24.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:24 smithi133 ceph-mon[125939]: pgmap v12538: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 108 KiB/s wr, 7 op/s 2023-05-08T10:14:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23403.101431 secs 2023-05-08T10:14:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23403.656558 secs 2023-05-08T10:14:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:24 smithi096 ceph-mon[124666]: pgmap v12538: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 108 KiB/s wr, 7 op/s 2023-05-08T10:14:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23403.101431 secs 2023-05-08T10:14:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23403.656558 secs 2023-05-08T10:14:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:26 smithi186 ceph-mon[126480]: pgmap v12539: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 98 KiB/s wr, 10 op/s 2023-05-08T10:14:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23404.943846 secs 2023-05-08T10:14:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:26 smithi133 ceph-mon[125939]: pgmap v12539: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 98 KiB/s wr, 10 op/s 2023-05-08T10:14:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23404.943846 secs 2023-05-08T10:14:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:26 smithi096 ceph-mon[124666]: pgmap v12539: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 98 KiB/s wr, 10 op/s 2023-05-08T10:14:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23404.943846 secs 2023-05-08T10:14:28.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:28 smithi186 ceph-mon[126480]: pgmap v12540: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:14:28.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:28 smithi133 ceph-mon[125939]: pgmap v12540: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:14:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:28 smithi096 ceph-mon[124666]: pgmap v12540: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:14:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23408.101496 secs 2023-05-08T10:14:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23408.656686 secs 2023-05-08T10:14:29.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23408.101496 secs 2023-05-08T10:14:29.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23408.656686 secs 2023-05-08T10:14:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23408.101496 secs 2023-05-08T10:14:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23408.656686 secs 2023-05-08T10:14:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:30 smithi186 ceph-mon[126480]: pgmap v12541: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:14:30.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:30 smithi133 ceph-mon[125939]: pgmap v12541: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:14:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:30 smithi096 ceph-mon[124666]: pgmap v12541: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:14:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23409.943999 secs 2023-05-08T10:14:31.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23409.943999 secs 2023-05-08T10:14:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23409.943999 secs 2023-05-08T10:14:32.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:32 smithi186 ceph-mon[126480]: pgmap v12542: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 9 op/s 2023-05-08T10:14:32.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:32 smithi133 ceph-mon[125939]: pgmap v12542: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 9 op/s 2023-05-08T10:14:32.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:32 smithi096 ceph-mon[124666]: pgmap v12542: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 9 op/s 2023-05-08T10:14:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:34 smithi186 ceph-mon[126480]: pgmap v12543: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 6 op/s 2023-05-08T10:14:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23413.101562 secs 2023-05-08T10:14:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23413.656787 secs 2023-05-08T10:14:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:34 smithi133 ceph-mon[125939]: pgmap v12543: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 6 op/s 2023-05-08T10:14:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23413.101562 secs 2023-05-08T10:14:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23413.656787 secs 2023-05-08T10:14:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:34 smithi096 ceph-mon[124666]: pgmap v12543: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 6 op/s 2023-05-08T10:14:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23413.101562 secs 2023-05-08T10:14:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23413.656787 secs 2023-05-08T10:14:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:36 smithi186 ceph-mon[126480]: pgmap v12544: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 169 KiB/s wr, 10 op/s 2023-05-08T10:14:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23414.944160 secs 2023-05-08T10:14:36.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:36 smithi133 ceph-mon[125939]: pgmap v12544: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 169 KiB/s wr, 10 op/s 2023-05-08T10:14:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23414.944160 secs 2023-05-08T10:14:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:36 smithi096 ceph-mon[124666]: pgmap v12544: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 169 KiB/s wr, 10 op/s 2023-05-08T10:14:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23414.944160 secs 2023-05-08T10:14:38.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:38 smithi186 ceph-mon[126480]: pgmap v12545: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 169 KiB/s wr, 7 op/s 2023-05-08T10:14:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:38 smithi133 ceph-mon[125939]: pgmap v12545: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 169 KiB/s wr, 7 op/s 2023-05-08T10:14:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:38 smithi096 ceph-mon[124666]: pgmap v12545: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 169 KiB/s wr, 7 op/s 2023-05-08T10:14:39.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23418.101630 secs 2023-05-08T10:14:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23418.656882 secs 2023-05-08T10:14:39.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23418.101630 secs 2023-05-08T10:14:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23418.656882 secs 2023-05-08T10:14:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23418.101630 secs 2023-05-08T10:14:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23418.656882 secs 2023-05-08T10:14:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:40 smithi186 ceph-mon[126480]: pgmap v12546: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 169 KiB/s wr, 7 op/s 2023-05-08T10:14:40.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:40 smithi133 ceph-mon[125939]: pgmap v12546: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 169 KiB/s wr, 7 op/s 2023-05-08T10:14:40.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:40 smithi096 ceph-mon[124666]: pgmap v12546: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 169 KiB/s wr, 7 op/s 2023-05-08T10:14:42.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:42 smithi186 ceph-mon[126480]: pgmap v12547: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 169 KiB/s wr, 10 op/s 2023-05-08T10:14:42.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:42 smithi133 ceph-mon[125939]: pgmap v12547: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 169 KiB/s wr, 10 op/s 2023-05-08T10:14:42.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:42 smithi096 ceph-mon[124666]: pgmap v12547: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 169 KiB/s wr, 10 op/s 2023-05-08T10:14:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:44 smithi186 ceph-mon[126480]: pgmap v12548: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 169 KiB/s wr, 7 op/s 2023-05-08T10:14:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23423.101720 secs 2023-05-08T10:14:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:44 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:14:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23423.656985 secs 2023-05-08T10:14:44.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:44 smithi133 ceph-mon[125939]: pgmap v12548: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 169 KiB/s wr, 7 op/s 2023-05-08T10:14:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23423.101720 secs 2023-05-08T10:14:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:44 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:14:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23423.656985 secs 2023-05-08T10:14:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:44 smithi096 ceph-mon[124666]: pgmap v12548: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 169 KiB/s wr, 7 op/s 2023-05-08T10:14:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23423.101720 secs 2023-05-08T10:14:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:44 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:14:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23423.656985 secs 2023-05-08T10:14:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:45 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:14:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:45 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:14:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:45 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:14:45.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:45 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:14:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:45 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:14:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:45 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:14:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:45 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:14:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:45 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:14:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:45 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:14:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:46 smithi186 ceph-mon[126480]: pgmap v12549: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 250 KiB/s wr, 10 op/s 2023-05-08T10:14:46.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:46 smithi133 ceph-mon[125939]: pgmap v12549: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 250 KiB/s wr, 10 op/s 2023-05-08T10:14:46.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:46 smithi096 ceph-mon[124666]: pgmap v12549: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 250 KiB/s wr, 10 op/s 2023-05-08T10:14:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:48 smithi186 ceph-mon[126480]: pgmap v12550: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 82 KiB/s wr, 6 op/s 2023-05-08T10:14:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:48 smithi133 ceph-mon[125939]: pgmap v12550: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 82 KiB/s wr, 6 op/s 2023-05-08T10:14:48.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:48 smithi096 ceph-mon[124666]: pgmap v12550: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 82 KiB/s wr, 6 op/s 2023-05-08T10:14:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23428.101835 secs 2023-05-08T10:14:49.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23428.101835 secs 2023-05-08T10:14:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23428.101835 secs 2023-05-08T10:14:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:50 smithi186 ceph-mon[126480]: pgmap v12551: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 82 KiB/s wr, 6 op/s 2023-05-08T10:14:50.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:50 smithi133 ceph-mon[125939]: pgmap v12551: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 82 KiB/s wr, 6 op/s 2023-05-08T10:14:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:50 smithi096 ceph-mon[124666]: pgmap v12551: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 82 KiB/s wr, 6 op/s 2023-05-08T10:14:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:52 smithi186 ceph-mon[126480]: pgmap v12552: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 463 KiB/s rd, 292 KiB/s wr, 10 op/s 2023-05-08T10:14:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:14:52.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:52 smithi133 ceph-mon[125939]: pgmap v12552: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 463 KiB/s rd, 292 KiB/s wr, 10 op/s 2023-05-08T10:14:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:14:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:52 smithi096 ceph-mon[124666]: pgmap v12552: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 463 KiB/s rd, 292 KiB/s wr, 10 op/s 2023-05-08T10:14:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:14:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:53 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:14:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:14:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:14:53.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:53 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:14:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:14:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:14:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:53 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:14:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:14:53.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:14:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:54 smithi186 ceph-mon[126480]: pgmap v12553: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 294 KiB/s rd, 292 KiB/s wr, 7 op/s 2023-05-08T10:14:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23433.101956 secs 2023-05-08T10:14:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23433.657217 secs 2023-05-08T10:14:54.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:54 smithi133 ceph-mon[125939]: pgmap v12553: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 294 KiB/s rd, 292 KiB/s wr, 7 op/s 2023-05-08T10:14:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23433.101956 secs 2023-05-08T10:14:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23433.657217 secs 2023-05-08T10:14:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:54 smithi096 ceph-mon[124666]: pgmap v12553: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 294 KiB/s rd, 292 KiB/s wr, 7 op/s 2023-05-08T10:14:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23433.101956 secs 2023-05-08T10:14:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23433.657217 secs 2023-05-08T10:14:56.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:56 smithi186 ceph-mon[126480]: pgmap v12554: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 505 KiB/s wr, 13 op/s 2023-05-08T10:14:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23434.944673 secs 2023-05-08T10:14:56.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:56 smithi133 ceph-mon[125939]: pgmap v12554: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 505 KiB/s wr, 13 op/s 2023-05-08T10:14:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23434.944673 secs 2023-05-08T10:14:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:56 smithi096 ceph-mon[124666]: pgmap v12554: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 505 KiB/s wr, 13 op/s 2023-05-08T10:14:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23434.944673 secs 2023-05-08T10:14:57.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:14:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:14:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:14:57.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:14:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:14:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:14:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:14:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:14:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:14:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:58 smithi186 ceph-mon[126480]: pgmap v12555: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 423 KiB/s wr, 10 op/s 2023-05-08T10:14:58.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:58 smithi133 ceph-mon[125939]: pgmap v12555: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 423 KiB/s wr, 10 op/s 2023-05-08T10:14:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:58 smithi096 ceph-mon[124666]: pgmap v12555: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 423 KiB/s wr, 10 op/s 2023-05-08T10:14:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23438.102094 secs 2023-05-08T10:14:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:14:59 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:14:59.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23438.102094 secs 2023-05-08T10:14:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:14:59 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:14:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23438.102094 secs 2023-05-08T10:14:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:14:59 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:15:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:00 smithi186 ceph-mon[126480]: pgmap v12556: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 423 KiB/s wr, 10 op/s 2023-05-08T10:15:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:15:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:00 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:15:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:15:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:15:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:15:00.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:00 smithi133 ceph-mon[125939]: pgmap v12556: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 423 KiB/s wr, 10 op/s 2023-05-08T10:15:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:15:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:00 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:15:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:15:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:15:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:15:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:00 smithi096 ceph-mon[124666]: pgmap v12556: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 423 KiB/s wr, 10 op/s 2023-05-08T10:15:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:15:00.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:00 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:15:00.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:15:00.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:15:00.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:15:01.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23439.944770 secs 2023-05-08T10:15:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:01 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:15:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:01 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T10:15:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:01 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T10:15:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:01 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:15:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:15:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:15:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23439.944770 secs 2023-05-08T10:15:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:01 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:15:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:01 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T10:15:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:01 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T10:15:01.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:01 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:15:01.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:15:01.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:15:01.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23439.944770 secs 2023-05-08T10:15:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:01 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:15:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:01 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T10:15:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:01 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T10:15:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:01 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:15:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:15:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:15:02.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:02 smithi133 ceph-mon[125939]: pgmap v12557: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 619 KiB/s rd, 618 KiB/s wr, 15 op/s 2023-05-08T10:15:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:02 smithi096 ceph-mon[124666]: pgmap v12557: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 619 KiB/s rd, 618 KiB/s wr, 15 op/s 2023-05-08T10:15:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:02 smithi186 ceph-mon[126480]: pgmap v12557: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 619 KiB/s rd, 618 KiB/s wr, 15 op/s 2023-05-08T10:15:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:04 smithi133 ceph-mon[125939]: pgmap v12558: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 407 KiB/s rd, 408 KiB/s wr, 11 op/s 2023-05-08T10:15:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23443.102211 secs 2023-05-08T10:15:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23443.657453 secs 2023-05-08T10:15:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:04 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:15:04.759 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:04 smithi096 ceph-mon[124666]: pgmap v12558: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 407 KiB/s rd, 408 KiB/s wr, 11 op/s 2023-05-08T10:15:04.760 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23443.102211 secs 2023-05-08T10:15:04.760 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23443.657453 secs 2023-05-08T10:15:04.760 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:04 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:15:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:04 smithi186 ceph-mon[126480]: pgmap v12558: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 407 KiB/s rd, 408 KiB/s wr, 11 op/s 2023-05-08T10:15:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23443.102211 secs 2023-05-08T10:15:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23443.657453 secs 2023-05-08T10:15:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:04 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:15:05.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23444.944882 secs 2023-05-08T10:15:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23444.944882 secs 2023-05-08T10:15:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23444.944882 secs 2023-05-08T10:15:06.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:06 smithi133 ceph-mon[125939]: pgmap v12559: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 654 KiB/s wr, 31 op/s 2023-05-08T10:15:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:06 smithi133 ceph-mon[125939]: osdmap e862: 12 total, 12 up, 12 in 2023-05-08T10:15:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:06 smithi096 ceph-mon[124666]: pgmap v12559: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 654 KiB/s wr, 31 op/s 2023-05-08T10:15:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:06 smithi096 ceph-mon[124666]: osdmap e862: 12 total, 12 up, 12 in 2023-05-08T10:15:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:06 smithi186 ceph-mon[126480]: pgmap v12559: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 654 KiB/s wr, 31 op/s 2023-05-08T10:15:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:06 smithi186 ceph-mon[126480]: osdmap e862: 12 total, 12 up, 12 in 2023-05-08T10:15:08.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:08 smithi133 ceph-mon[125939]: pgmap v12561: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 530 KiB/s wr, 30 op/s 2023-05-08T10:15:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:08 smithi096 ceph-mon[124666]: pgmap v12561: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 530 KiB/s wr, 30 op/s 2023-05-08T10:15:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:08 smithi186 ceph-mon[126480]: pgmap v12561: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 530 KiB/s wr, 30 op/s 2023-05-08T10:15:09.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23448.102272 secs 2023-05-08T10:15:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:15:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:15:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23448.657571 secs 2023-05-08T10:15:09.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:09 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:15:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23448.102272 secs 2023-05-08T10:15:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:15:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:15:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23448.657571 secs 2023-05-08T10:15:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:09 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:15:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23448.102272 secs 2023-05-08T10:15:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:15:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:15:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23448.657571 secs 2023-05-08T10:15:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:09 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:15:10.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:10 smithi133 ceph-mon[125939]: pgmap v12562: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 530 KiB/s wr, 30 op/s 2023-05-08T10:15:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23449.945013 secs 2023-05-08T10:15:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:10 smithi096 ceph-mon[124666]: pgmap v12562: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 530 KiB/s wr, 30 op/s 2023-05-08T10:15:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23449.945013 secs 2023-05-08T10:15:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:10 smithi186 ceph-mon[126480]: pgmap v12562: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 530 KiB/s wr, 30 op/s 2023-05-08T10:15:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23449.945013 secs 2023-05-08T10:15:12.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:12 smithi133 ceph-mon[125939]: pgmap v12563: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 492 KiB/s wr, 29 op/s 2023-05-08T10:15:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:12 smithi096 ceph-mon[124666]: pgmap v12563: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 492 KiB/s wr, 29 op/s 2023-05-08T10:15:12.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:12 smithi186 ceph-mon[126480]: pgmap v12563: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 492 KiB/s wr, 29 op/s 2023-05-08T10:15:14.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:14 smithi133 ceph-mon[125939]: pgmap v12564: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 492 KiB/s wr, 29 op/s 2023-05-08T10:15:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23453.102370 secs 2023-05-08T10:15:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23453.657693 secs 2023-05-08T10:15:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:14 smithi133 ceph-mon[125939]: osdmap e863: 12 total, 12 up, 12 in 2023-05-08T10:15:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:14 smithi096 ceph-mon[124666]: pgmap v12564: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 492 KiB/s wr, 29 op/s 2023-05-08T10:15:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23453.102370 secs 2023-05-08T10:15:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23453.657693 secs 2023-05-08T10:15:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:14 smithi096 ceph-mon[124666]: osdmap e863: 12 total, 12 up, 12 in 2023-05-08T10:15:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:14 smithi186 ceph-mon[126480]: pgmap v12564: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 492 KiB/s wr, 29 op/s 2023-05-08T10:15:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23453.102370 secs 2023-05-08T10:15:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23453.657693 secs 2023-05-08T10:15:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:14 smithi186 ceph-mon[126480]: osdmap e863: 12 total, 12 up, 12 in 2023-05-08T10:15:15.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23454.945155 secs 2023-05-08T10:15:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23454.945155 secs 2023-05-08T10:15:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23454.945155 secs 2023-05-08T10:15:16.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:16 smithi133 ceph-mon[125939]: pgmap v12566: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 291 KiB/s rd, 283 KiB/s wr, 10 op/s 2023-05-08T10:15:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:16 smithi096 ceph-mon[124666]: pgmap v12566: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 291 KiB/s rd, 283 KiB/s wr, 10 op/s 2023-05-08T10:15:16.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:16 smithi186 ceph-mon[126480]: pgmap v12566: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 291 KiB/s rd, 283 KiB/s wr, 10 op/s 2023-05-08T10:15:18.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:18 smithi133 ceph-mon[125939]: pgmap v12567: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 273 KiB/s wr, 9 op/s 2023-05-08T10:15:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:18 smithi096 ceph-mon[124666]: pgmap v12567: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 273 KiB/s wr, 9 op/s 2023-05-08T10:15:18.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:18 smithi186 ceph-mon[126480]: pgmap v12567: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 273 KiB/s wr, 9 op/s 2023-05-08T10:15:19.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23458.102479 secs 2023-05-08T10:15:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23458.657811 secs 2023-05-08T10:15:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23458.102479 secs 2023-05-08T10:15:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23458.657811 secs 2023-05-08T10:15:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23458.102479 secs 2023-05-08T10:15:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23458.657811 secs 2023-05-08T10:15:20.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:20 smithi133 ceph-mon[125939]: pgmap v12568: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 273 KiB/s wr, 9 op/s 2023-05-08T10:15:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23459.945255 secs 2023-05-08T10:15:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:20 smithi096 ceph-mon[124666]: pgmap v12568: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 273 KiB/s wr, 9 op/s 2023-05-08T10:15:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23459.945255 secs 2023-05-08T10:15:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:20 smithi186 ceph-mon[126480]: pgmap v12568: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 273 KiB/s wr, 9 op/s 2023-05-08T10:15:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23459.945255 secs 2023-05-08T10:15:22.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:22 smithi133 ceph-mon[125939]: pgmap v12569: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 138 KiB/s wr, 7 op/s 2023-05-08T10:15:22.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:22 smithi096 ceph-mon[124666]: pgmap v12569: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 138 KiB/s wr, 7 op/s 2023-05-08T10:15:22.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:22 smithi186 ceph-mon[126480]: pgmap v12569: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 138 KiB/s wr, 7 op/s 2023-05-08T10:15:24.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:24 smithi133 ceph-mon[125939]: pgmap v12570: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 138 KiB/s wr, 7 op/s 2023-05-08T10:15:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23463.102543 secs 2023-05-08T10:15:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23463.657926 secs 2023-05-08T10:15:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:24 smithi096 ceph-mon[124666]: pgmap v12570: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 138 KiB/s wr, 7 op/s 2023-05-08T10:15:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23463.102543 secs 2023-05-08T10:15:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23463.657926 secs 2023-05-08T10:15:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:24 smithi186 ceph-mon[126480]: pgmap v12570: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 138 KiB/s wr, 7 op/s 2023-05-08T10:15:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23463.102543 secs 2023-05-08T10:15:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23463.657926 secs 2023-05-08T10:15:25.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23464.945381 secs 2023-05-08T10:15:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23464.945381 secs 2023-05-08T10:15:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23464.945381 secs 2023-05-08T10:15:26.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:26 smithi133 ceph-mon[125939]: pgmap v12571: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 126 KiB/s wr, 10 op/s 2023-05-08T10:15:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:26 smithi096 ceph-mon[124666]: pgmap v12571: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 126 KiB/s wr, 10 op/s 2023-05-08T10:15:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:26 smithi186 ceph-mon[126480]: pgmap v12571: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 126 KiB/s wr, 10 op/s 2023-05-08T10:15:27.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:27 smithi133 ceph-mon[125939]: pgmap v12572: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 5 op/s 2023-05-08T10:15:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:27 smithi096 ceph-mon[124666]: pgmap v12572: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 5 op/s 2023-05-08T10:15:27.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:27 smithi186 ceph-mon[126480]: pgmap v12572: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 5 op/s 2023-05-08T10:15:28.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23468.102660 secs 2023-05-08T10:15:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23468.102660 secs 2023-05-08T10:15:29.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23468.102660 secs 2023-05-08T10:15:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23468.658047 secs 2023-05-08T10:15:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:30 smithi186 ceph-mon[126480]: pgmap v12573: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 5 op/s 2023-05-08T10:15:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23468.658047 secs 2023-05-08T10:15:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:30 smithi133 ceph-mon[125939]: pgmap v12573: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 5 op/s 2023-05-08T10:15:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23468.658047 secs 2023-05-08T10:15:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:30 smithi096 ceph-mon[124666]: pgmap v12573: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 5 op/s 2023-05-08T10:15:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23469.945510 secs 2023-05-08T10:15:31.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23469.945510 secs 2023-05-08T10:15:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23469.945510 secs 2023-05-08T10:15:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:32 smithi186 ceph-mon[126480]: pgmap v12574: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 51 KiB/s wr, 8 op/s 2023-05-08T10:15:32.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:32 smithi133 ceph-mon[125939]: pgmap v12574: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 51 KiB/s wr, 8 op/s 2023-05-08T10:15:32.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:32 smithi096 ceph-mon[124666]: pgmap v12574: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 51 KiB/s wr, 8 op/s 2023-05-08T10:15:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:34 smithi186 ceph-mon[126480]: pgmap v12575: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:15:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23473.102805 secs 2023-05-08T10:15:34.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:34 smithi133 ceph-mon[125939]: pgmap v12575: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:15:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23473.102805 secs 2023-05-08T10:15:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:34 smithi096 ceph-mon[124666]: pgmap v12575: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:15:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23473.102805 secs 2023-05-08T10:15:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23473.658174 secs 2023-05-08T10:15:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23473.658174 secs 2023-05-08T10:15:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23473.658174 secs 2023-05-08T10:15:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:36 smithi186 ceph-mon[126480]: pgmap v12576: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 9 op/s 2023-05-08T10:15:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23474.945644 secs 2023-05-08T10:15:36.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:36 smithi133 ceph-mon[125939]: pgmap v12576: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 9 op/s 2023-05-08T10:15:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23474.945644 secs 2023-05-08T10:15:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:36 smithi096 ceph-mon[124666]: pgmap v12576: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 9 op/s 2023-05-08T10:15:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23474.945644 secs 2023-05-08T10:15:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:38 smithi186 ceph-mon[126480]: pgmap v12577: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T10:15:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:38 smithi133 ceph-mon[125939]: pgmap v12577: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T10:15:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:38 smithi096 ceph-mon[124666]: pgmap v12577: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T10:15:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23478.102922 secs 2023-05-08T10:15:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23478.658292 secs 2023-05-08T10:15:39.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23478.102922 secs 2023-05-08T10:15:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23478.658292 secs 2023-05-08T10:15:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23478.102922 secs 2023-05-08T10:15:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23478.658292 secs 2023-05-08T10:15:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:40 smithi186 ceph-mon[126480]: pgmap v12578: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T10:15:40.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:40 smithi133 ceph-mon[125939]: pgmap v12578: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T10:15:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:40 smithi096 ceph-mon[124666]: pgmap v12578: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T10:15:42.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:42 smithi186 ceph-mon[126480]: pgmap v12579: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 83 KiB/s wr, 9 op/s 2023-05-08T10:15:42.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:42 smithi133 ceph-mon[125939]: pgmap v12579: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 83 KiB/s wr, 9 op/s 2023-05-08T10:15:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:42 smithi096 ceph-mon[124666]: pgmap v12579: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 83 KiB/s wr, 9 op/s 2023-05-08T10:15:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:44 smithi186 ceph-mon[126480]: pgmap v12580: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 83 KiB/s wr, 6 op/s 2023-05-08T10:15:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23483.103039 secs 2023-05-08T10:15:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:44 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:15:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23483.658410 secs 2023-05-08T10:15:44.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:44 smithi133 ceph-mon[125939]: pgmap v12580: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 83 KiB/s wr, 6 op/s 2023-05-08T10:15:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23483.103039 secs 2023-05-08T10:15:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:44 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:15:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23483.658410 secs 2023-05-08T10:15:44.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:44 smithi096 ceph-mon[124666]: pgmap v12580: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 83 KiB/s wr, 6 op/s 2023-05-08T10:15:44.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23483.103039 secs 2023-05-08T10:15:44.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:44 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:15:44.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23483.658410 secs 2023-05-08T10:15:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:45 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:15:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:45 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:15:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:45 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:15:45.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:45 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:15:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:45 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:15:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:45 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:15:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:45 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:15:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:45 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:15:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:45 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:15:46.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:46 smithi186 ceph-mon[126480]: pgmap v12581: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 94 KiB/s wr, 10 op/s 2023-05-08T10:15:46.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:46 smithi133 ceph-mon[125939]: pgmap v12581: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 94 KiB/s wr, 10 op/s 2023-05-08T10:15:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:46 smithi096 ceph-mon[124666]: pgmap v12581: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 94 KiB/s wr, 10 op/s 2023-05-08T10:15:48.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:48 smithi186 ceph-mon[126480]: pgmap v12582: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 94 KiB/s wr, 7 op/s 2023-05-08T10:15:48.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:48 smithi133 ceph-mon[125939]: pgmap v12582: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 94 KiB/s wr, 7 op/s 2023-05-08T10:15:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:48 smithi096 ceph-mon[124666]: pgmap v12582: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 94 KiB/s wr, 7 op/s 2023-05-08T10:15:49.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23488.103101 secs 2023-05-08T10:15:49.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23488.103101 secs 2023-05-08T10:15:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23488.103101 secs 2023-05-08T10:15:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:50 smithi186 ceph-mon[126480]: pgmap v12583: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 94 KiB/s wr, 7 op/s 2023-05-08T10:15:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:50 smithi133 ceph-mon[125939]: pgmap v12583: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 94 KiB/s wr, 7 op/s 2023-05-08T10:15:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:50 smithi096 ceph-mon[124666]: pgmap v12583: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 94 KiB/s wr, 7 op/s 2023-05-08T10:15:52.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:52 smithi186 ceph-mon[126480]: pgmap v12584: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 548 KiB/s wr, 13 op/s 2023-05-08T10:15:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:15:52.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:52 smithi133 ceph-mon[125939]: pgmap v12584: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 548 KiB/s wr, 13 op/s 2023-05-08T10:15:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:15:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:52 smithi096 ceph-mon[124666]: pgmap v12584: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 548 KiB/s wr, 13 op/s 2023-05-08T10:15:52.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:15:53.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:53 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:15:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:15:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:15:53.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:53 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:15:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:15:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:15:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:53 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:15:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:15:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:15:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:54 smithi186 ceph-mon[126480]: pgmap v12585: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 576 KiB/s rd, 466 KiB/s wr, 9 op/s 2023-05-08T10:15:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23493.103229 secs 2023-05-08T10:15:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23493.658688 secs 2023-05-08T10:15:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:54 smithi133 ceph-mon[125939]: pgmap v12585: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 576 KiB/s rd, 466 KiB/s wr, 9 op/s 2023-05-08T10:15:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23493.103229 secs 2023-05-08T10:15:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23493.658688 secs 2023-05-08T10:15:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:54 smithi096 ceph-mon[124666]: pgmap v12585: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 576 KiB/s rd, 466 KiB/s wr, 9 op/s 2023-05-08T10:15:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23493.103229 secs 2023-05-08T10:15:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23493.658688 secs 2023-05-08T10:15:56.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:56 smithi186 ceph-mon[126480]: pgmap v12586: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 965 KiB/s rd, 843 KiB/s wr, 16 op/s 2023-05-08T10:15:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23494.946140 secs 2023-05-08T10:15:56.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:56 smithi133 ceph-mon[125939]: pgmap v12586: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 965 KiB/s rd, 843 KiB/s wr, 16 op/s 2023-05-08T10:15:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23494.946140 secs 2023-05-08T10:15:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:56 smithi096 ceph-mon[124666]: pgmap v12586: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 965 KiB/s rd, 843 KiB/s wr, 16 op/s 2023-05-08T10:15:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23494.946140 secs 2023-05-08T10:15:57.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:15:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:15:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:15:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:15:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:15:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:15:57.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:15:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:15:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:15:58.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:58 smithi133 ceph-mon[125939]: pgmap v12587: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 855 KiB/s rd, 832 KiB/s wr, 12 op/s 2023-05-08T10:15:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:58 smithi096 ceph-mon[124666]: pgmap v12587: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 855 KiB/s rd, 832 KiB/s wr, 12 op/s 2023-05-08T10:15:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:58 smithi186 ceph-mon[126480]: pgmap v12587: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 855 KiB/s rd, 832 KiB/s wr, 12 op/s 2023-05-08T10:15:59.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23498.103352 secs 2023-05-08T10:15:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:15:59 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:15:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23498.103352 secs 2023-05-08T10:15:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:15:59 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:15:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23498.103352 secs 2023-05-08T10:15:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:15:59 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:16:00.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:00 smithi133 ceph-mon[125939]: pgmap v12588: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 855 KiB/s rd, 832 KiB/s wr, 12 op/s 2023-05-08T10:16:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:00 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:16:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:00 smithi096 ceph-mon[124666]: pgmap v12588: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 855 KiB/s rd, 832 KiB/s wr, 12 op/s 2023-05-08T10:16:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:00 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:16:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:00 smithi186 ceph-mon[126480]: pgmap v12588: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 855 KiB/s rd, 832 KiB/s wr, 12 op/s 2023-05-08T10:16:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:00 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:16:01.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:16:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:16:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23499.946292 secs 2023-05-08T10:16:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:01 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:16:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:01 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:16:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:01 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:16:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:01 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:16:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:16:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:16:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23499.946292 secs 2023-05-08T10:16:01.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:01 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:16:01.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:01 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:16:01.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:01 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:16:01.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:01 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:16:01.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:16:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:16:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23499.946292 secs 2023-05-08T10:16:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:01 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:16:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:01 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:16:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:01 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:16:01.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:01 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:16:02.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:02 smithi133 ceph-mon[125939]: pgmap v12589: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 927 KiB/s rd, 916 KiB/s wr, 17 op/s 2023-05-08T10:16:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:02 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:16:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:02 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T10:16:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:02 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T10:16:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:02 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:16:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:02 smithi096 ceph-mon[124666]: pgmap v12589: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 927 KiB/s rd, 916 KiB/s wr, 17 op/s 2023-05-08T10:16:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:02 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:16:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:02 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T10:16:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:02 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T10:16:02.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:02 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:16:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:02 smithi186 ceph-mon[126480]: pgmap v12589: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 927 KiB/s rd, 916 KiB/s wr, 17 op/s 2023-05-08T10:16:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:02 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:16:02.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:02 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T10:16:02.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:02 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T10:16:02.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:02 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:16:04.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:04 smithi133 ceph-mon[125939]: pgmap v12590: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 461 KiB/s wr, 11 op/s 2023-05-08T10:16:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23503.103472 secs 2023-05-08T10:16:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23503.658969 secs 2023-05-08T10:16:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:04 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:16:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:04 smithi096 ceph-mon[124666]: pgmap v12590: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 461 KiB/s wr, 11 op/s 2023-05-08T10:16:04.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23503.103472 secs 2023-05-08T10:16:04.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23503.658969 secs 2023-05-08T10:16:04.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:04 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:16:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:04 smithi186 ceph-mon[126480]: pgmap v12590: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 461 KiB/s wr, 11 op/s 2023-05-08T10:16:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23503.103472 secs 2023-05-08T10:16:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23503.658969 secs 2023-05-08T10:16:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:04 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:16:06.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:06 smithi133 ceph-mon[125939]: pgmap v12591: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 818 KiB/s rd, 841 KiB/s wr, 30 op/s 2023-05-08T10:16:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23504.946392 secs 2023-05-08T10:16:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:06 smithi096 ceph-mon[124666]: pgmap v12591: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 818 KiB/s rd, 841 KiB/s wr, 30 op/s 2023-05-08T10:16:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23504.946392 secs 2023-05-08T10:16:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:06 smithi186 ceph-mon[126480]: pgmap v12591: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 818 KiB/s rd, 841 KiB/s wr, 30 op/s 2023-05-08T10:16:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23504.946392 secs 2023-05-08T10:16:07.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:07 smithi133 ceph-mon[125939]: osdmap e864: 12 total, 12 up, 12 in 2023-05-08T10:16:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:07 smithi096 ceph-mon[124666]: osdmap e864: 12 total, 12 up, 12 in 2023-05-08T10:16:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:07 smithi186 ceph-mon[126480]: osdmap e864: 12 total, 12 up, 12 in 2023-05-08T10:16:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:08 smithi133 ceph-mon[125939]: pgmap v12593: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 515 KiB/s rd, 556 KiB/s wr, 29 op/s 2023-05-08T10:16:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:08 smithi096 ceph-mon[124666]: pgmap v12593: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 515 KiB/s rd, 556 KiB/s wr, 29 op/s 2023-05-08T10:16:08.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:08 smithi186 ceph-mon[126480]: pgmap v12593: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 515 KiB/s rd, 556 KiB/s wr, 29 op/s 2023-05-08T10:16:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:16:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:16:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23508.103587 secs 2023-05-08T10:16:09.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23508.659089 secs 2023-05-08T10:16:09.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:09 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:16:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:16:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:16:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23508.103587 secs 2023-05-08T10:16:09.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23508.659089 secs 2023-05-08T10:16:09.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:09 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:16:09.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:16:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:16:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23508.103587 secs 2023-05-08T10:16:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23508.659089 secs 2023-05-08T10:16:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:09 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:16:10.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:10 smithi133 ceph-mon[125939]: pgmap v12594: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 515 KiB/s rd, 556 KiB/s wr, 29 op/s 2023-05-08T10:16:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:10 smithi096 ceph-mon[124666]: pgmap v12594: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 515 KiB/s rd, 556 KiB/s wr, 29 op/s 2023-05-08T10:16:10.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:10 smithi186 ceph-mon[126480]: pgmap v12594: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 515 KiB/s rd, 556 KiB/s wr, 29 op/s 2023-05-08T10:16:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23509.946506 secs 2023-05-08T10:16:11.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23509.946506 secs 2023-05-08T10:16:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23509.946506 secs 2023-05-08T10:16:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:12 smithi133 ceph-mon[125939]: pgmap v12595: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 504 KiB/s wr, 27 op/s 2023-05-08T10:16:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:12 smithi096 ceph-mon[124666]: pgmap v12595: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 504 KiB/s wr, 27 op/s 2023-05-08T10:16:12.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:12 smithi186 ceph-mon[126480]: pgmap v12595: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 504 KiB/s wr, 27 op/s 2023-05-08T10:16:14.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:14 smithi133 ceph-mon[125939]: pgmap v12596: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 504 KiB/s wr, 27 op/s 2023-05-08T10:16:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23513.103708 secs 2023-05-08T10:16:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23513.659205 secs 2023-05-08T10:16:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:14 smithi133 ceph-mon[125939]: osdmap e865: 12 total, 12 up, 12 in 2023-05-08T10:16:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:14 smithi096 ceph-mon[124666]: pgmap v12596: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 504 KiB/s wr, 27 op/s 2023-05-08T10:16:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23513.103708 secs 2023-05-08T10:16:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23513.659205 secs 2023-05-08T10:16:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:14 smithi096 ceph-mon[124666]: osdmap e865: 12 total, 12 up, 12 in 2023-05-08T10:16:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:14 smithi186 ceph-mon[126480]: pgmap v12596: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 504 KiB/s wr, 27 op/s 2023-05-08T10:16:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23513.103708 secs 2023-05-08T10:16:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23513.659205 secs 2023-05-08T10:16:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:14 smithi186 ceph-mon[126480]: osdmap e865: 12 total, 12 up, 12 in 2023-05-08T10:16:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:16 smithi133 ceph-mon[125939]: pgmap v12598: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 176 KiB/s wr, 8 op/s 2023-05-08T10:16:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23514.946611 secs 2023-05-08T10:16:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:16 smithi096 ceph-mon[124666]: pgmap v12598: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 176 KiB/s wr, 8 op/s 2023-05-08T10:16:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23514.946611 secs 2023-05-08T10:16:16.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:16 smithi186 ceph-mon[126480]: pgmap v12598: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 176 KiB/s wr, 8 op/s 2023-05-08T10:16:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23514.946611 secs 2023-05-08T10:16:18.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:18 smithi133 ceph-mon[125939]: pgmap v12599: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 157 KiB/s wr, 7 op/s 2023-05-08T10:16:18.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:18 smithi096 ceph-mon[124666]: pgmap v12599: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 157 KiB/s wr, 7 op/s 2023-05-08T10:16:18.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:18 smithi186 ceph-mon[126480]: pgmap v12599: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 157 KiB/s wr, 7 op/s 2023-05-08T10:16:19.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23518.103823 secs 2023-05-08T10:16:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23518.659343 secs 2023-05-08T10:16:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23518.103823 secs 2023-05-08T10:16:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23518.659343 secs 2023-05-08T10:16:19.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23518.103823 secs 2023-05-08T10:16:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23518.659343 secs 2023-05-08T10:16:20.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:20 smithi133 ceph-mon[125939]: pgmap v12600: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 157 KiB/s wr, 7 op/s 2023-05-08T10:16:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:20 smithi096 ceph-mon[124666]: pgmap v12600: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 157 KiB/s wr, 7 op/s 2023-05-08T10:16:20.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:20 smithi186 ceph-mon[126480]: pgmap v12600: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 157 KiB/s wr, 7 op/s 2023-05-08T10:16:21.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23519.946739 secs 2023-05-08T10:16:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23519.946739 secs 2023-05-08T10:16:21.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23519.946739 secs 2023-05-08T10:16:22.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:22 smithi133 ceph-mon[125939]: pgmap v12601: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 108 KiB/s wr, 6 op/s 2023-05-08T10:16:22.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:22 smithi096 ceph-mon[124666]: pgmap v12601: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 108 KiB/s wr, 6 op/s 2023-05-08T10:16:22.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:22 smithi186 ceph-mon[126480]: pgmap v12601: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 108 KiB/s wr, 6 op/s 2023-05-08T10:16:24.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:24 smithi133 ceph-mon[125939]: pgmap v12602: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 108 KiB/s wr, 6 op/s 2023-05-08T10:16:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23523.103953 secs 2023-05-08T10:16:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23523.659455 secs 2023-05-08T10:16:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:24 smithi096 ceph-mon[124666]: pgmap v12602: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 108 KiB/s wr, 6 op/s 2023-05-08T10:16:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23523.103953 secs 2023-05-08T10:16:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23523.659455 secs 2023-05-08T10:16:24.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:24 smithi186 ceph-mon[126480]: pgmap v12602: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 108 KiB/s wr, 6 op/s 2023-05-08T10:16:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23523.103953 secs 2023-05-08T10:16:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23523.659455 secs 2023-05-08T10:16:26.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:26 smithi133 ceph-mon[125939]: pgmap v12603: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 98 KiB/s wr, 8 op/s 2023-05-08T10:16:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23524.946861 secs 2023-05-08T10:16:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:26 smithi096 ceph-mon[124666]: pgmap v12603: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 98 KiB/s wr, 8 op/s 2023-05-08T10:16:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23524.946861 secs 2023-05-08T10:16:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:26 smithi186 ceph-mon[126480]: pgmap v12603: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 98 KiB/s wr, 8 op/s 2023-05-08T10:16:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23524.946861 secs 2023-05-08T10:16:28.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:28 smithi133 ceph-mon[125939]: pgmap v12604: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T10:16:28.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:28 smithi096 ceph-mon[124666]: pgmap v12604: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T10:16:28.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:28 smithi186 ceph-mon[126480]: pgmap v12604: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T10:16:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23528.104020 secs 2023-05-08T10:16:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23528.659573 secs 2023-05-08T10:16:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23528.104020 secs 2023-05-08T10:16:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23528.659573 secs 2023-05-08T10:16:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23528.104020 secs 2023-05-08T10:16:29.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23528.659573 secs 2023-05-08T10:16:30.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:30 smithi133 ceph-mon[125939]: pgmap v12605: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-05-08T10:16:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:30 smithi096 ceph-mon[124666]: pgmap v12605: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-05-08T10:16:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:30 smithi186 ceph-mon[126480]: pgmap v12605: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-05-08T10:16:31.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23529.947012 secs 2023-05-08T10:16:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23529.947012 secs 2023-05-08T10:16:31.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23529.947012 secs 2023-05-08T10:16:32.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:32 smithi133 ceph-mon[125939]: pgmap v12606: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7.8 KiB/s wr, 7 op/s 2023-05-08T10:16:32.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:32 smithi096 ceph-mon[124666]: pgmap v12606: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7.8 KiB/s wr, 7 op/s 2023-05-08T10:16:32.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:32 smithi186 ceph-mon[126480]: pgmap v12606: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7.8 KiB/s wr, 7 op/s 2023-05-08T10:16:34.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:34 smithi133 ceph-mon[125939]: pgmap v12607: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 7.8 KiB/s wr, 4 op/s 2023-05-08T10:16:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23533.104142 secs 2023-05-08T10:16:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23533.659653 secs 2023-05-08T10:16:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:34 smithi096 ceph-mon[124666]: pgmap v12607: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 7.8 KiB/s wr, 4 op/s 2023-05-08T10:16:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23533.104142 secs 2023-05-08T10:16:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23533.659653 secs 2023-05-08T10:16:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:34 smithi186 ceph-mon[126480]: pgmap v12607: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 7.8 KiB/s wr, 4 op/s 2023-05-08T10:16:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23533.104142 secs 2023-05-08T10:16:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23533.659653 secs 2023-05-08T10:16:36.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:36 smithi133 ceph-mon[125939]: pgmap v12608: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 78 KiB/s wr, 8 op/s 2023-05-08T10:16:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23534.947164 secs 2023-05-08T10:16:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:36 smithi096 ceph-mon[124666]: pgmap v12608: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 78 KiB/s wr, 8 op/s 2023-05-08T10:16:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23534.947164 secs 2023-05-08T10:16:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:36 smithi186 ceph-mon[126480]: pgmap v12608: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 78 KiB/s wr, 8 op/s 2023-05-08T10:16:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23534.947164 secs 2023-05-08T10:16:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:38 smithi096 ceph-mon[124666]: pgmap v12609: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 78 KiB/s wr, 6 op/s 2023-05-08T10:16:38.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:38 smithi186 ceph-mon[126480]: pgmap v12609: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 78 KiB/s wr, 6 op/s 2023-05-08T10:16:38.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:38 smithi133 ceph-mon[125939]: pgmap v12609: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 78 KiB/s wr, 6 op/s 2023-05-08T10:16:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23538.104265 secs 2023-05-08T10:16:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23538.659770 secs 2023-05-08T10:16:39.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23538.104265 secs 2023-05-08T10:16:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23538.659770 secs 2023-05-08T10:16:39.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23538.104265 secs 2023-05-08T10:16:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23538.659770 secs 2023-05-08T10:16:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:40 smithi096 ceph-mon[124666]: pgmap v12610: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 78 KiB/s wr, 7 op/s 2023-05-08T10:16:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:40 smithi186 ceph-mon[126480]: pgmap v12610: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 78 KiB/s wr, 7 op/s 2023-05-08T10:16:40.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:40 smithi133 ceph-mon[125939]: pgmap v12610: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 78 KiB/s wr, 7 op/s 2023-05-08T10:16:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:42 smithi096 ceph-mon[124666]: pgmap v12611: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 319 KiB/s rd, 252 KiB/s wr, 9 op/s 2023-05-08T10:16:42.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:42 smithi186 ceph-mon[126480]: pgmap v12611: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 319 KiB/s rd, 252 KiB/s wr, 9 op/s 2023-05-08T10:16:42.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:42 smithi133 ceph-mon[125939]: pgmap v12611: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 319 KiB/s rd, 252 KiB/s wr, 9 op/s 2023-05-08T10:16:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:44 smithi186 ceph-mon[126480]: pgmap v12612: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 245 KiB/s wr, 7 op/s 2023-05-08T10:16:44.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23543.104391 secs 2023-05-08T10:16:44.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:44 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:16:44.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23543.659882 secs 2023-05-08T10:16:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:44 smithi133 ceph-mon[125939]: pgmap v12612: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 245 KiB/s wr, 7 op/s 2023-05-08T10:16:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23543.104391 secs 2023-05-08T10:16:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:44 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:16:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23543.659882 secs 2023-05-08T10:16:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:44 smithi096 ceph-mon[124666]: pgmap v12612: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 245 KiB/s wr, 7 op/s 2023-05-08T10:16:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23543.104391 secs 2023-05-08T10:16:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:44 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:16:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23543.659882 secs 2023-05-08T10:16:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:45 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:16:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:45 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:16:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:45 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:16:45.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:45 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:16:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:45 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:16:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:45 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:16:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:45 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:16:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:45 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:16:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:45 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:16:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:46 smithi186 ceph-mon[126480]: pgmap v12613: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 245 KiB/s wr, 11 op/s 2023-05-08T10:16:46.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:46 smithi133 ceph-mon[125939]: pgmap v12613: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 245 KiB/s wr, 11 op/s 2023-05-08T10:16:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:46 smithi096 ceph-mon[124666]: pgmap v12613: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 245 KiB/s wr, 11 op/s 2023-05-08T10:16:48.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:48 smithi186 ceph-mon[126480]: pgmap v12614: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 335 KiB/s wr, 8 op/s 2023-05-08T10:16:48.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:48 smithi133 ceph-mon[125939]: pgmap v12614: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 335 KiB/s wr, 8 op/s 2023-05-08T10:16:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:48 smithi096 ceph-mon[124666]: pgmap v12614: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 335 KiB/s wr, 8 op/s 2023-05-08T10:16:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23548.104518 secs 2023-05-08T10:16:49.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23548.104518 secs 2023-05-08T10:16:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23548.104518 secs 2023-05-08T10:16:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:50 smithi186 ceph-mon[126480]: pgmap v12615: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 335 KiB/s wr, 8 op/s 2023-05-08T10:16:50.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:50 smithi133 ceph-mon[125939]: pgmap v12615: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 335 KiB/s wr, 8 op/s 2023-05-08T10:16:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:50 smithi096 ceph-mon[124666]: pgmap v12615: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 335 KiB/s wr, 8 op/s 2023-05-08T10:16:52.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:52 smithi186 ceph-mon[126480]: pgmap v12616: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 541 KiB/s wr, 11 op/s 2023-05-08T10:16:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:16:52.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:52 smithi133 ceph-mon[125939]: pgmap v12616: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 541 KiB/s wr, 11 op/s 2023-05-08T10:16:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:16:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:52 smithi096 ceph-mon[124666]: pgmap v12616: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 541 KiB/s wr, 11 op/s 2023-05-08T10:16:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:16:53.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:53 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:16:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:16:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:16:53.744 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:53 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:16:53.744 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:16:53.744 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:16:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:53 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:16:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:16:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:16:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:54 smithi186 ceph-mon[126480]: pgmap v12617: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 366 KiB/s wr, 8 op/s 2023-05-08T10:16:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23553.104620 secs 2023-05-08T10:16:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23553.660118 secs 2023-05-08T10:16:54.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:54 smithi133 ceph-mon[125939]: pgmap v12617: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 366 KiB/s wr, 8 op/s 2023-05-08T10:16:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23553.104620 secs 2023-05-08T10:16:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23553.660118 secs 2023-05-08T10:16:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:54 smithi096 ceph-mon[124666]: pgmap v12617: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 366 KiB/s wr, 8 op/s 2023-05-08T10:16:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23553.104620 secs 2023-05-08T10:16:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23553.660118 secs 2023-05-08T10:16:56.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:56 smithi186 ceph-mon[126480]: pgmap v12618: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 660 KiB/s rd, 748 KiB/s wr, 14 op/s 2023-05-08T10:16:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23554.947702 secs 2023-05-08T10:16:56.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:56 smithi133 ceph-mon[125939]: pgmap v12618: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 660 KiB/s rd, 748 KiB/s wr, 14 op/s 2023-05-08T10:16:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23554.947702 secs 2023-05-08T10:16:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:56 smithi096 ceph-mon[124666]: pgmap v12618: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 660 KiB/s rd, 748 KiB/s wr, 14 op/s 2023-05-08T10:16:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23554.947702 secs 2023-05-08T10:16:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:16:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:16:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:16:57.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:16:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:16:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:16:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:16:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:16:57.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:16:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:58 smithi186 ceph-mon[126480]: pgmap v12619: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 658 KiB/s rd, 748 KiB/s wr, 11 op/s 2023-05-08T10:16:58.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:58 smithi133 ceph-mon[125939]: pgmap v12619: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 658 KiB/s rd, 748 KiB/s wr, 11 op/s 2023-05-08T10:16:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:58 smithi096 ceph-mon[124666]: pgmap v12619: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 658 KiB/s rd, 748 KiB/s wr, 11 op/s 2023-05-08T10:16:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23558.104722 secs 2023-05-08T10:16:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:16:59 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:16:59.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23558.104722 secs 2023-05-08T10:16:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:16:59 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:16:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23558.104722 secs 2023-05-08T10:16:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:16:59 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:17:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:00 smithi186 ceph-mon[126480]: pgmap v12620: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 653 KiB/s rd, 588 KiB/s wr, 11 op/s 2023-05-08T10:17:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:00 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:17:00.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:00 smithi133 ceph-mon[125939]: pgmap v12620: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 653 KiB/s rd, 588 KiB/s wr, 11 op/s 2023-05-08T10:17:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:00 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:17:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:00 smithi096 ceph-mon[124666]: pgmap v12620: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 653 KiB/s rd, 588 KiB/s wr, 11 op/s 2023-05-08T10:17:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:00 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:17:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23559.947807 secs 2023-05-08T10:17:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:17:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:17:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:01 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:17:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23559.947807 secs 2023-05-08T10:17:01.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:17:01.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:17:01.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:01 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:17:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23559.947807 secs 2023-05-08T10:17:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:17:01.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:17:01.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:01 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:17:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:02 smithi186 ceph-mon[126480]: pgmap v12621: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 828 KiB/s rd, 671 KiB/s wr, 15 op/s 2023-05-08T10:17:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:02 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:17:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:02 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:17:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:02 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:17:02.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:02 smithi133 ceph-mon[125939]: pgmap v12621: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 828 KiB/s rd, 671 KiB/s wr, 15 op/s 2023-05-08T10:17:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:02 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:17:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:02 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:17:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:02 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:17:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:02 smithi096 ceph-mon[124666]: pgmap v12621: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 828 KiB/s rd, 671 KiB/s wr, 15 op/s 2023-05-08T10:17:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:02 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:17:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:02 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:17:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:02 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:17:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:03 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:17:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:03 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T10:17:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:03 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T10:17:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:03 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:17:03.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:03 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:17:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:03 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T10:17:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:03 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T10:17:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:03 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:17:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:03 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:17:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:03 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T10:17:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:03 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T10:17:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:03 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:17:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:04 smithi186 ceph-mon[126480]: pgmap v12622: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 465 KiB/s wr, 11 op/s 2023-05-08T10:17:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23563.104865 secs 2023-05-08T10:17:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23563.660356 secs 2023-05-08T10:17:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:04 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:17:04.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:04 smithi133 ceph-mon[125939]: pgmap v12622: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 465 KiB/s wr, 11 op/s 2023-05-08T10:17:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23563.104865 secs 2023-05-08T10:17:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23563.660356 secs 2023-05-08T10:17:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:04 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:17:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:04 smithi096 ceph-mon[124666]: pgmap v12622: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 465 KiB/s wr, 11 op/s 2023-05-08T10:17:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23563.104865 secs 2023-05-08T10:17:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23563.660356 secs 2023-05-08T10:17:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:04 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:17:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:06 smithi186 ceph-mon[126480]: pgmap v12623: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 846 KiB/s wr, 30 op/s 2023-05-08T10:17:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23564.947922 secs 2023-05-08T10:17:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:06 smithi186 ceph-mon[126480]: osdmap e866: 12 total, 12 up, 12 in 2023-05-08T10:17:06.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:06 smithi133 ceph-mon[125939]: pgmap v12623: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 846 KiB/s wr, 30 op/s 2023-05-08T10:17:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23564.947922 secs 2023-05-08T10:17:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:06 smithi133 ceph-mon[125939]: osdmap e866: 12 total, 12 up, 12 in 2023-05-08T10:17:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:06 smithi096 ceph-mon[124666]: pgmap v12623: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 846 KiB/s wr, 30 op/s 2023-05-08T10:17:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23564.947922 secs 2023-05-08T10:17:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:06 smithi096 ceph-mon[124666]: osdmap e866: 12 total, 12 up, 12 in 2023-05-08T10:17:08.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:08 smithi186 ceph-mon[126480]: pgmap v12625: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 557 KiB/s wr, 29 op/s 2023-05-08T10:17:08.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:08 smithi133 ceph-mon[125939]: pgmap v12625: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 557 KiB/s wr, 29 op/s 2023-05-08T10:17:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:08 smithi096 ceph-mon[124666]: pgmap v12625: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 557 KiB/s wr, 29 op/s 2023-05-08T10:17:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:17:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:17:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23568.104968 secs 2023-05-08T10:17:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23568.660488 secs 2023-05-08T10:17:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:09 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:17:09.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:17:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:17:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23568.104968 secs 2023-05-08T10:17:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23568.660488 secs 2023-05-08T10:17:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:09 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:17:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:17:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:17:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23568.104968 secs 2023-05-08T10:17:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23568.660488 secs 2023-05-08T10:17:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:09 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:17:10.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:10 smithi186 ceph-mon[126480]: pgmap v12626: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 557 KiB/s wr, 28 op/s 2023-05-08T10:17:10.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:10 smithi133 ceph-mon[125939]: pgmap v12626: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 557 KiB/s wr, 28 op/s 2023-05-08T10:17:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:10 smithi096 ceph-mon[124666]: pgmap v12626: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 557 KiB/s wr, 28 op/s 2023-05-08T10:17:11.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23569.948044 secs 2023-05-08T10:17:11.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23569.948044 secs 2023-05-08T10:17:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23569.948044 secs 2023-05-08T10:17:12.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:12 smithi186 ceph-mon[126480]: pgmap v12627: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 505 KiB/s wr, 27 op/s 2023-05-08T10:17:12.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:12 smithi133 ceph-mon[125939]: pgmap v12627: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 505 KiB/s wr, 27 op/s 2023-05-08T10:17:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:12 smithi096 ceph-mon[124666]: pgmap v12627: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 505 KiB/s wr, 27 op/s 2023-05-08T10:17:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:14 smithi186 ceph-mon[126480]: pgmap v12628: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 505 KiB/s wr, 27 op/s 2023-05-08T10:17:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23573.105115 secs 2023-05-08T10:17:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23573.660557 secs 2023-05-08T10:17:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:14 smithi186 ceph-mon[126480]: osdmap e867: 12 total, 12 up, 12 in 2023-05-08T10:17:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:14 smithi133 ceph-mon[125939]: pgmap v12628: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 505 KiB/s wr, 27 op/s 2023-05-08T10:17:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23573.105115 secs 2023-05-08T10:17:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23573.660557 secs 2023-05-08T10:17:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:14 smithi133 ceph-mon[125939]: osdmap e867: 12 total, 12 up, 12 in 2023-05-08T10:17:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:14 smithi096 ceph-mon[124666]: pgmap v12628: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 505 KiB/s wr, 27 op/s 2023-05-08T10:17:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23573.105115 secs 2023-05-08T10:17:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23573.660557 secs 2023-05-08T10:17:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:14 smithi096 ceph-mon[124666]: osdmap e867: 12 total, 12 up, 12 in 2023-05-08T10:17:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:16 smithi186 ceph-mon[126480]: pgmap v12630: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 162 KiB/s wr, 8 op/s 2023-05-08T10:17:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23574.948162 secs 2023-05-08T10:17:16.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:16 smithi133 ceph-mon[125939]: pgmap v12630: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 162 KiB/s wr, 8 op/s 2023-05-08T10:17:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23574.948162 secs 2023-05-08T10:17:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:16 smithi096 ceph-mon[124666]: pgmap v12630: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 162 KiB/s wr, 8 op/s 2023-05-08T10:17:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23574.948162 secs 2023-05-08T10:17:18.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:18 smithi186 ceph-mon[126480]: pgmap v12631: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 157 KiB/s wr, 8 op/s 2023-05-08T10:17:18.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:18 smithi133 ceph-mon[125939]: pgmap v12631: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 157 KiB/s wr, 8 op/s 2023-05-08T10:17:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:18 smithi096 ceph-mon[124666]: pgmap v12631: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 157 KiB/s wr, 8 op/s 2023-05-08T10:17:19.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23578.105213 secs 2023-05-08T10:17:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23578.660675 secs 2023-05-08T10:17:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23578.105213 secs 2023-05-08T10:17:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23578.660675 secs 2023-05-08T10:17:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23578.105213 secs 2023-05-08T10:17:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23578.660675 secs 2023-05-08T10:17:20.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:20 smithi133 ceph-mon[125939]: pgmap v12632: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 157 KiB/s wr, 10 op/s 2023-05-08T10:17:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:20 smithi096 ceph-mon[124666]: pgmap v12632: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 157 KiB/s wr, 10 op/s 2023-05-08T10:17:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:20 smithi186 ceph-mon[126480]: pgmap v12632: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 157 KiB/s wr, 10 op/s 2023-05-08T10:17:21.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23579.948248 secs 2023-05-08T10:17:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23579.948248 secs 2023-05-08T10:17:21.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23579.948248 secs 2023-05-08T10:17:22.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:22 smithi133 ceph-mon[125939]: pgmap v12633: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 109 KiB/s wr, 7 op/s 2023-05-08T10:17:22.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:22 smithi096 ceph-mon[124666]: pgmap v12633: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 109 KiB/s wr, 7 op/s 2023-05-08T10:17:22.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:22 smithi186 ceph-mon[126480]: pgmap v12633: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 109 KiB/s wr, 7 op/s 2023-05-08T10:17:24.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:24 smithi133 ceph-mon[125939]: pgmap v12634: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 109 KiB/s wr, 7 op/s 2023-05-08T10:17:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23583.105329 secs 2023-05-08T10:17:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23583.660758 secs 2023-05-08T10:17:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:24 smithi096 ceph-mon[124666]: pgmap v12634: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 109 KiB/s wr, 7 op/s 2023-05-08T10:17:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23583.105329 secs 2023-05-08T10:17:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23583.660758 secs 2023-05-08T10:17:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:24 smithi186 ceph-mon[126480]: pgmap v12634: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 109 KiB/s wr, 7 op/s 2023-05-08T10:17:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23583.105329 secs 2023-05-08T10:17:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23583.660758 secs 2023-05-08T10:17:26.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:26 smithi133 ceph-mon[125939]: pgmap v12635: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 99 KiB/s wr, 9 op/s 2023-05-08T10:17:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23584.948363 secs 2023-05-08T10:17:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:26 smithi096 ceph-mon[124666]: pgmap v12635: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 99 KiB/s wr, 9 op/s 2023-05-08T10:17:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23584.948363 secs 2023-05-08T10:17:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:26 smithi186 ceph-mon[126480]: pgmap v12635: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 99 KiB/s wr, 9 op/s 2023-05-08T10:17:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23584.948363 secs 2023-05-08T10:17:28.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:28 smithi133 ceph-mon[125939]: pgmap v12636: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:17:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:28 smithi096 ceph-mon[124666]: pgmap v12636: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:17:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:28 smithi186 ceph-mon[126480]: pgmap v12636: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:17:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23588.105438 secs 2023-05-08T10:17:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23588.660875 secs 2023-05-08T10:17:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23588.105438 secs 2023-05-08T10:17:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23588.660875 secs 2023-05-08T10:17:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23588.105438 secs 2023-05-08T10:17:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23588.660875 secs 2023-05-08T10:17:30.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:30 smithi133 ceph-mon[125939]: pgmap v12637: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T10:17:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23589.948485 secs 2023-05-08T10:17:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:30 smithi096 ceph-mon[124666]: pgmap v12637: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T10:17:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23589.948485 secs 2023-05-08T10:17:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:30 smithi186 ceph-mon[126480]: pgmap v12637: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T10:17:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23589.948485 secs 2023-05-08T10:17:32.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:32 smithi133 ceph-mon[125939]: pgmap v12638: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 7 op/s 2023-05-08T10:17:32.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:32 smithi096 ceph-mon[124666]: pgmap v12638: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 7 op/s 2023-05-08T10:17:32.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:32 smithi186 ceph-mon[126480]: pgmap v12638: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 7 op/s 2023-05-08T10:17:34.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:34 smithi133 ceph-mon[125939]: pgmap v12639: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:17:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23593.105560 secs 2023-05-08T10:17:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23593.661024 secs 2023-05-08T10:17:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:34 smithi096 ceph-mon[124666]: pgmap v12639: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:17:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23593.105560 secs 2023-05-08T10:17:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23593.661024 secs 2023-05-08T10:17:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:34 smithi186 ceph-mon[126480]: pgmap v12639: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:17:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23593.105560 secs 2023-05-08T10:17:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23593.661024 secs 2023-05-08T10:17:35.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23594.948620 secs 2023-05-08T10:17:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23594.948620 secs 2023-05-08T10:17:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23594.948620 secs 2023-05-08T10:17:36.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:36 smithi133 ceph-mon[125939]: pgmap v12640: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 9 op/s 2023-05-08T10:17:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:36 smithi096 ceph-mon[124666]: pgmap v12640: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 9 op/s 2023-05-08T10:17:36.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:36 smithi186 ceph-mon[126480]: pgmap v12640: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 9 op/s 2023-05-08T10:17:38.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:38 smithi133 ceph-mon[125939]: pgmap v12641: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T10:17:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:38 smithi096 ceph-mon[124666]: pgmap v12641: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T10:17:38.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:38 smithi186 ceph-mon[126480]: pgmap v12641: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T10:17:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23598.105657 secs 2023-05-08T10:17:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23598.661133 secs 2023-05-08T10:17:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23598.105657 secs 2023-05-08T10:17:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23598.661133 secs 2023-05-08T10:17:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23598.105657 secs 2023-05-08T10:17:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23598.661133 secs 2023-05-08T10:17:40.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:40 smithi133 ceph-mon[125939]: pgmap v12642: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 597 B/s wr, 8 op/s 2023-05-08T10:17:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:40 smithi096 ceph-mon[124666]: pgmap v12642: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 597 B/s wr, 8 op/s 2023-05-08T10:17:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:40 smithi186 ceph-mon[126480]: pgmap v12642: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 597 B/s wr, 8 op/s 2023-05-08T10:17:42.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:42 smithi133 ceph-mon[125939]: pgmap v12643: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 KiB/s wr, 8 op/s 2023-05-08T10:17:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:42 smithi096 ceph-mon[124666]: pgmap v12643: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 KiB/s wr, 8 op/s 2023-05-08T10:17:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:42 smithi186 ceph-mon[126480]: pgmap v12643: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 KiB/s wr, 8 op/s 2023-05-08T10:17:44.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:44 smithi133 ceph-mon[125939]: pgmap v12644: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 KiB/s wr, 7 op/s 2023-05-08T10:17:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23603.105772 secs 2023-05-08T10:17:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:44 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:17:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23603.661259 secs 2023-05-08T10:17:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:44 smithi096 ceph-mon[124666]: pgmap v12644: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 KiB/s wr, 7 op/s 2023-05-08T10:17:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23603.105772 secs 2023-05-08T10:17:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:44 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:17:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23603.661259 secs 2023-05-08T10:17:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:44 smithi186 ceph-mon[126480]: pgmap v12644: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 KiB/s wr, 7 op/s 2023-05-08T10:17:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23603.105772 secs 2023-05-08T10:17:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:44 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:17:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23603.661259 secs 2023-05-08T10:17:45.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:45 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:17:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:45 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:17:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:45 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:17:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:45 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:17:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:45 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:17:45.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:45 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:17:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:45 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:17:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:45 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:17:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:45 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:17:46.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:46 smithi133 ceph-mon[125939]: pgmap v12645: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 177 KiB/s wr, 11 op/s 2023-05-08T10:17:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:46 smithi096 ceph-mon[124666]: pgmap v12645: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 177 KiB/s wr, 11 op/s 2023-05-08T10:17:46.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:46 smithi186 ceph-mon[126480]: pgmap v12645: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 177 KiB/s wr, 11 op/s 2023-05-08T10:17:48.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:48 smithi133 ceph-mon[125939]: pgmap v12646: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 176 KiB/s wr, 7 op/s 2023-05-08T10:17:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:48 smithi096 ceph-mon[124666]: pgmap v12646: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 176 KiB/s wr, 7 op/s 2023-05-08T10:17:48.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:48 smithi186 ceph-mon[126480]: pgmap v12646: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 176 KiB/s wr, 7 op/s 2023-05-08T10:17:49.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23608.105863 secs 2023-05-08T10:17:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23608.105863 secs 2023-05-08T10:17:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23608.105863 secs 2023-05-08T10:17:50.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:50 smithi133 ceph-mon[125939]: pgmap v12647: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 190 KiB/s wr, 9 op/s 2023-05-08T10:17:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:50 smithi096 ceph-mon[124666]: pgmap v12647: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 190 KiB/s wr, 9 op/s 2023-05-08T10:17:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:50 smithi186 ceph-mon[126480]: pgmap v12647: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 190 KiB/s wr, 9 op/s 2023-05-08T10:17:51.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:51 smithi133 ceph-mon[125939]: pgmap v12648: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 468 KiB/s rd, 466 KiB/s wr, 10 op/s 2023-05-08T10:17:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:51 smithi096 ceph-mon[124666]: pgmap v12648: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 468 KiB/s rd, 466 KiB/s wr, 10 op/s 2023-05-08T10:17:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:51 smithi186 ceph-mon[126480]: pgmap v12648: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 468 KiB/s rd, 466 KiB/s wr, 10 op/s 2023-05-08T10:17:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:17:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:17:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:17:53.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:53 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:17:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:17:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:17:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:53 smithi133 ceph-mon[125939]: pgmap v12649: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 467 KiB/s rd, 296 KiB/s wr, 8 op/s 2023-05-08T10:17:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:53 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:17:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:17:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:17:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:53 smithi096 ceph-mon[124666]: pgmap v12649: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 467 KiB/s rd, 296 KiB/s wr, 8 op/s 2023-05-08T10:17:53.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:53 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:17:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:17:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:17:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:53 smithi186 ceph-mon[126480]: pgmap v12649: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 467 KiB/s rd, 296 KiB/s wr, 8 op/s 2023-05-08T10:17:54.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23613.105998 secs 2023-05-08T10:17:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23613.661517 secs 2023-05-08T10:17:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23613.105998 secs 2023-05-08T10:17:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23613.661517 secs 2023-05-08T10:17:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23613.105998 secs 2023-05-08T10:17:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23613.661517 secs 2023-05-08T10:17:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:55 smithi133 ceph-mon[125939]: pgmap v12650: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 590 KiB/s rd, 511 KiB/s wr, 14 op/s 2023-05-08T10:17:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23614.949068 secs 2023-05-08T10:17:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:55 smithi096 ceph-mon[124666]: pgmap v12650: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 590 KiB/s rd, 511 KiB/s wr, 14 op/s 2023-05-08T10:17:55.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23614.949068 secs 2023-05-08T10:17:55.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:55 smithi186 ceph-mon[126480]: pgmap v12650: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 590 KiB/s rd, 511 KiB/s wr, 14 op/s 2023-05-08T10:17:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23614.949068 secs 2023-05-08T10:17:57.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:17:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:17:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:17:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:57 smithi133 ceph-mon[125939]: pgmap v12651: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 505 KiB/s wr, 10 op/s 2023-05-08T10:17:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:17:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:17:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:17:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:57 smithi096 ceph-mon[124666]: pgmap v12651: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 505 KiB/s wr, 10 op/s 2023-05-08T10:17:57.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:17:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:17:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:17:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:57 smithi186 ceph-mon[126480]: pgmap v12651: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 505 KiB/s wr, 10 op/s 2023-05-08T10:17:58.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23618.106131 secs 2023-05-08T10:17:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23618.106131 secs 2023-05-08T10:17:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23618.106131 secs 2023-05-08T10:17:59.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:59 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:17:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:17:59 smithi133 ceph-mon[125939]: pgmap v12652: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 519 KiB/s wr, 13 op/s 2023-05-08T10:18:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:59 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:18:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:17:59 smithi096 ceph-mon[124666]: pgmap v12652: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 519 KiB/s wr, 13 op/s 2023-05-08T10:18:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:59 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:18:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:17:59 smithi186 ceph-mon[126480]: pgmap v12652: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 519 KiB/s wr, 13 op/s 2023-05-08T10:18:00.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:00 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:18:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23619.949210 secs 2023-05-08T10:18:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:00 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:18:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23619.949210 secs 2023-05-08T10:18:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:00 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:18:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23619.949210 secs 2023-05-08T10:18:01.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:18:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:18:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:01 smithi133 ceph-mon[125939]: pgmap v12653: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 688 KiB/s wr, 13 op/s 2023-05-08T10:18:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:18:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:18:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:01 smithi096 ceph-mon[124666]: pgmap v12653: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 688 KiB/s wr, 13 op/s 2023-05-08T10:18:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:18:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:18:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:01 smithi186 ceph-mon[126480]: pgmap v12653: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 688 KiB/s wr, 13 op/s 2023-05-08T10:18:02.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:02 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:18:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:02 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:18:03.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:02 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:18:03.816 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:03 smithi133 ceph-mon[125939]: pgmap v12654: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 412 KiB/s wr, 11 op/s 2023-05-08T10:18:03.816 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23623.106277 secs 2023-05-08T10:18:03.923 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:03 smithi096 ceph-mon[124666]: pgmap v12654: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 412 KiB/s wr, 11 op/s 2023-05-08T10:18:03.924 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23623.106277 secs 2023-05-08T10:18:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:03 smithi186 ceph-mon[126480]: pgmap v12654: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 412 KiB/s wr, 11 op/s 2023-05-08T10:18:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23623.106277 secs 2023-05-08T10:18:04.966 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23623.661669 secs 2023-05-08T10:18:04.967 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:04 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:18:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23623.661669 secs 2023-05-08T10:18:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:04 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:18:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23623.661669 secs 2023-05-08T10:18:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:04 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:18:06.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:06 smithi133 ceph-mon[125939]: pgmap v12655: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 532 KiB/s rd, 657 KiB/s wr, 30 op/s 2023-05-08T10:18:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23624.949322 secs 2023-05-08T10:18:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:06 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:18:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:06 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:18:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:06 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:18:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:06 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:18:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:06 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:18:06.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:06 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:18:06.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:06 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:18:06.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:06 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:18:06.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:06 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T10:18:06.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:06 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T10:18:06.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:06 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:18:06.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:06 smithi133 ceph-mon[125939]: osdmap e868: 12 total, 12 up, 12 in 2023-05-08T10:18:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:06 smithi096 ceph-mon[124666]: pgmap v12655: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 532 KiB/s rd, 657 KiB/s wr, 30 op/s 2023-05-08T10:18:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23624.949322 secs 2023-05-08T10:18:06.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:06 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:18:06.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:06 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:18:06.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:06 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:18:06.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:06 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:18:06.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:06 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:18:06.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:06 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:18:06.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:06 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:18:06.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:06 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:18:06.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:06 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T10:18:06.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:06 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T10:18:06.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:06 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:18:06.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:06 smithi096 ceph-mon[124666]: osdmap e868: 12 total, 12 up, 12 in 2023-05-08T10:18:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:06 smithi186 ceph-mon[126480]: pgmap v12655: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 532 KiB/s rd, 657 KiB/s wr, 30 op/s 2023-05-08T10:18:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23624.949322 secs 2023-05-08T10:18:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:06 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:18:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:06 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:18:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:06 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:18:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:06 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:18:06.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:06 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:18:06.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:06 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:18:06.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:06 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:18:06.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:06 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:18:06.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:06 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T10:18:06.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:06 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T10:18:06.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:06 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:18:06.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:06 smithi186 ceph-mon[126480]: osdmap e868: 12 total, 12 up, 12 in 2023-05-08T10:18:08.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:08 smithi133 ceph-mon[125939]: pgmap v12657: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 491 KiB/s rd, 530 KiB/s wr, 29 op/s 2023-05-08T10:18:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:08 smithi096 ceph-mon[124666]: pgmap v12657: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 491 KiB/s rd, 530 KiB/s wr, 29 op/s 2023-05-08T10:18:08.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:08 smithi186 ceph-mon[126480]: pgmap v12657: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 491 KiB/s rd, 530 KiB/s wr, 29 op/s 2023-05-08T10:18:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:18:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:18:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23628.106386 secs 2023-05-08T10:18:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23628.661789 secs 2023-05-08T10:18:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:09 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:18:09.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:18:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:18:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23628.106386 secs 2023-05-08T10:18:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23628.661789 secs 2023-05-08T10:18:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:09 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:18:09.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:18:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:18:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23628.106386 secs 2023-05-08T10:18:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23628.661789 secs 2023-05-08T10:18:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:09 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:18:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:10 smithi096 ceph-mon[124666]: pgmap v12658: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 691 KiB/s rd, 711 KiB/s wr, 29 op/s 2023-05-08T10:18:10.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:10 smithi186 ceph-mon[126480]: pgmap v12658: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 691 KiB/s rd, 711 KiB/s wr, 29 op/s 2023-05-08T10:18:10.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:10 smithi133 ceph-mon[125939]: pgmap v12658: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 691 KiB/s rd, 711 KiB/s wr, 29 op/s 2023-05-08T10:18:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23629.949441 secs 2023-05-08T10:18:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23629.949441 secs 2023-05-08T10:18:11.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23629.949441 secs 2023-05-08T10:18:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:12 smithi096 ceph-mon[124666]: pgmap v12659: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 492 KiB/s wr, 27 op/s 2023-05-08T10:18:12.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:12 smithi186 ceph-mon[126480]: pgmap v12659: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 492 KiB/s wr, 27 op/s 2023-05-08T10:18:12.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:12 smithi133 ceph-mon[125939]: pgmap v12659: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 492 KiB/s wr, 27 op/s 2023-05-08T10:18:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:14 smithi186 ceph-mon[126480]: pgmap v12660: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 492 KiB/s wr, 27 op/s 2023-05-08T10:18:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23633.106506 secs 2023-05-08T10:18:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23633.661928 secs 2023-05-08T10:18:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:14 smithi186 ceph-mon[126480]: osdmap e869: 12 total, 12 up, 12 in 2023-05-08T10:18:14.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:14 smithi133 ceph-mon[125939]: pgmap v12660: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 492 KiB/s wr, 27 op/s 2023-05-08T10:18:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23633.106506 secs 2023-05-08T10:18:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23633.661928 secs 2023-05-08T10:18:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:14 smithi133 ceph-mon[125939]: osdmap e869: 12 total, 12 up, 12 in 2023-05-08T10:18:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:14 smithi096 ceph-mon[124666]: pgmap v12660: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 492 KiB/s wr, 27 op/s 2023-05-08T10:18:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23633.106506 secs 2023-05-08T10:18:14.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23633.661928 secs 2023-05-08T10:18:14.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:14 smithi096 ceph-mon[124666]: osdmap e869: 12 total, 12 up, 12 in 2023-05-08T10:18:16.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:16 smithi186 ceph-mon[126480]: pgmap v12662: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 295 KiB/s wr, 8 op/s 2023-05-08T10:18:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23634.949556 secs 2023-05-08T10:18:16.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:16 smithi133 ceph-mon[125939]: pgmap v12662: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 295 KiB/s wr, 8 op/s 2023-05-08T10:18:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23634.949556 secs 2023-05-08T10:18:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:16 smithi096 ceph-mon[124666]: pgmap v12662: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 295 KiB/s wr, 8 op/s 2023-05-08T10:18:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23634.949556 secs 2023-05-08T10:18:18.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:18 smithi186 ceph-mon[126480]: pgmap v12663: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 276 KiB/s wr, 7 op/s 2023-05-08T10:18:18.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:18 smithi133 ceph-mon[125939]: pgmap v12663: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 276 KiB/s wr, 7 op/s 2023-05-08T10:18:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:18 smithi096 ceph-mon[124666]: pgmap v12663: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 276 KiB/s wr, 7 op/s 2023-05-08T10:18:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23638.106625 secs 2023-05-08T10:18:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23638.662056 secs 2023-05-08T10:18:19.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23638.106625 secs 2023-05-08T10:18:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23638.662056 secs 2023-05-08T10:18:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23638.106625 secs 2023-05-08T10:18:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23638.662056 secs 2023-05-08T10:18:20.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:20 smithi186 ceph-mon[126480]: pgmap v12664: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 140 KiB/s wr, 7 op/s 2023-05-08T10:18:20.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:20 smithi133 ceph-mon[125939]: pgmap v12664: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 140 KiB/s wr, 7 op/s 2023-05-08T10:18:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:20 smithi096 ceph-mon[124666]: pgmap v12664: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 140 KiB/s wr, 7 op/s 2023-05-08T10:18:21.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23639.949698 secs 2023-05-08T10:18:21.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23639.949698 secs 2023-05-08T10:18:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23639.949698 secs 2023-05-08T10:18:22.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:22 smithi186 ceph-mon[126480]: pgmap v12665: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 140 KiB/s wr, 6 op/s 2023-05-08T10:18:22.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:22 smithi133 ceph-mon[125939]: pgmap v12665: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 140 KiB/s wr, 6 op/s 2023-05-08T10:18:22.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:22 smithi096 ceph-mon[124666]: pgmap v12665: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 140 KiB/s wr, 6 op/s 2023-05-08T10:18:24.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:24 smithi186 ceph-mon[126480]: pgmap v12666: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 140 KiB/s wr, 6 op/s 2023-05-08T10:18:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23643.106747 secs 2023-05-08T10:18:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23643.662177 secs 2023-05-08T10:18:24.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:24 smithi133 ceph-mon[125939]: pgmap v12666: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 140 KiB/s wr, 6 op/s 2023-05-08T10:18:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23643.106747 secs 2023-05-08T10:18:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23643.662177 secs 2023-05-08T10:18:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:24 smithi096 ceph-mon[124666]: pgmap v12666: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 140 KiB/s wr, 6 op/s 2023-05-08T10:18:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23643.106747 secs 2023-05-08T10:18:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23643.662177 secs 2023-05-08T10:18:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:26 smithi186 ceph-mon[126480]: pgmap v12667: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 56 KiB/s wr, 6 op/s 2023-05-08T10:18:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23644.949813 secs 2023-05-08T10:18:26.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:26 smithi133 ceph-mon[125939]: pgmap v12667: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 56 KiB/s wr, 6 op/s 2023-05-08T10:18:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23644.949813 secs 2023-05-08T10:18:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:26 smithi096 ceph-mon[124666]: pgmap v12667: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 56 KiB/s wr, 6 op/s 2023-05-08T10:18:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23644.949813 secs 2023-05-08T10:18:28.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:28 smithi186 ceph-mon[126480]: pgmap v12668: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 KiB/s wr, 5 op/s 2023-05-08T10:18:28.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:28 smithi133 ceph-mon[125939]: pgmap v12668: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 KiB/s wr, 5 op/s 2023-05-08T10:18:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:28 smithi096 ceph-mon[124666]: pgmap v12668: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 KiB/s wr, 5 op/s 2023-05-08T10:18:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23648.106886 secs 2023-05-08T10:18:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23648.662321 secs 2023-05-08T10:18:29.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23648.106886 secs 2023-05-08T10:18:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23648.662321 secs 2023-05-08T10:18:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23648.106886 secs 2023-05-08T10:18:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23648.662321 secs 2023-05-08T10:18:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:30 smithi186 ceph-mon[126480]: pgmap v12669: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 52 KiB/s wr, 7 op/s 2023-05-08T10:18:30.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:30 smithi133 ceph-mon[125939]: pgmap v12669: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 52 KiB/s wr, 7 op/s 2023-05-08T10:18:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:30 smithi096 ceph-mon[124666]: pgmap v12669: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 52 KiB/s wr, 7 op/s 2023-05-08T10:18:31.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23649.949952 secs 2023-05-08T10:18:31.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23649.949952 secs 2023-05-08T10:18:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23649.949952 secs 2023-05-08T10:18:32.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:32 smithi186 ceph-mon[126480]: pgmap v12670: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:18:32.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:32 smithi133 ceph-mon[125939]: pgmap v12670: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:18:32.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:32 smithi096 ceph-mon[124666]: pgmap v12670: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:18:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:34 smithi186 ceph-mon[126480]: pgmap v12671: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:18:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23653.107021 secs 2023-05-08T10:18:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23653.662450 secs 2023-05-08T10:18:34.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:34 smithi133 ceph-mon[125939]: pgmap v12671: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:18:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23653.107021 secs 2023-05-08T10:18:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23653.662450 secs 2023-05-08T10:18:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:34 smithi096 ceph-mon[124666]: pgmap v12671: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:18:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23653.107021 secs 2023-05-08T10:18:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23653.662450 secs 2023-05-08T10:18:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:36 smithi186 ceph-mon[126480]: pgmap v12672: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 78 KiB/s wr, 9 op/s 2023-05-08T10:18:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23654.950075 secs 2023-05-08T10:18:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:36 smithi133 ceph-mon[125939]: pgmap v12672: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 78 KiB/s wr, 9 op/s 2023-05-08T10:18:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23654.950075 secs 2023-05-08T10:18:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:36 smithi096 ceph-mon[124666]: pgmap v12672: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 78 KiB/s wr, 9 op/s 2023-05-08T10:18:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23654.950075 secs 2023-05-08T10:18:38.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:38 smithi186 ceph-mon[126480]: pgmap v12673: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 78 KiB/s wr, 6 op/s 2023-05-08T10:18:38.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:38 smithi133 ceph-mon[125939]: pgmap v12673: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 78 KiB/s wr, 6 op/s 2023-05-08T10:18:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:38 smithi096 ceph-mon[124666]: pgmap v12673: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 78 KiB/s wr, 6 op/s 2023-05-08T10:18:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23658.107136 secs 2023-05-08T10:18:39.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23658.662573 secs 2023-05-08T10:18:39.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23658.107136 secs 2023-05-08T10:18:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23658.662573 secs 2023-05-08T10:18:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23658.107136 secs 2023-05-08T10:18:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23658.662573 secs 2023-05-08T10:18:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:40 smithi186 ceph-mon[126480]: pgmap v12674: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 249 KiB/s wr, 9 op/s 2023-05-08T10:18:40.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:40 smithi133 ceph-mon[125939]: pgmap v12674: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 249 KiB/s wr, 9 op/s 2023-05-08T10:18:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:40 smithi096 ceph-mon[124666]: pgmap v12674: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 249 KiB/s wr, 9 op/s 2023-05-08T10:18:42.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:42 smithi186 ceph-mon[126480]: pgmap v12675: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 249 KiB/s wr, 7 op/s 2023-05-08T10:18:42.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:42 smithi133 ceph-mon[125939]: pgmap v12675: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 249 KiB/s wr, 7 op/s 2023-05-08T10:18:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:42 smithi096 ceph-mon[124666]: pgmap v12675: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 249 KiB/s wr, 7 op/s 2023-05-08T10:18:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:44 smithi186 ceph-mon[126480]: pgmap v12676: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 249 KiB/s wr, 7 op/s 2023-05-08T10:18:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23663.107192 secs 2023-05-08T10:18:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:44 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:18:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23663.662634 secs 2023-05-08T10:18:44.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:44 smithi133 ceph-mon[125939]: pgmap v12676: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 249 KiB/s wr, 7 op/s 2023-05-08T10:18:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23663.107192 secs 2023-05-08T10:18:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:44 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:18:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23663.662634 secs 2023-05-08T10:18:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:44 smithi096 ceph-mon[124666]: pgmap v12676: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 249 KiB/s wr, 7 op/s 2023-05-08T10:18:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23663.107192 secs 2023-05-08T10:18:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:44 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:18:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23663.662634 secs 2023-05-08T10:18:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:45 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:18:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:45 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:18:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:45 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:18:45.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:45 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:18:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:45 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:18:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:45 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:18:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:45 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:18:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:45 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:18:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:45 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:18:46.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:46 smithi186 ceph-mon[126480]: pgmap v12677: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 255 KiB/s wr, 11 op/s 2023-05-08T10:18:46.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:46 smithi133 ceph-mon[125939]: pgmap v12677: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 255 KiB/s wr, 11 op/s 2023-05-08T10:18:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:46 smithi096 ceph-mon[124666]: pgmap v12677: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 255 KiB/s wr, 11 op/s 2023-05-08T10:18:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:48 smithi186 ceph-mon[126480]: pgmap v12678: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 176 KiB/s wr, 7 op/s 2023-05-08T10:18:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:48 smithi133 ceph-mon[125939]: pgmap v12678: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 176 KiB/s wr, 7 op/s 2023-05-08T10:18:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:48 smithi096 ceph-mon[124666]: pgmap v12678: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 176 KiB/s wr, 7 op/s 2023-05-08T10:18:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23668.107298 secs 2023-05-08T10:18:49.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23668.107298 secs 2023-05-08T10:18:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23668.107298 secs 2023-05-08T10:18:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:50 smithi186 ceph-mon[126480]: pgmap v12679: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 324 KiB/s wr, 10 op/s 2023-05-08T10:18:50.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:50 smithi133 ceph-mon[125939]: pgmap v12679: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 324 KiB/s wr, 10 op/s 2023-05-08T10:18:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:50 smithi096 ceph-mon[124666]: pgmap v12679: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 324 KiB/s wr, 10 op/s 2023-05-08T10:18:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:52 smithi186 ceph-mon[126480]: pgmap v12680: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 375 KiB/s wr, 9 op/s 2023-05-08T10:18:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:18:52.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:52 smithi133 ceph-mon[125939]: pgmap v12680: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 375 KiB/s wr, 9 op/s 2023-05-08T10:18:52.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:18:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:52 smithi096 ceph-mon[124666]: pgmap v12680: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 375 KiB/s wr, 9 op/s 2023-05-08T10:18:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:18:53.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:53 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:18:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:18:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:18:53.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:53 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:18:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:18:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:18:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:53 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:18:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:18:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:18:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:54 smithi186 ceph-mon[126480]: pgmap v12681: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 546 KiB/s rd, 375 KiB/s wr, 8 op/s 2023-05-08T10:18:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23673.107430 secs 2023-05-08T10:18:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23673.662843 secs 2023-05-08T10:18:54.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:54 smithi133 ceph-mon[125939]: pgmap v12681: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 546 KiB/s rd, 375 KiB/s wr, 8 op/s 2023-05-08T10:18:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23673.107430 secs 2023-05-08T10:18:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23673.662843 secs 2023-05-08T10:18:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:54 smithi096 ceph-mon[124666]: pgmap v12681: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 546 KiB/s rd, 375 KiB/s wr, 8 op/s 2023-05-08T10:18:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23673.107430 secs 2023-05-08T10:18:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23673.662843 secs 2023-05-08T10:18:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:56 smithi186 ceph-mon[126480]: pgmap v12682: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 940 KiB/s rd, 756 KiB/s wr, 15 op/s 2023-05-08T10:18:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23674.950505 secs 2023-05-08T10:18:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:56 smithi133 ceph-mon[125939]: pgmap v12682: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 940 KiB/s rd, 756 KiB/s wr, 15 op/s 2023-05-08T10:18:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23674.950505 secs 2023-05-08T10:18:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:56 smithi096 ceph-mon[124666]: pgmap v12682: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 940 KiB/s rd, 756 KiB/s wr, 15 op/s 2023-05-08T10:18:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23674.950505 secs 2023-05-08T10:18:57.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:18:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:18:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:18:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:18:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:18:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:18:57.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:18:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:18:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:18:58.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:58 smithi133 ceph-mon[125939]: pgmap v12683: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 762 KiB/s rd, 750 KiB/s wr, 11 op/s 2023-05-08T10:18:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:58 smithi096 ceph-mon[124666]: pgmap v12683: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 762 KiB/s rd, 750 KiB/s wr, 11 op/s 2023-05-08T10:18:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:58 smithi186 ceph-mon[126480]: pgmap v12683: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 762 KiB/s rd, 750 KiB/s wr, 11 op/s 2023-05-08T10:18:59.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23678.107549 secs 2023-05-08T10:18:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:18:59 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:18:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23678.107549 secs 2023-05-08T10:18:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:18:59 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:18:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23678.107549 secs 2023-05-08T10:18:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:18:59 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:19:00.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:00 smithi133 ceph-mon[125939]: pgmap v12684: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 835 KiB/s rd, 822 KiB/s wr, 14 op/s 2023-05-08T10:19:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:00 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:19:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:00 smithi096 ceph-mon[124666]: pgmap v12684: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 835 KiB/s rd, 822 KiB/s wr, 14 op/s 2023-05-08T10:19:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:00 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:19:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:00 smithi186 ceph-mon[126480]: pgmap v12684: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 835 KiB/s rd, 822 KiB/s wr, 14 op/s 2023-05-08T10:19:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:00 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:19:01.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23679.950632 secs 2023-05-08T10:19:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:19:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:19:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23679.950632 secs 2023-05-08T10:19:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:19:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:19:01.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23679.950632 secs 2023-05-08T10:19:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:19:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:19:02.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:02 smithi133 ceph-mon[125939]: pgmap v12685: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 699 KiB/s rd, 688 KiB/s wr, 13 op/s 2023-05-08T10:19:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:02 smithi096 ceph-mon[124666]: pgmap v12685: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 699 KiB/s rd, 688 KiB/s wr, 13 op/s 2023-05-08T10:19:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:02 smithi186 ceph-mon[126480]: pgmap v12685: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 699 KiB/s rd, 688 KiB/s wr, 13 op/s 2023-05-08T10:19:04.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:04 smithi133 ceph-mon[125939]: pgmap v12686: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 466 KiB/s wr, 11 op/s 2023-05-08T10:19:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23683.107650 secs 2023-05-08T10:19:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23683.663121 secs 2023-05-08T10:19:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:04 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:19:04.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:04 smithi096 ceph-mon[124666]: pgmap v12686: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 466 KiB/s wr, 11 op/s 2023-05-08T10:19:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23683.107650 secs 2023-05-08T10:19:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23683.663121 secs 2023-05-08T10:19:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:04 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:19:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:04 smithi186 ceph-mon[126480]: pgmap v12686: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 466 KiB/s wr, 11 op/s 2023-05-08T10:19:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23683.107650 secs 2023-05-08T10:19:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23683.663121 secs 2023-05-08T10:19:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:04 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:19:06.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:06 smithi133 ceph-mon[125939]: pgmap v12687: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 826 KiB/s rd, 849 KiB/s wr, 30 op/s 2023-05-08T10:19:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23684.950766 secs 2023-05-08T10:19:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:06 smithi133 ceph-mon[125939]: osdmap e870: 12 total, 12 up, 12 in 2023-05-08T10:19:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:06 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:19:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:06 smithi096 ceph-mon[124666]: pgmap v12687: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 826 KiB/s rd, 849 KiB/s wr, 30 op/s 2023-05-08T10:19:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23684.950766 secs 2023-05-08T10:19:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:06 smithi096 ceph-mon[124666]: osdmap e870: 12 total, 12 up, 12 in 2023-05-08T10:19:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:06 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:19:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:06 smithi186 ceph-mon[126480]: pgmap v12687: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 826 KiB/s rd, 849 KiB/s wr, 30 op/s 2023-05-08T10:19:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23684.950766 secs 2023-05-08T10:19:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:06 smithi186 ceph-mon[126480]: osdmap e870: 12 total, 12 up, 12 in 2023-05-08T10:19:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:06 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:19:08.722 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:08 smithi186 ceph-mon[126480]: pgmap v12689: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 561 KiB/s wr, 29 op/s 2023-05-08T10:19:08.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:08 smithi133 ceph-mon[125939]: pgmap v12689: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 561 KiB/s wr, 29 op/s 2023-05-08T10:19:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:08 smithi096 ceph-mon[124666]: pgmap v12689: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 561 KiB/s wr, 29 op/s 2023-05-08T10:19:09.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23688.107741 secs 2023-05-08T10:19:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:19:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:19:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:09 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:19:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:09 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:19:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:09 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:19:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:09 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:19:09.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:09 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:19:09.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23688.663245 secs 2023-05-08T10:19:09.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:09 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:19:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23688.107741 secs 2023-05-08T10:19:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:19:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:19:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:09 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:19:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:09 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:19:09.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:09 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:19:09.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:09 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:19:09.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:09 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:19:09.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23688.663245 secs 2023-05-08T10:19:09.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:09 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:19:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23688.107741 secs 2023-05-08T10:19:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:19:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:19:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:09 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:19:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:09 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:19:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:09 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:19:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:09 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:19:09.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:09 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:19:09.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23688.663245 secs 2023-05-08T10:19:09.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:09 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:19:10.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:10 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:19:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:10 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T10:19:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:10 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T10:19:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:10 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:19:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:10 smithi133 ceph-mon[125939]: pgmap v12690: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 483 KiB/s rd, 524 KiB/s wr, 28 op/s 2023-05-08T10:19:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23689.950856 secs 2023-05-08T10:19:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:10 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:19:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:10 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T10:19:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:10 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T10:19:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:10 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:19:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:10 smithi096 ceph-mon[124666]: pgmap v12690: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 483 KiB/s rd, 524 KiB/s wr, 28 op/s 2023-05-08T10:19:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23689.950856 secs 2023-05-08T10:19:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:10 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:19:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:10 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T10:19:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:10 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T10:19:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:10 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:19:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:10 smithi186 ceph-mon[126480]: pgmap v12690: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 483 KiB/s rd, 524 KiB/s wr, 28 op/s 2023-05-08T10:19:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23689.950856 secs 2023-05-08T10:19:12.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:12 smithi133 ceph-mon[125939]: pgmap v12691: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 468 KiB/s rd, 508 KiB/s wr, 28 op/s 2023-05-08T10:19:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:12 smithi096 ceph-mon[124666]: pgmap v12691: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 468 KiB/s rd, 508 KiB/s wr, 28 op/s 2023-05-08T10:19:12.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:12 smithi186 ceph-mon[126480]: pgmap v12691: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 468 KiB/s rd, 508 KiB/s wr, 28 op/s 2023-05-08T10:19:14.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:14 smithi133 ceph-mon[125939]: pgmap v12692: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 468 KiB/s rd, 508 KiB/s wr, 28 op/s 2023-05-08T10:19:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23693.107843 secs 2023-05-08T10:19:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23693.663391 secs 2023-05-08T10:19:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:14 smithi133 ceph-mon[125939]: osdmap e871: 12 total, 12 up, 12 in 2023-05-08T10:19:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:14 smithi096 ceph-mon[124666]: pgmap v12692: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 468 KiB/s rd, 508 KiB/s wr, 28 op/s 2023-05-08T10:19:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23693.107843 secs 2023-05-08T10:19:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23693.663391 secs 2023-05-08T10:19:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:14 smithi096 ceph-mon[124666]: osdmap e871: 12 total, 12 up, 12 in 2023-05-08T10:19:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:14 smithi186 ceph-mon[126480]: pgmap v12692: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 468 KiB/s rd, 508 KiB/s wr, 28 op/s 2023-05-08T10:19:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23693.107843 secs 2023-05-08T10:19:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23693.663391 secs 2023-05-08T10:19:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:14 smithi186 ceph-mon[126480]: osdmap e871: 12 total, 12 up, 12 in 2023-05-08T10:19:15.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23694.951006 secs 2023-05-08T10:19:15.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23694.951006 secs 2023-05-08T10:19:15.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23694.951006 secs 2023-05-08T10:19:16.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:16 smithi133 ceph-mon[125939]: pgmap v12694: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 163 KiB/s wr, 8 op/s 2023-05-08T10:19:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:16 smithi096 ceph-mon[124666]: pgmap v12694: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 163 KiB/s wr, 8 op/s 2023-05-08T10:19:16.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:16 smithi186 ceph-mon[126480]: pgmap v12694: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 163 KiB/s wr, 8 op/s 2023-05-08T10:19:18.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:18 smithi133 ceph-mon[125939]: pgmap v12695: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 158 KiB/s wr, 8 op/s 2023-05-08T10:19:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:18 smithi096 ceph-mon[124666]: pgmap v12695: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 158 KiB/s wr, 8 op/s 2023-05-08T10:19:18.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:18 smithi186 ceph-mon[126480]: pgmap v12695: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 158 KiB/s wr, 8 op/s 2023-05-08T10:19:19.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23698.107938 secs 2023-05-08T10:19:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23698.663489 secs 2023-05-08T10:19:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23698.107938 secs 2023-05-08T10:19:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23698.663489 secs 2023-05-08T10:19:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23698.107938 secs 2023-05-08T10:19:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23698.663489 secs 2023-05-08T10:19:20.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:20 smithi133 ceph-mon[125939]: pgmap v12696: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 110 KiB/s wr, 7 op/s 2023-05-08T10:19:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23699.951094 secs 2023-05-08T10:19:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:20 smithi096 ceph-mon[124666]: pgmap v12696: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 110 KiB/s wr, 7 op/s 2023-05-08T10:19:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23699.951094 secs 2023-05-08T10:19:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:20 smithi186 ceph-mon[126480]: pgmap v12696: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 110 KiB/s wr, 7 op/s 2023-05-08T10:19:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23699.951094 secs 2023-05-08T10:19:22.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:22 smithi133 ceph-mon[125939]: pgmap v12697: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 109 KiB/s wr, 7 op/s 2023-05-08T10:19:22.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:22 smithi096 ceph-mon[124666]: pgmap v12697: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 109 KiB/s wr, 7 op/s 2023-05-08T10:19:22.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:22 smithi186 ceph-mon[126480]: pgmap v12697: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 109 KiB/s wr, 7 op/s 2023-05-08T10:19:24.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:24 smithi133 ceph-mon[125939]: pgmap v12698: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 109 KiB/s wr, 7 op/s 2023-05-08T10:19:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23703.108053 secs 2023-05-08T10:19:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23703.663610 secs 2023-05-08T10:19:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:24 smithi096 ceph-mon[124666]: pgmap v12698: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 109 KiB/s wr, 7 op/s 2023-05-08T10:19:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23703.108053 secs 2023-05-08T10:19:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23703.663610 secs 2023-05-08T10:19:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:24 smithi186 ceph-mon[126480]: pgmap v12698: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 109 KiB/s wr, 7 op/s 2023-05-08T10:19:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23703.108053 secs 2023-05-08T10:19:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23703.663610 secs 2023-05-08T10:19:25.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23704.951187 secs 2023-05-08T10:19:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23704.951187 secs 2023-05-08T10:19:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23704.951187 secs 2023-05-08T10:19:26.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:26 smithi133 ceph-mon[125939]: pgmap v12699: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2023-05-08T10:19:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:26 smithi096 ceph-mon[124666]: pgmap v12699: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2023-05-08T10:19:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:26 smithi186 ceph-mon[126480]: pgmap v12699: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2023-05-08T10:19:28.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:28 smithi133 ceph-mon[125939]: pgmap v12700: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:19:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:28 smithi096 ceph-mon[124666]: pgmap v12700: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:19:28.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:28 smithi186 ceph-mon[126480]: pgmap v12700: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:19:29.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23708.108170 secs 2023-05-08T10:19:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23708.663732 secs 2023-05-08T10:19:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23708.108170 secs 2023-05-08T10:19:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23708.663732 secs 2023-05-08T10:19:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23708.108170 secs 2023-05-08T10:19:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23708.663732 secs 2023-05-08T10:19:30.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:30 smithi133 ceph-mon[125939]: pgmap v12701: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T10:19:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23709.951285 secs 2023-05-08T10:19:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:30 smithi096 ceph-mon[124666]: pgmap v12701: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T10:19:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23709.951285 secs 2023-05-08T10:19:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:30 smithi186 ceph-mon[126480]: pgmap v12701: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T10:19:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23709.951285 secs 2023-05-08T10:19:32.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:32 smithi133 ceph-mon[125939]: pgmap v12702: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2023-05-08T10:19:32.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:32 smithi096 ceph-mon[124666]: pgmap v12702: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2023-05-08T10:19:32.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:32 smithi186 ceph-mon[126480]: pgmap v12702: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2023-05-08T10:19:34.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:34 smithi133 ceph-mon[125939]: pgmap v12703: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:19:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23713.108247 secs 2023-05-08T10:19:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23713.663854 secs 2023-05-08T10:19:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:34 smithi096 ceph-mon[124666]: pgmap v12703: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:19:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23713.108247 secs 2023-05-08T10:19:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23713.663854 secs 2023-05-08T10:19:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:34 smithi186 ceph-mon[126480]: pgmap v12703: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:19:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23713.108247 secs 2023-05-08T10:19:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23713.663854 secs 2023-05-08T10:19:35.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:35 smithi133 ceph-mon[125939]: pgmap v12704: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-05-08T10:19:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23714.951363 secs 2023-05-08T10:19:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:35 smithi096 ceph-mon[124666]: pgmap v12704: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-05-08T10:19:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23714.951363 secs 2023-05-08T10:19:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:35 smithi186 ceph-mon[126480]: pgmap v12704: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-05-08T10:19:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23714.951363 secs 2023-05-08T10:19:38.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:38 smithi133 ceph-mon[125939]: pgmap v12705: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 682 B/s wr, 6 op/s 2023-05-08T10:19:38.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:38 smithi096 ceph-mon[124666]: pgmap v12705: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 682 B/s wr, 6 op/s 2023-05-08T10:19:38.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:38 smithi186 ceph-mon[126480]: pgmap v12705: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 682 B/s wr, 6 op/s 2023-05-08T10:19:39.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23718.108388 secs 2023-05-08T10:19:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23718.663958 secs 2023-05-08T10:19:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23718.108388 secs 2023-05-08T10:19:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23718.663958 secs 2023-05-08T10:19:39.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23718.108388 secs 2023-05-08T10:19:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23718.663958 secs 2023-05-08T10:19:40.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:40 smithi133 ceph-mon[125939]: pgmap v12706: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 172 KiB/s wr, 9 op/s 2023-05-08T10:19:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:40 smithi096 ceph-mon[124666]: pgmap v12706: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 172 KiB/s wr, 9 op/s 2023-05-08T10:19:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:40 smithi186 ceph-mon[126480]: pgmap v12706: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 172 KiB/s wr, 9 op/s 2023-05-08T10:19:42.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:42 smithi133 ceph-mon[125939]: pgmap v12707: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 172 KiB/s wr, 7 op/s 2023-05-08T10:19:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:42 smithi096 ceph-mon[124666]: pgmap v12707: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 172 KiB/s wr, 7 op/s 2023-05-08T10:19:42.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:42 smithi186 ceph-mon[126480]: pgmap v12707: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 172 KiB/s wr, 7 op/s 2023-05-08T10:19:44.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:44 smithi133 ceph-mon[125939]: pgmap v12708: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 172 KiB/s wr, 6 op/s 2023-05-08T10:19:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23723.108492 secs 2023-05-08T10:19:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:44 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:19:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23723.664075 secs 2023-05-08T10:19:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:44 smithi096 ceph-mon[124666]: pgmap v12708: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 172 KiB/s wr, 6 op/s 2023-05-08T10:19:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23723.108492 secs 2023-05-08T10:19:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:44 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:19:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23723.664075 secs 2023-05-08T10:19:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:44 smithi186 ceph-mon[126480]: pgmap v12708: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 172 KiB/s wr, 6 op/s 2023-05-08T10:19:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23723.108492 secs 2023-05-08T10:19:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:44 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:19:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23723.664075 secs 2023-05-08T10:19:45.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:45 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:19:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:45 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:19:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:45 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:19:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:45 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:19:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:45 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:19:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:45 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:19:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:45 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:19:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:45 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:19:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:45 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:19:46.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:46 smithi133 ceph-mon[125939]: pgmap v12709: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 178 KiB/s wr, 10 op/s 2023-05-08T10:19:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23724.951630 secs 2023-05-08T10:19:46.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:46 smithi096 ceph-mon[124666]: pgmap v12709: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 178 KiB/s wr, 10 op/s 2023-05-08T10:19:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23724.951630 secs 2023-05-08T10:19:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:46 smithi186 ceph-mon[126480]: pgmap v12709: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 178 KiB/s wr, 10 op/s 2023-05-08T10:19:46.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23724.951630 secs 2023-05-08T10:19:48.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:48 smithi133 ceph-mon[125939]: pgmap v12710: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 177 KiB/s wr, 6 op/s 2023-05-08T10:19:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:48 smithi096 ceph-mon[124666]: pgmap v12710: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 177 KiB/s wr, 6 op/s 2023-05-08T10:19:48.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:48 smithi186 ceph-mon[126480]: pgmap v12710: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 177 KiB/s wr, 6 op/s 2023-05-08T10:19:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:19:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:19:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23728.108611 secs 2023-05-08T10:19:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:19:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:19:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23728.108611 secs 2023-05-08T10:19:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:19:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:19:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23728.108611 secs 2023-05-08T10:19:50.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:50 smithi133 ceph-mon[125939]: pgmap v12711: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 469 KiB/s wr, 10 op/s 2023-05-08T10:19:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:50 smithi096 ceph-mon[124666]: pgmap v12711: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 469 KiB/s wr, 10 op/s 2023-05-08T10:19:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:50 smithi186 ceph-mon[126480]: pgmap v12711: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 469 KiB/s wr, 10 op/s 2023-05-08T10:19:51.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23729.951769 secs 2023-05-08T10:19:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23729.951769 secs 2023-05-08T10:19:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23729.951769 secs 2023-05-08T10:19:52.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:52 smithi133 ceph-mon[125939]: pgmap v12712: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 298 KiB/s wr, 8 op/s 2023-05-08T10:19:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:19:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:52 smithi096 ceph-mon[124666]: pgmap v12712: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 298 KiB/s wr, 8 op/s 2023-05-08T10:19:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:19:52.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:52 smithi186 ceph-mon[126480]: pgmap v12712: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 298 KiB/s wr, 8 op/s 2023-05-08T10:19:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:19:53.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:53 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:19:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:19:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:19:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:53 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:19:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:19:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:19:53.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:53 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:19:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:19:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:19:54.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:54 smithi133 ceph-mon[125939]: pgmap v12713: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 298 KiB/s wr, 8 op/s 2023-05-08T10:19:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23733.108693 secs 2023-05-08T10:19:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23733.664321 secs 2023-05-08T10:19:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:54 smithi096 ceph-mon[124666]: pgmap v12713: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 298 KiB/s wr, 8 op/s 2023-05-08T10:19:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23733.108693 secs 2023-05-08T10:19:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23733.664321 secs 2023-05-08T10:19:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:54 smithi186 ceph-mon[126480]: pgmap v12713: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 298 KiB/s wr, 8 op/s 2023-05-08T10:19:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23733.108693 secs 2023-05-08T10:19:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23733.664321 secs 2023-05-08T10:19:56.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:56 smithi133 ceph-mon[125939]: pgmap v12714: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 787 KiB/s rd, 603 KiB/s wr, 14 op/s 2023-05-08T10:19:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23734.951905 secs 2023-05-08T10:19:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:56 smithi096 ceph-mon[124666]: pgmap v12714: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 787 KiB/s rd, 603 KiB/s wr, 14 op/s 2023-05-08T10:19:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23734.951905 secs 2023-05-08T10:19:56.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:56 smithi186 ceph-mon[126480]: pgmap v12714: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 787 KiB/s rd, 603 KiB/s wr, 14 op/s 2023-05-08T10:19:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23734.951905 secs 2023-05-08T10:19:57.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:19:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:19:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:19:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:19:57.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:19:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:19:58.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:58 smithi133 ceph-mon[125939]: pgmap v12715: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 609 KiB/s rd, 597 KiB/s wr, 10 op/s 2023-05-08T10:19:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:58 smithi096 ceph-mon[124666]: pgmap v12715: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 609 KiB/s rd, 597 KiB/s wr, 10 op/s 2023-05-08T10:19:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:58 smithi186 ceph-mon[126480]: pgmap v12715: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 609 KiB/s rd, 597 KiB/s wr, 10 op/s 2023-05-08T10:19:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23738.108793 secs 2023-05-08T10:19:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:19:59 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:19:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23738.108793 secs 2023-05-08T10:19:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:19:59 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:19:59.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23738.108793 secs 2023-05-08T10:19:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:19:59 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:20:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:00 smithi096 ceph-mon[124666]: pgmap v12716: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 708 KiB/s rd, 695 KiB/s wr, 14 op/s 2023-05-08T10:20:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:00 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:20:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:00 smithi096 ceph-mon[124666]: overall HEALTH_WARN 3 MDSs report slow requests 2023-05-08T10:20:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:00 smithi186 ceph-mon[126480]: pgmap v12716: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 708 KiB/s rd, 695 KiB/s wr, 14 op/s 2023-05-08T10:20:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:00 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:20:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:00 smithi186 ceph-mon[126480]: overall HEALTH_WARN 3 MDSs report slow requests 2023-05-08T10:20:00.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:00 smithi133 ceph-mon[125939]: pgmap v12716: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 708 KiB/s rd, 695 KiB/s wr, 14 op/s 2023-05-08T10:20:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:00 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:20:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:00 smithi133 ceph-mon[125939]: overall HEALTH_WARN 3 MDSs report slow requests 2023-05-08T10:20:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:20:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:20:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:20:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:20:01.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:20:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:20:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:02 smithi096 ceph-mon[124666]: pgmap v12717: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 416 KiB/s wr, 12 op/s 2023-05-08T10:20:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:02 smithi186 ceph-mon[126480]: pgmap v12717: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 416 KiB/s wr, 12 op/s 2023-05-08T10:20:02.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:02 smithi133 ceph-mon[125939]: pgmap v12717: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 416 KiB/s wr, 12 op/s 2023-05-08T10:20:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:04 smithi186 ceph-mon[126480]: pgmap v12718: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 416 KiB/s wr, 11 op/s 2023-05-08T10:20:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23743.108932 secs 2023-05-08T10:20:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:04 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:20:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23743.664542 secs 2023-05-08T10:20:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:04 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:20:04.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:04 smithi133 ceph-mon[125939]: pgmap v12718: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 416 KiB/s wr, 11 op/s 2023-05-08T10:20:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23743.108932 secs 2023-05-08T10:20:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:04 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:20:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23743.664542 secs 2023-05-08T10:20:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:04 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:20:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:04 smithi096 ceph-mon[124666]: pgmap v12718: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 416 KiB/s wr, 11 op/s 2023-05-08T10:20:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23743.108932 secs 2023-05-08T10:20:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:04 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:20:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23743.664542 secs 2023-05-08T10:20:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:04 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:20:05.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:20:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:20:05.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:20:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:20:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:20:05.843 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:20:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:06 smithi186 ceph-mon[126480]: pgmap v12719: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 726 KiB/s rd, 749 KiB/s wr, 30 op/s 2023-05-08T10:20:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23744.952150 secs 2023-05-08T10:20:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:06 smithi186 ceph-mon[126480]: osdmap e872: 12 total, 12 up, 12 in 2023-05-08T10:20:06.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:06 smithi133 ceph-mon[125939]: pgmap v12719: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 726 KiB/s rd, 749 KiB/s wr, 30 op/s 2023-05-08T10:20:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23744.952150 secs 2023-05-08T10:20:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:06 smithi133 ceph-mon[125939]: osdmap e872: 12 total, 12 up, 12 in 2023-05-08T10:20:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:06 smithi096 ceph-mon[124666]: pgmap v12719: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 726 KiB/s rd, 749 KiB/s wr, 30 op/s 2023-05-08T10:20:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23744.952150 secs 2023-05-08T10:20:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:06 smithi096 ceph-mon[124666]: osdmap e872: 12 total, 12 up, 12 in 2023-05-08T10:20:08.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:08 smithi186 ceph-mon[126480]: pgmap v12721: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 492 KiB/s rd, 533 KiB/s wr, 28 op/s 2023-05-08T10:20:08.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:08 smithi133 ceph-mon[125939]: pgmap v12721: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 492 KiB/s rd, 533 KiB/s wr, 28 op/s 2023-05-08T10:20:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:08 smithi096 ceph-mon[124666]: pgmap v12721: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 492 KiB/s rd, 533 KiB/s wr, 28 op/s 2023-05-08T10:20:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:20:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:20:09.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:20:09.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23748.109057 secs 2023-05-08T10:20:09.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23748.664662 secs 2023-05-08T10:20:09.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:09 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:20:09.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:09 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:20:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:20:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:20:09.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:20:09.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23748.109057 secs 2023-05-08T10:20:09.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23748.664662 secs 2023-05-08T10:20:09.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:09 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:20:09.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:09 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:20:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:20:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:20:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:20:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23748.109057 secs 2023-05-08T10:20:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23748.664662 secs 2023-05-08T10:20:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:09 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:20:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:09 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:20:10.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:10 smithi186 ceph-mon[126480]: pgmap v12722: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 417 KiB/s wr, 27 op/s 2023-05-08T10:20:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:10 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:20:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:10 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:20:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:10 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:20:10.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:10 smithi133 ceph-mon[125939]: pgmap v12722: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 417 KiB/s wr, 27 op/s 2023-05-08T10:20:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:10 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:20:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:10 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:20:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:10 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:20:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:10 smithi096 ceph-mon[124666]: pgmap v12722: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 417 KiB/s wr, 27 op/s 2023-05-08T10:20:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:10 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:20:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:10 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:20:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:10 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:20:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:11 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:20:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:11 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T10:20:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:11 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T10:20:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:11 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:20:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23749.952214 secs 2023-05-08T10:20:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:11 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:20:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:11 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T10:20:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:11 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T10:20:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:11 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:20:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23749.952214 secs 2023-05-08T10:20:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:11 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:20:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:11 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T10:20:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:11 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T10:20:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:11 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:20:11.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23749.952214 secs 2023-05-08T10:20:12.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:12 smithi186 ceph-mon[126480]: pgmap v12723: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 495 KiB/s wr, 27 op/s 2023-05-08T10:20:12.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:12 smithi133 ceph-mon[125939]: pgmap v12723: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 495 KiB/s wr, 27 op/s 2023-05-08T10:20:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:12 smithi096 ceph-mon[124666]: pgmap v12723: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 495 KiB/s wr, 27 op/s 2023-05-08T10:20:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:14 smithi186 ceph-mon[126480]: pgmap v12724: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 495 KiB/s wr, 27 op/s 2023-05-08T10:20:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23753.109194 secs 2023-05-08T10:20:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23753.664740 secs 2023-05-08T10:20:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:14 smithi186 ceph-mon[126480]: osdmap e873: 12 total, 12 up, 12 in 2023-05-08T10:20:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:14 smithi133 ceph-mon[125939]: pgmap v12724: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 495 KiB/s wr, 27 op/s 2023-05-08T10:20:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23753.109194 secs 2023-05-08T10:20:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23753.664740 secs 2023-05-08T10:20:14.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:14 smithi133 ceph-mon[125939]: osdmap e873: 12 total, 12 up, 12 in 2023-05-08T10:20:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:14 smithi096 ceph-mon[124666]: pgmap v12724: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 495 KiB/s wr, 27 op/s 2023-05-08T10:20:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23753.109194 secs 2023-05-08T10:20:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23753.664740 secs 2023-05-08T10:20:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:14 smithi096 ceph-mon[124666]: osdmap e873: 12 total, 12 up, 12 in 2023-05-08T10:20:16.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:16 smithi186 ceph-mon[126480]: pgmap v12726: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 176 KiB/s wr, 8 op/s 2023-05-08T10:20:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23754.952329 secs 2023-05-08T10:20:16.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:16 smithi133 ceph-mon[125939]: pgmap v12726: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 176 KiB/s wr, 8 op/s 2023-05-08T10:20:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23754.952329 secs 2023-05-08T10:20:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:16 smithi096 ceph-mon[124666]: pgmap v12726: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 176 KiB/s wr, 8 op/s 2023-05-08T10:20:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23754.952329 secs 2023-05-08T10:20:18.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:18 smithi186 ceph-mon[126480]: pgmap v12727: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 173 KiB/s wr, 8 op/s 2023-05-08T10:20:18.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:18 smithi133 ceph-mon[125939]: pgmap v12727: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 173 KiB/s wr, 8 op/s 2023-05-08T10:20:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:18 smithi096 ceph-mon[124666]: pgmap v12727: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 173 KiB/s wr, 8 op/s 2023-05-08T10:20:19.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23758.109315 secs 2023-05-08T10:20:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23758.664868 secs 2023-05-08T10:20:19.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23758.109315 secs 2023-05-08T10:20:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23758.664868 secs 2023-05-08T10:20:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23758.109315 secs 2023-05-08T10:20:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23758.664868 secs 2023-05-08T10:20:20.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:20 smithi186 ceph-mon[126480]: pgmap v12728: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 172 KiB/s wr, 7 op/s 2023-05-08T10:20:20.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:20 smithi133 ceph-mon[125939]: pgmap v12728: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 172 KiB/s wr, 7 op/s 2023-05-08T10:20:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:20 smithi096 ceph-mon[124666]: pgmap v12728: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 172 KiB/s wr, 7 op/s 2023-05-08T10:20:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23759.952407 secs 2023-05-08T10:20:21.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23759.952407 secs 2023-05-08T10:20:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23759.952407 secs 2023-05-08T10:20:22.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:22 smithi186 ceph-mon[126480]: pgmap v12729: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 140 KiB/s wr, 7 op/s 2023-05-08T10:20:22.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:22 smithi133 ceph-mon[125939]: pgmap v12729: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 140 KiB/s wr, 7 op/s 2023-05-08T10:20:22.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:22 smithi096 ceph-mon[124666]: pgmap v12729: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 140 KiB/s wr, 7 op/s 2023-05-08T10:20:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:24 smithi186 ceph-mon[126480]: pgmap v12730: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 140 KiB/s wr, 7 op/s 2023-05-08T10:20:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23763.109439 secs 2023-05-08T10:20:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23763.664990 secs 2023-05-08T10:20:24.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:24 smithi133 ceph-mon[125939]: pgmap v12730: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 140 KiB/s wr, 7 op/s 2023-05-08T10:20:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23763.109439 secs 2023-05-08T10:20:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23763.664990 secs 2023-05-08T10:20:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:24 smithi096 ceph-mon[124666]: pgmap v12730: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 140 KiB/s wr, 7 op/s 2023-05-08T10:20:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23763.109439 secs 2023-05-08T10:20:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23763.664990 secs 2023-05-08T10:20:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:26 smithi186 ceph-mon[126480]: pgmap v12731: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 127 KiB/s wr, 7 op/s 2023-05-08T10:20:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23764.952523 secs 2023-05-08T10:20:26.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:26 smithi133 ceph-mon[125939]: pgmap v12731: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 127 KiB/s wr, 7 op/s 2023-05-08T10:20:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23764.952523 secs 2023-05-08T10:20:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:26 smithi096 ceph-mon[124666]: pgmap v12731: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 127 KiB/s wr, 7 op/s 2023-05-08T10:20:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23764.952523 secs 2023-05-08T10:20:28.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:28 smithi186 ceph-mon[126480]: pgmap v12732: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 KiB/s wr, 6 op/s 2023-05-08T10:20:28.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:28 smithi133 ceph-mon[125939]: pgmap v12732: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 KiB/s wr, 6 op/s 2023-05-08T10:20:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:28 smithi096 ceph-mon[124666]: pgmap v12732: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 KiB/s wr, 6 op/s 2023-05-08T10:20:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23768.109572 secs 2023-05-08T10:20:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23768.665114 secs 2023-05-08T10:20:29.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23768.109572 secs 2023-05-08T10:20:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23768.665114 secs 2023-05-08T10:20:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23768.109572 secs 2023-05-08T10:20:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23768.665114 secs 2023-05-08T10:20:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:30 smithi186 ceph-mon[126480]: pgmap v12733: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 52 KiB/s wr, 7 op/s 2023-05-08T10:20:30.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:30 smithi133 ceph-mon[125939]: pgmap v12733: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 52 KiB/s wr, 7 op/s 2023-05-08T10:20:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:30 smithi096 ceph-mon[124666]: pgmap v12733: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 52 KiB/s wr, 7 op/s 2023-05-08T10:20:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23769.952651 secs 2023-05-08T10:20:31.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23769.952651 secs 2023-05-08T10:20:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23769.952651 secs 2023-05-08T10:20:32.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:32 smithi186 ceph-mon[126480]: pgmap v12734: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 KiB/s wr, 7 op/s 2023-05-08T10:20:32.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:32 smithi133 ceph-mon[125939]: pgmap v12734: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 KiB/s wr, 7 op/s 2023-05-08T10:20:32.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:32 smithi096 ceph-mon[124666]: pgmap v12734: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 KiB/s wr, 7 op/s 2023-05-08T10:20:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:34 smithi186 ceph-mon[126480]: pgmap v12735: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:20:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23773.109694 secs 2023-05-08T10:20:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23773.665222 secs 2023-05-08T10:20:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:34 smithi133 ceph-mon[125939]: pgmap v12735: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:20:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23773.109694 secs 2023-05-08T10:20:34.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23773.665222 secs 2023-05-08T10:20:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:34 smithi096 ceph-mon[124666]: pgmap v12735: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:20:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23773.109694 secs 2023-05-08T10:20:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23773.665222 secs 2023-05-08T10:20:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:36 smithi186 ceph-mon[126480]: pgmap v12736: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-05-08T10:20:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23774.952780 secs 2023-05-08T10:20:36.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:36 smithi133 ceph-mon[125939]: pgmap v12736: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-05-08T10:20:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23774.952780 secs 2023-05-08T10:20:36.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:36 smithi096 ceph-mon[124666]: pgmap v12736: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-05-08T10:20:36.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23774.952780 secs 2023-05-08T10:20:38.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:38 smithi186 ceph-mon[126480]: pgmap v12737: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 682 B/s wr, 6 op/s 2023-05-08T10:20:38.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:38 smithi133 ceph-mon[125939]: pgmap v12737: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 682 B/s wr, 6 op/s 2023-05-08T10:20:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:38 smithi096 ceph-mon[124666]: pgmap v12737: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 682 B/s wr, 6 op/s 2023-05-08T10:20:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23778.109816 secs 2023-05-08T10:20:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23778.665347 secs 2023-05-08T10:20:39.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23778.109816 secs 2023-05-08T10:20:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23778.665347 secs 2023-05-08T10:20:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23778.109816 secs 2023-05-08T10:20:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23778.665347 secs 2023-05-08T10:20:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:40 smithi186 ceph-mon[126480]: pgmap v12738: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 853 B/s wr, 8 op/s 2023-05-08T10:20:40.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:40 smithi133 ceph-mon[125939]: pgmap v12738: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 853 B/s wr, 8 op/s 2023-05-08T10:20:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:40 smithi096 ceph-mon[124666]: pgmap v12738: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 853 B/s wr, 8 op/s 2023-05-08T10:20:42.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:42 smithi186 ceph-mon[126480]: pgmap v12739: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 251 KiB/s wr, 8 op/s 2023-05-08T10:20:42.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:42 smithi133 ceph-mon[125939]: pgmap v12739: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 251 KiB/s wr, 8 op/s 2023-05-08T10:20:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:42 smithi096 ceph-mon[124666]: pgmap v12739: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 251 KiB/s wr, 8 op/s 2023-05-08T10:20:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:44 smithi186 ceph-mon[126480]: pgmap v12740: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 251 KiB/s wr, 6 op/s 2023-05-08T10:20:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23783.109936 secs 2023-05-08T10:20:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:44 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:20:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23783.665482 secs 2023-05-08T10:20:44.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:44 smithi133 ceph-mon[125939]: pgmap v12740: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 251 KiB/s wr, 6 op/s 2023-05-08T10:20:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23783.109936 secs 2023-05-08T10:20:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:44 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:20:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23783.665482 secs 2023-05-08T10:20:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:44 smithi096 ceph-mon[124666]: pgmap v12740: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 251 KiB/s wr, 6 op/s 2023-05-08T10:20:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23783.109936 secs 2023-05-08T10:20:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:44 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:20:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23783.665482 secs 2023-05-08T10:20:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:45 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:20:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:45 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:20:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:45 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:20:45.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:45 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:20:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:45 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:20:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:45 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:20:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:45 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:20:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:45 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:20:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:45 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:20:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:46 smithi186 ceph-mon[126480]: pgmap v12741: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 257 KiB/s wr, 10 op/s 2023-05-08T10:20:46.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:46 smithi133 ceph-mon[125939]: pgmap v12741: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 257 KiB/s wr, 10 op/s 2023-05-08T10:20:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:46 smithi096 ceph-mon[124666]: pgmap v12741: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 257 KiB/s wr, 10 op/s 2023-05-08T10:20:48.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:48 smithi133 ceph-mon[125939]: pgmap v12742: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 256 KiB/s wr, 6 op/s 2023-05-08T10:20:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:48 smithi096 ceph-mon[124666]: pgmap v12742: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 256 KiB/s wr, 6 op/s 2023-05-08T10:20:48.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:48 smithi186 ceph-mon[126480]: pgmap v12742: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 256 KiB/s wr, 6 op/s 2023-05-08T10:20:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23788.110007 secs 2023-05-08T10:20:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23788.110007 secs 2023-05-08T10:20:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23788.110007 secs 2023-05-08T10:20:50.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:50 smithi133 ceph-mon[125939]: pgmap v12743: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 464 KiB/s wr, 9 op/s 2023-05-08T10:20:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:50 smithi096 ceph-mon[124666]: pgmap v12743: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 464 KiB/s wr, 9 op/s 2023-05-08T10:20:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:50 smithi186 ceph-mon[126480]: pgmap v12743: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 464 KiB/s wr, 9 op/s 2023-05-08T10:20:51.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23789.953076 secs 2023-05-08T10:20:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23789.953076 secs 2023-05-08T10:20:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23789.953076 secs 2023-05-08T10:20:52.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:52 smithi133 ceph-mon[125939]: pgmap v12744: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 549 KiB/s wr, 9 op/s 2023-05-08T10:20:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:20:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:52 smithi096 ceph-mon[124666]: pgmap v12744: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 549 KiB/s wr, 9 op/s 2023-05-08T10:20:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:20:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:52 smithi186 ceph-mon[126480]: pgmap v12744: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 549 KiB/s wr, 9 op/s 2023-05-08T10:20:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:20:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:20:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:20:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:20:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:20:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:20:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:20:53.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:20:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:20:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:20:54.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:54 smithi133 ceph-mon[125939]: pgmap v12745: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 299 KiB/s wr, 8 op/s 2023-05-08T10:20:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23793.110135 secs 2023-05-08T10:20:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23793.665747 secs 2023-05-08T10:20:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:54 smithi096 ceph-mon[124666]: pgmap v12745: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 299 KiB/s wr, 8 op/s 2023-05-08T10:20:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23793.110135 secs 2023-05-08T10:20:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23793.665747 secs 2023-05-08T10:20:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:54 smithi186 ceph-mon[126480]: pgmap v12745: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 299 KiB/s wr, 8 op/s 2023-05-08T10:20:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23793.110135 secs 2023-05-08T10:20:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23793.665747 secs 2023-05-08T10:20:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:56 smithi133 ceph-mon[125939]: pgmap v12746: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 703 KiB/s rd, 606 KiB/s wr, 14 op/s 2023-05-08T10:20:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23794.953200 secs 2023-05-08T10:20:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:56 smithi096 ceph-mon[124666]: pgmap v12746: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 703 KiB/s rd, 606 KiB/s wr, 14 op/s 2023-05-08T10:20:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23794.953200 secs 2023-05-08T10:20:56.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:56 smithi186 ceph-mon[126480]: pgmap v12746: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 703 KiB/s rd, 606 KiB/s wr, 14 op/s 2023-05-08T10:20:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23794.953200 secs 2023-05-08T10:20:57.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:57 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:20:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:20:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:20:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:57 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:20:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:20:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:20:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:57 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:20:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:20:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:20:58.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:58 smithi133 ceph-mon[125939]: pgmap v12747: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 612 KiB/s rd, 600 KiB/s wr, 10 op/s 2023-05-08T10:20:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:58 smithi096 ceph-mon[124666]: pgmap v12747: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 612 KiB/s rd, 600 KiB/s wr, 10 op/s 2023-05-08T10:20:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:58 smithi186 ceph-mon[126480]: pgmap v12747: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 612 KiB/s rd, 600 KiB/s wr, 10 op/s 2023-05-08T10:20:59.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:20:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23798.110258 secs 2023-05-08T10:20:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:20:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23798.110258 secs 2023-05-08T10:20:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:20:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23798.110258 secs 2023-05-08T10:21:00.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:00 smithi133 ceph-mon[125939]: pgmap v12748: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 711 KiB/s rd, 699 KiB/s wr, 14 op/s 2023-05-08T10:21:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:00 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:21:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:00 smithi096 ceph-mon[124666]: pgmap v12748: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 711 KiB/s rd, 699 KiB/s wr, 14 op/s 2023-05-08T10:21:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:00 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:21:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:00 smithi186 ceph-mon[126480]: pgmap v12748: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 711 KiB/s rd, 699 KiB/s wr, 14 op/s 2023-05-08T10:21:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:00 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:21:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:21:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:21:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:21:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:21:01.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:21:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:21:02.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:02 smithi133 ceph-mon[125939]: pgmap v12749: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 503 KiB/s rd, 504 KiB/s wr, 12 op/s 2023-05-08T10:21:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:02 smithi096 ceph-mon[124666]: pgmap v12749: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 503 KiB/s rd, 504 KiB/s wr, 12 op/s 2023-05-08T10:21:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:02 smithi186 ceph-mon[126480]: pgmap v12749: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 503 KiB/s rd, 504 KiB/s wr, 12 op/s 2023-05-08T10:21:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:04 smithi133 ceph-mon[125939]: pgmap v12750: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 419 KiB/s wr, 11 op/s 2023-05-08T10:21:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23803.110384 secs 2023-05-08T10:21:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:04 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:21:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23803.665998 secs 2023-05-08T10:21:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:04 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:21:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:04 smithi096 ceph-mon[124666]: pgmap v12750: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 419 KiB/s wr, 11 op/s 2023-05-08T10:21:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23803.110384 secs 2023-05-08T10:21:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:04 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:21:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23803.665998 secs 2023-05-08T10:21:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:04 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:21:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:04 smithi186 ceph-mon[126480]: pgmap v12750: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 419 KiB/s wr, 11 op/s 2023-05-08T10:21:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23803.110384 secs 2023-05-08T10:21:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:04 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:21:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23803.665998 secs 2023-05-08T10:21:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:04 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:21:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:21:05.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:21:05.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23804.953456 secs 2023-05-08T10:21:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:21:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:21:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23804.953456 secs 2023-05-08T10:21:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:21:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:21:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23804.953456 secs 2023-05-08T10:21:06.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:06 smithi133 ceph-mon[125939]: pgmap v12751: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 730 KiB/s rd, 753 KiB/s wr, 30 op/s 2023-05-08T10:21:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:06 smithi133 ceph-mon[125939]: osdmap e874: 12 total, 12 up, 12 in 2023-05-08T10:21:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:06 smithi096 ceph-mon[124666]: pgmap v12751: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 730 KiB/s rd, 753 KiB/s wr, 30 op/s 2023-05-08T10:21:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:06 smithi096 ceph-mon[124666]: osdmap e874: 12 total, 12 up, 12 in 2023-05-08T10:21:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:06 smithi186 ceph-mon[126480]: pgmap v12751: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 730 KiB/s rd, 753 KiB/s wr, 30 op/s 2023-05-08T10:21:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:06 smithi186 ceph-mon[126480]: osdmap e874: 12 total, 12 up, 12 in 2023-05-08T10:21:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:08 smithi133 ceph-mon[125939]: pgmap v12753: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 495 KiB/s rd, 536 KiB/s wr, 29 op/s 2023-05-08T10:21:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:08 smithi096 ceph-mon[124666]: pgmap v12753: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 495 KiB/s rd, 536 KiB/s wr, 29 op/s 2023-05-08T10:21:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:08 smithi186 ceph-mon[126480]: pgmap v12753: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 495 KiB/s rd, 536 KiB/s wr, 29 op/s 2023-05-08T10:21:09.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23808.110517 secs 2023-05-08T10:21:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:21:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:21:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:21:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23808.666099 secs 2023-05-08T10:21:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:09 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:21:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23808.110517 secs 2023-05-08T10:21:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:21:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:21:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:21:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23808.666099 secs 2023-05-08T10:21:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:09 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:21:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23808.110517 secs 2023-05-08T10:21:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:21:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:21:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:21:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23808.666099 secs 2023-05-08T10:21:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:09 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:21:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:10 smithi133 ceph-mon[125939]: pgmap v12754: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 512 KiB/s wr, 28 op/s 2023-05-08T10:21:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:10 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:21:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23809.953520 secs 2023-05-08T10:21:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:10 smithi096 ceph-mon[124666]: pgmap v12754: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 512 KiB/s wr, 28 op/s 2023-05-08T10:21:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:10 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:21:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23809.953520 secs 2023-05-08T10:21:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:10 smithi186 ceph-mon[126480]: pgmap v12754: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 512 KiB/s wr, 28 op/s 2023-05-08T10:21:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:10 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:21:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23809.953520 secs 2023-05-08T10:21:12.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:12 smithi133 ceph-mon[125939]: pgmap v12755: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 497 KiB/s wr, 27 op/s 2023-05-08T10:21:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:12 smithi096 ceph-mon[124666]: pgmap v12755: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 497 KiB/s wr, 27 op/s 2023-05-08T10:21:12.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:12 smithi186 ceph-mon[126480]: pgmap v12755: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 497 KiB/s wr, 27 op/s 2023-05-08T10:21:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:13 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:21:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:13 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:21:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:13 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:21:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:13 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:21:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:13 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:21:13.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:13 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:21:13.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:13 smithi186 ceph-mon[126480]: pgmap v12756: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 497 KiB/s wr, 27 op/s 2023-05-08T10:21:13.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:13 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:21:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:13 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:21:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:13 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:21:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:13 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:21:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:13 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:21:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:13 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:21:13.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:13 smithi133 ceph-mon[125939]: pgmap v12756: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 497 KiB/s wr, 27 op/s 2023-05-08T10:21:14.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:13 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:21:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:13 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:21:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:13 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:21:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:13 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:21:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:13 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:21:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:13 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:21:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:13 smithi096 ceph-mon[124666]: pgmap v12756: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 497 KiB/s wr, 27 op/s 2023-05-08T10:21:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23813.110622 secs 2023-05-08T10:21:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:21:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:21:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:21:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:21:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:21:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:21:14.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:21:14.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:21:14.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:21:14.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:14 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T10:21:14.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:14 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T10:21:14.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:21:14.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:21:14.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:21:14.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:21:14.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:21:14.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:21:14.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:14 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T10:21:14.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:14 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T10:21:14.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:21:14.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:21:14.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:14 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:21:14.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:21:14.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:14 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T10:21:14.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:14 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T10:21:14.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:14 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:21:14.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23813.666242 secs 2023-05-08T10:21:14.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:14 smithi186 ceph-mon[126480]: osdmap e875: 12 total, 12 up, 12 in 2023-05-08T10:21:14.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23813.110622 secs 2023-05-08T10:21:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:21:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:21:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:21:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:21:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:21:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:21:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:21:14.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:21:14.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:21:14.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:14 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T10:21:14.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:14 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T10:21:14.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:21:14.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:21:14.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:21:14.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:21:14.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:21:14.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:21:14.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:14 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T10:21:14.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:14 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T10:21:14.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:21:14.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:21:14.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:14 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:21:14.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:21:14.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:14 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T10:21:14.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:14 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T10:21:14.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:14 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:21:14.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23813.666242 secs 2023-05-08T10:21:14.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:14 smithi133 ceph-mon[125939]: osdmap e875: 12 total, 12 up, 12 in 2023-05-08T10:21:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23813.110622 secs 2023-05-08T10:21:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:21:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:21:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:21:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:21:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:21:15.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:21:15.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:21:15.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:21:15.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:21:15.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:14 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T10:21:15.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:14 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T10:21:15.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:21:15.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:21:15.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:21:15.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:21:15.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:21:15.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:21:15.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:14 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T10:21:15.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:14 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T10:21:15.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:21:15.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:21:15.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:14 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:21:15.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:21:15.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:14 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T10:21:15.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:14 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T10:21:15.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:14 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:21:15.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23813.666242 secs 2023-05-08T10:21:15.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:14 smithi096 ceph-mon[124666]: osdmap e875: 12 total, 12 up, 12 in 2023-05-08T10:21:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:15 smithi186 ceph-mon[126480]: pgmap v12758: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 179 KiB/s wr, 7 op/s 2023-05-08T10:21:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23814.953638 secs 2023-05-08T10:21:15.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:15 smithi133 ceph-mon[125939]: pgmap v12758: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 179 KiB/s wr, 7 op/s 2023-05-08T10:21:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23814.953638 secs 2023-05-08T10:21:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:15 smithi096 ceph-mon[124666]: pgmap v12758: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 179 KiB/s wr, 7 op/s 2023-05-08T10:21:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23814.953638 secs 2023-05-08T10:21:18.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:18 smithi133 ceph-mon[125939]: pgmap v12759: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 173 KiB/s wr, 7 op/s 2023-05-08T10:21:18.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:18 smithi096 ceph-mon[124666]: pgmap v12759: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 173 KiB/s wr, 7 op/s 2023-05-08T10:21:18.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:18 smithi186 ceph-mon[126480]: pgmap v12759: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 173 KiB/s wr, 7 op/s 2023-05-08T10:21:19.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23818.110730 secs 2023-05-08T10:21:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23818.666364 secs 2023-05-08T10:21:19.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23818.110730 secs 2023-05-08T10:21:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23818.666364 secs 2023-05-08T10:21:19.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23818.110730 secs 2023-05-08T10:21:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23818.666364 secs 2023-05-08T10:21:20.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:20 smithi133 ceph-mon[125939]: pgmap v12760: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 141 KiB/s wr, 7 op/s 2023-05-08T10:21:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:20 smithi096 ceph-mon[124666]: pgmap v12760: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 141 KiB/s wr, 7 op/s 2023-05-08T10:21:20.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:20 smithi186 ceph-mon[126480]: pgmap v12760: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 141 KiB/s wr, 7 op/s 2023-05-08T10:21:21.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23819.953798 secs 2023-05-08T10:21:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23819.953798 secs 2023-05-08T10:21:21.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23819.953798 secs 2023-05-08T10:21:22.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:22 smithi133 ceph-mon[125939]: pgmap v12761: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 141 KiB/s wr, 7 op/s 2023-05-08T10:21:22.509 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:22 smithi096 ceph-mon[124666]: pgmap v12761: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 141 KiB/s wr, 7 op/s 2023-05-08T10:21:22.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:22 smithi186 ceph-mon[126480]: pgmap v12761: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 141 KiB/s wr, 7 op/s 2023-05-08T10:21:24.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:24 smithi133 ceph-mon[125939]: pgmap v12762: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 141 KiB/s wr, 7 op/s 2023-05-08T10:21:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23823.110824 secs 2023-05-08T10:21:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23823.666498 secs 2023-05-08T10:21:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:24 smithi096 ceph-mon[124666]: pgmap v12762: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 141 KiB/s wr, 7 op/s 2023-05-08T10:21:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23823.110824 secs 2023-05-08T10:21:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23823.666498 secs 2023-05-08T10:21:24.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:24 smithi186 ceph-mon[126480]: pgmap v12762: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 141 KiB/s wr, 7 op/s 2023-05-08T10:21:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23823.110824 secs 2023-05-08T10:21:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23823.666498 secs 2023-05-08T10:21:26.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:26 smithi133 ceph-mon[125939]: pgmap v12763: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 57 KiB/s wr, 7 op/s 2023-05-08T10:21:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23824.953919 secs 2023-05-08T10:21:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:26 smithi096 ceph-mon[124666]: pgmap v12763: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 57 KiB/s wr, 7 op/s 2023-05-08T10:21:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23824.953919 secs 2023-05-08T10:21:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:26 smithi186 ceph-mon[126480]: pgmap v12763: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 57 KiB/s wr, 7 op/s 2023-05-08T10:21:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23824.953919 secs 2023-05-08T10:21:28.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:28 smithi133 ceph-mon[125939]: pgmap v12764: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 52 KiB/s wr, 6 op/s 2023-05-08T10:21:28.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:28 smithi096 ceph-mon[124666]: pgmap v12764: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 52 KiB/s wr, 6 op/s 2023-05-08T10:21:28.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:28 smithi186 ceph-mon[126480]: pgmap v12764: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 52 KiB/s wr, 6 op/s 2023-05-08T10:21:29.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23828.110934 secs 2023-05-08T10:21:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23828.666560 secs 2023-05-08T10:21:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23828.110934 secs 2023-05-08T10:21:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23828.666560 secs 2023-05-08T10:21:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23828.110934 secs 2023-05-08T10:21:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23828.666560 secs 2023-05-08T10:21:30.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:30 smithi133 ceph-mon[125939]: pgmap v12765: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 52 KiB/s wr, 8 op/s 2023-05-08T10:21:30.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:30 smithi096 ceph-mon[124666]: pgmap v12765: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 52 KiB/s wr, 8 op/s 2023-05-08T10:21:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:30 smithi186 ceph-mon[126480]: pgmap v12765: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 52 KiB/s wr, 8 op/s 2023-05-08T10:21:31.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23829.954036 secs 2023-05-08T10:21:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23829.954036 secs 2023-05-08T10:21:31.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23829.954036 secs 2023-05-08T10:21:32.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:32 smithi133 ceph-mon[125939]: pgmap v12766: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2023-05-08T10:21:32.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:32 smithi096 ceph-mon[124666]: pgmap v12766: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2023-05-08T10:21:32.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:32 smithi186 ceph-mon[126480]: pgmap v12766: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2023-05-08T10:21:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:34 smithi133 ceph-mon[125939]: pgmap v12767: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:21:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23833.111066 secs 2023-05-08T10:21:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23833.666687 secs 2023-05-08T10:21:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:34 smithi096 ceph-mon[124666]: pgmap v12767: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:21:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23833.111066 secs 2023-05-08T10:21:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23833.666687 secs 2023-05-08T10:21:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:34 smithi186 ceph-mon[126480]: pgmap v12767: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:21:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23833.111066 secs 2023-05-08T10:21:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23833.666687 secs 2023-05-08T10:21:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:36 smithi133 ceph-mon[125939]: pgmap v12768: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 682 B/s wr, 9 op/s 2023-05-08T10:21:36.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23834.954166 secs 2023-05-08T10:21:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:36 smithi096 ceph-mon[124666]: pgmap v12768: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 682 B/s wr, 9 op/s 2023-05-08T10:21:36.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23834.954166 secs 2023-05-08T10:21:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:36 smithi186 ceph-mon[126480]: pgmap v12768: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 682 B/s wr, 9 op/s 2023-05-08T10:21:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23834.954166 secs 2023-05-08T10:21:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:38 smithi096 ceph-mon[124666]: pgmap v12769: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 682 B/s wr, 6 op/s 2023-05-08T10:21:38.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:38 smithi186 ceph-mon[126480]: pgmap v12769: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 682 B/s wr, 6 op/s 2023-05-08T10:21:38.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:38 smithi133 ceph-mon[125939]: pgmap v12769: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 682 B/s wr, 6 op/s 2023-05-08T10:21:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23838.111186 secs 2023-05-08T10:21:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23838.666757 secs 2023-05-08T10:21:39.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23838.111186 secs 2023-05-08T10:21:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23838.666757 secs 2023-05-08T10:21:39.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23838.111186 secs 2023-05-08T10:21:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23838.666757 secs 2023-05-08T10:21:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:40 smithi096 ceph-mon[124666]: pgmap v12770: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 173 KiB/s wr, 9 op/s 2023-05-08T10:21:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:40 smithi186 ceph-mon[126480]: pgmap v12770: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 173 KiB/s wr, 9 op/s 2023-05-08T10:21:40.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:40 smithi133 ceph-mon[125939]: pgmap v12770: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 173 KiB/s wr, 9 op/s 2023-05-08T10:21:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:42 smithi096 ceph-mon[124666]: pgmap v12771: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 173 KiB/s wr, 7 op/s 2023-05-08T10:21:42.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:42 smithi186 ceph-mon[126480]: pgmap v12771: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 173 KiB/s wr, 7 op/s 2023-05-08T10:21:42.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:42 smithi133 ceph-mon[125939]: pgmap v12771: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 173 KiB/s wr, 7 op/s 2023-05-08T10:21:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:44 smithi096 ceph-mon[124666]: pgmap v12772: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 173 KiB/s wr, 6 op/s 2023-05-08T10:21:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23843.111304 secs 2023-05-08T10:21:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:44 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:21:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23843.666885 secs 2023-05-08T10:21:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:44 smithi186 ceph-mon[126480]: pgmap v12772: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 173 KiB/s wr, 6 op/s 2023-05-08T10:21:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23843.111304 secs 2023-05-08T10:21:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:44 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:21:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23843.666885 secs 2023-05-08T10:21:44.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:44 smithi133 ceph-mon[125939]: pgmap v12772: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 173 KiB/s wr, 6 op/s 2023-05-08T10:21:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23843.111304 secs 2023-05-08T10:21:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:44 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:21:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23843.666885 secs 2023-05-08T10:21:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:45 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:21:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:45 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:21:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:45 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:21:45.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:45 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:21:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:45 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:21:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:45 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:21:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:45 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:21:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:45 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:21:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:45 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:21:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:46 smithi186 ceph-mon[126480]: pgmap v12773: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 179 KiB/s wr, 10 op/s 2023-05-08T10:21:46.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:46 smithi133 ceph-mon[125939]: pgmap v12773: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 179 KiB/s wr, 10 op/s 2023-05-08T10:21:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:46 smithi096 ceph-mon[124666]: pgmap v12773: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 179 KiB/s wr, 10 op/s 2023-05-08T10:21:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:48 smithi186 ceph-mon[126480]: pgmap v12774: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 179 KiB/s wr, 7 op/s 2023-05-08T10:21:48.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:48 smithi133 ceph-mon[125939]: pgmap v12774: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 179 KiB/s wr, 7 op/s 2023-05-08T10:21:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:48 smithi096 ceph-mon[124666]: pgmap v12774: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 179 KiB/s wr, 7 op/s 2023-05-08T10:21:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23848.111419 secs 2023-05-08T10:21:49.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23848.111419 secs 2023-05-08T10:21:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23848.111419 secs 2023-05-08T10:21:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:50 smithi186 ceph-mon[126480]: pgmap v12775: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 344 KiB/s wr, 10 op/s 2023-05-08T10:21:50.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:50 smithi133 ceph-mon[125939]: pgmap v12775: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 344 KiB/s wr, 10 op/s 2023-05-08T10:21:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:50 smithi096 ceph-mon[124666]: pgmap v12775: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 344 KiB/s wr, 10 op/s 2023-05-08T10:21:51.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23849.954538 secs 2023-05-08T10:21:51.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23849.954538 secs 2023-05-08T10:21:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23849.954538 secs 2023-05-08T10:21:52.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:52 smithi186 ceph-mon[126480]: pgmap v12776: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 272 KiB/s wr, 9 op/s 2023-05-08T10:21:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:21:52.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:52 smithi133 ceph-mon[125939]: pgmap v12776: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 272 KiB/s wr, 9 op/s 2023-05-08T10:21:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:21:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:52 smithi096 ceph-mon[124666]: pgmap v12776: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 272 KiB/s wr, 9 op/s 2023-05-08T10:21:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:21:53.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:21:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:21:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:21:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:21:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:21:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:21:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:21:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:21:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:21:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:54 smithi186 ceph-mon[126480]: pgmap v12777: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 272 KiB/s wr, 8 op/s 2023-05-08T10:21:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23853.111535 secs 2023-05-08T10:21:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:54 smithi133 ceph-mon[125939]: pgmap v12777: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 272 KiB/s wr, 8 op/s 2023-05-08T10:21:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23853.111535 secs 2023-05-08T10:21:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:54 smithi096 ceph-mon[124666]: pgmap v12777: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 272 KiB/s wr, 8 op/s 2023-05-08T10:21:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23853.111535 secs 2023-05-08T10:21:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:56 smithi186 ceph-mon[126480]: pgmap v12778: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 678 KiB/s rd, 493 KiB/s wr, 13 op/s 2023-05-08T10:21:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23854.954657 secs 2023-05-08T10:21:56.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:56 smithi133 ceph-mon[125939]: pgmap v12778: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 678 KiB/s rd, 493 KiB/s wr, 13 op/s 2023-05-08T10:21:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23854.954657 secs 2023-05-08T10:21:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:56 smithi096 ceph-mon[124666]: pgmap v12778: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 678 KiB/s rd, 493 KiB/s wr, 13 op/s 2023-05-08T10:21:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23854.954657 secs 2023-05-08T10:21:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:58 smithi186 ceph-mon[126480]: pgmap v12779: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 499 KiB/s rd, 486 KiB/s wr, 9 op/s 2023-05-08T10:21:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:58 smithi133 ceph-mon[125939]: pgmap v12779: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 499 KiB/s rd, 486 KiB/s wr, 9 op/s 2023-05-08T10:21:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:58 smithi096 ceph-mon[124666]: pgmap v12779: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 499 KiB/s rd, 486 KiB/s wr, 9 op/s 2023-05-08T10:21:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:21:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23858.111639 secs 2023-05-08T10:21:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:21:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23858.111639 secs 2023-05-08T10:21:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:21:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23858.111639 secs 2023-05-08T10:22:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:00 smithi186 ceph-mon[126480]: pgmap v12780: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 699 KiB/s rd, 685 KiB/s wr, 12 op/s 2023-05-08T10:22:00.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:00 smithi133 ceph-mon[125939]: pgmap v12780: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 699 KiB/s rd, 685 KiB/s wr, 12 op/s 2023-05-08T10:22:00.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:00 smithi096 ceph-mon[124666]: pgmap v12780: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 699 KiB/s rd, 685 KiB/s wr, 12 op/s 2023-05-08T10:22:01.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23859.954833 secs 2023-05-08T10:22:01.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23859.954833 secs 2023-05-08T10:22:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23859.954833 secs 2023-05-08T10:22:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:02 smithi186 ceph-mon[126480]: pgmap v12781: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 584 KiB/s rd, 571 KiB/s wr, 12 op/s 2023-05-08T10:22:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:02 smithi133 ceph-mon[125939]: pgmap v12781: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 584 KiB/s rd, 571 KiB/s wr, 12 op/s 2023-05-08T10:22:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:02 smithi096 ceph-mon[124666]: pgmap v12781: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 584 KiB/s rd, 571 KiB/s wr, 12 op/s 2023-05-08T10:22:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:04 smithi186 ceph-mon[126480]: pgmap v12782: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 471 KiB/s wr, 10 op/s 2023-05-08T10:22:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23863.111756 secs 2023-05-08T10:22:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23863.667383 secs 2023-05-08T10:22:04.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:04 smithi133 ceph-mon[125939]: pgmap v12782: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 471 KiB/s wr, 10 op/s 2023-05-08T10:22:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23863.111756 secs 2023-05-08T10:22:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23863.667383 secs 2023-05-08T10:22:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:04 smithi096 ceph-mon[124666]: pgmap v12782: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 471 KiB/s wr, 10 op/s 2023-05-08T10:22:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23863.111756 secs 2023-05-08T10:22:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23863.667383 secs 2023-05-08T10:22:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:06 smithi186 ceph-mon[126480]: pgmap v12783: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 618 KiB/s rd, 641 KiB/s wr, 30 op/s 2023-05-08T10:22:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23864.954969 secs 2023-05-08T10:22:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:06 smithi186 ceph-mon[126480]: osdmap e876: 12 total, 12 up, 12 in 2023-05-08T10:22:06.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:06 smithi133 ceph-mon[125939]: pgmap v12783: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 618 KiB/s rd, 641 KiB/s wr, 30 op/s 2023-05-08T10:22:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23864.954969 secs 2023-05-08T10:22:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:06 smithi133 ceph-mon[125939]: osdmap e876: 12 total, 12 up, 12 in 2023-05-08T10:22:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:06 smithi096 ceph-mon[124666]: pgmap v12783: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 618 KiB/s rd, 641 KiB/s wr, 30 op/s 2023-05-08T10:22:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23864.954969 secs 2023-05-08T10:22:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:06 smithi096 ceph-mon[124666]: osdmap e876: 12 total, 12 up, 12 in 2023-05-08T10:22:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:08 smithi186 ceph-mon[126480]: pgmap v12785: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 504 KiB/s wr, 30 op/s 2023-05-08T10:22:08.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:08 smithi133 ceph-mon[125939]: pgmap v12785: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 504 KiB/s wr, 30 op/s 2023-05-08T10:22:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:08 smithi096 ceph-mon[124666]: pgmap v12785: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 504 KiB/s wr, 30 op/s 2023-05-08T10:22:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:09 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:22:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:22:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:22:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23868.111851 secs 2023-05-08T10:22:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23868.667460 secs 2023-05-08T10:22:09.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:09 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:22:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:22:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:22:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23868.111851 secs 2023-05-08T10:22:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23868.667460 secs 2023-05-08T10:22:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:09 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:22:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:22:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:22:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23868.111851 secs 2023-05-08T10:22:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23868.667460 secs 2023-05-08T10:22:10.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:10 smithi186 ceph-mon[126480]: pgmap v12786: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 376 KiB/s wr, 30 op/s 2023-05-08T10:22:10.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:10 smithi133 ceph-mon[125939]: pgmap v12786: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 376 KiB/s wr, 30 op/s 2023-05-08T10:22:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:10 smithi096 ceph-mon[124666]: pgmap v12786: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 376 KiB/s wr, 30 op/s 2023-05-08T10:22:11.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23869.955068 secs 2023-05-08T10:22:11.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23869.955068 secs 2023-05-08T10:22:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23869.955068 secs 2023-05-08T10:22:12.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:12 smithi186 ceph-mon[126480]: pgmap v12787: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 314 KiB/s wr, 28 op/s 2023-05-08T10:22:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:12 smithi133 ceph-mon[125939]: pgmap v12787: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 314 KiB/s wr, 28 op/s 2023-05-08T10:22:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:12 smithi096 ceph-mon[124666]: pgmap v12787: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 314 KiB/s wr, 28 op/s 2023-05-08T10:22:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:14 smithi186 ceph-mon[126480]: pgmap v12788: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 314 KiB/s wr, 28 op/s 2023-05-08T10:22:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23873.111988 secs 2023-05-08T10:22:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:14 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:22:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23873.667531 secs 2023-05-08T10:22:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:14 smithi186 ceph-mon[126480]: osdmap e877: 12 total, 12 up, 12 in 2023-05-08T10:22:14.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:14 smithi133 ceph-mon[125939]: pgmap v12788: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 314 KiB/s wr, 28 op/s 2023-05-08T10:22:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23873.111988 secs 2023-05-08T10:22:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:14 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:22:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23873.667531 secs 2023-05-08T10:22:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:14 smithi133 ceph-mon[125939]: osdmap e877: 12 total, 12 up, 12 in 2023-05-08T10:22:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:14 smithi096 ceph-mon[124666]: pgmap v12788: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 314 KiB/s wr, 28 op/s 2023-05-08T10:22:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23873.111988 secs 2023-05-08T10:22:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:14 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:22:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23873.667531 secs 2023-05-08T10:22:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:14 smithi096 ceph-mon[124666]: osdmap e877: 12 total, 12 up, 12 in 2023-05-08T10:22:15.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:15 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:22:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:15 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:22:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:15 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:22:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:15 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:22:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:15 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:22:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:15 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:22:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:15 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:22:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:15 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:22:15.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:15 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:22:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:16 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:22:16.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:16 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T10:22:16.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:16 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T10:22:16.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:16 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:22:16.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:16 smithi186 ceph-mon[126480]: pgmap v12790: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 301 KiB/s wr, 9 op/s 2023-05-08T10:22:16.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23874.955184 secs 2023-05-08T10:22:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:16 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:22:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:16 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T10:22:16.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:16 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T10:22:16.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:16 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:22:16.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:16 smithi133 ceph-mon[125939]: pgmap v12790: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 301 KiB/s wr, 9 op/s 2023-05-08T10:22:16.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23874.955184 secs 2023-05-08T10:22:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:16 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:22:16.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:16 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T10:22:16.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:16 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T10:22:16.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:16 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:22:16.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:16 smithi096 ceph-mon[124666]: pgmap v12790: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 301 KiB/s wr, 9 op/s 2023-05-08T10:22:16.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23874.955184 secs 2023-05-08T10:22:18.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:18 smithi186 ceph-mon[126480]: pgmap v12791: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 296 KiB/s wr, 8 op/s 2023-05-08T10:22:18.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:18 smithi133 ceph-mon[125939]: pgmap v12791: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 296 KiB/s wr, 8 op/s 2023-05-08T10:22:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:18 smithi096 ceph-mon[124666]: pgmap v12791: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 296 KiB/s wr, 8 op/s 2023-05-08T10:22:19.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23878.112125 secs 2023-05-08T10:22:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23878.667652 secs 2023-05-08T10:22:19.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23878.112125 secs 2023-05-08T10:22:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23878.667652 secs 2023-05-08T10:22:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23878.112125 secs 2023-05-08T10:22:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23878.667652 secs 2023-05-08T10:22:20.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:20 smithi186 ceph-mon[126480]: pgmap v12792: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 185 KiB/s wr, 7 op/s 2023-05-08T10:22:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:20 smithi133 ceph-mon[125939]: pgmap v12792: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 185 KiB/s wr, 7 op/s 2023-05-08T10:22:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:20 smithi096 ceph-mon[124666]: pgmap v12792: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 185 KiB/s wr, 7 op/s 2023-05-08T10:22:21.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23879.955314 secs 2023-05-08T10:22:21.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23879.955314 secs 2023-05-08T10:22:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23879.955314 secs 2023-05-08T10:22:22.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:22 smithi186 ceph-mon[126480]: pgmap v12793: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 185 KiB/s wr, 6 op/s 2023-05-08T10:22:22.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:22 smithi133 ceph-mon[125939]: pgmap v12793: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 185 KiB/s wr, 6 op/s 2023-05-08T10:22:22.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:22 smithi096 ceph-mon[124666]: pgmap v12793: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 185 KiB/s wr, 6 op/s 2023-05-08T10:22:24.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:24 smithi186 ceph-mon[126480]: pgmap v12794: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 185 KiB/s wr, 6 op/s 2023-05-08T10:22:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23883.112242 secs 2023-05-08T10:22:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23883.667787 secs 2023-05-08T10:22:24.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:24 smithi133 ceph-mon[125939]: pgmap v12794: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 185 KiB/s wr, 6 op/s 2023-05-08T10:22:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23883.112242 secs 2023-05-08T10:22:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23883.667787 secs 2023-05-08T10:22:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:24 smithi096 ceph-mon[124666]: pgmap v12794: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 185 KiB/s wr, 6 op/s 2023-05-08T10:22:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23883.112242 secs 2023-05-08T10:22:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23883.667787 secs 2023-05-08T10:22:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:26 smithi186 ceph-mon[126480]: pgmap v12795: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 0 B/s wr, 5 op/s 2023-05-08T10:22:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23884.955449 secs 2023-05-08T10:22:26.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:26 smithi133 ceph-mon[125939]: pgmap v12795: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 0 B/s wr, 5 op/s 2023-05-08T10:22:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23884.955449 secs 2023-05-08T10:22:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:26 smithi096 ceph-mon[124666]: pgmap v12795: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 0 B/s wr, 5 op/s 2023-05-08T10:22:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23884.955449 secs 2023-05-08T10:22:28.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:28 smithi133 ceph-mon[125939]: pgmap v12796: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:22:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:28 smithi096 ceph-mon[124666]: pgmap v12796: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:22:28.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:28 smithi186 ceph-mon[126480]: pgmap v12796: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:22:29.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23888.112350 secs 2023-05-08T10:22:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23888.667895 secs 2023-05-08T10:22:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23888.112350 secs 2023-05-08T10:22:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23888.667895 secs 2023-05-08T10:22:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23888.112350 secs 2023-05-08T10:22:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23888.667895 secs 2023-05-08T10:22:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:30 smithi133 ceph-mon[125939]: pgmap v12797: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2023-05-08T10:22:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:30 smithi096 ceph-mon[124666]: pgmap v12797: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2023-05-08T10:22:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:30 smithi186 ceph-mon[126480]: pgmap v12797: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2023-05-08T10:22:31.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23889.955572 secs 2023-05-08T10:22:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23889.955572 secs 2023-05-08T10:22:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23889.955572 secs 2023-05-08T10:22:32.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:32 smithi133 ceph-mon[125939]: pgmap v12798: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T10:22:32.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:32 smithi096 ceph-mon[124666]: pgmap v12798: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T10:22:32.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:32 smithi186 ceph-mon[126480]: pgmap v12798: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T10:22:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:34 smithi133 ceph-mon[125939]: pgmap v12799: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T10:22:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23893.112468 secs 2023-05-08T10:22:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23893.668033 secs 2023-05-08T10:22:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:34 smithi096 ceph-mon[124666]: pgmap v12799: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T10:22:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23893.112468 secs 2023-05-08T10:22:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23893.668033 secs 2023-05-08T10:22:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:34 smithi186 ceph-mon[126480]: pgmap v12799: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T10:22:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23893.112468 secs 2023-05-08T10:22:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23893.668033 secs 2023-05-08T10:22:36.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:36 smithi133 ceph-mon[125939]: pgmap v12800: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 938 B/s wr, 8 op/s 2023-05-08T10:22:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23894.955670 secs 2023-05-08T10:22:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:36 smithi096 ceph-mon[124666]: pgmap v12800: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 938 B/s wr, 8 op/s 2023-05-08T10:22:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23894.955670 secs 2023-05-08T10:22:36.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:36 smithi186 ceph-mon[126480]: pgmap v12800: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 938 B/s wr, 8 op/s 2023-05-08T10:22:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23894.955670 secs 2023-05-08T10:22:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:38 smithi133 ceph-mon[125939]: pgmap v12801: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T10:22:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:38 smithi096 ceph-mon[124666]: pgmap v12801: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T10:22:38.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:38 smithi186 ceph-mon[126480]: pgmap v12801: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T10:22:39.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23898.112589 secs 2023-05-08T10:22:39.744 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23898.668148 secs 2023-05-08T10:22:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23898.112589 secs 2023-05-08T10:22:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23898.668148 secs 2023-05-08T10:22:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23898.112589 secs 2023-05-08T10:22:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23898.668148 secs 2023-05-08T10:22:40.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:40 smithi133 ceph-mon[125939]: pgmap v12802: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 85 KiB/s wr, 8 op/s 2023-05-08T10:22:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:40 smithi096 ceph-mon[124666]: pgmap v12802: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 85 KiB/s wr, 8 op/s 2023-05-08T10:22:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:40 smithi186 ceph-mon[126480]: pgmap v12802: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 85 KiB/s wr, 8 op/s 2023-05-08T10:22:42.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:42 smithi133 ceph-mon[125939]: pgmap v12803: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 KiB/s wr, 7 op/s 2023-05-08T10:22:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:42 smithi096 ceph-mon[124666]: pgmap v12803: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 KiB/s wr, 7 op/s 2023-05-08T10:22:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:42 smithi186 ceph-mon[126480]: pgmap v12803: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 KiB/s wr, 7 op/s 2023-05-08T10:22:44.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:44 smithi133 ceph-mon[125939]: pgmap v12804: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 KiB/s wr, 6 op/s 2023-05-08T10:22:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23903.112711 secs 2023-05-08T10:22:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:44 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:22:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23903.668260 secs 2023-05-08T10:22:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:44 smithi096 ceph-mon[124666]: pgmap v12804: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 KiB/s wr, 6 op/s 2023-05-08T10:22:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23903.112711 secs 2023-05-08T10:22:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:44 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:22:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23903.668260 secs 2023-05-08T10:22:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:44 smithi186 ceph-mon[126480]: pgmap v12804: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 KiB/s wr, 6 op/s 2023-05-08T10:22:44.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23903.112711 secs 2023-05-08T10:22:44.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:44 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:22:44.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23903.668260 secs 2023-05-08T10:22:45.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:45 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:22:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:45 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:22:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:45 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:22:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:45 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:22:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:45 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:22:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:45 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:22:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:45 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:22:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:45 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:22:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:45 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:22:46.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:46 smithi133 ceph-mon[125939]: pgmap v12805: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 170 KiB/s wr, 10 op/s 2023-05-08T10:22:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:46 smithi096 ceph-mon[124666]: pgmap v12805: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 170 KiB/s wr, 10 op/s 2023-05-08T10:22:46.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:46 smithi186 ceph-mon[126480]: pgmap v12805: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 170 KiB/s wr, 10 op/s 2023-05-08T10:22:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:48 smithi133 ceph-mon[125939]: pgmap v12806: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 169 KiB/s wr, 6 op/s 2023-05-08T10:22:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:48 smithi096 ceph-mon[124666]: pgmap v12806: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 169 KiB/s wr, 6 op/s 2023-05-08T10:22:48.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:48 smithi186 ceph-mon[126480]: pgmap v12806: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 169 KiB/s wr, 6 op/s 2023-05-08T10:22:49.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23908.112826 secs 2023-05-08T10:22:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23908.668380 secs 2023-05-08T10:22:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23908.112826 secs 2023-05-08T10:22:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23908.668380 secs 2023-05-08T10:22:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23908.112826 secs 2023-05-08T10:22:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23908.668380 secs 2023-05-08T10:22:50.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:50 smithi133 ceph-mon[125939]: pgmap v12807: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 339 KiB/s wr, 9 op/s 2023-05-08T10:22:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:50 smithi096 ceph-mon[124666]: pgmap v12807: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 339 KiB/s wr, 9 op/s 2023-05-08T10:22:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:50 smithi186 ceph-mon[126480]: pgmap v12807: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 339 KiB/s wr, 9 op/s 2023-05-08T10:22:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:52 smithi133 ceph-mon[125939]: pgmap v12808: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 255 KiB/s wr, 8 op/s 2023-05-08T10:22:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:52 smithi096 ceph-mon[124666]: pgmap v12808: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 255 KiB/s wr, 8 op/s 2023-05-08T10:22:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:52 smithi186 ceph-mon[126480]: pgmap v12808: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 255 KiB/s wr, 8 op/s 2023-05-08T10:22:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:54 smithi133 ceph-mon[125939]: pgmap v12809: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 255 KiB/s wr, 7 op/s 2023-05-08T10:22:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23913.112889 secs 2023-05-08T10:22:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:54 smithi096 ceph-mon[124666]: pgmap v12809: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 255 KiB/s wr, 7 op/s 2023-05-08T10:22:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23913.112889 secs 2023-05-08T10:22:54.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:54 smithi186 ceph-mon[126480]: pgmap v12809: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 255 KiB/s wr, 7 op/s 2023-05-08T10:22:54.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23913.112889 secs 2023-05-08T10:22:56.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:56 smithi133 ceph-mon[125939]: pgmap v12810: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 621 KiB/s wr, 12 op/s 2023-05-08T10:22:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23914.956108 secs 2023-05-08T10:22:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:22:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:56 smithi096 ceph-mon[124666]: pgmap v12810: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 621 KiB/s wr, 12 op/s 2023-05-08T10:22:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23914.956108 secs 2023-05-08T10:22:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:22:56.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:56 smithi186 ceph-mon[126480]: pgmap v12810: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 621 KiB/s wr, 12 op/s 2023-05-08T10:22:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23914.956108 secs 2023-05-08T10:22:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:22:57.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:22:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:22:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:22:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:22:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:22:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:22:57.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:22:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:22:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:22:58.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:58 smithi133 ceph-mon[125939]: pgmap v12811: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 536 KiB/s wr, 8 op/s 2023-05-08T10:22:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:58 smithi096 ceph-mon[124666]: pgmap v12811: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 536 KiB/s wr, 8 op/s 2023-05-08T10:22:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:58 smithi186 ceph-mon[126480]: pgmap v12811: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 536 KiB/s wr, 8 op/s 2023-05-08T10:22:59.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23918.113011 secs 2023-05-08T10:22:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:22:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23918.668600 secs 2023-05-08T10:22:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23918.113011 secs 2023-05-08T10:22:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:22:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23918.668600 secs 2023-05-08T10:22:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23918.113011 secs 2023-05-08T10:22:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:22:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23918.668600 secs 2023-05-08T10:23:00.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:00 smithi133 ceph-mon[125939]: pgmap v12812: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 699 KiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T10:23:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23919.956259 secs 2023-05-08T10:23:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:00 smithi096 ceph-mon[124666]: pgmap v12812: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 699 KiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T10:23:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23919.956259 secs 2023-05-08T10:23:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:00 smithi186 ceph-mon[126480]: pgmap v12812: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 699 KiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T10:23:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23919.956259 secs 2023-05-08T10:23:01.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:01 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:23:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:23:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:23:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:01 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:23:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:23:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:23:01.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:01 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:23:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:23:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:23:02.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:02 smithi133 ceph-mon[125939]: pgmap v12813: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 557 KiB/s rd, 1005 KiB/s wr, 11 op/s 2023-05-08T10:23:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:02 smithi096 ceph-mon[124666]: pgmap v12813: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 557 KiB/s rd, 1005 KiB/s wr, 11 op/s 2023-05-08T10:23:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:02 smithi186 ceph-mon[126480]: pgmap v12813: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 557 KiB/s rd, 1005 KiB/s wr, 11 op/s 2023-05-08T10:23:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:04 smithi133 ceph-mon[125939]: pgmap v12814: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 557 KiB/s rd, 1005 KiB/s wr, 10 op/s 2023-05-08T10:23:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23923.113130 secs 2023-05-08T10:23:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23923.668664 secs 2023-05-08T10:23:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:04 smithi096 ceph-mon[124666]: pgmap v12814: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 557 KiB/s rd, 1005 KiB/s wr, 10 op/s 2023-05-08T10:23:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23923.113130 secs 2023-05-08T10:23:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23923.668664 secs 2023-05-08T10:23:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:04 smithi186 ceph-mon[126480]: pgmap v12814: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 557 KiB/s rd, 1005 KiB/s wr, 10 op/s 2023-05-08T10:23:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23923.113130 secs 2023-05-08T10:23:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23923.668664 secs 2023-05-08T10:23:06.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:06 smithi133 ceph-mon[125939]: pgmap v12815: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1022 KiB/s rd, 1011 KiB/s wr, 17 op/s 2023-05-08T10:23:06.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:06 smithi096 ceph-mon[124666]: pgmap v12815: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1022 KiB/s rd, 1011 KiB/s wr, 17 op/s 2023-05-08T10:23:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:06 smithi186 ceph-mon[126480]: pgmap v12815: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1022 KiB/s rd, 1011 KiB/s wr, 17 op/s 2023-05-08T10:23:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:08 smithi133 ceph-mon[125939]: pgmap v12816: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 990 KiB/s rd, 645 KiB/s wr, 12 op/s 2023-05-08T10:23:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:08 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:23:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:08 smithi096 ceph-mon[124666]: pgmap v12816: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 990 KiB/s rd, 645 KiB/s wr, 12 op/s 2023-05-08T10:23:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:08 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:23:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:08 smithi186 ceph-mon[126480]: pgmap v12816: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 990 KiB/s rd, 645 KiB/s wr, 12 op/s 2023-05-08T10:23:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:08 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:23:09.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23928.113264 secs 2023-05-08T10:23:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:09 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:23:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:23:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:23:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23928.113264 secs 2023-05-08T10:23:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:09 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:23:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:23:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:23:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23928.113264 secs 2023-05-08T10:23:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:09 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:23:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:23:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:23:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:10 smithi133 ceph-mon[125939]: pgmap v12817: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 17 op/s 2023-05-08T10:23:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23929.956516 secs 2023-05-08T10:23:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:10 smithi096 ceph-mon[124666]: pgmap v12817: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 17 op/s 2023-05-08T10:23:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23929.956516 secs 2023-05-08T10:23:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:10 smithi186 ceph-mon[126480]: pgmap v12817: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 17 op/s 2023-05-08T10:23:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23929.956516 secs 2023-05-08T10:23:12.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:12 smithi133 ceph-mon[125939]: osdmap e878: 12 total, 12 up, 12 in 2023-05-08T10:23:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:12 smithi133 ceph-mon[125939]: pgmap v12819: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 989 KiB/s rd, 488 KiB/s wr, 27 op/s 2023-05-08T10:23:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:12 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:23:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:12 smithi096 ceph-mon[124666]: osdmap e878: 12 total, 12 up, 12 in 2023-05-08T10:23:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:12 smithi096 ceph-mon[124666]: pgmap v12819: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 989 KiB/s rd, 488 KiB/s wr, 27 op/s 2023-05-08T10:23:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:12 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:23:12.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:12 smithi186 ceph-mon[126480]: osdmap e878: 12 total, 12 up, 12 in 2023-05-08T10:23:12.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:12 smithi186 ceph-mon[126480]: pgmap v12819: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 989 KiB/s rd, 488 KiB/s wr, 27 op/s 2023-05-08T10:23:12.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:12 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:23:13.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:23:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:23:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:13 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:23:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:23:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:23:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:13 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:23:13.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:23:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:23:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:13 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:23:14.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:14 smithi133 ceph-mon[125939]: pgmap v12820: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 989 KiB/s rd, 488 KiB/s wr, 27 op/s 2023-05-08T10:23:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23933.113359 secs 2023-05-08T10:23:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23933.668914 secs 2023-05-08T10:23:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:14 smithi096 ceph-mon[124666]: pgmap v12820: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 989 KiB/s rd, 488 KiB/s wr, 27 op/s 2023-05-08T10:23:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23933.113359 secs 2023-05-08T10:23:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23933.668914 secs 2023-05-08T10:23:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:14 smithi186 ceph-mon[126480]: pgmap v12820: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 989 KiB/s rd, 488 KiB/s wr, 27 op/s 2023-05-08T10:23:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23933.113359 secs 2023-05-08T10:23:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23933.668914 secs 2023-05-08T10:23:15.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:15 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:23:15.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:15 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:23:15.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:15 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:23:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:16 smithi133 ceph-mon[125939]: pgmap v12821: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 609 KiB/s rd, 751 KiB/s wr, 28 op/s 2023-05-08T10:23:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23934.956630 secs 2023-05-08T10:23:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:16 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:23:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:16 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:23:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:16 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:23:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:16 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:23:16.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:16 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T10:23:16.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:16 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T10:23:16.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:16 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:23:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:16 smithi096 ceph-mon[124666]: pgmap v12821: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 609 KiB/s rd, 751 KiB/s wr, 28 op/s 2023-05-08T10:23:16.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23934.956630 secs 2023-05-08T10:23:16.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:16 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:23:16.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:16 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:23:16.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:16 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:23:16.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:16 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:23:16.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:16 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T10:23:16.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:16 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T10:23:16.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:16 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:23:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:16 smithi186 ceph-mon[126480]: pgmap v12821: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 609 KiB/s rd, 751 KiB/s wr, 28 op/s 2023-05-08T10:23:16.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23934.956630 secs 2023-05-08T10:23:16.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:16 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:23:16.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:16 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:23:16.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:16 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:23:16.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:16 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:23:16.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:16 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T10:23:16.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:16 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T10:23:16.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:16 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:23:17.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:17 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:23:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:17 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:23:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:17 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:23:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:17 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:23:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:17 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:23:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:17 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:23:17.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:17 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:23:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:17 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:23:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:17 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:23:18.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:18 smithi186 ceph-mon[126480]: pgmap v12822: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 609 KiB/s rd, 751 KiB/s wr, 28 op/s 2023-05-08T10:23:18.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:18 smithi133 ceph-mon[125939]: pgmap v12822: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 609 KiB/s rd, 751 KiB/s wr, 28 op/s 2023-05-08T10:23:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:18 smithi096 ceph-mon[124666]: pgmap v12822: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 609 KiB/s rd, 751 KiB/s wr, 28 op/s 2023-05-08T10:23:19.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23938.113469 secs 2023-05-08T10:23:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23938.669031 secs 2023-05-08T10:23:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:19 smithi186 ceph-mon[126480]: osdmap e879: 12 total, 12 up, 12 in 2023-05-08T10:23:19.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23938.113469 secs 2023-05-08T10:23:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23938.669031 secs 2023-05-08T10:23:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:19 smithi133 ceph-mon[125939]: osdmap e879: 12 total, 12 up, 12 in 2023-05-08T10:23:19.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23938.113469 secs 2023-05-08T10:23:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23938.669031 secs 2023-05-08T10:23:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:19 smithi096 ceph-mon[124666]: osdmap e879: 12 total, 12 up, 12 in 2023-05-08T10:23:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:20 smithi186 ceph-mon[126480]: pgmap v12824: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 625 KiB/s rd, 732 KiB/s wr, 16 op/s 2023-05-08T10:23:20.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:20 smithi133 ceph-mon[125939]: pgmap v12824: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 625 KiB/s rd, 732 KiB/s wr, 16 op/s 2023-05-08T10:23:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:20 smithi096 ceph-mon[124666]: pgmap v12824: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 625 KiB/s rd, 732 KiB/s wr, 16 op/s 2023-05-08T10:23:21.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23939.956749 secs 2023-05-08T10:23:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23939.956749 secs 2023-05-08T10:23:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23939.956749 secs 2023-05-08T10:23:22.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:22 smithi186 ceph-mon[126480]: pgmap v12825: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 586 KiB/s wr, 13 op/s 2023-05-08T10:23:22.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:22 smithi133 ceph-mon[125939]: pgmap v12825: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 586 KiB/s wr, 13 op/s 2023-05-08T10:23:22.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:22 smithi096 ceph-mon[124666]: pgmap v12825: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 586 KiB/s wr, 13 op/s 2023-05-08T10:23:24.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:24 smithi186 ceph-mon[126480]: pgmap v12826: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 586 KiB/s wr, 13 op/s 2023-05-08T10:23:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23943.113591 secs 2023-05-08T10:23:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23943.669147 secs 2023-05-08T10:23:24.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:24 smithi133 ceph-mon[125939]: pgmap v12826: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 586 KiB/s wr, 13 op/s 2023-05-08T10:23:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23943.113591 secs 2023-05-08T10:23:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23943.669147 secs 2023-05-08T10:23:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:24 smithi096 ceph-mon[124666]: pgmap v12826: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 586 KiB/s wr, 13 op/s 2023-05-08T10:23:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23943.113591 secs 2023-05-08T10:23:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23943.669147 secs 2023-05-08T10:23:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:26 smithi186 ceph-mon[126480]: pgmap v12827: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 421 KiB/s rd, 316 KiB/s wr, 8 op/s 2023-05-08T10:23:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23944.956870 secs 2023-05-08T10:23:26.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:26 smithi133 ceph-mon[125939]: pgmap v12827: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 421 KiB/s rd, 316 KiB/s wr, 8 op/s 2023-05-08T10:23:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23944.956870 secs 2023-05-08T10:23:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:26 smithi096 ceph-mon[124666]: pgmap v12827: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 421 KiB/s rd, 316 KiB/s wr, 8 op/s 2023-05-08T10:23:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23944.956870 secs 2023-05-08T10:23:28.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:28 smithi186 ceph-mon[126480]: pgmap v12828: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 421 KiB/s rd, 316 KiB/s wr, 8 op/s 2023-05-08T10:23:28.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:28 smithi133 ceph-mon[125939]: pgmap v12828: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 421 KiB/s rd, 316 KiB/s wr, 8 op/s 2023-05-08T10:23:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:28 smithi096 ceph-mon[124666]: pgmap v12828: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 421 KiB/s rd, 316 KiB/s wr, 8 op/s 2023-05-08T10:23:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23948.113738 secs 2023-05-08T10:23:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23948.669272 secs 2023-05-08T10:23:29.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23948.113738 secs 2023-05-08T10:23:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23948.669272 secs 2023-05-08T10:23:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23948.113738 secs 2023-05-08T10:23:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23948.669272 secs 2023-05-08T10:23:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:30 smithi186 ceph-mon[126480]: pgmap v12829: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 79 KiB/s wr, 7 op/s 2023-05-08T10:23:30.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:30 smithi133 ceph-mon[125939]: pgmap v12829: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 79 KiB/s wr, 7 op/s 2023-05-08T10:23:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:30 smithi096 ceph-mon[124666]: pgmap v12829: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 79 KiB/s wr, 7 op/s 2023-05-08T10:23:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23949.956983 secs 2023-05-08T10:23:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23949.956983 secs 2023-05-08T10:23:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23949.956983 secs 2023-05-08T10:23:32.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:32 smithi186 ceph-mon[126480]: pgmap v12830: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 66 KiB/s wr, 6 op/s 2023-05-08T10:23:32.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:32 smithi133 ceph-mon[125939]: pgmap v12830: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 66 KiB/s wr, 6 op/s 2023-05-08T10:23:32.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:32 smithi096 ceph-mon[124666]: pgmap v12830: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 66 KiB/s wr, 6 op/s 2023-05-08T10:23:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:34 smithi186 ceph-mon[126480]: pgmap v12831: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 66 KiB/s wr, 5 op/s 2023-05-08T10:23:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23953.113877 secs 2023-05-08T10:23:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23953.669409 secs 2023-05-08T10:23:34.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:34 smithi133 ceph-mon[125939]: pgmap v12831: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 66 KiB/s wr, 5 op/s 2023-05-08T10:23:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23953.113877 secs 2023-05-08T10:23:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23953.669409 secs 2023-05-08T10:23:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:34 smithi096 ceph-mon[124666]: pgmap v12831: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 66 KiB/s wr, 5 op/s 2023-05-08T10:23:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23953.113877 secs 2023-05-08T10:23:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23953.669409 secs 2023-05-08T10:23:36.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:36 smithi133 ceph-mon[125939]: pgmap v12832: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 66 KiB/s wr, 8 op/s 2023-05-08T10:23:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23954.957097 secs 2023-05-08T10:23:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:36 smithi096 ceph-mon[124666]: pgmap v12832: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 66 KiB/s wr, 8 op/s 2023-05-08T10:23:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23954.957097 secs 2023-05-08T10:23:36.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:36 smithi186 ceph-mon[126480]: pgmap v12832: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 66 KiB/s wr, 8 op/s 2023-05-08T10:23:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23954.957097 secs 2023-05-08T10:23:38.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:38 smithi133 ceph-mon[125939]: pgmap v12833: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 66 KiB/s wr, 5 op/s 2023-05-08T10:23:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:38 smithi096 ceph-mon[124666]: pgmap v12833: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 66 KiB/s wr, 5 op/s 2023-05-08T10:23:38.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:38 smithi186 ceph-mon[126480]: pgmap v12833: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 66 KiB/s wr, 5 op/s 2023-05-08T10:23:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23958.113976 secs 2023-05-08T10:23:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23958.669547 secs 2023-05-08T10:23:39.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23958.113976 secs 2023-05-08T10:23:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23958.669547 secs 2023-05-08T10:23:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23958.113976 secs 2023-05-08T10:23:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23958.669547 secs 2023-05-08T10:23:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:40 smithi133 ceph-mon[125939]: pgmap v12834: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 66 KiB/s wr, 7 op/s 2023-05-08T10:23:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:40 smithi096 ceph-mon[124666]: pgmap v12834: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 66 KiB/s wr, 7 op/s 2023-05-08T10:23:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:40 smithi186 ceph-mon[126480]: pgmap v12834: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 66 KiB/s wr, 7 op/s 2023-05-08T10:23:42.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:42 smithi133 ceph-mon[125939]: pgmap v12835: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:23:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:42 smithi096 ceph-mon[124666]: pgmap v12835: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:23:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:42 smithi186 ceph-mon[126480]: pgmap v12835: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:23:44.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:44 smithi133 ceph-mon[125939]: pgmap v12836: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:23:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23963.114091 secs 2023-05-08T10:23:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:44 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:23:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23963.669639 secs 2023-05-08T10:23:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:44 smithi096 ceph-mon[124666]: pgmap v12836: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:23:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23963.114091 secs 2023-05-08T10:23:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:44 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:23:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23963.669639 secs 2023-05-08T10:23:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:44 smithi186 ceph-mon[126480]: pgmap v12836: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:23:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23963.114091 secs 2023-05-08T10:23:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:44 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:23:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23963.669639 secs 2023-05-08T10:23:45.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:45 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:23:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:45 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:23:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:45 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:23:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:45 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:23:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:45 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:23:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:45 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:23:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:45 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:23:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:45 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:23:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:45 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:23:46.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:46 smithi133 ceph-mon[125939]: pgmap v12837: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 85 KiB/s wr, 8 op/s 2023-05-08T10:23:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:46 smithi096 ceph-mon[124666]: pgmap v12837: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 85 KiB/s wr, 8 op/s 2023-05-08T10:23:46.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:46 smithi186 ceph-mon[126480]: pgmap v12837: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 85 KiB/s wr, 8 op/s 2023-05-08T10:23:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:48 smithi133 ceph-mon[125939]: pgmap v12838: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 86 KiB/s wr, 6 op/s 2023-05-08T10:23:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:48 smithi096 ceph-mon[124666]: pgmap v12838: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 86 KiB/s wr, 6 op/s 2023-05-08T10:23:48.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:48 smithi186 ceph-mon[126480]: pgmap v12838: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 86 KiB/s wr, 6 op/s 2023-05-08T10:23:49.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23968.114224 secs 2023-05-08T10:23:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23968.114224 secs 2023-05-08T10:23:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23968.114224 secs 2023-05-08T10:23:50.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:50 smithi133 ceph-mon[125939]: pgmap v12839: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 100 KiB/s wr, 8 op/s 2023-05-08T10:23:50.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:50 smithi096 ceph-mon[124666]: pgmap v12839: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 100 KiB/s wr, 8 op/s 2023-05-08T10:23:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:50 smithi186 ceph-mon[126480]: pgmap v12839: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 100 KiB/s wr, 8 op/s 2023-05-08T10:23:52.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:52 smithi133 ceph-mon[125939]: pgmap v12840: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 305 KiB/s wr, 8 op/s 2023-05-08T10:23:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:23:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:52 smithi096 ceph-mon[124666]: pgmap v12840: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 305 KiB/s wr, 8 op/s 2023-05-08T10:23:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:23:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:52 smithi186 ceph-mon[126480]: pgmap v12840: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 305 KiB/s wr, 8 op/s 2023-05-08T10:23:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:23:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:53 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:23:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:23:53.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:23:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:53 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:23:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:23:53.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:23:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:53 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:23:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:23:53.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:23:54.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:54 smithi133 ceph-mon[125939]: pgmap v12841: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 305 KiB/s wr, 8 op/s 2023-05-08T10:23:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23973.669847 secs 2023-05-08T10:23:54.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:54 smithi096 ceph-mon[124666]: pgmap v12841: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 305 KiB/s wr, 8 op/s 2023-05-08T10:23:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23973.669847 secs 2023-05-08T10:23:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:54 smithi186 ceph-mon[126480]: pgmap v12841: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 305 KiB/s wr, 8 op/s 2023-05-08T10:23:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23973.669847 secs 2023-05-08T10:23:55.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:55 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:23:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:55 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:23:55.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:55 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:23:56.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:56 smithi133 ceph-mon[125939]: pgmap v12842: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 388 KiB/s wr, 13 op/s 2023-05-08T10:23:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23974.957544 secs 2023-05-08T10:23:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:56 smithi133 ceph-mon[125939]: Health check cleared: MDS_SLOW_REQUEST (was: 1 MDSs report slow requests) 2023-05-08T10:23:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:56 smithi133 ceph-mon[125939]: Cluster is now healthy 2023-05-08T10:23:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T10:23:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:23:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:56 smithi096 ceph-mon[124666]: pgmap v12842: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 388 KiB/s wr, 13 op/s 2023-05-08T10:23:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23974.957544 secs 2023-05-08T10:23:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:56 smithi096 ceph-mon[124666]: Health check cleared: MDS_SLOW_REQUEST (was: 1 MDSs report slow requests) 2023-05-08T10:23:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:56 smithi096 ceph-mon[124666]: Cluster is now healthy 2023-05-08T10:23:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T10:23:56.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:23:56.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:56 smithi186 ceph-mon[126480]: pgmap v12842: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 388 KiB/s wr, 13 op/s 2023-05-08T10:23:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23974.957544 secs 2023-05-08T10:23:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:56 smithi186 ceph-mon[126480]: Health check cleared: MDS_SLOW_REQUEST (was: 1 MDSs report slow requests) 2023-05-08T10:23:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:56 smithi186 ceph-mon[126480]: Cluster is now healthy 2023-05-08T10:23:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T10:23:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:23:57.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:57 smithi133 ceph-mon[125939]: Health check failed: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:23:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:23:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:23:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:23:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:57 smithi096 ceph-mon[124666]: Health check failed: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:23:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:23:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:23:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:23:57.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:57 smithi186 ceph-mon[126480]: Health check failed: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:23:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:23:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:23:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:23:58.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:58 smithi133 ceph-mon[125939]: pgmap v12843: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 615 KiB/s wr, 11 op/s 2023-05-08T10:23:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:58 smithi096 ceph-mon[124666]: pgmap v12843: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 615 KiB/s wr, 11 op/s 2023-05-08T10:23:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:58 smithi186 ceph-mon[126480]: pgmap v12843: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 615 KiB/s wr, 11 op/s 2023-05-08T10:23:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:23:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23978.114489 secs 2023-05-08T10:23:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:23:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23978.114489 secs 2023-05-08T10:23:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:23:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23978.114489 secs 2023-05-08T10:24:00.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:00 smithi133 ceph-mon[125939]: pgmap v12844: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 702 KiB/s rd, 630 KiB/s wr, 14 op/s 2023-05-08T10:24:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T10:24:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:24:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:00 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:24:00.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:00 smithi096 ceph-mon[124666]: pgmap v12844: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 702 KiB/s rd, 630 KiB/s wr, 14 op/s 2023-05-08T10:24:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T10:24:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:24:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:00 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:24:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:00 smithi186 ceph-mon[126480]: pgmap v12844: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 702 KiB/s rd, 630 KiB/s wr, 14 op/s 2023-05-08T10:24:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T10:24:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:24:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:00 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:24:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23979.957614 secs 2023-05-08T10:24:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:24:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:24:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23979.957614 secs 2023-05-08T10:24:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:24:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:24:01.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23979.957614 secs 2023-05-08T10:24:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:24:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:24:02.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:02 smithi133 ceph-mon[125939]: pgmap v12845: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 717 KiB/s rd, 658 KiB/s wr, 14 op/s 2023-05-08T10:24:02.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:02 smithi096 ceph-mon[124666]: pgmap v12845: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 717 KiB/s rd, 658 KiB/s wr, 14 op/s 2023-05-08T10:24:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:02 smithi186 ceph-mon[126480]: pgmap v12845: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 717 KiB/s rd, 658 KiB/s wr, 14 op/s 2023-05-08T10:24:04.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:04 smithi133 ceph-mon[125939]: pgmap v12846: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 512 KiB/s rd, 453 KiB/s wr, 11 op/s 2023-05-08T10:24:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23983.114597 secs 2023-05-08T10:24:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23983.670095 secs 2023-05-08T10:24:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:04 smithi096 ceph-mon[124666]: pgmap v12846: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 512 KiB/s rd, 453 KiB/s wr, 11 op/s 2023-05-08T10:24:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23983.114597 secs 2023-05-08T10:24:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23983.670095 secs 2023-05-08T10:24:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:04 smithi186 ceph-mon[126480]: pgmap v12846: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 512 KiB/s rd, 453 KiB/s wr, 11 op/s 2023-05-08T10:24:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23983.114597 secs 2023-05-08T10:24:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23983.670095 secs 2023-05-08T10:24:05.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23984.957750 secs 2023-05-08T10:24:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23984.957750 secs 2023-05-08T10:24:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23984.957750 secs 2023-05-08T10:24:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:06 smithi133 ceph-mon[125939]: pgmap v12847: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 800 KiB/s rd, 763 KiB/s wr, 31 op/s 2023-05-08T10:24:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:06 smithi133 ceph-mon[125939]: osdmap e880: 12 total, 12 up, 12 in 2023-05-08T10:24:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:06 smithi096 ceph-mon[124666]: pgmap v12847: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 800 KiB/s rd, 763 KiB/s wr, 31 op/s 2023-05-08T10:24:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:06 smithi096 ceph-mon[124666]: osdmap e880: 12 total, 12 up, 12 in 2023-05-08T10:24:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:06 smithi186 ceph-mon[126480]: pgmap v12847: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 800 KiB/s rd, 763 KiB/s wr, 31 op/s 2023-05-08T10:24:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:06 smithi186 ceph-mon[126480]: osdmap e880: 12 total, 12 up, 12 in 2023-05-08T10:24:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:08 smithi133 ceph-mon[125939]: pgmap v12849: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 441 KiB/s wr, 29 op/s 2023-05-08T10:24:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:08 smithi096 ceph-mon[124666]: pgmap v12849: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 441 KiB/s wr, 29 op/s 2023-05-08T10:24:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:08 smithi186 ceph-mon[126480]: pgmap v12849: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 441 KiB/s wr, 29 op/s 2023-05-08T10:24:09.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23988.114708 secs 2023-05-08T10:24:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:09 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:24:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:24:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:24:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23988.670208 secs 2023-05-08T10:24:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23988.114708 secs 2023-05-08T10:24:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:09 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:24:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:24:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:24:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23988.670208 secs 2023-05-08T10:24:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23988.114708 secs 2023-05-08T10:24:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:09 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:24:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:24:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:24:09.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23988.670208 secs 2023-05-08T10:24:10.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:10 smithi133 ceph-mon[125939]: pgmap v12850: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 519 KiB/s wr, 29 op/s 2023-05-08T10:24:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23989.957878 secs 2023-05-08T10:24:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:10 smithi096 ceph-mon[124666]: pgmap v12850: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 519 KiB/s wr, 29 op/s 2023-05-08T10:24:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23989.957878 secs 2023-05-08T10:24:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:10 smithi186 ceph-mon[126480]: pgmap v12850: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 519 KiB/s wr, 29 op/s 2023-05-08T10:24:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23989.957878 secs 2023-05-08T10:24:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:12 smithi133 ceph-mon[125939]: pgmap v12851: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 468 KiB/s wr, 28 op/s 2023-05-08T10:24:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:12 smithi096 ceph-mon[124666]: pgmap v12851: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 468 KiB/s wr, 28 op/s 2023-05-08T10:24:12.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:12 smithi186 ceph-mon[126480]: pgmap v12851: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 468 KiB/s wr, 28 op/s 2023-05-08T10:24:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:14 smithi133 ceph-mon[125939]: pgmap v12852: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 468 KiB/s wr, 28 op/s 2023-05-08T10:24:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23993.114829 secs 2023-05-08T10:24:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23993.670330 secs 2023-05-08T10:24:14.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:14 smithi133 ceph-mon[125939]: osdmap e881: 12 total, 12 up, 12 in 2023-05-08T10:24:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:14 smithi096 ceph-mon[124666]: pgmap v12852: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 468 KiB/s wr, 28 op/s 2023-05-08T10:24:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23993.114829 secs 2023-05-08T10:24:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23993.670330 secs 2023-05-08T10:24:14.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:14 smithi096 ceph-mon[124666]: osdmap e881: 12 total, 12 up, 12 in 2023-05-08T10:24:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:14 smithi186 ceph-mon[126480]: pgmap v12852: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 468 KiB/s wr, 28 op/s 2023-05-08T10:24:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23993.114829 secs 2023-05-08T10:24:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23993.670330 secs 2023-05-08T10:24:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:14 smithi186 ceph-mon[126480]: osdmap e881: 12 total, 12 up, 12 in 2023-05-08T10:24:15.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23994.957971 secs 2023-05-08T10:24:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:15 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:24:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23994.957971 secs 2023-05-08T10:24:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:15 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:24:15.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23994.957971 secs 2023-05-08T10:24:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:15 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:24:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:16 smithi133 ceph-mon[125939]: pgmap v12854: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 180 KiB/s wr, 9 op/s 2023-05-08T10:24:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:16 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:24:16.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:16 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:24:16.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:16 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:24:16.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:16 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:24:16.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:16 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:24:16.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:16 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:24:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:16 smithi096 ceph-mon[124666]: pgmap v12854: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 180 KiB/s wr, 9 op/s 2023-05-08T10:24:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:16 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:24:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:16 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:24:16.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:16 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:24:16.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:16 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:24:16.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:16 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:24:16.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:16 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:24:16.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:16 smithi186 ceph-mon[126480]: pgmap v12854: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 180 KiB/s wr, 9 op/s 2023-05-08T10:24:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:16 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:24:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:16 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:24:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:16 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:24:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:16 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:24:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:16 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:24:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:16 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:24:17.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:17 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:24:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:17 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:24:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:17 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:24:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:17 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:24:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:17 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:24:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:17 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:24:17.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:17 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:24:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:17 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:24:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:17 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:24:18.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:18 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:24:18.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:18 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T10:24:18.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:18 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T10:24:18.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:18 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:24:18.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:18 smithi133 ceph-mon[125939]: pgmap v12855: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 176 KiB/s wr, 9 op/s 2023-05-08T10:24:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:18 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:24:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:18 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T10:24:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:18 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T10:24:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:18 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:24:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:18 smithi096 ceph-mon[124666]: pgmap v12855: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 176 KiB/s wr, 9 op/s 2023-05-08T10:24:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:18 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:24:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:18 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T10:24:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:18 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T10:24:18.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:18 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:24:18.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:18 smithi186 ceph-mon[126480]: pgmap v12855: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 176 KiB/s wr, 9 op/s 2023-05-08T10:24:19.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23998.114942 secs 2023-05-08T10:24:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23998.670443 secs 2023-05-08T10:24:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23998.114942 secs 2023-05-08T10:24:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23998.670443 secs 2023-05-08T10:24:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23998.114942 secs 2023-05-08T10:24:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23998.670443 secs 2023-05-08T10:24:20.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:20 smithi133 ceph-mon[125939]: pgmap v12856: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 251 KiB/s wr, 8 op/s 2023-05-08T10:24:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 23999.958100 secs 2023-05-08T10:24:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:20 smithi096 ceph-mon[124666]: pgmap v12856: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 251 KiB/s wr, 8 op/s 2023-05-08T10:24:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 23999.958100 secs 2023-05-08T10:24:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:20 smithi186 ceph-mon[126480]: pgmap v12856: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 251 KiB/s wr, 8 op/s 2023-05-08T10:24:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 23999.958100 secs 2023-05-08T10:24:22.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:22 smithi096 ceph-mon[124666]: pgmap v12857: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 250 KiB/s wr, 7 op/s 2023-05-08T10:24:22.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:22 smithi186 ceph-mon[126480]: pgmap v12857: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 250 KiB/s wr, 7 op/s 2023-05-08T10:24:22.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:22 smithi133 ceph-mon[125939]: pgmap v12857: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 250 KiB/s wr, 7 op/s 2023-05-08T10:24:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:24 smithi096 ceph-mon[124666]: pgmap v12858: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 250 KiB/s wr, 7 op/s 2023-05-08T10:24:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24003.115049 secs 2023-05-08T10:24:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24003.670563 secs 2023-05-08T10:24:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:24 smithi186 ceph-mon[126480]: pgmap v12858: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 250 KiB/s wr, 7 op/s 2023-05-08T10:24:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24003.115049 secs 2023-05-08T10:24:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24003.670563 secs 2023-05-08T10:24:24.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:24 smithi133 ceph-mon[125939]: pgmap v12858: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 250 KiB/s wr, 7 op/s 2023-05-08T10:24:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24003.115049 secs 2023-05-08T10:24:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24003.670563 secs 2023-05-08T10:24:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24004.958216 secs 2023-05-08T10:24:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24004.958216 secs 2023-05-08T10:24:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24004.958216 secs 2023-05-08T10:24:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:26 smithi096 ceph-mon[124666]: pgmap v12859: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 155 KiB/s wr, 7 op/s 2023-05-08T10:24:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:26 smithi186 ceph-mon[126480]: pgmap v12859: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 155 KiB/s wr, 7 op/s 2023-05-08T10:24:26.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:26 smithi133 ceph-mon[125939]: pgmap v12859: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 155 KiB/s wr, 7 op/s 2023-05-08T10:24:27.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:27 smithi186 ceph-mon[126480]: pgmap v12860: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 143 KiB/s wr, 5 op/s 2023-05-08T10:24:27.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:27 smithi133 ceph-mon[125939]: pgmap v12860: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 143 KiB/s wr, 5 op/s 2023-05-08T10:24:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:27 smithi096 ceph-mon[124666]: pgmap v12860: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 143 KiB/s wr, 5 op/s 2023-05-08T10:24:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24008.115181 secs 2023-05-08T10:24:29.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24008.115181 secs 2023-05-08T10:24:29.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24008.115181 secs 2023-05-08T10:24:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24008.670687 secs 2023-05-08T10:24:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:29 smithi096 ceph-mon[124666]: pgmap v12861: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 143 KiB/s wr, 8 op/s 2023-05-08T10:24:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24008.670687 secs 2023-05-08T10:24:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:29 smithi186 ceph-mon[126480]: pgmap v12861: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 143 KiB/s wr, 8 op/s 2023-05-08T10:24:30.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24008.670687 secs 2023-05-08T10:24:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:29 smithi133 ceph-mon[125939]: pgmap v12861: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 143 KiB/s wr, 8 op/s 2023-05-08T10:24:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24009.958342 secs 2023-05-08T10:24:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24009.958342 secs 2023-05-08T10:24:31.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24009.958342 secs 2023-05-08T10:24:32.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:32 smithi133 ceph-mon[125939]: pgmap v12862: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T10:24:32.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:32 smithi096 ceph-mon[124666]: pgmap v12862: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T10:24:32.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:32 smithi186 ceph-mon[126480]: pgmap v12862: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T10:24:34.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:34 smithi133 ceph-mon[125939]: pgmap v12863: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T10:24:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24013.115301 secs 2023-05-08T10:24:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24013.670808 secs 2023-05-08T10:24:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:34 smithi096 ceph-mon[124666]: pgmap v12863: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T10:24:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24013.115301 secs 2023-05-08T10:24:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24013.670808 secs 2023-05-08T10:24:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:34 smithi186 ceph-mon[126480]: pgmap v12863: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T10:24:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24013.115301 secs 2023-05-08T10:24:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24013.670808 secs 2023-05-08T10:24:36.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:36 smithi133 ceph-mon[125939]: pgmap v12864: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 271 KiB/s wr, 10 op/s 2023-05-08T10:24:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24014.958460 secs 2023-05-08T10:24:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:36 smithi096 ceph-mon[124666]: pgmap v12864: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 271 KiB/s wr, 10 op/s 2023-05-08T10:24:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24014.958460 secs 2023-05-08T10:24:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:36 smithi186 ceph-mon[126480]: pgmap v12864: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 271 KiB/s wr, 10 op/s 2023-05-08T10:24:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24014.958460 secs 2023-05-08T10:24:38.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:38 smithi133 ceph-mon[125939]: pgmap v12865: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 271 KiB/s wr, 7 op/s 2023-05-08T10:24:38.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:38 smithi096 ceph-mon[124666]: pgmap v12865: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 271 KiB/s wr, 7 op/s 2023-05-08T10:24:38.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:38 smithi186 ceph-mon[126480]: pgmap v12865: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 271 KiB/s wr, 7 op/s 2023-05-08T10:24:39.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24018.115417 secs 2023-05-08T10:24:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24018.670989 secs 2023-05-08T10:24:39.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24018.115417 secs 2023-05-08T10:24:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24018.670989 secs 2023-05-08T10:24:39.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24018.115417 secs 2023-05-08T10:24:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24018.670989 secs 2023-05-08T10:24:40.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:40 smithi133 ceph-mon[125939]: pgmap v12866: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 271 KiB/s wr, 9 op/s 2023-05-08T10:24:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:40 smithi096 ceph-mon[124666]: pgmap v12866: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 271 KiB/s wr, 9 op/s 2023-05-08T10:24:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:40 smithi186 ceph-mon[126480]: pgmap v12866: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 271 KiB/s wr, 9 op/s 2023-05-08T10:24:42.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:42 smithi133 ceph-mon[125939]: pgmap v12867: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 271 KiB/s wr, 7 op/s 2023-05-08T10:24:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:42 smithi096 ceph-mon[124666]: pgmap v12867: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 271 KiB/s wr, 7 op/s 2023-05-08T10:24:42.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:42 smithi186 ceph-mon[126480]: pgmap v12867: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 271 KiB/s wr, 7 op/s 2023-05-08T10:24:44.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:44 smithi133 ceph-mon[125939]: pgmap v12868: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 271 KiB/s wr, 6 op/s 2023-05-08T10:24:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24023.115534 secs 2023-05-08T10:24:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:44 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:24:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24023.671071 secs 2023-05-08T10:24:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:44 smithi096 ceph-mon[124666]: pgmap v12868: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 271 KiB/s wr, 6 op/s 2023-05-08T10:24:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24023.115534 secs 2023-05-08T10:24:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:44 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:24:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24023.671071 secs 2023-05-08T10:24:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:44 smithi186 ceph-mon[126480]: pgmap v12868: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 271 KiB/s wr, 6 op/s 2023-05-08T10:24:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24023.115534 secs 2023-05-08T10:24:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:44 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:24:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24023.671071 secs 2023-05-08T10:24:45.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:45 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:24:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:45 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:24:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:45 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:24:45.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:45 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:24:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:45 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:24:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:45 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:24:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:45 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:24:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:45 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:24:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:45 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:24:46.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:46 smithi133 ceph-mon[125939]: pgmap v12869: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 381 KiB/s wr, 10 op/s 2023-05-08T10:24:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:46 smithi096 ceph-mon[124666]: pgmap v12869: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 381 KiB/s wr, 10 op/s 2023-05-08T10:24:46.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:46 smithi186 ceph-mon[126480]: pgmap v12869: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 381 KiB/s wr, 10 op/s 2023-05-08T10:24:48.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:48 smithi133 ceph-mon[125939]: pgmap v12870: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 111 KiB/s wr, 6 op/s 2023-05-08T10:24:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:48 smithi096 ceph-mon[124666]: pgmap v12870: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 111 KiB/s wr, 6 op/s 2023-05-08T10:24:48.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:48 smithi186 ceph-mon[126480]: pgmap v12870: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 111 KiB/s wr, 6 op/s 2023-05-08T10:24:49.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24028.115647 secs 2023-05-08T10:24:49.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24028.115647 secs 2023-05-08T10:24:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24028.115647 secs 2023-05-08T10:24:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:50 smithi096 ceph-mon[124666]: pgmap v12871: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 331 KiB/s wr, 10 op/s 2023-05-08T10:24:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:50 smithi186 ceph-mon[126480]: pgmap v12871: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 331 KiB/s wr, 10 op/s 2023-05-08T10:24:50.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:50 smithi133 ceph-mon[125939]: pgmap v12871: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 331 KiB/s wr, 10 op/s 2023-05-08T10:24:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:52 smithi096 ceph-mon[124666]: pgmap v12872: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 333 KiB/s rd, 331 KiB/s wr, 8 op/s 2023-05-08T10:24:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:24:52.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:52 smithi186 ceph-mon[126480]: pgmap v12872: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 333 KiB/s rd, 331 KiB/s wr, 8 op/s 2023-05-08T10:24:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:24:52.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:52 smithi133 ceph-mon[125939]: pgmap v12872: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 333 KiB/s rd, 331 KiB/s wr, 8 op/s 2023-05-08T10:24:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:24:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:53 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:24:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:24:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:24:53.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:53 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:24:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:24:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:24:53.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:53 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:24:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:24:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:24:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:54 smithi186 ceph-mon[126480]: pgmap v12873: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 331 KiB/s wr, 7 op/s 2023-05-08T10:24:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24033.115769 secs 2023-05-08T10:24:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24033.671338 secs 2023-05-08T10:24:54.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:54 smithi133 ceph-mon[125939]: pgmap v12873: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 331 KiB/s wr, 7 op/s 2023-05-08T10:24:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24033.115769 secs 2023-05-08T10:24:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24033.671338 secs 2023-05-08T10:24:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:54 smithi096 ceph-mon[124666]: pgmap v12873: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 331 KiB/s wr, 7 op/s 2023-05-08T10:24:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24033.115769 secs 2023-05-08T10:24:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24033.671338 secs 2023-05-08T10:24:56.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:56 smithi186 ceph-mon[126480]: pgmap v12874: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 565 KiB/s wr, 13 op/s 2023-05-08T10:24:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24034.958950 secs 2023-05-08T10:24:56.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:56 smithi133 ceph-mon[125939]: pgmap v12874: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 565 KiB/s wr, 13 op/s 2023-05-08T10:24:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24034.958950 secs 2023-05-08T10:24:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:56 smithi096 ceph-mon[124666]: pgmap v12874: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 565 KiB/s wr, 13 op/s 2023-05-08T10:24:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24034.958950 secs 2023-05-08T10:24:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:24:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:24:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:24:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:24:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:24:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:24:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:24:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:24:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:24:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:58 smithi186 ceph-mon[126480]: pgmap v12875: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 455 KiB/s wr, 10 op/s 2023-05-08T10:24:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:58 smithi133 ceph-mon[125939]: pgmap v12875: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 455 KiB/s wr, 10 op/s 2023-05-08T10:24:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:58 smithi096 ceph-mon[124666]: pgmap v12875: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 455 KiB/s wr, 10 op/s 2023-05-08T10:24:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24038.115899 secs 2023-05-08T10:24:59.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:24:59 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:24:59.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24038.115899 secs 2023-05-08T10:24:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:24:59 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:24:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24038.115899 secs 2023-05-08T10:24:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:24:59 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:25:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:00 smithi186 ceph-mon[126480]: pgmap v12876: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 658 KiB/s rd, 645 KiB/s wr, 14 op/s 2023-05-08T10:25:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:00 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:25:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:00 smithi133 ceph-mon[125939]: pgmap v12876: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 658 KiB/s rd, 645 KiB/s wr, 14 op/s 2023-05-08T10:25:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:00 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:25:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:00 smithi096 ceph-mon[124666]: pgmap v12876: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 658 KiB/s rd, 645 KiB/s wr, 14 op/s 2023-05-08T10:25:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:00 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:25:01.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24039.959066 secs 2023-05-08T10:25:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:25:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:25:01.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24039.959066 secs 2023-05-08T10:25:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:25:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:25:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24039.959066 secs 2023-05-08T10:25:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:25:01.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:25:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:02 smithi186 ceph-mon[126480]: pgmap v12877: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 439 KiB/s wr, 12 op/s 2023-05-08T10:25:02.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:02 smithi133 ceph-mon[125939]: pgmap v12877: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 439 KiB/s wr, 12 op/s 2023-05-08T10:25:02.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:02 smithi096 ceph-mon[124666]: pgmap v12877: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 439 KiB/s wr, 12 op/s 2023-05-08T10:25:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:04 smithi186 ceph-mon[126480]: pgmap v12878: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 438 KiB/s wr, 11 op/s 2023-05-08T10:25:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24043.116023 secs 2023-05-08T10:25:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24043.671562 secs 2023-05-08T10:25:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:04 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:25:04.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:04 smithi133 ceph-mon[125939]: pgmap v12878: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 438 KiB/s wr, 11 op/s 2023-05-08T10:25:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24043.116023 secs 2023-05-08T10:25:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24043.671562 secs 2023-05-08T10:25:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:04 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:25:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:04 smithi096 ceph-mon[124666]: pgmap v12878: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 438 KiB/s wr, 11 op/s 2023-05-08T10:25:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24043.116023 secs 2023-05-08T10:25:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24043.671562 secs 2023-05-08T10:25:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:04 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:25:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:06 smithi186 ceph-mon[126480]: pgmap v12879: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 665 KiB/s rd, 689 KiB/s wr, 31 op/s 2023-05-08T10:25:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24044.959190 secs 2023-05-08T10:25:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:06 smithi186 ceph-mon[126480]: osdmap e882: 12 total, 12 up, 12 in 2023-05-08T10:25:06.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:06 smithi133 ceph-mon[125939]: pgmap v12879: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 665 KiB/s rd, 689 KiB/s wr, 31 op/s 2023-05-08T10:25:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24044.959190 secs 2023-05-08T10:25:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:06 smithi133 ceph-mon[125939]: osdmap e882: 12 total, 12 up, 12 in 2023-05-08T10:25:06.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:06 smithi096 ceph-mon[124666]: pgmap v12879: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 665 KiB/s rd, 689 KiB/s wr, 31 op/s 2023-05-08T10:25:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24044.959190 secs 2023-05-08T10:25:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:06 smithi096 ceph-mon[124666]: osdmap e882: 12 total, 12 up, 12 in 2023-05-08T10:25:08.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:08 smithi186 ceph-mon[126480]: pgmap v12881: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 503 KiB/s rd, 545 KiB/s wr, 30 op/s 2023-05-08T10:25:08.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:08 smithi133 ceph-mon[125939]: pgmap v12881: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 503 KiB/s rd, 545 KiB/s wr, 30 op/s 2023-05-08T10:25:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:08 smithi096 ceph-mon[124666]: pgmap v12881: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 503 KiB/s rd, 545 KiB/s wr, 30 op/s 2023-05-08T10:25:09.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:25:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:25:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24048.116141 secs 2023-05-08T10:25:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24048.671714 secs 2023-05-08T10:25:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:09 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:25:09.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:25:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:25:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24048.116141 secs 2023-05-08T10:25:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24048.671714 secs 2023-05-08T10:25:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:09 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:25:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:25:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:25:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24048.116141 secs 2023-05-08T10:25:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24048.671714 secs 2023-05-08T10:25:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:09 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:25:10.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:10 smithi186 ceph-mon[126480]: pgmap v12882: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 521 KiB/s wr, 29 op/s 2023-05-08T10:25:10.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:10 smithi133 ceph-mon[125939]: pgmap v12882: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 521 KiB/s wr, 29 op/s 2023-05-08T10:25:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:10 smithi096 ceph-mon[124666]: pgmap v12882: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 521 KiB/s wr, 29 op/s 2023-05-08T10:25:11.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24049.959332 secs 2023-05-08T10:25:11.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24049.959332 secs 2023-05-08T10:25:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24049.959332 secs 2023-05-08T10:25:12.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:12 smithi186 ceph-mon[126480]: pgmap v12883: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 505 KiB/s wr, 29 op/s 2023-05-08T10:25:12.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:12 smithi133 ceph-mon[125939]: pgmap v12883: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 505 KiB/s wr, 29 op/s 2023-05-08T10:25:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:12 smithi096 ceph-mon[124666]: pgmap v12883: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 505 KiB/s wr, 29 op/s 2023-05-08T10:25:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:14 smithi186 ceph-mon[126480]: pgmap v12884: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 505 KiB/s wr, 29 op/s 2023-05-08T10:25:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24053.116260 secs 2023-05-08T10:25:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24053.671826 secs 2023-05-08T10:25:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:14 smithi186 ceph-mon[126480]: osdmap e883: 12 total, 12 up, 12 in 2023-05-08T10:25:14.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:14 smithi133 ceph-mon[125939]: pgmap v12884: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 505 KiB/s wr, 29 op/s 2023-05-08T10:25:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24053.116260 secs 2023-05-08T10:25:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24053.671826 secs 2023-05-08T10:25:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:14 smithi133 ceph-mon[125939]: osdmap e883: 12 total, 12 up, 12 in 2023-05-08T10:25:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:14 smithi096 ceph-mon[124666]: pgmap v12884: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 505 KiB/s wr, 29 op/s 2023-05-08T10:25:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24053.116260 secs 2023-05-08T10:25:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24053.671826 secs 2023-05-08T10:25:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:14 smithi096 ceph-mon[124666]: osdmap e883: 12 total, 12 up, 12 in 2023-05-08T10:25:16.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:16 smithi186 ceph-mon[126480]: pgmap v12886: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 290 KiB/s rd, 287 KiB/s wr, 9 op/s 2023-05-08T10:25:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24054.959446 secs 2023-05-08T10:25:16.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:16 smithi133 ceph-mon[125939]: pgmap v12886: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 290 KiB/s rd, 287 KiB/s wr, 9 op/s 2023-05-08T10:25:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24054.959446 secs 2023-05-08T10:25:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:16 smithi096 ceph-mon[124666]: pgmap v12886: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 290 KiB/s rd, 287 KiB/s wr, 9 op/s 2023-05-08T10:25:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24054.959446 secs 2023-05-08T10:25:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:17 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:25:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:17 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:25:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:17 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:25:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:17 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:25:17.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:17 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:25:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:17 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:25:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:17 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:25:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:17 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:25:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:17 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:25:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:17 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:25:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:17 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:25:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:17 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:25:18.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:18 smithi186 ceph-mon[126480]: pgmap v12887: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 285 KiB/s wr, 9 op/s 2023-05-08T10:25:18.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:18 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:25:18.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:18 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T10:25:18.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:18 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T10:25:18.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:18 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:25:18.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:18 smithi133 ceph-mon[125939]: pgmap v12887: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 285 KiB/s wr, 9 op/s 2023-05-08T10:25:18.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:18 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:25:18.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:18 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T10:25:18.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:18 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T10:25:18.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:18 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:25:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:18 smithi096 ceph-mon[124666]: pgmap v12887: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 285 KiB/s wr, 9 op/s 2023-05-08T10:25:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:18 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:25:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:18 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T10:25:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:18 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T10:25:18.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:18 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:25:19.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24058.116379 secs 2023-05-08T10:25:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24058.671911 secs 2023-05-08T10:25:19.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24058.116379 secs 2023-05-08T10:25:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24058.671911 secs 2023-05-08T10:25:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24058.116379 secs 2023-05-08T10:25:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24058.671911 secs 2023-05-08T10:25:20.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:20 smithi186 ceph-mon[126480]: pgmap v12888: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 143 KiB/s wr, 7 op/s 2023-05-08T10:25:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:20 smithi133 ceph-mon[125939]: pgmap v12888: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 143 KiB/s wr, 7 op/s 2023-05-08T10:25:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:20 smithi096 ceph-mon[124666]: pgmap v12888: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 143 KiB/s wr, 7 op/s 2023-05-08T10:25:21.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24059.959567 secs 2023-05-08T10:25:21.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24059.959567 secs 2023-05-08T10:25:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24059.959567 secs 2023-05-08T10:25:22.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:22 smithi186 ceph-mon[126480]: pgmap v12889: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 143 KiB/s wr, 7 op/s 2023-05-08T10:25:22.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:22 smithi133 ceph-mon[125939]: pgmap v12889: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 143 KiB/s wr, 7 op/s 2023-05-08T10:25:22.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:22 smithi096 ceph-mon[124666]: pgmap v12889: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 143 KiB/s wr, 7 op/s 2023-05-08T10:25:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:24 smithi186 ceph-mon[126480]: pgmap v12890: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 143 KiB/s wr, 7 op/s 2023-05-08T10:25:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24063.116518 secs 2023-05-08T10:25:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24063.672028 secs 2023-05-08T10:25:24.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:24 smithi133 ceph-mon[125939]: pgmap v12890: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 143 KiB/s wr, 7 op/s 2023-05-08T10:25:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24063.116518 secs 2023-05-08T10:25:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24063.672028 secs 2023-05-08T10:25:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:24 smithi096 ceph-mon[124666]: pgmap v12890: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 143 KiB/s wr, 7 op/s 2023-05-08T10:25:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24063.116518 secs 2023-05-08T10:25:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24063.672028 secs 2023-05-08T10:25:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:26 smithi186 ceph-mon[126480]: pgmap v12891: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 89 KiB/s wr, 6 op/s 2023-05-08T10:25:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24064.959683 secs 2023-05-08T10:25:26.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:26 smithi133 ceph-mon[125939]: pgmap v12891: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 89 KiB/s wr, 6 op/s 2023-05-08T10:25:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24064.959683 secs 2023-05-08T10:25:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:26 smithi096 ceph-mon[124666]: pgmap v12891: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 89 KiB/s wr, 6 op/s 2023-05-08T10:25:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24064.959683 secs 2023-05-08T10:25:28.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:28 smithi186 ceph-mon[126480]: pgmap v12892: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 82 KiB/s wr, 5 op/s 2023-05-08T10:25:28.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:28 smithi133 ceph-mon[125939]: pgmap v12892: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 82 KiB/s wr, 5 op/s 2023-05-08T10:25:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:28 smithi096 ceph-mon[124666]: pgmap v12892: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 82 KiB/s wr, 5 op/s 2023-05-08T10:25:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24068.116577 secs 2023-05-08T10:25:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24068.672122 secs 2023-05-08T10:25:29.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24068.116577 secs 2023-05-08T10:25:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24068.672122 secs 2023-05-08T10:25:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24068.116577 secs 2023-05-08T10:25:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24068.672122 secs 2023-05-08T10:25:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:30 smithi186 ceph-mon[126480]: pgmap v12893: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 82 KiB/s wr, 7 op/s 2023-05-08T10:25:30.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:30 smithi133 ceph-mon[125939]: pgmap v12893: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 82 KiB/s wr, 7 op/s 2023-05-08T10:25:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:30 smithi096 ceph-mon[124666]: pgmap v12893: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 82 KiB/s wr, 7 op/s 2023-05-08T10:25:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24069.959802 secs 2023-05-08T10:25:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24069.959802 secs 2023-05-08T10:25:31.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24069.959802 secs 2023-05-08T10:25:32.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:32 smithi133 ceph-mon[125939]: pgmap v12894: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 6 op/s 2023-05-08T10:25:32.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:32 smithi096 ceph-mon[124666]: pgmap v12894: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 6 op/s 2023-05-08T10:25:32.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:32 smithi186 ceph-mon[126480]: pgmap v12894: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 6 op/s 2023-05-08T10:25:34.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:34 smithi133 ceph-mon[125939]: pgmap v12895: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 5 op/s 2023-05-08T10:25:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24073.116675 secs 2023-05-08T10:25:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24073.672250 secs 2023-05-08T10:25:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:34 smithi096 ceph-mon[124666]: pgmap v12895: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 5 op/s 2023-05-08T10:25:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24073.116675 secs 2023-05-08T10:25:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24073.672250 secs 2023-05-08T10:25:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:34 smithi186 ceph-mon[126480]: pgmap v12895: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 5 op/s 2023-05-08T10:25:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24073.116675 secs 2023-05-08T10:25:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24073.672250 secs 2023-05-08T10:25:36.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:36 smithi133 ceph-mon[125939]: pgmap v12896: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 53 KiB/s wr, 9 op/s 2023-05-08T10:25:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24074.959924 secs 2023-05-08T10:25:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:36 smithi096 ceph-mon[124666]: pgmap v12896: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 53 KiB/s wr, 9 op/s 2023-05-08T10:25:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24074.959924 secs 2023-05-08T10:25:36.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:36 smithi186 ceph-mon[126480]: pgmap v12896: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 53 KiB/s wr, 9 op/s 2023-05-08T10:25:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24074.959924 secs 2023-05-08T10:25:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:38 smithi133 ceph-mon[125939]: pgmap v12897: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 86 KiB/s wr, 6 op/s 2023-05-08T10:25:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:38 smithi096 ceph-mon[124666]: pgmap v12897: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 86 KiB/s wr, 6 op/s 2023-05-08T10:25:38.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:38 smithi186 ceph-mon[126480]: pgmap v12897: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 86 KiB/s wr, 6 op/s 2023-05-08T10:25:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24078.116785 secs 2023-05-08T10:25:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24078.672354 secs 2023-05-08T10:25:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24078.116785 secs 2023-05-08T10:25:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24078.672354 secs 2023-05-08T10:25:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24078.116785 secs 2023-05-08T10:25:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24078.672354 secs 2023-05-08T10:25:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:40 smithi133 ceph-mon[125939]: pgmap v12898: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 86 KiB/s wr, 9 op/s 2023-05-08T10:25:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:40 smithi096 ceph-mon[124666]: pgmap v12898: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 86 KiB/s wr, 9 op/s 2023-05-08T10:25:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:40 smithi186 ceph-mon[126480]: pgmap v12898: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 86 KiB/s wr, 9 op/s 2023-05-08T10:25:42.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:42 smithi133 ceph-mon[125939]: pgmap v12899: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 262 KiB/s wr, 7 op/s 2023-05-08T10:25:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:42 smithi096 ceph-mon[124666]: pgmap v12899: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 262 KiB/s wr, 7 op/s 2023-05-08T10:25:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:42 smithi186 ceph-mon[126480]: pgmap v12899: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 262 KiB/s wr, 7 op/s 2023-05-08T10:25:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:44 smithi133 ceph-mon[125939]: pgmap v12900: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 262 KiB/s wr, 6 op/s 2023-05-08T10:25:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24083.116888 secs 2023-05-08T10:25:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:44 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:25:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24083.672502 secs 2023-05-08T10:25:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:44 smithi096 ceph-mon[124666]: pgmap v12900: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 262 KiB/s wr, 6 op/s 2023-05-08T10:25:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24083.116888 secs 2023-05-08T10:25:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:44 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:25:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24083.672502 secs 2023-05-08T10:25:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:44 smithi186 ceph-mon[126480]: pgmap v12900: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 262 KiB/s wr, 6 op/s 2023-05-08T10:25:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24083.116888 secs 2023-05-08T10:25:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:44 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:25:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24083.672502 secs 2023-05-08T10:25:45.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:45 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:25:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:45 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:25:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:45 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:25:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:45 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:25:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:45 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:25:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:45 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:25:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:45 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:25:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:45 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:25:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:45 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:25:46.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:46 smithi133 ceph-mon[125939]: pgmap v12901: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 262 KiB/s wr, 9 op/s 2023-05-08T10:25:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:46 smithi096 ceph-mon[124666]: pgmap v12901: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 262 KiB/s wr, 9 op/s 2023-05-08T10:25:46.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:46 smithi186 ceph-mon[126480]: pgmap v12901: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 262 KiB/s wr, 9 op/s 2023-05-08T10:25:48.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:48 smithi133 ceph-mon[125939]: pgmap v12902: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 325 KiB/s wr, 7 op/s 2023-05-08T10:25:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:48 smithi096 ceph-mon[124666]: pgmap v12902: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 325 KiB/s wr, 7 op/s 2023-05-08T10:25:48.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:48 smithi186 ceph-mon[126480]: pgmap v12902: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 325 KiB/s wr, 7 op/s 2023-05-08T10:25:49.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24088.117013 secs 2023-05-08T10:25:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24088.117013 secs 2023-05-08T10:25:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24088.117013 secs 2023-05-08T10:25:50.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:50 smithi133 ceph-mon[125939]: pgmap v12903: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 277 KiB/s wr, 10 op/s 2023-05-08T10:25:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:50 smithi096 ceph-mon[124666]: pgmap v12903: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 277 KiB/s wr, 10 op/s 2023-05-08T10:25:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:50 smithi186 ceph-mon[126480]: pgmap v12903: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 277 KiB/s wr, 10 op/s 2023-05-08T10:25:52.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:52 smithi133 ceph-mon[125939]: pgmap v12904: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 295 KiB/s wr, 8 op/s 2023-05-08T10:25:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:25:52.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:52 smithi096 ceph-mon[124666]: pgmap v12904: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 295 KiB/s wr, 8 op/s 2023-05-08T10:25:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:25:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:52 smithi186 ceph-mon[126480]: pgmap v12904: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 295 KiB/s wr, 8 op/s 2023-05-08T10:25:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:25:53.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:53 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:25:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:25:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:25:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:53 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:25:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:25:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:25:53.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:53 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:25:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:25:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:25:54.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:54 smithi133 ceph-mon[125939]: pgmap v12905: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 119 KiB/s wr, 7 op/s 2023-05-08T10:25:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24093.117148 secs 2023-05-08T10:25:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:54 smithi096 ceph-mon[124666]: pgmap v12905: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 119 KiB/s wr, 7 op/s 2023-05-08T10:25:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24093.117148 secs 2023-05-08T10:25:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:54 smithi186 ceph-mon[126480]: pgmap v12905: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 119 KiB/s wr, 7 op/s 2023-05-08T10:25:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24093.117148 secs 2023-05-08T10:25:56.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24094.960418 secs 2023-05-08T10:25:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:56 smithi133 ceph-mon[125939]: pgmap v12906: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 588 KiB/s rd, 416 KiB/s wr, 12 op/s 2023-05-08T10:25:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24094.960418 secs 2023-05-08T10:25:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:56 smithi096 ceph-mon[124666]: pgmap v12906: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 588 KiB/s rd, 416 KiB/s wr, 12 op/s 2023-05-08T10:25:56.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24094.960418 secs 2023-05-08T10:25:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:56 smithi186 ceph-mon[126480]: pgmap v12906: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 588 KiB/s rd, 416 KiB/s wr, 12 op/s 2023-05-08T10:25:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:25:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:25:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:25:57.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:25:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:25:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:25:58.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:58 smithi133 ceph-mon[125939]: pgmap v12907: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 604 KiB/s rd, 416 KiB/s wr, 9 op/s 2023-05-08T10:25:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:58 smithi096 ceph-mon[124666]: pgmap v12907: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 604 KiB/s rd, 416 KiB/s wr, 9 op/s 2023-05-08T10:25:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:58 smithi186 ceph-mon[126480]: pgmap v12907: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 604 KiB/s rd, 416 KiB/s wr, 9 op/s 2023-05-08T10:25:59.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24098.117278 secs 2023-05-08T10:25:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:25:59 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:25:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24098.117278 secs 2023-05-08T10:25:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:25:59 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:25:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24098.117278 secs 2023-05-08T10:25:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:25:59 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:26:00.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:00 smithi133 ceph-mon[125939]: pgmap v12908: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 684 KiB/s rd, 585 KiB/s wr, 14 op/s 2023-05-08T10:26:00.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:00 smithi096 ceph-mon[124666]: pgmap v12908: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 684 KiB/s rd, 585 KiB/s wr, 14 op/s 2023-05-08T10:26:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:00 smithi186 ceph-mon[126480]: pgmap v12908: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 684 KiB/s rd, 585 KiB/s wr, 14 op/s 2023-05-08T10:26:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24099.960554 secs 2023-05-08T10:26:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24099.960554 secs 2023-05-08T10:26:01.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24099.960554 secs 2023-05-08T10:26:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:02 smithi133 ceph-mon[125939]: pgmap v12909: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 669 KiB/s rd, 571 KiB/s wr, 12 op/s 2023-05-08T10:26:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:02 smithi096 ceph-mon[124666]: pgmap v12909: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 669 KiB/s rd, 571 KiB/s wr, 12 op/s 2023-05-08T10:26:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:02 smithi186 ceph-mon[126480]: pgmap v12909: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 669 KiB/s rd, 571 KiB/s wr, 12 op/s 2023-05-08T10:26:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:04 smithi133 ceph-mon[125939]: pgmap v12910: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 583 KiB/s rd, 553 KiB/s wr, 11 op/s 2023-05-08T10:26:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24103.117395 secs 2023-05-08T10:26:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24103.673004 secs 2023-05-08T10:26:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:04 smithi096 ceph-mon[124666]: pgmap v12910: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 583 KiB/s rd, 553 KiB/s wr, 11 op/s 2023-05-08T10:26:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24103.117395 secs 2023-05-08T10:26:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24103.673004 secs 2023-05-08T10:26:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:04 smithi186 ceph-mon[126480]: pgmap v12910: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 583 KiB/s rd, 553 KiB/s wr, 11 op/s 2023-05-08T10:26:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24103.117395 secs 2023-05-08T10:26:04.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24103.673004 secs 2023-05-08T10:26:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24104.960671 secs 2023-05-08T10:26:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:06 smithi133 ceph-mon[125939]: pgmap v12911: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 719 KiB/s rd, 725 KiB/s wr, 30 op/s 2023-05-08T10:26:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:06 smithi133 ceph-mon[125939]: osdmap e884: 12 total, 12 up, 12 in 2023-05-08T10:26:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24104.960671 secs 2023-05-08T10:26:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:06 smithi096 ceph-mon[124666]: pgmap v12911: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 719 KiB/s rd, 725 KiB/s wr, 30 op/s 2023-05-08T10:26:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:06 smithi096 ceph-mon[124666]: osdmap e884: 12 total, 12 up, 12 in 2023-05-08T10:26:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24104.960671 secs 2023-05-08T10:26:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:06 smithi186 ceph-mon[126480]: pgmap v12911: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 719 KiB/s rd, 725 KiB/s wr, 30 op/s 2023-05-08T10:26:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:06 smithi186 ceph-mon[126480]: osdmap e884: 12 total, 12 up, 12 in 2023-05-08T10:26:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:08 smithi133 ceph-mon[125939]: pgmap v12913: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 512 KiB/s wr, 30 op/s 2023-05-08T10:26:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:08 smithi096 ceph-mon[124666]: pgmap v12913: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 512 KiB/s wr, 30 op/s 2023-05-08T10:26:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:08 smithi186 ceph-mon[126480]: pgmap v12913: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 512 KiB/s wr, 30 op/s 2023-05-08T10:26:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24108.117517 secs 2023-05-08T10:26:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:09 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:26:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:26:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:26:09.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24108.673141 secs 2023-05-08T10:26:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24108.117517 secs 2023-05-08T10:26:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:09 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:26:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:26:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:26:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24108.673141 secs 2023-05-08T10:26:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24108.117517 secs 2023-05-08T10:26:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:09 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:26:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:26:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:26:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24108.673141 secs 2023-05-08T10:26:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:10 smithi133 ceph-mon[125939]: pgmap v12914: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 319 KiB/s wr, 29 op/s 2023-05-08T10:26:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24109.960803 secs 2023-05-08T10:26:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:10 smithi096 ceph-mon[124666]: pgmap v12914: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 319 KiB/s wr, 29 op/s 2023-05-08T10:26:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24109.960803 secs 2023-05-08T10:26:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:10 smithi186 ceph-mon[126480]: pgmap v12914: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 319 KiB/s wr, 29 op/s 2023-05-08T10:26:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24109.960803 secs 2023-05-08T10:26:12.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:12 smithi133 ceph-mon[125939]: pgmap v12915: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 319 KiB/s wr, 29 op/s 2023-05-08T10:26:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:12 smithi096 ceph-mon[124666]: pgmap v12915: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 319 KiB/s wr, 29 op/s 2023-05-08T10:26:12.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:12 smithi186 ceph-mon[126480]: pgmap v12915: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 319 KiB/s wr, 29 op/s 2023-05-08T10:26:14.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:14 smithi133 ceph-mon[125939]: pgmap v12916: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 319 KiB/s wr, 29 op/s 2023-05-08T10:26:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24113.117635 secs 2023-05-08T10:26:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24113.673208 secs 2023-05-08T10:26:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:14 smithi133 ceph-mon[125939]: osdmap e885: 12 total, 12 up, 12 in 2023-05-08T10:26:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:14 smithi096 ceph-mon[124666]: pgmap v12916: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 319 KiB/s wr, 29 op/s 2023-05-08T10:26:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24113.117635 secs 2023-05-08T10:26:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24113.673208 secs 2023-05-08T10:26:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:14 smithi096 ceph-mon[124666]: osdmap e885: 12 total, 12 up, 12 in 2023-05-08T10:26:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:14 smithi186 ceph-mon[126480]: pgmap v12916: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 319 KiB/s wr, 29 op/s 2023-05-08T10:26:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24113.117635 secs 2023-05-08T10:26:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24113.673208 secs 2023-05-08T10:26:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:14 smithi186 ceph-mon[126480]: osdmap e885: 12 total, 12 up, 12 in 2023-05-08T10:26:15.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24114.960941 secs 2023-05-08T10:26:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24114.960941 secs 2023-05-08T10:26:15.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24114.960941 secs 2023-05-08T10:26:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:16 smithi133 ceph-mon[125939]: pgmap v12918: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 309 KiB/s wr, 9 op/s 2023-05-08T10:26:16.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:16 smithi096 ceph-mon[124666]: pgmap v12918: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 309 KiB/s wr, 9 op/s 2023-05-08T10:26:16.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:16 smithi186 ceph-mon[126480]: pgmap v12918: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 309 KiB/s wr, 9 op/s 2023-05-08T10:26:17.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:17 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:26:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:17 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:26:17.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:17 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:26:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:18 smithi096 ceph-mon[124666]: pgmap v12919: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 302 KiB/s wr, 9 op/s 2023-05-08T10:26:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:26:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:26:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:26:18.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:18 smithi186 ceph-mon[126480]: pgmap v12919: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 302 KiB/s wr, 9 op/s 2023-05-08T10:26:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:26:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:26:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:26:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:18 smithi133 ceph-mon[125939]: pgmap v12919: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 302 KiB/s wr, 9 op/s 2023-05-08T10:26:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:26:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:26:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:26:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:19 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:26:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:19 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T10:26:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:19 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T10:26:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:19 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:26:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24118.117743 secs 2023-05-08T10:26:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24118.673347 secs 2023-05-08T10:26:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:19 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:26:19.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:19 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T10:26:19.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:19 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T10:26:19.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:19 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:26:19.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24118.117743 secs 2023-05-08T10:26:19.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24118.673347 secs 2023-05-08T10:26:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:19 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:26:19.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:19 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T10:26:19.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:19 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T10:26:19.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:19 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:26:19.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24118.117743 secs 2023-05-08T10:26:19.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24118.673347 secs 2023-05-08T10:26:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:20 smithi096 ceph-mon[124666]: pgmap v12920: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 189 KiB/s wr, 7 op/s 2023-05-08T10:26:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24119.961038 secs 2023-05-08T10:26:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:20 smithi186 ceph-mon[126480]: pgmap v12920: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 189 KiB/s wr, 7 op/s 2023-05-08T10:26:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24119.961038 secs 2023-05-08T10:26:20.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:20 smithi133 ceph-mon[125939]: pgmap v12920: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 189 KiB/s wr, 7 op/s 2023-05-08T10:26:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24119.961038 secs 2023-05-08T10:26:22.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:22 smithi096 ceph-mon[124666]: pgmap v12921: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 189 KiB/s wr, 7 op/s 2023-05-08T10:26:22.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:22 smithi186 ceph-mon[126480]: pgmap v12921: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 189 KiB/s wr, 7 op/s 2023-05-08T10:26:22.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:22 smithi133 ceph-mon[125939]: pgmap v12921: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 189 KiB/s wr, 7 op/s 2023-05-08T10:26:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:24 smithi096 ceph-mon[124666]: pgmap v12922: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 189 KiB/s wr, 7 op/s 2023-05-08T10:26:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24123.117854 secs 2023-05-08T10:26:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24123.673504 secs 2023-05-08T10:26:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:24 smithi186 ceph-mon[126480]: pgmap v12922: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 189 KiB/s wr, 7 op/s 2023-05-08T10:26:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24123.117854 secs 2023-05-08T10:26:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24123.673504 secs 2023-05-08T10:26:24.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:24 smithi133 ceph-mon[125939]: pgmap v12922: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 189 KiB/s wr, 7 op/s 2023-05-08T10:26:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24123.117854 secs 2023-05-08T10:26:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24123.673504 secs 2023-05-08T10:26:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24124.961155 secs 2023-05-08T10:26:25.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24124.961155 secs 2023-05-08T10:26:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24124.961155 secs 2023-05-08T10:26:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:26 smithi186 ceph-mon[126480]: pgmap v12923: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 0 B/s wr, 6 op/s 2023-05-08T10:26:26.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:26 smithi133 ceph-mon[125939]: pgmap v12923: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 0 B/s wr, 6 op/s 2023-05-08T10:26:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:26 smithi096 ceph-mon[124666]: pgmap v12923: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 0 B/s wr, 6 op/s 2023-05-08T10:26:28.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:28 smithi186 ceph-mon[126480]: pgmap v12924: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:26:28.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:28 smithi133 ceph-mon[125939]: pgmap v12924: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:26:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:28 smithi096 ceph-mon[124666]: pgmap v12924: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:26:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24128.117928 secs 2023-05-08T10:26:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24128.673615 secs 2023-05-08T10:26:29.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24128.117928 secs 2023-05-08T10:26:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24128.673615 secs 2023-05-08T10:26:30.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24128.117928 secs 2023-05-08T10:26:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24128.673615 secs 2023-05-08T10:26:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:30 smithi186 ceph-mon[126480]: pgmap v12925: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T10:26:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24129.961250 secs 2023-05-08T10:26:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:30 smithi133 ceph-mon[125939]: pgmap v12925: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T10:26:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24129.961250 secs 2023-05-08T10:26:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:30 smithi096 ceph-mon[124666]: pgmap v12925: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T10:26:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24129.961250 secs 2023-05-08T10:26:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:31 smithi186 ceph-mon[126480]: pgmap v12926: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T10:26:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:31 smithi133 ceph-mon[125939]: pgmap v12926: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T10:26:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:31 smithi096 ceph-mon[124666]: pgmap v12926: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T10:26:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:34 smithi186 ceph-mon[126480]: pgmap v12927: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T10:26:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24133.118063 secs 2023-05-08T10:26:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24133.673730 secs 2023-05-08T10:26:34.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:34 smithi133 ceph-mon[125939]: pgmap v12927: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T10:26:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24133.118063 secs 2023-05-08T10:26:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24133.673730 secs 2023-05-08T10:26:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:34 smithi096 ceph-mon[124666]: pgmap v12927: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T10:26:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24133.118063 secs 2023-05-08T10:26:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24133.673730 secs 2023-05-08T10:26:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24134.961384 secs 2023-05-08T10:26:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:36 smithi186 ceph-mon[126480]: pgmap v12928: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T10:26:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24134.961384 secs 2023-05-08T10:26:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:36 smithi133 ceph-mon[125939]: pgmap v12928: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T10:26:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24134.961384 secs 2023-05-08T10:26:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:36 smithi096 ceph-mon[124666]: pgmap v12928: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T10:26:38.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:38 smithi186 ceph-mon[126480]: pgmap v12929: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T10:26:38.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:38 smithi133 ceph-mon[125939]: pgmap v12929: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T10:26:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:38 smithi096 ceph-mon[124666]: pgmap v12929: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T10:26:39.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24138.118161 secs 2023-05-08T10:26:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24138.673832 secs 2023-05-08T10:26:39.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24138.118161 secs 2023-05-08T10:26:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24138.673832 secs 2023-05-08T10:26:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24138.118161 secs 2023-05-08T10:26:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24138.673832 secs 2023-05-08T10:26:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:40 smithi186 ceph-mon[126480]: pgmap v12930: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 87 KiB/s wr, 8 op/s 2023-05-08T10:26:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:40 smithi133 ceph-mon[125939]: pgmap v12930: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 87 KiB/s wr, 8 op/s 2023-05-08T10:26:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:40 smithi096 ceph-mon[124666]: pgmap v12930: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 87 KiB/s wr, 8 op/s 2023-05-08T10:26:42.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:42 smithi186 ceph-mon[126480]: pgmap v12931: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 87 KiB/s wr, 6 op/s 2023-05-08T10:26:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:42 smithi133 ceph-mon[125939]: pgmap v12931: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 87 KiB/s wr, 6 op/s 2023-05-08T10:26:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:42 smithi096 ceph-mon[124666]: pgmap v12931: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 87 KiB/s wr, 6 op/s 2023-05-08T10:26:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:44 smithi186 ceph-mon[126480]: pgmap v12932: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 87 KiB/s wr, 6 op/s 2023-05-08T10:26:44.742 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24143.118257 secs 2023-05-08T10:26:44.742 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:44 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:26:44.742 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24143.673958 secs 2023-05-08T10:26:44.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:44 smithi133 ceph-mon[125939]: pgmap v12932: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 87 KiB/s wr, 6 op/s 2023-05-08T10:26:44.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24143.118257 secs 2023-05-08T10:26:44.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:44 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:26:44.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24143.673958 secs 2023-05-08T10:26:44.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:44 smithi096 ceph-mon[124666]: pgmap v12932: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 87 KiB/s wr, 6 op/s 2023-05-08T10:26:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24143.118257 secs 2023-05-08T10:26:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:44 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:26:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24143.673958 secs 2023-05-08T10:26:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:45 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:26:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:45 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:26:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:45 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:26:45.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:45 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:26:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:45 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:26:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:45 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:26:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:45 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:26:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:45 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:26:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:45 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:26:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:46 smithi186 ceph-mon[126480]: pgmap v12933: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 173 KiB/s wr, 10 op/s 2023-05-08T10:26:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:46 smithi133 ceph-mon[125939]: pgmap v12933: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 173 KiB/s wr, 10 op/s 2023-05-08T10:26:46.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:46 smithi096 ceph-mon[124666]: pgmap v12933: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 173 KiB/s wr, 10 op/s 2023-05-08T10:26:48.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:48 smithi186 ceph-mon[126480]: pgmap v12934: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 173 KiB/s wr, 7 op/s 2023-05-08T10:26:48.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:48 smithi133 ceph-mon[125939]: pgmap v12934: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 173 KiB/s wr, 7 op/s 2023-05-08T10:26:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:48 smithi096 ceph-mon[124666]: pgmap v12934: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 173 KiB/s wr, 7 op/s 2023-05-08T10:26:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24148.118392 secs 2023-05-08T10:26:49.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24148.118392 secs 2023-05-08T10:26:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24148.118392 secs 2023-05-08T10:26:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:50 smithi186 ceph-mon[126480]: pgmap v12935: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 187 KiB/s wr, 10 op/s 2023-05-08T10:26:50.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:50 smithi133 ceph-mon[125939]: pgmap v12935: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 187 KiB/s wr, 10 op/s 2023-05-08T10:26:50.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:50 smithi096 ceph-mon[124666]: pgmap v12935: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 187 KiB/s wr, 10 op/s 2023-05-08T10:26:52.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:52 smithi186 ceph-mon[126480]: pgmap v12936: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 278 KiB/s wr, 8 op/s 2023-05-08T10:26:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:26:52.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:52 smithi133 ceph-mon[125939]: pgmap v12936: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 278 KiB/s wr, 8 op/s 2023-05-08T10:26:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:26:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:52 smithi096 ceph-mon[124666]: pgmap v12936: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 278 KiB/s wr, 8 op/s 2023-05-08T10:26:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:26:53.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:53 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:26:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:26:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:26:53.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:53 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:26:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:26:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:26:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:53 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:26:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:26:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:26:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:54 smithi186 ceph-mon[126480]: pgmap v12937: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 278 KiB/s wr, 8 op/s 2023-05-08T10:26:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24153.118535 secs 2023-05-08T10:26:54.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:54 smithi133 ceph-mon[125939]: pgmap v12937: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 278 KiB/s wr, 8 op/s 2023-05-08T10:26:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24153.118535 secs 2023-05-08T10:26:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:54 smithi096 ceph-mon[124666]: pgmap v12937: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 278 KiB/s wr, 8 op/s 2023-05-08T10:26:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24153.118535 secs 2023-05-08T10:26:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24154.961944 secs 2023-05-08T10:26:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:56 smithi186 ceph-mon[126480]: pgmap v12938: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 694 KiB/s rd, 595 KiB/s wr, 13 op/s 2023-05-08T10:26:56.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24154.961944 secs 2023-05-08T10:26:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:56 smithi133 ceph-mon[125939]: pgmap v12938: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 694 KiB/s rd, 595 KiB/s wr, 13 op/s 2023-05-08T10:26:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24154.961944 secs 2023-05-08T10:26:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:56 smithi096 ceph-mon[124666]: pgmap v12938: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 694 KiB/s rd, 595 KiB/s wr, 13 op/s 2023-05-08T10:26:57.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:26:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:26:57.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:26:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:26:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:26:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:26:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:58 smithi186 ceph-mon[126480]: pgmap v12939: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 521 KiB/s rd, 508 KiB/s wr, 9 op/s 2023-05-08T10:26:58.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:58 smithi133 ceph-mon[125939]: pgmap v12939: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 521 KiB/s rd, 508 KiB/s wr, 9 op/s 2023-05-08T10:26:58.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:58 smithi096 ceph-mon[124666]: pgmap v12939: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 521 KiB/s rd, 508 KiB/s wr, 9 op/s 2023-05-08T10:26:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24158.118602 secs 2023-05-08T10:26:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:26:59 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:26:59.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24158.118602 secs 2023-05-08T10:26:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:26:59 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:26:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24158.118602 secs 2023-05-08T10:26:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:26:59 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:27:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:00 smithi186 ceph-mon[126480]: pgmap v12940: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 701 KiB/s rd, 688 KiB/s wr, 14 op/s 2023-05-08T10:27:00.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:00 smithi133 ceph-mon[125939]: pgmap v12940: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 701 KiB/s rd, 688 KiB/s wr, 14 op/s 2023-05-08T10:27:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:00 smithi096 ceph-mon[124666]: pgmap v12940: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 701 KiB/s rd, 688 KiB/s wr, 14 op/s 2023-05-08T10:27:01.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24159.962012 secs 2023-05-08T10:27:01.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24159.962012 secs 2023-05-08T10:27:01.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24159.962012 secs 2023-05-08T10:27:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:02 smithi186 ceph-mon[126480]: pgmap v12941: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 685 KiB/s rd, 674 KiB/s wr, 12 op/s 2023-05-08T10:27:02.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:02 smithi133 ceph-mon[125939]: pgmap v12941: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 685 KiB/s rd, 674 KiB/s wr, 12 op/s 2023-05-08T10:27:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:02 smithi096 ceph-mon[124666]: pgmap v12941: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 685 KiB/s rd, 674 KiB/s wr, 12 op/s 2023-05-08T10:27:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:04 smithi186 ceph-mon[126480]: pgmap v12942: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 509 KiB/s rd, 497 KiB/s wr, 11 op/s 2023-05-08T10:27:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24163.118725 secs 2023-05-08T10:27:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24163.674447 secs 2023-05-08T10:27:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:04 smithi133 ceph-mon[125939]: pgmap v12942: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 509 KiB/s rd, 497 KiB/s wr, 11 op/s 2023-05-08T10:27:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24163.118725 secs 2023-05-08T10:27:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24163.674447 secs 2023-05-08T10:27:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:04 smithi096 ceph-mon[124666]: pgmap v12942: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 509 KiB/s rd, 497 KiB/s wr, 11 op/s 2023-05-08T10:27:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24163.118725 secs 2023-05-08T10:27:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24163.674447 secs 2023-05-08T10:27:06.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24164.962140 secs 2023-05-08T10:27:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:06 smithi133 ceph-mon[125939]: pgmap v12943: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 737 KiB/s rd, 759 KiB/s wr, 30 op/s 2023-05-08T10:27:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:06 smithi133 ceph-mon[125939]: osdmap e886: 12 total, 12 up, 12 in 2023-05-08T10:27:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24164.962140 secs 2023-05-08T10:27:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:06 smithi096 ceph-mon[124666]: pgmap v12943: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 737 KiB/s rd, 759 KiB/s wr, 30 op/s 2023-05-08T10:27:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:06 smithi096 ceph-mon[124666]: osdmap e886: 12 total, 12 up, 12 in 2023-05-08T10:27:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24164.962140 secs 2023-05-08T10:27:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:06 smithi186 ceph-mon[126480]: pgmap v12943: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 737 KiB/s rd, 759 KiB/s wr, 30 op/s 2023-05-08T10:27:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:06 smithi186 ceph-mon[126480]: osdmap e886: 12 total, 12 up, 12 in 2023-05-08T10:27:08.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:08 smithi133 ceph-mon[125939]: pgmap v12945: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 531 KiB/s wr, 30 op/s 2023-05-08T10:27:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:08 smithi096 ceph-mon[124666]: pgmap v12945: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 531 KiB/s wr, 30 op/s 2023-05-08T10:27:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:08 smithi186 ceph-mon[126480]: pgmap v12945: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 531 KiB/s wr, 30 op/s 2023-05-08T10:27:09.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:09 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:27:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24168.118783 secs 2023-05-08T10:27:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:27:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:27:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24168.674548 secs 2023-05-08T10:27:09.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:09 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:27:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24168.118783 secs 2023-05-08T10:27:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:27:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:27:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24168.674548 secs 2023-05-08T10:27:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:09 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:27:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24168.118783 secs 2023-05-08T10:27:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:27:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:27:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24168.674548 secs 2023-05-08T10:27:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:10 smithi133 ceph-mon[125939]: pgmap v12946: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 429 KiB/s wr, 28 op/s 2023-05-08T10:27:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:10 smithi096 ceph-mon[124666]: pgmap v12946: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 429 KiB/s wr, 28 op/s 2023-05-08T10:27:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:10 smithi186 ceph-mon[126480]: pgmap v12946: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 429 KiB/s wr, 28 op/s 2023-05-08T10:27:11.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24169.962267 secs 2023-05-08T10:27:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24169.962267 secs 2023-05-08T10:27:11.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24169.962267 secs 2023-05-08T10:27:12.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:12 smithi133 ceph-mon[125939]: pgmap v12947: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 429 KiB/s wr, 28 op/s 2023-05-08T10:27:12.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:12 smithi096 ceph-mon[124666]: pgmap v12947: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 429 KiB/s wr, 28 op/s 2023-05-08T10:27:12.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:12 smithi186 ceph-mon[126480]: pgmap v12947: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 429 KiB/s wr, 28 op/s 2023-05-08T10:27:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:14 smithi133 ceph-mon[125939]: pgmap v12948: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 429 KiB/s wr, 28 op/s 2023-05-08T10:27:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24173.118897 secs 2023-05-08T10:27:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24173.674666 secs 2023-05-08T10:27:14.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:14 smithi133 ceph-mon[125939]: osdmap e887: 12 total, 12 up, 12 in 2023-05-08T10:27:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:14 smithi096 ceph-mon[124666]: pgmap v12948: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 429 KiB/s wr, 28 op/s 2023-05-08T10:27:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24173.118897 secs 2023-05-08T10:27:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24173.674666 secs 2023-05-08T10:27:14.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:14 smithi096 ceph-mon[124666]: osdmap e887: 12 total, 12 up, 12 in 2023-05-08T10:27:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:14 smithi186 ceph-mon[126480]: pgmap v12948: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 429 KiB/s wr, 28 op/s 2023-05-08T10:27:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24173.118897 secs 2023-05-08T10:27:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24173.674666 secs 2023-05-08T10:27:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:14 smithi186 ceph-mon[126480]: osdmap e887: 12 total, 12 up, 12 in 2023-05-08T10:27:16.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24174.962370 secs 2023-05-08T10:27:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:16 smithi133 ceph-mon[125939]: pgmap v12950: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 115 KiB/s wr, 8 op/s 2023-05-08T10:27:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24174.962370 secs 2023-05-08T10:27:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:16 smithi096 ceph-mon[124666]: pgmap v12950: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 115 KiB/s wr, 8 op/s 2023-05-08T10:27:16.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24174.962370 secs 2023-05-08T10:27:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:16 smithi186 ceph-mon[126480]: pgmap v12950: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 115 KiB/s wr, 8 op/s 2023-05-08T10:27:18.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:18 smithi133 ceph-mon[125939]: pgmap v12951: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 113 KiB/s wr, 7 op/s 2023-05-08T10:27:18.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:18 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:27:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:18 smithi096 ceph-mon[124666]: pgmap v12951: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 113 KiB/s wr, 7 op/s 2023-05-08T10:27:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:18 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:27:18.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:18 smithi186 ceph-mon[126480]: pgmap v12951: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 113 KiB/s wr, 7 op/s 2023-05-08T10:27:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:18 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:27:19.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24178.118992 secs 2023-05-08T10:27:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:19 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:27:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:19 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:27:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:19 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:27:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24178.674733 secs 2023-05-08T10:27:19.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24178.118992 secs 2023-05-08T10:27:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:19 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:27:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:19 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:27:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:19 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:27:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24178.674733 secs 2023-05-08T10:27:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24178.118992 secs 2023-05-08T10:27:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:19 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:27:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:19 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:27:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:19 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:27:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24178.674733 secs 2023-05-08T10:27:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:20 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:27:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:20 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T10:27:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:20 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T10:27:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:20 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:27:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:20 smithi133 ceph-mon[125939]: pgmap v12952: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 80 KiB/s wr, 6 op/s 2023-05-08T10:27:20.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:20 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:27:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:20 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T10:27:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:20 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T10:27:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:20 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:27:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:20 smithi096 ceph-mon[124666]: pgmap v12952: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 80 KiB/s wr, 6 op/s 2023-05-08T10:27:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:20 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:27:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:20 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T10:27:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:20 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T10:27:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:20 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:27:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:20 smithi186 ceph-mon[126480]: pgmap v12952: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 80 KiB/s wr, 6 op/s 2023-05-08T10:27:21.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24179.962502 secs 2023-05-08T10:27:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24179.962502 secs 2023-05-08T10:27:21.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24179.962502 secs 2023-05-08T10:27:22.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:22 smithi133 ceph-mon[125939]: pgmap v12953: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 80 KiB/s wr, 6 op/s 2023-05-08T10:27:22.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:22 smithi096 ceph-mon[124666]: pgmap v12953: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 80 KiB/s wr, 6 op/s 2023-05-08T10:27:22.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:22 smithi186 ceph-mon[126480]: pgmap v12953: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 80 KiB/s wr, 6 op/s 2023-05-08T10:27:24.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:24 smithi133 ceph-mon[125939]: pgmap v12954: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 80 KiB/s wr, 6 op/s 2023-05-08T10:27:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24183.119106 secs 2023-05-08T10:27:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24183.674844 secs 2023-05-08T10:27:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:24 smithi096 ceph-mon[124666]: pgmap v12954: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 80 KiB/s wr, 6 op/s 2023-05-08T10:27:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24183.119106 secs 2023-05-08T10:27:24.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24183.674844 secs 2023-05-08T10:27:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:24 smithi186 ceph-mon[126480]: pgmap v12954: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 80 KiB/s wr, 6 op/s 2023-05-08T10:27:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24183.119106 secs 2023-05-08T10:27:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24183.674844 secs 2023-05-08T10:27:26.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24184.962609 secs 2023-05-08T10:27:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:26 smithi133 ceph-mon[125939]: pgmap v12955: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 73 KiB/s wr, 5 op/s 2023-05-08T10:27:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24184.962609 secs 2023-05-08T10:27:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:26 smithi096 ceph-mon[124666]: pgmap v12955: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 73 KiB/s wr, 5 op/s 2023-05-08T10:27:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24184.962609 secs 2023-05-08T10:27:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:26 smithi186 ceph-mon[126480]: pgmap v12955: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 73 KiB/s wr, 5 op/s 2023-05-08T10:27:28.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:28 smithi133 ceph-mon[125939]: pgmap v12956: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 67 KiB/s wr, 5 op/s 2023-05-08T10:27:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:28 smithi096 ceph-mon[124666]: pgmap v12956: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 67 KiB/s wr, 5 op/s 2023-05-08T10:27:28.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:28 smithi186 ceph-mon[126480]: pgmap v12956: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 67 KiB/s wr, 5 op/s 2023-05-08T10:27:29.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24188.119219 secs 2023-05-08T10:27:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24188.674963 secs 2023-05-08T10:27:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24188.119219 secs 2023-05-08T10:27:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24188.674963 secs 2023-05-08T10:27:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24188.119219 secs 2023-05-08T10:27:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24188.674963 secs 2023-05-08T10:27:30.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:30 smithi133 ceph-mon[125939]: pgmap v12957: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 67 KiB/s wr, 7 op/s 2023-05-08T10:27:30.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:30 smithi096 ceph-mon[124666]: pgmap v12957: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 67 KiB/s wr, 7 op/s 2023-05-08T10:27:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:30 smithi186 ceph-mon[126480]: pgmap v12957: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 67 KiB/s wr, 7 op/s 2023-05-08T10:27:31.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24189.962696 secs 2023-05-08T10:27:31.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24189.962696 secs 2023-05-08T10:27:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24189.962696 secs 2023-05-08T10:27:32.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:32 smithi133 ceph-mon[125939]: pgmap v12958: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T10:27:32.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:32 smithi096 ceph-mon[124666]: pgmap v12958: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T10:27:32.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:32 smithi186 ceph-mon[126480]: pgmap v12958: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T10:27:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:34 smithi133 ceph-mon[125939]: pgmap v12959: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T10:27:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24193.119354 secs 2023-05-08T10:27:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24193.675088 secs 2023-05-08T10:27:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:34 smithi096 ceph-mon[124666]: pgmap v12959: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T10:27:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24193.119354 secs 2023-05-08T10:27:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24193.675088 secs 2023-05-08T10:27:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:34 smithi186 ceph-mon[126480]: pgmap v12959: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T10:27:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24193.119354 secs 2023-05-08T10:27:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24193.675088 secs 2023-05-08T10:27:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24194.962850 secs 2023-05-08T10:27:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:36 smithi133 ceph-mon[125939]: pgmap v12960: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 938 B/s wr, 8 op/s 2023-05-08T10:27:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24194.962850 secs 2023-05-08T10:27:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:36 smithi096 ceph-mon[124666]: pgmap v12960: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 938 B/s wr, 8 op/s 2023-05-08T10:27:36.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24194.962850 secs 2023-05-08T10:27:36.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:36 smithi186 ceph-mon[126480]: pgmap v12960: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 938 B/s wr, 8 op/s 2023-05-08T10:27:38.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:38 smithi133 ceph-mon[125939]: pgmap v12961: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T10:27:38.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:38 smithi096 ceph-mon[124666]: pgmap v12961: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T10:27:38.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:38 smithi186 ceph-mon[126480]: pgmap v12961: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T10:27:39.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24198.119475 secs 2023-05-08T10:27:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24198.675208 secs 2023-05-08T10:27:39.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24198.119475 secs 2023-05-08T10:27:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24198.675208 secs 2023-05-08T10:27:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24198.119475 secs 2023-05-08T10:27:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24198.675208 secs 2023-05-08T10:27:40.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:40 smithi133 ceph-mon[125939]: pgmap v12962: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 87 KiB/s wr, 9 op/s 2023-05-08T10:27:40.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:40 smithi096 ceph-mon[124666]: pgmap v12962: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 87 KiB/s wr, 9 op/s 2023-05-08T10:27:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:40 smithi186 ceph-mon[126480]: pgmap v12962: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 87 KiB/s wr, 9 op/s 2023-05-08T10:27:42.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:42 smithi133 ceph-mon[125939]: pgmap v12963: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 87 KiB/s wr, 6 op/s 2023-05-08T10:27:42.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:42 smithi096 ceph-mon[124666]: pgmap v12963: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 87 KiB/s wr, 6 op/s 2023-05-08T10:27:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:42 smithi186 ceph-mon[126480]: pgmap v12963: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 87 KiB/s wr, 6 op/s 2023-05-08T10:27:44.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:44 smithi133 ceph-mon[125939]: pgmap v12964: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 87 KiB/s wr, 6 op/s 2023-05-08T10:27:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24203.119592 secs 2023-05-08T10:27:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:44 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:27:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24203.675329 secs 2023-05-08T10:27:44.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:44 smithi096 ceph-mon[124666]: pgmap v12964: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 87 KiB/s wr, 6 op/s 2023-05-08T10:27:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24203.119592 secs 2023-05-08T10:27:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:44 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:27:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24203.675329 secs 2023-05-08T10:27:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:44 smithi186 ceph-mon[126480]: pgmap v12964: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 87 KiB/s wr, 6 op/s 2023-05-08T10:27:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24203.119592 secs 2023-05-08T10:27:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:44 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:27:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24203.675329 secs 2023-05-08T10:27:45.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:45 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:27:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:45 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:27:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:45 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:27:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:45 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:27:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:45 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:27:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:45 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:27:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:45 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:27:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:45 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:27:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:45 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:27:46.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:46 smithi133 ceph-mon[125939]: pgmap v12965: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 265 KiB/s wr, 10 op/s 2023-05-08T10:27:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:46 smithi096 ceph-mon[124666]: pgmap v12965: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 265 KiB/s wr, 10 op/s 2023-05-08T10:27:46.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:46 smithi186 ceph-mon[126480]: pgmap v12965: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 265 KiB/s wr, 10 op/s 2023-05-08T10:27:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:48 smithi133 ceph-mon[125939]: pgmap v12966: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 264 KiB/s wr, 6 op/s 2023-05-08T10:27:48.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:48 smithi096 ceph-mon[124666]: pgmap v12966: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 264 KiB/s wr, 6 op/s 2023-05-08T10:27:48.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:48 smithi186 ceph-mon[126480]: pgmap v12966: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 264 KiB/s wr, 6 op/s 2023-05-08T10:27:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24208.119706 secs 2023-05-08T10:27:49.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24208.119706 secs 2023-05-08T10:27:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24208.119706 secs 2023-05-08T10:27:50.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:50 smithi133 ceph-mon[125939]: pgmap v12967: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 380 KiB/s wr, 11 op/s 2023-05-08T10:27:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:50 smithi096 ceph-mon[124666]: pgmap v12967: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 380 KiB/s wr, 11 op/s 2023-05-08T10:27:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:50 smithi186 ceph-mon[126480]: pgmap v12967: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 380 KiB/s wr, 11 op/s 2023-05-08T10:27:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:52 smithi133 ceph-mon[125939]: pgmap v12968: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 294 KiB/s wr, 8 op/s 2023-05-08T10:27:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:27:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:52 smithi096 ceph-mon[124666]: pgmap v12968: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 294 KiB/s wr, 8 op/s 2023-05-08T10:27:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:27:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:52 smithi186 ceph-mon[126480]: pgmap v12968: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 294 KiB/s wr, 8 op/s 2023-05-08T10:27:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:27:53.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:53 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:27:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:27:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:27:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:53 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:27:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:27:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:27:53.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:53 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:27:53.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:27:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:27:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:54 smithi096 ceph-mon[124666]: pgmap v12969: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 294 KiB/s wr, 8 op/s 2023-05-08T10:27:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24213.119826 secs 2023-05-08T10:27:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24213.675566 secs 2023-05-08T10:27:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:54 smithi186 ceph-mon[126480]: pgmap v12969: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 294 KiB/s wr, 8 op/s 2023-05-08T10:27:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24213.119826 secs 2023-05-08T10:27:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24213.675566 secs 2023-05-08T10:27:54.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:54 smithi133 ceph-mon[125939]: pgmap v12969: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 294 KiB/s wr, 8 op/s 2023-05-08T10:27:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24213.119826 secs 2023-05-08T10:27:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24213.675566 secs 2023-05-08T10:27:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24214.963270 secs 2023-05-08T10:27:55.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24214.963270 secs 2023-05-08T10:27:55.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24214.963270 secs 2023-05-08T10:27:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:56 smithi096 ceph-mon[124666]: pgmap v12970: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 671 KiB/s rd, 618 KiB/s wr, 14 op/s 2023-05-08T10:27:56.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:56 smithi186 ceph-mon[126480]: pgmap v12970: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 671 KiB/s rd, 618 KiB/s wr, 14 op/s 2023-05-08T10:27:56.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:56 smithi133 ceph-mon[125939]: pgmap v12970: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 671 KiB/s rd, 618 KiB/s wr, 14 op/s 2023-05-08T10:27:57.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:27:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:27:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:27:57.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:27:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:27:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:27:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:27:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:27:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:27:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:58 smithi186 ceph-mon[126480]: pgmap v12971: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 492 KiB/s rd, 440 KiB/s wr, 10 op/s 2023-05-08T10:27:58.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:58 smithi133 ceph-mon[125939]: pgmap v12971: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 492 KiB/s rd, 440 KiB/s wr, 10 op/s 2023-05-08T10:27:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:58 smithi096 ceph-mon[124666]: pgmap v12971: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 492 KiB/s rd, 440 KiB/s wr, 10 op/s 2023-05-08T10:27:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24218.119946 secs 2023-05-08T10:27:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:27:59 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:27:59.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24218.119946 secs 2023-05-08T10:27:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:27:59 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:28:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24218.119946 secs 2023-05-08T10:28:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:27:59 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:28:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:00 smithi186 ceph-mon[126480]: pgmap v12972: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 700 KiB/s rd, 660 KiB/s wr, 16 op/s 2023-05-08T10:28:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:00 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:28:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24219.963423 secs 2023-05-08T10:28:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:00 smithi133 ceph-mon[125939]: pgmap v12972: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 700 KiB/s rd, 660 KiB/s wr, 16 op/s 2023-05-08T10:28:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:00 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:28:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24219.963423 secs 2023-05-08T10:28:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:00 smithi096 ceph-mon[124666]: pgmap v12972: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 700 KiB/s rd, 660 KiB/s wr, 16 op/s 2023-05-08T10:28:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:00 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:28:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24219.963423 secs 2023-05-08T10:28:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:28:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:28:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:28:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:28:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:28:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:28:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:02 smithi186 ceph-mon[126480]: pgmap v12973: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 566 KiB/s rd, 544 KiB/s wr, 12 op/s 2023-05-08T10:28:02.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:02 smithi133 ceph-mon[125939]: pgmap v12973: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 566 KiB/s rd, 544 KiB/s wr, 12 op/s 2023-05-08T10:28:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:02 smithi096 ceph-mon[124666]: pgmap v12973: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 566 KiB/s rd, 544 KiB/s wr, 12 op/s 2023-05-08T10:28:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:04 smithi186 ceph-mon[126480]: pgmap v12974: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 566 KiB/s rd, 544 KiB/s wr, 12 op/s 2023-05-08T10:28:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24223.120083 secs 2023-05-08T10:28:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24223.675758 secs 2023-05-08T10:28:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:04 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:28:04.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:04 smithi133 ceph-mon[125939]: pgmap v12974: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 566 KiB/s rd, 544 KiB/s wr, 12 op/s 2023-05-08T10:28:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24223.120083 secs 2023-05-08T10:28:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24223.675758 secs 2023-05-08T10:28:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:04 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:28:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:04 smithi096 ceph-mon[124666]: pgmap v12974: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 566 KiB/s rd, 544 KiB/s wr, 12 op/s 2023-05-08T10:28:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24223.120083 secs 2023-05-08T10:28:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24223.675758 secs 2023-05-08T10:28:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:04 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:28:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24224.963549 secs 2023-05-08T10:28:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:05 smithi186 ceph-mon[126480]: pgmap v12975: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 744 KiB/s rd, 743 KiB/s wr, 31 op/s 2023-05-08T10:28:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24224.963549 secs 2023-05-08T10:28:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:05 smithi133 ceph-mon[125939]: pgmap v12975: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 744 KiB/s rd, 743 KiB/s wr, 31 op/s 2023-05-08T10:28:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24224.963549 secs 2023-05-08T10:28:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:05 smithi096 ceph-mon[124666]: pgmap v12975: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 744 KiB/s rd, 743 KiB/s wr, 31 op/s 2023-05-08T10:28:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:06 smithi186 ceph-mon[126480]: osdmap e888: 12 total, 12 up, 12 in 2023-05-08T10:28:06.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:06 smithi133 ceph-mon[125939]: osdmap e888: 12 total, 12 up, 12 in 2023-05-08T10:28:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:06 smithi096 ceph-mon[124666]: osdmap e888: 12 total, 12 up, 12 in 2023-05-08T10:28:07.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:07 smithi186 ceph-mon[126480]: pgmap v12977: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 503 KiB/s wr, 30 op/s 2023-05-08T10:28:07.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:07 smithi133 ceph-mon[125939]: pgmap v12977: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 503 KiB/s wr, 30 op/s 2023-05-08T10:28:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:07 smithi096 ceph-mon[124666]: pgmap v12977: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 503 KiB/s wr, 30 op/s 2023-05-08T10:28:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24228.120230 secs 2023-05-08T10:28:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:28:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:28:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24228.675875 secs 2023-05-08T10:28:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:09 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:28:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:09 smithi186 ceph-mon[126480]: pgmap v12978: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 352 KiB/s wr, 27 op/s 2023-05-08T10:28:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24228.120230 secs 2023-05-08T10:28:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:28:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:28:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24228.675875 secs 2023-05-08T10:28:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:09 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:28:09.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:09 smithi133 ceph-mon[125939]: pgmap v12978: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 352 KiB/s wr, 27 op/s 2023-05-08T10:28:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24228.120230 secs 2023-05-08T10:28:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:28:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:28:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24228.675875 secs 2023-05-08T10:28:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:09 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:28:10.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:09 smithi096 ceph-mon[124666]: pgmap v12978: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 352 KiB/s wr, 27 op/s 2023-05-08T10:28:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24229.963636 secs 2023-05-08T10:28:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24229.963636 secs 2023-05-08T10:28:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24229.963636 secs 2023-05-08T10:28:12.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:12 smithi186 ceph-mon[126480]: pgmap v12979: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 352 KiB/s wr, 27 op/s 2023-05-08T10:28:12.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:12 smithi133 ceph-mon[125939]: pgmap v12979: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 352 KiB/s wr, 27 op/s 2023-05-08T10:28:12.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:12 smithi096 ceph-mon[124666]: pgmap v12979: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 352 KiB/s wr, 27 op/s 2023-05-08T10:28:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:14 smithi186 ceph-mon[126480]: pgmap v12980: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 352 KiB/s wr, 27 op/s 2023-05-08T10:28:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24233.120380 secs 2023-05-08T10:28:14.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24233.675993 secs 2023-05-08T10:28:14.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:14 smithi186 ceph-mon[126480]: osdmap e889: 12 total, 12 up, 12 in 2023-05-08T10:28:14.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:14 smithi133 ceph-mon[125939]: pgmap v12980: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 352 KiB/s wr, 27 op/s 2023-05-08T10:28:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24233.120380 secs 2023-05-08T10:28:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24233.675993 secs 2023-05-08T10:28:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:14 smithi133 ceph-mon[125939]: osdmap e889: 12 total, 12 up, 12 in 2023-05-08T10:28:14.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:14 smithi096 ceph-mon[124666]: pgmap v12980: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 352 KiB/s wr, 27 op/s 2023-05-08T10:28:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24233.120380 secs 2023-05-08T10:28:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24233.675993 secs 2023-05-08T10:28:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:14 smithi096 ceph-mon[124666]: osdmap e889: 12 total, 12 up, 12 in 2023-05-08T10:28:16.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24234.963759 secs 2023-05-08T10:28:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:16 smithi186 ceph-mon[126480]: pgmap v12982: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 312 KiB/s wr, 8 op/s 2023-05-08T10:28:16.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24234.963759 secs 2023-05-08T10:28:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:16 smithi133 ceph-mon[125939]: pgmap v12982: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 312 KiB/s wr, 8 op/s 2023-05-08T10:28:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24234.963759 secs 2023-05-08T10:28:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:16 smithi096 ceph-mon[124666]: pgmap v12982: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 312 KiB/s wr, 8 op/s 2023-05-08T10:28:18.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:18 smithi186 ceph-mon[126480]: pgmap v12983: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 303 KiB/s wr, 8 op/s 2023-05-08T10:28:18.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:18 smithi133 ceph-mon[125939]: pgmap v12983: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 303 KiB/s wr, 8 op/s 2023-05-08T10:28:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:18 smithi096 ceph-mon[124666]: pgmap v12983: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 303 KiB/s wr, 8 op/s 2023-05-08T10:28:19.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24238.120521 secs 2023-05-08T10:28:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24238.676081 secs 2023-05-08T10:28:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:19 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:28:19.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24238.120521 secs 2023-05-08T10:28:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24238.676081 secs 2023-05-08T10:28:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:19 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:28:19.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24238.120521 secs 2023-05-08T10:28:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24238.676081 secs 2023-05-08T10:28:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:19 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:28:20.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:20 smithi186 ceph-mon[126480]: pgmap v12984: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 190 KiB/s wr, 6 op/s 2023-05-08T10:28:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:20 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:28:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:20 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:28:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:20 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:28:20.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:20 smithi133 ceph-mon[125939]: pgmap v12984: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 190 KiB/s wr, 6 op/s 2023-05-08T10:28:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:20 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:28:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:20 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:28:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:20 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:28:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:20 smithi096 ceph-mon[124666]: pgmap v12984: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 190 KiB/s wr, 6 op/s 2023-05-08T10:28:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:20 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:28:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:20 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:28:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:20 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:28:21.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:21 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:28:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:21 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T10:28:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:21 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T10:28:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:21 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:28:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24239.963883 secs 2023-05-08T10:28:21.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:21 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:28:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:21 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T10:28:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:21 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T10:28:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:21 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:28:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24239.963883 secs 2023-05-08T10:28:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:21 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:28:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:21 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T10:28:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:21 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T10:28:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:21 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:28:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24239.963883 secs 2023-05-08T10:28:22.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:22 smithi186 ceph-mon[126480]: pgmap v12985: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 190 KiB/s wr, 6 op/s 2023-05-08T10:28:22.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:22 smithi133 ceph-mon[125939]: pgmap v12985: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 190 KiB/s wr, 6 op/s 2023-05-08T10:28:22.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:22 smithi096 ceph-mon[124666]: pgmap v12985: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 190 KiB/s wr, 6 op/s 2023-05-08T10:28:24.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:24 smithi186 ceph-mon[126480]: pgmap v12986: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 190 KiB/s wr, 6 op/s 2023-05-08T10:28:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24243.120627 secs 2023-05-08T10:28:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24243.676197 secs 2023-05-08T10:28:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:24 smithi133 ceph-mon[125939]: pgmap v12986: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 190 KiB/s wr, 6 op/s 2023-05-08T10:28:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24243.120627 secs 2023-05-08T10:28:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24243.676197 secs 2023-05-08T10:28:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:24 smithi096 ceph-mon[124666]: pgmap v12986: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 190 KiB/s wr, 6 op/s 2023-05-08T10:28:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24243.120627 secs 2023-05-08T10:28:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24243.676197 secs 2023-05-08T10:28:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24244.963979 secs 2023-05-08T10:28:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:26 smithi186 ceph-mon[126480]: pgmap v12987: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:28:26.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24244.963979 secs 2023-05-08T10:28:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:26 smithi133 ceph-mon[125939]: pgmap v12987: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:28:26.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24244.963979 secs 2023-05-08T10:28:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:26 smithi096 ceph-mon[124666]: pgmap v12987: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:28:28.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:28 smithi186 ceph-mon[126480]: pgmap v12988: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2023-05-08T10:28:28.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:28 smithi133 ceph-mon[125939]: pgmap v12988: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2023-05-08T10:28:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:28 smithi096 ceph-mon[124666]: pgmap v12988: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2023-05-08T10:28:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24248.120749 secs 2023-05-08T10:28:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24248.676294 secs 2023-05-08T10:28:29.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24248.120749 secs 2023-05-08T10:28:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24248.676294 secs 2023-05-08T10:28:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24248.120749 secs 2023-05-08T10:28:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24248.676294 secs 2023-05-08T10:28:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:30 smithi186 ceph-mon[126480]: pgmap v12989: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 511 B/s wr, 7 op/s 2023-05-08T10:28:30.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:30 smithi133 ceph-mon[125939]: pgmap v12989: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 511 B/s wr, 7 op/s 2023-05-08T10:28:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:30 smithi096 ceph-mon[124666]: pgmap v12989: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 511 B/s wr, 7 op/s 2023-05-08T10:28:31.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24249.964104 secs 2023-05-08T10:28:31.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24249.964104 secs 2023-05-08T10:28:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24249.964104 secs 2023-05-08T10:28:32.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:32 smithi133 ceph-mon[125939]: pgmap v12990: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T10:28:32.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:32 smithi096 ceph-mon[124666]: pgmap v12990: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T10:28:32.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:32 smithi186 ceph-mon[126480]: pgmap v12990: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T10:28:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:34 smithi133 ceph-mon[125939]: pgmap v12991: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T10:28:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24253.120841 secs 2023-05-08T10:28:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24253.676410 secs 2023-05-08T10:28:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:34 smithi096 ceph-mon[124666]: pgmap v12991: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T10:28:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24253.120841 secs 2023-05-08T10:28:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24253.676410 secs 2023-05-08T10:28:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:34 smithi186 ceph-mon[126480]: pgmap v12991: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T10:28:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24253.120841 secs 2023-05-08T10:28:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24253.676410 secs 2023-05-08T10:28:36.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24254.964237 secs 2023-05-08T10:28:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:36 smithi133 ceph-mon[125939]: pgmap v12992: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 87 KiB/s wr, 8 op/s 2023-05-08T10:28:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24254.964237 secs 2023-05-08T10:28:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:36 smithi096 ceph-mon[124666]: pgmap v12992: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 87 KiB/s wr, 8 op/s 2023-05-08T10:28:36.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24254.964237 secs 2023-05-08T10:28:36.895 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:36 smithi186 ceph-mon[126480]: pgmap v12992: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 87 KiB/s wr, 8 op/s 2023-05-08T10:28:38.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:38 smithi133 ceph-mon[125939]: pgmap v12993: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 87 KiB/s wr, 6 op/s 2023-05-08T10:28:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:38 smithi096 ceph-mon[124666]: pgmap v12993: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 87 KiB/s wr, 6 op/s 2023-05-08T10:28:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:38 smithi186 ceph-mon[126480]: pgmap v12993: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 87 KiB/s wr, 6 op/s 2023-05-08T10:28:39.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24258.120982 secs 2023-05-08T10:28:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24258.676525 secs 2023-05-08T10:28:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24258.120982 secs 2023-05-08T10:28:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24258.676525 secs 2023-05-08T10:28:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24258.120982 secs 2023-05-08T10:28:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24258.676525 secs 2023-05-08T10:28:40.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:40 smithi133 ceph-mon[125939]: pgmap v12994: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 87 KiB/s wr, 9 op/s 2023-05-08T10:28:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:40 smithi096 ceph-mon[124666]: pgmap v12994: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 87 KiB/s wr, 9 op/s 2023-05-08T10:28:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:40 smithi186 ceph-mon[126480]: pgmap v12994: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 87 KiB/s wr, 9 op/s 2023-05-08T10:28:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:42 smithi133 ceph-mon[125939]: pgmap v12995: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 87 KiB/s wr, 6 op/s 2023-05-08T10:28:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:42 smithi096 ceph-mon[124666]: pgmap v12995: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 87 KiB/s wr, 6 op/s 2023-05-08T10:28:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:42 smithi186 ceph-mon[126480]: pgmap v12995: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 87 KiB/s wr, 6 op/s 2023-05-08T10:28:44.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:44 smithi133 ceph-mon[125939]: pgmap v12996: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 87 KiB/s wr, 6 op/s 2023-05-08T10:28:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24263.121106 secs 2023-05-08T10:28:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:44 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:28:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24263.676633 secs 2023-05-08T10:28:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:44 smithi096 ceph-mon[124666]: pgmap v12996: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 87 KiB/s wr, 6 op/s 2023-05-08T10:28:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24263.121106 secs 2023-05-08T10:28:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:44 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:28:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24263.676633 secs 2023-05-08T10:28:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:44 smithi186 ceph-mon[126480]: pgmap v12996: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 87 KiB/s wr, 6 op/s 2023-05-08T10:28:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24263.121106 secs 2023-05-08T10:28:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:44 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:28:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24263.676633 secs 2023-05-08T10:28:45.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:45 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:28:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:45 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:28:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:45 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:28:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:45 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:28:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:45 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:28:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:45 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:28:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:45 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:28:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:45 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:28:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:45 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:28:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:46 smithi133 ceph-mon[125939]: pgmap v12997: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 319 KiB/s rd, 265 KiB/s wr, 10 op/s 2023-05-08T10:28:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:46 smithi096 ceph-mon[124666]: pgmap v12997: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 319 KiB/s rd, 265 KiB/s wr, 10 op/s 2023-05-08T10:28:46.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:46 smithi186 ceph-mon[126480]: pgmap v12997: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 319 KiB/s rd, 265 KiB/s wr, 10 op/s 2023-05-08T10:28:48.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:48 smithi133 ceph-mon[125939]: pgmap v12998: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 179 KiB/s wr, 7 op/s 2023-05-08T10:28:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:48 smithi096 ceph-mon[124666]: pgmap v12998: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 179 KiB/s wr, 7 op/s 2023-05-08T10:28:48.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:48 smithi186 ceph-mon[126480]: pgmap v12998: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 179 KiB/s wr, 7 op/s 2023-05-08T10:28:49.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24268.121242 secs 2023-05-08T10:28:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24268.121242 secs 2023-05-08T10:28:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24268.121242 secs 2023-05-08T10:28:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:50 smithi133 ceph-mon[125939]: pgmap v12999: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 581 KiB/s rd, 407 KiB/s wr, 11 op/s 2023-05-08T10:28:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:50 smithi096 ceph-mon[124666]: pgmap v12999: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 581 KiB/s rd, 407 KiB/s wr, 11 op/s 2023-05-08T10:28:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:50 smithi186 ceph-mon[126480]: pgmap v12999: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 581 KiB/s rd, 407 KiB/s wr, 11 op/s 2023-05-08T10:28:52.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:52 smithi133 ceph-mon[125939]: pgmap v13000: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 568 KiB/s wr, 8 op/s 2023-05-08T10:28:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:28:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:52 smithi096 ceph-mon[124666]: pgmap v13000: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 568 KiB/s wr, 8 op/s 2023-05-08T10:28:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:28:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:52 smithi186 ceph-mon[126480]: pgmap v13000: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 568 KiB/s wr, 8 op/s 2023-05-08T10:28:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:28:53.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:53 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:28:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:28:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:28:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:53 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:28:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:28:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:28:53.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:53 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:28:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:28:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:28:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:54 smithi133 ceph-mon[125939]: pgmap v13001: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 568 KiB/s wr, 8 op/s 2023-05-08T10:28:54.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24273.121358 secs 2023-05-08T10:28:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:54 smithi096 ceph-mon[124666]: pgmap v13001: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 568 KiB/s wr, 8 op/s 2023-05-08T10:28:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24273.121358 secs 2023-05-08T10:28:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:54 smithi186 ceph-mon[126480]: pgmap v13001: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 568 KiB/s wr, 8 op/s 2023-05-08T10:28:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24273.121358 secs 2023-05-08T10:28:56.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24274.964803 secs 2023-05-08T10:28:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:56 smithi133 ceph-mon[125939]: pgmap v13002: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 596 KiB/s wr, 13 op/s 2023-05-08T10:28:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24274.964803 secs 2023-05-08T10:28:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:56 smithi096 ceph-mon[124666]: pgmap v13002: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 596 KiB/s wr, 13 op/s 2023-05-08T10:28:56.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24274.964803 secs 2023-05-08T10:28:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:56 smithi186 ceph-mon[126480]: pgmap v13002: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 596 KiB/s wr, 13 op/s 2023-05-08T10:28:57.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:28:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:28:57.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:28:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:28:57.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:28:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:28:58.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:58 smithi133 ceph-mon[125939]: pgmap v13003: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 683 KiB/s rd, 598 KiB/s wr, 10 op/s 2023-05-08T10:28:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:58 smithi096 ceph-mon[124666]: pgmap v13003: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 683 KiB/s rd, 598 KiB/s wr, 10 op/s 2023-05-08T10:28:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:58 smithi186 ceph-mon[126480]: pgmap v13003: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 683 KiB/s rd, 598 KiB/s wr, 10 op/s 2023-05-08T10:28:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24278.121475 secs 2023-05-08T10:28:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:28:59 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:28:59.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24278.121475 secs 2023-05-08T10:28:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:28:59 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:28:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24278.121475 secs 2023-05-08T10:28:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:28:59 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:29:00.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:00 smithi133 ceph-mon[125939]: pgmap v13004: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 925 KiB/s rd, 828 KiB/s wr, 16 op/s 2023-05-08T10:29:00.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:00 smithi096 ceph-mon[124666]: pgmap v13004: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 925 KiB/s rd, 828 KiB/s wr, 16 op/s 2023-05-08T10:29:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:00 smithi186 ceph-mon[126480]: pgmap v13004: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 925 KiB/s rd, 828 KiB/s wr, 16 op/s 2023-05-08T10:29:01.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24279.964895 secs 2023-05-08T10:29:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24279.964895 secs 2023-05-08T10:29:01.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24279.964895 secs 2023-05-08T10:29:02.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:02 smithi133 ceph-mon[125939]: pgmap v13005: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 662 KiB/s rd, 599 KiB/s wr, 12 op/s 2023-05-08T10:29:02.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:02 smithi096 ceph-mon[124666]: pgmap v13005: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 662 KiB/s rd, 599 KiB/s wr, 12 op/s 2023-05-08T10:29:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:02 smithi186 ceph-mon[126480]: pgmap v13005: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 662 KiB/s rd, 599 KiB/s wr, 12 op/s 2023-05-08T10:29:04.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:04 smithi133 ceph-mon[125939]: pgmap v13006: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 662 KiB/s rd, 438 KiB/s wr, 12 op/s 2023-05-08T10:29:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24283.121561 secs 2023-05-08T10:29:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24283.677134 secs 2023-05-08T10:29:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:04 smithi096 ceph-mon[124666]: pgmap v13006: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 662 KiB/s rd, 438 KiB/s wr, 12 op/s 2023-05-08T10:29:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24283.121561 secs 2023-05-08T10:29:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24283.677134 secs 2023-05-08T10:29:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:04 smithi186 ceph-mon[126480]: pgmap v13006: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 662 KiB/s rd, 438 KiB/s wr, 12 op/s 2023-05-08T10:29:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24283.121561 secs 2023-05-08T10:29:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24283.677134 secs 2023-05-08T10:29:06.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24284.965011 secs 2023-05-08T10:29:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:06 smithi133 ceph-mon[125939]: pgmap v13007: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 788 KiB/s rd, 796 KiB/s wr, 31 op/s 2023-05-08T10:29:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:06 smithi133 ceph-mon[125939]: osdmap e890: 12 total, 12 up, 12 in 2023-05-08T10:29:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24284.965011 secs 2023-05-08T10:29:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:06 smithi096 ceph-mon[124666]: pgmap v13007: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 788 KiB/s rd, 796 KiB/s wr, 31 op/s 2023-05-08T10:29:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:06 smithi096 ceph-mon[124666]: osdmap e890: 12 total, 12 up, 12 in 2023-05-08T10:29:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24284.965011 secs 2023-05-08T10:29:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:06 smithi186 ceph-mon[126480]: pgmap v13007: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 788 KiB/s rd, 796 KiB/s wr, 31 op/s 2023-05-08T10:29:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:06 smithi186 ceph-mon[126480]: osdmap e890: 12 total, 12 up, 12 in 2023-05-08T10:29:08.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:08 smithi133 ceph-mon[125939]: pgmap v13009: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 706 KiB/s wr, 30 op/s 2023-05-08T10:29:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:08 smithi096 ceph-mon[124666]: pgmap v13009: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 706 KiB/s wr, 30 op/s 2023-05-08T10:29:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:08 smithi186 ceph-mon[126480]: pgmap v13009: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 706 KiB/s wr, 30 op/s 2023-05-08T10:29:09.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24288.121651 secs 2023-05-08T10:29:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:09 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:29:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:29:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:29:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24288.677215 secs 2023-05-08T10:29:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24288.121651 secs 2023-05-08T10:29:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:09 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:29:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:29:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:29:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24288.677215 secs 2023-05-08T10:29:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24288.121651 secs 2023-05-08T10:29:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:09 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:29:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:29:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:29:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24288.677215 secs 2023-05-08T10:29:10.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:10 smithi133 ceph-mon[125939]: pgmap v13010: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 481 KiB/s wr, 27 op/s 2023-05-08T10:29:10.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:10 smithi096 ceph-mon[124666]: pgmap v13010: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 481 KiB/s wr, 27 op/s 2023-05-08T10:29:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:10 smithi186 ceph-mon[126480]: pgmap v13010: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 481 KiB/s wr, 27 op/s 2023-05-08T10:29:11.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24289.965113 secs 2023-05-08T10:29:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24289.965113 secs 2023-05-08T10:29:11.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24289.965113 secs 2023-05-08T10:29:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:12 smithi133 ceph-mon[125939]: pgmap v13011: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 481 KiB/s wr, 27 op/s 2023-05-08T10:29:12.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:12 smithi096 ceph-mon[124666]: pgmap v13011: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 481 KiB/s wr, 27 op/s 2023-05-08T10:29:12.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:12 smithi186 ceph-mon[126480]: pgmap v13011: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 481 KiB/s wr, 27 op/s 2023-05-08T10:29:14.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:14 smithi096 ceph-mon[124666]: pgmap v13012: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 481 KiB/s wr, 27 op/s 2023-05-08T10:29:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24293.121790 secs 2023-05-08T10:29:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24293.677334 secs 2023-05-08T10:29:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:14 smithi096 ceph-mon[124666]: osdmap e891: 12 total, 12 up, 12 in 2023-05-08T10:29:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:14 smithi186 ceph-mon[126480]: pgmap v13012: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 481 KiB/s wr, 27 op/s 2023-05-08T10:29:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24293.121790 secs 2023-05-08T10:29:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24293.677334 secs 2023-05-08T10:29:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:14 smithi186 ceph-mon[126480]: osdmap e891: 12 total, 12 up, 12 in 2023-05-08T10:29:14.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:14 smithi133 ceph-mon[125939]: pgmap v13012: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 481 KiB/s wr, 27 op/s 2023-05-08T10:29:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24293.121790 secs 2023-05-08T10:29:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24293.677334 secs 2023-05-08T10:29:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:14 smithi133 ceph-mon[125939]: osdmap e891: 12 total, 12 up, 12 in 2023-05-08T10:29:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24294.965234 secs 2023-05-08T10:29:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:16 smithi096 ceph-mon[124666]: pgmap v13014: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 411 KiB/s rd, 167 KiB/s wr, 8 op/s 2023-05-08T10:29:16.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24294.965234 secs 2023-05-08T10:29:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:16 smithi186 ceph-mon[126480]: pgmap v13014: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 411 KiB/s rd, 167 KiB/s wr, 8 op/s 2023-05-08T10:29:16.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24294.965234 secs 2023-05-08T10:29:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:16 smithi133 ceph-mon[125939]: pgmap v13014: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 411 KiB/s rd, 167 KiB/s wr, 8 op/s 2023-05-08T10:29:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:18 smithi096 ceph-mon[124666]: pgmap v13015: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 164 KiB/s wr, 8 op/s 2023-05-08T10:29:18.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:18 smithi186 ceph-mon[126480]: pgmap v13015: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 164 KiB/s wr, 8 op/s 2023-05-08T10:29:18.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:18 smithi133 ceph-mon[125939]: pgmap v13015: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 164 KiB/s wr, 8 op/s 2023-05-08T10:29:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24298.121929 secs 2023-05-08T10:29:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24298.677461 secs 2023-05-08T10:29:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24298.121929 secs 2023-05-08T10:29:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24298.677461 secs 2023-05-08T10:29:19.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24298.121929 secs 2023-05-08T10:29:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24298.677461 secs 2023-05-08T10:29:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:20 smithi096 ceph-mon[124666]: pgmap v13016: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 113 KiB/s wr, 6 op/s 2023-05-08T10:29:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:20 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:29:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24299.965303 secs 2023-05-08T10:29:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:20 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:29:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:20 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:29:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:20 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:29:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:20 smithi186 ceph-mon[126480]: pgmap v13016: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 113 KiB/s wr, 6 op/s 2023-05-08T10:29:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:20 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:29:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24299.965303 secs 2023-05-08T10:29:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:20 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:29:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:20 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:29:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:20 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:29:20.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:20 smithi133 ceph-mon[125939]: pgmap v13016: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 113 KiB/s wr, 6 op/s 2023-05-08T10:29:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:20 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:29:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24299.965303 secs 2023-05-08T10:29:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:20 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:29:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:20 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:29:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:20 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:29:21.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:21 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:29:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:21 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T10:29:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:21 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T10:29:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:21 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:29:21.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:21 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:29:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:21 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T10:29:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:21 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T10:29:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:21 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:29:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:21 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:29:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:21 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T10:29:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:21 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T10:29:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:21 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:29:22.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:22 smithi186 ceph-mon[126480]: pgmap v13017: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 113 KiB/s wr, 6 op/s 2023-05-08T10:29:22.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:22 smithi133 ceph-mon[125939]: pgmap v13017: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 113 KiB/s wr, 6 op/s 2023-05-08T10:29:23.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:22 smithi096 ceph-mon[124666]: pgmap v13017: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 113 KiB/s wr, 6 op/s 2023-05-08T10:29:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:24 smithi186 ceph-mon[126480]: pgmap v13018: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 113 KiB/s wr, 6 op/s 2023-05-08T10:29:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24303.122064 secs 2023-05-08T10:29:24.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24303.677556 secs 2023-05-08T10:29:24.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:24 smithi133 ceph-mon[125939]: pgmap v13018: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 113 KiB/s wr, 6 op/s 2023-05-08T10:29:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24303.122064 secs 2023-05-08T10:29:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24303.677556 secs 2023-05-08T10:29:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:24 smithi096 ceph-mon[124666]: pgmap v13018: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 113 KiB/s wr, 6 op/s 2023-05-08T10:29:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24303.122064 secs 2023-05-08T10:29:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24303.677556 secs 2023-05-08T10:29:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24304.965444 secs 2023-05-08T10:29:25.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24304.965444 secs 2023-05-08T10:29:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24304.965444 secs 2023-05-08T10:29:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:26 smithi186 ceph-mon[126480]: pgmap v13019: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-05-08T10:29:26.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:26 smithi133 ceph-mon[125939]: pgmap v13019: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-05-08T10:29:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:26 smithi096 ceph-mon[124666]: pgmap v13019: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-05-08T10:29:28.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:28 smithi186 ceph-mon[126480]: pgmap v13020: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:29:28.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:28 smithi133 ceph-mon[125939]: pgmap v13020: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:29:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:28 smithi096 ceph-mon[124666]: pgmap v13020: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:29:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24308.122210 secs 2023-05-08T10:29:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24308.677682 secs 2023-05-08T10:29:29.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24308.122210 secs 2023-05-08T10:29:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24308.677682 secs 2023-05-08T10:29:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24308.122210 secs 2023-05-08T10:29:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24308.677682 secs 2023-05-08T10:29:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:30 smithi186 ceph-mon[126480]: pgmap v13021: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T10:29:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24309.965598 secs 2023-05-08T10:29:30.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:30 smithi133 ceph-mon[125939]: pgmap v13021: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T10:29:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24309.965598 secs 2023-05-08T10:29:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:30 smithi096 ceph-mon[124666]: pgmap v13021: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T10:29:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24309.965598 secs 2023-05-08T10:29:32.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:32 smithi186 ceph-mon[126480]: pgmap v13022: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T10:29:32.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:32 smithi133 ceph-mon[125939]: pgmap v13022: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T10:29:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:32 smithi096 ceph-mon[124666]: pgmap v13022: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T10:29:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:34 smithi186 ceph-mon[126480]: pgmap v13023: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T10:29:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24313.122306 secs 2023-05-08T10:29:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24313.677806 secs 2023-05-08T10:29:34.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:34 smithi133 ceph-mon[125939]: pgmap v13023: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T10:29:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24313.122306 secs 2023-05-08T10:29:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24313.677806 secs 2023-05-08T10:29:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:34 smithi096 ceph-mon[124666]: pgmap v13023: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T10:29:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24313.122306 secs 2023-05-08T10:29:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24313.677806 secs 2023-05-08T10:29:35.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24314.965725 secs 2023-05-08T10:29:35.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24314.965725 secs 2023-05-08T10:29:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24314.965725 secs 2023-05-08T10:29:36.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:36 smithi186 ceph-mon[126480]: pgmap v13024: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 37 KiB/s wr, 8 op/s 2023-05-08T10:29:36.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:36 smithi133 ceph-mon[125939]: pgmap v13024: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 37 KiB/s wr, 8 op/s 2023-05-08T10:29:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:36 smithi096 ceph-mon[124666]: pgmap v13024: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 37 KiB/s wr, 8 op/s 2023-05-08T10:29:37.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:37 smithi186 ceph-mon[126480]: pgmap v13025: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 37 KiB/s wr, 6 op/s 2023-05-08T10:29:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:37 smithi133 ceph-mon[125939]: pgmap v13025: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 37 KiB/s wr, 6 op/s 2023-05-08T10:29:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:37 smithi096 ceph-mon[124666]: pgmap v13025: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 37 KiB/s wr, 6 op/s 2023-05-08T10:29:39.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24318.122427 secs 2023-05-08T10:29:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24318.122427 secs 2023-05-08T10:29:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24318.122427 secs 2023-05-08T10:29:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24318.677968 secs 2023-05-08T10:29:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:39 smithi186 ceph-mon[126480]: pgmap v13026: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 260 KiB/s wr, 10 op/s 2023-05-08T10:29:40.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24318.677968 secs 2023-05-08T10:29:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:39 smithi133 ceph-mon[125939]: pgmap v13026: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 260 KiB/s wr, 10 op/s 2023-05-08T10:29:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24318.677968 secs 2023-05-08T10:29:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:39 smithi096 ceph-mon[124666]: pgmap v13026: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 260 KiB/s wr, 10 op/s 2023-05-08T10:29:42.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:42 smithi186 ceph-mon[126480]: pgmap v13027: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 260 KiB/s wr, 7 op/s 2023-05-08T10:29:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:42 smithi133 ceph-mon[125939]: pgmap v13027: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 260 KiB/s wr, 7 op/s 2023-05-08T10:29:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:42 smithi096 ceph-mon[124666]: pgmap v13027: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 260 KiB/s wr, 7 op/s 2023-05-08T10:29:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:44 smithi186 ceph-mon[126480]: pgmap v13028: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 260 KiB/s wr, 7 op/s 2023-05-08T10:29:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24323.122477 secs 2023-05-08T10:29:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:44 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:29:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24323.678098 secs 2023-05-08T10:29:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:44 smithi133 ceph-mon[125939]: pgmap v13028: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 260 KiB/s wr, 7 op/s 2023-05-08T10:29:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24323.122477 secs 2023-05-08T10:29:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:44 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:29:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24323.678098 secs 2023-05-08T10:29:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:44 smithi096 ceph-mon[124666]: pgmap v13028: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 260 KiB/s wr, 7 op/s 2023-05-08T10:29:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24323.122477 secs 2023-05-08T10:29:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:44 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:29:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24323.678098 secs 2023-05-08T10:29:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:45 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:29:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:45 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:29:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:45 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:29:45.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:45 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:29:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:45 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:29:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:45 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:29:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:45 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:29:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:45 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:29:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:45 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:29:46.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:46 smithi133 ceph-mon[125939]: pgmap v13029: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 347 KiB/s wr, 11 op/s 2023-05-08T10:29:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:46 smithi096 ceph-mon[124666]: pgmap v13029: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 347 KiB/s wr, 11 op/s 2023-05-08T10:29:46.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:46 smithi186 ceph-mon[126480]: pgmap v13029: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 347 KiB/s wr, 11 op/s 2023-05-08T10:29:48.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:48 smithi133 ceph-mon[125939]: pgmap v13030: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 310 KiB/s wr, 7 op/s 2023-05-08T10:29:48.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:48 smithi096 ceph-mon[124666]: pgmap v13030: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 310 KiB/s wr, 7 op/s 2023-05-08T10:29:48.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:48 smithi186 ceph-mon[126480]: pgmap v13030: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 310 KiB/s wr, 7 op/s 2023-05-08T10:29:49.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24328.122555 secs 2023-05-08T10:29:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24328.122555 secs 2023-05-08T10:29:49.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24328.122555 secs 2023-05-08T10:29:50.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:50 smithi133 ceph-mon[125939]: pgmap v13031: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 580 KiB/s rd, 504 KiB/s wr, 12 op/s 2023-05-08T10:29:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:50 smithi096 ceph-mon[124666]: pgmap v13031: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 580 KiB/s rd, 504 KiB/s wr, 12 op/s 2023-05-08T10:29:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:50 smithi186 ceph-mon[126480]: pgmap v13031: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 580 KiB/s rd, 504 KiB/s wr, 12 op/s 2023-05-08T10:29:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:52 smithi133 ceph-mon[125939]: pgmap v13032: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 281 KiB/s wr, 8 op/s 2023-05-08T10:29:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:29:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:52 smithi096 ceph-mon[124666]: pgmap v13032: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 281 KiB/s wr, 8 op/s 2023-05-08T10:29:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:29:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:52 smithi186 ceph-mon[126480]: pgmap v13032: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 281 KiB/s wr, 8 op/s 2023-05-08T10:29:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:29:53.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:53 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:29:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:29:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:29:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:53 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:29:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:29:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:29:53.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:53 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:29:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:29:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:29:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:54 smithi133 ceph-mon[125939]: pgmap v13033: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 281 KiB/s wr, 8 op/s 2023-05-08T10:29:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24333.122621 secs 2023-05-08T10:29:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24333.678326 secs 2023-05-08T10:29:54.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:54 smithi096 ceph-mon[124666]: pgmap v13033: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 281 KiB/s wr, 8 op/s 2023-05-08T10:29:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24333.122621 secs 2023-05-08T10:29:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24333.678326 secs 2023-05-08T10:29:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:54 smithi186 ceph-mon[126480]: pgmap v13033: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 281 KiB/s wr, 8 op/s 2023-05-08T10:29:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24333.122621 secs 2023-05-08T10:29:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24333.678326 secs 2023-05-08T10:29:56.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:56 smithi133 ceph-mon[125939]: pgmap v13034: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 596 KiB/s rd, 511 KiB/s wr, 13 op/s 2023-05-08T10:29:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:56 smithi096 ceph-mon[124666]: pgmap v13034: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 596 KiB/s rd, 511 KiB/s wr, 13 op/s 2023-05-08T10:29:56.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:56 smithi186 ceph-mon[126480]: pgmap v13034: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 596 KiB/s rd, 511 KiB/s wr, 13 op/s 2023-05-08T10:29:57.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:29:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:29:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:29:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:29:57.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:29:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:29:58.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:58 smithi133 ceph-mon[125939]: pgmap v13035: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 423 KiB/s wr, 9 op/s 2023-05-08T10:29:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:58 smithi096 ceph-mon[124666]: pgmap v13035: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 423 KiB/s wr, 9 op/s 2023-05-08T10:29:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:58 smithi186 ceph-mon[126480]: pgmap v13035: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 423 KiB/s wr, 9 op/s 2023-05-08T10:29:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24338.122698 secs 2023-05-08T10:29:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:29:59 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:29:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24338.122698 secs 2023-05-08T10:29:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:29:59 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:29:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24338.122698 secs 2023-05-08T10:29:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:29:59 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:30:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:00 smithi133 ceph-mon[125939]: pgmap v13036: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 696 KiB/s rd, 683 KiB/s wr, 15 op/s 2023-05-08T10:30:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:00 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:30:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:00 smithi133 ceph-mon[125939]: Health detail: HEALTH_WARN 2 MDSs report slow requests 2023-05-08T10:30:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:00 smithi133 ceph-mon[125939]: [WRN] MDS_SLOW_REQUEST: 2 MDSs report slow requests 2023-05-08T10:30:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:00 smithi133 ceph-mon[125939]: mds.c(mds.2): 1 slow requests are blocked > 180 secs 2023-05-08T10:30:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:00 smithi133 ceph-mon[125939]: mds.i(mds.1): 1 slow requests are blocked > 180 secs 2023-05-08T10:30:00.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:00 smithi096 ceph-mon[124666]: pgmap v13036: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 696 KiB/s rd, 683 KiB/s wr, 15 op/s 2023-05-08T10:30:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:00 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:30:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:00 smithi096 ceph-mon[124666]: Health detail: HEALTH_WARN 2 MDSs report slow requests 2023-05-08T10:30:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:00 smithi096 ceph-mon[124666]: [WRN] MDS_SLOW_REQUEST: 2 MDSs report slow requests 2023-05-08T10:30:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:00 smithi096 ceph-mon[124666]: mds.c(mds.2): 1 slow requests are blocked > 180 secs 2023-05-08T10:30:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:00 smithi096 ceph-mon[124666]: mds.i(mds.1): 1 slow requests are blocked > 180 secs 2023-05-08T10:30:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:00 smithi186 ceph-mon[126480]: pgmap v13036: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 696 KiB/s rd, 683 KiB/s wr, 15 op/s 2023-05-08T10:30:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:00 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:30:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:00 smithi186 ceph-mon[126480]: Health detail: HEALTH_WARN 2 MDSs report slow requests 2023-05-08T10:30:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:00 smithi186 ceph-mon[126480]: [WRN] MDS_SLOW_REQUEST: 2 MDSs report slow requests 2023-05-08T10:30:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:00 smithi186 ceph-mon[126480]: mds.c(mds.2): 1 slow requests are blocked > 180 secs 2023-05-08T10:30:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:00 smithi186 ceph-mon[126480]: mds.i(mds.1): 1 slow requests are blocked > 180 secs 2023-05-08T10:30:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24339.966280 secs 2023-05-08T10:30:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:30:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:30:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24339.966280 secs 2023-05-08T10:30:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:30:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:30:01.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24339.966280 secs 2023-05-08T10:30:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:30:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:30:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:02 smithi133 ceph-mon[125939]: pgmap v13037: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 489 KiB/s wr, 11 op/s 2023-05-08T10:30:02.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:02 smithi096 ceph-mon[124666]: pgmap v13037: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 489 KiB/s wr, 11 op/s 2023-05-08T10:30:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:02 smithi186 ceph-mon[126480]: pgmap v13037: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 489 KiB/s wr, 11 op/s 2023-05-08T10:30:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:04 smithi133 ceph-mon[125939]: pgmap v13038: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 489 KiB/s wr, 11 op/s 2023-05-08T10:30:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24343.122840 secs 2023-05-08T10:30:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24343.678531 secs 2023-05-08T10:30:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:04 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:30:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:04 smithi096 ceph-mon[124666]: pgmap v13038: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 489 KiB/s wr, 11 op/s 2023-05-08T10:30:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24343.122840 secs 2023-05-08T10:30:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24343.678531 secs 2023-05-08T10:30:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:04 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:30:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:04 smithi186 ceph-mon[126480]: pgmap v13038: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 489 KiB/s wr, 11 op/s 2023-05-08T10:30:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24343.122840 secs 2023-05-08T10:30:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24343.678531 secs 2023-05-08T10:30:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:04 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:30:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:30:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:30:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:30:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:30:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:30:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:30:06.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24344.966400 secs 2023-05-08T10:30:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:06 smithi133 ceph-mon[125939]: pgmap v13039: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 732 KiB/s rd, 755 KiB/s wr, 30 op/s 2023-05-08T10:30:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:06 smithi133 ceph-mon[125939]: osdmap e892: 12 total, 12 up, 12 in 2023-05-08T10:30:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24344.966400 secs 2023-05-08T10:30:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:06 smithi096 ceph-mon[124666]: pgmap v13039: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 732 KiB/s rd, 755 KiB/s wr, 30 op/s 2023-05-08T10:30:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:06 smithi096 ceph-mon[124666]: osdmap e892: 12 total, 12 up, 12 in 2023-05-08T10:30:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24344.966400 secs 2023-05-08T10:30:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:06 smithi186 ceph-mon[126480]: pgmap v13039: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 732 KiB/s rd, 755 KiB/s wr, 30 op/s 2023-05-08T10:30:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:06 smithi186 ceph-mon[126480]: osdmap e892: 12 total, 12 up, 12 in 2023-05-08T10:30:08.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:08 smithi133 ceph-mon[125939]: pgmap v13041: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 716 KiB/s rd, 630 KiB/s wr, 30 op/s 2023-05-08T10:30:08.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:08 smithi096 ceph-mon[124666]: pgmap v13041: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 716 KiB/s rd, 630 KiB/s wr, 30 op/s 2023-05-08T10:30:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:08 smithi186 ceph-mon[126480]: pgmap v13041: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 716 KiB/s rd, 630 KiB/s wr, 30 op/s 2023-05-08T10:30:09.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24348.122972 secs 2023-05-08T10:30:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:30:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:30:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24348.678614 secs 2023-05-08T10:30:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:09 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:30:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24348.122972 secs 2023-05-08T10:30:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:30:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:30:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24348.678614 secs 2023-05-08T10:30:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:09 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:30:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24348.122972 secs 2023-05-08T10:30:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:30:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:30:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24348.678614 secs 2023-05-08T10:30:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:09 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:30:10.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:10 smithi133 ceph-mon[125939]: pgmap v13042: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 433 KiB/s wr, 27 op/s 2023-05-08T10:30:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:10 smithi096 ceph-mon[124666]: pgmap v13042: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 433 KiB/s wr, 27 op/s 2023-05-08T10:30:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:10 smithi186 ceph-mon[126480]: pgmap v13042: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 433 KiB/s wr, 27 op/s 2023-05-08T10:30:11.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24349.966490 secs 2023-05-08T10:30:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24349.966490 secs 2023-05-08T10:30:11.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24349.966490 secs 2023-05-08T10:30:12.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:12 smithi133 ceph-mon[125939]: pgmap v13043: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 432 KiB/s wr, 27 op/s 2023-05-08T10:30:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:12 smithi096 ceph-mon[124666]: pgmap v13043: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 432 KiB/s wr, 27 op/s 2023-05-08T10:30:12.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:12 smithi186 ceph-mon[126480]: pgmap v13043: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 432 KiB/s wr, 27 op/s 2023-05-08T10:30:14.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:14 smithi133 ceph-mon[125939]: pgmap v13044: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 432 KiB/s wr, 27 op/s 2023-05-08T10:30:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24353.123051 secs 2023-05-08T10:30:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24353.678713 secs 2023-05-08T10:30:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:14 smithi133 ceph-mon[125939]: osdmap e893: 12 total, 12 up, 12 in 2023-05-08T10:30:14.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:14 smithi096 ceph-mon[124666]: pgmap v13044: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 432 KiB/s wr, 27 op/s 2023-05-08T10:30:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24353.123051 secs 2023-05-08T10:30:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24353.678713 secs 2023-05-08T10:30:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:14 smithi096 ceph-mon[124666]: osdmap e893: 12 total, 12 up, 12 in 2023-05-08T10:30:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:14 smithi186 ceph-mon[126480]: pgmap v13044: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 432 KiB/s wr, 27 op/s 2023-05-08T10:30:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24353.123051 secs 2023-05-08T10:30:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24353.678713 secs 2023-05-08T10:30:14.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:14 smithi186 ceph-mon[126480]: osdmap e893: 12 total, 12 up, 12 in 2023-05-08T10:30:16.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24354.966641 secs 2023-05-08T10:30:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:16 smithi133 ceph-mon[125939]: pgmap v13046: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 197 KiB/s wr, 7 op/s 2023-05-08T10:30:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24354.966641 secs 2023-05-08T10:30:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:16 smithi096 ceph-mon[124666]: pgmap v13046: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 197 KiB/s wr, 7 op/s 2023-05-08T10:30:16.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24354.966641 secs 2023-05-08T10:30:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:16 smithi186 ceph-mon[126480]: pgmap v13046: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 197 KiB/s wr, 7 op/s 2023-05-08T10:30:18.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:18 smithi133 ceph-mon[125939]: pgmap v13047: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 195 KiB/s wr, 7 op/s 2023-05-08T10:30:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:18 smithi096 ceph-mon[124666]: pgmap v13047: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 195 KiB/s wr, 7 op/s 2023-05-08T10:30:18.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:18 smithi186 ceph-mon[126480]: pgmap v13047: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 195 KiB/s wr, 7 op/s 2023-05-08T10:30:19.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24358.123179 secs 2023-05-08T10:30:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24358.678798 secs 2023-05-08T10:30:19.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24358.123179 secs 2023-05-08T10:30:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24358.678798 secs 2023-05-08T10:30:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24358.123179 secs 2023-05-08T10:30:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24358.678798 secs 2023-05-08T10:30:20.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:20 smithi133 ceph-mon[125939]: pgmap v13048: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 81 KiB/s wr, 6 op/s 2023-05-08T10:30:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:20 smithi096 ceph-mon[124666]: pgmap v13048: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 81 KiB/s wr, 6 op/s 2023-05-08T10:30:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:20 smithi186 ceph-mon[126480]: pgmap v13048: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 81 KiB/s wr, 6 op/s 2023-05-08T10:30:21.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24359.966760 secs 2023-05-08T10:30:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:30:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:30:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:30:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:30:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24359.966760 secs 2023-05-08T10:30:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:30:21.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:30:21.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:30:21.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:30:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24359.966760 secs 2023-05-08T10:30:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:30:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:30:21.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:30:21.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:30:22.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:22 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:30:22.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:22 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T10:30:22.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:22 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T10:30:22.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:22 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:30:22.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:22 smithi133 ceph-mon[125939]: pgmap v13049: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 81 KiB/s wr, 6 op/s 2023-05-08T10:30:22.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:22 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:30:22.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:22 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T10:30:22.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:22 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T10:30:22.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:22 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:30:22.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:22 smithi096 ceph-mon[124666]: pgmap v13049: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 81 KiB/s wr, 6 op/s 2023-05-08T10:30:22.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:22 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:30:22.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:22 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T10:30:22.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:22 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T10:30:22.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:22 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:30:22.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:22 smithi186 ceph-mon[126480]: pgmap v13049: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 81 KiB/s wr, 6 op/s 2023-05-08T10:30:24.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:24 smithi133 ceph-mon[125939]: pgmap v13050: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 81 KiB/s wr, 6 op/s 2023-05-08T10:30:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24363.123296 secs 2023-05-08T10:30:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24363.678882 secs 2023-05-08T10:30:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:24 smithi096 ceph-mon[124666]: pgmap v13050: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 81 KiB/s wr, 6 op/s 2023-05-08T10:30:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24363.123296 secs 2023-05-08T10:30:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24363.678882 secs 2023-05-08T10:30:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:24 smithi186 ceph-mon[126480]: pgmap v13050: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 81 KiB/s wr, 6 op/s 2023-05-08T10:30:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24363.123296 secs 2023-05-08T10:30:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24363.678882 secs 2023-05-08T10:30:26.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24364.966858 secs 2023-05-08T10:30:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:26 smithi133 ceph-mon[125939]: pgmap v13051: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-05-08T10:30:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24364.966858 secs 2023-05-08T10:30:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:26 smithi096 ceph-mon[124666]: pgmap v13051: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-05-08T10:30:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24364.966858 secs 2023-05-08T10:30:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:26 smithi186 ceph-mon[126480]: pgmap v13051: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-05-08T10:30:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:28 smithi096 ceph-mon[124666]: pgmap v13052: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:30:28.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:28 smithi186 ceph-mon[126480]: pgmap v13052: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:30:28.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:28 smithi133 ceph-mon[125939]: pgmap v13052: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:30:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24368.123411 secs 2023-05-08T10:30:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24368.679000 secs 2023-05-08T10:30:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24368.123411 secs 2023-05-08T10:30:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24368.679000 secs 2023-05-08T10:30:29.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24368.123411 secs 2023-05-08T10:30:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24368.679000 secs 2023-05-08T10:30:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:30 smithi096 ceph-mon[124666]: pgmap v13053: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T10:30:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:30 smithi186 ceph-mon[126480]: pgmap v13053: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T10:30:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:30 smithi133 ceph-mon[125939]: pgmap v13053: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T10:30:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24369.966927 secs 2023-05-08T10:30:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24369.966927 secs 2023-05-08T10:30:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24369.966927 secs 2023-05-08T10:30:32.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:32 smithi096 ceph-mon[124666]: pgmap v13054: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T10:30:32.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:32 smithi186 ceph-mon[126480]: pgmap v13054: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T10:30:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:32 smithi133 ceph-mon[125939]: pgmap v13054: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T10:30:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:34 smithi186 ceph-mon[126480]: pgmap v13055: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T10:30:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24373.123542 secs 2023-05-08T10:30:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24373.679097 secs 2023-05-08T10:30:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:34 smithi133 ceph-mon[125939]: pgmap v13055: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T10:30:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24373.123542 secs 2023-05-08T10:30:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24373.679097 secs 2023-05-08T10:30:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:34 smithi096 ceph-mon[124666]: pgmap v13055: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T10:30:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24373.123542 secs 2023-05-08T10:30:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24373.679097 secs 2023-05-08T10:30:35.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24374.967022 secs 2023-05-08T10:30:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:35 smithi186 ceph-mon[126480]: pgmap v13056: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T10:30:35.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24374.967022 secs 2023-05-08T10:30:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:35 smithi133 ceph-mon[125939]: pgmap v13056: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T10:30:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24374.967022 secs 2023-05-08T10:30:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:35 smithi096 ceph-mon[124666]: pgmap v13056: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T10:30:38.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:38 smithi186 ceph-mon[126480]: pgmap v13057: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T10:30:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:38 smithi133 ceph-mon[125939]: pgmap v13057: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T10:30:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:38 smithi096 ceph-mon[124666]: pgmap v13057: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T10:30:39.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24378.123655 secs 2023-05-08T10:30:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24378.679248 secs 2023-05-08T10:30:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24378.123655 secs 2023-05-08T10:30:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24378.679248 secs 2023-05-08T10:30:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24378.123655 secs 2023-05-08T10:30:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24378.679248 secs 2023-05-08T10:30:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:40 smithi133 ceph-mon[125939]: pgmap v13058: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 88 KiB/s wr, 9 op/s 2023-05-08T10:30:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:40 smithi096 ceph-mon[124666]: pgmap v13058: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 88 KiB/s wr, 9 op/s 2023-05-08T10:30:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:40 smithi186 ceph-mon[126480]: pgmap v13058: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 88 KiB/s wr, 9 op/s 2023-05-08T10:30:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:42 smithi133 ceph-mon[125939]: pgmap v13059: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 88 KiB/s wr, 6 op/s 2023-05-08T10:30:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:42 smithi096 ceph-mon[124666]: pgmap v13059: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 88 KiB/s wr, 6 op/s 2023-05-08T10:30:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:42 smithi186 ceph-mon[126480]: pgmap v13059: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 88 KiB/s wr, 6 op/s 2023-05-08T10:30:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:44 smithi133 ceph-mon[125939]: pgmap v13060: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 88 KiB/s wr, 6 op/s 2023-05-08T10:30:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24383.123778 secs 2023-05-08T10:30:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:44 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:30:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24383.679390 secs 2023-05-08T10:30:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:44 smithi096 ceph-mon[124666]: pgmap v13060: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 88 KiB/s wr, 6 op/s 2023-05-08T10:30:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24383.123778 secs 2023-05-08T10:30:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:44 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:30:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24383.679390 secs 2023-05-08T10:30:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:44 smithi186 ceph-mon[126480]: pgmap v13060: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 88 KiB/s wr, 6 op/s 2023-05-08T10:30:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24383.123778 secs 2023-05-08T10:30:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:44 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:30:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24383.679390 secs 2023-05-08T10:30:45.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:45 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:30:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:45 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:30:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:45 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:30:45.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:45 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:30:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:45 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:30:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:45 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:30:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:45 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:30:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:45 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:30:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:45 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:30:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:46 smithi133 ceph-mon[125939]: pgmap v13061: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 268 KiB/s wr, 10 op/s 2023-05-08T10:30:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:46 smithi096 ceph-mon[124666]: pgmap v13061: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 268 KiB/s wr, 10 op/s 2023-05-08T10:30:46.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:46 smithi186 ceph-mon[126480]: pgmap v13061: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 268 KiB/s wr, 10 op/s 2023-05-08T10:30:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:48 smithi133 ceph-mon[125939]: pgmap v13062: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 267 KiB/s wr, 7 op/s 2023-05-08T10:30:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:48 smithi096 ceph-mon[124666]: pgmap v13062: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 267 KiB/s wr, 7 op/s 2023-05-08T10:30:48.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:48 smithi186 ceph-mon[126480]: pgmap v13062: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 267 KiB/s wr, 7 op/s 2023-05-08T10:30:49.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24388.123916 secs 2023-05-08T10:30:49.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24388.123916 secs 2023-05-08T10:30:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24388.123916 secs 2023-05-08T10:30:50.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:50 smithi133 ceph-mon[125939]: pgmap v13063: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 369 KiB/s wr, 11 op/s 2023-05-08T10:30:50.777 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:50 smithi096 ceph-mon[124666]: pgmap v13063: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 369 KiB/s wr, 11 op/s 2023-05-08T10:30:50.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:50 smithi186 ceph-mon[126480]: pgmap v13063: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 369 KiB/s wr, 11 op/s 2023-05-08T10:30:52.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:52 smithi133 ceph-mon[125939]: pgmap v13064: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 282 KiB/s wr, 7 op/s 2023-05-08T10:30:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:30:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:52 smithi096 ceph-mon[124666]: pgmap v13064: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 282 KiB/s wr, 7 op/s 2023-05-08T10:30:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:30:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:52 smithi186 ceph-mon[126480]: pgmap v13064: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 282 KiB/s wr, 7 op/s 2023-05-08T10:30:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:30:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:53 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:30:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:30:53.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:30:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:53 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:30:53.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:30:53.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:30:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:53 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:30:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:30:53.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:30:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:54 smithi133 ceph-mon[125939]: pgmap v13065: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 282 KiB/s wr, 7 op/s 2023-05-08T10:30:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24393.124051 secs 2023-05-08T10:30:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:54 smithi096 ceph-mon[124666]: pgmap v13065: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 282 KiB/s wr, 7 op/s 2023-05-08T10:30:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24393.124051 secs 2023-05-08T10:30:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:54 smithi186 ceph-mon[126480]: pgmap v13065: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 282 KiB/s wr, 7 op/s 2023-05-08T10:30:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24393.124051 secs 2023-05-08T10:30:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:56 smithi133 ceph-mon[125939]: pgmap v13066: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 809 KiB/s rd, 607 KiB/s wr, 14 op/s 2023-05-08T10:30:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:56 smithi096 ceph-mon[124666]: pgmap v13066: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 809 KiB/s rd, 607 KiB/s wr, 14 op/s 2023-05-08T10:30:56.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:56 smithi186 ceph-mon[126480]: pgmap v13066: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 809 KiB/s rd, 607 KiB/s wr, 14 op/s 2023-05-08T10:30:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:58 smithi133 ceph-mon[125939]: pgmap v13067: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 542 KiB/s rd, 427 KiB/s wr, 10 op/s 2023-05-08T10:30:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:58 smithi096 ceph-mon[124666]: pgmap v13067: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 542 KiB/s rd, 427 KiB/s wr, 10 op/s 2023-05-08T10:30:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:58 smithi186 ceph-mon[126480]: pgmap v13067: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 542 KiB/s rd, 427 KiB/s wr, 10 op/s 2023-05-08T10:30:59.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:30:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24398.124175 secs 2023-05-08T10:30:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:30:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24398.124175 secs 2023-05-08T10:30:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:30:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24398.124175 secs 2023-05-08T10:31:00.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:00 smithi133 ceph-mon[125939]: pgmap v13068: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 806 KiB/s rd, 688 KiB/s wr, 16 op/s 2023-05-08T10:31:00.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:00 smithi096 ceph-mon[124666]: pgmap v13068: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 806 KiB/s rd, 688 KiB/s wr, 16 op/s 2023-05-08T10:31:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:00 smithi186 ceph-mon[126480]: pgmap v13068: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 806 KiB/s rd, 688 KiB/s wr, 16 op/s 2023-05-08T10:31:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24399.967612 secs 2023-05-08T10:31:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24399.967612 secs 2023-05-08T10:31:01.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24399.967612 secs 2023-05-08T10:31:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:02 smithi133 ceph-mon[125939]: pgmap v13069: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 703 KiB/s rd, 586 KiB/s wr, 12 op/s 2023-05-08T10:31:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:02 smithi096 ceph-mon[124666]: pgmap v13069: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 703 KiB/s rd, 586 KiB/s wr, 12 op/s 2023-05-08T10:31:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:02 smithi186 ceph-mon[126480]: pgmap v13069: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 703 KiB/s rd, 586 KiB/s wr, 12 op/s 2023-05-08T10:31:04.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:04 smithi133 ceph-mon[125939]: pgmap v13070: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 703 KiB/s rd, 586 KiB/s wr, 12 op/s 2023-05-08T10:31:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24403.124292 secs 2023-05-08T10:31:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24403.679801 secs 2023-05-08T10:31:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:04 smithi096 ceph-mon[124666]: pgmap v13070: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 703 KiB/s rd, 586 KiB/s wr, 12 op/s 2023-05-08T10:31:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24403.124292 secs 2023-05-08T10:31:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24403.679801 secs 2023-05-08T10:31:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:04 smithi186 ceph-mon[126480]: pgmap v13070: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 703 KiB/s rd, 586 KiB/s wr, 12 op/s 2023-05-08T10:31:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24403.124292 secs 2023-05-08T10:31:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24403.679801 secs 2023-05-08T10:31:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:05 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:31:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:31:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:31:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:05 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:31:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:31:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:31:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:05 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:31:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:31:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:31:06.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24404.967732 secs 2023-05-08T10:31:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:06 smithi133 ceph-mon[125939]: pgmap v13071: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 842 KiB/s rd, 760 KiB/s wr, 32 op/s 2023-05-08T10:31:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:06 smithi133 ceph-mon[125939]: osdmap e894: 12 total, 12 up, 12 in 2023-05-08T10:31:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24404.967732 secs 2023-05-08T10:31:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:06 smithi096 ceph-mon[124666]: pgmap v13071: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 842 KiB/s rd, 760 KiB/s wr, 32 op/s 2023-05-08T10:31:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:06 smithi096 ceph-mon[124666]: osdmap e894: 12 total, 12 up, 12 in 2023-05-08T10:31:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24404.967732 secs 2023-05-08T10:31:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:06 smithi186 ceph-mon[126480]: pgmap v13071: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 842 KiB/s rd, 760 KiB/s wr, 32 op/s 2023-05-08T10:31:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:06 smithi186 ceph-mon[126480]: osdmap e894: 12 total, 12 up, 12 in 2023-05-08T10:31:08.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:08 smithi133 ceph-mon[125939]: pgmap v13073: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 522 KiB/s wr, 31 op/s 2023-05-08T10:31:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:08 smithi096 ceph-mon[124666]: pgmap v13073: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 522 KiB/s wr, 31 op/s 2023-05-08T10:31:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:08 smithi186 ceph-mon[126480]: pgmap v13073: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 522 KiB/s wr, 31 op/s 2023-05-08T10:31:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24408.124389 secs 2023-05-08T10:31:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:31:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:31:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24408.679939 secs 2023-05-08T10:31:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24408.124389 secs 2023-05-08T10:31:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:31:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:31:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24408.679939 secs 2023-05-08T10:31:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24408.124389 secs 2023-05-08T10:31:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:31:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:31:09.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24408.679939 secs 2023-05-08T10:31:10.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:10 smithi133 ceph-mon[125939]: pgmap v13074: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 323 KiB/s wr, 29 op/s 2023-05-08T10:31:10.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:10 smithi096 ceph-mon[124666]: pgmap v13074: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 323 KiB/s wr, 29 op/s 2023-05-08T10:31:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:10 smithi186 ceph-mon[126480]: pgmap v13074: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 323 KiB/s wr, 29 op/s 2023-05-08T10:31:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24409.967847 secs 2023-05-08T10:31:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24409.967847 secs 2023-05-08T10:31:11.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24409.967847 secs 2023-05-08T10:31:12.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:12 smithi133 ceph-mon[125939]: pgmap v13075: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 323 KiB/s wr, 29 op/s 2023-05-08T10:31:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:12 smithi096 ceph-mon[124666]: pgmap v13075: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 323 KiB/s wr, 29 op/s 2023-05-08T10:31:12.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:12 smithi186 ceph-mon[126480]: pgmap v13075: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 323 KiB/s wr, 29 op/s 2023-05-08T10:31:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:14 smithi133 ceph-mon[125939]: pgmap v13076: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 323 KiB/s wr, 29 op/s 2023-05-08T10:31:14.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24413.124509 secs 2023-05-08T10:31:14.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24413.680059 secs 2023-05-08T10:31:14.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:14 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:31:14.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:14 smithi133 ceph-mon[125939]: osdmap e895: 12 total, 12 up, 12 in 2023-05-08T10:31:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:14 smithi096 ceph-mon[124666]: pgmap v13076: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 323 KiB/s wr, 29 op/s 2023-05-08T10:31:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24413.124509 secs 2023-05-08T10:31:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24413.680059 secs 2023-05-08T10:31:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:14 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:31:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:14 smithi096 ceph-mon[124666]: osdmap e895: 12 total, 12 up, 12 in 2023-05-08T10:31:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:14 smithi186 ceph-mon[126480]: pgmap v13076: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 323 KiB/s wr, 29 op/s 2023-05-08T10:31:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24413.124509 secs 2023-05-08T10:31:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24413.680059 secs 2023-05-08T10:31:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:14 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:31:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:14 smithi186 ceph-mon[126480]: osdmap e895: 12 total, 12 up, 12 in 2023-05-08T10:31:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24414.967945 secs 2023-05-08T10:31:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:16 smithi133 ceph-mon[125939]: pgmap v13078: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 310 KiB/s wr, 9 op/s 2023-05-08T10:31:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24414.967945 secs 2023-05-08T10:31:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:16 smithi096 ceph-mon[124666]: pgmap v13078: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 310 KiB/s wr, 9 op/s 2023-05-08T10:31:16.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24414.967945 secs 2023-05-08T10:31:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:16 smithi186 ceph-mon[126480]: pgmap v13078: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 310 KiB/s wr, 9 op/s 2023-05-08T10:31:18.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:18 smithi133 ceph-mon[125939]: pgmap v13079: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 306 KiB/s wr, 9 op/s 2023-05-08T10:31:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:18 smithi096 ceph-mon[124666]: pgmap v13079: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 306 KiB/s wr, 9 op/s 2023-05-08T10:31:18.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:18 smithi186 ceph-mon[126480]: pgmap v13079: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 306 KiB/s wr, 9 op/s 2023-05-08T10:31:19.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24418.124622 secs 2023-05-08T10:31:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24418.680157 secs 2023-05-08T10:31:19.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24418.124622 secs 2023-05-08T10:31:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24418.680157 secs 2023-05-08T10:31:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24418.124622 secs 2023-05-08T10:31:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24418.680157 secs 2023-05-08T10:31:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:20 smithi133 ceph-mon[125939]: pgmap v13080: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 192 KiB/s wr, 7 op/s 2023-05-08T10:31:20.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:20 smithi096 ceph-mon[124666]: pgmap v13080: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 192 KiB/s wr, 7 op/s 2023-05-08T10:31:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:20 smithi186 ceph-mon[126480]: pgmap v13080: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 192 KiB/s wr, 7 op/s 2023-05-08T10:31:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24419.968065 secs 2023-05-08T10:31:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:31:21.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24419.968065 secs 2023-05-08T10:31:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:31:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24419.968065 secs 2023-05-08T10:31:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:31:22.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:22 smithi096 ceph-mon[124666]: pgmap v13081: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 192 KiB/s wr, 7 op/s 2023-05-08T10:31:22.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:22 smithi186 ceph-mon[126480]: pgmap v13081: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 192 KiB/s wr, 7 op/s 2023-05-08T10:31:22.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:22 smithi133 ceph-mon[125939]: pgmap v13081: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 192 KiB/s wr, 7 op/s 2023-05-08T10:31:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:24 smithi096 ceph-mon[124666]: pgmap v13082: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 192 KiB/s wr, 7 op/s 2023-05-08T10:31:24.782 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24423.124744 secs 2023-05-08T10:31:24.783 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24423.680283 secs 2023-05-08T10:31:24.783 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:31:24.783 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:31:24.783 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:31:24.783 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:31:24.784 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:31:24.784 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:31:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:24 smithi186 ceph-mon[126480]: pgmap v13082: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 192 KiB/s wr, 7 op/s 2023-05-08T10:31:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24423.124744 secs 2023-05-08T10:31:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24423.680283 secs 2023-05-08T10:31:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:31:24.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:31:24.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:31:24.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:31:24.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:31:24.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:31:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:24 smithi133 ceph-mon[125939]: pgmap v13082: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 192 KiB/s wr, 7 op/s 2023-05-08T10:31:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24423.124744 secs 2023-05-08T10:31:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24423.680283 secs 2023-05-08T10:31:24.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:31:24.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:31:24.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:31:24.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:31:24.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:31:24.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:31:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:25 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:31:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:25 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:31:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:25 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:31:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:25 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:31:25.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:25 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:31:25.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:25 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:31:25.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:25 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:31:25.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:25 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:31:25.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:25 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:31:25.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:25 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:31:25.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:25 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:31:25.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:25 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:31:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:25 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:31:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:25 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:31:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:25 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:31:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:25 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:31:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:25 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:31:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:25 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:31:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:25 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:31:25.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:25 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:31:25.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:25 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:31:25.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:25 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:31:25.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:25 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:31:25.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:25 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:31:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:25 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:31:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:25 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:31:25.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:25 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:31:25.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:25 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:31:25.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:25 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:31:25.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:25 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:31:25.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:25 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:31:25.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:25 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:31:25.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:25 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:31:25.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:25 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:31:25.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:25 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:31:25.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:25 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:31:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:26 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T10:31:26.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:26 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T10:31:26.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:26 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T10:31:26.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:26 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T10:31:26.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:26 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:31:26.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:26 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T10:31:26.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:26 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T10:31:26.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:26 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:31:26.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24424.968176 secs 2023-05-08T10:31:26.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:26 smithi096 ceph-mon[124666]: pgmap v13083: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2023-05-08T10:31:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:26 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T10:31:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:26 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T10:31:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:26 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T10:31:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:26 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T10:31:26.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:26 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:31:26.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:26 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T10:31:26.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:26 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T10:31:26.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:26 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:31:26.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24424.968176 secs 2023-05-08T10:31:26.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:26 smithi186 ceph-mon[126480]: pgmap v13083: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2023-05-08T10:31:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:26 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T10:31:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:26 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T10:31:26.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:26 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T10:31:26.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:26 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T10:31:26.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:26 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:31:26.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:26 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T10:31:26.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:26 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T10:31:26.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:26 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:31:26.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24424.968176 secs 2023-05-08T10:31:26.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:26 smithi133 ceph-mon[125939]: pgmap v13083: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2023-05-08T10:31:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:28 smithi096 ceph-mon[124666]: pgmap v13084: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:31:28.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:28 smithi186 ceph-mon[126480]: pgmap v13084: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:31:28.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:28 smithi133 ceph-mon[125939]: pgmap v13084: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:31:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24428.124877 secs 2023-05-08T10:31:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24428.680427 secs 2023-05-08T10:31:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24428.124877 secs 2023-05-08T10:31:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24428.680427 secs 2023-05-08T10:31:29.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24428.124877 secs 2023-05-08T10:31:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24428.680427 secs 2023-05-08T10:31:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:30 smithi096 ceph-mon[124666]: pgmap v13085: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T10:31:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:30 smithi186 ceph-mon[126480]: pgmap v13085: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T10:31:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:30 smithi133 ceph-mon[125939]: pgmap v13085: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T10:31:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24429.968304 secs 2023-05-08T10:31:31.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24429.968304 secs 2023-05-08T10:31:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24429.968304 secs 2023-05-08T10:31:32.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:32 smithi186 ceph-mon[126480]: pgmap v13086: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:31:32.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:32 smithi133 ceph-mon[125939]: pgmap v13086: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:31:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:32 smithi096 ceph-mon[124666]: pgmap v13086: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:31:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:34 smithi186 ceph-mon[126480]: pgmap v13087: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:31:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24433.124991 secs 2023-05-08T10:31:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24433.680562 secs 2023-05-08T10:31:34.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:34 smithi133 ceph-mon[125939]: pgmap v13087: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:31:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24433.124991 secs 2023-05-08T10:31:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24433.680562 secs 2023-05-08T10:31:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:34 smithi096 ceph-mon[124666]: pgmap v13087: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:31:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24433.124991 secs 2023-05-08T10:31:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24433.680562 secs 2023-05-08T10:31:35.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24434.968426 secs 2023-05-08T10:31:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24434.968426 secs 2023-05-08T10:31:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24434.968426 secs 2023-05-08T10:31:36.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:36 smithi186 ceph-mon[126480]: pgmap v13088: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 9 op/s 2023-05-08T10:31:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:36 smithi133 ceph-mon[125939]: pgmap v13088: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 9 op/s 2023-05-08T10:31:37.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:36 smithi096 ceph-mon[124666]: pgmap v13088: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 9 op/s 2023-05-08T10:31:38.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:38 smithi186 ceph-mon[126480]: pgmap v13089: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 6 op/s 2023-05-08T10:31:38.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:38 smithi133 ceph-mon[125939]: pgmap v13089: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 6 op/s 2023-05-08T10:31:39.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:38 smithi096 ceph-mon[124666]: pgmap v13089: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 6 op/s 2023-05-08T10:31:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24438.125112 secs 2023-05-08T10:31:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24438.680643 secs 2023-05-08T10:31:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24438.125112 secs 2023-05-08T10:31:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24438.680643 secs 2023-05-08T10:31:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24438.125112 secs 2023-05-08T10:31:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24438.680643 secs 2023-05-08T10:31:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:40 smithi186 ceph-mon[126480]: pgmap v13090: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 938 B/s wr, 10 op/s 2023-05-08T10:31:40.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:40 smithi133 ceph-mon[125939]: pgmap v13090: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 938 B/s wr, 10 op/s 2023-05-08T10:31:41.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:40 smithi096 ceph-mon[124666]: pgmap v13090: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 938 B/s wr, 10 op/s 2023-05-08T10:31:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:42 smithi186 ceph-mon[126480]: pgmap v13091: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 7 op/s 2023-05-08T10:31:42.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:42 smithi133 ceph-mon[125939]: pgmap v13091: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 7 op/s 2023-05-08T10:31:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:42 smithi096 ceph-mon[124666]: pgmap v13091: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 7 op/s 2023-05-08T10:31:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:44 smithi186 ceph-mon[126480]: pgmap v13092: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 7 op/s 2023-05-08T10:31:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:44 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:31:44.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:44 smithi133 ceph-mon[125939]: pgmap v13092: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 7 op/s 2023-05-08T10:31:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:44 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:31:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:44 smithi096 ceph-mon[124666]: pgmap v13092: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 7 op/s 2023-05-08T10:31:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:44 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:31:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:45 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:31:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:45 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:31:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:45 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:31:45.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:45 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:31:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:45 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:31:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:45 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:31:46.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:45 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:31:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:45 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:31:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:45 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:31:46.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:46 smithi186 ceph-mon[126480]: pgmap v13093: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 197 KiB/s wr, 11 op/s 2023-05-08T10:31:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:46 smithi133 ceph-mon[125939]: pgmap v13093: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 197 KiB/s wr, 11 op/s 2023-05-08T10:31:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:46 smithi096 ceph-mon[124666]: pgmap v13093: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 197 KiB/s wr, 11 op/s 2023-05-08T10:31:47.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:31:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:31:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:31:48.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:48 smithi186 ceph-mon[126480]: pgmap v13094: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 197 KiB/s wr, 8 op/s 2023-05-08T10:31:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T10:31:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:31:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:31:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:48 smithi133 ceph-mon[125939]: pgmap v13094: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 197 KiB/s wr, 8 op/s 2023-05-08T10:31:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T10:31:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:31:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:31:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:48 smithi096 ceph-mon[124666]: pgmap v13094: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 197 KiB/s wr, 8 op/s 2023-05-08T10:31:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T10:31:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:31:49.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:31:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24448.125366 secs 2023-05-08T10:31:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:49 smithi186 ceph-mon[126480]: Health check cleared: MDS_SLOW_REQUEST (was: 1 MDSs report slow requests) 2023-05-08T10:31:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:49 smithi186 ceph-mon[126480]: Cluster is now healthy 2023-05-08T10:31:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:31:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:31:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24448.680832 secs 2023-05-08T10:31:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:49 smithi186 ceph-mon[126480]: pgmap v13095: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 422 KiB/s wr, 14 op/s 2023-05-08T10:31:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24448.125366 secs 2023-05-08T10:31:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:49 smithi133 ceph-mon[125939]: Health check cleared: MDS_SLOW_REQUEST (was: 1 MDSs report slow requests) 2023-05-08T10:31:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:49 smithi133 ceph-mon[125939]: Cluster is now healthy 2023-05-08T10:31:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:31:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:31:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24448.680832 secs 2023-05-08T10:31:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:49 smithi133 ceph-mon[125939]: pgmap v13095: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 422 KiB/s wr, 14 op/s 2023-05-08T10:31:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24448.125366 secs 2023-05-08T10:31:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:49 smithi096 ceph-mon[124666]: Health check cleared: MDS_SLOW_REQUEST (was: 1 MDSs report slow requests) 2023-05-08T10:31:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:49 smithi096 ceph-mon[124666]: Cluster is now healthy 2023-05-08T10:31:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:31:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:31:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24448.680832 secs 2023-05-08T10:31:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:49 smithi096 ceph-mon[124666]: pgmap v13095: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 422 KiB/s wr, 14 op/s 2023-05-08T10:31:51.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:51 smithi186 ceph-mon[126480]: Health check failed: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:31:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T10:31:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:31:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:51 smithi133 ceph-mon[125939]: Health check failed: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:31:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T10:31:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:31:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:51 smithi096 ceph-mon[124666]: Health check failed: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:31:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T10:31:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:31:52.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:52 smithi133 ceph-mon[125939]: pgmap v13096: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 421 KiB/s wr, 10 op/s 2023-05-08T10:31:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:52 smithi096 ceph-mon[124666]: pgmap v13096: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 421 KiB/s wr, 10 op/s 2023-05-08T10:31:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:52 smithi186 ceph-mon[126480]: pgmap v13096: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 421 KiB/s wr, 10 op/s 2023-05-08T10:31:53.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:31:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:31:53.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:31:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:31:53.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:31:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:31:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:54 smithi133 ceph-mon[125939]: pgmap v13097: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 421 KiB/s wr, 10 op/s 2023-05-08T10:31:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24453.125481 secs 2023-05-08T10:31:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:54 smithi096 ceph-mon[124666]: pgmap v13097: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 421 KiB/s wr, 10 op/s 2023-05-08T10:31:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24453.125481 secs 2023-05-08T10:31:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:54 smithi186 ceph-mon[126480]: pgmap v13097: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 421 KiB/s wr, 10 op/s 2023-05-08T10:31:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24453.125481 secs 2023-05-08T10:31:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:56 smithi133 ceph-mon[125939]: pgmap v13098: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 576 KiB/s rd, 576 KiB/s wr, 14 op/s 2023-05-08T10:31:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:31:56.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:56 smithi096 ceph-mon[124666]: pgmap v13098: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 576 KiB/s rd, 576 KiB/s wr, 14 op/s 2023-05-08T10:31:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:31:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:56 smithi186 ceph-mon[126480]: pgmap v13098: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 576 KiB/s rd, 576 KiB/s wr, 14 op/s 2023-05-08T10:31:56.878 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:31:57.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:57 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:31:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:31:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:31:57.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:57 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:31:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:31:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:31:57.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:57 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:31:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:31:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:31:58.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:58 smithi133 ceph-mon[125939]: pgmap v13099: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 545 KiB/s rd, 648 KiB/s wr, 11 op/s 2023-05-08T10:31:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:58 smithi096 ceph-mon[124666]: pgmap v13099: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 545 KiB/s rd, 648 KiB/s wr, 11 op/s 2023-05-08T10:31:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:58 smithi186 ceph-mon[126480]: pgmap v13099: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 545 KiB/s rd, 648 KiB/s wr, 11 op/s 2023-05-08T10:31:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24458.125587 secs 2023-05-08T10:31:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:31:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24458.681105 secs 2023-05-08T10:31:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24458.125587 secs 2023-05-08T10:31:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:31:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24458.681105 secs 2023-05-08T10:31:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24458.125587 secs 2023-05-08T10:31:59.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:31:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24458.681105 secs 2023-05-08T10:32:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:00 smithi133 ceph-mon[125939]: pgmap v13100: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 575 KiB/s rd, 676 KiB/s wr, 15 op/s 2023-05-08T10:32:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:00 smithi096 ceph-mon[124666]: pgmap v13100: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 575 KiB/s rd, 676 KiB/s wr, 15 op/s 2023-05-08T10:32:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:00 smithi186 ceph-mon[126480]: pgmap v13100: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 575 KiB/s rd, 676 KiB/s wr, 15 op/s 2023-05-08T10:32:01.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24459.969003 secs 2023-05-08T10:32:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:32:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:32:01.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24459.969003 secs 2023-05-08T10:32:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:32:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:32:01.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24459.969003 secs 2023-05-08T10:32:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:32:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:32:02.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:02 smithi133 ceph-mon[125939]: pgmap v13101: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 525 KiB/s wr, 9 op/s 2023-05-08T10:32:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:02 smithi096 ceph-mon[124666]: pgmap v13101: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 525 KiB/s wr, 9 op/s 2023-05-08T10:32:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:02 smithi186 ceph-mon[126480]: pgmap v13101: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 525 KiB/s wr, 9 op/s 2023-05-08T10:32:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:04 smithi133 ceph-mon[125939]: pgmap v13102: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 525 KiB/s wr, 9 op/s 2023-05-08T10:32:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24463.125710 secs 2023-05-08T10:32:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24463.681244 secs 2023-05-08T10:32:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:04 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:32:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:04 smithi096 ceph-mon[124666]: pgmap v13102: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 525 KiB/s wr, 9 op/s 2023-05-08T10:32:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24463.125710 secs 2023-05-08T10:32:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24463.681244 secs 2023-05-08T10:32:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:04 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:32:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:04 smithi186 ceph-mon[126480]: pgmap v13102: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 525 KiB/s wr, 9 op/s 2023-05-08T10:32:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24463.125710 secs 2023-05-08T10:32:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24463.681244 secs 2023-05-08T10:32:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:04 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:32:05.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:32:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:32:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:32:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:32:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:32:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:32:06.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24464.969115 secs 2023-05-08T10:32:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:06 smithi133 ceph-mon[125939]: pgmap v13103: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 630 KiB/s rd, 750 KiB/s wr, 27 op/s 2023-05-08T10:32:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:06 smithi133 ceph-mon[125939]: osdmap e896: 12 total, 12 up, 12 in 2023-05-08T10:32:06.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24464.969115 secs 2023-05-08T10:32:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:06 smithi096 ceph-mon[124666]: pgmap v13103: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 630 KiB/s rd, 750 KiB/s wr, 27 op/s 2023-05-08T10:32:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:06 smithi096 ceph-mon[124666]: osdmap e896: 12 total, 12 up, 12 in 2023-05-08T10:32:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24464.969115 secs 2023-05-08T10:32:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:06 smithi186 ceph-mon[126480]: pgmap v13103: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 630 KiB/s rd, 750 KiB/s wr, 27 op/s 2023-05-08T10:32:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:06 smithi186 ceph-mon[126480]: osdmap e896: 12 total, 12 up, 12 in 2023-05-08T10:32:08.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:08 smithi133 ceph-mon[125939]: pgmap v13105: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 393 KiB/s wr, 27 op/s 2023-05-08T10:32:08.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:08 smithi096 ceph-mon[124666]: pgmap v13105: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 393 KiB/s wr, 27 op/s 2023-05-08T10:32:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:08 smithi186 ceph-mon[126480]: pgmap v13105: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 393 KiB/s wr, 27 op/s 2023-05-08T10:32:09.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24468.125825 secs 2023-05-08T10:32:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24468.681353 secs 2023-05-08T10:32:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:09 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:32:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24468.125825 secs 2023-05-08T10:32:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24468.681353 secs 2023-05-08T10:32:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:09 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:32:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24468.125825 secs 2023-05-08T10:32:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24468.681353 secs 2023-05-08T10:32:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:09 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:32:10.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:10 smithi133 ceph-mon[125939]: pgmap v13106: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 554 KiB/s rd, 457 KiB/s wr, 27 op/s 2023-05-08T10:32:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:10 smithi096 ceph-mon[124666]: pgmap v13106: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 554 KiB/s rd, 457 KiB/s wr, 27 op/s 2023-05-08T10:32:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:10 smithi186 ceph-mon[126480]: pgmap v13106: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 554 KiB/s rd, 457 KiB/s wr, 27 op/s 2023-05-08T10:32:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24469.969225 secs 2023-05-08T10:32:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24469.969225 secs 2023-05-08T10:32:11.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24469.969225 secs 2023-05-08T10:32:12.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:12 smithi133 ceph-mon[125939]: pgmap v13107: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 368 KiB/s wr, 26 op/s 2023-05-08T10:32:12.778 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:12 smithi096 ceph-mon[124666]: pgmap v13107: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 368 KiB/s wr, 26 op/s 2023-05-08T10:32:12.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:12 smithi186 ceph-mon[126480]: pgmap v13107: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 368 KiB/s wr, 26 op/s 2023-05-08T10:32:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:14 smithi133 ceph-mon[125939]: pgmap v13108: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 368 KiB/s wr, 26 op/s 2023-05-08T10:32:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24473.125966 secs 2023-05-08T10:32:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24473.681488 secs 2023-05-08T10:32:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:14 smithi133 ceph-mon[125939]: osdmap e897: 12 total, 12 up, 12 in 2023-05-08T10:32:14.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:14 smithi096 ceph-mon[124666]: pgmap v13108: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 368 KiB/s wr, 26 op/s 2023-05-08T10:32:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24473.125966 secs 2023-05-08T10:32:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24473.681488 secs 2023-05-08T10:32:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:14 smithi096 ceph-mon[124666]: osdmap e897: 12 total, 12 up, 12 in 2023-05-08T10:32:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:14 smithi186 ceph-mon[126480]: pgmap v13108: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 368 KiB/s wr, 26 op/s 2023-05-08T10:32:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24473.125966 secs 2023-05-08T10:32:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24473.681488 secs 2023-05-08T10:32:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:14 smithi186 ceph-mon[126480]: osdmap e897: 12 total, 12 up, 12 in 2023-05-08T10:32:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24474.969342 secs 2023-05-08T10:32:16.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:16 smithi133 ceph-mon[125939]: pgmap v13110: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 99 KiB/s wr, 8 op/s 2023-05-08T10:32:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24474.969342 secs 2023-05-08T10:32:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:16 smithi096 ceph-mon[124666]: pgmap v13110: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 99 KiB/s wr, 8 op/s 2023-05-08T10:32:16.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24474.969342 secs 2023-05-08T10:32:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:16 smithi186 ceph-mon[126480]: pgmap v13110: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 99 KiB/s wr, 8 op/s 2023-05-08T10:32:18.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:18 smithi133 ceph-mon[125939]: pgmap v13111: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 98 KiB/s wr, 7 op/s 2023-05-08T10:32:18.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:18 smithi096 ceph-mon[124666]: pgmap v13111: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 98 KiB/s wr, 7 op/s 2023-05-08T10:32:18.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:18 smithi186 ceph-mon[126480]: pgmap v13111: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 98 KiB/s wr, 7 op/s 2023-05-08T10:32:19.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24478.126091 secs 2023-05-08T10:32:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24478.681634 secs 2023-05-08T10:32:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24478.126091 secs 2023-05-08T10:32:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24478.681634 secs 2023-05-08T10:32:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24478.126091 secs 2023-05-08T10:32:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24478.681634 secs 2023-05-08T10:32:20.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:20 smithi133 ceph-mon[125939]: pgmap v13112: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T10:32:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:20 smithi096 ceph-mon[124666]: pgmap v13112: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T10:32:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:20 smithi186 ceph-mon[126480]: pgmap v13112: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T10:32:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24479.969453 secs 2023-05-08T10:32:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24479.969453 secs 2023-05-08T10:32:21.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24479.969453 secs 2023-05-08T10:32:22.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:22 smithi133 ceph-mon[125939]: pgmap v13113: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T10:32:22.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:22 smithi096 ceph-mon[124666]: pgmap v13113: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T10:32:22.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:22 smithi186 ceph-mon[126480]: pgmap v13113: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T10:32:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:24 smithi133 ceph-mon[125939]: pgmap v13114: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T10:32:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24483.126227 secs 2023-05-08T10:32:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24483.681758 secs 2023-05-08T10:32:24.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:24 smithi096 ceph-mon[124666]: pgmap v13114: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T10:32:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24483.126227 secs 2023-05-08T10:32:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24483.681758 secs 2023-05-08T10:32:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:24 smithi186 ceph-mon[126480]: pgmap v13114: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T10:32:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24483.126227 secs 2023-05-08T10:32:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24483.681758 secs 2023-05-08T10:32:25.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:25 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:32:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:25 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:32:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:25 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:32:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:25 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:32:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:25 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:32:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:25 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:32:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:25 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:32:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:25 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:32:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:25 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:32:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24484.969543 secs 2023-05-08T10:32:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:26 smithi133 ceph-mon[125939]: pgmap v13115: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 73 KiB/s wr, 6 op/s 2023-05-08T10:32:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:26 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:32:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:32:26.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:26 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T10:32:26.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:26 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T10:32:26.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:26 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:32:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24484.969543 secs 2023-05-08T10:32:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:26 smithi096 ceph-mon[124666]: pgmap v13115: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 73 KiB/s wr, 6 op/s 2023-05-08T10:32:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:26 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:32:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:32:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:26 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T10:32:26.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:26 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T10:32:26.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:26 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:32:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24484.969543 secs 2023-05-08T10:32:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:26 smithi186 ceph-mon[126480]: pgmap v13115: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 73 KiB/s wr, 6 op/s 2023-05-08T10:32:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:26 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:32:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:32:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:26 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T10:32:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:26 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T10:32:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:26 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:32:28.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:28 smithi133 ceph-mon[125939]: pgmap v13116: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 67 KiB/s wr, 5 op/s 2023-05-08T10:32:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:28 smithi096 ceph-mon[124666]: pgmap v13116: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 67 KiB/s wr, 5 op/s 2023-05-08T10:32:28.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:28 smithi186 ceph-mon[126480]: pgmap v13116: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 67 KiB/s wr, 5 op/s 2023-05-08T10:32:29.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24488.126310 secs 2023-05-08T10:32:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24488.681909 secs 2023-05-08T10:32:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24488.126310 secs 2023-05-08T10:32:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24488.681909 secs 2023-05-08T10:32:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24488.126310 secs 2023-05-08T10:32:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24488.681909 secs 2023-05-08T10:32:30.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:30 smithi133 ceph-mon[125939]: pgmap v13117: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 262 KiB/s wr, 9 op/s 2023-05-08T10:32:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:30 smithi096 ceph-mon[124666]: pgmap v13117: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 262 KiB/s wr, 9 op/s 2023-05-08T10:32:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:30 smithi186 ceph-mon[126480]: pgmap v13117: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 262 KiB/s wr, 9 op/s 2023-05-08T10:32:31.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24489.969640 secs 2023-05-08T10:32:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24489.969640 secs 2023-05-08T10:32:31.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24489.969640 secs 2023-05-08T10:32:32.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:32 smithi096 ceph-mon[124666]: pgmap v13118: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 262 KiB/s wr, 6 op/s 2023-05-08T10:32:32.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:32 smithi186 ceph-mon[126480]: pgmap v13118: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 262 KiB/s wr, 6 op/s 2023-05-08T10:32:32.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:32 smithi133 ceph-mon[125939]: pgmap v13118: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 262 KiB/s wr, 6 op/s 2023-05-08T10:32:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:34 smithi096 ceph-mon[124666]: pgmap v13119: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 262 KiB/s wr, 6 op/s 2023-05-08T10:32:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24493.126432 secs 2023-05-08T10:32:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24493.682045 secs 2023-05-08T10:32:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:34 smithi186 ceph-mon[126480]: pgmap v13119: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 262 KiB/s wr, 6 op/s 2023-05-08T10:32:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24493.126432 secs 2023-05-08T10:32:34.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24493.682045 secs 2023-05-08T10:32:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:34 smithi133 ceph-mon[125939]: pgmap v13119: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 262 KiB/s wr, 6 op/s 2023-05-08T10:32:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24493.126432 secs 2023-05-08T10:32:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24493.682045 secs 2023-05-08T10:32:36.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24494.969762 secs 2023-05-08T10:32:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:36 smithi096 ceph-mon[124666]: pgmap v13120: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 398 KiB/s rd, 263 KiB/s wr, 10 op/s 2023-05-08T10:32:36.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24494.969762 secs 2023-05-08T10:32:36.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:36 smithi186 ceph-mon[126480]: pgmap v13120: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 398 KiB/s rd, 263 KiB/s wr, 10 op/s 2023-05-08T10:32:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24494.969762 secs 2023-05-08T10:32:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:36 smithi133 ceph-mon[125939]: pgmap v13120: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 398 KiB/s rd, 263 KiB/s wr, 10 op/s 2023-05-08T10:32:38.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:38 smithi096 ceph-mon[124666]: pgmap v13121: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 196 KiB/s wr, 7 op/s 2023-05-08T10:32:38.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:38 smithi186 ceph-mon[126480]: pgmap v13121: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 196 KiB/s wr, 7 op/s 2023-05-08T10:32:38.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:38 smithi133 ceph-mon[125939]: pgmap v13121: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 196 KiB/s wr, 7 op/s 2023-05-08T10:32:39.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24498.126508 secs 2023-05-08T10:32:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24498.682147 secs 2023-05-08T10:32:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24498.126508 secs 2023-05-08T10:32:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24498.682147 secs 2023-05-08T10:32:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24498.126508 secs 2023-05-08T10:32:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24498.682147 secs 2023-05-08T10:32:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:40 smithi186 ceph-mon[126480]: pgmap v13122: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 284 KiB/s wr, 9 op/s 2023-05-08T10:32:40.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:40 smithi133 ceph-mon[125939]: pgmap v13122: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 284 KiB/s wr, 9 op/s 2023-05-08T10:32:41.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:40 smithi096 ceph-mon[124666]: pgmap v13122: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 284 KiB/s wr, 9 op/s 2023-05-08T10:32:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:42 smithi186 ceph-mon[126480]: pgmap v13123: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 88 KiB/s wr, 6 op/s 2023-05-08T10:32:42.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:42 smithi133 ceph-mon[125939]: pgmap v13123: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 88 KiB/s wr, 6 op/s 2023-05-08T10:32:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:42 smithi096 ceph-mon[124666]: pgmap v13123: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 88 KiB/s wr, 6 op/s 2023-05-08T10:32:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:44 smithi186 ceph-mon[126480]: pgmap v13124: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 88 KiB/s wr, 6 op/s 2023-05-08T10:32:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24503.126621 secs 2023-05-08T10:32:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:44 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:32:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24503.682268 secs 2023-05-08T10:32:44.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:44 smithi133 ceph-mon[125939]: pgmap v13124: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 88 KiB/s wr, 6 op/s 2023-05-08T10:32:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24503.126621 secs 2023-05-08T10:32:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:44 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:32:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24503.682268 secs 2023-05-08T10:32:45.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:44 smithi096 ceph-mon[124666]: pgmap v13124: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 88 KiB/s wr, 6 op/s 2023-05-08T10:32:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24503.126621 secs 2023-05-08T10:32:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:44 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:32:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24503.682268 secs 2023-05-08T10:32:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:45 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:32:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:45 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:32:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:45 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:32:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:45 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:32:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:45 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:32:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:45 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:32:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:45 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:32:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:45 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:32:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:45 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:32:46.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:46 smithi186 ceph-mon[126480]: pgmap v13125: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 176 KiB/s wr, 10 op/s 2023-05-08T10:32:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:46 smithi133 ceph-mon[125939]: pgmap v13125: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 176 KiB/s wr, 10 op/s 2023-05-08T10:32:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:46 smithi096 ceph-mon[124666]: pgmap v13125: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 176 KiB/s wr, 10 op/s 2023-05-08T10:32:48.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:48 smithi186 ceph-mon[126480]: pgmap v13126: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 176 KiB/s wr, 6 op/s 2023-05-08T10:32:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:48 smithi133 ceph-mon[125939]: pgmap v13126: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 176 KiB/s wr, 6 op/s 2023-05-08T10:32:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:48 smithi096 ceph-mon[124666]: pgmap v13126: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 176 KiB/s wr, 6 op/s 2023-05-08T10:32:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24508.126728 secs 2023-05-08T10:32:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24508.126728 secs 2023-05-08T10:32:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24508.126728 secs 2023-05-08T10:32:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:50 smithi186 ceph-mon[126480]: pgmap v13127: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 372 KiB/s wr, 11 op/s 2023-05-08T10:32:50.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:50 smithi133 ceph-mon[125939]: pgmap v13127: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 372 KiB/s wr, 11 op/s 2023-05-08T10:32:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:50 smithi096 ceph-mon[124666]: pgmap v13127: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 372 KiB/s wr, 11 op/s 2023-05-08T10:32:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:52 smithi186 ceph-mon[126480]: pgmap v13128: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 285 KiB/s wr, 8 op/s 2023-05-08T10:32:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:32:52.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:52 smithi133 ceph-mon[125939]: pgmap v13128: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 285 KiB/s wr, 8 op/s 2023-05-08T10:32:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:32:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:52 smithi096 ceph-mon[124666]: pgmap v13128: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 285 KiB/s wr, 8 op/s 2023-05-08T10:32:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:32:53.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:53 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:32:53.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:32:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:32:53.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:53 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:32:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:32:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:32:54.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:53 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:32:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:32:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:32:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:54 smithi186 ceph-mon[126480]: pgmap v13129: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 285 KiB/s wr, 8 op/s 2023-05-08T10:32:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24513.126840 secs 2023-05-08T10:32:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24513.682541 secs 2023-05-08T10:32:54.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:54 smithi133 ceph-mon[125939]: pgmap v13129: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 285 KiB/s wr, 8 op/s 2023-05-08T10:32:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24513.126840 secs 2023-05-08T10:32:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24513.682541 secs 2023-05-08T10:32:55.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:54 smithi096 ceph-mon[124666]: pgmap v13129: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 285 KiB/s wr, 8 op/s 2023-05-08T10:32:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24513.126840 secs 2023-05-08T10:32:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24513.682541 secs 2023-05-08T10:32:56.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:56 smithi186 ceph-mon[126480]: pgmap v13130: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 710 KiB/s rd, 609 KiB/s wr, 13 op/s 2023-05-08T10:32:56.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:56 smithi133 ceph-mon[125939]: pgmap v13130: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 710 KiB/s rd, 609 KiB/s wr, 13 op/s 2023-05-08T10:32:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:56 smithi096 ceph-mon[124666]: pgmap v13130: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 710 KiB/s rd, 609 KiB/s wr, 13 op/s 2023-05-08T10:32:57.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:32:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:32:57.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:32:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:32:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:32:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:32:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:58 smithi186 ceph-mon[126480]: pgmap v13131: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 533 KiB/s rd, 521 KiB/s wr, 9 op/s 2023-05-08T10:32:58.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:58 smithi133 ceph-mon[125939]: pgmap v13131: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 533 KiB/s rd, 521 KiB/s wr, 9 op/s 2023-05-08T10:32:59.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:58 smithi096 ceph-mon[124666]: pgmap v13131: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 533 KiB/s rd, 521 KiB/s wr, 9 op/s 2023-05-08T10:32:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24518.126956 secs 2023-05-08T10:32:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:32:59 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:32:59.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24518.126956 secs 2023-05-08T10:32:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:32:59 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:33:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24518.126956 secs 2023-05-08T10:33:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:32:59 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:33:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:00 smithi186 ceph-mon[126480]: pgmap v13132: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 703 KiB/s rd, 690 KiB/s wr, 15 op/s 2023-05-08T10:33:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:00 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:33:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:00 smithi133 ceph-mon[125939]: pgmap v13132: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 703 KiB/s rd, 690 KiB/s wr, 15 op/s 2023-05-08T10:33:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:00 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:33:01.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:00 smithi096 ceph-mon[124666]: pgmap v13132: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 703 KiB/s rd, 690 KiB/s wr, 15 op/s 2023-05-08T10:33:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:00 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:33:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:33:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:33:01.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:01 smithi186 ceph-mon[126480]: pgmap v13133: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 494 KiB/s wr, 10 op/s 2023-05-08T10:33:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:33:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:33:01.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:01 smithi133 ceph-mon[125939]: pgmap v13133: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 494 KiB/s wr, 10 op/s 2023-05-08T10:33:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:33:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:33:02.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:01 smithi096 ceph-mon[124666]: pgmap v13133: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 494 KiB/s wr, 10 op/s 2023-05-08T10:33:04.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:04 smithi133 ceph-mon[125939]: pgmap v13134: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 494 KiB/s wr, 10 op/s 2023-05-08T10:33:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24523.127072 secs 2023-05-08T10:33:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24523.682793 secs 2023-05-08T10:33:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:04 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:33:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:04 smithi096 ceph-mon[124666]: pgmap v13134: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 494 KiB/s wr, 10 op/s 2023-05-08T10:33:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24523.127072 secs 2023-05-08T10:33:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24523.682793 secs 2023-05-08T10:33:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:04 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:33:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:04 smithi186 ceph-mon[126480]: pgmap v13134: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 494 KiB/s wr, 10 op/s 2023-05-08T10:33:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24523.127072 secs 2023-05-08T10:33:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24523.682793 secs 2023-05-08T10:33:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:04 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:33:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24524.970496 secs 2023-05-08T10:33:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:06 smithi133 ceph-mon[125939]: pgmap v13135: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 820 KiB/s rd, 843 KiB/s wr, 30 op/s 2023-05-08T10:33:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:06 smithi133 ceph-mon[125939]: osdmap e898: 12 total, 12 up, 12 in 2023-05-08T10:33:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24524.970496 secs 2023-05-08T10:33:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:06 smithi096 ceph-mon[124666]: pgmap v13135: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 820 KiB/s rd, 843 KiB/s wr, 30 op/s 2023-05-08T10:33:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:06 smithi096 ceph-mon[124666]: osdmap e898: 12 total, 12 up, 12 in 2023-05-08T10:33:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24524.970496 secs 2023-05-08T10:33:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:06 smithi186 ceph-mon[126480]: pgmap v13135: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 820 KiB/s rd, 843 KiB/s wr, 30 op/s 2023-05-08T10:33:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:06 smithi186 ceph-mon[126480]: osdmap e898: 12 total, 12 up, 12 in 2023-05-08T10:33:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:08 smithi133 ceph-mon[125939]: pgmap v13137: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 580 KiB/s rd, 622 KiB/s wr, 30 op/s 2023-05-08T10:33:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:08 smithi096 ceph-mon[124666]: pgmap v13137: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 580 KiB/s rd, 622 KiB/s wr, 30 op/s 2023-05-08T10:33:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:08 smithi186 ceph-mon[126480]: pgmap v13137: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 580 KiB/s rd, 622 KiB/s wr, 30 op/s 2023-05-08T10:33:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24528.127189 secs 2023-05-08T10:33:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:33:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:33:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:33:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24528.682926 secs 2023-05-08T10:33:09.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:09 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:33:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24528.127189 secs 2023-05-08T10:33:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:33:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:33:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:33:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24528.682926 secs 2023-05-08T10:33:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:09 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:33:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24528.127189 secs 2023-05-08T10:33:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:33:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:33:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:33:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24528.682926 secs 2023-05-08T10:33:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:09 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:33:10.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:10 smithi133 ceph-mon[125939]: pgmap v13138: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 533 KiB/s wr, 28 op/s 2023-05-08T10:33:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:10 smithi096 ceph-mon[124666]: pgmap v13138: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 533 KiB/s wr, 28 op/s 2023-05-08T10:33:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:10 smithi186 ceph-mon[126480]: pgmap v13138: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 533 KiB/s wr, 28 op/s 2023-05-08T10:33:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24529.970619 secs 2023-05-08T10:33:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24529.970619 secs 2023-05-08T10:33:11.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24529.970619 secs 2023-05-08T10:33:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:12 smithi133 ceph-mon[125939]: pgmap v13139: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 533 KiB/s wr, 28 op/s 2023-05-08T10:33:12.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:12 smithi096 ceph-mon[124666]: pgmap v13139: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 533 KiB/s wr, 28 op/s 2023-05-08T10:33:12.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:12 smithi186 ceph-mon[126480]: pgmap v13139: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 533 KiB/s wr, 28 op/s 2023-05-08T10:33:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:14 smithi133 ceph-mon[125939]: pgmap v13140: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 533 KiB/s wr, 28 op/s 2023-05-08T10:33:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24533.127302 secs 2023-05-08T10:33:14.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24533.682984 secs 2023-05-08T10:33:14.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:14 smithi133 ceph-mon[125939]: osdmap e899: 12 total, 12 up, 12 in 2023-05-08T10:33:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:14 smithi096 ceph-mon[124666]: pgmap v13140: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 533 KiB/s wr, 28 op/s 2023-05-08T10:33:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24533.127302 secs 2023-05-08T10:33:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24533.682984 secs 2023-05-08T10:33:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:14 smithi096 ceph-mon[124666]: osdmap e899: 12 total, 12 up, 12 in 2023-05-08T10:33:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:14 smithi186 ceph-mon[126480]: pgmap v13140: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 533 KiB/s wr, 28 op/s 2023-05-08T10:33:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24533.127302 secs 2023-05-08T10:33:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24533.682984 secs 2023-05-08T10:33:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:14 smithi186 ceph-mon[126480]: osdmap e899: 12 total, 12 up, 12 in 2023-05-08T10:33:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24534.970737 secs 2023-05-08T10:33:16.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:16 smithi133 ceph-mon[125939]: pgmap v13142: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 310 KiB/s wr, 8 op/s 2023-05-08T10:33:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24534.970737 secs 2023-05-08T10:33:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:16 smithi096 ceph-mon[124666]: pgmap v13142: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 310 KiB/s wr, 8 op/s 2023-05-08T10:33:16.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24534.970737 secs 2023-05-08T10:33:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:16 smithi186 ceph-mon[126480]: pgmap v13142: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 310 KiB/s wr, 8 op/s 2023-05-08T10:33:18.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:18 smithi133 ceph-mon[125939]: pgmap v13143: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 311 KiB/s rd, 308 KiB/s wr, 8 op/s 2023-05-08T10:33:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:18 smithi096 ceph-mon[124666]: pgmap v13143: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 311 KiB/s rd, 308 KiB/s wr, 8 op/s 2023-05-08T10:33:18.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:18 smithi186 ceph-mon[126480]: pgmap v13143: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 311 KiB/s rd, 308 KiB/s wr, 8 op/s 2023-05-08T10:33:19.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24538.127417 secs 2023-05-08T10:33:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24538.683125 secs 2023-05-08T10:33:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24538.127417 secs 2023-05-08T10:33:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24538.683125 secs 2023-05-08T10:33:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24538.127417 secs 2023-05-08T10:33:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24538.683125 secs 2023-05-08T10:33:20.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:20 smithi133 ceph-mon[125939]: pgmap v13144: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 193 KiB/s wr, 6 op/s 2023-05-08T10:33:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:20 smithi096 ceph-mon[124666]: pgmap v13144: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 193 KiB/s wr, 6 op/s 2023-05-08T10:33:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:20 smithi186 ceph-mon[126480]: pgmap v13144: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 193 KiB/s wr, 6 op/s 2023-05-08T10:33:21.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24539.970859 secs 2023-05-08T10:33:21.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24539.970859 secs 2023-05-08T10:33:21.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24539.970859 secs 2023-05-08T10:33:22.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:22 smithi133 ceph-mon[125939]: pgmap v13145: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 193 KiB/s wr, 6 op/s 2023-05-08T10:33:22.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:22 smithi096 ceph-mon[124666]: pgmap v13145: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 193 KiB/s wr, 6 op/s 2023-05-08T10:33:22.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:22 smithi186 ceph-mon[126480]: pgmap v13145: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 193 KiB/s wr, 6 op/s 2023-05-08T10:33:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:24 smithi133 ceph-mon[125939]: pgmap v13146: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 193 KiB/s wr, 6 op/s 2023-05-08T10:33:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24543.127537 secs 2023-05-08T10:33:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24543.683243 secs 2023-05-08T10:33:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:24 smithi096 ceph-mon[124666]: pgmap v13146: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 193 KiB/s wr, 6 op/s 2023-05-08T10:33:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24543.127537 secs 2023-05-08T10:33:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24543.683243 secs 2023-05-08T10:33:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:24 smithi186 ceph-mon[126480]: pgmap v13146: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 193 KiB/s wr, 6 op/s 2023-05-08T10:33:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24543.127537 secs 2023-05-08T10:33:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24543.683243 secs 2023-05-08T10:33:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24544.970982 secs 2023-05-08T10:33:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:26 smithi133 ceph-mon[125939]: pgmap v13147: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-05-08T10:33:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:33:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:33:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:33:26.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:33:26.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24544.970982 secs 2023-05-08T10:33:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:26 smithi096 ceph-mon[124666]: pgmap v13147: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-05-08T10:33:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:33:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:33:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:33:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:33:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24544.970982 secs 2023-05-08T10:33:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:26 smithi186 ceph-mon[126480]: pgmap v13147: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-05-08T10:33:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:33:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:33:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:33:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:33:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:27 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:33:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:27 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T10:33:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:27 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T10:33:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:27 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:33:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:27 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:33:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:27 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T10:33:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:27 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T10:33:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:27 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:33:27.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:27 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:33:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:27 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T10:33:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:27 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T10:33:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:27 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:33:28.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:28 smithi133 ceph-mon[125939]: pgmap v13148: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:33:28.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:28 smithi096 ceph-mon[124666]: pgmap v13148: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:33:28.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:28 smithi186 ceph-mon[126480]: pgmap v13148: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:33:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24548.127618 secs 2023-05-08T10:33:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24548.683365 secs 2023-05-08T10:33:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24548.127618 secs 2023-05-08T10:33:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24548.683365 secs 2023-05-08T10:33:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24548.127618 secs 2023-05-08T10:33:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24548.683365 secs 2023-05-08T10:33:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:30 smithi133 ceph-mon[125939]: pgmap v13149: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T10:33:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:30 smithi096 ceph-mon[124666]: pgmap v13149: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T10:33:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:30 smithi186 ceph-mon[126480]: pgmap v13149: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T10:33:31.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24549.971101 secs 2023-05-08T10:33:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24549.971101 secs 2023-05-08T10:33:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24549.971101 secs 2023-05-08T10:33:32.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:32 smithi096 ceph-mon[124666]: pgmap v13150: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:33:32.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:32 smithi186 ceph-mon[126480]: pgmap v13150: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:33:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:32 smithi133 ceph-mon[125939]: pgmap v13150: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:33:34.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:34 smithi096 ceph-mon[124666]: pgmap v13151: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:33:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24553.127744 secs 2023-05-08T10:33:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24553.683500 secs 2023-05-08T10:33:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:34 smithi186 ceph-mon[126480]: pgmap v13151: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:33:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24553.127744 secs 2023-05-08T10:33:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24553.683500 secs 2023-05-08T10:33:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:34 smithi133 ceph-mon[125939]: pgmap v13151: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:33:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24553.127744 secs 2023-05-08T10:33:34.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24553.683500 secs 2023-05-08T10:33:36.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24554.971226 secs 2023-05-08T10:33:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:36 smithi186 ceph-mon[126480]: pgmap v13152: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 8 op/s 2023-05-08T10:33:36.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24554.971226 secs 2023-05-08T10:33:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:36 smithi133 ceph-mon[125939]: pgmap v13152: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 8 op/s 2023-05-08T10:33:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24554.971226 secs 2023-05-08T10:33:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:36 smithi096 ceph-mon[124666]: pgmap v13152: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 8 op/s 2023-05-08T10:33:38.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:38 smithi186 ceph-mon[126480]: pgmap v13153: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T10:33:38.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:38 smithi133 ceph-mon[125939]: pgmap v13153: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T10:33:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:38 smithi096 ceph-mon[124666]: pgmap v13153: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T10:33:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24558.127863 secs 2023-05-08T10:33:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24558.683603 secs 2023-05-08T10:33:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24558.127863 secs 2023-05-08T10:33:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24558.683603 secs 2023-05-08T10:33:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24558.127863 secs 2023-05-08T10:33:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24558.683603 secs 2023-05-08T10:33:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:40 smithi186 ceph-mon[126480]: pgmap v13154: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 938 B/s wr, 8 op/s 2023-05-08T10:33:40.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:40 smithi133 ceph-mon[125939]: pgmap v13154: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 938 B/s wr, 8 op/s 2023-05-08T10:33:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:40 smithi096 ceph-mon[124666]: pgmap v13154: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 938 B/s wr, 8 op/s 2023-05-08T10:33:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:42 smithi186 ceph-mon[126480]: pgmap v13155: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T10:33:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:42 smithi133 ceph-mon[125939]: pgmap v13155: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T10:33:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:42 smithi096 ceph-mon[124666]: pgmap v13155: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T10:33:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:44 smithi186 ceph-mon[126480]: pgmap v13156: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T10:33:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24563.127977 secs 2023-05-08T10:33:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:44 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:33:44.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:44 smithi133 ceph-mon[125939]: pgmap v13156: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T10:33:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24563.127977 secs 2023-05-08T10:33:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:44 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:33:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:44 smithi096 ceph-mon[124666]: pgmap v13156: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T10:33:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24563.127977 secs 2023-05-08T10:33:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:44 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:33:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:45 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:33:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:45 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:33:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:45 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:33:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:45 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:33:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:45 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:33:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:45 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:33:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:45 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:33:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:45 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:33:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:45 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:33:46.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:46 smithi186 ceph-mon[126480]: pgmap v13157: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 199 KiB/s wr, 10 op/s 2023-05-08T10:33:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:46 smithi133 ceph-mon[125939]: pgmap v13157: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 199 KiB/s wr, 10 op/s 2023-05-08T10:33:47.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:46 smithi096 ceph-mon[124666]: pgmap v13157: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 199 KiB/s wr, 10 op/s 2023-05-08T10:33:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:48 smithi186 ceph-mon[126480]: pgmap v13158: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 198 KiB/s wr, 7 op/s 2023-05-08T10:33:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:33:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:48 smithi133 ceph-mon[125939]: pgmap v13158: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 198 KiB/s wr, 7 op/s 2023-05-08T10:33:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:33:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:48 smithi096 ceph-mon[124666]: pgmap v13158: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 198 KiB/s wr, 7 op/s 2023-05-08T10:33:49.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:33:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24568.128115 secs 2023-05-08T10:33:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:33:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:33:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24568.683813 secs 2023-05-08T10:33:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24568.128115 secs 2023-05-08T10:33:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:33:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:33:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24568.683813 secs 2023-05-08T10:33:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24568.128115 secs 2023-05-08T10:33:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:33:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:33:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24568.683813 secs 2023-05-08T10:33:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:50 smithi186 ceph-mon[126480]: pgmap v13159: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 425 KiB/s wr, 13 op/s 2023-05-08T10:33:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:50 smithi133 ceph-mon[125939]: pgmap v13159: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 425 KiB/s wr, 13 op/s 2023-05-08T10:33:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:50 smithi096 ceph-mon[124666]: pgmap v13159: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 425 KiB/s wr, 13 op/s 2023-05-08T10:33:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:52 smithi186 ceph-mon[126480]: pgmap v13160: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 424 KiB/s wr, 10 op/s 2023-05-08T10:33:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:52 smithi133 ceph-mon[125939]: pgmap v13160: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 424 KiB/s wr, 10 op/s 2023-05-08T10:33:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:52 smithi096 ceph-mon[124666]: pgmap v13160: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 424 KiB/s wr, 10 op/s 2023-05-08T10:33:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:53 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:33:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:33:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:33:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:53 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:33:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:33:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:33:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:53 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:33:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:33:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:33:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:54 smithi186 ceph-mon[126480]: pgmap v13161: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 424 KiB/s wr, 10 op/s 2023-05-08T10:33:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24573.128232 secs 2023-05-08T10:33:54.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:54 smithi133 ceph-mon[125939]: pgmap v13161: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 424 KiB/s wr, 10 op/s 2023-05-08T10:33:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24573.128232 secs 2023-05-08T10:33:55.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:54 smithi096 ceph-mon[124666]: pgmap v13161: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 424 KiB/s wr, 10 op/s 2023-05-08T10:33:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24573.128232 secs 2023-05-08T10:33:56.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:56 smithi186 ceph-mon[126480]: pgmap v13162: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 640 KiB/s rd, 749 KiB/s wr, 14 op/s 2023-05-08T10:33:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:33:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:56 smithi133 ceph-mon[125939]: pgmap v13162: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 640 KiB/s rd, 749 KiB/s wr, 14 op/s 2023-05-08T10:33:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:33:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:56 smithi096 ceph-mon[124666]: pgmap v13162: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 640 KiB/s rd, 749 KiB/s wr, 14 op/s 2023-05-08T10:33:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:33:57.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:33:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:33:57.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:33:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:33:58.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:33:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:33:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:58 smithi186 ceph-mon[126480]: pgmap v13163: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 551 KiB/s wr, 10 op/s 2023-05-08T10:33:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:58 smithi133 ceph-mon[125939]: pgmap v13163: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 551 KiB/s wr, 10 op/s 2023-05-08T10:33:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:58 smithi096 ceph-mon[124666]: pgmap v13163: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 551 KiB/s wr, 10 op/s 2023-05-08T10:33:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24578.128350 secs 2023-05-08T10:33:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24578.684059 secs 2023-05-08T10:33:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:33:59 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:33:59.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24578.128350 secs 2023-05-08T10:33:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24578.684059 secs 2023-05-08T10:33:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:33:59 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:34:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24578.128350 secs 2023-05-08T10:34:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24578.684059 secs 2023-05-08T10:34:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:33:59 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:34:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:00 smithi186 ceph-mon[126480]: pgmap v13164: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 769 KiB/s rd, 756 KiB/s wr, 16 op/s 2023-05-08T10:34:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24579.971743 secs 2023-05-08T10:34:00.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:00 smithi133 ceph-mon[125939]: pgmap v13164: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 769 KiB/s rd, 756 KiB/s wr, 16 op/s 2023-05-08T10:34:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24579.971743 secs 2023-05-08T10:34:01.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:00 smithi096 ceph-mon[124666]: pgmap v13164: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 769 KiB/s rd, 756 KiB/s wr, 16 op/s 2023-05-08T10:34:01.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24579.971743 secs 2023-05-08T10:34:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:34:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:34:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:01 smithi186 ceph-mon[126480]: pgmap v13165: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 530 KiB/s wr, 10 op/s 2023-05-08T10:34:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:34:01.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:34:01.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:01 smithi133 ceph-mon[125939]: pgmap v13165: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 530 KiB/s wr, 10 op/s 2023-05-08T10:34:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:34:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:34:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:01 smithi096 ceph-mon[124666]: pgmap v13165: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 530 KiB/s wr, 10 op/s 2023-05-08T10:34:04.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:04 smithi133 ceph-mon[125939]: pgmap v13166: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 530 KiB/s wr, 10 op/s 2023-05-08T10:34:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24583.128469 secs 2023-05-08T10:34:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24583.684212 secs 2023-05-08T10:34:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:04 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:34:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:04 smithi096 ceph-mon[124666]: pgmap v13166: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 530 KiB/s wr, 10 op/s 2023-05-08T10:34:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24583.128469 secs 2023-05-08T10:34:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24583.684212 secs 2023-05-08T10:34:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:04 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:34:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:04 smithi186 ceph-mon[126480]: pgmap v13166: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 530 KiB/s wr, 10 op/s 2023-05-08T10:34:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24583.128469 secs 2023-05-08T10:34:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24583.684212 secs 2023-05-08T10:34:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:04 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:34:05.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:34:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:34:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:34:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:34:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:34:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:34:06.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24584.971863 secs 2023-05-08T10:34:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:06 smithi133 ceph-mon[125939]: pgmap v13167: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 723 KiB/s rd, 756 KiB/s wr, 28 op/s 2023-05-08T10:34:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:06 smithi133 ceph-mon[125939]: osdmap e900: 12 total, 12 up, 12 in 2023-05-08T10:34:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24584.971863 secs 2023-05-08T10:34:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:06 smithi096 ceph-mon[124666]: pgmap v13167: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 723 KiB/s rd, 756 KiB/s wr, 28 op/s 2023-05-08T10:34:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:06 smithi096 ceph-mon[124666]: osdmap e900: 12 total, 12 up, 12 in 2023-05-08T10:34:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24584.971863 secs 2023-05-08T10:34:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:06 smithi186 ceph-mon[126480]: pgmap v13167: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 723 KiB/s rd, 756 KiB/s wr, 28 op/s 2023-05-08T10:34:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:06 smithi186 ceph-mon[126480]: osdmap e900: 12 total, 12 up, 12 in 2023-05-08T10:34:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:08 smithi133 ceph-mon[125939]: pgmap v13169: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 623 KiB/s rd, 518 KiB/s wr, 28 op/s 2023-05-08T10:34:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:08 smithi096 ceph-mon[124666]: pgmap v13169: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 623 KiB/s rd, 518 KiB/s wr, 28 op/s 2023-05-08T10:34:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:08 smithi186 ceph-mon[126480]: pgmap v13169: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 623 KiB/s rd, 518 KiB/s wr, 28 op/s 2023-05-08T10:34:09.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24588.128563 secs 2023-05-08T10:34:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24588.684278 secs 2023-05-08T10:34:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:09 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:34:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24588.128563 secs 2023-05-08T10:34:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24588.684278 secs 2023-05-08T10:34:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:09 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:34:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24588.128563 secs 2023-05-08T10:34:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24588.684278 secs 2023-05-08T10:34:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:09 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:34:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:10 smithi133 ceph-mon[125939]: pgmap v13170: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 371 KiB/s wr, 25 op/s 2023-05-08T10:34:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:10 smithi096 ceph-mon[124666]: pgmap v13170: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 371 KiB/s wr, 25 op/s 2023-05-08T10:34:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:10 smithi186 ceph-mon[126480]: pgmap v13170: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 371 KiB/s wr, 25 op/s 2023-05-08T10:34:11.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24589.971965 secs 2023-05-08T10:34:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24589.971965 secs 2023-05-08T10:34:11.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24589.971965 secs 2023-05-08T10:34:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:12 smithi133 ceph-mon[125939]: pgmap v13171: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 370 KiB/s wr, 25 op/s 2023-05-08T10:34:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:12 smithi096 ceph-mon[124666]: pgmap v13171: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 370 KiB/s wr, 25 op/s 2023-05-08T10:34:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:12 smithi186 ceph-mon[126480]: pgmap v13171: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 370 KiB/s wr, 25 op/s 2023-05-08T10:34:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:14 smithi133 ceph-mon[125939]: pgmap v13172: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 370 KiB/s wr, 25 op/s 2023-05-08T10:34:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24593.128684 secs 2023-05-08T10:34:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24593.684410 secs 2023-05-08T10:34:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:14 smithi133 ceph-mon[125939]: osdmap e901: 12 total, 12 up, 12 in 2023-05-08T10:34:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:14 smithi096 ceph-mon[124666]: pgmap v13172: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 370 KiB/s wr, 25 op/s 2023-05-08T10:34:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24593.128684 secs 2023-05-08T10:34:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24593.684410 secs 2023-05-08T10:34:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:14 smithi096 ceph-mon[124666]: osdmap e901: 12 total, 12 up, 12 in 2023-05-08T10:34:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:14 smithi186 ceph-mon[126480]: pgmap v13172: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 370 KiB/s wr, 25 op/s 2023-05-08T10:34:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24593.128684 secs 2023-05-08T10:34:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24593.684410 secs 2023-05-08T10:34:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:14 smithi186 ceph-mon[126480]: osdmap e901: 12 total, 12 up, 12 in 2023-05-08T10:34:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24594.972074 secs 2023-05-08T10:34:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:16 smithi133 ceph-mon[125939]: pgmap v13174: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 99 KiB/s wr, 7 op/s 2023-05-08T10:34:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24594.972074 secs 2023-05-08T10:34:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:16 smithi096 ceph-mon[124666]: pgmap v13174: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 99 KiB/s wr, 7 op/s 2023-05-08T10:34:16.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24594.972074 secs 2023-05-08T10:34:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:16 smithi186 ceph-mon[126480]: pgmap v13174: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 99 KiB/s wr, 7 op/s 2023-05-08T10:34:18.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:18 smithi133 ceph-mon[125939]: pgmap v13175: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 99 KiB/s wr, 7 op/s 2023-05-08T10:34:18.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:18 smithi096 ceph-mon[124666]: pgmap v13175: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 99 KiB/s wr, 7 op/s 2023-05-08T10:34:18.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:18 smithi186 ceph-mon[126480]: pgmap v13175: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 99 KiB/s wr, 7 op/s 2023-05-08T10:34:19.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24598.128837 secs 2023-05-08T10:34:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24598.684561 secs 2023-05-08T10:34:19.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24598.128837 secs 2023-05-08T10:34:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24598.684561 secs 2023-05-08T10:34:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24598.128837 secs 2023-05-08T10:34:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24598.684561 secs 2023-05-08T10:34:20.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:20 smithi133 ceph-mon[125939]: pgmap v13176: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T10:34:20.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:20 smithi096 ceph-mon[124666]: pgmap v13176: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T10:34:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:20 smithi186 ceph-mon[126480]: pgmap v13176: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T10:34:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24599.972153 secs 2023-05-08T10:34:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24599.972153 secs 2023-05-08T10:34:21.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24599.972153 secs 2023-05-08T10:34:22.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:22 smithi133 ceph-mon[125939]: pgmap v13177: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T10:34:22.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:22 smithi096 ceph-mon[124666]: pgmap v13177: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T10:34:22.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:22 smithi186 ceph-mon[126480]: pgmap v13177: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T10:34:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:24 smithi133 ceph-mon[125939]: pgmap v13178: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T10:34:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24603.128935 secs 2023-05-08T10:34:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24603.684708 secs 2023-05-08T10:34:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:24 smithi096 ceph-mon[124666]: pgmap v13178: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T10:34:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24603.128935 secs 2023-05-08T10:34:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24603.684708 secs 2023-05-08T10:34:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:24 smithi186 ceph-mon[126480]: pgmap v13178: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T10:34:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24603.128935 secs 2023-05-08T10:34:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24603.684708 secs 2023-05-08T10:34:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24604.972272 secs 2023-05-08T10:34:26.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:26 smithi133 ceph-mon[125939]: pgmap v13179: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-05-08T10:34:26.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:34:26.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24604.972272 secs 2023-05-08T10:34:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:26 smithi096 ceph-mon[124666]: pgmap v13179: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-05-08T10:34:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:34:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24604.972272 secs 2023-05-08T10:34:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:26 smithi186 ceph-mon[126480]: pgmap v13179: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-05-08T10:34:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:34:28.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:34:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:34:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:34:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:34:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:34:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:34:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:27 smithi186 ceph-mon[126480]: pgmap v13180: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:34:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:34:28.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:34:28.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:27 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:34:28.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:34:28.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:27 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T10:34:28.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:27 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T10:34:28.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:27 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:34:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:34:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:34:28.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:34:28.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:34:28.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:34:28.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:34:28.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:27 smithi133 ceph-mon[125939]: pgmap v13180: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:34:28.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:34:28.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:34:28.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:27 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:34:28.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:34:28.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:27 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T10:34:28.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:27 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T10:34:28.244 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:27 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:34:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:34:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:34:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:34:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:34:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:34:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:34:28.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:27 smithi096 ceph-mon[124666]: pgmap v13180: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:34:28.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:34:28.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:34:28.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:27 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:34:28.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:34:28.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:27 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T10:34:28.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:27 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T10:34:28.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:27 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:34:29.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24608.129055 secs 2023-05-08T10:34:29.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24608.129055 secs 2023-05-08T10:34:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24608.129055 secs 2023-05-08T10:34:30.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24608.684837 secs 2023-05-08T10:34:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:29 smithi133 ceph-mon[125939]: pgmap v13181: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 82 KiB/s wr, 9 op/s 2023-05-08T10:34:30.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24608.684837 secs 2023-05-08T10:34:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:29 smithi096 ceph-mon[124666]: pgmap v13181: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 82 KiB/s wr, 9 op/s 2023-05-08T10:34:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24608.684837 secs 2023-05-08T10:34:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:29 smithi186 ceph-mon[126480]: pgmap v13181: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 82 KiB/s wr, 9 op/s 2023-05-08T10:34:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24609.972392 secs 2023-05-08T10:34:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24609.972392 secs 2023-05-08T10:34:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24609.972392 secs 2023-05-08T10:34:32.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:32 smithi133 ceph-mon[125939]: pgmap v13182: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 82 KiB/s wr, 6 op/s 2023-05-08T10:34:32.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:32 smithi096 ceph-mon[124666]: pgmap v13182: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 82 KiB/s wr, 6 op/s 2023-05-08T10:34:32.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:32 smithi186 ceph-mon[126480]: pgmap v13182: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 82 KiB/s wr, 6 op/s 2023-05-08T10:34:34.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:34 smithi133 ceph-mon[125939]: pgmap v13183: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 82 KiB/s wr, 6 op/s 2023-05-08T10:34:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24613.129179 secs 2023-05-08T10:34:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24613.684967 secs 2023-05-08T10:34:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:34 smithi096 ceph-mon[124666]: pgmap v13183: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 82 KiB/s wr, 6 op/s 2023-05-08T10:34:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24613.129179 secs 2023-05-08T10:34:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24613.684967 secs 2023-05-08T10:34:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:34 smithi186 ceph-mon[126480]: pgmap v13183: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 82 KiB/s wr, 6 op/s 2023-05-08T10:34:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24613.129179 secs 2023-05-08T10:34:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24613.684967 secs 2023-05-08T10:34:36.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24614.972514 secs 2023-05-08T10:34:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:36 smithi133 ceph-mon[125939]: pgmap v13184: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 264 KiB/s wr, 10 op/s 2023-05-08T10:34:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24614.972514 secs 2023-05-08T10:34:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:36 smithi096 ceph-mon[124666]: pgmap v13184: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 264 KiB/s wr, 10 op/s 2023-05-08T10:34:36.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24614.972514 secs 2023-05-08T10:34:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:36 smithi186 ceph-mon[126480]: pgmap v13184: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 264 KiB/s wr, 10 op/s 2023-05-08T10:34:38.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:38 smithi133 ceph-mon[125939]: pgmap v13185: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 311 KiB/s rd, 264 KiB/s wr, 7 op/s 2023-05-08T10:34:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:38 smithi096 ceph-mon[124666]: pgmap v13185: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 311 KiB/s rd, 264 KiB/s wr, 7 op/s 2023-05-08T10:34:38.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:38 smithi186 ceph-mon[126480]: pgmap v13185: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 311 KiB/s rd, 264 KiB/s wr, 7 op/s 2023-05-08T10:34:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24618.129291 secs 2023-05-08T10:34:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24618.685087 secs 2023-05-08T10:34:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24618.129291 secs 2023-05-08T10:34:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24618.685087 secs 2023-05-08T10:34:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24618.129291 secs 2023-05-08T10:34:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24618.685087 secs 2023-05-08T10:34:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:40 smithi133 ceph-mon[125939]: pgmap v13186: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 265 KiB/s wr, 10 op/s 2023-05-08T10:34:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:40 smithi096 ceph-mon[124666]: pgmap v13186: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 265 KiB/s wr, 10 op/s 2023-05-08T10:34:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:40 smithi186 ceph-mon[126480]: pgmap v13186: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 265 KiB/s wr, 10 op/s 2023-05-08T10:34:41.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24619.972639 secs 2023-05-08T10:34:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24619.972639 secs 2023-05-08T10:34:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24619.972639 secs 2023-05-08T10:34:42.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:42 smithi133 ceph-mon[125939]: pgmap v13187: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 182 KiB/s wr, 6 op/s 2023-05-08T10:34:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:42 smithi096 ceph-mon[124666]: pgmap v13187: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 182 KiB/s wr, 6 op/s 2023-05-08T10:34:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:42 smithi186 ceph-mon[126480]: pgmap v13187: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 182 KiB/s wr, 6 op/s 2023-05-08T10:34:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:44 smithi133 ceph-mon[125939]: pgmap v13188: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 182 KiB/s wr, 6 op/s 2023-05-08T10:34:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24623.129433 secs 2023-05-08T10:34:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24623.685207 secs 2023-05-08T10:34:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:44 smithi096 ceph-mon[124666]: pgmap v13188: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 182 KiB/s wr, 6 op/s 2023-05-08T10:34:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24623.129433 secs 2023-05-08T10:34:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24623.685207 secs 2023-05-08T10:34:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:44 smithi186 ceph-mon[126480]: pgmap v13188: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 182 KiB/s wr, 6 op/s 2023-05-08T10:34:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24623.129433 secs 2023-05-08T10:34:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24623.685207 secs 2023-05-08T10:34:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:46 smithi133 ceph-mon[125939]: pgmap v13189: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 182 KiB/s wr, 9 op/s 2023-05-08T10:34:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:46 smithi096 ceph-mon[124666]: pgmap v13189: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 182 KiB/s wr, 9 op/s 2023-05-08T10:34:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:46 smithi186 ceph-mon[126480]: pgmap v13189: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 182 KiB/s wr, 9 op/s 2023-05-08T10:34:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:48 smithi133 ceph-mon[125939]: pgmap v13190: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 597 B/s wr, 6 op/s 2023-05-08T10:34:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:34:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:48 smithi096 ceph-mon[124666]: pgmap v13190: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 597 B/s wr, 6 op/s 2023-05-08T10:34:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:34:48.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:48 smithi186 ceph-mon[126480]: pgmap v13190: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 597 B/s wr, 6 op/s 2023-05-08T10:34:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:34:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24628.129545 secs 2023-05-08T10:34:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:34:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:34:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:34:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24628.685316 secs 2023-05-08T10:34:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24628.129545 secs 2023-05-08T10:34:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:34:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:34:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:34:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24628.685316 secs 2023-05-08T10:34:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24628.129545 secs 2023-05-08T10:34:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:34:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:34:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:34:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24628.685316 secs 2023-05-08T10:34:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:50 smithi133 ceph-mon[125939]: pgmap v13191: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 124 KiB/s wr, 9 op/s 2023-05-08T10:34:50.811 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:50 smithi096 ceph-mon[124666]: pgmap v13191: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 124 KiB/s wr, 9 op/s 2023-05-08T10:34:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:50 smithi186 ceph-mon[126480]: pgmap v13191: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 124 KiB/s wr, 9 op/s 2023-05-08T10:34:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:52 smithi133 ceph-mon[125939]: pgmap v13192: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 123 KiB/s wr, 6 op/s 2023-05-08T10:34:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:52 smithi096 ceph-mon[124666]: pgmap v13192: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 123 KiB/s wr, 6 op/s 2023-05-08T10:34:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:52 smithi186 ceph-mon[126480]: pgmap v13192: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 123 KiB/s wr, 6 op/s 2023-05-08T10:34:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:54 smithi133 ceph-mon[125939]: pgmap v13193: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 123 KiB/s wr, 6 op/s 2023-05-08T10:34:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24633.129657 secs 2023-05-08T10:34:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:54 smithi096 ceph-mon[124666]: pgmap v13193: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 123 KiB/s wr, 6 op/s 2023-05-08T10:34:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24633.129657 secs 2023-05-08T10:34:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:54 smithi186 ceph-mon[126480]: pgmap v13193: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 123 KiB/s wr, 6 op/s 2023-05-08T10:34:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24633.129657 secs 2023-05-08T10:34:56.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:56 smithi133 ceph-mon[125939]: pgmap v13194: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 372 KiB/s wr, 10 op/s 2023-05-08T10:34:56.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:34:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:56 smithi096 ceph-mon[124666]: pgmap v13194: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 372 KiB/s wr, 10 op/s 2023-05-08T10:34:56.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:34:56.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:56 smithi186 ceph-mon[126480]: pgmap v13194: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 372 KiB/s wr, 10 op/s 2023-05-08T10:34:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:34:57.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:57 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:34:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:34:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:34:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:57 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:34:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:34:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:34:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:57 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:34:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:34:57.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:34:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:58 smithi096 ceph-mon[124666]: pgmap v13195: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 545 KiB/s rd, 372 KiB/s wr, 8 op/s 2023-05-08T10:34:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:58 smithi186 ceph-mon[126480]: pgmap v13195: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 545 KiB/s rd, 372 KiB/s wr, 8 op/s 2023-05-08T10:34:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:58 smithi133 ceph-mon[125939]: pgmap v13195: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 545 KiB/s rd, 372 KiB/s wr, 8 op/s 2023-05-08T10:34:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24638.129779 secs 2023-05-08T10:34:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:34:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24638.685515 secs 2023-05-08T10:34:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24638.129779 secs 2023-05-08T10:34:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:34:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24638.685515 secs 2023-05-08T10:34:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24638.129779 secs 2023-05-08T10:34:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:34:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24638.685515 secs 2023-05-08T10:35:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:00 smithi096 ceph-mon[124666]: pgmap v13196: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 785 KiB/s rd, 711 KiB/s wr, 14 op/s 2023-05-08T10:35:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:00 smithi186 ceph-mon[126480]: pgmap v13196: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 785 KiB/s rd, 711 KiB/s wr, 14 op/s 2023-05-08T10:35:00.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:00 smithi133 ceph-mon[125939]: pgmap v13196: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 785 KiB/s rd, 711 KiB/s wr, 14 op/s 2023-05-08T10:35:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:35:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:35:01.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:35:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:35:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:35:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:35:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:02 smithi186 ceph-mon[126480]: pgmap v13197: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 592 KiB/s rd, 588 KiB/s wr, 11 op/s 2023-05-08T10:35:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:02 smithi133 ceph-mon[125939]: pgmap v13197: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 592 KiB/s rd, 588 KiB/s wr, 11 op/s 2023-05-08T10:35:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:02 smithi096 ceph-mon[124666]: pgmap v13197: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 592 KiB/s rd, 588 KiB/s wr, 11 op/s 2023-05-08T10:35:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:04 smithi186 ceph-mon[126480]: pgmap v13198: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 592 KiB/s rd, 588 KiB/s wr, 11 op/s 2023-05-08T10:35:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24643.129904 secs 2023-05-08T10:35:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:04 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:35:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:04 smithi133 ceph-mon[125939]: pgmap v13198: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 592 KiB/s rd, 588 KiB/s wr, 11 op/s 2023-05-08T10:35:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24643.129904 secs 2023-05-08T10:35:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:04 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:35:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:04 smithi096 ceph-mon[124666]: pgmap v13198: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 592 KiB/s rd, 588 KiB/s wr, 11 op/s 2023-05-08T10:35:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24643.129904 secs 2023-05-08T10:35:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:04 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:35:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:06 smithi186 ceph-mon[126480]: pgmap v13199: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 913 KiB/s rd, 745 KiB/s wr, 17 op/s 2023-05-08T10:35:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:06 smithi133 ceph-mon[125939]: pgmap v13199: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 913 KiB/s rd, 745 KiB/s wr, 17 op/s 2023-05-08T10:35:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:06 smithi096 ceph-mon[124666]: pgmap v13199: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 913 KiB/s rd, 745 KiB/s wr, 17 op/s 2023-05-08T10:35:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:08 smithi186 ceph-mon[126480]: pgmap v13200: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 561 KiB/s rd, 497 KiB/s wr, 13 op/s 2023-05-08T10:35:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:08 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:35:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:08 smithi133 ceph-mon[125939]: pgmap v13200: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 561 KiB/s rd, 497 KiB/s wr, 13 op/s 2023-05-08T10:35:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:08 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:35:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:08 smithi096 ceph-mon[124666]: pgmap v13200: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 561 KiB/s rd, 497 KiB/s wr, 13 op/s 2023-05-08T10:35:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:08 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:35:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24648.130037 secs 2023-05-08T10:35:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:35:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:35:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24648.685725 secs 2023-05-08T10:35:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:09 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:35:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24648.130037 secs 2023-05-08T10:35:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:35:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:35:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24648.685725 secs 2023-05-08T10:35:09.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:09 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:35:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24648.130037 secs 2023-05-08T10:35:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:35:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:35:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24648.685725 secs 2023-05-08T10:35:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:09 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:35:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:10 smithi186 ceph-mon[126480]: pgmap v13201: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 739 KiB/s rd, 767 KiB/s wr, 31 op/s 2023-05-08T10:35:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:10 smithi133 ceph-mon[125939]: pgmap v13201: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 739 KiB/s rd, 767 KiB/s wr, 31 op/s 2023-05-08T10:35:11.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:10 smithi096 ceph-mon[124666]: pgmap v13201: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 739 KiB/s rd, 767 KiB/s wr, 31 op/s 2023-05-08T10:35:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24649.973256 secs 2023-05-08T10:35:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:11 smithi186 ceph-mon[126480]: osdmap e902: 12 total, 12 up, 12 in 2023-05-08T10:35:11.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24649.973256 secs 2023-05-08T10:35:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:11 smithi133 ceph-mon[125939]: osdmap e902: 12 total, 12 up, 12 in 2023-05-08T10:35:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24649.973256 secs 2023-05-08T10:35:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:11 smithi096 ceph-mon[124666]: osdmap e902: 12 total, 12 up, 12 in 2023-05-08T10:35:12.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:12 smithi186 ceph-mon[126480]: pgmap v13203: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 599 KiB/s rd, 513 KiB/s wr, 29 op/s 2023-05-08T10:35:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:12 smithi133 ceph-mon[125939]: pgmap v13203: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 599 KiB/s rd, 513 KiB/s wr, 29 op/s 2023-05-08T10:35:13.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:12 smithi096 ceph-mon[124666]: pgmap v13203: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 599 KiB/s rd, 513 KiB/s wr, 29 op/s 2023-05-08T10:35:13.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:35:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:35:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:13 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:35:13.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:35:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:35:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:13 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:35:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:35:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:35:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:13 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:35:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24653.130151 secs 2023-05-08T10:35:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:14 smithi186 ceph-mon[126480]: pgmap v13204: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 599 KiB/s rd, 513 KiB/s wr, 29 op/s 2023-05-08T10:35:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24653.685847 secs 2023-05-08T10:35:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:14 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:35:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24653.130151 secs 2023-05-08T10:35:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:14 smithi133 ceph-mon[125939]: pgmap v13204: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 599 KiB/s rd, 513 KiB/s wr, 29 op/s 2023-05-08T10:35:14.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24653.685847 secs 2023-05-08T10:35:14.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:14 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:35:15.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24653.130151 secs 2023-05-08T10:35:15.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:14 smithi096 ceph-mon[124666]: pgmap v13204: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 599 KiB/s rd, 513 KiB/s wr, 29 op/s 2023-05-08T10:35:15.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24653.685847 secs 2023-05-08T10:35:15.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:14 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:35:16.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24654.973374 secs 2023-05-08T10:35:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:16 smithi186 ceph-mon[126480]: pgmap v13205: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 441 KiB/s wr, 26 op/s 2023-05-08T10:35:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24654.973374 secs 2023-05-08T10:35:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:16 smithi133 ceph-mon[125939]: pgmap v13205: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 441 KiB/s wr, 26 op/s 2023-05-08T10:35:17.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24654.973374 secs 2023-05-08T10:35:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:16 smithi096 ceph-mon[124666]: pgmap v13205: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 441 KiB/s wr, 26 op/s 2023-05-08T10:35:18.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:18 smithi186 ceph-mon[126480]: pgmap v13206: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 441 KiB/s wr, 26 op/s 2023-05-08T10:35:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:18 smithi133 ceph-mon[125939]: pgmap v13206: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 441 KiB/s wr, 26 op/s 2023-05-08T10:35:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:18 smithi096 ceph-mon[124666]: pgmap v13206: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 441 KiB/s wr, 26 op/s 2023-05-08T10:35:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24658.130272 secs 2023-05-08T10:35:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24658.685964 secs 2023-05-08T10:35:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:19 smithi186 ceph-mon[126480]: osdmap e903: 12 total, 12 up, 12 in 2023-05-08T10:35:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24658.130272 secs 2023-05-08T10:35:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24658.685964 secs 2023-05-08T10:35:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:19 smithi133 ceph-mon[125939]: osdmap e903: 12 total, 12 up, 12 in 2023-05-08T10:35:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24658.130272 secs 2023-05-08T10:35:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24658.685964 secs 2023-05-08T10:35:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:19 smithi096 ceph-mon[124666]: osdmap e903: 12 total, 12 up, 12 in 2023-05-08T10:35:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:20 smithi186 ceph-mon[126480]: pgmap v13208: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 223 KiB/s wr, 10 op/s 2023-05-08T10:35:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24659.973476 secs 2023-05-08T10:35:20.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:20 smithi133 ceph-mon[125939]: pgmap v13208: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 223 KiB/s wr, 10 op/s 2023-05-08T10:35:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24659.973476 secs 2023-05-08T10:35:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:20 smithi096 ceph-mon[124666]: pgmap v13208: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 223 KiB/s wr, 10 op/s 2023-05-08T10:35:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24659.973476 secs 2023-05-08T10:35:22.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:22 smithi186 ceph-mon[126480]: pgmap v13209: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 198 KiB/s wr, 9 op/s 2023-05-08T10:35:22.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:22 smithi133 ceph-mon[125939]: pgmap v13209: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 198 KiB/s wr, 9 op/s 2023-05-08T10:35:23.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:22 smithi096 ceph-mon[124666]: pgmap v13209: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 198 KiB/s wr, 9 op/s 2023-05-08T10:35:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24663.130440 secs 2023-05-08T10:35:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:24 smithi186 ceph-mon[126480]: pgmap v13210: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 198 KiB/s wr, 9 op/s 2023-05-08T10:35:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24663.686083 secs 2023-05-08T10:35:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24663.130440 secs 2023-05-08T10:35:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:24 smithi133 ceph-mon[125939]: pgmap v13210: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 198 KiB/s wr, 9 op/s 2023-05-08T10:35:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24663.686083 secs 2023-05-08T10:35:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24663.130440 secs 2023-05-08T10:35:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:24 smithi096 ceph-mon[124666]: pgmap v13210: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 198 KiB/s wr, 9 op/s 2023-05-08T10:35:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24663.686083 secs 2023-05-08T10:35:25.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24664.973595 secs 2023-05-08T10:35:25.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24664.973595 secs 2023-05-08T10:35:26.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24664.973595 secs 2023-05-08T10:35:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:26 smithi186 ceph-mon[126480]: pgmap v13211: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 82 KiB/s wr, 7 op/s 2023-05-08T10:35:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:26 smithi133 ceph-mon[125939]: pgmap v13211: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 82 KiB/s wr, 7 op/s 2023-05-08T10:35:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:26 smithi096 ceph-mon[124666]: pgmap v13211: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 82 KiB/s wr, 7 op/s 2023-05-08T10:35:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:28 smithi186 ceph-mon[126480]: pgmap v13212: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 82 KiB/s wr, 7 op/s 2023-05-08T10:35:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:28 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:35:28.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:28 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:35:28.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:28 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:35:28.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:28 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:35:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:28 smithi133 ceph-mon[125939]: pgmap v13212: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 82 KiB/s wr, 7 op/s 2023-05-08T10:35:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:28 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:35:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:28 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:35:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:28 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:35:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:28 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:35:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:28 smithi096 ceph-mon[124666]: pgmap v13212: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 82 KiB/s wr, 7 op/s 2023-05-08T10:35:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:28 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:35:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:28 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:35:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:28 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:35:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:28 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:35:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:29 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:35:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:29 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T10:35:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:29 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T10:35:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:29 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:35:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24668.130505 secs 2023-05-08T10:35:29.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24668.686196 secs 2023-05-08T10:35:29.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:29 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:35:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:29 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T10:35:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:29 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T10:35:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:29 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:35:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24668.130505 secs 2023-05-08T10:35:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24668.686196 secs 2023-05-08T10:35:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:29 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:35:30.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:29 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T10:35:30.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:29 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T10:35:30.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:29 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:35:30.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24668.130505 secs 2023-05-08T10:35:30.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24668.686196 secs 2023-05-08T10:35:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:30 smithi186 ceph-mon[126480]: pgmap v13213: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2023-05-08T10:35:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24669.973741 secs 2023-05-08T10:35:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:30 smithi133 ceph-mon[125939]: pgmap v13213: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2023-05-08T10:35:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24669.973741 secs 2023-05-08T10:35:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:30 smithi096 ceph-mon[124666]: pgmap v13213: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2023-05-08T10:35:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24669.973741 secs 2023-05-08T10:35:32.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:32 smithi186 ceph-mon[126480]: pgmap v13214: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:35:32.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:32 smithi133 ceph-mon[125939]: pgmap v13214: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:35:33.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:32 smithi096 ceph-mon[124666]: pgmap v13214: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:35:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24673.130648 secs 2023-05-08T10:35:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:34 smithi186 ceph-mon[126480]: pgmap v13215: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:35:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24673.686314 secs 2023-05-08T10:35:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24673.130648 secs 2023-05-08T10:35:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:34 smithi133 ceph-mon[125939]: pgmap v13215: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:35:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24673.686314 secs 2023-05-08T10:35:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24673.130648 secs 2023-05-08T10:35:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:34 smithi096 ceph-mon[124666]: pgmap v13215: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:35:35.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24673.686314 secs 2023-05-08T10:35:35.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24674.973852 secs 2023-05-08T10:35:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24674.973852 secs 2023-05-08T10:35:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24674.973852 secs 2023-05-08T10:35:36.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:36 smithi186 ceph-mon[126480]: pgmap v13216: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 511 B/s wr, 9 op/s 2023-05-08T10:35:36.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:36 smithi133 ceph-mon[125939]: pgmap v13216: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 511 B/s wr, 9 op/s 2023-05-08T10:35:37.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:36 smithi096 ceph-mon[124666]: pgmap v13216: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 511 B/s wr, 9 op/s 2023-05-08T10:35:38.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:38 smithi186 ceph-mon[126480]: pgmap v13217: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T10:35:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:38 smithi133 ceph-mon[125939]: pgmap v13217: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T10:35:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:38 smithi096 ceph-mon[124666]: pgmap v13217: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T10:35:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24678.130745 secs 2023-05-08T10:35:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24678.686449 secs 2023-05-08T10:35:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24678.130745 secs 2023-05-08T10:35:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24678.686449 secs 2023-05-08T10:35:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24678.130745 secs 2023-05-08T10:35:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24678.686449 secs 2023-05-08T10:35:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:40 smithi186 ceph-mon[126480]: pgmap v13218: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 183 KiB/s wr, 10 op/s 2023-05-08T10:35:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24679.973934 secs 2023-05-08T10:35:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:40 smithi133 ceph-mon[125939]: pgmap v13218: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 183 KiB/s wr, 10 op/s 2023-05-08T10:35:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24679.973934 secs 2023-05-08T10:35:41.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:40 smithi096 ceph-mon[124666]: pgmap v13218: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 183 KiB/s wr, 10 op/s 2023-05-08T10:35:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24679.973934 secs 2023-05-08T10:35:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:41 smithi133 ceph-mon[125939]: pgmap v13219: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 183 KiB/s wr, 7 op/s 2023-05-08T10:35:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:41 smithi096 ceph-mon[124666]: pgmap v13219: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 183 KiB/s wr, 7 op/s 2023-05-08T10:35:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:41 smithi186 ceph-mon[126480]: pgmap v13219: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 183 KiB/s wr, 7 op/s 2023-05-08T10:35:44.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24683.130867 secs 2023-05-08T10:35:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:44 smithi133 ceph-mon[125939]: pgmap v13220: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 183 KiB/s wr, 7 op/s 2023-05-08T10:35:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24683.686590 secs 2023-05-08T10:35:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24683.130867 secs 2023-05-08T10:35:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:44 smithi096 ceph-mon[124666]: pgmap v13220: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 183 KiB/s wr, 7 op/s 2023-05-08T10:35:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24683.686590 secs 2023-05-08T10:35:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24683.130867 secs 2023-05-08T10:35:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:44 smithi186 ceph-mon[126480]: pgmap v13220: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 183 KiB/s wr, 7 op/s 2023-05-08T10:35:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24683.686590 secs 2023-05-08T10:35:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:46 smithi133 ceph-mon[125939]: pgmap v13221: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 184 KiB/s wr, 10 op/s 2023-05-08T10:35:46.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:46 smithi096 ceph-mon[124666]: pgmap v13221: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 184 KiB/s wr, 10 op/s 2023-05-08T10:35:46.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:46 smithi186 ceph-mon[126480]: pgmap v13221: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 184 KiB/s wr, 10 op/s 2023-05-08T10:35:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:48 smithi133 ceph-mon[125939]: pgmap v13222: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 183 KiB/s wr, 7 op/s 2023-05-08T10:35:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:35:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:48 smithi096 ceph-mon[124666]: pgmap v13222: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 183 KiB/s wr, 7 op/s 2023-05-08T10:35:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:35:48.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:48 smithi186 ceph-mon[126480]: pgmap v13222: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 183 KiB/s wr, 7 op/s 2023-05-08T10:35:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:35:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24688.130982 secs 2023-05-08T10:35:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:35:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:35:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:35:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24688.686699 secs 2023-05-08T10:35:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24688.130982 secs 2023-05-08T10:35:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:35:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:35:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:35:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24688.686699 secs 2023-05-08T10:35:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24688.130982 secs 2023-05-08T10:35:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:35:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:35:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:35:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24688.686699 secs 2023-05-08T10:35:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:50 smithi133 ceph-mon[125939]: pgmap v13223: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 308 KiB/s wr, 10 op/s 2023-05-08T10:35:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:50 smithi096 ceph-mon[124666]: pgmap v13223: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 308 KiB/s wr, 10 op/s 2023-05-08T10:35:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:50 smithi186 ceph-mon[126480]: pgmap v13223: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 308 KiB/s wr, 10 op/s 2023-05-08T10:35:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:52 smithi133 ceph-mon[125939]: pgmap v13224: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 418 KiB/s rd, 126 KiB/s wr, 6 op/s 2023-05-08T10:35:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:52 smithi096 ceph-mon[124666]: pgmap v13224: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 418 KiB/s rd, 126 KiB/s wr, 6 op/s 2023-05-08T10:35:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:52 smithi186 ceph-mon[126480]: pgmap v13224: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 418 KiB/s rd, 126 KiB/s wr, 6 op/s 2023-05-08T10:35:54.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24693.131088 secs 2023-05-08T10:35:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:54 smithi133 ceph-mon[125939]: pgmap v13225: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 418 KiB/s rd, 126 KiB/s wr, 6 op/s 2023-05-08T10:35:54.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24693.131088 secs 2023-05-08T10:35:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:54 smithi096 ceph-mon[124666]: pgmap v13225: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 418 KiB/s rd, 126 KiB/s wr, 6 op/s 2023-05-08T10:35:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24693.131088 secs 2023-05-08T10:35:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:54 smithi186 ceph-mon[126480]: pgmap v13225: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 418 KiB/s rd, 126 KiB/s wr, 6 op/s 2023-05-08T10:35:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:56 smithi133 ceph-mon[125939]: pgmap v13226: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 738 KiB/s rd, 373 KiB/s wr, 11 op/s 2023-05-08T10:35:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:35:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:56 smithi096 ceph-mon[124666]: pgmap v13226: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 738 KiB/s rd, 373 KiB/s wr, 11 op/s 2023-05-08T10:35:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:35:56.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:56 smithi186 ceph-mon[126480]: pgmap v13226: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 738 KiB/s rd, 373 KiB/s wr, 11 op/s 2023-05-08T10:35:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:35:57.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:57 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:35:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:35:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:35:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:57 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:35:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:35:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:35:57.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:57 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:35:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:35:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:35:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:58 smithi096 ceph-mon[124666]: pgmap v13227: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 554 KiB/s rd, 373 KiB/s wr, 7 op/s 2023-05-08T10:35:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:58 smithi186 ceph-mon[126480]: pgmap v13227: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 554 KiB/s rd, 373 KiB/s wr, 7 op/s 2023-05-08T10:35:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:58 smithi133 ceph-mon[125939]: pgmap v13227: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 554 KiB/s rd, 373 KiB/s wr, 7 op/s 2023-05-08T10:35:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24698.131236 secs 2023-05-08T10:35:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:35:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24698.686954 secs 2023-05-08T10:35:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24698.131236 secs 2023-05-08T10:35:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:35:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24698.686954 secs 2023-05-08T10:35:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24698.131236 secs 2023-05-08T10:35:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:35:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24698.686954 secs 2023-05-08T10:36:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:00 smithi096 ceph-mon[124666]: pgmap v13228: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 801 KiB/s rd, 713 KiB/s wr, 14 op/s 2023-05-08T10:36:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:00 smithi186 ceph-mon[126480]: pgmap v13228: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 801 KiB/s rd, 713 KiB/s wr, 14 op/s 2023-05-08T10:36:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:00 smithi133 ceph-mon[125939]: pgmap v13228: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 801 KiB/s rd, 713 KiB/s wr, 14 op/s 2023-05-08T10:36:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:36:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:36:01.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:36:01.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:36:01.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:36:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:36:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:02 smithi186 ceph-mon[126480]: pgmap v13229: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 567 KiB/s rd, 588 KiB/s wr, 11 op/s 2023-05-08T10:36:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:02 smithi133 ceph-mon[125939]: pgmap v13229: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 567 KiB/s rd, 588 KiB/s wr, 11 op/s 2023-05-08T10:36:03.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:02 smithi096 ceph-mon[124666]: pgmap v13229: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 567 KiB/s rd, 588 KiB/s wr, 11 op/s 2023-05-08T10:36:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24703.131327 secs 2023-05-08T10:36:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:04 smithi186 ceph-mon[126480]: pgmap v13230: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 567 KiB/s rd, 588 KiB/s wr, 11 op/s 2023-05-08T10:36:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24703.687151 secs 2023-05-08T10:36:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:04 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:36:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24703.131327 secs 2023-05-08T10:36:04.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:04 smithi133 ceph-mon[125939]: pgmap v13230: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 567 KiB/s rd, 588 KiB/s wr, 11 op/s 2023-05-08T10:36:04.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24703.687151 secs 2023-05-08T10:36:04.994 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:04 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:36:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24703.131327 secs 2023-05-08T10:36:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:04 smithi096 ceph-mon[124666]: pgmap v13230: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 567 KiB/s rd, 588 KiB/s wr, 11 op/s 2023-05-08T10:36:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24703.687151 secs 2023-05-08T10:36:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:04 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:36:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:06 smithi186 ceph-mon[126480]: pgmap v13231: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 909 KiB/s rd, 745 KiB/s wr, 17 op/s 2023-05-08T10:36:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:06 smithi133 ceph-mon[125939]: pgmap v13231: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 909 KiB/s rd, 745 KiB/s wr, 17 op/s 2023-05-08T10:36:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:06 smithi096 ceph-mon[124666]: pgmap v13231: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 909 KiB/s rd, 745 KiB/s wr, 17 op/s 2023-05-08T10:36:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:08 smithi186 ceph-mon[126480]: pgmap v13232: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 588 KiB/s rd, 497 KiB/s wr, 13 op/s 2023-05-08T10:36:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:08 smithi133 ceph-mon[125939]: pgmap v13232: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 588 KiB/s rd, 497 KiB/s wr, 13 op/s 2023-05-08T10:36:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:08 smithi096 ceph-mon[124666]: pgmap v13232: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 588 KiB/s rd, 497 KiB/s wr, 13 op/s 2023-05-08T10:36:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24708.131443 secs 2023-05-08T10:36:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24708.687272 secs 2023-05-08T10:36:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24708.131443 secs 2023-05-08T10:36:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24708.687272 secs 2023-05-08T10:36:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24708.131443 secs 2023-05-08T10:36:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24708.687272 secs 2023-05-08T10:36:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:10 smithi186 ceph-mon[126480]: pgmap v13233: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 876 KiB/s rd, 770 KiB/s wr, 31 op/s 2023-05-08T10:36:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:10 smithi133 ceph-mon[125939]: pgmap v13233: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 876 KiB/s rd, 770 KiB/s wr, 31 op/s 2023-05-08T10:36:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:10 smithi096 ceph-mon[124666]: pgmap v13233: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 876 KiB/s rd, 770 KiB/s wr, 31 op/s 2023-05-08T10:36:11.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24709.974622 secs 2023-05-08T10:36:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:11 smithi186 ceph-mon[126480]: osdmap e904: 12 total, 12 up, 12 in 2023-05-08T10:36:11.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24709.974622 secs 2023-05-08T10:36:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:11 smithi133 ceph-mon[125939]: osdmap e904: 12 total, 12 up, 12 in 2023-05-08T10:36:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24709.974622 secs 2023-05-08T10:36:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:11 smithi096 ceph-mon[124666]: osdmap e904: 12 total, 12 up, 12 in 2023-05-08T10:36:12.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:12 smithi186 ceph-mon[126480]: pgmap v13235: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 755 KiB/s rd, 515 KiB/s wr, 29 op/s 2023-05-08T10:36:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:12 smithi133 ceph-mon[125939]: pgmap v13235: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 755 KiB/s rd, 515 KiB/s wr, 29 op/s 2023-05-08T10:36:13.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:12 smithi096 ceph-mon[124666]: pgmap v13235: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 755 KiB/s rd, 515 KiB/s wr, 29 op/s 2023-05-08T10:36:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:13 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:36:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:36:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:13 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:36:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:13 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:36:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:36:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:13 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:36:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:13 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:36:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:36:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:13 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:36:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24713.131509 secs 2023-05-08T10:36:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:14 smithi186 ceph-mon[126480]: pgmap v13236: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 755 KiB/s rd, 515 KiB/s wr, 29 op/s 2023-05-08T10:36:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24713.687398 secs 2023-05-08T10:36:14.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24713.131509 secs 2023-05-08T10:36:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:14 smithi133 ceph-mon[125939]: pgmap v13236: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 755 KiB/s rd, 515 KiB/s wr, 29 op/s 2023-05-08T10:36:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24713.687398 secs 2023-05-08T10:36:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24713.131509 secs 2023-05-08T10:36:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:14 smithi096 ceph-mon[124666]: pgmap v13236: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 755 KiB/s rd, 515 KiB/s wr, 29 op/s 2023-05-08T10:36:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24713.687398 secs 2023-05-08T10:36:16.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24714.974740 secs 2023-05-08T10:36:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:16 smithi186 ceph-mon[126480]: pgmap v13237: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 443 KiB/s wr, 27 op/s 2023-05-08T10:36:16.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24714.974740 secs 2023-05-08T10:36:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:16 smithi133 ceph-mon[125939]: pgmap v13237: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 443 KiB/s wr, 27 op/s 2023-05-08T10:36:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24714.974740 secs 2023-05-08T10:36:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:16 smithi096 ceph-mon[124666]: pgmap v13237: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 443 KiB/s wr, 27 op/s 2023-05-08T10:36:18.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:18 smithi186 ceph-mon[126480]: pgmap v13238: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 443 KiB/s wr, 27 op/s 2023-05-08T10:36:18.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:18 smithi133 ceph-mon[125939]: pgmap v13238: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 443 KiB/s wr, 27 op/s 2023-05-08T10:36:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:18 smithi096 ceph-mon[124666]: pgmap v13238: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 443 KiB/s wr, 27 op/s 2023-05-08T10:36:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24718.131584 secs 2023-05-08T10:36:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24718.687546 secs 2023-05-08T10:36:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:19 smithi186 ceph-mon[126480]: osdmap e905: 12 total, 12 up, 12 in 2023-05-08T10:36:19.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24718.131584 secs 2023-05-08T10:36:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24718.687546 secs 2023-05-08T10:36:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:19 smithi133 ceph-mon[125939]: osdmap e905: 12 total, 12 up, 12 in 2023-05-08T10:36:20.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24718.131584 secs 2023-05-08T10:36:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24718.687546 secs 2023-05-08T10:36:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:19 smithi096 ceph-mon[124666]: osdmap e905: 12 total, 12 up, 12 in 2023-05-08T10:36:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:20 smithi186 ceph-mon[126480]: pgmap v13240: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 223 KiB/s wr, 10 op/s 2023-05-08T10:36:20.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:20 smithi133 ceph-mon[125939]: pgmap v13240: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 223 KiB/s wr, 10 op/s 2023-05-08T10:36:21.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:20 smithi096 ceph-mon[124666]: pgmap v13240: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 223 KiB/s wr, 10 op/s 2023-05-08T10:36:21.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24719.974878 secs 2023-05-08T10:36:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24719.974878 secs 2023-05-08T10:36:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24719.974878 secs 2023-05-08T10:36:22.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:22 smithi186 ceph-mon[126480]: pgmap v13241: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 199 KiB/s wr, 9 op/s 2023-05-08T10:36:22.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:22 smithi133 ceph-mon[125939]: pgmap v13241: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 199 KiB/s wr, 9 op/s 2023-05-08T10:36:23.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:22 smithi096 ceph-mon[124666]: pgmap v13241: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 199 KiB/s wr, 9 op/s 2023-05-08T10:36:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24723.131706 secs 2023-05-08T10:36:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:24 smithi186 ceph-mon[126480]: pgmap v13242: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 199 KiB/s wr, 9 op/s 2023-05-08T10:36:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24723.687674 secs 2023-05-08T10:36:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24723.131706 secs 2023-05-08T10:36:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:24 smithi133 ceph-mon[125939]: pgmap v13242: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 199 KiB/s wr, 9 op/s 2023-05-08T10:36:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24723.687674 secs 2023-05-08T10:36:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24723.131706 secs 2023-05-08T10:36:25.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:24 smithi096 ceph-mon[124666]: pgmap v13242: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 199 KiB/s wr, 9 op/s 2023-05-08T10:36:25.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24723.687674 secs 2023-05-08T10:36:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24724.974992 secs 2023-05-08T10:36:25.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24724.974992 secs 2023-05-08T10:36:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24724.974992 secs 2023-05-08T10:36:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:26 smithi186 ceph-mon[126480]: pgmap v13243: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 82 KiB/s wr, 7 op/s 2023-05-08T10:36:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:26 smithi133 ceph-mon[125939]: pgmap v13243: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 82 KiB/s wr, 7 op/s 2023-05-08T10:36:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:26 smithi096 ceph-mon[124666]: pgmap v13243: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 82 KiB/s wr, 7 op/s 2023-05-08T10:36:28.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:28 smithi186 ceph-mon[126480]: pgmap v13244: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 82 KiB/s wr, 7 op/s 2023-05-08T10:36:28.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:28 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:36:28.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:28 smithi133 ceph-mon[125939]: pgmap v13244: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 82 KiB/s wr, 7 op/s 2023-05-08T10:36:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:28 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:36:29.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:28 smithi096 ceph-mon[124666]: pgmap v13244: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 82 KiB/s wr, 7 op/s 2023-05-08T10:36:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:28 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:36:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24728.131820 secs 2023-05-08T10:36:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24728.687755 secs 2023-05-08T10:36:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:29 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:36:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:29 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:36:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:29 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:36:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24728.131820 secs 2023-05-08T10:36:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24728.687755 secs 2023-05-08T10:36:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:29 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:36:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:29 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:36:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:29 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:36:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24728.131820 secs 2023-05-08T10:36:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24728.687755 secs 2023-05-08T10:36:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:29 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:36:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:29 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:36:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:29 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:36:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:30 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:36:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:30 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T10:36:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:30 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T10:36:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:30 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:36:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:30 smithi186 ceph-mon[126480]: pgmap v13245: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2023-05-08T10:36:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24729.975139 secs 2023-05-08T10:36:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:30 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:36:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:30 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T10:36:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:30 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T10:36:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:30 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:36:30.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:30 smithi133 ceph-mon[125939]: pgmap v13245: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2023-05-08T10:36:30.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24729.975139 secs 2023-05-08T10:36:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:30 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:36:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:30 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T10:36:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:30 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T10:36:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:30 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:36:31.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:30 smithi096 ceph-mon[124666]: pgmap v13245: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2023-05-08T10:36:31.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24729.975139 secs 2023-05-08T10:36:32.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:32 smithi186 ceph-mon[126480]: pgmap v13246: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2023-05-08T10:36:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:32 smithi133 ceph-mon[125939]: pgmap v13246: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2023-05-08T10:36:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:32 smithi096 ceph-mon[124666]: pgmap v13246: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2023-05-08T10:36:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24733.131937 secs 2023-05-08T10:36:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:34 smithi186 ceph-mon[126480]: pgmap v13247: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2023-05-08T10:36:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24733.687900 secs 2023-05-08T10:36:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24733.131937 secs 2023-05-08T10:36:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:34 smithi133 ceph-mon[125939]: pgmap v13247: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2023-05-08T10:36:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24733.687900 secs 2023-05-08T10:36:35.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24733.131937 secs 2023-05-08T10:36:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:34 smithi096 ceph-mon[124666]: pgmap v13247: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2023-05-08T10:36:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24733.687900 secs 2023-05-08T10:36:35.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24734.975255 secs 2023-05-08T10:36:35.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24734.975255 secs 2023-05-08T10:36:36.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24734.975255 secs 2023-05-08T10:36:36.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:36 smithi186 ceph-mon[126480]: pgmap v13248: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 511 B/s wr, 9 op/s 2023-05-08T10:36:36.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:36 smithi133 ceph-mon[125939]: pgmap v13248: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 511 B/s wr, 9 op/s 2023-05-08T10:36:37.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:36 smithi096 ceph-mon[124666]: pgmap v13248: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 511 B/s wr, 9 op/s 2023-05-08T10:36:38.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:38 smithi186 ceph-mon[126480]: pgmap v13249: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T10:36:38.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:38 smithi133 ceph-mon[125939]: pgmap v13249: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T10:36:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:38 smithi096 ceph-mon[124666]: pgmap v13249: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T10:36:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24738.132021 secs 2023-05-08T10:36:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24738.687991 secs 2023-05-08T10:36:39.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24738.132021 secs 2023-05-08T10:36:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24738.687991 secs 2023-05-08T10:36:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24738.132021 secs 2023-05-08T10:36:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24738.687991 secs 2023-05-08T10:36:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:40 smithi186 ceph-mon[126480]: pgmap v13250: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 266 KiB/s wr, 10 op/s 2023-05-08T10:36:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24739.975375 secs 2023-05-08T10:36:40.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:40 smithi133 ceph-mon[125939]: pgmap v13250: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 266 KiB/s wr, 10 op/s 2023-05-08T10:36:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24739.975375 secs 2023-05-08T10:36:41.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:40 smithi096 ceph-mon[124666]: pgmap v13250: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 266 KiB/s wr, 10 op/s 2023-05-08T10:36:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24739.975375 secs 2023-05-08T10:36:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:42 smithi186 ceph-mon[126480]: pgmap v13251: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 266 KiB/s wr, 7 op/s 2023-05-08T10:36:42.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:42 smithi133 ceph-mon[125939]: pgmap v13251: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 266 KiB/s wr, 7 op/s 2023-05-08T10:36:43.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:42 smithi096 ceph-mon[124666]: pgmap v13251: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 266 KiB/s wr, 7 op/s 2023-05-08T10:36:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24743.132139 secs 2023-05-08T10:36:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:44 smithi186 ceph-mon[126480]: pgmap v13252: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 266 KiB/s wr, 7 op/s 2023-05-08T10:36:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24743.688132 secs 2023-05-08T10:36:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24743.132139 secs 2023-05-08T10:36:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:44 smithi133 ceph-mon[125939]: pgmap v13252: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 266 KiB/s wr, 7 op/s 2023-05-08T10:36:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24743.688132 secs 2023-05-08T10:36:45.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24743.132139 secs 2023-05-08T10:36:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:44 smithi096 ceph-mon[124666]: pgmap v13252: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 266 KiB/s wr, 7 op/s 2023-05-08T10:36:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24743.688132 secs 2023-05-08T10:36:46.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:46 smithi186 ceph-mon[126480]: pgmap v13253: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 307 KiB/s wr, 10 op/s 2023-05-08T10:36:46.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:46 smithi133 ceph-mon[125939]: pgmap v13253: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 307 KiB/s wr, 10 op/s 2023-05-08T10:36:47.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:46 smithi096 ceph-mon[124666]: pgmap v13253: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 307 KiB/s wr, 10 op/s 2023-05-08T10:36:48.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:48 smithi186 ceph-mon[126480]: pgmap v13254: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 306 KiB/s wr, 7 op/s 2023-05-08T10:36:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:36:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:48 smithi133 ceph-mon[125939]: pgmap v13254: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 306 KiB/s wr, 7 op/s 2023-05-08T10:36:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:36:49.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:48 smithi096 ceph-mon[124666]: pgmap v13254: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 306 KiB/s wr, 7 op/s 2023-05-08T10:36:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:36:49.616 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24748.132253 secs 2023-05-08T10:36:49.617 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:36:49.617 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:36:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24748.132253 secs 2023-05-08T10:36:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:36:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:36:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:36:49.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24748.688268 secs 2023-05-08T10:36:49.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:49 smithi186 ceph-mon[126480]: pgmap v13255: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 559 KiB/s rd, 355 KiB/s wr, 10 op/s 2023-05-08T10:36:49.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24748.132253 secs 2023-05-08T10:36:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:36:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:36:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:36:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24748.688268 secs 2023-05-08T10:36:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:49 smithi133 ceph-mon[125939]: pgmap v13255: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 559 KiB/s rd, 355 KiB/s wr, 10 op/s 2023-05-08T10:36:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:36:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24748.688268 secs 2023-05-08T10:36:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:49 smithi096 ceph-mon[124666]: pgmap v13255: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 559 KiB/s rd, 355 KiB/s wr, 10 op/s 2023-05-08T10:36:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:52 smithi133 ceph-mon[125939]: pgmap v13256: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 90 KiB/s wr, 7 op/s 2023-05-08T10:36:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:52 smithi096 ceph-mon[124666]: pgmap v13256: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 90 KiB/s wr, 7 op/s 2023-05-08T10:36:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:52 smithi186 ceph-mon[126480]: pgmap v13256: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 90 KiB/s wr, 7 op/s 2023-05-08T10:36:54.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24753.132375 secs 2023-05-08T10:36:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:54 smithi133 ceph-mon[125939]: pgmap v13257: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 90 KiB/s wr, 7 op/s 2023-05-08T10:36:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24753.132375 secs 2023-05-08T10:36:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:54 smithi096 ceph-mon[124666]: pgmap v13257: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 90 KiB/s wr, 7 op/s 2023-05-08T10:36:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24753.132375 secs 2023-05-08T10:36:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:54 smithi186 ceph-mon[126480]: pgmap v13257: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 90 KiB/s wr, 7 op/s 2023-05-08T10:36:56.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:56 smithi133 ceph-mon[125939]: pgmap v13258: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 666 KiB/s rd, 374 KiB/s wr, 11 op/s 2023-05-08T10:36:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:36:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:56 smithi096 ceph-mon[124666]: pgmap v13258: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 666 KiB/s rd, 374 KiB/s wr, 11 op/s 2023-05-08T10:36:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:36:56.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:56 smithi186 ceph-mon[126480]: pgmap v13258: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 666 KiB/s rd, 374 KiB/s wr, 11 op/s 2023-05-08T10:36:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:36:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:57 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:36:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:36:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:36:57.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:57 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:36:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:36:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:36:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:57 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:36:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:36:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:36:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:58 smithi096 ceph-mon[124666]: pgmap v13259: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 334 KiB/s wr, 7 op/s 2023-05-08T10:36:58.949 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:58 smithi186 ceph-mon[126480]: pgmap v13259: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 334 KiB/s wr, 7 op/s 2023-05-08T10:36:58.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:58 smithi133 ceph-mon[125939]: pgmap v13259: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 334 KiB/s wr, 7 op/s 2023-05-08T10:36:59.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24758.132494 secs 2023-05-08T10:36:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:36:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24758.688518 secs 2023-05-08T10:36:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24758.132494 secs 2023-05-08T10:36:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:36:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24758.688518 secs 2023-05-08T10:36:59.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24758.132494 secs 2023-05-08T10:36:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:36:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24758.688518 secs 2023-05-08T10:37:00.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:00 smithi096 ceph-mon[124666]: pgmap v13260: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 770 KiB/s rd, 677 KiB/s wr, 14 op/s 2023-05-08T10:37:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:00 smithi186 ceph-mon[126480]: pgmap v13260: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 770 KiB/s rd, 677 KiB/s wr, 14 op/s 2023-05-08T10:37:00.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:00 smithi133 ceph-mon[125939]: pgmap v13260: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 770 KiB/s rd, 677 KiB/s wr, 14 op/s 2023-05-08T10:37:01.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:37:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:37:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:37:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:37:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:37:02.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:37:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:02 smithi186 ceph-mon[126480]: pgmap v13261: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 639 KiB/s rd, 627 KiB/s wr, 10 op/s 2023-05-08T10:37:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:02 smithi133 ceph-mon[125939]: pgmap v13261: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 639 KiB/s rd, 627 KiB/s wr, 10 op/s 2023-05-08T10:37:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:02 smithi096 ceph-mon[124666]: pgmap v13261: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 639 KiB/s rd, 627 KiB/s wr, 10 op/s 2023-05-08T10:37:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24763.132616 secs 2023-05-08T10:37:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:04 smithi186 ceph-mon[126480]: pgmap v13262: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 639 KiB/s rd, 627 KiB/s wr, 10 op/s 2023-05-08T10:37:04.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:04 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:37:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24763.132616 secs 2023-05-08T10:37:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:04 smithi133 ceph-mon[125939]: pgmap v13262: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 639 KiB/s rd, 627 KiB/s wr, 10 op/s 2023-05-08T10:37:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:04 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:37:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24763.132616 secs 2023-05-08T10:37:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:04 smithi096 ceph-mon[124666]: pgmap v13262: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 639 KiB/s rd, 627 KiB/s wr, 10 op/s 2023-05-08T10:37:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:04 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:37:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:06 smithi186 ceph-mon[126480]: pgmap v13263: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 854 KiB/s rd, 854 KiB/s wr, 17 op/s 2023-05-08T10:37:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:06 smithi133 ceph-mon[125939]: pgmap v13263: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 854 KiB/s rd, 854 KiB/s wr, 17 op/s 2023-05-08T10:37:07.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:06 smithi096 ceph-mon[124666]: pgmap v13263: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 854 KiB/s rd, 854 KiB/s wr, 17 op/s 2023-05-08T10:37:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:08 smithi186 ceph-mon[126480]: pgmap v13264: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 569 KiB/s rd, 569 KiB/s wr, 12 op/s 2023-05-08T10:37:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:08 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:37:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:08 smithi133 ceph-mon[125939]: pgmap v13264: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 569 KiB/s rd, 569 KiB/s wr, 12 op/s 2023-05-08T10:37:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:08 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:37:09.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:08 smithi096 ceph-mon[124666]: pgmap v13264: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 569 KiB/s rd, 569 KiB/s wr, 12 op/s 2023-05-08T10:37:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:08 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:37:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24768.132731 secs 2023-05-08T10:37:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:37:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:37:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24768.688737 secs 2023-05-08T10:37:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:09 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:37:09.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24768.132731 secs 2023-05-08T10:37:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:37:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:37:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24768.688737 secs 2023-05-08T10:37:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:09 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:37:10.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24768.132731 secs 2023-05-08T10:37:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:37:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:37:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24768.688737 secs 2023-05-08T10:37:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:09 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:37:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:10 smithi186 ceph-mon[126480]: pgmap v13265: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 750 KiB/s rd, 774 KiB/s wr, 30 op/s 2023-05-08T10:37:10.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:10 smithi133 ceph-mon[125939]: pgmap v13265: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 750 KiB/s rd, 774 KiB/s wr, 30 op/s 2023-05-08T10:37:11.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:10 smithi096 ceph-mon[124666]: pgmap v13265: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 750 KiB/s rd, 774 KiB/s wr, 30 op/s 2023-05-08T10:37:11.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24769.976078 secs 2023-05-08T10:37:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:11 smithi186 ceph-mon[126480]: osdmap e906: 12 total, 12 up, 12 in 2023-05-08T10:37:11.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24769.976078 secs 2023-05-08T10:37:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:11 smithi133 ceph-mon[125939]: osdmap e906: 12 total, 12 up, 12 in 2023-05-08T10:37:12.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24769.976078 secs 2023-05-08T10:37:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:11 smithi096 ceph-mon[124666]: osdmap e906: 12 total, 12 up, 12 in 2023-05-08T10:37:12.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:12 smithi186 ceph-mon[126480]: pgmap v13267: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 476 KiB/s rd, 517 KiB/s wr, 28 op/s 2023-05-08T10:37:12.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:12 smithi133 ceph-mon[125939]: pgmap v13267: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 476 KiB/s rd, 517 KiB/s wr, 28 op/s 2023-05-08T10:37:13.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:12 smithi096 ceph-mon[124666]: pgmap v13267: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 476 KiB/s rd, 517 KiB/s wr, 28 op/s 2023-05-08T10:37:13.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:37:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:37:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:13 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:37:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:37:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:37:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:13 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:37:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:37:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:37:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:13 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:37:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24773.132844 secs 2023-05-08T10:37:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:14 smithi186 ceph-mon[126480]: pgmap v13268: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 476 KiB/s rd, 517 KiB/s wr, 28 op/s 2023-05-08T10:37:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24773.688883 secs 2023-05-08T10:37:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:14 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:37:14.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24773.132844 secs 2023-05-08T10:37:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:14 smithi133 ceph-mon[125939]: pgmap v13268: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 476 KiB/s rd, 517 KiB/s wr, 28 op/s 2023-05-08T10:37:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24773.688883 secs 2023-05-08T10:37:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:14 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:37:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24773.132844 secs 2023-05-08T10:37:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:14 smithi096 ceph-mon[124666]: pgmap v13268: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 476 KiB/s rd, 517 KiB/s wr, 28 op/s 2023-05-08T10:37:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24773.688883 secs 2023-05-08T10:37:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:14 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:37:16.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24774.976194 secs 2023-05-08T10:37:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:16 smithi186 ceph-mon[126480]: pgmap v13269: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 336 KiB/s rd, 362 KiB/s wr, 26 op/s 2023-05-08T10:37:16.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24774.976194 secs 2023-05-08T10:37:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:16 smithi133 ceph-mon[125939]: pgmap v13269: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 336 KiB/s rd, 362 KiB/s wr, 26 op/s 2023-05-08T10:37:17.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24774.976194 secs 2023-05-08T10:37:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:16 smithi096 ceph-mon[124666]: pgmap v13269: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 336 KiB/s rd, 362 KiB/s wr, 26 op/s 2023-05-08T10:37:18.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:18 smithi186 ceph-mon[126480]: pgmap v13270: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 336 KiB/s rd, 362 KiB/s wr, 26 op/s 2023-05-08T10:37:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:18 smithi133 ceph-mon[125939]: pgmap v13270: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 336 KiB/s rd, 362 KiB/s wr, 26 op/s 2023-05-08T10:37:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:18 smithi096 ceph-mon[124666]: pgmap v13270: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 336 KiB/s rd, 362 KiB/s wr, 26 op/s 2023-05-08T10:37:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24778.132948 secs 2023-05-08T10:37:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24778.688988 secs 2023-05-08T10:37:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:19 smithi186 ceph-mon[126480]: osdmap e907: 12 total, 12 up, 12 in 2023-05-08T10:37:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24778.132948 secs 2023-05-08T10:37:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24778.688988 secs 2023-05-08T10:37:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:19 smithi133 ceph-mon[125939]: osdmap e907: 12 total, 12 up, 12 in 2023-05-08T10:37:20.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24778.132948 secs 2023-05-08T10:37:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24778.688988 secs 2023-05-08T10:37:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:19 smithi096 ceph-mon[124666]: osdmap e907: 12 total, 12 up, 12 in 2023-05-08T10:37:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:20 smithi186 ceph-mon[126480]: pgmap v13272: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 355 KiB/s rd, 352 KiB/s wr, 10 op/s 2023-05-08T10:37:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24779.976287 secs 2023-05-08T10:37:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:20 smithi133 ceph-mon[125939]: pgmap v13272: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 355 KiB/s rd, 352 KiB/s wr, 10 op/s 2023-05-08T10:37:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24779.976287 secs 2023-05-08T10:37:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:20 smithi096 ceph-mon[124666]: pgmap v13272: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 355 KiB/s rd, 352 KiB/s wr, 10 op/s 2023-05-08T10:37:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24779.976287 secs 2023-05-08T10:37:22.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:22 smithi186 ceph-mon[126480]: pgmap v13273: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 313 KiB/s wr, 9 op/s 2023-05-08T10:37:22.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:22 smithi133 ceph-mon[125939]: pgmap v13273: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 313 KiB/s wr, 9 op/s 2023-05-08T10:37:23.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:22 smithi096 ceph-mon[124666]: pgmap v13273: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 313 KiB/s wr, 9 op/s 2023-05-08T10:37:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24783.133064 secs 2023-05-08T10:37:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:24 smithi186 ceph-mon[126480]: pgmap v13274: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 313 KiB/s wr, 9 op/s 2023-05-08T10:37:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24783.689108 secs 2023-05-08T10:37:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24783.133064 secs 2023-05-08T10:37:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:24 smithi133 ceph-mon[125939]: pgmap v13274: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 313 KiB/s wr, 9 op/s 2023-05-08T10:37:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24783.689108 secs 2023-05-08T10:37:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24783.133064 secs 2023-05-08T10:37:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:24 smithi096 ceph-mon[124666]: pgmap v13274: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 313 KiB/s wr, 9 op/s 2023-05-08T10:37:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24783.689108 secs 2023-05-08T10:37:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24784.976401 secs 2023-05-08T10:37:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24784.976401 secs 2023-05-08T10:37:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24784.976401 secs 2023-05-08T10:37:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:26 smithi186 ceph-mon[126480]: pgmap v13275: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 196 KiB/s wr, 6 op/s 2023-05-08T10:37:26.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:26 smithi133 ceph-mon[125939]: pgmap v13275: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 196 KiB/s wr, 6 op/s 2023-05-08T10:37:27.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:26 smithi096 ceph-mon[124666]: pgmap v13275: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 196 KiB/s wr, 6 op/s 2023-05-08T10:37:28.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:28 smithi186 ceph-mon[126480]: pgmap v13276: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 196 KiB/s wr, 6 op/s 2023-05-08T10:37:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:28 smithi133 ceph-mon[125939]: pgmap v13276: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 196 KiB/s wr, 6 op/s 2023-05-08T10:37:29.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:28 smithi096 ceph-mon[124666]: pgmap v13276: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 196 KiB/s wr, 6 op/s 2023-05-08T10:37:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24788.133181 secs 2023-05-08T10:37:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24788.689230 secs 2023-05-08T10:37:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:29 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:37:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24788.133181 secs 2023-05-08T10:37:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24788.689230 secs 2023-05-08T10:37:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:29 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:37:30.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24788.133181 secs 2023-05-08T10:37:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24788.689230 secs 2023-05-08T10:37:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:29 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:37:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:30 smithi186 ceph-mon[126480]: pgmap v13277: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T10:37:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:37:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:37:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:37:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24789.976513 secs 2023-05-08T10:37:30.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:30 smithi133 ceph-mon[125939]: pgmap v13277: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T10:37:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:37:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:37:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:37:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24789.976513 secs 2023-05-08T10:37:31.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:30 smithi096 ceph-mon[124666]: pgmap v13277: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T10:37:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:37:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:37:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:37:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24789.976513 secs 2023-05-08T10:37:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:31 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:37:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:31 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T10:37:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:31 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T10:37:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:31 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:37:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:31 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:37:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:31 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T10:37:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:31 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T10:37:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:31 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:37:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:31 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:37:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:31 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T10:37:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:31 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T10:37:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:31 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:37:32.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:32 smithi186 ceph-mon[126480]: pgmap v13278: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:37:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:32 smithi133 ceph-mon[125939]: pgmap v13278: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:37:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:32 smithi096 ceph-mon[124666]: pgmap v13278: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:37:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24793.133305 secs 2023-05-08T10:37:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:34 smithi186 ceph-mon[126480]: pgmap v13279: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:37:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24793.689353 secs 2023-05-08T10:37:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24793.133305 secs 2023-05-08T10:37:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:34 smithi133 ceph-mon[125939]: pgmap v13279: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:37:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24793.689353 secs 2023-05-08T10:37:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24793.133305 secs 2023-05-08T10:37:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:34 smithi096 ceph-mon[124666]: pgmap v13279: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:37:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24793.689353 secs 2023-05-08T10:37:35.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24794.976634 secs 2023-05-08T10:37:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24794.976634 secs 2023-05-08T10:37:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24794.976634 secs 2023-05-08T10:37:36.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:36 smithi186 ceph-mon[126480]: pgmap v13280: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T10:37:36.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:36 smithi133 ceph-mon[125939]: pgmap v13280: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T10:37:37.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:36 smithi096 ceph-mon[124666]: pgmap v13280: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T10:37:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:38 smithi186 ceph-mon[126480]: pgmap v13281: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T10:37:38.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:38 smithi133 ceph-mon[125939]: pgmap v13281: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T10:37:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:38 smithi096 ceph-mon[124666]: pgmap v13281: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T10:37:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24798.133417 secs 2023-05-08T10:37:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24798.689487 secs 2023-05-08T10:37:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24798.133417 secs 2023-05-08T10:37:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24798.689487 secs 2023-05-08T10:37:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24798.133417 secs 2023-05-08T10:37:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24798.689487 secs 2023-05-08T10:37:40.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:40 smithi133 ceph-mon[125939]: pgmap v13282: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 90 KiB/s wr, 8 op/s 2023-05-08T10:37:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24799.976735 secs 2023-05-08T10:37:41.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:40 smithi096 ceph-mon[124666]: pgmap v13282: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 90 KiB/s wr, 8 op/s 2023-05-08T10:37:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24799.976735 secs 2023-05-08T10:37:41.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:40 smithi186 ceph-mon[126480]: pgmap v13282: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 90 KiB/s wr, 8 op/s 2023-05-08T10:37:41.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24799.976735 secs 2023-05-08T10:37:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:41 smithi133 ceph-mon[125939]: pgmap v13283: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 90 KiB/s wr, 6 op/s 2023-05-08T10:37:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:41 smithi096 ceph-mon[124666]: pgmap v13283: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 90 KiB/s wr, 6 op/s 2023-05-08T10:37:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:41 smithi186 ceph-mon[126480]: pgmap v13283: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 90 KiB/s wr, 6 op/s 2023-05-08T10:37:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24803.133532 secs 2023-05-08T10:37:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:44 smithi096 ceph-mon[124666]: pgmap v13284: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 90 KiB/s wr, 6 op/s 2023-05-08T10:37:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24803.689590 secs 2023-05-08T10:37:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24803.133532 secs 2023-05-08T10:37:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:44 smithi186 ceph-mon[126480]: pgmap v13284: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 90 KiB/s wr, 6 op/s 2023-05-08T10:37:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24803.689590 secs 2023-05-08T10:37:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24803.133532 secs 2023-05-08T10:37:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:44 smithi133 ceph-mon[125939]: pgmap v13284: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 90 KiB/s wr, 6 op/s 2023-05-08T10:37:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24803.689590 secs 2023-05-08T10:37:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:46 smithi096 ceph-mon[124666]: pgmap v13285: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 122 KiB/s wr, 9 op/s 2023-05-08T10:37:46.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:46 smithi186 ceph-mon[126480]: pgmap v13285: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 122 KiB/s wr, 9 op/s 2023-05-08T10:37:46.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:46 smithi133 ceph-mon[125939]: pgmap v13285: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 122 KiB/s wr, 9 op/s 2023-05-08T10:37:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:48 smithi096 ceph-mon[124666]: pgmap v13286: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 121 KiB/s wr, 6 op/s 2023-05-08T10:37:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:37:48.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:48 smithi186 ceph-mon[126480]: pgmap v13286: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 121 KiB/s wr, 6 op/s 2023-05-08T10:37:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:37:48.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:48 smithi133 ceph-mon[125939]: pgmap v13286: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 121 KiB/s wr, 6 op/s 2023-05-08T10:37:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:37:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24808.133646 secs 2023-05-08T10:37:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:37:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:37:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:37:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24808.689696 secs 2023-05-08T10:37:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24808.133646 secs 2023-05-08T10:37:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:37:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:37:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:37:49.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24808.689696 secs 2023-05-08T10:37:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24808.133646 secs 2023-05-08T10:37:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:37:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:37:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:37:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24808.689696 secs 2023-05-08T10:37:50.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:50 smithi096 ceph-mon[124666]: pgmap v13287: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 179 KiB/s wr, 10 op/s 2023-05-08T10:37:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:50 smithi186 ceph-mon[126480]: pgmap v13287: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 179 KiB/s wr, 10 op/s 2023-05-08T10:37:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:50 smithi133 ceph-mon[125939]: pgmap v13287: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 179 KiB/s wr, 10 op/s 2023-05-08T10:37:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:52 smithi096 ceph-mon[124666]: pgmap v13288: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 340 KiB/s rd, 90 KiB/s wr, 7 op/s 2023-05-08T10:37:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:52 smithi186 ceph-mon[126480]: pgmap v13288: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 340 KiB/s rd, 90 KiB/s wr, 7 op/s 2023-05-08T10:37:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:52 smithi133 ceph-mon[125939]: pgmap v13288: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 340 KiB/s rd, 90 KiB/s wr, 7 op/s 2023-05-08T10:37:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24813.133773 secs 2023-05-08T10:37:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:54 smithi186 ceph-mon[126480]: pgmap v13289: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 340 KiB/s rd, 90 KiB/s wr, 7 op/s 2023-05-08T10:37:54.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24813.133773 secs 2023-05-08T10:37:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:54 smithi133 ceph-mon[125939]: pgmap v13289: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 340 KiB/s rd, 90 KiB/s wr, 7 op/s 2023-05-08T10:37:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24813.133773 secs 2023-05-08T10:37:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:54 smithi096 ceph-mon[124666]: pgmap v13289: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 340 KiB/s rd, 90 KiB/s wr, 7 op/s 2023-05-08T10:37:56.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:56 smithi186 ceph-mon[126480]: pgmap v13290: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 803 KiB/s rd, 553 KiB/s wr, 11 op/s 2023-05-08T10:37:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:37:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:56 smithi133 ceph-mon[125939]: pgmap v13290: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 803 KiB/s rd, 553 KiB/s wr, 11 op/s 2023-05-08T10:37:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:37:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:56 smithi096 ceph-mon[124666]: pgmap v13290: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 803 KiB/s rd, 553 KiB/s wr, 11 op/s 2023-05-08T10:37:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:37:57.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:57 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:37:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:37:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:37:57.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:57 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:37:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:37:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:37:58.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:57 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:37:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:37:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:37:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:58 smithi186 ceph-mon[126480]: pgmap v13291: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 586 KiB/s rd, 521 KiB/s wr, 8 op/s 2023-05-08T10:37:58.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:58 smithi133 ceph-mon[125939]: pgmap v13291: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 586 KiB/s rd, 521 KiB/s wr, 8 op/s 2023-05-08T10:37:59.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:58 smithi096 ceph-mon[124666]: pgmap v13291: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 586 KiB/s rd, 521 KiB/s wr, 8 op/s 2023-05-08T10:37:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24818.133835 secs 2023-05-08T10:37:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:37:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24818.689956 secs 2023-05-08T10:37:59.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24818.133835 secs 2023-05-08T10:37:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:37:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24818.689956 secs 2023-05-08T10:38:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24818.133835 secs 2023-05-08T10:38:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:37:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24818.689956 secs 2023-05-08T10:38:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:00 smithi186 ceph-mon[126480]: pgmap v13292: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 940 KiB/s rd, 864 KiB/s wr, 14 op/s 2023-05-08T10:38:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:00 smithi133 ceph-mon[125939]: pgmap v13292: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 940 KiB/s rd, 864 KiB/s wr, 14 op/s 2023-05-08T10:38:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:00 smithi096 ceph-mon[124666]: pgmap v13292: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 940 KiB/s rd, 864 KiB/s wr, 14 op/s 2023-05-08T10:38:01.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:38:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:38:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:38:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:38:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:38:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:38:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:02 smithi186 ceph-mon[126480]: pgmap v13293: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 817 KiB/s rd, 806 KiB/s wr, 10 op/s 2023-05-08T10:38:02.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:02 smithi133 ceph-mon[125939]: pgmap v13293: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 817 KiB/s rd, 806 KiB/s wr, 10 op/s 2023-05-08T10:38:03.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:02 smithi096 ceph-mon[124666]: pgmap v13293: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 817 KiB/s rd, 806 KiB/s wr, 10 op/s 2023-05-08T10:38:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24823.133955 secs 2023-05-08T10:38:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:04 smithi186 ceph-mon[126480]: pgmap v13294: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 817 KiB/s rd, 806 KiB/s wr, 10 op/s 2023-05-08T10:38:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:04 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:38:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24823.133955 secs 2023-05-08T10:38:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:04 smithi133 ceph-mon[125939]: pgmap v13294: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 817 KiB/s rd, 806 KiB/s wr, 10 op/s 2023-05-08T10:38:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:04 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:38:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24823.133955 secs 2023-05-08T10:38:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:04 smithi096 ceph-mon[124666]: pgmap v13294: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 817 KiB/s rd, 806 KiB/s wr, 10 op/s 2023-05-08T10:38:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:04 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:38:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:06 smithi186 ceph-mon[126480]: pgmap v13295: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 939 KiB/s rd, 939 KiB/s wr, 16 op/s 2023-05-08T10:38:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:06 smithi133 ceph-mon[125939]: pgmap v13295: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 939 KiB/s rd, 939 KiB/s wr, 16 op/s 2023-05-08T10:38:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:06 smithi096 ceph-mon[124666]: pgmap v13295: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 939 KiB/s rd, 939 KiB/s wr, 16 op/s 2023-05-08T10:38:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:08 smithi186 ceph-mon[126480]: pgmap v13296: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 476 KiB/s wr, 12 op/s 2023-05-08T10:38:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:08 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:38:08.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:08 smithi133 ceph-mon[125939]: pgmap v13296: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 476 KiB/s wr, 12 op/s 2023-05-08T10:38:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:08 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:38:09.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:08 smithi096 ceph-mon[124666]: pgmap v13296: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 476 KiB/s wr, 12 op/s 2023-05-08T10:38:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:08 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:38:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24828.134068 secs 2023-05-08T10:38:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:38:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:38:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24828.690225 secs 2023-05-08T10:38:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:09 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:38:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24828.134068 secs 2023-05-08T10:38:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:38:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:38:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24828.690225 secs 2023-05-08T10:38:09.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:09 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:38:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24828.134068 secs 2023-05-08T10:38:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:38:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:38:10.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24828.690225 secs 2023-05-08T10:38:10.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:09 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:38:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:10 smithi186 ceph-mon[126480]: pgmap v13297: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 658 KiB/s rd, 682 KiB/s wr, 30 op/s 2023-05-08T10:38:10.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:10 smithi133 ceph-mon[125939]: pgmap v13297: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 658 KiB/s rd, 682 KiB/s wr, 30 op/s 2023-05-08T10:38:11.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:10 smithi096 ceph-mon[124666]: pgmap v13297: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 658 KiB/s rd, 682 KiB/s wr, 30 op/s 2023-05-08T10:38:11.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24829.977466 secs 2023-05-08T10:38:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:11 smithi186 ceph-mon[126480]: osdmap e908: 12 total, 12 up, 12 in 2023-05-08T10:38:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24829.977466 secs 2023-05-08T10:38:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:11 smithi133 ceph-mon[125939]: osdmap e908: 12 total, 12 up, 12 in 2023-05-08T10:38:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24829.977466 secs 2023-05-08T10:38:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:11 smithi096 ceph-mon[124666]: osdmap e908: 12 total, 12 up, 12 in 2023-05-08T10:38:12.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:12 smithi186 ceph-mon[126480]: pgmap v13299: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 407 KiB/s wr, 29 op/s 2023-05-08T10:38:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:12 smithi133 ceph-mon[125939]: pgmap v13299: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 407 KiB/s wr, 29 op/s 2023-05-08T10:38:13.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:12 smithi096 ceph-mon[124666]: pgmap v13299: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 407 KiB/s wr, 29 op/s 2023-05-08T10:38:13.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:38:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:38:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:13 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:38:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:38:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:38:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:13 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:38:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:38:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:38:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:13 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:38:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24833.134190 secs 2023-05-08T10:38:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:14 smithi186 ceph-mon[126480]: pgmap v13300: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 407 KiB/s wr, 29 op/s 2023-05-08T10:38:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24833.690358 secs 2023-05-08T10:38:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:14 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:38:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24833.134190 secs 2023-05-08T10:38:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:14 smithi133 ceph-mon[125939]: pgmap v13300: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 407 KiB/s wr, 29 op/s 2023-05-08T10:38:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24833.690358 secs 2023-05-08T10:38:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:14 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:38:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24833.134190 secs 2023-05-08T10:38:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:14 smithi096 ceph-mon[124666]: pgmap v13300: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 407 KiB/s wr, 29 op/s 2023-05-08T10:38:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24833.690358 secs 2023-05-08T10:38:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:14 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:38:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24834.977583 secs 2023-05-08T10:38:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24834.977583 secs 2023-05-08T10:38:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24834.977583 secs 2023-05-08T10:38:16.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:16 smithi186 ceph-mon[126480]: pgmap v13301: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 481 KiB/s wr, 28 op/s 2023-05-08T10:38:16.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:16 smithi133 ceph-mon[125939]: pgmap v13301: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 481 KiB/s wr, 28 op/s 2023-05-08T10:38:17.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:16 smithi096 ceph-mon[124666]: pgmap v13301: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 481 KiB/s wr, 28 op/s 2023-05-08T10:38:18.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:18 smithi186 ceph-mon[126480]: pgmap v13302: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 481 KiB/s wr, 28 op/s 2023-05-08T10:38:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:18 smithi133 ceph-mon[125939]: pgmap v13302: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 481 KiB/s wr, 28 op/s 2023-05-08T10:38:19.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:18 smithi096 ceph-mon[124666]: pgmap v13302: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 481 KiB/s wr, 28 op/s 2023-05-08T10:38:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24838.134325 secs 2023-05-08T10:38:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24838.690524 secs 2023-05-08T10:38:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:19 smithi186 ceph-mon[126480]: osdmap e909: 12 total, 12 up, 12 in 2023-05-08T10:38:19.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24838.134325 secs 2023-05-08T10:38:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24838.690524 secs 2023-05-08T10:38:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:19 smithi133 ceph-mon[125939]: osdmap e909: 12 total, 12 up, 12 in 2023-05-08T10:38:20.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24838.134325 secs 2023-05-08T10:38:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24838.690524 secs 2023-05-08T10:38:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:19 smithi096 ceph-mon[124666]: osdmap e909: 12 total, 12 up, 12 in 2023-05-08T10:38:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:20 smithi186 ceph-mon[126480]: pgmap v13304: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 355 KiB/s wr, 11 op/s 2023-05-08T10:38:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24839.977704 secs 2023-05-08T10:38:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:20 smithi133 ceph-mon[125939]: pgmap v13304: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 355 KiB/s wr, 11 op/s 2023-05-08T10:38:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24839.977704 secs 2023-05-08T10:38:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:20 smithi096 ceph-mon[124666]: pgmap v13304: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 355 KiB/s wr, 11 op/s 2023-05-08T10:38:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24839.977704 secs 2023-05-08T10:38:22.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:22 smithi186 ceph-mon[126480]: pgmap v13305: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 316 KiB/s wr, 9 op/s 2023-05-08T10:38:22.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:22 smithi133 ceph-mon[125939]: pgmap v13305: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 316 KiB/s wr, 9 op/s 2023-05-08T10:38:23.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:22 smithi096 ceph-mon[124666]: pgmap v13305: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 316 KiB/s wr, 9 op/s 2023-05-08T10:38:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24843.134441 secs 2023-05-08T10:38:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:24 smithi186 ceph-mon[126480]: pgmap v13306: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 316 KiB/s wr, 9 op/s 2023-05-08T10:38:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24843.690651 secs 2023-05-08T10:38:24.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24843.134441 secs 2023-05-08T10:38:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:24 smithi133 ceph-mon[125939]: pgmap v13306: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 316 KiB/s wr, 9 op/s 2023-05-08T10:38:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24843.690651 secs 2023-05-08T10:38:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24843.134441 secs 2023-05-08T10:38:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:24 smithi096 ceph-mon[124666]: pgmap v13306: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 316 KiB/s wr, 9 op/s 2023-05-08T10:38:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24843.690651 secs 2023-05-08T10:38:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24844.977844 secs 2023-05-08T10:38:25.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24844.977844 secs 2023-05-08T10:38:26.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24844.977844 secs 2023-05-08T10:38:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:26 smithi186 ceph-mon[126480]: pgmap v13307: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 83 KiB/s wr, 7 op/s 2023-05-08T10:38:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:26 smithi133 ceph-mon[125939]: pgmap v13307: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 83 KiB/s wr, 7 op/s 2023-05-08T10:38:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:26 smithi096 ceph-mon[124666]: pgmap v13307: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 83 KiB/s wr, 7 op/s 2023-05-08T10:38:28.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:28 smithi186 ceph-mon[126480]: pgmap v13308: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 83 KiB/s wr, 7 op/s 2023-05-08T10:38:28.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:28 smithi133 ceph-mon[125939]: pgmap v13308: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 83 KiB/s wr, 7 op/s 2023-05-08T10:38:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:28 smithi096 ceph-mon[124666]: pgmap v13308: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 83 KiB/s wr, 7 op/s 2023-05-08T10:38:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24848.134537 secs 2023-05-08T10:38:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24848.690731 secs 2023-05-08T10:38:29.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24848.134537 secs 2023-05-08T10:38:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24848.690731 secs 2023-05-08T10:38:30.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24848.134537 secs 2023-05-08T10:38:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24848.690731 secs 2023-05-08T10:38:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:30 smithi186 ceph-mon[126480]: pgmap v13309: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T10:38:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:38:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24849.977918 secs 2023-05-08T10:38:30.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:30 smithi133 ceph-mon[125939]: pgmap v13309: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T10:38:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:38:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24849.977918 secs 2023-05-08T10:38:31.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:30 smithi096 ceph-mon[124666]: pgmap v13309: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T10:38:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:38:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24849.977918 secs 2023-05-08T10:38:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:31 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:38:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:31 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:38:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:31 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:38:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:31 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:38:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:31 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:38:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:31 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:38:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:31 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:38:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:31 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:38:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:31 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:38:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:31 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:38:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:31 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:38:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:31 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:38:32.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:32 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T10:38:32.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:32 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T10:38:32.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:32 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:38:32.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:32 smithi186 ceph-mon[126480]: pgmap v13310: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:38:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:32 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T10:38:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:32 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T10:38:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:32 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:38:32.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:32 smithi133 ceph-mon[125939]: pgmap v13310: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:38:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:32 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T10:38:33.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:32 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T10:38:33.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:32 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:38:33.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:32 smithi096 ceph-mon[124666]: pgmap v13310: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:38:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24853.134662 secs 2023-05-08T10:38:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:34 smithi186 ceph-mon[126480]: pgmap v13311: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:38:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24853.690853 secs 2023-05-08T10:38:34.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24853.134662 secs 2023-05-08T10:38:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:34 smithi133 ceph-mon[125939]: pgmap v13311: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:38:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24853.690853 secs 2023-05-08T10:38:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24853.134662 secs 2023-05-08T10:38:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:34 smithi096 ceph-mon[124666]: pgmap v13311: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:38:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24853.690853 secs 2023-05-08T10:38:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24854.978035 secs 2023-05-08T10:38:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24854.978035 secs 2023-05-08T10:38:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24854.978035 secs 2023-05-08T10:38:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:36 smithi133 ceph-mon[125939]: pgmap v13312: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 26 KiB/s wr, 8 op/s 2023-05-08T10:38:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:36 smithi096 ceph-mon[124666]: pgmap v13312: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 26 KiB/s wr, 8 op/s 2023-05-08T10:38:37.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:36 smithi186 ceph-mon[126480]: pgmap v13312: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 26 KiB/s wr, 8 op/s 2023-05-08T10:38:38.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:38 smithi133 ceph-mon[125939]: pgmap v13313: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 26 KiB/s wr, 5 op/s 2023-05-08T10:38:39.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:38 smithi096 ceph-mon[124666]: pgmap v13313: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 26 KiB/s wr, 5 op/s 2023-05-08T10:38:39.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:38 smithi186 ceph-mon[126480]: pgmap v13313: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 26 KiB/s wr, 5 op/s 2023-05-08T10:38:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24858.134782 secs 2023-05-08T10:38:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24858.690973 secs 2023-05-08T10:38:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:39 smithi133 ceph-mon[125939]: pgmap v13314: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 268 KiB/s wr, 9 op/s 2023-05-08T10:38:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24858.134782 secs 2023-05-08T10:38:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24858.690973 secs 2023-05-08T10:38:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:39 smithi096 ceph-mon[124666]: pgmap v13314: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 268 KiB/s wr, 9 op/s 2023-05-08T10:38:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24858.134782 secs 2023-05-08T10:38:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24858.690973 secs 2023-05-08T10:38:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:39 smithi186 ceph-mon[126480]: pgmap v13314: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 268 KiB/s wr, 9 op/s 2023-05-08T10:38:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24859.978161 secs 2023-05-08T10:38:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24859.978161 secs 2023-05-08T10:38:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24859.978161 secs 2023-05-08T10:38:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:42 smithi133 ceph-mon[125939]: pgmap v13315: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 268 KiB/s wr, 7 op/s 2023-05-08T10:38:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:42 smithi096 ceph-mon[124666]: pgmap v13315: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 268 KiB/s wr, 7 op/s 2023-05-08T10:38:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:42 smithi186 ceph-mon[126480]: pgmap v13315: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 268 KiB/s wr, 7 op/s 2023-05-08T10:38:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24863.134908 secs 2023-05-08T10:38:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:44 smithi186 ceph-mon[126480]: pgmap v13316: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 268 KiB/s wr, 7 op/s 2023-05-08T10:38:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24863.691110 secs 2023-05-08T10:38:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24863.134908 secs 2023-05-08T10:38:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:44 smithi133 ceph-mon[125939]: pgmap v13316: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 268 KiB/s wr, 7 op/s 2023-05-08T10:38:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24863.691110 secs 2023-05-08T10:38:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24863.134908 secs 2023-05-08T10:38:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:44 smithi096 ceph-mon[124666]: pgmap v13316: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 268 KiB/s wr, 7 op/s 2023-05-08T10:38:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24863.691110 secs 2023-05-08T10:38:46.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:46 smithi186 ceph-mon[126480]: pgmap v13317: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 268 KiB/s wr, 11 op/s 2023-05-08T10:38:46.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:46 smithi133 ceph-mon[125939]: pgmap v13317: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 268 KiB/s wr, 11 op/s 2023-05-08T10:38:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:46 smithi096 ceph-mon[124666]: pgmap v13317: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 268 KiB/s wr, 11 op/s 2023-05-08T10:38:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:48 smithi186 ceph-mon[126480]: pgmap v13318: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 242 KiB/s wr, 7 op/s 2023-05-08T10:38:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:38:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:48 smithi133 ceph-mon[125939]: pgmap v13318: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 242 KiB/s wr, 7 op/s 2023-05-08T10:38:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:38:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:48 smithi096 ceph-mon[124666]: pgmap v13318: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 242 KiB/s wr, 7 op/s 2023-05-08T10:38:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:38:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24868.135048 secs 2023-05-08T10:38:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:38:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:38:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:38:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24868.691249 secs 2023-05-08T10:38:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24868.135048 secs 2023-05-08T10:38:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:38:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:38:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:38:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24868.691249 secs 2023-05-08T10:38:50.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24868.135048 secs 2023-05-08T10:38:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:38:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:38:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:38:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24868.691249 secs 2023-05-08T10:38:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:50 smithi186 ceph-mon[126480]: pgmap v13319: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 343 KiB/s wr, 11 op/s 2023-05-08T10:38:50.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:50 smithi133 ceph-mon[125939]: pgmap v13319: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 343 KiB/s wr, 11 op/s 2023-05-08T10:38:51.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:50 smithi096 ceph-mon[124666]: pgmap v13319: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 343 KiB/s wr, 11 op/s 2023-05-08T10:38:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:52 smithi186 ceph-mon[126480]: pgmap v13320: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 101 KiB/s wr, 7 op/s 2023-05-08T10:38:52.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:52 smithi133 ceph-mon[125939]: pgmap v13320: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 101 KiB/s wr, 7 op/s 2023-05-08T10:38:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:52 smithi096 ceph-mon[124666]: pgmap v13320: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 101 KiB/s wr, 7 op/s 2023-05-08T10:38:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24873.135186 secs 2023-05-08T10:38:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:54 smithi186 ceph-mon[126480]: pgmap v13321: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 101 KiB/s wr, 7 op/s 2023-05-08T10:38:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24873.135186 secs 2023-05-08T10:38:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:54 smithi133 ceph-mon[125939]: pgmap v13321: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 101 KiB/s wr, 7 op/s 2023-05-08T10:38:55.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24873.135186 secs 2023-05-08T10:38:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:54 smithi096 ceph-mon[124666]: pgmap v13321: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 101 KiB/s wr, 7 op/s 2023-05-08T10:38:56.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:56 smithi186 ceph-mon[126480]: pgmap v13322: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 385 KiB/s wr, 11 op/s 2023-05-08T10:38:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:38:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:56 smithi133 ceph-mon[125939]: pgmap v13322: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 385 KiB/s wr, 11 op/s 2023-05-08T10:38:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:38:57.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:56 smithi096 ceph-mon[124666]: pgmap v13322: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 385 KiB/s wr, 11 op/s 2023-05-08T10:38:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:38:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:57 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:38:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:38:57.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:38:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:57 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:38:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:38:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:38:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:57 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:38:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:38:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:38:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:58 smithi186 ceph-mon[126480]: pgmap v13323: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 430 KiB/s rd, 384 KiB/s wr, 8 op/s 2023-05-08T10:38:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:58 smithi133 ceph-mon[125939]: pgmap v13323: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 430 KiB/s rd, 384 KiB/s wr, 8 op/s 2023-05-08T10:38:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:58 smithi096 ceph-mon[124666]: pgmap v13323: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 430 KiB/s rd, 384 KiB/s wr, 8 op/s 2023-05-08T10:38:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24878.135290 secs 2023-05-08T10:38:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:38:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24878.691496 secs 2023-05-08T10:38:59.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24878.135290 secs 2023-05-08T10:38:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:38:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24878.691496 secs 2023-05-08T10:39:00.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24878.135290 secs 2023-05-08T10:39:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:38:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24878.691496 secs 2023-05-08T10:39:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:00 smithi186 ceph-mon[126480]: pgmap v13324: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 795 KiB/s rd, 732 KiB/s wr, 14 op/s 2023-05-08T10:39:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:00 smithi133 ceph-mon[125939]: pgmap v13324: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 795 KiB/s rd, 732 KiB/s wr, 14 op/s 2023-05-08T10:39:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:00 smithi096 ceph-mon[124666]: pgmap v13324: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 795 KiB/s rd, 732 KiB/s wr, 14 op/s 2023-05-08T10:39:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:39:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:39:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:39:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:39:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:39:02.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:39:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:02 smithi186 ceph-mon[126480]: pgmap v13325: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 662 KiB/s rd, 631 KiB/s wr, 11 op/s 2023-05-08T10:39:02.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:02 smithi133 ceph-mon[125939]: pgmap v13325: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 662 KiB/s rd, 631 KiB/s wr, 11 op/s 2023-05-08T10:39:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:02 smithi096 ceph-mon[124666]: pgmap v13325: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 662 KiB/s rd, 631 KiB/s wr, 11 op/s 2023-05-08T10:39:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24883.135416 secs 2023-05-08T10:39:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:04 smithi186 ceph-mon[126480]: pgmap v13326: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 662 KiB/s rd, 631 KiB/s wr, 11 op/s 2023-05-08T10:39:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:04 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:39:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24883.135416 secs 2023-05-08T10:39:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:04 smithi133 ceph-mon[125939]: pgmap v13326: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 662 KiB/s rd, 631 KiB/s wr, 11 op/s 2023-05-08T10:39:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:04 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:39:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24883.135416 secs 2023-05-08T10:39:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:04 smithi096 ceph-mon[124666]: pgmap v13326: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 662 KiB/s rd, 631 KiB/s wr, 11 op/s 2023-05-08T10:39:05.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:04 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:39:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:06 smithi186 ceph-mon[126480]: pgmap v13327: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 881 KiB/s rd, 860 KiB/s wr, 18 op/s 2023-05-08T10:39:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:06 smithi133 ceph-mon[125939]: pgmap v13327: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 881 KiB/s rd, 860 KiB/s wr, 18 op/s 2023-05-08T10:39:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:06 smithi096 ceph-mon[124666]: pgmap v13327: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 881 KiB/s rd, 860 KiB/s wr, 18 op/s 2023-05-08T10:39:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:08 smithi186 ceph-mon[126480]: pgmap v13328: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 583 KiB/s rd, 577 KiB/s wr, 14 op/s 2023-05-08T10:39:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:08 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:39:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:08 smithi133 ceph-mon[125939]: pgmap v13328: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 583 KiB/s rd, 577 KiB/s wr, 14 op/s 2023-05-08T10:39:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:08 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:39:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:08 smithi096 ceph-mon[124666]: pgmap v13328: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 583 KiB/s rd, 577 KiB/s wr, 14 op/s 2023-05-08T10:39:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:08 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:39:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24888.135507 secs 2023-05-08T10:39:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:39:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:39:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24888.691727 secs 2023-05-08T10:39:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:09 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:39:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24888.135507 secs 2023-05-08T10:39:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:39:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:39:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24888.691727 secs 2023-05-08T10:39:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:09 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:39:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24888.135507 secs 2023-05-08T10:39:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:39:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:39:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24888.691727 secs 2023-05-08T10:39:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:09 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:39:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:10 smithi186 ceph-mon[126480]: pgmap v13329: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 766 KiB/s rd, 782 KiB/s wr, 32 op/s 2023-05-08T10:39:10.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:10 smithi133 ceph-mon[125939]: pgmap v13329: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 766 KiB/s rd, 782 KiB/s wr, 32 op/s 2023-05-08T10:39:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:10 smithi096 ceph-mon[124666]: pgmap v13329: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 766 KiB/s rd, 782 KiB/s wr, 32 op/s 2023-05-08T10:39:11.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24889.978825 secs 2023-05-08T10:39:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:11 smithi186 ceph-mon[126480]: osdmap e910: 12 total, 12 up, 12 in 2023-05-08T10:39:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24889.978825 secs 2023-05-08T10:39:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:11 smithi133 ceph-mon[125939]: osdmap e910: 12 total, 12 up, 12 in 2023-05-08T10:39:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24889.978825 secs 2023-05-08T10:39:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:11 smithi096 ceph-mon[124666]: osdmap e910: 12 total, 12 up, 12 in 2023-05-08T10:39:12.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:12 smithi186 ceph-mon[126480]: pgmap v13331: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 482 KiB/s rd, 522 KiB/s wr, 30 op/s 2023-05-08T10:39:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:12 smithi133 ceph-mon[125939]: pgmap v13331: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 482 KiB/s rd, 522 KiB/s wr, 30 op/s 2023-05-08T10:39:13.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:12 smithi096 ceph-mon[124666]: pgmap v13331: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 482 KiB/s rd, 522 KiB/s wr, 30 op/s 2023-05-08T10:39:13.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:39:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:39:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:13 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:39:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:39:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:39:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:13 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:39:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:39:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:39:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:13 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:39:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24893.135638 secs 2023-05-08T10:39:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:14 smithi186 ceph-mon[126480]: pgmap v13332: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 482 KiB/s rd, 522 KiB/s wr, 30 op/s 2023-05-08T10:39:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24893.691851 secs 2023-05-08T10:39:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:14 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:39:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24893.135638 secs 2023-05-08T10:39:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:14 smithi133 ceph-mon[125939]: pgmap v13332: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 482 KiB/s rd, 522 KiB/s wr, 30 op/s 2023-05-08T10:39:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24893.691851 secs 2023-05-08T10:39:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:14 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:39:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24893.135638 secs 2023-05-08T10:39:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:14 smithi096 ceph-mon[124666]: pgmap v13332: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 482 KiB/s rd, 522 KiB/s wr, 30 op/s 2023-05-08T10:39:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24893.691851 secs 2023-05-08T10:39:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:14 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:39:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24894.978944 secs 2023-05-08T10:39:16.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24894.978944 secs 2023-05-08T10:39:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24894.978944 secs 2023-05-08T10:39:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:16 smithi133 ceph-mon[125939]: pgmap v13333: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 364 KiB/s wr, 27 op/s 2023-05-08T10:39:17.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:16 smithi096 ceph-mon[124666]: pgmap v13333: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 364 KiB/s wr, 27 op/s 2023-05-08T10:39:17.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:16 smithi186 ceph-mon[126480]: pgmap v13333: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 364 KiB/s wr, 27 op/s 2023-05-08T10:39:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:18 smithi133 ceph-mon[125939]: pgmap v13334: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 364 KiB/s wr, 27 op/s 2023-05-08T10:39:19.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:18 smithi096 ceph-mon[124666]: pgmap v13334: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 364 KiB/s wr, 27 op/s 2023-05-08T10:39:19.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:18 smithi186 ceph-mon[126480]: pgmap v13334: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 364 KiB/s wr, 27 op/s 2023-05-08T10:39:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24898.135755 secs 2023-05-08T10:39:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24898.691973 secs 2023-05-08T10:39:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:19 smithi133 ceph-mon[125939]: osdmap e911: 12 total, 12 up, 12 in 2023-05-08T10:39:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24898.135755 secs 2023-05-08T10:39:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24898.691973 secs 2023-05-08T10:39:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:19 smithi096 ceph-mon[124666]: osdmap e911: 12 total, 12 up, 12 in 2023-05-08T10:39:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24898.135755 secs 2023-05-08T10:39:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24898.691973 secs 2023-05-08T10:39:20.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:19 smithi186 ceph-mon[126480]: osdmap e911: 12 total, 12 up, 12 in 2023-05-08T10:39:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:20 smithi133 ceph-mon[125939]: pgmap v13336: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 355 KiB/s wr, 10 op/s 2023-05-08T10:39:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24899.979135 secs 2023-05-08T10:39:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:20 smithi096 ceph-mon[124666]: pgmap v13336: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 355 KiB/s wr, 10 op/s 2023-05-08T10:39:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24899.979135 secs 2023-05-08T10:39:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:20 smithi186 ceph-mon[126480]: pgmap v13336: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 355 KiB/s wr, 10 op/s 2023-05-08T10:39:21.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24899.979135 secs 2023-05-08T10:39:22.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:22 smithi133 ceph-mon[125939]: pgmap v13337: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 315 KiB/s wr, 9 op/s 2023-05-08T10:39:23.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:22 smithi096 ceph-mon[124666]: pgmap v13337: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 315 KiB/s wr, 9 op/s 2023-05-08T10:39:23.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:22 smithi186 ceph-mon[126480]: pgmap v13337: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 315 KiB/s wr, 9 op/s 2023-05-08T10:39:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:23 smithi133 ceph-mon[125939]: pgmap v13338: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 315 KiB/s wr, 9 op/s 2023-05-08T10:39:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:23 smithi096 ceph-mon[124666]: pgmap v13338: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 315 KiB/s wr, 9 op/s 2023-05-08T10:39:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:23 smithi186 ceph-mon[126480]: pgmap v13338: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 315 KiB/s wr, 9 op/s 2023-05-08T10:39:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24903.135876 secs 2023-05-08T10:39:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24903.692091 secs 2023-05-08T10:39:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24903.135876 secs 2023-05-08T10:39:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24903.692091 secs 2023-05-08T10:39:25.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24903.135876 secs 2023-05-08T10:39:25.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24903.692091 secs 2023-05-08T10:39:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24904.979252 secs 2023-05-08T10:39:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:25 smithi133 ceph-mon[125939]: pgmap v13339: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 197 KiB/s wr, 7 op/s 2023-05-08T10:39:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24904.979252 secs 2023-05-08T10:39:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:25 smithi096 ceph-mon[124666]: pgmap v13339: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 197 KiB/s wr, 7 op/s 2023-05-08T10:39:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24904.979252 secs 2023-05-08T10:39:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:25 smithi186 ceph-mon[126480]: pgmap v13339: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 197 KiB/s wr, 7 op/s 2023-05-08T10:39:28.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:28 smithi186 ceph-mon[126480]: pgmap v13340: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 197 KiB/s wr, 7 op/s 2023-05-08T10:39:28.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:28 smithi133 ceph-mon[125939]: pgmap v13340: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 197 KiB/s wr, 7 op/s 2023-05-08T10:39:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:28 smithi096 ceph-mon[124666]: pgmap v13340: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 197 KiB/s wr, 7 op/s 2023-05-08T10:39:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24908.135994 secs 2023-05-08T10:39:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24908.692183 secs 2023-05-08T10:39:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24908.135994 secs 2023-05-08T10:39:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24908.692183 secs 2023-05-08T10:39:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24908.135994 secs 2023-05-08T10:39:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24908.692183 secs 2023-05-08T10:39:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:30 smithi186 ceph-mon[126480]: pgmap v13341: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T10:39:30.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:30 smithi133 ceph-mon[125939]: pgmap v13341: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T10:39:31.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:30 smithi096 ceph-mon[124666]: pgmap v13341: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T10:39:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24909.979406 secs 2023-05-08T10:39:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:31 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:39:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:31 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:39:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:31 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:39:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:31 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:39:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24909.979406 secs 2023-05-08T10:39:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:31 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:39:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:31 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:39:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:31 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:39:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:31 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:39:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24909.979406 secs 2023-05-08T10:39:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:31 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:39:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:31 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:39:32.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:31 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:39:32.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:31 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:39:32.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:32 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:39:32.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:32 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T10:39:32.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:32 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T10:39:32.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:32 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:39:32.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:32 smithi186 ceph-mon[126480]: pgmap v13342: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:39:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:32 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:39:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:32 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T10:39:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:32 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T10:39:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:32 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:39:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:32 smithi133 ceph-mon[125939]: pgmap v13342: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:39:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:32 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:39:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:32 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T10:39:33.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:32 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T10:39:33.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:32 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:39:33.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:32 smithi096 ceph-mon[124666]: pgmap v13342: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:39:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24913.136150 secs 2023-05-08T10:39:34.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:34 smithi186 ceph-mon[126480]: pgmap v13343: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:39:34.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24913.692322 secs 2023-05-08T10:39:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24913.136150 secs 2023-05-08T10:39:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:34 smithi133 ceph-mon[125939]: pgmap v13343: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:39:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24913.692322 secs 2023-05-08T10:39:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24913.136150 secs 2023-05-08T10:39:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:34 smithi096 ceph-mon[124666]: pgmap v13343: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:39:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24913.692322 secs 2023-05-08T10:39:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24914.979526 secs 2023-05-08T10:39:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:36 smithi186 ceph-mon[126480]: pgmap v13344: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T10:39:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24914.979526 secs 2023-05-08T10:39:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:36 smithi133 ceph-mon[125939]: pgmap v13344: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T10:39:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24914.979526 secs 2023-05-08T10:39:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:36 smithi096 ceph-mon[124666]: pgmap v13344: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T10:39:38.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:38 smithi186 ceph-mon[126480]: pgmap v13345: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T10:39:38.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:38 smithi133 ceph-mon[125939]: pgmap v13345: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T10:39:39.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:38 smithi096 ceph-mon[124666]: pgmap v13345: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T10:39:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24918.136273 secs 2023-05-08T10:39:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24918.692440 secs 2023-05-08T10:39:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24918.136273 secs 2023-05-08T10:39:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24918.692440 secs 2023-05-08T10:39:40.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24918.136273 secs 2023-05-08T10:39:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24918.692440 secs 2023-05-08T10:39:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:40 smithi186 ceph-mon[126480]: pgmap v13346: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 90 KiB/s wr, 8 op/s 2023-05-08T10:39:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:40 smithi133 ceph-mon[125939]: pgmap v13346: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 90 KiB/s wr, 8 op/s 2023-05-08T10:39:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:40 smithi096 ceph-mon[124666]: pgmap v13346: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 90 KiB/s wr, 8 op/s 2023-05-08T10:39:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24919.979657 secs 2023-05-08T10:39:41.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24919.979657 secs 2023-05-08T10:39:42.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24919.979657 secs 2023-05-08T10:39:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:42 smithi186 ceph-mon[126480]: pgmap v13347: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 90 KiB/s wr, 6 op/s 2023-05-08T10:39:42.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:42 smithi133 ceph-mon[125939]: pgmap v13347: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 90 KiB/s wr, 6 op/s 2023-05-08T10:39:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:42 smithi096 ceph-mon[124666]: pgmap v13347: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 90 KiB/s wr, 6 op/s 2023-05-08T10:39:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:44 smithi186 ceph-mon[126480]: pgmap v13348: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 90 KiB/s wr, 6 op/s 2023-05-08T10:39:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24923.692559 secs 2023-05-08T10:39:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:44 smithi133 ceph-mon[125939]: pgmap v13348: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 90 KiB/s wr, 6 op/s 2023-05-08T10:39:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24923.692559 secs 2023-05-08T10:39:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:44 smithi096 ceph-mon[124666]: pgmap v13348: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 90 KiB/s wr, 6 op/s 2023-05-08T10:39:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24923.692559 secs 2023-05-08T10:39:46.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:46 smithi186 ceph-mon[126480]: pgmap v13349: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 420 KiB/s rd, 172 KiB/s wr, 10 op/s 2023-05-08T10:39:46.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:46 smithi133 ceph-mon[125939]: pgmap v13349: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 420 KiB/s rd, 172 KiB/s wr, 10 op/s 2023-05-08T10:39:47.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:46 smithi096 ceph-mon[124666]: pgmap v13349: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 420 KiB/s rd, 172 KiB/s wr, 10 op/s 2023-05-08T10:39:47.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:39:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:39:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:39:48.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:48 smithi186 ceph-mon[126480]: pgmap v13350: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 172 KiB/s wr, 6 op/s 2023-05-08T10:39:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:48 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:39:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T10:39:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:39:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:39:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:48 smithi133 ceph-mon[125939]: pgmap v13350: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 172 KiB/s wr, 6 op/s 2023-05-08T10:39:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:48 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:39:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T10:39:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:39:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:39:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:48 smithi096 ceph-mon[124666]: pgmap v13350: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 172 KiB/s wr, 6 op/s 2023-05-08T10:39:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:48 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:39:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T10:39:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:39:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:39:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:39:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:39:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24928.692678 secs 2023-05-08T10:39:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:39:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:39:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24928.692678 secs 2023-05-08T10:39:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:39:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:39:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24928.692678 secs 2023-05-08T10:39:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:50 smithi186 ceph-mon[126480]: pgmap v13351: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 592 KiB/s rd, 181 KiB/s wr, 10 op/s 2023-05-08T10:39:50.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:50 smithi133 ceph-mon[125939]: pgmap v13351: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 592 KiB/s rd, 181 KiB/s wr, 10 op/s 2023-05-08T10:39:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:50 smithi096 ceph-mon[124666]: pgmap v13351: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 592 KiB/s rd, 181 KiB/s wr, 10 op/s 2023-05-08T10:39:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:52 smithi186 ceph-mon[126480]: pgmap v13352: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 91 KiB/s wr, 7 op/s 2023-05-08T10:39:52.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:52 smithi133 ceph-mon[125939]: pgmap v13352: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 91 KiB/s wr, 7 op/s 2023-05-08T10:39:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:52 smithi096 ceph-mon[124666]: pgmap v13352: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 91 KiB/s wr, 7 op/s 2023-05-08T10:39:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24933.136589 secs 2023-05-08T10:39:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:54 smithi186 ceph-mon[126480]: pgmap v13353: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 91 KiB/s wr, 7 op/s 2023-05-08T10:39:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:54 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:39:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24933.136589 secs 2023-05-08T10:39:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:54 smithi133 ceph-mon[125939]: pgmap v13353: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 91 KiB/s wr, 7 op/s 2023-05-08T10:39:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:54 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:39:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24933.136589 secs 2023-05-08T10:39:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:54 smithi096 ceph-mon[124666]: pgmap v13353: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 91 KiB/s wr, 7 op/s 2023-05-08T10:39:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:54 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:39:56.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:56 smithi186 ceph-mon[126480]: pgmap v13354: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 789 KiB/s rd, 378 KiB/s wr, 11 op/s 2023-05-08T10:39:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T10:39:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:39:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:39:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:56 smithi133 ceph-mon[125939]: pgmap v13354: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 789 KiB/s rd, 378 KiB/s wr, 11 op/s 2023-05-08T10:39:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T10:39:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:39:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:39:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:56 smithi096 ceph-mon[124666]: pgmap v13354: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 789 KiB/s rd, 378 KiB/s wr, 11 op/s 2023-05-08T10:39:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T10:39:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:39:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:39:57.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:39:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:39:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:39:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:39:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:39:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:39:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:58 smithi186 ceph-mon[126480]: pgmap v13355: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 296 KiB/s wr, 7 op/s 2023-05-08T10:39:58.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:58 smithi133 ceph-mon[125939]: pgmap v13355: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 296 KiB/s wr, 7 op/s 2023-05-08T10:39:59.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:58 smithi096 ceph-mon[124666]: pgmap v13355: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 296 KiB/s wr, 7 op/s 2023-05-08T10:39:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24938.136712 secs 2023-05-08T10:39:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:39:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24938.692935 secs 2023-05-08T10:39:59.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24938.136712 secs 2023-05-08T10:39:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:39:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24938.692935 secs 2023-05-08T10:40:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24938.136712 secs 2023-05-08T10:40:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:39:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24938.692935 secs 2023-05-08T10:40:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:00 smithi133 ceph-mon[125939]: pgmap v13356: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 819 KiB/s rd, 642 KiB/s wr, 13 op/s 2023-05-08T10:40:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:00 smithi133 ceph-mon[125939]: Health detail: HEALTH_WARN 1 MDSs report slow requests 2023-05-08T10:40:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:00 smithi133 ceph-mon[125939]: [WRN] MDS_SLOW_REQUEST: 1 MDSs report slow requests 2023-05-08T10:40:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:00 smithi133 ceph-mon[125939]: mds.i(mds.1): 1 slow requests are blocked > 180 secs 2023-05-08T10:40:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:00 smithi096 ceph-mon[124666]: pgmap v13356: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 819 KiB/s rd, 642 KiB/s wr, 13 op/s 2023-05-08T10:40:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:00 smithi096 ceph-mon[124666]: Health detail: HEALTH_WARN 1 MDSs report slow requests 2023-05-08T10:40:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:00 smithi096 ceph-mon[124666]: [WRN] MDS_SLOW_REQUEST: 1 MDSs report slow requests 2023-05-08T10:40:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:00 smithi096 ceph-mon[124666]: mds.i(mds.1): 1 slow requests are blocked > 180 secs 2023-05-08T10:40:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:00 smithi186 ceph-mon[126480]: pgmap v13356: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 819 KiB/s rd, 642 KiB/s wr, 13 op/s 2023-05-08T10:40:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:00 smithi186 ceph-mon[126480]: Health detail: HEALTH_WARN 1 MDSs report slow requests 2023-05-08T10:40:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:00 smithi186 ceph-mon[126480]: [WRN] MDS_SLOW_REQUEST: 1 MDSs report slow requests 2023-05-08T10:40:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:00 smithi186 ceph-mon[126480]: mds.i(mds.1): 1 slow requests are blocked > 180 secs 2023-05-08T10:40:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:01 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:40:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:40:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:40:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:01 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:40:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:40:02.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:40:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:01 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:40:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:40:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:40:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:02 smithi133 ceph-mon[125939]: pgmap v13357: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 646 KiB/s rd, 759 KiB/s wr, 10 op/s 2023-05-08T10:40:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:02 smithi096 ceph-mon[124666]: pgmap v13357: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 646 KiB/s rd, 759 KiB/s wr, 10 op/s 2023-05-08T10:40:03.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:02 smithi186 ceph-mon[126480]: pgmap v13357: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 646 KiB/s rd, 759 KiB/s wr, 10 op/s 2023-05-08T10:40:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24943.136797 secs 2023-05-08T10:40:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:04 smithi133 ceph-mon[125939]: pgmap v13358: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 646 KiB/s rd, 759 KiB/s wr, 10 op/s 2023-05-08T10:40:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24943.136797 secs 2023-05-08T10:40:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:04 smithi096 ceph-mon[124666]: pgmap v13358: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 646 KiB/s rd, 759 KiB/s wr, 10 op/s 2023-05-08T10:40:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24943.136797 secs 2023-05-08T10:40:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:04 smithi186 ceph-mon[126480]: pgmap v13358: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 646 KiB/s rd, 759 KiB/s wr, 10 op/s 2023-05-08T10:40:06.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:06 smithi133 ceph-mon[125939]: pgmap v13359: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 737 KiB/s rd, 862 KiB/s wr, 16 op/s 2023-05-08T10:40:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:06 smithi096 ceph-mon[124666]: pgmap v13359: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 737 KiB/s rd, 862 KiB/s wr, 16 op/s 2023-05-08T10:40:07.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:06 smithi186 ceph-mon[126480]: pgmap v13359: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 737 KiB/s rd, 862 KiB/s wr, 16 op/s 2023-05-08T10:40:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:08 smithi133 ceph-mon[125939]: pgmap v13360: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 575 KiB/s rd, 612 KiB/s wr, 14 op/s 2023-05-08T10:40:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:08 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:40:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:08 smithi096 ceph-mon[124666]: pgmap v13360: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 575 KiB/s rd, 612 KiB/s wr, 14 op/s 2023-05-08T10:40:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:08 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:40:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:08 smithi186 ceph-mon[126480]: pgmap v13360: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 575 KiB/s rd, 612 KiB/s wr, 14 op/s 2023-05-08T10:40:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:08 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:40:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24948.136885 secs 2023-05-08T10:40:09.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:09 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:40:09.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:40:09.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:40:09.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24948.693180 secs 2023-05-08T10:40:09.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:09 smithi133 ceph-mon[125939]: pgmap v13361: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 612 KiB/s rd, 671 KiB/s wr, 30 op/s 2023-05-08T10:40:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24948.136885 secs 2023-05-08T10:40:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:09 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:40:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:40:10.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:40:10.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24948.693180 secs 2023-05-08T10:40:10.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:09 smithi096 ceph-mon[124666]: pgmap v13361: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 612 KiB/s rd, 671 KiB/s wr, 30 op/s 2023-05-08T10:40:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24948.136885 secs 2023-05-08T10:40:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:09 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:40:10.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:40:10.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:40:10.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24948.693180 secs 2023-05-08T10:40:10.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:09 smithi186 ceph-mon[126480]: pgmap v13361: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 612 KiB/s rd, 671 KiB/s wr, 30 op/s 2023-05-08T10:40:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24949.980452 secs 2023-05-08T10:40:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:11 smithi133 ceph-mon[125939]: osdmap e912: 12 total, 12 up, 12 in 2023-05-08T10:40:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24949.980452 secs 2023-05-08T10:40:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:11 smithi096 ceph-mon[124666]: osdmap e912: 12 total, 12 up, 12 in 2023-05-08T10:40:11.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24949.980452 secs 2023-05-08T10:40:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:11 smithi186 ceph-mon[126480]: osdmap e912: 12 total, 12 up, 12 in 2023-05-08T10:40:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:12 smithi133 ceph-mon[125939]: pgmap v13363: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 515 KiB/s rd, 455 KiB/s wr, 30 op/s 2023-05-08T10:40:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:12 smithi096 ceph-mon[124666]: pgmap v13363: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 515 KiB/s rd, 455 KiB/s wr, 30 op/s 2023-05-08T10:40:12.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:12 smithi186 ceph-mon[126480]: pgmap v13363: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 515 KiB/s rd, 455 KiB/s wr, 30 op/s 2023-05-08T10:40:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:40:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:40:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:13 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:40:13.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:40:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:40:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:13 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:40:13.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:40:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:40:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:13 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:40:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24953.136948 secs 2023-05-08T10:40:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:14 smithi133 ceph-mon[125939]: pgmap v13364: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 515 KiB/s rd, 455 KiB/s wr, 30 op/s 2023-05-08T10:40:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24953.693317 secs 2023-05-08T10:40:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:14 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:40:14.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24953.136948 secs 2023-05-08T10:40:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:14 smithi096 ceph-mon[124666]: pgmap v13364: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 515 KiB/s rd, 455 KiB/s wr, 30 op/s 2023-05-08T10:40:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24953.693317 secs 2023-05-08T10:40:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:14 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:40:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24953.136948 secs 2023-05-08T10:40:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:14 smithi186 ceph-mon[126480]: pgmap v13364: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 515 KiB/s rd, 455 KiB/s wr, 30 op/s 2023-05-08T10:40:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24953.693317 secs 2023-05-08T10:40:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:14 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:40:16.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24954.980577 secs 2023-05-08T10:40:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:16 smithi186 ceph-mon[126480]: pgmap v13365: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 365 KiB/s wr, 27 op/s 2023-05-08T10:40:16.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24954.980577 secs 2023-05-08T10:40:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:16 smithi133 ceph-mon[125939]: pgmap v13365: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 365 KiB/s wr, 27 op/s 2023-05-08T10:40:17.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24954.980577 secs 2023-05-08T10:40:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:16 smithi096 ceph-mon[124666]: pgmap v13365: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 365 KiB/s wr, 27 op/s 2023-05-08T10:40:18.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:18 smithi186 ceph-mon[126480]: pgmap v13366: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 321 KiB/s wr, 26 op/s 2023-05-08T10:40:18.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:18 smithi133 ceph-mon[125939]: pgmap v13366: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 321 KiB/s wr, 26 op/s 2023-05-08T10:40:19.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:18 smithi096 ceph-mon[124666]: pgmap v13366: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 321 KiB/s wr, 26 op/s 2023-05-08T10:40:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24958.137074 secs 2023-05-08T10:40:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24958.693428 secs 2023-05-08T10:40:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:19 smithi186 ceph-mon[126480]: osdmap e913: 12 total, 12 up, 12 in 2023-05-08T10:40:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24958.137074 secs 2023-05-08T10:40:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24958.693428 secs 2023-05-08T10:40:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:19 smithi133 ceph-mon[125939]: osdmap e913: 12 total, 12 up, 12 in 2023-05-08T10:40:20.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24958.137074 secs 2023-05-08T10:40:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24958.693428 secs 2023-05-08T10:40:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:19 smithi096 ceph-mon[124666]: osdmap e913: 12 total, 12 up, 12 in 2023-05-08T10:40:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:20 smithi186 ceph-mon[126480]: pgmap v13368: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 509 KiB/s wr, 12 op/s 2023-05-08T10:40:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:20 smithi133 ceph-mon[125939]: pgmap v13368: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 509 KiB/s wr, 12 op/s 2023-05-08T10:40:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:20 smithi096 ceph-mon[124666]: pgmap v13368: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 509 KiB/s wr, 12 op/s 2023-05-08T10:40:21.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24959.980703 secs 2023-05-08T10:40:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24959.980703 secs 2023-05-08T10:40:22.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24959.980703 secs 2023-05-08T10:40:22.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:22 smithi186 ceph-mon[126480]: pgmap v13369: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 234 KiB/s wr, 9 op/s 2023-05-08T10:40:22.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:22 smithi133 ceph-mon[125939]: pgmap v13369: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 234 KiB/s wr, 9 op/s 2023-05-08T10:40:23.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:22 smithi096 ceph-mon[124666]: pgmap v13369: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 234 KiB/s wr, 9 op/s 2023-05-08T10:40:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24963.137185 secs 2023-05-08T10:40:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:24 smithi186 ceph-mon[126480]: pgmap v13370: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 234 KiB/s wr, 9 op/s 2023-05-08T10:40:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24963.693546 secs 2023-05-08T10:40:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24963.137185 secs 2023-05-08T10:40:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:24 smithi133 ceph-mon[125939]: pgmap v13370: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 234 KiB/s wr, 9 op/s 2023-05-08T10:40:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24963.693546 secs 2023-05-08T10:40:25.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24963.137185 secs 2023-05-08T10:40:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:24 smithi096 ceph-mon[124666]: pgmap v13370: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 234 KiB/s wr, 9 op/s 2023-05-08T10:40:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24963.693546 secs 2023-05-08T10:40:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24964.980824 secs 2023-05-08T10:40:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:26 smithi186 ceph-mon[126480]: pgmap v13371: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 200 KiB/s wr, 7 op/s 2023-05-08T10:40:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24964.980824 secs 2023-05-08T10:40:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:26 smithi133 ceph-mon[125939]: pgmap v13371: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 200 KiB/s wr, 7 op/s 2023-05-08T10:40:27.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24964.980824 secs 2023-05-08T10:40:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:26 smithi096 ceph-mon[124666]: pgmap v13371: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 200 KiB/s wr, 7 op/s 2023-05-08T10:40:28.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:28 smithi186 ceph-mon[126480]: pgmap v13372: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 200 KiB/s wr, 7 op/s 2023-05-08T10:40:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:28 smithi133 ceph-mon[125939]: pgmap v13372: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 200 KiB/s wr, 7 op/s 2023-05-08T10:40:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:28 smithi096 ceph-mon[124666]: pgmap v13372: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 200 KiB/s wr, 7 op/s 2023-05-08T10:40:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24968.137315 secs 2023-05-08T10:40:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24968.693659 secs 2023-05-08T10:40:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24968.137315 secs 2023-05-08T10:40:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24968.693659 secs 2023-05-08T10:40:30.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24968.137315 secs 2023-05-08T10:40:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24968.693659 secs 2023-05-08T10:40:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:30 smithi186 ceph-mon[126480]: pgmap v13373: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T10:40:30.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:30 smithi133 ceph-mon[125939]: pgmap v13373: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T10:40:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:30 smithi096 ceph-mon[124666]: pgmap v13373: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T10:40:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24969.980952 secs 2023-05-08T10:40:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:31 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:40:31.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24969.980952 secs 2023-05-08T10:40:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:31 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:40:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24969.980952 secs 2023-05-08T10:40:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:31 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:40:32.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:32 smithi186 ceph-mon[126480]: pgmap v13374: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:40:32.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:40:32.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:40:32.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:40:32.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:32 smithi133 ceph-mon[125939]: pgmap v13374: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:40:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:40:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:40:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:40:33.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:32 smithi096 ceph-mon[124666]: pgmap v13374: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:40:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:40:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:40:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:40:33.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:33 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:40:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:33 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T10:40:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:33 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T10:40:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:33 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:40:33.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:33 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:40:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:33 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T10:40:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:33 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T10:40:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:33 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:40:34.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:33 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:40:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:33 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T10:40:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:33 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T10:40:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:33 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:40:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24973.137426 secs 2023-05-08T10:40:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:34 smithi186 ceph-mon[126480]: pgmap v13375: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:40:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24973.693790 secs 2023-05-08T10:40:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24973.137426 secs 2023-05-08T10:40:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:34 smithi133 ceph-mon[125939]: pgmap v13375: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:40:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24973.693790 secs 2023-05-08T10:40:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24973.137426 secs 2023-05-08T10:40:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:34 smithi096 ceph-mon[124666]: pgmap v13375: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:40:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24973.693790 secs 2023-05-08T10:40:36.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24974.981082 secs 2023-05-08T10:40:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:36 smithi186 ceph-mon[126480]: pgmap v13376: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T10:40:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24974.981082 secs 2023-05-08T10:40:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:36 smithi133 ceph-mon[125939]: pgmap v13376: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T10:40:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24974.981082 secs 2023-05-08T10:40:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:36 smithi096 ceph-mon[124666]: pgmap v13376: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T10:40:38.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:38 smithi186 ceph-mon[126480]: pgmap v13377: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T10:40:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:38 smithi133 ceph-mon[125939]: pgmap v13377: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T10:40:39.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:38 smithi096 ceph-mon[124666]: pgmap v13377: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T10:40:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24978.137541 secs 2023-05-08T10:40:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24978.693907 secs 2023-05-08T10:40:39.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24978.137541 secs 2023-05-08T10:40:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24978.693907 secs 2023-05-08T10:40:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24978.137541 secs 2023-05-08T10:40:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24978.693907 secs 2023-05-08T10:40:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:40 smithi186 ceph-mon[126480]: pgmap v13378: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 171 KiB/s wr, 9 op/s 2023-05-08T10:40:40.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:40 smithi133 ceph-mon[125939]: pgmap v13378: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 171 KiB/s wr, 9 op/s 2023-05-08T10:40:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:40 smithi096 ceph-mon[124666]: pgmap v13378: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 171 KiB/s wr, 9 op/s 2023-05-08T10:40:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24979.981178 secs 2023-05-08T10:40:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24979.981178 secs 2023-05-08T10:40:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24979.981178 secs 2023-05-08T10:40:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:42 smithi186 ceph-mon[126480]: pgmap v13379: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 171 KiB/s wr, 6 op/s 2023-05-08T10:40:42.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:42 smithi133 ceph-mon[125939]: pgmap v13379: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 171 KiB/s wr, 6 op/s 2023-05-08T10:40:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:42 smithi096 ceph-mon[124666]: pgmap v13379: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 171 KiB/s wr, 6 op/s 2023-05-08T10:40:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24983.137662 secs 2023-05-08T10:40:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:44 smithi186 ceph-mon[126480]: pgmap v13380: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 171 KiB/s wr, 6 op/s 2023-05-08T10:40:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24983.694051 secs 2023-05-08T10:40:44.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24983.137662 secs 2023-05-08T10:40:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:44 smithi133 ceph-mon[125939]: pgmap v13380: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 171 KiB/s wr, 6 op/s 2023-05-08T10:40:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24983.694051 secs 2023-05-08T10:40:45.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24983.137662 secs 2023-05-08T10:40:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:44 smithi096 ceph-mon[124666]: pgmap v13380: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 171 KiB/s wr, 6 op/s 2023-05-08T10:40:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24983.694051 secs 2023-05-08T10:40:46.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:46 smithi186 ceph-mon[126480]: pgmap v13381: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 171 KiB/s wr, 10 op/s 2023-05-08T10:40:46.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:46 smithi133 ceph-mon[125939]: pgmap v13381: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 171 KiB/s wr, 10 op/s 2023-05-08T10:40:47.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:46 smithi096 ceph-mon[124666]: pgmap v13381: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 171 KiB/s wr, 10 op/s 2023-05-08T10:40:48.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:48 smithi186 ceph-mon[126480]: pgmap v13382: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 171 KiB/s wr, 7 op/s 2023-05-08T10:40:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:40:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:48 smithi133 ceph-mon[125939]: pgmap v13382: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 171 KiB/s wr, 7 op/s 2023-05-08T10:40:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:40:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:48 smithi096 ceph-mon[124666]: pgmap v13382: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 171 KiB/s wr, 7 op/s 2023-05-08T10:40:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:40:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24988.137793 secs 2023-05-08T10:40:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:40:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:40:49.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:40:49.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24988.694131 secs 2023-05-08T10:40:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24988.137793 secs 2023-05-08T10:40:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:40:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:40:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:40:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24988.694131 secs 2023-05-08T10:40:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24988.137793 secs 2023-05-08T10:40:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:40:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:40:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:40:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24988.694131 secs 2023-05-08T10:40:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:50 smithi186 ceph-mon[126480]: pgmap v13383: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 340 KiB/s wr, 10 op/s 2023-05-08T10:40:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:50 smithi133 ceph-mon[125939]: pgmap v13383: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 340 KiB/s wr, 10 op/s 2023-05-08T10:40:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:50 smithi096 ceph-mon[124666]: pgmap v13383: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 340 KiB/s wr, 10 op/s 2023-05-08T10:40:52.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:52 smithi133 ceph-mon[125939]: pgmap v13384: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 170 KiB/s wr, 7 op/s 2023-05-08T10:40:53.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:52 smithi096 ceph-mon[124666]: pgmap v13384: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 170 KiB/s wr, 7 op/s 2023-05-08T10:40:53.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:52 smithi186 ceph-mon[126480]: pgmap v13384: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 170 KiB/s wr, 7 op/s 2023-05-08T10:40:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24993.137906 secs 2023-05-08T10:40:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:54 smithi133 ceph-mon[125939]: pgmap v13385: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 170 KiB/s wr, 7 op/s 2023-05-08T10:40:55.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24993.137906 secs 2023-05-08T10:40:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:54 smithi096 ceph-mon[124666]: pgmap v13385: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 170 KiB/s wr, 7 op/s 2023-05-08T10:40:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24993.137906 secs 2023-05-08T10:40:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:54 smithi186 ceph-mon[126480]: pgmap v13385: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 170 KiB/s wr, 7 op/s 2023-05-08T10:40:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:56 smithi133 ceph-mon[125939]: pgmap v13386: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 528 KiB/s rd, 439 KiB/s wr, 11 op/s 2023-05-08T10:40:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:40:57.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:56 smithi096 ceph-mon[124666]: pgmap v13386: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 528 KiB/s rd, 439 KiB/s wr, 11 op/s 2023-05-08T10:40:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:40:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:56 smithi186 ceph-mon[126480]: pgmap v13386: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 528 KiB/s rd, 439 KiB/s wr, 11 op/s 2023-05-08T10:40:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:40:57.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:57 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:40:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:40:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:40:58.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:57 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:40:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:40:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:40:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:57 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:40:58.189 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:40:58.189 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:40:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:58 smithi133 ceph-mon[125939]: pgmap v13387: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 438 KiB/s wr, 7 op/s 2023-05-08T10:40:59.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:58 smithi096 ceph-mon[124666]: pgmap v13387: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 438 KiB/s wr, 7 op/s 2023-05-08T10:40:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:58 smithi186 ceph-mon[126480]: pgmap v13387: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 438 KiB/s wr, 7 op/s 2023-05-08T10:40:59.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24998.138021 secs 2023-05-08T10:40:59.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:40:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 24998.694348 secs 2023-05-08T10:41:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24998.138021 secs 2023-05-08T10:41:00.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:40:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 24998.694348 secs 2023-05-08T10:41:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24998.138021 secs 2023-05-08T10:41:00.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:40:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 24998.694348 secs 2023-05-08T10:41:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:00 smithi133 ceph-mon[125939]: pgmap v13388: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 662 KiB/s wr, 13 op/s 2023-05-08T10:41:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:00 smithi096 ceph-mon[124666]: pgmap v13388: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 662 KiB/s wr, 13 op/s 2023-05-08T10:41:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:00 smithi186 ceph-mon[126480]: pgmap v13388: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 662 KiB/s wr, 13 op/s 2023-05-08T10:41:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:41:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:41:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:01 smithi133 ceph-mon[125939]: pgmap v13389: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 492 KiB/s wr, 9 op/s 2023-05-08T10:41:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:41:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:41:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:01 smithi096 ceph-mon[124666]: pgmap v13389: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 492 KiB/s wr, 9 op/s 2023-05-08T10:41:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:41:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:41:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:01 smithi186 ceph-mon[126480]: pgmap v13389: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 492 KiB/s wr, 9 op/s 2023-05-08T10:41:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25003.138132 secs 2023-05-08T10:41:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:04 smithi186 ceph-mon[126480]: pgmap v13390: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 492 KiB/s wr, 9 op/s 2023-05-08T10:41:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:04 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:41:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25003.138132 secs 2023-05-08T10:41:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:04 smithi133 ceph-mon[125939]: pgmap v13390: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 492 KiB/s wr, 9 op/s 2023-05-08T10:41:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:04 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:41:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25003.138132 secs 2023-05-08T10:41:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:04 smithi096 ceph-mon[124666]: pgmap v13390: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 492 KiB/s wr, 9 op/s 2023-05-08T10:41:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:04 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:41:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:06 smithi186 ceph-mon[126480]: pgmap v13391: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 706 KiB/s rd, 705 KiB/s wr, 16 op/s 2023-05-08T10:41:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:06 smithi133 ceph-mon[125939]: pgmap v13391: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 706 KiB/s rd, 705 KiB/s wr, 16 op/s 2023-05-08T10:41:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:06 smithi096 ceph-mon[124666]: pgmap v13391: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 706 KiB/s rd, 705 KiB/s wr, 16 op/s 2023-05-08T10:41:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:08 smithi186 ceph-mon[126480]: pgmap v13392: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 437 KiB/s wr, 12 op/s 2023-05-08T10:41:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:08 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:41:08.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:08 smithi133 ceph-mon[125939]: pgmap v13392: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 437 KiB/s wr, 12 op/s 2023-05-08T10:41:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:08 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:41:09.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:08 smithi096 ceph-mon[124666]: pgmap v13392: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 437 KiB/s wr, 12 op/s 2023-05-08T10:41:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:08 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:41:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25008.138262 secs 2023-05-08T10:41:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:41:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:41:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25008.694566 secs 2023-05-08T10:41:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:09 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:41:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25008.138262 secs 2023-05-08T10:41:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:41:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:41:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25008.694566 secs 2023-05-08T10:41:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:09 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:41:10.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25008.138262 secs 2023-05-08T10:41:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:41:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:41:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25008.694566 secs 2023-05-08T10:41:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:09 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:41:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:10 smithi186 ceph-mon[126480]: pgmap v13393: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 632 KiB/s wr, 30 op/s 2023-05-08T10:41:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:10 smithi133 ceph-mon[125939]: pgmap v13393: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 632 KiB/s wr, 30 op/s 2023-05-08T10:41:11.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:10 smithi096 ceph-mon[124666]: pgmap v13393: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 632 KiB/s wr, 30 op/s 2023-05-08T10:41:11.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25009.981882 secs 2023-05-08T10:41:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:11 smithi186 ceph-mon[126480]: osdmap e914: 12 total, 12 up, 12 in 2023-05-08T10:41:11.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25009.981882 secs 2023-05-08T10:41:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:11 smithi133 ceph-mon[125939]: osdmap e914: 12 total, 12 up, 12 in 2023-05-08T10:41:12.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25009.981882 secs 2023-05-08T10:41:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:11 smithi096 ceph-mon[124666]: osdmap e914: 12 total, 12 up, 12 in 2023-05-08T10:41:12.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:12 smithi186 ceph-mon[126480]: pgmap v13395: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 489 KiB/s wr, 30 op/s 2023-05-08T10:41:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:12 smithi133 ceph-mon[125939]: pgmap v13395: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 489 KiB/s wr, 30 op/s 2023-05-08T10:41:13.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:12 smithi096 ceph-mon[124666]: pgmap v13395: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 489 KiB/s wr, 30 op/s 2023-05-08T10:41:13.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:41:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:41:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:13 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:41:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:41:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:41:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:13 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:41:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:41:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:41:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:13 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:41:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25013.138401 secs 2023-05-08T10:41:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:14 smithi186 ceph-mon[126480]: pgmap v13396: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 489 KiB/s wr, 30 op/s 2023-05-08T10:41:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25013.694697 secs 2023-05-08T10:41:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:14 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:41:14.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25013.138401 secs 2023-05-08T10:41:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:14 smithi133 ceph-mon[125939]: pgmap v13396: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 489 KiB/s wr, 30 op/s 2023-05-08T10:41:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25013.694697 secs 2023-05-08T10:41:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:14 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:41:15.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25013.138401 secs 2023-05-08T10:41:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:14 smithi096 ceph-mon[124666]: pgmap v13396: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 489 KiB/s wr, 30 op/s 2023-05-08T10:41:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25013.694697 secs 2023-05-08T10:41:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:14 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:41:16.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25014.981947 secs 2023-05-08T10:41:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:16 smithi186 ceph-mon[126480]: pgmap v13397: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 351 KiB/s wr, 27 op/s 2023-05-08T10:41:16.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25014.981947 secs 2023-05-08T10:41:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:16 smithi133 ceph-mon[125939]: pgmap v13397: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 351 KiB/s wr, 27 op/s 2023-05-08T10:41:17.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25014.981947 secs 2023-05-08T10:41:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:16 smithi096 ceph-mon[124666]: pgmap v13397: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 351 KiB/s wr, 27 op/s 2023-05-08T10:41:18.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:18 smithi186 ceph-mon[126480]: pgmap v13398: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 351 KiB/s wr, 27 op/s 2023-05-08T10:41:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:18 smithi133 ceph-mon[125939]: pgmap v13398: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 351 KiB/s wr, 27 op/s 2023-05-08T10:41:19.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:18 smithi096 ceph-mon[124666]: pgmap v13398: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 351 KiB/s wr, 27 op/s 2023-05-08T10:41:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25018.138505 secs 2023-05-08T10:41:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25018.694800 secs 2023-05-08T10:41:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:19 smithi186 ceph-mon[126480]: osdmap e915: 12 total, 12 up, 12 in 2023-05-08T10:41:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25018.138505 secs 2023-05-08T10:41:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25018.694800 secs 2023-05-08T10:41:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:19 smithi133 ceph-mon[125939]: osdmap e915: 12 total, 12 up, 12 in 2023-05-08T10:41:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25018.138505 secs 2023-05-08T10:41:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25018.694800 secs 2023-05-08T10:41:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:19 smithi096 ceph-mon[124666]: osdmap e915: 12 total, 12 up, 12 in 2023-05-08T10:41:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:20 smithi186 ceph-mon[126480]: pgmap v13400: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 341 KiB/s wr, 9 op/s 2023-05-08T10:41:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:20 smithi133 ceph-mon[125939]: pgmap v13400: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 341 KiB/s wr, 9 op/s 2023-05-08T10:41:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:20 smithi096 ceph-mon[124666]: pgmap v13400: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 341 KiB/s wr, 9 op/s 2023-05-08T10:41:21.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25019.982068 secs 2023-05-08T10:41:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25019.982068 secs 2023-05-08T10:41:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25019.982068 secs 2023-05-08T10:41:22.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:22 smithi186 ceph-mon[126480]: pgmap v13401: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 432 KiB/s rd, 304 KiB/s wr, 8 op/s 2023-05-08T10:41:22.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:22 smithi133 ceph-mon[125939]: pgmap v13401: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 432 KiB/s rd, 304 KiB/s wr, 8 op/s 2023-05-08T10:41:23.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:22 smithi096 ceph-mon[124666]: pgmap v13401: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 432 KiB/s rd, 304 KiB/s wr, 8 op/s 2023-05-08T10:41:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25023.138621 secs 2023-05-08T10:41:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:24 smithi186 ceph-mon[126480]: pgmap v13402: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 432 KiB/s rd, 304 KiB/s wr, 8 op/s 2023-05-08T10:41:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25023.694907 secs 2023-05-08T10:41:24.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25023.138621 secs 2023-05-08T10:41:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:24 smithi133 ceph-mon[125939]: pgmap v13402: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 432 KiB/s rd, 304 KiB/s wr, 8 op/s 2023-05-08T10:41:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25023.694907 secs 2023-05-08T10:41:25.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25023.138621 secs 2023-05-08T10:41:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:24 smithi096 ceph-mon[124666]: pgmap v13402: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 432 KiB/s rd, 304 KiB/s wr, 8 op/s 2023-05-08T10:41:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25023.694907 secs 2023-05-08T10:41:25.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25024.982166 secs 2023-05-08T10:41:26.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25024.982166 secs 2023-05-08T10:41:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25024.982166 secs 2023-05-08T10:41:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:26 smithi133 ceph-mon[125939]: pgmap v13403: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 186 KiB/s wr, 6 op/s 2023-05-08T10:41:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:26 smithi096 ceph-mon[124666]: pgmap v13403: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 186 KiB/s wr, 6 op/s 2023-05-08T10:41:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:26 smithi186 ceph-mon[126480]: pgmap v13403: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 186 KiB/s wr, 6 op/s 2023-05-08T10:41:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:28 smithi133 ceph-mon[125939]: pgmap v13404: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 186 KiB/s wr, 6 op/s 2023-05-08T10:41:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:28 smithi096 ceph-mon[124666]: pgmap v13404: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 186 KiB/s wr, 6 op/s 2023-05-08T10:41:29.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:28 smithi186 ceph-mon[126480]: pgmap v13404: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 186 KiB/s wr, 6 op/s 2023-05-08T10:41:29.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25028.138758 secs 2023-05-08T10:41:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25028.695043 secs 2023-05-08T10:41:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25028.138758 secs 2023-05-08T10:41:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25028.695043 secs 2023-05-08T10:41:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25028.138758 secs 2023-05-08T10:41:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25028.695043 secs 2023-05-08T10:41:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:30 smithi133 ceph-mon[125939]: pgmap v13405: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T10:41:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25029.982287 secs 2023-05-08T10:41:31.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:30 smithi096 ceph-mon[124666]: pgmap v13405: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T10:41:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25029.982287 secs 2023-05-08T10:41:31.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:30 smithi186 ceph-mon[126480]: pgmap v13405: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T10:41:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25029.982287 secs 2023-05-08T10:41:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:32 smithi133 ceph-mon[125939]: pgmap v13406: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:41:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:41:33.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:32 smithi096 ceph-mon[124666]: pgmap v13406: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:41:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:41:33.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:32 smithi186 ceph-mon[126480]: pgmap v13406: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:41:33.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:41:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25033.138887 secs 2023-05-08T10:41:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:34 smithi133 ceph-mon[125939]: pgmap v13407: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:41:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25033.695178 secs 2023-05-08T10:41:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25033.138887 secs 2023-05-08T10:41:35.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:34 smithi096 ceph-mon[124666]: pgmap v13407: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:41:35.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25033.695178 secs 2023-05-08T10:41:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25033.138887 secs 2023-05-08T10:41:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:34 smithi186 ceph-mon[126480]: pgmap v13407: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:41:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25033.695178 secs 2023-05-08T10:41:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:41:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:41:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:41:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:41:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:41:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:41:36.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25034.982386 secs 2023-05-08T10:41:36.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:36 smithi186 ceph-mon[126480]: pgmap v13408: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T10:41:36.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:41:36.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:41:36.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:41:36.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:41:36.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:41:36.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:41:36.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:41:36.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:41:36.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:41:36.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:41:36.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:41:36.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:41:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:41:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:41:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:41:36.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:41:36.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:41:36.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:41:36.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25034.982386 secs 2023-05-08T10:41:36.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:36 smithi133 ceph-mon[125939]: pgmap v13408: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T10:41:36.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:41:36.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:41:36.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:41:36.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:41:36.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:41:36.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:41:36.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:41:36.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:41:36.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:41:36.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:41:36.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:41:36.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:41:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:41:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:41:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:41:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:41:36.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:41:36.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:41:36.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25034.982386 secs 2023-05-08T10:41:36.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:36 smithi096 ceph-mon[124666]: pgmap v13408: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T10:41:36.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:41:36.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:41:36.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:41:36.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:41:36.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:41:36.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:41:36.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:41:36.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:41:36.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:41:36.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:41:36.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:41:36.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:41:37.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:37 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T10:41:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:37 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T10:41:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:37 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T10:41:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:37 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T10:41:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:37 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:41:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:37 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T10:41:37.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:37 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T10:41:37.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:37 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:41:37.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:37 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T10:41:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:37 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T10:41:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:37 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T10:41:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:37 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T10:41:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:37 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:41:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:37 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T10:41:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:37 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T10:41:37.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:37 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:41:37.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:37 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T10:41:37.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:37 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T10:41:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:37 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi186 to 196.2M 2023-05-08T10:41:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:37 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi186 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-05-08T10:41:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:37 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:41:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:37 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T10:41:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:37 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T10:41:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:37 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:41:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:38 smithi133 ceph-mon[125939]: pgmap v13409: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T10:41:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:38 smithi096 ceph-mon[124666]: pgmap v13409: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T10:41:38.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:38 smithi186 ceph-mon[126480]: pgmap v13409: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T10:41:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25038.139013 secs 2023-05-08T10:41:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25038.139013 secs 2023-05-08T10:41:39.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25038.139013 secs 2023-05-08T10:41:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25038.695309 secs 2023-05-08T10:41:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:40 smithi133 ceph-mon[125939]: pgmap v13410: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 88 KiB/s wr, 8 op/s 2023-05-08T10:41:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25038.695309 secs 2023-05-08T10:41:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:40 smithi096 ceph-mon[124666]: pgmap v13410: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 88 KiB/s wr, 8 op/s 2023-05-08T10:41:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25038.695309 secs 2023-05-08T10:41:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:40 smithi186 ceph-mon[126480]: pgmap v13410: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 88 KiB/s wr, 8 op/s 2023-05-08T10:41:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25039.982461 secs 2023-05-08T10:41:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25039.982461 secs 2023-05-08T10:41:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25039.982461 secs 2023-05-08T10:41:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:42 smithi096 ceph-mon[124666]: pgmap v13411: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 88 KiB/s wr, 6 op/s 2023-05-08T10:41:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:42 smithi186 ceph-mon[126480]: pgmap v13411: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 88 KiB/s wr, 6 op/s 2023-05-08T10:41:42.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:42 smithi133 ceph-mon[125939]: pgmap v13411: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 88 KiB/s wr, 6 op/s 2023-05-08T10:41:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25043.139133 secs 2023-05-08T10:41:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:44 smithi186 ceph-mon[126480]: pgmap v13412: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 88 KiB/s wr, 6 op/s 2023-05-08T10:41:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25043.695398 secs 2023-05-08T10:41:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25043.139133 secs 2023-05-08T10:41:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:44 smithi133 ceph-mon[125939]: pgmap v13412: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 88 KiB/s wr, 6 op/s 2023-05-08T10:41:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25043.695398 secs 2023-05-08T10:41:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25043.139133 secs 2023-05-08T10:41:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:44 smithi096 ceph-mon[124666]: pgmap v13412: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 88 KiB/s wr, 6 op/s 2023-05-08T10:41:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25043.695398 secs 2023-05-08T10:41:46.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:46 smithi186 ceph-mon[126480]: pgmap v13413: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 322 KiB/s rd, 146 KiB/s wr, 10 op/s 2023-05-08T10:41:46.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:46 smithi133 ceph-mon[125939]: pgmap v13413: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 322 KiB/s rd, 146 KiB/s wr, 10 op/s 2023-05-08T10:41:47.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:46 smithi096 ceph-mon[124666]: pgmap v13413: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 322 KiB/s rd, 146 KiB/s wr, 10 op/s 2023-05-08T10:41:48.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:48 smithi186 ceph-mon[126480]: pgmap v13414: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 145 KiB/s wr, 7 op/s 2023-05-08T10:41:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:41:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:48 smithi133 ceph-mon[125939]: pgmap v13414: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 145 KiB/s wr, 7 op/s 2023-05-08T10:41:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:41:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:48 smithi096 ceph-mon[124666]: pgmap v13414: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 145 KiB/s wr, 7 op/s 2023-05-08T10:41:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:41:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25048.139249 secs 2023-05-08T10:41:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:41:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:41:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:41:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25048.695512 secs 2023-05-08T10:41:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25048.139249 secs 2023-05-08T10:41:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:41:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:41:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:41:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25048.695512 secs 2023-05-08T10:41:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25048.139249 secs 2023-05-08T10:41:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:41:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:41:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:41:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25048.695512 secs 2023-05-08T10:41:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:50 smithi186 ceph-mon[126480]: pgmap v13415: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 173 KiB/s wr, 10 op/s 2023-05-08T10:41:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:50 smithi133 ceph-mon[125939]: pgmap v13415: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 173 KiB/s wr, 10 op/s 2023-05-08T10:41:51.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:50 smithi096 ceph-mon[124666]: pgmap v13415: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 173 KiB/s wr, 10 op/s 2023-05-08T10:41:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:52 smithi186 ceph-mon[126480]: pgmap v13416: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 463 KiB/s rd, 85 KiB/s wr, 7 op/s 2023-05-08T10:41:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:52 smithi133 ceph-mon[125939]: pgmap v13416: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 463 KiB/s rd, 85 KiB/s wr, 7 op/s 2023-05-08T10:41:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:52 smithi096 ceph-mon[124666]: pgmap v13416: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 463 KiB/s rd, 85 KiB/s wr, 7 op/s 2023-05-08T10:41:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25053.139362 secs 2023-05-08T10:41:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:54 smithi186 ceph-mon[126480]: pgmap v13417: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 463 KiB/s rd, 85 KiB/s wr, 7 op/s 2023-05-08T10:41:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25053.139362 secs 2023-05-08T10:41:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:54 smithi133 ceph-mon[125939]: pgmap v13417: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 463 KiB/s rd, 85 KiB/s wr, 7 op/s 2023-05-08T10:41:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25053.139362 secs 2023-05-08T10:41:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:54 smithi096 ceph-mon[124666]: pgmap v13417: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 463 KiB/s rd, 85 KiB/s wr, 7 op/s 2023-05-08T10:41:56.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:56 smithi186 ceph-mon[126480]: pgmap v13418: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 733 KiB/s rd, 355 KiB/s wr, 11 op/s 2023-05-08T10:41:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:41:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:56 smithi133 ceph-mon[125939]: pgmap v13418: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 733 KiB/s rd, 355 KiB/s wr, 11 op/s 2023-05-08T10:41:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:41:57.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:56 smithi096 ceph-mon[124666]: pgmap v13418: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 733 KiB/s rd, 355 KiB/s wr, 11 op/s 2023-05-08T10:41:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:41:57.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:57 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:41:57.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:41:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:41:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:57 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:41:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:41:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:41:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:57 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:41:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:41:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:41:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:58 smithi186 ceph-mon[126480]: pgmap v13419: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 297 KiB/s wr, 7 op/s 2023-05-08T10:41:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:58 smithi133 ceph-mon[125939]: pgmap v13419: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 297 KiB/s wr, 7 op/s 2023-05-08T10:41:59.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:58 smithi096 ceph-mon[124666]: pgmap v13419: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 297 KiB/s wr, 7 op/s 2023-05-08T10:41:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25058.139504 secs 2023-05-08T10:41:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:41:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25058.695778 secs 2023-05-08T10:41:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25058.139504 secs 2023-05-08T10:41:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:41:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25058.695778 secs 2023-05-08T10:42:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25058.139504 secs 2023-05-08T10:42:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:41:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25058.695778 secs 2023-05-08T10:42:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:00 smithi186 ceph-mon[126480]: pgmap v13420: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 781 KiB/s rd, 607 KiB/s wr, 13 op/s 2023-05-08T10:42:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:00 smithi133 ceph-mon[125939]: pgmap v13420: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 781 KiB/s rd, 607 KiB/s wr, 13 op/s 2023-05-08T10:42:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:00 smithi096 ceph-mon[124666]: pgmap v13420: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 781 KiB/s rd, 607 KiB/s wr, 13 op/s 2023-05-08T10:42:01.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25059.982906 secs 2023-05-08T10:42:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:42:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:42:02.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25059.982906 secs 2023-05-08T10:42:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:42:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:42:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25059.982906 secs 2023-05-08T10:42:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:42:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:42:02.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:02 smithi133 ceph-mon[125939]: pgmap v13421: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 637 KiB/s rd, 580 KiB/s wr, 10 op/s 2023-05-08T10:42:03.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:02 smithi096 ceph-mon[124666]: pgmap v13421: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 637 KiB/s rd, 580 KiB/s wr, 10 op/s 2023-05-08T10:42:03.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:02 smithi186 ceph-mon[126480]: pgmap v13421: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 637 KiB/s rd, 580 KiB/s wr, 10 op/s 2023-05-08T10:42:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25063.139646 secs 2023-05-08T10:42:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:04 smithi133 ceph-mon[125939]: pgmap v13422: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 637 KiB/s rd, 580 KiB/s wr, 10 op/s 2023-05-08T10:42:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:04 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:42:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25063.139646 secs 2023-05-08T10:42:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:04 smithi096 ceph-mon[124666]: pgmap v13422: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 637 KiB/s rd, 580 KiB/s wr, 10 op/s 2023-05-08T10:42:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:04 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:42:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25063.139646 secs 2023-05-08T10:42:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:04 smithi186 ceph-mon[126480]: pgmap v13422: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 637 KiB/s rd, 580 KiB/s wr, 10 op/s 2023-05-08T10:42:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:04 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:42:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:42:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:42:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25064.983021 secs 2023-05-08T10:42:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:42:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:42:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25064.983021 secs 2023-05-08T10:42:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:42:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:42:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25064.983021 secs 2023-05-08T10:42:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:06 smithi133 ceph-mon[125939]: pgmap v13423: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 795 KiB/s rd, 718 KiB/s wr, 17 op/s 2023-05-08T10:42:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:06 smithi096 ceph-mon[124666]: pgmap v13423: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 795 KiB/s rd, 718 KiB/s wr, 17 op/s 2023-05-08T10:42:07.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:06 smithi186 ceph-mon[126480]: pgmap v13423: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 795 KiB/s rd, 718 KiB/s wr, 17 op/s 2023-05-08T10:42:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:08 smithi133 ceph-mon[125939]: pgmap v13424: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 525 KiB/s rd, 449 KiB/s wr, 13 op/s 2023-05-08T10:42:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:08 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:42:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:08 smithi096 ceph-mon[124666]: pgmap v13424: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 525 KiB/s rd, 449 KiB/s wr, 13 op/s 2023-05-08T10:42:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:08 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:42:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:08 smithi186 ceph-mon[126480]: pgmap v13424: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 525 KiB/s rd, 449 KiB/s wr, 13 op/s 2023-05-08T10:42:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:08 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:42:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25068.139778 secs 2023-05-08T10:42:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:42:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:42:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25068.696060 secs 2023-05-08T10:42:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25068.139778 secs 2023-05-08T10:42:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:42:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:42:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25068.696060 secs 2023-05-08T10:42:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25068.139778 secs 2023-05-08T10:42:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:42:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:42:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25068.696060 secs 2023-05-08T10:42:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:10 smithi133 ceph-mon[125939]: pgmap v13425: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 794 KiB/s rd, 719 KiB/s wr, 32 op/s 2023-05-08T10:42:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25069.983140 secs 2023-05-08T10:42:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:10 smithi096 ceph-mon[124666]: pgmap v13425: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 794 KiB/s rd, 719 KiB/s wr, 32 op/s 2023-05-08T10:42:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25069.983140 secs 2023-05-08T10:42:11.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:10 smithi186 ceph-mon[126480]: pgmap v13425: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 794 KiB/s rd, 719 KiB/s wr, 32 op/s 2023-05-08T10:42:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25069.983140 secs 2023-05-08T10:42:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:11 smithi133 ceph-mon[125939]: osdmap e916: 12 total, 12 up, 12 in 2023-05-08T10:42:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:11 smithi096 ceph-mon[124666]: osdmap e916: 12 total, 12 up, 12 in 2023-05-08T10:42:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:11 smithi186 ceph-mon[126480]: osdmap e916: 12 total, 12 up, 12 in 2023-05-08T10:42:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:12 smithi133 ceph-mon[125939]: pgmap v13427: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 491 KiB/s wr, 31 op/s 2023-05-08T10:42:13.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:12 smithi096 ceph-mon[124666]: pgmap v13427: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 491 KiB/s wr, 31 op/s 2023-05-08T10:42:13.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:12 smithi186 ceph-mon[126480]: pgmap v13427: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 491 KiB/s wr, 31 op/s 2023-05-08T10:42:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:13 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:42:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:42:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:13 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:42:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:13 smithi133 ceph-mon[125939]: pgmap v13428: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 491 KiB/s wr, 31 op/s 2023-05-08T10:42:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:13 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:42:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:42:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:13 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:42:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:13 smithi096 ceph-mon[124666]: pgmap v13428: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 491 KiB/s wr, 31 op/s 2023-05-08T10:42:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:13 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:42:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:42:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:13 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:42:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:13 smithi186 ceph-mon[126480]: pgmap v13428: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 491 KiB/s wr, 31 op/s 2023-05-08T10:42:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25073.139893 secs 2023-05-08T10:42:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25073.696189 secs 2023-05-08T10:42:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25073.139893 secs 2023-05-08T10:42:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25073.696189 secs 2023-05-08T10:42:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25073.139893 secs 2023-05-08T10:42:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25073.696189 secs 2023-05-08T10:42:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25074.983275 secs 2023-05-08T10:42:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:15 smithi133 ceph-mon[125939]: pgmap v13429: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 442 KiB/s wr, 27 op/s 2023-05-08T10:42:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25074.983275 secs 2023-05-08T10:42:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:15 smithi096 ceph-mon[124666]: pgmap v13429: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 442 KiB/s wr, 27 op/s 2023-05-08T10:42:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25074.983275 secs 2023-05-08T10:42:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:15 smithi186 ceph-mon[126480]: pgmap v13429: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 442 KiB/s wr, 27 op/s 2023-05-08T10:42:18.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:18 smithi186 ceph-mon[126480]: pgmap v13430: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 442 KiB/s wr, 27 op/s 2023-05-08T10:42:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:18 smithi133 ceph-mon[125939]: pgmap v13430: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 442 KiB/s wr, 27 op/s 2023-05-08T10:42:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:18 smithi096 ceph-mon[124666]: pgmap v13430: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 442 KiB/s wr, 27 op/s 2023-05-08T10:42:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25078.140006 secs 2023-05-08T10:42:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25078.696332 secs 2023-05-08T10:42:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:19 smithi186 ceph-mon[126480]: osdmap e917: 12 total, 12 up, 12 in 2023-05-08T10:42:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25078.140006 secs 2023-05-08T10:42:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25078.696332 secs 2023-05-08T10:42:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:19 smithi133 ceph-mon[125939]: osdmap e917: 12 total, 12 up, 12 in 2023-05-08T10:42:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25078.140006 secs 2023-05-08T10:42:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25078.696332 secs 2023-05-08T10:42:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:19 smithi096 ceph-mon[124666]: osdmap e917: 12 total, 12 up, 12 in 2023-05-08T10:42:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:20 smithi186 ceph-mon[126480]: pgmap v13432: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 228 KiB/s wr, 9 op/s 2023-05-08T10:42:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:20 smithi133 ceph-mon[125939]: pgmap v13432: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 228 KiB/s wr, 9 op/s 2023-05-08T10:42:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:20 smithi096 ceph-mon[124666]: pgmap v13432: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 228 KiB/s wr, 9 op/s 2023-05-08T10:42:21.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25079.983376 secs 2023-05-08T10:42:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25079.983376 secs 2023-05-08T10:42:22.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25079.983376 secs 2023-05-08T10:42:22.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:22 smithi186 ceph-mon[126480]: pgmap v13433: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 202 KiB/s wr, 8 op/s 2023-05-08T10:42:22.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:22 smithi133 ceph-mon[125939]: pgmap v13433: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 202 KiB/s wr, 8 op/s 2023-05-08T10:42:23.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:22 smithi096 ceph-mon[124666]: pgmap v13433: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 202 KiB/s wr, 8 op/s 2023-05-08T10:42:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25083.140127 secs 2023-05-08T10:42:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:24 smithi186 ceph-mon[126480]: pgmap v13434: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 202 KiB/s wr, 8 op/s 2023-05-08T10:42:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25083.696455 secs 2023-05-08T10:42:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25083.140127 secs 2023-05-08T10:42:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:24 smithi133 ceph-mon[125939]: pgmap v13434: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 202 KiB/s wr, 8 op/s 2023-05-08T10:42:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25083.696455 secs 2023-05-08T10:42:25.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25083.140127 secs 2023-05-08T10:42:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:24 smithi096 ceph-mon[124666]: pgmap v13434: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 202 KiB/s wr, 8 op/s 2023-05-08T10:42:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25083.696455 secs 2023-05-08T10:42:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25084.983493 secs 2023-05-08T10:42:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:26 smithi186 ceph-mon[126480]: pgmap v13435: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 84 KiB/s wr, 7 op/s 2023-05-08T10:42:26.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25084.983493 secs 2023-05-08T10:42:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:26 smithi133 ceph-mon[125939]: pgmap v13435: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 84 KiB/s wr, 7 op/s 2023-05-08T10:42:27.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25084.983493 secs 2023-05-08T10:42:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:26 smithi096 ceph-mon[124666]: pgmap v13435: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 84 KiB/s wr, 7 op/s 2023-05-08T10:42:28.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:28 smithi186 ceph-mon[126480]: pgmap v13436: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 84 KiB/s wr, 7 op/s 2023-05-08T10:42:28.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:28 smithi133 ceph-mon[125939]: pgmap v13436: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 84 KiB/s wr, 7 op/s 2023-05-08T10:42:29.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:28 smithi096 ceph-mon[124666]: pgmap v13436: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 84 KiB/s wr, 7 op/s 2023-05-08T10:42:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25088.140271 secs 2023-05-08T10:42:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25088.696573 secs 2023-05-08T10:42:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25088.140271 secs 2023-05-08T10:42:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25088.696573 secs 2023-05-08T10:42:30.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25088.140271 secs 2023-05-08T10:42:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25088.696573 secs 2023-05-08T10:42:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:30 smithi186 ceph-mon[126480]: pgmap v13437: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2023-05-08T10:42:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:30 smithi133 ceph-mon[125939]: pgmap v13437: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2023-05-08T10:42:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:30 smithi096 ceph-mon[124666]: pgmap v13437: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2023-05-08T10:42:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25089.983564 secs 2023-05-08T10:42:31.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25089.983564 secs 2023-05-08T10:42:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25089.983564 secs 2023-05-08T10:42:32.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:32 smithi186 ceph-mon[126480]: pgmap v13438: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:42:32.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:32 smithi133 ceph-mon[125939]: pgmap v13438: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:42:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:32 smithi096 ceph-mon[124666]: pgmap v13438: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:42:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25093.140406 secs 2023-05-08T10:42:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:34 smithi133 ceph-mon[125939]: pgmap v13439: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:42:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25093.696691 secs 2023-05-08T10:42:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25093.140406 secs 2023-05-08T10:42:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:34 smithi096 ceph-mon[124666]: pgmap v13439: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:42:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25093.696691 secs 2023-05-08T10:42:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25093.140406 secs 2023-05-08T10:42:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:34 smithi186 ceph-mon[126480]: pgmap v13439: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:42:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25093.696691 secs 2023-05-08T10:42:35.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25094.983685 secs 2023-05-08T10:42:36.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25094.983685 secs 2023-05-08T10:42:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25094.983685 secs 2023-05-08T10:42:36.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:36 smithi133 ceph-mon[125939]: pgmap v13440: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 426 B/s wr, 9 op/s 2023-05-08T10:42:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:42:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:42:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:42:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:42:37.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:36 smithi096 ceph-mon[124666]: pgmap v13440: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 426 B/s wr, 9 op/s 2023-05-08T10:42:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:42:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:42:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:42:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:42:37.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:36 smithi186 ceph-mon[126480]: pgmap v13440: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 426 B/s wr, 9 op/s 2023-05-08T10:42:37.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:42:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:42:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:42:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:42:37.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:37 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:42:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:37 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T10:42:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:37 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T10:42:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:37 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:42:38.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:37 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:42:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:37 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T10:42:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:37 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T10:42:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:37 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:42:38.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:37 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:42:38.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:37 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T10:42:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:37 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T10:42:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:37 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:42:38.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:38 smithi133 ceph-mon[125939]: pgmap v13441: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2023-05-08T10:42:39.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:38 smithi096 ceph-mon[124666]: pgmap v13441: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2023-05-08T10:42:39.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:38 smithi186 ceph-mon[126480]: pgmap v13441: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2023-05-08T10:42:39.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25098.140481 secs 2023-05-08T10:42:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25098.696779 secs 2023-05-08T10:42:40.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25098.140481 secs 2023-05-08T10:42:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25098.696779 secs 2023-05-08T10:42:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25098.140481 secs 2023-05-08T10:42:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25098.696779 secs 2023-05-08T10:42:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:40 smithi133 ceph-mon[125939]: pgmap v13442: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 188 KiB/s wr, 10 op/s 2023-05-08T10:42:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25099.983832 secs 2023-05-08T10:42:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:40 smithi096 ceph-mon[124666]: pgmap v13442: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 188 KiB/s wr, 10 op/s 2023-05-08T10:42:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25099.983832 secs 2023-05-08T10:42:41.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:40 smithi186 ceph-mon[126480]: pgmap v13442: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 188 KiB/s wr, 10 op/s 2023-05-08T10:42:41.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25099.983832 secs 2023-05-08T10:42:42.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:42 smithi133 ceph-mon[125939]: pgmap v13443: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 188 KiB/s wr, 7 op/s 2023-05-08T10:42:43.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:42 smithi096 ceph-mon[124666]: pgmap v13443: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 188 KiB/s wr, 7 op/s 2023-05-08T10:42:43.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:42 smithi186 ceph-mon[126480]: pgmap v13443: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 188 KiB/s wr, 7 op/s 2023-05-08T10:42:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25103.140596 secs 2023-05-08T10:42:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:44 smithi133 ceph-mon[125939]: pgmap v13444: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 188 KiB/s wr, 7 op/s 2023-05-08T10:42:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25103.696927 secs 2023-05-08T10:42:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25103.140596 secs 2023-05-08T10:42:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:44 smithi096 ceph-mon[124666]: pgmap v13444: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 188 KiB/s wr, 7 op/s 2023-05-08T10:42:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25103.696927 secs 2023-05-08T10:42:45.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25103.140596 secs 2023-05-08T10:42:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:44 smithi186 ceph-mon[126480]: pgmap v13444: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 188 KiB/s wr, 7 op/s 2023-05-08T10:42:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25103.696927 secs 2023-05-08T10:42:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:46 smithi133 ceph-mon[125939]: pgmap v13445: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 189 KiB/s wr, 11 op/s 2023-05-08T10:42:47.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:46 smithi096 ceph-mon[124666]: pgmap v13445: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 189 KiB/s wr, 11 op/s 2023-05-08T10:42:47.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:46 smithi186 ceph-mon[126480]: pgmap v13445: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 189 KiB/s wr, 11 op/s 2023-05-08T10:42:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:48 smithi133 ceph-mon[125939]: pgmap v13446: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 189 KiB/s wr, 7 op/s 2023-05-08T10:42:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:42:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:48 smithi096 ceph-mon[124666]: pgmap v13446: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 189 KiB/s wr, 7 op/s 2023-05-08T10:42:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:42:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:48 smithi186 ceph-mon[126480]: pgmap v13446: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 189 KiB/s wr, 7 op/s 2023-05-08T10:42:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:42:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25108.140708 secs 2023-05-08T10:42:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:42:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:42:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:42:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25108.697049 secs 2023-05-08T10:42:50.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25108.140708 secs 2023-05-08T10:42:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:42:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:42:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:42:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25108.697049 secs 2023-05-08T10:42:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25108.140708 secs 2023-05-08T10:42:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:42:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:42:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:42:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25108.697049 secs 2023-05-08T10:42:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:50 smithi133 ceph-mon[125939]: pgmap v13447: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 343 KiB/s wr, 11 op/s 2023-05-08T10:42:51.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:50 smithi096 ceph-mon[124666]: pgmap v13447: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 343 KiB/s wr, 11 op/s 2023-05-08T10:42:51.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:50 smithi186 ceph-mon[126480]: pgmap v13447: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 343 KiB/s wr, 11 op/s 2023-05-08T10:42:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:52 smithi133 ceph-mon[125939]: pgmap v13448: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 155 KiB/s wr, 7 op/s 2023-05-08T10:42:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:52 smithi096 ceph-mon[124666]: pgmap v13448: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 155 KiB/s wr, 7 op/s 2023-05-08T10:42:53.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:52 smithi186 ceph-mon[126480]: pgmap v13448: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 155 KiB/s wr, 7 op/s 2023-05-08T10:42:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:53 smithi133 ceph-mon[125939]: pgmap v13449: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 155 KiB/s wr, 7 op/s 2023-05-08T10:42:54.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:53 smithi096 ceph-mon[124666]: pgmap v13449: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 155 KiB/s wr, 7 op/s 2023-05-08T10:42:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:53 smithi186 ceph-mon[126480]: pgmap v13449: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 155 KiB/s wr, 7 op/s 2023-05-08T10:42:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25113.140823 secs 2023-05-08T10:42:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25113.140823 secs 2023-05-08T10:42:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25113.140823 secs 2023-05-08T10:42:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:55 smithi133 ceph-mon[125939]: pgmap v13450: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 561 KiB/s rd, 371 KiB/s wr, 11 op/s 2023-05-08T10:42:56.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:55 smithi096 ceph-mon[124666]: pgmap v13450: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 561 KiB/s rd, 371 KiB/s wr, 11 op/s 2023-05-08T10:42:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:55 smithi186 ceph-mon[126480]: pgmap v13450: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 561 KiB/s rd, 371 KiB/s wr, 11 op/s 2023-05-08T10:42:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:42:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:42:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:42:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:57 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:42:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:42:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:42:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:57 smithi133 ceph-mon[125939]: pgmap v13451: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 370 KiB/s wr, 7 op/s 2023-05-08T10:42:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:57 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:42:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:42:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:42:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:57 smithi096 ceph-mon[124666]: pgmap v13451: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 370 KiB/s wr, 7 op/s 2023-05-08T10:42:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:57 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:42:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:42:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:42:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:57 smithi186 ceph-mon[126480]: pgmap v13451: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 370 KiB/s wr, 7 op/s 2023-05-08T10:42:59.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25118.140888 secs 2023-05-08T10:42:59.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25118.140888 secs 2023-05-08T10:42:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25118.140888 secs 2023-05-08T10:43:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25118.697313 secs 2023-05-08T10:43:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:42:59 smithi133 ceph-mon[125939]: pgmap v13452: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 708 KiB/s rd, 695 KiB/s wr, 13 op/s 2023-05-08T10:43:00.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25118.697313 secs 2023-05-08T10:43:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:42:59 smithi096 ceph-mon[124666]: pgmap v13452: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 708 KiB/s rd, 695 KiB/s wr, 13 op/s 2023-05-08T10:43:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25118.697313 secs 2023-05-08T10:43:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:42:59 smithi186 ceph-mon[126480]: pgmap v13452: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 708 KiB/s rd, 695 KiB/s wr, 13 op/s 2023-05-08T10:43:01.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25119.984240 secs 2023-05-08T10:43:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:43:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:43:01.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25119.984240 secs 2023-05-08T10:43:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:43:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:43:02.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25119.984240 secs 2023-05-08T10:43:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:43:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:43:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:02 smithi186 ceph-mon[126480]: pgmap v13453: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 540 KiB/s wr, 10 op/s 2023-05-08T10:43:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:02 smithi133 ceph-mon[125939]: pgmap v13453: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 540 KiB/s wr, 10 op/s 2023-05-08T10:43:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:02 smithi096 ceph-mon[124666]: pgmap v13453: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 540 KiB/s wr, 10 op/s 2023-05-08T10:43:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25123.141003 secs 2023-05-08T10:43:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:04 smithi186 ceph-mon[126480]: pgmap v13454: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 540 KiB/s wr, 10 op/s 2023-05-08T10:43:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:04 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:43:04.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25123.141003 secs 2023-05-08T10:43:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:04 smithi133 ceph-mon[125939]: pgmap v13454: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 540 KiB/s wr, 10 op/s 2023-05-08T10:43:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:04 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:43:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25123.141003 secs 2023-05-08T10:43:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:04 smithi096 ceph-mon[124666]: pgmap v13454: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 540 KiB/s wr, 10 op/s 2023-05-08T10:43:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:04 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:43:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:43:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:43:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:43:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:43:06.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:43:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:43:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25124.984365 secs 2023-05-08T10:43:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:06 smithi186 ceph-mon[126480]: pgmap v13455: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 669 KiB/s rd, 669 KiB/s wr, 16 op/s 2023-05-08T10:43:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25124.984365 secs 2023-05-08T10:43:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:06 smithi133 ceph-mon[125939]: pgmap v13455: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 669 KiB/s rd, 669 KiB/s wr, 16 op/s 2023-05-08T10:43:07.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25124.984365 secs 2023-05-08T10:43:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:06 smithi096 ceph-mon[124666]: pgmap v13455: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 669 KiB/s rd, 669 KiB/s wr, 16 op/s 2023-05-08T10:43:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:08 smithi186 ceph-mon[126480]: pgmap v13456: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 454 KiB/s wr, 12 op/s 2023-05-08T10:43:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:08 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:43:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:08 smithi133 ceph-mon[125939]: pgmap v13456: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 454 KiB/s wr, 12 op/s 2023-05-08T10:43:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:08 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:43:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:08 smithi096 ceph-mon[124666]: pgmap v13456: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 454 KiB/s wr, 12 op/s 2023-05-08T10:43:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:08 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:43:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25128.141138 secs 2023-05-08T10:43:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:43:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:43:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25128.697557 secs 2023-05-08T10:43:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25128.141138 secs 2023-05-08T10:43:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:43:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:43:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25128.697557 secs 2023-05-08T10:43:10.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25128.141138 secs 2023-05-08T10:43:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:43:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:43:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25128.697557 secs 2023-05-08T10:43:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:10 smithi186 ceph-mon[126480]: pgmap v13457: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 755 KiB/s rd, 778 KiB/s wr, 31 op/s 2023-05-08T10:43:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:10 smithi133 ceph-mon[125939]: pgmap v13457: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 755 KiB/s rd, 778 KiB/s wr, 31 op/s 2023-05-08T10:43:11.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:10 smithi096 ceph-mon[124666]: pgmap v13457: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 755 KiB/s rd, 778 KiB/s wr, 31 op/s 2023-05-08T10:43:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25129.984470 secs 2023-05-08T10:43:11.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:11 smithi186 ceph-mon[126480]: osdmap e918: 12 total, 12 up, 12 in 2023-05-08T10:43:11.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25129.984470 secs 2023-05-08T10:43:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:11 smithi133 ceph-mon[125939]: osdmap e918: 12 total, 12 up, 12 in 2023-05-08T10:43:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25129.984470 secs 2023-05-08T10:43:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:11 smithi096 ceph-mon[124666]: osdmap e918: 12 total, 12 up, 12 in 2023-05-08T10:43:12.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:12 smithi133 ceph-mon[125939]: pgmap v13459: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 502 KiB/s rd, 544 KiB/s wr, 29 op/s 2023-05-08T10:43:13.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:12 smithi096 ceph-mon[124666]: pgmap v13459: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 502 KiB/s rd, 544 KiB/s wr, 29 op/s 2023-05-08T10:43:13.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:12 smithi186 ceph-mon[126480]: pgmap v13459: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 502 KiB/s rd, 544 KiB/s wr, 29 op/s 2023-05-08T10:43:13.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:13 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:43:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:43:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:13 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:43:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:13 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:43:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:43:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:13 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:43:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:13 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:43:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:43:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:13 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:43:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25133.141291 secs 2023-05-08T10:43:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:14 smithi133 ceph-mon[125939]: pgmap v13460: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 502 KiB/s rd, 544 KiB/s wr, 29 op/s 2023-05-08T10:43:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25133.697667 secs 2023-05-08T10:43:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25133.141291 secs 2023-05-08T10:43:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:14 smithi096 ceph-mon[124666]: pgmap v13460: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 502 KiB/s rd, 544 KiB/s wr, 29 op/s 2023-05-08T10:43:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25133.697667 secs 2023-05-08T10:43:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25133.141291 secs 2023-05-08T10:43:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:14 smithi186 ceph-mon[126480]: pgmap v13460: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 502 KiB/s rd, 544 KiB/s wr, 29 op/s 2023-05-08T10:43:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25133.697667 secs 2023-05-08T10:43:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25134.984620 secs 2023-05-08T10:43:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25134.984620 secs 2023-05-08T10:43:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25134.984620 secs 2023-05-08T10:43:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:16 smithi133 ceph-mon[125939]: pgmap v13461: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 482 KiB/s rd, 508 KiB/s wr, 26 op/s 2023-05-08T10:43:17.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:16 smithi096 ceph-mon[124666]: pgmap v13461: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 482 KiB/s rd, 508 KiB/s wr, 26 op/s 2023-05-08T10:43:17.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:16 smithi186 ceph-mon[126480]: pgmap v13461: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 482 KiB/s rd, 508 KiB/s wr, 26 op/s 2023-05-08T10:43:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:18 smithi133 ceph-mon[125939]: pgmap v13462: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 482 KiB/s rd, 508 KiB/s wr, 26 op/s 2023-05-08T10:43:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:18 smithi096 ceph-mon[124666]: pgmap v13462: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 482 KiB/s rd, 508 KiB/s wr, 26 op/s 2023-05-08T10:43:19.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:18 smithi186 ceph-mon[126480]: pgmap v13462: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 482 KiB/s rd, 508 KiB/s wr, 26 op/s 2023-05-08T10:43:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25138.141401 secs 2023-05-08T10:43:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25138.697767 secs 2023-05-08T10:43:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:19 smithi133 ceph-mon[125939]: osdmap e919: 12 total, 12 up, 12 in 2023-05-08T10:43:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25138.141401 secs 2023-05-08T10:43:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25138.697767 secs 2023-05-08T10:43:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:19 smithi096 ceph-mon[124666]: osdmap e919: 12 total, 12 up, 12 in 2023-05-08T10:43:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25138.141401 secs 2023-05-08T10:43:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25138.697767 secs 2023-05-08T10:43:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:19 smithi186 ceph-mon[126480]: osdmap e919: 12 total, 12 up, 12 in 2023-05-08T10:43:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:20 smithi133 ceph-mon[125939]: pgmap v13464: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 227 KiB/s wr, 9 op/s 2023-05-08T10:43:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25139.984750 secs 2023-05-08T10:43:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:20 smithi096 ceph-mon[124666]: pgmap v13464: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 227 KiB/s wr, 9 op/s 2023-05-08T10:43:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25139.984750 secs 2023-05-08T10:43:21.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:20 smithi186 ceph-mon[126480]: pgmap v13464: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 227 KiB/s wr, 9 op/s 2023-05-08T10:43:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25139.984750 secs 2023-05-08T10:43:22.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:22 smithi133 ceph-mon[125939]: pgmap v13465: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 202 KiB/s wr, 8 op/s 2023-05-08T10:43:23.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:22 smithi096 ceph-mon[124666]: pgmap v13465: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 202 KiB/s wr, 8 op/s 2023-05-08T10:43:23.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:22 smithi186 ceph-mon[126480]: pgmap v13465: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 202 KiB/s wr, 8 op/s 2023-05-08T10:43:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25143.141524 secs 2023-05-08T10:43:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:24 smithi133 ceph-mon[125939]: pgmap v13466: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 202 KiB/s wr, 8 op/s 2023-05-08T10:43:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25143.697894 secs 2023-05-08T10:43:25.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25143.141524 secs 2023-05-08T10:43:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:24 smithi096 ceph-mon[124666]: pgmap v13466: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 202 KiB/s wr, 8 op/s 2023-05-08T10:43:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25143.697894 secs 2023-05-08T10:43:25.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25143.141524 secs 2023-05-08T10:43:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:24 smithi186 ceph-mon[126480]: pgmap v13466: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 202 KiB/s wr, 8 op/s 2023-05-08T10:43:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25143.697894 secs 2023-05-08T10:43:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25144.984869 secs 2023-05-08T10:43:26.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25144.984869 secs 2023-05-08T10:43:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25144.984869 secs 2023-05-08T10:43:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:26 smithi133 ceph-mon[125939]: pgmap v13467: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 84 KiB/s wr, 7 op/s 2023-05-08T10:43:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:26 smithi096 ceph-mon[124666]: pgmap v13467: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 84 KiB/s wr, 7 op/s 2023-05-08T10:43:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:26 smithi186 ceph-mon[126480]: pgmap v13467: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 84 KiB/s wr, 7 op/s 2023-05-08T10:43:27.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:27 smithi133 ceph-mon[125939]: pgmap v13468: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 84 KiB/s wr, 7 op/s 2023-05-08T10:43:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:27 smithi096 ceph-mon[124666]: pgmap v13468: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 84 KiB/s wr, 7 op/s 2023-05-08T10:43:28.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:27 smithi186 ceph-mon[126480]: pgmap v13468: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 84 KiB/s wr, 7 op/s 2023-05-08T10:43:29.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25148.141640 secs 2023-05-08T10:43:29.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25148.141640 secs 2023-05-08T10:43:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25148.141640 secs 2023-05-08T10:43:30.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25148.698046 secs 2023-05-08T10:43:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:29 smithi133 ceph-mon[125939]: pgmap v13469: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2023-05-08T10:43:30.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25148.698046 secs 2023-05-08T10:43:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:29 smithi096 ceph-mon[124666]: pgmap v13469: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2023-05-08T10:43:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25148.698046 secs 2023-05-08T10:43:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:29 smithi186 ceph-mon[126480]: pgmap v13469: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2023-05-08T10:43:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25149.984957 secs 2023-05-08T10:43:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25149.984957 secs 2023-05-08T10:43:32.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25149.984957 secs 2023-05-08T10:43:32.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:32 smithi186 ceph-mon[126480]: pgmap v13470: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:43:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:32 smithi133 ceph-mon[125939]: pgmap v13470: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:43:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:32 smithi096 ceph-mon[124666]: pgmap v13470: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:43:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25153.141754 secs 2023-05-08T10:43:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:34 smithi186 ceph-mon[126480]: pgmap v13471: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:43:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25153.698170 secs 2023-05-08T10:43:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25153.141754 secs 2023-05-08T10:43:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:34 smithi133 ceph-mon[125939]: pgmap v13471: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:43:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25153.698170 secs 2023-05-08T10:43:35.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25153.141754 secs 2023-05-08T10:43:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:34 smithi096 ceph-mon[124666]: pgmap v13471: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:43:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25153.698170 secs 2023-05-08T10:43:36.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25154.985082 secs 2023-05-08T10:43:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:36 smithi186 ceph-mon[126480]: pgmap v13472: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 9 op/s 2023-05-08T10:43:36.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25154.985082 secs 2023-05-08T10:43:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:36 smithi133 ceph-mon[125939]: pgmap v13472: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 9 op/s 2023-05-08T10:43:37.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25154.985082 secs 2023-05-08T10:43:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:36 smithi096 ceph-mon[124666]: pgmap v13472: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 9 op/s 2023-05-08T10:43:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:37 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:43:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:37 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:43:37.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:37 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:43:37.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:37 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:43:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:37 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:43:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:37 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:43:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:37 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:43:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:37 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:43:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:37 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:43:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:37 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:43:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:37 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:43:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:37 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:43:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:38 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:43:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:38 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T10:43:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:38 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T10:43:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:38 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:43:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:38 smithi186 ceph-mon[126480]: pgmap v13473: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T10:43:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:38 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:43:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:38 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T10:43:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:38 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T10:43:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:38 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:43:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:38 smithi133 ceph-mon[125939]: pgmap v13473: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T10:43:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:38 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:43:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:38 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T10:43:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:38 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T10:43:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:38 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:43:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:38 smithi096 ceph-mon[124666]: pgmap v13473: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T10:43:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25158.141850 secs 2023-05-08T10:43:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25158.698289 secs 2023-05-08T10:43:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25158.141850 secs 2023-05-08T10:43:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25158.698289 secs 2023-05-08T10:43:40.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25158.141850 secs 2023-05-08T10:43:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25158.698289 secs 2023-05-08T10:43:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:40 smithi186 ceph-mon[126480]: pgmap v13474: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 175 KiB/s wr, 10 op/s 2023-05-08T10:43:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:40 smithi133 ceph-mon[125939]: pgmap v13474: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 175 KiB/s wr, 10 op/s 2023-05-08T10:43:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:40 smithi096 ceph-mon[124666]: pgmap v13474: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 175 KiB/s wr, 10 op/s 2023-05-08T10:43:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25159.985196 secs 2023-05-08T10:43:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25159.985196 secs 2023-05-08T10:43:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25159.985196 secs 2023-05-08T10:43:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:42 smithi133 ceph-mon[125939]: pgmap v13475: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 175 KiB/s wr, 7 op/s 2023-05-08T10:43:43.010 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:42 smithi096 ceph-mon[124666]: pgmap v13475: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 175 KiB/s wr, 7 op/s 2023-05-08T10:43:43.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:42 smithi186 ceph-mon[126480]: pgmap v13475: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 175 KiB/s wr, 7 op/s 2023-05-08T10:43:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25163.141976 secs 2023-05-08T10:43:44.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:44 smithi133 ceph-mon[125939]: pgmap v13476: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 175 KiB/s wr, 7 op/s 2023-05-08T10:43:44.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25163.698405 secs 2023-05-08T10:43:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25163.141976 secs 2023-05-08T10:43:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:44 smithi096 ceph-mon[124666]: pgmap v13476: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 175 KiB/s wr, 7 op/s 2023-05-08T10:43:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25163.698405 secs 2023-05-08T10:43:45.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25163.141976 secs 2023-05-08T10:43:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:44 smithi186 ceph-mon[126480]: pgmap v13476: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 175 KiB/s wr, 7 op/s 2023-05-08T10:43:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25163.698405 secs 2023-05-08T10:43:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:46 smithi133 ceph-mon[125939]: pgmap v13477: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 175 KiB/s wr, 10 op/s 2023-05-08T10:43:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:46 smithi096 ceph-mon[124666]: pgmap v13477: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 175 KiB/s wr, 10 op/s 2023-05-08T10:43:47.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:46 smithi186 ceph-mon[126480]: pgmap v13477: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 175 KiB/s wr, 10 op/s 2023-05-08T10:43:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:48 smithi133 ceph-mon[125939]: pgmap v13478: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 175 KiB/s wr, 7 op/s 2023-05-08T10:43:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:43:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:48 smithi096 ceph-mon[124666]: pgmap v13478: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 175 KiB/s wr, 7 op/s 2023-05-08T10:43:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:43:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:48 smithi186 ceph-mon[126480]: pgmap v13478: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 175 KiB/s wr, 7 op/s 2023-05-08T10:43:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:43:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25168.142092 secs 2023-05-08T10:43:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:43:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:43:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:43:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25168.698525 secs 2023-05-08T10:43:50.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25168.142092 secs 2023-05-08T10:43:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:43:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:43:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:43:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25168.698525 secs 2023-05-08T10:43:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25168.142092 secs 2023-05-08T10:43:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:43:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:43:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:43:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25168.698525 secs 2023-05-08T10:43:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:50 smithi133 ceph-mon[125939]: pgmap v13479: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 292 KiB/s wr, 10 op/s 2023-05-08T10:43:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:50 smithi096 ceph-mon[124666]: pgmap v13479: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 292 KiB/s wr, 10 op/s 2023-05-08T10:43:51.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:50 smithi186 ceph-mon[126480]: pgmap v13479: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 292 KiB/s wr, 10 op/s 2023-05-08T10:43:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:52 smithi133 ceph-mon[125939]: pgmap v13480: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 118 KiB/s wr, 6 op/s 2023-05-08T10:43:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:52 smithi096 ceph-mon[124666]: pgmap v13480: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 118 KiB/s wr, 6 op/s 2023-05-08T10:43:53.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:52 smithi186 ceph-mon[126480]: pgmap v13480: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 118 KiB/s wr, 6 op/s 2023-05-08T10:43:54.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25173.142205 secs 2023-05-08T10:43:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:54 smithi133 ceph-mon[125939]: pgmap v13481: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 118 KiB/s wr, 6 op/s 2023-05-08T10:43:55.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25173.142205 secs 2023-05-08T10:43:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:54 smithi096 ceph-mon[124666]: pgmap v13481: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 118 KiB/s wr, 6 op/s 2023-05-08T10:43:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25173.142205 secs 2023-05-08T10:43:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:54 smithi186 ceph-mon[126480]: pgmap v13481: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 118 KiB/s wr, 6 op/s 2023-05-08T10:43:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:56 smithi133 ceph-mon[125939]: pgmap v13482: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 694 KiB/s rd, 358 KiB/s wr, 11 op/s 2023-05-08T10:43:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:43:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:56 smithi096 ceph-mon[124666]: pgmap v13482: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 694 KiB/s rd, 358 KiB/s wr, 11 op/s 2023-05-08T10:43:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:43:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:56 smithi186 ceph-mon[126480]: pgmap v13482: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 694 KiB/s rd, 358 KiB/s wr, 11 op/s 2023-05-08T10:43:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:43:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:57 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:43:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:43:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:43:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:57 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:43:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:43:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:43:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:57 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:43:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:43:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:43:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:58 smithi133 ceph-mon[125939]: pgmap v13483: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 357 KiB/s wr, 7 op/s 2023-05-08T10:43:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:58 smithi096 ceph-mon[124666]: pgmap v13483: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 357 KiB/s wr, 7 op/s 2023-05-08T10:43:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:58 smithi186 ceph-mon[126480]: pgmap v13483: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 357 KiB/s wr, 7 op/s 2023-05-08T10:43:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25178.142321 secs 2023-05-08T10:43:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:43:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25178.698767 secs 2023-05-08T10:44:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25178.142321 secs 2023-05-08T10:44:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:43:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25178.698767 secs 2023-05-08T10:44:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25178.142321 secs 2023-05-08T10:44:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:43:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25178.698767 secs 2023-05-08T10:44:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:00 smithi133 ceph-mon[125939]: pgmap v13484: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 843 KiB/s rd, 670 KiB/s wr, 14 op/s 2023-05-08T10:44:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25179.985731 secs 2023-05-08T10:44:01.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:00 smithi096 ceph-mon[124666]: pgmap v13484: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 843 KiB/s rd, 670 KiB/s wr, 14 op/s 2023-05-08T10:44:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25179.985731 secs 2023-05-08T10:44:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:00 smithi186 ceph-mon[126480]: pgmap v13484: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 843 KiB/s rd, 670 KiB/s wr, 14 op/s 2023-05-08T10:44:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25179.985731 secs 2023-05-08T10:44:01.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:44:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:44:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:01 smithi133 ceph-mon[125939]: pgmap v13485: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 629 KiB/s rd, 553 KiB/s wr, 10 op/s 2023-05-08T10:44:02.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:44:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:44:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:01 smithi096 ceph-mon[124666]: pgmap v13485: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 629 KiB/s rd, 553 KiB/s wr, 10 op/s 2023-05-08T10:44:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:44:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:44:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:01 smithi186 ceph-mon[126480]: pgmap v13485: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 629 KiB/s rd, 553 KiB/s wr, 10 op/s 2023-05-08T10:44:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25183.142444 secs 2023-05-08T10:44:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:04 smithi186 ceph-mon[126480]: pgmap v13486: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 629 KiB/s rd, 553 KiB/s wr, 10 op/s 2023-05-08T10:44:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:04 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:44:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25183.142444 secs 2023-05-08T10:44:04.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:04 smithi133 ceph-mon[125939]: pgmap v13486: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 629 KiB/s rd, 553 KiB/s wr, 10 op/s 2023-05-08T10:44:04.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:04 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:44:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25183.142444 secs 2023-05-08T10:44:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:04 smithi096 ceph-mon[124666]: pgmap v13486: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 629 KiB/s rd, 553 KiB/s wr, 10 op/s 2023-05-08T10:44:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:04 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:44:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:44:05.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:44:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:44:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:44:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:44:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:44:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25184.985861 secs 2023-05-08T10:44:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:06 smithi133 ceph-mon[125939]: pgmap v13487: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 746 KiB/s rd, 682 KiB/s wr, 17 op/s 2023-05-08T10:44:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25184.985861 secs 2023-05-08T10:44:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:06 smithi096 ceph-mon[124666]: pgmap v13487: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 746 KiB/s rd, 682 KiB/s wr, 17 op/s 2023-05-08T10:44:07.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25184.985861 secs 2023-05-08T10:44:07.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:06 smithi186 ceph-mon[126480]: pgmap v13487: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 746 KiB/s rd, 682 KiB/s wr, 17 op/s 2023-05-08T10:44:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:08 smithi133 ceph-mon[125939]: pgmap v13488: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 442 KiB/s wr, 13 op/s 2023-05-08T10:44:08.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:08 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:44:09.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:08 smithi096 ceph-mon[124666]: pgmap v13488: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 442 KiB/s wr, 13 op/s 2023-05-08T10:44:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:08 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:44:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:08 smithi186 ceph-mon[126480]: pgmap v13488: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 442 KiB/s wr, 13 op/s 2023-05-08T10:44:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:08 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:44:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25188.142574 secs 2023-05-08T10:44:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:44:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:44:09.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25188.698969 secs 2023-05-08T10:44:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25188.142574 secs 2023-05-08T10:44:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:44:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:44:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25188.698969 secs 2023-05-08T10:44:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25188.142574 secs 2023-05-08T10:44:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:44:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:44:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25188.698969 secs 2023-05-08T10:44:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:10 smithi133 ceph-mon[125939]: pgmap v13489: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 702 KiB/s rd, 725 KiB/s wr, 31 op/s 2023-05-08T10:44:11.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:10 smithi096 ceph-mon[124666]: pgmap v13489: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 702 KiB/s rd, 725 KiB/s wr, 31 op/s 2023-05-08T10:44:11.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:10 smithi186 ceph-mon[126480]: pgmap v13489: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 702 KiB/s rd, 725 KiB/s wr, 31 op/s 2023-05-08T10:44:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25189.985957 secs 2023-05-08T10:44:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:11 smithi133 ceph-mon[125939]: osdmap e920: 12 total, 12 up, 12 in 2023-05-08T10:44:12.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25189.985957 secs 2023-05-08T10:44:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:11 smithi096 ceph-mon[124666]: osdmap e920: 12 total, 12 up, 12 in 2023-05-08T10:44:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25189.985957 secs 2023-05-08T10:44:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:11 smithi186 ceph-mon[126480]: osdmap e920: 12 total, 12 up, 12 in 2023-05-08T10:44:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:12 smithi133 ceph-mon[125939]: pgmap v13491: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 495 KiB/s wr, 29 op/s 2023-05-08T10:44:13.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:12 smithi096 ceph-mon[124666]: pgmap v13491: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 495 KiB/s wr, 29 op/s 2023-05-08T10:44:13.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:12 smithi186 ceph-mon[126480]: pgmap v13491: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 495 KiB/s wr, 29 op/s 2023-05-08T10:44:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:13 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:44:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:44:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:13 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:44:14.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:13 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:44:14.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:44:14.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:13 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:44:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:13 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:44:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:44:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:13 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:44:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25193.142692 secs 2023-05-08T10:44:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:14 smithi133 ceph-mon[125939]: pgmap v13492: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 495 KiB/s wr, 29 op/s 2023-05-08T10:44:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25193.699087 secs 2023-05-08T10:44:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25193.142692 secs 2023-05-08T10:44:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:14 smithi096 ceph-mon[124666]: pgmap v13492: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 495 KiB/s wr, 29 op/s 2023-05-08T10:44:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25193.699087 secs 2023-05-08T10:44:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25193.142692 secs 2023-05-08T10:44:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:14 smithi186 ceph-mon[126480]: pgmap v13492: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 495 KiB/s wr, 29 op/s 2023-05-08T10:44:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25193.699087 secs 2023-05-08T10:44:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25194.986081 secs 2023-05-08T10:44:16.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25194.986081 secs 2023-05-08T10:44:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25194.986081 secs 2023-05-08T10:44:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:16 smithi133 ceph-mon[125939]: pgmap v13493: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 458 KiB/s wr, 26 op/s 2023-05-08T10:44:17.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:16 smithi096 ceph-mon[124666]: pgmap v13493: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 458 KiB/s wr, 26 op/s 2023-05-08T10:44:17.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:16 smithi186 ceph-mon[126480]: pgmap v13493: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 458 KiB/s wr, 26 op/s 2023-05-08T10:44:18.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:18 smithi133 ceph-mon[125939]: pgmap v13494: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 458 KiB/s wr, 26 op/s 2023-05-08T10:44:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:18 smithi096 ceph-mon[124666]: pgmap v13494: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 458 KiB/s wr, 26 op/s 2023-05-08T10:44:19.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:18 smithi186 ceph-mon[126480]: pgmap v13494: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 458 KiB/s wr, 26 op/s 2023-05-08T10:44:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25198.142810 secs 2023-05-08T10:44:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25198.699195 secs 2023-05-08T10:44:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:19 smithi133 ceph-mon[125939]: osdmap e921: 12 total, 12 up, 12 in 2023-05-08T10:44:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25198.142810 secs 2023-05-08T10:44:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25198.699195 secs 2023-05-08T10:44:20.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:19 smithi096 ceph-mon[124666]: osdmap e921: 12 total, 12 up, 12 in 2023-05-08T10:44:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25198.142810 secs 2023-05-08T10:44:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25198.699195 secs 2023-05-08T10:44:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:19 smithi186 ceph-mon[126480]: osdmap e921: 12 total, 12 up, 12 in 2023-05-08T10:44:20.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:20 smithi133 ceph-mon[125939]: pgmap v13496: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 227 KiB/s wr, 8 op/s 2023-05-08T10:44:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25199.986205 secs 2023-05-08T10:44:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:20 smithi096 ceph-mon[124666]: pgmap v13496: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 227 KiB/s wr, 8 op/s 2023-05-08T10:44:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25199.986205 secs 2023-05-08T10:44:21.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:20 smithi186 ceph-mon[126480]: pgmap v13496: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 227 KiB/s wr, 8 op/s 2023-05-08T10:44:21.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25199.986205 secs 2023-05-08T10:44:22.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:22 smithi133 ceph-mon[125939]: pgmap v13497: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 203 KiB/s wr, 7 op/s 2023-05-08T10:44:23.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:22 smithi096 ceph-mon[124666]: pgmap v13497: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 203 KiB/s wr, 7 op/s 2023-05-08T10:44:23.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:22 smithi186 ceph-mon[126480]: pgmap v13497: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 203 KiB/s wr, 7 op/s 2023-05-08T10:44:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25203.142925 secs 2023-05-08T10:44:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:24 smithi133 ceph-mon[125939]: pgmap v13498: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 203 KiB/s wr, 7 op/s 2023-05-08T10:44:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25203.699307 secs 2023-05-08T10:44:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25203.142925 secs 2023-05-08T10:44:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:24 smithi096 ceph-mon[124666]: pgmap v13498: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 203 KiB/s wr, 7 op/s 2023-05-08T10:44:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25203.699307 secs 2023-05-08T10:44:25.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25203.142925 secs 2023-05-08T10:44:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:24 smithi186 ceph-mon[126480]: pgmap v13498: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 203 KiB/s wr, 7 op/s 2023-05-08T10:44:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25203.699307 secs 2023-05-08T10:44:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25204.986325 secs 2023-05-08T10:44:26.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25204.986325 secs 2023-05-08T10:44:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25204.986325 secs 2023-05-08T10:44:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:26 smithi133 ceph-mon[125939]: pgmap v13499: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 84 KiB/s wr, 6 op/s 2023-05-08T10:44:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:26 smithi096 ceph-mon[124666]: pgmap v13499: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 84 KiB/s wr, 6 op/s 2023-05-08T10:44:27.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:26 smithi186 ceph-mon[126480]: pgmap v13499: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 84 KiB/s wr, 6 op/s 2023-05-08T10:44:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:27 smithi133 ceph-mon[125939]: pgmap v13500: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 84 KiB/s wr, 6 op/s 2023-05-08T10:44:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:27 smithi096 ceph-mon[124666]: pgmap v13500: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 84 KiB/s wr, 6 op/s 2023-05-08T10:44:28.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:27 smithi186 ceph-mon[126480]: pgmap v13500: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 84 KiB/s wr, 6 op/s 2023-05-08T10:44:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25208.143042 secs 2023-05-08T10:44:29.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25208.143042 secs 2023-05-08T10:44:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25208.143042 secs 2023-05-08T10:44:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25208.699424 secs 2023-05-08T10:44:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:29 smithi133 ceph-mon[125939]: pgmap v13501: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T10:44:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25208.699424 secs 2023-05-08T10:44:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:29 smithi096 ceph-mon[124666]: pgmap v13501: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T10:44:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25208.699424 secs 2023-05-08T10:44:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:29 smithi186 ceph-mon[126480]: pgmap v13501: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T10:44:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25209.986475 secs 2023-05-08T10:44:31.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25209.986475 secs 2023-05-08T10:44:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25209.986475 secs 2023-05-08T10:44:32.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:32 smithi186 ceph-mon[126480]: pgmap v13502: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:44:32.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:32 smithi133 ceph-mon[125939]: pgmap v13502: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:44:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:32 smithi096 ceph-mon[124666]: pgmap v13502: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:44:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25213.143160 secs 2023-05-08T10:44:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:34 smithi186 ceph-mon[126480]: pgmap v13503: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:44:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25213.699544 secs 2023-05-08T10:44:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25213.143160 secs 2023-05-08T10:44:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:34 smithi133 ceph-mon[125939]: pgmap v13503: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:44:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25213.699544 secs 2023-05-08T10:44:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25213.143160 secs 2023-05-08T10:44:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:34 smithi096 ceph-mon[124666]: pgmap v13503: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:44:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25213.699544 secs 2023-05-08T10:44:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25214.986602 secs 2023-05-08T10:44:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:36 smithi133 ceph-mon[125939]: pgmap v13504: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 7 op/s 2023-05-08T10:44:37.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25214.986602 secs 2023-05-08T10:44:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:36 smithi096 ceph-mon[124666]: pgmap v13504: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 7 op/s 2023-05-08T10:44:37.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25214.986602 secs 2023-05-08T10:44:37.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:36 smithi186 ceph-mon[126480]: pgmap v13504: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 7 op/s 2023-05-08T10:44:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:37 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:44:38.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:37 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:44:38.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:37 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:44:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:38 smithi133 ceph-mon[125939]: pgmap v13505: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T10:44:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:44:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:44:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:44:38.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:44:38.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:44:38.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:44:38.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:44:38.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:44:38.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:44:39.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:38 smithi096 ceph-mon[124666]: pgmap v13505: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T10:44:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:44:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:44:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:44:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:44:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:44:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:44:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:44:39.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:44:39.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:44:39.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:38 smithi186 ceph-mon[126480]: pgmap v13505: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T10:44:39.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:44:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:44:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:44:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:44:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:44:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:44:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:44:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:44:39.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:44:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25218.143227 secs 2023-05-08T10:44:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:39 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:44:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:39 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T10:44:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:39 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T10:44:39.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:39 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:44:39.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25218.699603 secs 2023-05-08T10:44:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25218.143227 secs 2023-05-08T10:44:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:39 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:44:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:39 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T10:44:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:39 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T10:44:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:39 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:44:40.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25218.699603 secs 2023-05-08T10:44:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25218.143227 secs 2023-05-08T10:44:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:39 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:44:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:39 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T10:44:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:39 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T10:44:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:39 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:44:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25218.699603 secs 2023-05-08T10:44:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:40 smithi133 ceph-mon[125939]: pgmap v13506: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 88 KiB/s wr, 8 op/s 2023-05-08T10:44:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:40 smithi096 ceph-mon[124666]: pgmap v13506: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 88 KiB/s wr, 8 op/s 2023-05-08T10:44:41.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:40 smithi186 ceph-mon[126480]: pgmap v13506: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 88 KiB/s wr, 8 op/s 2023-05-08T10:44:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25219.986699 secs 2023-05-08T10:44:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25219.986699 secs 2023-05-08T10:44:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25219.986699 secs 2023-05-08T10:44:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:42 smithi133 ceph-mon[125939]: pgmap v13507: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 88 KiB/s wr, 6 op/s 2023-05-08T10:44:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:42 smithi096 ceph-mon[124666]: pgmap v13507: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 88 KiB/s wr, 6 op/s 2023-05-08T10:44:43.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:42 smithi186 ceph-mon[126480]: pgmap v13507: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 88 KiB/s wr, 6 op/s 2023-05-08T10:44:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25223.143351 secs 2023-05-08T10:44:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:44 smithi133 ceph-mon[125939]: pgmap v13508: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 88 KiB/s wr, 6 op/s 2023-05-08T10:44:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25223.699715 secs 2023-05-08T10:44:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25223.143351 secs 2023-05-08T10:44:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:44 smithi096 ceph-mon[124666]: pgmap v13508: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 88 KiB/s wr, 6 op/s 2023-05-08T10:44:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25223.699715 secs 2023-05-08T10:44:45.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25223.143351 secs 2023-05-08T10:44:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:44 smithi186 ceph-mon[126480]: pgmap v13508: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 88 KiB/s wr, 6 op/s 2023-05-08T10:44:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25223.699715 secs 2023-05-08T10:44:46.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:46 smithi133 ceph-mon[125939]: pgmap v13509: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 89 KiB/s wr, 10 op/s 2023-05-08T10:44:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:46 smithi096 ceph-mon[124666]: pgmap v13509: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 89 KiB/s wr, 10 op/s 2023-05-08T10:44:47.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:46 smithi186 ceph-mon[126480]: pgmap v13509: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 89 KiB/s wr, 10 op/s 2023-05-08T10:44:48.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:48 smithi133 ceph-mon[125939]: pgmap v13510: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 89 KiB/s wr, 7 op/s 2023-05-08T10:44:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:44:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:48 smithi096 ceph-mon[124666]: pgmap v13510: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 89 KiB/s wr, 7 op/s 2023-05-08T10:44:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:44:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:48 smithi186 ceph-mon[126480]: pgmap v13510: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 89 KiB/s wr, 7 op/s 2023-05-08T10:44:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:44:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25228.143400 secs 2023-05-08T10:44:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:44:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:44:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:44:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25228.699830 secs 2023-05-08T10:44:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25228.143400 secs 2023-05-08T10:44:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:44:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:44:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:44:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25228.699830 secs 2023-05-08T10:44:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25228.143400 secs 2023-05-08T10:44:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:44:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:44:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:44:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25228.699830 secs 2023-05-08T10:44:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:50 smithi133 ceph-mon[125939]: pgmap v13511: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 450 KiB/s wr, 11 op/s 2023-05-08T10:44:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:50 smithi096 ceph-mon[124666]: pgmap v13511: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 450 KiB/s wr, 11 op/s 2023-05-08T10:44:51.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:50 smithi186 ceph-mon[126480]: pgmap v13511: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 450 KiB/s wr, 11 op/s 2023-05-08T10:44:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:52 smithi133 ceph-mon[125939]: pgmap v13512: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 362 KiB/s wr, 7 op/s 2023-05-08T10:44:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:52 smithi096 ceph-mon[124666]: pgmap v13512: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 362 KiB/s wr, 7 op/s 2023-05-08T10:44:53.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:52 smithi186 ceph-mon[126480]: pgmap v13512: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 362 KiB/s wr, 7 op/s 2023-05-08T10:44:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25233.143526 secs 2023-05-08T10:44:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:54 smithi133 ceph-mon[125939]: pgmap v13513: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 362 KiB/s wr, 7 op/s 2023-05-08T10:44:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25233.143526 secs 2023-05-08T10:44:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:54 smithi096 ceph-mon[124666]: pgmap v13513: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 362 KiB/s wr, 7 op/s 2023-05-08T10:44:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25233.143526 secs 2023-05-08T10:44:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:54 smithi186 ceph-mon[126480]: pgmap v13513: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 362 KiB/s wr, 7 op/s 2023-05-08T10:44:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:56 smithi133 ceph-mon[125939]: pgmap v13514: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 551 KiB/s wr, 12 op/s 2023-05-08T10:44:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:44:57.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:56 smithi096 ceph-mon[124666]: pgmap v13514: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 551 KiB/s wr, 12 op/s 2023-05-08T10:44:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:44:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:56 smithi186 ceph-mon[126480]: pgmap v13514: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 551 KiB/s wr, 12 op/s 2023-05-08T10:44:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:44:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:57 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:44:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:44:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:44:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:57 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:44:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:44:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:44:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:57 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:44:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:44:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:44:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:58 smithi133 ceph-mon[125939]: pgmap v13515: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 551 KiB/s wr, 8 op/s 2023-05-08T10:44:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:58 smithi096 ceph-mon[124666]: pgmap v13515: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 551 KiB/s wr, 8 op/s 2023-05-08T10:44:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:58 smithi186 ceph-mon[126480]: pgmap v13515: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 551 KiB/s wr, 8 op/s 2023-05-08T10:44:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:44:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25238.143649 secs 2023-05-08T10:45:00.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:44:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25238.143649 secs 2023-05-08T10:45:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:44:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25238.143649 secs 2023-05-08T10:45:00.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:00 smithi133 ceph-mon[125939]: pgmap v13516: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 784 KiB/s rd, 896 KiB/s wr, 14 op/s 2023-05-08T10:45:00.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25239.987191 secs 2023-05-08T10:45:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:00 smithi096 ceph-mon[124666]: pgmap v13516: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 784 KiB/s rd, 896 KiB/s wr, 14 op/s 2023-05-08T10:45:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25239.987191 secs 2023-05-08T10:45:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:00 smithi186 ceph-mon[126480]: pgmap v13516: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 784 KiB/s rd, 896 KiB/s wr, 14 op/s 2023-05-08T10:45:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25239.987191 secs 2023-05-08T10:45:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:01 smithi133 ceph-mon[125939]: pgmap v13517: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 534 KiB/s wr, 11 op/s 2023-05-08T10:45:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:01 smithi096 ceph-mon[124666]: pgmap v13517: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 534 KiB/s wr, 11 op/s 2023-05-08T10:45:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:01 smithi186 ceph-mon[126480]: pgmap v13517: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 534 KiB/s wr, 11 op/s 2023-05-08T10:45:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25243.143769 secs 2023-05-08T10:45:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:04 smithi133 ceph-mon[125939]: pgmap v13518: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 534 KiB/s wr, 11 op/s 2023-05-08T10:45:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25243.700195 secs 2023-05-08T10:45:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25243.143769 secs 2023-05-08T10:45:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:04 smithi096 ceph-mon[124666]: pgmap v13518: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 534 KiB/s wr, 11 op/s 2023-05-08T10:45:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25243.700195 secs 2023-05-08T10:45:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25243.143769 secs 2023-05-08T10:45:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:04 smithi186 ceph-mon[126480]: pgmap v13518: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 534 KiB/s wr, 11 op/s 2023-05-08T10:45:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25243.700195 secs 2023-05-08T10:45:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:05 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:45:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:45:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:45:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:05 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:45:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:45:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:45:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:05 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:45:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:45:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:45:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25244.987312 secs 2023-05-08T10:45:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:06 smithi133 ceph-mon[125939]: pgmap v13519: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 673 KiB/s rd, 681 KiB/s wr, 30 op/s 2023-05-08T10:45:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25244.987312 secs 2023-05-08T10:45:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:06 smithi096 ceph-mon[124666]: pgmap v13519: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 673 KiB/s rd, 681 KiB/s wr, 30 op/s 2023-05-08T10:45:07.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25244.987312 secs 2023-05-08T10:45:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:06 smithi186 ceph-mon[126480]: pgmap v13519: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 673 KiB/s rd, 681 KiB/s wr, 30 op/s 2023-05-08T10:45:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:08 smithi133 ceph-mon[125939]: pgmap v13520: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 492 KiB/s wr, 25 op/s 2023-05-08T10:45:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:08 smithi096 ceph-mon[124666]: pgmap v13520: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 492 KiB/s wr, 25 op/s 2023-05-08T10:45:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:08 smithi186 ceph-mon[126480]: pgmap v13520: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 492 KiB/s wr, 25 op/s 2023-05-08T10:45:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25248.143885 secs 2023-05-08T10:45:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:45:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:45:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25248.700310 secs 2023-05-08T10:45:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25248.143885 secs 2023-05-08T10:45:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:45:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:45:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25248.700310 secs 2023-05-08T10:45:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25248.143885 secs 2023-05-08T10:45:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:45:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:45:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25248.700310 secs 2023-05-08T10:45:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:10 smithi133 ceph-mon[125939]: pgmap v13521: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 512 KiB/s rd, 580 KiB/s wr, 28 op/s 2023-05-08T10:45:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25249.987438 secs 2023-05-08T10:45:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:10 smithi096 ceph-mon[124666]: pgmap v13521: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 512 KiB/s rd, 580 KiB/s wr, 28 op/s 2023-05-08T10:45:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25249.987438 secs 2023-05-08T10:45:11.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:10 smithi186 ceph-mon[126480]: pgmap v13521: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 512 KiB/s rd, 580 KiB/s wr, 28 op/s 2023-05-08T10:45:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25249.987438 secs 2023-05-08T10:45:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:11 smithi133 ceph-mon[125939]: osdmap e922: 12 total, 12 up, 12 in 2023-05-08T10:45:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:11 smithi096 ceph-mon[124666]: osdmap e922: 12 total, 12 up, 12 in 2023-05-08T10:45:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:11 smithi186 ceph-mon[126480]: osdmap e922: 12 total, 12 up, 12 in 2023-05-08T10:45:12.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:12 smithi133 ceph-mon[125939]: pgmap v13523: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 283 KiB/s wr, 27 op/s 2023-05-08T10:45:13.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:12 smithi096 ceph-mon[124666]: pgmap v13523: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 283 KiB/s wr, 27 op/s 2023-05-08T10:45:13.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:12 smithi186 ceph-mon[126480]: pgmap v13523: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 283 KiB/s wr, 27 op/s 2023-05-08T10:45:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25253.144008 secs 2023-05-08T10:45:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:14 smithi133 ceph-mon[125939]: pgmap v13524: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 283 KiB/s wr, 27 op/s 2023-05-08T10:45:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25253.700446 secs 2023-05-08T10:45:14.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:14 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:45:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25253.144008 secs 2023-05-08T10:45:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:14 smithi096 ceph-mon[124666]: pgmap v13524: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 283 KiB/s wr, 27 op/s 2023-05-08T10:45:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25253.700446 secs 2023-05-08T10:45:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:14 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:45:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25253.144008 secs 2023-05-08T10:45:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:14 smithi186 ceph-mon[126480]: pgmap v13524: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 283 KiB/s wr, 27 op/s 2023-05-08T10:45:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25253.700446 secs 2023-05-08T10:45:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:14 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:45:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25254.987549 secs 2023-05-08T10:45:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25254.987549 secs 2023-05-08T10:45:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25254.987549 secs 2023-05-08T10:45:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:16 smithi133 ceph-mon[125939]: pgmap v13525: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 106 KiB/s wr, 8 op/s 2023-05-08T10:45:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:16 smithi096 ceph-mon[124666]: pgmap v13525: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 106 KiB/s wr, 8 op/s 2023-05-08T10:45:17.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:16 smithi186 ceph-mon[126480]: pgmap v13525: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 106 KiB/s wr, 8 op/s 2023-05-08T10:45:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:18 smithi133 ceph-mon[125939]: pgmap v13526: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 106 KiB/s wr, 8 op/s 2023-05-08T10:45:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:18 smithi096 ceph-mon[124666]: pgmap v13526: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 106 KiB/s wr, 8 op/s 2023-05-08T10:45:19.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:18 smithi186 ceph-mon[126480]: pgmap v13526: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 106 KiB/s wr, 8 op/s 2023-05-08T10:45:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25258.144146 secs 2023-05-08T10:45:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25258.700559 secs 2023-05-08T10:45:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:19 smithi133 ceph-mon[125939]: osdmap e923: 12 total, 12 up, 12 in 2023-05-08T10:45:20.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25258.144146 secs 2023-05-08T10:45:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25258.700559 secs 2023-05-08T10:45:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:19 smithi096 ceph-mon[124666]: osdmap e923: 12 total, 12 up, 12 in 2023-05-08T10:45:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25258.144146 secs 2023-05-08T10:45:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25258.700559 secs 2023-05-08T10:45:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:19 smithi186 ceph-mon[126480]: osdmap e923: 12 total, 12 up, 12 in 2023-05-08T10:45:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:20 smithi133 ceph-mon[125939]: pgmap v13528: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 118 KiB/s wr, 8 op/s 2023-05-08T10:45:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25259.987677 secs 2023-05-08T10:45:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:20 smithi096 ceph-mon[124666]: pgmap v13528: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 118 KiB/s wr, 8 op/s 2023-05-08T10:45:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25259.987677 secs 2023-05-08T10:45:21.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:20 smithi186 ceph-mon[126480]: pgmap v13528: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 118 KiB/s wr, 8 op/s 2023-05-08T10:45:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25259.987677 secs 2023-05-08T10:45:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:21 smithi133 ceph-mon[125939]: pgmap v13529: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 105 KiB/s wr, 8 op/s 2023-05-08T10:45:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:21 smithi096 ceph-mon[124666]: pgmap v13529: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 105 KiB/s wr, 8 op/s 2023-05-08T10:45:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:21 smithi186 ceph-mon[126480]: pgmap v13529: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 105 KiB/s wr, 8 op/s 2023-05-08T10:45:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25263.144229 secs 2023-05-08T10:45:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:24 smithi133 ceph-mon[125939]: pgmap v13530: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 105 KiB/s wr, 8 op/s 2023-05-08T10:45:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25263.700698 secs 2023-05-08T10:45:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25263.144229 secs 2023-05-08T10:45:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:24 smithi096 ceph-mon[124666]: pgmap v13530: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 105 KiB/s wr, 8 op/s 2023-05-08T10:45:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25263.700698 secs 2023-05-08T10:45:25.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25263.144229 secs 2023-05-08T10:45:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:24 smithi186 ceph-mon[126480]: pgmap v13530: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 105 KiB/s wr, 8 op/s 2023-05-08T10:45:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25263.700698 secs 2023-05-08T10:45:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25264.987832 secs 2023-05-08T10:45:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:26 smithi133 ceph-mon[125939]: pgmap v13531: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 105 KiB/s wr, 6 op/s 2023-05-08T10:45:27.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25264.987832 secs 2023-05-08T10:45:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:26 smithi096 ceph-mon[124666]: pgmap v13531: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 105 KiB/s wr, 6 op/s 2023-05-08T10:45:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25264.987832 secs 2023-05-08T10:45:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:26 smithi186 ceph-mon[126480]: pgmap v13531: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 105 KiB/s wr, 6 op/s 2023-05-08T10:45:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:28 smithi133 ceph-mon[125939]: pgmap v13532: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 105 KiB/s wr, 6 op/s 2023-05-08T10:45:29.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:28 smithi096 ceph-mon[124666]: pgmap v13532: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 105 KiB/s wr, 6 op/s 2023-05-08T10:45:29.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:28 smithi186 ceph-mon[126480]: pgmap v13532: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 105 KiB/s wr, 6 op/s 2023-05-08T10:45:29.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25268.144358 secs 2023-05-08T10:45:29.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25268.700809 secs 2023-05-08T10:45:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25268.144358 secs 2023-05-08T10:45:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25268.700809 secs 2023-05-08T10:45:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25268.144358 secs 2023-05-08T10:45:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25268.700809 secs 2023-05-08T10:45:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:30 smithi133 ceph-mon[125939]: pgmap v13533: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T10:45:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:30 smithi096 ceph-mon[124666]: pgmap v13533: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T10:45:31.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:30 smithi186 ceph-mon[126480]: pgmap v13533: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T10:45:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25269.987919 secs 2023-05-08T10:45:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25269.987919 secs 2023-05-08T10:45:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25269.987919 secs 2023-05-08T10:45:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:32 smithi133 ceph-mon[125939]: pgmap v13534: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T10:45:33.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:32 smithi096 ceph-mon[124666]: pgmap v13534: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T10:45:33.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:32 smithi186 ceph-mon[126480]: pgmap v13534: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T10:45:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25273.144476 secs 2023-05-08T10:45:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:34 smithi133 ceph-mon[125939]: pgmap v13535: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T10:45:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25273.700932 secs 2023-05-08T10:45:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25273.144476 secs 2023-05-08T10:45:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:34 smithi096 ceph-mon[124666]: pgmap v13535: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T10:45:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25273.700932 secs 2023-05-08T10:45:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25273.144476 secs 2023-05-08T10:45:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:34 smithi186 ceph-mon[126480]: pgmap v13535: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T10:45:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25273.700932 secs 2023-05-08T10:45:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25274.988039 secs 2023-05-08T10:45:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25274.988039 secs 2023-05-08T10:45:36.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25274.988039 secs 2023-05-08T10:45:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:36 smithi133 ceph-mon[125939]: pgmap v13536: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 174 KiB/s wr, 9 op/s 2023-05-08T10:45:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:36 smithi096 ceph-mon[124666]: pgmap v13536: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 174 KiB/s wr, 9 op/s 2023-05-08T10:45:37.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:36 smithi186 ceph-mon[126480]: pgmap v13536: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 174 KiB/s wr, 9 op/s 2023-05-08T10:45:38.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:38 smithi133 ceph-mon[125939]: pgmap v13537: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 174 KiB/s wr, 6 op/s 2023-05-08T10:45:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:38 smithi096 ceph-mon[124666]: pgmap v13537: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 174 KiB/s wr, 6 op/s 2023-05-08T10:45:39.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:38 smithi186 ceph-mon[126480]: pgmap v13537: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 174 KiB/s wr, 6 op/s 2023-05-08T10:45:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25278.144590 secs 2023-05-08T10:45:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:45:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25278.701021 secs 2023-05-08T10:45:39.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:45:39.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:45:39.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:45:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25278.144590 secs 2023-05-08T10:45:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:45:40.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25278.701021 secs 2023-05-08T10:45:40.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:45:40.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:45:40.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:45:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25278.144590 secs 2023-05-08T10:45:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:45:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25278.701021 secs 2023-05-08T10:45:40.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:45:40.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:45:40.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:45:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:40 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:45:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:40 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T10:45:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:40 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T10:45:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:40 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:45:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:40 smithi133 ceph-mon[125939]: pgmap v13538: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 174 KiB/s wr, 9 op/s 2023-05-08T10:45:40.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25279.988145 secs 2023-05-08T10:45:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:40 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:45:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:40 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T10:45:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:40 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T10:45:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:40 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:45:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:40 smithi096 ceph-mon[124666]: pgmap v13538: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 174 KiB/s wr, 9 op/s 2023-05-08T10:45:41.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25279.988145 secs 2023-05-08T10:45:41.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:40 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:45:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:40 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T10:45:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:40 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T10:45:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:40 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:45:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:40 smithi186 ceph-mon[126480]: pgmap v13538: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 174 KiB/s wr, 9 op/s 2023-05-08T10:45:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25279.988145 secs 2023-05-08T10:45:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:42 smithi133 ceph-mon[125939]: pgmap v13539: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 174 KiB/s wr, 7 op/s 2023-05-08T10:45:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:42 smithi096 ceph-mon[124666]: pgmap v13539: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 174 KiB/s wr, 7 op/s 2023-05-08T10:45:43.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:42 smithi186 ceph-mon[126480]: pgmap v13539: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 174 KiB/s wr, 7 op/s 2023-05-08T10:45:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25283.144723 secs 2023-05-08T10:45:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:44 smithi133 ceph-mon[125939]: pgmap v13540: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 173 KiB/s wr, 6 op/s 2023-05-08T10:45:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25283.701111 secs 2023-05-08T10:45:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25283.144723 secs 2023-05-08T10:45:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:44 smithi096 ceph-mon[124666]: pgmap v13540: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 173 KiB/s wr, 6 op/s 2023-05-08T10:45:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25283.701111 secs 2023-05-08T10:45:45.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25283.144723 secs 2023-05-08T10:45:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:44 smithi186 ceph-mon[126480]: pgmap v13540: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 173 KiB/s wr, 6 op/s 2023-05-08T10:45:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25283.701111 secs 2023-05-08T10:45:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:46 smithi133 ceph-mon[125939]: pgmap v13541: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 202 KiB/s wr, 9 op/s 2023-05-08T10:45:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:46 smithi096 ceph-mon[124666]: pgmap v13541: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 202 KiB/s wr, 9 op/s 2023-05-08T10:45:47.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:46 smithi186 ceph-mon[126480]: pgmap v13541: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 202 KiB/s wr, 9 op/s 2023-05-08T10:45:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:48 smithi133 ceph-mon[125939]: pgmap v13542: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 29 KiB/s wr, 6 op/s 2023-05-08T10:45:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:45:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:48 smithi096 ceph-mon[124666]: pgmap v13542: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 29 KiB/s wr, 6 op/s 2023-05-08T10:45:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:45:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:48 smithi186 ceph-mon[126480]: pgmap v13542: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 29 KiB/s wr, 6 op/s 2023-05-08T10:45:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:45:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25288.144840 secs 2023-05-08T10:45:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:45:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:45:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:45:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25288.701238 secs 2023-05-08T10:45:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25288.144840 secs 2023-05-08T10:45:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:45:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:45:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:45:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25288.701238 secs 2023-05-08T10:45:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25288.144840 secs 2023-05-08T10:45:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:45:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:45:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:45:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25288.701238 secs 2023-05-08T10:45:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:50 smithi133 ceph-mon[125939]: pgmap v13543: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 322 KiB/s rd, 87 KiB/s wr, 9 op/s 2023-05-08T10:45:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:50 smithi096 ceph-mon[124666]: pgmap v13543: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 322 KiB/s rd, 87 KiB/s wr, 9 op/s 2023-05-08T10:45:51.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:50 smithi186 ceph-mon[126480]: pgmap v13543: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 322 KiB/s rd, 87 KiB/s wr, 9 op/s 2023-05-08T10:45:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:51 smithi096 ceph-mon[124666]: pgmap v13544: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 87 KiB/s wr, 7 op/s 2023-05-08T10:45:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:51 smithi186 ceph-mon[126480]: pgmap v13544: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 87 KiB/s wr, 7 op/s 2023-05-08T10:45:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:51 smithi133 ceph-mon[125939]: pgmap v13544: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 87 KiB/s wr, 7 op/s 2023-05-08T10:45:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25293.144976 secs 2023-05-08T10:45:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:54 smithi133 ceph-mon[125939]: pgmap v13545: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 86 KiB/s wr, 6 op/s 2023-05-08T10:45:55.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25293.144976 secs 2023-05-08T10:45:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:54 smithi096 ceph-mon[124666]: pgmap v13545: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 86 KiB/s wr, 6 op/s 2023-05-08T10:45:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25293.144976 secs 2023-05-08T10:45:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:54 smithi186 ceph-mon[126480]: pgmap v13545: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 86 KiB/s wr, 6 op/s 2023-05-08T10:45:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:56 smithi133 ceph-mon[125939]: pgmap v13546: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 376 KiB/s wr, 11 op/s 2023-05-08T10:45:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:45:57.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:56 smithi096 ceph-mon[124666]: pgmap v13546: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 376 KiB/s wr, 11 op/s 2023-05-08T10:45:57.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:45:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:56 smithi186 ceph-mon[126480]: pgmap v13546: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 376 KiB/s wr, 11 op/s 2023-05-08T10:45:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:45:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:57 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:45:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:45:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:45:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:57 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:45:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:45:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:45:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:57 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:45:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:45:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:45:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:58 smithi133 ceph-mon[125939]: pgmap v13547: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 348 KiB/s wr, 8 op/s 2023-05-08T10:45:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:58 smithi096 ceph-mon[124666]: pgmap v13547: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 348 KiB/s wr, 8 op/s 2023-05-08T10:45:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:58 smithi186 ceph-mon[126480]: pgmap v13547: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 348 KiB/s wr, 8 op/s 2023-05-08T10:45:59.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:45:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25298.145087 secs 2023-05-08T10:46:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:45:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25298.145087 secs 2023-05-08T10:46:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:45:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25298.145087 secs 2023-05-08T10:46:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:00 smithi133 ceph-mon[125939]: pgmap v13548: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 494 KiB/s rd, 643 KiB/s wr, 12 op/s 2023-05-08T10:46:01.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:00 smithi096 ceph-mon[124666]: pgmap v13548: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 494 KiB/s rd, 643 KiB/s wr, 12 op/s 2023-05-08T10:46:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:00 smithi186 ceph-mon[126480]: pgmap v13548: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 494 KiB/s rd, 643 KiB/s wr, 12 op/s 2023-05-08T10:46:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:02 smithi133 ceph-mon[125939]: pgmap v13549: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 601 KiB/s wr, 10 op/s 2023-05-08T10:46:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:02 smithi096 ceph-mon[124666]: pgmap v13549: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 601 KiB/s wr, 10 op/s 2023-05-08T10:46:03.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:02 smithi186 ceph-mon[126480]: pgmap v13549: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 601 KiB/s wr, 10 op/s 2023-05-08T10:46:04.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25303.145205 secs 2023-05-08T10:46:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:04 smithi133 ceph-mon[125939]: pgmap v13550: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 601 KiB/s wr, 9 op/s 2023-05-08T10:46:05.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25303.145205 secs 2023-05-08T10:46:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:04 smithi096 ceph-mon[124666]: pgmap v13550: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 601 KiB/s wr, 9 op/s 2023-05-08T10:46:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25303.145205 secs 2023-05-08T10:46:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:04 smithi186 ceph-mon[126480]: pgmap v13550: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 601 KiB/s wr, 9 op/s 2023-05-08T10:46:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25304.988825 secs 2023-05-08T10:46:06.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25304.988825 secs 2023-05-08T10:46:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25304.988825 secs 2023-05-08T10:46:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:06 smithi133 ceph-mon[125939]: pgmap v13551: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 894 KiB/s rd, 852 KiB/s wr, 17 op/s 2023-05-08T10:46:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:06 smithi096 ceph-mon[124666]: pgmap v13551: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 894 KiB/s rd, 852 KiB/s wr, 17 op/s 2023-05-08T10:46:07.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:06 smithi186 ceph-mon[126480]: pgmap v13551: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 894 KiB/s rd, 852 KiB/s wr, 17 op/s 2023-05-08T10:46:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:08 smithi133 ceph-mon[125939]: pgmap v13552: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 603 KiB/s rd, 561 KiB/s wr, 12 op/s 2023-05-08T10:46:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:08 smithi096 ceph-mon[124666]: pgmap v13552: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 603 KiB/s rd, 561 KiB/s wr, 12 op/s 2023-05-08T10:46:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:08 smithi186 ceph-mon[126480]: pgmap v13552: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 603 KiB/s rd, 561 KiB/s wr, 12 op/s 2023-05-08T10:46:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25308.145323 secs 2023-05-08T10:46:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:09 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:46:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:46:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:46:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25308.701707 secs 2023-05-08T10:46:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25308.145323 secs 2023-05-08T10:46:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:09 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:46:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:46:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:46:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25308.701707 secs 2023-05-08T10:46:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25308.145323 secs 2023-05-08T10:46:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:09 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:46:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:46:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:46:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25308.701707 secs 2023-05-08T10:46:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:10 smithi133 ceph-mon[125939]: pgmap v13553: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 700 KiB/s rd, 800 KiB/s wr, 30 op/s 2023-05-08T10:46:10.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25309.988923 secs 2023-05-08T10:46:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:10 smithi096 ceph-mon[124666]: pgmap v13553: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 700 KiB/s rd, 800 KiB/s wr, 30 op/s 2023-05-08T10:46:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25309.988923 secs 2023-05-08T10:46:11.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:10 smithi186 ceph-mon[126480]: pgmap v13553: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 700 KiB/s rd, 800 KiB/s wr, 30 op/s 2023-05-08T10:46:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25309.988923 secs 2023-05-08T10:46:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:11 smithi133 ceph-mon[125939]: osdmap e924: 12 total, 12 up, 12 in 2023-05-08T10:46:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:11 smithi133 ceph-mon[125939]: pgmap v13555: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 752 KiB/s rd, 587 KiB/s wr, 30 op/s 2023-05-08T10:46:12.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:11 smithi096 ceph-mon[124666]: osdmap e924: 12 total, 12 up, 12 in 2023-05-08T10:46:12.009 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:11 smithi096 ceph-mon[124666]: pgmap v13555: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 752 KiB/s rd, 587 KiB/s wr, 30 op/s 2023-05-08T10:46:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:11 smithi186 ceph-mon[126480]: osdmap e924: 12 total, 12 up, 12 in 2023-05-08T10:46:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:11 smithi186 ceph-mon[126480]: pgmap v13555: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 752 KiB/s rd, 587 KiB/s wr, 30 op/s 2023-05-08T10:46:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:46:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:13 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:46:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:13 smithi133 ceph-mon[125939]: pgmap v13556: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 752 KiB/s rd, 587 KiB/s wr, 30 op/s 2023-05-08T10:46:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:46:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:13 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:46:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:13 smithi096 ceph-mon[124666]: pgmap v13556: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 752 KiB/s rd, 587 KiB/s wr, 30 op/s 2023-05-08T10:46:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:46:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:13 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:46:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:13 smithi186 ceph-mon[126480]: pgmap v13556: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 752 KiB/s rd, 587 KiB/s wr, 30 op/s 2023-05-08T10:46:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25313.145433 secs 2023-05-08T10:46:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25313.701820 secs 2023-05-08T10:46:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:14 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:46:15.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25313.145433 secs 2023-05-08T10:46:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25313.701820 secs 2023-05-08T10:46:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:14 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:46:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25313.145433 secs 2023-05-08T10:46:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25313.701820 secs 2023-05-08T10:46:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:14 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:46:15.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25314.989039 secs 2023-05-08T10:46:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:15 smithi133 ceph-mon[125939]: pgmap v13557: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 470 KiB/s rd, 512 KiB/s wr, 26 op/s 2023-05-08T10:46:16.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25314.989039 secs 2023-05-08T10:46:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:15 smithi096 ceph-mon[124666]: pgmap v13557: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 470 KiB/s rd, 512 KiB/s wr, 26 op/s 2023-05-08T10:46:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25314.989039 secs 2023-05-08T10:46:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:15 smithi186 ceph-mon[126480]: pgmap v13557: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 470 KiB/s rd, 512 KiB/s wr, 26 op/s 2023-05-08T10:46:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:18 smithi133 ceph-mon[125939]: pgmap v13558: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 470 KiB/s rd, 512 KiB/s wr, 26 op/s 2023-05-08T10:46:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:18 smithi096 ceph-mon[124666]: pgmap v13558: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 470 KiB/s rd, 512 KiB/s wr, 26 op/s 2023-05-08T10:46:19.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:18 smithi186 ceph-mon[126480]: pgmap v13558: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 470 KiB/s rd, 512 KiB/s wr, 26 op/s 2023-05-08T10:46:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25318.145507 secs 2023-05-08T10:46:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25318.701934 secs 2023-05-08T10:46:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:19 smithi133 ceph-mon[125939]: osdmap e925: 12 total, 12 up, 12 in 2023-05-08T10:46:20.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25318.145507 secs 2023-05-08T10:46:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25318.701934 secs 2023-05-08T10:46:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:19 smithi096 ceph-mon[124666]: osdmap e925: 12 total, 12 up, 12 in 2023-05-08T10:46:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25318.145507 secs 2023-05-08T10:46:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25318.701934 secs 2023-05-08T10:46:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:19 smithi186 ceph-mon[126480]: osdmap e925: 12 total, 12 up, 12 in 2023-05-08T10:46:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:20 smithi133 ceph-mon[125939]: pgmap v13560: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 495 KiB/s rd, 348 KiB/s wr, 8 op/s 2023-05-08T10:46:21.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:20 smithi096 ceph-mon[124666]: pgmap v13560: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 495 KiB/s rd, 348 KiB/s wr, 8 op/s 2023-05-08T10:46:21.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:20 smithi186 ceph-mon[126480]: pgmap v13560: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 495 KiB/s rd, 348 KiB/s wr, 8 op/s 2023-05-08T10:46:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25319.989163 secs 2023-05-08T10:46:22.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25319.989163 secs 2023-05-08T10:46:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25319.989163 secs 2023-05-08T10:46:22.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:22 smithi133 ceph-mon[125939]: pgmap v13561: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 310 KiB/s wr, 8 op/s 2023-05-08T10:46:23.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:22 smithi096 ceph-mon[124666]: pgmap v13561: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 310 KiB/s wr, 8 op/s 2023-05-08T10:46:23.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:22 smithi186 ceph-mon[126480]: pgmap v13561: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 310 KiB/s wr, 8 op/s 2023-05-08T10:46:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25323.145620 secs 2023-05-08T10:46:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:24 smithi133 ceph-mon[125939]: pgmap v13562: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 310 KiB/s wr, 8 op/s 2023-05-08T10:46:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25323.702049 secs 2023-05-08T10:46:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25323.145620 secs 2023-05-08T10:46:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:24 smithi096 ceph-mon[124666]: pgmap v13562: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 310 KiB/s wr, 8 op/s 2023-05-08T10:46:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25323.702049 secs 2023-05-08T10:46:25.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25323.145620 secs 2023-05-08T10:46:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:24 smithi186 ceph-mon[126480]: pgmap v13562: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 310 KiB/s wr, 8 op/s 2023-05-08T10:46:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25323.702049 secs 2023-05-08T10:46:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25324.989281 secs 2023-05-08T10:46:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25324.989281 secs 2023-05-08T10:46:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25324.989281 secs 2023-05-08T10:46:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:26 smithi133 ceph-mon[125939]: pgmap v13563: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 85 KiB/s wr, 6 op/s 2023-05-08T10:46:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:26 smithi096 ceph-mon[124666]: pgmap v13563: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 85 KiB/s wr, 6 op/s 2023-05-08T10:46:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:26 smithi186 ceph-mon[126480]: pgmap v13563: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 85 KiB/s wr, 6 op/s 2023-05-08T10:46:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:28 smithi133 ceph-mon[125939]: pgmap v13564: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 85 KiB/s wr, 6 op/s 2023-05-08T10:46:29.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:28 smithi096 ceph-mon[124666]: pgmap v13564: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 85 KiB/s wr, 6 op/s 2023-05-08T10:46:29.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:28 smithi186 ceph-mon[126480]: pgmap v13564: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 85 KiB/s wr, 6 op/s 2023-05-08T10:46:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25328.145747 secs 2023-05-08T10:46:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25328.702181 secs 2023-05-08T10:46:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25328.145747 secs 2023-05-08T10:46:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25328.702181 secs 2023-05-08T10:46:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25328.145747 secs 2023-05-08T10:46:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25328.702181 secs 2023-05-08T10:46:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:30 smithi133 ceph-mon[125939]: pgmap v13565: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T10:46:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25329.989421 secs 2023-05-08T10:46:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:30 smithi096 ceph-mon[124666]: pgmap v13565: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T10:46:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25329.989421 secs 2023-05-08T10:46:31.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:30 smithi186 ceph-mon[126480]: pgmap v13565: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T10:46:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25329.989421 secs 2023-05-08T10:46:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:32 smithi133 ceph-mon[125939]: pgmap v13566: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:46:33.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:32 smithi096 ceph-mon[124666]: pgmap v13566: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:46:33.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:32 smithi186 ceph-mon[126480]: pgmap v13566: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:46:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25333.145866 secs 2023-05-08T10:46:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:34 smithi133 ceph-mon[125939]: pgmap v13567: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:46:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25333.702295 secs 2023-05-08T10:46:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25333.145866 secs 2023-05-08T10:46:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:34 smithi096 ceph-mon[124666]: pgmap v13567: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:46:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25333.702295 secs 2023-05-08T10:46:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25333.145866 secs 2023-05-08T10:46:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:34 smithi186 ceph-mon[126480]: pgmap v13567: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:46:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25333.702295 secs 2023-05-08T10:46:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25334.989536 secs 2023-05-08T10:46:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25334.989536 secs 2023-05-08T10:46:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25334.989536 secs 2023-05-08T10:46:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:36 smithi133 ceph-mon[125939]: pgmap v13568: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T10:46:37.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:36 smithi096 ceph-mon[124666]: pgmap v13568: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T10:46:37.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:36 smithi186 ceph-mon[126480]: pgmap v13568: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T10:46:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:38 smithi133 ceph-mon[125939]: pgmap v13569: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T10:46:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:38 smithi096 ceph-mon[124666]: pgmap v13569: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T10:46:39.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:38 smithi186 ceph-mon[126480]: pgmap v13569: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T10:46:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25338.145987 secs 2023-05-08T10:46:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25338.702407 secs 2023-05-08T10:46:39.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:46:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25338.145987 secs 2023-05-08T10:46:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25338.702407 secs 2023-05-08T10:46:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:46:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25338.145987 secs 2023-05-08T10:46:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25338.702407 secs 2023-05-08T10:46:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:46:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:40 smithi133 ceph-mon[125939]: pgmap v13570: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 7 op/s 2023-05-08T10:46:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:40 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:46:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:40 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:46:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:40 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:46:40.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:40 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:46:40.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:40 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T10:46:40.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:40 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T10:46:40.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:40 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:46:40.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25339.989678 secs 2023-05-08T10:46:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:40 smithi096 ceph-mon[124666]: pgmap v13570: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 7 op/s 2023-05-08T10:46:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:40 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:46:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:40 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:46:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:40 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:46:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:40 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:46:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:40 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T10:46:41.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:40 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T10:46:41.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:40 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:46:41.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25339.989678 secs 2023-05-08T10:46:41.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:40 smithi186 ceph-mon[126480]: pgmap v13570: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 7 op/s 2023-05-08T10:46:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:40 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:46:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:40 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:46:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:40 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:46:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:40 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:46:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:40 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T10:46:41.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:40 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T10:46:41.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:40 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:46:41.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25339.989678 secs 2023-05-08T10:46:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:41 smithi133 ceph-mon[125939]: pgmap v13571: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T10:46:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:41 smithi096 ceph-mon[124666]: pgmap v13571: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T10:46:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:41 smithi186 ceph-mon[126480]: pgmap v13571: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T10:46:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25343.146083 secs 2023-05-08T10:46:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:44 smithi133 ceph-mon[125939]: pgmap v13572: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T10:46:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25343.702539 secs 2023-05-08T10:46:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25343.146083 secs 2023-05-08T10:46:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:44 smithi096 ceph-mon[124666]: pgmap v13572: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T10:46:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25343.702539 secs 2023-05-08T10:46:45.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25343.146083 secs 2023-05-08T10:46:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:44 smithi186 ceph-mon[126480]: pgmap v13572: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T10:46:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25343.702539 secs 2023-05-08T10:46:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:46 smithi133 ceph-mon[125939]: pgmap v13573: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 264 KiB/s wr, 9 op/s 2023-05-08T10:46:47.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:46 smithi096 ceph-mon[124666]: pgmap v13573: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 264 KiB/s wr, 9 op/s 2023-05-08T10:46:47.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:46 smithi186 ceph-mon[126480]: pgmap v13573: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 264 KiB/s wr, 9 op/s 2023-05-08T10:46:48.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:48 smithi133 ceph-mon[125939]: pgmap v13574: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 264 KiB/s wr, 6 op/s 2023-05-08T10:46:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:46:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:48 smithi096 ceph-mon[124666]: pgmap v13574: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 264 KiB/s wr, 6 op/s 2023-05-08T10:46:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:46:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:48 smithi186 ceph-mon[126480]: pgmap v13574: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 264 KiB/s wr, 6 op/s 2023-05-08T10:46:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:46:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25348.146199 secs 2023-05-08T10:46:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:46:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:46:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:46:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25348.146199 secs 2023-05-08T10:46:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:46:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:46:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:46:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25348.146199 secs 2023-05-08T10:46:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:46:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:46:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:46:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:50 smithi133 ceph-mon[125939]: pgmap v13575: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 281 KiB/s wr, 10 op/s 2023-05-08T10:46:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:50 smithi096 ceph-mon[124666]: pgmap v13575: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 281 KiB/s wr, 10 op/s 2023-05-08T10:46:51.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:50 smithi186 ceph-mon[126480]: pgmap v13575: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 281 KiB/s wr, 10 op/s 2023-05-08T10:46:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:52 smithi133 ceph-mon[125939]: pgmap v13576: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 537 KiB/s rd, 297 KiB/s wr, 8 op/s 2023-05-08T10:46:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:46:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:52 smithi096 ceph-mon[124666]: pgmap v13576: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 537 KiB/s rd, 297 KiB/s wr, 8 op/s 2023-05-08T10:46:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:46:53.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:52 smithi186 ceph-mon[126480]: pgmap v13576: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 537 KiB/s rd, 297 KiB/s wr, 8 op/s 2023-05-08T10:46:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:46:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:46:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:46:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:46:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:46:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:46:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:46:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25353.146315 secs 2023-05-08T10:46:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:54 smithi133 ceph-mon[125939]: pgmap v13577: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 537 KiB/s rd, 296 KiB/s wr, 8 op/s 2023-05-08T10:46:54.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:54 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:46:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25353.146315 secs 2023-05-08T10:46:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:54 smithi096 ceph-mon[124666]: pgmap v13577: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 537 KiB/s rd, 296 KiB/s wr, 8 op/s 2023-05-08T10:46:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:54 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:46:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25353.146315 secs 2023-05-08T10:46:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:54 smithi186 ceph-mon[126480]: pgmap v13577: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 537 KiB/s rd, 296 KiB/s wr, 8 op/s 2023-05-08T10:46:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:54 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:46:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25354.989972 secs 2023-05-08T10:46:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25354.989972 secs 2023-05-08T10:46:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25354.989972 secs 2023-05-08T10:46:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:56 smithi133 ceph-mon[125939]: pgmap v13578: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 825 KiB/s rd, 695 KiB/s wr, 14 op/s 2023-05-08T10:46:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:56 smithi096 ceph-mon[124666]: pgmap v13578: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 825 KiB/s rd, 695 KiB/s wr, 14 op/s 2023-05-08T10:46:57.124 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:56 smithi186 ceph-mon[126480]: pgmap v13578: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 825 KiB/s rd, 695 KiB/s wr, 14 op/s 2023-05-08T10:46:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:46:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:46:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:46:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:46:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:46:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:46:58.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:58 smithi133 ceph-mon[125939]: pgmap v13579: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 569 KiB/s rd, 431 KiB/s wr, 10 op/s 2023-05-08T10:46:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:58 smithi096 ceph-mon[124666]: pgmap v13579: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 569 KiB/s rd, 431 KiB/s wr, 10 op/s 2023-05-08T10:46:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:58 smithi186 ceph-mon[126480]: pgmap v13579: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 569 KiB/s rd, 431 KiB/s wr, 10 op/s 2023-05-08T10:46:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25358.146436 secs 2023-05-08T10:46:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:59 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:46:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:46:59 smithi133 ceph-mon[125939]: pgmap v13580: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 797 KiB/s rd, 537 KiB/s wr, 15 op/s 2023-05-08T10:47:00.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25358.146436 secs 2023-05-08T10:47:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:59 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:47:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:46:59 smithi096 ceph-mon[124666]: pgmap v13580: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 797 KiB/s rd, 537 KiB/s wr, 15 op/s 2023-05-08T10:47:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25358.146436 secs 2023-05-08T10:47:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:59 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:47:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:46:59 smithi186 ceph-mon[126480]: pgmap v13580: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 797 KiB/s rd, 537 KiB/s wr, 15 op/s 2023-05-08T10:47:01.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25359.990067 secs 2023-05-08T10:47:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25359.990067 secs 2023-05-08T10:47:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25359.990067 secs 2023-05-08T10:47:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:02 smithi186 ceph-mon[126480]: pgmap v13581: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 532 KiB/s rd, 535 KiB/s wr, 12 op/s 2023-05-08T10:47:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:02 smithi133 ceph-mon[125939]: pgmap v13581: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 532 KiB/s rd, 535 KiB/s wr, 12 op/s 2023-05-08T10:47:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:02 smithi096 ceph-mon[124666]: pgmap v13581: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 532 KiB/s rd, 535 KiB/s wr, 12 op/s 2023-05-08T10:47:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25363.146547 secs 2023-05-08T10:47:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:04 smithi133 ceph-mon[125939]: pgmap v13582: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 532 KiB/s rd, 519 KiB/s wr, 11 op/s 2023-05-08T10:47:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25363.702979 secs 2023-05-08T10:47:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25363.146547 secs 2023-05-08T10:47:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:04 smithi096 ceph-mon[124666]: pgmap v13582: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 532 KiB/s rd, 519 KiB/s wr, 11 op/s 2023-05-08T10:47:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25363.702979 secs 2023-05-08T10:47:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25363.146547 secs 2023-05-08T10:47:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:04 smithi186 ceph-mon[126480]: pgmap v13582: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 532 KiB/s rd, 519 KiB/s wr, 11 op/s 2023-05-08T10:47:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25363.702979 secs 2023-05-08T10:47:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25364.990185 secs 2023-05-08T10:47:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:05 smithi133 ceph-mon[125939]: pgmap v13583: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 747 KiB/s rd, 861 KiB/s wr, 31 op/s 2023-05-08T10:47:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:05 smithi133 ceph-mon[125939]: osdmap e926: 12 total, 12 up, 12 in 2023-05-08T10:47:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25364.990185 secs 2023-05-08T10:47:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:05 smithi096 ceph-mon[124666]: pgmap v13583: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 747 KiB/s rd, 861 KiB/s wr, 31 op/s 2023-05-08T10:47:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:05 smithi096 ceph-mon[124666]: osdmap e926: 12 total, 12 up, 12 in 2023-05-08T10:47:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25364.990185 secs 2023-05-08T10:47:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:05 smithi186 ceph-mon[126480]: pgmap v13583: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 747 KiB/s rd, 861 KiB/s wr, 31 op/s 2023-05-08T10:47:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:05 smithi186 ceph-mon[126480]: osdmap e926: 12 total, 12 up, 12 in 2023-05-08T10:47:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:08 smithi133 ceph-mon[125939]: pgmap v13585: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 555 KiB/s wr, 30 op/s 2023-05-08T10:47:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:08 smithi096 ceph-mon[124666]: pgmap v13585: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 555 KiB/s wr, 30 op/s 2023-05-08T10:47:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:08 smithi186 ceph-mon[126480]: pgmap v13585: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 555 KiB/s wr, 30 op/s 2023-05-08T10:47:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25368.146616 secs 2023-05-08T10:47:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:09 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:47:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:47:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:47:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25368.703044 secs 2023-05-08T10:47:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25368.146616 secs 2023-05-08T10:47:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:09 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:47:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:47:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:47:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25368.703044 secs 2023-05-08T10:47:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25368.146616 secs 2023-05-08T10:47:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:09 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:47:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:47:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:47:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25368.703044 secs 2023-05-08T10:47:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:10 smithi133 ceph-mon[125939]: pgmap v13586: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 407 KiB/s rd, 429 KiB/s wr, 28 op/s 2023-05-08T10:47:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25369.990309 secs 2023-05-08T10:47:11.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:10 smithi096 ceph-mon[124666]: pgmap v13586: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 407 KiB/s rd, 429 KiB/s wr, 28 op/s 2023-05-08T10:47:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25369.990309 secs 2023-05-08T10:47:11.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:10 smithi186 ceph-mon[126480]: pgmap v13586: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 407 KiB/s rd, 429 KiB/s wr, 28 op/s 2023-05-08T10:47:11.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25369.990309 secs 2023-05-08T10:47:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:12 smithi133 ceph-mon[125939]: pgmap v13587: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 411 KiB/s wr, 28 op/s 2023-05-08T10:47:13.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:12 smithi096 ceph-mon[124666]: pgmap v13587: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 411 KiB/s wr, 28 op/s 2023-05-08T10:47:13.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:12 smithi186 ceph-mon[126480]: pgmap v13587: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 411 KiB/s wr, 28 op/s 2023-05-08T10:47:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25373.146696 secs 2023-05-08T10:47:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:14 smithi133 ceph-mon[125939]: pgmap v13588: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 411 KiB/s wr, 28 op/s 2023-05-08T10:47:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25373.703183 secs 2023-05-08T10:47:14.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:14 smithi133 ceph-mon[125939]: osdmap e927: 12 total, 12 up, 12 in 2023-05-08T10:47:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25373.146696 secs 2023-05-08T10:47:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:14 smithi096 ceph-mon[124666]: pgmap v13588: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 411 KiB/s wr, 28 op/s 2023-05-08T10:47:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25373.703183 secs 2023-05-08T10:47:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:14 smithi096 ceph-mon[124666]: osdmap e927: 12 total, 12 up, 12 in 2023-05-08T10:47:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25373.146696 secs 2023-05-08T10:47:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:14 smithi186 ceph-mon[126480]: pgmap v13588: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 411 KiB/s wr, 28 op/s 2023-05-08T10:47:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25373.703183 secs 2023-05-08T10:47:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:14 smithi186 ceph-mon[126480]: osdmap e927: 12 total, 12 up, 12 in 2023-05-08T10:47:15.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25374.990376 secs 2023-05-08T10:47:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25374.990376 secs 2023-05-08T10:47:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25374.990376 secs 2023-05-08T10:47:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:16 smithi133 ceph-mon[125939]: pgmap v13590: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 121 KiB/s wr, 8 op/s 2023-05-08T10:47:17.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:16 smithi096 ceph-mon[124666]: pgmap v13590: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 121 KiB/s wr, 8 op/s 2023-05-08T10:47:17.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:16 smithi186 ceph-mon[126480]: pgmap v13590: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 121 KiB/s wr, 8 op/s 2023-05-08T10:47:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:18 smithi133 ceph-mon[125939]: pgmap v13591: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 120 KiB/s wr, 8 op/s 2023-05-08T10:47:19.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:18 smithi096 ceph-mon[124666]: pgmap v13591: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 120 KiB/s wr, 8 op/s 2023-05-08T10:47:19.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:18 smithi186 ceph-mon[126480]: pgmap v13591: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 120 KiB/s wr, 8 op/s 2023-05-08T10:47:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25378.146790 secs 2023-05-08T10:47:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25378.703300 secs 2023-05-08T10:47:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25378.146790 secs 2023-05-08T10:47:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25378.703300 secs 2023-05-08T10:47:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25378.146790 secs 2023-05-08T10:47:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25378.703300 secs 2023-05-08T10:47:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:20 smithi133 ceph-mon[125939]: pgmap v13592: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 120 KiB/s wr, 7 op/s 2023-05-08T10:47:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25379.990492 secs 2023-05-08T10:47:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:20 smithi096 ceph-mon[124666]: pgmap v13592: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 120 KiB/s wr, 7 op/s 2023-05-08T10:47:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25379.990492 secs 2023-05-08T10:47:21.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:20 smithi186 ceph-mon[126480]: pgmap v13592: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 120 KiB/s wr, 7 op/s 2023-05-08T10:47:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25379.990492 secs 2023-05-08T10:47:22.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:22 smithi133 ceph-mon[125939]: pgmap v13593: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 120 KiB/s wr, 7 op/s 2023-05-08T10:47:23.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:22 smithi096 ceph-mon[124666]: pgmap v13593: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 120 KiB/s wr, 7 op/s 2023-05-08T10:47:23.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:22 smithi186 ceph-mon[126480]: pgmap v13593: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 120 KiB/s wr, 7 op/s 2023-05-08T10:47:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25383.146908 secs 2023-05-08T10:47:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:24 smithi133 ceph-mon[125939]: pgmap v13594: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 120 KiB/s wr, 7 op/s 2023-05-08T10:47:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25383.703416 secs 2023-05-08T10:47:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25383.146908 secs 2023-05-08T10:47:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:24 smithi096 ceph-mon[124666]: pgmap v13594: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 120 KiB/s wr, 7 op/s 2023-05-08T10:47:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25383.703416 secs 2023-05-08T10:47:25.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25383.146908 secs 2023-05-08T10:47:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:24 smithi186 ceph-mon[126480]: pgmap v13594: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 120 KiB/s wr, 7 op/s 2023-05-08T10:47:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25383.703416 secs 2023-05-08T10:47:25.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25384.990609 secs 2023-05-08T10:47:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25384.990609 secs 2023-05-08T10:47:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25384.990609 secs 2023-05-08T10:47:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:26 smithi133 ceph-mon[125939]: pgmap v13595: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2023-05-08T10:47:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:26 smithi096 ceph-mon[124666]: pgmap v13595: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2023-05-08T10:47:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:26 smithi186 ceph-mon[126480]: pgmap v13595: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2023-05-08T10:47:28.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:27 smithi096 ceph-mon[124666]: pgmap v13596: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:47:28.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:27 smithi186 ceph-mon[126480]: pgmap v13596: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:47:28.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:27 smithi133 ceph-mon[125939]: pgmap v13596: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:47:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25388.147016 secs 2023-05-08T10:47:29.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25388.147016 secs 2023-05-08T10:47:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25388.147016 secs 2023-05-08T10:47:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25388.703603 secs 2023-05-08T10:47:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:29 smithi133 ceph-mon[125939]: pgmap v13597: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T10:47:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25388.703603 secs 2023-05-08T10:47:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:29 smithi096 ceph-mon[124666]: pgmap v13597: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T10:47:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25388.703603 secs 2023-05-08T10:47:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:29 smithi186 ceph-mon[126480]: pgmap v13597: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T10:47:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25389.990733 secs 2023-05-08T10:47:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25389.990733 secs 2023-05-08T10:47:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25389.990733 secs 2023-05-08T10:47:32.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:32 smithi186 ceph-mon[126480]: pgmap v13598: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2023-05-08T10:47:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:32 smithi133 ceph-mon[125939]: pgmap v13598: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2023-05-08T10:47:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:32 smithi096 ceph-mon[124666]: pgmap v13598: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2023-05-08T10:47:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25393.147147 secs 2023-05-08T10:47:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:34 smithi133 ceph-mon[125939]: pgmap v13599: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:47:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25393.703695 secs 2023-05-08T10:47:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25393.147147 secs 2023-05-08T10:47:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:34 smithi096 ceph-mon[124666]: pgmap v13599: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:47:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25393.703695 secs 2023-05-08T10:47:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25393.147147 secs 2023-05-08T10:47:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:34 smithi186 ceph-mon[126480]: pgmap v13599: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:47:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25393.703695 secs 2023-05-08T10:47:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25394.990848 secs 2023-05-08T10:47:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25394.990848 secs 2023-05-08T10:47:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25394.990848 secs 2023-05-08T10:47:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:36 smithi133 ceph-mon[125939]: pgmap v13600: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 9 op/s 2023-05-08T10:47:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:36 smithi096 ceph-mon[124666]: pgmap v13600: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 9 op/s 2023-05-08T10:47:37.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:36 smithi186 ceph-mon[126480]: pgmap v13600: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 9 op/s 2023-05-08T10:47:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:38 smithi133 ceph-mon[125939]: pgmap v13601: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 6 op/s 2023-05-08T10:47:39.009 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:38 smithi096 ceph-mon[124666]: pgmap v13601: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 6 op/s 2023-05-08T10:47:39.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:38 smithi186 ceph-mon[126480]: pgmap v13601: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 6 op/s 2023-05-08T10:47:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25398.147264 secs 2023-05-08T10:47:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25398.703814 secs 2023-05-08T10:47:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25398.147264 secs 2023-05-08T10:47:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25398.703814 secs 2023-05-08T10:47:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25398.147264 secs 2023-05-08T10:47:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25398.703814 secs 2023-05-08T10:47:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:40 smithi133 ceph-mon[125939]: pgmap v13602: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 174 KiB/s wr, 9 op/s 2023-05-08T10:47:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25399.990991 secs 2023-05-08T10:47:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:40 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:47:41.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:40 smithi096 ceph-mon[124666]: pgmap v13602: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 174 KiB/s wr, 9 op/s 2023-05-08T10:47:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25399.990991 secs 2023-05-08T10:47:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:40 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:47:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:40 smithi186 ceph-mon[126480]: pgmap v13602: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 174 KiB/s wr, 9 op/s 2023-05-08T10:47:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25399.990991 secs 2023-05-08T10:47:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:40 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:47:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:47:41.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:47:41.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:47:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:47:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:47:42.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:47:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:47:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:47:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:47:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:42 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:47:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:42 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T10:47:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:42 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T10:47:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:42 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:47:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:42 smithi133 ceph-mon[125939]: pgmap v13603: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 174 KiB/s wr, 8 op/s 2023-05-08T10:47:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:42 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:47:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:42 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T10:47:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:42 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T10:47:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:42 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:47:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:42 smithi096 ceph-mon[124666]: pgmap v13603: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 174 KiB/s wr, 8 op/s 2023-05-08T10:47:43.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:42 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:47:43.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:42 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T10:47:43.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:42 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T10:47:43.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:42 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:47:43.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:42 smithi186 ceph-mon[126480]: pgmap v13603: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 174 KiB/s wr, 8 op/s 2023-05-08T10:47:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25403.147406 secs 2023-05-08T10:47:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:44 smithi133 ceph-mon[125939]: pgmap v13604: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 174 KiB/s wr, 7 op/s 2023-05-08T10:47:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25403.703890 secs 2023-05-08T10:47:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25403.147406 secs 2023-05-08T10:47:45.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:44 smithi096 ceph-mon[124666]: pgmap v13604: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 174 KiB/s wr, 7 op/s 2023-05-08T10:47:45.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25403.703890 secs 2023-05-08T10:47:45.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25403.147406 secs 2023-05-08T10:47:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:44 smithi186 ceph-mon[126480]: pgmap v13604: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 174 KiB/s wr, 7 op/s 2023-05-08T10:47:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25403.703890 secs 2023-05-08T10:47:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:46 smithi133 ceph-mon[125939]: pgmap v13605: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 353 KiB/s rd, 350 KiB/s wr, 11 op/s 2023-05-08T10:47:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:46 smithi096 ceph-mon[124666]: pgmap v13605: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 353 KiB/s rd, 350 KiB/s wr, 11 op/s 2023-05-08T10:47:47.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:46 smithi186 ceph-mon[126480]: pgmap v13605: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 353 KiB/s rd, 350 KiB/s wr, 11 op/s 2023-05-08T10:47:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:48 smithi133 ceph-mon[125939]: pgmap v13606: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 352 KiB/s rd, 350 KiB/s wr, 7 op/s 2023-05-08T10:47:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:47:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:48 smithi096 ceph-mon[124666]: pgmap v13606: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 352 KiB/s rd, 350 KiB/s wr, 7 op/s 2023-05-08T10:47:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:47:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:48 smithi186 ceph-mon[126480]: pgmap v13606: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 352 KiB/s rd, 350 KiB/s wr, 7 op/s 2023-05-08T10:47:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:47:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25408.147487 secs 2023-05-08T10:47:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:47:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:47:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:47:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25408.147487 secs 2023-05-08T10:47:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:47:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:47:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:47:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25408.147487 secs 2023-05-08T10:47:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:47:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:47:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:47:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:50 smithi133 ceph-mon[125939]: pgmap v13607: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 456 KiB/s wr, 11 op/s 2023-05-08T10:47:51.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:50 smithi096 ceph-mon[124666]: pgmap v13607: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 456 KiB/s wr, 11 op/s 2023-05-08T10:47:51.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:50 smithi186 ceph-mon[126480]: pgmap v13607: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 456 KiB/s wr, 11 op/s 2023-05-08T10:47:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:51 smithi133 ceph-mon[125939]: pgmap v13608: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 284 KiB/s rd, 297 KiB/s wr, 8 op/s 2023-05-08T10:47:52.020 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:51 smithi096 ceph-mon[124666]: pgmap v13608: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 284 KiB/s rd, 297 KiB/s wr, 8 op/s 2023-05-08T10:47:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:51 smithi186 ceph-mon[126480]: pgmap v13608: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 284 KiB/s rd, 297 KiB/s wr, 8 op/s 2023-05-08T10:47:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:47:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:47:53.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:47:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:47:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:47:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:53 smithi133 ceph-mon[125939]: pgmap v13609: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 284 KiB/s rd, 297 KiB/s wr, 7 op/s 2023-05-08T10:47:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:47:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:47:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:53 smithi096 ceph-mon[124666]: pgmap v13609: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 284 KiB/s rd, 297 KiB/s wr, 7 op/s 2023-05-08T10:47:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:47:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:47:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:53 smithi186 ceph-mon[126480]: pgmap v13609: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 284 KiB/s rd, 297 KiB/s wr, 7 op/s 2023-05-08T10:47:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25413.147605 secs 2023-05-08T10:47:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:54 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:47:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25413.147605 secs 2023-05-08T10:47:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:54 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:47:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25413.147605 secs 2023-05-08T10:47:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:54 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:47:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25414.991290 secs 2023-05-08T10:47:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:55 smithi133 ceph-mon[125939]: pgmap v13610: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 696 KiB/s rd, 697 KiB/s wr, 13 op/s 2023-05-08T10:47:56.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25414.991290 secs 2023-05-08T10:47:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:55 smithi096 ceph-mon[124666]: pgmap v13610: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 696 KiB/s rd, 697 KiB/s wr, 13 op/s 2023-05-08T10:47:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25414.991290 secs 2023-05-08T10:47:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:55 smithi186 ceph-mon[126480]: pgmap v13610: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 696 KiB/s rd, 697 KiB/s wr, 13 op/s 2023-05-08T10:47:58.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:47:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:47:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:57 smithi096 ceph-mon[124666]: pgmap v13611: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 521 KiB/s wr, 9 op/s 2023-05-08T10:47:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:47:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:47:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:57 smithi186 ceph-mon[126480]: pgmap v13611: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 521 KiB/s wr, 9 op/s 2023-05-08T10:47:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:47:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:47:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:57 smithi133 ceph-mon[125939]: pgmap v13611: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 521 KiB/s wr, 9 op/s 2023-05-08T10:47:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25418.147668 secs 2023-05-08T10:47:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25418.147668 secs 2023-05-08T10:47:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25418.147668 secs 2023-05-08T10:48:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:59 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:48:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:47:59 smithi133 ceph-mon[125939]: pgmap v13612: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 624 KiB/s rd, 627 KiB/s wr, 14 op/s 2023-05-08T10:48:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:59 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:48:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:47:59 smithi096 ceph-mon[124666]: pgmap v13612: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 624 KiB/s rd, 627 KiB/s wr, 14 op/s 2023-05-08T10:48:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:59 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:48:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:47:59 smithi186 ceph-mon[126480]: pgmap v13612: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 624 KiB/s rd, 627 KiB/s wr, 14 op/s 2023-05-08T10:48:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25419.991412 secs 2023-05-08T10:48:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25419.991412 secs 2023-05-08T10:48:02.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25419.991412 secs 2023-05-08T10:48:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:02 smithi186 ceph-mon[126480]: pgmap v13613: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 534 KiB/s rd, 637 KiB/s wr, 11 op/s 2023-05-08T10:48:02.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:02 smithi133 ceph-mon[125939]: pgmap v13613: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 534 KiB/s rd, 637 KiB/s wr, 11 op/s 2023-05-08T10:48:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:02 smithi096 ceph-mon[124666]: pgmap v13613: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 534 KiB/s rd, 637 KiB/s wr, 11 op/s 2023-05-08T10:48:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25423.147787 secs 2023-05-08T10:48:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:04 smithi133 ceph-mon[125939]: pgmap v13614: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 534 KiB/s rd, 622 KiB/s wr, 11 op/s 2023-05-08T10:48:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25423.704266 secs 2023-05-08T10:48:05.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25423.147787 secs 2023-05-08T10:48:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:04 smithi096 ceph-mon[124666]: pgmap v13614: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 534 KiB/s rd, 622 KiB/s wr, 11 op/s 2023-05-08T10:48:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25423.704266 secs 2023-05-08T10:48:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25423.147787 secs 2023-05-08T10:48:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:04 smithi186 ceph-mon[126480]: pgmap v13614: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 534 KiB/s rd, 622 KiB/s wr, 11 op/s 2023-05-08T10:48:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25423.704266 secs 2023-05-08T10:48:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25424.991545 secs 2023-05-08T10:48:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25424.991545 secs 2023-05-08T10:48:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25424.991545 secs 2023-05-08T10:48:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:06 smithi133 ceph-mon[125939]: pgmap v13615: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 857 KiB/s rd, 864 KiB/s wr, 30 op/s 2023-05-08T10:48:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:06 smithi133 ceph-mon[125939]: osdmap e928: 12 total, 12 up, 12 in 2023-05-08T10:48:07.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:06 smithi096 ceph-mon[124666]: pgmap v13615: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 857 KiB/s rd, 864 KiB/s wr, 30 op/s 2023-05-08T10:48:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:06 smithi096 ceph-mon[124666]: osdmap e928: 12 total, 12 up, 12 in 2023-05-08T10:48:07.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:06 smithi186 ceph-mon[126480]: pgmap v13615: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 857 KiB/s rd, 864 KiB/s wr, 30 op/s 2023-05-08T10:48:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:06 smithi186 ceph-mon[126480]: osdmap e928: 12 total, 12 up, 12 in 2023-05-08T10:48:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:08 smithi133 ceph-mon[125939]: pgmap v13617: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 534 KiB/s rd, 557 KiB/s wr, 30 op/s 2023-05-08T10:48:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:08 smithi096 ceph-mon[124666]: pgmap v13617: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 534 KiB/s rd, 557 KiB/s wr, 30 op/s 2023-05-08T10:48:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:08 smithi186 ceph-mon[126480]: pgmap v13617: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 534 KiB/s rd, 557 KiB/s wr, 30 op/s 2023-05-08T10:48:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25428.147905 secs 2023-05-08T10:48:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:09 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:48:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:48:09.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:48:09.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25428.704386 secs 2023-05-08T10:48:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25428.147905 secs 2023-05-08T10:48:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:09 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:48:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:48:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:48:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25428.704386 secs 2023-05-08T10:48:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25428.147905 secs 2023-05-08T10:48:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:09 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:48:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:48:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:48:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25428.704386 secs 2023-05-08T10:48:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:10 smithi133 ceph-mon[125939]: pgmap v13618: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 408 KiB/s rd, 430 KiB/s wr, 27 op/s 2023-05-08T10:48:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25429.991625 secs 2023-05-08T10:48:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:10 smithi096 ceph-mon[124666]: pgmap v13618: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 408 KiB/s rd, 430 KiB/s wr, 27 op/s 2023-05-08T10:48:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25429.991625 secs 2023-05-08T10:48:11.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:10 smithi186 ceph-mon[126480]: pgmap v13618: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 408 KiB/s rd, 430 KiB/s wr, 27 op/s 2023-05-08T10:48:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25429.991625 secs 2023-05-08T10:48:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:12 smithi133 ceph-mon[125939]: pgmap v13619: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 389 KiB/s rd, 411 KiB/s wr, 27 op/s 2023-05-08T10:48:13.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:12 smithi096 ceph-mon[124666]: pgmap v13619: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 389 KiB/s rd, 411 KiB/s wr, 27 op/s 2023-05-08T10:48:13.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:12 smithi186 ceph-mon[126480]: pgmap v13619: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 389 KiB/s rd, 411 KiB/s wr, 27 op/s 2023-05-08T10:48:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25433.148045 secs 2023-05-08T10:48:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:14 smithi133 ceph-mon[125939]: pgmap v13620: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 389 KiB/s rd, 411 KiB/s wr, 27 op/s 2023-05-08T10:48:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25433.704503 secs 2023-05-08T10:48:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:14 smithi133 ceph-mon[125939]: osdmap e929: 12 total, 12 up, 12 in 2023-05-08T10:48:15.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25433.148045 secs 2023-05-08T10:48:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:14 smithi096 ceph-mon[124666]: pgmap v13620: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 389 KiB/s rd, 411 KiB/s wr, 27 op/s 2023-05-08T10:48:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25433.704503 secs 2023-05-08T10:48:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:14 smithi096 ceph-mon[124666]: osdmap e929: 12 total, 12 up, 12 in 2023-05-08T10:48:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25433.148045 secs 2023-05-08T10:48:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:14 smithi186 ceph-mon[126480]: pgmap v13620: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 389 KiB/s rd, 411 KiB/s wr, 27 op/s 2023-05-08T10:48:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25433.704503 secs 2023-05-08T10:48:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:14 smithi186 ceph-mon[126480]: osdmap e929: 12 total, 12 up, 12 in 2023-05-08T10:48:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25434.991704 secs 2023-05-08T10:48:16.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25434.991704 secs 2023-05-08T10:48:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25434.991704 secs 2023-05-08T10:48:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:16 smithi133 ceph-mon[125939]: pgmap v13622: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 121 KiB/s wr, 7 op/s 2023-05-08T10:48:17.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:16 smithi096 ceph-mon[124666]: pgmap v13622: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 121 KiB/s wr, 7 op/s 2023-05-08T10:48:17.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:16 smithi186 ceph-mon[126480]: pgmap v13622: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 121 KiB/s wr, 7 op/s 2023-05-08T10:48:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:17 smithi133 ceph-mon[125939]: pgmap v13623: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 120 KiB/s wr, 7 op/s 2023-05-08T10:48:18.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:17 smithi096 ceph-mon[124666]: pgmap v13623: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 120 KiB/s wr, 7 op/s 2023-05-08T10:48:18.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:17 smithi186 ceph-mon[126480]: pgmap v13623: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 120 KiB/s wr, 7 op/s 2023-05-08T10:48:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25438.148183 secs 2023-05-08T10:48:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25438.148183 secs 2023-05-08T10:48:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25438.148183 secs 2023-05-08T10:48:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25438.704571 secs 2023-05-08T10:48:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:19 smithi133 ceph-mon[125939]: pgmap v13624: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 120 KiB/s wr, 6 op/s 2023-05-08T10:48:20.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25438.704571 secs 2023-05-08T10:48:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:19 smithi096 ceph-mon[124666]: pgmap v13624: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 120 KiB/s wr, 6 op/s 2023-05-08T10:48:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25438.704571 secs 2023-05-08T10:48:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:19 smithi186 ceph-mon[126480]: pgmap v13624: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 120 KiB/s wr, 6 op/s 2023-05-08T10:48:21.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25439.991849 secs 2023-05-08T10:48:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25439.991849 secs 2023-05-08T10:48:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25439.991849 secs 2023-05-08T10:48:22.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:22 smithi186 ceph-mon[126480]: pgmap v13625: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 6 op/s 2023-05-08T10:48:22.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:22 smithi133 ceph-mon[125939]: pgmap v13625: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 6 op/s 2023-05-08T10:48:23.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:22 smithi096 ceph-mon[124666]: pgmap v13625: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 6 op/s 2023-05-08T10:48:24.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25443.148317 secs 2023-05-08T10:48:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:24 smithi133 ceph-mon[125939]: pgmap v13626: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 6 op/s 2023-05-08T10:48:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25443.704687 secs 2023-05-08T10:48:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25443.148317 secs 2023-05-08T10:48:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:24 smithi096 ceph-mon[124666]: pgmap v13626: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 6 op/s 2023-05-08T10:48:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25443.704687 secs 2023-05-08T10:48:25.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25443.148317 secs 2023-05-08T10:48:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:24 smithi186 ceph-mon[126480]: pgmap v13626: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 6 op/s 2023-05-08T10:48:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25443.704687 secs 2023-05-08T10:48:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25444.991972 secs 2023-05-08T10:48:26.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25444.991972 secs 2023-05-08T10:48:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25444.991972 secs 2023-05-08T10:48:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:26 smithi133 ceph-mon[125939]: pgmap v13627: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 6 op/s 2023-05-08T10:48:27.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:26 smithi096 ceph-mon[124666]: pgmap v13627: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 6 op/s 2023-05-08T10:48:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:26 smithi186 ceph-mon[126480]: pgmap v13627: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 6 op/s 2023-05-08T10:48:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:28 smithi133 ceph-mon[125939]: pgmap v13628: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:48:29.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:28 smithi096 ceph-mon[124666]: pgmap v13628: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:48:29.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:28 smithi186 ceph-mon[126480]: pgmap v13628: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:48:29.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25448.148373 secs 2023-05-08T10:48:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25448.704768 secs 2023-05-08T10:48:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25448.148373 secs 2023-05-08T10:48:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25448.704768 secs 2023-05-08T10:48:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25448.148373 secs 2023-05-08T10:48:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25448.704768 secs 2023-05-08T10:48:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:30 smithi133 ceph-mon[125939]: pgmap v13629: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2023-05-08T10:48:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25449.992092 secs 2023-05-08T10:48:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:30 smithi096 ceph-mon[124666]: pgmap v13629: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2023-05-08T10:48:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25449.992092 secs 2023-05-08T10:48:31.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:30 smithi186 ceph-mon[126480]: pgmap v13629: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2023-05-08T10:48:31.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25449.992092 secs 2023-05-08T10:48:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:32 smithi133 ceph-mon[125939]: pgmap v13630: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:48:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:32 smithi096 ceph-mon[124666]: pgmap v13630: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:48:33.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:32 smithi186 ceph-mon[126480]: pgmap v13630: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:48:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25453.148500 secs 2023-05-08T10:48:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:34 smithi133 ceph-mon[125939]: pgmap v13631: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:48:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25453.704886 secs 2023-05-08T10:48:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25453.148500 secs 2023-05-08T10:48:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:34 smithi096 ceph-mon[124666]: pgmap v13631: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:48:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25453.704886 secs 2023-05-08T10:48:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25453.148500 secs 2023-05-08T10:48:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:34 smithi186 ceph-mon[126480]: pgmap v13631: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:48:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25453.704886 secs 2023-05-08T10:48:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25454.992192 secs 2023-05-08T10:48:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25454.992192 secs 2023-05-08T10:48:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25454.992192 secs 2023-05-08T10:48:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:36 smithi133 ceph-mon[125939]: pgmap v13632: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 8 op/s 2023-05-08T10:48:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:36 smithi096 ceph-mon[124666]: pgmap v13632: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 8 op/s 2023-05-08T10:48:37.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:36 smithi186 ceph-mon[126480]: pgmap v13632: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 8 op/s 2023-05-08T10:48:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:37 smithi133 ceph-mon[125939]: pgmap v13633: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T10:48:38.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:37 smithi096 ceph-mon[124666]: pgmap v13633: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T10:48:38.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:37 smithi186 ceph-mon[126480]: pgmap v13633: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T10:48:39.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25458.148608 secs 2023-05-08T10:48:39.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25458.148608 secs 2023-05-08T10:48:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25458.148608 secs 2023-05-08T10:48:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25458.704996 secs 2023-05-08T10:48:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:39 smithi133 ceph-mon[125939]: pgmap v13634: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 682 B/s wr, 8 op/s 2023-05-08T10:48:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25458.704996 secs 2023-05-08T10:48:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:39 smithi096 ceph-mon[124666]: pgmap v13634: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 682 B/s wr, 8 op/s 2023-05-08T10:48:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25458.704996 secs 2023-05-08T10:48:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:39 smithi186 ceph-mon[126480]: pgmap v13634: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 682 B/s wr, 8 op/s 2023-05-08T10:48:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25459.992316 secs 2023-05-08T10:48:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:48:41.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25459.992316 secs 2023-05-08T10:48:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:48:42.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25459.992316 secs 2023-05-08T10:48:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:48:42.844 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:42 smithi133 ceph-mon[125939]: pgmap v13635: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 938 B/s wr, 7 op/s 2023-05-08T10:48:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:42 smithi186 ceph-mon[126480]: pgmap v13635: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 938 B/s wr, 7 op/s 2023-05-08T10:48:42.932 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:42 smithi096 ceph-mon[124666]: pgmap v13635: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 938 B/s wr, 7 op/s 2023-05-08T10:48:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25463.148751 secs 2023-05-08T10:48:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:44 smithi133 ceph-mon[125939]: pgmap v13636: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T10:48:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25463.705132 secs 2023-05-08T10:48:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:44 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:48:44.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:44 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:48:44.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:44 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:48:44.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:44 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:48:44.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:44 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:48:44.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:44 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:48:44.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:44 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:48:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25463.148751 secs 2023-05-08T10:48:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:44 smithi096 ceph-mon[124666]: pgmap v13636: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T10:48:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25463.705132 secs 2023-05-08T10:48:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:44 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:48:45.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:44 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:48:45.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:44 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:48:45.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:44 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:48:45.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:44 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:48:45.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:44 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:48:45.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:44 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:48:45.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25463.148751 secs 2023-05-08T10:48:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:44 smithi186 ceph-mon[126480]: pgmap v13636: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T10:48:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25463.705132 secs 2023-05-08T10:48:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:44 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:48:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:44 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:48:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:44 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:48:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:44 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:48:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:44 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:48:45.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:44 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:48:45.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:44 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:48:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:45 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:48:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:45 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T10:48:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:45 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T10:48:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:45 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:48:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:45 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:48:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:45 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T10:48:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:45 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T10:48:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:45 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:48:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:45 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:48:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:45 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T10:48:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:45 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T10:48:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:45 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:48:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:46 smithi133 ceph-mon[125939]: pgmap v13637: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 266 KiB/s wr, 10 op/s 2023-05-08T10:48:47.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:46 smithi096 ceph-mon[124666]: pgmap v13637: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 266 KiB/s wr, 10 op/s 2023-05-08T10:48:47.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:46 smithi186 ceph-mon[126480]: pgmap v13637: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 266 KiB/s wr, 10 op/s 2023-05-08T10:48:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:48 smithi133 ceph-mon[125939]: pgmap v13638: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 266 KiB/s wr, 7 op/s 2023-05-08T10:48:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:48:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:48 smithi096 ceph-mon[124666]: pgmap v13638: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 266 KiB/s wr, 7 op/s 2023-05-08T10:48:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:48:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:48 smithi186 ceph-mon[126480]: pgmap v13638: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 266 KiB/s wr, 7 op/s 2023-05-08T10:48:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:48:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25468.148867 secs 2023-05-08T10:48:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:48:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:48:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:48:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25468.148867 secs 2023-05-08T10:48:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:48:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:48:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:48:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25468.148867 secs 2023-05-08T10:48:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:48:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:48:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:48:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:50 smithi133 ceph-mon[125939]: pgmap v13639: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 284 KiB/s wr, 10 op/s 2023-05-08T10:48:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:50 smithi096 ceph-mon[124666]: pgmap v13639: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 284 KiB/s wr, 10 op/s 2023-05-08T10:48:51.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:50 smithi186 ceph-mon[126480]: pgmap v13639: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 284 KiB/s wr, 10 op/s 2023-05-08T10:48:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:52 smithi133 ceph-mon[125939]: pgmap v13640: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 299 KiB/s wr, 8 op/s 2023-05-08T10:48:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:48:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:52 smithi096 ceph-mon[124666]: pgmap v13640: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 299 KiB/s wr, 8 op/s 2023-05-08T10:48:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:48:53.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:52 smithi186 ceph-mon[126480]: pgmap v13640: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 299 KiB/s wr, 8 op/s 2023-05-08T10:48:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:48:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:48:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:48:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:53 smithi133 ceph-mon[125939]: pgmap v13641: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 298 KiB/s wr, 7 op/s 2023-05-08T10:48:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:48:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:48:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:53 smithi096 ceph-mon[124666]: pgmap v13641: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 298 KiB/s wr, 7 op/s 2023-05-08T10:48:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:48:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:48:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:53 smithi186 ceph-mon[126480]: pgmap v13641: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 298 KiB/s wr, 7 op/s 2023-05-08T10:48:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25473.148983 secs 2023-05-08T10:48:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:54 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:48:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25473.148983 secs 2023-05-08T10:48:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:54 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:48:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25473.148983 secs 2023-05-08T10:48:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:54 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:48:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25474.992630 secs 2023-05-08T10:48:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:55 smithi133 ceph-mon[125939]: pgmap v13642: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 798 KiB/s rd, 699 KiB/s wr, 13 op/s 2023-05-08T10:48:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25474.992630 secs 2023-05-08T10:48:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:55 smithi096 ceph-mon[124666]: pgmap v13642: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 798 KiB/s rd, 699 KiB/s wr, 13 op/s 2023-05-08T10:48:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25474.992630 secs 2023-05-08T10:48:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:55 smithi186 ceph-mon[126480]: pgmap v13642: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 798 KiB/s rd, 699 KiB/s wr, 13 op/s 2023-05-08T10:48:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:48:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:48:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:57 smithi133 ceph-mon[125939]: pgmap v13643: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 432 KiB/s rd, 434 KiB/s wr, 9 op/s 2023-05-08T10:48:58.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:48:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:48:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:57 smithi096 ceph-mon[124666]: pgmap v13643: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 432 KiB/s rd, 434 KiB/s wr, 9 op/s 2023-05-08T10:48:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:48:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:48:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:57 smithi186 ceph-mon[126480]: pgmap v13643: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 432 KiB/s rd, 434 KiB/s wr, 9 op/s 2023-05-08T10:48:59.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25478.149100 secs 2023-05-08T10:48:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25478.149100 secs 2023-05-08T10:48:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25478.149100 secs 2023-05-08T10:49:00.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:59 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:49:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:48:59 smithi133 ceph-mon[125939]: pgmap v13644: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 633 KiB/s wr, 14 op/s 2023-05-08T10:49:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:59 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:49:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:48:59 smithi096 ceph-mon[124666]: pgmap v13644: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 633 KiB/s wr, 14 op/s 2023-05-08T10:49:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:59 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:49:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:48:59 smithi186 ceph-mon[126480]: pgmap v13644: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 633 KiB/s wr, 14 op/s 2023-05-08T10:49:01.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25479.992767 secs 2023-05-08T10:49:02.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25479.992767 secs 2023-05-08T10:49:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25479.992767 secs 2023-05-08T10:49:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:02 smithi133 ceph-mon[125939]: pgmap v13645: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 624 KiB/s rd, 631 KiB/s wr, 12 op/s 2023-05-08T10:49:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:02 smithi096 ceph-mon[124666]: pgmap v13645: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 624 KiB/s rd, 631 KiB/s wr, 12 op/s 2023-05-08T10:49:03.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:02 smithi186 ceph-mon[126480]: pgmap v13645: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 624 KiB/s rd, 631 KiB/s wr, 12 op/s 2023-05-08T10:49:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25483.149221 secs 2023-05-08T10:49:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:04 smithi133 ceph-mon[125939]: pgmap v13646: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 624 KiB/s rd, 615 KiB/s wr, 11 op/s 2023-05-08T10:49:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25483.705607 secs 2023-05-08T10:49:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25483.149221 secs 2023-05-08T10:49:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:04 smithi096 ceph-mon[124666]: pgmap v13646: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 624 KiB/s rd, 615 KiB/s wr, 11 op/s 2023-05-08T10:49:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25483.705607 secs 2023-05-08T10:49:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25483.149221 secs 2023-05-08T10:49:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:04 smithi186 ceph-mon[126480]: pgmap v13646: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 624 KiB/s rd, 615 KiB/s wr, 11 op/s 2023-05-08T10:49:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25483.705607 secs 2023-05-08T10:49:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25484.992877 secs 2023-05-08T10:49:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25484.992877 secs 2023-05-08T10:49:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25484.992877 secs 2023-05-08T10:49:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:06 smithi133 ceph-mon[125939]: pgmap v13647: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 859 KiB/s rd, 870 KiB/s wr, 30 op/s 2023-05-08T10:49:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:06 smithi133 ceph-mon[125939]: osdmap e930: 12 total, 12 up, 12 in 2023-05-08T10:49:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:06 smithi096 ceph-mon[124666]: pgmap v13647: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 859 KiB/s rd, 870 KiB/s wr, 30 op/s 2023-05-08T10:49:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:06 smithi096 ceph-mon[124666]: osdmap e930: 12 total, 12 up, 12 in 2023-05-08T10:49:07.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:06 smithi186 ceph-mon[126480]: pgmap v13647: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 859 KiB/s rd, 870 KiB/s wr, 30 op/s 2023-05-08T10:49:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:06 smithi186 ceph-mon[126480]: osdmap e930: 12 total, 12 up, 12 in 2023-05-08T10:49:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:08 smithi133 ceph-mon[125939]: pgmap v13649: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 563 KiB/s wr, 30 op/s 2023-05-08T10:49:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:08 smithi096 ceph-mon[124666]: pgmap v13649: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 563 KiB/s wr, 30 op/s 2023-05-08T10:49:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:08 smithi186 ceph-mon[126480]: pgmap v13649: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 563 KiB/s wr, 30 op/s 2023-05-08T10:49:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25488.149333 secs 2023-05-08T10:49:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:09 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:49:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:49:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:49:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25488.705724 secs 2023-05-08T10:49:10.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25488.149333 secs 2023-05-08T10:49:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:09 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:49:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:49:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:49:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25488.705724 secs 2023-05-08T10:49:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25488.149333 secs 2023-05-08T10:49:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:09 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:49:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:49:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:49:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25488.705724 secs 2023-05-08T10:49:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:10 smithi133 ceph-mon[125939]: pgmap v13650: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 325 KiB/s wr, 27 op/s 2023-05-08T10:49:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25489.993017 secs 2023-05-08T10:49:11.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:10 smithi096 ceph-mon[124666]: pgmap v13650: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 325 KiB/s wr, 27 op/s 2023-05-08T10:49:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25489.993017 secs 2023-05-08T10:49:11.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:10 smithi186 ceph-mon[126480]: pgmap v13650: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 325 KiB/s wr, 27 op/s 2023-05-08T10:49:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25489.993017 secs 2023-05-08T10:49:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:12 smithi133 ceph-mon[125939]: pgmap v13651: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 307 KiB/s wr, 26 op/s 2023-05-08T10:49:13.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:12 smithi096 ceph-mon[124666]: pgmap v13651: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 307 KiB/s wr, 26 op/s 2023-05-08T10:49:13.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:12 smithi186 ceph-mon[126480]: pgmap v13651: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 307 KiB/s wr, 26 op/s 2023-05-08T10:49:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25493.149421 secs 2023-05-08T10:49:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:14 smithi133 ceph-mon[125939]: pgmap v13652: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 307 KiB/s wr, 26 op/s 2023-05-08T10:49:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25493.705841 secs 2023-05-08T10:49:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:14 smithi133 ceph-mon[125939]: osdmap e931: 12 total, 12 up, 12 in 2023-05-08T10:49:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25493.149421 secs 2023-05-08T10:49:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:14 smithi096 ceph-mon[124666]: pgmap v13652: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 307 KiB/s wr, 26 op/s 2023-05-08T10:49:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25493.705841 secs 2023-05-08T10:49:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:14 smithi096 ceph-mon[124666]: osdmap e931: 12 total, 12 up, 12 in 2023-05-08T10:49:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25493.149421 secs 2023-05-08T10:49:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:14 smithi186 ceph-mon[126480]: pgmap v13652: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 307 KiB/s wr, 26 op/s 2023-05-08T10:49:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25493.705841 secs 2023-05-08T10:49:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:14 smithi186 ceph-mon[126480]: osdmap e931: 12 total, 12 up, 12 in 2023-05-08T10:49:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25494.993106 secs 2023-05-08T10:49:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25494.993106 secs 2023-05-08T10:49:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25494.993106 secs 2023-05-08T10:49:16.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:16 smithi133 ceph-mon[125939]: pgmap v13654: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 121 KiB/s wr, 7 op/s 2023-05-08T10:49:17.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:16 smithi096 ceph-mon[124666]: pgmap v13654: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 121 KiB/s wr, 7 op/s 2023-05-08T10:49:17.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:16 smithi186 ceph-mon[126480]: pgmap v13654: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 121 KiB/s wr, 7 op/s 2023-05-08T10:49:18.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:17 smithi186 ceph-mon[126480]: pgmap v13655: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 121 KiB/s wr, 7 op/s 2023-05-08T10:49:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:17 smithi133 ceph-mon[125939]: pgmap v13655: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 121 KiB/s wr, 7 op/s 2023-05-08T10:49:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:17 smithi096 ceph-mon[124666]: pgmap v13655: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 121 KiB/s wr, 7 op/s 2023-05-08T10:49:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25498.149516 secs 2023-05-08T10:49:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25498.149516 secs 2023-05-08T10:49:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25498.149516 secs 2023-05-08T10:49:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25498.705956 secs 2023-05-08T10:49:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:19 smithi133 ceph-mon[125939]: pgmap v13656: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 120 KiB/s wr, 7 op/s 2023-05-08T10:49:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25498.705956 secs 2023-05-08T10:49:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:19 smithi096 ceph-mon[124666]: pgmap v13656: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 120 KiB/s wr, 7 op/s 2023-05-08T10:49:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25498.705956 secs 2023-05-08T10:49:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:19 smithi186 ceph-mon[126480]: pgmap v13656: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 120 KiB/s wr, 7 op/s 2023-05-08T10:49:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25499.993192 secs 2023-05-08T10:49:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25499.993192 secs 2023-05-08T10:49:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25499.993192 secs 2023-05-08T10:49:22.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:22 smithi133 ceph-mon[125939]: pgmap v13657: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 120 KiB/s wr, 7 op/s 2023-05-08T10:49:23.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:22 smithi096 ceph-mon[124666]: pgmap v13657: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 120 KiB/s wr, 7 op/s 2023-05-08T10:49:23.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:22 smithi186 ceph-mon[126480]: pgmap v13657: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 120 KiB/s wr, 7 op/s 2023-05-08T10:49:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25503.149580 secs 2023-05-08T10:49:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:24 smithi133 ceph-mon[125939]: pgmap v13658: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 120 KiB/s wr, 7 op/s 2023-05-08T10:49:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25503.706050 secs 2023-05-08T10:49:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25503.149580 secs 2023-05-08T10:49:25.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:24 smithi096 ceph-mon[124666]: pgmap v13658: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 120 KiB/s wr, 7 op/s 2023-05-08T10:49:25.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25503.706050 secs 2023-05-08T10:49:25.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25503.149580 secs 2023-05-08T10:49:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:24 smithi186 ceph-mon[126480]: pgmap v13658: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 120 KiB/s wr, 7 op/s 2023-05-08T10:49:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25503.706050 secs 2023-05-08T10:49:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25504.993315 secs 2023-05-08T10:49:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25504.993315 secs 2023-05-08T10:49:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25504.993315 secs 2023-05-08T10:49:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:26 smithi133 ceph-mon[125939]: pgmap v13659: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2023-05-08T10:49:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:26 smithi096 ceph-mon[124666]: pgmap v13659: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2023-05-08T10:49:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:26 smithi186 ceph-mon[126480]: pgmap v13659: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2023-05-08T10:49:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:28 smithi133 ceph-mon[125939]: pgmap v13660: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:49:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:28 smithi096 ceph-mon[124666]: pgmap v13660: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:49:29.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:28 smithi186 ceph-mon[126480]: pgmap v13660: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:49:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25508.149676 secs 2023-05-08T10:49:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25508.706199 secs 2023-05-08T10:49:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25508.149676 secs 2023-05-08T10:49:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25508.706199 secs 2023-05-08T10:49:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25508.149676 secs 2023-05-08T10:49:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25508.706199 secs 2023-05-08T10:49:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:30 smithi133 ceph-mon[125939]: pgmap v13661: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T10:49:30.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25509.993436 secs 2023-05-08T10:49:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:30 smithi096 ceph-mon[124666]: pgmap v13661: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T10:49:31.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25509.993436 secs 2023-05-08T10:49:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:30 smithi186 ceph-mon[126480]: pgmap v13661: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T10:49:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25509.993436 secs 2023-05-08T10:49:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:32 smithi133 ceph-mon[125939]: pgmap v13662: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2023-05-08T10:49:33.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:32 smithi096 ceph-mon[124666]: pgmap v13662: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2023-05-08T10:49:33.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:32 smithi186 ceph-mon[126480]: pgmap v13662: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2023-05-08T10:49:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25513.149796 secs 2023-05-08T10:49:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:34 smithi133 ceph-mon[125939]: pgmap v13663: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:49:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25513.706296 secs 2023-05-08T10:49:35.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25513.149796 secs 2023-05-08T10:49:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:34 smithi096 ceph-mon[124666]: pgmap v13663: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:49:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25513.706296 secs 2023-05-08T10:49:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25513.149796 secs 2023-05-08T10:49:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:34 smithi186 ceph-mon[126480]: pgmap v13663: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:49:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25513.706296 secs 2023-05-08T10:49:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25514.993553 secs 2023-05-08T10:49:36.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25514.993553 secs 2023-05-08T10:49:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25514.993553 secs 2023-05-08T10:49:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:36 smithi133 ceph-mon[125939]: pgmap v13664: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 9 op/s 2023-05-08T10:49:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:36 smithi096 ceph-mon[124666]: pgmap v13664: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 9 op/s 2023-05-08T10:49:37.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:36 smithi186 ceph-mon[126480]: pgmap v13664: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 9 op/s 2023-05-08T10:49:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:37 smithi133 ceph-mon[125939]: pgmap v13665: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 6 op/s 2023-05-08T10:49:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:37 smithi096 ceph-mon[124666]: pgmap v13665: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 6 op/s 2023-05-08T10:49:38.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:37 smithi186 ceph-mon[126480]: pgmap v13665: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 6 op/s 2023-05-08T10:49:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25518.149931 secs 2023-05-08T10:49:39.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25518.149931 secs 2023-05-08T10:49:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25518.149931 secs 2023-05-08T10:49:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25518.706413 secs 2023-05-08T10:49:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:39 smithi133 ceph-mon[125939]: pgmap v13666: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 682 B/s wr, 9 op/s 2023-05-08T10:49:40.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25518.706413 secs 2023-05-08T10:49:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:39 smithi096 ceph-mon[124666]: pgmap v13666: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 682 B/s wr, 9 op/s 2023-05-08T10:49:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25518.706413 secs 2023-05-08T10:49:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:39 smithi186 ceph-mon[126480]: pgmap v13666: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 682 B/s wr, 9 op/s 2023-05-08T10:49:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25519.993690 secs 2023-05-08T10:49:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25519.993690 secs 2023-05-08T10:49:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25519.993690 secs 2023-05-08T10:49:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:42 smithi133 ceph-mon[125939]: pgmap v13667: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 938 B/s wr, 7 op/s 2023-05-08T10:49:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:42 smithi096 ceph-mon[124666]: pgmap v13667: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 938 B/s wr, 7 op/s 2023-05-08T10:49:43.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:42 smithi186 ceph-mon[126480]: pgmap v13667: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 938 B/s wr, 7 op/s 2023-05-08T10:49:44.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25523.150026 secs 2023-05-08T10:49:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:44 smithi133 ceph-mon[125939]: pgmap v13668: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 938 B/s wr, 7 op/s 2023-05-08T10:49:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25523.706551 secs 2023-05-08T10:49:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:44 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:49:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25523.150026 secs 2023-05-08T10:49:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:44 smithi096 ceph-mon[124666]: pgmap v13668: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 938 B/s wr, 7 op/s 2023-05-08T10:49:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25523.706551 secs 2023-05-08T10:49:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:44 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:49:45.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25523.150026 secs 2023-05-08T10:49:45.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:44 smithi186 ceph-mon[126480]: pgmap v13668: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 938 B/s wr, 7 op/s 2023-05-08T10:49:45.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25523.706551 secs 2023-05-08T10:49:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:44 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:49:46.983 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:46 smithi186 ceph-mon[126480]: pgmap v13669: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 267 KiB/s wr, 11 op/s 2023-05-08T10:49:46.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:46 smithi133 ceph-mon[125939]: pgmap v13669: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 267 KiB/s wr, 11 op/s 2023-05-08T10:49:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:46 smithi096 ceph-mon[124666]: pgmap v13669: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 267 KiB/s wr, 11 op/s 2023-05-08T10:49:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:48 smithi133 ceph-mon[125939]: pgmap v13670: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 267 KiB/s wr, 7 op/s 2023-05-08T10:49:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:49:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:48 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:49:48.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:48 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:49:48.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:48 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:49:48.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:48 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:49:48.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:48 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:49:49.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:48 smithi096 ceph-mon[124666]: pgmap v13670: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 267 KiB/s wr, 7 op/s 2023-05-08T10:49:49.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:49:49.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:48 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:49:49.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:48 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:49:49.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:48 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:49:49.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:48 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:49:49.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:48 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:49:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:48 smithi186 ceph-mon[126480]: pgmap v13670: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 267 KiB/s wr, 7 op/s 2023-05-08T10:49:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:49:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:48 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:49:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:48 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:49:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:48 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:49:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:48 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:49:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:48 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:49:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:49 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:49:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:49 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T10:49:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:49 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T10:49:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:49 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:49:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25528.150134 secs 2023-05-08T10:49:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:49:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:49:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:49:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:49 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:49:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:49 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T10:49:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:49 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T10:49:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:49 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:49:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25528.150134 secs 2023-05-08T10:49:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:49:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:49:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:49:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:49 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:49:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:49 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T10:49:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:49 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T10:49:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:49 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:49:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25528.150134 secs 2023-05-08T10:49:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:49:50.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:49:50.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:49:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:50 smithi133 ceph-mon[125939]: pgmap v13671: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 374 KiB/s wr, 11 op/s 2023-05-08T10:49:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:50 smithi096 ceph-mon[124666]: pgmap v13671: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 374 KiB/s wr, 11 op/s 2023-05-08T10:49:51.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:50 smithi186 ceph-mon[126480]: pgmap v13671: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 374 KiB/s wr, 11 op/s 2023-05-08T10:49:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:51 smithi133 ceph-mon[125939]: pgmap v13672: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 389 KiB/s wr, 9 op/s 2023-05-08T10:49:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:51 smithi096 ceph-mon[124666]: pgmap v13672: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 389 KiB/s wr, 9 op/s 2023-05-08T10:49:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:51 smithi186 ceph-mon[126480]: pgmap v13672: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 389 KiB/s wr, 9 op/s 2023-05-08T10:49:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:49:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:49:53.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:49:54.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:49:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:49:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:53 smithi096 ceph-mon[124666]: pgmap v13673: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 389 KiB/s wr, 8 op/s 2023-05-08T10:49:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:49:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:49:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:53 smithi186 ceph-mon[126480]: pgmap v13673: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 389 KiB/s wr, 8 op/s 2023-05-08T10:49:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:49:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:49:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:53 smithi133 ceph-mon[125939]: pgmap v13673: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 389 KiB/s wr, 8 op/s 2023-05-08T10:49:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25533.150254 secs 2023-05-08T10:49:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:54 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:49:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25533.150254 secs 2023-05-08T10:49:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:54 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:49:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25533.150254 secs 2023-05-08T10:49:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:54 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:49:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25534.993925 secs 2023-05-08T10:49:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:55 smithi096 ceph-mon[124666]: pgmap v13674: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 789 KiB/s rd, 791 KiB/s wr, 13 op/s 2023-05-08T10:49:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25534.993925 secs 2023-05-08T10:49:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:55 smithi186 ceph-mon[126480]: pgmap v13674: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 789 KiB/s rd, 791 KiB/s wr, 13 op/s 2023-05-08T10:49:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25534.993925 secs 2023-05-08T10:49:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:55 smithi133 ceph-mon[125939]: pgmap v13674: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 789 KiB/s rd, 791 KiB/s wr, 13 op/s 2023-05-08T10:49:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:49:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:49:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:57 smithi186 ceph-mon[126480]: pgmap v13675: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 525 KiB/s wr, 9 op/s 2023-05-08T10:49:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:49:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:49:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:57 smithi133 ceph-mon[125939]: pgmap v13675: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 525 KiB/s wr, 9 op/s 2023-05-08T10:49:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:49:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:49:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:57 smithi096 ceph-mon[124666]: pgmap v13675: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 525 KiB/s wr, 9 op/s 2023-05-08T10:49:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25538.150362 secs 2023-05-08T10:49:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25538.150362 secs 2023-05-08T10:49:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25538.150362 secs 2023-05-08T10:50:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:59 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:50:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:49:59 smithi096 ceph-mon[124666]: pgmap v13676: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 638 KiB/s rd, 641 KiB/s wr, 14 op/s 2023-05-08T10:50:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:59 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:50:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:49:59 smithi186 ceph-mon[126480]: pgmap v13676: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 638 KiB/s rd, 641 KiB/s wr, 14 op/s 2023-05-08T10:50:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:59 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:50:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:49:59 smithi133 ceph-mon[125939]: pgmap v13676: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 638 KiB/s rd, 641 KiB/s wr, 14 op/s 2023-05-08T10:50:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:00 smithi096 ceph-mon[124666]: Health detail: HEALTH_WARN 2 MDSs report slow requests 2023-05-08T10:50:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:00 smithi096 ceph-mon[124666]: [WRN] MDS_SLOW_REQUEST: 2 MDSs report slow requests 2023-05-08T10:50:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:00 smithi096 ceph-mon[124666]: mds.i(mds.1): 1 slow requests are blocked > 180 secs 2023-05-08T10:50:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:00 smithi096 ceph-mon[124666]: mds.b(mds.0): 1 slow requests are blocked > 180 secs 2023-05-08T10:50:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25539.994007 secs 2023-05-08T10:50:01.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:00 smithi186 ceph-mon[126480]: Health detail: HEALTH_WARN 2 MDSs report slow requests 2023-05-08T10:50:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:00 smithi186 ceph-mon[126480]: [WRN] MDS_SLOW_REQUEST: 2 MDSs report slow requests 2023-05-08T10:50:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:00 smithi186 ceph-mon[126480]: mds.i(mds.1): 1 slow requests are blocked > 180 secs 2023-05-08T10:50:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:00 smithi186 ceph-mon[126480]: mds.b(mds.0): 1 slow requests are blocked > 180 secs 2023-05-08T10:50:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25539.994007 secs 2023-05-08T10:50:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:00 smithi133 ceph-mon[125939]: Health detail: HEALTH_WARN 2 MDSs report slow requests 2023-05-08T10:50:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:00 smithi133 ceph-mon[125939]: [WRN] MDS_SLOW_REQUEST: 2 MDSs report slow requests 2023-05-08T10:50:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:00 smithi133 ceph-mon[125939]: mds.i(mds.1): 1 slow requests are blocked > 180 secs 2023-05-08T10:50:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:00 smithi133 ceph-mon[125939]: mds.b(mds.0): 1 slow requests are blocked > 180 secs 2023-05-08T10:50:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25539.994007 secs 2023-05-08T10:50:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:01 smithi096 ceph-mon[124666]: pgmap v13677: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 546 KiB/s rd, 550 KiB/s wr, 11 op/s 2023-05-08T10:50:02.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:01 smithi186 ceph-mon[126480]: pgmap v13677: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 546 KiB/s rd, 550 KiB/s wr, 11 op/s 2023-05-08T10:50:02.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:01 smithi133 ceph-mon[125939]: pgmap v13677: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 546 KiB/s rd, 550 KiB/s wr, 11 op/s 2023-05-08T10:50:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25543.150482 secs 2023-05-08T10:50:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:04 smithi133 ceph-mon[125939]: pgmap v13678: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 546 KiB/s rd, 534 KiB/s wr, 11 op/s 2023-05-08T10:50:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25543.707081 secs 2023-05-08T10:50:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25543.150482 secs 2023-05-08T10:50:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:04 smithi096 ceph-mon[124666]: pgmap v13678: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 546 KiB/s rd, 534 KiB/s wr, 11 op/s 2023-05-08T10:50:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25543.707081 secs 2023-05-08T10:50:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25543.150482 secs 2023-05-08T10:50:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:04 smithi186 ceph-mon[126480]: pgmap v13678: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 546 KiB/s rd, 534 KiB/s wr, 11 op/s 2023-05-08T10:50:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25543.707081 secs 2023-05-08T10:50:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25544.994080 secs 2023-05-08T10:50:06.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25544.994080 secs 2023-05-08T10:50:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25544.994080 secs 2023-05-08T10:50:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:06 smithi133 ceph-mon[125939]: pgmap v13679: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 872 KiB/s rd, 879 KiB/s wr, 30 op/s 2023-05-08T10:50:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:06 smithi133 ceph-mon[125939]: osdmap e932: 12 total, 12 up, 12 in 2023-05-08T10:50:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:06 smithi096 ceph-mon[124666]: pgmap v13679: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 872 KiB/s rd, 879 KiB/s wr, 30 op/s 2023-05-08T10:50:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:06 smithi096 ceph-mon[124666]: osdmap e932: 12 total, 12 up, 12 in 2023-05-08T10:50:07.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:06 smithi186 ceph-mon[126480]: pgmap v13679: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 872 KiB/s rd, 879 KiB/s wr, 30 op/s 2023-05-08T10:50:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:06 smithi186 ceph-mon[126480]: osdmap e932: 12 total, 12 up, 12 in 2023-05-08T10:50:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:07 smithi133 ceph-mon[125939]: pgmap v13681: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 549 KiB/s rd, 572 KiB/s wr, 30 op/s 2023-05-08T10:50:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:07 smithi096 ceph-mon[124666]: pgmap v13681: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 549 KiB/s rd, 572 KiB/s wr, 30 op/s 2023-05-08T10:50:08.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:07 smithi186 ceph-mon[126480]: pgmap v13681: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 549 KiB/s rd, 572 KiB/s wr, 30 op/s 2023-05-08T10:50:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:08 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:50:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:50:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:50:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:08 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:50:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:50:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:50:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:08 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:50:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:50:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:50:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25548.150594 secs 2023-05-08T10:50:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25548.707197 secs 2023-05-08T10:50:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:09 smithi186 ceph-mon[126480]: pgmap v13682: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 411 KiB/s rd, 434 KiB/s wr, 28 op/s 2023-05-08T10:50:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25548.150594 secs 2023-05-08T10:50:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25548.707197 secs 2023-05-08T10:50:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:09 smithi133 ceph-mon[125939]: pgmap v13682: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 411 KiB/s rd, 434 KiB/s wr, 28 op/s 2023-05-08T10:50:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25548.150594 secs 2023-05-08T10:50:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25548.707197 secs 2023-05-08T10:50:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:09 smithi096 ceph-mon[124666]: pgmap v13682: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 411 KiB/s rd, 434 KiB/s wr, 28 op/s 2023-05-08T10:50:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25549.994173 secs 2023-05-08T10:50:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25549.994173 secs 2023-05-08T10:50:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25549.994173 secs 2023-05-08T10:50:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:12 smithi133 ceph-mon[125939]: pgmap v13683: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 415 KiB/s wr, 28 op/s 2023-05-08T10:50:13.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:12 smithi096 ceph-mon[124666]: pgmap v13683: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 415 KiB/s wr, 28 op/s 2023-05-08T10:50:13.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:12 smithi186 ceph-mon[126480]: pgmap v13683: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 415 KiB/s wr, 28 op/s 2023-05-08T10:50:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25553.150714 secs 2023-05-08T10:50:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:14 smithi133 ceph-mon[125939]: pgmap v13684: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 415 KiB/s wr, 28 op/s 2023-05-08T10:50:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25553.707328 secs 2023-05-08T10:50:14.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:14 smithi133 ceph-mon[125939]: osdmap e933: 12 total, 12 up, 12 in 2023-05-08T10:50:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25553.150714 secs 2023-05-08T10:50:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:14 smithi096 ceph-mon[124666]: pgmap v13684: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 415 KiB/s wr, 28 op/s 2023-05-08T10:50:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25553.707328 secs 2023-05-08T10:50:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:14 smithi096 ceph-mon[124666]: osdmap e933: 12 total, 12 up, 12 in 2023-05-08T10:50:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25553.150714 secs 2023-05-08T10:50:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:14 smithi186 ceph-mon[126480]: pgmap v13684: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 415 KiB/s wr, 28 op/s 2023-05-08T10:50:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25553.707328 secs 2023-05-08T10:50:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:14 smithi186 ceph-mon[126480]: osdmap e933: 12 total, 12 up, 12 in 2023-05-08T10:50:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25554.994290 secs 2023-05-08T10:50:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25554.994290 secs 2023-05-08T10:50:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25554.994290 secs 2023-05-08T10:50:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:16 smithi133 ceph-mon[125939]: pgmap v13686: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 122 KiB/s wr, 8 op/s 2023-05-08T10:50:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:16 smithi096 ceph-mon[124666]: pgmap v13686: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 122 KiB/s wr, 8 op/s 2023-05-08T10:50:17.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:16 smithi186 ceph-mon[126480]: pgmap v13686: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 122 KiB/s wr, 8 op/s 2023-05-08T10:50:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:17 smithi133 ceph-mon[125939]: pgmap v13687: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 121 KiB/s wr, 8 op/s 2023-05-08T10:50:18.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:17 smithi096 ceph-mon[124666]: pgmap v13687: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 121 KiB/s wr, 8 op/s 2023-05-08T10:50:18.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:17 smithi186 ceph-mon[126480]: pgmap v13687: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 121 KiB/s wr, 8 op/s 2023-05-08T10:50:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25558.150833 secs 2023-05-08T10:50:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25558.150833 secs 2023-05-08T10:50:19.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25558.150833 secs 2023-05-08T10:50:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25558.707443 secs 2023-05-08T10:50:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:19 smithi096 ceph-mon[124666]: pgmap v13688: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 121 KiB/s wr, 7 op/s 2023-05-08T10:50:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25558.707443 secs 2023-05-08T10:50:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:19 smithi186 ceph-mon[126480]: pgmap v13688: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 121 KiB/s wr, 7 op/s 2023-05-08T10:50:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25558.707443 secs 2023-05-08T10:50:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:19 smithi133 ceph-mon[125939]: pgmap v13688: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 121 KiB/s wr, 7 op/s 2023-05-08T10:50:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25559.994358 secs 2023-05-08T10:50:22.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25559.994358 secs 2023-05-08T10:50:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25559.994358 secs 2023-05-08T10:50:22.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:22 smithi133 ceph-mon[125939]: pgmap v13689: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 121 KiB/s wr, 7 op/s 2023-05-08T10:50:23.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:22 smithi096 ceph-mon[124666]: pgmap v13689: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 121 KiB/s wr, 7 op/s 2023-05-08T10:50:23.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:22 smithi186 ceph-mon[126480]: pgmap v13689: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 121 KiB/s wr, 7 op/s 2023-05-08T10:50:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25563.150949 secs 2023-05-08T10:50:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:24 smithi133 ceph-mon[125939]: pgmap v13690: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 121 KiB/s wr, 7 op/s 2023-05-08T10:50:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25563.707560 secs 2023-05-08T10:50:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25563.150949 secs 2023-05-08T10:50:25.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:24 smithi096 ceph-mon[124666]: pgmap v13690: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 121 KiB/s wr, 7 op/s 2023-05-08T10:50:25.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25563.707560 secs 2023-05-08T10:50:25.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25563.150949 secs 2023-05-08T10:50:25.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:24 smithi186 ceph-mon[126480]: pgmap v13690: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 121 KiB/s wr, 7 op/s 2023-05-08T10:50:25.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25563.707560 secs 2023-05-08T10:50:25.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25564.994468 secs 2023-05-08T10:50:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25564.994468 secs 2023-05-08T10:50:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25564.994468 secs 2023-05-08T10:50:26.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:26 smithi133 ceph-mon[125939]: pgmap v13691: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2023-05-08T10:50:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:26 smithi096 ceph-mon[124666]: pgmap v13691: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2023-05-08T10:50:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:26 smithi186 ceph-mon[126480]: pgmap v13691: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2023-05-08T10:50:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:28 smithi133 ceph-mon[125939]: pgmap v13692: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:50:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:28 smithi096 ceph-mon[124666]: pgmap v13692: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:50:29.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:28 smithi186 ceph-mon[126480]: pgmap v13692: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:50:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25568.151082 secs 2023-05-08T10:50:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25568.707641 secs 2023-05-08T10:50:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25568.151082 secs 2023-05-08T10:50:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25568.707641 secs 2023-05-08T10:50:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25568.151082 secs 2023-05-08T10:50:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25568.707641 secs 2023-05-08T10:50:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:30 smithi133 ceph-mon[125939]: pgmap v13693: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T10:50:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25569.994587 secs 2023-05-08T10:50:31.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:30 smithi096 ceph-mon[124666]: pgmap v13693: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T10:50:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25569.994587 secs 2023-05-08T10:50:31.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:30 smithi186 ceph-mon[126480]: pgmap v13693: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T10:50:31.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25569.994587 secs 2023-05-08T10:50:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:31 smithi186 ceph-mon[126480]: pgmap v13694: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2023-05-08T10:50:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:31 smithi133 ceph-mon[125939]: pgmap v13694: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2023-05-08T10:50:32.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:31 smithi096 ceph-mon[124666]: pgmap v13694: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2023-05-08T10:50:34.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25573.151222 secs 2023-05-08T10:50:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:34 smithi133 ceph-mon[125939]: pgmap v13695: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:50:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25573.707753 secs 2023-05-08T10:50:35.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25573.151222 secs 2023-05-08T10:50:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:34 smithi096 ceph-mon[124666]: pgmap v13695: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:50:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25573.707753 secs 2023-05-08T10:50:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25573.151222 secs 2023-05-08T10:50:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:34 smithi186 ceph-mon[126480]: pgmap v13695: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:50:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25573.707753 secs 2023-05-08T10:50:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25574.994715 secs 2023-05-08T10:50:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25574.994715 secs 2023-05-08T10:50:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25574.994715 secs 2023-05-08T10:50:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:36 smithi133 ceph-mon[125939]: pgmap v13696: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 9 op/s 2023-05-08T10:50:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:36 smithi096 ceph-mon[124666]: pgmap v13696: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 9 op/s 2023-05-08T10:50:37.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:36 smithi186 ceph-mon[126480]: pgmap v13696: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 9 op/s 2023-05-08T10:50:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:37 smithi133 ceph-mon[125939]: pgmap v13697: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 6 op/s 2023-05-08T10:50:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:37 smithi096 ceph-mon[124666]: pgmap v13697: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 6 op/s 2023-05-08T10:50:38.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:37 smithi186 ceph-mon[126480]: pgmap v13697: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 6 op/s 2023-05-08T10:50:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25578.151350 secs 2023-05-08T10:50:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25578.151350 secs 2023-05-08T10:50:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25578.151350 secs 2023-05-08T10:50:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25578.707864 secs 2023-05-08T10:50:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:39 smithi096 ceph-mon[124666]: pgmap v13698: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 50 KiB/s wr, 10 op/s 2023-05-08T10:50:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25578.707864 secs 2023-05-08T10:50:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:39 smithi186 ceph-mon[126480]: pgmap v13698: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 50 KiB/s wr, 10 op/s 2023-05-08T10:50:40.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25578.707864 secs 2023-05-08T10:50:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:39 smithi133 ceph-mon[125939]: pgmap v13698: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 50 KiB/s wr, 10 op/s 2023-05-08T10:50:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25579.994849 secs 2023-05-08T10:50:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25579.994849 secs 2023-05-08T10:50:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25579.994849 secs 2023-05-08T10:50:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:42 smithi133 ceph-mon[125939]: pgmap v13699: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 50 KiB/s wr, 8 op/s 2023-05-08T10:50:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:42 smithi096 ceph-mon[124666]: pgmap v13699: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 50 KiB/s wr, 8 op/s 2023-05-08T10:50:43.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:42 smithi186 ceph-mon[126480]: pgmap v13699: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 50 KiB/s wr, 8 op/s 2023-05-08T10:50:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25583.151460 secs 2023-05-08T10:50:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:44 smithi133 ceph-mon[125939]: pgmap v13700: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 50 KiB/s wr, 7 op/s 2023-05-08T10:50:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25583.707994 secs 2023-05-08T10:50:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25583.151460 secs 2023-05-08T10:50:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:44 smithi096 ceph-mon[124666]: pgmap v13700: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 50 KiB/s wr, 7 op/s 2023-05-08T10:50:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25583.707994 secs 2023-05-08T10:50:45.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25583.151460 secs 2023-05-08T10:50:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:44 smithi186 ceph-mon[126480]: pgmap v13700: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 50 KiB/s wr, 7 op/s 2023-05-08T10:50:45.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25583.707994 secs 2023-05-08T10:50:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:46 smithi133 ceph-mon[125939]: pgmap v13701: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 604 KiB/s rd, 354 KiB/s wr, 11 op/s 2023-05-08T10:50:47.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:46 smithi096 ceph-mon[124666]: pgmap v13701: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 604 KiB/s rd, 354 KiB/s wr, 11 op/s 2023-05-08T10:50:47.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:46 smithi186 ceph-mon[126480]: pgmap v13701: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 604 KiB/s rd, 354 KiB/s wr, 11 op/s 2023-05-08T10:50:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:48 smithi133 ceph-mon[125939]: pgmap v13702: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 602 KiB/s rd, 354 KiB/s wr, 8 op/s 2023-05-08T10:50:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:50:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:48 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:50:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:48 smithi096 ceph-mon[124666]: pgmap v13702: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 602 KiB/s rd, 354 KiB/s wr, 8 op/s 2023-05-08T10:50:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:50:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:48 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:50:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:48 smithi186 ceph-mon[126480]: pgmap v13702: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 602 KiB/s rd, 354 KiB/s wr, 8 op/s 2023-05-08T10:50:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:50:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:48 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:50:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25588.151546 secs 2023-05-08T10:50:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:50:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:50:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:50:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:49 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:50:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:49 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:50:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:49 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:50:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:49 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:50:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:49 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T10:50:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:49 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T10:50:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:49 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:50:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:49 smithi096 ceph-mon[124666]: pgmap v13703: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 767 KiB/s rd, 410 KiB/s wr, 12 op/s 2023-05-08T10:50:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25588.151546 secs 2023-05-08T10:50:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:50:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:50:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:50:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:49 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:50:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:49 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:50:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:49 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:50:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:49 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:50:50.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:49 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T10:50:50.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:49 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T10:50:50.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:49 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:50:50.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:49 smithi186 ceph-mon[126480]: pgmap v13703: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 767 KiB/s rd, 410 KiB/s wr, 12 op/s 2023-05-08T10:50:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25588.151546 secs 2023-05-08T10:50:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:50:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:50:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:50:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:49 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:50:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:49 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:50:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:49 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:50:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:49 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:50:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:49 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T10:50:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:49 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T10:50:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:49 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:50:50.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:49 smithi133 ceph-mon[125939]: pgmap v13703: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 767 KiB/s rd, 410 KiB/s wr, 12 op/s 2023-05-08T10:50:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:52 smithi133 ceph-mon[125939]: pgmap v13704: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 569 KiB/s rd, 376 KiB/s wr, 9 op/s 2023-05-08T10:50:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:50:53.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:52 smithi096 ceph-mon[124666]: pgmap v13704: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 569 KiB/s rd, 376 KiB/s wr, 9 op/s 2023-05-08T10:50:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:50:53.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:52 smithi186 ceph-mon[126480]: pgmap v13704: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 569 KiB/s rd, 376 KiB/s wr, 9 op/s 2023-05-08T10:50:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:50:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:50:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:50:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:53 smithi133 ceph-mon[125939]: pgmap v13705: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 568 KiB/s rd, 375 KiB/s wr, 8 op/s 2023-05-08T10:50:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:50:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:50:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:53 smithi096 ceph-mon[124666]: pgmap v13705: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 568 KiB/s rd, 375 KiB/s wr, 8 op/s 2023-05-08T10:50:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:50:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:50:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:53 smithi186 ceph-mon[126480]: pgmap v13705: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 568 KiB/s rd, 375 KiB/s wr, 8 op/s 2023-05-08T10:50:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25593.151682 secs 2023-05-08T10:50:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:54 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:50:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25593.151682 secs 2023-05-08T10:50:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:54 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:50:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25593.151682 secs 2023-05-08T10:50:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:54 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:50:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:55 smithi186 ceph-mon[126480]: pgmap v13706: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1021 KiB/s rd, 744 KiB/s wr, 14 op/s 2023-05-08T10:50:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:55 smithi133 ceph-mon[125939]: pgmap v13706: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1021 KiB/s rd, 744 KiB/s wr, 14 op/s 2023-05-08T10:50:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:55 smithi096 ceph-mon[124666]: pgmap v13706: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1021 KiB/s rd, 744 KiB/s wr, 14 op/s 2023-05-08T10:50:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:58 smithi133 ceph-mon[125939]: pgmap v13707: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 617 KiB/s rd, 440 KiB/s wr, 10 op/s 2023-05-08T10:50:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:58 smithi096 ceph-mon[124666]: pgmap v13707: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 617 KiB/s rd, 440 KiB/s wr, 10 op/s 2023-05-08T10:50:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:58 smithi186 ceph-mon[126480]: pgmap v13707: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 617 KiB/s rd, 440 KiB/s wr, 10 op/s 2023-05-08T10:50:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:50:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25598.151823 secs 2023-05-08T10:51:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:50:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25598.151823 secs 2023-05-08T10:51:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:50:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25598.151823 secs 2023-05-08T10:51:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:00 smithi133 ceph-mon[125939]: pgmap v13708: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 815 KiB/s rd, 637 KiB/s wr, 15 op/s 2023-05-08T10:51:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25599.995339 secs 2023-05-08T10:51:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:00 smithi096 ceph-mon[124666]: pgmap v13708: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 815 KiB/s rd, 637 KiB/s wr, 15 op/s 2023-05-08T10:51:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25599.995339 secs 2023-05-08T10:51:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:00 smithi186 ceph-mon[126480]: pgmap v13708: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 815 KiB/s rd, 637 KiB/s wr, 15 op/s 2023-05-08T10:51:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25599.995339 secs 2023-05-08T10:51:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:01 smithi133 ceph-mon[125939]: pgmap v13709: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 666 KiB/s rd, 597 KiB/s wr, 12 op/s 2023-05-08T10:51:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:01 smithi096 ceph-mon[124666]: pgmap v13709: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 666 KiB/s rd, 597 KiB/s wr, 12 op/s 2023-05-08T10:51:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:01 smithi186 ceph-mon[126480]: pgmap v13709: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 666 KiB/s rd, 597 KiB/s wr, 12 op/s 2023-05-08T10:51:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25603.151945 secs 2023-05-08T10:51:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:04 smithi096 ceph-mon[124666]: pgmap v13710: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 666 KiB/s rd, 581 KiB/s wr, 11 op/s 2023-05-08T10:51:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25603.708448 secs 2023-05-08T10:51:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25603.151945 secs 2023-05-08T10:51:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:04 smithi186 ceph-mon[126480]: pgmap v13710: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 666 KiB/s rd, 581 KiB/s wr, 11 op/s 2023-05-08T10:51:05.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25603.708448 secs 2023-05-08T10:51:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25603.151945 secs 2023-05-08T10:51:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:04 smithi133 ceph-mon[125939]: pgmap v13710: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 666 KiB/s rd, 581 KiB/s wr, 11 op/s 2023-05-08T10:51:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25603.708448 secs 2023-05-08T10:51:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:05 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:51:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:51:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:51:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25604.995460 secs 2023-05-08T10:51:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:05 smithi096 ceph-mon[124666]: pgmap v13711: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 992 KiB/s rd, 928 KiB/s wr, 30 op/s 2023-05-08T10:51:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:05 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:51:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:51:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:51:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25604.995460 secs 2023-05-08T10:51:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:05 smithi186 ceph-mon[126480]: pgmap v13711: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 992 KiB/s rd, 928 KiB/s wr, 30 op/s 2023-05-08T10:51:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:05 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:51:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:51:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:51:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25604.995460 secs 2023-05-08T10:51:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:05 smithi133 ceph-mon[125939]: pgmap v13711: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 992 KiB/s rd, 928 KiB/s wr, 30 op/s 2023-05-08T10:51:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:06 smithi096 ceph-mon[124666]: osdmap e934: 12 total, 12 up, 12 in 2023-05-08T10:51:07.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:06 smithi186 ceph-mon[126480]: osdmap e934: 12 total, 12 up, 12 in 2023-05-08T10:51:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:06 smithi133 ceph-mon[125939]: osdmap e934: 12 total, 12 up, 12 in 2023-05-08T10:51:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:07 smithi096 ceph-mon[124666]: pgmap v13713: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 648 KiB/s rd, 671 KiB/s wr, 29 op/s 2023-05-08T10:51:08.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:07 smithi186 ceph-mon[126480]: pgmap v13713: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 648 KiB/s rd, 671 KiB/s wr, 29 op/s 2023-05-08T10:51:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:07 smithi133 ceph-mon[125939]: pgmap v13713: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 648 KiB/s rd, 671 KiB/s wr, 29 op/s 2023-05-08T10:51:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25608.152041 secs 2023-05-08T10:51:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:51:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:51:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25608.708487 secs 2023-05-08T10:51:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:09 smithi186 ceph-mon[126480]: pgmap v13714: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 435 KiB/s wr, 26 op/s 2023-05-08T10:51:10.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25608.152041 secs 2023-05-08T10:51:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:51:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:51:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25608.708487 secs 2023-05-08T10:51:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:09 smithi133 ceph-mon[125939]: pgmap v13714: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 435 KiB/s wr, 26 op/s 2023-05-08T10:51:10.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25608.152041 secs 2023-05-08T10:51:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:51:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:51:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25608.708487 secs 2023-05-08T10:51:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:09 smithi096 ceph-mon[124666]: pgmap v13714: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 435 KiB/s wr, 26 op/s 2023-05-08T10:51:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25609.995598 secs 2023-05-08T10:51:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25609.995598 secs 2023-05-08T10:51:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25609.995598 secs 2023-05-08T10:51:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:12 smithi133 ceph-mon[125939]: pgmap v13715: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 394 KiB/s rd, 537 KiB/s wr, 27 op/s 2023-05-08T10:51:13.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:12 smithi096 ceph-mon[124666]: pgmap v13715: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 394 KiB/s rd, 537 KiB/s wr, 27 op/s 2023-05-08T10:51:13.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:12 smithi186 ceph-mon[126480]: pgmap v13715: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 394 KiB/s rd, 537 KiB/s wr, 27 op/s 2023-05-08T10:51:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25613.152133 secs 2023-05-08T10:51:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:14 smithi133 ceph-mon[125939]: pgmap v13716: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 394 KiB/s rd, 537 KiB/s wr, 27 op/s 2023-05-08T10:51:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25613.708583 secs 2023-05-08T10:51:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:14 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:51:14.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:14 smithi133 ceph-mon[125939]: osdmap e935: 12 total, 12 up, 12 in 2023-05-08T10:51:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25613.152133 secs 2023-05-08T10:51:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:14 smithi096 ceph-mon[124666]: pgmap v13716: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 394 KiB/s rd, 537 KiB/s wr, 27 op/s 2023-05-08T10:51:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25613.708583 secs 2023-05-08T10:51:15.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:14 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:51:15.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:14 smithi096 ceph-mon[124666]: osdmap e935: 12 total, 12 up, 12 in 2023-05-08T10:51:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25613.152133 secs 2023-05-08T10:51:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:14 smithi186 ceph-mon[126480]: pgmap v13716: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 394 KiB/s rd, 537 KiB/s wr, 27 op/s 2023-05-08T10:51:15.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25613.708583 secs 2023-05-08T10:51:15.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:14 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:51:15.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:14 smithi186 ceph-mon[126480]: osdmap e935: 12 total, 12 up, 12 in 2023-05-08T10:51:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25614.995713 secs 2023-05-08T10:51:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25614.995713 secs 2023-05-08T10:51:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25614.995713 secs 2023-05-08T10:51:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:16 smithi096 ceph-mon[124666]: pgmap v13718: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 122 KiB/s wr, 7 op/s 2023-05-08T10:51:17.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:16 smithi186 ceph-mon[126480]: pgmap v13718: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 122 KiB/s wr, 7 op/s 2023-05-08T10:51:17.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:16 smithi133 ceph-mon[125939]: pgmap v13718: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 122 KiB/s wr, 7 op/s 2023-05-08T10:51:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:17 smithi096 ceph-mon[124666]: pgmap v13719: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 122 KiB/s wr, 7 op/s 2023-05-08T10:51:18.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:17 smithi186 ceph-mon[126480]: pgmap v13719: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 122 KiB/s wr, 7 op/s 2023-05-08T10:51:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:17 smithi133 ceph-mon[125939]: pgmap v13719: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 122 KiB/s wr, 7 op/s 2023-05-08T10:51:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25618.152271 secs 2023-05-08T10:51:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25618.152271 secs 2023-05-08T10:51:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25618.152271 secs 2023-05-08T10:51:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25618.708674 secs 2023-05-08T10:51:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:20 smithi096 ceph-mon[124666]: pgmap v13720: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 121 KiB/s wr, 6 op/s 2023-05-08T10:51:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25618.708674 secs 2023-05-08T10:51:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:20 smithi186 ceph-mon[126480]: pgmap v13720: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 121 KiB/s wr, 6 op/s 2023-05-08T10:51:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25618.708674 secs 2023-05-08T10:51:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:20 smithi133 ceph-mon[125939]: pgmap v13720: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 121 KiB/s wr, 6 op/s 2023-05-08T10:51:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25619.995814 secs 2023-05-08T10:51:22.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25619.995814 secs 2023-05-08T10:51:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25619.995814 secs 2023-05-08T10:51:22.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:22 smithi133 ceph-mon[125939]: pgmap v13721: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 0 B/s wr, 6 op/s 2023-05-08T10:51:23.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:22 smithi096 ceph-mon[124666]: pgmap v13721: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 0 B/s wr, 6 op/s 2023-05-08T10:51:23.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:22 smithi186 ceph-mon[126480]: pgmap v13721: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 0 B/s wr, 6 op/s 2023-05-08T10:51:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:23 smithi186 ceph-mon[126480]: pgmap v13722: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 0 B/s wr, 6 op/s 2023-05-08T10:51:24.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:23 smithi133 ceph-mon[125939]: pgmap v13722: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 0 B/s wr, 6 op/s 2023-05-08T10:51:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:23 smithi096 ceph-mon[124666]: pgmap v13722: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 0 B/s wr, 6 op/s 2023-05-08T10:51:25.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25623.152329 secs 2023-05-08T10:51:25.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25623.708773 secs 2023-05-08T10:51:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25623.152329 secs 2023-05-08T10:51:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25623.708773 secs 2023-05-08T10:51:25.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25623.152329 secs 2023-05-08T10:51:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25623.708773 secs 2023-05-08T10:51:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25624.995893 secs 2023-05-08T10:51:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:25 smithi186 ceph-mon[126480]: pgmap v13723: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 6 op/s 2023-05-08T10:51:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25624.995893 secs 2023-05-08T10:51:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:25 smithi133 ceph-mon[125939]: pgmap v13723: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 6 op/s 2023-05-08T10:51:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25624.995893 secs 2023-05-08T10:51:26.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:25 smithi096 ceph-mon[124666]: pgmap v13723: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 6 op/s 2023-05-08T10:51:28.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:27 smithi186 ceph-mon[126480]: pgmap v13724: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:51:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:27 smithi133 ceph-mon[125939]: pgmap v13724: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:51:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:27 smithi096 ceph-mon[124666]: pgmap v13724: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:51:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25628.152463 secs 2023-05-08T10:51:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25628.152463 secs 2023-05-08T10:51:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25628.152463 secs 2023-05-08T10:51:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25628.708882 secs 2023-05-08T10:51:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:30 smithi186 ceph-mon[126480]: pgmap v13725: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2023-05-08T10:51:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25628.708882 secs 2023-05-08T10:51:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:30 smithi133 ceph-mon[125939]: pgmap v13725: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2023-05-08T10:51:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25628.708882 secs 2023-05-08T10:51:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:30 smithi096 ceph-mon[124666]: pgmap v13725: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2023-05-08T10:51:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25629.996033 secs 2023-05-08T10:51:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25629.996033 secs 2023-05-08T10:51:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25629.996033 secs 2023-05-08T10:51:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:32 smithi133 ceph-mon[125939]: pgmap v13726: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:51:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:32 smithi096 ceph-mon[124666]: pgmap v13726: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:51:33.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:32 smithi186 ceph-mon[126480]: pgmap v13726: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:51:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:33 smithi186 ceph-mon[126480]: pgmap v13727: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:51:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:33 smithi133 ceph-mon[125939]: pgmap v13727: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:51:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:33 smithi096 ceph-mon[124666]: pgmap v13727: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:51:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25633.152580 secs 2023-05-08T10:51:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25633.709009 secs 2023-05-08T10:51:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25633.152580 secs 2023-05-08T10:51:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25633.709009 secs 2023-05-08T10:51:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25633.152580 secs 2023-05-08T10:51:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25633.709009 secs 2023-05-08T10:51:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25634.996116 secs 2023-05-08T10:51:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:35 smithi186 ceph-mon[126480]: pgmap v13728: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 853 B/s wr, 8 op/s 2023-05-08T10:51:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25634.996116 secs 2023-05-08T10:51:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:35 smithi133 ceph-mon[125939]: pgmap v13728: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 853 B/s wr, 8 op/s 2023-05-08T10:51:36.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25634.996116 secs 2023-05-08T10:51:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:35 smithi096 ceph-mon[124666]: pgmap v13728: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 853 B/s wr, 8 op/s 2023-05-08T10:51:38.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:37 smithi186 ceph-mon[126480]: pgmap v13729: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 853 B/s wr, 5 op/s 2023-05-08T10:51:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:37 smithi133 ceph-mon[125939]: pgmap v13729: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 853 B/s wr, 5 op/s 2023-05-08T10:51:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:37 smithi096 ceph-mon[124666]: pgmap v13729: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 853 B/s wr, 5 op/s 2023-05-08T10:51:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25638.152645 secs 2023-05-08T10:51:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25638.152645 secs 2023-05-08T10:51:39.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25638.152645 secs 2023-05-08T10:51:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25638.709090 secs 2023-05-08T10:51:40.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:40 smithi186 ceph-mon[126480]: pgmap v13730: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 938 B/s wr, 7 op/s 2023-05-08T10:51:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25638.709090 secs 2023-05-08T10:51:40.514 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:40 smithi133 ceph-mon[125939]: pgmap v13730: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 938 B/s wr, 7 op/s 2023-05-08T10:51:40.515 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25638.709090 secs 2023-05-08T10:51:40.515 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:40 smithi096 ceph-mon[124666]: pgmap v13730: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 938 B/s wr, 7 op/s 2023-05-08T10:51:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25639.996236 secs 2023-05-08T10:51:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25639.996236 secs 2023-05-08T10:51:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25639.996236 secs 2023-05-08T10:51:42.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:42 smithi133 ceph-mon[125939]: pgmap v13731: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 91 KiB/s wr, 7 op/s 2023-05-08T10:51:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:42 smithi096 ceph-mon[124666]: pgmap v13731: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 91 KiB/s wr, 7 op/s 2023-05-08T10:51:43.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:42 smithi186 ceph-mon[126480]: pgmap v13731: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 91 KiB/s wr, 7 op/s 2023-05-08T10:51:44.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:43 smithi186 ceph-mon[126480]: pgmap v13732: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 91 KiB/s wr, 6 op/s 2023-05-08T10:51:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:43 smithi133 ceph-mon[125939]: pgmap v13732: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 91 KiB/s wr, 6 op/s 2023-05-08T10:51:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:43 smithi096 ceph-mon[124666]: pgmap v13732: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 91 KiB/s wr, 6 op/s 2023-05-08T10:51:45.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25643.152764 secs 2023-05-08T10:51:45.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25643.709208 secs 2023-05-08T10:51:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25643.152764 secs 2023-05-08T10:51:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25643.709208 secs 2023-05-08T10:51:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25643.152764 secs 2023-05-08T10:51:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25643.709208 secs 2023-05-08T10:51:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:45 smithi186 ceph-mon[126480]: pgmap v13733: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 91 KiB/s wr, 10 op/s 2023-05-08T10:51:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:45 smithi133 ceph-mon[125939]: pgmap v13733: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 91 KiB/s wr, 10 op/s 2023-05-08T10:51:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:45 smithi096 ceph-mon[124666]: pgmap v13733: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 91 KiB/s wr, 10 op/s 2023-05-08T10:51:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:47 smithi186 ceph-mon[126480]: pgmap v13734: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 91 KiB/s wr, 6 op/s 2023-05-08T10:51:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:47 smithi133 ceph-mon[125939]: pgmap v13734: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 91 KiB/s wr, 6 op/s 2023-05-08T10:51:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:47 smithi096 ceph-mon[124666]: pgmap v13734: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 91 KiB/s wr, 6 op/s 2023-05-08T10:51:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:51:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:51:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:51:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25648.152877 secs 2023-05-08T10:51:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:51:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:51:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:51:50.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25648.709299 secs 2023-05-08T10:51:50.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:49 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:51:50.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:49 smithi186 ceph-mon[126480]: pgmap v13735: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 179 KiB/s wr, 8 op/s 2023-05-08T10:51:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25648.152877 secs 2023-05-08T10:51:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:51:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:51:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:51:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25648.709299 secs 2023-05-08T10:51:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:49 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:51:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:49 smithi133 ceph-mon[125939]: pgmap v13735: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 179 KiB/s wr, 8 op/s 2023-05-08T10:51:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25648.152877 secs 2023-05-08T10:51:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:51:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:51:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:51:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25648.709299 secs 2023-05-08T10:51:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:49 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:51:50.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:49 smithi096 ceph-mon[124666]: pgmap v13735: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 179 KiB/s wr, 8 op/s 2023-05-08T10:51:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:51 smithi186 ceph-mon[126480]: pgmap v13736: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 179 KiB/s wr, 7 op/s 2023-05-08T10:51:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:51 smithi133 ceph-mon[125939]: pgmap v13736: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 179 KiB/s wr, 7 op/s 2023-05-08T10:51:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:51 smithi096 ceph-mon[124666]: pgmap v13736: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 179 KiB/s wr, 7 op/s 2023-05-08T10:51:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:51:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:51:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:51:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:51:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:51:53.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:51:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:51:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:51:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:51:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:51:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:51:53.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:51:53.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:51:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:51:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:51:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:51:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:51:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:51:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:51:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:51:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:51:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:51:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:51:54.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:51:54.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:51:54.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:51:54.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:51:54.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:54 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi186 to 190.8M 2023-05-08T10:51:54.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:54 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi186 to 200132481: error parsing value: Value '200132481' is below minimum 939524096 2023-05-08T10:51:54.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:51:54.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:51:54.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:51:54.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:51:54.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:51:54.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:51:54.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:54 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T10:51:54.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:54 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T10:51:54.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:51:54.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:51:54.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:54 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:51:54.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:51:54.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:54 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T10:51:54.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:54 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T10:51:54.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:54 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:51:54.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25653.152997 secs 2023-05-08T10:51:54.373 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:54 smithi186 ceph-mon[126480]: pgmap v13737: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 89 KiB/s wr, 6 op/s 2023-05-08T10:51:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:51:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:51:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:51:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:51:54.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:51:54.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:51:54.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:51:54.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:51:54.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:51:54.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:54 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi186 to 190.8M 2023-05-08T10:51:54.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:54 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi186 to 200132481: error parsing value: Value '200132481' is below minimum 939524096 2023-05-08T10:51:54.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:51:54.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:51:54.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:51:54.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:51:54.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:51:54.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:51:54.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:54 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T10:51:54.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:54 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T10:51:54.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:51:54.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:51:54.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:54 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:51:54.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:51:54.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:54 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T10:51:54.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:54 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T10:51:54.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:54 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:51:54.494 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25653.152997 secs 2023-05-08T10:51:54.494 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:54 smithi133 ceph-mon[125939]: pgmap v13737: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 89 KiB/s wr, 6 op/s 2023-05-08T10:51:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:51:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:51:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:51:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:51:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:51:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:51:54.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:51:54.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:51:54.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:51:54.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:54 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi186 to 190.8M 2023-05-08T10:51:54.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:54 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi186 to 200132481: error parsing value: Value '200132481' is below minimum 939524096 2023-05-08T10:51:54.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:51:54.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:51:54.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:51:54.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:51:54.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:51:54.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T10:51:54.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:54 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi133 to 196.2M 2023-05-08T10:51:54.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:54 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi133 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-05-08T10:51:54.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:51:54.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:51:54.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:54 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:51:54.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:51:54.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:54 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T10:51:54.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:54 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T10:51:54.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:54 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:51:54.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25653.152997 secs 2023-05-08T10:51:54.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:54 smithi096 ceph-mon[124666]: pgmap v13737: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 89 KiB/s wr, 6 op/s 2023-05-08T10:51:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:55 smithi186 ceph-mon[126480]: pgmap v13738: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 476 KiB/s wr, 12 op/s 2023-05-08T10:51:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:55 smithi133 ceph-mon[125939]: pgmap v13738: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 476 KiB/s wr, 12 op/s 2023-05-08T10:51:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:55 smithi096 ceph-mon[124666]: pgmap v13738: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 476 KiB/s wr, 12 op/s 2023-05-08T10:51:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:51:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:51:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:51:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:57 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:51:58.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:51:58.144 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:51:58.144 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:57 smithi186 ceph-mon[126480]: pgmap v13739: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 475 KiB/s wr, 8 op/s 2023-05-08T10:51:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:57 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:51:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:51:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:51:58.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:57 smithi133 ceph-mon[125939]: pgmap v13739: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 475 KiB/s wr, 8 op/s 2023-05-08T10:51:58.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:57 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:51:58.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:51:58.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:51:58.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:57 smithi096 ceph-mon[124666]: pgmap v13739: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 475 KiB/s wr, 8 op/s 2023-05-08T10:51:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:51:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25658.153109 secs 2023-05-08T10:51:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:51:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25658.153109 secs 2023-05-08T10:51:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:51:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25658.153109 secs 2023-05-08T10:52:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25658.709564 secs 2023-05-08T10:52:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:00 smithi186 ceph-mon[126480]: pgmap v13740: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 843 KiB/s rd, 957 KiB/s wr, 14 op/s 2023-05-08T10:52:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25658.709564 secs 2023-05-08T10:52:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:00 smithi133 ceph-mon[125939]: pgmap v13740: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 843 KiB/s rd, 957 KiB/s wr, 14 op/s 2023-05-08T10:52:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25658.709564 secs 2023-05-08T10:52:00.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:00 smithi096 ceph-mon[124666]: pgmap v13740: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 843 KiB/s rd, 957 KiB/s wr, 14 op/s 2023-05-08T10:52:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25659.996724 secs 2023-05-08T10:52:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:52:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:52:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25659.996724 secs 2023-05-08T10:52:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:52:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:52:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25659.996724 secs 2023-05-08T10:52:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:52:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:52:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:02 smithi133 ceph-mon[125939]: pgmap v13741: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 772 KiB/s rd, 871 KiB/s wr, 12 op/s 2023-05-08T10:52:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:02 smithi096 ceph-mon[124666]: pgmap v13741: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 772 KiB/s rd, 871 KiB/s wr, 12 op/s 2023-05-08T10:52:03.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:02 smithi186 ceph-mon[126480]: pgmap v13741: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 772 KiB/s rd, 871 KiB/s wr, 12 op/s 2023-05-08T10:52:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:03 smithi186 ceph-mon[126480]: pgmap v13742: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 772 KiB/s rd, 871 KiB/s wr, 12 op/s 2023-05-08T10:52:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:03 smithi133 ceph-mon[125939]: pgmap v13742: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 772 KiB/s rd, 871 KiB/s wr, 12 op/s 2023-05-08T10:52:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:03 smithi096 ceph-mon[124666]: pgmap v13742: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 772 KiB/s rd, 871 KiB/s wr, 12 op/s 2023-05-08T10:52:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25663.153224 secs 2023-05-08T10:52:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:04 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:52:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25663.153224 secs 2023-05-08T10:52:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:04 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:52:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25663.153224 secs 2023-05-08T10:52:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:04 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:52:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:52:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:52:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25664.996813 secs 2023-05-08T10:52:06.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:05 smithi186 ceph-mon[126480]: pgmap v13743: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1018 KiB/s rd, 1020 KiB/s wr, 18 op/s 2023-05-08T10:52:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:52:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:52:06.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25664.996813 secs 2023-05-08T10:52:06.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:05 smithi133 ceph-mon[125939]: pgmap v13743: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1018 KiB/s rd, 1020 KiB/s wr, 18 op/s 2023-05-08T10:52:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:52:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:52:06.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25664.996813 secs 2023-05-08T10:52:06.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:05 smithi096 ceph-mon[124666]: pgmap v13743: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1018 KiB/s rd, 1020 KiB/s wr, 18 op/s 2023-05-08T10:52:08.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:07 smithi186 ceph-mon[126480]: pgmap v13744: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 646 KiB/s rd, 633 KiB/s wr, 13 op/s 2023-05-08T10:52:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:07 smithi133 ceph-mon[125939]: pgmap v13744: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 646 KiB/s rd, 633 KiB/s wr, 13 op/s 2023-05-08T10:52:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:07 smithi096 ceph-mon[124666]: pgmap v13744: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 646 KiB/s rd, 633 KiB/s wr, 13 op/s 2023-05-08T10:52:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:08 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:52:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:08 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:52:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:08 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:52:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25668.153358 secs 2023-05-08T10:52:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:52:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:52:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25668.709834 secs 2023-05-08T10:52:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:09 smithi186 ceph-mon[126480]: pgmap v13745: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 777 KiB/s rd, 923 KiB/s wr, 30 op/s 2023-05-08T10:52:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25668.153358 secs 2023-05-08T10:52:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:52:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:52:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25668.709834 secs 2023-05-08T10:52:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:09 smithi133 ceph-mon[125939]: pgmap v13745: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 777 KiB/s rd, 923 KiB/s wr, 30 op/s 2023-05-08T10:52:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25668.153358 secs 2023-05-08T10:52:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:52:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:52:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25668.709834 secs 2023-05-08T10:52:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:09 smithi096 ceph-mon[124666]: pgmap v13745: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 777 KiB/s rd, 923 KiB/s wr, 30 op/s 2023-05-08T10:52:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25669.996907 secs 2023-05-08T10:52:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:11 smithi133 ceph-mon[125939]: osdmap e936: 12 total, 12 up, 12 in 2023-05-08T10:52:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25669.996907 secs 2023-05-08T10:52:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:11 smithi096 ceph-mon[124666]: osdmap e936: 12 total, 12 up, 12 in 2023-05-08T10:52:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25669.996907 secs 2023-05-08T10:52:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:11 smithi186 ceph-mon[126480]: osdmap e936: 12 total, 12 up, 12 in 2023-05-08T10:52:12.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:12 smithi133 ceph-mon[125939]: pgmap v13747: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 527 KiB/s wr, 29 op/s 2023-05-08T10:52:13.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:12 smithi096 ceph-mon[124666]: pgmap v13747: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 527 KiB/s wr, 29 op/s 2023-05-08T10:52:13.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:12 smithi186 ceph-mon[126480]: pgmap v13747: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 527 KiB/s wr, 29 op/s 2023-05-08T10:52:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:13 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:52:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:52:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:13 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:52:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:13 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:52:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:52:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:13 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:52:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:13 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:52:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:52:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:13 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:52:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25673.153478 secs 2023-05-08T10:52:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:14 smithi133 ceph-mon[125939]: pgmap v13748: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 527 KiB/s wr, 29 op/s 2023-05-08T10:52:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25673.709954 secs 2023-05-08T10:52:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25673.153478 secs 2023-05-08T10:52:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:14 smithi096 ceph-mon[124666]: pgmap v13748: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 527 KiB/s wr, 29 op/s 2023-05-08T10:52:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25673.709954 secs 2023-05-08T10:52:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25673.153478 secs 2023-05-08T10:52:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:14 smithi186 ceph-mon[126480]: pgmap v13748: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 527 KiB/s wr, 29 op/s 2023-05-08T10:52:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25673.709954 secs 2023-05-08T10:52:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25674.997041 secs 2023-05-08T10:52:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:15 smithi186 ceph-mon[126480]: pgmap v13749: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 470 KiB/s wr, 27 op/s 2023-05-08T10:52:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25674.997041 secs 2023-05-08T10:52:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:15 smithi133 ceph-mon[125939]: pgmap v13749: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 470 KiB/s wr, 27 op/s 2023-05-08T10:52:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25674.997041 secs 2023-05-08T10:52:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:15 smithi096 ceph-mon[124666]: pgmap v13749: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 470 KiB/s wr, 27 op/s 2023-05-08T10:52:18.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:17 smithi186 ceph-mon[126480]: pgmap v13750: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 470 KiB/s wr, 27 op/s 2023-05-08T10:52:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:17 smithi133 ceph-mon[125939]: pgmap v13750: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 470 KiB/s wr, 27 op/s 2023-05-08T10:52:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:17 smithi096 ceph-mon[124666]: pgmap v13750: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 470 KiB/s wr, 27 op/s 2023-05-08T10:52:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25678.153600 secs 2023-05-08T10:52:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25678.153600 secs 2023-05-08T10:52:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25678.153600 secs 2023-05-08T10:52:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25678.710075 secs 2023-05-08T10:52:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:20 smithi186 ceph-mon[126480]: osdmap e937: 12 total, 12 up, 12 in 2023-05-08T10:52:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:20 smithi186 ceph-mon[126480]: pgmap v13752: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 525 KiB/s rd, 356 KiB/s wr, 10 op/s 2023-05-08T10:52:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25678.710075 secs 2023-05-08T10:52:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:20 smithi133 ceph-mon[125939]: osdmap e937: 12 total, 12 up, 12 in 2023-05-08T10:52:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:20 smithi133 ceph-mon[125939]: pgmap v13752: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 525 KiB/s rd, 356 KiB/s wr, 10 op/s 2023-05-08T10:52:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25678.710075 secs 2023-05-08T10:52:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:20 smithi096 ceph-mon[124666]: osdmap e937: 12 total, 12 up, 12 in 2023-05-08T10:52:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:20 smithi096 ceph-mon[124666]: pgmap v13752: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 525 KiB/s rd, 356 KiB/s wr, 10 op/s 2023-05-08T10:52:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25679.997167 secs 2023-05-08T10:52:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25679.997167 secs 2023-05-08T10:52:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25679.997167 secs 2023-05-08T10:52:22.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:22 smithi133 ceph-mon[125939]: pgmap v13753: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 467 KiB/s rd, 316 KiB/s wr, 9 op/s 2023-05-08T10:52:23.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:22 smithi096 ceph-mon[124666]: pgmap v13753: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 467 KiB/s rd, 316 KiB/s wr, 9 op/s 2023-05-08T10:52:23.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:22 smithi186 ceph-mon[126480]: pgmap v13753: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 467 KiB/s rd, 316 KiB/s wr, 9 op/s 2023-05-08T10:52:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:23 smithi186 ceph-mon[126480]: pgmap v13754: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 467 KiB/s rd, 316 KiB/s wr, 9 op/s 2023-05-08T10:52:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:23 smithi133 ceph-mon[125939]: pgmap v13754: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 467 KiB/s rd, 316 KiB/s wr, 9 op/s 2023-05-08T10:52:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:23 smithi096 ceph-mon[124666]: pgmap v13754: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 467 KiB/s rd, 316 KiB/s wr, 9 op/s 2023-05-08T10:52:25.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25683.153720 secs 2023-05-08T10:52:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25683.710178 secs 2023-05-08T10:52:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25683.153720 secs 2023-05-08T10:52:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25683.710178 secs 2023-05-08T10:52:25.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25683.153720 secs 2023-05-08T10:52:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25683.710178 secs 2023-05-08T10:52:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25684.997302 secs 2023-05-08T10:52:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:25 smithi186 ceph-mon[126480]: pgmap v13755: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 194 KiB/s wr, 6 op/s 2023-05-08T10:52:26.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25684.997302 secs 2023-05-08T10:52:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:25 smithi133 ceph-mon[125939]: pgmap v13755: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 194 KiB/s wr, 6 op/s 2023-05-08T10:52:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25684.997302 secs 2023-05-08T10:52:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:25 smithi096 ceph-mon[124666]: pgmap v13755: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 194 KiB/s wr, 6 op/s 2023-05-08T10:52:28.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:27 smithi186 ceph-mon[126480]: pgmap v13756: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 194 KiB/s wr, 6 op/s 2023-05-08T10:52:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:27 smithi133 ceph-mon[125939]: pgmap v13756: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 194 KiB/s wr, 6 op/s 2023-05-08T10:52:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:27 smithi096 ceph-mon[124666]: pgmap v13756: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 194 KiB/s wr, 6 op/s 2023-05-08T10:52:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25688.153837 secs 2023-05-08T10:52:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25688.153837 secs 2023-05-08T10:52:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25688.153837 secs 2023-05-08T10:52:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25688.710317 secs 2023-05-08T10:52:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:30 smithi186 ceph-mon[126480]: pgmap v13757: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T10:52:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25688.710317 secs 2023-05-08T10:52:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:30 smithi133 ceph-mon[125939]: pgmap v13757: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T10:52:30.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25688.710317 secs 2023-05-08T10:52:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:30 smithi096 ceph-mon[124666]: pgmap v13757: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T10:52:31.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25689.997447 secs 2023-05-08T10:52:32.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25689.997447 secs 2023-05-08T10:52:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25689.997447 secs 2023-05-08T10:52:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:32 smithi133 ceph-mon[125939]: pgmap v13758: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:52:33.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:32 smithi096 ceph-mon[124666]: pgmap v13758: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:52:33.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:32 smithi186 ceph-mon[126480]: pgmap v13758: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:52:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:33 smithi186 ceph-mon[126480]: pgmap v13759: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:52:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:33 smithi133 ceph-mon[125939]: pgmap v13759: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:52:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:33 smithi096 ceph-mon[124666]: pgmap v13759: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:52:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25693.153977 secs 2023-05-08T10:52:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25693.710440 secs 2023-05-08T10:52:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25693.153977 secs 2023-05-08T10:52:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25693.710440 secs 2023-05-08T10:52:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25693.153977 secs 2023-05-08T10:52:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25693.710440 secs 2023-05-08T10:52:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25694.997562 secs 2023-05-08T10:52:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:35 smithi186 ceph-mon[126480]: pgmap v13760: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T10:52:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25694.997562 secs 2023-05-08T10:52:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:35 smithi133 ceph-mon[125939]: pgmap v13760: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T10:52:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25694.997562 secs 2023-05-08T10:52:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:35 smithi096 ceph-mon[124666]: pgmap v13760: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T10:52:38.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:37 smithi186 ceph-mon[126480]: pgmap v13761: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T10:52:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:37 smithi133 ceph-mon[125939]: pgmap v13761: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T10:52:38.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:37 smithi096 ceph-mon[124666]: pgmap v13761: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T10:52:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25698.154114 secs 2023-05-08T10:52:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25698.154114 secs 2023-05-08T10:52:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25698.154114 secs 2023-05-08T10:52:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25698.710563 secs 2023-05-08T10:52:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:40 smithi186 ceph-mon[126480]: pgmap v13762: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 91 KiB/s wr, 8 op/s 2023-05-08T10:52:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25698.710563 secs 2023-05-08T10:52:40.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:40 smithi133 ceph-mon[125939]: pgmap v13762: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 91 KiB/s wr, 8 op/s 2023-05-08T10:52:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25698.710563 secs 2023-05-08T10:52:40.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:40 smithi096 ceph-mon[124666]: pgmap v13762: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 91 KiB/s wr, 8 op/s 2023-05-08T10:52:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25699.997704 secs 2023-05-08T10:52:42.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25699.997704 secs 2023-05-08T10:52:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25699.997704 secs 2023-05-08T10:52:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:42 smithi133 ceph-mon[125939]: pgmap v13763: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 91 KiB/s wr, 6 op/s 2023-05-08T10:52:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:42 smithi096 ceph-mon[124666]: pgmap v13763: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 91 KiB/s wr, 6 op/s 2023-05-08T10:52:43.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:42 smithi186 ceph-mon[126480]: pgmap v13763: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 91 KiB/s wr, 6 op/s 2023-05-08T10:52:44.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:43 smithi186 ceph-mon[126480]: pgmap v13764: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 91 KiB/s wr, 6 op/s 2023-05-08T10:52:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:43 smithi133 ceph-mon[125939]: pgmap v13764: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 91 KiB/s wr, 6 op/s 2023-05-08T10:52:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:43 smithi096 ceph-mon[124666]: pgmap v13764: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 91 KiB/s wr, 6 op/s 2023-05-08T10:52:45.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25703.154231 secs 2023-05-08T10:52:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25703.710655 secs 2023-05-08T10:52:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25703.154231 secs 2023-05-08T10:52:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25703.710655 secs 2023-05-08T10:52:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25703.154231 secs 2023-05-08T10:52:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25703.710655 secs 2023-05-08T10:52:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:45 smithi186 ceph-mon[126480]: pgmap v13765: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 176 KiB/s wr, 10 op/s 2023-05-08T10:52:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:45 smithi133 ceph-mon[125939]: pgmap v13765: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 176 KiB/s wr, 10 op/s 2023-05-08T10:52:46.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:45 smithi096 ceph-mon[124666]: pgmap v13765: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 176 KiB/s wr, 10 op/s 2023-05-08T10:52:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:47 smithi186 ceph-mon[126480]: pgmap v13766: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 176 KiB/s wr, 6 op/s 2023-05-08T10:52:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:47 smithi133 ceph-mon[125939]: pgmap v13766: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 176 KiB/s wr, 6 op/s 2023-05-08T10:52:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:47 smithi096 ceph-mon[124666]: pgmap v13766: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 176 KiB/s wr, 6 op/s 2023-05-08T10:52:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:52:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:52:49.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:52:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25708.154360 secs 2023-05-08T10:52:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:52:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:52:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:52:50.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25708.710768 secs 2023-05-08T10:52:50.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:49 smithi186 ceph-mon[126480]: pgmap v13767: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 180 KiB/s wr, 9 op/s 2023-05-08T10:52:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25708.154360 secs 2023-05-08T10:52:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:52:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:52:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:52:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25708.710768 secs 2023-05-08T10:52:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:49 smithi133 ceph-mon[125939]: pgmap v13767: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 180 KiB/s wr, 9 op/s 2023-05-08T10:52:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25708.154360 secs 2023-05-08T10:52:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:52:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:52:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:52:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25708.710768 secs 2023-05-08T10:52:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:49 smithi096 ceph-mon[124666]: pgmap v13767: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 180 KiB/s wr, 9 op/s 2023-05-08T10:52:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:51 smithi186 ceph-mon[126480]: pgmap v13768: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 520 KiB/s rd, 89 KiB/s wr, 7 op/s 2023-05-08T10:52:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:51 smithi133 ceph-mon[125939]: pgmap v13768: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 520 KiB/s rd, 89 KiB/s wr, 7 op/s 2023-05-08T10:52:52.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:51 smithi096 ceph-mon[124666]: pgmap v13768: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 520 KiB/s rd, 89 KiB/s wr, 7 op/s 2023-05-08T10:52:53.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:53 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:52:53.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:53 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:52:53.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:53 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:52:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25713.154452 secs 2023-05-08T10:52:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:54 smithi186 ceph-mon[126480]: pgmap v13769: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 520 KiB/s rd, 89 KiB/s wr, 7 op/s 2023-05-08T10:52:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:52:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:52:54.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:52:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25713.154452 secs 2023-05-08T10:52:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:54 smithi133 ceph-mon[125939]: pgmap v13769: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 520 KiB/s rd, 89 KiB/s wr, 7 op/s 2023-05-08T10:52:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:52:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:52:54.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:52:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25713.154452 secs 2023-05-08T10:52:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:54 smithi096 ceph-mon[124666]: pgmap v13769: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 520 KiB/s rd, 89 KiB/s wr, 7 op/s 2023-05-08T10:52:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:52:54.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:52:54.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:52:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:55 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:52:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:55 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T10:52:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:55 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T10:52:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:55 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:52:56.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:55 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:52:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:55 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T10:52:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:55 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T10:52:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:55 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:52:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:55 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:52:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:55 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T10:52:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:55 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T10:52:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:55 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:52:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:56 smithi133 ceph-mon[125939]: pgmap v13770: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 803 KiB/s rd, 379 KiB/s wr, 11 op/s 2023-05-08T10:52:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:52:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:56 smithi096 ceph-mon[124666]: pgmap v13770: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 803 KiB/s rd, 379 KiB/s wr, 11 op/s 2023-05-08T10:52:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:52:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:56 smithi186 ceph-mon[126480]: pgmap v13770: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 803 KiB/s rd, 379 KiB/s wr, 11 op/s 2023-05-08T10:52:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:52:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:57 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:52:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:52:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:52:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:57 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:52:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:52:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:52:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:57 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:52:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:52:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:52:58.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:58 smithi133 ceph-mon[125939]: pgmap v13771: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 294 KiB/s wr, 7 op/s 2023-05-08T10:52:59.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:58 smithi096 ceph-mon[124666]: pgmap v13771: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 294 KiB/s wr, 7 op/s 2023-05-08T10:52:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:58 smithi186 ceph-mon[126480]: pgmap v13771: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 294 KiB/s wr, 7 op/s 2023-05-08T10:52:59.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25718.154563 secs 2023-05-08T10:52:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:52:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25718.710982 secs 2023-05-08T10:53:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25718.154563 secs 2023-05-08T10:53:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:52:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25718.710982 secs 2023-05-08T10:53:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25718.154563 secs 2023-05-08T10:53:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:52:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25718.710982 secs 2023-05-08T10:53:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:00 smithi133 ceph-mon[125939]: pgmap v13772: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 735 KiB/s rd, 617 KiB/s wr, 14 op/s 2023-05-08T10:53:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:00 smithi096 ceph-mon[124666]: pgmap v13772: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 735 KiB/s rd, 617 KiB/s wr, 14 op/s 2023-05-08T10:53:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:00 smithi186 ceph-mon[126480]: pgmap v13772: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 735 KiB/s rd, 617 KiB/s wr, 14 op/s 2023-05-08T10:53:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25719.998133 secs 2023-05-08T10:53:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:53:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:53:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25719.998133 secs 2023-05-08T10:53:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:53:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:53:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25719.998133 secs 2023-05-08T10:53:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:53:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:53:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:02 smithi133 ceph-mon[125939]: pgmap v13773: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 568 KiB/s rd, 613 KiB/s wr, 11 op/s 2023-05-08T10:53:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:02 smithi096 ceph-mon[124666]: pgmap v13773: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 568 KiB/s rd, 613 KiB/s wr, 11 op/s 2023-05-08T10:53:03.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:02 smithi186 ceph-mon[126480]: pgmap v13773: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 568 KiB/s rd, 613 KiB/s wr, 11 op/s 2023-05-08T10:53:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25723.154680 secs 2023-05-08T10:53:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:04 smithi133 ceph-mon[125939]: pgmap v13774: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 568 KiB/s rd, 613 KiB/s wr, 11 op/s 2023-05-08T10:53:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:04 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:53:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25723.154680 secs 2023-05-08T10:53:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:04 smithi096 ceph-mon[124666]: pgmap v13774: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 568 KiB/s rd, 613 KiB/s wr, 11 op/s 2023-05-08T10:53:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:04 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:53:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25723.154680 secs 2023-05-08T10:53:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:04 smithi186 ceph-mon[126480]: pgmap v13774: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 568 KiB/s rd, 613 KiB/s wr, 11 op/s 2023-05-08T10:53:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:04 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:53:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:53:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:53:05.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25724.998248 secs 2023-05-08T10:53:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:53:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:53:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25724.998248 secs 2023-05-08T10:53:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:53:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:53:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25724.998248 secs 2023-05-08T10:53:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:06 smithi096 ceph-mon[124666]: pgmap v13775: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 810 KiB/s rd, 749 KiB/s wr, 17 op/s 2023-05-08T10:53:07.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:06 smithi186 ceph-mon[126480]: pgmap v13775: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 810 KiB/s rd, 749 KiB/s wr, 17 op/s 2023-05-08T10:53:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:06 smithi133 ceph-mon[125939]: pgmap v13775: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 810 KiB/s rd, 749 KiB/s wr, 17 op/s 2023-05-08T10:53:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:08 smithi096 ceph-mon[124666]: pgmap v13776: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 527 KiB/s rd, 459 KiB/s wr, 13 op/s 2023-05-08T10:53:09.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:08 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:53:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:08 smithi186 ceph-mon[126480]: pgmap v13776: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 527 KiB/s rd, 459 KiB/s wr, 13 op/s 2023-05-08T10:53:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:08 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:53:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:08 smithi133 ceph-mon[125939]: pgmap v13776: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 527 KiB/s rd, 459 KiB/s wr, 13 op/s 2023-05-08T10:53:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:08 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:53:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25728.154793 secs 2023-05-08T10:53:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:53:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:53:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25728.711200 secs 2023-05-08T10:53:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25728.154793 secs 2023-05-08T10:53:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:53:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:53:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25728.711200 secs 2023-05-08T10:53:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25728.154793 secs 2023-05-08T10:53:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:53:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:53:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25728.711200 secs 2023-05-08T10:53:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:10 smithi096 ceph-mon[124666]: pgmap v13777: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 690 KiB/s rd, 748 KiB/s wr, 31 op/s 2023-05-08T10:53:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25729.998373 secs 2023-05-08T10:53:11.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:10 smithi186 ceph-mon[126480]: pgmap v13777: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 690 KiB/s rd, 748 KiB/s wr, 31 op/s 2023-05-08T10:53:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25729.998373 secs 2023-05-08T10:53:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:10 smithi133 ceph-mon[125939]: pgmap v13777: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 690 KiB/s rd, 748 KiB/s wr, 31 op/s 2023-05-08T10:53:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25729.998373 secs 2023-05-08T10:53:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:11 smithi186 ceph-mon[126480]: osdmap e938: 12 total, 12 up, 12 in 2023-05-08T10:53:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:11 smithi186 ceph-mon[126480]: pgmap v13779: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 486 KiB/s rd, 510 KiB/s wr, 30 op/s 2023-05-08T10:53:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:11 smithi133 ceph-mon[125939]: osdmap e938: 12 total, 12 up, 12 in 2023-05-08T10:53:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:11 smithi133 ceph-mon[125939]: pgmap v13779: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 486 KiB/s rd, 510 KiB/s wr, 30 op/s 2023-05-08T10:53:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:11 smithi096 ceph-mon[124666]: osdmap e938: 12 total, 12 up, 12 in 2023-05-08T10:53:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:11 smithi096 ceph-mon[124666]: pgmap v13779: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 486 KiB/s rd, 510 KiB/s wr, 30 op/s 2023-05-08T10:53:13.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:12 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:53:13.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:12 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:53:13.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:12 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:53:13.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:12 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:53:13.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:12 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:53:13.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:12 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:53:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:12 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:53:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:12 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:53:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:12 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:53:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:13 smithi186 ceph-mon[126480]: pgmap v13780: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 486 KiB/s rd, 510 KiB/s wr, 30 op/s 2023-05-08T10:53:14.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:13 smithi133 ceph-mon[125939]: pgmap v13780: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 486 KiB/s rd, 510 KiB/s wr, 30 op/s 2023-05-08T10:53:14.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:13 smithi096 ceph-mon[124666]: pgmap v13780: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 486 KiB/s rd, 510 KiB/s wr, 30 op/s 2023-05-08T10:53:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25733.154927 secs 2023-05-08T10:53:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25733.711324 secs 2023-05-08T10:53:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25733.154927 secs 2023-05-08T10:53:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25733.711324 secs 2023-05-08T10:53:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25733.154927 secs 2023-05-08T10:53:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25733.711324 secs 2023-05-08T10:53:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25734.998509 secs 2023-05-08T10:53:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:15 smithi186 ceph-mon[126480]: pgmap v13781: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 450 KiB/s rd, 470 KiB/s wr, 27 op/s 2023-05-08T10:53:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25734.998509 secs 2023-05-08T10:53:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:15 smithi133 ceph-mon[125939]: pgmap v13781: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 450 KiB/s rd, 470 KiB/s wr, 27 op/s 2023-05-08T10:53:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25734.998509 secs 2023-05-08T10:53:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:15 smithi096 ceph-mon[124666]: pgmap v13781: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 450 KiB/s rd, 470 KiB/s wr, 27 op/s 2023-05-08T10:53:18.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:17 smithi186 ceph-mon[126480]: pgmap v13782: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 450 KiB/s rd, 470 KiB/s wr, 27 op/s 2023-05-08T10:53:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:17 smithi133 ceph-mon[125939]: pgmap v13782: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 450 KiB/s rd, 470 KiB/s wr, 27 op/s 2023-05-08T10:53:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:17 smithi096 ceph-mon[124666]: pgmap v13782: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 450 KiB/s rd, 470 KiB/s wr, 27 op/s 2023-05-08T10:53:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25738.155054 secs 2023-05-08T10:53:19.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25738.155054 secs 2023-05-08T10:53:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25738.155054 secs 2023-05-08T10:53:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25738.711435 secs 2023-05-08T10:53:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:20 smithi186 ceph-mon[126480]: osdmap e939: 12 total, 12 up, 12 in 2023-05-08T10:53:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:20 smithi186 ceph-mon[126480]: pgmap v13784: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 234 KiB/s wr, 10 op/s 2023-05-08T10:53:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25738.711435 secs 2023-05-08T10:53:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:20 smithi133 ceph-mon[125939]: osdmap e939: 12 total, 12 up, 12 in 2023-05-08T10:53:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:20 smithi133 ceph-mon[125939]: pgmap v13784: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 234 KiB/s wr, 10 op/s 2023-05-08T10:53:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25738.711435 secs 2023-05-08T10:53:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:20 smithi096 ceph-mon[124666]: osdmap e939: 12 total, 12 up, 12 in 2023-05-08T10:53:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:20 smithi096 ceph-mon[124666]: pgmap v13784: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 234 KiB/s wr, 10 op/s 2023-05-08T10:53:21.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25739.998630 secs 2023-05-08T10:53:22.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25739.998630 secs 2023-05-08T10:53:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25739.998630 secs 2023-05-08T10:53:22.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:22 smithi133 ceph-mon[125939]: pgmap v13785: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 209 KiB/s wr, 9 op/s 2023-05-08T10:53:23.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:22 smithi096 ceph-mon[124666]: pgmap v13785: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 209 KiB/s wr, 9 op/s 2023-05-08T10:53:23.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:22 smithi186 ceph-mon[126480]: pgmap v13785: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 209 KiB/s wr, 9 op/s 2023-05-08T10:53:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:23 smithi186 ceph-mon[126480]: pgmap v13786: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 209 KiB/s wr, 9 op/s 2023-05-08T10:53:24.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:23 smithi133 ceph-mon[125939]: pgmap v13786: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 209 KiB/s wr, 9 op/s 2023-05-08T10:53:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:23 smithi096 ceph-mon[124666]: pgmap v13786: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 209 KiB/s wr, 9 op/s 2023-05-08T10:53:25.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25743.155188 secs 2023-05-08T10:53:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25743.711555 secs 2023-05-08T10:53:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25743.155188 secs 2023-05-08T10:53:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25743.711555 secs 2023-05-08T10:53:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25743.155188 secs 2023-05-08T10:53:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25743.711555 secs 2023-05-08T10:53:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25744.998746 secs 2023-05-08T10:53:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:25 smithi186 ceph-mon[126480]: pgmap v13787: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 86 KiB/s wr, 7 op/s 2023-05-08T10:53:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25744.998746 secs 2023-05-08T10:53:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:25 smithi133 ceph-mon[125939]: pgmap v13787: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 86 KiB/s wr, 7 op/s 2023-05-08T10:53:26.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25744.998746 secs 2023-05-08T10:53:26.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:25 smithi096 ceph-mon[124666]: pgmap v13787: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 86 KiB/s wr, 7 op/s 2023-05-08T10:53:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:27 smithi186 ceph-mon[126480]: pgmap v13788: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 86 KiB/s wr, 7 op/s 2023-05-08T10:53:28.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:27 smithi133 ceph-mon[125939]: pgmap v13788: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 86 KiB/s wr, 7 op/s 2023-05-08T10:53:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:27 smithi096 ceph-mon[124666]: pgmap v13788: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 86 KiB/s wr, 7 op/s 2023-05-08T10:53:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25748.155310 secs 2023-05-08T10:53:29.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25748.155310 secs 2023-05-08T10:53:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25748.155310 secs 2023-05-08T10:53:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25748.711674 secs 2023-05-08T10:53:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:30 smithi186 ceph-mon[126480]: pgmap v13789: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2023-05-08T10:53:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25748.711674 secs 2023-05-08T10:53:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:30 smithi133 ceph-mon[125939]: pgmap v13789: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2023-05-08T10:53:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25748.711674 secs 2023-05-08T10:53:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:30 smithi096 ceph-mon[124666]: pgmap v13789: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2023-05-08T10:53:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25749.998867 secs 2023-05-08T10:53:32.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25749.998867 secs 2023-05-08T10:53:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25749.998867 secs 2023-05-08T10:53:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:32 smithi133 ceph-mon[125939]: pgmap v13790: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:53:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:32 smithi096 ceph-mon[124666]: pgmap v13790: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:53:33.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:32 smithi186 ceph-mon[126480]: pgmap v13790: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:53:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:33 smithi186 ceph-mon[126480]: pgmap v13791: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:53:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:33 smithi133 ceph-mon[125939]: pgmap v13791: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:53:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:33 smithi096 ceph-mon[124666]: pgmap v13791: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:53:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25753.155429 secs 2023-05-08T10:53:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25753.711764 secs 2023-05-08T10:53:35.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25753.155429 secs 2023-05-08T10:53:35.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25753.711764 secs 2023-05-08T10:53:35.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25753.155429 secs 2023-05-08T10:53:35.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25753.711764 secs 2023-05-08T10:53:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25754.999018 secs 2023-05-08T10:53:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:35 smithi186 ceph-mon[126480]: pgmap v13792: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 9 op/s 2023-05-08T10:53:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25754.999018 secs 2023-05-08T10:53:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:35 smithi133 ceph-mon[125939]: pgmap v13792: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 9 op/s 2023-05-08T10:53:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25754.999018 secs 2023-05-08T10:53:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:35 smithi096 ceph-mon[124666]: pgmap v13792: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 9 op/s 2023-05-08T10:53:38.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:37 smithi186 ceph-mon[126480]: pgmap v13793: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T10:53:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:37 smithi133 ceph-mon[125939]: pgmap v13793: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T10:53:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:37 smithi096 ceph-mon[124666]: pgmap v13793: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T10:53:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25758.155526 secs 2023-05-08T10:53:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25758.155526 secs 2023-05-08T10:53:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25758.155526 secs 2023-05-08T10:53:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25758.711876 secs 2023-05-08T10:53:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:40 smithi186 ceph-mon[126480]: pgmap v13794: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 268 KiB/s wr, 10 op/s 2023-05-08T10:53:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25758.711876 secs 2023-05-08T10:53:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:40 smithi133 ceph-mon[125939]: pgmap v13794: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 268 KiB/s wr, 10 op/s 2023-05-08T10:53:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25758.711876 secs 2023-05-08T10:53:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:40 smithi096 ceph-mon[124666]: pgmap v13794: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 268 KiB/s wr, 10 op/s 2023-05-08T10:53:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25759.999140 secs 2023-05-08T10:53:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25759.999140 secs 2023-05-08T10:53:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25759.999140 secs 2023-05-08T10:53:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:42 smithi133 ceph-mon[125939]: pgmap v13795: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 268 KiB/s wr, 7 op/s 2023-05-08T10:53:43.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:42 smithi096 ceph-mon[124666]: pgmap v13795: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 268 KiB/s wr, 7 op/s 2023-05-08T10:53:43.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:42 smithi186 ceph-mon[126480]: pgmap v13795: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 268 KiB/s wr, 7 op/s 2023-05-08T10:53:44.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:43 smithi186 ceph-mon[126480]: pgmap v13796: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 268 KiB/s wr, 7 op/s 2023-05-08T10:53:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:43 smithi133 ceph-mon[125939]: pgmap v13796: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 268 KiB/s wr, 7 op/s 2023-05-08T10:53:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:43 smithi096 ceph-mon[124666]: pgmap v13796: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 268 KiB/s wr, 7 op/s 2023-05-08T10:53:45.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25763.155649 secs 2023-05-08T10:53:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25763.711993 secs 2023-05-08T10:53:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25763.155649 secs 2023-05-08T10:53:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25763.711993 secs 2023-05-08T10:53:45.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25763.155649 secs 2023-05-08T10:53:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25763.711993 secs 2023-05-08T10:53:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:45 smithi186 ceph-mon[126480]: pgmap v13797: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 282 KiB/s wr, 10 op/s 2023-05-08T10:53:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:45 smithi133 ceph-mon[125939]: pgmap v13797: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 282 KiB/s wr, 10 op/s 2023-05-08T10:53:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:45 smithi096 ceph-mon[124666]: pgmap v13797: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 282 KiB/s wr, 10 op/s 2023-05-08T10:53:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:47 smithi186 ceph-mon[126480]: pgmap v13798: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 281 KiB/s wr, 7 op/s 2023-05-08T10:53:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:47 smithi133 ceph-mon[125939]: pgmap v13798: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 281 KiB/s wr, 7 op/s 2023-05-08T10:53:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:47 smithi096 ceph-mon[124666]: pgmap v13798: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 281 KiB/s wr, 7 op/s 2023-05-08T10:53:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:53:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:53:49.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:53:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25768.155793 secs 2023-05-08T10:53:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:53:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:53:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:53:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25768.712134 secs 2023-05-08T10:53:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:49 smithi186 ceph-mon[126480]: pgmap v13799: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 357 KiB/s wr, 10 op/s 2023-05-08T10:53:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25768.155793 secs 2023-05-08T10:53:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:53:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:53:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:53:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25768.712134 secs 2023-05-08T10:53:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:49 smithi133 ceph-mon[125939]: pgmap v13799: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 357 KiB/s wr, 10 op/s 2023-05-08T10:53:50.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25768.155793 secs 2023-05-08T10:53:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:53:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:53:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:53:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25768.712134 secs 2023-05-08T10:53:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:49 smithi096 ceph-mon[124666]: pgmap v13799: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 357 KiB/s wr, 10 op/s 2023-05-08T10:53:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:51 smithi186 ceph-mon[126480]: pgmap v13800: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 90 KiB/s wr, 7 op/s 2023-05-08T10:53:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:51 smithi133 ceph-mon[125939]: pgmap v13800: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 90 KiB/s wr, 7 op/s 2023-05-08T10:53:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:51 smithi096 ceph-mon[124666]: pgmap v13800: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 90 KiB/s wr, 7 op/s 2023-05-08T10:53:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:53 smithi186 ceph-mon[126480]: pgmap v13801: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 90 KiB/s wr, 7 op/s 2023-05-08T10:53:54.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:53 smithi133 ceph-mon[125939]: pgmap v13801: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 90 KiB/s wr, 7 op/s 2023-05-08T10:53:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:53 smithi096 ceph-mon[124666]: pgmap v13801: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 90 KiB/s wr, 7 op/s 2023-05-08T10:53:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25773.155915 secs 2023-05-08T10:53:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:53:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:53:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:53:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:54 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:53:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:53:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:54 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T10:53:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:54 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T10:53:55.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:54 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:53:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25773.155915 secs 2023-05-08T10:53:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:53:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:53:55.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:53:55.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:54 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:53:55.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:53:55.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:54 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T10:53:55.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:54 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T10:53:55.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:54 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:53:55.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25773.155915 secs 2023-05-08T10:53:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:53:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:53:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:53:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:54 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:53:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:53:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:54 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T10:53:55.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:54 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T10:53:55.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:54 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:53:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:55 smithi186 ceph-mon[126480]: pgmap v13802: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 463 KiB/s wr, 11 op/s 2023-05-08T10:53:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:55 smithi133 ceph-mon[125939]: pgmap v13802: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 463 KiB/s wr, 11 op/s 2023-05-08T10:53:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:55 smithi096 ceph-mon[124666]: pgmap v13802: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 463 KiB/s wr, 11 op/s 2023-05-08T10:53:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:53:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:53:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:53:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:57 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:53:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:53:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:53:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:57 smithi186 ceph-mon[126480]: pgmap v13803: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 450 KiB/s wr, 8 op/s 2023-05-08T10:53:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:57 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:53:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:53:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:53:58.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:57 smithi133 ceph-mon[125939]: pgmap v13803: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 450 KiB/s wr, 8 op/s 2023-05-08T10:53:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:57 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:53:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:53:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:53:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:57 smithi096 ceph-mon[124666]: pgmap v13803: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 450 KiB/s wr, 8 op/s 2023-05-08T10:53:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:53:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25778.156029 secs 2023-05-08T10:53:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:53:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25778.156029 secs 2023-05-08T10:53:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:53:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25778.156029 secs 2023-05-08T10:54:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25778.712321 secs 2023-05-08T10:54:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:00 smithi186 ceph-mon[126480]: pgmap v13804: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 726 KiB/s rd, 687 KiB/s wr, 14 op/s 2023-05-08T10:54:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25778.712321 secs 2023-05-08T10:54:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:00 smithi133 ceph-mon[125939]: pgmap v13804: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 726 KiB/s rd, 687 KiB/s wr, 14 op/s 2023-05-08T10:54:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25778.712321 secs 2023-05-08T10:54:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:00 smithi096 ceph-mon[124666]: pgmap v13804: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 726 KiB/s rd, 687 KiB/s wr, 14 op/s 2023-05-08T10:54:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:54:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:54:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:54:02.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:54:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:54:02.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:54:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:02 smithi133 ceph-mon[125939]: pgmap v13805: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 623 KiB/s rd, 611 KiB/s wr, 11 op/s 2023-05-08T10:54:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:02 smithi096 ceph-mon[124666]: pgmap v13805: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 623 KiB/s rd, 611 KiB/s wr, 11 op/s 2023-05-08T10:54:03.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:02 smithi186 ceph-mon[126480]: pgmap v13805: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 623 KiB/s rd, 611 KiB/s wr, 11 op/s 2023-05-08T10:54:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:03 smithi186 ceph-mon[126480]: pgmap v13806: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 623 KiB/s rd, 611 KiB/s wr, 11 op/s 2023-05-08T10:54:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:03 smithi133 ceph-mon[125939]: pgmap v13806: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 623 KiB/s rd, 611 KiB/s wr, 11 op/s 2023-05-08T10:54:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:03 smithi096 ceph-mon[124666]: pgmap v13806: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 623 KiB/s rd, 611 KiB/s wr, 11 op/s 2023-05-08T10:54:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25783.156164 secs 2023-05-08T10:54:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:04 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:54:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25783.156164 secs 2023-05-08T10:54:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:04 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:54:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25783.156164 secs 2023-05-08T10:54:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:04 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:54:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:05 smithi186 ceph-mon[126480]: pgmap v13807: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 836 KiB/s rd, 836 KiB/s wr, 17 op/s 2023-05-08T10:54:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:05 smithi133 ceph-mon[125939]: pgmap v13807: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 836 KiB/s rd, 836 KiB/s wr, 17 op/s 2023-05-08T10:54:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:05 smithi096 ceph-mon[124666]: pgmap v13807: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 836 KiB/s rd, 836 KiB/s wr, 17 op/s 2023-05-08T10:54:08.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:07 smithi186 ceph-mon[126480]: pgmap v13808: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 463 KiB/s wr, 13 op/s 2023-05-08T10:54:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:07 smithi133 ceph-mon[125939]: pgmap v13808: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 463 KiB/s wr, 13 op/s 2023-05-08T10:54:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:07 smithi096 ceph-mon[124666]: pgmap v13808: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 463 KiB/s wr, 13 op/s 2023-05-08T10:54:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:08 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:54:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:08 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:54:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:08 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:54:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25788.156276 secs 2023-05-08T10:54:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:54:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:54:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25788.712558 secs 2023-05-08T10:54:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:09 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:54:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:09 smithi186 ceph-mon[126480]: pgmap v13809: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 642 KiB/s rd, 665 KiB/s wr, 31 op/s 2023-05-08T10:54:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25788.156276 secs 2023-05-08T10:54:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:54:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:54:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25788.712558 secs 2023-05-08T10:54:10.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:09 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:54:10.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:09 smithi133 ceph-mon[125939]: pgmap v13809: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 642 KiB/s rd, 665 KiB/s wr, 31 op/s 2023-05-08T10:54:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25788.156276 secs 2023-05-08T10:54:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:54:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:54:10.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25788.712558 secs 2023-05-08T10:54:10.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:09 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:54:10.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:09 smithi096 ceph-mon[124666]: pgmap v13809: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 642 KiB/s rd, 665 KiB/s wr, 31 op/s 2023-05-08T10:54:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25789.999820 secs 2023-05-08T10:54:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:11 smithi133 ceph-mon[125939]: osdmap e940: 12 total, 12 up, 12 in 2023-05-08T10:54:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25789.999820 secs 2023-05-08T10:54:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:11 smithi096 ceph-mon[124666]: osdmap e940: 12 total, 12 up, 12 in 2023-05-08T10:54:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25789.999820 secs 2023-05-08T10:54:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:11 smithi186 ceph-mon[126480]: osdmap e940: 12 total, 12 up, 12 in 2023-05-08T10:54:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:12 smithi133 ceph-mon[125939]: pgmap v13811: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 513 KiB/s wr, 29 op/s 2023-05-08T10:54:13.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:12 smithi096 ceph-mon[124666]: pgmap v13811: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 513 KiB/s wr, 29 op/s 2023-05-08T10:54:13.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:12 smithi186 ceph-mon[126480]: pgmap v13811: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 513 KiB/s wr, 29 op/s 2023-05-08T10:54:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:54:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:54:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:13 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:54:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:54:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:54:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:13 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:54:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:54:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:54:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:13 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:54:14.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25793.156366 secs 2023-05-08T10:54:14.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:14 smithi133 ceph-mon[125939]: pgmap v13812: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 513 KiB/s wr, 29 op/s 2023-05-08T10:54:14.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25793.712705 secs 2023-05-08T10:54:14.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:14 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:54:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25793.156366 secs 2023-05-08T10:54:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:14 smithi096 ceph-mon[124666]: pgmap v13812: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 513 KiB/s wr, 29 op/s 2023-05-08T10:54:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25793.712705 secs 2023-05-08T10:54:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:14 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:54:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25793.156366 secs 2023-05-08T10:54:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:14 smithi186 ceph-mon[126480]: pgmap v13812: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 513 KiB/s wr, 29 op/s 2023-05-08T10:54:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25793.712705 secs 2023-05-08T10:54:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:14 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:54:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25794.999931 secs 2023-05-08T10:54:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:15 smithi186 ceph-mon[126480]: pgmap v13813: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 340 KiB/s rd, 366 KiB/s wr, 27 op/s 2023-05-08T10:54:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25794.999931 secs 2023-05-08T10:54:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:15 smithi133 ceph-mon[125939]: pgmap v13813: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 340 KiB/s rd, 366 KiB/s wr, 27 op/s 2023-05-08T10:54:16.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25794.999931 secs 2023-05-08T10:54:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:15 smithi096 ceph-mon[124666]: pgmap v13813: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 340 KiB/s rd, 366 KiB/s wr, 27 op/s 2023-05-08T10:54:18.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:17 smithi186 ceph-mon[126480]: pgmap v13814: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 340 KiB/s rd, 366 KiB/s wr, 27 op/s 2023-05-08T10:54:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:17 smithi133 ceph-mon[125939]: pgmap v13814: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 340 KiB/s rd, 366 KiB/s wr, 27 op/s 2023-05-08T10:54:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:17 smithi096 ceph-mon[124666]: pgmap v13814: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 340 KiB/s rd, 366 KiB/s wr, 27 op/s 2023-05-08T10:54:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25798.156485 secs 2023-05-08T10:54:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25798.156485 secs 2023-05-08T10:54:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25798.156485 secs 2023-05-08T10:54:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25798.712829 secs 2023-05-08T10:54:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:20 smithi186 ceph-mon[126480]: osdmap e941: 12 total, 12 up, 12 in 2023-05-08T10:54:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:20 smithi186 ceph-mon[126480]: pgmap v13816: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 357 KiB/s wr, 10 op/s 2023-05-08T10:54:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25798.712829 secs 2023-05-08T10:54:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:20 smithi133 ceph-mon[125939]: osdmap e941: 12 total, 12 up, 12 in 2023-05-08T10:54:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:20 smithi133 ceph-mon[125939]: pgmap v13816: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 357 KiB/s wr, 10 op/s 2023-05-08T10:54:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25798.712829 secs 2023-05-08T10:54:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:20 smithi096 ceph-mon[124666]: osdmap e941: 12 total, 12 up, 12 in 2023-05-08T10:54:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:20 smithi096 ceph-mon[124666]: pgmap v13816: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 357 KiB/s wr, 10 op/s 2023-05-08T10:54:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25800.000011 secs 2023-05-08T10:54:22.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25800.000011 secs 2023-05-08T10:54:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25800.000011 secs 2023-05-08T10:54:22.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:22 smithi133 ceph-mon[125939]: pgmap v13817: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 318 KiB/s wr, 9 op/s 2023-05-08T10:54:23.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:22 smithi096 ceph-mon[124666]: pgmap v13817: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 318 KiB/s wr, 9 op/s 2023-05-08T10:54:23.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:22 smithi186 ceph-mon[126480]: pgmap v13817: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 318 KiB/s wr, 9 op/s 2023-05-08T10:54:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:23 smithi186 ceph-mon[126480]: pgmap v13818: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 318 KiB/s wr, 9 op/s 2023-05-08T10:54:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:23 smithi133 ceph-mon[125939]: pgmap v13818: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 318 KiB/s wr, 9 op/s 2023-05-08T10:54:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:23 smithi096 ceph-mon[124666]: pgmap v13818: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 318 KiB/s wr, 9 op/s 2023-05-08T10:54:25.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25803.156555 secs 2023-05-08T10:54:25.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25803.712920 secs 2023-05-08T10:54:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25803.156555 secs 2023-05-08T10:54:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25803.712920 secs 2023-05-08T10:54:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25803.156555 secs 2023-05-08T10:54:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25803.712920 secs 2023-05-08T10:54:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25805.000093 secs 2023-05-08T10:54:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:25 smithi186 ceph-mon[126480]: pgmap v13819: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 196 KiB/s wr, 6 op/s 2023-05-08T10:54:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25805.000093 secs 2023-05-08T10:54:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:25 smithi133 ceph-mon[125939]: pgmap v13819: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 196 KiB/s wr, 6 op/s 2023-05-08T10:54:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25805.000093 secs 2023-05-08T10:54:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:25 smithi096 ceph-mon[124666]: pgmap v13819: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 196 KiB/s wr, 6 op/s 2023-05-08T10:54:28.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:27 smithi186 ceph-mon[126480]: pgmap v13820: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 196 KiB/s wr, 6 op/s 2023-05-08T10:54:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:27 smithi133 ceph-mon[125939]: pgmap v13820: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 196 KiB/s wr, 6 op/s 2023-05-08T10:54:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:27 smithi096 ceph-mon[124666]: pgmap v13820: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 196 KiB/s wr, 6 op/s 2023-05-08T10:54:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25808.156664 secs 2023-05-08T10:54:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25808.156664 secs 2023-05-08T10:54:29.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25808.156664 secs 2023-05-08T10:54:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25808.713053 secs 2023-05-08T10:54:30.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:30 smithi186 ceph-mon[126480]: pgmap v13821: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T10:54:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25808.713053 secs 2023-05-08T10:54:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:30 smithi133 ceph-mon[125939]: pgmap v13821: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T10:54:30.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25808.713053 secs 2023-05-08T10:54:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:30 smithi096 ceph-mon[124666]: pgmap v13821: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T10:54:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25810.000211 secs 2023-05-08T10:54:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25810.000211 secs 2023-05-08T10:54:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25810.000211 secs 2023-05-08T10:54:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:32 smithi133 ceph-mon[125939]: pgmap v13822: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:54:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:32 smithi096 ceph-mon[124666]: pgmap v13822: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:54:33.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:32 smithi186 ceph-mon[126480]: pgmap v13822: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:54:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:33 smithi186 ceph-mon[126480]: pgmap v13823: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:54:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:33 smithi133 ceph-mon[125939]: pgmap v13823: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:54:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:33 smithi096 ceph-mon[124666]: pgmap v13823: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:54:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25813.156791 secs 2023-05-08T10:54:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25813.713175 secs 2023-05-08T10:54:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25813.156791 secs 2023-05-08T10:54:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25813.713175 secs 2023-05-08T10:54:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25813.156791 secs 2023-05-08T10:54:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25813.713175 secs 2023-05-08T10:54:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25815.000332 secs 2023-05-08T10:54:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:35 smithi186 ceph-mon[126480]: pgmap v13824: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T10:54:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25815.000332 secs 2023-05-08T10:54:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:35 smithi133 ceph-mon[125939]: pgmap v13824: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T10:54:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25815.000332 secs 2023-05-08T10:54:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:35 smithi096 ceph-mon[124666]: pgmap v13824: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T10:54:38.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:37 smithi186 ceph-mon[126480]: pgmap v13825: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T10:54:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:37 smithi133 ceph-mon[125939]: pgmap v13825: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T10:54:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:37 smithi096 ceph-mon[124666]: pgmap v13825: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T10:54:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25818.156909 secs 2023-05-08T10:54:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25818.156909 secs 2023-05-08T10:54:39.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25818.156909 secs 2023-05-08T10:54:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25818.713311 secs 2023-05-08T10:54:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:40 smithi186 ceph-mon[126480]: pgmap v13826: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 92 KiB/s wr, 8 op/s 2023-05-08T10:54:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25818.713311 secs 2023-05-08T10:54:40.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:40 smithi133 ceph-mon[125939]: pgmap v13826: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 92 KiB/s wr, 8 op/s 2023-05-08T10:54:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25818.713311 secs 2023-05-08T10:54:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:40 smithi096 ceph-mon[124666]: pgmap v13826: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 92 KiB/s wr, 8 op/s 2023-05-08T10:54:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25820.000454 secs 2023-05-08T10:54:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25820.000454 secs 2023-05-08T10:54:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25820.000454 secs 2023-05-08T10:54:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:42 smithi133 ceph-mon[125939]: pgmap v13827: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 92 KiB/s wr, 6 op/s 2023-05-08T10:54:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:42 smithi096 ceph-mon[124666]: pgmap v13827: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 92 KiB/s wr, 6 op/s 2023-05-08T10:54:43.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:42 smithi186 ceph-mon[126480]: pgmap v13827: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 92 KiB/s wr, 6 op/s 2023-05-08T10:54:44.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:43 smithi186 ceph-mon[126480]: pgmap v13828: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 92 KiB/s wr, 6 op/s 2023-05-08T10:54:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:43 smithi133 ceph-mon[125939]: pgmap v13828: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 92 KiB/s wr, 6 op/s 2023-05-08T10:54:44.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:43 smithi096 ceph-mon[124666]: pgmap v13828: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 92 KiB/s wr, 6 op/s 2023-05-08T10:54:45.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25823.157001 secs 2023-05-08T10:54:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25823.713410 secs 2023-05-08T10:54:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25823.157001 secs 2023-05-08T10:54:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25823.713410 secs 2023-05-08T10:54:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25823.157001 secs 2023-05-08T10:54:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25823.713410 secs 2023-05-08T10:54:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:45 smithi186 ceph-mon[126480]: pgmap v13829: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 115 KiB/s wr, 10 op/s 2023-05-08T10:54:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:45 smithi133 ceph-mon[125939]: pgmap v13829: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 115 KiB/s wr, 10 op/s 2023-05-08T10:54:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:45 smithi096 ceph-mon[124666]: pgmap v13829: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 115 KiB/s wr, 10 op/s 2023-05-08T10:54:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:47 smithi186 ceph-mon[126480]: pgmap v13830: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 114 KiB/s wr, 7 op/s 2023-05-08T10:54:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:47 smithi133 ceph-mon[125939]: pgmap v13830: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 114 KiB/s wr, 7 op/s 2023-05-08T10:54:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:47 smithi096 ceph-mon[124666]: pgmap v13830: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 114 KiB/s wr, 7 op/s 2023-05-08T10:54:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:54:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:54:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:54:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25828.157134 secs 2023-05-08T10:54:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:54:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:54:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:54:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25828.713540 secs 2023-05-08T10:54:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:49 smithi186 ceph-mon[126480]: pgmap v13831: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 181 KiB/s wr, 10 op/s 2023-05-08T10:54:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25828.157134 secs 2023-05-08T10:54:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:54:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:54:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:54:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25828.713540 secs 2023-05-08T10:54:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:49 smithi133 ceph-mon[125939]: pgmap v13831: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 181 KiB/s wr, 10 op/s 2023-05-08T10:54:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25828.157134 secs 2023-05-08T10:54:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:54:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:54:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:54:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25828.713540 secs 2023-05-08T10:54:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:49 smithi096 ceph-mon[124666]: pgmap v13831: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 181 KiB/s wr, 10 op/s 2023-05-08T10:54:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25830.000694 secs 2023-05-08T10:54:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25830.000694 secs 2023-05-08T10:54:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25830.000694 secs 2023-05-08T10:54:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:52 smithi133 ceph-mon[125939]: pgmap v13832: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 90 KiB/s wr, 7 op/s 2023-05-08T10:54:53.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:52 smithi096 ceph-mon[124666]: pgmap v13832: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 90 KiB/s wr, 7 op/s 2023-05-08T10:54:53.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:52 smithi186 ceph-mon[126480]: pgmap v13832: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 90 KiB/s wr, 7 op/s 2023-05-08T10:54:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:54:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:54:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:54:54.072 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:54:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:54:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:54:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25833.157256 secs 2023-05-08T10:54:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:54 smithi133 ceph-mon[125939]: pgmap v13833: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 90 KiB/s wr, 7 op/s 2023-05-08T10:54:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:54 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:54:55.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25833.157256 secs 2023-05-08T10:54:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:54 smithi096 ceph-mon[124666]: pgmap v13833: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 90 KiB/s wr, 7 op/s 2023-05-08T10:54:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:54 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:54:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25833.157256 secs 2023-05-08T10:54:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:54 smithi186 ceph-mon[126480]: pgmap v13833: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 90 KiB/s wr, 7 op/s 2023-05-08T10:54:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:54 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:54:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:55 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:54:55.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:55 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:54:55.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:55 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:54:55.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:55 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:54:55.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:55 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:54:55.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:55 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:54:55.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:55 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:54:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:55 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:54:56.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:55 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:54:56.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:55 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:54:56.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:55 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:54:56.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:55 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:54:56.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:55 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:54:56.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:55 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:54:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:55 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:54:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:55 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:54:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:55 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:54:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:55 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:54:56.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:55 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:54:56.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:55 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:54:56.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:55 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:54:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25835.000758 secs 2023-05-08T10:54:56.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:56 smithi133 ceph-mon[125939]: pgmap v13834: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 584 KiB/s rd, 381 KiB/s wr, 11 op/s 2023-05-08T10:54:56.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:54:56.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:54:56.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:54:56.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:54:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25835.000758 secs 2023-05-08T10:54:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:56 smithi096 ceph-mon[124666]: pgmap v13834: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 584 KiB/s rd, 381 KiB/s wr, 11 op/s 2023-05-08T10:54:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:54:57.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:54:57.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:54:57.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:54:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25835.000758 secs 2023-05-08T10:54:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:56 smithi186 ceph-mon[126480]: pgmap v13834: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 584 KiB/s rd, 381 KiB/s wr, 11 op/s 2023-05-08T10:54:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:54:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:54:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:54:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:54:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:57 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:54:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:57 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T10:54:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:57 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T10:54:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:57 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:54:57.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:54:57.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:54:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:57 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:54:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:57 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T10:54:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:57 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T10:54:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:57 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:54:58.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:54:58.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:54:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:57 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:54:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:57 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T10:54:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:57 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T10:54:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:57 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:54:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:54:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:54:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:58 smithi133 ceph-mon[125939]: pgmap v13835: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 424 KiB/s rd, 358 KiB/s wr, 8 op/s 2023-05-08T10:54:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:58 smithi096 ceph-mon[124666]: pgmap v13835: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 424 KiB/s rd, 358 KiB/s wr, 8 op/s 2023-05-08T10:54:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:58 smithi186 ceph-mon[126480]: pgmap v13835: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 424 KiB/s rd, 358 KiB/s wr, 8 op/s 2023-05-08T10:55:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25838.157371 secs 2023-05-08T10:55:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25838.713686 secs 2023-05-08T10:55:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:54:59 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:55:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25838.157371 secs 2023-05-08T10:55:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25838.713686 secs 2023-05-08T10:55:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:54:59 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:55:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25838.157371 secs 2023-05-08T10:55:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25838.713686 secs 2023-05-08T10:55:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:54:59 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:55:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:00 smithi096 ceph-mon[124666]: pgmap v13836: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 771 KiB/s rd, 680 KiB/s wr, 13 op/s 2023-05-08T10:55:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25840.000881 secs 2023-05-08T10:55:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:00 smithi186 ceph-mon[126480]: pgmap v13836: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 771 KiB/s rd, 680 KiB/s wr, 13 op/s 2023-05-08T10:55:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25840.000881 secs 2023-05-08T10:55:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:00 smithi133 ceph-mon[125939]: pgmap v13836: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 771 KiB/s rd, 680 KiB/s wr, 13 op/s 2023-05-08T10:55:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25840.000881 secs 2023-05-08T10:55:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:55:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:55:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:55:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:55:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:55:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:55:03.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:02 smithi186 ceph-mon[126480]: pgmap v13837: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 658 KiB/s rd, 613 KiB/s wr, 10 op/s 2023-05-08T10:55:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:02 smithi133 ceph-mon[125939]: pgmap v13837: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 658 KiB/s rd, 613 KiB/s wr, 10 op/s 2023-05-08T10:55:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:02 smithi096 ceph-mon[124666]: pgmap v13837: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 658 KiB/s rd, 613 KiB/s wr, 10 op/s 2023-05-08T10:55:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25843.157485 secs 2023-05-08T10:55:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:04 smithi186 ceph-mon[126480]: pgmap v13838: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 658 KiB/s rd, 613 KiB/s wr, 10 op/s 2023-05-08T10:55:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:04 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:55:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:04 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:55:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25843.157485 secs 2023-05-08T10:55:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:04 smithi133 ceph-mon[125939]: pgmap v13838: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 658 KiB/s rd, 613 KiB/s wr, 10 op/s 2023-05-08T10:55:05.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:04 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:55:05.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:04 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:55:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25843.157485 secs 2023-05-08T10:55:05.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:04 smithi096 ceph-mon[124666]: pgmap v13838: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 658 KiB/s rd, 613 KiB/s wr, 10 op/s 2023-05-08T10:55:05.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:04 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:55:05.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:04 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:55:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:55:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:55:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:55:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:55:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:55:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:55:07.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:06 smithi186 ceph-mon[126480]: pgmap v13839: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 871 KiB/s rd, 839 KiB/s wr, 17 op/s 2023-05-08T10:55:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:06 smithi133 ceph-mon[125939]: pgmap v13839: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 871 KiB/s rd, 839 KiB/s wr, 17 op/s 2023-05-08T10:55:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:06 smithi096 ceph-mon[124666]: pgmap v13839: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 871 KiB/s rd, 839 KiB/s wr, 17 op/s 2023-05-08T10:55:08.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:07 smithi186 ceph-mon[126480]: pgmap v13840: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 548 KiB/s wr, 12 op/s 2023-05-08T10:55:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:07 smithi133 ceph-mon[125939]: pgmap v13840: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 548 KiB/s wr, 12 op/s 2023-05-08T10:55:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:07 smithi096 ceph-mon[124666]: pgmap v13840: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 548 KiB/s wr, 12 op/s 2023-05-08T10:55:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:08 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:55:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:08 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:55:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:08 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:55:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25848.157601 secs 2023-05-08T10:55:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:55:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:55:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25848.713874 secs 2023-05-08T10:55:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:09 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:55:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:09 smithi186 ceph-mon[126480]: pgmap v13841: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 741 KiB/s rd, 750 KiB/s wr, 30 op/s 2023-05-08T10:55:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25848.157601 secs 2023-05-08T10:55:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:55:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:55:10.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25848.713874 secs 2023-05-08T10:55:10.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:09 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:55:10.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:09 smithi133 ceph-mon[125939]: pgmap v13841: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 741 KiB/s rd, 750 KiB/s wr, 30 op/s 2023-05-08T10:55:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25848.157601 secs 2023-05-08T10:55:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:55:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:55:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25848.713874 secs 2023-05-08T10:55:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:09 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:55:10.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:09 smithi096 ceph-mon[124666]: pgmap v13841: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 741 KiB/s rd, 750 KiB/s wr, 30 op/s 2023-05-08T10:55:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25850.001079 secs 2023-05-08T10:55:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:11 smithi133 ceph-mon[125939]: osdmap e942: 12 total, 12 up, 12 in 2023-05-08T10:55:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25850.001079 secs 2023-05-08T10:55:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:11 smithi096 ceph-mon[124666]: osdmap e942: 12 total, 12 up, 12 in 2023-05-08T10:55:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25850.001079 secs 2023-05-08T10:55:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:11 smithi186 ceph-mon[126480]: osdmap e942: 12 total, 12 up, 12 in 2023-05-08T10:55:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:12 smithi133 ceph-mon[125939]: pgmap v13843: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 586 KiB/s wr, 30 op/s 2023-05-08T10:55:13.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:12 smithi096 ceph-mon[124666]: pgmap v13843: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 586 KiB/s wr, 30 op/s 2023-05-08T10:55:13.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:12 smithi186 ceph-mon[126480]: pgmap v13843: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 586 KiB/s wr, 30 op/s 2023-05-08T10:55:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:55:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:55:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:13 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:55:14.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:55:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:55:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:13 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:55:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:55:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:55:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:13 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:55:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25853.157717 secs 2023-05-08T10:55:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:14 smithi133 ceph-mon[125939]: pgmap v13844: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 586 KiB/s wr, 30 op/s 2023-05-08T10:55:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25853.714030 secs 2023-05-08T10:55:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:14 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:55:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25853.157717 secs 2023-05-08T10:55:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:14 smithi096 ceph-mon[124666]: pgmap v13844: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 586 KiB/s wr, 30 op/s 2023-05-08T10:55:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25853.714030 secs 2023-05-08T10:55:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:14 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:55:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25853.157717 secs 2023-05-08T10:55:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:14 smithi186 ceph-mon[126480]: pgmap v13844: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 586 KiB/s wr, 30 op/s 2023-05-08T10:55:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25853.714030 secs 2023-05-08T10:55:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:14 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:55:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25855.001216 secs 2023-05-08T10:55:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25855.001216 secs 2023-05-08T10:55:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25855.001216 secs 2023-05-08T10:55:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:16 smithi096 ceph-mon[124666]: pgmap v13845: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 563 KiB/s wr, 27 op/s 2023-05-08T10:55:17.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:16 smithi186 ceph-mon[126480]: pgmap v13845: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 563 KiB/s wr, 27 op/s 2023-05-08T10:55:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:16 smithi133 ceph-mon[125939]: pgmap v13845: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 563 KiB/s wr, 27 op/s 2023-05-08T10:55:18.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:17 smithi186 ceph-mon[126480]: pgmap v13846: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 563 KiB/s wr, 27 op/s 2023-05-08T10:55:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:17 smithi133 ceph-mon[125939]: pgmap v13846: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 563 KiB/s wr, 27 op/s 2023-05-08T10:55:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:17 smithi096 ceph-mon[124666]: pgmap v13846: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 563 KiB/s wr, 27 op/s 2023-05-08T10:55:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25858.157851 secs 2023-05-08T10:55:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25858.157851 secs 2023-05-08T10:55:19.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25858.157851 secs 2023-05-08T10:55:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25858.714165 secs 2023-05-08T10:55:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:20 smithi186 ceph-mon[126480]: osdmap e943: 12 total, 12 up, 12 in 2023-05-08T10:55:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:20 smithi186 ceph-mon[126480]: pgmap v13848: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 276 KiB/s wr, 10 op/s 2023-05-08T10:55:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25858.714165 secs 2023-05-08T10:55:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:20 smithi133 ceph-mon[125939]: osdmap e943: 12 total, 12 up, 12 in 2023-05-08T10:55:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:20 smithi133 ceph-mon[125939]: pgmap v13848: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 276 KiB/s wr, 10 op/s 2023-05-08T10:55:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25858.714165 secs 2023-05-08T10:55:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:20 smithi096 ceph-mon[124666]: osdmap e943: 12 total, 12 up, 12 in 2023-05-08T10:55:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:20 smithi096 ceph-mon[124666]: pgmap v13848: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 276 KiB/s wr, 10 op/s 2023-05-08T10:55:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25860.001352 secs 2023-05-08T10:55:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25860.001352 secs 2023-05-08T10:55:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25860.001352 secs 2023-05-08T10:55:22.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:22 smithi133 ceph-mon[125939]: pgmap v13849: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 322 KiB/s rd, 248 KiB/s wr, 9 op/s 2023-05-08T10:55:23.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:22 smithi096 ceph-mon[124666]: pgmap v13849: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 322 KiB/s rd, 248 KiB/s wr, 9 op/s 2023-05-08T10:55:23.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:22 smithi186 ceph-mon[126480]: pgmap v13849: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 322 KiB/s rd, 248 KiB/s wr, 9 op/s 2023-05-08T10:55:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:23 smithi186 ceph-mon[126480]: pgmap v13850: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 322 KiB/s rd, 248 KiB/s wr, 9 op/s 2023-05-08T10:55:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:23 smithi133 ceph-mon[125939]: pgmap v13850: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 322 KiB/s rd, 248 KiB/s wr, 9 op/s 2023-05-08T10:55:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:23 smithi096 ceph-mon[124666]: pgmap v13850: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 322 KiB/s rd, 248 KiB/s wr, 9 op/s 2023-05-08T10:55:25.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25863.158001 secs 2023-05-08T10:55:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25863.714302 secs 2023-05-08T10:55:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25863.158001 secs 2023-05-08T10:55:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25863.714302 secs 2023-05-08T10:55:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25863.158001 secs 2023-05-08T10:55:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25863.714302 secs 2023-05-08T10:55:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25865.001475 secs 2023-05-08T10:55:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:25 smithi186 ceph-mon[126480]: pgmap v13851: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T10:55:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25865.001475 secs 2023-05-08T10:55:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:25 smithi133 ceph-mon[125939]: pgmap v13851: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T10:55:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25865.001475 secs 2023-05-08T10:55:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:25 smithi096 ceph-mon[124666]: pgmap v13851: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T10:55:28.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:27 smithi186 ceph-mon[126480]: pgmap v13852: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T10:55:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:27 smithi133 ceph-mon[125939]: pgmap v13852: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T10:55:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:27 smithi096 ceph-mon[124666]: pgmap v13852: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T10:55:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25868.158137 secs 2023-05-08T10:55:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25868.158137 secs 2023-05-08T10:55:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25868.158137 secs 2023-05-08T10:55:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25868.714413 secs 2023-05-08T10:55:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:30 smithi186 ceph-mon[126480]: pgmap v13853: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 6 op/s 2023-05-08T10:55:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25868.714413 secs 2023-05-08T10:55:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:30 smithi133 ceph-mon[125939]: pgmap v13853: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 6 op/s 2023-05-08T10:55:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25868.714413 secs 2023-05-08T10:55:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:30 smithi096 ceph-mon[124666]: pgmap v13853: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 6 op/s 2023-05-08T10:55:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25870.001592 secs 2023-05-08T10:55:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25870.001592 secs 2023-05-08T10:55:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25870.001592 secs 2023-05-08T10:55:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:32 smithi133 ceph-mon[125939]: pgmap v13854: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 5 op/s 2023-05-08T10:55:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:32 smithi096 ceph-mon[124666]: pgmap v13854: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 5 op/s 2023-05-08T10:55:33.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:32 smithi186 ceph-mon[126480]: pgmap v13854: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 5 op/s 2023-05-08T10:55:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:33 smithi186 ceph-mon[126480]: pgmap v13855: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:55:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:33 smithi133 ceph-mon[125939]: pgmap v13855: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:55:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:33 smithi096 ceph-mon[124666]: pgmap v13855: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:55:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25873.158273 secs 2023-05-08T10:55:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25873.714531 secs 2023-05-08T10:55:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25873.158273 secs 2023-05-08T10:55:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25873.714531 secs 2023-05-08T10:55:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25873.158273 secs 2023-05-08T10:55:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25873.714531 secs 2023-05-08T10:55:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25875.001688 secs 2023-05-08T10:55:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:35 smithi186 ceph-mon[126480]: pgmap v13856: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 88 KiB/s wr, 8 op/s 2023-05-08T10:55:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25875.001688 secs 2023-05-08T10:55:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:35 smithi133 ceph-mon[125939]: pgmap v13856: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 88 KiB/s wr, 8 op/s 2023-05-08T10:55:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25875.001688 secs 2023-05-08T10:55:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:35 smithi096 ceph-mon[124666]: pgmap v13856: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 88 KiB/s wr, 8 op/s 2023-05-08T10:55:38.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:37 smithi186 ceph-mon[126480]: pgmap v13857: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 88 KiB/s wr, 5 op/s 2023-05-08T10:55:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:37 smithi133 ceph-mon[125939]: pgmap v13857: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 88 KiB/s wr, 5 op/s 2023-05-08T10:55:38.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:37 smithi096 ceph-mon[124666]: pgmap v13857: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 88 KiB/s wr, 5 op/s 2023-05-08T10:55:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25878.158397 secs 2023-05-08T10:55:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25878.158397 secs 2023-05-08T10:55:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25878.158397 secs 2023-05-08T10:55:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25878.714646 secs 2023-05-08T10:55:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:40 smithi186 ceph-mon[126480]: pgmap v13858: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 148 KiB/s wr, 8 op/s 2023-05-08T10:55:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25878.714646 secs 2023-05-08T10:55:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:40 smithi133 ceph-mon[125939]: pgmap v13858: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 148 KiB/s wr, 8 op/s 2023-05-08T10:55:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25878.714646 secs 2023-05-08T10:55:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:40 smithi096 ceph-mon[124666]: pgmap v13858: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 148 KiB/s wr, 8 op/s 2023-05-08T10:55:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25880.001849 secs 2023-05-08T10:55:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25880.001849 secs 2023-05-08T10:55:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25880.001849 secs 2023-05-08T10:55:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:42 smithi133 ceph-mon[125939]: pgmap v13859: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 179 KiB/s wr, 7 op/s 2023-05-08T10:55:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:42 smithi096 ceph-mon[124666]: pgmap v13859: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 179 KiB/s wr, 7 op/s 2023-05-08T10:55:43.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:42 smithi186 ceph-mon[126480]: pgmap v13859: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 179 KiB/s wr, 7 op/s 2023-05-08T10:55:44.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:43 smithi186 ceph-mon[126480]: pgmap v13860: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 179 KiB/s wr, 6 op/s 2023-05-08T10:55:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:43 smithi133 ceph-mon[125939]: pgmap v13860: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 179 KiB/s wr, 6 op/s 2023-05-08T10:55:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:43 smithi096 ceph-mon[124666]: pgmap v13860: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 179 KiB/s wr, 6 op/s 2023-05-08T10:55:45.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25883.158515 secs 2023-05-08T10:55:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25883.714771 secs 2023-05-08T10:55:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25883.158515 secs 2023-05-08T10:55:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25883.714771 secs 2023-05-08T10:55:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25883.158515 secs 2023-05-08T10:55:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25883.714771 secs 2023-05-08T10:55:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:45 smithi186 ceph-mon[126480]: pgmap v13861: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 180 KiB/s wr, 10 op/s 2023-05-08T10:55:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:45 smithi133 ceph-mon[125939]: pgmap v13861: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 180 KiB/s wr, 10 op/s 2023-05-08T10:55:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:45 smithi096 ceph-mon[124666]: pgmap v13861: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 180 KiB/s wr, 10 op/s 2023-05-08T10:55:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:47 smithi186 ceph-mon[126480]: pgmap v13862: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 92 KiB/s wr, 7 op/s 2023-05-08T10:55:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:47 smithi133 ceph-mon[125939]: pgmap v13862: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 92 KiB/s wr, 7 op/s 2023-05-08T10:55:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:47 smithi096 ceph-mon[124666]: pgmap v13862: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 92 KiB/s wr, 7 op/s 2023-05-08T10:55:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:55:49.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:55:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:55:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25888.158592 secs 2023-05-08T10:55:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:55:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:55:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:55:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25888.714888 secs 2023-05-08T10:55:50.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:49 smithi186 ceph-mon[126480]: pgmap v13863: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 273 KiB/s wr, 10 op/s 2023-05-08T10:55:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25888.158592 secs 2023-05-08T10:55:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:55:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:55:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:55:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25888.714888 secs 2023-05-08T10:55:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:49 smithi133 ceph-mon[125939]: pgmap v13863: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 273 KiB/s wr, 10 op/s 2023-05-08T10:55:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25888.158592 secs 2023-05-08T10:55:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:55:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:55:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:55:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25888.714888 secs 2023-05-08T10:55:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:49 smithi096 ceph-mon[124666]: pgmap v13863: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 273 KiB/s wr, 10 op/s 2023-05-08T10:55:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25890.002110 secs 2023-05-08T10:55:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25890.002110 secs 2023-05-08T10:55:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25890.002110 secs 2023-05-08T10:55:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:52 smithi133 ceph-mon[125939]: pgmap v13864: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 212 KiB/s wr, 7 op/s 2023-05-08T10:55:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:52 smithi096 ceph-mon[124666]: pgmap v13864: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 212 KiB/s wr, 7 op/s 2023-05-08T10:55:53.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:52 smithi186 ceph-mon[126480]: pgmap v13864: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 212 KiB/s wr, 7 op/s 2023-05-08T10:55:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:55:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:55:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:55:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:55:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:55:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:55:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25893.158710 secs 2023-05-08T10:55:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:54 smithi096 ceph-mon[124666]: pgmap v13865: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 181 KiB/s wr, 7 op/s 2023-05-08T10:55:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:54 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:55:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25893.158710 secs 2023-05-08T10:55:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:54 smithi186 ceph-mon[126480]: pgmap v13865: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 181 KiB/s wr, 7 op/s 2023-05-08T10:55:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:54 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:55:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25893.158710 secs 2023-05-08T10:55:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:54 smithi133 ceph-mon[125939]: pgmap v13865: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 181 KiB/s wr, 7 op/s 2023-05-08T10:55:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:54 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:55:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25895.002237 secs 2023-05-08T10:55:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25895.002237 secs 2023-05-08T10:55:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25895.002237 secs 2023-05-08T10:55:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:56 smithi096 ceph-mon[124666]: pgmap v13866: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 530 KiB/s rd, 466 KiB/s wr, 11 op/s 2023-05-08T10:55:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:55:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:55:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:56 smithi186 ceph-mon[126480]: pgmap v13866: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 530 KiB/s rd, 466 KiB/s wr, 11 op/s 2023-05-08T10:55:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:55:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:55:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:56 smithi133 ceph-mon[125939]: pgmap v13866: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 530 KiB/s rd, 466 KiB/s wr, 11 op/s 2023-05-08T10:55:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:55:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:55:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:55:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:55:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:55:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:55:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:57 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:55:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:55:58.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:57 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T10:55:58.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:57 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T10:55:58.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:57 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:55:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:55:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:55:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:55:58.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:55:58.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:57 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:55:58.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:55:58.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:57 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T10:55:58.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:57 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T10:55:58.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:57 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:55:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:55:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:55:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:55:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:55:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:57 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:55:58.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:55:58.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:57 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T10:55:58.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:57 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T10:55:58.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:57 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:55:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:58 smithi186 ceph-mon[126480]: pgmap v13867: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 468 KiB/s rd, 466 KiB/s wr, 7 op/s 2023-05-08T10:55:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:58 smithi133 ceph-mon[125939]: pgmap v13867: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 468 KiB/s rd, 466 KiB/s wr, 7 op/s 2023-05-08T10:55:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:58 smithi096 ceph-mon[124666]: pgmap v13867: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 468 KiB/s rd, 466 KiB/s wr, 7 op/s 2023-05-08T10:56:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25898.158818 secs 2023-05-08T10:56:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25898.715146 secs 2023-05-08T10:56:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:55:59 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:56:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25898.158818 secs 2023-05-08T10:56:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25898.715146 secs 2023-05-08T10:56:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:55:59 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:56:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25898.158818 secs 2023-05-08T10:56:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25898.715146 secs 2023-05-08T10:56:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:55:59 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:56:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:00 smithi186 ceph-mon[126480]: pgmap v13868: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 810 KiB/s rd, 797 KiB/s wr, 13 op/s 2023-05-08T10:56:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25900.002340 secs 2023-05-08T10:56:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:00 smithi133 ceph-mon[125939]: pgmap v13868: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 810 KiB/s rd, 797 KiB/s wr, 13 op/s 2023-05-08T10:56:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25900.002340 secs 2023-05-08T10:56:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:00 smithi096 ceph-mon[124666]: pgmap v13868: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 810 KiB/s rd, 797 KiB/s wr, 13 op/s 2023-05-08T10:56:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25900.002340 secs 2023-05-08T10:56:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:56:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:56:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:56:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:56:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:56:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:56:03.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:02 smithi186 ceph-mon[126480]: pgmap v13869: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 628 KiB/s rd, 616 KiB/s wr, 10 op/s 2023-05-08T10:56:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:02 smithi133 ceph-mon[125939]: pgmap v13869: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 628 KiB/s rd, 616 KiB/s wr, 10 op/s 2023-05-08T10:56:03.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:02 smithi096 ceph-mon[124666]: pgmap v13869: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 628 KiB/s rd, 616 KiB/s wr, 10 op/s 2023-05-08T10:56:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25903.158930 secs 2023-05-08T10:56:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:04 smithi186 ceph-mon[126480]: pgmap v13870: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 628 KiB/s rd, 616 KiB/s wr, 10 op/s 2023-05-08T10:56:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:04 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:56:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:04 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:56:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25903.158930 secs 2023-05-08T10:56:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:04 smithi133 ceph-mon[125939]: pgmap v13870: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 628 KiB/s rd, 616 KiB/s wr, 10 op/s 2023-05-08T10:56:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:04 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:56:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:04 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:56:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25903.158930 secs 2023-05-08T10:56:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:04 smithi096 ceph-mon[124666]: pgmap v13870: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 628 KiB/s rd, 616 KiB/s wr, 10 op/s 2023-05-08T10:56:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:04 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:56:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:04 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:56:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:56:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:56:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:05 smithi186 ceph-mon[126480]: pgmap v13871: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 751 KiB/s rd, 751 KiB/s wr, 16 op/s 2023-05-08T10:56:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:56:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:56:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:05 smithi133 ceph-mon[125939]: pgmap v13871: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 751 KiB/s rd, 751 KiB/s wr, 16 op/s 2023-05-08T10:56:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:56:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:56:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:05 smithi096 ceph-mon[124666]: pgmap v13871: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 751 KiB/s rd, 751 KiB/s wr, 16 op/s 2023-05-08T10:56:08.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:07 smithi186 ceph-mon[126480]: pgmap v13872: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 465 KiB/s rd, 466 KiB/s wr, 12 op/s 2023-05-08T10:56:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:07 smithi133 ceph-mon[125939]: pgmap v13872: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 465 KiB/s rd, 466 KiB/s wr, 12 op/s 2023-05-08T10:56:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:07 smithi096 ceph-mon[124666]: pgmap v13872: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 465 KiB/s rd, 466 KiB/s wr, 12 op/s 2023-05-08T10:56:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:08 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:56:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:08 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:56:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:08 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:56:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25908.159066 secs 2023-05-08T10:56:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:56:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:56:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25908.715403 secs 2023-05-08T10:56:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:09 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:56:10.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:09 smithi186 ceph-mon[126480]: pgmap v13873: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 738 KiB/s rd, 761 KiB/s wr, 30 op/s 2023-05-08T10:56:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25908.159066 secs 2023-05-08T10:56:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:56:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:56:10.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25908.715403 secs 2023-05-08T10:56:10.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:09 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:56:10.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:09 smithi133 ceph-mon[125939]: pgmap v13873: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 738 KiB/s rd, 761 KiB/s wr, 30 op/s 2023-05-08T10:56:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25908.159066 secs 2023-05-08T10:56:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:56:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:56:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25908.715403 secs 2023-05-08T10:56:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:09 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:56:10.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:09 smithi096 ceph-mon[124666]: pgmap v13873: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 738 KiB/s rd, 761 KiB/s wr, 30 op/s 2023-05-08T10:56:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25910.002574 secs 2023-05-08T10:56:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:11 smithi133 ceph-mon[125939]: osdmap e944: 12 total, 12 up, 12 in 2023-05-08T10:56:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25910.002574 secs 2023-05-08T10:56:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:11 smithi096 ceph-mon[124666]: osdmap e944: 12 total, 12 up, 12 in 2023-05-08T10:56:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25910.002574 secs 2023-05-08T10:56:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:11 smithi186 ceph-mon[126480]: osdmap e944: 12 total, 12 up, 12 in 2023-05-08T10:56:13.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:12 smithi096 ceph-mon[124666]: pgmap v13875: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 476 KiB/s rd, 517 KiB/s wr, 29 op/s 2023-05-08T10:56:13.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:12 smithi186 ceph-mon[126480]: pgmap v13875: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 476 KiB/s rd, 517 KiB/s wr, 29 op/s 2023-05-08T10:56:13.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:12 smithi133 ceph-mon[125939]: pgmap v13875: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 476 KiB/s rd, 517 KiB/s wr, 29 op/s 2023-05-08T10:56:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:56:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:56:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:13 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:56:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:56:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:56:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:13 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:56:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:56:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:56:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:13 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:56:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25913.159140 secs 2023-05-08T10:56:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:14 smithi096 ceph-mon[124666]: pgmap v13876: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 476 KiB/s rd, 517 KiB/s wr, 29 op/s 2023-05-08T10:56:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25913.715516 secs 2023-05-08T10:56:15.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:14 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:56:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25913.159140 secs 2023-05-08T10:56:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:14 smithi186 ceph-mon[126480]: pgmap v13876: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 476 KiB/s rd, 517 KiB/s wr, 29 op/s 2023-05-08T10:56:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25913.715516 secs 2023-05-08T10:56:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:14 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:56:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25913.159140 secs 2023-05-08T10:56:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:14 smithi133 ceph-mon[125939]: pgmap v13876: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 476 KiB/s rd, 517 KiB/s wr, 29 op/s 2023-05-08T10:56:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25913.715516 secs 2023-05-08T10:56:15.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:14 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:56:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25915.002688 secs 2023-05-08T10:56:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25915.002688 secs 2023-05-08T10:56:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25915.002688 secs 2023-05-08T10:56:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:16 smithi096 ceph-mon[124666]: pgmap v13877: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 452 KiB/s rd, 478 KiB/s wr, 26 op/s 2023-05-08T10:56:17.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:16 smithi186 ceph-mon[126480]: pgmap v13877: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 452 KiB/s rd, 478 KiB/s wr, 26 op/s 2023-05-08T10:56:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:16 smithi133 ceph-mon[125939]: pgmap v13877: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 452 KiB/s rd, 478 KiB/s wr, 26 op/s 2023-05-08T10:56:18.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:17 smithi186 ceph-mon[126480]: pgmap v13878: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 452 KiB/s rd, 478 KiB/s wr, 26 op/s 2023-05-08T10:56:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:17 smithi133 ceph-mon[125939]: pgmap v13878: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 452 KiB/s rd, 478 KiB/s wr, 26 op/s 2023-05-08T10:56:18.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:17 smithi096 ceph-mon[124666]: pgmap v13878: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 452 KiB/s rd, 478 KiB/s wr, 26 op/s 2023-05-08T10:56:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25918.159260 secs 2023-05-08T10:56:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25918.159260 secs 2023-05-08T10:56:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25918.159260 secs 2023-05-08T10:56:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25918.715633 secs 2023-05-08T10:56:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:20 smithi186 ceph-mon[126480]: osdmap e945: 12 total, 12 up, 12 in 2023-05-08T10:56:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:20 smithi186 ceph-mon[126480]: pgmap v13880: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 236 KiB/s wr, 9 op/s 2023-05-08T10:56:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25918.715633 secs 2023-05-08T10:56:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:20 smithi133 ceph-mon[125939]: osdmap e945: 12 total, 12 up, 12 in 2023-05-08T10:56:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:20 smithi133 ceph-mon[125939]: pgmap v13880: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 236 KiB/s wr, 9 op/s 2023-05-08T10:56:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25918.715633 secs 2023-05-08T10:56:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:20 smithi096 ceph-mon[124666]: osdmap e945: 12 total, 12 up, 12 in 2023-05-08T10:56:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:20 smithi096 ceph-mon[124666]: pgmap v13880: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 236 KiB/s wr, 9 op/s 2023-05-08T10:56:22.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25920.002830 secs 2023-05-08T10:56:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25920.002830 secs 2023-05-08T10:56:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25920.002830 secs 2023-05-08T10:56:23.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:22 smithi096 ceph-mon[124666]: pgmap v13881: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 211 KiB/s wr, 8 op/s 2023-05-08T10:56:23.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:22 smithi186 ceph-mon[126480]: pgmap v13881: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 211 KiB/s wr, 8 op/s 2023-05-08T10:56:23.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:22 smithi133 ceph-mon[125939]: pgmap v13881: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 211 KiB/s wr, 8 op/s 2023-05-08T10:56:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:23 smithi186 ceph-mon[126480]: pgmap v13882: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 211 KiB/s wr, 8 op/s 2023-05-08T10:56:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:23 smithi133 ceph-mon[125939]: pgmap v13882: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 211 KiB/s wr, 8 op/s 2023-05-08T10:56:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:23 smithi096 ceph-mon[124666]: pgmap v13882: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 211 KiB/s wr, 8 op/s 2023-05-08T10:56:25.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25923.159378 secs 2023-05-08T10:56:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25923.715729 secs 2023-05-08T10:56:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25923.159378 secs 2023-05-08T10:56:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25923.715729 secs 2023-05-08T10:56:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25923.159378 secs 2023-05-08T10:56:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25923.715729 secs 2023-05-08T10:56:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25925.002896 secs 2023-05-08T10:56:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:25 smithi186 ceph-mon[126480]: pgmap v13883: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 87 KiB/s wr, 6 op/s 2023-05-08T10:56:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25925.002896 secs 2023-05-08T10:56:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:25 smithi133 ceph-mon[125939]: pgmap v13883: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 87 KiB/s wr, 6 op/s 2023-05-08T10:56:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25925.002896 secs 2023-05-08T10:56:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:25 smithi096 ceph-mon[124666]: pgmap v13883: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 87 KiB/s wr, 6 op/s 2023-05-08T10:56:28.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:27 smithi186 ceph-mon[126480]: pgmap v13884: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 87 KiB/s wr, 6 op/s 2023-05-08T10:56:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:27 smithi133 ceph-mon[125939]: pgmap v13884: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 87 KiB/s wr, 6 op/s 2023-05-08T10:56:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:27 smithi096 ceph-mon[124666]: pgmap v13884: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 87 KiB/s wr, 6 op/s 2023-05-08T10:56:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25928.159480 secs 2023-05-08T10:56:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25928.159480 secs 2023-05-08T10:56:29.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25928.159480 secs 2023-05-08T10:56:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25928.715847 secs 2023-05-08T10:56:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:30 smithi186 ceph-mon[126480]: pgmap v13885: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T10:56:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25928.715847 secs 2023-05-08T10:56:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:30 smithi133 ceph-mon[125939]: pgmap v13885: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T10:56:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25928.715847 secs 2023-05-08T10:56:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:30 smithi096 ceph-mon[124666]: pgmap v13885: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T10:56:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25930.003020 secs 2023-05-08T10:56:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25930.003020 secs 2023-05-08T10:56:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25930.003020 secs 2023-05-08T10:56:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:32 smithi096 ceph-mon[124666]: pgmap v13886: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:56:33.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:32 smithi186 ceph-mon[126480]: pgmap v13886: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:56:33.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:32 smithi133 ceph-mon[125939]: pgmap v13886: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:56:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:33 smithi186 ceph-mon[126480]: pgmap v13887: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:56:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:33 smithi133 ceph-mon[125939]: pgmap v13887: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:56:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:33 smithi096 ceph-mon[124666]: pgmap v13887: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:56:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25933.159602 secs 2023-05-08T10:56:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25933.715971 secs 2023-05-08T10:56:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25933.159602 secs 2023-05-08T10:56:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25933.715971 secs 2023-05-08T10:56:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25933.159602 secs 2023-05-08T10:56:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25933.715971 secs 2023-05-08T10:56:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25935.003138 secs 2023-05-08T10:56:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:35 smithi186 ceph-mon[126480]: pgmap v13888: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T10:56:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25935.003138 secs 2023-05-08T10:56:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:35 smithi133 ceph-mon[125939]: pgmap v13888: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T10:56:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25935.003138 secs 2023-05-08T10:56:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:35 smithi096 ceph-mon[124666]: pgmap v13888: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T10:56:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:37 smithi186 ceph-mon[126480]: pgmap v13889: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T10:56:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:37 smithi133 ceph-mon[125939]: pgmap v13889: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T10:56:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:37 smithi096 ceph-mon[124666]: pgmap v13889: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T10:56:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25938.159734 secs 2023-05-08T10:56:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25938.159734 secs 2023-05-08T10:56:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25938.159734 secs 2023-05-08T10:56:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25938.716049 secs 2023-05-08T10:56:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:40 smithi186 ceph-mon[126480]: pgmap v13890: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 8 op/s 2023-05-08T10:56:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25938.716049 secs 2023-05-08T10:56:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:40 smithi133 ceph-mon[125939]: pgmap v13890: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 8 op/s 2023-05-08T10:56:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25938.716049 secs 2023-05-08T10:56:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:40 smithi096 ceph-mon[124666]: pgmap v13890: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 8 op/s 2023-05-08T10:56:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25940.003259 secs 2023-05-08T10:56:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25940.003259 secs 2023-05-08T10:56:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25940.003259 secs 2023-05-08T10:56:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:42 smithi096 ceph-mon[124666]: pgmap v13891: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 92 KiB/s wr, 6 op/s 2023-05-08T10:56:43.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:42 smithi186 ceph-mon[126480]: pgmap v13891: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 92 KiB/s wr, 6 op/s 2023-05-08T10:56:43.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:42 smithi133 ceph-mon[125939]: pgmap v13891: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 92 KiB/s wr, 6 op/s 2023-05-08T10:56:44.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:43 smithi186 ceph-mon[126480]: pgmap v13892: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 92 KiB/s wr, 6 op/s 2023-05-08T10:56:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:43 smithi133 ceph-mon[125939]: pgmap v13892: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 92 KiB/s wr, 6 op/s 2023-05-08T10:56:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:43 smithi096 ceph-mon[124666]: pgmap v13892: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 92 KiB/s wr, 6 op/s 2023-05-08T10:56:45.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25943.159856 secs 2023-05-08T10:56:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25943.716163 secs 2023-05-08T10:56:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25943.159856 secs 2023-05-08T10:56:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25943.716163 secs 2023-05-08T10:56:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25943.159856 secs 2023-05-08T10:56:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25943.716163 secs 2023-05-08T10:56:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:45 smithi186 ceph-mon[126480]: pgmap v13893: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 274 KiB/s wr, 10 op/s 2023-05-08T10:56:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:45 smithi133 ceph-mon[125939]: pgmap v13893: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 274 KiB/s wr, 10 op/s 2023-05-08T10:56:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:45 smithi096 ceph-mon[124666]: pgmap v13893: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 274 KiB/s wr, 10 op/s 2023-05-08T10:56:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:47 smithi186 ceph-mon[126480]: pgmap v13894: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 274 KiB/s wr, 7 op/s 2023-05-08T10:56:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:47 smithi133 ceph-mon[125939]: pgmap v13894: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 274 KiB/s wr, 7 op/s 2023-05-08T10:56:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:47 smithi096 ceph-mon[124666]: pgmap v13894: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 274 KiB/s wr, 7 op/s 2023-05-08T10:56:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:56:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:56:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:56:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25948.159970 secs 2023-05-08T10:56:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:56:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:56:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:56:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25948.716278 secs 2023-05-08T10:56:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:49 smithi186 ceph-mon[126480]: pgmap v13895: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 274 KiB/s wr, 10 op/s 2023-05-08T10:56:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25948.159970 secs 2023-05-08T10:56:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:56:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:56:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:56:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25948.716278 secs 2023-05-08T10:56:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:49 smithi133 ceph-mon[125939]: pgmap v13895: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 274 KiB/s wr, 10 op/s 2023-05-08T10:56:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25948.159970 secs 2023-05-08T10:56:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:56:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:56:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:56:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25948.716278 secs 2023-05-08T10:56:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:49 smithi096 ceph-mon[124666]: pgmap v13895: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 274 KiB/s wr, 10 op/s 2023-05-08T10:56:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:51 smithi186 ceph-mon[126480]: pgmap v13896: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 342 KiB/s wr, 7 op/s 2023-05-08T10:56:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:51 smithi133 ceph-mon[125939]: pgmap v13896: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 342 KiB/s wr, 7 op/s 2023-05-08T10:56:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:51 smithi096 ceph-mon[124666]: pgmap v13896: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 342 KiB/s wr, 7 op/s 2023-05-08T10:56:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:53 smithi186 ceph-mon[126480]: pgmap v13897: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 281 KiB/s wr, 7 op/s 2023-05-08T10:56:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:53 smithi133 ceph-mon[125939]: pgmap v13897: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 281 KiB/s wr, 7 op/s 2023-05-08T10:56:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:53 smithi096 ceph-mon[124666]: pgmap v13897: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 281 KiB/s wr, 7 op/s 2023-05-08T10:56:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25953.160089 secs 2023-05-08T10:56:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25953.716377 secs 2023-05-08T10:56:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25953.160089 secs 2023-05-08T10:56:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25953.716377 secs 2023-05-08T10:56:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25953.160089 secs 2023-05-08T10:56:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25953.716377 secs 2023-05-08T10:56:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25955.003634 secs 2023-05-08T10:56:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:55 smithi186 ceph-mon[126480]: pgmap v13898: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 468 KiB/s wr, 11 op/s 2023-05-08T10:56:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25955.003634 secs 2023-05-08T10:56:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:55 smithi133 ceph-mon[125939]: pgmap v13898: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 468 KiB/s wr, 11 op/s 2023-05-08T10:56:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25955.003634 secs 2023-05-08T10:56:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:55 smithi096 ceph-mon[124666]: pgmap v13898: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 468 KiB/s wr, 11 op/s 2023-05-08T10:56:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:56 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:56:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:56:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:56:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:56:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:56 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:56:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:56:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:56:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:56:57.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:56 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:56:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:56:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:56:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:56:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:56:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:56:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:57 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:56:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:56:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:57 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T10:56:58.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:57 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T10:56:58.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:57 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:56:58.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:57 smithi133 ceph-mon[125939]: pgmap v13899: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 470 KiB/s rd, 287 KiB/s wr, 7 op/s 2023-05-08T10:56:58.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:56:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:56:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:57 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:56:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:56:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:57 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T10:56:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:57 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T10:56:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:57 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:56:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:57 smithi096 ceph-mon[124666]: pgmap v13899: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 470 KiB/s rd, 287 KiB/s wr, 7 op/s 2023-05-08T10:56:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:56:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:56:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:57 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:56:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:56:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:57 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T10:56:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:57 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T10:56:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:57 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:56:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:57 smithi186 ceph-mon[126480]: pgmap v13899: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 470 KiB/s rd, 287 KiB/s wr, 7 op/s 2023-05-08T10:56:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25958.160240 secs 2023-05-08T10:56:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:56:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25958.716498 secs 2023-05-08T10:56:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25958.160240 secs 2023-05-08T10:56:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:56:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25958.716498 secs 2023-05-08T10:57:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25958.160240 secs 2023-05-08T10:57:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:56:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25958.716498 secs 2023-05-08T10:57:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:00 smithi096 ceph-mon[124666]: pgmap v13900: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 671 KiB/s rd, 476 KiB/s wr, 17 op/s 2023-05-08T10:57:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:00 smithi186 ceph-mon[126480]: pgmap v13900: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 671 KiB/s rd, 476 KiB/s wr, 17 op/s 2023-05-08T10:57:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:00 smithi133 ceph-mon[125939]: pgmap v13900: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 671 KiB/s rd, 476 KiB/s wr, 17 op/s 2023-05-08T10:57:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25960.003788 secs 2023-05-08T10:57:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25960.003788 secs 2023-05-08T10:57:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25960.003788 secs 2023-05-08T10:57:03.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:02 smithi186 ceph-mon[126480]: pgmap v13901: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 811 KiB/s rd, 723 KiB/s wr, 15 op/s 2023-05-08T10:57:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:02 smithi133 ceph-mon[125939]: pgmap v13901: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 811 KiB/s rd, 723 KiB/s wr, 15 op/s 2023-05-08T10:57:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:02 smithi096 ceph-mon[124666]: pgmap v13901: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 811 KiB/s rd, 723 KiB/s wr, 15 op/s 2023-05-08T10:57:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:03 smithi186 ceph-mon[126480]: pgmap v13902: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 630 KiB/s rd, 623 KiB/s wr, 14 op/s 2023-05-08T10:57:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:03 smithi133 ceph-mon[125939]: pgmap v13902: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 630 KiB/s rd, 623 KiB/s wr, 14 op/s 2023-05-08T10:57:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:03 smithi096 ceph-mon[124666]: pgmap v13902: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 630 KiB/s rd, 623 KiB/s wr, 14 op/s 2023-05-08T10:57:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25963.160374 secs 2023-05-08T10:57:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:04 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:57:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25963.160374 secs 2023-05-08T10:57:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:04 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:57:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25963.160374 secs 2023-05-08T10:57:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:04 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:57:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:05 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:57:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:57:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:57:06.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:05 smithi186 ceph-mon[126480]: pgmap v13903: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 753 KiB/s rd, 688 KiB/s wr, 21 op/s 2023-05-08T10:57:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:05 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:57:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:57:06.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:57:06.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:05 smithi133 ceph-mon[125939]: pgmap v13903: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 753 KiB/s rd, 688 KiB/s wr, 21 op/s 2023-05-08T10:57:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:05 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:57:06.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:57:06.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:57:06.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:05 smithi096 ceph-mon[124666]: pgmap v13903: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 753 KiB/s rd, 688 KiB/s wr, 21 op/s 2023-05-08T10:57:08.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:07 smithi186 ceph-mon[126480]: pgmap v13904: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 501 KiB/s wr, 17 op/s 2023-05-08T10:57:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:07 smithi133 ceph-mon[125939]: pgmap v13904: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 501 KiB/s wr, 17 op/s 2023-05-08T10:57:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:07 smithi096 ceph-mon[124666]: pgmap v13904: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 501 KiB/s wr, 17 op/s 2023-05-08T10:57:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:08 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:57:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:08 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:57:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:08 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:57:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25968.160485 secs 2023-05-08T10:57:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:57:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:57:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25968.716652 secs 2023-05-08T10:57:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:09 smithi186 ceph-mon[126480]: pgmap v13905: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 646 KiB/s rd, 702 KiB/s wr, 34 op/s 2023-05-08T10:57:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25968.160485 secs 2023-05-08T10:57:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:57:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:57:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25968.716652 secs 2023-05-08T10:57:10.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:09 smithi133 ceph-mon[125939]: pgmap v13905: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 646 KiB/s rd, 702 KiB/s wr, 34 op/s 2023-05-08T10:57:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25968.160485 secs 2023-05-08T10:57:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:57:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:57:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25968.716652 secs 2023-05-08T10:57:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:09 smithi096 ceph-mon[124666]: pgmap v13905: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 646 KiB/s rd, 702 KiB/s wr, 34 op/s 2023-05-08T10:57:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25970.004004 secs 2023-05-08T10:57:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:11 smithi096 ceph-mon[124666]: osdmap e946: 12 total, 12 up, 12 in 2023-05-08T10:57:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25970.004004 secs 2023-05-08T10:57:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:11 smithi186 ceph-mon[126480]: osdmap e946: 12 total, 12 up, 12 in 2023-05-08T10:57:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25970.004004 secs 2023-05-08T10:57:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:11 smithi133 ceph-mon[125939]: osdmap e946: 12 total, 12 up, 12 in 2023-05-08T10:57:13.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:12 smithi186 ceph-mon[126480]: pgmap v13907: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 477 KiB/s rd, 392 KiB/s wr, 29 op/s 2023-05-08T10:57:13.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:12 smithi133 ceph-mon[125939]: pgmap v13907: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 477 KiB/s rd, 392 KiB/s wr, 29 op/s 2023-05-08T10:57:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:12 smithi096 ceph-mon[124666]: pgmap v13907: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 477 KiB/s rd, 392 KiB/s wr, 29 op/s 2023-05-08T10:57:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:13 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:57:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:57:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:57:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:13 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:57:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:13 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:57:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:57:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:57:14.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:13 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:57:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:13 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:57:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:57:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:57:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:13 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:57:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25973.160549 secs 2023-05-08T10:57:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:14 smithi186 ceph-mon[126480]: pgmap v13908: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 477 KiB/s rd, 392 KiB/s wr, 29 op/s 2023-05-08T10:57:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25973.716784 secs 2023-05-08T10:57:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25973.160549 secs 2023-05-08T10:57:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:14 smithi133 ceph-mon[125939]: pgmap v13908: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 477 KiB/s rd, 392 KiB/s wr, 29 op/s 2023-05-08T10:57:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25973.716784 secs 2023-05-08T10:57:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25973.160549 secs 2023-05-08T10:57:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:14 smithi096 ceph-mon[124666]: pgmap v13908: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 477 KiB/s rd, 392 KiB/s wr, 29 op/s 2023-05-08T10:57:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25973.716784 secs 2023-05-08T10:57:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25975.004127 secs 2023-05-08T10:57:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25975.004127 secs 2023-05-08T10:57:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25975.004127 secs 2023-05-08T10:57:17.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:16 smithi186 ceph-mon[126480]: pgmap v13909: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 438 KiB/s wr, 25 op/s 2023-05-08T10:57:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:16 smithi133 ceph-mon[125939]: pgmap v13909: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 438 KiB/s wr, 25 op/s 2023-05-08T10:57:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:16 smithi096 ceph-mon[124666]: pgmap v13909: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 438 KiB/s wr, 25 op/s 2023-05-08T10:57:18.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:17 smithi186 ceph-mon[126480]: pgmap v13910: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 438 KiB/s wr, 25 op/s 2023-05-08T10:57:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:17 smithi133 ceph-mon[125939]: pgmap v13910: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 438 KiB/s wr, 25 op/s 2023-05-08T10:57:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:17 smithi096 ceph-mon[124666]: pgmap v13910: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 438 KiB/s wr, 25 op/s 2023-05-08T10:57:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25978.160669 secs 2023-05-08T10:57:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25978.160669 secs 2023-05-08T10:57:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25978.160669 secs 2023-05-08T10:57:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25978.716903 secs 2023-05-08T10:57:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:20 smithi186 ceph-mon[126480]: osdmap e947: 12 total, 12 up, 12 in 2023-05-08T10:57:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25978.716903 secs 2023-05-08T10:57:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:20 smithi133 ceph-mon[125939]: osdmap e947: 12 total, 12 up, 12 in 2023-05-08T10:57:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25978.716903 secs 2023-05-08T10:57:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:20 smithi096 ceph-mon[124666]: osdmap e947: 12 total, 12 up, 12 in 2023-05-08T10:57:21.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:21 smithi186 ceph-mon[126480]: pgmap v13912: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 236 KiB/s wr, 8 op/s 2023-05-08T10:57:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25980.004230 secs 2023-05-08T10:57:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:21 smithi133 ceph-mon[125939]: pgmap v13912: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 236 KiB/s wr, 8 op/s 2023-05-08T10:57:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25980.004230 secs 2023-05-08T10:57:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:21 smithi096 ceph-mon[124666]: pgmap v13912: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 236 KiB/s wr, 8 op/s 2023-05-08T10:57:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25980.004230 secs 2023-05-08T10:57:23.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:23 smithi186 ceph-mon[126480]: pgmap v13913: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 211 KiB/s wr, 7 op/s 2023-05-08T10:57:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:23 smithi133 ceph-mon[125939]: pgmap v13913: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 211 KiB/s wr, 7 op/s 2023-05-08T10:57:23.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:23 smithi096 ceph-mon[124666]: pgmap v13913: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 211 KiB/s wr, 7 op/s 2023-05-08T10:57:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25983.160790 secs 2023-05-08T10:57:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25983.160790 secs 2023-05-08T10:57:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25983.160790 secs 2023-05-08T10:57:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:25 smithi186 ceph-mon[126480]: pgmap v13914: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 211 KiB/s wr, 7 op/s 2023-05-08T10:57:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25983.717030 secs 2023-05-08T10:57:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:25 smithi133 ceph-mon[125939]: pgmap v13914: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 211 KiB/s wr, 7 op/s 2023-05-08T10:57:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25983.717030 secs 2023-05-08T10:57:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:25 smithi096 ceph-mon[124666]: pgmap v13914: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 211 KiB/s wr, 7 op/s 2023-05-08T10:57:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25983.717030 secs 2023-05-08T10:57:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25985.004351 secs 2023-05-08T10:57:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25985.004351 secs 2023-05-08T10:57:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25985.004351 secs 2023-05-08T10:57:27.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:27 smithi186 ceph-mon[126480]: pgmap v13915: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 87 KiB/s wr, 6 op/s 2023-05-08T10:57:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:27 smithi133 ceph-mon[125939]: pgmap v13915: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 87 KiB/s wr, 6 op/s 2023-05-08T10:57:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:27 smithi096 ceph-mon[124666]: pgmap v13915: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 87 KiB/s wr, 6 op/s 2023-05-08T10:57:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:29 smithi186 ceph-mon[126480]: pgmap v13916: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 87 KiB/s wr, 6 op/s 2023-05-08T10:57:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25988.160929 secs 2023-05-08T10:57:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:29 smithi133 ceph-mon[125939]: pgmap v13916: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 87 KiB/s wr, 6 op/s 2023-05-08T10:57:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25988.160929 secs 2023-05-08T10:57:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:29 smithi096 ceph-mon[124666]: pgmap v13916: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 87 KiB/s wr, 6 op/s 2023-05-08T10:57:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25988.160929 secs 2023-05-08T10:57:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25988.717165 secs 2023-05-08T10:57:30.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25988.717165 secs 2023-05-08T10:57:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25988.717165 secs 2023-05-08T10:57:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:31 smithi186 ceph-mon[126480]: pgmap v13917: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T10:57:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25990.004471 secs 2023-05-08T10:57:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:31 smithi133 ceph-mon[125939]: pgmap v13917: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T10:57:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25990.004471 secs 2023-05-08T10:57:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:31 smithi096 ceph-mon[124666]: pgmap v13917: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T10:57:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25990.004471 secs 2023-05-08T10:57:33.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:33 smithi186 ceph-mon[126480]: pgmap v13918: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:57:33.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:33 smithi133 ceph-mon[125939]: pgmap v13918: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:57:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:33 smithi096 ceph-mon[124666]: pgmap v13918: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:57:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25993.161064 secs 2023-05-08T10:57:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25993.161064 secs 2023-05-08T10:57:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25993.161064 secs 2023-05-08T10:57:35.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:35 smithi186 ceph-mon[126480]: pgmap v13919: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:57:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25993.717304 secs 2023-05-08T10:57:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:35 smithi133 ceph-mon[125939]: pgmap v13919: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:57:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25993.717304 secs 2023-05-08T10:57:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:35 smithi096 ceph-mon[124666]: pgmap v13919: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:57:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25993.717304 secs 2023-05-08T10:57:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25995.004590 secs 2023-05-08T10:57:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25995.004590 secs 2023-05-08T10:57:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25995.004590 secs 2023-05-08T10:57:37.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:37 smithi186 ceph-mon[126480]: pgmap v13920: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 8 op/s 2023-05-08T10:57:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:37 smithi133 ceph-mon[125939]: pgmap v13920: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 8 op/s 2023-05-08T10:57:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:37 smithi096 ceph-mon[124666]: pgmap v13920: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 8 op/s 2023-05-08T10:57:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:39 smithi133 ceph-mon[125939]: pgmap v13921: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 5 op/s 2023-05-08T10:57:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25998.161181 secs 2023-05-08T10:57:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:39 smithi096 ceph-mon[124666]: pgmap v13921: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 5 op/s 2023-05-08T10:57:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25998.161181 secs 2023-05-08T10:57:39.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:39 smithi186 ceph-mon[126480]: pgmap v13921: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 5 op/s 2023-05-08T10:57:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25998.161181 secs 2023-05-08T10:57:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 25998.717377 secs 2023-05-08T10:57:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 25998.717377 secs 2023-05-08T10:57:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 25998.717377 secs 2023-05-08T10:57:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:41 smithi133 ceph-mon[125939]: pgmap v13922: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 272 KiB/s wr, 9 op/s 2023-05-08T10:57:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26000.004728 secs 2023-05-08T10:57:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:41 smithi096 ceph-mon[124666]: pgmap v13922: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 272 KiB/s wr, 9 op/s 2023-05-08T10:57:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26000.004728 secs 2023-05-08T10:57:41.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:41 smithi186 ceph-mon[126480]: pgmap v13922: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 272 KiB/s wr, 9 op/s 2023-05-08T10:57:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26000.004728 secs 2023-05-08T10:57:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:43 smithi133 ceph-mon[125939]: pgmap v13923: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 272 KiB/s wr, 7 op/s 2023-05-08T10:57:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:43 smithi096 ceph-mon[124666]: pgmap v13923: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 272 KiB/s wr, 7 op/s 2023-05-08T10:57:43.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:43 smithi186 ceph-mon[126480]: pgmap v13923: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 272 KiB/s wr, 7 op/s 2023-05-08T10:57:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26003.161263 secs 2023-05-08T10:57:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26003.161263 secs 2023-05-08T10:57:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26003.161263 secs 2023-05-08T10:57:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:45 smithi133 ceph-mon[125939]: pgmap v13924: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 272 KiB/s wr, 7 op/s 2023-05-08T10:57:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26003.717514 secs 2023-05-08T10:57:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:45 smithi096 ceph-mon[124666]: pgmap v13924: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 272 KiB/s wr, 7 op/s 2023-05-08T10:57:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26003.717514 secs 2023-05-08T10:57:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:45 smithi186 ceph-mon[126480]: pgmap v13924: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 272 KiB/s wr, 7 op/s 2023-05-08T10:57:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26003.717514 secs 2023-05-08T10:57:47.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:47 smithi133 ceph-mon[125939]: pgmap v13925: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 352 KiB/s rd, 273 KiB/s wr, 10 op/s 2023-05-08T10:57:47.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:47 smithi096 ceph-mon[124666]: pgmap v13925: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 352 KiB/s rd, 273 KiB/s wr, 10 op/s 2023-05-08T10:57:47.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:47 smithi186 ceph-mon[126480]: pgmap v13925: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 352 KiB/s rd, 273 KiB/s wr, 10 op/s 2023-05-08T10:57:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:57:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:57:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:57:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:49 smithi133 ceph-mon[125939]: pgmap v13926: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 247 KiB/s wr, 7 op/s 2023-05-08T10:57:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:57:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:57:49.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:57:49.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26008.161352 secs 2023-05-08T10:57:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:49 smithi096 ceph-mon[124666]: pgmap v13926: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 247 KiB/s wr, 7 op/s 2023-05-08T10:57:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:57:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:57:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:57:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26008.161352 secs 2023-05-08T10:57:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:49 smithi186 ceph-mon[126480]: pgmap v13926: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 247 KiB/s wr, 7 op/s 2023-05-08T10:57:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:57:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:57:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:57:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26008.161352 secs 2023-05-08T10:57:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26008.717629 secs 2023-05-08T10:57:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26008.717629 secs 2023-05-08T10:57:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26008.717629 secs 2023-05-08T10:57:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:51 smithi186 ceph-mon[126480]: pgmap v13927: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 434 KiB/s rd, 343 KiB/s wr, 10 op/s 2023-05-08T10:57:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:51 smithi133 ceph-mon[125939]: pgmap v13927: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 434 KiB/s rd, 343 KiB/s wr, 10 op/s 2023-05-08T10:57:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:51 smithi096 ceph-mon[124666]: pgmap v13927: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 434 KiB/s rd, 343 KiB/s wr, 10 op/s 2023-05-08T10:57:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:53 smithi186 ceph-mon[126480]: pgmap v13928: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 294 KiB/s rd, 97 KiB/s wr, 6 op/s 2023-05-08T10:57:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:53 smithi133 ceph-mon[125939]: pgmap v13928: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 294 KiB/s rd, 97 KiB/s wr, 6 op/s 2023-05-08T10:57:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:53 smithi096 ceph-mon[124666]: pgmap v13928: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 294 KiB/s rd, 97 KiB/s wr, 6 op/s 2023-05-08T10:57:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26013.161492 secs 2023-05-08T10:57:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26013.161492 secs 2023-05-08T10:57:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26013.161492 secs 2023-05-08T10:57:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:55 smithi186 ceph-mon[126480]: pgmap v13929: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 294 KiB/s rd, 97 KiB/s wr, 6 op/s 2023-05-08T10:57:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:55 smithi133 ceph-mon[125939]: pgmap v13929: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 294 KiB/s rd, 97 KiB/s wr, 6 op/s 2023-05-08T10:57:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:55 smithi096 ceph-mon[124666]: pgmap v13929: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 294 KiB/s rd, 97 KiB/s wr, 6 op/s 2023-05-08T10:57:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:57:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:57:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:57:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:57 smithi186 ceph-mon[126480]: pgmap v13930: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 593 KiB/s rd, 378 KiB/s wr, 11 op/s 2023-05-08T10:57:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:57 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:57:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:57:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:57:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:57:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:57 smithi133 ceph-mon[125939]: pgmap v13930: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 593 KiB/s rd, 378 KiB/s wr, 11 op/s 2023-05-08T10:57:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:57 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:57:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:57:58.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:57:58.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:57:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:57 smithi096 ceph-mon[124666]: pgmap v13930: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 593 KiB/s rd, 378 KiB/s wr, 11 op/s 2023-05-08T10:57:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:57 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:57:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:57:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:57:58.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:57:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:57:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:57:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:57:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:57:59.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:57:59.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:57:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:57:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:57:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:58:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:59 smithi186 ceph-mon[126480]: pgmap v13931: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 408 KiB/s rd, 378 KiB/s wr, 7 op/s 2023-05-08T10:58:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:59 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:58:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:59 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T10:58:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:59 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T10:58:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:59 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:58:00.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26018.161557 secs 2023-05-08T10:58:00.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:57:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26018.717809 secs 2023-05-08T10:58:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:59 smithi133 ceph-mon[125939]: pgmap v13931: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 408 KiB/s rd, 378 KiB/s wr, 7 op/s 2023-05-08T10:58:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:59 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:58:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:59 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T10:58:00.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:59 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T10:58:00.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:59 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:58:00.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26018.161557 secs 2023-05-08T10:58:00.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:57:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26018.717809 secs 2023-05-08T10:58:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:59 smithi096 ceph-mon[124666]: pgmap v13931: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 408 KiB/s rd, 378 KiB/s wr, 7 op/s 2023-05-08T10:58:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:59 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:58:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:59 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T10:58:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:59 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T10:58:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:59 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:58:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26018.161557 secs 2023-05-08T10:58:00.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:57:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26018.717809 secs 2023-05-08T10:58:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26020.005114 secs 2023-05-08T10:58:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26020.005114 secs 2023-05-08T10:58:01.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26020.005114 secs 2023-05-08T10:58:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:01 smithi186 ceph-mon[126480]: pgmap v13932: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 641 KiB/s rd, 711 KiB/s wr, 13 op/s 2023-05-08T10:58:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:58:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:58:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:01 smithi133 ceph-mon[125939]: pgmap v13932: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 641 KiB/s rd, 711 KiB/s wr, 13 op/s 2023-05-08T10:58:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:58:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:58:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:01 smithi096 ceph-mon[124666]: pgmap v13932: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 641 KiB/s rd, 711 KiB/s wr, 13 op/s 2023-05-08T10:58:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:58:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:58:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:03 smithi186 ceph-mon[126480]: pgmap v13933: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 535 KiB/s rd, 709 KiB/s wr, 11 op/s 2023-05-08T10:58:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:03 smithi133 ceph-mon[125939]: pgmap v13933: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 535 KiB/s rd, 709 KiB/s wr, 11 op/s 2023-05-08T10:58:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:03 smithi096 ceph-mon[124666]: pgmap v13933: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 535 KiB/s rd, 709 KiB/s wr, 11 op/s 2023-05-08T10:58:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26023.161674 secs 2023-05-08T10:58:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:04 smithi186 ceph-mon[126480]: pgmap v13934: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 535 KiB/s rd, 709 KiB/s wr, 11 op/s 2023-05-08T10:58:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:04 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:58:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:04 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:58:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26023.161674 secs 2023-05-08T10:58:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:04 smithi133 ceph-mon[125939]: pgmap v13934: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 535 KiB/s rd, 709 KiB/s wr, 11 op/s 2023-05-08T10:58:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:04 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:58:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:04 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:58:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26023.161674 secs 2023-05-08T10:58:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:04 smithi096 ceph-mon[124666]: pgmap v13934: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 535 KiB/s rd, 709 KiB/s wr, 11 op/s 2023-05-08T10:58:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:04 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:58:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:04 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:58:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:58:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:58:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:58:06.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26025.005231 secs 2023-05-08T10:58:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:58:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:58:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:58:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26025.005231 secs 2023-05-08T10:58:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:58:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:58:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:58:06.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26025.005231 secs 2023-05-08T10:58:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:06 smithi186 ceph-mon[126480]: pgmap v13935: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 893 KiB/s rd, 877 KiB/s wr, 18 op/s 2023-05-08T10:58:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:06 smithi133 ceph-mon[125939]: pgmap v13935: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 893 KiB/s rd, 877 KiB/s wr, 18 op/s 2023-05-08T10:58:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:06 smithi096 ceph-mon[124666]: pgmap v13935: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 893 KiB/s rd, 877 KiB/s wr, 18 op/s 2023-05-08T10:58:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:08 smithi186 ceph-mon[126480]: pgmap v13936: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 593 KiB/s rd, 595 KiB/s wr, 14 op/s 2023-05-08T10:58:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:08 smithi133 ceph-mon[125939]: pgmap v13936: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 593 KiB/s rd, 595 KiB/s wr, 14 op/s 2023-05-08T10:58:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:08 smithi096 ceph-mon[124666]: pgmap v13936: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 593 KiB/s rd, 595 KiB/s wr, 14 op/s 2023-05-08T10:58:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26028.161787 secs 2023-05-08T10:58:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26028.718046 secs 2023-05-08T10:58:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26028.161787 secs 2023-05-08T10:58:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26028.718046 secs 2023-05-08T10:58:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26028.161787 secs 2023-05-08T10:58:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26028.718046 secs 2023-05-08T10:58:11.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:10 smithi186 ceph-mon[126480]: pgmap v13937: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 632 KiB/s rd, 656 KiB/s wr, 31 op/s 2023-05-08T10:58:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26030.005358 secs 2023-05-08T10:58:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:10 smithi133 ceph-mon[125939]: pgmap v13937: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 632 KiB/s rd, 656 KiB/s wr, 31 op/s 2023-05-08T10:58:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26030.005358 secs 2023-05-08T10:58:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:10 smithi096 ceph-mon[124666]: pgmap v13937: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 632 KiB/s rd, 656 KiB/s wr, 31 op/s 2023-05-08T10:58:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26030.005358 secs 2023-05-08T10:58:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:11 smithi133 ceph-mon[125939]: osdmap e948: 12 total, 12 up, 12 in 2023-05-08T10:58:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:11 smithi096 ceph-mon[124666]: osdmap e948: 12 total, 12 up, 12 in 2023-05-08T10:58:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:11 smithi186 ceph-mon[126480]: osdmap e948: 12 total, 12 up, 12 in 2023-05-08T10:58:13.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:12 smithi133 ceph-mon[125939]: pgmap v13939: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 733 KiB/s rd, 530 KiB/s wr, 31 op/s 2023-05-08T10:58:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:12 smithi096 ceph-mon[124666]: pgmap v13939: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 733 KiB/s rd, 530 KiB/s wr, 31 op/s 2023-05-08T10:58:13.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:12 smithi186 ceph-mon[126480]: pgmap v13939: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 733 KiB/s rd, 530 KiB/s wr, 31 op/s 2023-05-08T10:58:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:13 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:58:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:58:14.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:13 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:58:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:13 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:58:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:58:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:13 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:58:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:13 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:58:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:58:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:13 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:58:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26033.161904 secs 2023-05-08T10:58:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:14 smithi133 ceph-mon[125939]: pgmap v13940: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 733 KiB/s rd, 530 KiB/s wr, 31 op/s 2023-05-08T10:58:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26033.718178 secs 2023-05-08T10:58:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26033.161904 secs 2023-05-08T10:58:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:14 smithi096 ceph-mon[124666]: pgmap v13940: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 733 KiB/s rd, 530 KiB/s wr, 31 op/s 2023-05-08T10:58:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26033.718178 secs 2023-05-08T10:58:15.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26033.161904 secs 2023-05-08T10:58:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:14 smithi186 ceph-mon[126480]: pgmap v13940: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 733 KiB/s rd, 530 KiB/s wr, 31 op/s 2023-05-08T10:58:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26033.718178 secs 2023-05-08T10:58:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26035.005490 secs 2023-05-08T10:58:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26035.005490 secs 2023-05-08T10:58:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26035.005490 secs 2023-05-08T10:58:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:16 smithi133 ceph-mon[125939]: pgmap v13941: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 330 KiB/s wr, 26 op/s 2023-05-08T10:58:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:16 smithi096 ceph-mon[124666]: pgmap v13941: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 330 KiB/s wr, 26 op/s 2023-05-08T10:58:17.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:16 smithi186 ceph-mon[126480]: pgmap v13941: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 330 KiB/s wr, 26 op/s 2023-05-08T10:58:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:18 smithi133 ceph-mon[125939]: pgmap v13942: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 330 KiB/s wr, 26 op/s 2023-05-08T10:58:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:18 smithi096 ceph-mon[124666]: pgmap v13942: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 330 KiB/s wr, 26 op/s 2023-05-08T10:58:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:18 smithi186 ceph-mon[126480]: pgmap v13942: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 330 KiB/s wr, 26 op/s 2023-05-08T10:58:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26038.162042 secs 2023-05-08T10:58:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26038.718317 secs 2023-05-08T10:58:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:19 smithi133 ceph-mon[125939]: osdmap e949: 12 total, 12 up, 12 in 2023-05-08T10:58:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26038.162042 secs 2023-05-08T10:58:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26038.718317 secs 2023-05-08T10:58:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:19 smithi096 ceph-mon[124666]: osdmap e949: 12 total, 12 up, 12 in 2023-05-08T10:58:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26038.162042 secs 2023-05-08T10:58:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26038.718317 secs 2023-05-08T10:58:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:19 smithi186 ceph-mon[126480]: osdmap e949: 12 total, 12 up, 12 in 2023-05-08T10:58:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:20 smithi133 ceph-mon[125939]: pgmap v13944: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 99 KiB/s wr, 8 op/s 2023-05-08T10:58:21.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26040.005612 secs 2023-05-08T10:58:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:20 smithi096 ceph-mon[124666]: pgmap v13944: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 99 KiB/s wr, 8 op/s 2023-05-08T10:58:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26040.005612 secs 2023-05-08T10:58:21.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:20 smithi186 ceph-mon[126480]: pgmap v13944: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 99 KiB/s wr, 8 op/s 2023-05-08T10:58:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26040.005612 secs 2023-05-08T10:58:23.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:22 smithi133 ceph-mon[125939]: pgmap v13945: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 88 KiB/s wr, 7 op/s 2023-05-08T10:58:23.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:22 smithi096 ceph-mon[124666]: pgmap v13945: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 88 KiB/s wr, 7 op/s 2023-05-08T10:58:23.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:22 smithi186 ceph-mon[126480]: pgmap v13945: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 88 KiB/s wr, 7 op/s 2023-05-08T10:58:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26043.162165 secs 2023-05-08T10:58:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:24 smithi133 ceph-mon[125939]: pgmap v13946: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 88 KiB/s wr, 7 op/s 2023-05-08T10:58:25.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26043.718454 secs 2023-05-08T10:58:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26043.162165 secs 2023-05-08T10:58:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:24 smithi096 ceph-mon[124666]: pgmap v13946: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 88 KiB/s wr, 7 op/s 2023-05-08T10:58:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26043.718454 secs 2023-05-08T10:58:25.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26043.162165 secs 2023-05-08T10:58:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:24 smithi186 ceph-mon[126480]: pgmap v13946: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 88 KiB/s wr, 7 op/s 2023-05-08T10:58:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26043.718454 secs 2023-05-08T10:58:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26045.005726 secs 2023-05-08T10:58:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26045.005726 secs 2023-05-08T10:58:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26045.005726 secs 2023-05-08T10:58:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:26 smithi133 ceph-mon[125939]: pgmap v13947: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 87 KiB/s wr, 7 op/s 2023-05-08T10:58:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:26 smithi096 ceph-mon[124666]: pgmap v13947: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 87 KiB/s wr, 7 op/s 2023-05-08T10:58:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:26 smithi186 ceph-mon[126480]: pgmap v13947: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 87 KiB/s wr, 7 op/s 2023-05-08T10:58:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:28 smithi133 ceph-mon[125939]: pgmap v13948: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 87 KiB/s wr, 7 op/s 2023-05-08T10:58:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:28 smithi096 ceph-mon[124666]: pgmap v13948: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 87 KiB/s wr, 7 op/s 2023-05-08T10:58:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:28 smithi186 ceph-mon[126480]: pgmap v13948: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 87 KiB/s wr, 7 op/s 2023-05-08T10:58:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26048.162287 secs 2023-05-08T10:58:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26048.718542 secs 2023-05-08T10:58:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26048.162287 secs 2023-05-08T10:58:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26048.718542 secs 2023-05-08T10:58:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26048.162287 secs 2023-05-08T10:58:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26048.718542 secs 2023-05-08T10:58:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:30 smithi133 ceph-mon[125939]: pgmap v13949: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2023-05-08T10:58:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26050.005843 secs 2023-05-08T10:58:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:30 smithi096 ceph-mon[124666]: pgmap v13949: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2023-05-08T10:58:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26050.005843 secs 2023-05-08T10:58:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:30 smithi186 ceph-mon[126480]: pgmap v13949: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2023-05-08T10:58:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26050.005843 secs 2023-05-08T10:58:33.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:32 smithi133 ceph-mon[125939]: pgmap v13950: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2023-05-08T10:58:33.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:32 smithi096 ceph-mon[124666]: pgmap v13950: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2023-05-08T10:58:33.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:32 smithi186 ceph-mon[126480]: pgmap v13950: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2023-05-08T10:58:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26053.162410 secs 2023-05-08T10:58:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:34 smithi133 ceph-mon[125939]: pgmap v13951: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:58:35.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26053.718656 secs 2023-05-08T10:58:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26053.162410 secs 2023-05-08T10:58:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:34 smithi096 ceph-mon[124666]: pgmap v13951: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:58:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26053.718656 secs 2023-05-08T10:58:35.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26053.162410 secs 2023-05-08T10:58:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:34 smithi186 ceph-mon[126480]: pgmap v13951: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T10:58:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26053.718656 secs 2023-05-08T10:58:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26055.005963 secs 2023-05-08T10:58:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26055.005963 secs 2023-05-08T10:58:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26055.005963 secs 2023-05-08T10:58:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:36 smithi133 ceph-mon[125939]: pgmap v13952: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 426 B/s wr, 9 op/s 2023-05-08T10:58:37.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:36 smithi096 ceph-mon[124666]: pgmap v13952: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 426 B/s wr, 9 op/s 2023-05-08T10:58:37.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:36 smithi186 ceph-mon[126480]: pgmap v13952: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 426 B/s wr, 9 op/s 2023-05-08T10:58:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:38 smithi133 ceph-mon[125939]: pgmap v13953: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2023-05-08T10:58:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:38 smithi096 ceph-mon[124666]: pgmap v13953: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2023-05-08T10:58:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:38 smithi186 ceph-mon[126480]: pgmap v13953: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2023-05-08T10:58:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26058.162519 secs 2023-05-08T10:58:40.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26058.718767 secs 2023-05-08T10:58:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26058.162519 secs 2023-05-08T10:58:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26058.718767 secs 2023-05-08T10:58:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26058.162519 secs 2023-05-08T10:58:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26058.718767 secs 2023-05-08T10:58:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:40 smithi133 ceph-mon[125939]: pgmap v13954: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 185 KiB/s wr, 9 op/s 2023-05-08T10:58:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26060.006032 secs 2023-05-08T10:58:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:40 smithi096 ceph-mon[124666]: pgmap v13954: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 185 KiB/s wr, 9 op/s 2023-05-08T10:58:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26060.006032 secs 2023-05-08T10:58:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:40 smithi186 ceph-mon[126480]: pgmap v13954: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 185 KiB/s wr, 9 op/s 2023-05-08T10:58:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26060.006032 secs 2023-05-08T10:58:43.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:42 smithi133 ceph-mon[125939]: pgmap v13955: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 185 KiB/s wr, 7 op/s 2023-05-08T10:58:43.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:42 smithi096 ceph-mon[124666]: pgmap v13955: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 185 KiB/s wr, 7 op/s 2023-05-08T10:58:43.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:42 smithi186 ceph-mon[126480]: pgmap v13955: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 185 KiB/s wr, 7 op/s 2023-05-08T10:58:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26063.162655 secs 2023-05-08T10:58:45.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:44 smithi133 ceph-mon[125939]: pgmap v13956: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 185 KiB/s wr, 7 op/s 2023-05-08T10:58:45.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26063.718887 secs 2023-05-08T10:58:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26063.162655 secs 2023-05-08T10:58:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:44 smithi096 ceph-mon[124666]: pgmap v13956: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 185 KiB/s wr, 7 op/s 2023-05-08T10:58:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26063.718887 secs 2023-05-08T10:58:45.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26063.162655 secs 2023-05-08T10:58:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:44 smithi186 ceph-mon[126480]: pgmap v13956: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 185 KiB/s wr, 7 op/s 2023-05-08T10:58:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26063.718887 secs 2023-05-08T10:58:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:46 smithi133 ceph-mon[125939]: pgmap v13957: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 270 KiB/s wr, 11 op/s 2023-05-08T10:58:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:46 smithi096 ceph-mon[124666]: pgmap v13957: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 270 KiB/s wr, 11 op/s 2023-05-08T10:58:47.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:46 smithi186 ceph-mon[126480]: pgmap v13957: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 270 KiB/s wr, 11 op/s 2023-05-08T10:58:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:58:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:58:48.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:58:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:48 smithi133 ceph-mon[125939]: pgmap v13958: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 270 KiB/s wr, 7 op/s 2023-05-08T10:58:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:48 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:58:49.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:58:49.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:58:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:48 smithi096 ceph-mon[124666]: pgmap v13958: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 270 KiB/s wr, 7 op/s 2023-05-08T10:58:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:48 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:58:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:58:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:58:49.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:48 smithi186 ceph-mon[126480]: pgmap v13958: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 270 KiB/s wr, 7 op/s 2023-05-08T10:58:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:48 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:58:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:58:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:58:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26068.162772 secs 2023-05-08T10:58:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26068.719025 secs 2023-05-08T10:58:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26068.162772 secs 2023-05-08T10:58:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26068.719025 secs 2023-05-08T10:58:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26068.162772 secs 2023-05-08T10:58:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26068.719025 secs 2023-05-08T10:58:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:51 smithi186 ceph-mon[126480]: pgmap v13959: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 618 KiB/s rd, 276 KiB/s wr, 11 op/s 2023-05-08T10:58:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:51 smithi133 ceph-mon[125939]: pgmap v13959: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 618 KiB/s rd, 276 KiB/s wr, 11 op/s 2023-05-08T10:58:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:51 smithi096 ceph-mon[124666]: pgmap v13959: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 618 KiB/s rd, 276 KiB/s wr, 11 op/s 2023-05-08T10:58:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:53 smithi186 ceph-mon[126480]: pgmap v13960: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 617 KiB/s rd, 91 KiB/s wr, 7 op/s 2023-05-08T10:58:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:53 smithi133 ceph-mon[125939]: pgmap v13960: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 617 KiB/s rd, 91 KiB/s wr, 7 op/s 2023-05-08T10:58:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:53 smithi096 ceph-mon[124666]: pgmap v13960: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 617 KiB/s rd, 91 KiB/s wr, 7 op/s 2023-05-08T10:58:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26073.162882 secs 2023-05-08T10:58:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26073.162882 secs 2023-05-08T10:58:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26073.162882 secs 2023-05-08T10:58:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:55 smithi186 ceph-mon[126480]: pgmap v13961: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 617 KiB/s rd, 91 KiB/s wr, 7 op/s 2023-05-08T10:58:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26075.006416 secs 2023-05-08T10:58:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:55 smithi133 ceph-mon[125939]: pgmap v13961: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 617 KiB/s rd, 91 KiB/s wr, 7 op/s 2023-05-08T10:58:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26075.006416 secs 2023-05-08T10:58:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:55 smithi096 ceph-mon[124666]: pgmap v13961: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 617 KiB/s rd, 91 KiB/s wr, 7 op/s 2023-05-08T10:58:56.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26075.006416 secs 2023-05-08T10:58:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:58:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:58:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:58:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:57 smithi186 ceph-mon[126480]: pgmap v13962: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 560 KiB/s wr, 11 op/s 2023-05-08T10:58:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:58:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:58:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:58:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:57 smithi133 ceph-mon[125939]: pgmap v13962: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 560 KiB/s wr, 11 op/s 2023-05-08T10:58:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:58:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:58:58.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:58:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:57 smithi096 ceph-mon[124666]: pgmap v13962: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 560 KiB/s wr, 11 op/s 2023-05-08T10:58:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:58:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:58:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:58:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:58 smithi186 ceph-mon[126480]: pgmap v13963: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 646 KiB/s rd, 474 KiB/s wr, 7 op/s 2023-05-08T10:58:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:58:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:58 smithi133 ceph-mon[125939]: pgmap v13963: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 646 KiB/s rd, 474 KiB/s wr, 7 op/s 2023-05-08T10:58:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:58:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:58 smithi096 ceph-mon[124666]: pgmap v13963: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 646 KiB/s rd, 474 KiB/s wr, 7 op/s 2023-05-08T10:58:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T10:59:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26078.163008 secs 2023-05-08T10:59:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26078.719317 secs 2023-05-08T10:59:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:59:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:59:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:59 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:59:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:59:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:59 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T10:59:00.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:59 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T10:59:00.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:58:59 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T10:59:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26078.163008 secs 2023-05-08T10:59:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26078.719317 secs 2023-05-08T10:59:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:59:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:59:00.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:59 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:59:00.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:59:00.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:59 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T10:59:00.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:59 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T10:59:00.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:58:59 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T10:59:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26078.163008 secs 2023-05-08T10:59:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26078.719317 secs 2023-05-08T10:59:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T10:59:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T10:59:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:59 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:59:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T10:59:00.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:59 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T10:59:00.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:59 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T10:59:00.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:58:59 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T10:59:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:00 smithi186 ceph-mon[126480]: pgmap v13964: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 900 KiB/s rd, 717 KiB/s wr, 14 op/s 2023-05-08T10:59:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:00 smithi133 ceph-mon[125939]: pgmap v13964: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 900 KiB/s rd, 717 KiB/s wr, 14 op/s 2023-05-08T10:59:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:00 smithi096 ceph-mon[124666]: pgmap v13964: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 900 KiB/s rd, 717 KiB/s wr, 14 op/s 2023-05-08T10:59:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:01 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:59:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:59:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:59:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:01 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:59:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:59:02.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:59:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:01 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:59:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:59:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:59:03.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:02 smithi186 ceph-mon[126480]: pgmap v13965: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 723 KiB/s rd, 711 KiB/s wr, 10 op/s 2023-05-08T10:59:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:02 smithi133 ceph-mon[125939]: pgmap v13965: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 723 KiB/s rd, 711 KiB/s wr, 10 op/s 2023-05-08T10:59:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:02 smithi096 ceph-mon[124666]: pgmap v13965: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 723 KiB/s rd, 711 KiB/s wr, 10 op/s 2023-05-08T10:59:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26083.163134 secs 2023-05-08T10:59:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:04 smithi186 ceph-mon[126480]: pgmap v13966: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 723 KiB/s rd, 711 KiB/s wr, 10 op/s 2023-05-08T10:59:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:04 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:59:05.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:04 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:59:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26083.163134 secs 2023-05-08T10:59:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:04 smithi133 ceph-mon[125939]: pgmap v13966: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 723 KiB/s rd, 711 KiB/s wr, 10 op/s 2023-05-08T10:59:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:04 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:59:05.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:04 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:59:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26083.163134 secs 2023-05-08T10:59:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:04 smithi096 ceph-mon[124666]: pgmap v13966: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 723 KiB/s rd, 711 KiB/s wr, 10 op/s 2023-05-08T10:59:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:04 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:59:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:04 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:59:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:59:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:59:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:59:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:59:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:59:06.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:59:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:59:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:59:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:59:07.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:06 smithi186 ceph-mon[126480]: pgmap v13967: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 940 KiB/s rd, 940 KiB/s wr, 17 op/s 2023-05-08T10:59:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:06 smithi133 ceph-mon[125939]: pgmap v13967: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 940 KiB/s rd, 940 KiB/s wr, 17 op/s 2023-05-08T10:59:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:06 smithi096 ceph-mon[124666]: pgmap v13967: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 940 KiB/s rd, 940 KiB/s wr, 17 op/s 2023-05-08T10:59:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:08 smithi186 ceph-mon[126480]: pgmap v13968: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 472 KiB/s wr, 13 op/s 2023-05-08T10:59:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:08 smithi133 ceph-mon[125939]: pgmap v13968: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 472 KiB/s wr, 13 op/s 2023-05-08T10:59:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:08 smithi096 ceph-mon[124666]: pgmap v13968: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 472 KiB/s wr, 13 op/s 2023-05-08T10:59:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26088.163247 secs 2023-05-08T10:59:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26088.719504 secs 2023-05-08T10:59:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:09 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:59:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26088.163247 secs 2023-05-08T10:59:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26088.719504 secs 2023-05-08T10:59:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:09 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:59:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26088.163247 secs 2023-05-08T10:59:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26088.719504 secs 2023-05-08T10:59:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:09 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:59:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:10 smithi186 ceph-mon[126480]: pgmap v13969: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 654 KiB/s rd, 677 KiB/s wr, 31 op/s 2023-05-08T10:59:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26090.006766 secs 2023-05-08T10:59:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:10 smithi133 ceph-mon[125939]: pgmap v13969: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 654 KiB/s rd, 677 KiB/s wr, 31 op/s 2023-05-08T10:59:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26090.006766 secs 2023-05-08T10:59:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:10 smithi096 ceph-mon[124666]: pgmap v13969: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 654 KiB/s rd, 677 KiB/s wr, 31 op/s 2023-05-08T10:59:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26090.006766 secs 2023-05-08T10:59:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:11 smithi133 ceph-mon[125939]: osdmap e950: 12 total, 12 up, 12 in 2023-05-08T10:59:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:11 smithi096 ceph-mon[124666]: osdmap e950: 12 total, 12 up, 12 in 2023-05-08T10:59:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:11 smithi186 ceph-mon[126480]: osdmap e950: 12 total, 12 up, 12 in 2023-05-08T10:59:13.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:12 smithi133 ceph-mon[125939]: pgmap v13971: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 521 KiB/s wr, 29 op/s 2023-05-08T10:59:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:12 smithi096 ceph-mon[124666]: pgmap v13971: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 521 KiB/s wr, 29 op/s 2023-05-08T10:59:13.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:12 smithi186 ceph-mon[126480]: pgmap v13971: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 521 KiB/s wr, 29 op/s 2023-05-08T10:59:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:59:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:59:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:13 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:59:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:59:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:59:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:13 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:59:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T10:59:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:59:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:13 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:59:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26093.163393 secs 2023-05-08T10:59:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:14 smithi133 ceph-mon[125939]: pgmap v13972: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 521 KiB/s wr, 29 op/s 2023-05-08T10:59:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26093.719628 secs 2023-05-08T10:59:15.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:14 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:59:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26093.163393 secs 2023-05-08T10:59:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:14 smithi096 ceph-mon[124666]: pgmap v13972: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 521 KiB/s wr, 29 op/s 2023-05-08T10:59:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26093.719628 secs 2023-05-08T10:59:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:14 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:59:15.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26093.163393 secs 2023-05-08T10:59:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:14 smithi186 ceph-mon[126480]: pgmap v13972: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 521 KiB/s wr, 29 op/s 2023-05-08T10:59:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26093.719628 secs 2023-05-08T10:59:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:14 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:59:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26095.006881 secs 2023-05-08T10:59:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26095.006881 secs 2023-05-08T10:59:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26095.006881 secs 2023-05-08T10:59:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:16 smithi133 ceph-mon[125939]: pgmap v13973: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 482 KiB/s wr, 26 op/s 2023-05-08T10:59:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:16 smithi096 ceph-mon[124666]: pgmap v13973: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 482 KiB/s wr, 26 op/s 2023-05-08T10:59:17.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:16 smithi186 ceph-mon[126480]: pgmap v13973: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 482 KiB/s wr, 26 op/s 2023-05-08T10:59:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:18 smithi133 ceph-mon[125939]: pgmap v13974: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 482 KiB/s wr, 26 op/s 2023-05-08T10:59:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:18 smithi096 ceph-mon[124666]: pgmap v13974: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 482 KiB/s wr, 26 op/s 2023-05-08T10:59:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:18 smithi186 ceph-mon[126480]: pgmap v13974: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 482 KiB/s wr, 26 op/s 2023-05-08T10:59:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26098.163492 secs 2023-05-08T10:59:20.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26098.719747 secs 2023-05-08T10:59:20.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:19 smithi133 ceph-mon[125939]: osdmap e951: 12 total, 12 up, 12 in 2023-05-08T10:59:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26098.163492 secs 2023-05-08T10:59:20.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26098.719747 secs 2023-05-08T10:59:20.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:19 smithi096 ceph-mon[124666]: osdmap e951: 12 total, 12 up, 12 in 2023-05-08T10:59:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26098.163492 secs 2023-05-08T10:59:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26098.719747 secs 2023-05-08T10:59:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:19 smithi186 ceph-mon[126480]: osdmap e951: 12 total, 12 up, 12 in 2023-05-08T10:59:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:20 smithi133 ceph-mon[125939]: pgmap v13976: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 361 KiB/s wr, 9 op/s 2023-05-08T10:59:21.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26100.006988 secs 2023-05-08T10:59:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:20 smithi096 ceph-mon[124666]: pgmap v13976: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 361 KiB/s wr, 9 op/s 2023-05-08T10:59:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26100.006988 secs 2023-05-08T10:59:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:20 smithi186 ceph-mon[126480]: pgmap v13976: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 361 KiB/s wr, 9 op/s 2023-05-08T10:59:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26100.006988 secs 2023-05-08T10:59:23.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:22 smithi133 ceph-mon[125939]: pgmap v13977: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 323 KiB/s wr, 8 op/s 2023-05-08T10:59:23.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:22 smithi096 ceph-mon[124666]: pgmap v13977: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 323 KiB/s wr, 8 op/s 2023-05-08T10:59:23.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:22 smithi186 ceph-mon[126480]: pgmap v13977: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 323 KiB/s wr, 8 op/s 2023-05-08T10:59:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26103.163617 secs 2023-05-08T10:59:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:24 smithi133 ceph-mon[125939]: pgmap v13978: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 323 KiB/s wr, 8 op/s 2023-05-08T10:59:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26103.719871 secs 2023-05-08T10:59:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26103.163617 secs 2023-05-08T10:59:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:24 smithi096 ceph-mon[124666]: pgmap v13978: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 323 KiB/s wr, 8 op/s 2023-05-08T10:59:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26103.719871 secs 2023-05-08T10:59:25.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26103.163617 secs 2023-05-08T10:59:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:24 smithi186 ceph-mon[126480]: pgmap v13978: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 323 KiB/s wr, 8 op/s 2023-05-08T10:59:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26103.719871 secs 2023-05-08T10:59:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26105.007104 secs 2023-05-08T10:59:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26105.007104 secs 2023-05-08T10:59:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26105.007104 secs 2023-05-08T10:59:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:26 smithi133 ceph-mon[125939]: pgmap v13979: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 88 KiB/s wr, 6 op/s 2023-05-08T10:59:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:26 smithi096 ceph-mon[124666]: pgmap v13979: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 88 KiB/s wr, 6 op/s 2023-05-08T10:59:27.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:26 smithi186 ceph-mon[126480]: pgmap v13979: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 88 KiB/s wr, 6 op/s 2023-05-08T10:59:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:28 smithi133 ceph-mon[125939]: pgmap v13980: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 88 KiB/s wr, 6 op/s 2023-05-08T10:59:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:28 smithi096 ceph-mon[124666]: pgmap v13980: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 88 KiB/s wr, 6 op/s 2023-05-08T10:59:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:28 smithi186 ceph-mon[126480]: pgmap v13980: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 88 KiB/s wr, 6 op/s 2023-05-08T10:59:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26108.163680 secs 2023-05-08T10:59:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26108.720007 secs 2023-05-08T10:59:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26108.163680 secs 2023-05-08T10:59:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26108.720007 secs 2023-05-08T10:59:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26108.163680 secs 2023-05-08T10:59:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26108.720007 secs 2023-05-08T10:59:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:30 smithi133 ceph-mon[125939]: pgmap v13981: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T10:59:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26110.007215 secs 2023-05-08T10:59:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:30 smithi096 ceph-mon[124666]: pgmap v13981: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T10:59:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26110.007215 secs 2023-05-08T10:59:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:30 smithi186 ceph-mon[126480]: pgmap v13981: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T10:59:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26110.007215 secs 2023-05-08T10:59:33.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:32 smithi133 ceph-mon[125939]: pgmap v13982: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:59:33.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:32 smithi096 ceph-mon[124666]: pgmap v13982: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:59:33.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:32 smithi186 ceph-mon[126480]: pgmap v13982: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:59:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26113.163797 secs 2023-05-08T10:59:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:34 smithi133 ceph-mon[125939]: pgmap v13983: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:59:35.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26113.720147 secs 2023-05-08T10:59:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26113.163797 secs 2023-05-08T10:59:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:34 smithi096 ceph-mon[124666]: pgmap v13983: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:59:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26113.720147 secs 2023-05-08T10:59:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26113.163797 secs 2023-05-08T10:59:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:34 smithi186 ceph-mon[126480]: pgmap v13983: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T10:59:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26113.720147 secs 2023-05-08T10:59:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26115.007322 secs 2023-05-08T10:59:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26115.007322 secs 2023-05-08T10:59:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26115.007322 secs 2023-05-08T10:59:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:36 smithi133 ceph-mon[125939]: pgmap v13984: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T10:59:37.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:36 smithi096 ceph-mon[124666]: pgmap v13984: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T10:59:37.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:36 smithi186 ceph-mon[126480]: pgmap v13984: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T10:59:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:38 smithi133 ceph-mon[125939]: pgmap v13985: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T10:59:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:38 smithi096 ceph-mon[124666]: pgmap v13985: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T10:59:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:38 smithi186 ceph-mon[126480]: pgmap v13985: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T10:59:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26118.163912 secs 2023-05-08T10:59:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26118.720283 secs 2023-05-08T10:59:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26118.163912 secs 2023-05-08T10:59:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26118.720283 secs 2023-05-08T10:59:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26118.163912 secs 2023-05-08T10:59:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26118.720283 secs 2023-05-08T10:59:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:40 smithi133 ceph-mon[125939]: pgmap v13986: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 19 KiB/s wr, 8 op/s 2023-05-08T10:59:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26120.007440 secs 2023-05-08T10:59:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:40 smithi096 ceph-mon[124666]: pgmap v13986: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 19 KiB/s wr, 8 op/s 2023-05-08T10:59:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26120.007440 secs 2023-05-08T10:59:41.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:40 smithi186 ceph-mon[126480]: pgmap v13986: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 19 KiB/s wr, 8 op/s 2023-05-08T10:59:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26120.007440 secs 2023-05-08T10:59:43.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:42 smithi133 ceph-mon[125939]: pgmap v13987: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 19 KiB/s wr, 6 op/s 2023-05-08T10:59:43.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:42 smithi096 ceph-mon[124666]: pgmap v13987: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 19 KiB/s wr, 6 op/s 2023-05-08T10:59:43.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:42 smithi186 ceph-mon[126480]: pgmap v13987: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 19 KiB/s wr, 6 op/s 2023-05-08T10:59:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26123.164051 secs 2023-05-08T10:59:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:44 smithi133 ceph-mon[125939]: pgmap v13988: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 19 KiB/s wr, 6 op/s 2023-05-08T10:59:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26123.720404 secs 2023-05-08T10:59:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26123.164051 secs 2023-05-08T10:59:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:44 smithi096 ceph-mon[124666]: pgmap v13988: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 19 KiB/s wr, 6 op/s 2023-05-08T10:59:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26123.720404 secs 2023-05-08T10:59:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26123.164051 secs 2023-05-08T10:59:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:44 smithi186 ceph-mon[126480]: pgmap v13988: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 19 KiB/s wr, 6 op/s 2023-05-08T10:59:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26123.720404 secs 2023-05-08T10:59:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26125.007560 secs 2023-05-08T10:59:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26125.007560 secs 2023-05-08T10:59:46.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26125.007560 secs 2023-05-08T10:59:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:46 smithi133 ceph-mon[125939]: pgmap v13989: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 94 KiB/s wr, 10 op/s 2023-05-08T10:59:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:46 smithi096 ceph-mon[124666]: pgmap v13989: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 94 KiB/s wr, 10 op/s 2023-05-08T10:59:47.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:46 smithi186 ceph-mon[126480]: pgmap v13989: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 94 KiB/s wr, 10 op/s 2023-05-08T10:59:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:48 smithi133 ceph-mon[125939]: pgmap v13990: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 93 KiB/s wr, 7 op/s 2023-05-08T10:59:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:48 smithi096 ceph-mon[124666]: pgmap v13990: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 93 KiB/s wr, 7 op/s 2023-05-08T10:59:49.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:48 smithi186 ceph-mon[126480]: pgmap v13990: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 93 KiB/s wr, 7 op/s 2023-05-08T10:59:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26128.164172 secs 2023-05-08T10:59:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26128.720522 secs 2023-05-08T10:59:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26128.164172 secs 2023-05-08T10:59:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26128.720522 secs 2023-05-08T10:59:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26128.164172 secs 2023-05-08T10:59:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26128.720522 secs 2023-05-08T10:59:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:50 smithi133 ceph-mon[125939]: pgmap v13991: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 277 KiB/s wr, 10 op/s 2023-05-08T10:59:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26130.007696 secs 2023-05-08T10:59:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:50 smithi096 ceph-mon[124666]: pgmap v13991: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 277 KiB/s wr, 10 op/s 2023-05-08T10:59:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26130.007696 secs 2023-05-08T10:59:51.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:50 smithi186 ceph-mon[126480]: pgmap v13991: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 277 KiB/s wr, 10 op/s 2023-05-08T10:59:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26130.007696 secs 2023-05-08T10:59:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:52 smithi133 ceph-mon[125939]: pgmap v13992: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 258 KiB/s wr, 7 op/s 2023-05-08T10:59:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:52 smithi096 ceph-mon[124666]: pgmap v13992: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 258 KiB/s wr, 7 op/s 2023-05-08T10:59:53.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:52 smithi186 ceph-mon[126480]: pgmap v13992: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 258 KiB/s wr, 7 op/s 2023-05-08T10:59:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26133.164298 secs 2023-05-08T10:59:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:54 smithi133 ceph-mon[125939]: pgmap v13993: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 258 KiB/s wr, 7 op/s 2023-05-08T10:59:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26133.164298 secs 2023-05-08T10:59:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:54 smithi096 ceph-mon[124666]: pgmap v13993: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 258 KiB/s wr, 7 op/s 2023-05-08T10:59:55.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26133.164298 secs 2023-05-08T10:59:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:54 smithi186 ceph-mon[126480]: pgmap v13993: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 258 KiB/s wr, 7 op/s 2023-05-08T10:59:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26135.007798 secs 2023-05-08T10:59:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26135.007798 secs 2023-05-08T10:59:56.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26135.007798 secs 2023-05-08T10:59:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:56 smithi133 ceph-mon[125939]: pgmap v13994: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 569 KiB/s rd, 547 KiB/s wr, 11 op/s 2023-05-08T10:59:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:59:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:56 smithi096 ceph-mon[124666]: pgmap v13994: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 569 KiB/s rd, 547 KiB/s wr, 11 op/s 2023-05-08T10:59:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:59:57.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:56 smithi186 ceph-mon[126480]: pgmap v13994: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 569 KiB/s rd, 547 KiB/s wr, 11 op/s 2023-05-08T10:59:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T10:59:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:57 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:59:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:59:58.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:59:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:57 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:59:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:59:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:59:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:57 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T10:59:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T10:59:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T10:59:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:58 smithi096 ceph-mon[124666]: pgmap v13995: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 473 KiB/s wr, 7 op/s 2023-05-08T10:59:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:58 smithi186 ceph-mon[126480]: pgmap v13995: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 473 KiB/s wr, 7 op/s 2023-05-08T10:59:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:58 smithi133 ceph-mon[125939]: pgmap v13995: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 473 KiB/s wr, 7 op/s 2023-05-08T11:00:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26138.164415 secs 2023-05-08T11:00:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26138.720717 secs 2023-05-08T11:00:00.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:00:00.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:00:00.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:00:00.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 10:59:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:00:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26138.164415 secs 2023-05-08T11:00:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26138.720717 secs 2023-05-08T11:00:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:00:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:00:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:00:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 10:59:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:00:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26138.164415 secs 2023-05-08T11:00:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26138.720717 secs 2023-05-08T11:00:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:00:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:00:00.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:00:00.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 10:59:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:00:01.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:01 smithi186 ceph-mon[126480]: pgmap v13996: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 732 KiB/s rd, 720 KiB/s wr, 14 op/s 2023-05-08T11:00:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:01 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:00:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:01 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T11:00:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:01 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T11:00:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:01 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:00:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:01 smithi186 ceph-mon[126480]: overall HEALTH_WARN 2 MDSs report slow requests 2023-05-08T11:00:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:01 smithi133 ceph-mon[125939]: pgmap v13996: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 732 KiB/s rd, 720 KiB/s wr, 14 op/s 2023-05-08T11:00:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:01 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:00:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:01 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T11:00:01.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:01 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T11:00:01.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:01 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:00:01.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:01 smithi133 ceph-mon[125939]: overall HEALTH_WARN 2 MDSs report slow requests 2023-05-08T11:00:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:01 smithi096 ceph-mon[124666]: pgmap v13996: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 732 KiB/s rd, 720 KiB/s wr, 14 op/s 2023-05-08T11:00:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:01 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:00:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:01 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T11:00:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:01 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T11:00:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:01 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:00:01.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:01 smithi096 ceph-mon[124666]: overall HEALTH_WARN 2 MDSs report slow requests 2023-05-08T11:00:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:00:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:00:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:00:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:00:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:00:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:00:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:03 smithi186 ceph-mon[126480]: pgmap v13997: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 537 KiB/s wr, 11 op/s 2023-05-08T11:00:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:03 smithi133 ceph-mon[125939]: pgmap v13997: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 537 KiB/s wr, 11 op/s 2023-05-08T11:00:03.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:03 smithi096 ceph-mon[124666]: pgmap v13997: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 537 KiB/s wr, 11 op/s 2023-05-08T11:00:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:04 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:00:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:04 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:00:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:04 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:00:05.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26143.164529 secs 2023-05-08T11:00:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:05 smithi186 ceph-mon[126480]: pgmap v13998: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 537 KiB/s wr, 10 op/s 2023-05-08T11:00:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:05 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:00:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:00:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:00:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26143.164529 secs 2023-05-08T11:00:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:05 smithi133 ceph-mon[125939]: pgmap v13998: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 537 KiB/s wr, 10 op/s 2023-05-08T11:00:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:05 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:00:05.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:00:05.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:00:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26143.164529 secs 2023-05-08T11:00:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:05 smithi096 ceph-mon[124666]: pgmap v13998: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 537 KiB/s wr, 10 op/s 2023-05-08T11:00:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:05 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:00:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:00:05.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:00:07.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:07 smithi186 ceph-mon[126480]: pgmap v13999: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 776 KiB/s rd, 776 KiB/s wr, 18 op/s 2023-05-08T11:00:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:07 smithi133 ceph-mon[125939]: pgmap v13999: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 776 KiB/s rd, 776 KiB/s wr, 18 op/s 2023-05-08T11:00:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:07 smithi096 ceph-mon[124666]: pgmap v13999: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 776 KiB/s rd, 776 KiB/s wr, 18 op/s 2023-05-08T11:00:08.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:08 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:00:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:08 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:00:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:08 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:00:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:09 smithi186 ceph-mon[126480]: pgmap v14000: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 485 KiB/s rd, 487 KiB/s wr, 14 op/s 2023-05-08T11:00:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:00:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:00:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:09 smithi133 ceph-mon[125939]: pgmap v14000: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 485 KiB/s rd, 487 KiB/s wr, 14 op/s 2023-05-08T11:00:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:00:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:00:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:09 smithi096 ceph-mon[124666]: pgmap v14000: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 485 KiB/s rd, 487 KiB/s wr, 14 op/s 2023-05-08T11:00:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:00:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:00:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26148.164644 secs 2023-05-08T11:00:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26148.720978 secs 2023-05-08T11:00:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:10 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:00:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26148.164644 secs 2023-05-08T11:00:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26148.720978 secs 2023-05-08T11:00:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:10 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:00:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26148.164644 secs 2023-05-08T11:00:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26148.720978 secs 2023-05-08T11:00:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:10 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:00:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:11 smithi186 ceph-mon[126480]: pgmap v14001: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 669 KiB/s rd, 692 KiB/s wr, 33 op/s 2023-05-08T11:00:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26150.008119 secs 2023-05-08T11:00:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:11 smithi133 ceph-mon[125939]: pgmap v14001: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 669 KiB/s rd, 692 KiB/s wr, 33 op/s 2023-05-08T11:00:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26150.008119 secs 2023-05-08T11:00:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:11 smithi096 ceph-mon[124666]: pgmap v14001: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 669 KiB/s rd, 692 KiB/s wr, 33 op/s 2023-05-08T11:00:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26150.008119 secs 2023-05-08T11:00:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:12 smithi186 ceph-mon[126480]: osdmap e952: 12 total, 12 up, 12 in 2023-05-08T11:00:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:12 smithi133 ceph-mon[125939]: osdmap e952: 12 total, 12 up, 12 in 2023-05-08T11:00:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:12 smithi096 ceph-mon[124666]: osdmap e952: 12 total, 12 up, 12 in 2023-05-08T11:00:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:13 smithi186 ceph-mon[126480]: pgmap v14003: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 495 KiB/s rd, 534 KiB/s wr, 31 op/s 2023-05-08T11:00:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:00:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:00:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:13 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:00:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:13 smithi133 ceph-mon[125939]: pgmap v14003: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 495 KiB/s rd, 534 KiB/s wr, 31 op/s 2023-05-08T11:00:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:00:13.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:00:13.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:13 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:00:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:13 smithi096 ceph-mon[124666]: pgmap v14003: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 495 KiB/s rd, 534 KiB/s wr, 31 op/s 2023-05-08T11:00:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:00:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:00:13.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:13 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:00:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26153.164762 secs 2023-05-08T11:00:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26153.164762 secs 2023-05-08T11:00:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26153.164762 secs 2023-05-08T11:00:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:15 smithi186 ceph-mon[126480]: pgmap v14004: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 495 KiB/s rd, 534 KiB/s wr, 31 op/s 2023-05-08T11:00:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26153.721103 secs 2023-05-08T11:00:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:15 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:00:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:15 smithi133 ceph-mon[125939]: pgmap v14004: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 495 KiB/s rd, 534 KiB/s wr, 31 op/s 2023-05-08T11:00:15.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26153.721103 secs 2023-05-08T11:00:15.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:15 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:00:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:15 smithi096 ceph-mon[124666]: pgmap v14004: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 495 KiB/s rd, 534 KiB/s wr, 31 op/s 2023-05-08T11:00:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26153.721103 secs 2023-05-08T11:00:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:15 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:00:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26155.008262 secs 2023-05-08T11:00:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26155.008262 secs 2023-05-08T11:00:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26155.008262 secs 2023-05-08T11:00:17.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:17 smithi186 ceph-mon[126480]: pgmap v14005: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 483 KiB/s wr, 28 op/s 2023-05-08T11:00:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:17 smithi133 ceph-mon[125939]: pgmap v14005: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 483 KiB/s wr, 28 op/s 2023-05-08T11:00:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:17 smithi096 ceph-mon[124666]: pgmap v14005: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 483 KiB/s wr, 28 op/s 2023-05-08T11:00:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:19 smithi186 ceph-mon[126480]: pgmap v14006: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 483 KiB/s wr, 28 op/s 2023-05-08T11:00:19.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26158.164904 secs 2023-05-08T11:00:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:19 smithi133 ceph-mon[125939]: pgmap v14006: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 483 KiB/s wr, 28 op/s 2023-05-08T11:00:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26158.164904 secs 2023-05-08T11:00:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:19 smithi096 ceph-mon[124666]: pgmap v14006: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 483 KiB/s wr, 28 op/s 2023-05-08T11:00:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26158.164904 secs 2023-05-08T11:00:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26158.721217 secs 2023-05-08T11:00:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:20 smithi186 ceph-mon[126480]: osdmap e953: 12 total, 12 up, 12 in 2023-05-08T11:00:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26158.721217 secs 2023-05-08T11:00:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:20 smithi133 ceph-mon[125939]: osdmap e953: 12 total, 12 up, 12 in 2023-05-08T11:00:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26158.721217 secs 2023-05-08T11:00:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:20 smithi096 ceph-mon[124666]: osdmap e953: 12 total, 12 up, 12 in 2023-05-08T11:00:21.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:21 smithi186 ceph-mon[126480]: pgmap v14008: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 368 KiB/s wr, 11 op/s 2023-05-08T11:00:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26160.008385 secs 2023-05-08T11:00:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:21 smithi133 ceph-mon[125939]: pgmap v14008: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 368 KiB/s wr, 11 op/s 2023-05-08T11:00:21.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26160.008385 secs 2023-05-08T11:00:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:21 smithi096 ceph-mon[124666]: pgmap v14008: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 368 KiB/s wr, 11 op/s 2023-05-08T11:00:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26160.008385 secs 2023-05-08T11:00:23.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:23 smithi186 ceph-mon[126480]: pgmap v14009: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 324 KiB/s wr, 9 op/s 2023-05-08T11:00:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:23 smithi133 ceph-mon[125939]: pgmap v14009: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 324 KiB/s wr, 9 op/s 2023-05-08T11:00:23.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:23 smithi096 ceph-mon[124666]: pgmap v14009: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 324 KiB/s wr, 9 op/s 2023-05-08T11:00:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26163.165024 secs 2023-05-08T11:00:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26163.165024 secs 2023-05-08T11:00:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26163.165024 secs 2023-05-08T11:00:25.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:25 smithi186 ceph-mon[126480]: pgmap v14010: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 324 KiB/s wr, 9 op/s 2023-05-08T11:00:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26163.721342 secs 2023-05-08T11:00:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:25 smithi133 ceph-mon[125939]: pgmap v14010: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 324 KiB/s wr, 9 op/s 2023-05-08T11:00:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26163.721342 secs 2023-05-08T11:00:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:25 smithi096 ceph-mon[124666]: pgmap v14010: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 324 KiB/s wr, 9 op/s 2023-05-08T11:00:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26163.721342 secs 2023-05-08T11:00:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26165.008501 secs 2023-05-08T11:00:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26165.008501 secs 2023-05-08T11:00:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26165.008501 secs 2023-05-08T11:00:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:27 smithi186 ceph-mon[126480]: pgmap v14011: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 88 KiB/s wr, 7 op/s 2023-05-08T11:00:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:27 smithi133 ceph-mon[125939]: pgmap v14011: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 88 KiB/s wr, 7 op/s 2023-05-08T11:00:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:27 smithi096 ceph-mon[124666]: pgmap v14011: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 88 KiB/s wr, 7 op/s 2023-05-08T11:00:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:29 smithi186 ceph-mon[126480]: pgmap v14012: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 88 KiB/s wr, 7 op/s 2023-05-08T11:00:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26168.165137 secs 2023-05-08T11:00:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:29 smithi133 ceph-mon[125939]: pgmap v14012: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 88 KiB/s wr, 7 op/s 2023-05-08T11:00:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26168.165137 secs 2023-05-08T11:00:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:29 smithi096 ceph-mon[124666]: pgmap v14012: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 88 KiB/s wr, 7 op/s 2023-05-08T11:00:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26168.165137 secs 2023-05-08T11:00:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26168.721459 secs 2023-05-08T11:00:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26168.721459 secs 2023-05-08T11:00:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26168.721459 secs 2023-05-08T11:00:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:31 smithi186 ceph-mon[126480]: pgmap v14013: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2023-05-08T11:00:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26170.008616 secs 2023-05-08T11:00:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:31 smithi133 ceph-mon[125939]: pgmap v14013: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2023-05-08T11:00:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26170.008616 secs 2023-05-08T11:00:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:31 smithi096 ceph-mon[124666]: pgmap v14013: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2023-05-08T11:00:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26170.008616 secs 2023-05-08T11:00:33.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:33 smithi186 ceph-mon[126480]: pgmap v14014: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T11:00:33.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:33 smithi133 ceph-mon[125939]: pgmap v14014: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T11:00:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:33 smithi096 ceph-mon[124666]: pgmap v14014: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T11:00:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26173.165254 secs 2023-05-08T11:00:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26173.165254 secs 2023-05-08T11:00:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26173.165254 secs 2023-05-08T11:00:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:35 smithi186 ceph-mon[126480]: pgmap v14015: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T11:00:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26173.721549 secs 2023-05-08T11:00:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:35 smithi133 ceph-mon[125939]: pgmap v14015: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T11:00:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26173.721549 secs 2023-05-08T11:00:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:35 smithi096 ceph-mon[124666]: pgmap v14015: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T11:00:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26173.721549 secs 2023-05-08T11:00:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26175.008755 secs 2023-05-08T11:00:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26175.008755 secs 2023-05-08T11:00:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26175.008755 secs 2023-05-08T11:00:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:37 smithi133 ceph-mon[125939]: pgmap v14016: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 9 op/s 2023-05-08T11:00:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:37 smithi096 ceph-mon[124666]: pgmap v14016: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 9 op/s 2023-05-08T11:00:37.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:37 smithi186 ceph-mon[126480]: pgmap v14016: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 9 op/s 2023-05-08T11:00:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:39 smithi133 ceph-mon[125939]: pgmap v14017: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 6 op/s 2023-05-08T11:00:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26178.165332 secs 2023-05-08T11:00:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:39 smithi096 ceph-mon[124666]: pgmap v14017: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 6 op/s 2023-05-08T11:00:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26178.165332 secs 2023-05-08T11:00:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:39 smithi186 ceph-mon[126480]: pgmap v14017: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 6 op/s 2023-05-08T11:00:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26178.165332 secs 2023-05-08T11:00:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26178.721672 secs 2023-05-08T11:00:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26178.721672 secs 2023-05-08T11:00:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26178.721672 secs 2023-05-08T11:00:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:41 smithi133 ceph-mon[125939]: pgmap v14018: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 93 KiB/s wr, 9 op/s 2023-05-08T11:00:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26180.008851 secs 2023-05-08T11:00:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:41 smithi096 ceph-mon[124666]: pgmap v14018: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 93 KiB/s wr, 9 op/s 2023-05-08T11:00:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26180.008851 secs 2023-05-08T11:00:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:41 smithi186 ceph-mon[126480]: pgmap v14018: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 93 KiB/s wr, 9 op/s 2023-05-08T11:00:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26180.008851 secs 2023-05-08T11:00:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:43 smithi133 ceph-mon[125939]: pgmap v14019: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 93 KiB/s wr, 6 op/s 2023-05-08T11:00:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:43 smithi096 ceph-mon[124666]: pgmap v14019: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 93 KiB/s wr, 6 op/s 2023-05-08T11:00:43.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:43 smithi186 ceph-mon[126480]: pgmap v14019: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 93 KiB/s wr, 6 op/s 2023-05-08T11:00:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26183.165402 secs 2023-05-08T11:00:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26183.165402 secs 2023-05-08T11:00:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26183.165402 secs 2023-05-08T11:00:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:45 smithi133 ceph-mon[125939]: pgmap v14020: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 93 KiB/s wr, 6 op/s 2023-05-08T11:00:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26183.721742 secs 2023-05-08T11:00:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:45 smithi096 ceph-mon[124666]: pgmap v14020: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 93 KiB/s wr, 6 op/s 2023-05-08T11:00:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26183.721742 secs 2023-05-08T11:00:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:45 smithi186 ceph-mon[126480]: pgmap v14020: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 93 KiB/s wr, 6 op/s 2023-05-08T11:00:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26183.721742 secs 2023-05-08T11:00:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26185.008929 secs 2023-05-08T11:00:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26185.008929 secs 2023-05-08T11:00:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26185.008929 secs 2023-05-08T11:00:47.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:47 smithi133 ceph-mon[125939]: pgmap v14021: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 94 KiB/s wr, 10 op/s 2023-05-08T11:00:47.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:47 smithi096 ceph-mon[124666]: pgmap v14021: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 94 KiB/s wr, 10 op/s 2023-05-08T11:00:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:47 smithi186 ceph-mon[126480]: pgmap v14021: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 94 KiB/s wr, 10 op/s 2023-05-08T11:00:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:49 smithi133 ceph-mon[125939]: pgmap v14022: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 93 KiB/s wr, 6 op/s 2023-05-08T11:00:49.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26188.165496 secs 2023-05-08T11:00:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:49 smithi096 ceph-mon[124666]: pgmap v14022: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 93 KiB/s wr, 6 op/s 2023-05-08T11:00:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26188.165496 secs 2023-05-08T11:00:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:49 smithi186 ceph-mon[126480]: pgmap v14022: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 93 KiB/s wr, 6 op/s 2023-05-08T11:00:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26188.165496 secs 2023-05-08T11:00:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26188.721818 secs 2023-05-08T11:00:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26188.721818 secs 2023-05-08T11:00:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26188.721818 secs 2023-05-08T11:00:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:51 smithi133 ceph-mon[125939]: pgmap v14023: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 481 KiB/s wr, 10 op/s 2023-05-08T11:00:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26190.009014 secs 2023-05-08T11:00:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:51 smithi096 ceph-mon[124666]: pgmap v14023: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 481 KiB/s wr, 10 op/s 2023-05-08T11:00:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26190.009014 secs 2023-05-08T11:00:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:51 smithi186 ceph-mon[126480]: pgmap v14023: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 481 KiB/s wr, 10 op/s 2023-05-08T11:00:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26190.009014 secs 2023-05-08T11:00:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:53 smithi133 ceph-mon[125939]: pgmap v14024: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 388 KiB/s wr, 7 op/s 2023-05-08T11:00:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:53 smithi096 ceph-mon[124666]: pgmap v14024: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 388 KiB/s wr, 7 op/s 2023-05-08T11:00:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:53 smithi186 ceph-mon[126480]: pgmap v14024: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 388 KiB/s wr, 7 op/s 2023-05-08T11:00:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26193.165644 secs 2023-05-08T11:00:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26193.165644 secs 2023-05-08T11:00:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26193.165644 secs 2023-05-08T11:00:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:55 smithi186 ceph-mon[126480]: pgmap v14025: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 388 KiB/s wr, 7 op/s 2023-05-08T11:00:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:55 smithi133 ceph-mon[125939]: pgmap v14025: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 388 KiB/s wr, 7 op/s 2023-05-08T11:00:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:55 smithi096 ceph-mon[124666]: pgmap v14025: 97 pgs: 97 active+clean; 6.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 388 KiB/s wr, 7 op/s 2023-05-08T11:00:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:00:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:00:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:00:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:00:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:00:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:00:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:57 smithi186 ceph-mon[126480]: pgmap v14026: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 696 KiB/s rd, 589 KiB/s wr, 12 op/s 2023-05-08T11:00:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:57 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:00:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:00:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:00:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:00:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:57 smithi133 ceph-mon[125939]: pgmap v14026: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 696 KiB/s rd, 589 KiB/s wr, 12 op/s 2023-05-08T11:00:58.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:57 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:00:58.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:00:58.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:00:58.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:00:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:57 smithi096 ceph-mon[124666]: pgmap v14026: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 696 KiB/s rd, 589 KiB/s wr, 12 op/s 2023-05-08T11:00:58.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:57 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:00:58.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:00:58.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:00:58.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:01:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:59 smithi186 ceph-mon[126480]: pgmap v14027: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 601 KiB/s rd, 589 KiB/s wr, 8 op/s 2023-05-08T11:01:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:00:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26198.165795 secs 2023-05-08T11:01:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:59 smithi133 ceph-mon[125939]: pgmap v14027: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 601 KiB/s rd, 589 KiB/s wr, 8 op/s 2023-05-08T11:01:00.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:00:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26198.165795 secs 2023-05-08T11:01:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:59 smithi096 ceph-mon[124666]: pgmap v14027: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 601 KiB/s rd, 589 KiB/s wr, 8 op/s 2023-05-08T11:01:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:00:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26198.165795 secs 2023-05-08T11:01:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:01:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26200.009203 secs 2023-05-08T11:01:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:01:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:01:01.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:01:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:01:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26200.009203 secs 2023-05-08T11:01:01.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:01:01.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:01:01.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:01:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:01:01.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26200.009203 secs 2023-05-08T11:01:01.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:01:01.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:01:01.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:01:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:01 smithi186 ceph-mon[126480]: pgmap v14028: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 934 KiB/s rd, 959 KiB/s wr, 15 op/s 2023-05-08T11:01:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:01 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:01:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:01 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T11:01:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:01 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T11:01:02.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:01 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:01:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:01 smithi133 ceph-mon[125939]: pgmap v14028: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 934 KiB/s rd, 959 KiB/s wr, 15 op/s 2023-05-08T11:01:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:01 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:01:02.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:01 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T11:01:02.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:01 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T11:01:02.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:01 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:01:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:01 smithi096 ceph-mon[124666]: pgmap v14028: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 934 KiB/s rd, 959 KiB/s wr, 15 op/s 2023-05-08T11:01:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:01 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:01:02.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:01 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T11:01:02.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:01 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T11:01:02.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:01 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:01:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:02 smithi186 ceph-mon[126480]: pgmap v14029: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 748 KiB/s rd, 571 KiB/s wr, 11 op/s 2023-05-08T11:01:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:02 smithi133 ceph-mon[125939]: pgmap v14029: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 748 KiB/s rd, 571 KiB/s wr, 11 op/s 2023-05-08T11:01:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:02 smithi096 ceph-mon[124666]: pgmap v14029: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 748 KiB/s rd, 571 KiB/s wr, 11 op/s 2023-05-08T11:01:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26203.165934 secs 2023-05-08T11:01:05.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:04 smithi133 ceph-mon[125939]: pgmap v14030: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 748 KiB/s rd, 571 KiB/s wr, 11 op/s 2023-05-08T11:01:05.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:04 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:01:05.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:04 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:01:05.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:04 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:01:05.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26203.722169 secs 2023-05-08T11:01:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26203.165934 secs 2023-05-08T11:01:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:04 smithi096 ceph-mon[124666]: pgmap v14030: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 748 KiB/s rd, 571 KiB/s wr, 11 op/s 2023-05-08T11:01:05.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:04 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:01:05.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:04 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:01:05.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:04 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:01:05.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26203.722169 secs 2023-05-08T11:01:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26203.165934 secs 2023-05-08T11:01:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:04 smithi186 ceph-mon[126480]: pgmap v14030: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 748 KiB/s rd, 571 KiB/s wr, 11 op/s 2023-05-08T11:01:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:04 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:01:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:04 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:01:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:04 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:01:05.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26203.722169 secs 2023-05-08T11:01:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:01:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:01:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26205.009327 secs 2023-05-08T11:01:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:01:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:01:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26205.009327 secs 2023-05-08T11:01:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:01:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:01:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26205.009327 secs 2023-05-08T11:01:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:06 smithi133 ceph-mon[125939]: pgmap v14031: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 901 KiB/s rd, 720 KiB/s wr, 30 op/s 2023-05-08T11:01:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:06 smithi096 ceph-mon[124666]: pgmap v14031: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 901 KiB/s rd, 720 KiB/s wr, 30 op/s 2023-05-08T11:01:07.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:06 smithi186 ceph-mon[126480]: pgmap v14031: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 901 KiB/s rd, 720 KiB/s wr, 30 op/s 2023-05-08T11:01:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:08 smithi133 ceph-mon[125939]: pgmap v14032: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 485 KiB/s rd, 519 KiB/s wr, 25 op/s 2023-05-08T11:01:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:08 smithi096 ceph-mon[124666]: pgmap v14032: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 485 KiB/s rd, 519 KiB/s wr, 25 op/s 2023-05-08T11:01:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:08 smithi186 ceph-mon[126480]: pgmap v14032: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 485 KiB/s rd, 519 KiB/s wr, 25 op/s 2023-05-08T11:01:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26208.166055 secs 2023-05-08T11:01:10.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26208.722270 secs 2023-05-08T11:01:10.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:09 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:01:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26208.166055 secs 2023-05-08T11:01:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26208.722270 secs 2023-05-08T11:01:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:09 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:01:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26208.166055 secs 2023-05-08T11:01:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26208.722270 secs 2023-05-08T11:01:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:09 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:01:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:10 smithi133 ceph-mon[125939]: pgmap v14033: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 486 KiB/s rd, 612 KiB/s wr, 28 op/s 2023-05-08T11:01:11.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26210.009467 secs 2023-05-08T11:01:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:10 smithi096 ceph-mon[124666]: pgmap v14033: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 486 KiB/s rd, 612 KiB/s wr, 28 op/s 2023-05-08T11:01:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26210.009467 secs 2023-05-08T11:01:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:10 smithi186 ceph-mon[126480]: pgmap v14033: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 486 KiB/s rd, 612 KiB/s wr, 28 op/s 2023-05-08T11:01:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26210.009467 secs 2023-05-08T11:01:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:11 smithi133 ceph-mon[125939]: osdmap e954: 12 total, 12 up, 12 in 2023-05-08T11:01:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:11 smithi096 ceph-mon[124666]: osdmap e954: 12 total, 12 up, 12 in 2023-05-08T11:01:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:11 smithi186 ceph-mon[126480]: osdmap e954: 12 total, 12 up, 12 in 2023-05-08T11:01:13.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:12 smithi133 ceph-mon[125939]: pgmap v14035: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 291 KiB/s wr, 26 op/s 2023-05-08T11:01:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:12 smithi096 ceph-mon[124666]: pgmap v14035: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 291 KiB/s wr, 26 op/s 2023-05-08T11:01:13.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:12 smithi186 ceph-mon[126480]: pgmap v14035: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 291 KiB/s wr, 26 op/s 2023-05-08T11:01:15.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26213.166166 secs 2023-05-08T11:01:15.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:14 smithi133 ceph-mon[125939]: pgmap v14036: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 291 KiB/s wr, 26 op/s 2023-05-08T11:01:15.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26213.722396 secs 2023-05-08T11:01:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26213.166166 secs 2023-05-08T11:01:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:14 smithi096 ceph-mon[124666]: pgmap v14036: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 291 KiB/s wr, 26 op/s 2023-05-08T11:01:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26213.722396 secs 2023-05-08T11:01:15.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26213.166166 secs 2023-05-08T11:01:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:14 smithi186 ceph-mon[126480]: pgmap v14036: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 291 KiB/s wr, 26 op/s 2023-05-08T11:01:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26213.722396 secs 2023-05-08T11:01:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26215.009603 secs 2023-05-08T11:01:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26215.009603 secs 2023-05-08T11:01:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26215.009603 secs 2023-05-08T11:01:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:16 smithi133 ceph-mon[125939]: pgmap v14037: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 112 KiB/s wr, 7 op/s 2023-05-08T11:01:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:16 smithi096 ceph-mon[124666]: pgmap v14037: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 112 KiB/s wr, 7 op/s 2023-05-08T11:01:17.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:16 smithi186 ceph-mon[126480]: pgmap v14037: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 112 KiB/s wr, 7 op/s 2023-05-08T11:01:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:18 smithi096 ceph-mon[124666]: pgmap v14038: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 112 KiB/s wr, 7 op/s 2023-05-08T11:01:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:18 smithi186 ceph-mon[126480]: pgmap v14038: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 112 KiB/s wr, 7 op/s 2023-05-08T11:01:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:18 smithi133 ceph-mon[125939]: pgmap v14038: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 112 KiB/s wr, 7 op/s 2023-05-08T11:01:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26218.166287 secs 2023-05-08T11:01:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26218.722510 secs 2023-05-08T11:01:20.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:19 smithi096 ceph-mon[124666]: osdmap e955: 12 total, 12 up, 12 in 2023-05-08T11:01:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26218.166287 secs 2023-05-08T11:01:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26218.722510 secs 2023-05-08T11:01:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:19 smithi186 ceph-mon[126480]: osdmap e955: 12 total, 12 up, 12 in 2023-05-08T11:01:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26218.166287 secs 2023-05-08T11:01:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26218.722510 secs 2023-05-08T11:01:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:19 smithi133 ceph-mon[125939]: osdmap e955: 12 total, 12 up, 12 in 2023-05-08T11:01:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:20 smithi096 ceph-mon[124666]: pgmap v14040: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 255 KiB/s rd, 127 KiB/s wr, 8 op/s 2023-05-08T11:01:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26220.009742 secs 2023-05-08T11:01:21.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:20 smithi186 ceph-mon[126480]: pgmap v14040: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 255 KiB/s rd, 127 KiB/s wr, 8 op/s 2023-05-08T11:01:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26220.009742 secs 2023-05-08T11:01:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:20 smithi133 ceph-mon[125939]: pgmap v14040: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 255 KiB/s rd, 127 KiB/s wr, 8 op/s 2023-05-08T11:01:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26220.009742 secs 2023-05-08T11:01:23.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:22 smithi096 ceph-mon[124666]: pgmap v14041: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 113 KiB/s wr, 7 op/s 2023-05-08T11:01:23.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:22 smithi186 ceph-mon[126480]: pgmap v14041: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 113 KiB/s wr, 7 op/s 2023-05-08T11:01:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:22 smithi133 ceph-mon[125939]: pgmap v14041: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 113 KiB/s wr, 7 op/s 2023-05-08T11:01:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26223.166404 secs 2023-05-08T11:01:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:25 smithi096 ceph-mon[124666]: pgmap v14042: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 113 KiB/s wr, 7 op/s 2023-05-08T11:01:25.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26223.722632 secs 2023-05-08T11:01:25.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26223.166404 secs 2023-05-08T11:01:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:25 smithi186 ceph-mon[126480]: pgmap v14042: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 113 KiB/s wr, 7 op/s 2023-05-08T11:01:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26223.722632 secs 2023-05-08T11:01:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26223.166404 secs 2023-05-08T11:01:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:25 smithi133 ceph-mon[125939]: pgmap v14042: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 113 KiB/s wr, 7 op/s 2023-05-08T11:01:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26223.722632 secs 2023-05-08T11:01:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26225.009855 secs 2023-05-08T11:01:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26225.009855 secs 2023-05-08T11:01:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26225.009855 secs 2023-05-08T11:01:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:27 smithi186 ceph-mon[126480]: pgmap v14043: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 112 KiB/s wr, 6 op/s 2023-05-08T11:01:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:27 smithi133 ceph-mon[125939]: pgmap v14043: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 112 KiB/s wr, 6 op/s 2023-05-08T11:01:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:27 smithi096 ceph-mon[124666]: pgmap v14043: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 112 KiB/s wr, 6 op/s 2023-05-08T11:01:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:29 smithi186 ceph-mon[126480]: pgmap v14044: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 112 KiB/s wr, 6 op/s 2023-05-08T11:01:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:29 smithi133 ceph-mon[125939]: pgmap v14044: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 112 KiB/s wr, 6 op/s 2023-05-08T11:01:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:29 smithi096 ceph-mon[124666]: pgmap v14044: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 112 KiB/s wr, 6 op/s 2023-05-08T11:01:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26228.166514 secs 2023-05-08T11:01:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26228.722773 secs 2023-05-08T11:01:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26228.166514 secs 2023-05-08T11:01:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26228.722773 secs 2023-05-08T11:01:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26228.166514 secs 2023-05-08T11:01:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26228.722773 secs 2023-05-08T11:01:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:31 smithi186 ceph-mon[126480]: pgmap v14045: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 509 B/s wr, 6 op/s 2023-05-08T11:01:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26230.009974 secs 2023-05-08T11:01:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:31 smithi133 ceph-mon[125939]: pgmap v14045: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 509 B/s wr, 6 op/s 2023-05-08T11:01:31.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26230.009974 secs 2023-05-08T11:01:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:31 smithi096 ceph-mon[124666]: pgmap v14045: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 509 B/s wr, 6 op/s 2023-05-08T11:01:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26230.009974 secs 2023-05-08T11:01:33.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:33 smithi186 ceph-mon[126480]: pgmap v14046: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T11:01:33.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:33 smithi133 ceph-mon[125939]: pgmap v14046: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T11:01:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:33 smithi096 ceph-mon[124666]: pgmap v14046: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T11:01:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26233.166626 secs 2023-05-08T11:01:35.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:35 smithi186 ceph-mon[126480]: pgmap v14047: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T11:01:35.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26233.722899 secs 2023-05-08T11:01:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26233.166626 secs 2023-05-08T11:01:35.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:35 smithi133 ceph-mon[125939]: pgmap v14047: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T11:01:35.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26233.722899 secs 2023-05-08T11:01:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26233.166626 secs 2023-05-08T11:01:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:35 smithi096 ceph-mon[124666]: pgmap v14047: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T11:01:35.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26233.722899 secs 2023-05-08T11:01:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26235.010083 secs 2023-05-08T11:01:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26235.010083 secs 2023-05-08T11:01:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26235.010083 secs 2023-05-08T11:01:37.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:37 smithi186 ceph-mon[126480]: pgmap v14048: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 182 KiB/s wr, 9 op/s 2023-05-08T11:01:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:37 smithi133 ceph-mon[125939]: pgmap v14048: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 182 KiB/s wr, 9 op/s 2023-05-08T11:01:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:37 smithi096 ceph-mon[124666]: pgmap v14048: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 182 KiB/s wr, 9 op/s 2023-05-08T11:01:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:39 smithi186 ceph-mon[126480]: pgmap v14049: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 182 KiB/s wr, 6 op/s 2023-05-08T11:01:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:39 smithi133 ceph-mon[125939]: pgmap v14049: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 182 KiB/s wr, 6 op/s 2023-05-08T11:01:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:39 smithi096 ceph-mon[124666]: pgmap v14049: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 182 KiB/s wr, 6 op/s 2023-05-08T11:01:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26238.166740 secs 2023-05-08T11:01:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26238.723049 secs 2023-05-08T11:01:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26238.166740 secs 2023-05-08T11:01:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26238.723049 secs 2023-05-08T11:01:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26238.166740 secs 2023-05-08T11:01:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26238.723049 secs 2023-05-08T11:01:41.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:41 smithi186 ceph-mon[126480]: pgmap v14050: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 183 KiB/s wr, 10 op/s 2023-05-08T11:01:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26240.010204 secs 2023-05-08T11:01:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:41 smithi133 ceph-mon[125939]: pgmap v14050: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 183 KiB/s wr, 10 op/s 2023-05-08T11:01:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26240.010204 secs 2023-05-08T11:01:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:41 smithi096 ceph-mon[124666]: pgmap v14050: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 183 KiB/s wr, 10 op/s 2023-05-08T11:01:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26240.010204 secs 2023-05-08T11:01:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:43 smithi186 ceph-mon[126480]: pgmap v14051: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 182 KiB/s wr, 7 op/s 2023-05-08T11:01:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:43 smithi133 ceph-mon[125939]: pgmap v14051: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 182 KiB/s wr, 7 op/s 2023-05-08T11:01:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:43 smithi096 ceph-mon[124666]: pgmap v14051: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 182 KiB/s wr, 7 op/s 2023-05-08T11:01:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26243.166857 secs 2023-05-08T11:01:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:45 smithi186 ceph-mon[126480]: pgmap v14052: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 182 KiB/s wr, 7 op/s 2023-05-08T11:01:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26243.723181 secs 2023-05-08T11:01:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26243.166857 secs 2023-05-08T11:01:45.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:45 smithi133 ceph-mon[125939]: pgmap v14052: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 182 KiB/s wr, 7 op/s 2023-05-08T11:01:45.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26243.723181 secs 2023-05-08T11:01:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26243.166857 secs 2023-05-08T11:01:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:45 smithi096 ceph-mon[124666]: pgmap v14052: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 182 KiB/s wr, 7 op/s 2023-05-08T11:01:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26243.723181 secs 2023-05-08T11:01:46.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26245.010319 secs 2023-05-08T11:01:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26245.010319 secs 2023-05-08T11:01:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26245.010319 secs 2023-05-08T11:01:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:47 smithi186 ceph-mon[126480]: pgmap v14053: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 182 KiB/s wr, 10 op/s 2023-05-08T11:01:47.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:47 smithi133 ceph-mon[125939]: pgmap v14053: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 182 KiB/s wr, 10 op/s 2023-05-08T11:01:47.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:47 smithi096 ceph-mon[124666]: pgmap v14053: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 182 KiB/s wr, 10 op/s 2023-05-08T11:01:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:49 smithi186 ceph-mon[126480]: pgmap v14054: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 426 B/s wr, 6 op/s 2023-05-08T11:01:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:49 smithi133 ceph-mon[125939]: pgmap v14054: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 426 B/s wr, 6 op/s 2023-05-08T11:01:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:49 smithi096 ceph-mon[124666]: pgmap v14054: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 426 B/s wr, 6 op/s 2023-05-08T11:01:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26248.166971 secs 2023-05-08T11:01:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26248.723331 secs 2023-05-08T11:01:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26248.166971 secs 2023-05-08T11:01:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26248.723331 secs 2023-05-08T11:01:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26248.166971 secs 2023-05-08T11:01:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26248.723331 secs 2023-05-08T11:01:51.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:51 smithi186 ceph-mon[126480]: pgmap v14055: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 186 KiB/s wr, 10 op/s 2023-05-08T11:01:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26250.010435 secs 2023-05-08T11:01:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:51 smithi133 ceph-mon[125939]: pgmap v14055: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 186 KiB/s wr, 10 op/s 2023-05-08T11:01:51.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26250.010435 secs 2023-05-08T11:01:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:51 smithi096 ceph-mon[124666]: pgmap v14055: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 186 KiB/s wr, 10 op/s 2023-05-08T11:01:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26250.010435 secs 2023-05-08T11:01:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:53 smithi186 ceph-mon[126480]: pgmap v14056: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 185 KiB/s wr, 6 op/s 2023-05-08T11:01:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:53 smithi133 ceph-mon[125939]: pgmap v14056: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 185 KiB/s wr, 6 op/s 2023-05-08T11:01:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:53 smithi096 ceph-mon[124666]: pgmap v14056: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 185 KiB/s wr, 6 op/s 2023-05-08T11:01:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26253.167086 secs 2023-05-08T11:01:54.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26253.167086 secs 2023-05-08T11:01:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26253.167086 secs 2023-05-08T11:01:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:55 smithi186 ceph-mon[126480]: pgmap v14057: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 185 KiB/s wr, 6 op/s 2023-05-08T11:01:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26255.010552 secs 2023-05-08T11:01:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:55 smithi133 ceph-mon[125939]: pgmap v14057: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 185 KiB/s wr, 6 op/s 2023-05-08T11:01:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26255.010552 secs 2023-05-08T11:01:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:55 smithi096 ceph-mon[124666]: pgmap v14057: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 185 KiB/s wr, 6 op/s 2023-05-08T11:01:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26255.010552 secs 2023-05-08T11:01:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:56 smithi186 ceph-mon[126480]: pgmap v14058: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 477 KiB/s wr, 11 op/s 2023-05-08T11:01:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:01:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:56 smithi133 ceph-mon[125939]: pgmap v14058: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 477 KiB/s wr, 11 op/s 2023-05-08T11:01:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:01:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:56 smithi096 ceph-mon[124666]: pgmap v14058: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 477 KiB/s wr, 11 op/s 2023-05-08T11:01:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:01:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:57 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:01:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:01:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:01:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:57 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:01:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:01:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:01:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:57 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:01:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:01:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:01:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:58 smithi186 ceph-mon[126480]: pgmap v14059: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 477 KiB/s wr, 7 op/s 2023-05-08T11:01:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:58 smithi133 ceph-mon[125939]: pgmap v14059: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 477 KiB/s wr, 7 op/s 2023-05-08T11:01:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:58 smithi096 ceph-mon[124666]: pgmap v14059: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 477 KiB/s wr, 7 op/s 2023-05-08T11:02:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26258.167213 secs 2023-05-08T11:02:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:01:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26258.723584 secs 2023-05-08T11:02:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26258.167213 secs 2023-05-08T11:02:00.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:01:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26258.723584 secs 2023-05-08T11:02:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26258.167213 secs 2023-05-08T11:02:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:01:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26258.723584 secs 2023-05-08T11:02:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:00 smithi186 ceph-mon[126480]: pgmap v14060: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 829 KiB/s rd, 815 KiB/s wr, 14 op/s 2023-05-08T11:02:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:02:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:00 smithi133 ceph-mon[125939]: pgmap v14060: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 829 KiB/s rd, 815 KiB/s wr, 14 op/s 2023-05-08T11:02:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:02:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:00 smithi096 ceph-mon[124666]: pgmap v14060: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 829 KiB/s rd, 815 KiB/s wr, 14 op/s 2023-05-08T11:02:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:02:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:02:02.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:02:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:02:02.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:02:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:02:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:02:03.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:02 smithi186 ceph-mon[126480]: pgmap v14061: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 642 KiB/s rd, 630 KiB/s wr, 10 op/s 2023-05-08T11:02:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:02 smithi133 ceph-mon[125939]: pgmap v14061: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 642 KiB/s rd, 630 KiB/s wr, 10 op/s 2023-05-08T11:02:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:02 smithi096 ceph-mon[124666]: pgmap v14061: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 642 KiB/s rd, 630 KiB/s wr, 10 op/s 2023-05-08T11:02:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26263.167319 secs 2023-05-08T11:02:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:04 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:02:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:04 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:02:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:04 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:02:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:04 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:02:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:04 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:02:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:04 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:02:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:04 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:02:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:04 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:02:04.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:04 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:02:04.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:04 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:02:04.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:04 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:02:04.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:04 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:02:04.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:04 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:02:04.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:04 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:02:04.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:04 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:02:04.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:04 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:02:04.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:04 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:02:04.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:04 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:02:04.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:04 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:02:04.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:04 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:02:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26263.167319 secs 2023-05-08T11:02:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:04 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:02:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:04 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:02:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:04 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:02:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:04 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:02:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:04 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:02:04.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:04 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:02:04.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:04 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:02:04.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:04 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:02:04.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:04 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:02:04.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:04 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:02:04.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:04 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:02:04.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:04 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:02:04.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:04 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:02:04.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:04 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:02:04.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:04 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:02:04.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:04 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:02:04.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:04 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:02:04.759 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:04 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:02:04.759 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:04 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:02:04.759 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:04 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:02:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26263.167319 secs 2023-05-08T11:02:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:04 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:02:04.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:04 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:02:04.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:04 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:02:04.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:04 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:02:04.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:04 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:02:04.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:04 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:02:04.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:04 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:02:04.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:04 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:02:04.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:04 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:02:04.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:04 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:02:04.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:04 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:02:04.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:04 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:02:04.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:04 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:02:04.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:04 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:02:04.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:04 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:02:04.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:04 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:02:04.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:04 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:02:04.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:04 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:02:04.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:04 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:02:04.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:04 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:02:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:05 smithi133 ceph-mon[125939]: pgmap v14062: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 642 KiB/s rd, 630 KiB/s wr, 10 op/s 2023-05-08T11:02:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:05 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi133 to 192.8M 2023-05-08T11:02:05.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:05 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi186 to 184.7M 2023-05-08T11:02:05.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:05 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi133 to 202262761: error parsing value: Value '202262761' is below minimum 939524096 2023-05-08T11:02:05.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:05 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi186 to 193690030: error parsing value: Value '193690030' is below minimum 939524096 2023-05-08T11:02:05.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:05 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:02:05.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:05 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T11:02:05.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:05 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T11:02:05.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:05 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:02:05.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:05 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:02:05.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:02:05.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:02:05.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:02:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:05 smithi096 ceph-mon[124666]: pgmap v14062: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 642 KiB/s rd, 630 KiB/s wr, 10 op/s 2023-05-08T11:02:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:05 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi133 to 192.8M 2023-05-08T11:02:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:05 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi186 to 184.7M 2023-05-08T11:02:05.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:05 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi133 to 202262761: error parsing value: Value '202262761' is below minimum 939524096 2023-05-08T11:02:05.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:05 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi186 to 193690030: error parsing value: Value '193690030' is below minimum 939524096 2023-05-08T11:02:05.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:05 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:02:05.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:05 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T11:02:05.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:05 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T11:02:05.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:05 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:02:05.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:05 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:02:05.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:02:05.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:02:05.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:02:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:05 smithi186 ceph-mon[126480]: pgmap v14062: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 642 KiB/s rd, 630 KiB/s wr, 10 op/s 2023-05-08T11:02:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:05 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi133 to 192.8M 2023-05-08T11:02:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:05 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi186 to 184.7M 2023-05-08T11:02:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:05 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi133 to 202262761: error parsing value: Value '202262761' is below minimum 939524096 2023-05-08T11:02:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:05 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi186 to 193690030: error parsing value: Value '193690030' is below minimum 939524096 2023-05-08T11:02:05.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:05 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:02:05.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:05 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T11:02:05.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:05 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T11:02:05.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:05 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:02:05.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:05 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:02:05.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:02:05.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:02:05.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:02:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:07 smithi096 ceph-mon[124666]: pgmap v14063: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 768 KiB/s rd, 769 KiB/s wr, 17 op/s 2023-05-08T11:02:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:07 smithi186 ceph-mon[126480]: pgmap v14063: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 768 KiB/s rd, 769 KiB/s wr, 17 op/s 2023-05-08T11:02:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:07 smithi133 ceph-mon[125939]: pgmap v14063: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 768 KiB/s rd, 769 KiB/s wr, 17 op/s 2023-05-08T11:02:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:09 smithi096 ceph-mon[124666]: pgmap v14064: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 476 KiB/s rd, 477 KiB/s wr, 12 op/s 2023-05-08T11:02:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26268.167396 secs 2023-05-08T11:02:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26268.723768 secs 2023-05-08T11:02:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:09 smithi186 ceph-mon[126480]: pgmap v14064: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 476 KiB/s rd, 477 KiB/s wr, 12 op/s 2023-05-08T11:02:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26268.167396 secs 2023-05-08T11:02:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26268.723768 secs 2023-05-08T11:02:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:09 smithi133 ceph-mon[125939]: pgmap v14064: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 476 KiB/s rd, 477 KiB/s wr, 12 op/s 2023-05-08T11:02:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26268.167396 secs 2023-05-08T11:02:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26268.723768 secs 2023-05-08T11:02:11.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:10 smithi186 ceph-mon[126480]: pgmap v14065: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 844 KiB/s rd, 867 KiB/s wr, 31 op/s 2023-05-08T11:02:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26270.010925 secs 2023-05-08T11:02:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:10 smithi133 ceph-mon[125939]: pgmap v14065: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 844 KiB/s rd, 867 KiB/s wr, 31 op/s 2023-05-08T11:02:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26270.010925 secs 2023-05-08T11:02:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:10 smithi096 ceph-mon[124666]: pgmap v14065: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 844 KiB/s rd, 867 KiB/s wr, 31 op/s 2023-05-08T11:02:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26270.010925 secs 2023-05-08T11:02:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:11 smithi186 ceph-mon[126480]: osdmap e956: 12 total, 12 up, 12 in 2023-05-08T11:02:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:11 smithi133 ceph-mon[125939]: osdmap e956: 12 total, 12 up, 12 in 2023-05-08T11:02:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:11 smithi096 ceph-mon[124666]: osdmap e956: 12 total, 12 up, 12 in 2023-05-08T11:02:13.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:12 smithi186 ceph-mon[126480]: pgmap v14067: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 593 KiB/s rd, 634 KiB/s wr, 29 op/s 2023-05-08T11:02:13.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:12 smithi133 ceph-mon[125939]: pgmap v14067: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 593 KiB/s rd, 634 KiB/s wr, 29 op/s 2023-05-08T11:02:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:12 smithi096 ceph-mon[124666]: pgmap v14067: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 593 KiB/s rd, 634 KiB/s wr, 29 op/s 2023-05-08T11:02:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:13 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:02:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:02:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:02:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:13 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:02:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:13 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:02:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:02:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:02:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:13 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:02:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:13 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:02:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:02:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:02:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:13 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:02:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26273.167523 secs 2023-05-08T11:02:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:14 smithi186 ceph-mon[126480]: pgmap v14068: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 593 KiB/s rd, 634 KiB/s wr, 29 op/s 2023-05-08T11:02:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26273.723905 secs 2023-05-08T11:02:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26273.167523 secs 2023-05-08T11:02:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:14 smithi133 ceph-mon[125939]: pgmap v14068: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 593 KiB/s rd, 634 KiB/s wr, 29 op/s 2023-05-08T11:02:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26273.723905 secs 2023-05-08T11:02:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26273.167523 secs 2023-05-08T11:02:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:14 smithi096 ceph-mon[124666]: pgmap v14068: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 593 KiB/s rd, 634 KiB/s wr, 29 op/s 2023-05-08T11:02:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26273.723905 secs 2023-05-08T11:02:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26275.011086 secs 2023-05-08T11:02:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26275.011086 secs 2023-05-08T11:02:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26275.011086 secs 2023-05-08T11:02:17.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:16 smithi186 ceph-mon[126480]: pgmap v14069: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 569 KiB/s rd, 593 KiB/s wr, 26 op/s 2023-05-08T11:02:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:16 smithi133 ceph-mon[125939]: pgmap v14069: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 569 KiB/s rd, 593 KiB/s wr, 26 op/s 2023-05-08T11:02:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:16 smithi096 ceph-mon[124666]: pgmap v14069: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 569 KiB/s rd, 593 KiB/s wr, 26 op/s 2023-05-08T11:02:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:18 smithi133 ceph-mon[125939]: pgmap v14070: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 569 KiB/s rd, 593 KiB/s wr, 26 op/s 2023-05-08T11:02:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:18 smithi096 ceph-mon[124666]: pgmap v14070: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 569 KiB/s rd, 593 KiB/s wr, 26 op/s 2023-05-08T11:02:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:18 smithi186 ceph-mon[126480]: pgmap v14070: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 569 KiB/s rd, 593 KiB/s wr, 26 op/s 2023-05-08T11:02:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26278.167618 secs 2023-05-08T11:02:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26278.724036 secs 2023-05-08T11:02:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:19 smithi133 ceph-mon[125939]: osdmap e957: 12 total, 12 up, 12 in 2023-05-08T11:02:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26278.167618 secs 2023-05-08T11:02:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26278.724036 secs 2023-05-08T11:02:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:19 smithi096 ceph-mon[124666]: osdmap e957: 12 total, 12 up, 12 in 2023-05-08T11:02:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26278.167618 secs 2023-05-08T11:02:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26278.724036 secs 2023-05-08T11:02:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:19 smithi186 ceph-mon[126480]: osdmap e957: 12 total, 12 up, 12 in 2023-05-08T11:02:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:20 smithi133 ceph-mon[125939]: pgmap v14072: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 237 KiB/s wr, 9 op/s 2023-05-08T11:02:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26280.011218 secs 2023-05-08T11:02:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:20 smithi096 ceph-mon[124666]: pgmap v14072: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 237 KiB/s wr, 9 op/s 2023-05-08T11:02:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26280.011218 secs 2023-05-08T11:02:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:20 smithi186 ceph-mon[126480]: pgmap v14072: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 237 KiB/s wr, 9 op/s 2023-05-08T11:02:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26280.011218 secs 2023-05-08T11:02:23.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:22 smithi133 ceph-mon[125939]: pgmap v14073: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 215 KiB/s wr, 8 op/s 2023-05-08T11:02:23.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:22 smithi096 ceph-mon[124666]: pgmap v14073: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 215 KiB/s wr, 8 op/s 2023-05-08T11:02:23.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:22 smithi186 ceph-mon[126480]: pgmap v14073: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 215 KiB/s wr, 8 op/s 2023-05-08T11:02:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26283.167755 secs 2023-05-08T11:02:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:24 smithi133 ceph-mon[125939]: pgmap v14074: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 215 KiB/s wr, 8 op/s 2023-05-08T11:02:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26283.724180 secs 2023-05-08T11:02:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26283.167755 secs 2023-05-08T11:02:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:24 smithi096 ceph-mon[124666]: pgmap v14074: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 215 KiB/s wr, 8 op/s 2023-05-08T11:02:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26283.724180 secs 2023-05-08T11:02:25.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26283.167755 secs 2023-05-08T11:02:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:24 smithi186 ceph-mon[126480]: pgmap v14074: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 215 KiB/s wr, 8 op/s 2023-05-08T11:02:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26283.724180 secs 2023-05-08T11:02:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26285.011343 secs 2023-05-08T11:02:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26285.011343 secs 2023-05-08T11:02:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26285.011343 secs 2023-05-08T11:02:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:26 smithi133 ceph-mon[125939]: pgmap v14075: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 89 KiB/s wr, 7 op/s 2023-05-08T11:02:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:26 smithi096 ceph-mon[124666]: pgmap v14075: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 89 KiB/s wr, 7 op/s 2023-05-08T11:02:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:26 smithi186 ceph-mon[126480]: pgmap v14075: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 89 KiB/s wr, 7 op/s 2023-05-08T11:02:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:28 smithi133 ceph-mon[125939]: pgmap v14076: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 89 KiB/s wr, 7 op/s 2023-05-08T11:02:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:28 smithi096 ceph-mon[124666]: pgmap v14076: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 89 KiB/s wr, 7 op/s 2023-05-08T11:02:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:28 smithi186 ceph-mon[126480]: pgmap v14076: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 89 KiB/s wr, 7 op/s 2023-05-08T11:02:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26288.167869 secs 2023-05-08T11:02:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26288.724276 secs 2023-05-08T11:02:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26288.167869 secs 2023-05-08T11:02:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26288.724276 secs 2023-05-08T11:02:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26288.167869 secs 2023-05-08T11:02:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26288.724276 secs 2023-05-08T11:02:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:30 smithi133 ceph-mon[125939]: pgmap v14077: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2023-05-08T11:02:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26290.011462 secs 2023-05-08T11:02:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:30 smithi096 ceph-mon[124666]: pgmap v14077: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2023-05-08T11:02:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26290.011462 secs 2023-05-08T11:02:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:30 smithi186 ceph-mon[126480]: pgmap v14077: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2023-05-08T11:02:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26290.011462 secs 2023-05-08T11:02:33.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:32 smithi133 ceph-mon[125939]: pgmap v14078: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T11:02:33.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:32 smithi096 ceph-mon[124666]: pgmap v14078: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T11:02:33.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:32 smithi186 ceph-mon[126480]: pgmap v14078: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T11:02:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26293.167959 secs 2023-05-08T11:02:35.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:34 smithi133 ceph-mon[125939]: pgmap v14079: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T11:02:35.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26293.724419 secs 2023-05-08T11:02:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26293.167959 secs 2023-05-08T11:02:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:34 smithi096 ceph-mon[124666]: pgmap v14079: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T11:02:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26293.724419 secs 2023-05-08T11:02:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26293.167959 secs 2023-05-08T11:02:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:34 smithi186 ceph-mon[126480]: pgmap v14079: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T11:02:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26293.724419 secs 2023-05-08T11:02:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26295.011600 secs 2023-05-08T11:02:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26295.011600 secs 2023-05-08T11:02:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26295.011600 secs 2023-05-08T11:02:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:36 smithi133 ceph-mon[125939]: pgmap v14080: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 9 op/s 2023-05-08T11:02:37.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:36 smithi096 ceph-mon[124666]: pgmap v14080: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 9 op/s 2023-05-08T11:02:37.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:36 smithi186 ceph-mon[126480]: pgmap v14080: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 9 op/s 2023-05-08T11:02:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:38 smithi133 ceph-mon[125939]: pgmap v14081: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 6 op/s 2023-05-08T11:02:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:38 smithi096 ceph-mon[124666]: pgmap v14081: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 6 op/s 2023-05-08T11:02:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:38 smithi186 ceph-mon[126480]: pgmap v14081: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 6 op/s 2023-05-08T11:02:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26298.168074 secs 2023-05-08T11:02:40.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26298.724531 secs 2023-05-08T11:02:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26298.168074 secs 2023-05-08T11:02:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26298.724531 secs 2023-05-08T11:02:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26298.168074 secs 2023-05-08T11:02:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26298.724531 secs 2023-05-08T11:02:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:40 smithi133 ceph-mon[125939]: pgmap v14082: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 188 KiB/s wr, 10 op/s 2023-05-08T11:02:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26300.011740 secs 2023-05-08T11:02:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:40 smithi096 ceph-mon[124666]: pgmap v14082: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 188 KiB/s wr, 10 op/s 2023-05-08T11:02:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26300.011740 secs 2023-05-08T11:02:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:40 smithi186 ceph-mon[126480]: pgmap v14082: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 188 KiB/s wr, 10 op/s 2023-05-08T11:02:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26300.011740 secs 2023-05-08T11:02:43.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:42 smithi133 ceph-mon[125939]: pgmap v14083: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 188 KiB/s wr, 7 op/s 2023-05-08T11:02:43.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:42 smithi096 ceph-mon[124666]: pgmap v14083: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 188 KiB/s wr, 7 op/s 2023-05-08T11:02:43.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:42 smithi186 ceph-mon[126480]: pgmap v14083: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 188 KiB/s wr, 7 op/s 2023-05-08T11:02:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26303.168192 secs 2023-05-08T11:02:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:44 smithi133 ceph-mon[125939]: pgmap v14084: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 188 KiB/s wr, 7 op/s 2023-05-08T11:02:45.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26303.724664 secs 2023-05-08T11:02:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26303.168192 secs 2023-05-08T11:02:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:44 smithi096 ceph-mon[124666]: pgmap v14084: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 188 KiB/s wr, 7 op/s 2023-05-08T11:02:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26303.724664 secs 2023-05-08T11:02:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26303.168192 secs 2023-05-08T11:02:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:44 smithi186 ceph-mon[126480]: pgmap v14084: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 188 KiB/s wr, 7 op/s 2023-05-08T11:02:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26303.724664 secs 2023-05-08T11:02:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:46 smithi133 ceph-mon[125939]: pgmap v14085: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 189 KiB/s wr, 10 op/s 2023-05-08T11:02:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:46 smithi096 ceph-mon[124666]: pgmap v14085: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 189 KiB/s wr, 10 op/s 2023-05-08T11:02:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:46 smithi186 ceph-mon[126480]: pgmap v14085: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 189 KiB/s wr, 10 op/s 2023-05-08T11:02:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:02:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:02:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:02:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:48 smithi096 ceph-mon[124666]: pgmap v14086: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 188 KiB/s wr, 7 op/s 2023-05-08T11:02:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:48 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:02:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:02:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:02:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:48 smithi186 ceph-mon[126480]: pgmap v14086: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 188 KiB/s wr, 7 op/s 2023-05-08T11:02:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:48 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:02:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:02:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:02:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:48 smithi133 ceph-mon[125939]: pgmap v14086: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 188 KiB/s wr, 7 op/s 2023-05-08T11:02:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:48 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:02:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:02:49.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:02:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26308.168287 secs 2023-05-08T11:02:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26308.724731 secs 2023-05-08T11:02:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26308.168287 secs 2023-05-08T11:02:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26308.724731 secs 2023-05-08T11:02:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26308.168287 secs 2023-05-08T11:02:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26308.724731 secs 2023-05-08T11:02:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:50 smithi096 ceph-mon[124666]: pgmap v14087: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 329 KiB/s rd, 295 KiB/s wr, 10 op/s 2023-05-08T11:02:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:50 smithi186 ceph-mon[126480]: pgmap v14087: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 329 KiB/s rd, 295 KiB/s wr, 10 op/s 2023-05-08T11:02:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:50 smithi133 ceph-mon[125939]: pgmap v14087: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 329 KiB/s rd, 295 KiB/s wr, 10 op/s 2023-05-08T11:02:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:52 smithi096 ceph-mon[124666]: pgmap v14088: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 108 KiB/s wr, 6 op/s 2023-05-08T11:02:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:52 smithi186 ceph-mon[126480]: pgmap v14088: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 108 KiB/s wr, 6 op/s 2023-05-08T11:02:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:52 smithi133 ceph-mon[125939]: pgmap v14088: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 108 KiB/s wr, 6 op/s 2023-05-08T11:02:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26313.168408 secs 2023-05-08T11:02:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:54 smithi096 ceph-mon[124666]: pgmap v14089: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 108 KiB/s wr, 6 op/s 2023-05-08T11:02:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26313.724820 secs 2023-05-08T11:02:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26313.168408 secs 2023-05-08T11:02:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:54 smithi186 ceph-mon[126480]: pgmap v14089: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 108 KiB/s wr, 6 op/s 2023-05-08T11:02:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26313.724820 secs 2023-05-08T11:02:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26313.168408 secs 2023-05-08T11:02:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:55 smithi133 ceph-mon[125939]: pgmap v14089: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 108 KiB/s wr, 6 op/s 2023-05-08T11:02:55.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26313.724820 secs 2023-05-08T11:02:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:57 smithi096 ceph-mon[124666]: pgmap v14090: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 835 KiB/s rd, 569 KiB/s wr, 11 op/s 2023-05-08T11:02:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:57 smithi186 ceph-mon[126480]: pgmap v14090: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 835 KiB/s rd, 569 KiB/s wr, 11 op/s 2023-05-08T11:02:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:57 smithi133 ceph-mon[125939]: pgmap v14090: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 835 KiB/s rd, 569 KiB/s wr, 11 op/s 2023-05-08T11:02:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:02:59 smithi186 ceph-mon[126480]: pgmap v14091: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 647 KiB/s rd, 569 KiB/s wr, 8 op/s 2023-05-08T11:02:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:02:59 smithi133 ceph-mon[125939]: pgmap v14091: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 647 KiB/s rd, 569 KiB/s wr, 8 op/s 2023-05-08T11:02:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:02:59 smithi096 ceph-mon[124666]: pgmap v14091: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 647 KiB/s rd, 569 KiB/s wr, 8 op/s 2023-05-08T11:03:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26318.168550 secs 2023-05-08T11:03:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26318.724934 secs 2023-05-08T11:03:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26318.168550 secs 2023-05-08T11:03:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26318.724934 secs 2023-05-08T11:03:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26318.168550 secs 2023-05-08T11:03:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26318.724934 secs 2023-05-08T11:03:01.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:01 smithi186 ceph-mon[126480]: pgmap v14092: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 790 KiB/s rd, 815 KiB/s wr, 14 op/s 2023-05-08T11:03:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:01 smithi133 ceph-mon[125939]: pgmap v14092: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 790 KiB/s rd, 815 KiB/s wr, 14 op/s 2023-05-08T11:03:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:01 smithi096 ceph-mon[124666]: pgmap v14092: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 790 KiB/s rd, 815 KiB/s wr, 14 op/s 2023-05-08T11:03:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:03 smithi186 ceph-mon[126480]: pgmap v14093: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 651 KiB/s rd, 708 KiB/s wr, 11 op/s 2023-05-08T11:03:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:03 smithi133 ceph-mon[125939]: pgmap v14093: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 651 KiB/s rd, 708 KiB/s wr, 11 op/s 2023-05-08T11:03:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:03 smithi096 ceph-mon[124666]: pgmap v14093: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 651 KiB/s rd, 708 KiB/s wr, 11 op/s 2023-05-08T11:03:05.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26323.168656 secs 2023-05-08T11:03:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:05 smithi186 ceph-mon[126480]: pgmap v14094: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 651 KiB/s rd, 708 KiB/s wr, 10 op/s 2023-05-08T11:03:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:05 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:03:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:05 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:03:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:05 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:03:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:05 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:03:05.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:05 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:03:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26323.168656 secs 2023-05-08T11:03:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:05 smithi133 ceph-mon[125939]: pgmap v14094: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 651 KiB/s rd, 708 KiB/s wr, 10 op/s 2023-05-08T11:03:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:05 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:03:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:05 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:03:05.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:05 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:03:05.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:05 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:03:05.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:05 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:03:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26323.168656 secs 2023-05-08T11:03:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:05 smithi096 ceph-mon[124666]: pgmap v14094: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 651 KiB/s rd, 708 KiB/s wr, 10 op/s 2023-05-08T11:03:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:05 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:03:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:05 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:03:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:05 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:03:05.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:05 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:03:05.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:05 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:03:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:06 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:03:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:06 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T11:03:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:06 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T11:03:06.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:06 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:03:06.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:06 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:03:06.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:03:06.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:03:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:06 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:03:06.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:06 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T11:03:06.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:06 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T11:03:06.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:06 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:03:06.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:06 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:03:06.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:03:06.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:03:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:06 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:03:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:06 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T11:03:06.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:06 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T11:03:06.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:06 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:03:06.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:06 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:03:06.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:03:06.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:03:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:07 smithi186 ceph-mon[126480]: pgmap v14095: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 986 KiB/s rd, 941 KiB/s wr, 17 op/s 2023-05-08T11:03:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:07 smithi133 ceph-mon[125939]: pgmap v14095: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 986 KiB/s rd, 941 KiB/s wr, 17 op/s 2023-05-08T11:03:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:07 smithi096 ceph-mon[124666]: pgmap v14095: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 986 KiB/s rd, 941 KiB/s wr, 17 op/s 2023-05-08T11:03:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:09 smithi186 ceph-mon[126480]: pgmap v14096: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 480 KiB/s wr, 12 op/s 2023-05-08T11:03:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:09 smithi133 ceph-mon[125939]: pgmap v14096: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 480 KiB/s wr, 12 op/s 2023-05-08T11:03:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:09 smithi096 ceph-mon[124666]: pgmap v14096: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 480 KiB/s wr, 12 op/s 2023-05-08T11:03:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26328.168781 secs 2023-05-08T11:03:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26328.725185 secs 2023-05-08T11:03:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26328.168781 secs 2023-05-08T11:03:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26328.725185 secs 2023-05-08T11:03:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26328.168781 secs 2023-05-08T11:03:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26328.725185 secs 2023-05-08T11:03:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:11 smithi186 ceph-mon[126480]: pgmap v14097: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 688 KiB/s wr, 30 op/s 2023-05-08T11:03:11.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26330.012444 secs 2023-05-08T11:03:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:11 smithi133 ceph-mon[125939]: pgmap v14097: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 688 KiB/s wr, 30 op/s 2023-05-08T11:03:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26330.012444 secs 2023-05-08T11:03:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:11 smithi096 ceph-mon[124666]: pgmap v14097: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 688 KiB/s wr, 30 op/s 2023-05-08T11:03:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26330.012444 secs 2023-05-08T11:03:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:12 smithi186 ceph-mon[126480]: osdmap e958: 12 total, 12 up, 12 in 2023-05-08T11:03:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:12 smithi133 ceph-mon[125939]: osdmap e958: 12 total, 12 up, 12 in 2023-05-08T11:03:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:12 smithi096 ceph-mon[124666]: osdmap e958: 12 total, 12 up, 12 in 2023-05-08T11:03:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:13 smithi186 ceph-mon[126480]: pgmap v14099: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 529 KiB/s wr, 29 op/s 2023-05-08T11:03:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:13 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:03:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:03:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:03:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:13 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:03:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:13 smithi133 ceph-mon[125939]: pgmap v14099: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 529 KiB/s wr, 29 op/s 2023-05-08T11:03:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:13 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:03:13.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:03:13.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:03:13.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:13 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:03:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:13 smithi096 ceph-mon[124666]: pgmap v14099: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 529 KiB/s wr, 29 op/s 2023-05-08T11:03:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:13 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:03:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:03:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:03:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:13 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:03:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26333.168887 secs 2023-05-08T11:03:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:15 smithi186 ceph-mon[126480]: pgmap v14100: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 529 KiB/s wr, 29 op/s 2023-05-08T11:03:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26333.725302 secs 2023-05-08T11:03:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26333.168887 secs 2023-05-08T11:03:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:15 smithi133 ceph-mon[125939]: pgmap v14100: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 529 KiB/s wr, 29 op/s 2023-05-08T11:03:15.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26333.725302 secs 2023-05-08T11:03:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26333.168887 secs 2023-05-08T11:03:15.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:15 smithi096 ceph-mon[124666]: pgmap v14100: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 529 KiB/s wr, 29 op/s 2023-05-08T11:03:15.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26333.725302 secs 2023-05-08T11:03:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26335.012579 secs 2023-05-08T11:03:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26335.012579 secs 2023-05-08T11:03:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26335.012579 secs 2023-05-08T11:03:17.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:17 smithi186 ceph-mon[126480]: pgmap v14101: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 489 KiB/s wr, 26 op/s 2023-05-08T11:03:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:17 smithi133 ceph-mon[125939]: pgmap v14101: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 489 KiB/s wr, 26 op/s 2023-05-08T11:03:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:17 smithi096 ceph-mon[124666]: pgmap v14101: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 489 KiB/s wr, 26 op/s 2023-05-08T11:03:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:19 smithi186 ceph-mon[126480]: pgmap v14102: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 489 KiB/s wr, 26 op/s 2023-05-08T11:03:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26338.169009 secs 2023-05-08T11:03:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:19 smithi133 ceph-mon[125939]: pgmap v14102: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 489 KiB/s wr, 26 op/s 2023-05-08T11:03:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26338.169009 secs 2023-05-08T11:03:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:19 smithi096 ceph-mon[124666]: pgmap v14102: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 489 KiB/s wr, 26 op/s 2023-05-08T11:03:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26338.169009 secs 2023-05-08T11:03:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26338.725379 secs 2023-05-08T11:03:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:20 smithi186 ceph-mon[126480]: osdmap e959: 12 total, 12 up, 12 in 2023-05-08T11:03:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26338.725379 secs 2023-05-08T11:03:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:20 smithi133 ceph-mon[125939]: osdmap e959: 12 total, 12 up, 12 in 2023-05-08T11:03:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26338.725379 secs 2023-05-08T11:03:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:20 smithi096 ceph-mon[124666]: osdmap e959: 12 total, 12 up, 12 in 2023-05-08T11:03:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:21 smithi186 ceph-mon[126480]: pgmap v14104: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 527 KiB/s rd, 371 KiB/s wr, 9 op/s 2023-05-08T11:03:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26340.012704 secs 2023-05-08T11:03:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:21 smithi133 ceph-mon[125939]: pgmap v14104: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 527 KiB/s rd, 371 KiB/s wr, 9 op/s 2023-05-08T11:03:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26340.012704 secs 2023-05-08T11:03:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:21 smithi096 ceph-mon[124666]: pgmap v14104: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 527 KiB/s rd, 371 KiB/s wr, 9 op/s 2023-05-08T11:03:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26340.012704 secs 2023-05-08T11:03:23.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:23 smithi186 ceph-mon[126480]: pgmap v14105: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 328 KiB/s wr, 8 op/s 2023-05-08T11:03:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:23 smithi133 ceph-mon[125939]: pgmap v14105: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 328 KiB/s wr, 8 op/s 2023-05-08T11:03:23.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:23 smithi096 ceph-mon[124666]: pgmap v14105: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 328 KiB/s wr, 8 op/s 2023-05-08T11:03:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26343.169127 secs 2023-05-08T11:03:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26343.169127 secs 2023-05-08T11:03:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26343.169127 secs 2023-05-08T11:03:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:25 smithi186 ceph-mon[126480]: pgmap v14106: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 328 KiB/s wr, 8 op/s 2023-05-08T11:03:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26343.725496 secs 2023-05-08T11:03:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:25 smithi133 ceph-mon[125939]: pgmap v14106: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 328 KiB/s wr, 8 op/s 2023-05-08T11:03:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26343.725496 secs 2023-05-08T11:03:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:25 smithi096 ceph-mon[124666]: pgmap v14106: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 328 KiB/s wr, 8 op/s 2023-05-08T11:03:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26343.725496 secs 2023-05-08T11:03:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26345.012799 secs 2023-05-08T11:03:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26345.012799 secs 2023-05-08T11:03:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26345.012799 secs 2023-05-08T11:03:27.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:27 smithi186 ceph-mon[126480]: pgmap v14107: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 89 KiB/s wr, 6 op/s 2023-05-08T11:03:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:27 smithi133 ceph-mon[125939]: pgmap v14107: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 89 KiB/s wr, 6 op/s 2023-05-08T11:03:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:27 smithi096 ceph-mon[124666]: pgmap v14107: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 89 KiB/s wr, 6 op/s 2023-05-08T11:03:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:29 smithi186 ceph-mon[126480]: pgmap v14108: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 89 KiB/s wr, 6 op/s 2023-05-08T11:03:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26348.169267 secs 2023-05-08T11:03:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:29 smithi133 ceph-mon[125939]: pgmap v14108: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 89 KiB/s wr, 6 op/s 2023-05-08T11:03:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26348.169267 secs 2023-05-08T11:03:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:29 smithi096 ceph-mon[124666]: pgmap v14108: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 89 KiB/s wr, 6 op/s 2023-05-08T11:03:29.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26348.169267 secs 2023-05-08T11:03:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26348.725609 secs 2023-05-08T11:03:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26348.725609 secs 2023-05-08T11:03:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26348.725609 secs 2023-05-08T11:03:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:31 smithi186 ceph-mon[126480]: pgmap v14109: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T11:03:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26350.012949 secs 2023-05-08T11:03:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:31 smithi133 ceph-mon[125939]: pgmap v14109: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T11:03:31.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26350.012949 secs 2023-05-08T11:03:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:31 smithi096 ceph-mon[124666]: pgmap v14109: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T11:03:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26350.012949 secs 2023-05-08T11:03:33.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:33 smithi186 ceph-mon[126480]: pgmap v14110: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T11:03:33.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:33 smithi133 ceph-mon[125939]: pgmap v14110: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T11:03:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:33 smithi096 ceph-mon[124666]: pgmap v14110: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T11:03:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26353.169384 secs 2023-05-08T11:03:34.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26353.169384 secs 2023-05-08T11:03:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26353.169384 secs 2023-05-08T11:03:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:35 smithi186 ceph-mon[126480]: pgmap v14111: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T11:03:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26353.725743 secs 2023-05-08T11:03:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:35 smithi133 ceph-mon[125939]: pgmap v14111: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T11:03:35.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26353.725743 secs 2023-05-08T11:03:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:35 smithi096 ceph-mon[124666]: pgmap v14111: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T11:03:35.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26353.725743 secs 2023-05-08T11:03:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26355.013072 secs 2023-05-08T11:03:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26355.013072 secs 2023-05-08T11:03:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26355.013072 secs 2023-05-08T11:03:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:37 smithi133 ceph-mon[125939]: pgmap v14112: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T11:03:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:37 smithi096 ceph-mon[124666]: pgmap v14112: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T11:03:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:37 smithi186 ceph-mon[126480]: pgmap v14112: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T11:03:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:39 smithi133 ceph-mon[125939]: pgmap v14113: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T11:03:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26358.169446 secs 2023-05-08T11:03:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:39 smithi096 ceph-mon[124666]: pgmap v14113: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T11:03:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26358.169446 secs 2023-05-08T11:03:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:39 smithi186 ceph-mon[126480]: pgmap v14113: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T11:03:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26358.169446 secs 2023-05-08T11:03:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26358.725834 secs 2023-05-08T11:03:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26358.725834 secs 2023-05-08T11:03:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26358.725834 secs 2023-05-08T11:03:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:41 smithi133 ceph-mon[125939]: pgmap v14114: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 90 KiB/s wr, 9 op/s 2023-05-08T11:03:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26360.013189 secs 2023-05-08T11:03:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:41 smithi096 ceph-mon[124666]: pgmap v14114: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 90 KiB/s wr, 9 op/s 2023-05-08T11:03:41.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26360.013189 secs 2023-05-08T11:03:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:41 smithi186 ceph-mon[126480]: pgmap v14114: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 90 KiB/s wr, 9 op/s 2023-05-08T11:03:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26360.013189 secs 2023-05-08T11:03:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:43 smithi133 ceph-mon[125939]: pgmap v14115: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 90 KiB/s wr, 6 op/s 2023-05-08T11:03:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:43 smithi096 ceph-mon[124666]: pgmap v14115: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 90 KiB/s wr, 6 op/s 2023-05-08T11:03:43.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:43 smithi186 ceph-mon[126480]: pgmap v14115: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 90 KiB/s wr, 6 op/s 2023-05-08T11:03:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26363.169557 secs 2023-05-08T11:03:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26363.169557 secs 2023-05-08T11:03:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26363.169557 secs 2023-05-08T11:03:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:45 smithi133 ceph-mon[125939]: pgmap v14116: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 90 KiB/s wr, 6 op/s 2023-05-08T11:03:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26363.725969 secs 2023-05-08T11:03:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:45 smithi096 ceph-mon[124666]: pgmap v14116: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 90 KiB/s wr, 6 op/s 2023-05-08T11:03:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26363.725969 secs 2023-05-08T11:03:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:45 smithi186 ceph-mon[126480]: pgmap v14116: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 90 KiB/s wr, 6 op/s 2023-05-08T11:03:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26363.725969 secs 2023-05-08T11:03:47.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:47 smithi133 ceph-mon[125939]: pgmap v14117: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 370 KiB/s wr, 10 op/s 2023-05-08T11:03:47.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:47 smithi096 ceph-mon[124666]: pgmap v14117: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 370 KiB/s wr, 10 op/s 2023-05-08T11:03:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:47 smithi186 ceph-mon[126480]: pgmap v14117: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 370 KiB/s wr, 10 op/s 2023-05-08T11:03:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:03:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:03:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:03:49.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:49 smithi133 ceph-mon[125939]: pgmap v14118: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 370 KiB/s wr, 7 op/s 2023-05-08T11:03:49.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:03:49.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:03:49.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:03:49.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26368.169674 secs 2023-05-08T11:03:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:49 smithi096 ceph-mon[124666]: pgmap v14118: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 370 KiB/s wr, 7 op/s 2023-05-08T11:03:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:03:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:03:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:03:49.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26368.169674 secs 2023-05-08T11:03:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:49 smithi186 ceph-mon[126480]: pgmap v14118: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 370 KiB/s wr, 7 op/s 2023-05-08T11:03:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:03:49.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:03:49.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:03:49.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26368.169674 secs 2023-05-08T11:03:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:50 smithi133 ceph-mon[125939]: pgmap v14119: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 557 KiB/s rd, 432 KiB/s wr, 12 op/s 2023-05-08T11:03:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:50 smithi096 ceph-mon[124666]: pgmap v14119: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 557 KiB/s rd, 432 KiB/s wr, 12 op/s 2023-05-08T11:03:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:50 smithi186 ceph-mon[126480]: pgmap v14119: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 557 KiB/s rd, 432 KiB/s wr, 12 op/s 2023-05-08T11:03:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:52 smithi133 ceph-mon[125939]: pgmap v14120: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 342 KiB/s wr, 8 op/s 2023-05-08T11:03:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:03:53.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:52 smithi096 ceph-mon[124666]: pgmap v14120: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 342 KiB/s wr, 8 op/s 2023-05-08T11:03:53.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:03:53.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:52 smithi186 ceph-mon[126480]: pgmap v14120: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 342 KiB/s wr, 8 op/s 2023-05-08T11:03:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:03:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:03:54.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:03:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:03:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:03:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:03:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:03:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26373.169808 secs 2023-05-08T11:03:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:54 smithi133 ceph-mon[125939]: pgmap v14121: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 342 KiB/s wr, 8 op/s 2023-05-08T11:03:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:54 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:03:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26373.169808 secs 2023-05-08T11:03:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:54 smithi096 ceph-mon[124666]: pgmap v14121: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 342 KiB/s wr, 8 op/s 2023-05-08T11:03:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:54 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:03:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26373.169808 secs 2023-05-08T11:03:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:54 smithi186 ceph-mon[126480]: pgmap v14121: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 342 KiB/s wr, 8 op/s 2023-05-08T11:03:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:54 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:03:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:56 smithi133 ceph-mon[125939]: pgmap v14122: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 812 KiB/s rd, 820 KiB/s wr, 14 op/s 2023-05-08T11:03:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:56 smithi096 ceph-mon[124666]: pgmap v14122: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 812 KiB/s rd, 820 KiB/s wr, 14 op/s 2023-05-08T11:03:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:56 smithi186 ceph-mon[126480]: pgmap v14122: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 812 KiB/s rd, 820 KiB/s wr, 14 op/s 2023-05-08T11:03:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:58 smithi133 ceph-mon[125939]: pgmap v14123: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 810 KiB/s rd, 539 KiB/s wr, 10 op/s 2023-05-08T11:03:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:58 smithi096 ceph-mon[124666]: pgmap v14123: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 810 KiB/s rd, 539 KiB/s wr, 10 op/s 2023-05-08T11:03:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:58 smithi186 ceph-mon[126480]: pgmap v14123: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 810 KiB/s rd, 539 KiB/s wr, 10 op/s 2023-05-08T11:04:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:03:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26378.169929 secs 2023-05-08T11:04:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:03:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26378.169929 secs 2023-05-08T11:04:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:03:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26378.169929 secs 2023-05-08T11:04:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:00 smithi096 ceph-mon[124666]: pgmap v14124: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 671 KiB/s wr, 16 op/s 2023-05-08T11:04:01.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:00 smithi186 ceph-mon[126480]: pgmap v14124: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 671 KiB/s wr, 16 op/s 2023-05-08T11:04:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:00 smithi133 ceph-mon[125939]: pgmap v14124: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 671 KiB/s wr, 16 op/s 2023-05-08T11:04:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:02 smithi096 ceph-mon[124666]: pgmap v14125: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 703 KiB/s rd, 609 KiB/s wr, 11 op/s 2023-05-08T11:04:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:02 smithi186 ceph-mon[126480]: pgmap v14125: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 703 KiB/s rd, 609 KiB/s wr, 11 op/s 2023-05-08T11:04:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:02 smithi133 ceph-mon[125939]: pgmap v14125: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 703 KiB/s rd, 609 KiB/s wr, 11 op/s 2023-05-08T11:04:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26383.170051 secs 2023-05-08T11:04:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:04 smithi096 ceph-mon[124666]: pgmap v14126: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 703 KiB/s rd, 609 KiB/s wr, 11 op/s 2023-05-08T11:04:05.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26383.726465 secs 2023-05-08T11:04:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26383.170051 secs 2023-05-08T11:04:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:04 smithi186 ceph-mon[126480]: pgmap v14126: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 703 KiB/s rd, 609 KiB/s wr, 11 op/s 2023-05-08T11:04:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26383.726465 secs 2023-05-08T11:04:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26383.170051 secs 2023-05-08T11:04:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:04 smithi133 ceph-mon[125939]: pgmap v14126: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 703 KiB/s rd, 609 KiB/s wr, 11 op/s 2023-05-08T11:04:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26383.726465 secs 2023-05-08T11:04:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:05 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:04:06.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:04:06.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:04:06.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:05 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:04:06.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26385.013709 secs 2023-05-08T11:04:06.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:05 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:04:06.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:05 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:04:06.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:05 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:04:06.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:05 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:04:06.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:05 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T11:04:06.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:05 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T11:04:06.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:05 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:04:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:05 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:04:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:04:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:04:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:05 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:04:06.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26385.013709 secs 2023-05-08T11:04:06.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:05 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:04:06.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:05 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:04:06.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:05 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:04:06.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:05 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:04:06.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:05 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T11:04:06.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:05 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T11:04:06.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:05 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:04:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:05 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:04:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:04:06.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:04:06.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:05 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:04:06.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26385.013709 secs 2023-05-08T11:04:06.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:05 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:04:06.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:05 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:04:06.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:05 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:04:06.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:05 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:04:06.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:05 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T11:04:06.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:05 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T11:04:06.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:05 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:04:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:07 smithi186 ceph-mon[126480]: pgmap v14127: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 837 KiB/s rd, 986 KiB/s wr, 30 op/s 2023-05-08T11:04:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:07 smithi186 ceph-mon[126480]: osdmap e960: 12 total, 12 up, 12 in 2023-05-08T11:04:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:07 smithi133 ceph-mon[125939]: pgmap v14127: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 837 KiB/s rd, 986 KiB/s wr, 30 op/s 2023-05-08T11:04:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:07 smithi133 ceph-mon[125939]: osdmap e960: 12 total, 12 up, 12 in 2023-05-08T11:04:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:07 smithi096 ceph-mon[124666]: pgmap v14127: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 837 KiB/s rd, 986 KiB/s wr, 30 op/s 2023-05-08T11:04:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:07 smithi096 ceph-mon[124666]: osdmap e960: 12 total, 12 up, 12 in 2023-05-08T11:04:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:09 smithi186 ceph-mon[126480]: pgmap v14129: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 590 KiB/s rd, 610 KiB/s wr, 29 op/s 2023-05-08T11:04:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:04:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:04:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:09 smithi133 ceph-mon[125939]: pgmap v14129: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 590 KiB/s rd, 610 KiB/s wr, 29 op/s 2023-05-08T11:04:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:04:09.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:04:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:09 smithi096 ceph-mon[124666]: pgmap v14129: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 590 KiB/s rd, 610 KiB/s wr, 29 op/s 2023-05-08T11:04:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:04:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:04:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26388.170165 secs 2023-05-08T11:04:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26388.726606 secs 2023-05-08T11:04:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26388.170165 secs 2023-05-08T11:04:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26388.726606 secs 2023-05-08T11:04:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26388.170165 secs 2023-05-08T11:04:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26388.726606 secs 2023-05-08T11:04:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:11 smithi186 ceph-mon[126480]: pgmap v14130: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 453 KiB/s wr, 27 op/s 2023-05-08T11:04:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26390.013865 secs 2023-05-08T11:04:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:11 smithi133 ceph-mon[125939]: pgmap v14130: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 453 KiB/s wr, 27 op/s 2023-05-08T11:04:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26390.013865 secs 2023-05-08T11:04:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:11 smithi096 ceph-mon[124666]: pgmap v14130: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 453 KiB/s wr, 27 op/s 2023-05-08T11:04:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26390.013865 secs 2023-05-08T11:04:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:13 smithi186 ceph-mon[126480]: pgmap v14131: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 453 KiB/s wr, 27 op/s 2023-05-08T11:04:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:13 smithi133 ceph-mon[125939]: pgmap v14131: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 453 KiB/s wr, 27 op/s 2023-05-08T11:04:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:13 smithi096 ceph-mon[124666]: pgmap v14131: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 453 KiB/s wr, 27 op/s 2023-05-08T11:04:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26393.170286 secs 2023-05-08T11:04:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:15 smithi186 ceph-mon[126480]: pgmap v14132: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 453 KiB/s wr, 27 op/s 2023-05-08T11:04:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26393.726714 secs 2023-05-08T11:04:15.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:15 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:04:15.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:15 smithi186 ceph-mon[126480]: osdmap e961: 12 total, 12 up, 12 in 2023-05-08T11:04:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26393.170286 secs 2023-05-08T11:04:15.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:15 smithi133 ceph-mon[125939]: pgmap v14132: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 453 KiB/s wr, 27 op/s 2023-05-08T11:04:15.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26393.726714 secs 2023-05-08T11:04:15.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:15 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:04:15.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:15 smithi133 ceph-mon[125939]: osdmap e961: 12 total, 12 up, 12 in 2023-05-08T11:04:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26393.170286 secs 2023-05-08T11:04:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:15 smithi096 ceph-mon[124666]: pgmap v14132: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 453 KiB/s wr, 27 op/s 2023-05-08T11:04:15.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26393.726714 secs 2023-05-08T11:04:15.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:15 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:04:15.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:15 smithi096 ceph-mon[124666]: osdmap e961: 12 total, 12 up, 12 in 2023-05-08T11:04:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26395.013977 secs 2023-05-08T11:04:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26395.013977 secs 2023-05-08T11:04:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26395.013977 secs 2023-05-08T11:04:17.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:17 smithi186 ceph-mon[126480]: pgmap v14134: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 128 KiB/s wr, 8 op/s 2023-05-08T11:04:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:17 smithi133 ceph-mon[125939]: pgmap v14134: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 128 KiB/s wr, 8 op/s 2023-05-08T11:04:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:17 smithi096 ceph-mon[124666]: pgmap v14134: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 128 KiB/s wr, 8 op/s 2023-05-08T11:04:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:19 smithi186 ceph-mon[126480]: pgmap v14135: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 379 KiB/s rd, 126 KiB/s wr, 7 op/s 2023-05-08T11:04:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:19 smithi133 ceph-mon[125939]: pgmap v14135: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 379 KiB/s rd, 126 KiB/s wr, 7 op/s 2023-05-08T11:04:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:19 smithi096 ceph-mon[124666]: pgmap v14135: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 379 KiB/s rd, 126 KiB/s wr, 7 op/s 2023-05-08T11:04:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26398.170409 secs 2023-05-08T11:04:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26398.726777 secs 2023-05-08T11:04:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26398.170409 secs 2023-05-08T11:04:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26398.726777 secs 2023-05-08T11:04:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26398.170409 secs 2023-05-08T11:04:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26398.726777 secs 2023-05-08T11:04:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:21 smithi186 ceph-mon[126480]: pgmap v14136: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 126 KiB/s wr, 6 op/s 2023-05-08T11:04:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26400.014101 secs 2023-05-08T11:04:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:21 smithi133 ceph-mon[125939]: pgmap v14136: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 126 KiB/s wr, 6 op/s 2023-05-08T11:04:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26400.014101 secs 2023-05-08T11:04:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:21 smithi096 ceph-mon[124666]: pgmap v14136: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 126 KiB/s wr, 6 op/s 2023-05-08T11:04:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26400.014101 secs 2023-05-08T11:04:23.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:23 smithi186 ceph-mon[126480]: pgmap v14137: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 126 KiB/s wr, 6 op/s 2023-05-08T11:04:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:23 smithi133 ceph-mon[125939]: pgmap v14137: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 126 KiB/s wr, 6 op/s 2023-05-08T11:04:23.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:23 smithi096 ceph-mon[124666]: pgmap v14137: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 126 KiB/s wr, 6 op/s 2023-05-08T11:04:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26403.170547 secs 2023-05-08T11:04:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:25 smithi186 ceph-mon[126480]: pgmap v14138: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 126 KiB/s wr, 6 op/s 2023-05-08T11:04:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26403.726901 secs 2023-05-08T11:04:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26403.170547 secs 2023-05-08T11:04:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:25 smithi133 ceph-mon[125939]: pgmap v14138: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 126 KiB/s wr, 6 op/s 2023-05-08T11:04:25.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26403.726901 secs 2023-05-08T11:04:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26403.170547 secs 2023-05-08T11:04:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:25 smithi096 ceph-mon[124666]: pgmap v14138: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 126 KiB/s wr, 6 op/s 2023-05-08T11:04:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26403.726901 secs 2023-05-08T11:04:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26405.014222 secs 2023-05-08T11:04:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26405.014222 secs 2023-05-08T11:04:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26405.014222 secs 2023-05-08T11:04:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:27 smithi186 ceph-mon[126480]: pgmap v14139: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-05-08T11:04:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:27 smithi133 ceph-mon[125939]: pgmap v14139: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-05-08T11:04:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:27 smithi096 ceph-mon[124666]: pgmap v14139: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-05-08T11:04:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:29 smithi186 ceph-mon[126480]: pgmap v14140: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T11:04:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:29 smithi133 ceph-mon[125939]: pgmap v14140: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T11:04:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:29 smithi096 ceph-mon[124666]: pgmap v14140: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T11:04:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26408.170628 secs 2023-05-08T11:04:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26408.727019 secs 2023-05-08T11:04:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26408.170628 secs 2023-05-08T11:04:30.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26408.727019 secs 2023-05-08T11:04:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26408.170628 secs 2023-05-08T11:04:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26408.727019 secs 2023-05-08T11:04:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:31 smithi186 ceph-mon[126480]: pgmap v14141: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T11:04:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26410.014342 secs 2023-05-08T11:04:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:31 smithi133 ceph-mon[125939]: pgmap v14141: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T11:04:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26410.014342 secs 2023-05-08T11:04:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:31 smithi096 ceph-mon[124666]: pgmap v14141: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T11:04:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26410.014342 secs 2023-05-08T11:04:33.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:33 smithi186 ceph-mon[126480]: pgmap v14142: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T11:04:33.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:33 smithi133 ceph-mon[125939]: pgmap v14142: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T11:04:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:33 smithi096 ceph-mon[124666]: pgmap v14142: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T11:04:35.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26413.170736 secs 2023-05-08T11:04:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:35 smithi186 ceph-mon[126480]: pgmap v14143: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T11:04:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26413.727136 secs 2023-05-08T11:04:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26413.170736 secs 2023-05-08T11:04:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:35 smithi133 ceph-mon[125939]: pgmap v14143: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T11:04:35.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26413.727136 secs 2023-05-08T11:04:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26413.170736 secs 2023-05-08T11:04:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:35 smithi096 ceph-mon[124666]: pgmap v14143: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T11:04:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26413.727136 secs 2023-05-08T11:04:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26415.014480 secs 2023-05-08T11:04:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26415.014480 secs 2023-05-08T11:04:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26415.014480 secs 2023-05-08T11:04:37.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:37 smithi186 ceph-mon[126480]: pgmap v14144: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 8 op/s 2023-05-08T11:04:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:37 smithi133 ceph-mon[125939]: pgmap v14144: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 8 op/s 2023-05-08T11:04:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:37 smithi096 ceph-mon[124666]: pgmap v14144: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 8 op/s 2023-05-08T11:04:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:39 smithi186 ceph-mon[126480]: pgmap v14145: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T11:04:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:39 smithi133 ceph-mon[125939]: pgmap v14145: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T11:04:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:39 smithi096 ceph-mon[124666]: pgmap v14145: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T11:04:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26418.170832 secs 2023-05-08T11:04:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26418.727249 secs 2023-05-08T11:04:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26418.170832 secs 2023-05-08T11:04:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26418.727249 secs 2023-05-08T11:04:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26418.170832 secs 2023-05-08T11:04:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26418.727249 secs 2023-05-08T11:04:41.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:41 smithi186 ceph-mon[126480]: pgmap v14146: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 938 B/s wr, 8 op/s 2023-05-08T11:04:41.404 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26420.014580 secs 2023-05-08T11:04:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:41 smithi133 ceph-mon[125939]: pgmap v14146: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 938 B/s wr, 8 op/s 2023-05-08T11:04:41.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26420.014580 secs 2023-05-08T11:04:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:41 smithi096 ceph-mon[124666]: pgmap v14146: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 938 B/s wr, 8 op/s 2023-05-08T11:04:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26420.014580 secs 2023-05-08T11:04:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:43 smithi186 ceph-mon[126480]: pgmap v14147: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T11:04:43.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:43 smithi133 ceph-mon[125939]: pgmap v14147: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T11:04:43.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:43 smithi096 ceph-mon[124666]: pgmap v14147: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T11:04:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26423.170938 secs 2023-05-08T11:04:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26423.170938 secs 2023-05-08T11:04:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26423.170938 secs 2023-05-08T11:04:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:45 smithi186 ceph-mon[126480]: pgmap v14148: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T11:04:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26423.727377 secs 2023-05-08T11:04:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:45 smithi133 ceph-mon[125939]: pgmap v14148: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T11:04:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26423.727377 secs 2023-05-08T11:04:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:45 smithi096 ceph-mon[124666]: pgmap v14148: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T11:04:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26423.727377 secs 2023-05-08T11:04:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:47 smithi186 ceph-mon[126480]: pgmap v14149: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 282 KiB/s wr, 10 op/s 2023-05-08T11:04:47.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:47 smithi133 ceph-mon[125939]: pgmap v14149: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 282 KiB/s wr, 10 op/s 2023-05-08T11:04:47.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:47 smithi096 ceph-mon[124666]: pgmap v14149: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 282 KiB/s wr, 10 op/s 2023-05-08T11:04:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:04:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:04:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:04:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:49 smithi186 ceph-mon[126480]: pgmap v14150: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 282 KiB/s wr, 7 op/s 2023-05-08T11:04:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:04:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:04:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:04:49.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26428.171061 secs 2023-05-08T11:04:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:49 smithi133 ceph-mon[125939]: pgmap v14150: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 282 KiB/s wr, 7 op/s 2023-05-08T11:04:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:04:49.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:04:49.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:04:49.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26428.171061 secs 2023-05-08T11:04:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:49 smithi096 ceph-mon[124666]: pgmap v14150: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 282 KiB/s wr, 7 op/s 2023-05-08T11:04:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:04:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:04:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:04:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26428.171061 secs 2023-05-08T11:04:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:50 smithi133 ceph-mon[125939]: pgmap v14151: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 303 KiB/s wr, 11 op/s 2023-05-08T11:04:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:50 smithi096 ceph-mon[124666]: pgmap v14151: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 303 KiB/s wr, 11 op/s 2023-05-08T11:04:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:50 smithi186 ceph-mon[126480]: pgmap v14151: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 303 KiB/s wr, 11 op/s 2023-05-08T11:04:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:52 smithi133 ceph-mon[125939]: pgmap v14152: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 394 KiB/s rd, 302 KiB/s wr, 8 op/s 2023-05-08T11:04:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:04:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:52 smithi096 ceph-mon[124666]: pgmap v14152: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 394 KiB/s rd, 302 KiB/s wr, 8 op/s 2023-05-08T11:04:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:04:53.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:52 smithi186 ceph-mon[126480]: pgmap v14152: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 394 KiB/s rd, 302 KiB/s wr, 8 op/s 2023-05-08T11:04:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:04:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:04:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:04:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:04:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:04:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:04:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:04:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26433.171202 secs 2023-05-08T11:04:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:54 smithi096 ceph-mon[124666]: pgmap v14153: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 394 KiB/s rd, 302 KiB/s wr, 8 op/s 2023-05-08T11:04:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:54 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:04:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26433.171202 secs 2023-05-08T11:04:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:54 smithi186 ceph-mon[126480]: pgmap v14153: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 394 KiB/s rd, 302 KiB/s wr, 8 op/s 2023-05-08T11:04:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:54 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:04:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26433.171202 secs 2023-05-08T11:04:55.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:54 smithi133 ceph-mon[125939]: pgmap v14153: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 394 KiB/s rd, 302 KiB/s wr, 8 op/s 2023-05-08T11:04:55.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:54 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:04:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:56 smithi096 ceph-mon[124666]: pgmap v14154: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 832 KiB/s rd, 729 KiB/s wr, 14 op/s 2023-05-08T11:04:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:56 smithi186 ceph-mon[126480]: pgmap v14154: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 832 KiB/s rd, 729 KiB/s wr, 14 op/s 2023-05-08T11:04:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:56 smithi133 ceph-mon[125939]: pgmap v14154: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 832 KiB/s rd, 729 KiB/s wr, 14 op/s 2023-05-08T11:04:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:04:59 smithi096 ceph-mon[124666]: pgmap v14155: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 648 KiB/s rd, 447 KiB/s wr, 10 op/s 2023-05-08T11:04:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:04:59 smithi186 ceph-mon[126480]: pgmap v14155: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 648 KiB/s rd, 447 KiB/s wr, 10 op/s 2023-05-08T11:04:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:04:59 smithi133 ceph-mon[125939]: pgmap v14155: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 648 KiB/s rd, 447 KiB/s wr, 10 op/s 2023-05-08T11:05:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26438.171315 secs 2023-05-08T11:05:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26438.171315 secs 2023-05-08T11:05:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26438.171315 secs 2023-05-08T11:05:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:01 smithi186 ceph-mon[126480]: pgmap v14156: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 905 KiB/s rd, 674 KiB/s wr, 16 op/s 2023-05-08T11:05:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:01 smithi133 ceph-mon[125939]: pgmap v14156: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 905 KiB/s rd, 674 KiB/s wr, 16 op/s 2023-05-08T11:05:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:01 smithi096 ceph-mon[124666]: pgmap v14156: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 905 KiB/s rd, 674 KiB/s wr, 16 op/s 2023-05-08T11:05:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:03 smithi186 ceph-mon[126480]: pgmap v14157: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 695 KiB/s rd, 653 KiB/s wr, 11 op/s 2023-05-08T11:05:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:03 smithi133 ceph-mon[125939]: pgmap v14157: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 695 KiB/s rd, 653 KiB/s wr, 11 op/s 2023-05-08T11:05:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:03 smithi096 ceph-mon[124666]: pgmap v14157: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 695 KiB/s rd, 653 KiB/s wr, 11 op/s 2023-05-08T11:05:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26443.171438 secs 2023-05-08T11:05:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:05 smithi186 ceph-mon[126480]: pgmap v14158: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 695 KiB/s rd, 653 KiB/s wr, 11 op/s 2023-05-08T11:05:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26443.727770 secs 2023-05-08T11:05:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26443.171438 secs 2023-05-08T11:05:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:05 smithi133 ceph-mon[125939]: pgmap v14158: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 695 KiB/s rd, 653 KiB/s wr, 11 op/s 2023-05-08T11:05:05.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26443.727770 secs 2023-05-08T11:05:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26443.171438 secs 2023-05-08T11:05:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:05 smithi096 ceph-mon[124666]: pgmap v14158: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 695 KiB/s rd, 653 KiB/s wr, 11 op/s 2023-05-08T11:05:05.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26443.727770 secs 2023-05-08T11:05:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:06 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:05:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:05:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:05:06.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26445.015202 secs 2023-05-08T11:05:06.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:06 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:05:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:06 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:05:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:05:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:05:06.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26445.015202 secs 2023-05-08T11:05:06.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:06 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:05:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:06 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:05:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:05:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:05:06.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26445.015202 secs 2023-05-08T11:05:06.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:06 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:05:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:07 smithi186 ceph-mon[126480]: pgmap v14159: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 31 op/s 2023-05-08T11:05:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:07 smithi186 ceph-mon[126480]: osdmap e962: 12 total, 12 up, 12 in 2023-05-08T11:05:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:07 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:05:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:07 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:05:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:07 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:05:07.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:07 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:05:07.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:07 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:05:07.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:07 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:05:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:07 smithi133 ceph-mon[125939]: pgmap v14159: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 31 op/s 2023-05-08T11:05:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:07 smithi133 ceph-mon[125939]: osdmap e962: 12 total, 12 up, 12 in 2023-05-08T11:05:07.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:07 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:05:07.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:07 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:05:07.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:07 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:05:07.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:07 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:05:07.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:07 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:05:07.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:07 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:05:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:07 smithi096 ceph-mon[124666]: pgmap v14159: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 31 op/s 2023-05-08T11:05:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:07 smithi096 ceph-mon[124666]: osdmap e962: 12 total, 12 up, 12 in 2023-05-08T11:05:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:07 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:05:07.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:07 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:05:07.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:07 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:05:07.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:07 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:05:07.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:07 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:05:07.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:07 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:05:08.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:08 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:05:08.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:08 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:05:08.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:08 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:05:08.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:08 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:05:08.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:08 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T11:05:08.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:08 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T11:05:08.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:08 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:05:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:08 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:05:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:08 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:05:08.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:08 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:05:08.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:08 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:05:08.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:08 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T11:05:08.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:08 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T11:05:08.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:08 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:05:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:08 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:05:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:08 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:05:08.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:08 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:05:08.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:08 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:05:08.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:08 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T11:05:08.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:08 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T11:05:08.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:08 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:05:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:09 smithi186 ceph-mon[126480]: pgmap v14161: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 721 KiB/s rd, 726 KiB/s wr, 30 op/s 2023-05-08T11:05:09.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:05:09.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:05:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:09 smithi133 ceph-mon[125939]: pgmap v14161: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 721 KiB/s rd, 726 KiB/s wr, 30 op/s 2023-05-08T11:05:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:05:09.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:05:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:09 smithi096 ceph-mon[124666]: pgmap v14161: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 721 KiB/s rd, 726 KiB/s wr, 30 op/s 2023-05-08T11:05:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:05:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:05:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26448.171561 secs 2023-05-08T11:05:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26448.727860 secs 2023-05-08T11:05:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26448.171561 secs 2023-05-08T11:05:10.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26448.727860 secs 2023-05-08T11:05:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26448.171561 secs 2023-05-08T11:05:10.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26448.727860 secs 2023-05-08T11:05:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:11 smithi186 ceph-mon[126480]: pgmap v14162: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 455 KiB/s wr, 27 op/s 2023-05-08T11:05:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26450.015307 secs 2023-05-08T11:05:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:11 smithi133 ceph-mon[125939]: pgmap v14162: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 455 KiB/s wr, 27 op/s 2023-05-08T11:05:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26450.015307 secs 2023-05-08T11:05:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:11 smithi096 ceph-mon[124666]: pgmap v14162: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 455 KiB/s wr, 27 op/s 2023-05-08T11:05:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26450.015307 secs 2023-05-08T11:05:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:13 smithi186 ceph-mon[126480]: pgmap v14163: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 455 KiB/s wr, 27 op/s 2023-05-08T11:05:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:13 smithi133 ceph-mon[125939]: pgmap v14163: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 455 KiB/s wr, 27 op/s 2023-05-08T11:05:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:13 smithi096 ceph-mon[124666]: pgmap v14163: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 455 KiB/s wr, 27 op/s 2023-05-08T11:05:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26453.171701 secs 2023-05-08T11:05:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:15 smithi186 ceph-mon[126480]: pgmap v14164: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 455 KiB/s wr, 27 op/s 2023-05-08T11:05:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26453.727998 secs 2023-05-08T11:05:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:15 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:05:15.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:15 smithi186 ceph-mon[126480]: osdmap e963: 12 total, 12 up, 12 in 2023-05-08T11:05:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26453.171701 secs 2023-05-08T11:05:15.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:15 smithi133 ceph-mon[125939]: pgmap v14164: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 455 KiB/s wr, 27 op/s 2023-05-08T11:05:15.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26453.727998 secs 2023-05-08T11:05:15.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:15 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:05:15.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:15 smithi133 ceph-mon[125939]: osdmap e963: 12 total, 12 up, 12 in 2023-05-08T11:05:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26453.171701 secs 2023-05-08T11:05:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:15 smithi096 ceph-mon[124666]: pgmap v14164: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 455 KiB/s wr, 27 op/s 2023-05-08T11:05:15.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26453.727998 secs 2023-05-08T11:05:15.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:15 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:05:15.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:15 smithi096 ceph-mon[124666]: osdmap e963: 12 total, 12 up, 12 in 2023-05-08T11:05:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26455.015430 secs 2023-05-08T11:05:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26455.015430 secs 2023-05-08T11:05:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26455.015430 secs 2023-05-08T11:05:17.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:17 smithi186 ceph-mon[126480]: pgmap v14166: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 128 KiB/s wr, 7 op/s 2023-05-08T11:05:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:17 smithi133 ceph-mon[125939]: pgmap v14166: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 128 KiB/s wr, 7 op/s 2023-05-08T11:05:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:17 smithi096 ceph-mon[124666]: pgmap v14166: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 128 KiB/s wr, 7 op/s 2023-05-08T11:05:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:19 smithi186 ceph-mon[126480]: pgmap v14167: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 127 KiB/s wr, 7 op/s 2023-05-08T11:05:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26458.171818 secs 2023-05-08T11:05:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:19 smithi133 ceph-mon[125939]: pgmap v14167: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 127 KiB/s wr, 7 op/s 2023-05-08T11:05:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26458.171818 secs 2023-05-08T11:05:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:19 smithi096 ceph-mon[124666]: pgmap v14167: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 127 KiB/s wr, 7 op/s 2023-05-08T11:05:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26458.171818 secs 2023-05-08T11:05:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26458.728117 secs 2023-05-08T11:05:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26458.728117 secs 2023-05-08T11:05:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26458.728117 secs 2023-05-08T11:05:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:21 smithi186 ceph-mon[126480]: pgmap v14168: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 126 KiB/s wr, 6 op/s 2023-05-08T11:05:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26460.015520 secs 2023-05-08T11:05:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:21 smithi133 ceph-mon[125939]: pgmap v14168: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 126 KiB/s wr, 6 op/s 2023-05-08T11:05:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26460.015520 secs 2023-05-08T11:05:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:21 smithi096 ceph-mon[124666]: pgmap v14168: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 126 KiB/s wr, 6 op/s 2023-05-08T11:05:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26460.015520 secs 2023-05-08T11:05:23.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:23 smithi186 ceph-mon[126480]: pgmap v14169: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 126 KiB/s wr, 6 op/s 2023-05-08T11:05:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:23 smithi133 ceph-mon[125939]: pgmap v14169: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 126 KiB/s wr, 6 op/s 2023-05-08T11:05:23.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:23 smithi096 ceph-mon[124666]: pgmap v14169: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 126 KiB/s wr, 6 op/s 2023-05-08T11:05:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26463.171924 secs 2023-05-08T11:05:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26463.171924 secs 2023-05-08T11:05:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26463.171924 secs 2023-05-08T11:05:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:25 smithi186 ceph-mon[126480]: pgmap v14170: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 126 KiB/s wr, 6 op/s 2023-05-08T11:05:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26463.728247 secs 2023-05-08T11:05:25.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:25 smithi133 ceph-mon[125939]: pgmap v14170: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 126 KiB/s wr, 6 op/s 2023-05-08T11:05:25.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26463.728247 secs 2023-05-08T11:05:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:25 smithi096 ceph-mon[124666]: pgmap v14170: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 126 KiB/s wr, 6 op/s 2023-05-08T11:05:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26463.728247 secs 2023-05-08T11:05:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26465.015669 secs 2023-05-08T11:05:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26465.015669 secs 2023-05-08T11:05:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26465.015669 secs 2023-05-08T11:05:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:27 smithi133 ceph-mon[125939]: pgmap v14171: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-05-08T11:05:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:27 smithi096 ceph-mon[124666]: pgmap v14171: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-05-08T11:05:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:27 smithi186 ceph-mon[126480]: pgmap v14171: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-05-08T11:05:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:29 smithi133 ceph-mon[125939]: pgmap v14172: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T11:05:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26468.172040 secs 2023-05-08T11:05:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:29 smithi096 ceph-mon[124666]: pgmap v14172: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T11:05:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26468.172040 secs 2023-05-08T11:05:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:29 smithi186 ceph-mon[126480]: pgmap v14172: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T11:05:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26468.172040 secs 2023-05-08T11:05:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26468.728356 secs 2023-05-08T11:05:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26468.728356 secs 2023-05-08T11:05:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26468.728356 secs 2023-05-08T11:05:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:31 smithi133 ceph-mon[125939]: pgmap v14173: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T11:05:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26470.015792 secs 2023-05-08T11:05:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:31 smithi096 ceph-mon[124666]: pgmap v14173: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T11:05:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26470.015792 secs 2023-05-08T11:05:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:31 smithi186 ceph-mon[126480]: pgmap v14173: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T11:05:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26470.015792 secs 2023-05-08T11:05:33.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:33 smithi133 ceph-mon[125939]: pgmap v14174: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T11:05:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:33 smithi096 ceph-mon[124666]: pgmap v14174: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T11:05:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:33 smithi186 ceph-mon[126480]: pgmap v14174: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T11:05:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26473.172168 secs 2023-05-08T11:05:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26473.172168 secs 2023-05-08T11:05:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26473.172168 secs 2023-05-08T11:05:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:35 smithi133 ceph-mon[125939]: pgmap v14175: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T11:05:35.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26473.728501 secs 2023-05-08T11:05:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:35 smithi096 ceph-mon[124666]: pgmap v14175: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T11:05:35.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26473.728501 secs 2023-05-08T11:05:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:35 smithi186 ceph-mon[126480]: pgmap v14175: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T11:05:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26473.728501 secs 2023-05-08T11:05:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26475.015855 secs 2023-05-08T11:05:36.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26475.015855 secs 2023-05-08T11:05:36.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26475.015855 secs 2023-05-08T11:05:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:37 smithi133 ceph-mon[125939]: pgmap v14176: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 8 op/s 2023-05-08T11:05:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:37 smithi096 ceph-mon[124666]: pgmap v14176: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 8 op/s 2023-05-08T11:05:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:37 smithi186 ceph-mon[126480]: pgmap v14176: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 8 op/s 2023-05-08T11:05:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:39 smithi133 ceph-mon[125939]: pgmap v14177: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T11:05:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26478.172246 secs 2023-05-08T11:05:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:39 smithi096 ceph-mon[124666]: pgmap v14177: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T11:05:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26478.172246 secs 2023-05-08T11:05:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:39 smithi186 ceph-mon[126480]: pgmap v14177: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T11:05:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26478.172246 secs 2023-05-08T11:05:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26478.728613 secs 2023-05-08T11:05:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26478.728613 secs 2023-05-08T11:05:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26478.728613 secs 2023-05-08T11:05:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:41 smithi133 ceph-mon[125939]: pgmap v14178: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 938 B/s wr, 8 op/s 2023-05-08T11:05:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26480.015977 secs 2023-05-08T11:05:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:41 smithi096 ceph-mon[124666]: pgmap v14178: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 938 B/s wr, 8 op/s 2023-05-08T11:05:41.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26480.015977 secs 2023-05-08T11:05:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:41 smithi186 ceph-mon[126480]: pgmap v14178: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 938 B/s wr, 8 op/s 2023-05-08T11:05:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26480.015977 secs 2023-05-08T11:05:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:43 smithi133 ceph-mon[125939]: pgmap v14179: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T11:05:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:43 smithi096 ceph-mon[124666]: pgmap v14179: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T11:05:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:43 smithi186 ceph-mon[126480]: pgmap v14179: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T11:05:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26483.172381 secs 2023-05-08T11:05:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26483.172381 secs 2023-05-08T11:05:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26483.172381 secs 2023-05-08T11:05:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:45 smithi133 ceph-mon[125939]: pgmap v14180: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T11:05:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26483.728731 secs 2023-05-08T11:05:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:45 smithi096 ceph-mon[124666]: pgmap v14180: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T11:05:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26483.728731 secs 2023-05-08T11:05:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:45 smithi186 ceph-mon[126480]: pgmap v14180: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T11:05:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26483.728731 secs 2023-05-08T11:05:47.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:47 smithi133 ceph-mon[125939]: pgmap v14181: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 189 KiB/s wr, 10 op/s 2023-05-08T11:05:47.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:47 smithi096 ceph-mon[124666]: pgmap v14181: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 189 KiB/s wr, 10 op/s 2023-05-08T11:05:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:47 smithi186 ceph-mon[126480]: pgmap v14181: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 189 KiB/s wr, 10 op/s 2023-05-08T11:05:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:05:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:05:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:05:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:49 smithi133 ceph-mon[125939]: pgmap v14182: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 189 KiB/s wr, 7 op/s 2023-05-08T11:05:49.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:05:49.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:05:49.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:05:49.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26488.172501 secs 2023-05-08T11:05:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:49 smithi096 ceph-mon[124666]: pgmap v14182: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 189 KiB/s wr, 7 op/s 2023-05-08T11:05:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:05:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:05:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:05:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26488.172501 secs 2023-05-08T11:05:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:49 smithi186 ceph-mon[126480]: pgmap v14182: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 189 KiB/s wr, 7 op/s 2023-05-08T11:05:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:05:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:05:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:05:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26488.172501 secs 2023-05-08T11:05:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:50 smithi133 ceph-mon[125939]: pgmap v14183: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 305 KiB/s wr, 11 op/s 2023-05-08T11:05:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:50 smithi096 ceph-mon[124666]: pgmap v14183: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 305 KiB/s wr, 11 op/s 2023-05-08T11:05:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:50 smithi186 ceph-mon[126480]: pgmap v14183: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 305 KiB/s wr, 11 op/s 2023-05-08T11:05:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:52 smithi096 ceph-mon[124666]: pgmap v14184: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 304 KiB/s wr, 8 op/s 2023-05-08T11:05:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:05:53.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:52 smithi186 ceph-mon[126480]: pgmap v14184: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 304 KiB/s wr, 8 op/s 2023-05-08T11:05:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:05:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:52 smithi133 ceph-mon[125939]: pgmap v14184: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 304 KiB/s wr, 8 op/s 2023-05-08T11:05:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:05:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:54 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:05:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:54 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:05:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:54 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:05:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:54 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:05:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:54 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:05:54.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:54 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:05:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26493.172618 secs 2023-05-08T11:05:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:55 smithi186 ceph-mon[126480]: pgmap v14185: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 304 KiB/s wr, 8 op/s 2023-05-08T11:05:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:55 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:05:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26493.172618 secs 2023-05-08T11:05:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:55 smithi133 ceph-mon[125939]: pgmap v14185: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 304 KiB/s wr, 8 op/s 2023-05-08T11:05:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:55 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:05:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26493.172618 secs 2023-05-08T11:05:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:55 smithi096 ceph-mon[124666]: pgmap v14185: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 304 KiB/s wr, 8 op/s 2023-05-08T11:05:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:55 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:05:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:57 smithi186 ceph-mon[126480]: pgmap v14186: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 744 KiB/s rd, 731 KiB/s wr, 13 op/s 2023-05-08T11:05:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:57 smithi133 ceph-mon[125939]: pgmap v14186: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 744 KiB/s rd, 731 KiB/s wr, 13 op/s 2023-05-08T11:05:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:57 smithi096 ceph-mon[124666]: pgmap v14186: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 744 KiB/s rd, 731 KiB/s wr, 13 op/s 2023-05-08T11:05:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:05:59 smithi186 ceph-mon[126480]: pgmap v14187: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 555 KiB/s rd, 543 KiB/s wr, 9 op/s 2023-05-08T11:05:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:05:59 smithi133 ceph-mon[125939]: pgmap v14187: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 555 KiB/s rd, 543 KiB/s wr, 9 op/s 2023-05-08T11:05:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:05:59 smithi096 ceph-mon[124666]: pgmap v14187: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 555 KiB/s rd, 543 KiB/s wr, 9 op/s 2023-05-08T11:06:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26498.172744 secs 2023-05-08T11:06:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26498.172744 secs 2023-05-08T11:06:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26498.172744 secs 2023-05-08T11:06:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:01 smithi186 ceph-mon[126480]: pgmap v14188: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 783 KiB/s rd, 771 KiB/s wr, 15 op/s 2023-05-08T11:06:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:01 smithi133 ceph-mon[125939]: pgmap v14188: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 783 KiB/s rd, 771 KiB/s wr, 15 op/s 2023-05-08T11:06:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:01 smithi096 ceph-mon[124666]: pgmap v14188: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 783 KiB/s rd, 771 KiB/s wr, 15 op/s 2023-05-08T11:06:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:03 smithi186 ceph-mon[126480]: pgmap v14189: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 667 KiB/s rd, 655 KiB/s wr, 11 op/s 2023-05-08T11:06:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:03 smithi133 ceph-mon[125939]: pgmap v14189: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 667 KiB/s rd, 655 KiB/s wr, 11 op/s 2023-05-08T11:06:03.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:03 smithi096 ceph-mon[124666]: pgmap v14189: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 667 KiB/s rd, 655 KiB/s wr, 11 op/s 2023-05-08T11:06:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26503.172868 secs 2023-05-08T11:06:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:05 smithi186 ceph-mon[126480]: pgmap v14190: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 667 KiB/s rd, 654 KiB/s wr, 11 op/s 2023-05-08T11:06:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26503.729261 secs 2023-05-08T11:06:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26503.172868 secs 2023-05-08T11:06:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:05 smithi133 ceph-mon[125939]: pgmap v14190: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 667 KiB/s rd, 654 KiB/s wr, 11 op/s 2023-05-08T11:06:05.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26503.729261 secs 2023-05-08T11:06:05.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26503.172868 secs 2023-05-08T11:06:05.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:05 smithi096 ceph-mon[124666]: pgmap v14190: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 667 KiB/s rd, 654 KiB/s wr, 11 op/s 2023-05-08T11:06:05.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26503.729261 secs 2023-05-08T11:06:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:06 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:06:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:06:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:06:06.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26505.016587 secs 2023-05-08T11:06:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:06 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:06:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:06:06.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:06:06.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26505.016587 secs 2023-05-08T11:06:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:06 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:06:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:06:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:06:06.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26505.016587 secs 2023-05-08T11:06:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:07 smithi186 ceph-mon[126480]: pgmap v14191: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 916 KiB/s rd, 939 KiB/s wr, 30 op/s 2023-05-08T11:06:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:07 smithi186 ceph-mon[126480]: osdmap e964: 12 total, 12 up, 12 in 2023-05-08T11:06:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:07 smithi133 ceph-mon[125939]: pgmap v14191: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 916 KiB/s rd, 939 KiB/s wr, 30 op/s 2023-05-08T11:06:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:07 smithi133 ceph-mon[125939]: osdmap e964: 12 total, 12 up, 12 in 2023-05-08T11:06:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:07 smithi096 ceph-mon[124666]: pgmap v14191: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 916 KiB/s rd, 939 KiB/s wr, 30 op/s 2023-05-08T11:06:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:07 smithi096 ceph-mon[124666]: osdmap e964: 12 total, 12 up, 12 in 2023-05-08T11:06:08.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:08 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:06:08.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:08 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:06:08.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:08 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:06:08.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:08 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:06:08.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:08 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:06:08.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:08 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T11:06:08.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:08 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T11:06:08.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:08 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:06:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:08 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:06:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:08 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:06:08.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:08 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:06:08.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:08 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:06:08.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:08 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:06:08.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:08 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T11:06:08.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:08 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T11:06:08.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:08 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:06:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:08 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:06:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:08 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:06:08.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:08 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:06:08.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:08 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:06:08.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:08 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:06:08.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:08 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T11:06:08.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:08 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T11:06:08.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:08 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:06:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:09 smithi186 ceph-mon[126480]: pgmap v14193: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 572 KiB/s rd, 614 KiB/s wr, 30 op/s 2023-05-08T11:06:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26508.172997 secs 2023-05-08T11:06:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:06:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:06:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26508.729337 secs 2023-05-08T11:06:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:09 smithi133 ceph-mon[125939]: pgmap v14193: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 572 KiB/s rd, 614 KiB/s wr, 30 op/s 2023-05-08T11:06:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26508.172997 secs 2023-05-08T11:06:10.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:06:10.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:06:10.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26508.729337 secs 2023-05-08T11:06:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:09 smithi096 ceph-mon[124666]: pgmap v14193: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 572 KiB/s rd, 614 KiB/s wr, 30 op/s 2023-05-08T11:06:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26508.172997 secs 2023-05-08T11:06:10.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:06:10.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:06:10.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26508.729337 secs 2023-05-08T11:06:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:10 smithi133 ceph-mon[125939]: pgmap v14194: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 342 KiB/s wr, 27 op/s 2023-05-08T11:06:11.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26510.016744 secs 2023-05-08T11:06:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:10 smithi096 ceph-mon[124666]: pgmap v14194: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 342 KiB/s wr, 27 op/s 2023-05-08T11:06:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26510.016744 secs 2023-05-08T11:06:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:10 smithi186 ceph-mon[126480]: pgmap v14194: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 342 KiB/s wr, 27 op/s 2023-05-08T11:06:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26510.016744 secs 2023-05-08T11:06:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:13 smithi096 ceph-mon[124666]: pgmap v14195: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 342 KiB/s wr, 27 op/s 2023-05-08T11:06:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:13 smithi186 ceph-mon[126480]: pgmap v14195: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 342 KiB/s wr, 27 op/s 2023-05-08T11:06:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:13 smithi133 ceph-mon[125939]: pgmap v14195: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 342 KiB/s wr, 27 op/s 2023-05-08T11:06:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26513.173095 secs 2023-05-08T11:06:15.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:15 smithi096 ceph-mon[124666]: pgmap v14196: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 341 KiB/s wr, 27 op/s 2023-05-08T11:06:15.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26513.729402 secs 2023-05-08T11:06:15.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:15 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:06:15.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:15 smithi096 ceph-mon[124666]: osdmap e965: 12 total, 12 up, 12 in 2023-05-08T11:06:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26513.173095 secs 2023-05-08T11:06:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:15 smithi186 ceph-mon[126480]: pgmap v14196: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 341 KiB/s wr, 27 op/s 2023-05-08T11:06:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26513.729402 secs 2023-05-08T11:06:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:15 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:06:15.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:15 smithi186 ceph-mon[126480]: osdmap e965: 12 total, 12 up, 12 in 2023-05-08T11:06:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26513.173095 secs 2023-05-08T11:06:15.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:15 smithi133 ceph-mon[125939]: pgmap v14196: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 341 KiB/s wr, 27 op/s 2023-05-08T11:06:15.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26513.729402 secs 2023-05-08T11:06:15.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:15 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:06:15.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:15 smithi133 ceph-mon[125939]: osdmap e965: 12 total, 12 up, 12 in 2023-05-08T11:06:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26515.016859 secs 2023-05-08T11:06:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26515.016859 secs 2023-05-08T11:06:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26515.016859 secs 2023-05-08T11:06:17.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:17 smithi186 ceph-mon[126480]: pgmap v14198: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 244 KiB/s wr, 8 op/s 2023-05-08T11:06:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:17 smithi133 ceph-mon[125939]: pgmap v14198: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 244 KiB/s wr, 8 op/s 2023-05-08T11:06:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:17 smithi096 ceph-mon[124666]: pgmap v14198: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 244 KiB/s wr, 8 op/s 2023-05-08T11:06:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:19 smithi186 ceph-mon[126480]: pgmap v14199: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 241 KiB/s wr, 7 op/s 2023-05-08T11:06:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:19 smithi133 ceph-mon[125939]: pgmap v14199: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 241 KiB/s wr, 7 op/s 2023-05-08T11:06:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:19 smithi096 ceph-mon[124666]: pgmap v14199: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 241 KiB/s wr, 7 op/s 2023-05-08T11:06:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26518.173155 secs 2023-05-08T11:06:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26518.729543 secs 2023-05-08T11:06:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26518.173155 secs 2023-05-08T11:06:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26518.729543 secs 2023-05-08T11:06:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26518.173155 secs 2023-05-08T11:06:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26518.729543 secs 2023-05-08T11:06:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:21 smithi186 ceph-mon[126480]: pgmap v14200: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 241 KiB/s wr, 7 op/s 2023-05-08T11:06:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26520.016972 secs 2023-05-08T11:06:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:21 smithi133 ceph-mon[125939]: pgmap v14200: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 241 KiB/s wr, 7 op/s 2023-05-08T11:06:21.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26520.016972 secs 2023-05-08T11:06:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:21 smithi096 ceph-mon[124666]: pgmap v14200: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 241 KiB/s wr, 7 op/s 2023-05-08T11:06:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26520.016972 secs 2023-05-08T11:06:23.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:23 smithi186 ceph-mon[126480]: pgmap v14201: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 241 KiB/s wr, 7 op/s 2023-05-08T11:06:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:23 smithi133 ceph-mon[125939]: pgmap v14201: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 241 KiB/s wr, 7 op/s 2023-05-08T11:06:23.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:23 smithi096 ceph-mon[124666]: pgmap v14201: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 241 KiB/s wr, 7 op/s 2023-05-08T11:06:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26523.173291 secs 2023-05-08T11:06:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:25 smithi186 ceph-mon[126480]: pgmap v14202: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 241 KiB/s wr, 7 op/s 2023-05-08T11:06:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26523.729659 secs 2023-05-08T11:06:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26523.173291 secs 2023-05-08T11:06:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:25 smithi133 ceph-mon[125939]: pgmap v14202: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 241 KiB/s wr, 7 op/s 2023-05-08T11:06:25.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26523.729659 secs 2023-05-08T11:06:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26523.173291 secs 2023-05-08T11:06:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:25 smithi096 ceph-mon[124666]: pgmap v14202: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 241 KiB/s wr, 7 op/s 2023-05-08T11:06:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26523.729659 secs 2023-05-08T11:06:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26525.017068 secs 2023-05-08T11:06:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26525.017068 secs 2023-05-08T11:06:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26525.017068 secs 2023-05-08T11:06:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:27 smithi186 ceph-mon[126480]: pgmap v14203: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 92 B/s wr, 5 op/s 2023-05-08T11:06:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:27 smithi133 ceph-mon[125939]: pgmap v14203: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 92 B/s wr, 5 op/s 2023-05-08T11:06:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:27 smithi096 ceph-mon[124666]: pgmap v14203: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 92 B/s wr, 5 op/s 2023-05-08T11:06:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:29 smithi186 ceph-mon[126480]: pgmap v14204: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T11:06:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:29 smithi133 ceph-mon[125939]: pgmap v14204: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T11:06:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:29 smithi096 ceph-mon[124666]: pgmap v14204: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T11:06:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26528.173364 secs 2023-05-08T11:06:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26528.729735 secs 2023-05-08T11:06:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26528.173364 secs 2023-05-08T11:06:30.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26528.729735 secs 2023-05-08T11:06:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26528.173364 secs 2023-05-08T11:06:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26528.729735 secs 2023-05-08T11:06:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:31 smithi186 ceph-mon[126480]: pgmap v14205: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T11:06:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26530.017188 secs 2023-05-08T11:06:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:31 smithi133 ceph-mon[125939]: pgmap v14205: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T11:06:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26530.017188 secs 2023-05-08T11:06:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:31 smithi096 ceph-mon[124666]: pgmap v14205: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T11:06:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26530.017188 secs 2023-05-08T11:06:33.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:33 smithi186 ceph-mon[126480]: pgmap v14206: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T11:06:33.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:33 smithi133 ceph-mon[125939]: pgmap v14206: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T11:06:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:33 smithi096 ceph-mon[124666]: pgmap v14206: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T11:06:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26533.173488 secs 2023-05-08T11:06:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:35 smithi186 ceph-mon[126480]: pgmap v14207: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T11:06:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26533.729796 secs 2023-05-08T11:06:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26533.173488 secs 2023-05-08T11:06:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:35 smithi133 ceph-mon[125939]: pgmap v14207: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T11:06:35.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26533.729796 secs 2023-05-08T11:06:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26533.173488 secs 2023-05-08T11:06:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:35 smithi096 ceph-mon[124666]: pgmap v14207: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T11:06:35.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26533.729796 secs 2023-05-08T11:06:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26535.017311 secs 2023-05-08T11:06:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26535.017311 secs 2023-05-08T11:06:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26535.017311 secs 2023-05-08T11:06:37.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:37 smithi186 ceph-mon[126480]: pgmap v14208: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 8 op/s 2023-05-08T11:06:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:37 smithi133 ceph-mon[125939]: pgmap v14208: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 8 op/s 2023-05-08T11:06:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:37 smithi096 ceph-mon[124666]: pgmap v14208: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 8 op/s 2023-05-08T11:06:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:39 smithi186 ceph-mon[126480]: pgmap v14209: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T11:06:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:39 smithi133 ceph-mon[125939]: pgmap v14209: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T11:06:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:39 smithi096 ceph-mon[124666]: pgmap v14209: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T11:06:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26538.173594 secs 2023-05-08T11:06:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26538.729916 secs 2023-05-08T11:06:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26538.173594 secs 2023-05-08T11:06:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26538.729916 secs 2023-05-08T11:06:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26538.173594 secs 2023-05-08T11:06:40.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26538.729916 secs 2023-05-08T11:06:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:41 smithi186 ceph-mon[126480]: pgmap v14210: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 938 B/s wr, 9 op/s 2023-05-08T11:06:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26540.017434 secs 2023-05-08T11:06:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:41 smithi133 ceph-mon[125939]: pgmap v14210: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 938 B/s wr, 9 op/s 2023-05-08T11:06:41.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26540.017434 secs 2023-05-08T11:06:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:41 smithi096 ceph-mon[124666]: pgmap v14210: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 938 B/s wr, 9 op/s 2023-05-08T11:06:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26540.017434 secs 2023-05-08T11:06:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:43 smithi186 ceph-mon[126480]: pgmap v14211: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T11:06:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:43 smithi133 ceph-mon[125939]: pgmap v14211: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T11:06:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:43 smithi096 ceph-mon[124666]: pgmap v14211: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T11:06:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26543.173738 secs 2023-05-08T11:06:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:45 smithi186 ceph-mon[126480]: pgmap v14212: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T11:06:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26543.730036 secs 2023-05-08T11:06:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26543.173738 secs 2023-05-08T11:06:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:45 smithi133 ceph-mon[125939]: pgmap v14212: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T11:06:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26543.730036 secs 2023-05-08T11:06:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26543.173738 secs 2023-05-08T11:06:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:45 smithi096 ceph-mon[124666]: pgmap v14212: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T11:06:45.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26543.730036 secs 2023-05-08T11:06:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:47 smithi186 ceph-mon[126480]: pgmap v14213: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 189 KiB/s wr, 10 op/s 2023-05-08T11:06:47.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:47 smithi133 ceph-mon[125939]: pgmap v14213: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 189 KiB/s wr, 10 op/s 2023-05-08T11:06:47.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:47 smithi096 ceph-mon[124666]: pgmap v14213: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 189 KiB/s wr, 10 op/s 2023-05-08T11:06:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:06:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:06:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:06:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:49 smithi186 ceph-mon[126480]: pgmap v14214: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 189 KiB/s wr, 6 op/s 2023-05-08T11:06:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:06:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:06:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:06:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:49 smithi133 ceph-mon[125939]: pgmap v14214: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 189 KiB/s wr, 6 op/s 2023-05-08T11:06:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:06:49.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:06:49.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:06:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:49 smithi096 ceph-mon[124666]: pgmap v14214: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 189 KiB/s wr, 6 op/s 2023-05-08T11:06:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:06:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:06:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:06:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26548.173855 secs 2023-05-08T11:06:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26548.173855 secs 2023-05-08T11:06:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26548.173855 secs 2023-05-08T11:06:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:51 smithi186 ceph-mon[126480]: pgmap v14215: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 305 KiB/s wr, 11 op/s 2023-05-08T11:06:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:51 smithi133 ceph-mon[125939]: pgmap v14215: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 305 KiB/s wr, 11 op/s 2023-05-08T11:06:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:51 smithi096 ceph-mon[124666]: pgmap v14215: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 305 KiB/s wr, 11 op/s 2023-05-08T11:06:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:06:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:06:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:06:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:53 smithi186 ceph-mon[126480]: pgmap v14216: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 305 KiB/s wr, 7 op/s 2023-05-08T11:06:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:06:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:06:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:53 smithi133 ceph-mon[125939]: pgmap v14216: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 305 KiB/s wr, 7 op/s 2023-05-08T11:06:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:06:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:06:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:53 smithi096 ceph-mon[124666]: pgmap v14216: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 305 KiB/s wr, 7 op/s 2023-05-08T11:06:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:06:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:06:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26553.173998 secs 2023-05-08T11:06:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:55 smithi186 ceph-mon[126480]: pgmap v14217: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 305 KiB/s wr, 7 op/s 2023-05-08T11:06:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:55 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:06:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26553.173998 secs 2023-05-08T11:06:55.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:55 smithi133 ceph-mon[125939]: pgmap v14217: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 305 KiB/s wr, 7 op/s 2023-05-08T11:06:55.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:55 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:06:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26553.173998 secs 2023-05-08T11:06:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:55 smithi096 ceph-mon[124666]: pgmap v14217: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 305 KiB/s wr, 7 op/s 2023-05-08T11:06:55.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:55 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:06:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:57 smithi186 ceph-mon[126480]: pgmap v14218: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 750 KiB/s rd, 740 KiB/s wr, 13 op/s 2023-05-08T11:06:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:57 smithi133 ceph-mon[125939]: pgmap v14218: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 750 KiB/s rd, 740 KiB/s wr, 13 op/s 2023-05-08T11:06:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:57 smithi096 ceph-mon[124666]: pgmap v14218: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 750 KiB/s rd, 740 KiB/s wr, 13 op/s 2023-05-08T11:06:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:06:59 smithi186 ceph-mon[126480]: pgmap v14219: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 561 KiB/s rd, 552 KiB/s wr, 10 op/s 2023-05-08T11:06:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:06:59 smithi133 ceph-mon[125939]: pgmap v14219: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 561 KiB/s rd, 552 KiB/s wr, 10 op/s 2023-05-08T11:06:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:06:59 smithi096 ceph-mon[124666]: pgmap v14219: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 561 KiB/s rd, 552 KiB/s wr, 10 op/s 2023-05-08T11:07:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26558.174057 secs 2023-05-08T11:07:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26558.730416 secs 2023-05-08T11:07:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26558.174057 secs 2023-05-08T11:07:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26558.730416 secs 2023-05-08T11:07:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26558.174057 secs 2023-05-08T11:07:00.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26558.730416 secs 2023-05-08T11:07:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:01 smithi186 ceph-mon[126480]: pgmap v14220: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 580 KiB/s rd, 570 KiB/s wr, 13 op/s 2023-05-08T11:07:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:01 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:07:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:07:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:07:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:01 smithi133 ceph-mon[125939]: pgmap v14220: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 580 KiB/s rd, 570 KiB/s wr, 13 op/s 2023-05-08T11:07:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:01 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:07:01.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:07:01.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:07:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:01 smithi096 ceph-mon[124666]: pgmap v14220: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 580 KiB/s rd, 570 KiB/s wr, 13 op/s 2023-05-08T11:07:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:01 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:07:01.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:07:01.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:07:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:03 smithi186 ceph-mon[126480]: pgmap v14221: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 588 KiB/s wr, 10 op/s 2023-05-08T11:07:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:03 smithi133 ceph-mon[125939]: pgmap v14221: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 588 KiB/s wr, 10 op/s 2023-05-08T11:07:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:03 smithi096 ceph-mon[124666]: pgmap v14221: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 588 KiB/s wr, 10 op/s 2023-05-08T11:07:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26563.174203 secs 2023-05-08T11:07:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:05 smithi186 ceph-mon[126480]: pgmap v14222: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 588 KiB/s wr, 10 op/s 2023-05-08T11:07:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26563.730551 secs 2023-05-08T11:07:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26563.174203 secs 2023-05-08T11:07:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:05 smithi133 ceph-mon[125939]: pgmap v14222: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 588 KiB/s wr, 10 op/s 2023-05-08T11:07:05.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26563.730551 secs 2023-05-08T11:07:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26563.174203 secs 2023-05-08T11:07:05.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:05 smithi096 ceph-mon[124666]: pgmap v14222: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 588 KiB/s wr, 10 op/s 2023-05-08T11:07:05.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26563.730551 secs 2023-05-08T11:07:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:07 smithi186 ceph-mon[126480]: pgmap v14223: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 666 KiB/s rd, 907 KiB/s wr, 17 op/s 2023-05-08T11:07:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:07 smithi133 ceph-mon[125939]: pgmap v14223: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 666 KiB/s rd, 907 KiB/s wr, 17 op/s 2023-05-08T11:07:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:07 smithi096 ceph-mon[124666]: pgmap v14223: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 666 KiB/s rd, 907 KiB/s wr, 17 op/s 2023-05-08T11:07:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:09 smithi186 ceph-mon[126480]: pgmap v14224: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 472 KiB/s wr, 11 op/s 2023-05-08T11:07:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26568.174360 secs 2023-05-08T11:07:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:09 smithi133 ceph-mon[125939]: pgmap v14224: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 472 KiB/s wr, 11 op/s 2023-05-08T11:07:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26568.174360 secs 2023-05-08T11:07:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:09 smithi096 ceph-mon[124666]: pgmap v14224: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 472 KiB/s wr, 11 op/s 2023-05-08T11:07:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26568.174360 secs 2023-05-08T11:07:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:10 smithi133 ceph-mon[125939]: pgmap v14225: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 569 KiB/s rd, 577 KiB/s wr, 25 op/s 2023-05-08T11:07:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:10 smithi096 ceph-mon[124666]: pgmap v14225: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 569 KiB/s rd, 577 KiB/s wr, 25 op/s 2023-05-08T11:07:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:10 smithi186 ceph-mon[126480]: pgmap v14225: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 569 KiB/s rd, 577 KiB/s wr, 25 op/s 2023-05-08T11:07:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:13 smithi186 ceph-mon[126480]: pgmap v14226: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 550 KiB/s rd, 559 KiB/s wr, 21 op/s 2023-05-08T11:07:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:13 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:07:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:13 smithi133 ceph-mon[125939]: pgmap v14226: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 550 KiB/s rd, 559 KiB/s wr, 21 op/s 2023-05-08T11:07:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:13 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:07:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:13 smithi096 ceph-mon[124666]: pgmap v14226: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 550 KiB/s rd, 559 KiB/s wr, 21 op/s 2023-05-08T11:07:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:13 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:07:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:14 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:07:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:14 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:07:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:14 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:07:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:14 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:07:14.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:14 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:07:14.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:14 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:07:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:14 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:07:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:14 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:07:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:14 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:07:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26573.174413 secs 2023-05-08T11:07:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:15 smithi186 ceph-mon[126480]: pgmap v14227: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 546 KiB/s rd, 424 KiB/s wr, 20 op/s 2023-05-08T11:07:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26573.174413 secs 2023-05-08T11:07:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:15 smithi133 ceph-mon[125939]: pgmap v14227: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 546 KiB/s rd, 424 KiB/s wr, 20 op/s 2023-05-08T11:07:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26573.174413 secs 2023-05-08T11:07:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:15 smithi096 ceph-mon[124666]: pgmap v14227: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 546 KiB/s rd, 424 KiB/s wr, 20 op/s 2023-05-08T11:07:17.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:17 smithi186 ceph-mon[126480]: pgmap v14228: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 734 KiB/s rd, 610 KiB/s wr, 24 op/s 2023-05-08T11:07:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:17 smithi133 ceph-mon[125939]: pgmap v14228: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 734 KiB/s rd, 610 KiB/s wr, 24 op/s 2023-05-08T11:07:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:17 smithi096 ceph-mon[124666]: pgmap v14228: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 734 KiB/s rd, 610 KiB/s wr, 24 op/s 2023-05-08T11:07:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:19 smithi186 ceph-mon[126480]: pgmap v14229: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 534 KiB/s rd, 291 KiB/s wr, 17 op/s 2023-05-08T11:07:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:19 smithi133 ceph-mon[125939]: pgmap v14229: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 534 KiB/s rd, 291 KiB/s wr, 17 op/s 2023-05-08T11:07:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:19 smithi096 ceph-mon[124666]: pgmap v14229: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 534 KiB/s rd, 291 KiB/s wr, 17 op/s 2023-05-08T11:07:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26578.174486 secs 2023-05-08T11:07:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26578.174486 secs 2023-05-08T11:07:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26578.174486 secs 2023-05-08T11:07:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:21 smithi186 ceph-mon[126480]: pgmap v14230: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 535 KiB/s rd, 291 KiB/s wr, 20 op/s 2023-05-08T11:07:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:07:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:07:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:07:21.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:07:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:21 smithi133 ceph-mon[125939]: pgmap v14230: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 535 KiB/s rd, 291 KiB/s wr, 20 op/s 2023-05-08T11:07:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:07:21.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:07:21.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:07:21.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:07:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:21 smithi096 ceph-mon[124666]: pgmap v14230: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 535 KiB/s rd, 291 KiB/s wr, 20 op/s 2023-05-08T11:07:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:07:21.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:07:21.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:07:21.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:07:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:22 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:07:22.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:22 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T11:07:22.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:22 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T11:07:22.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:22 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:07:22.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:22 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:07:22.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:22 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T11:07:22.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:22 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T11:07:22.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:22 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:07:22.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:22 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:07:22.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:22 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T11:07:22.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:22 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T11:07:22.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:22 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:07:23.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:23 smithi186 ceph-mon[126480]: pgmap v14231: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 187 KiB/s wr, 6 op/s 2023-05-08T11:07:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:23 smithi133 ceph-mon[125939]: pgmap v14231: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 187 KiB/s wr, 6 op/s 2023-05-08T11:07:23.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:23 smithi096 ceph-mon[124666]: pgmap v14231: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 187 KiB/s wr, 6 op/s 2023-05-08T11:07:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26583.174561 secs 2023-05-08T11:07:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:25 smithi186 ceph-mon[126480]: pgmap v14232: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 187 KiB/s wr, 6 op/s 2023-05-08T11:07:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26583.731037 secs 2023-05-08T11:07:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26583.174561 secs 2023-05-08T11:07:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:25 smithi133 ceph-mon[125939]: pgmap v14232: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 187 KiB/s wr, 6 op/s 2023-05-08T11:07:25.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26583.731037 secs 2023-05-08T11:07:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26583.174561 secs 2023-05-08T11:07:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:25 smithi096 ceph-mon[124666]: pgmap v14232: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 187 KiB/s wr, 6 op/s 2023-05-08T11:07:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26583.731037 secs 2023-05-08T11:07:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:26 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:07:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:26 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:07:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:26 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:07:26.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26585.018324 secs 2023-05-08T11:07:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:26 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:07:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:26 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:07:26.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:26 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:07:26.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26585.018324 secs 2023-05-08T11:07:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:26 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:07:26.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:26 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:07:26.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:26 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:07:26.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26585.018324 secs 2023-05-08T11:07:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:27 smithi186 ceph-mon[126480]: pgmap v14233: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 489 KiB/s rd, 508 KiB/s wr, 13 op/s 2023-05-08T11:07:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:27 smithi133 ceph-mon[125939]: pgmap v14233: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 489 KiB/s rd, 508 KiB/s wr, 13 op/s 2023-05-08T11:07:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:27 smithi096 ceph-mon[124666]: pgmap v14233: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 489 KiB/s rd, 508 KiB/s wr, 13 op/s 2023-05-08T11:07:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:29 smithi186 ceph-mon[126480]: pgmap v14234: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 321 KiB/s wr, 9 op/s 2023-05-08T11:07:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:29 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:07:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:29 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:07:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:29 smithi133 ceph-mon[125939]: pgmap v14234: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 321 KiB/s wr, 9 op/s 2023-05-08T11:07:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:29 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:07:29.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:29 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:07:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:29 smithi096 ceph-mon[124666]: pgmap v14234: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 321 KiB/s wr, 9 op/s 2023-05-08T11:07:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:29 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:07:29.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:29 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:07:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26588.174635 secs 2023-05-08T11:07:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26588.731098 secs 2023-05-08T11:07:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26588.174635 secs 2023-05-08T11:07:30.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26588.731098 secs 2023-05-08T11:07:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26588.174635 secs 2023-05-08T11:07:30.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26588.731098 secs 2023-05-08T11:07:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:31 smithi186 ceph-mon[126480]: pgmap v14235: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 394 KiB/s rd, 624 KiB/s wr, 13 op/s 2023-05-08T11:07:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26590.018442 secs 2023-05-08T11:07:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:31 smithi133 ceph-mon[125939]: pgmap v14235: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 394 KiB/s rd, 624 KiB/s wr, 13 op/s 2023-05-08T11:07:31.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26590.018442 secs 2023-05-08T11:07:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:31 smithi096 ceph-mon[124666]: pgmap v14235: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 394 KiB/s rd, 624 KiB/s wr, 13 op/s 2023-05-08T11:07:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26590.018442 secs 2023-05-08T11:07:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:32 smithi186 ceph-mon[126480]: osdmap e966: 12 total, 12 up, 12 in 2023-05-08T11:07:32.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:32 smithi133 ceph-mon[125939]: osdmap e966: 12 total, 12 up, 12 in 2023-05-08T11:07:32.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:32 smithi096 ceph-mon[124666]: osdmap e966: 12 total, 12 up, 12 in 2023-05-08T11:07:33.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:33 smithi186 ceph-mon[126480]: pgmap v14237: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 748 KiB/s wr, 13 op/s 2023-05-08T11:07:33.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:33 smithi133 ceph-mon[125939]: pgmap v14237: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 748 KiB/s wr, 13 op/s 2023-05-08T11:07:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:33 smithi096 ceph-mon[124666]: pgmap v14237: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 748 KiB/s wr, 13 op/s 2023-05-08T11:07:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26593.174745 secs 2023-05-08T11:07:35.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:35 smithi186 ceph-mon[126480]: pgmap v14238: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 748 KiB/s wr, 13 op/s 2023-05-08T11:07:35.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26593.731201 secs 2023-05-08T11:07:35.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:35 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:07:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26593.174745 secs 2023-05-08T11:07:35.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:35 smithi133 ceph-mon[125939]: pgmap v14238: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 748 KiB/s wr, 13 op/s 2023-05-08T11:07:35.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26593.731201 secs 2023-05-08T11:07:35.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:35 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:07:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26593.174745 secs 2023-05-08T11:07:35.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:35 smithi096 ceph-mon[124666]: pgmap v14238: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 748 KiB/s wr, 13 op/s 2023-05-08T11:07:35.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26593.731201 secs 2023-05-08T11:07:35.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:35 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:07:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26595.018507 secs 2023-05-08T11:07:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26595.018507 secs 2023-05-08T11:07:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26595.018507 secs 2023-05-08T11:07:37.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:37 smithi186 ceph-mon[126480]: pgmap v14239: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 456 KiB/s rd, 455 KiB/s wr, 10 op/s 2023-05-08T11:07:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:37 smithi133 ceph-mon[125939]: pgmap v14239: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 456 KiB/s rd, 455 KiB/s wr, 10 op/s 2023-05-08T11:07:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:37 smithi096 ceph-mon[124666]: pgmap v14239: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 456 KiB/s rd, 455 KiB/s wr, 10 op/s 2023-05-08T11:07:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:39 smithi186 ceph-mon[126480]: pgmap v14240: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 456 KiB/s rd, 455 KiB/s wr, 10 op/s 2023-05-08T11:07:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:39 smithi133 ceph-mon[125939]: pgmap v14240: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 456 KiB/s rd, 455 KiB/s wr, 10 op/s 2023-05-08T11:07:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:39 smithi096 ceph-mon[124666]: pgmap v14240: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 456 KiB/s rd, 455 KiB/s wr, 10 op/s 2023-05-08T11:07:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26598.174911 secs 2023-05-08T11:07:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26598.731294 secs 2023-05-08T11:07:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:40 smithi186 ceph-mon[126480]: osdmap e967: 12 total, 12 up, 12 in 2023-05-08T11:07:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26598.174911 secs 2023-05-08T11:07:40.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26598.731294 secs 2023-05-08T11:07:40.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:40 smithi133 ceph-mon[125939]: osdmap e967: 12 total, 12 up, 12 in 2023-05-08T11:07:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26598.174911 secs 2023-05-08T11:07:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26598.731294 secs 2023-05-08T11:07:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:40 smithi096 ceph-mon[124666]: osdmap e967: 12 total, 12 up, 12 in 2023-05-08T11:07:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:41 smithi186 ceph-mon[126480]: pgmap v14242: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 226 KiB/s wr, 9 op/s 2023-05-08T11:07:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26600.018648 secs 2023-05-08T11:07:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:41 smithi133 ceph-mon[125939]: pgmap v14242: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 226 KiB/s wr, 9 op/s 2023-05-08T11:07:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26600.018648 secs 2023-05-08T11:07:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:41 smithi096 ceph-mon[124666]: pgmap v14242: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 226 KiB/s wr, 9 op/s 2023-05-08T11:07:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26600.018648 secs 2023-05-08T11:07:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:43 smithi186 ceph-mon[126480]: pgmap v14243: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 201 KiB/s wr, 8 op/s 2023-05-08T11:07:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:43 smithi133 ceph-mon[125939]: pgmap v14243: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 201 KiB/s wr, 8 op/s 2023-05-08T11:07:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:43 smithi096 ceph-mon[124666]: pgmap v14243: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 201 KiB/s wr, 8 op/s 2023-05-08T11:07:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26603.175041 secs 2023-05-08T11:07:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26603.175041 secs 2023-05-08T11:07:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26603.175041 secs 2023-05-08T11:07:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:45 smithi186 ceph-mon[126480]: pgmap v14244: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 201 KiB/s wr, 8 op/s 2023-05-08T11:07:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26603.731410 secs 2023-05-08T11:07:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:45 smithi133 ceph-mon[125939]: pgmap v14244: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 201 KiB/s wr, 8 op/s 2023-05-08T11:07:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26603.731410 secs 2023-05-08T11:07:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:45 smithi096 ceph-mon[124666]: pgmap v14244: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 201 KiB/s wr, 8 op/s 2023-05-08T11:07:45.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26603.731410 secs 2023-05-08T11:07:47.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:47 smithi133 ceph-mon[125939]: pgmap v14245: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 223 KiB/s wr, 7 op/s 2023-05-08T11:07:47.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:47 smithi096 ceph-mon[124666]: pgmap v14245: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 223 KiB/s wr, 7 op/s 2023-05-08T11:07:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:47 smithi186 ceph-mon[126480]: pgmap v14245: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 223 KiB/s wr, 7 op/s 2023-05-08T11:07:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:07:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:07:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:07:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:49 smithi133 ceph-mon[125939]: pgmap v14246: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 223 KiB/s wr, 7 op/s 2023-05-08T11:07:49.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:07:49.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:07:49.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:07:49.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26608.175163 secs 2023-05-08T11:07:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:49 smithi096 ceph-mon[124666]: pgmap v14246: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 223 KiB/s wr, 7 op/s 2023-05-08T11:07:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:07:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:07:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:07:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26608.175163 secs 2023-05-08T11:07:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:49 smithi186 ceph-mon[126480]: pgmap v14246: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 223 KiB/s wr, 7 op/s 2023-05-08T11:07:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:07:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:07:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:07:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26608.175163 secs 2023-05-08T11:07:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26608.731551 secs 2023-05-08T11:07:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26608.731551 secs 2023-05-08T11:07:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26608.731551 secs 2023-05-08T11:07:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:51 smithi133 ceph-mon[125939]: pgmap v14247: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 113 KiB/s wr, 7 op/s 2023-05-08T11:07:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:51 smithi096 ceph-mon[124666]: pgmap v14247: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 113 KiB/s wr, 7 op/s 2023-05-08T11:07:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:51 smithi186 ceph-mon[126480]: pgmap v14247: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 113 KiB/s wr, 7 op/s 2023-05-08T11:07:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:53 smithi133 ceph-mon[125939]: pgmap v14248: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 388 KiB/s wr, 7 op/s 2023-05-08T11:07:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:53 smithi096 ceph-mon[124666]: pgmap v14248: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 388 KiB/s wr, 7 op/s 2023-05-08T11:07:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:53 smithi186 ceph-mon[126480]: pgmap v14248: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 388 KiB/s wr, 7 op/s 2023-05-08T11:07:54.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26613.175324 secs 2023-05-08T11:07:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26613.175324 secs 2023-05-08T11:07:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26613.175324 secs 2023-05-08T11:07:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:55 smithi133 ceph-mon[125939]: pgmap v14249: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 388 KiB/s wr, 7 op/s 2023-05-08T11:07:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:55 smithi096 ceph-mon[124666]: pgmap v14249: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 388 KiB/s wr, 7 op/s 2023-05-08T11:07:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:55 smithi186 ceph-mon[126480]: pgmap v14249: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 388 KiB/s wr, 7 op/s 2023-05-08T11:07:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:07:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:07:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:07:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:57 smithi133 ceph-mon[125939]: pgmap v14250: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 980 KiB/s rd, 763 KiB/s wr, 12 op/s 2023-05-08T11:07:57.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:57 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:07:57.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:07:57.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:07:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:57 smithi096 ceph-mon[124666]: pgmap v14250: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 980 KiB/s rd, 763 KiB/s wr, 12 op/s 2023-05-08T11:07:57.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:57 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:07:57.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:07:57.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:07:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:57 smithi186 ceph-mon[126480]: pgmap v14250: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 980 KiB/s rd, 763 KiB/s wr, 12 op/s 2023-05-08T11:07:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:57 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:07:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:07:57.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:07:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:59 smithi133 ceph-mon[125939]: pgmap v14251: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 842 KiB/s rd, 669 KiB/s wr, 9 op/s 2023-05-08T11:07:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:07:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26618.175445 secs 2023-05-08T11:07:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:59 smithi096 ceph-mon[124666]: pgmap v14251: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 842 KiB/s rd, 669 KiB/s wr, 9 op/s 2023-05-08T11:07:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:07:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26618.175445 secs 2023-05-08T11:07:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:59 smithi186 ceph-mon[126480]: pgmap v14251: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 842 KiB/s rd, 669 KiB/s wr, 9 op/s 2023-05-08T11:07:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:07:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26618.175445 secs 2023-05-08T11:08:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26618.731741 secs 2023-05-08T11:08:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26618.731741 secs 2023-05-08T11:08:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26618.731741 secs 2023-05-08T11:08:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:01 smithi133 ceph-mon[125939]: pgmap v14252: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 14 op/s 2023-05-08T11:08:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:08:01.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:08:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:01 smithi096 ceph-mon[124666]: pgmap v14252: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 14 op/s 2023-05-08T11:08:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:08:01.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:08:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:01 smithi186 ceph-mon[126480]: pgmap v14252: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 14 op/s 2023-05-08T11:08:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:08:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:08:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:03 smithi133 ceph-mon[125939]: pgmap v14253: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T11:08:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:03 smithi096 ceph-mon[124666]: pgmap v14253: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T11:08:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:03 smithi186 ceph-mon[126480]: pgmap v14253: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T11:08:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26623.175598 secs 2023-05-08T11:08:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26623.175598 secs 2023-05-08T11:08:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26623.175598 secs 2023-05-08T11:08:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:05 smithi133 ceph-mon[125939]: pgmap v14254: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 736 KiB/s wr, 10 op/s 2023-05-08T11:08:05.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26623.731857 secs 2023-05-08T11:08:05.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:05 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:08:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:05 smithi096 ceph-mon[124666]: pgmap v14254: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 736 KiB/s wr, 10 op/s 2023-05-08T11:08:05.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26623.731857 secs 2023-05-08T11:08:05.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:05 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:08:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:05 smithi186 ceph-mon[126480]: pgmap v14254: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 736 KiB/s wr, 10 op/s 2023-05-08T11:08:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26623.731857 secs 2023-05-08T11:08:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:05 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:08:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:07 smithi133 ceph-mon[125939]: pgmap v14255: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.1 MiB/s wr, 27 op/s 2023-05-08T11:08:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:07 smithi096 ceph-mon[124666]: pgmap v14255: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.1 MiB/s wr, 27 op/s 2023-05-08T11:08:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:07 smithi186 ceph-mon[126480]: pgmap v14255: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.1 MiB/s wr, 27 op/s 2023-05-08T11:08:09.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:09 smithi133 ceph-mon[125939]: pgmap v14256: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 839 KiB/s rd, 723 KiB/s wr, 22 op/s 2023-05-08T11:08:09.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26628.175691 secs 2023-05-08T11:08:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:09 smithi096 ceph-mon[124666]: pgmap v14256: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 839 KiB/s rd, 723 KiB/s wr, 22 op/s 2023-05-08T11:08:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26628.175691 secs 2023-05-08T11:08:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:09 smithi186 ceph-mon[126480]: pgmap v14256: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 839 KiB/s rd, 723 KiB/s wr, 22 op/s 2023-05-08T11:08:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26628.175691 secs 2023-05-08T11:08:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26628.731967 secs 2023-05-08T11:08:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26628.731967 secs 2023-05-08T11:08:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26628.731967 secs 2023-05-08T11:08:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:11 smithi133 ceph-mon[125939]: pgmap v14257: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1020 KiB/s rd, 725 KiB/s wr, 25 op/s 2023-05-08T11:08:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:11 smithi096 ceph-mon[124666]: pgmap v14257: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1020 KiB/s rd, 725 KiB/s wr, 25 op/s 2023-05-08T11:08:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:11 smithi186 ceph-mon[126480]: pgmap v14257: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1020 KiB/s rd, 725 KiB/s wr, 25 op/s 2023-05-08T11:08:13.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:13 smithi133 ceph-mon[125939]: pgmap v14258: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 546 KiB/s rd, 365 KiB/s wr, 20 op/s 2023-05-08T11:08:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:13 smithi096 ceph-mon[124666]: pgmap v14258: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 546 KiB/s rd, 365 KiB/s wr, 20 op/s 2023-05-08T11:08:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:13 smithi186 ceph-mon[126480]: pgmap v14258: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 546 KiB/s rd, 365 KiB/s wr, 20 op/s 2023-05-08T11:08:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26633.175808 secs 2023-05-08T11:08:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26633.175808 secs 2023-05-08T11:08:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26633.175808 secs 2023-05-08T11:08:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:15 smithi133 ceph-mon[125939]: pgmap v14259: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 546 KiB/s rd, 365 KiB/s wr, 20 op/s 2023-05-08T11:08:15.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26633.732080 secs 2023-05-08T11:08:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:15 smithi096 ceph-mon[124666]: pgmap v14259: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 546 KiB/s rd, 365 KiB/s wr, 20 op/s 2023-05-08T11:08:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26633.732080 secs 2023-05-08T11:08:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:15 smithi186 ceph-mon[126480]: pgmap v14259: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 546 KiB/s rd, 365 KiB/s wr, 20 op/s 2023-05-08T11:08:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26633.732080 secs 2023-05-08T11:08:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:17 smithi133 ceph-mon[125939]: pgmap v14260: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 691 KiB/s rd, 508 KiB/s wr, 23 op/s 2023-05-08T11:08:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:17 smithi096 ceph-mon[124666]: pgmap v14260: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 691 KiB/s rd, 508 KiB/s wr, 23 op/s 2023-05-08T11:08:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:17 smithi186 ceph-mon[126480]: pgmap v14260: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 691 KiB/s rd, 508 KiB/s wr, 23 op/s 2023-05-08T11:08:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:19 smithi133 ceph-mon[125939]: pgmap v14261: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 146 KiB/s wr, 7 op/s 2023-05-08T11:08:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26638.175908 secs 2023-05-08T11:08:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:19 smithi096 ceph-mon[124666]: pgmap v14261: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 146 KiB/s wr, 7 op/s 2023-05-08T11:08:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26638.175908 secs 2023-05-08T11:08:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:19 smithi186 ceph-mon[126480]: pgmap v14261: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 146 KiB/s wr, 7 op/s 2023-05-08T11:08:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26638.175908 secs 2023-05-08T11:08:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:20 smithi133 ceph-mon[125939]: pgmap v14262: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 786 KiB/s rd, 516 KiB/s wr, 13 op/s 2023-05-08T11:08:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:20 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:08:21.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26640.019564 secs 2023-05-08T11:08:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:20 smithi096 ceph-mon[124666]: pgmap v14262: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 786 KiB/s rd, 516 KiB/s wr, 13 op/s 2023-05-08T11:08:21.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:20 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:08:21.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26640.019564 secs 2023-05-08T11:08:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:20 smithi186 ceph-mon[126480]: pgmap v14262: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 786 KiB/s rd, 516 KiB/s wr, 13 op/s 2023-05-08T11:08:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:20 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:08:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26640.019564 secs 2023-05-08T11:08:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:21 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:08:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:21 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:08:22.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:21 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:08:22.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:21 smithi133 ceph-mon[125939]: osdmap e968: 12 total, 12 up, 12 in 2023-05-08T11:08:22.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:08:22.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:08:22.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:08:22.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:21 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:08:22.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:08:22.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:21 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T11:08:22.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:21 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T11:08:22.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:21 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:08:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:21 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:08:22.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:21 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:08:22.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:21 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:08:22.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:21 smithi096 ceph-mon[124666]: osdmap e968: 12 total, 12 up, 12 in 2023-05-08T11:08:22.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:08:22.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:08:22.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:08:22.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:21 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:08:22.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:08:22.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:21 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T11:08:22.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:21 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T11:08:22.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:21 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:08:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:21 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:08:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:21 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:08:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:21 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:08:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:21 smithi186 ceph-mon[126480]: osdmap e968: 12 total, 12 up, 12 in 2023-05-08T11:08:22.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:08:22.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:08:22.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:08:22.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:21 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:08:22.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:08:22.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:21 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T11:08:22.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:21 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T11:08:22.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:21 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:08:23.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:22 smithi133 ceph-mon[125939]: pgmap v14264: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 726 KiB/s rd, 617 KiB/s wr, 12 op/s 2023-05-08T11:08:23.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:22 smithi096 ceph-mon[124666]: pgmap v14264: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 726 KiB/s rd, 617 KiB/s wr, 12 op/s 2023-05-08T11:08:23.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:22 smithi186 ceph-mon[126480]: pgmap v14264: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 726 KiB/s rd, 617 KiB/s wr, 12 op/s 2023-05-08T11:08:25.212 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26643.176012 secs 2023-05-08T11:08:25.213 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:24 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:08:25.213 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:24 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:08:25.213 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:24 smithi133 ceph-mon[125939]: pgmap v14265: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 726 KiB/s rd, 617 KiB/s wr, 12 op/s 2023-05-08T11:08:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26643.176012 secs 2023-05-08T11:08:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:24 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:08:25.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:24 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:08:25.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:24 smithi096 ceph-mon[124666]: pgmap v14265: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 726 KiB/s rd, 617 KiB/s wr, 12 op/s 2023-05-08T11:08:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26643.176012 secs 2023-05-08T11:08:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:24 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:08:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:24 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:08:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:24 smithi186 ceph-mon[126480]: pgmap v14265: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 726 KiB/s rd, 617 KiB/s wr, 12 op/s 2023-05-08T11:08:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26645.019618 secs 2023-05-08T11:08:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26645.019618 secs 2023-05-08T11:08:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26645.019618 secs 2023-05-08T11:08:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:26 smithi133 ceph-mon[125939]: pgmap v14266: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 730 KiB/s rd, 554 KiB/s wr, 12 op/s 2023-05-08T11:08:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:26 smithi096 ceph-mon[124666]: pgmap v14266: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 730 KiB/s rd, 554 KiB/s wr, 12 op/s 2023-05-08T11:08:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:26 smithi186 ceph-mon[126480]: pgmap v14266: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 730 KiB/s rd, 554 KiB/s wr, 12 op/s 2023-05-08T11:08:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:29 smithi186 ceph-mon[126480]: pgmap v14267: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 730 KiB/s rd, 554 KiB/s wr, 12 op/s 2023-05-08T11:08:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:29 smithi133 ceph-mon[125939]: pgmap v14267: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 730 KiB/s rd, 554 KiB/s wr, 12 op/s 2023-05-08T11:08:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:29 smithi096 ceph-mon[124666]: pgmap v14267: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 730 KiB/s rd, 554 KiB/s wr, 12 op/s 2023-05-08T11:08:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26648.176125 secs 2023-05-08T11:08:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:30 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:08:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:30 smithi186 ceph-mon[126480]: osdmap e969: 12 total, 12 up, 12 in 2023-05-08T11:08:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26648.176125 secs 2023-05-08T11:08:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:30 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:08:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:30 smithi133 ceph-mon[125939]: osdmap e969: 12 total, 12 up, 12 in 2023-05-08T11:08:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26648.176125 secs 2023-05-08T11:08:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:30 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:08:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:30 smithi096 ceph-mon[124666]: osdmap e969: 12 total, 12 up, 12 in 2023-05-08T11:08:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:31 smithi186 ceph-mon[126480]: pgmap v14269: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 122 KiB/s wr, 9 op/s 2023-05-08T11:08:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26650.019708 secs 2023-05-08T11:08:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:31 smithi133 ceph-mon[125939]: pgmap v14269: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 122 KiB/s wr, 9 op/s 2023-05-08T11:08:31.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26650.019708 secs 2023-05-08T11:08:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:31 smithi096 ceph-mon[124666]: pgmap v14269: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 122 KiB/s wr, 9 op/s 2023-05-08T11:08:31.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26650.019708 secs 2023-05-08T11:08:33.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:33 smithi186 ceph-mon[126480]: pgmap v14270: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 110 KiB/s wr, 8 op/s 2023-05-08T11:08:33.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:33 smithi133 ceph-mon[125939]: pgmap v14270: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 110 KiB/s wr, 8 op/s 2023-05-08T11:08:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:33 smithi096 ceph-mon[124666]: pgmap v14270: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 110 KiB/s wr, 8 op/s 2023-05-08T11:08:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26653.176244 secs 2023-05-08T11:08:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:35 smithi133 ceph-mon[125939]: pgmap v14271: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 110 KiB/s wr, 8 op/s 2023-05-08T11:08:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26653.176244 secs 2023-05-08T11:08:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:35 smithi186 ceph-mon[126480]: pgmap v14271: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 110 KiB/s wr, 8 op/s 2023-05-08T11:08:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26653.176244 secs 2023-05-08T11:08:35.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:35 smithi096 ceph-mon[124666]: pgmap v14271: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 110 KiB/s wr, 8 op/s 2023-05-08T11:08:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26655.019863 secs 2023-05-08T11:08:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26655.019863 secs 2023-05-08T11:08:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26655.019863 secs 2023-05-08T11:08:37.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:37 smithi186 ceph-mon[126480]: pgmap v14272: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 353 KiB/s wr, 8 op/s 2023-05-08T11:08:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:37 smithi133 ceph-mon[125939]: pgmap v14272: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 353 KiB/s wr, 8 op/s 2023-05-08T11:08:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:37 smithi096 ceph-mon[124666]: pgmap v14272: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 353 KiB/s wr, 8 op/s 2023-05-08T11:08:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:39 smithi186 ceph-mon[126480]: pgmap v14273: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 353 KiB/s wr, 8 op/s 2023-05-08T11:08:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:39 smithi133 ceph-mon[125939]: pgmap v14273: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 353 KiB/s wr, 8 op/s 2023-05-08T11:08:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:39 smithi096 ceph-mon[124666]: pgmap v14273: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 353 KiB/s wr, 8 op/s 2023-05-08T11:08:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26658.176382 secs 2023-05-08T11:08:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26658.732709 secs 2023-05-08T11:08:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26658.176382 secs 2023-05-08T11:08:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26658.732709 secs 2023-05-08T11:08:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26658.176382 secs 2023-05-08T11:08:40.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26658.732709 secs 2023-05-08T11:08:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:41 smithi186 ceph-mon[126480]: pgmap v14274: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 352 KiB/s wr, 10 op/s 2023-05-08T11:08:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26660.019980 secs 2023-05-08T11:08:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:41 smithi133 ceph-mon[125939]: pgmap v14274: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 352 KiB/s wr, 10 op/s 2023-05-08T11:08:41.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26660.019980 secs 2023-05-08T11:08:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:41 smithi096 ceph-mon[124666]: pgmap v14274: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 352 KiB/s wr, 10 op/s 2023-05-08T11:08:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26660.019980 secs 2023-05-08T11:08:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:42 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:08:42.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:42 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:08:42.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:42 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:08:42.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:42 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:08:42.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:42 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:08:42.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:42 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:08:42.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:42 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:08:42.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:42 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:08:42.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:42 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:08:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:43 smithi186 ceph-mon[126480]: pgmap v14275: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 295 KiB/s wr, 8 op/s 2023-05-08T11:08:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:43 smithi133 ceph-mon[125939]: pgmap v14275: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 295 KiB/s wr, 8 op/s 2023-05-08T11:08:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:43 smithi096 ceph-mon[124666]: pgmap v14275: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 295 KiB/s wr, 8 op/s 2023-05-08T11:08:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26663.176501 secs 2023-05-08T11:08:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:45 smithi186 ceph-mon[126480]: pgmap v14276: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 295 KiB/s wr, 8 op/s 2023-05-08T11:08:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26663.732776 secs 2023-05-08T11:08:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26663.176501 secs 2023-05-08T11:08:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:45 smithi133 ceph-mon[125939]: pgmap v14276: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 295 KiB/s wr, 8 op/s 2023-05-08T11:08:45.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26663.732776 secs 2023-05-08T11:08:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26663.176501 secs 2023-05-08T11:08:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:45 smithi096 ceph-mon[124666]: pgmap v14276: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 295 KiB/s wr, 8 op/s 2023-05-08T11:08:45.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26663.732776 secs 2023-05-08T11:08:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:47 smithi186 ceph-mon[126480]: pgmap v14277: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 404 KiB/s rd, 684 KiB/s wr, 12 op/s 2023-05-08T11:08:47.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:47 smithi133 ceph-mon[125939]: pgmap v14277: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 404 KiB/s rd, 684 KiB/s wr, 12 op/s 2023-05-08T11:08:47.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:47 smithi096 ceph-mon[124666]: pgmap v14277: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 404 KiB/s rd, 684 KiB/s wr, 12 op/s 2023-05-08T11:08:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:08:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:08:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:08:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:49 smithi186 ceph-mon[126480]: pgmap v14278: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 390 KiB/s wr, 8 op/s 2023-05-08T11:08:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:08:49.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:08:49.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:08:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:49 smithi133 ceph-mon[125939]: pgmap v14278: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 390 KiB/s wr, 8 op/s 2023-05-08T11:08:49.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:08:49.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:08:49.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:08:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:49 smithi096 ceph-mon[124666]: pgmap v14278: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 390 KiB/s wr, 8 op/s 2023-05-08T11:08:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:08:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:08:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:08:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26668.176621 secs 2023-05-08T11:08:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26668.176621 secs 2023-05-08T11:08:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26668.176621 secs 2023-05-08T11:08:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:51 smithi186 ceph-mon[126480]: pgmap v14279: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 602 KiB/s rd, 412 KiB/s wr, 13 op/s 2023-05-08T11:08:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:51 smithi133 ceph-mon[125939]: pgmap v14279: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 602 KiB/s rd, 412 KiB/s wr, 13 op/s 2023-05-08T11:08:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:51 smithi096 ceph-mon[124666]: pgmap v14279: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 602 KiB/s rd, 412 KiB/s wr, 13 op/s 2023-05-08T11:08:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:08:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:08:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:08:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:53 smithi186 ceph-mon[126480]: pgmap v14280: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 410 KiB/s wr, 9 op/s 2023-05-08T11:08:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:08:53.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:08:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:53 smithi133 ceph-mon[125939]: pgmap v14280: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 410 KiB/s wr, 9 op/s 2023-05-08T11:08:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:08:53.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:08:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:53 smithi096 ceph-mon[124666]: pgmap v14280: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 410 KiB/s wr, 9 op/s 2023-05-08T11:08:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:08:53.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:08:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26673.176740 secs 2023-05-08T11:08:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:55 smithi186 ceph-mon[126480]: pgmap v14281: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 410 KiB/s wr, 9 op/s 2023-05-08T11:08:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26673.732955 secs 2023-05-08T11:08:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:55 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:08:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26673.176740 secs 2023-05-08T11:08:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:55 smithi133 ceph-mon[125939]: pgmap v14281: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 410 KiB/s wr, 9 op/s 2023-05-08T11:08:55.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26673.732955 secs 2023-05-08T11:08:55.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:55 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:08:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26673.176740 secs 2023-05-08T11:08:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:55 smithi096 ceph-mon[124666]: pgmap v14281: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 410 KiB/s wr, 9 op/s 2023-05-08T11:08:55.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26673.732955 secs 2023-05-08T11:08:55.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:55 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:08:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:57 smithi186 ceph-mon[126480]: pgmap v14282: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 723 KiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T11:08:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:08:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:08:57.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:57 smithi133 ceph-mon[125939]: pgmap v14282: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 723 KiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T11:08:57.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:08:57.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:08:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:57 smithi096 ceph-mon[124666]: pgmap v14282: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 723 KiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T11:08:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:08:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:08:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:08:59 smithi186 ceph-mon[126480]: pgmap v14283: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 615 KiB/s rd, 738 KiB/s wr, 10 op/s 2023-05-08T11:08:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:08:59 smithi133 ceph-mon[125939]: pgmap v14283: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 615 KiB/s rd, 738 KiB/s wr, 10 op/s 2023-05-08T11:08:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:08:59 smithi096 ceph-mon[124666]: pgmap v14283: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 615 KiB/s rd, 738 KiB/s wr, 10 op/s 2023-05-08T11:09:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26678.176868 secs 2023-05-08T11:09:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26678.733039 secs 2023-05-08T11:09:00.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:00 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:09:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26678.176868 secs 2023-05-08T11:09:00.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26678.733039 secs 2023-05-08T11:09:00.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:00 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:09:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26678.176868 secs 2023-05-08T11:09:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26678.733039 secs 2023-05-08T11:09:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:00 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:09:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:01 smithi133 ceph-mon[125939]: pgmap v14284: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 16 op/s 2023-05-08T11:09:01.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26680.020453 secs 2023-05-08T11:09:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:01 smithi096 ceph-mon[124666]: pgmap v14284: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 16 op/s 2023-05-08T11:09:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26680.020453 secs 2023-05-08T11:09:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:01 smithi186 ceph-mon[126480]: pgmap v14284: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 16 op/s 2023-05-08T11:09:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26680.020453 secs 2023-05-08T11:09:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:03 smithi133 ceph-mon[125939]: pgmap v14285: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 740 KiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T11:09:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:03 smithi096 ceph-mon[124666]: pgmap v14285: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 740 KiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T11:09:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:03 smithi186 ceph-mon[126480]: pgmap v14285: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 740 KiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T11:09:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26683.176986 secs 2023-05-08T11:09:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26683.176986 secs 2023-05-08T11:09:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26683.176986 secs 2023-05-08T11:09:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:05 smithi133 ceph-mon[125939]: pgmap v14286: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 740 KiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T11:09:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26683.733165 secs 2023-05-08T11:09:05.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:09:05.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:09:05.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:05 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:09:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:05 smithi096 ceph-mon[124666]: pgmap v14286: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 740 KiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T11:09:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26683.733165 secs 2023-05-08T11:09:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:09:05.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:09:05.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:05 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:09:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:05 smithi186 ceph-mon[126480]: pgmap v14286: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 740 KiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T11:09:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26683.733165 secs 2023-05-08T11:09:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:09:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:09:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:05 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:09:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26685.020588 secs 2023-05-08T11:09:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26685.020588 secs 2023-05-08T11:09:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26685.020588 secs 2023-05-08T11:09:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:07 smithi133 ceph-mon[125939]: pgmap v14287: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 29 op/s 2023-05-08T11:09:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:07 smithi133 ceph-mon[125939]: osdmap e970: 12 total, 12 up, 12 in 2023-05-08T11:09:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:07 smithi096 ceph-mon[124666]: pgmap v14287: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 29 op/s 2023-05-08T11:09:07.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:07 smithi096 ceph-mon[124666]: osdmap e970: 12 total, 12 up, 12 in 2023-05-08T11:09:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:07 smithi186 ceph-mon[126480]: pgmap v14287: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 29 op/s 2023-05-08T11:09:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:07 smithi186 ceph-mon[126480]: osdmap e970: 12 total, 12 up, 12 in 2023-05-08T11:09:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:09 smithi133 ceph-mon[125939]: pgmap v14289: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 30 op/s 2023-05-08T11:09:09.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26688.177130 secs 2023-05-08T11:09:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:09 smithi096 ceph-mon[124666]: pgmap v14289: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 30 op/s 2023-05-08T11:09:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26688.177130 secs 2023-05-08T11:09:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:09 smithi186 ceph-mon[126480]: pgmap v14289: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 30 op/s 2023-05-08T11:09:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26688.177130 secs 2023-05-08T11:09:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26688.733289 secs 2023-05-08T11:09:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26688.733289 secs 2023-05-08T11:09:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26688.733289 secs 2023-05-08T11:09:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:11 smithi133 ceph-mon[125939]: pgmap v14290: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 977 KiB/s rd, 439 KiB/s wr, 27 op/s 2023-05-08T11:09:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26690.020708 secs 2023-05-08T11:09:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:11 smithi096 ceph-mon[124666]: pgmap v14290: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 977 KiB/s rd, 439 KiB/s wr, 27 op/s 2023-05-08T11:09:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26690.020708 secs 2023-05-08T11:09:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:11 smithi186 ceph-mon[126480]: pgmap v14290: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 977 KiB/s rd, 439 KiB/s wr, 27 op/s 2023-05-08T11:09:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26690.020708 secs 2023-05-08T11:09:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:13 smithi133 ceph-mon[125939]: pgmap v14291: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 977 KiB/s rd, 439 KiB/s wr, 27 op/s 2023-05-08T11:09:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:13 smithi096 ceph-mon[124666]: pgmap v14291: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 977 KiB/s rd, 439 KiB/s wr, 27 op/s 2023-05-08T11:09:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:13 smithi186 ceph-mon[126480]: pgmap v14291: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 977 KiB/s rd, 439 KiB/s wr, 27 op/s 2023-05-08T11:09:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26693.177286 secs 2023-05-08T11:09:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26693.177286 secs 2023-05-08T11:09:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26693.177286 secs 2023-05-08T11:09:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:15 smithi133 ceph-mon[125939]: pgmap v14292: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 977 KiB/s rd, 439 KiB/s wr, 27 op/s 2023-05-08T11:09:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26693.733413 secs 2023-05-08T11:09:15.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:15 smithi133 ceph-mon[125939]: osdmap e971: 12 total, 12 up, 12 in 2023-05-08T11:09:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:15 smithi096 ceph-mon[124666]: pgmap v14292: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 977 KiB/s rd, 439 KiB/s wr, 27 op/s 2023-05-08T11:09:15.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26693.733413 secs 2023-05-08T11:09:15.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:15 smithi096 ceph-mon[124666]: osdmap e971: 12 total, 12 up, 12 in 2023-05-08T11:09:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:15 smithi186 ceph-mon[126480]: pgmap v14292: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 977 KiB/s rd, 439 KiB/s wr, 27 op/s 2023-05-08T11:09:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26693.733413 secs 2023-05-08T11:09:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:15 smithi186 ceph-mon[126480]: osdmap e971: 12 total, 12 up, 12 in 2023-05-08T11:09:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26695.020834 secs 2023-05-08T11:09:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26695.020834 secs 2023-05-08T11:09:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26695.020834 secs 2023-05-08T11:09:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:17 smithi133 ceph-mon[125939]: pgmap v14294: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 229 KiB/s wr, 8 op/s 2023-05-08T11:09:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:17 smithi096 ceph-mon[124666]: pgmap v14294: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 229 KiB/s wr, 8 op/s 2023-05-08T11:09:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:17 smithi186 ceph-mon[126480]: pgmap v14294: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 229 KiB/s wr, 8 op/s 2023-05-08T11:09:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:19 smithi133 ceph-mon[125939]: pgmap v14295: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 226 KiB/s wr, 8 op/s 2023-05-08T11:09:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26698.177418 secs 2023-05-08T11:09:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:19 smithi096 ceph-mon[124666]: pgmap v14295: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 226 KiB/s wr, 8 op/s 2023-05-08T11:09:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26698.177418 secs 2023-05-08T11:09:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:19 smithi186 ceph-mon[126480]: pgmap v14295: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 226 KiB/s wr, 8 op/s 2023-05-08T11:09:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26698.177418 secs 2023-05-08T11:09:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26698.733510 secs 2023-05-08T11:09:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26698.733510 secs 2023-05-08T11:09:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26698.733510 secs 2023-05-08T11:09:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:21 smithi133 ceph-mon[125939]: pgmap v14296: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 360 KiB/s wr, 10 op/s 2023-05-08T11:09:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26700.020954 secs 2023-05-08T11:09:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:21 smithi096 ceph-mon[124666]: pgmap v14296: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 360 KiB/s wr, 10 op/s 2023-05-08T11:09:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26700.020954 secs 2023-05-08T11:09:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:21 smithi186 ceph-mon[126480]: pgmap v14296: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 360 KiB/s wr, 10 op/s 2023-05-08T11:09:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26700.020954 secs 2023-05-08T11:09:22.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:22 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:09:22.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:22 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:09:22.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:22 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:09:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:23 smithi133 ceph-mon[125939]: pgmap v14297: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 360 KiB/s wr, 10 op/s 2023-05-08T11:09:23.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:09:23.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:09:23.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:23 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:09:23.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:09:23.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:23 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T11:09:23.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:23 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T11:09:23.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:23 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:09:23.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:23 smithi096 ceph-mon[124666]: pgmap v14297: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 360 KiB/s wr, 10 op/s 2023-05-08T11:09:23.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:09:23.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:09:23.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:23 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:09:23.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:09:23.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:23 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T11:09:23.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:23 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T11:09:23.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:23 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:09:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:23 smithi186 ceph-mon[126480]: pgmap v14297: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 360 KiB/s wr, 10 op/s 2023-05-08T11:09:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:09:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:09:23.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:23 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:09:23.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:09:23.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:23 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T11:09:23.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:23 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T11:09:23.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:23 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:09:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26703.177551 secs 2023-05-08T11:09:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26703.177551 secs 2023-05-08T11:09:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26703.177551 secs 2023-05-08T11:09:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:25 smithi133 ceph-mon[125939]: pgmap v14298: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 360 KiB/s wr, 10 op/s 2023-05-08T11:09:25.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26703.733556 secs 2023-05-08T11:09:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:25 smithi096 ceph-mon[124666]: pgmap v14298: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 360 KiB/s wr, 10 op/s 2023-05-08T11:09:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26703.733556 secs 2023-05-08T11:09:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:25 smithi186 ceph-mon[126480]: pgmap v14298: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 360 KiB/s wr, 10 op/s 2023-05-08T11:09:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26703.733556 secs 2023-05-08T11:09:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26705.021072 secs 2023-05-08T11:09:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26705.021072 secs 2023-05-08T11:09:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26705.021072 secs 2023-05-08T11:09:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:27 smithi133 ceph-mon[125939]: pgmap v14299: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 303 KiB/s wr, 9 op/s 2023-05-08T11:09:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:27 smithi096 ceph-mon[124666]: pgmap v14299: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 303 KiB/s wr, 9 op/s 2023-05-08T11:09:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:27 smithi186 ceph-mon[126480]: pgmap v14299: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 303 KiB/s wr, 9 op/s 2023-05-08T11:09:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:29 smithi133 ceph-mon[125939]: pgmap v14300: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 255 KiB/s rd, 279 KiB/s wr, 8 op/s 2023-05-08T11:09:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26708.177646 secs 2023-05-08T11:09:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:29 smithi096 ceph-mon[124666]: pgmap v14300: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 255 KiB/s rd, 279 KiB/s wr, 8 op/s 2023-05-08T11:09:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26708.177646 secs 2023-05-08T11:09:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:29 smithi186 ceph-mon[126480]: pgmap v14300: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 255 KiB/s rd, 279 KiB/s wr, 8 op/s 2023-05-08T11:09:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26708.177646 secs 2023-05-08T11:09:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26708.733630 secs 2023-05-08T11:09:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26708.733630 secs 2023-05-08T11:09:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26708.733630 secs 2023-05-08T11:09:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:31 smithi133 ceph-mon[125939]: pgmap v14301: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 352 KiB/s rd, 279 KiB/s wr, 12 op/s 2023-05-08T11:09:31.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26710.021173 secs 2023-05-08T11:09:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:31 smithi096 ceph-mon[124666]: pgmap v14301: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 352 KiB/s rd, 279 KiB/s wr, 12 op/s 2023-05-08T11:09:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26710.021173 secs 2023-05-08T11:09:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:31 smithi186 ceph-mon[126480]: pgmap v14301: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 352 KiB/s rd, 279 KiB/s wr, 12 op/s 2023-05-08T11:09:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26710.021173 secs 2023-05-08T11:09:33.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:33 smithi133 ceph-mon[125939]: pgmap v14302: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 167 KiB/s wr, 8 op/s 2023-05-08T11:09:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:33 smithi096 ceph-mon[124666]: pgmap v14302: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 167 KiB/s wr, 8 op/s 2023-05-08T11:09:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:33 smithi186 ceph-mon[126480]: pgmap v14302: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 167 KiB/s wr, 8 op/s 2023-05-08T11:09:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26713.177751 secs 2023-05-08T11:09:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26713.177751 secs 2023-05-08T11:09:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26713.177751 secs 2023-05-08T11:09:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26713.733763 secs 2023-05-08T11:09:35.559 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:35 smithi133 ceph-mon[125939]: pgmap v14303: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 167 KiB/s wr, 8 op/s 2023-05-08T11:09:35.560 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26713.733763 secs 2023-05-08T11:09:35.560 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:35 smithi096 ceph-mon[124666]: pgmap v14303: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 167 KiB/s wr, 8 op/s 2023-05-08T11:09:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26713.733763 secs 2023-05-08T11:09:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:35 smithi186 ceph-mon[126480]: pgmap v14303: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 167 KiB/s wr, 8 op/s 2023-05-08T11:09:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26715.021289 secs 2023-05-08T11:09:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26715.021289 secs 2023-05-08T11:09:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26715.021289 secs 2023-05-08T11:09:37.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:37 smithi133 ceph-mon[125939]: pgmap v14304: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 360 KiB/s wr, 11 op/s 2023-05-08T11:09:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:37 smithi096 ceph-mon[124666]: pgmap v14304: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 360 KiB/s wr, 11 op/s 2023-05-08T11:09:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:37 smithi186 ceph-mon[126480]: pgmap v14304: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 360 KiB/s wr, 11 op/s 2023-05-08T11:09:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:39 smithi133 ceph-mon[125939]: pgmap v14305: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 194 KiB/s wr, 7 op/s 2023-05-08T11:09:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26718.177863 secs 2023-05-08T11:09:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:39 smithi096 ceph-mon[124666]: pgmap v14305: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 194 KiB/s wr, 7 op/s 2023-05-08T11:09:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26718.177863 secs 2023-05-08T11:09:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:39 smithi186 ceph-mon[126480]: pgmap v14305: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 194 KiB/s wr, 7 op/s 2023-05-08T11:09:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26718.177863 secs 2023-05-08T11:09:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26718.733894 secs 2023-05-08T11:09:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26718.733894 secs 2023-05-08T11:09:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26718.733894 secs 2023-05-08T11:09:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:41 smithi133 ceph-mon[125939]: pgmap v14306: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 194 KiB/s wr, 10 op/s 2023-05-08T11:09:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26720.021409 secs 2023-05-08T11:09:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:41 smithi096 ceph-mon[124666]: pgmap v14306: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 194 KiB/s wr, 10 op/s 2023-05-08T11:09:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26720.021409 secs 2023-05-08T11:09:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:41 smithi186 ceph-mon[126480]: pgmap v14306: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 194 KiB/s wr, 10 op/s 2023-05-08T11:09:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26720.021409 secs 2023-05-08T11:09:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:43 smithi133 ceph-mon[125939]: pgmap v14307: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 194 KiB/s wr, 6 op/s 2023-05-08T11:09:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:43 smithi096 ceph-mon[124666]: pgmap v14307: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 194 KiB/s wr, 6 op/s 2023-05-08T11:09:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:43 smithi186 ceph-mon[126480]: pgmap v14307: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 194 KiB/s wr, 6 op/s 2023-05-08T11:09:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26723.177960 secs 2023-05-08T11:09:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26723.177960 secs 2023-05-08T11:09:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26723.177960 secs 2023-05-08T11:09:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26723.734014 secs 2023-05-08T11:09:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:45 smithi133 ceph-mon[125939]: pgmap v14308: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 194 KiB/s wr, 6 op/s 2023-05-08T11:09:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26723.734014 secs 2023-05-08T11:09:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:45 smithi096 ceph-mon[124666]: pgmap v14308: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 194 KiB/s wr, 6 op/s 2023-05-08T11:09:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26723.734014 secs 2023-05-08T11:09:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:45 smithi186 ceph-mon[126480]: pgmap v14308: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 194 KiB/s wr, 6 op/s 2023-05-08T11:09:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26725.021528 secs 2023-05-08T11:09:46.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26725.021528 secs 2023-05-08T11:09:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26725.021528 secs 2023-05-08T11:09:47.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:47 smithi096 ceph-mon[124666]: pgmap v14309: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 288 KiB/s wr, 10 op/s 2023-05-08T11:09:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:47 smithi186 ceph-mon[126480]: pgmap v14309: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 288 KiB/s wr, 10 op/s 2023-05-08T11:09:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:47 smithi133 ceph-mon[125939]: pgmap v14309: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 288 KiB/s wr, 10 op/s 2023-05-08T11:09:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:49 smithi096 ceph-mon[124666]: pgmap v14310: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 95 KiB/s wr, 7 op/s 2023-05-08T11:09:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26728.178072 secs 2023-05-08T11:09:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:49 smithi186 ceph-mon[126480]: pgmap v14310: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 95 KiB/s wr, 7 op/s 2023-05-08T11:09:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26728.178072 secs 2023-05-08T11:09:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:49 smithi133 ceph-mon[125939]: pgmap v14310: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 95 KiB/s wr, 7 op/s 2023-05-08T11:09:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26728.178072 secs 2023-05-08T11:09:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26728.734143 secs 2023-05-08T11:09:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26728.734143 secs 2023-05-08T11:09:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26728.734143 secs 2023-05-08T11:09:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:51 smithi096 ceph-mon[124666]: pgmap v14311: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 96 KiB/s wr, 10 op/s 2023-05-08T11:09:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:51 smithi186 ceph-mon[126480]: pgmap v14311: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 96 KiB/s wr, 10 op/s 2023-05-08T11:09:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:51 smithi133 ceph-mon[125939]: pgmap v14311: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 96 KiB/s wr, 10 op/s 2023-05-08T11:09:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:09:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:09:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:09:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:53 smithi096 ceph-mon[124666]: pgmap v14312: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 95 KiB/s wr, 6 op/s 2023-05-08T11:09:53.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:53 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:09:53.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:09:53.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:09:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:53 smithi186 ceph-mon[126480]: pgmap v14312: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 95 KiB/s wr, 6 op/s 2023-05-08T11:09:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:53 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:09:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:09:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:09:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:53 smithi133 ceph-mon[125939]: pgmap v14312: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 95 KiB/s wr, 6 op/s 2023-05-08T11:09:53.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:53 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:09:53.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:09:53.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:09:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26733.178198 secs 2023-05-08T11:09:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26733.178198 secs 2023-05-08T11:09:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26733.178198 secs 2023-05-08T11:09:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:55 smithi186 ceph-mon[126480]: pgmap v14313: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 95 KiB/s wr, 6 op/s 2023-05-08T11:09:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:55 smithi133 ceph-mon[125939]: pgmap v14313: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 95 KiB/s wr, 6 op/s 2023-05-08T11:09:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:55 smithi096 ceph-mon[124666]: pgmap v14313: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 95 KiB/s wr, 6 op/s 2023-05-08T11:09:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:09:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:09:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:09:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:57 smithi186 ceph-mon[126480]: pgmap v14314: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 407 KiB/s rd, 398 KiB/s wr, 11 op/s 2023-05-08T11:09:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:09:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:09:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:57 smithi133 ceph-mon[125939]: pgmap v14314: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 407 KiB/s rd, 398 KiB/s wr, 11 op/s 2023-05-08T11:09:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:09:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:09:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:57 smithi096 ceph-mon[124666]: pgmap v14314: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 407 KiB/s rd, 398 KiB/s wr, 11 op/s 2023-05-08T11:09:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:09:57.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:09:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:59 smithi186 ceph-mon[126480]: pgmap v14315: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 303 KiB/s wr, 7 op/s 2023-05-08T11:09:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:09:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26738.178316 secs 2023-05-08T11:09:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:59 smithi133 ceph-mon[125939]: pgmap v14315: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 303 KiB/s wr, 7 op/s 2023-05-08T11:09:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:09:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26738.178316 secs 2023-05-08T11:09:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:59 smithi096 ceph-mon[124666]: pgmap v14315: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 303 KiB/s wr, 7 op/s 2023-05-08T11:09:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:09:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26738.178316 secs 2023-05-08T11:10:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:00 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:10:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:00 smithi186 ceph-mon[126480]: Health detail: HEALTH_WARN 1 MDSs report slow requests 2023-05-08T11:10:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:00 smithi186 ceph-mon[126480]: [WRN] MDS_SLOW_REQUEST: 1 MDSs report slow requests 2023-05-08T11:10:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:00 smithi186 ceph-mon[126480]: mds.i(mds.1): 1 slow requests are blocked > 180 secs 2023-05-08T11:10:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:00 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:10:00.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:00 smithi133 ceph-mon[125939]: Health detail: HEALTH_WARN 1 MDSs report slow requests 2023-05-08T11:10:00.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:00 smithi133 ceph-mon[125939]: [WRN] MDS_SLOW_REQUEST: 1 MDSs report slow requests 2023-05-08T11:10:00.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:00 smithi133 ceph-mon[125939]: mds.i(mds.1): 1 slow requests are blocked > 180 secs 2023-05-08T11:10:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:00 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:10:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:00 smithi096 ceph-mon[124666]: Health detail: HEALTH_WARN 1 MDSs report slow requests 2023-05-08T11:10:00.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:00 smithi096 ceph-mon[124666]: [WRN] MDS_SLOW_REQUEST: 1 MDSs report slow requests 2023-05-08T11:10:00.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:00 smithi096 ceph-mon[124666]: mds.i(mds.1): 1 slow requests are blocked > 180 secs 2023-05-08T11:10:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:01 smithi186 ceph-mon[126480]: pgmap v14316: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 564 KiB/s rd, 649 KiB/s wr, 12 op/s 2023-05-08T11:10:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:01 smithi133 ceph-mon[125939]: pgmap v14316: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 564 KiB/s rd, 649 KiB/s wr, 12 op/s 2023-05-08T11:10:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:01 smithi096 ceph-mon[124666]: pgmap v14316: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 564 KiB/s rd, 649 KiB/s wr, 12 op/s 2023-05-08T11:10:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:03 smithi186 ceph-mon[126480]: pgmap v14317: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 648 KiB/s wr, 9 op/s 2023-05-08T11:10:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:03 smithi133 ceph-mon[125939]: pgmap v14317: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 648 KiB/s wr, 9 op/s 2023-05-08T11:10:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:03 smithi096 ceph-mon[124666]: pgmap v14317: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 648 KiB/s wr, 9 op/s 2023-05-08T11:10:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26743.178441 secs 2023-05-08T11:10:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26743.178441 secs 2023-05-08T11:10:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26743.178441 secs 2023-05-08T11:10:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26743.734502 secs 2023-05-08T11:10:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:05 smithi186 ceph-mon[126480]: pgmap v14318: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 648 KiB/s wr, 9 op/s 2023-05-08T11:10:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:10:05.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:10:05.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:05 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:10:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26743.734502 secs 2023-05-08T11:10:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:05 smithi133 ceph-mon[125939]: pgmap v14318: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 648 KiB/s wr, 9 op/s 2023-05-08T11:10:05.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:10:05.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:10:05.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:05 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:10:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26743.734502 secs 2023-05-08T11:10:05.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:05 smithi096 ceph-mon[124666]: pgmap v14318: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 648 KiB/s wr, 9 op/s 2023-05-08T11:10:05.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:10:05.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:10:05.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:05 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:10:07.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:07 smithi186 ceph-mon[126480]: pgmap v14319: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 944 KiB/s wr, 27 op/s 2023-05-08T11:10:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:07 smithi133 ceph-mon[125939]: pgmap v14319: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 944 KiB/s wr, 27 op/s 2023-05-08T11:10:07.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:07 smithi096 ceph-mon[124666]: pgmap v14319: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 944 KiB/s wr, 27 op/s 2023-05-08T11:10:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:09 smithi186 ceph-mon[126480]: pgmap v14320: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 753 KiB/s rd, 642 KiB/s wr, 22 op/s 2023-05-08T11:10:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26748.178556 secs 2023-05-08T11:10:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:09 smithi133 ceph-mon[125939]: pgmap v14320: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 753 KiB/s rd, 642 KiB/s wr, 22 op/s 2023-05-08T11:10:09.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26748.178556 secs 2023-05-08T11:10:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:09 smithi096 ceph-mon[124666]: pgmap v14320: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 753 KiB/s rd, 642 KiB/s wr, 22 op/s 2023-05-08T11:10:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26748.178556 secs 2023-05-08T11:10:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26748.734582 secs 2023-05-08T11:10:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26748.734582 secs 2023-05-08T11:10:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26748.734582 secs 2023-05-08T11:10:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:11 smithi186 ceph-mon[126480]: pgmap v14321: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 756 KiB/s rd, 645 KiB/s wr, 26 op/s 2023-05-08T11:10:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:11 smithi133 ceph-mon[125939]: pgmap v14321: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 756 KiB/s rd, 645 KiB/s wr, 26 op/s 2023-05-08T11:10:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:11 smithi096 ceph-mon[124666]: pgmap v14321: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 756 KiB/s rd, 645 KiB/s wr, 26 op/s 2023-05-08T11:10:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:13 smithi186 ceph-mon[126480]: pgmap v14322: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 299 KiB/s wr, 21 op/s 2023-05-08T11:10:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:13 smithi133 ceph-mon[125939]: pgmap v14322: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 299 KiB/s wr, 21 op/s 2023-05-08T11:10:13.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:13 smithi096 ceph-mon[124666]: pgmap v14322: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 299 KiB/s wr, 21 op/s 2023-05-08T11:10:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26753.178673 secs 2023-05-08T11:10:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26753.178673 secs 2023-05-08T11:10:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26753.178673 secs 2023-05-08T11:10:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26753.734704 secs 2023-05-08T11:10:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:15 smithi186 ceph-mon[126480]: pgmap v14323: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 299 KiB/s wr, 21 op/s 2023-05-08T11:10:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26753.734704 secs 2023-05-08T11:10:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:15 smithi133 ceph-mon[125939]: pgmap v14323: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 299 KiB/s wr, 21 op/s 2023-05-08T11:10:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26753.734704 secs 2023-05-08T11:10:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:15 smithi096 ceph-mon[124666]: pgmap v14323: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 299 KiB/s wr, 21 op/s 2023-05-08T11:10:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:17 smithi186 ceph-mon[126480]: pgmap v14324: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 858 KiB/s rd, 656 KiB/s wr, 25 op/s 2023-05-08T11:10:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:17 smithi133 ceph-mon[125939]: pgmap v14324: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 858 KiB/s rd, 656 KiB/s wr, 25 op/s 2023-05-08T11:10:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:17 smithi096 ceph-mon[124666]: pgmap v14324: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 858 KiB/s rd, 656 KiB/s wr, 25 op/s 2023-05-08T11:10:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:19 smithi186 ceph-mon[126480]: pgmap v14325: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 360 KiB/s wr, 8 op/s 2023-05-08T11:10:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26758.178802 secs 2023-05-08T11:10:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:19 smithi133 ceph-mon[125939]: pgmap v14325: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 360 KiB/s wr, 8 op/s 2023-05-08T11:10:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26758.178802 secs 2023-05-08T11:10:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:19 smithi096 ceph-mon[124666]: pgmap v14325: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 360 KiB/s wr, 8 op/s 2023-05-08T11:10:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26758.178802 secs 2023-05-08T11:10:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:20 smithi133 ceph-mon[125939]: pgmap v14326: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 689 KiB/s rd, 707 KiB/s wr, 14 op/s 2023-05-08T11:10:21.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:20 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:10:21.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26760.022385 secs 2023-05-08T11:10:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:20 smithi096 ceph-mon[124666]: pgmap v14326: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 689 KiB/s rd, 707 KiB/s wr, 14 op/s 2023-05-08T11:10:21.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:20 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:10:21.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26760.022385 secs 2023-05-08T11:10:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:20 smithi186 ceph-mon[126480]: pgmap v14326: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 689 KiB/s rd, 707 KiB/s wr, 14 op/s 2023-05-08T11:10:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:20 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:10:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26760.022385 secs 2023-05-08T11:10:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:21 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:10:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:21 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:10:22.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:21 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:10:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:21 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:10:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:21 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:10:22.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:21 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:10:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:21 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:10:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:21 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:10:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:21 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:10:23.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:22 smithi133 ceph-mon[125939]: pgmap v14327: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 685 KiB/s rd, 704 KiB/s wr, 10 op/s 2023-05-08T11:10:23.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:22 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:10:23.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:22 smithi096 ceph-mon[124666]: pgmap v14327: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 685 KiB/s rd, 704 KiB/s wr, 10 op/s 2023-05-08T11:10:23.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:22 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:10:23.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:22 smithi186 ceph-mon[126480]: pgmap v14327: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 685 KiB/s rd, 704 KiB/s wr, 10 op/s 2023-05-08T11:10:23.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:22 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:10:24.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:10:24.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:10:24.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:23 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:10:24.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:10:24.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:23 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T11:10:24.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:23 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T11:10:24.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:23 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:10:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:10:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:10:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:23 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:10:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:10:24.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:23 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T11:10:24.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:23 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T11:10:24.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:23 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:10:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:10:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:10:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:23 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:10:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:10:24.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:23 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T11:10:24.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:23 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T11:10:24.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:23 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:10:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26763.178868 secs 2023-05-08T11:10:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:24 smithi133 ceph-mon[125939]: pgmap v14328: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 685 KiB/s rd, 704 KiB/s wr, 10 op/s 2023-05-08T11:10:25.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:24 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:10:25.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:24 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:10:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26763.178868 secs 2023-05-08T11:10:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:24 smithi096 ceph-mon[124666]: pgmap v14328: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 685 KiB/s rd, 704 KiB/s wr, 10 op/s 2023-05-08T11:10:25.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:24 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:10:25.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:24 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:10:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26763.178868 secs 2023-05-08T11:10:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:24 smithi186 ceph-mon[126480]: pgmap v14328: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 685 KiB/s rd, 704 KiB/s wr, 10 op/s 2023-05-08T11:10:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:24 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:10:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:24 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:10:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26765.022516 secs 2023-05-08T11:10:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26765.022516 secs 2023-05-08T11:10:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26765.022516 secs 2023-05-08T11:10:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:27 smithi096 ceph-mon[124666]: osdmap e972: 12 total, 12 up, 12 in 2023-05-08T11:10:27.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:27 smithi096 ceph-mon[124666]: pgmap v14330: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 460 KiB/s wr, 12 op/s 2023-05-08T11:10:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:27 smithi186 ceph-mon[126480]: osdmap e972: 12 total, 12 up, 12 in 2023-05-08T11:10:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:27 smithi186 ceph-mon[126480]: pgmap v14330: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 460 KiB/s wr, 12 op/s 2023-05-08T11:10:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:27 smithi133 ceph-mon[125939]: osdmap e972: 12 total, 12 up, 12 in 2023-05-08T11:10:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:27 smithi133 ceph-mon[125939]: pgmap v14330: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 460 KiB/s wr, 12 op/s 2023-05-08T11:10:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:29 smithi186 ceph-mon[126480]: pgmap v14331: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 460 KiB/s wr, 12 op/s 2023-05-08T11:10:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:29 smithi133 ceph-mon[125939]: pgmap v14331: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 460 KiB/s wr, 12 op/s 2023-05-08T11:10:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:29 smithi096 ceph-mon[124666]: pgmap v14331: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 460 KiB/s wr, 12 op/s 2023-05-08T11:10:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26768.178988 secs 2023-05-08T11:10:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:30 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:10:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26768.178988 secs 2023-05-08T11:10:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:30 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:10:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26768.178988 secs 2023-05-08T11:10:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:30 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:10:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:31 smithi186 ceph-mon[126480]: pgmap v14332: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 173 KiB/s wr, 8 op/s 2023-05-08T11:10:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26770.022658 secs 2023-05-08T11:10:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:31 smithi133 ceph-mon[125939]: pgmap v14332: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 173 KiB/s wr, 8 op/s 2023-05-08T11:10:31.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26770.022658 secs 2023-05-08T11:10:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:31 smithi096 ceph-mon[124666]: pgmap v14332: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 173 KiB/s wr, 8 op/s 2023-05-08T11:10:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26770.022658 secs 2023-05-08T11:10:33.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:33 smithi186 ceph-mon[126480]: pgmap v14333: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 173 KiB/s wr, 8 op/s 2023-05-08T11:10:33.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:33 smithi133 ceph-mon[125939]: pgmap v14333: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 173 KiB/s wr, 8 op/s 2023-05-08T11:10:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:33 smithi096 ceph-mon[124666]: pgmap v14333: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 173 KiB/s wr, 8 op/s 2023-05-08T11:10:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26773.179069 secs 2023-05-08T11:10:35.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:35 smithi186 ceph-mon[126480]: pgmap v14334: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 173 KiB/s wr, 8 op/s 2023-05-08T11:10:35.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:35 smithi186 ceph-mon[126480]: osdmap e973: 12 total, 12 up, 12 in 2023-05-08T11:10:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26773.179069 secs 2023-05-08T11:10:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:35 smithi133 ceph-mon[125939]: pgmap v14334: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 173 KiB/s wr, 8 op/s 2023-05-08T11:10:35.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:35 smithi133 ceph-mon[125939]: osdmap e973: 12 total, 12 up, 12 in 2023-05-08T11:10:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26773.179069 secs 2023-05-08T11:10:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:35 smithi096 ceph-mon[124666]: pgmap v14334: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 173 KiB/s wr, 8 op/s 2023-05-08T11:10:35.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:35 smithi096 ceph-mon[124666]: osdmap e973: 12 total, 12 up, 12 in 2023-05-08T11:10:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26775.022791 secs 2023-05-08T11:10:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26775.022791 secs 2023-05-08T11:10:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26775.022791 secs 2023-05-08T11:10:37.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:37 smithi186 ceph-mon[126480]: pgmap v14336: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 632 KiB/s wr, 9 op/s 2023-05-08T11:10:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:37 smithi133 ceph-mon[125939]: pgmap v14336: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 632 KiB/s wr, 9 op/s 2023-05-08T11:10:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:37 smithi096 ceph-mon[124666]: pgmap v14336: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 632 KiB/s wr, 9 op/s 2023-05-08T11:10:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:39 smithi186 ceph-mon[126480]: pgmap v14337: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 632 KiB/s wr, 9 op/s 2023-05-08T11:10:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:39 smithi133 ceph-mon[125939]: pgmap v14337: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 632 KiB/s wr, 9 op/s 2023-05-08T11:10:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:39 smithi096 ceph-mon[124666]: pgmap v14337: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 632 KiB/s wr, 9 op/s 2023-05-08T11:10:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26778.179190 secs 2023-05-08T11:10:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26778.735303 secs 2023-05-08T11:10:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26778.179190 secs 2023-05-08T11:10:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26778.735303 secs 2023-05-08T11:10:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26778.179190 secs 2023-05-08T11:10:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26778.735303 secs 2023-05-08T11:10:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:41 smithi186 ceph-mon[126480]: pgmap v14338: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 924 KiB/s rd, 712 KiB/s wr, 10 op/s 2023-05-08T11:10:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26780.022903 secs 2023-05-08T11:10:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:41 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:10:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:41 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:10:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:41 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:10:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:41 smithi133 ceph-mon[125939]: pgmap v14338: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 924 KiB/s rd, 712 KiB/s wr, 10 op/s 2023-05-08T11:10:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26780.022903 secs 2023-05-08T11:10:41.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:41 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:10:41.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:41 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:10:41.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:41 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:10:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:41 smithi096 ceph-mon[124666]: pgmap v14338: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 924 KiB/s rd, 712 KiB/s wr, 10 op/s 2023-05-08T11:10:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26780.022903 secs 2023-05-08T11:10:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:41 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:10:41.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:41 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:10:41.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:41 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:10:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:43 smithi186 ceph-mon[126480]: pgmap v14339: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 924 KiB/s rd, 712 KiB/s wr, 10 op/s 2023-05-08T11:10:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:43 smithi133 ceph-mon[125939]: pgmap v14339: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 924 KiB/s rd, 712 KiB/s wr, 10 op/s 2023-05-08T11:10:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:43 smithi096 ceph-mon[124666]: pgmap v14339: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 924 KiB/s rd, 712 KiB/s wr, 10 op/s 2023-05-08T11:10:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26783.179332 secs 2023-05-08T11:10:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26783.735403 secs 2023-05-08T11:10:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:45 smithi186 ceph-mon[126480]: pgmap v14340: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 924 KiB/s rd, 712 KiB/s wr, 10 op/s 2023-05-08T11:10:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26783.179332 secs 2023-05-08T11:10:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26783.735403 secs 2023-05-08T11:10:45.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:45 smithi133 ceph-mon[125939]: pgmap v14340: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 924 KiB/s rd, 712 KiB/s wr, 10 op/s 2023-05-08T11:10:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26783.179332 secs 2023-05-08T11:10:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26783.735403 secs 2023-05-08T11:10:45.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:45 smithi096 ceph-mon[124666]: pgmap v14340: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 924 KiB/s rd, 712 KiB/s wr, 10 op/s 2023-05-08T11:10:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:47 smithi186 ceph-mon[126480]: pgmap v14341: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 867 KiB/s rd, 586 KiB/s wr, 9 op/s 2023-05-08T11:10:47.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:47 smithi133 ceph-mon[125939]: pgmap v14341: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 867 KiB/s rd, 586 KiB/s wr, 9 op/s 2023-05-08T11:10:47.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:47 smithi096 ceph-mon[124666]: pgmap v14341: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 867 KiB/s rd, 586 KiB/s wr, 9 op/s 2023-05-08T11:10:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:10:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:10:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:10:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:49 smithi186 ceph-mon[126480]: pgmap v14342: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 798 KiB/s rd, 540 KiB/s wr, 8 op/s 2023-05-08T11:10:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:10:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:10:49.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:10:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:49 smithi133 ceph-mon[125939]: pgmap v14342: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 798 KiB/s rd, 540 KiB/s wr, 8 op/s 2023-05-08T11:10:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:10:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:10:49.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:10:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:49 smithi096 ceph-mon[124666]: pgmap v14342: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 798 KiB/s rd, 540 KiB/s wr, 8 op/s 2023-05-08T11:10:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:10:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:10:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:10:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26788.179450 secs 2023-05-08T11:10:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26788.179450 secs 2023-05-08T11:10:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26788.179450 secs 2023-05-08T11:10:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:51 smithi133 ceph-mon[125939]: pgmap v14343: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 992 KiB/s rd, 562 KiB/s wr, 14 op/s 2023-05-08T11:10:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:51 smithi096 ceph-mon[124666]: pgmap v14343: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 992 KiB/s rd, 562 KiB/s wr, 14 op/s 2023-05-08T11:10:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:51 smithi186 ceph-mon[126480]: pgmap v14343: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 992 KiB/s rd, 562 KiB/s wr, 14 op/s 2023-05-08T11:10:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:10:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:10:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:10:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:53 smithi133 ceph-mon[125939]: pgmap v14344: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 386 KiB/s wr, 9 op/s 2023-05-08T11:10:53.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:10:53.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:10:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:53 smithi096 ceph-mon[124666]: pgmap v14344: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 386 KiB/s wr, 9 op/s 2023-05-08T11:10:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:10:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:10:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:53 smithi186 ceph-mon[126480]: pgmap v14344: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 386 KiB/s wr, 9 op/s 2023-05-08T11:10:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:10:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:10:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26793.179593 secs 2023-05-08T11:10:55.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:55 smithi133 ceph-mon[125939]: pgmap v14345: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 386 KiB/s wr, 9 op/s 2023-05-08T11:10:55.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:55 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:10:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26793.179593 secs 2023-05-08T11:10:55.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:55 smithi096 ceph-mon[124666]: pgmap v14345: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 386 KiB/s wr, 9 op/s 2023-05-08T11:10:55.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:55 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:10:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26793.179593 secs 2023-05-08T11:10:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:55 smithi186 ceph-mon[126480]: pgmap v14345: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 386 KiB/s wr, 9 op/s 2023-05-08T11:10:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:55 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:10:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:57 smithi133 ceph-mon[125939]: pgmap v14346: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 588 KiB/s rd, 841 KiB/s wr, 13 op/s 2023-05-08T11:10:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:57 smithi096 ceph-mon[124666]: pgmap v14346: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 588 KiB/s rd, 841 KiB/s wr, 13 op/s 2023-05-08T11:10:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:57 smithi186 ceph-mon[126480]: pgmap v14346: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 588 KiB/s rd, 841 KiB/s wr, 13 op/s 2023-05-08T11:10:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:10:59 smithi133 ceph-mon[125939]: pgmap v14347: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 477 KiB/s wr, 9 op/s 2023-05-08T11:10:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:10:59 smithi096 ceph-mon[124666]: pgmap v14347: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 477 KiB/s wr, 9 op/s 2023-05-08T11:10:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:10:59 smithi186 ceph-mon[126480]: pgmap v14347: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 477 KiB/s wr, 9 op/s 2023-05-08T11:11:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26798.179708 secs 2023-05-08T11:11:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26798.179708 secs 2023-05-08T11:11:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26798.179708 secs 2023-05-08T11:11:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:01 smithi133 ceph-mon[125939]: pgmap v14348: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 881 KiB/s wr, 14 op/s 2023-05-08T11:11:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:01 smithi096 ceph-mon[124666]: pgmap v14348: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 881 KiB/s wr, 14 op/s 2023-05-08T11:11:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:01 smithi186 ceph-mon[126480]: pgmap v14348: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 881 KiB/s wr, 14 op/s 2023-05-08T11:11:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:03 smithi133 ceph-mon[125939]: pgmap v14349: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 974 KiB/s rd, 859 KiB/s wr, 9 op/s 2023-05-08T11:11:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:03 smithi096 ceph-mon[124666]: pgmap v14349: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 974 KiB/s rd, 859 KiB/s wr, 9 op/s 2023-05-08T11:11:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:03 smithi186 ceph-mon[126480]: pgmap v14349: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 974 KiB/s rd, 859 KiB/s wr, 9 op/s 2023-05-08T11:11:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26803.179834 secs 2023-05-08T11:11:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26803.179834 secs 2023-05-08T11:11:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26803.179834 secs 2023-05-08T11:11:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26803.735894 secs 2023-05-08T11:11:05.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:05 smithi133 ceph-mon[125939]: pgmap v14350: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 974 KiB/s rd, 859 KiB/s wr, 9 op/s 2023-05-08T11:11:05.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:05 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:11:05.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:11:05.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:11:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26803.735894 secs 2023-05-08T11:11:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:05 smithi096 ceph-mon[124666]: pgmap v14350: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 974 KiB/s rd, 859 KiB/s wr, 9 op/s 2023-05-08T11:11:05.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:05 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:11:05.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:11:05.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:11:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26803.735894 secs 2023-05-08T11:11:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:05 smithi186 ceph-mon[126480]: pgmap v14350: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 974 KiB/s rd, 859 KiB/s wr, 9 op/s 2023-05-08T11:11:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:05 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:11:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:11:05.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:11:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26805.023518 secs 2023-05-08T11:11:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26805.023518 secs 2023-05-08T11:11:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26805.023518 secs 2023-05-08T11:11:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:07 smithi133 ceph-mon[125939]: pgmap v14351: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 29 op/s 2023-05-08T11:11:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:07 smithi096 ceph-mon[124666]: pgmap v14351: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 29 op/s 2023-05-08T11:11:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:07 smithi186 ceph-mon[126480]: pgmap v14351: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 29 op/s 2023-05-08T11:11:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:09 smithi133 ceph-mon[125939]: pgmap v14352: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 762 KiB/s wr, 24 op/s 2023-05-08T11:11:09.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:11:09.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:11:09.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26808.179945 secs 2023-05-08T11:11:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:09 smithi096 ceph-mon[124666]: pgmap v14352: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 762 KiB/s wr, 24 op/s 2023-05-08T11:11:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:11:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:11:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26808.179945 secs 2023-05-08T11:11:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:09 smithi186 ceph-mon[126480]: pgmap v14352: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 762 KiB/s wr, 24 op/s 2023-05-08T11:11:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:11:09.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:11:09.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26808.179945 secs 2023-05-08T11:11:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26808.736012 secs 2023-05-08T11:11:10.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:10 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:11:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26808.736012 secs 2023-05-08T11:11:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:10 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:11:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26808.736012 secs 2023-05-08T11:11:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:10 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:11:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:11 smithi133 ceph-mon[125939]: pgmap v14353: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 978 KiB/s wr, 28 op/s 2023-05-08T11:11:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26810.023641 secs 2023-05-08T11:11:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:11 smithi096 ceph-mon[124666]: pgmap v14353: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 978 KiB/s wr, 28 op/s 2023-05-08T11:11:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26810.023641 secs 2023-05-08T11:11:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:11 smithi186 ceph-mon[126480]: pgmap v14353: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 978 KiB/s wr, 28 op/s 2023-05-08T11:11:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26810.023641 secs 2023-05-08T11:11:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:12 smithi133 ceph-mon[125939]: osdmap e974: 12 total, 12 up, 12 in 2023-05-08T11:11:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:12 smithi096 ceph-mon[124666]: osdmap e974: 12 total, 12 up, 12 in 2023-05-08T11:11:12.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:12 smithi186 ceph-mon[126480]: osdmap e974: 12 total, 12 up, 12 in 2023-05-08T11:11:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:13 smithi133 ceph-mon[125939]: pgmap v14355: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 683 KiB/s rd, 689 KiB/s wr, 28 op/s 2023-05-08T11:11:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:13 smithi096 ceph-mon[124666]: pgmap v14355: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 683 KiB/s rd, 689 KiB/s wr, 28 op/s 2023-05-08T11:11:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:13 smithi186 ceph-mon[126480]: pgmap v14355: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 683 KiB/s rd, 689 KiB/s wr, 28 op/s 2023-05-08T11:11:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26813.180066 secs 2023-05-08T11:11:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26813.180066 secs 2023-05-08T11:11:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26813.180066 secs 2023-05-08T11:11:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26813.736153 secs 2023-05-08T11:11:15.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:15 smithi133 ceph-mon[125939]: pgmap v14356: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 683 KiB/s rd, 689 KiB/s wr, 28 op/s 2023-05-08T11:11:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26813.736153 secs 2023-05-08T11:11:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:15 smithi096 ceph-mon[124666]: pgmap v14356: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 683 KiB/s rd, 689 KiB/s wr, 28 op/s 2023-05-08T11:11:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26813.736153 secs 2023-05-08T11:11:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:15 smithi186 ceph-mon[126480]: pgmap v14356: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 683 KiB/s rd, 689 KiB/s wr, 28 op/s 2023-05-08T11:11:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26815.023741 secs 2023-05-08T11:11:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26815.023741 secs 2023-05-08T11:11:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26815.023741 secs 2023-05-08T11:11:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:17 smithi133 ceph-mon[125939]: pgmap v14357: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 391 KiB/s wr, 9 op/s 2023-05-08T11:11:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:17 smithi096 ceph-mon[124666]: pgmap v14357: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 391 KiB/s wr, 9 op/s 2023-05-08T11:11:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:17 smithi186 ceph-mon[126480]: pgmap v14357: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 391 KiB/s wr, 9 op/s 2023-05-08T11:11:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:19 smithi133 ceph-mon[125939]: pgmap v14358: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 391 KiB/s wr, 9 op/s 2023-05-08T11:11:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26818.180208 secs 2023-05-08T11:11:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:19 smithi096 ceph-mon[124666]: pgmap v14358: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 391 KiB/s wr, 9 op/s 2023-05-08T11:11:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26818.180208 secs 2023-05-08T11:11:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:19 smithi186 ceph-mon[126480]: pgmap v14358: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 391 KiB/s wr, 9 op/s 2023-05-08T11:11:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26818.180208 secs 2023-05-08T11:11:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26818.736272 secs 2023-05-08T11:11:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:20 smithi133 ceph-mon[125939]: osdmap e975: 12 total, 12 up, 12 in 2023-05-08T11:11:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26818.736272 secs 2023-05-08T11:11:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:20 smithi096 ceph-mon[124666]: osdmap e975: 12 total, 12 up, 12 in 2023-05-08T11:11:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26818.736272 secs 2023-05-08T11:11:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:20 smithi186 ceph-mon[126480]: osdmap e975: 12 total, 12 up, 12 in 2023-05-08T11:11:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:21 smithi133 ceph-mon[125939]: pgmap v14360: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 171 KiB/s wr, 10 op/s 2023-05-08T11:11:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26820.023862 secs 2023-05-08T11:11:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:21 smithi096 ceph-mon[124666]: pgmap v14360: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 171 KiB/s wr, 10 op/s 2023-05-08T11:11:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26820.023862 secs 2023-05-08T11:11:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:21 smithi186 ceph-mon[126480]: pgmap v14360: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 171 KiB/s wr, 10 op/s 2023-05-08T11:11:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26820.023862 secs 2023-05-08T11:11:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:23 smithi133 ceph-mon[125939]: pgmap v14361: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 151 KiB/s wr, 8 op/s 2023-05-08T11:11:23.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:23 smithi096 ceph-mon[124666]: pgmap v14361: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 151 KiB/s wr, 8 op/s 2023-05-08T11:11:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:23 smithi186 ceph-mon[126480]: pgmap v14361: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 151 KiB/s wr, 8 op/s 2023-05-08T11:11:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26823.180359 secs 2023-05-08T11:11:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:11:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:11:24.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:11:24.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:11:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26823.180359 secs 2023-05-08T11:11:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:11:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:11:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:11:24.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:11:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26823.180359 secs 2023-05-08T11:11:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:11:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:11:24.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:11:24.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:11:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26823.736363 secs 2023-05-08T11:11:25.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:25 smithi133 ceph-mon[125939]: pgmap v14362: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 151 KiB/s wr, 8 op/s 2023-05-08T11:11:25.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:25 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:11:25.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:25 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T11:11:25.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:25 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T11:11:25.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:25 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:11:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26823.736363 secs 2023-05-08T11:11:25.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:25 smithi096 ceph-mon[124666]: pgmap v14362: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 151 KiB/s wr, 8 op/s 2023-05-08T11:11:25.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:25 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:11:25.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:25 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T11:11:25.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:25 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T11:11:25.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:25 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:11:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26823.736363 secs 2023-05-08T11:11:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:25 smithi186 ceph-mon[126480]: pgmap v14362: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 151 KiB/s wr, 8 op/s 2023-05-08T11:11:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:25 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:11:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:25 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T11:11:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:25 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T11:11:25.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:25 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:11:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26825.023977 secs 2023-05-08T11:11:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26825.023977 secs 2023-05-08T11:11:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26825.023977 secs 2023-05-08T11:11:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:27 smithi096 ceph-mon[124666]: pgmap v14363: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 365 KiB/s wr, 8 op/s 2023-05-08T11:11:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:27 smithi186 ceph-mon[126480]: pgmap v14363: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 365 KiB/s wr, 8 op/s 2023-05-08T11:11:27.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:27 smithi133 ceph-mon[125939]: pgmap v14363: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 365 KiB/s wr, 8 op/s 2023-05-08T11:11:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:29 smithi096 ceph-mon[124666]: pgmap v14364: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 365 KiB/s wr, 8 op/s 2023-05-08T11:11:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26828.180412 secs 2023-05-08T11:11:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:29 smithi186 ceph-mon[126480]: pgmap v14364: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 365 KiB/s wr, 8 op/s 2023-05-08T11:11:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26828.180412 secs 2023-05-08T11:11:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:29 smithi133 ceph-mon[125939]: pgmap v14364: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 365 KiB/s wr, 8 op/s 2023-05-08T11:11:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26828.180412 secs 2023-05-08T11:11:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26828.736498 secs 2023-05-08T11:11:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26828.736498 secs 2023-05-08T11:11:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26828.736498 secs 2023-05-08T11:11:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:31 smithi096 ceph-mon[124666]: pgmap v14365: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 366 KiB/s rd, 345 KiB/s wr, 8 op/s 2023-05-08T11:11:31.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26830.024096 secs 2023-05-08T11:11:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:31 smithi186 ceph-mon[126480]: pgmap v14365: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 366 KiB/s rd, 345 KiB/s wr, 8 op/s 2023-05-08T11:11:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26830.024096 secs 2023-05-08T11:11:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:31 smithi133 ceph-mon[125939]: pgmap v14365: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 366 KiB/s rd, 345 KiB/s wr, 8 op/s 2023-05-08T11:11:31.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26830.024096 secs 2023-05-08T11:11:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:33 smithi096 ceph-mon[124666]: pgmap v14366: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 289 KiB/s wr, 7 op/s 2023-05-08T11:11:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:33 smithi186 ceph-mon[126480]: pgmap v14366: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 289 KiB/s wr, 7 op/s 2023-05-08T11:11:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:33 smithi133 ceph-mon[125939]: pgmap v14366: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 289 KiB/s wr, 7 op/s 2023-05-08T11:11:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26833.180533 secs 2023-05-08T11:11:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26833.180533 secs 2023-05-08T11:11:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26833.180533 secs 2023-05-08T11:11:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26833.736611 secs 2023-05-08T11:11:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:35 smithi186 ceph-mon[126480]: pgmap v14367: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 289 KiB/s wr, 7 op/s 2023-05-08T11:11:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26833.736611 secs 2023-05-08T11:11:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:35 smithi133 ceph-mon[125939]: pgmap v14367: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 289 KiB/s wr, 7 op/s 2023-05-08T11:11:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26833.736611 secs 2023-05-08T11:11:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:35 smithi096 ceph-mon[124666]: pgmap v14367: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 289 KiB/s wr, 7 op/s 2023-05-08T11:11:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26835.024219 secs 2023-05-08T11:11:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26835.024219 secs 2023-05-08T11:11:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26835.024219 secs 2023-05-08T11:11:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:37 smithi186 ceph-mon[126480]: pgmap v14368: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 385 KiB/s wr, 10 op/s 2023-05-08T11:11:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:37 smithi133 ceph-mon[125939]: pgmap v14368: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 385 KiB/s wr, 10 op/s 2023-05-08T11:11:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:37 smithi096 ceph-mon[124666]: pgmap v14368: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 385 KiB/s wr, 10 op/s 2023-05-08T11:11:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:39 smithi186 ceph-mon[126480]: pgmap v14369: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 98 KiB/s wr, 6 op/s 2023-05-08T11:11:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26838.180668 secs 2023-05-08T11:11:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:39 smithi133 ceph-mon[125939]: pgmap v14369: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 98 KiB/s wr, 6 op/s 2023-05-08T11:11:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26838.180668 secs 2023-05-08T11:11:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:39 smithi096 ceph-mon[124666]: pgmap v14369: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 98 KiB/s wr, 6 op/s 2023-05-08T11:11:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26838.180668 secs 2023-05-08T11:11:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26838.736678 secs 2023-05-08T11:11:40.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26838.736678 secs 2023-05-08T11:11:40.766 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26838.736678 secs 2023-05-08T11:11:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:41 smithi186 ceph-mon[126480]: pgmap v14370: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 192 KiB/s wr, 10 op/s 2023-05-08T11:11:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26840.024330 secs 2023-05-08T11:11:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:41 smithi133 ceph-mon[125939]: pgmap v14370: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 192 KiB/s wr, 10 op/s 2023-05-08T11:11:41.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26840.024330 secs 2023-05-08T11:11:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:41 smithi096 ceph-mon[124666]: pgmap v14370: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 192 KiB/s wr, 10 op/s 2023-05-08T11:11:41.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26840.024330 secs 2023-05-08T11:11:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:43 smithi186 ceph-mon[126480]: pgmap v14371: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 190 KiB/s wr, 6 op/s 2023-05-08T11:11:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:43 smithi133 ceph-mon[125939]: pgmap v14371: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 190 KiB/s wr, 6 op/s 2023-05-08T11:11:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:43 smithi096 ceph-mon[124666]: pgmap v14371: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 190 KiB/s wr, 6 op/s 2023-05-08T11:11:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26843.180773 secs 2023-05-08T11:11:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26843.180773 secs 2023-05-08T11:11:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26843.180773 secs 2023-05-08T11:11:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26843.736799 secs 2023-05-08T11:11:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:45 smithi186 ceph-mon[126480]: pgmap v14372: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 190 KiB/s wr, 6 op/s 2023-05-08T11:11:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26843.736799 secs 2023-05-08T11:11:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:45 smithi133 ceph-mon[125939]: pgmap v14372: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 190 KiB/s wr, 6 op/s 2023-05-08T11:11:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26843.736799 secs 2023-05-08T11:11:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:45 smithi096 ceph-mon[124666]: pgmap v14372: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 190 KiB/s wr, 6 op/s 2023-05-08T11:11:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:47 smithi186 ceph-mon[126480]: pgmap v14373: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 191 KiB/s wr, 10 op/s 2023-05-08T11:11:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:47 smithi133 ceph-mon[125939]: pgmap v14373: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 191 KiB/s wr, 10 op/s 2023-05-08T11:11:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:47 smithi096 ceph-mon[124666]: pgmap v14373: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 191 KiB/s wr, 10 op/s 2023-05-08T11:11:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:11:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:11:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:11:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:49 smithi186 ceph-mon[126480]: pgmap v14374: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 94 KiB/s wr, 7 op/s 2023-05-08T11:11:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:11:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:11:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:11:49.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26848.180911 secs 2023-05-08T11:11:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:49 smithi133 ceph-mon[125939]: pgmap v14374: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 94 KiB/s wr, 7 op/s 2023-05-08T11:11:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:11:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:11:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:11:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26848.180911 secs 2023-05-08T11:11:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:49 smithi096 ceph-mon[124666]: pgmap v14374: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 94 KiB/s wr, 7 op/s 2023-05-08T11:11:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:11:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:11:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:11:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26848.180911 secs 2023-05-08T11:11:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26848.736875 secs 2023-05-08T11:11:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26848.736875 secs 2023-05-08T11:11:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26848.736875 secs 2023-05-08T11:11:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:51 smithi186 ceph-mon[126480]: pgmap v14375: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 750 KiB/s rd, 379 KiB/s wr, 11 op/s 2023-05-08T11:11:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:51 smithi133 ceph-mon[125939]: pgmap v14375: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 750 KiB/s rd, 379 KiB/s wr, 11 op/s 2023-05-08T11:11:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:51 smithi096 ceph-mon[124666]: pgmap v14375: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 750 KiB/s rd, 379 KiB/s wr, 11 op/s 2023-05-08T11:11:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:53 smithi186 ceph-mon[126480]: pgmap v14376: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 286 KiB/s wr, 7 op/s 2023-05-08T11:11:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:53 smithi133 ceph-mon[125939]: pgmap v14376: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 286 KiB/s wr, 7 op/s 2023-05-08T11:11:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:53 smithi096 ceph-mon[124666]: pgmap v14376: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 286 KiB/s wr, 7 op/s 2023-05-08T11:11:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26853.181036 secs 2023-05-08T11:11:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26853.181036 secs 2023-05-08T11:11:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26853.181036 secs 2023-05-08T11:11:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:55 smithi186 ceph-mon[126480]: pgmap v14377: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 286 KiB/s wr, 7 op/s 2023-05-08T11:11:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:55 smithi133 ceph-mon[125939]: pgmap v14377: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 286 KiB/s wr, 7 op/s 2023-05-08T11:11:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:55 smithi096 ceph-mon[124666]: pgmap v14377: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 286 KiB/s wr, 7 op/s 2023-05-08T11:11:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:11:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:11:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:11:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:57 smithi186 ceph-mon[126480]: pgmap v14378: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 820 KiB/s wr, 20 op/s 2023-05-08T11:11:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:57 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:11:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:11:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:11:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:57 smithi133 ceph-mon[125939]: pgmap v14378: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 820 KiB/s wr, 20 op/s 2023-05-08T11:11:57.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:57 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:11:57.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:11:57.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:11:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:57 smithi096 ceph-mon[124666]: pgmap v14378: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 820 KiB/s wr, 20 op/s 2023-05-08T11:11:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:57 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:11:57.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:11:57.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:11:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:59 smithi186 ceph-mon[126480]: pgmap v14379: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 819 KiB/s wr, 16 op/s 2023-05-08T11:11:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:11:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26858.181189 secs 2023-05-08T11:11:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:59 smithi133 ceph-mon[125939]: pgmap v14379: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 819 KiB/s wr, 16 op/s 2023-05-08T11:11:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:11:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26858.181189 secs 2023-05-08T11:11:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:59 smithi096 ceph-mon[124666]: pgmap v14379: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 819 KiB/s wr, 16 op/s 2023-05-08T11:11:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:11:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26858.181189 secs 2023-05-08T11:12:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26858.737121 secs 2023-05-08T11:12:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26858.737121 secs 2023-05-08T11:12:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26858.737121 secs 2023-05-08T11:12:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:01 smithi186 ceph-mon[126480]: pgmap v14380: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.2 MiB/s wr, 31 op/s 2023-05-08T11:12:01.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26860.024811 secs 2023-05-08T11:12:01.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:12:01.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:12:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:01 smithi133 ceph-mon[125939]: pgmap v14380: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.2 MiB/s wr, 31 op/s 2023-05-08T11:12:01.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26860.024811 secs 2023-05-08T11:12:01.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:12:01.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:12:01.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:01 smithi096 ceph-mon[124666]: pgmap v14380: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.2 MiB/s wr, 31 op/s 2023-05-08T11:12:01.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26860.024811 secs 2023-05-08T11:12:01.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:12:01.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:12:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:03 smithi186 ceph-mon[126480]: pgmap v14381: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 970 KiB/s wr, 27 op/s 2023-05-08T11:12:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:03 smithi133 ceph-mon[125939]: pgmap v14381: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 970 KiB/s wr, 27 op/s 2023-05-08T11:12:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:03 smithi096 ceph-mon[124666]: pgmap v14381: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 970 KiB/s wr, 27 op/s 2023-05-08T11:12:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26863.181327 secs 2023-05-08T11:12:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26863.181327 secs 2023-05-08T11:12:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26863.181327 secs 2023-05-08T11:12:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26863.737192 secs 2023-05-08T11:12:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:05 smithi186 ceph-mon[126480]: pgmap v14382: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 970 KiB/s wr, 27 op/s 2023-05-08T11:12:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:05 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:12:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:12:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:12:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26863.737192 secs 2023-05-08T11:12:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:05 smithi133 ceph-mon[125939]: pgmap v14382: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 970 KiB/s wr, 27 op/s 2023-05-08T11:12:05.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:05 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:12:05.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:12:05.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:12:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26863.737192 secs 2023-05-08T11:12:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:05 smithi096 ceph-mon[124666]: pgmap v14382: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 970 KiB/s wr, 27 op/s 2023-05-08T11:12:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:05 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:12:05.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:12:05.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:12:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:07 smithi186 ceph-mon[126480]: pgmap v14383: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 34 op/s 2023-05-08T11:12:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:07 smithi133 ceph-mon[125939]: pgmap v14383: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 34 op/s 2023-05-08T11:12:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:07 smithi096 ceph-mon[124666]: pgmap v14383: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 34 op/s 2023-05-08T11:12:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:08 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:12:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:08 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:12:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:08 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:12:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:09 smithi186 ceph-mon[126480]: pgmap v14384: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 824 KiB/s rd, 656 KiB/s wr, 21 op/s 2023-05-08T11:12:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:12:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:12:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26868.181489 secs 2023-05-08T11:12:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:09 smithi133 ceph-mon[125939]: pgmap v14384: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 824 KiB/s rd, 656 KiB/s wr, 21 op/s 2023-05-08T11:12:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:12:09.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:12:09.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26868.181489 secs 2023-05-08T11:12:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:09 smithi096 ceph-mon[124666]: pgmap v14384: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 824 KiB/s rd, 656 KiB/s wr, 21 op/s 2023-05-08T11:12:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:12:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:12:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26868.181489 secs 2023-05-08T11:12:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:10 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:12:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:10 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:12:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:10 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:12:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:11 smithi186 ceph-mon[126480]: pgmap v14385: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 849 KiB/s rd, 697 KiB/s wr, 35 op/s 2023-05-08T11:12:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:11 smithi133 ceph-mon[125939]: pgmap v14385: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 849 KiB/s rd, 697 KiB/s wr, 35 op/s 2023-05-08T11:12:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:11 smithi096 ceph-mon[124666]: pgmap v14385: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 849 KiB/s rd, 697 KiB/s wr, 35 op/s 2023-05-08T11:12:12.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:12 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:12:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:12 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:12:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:12 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:12:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:13 smithi186 ceph-mon[126480]: pgmap v14386: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 500 KiB/s wr, 21 op/s 2023-05-08T11:12:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:12:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:13 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:12:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:13 smithi133 ceph-mon[125939]: pgmap v14386: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 500 KiB/s wr, 21 op/s 2023-05-08T11:12:13.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:12:13.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:13 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:12:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:13 smithi096 ceph-mon[124666]: pgmap v14386: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 500 KiB/s wr, 21 op/s 2023-05-08T11:12:13.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:12:13.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:13 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:12:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26873.181623 secs 2023-05-08T11:12:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26873.181623 secs 2023-05-08T11:12:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26873.181623 secs 2023-05-08T11:12:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:15 smithi186 ceph-mon[126480]: pgmap v14387: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 490 KiB/s wr, 21 op/s 2023-05-08T11:12:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:15 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:12:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:15 smithi133 ceph-mon[125939]: pgmap v14387: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 490 KiB/s wr, 21 op/s 2023-05-08T11:12:15.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:15 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:12:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:15 smithi096 ceph-mon[124666]: pgmap v14387: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 490 KiB/s wr, 21 op/s 2023-05-08T11:12:15.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:15 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:12:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:17 smithi186 ceph-mon[126480]: pgmap v14388: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 540 KiB/s rd, 559 KiB/s wr, 26 op/s 2023-05-08T11:12:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:17 smithi133 ceph-mon[125939]: pgmap v14388: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 540 KiB/s rd, 559 KiB/s wr, 26 op/s 2023-05-08T11:12:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:17 smithi096 ceph-mon[124666]: pgmap v14388: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 540 KiB/s rd, 559 KiB/s wr, 26 op/s 2023-05-08T11:12:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:19 smithi186 ceph-mon[126480]: pgmap v14389: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 411 KiB/s rd, 338 KiB/s wr, 19 op/s 2023-05-08T11:12:19.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26878.181755 secs 2023-05-08T11:12:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:19 smithi133 ceph-mon[125939]: pgmap v14389: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 411 KiB/s rd, 338 KiB/s wr, 19 op/s 2023-05-08T11:12:19.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26878.181755 secs 2023-05-08T11:12:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:19 smithi096 ceph-mon[124666]: pgmap v14389: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 411 KiB/s rd, 338 KiB/s wr, 19 op/s 2023-05-08T11:12:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26878.181755 secs 2023-05-08T11:12:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:21 smithi186 ceph-mon[126480]: pgmap v14390: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 621 KiB/s rd, 530 KiB/s wr, 22 op/s 2023-05-08T11:12:21.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:21 smithi133 ceph-mon[125939]: pgmap v14390: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 621 KiB/s rd, 530 KiB/s wr, 22 op/s 2023-05-08T11:12:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:21 smithi096 ceph-mon[124666]: pgmap v14390: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 621 KiB/s rd, 530 KiB/s wr, 22 op/s 2023-05-08T11:12:23.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:23 smithi186 ceph-mon[126480]: pgmap v14391: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 596 KiB/s rd, 489 KiB/s wr, 8 op/s 2023-05-08T11:12:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:23 smithi133 ceph-mon[125939]: pgmap v14391: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 596 KiB/s rd, 489 KiB/s wr, 8 op/s 2023-05-08T11:12:23.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:23 smithi096 ceph-mon[124666]: pgmap v14391: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 596 KiB/s rd, 489 KiB/s wr, 8 op/s 2023-05-08T11:12:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26883.181885 secs 2023-05-08T11:12:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:25 smithi186 ceph-mon[126480]: pgmap v14392: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 261 KiB/s wr, 9 op/s 2023-05-08T11:12:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26883.181885 secs 2023-05-08T11:12:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:25 smithi133 ceph-mon[125939]: pgmap v14392: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 261 KiB/s wr, 9 op/s 2023-05-08T11:12:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26883.181885 secs 2023-05-08T11:12:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:25 smithi096 ceph-mon[124666]: pgmap v14392: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 261 KiB/s wr, 9 op/s 2023-05-08T11:12:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:12:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:12:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:12:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:27 smithi133 ceph-mon[125939]: pgmap v14393: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 261 KiB/s wr, 10 op/s 2023-05-08T11:12:27.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:27 smithi096 ceph-mon[124666]: pgmap v14393: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 261 KiB/s wr, 10 op/s 2023-05-08T11:12:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:27 smithi186 ceph-mon[126480]: pgmap v14393: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 261 KiB/s wr, 10 op/s 2023-05-08T11:12:29.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:29 smithi133 ceph-mon[125939]: pgmap v14394: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 192 KiB/s wr, 6 op/s 2023-05-08T11:12:29.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:29 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:12:29.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:29 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:12:29.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:29 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:12:29.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:29 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:12:29.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:29 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:12:29.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:29 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:12:29.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26888.181975 secs 2023-05-08T11:12:29.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:29 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:12:29.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:29 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:12:29.494 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:29 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:12:29.494 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:29 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:12:29.494 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:29 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi186 to 178.5M 2023-05-08T11:12:29.494 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:29 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi186 to 187247579: error parsing value: Value '187247579' is below minimum 939524096 2023-05-08T11:12:29.494 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:29 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:12:29.494 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:29 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:12:29.494 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:29 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:12:29.495 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:29 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:12:29.495 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:29 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:12:29.495 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:29 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi133 to 187.0M 2023-05-08T11:12:29.495 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:29 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi133 to 196088746: error parsing value: Value '196088746' is below minimum 939524096 2023-05-08T11:12:29.495 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:29 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:12:29.495 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:29 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:12:29.495 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:29 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:12:29.495 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:29 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:12:29.496 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:29 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T11:12:29.496 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:29 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T11:12:29.496 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:29 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:12:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:29 smithi096 ceph-mon[124666]: pgmap v14394: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 192 KiB/s wr, 6 op/s 2023-05-08T11:12:29.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:29 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:12:29.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:29 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:12:29.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:29 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:12:29.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:29 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:12:29.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:29 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:12:29.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:29 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:12:29.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26888.181975 secs 2023-05-08T11:12:29.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:29 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:12:29.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:29 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:12:29.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:29 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:12:29.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:29 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:12:29.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:29 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi186 to 178.5M 2023-05-08T11:12:29.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:29 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi186 to 187247579: error parsing value: Value '187247579' is below minimum 939524096 2023-05-08T11:12:29.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:29 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:12:29.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:29 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:12:29.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:29 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:12:29.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:29 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:12:29.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:29 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:12:29.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:29 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi133 to 187.0M 2023-05-08T11:12:29.509 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:29 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi133 to 196088746: error parsing value: Value '196088746' is below minimum 939524096 2023-05-08T11:12:29.509 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:29 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:12:29.509 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:29 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:12:29.509 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:29 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:12:29.510 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:29 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:12:29.510 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:29 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T11:12:29.510 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:29 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T11:12:29.510 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:29 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:12:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:29 smithi186 ceph-mon[126480]: pgmap v14394: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 192 KiB/s wr, 6 op/s 2023-05-08T11:12:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:29 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:12:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:29 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:12:29.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:29 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:12:29.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:29 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:12:29.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:29 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:12:29.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:29 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:12:29.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26888.181975 secs 2023-05-08T11:12:29.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:29 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:12:29.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:29 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:12:29.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:29 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:12:29.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:29 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:12:29.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:29 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi186 to 178.5M 2023-05-08T11:12:29.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:29 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi186 to 187247579: error parsing value: Value '187247579' is below minimum 939524096 2023-05-08T11:12:29.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:29 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:12:29.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:29 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:12:29.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:29 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:12:29.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:29 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:12:29.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:29 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:12:29.623 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:29 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi133 to 187.0M 2023-05-08T11:12:29.623 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:29 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi133 to 196088746: error parsing value: Value '196088746' is below minimum 939524096 2023-05-08T11:12:29.623 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:29 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:12:29.623 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:29 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:12:29.623 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:29 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:12:29.623 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:29 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:12:29.623 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:29 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T11:12:29.623 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:29 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T11:12:29.624 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:29 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:12:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26888.737746 secs 2023-05-08T11:12:30.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26888.737746 secs 2023-05-08T11:12:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26888.737746 secs 2023-05-08T11:12:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:31 smithi133 ceph-mon[125939]: pgmap v14395: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 543 KiB/s rd, 544 KiB/s wr, 13 op/s 2023-05-08T11:12:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26890.025548 secs 2023-05-08T11:12:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:31 smithi096 ceph-mon[124666]: pgmap v14395: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 543 KiB/s rd, 544 KiB/s wr, 13 op/s 2023-05-08T11:12:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26890.025548 secs 2023-05-08T11:12:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:31 smithi186 ceph-mon[126480]: pgmap v14395: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 543 KiB/s rd, 544 KiB/s wr, 13 op/s 2023-05-08T11:12:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26890.025548 secs 2023-05-08T11:12:32.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:32 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:12:32.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:32 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:12:32.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:32 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:12:32.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:32 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:12:32.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:32 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:12:32.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:32 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:12:32.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:32 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:12:32.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:32 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:12:32.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:32 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:12:32.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:32 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:12:32.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:32 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:12:32.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:32 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:12:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:33 smithi186 ceph-mon[126480]: pgmap v14396: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 333 KiB/s rd, 353 KiB/s wr, 10 op/s 2023-05-08T11:12:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:33 smithi133 ceph-mon[125939]: pgmap v14396: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 333 KiB/s rd, 353 KiB/s wr, 10 op/s 2023-05-08T11:12:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:33 smithi096 ceph-mon[124666]: pgmap v14396: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 333 KiB/s rd, 353 KiB/s wr, 10 op/s 2023-05-08T11:12:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26893.182116 secs 2023-05-08T11:12:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26893.182116 secs 2023-05-08T11:12:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26893.182116 secs 2023-05-08T11:12:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26893.737863 secs 2023-05-08T11:12:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:35 smithi186 ceph-mon[126480]: pgmap v14397: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 353 KiB/s wr, 12 op/s 2023-05-08T11:12:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26893.737863 secs 2023-05-08T11:12:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:35 smithi133 ceph-mon[125939]: pgmap v14397: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 353 KiB/s wr, 12 op/s 2023-05-08T11:12:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26893.737863 secs 2023-05-08T11:12:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:35 smithi096 ceph-mon[124666]: pgmap v14397: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 353 KiB/s wr, 12 op/s 2023-05-08T11:12:36.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26895.025668 secs 2023-05-08T11:12:36.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:36 smithi186 ceph-mon[126480]: osdmap e976: 12 total, 12 up, 12 in 2023-05-08T11:12:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26895.025668 secs 2023-05-08T11:12:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:36 smithi133 ceph-mon[125939]: osdmap e976: 12 total, 12 up, 12 in 2023-05-08T11:12:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26895.025668 secs 2023-05-08T11:12:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:36 smithi096 ceph-mon[124666]: osdmap e976: 12 total, 12 up, 12 in 2023-05-08T11:12:37.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:37 smithi186 ceph-mon[126480]: pgmap v14399: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 620 KiB/s wr, 13 op/s 2023-05-08T11:12:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:37 smithi133 ceph-mon[125939]: pgmap v14399: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 620 KiB/s wr, 13 op/s 2023-05-08T11:12:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:37 smithi096 ceph-mon[124666]: pgmap v14399: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 620 KiB/s wr, 13 op/s 2023-05-08T11:12:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:39 smithi186 ceph-mon[126480]: pgmap v14400: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 620 KiB/s wr, 13 op/s 2023-05-08T11:12:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26898.182270 secs 2023-05-08T11:12:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:39 smithi133 ceph-mon[125939]: pgmap v14400: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 620 KiB/s wr, 13 op/s 2023-05-08T11:12:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26898.182270 secs 2023-05-08T11:12:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:39 smithi096 ceph-mon[124666]: pgmap v14400: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 620 KiB/s wr, 13 op/s 2023-05-08T11:12:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26898.182270 secs 2023-05-08T11:12:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26898.737989 secs 2023-05-08T11:12:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26898.737989 secs 2023-05-08T11:12:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26898.737989 secs 2023-05-08T11:12:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:41 smithi186 ceph-mon[126480]: pgmap v14401: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 351 KiB/s wr, 9 op/s 2023-05-08T11:12:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26900.025809 secs 2023-05-08T11:12:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:41 smithi133 ceph-mon[125939]: pgmap v14401: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 351 KiB/s wr, 9 op/s 2023-05-08T11:12:41.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26900.025809 secs 2023-05-08T11:12:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:41 smithi096 ceph-mon[124666]: pgmap v14401: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 351 KiB/s wr, 9 op/s 2023-05-08T11:12:41.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26900.025809 secs 2023-05-08T11:12:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:43 smithi186 ceph-mon[126480]: pgmap v14402: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 353 KiB/s rd, 351 KiB/s wr, 9 op/s 2023-05-08T11:12:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:43 smithi133 ceph-mon[125939]: pgmap v14402: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 353 KiB/s rd, 351 KiB/s wr, 9 op/s 2023-05-08T11:12:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:43 smithi096 ceph-mon[124666]: pgmap v14402: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 353 KiB/s rd, 351 KiB/s wr, 9 op/s 2023-05-08T11:12:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26903.182394 secs 2023-05-08T11:12:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26903.182394 secs 2023-05-08T11:12:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26903.182394 secs 2023-05-08T11:12:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26903.738121 secs 2023-05-08T11:12:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:45 smithi186 ceph-mon[126480]: pgmap v14403: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 353 KiB/s rd, 503 KiB/s wr, 8 op/s 2023-05-08T11:12:45.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:45 smithi186 ceph-mon[126480]: osdmap e977: 12 total, 12 up, 12 in 2023-05-08T11:12:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26903.738121 secs 2023-05-08T11:12:45.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:45 smithi133 ceph-mon[125939]: pgmap v14403: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 353 KiB/s rd, 503 KiB/s wr, 8 op/s 2023-05-08T11:12:45.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:45 smithi133 ceph-mon[125939]: osdmap e977: 12 total, 12 up, 12 in 2023-05-08T11:12:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26903.738121 secs 2023-05-08T11:12:45.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:45 smithi096 ceph-mon[124666]: pgmap v14403: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 353 KiB/s rd, 503 KiB/s wr, 8 op/s 2023-05-08T11:12:45.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:45 smithi096 ceph-mon[124666]: osdmap e977: 12 total, 12 up, 12 in 2023-05-08T11:12:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:47 smithi186 ceph-mon[126480]: pgmap v14405: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 568 KiB/s rd, 521 KiB/s wr, 8 op/s 2023-05-08T11:12:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:47 smithi133 ceph-mon[125939]: pgmap v14405: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 568 KiB/s rd, 521 KiB/s wr, 8 op/s 2023-05-08T11:12:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:47 smithi096 ceph-mon[124666]: pgmap v14405: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 568 KiB/s rd, 521 KiB/s wr, 8 op/s 2023-05-08T11:12:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:12:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:12:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:12:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:49 smithi186 ceph-mon[126480]: pgmap v14406: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 568 KiB/s rd, 521 KiB/s wr, 8 op/s 2023-05-08T11:12:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:12:49.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:12:49.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:12:49.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26908.182539 secs 2023-05-08T11:12:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:49 smithi133 ceph-mon[125939]: pgmap v14406: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 568 KiB/s rd, 521 KiB/s wr, 8 op/s 2023-05-08T11:12:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:12:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:12:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:12:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26908.182539 secs 2023-05-08T11:12:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:49 smithi096 ceph-mon[124666]: pgmap v14406: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 568 KiB/s rd, 521 KiB/s wr, 8 op/s 2023-05-08T11:12:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:12:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:12:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:12:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26908.182539 secs 2023-05-08T11:12:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:51 smithi186 ceph-mon[126480]: pgmap v14407: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 683 KiB/s rd, 486 KiB/s wr, 9 op/s 2023-05-08T11:12:51.603 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26910.026038 secs 2023-05-08T11:12:51.603 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:51 smithi096 ceph-mon[124666]: pgmap v14407: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 683 KiB/s rd, 486 KiB/s wr, 9 op/s 2023-05-08T11:12:51.604 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26910.026038 secs 2023-05-08T11:12:51.604 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:51 smithi133 ceph-mon[125939]: pgmap v14407: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 683 KiB/s rd, 486 KiB/s wr, 9 op/s 2023-05-08T11:12:51.604 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26910.026038 secs 2023-05-08T11:12:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:12:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:12:53.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:53 smithi186 ceph-mon[126480]: pgmap v14408: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 488 KiB/s rd, 486 KiB/s wr, 9 op/s 2023-05-08T11:12:53.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:53 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:12:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:12:53.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:12:53.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:53 smithi133 ceph-mon[125939]: pgmap v14408: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 488 KiB/s rd, 486 KiB/s wr, 9 op/s 2023-05-08T11:12:53.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:53 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:12:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:12:53.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:12:53.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:53 smithi096 ceph-mon[124666]: pgmap v14408: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 488 KiB/s rd, 486 KiB/s wr, 9 op/s 2023-05-08T11:12:53.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:53 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:12:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:54 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:12:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:54 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:12:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:54 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:12:54.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:54 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:12:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:54 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:12:54.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:54 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:12:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26913.182673 secs 2023-05-08T11:12:55.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:55 smithi186 ceph-mon[126480]: pgmap v14409: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 661 KiB/s rd, 773 KiB/s wr, 11 op/s 2023-05-08T11:12:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26913.182673 secs 2023-05-08T11:12:55.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:55 smithi133 ceph-mon[125939]: pgmap v14409: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 661 KiB/s rd, 773 KiB/s wr, 11 op/s 2023-05-08T11:12:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26913.182673 secs 2023-05-08T11:12:55.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:55 smithi096 ceph-mon[124666]: pgmap v14409: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 661 KiB/s rd, 773 KiB/s wr, 11 op/s 2023-05-08T11:12:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26915.026179 secs 2023-05-08T11:12:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26915.026179 secs 2023-05-08T11:12:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26915.026179 secs 2023-05-08T11:12:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:57 smithi186 ceph-mon[126480]: pgmap v14410: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 628 KiB/s rd, 718 KiB/s wr, 11 op/s 2023-05-08T11:12:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:57 smithi133 ceph-mon[125939]: pgmap v14410: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 628 KiB/s rd, 718 KiB/s wr, 11 op/s 2023-05-08T11:12:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:57 smithi096 ceph-mon[124666]: pgmap v14410: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 628 KiB/s rd, 718 KiB/s wr, 11 op/s 2023-05-08T11:12:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:12:59 smithi133 ceph-mon[125939]: pgmap v14411: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 482 KiB/s wr, 9 op/s 2023-05-08T11:12:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:12:59 smithi096 ceph-mon[124666]: pgmap v14411: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 482 KiB/s wr, 9 op/s 2023-05-08T11:12:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:12:59 smithi186 ceph-mon[126480]: pgmap v14411: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 482 KiB/s wr, 9 op/s 2023-05-08T11:13:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26918.182804 secs 2023-05-08T11:13:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26918.738462 secs 2023-05-08T11:13:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26918.182804 secs 2023-05-08T11:13:00.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26918.738462 secs 2023-05-08T11:13:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26918.182804 secs 2023-05-08T11:13:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26918.738462 secs 2023-05-08T11:13:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:01 smithi133 ceph-mon[125939]: pgmap v14412: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 852 KiB/s rd, 808 KiB/s wr, 15 op/s 2023-05-08T11:13:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26920.026300 secs 2023-05-08T11:13:01.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:01 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:13:01.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:13:01.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:13:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:01 smithi096 ceph-mon[124666]: pgmap v14412: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 852 KiB/s rd, 808 KiB/s wr, 15 op/s 2023-05-08T11:13:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26920.026300 secs 2023-05-08T11:13:01.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:01 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:13:01.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:13:01.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:13:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:01 smithi186 ceph-mon[126480]: pgmap v14412: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 852 KiB/s rd, 808 KiB/s wr, 15 op/s 2023-05-08T11:13:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26920.026300 secs 2023-05-08T11:13:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:01 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:13:01.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:13:01.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:13:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:03 smithi133 ceph-mon[125939]: pgmap v14413: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 626 KiB/s rd, 709 KiB/s wr, 11 op/s 2023-05-08T11:13:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:03 smithi096 ceph-mon[124666]: pgmap v14413: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 626 KiB/s rd, 709 KiB/s wr, 11 op/s 2023-05-08T11:13:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:03 smithi186 ceph-mon[126480]: pgmap v14413: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 626 KiB/s rd, 709 KiB/s wr, 11 op/s 2023-05-08T11:13:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:04 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:13:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:04 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:13:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:04 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:13:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26923.182941 secs 2023-05-08T11:13:05.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:05 smithi133 ceph-mon[125939]: pgmap v14414: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 874 KiB/s wr, 16 op/s 2023-05-08T11:13:05.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:13:05.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:13:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26923.182941 secs 2023-05-08T11:13:05.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:05 smithi096 ceph-mon[124666]: pgmap v14414: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 874 KiB/s wr, 16 op/s 2023-05-08T11:13:05.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:13:05.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:13:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26923.182941 secs 2023-05-08T11:13:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:05 smithi186 ceph-mon[126480]: pgmap v14414: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 874 KiB/s wr, 16 op/s 2023-05-08T11:13:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:13:05.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:13:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26925.026416 secs 2023-05-08T11:13:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26925.026416 secs 2023-05-08T11:13:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26925.026416 secs 2023-05-08T11:13:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:07 smithi133 ceph-mon[125939]: pgmap v14415: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 950 KiB/s rd, 763 KiB/s wr, 14 op/s 2023-05-08T11:13:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:07 smithi096 ceph-mon[124666]: pgmap v14415: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 950 KiB/s rd, 763 KiB/s wr, 14 op/s 2023-05-08T11:13:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:07 smithi186 ceph-mon[126480]: pgmap v14415: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 950 KiB/s rd, 763 KiB/s wr, 14 op/s 2023-05-08T11:13:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:09 smithi133 ceph-mon[125939]: pgmap v14416: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 922 KiB/s rd, 746 KiB/s wr, 13 op/s 2023-05-08T11:13:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:09 smithi096 ceph-mon[124666]: pgmap v14416: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 922 KiB/s rd, 746 KiB/s wr, 13 op/s 2023-05-08T11:13:09.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:09 smithi186 ceph-mon[126480]: pgmap v14416: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 922 KiB/s rd, 746 KiB/s wr, 13 op/s 2023-05-08T11:13:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26928.183062 secs 2023-05-08T11:13:10.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26928.738691 secs 2023-05-08T11:13:10.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:10 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:13:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26928.183062 secs 2023-05-08T11:13:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26928.738691 secs 2023-05-08T11:13:10.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:10 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:13:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26928.183062 secs 2023-05-08T11:13:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26928.738691 secs 2023-05-08T11:13:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:10 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:13:11.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:11 smithi133 ceph-mon[125939]: pgmap v14417: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 838 KiB/s wr, 30 op/s 2023-05-08T11:13:11.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26930.026553 secs 2023-05-08T11:13:11.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:11 smithi096 ceph-mon[124666]: pgmap v14417: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 838 KiB/s wr, 30 op/s 2023-05-08T11:13:11.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26930.026553 secs 2023-05-08T11:13:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:11 smithi186 ceph-mon[126480]: pgmap v14417: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 838 KiB/s wr, 30 op/s 2023-05-08T11:13:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26930.026553 secs 2023-05-08T11:13:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:12 smithi133 ceph-mon[125939]: osdmap e978: 12 total, 12 up, 12 in 2023-05-08T11:13:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:12 smithi096 ceph-mon[124666]: osdmap e978: 12 total, 12 up, 12 in 2023-05-08T11:13:12.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:12 smithi186 ceph-mon[126480]: osdmap e978: 12 total, 12 up, 12 in 2023-05-08T11:13:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:13 smithi133 ceph-mon[125939]: pgmap v14419: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 980 KiB/s rd, 615 KiB/s wr, 30 op/s 2023-05-08T11:13:13.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:13:13.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:13 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:13:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:13 smithi096 ceph-mon[124666]: pgmap v14419: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 980 KiB/s rd, 615 KiB/s wr, 30 op/s 2023-05-08T11:13:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:13:13.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:13 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:13:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:13 smithi186 ceph-mon[126480]: pgmap v14419: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 980 KiB/s rd, 615 KiB/s wr, 30 op/s 2023-05-08T11:13:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:13:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:13 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:13:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26933.183233 secs 2023-05-08T11:13:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26933.183233 secs 2023-05-08T11:13:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26933.183233 secs 2023-05-08T11:13:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26933.738788 secs 2023-05-08T11:13:15.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:15 smithi133 ceph-mon[125939]: pgmap v14420: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 622 KiB/s rd, 714 KiB/s wr, 27 op/s 2023-05-08T11:13:15.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:15 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:13:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26933.738788 secs 2023-05-08T11:13:15.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:15 smithi096 ceph-mon[124666]: pgmap v14420: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 622 KiB/s rd, 714 KiB/s wr, 27 op/s 2023-05-08T11:13:15.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:15 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:13:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26933.738788 secs 2023-05-08T11:13:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:15 smithi186 ceph-mon[126480]: pgmap v14420: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 622 KiB/s rd, 714 KiB/s wr, 27 op/s 2023-05-08T11:13:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:15 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:13:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26935.026647 secs 2023-05-08T11:13:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26935.026647 secs 2023-05-08T11:13:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26935.026647 secs 2023-05-08T11:13:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:17 smithi133 ceph-mon[125939]: pgmap v14421: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 495 KiB/s wr, 26 op/s 2023-05-08T11:13:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:17 smithi096 ceph-mon[124666]: pgmap v14421: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 495 KiB/s wr, 26 op/s 2023-05-08T11:13:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:17 smithi186 ceph-mon[126480]: pgmap v14421: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 495 KiB/s wr, 26 op/s 2023-05-08T11:13:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:19 smithi133 ceph-mon[125939]: pgmap v14422: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 495 KiB/s wr, 26 op/s 2023-05-08T11:13:19.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26938.183426 secs 2023-05-08T11:13:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:19 smithi096 ceph-mon[124666]: pgmap v14422: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 495 KiB/s wr, 26 op/s 2023-05-08T11:13:19.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26938.183426 secs 2023-05-08T11:13:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:19 smithi186 ceph-mon[126480]: pgmap v14422: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 495 KiB/s wr, 26 op/s 2023-05-08T11:13:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26938.183426 secs 2023-05-08T11:13:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26938.738922 secs 2023-05-08T11:13:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:20 smithi133 ceph-mon[125939]: osdmap e979: 12 total, 12 up, 12 in 2023-05-08T11:13:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26938.738922 secs 2023-05-08T11:13:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:20 smithi096 ceph-mon[124666]: osdmap e979: 12 total, 12 up, 12 in 2023-05-08T11:13:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26938.738922 secs 2023-05-08T11:13:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:20 smithi186 ceph-mon[126480]: osdmap e979: 12 total, 12 up, 12 in 2023-05-08T11:13:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:21 smithi133 ceph-mon[125939]: pgmap v14424: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 434 KiB/s rd, 453 KiB/s wr, 11 op/s 2023-05-08T11:13:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26940.026767 secs 2023-05-08T11:13:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:21 smithi096 ceph-mon[124666]: pgmap v14424: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 434 KiB/s rd, 453 KiB/s wr, 11 op/s 2023-05-08T11:13:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26940.026767 secs 2023-05-08T11:13:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:21 smithi186 ceph-mon[126480]: pgmap v14424: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 434 KiB/s rd, 453 KiB/s wr, 11 op/s 2023-05-08T11:13:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26940.026767 secs 2023-05-08T11:13:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:23 smithi133 ceph-mon[125939]: pgmap v14425: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 404 KiB/s wr, 9 op/s 2023-05-08T11:13:23.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:23 smithi096 ceph-mon[124666]: pgmap v14425: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 404 KiB/s wr, 9 op/s 2023-05-08T11:13:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:23 smithi186 ceph-mon[126480]: pgmap v14425: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 404 KiB/s wr, 9 op/s 2023-05-08T11:13:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26943.183539 secs 2023-05-08T11:13:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26943.183539 secs 2023-05-08T11:13:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26943.183539 secs 2023-05-08T11:13:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26943.739021 secs 2023-05-08T11:13:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:25 smithi133 ceph-mon[125939]: pgmap v14426: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 182 KiB/s wr, 9 op/s 2023-05-08T11:13:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26943.739021 secs 2023-05-08T11:13:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:25 smithi096 ceph-mon[124666]: pgmap v14426: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 182 KiB/s wr, 9 op/s 2023-05-08T11:13:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26943.739021 secs 2023-05-08T11:13:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:25 smithi186 ceph-mon[126480]: pgmap v14426: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 182 KiB/s wr, 9 op/s 2023-05-08T11:13:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26945.026903 secs 2023-05-08T11:13:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26945.026903 secs 2023-05-08T11:13:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26945.026903 secs 2023-05-08T11:13:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:27 smithi133 ceph-mon[125939]: pgmap v14427: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 94 KiB/s wr, 8 op/s 2023-05-08T11:13:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:27 smithi096 ceph-mon[124666]: pgmap v14427: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 94 KiB/s wr, 8 op/s 2023-05-08T11:13:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:27 smithi186 ceph-mon[126480]: pgmap v14427: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 94 KiB/s wr, 8 op/s 2023-05-08T11:13:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:29 smithi133 ceph-mon[125939]: pgmap v14428: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 94 KiB/s wr, 8 op/s 2023-05-08T11:13:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26948.183650 secs 2023-05-08T11:13:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:29 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:13:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:29 smithi096 ceph-mon[124666]: pgmap v14428: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 94 KiB/s wr, 8 op/s 2023-05-08T11:13:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26948.183650 secs 2023-05-08T11:13:29.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:29 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:13:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:29 smithi186 ceph-mon[126480]: pgmap v14428: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 94 KiB/s wr, 8 op/s 2023-05-08T11:13:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26948.183650 secs 2023-05-08T11:13:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:29 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:13:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26948.739107 secs 2023-05-08T11:13:30.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:13:30.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:13:30.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:30 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:13:30.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:13:30.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:30 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T11:13:30.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:30 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T11:13:30.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:30 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:13:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26948.739107 secs 2023-05-08T11:13:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:13:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:13:30.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:30 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:13:30.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:13:30.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:30 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T11:13:30.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:30 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T11:13:30.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:30 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:13:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26948.739107 secs 2023-05-08T11:13:30.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:13:30.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:13:30.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:30 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:13:30.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:13:30.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:30 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T11:13:30.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:30 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T11:13:30.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:30 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:13:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:31 smithi133 ceph-mon[125939]: pgmap v14429: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 150 KiB/s wr, 8 op/s 2023-05-08T11:13:31.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26950.027013 secs 2023-05-08T11:13:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:31 smithi096 ceph-mon[124666]: pgmap v14429: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 150 KiB/s wr, 8 op/s 2023-05-08T11:13:31.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26950.027013 secs 2023-05-08T11:13:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:31 smithi186 ceph-mon[126480]: pgmap v14429: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 150 KiB/s wr, 8 op/s 2023-05-08T11:13:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26950.027013 secs 2023-05-08T11:13:33.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:33 smithi133 ceph-mon[125939]: pgmap v14430: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 126 KiB/s wr, 6 op/s 2023-05-08T11:13:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:33 smithi096 ceph-mon[124666]: pgmap v14430: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 126 KiB/s wr, 6 op/s 2023-05-08T11:13:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:33 smithi186 ceph-mon[126480]: pgmap v14430: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 126 KiB/s wr, 6 op/s 2023-05-08T11:13:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26953.183778 secs 2023-05-08T11:13:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26953.183778 secs 2023-05-08T11:13:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26953.183778 secs 2023-05-08T11:13:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26953.739223 secs 2023-05-08T11:13:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:35 smithi133 ceph-mon[125939]: pgmap v14431: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 160 KiB/s wr, 9 op/s 2023-05-08T11:13:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26953.739223 secs 2023-05-08T11:13:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:35 smithi096 ceph-mon[124666]: pgmap v14431: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 160 KiB/s wr, 9 op/s 2023-05-08T11:13:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26953.739223 secs 2023-05-08T11:13:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:35 smithi186 ceph-mon[126480]: pgmap v14431: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 160 KiB/s wr, 9 op/s 2023-05-08T11:13:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26955.027130 secs 2023-05-08T11:13:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26955.027130 secs 2023-05-08T11:13:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26955.027130 secs 2023-05-08T11:13:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:37 smithi133 ceph-mon[125939]: pgmap v14432: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 99 KiB/s wr, 8 op/s 2023-05-08T11:13:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:37 smithi096 ceph-mon[124666]: pgmap v14432: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 99 KiB/s wr, 8 op/s 2023-05-08T11:13:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:37 smithi186 ceph-mon[126480]: pgmap v14432: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 99 KiB/s wr, 8 op/s 2023-05-08T11:13:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:39 smithi133 ceph-mon[125939]: pgmap v14433: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 99 KiB/s wr, 7 op/s 2023-05-08T11:13:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26958.183915 secs 2023-05-08T11:13:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:39 smithi096 ceph-mon[124666]: pgmap v14433: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 99 KiB/s wr, 7 op/s 2023-05-08T11:13:39.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26958.183915 secs 2023-05-08T11:13:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:39 smithi186 ceph-mon[126480]: pgmap v14433: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 99 KiB/s wr, 7 op/s 2023-05-08T11:13:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26958.183915 secs 2023-05-08T11:13:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26958.739342 secs 2023-05-08T11:13:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26958.739342 secs 2023-05-08T11:13:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26958.739342 secs 2023-05-08T11:13:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:41 smithi096 ceph-mon[124666]: pgmap v14434: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 296 KiB/s wr, 10 op/s 2023-05-08T11:13:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26960.027249 secs 2023-05-08T11:13:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:41 smithi186 ceph-mon[126480]: pgmap v14434: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 296 KiB/s wr, 10 op/s 2023-05-08T11:13:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26960.027249 secs 2023-05-08T11:13:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:41 smithi133 ceph-mon[125939]: pgmap v14434: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 296 KiB/s wr, 10 op/s 2023-05-08T11:13:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26960.027249 secs 2023-05-08T11:13:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:43 smithi096 ceph-mon[124666]: pgmap v14435: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 232 KiB/s wr, 7 op/s 2023-05-08T11:13:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:43 smithi186 ceph-mon[126480]: pgmap v14435: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 232 KiB/s wr, 7 op/s 2023-05-08T11:13:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:43 smithi133 ceph-mon[125939]: pgmap v14435: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 232 KiB/s wr, 7 op/s 2023-05-08T11:13:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26963.184043 secs 2023-05-08T11:13:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26963.184043 secs 2023-05-08T11:13:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26963.184043 secs 2023-05-08T11:13:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26963.739460 secs 2023-05-08T11:13:45.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:45 smithi096 ceph-mon[124666]: pgmap v14436: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 233 KiB/s wr, 9 op/s 2023-05-08T11:13:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26963.739460 secs 2023-05-08T11:13:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:45 smithi186 ceph-mon[126480]: pgmap v14436: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 233 KiB/s wr, 9 op/s 2023-05-08T11:13:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26963.739460 secs 2023-05-08T11:13:45.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:45 smithi133 ceph-mon[125939]: pgmap v14436: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 233 KiB/s wr, 9 op/s 2023-05-08T11:13:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:47 smithi186 ceph-mon[126480]: pgmap v14437: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 278 KiB/s wr, 8 op/s 2023-05-08T11:13:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:47 smithi133 ceph-mon[125939]: pgmap v14437: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 278 KiB/s wr, 8 op/s 2023-05-08T11:13:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:47 smithi096 ceph-mon[124666]: pgmap v14437: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 278 KiB/s wr, 8 op/s 2023-05-08T11:13:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:13:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:13:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:13:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:49 smithi186 ceph-mon[126480]: pgmap v14438: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 278 KiB/s wr, 7 op/s 2023-05-08T11:13:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:13:49.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:13:49.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:13:49.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26968.184178 secs 2023-05-08T11:13:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:49 smithi133 ceph-mon[125939]: pgmap v14438: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 278 KiB/s wr, 7 op/s 2023-05-08T11:13:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:13:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:13:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:13:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26968.184178 secs 2023-05-08T11:13:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:49 smithi096 ceph-mon[124666]: pgmap v14438: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 278 KiB/s wr, 7 op/s 2023-05-08T11:13:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:13:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:13:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:13:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26968.184178 secs 2023-05-08T11:13:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26968.739569 secs 2023-05-08T11:13:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26968.739569 secs 2023-05-08T11:13:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26968.739569 secs 2023-05-08T11:13:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:51 smithi186 ceph-mon[126480]: pgmap v14439: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 619 KiB/s rd, 296 KiB/s wr, 10 op/s 2023-05-08T11:13:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:51 smithi133 ceph-mon[125939]: pgmap v14439: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 619 KiB/s rd, 296 KiB/s wr, 10 op/s 2023-05-08T11:13:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:51 smithi096 ceph-mon[124666]: pgmap v14439: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 619 KiB/s rd, 296 KiB/s wr, 10 op/s 2023-05-08T11:13:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:53 smithi186 ceph-mon[126480]: pgmap v14440: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 617 KiB/s rd, 98 KiB/s wr, 7 op/s 2023-05-08T11:13:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:53 smithi133 ceph-mon[125939]: pgmap v14440: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 617 KiB/s rd, 98 KiB/s wr, 7 op/s 2023-05-08T11:13:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:53 smithi096 ceph-mon[124666]: pgmap v14440: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 617 KiB/s rd, 98 KiB/s wr, 7 op/s 2023-05-08T11:13:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26973.184311 secs 2023-05-08T11:13:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26973.184311 secs 2023-05-08T11:13:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26973.184311 secs 2023-05-08T11:13:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:55 smithi186 ceph-mon[126480]: pgmap v14441: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 618 KiB/s rd, 98 KiB/s wr, 9 op/s 2023-05-08T11:13:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:55 smithi133 ceph-mon[125939]: pgmap v14441: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 618 KiB/s rd, 98 KiB/s wr, 9 op/s 2023-05-08T11:13:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:55 smithi096 ceph-mon[124666]: pgmap v14441: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 618 KiB/s rd, 98 KiB/s wr, 9 op/s 2023-05-08T11:13:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:13:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:13:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:13:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:57 smithi186 ceph-mon[126480]: pgmap v14442: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 924 KiB/s rd, 404 KiB/s wr, 8 op/s 2023-05-08T11:13:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:57 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:13:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:13:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:13:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:57 smithi133 ceph-mon[125939]: pgmap v14442: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 924 KiB/s rd, 404 KiB/s wr, 8 op/s 2023-05-08T11:13:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:57 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:13:57.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:13:57.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:13:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:57 smithi096 ceph-mon[124666]: pgmap v14442: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 924 KiB/s rd, 404 KiB/s wr, 8 op/s 2023-05-08T11:13:57.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:57 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:13:57.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:13:57.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:13:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:59 smithi186 ceph-mon[126480]: pgmap v14443: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 486 KiB/s rd, 324 KiB/s wr, 7 op/s 2023-05-08T11:13:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:13:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26978.184423 secs 2023-05-08T11:13:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:59 smithi133 ceph-mon[125939]: pgmap v14443: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 486 KiB/s rd, 324 KiB/s wr, 7 op/s 2023-05-08T11:13:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:13:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26978.184423 secs 2023-05-08T11:13:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:59 smithi096 ceph-mon[124666]: pgmap v14443: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 486 KiB/s rd, 324 KiB/s wr, 7 op/s 2023-05-08T11:13:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:13:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26978.184423 secs 2023-05-08T11:14:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:01 smithi186 ceph-mon[126480]: pgmap v14444: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 678 KiB/s wr, 12 op/s 2023-05-08T11:14:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26980.027764 secs 2023-05-08T11:14:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:01 smithi133 ceph-mon[125939]: pgmap v14444: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 678 KiB/s wr, 12 op/s 2023-05-08T11:14:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26980.027764 secs 2023-05-08T11:14:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:01 smithi096 ceph-mon[124666]: pgmap v14444: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 678 KiB/s wr, 12 op/s 2023-05-08T11:14:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26980.027764 secs 2023-05-08T11:14:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:03 smithi133 ceph-mon[125939]: pgmap v14445: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 573 KiB/s rd, 869 KiB/s wr, 10 op/s 2023-05-08T11:14:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:03 smithi096 ceph-mon[124666]: pgmap v14445: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 573 KiB/s rd, 869 KiB/s wr, 10 op/s 2023-05-08T11:14:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:03 smithi186 ceph-mon[126480]: pgmap v14445: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 573 KiB/s rd, 869 KiB/s wr, 10 op/s 2023-05-08T11:14:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26983.184542 secs 2023-05-08T11:14:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:04 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:14:04.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:04 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:14:04.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:04 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:14:04.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:04 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:14:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26983.184542 secs 2023-05-08T11:14:04.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:04 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:14:04.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:04 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:14:04.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:04 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:14:04.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:04 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:14:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26983.184542 secs 2023-05-08T11:14:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:04 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:14:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:04 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:14:04.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:04 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:14:04.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:04 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:14:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26983.739856 secs 2023-05-08T11:14:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:05 smithi133 ceph-mon[125939]: pgmap v14446: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 930 KiB/s wr, 26 op/s 2023-05-08T11:14:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26983.739856 secs 2023-05-08T11:14:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:05 smithi096 ceph-mon[124666]: pgmap v14446: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 930 KiB/s wr, 26 op/s 2023-05-08T11:14:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26983.739856 secs 2023-05-08T11:14:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:05 smithi186 ceph-mon[126480]: pgmap v14446: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 930 KiB/s wr, 26 op/s 2023-05-08T11:14:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:07 smithi133 ceph-mon[125939]: pgmap v14447: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 993 KiB/s rd, 975 KiB/s wr, 27 op/s 2023-05-08T11:14:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:07 smithi096 ceph-mon[124666]: pgmap v14447: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 993 KiB/s rd, 975 KiB/s wr, 27 op/s 2023-05-08T11:14:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:07 smithi186 ceph-mon[126480]: pgmap v14447: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 993 KiB/s rd, 975 KiB/s wr, 27 op/s 2023-05-08T11:14:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:08 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:14:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:08 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:14:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:08 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:14:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:09 smithi133 ceph-mon[125939]: pgmap v14448: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 668 KiB/s wr, 25 op/s 2023-05-08T11:14:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:14:09.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:14:09.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26988.184667 secs 2023-05-08T11:14:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:09 smithi096 ceph-mon[124666]: pgmap v14448: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 668 KiB/s wr, 25 op/s 2023-05-08T11:14:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:14:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:14:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26988.184667 secs 2023-05-08T11:14:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:09 smithi186 ceph-mon[126480]: pgmap v14448: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 668 KiB/s wr, 25 op/s 2023-05-08T11:14:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:14:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:14:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26988.184667 secs 2023-05-08T11:14:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:10 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:14:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:10 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:14:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:10 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:14:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:11 smithi133 ceph-mon[125939]: pgmap v14449: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 705 KiB/s rd, 686 KiB/s wr, 29 op/s 2023-05-08T11:14:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:11 smithi096 ceph-mon[124666]: pgmap v14449: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 705 KiB/s rd, 686 KiB/s wr, 29 op/s 2023-05-08T11:14:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:11 smithi186 ceph-mon[126480]: pgmap v14449: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 705 KiB/s rd, 686 KiB/s wr, 29 op/s 2023-05-08T11:14:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:12 smithi133 ceph-mon[125939]: osdmap e980: 12 total, 12 up, 12 in 2023-05-08T11:14:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:12 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:14:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:12 smithi096 ceph-mon[124666]: osdmap e980: 12 total, 12 up, 12 in 2023-05-08T11:14:12.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:12 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:14:12.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:12 smithi186 ceph-mon[126480]: osdmap e980: 12 total, 12 up, 12 in 2023-05-08T11:14:12.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:12 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:14:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:13 smithi133 ceph-mon[125939]: pgmap v14451: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 682 KiB/s rd, 303 KiB/s wr, 28 op/s 2023-05-08T11:14:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:14:13.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:13 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:14:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:13 smithi096 ceph-mon[124666]: pgmap v14451: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 682 KiB/s rd, 303 KiB/s wr, 28 op/s 2023-05-08T11:14:13.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:14:13.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:13 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:14:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:13 smithi186 ceph-mon[126480]: pgmap v14451: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 682 KiB/s rd, 303 KiB/s wr, 28 op/s 2023-05-08T11:14:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:14:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:13 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:14:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26993.184798 secs 2023-05-08T11:14:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26993.184798 secs 2023-05-08T11:14:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26993.184798 secs 2023-05-08T11:14:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:15 smithi133 ceph-mon[125939]: pgmap v14452: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 230 KiB/s wr, 11 op/s 2023-05-08T11:14:15.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:15 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:14:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:15 smithi096 ceph-mon[124666]: pgmap v14452: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 230 KiB/s wr, 11 op/s 2023-05-08T11:14:15.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:15 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:14:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:15 smithi186 ceph-mon[126480]: pgmap v14452: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 230 KiB/s wr, 11 op/s 2023-05-08T11:14:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:15 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:14:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:17 smithi096 ceph-mon[124666]: pgmap v14453: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 427 KiB/s wr, 10 op/s 2023-05-08T11:14:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:17 smithi186 ceph-mon[126480]: pgmap v14453: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 427 KiB/s wr, 10 op/s 2023-05-08T11:14:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:17 smithi133 ceph-mon[125939]: pgmap v14453: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 427 KiB/s wr, 10 op/s 2023-05-08T11:14:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:19 smithi096 ceph-mon[124666]: pgmap v14454: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 427 KiB/s wr, 10 op/s 2023-05-08T11:14:19.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 26998.184888 secs 2023-05-08T11:14:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:19 smithi186 ceph-mon[126480]: pgmap v14454: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 427 KiB/s wr, 10 op/s 2023-05-08T11:14:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 26998.184888 secs 2023-05-08T11:14:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:19 smithi133 ceph-mon[125939]: pgmap v14454: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 427 KiB/s wr, 10 op/s 2023-05-08T11:14:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 26998.184888 secs 2023-05-08T11:14:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:21 smithi186 ceph-mon[126480]: osdmap e981: 12 total, 12 up, 12 in 2023-05-08T11:14:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:21 smithi186 ceph-mon[126480]: pgmap v14456: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 388 KiB/s wr, 10 op/s 2023-05-08T11:14:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:21 smithi133 ceph-mon[125939]: osdmap e981: 12 total, 12 up, 12 in 2023-05-08T11:14:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:21 smithi133 ceph-mon[125939]: pgmap v14456: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 388 KiB/s wr, 10 op/s 2023-05-08T11:14:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:21 smithi096 ceph-mon[124666]: osdmap e981: 12 total, 12 up, 12 in 2023-05-08T11:14:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:21 smithi096 ceph-mon[124666]: pgmap v14456: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 388 KiB/s wr, 10 op/s 2023-05-08T11:14:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:23 smithi133 ceph-mon[125939]: pgmap v14457: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 344 KiB/s wr, 9 op/s 2023-05-08T11:14:23.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:23 smithi096 ceph-mon[124666]: pgmap v14457: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 344 KiB/s wr, 9 op/s 2023-05-08T11:14:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:23 smithi186 ceph-mon[126480]: pgmap v14457: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 344 KiB/s wr, 9 op/s 2023-05-08T11:14:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27003.184953 secs 2023-05-08T11:14:24.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:24 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:14:24.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:24 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:14:24.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:24 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:14:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27003.184953 secs 2023-05-08T11:14:24.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:24 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:14:24.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:24 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:14:24.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:24 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:14:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27003.184953 secs 2023-05-08T11:14:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:24 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:14:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:24 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:14:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:24 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:14:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27003.740302 secs 2023-05-08T11:14:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:25 smithi133 ceph-mon[125939]: pgmap v14458: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 364 KiB/s wr, 8 op/s 2023-05-08T11:14:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27003.740302 secs 2023-05-08T11:14:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:25 smithi096 ceph-mon[124666]: pgmap v14458: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 364 KiB/s wr, 8 op/s 2023-05-08T11:14:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27003.740302 secs 2023-05-08T11:14:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:25 smithi186 ceph-mon[126480]: pgmap v14458: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 364 KiB/s wr, 8 op/s 2023-05-08T11:14:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27005.028311 secs 2023-05-08T11:14:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27005.028311 secs 2023-05-08T11:14:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27005.028311 secs 2023-05-08T11:14:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:27 smithi133 ceph-mon[125939]: pgmap v14459: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 511 KiB/s wr, 8 op/s 2023-05-08T11:14:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:27 smithi096 ceph-mon[124666]: pgmap v14459: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 511 KiB/s wr, 8 op/s 2023-05-08T11:14:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:27 smithi186 ceph-mon[126480]: pgmap v14459: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 511 KiB/s wr, 8 op/s 2023-05-08T11:14:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:29 smithi133 ceph-mon[125939]: pgmap v14460: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 511 KiB/s wr, 8 op/s 2023-05-08T11:14:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:29 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:14:29.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:29 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:14:29.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27008.185069 secs 2023-05-08T11:14:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:29 smithi096 ceph-mon[124666]: pgmap v14460: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 511 KiB/s wr, 8 op/s 2023-05-08T11:14:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:29 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:14:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:29 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:14:29.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27008.185069 secs 2023-05-08T11:14:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:29 smithi186 ceph-mon[126480]: pgmap v14460: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 511 KiB/s wr, 8 op/s 2023-05-08T11:14:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:29 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:14:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:29 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:14:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27008.185069 secs 2023-05-08T11:14:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27008.740416 secs 2023-05-08T11:14:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:14:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:30 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:14:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27008.740416 secs 2023-05-08T11:14:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:14:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:30 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:14:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27008.740416 secs 2023-05-08T11:14:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:14:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:30 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:14:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:31 smithi133 ceph-mon[125939]: pgmap v14461: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 554 KiB/s wr, 9 op/s 2023-05-08T11:14:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27010.028374 secs 2023-05-08T11:14:31.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:31 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:14:31.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:31 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:14:31.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:31 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:14:31.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:31 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:14:31.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:31 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T11:14:31.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:31 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T11:14:31.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:31 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:14:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:31 smithi096 ceph-mon[124666]: pgmap v14461: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 554 KiB/s wr, 9 op/s 2023-05-08T11:14:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27010.028374 secs 2023-05-08T11:14:31.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:31 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:14:31.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:31 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:14:31.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:31 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:14:31.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:31 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:14:31.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:31 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T11:14:31.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:31 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T11:14:31.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:31 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:14:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:31 smithi186 ceph-mon[126480]: pgmap v14461: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 554 KiB/s wr, 9 op/s 2023-05-08T11:14:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27010.028374 secs 2023-05-08T11:14:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:31 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:14:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:31 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:14:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:31 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:14:31.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:31 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:14:31.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:31 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T11:14:31.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:31 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T11:14:31.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:31 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:14:33.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:33 smithi133 ceph-mon[125939]: pgmap v14462: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 464 KiB/s wr, 8 op/s 2023-05-08T11:14:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:33 smithi096 ceph-mon[124666]: pgmap v14462: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 464 KiB/s wr, 8 op/s 2023-05-08T11:14:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:33 smithi186 ceph-mon[126480]: pgmap v14462: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 464 KiB/s wr, 8 op/s 2023-05-08T11:14:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27013.185185 secs 2023-05-08T11:14:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27013.185185 secs 2023-05-08T11:14:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27013.185185 secs 2023-05-08T11:14:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27013.740538 secs 2023-05-08T11:14:35.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:35 smithi133 ceph-mon[125939]: pgmap v14463: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 562 KiB/s rd, 642 KiB/s wr, 10 op/s 2023-05-08T11:14:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27013.740538 secs 2023-05-08T11:14:35.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:35 smithi096 ceph-mon[124666]: pgmap v14463: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 562 KiB/s rd, 642 KiB/s wr, 10 op/s 2023-05-08T11:14:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27013.740538 secs 2023-05-08T11:14:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:35 smithi186 ceph-mon[126480]: pgmap v14463: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 562 KiB/s rd, 642 KiB/s wr, 10 op/s 2023-05-08T11:14:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27015.028510 secs 2023-05-08T11:14:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27015.028510 secs 2023-05-08T11:14:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27015.028510 secs 2023-05-08T11:14:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:37 smithi096 ceph-mon[124666]: pgmap v14464: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 625 KiB/s wr, 9 op/s 2023-05-08T11:14:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:37 smithi186 ceph-mon[126480]: pgmap v14464: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 625 KiB/s wr, 9 op/s 2023-05-08T11:14:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:37 smithi133 ceph-mon[125939]: pgmap v14464: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 625 KiB/s wr, 9 op/s 2023-05-08T11:14:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:39 smithi096 ceph-mon[124666]: pgmap v14465: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 293 KiB/s wr, 7 op/s 2023-05-08T11:14:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27018.185299 secs 2023-05-08T11:14:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:39 smithi186 ceph-mon[126480]: pgmap v14465: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 293 KiB/s wr, 7 op/s 2023-05-08T11:14:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27018.185299 secs 2023-05-08T11:14:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:39 smithi133 ceph-mon[125939]: pgmap v14465: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 293 KiB/s wr, 7 op/s 2023-05-08T11:14:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27018.185299 secs 2023-05-08T11:14:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27018.740658 secs 2023-05-08T11:14:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27018.740658 secs 2023-05-08T11:14:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27018.740658 secs 2023-05-08T11:14:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:41 smithi096 ceph-mon[124666]: pgmap v14466: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 726 KiB/s rd, 392 KiB/s wr, 11 op/s 2023-05-08T11:14:41.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27020.028630 secs 2023-05-08T11:14:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:41 smithi186 ceph-mon[126480]: pgmap v14466: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 726 KiB/s rd, 392 KiB/s wr, 11 op/s 2023-05-08T11:14:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27020.028630 secs 2023-05-08T11:14:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:41 smithi133 ceph-mon[125939]: pgmap v14466: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 726 KiB/s rd, 392 KiB/s wr, 11 op/s 2023-05-08T11:14:41.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27020.028630 secs 2023-05-08T11:14:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:43 smithi186 ceph-mon[126480]: pgmap v14467: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 393 KiB/s rd, 276 KiB/s wr, 6 op/s 2023-05-08T11:14:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:43 smithi133 ceph-mon[125939]: pgmap v14467: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 393 KiB/s rd, 276 KiB/s wr, 6 op/s 2023-05-08T11:14:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:43 smithi096 ceph-mon[124666]: pgmap v14467: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 393 KiB/s rd, 276 KiB/s wr, 6 op/s 2023-05-08T11:14:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27023.185420 secs 2023-05-08T11:14:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27023.185420 secs 2023-05-08T11:14:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27023.185420 secs 2023-05-08T11:14:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27023.740784 secs 2023-05-08T11:14:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:45 smithi186 ceph-mon[126480]: pgmap v14468: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 545 KiB/s rd, 326 KiB/s wr, 9 op/s 2023-05-08T11:14:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27023.740784 secs 2023-05-08T11:14:45.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:45 smithi133 ceph-mon[125939]: pgmap v14468: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 545 KiB/s rd, 326 KiB/s wr, 9 op/s 2023-05-08T11:14:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27023.740784 secs 2023-05-08T11:14:45.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:45 smithi096 ceph-mon[124666]: pgmap v14468: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 545 KiB/s rd, 326 KiB/s wr, 9 op/s 2023-05-08T11:14:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:47 smithi186 ceph-mon[126480]: pgmap v14469: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 149 KiB/s wr, 7 op/s 2023-05-08T11:14:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:47 smithi133 ceph-mon[125939]: pgmap v14469: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 149 KiB/s wr, 7 op/s 2023-05-08T11:14:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:47 smithi096 ceph-mon[124666]: pgmap v14469: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 149 KiB/s wr, 7 op/s 2023-05-08T11:14:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:14:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:14:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:14:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:49 smithi186 ceph-mon[126480]: pgmap v14470: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 149 KiB/s wr, 6 op/s 2023-05-08T11:14:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:14:49.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:14:49.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:14:49.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27028.185533 secs 2023-05-08T11:14:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:49 smithi133 ceph-mon[125939]: pgmap v14470: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 149 KiB/s wr, 6 op/s 2023-05-08T11:14:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:14:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:14:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:14:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27028.185533 secs 2023-05-08T11:14:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:49 smithi096 ceph-mon[124666]: pgmap v14470: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 149 KiB/s wr, 6 op/s 2023-05-08T11:14:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:14:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:14:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:14:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27028.185533 secs 2023-05-08T11:14:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27028.740859 secs 2023-05-08T11:14:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27028.740859 secs 2023-05-08T11:14:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27028.740859 secs 2023-05-08T11:14:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:51 smithi186 ceph-mon[126480]: pgmap v14471: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 196 KiB/s wr, 9 op/s 2023-05-08T11:14:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:51 smithi133 ceph-mon[125939]: pgmap v14471: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 196 KiB/s wr, 9 op/s 2023-05-08T11:14:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:51 smithi096 ceph-mon[124666]: pgmap v14471: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 196 KiB/s wr, 9 op/s 2023-05-08T11:14:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:53 smithi186 ceph-mon[126480]: pgmap v14472: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 98 KiB/s wr, 6 op/s 2023-05-08T11:14:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:53 smithi133 ceph-mon[125939]: pgmap v14472: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 98 KiB/s wr, 6 op/s 2023-05-08T11:14:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:53 smithi096 ceph-mon[124666]: pgmap v14472: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 98 KiB/s wr, 6 op/s 2023-05-08T11:14:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27033.185656 secs 2023-05-08T11:14:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27033.185656 secs 2023-05-08T11:14:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27033.185656 secs 2023-05-08T11:14:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:55 smithi186 ceph-mon[126480]: pgmap v14473: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 98 KiB/s wr, 8 op/s 2023-05-08T11:14:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:55 smithi133 ceph-mon[125939]: pgmap v14473: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 98 KiB/s wr, 8 op/s 2023-05-08T11:14:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:55 smithi096 ceph-mon[124666]: pgmap v14473: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 98 KiB/s wr, 8 op/s 2023-05-08T11:14:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:14:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:14:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:14:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:57 smithi186 ceph-mon[126480]: pgmap v14474: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 470 KiB/s rd, 359 KiB/s wr, 8 op/s 2023-05-08T11:14:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:57 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:14:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:14:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:14:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:57 smithi133 ceph-mon[125939]: pgmap v14474: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 470 KiB/s rd, 359 KiB/s wr, 8 op/s 2023-05-08T11:14:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:57 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:14:57.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:14:57.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:14:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:57 smithi096 ceph-mon[124666]: pgmap v14474: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 470 KiB/s rd, 359 KiB/s wr, 8 op/s 2023-05-08T11:14:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:57 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:14:57.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:14:57.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:14:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:59 smithi186 ceph-mon[126480]: pgmap v14475: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 470 KiB/s rd, 359 KiB/s wr, 7 op/s 2023-05-08T11:14:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:14:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27038.185770 secs 2023-05-08T11:14:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:59 smithi133 ceph-mon[125939]: pgmap v14475: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 470 KiB/s rd, 359 KiB/s wr, 7 op/s 2023-05-08T11:14:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:14:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27038.185770 secs 2023-05-08T11:14:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:59 smithi096 ceph-mon[124666]: pgmap v14475: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 470 KiB/s rd, 359 KiB/s wr, 7 op/s 2023-05-08T11:14:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:14:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27038.185770 secs 2023-05-08T11:15:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:01 smithi186 ceph-mon[126480]: pgmap v14476: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 829 KiB/s rd, 712 KiB/s wr, 13 op/s 2023-05-08T11:15:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27040.029061 secs 2023-05-08T11:15:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:01 smithi133 ceph-mon[125939]: pgmap v14476: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 829 KiB/s rd, 712 KiB/s wr, 13 op/s 2023-05-08T11:15:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27040.029061 secs 2023-05-08T11:15:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:01 smithi096 ceph-mon[124666]: pgmap v14476: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 829 KiB/s rd, 712 KiB/s wr, 13 op/s 2023-05-08T11:15:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27040.029061 secs 2023-05-08T11:15:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:03 smithi133 ceph-mon[125939]: pgmap v14477: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 680 KiB/s rd, 664 KiB/s wr, 10 op/s 2023-05-08T11:15:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:03 smithi096 ceph-mon[124666]: pgmap v14477: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 680 KiB/s rd, 664 KiB/s wr, 10 op/s 2023-05-08T11:15:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:03 smithi186 ceph-mon[126480]: pgmap v14477: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 680 KiB/s rd, 664 KiB/s wr, 10 op/s 2023-05-08T11:15:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:04 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:15:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:04 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:15:04.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:04 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:15:04.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:04 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:15:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:04 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:15:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:04 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:15:04.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:04 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:15:04.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:04 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:15:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:04 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:15:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:04 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:15:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:04 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:15:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:04 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:15:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27043.741211 secs 2023-05-08T11:15:05.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:05 smithi133 ceph-mon[125939]: pgmap v14478: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 954 KiB/s rd, 952 KiB/s wr, 26 op/s 2023-05-08T11:15:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27043.741211 secs 2023-05-08T11:15:05.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:05 smithi096 ceph-mon[124666]: pgmap v14478: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 954 KiB/s rd, 952 KiB/s wr, 26 op/s 2023-05-08T11:15:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27043.741211 secs 2023-05-08T11:15:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:05 smithi186 ceph-mon[126480]: pgmap v14478: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 954 KiB/s rd, 952 KiB/s wr, 26 op/s 2023-05-08T11:15:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:07 smithi133 ceph-mon[125939]: pgmap v14479: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 953 KiB/s rd, 952 KiB/s wr, 25 op/s 2023-05-08T11:15:07.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:07 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:15:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:07 smithi096 ceph-mon[124666]: pgmap v14479: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 953 KiB/s rd, 952 KiB/s wr, 25 op/s 2023-05-08T11:15:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:07 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:15:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:07 smithi186 ceph-mon[126480]: pgmap v14479: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 953 KiB/s rd, 952 KiB/s wr, 25 op/s 2023-05-08T11:15:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:07 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:15:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T11:15:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:15:08.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:08 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:15:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T11:15:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:15:08.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:08 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:15:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T11:15:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:15:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:08 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:15:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:09 smithi133 ceph-mon[125939]: pgmap v14480: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 641 KiB/s wr, 22 op/s 2023-05-08T11:15:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:15:09.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:15:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:09 smithi096 ceph-mon[124666]: pgmap v14480: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 641 KiB/s wr, 22 op/s 2023-05-08T11:15:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:15:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:15:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:09 smithi186 ceph-mon[126480]: pgmap v14480: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 641 KiB/s wr, 22 op/s 2023-05-08T11:15:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:15:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:15:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27048.741329 secs 2023-05-08T11:15:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:10 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:15:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27048.741329 secs 2023-05-08T11:15:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:10 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:15:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27048.741329 secs 2023-05-08T11:15:10.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:10 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:15:11.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:11 smithi096 ceph-mon[124666]: pgmap v14481: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 637 KiB/s rd, 648 KiB/s wr, 26 op/s 2023-05-08T11:15:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:11 smithi186 ceph-mon[126480]: pgmap v14481: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 637 KiB/s rd, 648 KiB/s wr, 26 op/s 2023-05-08T11:15:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:11 smithi133 ceph-mon[125939]: pgmap v14481: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 637 KiB/s rd, 648 KiB/s wr, 26 op/s 2023-05-08T11:15:13.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:13 smithi096 ceph-mon[124666]: pgmap v14482: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 295 KiB/s wr, 21 op/s 2023-05-08T11:15:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:13 smithi186 ceph-mon[126480]: pgmap v14482: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 295 KiB/s wr, 21 op/s 2023-05-08T11:15:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:13 smithi133 ceph-mon[125939]: pgmap v14482: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 295 KiB/s wr, 21 op/s 2023-05-08T11:15:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27053.741422 secs 2023-05-08T11:15:15.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:15 smithi096 ceph-mon[124666]: pgmap v14483: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 584 KiB/s rd, 600 KiB/s wr, 24 op/s 2023-05-08T11:15:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27053.741422 secs 2023-05-08T11:15:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:15 smithi186 ceph-mon[126480]: pgmap v14483: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 584 KiB/s rd, 600 KiB/s wr, 24 op/s 2023-05-08T11:15:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27053.741422 secs 2023-05-08T11:15:15.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:15 smithi133 ceph-mon[125939]: pgmap v14483: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 584 KiB/s rd, 600 KiB/s wr, 24 op/s 2023-05-08T11:15:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:17 smithi096 ceph-mon[124666]: pgmap v14484: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 312 KiB/s wr, 8 op/s 2023-05-08T11:15:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:17 smithi186 ceph-mon[126480]: pgmap v14484: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 312 KiB/s wr, 8 op/s 2023-05-08T11:15:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:17 smithi133 ceph-mon[125939]: pgmap v14484: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 312 KiB/s wr, 8 op/s 2023-05-08T11:15:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:19 smithi096 ceph-mon[124666]: pgmap v14485: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 311 KiB/s wr, 7 op/s 2023-05-08T11:15:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:19 smithi186 ceph-mon[126480]: pgmap v14485: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 311 KiB/s wr, 7 op/s 2023-05-08T11:15:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:19 smithi133 ceph-mon[125939]: pgmap v14485: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 311 KiB/s wr, 7 op/s 2023-05-08T11:15:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27058.741556 secs 2023-05-08T11:15:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27058.741556 secs 2023-05-08T11:15:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27058.741556 secs 2023-05-08T11:15:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:21 smithi186 ceph-mon[126480]: pgmap v14486: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 311 KiB/s rd, 312 KiB/s wr, 10 op/s 2023-05-08T11:15:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:21 smithi133 ceph-mon[125939]: pgmap v14486: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 311 KiB/s rd, 312 KiB/s wr, 10 op/s 2023-05-08T11:15:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:21 smithi096 ceph-mon[124666]: pgmap v14486: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 311 KiB/s rd, 312 KiB/s wr, 10 op/s 2023-05-08T11:15:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:23 smithi186 ceph-mon[126480]: pgmap v14487: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 305 KiB/s wr, 6 op/s 2023-05-08T11:15:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:23 smithi133 ceph-mon[125939]: pgmap v14487: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 305 KiB/s wr, 6 op/s 2023-05-08T11:15:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:23 smithi096 ceph-mon[124666]: pgmap v14487: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 305 KiB/s wr, 6 op/s 2023-05-08T11:15:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27063.186377 secs 2023-05-08T11:15:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:24 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:15:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27063.186377 secs 2023-05-08T11:15:24.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:24 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:15:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27063.186377 secs 2023-05-08T11:15:24.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:24 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:15:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:25 smithi186 ceph-mon[126480]: pgmap v14488: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 461 KiB/s wr, 12 op/s 2023-05-08T11:15:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:25 smithi186 ceph-mon[126480]: Health check cleared: MDS_SLOW_REQUEST (was: 1 MDSs report slow requests) 2023-05-08T11:15:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:25 smithi186 ceph-mon[126480]: Cluster is now healthy 2023-05-08T11:15:25.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:25 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:15:25.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:25 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:15:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:25 smithi133 ceph-mon[125939]: pgmap v14488: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 461 KiB/s wr, 12 op/s 2023-05-08T11:15:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:25 smithi133 ceph-mon[125939]: Health check cleared: MDS_SLOW_REQUEST (was: 1 MDSs report slow requests) 2023-05-08T11:15:25.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:25 smithi133 ceph-mon[125939]: Cluster is now healthy 2023-05-08T11:15:25.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:25 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:15:25.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:25 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:15:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:25 smithi096 ceph-mon[124666]: pgmap v14488: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 461 KiB/s wr, 12 op/s 2023-05-08T11:15:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:25 smithi096 ceph-mon[124666]: Health check cleared: MDS_SLOW_REQUEST (was: 1 MDSs report slow requests) 2023-05-08T11:15:25.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:25 smithi096 ceph-mon[124666]: Cluster is now healthy 2023-05-08T11:15:25.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:25 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:15:25.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:25 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:15:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:27 smithi186 ceph-mon[126480]: pgmap v14489: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 357 KiB/s wr, 10 op/s 2023-05-08T11:15:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:27 smithi133 ceph-mon[125939]: pgmap v14489: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 357 KiB/s wr, 10 op/s 2023-05-08T11:15:27.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:27 smithi096 ceph-mon[124666]: pgmap v14489: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 357 KiB/s wr, 10 op/s 2023-05-08T11:15:28.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:28 smithi186 ceph-mon[126480]: Health check failed: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:15:28.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:28 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T11:15:28.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:28 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:15:28.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:28 smithi133 ceph-mon[125939]: Health check failed: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:15:28.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:28 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T11:15:28.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:28 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:15:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:28 smithi096 ceph-mon[124666]: Health check failed: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:15:28.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:28 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T11:15:28.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:28 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:15:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:29 smithi186 ceph-mon[126480]: pgmap v14490: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 357 KiB/s wr, 10 op/s 2023-05-08T11:15:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27068.186497 secs 2023-05-08T11:15:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:29 smithi133 ceph-mon[125939]: pgmap v14490: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 357 KiB/s wr, 10 op/s 2023-05-08T11:15:29.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27068.186497 secs 2023-05-08T11:15:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:29 smithi096 ceph-mon[124666]: pgmap v14490: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 357 KiB/s wr, 10 op/s 2023-05-08T11:15:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27068.186497 secs 2023-05-08T11:15:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:31 smithi186 ceph-mon[126480]: pgmap v14491: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 359 KiB/s rd, 381 KiB/s wr, 14 op/s 2023-05-08T11:15:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:31 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:15:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:31 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:15:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:31 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:15:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:31 smithi133 ceph-mon[125939]: pgmap v14491: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 359 KiB/s rd, 381 KiB/s wr, 14 op/s 2023-05-08T11:15:31.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:31 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:15:31.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:31 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:15:31.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:31 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:15:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:31 smithi096 ceph-mon[124666]: pgmap v14491: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 359 KiB/s rd, 381 KiB/s wr, 14 op/s 2023-05-08T11:15:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:31 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:15:31.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:31 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:15:31.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:31 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:15:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:32 smithi186 ceph-mon[126480]: osdmap e982: 12 total, 12 up, 12 in 2023-05-08T11:15:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:15:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:15:32.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:15:32.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:15:32.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:15:32.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:15:32.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:32 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:15:32.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:15:32.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:32 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T11:15:32.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:32 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T11:15:32.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:32 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:15:32.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:32 smithi133 ceph-mon[125939]: osdmap e982: 12 total, 12 up, 12 in 2023-05-08T11:15:32.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:15:32.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:15:32.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:15:32.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:15:32.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:15:32.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:15:32.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:32 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:15:32.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:15:32.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:32 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T11:15:32.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:32 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T11:15:32.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:32 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:15:32.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:32 smithi096 ceph-mon[124666]: osdmap e982: 12 total, 12 up, 12 in 2023-05-08T11:15:32.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:15:32.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:15:32.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:15:32.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:15:32.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:15:32.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:15:32.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:32 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:15:32.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:15:32.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:32 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T11:15:32.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:32 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T11:15:32.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:32 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:15:33.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:33 smithi186 ceph-mon[126480]: pgmap v14493: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 457 KiB/s wr, 12 op/s 2023-05-08T11:15:33.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:33 smithi133 ceph-mon[125939]: pgmap v14493: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 457 KiB/s wr, 12 op/s 2023-05-08T11:15:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:33 smithi096 ceph-mon[124666]: pgmap v14493: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 457 KiB/s wr, 12 op/s 2023-05-08T11:15:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27073.186613 secs 2023-05-08T11:15:35.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:35 smithi133 ceph-mon[125939]: pgmap v14494: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 270 KiB/s wr, 9 op/s 2023-05-08T11:15:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27073.186613 secs 2023-05-08T11:15:35.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:35 smithi096 ceph-mon[124666]: pgmap v14494: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 270 KiB/s wr, 9 op/s 2023-05-08T11:15:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27073.186613 secs 2023-05-08T11:15:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:35 smithi186 ceph-mon[126480]: pgmap v14494: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 270 KiB/s wr, 9 op/s 2023-05-08T11:15:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:37 smithi133 ceph-mon[125939]: pgmap v14495: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 490 KiB/s wr, 9 op/s 2023-05-08T11:15:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:37 smithi096 ceph-mon[124666]: pgmap v14495: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 490 KiB/s wr, 9 op/s 2023-05-08T11:15:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:37 smithi186 ceph-mon[126480]: pgmap v14495: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 490 KiB/s wr, 9 op/s 2023-05-08T11:15:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:39 smithi133 ceph-mon[125939]: pgmap v14496: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 490 KiB/s wr, 9 op/s 2023-05-08T11:15:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:39 smithi096 ceph-mon[124666]: pgmap v14496: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 490 KiB/s wr, 9 op/s 2023-05-08T11:15:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:39 smithi186 ceph-mon[126480]: pgmap v14496: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 490 KiB/s wr, 9 op/s 2023-05-08T11:15:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27078.186702 secs 2023-05-08T11:15:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:40 smithi133 ceph-mon[125939]: osdmap e983: 12 total, 12 up, 12 in 2023-05-08T11:15:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27078.186702 secs 2023-05-08T11:15:40.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:40 smithi096 ceph-mon[124666]: osdmap e983: 12 total, 12 up, 12 in 2023-05-08T11:15:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27078.186702 secs 2023-05-08T11:15:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:40 smithi186 ceph-mon[126480]: osdmap e983: 12 total, 12 up, 12 in 2023-05-08T11:15:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:41 smithi133 ceph-mon[125939]: pgmap v14498: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 685 KiB/s wr, 10 op/s 2023-05-08T11:15:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27080.029981 secs 2023-05-08T11:15:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:41 smithi096 ceph-mon[124666]: pgmap v14498: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 685 KiB/s wr, 10 op/s 2023-05-08T11:15:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27080.029981 secs 2023-05-08T11:15:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:41 smithi186 ceph-mon[126480]: pgmap v14498: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 685 KiB/s wr, 10 op/s 2023-05-08T11:15:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27080.029981 secs 2023-05-08T11:15:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:43 smithi133 ceph-mon[125939]: pgmap v14499: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 620 KiB/s wr, 9 op/s 2023-05-08T11:15:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:43 smithi096 ceph-mon[124666]: pgmap v14499: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 620 KiB/s wr, 9 op/s 2023-05-08T11:15:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:43 smithi186 ceph-mon[126480]: pgmap v14499: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 620 KiB/s wr, 9 op/s 2023-05-08T11:15:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27083.186795 secs 2023-05-08T11:15:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27083.186795 secs 2023-05-08T11:15:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27083.186795 secs 2023-05-08T11:15:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27083.742074 secs 2023-05-08T11:15:45.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:45 smithi133 ceph-mon[125939]: pgmap v14500: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 972 KiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T11:15:45.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:45 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:15:45.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:45 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:15:45.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:45 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:15:45.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:45 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:15:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27083.742074 secs 2023-05-08T11:15:45.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:45 smithi096 ceph-mon[124666]: pgmap v14500: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 972 KiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T11:15:45.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:45 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:15:45.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:45 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:15:45.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:45 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:15:45.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:45 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:15:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27083.742074 secs 2023-05-08T11:15:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:45 smithi186 ceph-mon[126480]: pgmap v14500: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 972 KiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T11:15:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:45 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:15:45.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:45 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:15:45.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:45 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:15:45.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:45 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:15:47.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:47 smithi133 ceph-mon[125939]: pgmap v14501: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 764 KiB/s rd, 648 KiB/s wr, 10 op/s 2023-05-08T11:15:47.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:47 smithi096 ceph-mon[124666]: pgmap v14501: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 764 KiB/s rd, 648 KiB/s wr, 10 op/s 2023-05-08T11:15:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:47 smithi186 ceph-mon[126480]: pgmap v14501: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 764 KiB/s rd, 648 KiB/s wr, 10 op/s 2023-05-08T11:15:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:15:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:15:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:15:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:49 smithi133 ceph-mon[125939]: pgmap v14502: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 764 KiB/s rd, 648 KiB/s wr, 10 op/s 2023-05-08T11:15:49.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:15:49.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:15:49.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27088.186913 secs 2023-05-08T11:15:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:49 smithi096 ceph-mon[124666]: pgmap v14502: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 764 KiB/s rd, 648 KiB/s wr, 10 op/s 2023-05-08T11:15:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:15:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:15:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27088.186913 secs 2023-05-08T11:15:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:49 smithi186 ceph-mon[126480]: pgmap v14502: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 764 KiB/s rd, 648 KiB/s wr, 10 op/s 2023-05-08T11:15:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:15:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:15:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27088.186913 secs 2023-05-08T11:15:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:15:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:15:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:15:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:51 smithi133 ceph-mon[125939]: pgmap v14503: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T11:15:51.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27090.030212 secs 2023-05-08T11:15:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:51 smithi096 ceph-mon[124666]: pgmap v14503: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T11:15:51.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27090.030212 secs 2023-05-08T11:15:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:51 smithi186 ceph-mon[126480]: pgmap v14503: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T11:15:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27090.030212 secs 2023-05-08T11:15:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:15:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:15:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:15:53.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:53 smithi133 ceph-mon[125939]: pgmap v14504: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T11:15:53.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:15:53.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:15:53.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:15:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:53 smithi096 ceph-mon[124666]: pgmap v14504: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T11:15:53.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:15:53.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:15:53.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:15:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:53 smithi186 ceph-mon[126480]: pgmap v14504: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T11:15:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:15:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:15:53.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:15:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27093.187055 secs 2023-05-08T11:15:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27093.187055 secs 2023-05-08T11:15:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27093.187055 secs 2023-05-08T11:15:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27093.742311 secs 2023-05-08T11:15:55.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:55 smithi133 ceph-mon[125939]: pgmap v14505: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 17 op/s 2023-05-08T11:15:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27093.742311 secs 2023-05-08T11:15:55.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:55 smithi096 ceph-mon[124666]: pgmap v14505: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 17 op/s 2023-05-08T11:15:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27093.742311 secs 2023-05-08T11:15:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:55 smithi186 ceph-mon[126480]: pgmap v14505: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 17 op/s 2023-05-08T11:15:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27095.030309 secs 2023-05-08T11:15:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27095.030309 secs 2023-05-08T11:15:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27095.030309 secs 2023-05-08T11:15:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:57 smithi096 ceph-mon[124666]: pgmap v14506: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1011 KiB/s rd, 884 KiB/s wr, 14 op/s 2023-05-08T11:15:57.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:57 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:15:57.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:15:57.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:15:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:57 smithi186 ceph-mon[126480]: pgmap v14506: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1011 KiB/s rd, 884 KiB/s wr, 14 op/s 2023-05-08T11:15:57.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:57 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:15:57.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:15:57.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:15:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:57 smithi133 ceph-mon[125939]: pgmap v14506: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1011 KiB/s rd, 884 KiB/s wr, 14 op/s 2023-05-08T11:15:57.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:57 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:15:57.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:15:57.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:15:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:59 smithi096 ceph-mon[124666]: pgmap v14507: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 896 KiB/s rd, 884 KiB/s wr, 12 op/s 2023-05-08T11:15:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:15:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27098.187191 secs 2023-05-08T11:15:59.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:59 smithi186 ceph-mon[126480]: pgmap v14507: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 896 KiB/s rd, 884 KiB/s wr, 12 op/s 2023-05-08T11:15:59.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:15:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27098.187191 secs 2023-05-08T11:15:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:59 smithi133 ceph-mon[125939]: pgmap v14507: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 896 KiB/s rd, 884 KiB/s wr, 12 op/s 2023-05-08T11:15:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:15:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27098.187191 secs 2023-05-08T11:16:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:01 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:16:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:01 smithi186 ceph-mon[126480]: pgmap v14508: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 18 op/s 2023-05-08T11:16:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27100.030405 secs 2023-05-08T11:16:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:01 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:16:01.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:01 smithi133 ceph-mon[125939]: pgmap v14508: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 18 op/s 2023-05-08T11:16:01.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27100.030405 secs 2023-05-08T11:16:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:01 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:16:01.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:01 smithi096 ceph-mon[124666]: pgmap v14508: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 18 op/s 2023-05-08T11:16:01.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27100.030405 secs 2023-05-08T11:16:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:16:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:16:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:16:02.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:16:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:16:02.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:16:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:03 smithi186 ceph-mon[126480]: pgmap v14509: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 952 KiB/s rd, 949 KiB/s wr, 11 op/s 2023-05-08T11:16:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:03 smithi133 ceph-mon[125939]: pgmap v14509: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 952 KiB/s rd, 949 KiB/s wr, 11 op/s 2023-05-08T11:16:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:03 smithi096 ceph-mon[124666]: pgmap v14509: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 952 KiB/s rd, 949 KiB/s wr, 11 op/s 2023-05-08T11:16:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27103.187300 secs 2023-05-08T11:16:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:04 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:16:04.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:04 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:16:04.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:04 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:16:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27103.187300 secs 2023-05-08T11:16:04.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:04 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:16:04.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:04 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:16:04.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:04 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:16:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27103.187300 secs 2023-05-08T11:16:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:04 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:16:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:04 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:16:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:04 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:16:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27103.742527 secs 2023-05-08T11:16:05.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:05 smithi133 ceph-mon[125939]: pgmap v14510: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 29 op/s 2023-05-08T11:16:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27103.742527 secs 2023-05-08T11:16:05.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:05 smithi096 ceph-mon[124666]: pgmap v14510: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 29 op/s 2023-05-08T11:16:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27103.742527 secs 2023-05-08T11:16:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:05 smithi186 ceph-mon[126480]: pgmap v14510: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 29 op/s 2023-05-08T11:16:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27105.030544 secs 2023-05-08T11:16:06.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27105.030544 secs 2023-05-08T11:16:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27105.030544 secs 2023-05-08T11:16:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:07 smithi133 ceph-mon[125939]: pgmap v14511: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 KiB/s rd, 950 KiB/s wr, 25 op/s 2023-05-08T11:16:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:07 smithi133 ceph-mon[125939]: osdmap e984: 12 total, 12 up, 12 in 2023-05-08T11:16:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:07 smithi096 ceph-mon[124666]: pgmap v14511: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 KiB/s rd, 950 KiB/s wr, 25 op/s 2023-05-08T11:16:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:07 smithi096 ceph-mon[124666]: osdmap e984: 12 total, 12 up, 12 in 2023-05-08T11:16:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:07 smithi186 ceph-mon[126480]: pgmap v14511: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 KiB/s rd, 950 KiB/s wr, 25 op/s 2023-05-08T11:16:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:07 smithi186 ceph-mon[126480]: osdmap e984: 12 total, 12 up, 12 in 2023-05-08T11:16:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:09 smithi133 ceph-mon[125939]: pgmap v14513: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 29 op/s 2023-05-08T11:16:09.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27108.187417 secs 2023-05-08T11:16:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:09 smithi096 ceph-mon[124666]: pgmap v14513: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 29 op/s 2023-05-08T11:16:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27108.187417 secs 2023-05-08T11:16:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:09 smithi186 ceph-mon[126480]: pgmap v14513: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 29 op/s 2023-05-08T11:16:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27108.187417 secs 2023-05-08T11:16:10.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27108.742652 secs 2023-05-08T11:16:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27108.742652 secs 2023-05-08T11:16:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27108.742652 secs 2023-05-08T11:16:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:11 smithi133 ceph-mon[125939]: pgmap v14514: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 629 KiB/s rd, 506 KiB/s wr, 27 op/s 2023-05-08T11:16:11.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27110.030682 secs 2023-05-08T11:16:11.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:11 smithi096 ceph-mon[124666]: pgmap v14514: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 629 KiB/s rd, 506 KiB/s wr, 27 op/s 2023-05-08T11:16:11.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27110.030682 secs 2023-05-08T11:16:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:11 smithi186 ceph-mon[126480]: pgmap v14514: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 629 KiB/s rd, 506 KiB/s wr, 27 op/s 2023-05-08T11:16:11.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27110.030682 secs 2023-05-08T11:16:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:13 smithi096 ceph-mon[124666]: pgmap v14515: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 629 KiB/s rd, 506 KiB/s wr, 27 op/s 2023-05-08T11:16:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:13 smithi186 ceph-mon[126480]: pgmap v14515: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 629 KiB/s rd, 506 KiB/s wr, 27 op/s 2023-05-08T11:16:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:13 smithi133 ceph-mon[125939]: pgmap v14515: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 629 KiB/s rd, 506 KiB/s wr, 27 op/s 2023-05-08T11:16:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27113.187539 secs 2023-05-08T11:16:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27113.187539 secs 2023-05-08T11:16:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27113.187539 secs 2023-05-08T11:16:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27113.742761 secs 2023-05-08T11:16:15.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:15 smithi096 ceph-mon[124666]: pgmap v14516: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 324 KiB/s wr, 8 op/s 2023-05-08T11:16:15.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:15 smithi096 ceph-mon[124666]: osdmap e985: 12 total, 12 up, 12 in 2023-05-08T11:16:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27113.742761 secs 2023-05-08T11:16:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:15 smithi186 ceph-mon[126480]: pgmap v14516: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 324 KiB/s wr, 8 op/s 2023-05-08T11:16:15.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:15 smithi186 ceph-mon[126480]: osdmap e985: 12 total, 12 up, 12 in 2023-05-08T11:16:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27113.742761 secs 2023-05-08T11:16:15.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:15 smithi133 ceph-mon[125939]: pgmap v14516: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 324 KiB/s wr, 8 op/s 2023-05-08T11:16:15.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:15 smithi133 ceph-mon[125939]: osdmap e985: 12 total, 12 up, 12 in 2023-05-08T11:16:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27115.030821 secs 2023-05-08T11:16:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27115.030821 secs 2023-05-08T11:16:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27115.030821 secs 2023-05-08T11:16:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:17 smithi186 ceph-mon[126480]: pgmap v14518: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 373 KiB/s wr, 8 op/s 2023-05-08T11:16:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:17 smithi133 ceph-mon[125939]: pgmap v14518: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 373 KiB/s wr, 8 op/s 2023-05-08T11:16:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:17 smithi096 ceph-mon[124666]: pgmap v14518: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 373 KiB/s wr, 8 op/s 2023-05-08T11:16:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:19 smithi186 ceph-mon[126480]: pgmap v14519: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 369 KiB/s wr, 8 op/s 2023-05-08T11:16:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27118.187678 secs 2023-05-08T11:16:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:19 smithi133 ceph-mon[125939]: pgmap v14519: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 369 KiB/s wr, 8 op/s 2023-05-08T11:16:19.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27118.187678 secs 2023-05-08T11:16:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:19 smithi096 ceph-mon[124666]: pgmap v14519: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 369 KiB/s wr, 8 op/s 2023-05-08T11:16:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27118.187678 secs 2023-05-08T11:16:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27118.742824 secs 2023-05-08T11:16:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27118.742824 secs 2023-05-08T11:16:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27118.742824 secs 2023-05-08T11:16:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:21 smithi186 ceph-mon[126480]: pgmap v14520: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 333 KiB/s rd, 331 KiB/s wr, 8 op/s 2023-05-08T11:16:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27120.030941 secs 2023-05-08T11:16:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:21 smithi133 ceph-mon[125939]: pgmap v14520: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 333 KiB/s rd, 331 KiB/s wr, 8 op/s 2023-05-08T11:16:21.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27120.030941 secs 2023-05-08T11:16:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:21 smithi096 ceph-mon[124666]: pgmap v14520: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 333 KiB/s rd, 331 KiB/s wr, 8 op/s 2023-05-08T11:16:21.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27120.030941 secs 2023-05-08T11:16:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:23 smithi186 ceph-mon[126480]: pgmap v14521: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 333 KiB/s rd, 331 KiB/s wr, 8 op/s 2023-05-08T11:16:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:23 smithi133 ceph-mon[125939]: pgmap v14521: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 333 KiB/s rd, 331 KiB/s wr, 8 op/s 2023-05-08T11:16:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:23 smithi096 ceph-mon[124666]: pgmap v14521: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 333 KiB/s rd, 331 KiB/s wr, 8 op/s 2023-05-08T11:16:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27123.187799 secs 2023-05-08T11:16:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27123.187799 secs 2023-05-08T11:16:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27123.187799 secs 2023-05-08T11:16:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27123.742946 secs 2023-05-08T11:16:25.883 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:25 smithi186 ceph-mon[126480]: pgmap v14522: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 338 KiB/s wr, 9 op/s 2023-05-08T11:16:25.884 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27123.742946 secs 2023-05-08T11:16:25.884 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:25 smithi096 ceph-mon[124666]: pgmap v14522: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 338 KiB/s wr, 9 op/s 2023-05-08T11:16:25.885 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27123.742946 secs 2023-05-08T11:16:25.885 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:25 smithi133 ceph-mon[125939]: pgmap v14522: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 338 KiB/s wr, 9 op/s 2023-05-08T11:16:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27125.031062 secs 2023-05-08T11:16:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27125.031062 secs 2023-05-08T11:16:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27125.031062 secs 2023-05-08T11:16:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:27 smithi186 ceph-mon[126480]: pgmap v14523: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 215 KiB/s wr, 8 op/s 2023-05-08T11:16:27.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:27 smithi133 ceph-mon[125939]: pgmap v14523: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 215 KiB/s wr, 8 op/s 2023-05-08T11:16:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:27 smithi096 ceph-mon[124666]: pgmap v14523: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 215 KiB/s wr, 8 op/s 2023-05-08T11:16:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:29 smithi186 ceph-mon[126480]: pgmap v14524: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 198 KiB/s wr, 7 op/s 2023-05-08T11:16:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27128.187916 secs 2023-05-08T11:16:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:29 smithi133 ceph-mon[125939]: pgmap v14524: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 198 KiB/s wr, 7 op/s 2023-05-08T11:16:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27128.187916 secs 2023-05-08T11:16:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:29 smithi096 ceph-mon[124666]: pgmap v14524: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 198 KiB/s wr, 7 op/s 2023-05-08T11:16:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27128.187916 secs 2023-05-08T11:16:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27128.743067 secs 2023-05-08T11:16:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27128.743067 secs 2023-05-08T11:16:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27128.743067 secs 2023-05-08T11:16:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:31 smithi186 ceph-mon[126480]: pgmap v14525: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 198 KiB/s wr, 10 op/s 2023-05-08T11:16:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27130.031159 secs 2023-05-08T11:16:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:31 smithi133 ceph-mon[125939]: pgmap v14525: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 198 KiB/s wr, 10 op/s 2023-05-08T11:16:31.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27130.031159 secs 2023-05-08T11:16:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:31 smithi096 ceph-mon[124666]: pgmap v14525: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 198 KiB/s wr, 10 op/s 2023-05-08T11:16:31.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27130.031159 secs 2023-05-08T11:16:32.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:16:32.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:16:32.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:16:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:33 smithi186 ceph-mon[126480]: pgmap v14526: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 7 op/s 2023-05-08T11:16:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:33 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:16:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:33 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:16:33.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:33 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:16:33.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:33 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:16:33.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:33 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T11:16:33.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:33 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T11:16:33.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:33 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:16:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:33 smithi133 ceph-mon[125939]: pgmap v14526: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 7 op/s 2023-05-08T11:16:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:33 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:16:33.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:33 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:16:33.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:33 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:16:33.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:33 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:16:33.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:33 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T11:16:33.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:33 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T11:16:33.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:33 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:16:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:33 smithi096 ceph-mon[124666]: pgmap v14526: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 7 op/s 2023-05-08T11:16:33.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:33 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:16:33.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:33 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:16:33.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:33 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:16:33.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:33 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:16:33.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:33 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T11:16:33.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:33 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T11:16:33.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:33 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:16:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27133.188051 secs 2023-05-08T11:16:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27133.188051 secs 2023-05-08T11:16:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27133.188051 secs 2023-05-08T11:16:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27133.743191 secs 2023-05-08T11:16:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:35 smithi186 ceph-mon[126480]: pgmap v14527: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 117 KiB/s wr, 10 op/s 2023-05-08T11:16:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27133.743191 secs 2023-05-08T11:16:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:35 smithi133 ceph-mon[125939]: pgmap v14527: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 117 KiB/s wr, 10 op/s 2023-05-08T11:16:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27133.743191 secs 2023-05-08T11:16:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:35 smithi096 ceph-mon[124666]: pgmap v14527: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 117 KiB/s wr, 10 op/s 2023-05-08T11:16:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27135.031278 secs 2023-05-08T11:16:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27135.031278 secs 2023-05-08T11:16:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27135.031278 secs 2023-05-08T11:16:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:37 smithi186 ceph-mon[126480]: pgmap v14528: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 100 KiB/s wr, 7 op/s 2023-05-08T11:16:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:37 smithi133 ceph-mon[125939]: pgmap v14528: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 100 KiB/s wr, 7 op/s 2023-05-08T11:16:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:37 smithi096 ceph-mon[124666]: pgmap v14528: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 100 KiB/s wr, 7 op/s 2023-05-08T11:16:39.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:39 smithi186 ceph-mon[126480]: pgmap v14529: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 100 KiB/s wr, 6 op/s 2023-05-08T11:16:39.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27138.188166 secs 2023-05-08T11:16:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:39 smithi133 ceph-mon[125939]: pgmap v14529: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 100 KiB/s wr, 6 op/s 2023-05-08T11:16:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27138.188166 secs 2023-05-08T11:16:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:39 smithi096 ceph-mon[124666]: pgmap v14529: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 100 KiB/s wr, 6 op/s 2023-05-08T11:16:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27138.188166 secs 2023-05-08T11:16:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27138.743321 secs 2023-05-08T11:16:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27138.743321 secs 2023-05-08T11:16:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27138.743321 secs 2023-05-08T11:16:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:41 smithi186 ceph-mon[126480]: pgmap v14530: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 131 KiB/s wr, 9 op/s 2023-05-08T11:16:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27140.031415 secs 2023-05-08T11:16:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:41 smithi133 ceph-mon[125939]: pgmap v14530: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 131 KiB/s wr, 9 op/s 2023-05-08T11:16:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27140.031415 secs 2023-05-08T11:16:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:41 smithi096 ceph-mon[124666]: pgmap v14530: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 131 KiB/s wr, 9 op/s 2023-05-08T11:16:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27140.031415 secs 2023-05-08T11:16:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:43 smithi186 ceph-mon[126480]: pgmap v14531: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 131 KiB/s wr, 5 op/s 2023-05-08T11:16:43.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:43 smithi133 ceph-mon[125939]: pgmap v14531: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 131 KiB/s wr, 5 op/s 2023-05-08T11:16:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:43 smithi096 ceph-mon[124666]: pgmap v14531: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 131 KiB/s wr, 5 op/s 2023-05-08T11:16:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27143.188277 secs 2023-05-08T11:16:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27143.188277 secs 2023-05-08T11:16:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27143.188277 secs 2023-05-08T11:16:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27143.743441 secs 2023-05-08T11:16:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:45 smithi186 ceph-mon[126480]: pgmap v14532: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 317 KiB/s wr, 10 op/s 2023-05-08T11:16:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27143.743441 secs 2023-05-08T11:16:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:45 smithi133 ceph-mon[125939]: pgmap v14532: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 317 KiB/s wr, 10 op/s 2023-05-08T11:16:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27143.743441 secs 2023-05-08T11:16:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:45 smithi096 ceph-mon[124666]: pgmap v14532: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 317 KiB/s wr, 10 op/s 2023-05-08T11:16:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:47 smithi186 ceph-mon[126480]: pgmap v14533: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 218 KiB/s wr, 7 op/s 2023-05-08T11:16:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:47 smithi133 ceph-mon[125939]: pgmap v14533: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 218 KiB/s wr, 7 op/s 2023-05-08T11:16:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:47 smithi096 ceph-mon[124666]: pgmap v14533: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 218 KiB/s wr, 7 op/s 2023-05-08T11:16:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:16:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:16:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:16:49.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:49 smithi186 ceph-mon[126480]: pgmap v14534: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 218 KiB/s wr, 7 op/s 2023-05-08T11:16:49.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:16:49.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:16:49.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:16:49.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27148.188408 secs 2023-05-08T11:16:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:49 smithi133 ceph-mon[125939]: pgmap v14534: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 218 KiB/s wr, 7 op/s 2023-05-08T11:16:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:16:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:16:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:16:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27148.188408 secs 2023-05-08T11:16:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:49 smithi096 ceph-mon[124666]: pgmap v14534: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 218 KiB/s wr, 7 op/s 2023-05-08T11:16:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:16:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:16:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:16:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27148.188408 secs 2023-05-08T11:16:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27148.743557 secs 2023-05-08T11:16:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27148.743557 secs 2023-05-08T11:16:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27148.743557 secs 2023-05-08T11:16:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:51 smithi186 ceph-mon[126480]: pgmap v14535: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 410 KiB/s wr, 10 op/s 2023-05-08T11:16:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:51 smithi133 ceph-mon[125939]: pgmap v14535: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 410 KiB/s wr, 10 op/s 2023-05-08T11:16:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:51 smithi096 ceph-mon[124666]: pgmap v14535: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 410 KiB/s wr, 10 op/s 2023-05-08T11:16:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:53 smithi186 ceph-mon[126480]: pgmap v14536: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 460 KiB/s rd, 379 KiB/s wr, 7 op/s 2023-05-08T11:16:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:53 smithi133 ceph-mon[125939]: pgmap v14536: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 460 KiB/s rd, 379 KiB/s wr, 7 op/s 2023-05-08T11:16:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:53 smithi096 ceph-mon[124666]: pgmap v14536: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 460 KiB/s rd, 379 KiB/s wr, 7 op/s 2023-05-08T11:16:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27153.188530 secs 2023-05-08T11:16:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27153.188530 secs 2023-05-08T11:16:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27153.188530 secs 2023-05-08T11:16:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:55 smithi186 ceph-mon[126480]: pgmap v14537: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 726 KiB/s rd, 612 KiB/s wr, 11 op/s 2023-05-08T11:16:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:55 smithi133 ceph-mon[125939]: pgmap v14537: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 726 KiB/s rd, 612 KiB/s wr, 11 op/s 2023-05-08T11:16:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:55 smithi096 ceph-mon[124666]: pgmap v14537: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 726 KiB/s rd, 612 KiB/s wr, 11 op/s 2023-05-08T11:16:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:16:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:16:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:16:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:57 smithi186 ceph-mon[126480]: pgmap v14538: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 508 KiB/s rd, 426 KiB/s wr, 7 op/s 2023-05-08T11:16:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:57 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:16:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:16:57.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:16:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:57 smithi133 ceph-mon[125939]: pgmap v14538: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 508 KiB/s rd, 426 KiB/s wr, 7 op/s 2023-05-08T11:16:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:57 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:16:57.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:16:57.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:16:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:57 smithi096 ceph-mon[124666]: pgmap v14538: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 508 KiB/s rd, 426 KiB/s wr, 7 op/s 2023-05-08T11:16:57.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:57 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:16:57.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:16:57.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:16:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:59 smithi186 ceph-mon[126480]: pgmap v14539: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 508 KiB/s rd, 426 KiB/s wr, 7 op/s 2023-05-08T11:16:59.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:16:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27158.188610 secs 2023-05-08T11:16:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:59 smithi133 ceph-mon[125939]: pgmap v14539: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 508 KiB/s rd, 426 KiB/s wr, 7 op/s 2023-05-08T11:16:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:16:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27158.188610 secs 2023-05-08T11:16:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:59 smithi096 ceph-mon[124666]: pgmap v14539: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 508 KiB/s rd, 426 KiB/s wr, 7 op/s 2023-05-08T11:16:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:16:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27158.188610 secs 2023-05-08T11:17:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:01 smithi186 ceph-mon[126480]: pgmap v14540: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 894 KiB/s rd, 800 KiB/s wr, 13 op/s 2023-05-08T11:17:01.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27160.031864 secs 2023-05-08T11:17:01.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:01 smithi133 ceph-mon[125939]: pgmap v14540: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 894 KiB/s rd, 800 KiB/s wr, 13 op/s 2023-05-08T11:17:01.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27160.031864 secs 2023-05-08T11:17:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:01 smithi096 ceph-mon[124666]: pgmap v14540: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 894 KiB/s rd, 800 KiB/s wr, 13 op/s 2023-05-08T11:17:01.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27160.031864 secs 2023-05-08T11:17:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:03 smithi133 ceph-mon[125939]: pgmap v14541: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 608 KiB/s wr, 10 op/s 2023-05-08T11:17:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:03 smithi096 ceph-mon[124666]: pgmap v14541: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 608 KiB/s wr, 10 op/s 2023-05-08T11:17:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:03 smithi186 ceph-mon[126480]: pgmap v14541: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 608 KiB/s wr, 10 op/s 2023-05-08T11:17:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27163.188730 secs 2023-05-08T11:17:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27163.188730 secs 2023-05-08T11:17:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27163.188730 secs 2023-05-08T11:17:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27163.743827 secs 2023-05-08T11:17:05.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:05 smithi133 ceph-mon[125939]: pgmap v14542: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 648 KiB/s wr, 25 op/s 2023-05-08T11:17:05.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:05 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:17:05.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:17:05.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:17:05.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:17:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27163.743827 secs 2023-05-08T11:17:05.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:05 smithi096 ceph-mon[124666]: pgmap v14542: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 648 KiB/s wr, 25 op/s 2023-05-08T11:17:05.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:05 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:17:05.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:17:05.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:17:05.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:17:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27163.743827 secs 2023-05-08T11:17:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:05 smithi186 ceph-mon[126480]: pgmap v14542: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 648 KiB/s wr, 25 op/s 2023-05-08T11:17:05.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:05 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:17:05.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:17:05.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:17:05.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:17:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:07 smithi133 ceph-mon[125939]: pgmap v14543: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 664 KiB/s rd, 666 KiB/s wr, 23 op/s 2023-05-08T11:17:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:07 smithi096 ceph-mon[124666]: pgmap v14543: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 664 KiB/s rd, 666 KiB/s wr, 23 op/s 2023-05-08T11:17:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:07 smithi186 ceph-mon[126480]: pgmap v14543: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 664 KiB/s rd, 666 KiB/s wr, 23 op/s 2023-05-08T11:17:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:08 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:17:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:08 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:17:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:08 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:17:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:09 smithi133 ceph-mon[125939]: pgmap v14544: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 664 KiB/s rd, 666 KiB/s wr, 23 op/s 2023-05-08T11:17:09.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:17:09.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:17:09.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27168.188880 secs 2023-05-08T11:17:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:09 smithi096 ceph-mon[124666]: pgmap v14544: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 664 KiB/s rd, 666 KiB/s wr, 23 op/s 2023-05-08T11:17:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:17:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:17:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27168.188880 secs 2023-05-08T11:17:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:09 smithi186 ceph-mon[126480]: pgmap v14544: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 664 KiB/s rd, 666 KiB/s wr, 23 op/s 2023-05-08T11:17:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:17:09.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:17:09.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27168.188880 secs 2023-05-08T11:17:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27168.743950 secs 2023-05-08T11:17:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:10 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:17:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27168.743950 secs 2023-05-08T11:17:10.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:10 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:17:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27168.743950 secs 2023-05-08T11:17:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:10 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:17:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:11 smithi133 ceph-mon[125939]: pgmap v14545: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 716 KiB/s rd, 717 KiB/s wr, 27 op/s 2023-05-08T11:17:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:11 smithi096 ceph-mon[124666]: pgmap v14545: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 716 KiB/s rd, 717 KiB/s wr, 27 op/s 2023-05-08T11:17:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:11 smithi186 ceph-mon[126480]: pgmap v14545: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 716 KiB/s rd, 717 KiB/s wr, 27 op/s 2023-05-08T11:17:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:13 smithi133 ceph-mon[125939]: pgmap v14546: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 342 KiB/s wr, 21 op/s 2023-05-08T11:17:13.510 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:13 smithi096 ceph-mon[124666]: pgmap v14546: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 342 KiB/s wr, 21 op/s 2023-05-08T11:17:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:13 smithi186 ceph-mon[126480]: pgmap v14546: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 342 KiB/s wr, 21 op/s 2023-05-08T11:17:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27173.189017 secs 2023-05-08T11:17:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27173.189017 secs 2023-05-08T11:17:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27173.189017 secs 2023-05-08T11:17:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27173.744068 secs 2023-05-08T11:17:15.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:15 smithi133 ceph-mon[125939]: pgmap v14547: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 398 KiB/s wr, 23 op/s 2023-05-08T11:17:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27173.744068 secs 2023-05-08T11:17:15.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:15 smithi096 ceph-mon[124666]: pgmap v14547: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 398 KiB/s wr, 23 op/s 2023-05-08T11:17:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27173.744068 secs 2023-05-08T11:17:15.762 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:15 smithi186 ceph-mon[126480]: pgmap v14547: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 398 KiB/s wr, 23 op/s 2023-05-08T11:17:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:17 smithi133 ceph-mon[125939]: pgmap v14548: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 510 KiB/s rd, 509 KiB/s wr, 9 op/s 2023-05-08T11:17:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:17 smithi096 ceph-mon[124666]: pgmap v14548: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 510 KiB/s rd, 509 KiB/s wr, 9 op/s 2023-05-08T11:17:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:17 smithi186 ceph-mon[126480]: pgmap v14548: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 510 KiB/s rd, 509 KiB/s wr, 9 op/s 2023-05-08T11:17:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:19 smithi133 ceph-mon[125939]: pgmap v14549: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 257 KiB/s wr, 7 op/s 2023-05-08T11:17:19.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27178.189130 secs 2023-05-08T11:17:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:19 smithi096 ceph-mon[124666]: pgmap v14549: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 257 KiB/s wr, 7 op/s 2023-05-08T11:17:19.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27178.189130 secs 2023-05-08T11:17:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:19 smithi186 ceph-mon[126480]: pgmap v14549: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 257 KiB/s wr, 7 op/s 2023-05-08T11:17:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27178.189130 secs 2023-05-08T11:17:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:21 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:17:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:21 smithi186 ceph-mon[126480]: pgmap v14550: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 700 KiB/s rd, 718 KiB/s wr, 13 op/s 2023-05-08T11:17:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:21 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:17:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:21 smithi133 ceph-mon[125939]: pgmap v14550: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 700 KiB/s rd, 718 KiB/s wr, 13 op/s 2023-05-08T11:17:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:21 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:17:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:21 smithi096 ceph-mon[124666]: pgmap v14550: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 700 KiB/s rd, 718 KiB/s wr, 13 op/s 2023-05-08T11:17:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:22 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:17:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:22 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:17:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:22 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:17:22.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:22 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:17:22.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:22 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:17:22.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:22 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:17:22.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:22 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:17:22.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:22 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:17:22.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:22 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:17:23.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:23 smithi186 ceph-mon[126480]: pgmap v14551: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 648 KiB/s rd, 668 KiB/s wr, 10 op/s 2023-05-08T11:17:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:23 smithi133 ceph-mon[125939]: pgmap v14551: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 648 KiB/s rd, 668 KiB/s wr, 10 op/s 2023-05-08T11:17:23.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:23 smithi096 ceph-mon[124666]: pgmap v14551: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 648 KiB/s rd, 668 KiB/s wr, 10 op/s 2023-05-08T11:17:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27183.189239 secs 2023-05-08T11:17:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27183.189239 secs 2023-05-08T11:17:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27183.189239 secs 2023-05-08T11:17:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:25 smithi096 ceph-mon[124666]: pgmap v14552: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 650 KiB/s rd, 668 KiB/s wr, 13 op/s 2023-05-08T11:17:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:25 smithi186 ceph-mon[126480]: pgmap v14552: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 650 KiB/s rd, 668 KiB/s wr, 13 op/s 2023-05-08T11:17:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:25 smithi133 ceph-mon[125939]: pgmap v14552: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 650 KiB/s rd, 668 KiB/s wr, 13 op/s 2023-05-08T11:17:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:27 smithi186 ceph-mon[126480]: pgmap v14553: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 595 KiB/s rd, 615 KiB/s wr, 11 op/s 2023-05-08T11:17:27.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:27 smithi186 ceph-mon[126480]: osdmap e986: 12 total, 12 up, 12 in 2023-05-08T11:17:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:27 smithi133 ceph-mon[125939]: pgmap v14553: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 595 KiB/s rd, 615 KiB/s wr, 11 op/s 2023-05-08T11:17:27.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:27 smithi133 ceph-mon[125939]: osdmap e986: 12 total, 12 up, 12 in 2023-05-08T11:17:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:27 smithi096 ceph-mon[124666]: pgmap v14553: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 595 KiB/s rd, 615 KiB/s wr, 11 op/s 2023-05-08T11:17:27.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:27 smithi096 ceph-mon[124666]: osdmap e986: 12 total, 12 up, 12 in 2023-05-08T11:17:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:29 smithi186 ceph-mon[126480]: pgmap v14555: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 534 KiB/s rd, 558 KiB/s wr, 12 op/s 2023-05-08T11:17:29.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27188.189365 secs 2023-05-08T11:17:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:29 smithi133 ceph-mon[125939]: pgmap v14555: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 534 KiB/s rd, 558 KiB/s wr, 12 op/s 2023-05-08T11:17:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27188.189365 secs 2023-05-08T11:17:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:29 smithi096 ceph-mon[124666]: pgmap v14555: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 534 KiB/s rd, 558 KiB/s wr, 12 op/s 2023-05-08T11:17:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27188.189365 secs 2023-05-08T11:17:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:31 smithi186 ceph-mon[126480]: pgmap v14556: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 138 KiB/s wr, 9 op/s 2023-05-08T11:17:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:31 smithi133 ceph-mon[125939]: pgmap v14556: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 138 KiB/s wr, 9 op/s 2023-05-08T11:17:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:31 smithi096 ceph-mon[124666]: pgmap v14556: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 138 KiB/s wr, 9 op/s 2023-05-08T11:17:33.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:33 smithi133 ceph-mon[125939]: pgmap v14557: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 138 KiB/s wr, 9 op/s 2023-05-08T11:17:33.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:33 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:17:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:33 smithi096 ceph-mon[124666]: pgmap v14557: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 138 KiB/s wr, 9 op/s 2023-05-08T11:17:33.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:33 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:17:33.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:33 smithi186 ceph-mon[126480]: pgmap v14557: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 138 KiB/s wr, 9 op/s 2023-05-08T11:17:33.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:33 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:17:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:34 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:17:34.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:34 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:17:34.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:34 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:17:34.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:34 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:17:34.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:34 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T11:17:34.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:34 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T11:17:34.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:34 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:17:34.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27193.189460 secs 2023-05-08T11:17:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:34 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:17:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:34 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:17:34.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:34 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:17:34.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:34 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:17:34.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:34 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T11:17:34.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:34 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T11:17:34.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:34 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:17:34.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27193.189460 secs 2023-05-08T11:17:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:34 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:17:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:34 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:17:34.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:34 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:17:34.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:34 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:17:34.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:34 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T11:17:34.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:34 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T11:17:34.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:34 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:17:34.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27193.189460 secs 2023-05-08T11:17:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:35 smithi186 ceph-mon[126480]: pgmap v14558: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 158 KiB/s wr, 8 op/s 2023-05-08T11:17:35.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:35 smithi186 ceph-mon[126480]: osdmap e987: 12 total, 12 up, 12 in 2023-05-08T11:17:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:35 smithi133 ceph-mon[125939]: pgmap v14558: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 158 KiB/s wr, 8 op/s 2023-05-08T11:17:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:35 smithi133 ceph-mon[125939]: osdmap e987: 12 total, 12 up, 12 in 2023-05-08T11:17:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:35 smithi096 ceph-mon[124666]: pgmap v14558: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 158 KiB/s wr, 8 op/s 2023-05-08T11:17:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:35 smithi096 ceph-mon[124666]: osdmap e987: 12 total, 12 up, 12 in 2023-05-08T11:17:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27195.032563 secs 2023-05-08T11:17:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27195.032563 secs 2023-05-08T11:17:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27195.032563 secs 2023-05-08T11:17:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:37 smithi186 ceph-mon[126480]: pgmap v14560: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 621 KiB/s rd, 639 KiB/s wr, 9 op/s 2023-05-08T11:17:37.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:37 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:17:37.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:37 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:17:37.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:37 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:17:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:37 smithi133 ceph-mon[125939]: pgmap v14560: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 621 KiB/s rd, 639 KiB/s wr, 9 op/s 2023-05-08T11:17:37.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:37 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:17:37.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:37 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:17:37.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:37 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:17:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:37 smithi096 ceph-mon[124666]: pgmap v14560: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 621 KiB/s rd, 639 KiB/s wr, 9 op/s 2023-05-08T11:17:37.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:37 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:17:37.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:37 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:17:37.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:37 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:17:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:39 smithi186 ceph-mon[126480]: pgmap v14561: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 614 KiB/s rd, 632 KiB/s wr, 9 op/s 2023-05-08T11:17:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27198.189537 secs 2023-05-08T11:17:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:39 smithi133 ceph-mon[125939]: pgmap v14561: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 614 KiB/s rd, 632 KiB/s wr, 9 op/s 2023-05-08T11:17:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27198.189537 secs 2023-05-08T11:17:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:39 smithi096 ceph-mon[124666]: pgmap v14561: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 614 KiB/s rd, 632 KiB/s wr, 9 op/s 2023-05-08T11:17:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27198.189537 secs 2023-05-08T11:17:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27198.744695 secs 2023-05-08T11:17:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27198.744695 secs 2023-05-08T11:17:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27198.744695 secs 2023-05-08T11:17:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:41 smithi186 ceph-mon[126480]: pgmap v14562: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 596 KiB/s rd, 594 KiB/s wr, 10 op/s 2023-05-08T11:17:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27200.032628 secs 2023-05-08T11:17:41.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:41 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:17:41.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:41 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:17:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:41 smithi133 ceph-mon[125939]: pgmap v14562: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 596 KiB/s rd, 594 KiB/s wr, 10 op/s 2023-05-08T11:17:41.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27200.032628 secs 2023-05-08T11:17:41.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:41 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:17:41.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:41 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:17:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:41 smithi096 ceph-mon[124666]: pgmap v14562: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 596 KiB/s rd, 594 KiB/s wr, 10 op/s 2023-05-08T11:17:41.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27200.032628 secs 2023-05-08T11:17:41.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:41 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:17:41.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:41 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:17:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:43 smithi186 ceph-mon[126480]: pgmap v14563: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 596 KiB/s rd, 594 KiB/s wr, 10 op/s 2023-05-08T11:17:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:43 smithi133 ceph-mon[125939]: pgmap v14563: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 596 KiB/s rd, 594 KiB/s wr, 10 op/s 2023-05-08T11:17:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:43 smithi096 ceph-mon[124666]: pgmap v14563: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 596 KiB/s rd, 594 KiB/s wr, 10 op/s 2023-05-08T11:17:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27203.189618 secs 2023-05-08T11:17:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27203.189618 secs 2023-05-08T11:17:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27203.189618 secs 2023-05-08T11:17:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27203.744775 secs 2023-05-08T11:17:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:45 smithi186 ceph-mon[126480]: pgmap v14564: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 596 KiB/s rd, 842 KiB/s wr, 11 op/s 2023-05-08T11:17:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:45 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:17:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27203.744775 secs 2023-05-08T11:17:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:45 smithi133 ceph-mon[125939]: pgmap v14564: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 596 KiB/s rd, 842 KiB/s wr, 11 op/s 2023-05-08T11:17:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:45 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:17:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27203.744775 secs 2023-05-08T11:17:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:45 smithi096 ceph-mon[124666]: pgmap v14564: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 596 KiB/s rd, 842 KiB/s wr, 11 op/s 2023-05-08T11:17:45.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:45 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:17:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:47 smithi186 ceph-mon[126480]: pgmap v14565: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 671 KiB/s wr, 10 op/s 2023-05-08T11:17:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:47 smithi133 ceph-mon[125939]: pgmap v14565: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 671 KiB/s wr, 10 op/s 2023-05-08T11:17:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:47 smithi096 ceph-mon[124666]: pgmap v14565: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 671 KiB/s wr, 10 op/s 2023-05-08T11:17:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:17:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:17:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:17:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:49 smithi186 ceph-mon[126480]: pgmap v14566: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 618 KiB/s wr, 9 op/s 2023-05-08T11:17:49.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:17:49.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:17:49.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27208.189696 secs 2023-05-08T11:17:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:49 smithi133 ceph-mon[125939]: pgmap v14566: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 618 KiB/s wr, 9 op/s 2023-05-08T11:17:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:17:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:17:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27208.189696 secs 2023-05-08T11:17:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:49 smithi096 ceph-mon[124666]: pgmap v14566: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 618 KiB/s wr, 9 op/s 2023-05-08T11:17:49.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:17:49.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:17:49.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27208.189696 secs 2023-05-08T11:17:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:17:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:17:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:17:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:51 smithi186 ceph-mon[126480]: pgmap v14567: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 672 KiB/s rd, 771 KiB/s wr, 14 op/s 2023-05-08T11:17:51.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27210.032873 secs 2023-05-08T11:17:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:51 smithi133 ceph-mon[125939]: pgmap v14567: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 672 KiB/s rd, 771 KiB/s wr, 14 op/s 2023-05-08T11:17:51.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27210.032873 secs 2023-05-08T11:17:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:51 smithi096 ceph-mon[124666]: pgmap v14567: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 672 KiB/s rd, 771 KiB/s wr, 14 op/s 2023-05-08T11:17:51.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27210.032873 secs 2023-05-08T11:17:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:17:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:17:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:17:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:53 smithi186 ceph-mon[126480]: pgmap v14568: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 575 KiB/s rd, 691 KiB/s wr, 10 op/s 2023-05-08T11:17:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:17:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:17:53.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:17:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:53 smithi133 ceph-mon[125939]: pgmap v14568: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 575 KiB/s rd, 691 KiB/s wr, 10 op/s 2023-05-08T11:17:53.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:17:53.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:17:53.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:17:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:53 smithi096 ceph-mon[124666]: pgmap v14568: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 575 KiB/s rd, 691 KiB/s wr, 10 op/s 2023-05-08T11:17:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:17:53.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:17:53.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:17:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27213.189820 secs 2023-05-08T11:17:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27213.189820 secs 2023-05-08T11:17:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27213.189820 secs 2023-05-08T11:17:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27213.744975 secs 2023-05-08T11:17:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:55 smithi186 ceph-mon[126480]: pgmap v14569: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1010 KiB/s rd, 1.0 MiB/s wr, 15 op/s 2023-05-08T11:17:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27213.744975 secs 2023-05-08T11:17:55.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:55 smithi133 ceph-mon[125939]: pgmap v14569: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1010 KiB/s rd, 1.0 MiB/s wr, 15 op/s 2023-05-08T11:17:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27213.744975 secs 2023-05-08T11:17:55.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:55 smithi096 ceph-mon[124666]: pgmap v14569: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1010 KiB/s rd, 1.0 MiB/s wr, 15 op/s 2023-05-08T11:17:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27215.032988 secs 2023-05-08T11:17:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27215.032988 secs 2023-05-08T11:17:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27215.032988 secs 2023-05-08T11:17:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:57 smithi186 ceph-mon[126480]: pgmap v14570: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1009 KiB/s rd, 907 KiB/s wr, 12 op/s 2023-05-08T11:17:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:57 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:17:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:17:57.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:17:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:57 smithi133 ceph-mon[125939]: pgmap v14570: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1009 KiB/s rd, 907 KiB/s wr, 12 op/s 2023-05-08T11:17:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:57 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:17:57.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:17:57.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:17:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:57 smithi096 ceph-mon[124666]: pgmap v14570: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1009 KiB/s rd, 907 KiB/s wr, 12 op/s 2023-05-08T11:17:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:57 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:17:57.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:17:57.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:17:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:59 smithi186 ceph-mon[126480]: pgmap v14571: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 695 KiB/s rd, 592 KiB/s wr, 10 op/s 2023-05-08T11:17:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:17:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27218.189944 secs 2023-05-08T11:17:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:59 smithi133 ceph-mon[125939]: pgmap v14571: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 695 KiB/s rd, 592 KiB/s wr, 10 op/s 2023-05-08T11:17:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:17:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27218.189944 secs 2023-05-08T11:17:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:59 smithi096 ceph-mon[124666]: pgmap v14571: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 695 KiB/s rd, 592 KiB/s wr, 10 op/s 2023-05-08T11:17:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:17:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27218.189944 secs 2023-05-08T11:18:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27218.745097 secs 2023-05-08T11:18:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27218.745097 secs 2023-05-08T11:18:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27218.745097 secs 2023-05-08T11:18:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:01 smithi186 ceph-mon[126480]: pgmap v14572: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 955 KiB/s rd, 1.2 MiB/s wr, 15 op/s 2023-05-08T11:18:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27220.033106 secs 2023-05-08T11:18:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:01 smithi133 ceph-mon[125939]: pgmap v14572: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 955 KiB/s rd, 1.2 MiB/s wr, 15 op/s 2023-05-08T11:18:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27220.033106 secs 2023-05-08T11:18:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:01 smithi096 ceph-mon[124666]: pgmap v14572: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 955 KiB/s rd, 1.2 MiB/s wr, 15 op/s 2023-05-08T11:18:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27220.033106 secs 2023-05-08T11:18:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:03 smithi186 ceph-mon[126480]: pgmap v14573: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 696 KiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T11:18:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:03 smithi133 ceph-mon[125939]: pgmap v14573: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 696 KiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T11:18:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:03 smithi096 ceph-mon[124666]: pgmap v14573: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 696 KiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T11:18:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27223.190064 secs 2023-05-08T11:18:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27223.190064 secs 2023-05-08T11:18:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27223.190064 secs 2023-05-08T11:18:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27223.745215 secs 2023-05-08T11:18:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:05 smithi186 ceph-mon[126480]: pgmap v14574: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 931 KiB/s rd, 1.4 MiB/s wr, 28 op/s 2023-05-08T11:18:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27223.745215 secs 2023-05-08T11:18:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:05 smithi133 ceph-mon[125939]: pgmap v14574: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 931 KiB/s rd, 1.4 MiB/s wr, 28 op/s 2023-05-08T11:18:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27223.745215 secs 2023-05-08T11:18:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:05 smithi096 ceph-mon[124666]: pgmap v14574: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 931 KiB/s rd, 1.4 MiB/s wr, 28 op/s 2023-05-08T11:18:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27225.033225 secs 2023-05-08T11:18:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:06 smithi186 ceph-mon[126480]: osdmap e988: 12 total, 12 up, 12 in 2023-05-08T11:18:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27225.033225 secs 2023-05-08T11:18:06.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:06 smithi133 ceph-mon[125939]: osdmap e988: 12 total, 12 up, 12 in 2023-05-08T11:18:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27225.033225 secs 2023-05-08T11:18:06.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:06 smithi096 ceph-mon[124666]: osdmap e988: 12 total, 12 up, 12 in 2023-05-08T11:18:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:07 smithi186 ceph-mon[126480]: pgmap v14576: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 29 op/s 2023-05-08T11:18:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:07 smithi133 ceph-mon[125939]: pgmap v14576: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 29 op/s 2023-05-08T11:18:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:07 smithi096 ceph-mon[124666]: pgmap v14576: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 29 op/s 2023-05-08T11:18:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:09 smithi186 ceph-mon[126480]: pgmap v14577: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 29 op/s 2023-05-08T11:18:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27228.190192 secs 2023-05-08T11:18:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:09 smithi133 ceph-mon[125939]: pgmap v14577: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 29 op/s 2023-05-08T11:18:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27228.190192 secs 2023-05-08T11:18:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:09 smithi096 ceph-mon[124666]: pgmap v14577: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 29 op/s 2023-05-08T11:18:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27228.190192 secs 2023-05-08T11:18:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27228.745356 secs 2023-05-08T11:18:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27228.745356 secs 2023-05-08T11:18:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27228.745356 secs 2023-05-08T11:18:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:11 smithi186 ceph-mon[126480]: pgmap v14578: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 468 KiB/s wr, 28 op/s 2023-05-08T11:18:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27230.033361 secs 2023-05-08T11:18:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:11 smithi133 ceph-mon[125939]: pgmap v14578: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 468 KiB/s wr, 28 op/s 2023-05-08T11:18:11.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27230.033361 secs 2023-05-08T11:18:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:11 smithi096 ceph-mon[124666]: pgmap v14578: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 468 KiB/s wr, 28 op/s 2023-05-08T11:18:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27230.033361 secs 2023-05-08T11:18:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:13 smithi133 ceph-mon[125939]: pgmap v14579: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 468 KiB/s wr, 28 op/s 2023-05-08T11:18:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:13 smithi096 ceph-mon[124666]: pgmap v14579: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 468 KiB/s wr, 28 op/s 2023-05-08T11:18:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:13 smithi186 ceph-mon[126480]: pgmap v14579: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 468 KiB/s wr, 28 op/s 2023-05-08T11:18:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27233.190316 secs 2023-05-08T11:18:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27233.190316 secs 2023-05-08T11:18:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27233.190316 secs 2023-05-08T11:18:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27233.745517 secs 2023-05-08T11:18:15.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:15 smithi133 ceph-mon[125939]: pgmap v14580: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 871 KiB/s rd, 42 KiB/s wr, 10 op/s 2023-05-08T11:18:15.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:15 smithi133 ceph-mon[125939]: osdmap e989: 12 total, 12 up, 12 in 2023-05-08T11:18:15.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27233.745517 secs 2023-05-08T11:18:15.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:15 smithi096 ceph-mon[124666]: pgmap v14580: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 871 KiB/s rd, 42 KiB/s wr, 10 op/s 2023-05-08T11:18:15.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:15 smithi096 ceph-mon[124666]: osdmap e989: 12 total, 12 up, 12 in 2023-05-08T11:18:15.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27233.745517 secs 2023-05-08T11:18:15.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:15 smithi186 ceph-mon[126480]: pgmap v14580: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 871 KiB/s rd, 42 KiB/s wr, 10 op/s 2023-05-08T11:18:15.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:15 smithi186 ceph-mon[126480]: osdmap e989: 12 total, 12 up, 12 in 2023-05-08T11:18:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27235.033453 secs 2023-05-08T11:18:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27235.033453 secs 2023-05-08T11:18:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27235.033453 secs 2023-05-08T11:18:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:17 smithi133 ceph-mon[125939]: pgmap v14582: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 348 KiB/s rd, 353 KiB/s wr, 9 op/s 2023-05-08T11:18:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:17 smithi096 ceph-mon[124666]: pgmap v14582: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 348 KiB/s rd, 353 KiB/s wr, 9 op/s 2023-05-08T11:18:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:17 smithi186 ceph-mon[126480]: pgmap v14582: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 348 KiB/s rd, 353 KiB/s wr, 9 op/s 2023-05-08T11:18:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:19 smithi133 ceph-mon[125939]: pgmap v14583: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 348 KiB/s rd, 353 KiB/s wr, 9 op/s 2023-05-08T11:18:19.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27238.190433 secs 2023-05-08T11:18:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:19 smithi096 ceph-mon[124666]: pgmap v14583: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 348 KiB/s rd, 353 KiB/s wr, 9 op/s 2023-05-08T11:18:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27238.190433 secs 2023-05-08T11:18:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:19 smithi186 ceph-mon[126480]: pgmap v14583: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 348 KiB/s rd, 353 KiB/s wr, 9 op/s 2023-05-08T11:18:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27238.190433 secs 2023-05-08T11:18:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27238.745637 secs 2023-05-08T11:18:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27238.745637 secs 2023-05-08T11:18:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27238.745637 secs 2023-05-08T11:18:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:21 smithi133 ceph-mon[125939]: pgmap v14584: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 430 KiB/s rd, 356 KiB/s wr, 9 op/s 2023-05-08T11:18:21.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27240.033589 secs 2023-05-08T11:18:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:21 smithi096 ceph-mon[124666]: pgmap v14584: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 430 KiB/s rd, 356 KiB/s wr, 9 op/s 2023-05-08T11:18:21.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27240.033589 secs 2023-05-08T11:18:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:21 smithi186 ceph-mon[126480]: pgmap v14584: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 430 KiB/s rd, 356 KiB/s wr, 9 op/s 2023-05-08T11:18:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27240.033589 secs 2023-05-08T11:18:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:23 smithi133 ceph-mon[125939]: pgmap v14585: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 430 KiB/s rd, 357 KiB/s wr, 10 op/s 2023-05-08T11:18:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:23 smithi096 ceph-mon[124666]: pgmap v14585: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 430 KiB/s rd, 357 KiB/s wr, 10 op/s 2023-05-08T11:18:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:23 smithi186 ceph-mon[126480]: pgmap v14585: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 430 KiB/s rd, 357 KiB/s wr, 10 op/s 2023-05-08T11:18:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27243.190540 secs 2023-05-08T11:18:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27243.190540 secs 2023-05-08T11:18:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27243.190540 secs 2023-05-08T11:18:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27243.745733 secs 2023-05-08T11:18:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:25 smithi133 ceph-mon[125939]: pgmap v14586: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 382 KiB/s wr, 9 op/s 2023-05-08T11:18:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27243.745733 secs 2023-05-08T11:18:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:25 smithi096 ceph-mon[124666]: pgmap v14586: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 382 KiB/s wr, 9 op/s 2023-05-08T11:18:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27243.745733 secs 2023-05-08T11:18:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:25 smithi186 ceph-mon[126480]: pgmap v14586: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 382 KiB/s wr, 9 op/s 2023-05-08T11:18:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27245.033727 secs 2023-05-08T11:18:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27245.033727 secs 2023-05-08T11:18:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27245.033727 secs 2023-05-08T11:18:27.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:27 smithi133 ceph-mon[125939]: pgmap v14587: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 146 KiB/s wr, 8 op/s 2023-05-08T11:18:27.873 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:27 smithi186 ceph-mon[126480]: pgmap v14587: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 146 KiB/s wr, 8 op/s 2023-05-08T11:18:27.874 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:27 smithi096 ceph-mon[124666]: pgmap v14587: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 146 KiB/s wr, 8 op/s 2023-05-08T11:18:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:29 smithi133 ceph-mon[125939]: pgmap v14588: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 135 KiB/s wr, 8 op/s 2023-05-08T11:18:29.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27248.190679 secs 2023-05-08T11:18:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:29 smithi096 ceph-mon[124666]: pgmap v14588: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 135 KiB/s wr, 8 op/s 2023-05-08T11:18:29.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27248.190679 secs 2023-05-08T11:18:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:29 smithi186 ceph-mon[126480]: pgmap v14588: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 135 KiB/s wr, 8 op/s 2023-05-08T11:18:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27248.190679 secs 2023-05-08T11:18:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27248.745869 secs 2023-05-08T11:18:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27248.745869 secs 2023-05-08T11:18:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27248.745869 secs 2023-05-08T11:18:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:31 smithi133 ceph-mon[125939]: pgmap v14589: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 135 KiB/s wr, 11 op/s 2023-05-08T11:18:31.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27250.033830 secs 2023-05-08T11:18:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:31 smithi096 ceph-mon[124666]: pgmap v14589: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 135 KiB/s wr, 11 op/s 2023-05-08T11:18:31.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27250.033830 secs 2023-05-08T11:18:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:31 smithi186 ceph-mon[126480]: pgmap v14589: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 135 KiB/s wr, 11 op/s 2023-05-08T11:18:31.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27250.033830 secs 2023-05-08T11:18:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:33 smithi133 ceph-mon[125939]: pgmap v14590: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 101 KiB/s wr, 7 op/s 2023-05-08T11:18:33.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:33 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:18:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:33 smithi096 ceph-mon[124666]: pgmap v14590: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 101 KiB/s wr, 7 op/s 2023-05-08T11:18:33.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:33 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:18:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:33 smithi186 ceph-mon[126480]: pgmap v14590: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 101 KiB/s wr, 7 op/s 2023-05-08T11:18:33.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:33 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:18:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27253.190774 secs 2023-05-08T11:18:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:34 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:18:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:34 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:18:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:34 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:18:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27253.190774 secs 2023-05-08T11:18:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:34 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:18:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:34 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:18:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:34 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:18:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27253.190774 secs 2023-05-08T11:18:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:34 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:18:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:34 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:18:34.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:34 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:18:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27253.746008 secs 2023-05-08T11:18:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:35 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:18:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:35 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T11:18:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:35 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T11:18:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:35 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:18:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:35 smithi133 ceph-mon[125939]: pgmap v14591: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 101 KiB/s wr, 9 op/s 2023-05-08T11:18:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27253.746008 secs 2023-05-08T11:18:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:35 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:18:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:35 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T11:18:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:35 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T11:18:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:35 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:18:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:35 smithi096 ceph-mon[124666]: pgmap v14591: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 101 KiB/s wr, 9 op/s 2023-05-08T11:18:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27253.746008 secs 2023-05-08T11:18:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:35 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:18:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:35 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T11:18:35.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:35 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T11:18:35.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:35 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:18:35.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:35 smithi186 ceph-mon[126480]: pgmap v14591: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 101 KiB/s wr, 9 op/s 2023-05-08T11:18:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27255.033929 secs 2023-05-08T11:18:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27255.033929 secs 2023-05-08T11:18:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27255.033929 secs 2023-05-08T11:18:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:37 smithi133 ceph-mon[125939]: pgmap v14592: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 80 KiB/s wr, 8 op/s 2023-05-08T11:18:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:37 smithi096 ceph-mon[124666]: pgmap v14592: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 80 KiB/s wr, 8 op/s 2023-05-08T11:18:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:37 smithi186 ceph-mon[126480]: pgmap v14592: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 80 KiB/s wr, 8 op/s 2023-05-08T11:18:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:39 smithi133 ceph-mon[125939]: pgmap v14593: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 682 B/s wr, 7 op/s 2023-05-08T11:18:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27258.190918 secs 2023-05-08T11:18:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:39 smithi096 ceph-mon[124666]: pgmap v14593: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 682 B/s wr, 7 op/s 2023-05-08T11:18:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27258.190918 secs 2023-05-08T11:18:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:39 smithi186 ceph-mon[126480]: pgmap v14593: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 682 B/s wr, 7 op/s 2023-05-08T11:18:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27258.190918 secs 2023-05-08T11:18:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27258.746088 secs 2023-05-08T11:18:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27258.746088 secs 2023-05-08T11:18:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27258.746088 secs 2023-05-08T11:18:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:41 smithi133 ceph-mon[125939]: pgmap v14594: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 204 KiB/s wr, 10 op/s 2023-05-08T11:18:41.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27260.034067 secs 2023-05-08T11:18:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:41 smithi096 ceph-mon[124666]: pgmap v14594: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 204 KiB/s wr, 10 op/s 2023-05-08T11:18:41.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27260.034067 secs 2023-05-08T11:18:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:41 smithi186 ceph-mon[126480]: pgmap v14594: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 204 KiB/s wr, 10 op/s 2023-05-08T11:18:41.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27260.034067 secs 2023-05-08T11:18:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:43 smithi133 ceph-mon[125939]: pgmap v14595: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 203 KiB/s wr, 7 op/s 2023-05-08T11:18:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:43 smithi096 ceph-mon[124666]: pgmap v14595: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 203 KiB/s wr, 7 op/s 2023-05-08T11:18:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:43 smithi186 ceph-mon[126480]: pgmap v14595: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 203 KiB/s wr, 7 op/s 2023-05-08T11:18:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27263.191012 secs 2023-05-08T11:18:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27263.191012 secs 2023-05-08T11:18:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27263.191012 secs 2023-05-08T11:18:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27263.746223 secs 2023-05-08T11:18:45.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:45 smithi133 ceph-mon[125939]: pgmap v14596: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 204 KiB/s wr, 9 op/s 2023-05-08T11:18:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27263.746223 secs 2023-05-08T11:18:45.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:45 smithi096 ceph-mon[124666]: pgmap v14596: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 204 KiB/s wr, 9 op/s 2023-05-08T11:18:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27263.746223 secs 2023-05-08T11:18:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:45 smithi186 ceph-mon[126480]: pgmap v14596: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 204 KiB/s wr, 9 op/s 2023-05-08T11:18:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:47 smithi133 ceph-mon[125939]: pgmap v14597: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 204 KiB/s wr, 8 op/s 2023-05-08T11:18:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:47 smithi096 ceph-mon[124666]: pgmap v14597: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 204 KiB/s wr, 8 op/s 2023-05-08T11:18:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:47 smithi186 ceph-mon[126480]: pgmap v14597: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 204 KiB/s wr, 8 op/s 2023-05-08T11:18:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:18:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:18:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:18:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:49 smithi133 ceph-mon[125939]: pgmap v14598: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 204 KiB/s wr, 7 op/s 2023-05-08T11:18:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27268.191112 secs 2023-05-08T11:18:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:18:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:18:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:18:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:49 smithi096 ceph-mon[124666]: pgmap v14598: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 204 KiB/s wr, 7 op/s 2023-05-08T11:18:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27268.191112 secs 2023-05-08T11:18:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:18:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:18:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:18:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:49 smithi186 ceph-mon[126480]: pgmap v14598: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 204 KiB/s wr, 7 op/s 2023-05-08T11:18:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27268.191112 secs 2023-05-08T11:18:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:18:49.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:18:49.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:18:50.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27268.746338 secs 2023-05-08T11:18:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27268.746338 secs 2023-05-08T11:18:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27268.746338 secs 2023-05-08T11:18:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:51 smithi133 ceph-mon[125939]: pgmap v14599: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 379 KiB/s rd, 321 KiB/s wr, 10 op/s 2023-05-08T11:18:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:51 smithi096 ceph-mon[124666]: pgmap v14599: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 379 KiB/s rd, 321 KiB/s wr, 10 op/s 2023-05-08T11:18:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:51 smithi186 ceph-mon[126480]: pgmap v14599: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 379 KiB/s rd, 321 KiB/s wr, 10 op/s 2023-05-08T11:18:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:53 smithi133 ceph-mon[125939]: pgmap v14600: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 118 KiB/s wr, 6 op/s 2023-05-08T11:18:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:53 smithi096 ceph-mon[124666]: pgmap v14600: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 118 KiB/s wr, 6 op/s 2023-05-08T11:18:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:53 smithi186 ceph-mon[126480]: pgmap v14600: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 118 KiB/s wr, 6 op/s 2023-05-08T11:18:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27273.191248 secs 2023-05-08T11:18:54.782 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27273.191248 secs 2023-05-08T11:18:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27273.191248 secs 2023-05-08T11:18:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:55 smithi133 ceph-mon[125939]: pgmap v14601: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 711 KiB/s rd, 415 KiB/s wr, 10 op/s 2023-05-08T11:18:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:55 smithi096 ceph-mon[124666]: pgmap v14601: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 711 KiB/s rd, 415 KiB/s wr, 10 op/s 2023-05-08T11:18:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:55 smithi186 ceph-mon[126480]: pgmap v14601: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 711 KiB/s rd, 415 KiB/s wr, 10 op/s 2023-05-08T11:18:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:18:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:18:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:18:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:57 smithi133 ceph-mon[125939]: pgmap v14602: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 414 KiB/s wr, 8 op/s 2023-05-08T11:18:57.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:57 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:18:57.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:18:57.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:18:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:57 smithi096 ceph-mon[124666]: pgmap v14602: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 414 KiB/s wr, 8 op/s 2023-05-08T11:18:57.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:57 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:18:57.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:18:57.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:18:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:57 smithi186 ceph-mon[126480]: pgmap v14602: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 414 KiB/s wr, 8 op/s 2023-05-08T11:18:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:57 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:18:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:18:57.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:18:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:59 smithi133 ceph-mon[125939]: pgmap v14603: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 414 KiB/s wr, 7 op/s 2023-05-08T11:18:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:18:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27278.191367 secs 2023-05-08T11:18:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:59 smithi096 ceph-mon[124666]: pgmap v14603: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 414 KiB/s wr, 7 op/s 2023-05-08T11:18:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:18:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27278.191367 secs 2023-05-08T11:18:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:59 smithi186 ceph-mon[126480]: pgmap v14603: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 414 KiB/s wr, 7 op/s 2023-05-08T11:18:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:18:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27278.191367 secs 2023-05-08T11:19:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:01 smithi133 ceph-mon[125939]: pgmap v14604: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 724 KiB/s rd, 780 KiB/s wr, 13 op/s 2023-05-08T11:19:01.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27280.034593 secs 2023-05-08T11:19:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:01 smithi096 ceph-mon[124666]: pgmap v14604: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 724 KiB/s rd, 780 KiB/s wr, 13 op/s 2023-05-08T11:19:01.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27280.034593 secs 2023-05-08T11:19:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:01 smithi186 ceph-mon[126480]: pgmap v14604: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 724 KiB/s rd, 780 KiB/s wr, 13 op/s 2023-05-08T11:19:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27280.034593 secs 2023-05-08T11:19:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:03 smithi133 ceph-mon[125939]: pgmap v14605: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 550 KiB/s rd, 663 KiB/s wr, 10 op/s 2023-05-08T11:19:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:03 smithi096 ceph-mon[124666]: pgmap v14605: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 550 KiB/s rd, 663 KiB/s wr, 10 op/s 2023-05-08T11:19:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:03 smithi186 ceph-mon[126480]: pgmap v14605: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 550 KiB/s rd, 663 KiB/s wr, 10 op/s 2023-05-08T11:19:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27283.191512 secs 2023-05-08T11:19:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27283.191512 secs 2023-05-08T11:19:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27283.191512 secs 2023-05-08T11:19:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27283.746701 secs 2023-05-08T11:19:05.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:05 smithi096 ceph-mon[124666]: pgmap v14606: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 797 KiB/s rd, 904 KiB/s wr, 28 op/s 2023-05-08T11:19:05.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:05 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:19:05.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:19:05.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:19:05.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:19:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27283.746701 secs 2023-05-08T11:19:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:05 smithi186 ceph-mon[126480]: pgmap v14606: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 797 KiB/s rd, 904 KiB/s wr, 28 op/s 2023-05-08T11:19:05.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:05 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:19:05.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:19:05.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:19:05.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:19:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27283.746701 secs 2023-05-08T11:19:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:05 smithi133 ceph-mon[125939]: pgmap v14606: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 797 KiB/s rd, 904 KiB/s wr, 28 op/s 2023-05-08T11:19:05.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:05 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:19:05.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:19:05.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:19:05.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:19:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:07 smithi096 ceph-mon[124666]: pgmap v14607: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 822 KiB/s rd, 683 KiB/s wr, 26 op/s 2023-05-08T11:19:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:07 smithi186 ceph-mon[126480]: pgmap v14607: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 822 KiB/s rd, 683 KiB/s wr, 26 op/s 2023-05-08T11:19:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:07 smithi133 ceph-mon[125939]: pgmap v14607: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 822 KiB/s rd, 683 KiB/s wr, 26 op/s 2023-05-08T11:19:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:08 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:19:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:08 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:19:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:08 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:19:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:09 smithi186 ceph-mon[126480]: pgmap v14608: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 823 KiB/s rd, 683 KiB/s wr, 25 op/s 2023-05-08T11:19:09.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:19:09.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:19:09.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27288.191627 secs 2023-05-08T11:19:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:09 smithi133 ceph-mon[125939]: pgmap v14608: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 823 KiB/s rd, 683 KiB/s wr, 25 op/s 2023-05-08T11:19:09.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:19:09.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:19:09.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27288.191627 secs 2023-05-08T11:19:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:09 smithi096 ceph-mon[124666]: pgmap v14608: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 823 KiB/s rd, 683 KiB/s wr, 25 op/s 2023-05-08T11:19:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:19:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:19:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27288.191627 secs 2023-05-08T11:19:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:10 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:19:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:10 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:19:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:10 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:19:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:11 smithi186 ceph-mon[126480]: pgmap v14609: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 986 KiB/s rd, 898 KiB/s wr, 29 op/s 2023-05-08T11:19:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:11 smithi133 ceph-mon[125939]: pgmap v14609: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 986 KiB/s rd, 898 KiB/s wr, 29 op/s 2023-05-08T11:19:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:11 smithi096 ceph-mon[124666]: pgmap v14609: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 986 KiB/s rd, 898 KiB/s wr, 29 op/s 2023-05-08T11:19:12.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:12 smithi186 ceph-mon[126480]: osdmap e990: 12 total, 12 up, 12 in 2023-05-08T11:19:12.665 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:12 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:19:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:12 smithi133 ceph-mon[125939]: osdmap e990: 12 total, 12 up, 12 in 2023-05-08T11:19:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:12 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:19:12.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:12 smithi096 ceph-mon[124666]: osdmap e990: 12 total, 12 up, 12 in 2023-05-08T11:19:12.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:12 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:19:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:13 smithi186 ceph-mon[126480]: pgmap v14611: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 923 KiB/s rd, 639 KiB/s wr, 28 op/s 2023-05-08T11:19:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:19:13.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:13 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:19:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:13 smithi133 ceph-mon[125939]: pgmap v14611: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 923 KiB/s rd, 639 KiB/s wr, 28 op/s 2023-05-08T11:19:13.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:19:13.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:13 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:19:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:13 smithi096 ceph-mon[124666]: pgmap v14611: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 923 KiB/s rd, 639 KiB/s wr, 28 op/s 2023-05-08T11:19:13.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:19:13.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:13 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:19:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27293.191706 secs 2023-05-08T11:19:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27293.191706 secs 2023-05-08T11:19:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27293.191706 secs 2023-05-08T11:19:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:15 smithi186 ceph-mon[126480]: pgmap v14612: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1000 KiB/s rd, 628 KiB/s wr, 11 op/s 2023-05-08T11:19:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:15 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:19:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:15 smithi133 ceph-mon[125939]: pgmap v14612: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1000 KiB/s rd, 628 KiB/s wr, 11 op/s 2023-05-08T11:19:15.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:15 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:19:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:15 smithi096 ceph-mon[124666]: pgmap v14612: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1000 KiB/s rd, 628 KiB/s wr, 11 op/s 2023-05-08T11:19:15.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:15 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:19:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:17 smithi186 ceph-mon[126480]: pgmap v14613: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 569 KiB/s rd, 537 KiB/s wr, 10 op/s 2023-05-08T11:19:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:17 smithi133 ceph-mon[125939]: pgmap v14613: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 569 KiB/s rd, 537 KiB/s wr, 10 op/s 2023-05-08T11:19:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:17 smithi096 ceph-mon[124666]: pgmap v14613: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 569 KiB/s rd, 537 KiB/s wr, 10 op/s 2023-05-08T11:19:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:19 smithi186 ceph-mon[126480]: pgmap v14614: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 569 KiB/s rd, 537 KiB/s wr, 10 op/s 2023-05-08T11:19:19.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27298.191825 secs 2023-05-08T11:19:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:19 smithi133 ceph-mon[125939]: pgmap v14614: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 569 KiB/s rd, 537 KiB/s wr, 10 op/s 2023-05-08T11:19:19.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27298.191825 secs 2023-05-08T11:19:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:19 smithi096 ceph-mon[124666]: pgmap v14614: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 569 KiB/s rd, 537 KiB/s wr, 10 op/s 2023-05-08T11:19:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27298.191825 secs 2023-05-08T11:19:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:21 smithi133 ceph-mon[125939]: osdmap e991: 12 total, 12 up, 12 in 2023-05-08T11:19:21.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:21 smithi133 ceph-mon[125939]: pgmap v14616: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 313 KiB/s wr, 10 op/s 2023-05-08T11:19:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:21 smithi096 ceph-mon[124666]: osdmap e991: 12 total, 12 up, 12 in 2023-05-08T11:19:21.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:21 smithi096 ceph-mon[124666]: pgmap v14616: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 313 KiB/s wr, 10 op/s 2023-05-08T11:19:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:21 smithi186 ceph-mon[126480]: osdmap e991: 12 total, 12 up, 12 in 2023-05-08T11:19:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:21 smithi186 ceph-mon[126480]: pgmap v14616: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 313 KiB/s wr, 10 op/s 2023-05-08T11:19:23.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:23 smithi096 ceph-mon[124666]: pgmap v14617: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 279 KiB/s wr, 9 op/s 2023-05-08T11:19:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:23 smithi186 ceph-mon[126480]: pgmap v14617: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 279 KiB/s wr, 9 op/s 2023-05-08T11:19:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:23 smithi133 ceph-mon[125939]: pgmap v14617: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 279 KiB/s wr, 9 op/s 2023-05-08T11:19:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27303.191926 secs 2023-05-08T11:19:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27303.191926 secs 2023-05-08T11:19:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27303.191926 secs 2023-05-08T11:19:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27303.747220 secs 2023-05-08T11:19:25.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:25 smithi096 ceph-mon[124666]: pgmap v14618: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 410 KiB/s wr, 8 op/s 2023-05-08T11:19:25.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:25 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:19:25.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:25 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:19:25.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:25 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:19:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27303.747220 secs 2023-05-08T11:19:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:25 smithi186 ceph-mon[126480]: pgmap v14618: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 410 KiB/s wr, 8 op/s 2023-05-08T11:19:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:25 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:19:25.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:25 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:19:25.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:25 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:19:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27303.747220 secs 2023-05-08T11:19:25.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:25 smithi133 ceph-mon[125939]: pgmap v14618: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 410 KiB/s wr, 8 op/s 2023-05-08T11:19:25.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:25 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:19:25.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:25 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:19:25.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:25 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:19:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27305.035095 secs 2023-05-08T11:19:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27305.035095 secs 2023-05-08T11:19:26.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27305.035095 secs 2023-05-08T11:19:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:27 smithi186 ceph-mon[126480]: pgmap v14619: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 431 KiB/s wr, 8 op/s 2023-05-08T11:19:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:27 smithi133 ceph-mon[125939]: pgmap v14619: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 431 KiB/s wr, 8 op/s 2023-05-08T11:19:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:27 smithi096 ceph-mon[124666]: pgmap v14619: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 431 KiB/s wr, 8 op/s 2023-05-08T11:19:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:29 smithi186 ceph-mon[126480]: pgmap v14620: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 431 KiB/s wr, 8 op/s 2023-05-08T11:19:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:29 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:19:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:29 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:19:29.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27308.192039 secs 2023-05-08T11:19:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:29 smithi133 ceph-mon[125939]: pgmap v14620: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 431 KiB/s wr, 8 op/s 2023-05-08T11:19:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:29 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:19:29.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:29 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:19:29.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27308.192039 secs 2023-05-08T11:19:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:29 smithi096 ceph-mon[124666]: pgmap v14620: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 431 KiB/s wr, 8 op/s 2023-05-08T11:19:29.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:29 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:19:29.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:29 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:19:29.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27308.192039 secs 2023-05-08T11:19:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27308.747333 secs 2023-05-08T11:19:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:30 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:19:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27308.747333 secs 2023-05-08T11:19:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:30 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:19:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27308.747333 secs 2023-05-08T11:19:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:30 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:19:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:31 smithi186 ceph-mon[126480]: pgmap v14621: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 550 KiB/s rd, 548 KiB/s wr, 9 op/s 2023-05-08T11:19:31.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27310.035230 secs 2023-05-08T11:19:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:31 smithi133 ceph-mon[125939]: pgmap v14621: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 550 KiB/s rd, 548 KiB/s wr, 9 op/s 2023-05-08T11:19:31.776 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27310.035230 secs 2023-05-08T11:19:31.777 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:31 smithi096 ceph-mon[124666]: pgmap v14621: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 550 KiB/s rd, 548 KiB/s wr, 9 op/s 2023-05-08T11:19:31.778 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27310.035230 secs 2023-05-08T11:19:33.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:33 smithi186 ceph-mon[126480]: pgmap v14622: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 460 KiB/s wr, 8 op/s 2023-05-08T11:19:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:33 smithi133 ceph-mon[125939]: pgmap v14622: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 460 KiB/s wr, 8 op/s 2023-05-08T11:19:33.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:33 smithi096 ceph-mon[124666]: pgmap v14622: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 460 KiB/s wr, 8 op/s 2023-05-08T11:19:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27313.192162 secs 2023-05-08T11:19:34.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:34 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:19:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27313.192162 secs 2023-05-08T11:19:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:34 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:19:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27313.192162 secs 2023-05-08T11:19:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:34 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:19:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27313.747455 secs 2023-05-08T11:19:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:35 smithi186 ceph-mon[126480]: pgmap v14623: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 460 KiB/s wr, 10 op/s 2023-05-08T11:19:35.702 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27313.747455 secs 2023-05-08T11:19:35.703 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:35 smithi096 ceph-mon[124666]: pgmap v14623: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 460 KiB/s wr, 10 op/s 2023-05-08T11:19:35.710 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27313.747455 secs 2023-05-08T11:19:35.710 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:35 smithi133 ceph-mon[125939]: pgmap v14623: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 460 KiB/s wr, 10 op/s 2023-05-08T11:19:36.546 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27315.035356 secs 2023-05-08T11:19:36.561 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27315.035356 secs 2023-05-08T11:19:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27315.035356 secs 2023-05-08T11:19:37.394 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:37 smithi096 ceph-mon[124666]: pgmap v14624: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 317 KiB/s wr, 8 op/s 2023-05-08T11:19:37.484 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:37 smithi133 ceph-mon[125939]: pgmap v14624: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 317 KiB/s wr, 8 op/s 2023-05-08T11:19:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:37 smithi186 ceph-mon[126480]: pgmap v14624: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 317 KiB/s wr, 8 op/s 2023-05-08T11:19:38.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:19:38.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:19:38.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:19:38.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:19:38.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:19:38.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:19:38.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:38 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:19:38.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:19:38.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:38 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T11:19:38.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:38 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T11:19:38.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:38 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:19:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:19:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:19:38.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:19:38.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:19:38.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:19:38.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:19:38.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:38 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:19:38.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:19:38.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:38 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T11:19:38.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:38 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T11:19:38.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:38 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:19:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:19:38.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:19:38.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:19:38.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:19:38.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:19:38.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:19:38.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:38 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:19:38.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:19:38.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:38 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T11:19:38.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:38 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T11:19:38.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:38 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:19:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:39 smithi186 ceph-mon[126480]: pgmap v14625: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 300 KiB/s wr, 7 op/s 2023-05-08T11:19:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27318.192295 secs 2023-05-08T11:19:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:39 smithi133 ceph-mon[125939]: pgmap v14625: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 300 KiB/s wr, 7 op/s 2023-05-08T11:19:39.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27318.192295 secs 2023-05-08T11:19:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:39 smithi096 ceph-mon[124666]: pgmap v14625: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 300 KiB/s wr, 7 op/s 2023-05-08T11:19:40.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27318.192295 secs 2023-05-08T11:19:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27318.747580 secs 2023-05-08T11:19:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27318.747580 secs 2023-05-08T11:19:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27318.747580 secs 2023-05-08T11:19:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:41 smithi186 ceph-mon[126480]: pgmap v14626: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 400 KiB/s wr, 11 op/s 2023-05-08T11:19:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27320.035493 secs 2023-05-08T11:19:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:41 smithi133 ceph-mon[125939]: pgmap v14626: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 400 KiB/s wr, 11 op/s 2023-05-08T11:19:41.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27320.035493 secs 2023-05-08T11:19:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:41 smithi096 ceph-mon[124666]: pgmap v14626: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 400 KiB/s wr, 11 op/s 2023-05-08T11:19:42.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27320.035493 secs 2023-05-08T11:19:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:43 smithi186 ceph-mon[126480]: pgmap v14627: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 299 KiB/s wr, 6 op/s 2023-05-08T11:19:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:43 smithi133 ceph-mon[125939]: pgmap v14627: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 299 KiB/s wr, 6 op/s 2023-05-08T11:19:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:43 smithi096 ceph-mon[124666]: pgmap v14627: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 299 KiB/s wr, 6 op/s 2023-05-08T11:19:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27323.192427 secs 2023-05-08T11:19:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27323.192427 secs 2023-05-08T11:19:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27323.192427 secs 2023-05-08T11:19:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27323.747696 secs 2023-05-08T11:19:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:45 smithi186 ceph-mon[126480]: pgmap v14628: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 361 KiB/s wr, 9 op/s 2023-05-08T11:19:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27323.747696 secs 2023-05-08T11:19:45.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:45 smithi133 ceph-mon[125939]: pgmap v14628: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 361 KiB/s wr, 9 op/s 2023-05-08T11:19:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27323.747696 secs 2023-05-08T11:19:46.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:45 smithi096 ceph-mon[124666]: pgmap v14628: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 361 KiB/s wr, 9 op/s 2023-05-08T11:19:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:47 smithi186 ceph-mon[126480]: pgmap v14629: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 378 KiB/s wr, 7 op/s 2023-05-08T11:19:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:47 smithi133 ceph-mon[125939]: pgmap v14629: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 378 KiB/s wr, 7 op/s 2023-05-08T11:19:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:47 smithi096 ceph-mon[124666]: pgmap v14629: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 378 KiB/s wr, 7 op/s 2023-05-08T11:19:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:19:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:19:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:19:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:49 smithi186 ceph-mon[126480]: pgmap v14630: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 179 KiB/s wr, 6 op/s 2023-05-08T11:19:49.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27328.192553 secs 2023-05-08T11:19:49.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:19:49.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:19:49.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:19:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:49 smithi133 ceph-mon[125939]: pgmap v14630: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 179 KiB/s wr, 6 op/s 2023-05-08T11:19:49.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27328.192553 secs 2023-05-08T11:19:49.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:19:49.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:19:49.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:19:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:49 smithi096 ceph-mon[124666]: pgmap v14630: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 179 KiB/s wr, 6 op/s 2023-05-08T11:19:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27328.192553 secs 2023-05-08T11:19:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:19:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:19:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:19:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27328.747819 secs 2023-05-08T11:19:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27328.747819 secs 2023-05-08T11:19:51.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27328.747819 secs 2023-05-08T11:19:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:51 smithi186 ceph-mon[126480]: pgmap v14631: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 689 KiB/s rd, 459 KiB/s wr, 10 op/s 2023-05-08T11:19:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:51 smithi133 ceph-mon[125939]: pgmap v14631: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 689 KiB/s rd, 459 KiB/s wr, 10 op/s 2023-05-08T11:19:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:51 smithi096 ceph-mon[124666]: pgmap v14631: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 689 KiB/s rd, 459 KiB/s wr, 10 op/s 2023-05-08T11:19:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:53 smithi186 ceph-mon[126480]: pgmap v14632: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 588 KiB/s rd, 358 KiB/s wr, 6 op/s 2023-05-08T11:19:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:53 smithi133 ceph-mon[125939]: pgmap v14632: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 588 KiB/s rd, 358 KiB/s wr, 6 op/s 2023-05-08T11:19:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:53 smithi096 ceph-mon[124666]: pgmap v14632: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 588 KiB/s rd, 358 KiB/s wr, 6 op/s 2023-05-08T11:19:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27333.192671 secs 2023-05-08T11:19:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27333.192671 secs 2023-05-08T11:19:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27333.192671 secs 2023-05-08T11:19:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:55 smithi186 ceph-mon[126480]: pgmap v14633: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 980 KiB/s rd, 599 KiB/s wr, 10 op/s 2023-05-08T11:19:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:55 smithi133 ceph-mon[125939]: pgmap v14633: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 980 KiB/s rd, 599 KiB/s wr, 10 op/s 2023-05-08T11:19:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:55 smithi096 ceph-mon[124666]: pgmap v14633: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 980 KiB/s rd, 599 KiB/s wr, 10 op/s 2023-05-08T11:19:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:19:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:19:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:19:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:57 smithi186 ceph-mon[126480]: pgmap v14634: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 917 KiB/s rd, 537 KiB/s wr, 9 op/s 2023-05-08T11:19:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:57 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:19:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:19:57.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:19:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:57 smithi133 ceph-mon[125939]: pgmap v14634: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 917 KiB/s rd, 537 KiB/s wr, 9 op/s 2023-05-08T11:19:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:57 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:19:57.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:19:57.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:19:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:57 smithi096 ceph-mon[124666]: pgmap v14634: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 917 KiB/s rd, 537 KiB/s wr, 9 op/s 2023-05-08T11:19:58.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:57 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:19:58.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:19:58.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:19:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:59 smithi186 ceph-mon[126480]: pgmap v14635: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 900 KiB/s rd, 520 KiB/s wr, 7 op/s 2023-05-08T11:19:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:19:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27338.192809 secs 2023-05-08T11:19:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:59 smithi133 ceph-mon[125939]: pgmap v14635: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 900 KiB/s rd, 520 KiB/s wr, 7 op/s 2023-05-08T11:19:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:19:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27338.192809 secs 2023-05-08T11:20:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:59 smithi096 ceph-mon[124666]: pgmap v14635: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 900 KiB/s rd, 520 KiB/s wr, 7 op/s 2023-05-08T11:20:00.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:19:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27338.192809 secs 2023-05-08T11:20:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:00 smithi186 ceph-mon[126480]: overall HEALTH_WARN 1 MDSs report slow requests 2023-05-08T11:20:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:00 smithi133 ceph-mon[125939]: overall HEALTH_WARN 1 MDSs report slow requests 2023-05-08T11:20:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:00 smithi096 ceph-mon[124666]: overall HEALTH_WARN 1 MDSs report slow requests 2023-05-08T11:20:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:01 smithi186 ceph-mon[126480]: pgmap v14636: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 885 KiB/s wr, 13 op/s 2023-05-08T11:20:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27340.035958 secs 2023-05-08T11:20:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:01 smithi133 ceph-mon[125939]: pgmap v14636: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 885 KiB/s wr, 13 op/s 2023-05-08T11:20:01.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27340.035958 secs 2023-05-08T11:20:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:01 smithi096 ceph-mon[124666]: pgmap v14636: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 885 KiB/s wr, 13 op/s 2023-05-08T11:20:02.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27340.035958 secs 2023-05-08T11:20:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:03 smithi186 ceph-mon[126480]: pgmap v14637: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 606 KiB/s wr, 10 op/s 2023-05-08T11:20:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:03 smithi133 ceph-mon[125939]: pgmap v14637: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 606 KiB/s wr, 10 op/s 2023-05-08T11:20:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:03 smithi096 ceph-mon[124666]: pgmap v14637: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 606 KiB/s wr, 10 op/s 2023-05-08T11:20:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27343.192939 secs 2023-05-08T11:20:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27343.192939 secs 2023-05-08T11:20:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27343.192939 secs 2023-05-08T11:20:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27343.748173 secs 2023-05-08T11:20:05.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:05 smithi186 ceph-mon[126480]: pgmap v14638: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 771 KiB/s wr, 25 op/s 2023-05-08T11:20:05.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:05 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:20:05.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:20:05.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:20:05.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:20:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27343.748173 secs 2023-05-08T11:20:05.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:05 smithi133 ceph-mon[125939]: pgmap v14638: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 771 KiB/s wr, 25 op/s 2023-05-08T11:20:05.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:05 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:20:05.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:20:05.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:20:05.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:20:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27343.748173 secs 2023-05-08T11:20:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:05 smithi096 ceph-mon[124666]: pgmap v14638: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 771 KiB/s wr, 25 op/s 2023-05-08T11:20:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:05 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:20:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:20:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:20:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:20:07.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:07 smithi186 ceph-mon[126480]: pgmap v14639: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 939 KiB/s rd, 661 KiB/s wr, 23 op/s 2023-05-08T11:20:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:07 smithi133 ceph-mon[125939]: pgmap v14639: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 939 KiB/s rd, 661 KiB/s wr, 23 op/s 2023-05-08T11:20:08.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:07 smithi096 ceph-mon[124666]: pgmap v14639: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 939 KiB/s rd, 661 KiB/s wr, 23 op/s 2023-05-08T11:20:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:08 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:20:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:08 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:20:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:08 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:20:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:09 smithi186 ceph-mon[126480]: pgmap v14640: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 939 KiB/s rd, 661 KiB/s wr, 22 op/s 2023-05-08T11:20:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27348.193075 secs 2023-05-08T11:20:09.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:20:09.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:20:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:09 smithi133 ceph-mon[125939]: pgmap v14640: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 939 KiB/s rd, 661 KiB/s wr, 22 op/s 2023-05-08T11:20:09.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27348.193075 secs 2023-05-08T11:20:09.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:20:09.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:20:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:09 smithi096 ceph-mon[124666]: pgmap v14640: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 939 KiB/s rd, 661 KiB/s wr, 22 op/s 2023-05-08T11:20:10.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27348.193075 secs 2023-05-08T11:20:10.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:20:10.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:20:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27348.748290 secs 2023-05-08T11:20:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:10 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:20:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27348.748290 secs 2023-05-08T11:20:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:10 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:20:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27348.748290 secs 2023-05-08T11:20:11.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:10 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:20:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:11 smithi186 ceph-mon[126480]: pgmap v14641: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 944 KiB/s rd, 664 KiB/s wr, 26 op/s 2023-05-08T11:20:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:11 smithi133 ceph-mon[125939]: pgmap v14641: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 944 KiB/s rd, 664 KiB/s wr, 26 op/s 2023-05-08T11:20:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:11 smithi096 ceph-mon[124666]: pgmap v14641: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 944 KiB/s rd, 664 KiB/s wr, 26 op/s 2023-05-08T11:20:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:13 smithi186 ceph-mon[126480]: pgmap v14642: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 286 KiB/s rd, 299 KiB/s wr, 21 op/s 2023-05-08T11:20:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:13 smithi133 ceph-mon[125939]: pgmap v14642: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 286 KiB/s rd, 299 KiB/s wr, 21 op/s 2023-05-08T11:20:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:13 smithi096 ceph-mon[124666]: pgmap v14642: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 286 KiB/s rd, 299 KiB/s wr, 21 op/s 2023-05-08T11:20:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27353.193199 secs 2023-05-08T11:20:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27353.193199 secs 2023-05-08T11:20:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27353.193199 secs 2023-05-08T11:20:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27353.748414 secs 2023-05-08T11:20:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:15 smithi186 ceph-mon[126480]: pgmap v14643: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 496 KiB/s rd, 507 KiB/s wr, 24 op/s 2023-05-08T11:20:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27353.748414 secs 2023-05-08T11:20:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:15 smithi133 ceph-mon[125939]: pgmap v14643: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 496 KiB/s rd, 507 KiB/s wr, 24 op/s 2023-05-08T11:20:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27353.748414 secs 2023-05-08T11:20:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:15 smithi096 ceph-mon[124666]: pgmap v14643: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 496 KiB/s rd, 507 KiB/s wr, 24 op/s 2023-05-08T11:20:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:17 smithi186 ceph-mon[126480]: pgmap v14644: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 342 KiB/s wr, 9 op/s 2023-05-08T11:20:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:17 smithi133 ceph-mon[125939]: pgmap v14644: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 342 KiB/s wr, 9 op/s 2023-05-08T11:20:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:17 smithi096 ceph-mon[124666]: pgmap v14644: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 342 KiB/s wr, 9 op/s 2023-05-08T11:20:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:19 smithi186 ceph-mon[126480]: pgmap v14645: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 211 KiB/s wr, 7 op/s 2023-05-08T11:20:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27358.193345 secs 2023-05-08T11:20:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:19 smithi133 ceph-mon[125939]: pgmap v14645: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 211 KiB/s wr, 7 op/s 2023-05-08T11:20:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27358.193345 secs 2023-05-08T11:20:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:19 smithi096 ceph-mon[124666]: pgmap v14645: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 211 KiB/s wr, 7 op/s 2023-05-08T11:20:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27358.193345 secs 2023-05-08T11:20:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27358.748509 secs 2023-05-08T11:20:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27358.748509 secs 2023-05-08T11:20:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27358.748509 secs 2023-05-08T11:20:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:21 smithi133 ceph-mon[125939]: pgmap v14646: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 212 KiB/s wr, 10 op/s 2023-05-08T11:20:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:21 smithi096 ceph-mon[124666]: pgmap v14646: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 212 KiB/s wr, 10 op/s 2023-05-08T11:20:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:21 smithi186 ceph-mon[126480]: pgmap v14646: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 212 KiB/s wr, 10 op/s 2023-05-08T11:20:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:23 smithi133 ceph-mon[125939]: pgmap v14647: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 208 KiB/s wr, 6 op/s 2023-05-08T11:20:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:23 smithi096 ceph-mon[124666]: pgmap v14647: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 208 KiB/s wr, 6 op/s 2023-05-08T11:20:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:23 smithi186 ceph-mon[126480]: pgmap v14647: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 208 KiB/s wr, 6 op/s 2023-05-08T11:20:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27363.193462 secs 2023-05-08T11:20:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:24 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:20:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27363.193462 secs 2023-05-08T11:20:25.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:24 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:20:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27363.193462 secs 2023-05-08T11:20:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:24 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:20:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:25 smithi133 ceph-mon[125939]: pgmap v14648: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 554 KiB/s rd, 577 KiB/s wr, 12 op/s 2023-05-08T11:20:25.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:25 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:20:25.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:25 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:20:25.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:25 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:20:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:25 smithi096 ceph-mon[124666]: pgmap v14648: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 554 KiB/s rd, 577 KiB/s wr, 12 op/s 2023-05-08T11:20:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:25 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:20:26.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:25 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:20:26.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:25 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:20:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:25 smithi186 ceph-mon[126480]: pgmap v14648: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 554 KiB/s rd, 577 KiB/s wr, 12 op/s 2023-05-08T11:20:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:25 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:20:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:25 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:20:26.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:25 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:20:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:27 smithi133 ceph-mon[125939]: osdmap e992: 12 total, 12 up, 12 in 2023-05-08T11:20:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:27 smithi133 ceph-mon[125939]: pgmap v14650: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 444 KiB/s wr, 12 op/s 2023-05-08T11:20:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:27 smithi096 ceph-mon[124666]: osdmap e992: 12 total, 12 up, 12 in 2023-05-08T11:20:27.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:27 smithi096 ceph-mon[124666]: pgmap v14650: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 444 KiB/s wr, 12 op/s 2023-05-08T11:20:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:27 smithi186 ceph-mon[126480]: osdmap e992: 12 total, 12 up, 12 in 2023-05-08T11:20:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:27 smithi186 ceph-mon[126480]: pgmap v14650: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 444 KiB/s wr, 12 op/s 2023-05-08T11:20:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:29 smithi186 ceph-mon[126480]: pgmap v14651: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 444 KiB/s wr, 12 op/s 2023-05-08T11:20:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27368.193541 secs 2023-05-08T11:20:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:29 smithi133 ceph-mon[125939]: pgmap v14651: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 444 KiB/s wr, 12 op/s 2023-05-08T11:20:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27368.193541 secs 2023-05-08T11:20:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:29 smithi096 ceph-mon[124666]: pgmap v14651: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 444 KiB/s wr, 12 op/s 2023-05-08T11:20:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27368.193541 secs 2023-05-08T11:20:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:31 smithi133 ceph-mon[125939]: pgmap v14652: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 680 KiB/s rd, 724 KiB/s wr, 13 op/s 2023-05-08T11:20:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:31 smithi096 ceph-mon[124666]: pgmap v14652: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 680 KiB/s rd, 724 KiB/s wr, 13 op/s 2023-05-08T11:20:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:31 smithi186 ceph-mon[126480]: pgmap v14652: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 680 KiB/s rd, 724 KiB/s wr, 13 op/s 2023-05-08T11:20:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:33 smithi186 ceph-mon[126480]: pgmap v14653: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 680 KiB/s rd, 724 KiB/s wr, 13 op/s 2023-05-08T11:20:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:33 smithi133 ceph-mon[125939]: pgmap v14653: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 680 KiB/s rd, 724 KiB/s wr, 13 op/s 2023-05-08T11:20:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:33 smithi096 ceph-mon[124666]: pgmap v14653: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 680 KiB/s rd, 724 KiB/s wr, 13 op/s 2023-05-08T11:20:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27373.193667 secs 2023-05-08T11:20:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27373.193667 secs 2023-05-08T11:20:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27373.193667 secs 2023-05-08T11:20:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:35 smithi186 ceph-mon[126480]: pgmap v14654: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 396 KiB/s wr, 9 op/s 2023-05-08T11:20:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:35 smithi186 ceph-mon[126480]: osdmap e993: 12 total, 12 up, 12 in 2023-05-08T11:20:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:35 smithi133 ceph-mon[125939]: pgmap v14654: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 396 KiB/s wr, 9 op/s 2023-05-08T11:20:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:35 smithi133 ceph-mon[125939]: osdmap e993: 12 total, 12 up, 12 in 2023-05-08T11:20:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:35 smithi096 ceph-mon[124666]: pgmap v14654: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 396 KiB/s wr, 9 op/s 2023-05-08T11:20:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:35 smithi096 ceph-mon[124666]: osdmap e993: 12 total, 12 up, 12 in 2023-05-08T11:20:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:37 smithi133 ceph-mon[125939]: pgmap v14656: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 396 KiB/s wr, 9 op/s 2023-05-08T11:20:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:37 smithi186 ceph-mon[126480]: pgmap v14656: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 396 KiB/s wr, 9 op/s 2023-05-08T11:20:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:37 smithi096 ceph-mon[124666]: pgmap v14656: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 396 KiB/s wr, 9 op/s 2023-05-08T11:20:38.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:20:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:20:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:20:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:39 smithi186 ceph-mon[126480]: pgmap v14657: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 396 KiB/s wr, 9 op/s 2023-05-08T11:20:39.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27378.193757 secs 2023-05-08T11:20:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:39 smithi133 ceph-mon[125939]: pgmap v14657: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 396 KiB/s wr, 9 op/s 2023-05-08T11:20:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27378.193757 secs 2023-05-08T11:20:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:39 smithi096 ceph-mon[124666]: pgmap v14657: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 396 KiB/s wr, 9 op/s 2023-05-08T11:20:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27378.193757 secs 2023-05-08T11:20:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27378.748981 secs 2023-05-08T11:20:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27378.748981 secs 2023-05-08T11:20:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27378.748981 secs 2023-05-08T11:20:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:41 smithi186 ceph-mon[126480]: pgmap v14658: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 787 KiB/s rd, 763 KiB/s wr, 10 op/s 2023-05-08T11:20:41.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:41 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:20:41.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:41 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:20:41.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:41 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:20:41.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27380.036979 secs 2023-05-08T11:20:41.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:20:41.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:20:41.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:20:41.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:20:41.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:20:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:41 smithi133 ceph-mon[125939]: pgmap v14658: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 787 KiB/s rd, 763 KiB/s wr, 10 op/s 2023-05-08T11:20:41.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:41 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:20:41.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:41 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:20:41.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:41 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:20:41.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27380.036979 secs 2023-05-08T11:20:41.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:20:41.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:20:41.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:20:41.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:20:41.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:20:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:41 smithi096 ceph-mon[124666]: pgmap v14658: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 787 KiB/s rd, 763 KiB/s wr, 10 op/s 2023-05-08T11:20:41.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:41 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:20:41.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:41 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:20:41.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:41 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:20:41.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27380.036979 secs 2023-05-08T11:20:41.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:20:41.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:20:41.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:20:41.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:20:41.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:20:42.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:42 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:20:42.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:42 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T11:20:42.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:42 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T11:20:42.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:42 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:20:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:42 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:20:42.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:42 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T11:20:42.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:42 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T11:20:42.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:42 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:20:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:42 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:20:42.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:42 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T11:20:42.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:42 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T11:20:42.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:42 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:20:43.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:43 smithi186 ceph-mon[126480]: pgmap v14659: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 787 KiB/s rd, 763 KiB/s wr, 10 op/s 2023-05-08T11:20:43.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:43 smithi133 ceph-mon[125939]: pgmap v14659: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 787 KiB/s rd, 763 KiB/s wr, 10 op/s 2023-05-08T11:20:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:43 smithi096 ceph-mon[124666]: pgmap v14659: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 787 KiB/s rd, 763 KiB/s wr, 10 op/s 2023-05-08T11:20:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27383.193889 secs 2023-05-08T11:20:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27383.193889 secs 2023-05-08T11:20:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27383.193889 secs 2023-05-08T11:20:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27383.749098 secs 2023-05-08T11:20:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:45 smithi186 ceph-mon[126480]: pgmap v14660: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 746 KiB/s rd, 882 KiB/s wr, 12 op/s 2023-05-08T11:20:45.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:45 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:20:45.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:45 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:20:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27383.749098 secs 2023-05-08T11:20:45.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:45 smithi133 ceph-mon[125939]: pgmap v14660: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 746 KiB/s rd, 882 KiB/s wr, 12 op/s 2023-05-08T11:20:45.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:45 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:20:45.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:45 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:20:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27383.749098 secs 2023-05-08T11:20:45.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:45 smithi096 ceph-mon[124666]: pgmap v14660: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 746 KiB/s rd, 882 KiB/s wr, 12 op/s 2023-05-08T11:20:45.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:45 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:20:45.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:45 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:20:46.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27385.037060 secs 2023-05-08T11:20:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27385.037060 secs 2023-05-08T11:20:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27385.037060 secs 2023-05-08T11:20:47.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:47 smithi186 ceph-mon[126480]: pgmap v14661: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 674 KiB/s rd, 893 KiB/s wr, 10 op/s 2023-05-08T11:20:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:47 smithi133 ceph-mon[125939]: pgmap v14661: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 674 KiB/s rd, 893 KiB/s wr, 10 op/s 2023-05-08T11:20:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:47 smithi096 ceph-mon[124666]: pgmap v14661: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 674 KiB/s rd, 893 KiB/s wr, 10 op/s 2023-05-08T11:20:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:49 smithi186 ceph-mon[126480]: pgmap v14662: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 621 KiB/s rd, 823 KiB/s wr, 10 op/s 2023-05-08T11:20:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27388.194011 secs 2023-05-08T11:20:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:49 smithi133 ceph-mon[125939]: pgmap v14662: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 621 KiB/s rd, 823 KiB/s wr, 10 op/s 2023-05-08T11:20:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27388.194011 secs 2023-05-08T11:20:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:49 smithi096 ceph-mon[124666]: pgmap v14662: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 621 KiB/s rd, 823 KiB/s wr, 10 op/s 2023-05-08T11:20:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27388.194011 secs 2023-05-08T11:20:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:50 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:20:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:50 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:20:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:50 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:20:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:51 smithi186 ceph-mon[126480]: pgmap v14663: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 16 op/s 2023-05-08T11:20:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27390.037182 secs 2023-05-08T11:20:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:51 smithi133 ceph-mon[125939]: pgmap v14663: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 16 op/s 2023-05-08T11:20:51.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27390.037182 secs 2023-05-08T11:20:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:51 smithi096 ceph-mon[124666]: pgmap v14663: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 16 op/s 2023-05-08T11:20:51.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27390.037182 secs 2023-05-08T11:20:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:20:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:20:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:20:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:53 smithi186 ceph-mon[126480]: pgmap v14664: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 926 KiB/s rd, 913 KiB/s wr, 10 op/s 2023-05-08T11:20:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:20:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:20:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:53 smithi133 ceph-mon[125939]: pgmap v14664: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 926 KiB/s rd, 913 KiB/s wr, 10 op/s 2023-05-08T11:20:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:20:53.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:20:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:53 smithi096 ceph-mon[124666]: pgmap v14664: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 926 KiB/s rd, 913 KiB/s wr, 10 op/s 2023-05-08T11:20:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:20:53.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:20:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27393.194132 secs 2023-05-08T11:20:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27393.194132 secs 2023-05-08T11:20:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27393.194132 secs 2023-05-08T11:20:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27393.749334 secs 2023-05-08T11:20:55.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:55 smithi186 ceph-mon[126480]: pgmap v14665: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 16 op/s 2023-05-08T11:20:55.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:55 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:20:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27393.749334 secs 2023-05-08T11:20:55.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:55 smithi133 ceph-mon[125939]: pgmap v14665: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 16 op/s 2023-05-08T11:20:55.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:55 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:20:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27393.749334 secs 2023-05-08T11:20:55.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:55 smithi096 ceph-mon[124666]: pgmap v14665: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 16 op/s 2023-05-08T11:20:55.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:55 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:20:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27395.037298 secs 2023-05-08T11:20:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27395.037298 secs 2023-05-08T11:20:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27395.037298 secs 2023-05-08T11:20:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:57 smithi186 ceph-mon[126480]: pgmap v14666: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2023-05-08T11:20:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:20:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:20:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:57 smithi133 ceph-mon[125939]: pgmap v14666: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2023-05-08T11:20:57.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:20:57.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:20:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:57 smithi096 ceph-mon[124666]: pgmap v14666: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2023-05-08T11:20:57.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:20:57.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:20:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:59 smithi186 ceph-mon[126480]: pgmap v14667: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T11:20:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:20:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27398.194289 secs 2023-05-08T11:20:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:59 smithi133 ceph-mon[125939]: pgmap v14667: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T11:20:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:20:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27398.194289 secs 2023-05-08T11:20:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:59 smithi096 ceph-mon[124666]: pgmap v14667: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T11:20:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:20:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27398.194289 secs 2023-05-08T11:21:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27398.749422 secs 2023-05-08T11:21:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:00 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:21:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27398.749422 secs 2023-05-08T11:21:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:00 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:21:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27398.749422 secs 2023-05-08T11:21:00.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:00 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:21:01.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:01 smithi186 ceph-mon[126480]: pgmap v14668: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.4 MiB/s wr, 16 op/s 2023-05-08T11:21:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:01 smithi133 ceph-mon[125939]: pgmap v14668: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.4 MiB/s wr, 16 op/s 2023-05-08T11:21:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:01 smithi096 ceph-mon[124666]: pgmap v14668: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.4 MiB/s wr, 16 op/s 2023-05-08T11:21:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:03 smithi186 ceph-mon[126480]: pgmap v14669: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 930 KiB/s rd, 788 KiB/s wr, 10 op/s 2023-05-08T11:21:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:03 smithi133 ceph-mon[125939]: pgmap v14669: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 930 KiB/s rd, 788 KiB/s wr, 10 op/s 2023-05-08T11:21:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:03 smithi096 ceph-mon[124666]: pgmap v14669: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 930 KiB/s rd, 788 KiB/s wr, 10 op/s 2023-05-08T11:21:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27403.194414 secs 2023-05-08T11:21:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:04 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:21:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27403.194414 secs 2023-05-08T11:21:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:04 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:21:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27403.194414 secs 2023-05-08T11:21:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:04 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:21:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27403.749567 secs 2023-05-08T11:21:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:05 smithi186 ceph-mon[126480]: pgmap v14670: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 30 op/s 2023-05-08T11:21:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:21:05.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:21:05.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:05 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:21:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27403.749567 secs 2023-05-08T11:21:05.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:05 smithi133 ceph-mon[125939]: pgmap v14670: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 30 op/s 2023-05-08T11:21:05.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:21:05.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:21:05.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:05 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:21:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27403.749567 secs 2023-05-08T11:21:05.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:05 smithi096 ceph-mon[124666]: pgmap v14670: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 30 op/s 2023-05-08T11:21:05.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:21:05.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:21:05.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:05 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:21:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27405.037538 secs 2023-05-08T11:21:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27405.037538 secs 2023-05-08T11:21:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27405.037538 secs 2023-05-08T11:21:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:07 smithi186 ceph-mon[126480]: pgmap v14671: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 702 KiB/s rd, 736 KiB/s wr, 24 op/s 2023-05-08T11:21:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:07 smithi133 ceph-mon[125939]: pgmap v14671: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 702 KiB/s rd, 736 KiB/s wr, 24 op/s 2023-05-08T11:21:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:07 smithi096 ceph-mon[124666]: pgmap v14671: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 702 KiB/s rd, 736 KiB/s wr, 24 op/s 2023-05-08T11:21:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:09 smithi133 ceph-mon[125939]: pgmap v14672: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 702 KiB/s rd, 736 KiB/s wr, 24 op/s 2023-05-08T11:21:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:21:09.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:21:09.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27408.194472 secs 2023-05-08T11:21:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:09 smithi096 ceph-mon[124666]: pgmap v14672: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 702 KiB/s rd, 736 KiB/s wr, 24 op/s 2023-05-08T11:21:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:21:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:21:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27408.194472 secs 2023-05-08T11:21:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:09 smithi186 ceph-mon[126480]: pgmap v14672: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 702 KiB/s rd, 736 KiB/s wr, 24 op/s 2023-05-08T11:21:09.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:21:09.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:21:09.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27408.194472 secs 2023-05-08T11:21:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27408.749687 secs 2023-05-08T11:21:10.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:10 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:21:10.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27408.749687 secs 2023-05-08T11:21:10.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:10 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:21:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27408.749687 secs 2023-05-08T11:21:10.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:10 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:21:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:11 smithi133 ceph-mon[125939]: pgmap v14673: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 994 KiB/s rd, 1.0 MiB/s wr, 28 op/s 2023-05-08T11:21:11.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27410.037656 secs 2023-05-08T11:21:11.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:11 smithi133 ceph-mon[125939]: osdmap e994: 12 total, 12 up, 12 in 2023-05-08T11:21:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:11 smithi096 ceph-mon[124666]: pgmap v14673: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 994 KiB/s rd, 1.0 MiB/s wr, 28 op/s 2023-05-08T11:21:11.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27410.037656 secs 2023-05-08T11:21:11.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:11 smithi096 ceph-mon[124666]: osdmap e994: 12 total, 12 up, 12 in 2023-05-08T11:21:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:11 smithi186 ceph-mon[126480]: pgmap v14673: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 994 KiB/s rd, 1.0 MiB/s wr, 28 op/s 2023-05-08T11:21:11.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27410.037656 secs 2023-05-08T11:21:11.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:11 smithi186 ceph-mon[126480]: osdmap e994: 12 total, 12 up, 12 in 2023-05-08T11:21:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:13 smithi133 ceph-mon[125939]: pgmap v14675: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 28 op/s 2023-05-08T11:21:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:13 smithi096 ceph-mon[124666]: pgmap v14675: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 28 op/s 2023-05-08T11:21:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:13 smithi186 ceph-mon[126480]: pgmap v14675: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 28 op/s 2023-05-08T11:21:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27413.194598 secs 2023-05-08T11:21:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27413.194598 secs 2023-05-08T11:21:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27413.194598 secs 2023-05-08T11:21:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27413.749808 secs 2023-05-08T11:21:15.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:15 smithi133 ceph-mon[125939]: pgmap v14676: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 467 KiB/s rd, 465 KiB/s wr, 9 op/s 2023-05-08T11:21:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27413.749808 secs 2023-05-08T11:21:15.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:15 smithi096 ceph-mon[124666]: pgmap v14676: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 467 KiB/s rd, 465 KiB/s wr, 9 op/s 2023-05-08T11:21:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27413.749808 secs 2023-05-08T11:21:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:15 smithi186 ceph-mon[126480]: pgmap v14676: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 467 KiB/s rd, 465 KiB/s wr, 9 op/s 2023-05-08T11:21:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27415.037805 secs 2023-05-08T11:21:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27415.037805 secs 2023-05-08T11:21:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27415.037805 secs 2023-05-08T11:21:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:17 smithi133 ceph-mon[125939]: pgmap v14677: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 467 KiB/s rd, 465 KiB/s wr, 9 op/s 2023-05-08T11:21:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:17 smithi096 ceph-mon[124666]: pgmap v14677: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 467 KiB/s rd, 465 KiB/s wr, 9 op/s 2023-05-08T11:21:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:17 smithi186 ceph-mon[126480]: pgmap v14677: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 467 KiB/s rd, 465 KiB/s wr, 9 op/s 2023-05-08T11:21:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:19 smithi133 ceph-mon[125939]: pgmap v14678: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 467 KiB/s rd, 465 KiB/s wr, 9 op/s 2023-05-08T11:21:19.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27418.194660 secs 2023-05-08T11:21:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:19 smithi096 ceph-mon[124666]: pgmap v14678: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 467 KiB/s rd, 465 KiB/s wr, 9 op/s 2023-05-08T11:21:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27418.194660 secs 2023-05-08T11:21:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:19 smithi186 ceph-mon[126480]: pgmap v14678: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 467 KiB/s rd, 465 KiB/s wr, 9 op/s 2023-05-08T11:21:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27418.194660 secs 2023-05-08T11:21:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27418.749905 secs 2023-05-08T11:21:20.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:20 smithi133 ceph-mon[125939]: osdmap e995: 12 total, 12 up, 12 in 2023-05-08T11:21:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27418.749905 secs 2023-05-08T11:21:20.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:20 smithi096 ceph-mon[124666]: osdmap e995: 12 total, 12 up, 12 in 2023-05-08T11:21:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27418.749905 secs 2023-05-08T11:21:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:20 smithi186 ceph-mon[126480]: osdmap e995: 12 total, 12 up, 12 in 2023-05-08T11:21:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:21 smithi133 ceph-mon[125939]: pgmap v14680: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 255 KiB/s wr, 9 op/s 2023-05-08T11:21:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27420.037934 secs 2023-05-08T11:21:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:21 smithi096 ceph-mon[124666]: pgmap v14680: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 255 KiB/s wr, 9 op/s 2023-05-08T11:21:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27420.037934 secs 2023-05-08T11:21:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:21 smithi186 ceph-mon[126480]: pgmap v14680: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 255 KiB/s wr, 9 op/s 2023-05-08T11:21:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27420.037934 secs 2023-05-08T11:21:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:23 smithi133 ceph-mon[125939]: pgmap v14681: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 231 KiB/s wr, 8 op/s 2023-05-08T11:21:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:23 smithi096 ceph-mon[124666]: pgmap v14681: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 231 KiB/s wr, 8 op/s 2023-05-08T11:21:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:23 smithi186 ceph-mon[126480]: pgmap v14681: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 231 KiB/s wr, 8 op/s 2023-05-08T11:21:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27423.194755 secs 2023-05-08T11:21:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27423.194755 secs 2023-05-08T11:21:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27423.194755 secs 2023-05-08T11:21:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27423.750023 secs 2023-05-08T11:21:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:25 smithi133 ceph-mon[125939]: pgmap v14682: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 137 KiB/s wr, 9 op/s 2023-05-08T11:21:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27423.750023 secs 2023-05-08T11:21:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:25 smithi096 ceph-mon[124666]: pgmap v14682: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 137 KiB/s wr, 9 op/s 2023-05-08T11:21:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27423.750023 secs 2023-05-08T11:21:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:25 smithi186 ceph-mon[126480]: pgmap v14682: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 137 KiB/s wr, 9 op/s 2023-05-08T11:21:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27425.038059 secs 2023-05-08T11:21:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27425.038059 secs 2023-05-08T11:21:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27425.038059 secs 2023-05-08T11:21:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:27 smithi133 ceph-mon[125939]: pgmap v14683: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 137 KiB/s wr, 9 op/s 2023-05-08T11:21:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:27 smithi096 ceph-mon[124666]: pgmap v14683: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 137 KiB/s wr, 9 op/s 2023-05-08T11:21:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:27 smithi186 ceph-mon[126480]: pgmap v14683: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 137 KiB/s wr, 9 op/s 2023-05-08T11:21:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:29 smithi133 ceph-mon[125939]: pgmap v14684: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 137 KiB/s wr, 9 op/s 2023-05-08T11:21:29.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27428.194861 secs 2023-05-08T11:21:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:29 smithi096 ceph-mon[124666]: pgmap v14684: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 137 KiB/s wr, 9 op/s 2023-05-08T11:21:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27428.194861 secs 2023-05-08T11:21:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:29 smithi186 ceph-mon[126480]: pgmap v14684: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 137 KiB/s wr, 9 op/s 2023-05-08T11:21:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27428.194861 secs 2023-05-08T11:21:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27428.750135 secs 2023-05-08T11:21:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27428.750135 secs 2023-05-08T11:21:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27428.750135 secs 2023-05-08T11:21:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:31 smithi133 ceph-mon[125939]: pgmap v14685: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 268 KiB/s wr, 9 op/s 2023-05-08T11:21:31.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27430.038200 secs 2023-05-08T11:21:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:31 smithi096 ceph-mon[124666]: pgmap v14685: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 268 KiB/s wr, 9 op/s 2023-05-08T11:21:31.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27430.038200 secs 2023-05-08T11:21:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:31 smithi186 ceph-mon[126480]: pgmap v14685: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 268 KiB/s wr, 9 op/s 2023-05-08T11:21:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27430.038200 secs 2023-05-08T11:21:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:33 smithi133 ceph-mon[125939]: pgmap v14686: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 225 KiB/s wr, 8 op/s 2023-05-08T11:21:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:33 smithi096 ceph-mon[124666]: pgmap v14686: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 225 KiB/s wr, 8 op/s 2023-05-08T11:21:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:33 smithi186 ceph-mon[126480]: pgmap v14686: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 225 KiB/s wr, 8 op/s 2023-05-08T11:21:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27433.195011 secs 2023-05-08T11:21:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27433.195011 secs 2023-05-08T11:21:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27433.195011 secs 2023-05-08T11:21:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27433.750274 secs 2023-05-08T11:21:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:35 smithi133 ceph-mon[125939]: pgmap v14687: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 225 KiB/s wr, 11 op/s 2023-05-08T11:21:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27433.750274 secs 2023-05-08T11:21:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:35 smithi096 ceph-mon[124666]: pgmap v14687: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 225 KiB/s wr, 11 op/s 2023-05-08T11:21:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27433.750274 secs 2023-05-08T11:21:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:35 smithi186 ceph-mon[126480]: pgmap v14687: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 225 KiB/s wr, 11 op/s 2023-05-08T11:21:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27435.038314 secs 2023-05-08T11:21:36.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27435.038314 secs 2023-05-08T11:21:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27435.038314 secs 2023-05-08T11:21:37.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:37 smithi133 ceph-mon[125939]: pgmap v14688: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 207 KiB/s wr, 7 op/s 2023-05-08T11:21:37.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:37 smithi096 ceph-mon[124666]: pgmap v14688: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 207 KiB/s wr, 7 op/s 2023-05-08T11:21:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:37 smithi186 ceph-mon[126480]: pgmap v14688: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 207 KiB/s wr, 7 op/s 2023-05-08T11:21:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:39 smithi133 ceph-mon[125939]: pgmap v14689: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 207 KiB/s wr, 7 op/s 2023-05-08T11:21:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27438.195168 secs 2023-05-08T11:21:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:39 smithi096 ceph-mon[124666]: pgmap v14689: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 207 KiB/s wr, 7 op/s 2023-05-08T11:21:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27438.195168 secs 2023-05-08T11:21:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:39 smithi186 ceph-mon[126480]: pgmap v14689: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 207 KiB/s wr, 7 op/s 2023-05-08T11:21:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27438.195168 secs 2023-05-08T11:21:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27438.750394 secs 2023-05-08T11:21:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27438.750394 secs 2023-05-08T11:21:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27438.750394 secs 2023-05-08T11:21:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:41 smithi133 ceph-mon[125939]: pgmap v14690: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 432 KiB/s wr, 10 op/s 2023-05-08T11:21:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27440.038428 secs 2023-05-08T11:21:41.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:21:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:41 smithi096 ceph-mon[124666]: pgmap v14690: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 432 KiB/s wr, 10 op/s 2023-05-08T11:21:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27440.038428 secs 2023-05-08T11:21:41.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:21:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:41 smithi186 ceph-mon[126480]: pgmap v14690: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 432 KiB/s wr, 10 op/s 2023-05-08T11:21:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27440.038428 secs 2023-05-08T11:21:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:21:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:21:42.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:21:42.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:42 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:21:42.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:21:42.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:42 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T11:21:42.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:42 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T11:21:42.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:42 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:21:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:21:42.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:21:42.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:42 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:21:42.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:21:42.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:42 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T11:21:42.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:42 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T11:21:42.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:42 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:21:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:21:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:21:42.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:42 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:21:42.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:21:42.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:42 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T11:21:42.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:42 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T11:21:42.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:42 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:21:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:43 smithi133 ceph-mon[125939]: pgmap v14691: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 225 KiB/s wr, 6 op/s 2023-05-08T11:21:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:43 smithi096 ceph-mon[124666]: pgmap v14691: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 225 KiB/s wr, 6 op/s 2023-05-08T11:21:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:43 smithi186 ceph-mon[126480]: pgmap v14691: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 225 KiB/s wr, 6 op/s 2023-05-08T11:21:45.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27443.195296 secs 2023-05-08T11:21:45.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27443.750520 secs 2023-05-08T11:21:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27443.195296 secs 2023-05-08T11:21:45.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27443.750520 secs 2023-05-08T11:21:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27443.195296 secs 2023-05-08T11:21:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27443.750520 secs 2023-05-08T11:21:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:45 smithi133 ceph-mon[125939]: pgmap v14692: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 226 KiB/s wr, 10 op/s 2023-05-08T11:21:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:45 smithi096 ceph-mon[124666]: pgmap v14692: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 226 KiB/s wr, 10 op/s 2023-05-08T11:21:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:45 smithi186 ceph-mon[126480]: pgmap v14692: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 226 KiB/s wr, 10 op/s 2023-05-08T11:21:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:47 smithi133 ceph-mon[125939]: pgmap v14693: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 225 KiB/s wr, 6 op/s 2023-05-08T11:21:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:47 smithi096 ceph-mon[124666]: pgmap v14693: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 225 KiB/s wr, 6 op/s 2023-05-08T11:21:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:47 smithi186 ceph-mon[126480]: pgmap v14693: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 225 KiB/s wr, 6 op/s 2023-05-08T11:21:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:21:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:21:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:21:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:49 smithi133 ceph-mon[125939]: pgmap v14694: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 225 KiB/s wr, 6 op/s 2023-05-08T11:21:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27448.195417 secs 2023-05-08T11:21:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:21:50.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:21:50.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:21:50.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27448.750646 secs 2023-05-08T11:21:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:49 smithi096 ceph-mon[124666]: pgmap v14694: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 225 KiB/s wr, 6 op/s 2023-05-08T11:21:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27448.195417 secs 2023-05-08T11:21:50.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:21:50.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:21:50.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:21:50.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27448.750646 secs 2023-05-08T11:21:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:49 smithi186 ceph-mon[126480]: pgmap v14694: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 225 KiB/s wr, 6 op/s 2023-05-08T11:21:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27448.195417 secs 2023-05-08T11:21:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:21:50.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:21:50.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:21:50.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27448.750646 secs 2023-05-08T11:21:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:51 smithi133 ceph-mon[125939]: pgmap v14695: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 410 KiB/s wr, 10 op/s 2023-05-08T11:21:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27450.038701 secs 2023-05-08T11:21:51.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:51 smithi096 ceph-mon[124666]: pgmap v14695: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 410 KiB/s wr, 10 op/s 2023-05-08T11:21:51.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27450.038701 secs 2023-05-08T11:21:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:51 smithi186 ceph-mon[126480]: pgmap v14695: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 410 KiB/s wr, 10 op/s 2023-05-08T11:21:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27450.038701 secs 2023-05-08T11:21:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:21:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:21:53.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:53 smithi133 ceph-mon[125939]: pgmap v14696: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 186 KiB/s wr, 7 op/s 2023-05-08T11:21:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:21:53.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:21:53.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:53 smithi096 ceph-mon[124666]: pgmap v14696: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 186 KiB/s wr, 7 op/s 2023-05-08T11:21:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:21:53.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:21:53.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:53 smithi186 ceph-mon[126480]: pgmap v14696: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 186 KiB/s wr, 7 op/s 2023-05-08T11:21:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27453.195562 secs 2023-05-08T11:21:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27453.195562 secs 2023-05-08T11:21:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27453.195562 secs 2023-05-08T11:21:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:55 smithi186 ceph-mon[126480]: pgmap v14697: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 941 KiB/s rd, 775 KiB/s wr, 13 op/s 2023-05-08T11:21:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:55 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:21:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:55 smithi133 ceph-mon[125939]: pgmap v14697: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 941 KiB/s rd, 775 KiB/s wr, 13 op/s 2023-05-08T11:21:55.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:55 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:21:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:55 smithi096 ceph-mon[124666]: pgmap v14697: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 941 KiB/s rd, 775 KiB/s wr, 13 op/s 2023-05-08T11:21:55.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:55 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:21:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27455.038846 secs 2023-05-08T11:21:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:21:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27455.038846 secs 2023-05-08T11:21:56.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:21:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27455.038846 secs 2023-05-08T11:21:56.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:21:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:57 smithi186 ceph-mon[126480]: pgmap v14698: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 813 KiB/s rd, 774 KiB/s wr, 9 op/s 2023-05-08T11:21:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:21:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:21:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:57 smithi133 ceph-mon[125939]: pgmap v14698: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 813 KiB/s rd, 774 KiB/s wr, 9 op/s 2023-05-08T11:21:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:21:57.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:21:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:57 smithi096 ceph-mon[124666]: pgmap v14698: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 813 KiB/s rd, 774 KiB/s wr, 9 op/s 2023-05-08T11:21:57.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:21:57.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:21:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:59 smithi186 ceph-mon[126480]: pgmap v14699: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 813 KiB/s rd, 774 KiB/s wr, 9 op/s 2023-05-08T11:21:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:21:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27458.195688 secs 2023-05-08T11:21:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:59 smithi133 ceph-mon[125939]: pgmap v14699: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 813 KiB/s rd, 774 KiB/s wr, 9 op/s 2023-05-08T11:21:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:21:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27458.195688 secs 2023-05-08T11:21:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:59 smithi096 ceph-mon[124666]: pgmap v14699: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 813 KiB/s rd, 774 KiB/s wr, 9 op/s 2023-05-08T11:21:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:21:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27458.195688 secs 2023-05-08T11:22:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27458.750858 secs 2023-05-08T11:22:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:00 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:22:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27458.750858 secs 2023-05-08T11:22:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:00 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:22:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27458.750858 secs 2023-05-08T11:22:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:00 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:22:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:01 smithi186 ceph-mon[126480]: pgmap v14700: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 996 KiB/s rd, 1.2 MiB/s wr, 15 op/s 2023-05-08T11:22:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27460.038980 secs 2023-05-08T11:22:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:22:01.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:22:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:01 smithi133 ceph-mon[125939]: pgmap v14700: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 996 KiB/s rd, 1.2 MiB/s wr, 15 op/s 2023-05-08T11:22:01.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27460.038980 secs 2023-05-08T11:22:01.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:22:01.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:22:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:01 smithi096 ceph-mon[124666]: pgmap v14700: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 996 KiB/s rd, 1.2 MiB/s wr, 15 op/s 2023-05-08T11:22:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27460.038980 secs 2023-05-08T11:22:01.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:22:01.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:22:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:03 smithi186 ceph-mon[126480]: pgmap v14701: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 794 KiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T11:22:03.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:03 smithi133 ceph-mon[125939]: pgmap v14701: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 794 KiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T11:22:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:03 smithi096 ceph-mon[124666]: pgmap v14701: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 794 KiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T11:22:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27463.195814 secs 2023-05-08T11:22:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27463.195814 secs 2023-05-08T11:22:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27463.195814 secs 2023-05-08T11:22:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27463.750997 secs 2023-05-08T11:22:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:05 smithi186 ceph-mon[126480]: pgmap v14702: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 18 op/s 2023-05-08T11:22:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:05 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:22:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27463.750997 secs 2023-05-08T11:22:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:05 smithi133 ceph-mon[125939]: pgmap v14702: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 18 op/s 2023-05-08T11:22:05.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:05 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:22:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27463.750997 secs 2023-05-08T11:22:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:05 smithi096 ceph-mon[124666]: pgmap v14702: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 18 op/s 2023-05-08T11:22:05.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:05 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:22:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:07 smithi186 ceph-mon[126480]: pgmap v14703: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 582 KiB/s rd, 833 KiB/s wr, 12 op/s 2023-05-08T11:22:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:07 smithi133 ceph-mon[125939]: pgmap v14703: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 582 KiB/s rd, 833 KiB/s wr, 12 op/s 2023-05-08T11:22:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:07 smithi096 ceph-mon[124666]: pgmap v14703: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 582 KiB/s rd, 833 KiB/s wr, 12 op/s 2023-05-08T11:22:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:08 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:22:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:08 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:22:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:08 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:22:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:09 smithi186 ceph-mon[126480]: pgmap v14704: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 582 KiB/s rd, 833 KiB/s wr, 12 op/s 2023-05-08T11:22:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:22:09.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:22:09.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27468.195947 secs 2023-05-08T11:22:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:09 smithi133 ceph-mon[125939]: pgmap v14704: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 582 KiB/s rd, 833 KiB/s wr, 12 op/s 2023-05-08T11:22:09.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:22:09.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:22:09.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27468.195947 secs 2023-05-08T11:22:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:09 smithi096 ceph-mon[124666]: pgmap v14704: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 582 KiB/s rd, 833 KiB/s wr, 12 op/s 2023-05-08T11:22:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:22:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:22:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27468.195947 secs 2023-05-08T11:22:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27468.751132 secs 2023-05-08T11:22:10.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:10 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:22:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27468.751132 secs 2023-05-08T11:22:10.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:10 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:22:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27468.751132 secs 2023-05-08T11:22:10.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:10 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:22:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:11 smithi186 ceph-mon[126480]: pgmap v14705: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 33 op/s 2023-05-08T11:22:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27470.039188 secs 2023-05-08T11:22:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:11 smithi186 ceph-mon[126480]: osdmap e996: 12 total, 12 up, 12 in 2023-05-08T11:22:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:11 smithi133 ceph-mon[125939]: pgmap v14705: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 33 op/s 2023-05-08T11:22:11.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27470.039188 secs 2023-05-08T11:22:11.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:11 smithi133 ceph-mon[125939]: osdmap e996: 12 total, 12 up, 12 in 2023-05-08T11:22:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:11 smithi096 ceph-mon[124666]: pgmap v14705: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 33 op/s 2023-05-08T11:22:11.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27470.039188 secs 2023-05-08T11:22:11.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:11 smithi096 ceph-mon[124666]: osdmap e996: 12 total, 12 up, 12 in 2023-05-08T11:22:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:13 smithi186 ceph-mon[126480]: pgmap v14707: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 32 op/s 2023-05-08T11:22:13.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:22:13.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:13 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:22:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:13 smithi133 ceph-mon[125939]: pgmap v14707: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 32 op/s 2023-05-08T11:22:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:22:13.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:13 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:22:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:13 smithi096 ceph-mon[124666]: pgmap v14707: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 32 op/s 2023-05-08T11:22:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:22:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:13 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:22:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27473.196089 secs 2023-05-08T11:22:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27473.196089 secs 2023-05-08T11:22:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27473.196089 secs 2023-05-08T11:22:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27473.751247 secs 2023-05-08T11:22:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:15 smithi186 ceph-mon[126480]: pgmap v14708: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.4 MiB/s wr, 31 op/s 2023-05-08T11:22:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:15 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:22:15.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27473.751247 secs 2023-05-08T11:22:15.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:15 smithi133 ceph-mon[125939]: pgmap v14708: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.4 MiB/s wr, 31 op/s 2023-05-08T11:22:15.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:15 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:22:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27473.751247 secs 2023-05-08T11:22:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:15 smithi096 ceph-mon[124666]: pgmap v14708: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.4 MiB/s wr, 31 op/s 2023-05-08T11:22:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:15 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:22:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27475.039328 secs 2023-05-08T11:22:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27475.039328 secs 2023-05-08T11:22:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27475.039328 secs 2023-05-08T11:22:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:17 smithi186 ceph-mon[126480]: pgmap v14709: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.4 MiB/s wr, 31 op/s 2023-05-08T11:22:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:17 smithi133 ceph-mon[125939]: pgmap v14709: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.4 MiB/s wr, 31 op/s 2023-05-08T11:22:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:17 smithi096 ceph-mon[124666]: pgmap v14709: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.4 MiB/s wr, 31 op/s 2023-05-08T11:22:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:19 smithi186 ceph-mon[126480]: pgmap v14710: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.4 MiB/s wr, 31 op/s 2023-05-08T11:22:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27478.196242 secs 2023-05-08T11:22:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:19 smithi133 ceph-mon[125939]: pgmap v14710: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.4 MiB/s wr, 31 op/s 2023-05-08T11:22:19.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27478.196242 secs 2023-05-08T11:22:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:19 smithi096 ceph-mon[124666]: pgmap v14710: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.4 MiB/s wr, 31 op/s 2023-05-08T11:22:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27478.196242 secs 2023-05-08T11:22:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27478.751385 secs 2023-05-08T11:22:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:20 smithi186 ceph-mon[126480]: osdmap e997: 12 total, 12 up, 12 in 2023-05-08T11:22:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27478.751385 secs 2023-05-08T11:22:20.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:20 smithi133 ceph-mon[125939]: osdmap e997: 12 total, 12 up, 12 in 2023-05-08T11:22:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27478.751385 secs 2023-05-08T11:22:20.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:20 smithi096 ceph-mon[124666]: osdmap e997: 12 total, 12 up, 12 in 2023-05-08T11:22:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:21 smithi133 ceph-mon[125939]: pgmap v14712: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 681 KiB/s wr, 12 op/s 2023-05-08T11:22:21.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27480.039462 secs 2023-05-08T11:22:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:21 smithi096 ceph-mon[124666]: pgmap v14712: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 681 KiB/s wr, 12 op/s 2023-05-08T11:22:21.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27480.039462 secs 2023-05-08T11:22:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:21 smithi186 ceph-mon[126480]: pgmap v14712: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 681 KiB/s wr, 12 op/s 2023-05-08T11:22:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27480.039462 secs 2023-05-08T11:22:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:23 smithi133 ceph-mon[125939]: pgmap v14713: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 959 KiB/s rd, 616 KiB/s wr, 11 op/s 2023-05-08T11:22:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:23 smithi096 ceph-mon[124666]: pgmap v14713: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 959 KiB/s rd, 616 KiB/s wr, 11 op/s 2023-05-08T11:22:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:23 smithi186 ceph-mon[126480]: pgmap v14713: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 959 KiB/s rd, 616 KiB/s wr, 11 op/s 2023-05-08T11:22:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27483.196347 secs 2023-05-08T11:22:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27483.196347 secs 2023-05-08T11:22:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27483.196347 secs 2023-05-08T11:22:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27483.751532 secs 2023-05-08T11:22:25.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:25 smithi133 ceph-mon[125939]: pgmap v14714: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 398 KiB/s wr, 8 op/s 2023-05-08T11:22:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27483.751532 secs 2023-05-08T11:22:25.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:25 smithi096 ceph-mon[124666]: pgmap v14714: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 398 KiB/s wr, 8 op/s 2023-05-08T11:22:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27483.751532 secs 2023-05-08T11:22:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:25 smithi186 ceph-mon[126480]: pgmap v14714: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 398 KiB/s wr, 8 op/s 2023-05-08T11:22:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27485.039588 secs 2023-05-08T11:22:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27485.039588 secs 2023-05-08T11:22:26.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27485.039588 secs 2023-05-08T11:22:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:27 smithi133 ceph-mon[125939]: pgmap v14715: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 398 KiB/s wr, 8 op/s 2023-05-08T11:22:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:27 smithi096 ceph-mon[124666]: pgmap v14715: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 398 KiB/s wr, 8 op/s 2023-05-08T11:22:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:27 smithi186 ceph-mon[126480]: pgmap v14715: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 398 KiB/s wr, 8 op/s 2023-05-08T11:22:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:29 smithi133 ceph-mon[125939]: pgmap v14716: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 398 KiB/s wr, 8 op/s 2023-05-08T11:22:29.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27488.196470 secs 2023-05-08T11:22:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:29 smithi096 ceph-mon[124666]: pgmap v14716: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 398 KiB/s wr, 8 op/s 2023-05-08T11:22:29.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27488.196470 secs 2023-05-08T11:22:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:29 smithi186 ceph-mon[126480]: pgmap v14716: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 398 KiB/s wr, 8 op/s 2023-05-08T11:22:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27488.196470 secs 2023-05-08T11:22:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27488.751645 secs 2023-05-08T11:22:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27488.751645 secs 2023-05-08T11:22:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27488.751645 secs 2023-05-08T11:22:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:31 smithi133 ceph-mon[125939]: pgmap v14717: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 222 KiB/s wr, 7 op/s 2023-05-08T11:22:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27490.039732 secs 2023-05-08T11:22:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:31 smithi096 ceph-mon[124666]: pgmap v14717: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 222 KiB/s wr, 7 op/s 2023-05-08T11:22:31.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27490.039732 secs 2023-05-08T11:22:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:31 smithi186 ceph-mon[126480]: pgmap v14717: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 222 KiB/s wr, 7 op/s 2023-05-08T11:22:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27490.039732 secs 2023-05-08T11:22:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:33 smithi133 ceph-mon[125939]: pgmap v14718: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 186 KiB/s wr, 6 op/s 2023-05-08T11:22:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:33 smithi096 ceph-mon[124666]: pgmap v14718: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 186 KiB/s wr, 6 op/s 2023-05-08T11:22:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:33 smithi186 ceph-mon[126480]: pgmap v14718: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 186 KiB/s wr, 6 op/s 2023-05-08T11:22:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27493.196551 secs 2023-05-08T11:22:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27493.196551 secs 2023-05-08T11:22:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27493.196551 secs 2023-05-08T11:22:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27493.751762 secs 2023-05-08T11:22:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:35 smithi133 ceph-mon[125939]: pgmap v14719: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 186 KiB/s wr, 8 op/s 2023-05-08T11:22:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27493.751762 secs 2023-05-08T11:22:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:35 smithi096 ceph-mon[124666]: pgmap v14719: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 186 KiB/s wr, 8 op/s 2023-05-08T11:22:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27493.751762 secs 2023-05-08T11:22:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:35 smithi186 ceph-mon[126480]: pgmap v14719: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 186 KiB/s wr, 8 op/s 2023-05-08T11:22:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27495.039829 secs 2023-05-08T11:22:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27495.039829 secs 2023-05-08T11:22:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27495.039829 secs 2023-05-08T11:22:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:37 smithi133 ceph-mon[125939]: pgmap v14720: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 186 KiB/s wr, 5 op/s 2023-05-08T11:22:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:37 smithi096 ceph-mon[124666]: pgmap v14720: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 186 KiB/s wr, 5 op/s 2023-05-08T11:22:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:37 smithi186 ceph-mon[126480]: pgmap v14720: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 186 KiB/s wr, 5 op/s 2023-05-08T11:22:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:39 smithi133 ceph-mon[125939]: pgmap v14721: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 186 KiB/s wr, 5 op/s 2023-05-08T11:22:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27498.196666 secs 2023-05-08T11:22:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:39 smithi096 ceph-mon[124666]: pgmap v14721: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 186 KiB/s wr, 5 op/s 2023-05-08T11:22:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27498.196666 secs 2023-05-08T11:22:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:39 smithi186 ceph-mon[126480]: pgmap v14721: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 186 KiB/s wr, 5 op/s 2023-05-08T11:22:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27498.196666 secs 2023-05-08T11:22:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27498.751874 secs 2023-05-08T11:22:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27498.751874 secs 2023-05-08T11:22:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27498.751874 secs 2023-05-08T11:22:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:41 smithi133 ceph-mon[125939]: pgmap v14722: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 249 KiB/s wr, 8 op/s 2023-05-08T11:22:41.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27500.039982 secs 2023-05-08T11:22:41.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:41 smithi096 ceph-mon[124666]: pgmap v14722: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 249 KiB/s wr, 8 op/s 2023-05-08T11:22:41.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27500.039982 secs 2023-05-08T11:22:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:41 smithi186 ceph-mon[126480]: pgmap v14722: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 249 KiB/s wr, 8 op/s 2023-05-08T11:22:41.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27500.039982 secs 2023-05-08T11:22:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:22:42.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:22:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:22:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:43 smithi133 ceph-mon[125939]: pgmap v14723: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 63 KiB/s wr, 5 op/s 2023-05-08T11:22:43.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:43 smithi096 ceph-mon[124666]: pgmap v14723: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 63 KiB/s wr, 5 op/s 2023-05-08T11:22:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:43 smithi186 ceph-mon[126480]: pgmap v14723: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 63 KiB/s wr, 5 op/s 2023-05-08T11:22:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27503.196778 secs 2023-05-08T11:22:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27503.196778 secs 2023-05-08T11:22:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27503.196778 secs 2023-05-08T11:22:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27503.752024 secs 2023-05-08T11:22:45.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:45 smithi133 ceph-mon[125939]: pgmap v14724: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 130 KiB/s wr, 8 op/s 2023-05-08T11:22:45.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:22:45.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:22:45.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:22:45.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:22:45.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:22:45.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:22:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27503.752024 secs 2023-05-08T11:22:45.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:45 smithi096 ceph-mon[124666]: pgmap v14724: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 130 KiB/s wr, 8 op/s 2023-05-08T11:22:45.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:22:45.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:22:45.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:22:45.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:22:45.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:22:45.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:22:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27503.752024 secs 2023-05-08T11:22:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:45 smithi186 ceph-mon[126480]: pgmap v14724: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 130 KiB/s wr, 8 op/s 2023-05-08T11:22:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:22:45.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:22:45.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:22:45.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:22:45.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:22:45.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:22:47.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:46 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:22:47.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:46 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:22:47.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:46 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:22:47.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:46 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:22:47.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:46 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:22:47.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:46 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:22:47.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:46 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi133 to 181.1M 2023-05-08T11:22:47.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:46 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi133 to 189914730: error parsing value: Value '189914730' is below minimum 939524096 2023-05-08T11:22:47.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:46 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:22:47.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:46 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:22:47.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:46 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:22:47.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:46 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:22:47.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:46 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:22:47.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:46 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:22:47.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:46 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:22:47.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:46 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:22:47.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:46 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:22:47.244 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:46 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:22:47.244 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:46 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:22:47.244 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:46 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:22:47.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:46 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:22:47.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:46 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:22:47.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:46 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:22:47.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:46 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:22:47.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:46 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:22:47.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:46 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:22:47.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:46 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi133 to 181.1M 2023-05-08T11:22:47.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:46 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi133 to 189914730: error parsing value: Value '189914730' is below minimum 939524096 2023-05-08T11:22:47.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:46 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:22:47.259 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:46 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:22:47.259 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:46 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:22:47.259 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:46 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:22:47.260 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:46 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:22:47.260 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:46 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:22:47.260 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:46 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:22:47.261 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:46 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:22:47.261 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:46 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:22:47.261 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:46 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:22:47.261 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:46 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:22:47.262 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:46 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:22:47.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:46 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:22:47.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:46 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:22:47.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:46 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:22:47.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:46 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:22:47.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:46 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:22:47.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:46 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:22:47.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:46 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi133 to 181.1M 2023-05-08T11:22:47.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:46 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi133 to 189914730: error parsing value: Value '189914730' is below minimum 939524096 2023-05-08T11:22:47.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:46 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:22:47.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:46 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:22:47.373 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:46 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:22:47.373 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:46 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:22:47.373 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:46 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:22:47.373 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:46 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:22:47.374 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:46 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:22:47.374 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:46 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:22:47.374 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:46 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:22:47.374 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:46 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:22:47.375 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:46 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:22:47.375 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:46 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:22:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:47 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi186 to 172.6M 2023-05-08T11:22:48.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:47 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi186 to 181073563: error parsing value: Value '181073563' is below minimum 939524096 2023-05-08T11:22:48.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:47 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:22:48.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:47 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T11:22:48.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:47 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T11:22:48.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:47 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:22:48.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:47 smithi133 ceph-mon[125939]: pgmap v14725: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 130 KiB/s wr, 5 op/s 2023-05-08T11:22:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:47 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi186 to 172.6M 2023-05-08T11:22:48.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:47 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi186 to 181073563: error parsing value: Value '181073563' is below minimum 939524096 2023-05-08T11:22:48.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:47 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:22:48.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:47 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T11:22:48.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:47 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T11:22:48.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:47 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:22:48.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:47 smithi096 ceph-mon[124666]: pgmap v14725: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 130 KiB/s wr, 5 op/s 2023-05-08T11:22:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:47 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi186 to 172.6M 2023-05-08T11:22:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:47 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi186 to 181073563: error parsing value: Value '181073563' is below minimum 939524096 2023-05-08T11:22:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:47 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:22:48.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:47 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T11:22:48.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:47 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T11:22:48.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:47 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:22:48.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:47 smithi186 ceph-mon[126480]: pgmap v14725: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 130 KiB/s wr, 5 op/s 2023-05-08T11:22:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:22:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:22:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:22:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:49 smithi133 ceph-mon[125939]: pgmap v14726: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 130 KiB/s wr, 5 op/s 2023-05-08T11:22:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27508.196894 secs 2023-05-08T11:22:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:22:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:22:50.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:22:50.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27508.752142 secs 2023-05-08T11:22:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:49 smithi096 ceph-mon[124666]: pgmap v14726: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 130 KiB/s wr, 5 op/s 2023-05-08T11:22:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27508.196894 secs 2023-05-08T11:22:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:22:50.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:22:50.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:22:50.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27508.752142 secs 2023-05-08T11:22:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:49 smithi186 ceph-mon[126480]: pgmap v14726: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 130 KiB/s wr, 5 op/s 2023-05-08T11:22:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27508.196894 secs 2023-05-08T11:22:50.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:22:50.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:22:50.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:22:50.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27508.752142 secs 2023-05-08T11:22:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:51 smithi133 ceph-mon[125939]: pgmap v14727: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 166 KiB/s wr, 9 op/s 2023-05-08T11:22:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:51 smithi096 ceph-mon[124666]: pgmap v14727: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 166 KiB/s wr, 9 op/s 2023-05-08T11:22:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:51 smithi186 ceph-mon[126480]: pgmap v14727: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 166 KiB/s wr, 9 op/s 2023-05-08T11:22:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:53 smithi186 ceph-mon[126480]: pgmap v14728: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 103 KiB/s wr, 7 op/s 2023-05-08T11:22:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:53 smithi133 ceph-mon[125939]: pgmap v14728: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 103 KiB/s wr, 7 op/s 2023-05-08T11:22:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:53 smithi096 ceph-mon[124666]: pgmap v14728: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 103 KiB/s wr, 7 op/s 2023-05-08T11:22:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27513.197006 secs 2023-05-08T11:22:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27513.197006 secs 2023-05-08T11:22:54.759 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27513.197006 secs 2023-05-08T11:22:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:55 smithi186 ceph-mon[126480]: pgmap v14729: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 13 op/s 2023-05-08T11:22:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:55 smithi133 ceph-mon[125939]: pgmap v14729: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 13 op/s 2023-05-08T11:22:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:55 smithi096 ceph-mon[124666]: pgmap v14729: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 13 op/s 2023-05-08T11:22:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27515.040341 secs 2023-05-08T11:22:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:22:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27515.040341 secs 2023-05-08T11:22:56.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:22:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27515.040341 secs 2023-05-08T11:22:56.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:22:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:57 smithi186 ceph-mon[126480]: pgmap v14730: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1003 KiB/s rd, 1002 KiB/s wr, 10 op/s 2023-05-08T11:22:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:22:57.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:22:57.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:22:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:57 smithi133 ceph-mon[125939]: pgmap v14730: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1003 KiB/s rd, 1002 KiB/s wr, 10 op/s 2023-05-08T11:22:57.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:22:57.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:22:57.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:22:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:57 smithi096 ceph-mon[124666]: pgmap v14730: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1003 KiB/s rd, 1002 KiB/s wr, 10 op/s 2023-05-08T11:22:57.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:22:57.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:22:57.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:22:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:59 smithi186 ceph-mon[126480]: pgmap v14731: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1003 KiB/s rd, 1002 KiB/s wr, 10 op/s 2023-05-08T11:22:59.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:22:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27518.197129 secs 2023-05-08T11:22:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:59 smithi133 ceph-mon[125939]: pgmap v14731: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1003 KiB/s rd, 1002 KiB/s wr, 10 op/s 2023-05-08T11:22:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:22:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27518.197129 secs 2023-05-08T11:22:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:59 smithi096 ceph-mon[124666]: pgmap v14731: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1003 KiB/s rd, 1002 KiB/s wr, 10 op/s 2023-05-08T11:22:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:22:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27518.197129 secs 2023-05-08T11:23:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27518.752332 secs 2023-05-08T11:23:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27518.752332 secs 2023-05-08T11:23:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27518.752332 secs 2023-05-08T11:23:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:01 smithi186 ceph-mon[126480]: pgmap v14732: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 15 op/s 2023-05-08T11:23:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27520.040487 secs 2023-05-08T11:23:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:01 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:23:01.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:23:01.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:23:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:01 smithi133 ceph-mon[125939]: pgmap v14732: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 15 op/s 2023-05-08T11:23:01.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27520.040487 secs 2023-05-08T11:23:01.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:01 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:23:01.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:23:01.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:23:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:01 smithi096 ceph-mon[124666]: pgmap v14732: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 15 op/s 2023-05-08T11:23:01.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27520.040487 secs 2023-05-08T11:23:01.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:01 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:23:01.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:23:01.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:23:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:03 smithi186 ceph-mon[126480]: pgmap v14733: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T11:23:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:03 smithi133 ceph-mon[125939]: pgmap v14733: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T11:23:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:03 smithi096 ceph-mon[124666]: pgmap v14733: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T11:23:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27523.197225 secs 2023-05-08T11:23:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27523.197225 secs 2023-05-08T11:23:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27523.197225 secs 2023-05-08T11:23:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27523.752448 secs 2023-05-08T11:23:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:05 smithi186 ceph-mon[126480]: pgmap v14734: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 18 op/s 2023-05-08T11:23:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27523.752448 secs 2023-05-08T11:23:05.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:05 smithi133 ceph-mon[125939]: pgmap v14734: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 18 op/s 2023-05-08T11:23:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27523.752448 secs 2023-05-08T11:23:05.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:05 smithi096 ceph-mon[124666]: pgmap v14734: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 18 op/s 2023-05-08T11:23:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:07 smithi186 ceph-mon[126480]: pgmap v14735: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1009 KiB/s rd, 896 KiB/s wr, 12 op/s 2023-05-08T11:23:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:07 smithi133 ceph-mon[125939]: pgmap v14735: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1009 KiB/s rd, 896 KiB/s wr, 12 op/s 2023-05-08T11:23:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:07 smithi096 ceph-mon[124666]: pgmap v14735: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1009 KiB/s rd, 896 KiB/s wr, 12 op/s 2023-05-08T11:23:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:08 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:23:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:08 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:23:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:08 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:23:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:09 smithi186 ceph-mon[126480]: pgmap v14736: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1009 KiB/s rd, 896 KiB/s wr, 12 op/s 2023-05-08T11:23:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:09 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:23:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:23:09.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:23:09.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27528.197368 secs 2023-05-08T11:23:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:09 smithi133 ceph-mon[125939]: pgmap v14736: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1009 KiB/s rd, 896 KiB/s wr, 12 op/s 2023-05-08T11:23:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:09 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:23:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:23:09.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:23:09.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27528.197368 secs 2023-05-08T11:23:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:09 smithi096 ceph-mon[124666]: pgmap v14736: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1009 KiB/s rd, 896 KiB/s wr, 12 op/s 2023-05-08T11:23:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:09 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:23:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:23:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:23:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27528.197368 secs 2023-05-08T11:23:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:11 smithi133 ceph-mon[125939]: pgmap v14737: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 28 op/s 2023-05-08T11:23:11.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27530.040749 secs 2023-05-08T11:23:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:11 smithi096 ceph-mon[124666]: pgmap v14737: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 28 op/s 2023-05-08T11:23:11.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27530.040749 secs 2023-05-08T11:23:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:11 smithi186 ceph-mon[126480]: pgmap v14737: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 28 op/s 2023-05-08T11:23:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27530.040749 secs 2023-05-08T11:23:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:12 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:23:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:12 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:23:12.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:12 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:23:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:23:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:23:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:13 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:23:13.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:13 smithi133 ceph-mon[125939]: pgmap v14738: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 986 KiB/s rd, 894 KiB/s wr, 22 op/s 2023-05-08T11:23:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:23:13.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:23:13.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:13 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:23:13.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:13 smithi096 ceph-mon[124666]: pgmap v14738: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 986 KiB/s rd, 894 KiB/s wr, 22 op/s 2023-05-08T11:23:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:23:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:23:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:13 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:23:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:13 smithi186 ceph-mon[126480]: pgmap v14738: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 986 KiB/s rd, 894 KiB/s wr, 22 op/s 2023-05-08T11:23:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27533.197491 secs 2023-05-08T11:23:14.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27533.197491 secs 2023-05-08T11:23:14.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27533.197491 secs 2023-05-08T11:23:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27533.752663 secs 2023-05-08T11:23:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:15 smithi186 ceph-mon[126480]: pgmap v14739: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 30 op/s 2023-05-08T11:23:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27533.752663 secs 2023-05-08T11:23:15.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:15 smithi133 ceph-mon[125939]: pgmap v14739: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 30 op/s 2023-05-08T11:23:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27533.752663 secs 2023-05-08T11:23:15.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:15 smithi096 ceph-mon[124666]: pgmap v14739: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 30 op/s 2023-05-08T11:23:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27535.040863 secs 2023-05-08T11:23:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:16 smithi186 ceph-mon[126480]: osdmap e998: 12 total, 12 up, 12 in 2023-05-08T11:23:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27535.040863 secs 2023-05-08T11:23:16.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:16 smithi133 ceph-mon[125939]: osdmap e998: 12 total, 12 up, 12 in 2023-05-08T11:23:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27535.040863 secs 2023-05-08T11:23:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:16 smithi096 ceph-mon[124666]: osdmap e998: 12 total, 12 up, 12 in 2023-05-08T11:23:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:17 smithi186 ceph-mon[126480]: pgmap v14741: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 962 KiB/s wr, 28 op/s 2023-05-08T11:23:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:17 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:23:17.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:17 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:23:17.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:17 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:23:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:17 smithi133 ceph-mon[125939]: pgmap v14741: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 962 KiB/s wr, 28 op/s 2023-05-08T11:23:17.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:17 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:23:17.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:17 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:23:17.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:17 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:23:17.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:17 smithi096 ceph-mon[124666]: pgmap v14741: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 962 KiB/s wr, 28 op/s 2023-05-08T11:23:17.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:17 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:23:17.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:17 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:23:17.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:17 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:23:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:19 smithi186 ceph-mon[126480]: pgmap v14742: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 962 KiB/s wr, 28 op/s 2023-05-08T11:23:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27538.197610 secs 2023-05-08T11:23:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:19 smithi133 ceph-mon[125939]: pgmap v14742: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 962 KiB/s wr, 28 op/s 2023-05-08T11:23:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27538.197610 secs 2023-05-08T11:23:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:19 smithi096 ceph-mon[124666]: pgmap v14742: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 962 KiB/s wr, 28 op/s 2023-05-08T11:23:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27538.197610 secs 2023-05-08T11:23:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27538.752796 secs 2023-05-08T11:23:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27538.752796 secs 2023-05-08T11:23:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27538.752796 secs 2023-05-08T11:23:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:21 smithi186 ceph-mon[126480]: pgmap v14743: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 785 KiB/s rd, 564 KiB/s wr, 13 op/s 2023-05-08T11:23:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27540.040975 secs 2023-05-08T11:23:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:21 smithi133 ceph-mon[125939]: pgmap v14743: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 785 KiB/s rd, 564 KiB/s wr, 13 op/s 2023-05-08T11:23:21.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27540.040975 secs 2023-05-08T11:23:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:21 smithi096 ceph-mon[124666]: pgmap v14743: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 785 KiB/s rd, 564 KiB/s wr, 13 op/s 2023-05-08T11:23:21.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27540.040975 secs 2023-05-08T11:23:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:23 smithi186 ceph-mon[126480]: pgmap v14744: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 785 KiB/s rd, 564 KiB/s wr, 12 op/s 2023-05-08T11:23:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:23 smithi133 ceph-mon[125939]: pgmap v14744: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 785 KiB/s rd, 564 KiB/s wr, 12 op/s 2023-05-08T11:23:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:23 smithi096 ceph-mon[124666]: pgmap v14744: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 785 KiB/s rd, 564 KiB/s wr, 12 op/s 2023-05-08T11:23:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27543.197725 secs 2023-05-08T11:23:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27543.197725 secs 2023-05-08T11:23:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27543.197725 secs 2023-05-08T11:23:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27543.752912 secs 2023-05-08T11:23:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:25 smithi186 ceph-mon[126480]: pgmap v14745: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 97 KiB/s wr, 7 op/s 2023-05-08T11:23:25.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:25 smithi186 ceph-mon[126480]: osdmap e999: 12 total, 12 up, 12 in 2023-05-08T11:23:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27543.752912 secs 2023-05-08T11:23:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:25 smithi133 ceph-mon[125939]: pgmap v14745: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 97 KiB/s wr, 7 op/s 2023-05-08T11:23:25.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:25 smithi133 ceph-mon[125939]: osdmap e999: 12 total, 12 up, 12 in 2023-05-08T11:23:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27543.752912 secs 2023-05-08T11:23:25.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:25 smithi096 ceph-mon[124666]: pgmap v14745: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 97 KiB/s wr, 7 op/s 2023-05-08T11:23:25.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:25 smithi096 ceph-mon[124666]: osdmap e999: 12 total, 12 up, 12 in 2023-05-08T11:23:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27545.041035 secs 2023-05-08T11:23:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27545.041035 secs 2023-05-08T11:23:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27545.041035 secs 2023-05-08T11:23:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:27 smithi186 ceph-mon[126480]: pgmap v14747: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 97 KiB/s wr, 7 op/s 2023-05-08T11:23:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:27 smithi133 ceph-mon[125939]: pgmap v14747: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 97 KiB/s wr, 7 op/s 2023-05-08T11:23:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:27 smithi096 ceph-mon[124666]: pgmap v14747: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 97 KiB/s wr, 7 op/s 2023-05-08T11:23:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:29 smithi186 ceph-mon[126480]: pgmap v14748: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 97 KiB/s wr, 7 op/s 2023-05-08T11:23:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27548.197845 secs 2023-05-08T11:23:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:29 smithi133 ceph-mon[125939]: pgmap v14748: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 97 KiB/s wr, 7 op/s 2023-05-08T11:23:29.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27548.197845 secs 2023-05-08T11:23:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:29 smithi096 ceph-mon[124666]: pgmap v14748: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 97 KiB/s wr, 7 op/s 2023-05-08T11:23:29.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27548.197845 secs 2023-05-08T11:23:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27548.753058 secs 2023-05-08T11:23:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27548.753058 secs 2023-05-08T11:23:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27548.753058 secs 2023-05-08T11:23:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:31 smithi186 ceph-mon[126480]: pgmap v14749: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 96 KiB/s wr, 6 op/s 2023-05-08T11:23:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27550.041148 secs 2023-05-08T11:23:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:31 smithi133 ceph-mon[125939]: pgmap v14749: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 96 KiB/s wr, 6 op/s 2023-05-08T11:23:31.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27550.041148 secs 2023-05-08T11:23:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:31 smithi096 ceph-mon[124666]: pgmap v14749: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 96 KiB/s wr, 6 op/s 2023-05-08T11:23:31.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27550.041148 secs 2023-05-08T11:23:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:33 smithi186 ceph-mon[126480]: pgmap v14750: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 96 KiB/s wr, 6 op/s 2023-05-08T11:23:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:33 smithi133 ceph-mon[125939]: pgmap v14750: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 96 KiB/s wr, 6 op/s 2023-05-08T11:23:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:33 smithi096 ceph-mon[124666]: pgmap v14750: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 96 KiB/s wr, 6 op/s 2023-05-08T11:23:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27553.197978 secs 2023-05-08T11:23:34.841 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27553.197978 secs 2023-05-08T11:23:34.841 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27553.197978 secs 2023-05-08T11:23:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27553.753169 secs 2023-05-08T11:23:35.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:35 smithi186 ceph-mon[126480]: pgmap v14751: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T11:23:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27553.753169 secs 2023-05-08T11:23:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:35 smithi133 ceph-mon[125939]: pgmap v14751: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T11:23:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27553.753169 secs 2023-05-08T11:23:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:35 smithi096 ceph-mon[124666]: pgmap v14751: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T11:23:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27555.041281 secs 2023-05-08T11:23:36.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27555.041281 secs 2023-05-08T11:23:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27555.041281 secs 2023-05-08T11:23:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:37 smithi133 ceph-mon[125939]: pgmap v14752: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-05-08T11:23:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:37 smithi096 ceph-mon[124666]: pgmap v14752: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-05-08T11:23:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:37 smithi186 ceph-mon[126480]: pgmap v14752: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-05-08T11:23:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:39 smithi133 ceph-mon[125939]: pgmap v14753: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T11:23:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27558.198098 secs 2023-05-08T11:23:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:39 smithi096 ceph-mon[124666]: pgmap v14753: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T11:23:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27558.198098 secs 2023-05-08T11:23:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:39 smithi186 ceph-mon[126480]: pgmap v14753: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T11:23:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27558.198098 secs 2023-05-08T11:23:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27558.753269 secs 2023-05-08T11:23:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27558.753269 secs 2023-05-08T11:23:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27558.753269 secs 2023-05-08T11:23:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:41 smithi133 ceph-mon[125939]: pgmap v14754: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T11:23:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27560.041446 secs 2023-05-08T11:23:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:41 smithi096 ceph-mon[124666]: pgmap v14754: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T11:23:41.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27560.041446 secs 2023-05-08T11:23:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:41 smithi186 ceph-mon[126480]: pgmap v14754: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T11:23:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27560.041446 secs 2023-05-08T11:23:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:43 smithi133 ceph-mon[125939]: pgmap v14755: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T11:23:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:43 smithi096 ceph-mon[124666]: pgmap v14755: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T11:23:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:43 smithi186 ceph-mon[126480]: pgmap v14755: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T11:23:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27563.198224 secs 2023-05-08T11:23:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27563.198224 secs 2023-05-08T11:23:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27563.198224 secs 2023-05-08T11:23:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27563.753335 secs 2023-05-08T11:23:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:45 smithi133 ceph-mon[125939]: pgmap v14756: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 90 KiB/s wr, 8 op/s 2023-05-08T11:23:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27563.753335 secs 2023-05-08T11:23:45.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:45 smithi096 ceph-mon[124666]: pgmap v14756: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 90 KiB/s wr, 8 op/s 2023-05-08T11:23:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27563.753335 secs 2023-05-08T11:23:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:45 smithi186 ceph-mon[126480]: pgmap v14756: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 90 KiB/s wr, 8 op/s 2023-05-08T11:23:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:46 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:23:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:46 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:23:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:46 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:23:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:47 smithi133 ceph-mon[125939]: pgmap v14757: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 90 KiB/s wr, 5 op/s 2023-05-08T11:23:47.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:47 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:23:47.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:47 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:23:47.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:47 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:23:47.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:47 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:23:47.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:47 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T11:23:47.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:47 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T11:23:47.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:47 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:23:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:47 smithi096 ceph-mon[124666]: pgmap v14757: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 90 KiB/s wr, 5 op/s 2023-05-08T11:23:47.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:47 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:23:47.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:47 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:23:47.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:47 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:23:47.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:47 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:23:47.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:47 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T11:23:47.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:47 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T11:23:47.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:47 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:23:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:47 smithi186 ceph-mon[126480]: pgmap v14757: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 90 KiB/s wr, 5 op/s 2023-05-08T11:23:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:47 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:23:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:47 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:23:47.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:47 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:23:47.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:47 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:23:47.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:47 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T11:23:47.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:47 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T11:23:47.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:47 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:23:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:23:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:23:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:23:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:49 smithi133 ceph-mon[125939]: pgmap v14758: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 90 KiB/s wr, 5 op/s 2023-05-08T11:23:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:23:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:23:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:23:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27568.198364 secs 2023-05-08T11:23:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:49 smithi096 ceph-mon[124666]: pgmap v14758: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 90 KiB/s wr, 5 op/s 2023-05-08T11:23:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:23:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:23:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:23:49.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27568.198364 secs 2023-05-08T11:23:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:49 smithi186 ceph-mon[126480]: pgmap v14758: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 90 KiB/s wr, 5 op/s 2023-05-08T11:23:49.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:23:49.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:23:49.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:23:49.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27568.198364 secs 2023-05-08T11:23:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27568.753446 secs 2023-05-08T11:23:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27568.753446 secs 2023-05-08T11:23:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27568.753446 secs 2023-05-08T11:23:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:51 smithi133 ceph-mon[125939]: pgmap v14759: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 103 KiB/s wr, 9 op/s 2023-05-08T11:23:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:51 smithi096 ceph-mon[124666]: pgmap v14759: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 103 KiB/s wr, 9 op/s 2023-05-08T11:23:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:51 smithi186 ceph-mon[126480]: pgmap v14759: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 103 KiB/s wr, 9 op/s 2023-05-08T11:23:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:53 smithi133 ceph-mon[125939]: pgmap v14760: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 463 KiB/s rd, 103 KiB/s wr, 7 op/s 2023-05-08T11:23:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:53 smithi096 ceph-mon[124666]: pgmap v14760: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 463 KiB/s rd, 103 KiB/s wr, 7 op/s 2023-05-08T11:23:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:53 smithi186 ceph-mon[126480]: pgmap v14760: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 463 KiB/s rd, 103 KiB/s wr, 7 op/s 2023-05-08T11:23:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27573.198489 secs 2023-05-08T11:23:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27573.198489 secs 2023-05-08T11:23:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27573.198489 secs 2023-05-08T11:23:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:55 smithi133 ceph-mon[125939]: pgmap v14761: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1021 KiB/s rd, 775 KiB/s wr, 12 op/s 2023-05-08T11:23:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:55 smithi096 ceph-mon[124666]: pgmap v14761: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1021 KiB/s rd, 775 KiB/s wr, 12 op/s 2023-05-08T11:23:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:55 smithi186 ceph-mon[126480]: pgmap v14761: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1021 KiB/s rd, 775 KiB/s wr, 12 op/s 2023-05-08T11:23:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27575.041805 secs 2023-05-08T11:23:56.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:23:56.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27575.041805 secs 2023-05-08T11:23:56.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:23:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27575.041805 secs 2023-05-08T11:23:56.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:23:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:57 smithi133 ceph-mon[125939]: pgmap v14762: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 752 KiB/s rd, 686 KiB/s wr, 9 op/s 2023-05-08T11:23:57.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:23:57.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:23:57.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:23:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:57 smithi096 ceph-mon[124666]: pgmap v14762: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 752 KiB/s rd, 686 KiB/s wr, 9 op/s 2023-05-08T11:23:57.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:23:57.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:23:57.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:23:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:57 smithi186 ceph-mon[126480]: pgmap v14762: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 752 KiB/s rd, 686 KiB/s wr, 9 op/s 2023-05-08T11:23:57.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:23:57.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:23:57.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:23:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:59 smithi133 ceph-mon[125939]: pgmap v14763: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 752 KiB/s rd, 686 KiB/s wr, 9 op/s 2023-05-08T11:23:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:23:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27578.198628 secs 2023-05-08T11:23:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:59 smithi096 ceph-mon[124666]: pgmap v14763: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 752 KiB/s rd, 686 KiB/s wr, 9 op/s 2023-05-08T11:23:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:23:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27578.198628 secs 2023-05-08T11:23:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:59 smithi186 ceph-mon[126480]: pgmap v14763: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 752 KiB/s rd, 686 KiB/s wr, 9 op/s 2023-05-08T11:23:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:23:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27578.198628 secs 2023-05-08T11:24:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27578.753642 secs 2023-05-08T11:24:00.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27578.753642 secs 2023-05-08T11:24:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27578.753642 secs 2023-05-08T11:24:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:01 smithi133 ceph-mon[125939]: pgmap v14764: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1024 KiB/s wr, 15 op/s 2023-05-08T11:24:01.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27580.041868 secs 2023-05-08T11:24:01.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:01 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:24:01.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:24:01.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:24:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:01 smithi096 ceph-mon[124666]: pgmap v14764: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1024 KiB/s wr, 15 op/s 2023-05-08T11:24:01.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27580.041868 secs 2023-05-08T11:24:01.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:01 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:24:01.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:24:01.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:24:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:01 smithi186 ceph-mon[126480]: pgmap v14764: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1024 KiB/s wr, 15 op/s 2023-05-08T11:24:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27580.041868 secs 2023-05-08T11:24:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:01 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:24:01.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:24:01.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:24:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:03 smithi133 ceph-mon[125939]: pgmap v14765: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1010 KiB/s wr, 11 op/s 2023-05-08T11:24:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:03 smithi096 ceph-mon[124666]: pgmap v14765: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1010 KiB/s wr, 11 op/s 2023-05-08T11:24:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:03 smithi186 ceph-mon[126480]: pgmap v14765: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1010 KiB/s wr, 11 op/s 2023-05-08T11:24:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27583.198755 secs 2023-05-08T11:24:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:04 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:24:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27583.198755 secs 2023-05-08T11:24:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:04 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:24:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27583.198755 secs 2023-05-08T11:24:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:04 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:24:05.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:05 smithi133 ceph-mon[125939]: pgmap v14766: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 31 op/s 2023-05-08T11:24:05.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:24:05.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:24:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:05 smithi096 ceph-mon[124666]: pgmap v14766: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 31 op/s 2023-05-08T11:24:05.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:24:05.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:24:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:05 smithi186 ceph-mon[126480]: pgmap v14766: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 31 op/s 2023-05-08T11:24:05.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:24:05.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:24:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:07 smithi133 ceph-mon[125939]: osdmap e1000: 12 total, 12 up, 12 in 2023-05-08T11:24:07.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:07 smithi133 ceph-mon[125939]: pgmap v14768: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 994 KiB/s rd, 1.3 MiB/s wr, 30 op/s 2023-05-08T11:24:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:07 smithi096 ceph-mon[124666]: osdmap e1000: 12 total, 12 up, 12 in 2023-05-08T11:24:07.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:07 smithi096 ceph-mon[124666]: pgmap v14768: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 994 KiB/s rd, 1.3 MiB/s wr, 30 op/s 2023-05-08T11:24:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:07 smithi186 ceph-mon[126480]: osdmap e1000: 12 total, 12 up, 12 in 2023-05-08T11:24:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:07 smithi186 ceph-mon[126480]: pgmap v14768: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 994 KiB/s rd, 1.3 MiB/s wr, 30 op/s 2023-05-08T11:24:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:08 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:24:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:08 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:24:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:08 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:24:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:09 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:24:09.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:24:09.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:24:09.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:09 smithi133 ceph-mon[125939]: pgmap v14769: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 994 KiB/s rd, 1.3 MiB/s wr, 30 op/s 2023-05-08T11:24:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:09 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:24:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:24:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:24:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:09 smithi096 ceph-mon[124666]: pgmap v14769: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 994 KiB/s rd, 1.3 MiB/s wr, 30 op/s 2023-05-08T11:24:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:09 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:24:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:24:09.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:24:09.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:09 smithi186 ceph-mon[126480]: pgmap v14769: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 994 KiB/s rd, 1.3 MiB/s wr, 30 op/s 2023-05-08T11:24:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27588.198850 secs 2023-05-08T11:24:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27588.198850 secs 2023-05-08T11:24:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27588.198850 secs 2023-05-08T11:24:11.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:11 smithi096 ceph-mon[124666]: pgmap v14770: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 859 KiB/s rd, 896 KiB/s wr, 29 op/s 2023-05-08T11:24:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:11 smithi186 ceph-mon[126480]: pgmap v14770: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 859 KiB/s rd, 896 KiB/s wr, 29 op/s 2023-05-08T11:24:11.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:11 smithi133 ceph-mon[125939]: pgmap v14770: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 859 KiB/s rd, 896 KiB/s wr, 29 op/s 2023-05-08T11:24:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:13 smithi186 ceph-mon[126480]: pgmap v14771: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 859 KiB/s rd, 896 KiB/s wr, 29 op/s 2023-05-08T11:24:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:13 smithi133 ceph-mon[125939]: pgmap v14771: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 859 KiB/s rd, 896 KiB/s wr, 29 op/s 2023-05-08T11:24:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:13 smithi096 ceph-mon[124666]: pgmap v14771: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 859 KiB/s rd, 896 KiB/s wr, 29 op/s 2023-05-08T11:24:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27593.198979 secs 2023-05-08T11:24:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27593.198979 secs 2023-05-08T11:24:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27593.198979 secs 2023-05-08T11:24:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27593.753930 secs 2023-05-08T11:24:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:15 smithi186 ceph-mon[126480]: pgmap v14772: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 958 KiB/s rd, 444 KiB/s wr, 11 op/s 2023-05-08T11:24:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:15 smithi186 ceph-mon[126480]: osdmap e1001: 12 total, 12 up, 12 in 2023-05-08T11:24:15.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27593.753930 secs 2023-05-08T11:24:15.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:15 smithi133 ceph-mon[125939]: pgmap v14772: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 958 KiB/s rd, 444 KiB/s wr, 11 op/s 2023-05-08T11:24:15.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:15 smithi133 ceph-mon[125939]: osdmap e1001: 12 total, 12 up, 12 in 2023-05-08T11:24:15.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27593.753930 secs 2023-05-08T11:24:15.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:15 smithi096 ceph-mon[124666]: pgmap v14772: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 958 KiB/s rd, 444 KiB/s wr, 11 op/s 2023-05-08T11:24:15.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:15 smithi096 ceph-mon[124666]: osdmap e1001: 12 total, 12 up, 12 in 2023-05-08T11:24:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27595.042272 secs 2023-05-08T11:24:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27595.042272 secs 2023-05-08T11:24:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27595.042272 secs 2023-05-08T11:24:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:17 smithi186 ceph-mon[126480]: pgmap v14774: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 958 KiB/s rd, 444 KiB/s wr, 11 op/s 2023-05-08T11:24:17.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:17 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:24:17.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:17 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:24:17.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:17 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:24:17.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:17 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:24:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:17 smithi133 ceph-mon[125939]: pgmap v14774: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 958 KiB/s rd, 444 KiB/s wr, 11 op/s 2023-05-08T11:24:17.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:17 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:24:17.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:17 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:24:17.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:17 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:24:17.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:17 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:24:17.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:17 smithi096 ceph-mon[124666]: pgmap v14774: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 958 KiB/s rd, 444 KiB/s wr, 11 op/s 2023-05-08T11:24:17.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:17 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:24:17.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:17 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:24:17.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:17 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:24:17.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:17 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:24:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:19 smithi186 ceph-mon[126480]: pgmap v14775: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 958 KiB/s rd, 444 KiB/s wr, 11 op/s 2023-05-08T11:24:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27598.199106 secs 2023-05-08T11:24:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:19 smithi133 ceph-mon[125939]: pgmap v14775: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 958 KiB/s rd, 444 KiB/s wr, 11 op/s 2023-05-08T11:24:19.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27598.199106 secs 2023-05-08T11:24:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:19 smithi096 ceph-mon[124666]: pgmap v14775: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 958 KiB/s rd, 444 KiB/s wr, 11 op/s 2023-05-08T11:24:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27598.199106 secs 2023-05-08T11:24:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27598.754057 secs 2023-05-08T11:24:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27598.754057 secs 2023-05-08T11:24:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27598.754057 secs 2023-05-08T11:24:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:21 smithi186 ceph-mon[126480]: pgmap v14776: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 446 KiB/s wr, 11 op/s 2023-05-08T11:24:21.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27600.042395 secs 2023-05-08T11:24:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:21 smithi133 ceph-mon[125939]: pgmap v14776: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 446 KiB/s wr, 11 op/s 2023-05-08T11:24:21.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27600.042395 secs 2023-05-08T11:24:21.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:21 smithi096 ceph-mon[124666]: pgmap v14776: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 446 KiB/s wr, 11 op/s 2023-05-08T11:24:21.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27600.042395 secs 2023-05-08T11:24:23.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:23 smithi186 ceph-mon[126480]: pgmap v14777: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 446 KiB/s wr, 10 op/s 2023-05-08T11:24:23.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:23 smithi133 ceph-mon[125939]: pgmap v14777: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 446 KiB/s wr, 10 op/s 2023-05-08T11:24:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:23 smithi096 ceph-mon[124666]: pgmap v14777: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 446 KiB/s wr, 10 op/s 2023-05-08T11:24:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27603.199264 secs 2023-05-08T11:24:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27603.199264 secs 2023-05-08T11:24:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27603.199264 secs 2023-05-08T11:24:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27603.754174 secs 2023-05-08T11:24:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:25 smithi186 ceph-mon[126480]: pgmap v14778: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 269 KiB/s wr, 8 op/s 2023-05-08T11:24:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27603.754174 secs 2023-05-08T11:24:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:25 smithi133 ceph-mon[125939]: pgmap v14778: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 269 KiB/s wr, 8 op/s 2023-05-08T11:24:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27603.754174 secs 2023-05-08T11:24:25.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:25 smithi096 ceph-mon[124666]: pgmap v14778: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 269 KiB/s wr, 8 op/s 2023-05-08T11:24:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27605.042528 secs 2023-05-08T11:24:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27605.042528 secs 2023-05-08T11:24:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27605.042528 secs 2023-05-08T11:24:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:27 smithi186 ceph-mon[126480]: pgmap v14779: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 243 KiB/s wr, 8 op/s 2023-05-08T11:24:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:27 smithi133 ceph-mon[125939]: pgmap v14779: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 243 KiB/s wr, 8 op/s 2023-05-08T11:24:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:27 smithi096 ceph-mon[124666]: pgmap v14779: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 243 KiB/s wr, 8 op/s 2023-05-08T11:24:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:29 smithi133 ceph-mon[125939]: pgmap v14780: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 224 KiB/s wr, 7 op/s 2023-05-08T11:24:30.156 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27608.199324 secs 2023-05-08T11:24:30.158 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:29 smithi186 ceph-mon[126480]: pgmap v14780: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 224 KiB/s wr, 7 op/s 2023-05-08T11:24:30.158 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27608.199324 secs 2023-05-08T11:24:30.158 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:29 smithi096 ceph-mon[124666]: pgmap v14780: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 224 KiB/s wr, 7 op/s 2023-05-08T11:24:30.158 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27608.199324 secs 2023-05-08T11:24:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27608.754290 secs 2023-05-08T11:24:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27608.754290 secs 2023-05-08T11:24:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27608.754290 secs 2023-05-08T11:24:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:31 smithi133 ceph-mon[125939]: pgmap v14781: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 321 KiB/s wr, 10 op/s 2023-05-08T11:24:31.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27610.042618 secs 2023-05-08T11:24:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:31 smithi096 ceph-mon[124666]: pgmap v14781: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 321 KiB/s wr, 10 op/s 2023-05-08T11:24:31.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27610.042618 secs 2023-05-08T11:24:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:31 smithi186 ceph-mon[126480]: pgmap v14781: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 321 KiB/s wr, 10 op/s 2023-05-08T11:24:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27610.042618 secs 2023-05-08T11:24:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:33 smithi133 ceph-mon[125939]: pgmap v14782: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 319 KiB/s wr, 6 op/s 2023-05-08T11:24:33.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:33 smithi096 ceph-mon[124666]: pgmap v14782: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 319 KiB/s wr, 6 op/s 2023-05-08T11:24:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:33 smithi186 ceph-mon[126480]: pgmap v14782: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 319 KiB/s wr, 6 op/s 2023-05-08T11:24:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27613.199443 secs 2023-05-08T11:24:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27613.199443 secs 2023-05-08T11:24:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27613.199443 secs 2023-05-08T11:24:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27613.754438 secs 2023-05-08T11:24:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:35 smithi133 ceph-mon[125939]: pgmap v14783: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 359 KiB/s rd, 354 KiB/s wr, 9 op/s 2023-05-08T11:24:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27613.754438 secs 2023-05-08T11:24:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:35 smithi096 ceph-mon[124666]: pgmap v14783: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 359 KiB/s rd, 354 KiB/s wr, 9 op/s 2023-05-08T11:24:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27613.754438 secs 2023-05-08T11:24:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:35 smithi186 ceph-mon[126480]: pgmap v14783: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 359 KiB/s rd, 354 KiB/s wr, 9 op/s 2023-05-08T11:24:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27615.042735 secs 2023-05-08T11:24:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27615.042735 secs 2023-05-08T11:24:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27615.042735 secs 2023-05-08T11:24:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:37 smithi133 ceph-mon[125939]: pgmap v14784: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 132 KiB/s wr, 5 op/s 2023-05-08T11:24:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:37 smithi096 ceph-mon[124666]: pgmap v14784: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 132 KiB/s wr, 5 op/s 2023-05-08T11:24:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:37 smithi186 ceph-mon[126480]: pgmap v14784: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 132 KiB/s wr, 5 op/s 2023-05-08T11:24:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:39 smithi133 ceph-mon[125939]: pgmap v14785: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 132 KiB/s wr, 5 op/s 2023-05-08T11:24:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27618.199567 secs 2023-05-08T11:24:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:39 smithi096 ceph-mon[124666]: pgmap v14785: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 132 KiB/s wr, 5 op/s 2023-05-08T11:24:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27618.199567 secs 2023-05-08T11:24:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:39 smithi186 ceph-mon[126480]: pgmap v14785: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 132 KiB/s wr, 5 op/s 2023-05-08T11:24:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27618.199567 secs 2023-05-08T11:24:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27618.754554 secs 2023-05-08T11:24:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27618.754554 secs 2023-05-08T11:24:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27618.754554 secs 2023-05-08T11:24:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:41 smithi133 ceph-mon[125939]: pgmap v14786: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 132 KiB/s wr, 8 op/s 2023-05-08T11:24:41.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27620.042855 secs 2023-05-08T11:24:41.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:41 smithi096 ceph-mon[124666]: pgmap v14786: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 132 KiB/s wr, 8 op/s 2023-05-08T11:24:41.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27620.042855 secs 2023-05-08T11:24:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:41 smithi186 ceph-mon[126480]: pgmap v14786: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 132 KiB/s wr, 8 op/s 2023-05-08T11:24:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27620.042855 secs 2023-05-08T11:24:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:43 smithi133 ceph-mon[125939]: pgmap v14787: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 5 op/s 2023-05-08T11:24:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:43 smithi096 ceph-mon[124666]: pgmap v14787: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 5 op/s 2023-05-08T11:24:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:43 smithi186 ceph-mon[126480]: pgmap v14787: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 5 op/s 2023-05-08T11:24:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27623.199711 secs 2023-05-08T11:24:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27623.199711 secs 2023-05-08T11:24:44.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27623.199711 secs 2023-05-08T11:24:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27623.754691 secs 2023-05-08T11:24:45.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:45 smithi133 ceph-mon[125939]: pgmap v14788: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 73 KiB/s wr, 8 op/s 2023-05-08T11:24:45.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27623.754691 secs 2023-05-08T11:24:45.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:45 smithi096 ceph-mon[124666]: pgmap v14788: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 73 KiB/s wr, 8 op/s 2023-05-08T11:24:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27623.754691 secs 2023-05-08T11:24:45.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:45 smithi186 ceph-mon[126480]: pgmap v14788: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 73 KiB/s wr, 8 op/s 2023-05-08T11:24:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:47 smithi133 ceph-mon[125939]: pgmap v14789: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 39 KiB/s wr, 5 op/s 2023-05-08T11:24:47.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:47 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:24:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:47 smithi096 ceph-mon[124666]: pgmap v14789: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 39 KiB/s wr, 5 op/s 2023-05-08T11:24:47.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:47 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:24:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:47 smithi186 ceph-mon[126480]: pgmap v14789: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 39 KiB/s wr, 5 op/s 2023-05-08T11:24:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:47 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:24:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:48 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:24:48.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:48 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:24:48.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:48 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:24:48.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:48 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:24:48.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:48 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T11:24:48.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:48 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T11:24:48.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:48 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:24:48.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:24:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:48 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:24:48.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:48 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:24:48.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:48 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:24:48.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:48 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:24:48.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:48 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T11:24:48.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:48 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T11:24:48.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:48 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:24:48.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:24:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:48 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:24:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:48 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:24:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:48 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:24:48.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:48 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:24:48.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:48 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T11:24:48.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:48 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T11:24:48.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:48 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:24:48.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:24:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:49 smithi133 ceph-mon[125939]: pgmap v14790: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 39 KiB/s wr, 5 op/s 2023-05-08T11:24:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27628.199789 secs 2023-05-08T11:24:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:24:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:24:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:24:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:49 smithi096 ceph-mon[124666]: pgmap v14790: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 39 KiB/s wr, 5 op/s 2023-05-08T11:24:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27628.199789 secs 2023-05-08T11:24:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:24:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:24:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:24:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:49 smithi186 ceph-mon[126480]: pgmap v14790: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 39 KiB/s wr, 5 op/s 2023-05-08T11:24:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27628.199789 secs 2023-05-08T11:24:49.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:24:49.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:24:49.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:24:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27628.754823 secs 2023-05-08T11:24:50.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27628.754823 secs 2023-05-08T11:24:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27628.754823 secs 2023-05-08T11:24:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:51 smithi133 ceph-mon[125939]: pgmap v14791: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 380 KiB/s wr, 9 op/s 2023-05-08T11:24:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:51 smithi096 ceph-mon[124666]: pgmap v14791: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 380 KiB/s wr, 9 op/s 2023-05-08T11:24:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:51 smithi186 ceph-mon[126480]: pgmap v14791: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 380 KiB/s wr, 9 op/s 2023-05-08T11:24:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:53 smithi133 ceph-mon[125939]: pgmap v14792: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 606 KiB/s rd, 381 KiB/s wr, 7 op/s 2023-05-08T11:24:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:53 smithi096 ceph-mon[124666]: pgmap v14792: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 606 KiB/s rd, 381 KiB/s wr, 7 op/s 2023-05-08T11:24:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:53 smithi186 ceph-mon[126480]: pgmap v14792: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 606 KiB/s rd, 381 KiB/s wr, 7 op/s 2023-05-08T11:24:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27633.199946 secs 2023-05-08T11:24:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27633.199946 secs 2023-05-08T11:24:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27633.199946 secs 2023-05-08T11:24:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:55 smithi133 ceph-mon[125939]: pgmap v14793: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1013 KiB/s rd, 779 KiB/s wr, 12 op/s 2023-05-08T11:24:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:55 smithi096 ceph-mon[124666]: pgmap v14793: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1013 KiB/s rd, 779 KiB/s wr, 12 op/s 2023-05-08T11:24:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:55 smithi186 ceph-mon[126480]: pgmap v14793: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1013 KiB/s rd, 779 KiB/s wr, 12 op/s 2023-05-08T11:24:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27635.043204 secs 2023-05-08T11:24:56.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:24:56.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27635.043204 secs 2023-05-08T11:24:56.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:24:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27635.043204 secs 2023-05-08T11:24:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:24:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:57 smithi133 ceph-mon[125939]: pgmap v14794: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 896 KiB/s rd, 741 KiB/s wr, 10 op/s 2023-05-08T11:24:57.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:24:57.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:24:57.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:24:57.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:57 smithi096 ceph-mon[124666]: pgmap v14794: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 896 KiB/s rd, 741 KiB/s wr, 10 op/s 2023-05-08T11:24:57.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:24:57.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:24:57.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:24:57.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:57 smithi186 ceph-mon[126480]: pgmap v14794: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 896 KiB/s rd, 741 KiB/s wr, 10 op/s 2023-05-08T11:24:57.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:24:57.874 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:24:57.874 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:24:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:59 smithi133 ceph-mon[125939]: pgmap v14795: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 896 KiB/s rd, 741 KiB/s wr, 10 op/s 2023-05-08T11:24:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:24:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27638.200069 secs 2023-05-08T11:24:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:59 smithi096 ceph-mon[124666]: pgmap v14795: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 896 KiB/s rd, 741 KiB/s wr, 10 op/s 2023-05-08T11:24:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:24:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27638.200069 secs 2023-05-08T11:24:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:59 smithi186 ceph-mon[126480]: pgmap v14795: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 896 KiB/s rd, 741 KiB/s wr, 10 op/s 2023-05-08T11:24:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:24:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27638.200069 secs 2023-05-08T11:25:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27638.755058 secs 2023-05-08T11:25:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27638.755058 secs 2023-05-08T11:25:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27638.755058 secs 2023-05-08T11:25:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:01 smithi133 ceph-mon[125939]: pgmap v14796: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 16 op/s 2023-05-08T11:25:01.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27640.043333 secs 2023-05-08T11:25:01.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:01 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:25:01.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:25:01.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:25:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:01 smithi096 ceph-mon[124666]: pgmap v14796: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 16 op/s 2023-05-08T11:25:01.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27640.043333 secs 2023-05-08T11:25:01.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:01 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:25:01.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:25:01.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:25:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:01 smithi186 ceph-mon[126480]: pgmap v14796: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 16 op/s 2023-05-08T11:25:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27640.043333 secs 2023-05-08T11:25:01.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:01 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:25:01.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:25:01.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:25:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:03 smithi133 ceph-mon[125939]: pgmap v14797: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 871 KiB/s rd, 738 KiB/s wr, 11 op/s 2023-05-08T11:25:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:03 smithi096 ceph-mon[124666]: pgmap v14797: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 871 KiB/s rd, 738 KiB/s wr, 11 op/s 2023-05-08T11:25:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:03 smithi186 ceph-mon[126480]: pgmap v14797: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 871 KiB/s rd, 738 KiB/s wr, 11 op/s 2023-05-08T11:25:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27643.200133 secs 2023-05-08T11:25:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27643.200133 secs 2023-05-08T11:25:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27643.200133 secs 2023-05-08T11:25:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27643.755175 secs 2023-05-08T11:25:05.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:05 smithi133 ceph-mon[125939]: pgmap v14798: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 18 op/s 2023-05-08T11:25:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27643.755175 secs 2023-05-08T11:25:05.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:05 smithi096 ceph-mon[124666]: pgmap v14798: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 18 op/s 2023-05-08T11:25:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27643.755175 secs 2023-05-08T11:25:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:05 smithi186 ceph-mon[126480]: pgmap v14798: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 18 op/s 2023-05-08T11:25:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:07 smithi133 ceph-mon[125939]: pgmap v14799: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 825 KiB/s rd, 1.0 MiB/s wr, 12 op/s 2023-05-08T11:25:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:07 smithi096 ceph-mon[124666]: pgmap v14799: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 825 KiB/s rd, 1.0 MiB/s wr, 12 op/s 2023-05-08T11:25:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:07 smithi186 ceph-mon[126480]: pgmap v14799: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 825 KiB/s rd, 1.0 MiB/s wr, 12 op/s 2023-05-08T11:25:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:08 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:25:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:08 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:25:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:08 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:25:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:09 smithi133 ceph-mon[125939]: pgmap v14800: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 825 KiB/s rd, 1.0 MiB/s wr, 12 op/s 2023-05-08T11:25:09.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:09 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:25:09.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27648.200232 secs 2023-05-08T11:25:09.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:25:09.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:25:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:09 smithi096 ceph-mon[124666]: pgmap v14800: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 825 KiB/s rd, 1.0 MiB/s wr, 12 op/s 2023-05-08T11:25:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:09 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:25:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27648.200232 secs 2023-05-08T11:25:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:25:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:25:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:09 smithi186 ceph-mon[126480]: pgmap v14800: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 825 KiB/s rd, 1.0 MiB/s wr, 12 op/s 2023-05-08T11:25:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:09 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:25:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27648.200232 secs 2023-05-08T11:25:09.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:25:09.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:25:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:11 smithi133 ceph-mon[125939]: pgmap v14801: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 28 op/s 2023-05-08T11:25:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27650.043674 secs 2023-05-08T11:25:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:11 smithi096 ceph-mon[124666]: pgmap v14801: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 28 op/s 2023-05-08T11:25:11.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27650.043674 secs 2023-05-08T11:25:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:11 smithi186 ceph-mon[126480]: pgmap v14801: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 28 op/s 2023-05-08T11:25:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27650.043674 secs 2023-05-08T11:25:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:12 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:25:12.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:12 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:25:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:12 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:25:13.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:25:13.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:25:13.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:13 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:25:13.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:13 smithi186 ceph-mon[126480]: pgmap v14802: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 908 KiB/s rd, 903 KiB/s wr, 22 op/s 2023-05-08T11:25:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:25:13.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:25:13.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:13 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:25:13.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:13 smithi133 ceph-mon[125939]: pgmap v14802: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 908 KiB/s rd, 903 KiB/s wr, 22 op/s 2023-05-08T11:25:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:25:13.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:25:13.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:13 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:25:13.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:13 smithi096 ceph-mon[124666]: pgmap v14802: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 908 KiB/s rd, 903 KiB/s wr, 22 op/s 2023-05-08T11:25:14.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27653.200371 secs 2023-05-08T11:25:14.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27653.200371 secs 2023-05-08T11:25:14.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27653.200371 secs 2023-05-08T11:25:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27653.755415 secs 2023-05-08T11:25:15.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:15 smithi186 ceph-mon[126480]: pgmap v14803: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 29 op/s 2023-05-08T11:25:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27653.755415 secs 2023-05-08T11:25:15.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:15 smithi133 ceph-mon[125939]: pgmap v14803: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 29 op/s 2023-05-08T11:25:15.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27653.755415 secs 2023-05-08T11:25:15.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:15 smithi096 ceph-mon[124666]: pgmap v14803: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 29 op/s 2023-05-08T11:25:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27655.043859 secs 2023-05-08T11:25:16.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:16 smithi186 ceph-mon[126480]: osdmap e1002: 12 total, 12 up, 12 in 2023-05-08T11:25:16.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27655.043859 secs 2023-05-08T11:25:16.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:16 smithi133 ceph-mon[125939]: osdmap e1002: 12 total, 12 up, 12 in 2023-05-08T11:25:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27655.043859 secs 2023-05-08T11:25:16.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:16 smithi096 ceph-mon[124666]: osdmap e1002: 12 total, 12 up, 12 in 2023-05-08T11:25:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:17 smithi186 ceph-mon[126480]: pgmap v14805: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 27 op/s 2023-05-08T11:25:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:17 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:25:17.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:17 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:25:17.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:17 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:25:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:17 smithi133 ceph-mon[125939]: pgmap v14805: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 27 op/s 2023-05-08T11:25:17.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:17 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:25:17.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:17 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:25:17.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:17 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:25:17.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:17 smithi096 ceph-mon[124666]: pgmap v14805: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 27 op/s 2023-05-08T11:25:17.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:17 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:25:17.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:17 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:25:17.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:17 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:25:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:19 smithi186 ceph-mon[126480]: pgmap v14806: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 27 op/s 2023-05-08T11:25:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27658.200412 secs 2023-05-08T11:25:19.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:19 smithi133 ceph-mon[125939]: pgmap v14806: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 27 op/s 2023-05-08T11:25:19.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27658.200412 secs 2023-05-08T11:25:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:19 smithi096 ceph-mon[124666]: pgmap v14806: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 27 op/s 2023-05-08T11:25:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27658.200412 secs 2023-05-08T11:25:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27658.755502 secs 2023-05-08T11:25:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27658.755502 secs 2023-05-08T11:25:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27658.755502 secs 2023-05-08T11:25:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:21 smithi186 ceph-mon[126480]: pgmap v14807: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 794 KiB/s rd, 818 KiB/s wr, 13 op/s 2023-05-08T11:25:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27660.043948 secs 2023-05-08T11:25:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:21 smithi133 ceph-mon[125939]: pgmap v14807: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 794 KiB/s rd, 818 KiB/s wr, 13 op/s 2023-05-08T11:25:21.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27660.043948 secs 2023-05-08T11:25:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:21 smithi096 ceph-mon[124666]: pgmap v14807: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 794 KiB/s rd, 818 KiB/s wr, 13 op/s 2023-05-08T11:25:21.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27660.043948 secs 2023-05-08T11:25:23.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:23 smithi186 ceph-mon[126480]: pgmap v14808: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 794 KiB/s rd, 818 KiB/s wr, 13 op/s 2023-05-08T11:25:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:23 smithi133 ceph-mon[125939]: pgmap v14808: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 794 KiB/s rd, 818 KiB/s wr, 13 op/s 2023-05-08T11:25:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:23 smithi096 ceph-mon[124666]: pgmap v14808: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 794 KiB/s rd, 818 KiB/s wr, 13 op/s 2023-05-08T11:25:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27663.200506 secs 2023-05-08T11:25:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27663.200506 secs 2023-05-08T11:25:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27663.200506 secs 2023-05-08T11:25:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27663.755602 secs 2023-05-08T11:25:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:25 smithi186 ceph-mon[126480]: pgmap v14809: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 98 KiB/s wr, 7 op/s 2023-05-08T11:25:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:25 smithi186 ceph-mon[126480]: osdmap e1003: 12 total, 12 up, 12 in 2023-05-08T11:25:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27663.755602 secs 2023-05-08T11:25:25.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:25 smithi133 ceph-mon[125939]: pgmap v14809: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 98 KiB/s wr, 7 op/s 2023-05-08T11:25:25.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:25 smithi133 ceph-mon[125939]: osdmap e1003: 12 total, 12 up, 12 in 2023-05-08T11:25:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27663.755602 secs 2023-05-08T11:25:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:25 smithi096 ceph-mon[124666]: pgmap v14809: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 98 KiB/s wr, 7 op/s 2023-05-08T11:25:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:25 smithi096 ceph-mon[124666]: osdmap e1003: 12 total, 12 up, 12 in 2023-05-08T11:25:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27665.044038 secs 2023-05-08T11:25:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27665.044038 secs 2023-05-08T11:25:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27665.044038 secs 2023-05-08T11:25:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:27 smithi133 ceph-mon[125939]: pgmap v14811: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 98 KiB/s wr, 7 op/s 2023-05-08T11:25:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:27 smithi096 ceph-mon[124666]: pgmap v14811: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 98 KiB/s wr, 7 op/s 2023-05-08T11:25:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:27 smithi186 ceph-mon[126480]: pgmap v14811: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 98 KiB/s wr, 7 op/s 2023-05-08T11:25:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:29 smithi133 ceph-mon[125939]: pgmap v14812: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 98 KiB/s wr, 7 op/s 2023-05-08T11:25:29.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27668.200619 secs 2023-05-08T11:25:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:29 smithi096 ceph-mon[124666]: pgmap v14812: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 98 KiB/s wr, 7 op/s 2023-05-08T11:25:29.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27668.200619 secs 2023-05-08T11:25:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:29 smithi186 ceph-mon[126480]: pgmap v14812: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 98 KiB/s wr, 7 op/s 2023-05-08T11:25:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27668.200619 secs 2023-05-08T11:25:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27668.755711 secs 2023-05-08T11:25:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27668.755711 secs 2023-05-08T11:25:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27668.755711 secs 2023-05-08T11:25:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:31 smithi133 ceph-mon[125939]: pgmap v14813: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 97 KiB/s wr, 6 op/s 2023-05-08T11:25:31.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27670.044166 secs 2023-05-08T11:25:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:31 smithi096 ceph-mon[124666]: pgmap v14813: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 97 KiB/s wr, 6 op/s 2023-05-08T11:25:31.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27670.044166 secs 2023-05-08T11:25:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:31 smithi186 ceph-mon[126480]: pgmap v14813: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 97 KiB/s wr, 6 op/s 2023-05-08T11:25:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27670.044166 secs 2023-05-08T11:25:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:33 smithi133 ceph-mon[125939]: pgmap v14814: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 97 KiB/s wr, 6 op/s 2023-05-08T11:25:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:33 smithi096 ceph-mon[124666]: pgmap v14814: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 97 KiB/s wr, 6 op/s 2023-05-08T11:25:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:33 smithi186 ceph-mon[126480]: pgmap v14814: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 97 KiB/s wr, 6 op/s 2023-05-08T11:25:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27673.200743 secs 2023-05-08T11:25:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27673.200743 secs 2023-05-08T11:25:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27673.200743 secs 2023-05-08T11:25:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27673.755827 secs 2023-05-08T11:25:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:35 smithi133 ceph-mon[125939]: pgmap v14815: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T11:25:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27673.755827 secs 2023-05-08T11:25:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:35 smithi096 ceph-mon[124666]: pgmap v14815: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T11:25:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27673.755827 secs 2023-05-08T11:25:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:35 smithi186 ceph-mon[126480]: pgmap v14815: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T11:25:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27675.044288 secs 2023-05-08T11:25:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27675.044288 secs 2023-05-08T11:25:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27675.044288 secs 2023-05-08T11:25:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:37 smithi133 ceph-mon[125939]: pgmap v14816: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-05-08T11:25:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:37 smithi096 ceph-mon[124666]: pgmap v14816: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-05-08T11:25:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:37 smithi186 ceph-mon[126480]: pgmap v14816: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-05-08T11:25:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:39 smithi133 ceph-mon[125939]: pgmap v14817: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T11:25:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27678.200868 secs 2023-05-08T11:25:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:39 smithi096 ceph-mon[124666]: pgmap v14817: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T11:25:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27678.200868 secs 2023-05-08T11:25:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:39 smithi186 ceph-mon[126480]: pgmap v14817: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T11:25:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27678.200868 secs 2023-05-08T11:25:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27678.755947 secs 2023-05-08T11:25:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27678.755947 secs 2023-05-08T11:25:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27678.755947 secs 2023-05-08T11:25:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:41 smithi133 ceph-mon[125939]: pgmap v14818: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T11:25:41.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27680.044351 secs 2023-05-08T11:25:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:41 smithi096 ceph-mon[124666]: pgmap v14818: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T11:25:41.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27680.044351 secs 2023-05-08T11:25:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:41 smithi186 ceph-mon[126480]: pgmap v14818: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T11:25:41.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27680.044351 secs 2023-05-08T11:25:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:43 smithi133 ceph-mon[125939]: pgmap v14819: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T11:25:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:43 smithi096 ceph-mon[124666]: pgmap v14819: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T11:25:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:43 smithi186 ceph-mon[126480]: pgmap v14819: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T11:25:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27683.200990 secs 2023-05-08T11:25:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27683.200990 secs 2023-05-08T11:25:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27683.200990 secs 2023-05-08T11:25:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27683.756082 secs 2023-05-08T11:25:45.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:45 smithi133 ceph-mon[125939]: pgmap v14820: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 255 B/s wr, 7 op/s 2023-05-08T11:25:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27683.756082 secs 2023-05-08T11:25:45.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:45 smithi096 ceph-mon[124666]: pgmap v14820: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 255 B/s wr, 7 op/s 2023-05-08T11:25:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27683.756082 secs 2023-05-08T11:25:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:45 smithi186 ceph-mon[126480]: pgmap v14820: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 255 B/s wr, 7 op/s 2023-05-08T11:25:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:47 smithi133 ceph-mon[125939]: pgmap v14821: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2023-05-08T11:25:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:47 smithi096 ceph-mon[124666]: pgmap v14821: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2023-05-08T11:25:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:47 smithi186 ceph-mon[126480]: pgmap v14821: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2023-05-08T11:25:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:48 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:25:48.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:25:48.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:48 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:25:48.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:48 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:25:48.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:48 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:25:48.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:48 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:25:48.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:48 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:25:48.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:48 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:25:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:48 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:25:48.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:25:48.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:48 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:25:48.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:48 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:25:48.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:48 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:25:48.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:48 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:25:48.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:48 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:25:48.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:48 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:25:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:48 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:25:48.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:25:48.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:48 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:25:48.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:48 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:25:48.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:48 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:25:48.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:48 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:25:48.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:48 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:25:48.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:48 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:25:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:49 smithi133 ceph-mon[125939]: pgmap v14822: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2023-05-08T11:25:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:25:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:25:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:25:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27688.201094 secs 2023-05-08T11:25:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:49 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:25:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:49 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:25:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:49 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:25:49.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:49 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:25:49.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:49 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T11:25:49.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:49 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T11:25:49.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:49 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:25:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:49 smithi096 ceph-mon[124666]: pgmap v14822: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2023-05-08T11:25:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:25:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:25:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:25:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27688.201094 secs 2023-05-08T11:25:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:49 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:25:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:49 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:25:49.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:49 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:25:49.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:49 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:25:49.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:49 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T11:25:49.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:49 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T11:25:49.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:49 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:25:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:49 smithi186 ceph-mon[126480]: pgmap v14822: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2023-05-08T11:25:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:25:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:25:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:25:49.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27688.201094 secs 2023-05-08T11:25:49.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:49 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:25:49.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:49 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:25:49.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:49 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:25:49.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:49 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:25:49.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:49 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T11:25:49.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:49 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T11:25:49.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:49 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:25:50.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27688.756211 secs 2023-05-08T11:25:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27688.756211 secs 2023-05-08T11:25:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27688.756211 secs 2023-05-08T11:25:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:51 smithi133 ceph-mon[125939]: pgmap v14823: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 124 KiB/s wr, 9 op/s 2023-05-08T11:25:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:51 smithi096 ceph-mon[124666]: pgmap v14823: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 124 KiB/s wr, 9 op/s 2023-05-08T11:25:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:51 smithi186 ceph-mon[126480]: pgmap v14823: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 124 KiB/s wr, 9 op/s 2023-05-08T11:25:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:53 smithi133 ceph-mon[125939]: pgmap v14824: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 124 KiB/s wr, 6 op/s 2023-05-08T11:25:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:53 smithi096 ceph-mon[124666]: pgmap v14824: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 124 KiB/s wr, 6 op/s 2023-05-08T11:25:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:53 smithi186 ceph-mon[126480]: pgmap v14824: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 124 KiB/s wr, 6 op/s 2023-05-08T11:25:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27693.201218 secs 2023-05-08T11:25:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27693.201218 secs 2023-05-08T11:25:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27693.201218 secs 2023-05-08T11:25:55.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:55 smithi133 ceph-mon[125939]: pgmap v14825: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 777 KiB/s rd, 801 KiB/s wr, 12 op/s 2023-05-08T11:25:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:55 smithi096 ceph-mon[124666]: pgmap v14825: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 777 KiB/s rd, 801 KiB/s wr, 12 op/s 2023-05-08T11:25:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:55 smithi186 ceph-mon[126480]: pgmap v14825: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 777 KiB/s rd, 801 KiB/s wr, 12 op/s 2023-05-08T11:25:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:25:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:25:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:25:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:57 smithi133 ceph-mon[125939]: pgmap v14826: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 776 KiB/s rd, 801 KiB/s wr, 10 op/s 2023-05-08T11:25:57.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:57 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:25:57.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:25:57.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:25:57.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:57 smithi096 ceph-mon[124666]: pgmap v14826: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 776 KiB/s rd, 801 KiB/s wr, 10 op/s 2023-05-08T11:25:57.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:57 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:25:57.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:25:57.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:25:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:57 smithi186 ceph-mon[126480]: pgmap v14826: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 776 KiB/s rd, 801 KiB/s wr, 10 op/s 2023-05-08T11:25:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:57 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:25:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:25:57.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:25:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:59 smithi133 ceph-mon[125939]: pgmap v14827: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 776 KiB/s rd, 801 KiB/s wr, 10 op/s 2023-05-08T11:25:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:25:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27698.201357 secs 2023-05-08T11:25:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:59 smithi096 ceph-mon[124666]: pgmap v14827: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 776 KiB/s rd, 801 KiB/s wr, 10 op/s 2023-05-08T11:25:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:25:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27698.201357 secs 2023-05-08T11:25:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:59 smithi186 ceph-mon[126480]: pgmap v14827: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 776 KiB/s rd, 801 KiB/s wr, 10 op/s 2023-05-08T11:25:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:25:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27698.201357 secs 2023-05-08T11:26:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27698.756444 secs 2023-05-08T11:26:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27698.756444 secs 2023-05-08T11:26:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27698.756444 secs 2023-05-08T11:26:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:01 smithi133 ceph-mon[125939]: pgmap v14828: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 15 op/s 2023-05-08T11:26:01.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27700.045044 secs 2023-05-08T11:26:01.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:26:01.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:26:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:01 smithi096 ceph-mon[124666]: pgmap v14828: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 15 op/s 2023-05-08T11:26:01.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27700.045044 secs 2023-05-08T11:26:01.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:26:01.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:26:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:01 smithi186 ceph-mon[126480]: pgmap v14828: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 15 op/s 2023-05-08T11:26:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27700.045044 secs 2023-05-08T11:26:01.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:26:01.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:26:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:03 smithi133 ceph-mon[125939]: pgmap v14829: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1017 KiB/s wr, 12 op/s 2023-05-08T11:26:03.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:03 smithi096 ceph-mon[124666]: pgmap v14829: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1017 KiB/s wr, 12 op/s 2023-05-08T11:26:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:03 smithi186 ceph-mon[126480]: pgmap v14829: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1017 KiB/s wr, 12 op/s 2023-05-08T11:26:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27703.201428 secs 2023-05-08T11:26:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27703.201428 secs 2023-05-08T11:26:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27703.201428 secs 2023-05-08T11:26:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27703.756573 secs 2023-05-08T11:26:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:05 smithi133 ceph-mon[125939]: pgmap v14830: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 29 op/s 2023-05-08T11:26:05.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:05 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:26:05.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:26:05.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:26:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27703.756573 secs 2023-05-08T11:26:05.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:05 smithi096 ceph-mon[124666]: pgmap v14830: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 29 op/s 2023-05-08T11:26:05.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:05 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:26:05.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:26:05.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:26:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27703.756573 secs 2023-05-08T11:26:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:05 smithi186 ceph-mon[126480]: pgmap v14830: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 29 op/s 2023-05-08T11:26:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:05 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:26:05.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:26:05.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:26:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:07 smithi133 ceph-mon[125939]: pgmap v14831: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 957 KiB/s wr, 23 op/s 2023-05-08T11:26:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:07 smithi096 ceph-mon[124666]: pgmap v14831: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 957 KiB/s wr, 23 op/s 2023-05-08T11:26:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:07 smithi186 ceph-mon[126480]: pgmap v14831: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 957 KiB/s wr, 23 op/s 2023-05-08T11:26:08.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:08 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:26:08.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:08 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:26:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:08 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:26:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:09 smithi133 ceph-mon[125939]: pgmap v14832: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 956 KiB/s wr, 23 op/s 2023-05-08T11:26:09.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27708.201526 secs 2023-05-08T11:26:09.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:26:09.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:26:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:09 smithi096 ceph-mon[124666]: pgmap v14832: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 956 KiB/s wr, 23 op/s 2023-05-08T11:26:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27708.201526 secs 2023-05-08T11:26:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:26:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:26:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:09 smithi186 ceph-mon[126480]: pgmap v14832: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 956 KiB/s wr, 23 op/s 2023-05-08T11:26:09.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27708.201526 secs 2023-05-08T11:26:09.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:26:09.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:26:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:10 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:26:10.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:10 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:26:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:10 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:26:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:11 smithi133 ceph-mon[125939]: pgmap v14833: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 29 op/s 2023-05-08T11:26:11.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:11 smithi133 ceph-mon[125939]: osdmap e1004: 12 total, 12 up, 12 in 2023-05-08T11:26:11.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:11 smithi096 ceph-mon[124666]: pgmap v14833: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 29 op/s 2023-05-08T11:26:11.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:11 smithi096 ceph-mon[124666]: osdmap e1004: 12 total, 12 up, 12 in 2023-05-08T11:26:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:11 smithi186 ceph-mon[126480]: pgmap v14833: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 29 op/s 2023-05-08T11:26:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:11 smithi186 ceph-mon[126480]: osdmap e1004: 12 total, 12 up, 12 in 2023-05-08T11:26:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:12 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:26:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:12 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:26:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:12 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:26:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:13 smithi096 ceph-mon[124666]: pgmap v14835: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 876 KiB/s rd, 896 KiB/s wr, 28 op/s 2023-05-08T11:26:13.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:26:13.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:13 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:26:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:13 smithi186 ceph-mon[126480]: pgmap v14835: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 876 KiB/s rd, 896 KiB/s wr, 28 op/s 2023-05-08T11:26:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:26:13.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:13 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:26:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:13 smithi133 ceph-mon[125939]: pgmap v14835: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 876 KiB/s rd, 896 KiB/s wr, 28 op/s 2023-05-08T11:26:13.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:26:13.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:13 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:26:14.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27713.201592 secs 2023-05-08T11:26:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27713.201592 secs 2023-05-08T11:26:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27713.201592 secs 2023-05-08T11:26:15.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27713.756768 secs 2023-05-08T11:26:15.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:15 smithi096 ceph-mon[124666]: pgmap v14836: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 666 KiB/s wr, 13 op/s 2023-05-08T11:26:15.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:15 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:26:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27713.756768 secs 2023-05-08T11:26:15.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:15 smithi186 ceph-mon[126480]: pgmap v14836: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 666 KiB/s wr, 13 op/s 2023-05-08T11:26:15.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:15 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:26:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27713.756768 secs 2023-05-08T11:26:15.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:15 smithi133 ceph-mon[125939]: pgmap v14836: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 666 KiB/s wr, 13 op/s 2023-05-08T11:26:15.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:15 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:26:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27715.045363 secs 2023-05-08T11:26:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27715.045363 secs 2023-05-08T11:26:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27715.045363 secs 2023-05-08T11:26:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:17 smithi186 ceph-mon[126480]: pgmap v14837: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 666 KiB/s wr, 13 op/s 2023-05-08T11:26:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:17 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:26:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:17 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:26:17.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:17 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:26:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:17 smithi133 ceph-mon[125939]: pgmap v14837: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 666 KiB/s wr, 13 op/s 2023-05-08T11:26:17.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:17 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:26:17.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:17 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:26:17.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:17 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:26:18.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:17 smithi096 ceph-mon[124666]: pgmap v14837: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 666 KiB/s wr, 13 op/s 2023-05-08T11:26:18.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:17 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:26:18.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:17 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:26:18.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:17 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:26:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:19 smithi186 ceph-mon[126480]: pgmap v14838: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 666 KiB/s wr, 13 op/s 2023-05-08T11:26:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27718.201721 secs 2023-05-08T11:26:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:19 smithi133 ceph-mon[125939]: pgmap v14838: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 666 KiB/s wr, 13 op/s 2023-05-08T11:26:19.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27718.201721 secs 2023-05-08T11:26:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:19 smithi096 ceph-mon[124666]: pgmap v14838: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 666 KiB/s wr, 13 op/s 2023-05-08T11:26:20.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27718.201721 secs 2023-05-08T11:26:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27718.756885 secs 2023-05-08T11:26:20.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:20 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:26:20.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:20 smithi186 ceph-mon[126480]: osdmap e1005: 12 total, 12 up, 12 in 2023-05-08T11:26:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27718.756885 secs 2023-05-08T11:26:20.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:20 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:26:20.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:20 smithi133 ceph-mon[125939]: osdmap e1005: 12 total, 12 up, 12 in 2023-05-08T11:26:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27718.756885 secs 2023-05-08T11:26:21.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:20 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:26:21.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:20 smithi096 ceph-mon[124666]: osdmap e1005: 12 total, 12 up, 12 in 2023-05-08T11:26:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27720.045479 secs 2023-05-08T11:26:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:21 smithi186 ceph-mon[126480]: pgmap v14840: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 646 KiB/s rd, 564 KiB/s wr, 12 op/s 2023-05-08T11:26:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27720.045479 secs 2023-05-08T11:26:21.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:21 smithi133 ceph-mon[125939]: pgmap v14840: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 646 KiB/s rd, 564 KiB/s wr, 12 op/s 2023-05-08T11:26:22.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27720.045479 secs 2023-05-08T11:26:22.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:21 smithi096 ceph-mon[124666]: pgmap v14840: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 646 KiB/s rd, 564 KiB/s wr, 12 op/s 2023-05-08T11:26:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:23 smithi186 ceph-mon[126480]: pgmap v14841: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 585 KiB/s rd, 510 KiB/s wr, 11 op/s 2023-05-08T11:26:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:23 smithi133 ceph-mon[125939]: pgmap v14841: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 585 KiB/s rd, 510 KiB/s wr, 11 op/s 2023-05-08T11:26:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:23 smithi096 ceph-mon[124666]: pgmap v14841: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 585 KiB/s rd, 510 KiB/s wr, 11 op/s 2023-05-08T11:26:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27723.201835 secs 2023-05-08T11:26:24.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27723.201835 secs 2023-05-08T11:26:25.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27723.201835 secs 2023-05-08T11:26:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27723.756999 secs 2023-05-08T11:26:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:25 smithi186 ceph-mon[126480]: pgmap v14842: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 270 KiB/s wr, 8 op/s 2023-05-08T11:26:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27723.756999 secs 2023-05-08T11:26:25.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:25 smithi133 ceph-mon[125939]: pgmap v14842: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 270 KiB/s wr, 8 op/s 2023-05-08T11:26:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27723.756999 secs 2023-05-08T11:26:26.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:25 smithi096 ceph-mon[124666]: pgmap v14842: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 270 KiB/s wr, 8 op/s 2023-05-08T11:26:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27725.045574 secs 2023-05-08T11:26:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27725.045574 secs 2023-05-08T11:26:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27725.045574 secs 2023-05-08T11:26:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:27 smithi186 ceph-mon[126480]: pgmap v14843: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 270 KiB/s wr, 8 op/s 2023-05-08T11:26:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:27 smithi133 ceph-mon[125939]: pgmap v14843: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 270 KiB/s wr, 8 op/s 2023-05-08T11:26:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:27 smithi096 ceph-mon[124666]: pgmap v14843: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 270 KiB/s wr, 8 op/s 2023-05-08T11:26:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:29 smithi186 ceph-mon[126480]: pgmap v14844: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 270 KiB/s wr, 8 op/s 2023-05-08T11:26:29.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27728.201913 secs 2023-05-08T11:26:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:29 smithi133 ceph-mon[125939]: pgmap v14844: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 270 KiB/s wr, 8 op/s 2023-05-08T11:26:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27728.201913 secs 2023-05-08T11:26:30.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:29 smithi096 ceph-mon[124666]: pgmap v14844: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 270 KiB/s wr, 8 op/s 2023-05-08T11:26:30.009 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27728.201913 secs 2023-05-08T11:26:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27728.757115 secs 2023-05-08T11:26:30.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27728.757115 secs 2023-05-08T11:26:31.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27728.757115 secs 2023-05-08T11:26:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27730.045639 secs 2023-05-08T11:26:31.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:31 smithi186 ceph-mon[126480]: pgmap v14845: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 267 KiB/s wr, 6 op/s 2023-05-08T11:26:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27730.045639 secs 2023-05-08T11:26:31.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:31 smithi133 ceph-mon[125939]: pgmap v14845: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 267 KiB/s wr, 6 op/s 2023-05-08T11:26:32.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27730.045639 secs 2023-05-08T11:26:32.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:31 smithi096 ceph-mon[124666]: pgmap v14845: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 267 KiB/s wr, 6 op/s 2023-05-08T11:26:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:33 smithi186 ceph-mon[126480]: pgmap v14846: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 224 KiB/s wr, 5 op/s 2023-05-08T11:26:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:33 smithi133 ceph-mon[125939]: pgmap v14846: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 224 KiB/s wr, 5 op/s 2023-05-08T11:26:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:33 smithi096 ceph-mon[124666]: pgmap v14846: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 224 KiB/s wr, 5 op/s 2023-05-08T11:26:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27733.202048 secs 2023-05-08T11:26:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27733.202048 secs 2023-05-08T11:26:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27733.202048 secs 2023-05-08T11:26:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27733.757227 secs 2023-05-08T11:26:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:35 smithi186 ceph-mon[126480]: pgmap v14847: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 320 KiB/s wr, 8 op/s 2023-05-08T11:26:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27733.757227 secs 2023-05-08T11:26:35.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:35 smithi133 ceph-mon[125939]: pgmap v14847: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 320 KiB/s wr, 8 op/s 2023-05-08T11:26:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27733.757227 secs 2023-05-08T11:26:36.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:35 smithi096 ceph-mon[124666]: pgmap v14847: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 320 KiB/s wr, 8 op/s 2023-05-08T11:26:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27735.045758 secs 2023-05-08T11:26:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27735.045758 secs 2023-05-08T11:26:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27735.045758 secs 2023-05-08T11:26:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:37 smithi186 ceph-mon[126480]: pgmap v14848: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 96 KiB/s wr, 5 op/s 2023-05-08T11:26:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:37 smithi133 ceph-mon[125939]: pgmap v14848: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 96 KiB/s wr, 5 op/s 2023-05-08T11:26:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:37 smithi096 ceph-mon[124666]: pgmap v14848: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 96 KiB/s wr, 5 op/s 2023-05-08T11:26:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:39 smithi186 ceph-mon[126480]: pgmap v14849: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 96 KiB/s wr, 5 op/s 2023-05-08T11:26:39.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27738.202148 secs 2023-05-08T11:26:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:39 smithi133 ceph-mon[125939]: pgmap v14849: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 96 KiB/s wr, 5 op/s 2023-05-08T11:26:39.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27738.202148 secs 2023-05-08T11:26:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:39 smithi096 ceph-mon[124666]: pgmap v14849: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 96 KiB/s wr, 5 op/s 2023-05-08T11:26:40.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27738.202148 secs 2023-05-08T11:26:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27738.757345 secs 2023-05-08T11:26:40.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27738.757345 secs 2023-05-08T11:26:41.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27738.757345 secs 2023-05-08T11:26:41.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27740.045861 secs 2023-05-08T11:26:41.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:41 smithi186 ceph-mon[126480]: pgmap v14850: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 96 KiB/s wr, 7 op/s 2023-05-08T11:26:41.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27740.045861 secs 2023-05-08T11:26:41.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:41 smithi133 ceph-mon[125939]: pgmap v14850: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 96 KiB/s wr, 7 op/s 2023-05-08T11:26:42.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27740.045861 secs 2023-05-08T11:26:42.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:41 smithi096 ceph-mon[124666]: pgmap v14850: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 96 KiB/s wr, 7 op/s 2023-05-08T11:26:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:43 smithi186 ceph-mon[126480]: pgmap v14851: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 96 KiB/s wr, 5 op/s 2023-05-08T11:26:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:43 smithi133 ceph-mon[125939]: pgmap v14851: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 96 KiB/s wr, 5 op/s 2023-05-08T11:26:44.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:43 smithi096 ceph-mon[124666]: pgmap v14851: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 96 KiB/s wr, 5 op/s 2023-05-08T11:26:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27743.202269 secs 2023-05-08T11:26:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27743.202269 secs 2023-05-08T11:26:45.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27743.202269 secs 2023-05-08T11:26:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27743.757462 secs 2023-05-08T11:26:45.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:45 smithi186 ceph-mon[126480]: pgmap v14852: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 146 KiB/s wr, 8 op/s 2023-05-08T11:26:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27743.757462 secs 2023-05-08T11:26:45.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:45 smithi133 ceph-mon[125939]: pgmap v14852: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 146 KiB/s wr, 8 op/s 2023-05-08T11:26:46.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27743.757462 secs 2023-05-08T11:26:46.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:45 smithi096 ceph-mon[124666]: pgmap v14852: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 146 KiB/s wr, 8 op/s 2023-05-08T11:26:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:47 smithi186 ceph-mon[126480]: pgmap v14853: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 50 KiB/s wr, 5 op/s 2023-05-08T11:26:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:47 smithi133 ceph-mon[125939]: pgmap v14853: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 50 KiB/s wr, 5 op/s 2023-05-08T11:26:48.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:47 smithi096 ceph-mon[124666]: pgmap v14853: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 50 KiB/s wr, 5 op/s 2023-05-08T11:26:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:26:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:26:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:26:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:49 smithi186 ceph-mon[126480]: pgmap v14854: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 50 KiB/s wr, 5 op/s 2023-05-08T11:26:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27748.202399 secs 2023-05-08T11:26:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:26:49.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:26:49.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:26:49.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:49 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:26:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:49 smithi133 ceph-mon[125939]: pgmap v14854: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 50 KiB/s wr, 5 op/s 2023-05-08T11:26:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27748.202399 secs 2023-05-08T11:26:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:26:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:26:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:26:49.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:49 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:26:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:49 smithi096 ceph-mon[124666]: pgmap v14854: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 50 KiB/s wr, 5 op/s 2023-05-08T11:26:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27748.202399 secs 2023-05-08T11:26:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:26:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:26:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:26:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:49 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:26:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27748.757563 secs 2023-05-08T11:26:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:26:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:26:50.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:50 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:26:50.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:26:50.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:50 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T11:26:50.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:50 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T11:26:50.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:50 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:26:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27748.757563 secs 2023-05-08T11:26:50.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:26:50.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:26:50.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:50 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:26:50.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:26:50.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:50 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T11:26:50.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:50 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T11:26:50.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:50 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:26:51.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27748.757563 secs 2023-05-08T11:26:51.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:26:51.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:26:51.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:50 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:26:51.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:26:51.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:50 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T11:26:51.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:50 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T11:26:51.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:50 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:26:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:51 smithi186 ceph-mon[126480]: pgmap v14855: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 554 KiB/s rd, 360 KiB/s wr, 9 op/s 2023-05-08T11:26:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:51 smithi133 ceph-mon[125939]: pgmap v14855: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 554 KiB/s rd, 360 KiB/s wr, 9 op/s 2023-05-08T11:26:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:51 smithi096 ceph-mon[124666]: pgmap v14855: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 554 KiB/s rd, 360 KiB/s wr, 9 op/s 2023-05-08T11:26:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:53 smithi186 ceph-mon[126480]: pgmap v14856: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 553 KiB/s rd, 360 KiB/s wr, 7 op/s 2023-05-08T11:26:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:53 smithi133 ceph-mon[125939]: pgmap v14856: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 553 KiB/s rd, 360 KiB/s wr, 7 op/s 2023-05-08T11:26:54.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:53 smithi096 ceph-mon[124666]: pgmap v14856: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 553 KiB/s rd, 360 KiB/s wr, 7 op/s 2023-05-08T11:26:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27753.202505 secs 2023-05-08T11:26:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27753.202505 secs 2023-05-08T11:26:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27753.202505 secs 2023-05-08T11:26:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:55 smithi186 ceph-mon[126480]: pgmap v14857: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 839 KiB/s wr, 13 op/s 2023-05-08T11:26:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:55 smithi133 ceph-mon[125939]: pgmap v14857: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 839 KiB/s wr, 13 op/s 2023-05-08T11:26:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:55 smithi096 ceph-mon[124666]: pgmap v14857: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 839 KiB/s wr, 13 op/s 2023-05-08T11:26:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:26:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:26:57.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:26:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:57 smithi186 ceph-mon[126480]: pgmap v14858: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 789 KiB/s wr, 9 op/s 2023-05-08T11:26:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:57 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:26:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:26:57.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:26:57.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:57 smithi133 ceph-mon[125939]: pgmap v14858: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 789 KiB/s wr, 9 op/s 2023-05-08T11:26:57.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:57 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:26:57.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:26:57.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:26:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:57 smithi096 ceph-mon[124666]: pgmap v14858: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 789 KiB/s wr, 9 op/s 2023-05-08T11:26:58.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:57 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:26:58.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:26:58.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:26:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:59 smithi133 ceph-mon[125939]: pgmap v14859: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 789 KiB/s wr, 9 op/s 2023-05-08T11:26:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:26:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27758.202571 secs 2023-05-08T11:27:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:59 smithi096 ceph-mon[124666]: pgmap v14859: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 789 KiB/s wr, 9 op/s 2023-05-08T11:27:00.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:26:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27758.202571 secs 2023-05-08T11:27:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:59 smithi186 ceph-mon[126480]: pgmap v14859: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 789 KiB/s wr, 9 op/s 2023-05-08T11:27:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:26:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27758.202571 secs 2023-05-08T11:27:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27758.757722 secs 2023-05-08T11:27:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27758.757722 secs 2023-05-08T11:27:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27758.757722 secs 2023-05-08T11:27:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27760.046310 secs 2023-05-08T11:27:01.997 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:01 smithi133 ceph-mon[125939]: pgmap v14860: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 15 op/s 2023-05-08T11:27:01.998 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:27:01.998 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:27:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27760.046310 secs 2023-05-08T11:27:02.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:01 smithi096 ceph-mon[124666]: pgmap v14860: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 15 op/s 2023-05-08T11:27:02.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:27:02.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:27:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27760.046310 secs 2023-05-08T11:27:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:01 smithi186 ceph-mon[126480]: pgmap v14860: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 15 op/s 2023-05-08T11:27:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:27:02.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:27:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:03 smithi133 ceph-mon[125939]: pgmap v14861: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 913 KiB/s rd, 822 KiB/s wr, 11 op/s 2023-05-08T11:27:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:03 smithi096 ceph-mon[124666]: pgmap v14861: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 913 KiB/s rd, 822 KiB/s wr, 11 op/s 2023-05-08T11:27:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:03 smithi186 ceph-mon[126480]: pgmap v14861: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 913 KiB/s rd, 822 KiB/s wr, 11 op/s 2023-05-08T11:27:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27763.202710 secs 2023-05-08T11:27:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27763.202710 secs 2023-05-08T11:27:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27763.202710 secs 2023-05-08T11:27:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27763.757818 secs 2023-05-08T11:27:05.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:05 smithi133 ceph-mon[125939]: pgmap v14862: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 18 op/s 2023-05-08T11:27:05.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:05 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:27:05.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:27:05.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:27:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27763.757818 secs 2023-05-08T11:27:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:05 smithi096 ceph-mon[124666]: pgmap v14862: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 18 op/s 2023-05-08T11:27:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:05 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:27:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:27:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:27:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27763.757818 secs 2023-05-08T11:27:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:05 smithi186 ceph-mon[126480]: pgmap v14862: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 18 op/s 2023-05-08T11:27:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:05 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:27:06.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:27:06.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:27:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:07 smithi133 ceph-mon[125939]: pgmap v14863: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 782 KiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T11:27:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:07 smithi096 ceph-mon[124666]: pgmap v14863: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 782 KiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T11:27:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:07 smithi186 ceph-mon[126480]: pgmap v14863: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 782 KiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T11:27:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:08 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:27:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:08 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:27:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:08 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:27:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:09 smithi133 ceph-mon[125939]: pgmap v14864: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 782 KiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T11:27:09.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27768.202847 secs 2023-05-08T11:27:09.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:27:09.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:27:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:09 smithi096 ceph-mon[124666]: pgmap v14864: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 782 KiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T11:27:10.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27768.202847 secs 2023-05-08T11:27:10.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:27:10.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:27:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:09 smithi186 ceph-mon[126480]: pgmap v14864: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 782 KiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T11:27:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27768.202847 secs 2023-05-08T11:27:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:27:10.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:27:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:10 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:27:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:10 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:27:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:10 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:27:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27770.046516 secs 2023-05-08T11:27:11.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:11 smithi133 ceph-mon[125939]: pgmap v14865: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 27 op/s 2023-05-08T11:27:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27770.046516 secs 2023-05-08T11:27:12.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:11 smithi096 ceph-mon[124666]: pgmap v14865: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 27 op/s 2023-05-08T11:27:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27770.046516 secs 2023-05-08T11:27:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:11 smithi186 ceph-mon[126480]: pgmap v14865: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 27 op/s 2023-05-08T11:27:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:12 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:27:13.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:12 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:27:13.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:12 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:27:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:13 smithi133 ceph-mon[125939]: pgmap v14866: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 848 KiB/s wr, 22 op/s 2023-05-08T11:27:13.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:27:13.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:27:13.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:13 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:27:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:13 smithi096 ceph-mon[124666]: pgmap v14866: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 848 KiB/s wr, 22 op/s 2023-05-08T11:27:14.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:27:14.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:27:14.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:13 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:27:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:13 smithi186 ceph-mon[126480]: pgmap v14866: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 848 KiB/s wr, 22 op/s 2023-05-08T11:27:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:27:14.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:27:14.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:13 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:27:14.997 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27773.202959 secs 2023-05-08T11:27:15.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27773.202959 secs 2023-05-08T11:27:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27773.202959 secs 2023-05-08T11:27:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27773.758099 secs 2023-05-08T11:27:15.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:15 smithi133 ceph-mon[125939]: pgmap v14867: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 29 op/s 2023-05-08T11:27:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27773.758099 secs 2023-05-08T11:27:16.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:15 smithi096 ceph-mon[124666]: pgmap v14867: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 29 op/s 2023-05-08T11:27:16.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27773.758099 secs 2023-05-08T11:27:16.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:15 smithi186 ceph-mon[126480]: pgmap v14867: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 29 op/s 2023-05-08T11:27:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27775.046673 secs 2023-05-08T11:27:16.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:16 smithi133 ceph-mon[125939]: osdmap e1006: 12 total, 12 up, 12 in 2023-05-08T11:27:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27775.046673 secs 2023-05-08T11:27:17.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:16 smithi096 ceph-mon[124666]: osdmap e1006: 12 total, 12 up, 12 in 2023-05-08T11:27:17.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27775.046673 secs 2023-05-08T11:27:17.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:16 smithi186 ceph-mon[126480]: osdmap e1006: 12 total, 12 up, 12 in 2023-05-08T11:27:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:17 smithi133 ceph-mon[125939]: pgmap v14869: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 858 KiB/s wr, 26 op/s 2023-05-08T11:27:17.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:17 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:27:17.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:17 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:27:17.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:17 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:27:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:17 smithi096 ceph-mon[124666]: pgmap v14869: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 858 KiB/s wr, 26 op/s 2023-05-08T11:27:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:17 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:27:18.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:17 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:27:18.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:17 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:27:18.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:17 smithi186 ceph-mon[126480]: pgmap v14869: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 858 KiB/s wr, 26 op/s 2023-05-08T11:27:18.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:17 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:27:18.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:17 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:27:18.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:17 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:27:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:19 smithi133 ceph-mon[125939]: pgmap v14870: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 858 KiB/s wr, 26 op/s 2023-05-08T11:27:19.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27778.203102 secs 2023-05-08T11:27:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:19 smithi096 ceph-mon[124666]: pgmap v14870: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 858 KiB/s wr, 26 op/s 2023-05-08T11:27:20.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27778.203102 secs 2023-05-08T11:27:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:19 smithi186 ceph-mon[126480]: pgmap v14870: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 858 KiB/s wr, 26 op/s 2023-05-08T11:27:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27778.203102 secs 2023-05-08T11:27:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27778.758216 secs 2023-05-08T11:27:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27778.758216 secs 2023-05-08T11:27:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27778.758216 secs 2023-05-08T11:27:21.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27780.046836 secs 2023-05-08T11:27:21.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:21 smithi133 ceph-mon[125939]: pgmap v14871: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 803 KiB/s rd, 827 KiB/s wr, 12 op/s 2023-05-08T11:27:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27780.046836 secs 2023-05-08T11:27:22.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:21 smithi096 ceph-mon[124666]: pgmap v14871: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 803 KiB/s rd, 827 KiB/s wr, 12 op/s 2023-05-08T11:27:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27780.046836 secs 2023-05-08T11:27:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:21 smithi186 ceph-mon[126480]: pgmap v14871: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 803 KiB/s rd, 827 KiB/s wr, 12 op/s 2023-05-08T11:27:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:23 smithi133 ceph-mon[125939]: pgmap v14872: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 803 KiB/s rd, 827 KiB/s wr, 12 op/s 2023-05-08T11:27:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:23 smithi096 ceph-mon[124666]: pgmap v14872: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 803 KiB/s rd, 827 KiB/s wr, 12 op/s 2023-05-08T11:27:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:23 smithi186 ceph-mon[126480]: pgmap v14872: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 803 KiB/s rd, 827 KiB/s wr, 12 op/s 2023-05-08T11:27:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27783.203216 secs 2023-05-08T11:27:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27783.203216 secs 2023-05-08T11:27:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27783.203216 secs 2023-05-08T11:27:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27783.758328 secs 2023-05-08T11:27:25.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:25 smithi133 ceph-mon[125939]: pgmap v14873: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 386 KiB/s rd, 99 KiB/s wr, 7 op/s 2023-05-08T11:27:25.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:25 smithi133 ceph-mon[125939]: osdmap e1007: 12 total, 12 up, 12 in 2023-05-08T11:27:26.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27783.758328 secs 2023-05-08T11:27:26.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:25 smithi096 ceph-mon[124666]: pgmap v14873: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 386 KiB/s rd, 99 KiB/s wr, 7 op/s 2023-05-08T11:27:26.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:25 smithi096 ceph-mon[124666]: osdmap e1007: 12 total, 12 up, 12 in 2023-05-08T11:27:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27783.758328 secs 2023-05-08T11:27:26.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:25 smithi186 ceph-mon[126480]: pgmap v14873: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 386 KiB/s rd, 99 KiB/s wr, 7 op/s 2023-05-08T11:27:26.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:25 smithi186 ceph-mon[126480]: osdmap e1007: 12 total, 12 up, 12 in 2023-05-08T11:27:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27785.046896 secs 2023-05-08T11:27:27.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27785.046896 secs 2023-05-08T11:27:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27785.046896 secs 2023-05-08T11:27:27.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:27 smithi133 ceph-mon[125939]: pgmap v14875: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 386 KiB/s rd, 99 KiB/s wr, 7 op/s 2023-05-08T11:27:28.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:27 smithi096 ceph-mon[124666]: pgmap v14875: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 386 KiB/s rd, 99 KiB/s wr, 7 op/s 2023-05-08T11:27:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:27 smithi186 ceph-mon[126480]: pgmap v14875: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 386 KiB/s rd, 99 KiB/s wr, 7 op/s 2023-05-08T11:27:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:29 smithi133 ceph-mon[125939]: pgmap v14876: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 386 KiB/s rd, 99 KiB/s wr, 7 op/s 2023-05-08T11:27:29.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27788.203330 secs 2023-05-08T11:27:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:29 smithi096 ceph-mon[124666]: pgmap v14876: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 386 KiB/s rd, 99 KiB/s wr, 7 op/s 2023-05-08T11:27:30.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27788.203330 secs 2023-05-08T11:27:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:29 smithi186 ceph-mon[126480]: pgmap v14876: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 386 KiB/s rd, 99 KiB/s wr, 7 op/s 2023-05-08T11:27:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27788.203330 secs 2023-05-08T11:27:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27788.758440 secs 2023-05-08T11:27:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27788.758440 secs 2023-05-08T11:27:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27788.758440 secs 2023-05-08T11:27:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27790.047029 secs 2023-05-08T11:27:31.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:31 smithi133 ceph-mon[125939]: pgmap v14877: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 98 KiB/s wr, 6 op/s 2023-05-08T11:27:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27790.047029 secs 2023-05-08T11:27:32.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:31 smithi096 ceph-mon[124666]: pgmap v14877: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 98 KiB/s wr, 6 op/s 2023-05-08T11:27:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27790.047029 secs 2023-05-08T11:27:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:31 smithi186 ceph-mon[126480]: pgmap v14877: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 98 KiB/s wr, 6 op/s 2023-05-08T11:27:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:33 smithi133 ceph-mon[125939]: pgmap v14878: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 98 KiB/s wr, 6 op/s 2023-05-08T11:27:34.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:33 smithi096 ceph-mon[124666]: pgmap v14878: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 98 KiB/s wr, 6 op/s 2023-05-08T11:27:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:33 smithi186 ceph-mon[126480]: pgmap v14878: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 98 KiB/s wr, 6 op/s 2023-05-08T11:27:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27793.203422 secs 2023-05-08T11:27:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27793.203422 secs 2023-05-08T11:27:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27793.203422 secs 2023-05-08T11:27:35.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27793.758554 secs 2023-05-08T11:27:35.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:35 smithi133 ceph-mon[125939]: pgmap v14879: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 78 KiB/s wr, 6 op/s 2023-05-08T11:27:36.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27793.758554 secs 2023-05-08T11:27:36.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:35 smithi096 ceph-mon[124666]: pgmap v14879: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 78 KiB/s wr, 6 op/s 2023-05-08T11:27:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27793.758554 secs 2023-05-08T11:27:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:35 smithi186 ceph-mon[126480]: pgmap v14879: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 78 KiB/s wr, 6 op/s 2023-05-08T11:27:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27795.047155 secs 2023-05-08T11:27:37.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27795.047155 secs 2023-05-08T11:27:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27795.047155 secs 2023-05-08T11:27:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:37 smithi133 ceph-mon[125939]: pgmap v14880: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 70 KiB/s wr, 5 op/s 2023-05-08T11:27:38.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:37 smithi096 ceph-mon[124666]: pgmap v14880: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 70 KiB/s wr, 5 op/s 2023-05-08T11:27:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:37 smithi186 ceph-mon[126480]: pgmap v14880: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 70 KiB/s wr, 5 op/s 2023-05-08T11:27:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:39 smithi133 ceph-mon[125939]: pgmap v14881: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 65 KiB/s wr, 5 op/s 2023-05-08T11:27:39.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27798.203518 secs 2023-05-08T11:27:39.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27798.758692 secs 2023-05-08T11:27:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:39 smithi096 ceph-mon[124666]: pgmap v14881: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 65 KiB/s wr, 5 op/s 2023-05-08T11:27:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27798.203518 secs 2023-05-08T11:27:40.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27798.758692 secs 2023-05-08T11:27:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:39 smithi186 ceph-mon[126480]: pgmap v14881: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 65 KiB/s wr, 5 op/s 2023-05-08T11:27:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27798.203518 secs 2023-05-08T11:27:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27798.758692 secs 2023-05-08T11:27:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27800.047288 secs 2023-05-08T11:27:41.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:41 smithi186 ceph-mon[126480]: pgmap v14882: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 65 KiB/s wr, 7 op/s 2023-05-08T11:27:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27800.047288 secs 2023-05-08T11:27:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:41 smithi133 ceph-mon[125939]: pgmap v14882: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 65 KiB/s wr, 7 op/s 2023-05-08T11:27:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27800.047288 secs 2023-05-08T11:27:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:41 smithi096 ceph-mon[124666]: pgmap v14882: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 65 KiB/s wr, 7 op/s 2023-05-08T11:27:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:43 smithi133 ceph-mon[125939]: pgmap v14883: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 65 KiB/s wr, 5 op/s 2023-05-08T11:27:43.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:43 smithi096 ceph-mon[124666]: pgmap v14883: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 65 KiB/s wr, 5 op/s 2023-05-08T11:27:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:43 smithi186 ceph-mon[126480]: pgmap v14883: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 65 KiB/s wr, 5 op/s 2023-05-08T11:27:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27803.203651 secs 2023-05-08T11:27:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27803.203651 secs 2023-05-08T11:27:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27803.203651 secs 2023-05-08T11:27:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27803.758794 secs 2023-05-08T11:27:45.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:45 smithi133 ceph-mon[125939]: pgmap v14884: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 87 KiB/s wr, 8 op/s 2023-05-08T11:27:45.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27803.758794 secs 2023-05-08T11:27:45.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:45 smithi096 ceph-mon[124666]: pgmap v14884: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 87 KiB/s wr, 8 op/s 2023-05-08T11:27:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27803.758794 secs 2023-05-08T11:27:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:45 smithi186 ceph-mon[126480]: pgmap v14884: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 87 KiB/s wr, 8 op/s 2023-05-08T11:27:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:47 smithi133 ceph-mon[125939]: pgmap v14885: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 22 KiB/s wr, 5 op/s 2023-05-08T11:27:47.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:47 smithi096 ceph-mon[124666]: pgmap v14885: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 22 KiB/s wr, 5 op/s 2023-05-08T11:27:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:47 smithi186 ceph-mon[126480]: pgmap v14885: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 22 KiB/s wr, 5 op/s 2023-05-08T11:27:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:27:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:27:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:27:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:49 smithi133 ceph-mon[125939]: pgmap v14886: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 22 KiB/s wr, 5 op/s 2023-05-08T11:27:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:27:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:27:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:27:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27808.203743 secs 2023-05-08T11:27:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:49 smithi096 ceph-mon[124666]: pgmap v14886: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 22 KiB/s wr, 5 op/s 2023-05-08T11:27:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:27:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:27:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:27:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27808.203743 secs 2023-05-08T11:27:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:49 smithi186 ceph-mon[126480]: pgmap v14886: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 22 KiB/s wr, 5 op/s 2023-05-08T11:27:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:27:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:27:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:27:49.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27808.203743 secs 2023-05-08T11:27:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27808.758874 secs 2023-05-08T11:27:50.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:27:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27808.758874 secs 2023-05-08T11:27:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:27:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27808.758874 secs 2023-05-08T11:27:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:27:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:51 smithi133 ceph-mon[125939]: pgmap v14887: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 363 KiB/s wr, 9 op/s 2023-05-08T11:27:51.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:51 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:27:51.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:51 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:27:51.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:51 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:27:51.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:51 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:27:51.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:51 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T11:27:51.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:51 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T11:27:51.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:51 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:27:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:51 smithi096 ceph-mon[124666]: pgmap v14887: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 363 KiB/s wr, 9 op/s 2023-05-08T11:27:51.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:51 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:27:51.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:51 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:27:51.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:51 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:27:51.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:51 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:27:51.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:51 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T11:27:51.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:51 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T11:27:51.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:51 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:27:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:51 smithi186 ceph-mon[126480]: pgmap v14887: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 363 KiB/s wr, 9 op/s 2023-05-08T11:27:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:51 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:27:51.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:51 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:27:51.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:51 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:27:51.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:51 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:27:51.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:51 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T11:27:51.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:51 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T11:27:51.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:51 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:27:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:53 smithi133 ceph-mon[125939]: pgmap v14888: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 477 KiB/s rd, 363 KiB/s wr, 6 op/s 2023-05-08T11:27:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:53 smithi096 ceph-mon[124666]: pgmap v14888: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 477 KiB/s rd, 363 KiB/s wr, 6 op/s 2023-05-08T11:27:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:53 smithi186 ceph-mon[126480]: pgmap v14888: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 477 KiB/s rd, 363 KiB/s wr, 6 op/s 2023-05-08T11:27:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27813.203844 secs 2023-05-08T11:27:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27813.203844 secs 2023-05-08T11:27:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27813.203844 secs 2023-05-08T11:27:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:55 smithi133 ceph-mon[125939]: pgmap v14889: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 856 KiB/s rd, 648 KiB/s wr, 11 op/s 2023-05-08T11:27:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:55 smithi096 ceph-mon[124666]: pgmap v14889: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 856 KiB/s rd, 648 KiB/s wr, 11 op/s 2023-05-08T11:27:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:55 smithi186 ceph-mon[126480]: pgmap v14889: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 856 KiB/s rd, 648 KiB/s wr, 11 op/s 2023-05-08T11:27:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:27:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:27:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:27:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:57 smithi133 ceph-mon[125939]: pgmap v14890: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 811 KiB/s rd, 626 KiB/s wr, 8 op/s 2023-05-08T11:27:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:57 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:27:57.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:27:57.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:27:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:57 smithi096 ceph-mon[124666]: pgmap v14890: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 811 KiB/s rd, 626 KiB/s wr, 8 op/s 2023-05-08T11:27:57.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:57 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:27:57.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:27:57.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:27:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:57 smithi186 ceph-mon[126480]: pgmap v14890: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 811 KiB/s rd, 626 KiB/s wr, 8 op/s 2023-05-08T11:27:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:57 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:27:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:27:57.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:27:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:59 smithi133 ceph-mon[125939]: pgmap v14891: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 811 KiB/s rd, 626 KiB/s wr, 8 op/s 2023-05-08T11:27:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:27:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27818.203973 secs 2023-05-08T11:27:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:59 smithi096 ceph-mon[124666]: pgmap v14891: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 811 KiB/s rd, 626 KiB/s wr, 8 op/s 2023-05-08T11:27:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:27:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27818.203973 secs 2023-05-08T11:27:59.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:59 smithi186 ceph-mon[126480]: pgmap v14891: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 811 KiB/s rd, 626 KiB/s wr, 8 op/s 2023-05-08T11:27:59.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:27:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27818.203973 secs 2023-05-08T11:28:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27818.759124 secs 2023-05-08T11:28:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27818.759124 secs 2023-05-08T11:28:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27818.759124 secs 2023-05-08T11:28:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27820.047723 secs 2023-05-08T11:28:01.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:01 smithi133 ceph-mon[125939]: pgmap v14892: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1024 KiB/s wr, 14 op/s 2023-05-08T11:28:01.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:28:01.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:28:01.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27820.047723 secs 2023-05-08T11:28:01.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:01 smithi096 ceph-mon[124666]: pgmap v14892: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1024 KiB/s wr, 14 op/s 2023-05-08T11:28:01.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:28:01.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:28:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27820.047723 secs 2023-05-08T11:28:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:01 smithi186 ceph-mon[126480]: pgmap v14892: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1024 KiB/s wr, 14 op/s 2023-05-08T11:28:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:28:01.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:28:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:03 smithi133 ceph-mon[125939]: pgmap v14893: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 787 KiB/s rd, 682 KiB/s wr, 10 op/s 2023-05-08T11:28:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:03 smithi096 ceph-mon[124666]: pgmap v14893: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 787 KiB/s rd, 682 KiB/s wr, 10 op/s 2023-05-08T11:28:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:03 smithi186 ceph-mon[126480]: pgmap v14893: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 787 KiB/s rd, 682 KiB/s wr, 10 op/s 2023-05-08T11:28:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27823.204095 secs 2023-05-08T11:28:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:04 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:28:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27823.204095 secs 2023-05-08T11:28:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:04 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:28:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27823.204095 secs 2023-05-08T11:28:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:04 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:28:05.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:05 smithi133 ceph-mon[125939]: pgmap v14894: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 971 KiB/s wr, 28 op/s 2023-05-08T11:28:05.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:28:05.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:28:05.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:28:05.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:05 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:28:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:05 smithi096 ceph-mon[124666]: pgmap v14894: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 971 KiB/s wr, 28 op/s 2023-05-08T11:28:05.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:28:05.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:28:05.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:28:05.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:05 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:28:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:05 smithi186 ceph-mon[126480]: pgmap v14894: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 971 KiB/s wr, 28 op/s 2023-05-08T11:28:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:28:05.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:28:05.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:28:05.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:05 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:28:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:07 smithi133 ceph-mon[125939]: pgmap v14895: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 668 KiB/s rd, 687 KiB/s wr, 24 op/s 2023-05-08T11:28:07.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:07 smithi096 ceph-mon[124666]: pgmap v14895: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 668 KiB/s rd, 687 KiB/s wr, 24 op/s 2023-05-08T11:28:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:07 smithi186 ceph-mon[126480]: pgmap v14895: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 668 KiB/s rd, 687 KiB/s wr, 24 op/s 2023-05-08T11:28:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:08 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:28:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:08 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:28:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:08 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:28:09.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:09 smithi133 ceph-mon[125939]: pgmap v14896: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 668 KiB/s rd, 686 KiB/s wr, 24 op/s 2023-05-08T11:28:09.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:28:09.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:28:09.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27828.204221 secs 2023-05-08T11:28:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:09 smithi096 ceph-mon[124666]: pgmap v14896: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 668 KiB/s rd, 686 KiB/s wr, 24 op/s 2023-05-08T11:28:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:28:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:28:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27828.204221 secs 2023-05-08T11:28:09.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:09 smithi186 ceph-mon[126480]: pgmap v14896: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 668 KiB/s rd, 686 KiB/s wr, 24 op/s 2023-05-08T11:28:09.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:28:09.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:28:09.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27828.204221 secs 2023-05-08T11:28:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27828.759347 secs 2023-05-08T11:28:10.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:10 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:28:10.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27828.759347 secs 2023-05-08T11:28:10.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:10 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:28:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27828.759347 secs 2023-05-08T11:28:10.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:10 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:28:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27830.047925 secs 2023-05-08T11:28:11.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:11 smithi133 ceph-mon[125939]: pgmap v14897: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 986 KiB/s rd, 1010 KiB/s wr, 31 op/s 2023-05-08T11:28:11.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:11 smithi133 ceph-mon[125939]: osdmap e1008: 12 total, 12 up, 12 in 2023-05-08T11:28:11.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27830.047925 secs 2023-05-08T11:28:11.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:11 smithi096 ceph-mon[124666]: pgmap v14897: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 986 KiB/s rd, 1010 KiB/s wr, 31 op/s 2023-05-08T11:28:11.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:11 smithi096 ceph-mon[124666]: osdmap e1008: 12 total, 12 up, 12 in 2023-05-08T11:28:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27830.047925 secs 2023-05-08T11:28:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:11 smithi186 ceph-mon[126480]: pgmap v14897: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 986 KiB/s rd, 1010 KiB/s wr, 31 op/s 2023-05-08T11:28:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:11 smithi186 ceph-mon[126480]: osdmap e1008: 12 total, 12 up, 12 in 2023-05-08T11:28:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:13 smithi133 ceph-mon[125939]: pgmap v14899: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 693 KiB/s rd, 735 KiB/s wr, 30 op/s 2023-05-08T11:28:13.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:28:13.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:28:13.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:13 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:28:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:13 smithi096 ceph-mon[124666]: pgmap v14899: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 693 KiB/s rd, 735 KiB/s wr, 30 op/s 2023-05-08T11:28:13.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:28:13.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:28:13.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:13 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:28:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:13 smithi186 ceph-mon[126480]: pgmap v14899: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 693 KiB/s rd, 735 KiB/s wr, 30 op/s 2023-05-08T11:28:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:28:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:28:13.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:13 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:28:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27833.204352 secs 2023-05-08T11:28:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27833.204352 secs 2023-05-08T11:28:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27833.204352 secs 2023-05-08T11:28:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27833.759485 secs 2023-05-08T11:28:15.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:15 smithi133 ceph-mon[125939]: pgmap v14900: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 528 KiB/s wr, 14 op/s 2023-05-08T11:28:15.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:15 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:28:15.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27833.759485 secs 2023-05-08T11:28:15.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:15 smithi096 ceph-mon[124666]: pgmap v14900: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 528 KiB/s wr, 14 op/s 2023-05-08T11:28:15.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:15 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:28:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27833.759485 secs 2023-05-08T11:28:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:15 smithi186 ceph-mon[126480]: pgmap v14900: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 528 KiB/s wr, 14 op/s 2023-05-08T11:28:15.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:15 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:28:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27835.047987 secs 2023-05-08T11:28:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27835.047987 secs 2023-05-08T11:28:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27835.047987 secs 2023-05-08T11:28:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:17 smithi133 ceph-mon[125939]: pgmap v14901: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 528 KiB/s wr, 13 op/s 2023-05-08T11:28:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:17 smithi096 ceph-mon[124666]: pgmap v14901: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 528 KiB/s wr, 13 op/s 2023-05-08T11:28:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:17 smithi186 ceph-mon[126480]: pgmap v14901: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 528 KiB/s wr, 13 op/s 2023-05-08T11:28:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:19 smithi133 ceph-mon[125939]: pgmap v14902: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 528 KiB/s wr, 13 op/s 2023-05-08T11:28:19.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27838.204470 secs 2023-05-08T11:28:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:19 smithi096 ceph-mon[124666]: pgmap v14902: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 528 KiB/s wr, 13 op/s 2023-05-08T11:28:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27838.204470 secs 2023-05-08T11:28:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:19 smithi186 ceph-mon[126480]: pgmap v14902: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 528 KiB/s wr, 13 op/s 2023-05-08T11:28:19.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27838.204470 secs 2023-05-08T11:28:20.746 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27838.759584 secs 2023-05-08T11:28:20.746 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:20 smithi133 ceph-mon[125939]: osdmap e1009: 12 total, 12 up, 12 in 2023-05-08T11:28:20.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27838.759584 secs 2023-05-08T11:28:20.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:20 smithi096 ceph-mon[124666]: osdmap e1009: 12 total, 12 up, 12 in 2023-05-08T11:28:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27838.759584 secs 2023-05-08T11:28:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:20 smithi186 ceph-mon[126480]: osdmap e1009: 12 total, 12 up, 12 in 2023-05-08T11:28:21.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27840.048112 secs 2023-05-08T11:28:21.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:21 smithi133 ceph-mon[125939]: pgmap v14904: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 263 KiB/s wr, 9 op/s 2023-05-08T11:28:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27840.048112 secs 2023-05-08T11:28:21.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:21 smithi096 ceph-mon[124666]: pgmap v14904: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 263 KiB/s wr, 9 op/s 2023-05-08T11:28:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27840.048112 secs 2023-05-08T11:28:21.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:21 smithi186 ceph-mon[126480]: pgmap v14904: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 263 KiB/s wr, 9 op/s 2023-05-08T11:28:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:23 smithi096 ceph-mon[124666]: pgmap v14905: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 238 KiB/s wr, 8 op/s 2023-05-08T11:28:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:23 smithi186 ceph-mon[126480]: pgmap v14905: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 238 KiB/s wr, 8 op/s 2023-05-08T11:28:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:23 smithi133 ceph-mon[125939]: pgmap v14905: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 238 KiB/s wr, 8 op/s 2023-05-08T11:28:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27843.204591 secs 2023-05-08T11:28:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27843.204591 secs 2023-05-08T11:28:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27843.204591 secs 2023-05-08T11:28:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27843.759693 secs 2023-05-08T11:28:25.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:25 smithi096 ceph-mon[124666]: pgmap v14906: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 98 KiB/s wr, 6 op/s 2023-05-08T11:28:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27843.759693 secs 2023-05-08T11:28:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:25 smithi186 ceph-mon[126480]: pgmap v14906: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 98 KiB/s wr, 6 op/s 2023-05-08T11:28:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27843.759693 secs 2023-05-08T11:28:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:25 smithi133 ceph-mon[125939]: pgmap v14906: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 98 KiB/s wr, 6 op/s 2023-05-08T11:28:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27845.048233 secs 2023-05-08T11:28:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27845.048233 secs 2023-05-08T11:28:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27845.048233 secs 2023-05-08T11:28:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:27 smithi096 ceph-mon[124666]: pgmap v14907: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 98 KiB/s wr, 6 op/s 2023-05-08T11:28:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:27 smithi186 ceph-mon[126480]: pgmap v14907: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 98 KiB/s wr, 6 op/s 2023-05-08T11:28:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:27 smithi133 ceph-mon[125939]: pgmap v14907: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 98 KiB/s wr, 6 op/s 2023-05-08T11:28:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:29 smithi186 ceph-mon[126480]: pgmap v14908: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 98 KiB/s wr, 6 op/s 2023-05-08T11:28:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27848.204669 secs 2023-05-08T11:28:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:29 smithi133 ceph-mon[125939]: pgmap v14908: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 98 KiB/s wr, 6 op/s 2023-05-08T11:28:29.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27848.204669 secs 2023-05-08T11:28:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:29 smithi096 ceph-mon[124666]: pgmap v14908: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 98 KiB/s wr, 6 op/s 2023-05-08T11:28:30.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27848.204669 secs 2023-05-08T11:28:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27848.759758 secs 2023-05-08T11:28:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27848.759758 secs 2023-05-08T11:28:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27848.759758 secs 2023-05-08T11:28:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27850.048378 secs 2023-05-08T11:28:31.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:31 smithi186 ceph-mon[126480]: pgmap v14909: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T11:28:31.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27850.048378 secs 2023-05-08T11:28:31.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:31 smithi133 ceph-mon[125939]: pgmap v14909: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T11:28:32.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27850.048378 secs 2023-05-08T11:28:32.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:31 smithi096 ceph-mon[124666]: pgmap v14909: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T11:28:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:33 smithi186 ceph-mon[126480]: pgmap v14910: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T11:28:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:33 smithi133 ceph-mon[125939]: pgmap v14910: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T11:28:34.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:33 smithi096 ceph-mon[124666]: pgmap v14910: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T11:28:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27853.204764 secs 2023-05-08T11:28:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27853.204764 secs 2023-05-08T11:28:35.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27853.204764 secs 2023-05-08T11:28:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27853.759900 secs 2023-05-08T11:28:35.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:35 smithi186 ceph-mon[126480]: pgmap v14911: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T11:28:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27853.759900 secs 2023-05-08T11:28:35.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:35 smithi133 ceph-mon[125939]: pgmap v14911: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T11:28:36.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27853.759900 secs 2023-05-08T11:28:36.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:35 smithi096 ceph-mon[124666]: pgmap v14911: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T11:28:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27855.048483 secs 2023-05-08T11:28:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27855.048483 secs 2023-05-08T11:28:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27855.048483 secs 2023-05-08T11:28:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:37 smithi186 ceph-mon[126480]: pgmap v14912: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T11:28:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:37 smithi133 ceph-mon[125939]: pgmap v14912: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T11:28:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:37 smithi096 ceph-mon[124666]: pgmap v14912: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T11:28:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:39 smithi186 ceph-mon[126480]: pgmap v14913: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T11:28:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27858.204914 secs 2023-05-08T11:28:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:39 smithi133 ceph-mon[125939]: pgmap v14913: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T11:28:39.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27858.204914 secs 2023-05-08T11:28:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:39 smithi096 ceph-mon[124666]: pgmap v14913: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T11:28:40.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27858.204914 secs 2023-05-08T11:28:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27858.760001 secs 2023-05-08T11:28:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27858.760001 secs 2023-05-08T11:28:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27858.760001 secs 2023-05-08T11:28:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27860.048610 secs 2023-05-08T11:28:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:41 smithi186 ceph-mon[126480]: pgmap v14914: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 95 KiB/s wr, 8 op/s 2023-05-08T11:28:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27860.048610 secs 2023-05-08T11:28:41.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:41 smithi133 ceph-mon[125939]: pgmap v14914: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 95 KiB/s wr, 8 op/s 2023-05-08T11:28:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27860.048610 secs 2023-05-08T11:28:42.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:41 smithi096 ceph-mon[124666]: pgmap v14914: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 95 KiB/s wr, 8 op/s 2023-05-08T11:28:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:43 smithi186 ceph-mon[126480]: pgmap v14915: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 95 KiB/s wr, 6 op/s 2023-05-08T11:28:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:43 smithi133 ceph-mon[125939]: pgmap v14915: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 95 KiB/s wr, 6 op/s 2023-05-08T11:28:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:43 smithi096 ceph-mon[124666]: pgmap v14915: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 95 KiB/s wr, 6 op/s 2023-05-08T11:28:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27863.205050 secs 2023-05-08T11:28:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27863.205050 secs 2023-05-08T11:28:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27863.205050 secs 2023-05-08T11:28:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27863.760143 secs 2023-05-08T11:28:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:45 smithi186 ceph-mon[126480]: pgmap v14916: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 106 KiB/s wr, 10 op/s 2023-05-08T11:28:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27863.760143 secs 2023-05-08T11:28:45.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:45 smithi133 ceph-mon[125939]: pgmap v14916: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 106 KiB/s wr, 10 op/s 2023-05-08T11:28:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27863.760143 secs 2023-05-08T11:28:46.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:45 smithi096 ceph-mon[124666]: pgmap v14916: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 106 KiB/s wr, 10 op/s 2023-05-08T11:28:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:47 smithi186 ceph-mon[126480]: pgmap v14917: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 106 KiB/s wr, 7 op/s 2023-05-08T11:28:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:47 smithi133 ceph-mon[125939]: pgmap v14917: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 106 KiB/s wr, 7 op/s 2023-05-08T11:28:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:47 smithi096 ceph-mon[124666]: pgmap v14917: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 106 KiB/s wr, 7 op/s 2023-05-08T11:28:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:28:48.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:28:49.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:28:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:49 smithi186 ceph-mon[126480]: pgmap v14918: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 106 KiB/s wr, 7 op/s 2023-05-08T11:28:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27868.205163 secs 2023-05-08T11:28:49.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:28:49.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:28:49.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:28:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:49 smithi133 ceph-mon[125939]: pgmap v14918: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 106 KiB/s wr, 7 op/s 2023-05-08T11:28:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27868.205163 secs 2023-05-08T11:28:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:28:49.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:28:49.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:28:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:49 smithi096 ceph-mon[124666]: pgmap v14918: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 106 KiB/s wr, 7 op/s 2023-05-08T11:28:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27868.205163 secs 2023-05-08T11:28:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:28:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:28:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:28:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27868.760268 secs 2023-05-08T11:28:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27868.760268 secs 2023-05-08T11:28:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27868.760268 secs 2023-05-08T11:28:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:51 smithi186 ceph-mon[126480]: pgmap v14919: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 353 KiB/s wr, 10 op/s 2023-05-08T11:28:51.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:51 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:28:51.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:51 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:28:51.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:51 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:28:51.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:51 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:28:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:51 smithi133 ceph-mon[125939]: pgmap v14919: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 353 KiB/s wr, 10 op/s 2023-05-08T11:28:51.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:51 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:28:51.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:51 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:28:51.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:51 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:28:51.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:51 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:28:52.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:51 smithi096 ceph-mon[124666]: pgmap v14919: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 353 KiB/s wr, 10 op/s 2023-05-08T11:28:52.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:51 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:28:52.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:51 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:28:52.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:51 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:28:52.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:51 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:28:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:52 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:28:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:52 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T11:28:52.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:52 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T11:28:52.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:52 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:28:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:52 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:28:52.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:52 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T11:28:52.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:52 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T11:28:52.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:52 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:28:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:52 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:28:53.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:52 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T11:28:53.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:52 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T11:28:53.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:52 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:28:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:53 smithi186 ceph-mon[126480]: pgmap v14920: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 449 KiB/s rd, 258 KiB/s wr, 7 op/s 2023-05-08T11:28:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:53 smithi133 ceph-mon[125939]: pgmap v14920: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 449 KiB/s rd, 258 KiB/s wr, 7 op/s 2023-05-08T11:28:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:53 smithi096 ceph-mon[124666]: pgmap v14920: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 449 KiB/s rd, 258 KiB/s wr, 7 op/s 2023-05-08T11:28:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27873.205230 secs 2023-05-08T11:28:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27873.205230 secs 2023-05-08T11:28:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27873.205230 secs 2023-05-08T11:28:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:55 smithi186 ceph-mon[126480]: pgmap v14921: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 772 KiB/s wr, 12 op/s 2023-05-08T11:28:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:55 smithi133 ceph-mon[125939]: pgmap v14921: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 772 KiB/s wr, 12 op/s 2023-05-08T11:28:56.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:55 smithi096 ceph-mon[124666]: pgmap v14921: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 772 KiB/s wr, 12 op/s 2023-05-08T11:28:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:28:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:28:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:28:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:57 smithi186 ceph-mon[126480]: pgmap v14922: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 920 KiB/s rd, 761 KiB/s wr, 8 op/s 2023-05-08T11:28:57.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:57 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:28:57.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:28:57.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:28:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:57 smithi133 ceph-mon[125939]: pgmap v14922: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 920 KiB/s rd, 761 KiB/s wr, 8 op/s 2023-05-08T11:28:57.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:57 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:28:57.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:28:57.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:28:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:57 smithi096 ceph-mon[124666]: pgmap v14922: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 920 KiB/s rd, 761 KiB/s wr, 8 op/s 2023-05-08T11:28:58.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:57 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:28:58.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:28:58.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:28:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:59 smithi186 ceph-mon[126480]: pgmap v14923: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 920 KiB/s rd, 761 KiB/s wr, 8 op/s 2023-05-08T11:28:59.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:28:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27878.205372 secs 2023-05-08T11:28:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:59 smithi133 ceph-mon[125939]: pgmap v14923: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 920 KiB/s rd, 761 KiB/s wr, 8 op/s 2023-05-08T11:28:59.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:28:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27878.205372 secs 2023-05-08T11:29:00.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:59 smithi096 ceph-mon[124666]: pgmap v14923: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 920 KiB/s rd, 761 KiB/s wr, 8 op/s 2023-05-08T11:29:00.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:28:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27878.205372 secs 2023-05-08T11:29:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27878.760509 secs 2023-05-08T11:29:00.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27878.760509 secs 2023-05-08T11:29:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27878.760509 secs 2023-05-08T11:29:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:01 smithi186 ceph-mon[126480]: pgmap v14924: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 970 KiB/s wr, 14 op/s 2023-05-08T11:29:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:29:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:29:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:01 smithi133 ceph-mon[125939]: pgmap v14924: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 970 KiB/s wr, 14 op/s 2023-05-08T11:29:01.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:29:01.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:29:02.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:01 smithi096 ceph-mon[124666]: pgmap v14924: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 970 KiB/s wr, 14 op/s 2023-05-08T11:29:02.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:29:02.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:29:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:03 smithi186 ceph-mon[126480]: pgmap v14925: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 987 KiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T11:29:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:03 smithi133 ceph-mon[125939]: pgmap v14925: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 987 KiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T11:29:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:03 smithi096 ceph-mon[124666]: pgmap v14925: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 987 KiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T11:29:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27883.205485 secs 2023-05-08T11:29:04.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:04 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:29:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27883.205485 secs 2023-05-08T11:29:04.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:04 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:29:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27883.205485 secs 2023-05-08T11:29:05.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:04 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:29:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:05 smithi186 ceph-mon[126480]: pgmap v14926: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1008 KiB/s rd, 1.1 MiB/s wr, 17 op/s 2023-05-08T11:29:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:05 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:29:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:29:05.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:29:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:05 smithi133 ceph-mon[125939]: pgmap v14926: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1008 KiB/s rd, 1.1 MiB/s wr, 17 op/s 2023-05-08T11:29:05.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:05 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:29:05.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:29:05.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:29:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:05 smithi096 ceph-mon[124666]: pgmap v14926: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1008 KiB/s rd, 1.1 MiB/s wr, 17 op/s 2023-05-08T11:29:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:05 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:29:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:29:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:29:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27885.049147 secs 2023-05-08T11:29:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27885.049147 secs 2023-05-08T11:29:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27885.049147 secs 2023-05-08T11:29:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:07 smithi186 ceph-mon[126480]: pgmap v14927: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 697 KiB/s rd, 585 KiB/s wr, 13 op/s 2023-05-08T11:29:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:07 smithi133 ceph-mon[125939]: pgmap v14927: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 697 KiB/s rd, 585 KiB/s wr, 13 op/s 2023-05-08T11:29:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:07 smithi096 ceph-mon[124666]: pgmap v14927: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 697 KiB/s rd, 585 KiB/s wr, 13 op/s 2023-05-08T11:29:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:09 smithi186 ceph-mon[126480]: pgmap v14928: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 697 KiB/s rd, 585 KiB/s wr, 12 op/s 2023-05-08T11:29:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27888.205577 secs 2023-05-08T11:29:09.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:29:09.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:29:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:09 smithi133 ceph-mon[125939]: pgmap v14928: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 697 KiB/s rd, 585 KiB/s wr, 12 op/s 2023-05-08T11:29:10.072 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27888.205577 secs 2023-05-08T11:29:10.073 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:29:10.073 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:29:10.074 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:09 smithi096 ceph-mon[124666]: pgmap v14928: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 697 KiB/s rd, 585 KiB/s wr, 12 op/s 2023-05-08T11:29:10.074 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27888.205577 secs 2023-05-08T11:29:10.074 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:29:10.074 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:29:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27888.760739 secs 2023-05-08T11:29:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:10 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:29:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27888.760739 secs 2023-05-08T11:29:10.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:10 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:29:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27888.760739 secs 2023-05-08T11:29:11.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:10 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:29:11.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27890.049277 secs 2023-05-08T11:29:11.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:11 smithi186 ceph-mon[126480]: pgmap v14929: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 991 KiB/s rd, 899 KiB/s wr, 30 op/s 2023-05-08T11:29:11.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:11 smithi186 ceph-mon[126480]: osdmap e1010: 12 total, 12 up, 12 in 2023-05-08T11:29:11.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27890.049277 secs 2023-05-08T11:29:11.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:11 smithi133 ceph-mon[125939]: pgmap v14929: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 991 KiB/s rd, 899 KiB/s wr, 30 op/s 2023-05-08T11:29:11.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:11 smithi133 ceph-mon[125939]: osdmap e1010: 12 total, 12 up, 12 in 2023-05-08T11:29:12.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27890.049277 secs 2023-05-08T11:29:12.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:11 smithi096 ceph-mon[124666]: pgmap v14929: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 991 KiB/s rd, 899 KiB/s wr, 30 op/s 2023-05-08T11:29:12.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:11 smithi096 ceph-mon[124666]: osdmap e1010: 12 total, 12 up, 12 in 2023-05-08T11:29:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:13 smithi186 ceph-mon[126480]: pgmap v14931: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 731 KiB/s rd, 418 KiB/s wr, 30 op/s 2023-05-08T11:29:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:29:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:13 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:29:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:13 smithi133 ceph-mon[125939]: pgmap v14931: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 731 KiB/s rd, 418 KiB/s wr, 30 op/s 2023-05-08T11:29:13.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:29:13.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:13 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:29:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:13 smithi096 ceph-mon[124666]: pgmap v14931: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 731 KiB/s rd, 418 KiB/s wr, 30 op/s 2023-05-08T11:29:14.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:29:14.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:13 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:29:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27893.205700 secs 2023-05-08T11:29:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27893.205700 secs 2023-05-08T11:29:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27893.205700 secs 2023-05-08T11:29:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27893.760860 secs 2023-05-08T11:29:15.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:15 smithi133 ceph-mon[125939]: pgmap v14932: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 848 KiB/s rd, 517 KiB/s wr, 28 op/s 2023-05-08T11:29:15.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:15 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:29:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27893.760860 secs 2023-05-08T11:29:16.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:15 smithi096 ceph-mon[124666]: pgmap v14932: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 848 KiB/s rd, 517 KiB/s wr, 28 op/s 2023-05-08T11:29:16.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:15 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:29:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27893.760860 secs 2023-05-08T11:29:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:15 smithi186 ceph-mon[126480]: pgmap v14932: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 848 KiB/s rd, 517 KiB/s wr, 28 op/s 2023-05-08T11:29:16.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:15 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:29:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27895.049399 secs 2023-05-08T11:29:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27895.049399 secs 2023-05-08T11:29:17.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27895.049399 secs 2023-05-08T11:29:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:17 smithi133 ceph-mon[125939]: pgmap v14933: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 528 KiB/s rd, 517 KiB/s wr, 27 op/s 2023-05-08T11:29:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:17 smithi096 ceph-mon[124666]: pgmap v14933: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 528 KiB/s rd, 517 KiB/s wr, 27 op/s 2023-05-08T11:29:18.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:17 smithi186 ceph-mon[126480]: pgmap v14933: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 528 KiB/s rd, 517 KiB/s wr, 27 op/s 2023-05-08T11:29:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:19 smithi133 ceph-mon[125939]: pgmap v14934: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 528 KiB/s rd, 517 KiB/s wr, 27 op/s 2023-05-08T11:29:19.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27898.205820 secs 2023-05-08T11:29:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:19 smithi096 ceph-mon[124666]: pgmap v14934: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 528 KiB/s rd, 517 KiB/s wr, 27 op/s 2023-05-08T11:29:20.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27898.205820 secs 2023-05-08T11:29:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:19 smithi186 ceph-mon[126480]: pgmap v14934: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 528 KiB/s rd, 517 KiB/s wr, 27 op/s 2023-05-08T11:29:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27898.205820 secs 2023-05-08T11:29:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27898.760942 secs 2023-05-08T11:29:20.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:20 smithi133 ceph-mon[125939]: osdmap e1011: 12 total, 12 up, 12 in 2023-05-08T11:29:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27898.760942 secs 2023-05-08T11:29:21.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:20 smithi096 ceph-mon[124666]: osdmap e1011: 12 total, 12 up, 12 in 2023-05-08T11:29:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27898.760942 secs 2023-05-08T11:29:21.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:20 smithi186 ceph-mon[126480]: osdmap e1011: 12 total, 12 up, 12 in 2023-05-08T11:29:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27900.049523 secs 2023-05-08T11:29:21.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:21 smithi133 ceph-mon[125939]: pgmap v14936: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 410 KiB/s wr, 9 op/s 2023-05-08T11:29:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27900.049523 secs 2023-05-08T11:29:22.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:21 smithi096 ceph-mon[124666]: pgmap v14936: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 410 KiB/s wr, 9 op/s 2023-05-08T11:29:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27900.049523 secs 2023-05-08T11:29:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:21 smithi186 ceph-mon[126480]: pgmap v14936: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 410 KiB/s wr, 9 op/s 2023-05-08T11:29:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:23 smithi133 ceph-mon[125939]: pgmap v14937: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 371 KiB/s wr, 8 op/s 2023-05-08T11:29:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:23 smithi096 ceph-mon[124666]: pgmap v14937: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 371 KiB/s wr, 8 op/s 2023-05-08T11:29:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:23 smithi186 ceph-mon[126480]: pgmap v14937: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 371 KiB/s wr, 8 op/s 2023-05-08T11:29:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27903.205940 secs 2023-05-08T11:29:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27903.205940 secs 2023-05-08T11:29:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27903.205940 secs 2023-05-08T11:29:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27903.761065 secs 2023-05-08T11:29:25.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:25 smithi133 ceph-mon[125939]: pgmap v14938: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 231 KiB/s wr, 6 op/s 2023-05-08T11:29:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27903.761065 secs 2023-05-08T11:29:26.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:25 smithi096 ceph-mon[124666]: pgmap v14938: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 231 KiB/s wr, 6 op/s 2023-05-08T11:29:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27903.761065 secs 2023-05-08T11:29:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:25 smithi186 ceph-mon[126480]: pgmap v14938: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 231 KiB/s wr, 6 op/s 2023-05-08T11:29:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27905.049683 secs 2023-05-08T11:29:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27905.049683 secs 2023-05-08T11:29:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27905.049683 secs 2023-05-08T11:29:27.994 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:27 smithi133 ceph-mon[125939]: pgmap v14939: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 231 KiB/s wr, 6 op/s 2023-05-08T11:29:28.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:27 smithi096 ceph-mon[124666]: pgmap v14939: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 231 KiB/s wr, 6 op/s 2023-05-08T11:29:28.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:27 smithi186 ceph-mon[126480]: pgmap v14939: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 231 KiB/s wr, 6 op/s 2023-05-08T11:29:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:29 smithi133 ceph-mon[125939]: pgmap v14940: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 231 KiB/s wr, 6 op/s 2023-05-08T11:29:29.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27908.206062 secs 2023-05-08T11:29:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:29 smithi096 ceph-mon[124666]: pgmap v14940: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 231 KiB/s wr, 6 op/s 2023-05-08T11:29:30.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27908.206062 secs 2023-05-08T11:29:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:29 smithi186 ceph-mon[126480]: pgmap v14940: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 231 KiB/s wr, 6 op/s 2023-05-08T11:29:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27908.206062 secs 2023-05-08T11:29:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27908.761189 secs 2023-05-08T11:29:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27908.761189 secs 2023-05-08T11:29:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27908.761189 secs 2023-05-08T11:29:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27910.049841 secs 2023-05-08T11:29:31.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:31 smithi133 ceph-mon[125939]: pgmap v14941: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T11:29:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27910.049841 secs 2023-05-08T11:29:32.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:31 smithi096 ceph-mon[124666]: pgmap v14941: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T11:29:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27910.049841 secs 2023-05-08T11:29:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:31 smithi186 ceph-mon[126480]: pgmap v14941: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T11:29:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:33 smithi133 ceph-mon[125939]: pgmap v14942: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T11:29:34.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:33 smithi096 ceph-mon[124666]: pgmap v14942: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T11:29:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:33 smithi186 ceph-mon[126480]: pgmap v14942: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T11:29:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27913.206160 secs 2023-05-08T11:29:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27913.206160 secs 2023-05-08T11:29:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27913.206160 secs 2023-05-08T11:29:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27913.761311 secs 2023-05-08T11:29:35.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:35 smithi133 ceph-mon[125939]: pgmap v14943: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T11:29:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27913.761311 secs 2023-05-08T11:29:36.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:35 smithi096 ceph-mon[124666]: pgmap v14943: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T11:29:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27913.761311 secs 2023-05-08T11:29:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:35 smithi186 ceph-mon[126480]: pgmap v14943: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T11:29:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27915.049911 secs 2023-05-08T11:29:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27915.049911 secs 2023-05-08T11:29:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27915.049911 secs 2023-05-08T11:29:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:37 smithi133 ceph-mon[125939]: pgmap v14944: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T11:29:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:37 smithi096 ceph-mon[124666]: pgmap v14944: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T11:29:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:37 smithi186 ceph-mon[126480]: pgmap v14944: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T11:29:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:39 smithi133 ceph-mon[125939]: pgmap v14945: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T11:29:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27918.206240 secs 2023-05-08T11:29:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:39 smithi096 ceph-mon[124666]: pgmap v14945: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T11:29:40.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27918.206240 secs 2023-05-08T11:29:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:39 smithi186 ceph-mon[126480]: pgmap v14945: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T11:29:40.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27918.206240 secs 2023-05-08T11:29:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27918.761433 secs 2023-05-08T11:29:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27918.761433 secs 2023-05-08T11:29:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27918.761433 secs 2023-05-08T11:29:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27920.050026 secs 2023-05-08T11:29:41.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:41 smithi133 ceph-mon[125939]: pgmap v14946: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 181 KiB/s wr, 9 op/s 2023-05-08T11:29:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27920.050026 secs 2023-05-08T11:29:42.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:41 smithi096 ceph-mon[124666]: pgmap v14946: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 181 KiB/s wr, 9 op/s 2023-05-08T11:29:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27920.050026 secs 2023-05-08T11:29:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:41 smithi186 ceph-mon[126480]: pgmap v14946: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 181 KiB/s wr, 9 op/s 2023-05-08T11:29:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:43 smithi133 ceph-mon[125939]: pgmap v14947: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 181 KiB/s wr, 6 op/s 2023-05-08T11:29:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:43 smithi096 ceph-mon[124666]: pgmap v14947: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 181 KiB/s wr, 6 op/s 2023-05-08T11:29:44.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:43 smithi186 ceph-mon[126480]: pgmap v14947: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 181 KiB/s wr, 6 op/s 2023-05-08T11:29:44.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27923.206364 secs 2023-05-08T11:29:45.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27923.206364 secs 2023-05-08T11:29:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27923.206364 secs 2023-05-08T11:29:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27923.761546 secs 2023-05-08T11:29:45.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:45 smithi133 ceph-mon[125939]: pgmap v14948: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 206 KiB/s wr, 10 op/s 2023-05-08T11:29:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27923.761546 secs 2023-05-08T11:29:46.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:45 smithi096 ceph-mon[124666]: pgmap v14948: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 206 KiB/s wr, 10 op/s 2023-05-08T11:29:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27923.761546 secs 2023-05-08T11:29:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:45 smithi186 ceph-mon[126480]: pgmap v14948: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 206 KiB/s wr, 10 op/s 2023-05-08T11:29:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:47 smithi133 ceph-mon[125939]: pgmap v14949: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 205 KiB/s wr, 7 op/s 2023-05-08T11:29:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:47 smithi096 ceph-mon[124666]: pgmap v14949: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 205 KiB/s wr, 7 op/s 2023-05-08T11:29:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:47 smithi186 ceph-mon[126480]: pgmap v14949: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 205 KiB/s wr, 7 op/s 2023-05-08T11:29:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:29:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:29:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:29:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:49 smithi133 ceph-mon[125939]: pgmap v14950: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 205 KiB/s wr, 7 op/s 2023-05-08T11:29:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27928.206479 secs 2023-05-08T11:29:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:29:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:29:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:29:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:49 smithi096 ceph-mon[124666]: pgmap v14950: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 205 KiB/s wr, 7 op/s 2023-05-08T11:29:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27928.206479 secs 2023-05-08T11:29:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:29:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:29:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:29:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:49 smithi186 ceph-mon[126480]: pgmap v14950: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 205 KiB/s wr, 7 op/s 2023-05-08T11:29:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27928.206479 secs 2023-05-08T11:29:50.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:29:50.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:29:50.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:29:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27928.761669 secs 2023-05-08T11:29:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27928.761669 secs 2023-05-08T11:29:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27928.761669 secs 2023-05-08T11:29:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:51 smithi133 ceph-mon[125939]: pgmap v14951: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 599 KiB/s rd, 465 KiB/s wr, 10 op/s 2023-05-08T11:29:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:51 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:29:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:51 smithi096 ceph-mon[124666]: pgmap v14951: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 599 KiB/s rd, 465 KiB/s wr, 10 op/s 2023-05-08T11:29:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:51 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:29:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:51 smithi186 ceph-mon[126480]: pgmap v14951: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 599 KiB/s rd, 465 KiB/s wr, 10 op/s 2023-05-08T11:29:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:51 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:29:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:29:52.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:29:52.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:29:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:29:53.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:29:53.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:29:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:29:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:29:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:29:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:53 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:29:53.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:53 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T11:29:53.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:53 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T11:29:53.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:53 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:29:53.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:53 smithi133 ceph-mon[125939]: pgmap v14952: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 499 KiB/s rd, 428 KiB/s wr, 7 op/s 2023-05-08T11:29:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:53 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:29:54.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:53 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T11:29:54.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:53 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T11:29:54.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:53 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:29:54.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:53 smithi096 ceph-mon[124666]: pgmap v14952: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 499 KiB/s rd, 428 KiB/s wr, 7 op/s 2023-05-08T11:29:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:53 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:29:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:53 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T11:29:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:53 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T11:29:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:53 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:29:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:53 smithi186 ceph-mon[126480]: pgmap v14952: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 499 KiB/s rd, 428 KiB/s wr, 7 op/s 2023-05-08T11:29:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27933.206591 secs 2023-05-08T11:29:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27933.206591 secs 2023-05-08T11:29:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27933.206591 secs 2023-05-08T11:29:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:55 smithi133 ceph-mon[125939]: pgmap v14953: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 945 KiB/s rd, 787 KiB/s wr, 11 op/s 2023-05-08T11:29:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:55 smithi096 ceph-mon[124666]: pgmap v14953: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 945 KiB/s rd, 787 KiB/s wr, 11 op/s 2023-05-08T11:29:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:55 smithi186 ceph-mon[126480]: pgmap v14953: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 945 KiB/s rd, 787 KiB/s wr, 11 op/s 2023-05-08T11:29:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:29:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:29:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:29:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:57 smithi133 ceph-mon[125939]: pgmap v14954: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 982 KiB/s rd, 886 KiB/s wr, 8 op/s 2023-05-08T11:29:57.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:57 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:29:57.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:29:57.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:29:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:57 smithi096 ceph-mon[124666]: pgmap v14954: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 982 KiB/s rd, 886 KiB/s wr, 8 op/s 2023-05-08T11:29:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:57 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:29:58.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:29:58.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:29:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:57 smithi186 ceph-mon[126480]: pgmap v14954: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 982 KiB/s rd, 886 KiB/s wr, 8 op/s 2023-05-08T11:29:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:57 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:29:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:29:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:29:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:59 smithi133 ceph-mon[125939]: pgmap v14955: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 982 KiB/s rd, 886 KiB/s wr, 8 op/s 2023-05-08T11:29:59.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27938.206650 secs 2023-05-08T11:29:59.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:29:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27938.761889 secs 2023-05-08T11:30:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:59 smithi096 ceph-mon[124666]: pgmap v14955: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 982 KiB/s rd, 886 KiB/s wr, 8 op/s 2023-05-08T11:30:00.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27938.206650 secs 2023-05-08T11:30:00.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:29:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27938.761889 secs 2023-05-08T11:30:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:59 smithi186 ceph-mon[126480]: pgmap v14955: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 982 KiB/s rd, 886 KiB/s wr, 8 op/s 2023-05-08T11:30:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27938.206650 secs 2023-05-08T11:30:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:29:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27938.761889 secs 2023-05-08T11:30:00.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:00 smithi133 ceph-mon[125939]: overall HEALTH_WARN 1 MDSs report slow requests 2023-05-08T11:30:01.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:00 smithi096 ceph-mon[124666]: overall HEALTH_WARN 1 MDSs report slow requests 2023-05-08T11:30:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:00 smithi186 ceph-mon[126480]: overall HEALTH_WARN 1 MDSs report slow requests 2023-05-08T11:30:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:01 smithi096 ceph-mon[124666]: pgmap v14956: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T11:30:02.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:30:02.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:30:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:01 smithi186 ceph-mon[126480]: pgmap v14956: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T11:30:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:30:02.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:30:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:01 smithi133 ceph-mon[125939]: pgmap v14956: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T11:30:02.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:30:02.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:30:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:03 smithi096 ceph-mon[124666]: pgmap v14957: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1003 KiB/s rd, 905 KiB/s wr, 11 op/s 2023-05-08T11:30:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:03 smithi186 ceph-mon[126480]: pgmap v14957: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1003 KiB/s rd, 905 KiB/s wr, 11 op/s 2023-05-08T11:30:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:03 smithi133 ceph-mon[125939]: pgmap v14957: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1003 KiB/s rd, 905 KiB/s wr, 11 op/s 2023-05-08T11:30:05.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27943.206772 secs 2023-05-08T11:30:05.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:04 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:30:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27943.206772 secs 2023-05-08T11:30:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:04 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:30:05.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27943.206772 secs 2023-05-08T11:30:05.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:04 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:30:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:05 smithi096 ceph-mon[124666]: pgmap v14958: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 955 KiB/s wr, 17 op/s 2023-05-08T11:30:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:05 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:30:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:30:06.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:30:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:05 smithi186 ceph-mon[126480]: pgmap v14958: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 955 KiB/s wr, 17 op/s 2023-05-08T11:30:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:05 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:30:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:30:06.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:30:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:05 smithi133 ceph-mon[125939]: pgmap v14958: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 955 KiB/s wr, 17 op/s 2023-05-08T11:30:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:05 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:30:06.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:30:06.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:30:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:07 smithi186 ceph-mon[126480]: pgmap v14959: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 846 KiB/s rd, 596 KiB/s wr, 13 op/s 2023-05-08T11:30:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:07 smithi133 ceph-mon[125939]: pgmap v14959: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 846 KiB/s rd, 596 KiB/s wr, 13 op/s 2023-05-08T11:30:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:07 smithi096 ceph-mon[124666]: pgmap v14959: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 846 KiB/s rd, 596 KiB/s wr, 13 op/s 2023-05-08T11:30:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:09 smithi186 ceph-mon[126480]: pgmap v14960: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 703 KiB/s rd, 473 KiB/s wr, 12 op/s 2023-05-08T11:30:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27948.206887 secs 2023-05-08T11:30:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27948.762079 secs 2023-05-08T11:30:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:09 smithi133 ceph-mon[125939]: pgmap v14960: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 703 KiB/s rd, 473 KiB/s wr, 12 op/s 2023-05-08T11:30:10.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27948.206887 secs 2023-05-08T11:30:10.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27948.762079 secs 2023-05-08T11:30:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:09 smithi096 ceph-mon[124666]: pgmap v14960: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 703 KiB/s rd, 473 KiB/s wr, 12 op/s 2023-05-08T11:30:10.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27948.206887 secs 2023-05-08T11:30:10.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27948.762079 secs 2023-05-08T11:30:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27950.050634 secs 2023-05-08T11:30:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:11 smithi186 ceph-mon[126480]: pgmap v14961: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 784 KiB/s wr, 31 op/s 2023-05-08T11:30:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27950.050634 secs 2023-05-08T11:30:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:11 smithi133 ceph-mon[125939]: pgmap v14961: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 784 KiB/s wr, 31 op/s 2023-05-08T11:30:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27950.050634 secs 2023-05-08T11:30:11.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:11 smithi096 ceph-mon[124666]: pgmap v14961: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 784 KiB/s wr, 31 op/s 2023-05-08T11:30:12.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:12 smithi186 ceph-mon[126480]: osdmap e1012: 12 total, 12 up, 12 in 2023-05-08T11:30:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:12 smithi133 ceph-mon[125939]: osdmap e1012: 12 total, 12 up, 12 in 2023-05-08T11:30:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:12 smithi096 ceph-mon[124666]: osdmap e1012: 12 total, 12 up, 12 in 2023-05-08T11:30:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:13 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:30:13.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:30:13.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:30:13.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:13 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:30:13.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:13 smithi186 ceph-mon[126480]: pgmap v14963: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 780 KiB/s rd, 606 KiB/s wr, 31 op/s 2023-05-08T11:30:13.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:13 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:30:13.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:30:13.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:30:13.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:13 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:30:13.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:13 smithi133 ceph-mon[125939]: pgmap v14963: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 780 KiB/s rd, 606 KiB/s wr, 31 op/s 2023-05-08T11:30:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:13 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:30:13.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:30:13.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:30:13.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:13 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:30:13.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:13 smithi096 ceph-mon[124666]: pgmap v14963: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 780 KiB/s rd, 606 KiB/s wr, 31 op/s 2023-05-08T11:30:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27953.207005 secs 2023-05-08T11:30:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27953.207005 secs 2023-05-08T11:30:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27953.207005 secs 2023-05-08T11:30:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27953.762219 secs 2023-05-08T11:30:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:15 smithi186 ceph-mon[126480]: pgmap v14964: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 514 KiB/s wr, 28 op/s 2023-05-08T11:30:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27953.762219 secs 2023-05-08T11:30:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:15 smithi133 ceph-mon[125939]: pgmap v14964: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 514 KiB/s wr, 28 op/s 2023-05-08T11:30:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27953.762219 secs 2023-05-08T11:30:15.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:15 smithi096 ceph-mon[124666]: pgmap v14964: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 514 KiB/s wr, 28 op/s 2023-05-08T11:30:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27955.050758 secs 2023-05-08T11:30:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27955.050758 secs 2023-05-08T11:30:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27955.050758 secs 2023-05-08T11:30:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:17 smithi186 ceph-mon[126480]: pgmap v14965: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 514 KiB/s wr, 28 op/s 2023-05-08T11:30:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:17 smithi133 ceph-mon[125939]: pgmap v14965: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 514 KiB/s wr, 28 op/s 2023-05-08T11:30:17.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:17 smithi096 ceph-mon[124666]: pgmap v14965: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 514 KiB/s wr, 28 op/s 2023-05-08T11:30:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:19 smithi133 ceph-mon[125939]: pgmap v14966: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 514 KiB/s wr, 28 op/s 2023-05-08T11:30:19.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27958.207139 secs 2023-05-08T11:30:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:19 smithi096 ceph-mon[124666]: pgmap v14966: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 514 KiB/s wr, 28 op/s 2023-05-08T11:30:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27958.207139 secs 2023-05-08T11:30:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:19 smithi186 ceph-mon[126480]: pgmap v14966: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 514 KiB/s wr, 28 op/s 2023-05-08T11:30:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27958.207139 secs 2023-05-08T11:30:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27958.762369 secs 2023-05-08T11:30:20.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:20 smithi133 ceph-mon[125939]: osdmap e1013: 12 total, 12 up, 12 in 2023-05-08T11:30:20.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27958.762369 secs 2023-05-08T11:30:20.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:20 smithi096 ceph-mon[124666]: osdmap e1013: 12 total, 12 up, 12 in 2023-05-08T11:30:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27958.762369 secs 2023-05-08T11:30:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:20 smithi186 ceph-mon[126480]: osdmap e1013: 12 total, 12 up, 12 in 2023-05-08T11:30:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27960.050838 secs 2023-05-08T11:30:21.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:21 smithi133 ceph-mon[125939]: pgmap v14968: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 411 KiB/s wr, 10 op/s 2023-05-08T11:30:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27960.050838 secs 2023-05-08T11:30:21.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:21 smithi096 ceph-mon[124666]: pgmap v14968: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 411 KiB/s wr, 10 op/s 2023-05-08T11:30:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27960.050838 secs 2023-05-08T11:30:21.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:21 smithi186 ceph-mon[126480]: pgmap v14968: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 411 KiB/s wr, 10 op/s 2023-05-08T11:30:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:23 smithi133 ceph-mon[125939]: pgmap v14969: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 379 KiB/s rd, 372 KiB/s wr, 9 op/s 2023-05-08T11:30:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:23 smithi096 ceph-mon[124666]: pgmap v14969: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 379 KiB/s rd, 372 KiB/s wr, 9 op/s 2023-05-08T11:30:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:23 smithi186 ceph-mon[126480]: pgmap v14969: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 379 KiB/s rd, 372 KiB/s wr, 9 op/s 2023-05-08T11:30:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27963.207263 secs 2023-05-08T11:30:24.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27963.207263 secs 2023-05-08T11:30:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27963.207263 secs 2023-05-08T11:30:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27963.762506 secs 2023-05-08T11:30:25.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:25 smithi133 ceph-mon[125939]: pgmap v14970: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 232 KiB/s wr, 7 op/s 2023-05-08T11:30:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27963.762506 secs 2023-05-08T11:30:25.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:25 smithi096 ceph-mon[124666]: pgmap v14970: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 232 KiB/s wr, 7 op/s 2023-05-08T11:30:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27963.762506 secs 2023-05-08T11:30:25.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:25 smithi186 ceph-mon[126480]: pgmap v14970: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 232 KiB/s wr, 7 op/s 2023-05-08T11:30:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27965.050957 secs 2023-05-08T11:30:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27965.050957 secs 2023-05-08T11:30:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27965.050957 secs 2023-05-08T11:30:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:27 smithi133 ceph-mon[125939]: pgmap v14971: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 232 KiB/s wr, 7 op/s 2023-05-08T11:30:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:27 smithi096 ceph-mon[124666]: pgmap v14971: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 232 KiB/s wr, 7 op/s 2023-05-08T11:30:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:27 smithi186 ceph-mon[126480]: pgmap v14971: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 232 KiB/s wr, 7 op/s 2023-05-08T11:30:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:29 smithi133 ceph-mon[125939]: pgmap v14972: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 232 KiB/s wr, 7 op/s 2023-05-08T11:30:29.849 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27968.207412 secs 2023-05-08T11:30:29.849 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:29 smithi096 ceph-mon[124666]: pgmap v14972: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 232 KiB/s wr, 7 op/s 2023-05-08T11:30:29.850 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27968.207412 secs 2023-05-08T11:30:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:29 smithi186 ceph-mon[126480]: pgmap v14972: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 232 KiB/s wr, 7 op/s 2023-05-08T11:30:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27968.207412 secs 2023-05-08T11:30:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27968.762617 secs 2023-05-08T11:30:30.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27968.762617 secs 2023-05-08T11:30:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27968.762617 secs 2023-05-08T11:30:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27970.051087 secs 2023-05-08T11:30:31.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:31 smithi133 ceph-mon[125939]: pgmap v14973: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2023-05-08T11:30:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27970.051087 secs 2023-05-08T11:30:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:31 smithi096 ceph-mon[124666]: pgmap v14973: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2023-05-08T11:30:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27970.051087 secs 2023-05-08T11:30:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:31 smithi186 ceph-mon[126480]: pgmap v14973: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2023-05-08T11:30:33.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:33 smithi133 ceph-mon[125939]: pgmap v14974: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T11:30:33.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:33 smithi096 ceph-mon[124666]: pgmap v14974: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T11:30:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:33 smithi186 ceph-mon[126480]: pgmap v14974: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T11:30:34.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27973.207495 secs 2023-05-08T11:30:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27973.207495 secs 2023-05-08T11:30:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27973.207495 secs 2023-05-08T11:30:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27973.762734 secs 2023-05-08T11:30:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:35 smithi133 ceph-mon[125939]: pgmap v14975: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 9 op/s 2023-05-08T11:30:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27973.762734 secs 2023-05-08T11:30:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:35 smithi096 ceph-mon[124666]: pgmap v14975: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 9 op/s 2023-05-08T11:30:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27973.762734 secs 2023-05-08T11:30:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:35 smithi186 ceph-mon[126480]: pgmap v14975: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 9 op/s 2023-05-08T11:30:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27975.051219 secs 2023-05-08T11:30:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27975.051219 secs 2023-05-08T11:30:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27975.051219 secs 2023-05-08T11:30:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:37 smithi133 ceph-mon[125939]: pgmap v14976: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 6 op/s 2023-05-08T11:30:37.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:37 smithi096 ceph-mon[124666]: pgmap v14976: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 6 op/s 2023-05-08T11:30:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:37 smithi186 ceph-mon[126480]: pgmap v14976: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 6 op/s 2023-05-08T11:30:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:39 smithi133 ceph-mon[125939]: pgmap v14977: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 6 op/s 2023-05-08T11:30:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27978.207616 secs 2023-05-08T11:30:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:39 smithi096 ceph-mon[124666]: pgmap v14977: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 6 op/s 2023-05-08T11:30:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27978.207616 secs 2023-05-08T11:30:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:39 smithi186 ceph-mon[126480]: pgmap v14977: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 6 op/s 2023-05-08T11:30:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27978.207616 secs 2023-05-08T11:30:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27978.762859 secs 2023-05-08T11:30:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27978.762859 secs 2023-05-08T11:30:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27978.762859 secs 2023-05-08T11:30:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27980.051364 secs 2023-05-08T11:30:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:41 smithi133 ceph-mon[125939]: pgmap v14978: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 938 B/s wr, 9 op/s 2023-05-08T11:30:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27980.051364 secs 2023-05-08T11:30:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:41 smithi096 ceph-mon[124666]: pgmap v14978: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 938 B/s wr, 9 op/s 2023-05-08T11:30:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27980.051364 secs 2023-05-08T11:30:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:41 smithi186 ceph-mon[126480]: pgmap v14978: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 938 B/s wr, 9 op/s 2023-05-08T11:30:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:43 smithi096 ceph-mon[124666]: pgmap v14979: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T11:30:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:43 smithi186 ceph-mon[126480]: pgmap v14979: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T11:30:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:43 smithi133 ceph-mon[125939]: pgmap v14979: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T11:30:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27983.207661 secs 2023-05-08T11:30:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27983.207661 secs 2023-05-08T11:30:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27983.207661 secs 2023-05-08T11:30:45.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27983.762974 secs 2023-05-08T11:30:45.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:45 smithi096 ceph-mon[124666]: pgmap v14980: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 130 KiB/s wr, 10 op/s 2023-05-08T11:30:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27983.762974 secs 2023-05-08T11:30:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:45 smithi186 ceph-mon[126480]: pgmap v14980: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 130 KiB/s wr, 10 op/s 2023-05-08T11:30:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27983.762974 secs 2023-05-08T11:30:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:45 smithi133 ceph-mon[125939]: pgmap v14980: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 130 KiB/s wr, 10 op/s 2023-05-08T11:30:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:47 smithi186 ceph-mon[126480]: pgmap v14981: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 130 KiB/s wr, 7 op/s 2023-05-08T11:30:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:47 smithi133 ceph-mon[125939]: pgmap v14981: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 130 KiB/s wr, 7 op/s 2023-05-08T11:30:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:47 smithi096 ceph-mon[124666]: pgmap v14981: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 130 KiB/s wr, 7 op/s 2023-05-08T11:30:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:30:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:30:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:30:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:49 smithi186 ceph-mon[126480]: pgmap v14982: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 130 KiB/s wr, 7 op/s 2023-05-08T11:30:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27988.207757 secs 2023-05-08T11:30:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:30:49.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:30:49.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:30:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:49 smithi133 ceph-mon[125939]: pgmap v14982: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 130 KiB/s wr, 7 op/s 2023-05-08T11:30:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27988.207757 secs 2023-05-08T11:30:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:30:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:30:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:30:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:49 smithi096 ceph-mon[124666]: pgmap v14982: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 130 KiB/s wr, 7 op/s 2023-05-08T11:30:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27988.207757 secs 2023-05-08T11:30:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:30:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:30:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:30:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27988.763092 secs 2023-05-08T11:30:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27988.763092 secs 2023-05-08T11:30:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27988.763092 secs 2023-05-08T11:30:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:51 smithi186 ceph-mon[126480]: pgmap v14983: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 614 KiB/s rd, 471 KiB/s wr, 10 op/s 2023-05-08T11:30:51.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:51 smithi133 ceph-mon[125939]: pgmap v14983: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 614 KiB/s rd, 471 KiB/s wr, 10 op/s 2023-05-08T11:30:52.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:51 smithi096 ceph-mon[124666]: pgmap v14983: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 614 KiB/s rd, 471 KiB/s wr, 10 op/s 2023-05-08T11:30:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:30:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:30:53.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:30:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:53 smithi186 ceph-mon[126480]: pgmap v14984: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 612 KiB/s rd, 742 KiB/s wr, 7 op/s 2023-05-08T11:30:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:53 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:30:53.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:53 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:30:53.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:53 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:30:53.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:53 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:30:53.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:53 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T11:30:53.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:53 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T11:30:53.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:53 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:30:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:53 smithi133 ceph-mon[125939]: pgmap v14984: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 612 KiB/s rd, 742 KiB/s wr, 7 op/s 2023-05-08T11:30:53.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:53 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:30:53.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:53 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:30:53.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:53 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:30:53.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:53 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:30:53.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:53 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T11:30:53.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:53 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T11:30:53.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:53 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:30:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:53 smithi096 ceph-mon[124666]: pgmap v14984: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 612 KiB/s rd, 742 KiB/s wr, 7 op/s 2023-05-08T11:30:54.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:53 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:30:54.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:53 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:30:54.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:53 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:30:54.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:53 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:30:54.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:53 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T11:30:54.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:53 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T11:30:54.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:53 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:30:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27993.207876 secs 2023-05-08T11:30:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27993.207876 secs 2023-05-08T11:30:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27993.207876 secs 2023-05-08T11:30:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:55 smithi186 ceph-mon[126480]: pgmap v14985: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 766 KiB/s rd, 760 KiB/s wr, 11 op/s 2023-05-08T11:30:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:55 smithi133 ceph-mon[125939]: pgmap v14985: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 766 KiB/s rd, 760 KiB/s wr, 11 op/s 2023-05-08T11:30:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:55 smithi096 ceph-mon[124666]: pgmap v14985: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 766 KiB/s rd, 760 KiB/s wr, 11 op/s 2023-05-08T11:30:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:30:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:30:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:30:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:57 smithi186 ceph-mon[126480]: pgmap v14986: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 884 KiB/s rd, 701 KiB/s wr, 8 op/s 2023-05-08T11:30:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:57 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:30:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:30:57.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:30:57.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:57 smithi133 ceph-mon[125939]: pgmap v14986: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 884 KiB/s rd, 701 KiB/s wr, 8 op/s 2023-05-08T11:30:57.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:57 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:30:57.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:30:57.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:30:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:57 smithi096 ceph-mon[124666]: pgmap v14986: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 884 KiB/s rd, 701 KiB/s wr, 8 op/s 2023-05-08T11:30:58.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:57 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:30:58.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:30:58.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:30:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:59 smithi186 ceph-mon[126480]: pgmap v14987: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 884 KiB/s rd, 701 KiB/s wr, 8 op/s 2023-05-08T11:30:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:30:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27998.208019 secs 2023-05-08T11:30:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:59 smithi133 ceph-mon[125939]: pgmap v14987: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 884 KiB/s rd, 701 KiB/s wr, 8 op/s 2023-05-08T11:30:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:30:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27998.208019 secs 2023-05-08T11:31:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:59 smithi096 ceph-mon[124666]: pgmap v14987: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 884 KiB/s rd, 701 KiB/s wr, 8 op/s 2023-05-08T11:31:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:30:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27998.208019 secs 2023-05-08T11:31:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 27998.763267 secs 2023-05-08T11:31:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 27998.763267 secs 2023-05-08T11:31:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 27998.763267 secs 2023-05-08T11:31:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:01 smithi186 ceph-mon[126480]: pgmap v14988: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 14 op/s 2023-05-08T11:31:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:31:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:31:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:01 smithi133 ceph-mon[125939]: pgmap v14988: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 14 op/s 2023-05-08T11:31:01.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:31:01.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:31:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:01 smithi096 ceph-mon[124666]: pgmap v14988: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 14 op/s 2023-05-08T11:31:02.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:31:02.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:31:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:03 smithi186 ceph-mon[126480]: pgmap v14989: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 840 KiB/s rd, 692 KiB/s wr, 11 op/s 2023-05-08T11:31:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:03 smithi133 ceph-mon[125939]: pgmap v14989: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 840 KiB/s rd, 692 KiB/s wr, 11 op/s 2023-05-08T11:31:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:03 smithi096 ceph-mon[124666]: pgmap v14989: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 840 KiB/s rd, 692 KiB/s wr, 11 op/s 2023-05-08T11:31:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28003.208142 secs 2023-05-08T11:31:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:04 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:31:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28003.208142 secs 2023-05-08T11:31:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:04 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:31:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28003.208142 secs 2023-05-08T11:31:05.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:04 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:31:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:05 smithi186 ceph-mon[126480]: pgmap v14990: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 689 KiB/s wr, 17 op/s 2023-05-08T11:31:05.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:05 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:31:05.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:31:05.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:31:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:05 smithi133 ceph-mon[125939]: pgmap v14990: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 689 KiB/s wr, 17 op/s 2023-05-08T11:31:05.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:05 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:31:05.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:31:05.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:31:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:05 smithi096 ceph-mon[124666]: pgmap v14990: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 689 KiB/s wr, 17 op/s 2023-05-08T11:31:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:05 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:31:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:31:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:31:07.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:07 smithi186 ceph-mon[126480]: pgmap v14991: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 955 KiB/s rd, 672 KiB/s wr, 14 op/s 2023-05-08T11:31:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:07 smithi133 ceph-mon[125939]: pgmap v14991: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 955 KiB/s rd, 672 KiB/s wr, 14 op/s 2023-05-08T11:31:08.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:07 smithi096 ceph-mon[124666]: pgmap v14991: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 955 KiB/s rd, 672 KiB/s wr, 14 op/s 2023-05-08T11:31:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:09 smithi186 ceph-mon[126480]: pgmap v14992: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 684 KiB/s rd, 601 KiB/s wr, 13 op/s 2023-05-08T11:31:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28008.208260 secs 2023-05-08T11:31:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:09 smithi133 ceph-mon[125939]: pgmap v14992: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 684 KiB/s rd, 601 KiB/s wr, 13 op/s 2023-05-08T11:31:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28008.208260 secs 2023-05-08T11:31:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:09 smithi096 ceph-mon[124666]: pgmap v14992: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 684 KiB/s rd, 601 KiB/s wr, 13 op/s 2023-05-08T11:31:10.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28008.208260 secs 2023-05-08T11:31:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28008.763502 secs 2023-05-08T11:31:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28008.763502 secs 2023-05-08T11:31:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28008.763502 secs 2023-05-08T11:31:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28010.052053 secs 2023-05-08T11:31:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:11 smithi186 ceph-mon[126480]: pgmap v14993: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 753 KiB/s rd, 946 KiB/s wr, 31 op/s 2023-05-08T11:31:11.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:11 smithi186 ceph-mon[126480]: osdmap e1014: 12 total, 12 up, 12 in 2023-05-08T11:31:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28010.052053 secs 2023-05-08T11:31:11.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:11 smithi133 ceph-mon[125939]: pgmap v14993: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 753 KiB/s rd, 946 KiB/s wr, 31 op/s 2023-05-08T11:31:11.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:11 smithi133 ceph-mon[125939]: osdmap e1014: 12 total, 12 up, 12 in 2023-05-08T11:31:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28010.052053 secs 2023-05-08T11:31:12.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:11 smithi096 ceph-mon[124666]: pgmap v14993: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 753 KiB/s rd, 946 KiB/s wr, 31 op/s 2023-05-08T11:31:12.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:11 smithi096 ceph-mon[124666]: osdmap e1014: 12 total, 12 up, 12 in 2023-05-08T11:31:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:12 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:31:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:12 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:31:12.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:12 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:31:12.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:12 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:31:13.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:12 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:31:13.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:12 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:31:13.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:12 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:31:13.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:12 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:31:13.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:12 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:31:13.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:12 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:31:13.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:12 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:31:13.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:12 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:31:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:13 smithi133 ceph-mon[125939]: pgmap v14995: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 736 KiB/s wr, 29 op/s 2023-05-08T11:31:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:13 smithi096 ceph-mon[124666]: pgmap v14995: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 736 KiB/s wr, 29 op/s 2023-05-08T11:31:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:13 smithi186 ceph-mon[126480]: pgmap v14995: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 736 KiB/s wr, 29 op/s 2023-05-08T11:31:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28013.208380 secs 2023-05-08T11:31:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28013.208380 secs 2023-05-08T11:31:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28013.208380 secs 2023-05-08T11:31:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28013.763596 secs 2023-05-08T11:31:15.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:15 smithi133 ceph-mon[125939]: pgmap v14996: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 512 KiB/s rd, 554 KiB/s wr, 26 op/s 2023-05-08T11:31:16.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28013.763596 secs 2023-05-08T11:31:16.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:15 smithi096 ceph-mon[124666]: pgmap v14996: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 512 KiB/s rd, 554 KiB/s wr, 26 op/s 2023-05-08T11:31:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28013.763596 secs 2023-05-08T11:31:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:15 smithi186 ceph-mon[126480]: pgmap v14996: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 512 KiB/s rd, 554 KiB/s wr, 26 op/s 2023-05-08T11:31:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28015.052177 secs 2023-05-08T11:31:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28015.052177 secs 2023-05-08T11:31:17.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28015.052177 secs 2023-05-08T11:31:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:17 smithi133 ceph-mon[125939]: pgmap v14997: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 512 KiB/s rd, 554 KiB/s wr, 26 op/s 2023-05-08T11:31:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:17 smithi096 ceph-mon[124666]: pgmap v14997: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 512 KiB/s rd, 554 KiB/s wr, 26 op/s 2023-05-08T11:31:18.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:17 smithi186 ceph-mon[126480]: pgmap v14997: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 512 KiB/s rd, 554 KiB/s wr, 26 op/s 2023-05-08T11:31:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:19 smithi133 ceph-mon[125939]: pgmap v14998: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 512 KiB/s rd, 554 KiB/s wr, 26 op/s 2023-05-08T11:31:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28018.208470 secs 2023-05-08T11:31:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:19 smithi096 ceph-mon[124666]: pgmap v14998: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 512 KiB/s rd, 554 KiB/s wr, 26 op/s 2023-05-08T11:31:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28018.208470 secs 2023-05-08T11:31:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:19 smithi186 ceph-mon[126480]: pgmap v14998: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 512 KiB/s rd, 554 KiB/s wr, 26 op/s 2023-05-08T11:31:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28018.208470 secs 2023-05-08T11:31:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28018.763707 secs 2023-05-08T11:31:20.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:20 smithi133 ceph-mon[125939]: osdmap e1015: 12 total, 12 up, 12 in 2023-05-08T11:31:21.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28018.763707 secs 2023-05-08T11:31:21.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:20 smithi096 ceph-mon[124666]: osdmap e1015: 12 total, 12 up, 12 in 2023-05-08T11:31:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28018.763707 secs 2023-05-08T11:31:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:20 smithi186 ceph-mon[126480]: osdmap e1015: 12 total, 12 up, 12 in 2023-05-08T11:31:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28020.052303 secs 2023-05-08T11:31:21.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:21 smithi133 ceph-mon[125939]: pgmap v15000: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 540 KiB/s rd, 244 KiB/s wr, 8 op/s 2023-05-08T11:31:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28020.052303 secs 2023-05-08T11:31:22.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:21 smithi096 ceph-mon[124666]: pgmap v15000: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 540 KiB/s rd, 244 KiB/s wr, 8 op/s 2023-05-08T11:31:22.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28020.052303 secs 2023-05-08T11:31:22.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:21 smithi186 ceph-mon[126480]: pgmap v15000: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 540 KiB/s rd, 244 KiB/s wr, 8 op/s 2023-05-08T11:31:24.000 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:23 smithi133 ceph-mon[125939]: pgmap v15001: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 530 KiB/s rd, 239 KiB/s wr, 8 op/s 2023-05-08T11:31:24.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:23 smithi096 ceph-mon[124666]: pgmap v15001: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 530 KiB/s rd, 239 KiB/s wr, 8 op/s 2023-05-08T11:31:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:23 smithi186 ceph-mon[126480]: pgmap v15001: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 530 KiB/s rd, 239 KiB/s wr, 8 op/s 2023-05-08T11:31:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28023.208589 secs 2023-05-08T11:31:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28023.208589 secs 2023-05-08T11:31:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28023.208589 secs 2023-05-08T11:31:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28023.763827 secs 2023-05-08T11:31:25.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:25 smithi133 ceph-mon[125939]: pgmap v15002: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 99 KiB/s wr, 7 op/s 2023-05-08T11:31:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28023.763827 secs 2023-05-08T11:31:26.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:25 smithi096 ceph-mon[124666]: pgmap v15002: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 99 KiB/s wr, 7 op/s 2023-05-08T11:31:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28023.763827 secs 2023-05-08T11:31:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:25 smithi186 ceph-mon[126480]: pgmap v15002: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 99 KiB/s wr, 7 op/s 2023-05-08T11:31:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28025.052420 secs 2023-05-08T11:31:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28025.052420 secs 2023-05-08T11:31:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28025.052420 secs 2023-05-08T11:31:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:27 smithi133 ceph-mon[125939]: pgmap v15003: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 99 KiB/s wr, 7 op/s 2023-05-08T11:31:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:27 smithi096 ceph-mon[124666]: pgmap v15003: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 99 KiB/s wr, 7 op/s 2023-05-08T11:31:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:27 smithi186 ceph-mon[126480]: pgmap v15003: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 99 KiB/s wr, 7 op/s 2023-05-08T11:31:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:29 smithi133 ceph-mon[125939]: pgmap v15004: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 99 KiB/s wr, 7 op/s 2023-05-08T11:31:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28028.208694 secs 2023-05-08T11:31:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:29 smithi096 ceph-mon[124666]: pgmap v15004: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 99 KiB/s wr, 7 op/s 2023-05-08T11:31:30.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28028.208694 secs 2023-05-08T11:31:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:29 smithi186 ceph-mon[126480]: pgmap v15004: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 99 KiB/s wr, 7 op/s 2023-05-08T11:31:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28028.208694 secs 2023-05-08T11:31:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28028.763941 secs 2023-05-08T11:31:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28028.763941 secs 2023-05-08T11:31:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28028.763941 secs 2023-05-08T11:31:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28030.052543 secs 2023-05-08T11:31:31.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:31 smithi133 ceph-mon[125939]: pgmap v15005: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2023-05-08T11:31:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28030.052543 secs 2023-05-08T11:31:32.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:31 smithi096 ceph-mon[124666]: pgmap v15005: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2023-05-08T11:31:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28030.052543 secs 2023-05-08T11:31:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:31 smithi186 ceph-mon[126480]: pgmap v15005: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2023-05-08T11:31:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:33 smithi133 ceph-mon[125939]: pgmap v15006: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T11:31:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:33 smithi096 ceph-mon[124666]: pgmap v15006: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T11:31:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:33 smithi186 ceph-mon[126480]: pgmap v15006: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T11:31:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28033.208837 secs 2023-05-08T11:31:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28033.208837 secs 2023-05-08T11:31:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28033.208837 secs 2023-05-08T11:31:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28033.764076 secs 2023-05-08T11:31:35.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:35 smithi133 ceph-mon[125939]: pgmap v15007: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 511 B/s wr, 9 op/s 2023-05-08T11:31:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28033.764076 secs 2023-05-08T11:31:36.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:35 smithi096 ceph-mon[124666]: pgmap v15007: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 511 B/s wr, 9 op/s 2023-05-08T11:31:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28033.764076 secs 2023-05-08T11:31:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:35 smithi186 ceph-mon[126480]: pgmap v15007: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 511 B/s wr, 9 op/s 2023-05-08T11:31:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28035.052670 secs 2023-05-08T11:31:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28035.052670 secs 2023-05-08T11:31:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28035.052670 secs 2023-05-08T11:31:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:37 smithi133 ceph-mon[125939]: pgmap v15008: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T11:31:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:37 smithi096 ceph-mon[124666]: pgmap v15008: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T11:31:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:37 smithi186 ceph-mon[126480]: pgmap v15008: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T11:31:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:39 smithi133 ceph-mon[125939]: pgmap v15009: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T11:31:39.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28038.208972 secs 2023-05-08T11:31:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:39 smithi096 ceph-mon[124666]: pgmap v15009: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T11:31:40.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28038.208972 secs 2023-05-08T11:31:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:39 smithi186 ceph-mon[126480]: pgmap v15009: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T11:31:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28038.208972 secs 2023-05-08T11:31:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28038.764190 secs 2023-05-08T11:31:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28038.764190 secs 2023-05-08T11:31:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28038.764190 secs 2023-05-08T11:31:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28040.052794 secs 2023-05-08T11:31:41.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:41 smithi133 ceph-mon[125939]: pgmap v15010: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 218 KiB/s wr, 10 op/s 2023-05-08T11:31:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28040.052794 secs 2023-05-08T11:31:42.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:41 smithi096 ceph-mon[124666]: pgmap v15010: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 218 KiB/s wr, 10 op/s 2023-05-08T11:31:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28040.052794 secs 2023-05-08T11:31:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:41 smithi186 ceph-mon[126480]: pgmap v15010: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 218 KiB/s wr, 10 op/s 2023-05-08T11:31:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:43 smithi133 ceph-mon[125939]: pgmap v15011: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 218 KiB/s wr, 7 op/s 2023-05-08T11:31:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:43 smithi096 ceph-mon[124666]: pgmap v15011: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 218 KiB/s wr, 7 op/s 2023-05-08T11:31:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:43 smithi186 ceph-mon[126480]: pgmap v15011: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 218 KiB/s wr, 7 op/s 2023-05-08T11:31:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28043.764305 secs 2023-05-08T11:31:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:45 smithi133 ceph-mon[125939]: pgmap v15012: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 219 KiB/s wr, 10 op/s 2023-05-08T11:31:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28043.764305 secs 2023-05-08T11:31:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:45 smithi096 ceph-mon[124666]: pgmap v15012: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 219 KiB/s wr, 10 op/s 2023-05-08T11:31:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28043.764305 secs 2023-05-08T11:31:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:45 smithi186 ceph-mon[126480]: pgmap v15012: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 219 KiB/s wr, 10 op/s 2023-05-08T11:31:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:47 smithi133 ceph-mon[125939]: pgmap v15013: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 218 KiB/s wr, 7 op/s 2023-05-08T11:31:47.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:31:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:47 smithi096 ceph-mon[124666]: pgmap v15013: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 218 KiB/s wr, 7 op/s 2023-05-08T11:31:48.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:31:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:47 smithi186 ceph-mon[126480]: pgmap v15013: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 218 KiB/s wr, 7 op/s 2023-05-08T11:31:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:31:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:48 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:31:48.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T11:31:48.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:31:48.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:31:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:48 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:31:49.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T11:31:49.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:31:49.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:31:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:48 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:31:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T11:31:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:31:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:31:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:49 smithi133 ceph-mon[125939]: pgmap v15014: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 218 KiB/s wr, 7 op/s 2023-05-08T11:31:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:31:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:31:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:49 smithi096 ceph-mon[124666]: pgmap v15014: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 218 KiB/s wr, 7 op/s 2023-05-08T11:31:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:31:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:31:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:49 smithi186 ceph-mon[126480]: pgmap v15014: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 218 KiB/s wr, 7 op/s 2023-05-08T11:31:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:31:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:31:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28048.764381 secs 2023-05-08T11:31:51.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28048.764381 secs 2023-05-08T11:31:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28048.764381 secs 2023-05-08T11:31:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:51 smithi133 ceph-mon[125939]: pgmap v15015: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 377 KiB/s rd, 341 KiB/s wr, 10 op/s 2023-05-08T11:31:52.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:51 smithi096 ceph-mon[124666]: pgmap v15015: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 377 KiB/s rd, 341 KiB/s wr, 10 op/s 2023-05-08T11:31:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:51 smithi186 ceph-mon[126480]: pgmap v15015: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 377 KiB/s rd, 341 KiB/s wr, 10 op/s 2023-05-08T11:31:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:53 smithi133 ceph-mon[125939]: pgmap v15016: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 124 KiB/s wr, 6 op/s 2023-05-08T11:31:53.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:53 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:31:53.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:53 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:31:53.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:53 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:31:53.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:53 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:31:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:53 smithi096 ceph-mon[124666]: pgmap v15016: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 124 KiB/s wr, 6 op/s 2023-05-08T11:31:54.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:53 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:31:54.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:53 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:31:54.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:53 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:31:54.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:53 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:31:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:53 smithi186 ceph-mon[126480]: pgmap v15016: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 124 KiB/s wr, 6 op/s 2023-05-08T11:31:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:53 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:31:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:53 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:31:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:53 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:31:54.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:53 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:31:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28053.209303 secs 2023-05-08T11:31:55.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:54 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:31:55.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:54 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T11:31:55.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:54 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T11:31:55.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:54 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:31:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28053.209303 secs 2023-05-08T11:31:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:54 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:31:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:54 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T11:31:55.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:54 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T11:31:55.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:54 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:31:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28053.209303 secs 2023-05-08T11:31:55.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:54 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:31:55.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:54 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T11:31:55.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:54 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T11:31:55.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:54 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:31:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:55 smithi096 ceph-mon[124666]: pgmap v15017: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 967 KiB/s rd, 665 KiB/s wr, 11 op/s 2023-05-08T11:31:56.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:55 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:31:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:55 smithi186 ceph-mon[126480]: pgmap v15017: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 967 KiB/s rd, 665 KiB/s wr, 11 op/s 2023-05-08T11:31:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:55 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:31:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:55 smithi133 ceph-mon[125939]: pgmap v15017: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 967 KiB/s rd, 665 KiB/s wr, 11 op/s 2023-05-08T11:31:56.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:55 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:31:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T11:31:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:31:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:31:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T11:31:57.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:31:57.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:31:57.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T11:31:57.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:31:57.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:31:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:57 smithi186 ceph-mon[126480]: pgmap v15018: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 748 KiB/s rd, 664 KiB/s wr, 8 op/s 2023-05-08T11:31:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:31:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:31:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:57 smithi133 ceph-mon[125939]: pgmap v15018: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 748 KiB/s rd, 664 KiB/s wr, 8 op/s 2023-05-08T11:31:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:31:58.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:31:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:57 smithi096 ceph-mon[124666]: pgmap v15018: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 748 KiB/s rd, 664 KiB/s wr, 8 op/s 2023-05-08T11:31:58.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:31:58.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:32:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:59 smithi186 ceph-mon[126480]: pgmap v15019: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 748 KiB/s rd, 664 KiB/s wr, 8 op/s 2023-05-08T11:32:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28058.209427 secs 2023-05-08T11:32:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:31:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28058.764645 secs 2023-05-08T11:32:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:59 smithi133 ceph-mon[125939]: pgmap v15019: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 748 KiB/s rd, 664 KiB/s wr, 8 op/s 2023-05-08T11:32:00.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28058.209427 secs 2023-05-08T11:32:00.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:31:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28058.764645 secs 2023-05-08T11:32:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:59 smithi096 ceph-mon[124666]: pgmap v15019: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 748 KiB/s rd, 664 KiB/s wr, 8 op/s 2023-05-08T11:32:00.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28058.209427 secs 2023-05-08T11:32:00.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:31:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28058.764645 secs 2023-05-08T11:32:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28060.053255 secs 2023-05-08T11:32:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:01 smithi186 ceph-mon[126480]: pgmap v15020: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 920 KiB/s rd, 1.0 MiB/s wr, 15 op/s 2023-05-08T11:32:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:01 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:32:01.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:32:01.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:32:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28060.053255 secs 2023-05-08T11:32:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:01 smithi133 ceph-mon[125939]: pgmap v15020: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 920 KiB/s rd, 1.0 MiB/s wr, 15 op/s 2023-05-08T11:32:01.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:01 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:32:01.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:32:01.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:32:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28060.053255 secs 2023-05-08T11:32:01.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:01 smithi096 ceph-mon[124666]: pgmap v15020: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 920 KiB/s rd, 1.0 MiB/s wr, 15 op/s 2023-05-08T11:32:01.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:01 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:32:01.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:32:01.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:32:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:03 smithi133 ceph-mon[125939]: pgmap v15021: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 764 KiB/s rd, 946 KiB/s wr, 12 op/s 2023-05-08T11:32:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:03 smithi096 ceph-mon[124666]: pgmap v15021: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 764 KiB/s rd, 946 KiB/s wr, 12 op/s 2023-05-08T11:32:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:03 smithi186 ceph-mon[126480]: pgmap v15021: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 764 KiB/s rd, 946 KiB/s wr, 12 op/s 2023-05-08T11:32:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28063.209509 secs 2023-05-08T11:32:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:04 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:32:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28063.209509 secs 2023-05-08T11:32:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:04 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:32:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28063.209509 secs 2023-05-08T11:32:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:04 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:32:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:05 smithi133 ceph-mon[125939]: pgmap v15022: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 18 op/s 2023-05-08T11:32:05.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:32:05.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:32:05.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:32:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:05 smithi096 ceph-mon[124666]: pgmap v15022: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 18 op/s 2023-05-08T11:32:05.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:32:05.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:32:05.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:32:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:05 smithi186 ceph-mon[126480]: pgmap v15022: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 18 op/s 2023-05-08T11:32:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:32:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:32:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:32:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28065.053371 secs 2023-05-08T11:32:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28065.053371 secs 2023-05-08T11:32:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28065.053371 secs 2023-05-08T11:32:07.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:07 smithi133 ceph-mon[125939]: pgmap v15023: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 573 KiB/s rd, 568 KiB/s wr, 14 op/s 2023-05-08T11:32:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:07 smithi096 ceph-mon[124666]: pgmap v15023: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 573 KiB/s rd, 568 KiB/s wr, 14 op/s 2023-05-08T11:32:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:07 smithi186 ceph-mon[126480]: pgmap v15023: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 573 KiB/s rd, 568 KiB/s wr, 14 op/s 2023-05-08T11:32:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:09 smithi133 ceph-mon[125939]: pgmap v15024: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 573 KiB/s rd, 568 KiB/s wr, 14 op/s 2023-05-08T11:32:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28068.209612 secs 2023-05-08T11:32:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:09 smithi096 ceph-mon[124666]: pgmap v15024: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 573 KiB/s rd, 568 KiB/s wr, 14 op/s 2023-05-08T11:32:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28068.209612 secs 2023-05-08T11:32:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:09 smithi186 ceph-mon[126480]: pgmap v15024: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 573 KiB/s rd, 568 KiB/s wr, 14 op/s 2023-05-08T11:32:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28068.209612 secs 2023-05-08T11:32:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28068.764903 secs 2023-05-08T11:32:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28068.764903 secs 2023-05-08T11:32:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28068.764903 secs 2023-05-08T11:32:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28070.053461 secs 2023-05-08T11:32:11.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:11 smithi096 ceph-mon[124666]: pgmap v15025: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 773 KiB/s rd, 910 KiB/s wr, 32 op/s 2023-05-08T11:32:11.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:11 smithi096 ceph-mon[124666]: osdmap e1016: 12 total, 12 up, 12 in 2023-05-08T11:32:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28070.053461 secs 2023-05-08T11:32:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:11 smithi186 ceph-mon[126480]: pgmap v15025: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 773 KiB/s rd, 910 KiB/s wr, 32 op/s 2023-05-08T11:32:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:11 smithi186 ceph-mon[126480]: osdmap e1016: 12 total, 12 up, 12 in 2023-05-08T11:32:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28070.053461 secs 2023-05-08T11:32:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:11 smithi133 ceph-mon[125939]: pgmap v15025: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 773 KiB/s rd, 910 KiB/s wr, 32 op/s 2023-05-08T11:32:11.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:11 smithi133 ceph-mon[125939]: osdmap e1016: 12 total, 12 up, 12 in 2023-05-08T11:32:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:12 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:32:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:12 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:32:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:12 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:32:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:12 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:32:12.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:12 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:32:12.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:12 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:32:13.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:12 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:32:13.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:12 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:32:13.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:12 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:32:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:13 smithi186 ceph-mon[126480]: pgmap v15027: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 720 KiB/s rd, 606 KiB/s wr, 29 op/s 2023-05-08T11:32:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:13 smithi133 ceph-mon[125939]: pgmap v15027: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 720 KiB/s rd, 606 KiB/s wr, 29 op/s 2023-05-08T11:32:14.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:13 smithi096 ceph-mon[124666]: pgmap v15027: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 720 KiB/s rd, 606 KiB/s wr, 29 op/s 2023-05-08T11:32:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28073.209692 secs 2023-05-08T11:32:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28073.209692 secs 2023-05-08T11:32:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28073.209692 secs 2023-05-08T11:32:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28073.764967 secs 2023-05-08T11:32:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:15 smithi186 ceph-mon[126480]: pgmap v15028: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 537 KiB/s rd, 551 KiB/s wr, 27 op/s 2023-05-08T11:32:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28073.764967 secs 2023-05-08T11:32:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:15 smithi133 ceph-mon[125939]: pgmap v15028: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 537 KiB/s rd, 551 KiB/s wr, 27 op/s 2023-05-08T11:32:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28073.764967 secs 2023-05-08T11:32:16.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:15 smithi096 ceph-mon[124666]: pgmap v15028: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 537 KiB/s rd, 551 KiB/s wr, 27 op/s 2023-05-08T11:32:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28075.053583 secs 2023-05-08T11:32:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28075.053583 secs 2023-05-08T11:32:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28075.053583 secs 2023-05-08T11:32:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:17 smithi186 ceph-mon[126480]: pgmap v15029: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 537 KiB/s rd, 550 KiB/s wr, 26 op/s 2023-05-08T11:32:17.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:17 smithi133 ceph-mon[125939]: pgmap v15029: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 537 KiB/s rd, 550 KiB/s wr, 26 op/s 2023-05-08T11:32:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:17 smithi096 ceph-mon[124666]: pgmap v15029: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 537 KiB/s rd, 550 KiB/s wr, 26 op/s 2023-05-08T11:32:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:19 smithi186 ceph-mon[126480]: pgmap v15030: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 537 KiB/s rd, 550 KiB/s wr, 26 op/s 2023-05-08T11:32:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28078.209806 secs 2023-05-08T11:32:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:19 smithi133 ceph-mon[125939]: pgmap v15030: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 537 KiB/s rd, 550 KiB/s wr, 26 op/s 2023-05-08T11:32:19.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28078.209806 secs 2023-05-08T11:32:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:19 smithi096 ceph-mon[124666]: pgmap v15030: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 537 KiB/s rd, 550 KiB/s wr, 26 op/s 2023-05-08T11:32:20.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28078.209806 secs 2023-05-08T11:32:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28078.765087 secs 2023-05-08T11:32:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:20 smithi186 ceph-mon[126480]: osdmap e1017: 12 total, 12 up, 12 in 2023-05-08T11:32:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28078.765087 secs 2023-05-08T11:32:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:20 smithi133 ceph-mon[125939]: osdmap e1017: 12 total, 12 up, 12 in 2023-05-08T11:32:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28078.765087 secs 2023-05-08T11:32:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:20 smithi096 ceph-mon[124666]: osdmap e1017: 12 total, 12 up, 12 in 2023-05-08T11:32:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28080.053711 secs 2023-05-08T11:32:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:21 smithi186 ceph-mon[126480]: pgmap v15032: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 377 KiB/s wr, 8 op/s 2023-05-08T11:32:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28080.053711 secs 2023-05-08T11:32:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:21 smithi133 ceph-mon[125939]: pgmap v15032: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 377 KiB/s wr, 8 op/s 2023-05-08T11:32:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28080.053711 secs 2023-05-08T11:32:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:21 smithi096 ceph-mon[124666]: pgmap v15032: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 377 KiB/s wr, 8 op/s 2023-05-08T11:32:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:23 smithi186 ceph-mon[126480]: pgmap v15033: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 532 KiB/s rd, 374 KiB/s wr, 8 op/s 2023-05-08T11:32:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:23 smithi133 ceph-mon[125939]: pgmap v15033: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 532 KiB/s rd, 374 KiB/s wr, 8 op/s 2023-05-08T11:32:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:23 smithi096 ceph-mon[124666]: pgmap v15033: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 532 KiB/s rd, 374 KiB/s wr, 8 op/s 2023-05-08T11:32:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28083.209941 secs 2023-05-08T11:32:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28083.209941 secs 2023-05-08T11:32:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28083.209941 secs 2023-05-08T11:32:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28083.765186 secs 2023-05-08T11:32:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:25 smithi186 ceph-mon[126480]: pgmap v15034: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 233 KiB/s wr, 6 op/s 2023-05-08T11:32:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28083.765186 secs 2023-05-08T11:32:25.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:25 smithi133 ceph-mon[125939]: pgmap v15034: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 233 KiB/s wr, 6 op/s 2023-05-08T11:32:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28083.765186 secs 2023-05-08T11:32:26.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:25 smithi096 ceph-mon[124666]: pgmap v15034: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 233 KiB/s wr, 6 op/s 2023-05-08T11:32:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28085.053845 secs 2023-05-08T11:32:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28085.053845 secs 2023-05-08T11:32:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28085.053845 secs 2023-05-08T11:32:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:27 smithi186 ceph-mon[126480]: pgmap v15035: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 233 KiB/s wr, 6 op/s 2023-05-08T11:32:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:27 smithi133 ceph-mon[125939]: pgmap v15035: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 233 KiB/s wr, 6 op/s 2023-05-08T11:32:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:27 smithi096 ceph-mon[124666]: pgmap v15035: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 233 KiB/s wr, 6 op/s 2023-05-08T11:32:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:29 smithi186 ceph-mon[126480]: pgmap v15036: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 233 KiB/s wr, 6 op/s 2023-05-08T11:32:29.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28088.210058 secs 2023-05-08T11:32:29.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:29 smithi133 ceph-mon[125939]: pgmap v15036: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 233 KiB/s wr, 6 op/s 2023-05-08T11:32:29.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28088.210058 secs 2023-05-08T11:32:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:29 smithi096 ceph-mon[124666]: pgmap v15036: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 233 KiB/s wr, 6 op/s 2023-05-08T11:32:30.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28088.210058 secs 2023-05-08T11:32:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28088.765304 secs 2023-05-08T11:32:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28088.765304 secs 2023-05-08T11:32:31.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28088.765304 secs 2023-05-08T11:32:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28090.053970 secs 2023-05-08T11:32:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:31 smithi186 ceph-mon[126480]: pgmap v15037: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T11:32:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28090.053970 secs 2023-05-08T11:32:31.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:31 smithi133 ceph-mon[125939]: pgmap v15037: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T11:32:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28090.053970 secs 2023-05-08T11:32:32.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:31 smithi096 ceph-mon[124666]: pgmap v15037: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T11:32:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:33 smithi186 ceph-mon[126480]: pgmap v15038: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T11:32:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:33 smithi133 ceph-mon[125939]: pgmap v15038: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T11:32:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:33 smithi096 ceph-mon[124666]: pgmap v15038: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T11:32:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28093.210194 secs 2023-05-08T11:32:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28093.210194 secs 2023-05-08T11:32:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28093.210194 secs 2023-05-08T11:32:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28093.765414 secs 2023-05-08T11:32:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:35 smithi186 ceph-mon[126480]: pgmap v15039: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 7 op/s 2023-05-08T11:32:35.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28093.765414 secs 2023-05-08T11:32:35.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:35 smithi133 ceph-mon[125939]: pgmap v15039: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 7 op/s 2023-05-08T11:32:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28093.765414 secs 2023-05-08T11:32:36.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:35 smithi096 ceph-mon[124666]: pgmap v15039: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 7 op/s 2023-05-08T11:32:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28095.054031 secs 2023-05-08T11:32:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28095.054031 secs 2023-05-08T11:32:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28095.054031 secs 2023-05-08T11:32:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:37 smithi186 ceph-mon[126480]: pgmap v15040: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T11:32:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:37 smithi133 ceph-mon[125939]: pgmap v15040: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T11:32:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:37 smithi096 ceph-mon[124666]: pgmap v15040: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T11:32:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:39 smithi186 ceph-mon[126480]: pgmap v15041: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T11:32:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28098.210303 secs 2023-05-08T11:32:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:39 smithi133 ceph-mon[125939]: pgmap v15041: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T11:32:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28098.210303 secs 2023-05-08T11:32:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:39 smithi096 ceph-mon[124666]: pgmap v15041: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T11:32:40.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28098.210303 secs 2023-05-08T11:32:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28098.765530 secs 2023-05-08T11:32:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28098.765530 secs 2023-05-08T11:32:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28098.765530 secs 2023-05-08T11:32:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28100.054153 secs 2023-05-08T11:32:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:41 smithi133 ceph-mon[125939]: pgmap v15042: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 8 op/s 2023-05-08T11:32:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28100.054153 secs 2023-05-08T11:32:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:41 smithi096 ceph-mon[124666]: pgmap v15042: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 8 op/s 2023-05-08T11:32:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28100.054153 secs 2023-05-08T11:32:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:41 smithi186 ceph-mon[126480]: pgmap v15042: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 8 op/s 2023-05-08T11:32:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:43 smithi133 ceph-mon[125939]: pgmap v15043: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 5 op/s 2023-05-08T11:32:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:43 smithi096 ceph-mon[124666]: pgmap v15043: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 5 op/s 2023-05-08T11:32:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:43 smithi186 ceph-mon[126480]: pgmap v15043: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 5 op/s 2023-05-08T11:32:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28103.210394 secs 2023-05-08T11:32:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28103.210394 secs 2023-05-08T11:32:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28103.210394 secs 2023-05-08T11:32:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28103.765654 secs 2023-05-08T11:32:45.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:45 smithi133 ceph-mon[125939]: pgmap v15044: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 107 KiB/s wr, 10 op/s 2023-05-08T11:32:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28103.765654 secs 2023-05-08T11:32:46.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:45 smithi096 ceph-mon[124666]: pgmap v15044: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 107 KiB/s wr, 10 op/s 2023-05-08T11:32:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28103.765654 secs 2023-05-08T11:32:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:45 smithi186 ceph-mon[126480]: pgmap v15044: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 107 KiB/s wr, 10 op/s 2023-05-08T11:32:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:47 smithi133 ceph-mon[125939]: pgmap v15045: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 107 KiB/s wr, 7 op/s 2023-05-08T11:32:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:47 smithi096 ceph-mon[124666]: pgmap v15045: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 107 KiB/s wr, 7 op/s 2023-05-08T11:32:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:47 smithi186 ceph-mon[126480]: pgmap v15045: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 107 KiB/s wr, 7 op/s 2023-05-08T11:32:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:32:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:32:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:32:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:49 smithi133 ceph-mon[125939]: pgmap v15046: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 107 KiB/s wr, 7 op/s 2023-05-08T11:32:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28108.210547 secs 2023-05-08T11:32:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:32:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:32:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:32:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:49 smithi096 ceph-mon[124666]: pgmap v15046: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 107 KiB/s wr, 7 op/s 2023-05-08T11:32:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28108.210547 secs 2023-05-08T11:32:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:32:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:32:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:32:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:49 smithi186 ceph-mon[126480]: pgmap v15046: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 107 KiB/s wr, 7 op/s 2023-05-08T11:32:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28108.210547 secs 2023-05-08T11:32:50.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:32:50.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:32:50.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:32:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28108.765777 secs 2023-05-08T11:32:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28108.765777 secs 2023-05-08T11:32:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28108.765777 secs 2023-05-08T11:32:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:51 smithi133 ceph-mon[125939]: pgmap v15047: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 444 KiB/s rd, 776 KiB/s wr, 10 op/s 2023-05-08T11:32:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:51 smithi096 ceph-mon[124666]: pgmap v15047: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 444 KiB/s rd, 776 KiB/s wr, 10 op/s 2023-05-08T11:32:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:51 smithi186 ceph-mon[126480]: pgmap v15047: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 444 KiB/s rd, 776 KiB/s wr, 10 op/s 2023-05-08T11:32:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:53 smithi133 ceph-mon[125939]: pgmap v15048: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 776 KiB/s wr, 7 op/s 2023-05-08T11:32:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:53 smithi096 ceph-mon[124666]: pgmap v15048: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 776 KiB/s wr, 7 op/s 2023-05-08T11:32:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:53 smithi186 ceph-mon[126480]: pgmap v15048: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 776 KiB/s wr, 7 op/s 2023-05-08T11:32:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28113.210638 secs 2023-05-08T11:32:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:32:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28113.210638 secs 2023-05-08T11:32:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:32:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28113.210638 secs 2023-05-08T11:32:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:32:55.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:55 smithi133 ceph-mon[125939]: pgmap v15049: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T11:32:56.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:55 smithi096 ceph-mon[124666]: pgmap v15049: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T11:32:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:55 smithi186 ceph-mon[126480]: pgmap v15049: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T11:32:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28115.054516 secs 2023-05-08T11:32:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:32:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:32:56.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:32:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28115.054516 secs 2023-05-08T11:32:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:32:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:32:57.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:32:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28115.054516 secs 2023-05-08T11:32:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:32:57.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:32:57.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:32:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:57 smithi133 ceph-mon[125939]: pgmap v15050: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1001 KiB/s wr, 9 op/s 2023-05-08T11:32:57.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:32:57.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:32:57.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:32:57.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:32:57.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:32:57.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:32:57.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:32:57.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:32:57.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:32:57.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:32:57.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:32:57.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:32:57.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:32:57.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:32:57.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:32:57.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:32:57.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:32:57.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:32:57.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:32:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:57 smithi096 ceph-mon[124666]: pgmap v15050: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1001 KiB/s wr, 9 op/s 2023-05-08T11:32:58.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:32:58.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:32:58.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:32:58.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:32:58.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:32:58.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:32:58.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:32:58.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:32:58.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:32:58.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:32:58.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:32:58.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:32:58.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:32:58.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:32:58.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:32:58.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:32:58.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:32:58.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:32:58.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:32:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:57 smithi186 ceph-mon[126480]: pgmap v15050: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1001 KiB/s wr, 9 op/s 2023-05-08T11:32:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:32:58.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:32:58.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:32:58.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:32:58.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:32:58.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:32:58.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:32:58.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:32:58.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:32:58.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:32:58.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:32:58.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:32:58.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:32:58.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:32:58.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:32:58.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:32:58.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:32:58.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:32:58.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:32:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:58 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi186 to 167.0M 2023-05-08T11:32:58.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:58 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi186 to 175167983: error parsing value: Value '175167983' is below minimum 939524096 2023-05-08T11:32:58.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:58 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi133 to 175.9M 2023-05-08T11:32:58.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:58 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi133 to 184546021: error parsing value: Value '184546021' is below minimum 939524096 2023-05-08T11:32:58.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:58 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:32:58.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:58 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T11:32:58.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:58 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T11:32:58.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:58 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:32:59.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:58 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi186 to 167.0M 2023-05-08T11:32:59.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:58 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi186 to 175167983: error parsing value: Value '175167983' is below minimum 939524096 2023-05-08T11:32:59.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:58 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi133 to 175.9M 2023-05-08T11:32:59.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:58 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi133 to 184546021: error parsing value: Value '184546021' is below minimum 939524096 2023-05-08T11:32:59.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:58 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:32:59.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:58 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T11:32:59.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:58 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T11:32:59.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:58 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:32:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:58 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi186 to 167.0M 2023-05-08T11:32:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:58 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi186 to 175167983: error parsing value: Value '175167983' is below minimum 939524096 2023-05-08T11:32:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:58 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi133 to 175.9M 2023-05-08T11:32:59.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:58 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi133 to 184546021: error parsing value: Value '184546021' is below minimum 939524096 2023-05-08T11:32:59.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:58 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:32:59.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:58 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T11:32:59.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:58 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T11:32:59.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:58 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:32:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:59 smithi133 ceph-mon[125939]: pgmap v15051: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1001 KiB/s wr, 9 op/s 2023-05-08T11:32:59.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:32:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28118.210751 secs 2023-05-08T11:33:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:59 smithi096 ceph-mon[124666]: pgmap v15051: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1001 KiB/s wr, 9 op/s 2023-05-08T11:33:00.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:32:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28118.210751 secs 2023-05-08T11:33:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:59 smithi186 ceph-mon[126480]: pgmap v15051: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1001 KiB/s wr, 9 op/s 2023-05-08T11:33:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:32:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28118.210751 secs 2023-05-08T11:33:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28120.054640 secs 2023-05-08T11:33:01.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:01 smithi133 ceph-mon[125939]: pgmap v15052: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 15 op/s 2023-05-08T11:33:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28120.054640 secs 2023-05-08T11:33:01.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:01 smithi096 ceph-mon[124666]: pgmap v15052: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 15 op/s 2023-05-08T11:33:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28120.054640 secs 2023-05-08T11:33:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:01 smithi186 ceph-mon[126480]: pgmap v15052: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 15 op/s 2023-05-08T11:33:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:03 smithi133 ceph-mon[125939]: pgmap v15053: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 773 KiB/s wr, 11 op/s 2023-05-08T11:33:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:03 smithi096 ceph-mon[124666]: pgmap v15053: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 773 KiB/s wr, 11 op/s 2023-05-08T11:33:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:03 smithi186 ceph-mon[126480]: pgmap v15053: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 773 KiB/s wr, 11 op/s 2023-05-08T11:33:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28123.210873 secs 2023-05-08T11:33:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28123.210873 secs 2023-05-08T11:33:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28123.210873 secs 2023-05-08T11:33:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28123.766078 secs 2023-05-08T11:33:05.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:05 smithi096 ceph-mon[124666]: pgmap v15054: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 31 op/s 2023-05-08T11:33:05.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:05 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:33:05.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:33:05.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:33:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28123.766078 secs 2023-05-08T11:33:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:05 smithi186 ceph-mon[126480]: pgmap v15054: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 31 op/s 2023-05-08T11:33:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:05 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:33:05.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:33:05.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:33:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28123.766078 secs 2023-05-08T11:33:05.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:05 smithi133 ceph-mon[125939]: pgmap v15054: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 31 op/s 2023-05-08T11:33:05.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:05 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:33:05.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:33:05.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:33:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28125.054809 secs 2023-05-08T11:33:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28125.054809 secs 2023-05-08T11:33:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28125.054809 secs 2023-05-08T11:33:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:07 smithi096 ceph-mon[124666]: pgmap v15055: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 684 KiB/s rd, 719 KiB/s wr, 26 op/s 2023-05-08T11:33:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:07 smithi186 ceph-mon[126480]: pgmap v15055: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 684 KiB/s rd, 719 KiB/s wr, 26 op/s 2023-05-08T11:33:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:07 smithi133 ceph-mon[125939]: pgmap v15055: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 684 KiB/s rd, 719 KiB/s wr, 26 op/s 2023-05-08T11:33:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:09 smithi096 ceph-mon[124666]: pgmap v15056: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 684 KiB/s rd, 719 KiB/s wr, 26 op/s 2023-05-08T11:33:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28128.210991 secs 2023-05-08T11:33:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:09 smithi186 ceph-mon[126480]: pgmap v15056: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 684 KiB/s rd, 719 KiB/s wr, 26 op/s 2023-05-08T11:33:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28128.210991 secs 2023-05-08T11:33:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:09 smithi133 ceph-mon[125939]: pgmap v15056: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 684 KiB/s rd, 719 KiB/s wr, 26 op/s 2023-05-08T11:33:09.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28128.210991 secs 2023-05-08T11:33:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28128.766175 secs 2023-05-08T11:33:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28128.766175 secs 2023-05-08T11:33:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28128.766175 secs 2023-05-08T11:33:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28130.054894 secs 2023-05-08T11:33:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:11 smithi186 ceph-mon[126480]: pgmap v15057: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 686 KiB/s rd, 825 KiB/s wr, 29 op/s 2023-05-08T11:33:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:11 smithi186 ceph-mon[126480]: osdmap e1018: 12 total, 12 up, 12 in 2023-05-08T11:33:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28130.054894 secs 2023-05-08T11:33:11.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:11 smithi133 ceph-mon[125939]: pgmap v15057: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 686 KiB/s rd, 825 KiB/s wr, 29 op/s 2023-05-08T11:33:11.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:11 smithi133 ceph-mon[125939]: osdmap e1018: 12 total, 12 up, 12 in 2023-05-08T11:33:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28130.054894 secs 2023-05-08T11:33:12.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:11 smithi096 ceph-mon[124666]: pgmap v15057: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 686 KiB/s rd, 825 KiB/s wr, 29 op/s 2023-05-08T11:33:12.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:11 smithi096 ceph-mon[124666]: osdmap e1018: 12 total, 12 up, 12 in 2023-05-08T11:33:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:13 smithi186 ceph-mon[126480]: pgmap v15059: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 460 KiB/s wr, 27 op/s 2023-05-08T11:33:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:13 smithi133 ceph-mon[125939]: pgmap v15059: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 460 KiB/s wr, 27 op/s 2023-05-08T11:33:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:13 smithi096 ceph-mon[124666]: pgmap v15059: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 460 KiB/s wr, 27 op/s 2023-05-08T11:33:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28133.211128 secs 2023-05-08T11:33:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28133.211128 secs 2023-05-08T11:33:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28133.211128 secs 2023-05-08T11:33:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28133.766315 secs 2023-05-08T11:33:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:15 smithi186 ceph-mon[126480]: pgmap v15060: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 128 KiB/s wr, 7 op/s 2023-05-08T11:33:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28133.766315 secs 2023-05-08T11:33:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:15 smithi133 ceph-mon[125939]: pgmap v15060: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 128 KiB/s wr, 7 op/s 2023-05-08T11:33:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28133.766315 secs 2023-05-08T11:33:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:15 smithi096 ceph-mon[124666]: pgmap v15060: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 128 KiB/s wr, 7 op/s 2023-05-08T11:33:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28135.055015 secs 2023-05-08T11:33:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28135.055015 secs 2023-05-08T11:33:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28135.055015 secs 2023-05-08T11:33:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:17 smithi186 ceph-mon[126480]: pgmap v15061: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 128 KiB/s wr, 7 op/s 2023-05-08T11:33:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:17 smithi133 ceph-mon[125939]: pgmap v15061: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 128 KiB/s wr, 7 op/s 2023-05-08T11:33:18.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:17 smithi096 ceph-mon[124666]: pgmap v15061: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 128 KiB/s wr, 7 op/s 2023-05-08T11:33:19.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:19 smithi186 ceph-mon[126480]: pgmap v15062: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 128 KiB/s wr, 7 op/s 2023-05-08T11:33:19.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28138.211249 secs 2023-05-08T11:33:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:19 smithi133 ceph-mon[125939]: pgmap v15062: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 128 KiB/s wr, 7 op/s 2023-05-08T11:33:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28138.211249 secs 2023-05-08T11:33:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:19 smithi096 ceph-mon[124666]: pgmap v15062: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 128 KiB/s wr, 7 op/s 2023-05-08T11:33:20.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28138.211249 secs 2023-05-08T11:33:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28138.766431 secs 2023-05-08T11:33:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:20 smithi186 ceph-mon[126480]: osdmap e1019: 12 total, 12 up, 12 in 2023-05-08T11:33:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28138.766431 secs 2023-05-08T11:33:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:20 smithi133 ceph-mon[125939]: osdmap e1019: 12 total, 12 up, 12 in 2023-05-08T11:33:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28138.766431 secs 2023-05-08T11:33:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:20 smithi096 ceph-mon[124666]: osdmap e1019: 12 total, 12 up, 12 in 2023-05-08T11:33:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28140.055143 secs 2023-05-08T11:33:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:21 smithi186 ceph-mon[126480]: pgmap v15064: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 618 B/s wr, 6 op/s 2023-05-08T11:33:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28140.055143 secs 2023-05-08T11:33:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:21 smithi133 ceph-mon[125939]: pgmap v15064: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 618 B/s wr, 6 op/s 2023-05-08T11:33:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28140.055143 secs 2023-05-08T11:33:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:21 smithi096 ceph-mon[124666]: pgmap v15064: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 618 B/s wr, 6 op/s 2023-05-08T11:33:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:23 smithi186 ceph-mon[126480]: pgmap v15065: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 614 B/s wr, 6 op/s 2023-05-08T11:33:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:23 smithi133 ceph-mon[125939]: pgmap v15065: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 614 B/s wr, 6 op/s 2023-05-08T11:33:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:23 smithi096 ceph-mon[124666]: pgmap v15065: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 614 B/s wr, 6 op/s 2023-05-08T11:33:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28143.211387 secs 2023-05-08T11:33:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28143.211387 secs 2023-05-08T11:33:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28143.211387 secs 2023-05-08T11:33:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28143.766555 secs 2023-05-08T11:33:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:25 smithi186 ceph-mon[126480]: pgmap v15066: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T11:33:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28143.766555 secs 2023-05-08T11:33:25.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:25 smithi133 ceph-mon[125939]: pgmap v15066: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T11:33:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28143.766555 secs 2023-05-08T11:33:26.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:25 smithi096 ceph-mon[124666]: pgmap v15066: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T11:33:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28145.055269 secs 2023-05-08T11:33:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28145.055269 secs 2023-05-08T11:33:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28145.055269 secs 2023-05-08T11:33:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:27 smithi186 ceph-mon[126480]: pgmap v15067: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T11:33:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:27 smithi133 ceph-mon[125939]: pgmap v15067: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T11:33:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:27 smithi096 ceph-mon[124666]: pgmap v15067: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T11:33:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:29 smithi186 ceph-mon[126480]: pgmap v15068: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T11:33:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28148.211493 secs 2023-05-08T11:33:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:29 smithi133 ceph-mon[125939]: pgmap v15068: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T11:33:29.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28148.211493 secs 2023-05-08T11:33:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:29 smithi096 ceph-mon[124666]: pgmap v15068: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T11:33:30.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28148.211493 secs 2023-05-08T11:33:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28148.766657 secs 2023-05-08T11:33:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28148.766657 secs 2023-05-08T11:33:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28148.766657 secs 2023-05-08T11:33:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28150.055401 secs 2023-05-08T11:33:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:31 smithi186 ceph-mon[126480]: pgmap v15069: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 4.3 KiB/s wr, 6 op/s 2023-05-08T11:33:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28150.055401 secs 2023-05-08T11:33:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:31 smithi133 ceph-mon[125939]: pgmap v15069: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 4.3 KiB/s wr, 6 op/s 2023-05-08T11:33:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28150.055401 secs 2023-05-08T11:33:32.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:31 smithi096 ceph-mon[124666]: pgmap v15069: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 4.3 KiB/s wr, 6 op/s 2023-05-08T11:33:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:33 smithi186 ceph-mon[126480]: pgmap v15070: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 3.6 KiB/s wr, 5 op/s 2023-05-08T11:33:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:33 smithi133 ceph-mon[125939]: pgmap v15070: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 3.6 KiB/s wr, 5 op/s 2023-05-08T11:33:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:33 smithi096 ceph-mon[124666]: pgmap v15070: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 3.6 KiB/s wr, 5 op/s 2023-05-08T11:33:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28153.211632 secs 2023-05-08T11:33:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28153.211632 secs 2023-05-08T11:33:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28153.211632 secs 2023-05-08T11:33:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28153.766789 secs 2023-05-08T11:33:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:35 smithi186 ceph-mon[126480]: pgmap v15071: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 319 KiB/s wr, 9 op/s 2023-05-08T11:33:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28153.766789 secs 2023-05-08T11:33:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:35 smithi133 ceph-mon[125939]: pgmap v15071: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 319 KiB/s wr, 9 op/s 2023-05-08T11:33:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28153.766789 secs 2023-05-08T11:33:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:35 smithi096 ceph-mon[124666]: pgmap v15071: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 319 KiB/s wr, 9 op/s 2023-05-08T11:33:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28155.055527 secs 2023-05-08T11:33:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28155.055527 secs 2023-05-08T11:33:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28155.055527 secs 2023-05-08T11:33:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:37 smithi186 ceph-mon[126480]: pgmap v15072: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 319 KiB/s wr, 7 op/s 2023-05-08T11:33:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:37 smithi133 ceph-mon[125939]: pgmap v15072: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 319 KiB/s wr, 7 op/s 2023-05-08T11:33:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:37 smithi096 ceph-mon[124666]: pgmap v15072: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 319 KiB/s wr, 7 op/s 2023-05-08T11:33:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:39 smithi186 ceph-mon[126480]: pgmap v15073: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 319 KiB/s wr, 7 op/s 2023-05-08T11:33:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28158.211734 secs 2023-05-08T11:33:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:39 smithi133 ceph-mon[125939]: pgmap v15073: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 319 KiB/s wr, 7 op/s 2023-05-08T11:33:39.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28158.211734 secs 2023-05-08T11:33:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:39 smithi096 ceph-mon[124666]: pgmap v15073: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 319 KiB/s wr, 7 op/s 2023-05-08T11:33:40.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28158.211734 secs 2023-05-08T11:33:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28158.766883 secs 2023-05-08T11:33:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28158.766883 secs 2023-05-08T11:33:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28158.766883 secs 2023-05-08T11:33:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28160.055659 secs 2023-05-08T11:33:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:41 smithi186 ceph-mon[126480]: pgmap v15074: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 320 KiB/s wr, 10 op/s 2023-05-08T11:33:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28160.055659 secs 2023-05-08T11:33:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:41 smithi133 ceph-mon[125939]: pgmap v15074: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 320 KiB/s wr, 10 op/s 2023-05-08T11:33:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28160.055659 secs 2023-05-08T11:33:42.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:41 smithi096 ceph-mon[124666]: pgmap v15074: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 320 KiB/s wr, 10 op/s 2023-05-08T11:33:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:43 smithi186 ceph-mon[126480]: pgmap v15075: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 316 KiB/s wr, 7 op/s 2023-05-08T11:33:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:43 smithi133 ceph-mon[125939]: pgmap v15075: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 316 KiB/s wr, 7 op/s 2023-05-08T11:33:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:43 smithi096 ceph-mon[124666]: pgmap v15075: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 316 KiB/s wr, 7 op/s 2023-05-08T11:33:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28163.211847 secs 2023-05-08T11:33:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28163.211847 secs 2023-05-08T11:33:45.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28163.211847 secs 2023-05-08T11:33:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28163.767005 secs 2023-05-08T11:33:45.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:45 smithi186 ceph-mon[126480]: pgmap v15076: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 405 KiB/s rd, 343 KiB/s wr, 11 op/s 2023-05-08T11:33:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28163.767005 secs 2023-05-08T11:33:45.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:45 smithi133 ceph-mon[125939]: pgmap v15076: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 405 KiB/s rd, 343 KiB/s wr, 11 op/s 2023-05-08T11:33:46.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28163.767005 secs 2023-05-08T11:33:46.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:45 smithi096 ceph-mon[124666]: pgmap v15076: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 405 KiB/s rd, 343 KiB/s wr, 11 op/s 2023-05-08T11:33:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:47 smithi186 ceph-mon[126480]: pgmap v15077: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 27 KiB/s wr, 6 op/s 2023-05-08T11:33:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:47 smithi133 ceph-mon[125939]: pgmap v15077: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 27 KiB/s wr, 6 op/s 2023-05-08T11:33:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:47 smithi096 ceph-mon[124666]: pgmap v15077: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 27 KiB/s wr, 6 op/s 2023-05-08T11:33:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:33:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:33:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:33:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:49 smithi186 ceph-mon[126480]: pgmap v15078: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 27 KiB/s wr, 6 op/s 2023-05-08T11:33:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28168.211960 secs 2023-05-08T11:33:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:33:49.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:33:49.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:33:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:49 smithi133 ceph-mon[125939]: pgmap v15078: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 27 KiB/s wr, 6 op/s 2023-05-08T11:33:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28168.211960 secs 2023-05-08T11:33:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:33:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:33:49.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:33:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:49 smithi096 ceph-mon[124666]: pgmap v15078: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 27 KiB/s wr, 6 op/s 2023-05-08T11:33:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28168.211960 secs 2023-05-08T11:33:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:33:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:33:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:33:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28168.767155 secs 2023-05-08T11:33:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28168.767155 secs 2023-05-08T11:33:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28168.767155 secs 2023-05-08T11:33:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:51 smithi186 ceph-mon[126480]: pgmap v15079: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 740 KiB/s rd, 368 KiB/s wr, 10 op/s 2023-05-08T11:33:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:51 smithi133 ceph-mon[125939]: pgmap v15079: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 740 KiB/s rd, 368 KiB/s wr, 10 op/s 2023-05-08T11:33:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:51 smithi096 ceph-mon[124666]: pgmap v15079: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 740 KiB/s rd, 368 KiB/s wr, 10 op/s 2023-05-08T11:33:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:53 smithi133 ceph-mon[125939]: pgmap v15080: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 520 KiB/s rd, 368 KiB/s wr, 6 op/s 2023-05-08T11:33:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:53 smithi096 ceph-mon[124666]: pgmap v15080: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 520 KiB/s rd, 368 KiB/s wr, 6 op/s 2023-05-08T11:33:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:53 smithi186 ceph-mon[126480]: pgmap v15080: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 520 KiB/s rd, 368 KiB/s wr, 6 op/s 2023-05-08T11:33:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28173.212105 secs 2023-05-08T11:33:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28173.212105 secs 2023-05-08T11:33:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28173.212105 secs 2023-05-08T11:33:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:55 smithi133 ceph-mon[125939]: pgmap v15081: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 903 KiB/s rd, 660 KiB/s wr, 11 op/s 2023-05-08T11:33:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:55 smithi096 ceph-mon[124666]: pgmap v15081: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 903 KiB/s rd, 660 KiB/s wr, 11 op/s 2023-05-08T11:33:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:55 smithi186 ceph-mon[126480]: pgmap v15081: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 903 KiB/s rd, 660 KiB/s wr, 11 op/s 2023-05-08T11:33:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:33:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:33:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:33:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:57 smithi133 ceph-mon[125939]: pgmap v15082: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 823 KiB/s rd, 634 KiB/s wr, 8 op/s 2023-05-08T11:33:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:57 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:33:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:33:57.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:33:57.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:33:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:57 smithi096 ceph-mon[124666]: pgmap v15082: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 823 KiB/s rd, 634 KiB/s wr, 8 op/s 2023-05-08T11:33:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:57 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:33:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:33:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:33:58.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:33:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:57 smithi186 ceph-mon[126480]: pgmap v15082: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 823 KiB/s rd, 634 KiB/s wr, 8 op/s 2023-05-08T11:33:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:57 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:33:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:33:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:33:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:33:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:33:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:33:58.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:58 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:33:58.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:33:58.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:58 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T11:33:58.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:58 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T11:33:58.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:33:58 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:33:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:33:59.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:33:59.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:58 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:33:59.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:33:59.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:58 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T11:33:59.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:58 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T11:33:59.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:33:58 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:33:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:33:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:33:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:58 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:33:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:33:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:58 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T11:33:59.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:58 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T11:33:59.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:33:58 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:34:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:00 smithi133 ceph-mon[125939]: pgmap v15083: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 823 KiB/s rd, 634 KiB/s wr, 8 op/s 2023-05-08T11:34:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28178.212216 secs 2023-05-08T11:34:00.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28178.767422 secs 2023-05-08T11:34:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:00 smithi096 ceph-mon[124666]: pgmap v15083: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 823 KiB/s rd, 634 KiB/s wr, 8 op/s 2023-05-08T11:34:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28178.212216 secs 2023-05-08T11:34:00.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28178.767422 secs 2023-05-08T11:34:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:00 smithi186 ceph-mon[126480]: pgmap v15083: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 823 KiB/s rd, 634 KiB/s wr, 8 op/s 2023-05-08T11:34:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28178.212216 secs 2023-05-08T11:34:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28178.767422 secs 2023-05-08T11:34:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28180.056148 secs 2023-05-08T11:34:01.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:01 smithi133 ceph-mon[125939]: pgmap v15084: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 14 op/s 2023-05-08T11:34:01.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:34:01.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:34:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28180.056148 secs 2023-05-08T11:34:01.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:01 smithi096 ceph-mon[124666]: pgmap v15084: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 14 op/s 2023-05-08T11:34:01.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:34:01.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:34:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28180.056148 secs 2023-05-08T11:34:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:01 smithi186 ceph-mon[126480]: pgmap v15084: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 14 op/s 2023-05-08T11:34:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:34:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:34:03.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:03 smithi096 ceph-mon[124666]: pgmap v15085: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 842 KiB/s rd, 702 KiB/s wr, 11 op/s 2023-05-08T11:34:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:03 smithi186 ceph-mon[126480]: pgmap v15085: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 842 KiB/s rd, 702 KiB/s wr, 11 op/s 2023-05-08T11:34:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:03 smithi133 ceph-mon[125939]: pgmap v15085: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 842 KiB/s rd, 702 KiB/s wr, 11 op/s 2023-05-08T11:34:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28183.212332 secs 2023-05-08T11:34:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:04 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:34:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28183.212332 secs 2023-05-08T11:34:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:04 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:34:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28183.212332 secs 2023-05-08T11:34:05.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:04 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:34:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:05 smithi186 ceph-mon[126480]: pgmap v15086: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 973 KiB/s wr, 18 op/s 2023-05-08T11:34:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:34:05.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:34:05.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:34:05.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:05 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:34:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:05 smithi133 ceph-mon[125939]: pgmap v15086: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 973 KiB/s wr, 18 op/s 2023-05-08T11:34:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:34:05.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:34:05.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:34:05.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:05 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:34:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:05 smithi096 ceph-mon[124666]: pgmap v15086: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 973 KiB/s wr, 18 op/s 2023-05-08T11:34:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:34:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:34:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:34:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:05 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:34:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28185.056274 secs 2023-05-08T11:34:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28185.056274 secs 2023-05-08T11:34:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28185.056274 secs 2023-05-08T11:34:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:07 smithi186 ceph-mon[126480]: pgmap v15087: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 716 KiB/s rd, 681 KiB/s wr, 13 op/s 2023-05-08T11:34:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:07 smithi133 ceph-mon[125939]: pgmap v15087: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 716 KiB/s rd, 681 KiB/s wr, 13 op/s 2023-05-08T11:34:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:07 smithi096 ceph-mon[124666]: pgmap v15087: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 716 KiB/s rd, 681 KiB/s wr, 13 op/s 2023-05-08T11:34:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:09 smithi186 ceph-mon[126480]: pgmap v15088: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 716 KiB/s rd, 681 KiB/s wr, 13 op/s 2023-05-08T11:34:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28188.212454 secs 2023-05-08T11:34:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:09 smithi133 ceph-mon[125939]: pgmap v15088: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 716 KiB/s rd, 681 KiB/s wr, 13 op/s 2023-05-08T11:34:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28188.212454 secs 2023-05-08T11:34:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:09 smithi096 ceph-mon[124666]: pgmap v15088: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 716 KiB/s rd, 681 KiB/s wr, 13 op/s 2023-05-08T11:34:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28188.212454 secs 2023-05-08T11:34:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28188.767648 secs 2023-05-08T11:34:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28188.767648 secs 2023-05-08T11:34:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28188.767648 secs 2023-05-08T11:34:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28190.056398 secs 2023-05-08T11:34:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:11 smithi186 ceph-mon[126480]: pgmap v15089: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 31 op/s 2023-05-08T11:34:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:11 smithi186 ceph-mon[126480]: osdmap e1020: 12 total, 12 up, 12 in 2023-05-08T11:34:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28190.056398 secs 2023-05-08T11:34:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:11 smithi133 ceph-mon[125939]: pgmap v15089: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 31 op/s 2023-05-08T11:34:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:11 smithi133 ceph-mon[125939]: osdmap e1020: 12 total, 12 up, 12 in 2023-05-08T11:34:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28190.056398 secs 2023-05-08T11:34:12.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:11 smithi096 ceph-mon[124666]: pgmap v15089: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 31 op/s 2023-05-08T11:34:12.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:11 smithi096 ceph-mon[124666]: osdmap e1020: 12 total, 12 up, 12 in 2023-05-08T11:34:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:12 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:34:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:12 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:34:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:12 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:34:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:12 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:34:12.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:12 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:34:12.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:12 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:34:13.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:12 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:34:13.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:12 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:34:13.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:12 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:34:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:13 smithi186 ceph-mon[126480]: pgmap v15091: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 822 KiB/s rd, 863 KiB/s wr, 30 op/s 2023-05-08T11:34:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:13 smithi133 ceph-mon[125939]: pgmap v15091: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 822 KiB/s rd, 863 KiB/s wr, 30 op/s 2023-05-08T11:34:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:13 smithi096 ceph-mon[124666]: pgmap v15091: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 822 KiB/s rd, 863 KiB/s wr, 30 op/s 2023-05-08T11:34:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28193.212569 secs 2023-05-08T11:34:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28193.212569 secs 2023-05-08T11:34:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28193.212569 secs 2023-05-08T11:34:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28193.767777 secs 2023-05-08T11:34:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:15 smithi186 ceph-mon[126480]: pgmap v15092: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 657 KiB/s rd, 680 KiB/s wr, 27 op/s 2023-05-08T11:34:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28193.767777 secs 2023-05-08T11:34:15.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:15 smithi133 ceph-mon[125939]: pgmap v15092: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 657 KiB/s rd, 680 KiB/s wr, 27 op/s 2023-05-08T11:34:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28193.767777 secs 2023-05-08T11:34:16.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:15 smithi096 ceph-mon[124666]: pgmap v15092: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 657 KiB/s rd, 680 KiB/s wr, 27 op/s 2023-05-08T11:34:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28195.056525 secs 2023-05-08T11:34:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28195.056525 secs 2023-05-08T11:34:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28195.056525 secs 2023-05-08T11:34:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:17 smithi186 ceph-mon[126480]: pgmap v15093: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 657 KiB/s rd, 680 KiB/s wr, 27 op/s 2023-05-08T11:34:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:17 smithi133 ceph-mon[125939]: pgmap v15093: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 657 KiB/s rd, 680 KiB/s wr, 27 op/s 2023-05-08T11:34:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:17 smithi096 ceph-mon[124666]: pgmap v15093: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 657 KiB/s rd, 680 KiB/s wr, 27 op/s 2023-05-08T11:34:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:19 smithi186 ceph-mon[126480]: pgmap v15094: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 657 KiB/s rd, 680 KiB/s wr, 27 op/s 2023-05-08T11:34:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28198.212683 secs 2023-05-08T11:34:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:19 smithi133 ceph-mon[125939]: pgmap v15094: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 657 KiB/s rd, 680 KiB/s wr, 27 op/s 2023-05-08T11:34:19.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28198.212683 secs 2023-05-08T11:34:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:19 smithi096 ceph-mon[124666]: pgmap v15094: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 657 KiB/s rd, 680 KiB/s wr, 27 op/s 2023-05-08T11:34:20.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28198.212683 secs 2023-05-08T11:34:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28198.767894 secs 2023-05-08T11:34:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:20 smithi186 ceph-mon[126480]: osdmap e1021: 12 total, 12 up, 12 in 2023-05-08T11:34:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28198.767894 secs 2023-05-08T11:34:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:20 smithi133 ceph-mon[125939]: osdmap e1021: 12 total, 12 up, 12 in 2023-05-08T11:34:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28198.767894 secs 2023-05-08T11:34:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:20 smithi096 ceph-mon[124666]: osdmap e1021: 12 total, 12 up, 12 in 2023-05-08T11:34:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28200.056650 secs 2023-05-08T11:34:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:21 smithi186 ceph-mon[126480]: pgmap v15096: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 380 KiB/s wr, 8 op/s 2023-05-08T11:34:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28200.056650 secs 2023-05-08T11:34:21.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:21 smithi133 ceph-mon[125939]: pgmap v15096: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 380 KiB/s wr, 8 op/s 2023-05-08T11:34:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28200.056650 secs 2023-05-08T11:34:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:21 smithi096 ceph-mon[124666]: pgmap v15096: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 380 KiB/s wr, 8 op/s 2023-05-08T11:34:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:23 smithi133 ceph-mon[125939]: pgmap v15097: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 377 KiB/s wr, 8 op/s 2023-05-08T11:34:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:23 smithi096 ceph-mon[124666]: pgmap v15097: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 377 KiB/s wr, 8 op/s 2023-05-08T11:34:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:23 smithi186 ceph-mon[126480]: pgmap v15097: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 377 KiB/s wr, 8 op/s 2023-05-08T11:34:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28203.212806 secs 2023-05-08T11:34:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28203.212806 secs 2023-05-08T11:34:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28203.212806 secs 2023-05-08T11:34:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28203.768032 secs 2023-05-08T11:34:25.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:25 smithi133 ceph-mon[125939]: pgmap v15098: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 235 KiB/s wr, 6 op/s 2023-05-08T11:34:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28203.768032 secs 2023-05-08T11:34:26.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:25 smithi096 ceph-mon[124666]: pgmap v15098: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 235 KiB/s wr, 6 op/s 2023-05-08T11:34:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28203.768032 secs 2023-05-08T11:34:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:25 smithi186 ceph-mon[126480]: pgmap v15098: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 235 KiB/s wr, 6 op/s 2023-05-08T11:34:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28205.056801 secs 2023-05-08T11:34:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28205.056801 secs 2023-05-08T11:34:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28205.056801 secs 2023-05-08T11:34:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:27 smithi133 ceph-mon[125939]: pgmap v15099: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 235 KiB/s wr, 6 op/s 2023-05-08T11:34:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:27 smithi096 ceph-mon[124666]: pgmap v15099: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 235 KiB/s wr, 6 op/s 2023-05-08T11:34:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:27 smithi186 ceph-mon[126480]: pgmap v15099: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 235 KiB/s wr, 6 op/s 2023-05-08T11:34:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:29 smithi133 ceph-mon[125939]: pgmap v15100: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 235 KiB/s wr, 6 op/s 2023-05-08T11:34:29.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28208.212933 secs 2023-05-08T11:34:30.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:29 smithi096 ceph-mon[124666]: pgmap v15100: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 235 KiB/s wr, 6 op/s 2023-05-08T11:34:30.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28208.212933 secs 2023-05-08T11:34:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:29 smithi186 ceph-mon[126480]: pgmap v15100: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 235 KiB/s wr, 6 op/s 2023-05-08T11:34:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28208.212933 secs 2023-05-08T11:34:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28208.768162 secs 2023-05-08T11:34:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28208.768162 secs 2023-05-08T11:34:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28208.768162 secs 2023-05-08T11:34:31.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28210.056902 secs 2023-05-08T11:34:31.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:31 smithi133 ceph-mon[125939]: pgmap v15101: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T11:34:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28210.056902 secs 2023-05-08T11:34:32.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:31 smithi096 ceph-mon[124666]: pgmap v15101: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T11:34:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28210.056902 secs 2023-05-08T11:34:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:31 smithi186 ceph-mon[126480]: pgmap v15101: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T11:34:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:33 smithi133 ceph-mon[125939]: pgmap v15102: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T11:34:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:33 smithi096 ceph-mon[124666]: pgmap v15102: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T11:34:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:33 smithi186 ceph-mon[126480]: pgmap v15102: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T11:34:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28213.213053 secs 2023-05-08T11:34:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28213.213053 secs 2023-05-08T11:34:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28213.213053 secs 2023-05-08T11:34:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28213.768288 secs 2023-05-08T11:34:35.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:35 smithi133 ceph-mon[125939]: pgmap v15103: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 7 op/s 2023-05-08T11:34:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28213.768288 secs 2023-05-08T11:34:36.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:35 smithi096 ceph-mon[124666]: pgmap v15103: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 7 op/s 2023-05-08T11:34:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28213.768288 secs 2023-05-08T11:34:36.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:35 smithi186 ceph-mon[126480]: pgmap v15103: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 7 op/s 2023-05-08T11:34:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28215.057035 secs 2023-05-08T11:34:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28215.057035 secs 2023-05-08T11:34:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28215.057035 secs 2023-05-08T11:34:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:37 smithi133 ceph-mon[125939]: pgmap v15104: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T11:34:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:37 smithi096 ceph-mon[124666]: pgmap v15104: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T11:34:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:37 smithi186 ceph-mon[126480]: pgmap v15104: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T11:34:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:39 smithi133 ceph-mon[125939]: pgmap v15105: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T11:34:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28218.213165 secs 2023-05-08T11:34:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:39 smithi096 ceph-mon[124666]: pgmap v15105: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T11:34:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28218.213165 secs 2023-05-08T11:34:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:39 smithi186 ceph-mon[126480]: pgmap v15105: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T11:34:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28218.213165 secs 2023-05-08T11:34:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28218.768399 secs 2023-05-08T11:34:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28218.768399 secs 2023-05-08T11:34:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28218.768399 secs 2023-05-08T11:34:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28220.057155 secs 2023-05-08T11:34:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:41 smithi133 ceph-mon[125939]: pgmap v15106: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 108 KiB/s wr, 8 op/s 2023-05-08T11:34:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28220.057155 secs 2023-05-08T11:34:42.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:41 smithi096 ceph-mon[124666]: pgmap v15106: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 108 KiB/s wr, 8 op/s 2023-05-08T11:34:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28220.057155 secs 2023-05-08T11:34:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:41 smithi186 ceph-mon[126480]: pgmap v15106: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 108 KiB/s wr, 8 op/s 2023-05-08T11:34:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:43 smithi133 ceph-mon[125939]: pgmap v15107: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 108 KiB/s wr, 6 op/s 2023-05-08T11:34:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:43 smithi096 ceph-mon[124666]: pgmap v15107: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 108 KiB/s wr, 6 op/s 2023-05-08T11:34:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:43 smithi186 ceph-mon[126480]: pgmap v15107: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 108 KiB/s wr, 6 op/s 2023-05-08T11:34:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28223.213286 secs 2023-05-08T11:34:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28223.213286 secs 2023-05-08T11:34:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28223.213286 secs 2023-05-08T11:34:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28223.768487 secs 2023-05-08T11:34:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:45 smithi133 ceph-mon[125939]: pgmap v15108: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 113 KiB/s wr, 10 op/s 2023-05-08T11:34:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28223.768487 secs 2023-05-08T11:34:46.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:45 smithi096 ceph-mon[124666]: pgmap v15108: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 113 KiB/s wr, 10 op/s 2023-05-08T11:34:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28223.768487 secs 2023-05-08T11:34:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:45 smithi186 ceph-mon[126480]: pgmap v15108: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 113 KiB/s wr, 10 op/s 2023-05-08T11:34:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:47 smithi133 ceph-mon[125939]: pgmap v15109: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 113 KiB/s wr, 7 op/s 2023-05-08T11:34:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:47 smithi096 ceph-mon[124666]: pgmap v15109: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 113 KiB/s wr, 7 op/s 2023-05-08T11:34:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:47 smithi186 ceph-mon[126480]: pgmap v15109: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 113 KiB/s wr, 7 op/s 2023-05-08T11:34:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:34:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:34:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:34:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:49 smithi133 ceph-mon[125939]: pgmap v15110: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 113 KiB/s wr, 7 op/s 2023-05-08T11:34:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28228.213432 secs 2023-05-08T11:34:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:34:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:34:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:34:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:49 smithi096 ceph-mon[124666]: pgmap v15110: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 113 KiB/s wr, 7 op/s 2023-05-08T11:34:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28228.213432 secs 2023-05-08T11:34:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:34:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:34:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:34:50.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:49 smithi186 ceph-mon[126480]: pgmap v15110: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 113 KiB/s wr, 7 op/s 2023-05-08T11:34:50.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28228.213432 secs 2023-05-08T11:34:50.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:34:50.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:34:50.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:34:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28228.768604 secs 2023-05-08T11:34:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28228.768604 secs 2023-05-08T11:34:51.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28228.768604 secs 2023-05-08T11:34:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:51 smithi133 ceph-mon[125939]: pgmap v15111: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 454 KiB/s wr, 10 op/s 2023-05-08T11:34:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:51 smithi096 ceph-mon[124666]: pgmap v15111: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 454 KiB/s wr, 10 op/s 2023-05-08T11:34:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:51 smithi186 ceph-mon[126480]: pgmap v15111: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 454 KiB/s wr, 10 op/s 2023-05-08T11:34:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:53 smithi133 ceph-mon[125939]: pgmap v15112: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 499 KiB/s rd, 347 KiB/s wr, 7 op/s 2023-05-08T11:34:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:53 smithi096 ceph-mon[124666]: pgmap v15112: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 499 KiB/s rd, 347 KiB/s wr, 7 op/s 2023-05-08T11:34:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:53 smithi186 ceph-mon[126480]: pgmap v15112: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 499 KiB/s rd, 347 KiB/s wr, 7 op/s 2023-05-08T11:34:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28233.213547 secs 2023-05-08T11:34:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28233.213547 secs 2023-05-08T11:34:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28233.213547 secs 2023-05-08T11:34:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:55 smithi133 ceph-mon[125939]: pgmap v15113: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 860 KiB/s rd, 664 KiB/s wr, 11 op/s 2023-05-08T11:34:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:55 smithi096 ceph-mon[124666]: pgmap v15113: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 860 KiB/s rd, 664 KiB/s wr, 11 op/s 2023-05-08T11:34:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:55 smithi186 ceph-mon[126480]: pgmap v15113: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 860 KiB/s rd, 664 KiB/s wr, 11 op/s 2023-05-08T11:34:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:34:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:34:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:34:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:57 smithi133 ceph-mon[125939]: pgmap v15114: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 737 KiB/s rd, 659 KiB/s wr, 8 op/s 2023-05-08T11:34:57.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:57 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:34:57.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:34:57.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:34:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:57 smithi096 ceph-mon[124666]: pgmap v15114: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 737 KiB/s rd, 659 KiB/s wr, 8 op/s 2023-05-08T11:34:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:57 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:34:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:34:58.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:34:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:57 smithi186 ceph-mon[126480]: pgmap v15114: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 737 KiB/s rd, 659 KiB/s wr, 8 op/s 2023-05-08T11:34:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:57 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:34:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:34:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:34:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:34:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:34:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:34:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:59 smithi133 ceph-mon[125939]: pgmap v15115: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 737 KiB/s rd, 659 KiB/s wr, 8 op/s 2023-05-08T11:34:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28238.213618 secs 2023-05-08T11:34:59.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:34:59.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:34:59.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:59 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:34:59.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:34:59.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:59 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T11:34:59.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:59 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T11:34:59.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:34:59 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:35:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:59 smithi096 ceph-mon[124666]: pgmap v15115: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 737 KiB/s rd, 659 KiB/s wr, 8 op/s 2023-05-08T11:35:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28238.213618 secs 2023-05-08T11:35:00.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:35:00.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:35:00.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:59 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:35:00.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:35:00.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:59 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T11:35:00.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:59 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T11:35:00.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:34:59 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:35:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:59 smithi186 ceph-mon[126480]: pgmap v15115: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 737 KiB/s rd, 659 KiB/s wr, 8 op/s 2023-05-08T11:35:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28238.213618 secs 2023-05-08T11:35:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:35:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:35:00.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:59 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:35:00.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:35:00.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:59 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T11:35:00.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:59 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T11:35:00.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:34:59 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:35:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28238.768834 secs 2023-05-08T11:35:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28238.768834 secs 2023-05-08T11:35:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28238.768834 secs 2023-05-08T11:35:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28240.057667 secs 2023-05-08T11:35:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:01 smithi133 ceph-mon[125939]: pgmap v15116: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 14 op/s 2023-05-08T11:35:01.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:35:01.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:35:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28240.057667 secs 2023-05-08T11:35:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:01 smithi096 ceph-mon[124666]: pgmap v15116: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 14 op/s 2023-05-08T11:35:02.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:35:02.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:35:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28240.057667 secs 2023-05-08T11:35:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:01 smithi186 ceph-mon[126480]: pgmap v15116: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 14 op/s 2023-05-08T11:35:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:35:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:35:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:03 smithi133 ceph-mon[125939]: pgmap v15117: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 781 KiB/s rd, 725 KiB/s wr, 11 op/s 2023-05-08T11:35:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:03 smithi096 ceph-mon[124666]: pgmap v15117: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 781 KiB/s rd, 725 KiB/s wr, 11 op/s 2023-05-08T11:35:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:03 smithi186 ceph-mon[126480]: pgmap v15117: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 781 KiB/s rd, 725 KiB/s wr, 11 op/s 2023-05-08T11:35:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28243.213734 secs 2023-05-08T11:35:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:04 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:35:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28243.213734 secs 2023-05-08T11:35:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:04 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:35:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28243.213734 secs 2023-05-08T11:35:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:04 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:35:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:05 smithi133 ceph-mon[125939]: pgmap v15118: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 997 KiB/s wr, 17 op/s 2023-05-08T11:35:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:35:05.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:35:05.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:35:05.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:05 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:35:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:05 smithi096 ceph-mon[124666]: pgmap v15118: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 997 KiB/s wr, 17 op/s 2023-05-08T11:35:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:35:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:35:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:35:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:05 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:35:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:05 smithi186 ceph-mon[126480]: pgmap v15118: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 997 KiB/s wr, 17 op/s 2023-05-08T11:35:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:35:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:35:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:35:06.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:05 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:35:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28245.057753 secs 2023-05-08T11:35:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28245.057753 secs 2023-05-08T11:35:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28245.057753 secs 2023-05-08T11:35:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:07 smithi096 ceph-mon[124666]: pgmap v15119: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 677 KiB/s rd, 680 KiB/s wr, 13 op/s 2023-05-08T11:35:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:07 smithi186 ceph-mon[126480]: pgmap v15119: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 677 KiB/s rd, 680 KiB/s wr, 13 op/s 2023-05-08T11:35:08.285 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:07 smithi133 ceph-mon[125939]: pgmap v15119: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 677 KiB/s rd, 680 KiB/s wr, 13 op/s 2023-05-08T11:35:10.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:09 smithi096 ceph-mon[124666]: pgmap v15120: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 677 KiB/s rd, 680 KiB/s wr, 12 op/s 2023-05-08T11:35:10.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28248.213852 secs 2023-05-08T11:35:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:09 smithi186 ceph-mon[126480]: pgmap v15120: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 677 KiB/s rd, 680 KiB/s wr, 12 op/s 2023-05-08T11:35:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28248.213852 secs 2023-05-08T11:35:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:09 smithi133 ceph-mon[125939]: pgmap v15120: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 677 KiB/s rd, 680 KiB/s wr, 12 op/s 2023-05-08T11:35:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28248.213852 secs 2023-05-08T11:35:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28248.769065 secs 2023-05-08T11:35:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28248.769065 secs 2023-05-08T11:35:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28248.769065 secs 2023-05-08T11:35:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28250.057884 secs 2023-05-08T11:35:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:11 smithi186 ceph-mon[126480]: pgmap v15121: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1006 KiB/s rd, 1.0 MiB/s wr, 30 op/s 2023-05-08T11:35:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:11 smithi186 ceph-mon[126480]: osdmap e1022: 12 total, 12 up, 12 in 2023-05-08T11:35:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28250.057884 secs 2023-05-08T11:35:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:11 smithi133 ceph-mon[125939]: pgmap v15121: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1006 KiB/s rd, 1.0 MiB/s wr, 30 op/s 2023-05-08T11:35:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:11 smithi133 ceph-mon[125939]: osdmap e1022: 12 total, 12 up, 12 in 2023-05-08T11:35:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28250.057884 secs 2023-05-08T11:35:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:11 smithi096 ceph-mon[124666]: pgmap v15121: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1006 KiB/s rd, 1.0 MiB/s wr, 30 op/s 2023-05-08T11:35:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:11 smithi096 ceph-mon[124666]: osdmap e1022: 12 total, 12 up, 12 in 2023-05-08T11:35:13.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:12 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:35:13.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:12 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:35:13.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:12 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:35:13.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:12 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:35:13.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:12 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:35:13.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:12 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:35:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:12 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:35:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:12 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:35:13.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:12 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:35:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:13 smithi186 ceph-mon[126480]: pgmap v15123: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 705 KiB/s rd, 746 KiB/s wr, 29 op/s 2023-05-08T11:35:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:13 smithi133 ceph-mon[125939]: pgmap v15123: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 705 KiB/s rd, 746 KiB/s wr, 29 op/s 2023-05-08T11:35:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:13 smithi096 ceph-mon[124666]: pgmap v15123: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 705 KiB/s rd, 746 KiB/s wr, 29 op/s 2023-05-08T11:35:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28253.213973 secs 2023-05-08T11:35:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28253.769191 secs 2023-05-08T11:35:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28253.213973 secs 2023-05-08T11:35:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28253.769191 secs 2023-05-08T11:35:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28253.213973 secs 2023-05-08T11:35:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28253.769191 secs 2023-05-08T11:35:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:15 smithi186 ceph-mon[126480]: pgmap v15124: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 561 KiB/s wr, 26 op/s 2023-05-08T11:35:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:15 smithi133 ceph-mon[125939]: pgmap v15124: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 561 KiB/s wr, 26 op/s 2023-05-08T11:35:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:15 smithi096 ceph-mon[124666]: pgmap v15124: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 561 KiB/s wr, 26 op/s 2023-05-08T11:35:17.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28255.058009 secs 2023-05-08T11:35:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28255.058009 secs 2023-05-08T11:35:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28255.058009 secs 2023-05-08T11:35:18.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:17 smithi186 ceph-mon[126480]: pgmap v15125: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 561 KiB/s wr, 26 op/s 2023-05-08T11:35:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:17 smithi133 ceph-mon[125939]: pgmap v15125: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 561 KiB/s wr, 26 op/s 2023-05-08T11:35:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:17 smithi096 ceph-mon[124666]: pgmap v15125: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 561 KiB/s wr, 26 op/s 2023-05-08T11:35:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:19 smithi186 ceph-mon[126480]: pgmap v15126: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 561 KiB/s wr, 26 op/s 2023-05-08T11:35:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28258.214128 secs 2023-05-08T11:35:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28258.769331 secs 2023-05-08T11:35:20.249 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:19 smithi133 ceph-mon[125939]: pgmap v15126: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 561 KiB/s wr, 26 op/s 2023-05-08T11:35:20.249 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28258.214128 secs 2023-05-08T11:35:20.249 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28258.769331 secs 2023-05-08T11:35:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:19 smithi096 ceph-mon[124666]: pgmap v15126: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 561 KiB/s wr, 26 op/s 2023-05-08T11:35:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28258.214128 secs 2023-05-08T11:35:20.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28258.769331 secs 2023-05-08T11:35:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28260.058158 secs 2023-05-08T11:35:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:21 smithi133 ceph-mon[125939]: osdmap e1023: 12 total, 12 up, 12 in 2023-05-08T11:35:21.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:21 smithi133 ceph-mon[125939]: pgmap v15128: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 249 KiB/s wr, 8 op/s 2023-05-08T11:35:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28260.058158 secs 2023-05-08T11:35:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:21 smithi096 ceph-mon[124666]: osdmap e1023: 12 total, 12 up, 12 in 2023-05-08T11:35:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:21 smithi096 ceph-mon[124666]: pgmap v15128: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 249 KiB/s wr, 8 op/s 2023-05-08T11:35:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28260.058158 secs 2023-05-08T11:35:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:21 smithi186 ceph-mon[126480]: osdmap e1023: 12 total, 12 up, 12 in 2023-05-08T11:35:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:21 smithi186 ceph-mon[126480]: pgmap v15128: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 249 KiB/s wr, 8 op/s 2023-05-08T11:35:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:23 smithi186 ceph-mon[126480]: pgmap v15129: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 242 KiB/s wr, 8 op/s 2023-05-08T11:35:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:23 smithi133 ceph-mon[125939]: pgmap v15129: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 242 KiB/s wr, 8 op/s 2023-05-08T11:35:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:23 smithi096 ceph-mon[124666]: pgmap v15129: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 242 KiB/s wr, 8 op/s 2023-05-08T11:35:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28263.214265 secs 2023-05-08T11:35:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28263.214265 secs 2023-05-08T11:35:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28263.214265 secs 2023-05-08T11:35:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28263.769451 secs 2023-05-08T11:35:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:25 smithi186 ceph-mon[126480]: pgmap v15130: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 100 KiB/s wr, 7 op/s 2023-05-08T11:35:25.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28263.769451 secs 2023-05-08T11:35:25.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:25 smithi133 ceph-mon[125939]: pgmap v15130: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 100 KiB/s wr, 7 op/s 2023-05-08T11:35:26.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28263.769451 secs 2023-05-08T11:35:26.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:25 smithi096 ceph-mon[124666]: pgmap v15130: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 100 KiB/s wr, 7 op/s 2023-05-08T11:35:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28265.058282 secs 2023-05-08T11:35:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28265.058282 secs 2023-05-08T11:35:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28265.058282 secs 2023-05-08T11:35:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:27 smithi186 ceph-mon[126480]: pgmap v15131: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 100 KiB/s wr, 7 op/s 2023-05-08T11:35:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:27 smithi133 ceph-mon[125939]: pgmap v15131: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 100 KiB/s wr, 7 op/s 2023-05-08T11:35:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:27 smithi096 ceph-mon[124666]: pgmap v15131: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 100 KiB/s wr, 7 op/s 2023-05-08T11:35:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:29 smithi186 ceph-mon[126480]: pgmap v15132: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 100 KiB/s wr, 7 op/s 2023-05-08T11:35:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28268.214382 secs 2023-05-08T11:35:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:29 smithi133 ceph-mon[125939]: pgmap v15132: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 100 KiB/s wr, 7 op/s 2023-05-08T11:35:29.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28268.214382 secs 2023-05-08T11:35:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:29 smithi096 ceph-mon[124666]: pgmap v15132: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 100 KiB/s wr, 7 op/s 2023-05-08T11:35:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28268.214382 secs 2023-05-08T11:35:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28268.769550 secs 2023-05-08T11:35:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28268.769550 secs 2023-05-08T11:35:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28268.769550 secs 2023-05-08T11:35:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28270.058411 secs 2023-05-08T11:35:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:31 smithi186 ceph-mon[126480]: pgmap v15133: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2023-05-08T11:35:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28270.058411 secs 2023-05-08T11:35:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:31 smithi133 ceph-mon[125939]: pgmap v15133: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2023-05-08T11:35:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28270.058411 secs 2023-05-08T11:35:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:31 smithi096 ceph-mon[124666]: pgmap v15133: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2023-05-08T11:35:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:33 smithi186 ceph-mon[126480]: pgmap v15134: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T11:35:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:33 smithi133 ceph-mon[125939]: pgmap v15134: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T11:35:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:33 smithi096 ceph-mon[124666]: pgmap v15134: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T11:35:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28273.214517 secs 2023-05-08T11:35:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28273.214517 secs 2023-05-08T11:35:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28273.214517 secs 2023-05-08T11:35:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28273.769665 secs 2023-05-08T11:35:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:35 smithi186 ceph-mon[126480]: pgmap v15135: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T11:35:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28273.769665 secs 2023-05-08T11:35:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:35 smithi133 ceph-mon[125939]: pgmap v15135: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T11:35:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28273.769665 secs 2023-05-08T11:35:36.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:35 smithi096 ceph-mon[124666]: pgmap v15135: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T11:35:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28275.058554 secs 2023-05-08T11:35:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28275.058554 secs 2023-05-08T11:35:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28275.058554 secs 2023-05-08T11:35:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:37 smithi186 ceph-mon[126480]: pgmap v15136: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T11:35:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:37 smithi133 ceph-mon[125939]: pgmap v15136: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T11:35:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:37 smithi096 ceph-mon[124666]: pgmap v15136: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T11:35:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28278.214584 secs 2023-05-08T11:35:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:39 smithi186 ceph-mon[126480]: pgmap v15137: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T11:35:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28278.214584 secs 2023-05-08T11:35:39.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:39 smithi133 ceph-mon[125939]: pgmap v15137: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T11:35:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28278.214584 secs 2023-05-08T11:35:40.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:39 smithi096 ceph-mon[124666]: pgmap v15137: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T11:35:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28278.769789 secs 2023-05-08T11:35:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28278.769789 secs 2023-05-08T11:35:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28278.769789 secs 2023-05-08T11:35:41.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28280.058653 secs 2023-05-08T11:35:41.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:41 smithi186 ceph-mon[126480]: pgmap v15138: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 214 KiB/s wr, 9 op/s 2023-05-08T11:35:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28280.058653 secs 2023-05-08T11:35:41.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:41 smithi133 ceph-mon[125939]: pgmap v15138: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 214 KiB/s wr, 9 op/s 2023-05-08T11:35:42.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28280.058653 secs 2023-05-08T11:35:42.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:41 smithi096 ceph-mon[124666]: pgmap v15138: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 214 KiB/s wr, 9 op/s 2023-05-08T11:35:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:43 smithi186 ceph-mon[126480]: pgmap v15139: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 214 KiB/s wr, 6 op/s 2023-05-08T11:35:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:43 smithi133 ceph-mon[125939]: pgmap v15139: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 214 KiB/s wr, 6 op/s 2023-05-08T11:35:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:43 smithi096 ceph-mon[124666]: pgmap v15139: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 214 KiB/s wr, 6 op/s 2023-05-08T11:35:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28283.214699 secs 2023-05-08T11:35:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28283.214699 secs 2023-05-08T11:35:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28283.214699 secs 2023-05-08T11:35:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28283.769911 secs 2023-05-08T11:35:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:45 smithi186 ceph-mon[126480]: pgmap v15140: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 489 KiB/s rd, 543 KiB/s wr, 10 op/s 2023-05-08T11:35:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28283.769911 secs 2023-05-08T11:35:45.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:45 smithi133 ceph-mon[125939]: pgmap v15140: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 489 KiB/s rd, 543 KiB/s wr, 10 op/s 2023-05-08T11:35:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28283.769911 secs 2023-05-08T11:35:46.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:45 smithi096 ceph-mon[124666]: pgmap v15140: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 489 KiB/s rd, 543 KiB/s wr, 10 op/s 2023-05-08T11:35:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:47 smithi186 ceph-mon[126480]: pgmap v15141: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 488 KiB/s rd, 543 KiB/s wr, 7 op/s 2023-05-08T11:35:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:47 smithi133 ceph-mon[125939]: pgmap v15141: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 488 KiB/s rd, 543 KiB/s wr, 7 op/s 2023-05-08T11:35:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:47 smithi096 ceph-mon[124666]: pgmap v15141: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 488 KiB/s rd, 543 KiB/s wr, 7 op/s 2023-05-08T11:35:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:35:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:35:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:35:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28288.214839 secs 2023-05-08T11:35:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:49 smithi186 ceph-mon[126480]: pgmap v15142: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 488 KiB/s rd, 543 KiB/s wr, 7 op/s 2023-05-08T11:35:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:35:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:35:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:35:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28288.214839 secs 2023-05-08T11:35:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:49 smithi133 ceph-mon[125939]: pgmap v15142: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 488 KiB/s rd, 543 KiB/s wr, 7 op/s 2023-05-08T11:35:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:35:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:35:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:35:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28288.214839 secs 2023-05-08T11:35:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:49 smithi096 ceph-mon[124666]: pgmap v15142: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 488 KiB/s rd, 543 KiB/s wr, 7 op/s 2023-05-08T11:35:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:35:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:35:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:35:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:51 smithi133 ceph-mon[125939]: pgmap v15143: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 998 KiB/s rd, 657 KiB/s wr, 12 op/s 2023-05-08T11:35:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:51 smithi096 ceph-mon[124666]: pgmap v15143: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 998 KiB/s rd, 657 KiB/s wr, 12 op/s 2023-05-08T11:35:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:51 smithi186 ceph-mon[126480]: pgmap v15143: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 998 KiB/s rd, 657 KiB/s wr, 12 op/s 2023-05-08T11:35:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:35:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:35:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:35:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:35:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:35:53.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:53 smithi133 ceph-mon[125939]: pgmap v15144: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 783 KiB/s rd, 442 KiB/s wr, 8 op/s 2023-05-08T11:35:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:35:53.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:35:53.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:53 smithi096 ceph-mon[124666]: pgmap v15144: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 783 KiB/s rd, 442 KiB/s wr, 8 op/s 2023-05-08T11:35:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:35:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:35:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:53 smithi186 ceph-mon[126480]: pgmap v15144: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 783 KiB/s rd, 442 KiB/s wr, 8 op/s 2023-05-08T11:35:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28293.214978 secs 2023-05-08T11:35:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28293.214978 secs 2023-05-08T11:35:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28293.214978 secs 2023-05-08T11:35:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:55 smithi133 ceph-mon[125939]: pgmap v15145: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 964 KiB/s wr, 14 op/s 2023-05-08T11:35:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:55 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:35:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:55 smithi096 ceph-mon[124666]: pgmap v15145: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 964 KiB/s wr, 14 op/s 2023-05-08T11:35:55.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:55 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:35:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:55 smithi186 ceph-mon[126480]: pgmap v15145: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 964 KiB/s wr, 14 op/s 2023-05-08T11:35:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:55 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:35:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:57 smithi186 ceph-mon[126480]: pgmap v15146: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 636 KiB/s wr, 10 op/s 2023-05-08T11:35:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:57 smithi133 ceph-mon[125939]: pgmap v15146: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 636 KiB/s wr, 10 op/s 2023-05-08T11:35:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:57 smithi096 ceph-mon[124666]: pgmap v15146: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 636 KiB/s wr, 10 op/s 2023-05-08T11:35:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28298.215064 secs 2023-05-08T11:35:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:59 smithi186 ceph-mon[126480]: pgmap v15147: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 636 KiB/s wr, 10 op/s 2023-05-08T11:35:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:35:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:35:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:35:59.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:35:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:35:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28298.215064 secs 2023-05-08T11:35:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:59 smithi133 ceph-mon[125939]: pgmap v15147: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 636 KiB/s wr, 10 op/s 2023-05-08T11:35:59.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:35:59.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:35:59.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:35:59.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:35:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:36:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28298.215064 secs 2023-05-08T11:36:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:59 smithi096 ceph-mon[124666]: pgmap v15147: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 636 KiB/s wr, 10 op/s 2023-05-08T11:36:00.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:36:00.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:36:00.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:36:00.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:35:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:36:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:36:00.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:36:00.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:36:00.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:36:00.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:36:00.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:36:00.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:36:00.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:36:00.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:36:00.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:36:00.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:36:00.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:36:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:36:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:36:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:36:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:36:01.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:36:01.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:36:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:01 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:36:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:01 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T11:36:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:01 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T11:36:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:01 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:36:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28300.059164 secs 2023-05-08T11:36:01.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:01 smithi186 ceph-mon[126480]: pgmap v15148: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 792 KiB/s wr, 15 op/s 2023-05-08T11:36:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:01 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:36:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:01 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T11:36:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:01 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T11:36:01.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:01 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:36:01.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28300.059164 secs 2023-05-08T11:36:01.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:01 smithi133 ceph-mon[125939]: pgmap v15148: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 792 KiB/s wr, 15 op/s 2023-05-08T11:36:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:01 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:36:02.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:01 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T11:36:02.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:01 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T11:36:02.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:01 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:36:02.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28300.059164 secs 2023-05-08T11:36:02.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:01 smithi096 ceph-mon[124666]: pgmap v15148: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 792 KiB/s wr, 15 op/s 2023-05-08T11:36:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:03 smithi186 ceph-mon[126480]: pgmap v15149: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 953 KiB/s rd, 678 KiB/s wr, 11 op/s 2023-05-08T11:36:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:03 smithi133 ceph-mon[125939]: pgmap v15149: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 953 KiB/s rd, 678 KiB/s wr, 11 op/s 2023-05-08T11:36:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:03 smithi096 ceph-mon[124666]: pgmap v15149: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 953 KiB/s rd, 678 KiB/s wr, 11 op/s 2023-05-08T11:36:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28303.215217 secs 2023-05-08T11:36:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28303.215217 secs 2023-05-08T11:36:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28303.215217 secs 2023-05-08T11:36:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28303.770330 secs 2023-05-08T11:36:06.257 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:05 smithi186 ceph-mon[126480]: pgmap v15150: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 30 op/s 2023-05-08T11:36:06.257 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:05 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:36:06.257 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:36:06.257 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:36:06.257 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:36:06.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28303.770330 secs 2023-05-08T11:36:06.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:05 smithi096 ceph-mon[124666]: pgmap v15150: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 30 op/s 2023-05-08T11:36:06.259 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:05 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:36:06.259 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:36:06.259 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:36:06.259 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:36:06.259 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28303.770330 secs 2023-05-08T11:36:06.259 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:05 smithi133 ceph-mon[125939]: pgmap v15150: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 30 op/s 2023-05-08T11:36:06.259 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:05 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:36:06.260 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:36:06.260 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:36:06.260 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:36:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28305.059286 secs 2023-05-08T11:36:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:06 smithi186 ceph-mon[126480]: osdmap e1024: 12 total, 12 up, 12 in 2023-05-08T11:36:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28305.059286 secs 2023-05-08T11:36:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:06 smithi133 ceph-mon[125939]: osdmap e1024: 12 total, 12 up, 12 in 2023-05-08T11:36:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28305.059286 secs 2023-05-08T11:36:07.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:06 smithi096 ceph-mon[124666]: osdmap e1024: 12 total, 12 up, 12 in 2023-05-08T11:36:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:07 smithi186 ceph-mon[126480]: pgmap v15152: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 637 KiB/s rd, 707 KiB/s wr, 30 op/s 2023-05-08T11:36:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:07 smithi133 ceph-mon[125939]: pgmap v15152: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 637 KiB/s rd, 707 KiB/s wr, 30 op/s 2023-05-08T11:36:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:07 smithi096 ceph-mon[124666]: pgmap v15152: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 637 KiB/s rd, 707 KiB/s wr, 30 op/s 2023-05-08T11:36:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28308.215331 secs 2023-05-08T11:36:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:09 smithi186 ceph-mon[126480]: pgmap v15153: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 637 KiB/s rd, 708 KiB/s wr, 30 op/s 2023-05-08T11:36:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28308.215331 secs 2023-05-08T11:36:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:09 smithi133 ceph-mon[125939]: pgmap v15153: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 637 KiB/s rd, 708 KiB/s wr, 30 op/s 2023-05-08T11:36:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28308.215331 secs 2023-05-08T11:36:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:09 smithi096 ceph-mon[124666]: pgmap v15153: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 637 KiB/s rd, 708 KiB/s wr, 30 op/s 2023-05-08T11:36:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28308.770444 secs 2023-05-08T11:36:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28308.770444 secs 2023-05-08T11:36:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28308.770444 secs 2023-05-08T11:36:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28310.059415 secs 2023-05-08T11:36:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:11 smithi186 ceph-mon[126480]: pgmap v15154: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 521 KiB/s wr, 27 op/s 2023-05-08T11:36:11.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28310.059415 secs 2023-05-08T11:36:11.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:11 smithi133 ceph-mon[125939]: pgmap v15154: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 521 KiB/s wr, 27 op/s 2023-05-08T11:36:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28310.059415 secs 2023-05-08T11:36:12.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:11 smithi096 ceph-mon[124666]: pgmap v15154: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 521 KiB/s wr, 27 op/s 2023-05-08T11:36:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:13 smithi186 ceph-mon[126480]: pgmap v15155: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 521 KiB/s wr, 27 op/s 2023-05-08T11:36:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:13 smithi133 ceph-mon[125939]: pgmap v15155: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 521 KiB/s wr, 27 op/s 2023-05-08T11:36:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:13 smithi096 ceph-mon[124666]: pgmap v15155: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 521 KiB/s wr, 27 op/s 2023-05-08T11:36:14.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28313.215443 secs 2023-05-08T11:36:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28313.215443 secs 2023-05-08T11:36:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28313.215443 secs 2023-05-08T11:36:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28313.770565 secs 2023-05-08T11:36:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:15 smithi186 ceph-mon[126480]: pgmap v15156: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 143 KiB/s wr, 8 op/s 2023-05-08T11:36:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:15 smithi186 ceph-mon[126480]: osdmap e1025: 12 total, 12 up, 12 in 2023-05-08T11:36:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28313.770565 secs 2023-05-08T11:36:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:15 smithi133 ceph-mon[125939]: pgmap v15156: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 143 KiB/s wr, 8 op/s 2023-05-08T11:36:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:15 smithi133 ceph-mon[125939]: osdmap e1025: 12 total, 12 up, 12 in 2023-05-08T11:36:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28313.770565 secs 2023-05-08T11:36:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:15 smithi096 ceph-mon[124666]: pgmap v15156: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 143 KiB/s wr, 8 op/s 2023-05-08T11:36:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:15 smithi096 ceph-mon[124666]: osdmap e1025: 12 total, 12 up, 12 in 2023-05-08T11:36:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28315.059502 secs 2023-05-08T11:36:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28315.059502 secs 2023-05-08T11:36:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28315.059502 secs 2023-05-08T11:36:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:17 smithi186 ceph-mon[126480]: pgmap v15158: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 143 KiB/s wr, 8 op/s 2023-05-08T11:36:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:17 smithi133 ceph-mon[125939]: pgmap v15158: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 143 KiB/s wr, 8 op/s 2023-05-08T11:36:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:17 smithi096 ceph-mon[124666]: pgmap v15158: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 143 KiB/s wr, 8 op/s 2023-05-08T11:36:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28318.215508 secs 2023-05-08T11:36:19.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:19 smithi186 ceph-mon[126480]: pgmap v15159: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 143 KiB/s wr, 8 op/s 2023-05-08T11:36:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28318.215508 secs 2023-05-08T11:36:19.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:19 smithi133 ceph-mon[125939]: pgmap v15159: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 143 KiB/s wr, 8 op/s 2023-05-08T11:36:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28318.215508 secs 2023-05-08T11:36:20.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:19 smithi096 ceph-mon[124666]: pgmap v15159: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 143 KiB/s wr, 8 op/s 2023-05-08T11:36:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28318.770663 secs 2023-05-08T11:36:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28318.770663 secs 2023-05-08T11:36:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28318.770663 secs 2023-05-08T11:36:21.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28320.059639 secs 2023-05-08T11:36:21.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:21 smithi186 ceph-mon[126480]: pgmap v15160: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 142 KiB/s wr, 7 op/s 2023-05-08T11:36:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28320.059639 secs 2023-05-08T11:36:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:21 smithi133 ceph-mon[125939]: pgmap v15160: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 142 KiB/s wr, 7 op/s 2023-05-08T11:36:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28320.059639 secs 2023-05-08T11:36:22.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:21 smithi096 ceph-mon[124666]: pgmap v15160: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 142 KiB/s wr, 7 op/s 2023-05-08T11:36:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:23 smithi186 ceph-mon[126480]: pgmap v15161: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 142 KiB/s wr, 7 op/s 2023-05-08T11:36:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:23 smithi133 ceph-mon[125939]: pgmap v15161: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 142 KiB/s wr, 7 op/s 2023-05-08T11:36:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:23 smithi096 ceph-mon[124666]: pgmap v15161: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 142 KiB/s wr, 7 op/s 2023-05-08T11:36:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28323.215644 secs 2023-05-08T11:36:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28323.215644 secs 2023-05-08T11:36:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28323.215644 secs 2023-05-08T11:36:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28323.770782 secs 2023-05-08T11:36:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:25 smithi133 ceph-mon[125939]: pgmap v15162: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2023-05-08T11:36:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28323.770782 secs 2023-05-08T11:36:26.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:25 smithi096 ceph-mon[124666]: pgmap v15162: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2023-05-08T11:36:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28323.770782 secs 2023-05-08T11:36:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:25 smithi186 ceph-mon[126480]: pgmap v15162: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2023-05-08T11:36:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28325.059714 secs 2023-05-08T11:36:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28325.059714 secs 2023-05-08T11:36:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28325.059714 secs 2023-05-08T11:36:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:27 smithi133 ceph-mon[125939]: pgmap v15163: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2023-05-08T11:36:28.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:27 smithi096 ceph-mon[124666]: pgmap v15163: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2023-05-08T11:36:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:27 smithi186 ceph-mon[126480]: pgmap v15163: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2023-05-08T11:36:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28328.215757 secs 2023-05-08T11:36:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:29 smithi133 ceph-mon[125939]: pgmap v15164: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T11:36:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28328.215757 secs 2023-05-08T11:36:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:29 smithi096 ceph-mon[124666]: pgmap v15164: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T11:36:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28328.215757 secs 2023-05-08T11:36:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:29 smithi186 ceph-mon[126480]: pgmap v15164: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T11:36:30.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28328.770903 secs 2023-05-08T11:36:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28328.770903 secs 2023-05-08T11:36:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28328.770903 secs 2023-05-08T11:36:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28330.059840 secs 2023-05-08T11:36:31.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:31 smithi133 ceph-mon[125939]: pgmap v15165: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T11:36:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28330.059840 secs 2023-05-08T11:36:32.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:31 smithi096 ceph-mon[124666]: pgmap v15165: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T11:36:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28330.059840 secs 2023-05-08T11:36:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:31 smithi186 ceph-mon[126480]: pgmap v15165: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T11:36:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:33 smithi133 ceph-mon[125939]: pgmap v15166: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T11:36:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:33 smithi096 ceph-mon[124666]: pgmap v15166: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T11:36:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:33 smithi186 ceph-mon[126480]: pgmap v15166: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T11:36:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28333.215870 secs 2023-05-08T11:36:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28333.215870 secs 2023-05-08T11:36:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28333.215870 secs 2023-05-08T11:36:35.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28333.771021 secs 2023-05-08T11:36:35.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:35 smithi133 ceph-mon[125939]: pgmap v15167: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 9 op/s 2023-05-08T11:36:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28333.771021 secs 2023-05-08T11:36:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:35 smithi096 ceph-mon[124666]: pgmap v15167: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 9 op/s 2023-05-08T11:36:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28333.771021 secs 2023-05-08T11:36:36.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:35 smithi186 ceph-mon[126480]: pgmap v15167: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 9 op/s 2023-05-08T11:36:36.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28335.059962 secs 2023-05-08T11:36:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28335.059962 secs 2023-05-08T11:36:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28335.059962 secs 2023-05-08T11:36:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:37 smithi133 ceph-mon[125939]: pgmap v15168: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 6 op/s 2023-05-08T11:36:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:37 smithi096 ceph-mon[124666]: pgmap v15168: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 6 op/s 2023-05-08T11:36:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:37 smithi186 ceph-mon[126480]: pgmap v15168: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 6 op/s 2023-05-08T11:36:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28338.215989 secs 2023-05-08T11:36:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:39 smithi133 ceph-mon[125939]: pgmap v15169: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 6 op/s 2023-05-08T11:36:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28338.215989 secs 2023-05-08T11:36:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:39 smithi096 ceph-mon[124666]: pgmap v15169: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 6 op/s 2023-05-08T11:36:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28338.215989 secs 2023-05-08T11:36:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:39 smithi186 ceph-mon[126480]: pgmap v15169: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 6 op/s 2023-05-08T11:36:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28338.771135 secs 2023-05-08T11:36:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28338.771135 secs 2023-05-08T11:36:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28338.771135 secs 2023-05-08T11:36:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28340.060096 secs 2023-05-08T11:36:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:41 smithi133 ceph-mon[125939]: pgmap v15170: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 938 B/s wr, 10 op/s 2023-05-08T11:36:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28340.060096 secs 2023-05-08T11:36:42.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:41 smithi096 ceph-mon[124666]: pgmap v15170: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 938 B/s wr, 10 op/s 2023-05-08T11:36:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28340.060096 secs 2023-05-08T11:36:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:41 smithi186 ceph-mon[126480]: pgmap v15170: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 938 B/s wr, 10 op/s 2023-05-08T11:36:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:43 smithi133 ceph-mon[125939]: pgmap v15171: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 938 B/s wr, 7 op/s 2023-05-08T11:36:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:43 smithi096 ceph-mon[124666]: pgmap v15171: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 938 B/s wr, 7 op/s 2023-05-08T11:36:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:43 smithi186 ceph-mon[126480]: pgmap v15171: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 938 B/s wr, 7 op/s 2023-05-08T11:36:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28343.216118 secs 2023-05-08T11:36:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28343.216118 secs 2023-05-08T11:36:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28343.216118 secs 2023-05-08T11:36:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28343.771258 secs 2023-05-08T11:36:45.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:45 smithi133 ceph-mon[125939]: pgmap v15172: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 330 KiB/s wr, 11 op/s 2023-05-08T11:36:46.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28343.771258 secs 2023-05-08T11:36:46.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:45 smithi096 ceph-mon[124666]: pgmap v15172: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 330 KiB/s wr, 11 op/s 2023-05-08T11:36:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28343.771258 secs 2023-05-08T11:36:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:45 smithi186 ceph-mon[126480]: pgmap v15172: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 330 KiB/s wr, 11 op/s 2023-05-08T11:36:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:47 smithi133 ceph-mon[125939]: pgmap v15173: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 330 KiB/s wr, 7 op/s 2023-05-08T11:36:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:47 smithi096 ceph-mon[124666]: pgmap v15173: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 330 KiB/s wr, 7 op/s 2023-05-08T11:36:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:47 smithi186 ceph-mon[126480]: pgmap v15173: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 330 KiB/s wr, 7 op/s 2023-05-08T11:36:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:36:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:36:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:36:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28348.216235 secs 2023-05-08T11:36:50.093 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:49 smithi133 ceph-mon[125939]: pgmap v15174: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 330 KiB/s wr, 7 op/s 2023-05-08T11:36:50.093 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:36:50.094 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:36:50.094 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:36:50.095 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28348.216235 secs 2023-05-08T11:36:50.095 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:49 smithi096 ceph-mon[124666]: pgmap v15174: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 330 KiB/s wr, 7 op/s 2023-05-08T11:36:50.095 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:36:50.095 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:36:50.095 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:36:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28348.216235 secs 2023-05-08T11:36:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:49 smithi186 ceph-mon[126480]: pgmap v15174: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 330 KiB/s wr, 7 op/s 2023-05-08T11:36:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:36:50.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:36:50.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:36:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:51 smithi133 ceph-mon[125939]: pgmap v15175: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 470 KiB/s wr, 12 op/s 2023-05-08T11:36:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:51 smithi096 ceph-mon[124666]: pgmap v15175: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 470 KiB/s wr, 12 op/s 2023-05-08T11:36:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:51 smithi186 ceph-mon[126480]: pgmap v15175: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 470 KiB/s wr, 12 op/s 2023-05-08T11:36:52.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:36:52.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:36:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:36:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:36:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:36:53.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:53 smithi133 ceph-mon[125939]: pgmap v15176: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 469 KiB/s wr, 8 op/s 2023-05-08T11:36:53.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:36:53.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:36:53.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:53 smithi096 ceph-mon[124666]: pgmap v15176: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 469 KiB/s wr, 8 op/s 2023-05-08T11:36:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:36:53.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:36:53.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:53 smithi186 ceph-mon[126480]: pgmap v15176: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 469 KiB/s wr, 8 op/s 2023-05-08T11:36:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28353.216360 secs 2023-05-08T11:36:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28353.216360 secs 2023-05-08T11:36:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28353.216360 secs 2023-05-08T11:36:55.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:55 smithi133 ceph-mon[125939]: pgmap v15177: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 846 KiB/s rd, 971 KiB/s wr, 14 op/s 2023-05-08T11:36:55.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:55 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:36:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:55 smithi096 ceph-mon[124666]: pgmap v15177: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 846 KiB/s rd, 971 KiB/s wr, 14 op/s 2023-05-08T11:36:55.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:55 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:36:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:55 smithi186 ceph-mon[126480]: pgmap v15177: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 846 KiB/s rd, 971 KiB/s wr, 14 op/s 2023-05-08T11:36:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:55 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:36:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:57 smithi186 ceph-mon[126480]: pgmap v15178: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 844 KiB/s rd, 642 KiB/s wr, 10 op/s 2023-05-08T11:36:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:57 smithi133 ceph-mon[125939]: pgmap v15178: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 844 KiB/s rd, 642 KiB/s wr, 10 op/s 2023-05-08T11:36:58.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:57 smithi096 ceph-mon[124666]: pgmap v15178: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 844 KiB/s rd, 642 KiB/s wr, 10 op/s 2023-05-08T11:36:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28358.216423 secs 2023-05-08T11:36:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:36:59 smithi186 ceph-mon[126480]: pgmap v15179: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 844 KiB/s rd, 642 KiB/s wr, 10 op/s 2023-05-08T11:36:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28358.216423 secs 2023-05-08T11:36:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:36:59 smithi133 ceph-mon[125939]: pgmap v15179: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 844 KiB/s rd, 642 KiB/s wr, 10 op/s 2023-05-08T11:37:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28358.216423 secs 2023-05-08T11:37:00.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:36:59 smithi096 ceph-mon[124666]: pgmap v15179: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 844 KiB/s rd, 642 KiB/s wr, 10 op/s 2023-05-08T11:37:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:37:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:37:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:37:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28360.060553 secs 2023-05-08T11:37:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:01 smithi186 ceph-mon[126480]: pgmap v15180: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 913 KiB/s wr, 16 op/s 2023-05-08T11:37:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:01 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:37:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:01 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:37:01.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:01 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:37:01.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:01 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:37:01.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:01 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T11:37:01.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:01 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T11:37:01.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:01 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:37:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28360.060553 secs 2023-05-08T11:37:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:01 smithi133 ceph-mon[125939]: pgmap v15180: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 913 KiB/s wr, 16 op/s 2023-05-08T11:37:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:01 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:37:01.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:01 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:37:01.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:01 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:37:01.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:01 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:37:01.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:01 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T11:37:01.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:01 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T11:37:01.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:01 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:37:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28360.060553 secs 2023-05-08T11:37:02.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:01 smithi096 ceph-mon[124666]: pgmap v15180: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 913 KiB/s wr, 16 op/s 2023-05-08T11:37:02.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:01 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:37:02.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:01 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:37:02.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:01 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:37:02.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:01 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:37:02.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:01 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T11:37:02.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:01 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T11:37:02.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:01 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:37:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:03 smithi186 ceph-mon[126480]: pgmap v15181: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 785 KiB/s rd, 773 KiB/s wr, 12 op/s 2023-05-08T11:37:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:03 smithi133 ceph-mon[125939]: pgmap v15181: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 785 KiB/s rd, 773 KiB/s wr, 12 op/s 2023-05-08T11:37:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:03 smithi096 ceph-mon[124666]: pgmap v15181: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 785 KiB/s rd, 773 KiB/s wr, 12 op/s 2023-05-08T11:37:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28363.216532 secs 2023-05-08T11:37:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28363.216532 secs 2023-05-08T11:37:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28363.216532 secs 2023-05-08T11:37:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28363.771692 secs 2023-05-08T11:37:05.908 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:05 smithi186 ceph-mon[126480]: pgmap v15182: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 32 op/s 2023-05-08T11:37:05.908 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:05 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:37:05.908 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:37:05.909 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:37:05.909 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:37:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28363.771692 secs 2023-05-08T11:37:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:05 smithi133 ceph-mon[125939]: pgmap v15182: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 32 op/s 2023-05-08T11:37:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:05 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:37:05.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:37:05.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:37:05.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:37:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28363.771692 secs 2023-05-08T11:37:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:05 smithi096 ceph-mon[124666]: pgmap v15182: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 32 op/s 2023-05-08T11:37:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:05 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:37:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:37:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:37:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:37:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28365.060643 secs 2023-05-08T11:37:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:06 smithi186 ceph-mon[126480]: osdmap e1026: 12 total, 12 up, 12 in 2023-05-08T11:37:06.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28365.060643 secs 2023-05-08T11:37:06.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:06 smithi133 ceph-mon[125939]: osdmap e1026: 12 total, 12 up, 12 in 2023-05-08T11:37:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28365.060643 secs 2023-05-08T11:37:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:06 smithi096 ceph-mon[124666]: osdmap e1026: 12 total, 12 up, 12 in 2023-05-08T11:37:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:07 smithi186 ceph-mon[126480]: pgmap v15184: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 814 KiB/s rd, 846 KiB/s wr, 31 op/s 2023-05-08T11:37:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:07 smithi133 ceph-mon[125939]: pgmap v15184: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 814 KiB/s rd, 846 KiB/s wr, 31 op/s 2023-05-08T11:37:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:07 smithi096 ceph-mon[124666]: pgmap v15184: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 814 KiB/s rd, 846 KiB/s wr, 31 op/s 2023-05-08T11:37:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28368.216647 secs 2023-05-08T11:37:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:09 smithi186 ceph-mon[126480]: pgmap v15185: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 814 KiB/s rd, 846 KiB/s wr, 31 op/s 2023-05-08T11:37:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28368.216647 secs 2023-05-08T11:37:09.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:09 smithi133 ceph-mon[125939]: pgmap v15185: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 814 KiB/s rd, 846 KiB/s wr, 31 op/s 2023-05-08T11:37:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28368.216647 secs 2023-05-08T11:37:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:09 smithi096 ceph-mon[124666]: pgmap v15185: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 814 KiB/s rd, 846 KiB/s wr, 31 op/s 2023-05-08T11:37:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28368.771763 secs 2023-05-08T11:37:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28368.771763 secs 2023-05-08T11:37:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28368.771763 secs 2023-05-08T11:37:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28370.060714 secs 2023-05-08T11:37:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:11 smithi186 ceph-mon[126480]: pgmap v15186: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 481 KiB/s rd, 521 KiB/s wr, 28 op/s 2023-05-08T11:37:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28370.060714 secs 2023-05-08T11:37:11.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:11 smithi133 ceph-mon[125939]: pgmap v15186: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 481 KiB/s rd, 521 KiB/s wr, 28 op/s 2023-05-08T11:37:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28370.060714 secs 2023-05-08T11:37:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:11 smithi096 ceph-mon[124666]: pgmap v15186: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 481 KiB/s rd, 521 KiB/s wr, 28 op/s 2023-05-08T11:37:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:13 smithi186 ceph-mon[126480]: pgmap v15187: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 481 KiB/s rd, 521 KiB/s wr, 27 op/s 2023-05-08T11:37:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:13 smithi133 ceph-mon[125939]: pgmap v15187: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 481 KiB/s rd, 521 KiB/s wr, 27 op/s 2023-05-08T11:37:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:13 smithi096 ceph-mon[124666]: pgmap v15187: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 481 KiB/s rd, 521 KiB/s wr, 27 op/s 2023-05-08T11:37:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28373.216736 secs 2023-05-08T11:37:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28373.216736 secs 2023-05-08T11:37:15.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28373.216736 secs 2023-05-08T11:37:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28373.771883 secs 2023-05-08T11:37:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:15 smithi186 ceph-mon[126480]: pgmap v15188: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 143 KiB/s wr, 8 op/s 2023-05-08T11:37:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:15 smithi186 ceph-mon[126480]: osdmap e1027: 12 total, 12 up, 12 in 2023-05-08T11:37:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28373.771883 secs 2023-05-08T11:37:15.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:15 smithi133 ceph-mon[125939]: pgmap v15188: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 143 KiB/s wr, 8 op/s 2023-05-08T11:37:15.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:15 smithi133 ceph-mon[125939]: osdmap e1027: 12 total, 12 up, 12 in 2023-05-08T11:37:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28373.771883 secs 2023-05-08T11:37:16.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:15 smithi096 ceph-mon[124666]: pgmap v15188: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 143 KiB/s wr, 8 op/s 2023-05-08T11:37:16.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:15 smithi096 ceph-mon[124666]: osdmap e1027: 12 total, 12 up, 12 in 2023-05-08T11:37:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28375.060840 secs 2023-05-08T11:37:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28375.060840 secs 2023-05-08T11:37:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28375.060840 secs 2023-05-08T11:37:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:17 smithi186 ceph-mon[126480]: pgmap v15190: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 143 KiB/s wr, 8 op/s 2023-05-08T11:37:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:17 smithi133 ceph-mon[125939]: pgmap v15190: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 143 KiB/s wr, 8 op/s 2023-05-08T11:37:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:17 smithi096 ceph-mon[124666]: pgmap v15190: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 143 KiB/s wr, 8 op/s 2023-05-08T11:37:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28378.216830 secs 2023-05-08T11:37:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:19 smithi186 ceph-mon[126480]: pgmap v15191: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 143 KiB/s wr, 8 op/s 2023-05-08T11:37:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28378.216830 secs 2023-05-08T11:37:20.086 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:19 smithi133 ceph-mon[125939]: pgmap v15191: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 143 KiB/s wr, 8 op/s 2023-05-08T11:37:20.087 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28378.216830 secs 2023-05-08T11:37:20.088 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:19 smithi096 ceph-mon[124666]: pgmap v15191: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 143 KiB/s wr, 8 op/s 2023-05-08T11:37:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28378.772028 secs 2023-05-08T11:37:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28378.772028 secs 2023-05-08T11:37:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28378.772028 secs 2023-05-08T11:37:21.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28380.060958 secs 2023-05-08T11:37:21.915 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:21 smithi186 ceph-mon[126480]: pgmap v15192: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 142 KiB/s wr, 7 op/s 2023-05-08T11:37:21.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28380.060958 secs 2023-05-08T11:37:21.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:21 smithi133 ceph-mon[125939]: pgmap v15192: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 142 KiB/s wr, 7 op/s 2023-05-08T11:37:22.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28380.060958 secs 2023-05-08T11:37:22.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:21 smithi096 ceph-mon[124666]: pgmap v15192: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 142 KiB/s wr, 7 op/s 2023-05-08T11:37:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:23 smithi133 ceph-mon[125939]: pgmap v15193: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 142 KiB/s wr, 7 op/s 2023-05-08T11:37:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:23 smithi096 ceph-mon[124666]: pgmap v15193: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 142 KiB/s wr, 7 op/s 2023-05-08T11:37:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:23 smithi186 ceph-mon[126480]: pgmap v15193: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 142 KiB/s wr, 7 op/s 2023-05-08T11:37:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28383.216948 secs 2023-05-08T11:37:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28383.216948 secs 2023-05-08T11:37:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28383.216948 secs 2023-05-08T11:37:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28383.772151 secs 2023-05-08T11:37:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:25 smithi133 ceph-mon[125939]: pgmap v15194: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2023-05-08T11:37:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28383.772151 secs 2023-05-08T11:37:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:25 smithi096 ceph-mon[124666]: pgmap v15194: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2023-05-08T11:37:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28383.772151 secs 2023-05-08T11:37:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:25 smithi186 ceph-mon[126480]: pgmap v15194: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2023-05-08T11:37:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28385.061075 secs 2023-05-08T11:37:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28385.061075 secs 2023-05-08T11:37:27.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28385.061075 secs 2023-05-08T11:37:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:27 smithi133 ceph-mon[125939]: pgmap v15195: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2023-05-08T11:37:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:27 smithi096 ceph-mon[124666]: pgmap v15195: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2023-05-08T11:37:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:27 smithi186 ceph-mon[126480]: pgmap v15195: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2023-05-08T11:37:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28388.217067 secs 2023-05-08T11:37:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:29 smithi133 ceph-mon[125939]: pgmap v15196: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T11:37:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28388.217067 secs 2023-05-08T11:37:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:29 smithi096 ceph-mon[124666]: pgmap v15196: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T11:37:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28388.217067 secs 2023-05-08T11:37:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:29 smithi186 ceph-mon[126480]: pgmap v15196: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T11:37:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28388.772300 secs 2023-05-08T11:37:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28388.772300 secs 2023-05-08T11:37:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28388.772300 secs 2023-05-08T11:37:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28390.061193 secs 2023-05-08T11:37:32.137 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:31 smithi133 ceph-mon[125939]: pgmap v15197: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T11:37:32.138 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28390.061193 secs 2023-05-08T11:37:32.138 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:31 smithi186 ceph-mon[126480]: pgmap v15197: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T11:37:32.138 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28390.061193 secs 2023-05-08T11:37:32.138 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:31 smithi096 ceph-mon[124666]: pgmap v15197: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T11:37:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:33 smithi133 ceph-mon[125939]: pgmap v15198: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T11:37:34.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:33 smithi096 ceph-mon[124666]: pgmap v15198: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T11:37:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:33 smithi186 ceph-mon[126480]: pgmap v15198: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T11:37:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28393.217182 secs 2023-05-08T11:37:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28393.217182 secs 2023-05-08T11:37:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28393.217182 secs 2023-05-08T11:37:35.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28393.772439 secs 2023-05-08T11:37:35.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:35 smithi133 ceph-mon[125939]: pgmap v15199: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 9 op/s 2023-05-08T11:37:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28393.772439 secs 2023-05-08T11:37:36.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:35 smithi096 ceph-mon[124666]: pgmap v15199: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 9 op/s 2023-05-08T11:37:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28393.772439 secs 2023-05-08T11:37:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:35 smithi186 ceph-mon[126480]: pgmap v15199: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 9 op/s 2023-05-08T11:37:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28395.061317 secs 2023-05-08T11:37:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28395.061317 secs 2023-05-08T11:37:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28395.061317 secs 2023-05-08T11:37:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:37 smithi133 ceph-mon[125939]: pgmap v15200: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 6 op/s 2023-05-08T11:37:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:37 smithi096 ceph-mon[124666]: pgmap v15200: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 6 op/s 2023-05-08T11:37:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:37 smithi186 ceph-mon[126480]: pgmap v15200: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 6 op/s 2023-05-08T11:37:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28398.217244 secs 2023-05-08T11:37:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:39 smithi133 ceph-mon[125939]: pgmap v15201: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 6 op/s 2023-05-08T11:37:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28398.217244 secs 2023-05-08T11:37:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:39 smithi096 ceph-mon[124666]: pgmap v15201: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 6 op/s 2023-05-08T11:37:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28398.217244 secs 2023-05-08T11:37:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:39 smithi186 ceph-mon[126480]: pgmap v15201: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 6 op/s 2023-05-08T11:37:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28398.772559 secs 2023-05-08T11:37:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28398.772559 secs 2023-05-08T11:37:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28398.772559 secs 2023-05-08T11:37:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28400.061435 secs 2023-05-08T11:37:41.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:41 smithi133 ceph-mon[125939]: pgmap v15202: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 938 B/s wr, 10 op/s 2023-05-08T11:37:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28400.061435 secs 2023-05-08T11:37:42.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:41 smithi096 ceph-mon[124666]: pgmap v15202: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 938 B/s wr, 10 op/s 2023-05-08T11:37:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28400.061435 secs 2023-05-08T11:37:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:41 smithi186 ceph-mon[126480]: pgmap v15202: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 938 B/s wr, 10 op/s 2023-05-08T11:37:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:43 smithi133 ceph-mon[125939]: pgmap v15203: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 938 B/s wr, 7 op/s 2023-05-08T11:37:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:43 smithi096 ceph-mon[124666]: pgmap v15203: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 938 B/s wr, 7 op/s 2023-05-08T11:37:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:43 smithi186 ceph-mon[126480]: pgmap v15203: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 938 B/s wr, 7 op/s 2023-05-08T11:37:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28403.217362 secs 2023-05-08T11:37:45.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28403.217362 secs 2023-05-08T11:37:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28403.217362 secs 2023-05-08T11:37:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28403.772680 secs 2023-05-08T11:37:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:45 smithi133 ceph-mon[125939]: pgmap v15204: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 331 KiB/s wr, 11 op/s 2023-05-08T11:37:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28403.772680 secs 2023-05-08T11:37:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:45 smithi096 ceph-mon[124666]: pgmap v15204: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 331 KiB/s wr, 11 op/s 2023-05-08T11:37:46.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28403.772680 secs 2023-05-08T11:37:46.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:45 smithi186 ceph-mon[126480]: pgmap v15204: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 331 KiB/s wr, 11 op/s 2023-05-08T11:37:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:47 smithi133 ceph-mon[125939]: pgmap v15205: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 331 KiB/s wr, 7 op/s 2023-05-08T11:37:48.009 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:47 smithi096 ceph-mon[124666]: pgmap v15205: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 331 KiB/s wr, 7 op/s 2023-05-08T11:37:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:47 smithi186 ceph-mon[126480]: pgmap v15205: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 331 KiB/s wr, 7 op/s 2023-05-08T11:37:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:37:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:37:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:37:49.994 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28408.217479 secs 2023-05-08T11:37:49.994 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:49 smithi133 ceph-mon[125939]: pgmap v15206: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 331 KiB/s wr, 7 op/s 2023-05-08T11:37:49.995 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:37:49.995 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:37:49.995 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:37:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28408.217479 secs 2023-05-08T11:37:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:49 smithi096 ceph-mon[124666]: pgmap v15206: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 331 KiB/s wr, 7 op/s 2023-05-08T11:37:50.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:37:50.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:37:50.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:37:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28408.217479 secs 2023-05-08T11:37:50.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:49 smithi186 ceph-mon[126480]: pgmap v15206: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 331 KiB/s wr, 7 op/s 2023-05-08T11:37:50.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:37:50.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:37:50.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:37:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:51 smithi133 ceph-mon[125939]: pgmap v15207: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 472 KiB/s wr, 12 op/s 2023-05-08T11:37:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:51 smithi096 ceph-mon[124666]: pgmap v15207: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 472 KiB/s wr, 12 op/s 2023-05-08T11:37:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:51 smithi186 ceph-mon[126480]: pgmap v15207: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 472 KiB/s wr, 12 op/s 2023-05-08T11:37:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:37:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:37:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:37:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:37:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:37:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:53 smithi133 ceph-mon[125939]: pgmap v15208: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 598 KiB/s rd, 596 KiB/s wr, 9 op/s 2023-05-08T11:37:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:37:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:37:53.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:53 smithi096 ceph-mon[124666]: pgmap v15208: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 598 KiB/s rd, 596 KiB/s wr, 9 op/s 2023-05-08T11:37:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:37:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:37:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:53 smithi186 ceph-mon[126480]: pgmap v15208: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 598 KiB/s rd, 596 KiB/s wr, 9 op/s 2023-05-08T11:37:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28413.217594 secs 2023-05-08T11:37:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28413.217594 secs 2023-05-08T11:37:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28413.217594 secs 2023-05-08T11:37:55.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:55 smithi133 ceph-mon[125939]: pgmap v15209: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 827 KiB/s rd, 813 KiB/s wr, 13 op/s 2023-05-08T11:37:55.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:55 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:37:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:55 smithi096 ceph-mon[124666]: pgmap v15209: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 827 KiB/s rd, 813 KiB/s wr, 13 op/s 2023-05-08T11:37:55.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:55 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:37:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:55 smithi186 ceph-mon[126480]: pgmap v15209: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 827 KiB/s rd, 813 KiB/s wr, 13 op/s 2023-05-08T11:37:55.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:55 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:37:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:57 smithi186 ceph-mon[126480]: pgmap v15210: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 699 KiB/s wr, 10 op/s 2023-05-08T11:37:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:57 smithi133 ceph-mon[125939]: pgmap v15210: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 699 KiB/s wr, 10 op/s 2023-05-08T11:37:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:57 smithi096 ceph-mon[124666]: pgmap v15210: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 699 KiB/s wr, 10 op/s 2023-05-08T11:37:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28418.217699 secs 2023-05-08T11:37:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:37:59 smithi186 ceph-mon[126480]: pgmap v15211: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 699 KiB/s wr, 10 op/s 2023-05-08T11:37:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28418.217699 secs 2023-05-08T11:37:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:37:59 smithi133 ceph-mon[125939]: pgmap v15211: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 699 KiB/s wr, 10 op/s 2023-05-08T11:38:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28418.217699 secs 2023-05-08T11:38:00.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:37:59 smithi096 ceph-mon[124666]: pgmap v15211: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 699 KiB/s wr, 10 op/s 2023-05-08T11:38:01.746 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28420.061933 secs 2023-05-08T11:38:01.747 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:01 smithi133 ceph-mon[125939]: pgmap v15212: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 910 KiB/s wr, 15 op/s 2023-05-08T11:38:01.747 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:01 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:38:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28420.061933 secs 2023-05-08T11:38:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:01 smithi096 ceph-mon[124666]: pgmap v15212: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 910 KiB/s wr, 15 op/s 2023-05-08T11:38:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:01 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:38:01.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28420.061933 secs 2023-05-08T11:38:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:01 smithi186 ceph-mon[126480]: pgmap v15212: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 910 KiB/s wr, 15 op/s 2023-05-08T11:38:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:01 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:38:02.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:02 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:38:02.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:02 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:38:02.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:02 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:38:02.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:02 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:38:02.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:02 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T11:38:02.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:02 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T11:38:02.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:02 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:38:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:02 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:38:02.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:02 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:38:02.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:02 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:38:02.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:02 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:38:02.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:02 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T11:38:02.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:02 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T11:38:02.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:02 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:38:02.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:02 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:38:02.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:02 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:38:02.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:02 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:38:02.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:02 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:38:02.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:02 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T11:38:02.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:02 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T11:38:02.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:02 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:38:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:03 smithi133 ceph-mon[125939]: pgmap v15213: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 782 KiB/s rd, 770 KiB/s wr, 11 op/s 2023-05-08T11:38:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:03 smithi096 ceph-mon[124666]: pgmap v15213: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 782 KiB/s rd, 770 KiB/s wr, 11 op/s 2023-05-08T11:38:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:03 smithi186 ceph-mon[126480]: pgmap v15213: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 782 KiB/s rd, 770 KiB/s wr, 11 op/s 2023-05-08T11:38:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28423.217819 secs 2023-05-08T11:38:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28423.217819 secs 2023-05-08T11:38:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28423.217819 secs 2023-05-08T11:38:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28423.773177 secs 2023-05-08T11:38:05.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:05 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:38:05.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:38:05.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:38:05.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:38:05.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:05 smithi133 ceph-mon[125939]: pgmap v15214: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 811 KiB/s rd, 1.1 MiB/s wr, 30 op/s 2023-05-08T11:38:05.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28423.773177 secs 2023-05-08T11:38:05.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:05 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:38:05.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:38:05.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:38:05.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:38:05.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:05 smithi096 ceph-mon[124666]: pgmap v15214: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 811 KiB/s rd, 1.1 MiB/s wr, 30 op/s 2023-05-08T11:38:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28423.773177 secs 2023-05-08T11:38:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:05 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:38:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:38:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:38:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:38:05.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:05 smithi186 ceph-mon[126480]: pgmap v15214: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 811 KiB/s rd, 1.1 MiB/s wr, 30 op/s 2023-05-08T11:38:06.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28425.062079 secs 2023-05-08T11:38:06.744 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:06 smithi133 ceph-mon[125939]: osdmap e1028: 12 total, 12 up, 12 in 2023-05-08T11:38:06.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28425.062079 secs 2023-05-08T11:38:06.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:06 smithi096 ceph-mon[124666]: osdmap e1028: 12 total, 12 up, 12 in 2023-05-08T11:38:06.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28425.062079 secs 2023-05-08T11:38:06.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:06 smithi186 ceph-mon[126480]: osdmap e1028: 12 total, 12 up, 12 in 2023-05-08T11:38:07.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:07 smithi133 ceph-mon[125939]: pgmap v15216: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 776 KiB/s wr, 29 op/s 2023-05-08T11:38:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:07 smithi096 ceph-mon[124666]: pgmap v15216: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 776 KiB/s wr, 29 op/s 2023-05-08T11:38:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:07 smithi186 ceph-mon[126480]: pgmap v15216: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 776 KiB/s wr, 29 op/s 2023-05-08T11:38:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28428.217931 secs 2023-05-08T11:38:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:09 smithi186 ceph-mon[126480]: pgmap v15217: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 776 KiB/s wr, 29 op/s 2023-05-08T11:38:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28428.217931 secs 2023-05-08T11:38:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:09 smithi133 ceph-mon[125939]: pgmap v15217: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 776 KiB/s wr, 29 op/s 2023-05-08T11:38:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28428.217931 secs 2023-05-08T11:38:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:09 smithi096 ceph-mon[124666]: pgmap v15217: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 776 KiB/s wr, 29 op/s 2023-05-08T11:38:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28428.773294 secs 2023-05-08T11:38:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28428.773294 secs 2023-05-08T11:38:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28428.773294 secs 2023-05-08T11:38:11.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28430.062218 secs 2023-05-08T11:38:11.917 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:11 smithi186 ceph-mon[126480]: pgmap v15218: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 483 KiB/s rd, 523 KiB/s wr, 28 op/s 2023-05-08T11:38:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28430.062218 secs 2023-05-08T11:38:11.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:11 smithi133 ceph-mon[125939]: pgmap v15218: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 483 KiB/s rd, 523 KiB/s wr, 28 op/s 2023-05-08T11:38:12.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28430.062218 secs 2023-05-08T11:38:12.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:11 smithi096 ceph-mon[124666]: pgmap v15218: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 483 KiB/s rd, 523 KiB/s wr, 28 op/s 2023-05-08T11:38:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:13 smithi186 ceph-mon[126480]: pgmap v15219: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 483 KiB/s rd, 523 KiB/s wr, 27 op/s 2023-05-08T11:38:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:13 smithi133 ceph-mon[125939]: pgmap v15219: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 483 KiB/s rd, 523 KiB/s wr, 27 op/s 2023-05-08T11:38:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:13 smithi096 ceph-mon[124666]: pgmap v15219: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 483 KiB/s rd, 523 KiB/s wr, 27 op/s 2023-05-08T11:38:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28433.218049 secs 2023-05-08T11:38:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28433.218049 secs 2023-05-08T11:38:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28433.218049 secs 2023-05-08T11:38:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28433.773416 secs 2023-05-08T11:38:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:15 smithi186 ceph-mon[126480]: pgmap v15220: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 143 KiB/s wr, 8 op/s 2023-05-08T11:38:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:15 smithi186 ceph-mon[126480]: osdmap e1029: 12 total, 12 up, 12 in 2023-05-08T11:38:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28433.773416 secs 2023-05-08T11:38:15.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:15 smithi133 ceph-mon[125939]: pgmap v15220: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 143 KiB/s wr, 8 op/s 2023-05-08T11:38:15.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:15 smithi133 ceph-mon[125939]: osdmap e1029: 12 total, 12 up, 12 in 2023-05-08T11:38:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28433.773416 secs 2023-05-08T11:38:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:15 smithi096 ceph-mon[124666]: pgmap v15220: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 143 KiB/s wr, 8 op/s 2023-05-08T11:38:16.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:15 smithi096 ceph-mon[124666]: osdmap e1029: 12 total, 12 up, 12 in 2023-05-08T11:38:16.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28435.062338 secs 2023-05-08T11:38:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28435.062338 secs 2023-05-08T11:38:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28435.062338 secs 2023-05-08T11:38:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:17 smithi186 ceph-mon[126480]: pgmap v15222: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 143 KiB/s wr, 7 op/s 2023-05-08T11:38:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:17 smithi133 ceph-mon[125939]: pgmap v15222: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 143 KiB/s wr, 7 op/s 2023-05-08T11:38:18.010 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:17 smithi096 ceph-mon[124666]: pgmap v15222: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 143 KiB/s wr, 7 op/s 2023-05-08T11:38:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28438.218112 secs 2023-05-08T11:38:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:19 smithi186 ceph-mon[126480]: pgmap v15223: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 143 KiB/s wr, 7 op/s 2023-05-08T11:38:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28438.218112 secs 2023-05-08T11:38:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:19 smithi133 ceph-mon[125939]: pgmap v15223: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 143 KiB/s wr, 7 op/s 2023-05-08T11:38:20.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28438.218112 secs 2023-05-08T11:38:20.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:19 smithi096 ceph-mon[124666]: pgmap v15223: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 143 KiB/s wr, 7 op/s 2023-05-08T11:38:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28438.773505 secs 2023-05-08T11:38:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28438.773505 secs 2023-05-08T11:38:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28438.773505 secs 2023-05-08T11:38:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28440.062458 secs 2023-05-08T11:38:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:21 smithi186 ceph-mon[126480]: pgmap v15224: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 143 KiB/s wr, 6 op/s 2023-05-08T11:38:21.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28440.062458 secs 2023-05-08T11:38:21.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:21 smithi133 ceph-mon[125939]: pgmap v15224: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 143 KiB/s wr, 6 op/s 2023-05-08T11:38:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28440.062458 secs 2023-05-08T11:38:22.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:21 smithi096 ceph-mon[124666]: pgmap v15224: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 143 KiB/s wr, 6 op/s 2023-05-08T11:38:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:23 smithi186 ceph-mon[126480]: pgmap v15225: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 143 KiB/s wr, 6 op/s 2023-05-08T11:38:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:23 smithi133 ceph-mon[125939]: pgmap v15225: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 143 KiB/s wr, 6 op/s 2023-05-08T11:38:24.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:23 smithi096 ceph-mon[124666]: pgmap v15225: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 143 KiB/s wr, 6 op/s 2023-05-08T11:38:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28443.218252 secs 2023-05-08T11:38:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28443.218252 secs 2023-05-08T11:38:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28443.218252 secs 2023-05-08T11:38:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28443.773629 secs 2023-05-08T11:38:25.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:25 smithi186 ceph-mon[126480]: pgmap v15226: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T11:38:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28443.773629 secs 2023-05-08T11:38:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:25 smithi133 ceph-mon[125939]: pgmap v15226: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T11:38:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28443.773629 secs 2023-05-08T11:38:26.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:25 smithi096 ceph-mon[124666]: pgmap v15226: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T11:38:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28445.062580 secs 2023-05-08T11:38:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28445.062580 secs 2023-05-08T11:38:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28445.062580 secs 2023-05-08T11:38:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:27 smithi133 ceph-mon[125939]: pgmap v15227: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-05-08T11:38:28.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:27 smithi096 ceph-mon[124666]: pgmap v15227: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-05-08T11:38:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:27 smithi186 ceph-mon[126480]: pgmap v15227: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-05-08T11:38:29.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28448.218359 secs 2023-05-08T11:38:29.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:29 smithi133 ceph-mon[125939]: pgmap v15228: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T11:38:30.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28448.218359 secs 2023-05-08T11:38:30.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:29 smithi096 ceph-mon[124666]: pgmap v15228: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T11:38:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28448.218359 secs 2023-05-08T11:38:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:29 smithi186 ceph-mon[126480]: pgmap v15228: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T11:38:30.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28448.773768 secs 2023-05-08T11:38:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28448.773768 secs 2023-05-08T11:38:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28448.773768 secs 2023-05-08T11:38:31.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28450.062683 secs 2023-05-08T11:38:31.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:31 smithi133 ceph-mon[125939]: pgmap v15229: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T11:38:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28450.062683 secs 2023-05-08T11:38:32.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:31 smithi096 ceph-mon[124666]: pgmap v15229: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T11:38:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28450.062683 secs 2023-05-08T11:38:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:31 smithi186 ceph-mon[126480]: pgmap v15229: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T11:38:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:33 smithi133 ceph-mon[125939]: pgmap v15230: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T11:38:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:33 smithi096 ceph-mon[124666]: pgmap v15230: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T11:38:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:33 smithi186 ceph-mon[126480]: pgmap v15230: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T11:38:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28453.218473 secs 2023-05-08T11:38:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28453.218473 secs 2023-05-08T11:38:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28453.218473 secs 2023-05-08T11:38:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28453.773919 secs 2023-05-08T11:38:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:35 smithi133 ceph-mon[125939]: pgmap v15231: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 8 op/s 2023-05-08T11:38:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28453.773919 secs 2023-05-08T11:38:36.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:35 smithi096 ceph-mon[124666]: pgmap v15231: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 8 op/s 2023-05-08T11:38:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28453.773919 secs 2023-05-08T11:38:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:35 smithi186 ceph-mon[126480]: pgmap v15231: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 8 op/s 2023-05-08T11:38:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28455.062803 secs 2023-05-08T11:38:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28455.062803 secs 2023-05-08T11:38:37.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28455.062803 secs 2023-05-08T11:38:37.995 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:37 smithi133 ceph-mon[125939]: pgmap v15232: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T11:38:38.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:37 smithi096 ceph-mon[124666]: pgmap v15232: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T11:38:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:37 smithi186 ceph-mon[126480]: pgmap v15232: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T11:38:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28458.218595 secs 2023-05-08T11:38:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:39 smithi133 ceph-mon[125939]: pgmap v15233: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T11:38:40.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28458.218595 secs 2023-05-08T11:38:40.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:39 smithi096 ceph-mon[124666]: pgmap v15233: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T11:38:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28458.218595 secs 2023-05-08T11:38:40.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:39 smithi186 ceph-mon[126480]: pgmap v15233: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T11:38:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28458.774063 secs 2023-05-08T11:38:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28458.774063 secs 2023-05-08T11:38:41.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28458.774063 secs 2023-05-08T11:38:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28460.062907 secs 2023-05-08T11:38:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:41 smithi133 ceph-mon[125939]: pgmap v15234: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 938 B/s wr, 8 op/s 2023-05-08T11:38:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28460.062907 secs 2023-05-08T11:38:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:41 smithi096 ceph-mon[124666]: pgmap v15234: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 938 B/s wr, 8 op/s 2023-05-08T11:38:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28460.062907 secs 2023-05-08T11:38:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:41 smithi186 ceph-mon[126480]: pgmap v15234: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 938 B/s wr, 8 op/s 2023-05-08T11:38:43.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:43 smithi133 ceph-mon[125939]: pgmap v15235: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T11:38:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:43 smithi096 ceph-mon[124666]: pgmap v15235: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T11:38:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:43 smithi186 ceph-mon[126480]: pgmap v15235: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T11:38:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28463.218708 secs 2023-05-08T11:38:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28463.218708 secs 2023-05-08T11:38:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28463.218708 secs 2023-05-08T11:38:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28463.774208 secs 2023-05-08T11:38:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:45 smithi133 ceph-mon[125939]: pgmap v15236: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 352 KiB/s rd, 332 KiB/s wr, 10 op/s 2023-05-08T11:38:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28463.774208 secs 2023-05-08T11:38:46.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:45 smithi096 ceph-mon[124666]: pgmap v15236: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 352 KiB/s rd, 332 KiB/s wr, 10 op/s 2023-05-08T11:38:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28463.774208 secs 2023-05-08T11:38:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:45 smithi186 ceph-mon[126480]: pgmap v15236: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 352 KiB/s rd, 332 KiB/s wr, 10 op/s 2023-05-08T11:38:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:47 smithi133 ceph-mon[125939]: pgmap v15237: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 332 KiB/s wr, 7 op/s 2023-05-08T11:38:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:47 smithi096 ceph-mon[124666]: pgmap v15237: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 332 KiB/s wr, 7 op/s 2023-05-08T11:38:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:47 smithi186 ceph-mon[126480]: pgmap v15237: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 332 KiB/s wr, 7 op/s 2023-05-08T11:38:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:38:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:38:49.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:38:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28468.218782 secs 2023-05-08T11:38:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:49 smithi133 ceph-mon[125939]: pgmap v15238: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 332 KiB/s wr, 7 op/s 2023-05-08T11:38:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:38:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:38:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:38:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28468.218782 secs 2023-05-08T11:38:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:49 smithi096 ceph-mon[124666]: pgmap v15238: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 332 KiB/s wr, 7 op/s 2023-05-08T11:38:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:38:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:38:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:38:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28468.218782 secs 2023-05-08T11:38:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:49 smithi186 ceph-mon[126480]: pgmap v15238: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 332 KiB/s wr, 7 op/s 2023-05-08T11:38:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:38:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:38:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:38:51.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:51 smithi133 ceph-mon[125939]: pgmap v15239: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 455 KiB/s rd, 378 KiB/s wr, 11 op/s 2023-05-08T11:38:51.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:51 smithi096 ceph-mon[124666]: pgmap v15239: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 455 KiB/s rd, 378 KiB/s wr, 11 op/s 2023-05-08T11:38:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:51 smithi186 ceph-mon[126480]: pgmap v15239: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 455 KiB/s rd, 378 KiB/s wr, 11 op/s 2023-05-08T11:38:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:38:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:38:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:38:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:38:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:38:53.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:53 smithi133 ceph-mon[125939]: pgmap v15240: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 377 KiB/s wr, 8 op/s 2023-05-08T11:38:53.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:38:53.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:38:53.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:53 smithi096 ceph-mon[124666]: pgmap v15240: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 377 KiB/s wr, 8 op/s 2023-05-08T11:38:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:38:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:38:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:53 smithi186 ceph-mon[126480]: pgmap v15240: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 377 KiB/s wr, 8 op/s 2023-05-08T11:38:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28473.218878 secs 2023-05-08T11:38:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28473.218878 secs 2023-05-08T11:38:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28473.218878 secs 2023-05-08T11:38:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:55 smithi096 ceph-mon[124666]: pgmap v15241: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 972 KiB/s wr, 13 op/s 2023-05-08T11:38:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:55 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:38:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:55 smithi186 ceph-mon[126480]: pgmap v15241: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 972 KiB/s wr, 13 op/s 2023-05-08T11:38:55.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:55 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:38:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:55 smithi133 ceph-mon[125939]: pgmap v15241: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 972 KiB/s wr, 13 op/s 2023-05-08T11:38:55.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:55 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:38:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:57 smithi186 ceph-mon[126480]: pgmap v15242: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 750 KiB/s rd, 641 KiB/s wr, 10 op/s 2023-05-08T11:38:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:57 smithi133 ceph-mon[125939]: pgmap v15242: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 750 KiB/s rd, 641 KiB/s wr, 10 op/s 2023-05-08T11:38:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:57 smithi096 ceph-mon[124666]: pgmap v15242: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 750 KiB/s rd, 641 KiB/s wr, 10 op/s 2023-05-08T11:38:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28478.218942 secs 2023-05-08T11:38:59.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:38:59 smithi186 ceph-mon[126480]: pgmap v15243: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 750 KiB/s rd, 641 KiB/s wr, 10 op/s 2023-05-08T11:38:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28478.218942 secs 2023-05-08T11:38:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:38:59 smithi133 ceph-mon[125939]: pgmap v15243: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 750 KiB/s rd, 641 KiB/s wr, 10 op/s 2023-05-08T11:39:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28478.218942 secs 2023-05-08T11:39:00.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:38:59 smithi096 ceph-mon[124666]: pgmap v15243: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 750 KiB/s rd, 641 KiB/s wr, 10 op/s 2023-05-08T11:39:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28480.063343 secs 2023-05-08T11:39:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:01 smithi133 ceph-mon[125939]: pgmap v15244: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 912 KiB/s wr, 16 op/s 2023-05-08T11:39:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28480.063343 secs 2023-05-08T11:39:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:01 smithi096 ceph-mon[124666]: pgmap v15244: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 912 KiB/s wr, 16 op/s 2023-05-08T11:39:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28480.063343 secs 2023-05-08T11:39:01.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:01 smithi186 ceph-mon[126480]: pgmap v15244: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 912 KiB/s wr, 16 op/s 2023-05-08T11:39:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:02 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:39:02.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:02 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:39:02.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:02 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:39:03.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:39:03.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:39:03.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:03 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:39:03.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:39:03.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:03 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T11:39:03.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:03 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T11:39:03.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:03 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:39:03.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:03 smithi133 ceph-mon[125939]: pgmap v15245: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1016 KiB/s rd, 867 KiB/s wr, 11 op/s 2023-05-08T11:39:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:39:03.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:39:03.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:03 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:39:03.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:39:03.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:03 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T11:39:03.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:03 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T11:39:03.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:03 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:39:03.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:03 smithi096 ceph-mon[124666]: pgmap v15245: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1016 KiB/s rd, 867 KiB/s wr, 11 op/s 2023-05-08T11:39:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:39:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:39:03.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:03 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:39:03.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:39:03.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:03 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T11:39:03.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:03 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T11:39:03.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:03 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:39:03.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:03 smithi186 ceph-mon[126480]: pgmap v15245: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1016 KiB/s rd, 867 KiB/s wr, 11 op/s 2023-05-08T11:39:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28483.219012 secs 2023-05-08T11:39:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28483.219012 secs 2023-05-08T11:39:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28483.219012 secs 2023-05-08T11:39:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28483.774661 secs 2023-05-08T11:39:05.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:05 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:39:05.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:39:05.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:39:05.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:39:05.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:05 smithi096 ceph-mon[124666]: pgmap v15246: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 31 op/s 2023-05-08T11:39:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28483.774661 secs 2023-05-08T11:39:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:05 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:39:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:39:05.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:39:05.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:39:05.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:05 smithi186 ceph-mon[126480]: pgmap v15246: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 31 op/s 2023-05-08T11:39:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28483.774661 secs 2023-05-08T11:39:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:05 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:39:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:39:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:39:05.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:39:05.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:05 smithi133 ceph-mon[125939]: pgmap v15246: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 31 op/s 2023-05-08T11:39:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28485.063453 secs 2023-05-08T11:39:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:06 smithi186 ceph-mon[126480]: osdmap e1030: 12 total, 12 up, 12 in 2023-05-08T11:39:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28485.063453 secs 2023-05-08T11:39:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:06 smithi133 ceph-mon[125939]: osdmap e1030: 12 total, 12 up, 12 in 2023-05-08T11:39:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28485.063453 secs 2023-05-08T11:39:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:06 smithi096 ceph-mon[124666]: osdmap e1030: 12 total, 12 up, 12 in 2023-05-08T11:39:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:07 smithi186 ceph-mon[126480]: pgmap v15248: 97 pgs: 1 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 90 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 927 KiB/s rd, 850 KiB/s wr, 30 op/s 2023-05-08T11:39:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:07 smithi133 ceph-mon[125939]: pgmap v15248: 97 pgs: 1 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 90 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 927 KiB/s rd, 850 KiB/s wr, 30 op/s 2023-05-08T11:39:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:07 smithi096 ceph-mon[124666]: pgmap v15248: 97 pgs: 1 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 90 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 927 KiB/s rd, 850 KiB/s wr, 30 op/s 2023-05-08T11:39:09.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28488.219073 secs 2023-05-08T11:39:09.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:09 smithi186 ceph-mon[126480]: pgmap v15249: 97 pgs: 1 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 90 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 927 KiB/s rd, 850 KiB/s wr, 30 op/s 2023-05-08T11:39:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28488.219073 secs 2023-05-08T11:39:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:09 smithi133 ceph-mon[125939]: pgmap v15249: 97 pgs: 1 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 90 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 927 KiB/s rd, 850 KiB/s wr, 30 op/s 2023-05-08T11:39:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28488.219073 secs 2023-05-08T11:39:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:09 smithi096 ceph-mon[124666]: pgmap v15249: 97 pgs: 1 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 90 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 927 KiB/s rd, 850 KiB/s wr, 30 op/s 2023-05-08T11:39:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28488.774743 secs 2023-05-08T11:39:10.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28488.774743 secs 2023-05-08T11:39:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28488.774743 secs 2023-05-08T11:39:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28490.063602 secs 2023-05-08T11:39:11.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:11 smithi186 ceph-mon[126480]: pgmap v15250: 97 pgs: 1 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 90 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 525 KiB/s wr, 27 op/s 2023-05-08T11:39:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28490.063602 secs 2023-05-08T11:39:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:11 smithi133 ceph-mon[125939]: pgmap v15250: 97 pgs: 1 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 90 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 525 KiB/s wr, 27 op/s 2023-05-08T11:39:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28490.063602 secs 2023-05-08T11:39:12.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:11 smithi096 ceph-mon[124666]: pgmap v15250: 97 pgs: 1 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 90 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 525 KiB/s wr, 27 op/s 2023-05-08T11:39:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:13 smithi186 ceph-mon[126480]: pgmap v15251: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 525 KiB/s wr, 27 op/s 2023-05-08T11:39:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:13 smithi133 ceph-mon[125939]: pgmap v15251: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 525 KiB/s wr, 27 op/s 2023-05-08T11:39:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:13 smithi096 ceph-mon[124666]: pgmap v15251: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 525 KiB/s wr, 27 op/s 2023-05-08T11:39:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28493.219213 secs 2023-05-08T11:39:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28493.219213 secs 2023-05-08T11:39:15.012 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28493.219213 secs 2023-05-08T11:39:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28493.774870 secs 2023-05-08T11:39:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:15 smithi186 ceph-mon[126480]: pgmap v15252: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 144 KiB/s wr, 8 op/s 2023-05-08T11:39:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:15 smithi186 ceph-mon[126480]: osdmap e1031: 12 total, 12 up, 12 in 2023-05-08T11:39:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28493.774870 secs 2023-05-08T11:39:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:15 smithi133 ceph-mon[125939]: pgmap v15252: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 144 KiB/s wr, 8 op/s 2023-05-08T11:39:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:15 smithi133 ceph-mon[125939]: osdmap e1031: 12 total, 12 up, 12 in 2023-05-08T11:39:16.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28493.774870 secs 2023-05-08T11:39:16.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:15 smithi096 ceph-mon[124666]: pgmap v15252: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 144 KiB/s wr, 8 op/s 2023-05-08T11:39:16.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:15 smithi096 ceph-mon[124666]: osdmap e1031: 12 total, 12 up, 12 in 2023-05-08T11:39:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28495.063721 secs 2023-05-08T11:39:16.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28495.063721 secs 2023-05-08T11:39:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28495.063721 secs 2023-05-08T11:39:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:17 smithi186 ceph-mon[126480]: pgmap v15254: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 144 KiB/s wr, 8 op/s 2023-05-08T11:39:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:17 smithi133 ceph-mon[125939]: pgmap v15254: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 144 KiB/s wr, 8 op/s 2023-05-08T11:39:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:17 smithi096 ceph-mon[124666]: pgmap v15254: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 144 KiB/s wr, 8 op/s 2023-05-08T11:39:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28498.219324 secs 2023-05-08T11:39:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:19 smithi133 ceph-mon[125939]: pgmap v15255: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 144 KiB/s wr, 8 op/s 2023-05-08T11:39:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28498.219324 secs 2023-05-08T11:39:20.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:19 smithi096 ceph-mon[124666]: pgmap v15255: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 144 KiB/s wr, 8 op/s 2023-05-08T11:39:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28498.219324 secs 2023-05-08T11:39:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:19 smithi186 ceph-mon[126480]: pgmap v15255: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 144 KiB/s wr, 8 op/s 2023-05-08T11:39:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28498.775006 secs 2023-05-08T11:39:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28498.775006 secs 2023-05-08T11:39:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28498.775006 secs 2023-05-08T11:39:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28500.063841 secs 2023-05-08T11:39:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:21 smithi133 ceph-mon[125939]: pgmap v15256: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 143 KiB/s wr, 6 op/s 2023-05-08T11:39:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28500.063841 secs 2023-05-08T11:39:22.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:21 smithi096 ceph-mon[124666]: pgmap v15256: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 143 KiB/s wr, 6 op/s 2023-05-08T11:39:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28500.063841 secs 2023-05-08T11:39:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:21 smithi186 ceph-mon[126480]: pgmap v15256: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 143 KiB/s wr, 6 op/s 2023-05-08T11:39:23.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:23 smithi133 ceph-mon[125939]: pgmap v15257: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 143 KiB/s wr, 6 op/s 2023-05-08T11:39:24.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:23 smithi096 ceph-mon[124666]: pgmap v15257: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 143 KiB/s wr, 6 op/s 2023-05-08T11:39:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:23 smithi186 ceph-mon[126480]: pgmap v15257: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 143 KiB/s wr, 6 op/s 2023-05-08T11:39:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28503.219441 secs 2023-05-08T11:39:25.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28503.219441 secs 2023-05-08T11:39:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28503.219441 secs 2023-05-08T11:39:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28503.775105 secs 2023-05-08T11:39:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:25 smithi133 ceph-mon[125939]: pgmap v15258: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T11:39:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28503.775105 secs 2023-05-08T11:39:26.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:25 smithi096 ceph-mon[124666]: pgmap v15258: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T11:39:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28503.775105 secs 2023-05-08T11:39:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:25 smithi186 ceph-mon[126480]: pgmap v15258: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T11:39:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28505.063964 secs 2023-05-08T11:39:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28505.063964 secs 2023-05-08T11:39:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28505.063964 secs 2023-05-08T11:39:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:27 smithi133 ceph-mon[125939]: pgmap v15259: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-05-08T11:39:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:27 smithi096 ceph-mon[124666]: pgmap v15259: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-05-08T11:39:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:27 smithi186 ceph-mon[126480]: pgmap v15259: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-05-08T11:39:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28508.219544 secs 2023-05-08T11:39:29.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:29 smithi133 ceph-mon[125939]: pgmap v15260: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T11:39:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28508.219544 secs 2023-05-08T11:39:30.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:29 smithi096 ceph-mon[124666]: pgmap v15260: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T11:39:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28508.219544 secs 2023-05-08T11:39:30.130 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:29 smithi186 ceph-mon[126480]: pgmap v15260: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T11:39:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28508.775230 secs 2023-05-08T11:39:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28508.775230 secs 2023-05-08T11:39:31.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28508.775230 secs 2023-05-08T11:39:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28510.064084 secs 2023-05-08T11:39:31.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:31 smithi133 ceph-mon[125939]: pgmap v15261: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T11:39:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28510.064084 secs 2023-05-08T11:39:32.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:31 smithi096 ceph-mon[124666]: pgmap v15261: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T11:39:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28510.064084 secs 2023-05-08T11:39:32.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:31 smithi186 ceph-mon[126480]: pgmap v15261: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T11:39:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:33 smithi133 ceph-mon[125939]: pgmap v15262: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T11:39:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:33 smithi096 ceph-mon[124666]: pgmap v15262: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T11:39:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:33 smithi186 ceph-mon[126480]: pgmap v15262: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T11:39:34.994 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28513.219664 secs 2023-05-08T11:39:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28513.219664 secs 2023-05-08T11:39:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28513.219664 secs 2023-05-08T11:39:35.996 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28513.775378 secs 2023-05-08T11:39:35.997 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:35 smithi133 ceph-mon[125939]: pgmap v15263: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T11:39:36.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28513.775378 secs 2023-05-08T11:39:36.009 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:35 smithi096 ceph-mon[124666]: pgmap v15263: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T11:39:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28513.775378 secs 2023-05-08T11:39:36.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:35 smithi186 ceph-mon[126480]: pgmap v15263: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T11:39:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28515.064199 secs 2023-05-08T11:39:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28515.064199 secs 2023-05-08T11:39:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28515.064199 secs 2023-05-08T11:39:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:37 smithi133 ceph-mon[125939]: pgmap v15264: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T11:39:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:37 smithi096 ceph-mon[124666]: pgmap v15264: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T11:39:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:37 smithi186 ceph-mon[126480]: pgmap v15264: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T11:39:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28518.219782 secs 2023-05-08T11:39:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:39 smithi133 ceph-mon[125939]: pgmap v15265: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T11:39:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28518.219782 secs 2023-05-08T11:39:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:39 smithi096 ceph-mon[124666]: pgmap v15265: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T11:39:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28518.219782 secs 2023-05-08T11:39:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:39 smithi186 ceph-mon[126480]: pgmap v15265: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T11:39:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28518.775504 secs 2023-05-08T11:39:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28518.775504 secs 2023-05-08T11:39:41.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28518.775504 secs 2023-05-08T11:39:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28520.064339 secs 2023-05-08T11:39:41.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:41 smithi133 ceph-mon[125939]: pgmap v15266: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 109 KiB/s wr, 9 op/s 2023-05-08T11:39:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28520.064339 secs 2023-05-08T11:39:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:41 smithi096 ceph-mon[124666]: pgmap v15266: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 109 KiB/s wr, 9 op/s 2023-05-08T11:39:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28520.064339 secs 2023-05-08T11:39:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:41 smithi186 ceph-mon[126480]: pgmap v15266: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 109 KiB/s wr, 9 op/s 2023-05-08T11:39:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:43 smithi133 ceph-mon[125939]: pgmap v15267: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 109 KiB/s wr, 6 op/s 2023-05-08T11:39:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:43 smithi096 ceph-mon[124666]: pgmap v15267: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 109 KiB/s wr, 6 op/s 2023-05-08T11:39:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:43 smithi186 ceph-mon[126480]: pgmap v15267: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 109 KiB/s wr, 6 op/s 2023-05-08T11:39:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28523.775602 secs 2023-05-08T11:39:45.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:45 smithi133 ceph-mon[125939]: pgmap v15268: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 110 KiB/s wr, 10 op/s 2023-05-08T11:39:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28523.775602 secs 2023-05-08T11:39:46.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:45 smithi096 ceph-mon[124666]: pgmap v15268: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 110 KiB/s wr, 10 op/s 2023-05-08T11:39:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28523.775602 secs 2023-05-08T11:39:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:45 smithi186 ceph-mon[126480]: pgmap v15268: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 110 KiB/s wr, 10 op/s 2023-05-08T11:39:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:47 smithi133 ceph-mon[125939]: pgmap v15269: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 109 KiB/s wr, 7 op/s 2023-05-08T11:39:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:39:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:47 smithi096 ceph-mon[124666]: pgmap v15269: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 109 KiB/s wr, 7 op/s 2023-05-08T11:39:48.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:39:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:47 smithi186 ceph-mon[126480]: pgmap v15269: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 109 KiB/s wr, 7 op/s 2023-05-08T11:39:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:39:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:48 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:39:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T11:39:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:39:48.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:39:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:48 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:39:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T11:39:49.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:39:49.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:39:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:48 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:39:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T11:39:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:39:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:39:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:49 smithi133 ceph-mon[125939]: pgmap v15270: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 109 KiB/s wr, 7 op/s 2023-05-08T11:39:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:39:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:39:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:49 smithi096 ceph-mon[124666]: pgmap v15270: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 109 KiB/s wr, 7 op/s 2023-05-08T11:39:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:39:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:39:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:49 smithi186 ceph-mon[126480]: pgmap v15270: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 109 KiB/s wr, 7 op/s 2023-05-08T11:39:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:39:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:39:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28528.775699 secs 2023-05-08T11:39:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28528.775699 secs 2023-05-08T11:39:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28528.775699 secs 2023-05-08T11:39:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:51 smithi133 ceph-mon[125939]: pgmap v15271: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 403 KiB/s wr, 10 op/s 2023-05-08T11:39:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:51 smithi096 ceph-mon[124666]: pgmap v15271: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 403 KiB/s wr, 10 op/s 2023-05-08T11:39:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:51 smithi186 ceph-mon[126480]: pgmap v15271: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 403 KiB/s wr, 10 op/s 2023-05-08T11:39:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:53 smithi133 ceph-mon[125939]: pgmap v15272: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 636 KiB/s wr, 7 op/s 2023-05-08T11:39:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:53 smithi096 ceph-mon[124666]: pgmap v15272: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 636 KiB/s wr, 7 op/s 2023-05-08T11:39:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:53 smithi186 ceph-mon[126480]: pgmap v15272: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 636 KiB/s wr, 7 op/s 2023-05-08T11:39:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28533.220110 secs 2023-05-08T11:39:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28533.220110 secs 2023-05-08T11:39:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28533.220110 secs 2023-05-08T11:39:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:55 smithi133 ceph-mon[125939]: pgmap v15273: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 801 KiB/s rd, 789 KiB/s wr, 12 op/s 2023-05-08T11:39:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:55 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:39:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:55 smithi096 ceph-mon[124666]: pgmap v15273: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 801 KiB/s rd, 789 KiB/s wr, 12 op/s 2023-05-08T11:39:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:55 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:39:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:55 smithi186 ceph-mon[126480]: pgmap v15273: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 801 KiB/s rd, 789 KiB/s wr, 12 op/s 2023-05-08T11:39:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:55 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:39:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T11:39:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:39:56.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:39:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T11:39:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:39:57.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:39:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T11:39:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:39:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:39:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:57 smithi133 ceph-mon[125939]: pgmap v15274: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 789 KiB/s wr, 9 op/s 2023-05-08T11:39:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:39:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:39:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:57 smithi096 ceph-mon[124666]: pgmap v15274: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 789 KiB/s wr, 9 op/s 2023-05-08T11:39:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:39:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:39:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:57 smithi186 ceph-mon[126480]: pgmap v15274: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 789 KiB/s wr, 9 op/s 2023-05-08T11:39:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:39:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:39:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28538.220246 secs 2023-05-08T11:39:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:39:59 smithi133 ceph-mon[125939]: pgmap v15275: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 789 KiB/s wr, 9 op/s 2023-05-08T11:40:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28538.220246 secs 2023-05-08T11:40:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:39:59 smithi096 ceph-mon[124666]: pgmap v15275: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 789 KiB/s wr, 9 op/s 2023-05-08T11:40:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28538.220246 secs 2023-05-08T11:40:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:39:59 smithi186 ceph-mon[126480]: pgmap v15275: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 789 KiB/s wr, 9 op/s 2023-05-08T11:40:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:00 smithi133 ceph-mon[125939]: overall HEALTH_WARN 1 MDSs report slow requests 2023-05-08T11:40:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:00 smithi096 ceph-mon[124666]: overall HEALTH_WARN 1 MDSs report slow requests 2023-05-08T11:40:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:00 smithi186 ceph-mon[126480]: overall HEALTH_WARN 1 MDSs report slow requests 2023-05-08T11:40:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:01 smithi133 ceph-mon[125939]: pgmap v15276: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 15 op/s 2023-05-08T11:40:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:01 smithi096 ceph-mon[124666]: pgmap v15276: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 15 op/s 2023-05-08T11:40:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:01 smithi186 ceph-mon[126480]: pgmap v15276: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 15 op/s 2023-05-08T11:40:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:02 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:40:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:02 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:40:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:02 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:40:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:03 smithi133 ceph-mon[125939]: pgmap v15277: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T11:40:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:40:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:40:03.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:40:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:03 smithi096 ceph-mon[124666]: pgmap v15277: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T11:40:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:40:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:40:04.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:40:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:03 smithi186 ceph-mon[126480]: pgmap v15277: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T11:40:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:40:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:40:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:40:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:04 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:40:05.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:04 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T11:40:05.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:04 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T11:40:05.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:04 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:40:05.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28543.220328 secs 2023-05-08T11:40:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:04 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:40:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:04 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T11:40:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:04 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T11:40:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:04 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:40:05.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28543.220328 secs 2023-05-08T11:40:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:04 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:40:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:04 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T11:40:05.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:04 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T11:40:05.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:04 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:40:05.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28543.220328 secs 2023-05-08T11:40:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28543.776007 secs 2023-05-08T11:40:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:05 smithi096 ceph-mon[124666]: pgmap v15278: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.1 MiB/s wr, 31 op/s 2023-05-08T11:40:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:05 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:40:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:40:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:40:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28543.776007 secs 2023-05-08T11:40:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:05 smithi186 ceph-mon[126480]: pgmap v15278: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.1 MiB/s wr, 31 op/s 2023-05-08T11:40:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:05 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:40:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:40:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:40:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28543.776007 secs 2023-05-08T11:40:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:05 smithi133 ceph-mon[125939]: pgmap v15278: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.1 MiB/s wr, 31 op/s 2023-05-08T11:40:06.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:05 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:40:06.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:40:06.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:40:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:07 smithi096 ceph-mon[124666]: pgmap v15279: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 950 KiB/s wr, 26 op/s 2023-05-08T11:40:08.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:07 smithi186 ceph-mon[126480]: pgmap v15279: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 950 KiB/s wr, 26 op/s 2023-05-08T11:40:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:07 smithi133 ceph-mon[125939]: pgmap v15279: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 950 KiB/s wr, 26 op/s 2023-05-08T11:40:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28548.220462 secs 2023-05-08T11:40:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:09 smithi096 ceph-mon[124666]: pgmap v15280: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 927 KiB/s rd, 950 KiB/s wr, 25 op/s 2023-05-08T11:40:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28548.220462 secs 2023-05-08T11:40:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:09 smithi186 ceph-mon[126480]: pgmap v15280: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 927 KiB/s rd, 950 KiB/s wr, 25 op/s 2023-05-08T11:40:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28548.220462 secs 2023-05-08T11:40:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:09 smithi133 ceph-mon[125939]: pgmap v15280: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 927 KiB/s rd, 950 KiB/s wr, 25 op/s 2023-05-08T11:40:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:11 smithi096 ceph-mon[124666]: pgmap v15281: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 30 op/s 2023-05-08T11:40:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:11 smithi096 ceph-mon[124666]: osdmap e1032: 12 total, 12 up, 12 in 2023-05-08T11:40:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:11 smithi186 ceph-mon[126480]: pgmap v15281: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 30 op/s 2023-05-08T11:40:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:11 smithi186 ceph-mon[126480]: osdmap e1032: 12 total, 12 up, 12 in 2023-05-08T11:40:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:11 smithi133 ceph-mon[125939]: pgmap v15281: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 30 op/s 2023-05-08T11:40:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:11 smithi133 ceph-mon[125939]: osdmap e1032: 12 total, 12 up, 12 in 2023-05-08T11:40:13.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:12 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:40:13.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:12 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:40:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:12 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:40:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:13 smithi186 ceph-mon[126480]: pgmap v15283: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 712 KiB/s rd, 698 KiB/s wr, 29 op/s 2023-05-08T11:40:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:13 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:40:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:40:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:13 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:40:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:13 smithi133 ceph-mon[125939]: pgmap v15283: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 712 KiB/s rd, 698 KiB/s wr, 29 op/s 2023-05-08T11:40:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:13 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:40:14.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:40:14.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:13 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:40:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:13 smithi096 ceph-mon[124666]: pgmap v15283: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 712 KiB/s rd, 698 KiB/s wr, 29 op/s 2023-05-08T11:40:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:13 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:40:14.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:40:14.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:13 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:40:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28553.220574 secs 2023-05-08T11:40:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28553.220574 secs 2023-05-08T11:40:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28553.220574 secs 2023-05-08T11:40:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:15 smithi186 ceph-mon[126480]: pgmap v15284: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 762 KiB/s rd, 705 KiB/s wr, 11 op/s 2023-05-08T11:40:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:15 smithi133 ceph-mon[125939]: pgmap v15284: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 762 KiB/s rd, 705 KiB/s wr, 11 op/s 2023-05-08T11:40:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:15 smithi096 ceph-mon[124666]: pgmap v15284: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 762 KiB/s rd, 705 KiB/s wr, 11 op/s 2023-05-08T11:40:18.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:17 smithi186 ceph-mon[126480]: pgmap v15285: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 762 KiB/s rd, 705 KiB/s wr, 11 op/s 2023-05-08T11:40:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:17 smithi133 ceph-mon[125939]: pgmap v15285: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 762 KiB/s rd, 705 KiB/s wr, 11 op/s 2023-05-08T11:40:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:17 smithi096 ceph-mon[124666]: pgmap v15285: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 762 KiB/s rd, 705 KiB/s wr, 11 op/s 2023-05-08T11:40:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28558.220641 secs 2023-05-08T11:40:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:19 smithi186 ceph-mon[126480]: pgmap v15286: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 762 KiB/s rd, 705 KiB/s wr, 11 op/s 2023-05-08T11:40:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28558.220641 secs 2023-05-08T11:40:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:19 smithi133 ceph-mon[125939]: pgmap v15286: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 762 KiB/s rd, 705 KiB/s wr, 11 op/s 2023-05-08T11:40:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28558.220641 secs 2023-05-08T11:40:20.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:19 smithi096 ceph-mon[124666]: pgmap v15286: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 762 KiB/s rd, 705 KiB/s wr, 11 op/s 2023-05-08T11:40:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:21 smithi096 ceph-mon[124666]: osdmap e1033: 12 total, 12 up, 12 in 2023-05-08T11:40:21.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:21 smithi096 ceph-mon[124666]: pgmap v15288: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 418 KiB/s rd, 413 KiB/s wr, 9 op/s 2023-05-08T11:40:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:21 smithi186 ceph-mon[126480]: osdmap e1033: 12 total, 12 up, 12 in 2023-05-08T11:40:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:21 smithi186 ceph-mon[126480]: pgmap v15288: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 418 KiB/s rd, 413 KiB/s wr, 9 op/s 2023-05-08T11:40:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:21 smithi133 ceph-mon[125939]: osdmap e1033: 12 total, 12 up, 12 in 2023-05-08T11:40:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:21 smithi133 ceph-mon[125939]: pgmap v15288: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 418 KiB/s rd, 413 KiB/s wr, 9 op/s 2023-05-08T11:40:23.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:23 smithi186 ceph-mon[126480]: pgmap v15289: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 410 KiB/s rd, 406 KiB/s wr, 9 op/s 2023-05-08T11:40:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:23 smithi133 ceph-mon[125939]: pgmap v15289: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 410 KiB/s rd, 406 KiB/s wr, 9 op/s 2023-05-08T11:40:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:23 smithi096 ceph-mon[124666]: pgmap v15289: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 410 KiB/s rd, 406 KiB/s wr, 9 op/s 2023-05-08T11:40:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28563.220780 secs 2023-05-08T11:40:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28563.220780 secs 2023-05-08T11:40:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28563.220780 secs 2023-05-08T11:40:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:25 smithi133 ceph-mon[125939]: pgmap v15290: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 570 KiB/s wr, 8 op/s 2023-05-08T11:40:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:25 smithi096 ceph-mon[124666]: pgmap v15290: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 570 KiB/s wr, 8 op/s 2023-05-08T11:40:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:25 smithi186 ceph-mon[126480]: pgmap v15290: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 570 KiB/s wr, 8 op/s 2023-05-08T11:40:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28565.065345 secs 2023-05-08T11:40:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28565.065345 secs 2023-05-08T11:40:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28565.065345 secs 2023-05-08T11:40:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:27 smithi133 ceph-mon[125939]: pgmap v15291: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 570 KiB/s wr, 8 op/s 2023-05-08T11:40:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:27 smithi096 ceph-mon[124666]: pgmap v15291: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 570 KiB/s wr, 8 op/s 2023-05-08T11:40:28.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:27 smithi186 ceph-mon[126480]: pgmap v15291: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 570 KiB/s wr, 8 op/s 2023-05-08T11:40:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:28 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:40:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:28 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:40:28.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:28 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:40:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:28 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:40:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:28 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:40:29.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:28 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:40:29.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:28 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:40:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:28 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:40:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:28 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:40:29.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28568.220894 secs 2023-05-08T11:40:29.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:29 smithi133 ceph-mon[125939]: pgmap v15292: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 570 KiB/s wr, 8 op/s 2023-05-08T11:40:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28568.220894 secs 2023-05-08T11:40:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:29 smithi096 ceph-mon[124666]: pgmap v15292: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 570 KiB/s wr, 8 op/s 2023-05-08T11:40:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28568.220894 secs 2023-05-08T11:40:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:29 smithi186 ceph-mon[126480]: pgmap v15292: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 570 KiB/s wr, 8 op/s 2023-05-08T11:40:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28568.776606 secs 2023-05-08T11:40:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28568.776606 secs 2023-05-08T11:40:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28568.776606 secs 2023-05-08T11:40:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28570.065496 secs 2023-05-08T11:40:31.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:31 smithi133 ceph-mon[125939]: pgmap v15293: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 445 KiB/s wr, 9 op/s 2023-05-08T11:40:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28570.065496 secs 2023-05-08T11:40:32.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:31 smithi096 ceph-mon[124666]: pgmap v15293: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 445 KiB/s wr, 9 op/s 2023-05-08T11:40:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28570.065496 secs 2023-05-08T11:40:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:31 smithi186 ceph-mon[126480]: pgmap v15293: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 445 KiB/s wr, 9 op/s 2023-05-08T11:40:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:33 smithi133 ceph-mon[125939]: pgmap v15294: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 374 KiB/s wr, 7 op/s 2023-05-08T11:40:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:33 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:40:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:33 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:40:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:33 smithi096 ceph-mon[124666]: pgmap v15294: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 374 KiB/s wr, 7 op/s 2023-05-08T11:40:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:33 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:40:34.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:33 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:40:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:33 smithi186 ceph-mon[126480]: pgmap v15294: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 374 KiB/s wr, 7 op/s 2023-05-08T11:40:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:33 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:40:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:33 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:40:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28573.221000 secs 2023-05-08T11:40:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28573.221000 secs 2023-05-08T11:40:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28573.221000 secs 2023-05-08T11:40:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28573.776701 secs 2023-05-08T11:40:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:35 smithi133 ceph-mon[125939]: pgmap v15295: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 478 KiB/s wr, 11 op/s 2023-05-08T11:40:35.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:35 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:40:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28573.776701 secs 2023-05-08T11:40:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:35 smithi096 ceph-mon[124666]: pgmap v15295: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 478 KiB/s wr, 11 op/s 2023-05-08T11:40:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:35 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:40:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28573.776701 secs 2023-05-08T11:40:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:35 smithi186 ceph-mon[126480]: pgmap v15295: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 478 KiB/s wr, 11 op/s 2023-05-08T11:40:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:35 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:40:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28575.065642 secs 2023-05-08T11:40:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28575.065642 secs 2023-05-08T11:40:37.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28575.065642 secs 2023-05-08T11:40:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:37 smithi133 ceph-mon[125939]: pgmap v15296: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 105 KiB/s wr, 7 op/s 2023-05-08T11:40:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:37 smithi096 ceph-mon[124666]: pgmap v15296: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 105 KiB/s wr, 7 op/s 2023-05-08T11:40:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:37 smithi186 ceph-mon[126480]: pgmap v15296: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 105 KiB/s wr, 7 op/s 2023-05-08T11:40:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28578.221098 secs 2023-05-08T11:40:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:39 smithi133 ceph-mon[125939]: pgmap v15297: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 105 KiB/s wr, 7 op/s 2023-05-08T11:40:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28578.221098 secs 2023-05-08T11:40:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:39 smithi096 ceph-mon[124666]: pgmap v15297: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 105 KiB/s wr, 7 op/s 2023-05-08T11:40:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28578.221098 secs 2023-05-08T11:40:40.148 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:39 smithi186 ceph-mon[126480]: pgmap v15297: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 105 KiB/s wr, 7 op/s 2023-05-08T11:40:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28578.776807 secs 2023-05-08T11:40:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28578.776807 secs 2023-05-08T11:40:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28578.776807 secs 2023-05-08T11:40:41.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28580.065765 secs 2023-05-08T11:40:41.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:41 smithi133 ceph-mon[125939]: pgmap v15298: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 686 KiB/s rd, 329 KiB/s wr, 11 op/s 2023-05-08T11:40:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28580.065765 secs 2023-05-08T11:40:42.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:41 smithi096 ceph-mon[124666]: pgmap v15298: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 686 KiB/s rd, 329 KiB/s wr, 11 op/s 2023-05-08T11:40:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28580.065765 secs 2023-05-08T11:40:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:41 smithi186 ceph-mon[126480]: pgmap v15298: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 686 KiB/s rd, 329 KiB/s wr, 11 op/s 2023-05-08T11:40:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:43 smithi133 ceph-mon[125939]: pgmap v15299: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 328 KiB/s wr, 6 op/s 2023-05-08T11:40:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:43 smithi096 ceph-mon[124666]: pgmap v15299: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 328 KiB/s wr, 6 op/s 2023-05-08T11:40:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:43 smithi186 ceph-mon[126480]: pgmap v15299: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 328 KiB/s wr, 6 op/s 2023-05-08T11:40:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28583.221214 secs 2023-05-08T11:40:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28583.221214 secs 2023-05-08T11:40:45.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28583.221214 secs 2023-05-08T11:40:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28583.776922 secs 2023-05-08T11:40:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:45 smithi133 ceph-mon[125939]: pgmap v15300: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 774 KiB/s rd, 656 KiB/s wr, 10 op/s 2023-05-08T11:40:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28583.776922 secs 2023-05-08T11:40:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:45 smithi096 ceph-mon[124666]: pgmap v15300: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 774 KiB/s rd, 656 KiB/s wr, 10 op/s 2023-05-08T11:40:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28583.776922 secs 2023-05-08T11:40:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:45 smithi186 ceph-mon[126480]: pgmap v15300: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 774 KiB/s rd, 656 KiB/s wr, 10 op/s 2023-05-08T11:40:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:47 smithi096 ceph-mon[124666]: pgmap v15301: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 689 KiB/s rd, 552 KiB/s wr, 7 op/s 2023-05-08T11:40:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:47 smithi186 ceph-mon[126480]: pgmap v15301: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 689 KiB/s rd, 552 KiB/s wr, 7 op/s 2023-05-08T11:40:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:47 smithi133 ceph-mon[125939]: pgmap v15301: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 689 KiB/s rd, 552 KiB/s wr, 7 op/s 2023-05-08T11:40:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:40:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:40:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:40:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28588.221361 secs 2023-05-08T11:40:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:49 smithi096 ceph-mon[124666]: pgmap v15302: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 689 KiB/s rd, 552 KiB/s wr, 7 op/s 2023-05-08T11:40:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:40:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:40:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:40:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28588.221361 secs 2023-05-08T11:40:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:49 smithi186 ceph-mon[126480]: pgmap v15302: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 689 KiB/s rd, 552 KiB/s wr, 7 op/s 2023-05-08T11:40:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:40:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:40:50.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:40:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28588.221361 secs 2023-05-08T11:40:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:49 smithi133 ceph-mon[125939]: pgmap v15302: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 689 KiB/s rd, 552 KiB/s wr, 7 op/s 2023-05-08T11:40:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:40:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:40:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:40:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:51 smithi096 ceph-mon[124666]: pgmap v15303: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 980 KiB/s rd, 652 KiB/s wr, 12 op/s 2023-05-08T11:40:51.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:51 smithi186 ceph-mon[126480]: pgmap v15303: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 980 KiB/s rd, 652 KiB/s wr, 12 op/s 2023-05-08T11:40:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:51 smithi133 ceph-mon[125939]: pgmap v15303: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 980 KiB/s rd, 652 KiB/s wr, 12 op/s 2023-05-08T11:40:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:40:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:40:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:40:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:40:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:40:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:53 smithi186 ceph-mon[126480]: pgmap v15304: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 735 KiB/s rd, 428 KiB/s wr, 8 op/s 2023-05-08T11:40:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:40:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:40:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:53 smithi133 ceph-mon[125939]: pgmap v15304: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 735 KiB/s rd, 428 KiB/s wr, 8 op/s 2023-05-08T11:40:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:40:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:40:54.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:53 smithi096 ceph-mon[124666]: pgmap v15304: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 735 KiB/s rd, 428 KiB/s wr, 8 op/s 2023-05-08T11:40:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28593.221461 secs 2023-05-08T11:40:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28593.221461 secs 2023-05-08T11:40:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28593.221461 secs 2023-05-08T11:40:55.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:55 smithi186 ceph-mon[126480]: pgmap v15305: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 984 KiB/s wr, 14 op/s 2023-05-08T11:40:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:55 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:40:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:55 smithi133 ceph-mon[125939]: pgmap v15305: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 984 KiB/s wr, 14 op/s 2023-05-08T11:40:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:55 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:40:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:55 smithi096 ceph-mon[124666]: pgmap v15305: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 984 KiB/s wr, 14 op/s 2023-05-08T11:40:56.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:55 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:40:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:57 smithi133 ceph-mon[125939]: pgmap v15306: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 974 KiB/s rd, 656 KiB/s wr, 10 op/s 2023-05-08T11:40:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:57 smithi096 ceph-mon[124666]: pgmap v15306: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 974 KiB/s rd, 656 KiB/s wr, 10 op/s 2023-05-08T11:40:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:57 smithi186 ceph-mon[126480]: pgmap v15306: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 974 KiB/s rd, 656 KiB/s wr, 10 op/s 2023-05-08T11:40:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28598.221552 secs 2023-05-08T11:40:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:40:59 smithi133 ceph-mon[125939]: pgmap v15307: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 974 KiB/s rd, 656 KiB/s wr, 10 op/s 2023-05-08T11:41:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28598.221552 secs 2023-05-08T11:41:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:40:59 smithi096 ceph-mon[124666]: pgmap v15307: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 974 KiB/s rd, 656 KiB/s wr, 10 op/s 2023-05-08T11:41:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28598.221552 secs 2023-05-08T11:41:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:40:59 smithi186 ceph-mon[126480]: pgmap v15307: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 974 KiB/s rd, 656 KiB/s wr, 10 op/s 2023-05-08T11:41:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28598.777294 secs 2023-05-08T11:41:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28598.777294 secs 2023-05-08T11:41:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28598.777294 secs 2023-05-08T11:41:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:01 smithi133 ceph-mon[125939]: pgmap v15308: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 820 KiB/s wr, 15 op/s 2023-05-08T11:41:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:01 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:41:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:41:01.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:41:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:01 smithi096 ceph-mon[124666]: pgmap v15308: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 820 KiB/s wr, 15 op/s 2023-05-08T11:41:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:01 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:41:02.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:41:02.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:41:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:01 smithi186 ceph-mon[126480]: pgmap v15308: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 820 KiB/s wr, 15 op/s 2023-05-08T11:41:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:01 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:41:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:41:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:41:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:03 smithi133 ceph-mon[125939]: pgmap v15309: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 880 KiB/s rd, 720 KiB/s wr, 10 op/s 2023-05-08T11:41:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:41:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:03 smithi096 ceph-mon[124666]: pgmap v15309: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 880 KiB/s rd, 720 KiB/s wr, 10 op/s 2023-05-08T11:41:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:41:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:03 smithi186 ceph-mon[126480]: pgmap v15309: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 880 KiB/s rd, 720 KiB/s wr, 10 op/s 2023-05-08T11:41:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:41:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28603.221640 secs 2023-05-08T11:41:04.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:04 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:41:04.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:04 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:41:04.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:04 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:41:04.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:04 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:41:04.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:04 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T11:41:04.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:04 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T11:41:04.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:04 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:41:04.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:04 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:41:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28603.221640 secs 2023-05-08T11:41:05.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:04 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:41:05.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:04 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:41:05.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:04 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:41:05.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:04 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:41:05.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:04 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T11:41:05.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:04 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T11:41:05.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:04 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:41:05.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:04 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:41:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28603.221640 secs 2023-05-08T11:41:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:04 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:41:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:04 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:41:05.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:04 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:41:05.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:04 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:41:05.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:04 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T11:41:05.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:04 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T11:41:05.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:04 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:41:05.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:04 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:41:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:06 smithi186 ceph-mon[126480]: pgmap v15310: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 23 op/s 2023-05-08T11:41:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:41:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:41:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:06 smithi133 ceph-mon[125939]: pgmap v15310: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 23 op/s 2023-05-08T11:41:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:41:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:41:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:06 smithi096 ceph-mon[124666]: pgmap v15310: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 23 op/s 2023-05-08T11:41:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:41:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:41:07.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:07 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28605.066349 secs 2023-05-08T11:41:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:07 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28605.066349 secs 2023-05-08T11:41:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:07 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28605.066349 secs 2023-05-08T11:41:08.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:08 smithi186 ceph-mon[126480]: pgmap v15311: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 712 KiB/s rd, 846 KiB/s wr, 18 op/s 2023-05-08T11:41:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:08 smithi133 ceph-mon[125939]: pgmap v15311: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 712 KiB/s rd, 846 KiB/s wr, 18 op/s 2023-05-08T11:41:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:08 smithi096 ceph-mon[124666]: pgmap v15311: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 712 KiB/s rd, 846 KiB/s wr, 18 op/s 2023-05-08T11:41:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:09 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:41:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:41:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:41:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:09 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:41:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:41:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:41:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:09 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:41:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:41:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:41:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28608.221714 secs 2023-05-08T11:41:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:10 smithi133 ceph-mon[125939]: pgmap v15312: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 712 KiB/s rd, 846 KiB/s wr, 18 op/s 2023-05-08T11:41:10.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28608.777522 secs 2023-05-08T11:41:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28608.221714 secs 2023-05-08T11:41:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:10 smithi096 ceph-mon[124666]: pgmap v15312: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 712 KiB/s rd, 846 KiB/s wr, 18 op/s 2023-05-08T11:41:10.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28608.777522 secs 2023-05-08T11:41:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28608.221714 secs 2023-05-08T11:41:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:10 smithi186 ceph-mon[126480]: pgmap v15312: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 712 KiB/s rd, 846 KiB/s wr, 18 op/s 2023-05-08T11:41:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28608.777522 secs 2023-05-08T11:41:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:12 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28610.066481 secs 2023-05-08T11:41:12.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:12 smithi133 ceph-mon[125939]: pgmap v15313: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1017 KiB/s rd, 869 KiB/s wr, 29 op/s 2023-05-08T11:41:12.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:12 smithi133 ceph-mon[125939]: osdmap e1034: 12 total, 12 up, 12 in 2023-05-08T11:41:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:12 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28610.066481 secs 2023-05-08T11:41:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:12 smithi096 ceph-mon[124666]: pgmap v15313: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1017 KiB/s rd, 869 KiB/s wr, 29 op/s 2023-05-08T11:41:12.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:12 smithi096 ceph-mon[124666]: osdmap e1034: 12 total, 12 up, 12 in 2023-05-08T11:41:12.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:12 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28610.066481 secs 2023-05-08T11:41:12.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:12 smithi186 ceph-mon[126480]: pgmap v15313: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1017 KiB/s rd, 869 KiB/s wr, 29 op/s 2023-05-08T11:41:12.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:12 smithi186 ceph-mon[126480]: osdmap e1034: 12 total, 12 up, 12 in 2023-05-08T11:41:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:14 smithi133 ceph-mon[125939]: pgmap v15315: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 984 KiB/s rd, 846 KiB/s wr, 28 op/s 2023-05-08T11:41:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:14 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:41:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:14 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:41:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:14 smithi096 ceph-mon[124666]: pgmap v15315: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 984 KiB/s rd, 846 KiB/s wr, 28 op/s 2023-05-08T11:41:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:14 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:41:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:14 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:41:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:14 smithi186 ceph-mon[126480]: pgmap v15315: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 984 KiB/s rd, 846 KiB/s wr, 28 op/s 2023-05-08T11:41:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:14 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:41:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:14 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:41:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28613.221802 secs 2023-05-08T11:41:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28613.777642 secs 2023-05-08T11:41:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28613.221802 secs 2023-05-08T11:41:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28613.777642 secs 2023-05-08T11:41:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28613.221802 secs 2023-05-08T11:41:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28613.777642 secs 2023-05-08T11:41:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:16 smithi133 ceph-mon[125939]: pgmap v15316: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 671 KiB/s rd, 332 KiB/s wr, 18 op/s 2023-05-08T11:41:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:16 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:41:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:16 smithi096 ceph-mon[124666]: pgmap v15316: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 671 KiB/s rd, 332 KiB/s wr, 18 op/s 2023-05-08T11:41:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:16 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:41:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:16 smithi186 ceph-mon[126480]: pgmap v15316: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 671 KiB/s rd, 332 KiB/s wr, 18 op/s 2023-05-08T11:41:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:16 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:41:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:17 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28615.066557 secs 2023-05-08T11:41:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:17 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28615.066557 secs 2023-05-08T11:41:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:17 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28615.066557 secs 2023-05-08T11:41:18.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:18 smithi133 ceph-mon[125939]: pgmap v15317: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 671 KiB/s rd, 332 KiB/s wr, 18 op/s 2023-05-08T11:41:18.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:18 smithi096 ceph-mon[124666]: pgmap v15317: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 671 KiB/s rd, 332 KiB/s wr, 18 op/s 2023-05-08T11:41:18.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:18 smithi186 ceph-mon[126480]: pgmap v15317: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 671 KiB/s rd, 332 KiB/s wr, 18 op/s 2023-05-08T11:41:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28618.221922 secs 2023-05-08T11:41:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:20 smithi133 ceph-mon[125939]: pgmap v15318: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 671 KiB/s rd, 332 KiB/s wr, 18 op/s 2023-05-08T11:41:20.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28618.777758 secs 2023-05-08T11:41:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28618.221922 secs 2023-05-08T11:41:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:20 smithi096 ceph-mon[124666]: pgmap v15318: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 671 KiB/s rd, 332 KiB/s wr, 18 op/s 2023-05-08T11:41:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28618.777758 secs 2023-05-08T11:41:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28618.221922 secs 2023-05-08T11:41:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:20 smithi186 ceph-mon[126480]: pgmap v15318: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 671 KiB/s rd, 332 KiB/s wr, 18 op/s 2023-05-08T11:41:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28618.777758 secs 2023-05-08T11:41:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28620.066700 secs 2023-05-08T11:41:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:21 smithi186 ceph-mon[126480]: osdmap e1035: 12 total, 12 up, 12 in 2023-05-08T11:41:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:21 smithi186 ceph-mon[126480]: pgmap v15320: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 345 KiB/s wr, 10 op/s 2023-05-08T11:41:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28620.066700 secs 2023-05-08T11:41:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:21 smithi133 ceph-mon[125939]: osdmap e1035: 12 total, 12 up, 12 in 2023-05-08T11:41:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:21 smithi133 ceph-mon[125939]: pgmap v15320: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 345 KiB/s wr, 10 op/s 2023-05-08T11:41:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28620.066700 secs 2023-05-08T11:41:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:21 smithi096 ceph-mon[124666]: osdmap e1035: 12 total, 12 up, 12 in 2023-05-08T11:41:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:21 smithi096 ceph-mon[124666]: pgmap v15320: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 345 KiB/s wr, 10 op/s 2023-05-08T11:41:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:23 smithi133 ceph-mon[125939]: pgmap v15321: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 326 KiB/s wr, 9 op/s 2023-05-08T11:41:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:23 smithi096 ceph-mon[124666]: pgmap v15321: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 326 KiB/s wr, 9 op/s 2023-05-08T11:41:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:23 smithi186 ceph-mon[126480]: pgmap v15321: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 326 KiB/s wr, 9 op/s 2023-05-08T11:41:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28623.222011 secs 2023-05-08T11:41:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28623.222011 secs 2023-05-08T11:41:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28623.222011 secs 2023-05-08T11:41:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28623.777903 secs 2023-05-08T11:41:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:25 smithi133 ceph-mon[125939]: pgmap v15322: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 124 KiB/s wr, 8 op/s 2023-05-08T11:41:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28623.777903 secs 2023-05-08T11:41:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:25 smithi096 ceph-mon[124666]: pgmap v15322: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 124 KiB/s wr, 8 op/s 2023-05-08T11:41:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28623.777903 secs 2023-05-08T11:41:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:25 smithi186 ceph-mon[126480]: pgmap v15322: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 124 KiB/s wr, 8 op/s 2023-05-08T11:41:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28625.066844 secs 2023-05-08T11:41:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28625.066844 secs 2023-05-08T11:41:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28625.066844 secs 2023-05-08T11:41:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:27 smithi133 ceph-mon[125939]: pgmap v15323: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 124 KiB/s wr, 8 op/s 2023-05-08T11:41:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:27 smithi096 ceph-mon[124666]: pgmap v15323: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 124 KiB/s wr, 8 op/s 2023-05-08T11:41:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:27 smithi186 ceph-mon[126480]: pgmap v15323: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 124 KiB/s wr, 8 op/s 2023-05-08T11:41:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28628.222095 secs 2023-05-08T11:41:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:29 smithi133 ceph-mon[125939]: pgmap v15324: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 124 KiB/s wr, 8 op/s 2023-05-08T11:41:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28628.222095 secs 2023-05-08T11:41:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:29 smithi096 ceph-mon[124666]: pgmap v15324: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 124 KiB/s wr, 8 op/s 2023-05-08T11:41:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28628.222095 secs 2023-05-08T11:41:30.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:29 smithi186 ceph-mon[126480]: pgmap v15324: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 124 KiB/s wr, 8 op/s 2023-05-08T11:41:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28628.778041 secs 2023-05-08T11:41:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28628.778041 secs 2023-05-08T11:41:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28628.778041 secs 2023-05-08T11:41:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28630.066965 secs 2023-05-08T11:41:31.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:31 smithi133 ceph-mon[125939]: pgmap v15325: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 231 KiB/s wr, 7 op/s 2023-05-08T11:41:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28630.066965 secs 2023-05-08T11:41:32.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:31 smithi096 ceph-mon[124666]: pgmap v15325: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 231 KiB/s wr, 7 op/s 2023-05-08T11:41:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28630.066965 secs 2023-05-08T11:41:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:31 smithi186 ceph-mon[126480]: pgmap v15325: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 231 KiB/s wr, 7 op/s 2023-05-08T11:41:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:33 smithi133 ceph-mon[125939]: pgmap v15326: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 194 KiB/s wr, 6 op/s 2023-05-08T11:41:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:33 smithi096 ceph-mon[124666]: pgmap v15326: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 194 KiB/s wr, 6 op/s 2023-05-08T11:41:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:33 smithi186 ceph-mon[126480]: pgmap v15326: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 194 KiB/s wr, 6 op/s 2023-05-08T11:41:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28633.222215 secs 2023-05-08T11:41:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28633.222215 secs 2023-05-08T11:41:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28633.222215 secs 2023-05-08T11:41:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28633.778159 secs 2023-05-08T11:41:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:35 smithi133 ceph-mon[125939]: pgmap v15327: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 195 KiB/s wr, 10 op/s 2023-05-08T11:41:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28633.778159 secs 2023-05-08T11:41:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:35 smithi096 ceph-mon[124666]: pgmap v15327: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 195 KiB/s wr, 10 op/s 2023-05-08T11:41:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28633.778159 secs 2023-05-08T11:41:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:35 smithi186 ceph-mon[126480]: pgmap v15327: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 195 KiB/s wr, 10 op/s 2023-05-08T11:41:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28635.067051 secs 2023-05-08T11:41:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28635.067051 secs 2023-05-08T11:41:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28635.067051 secs 2023-05-08T11:41:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:37 smithi133 ceph-mon[125939]: pgmap v15328: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 110 KiB/s wr, 7 op/s 2023-05-08T11:41:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:37 smithi096 ceph-mon[124666]: pgmap v15328: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 110 KiB/s wr, 7 op/s 2023-05-08T11:41:38.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:37 smithi186 ceph-mon[126480]: pgmap v15328: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 110 KiB/s wr, 7 op/s 2023-05-08T11:41:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28638.222348 secs 2023-05-08T11:41:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:39 smithi133 ceph-mon[125939]: pgmap v15329: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 110 KiB/s wr, 7 op/s 2023-05-08T11:41:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28638.222348 secs 2023-05-08T11:41:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:39 smithi096 ceph-mon[124666]: pgmap v15329: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 110 KiB/s wr, 7 op/s 2023-05-08T11:41:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28638.222348 secs 2023-05-08T11:41:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:39 smithi186 ceph-mon[126480]: pgmap v15329: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 110 KiB/s wr, 7 op/s 2023-05-08T11:41:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28638.778276 secs 2023-05-08T11:41:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28638.778276 secs 2023-05-08T11:41:41.123 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28638.778276 secs 2023-05-08T11:41:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28640.067175 secs 2023-05-08T11:41:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:41 smithi133 ceph-mon[125939]: pgmap v15330: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 334 KiB/s wr, 10 op/s 2023-05-08T11:41:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28640.067175 secs 2023-05-08T11:41:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:41 smithi096 ceph-mon[124666]: pgmap v15330: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 334 KiB/s wr, 10 op/s 2023-05-08T11:41:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28640.067175 secs 2023-05-08T11:41:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:41 smithi186 ceph-mon[126480]: pgmap v15330: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 334 KiB/s wr, 10 op/s 2023-05-08T11:41:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:43 smithi133 ceph-mon[125939]: pgmap v15331: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 225 KiB/s wr, 7 op/s 2023-05-08T11:41:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:43 smithi096 ceph-mon[124666]: pgmap v15331: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 225 KiB/s wr, 7 op/s 2023-05-08T11:41:44.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:43 smithi186 ceph-mon[126480]: pgmap v15331: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 225 KiB/s wr, 7 op/s 2023-05-08T11:41:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28643.222388 secs 2023-05-08T11:41:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28643.222388 secs 2023-05-08T11:41:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28643.222388 secs 2023-05-08T11:41:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28643.778419 secs 2023-05-08T11:41:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:45 smithi133 ceph-mon[125939]: pgmap v15332: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 516 KiB/s rd, 315 KiB/s wr, 11 op/s 2023-05-08T11:41:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28643.778419 secs 2023-05-08T11:41:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:45 smithi096 ceph-mon[124666]: pgmap v15332: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 516 KiB/s rd, 315 KiB/s wr, 11 op/s 2023-05-08T11:41:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28643.778419 secs 2023-05-08T11:41:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:45 smithi186 ceph-mon[126480]: pgmap v15332: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 516 KiB/s rd, 315 KiB/s wr, 11 op/s 2023-05-08T11:41:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:47 smithi133 ceph-mon[125939]: pgmap v15333: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 314 KiB/s wr, 7 op/s 2023-05-08T11:41:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:47 smithi096 ceph-mon[124666]: pgmap v15333: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 314 KiB/s wr, 7 op/s 2023-05-08T11:41:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:47 smithi186 ceph-mon[126480]: pgmap v15333: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 314 KiB/s wr, 7 op/s 2023-05-08T11:41:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:41:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:41:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:41:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28648.222525 secs 2023-05-08T11:41:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:49 smithi133 ceph-mon[125939]: pgmap v15334: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 314 KiB/s wr, 7 op/s 2023-05-08T11:41:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:41:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:41:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:41:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28648.222525 secs 2023-05-08T11:41:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:49 smithi096 ceph-mon[124666]: pgmap v15334: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 314 KiB/s wr, 7 op/s 2023-05-08T11:41:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:41:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:41:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:41:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28648.222525 secs 2023-05-08T11:41:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:49 smithi186 ceph-mon[126480]: pgmap v15334: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 314 KiB/s wr, 7 op/s 2023-05-08T11:41:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:41:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:41:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:41:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28648.778537 secs 2023-05-08T11:41:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28648.778537 secs 2023-05-08T11:41:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28648.778537 secs 2023-05-08T11:41:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:51 smithi133 ceph-mon[125939]: pgmap v15335: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 696 KiB/s rd, 335 KiB/s wr, 10 op/s 2023-05-08T11:41:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:51 smithi096 ceph-mon[124666]: pgmap v15335: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 696 KiB/s rd, 335 KiB/s wr, 10 op/s 2023-05-08T11:41:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:51 smithi186 ceph-mon[126480]: pgmap v15335: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 696 KiB/s rd, 335 KiB/s wr, 10 op/s 2023-05-08T11:41:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:53 smithi133 ceph-mon[125939]: pgmap v15336: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 694 KiB/s rd, 111 KiB/s wr, 7 op/s 2023-05-08T11:41:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:53 smithi096 ceph-mon[124666]: pgmap v15336: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 694 KiB/s rd, 111 KiB/s wr, 7 op/s 2023-05-08T11:41:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:53 smithi186 ceph-mon[126480]: pgmap v15336: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 694 KiB/s rd, 111 KiB/s wr, 7 op/s 2023-05-08T11:41:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28653.222665 secs 2023-05-08T11:41:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28653.222665 secs 2023-05-08T11:41:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28653.222665 secs 2023-05-08T11:41:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:55 smithi133 ceph-mon[125939]: pgmap v15337: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 573 KiB/s wr, 11 op/s 2023-05-08T11:41:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:55 smithi096 ceph-mon[124666]: pgmap v15337: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 573 KiB/s wr, 11 op/s 2023-05-08T11:41:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:55 smithi186 ceph-mon[126480]: pgmap v15337: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 573 KiB/s wr, 11 op/s 2023-05-08T11:41:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:41:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:41:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:41:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:57 smithi133 ceph-mon[125939]: pgmap v15338: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 753 KiB/s rd, 483 KiB/s wr, 8 op/s 2023-05-08T11:41:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:57 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:41:57.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:41:57.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:41:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:57 smithi096 ceph-mon[124666]: pgmap v15338: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 753 KiB/s rd, 483 KiB/s wr, 8 op/s 2023-05-08T11:41:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:57 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:41:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:41:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:41:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:57 smithi186 ceph-mon[126480]: pgmap v15338: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 753 KiB/s rd, 483 KiB/s wr, 8 op/s 2023-05-08T11:41:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:57 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:41:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:41:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:41:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28658.222784 secs 2023-05-08T11:41:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:41:59 smithi133 ceph-mon[125939]: pgmap v15339: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 753 KiB/s rd, 483 KiB/s wr, 8 op/s 2023-05-08T11:42:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28658.222784 secs 2023-05-08T11:42:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:41:59 smithi096 ceph-mon[124666]: pgmap v15339: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 753 KiB/s rd, 483 KiB/s wr, 8 op/s 2023-05-08T11:42:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28658.222784 secs 2023-05-08T11:42:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:41:59 smithi186 ceph-mon[126480]: pgmap v15339: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 753 KiB/s rd, 483 KiB/s wr, 8 op/s 2023-05-08T11:42:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:01 smithi186 ceph-mon[126480]: pgmap v15340: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 809 KiB/s rd, 887 KiB/s wr, 13 op/s 2023-05-08T11:42:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:01 smithi133 ceph-mon[125939]: pgmap v15340: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 809 KiB/s rd, 887 KiB/s wr, 13 op/s 2023-05-08T11:42:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:01 smithi096 ceph-mon[124666]: pgmap v15340: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 809 KiB/s rd, 887 KiB/s wr, 13 op/s 2023-05-08T11:42:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:03 smithi133 ceph-mon[125939]: pgmap v15341: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 866 KiB/s wr, 9 op/s 2023-05-08T11:42:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:03 smithi096 ceph-mon[124666]: pgmap v15341: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 866 KiB/s wr, 9 op/s 2023-05-08T11:42:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:03 smithi186 ceph-mon[126480]: pgmap v15341: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 866 KiB/s wr, 9 op/s 2023-05-08T11:42:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28663.222903 secs 2023-05-08T11:42:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:04 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:42:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28663.222903 secs 2023-05-08T11:42:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:04 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:42:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28663.222903 secs 2023-05-08T11:42:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:04 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:42:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28663.778830 secs 2023-05-08T11:42:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:05 smithi133 ceph-mon[125939]: pgmap v15342: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 29 op/s 2023-05-08T11:42:05.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:05 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:42:05.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:42:05.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:42:05.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:05 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:42:05.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:05 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:42:05.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:05 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:42:05.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:05 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:42:05.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:05 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T11:42:05.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:05 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T11:42:05.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:05 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:42:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28663.778830 secs 2023-05-08T11:42:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:05 smithi096 ceph-mon[124666]: pgmap v15342: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 29 op/s 2023-05-08T11:42:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:05 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:42:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:42:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:42:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:05 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:42:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:05 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:42:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:05 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:42:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:05 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:42:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:05 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T11:42:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:05 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T11:42:06.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:05 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:42:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28663.778830 secs 2023-05-08T11:42:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:05 smithi186 ceph-mon[126480]: pgmap v15342: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 29 op/s 2023-05-08T11:42:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:05 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:42:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:42:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:42:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:05 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:42:06.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:05 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:42:06.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:05 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:42:06.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:05 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:42:06.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:05 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T11:42:06.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:05 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T11:42:06.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:05 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:42:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:07 smithi133 ceph-mon[125939]: pgmap v15343: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 612 KiB/s rd, 635 KiB/s wr, 24 op/s 2023-05-08T11:42:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:07 smithi096 ceph-mon[124666]: pgmap v15343: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 612 KiB/s rd, 635 KiB/s wr, 24 op/s 2023-05-08T11:42:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:07 smithi186 ceph-mon[126480]: pgmap v15343: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 612 KiB/s rd, 635 KiB/s wr, 24 op/s 2023-05-08T11:42:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28668.223023 secs 2023-05-08T11:42:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:09 smithi133 ceph-mon[125939]: pgmap v15344: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 612 KiB/s rd, 635 KiB/s wr, 24 op/s 2023-05-08T11:42:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28668.223023 secs 2023-05-08T11:42:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:09 smithi096 ceph-mon[124666]: pgmap v15344: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 612 KiB/s rd, 635 KiB/s wr, 24 op/s 2023-05-08T11:42:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28668.223023 secs 2023-05-08T11:42:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:09 smithi186 ceph-mon[126480]: pgmap v15344: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 612 KiB/s rd, 635 KiB/s wr, 24 op/s 2023-05-08T11:42:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:11 smithi133 ceph-mon[125939]: pgmap v15345: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 756 KiB/s rd, 884 KiB/s wr, 29 op/s 2023-05-08T11:42:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:11 smithi133 ceph-mon[125939]: osdmap e1036: 12 total, 12 up, 12 in 2023-05-08T11:42:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:11 smithi096 ceph-mon[124666]: pgmap v15345: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 756 KiB/s rd, 884 KiB/s wr, 29 op/s 2023-05-08T11:42:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:11 smithi096 ceph-mon[124666]: osdmap e1036: 12 total, 12 up, 12 in 2023-05-08T11:42:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:11 smithi186 ceph-mon[126480]: pgmap v15345: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 756 KiB/s rd, 884 KiB/s wr, 29 op/s 2023-05-08T11:42:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:11 smithi186 ceph-mon[126480]: osdmap e1036: 12 total, 12 up, 12 in 2023-05-08T11:42:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:12 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:42:13.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:12 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:42:13.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:12 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:42:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:13 smithi133 ceph-mon[125939]: pgmap v15347: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 840 KiB/s rd, 576 KiB/s wr, 28 op/s 2023-05-08T11:42:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:13 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:42:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:42:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:13 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:42:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:13 smithi096 ceph-mon[124666]: pgmap v15347: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 840 KiB/s rd, 576 KiB/s wr, 28 op/s 2023-05-08T11:42:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:13 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:42:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:42:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:13 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:42:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:13 smithi186 ceph-mon[126480]: pgmap v15347: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 840 KiB/s rd, 576 KiB/s wr, 28 op/s 2023-05-08T11:42:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:13 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:42:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:42:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:13 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:42:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28673.223138 secs 2023-05-08T11:42:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28673.223138 secs 2023-05-08T11:42:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28673.223138 secs 2023-05-08T11:42:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:15 smithi133 ceph-mon[125939]: pgmap v15348: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 686 KiB/s rd, 684 KiB/s wr, 10 op/s 2023-05-08T11:42:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:15 smithi096 ceph-mon[124666]: pgmap v15348: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 686 KiB/s rd, 684 KiB/s wr, 10 op/s 2023-05-08T11:42:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:15 smithi186 ceph-mon[126480]: pgmap v15348: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 686 KiB/s rd, 684 KiB/s wr, 10 op/s 2023-05-08T11:42:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:17 smithi133 ceph-mon[125939]: pgmap v15349: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 686 KiB/s rd, 684 KiB/s wr, 10 op/s 2023-05-08T11:42:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:17 smithi096 ceph-mon[124666]: pgmap v15349: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 686 KiB/s rd, 684 KiB/s wr, 10 op/s 2023-05-08T11:42:18.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:17 smithi186 ceph-mon[126480]: pgmap v15349: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 686 KiB/s rd, 684 KiB/s wr, 10 op/s 2023-05-08T11:42:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28678.223252 secs 2023-05-08T11:42:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:19 smithi133 ceph-mon[125939]: pgmap v15350: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 686 KiB/s rd, 684 KiB/s wr, 10 op/s 2023-05-08T11:42:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28678.223252 secs 2023-05-08T11:42:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:19 smithi096 ceph-mon[124666]: pgmap v15350: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 686 KiB/s rd, 684 KiB/s wr, 10 op/s 2023-05-08T11:42:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28678.223252 secs 2023-05-08T11:42:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:19 smithi186 ceph-mon[126480]: pgmap v15350: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 686 KiB/s rd, 684 KiB/s wr, 10 op/s 2023-05-08T11:42:21.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:21 smithi186 ceph-mon[126480]: osdmap e1037: 12 total, 12 up, 12 in 2023-05-08T11:42:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:21 smithi186 ceph-mon[126480]: pgmap v15352: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 389 KiB/s wr, 9 op/s 2023-05-08T11:42:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:21 smithi133 ceph-mon[125939]: osdmap e1037: 12 total, 12 up, 12 in 2023-05-08T11:42:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:21 smithi133 ceph-mon[125939]: pgmap v15352: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 389 KiB/s wr, 9 op/s 2023-05-08T11:42:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:21 smithi096 ceph-mon[124666]: osdmap e1037: 12 total, 12 up, 12 in 2023-05-08T11:42:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:21 smithi096 ceph-mon[124666]: pgmap v15352: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 389 KiB/s wr, 9 op/s 2023-05-08T11:42:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:23 smithi133 ceph-mon[125939]: pgmap v15353: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 516 KiB/s rd, 386 KiB/s wr, 9 op/s 2023-05-08T11:42:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:23 smithi096 ceph-mon[124666]: pgmap v15353: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 516 KiB/s rd, 386 KiB/s wr, 9 op/s 2023-05-08T11:42:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:23 smithi186 ceph-mon[126480]: pgmap v15353: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 516 KiB/s rd, 386 KiB/s wr, 9 op/s 2023-05-08T11:42:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28683.223367 secs 2023-05-08T11:42:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28683.223367 secs 2023-05-08T11:42:25.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28683.223367 secs 2023-05-08T11:42:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28683.779244 secs 2023-05-08T11:42:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:25 smithi133 ceph-mon[125939]: pgmap v15354: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 516 KiB/s wr, 8 op/s 2023-05-08T11:42:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:25 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:42:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:25 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:42:25.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:25 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:42:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28683.779244 secs 2023-05-08T11:42:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:25 smithi096 ceph-mon[124666]: pgmap v15354: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 516 KiB/s wr, 8 op/s 2023-05-08T11:42:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:25 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:42:26.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:25 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:42:26.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:25 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:42:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28683.779244 secs 2023-05-08T11:42:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:25 smithi186 ceph-mon[126480]: pgmap v15354: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 516 KiB/s wr, 8 op/s 2023-05-08T11:42:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:25 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:42:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:25 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:42:26.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:25 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:42:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28685.068208 secs 2023-05-08T11:42:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28685.068208 secs 2023-05-08T11:42:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28685.068208 secs 2023-05-08T11:42:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:27 smithi133 ceph-mon[125939]: pgmap v15355: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 516 KiB/s wr, 8 op/s 2023-05-08T11:42:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:27 smithi096 ceph-mon[124666]: pgmap v15355: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 516 KiB/s wr, 8 op/s 2023-05-08T11:42:28.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:27 smithi186 ceph-mon[126480]: pgmap v15355: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 516 KiB/s wr, 8 op/s 2023-05-08T11:42:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28688.223477 secs 2023-05-08T11:42:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:29 smithi133 ceph-mon[125939]: pgmap v15356: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 516 KiB/s wr, 8 op/s 2023-05-08T11:42:29.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:29 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:42:29.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:29 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:42:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28688.223477 secs 2023-05-08T11:42:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:29 smithi096 ceph-mon[124666]: pgmap v15356: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 516 KiB/s wr, 8 op/s 2023-05-08T11:42:30.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:29 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:42:30.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:29 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:42:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28688.223477 secs 2023-05-08T11:42:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:29 smithi186 ceph-mon[126480]: pgmap v15356: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 516 KiB/s wr, 8 op/s 2023-05-08T11:42:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:29 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:42:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:29 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:42:30.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28688.779358 secs 2023-05-08T11:42:30.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:30 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:42:31.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28688.779358 secs 2023-05-08T11:42:31.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:30 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:42:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28688.779358 secs 2023-05-08T11:42:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:30 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:42:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28690.068327 secs 2023-05-08T11:42:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:31 smithi133 ceph-mon[125939]: pgmap v15357: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 516 KiB/s rd, 643 KiB/s wr, 10 op/s 2023-05-08T11:42:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28690.068327 secs 2023-05-08T11:42:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:31 smithi096 ceph-mon[124666]: pgmap v15357: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 516 KiB/s rd, 643 KiB/s wr, 10 op/s 2023-05-08T11:42:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28690.068327 secs 2023-05-08T11:42:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:31 smithi186 ceph-mon[126480]: pgmap v15357: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 516 KiB/s rd, 643 KiB/s wr, 10 op/s 2023-05-08T11:42:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:33 smithi133 ceph-mon[125939]: pgmap v15358: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 434 KiB/s rd, 539 KiB/s wr, 8 op/s 2023-05-08T11:42:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:33 smithi096 ceph-mon[124666]: pgmap v15358: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 434 KiB/s rd, 539 KiB/s wr, 8 op/s 2023-05-08T11:42:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:33 smithi186 ceph-mon[126480]: pgmap v15358: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 434 KiB/s rd, 539 KiB/s wr, 8 op/s 2023-05-08T11:42:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28693.223586 secs 2023-05-08T11:42:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28693.223586 secs 2023-05-08T11:42:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28693.223586 secs 2023-05-08T11:42:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28693.779426 secs 2023-05-08T11:42:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:35 smithi133 ceph-mon[125939]: pgmap v15359: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 750 KiB/s rd, 749 KiB/s wr, 13 op/s 2023-05-08T11:42:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28693.779426 secs 2023-05-08T11:42:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:35 smithi096 ceph-mon[124666]: pgmap v15359: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 750 KiB/s rd, 749 KiB/s wr, 13 op/s 2023-05-08T11:42:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28693.779426 secs 2023-05-08T11:42:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:35 smithi186 ceph-mon[126480]: pgmap v15359: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 750 KiB/s rd, 749 KiB/s wr, 13 op/s 2023-05-08T11:42:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28695.068443 secs 2023-05-08T11:42:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28695.068443 secs 2023-05-08T11:42:37.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28695.068443 secs 2023-05-08T11:42:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:37 smithi133 ceph-mon[125939]: pgmap v15360: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 712 KiB/s rd, 319 KiB/s wr, 9 op/s 2023-05-08T11:42:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:37 smithi096 ceph-mon[124666]: pgmap v15360: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 712 KiB/s rd, 319 KiB/s wr, 9 op/s 2023-05-08T11:42:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:37 smithi186 ceph-mon[126480]: pgmap v15360: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 712 KiB/s rd, 319 KiB/s wr, 9 op/s 2023-05-08T11:42:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28698.223663 secs 2023-05-08T11:42:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:39 smithi133 ceph-mon[125939]: pgmap v15361: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 712 KiB/s rd, 319 KiB/s wr, 9 op/s 2023-05-08T11:42:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28698.223663 secs 2023-05-08T11:42:40.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:39 smithi096 ceph-mon[124666]: pgmap v15361: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 712 KiB/s rd, 319 KiB/s wr, 9 op/s 2023-05-08T11:42:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28698.223663 secs 2023-05-08T11:42:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:39 smithi186 ceph-mon[126480]: pgmap v15361: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 712 KiB/s rd, 319 KiB/s wr, 9 op/s 2023-05-08T11:42:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28698.779496 secs 2023-05-08T11:42:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28698.779496 secs 2023-05-08T11:42:41.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28698.779496 secs 2023-05-08T11:42:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28700.068565 secs 2023-05-08T11:42:41.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:41 smithi133 ceph-mon[125939]: pgmap v15362: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 713 KiB/s rd, 425 KiB/s wr, 13 op/s 2023-05-08T11:42:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28700.068565 secs 2023-05-08T11:42:42.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:41 smithi096 ceph-mon[124666]: pgmap v15362: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 713 KiB/s rd, 425 KiB/s wr, 13 op/s 2023-05-08T11:42:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28700.068565 secs 2023-05-08T11:42:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:41 smithi186 ceph-mon[126480]: pgmap v15362: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 713 KiB/s rd, 425 KiB/s wr, 13 op/s 2023-05-08T11:42:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:43 smithi133 ceph-mon[125939]: pgmap v15363: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 315 KiB/s wr, 7 op/s 2023-05-08T11:42:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:43 smithi096 ceph-mon[124666]: pgmap v15363: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 315 KiB/s wr, 7 op/s 2023-05-08T11:42:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:43 smithi186 ceph-mon[126480]: pgmap v15363: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 315 KiB/s wr, 7 op/s 2023-05-08T11:42:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28703.223784 secs 2023-05-08T11:42:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28703.223784 secs 2023-05-08T11:42:45.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28703.223784 secs 2023-05-08T11:42:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28703.779604 secs 2023-05-08T11:42:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:45 smithi133 ceph-mon[125939]: pgmap v15364: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 341 KiB/s wr, 11 op/s 2023-05-08T11:42:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28703.779604 secs 2023-05-08T11:42:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:45 smithi096 ceph-mon[124666]: pgmap v15364: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 341 KiB/s wr, 11 op/s 2023-05-08T11:42:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28703.779604 secs 2023-05-08T11:42:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:45 smithi186 ceph-mon[126480]: pgmap v15364: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 341 KiB/s wr, 11 op/s 2023-05-08T11:42:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:47 smithi133 ceph-mon[125939]: pgmap v15365: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 132 KiB/s wr, 6 op/s 2023-05-08T11:42:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:47 smithi096 ceph-mon[124666]: pgmap v15365: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 132 KiB/s wr, 6 op/s 2023-05-08T11:42:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:47 smithi186 ceph-mon[126480]: pgmap v15365: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 132 KiB/s wr, 6 op/s 2023-05-08T11:42:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:42:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:42:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:42:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28708.223897 secs 2023-05-08T11:42:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:49 smithi133 ceph-mon[125939]: pgmap v15366: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 132 KiB/s wr, 6 op/s 2023-05-08T11:42:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:42:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:42:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:42:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28708.223897 secs 2023-05-08T11:42:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:49 smithi096 ceph-mon[124666]: pgmap v15366: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 132 KiB/s wr, 6 op/s 2023-05-08T11:42:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:42:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:42:50.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:42:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28708.223897 secs 2023-05-08T11:42:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:49 smithi186 ceph-mon[126480]: pgmap v15366: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 132 KiB/s wr, 6 op/s 2023-05-08T11:42:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:42:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:42:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:42:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28708.779682 secs 2023-05-08T11:42:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28708.779682 secs 2023-05-08T11:42:51.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28708.779682 secs 2023-05-08T11:42:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:51 smithi133 ceph-mon[125939]: pgmap v15367: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 290 KiB/s rd, 210 KiB/s wr, 9 op/s 2023-05-08T11:42:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:51 smithi096 ceph-mon[124666]: pgmap v15367: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 290 KiB/s rd, 210 KiB/s wr, 9 op/s 2023-05-08T11:42:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:51 smithi186 ceph-mon[126480]: pgmap v15367: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 290 KiB/s rd, 210 KiB/s wr, 9 op/s 2023-05-08T11:42:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:53 smithi133 ceph-mon[125939]: pgmap v15368: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 288 KiB/s rd, 104 KiB/s wr, 6 op/s 2023-05-08T11:42:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:53 smithi096 ceph-mon[124666]: pgmap v15368: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 288 KiB/s rd, 104 KiB/s wr, 6 op/s 2023-05-08T11:42:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:53 smithi186 ceph-mon[126480]: pgmap v15368: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 288 KiB/s rd, 104 KiB/s wr, 6 op/s 2023-05-08T11:42:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28713.223977 secs 2023-05-08T11:42:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28713.223977 secs 2023-05-08T11:42:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28713.223977 secs 2023-05-08T11:42:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:55 smithi133 ceph-mon[125939]: pgmap v15369: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 723 KiB/s rd, 538 KiB/s wr, 10 op/s 2023-05-08T11:42:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:55 smithi096 ceph-mon[124666]: pgmap v15369: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 723 KiB/s rd, 538 KiB/s wr, 10 op/s 2023-05-08T11:42:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:55 smithi186 ceph-mon[126480]: pgmap v15369: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 723 KiB/s rd, 538 KiB/s wr, 10 op/s 2023-05-08T11:42:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:42:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:42:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:42:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:57 smithi133 ceph-mon[125939]: pgmap v15370: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 512 KiB/s wr, 7 op/s 2023-05-08T11:42:57.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:57 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:42:57.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:42:57.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:42:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:57 smithi096 ceph-mon[124666]: pgmap v15370: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 512 KiB/s wr, 7 op/s 2023-05-08T11:42:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:57 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:42:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:42:58.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:42:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:57 smithi186 ceph-mon[126480]: pgmap v15370: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 512 KiB/s wr, 7 op/s 2023-05-08T11:42:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:57 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:42:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:42:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:42:59.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28718.224040 secs 2023-05-08T11:43:00.021 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:42:59 smithi133 ceph-mon[125939]: pgmap v15371: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 512 KiB/s wr, 7 op/s 2023-05-08T11:43:00.022 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28718.224040 secs 2023-05-08T11:43:00.022 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:42:59 smithi096 ceph-mon[124666]: pgmap v15371: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 512 KiB/s wr, 7 op/s 2023-05-08T11:43:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28718.224040 secs 2023-05-08T11:43:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:42:59 smithi186 ceph-mon[126480]: pgmap v15371: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 512 KiB/s wr, 7 op/s 2023-05-08T11:43:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:01 smithi186 ceph-mon[126480]: pgmap v15372: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 951 KiB/s rd, 887 KiB/s wr, 13 op/s 2023-05-08T11:43:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:01 smithi133 ceph-mon[125939]: pgmap v15372: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 951 KiB/s rd, 887 KiB/s wr, 13 op/s 2023-05-08T11:43:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:01 smithi096 ceph-mon[124666]: pgmap v15372: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 951 KiB/s rd, 887 KiB/s wr, 13 op/s 2023-05-08T11:43:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:03 smithi133 ceph-mon[125939]: pgmap v15373: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 821 KiB/s rd, 809 KiB/s wr, 10 op/s 2023-05-08T11:43:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:03 smithi096 ceph-mon[124666]: pgmap v15373: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 821 KiB/s rd, 809 KiB/s wr, 10 op/s 2023-05-08T11:43:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:03 smithi186 ceph-mon[126480]: pgmap v15373: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 821 KiB/s rd, 809 KiB/s wr, 10 op/s 2023-05-08T11:43:04.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28723.224163 secs 2023-05-08T11:43:05.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28723.224163 secs 2023-05-08T11:43:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28723.224163 secs 2023-05-08T11:43:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28723.779930 secs 2023-05-08T11:43:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:05 smithi133 ceph-mon[125939]: pgmap v15374: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1006 KiB/s rd, 1007 KiB/s wr, 26 op/s 2023-05-08T11:43:05.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:05 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:43:05.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:43:05.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:43:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28723.779930 secs 2023-05-08T11:43:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:05 smithi096 ceph-mon[124666]: pgmap v15374: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1006 KiB/s rd, 1007 KiB/s wr, 26 op/s 2023-05-08T11:43:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:05 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:43:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:43:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:43:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28723.779930 secs 2023-05-08T11:43:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:05 smithi186 ceph-mon[126480]: pgmap v15374: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1006 KiB/s rd, 1007 KiB/s wr, 26 op/s 2023-05-08T11:43:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:05 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:43:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:43:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:43:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:07 smithi133 ceph-mon[125939]: pgmap v15375: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 572 KiB/s rd, 573 KiB/s wr, 22 op/s 2023-05-08T11:43:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:07 smithi096 ceph-mon[124666]: pgmap v15375: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 572 KiB/s rd, 573 KiB/s wr, 22 op/s 2023-05-08T11:43:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:07 smithi186 ceph-mon[126480]: pgmap v15375: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 572 KiB/s rd, 573 KiB/s wr, 22 op/s 2023-05-08T11:43:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28728.224273 secs 2023-05-08T11:43:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:09 smithi133 ceph-mon[125939]: pgmap v15376: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 572 KiB/s rd, 573 KiB/s wr, 22 op/s 2023-05-08T11:43:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28728.224273 secs 2023-05-08T11:43:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:09 smithi096 ceph-mon[124666]: pgmap v15376: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 572 KiB/s rd, 573 KiB/s wr, 22 op/s 2023-05-08T11:43:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28728.224273 secs 2023-05-08T11:43:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:09 smithi186 ceph-mon[126480]: pgmap v15376: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 572 KiB/s rd, 573 KiB/s wr, 22 op/s 2023-05-08T11:43:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28728.780066 secs 2023-05-08T11:43:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28728.780066 secs 2023-05-08T11:43:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28728.780066 secs 2023-05-08T11:43:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:11 smithi133 ceph-mon[125939]: pgmap v15377: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 574 KiB/s rd, 575 KiB/s wr, 26 op/s 2023-05-08T11:43:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:11 smithi096 ceph-mon[124666]: pgmap v15377: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 574 KiB/s rd, 575 KiB/s wr, 26 op/s 2023-05-08T11:43:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:11 smithi186 ceph-mon[126480]: pgmap v15377: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 574 KiB/s rd, 575 KiB/s wr, 26 op/s 2023-05-08T11:43:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:13 smithi133 ceph-mon[125939]: pgmap v15378: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 200 KiB/s wr, 20 op/s 2023-05-08T11:43:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:13 smithi096 ceph-mon[124666]: pgmap v15378: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 200 KiB/s wr, 20 op/s 2023-05-08T11:43:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:13 smithi186 ceph-mon[126480]: pgmap v15378: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 200 KiB/s wr, 20 op/s 2023-05-08T11:43:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28733.224368 secs 2023-05-08T11:43:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28733.224368 secs 2023-05-08T11:43:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28733.224368 secs 2023-05-08T11:43:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28733.780170 secs 2023-05-08T11:43:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:15 smithi133 ceph-mon[125939]: pgmap v15379: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 530 KiB/s wr, 24 op/s 2023-05-08T11:43:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28733.780170 secs 2023-05-08T11:43:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:15 smithi096 ceph-mon[124666]: pgmap v15379: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 530 KiB/s wr, 24 op/s 2023-05-08T11:43:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28733.780170 secs 2023-05-08T11:43:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:15 smithi186 ceph-mon[126480]: pgmap v15379: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 530 KiB/s wr, 24 op/s 2023-05-08T11:43:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:17 smithi133 ceph-mon[125939]: pgmap v15380: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 333 KiB/s rd, 331 KiB/s wr, 7 op/s 2023-05-08T11:43:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:17 smithi096 ceph-mon[124666]: pgmap v15380: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 333 KiB/s rd, 331 KiB/s wr, 7 op/s 2023-05-08T11:43:18.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:17 smithi186 ceph-mon[126480]: pgmap v15380: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 333 KiB/s rd, 331 KiB/s wr, 7 op/s 2023-05-08T11:43:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28738.224489 secs 2023-05-08T11:43:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:19 smithi133 ceph-mon[125939]: pgmap v15381: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 333 KiB/s rd, 331 KiB/s wr, 7 op/s 2023-05-08T11:43:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28738.224489 secs 2023-05-08T11:43:20.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:19 smithi096 ceph-mon[124666]: pgmap v15381: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 333 KiB/s rd, 331 KiB/s wr, 7 op/s 2023-05-08T11:43:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28738.224489 secs 2023-05-08T11:43:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:19 smithi186 ceph-mon[126480]: pgmap v15381: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 333 KiB/s rd, 331 KiB/s wr, 7 op/s 2023-05-08T11:43:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28738.780290 secs 2023-05-08T11:43:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:20 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:43:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28738.780290 secs 2023-05-08T11:43:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:20 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:43:21.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28738.780290 secs 2023-05-08T11:43:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:20 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:43:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:21 smithi133 ceph-mon[125939]: pgmap v15382: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 331 KiB/s wr, 10 op/s 2023-05-08T11:43:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:21 smithi096 ceph-mon[124666]: pgmap v15382: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 331 KiB/s wr, 10 op/s 2023-05-08T11:43:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:21 smithi186 ceph-mon[126480]: pgmap v15382: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 331 KiB/s wr, 10 op/s 2023-05-08T11:43:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:24 smithi133 ceph-mon[125939]: pgmap v15383: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 330 KiB/s wr, 7 op/s 2023-05-08T11:43:24.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:43:24.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:43:24.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:43:24.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:43:24.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:43:24.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:43:24.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:43:24.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:43:24.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:43:24.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:43:24.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:43:24.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:43:24.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:43:24.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:43:24.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:43:24.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:43:24.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:43:24.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:43:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:24 smithi096 ceph-mon[124666]: pgmap v15383: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 330 KiB/s wr, 7 op/s 2023-05-08T11:43:24.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:43:24.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:43:24.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:43:24.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:43:24.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:43:24.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:43:24.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:43:24.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:43:24.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:43:24.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:43:24.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:43:24.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:43:24.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:43:24.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:43:24.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:43:24.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:43:24.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:43:24.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:43:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:24 smithi186 ceph-mon[126480]: pgmap v15383: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 330 KiB/s wr, 7 op/s 2023-05-08T11:43:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:43:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:43:24.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:43:24.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:43:24.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:43:24.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:43:24.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:43:24.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:43:24.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:43:24.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:43:24.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:43:24.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:43:24.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:43:24.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:43:24.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:43:24.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:43:24.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:43:24.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:43:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28743.224565 secs 2023-05-08T11:43:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:25 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi133 to 170.1M 2023-05-08T11:43:25.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:25 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi133 to 178372005: error parsing value: Value '178372005' is below minimum 939524096 2023-05-08T11:43:25.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:25 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi186 to 161.1M 2023-05-08T11:43:25.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:25 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi186 to 168993968: error parsing value: Value '168993968' is below minimum 939524096 2023-05-08T11:43:25.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:25 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:43:25.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:25 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T11:43:25.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:25 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T11:43:25.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:25 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:43:25.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:25 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:43:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28743.224565 secs 2023-05-08T11:43:25.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:25 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi133 to 170.1M 2023-05-08T11:43:25.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:25 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi133 to 178372005: error parsing value: Value '178372005' is below minimum 939524096 2023-05-08T11:43:25.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:25 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi186 to 161.1M 2023-05-08T11:43:25.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:25 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi186 to 168993968: error parsing value: Value '168993968' is below minimum 939524096 2023-05-08T11:43:25.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:25 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:43:25.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:25 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T11:43:25.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:25 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T11:43:25.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:25 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:43:25.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:25 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:43:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28743.224565 secs 2023-05-08T11:43:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:25 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi133 to 170.1M 2023-05-08T11:43:25.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:25 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi133 to 178372005: error parsing value: Value '178372005' is below minimum 939524096 2023-05-08T11:43:25.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:25 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi186 to 161.1M 2023-05-08T11:43:25.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:25 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi186 to 168993968: error parsing value: Value '168993968' is below minimum 939524096 2023-05-08T11:43:25.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:25 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:43:25.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:25 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T11:43:25.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:25 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T11:43:25.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:25 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:43:25.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:25 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:43:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:26 smithi133 ceph-mon[125939]: pgmap v15384: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 689 KiB/s rd, 707 KiB/s wr, 13 op/s 2023-05-08T11:43:26.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:26 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:43:26.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:26 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:43:26.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:26 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:43:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:26 smithi096 ceph-mon[124666]: pgmap v15384: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 689 KiB/s rd, 707 KiB/s wr, 13 op/s 2023-05-08T11:43:26.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:26 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:43:26.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:26 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:43:26.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:26 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:43:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:26 smithi186 ceph-mon[126480]: pgmap v15384: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 689 KiB/s rd, 707 KiB/s wr, 13 op/s 2023-05-08T11:43:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:26 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:43:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:26 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:43:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:26 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:43:28.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:28 smithi133 ceph-mon[125939]: pgmap v15385: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 378 KiB/s wr, 10 op/s 2023-05-08T11:43:28.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:28 smithi096 ceph-mon[124666]: pgmap v15385: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 378 KiB/s wr, 10 op/s 2023-05-08T11:43:28.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:28 smithi186 ceph-mon[126480]: pgmap v15385: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 378 KiB/s wr, 10 op/s 2023-05-08T11:43:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28748.224684 secs 2023-05-08T11:43:30.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:30 smithi133 ceph-mon[125939]: pgmap v15386: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 377 KiB/s wr, 9 op/s 2023-05-08T11:43:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28748.224684 secs 2023-05-08T11:43:30.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:30 smithi096 ceph-mon[124666]: pgmap v15386: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 377 KiB/s wr, 9 op/s 2023-05-08T11:43:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28748.224684 secs 2023-05-08T11:43:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:30 smithi186 ceph-mon[126480]: pgmap v15386: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 377 KiB/s wr, 9 op/s 2023-05-08T11:43:32.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:32 smithi133 ceph-mon[125939]: pgmap v15387: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 430 KiB/s wr, 13 op/s 2023-05-08T11:43:32.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:32 smithi133 ceph-mon[125939]: osdmap e1038: 12 total, 12 up, 12 in 2023-05-08T11:43:32.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:32 smithi096 ceph-mon[124666]: pgmap v15387: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 430 KiB/s wr, 13 op/s 2023-05-08T11:43:32.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:32 smithi096 ceph-mon[124666]: osdmap e1038: 12 total, 12 up, 12 in 2023-05-08T11:43:32.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:32 smithi186 ceph-mon[126480]: pgmap v15387: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 430 KiB/s wr, 13 op/s 2023-05-08T11:43:32.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:32 smithi186 ceph-mon[126480]: osdmap e1038: 12 total, 12 up, 12 in 2023-05-08T11:43:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:34 smithi133 ceph-mon[125939]: pgmap v15389: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 512 KiB/s rd, 516 KiB/s wr, 12 op/s 2023-05-08T11:43:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:34 smithi096 ceph-mon[124666]: pgmap v15389: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 512 KiB/s rd, 516 KiB/s wr, 12 op/s 2023-05-08T11:43:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:34 smithi186 ceph-mon[126480]: pgmap v15389: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 512 KiB/s rd, 516 KiB/s wr, 12 op/s 2023-05-08T11:43:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28753.224804 secs 2023-05-08T11:43:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28753.224804 secs 2023-05-08T11:43:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28753.224804 secs 2023-05-08T11:43:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:36 smithi133 ceph-mon[125939]: pgmap v15390: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 397 KiB/s wr, 9 op/s 2023-05-08T11:43:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:36 smithi096 ceph-mon[124666]: pgmap v15390: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 397 KiB/s wr, 9 op/s 2023-05-08T11:43:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:36 smithi186 ceph-mon[126480]: pgmap v15390: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 397 KiB/s wr, 9 op/s 2023-05-08T11:43:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:38 smithi133 ceph-mon[125939]: pgmap v15391: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 397 KiB/s wr, 9 op/s 2023-05-08T11:43:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:38 smithi096 ceph-mon[124666]: pgmap v15391: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 397 KiB/s wr, 9 op/s 2023-05-08T11:43:38.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:38 smithi186 ceph-mon[126480]: pgmap v15391: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 397 KiB/s wr, 9 op/s 2023-05-08T11:43:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28758.224956 secs 2023-05-08T11:43:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:40 smithi133 ceph-mon[125939]: pgmap v15392: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 397 KiB/s wr, 9 op/s 2023-05-08T11:43:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28758.224956 secs 2023-05-08T11:43:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:40 smithi096 ceph-mon[124666]: pgmap v15392: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 397 KiB/s wr, 9 op/s 2023-05-08T11:43:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28758.224956 secs 2023-05-08T11:43:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:40 smithi186 ceph-mon[126480]: pgmap v15392: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 397 KiB/s wr, 9 op/s 2023-05-08T11:43:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28760.070124 secs 2023-05-08T11:43:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:41 smithi186 ceph-mon[126480]: osdmap e1039: 12 total, 12 up, 12 in 2023-05-08T11:43:41.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:41 smithi186 ceph-mon[126480]: pgmap v15394: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 790 KiB/s rd, 437 KiB/s wr, 10 op/s 2023-05-08T11:43:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28760.070124 secs 2023-05-08T11:43:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:41 smithi133 ceph-mon[125939]: osdmap e1039: 12 total, 12 up, 12 in 2023-05-08T11:43:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:41 smithi133 ceph-mon[125939]: pgmap v15394: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 790 KiB/s rd, 437 KiB/s wr, 10 op/s 2023-05-08T11:43:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28760.070124 secs 2023-05-08T11:43:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:41 smithi096 ceph-mon[124666]: osdmap e1039: 12 total, 12 up, 12 in 2023-05-08T11:43:42.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:41 smithi096 ceph-mon[124666]: pgmap v15394: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 790 KiB/s rd, 437 KiB/s wr, 10 op/s 2023-05-08T11:43:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:43 smithi133 ceph-mon[125939]: pgmap v15395: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 747 KiB/s rd, 413 KiB/s wr, 10 op/s 2023-05-08T11:43:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:43 smithi096 ceph-mon[124666]: pgmap v15395: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 747 KiB/s rd, 413 KiB/s wr, 10 op/s 2023-05-08T11:43:44.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:43 smithi186 ceph-mon[126480]: pgmap v15395: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 747 KiB/s rd, 413 KiB/s wr, 10 op/s 2023-05-08T11:43:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28763.225072 secs 2023-05-08T11:43:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28763.225072 secs 2023-05-08T11:43:45.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28763.225072 secs 2023-05-08T11:43:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28763.780887 secs 2023-05-08T11:43:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:45 smithi133 ceph-mon[125939]: pgmap v15396: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T11:43:45.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:45 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:43:45.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:45 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:43:45.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:45 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:43:45.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:45 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:43:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28763.780887 secs 2023-05-08T11:43:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:45 smithi096 ceph-mon[124666]: pgmap v15396: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T11:43:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:45 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:43:46.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:45 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:43:46.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:45 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:43:46.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:45 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:43:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28763.780887 secs 2023-05-08T11:43:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:45 smithi186 ceph-mon[126480]: pgmap v15396: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T11:43:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:45 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:43:46.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:45 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:43:46.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:45 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:43:46.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:45 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:43:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:47 smithi133 ceph-mon[125939]: pgmap v15397: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T11:43:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:47 smithi096 ceph-mon[124666]: pgmap v15397: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T11:43:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:47 smithi186 ceph-mon[126480]: pgmap v15397: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T11:43:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:43:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:43:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:43:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28768.225164 secs 2023-05-08T11:43:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:49 smithi133 ceph-mon[125939]: pgmap v15398: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T11:43:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:43:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:43:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28768.225164 secs 2023-05-08T11:43:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:49 smithi096 ceph-mon[124666]: pgmap v15398: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T11:43:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:43:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:43:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28768.225164 secs 2023-05-08T11:43:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:49 smithi186 ceph-mon[126480]: pgmap v15398: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T11:43:50.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:43:50.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:43:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:43:51.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:43:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:43:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:51 smithi133 ceph-mon[125939]: pgmap v15399: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 14 op/s 2023-05-08T11:43:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:51 smithi096 ceph-mon[124666]: pgmap v15399: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 14 op/s 2023-05-08T11:43:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:51 smithi186 ceph-mon[126480]: pgmap v15399: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 14 op/s 2023-05-08T11:43:52.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:43:53.082 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:43:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:43:53.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:53 smithi133 ceph-mon[125939]: pgmap v15400: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2023-05-08T11:43:53.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:43:53.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:43:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:53 smithi096 ceph-mon[124666]: pgmap v15400: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2023-05-08T11:43:54.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:43:54.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:43:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:53 smithi186 ceph-mon[126480]: pgmap v15400: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2023-05-08T11:43:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:43:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:43:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28773.225303 secs 2023-05-08T11:43:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28773.225303 secs 2023-05-08T11:43:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28773.225303 secs 2023-05-08T11:43:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28773.781143 secs 2023-05-08T11:43:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:55 smithi133 ceph-mon[125939]: pgmap v15401: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 17 op/s 2023-05-08T11:43:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:55 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:43:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28773.781143 secs 2023-05-08T11:43:56.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:55 smithi096 ceph-mon[124666]: pgmap v15401: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 17 op/s 2023-05-08T11:43:56.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:55 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:43:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28773.781143 secs 2023-05-08T11:43:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:55 smithi186 ceph-mon[126480]: pgmap v15401: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 17 op/s 2023-05-08T11:43:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:55 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:43:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:57 smithi133 ceph-mon[125939]: pgmap v15402: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 917 KiB/s rd, 854 KiB/s wr, 11 op/s 2023-05-08T11:43:57.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:43:57.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:43:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:57 smithi096 ceph-mon[124666]: pgmap v15402: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 917 KiB/s rd, 854 KiB/s wr, 11 op/s 2023-05-08T11:43:58.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:43:58.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:43:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:57 smithi186 ceph-mon[126480]: pgmap v15402: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 917 KiB/s rd, 854 KiB/s wr, 11 op/s 2023-05-08T11:43:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:43:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:43:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28778.225419 secs 2023-05-08T11:43:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:43:59 smithi133 ceph-mon[125939]: pgmap v15403: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 917 KiB/s rd, 854 KiB/s wr, 11 op/s 2023-05-08T11:44:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28778.225419 secs 2023-05-08T11:44:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:43:59 smithi096 ceph-mon[124666]: pgmap v15403: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 917 KiB/s rd, 854 KiB/s wr, 11 op/s 2023-05-08T11:44:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28778.225419 secs 2023-05-08T11:44:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:43:59 smithi186 ceph-mon[126480]: pgmap v15403: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 917 KiB/s rd, 854 KiB/s wr, 11 op/s 2023-05-08T11:44:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:00 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:44:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:00 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:44:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:00 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:44:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:00 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:44:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:00 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:44:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:00 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:44:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28780.070576 secs 2023-05-08T11:44:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:01 smithi133 ceph-mon[125939]: pgmap v15404: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 17 op/s 2023-05-08T11:44:01.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:44:01.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:44:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28780.070576 secs 2023-05-08T11:44:02.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:01 smithi096 ceph-mon[124666]: pgmap v15404: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 17 op/s 2023-05-08T11:44:02.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:44:02.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:44:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28780.070576 secs 2023-05-08T11:44:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:01 smithi186 ceph-mon[126480]: pgmap v15404: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 17 op/s 2023-05-08T11:44:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:44:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:44:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:03 smithi133 ceph-mon[125939]: pgmap v15405: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T11:44:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:03 smithi096 ceph-mon[124666]: pgmap v15405: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T11:44:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:03 smithi186 ceph-mon[126480]: pgmap v15405: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T11:44:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28783.225531 secs 2023-05-08T11:44:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28783.225531 secs 2023-05-08T11:44:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28783.225531 secs 2023-05-08T11:44:06.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28783.781392 secs 2023-05-08T11:44:06.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:05 smithi096 ceph-mon[124666]: pgmap v15406: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 28 op/s 2023-05-08T11:44:06.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:44:06.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:44:06.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:44:06.009 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:05 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:44:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28783.781392 secs 2023-05-08T11:44:06.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:05 smithi186 ceph-mon[126480]: pgmap v15406: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 28 op/s 2023-05-08T11:44:06.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:44:06.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:44:06.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:44:06.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:05 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:44:06.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28783.781392 secs 2023-05-08T11:44:06.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:05 smithi133 ceph-mon[125939]: pgmap v15406: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 28 op/s 2023-05-08T11:44:06.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:44:06.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:44:06.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:44:06.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:05 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:44:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28785.070697 secs 2023-05-08T11:44:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:06 smithi186 ceph-mon[126480]: osdmap e1040: 12 total, 12 up, 12 in 2023-05-08T11:44:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28785.070697 secs 2023-05-08T11:44:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:06 smithi133 ceph-mon[125939]: osdmap e1040: 12 total, 12 up, 12 in 2023-05-08T11:44:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28785.070697 secs 2023-05-08T11:44:07.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:06 smithi096 ceph-mon[124666]: osdmap e1040: 12 total, 12 up, 12 in 2023-05-08T11:44:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:07 smithi186 ceph-mon[126480]: pgmap v15408: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 30 op/s 2023-05-08T11:44:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:07 smithi133 ceph-mon[125939]: pgmap v15408: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 30 op/s 2023-05-08T11:44:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:07 smithi096 ceph-mon[124666]: pgmap v15408: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 30 op/s 2023-05-08T11:44:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28788.225650 secs 2023-05-08T11:44:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:09 smithi186 ceph-mon[126480]: pgmap v15409: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 30 op/s 2023-05-08T11:44:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28788.225650 secs 2023-05-08T11:44:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:09 smithi133 ceph-mon[125939]: pgmap v15409: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 30 op/s 2023-05-08T11:44:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28788.225650 secs 2023-05-08T11:44:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:09 smithi096 ceph-mon[124666]: pgmap v15409: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 30 op/s 2023-05-08T11:44:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28788.781530 secs 2023-05-08T11:44:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28788.781530 secs 2023-05-08T11:44:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28788.781530 secs 2023-05-08T11:44:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28790.070831 secs 2023-05-08T11:44:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:11 smithi186 ceph-mon[126480]: pgmap v15410: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 456 KiB/s rd, 474 KiB/s wr, 26 op/s 2023-05-08T11:44:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28790.070831 secs 2023-05-08T11:44:12.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:11 smithi133 ceph-mon[125939]: pgmap v15410: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 456 KiB/s rd, 474 KiB/s wr, 26 op/s 2023-05-08T11:44:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28790.070831 secs 2023-05-08T11:44:12.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:11 smithi096 ceph-mon[124666]: pgmap v15410: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 456 KiB/s rd, 474 KiB/s wr, 26 op/s 2023-05-08T11:44:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:13 smithi186 ceph-mon[126480]: pgmap v15411: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 456 KiB/s rd, 474 KiB/s wr, 26 op/s 2023-05-08T11:44:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:13 smithi133 ceph-mon[125939]: pgmap v15411: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 456 KiB/s rd, 474 KiB/s wr, 26 op/s 2023-05-08T11:44:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:13 smithi096 ceph-mon[124666]: pgmap v15411: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 456 KiB/s rd, 474 KiB/s wr, 26 op/s 2023-05-08T11:44:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28793.225787 secs 2023-05-08T11:44:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28793.225787 secs 2023-05-08T11:44:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28793.225787 secs 2023-05-08T11:44:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28793.781625 secs 2023-05-08T11:44:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:15 smithi186 ceph-mon[126480]: pgmap v15412: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 400 KiB/s wr, 8 op/s 2023-05-08T11:44:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:15 smithi186 ceph-mon[126480]: osdmap e1041: 12 total, 12 up, 12 in 2023-05-08T11:44:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28793.781625 secs 2023-05-08T11:44:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:15 smithi133 ceph-mon[125939]: pgmap v15412: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 400 KiB/s wr, 8 op/s 2023-05-08T11:44:16.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:15 smithi133 ceph-mon[125939]: osdmap e1041: 12 total, 12 up, 12 in 2023-05-08T11:44:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28793.781625 secs 2023-05-08T11:44:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:15 smithi096 ceph-mon[124666]: pgmap v15412: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 400 KiB/s wr, 8 op/s 2023-05-08T11:44:16.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:15 smithi096 ceph-mon[124666]: osdmap e1041: 12 total, 12 up, 12 in 2023-05-08T11:44:17.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28795.070897 secs 2023-05-08T11:44:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28795.070897 secs 2023-05-08T11:44:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28795.070897 secs 2023-05-08T11:44:18.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:17 smithi186 ceph-mon[126480]: pgmap v15414: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 7.5 KiB/s wr, 7 op/s 2023-05-08T11:44:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:17 smithi133 ceph-mon[125939]: pgmap v15414: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 7.5 KiB/s wr, 7 op/s 2023-05-08T11:44:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:17 smithi096 ceph-mon[124666]: pgmap v15414: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 7.5 KiB/s wr, 7 op/s 2023-05-08T11:44:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28798.225921 secs 2023-05-08T11:44:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:19 smithi186 ceph-mon[126480]: pgmap v15415: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 7.5 KiB/s wr, 7 op/s 2023-05-08T11:44:20.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28798.225921 secs 2023-05-08T11:44:20.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:19 smithi133 ceph-mon[125939]: pgmap v15415: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 7.5 KiB/s wr, 7 op/s 2023-05-08T11:44:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28798.225921 secs 2023-05-08T11:44:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:19 smithi096 ceph-mon[124666]: pgmap v15415: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 7.5 KiB/s wr, 7 op/s 2023-05-08T11:44:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28798.781741 secs 2023-05-08T11:44:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28798.781741 secs 2023-05-08T11:44:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28798.781741 secs 2023-05-08T11:44:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28800.071016 secs 2023-05-08T11:44:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:21 smithi186 ceph-mon[126480]: pgmap v15416: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 377 KiB/s wr, 8 op/s 2023-05-08T11:44:22.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28800.071016 secs 2023-05-08T11:44:22.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:21 smithi133 ceph-mon[125939]: pgmap v15416: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 377 KiB/s wr, 8 op/s 2023-05-08T11:44:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28800.071016 secs 2023-05-08T11:44:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:21 smithi096 ceph-mon[124666]: pgmap v15416: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 377 KiB/s wr, 8 op/s 2023-05-08T11:44:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:23 smithi186 ceph-mon[126480]: pgmap v15417: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 377 KiB/s wr, 8 op/s 2023-05-08T11:44:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:23 smithi133 ceph-mon[125939]: pgmap v15417: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 377 KiB/s wr, 8 op/s 2023-05-08T11:44:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:23 smithi096 ceph-mon[124666]: pgmap v15417: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 377 KiB/s wr, 8 op/s 2023-05-08T11:44:25.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28803.226018 secs 2023-05-08T11:44:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:44:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:44:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:44:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:44:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28803.226018 secs 2023-05-08T11:44:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:44:25.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:44:25.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:44:25.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:44:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28803.226018 secs 2023-05-08T11:44:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:44:25.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:44:25.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:44:25.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:44:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28803.781826 secs 2023-05-08T11:44:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:25 smithi186 ceph-mon[126480]: pgmap v15418: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 379 KiB/s rd, 399 KiB/s wr, 9 op/s 2023-05-08T11:44:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:25 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:44:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:25 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T11:44:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:25 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T11:44:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:25 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:44:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28803.781826 secs 2023-05-08T11:44:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:25 smithi133 ceph-mon[125939]: pgmap v15418: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 379 KiB/s rd, 399 KiB/s wr, 9 op/s 2023-05-08T11:44:26.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:25 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:44:26.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:25 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T11:44:26.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:25 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T11:44:26.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:25 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:44:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28803.781826 secs 2023-05-08T11:44:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:25 smithi096 ceph-mon[124666]: pgmap v15418: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 379 KiB/s rd, 399 KiB/s wr, 9 op/s 2023-05-08T11:44:26.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:25 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:44:26.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:25 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T11:44:26.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:25 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T11:44:26.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:25 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:44:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28805.071106 secs 2023-05-08T11:44:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28805.071106 secs 2023-05-08T11:44:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28805.071106 secs 2023-05-08T11:44:28.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:27 smithi186 ceph-mon[126480]: pgmap v15419: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 354 KiB/s wr, 8 op/s 2023-05-08T11:44:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:27 smithi133 ceph-mon[125939]: pgmap v15419: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 354 KiB/s wr, 8 op/s 2023-05-08T11:44:28.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:27 smithi096 ceph-mon[124666]: pgmap v15419: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 354 KiB/s wr, 8 op/s 2023-05-08T11:44:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28808.226154 secs 2023-05-08T11:44:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:29 smithi186 ceph-mon[126480]: pgmap v15420: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 327 KiB/s wr, 7 op/s 2023-05-08T11:44:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28808.226154 secs 2023-05-08T11:44:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:29 smithi133 ceph-mon[125939]: pgmap v15420: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 327 KiB/s wr, 7 op/s 2023-05-08T11:44:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28808.226154 secs 2023-05-08T11:44:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:29 smithi096 ceph-mon[124666]: pgmap v15420: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 327 KiB/s wr, 7 op/s 2023-05-08T11:44:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28808.781941 secs 2023-05-08T11:44:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28808.781941 secs 2023-05-08T11:44:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28808.781941 secs 2023-05-08T11:44:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28810.071204 secs 2023-05-08T11:44:32.211 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:31 smithi186 ceph-mon[126480]: pgmap v15421: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 434 KiB/s wr, 11 op/s 2023-05-08T11:44:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28810.071204 secs 2023-05-08T11:44:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:31 smithi133 ceph-mon[125939]: pgmap v15421: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 434 KiB/s wr, 11 op/s 2023-05-08T11:44:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28810.071204 secs 2023-05-08T11:44:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:31 smithi096 ceph-mon[124666]: pgmap v15421: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 434 KiB/s wr, 11 op/s 2023-05-08T11:44:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:33 smithi186 ceph-mon[126480]: pgmap v15422: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 126 KiB/s wr, 7 op/s 2023-05-08T11:44:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:33 smithi133 ceph-mon[125939]: pgmap v15422: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 126 KiB/s wr, 7 op/s 2023-05-08T11:44:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:33 smithi096 ceph-mon[124666]: pgmap v15422: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 126 KiB/s wr, 7 op/s 2023-05-08T11:44:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28813.226218 secs 2023-05-08T11:44:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28813.226218 secs 2023-05-08T11:44:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28813.226218 secs 2023-05-08T11:44:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28813.782064 secs 2023-05-08T11:44:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:35 smithi186 ceph-mon[126480]: pgmap v15423: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 126 KiB/s wr, 10 op/s 2023-05-08T11:44:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28813.782064 secs 2023-05-08T11:44:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:35 smithi133 ceph-mon[125939]: pgmap v15423: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 126 KiB/s wr, 10 op/s 2023-05-08T11:44:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28813.782064 secs 2023-05-08T11:44:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:35 smithi096 ceph-mon[124666]: pgmap v15423: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 126 KiB/s wr, 10 op/s 2023-05-08T11:44:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28815.071344 secs 2023-05-08T11:44:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28815.071344 secs 2023-05-08T11:44:37.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28815.071344 secs 2023-05-08T11:44:38.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:37 smithi186 ceph-mon[126480]: pgmap v15424: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 107 KiB/s wr, 6 op/s 2023-05-08T11:44:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:37 smithi133 ceph-mon[125939]: pgmap v15424: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 107 KiB/s wr, 6 op/s 2023-05-08T11:44:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:37 smithi096 ceph-mon[124666]: pgmap v15424: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 107 KiB/s wr, 6 op/s 2023-05-08T11:44:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28818.226367 secs 2023-05-08T11:44:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:39 smithi186 ceph-mon[126480]: pgmap v15425: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 107 KiB/s wr, 6 op/s 2023-05-08T11:44:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28818.226367 secs 2023-05-08T11:44:40.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:39 smithi133 ceph-mon[125939]: pgmap v15425: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 107 KiB/s wr, 6 op/s 2023-05-08T11:44:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28818.226367 secs 2023-05-08T11:44:40.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:39 smithi096 ceph-mon[124666]: pgmap v15425: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 107 KiB/s wr, 6 op/s 2023-05-08T11:44:41.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28818.782211 secs 2023-05-08T11:44:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28818.782211 secs 2023-05-08T11:44:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28818.782211 secs 2023-05-08T11:44:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28820.071410 secs 2023-05-08T11:44:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:41 smithi186 ceph-mon[126480]: pgmap v15426: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 108 KiB/s wr, 10 op/s 2023-05-08T11:44:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28820.071410 secs 2023-05-08T11:44:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:41 smithi133 ceph-mon[125939]: pgmap v15426: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 108 KiB/s wr, 10 op/s 2023-05-08T11:44:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28820.071410 secs 2023-05-08T11:44:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:41 smithi096 ceph-mon[124666]: pgmap v15426: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 108 KiB/s wr, 10 op/s 2023-05-08T11:44:44.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:43 smithi186 ceph-mon[126480]: pgmap v15427: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T11:44:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:43 smithi133 ceph-mon[125939]: pgmap v15427: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T11:44:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:43 smithi096 ceph-mon[124666]: pgmap v15427: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T11:44:45.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28823.226485 secs 2023-05-08T11:44:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28823.226485 secs 2023-05-08T11:44:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28823.226485 secs 2023-05-08T11:44:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28823.782361 secs 2023-05-08T11:44:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:45 smithi186 ceph-mon[126480]: pgmap v15428: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 288 KiB/s wr, 11 op/s 2023-05-08T11:44:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28823.782361 secs 2023-05-08T11:44:46.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:45 smithi133 ceph-mon[125939]: pgmap v15428: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 288 KiB/s wr, 11 op/s 2023-05-08T11:44:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28823.782361 secs 2023-05-08T11:44:46.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:45 smithi096 ceph-mon[124666]: pgmap v15428: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 288 KiB/s wr, 11 op/s 2023-05-08T11:44:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:47 smithi186 ceph-mon[126480]: pgmap v15429: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 287 KiB/s wr, 7 op/s 2023-05-08T11:44:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:47 smithi133 ceph-mon[125939]: pgmap v15429: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 287 KiB/s wr, 7 op/s 2023-05-08T11:44:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:47 smithi096 ceph-mon[124666]: pgmap v15429: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 287 KiB/s wr, 7 op/s 2023-05-08T11:44:49.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:44:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:44:49.310 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:44:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28828.226564 secs 2023-05-08T11:44:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:49 smithi186 ceph-mon[126480]: pgmap v15430: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 287 KiB/s wr, 7 op/s 2023-05-08T11:44:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:44:50.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:44:50.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:44:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28828.226564 secs 2023-05-08T11:44:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:49 smithi133 ceph-mon[125939]: pgmap v15430: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 287 KiB/s wr, 7 op/s 2023-05-08T11:44:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:44:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:44:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:44:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28828.226564 secs 2023-05-08T11:44:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:49 smithi096 ceph-mon[124666]: pgmap v15430: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 287 KiB/s wr, 7 op/s 2023-05-08T11:44:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:44:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:44:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:44:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28828.782499 secs 2023-05-08T11:44:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28828.782499 secs 2023-05-08T11:44:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28828.782499 secs 2023-05-08T11:44:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:51 smithi186 ceph-mon[126480]: pgmap v15431: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 841 KiB/s wr, 12 op/s 2023-05-08T11:44:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:51 smithi133 ceph-mon[125939]: pgmap v15431: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 841 KiB/s wr, 12 op/s 2023-05-08T11:44:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:51 smithi096 ceph-mon[124666]: pgmap v15431: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 841 KiB/s wr, 12 op/s 2023-05-08T11:44:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:53 smithi186 ceph-mon[126480]: pgmap v15432: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 841 KiB/s wr, 8 op/s 2023-05-08T11:44:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:53 smithi133 ceph-mon[125939]: pgmap v15432: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 841 KiB/s wr, 8 op/s 2023-05-08T11:44:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:53 smithi096 ceph-mon[124666]: pgmap v15432: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 841 KiB/s wr, 8 op/s 2023-05-08T11:44:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28833.226679 secs 2023-05-08T11:44:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28833.226679 secs 2023-05-08T11:44:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28833.226679 secs 2023-05-08T11:44:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:55 smithi186 ceph-mon[126480]: pgmap v15433: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 859 KiB/s wr, 12 op/s 2023-05-08T11:44:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:55 smithi133 ceph-mon[125939]: pgmap v15433: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 859 KiB/s wr, 12 op/s 2023-05-08T11:44:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:55 smithi096 ceph-mon[124666]: pgmap v15433: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 859 KiB/s wr, 12 op/s 2023-05-08T11:44:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:44:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:44:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:44:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:57 smithi133 ceph-mon[125939]: pgmap v15434: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 695 KiB/s wr, 9 op/s 2023-05-08T11:44:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:57 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:44:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:44:58.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:44:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:57 smithi096 ceph-mon[124666]: pgmap v15434: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 695 KiB/s wr, 9 op/s 2023-05-08T11:44:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:57 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:44:58.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:44:58.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:44:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:57 smithi186 ceph-mon[126480]: pgmap v15434: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 695 KiB/s wr, 9 op/s 2023-05-08T11:44:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:57 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:44:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:44:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:45:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28838.226792 secs 2023-05-08T11:45:00.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:44:59 smithi133 ceph-mon[125939]: pgmap v15435: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 695 KiB/s wr, 9 op/s 2023-05-08T11:45:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28838.226792 secs 2023-05-08T11:45:00.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:44:59 smithi096 ceph-mon[124666]: pgmap v15435: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 695 KiB/s wr, 9 op/s 2023-05-08T11:45:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28838.226792 secs 2023-05-08T11:45:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:44:59 smithi186 ceph-mon[126480]: pgmap v15435: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 695 KiB/s wr, 9 op/s 2023-05-08T11:45:01.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:01 smithi186 ceph-mon[126480]: pgmap v15436: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 950 KiB/s wr, 14 op/s 2023-05-08T11:45:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:01 smithi133 ceph-mon[125939]: pgmap v15436: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 950 KiB/s wr, 14 op/s 2023-05-08T11:45:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:01 smithi096 ceph-mon[124666]: pgmap v15436: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 950 KiB/s wr, 14 op/s 2023-05-08T11:45:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:03 smithi133 ceph-mon[125939]: pgmap v15437: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 824 KiB/s rd, 396 KiB/s wr, 9 op/s 2023-05-08T11:45:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:03 smithi096 ceph-mon[124666]: pgmap v15437: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 824 KiB/s rd, 396 KiB/s wr, 9 op/s 2023-05-08T11:45:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:03 smithi186 ceph-mon[126480]: pgmap v15437: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 824 KiB/s rd, 396 KiB/s wr, 9 op/s 2023-05-08T11:45:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28843.226907 secs 2023-05-08T11:45:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28843.226907 secs 2023-05-08T11:45:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28843.226907 secs 2023-05-08T11:45:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28843.782795 secs 2023-05-08T11:45:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:05 smithi133 ceph-mon[125939]: pgmap v15438: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 702 KiB/s wr, 27 op/s 2023-05-08T11:45:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:05 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:45:05.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:45:05.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:45:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28843.782795 secs 2023-05-08T11:45:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:05 smithi096 ceph-mon[124666]: pgmap v15438: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 702 KiB/s wr, 27 op/s 2023-05-08T11:45:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:05 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:45:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:45:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:45:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28843.782795 secs 2023-05-08T11:45:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:05 smithi186 ceph-mon[126480]: pgmap v15438: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 702 KiB/s wr, 27 op/s 2023-05-08T11:45:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:05 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:45:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:45:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:45:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:07 smithi133 ceph-mon[125939]: pgmap v15439: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 894 KiB/s rd, 684 KiB/s wr, 23 op/s 2023-05-08T11:45:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:07 smithi096 ceph-mon[124666]: pgmap v15439: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 894 KiB/s rd, 684 KiB/s wr, 23 op/s 2023-05-08T11:45:08.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:07 smithi186 ceph-mon[126480]: pgmap v15439: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 894 KiB/s rd, 684 KiB/s wr, 23 op/s 2023-05-08T11:45:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28848.227056 secs 2023-05-08T11:45:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:09 smithi133 ceph-mon[125939]: pgmap v15440: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 682 KiB/s rd, 561 KiB/s wr, 22 op/s 2023-05-08T11:45:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28848.227056 secs 2023-05-08T11:45:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:09 smithi096 ceph-mon[124666]: pgmap v15440: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 682 KiB/s rd, 561 KiB/s wr, 22 op/s 2023-05-08T11:45:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28848.227056 secs 2023-05-08T11:45:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:09 smithi186 ceph-mon[126480]: pgmap v15440: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 682 KiB/s rd, 561 KiB/s wr, 22 op/s 2023-05-08T11:45:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28848.782940 secs 2023-05-08T11:45:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28848.782940 secs 2023-05-08T11:45:11.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28848.782940 secs 2023-05-08T11:45:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:11 smithi133 ceph-mon[125939]: pgmap v15441: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 684 KiB/s rd, 562 KiB/s wr, 26 op/s 2023-05-08T11:45:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:11 smithi096 ceph-mon[124666]: pgmap v15441: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 684 KiB/s rd, 562 KiB/s wr, 26 op/s 2023-05-08T11:45:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:11 smithi186 ceph-mon[126480]: pgmap v15441: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 684 KiB/s rd, 562 KiB/s wr, 26 op/s 2023-05-08T11:45:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:13 smithi133 ceph-mon[125939]: pgmap v15442: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 308 KiB/s wr, 21 op/s 2023-05-08T11:45:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:13 smithi096 ceph-mon[124666]: pgmap v15442: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 308 KiB/s wr, 21 op/s 2023-05-08T11:45:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:13 smithi186 ceph-mon[126480]: pgmap v15442: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 308 KiB/s wr, 21 op/s 2023-05-08T11:45:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28853.227179 secs 2023-05-08T11:45:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28853.227179 secs 2023-05-08T11:45:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28853.227179 secs 2023-05-08T11:45:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28853.783090 secs 2023-05-08T11:45:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:15 smithi133 ceph-mon[125939]: pgmap v15443: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 553 KiB/s wr, 25 op/s 2023-05-08T11:45:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28853.783090 secs 2023-05-08T11:45:16.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:15 smithi096 ceph-mon[124666]: pgmap v15443: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 553 KiB/s wr, 25 op/s 2023-05-08T11:45:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28853.783090 secs 2023-05-08T11:45:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:15 smithi186 ceph-mon[126480]: pgmap v15443: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 553 KiB/s wr, 25 op/s 2023-05-08T11:45:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:17 smithi133 ceph-mon[125939]: pgmap v15444: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 246 KiB/s wr, 8 op/s 2023-05-08T11:45:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:17 smithi096 ceph-mon[124666]: pgmap v15444: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 246 KiB/s wr, 8 op/s 2023-05-08T11:45:18.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:17 smithi186 ceph-mon[126480]: pgmap v15444: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 246 KiB/s wr, 8 op/s 2023-05-08T11:45:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28858.227297 secs 2023-05-08T11:45:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:19 smithi133 ceph-mon[125939]: pgmap v15445: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 246 KiB/s wr, 8 op/s 2023-05-08T11:45:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28858.227297 secs 2023-05-08T11:45:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:19 smithi096 ceph-mon[124666]: pgmap v15445: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 246 KiB/s wr, 8 op/s 2023-05-08T11:45:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28858.227297 secs 2023-05-08T11:45:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:19 smithi186 ceph-mon[126480]: pgmap v15445: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 246 KiB/s wr, 8 op/s 2023-05-08T11:45:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:20 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:45:21.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:20 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:45:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:20 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:45:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:21 smithi096 ceph-mon[124666]: pgmap v15446: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 696 KiB/s rd, 733 KiB/s wr, 14 op/s 2023-05-08T11:45:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:21 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:45:22.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:21 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:45:22.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:21 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:45:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:21 smithi186 ceph-mon[126480]: pgmap v15446: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 696 KiB/s rd, 733 KiB/s wr, 14 op/s 2023-05-08T11:45:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:21 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:45:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:21 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:45:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:21 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:45:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:21 smithi133 ceph-mon[125939]: pgmap v15446: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 696 KiB/s rd, 733 KiB/s wr, 14 op/s 2023-05-08T11:45:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:21 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:45:22.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:21 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:45:22.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:21 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:45:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:23 smithi096 ceph-mon[124666]: pgmap v15447: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 694 KiB/s rd, 731 KiB/s wr, 10 op/s 2023-05-08T11:45:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:23 smithi186 ceph-mon[126480]: pgmap v15447: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 694 KiB/s rd, 731 KiB/s wr, 10 op/s 2023-05-08T11:45:24.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:23 smithi133 ceph-mon[125939]: pgmap v15447: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 694 KiB/s rd, 731 KiB/s wr, 10 op/s 2023-05-08T11:45:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28863.227415 secs 2023-05-08T11:45:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28863.227415 secs 2023-05-08T11:45:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28863.227415 secs 2023-05-08T11:45:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:25 smithi096 ceph-mon[124666]: pgmap v15448: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 800 KiB/s rd, 819 KiB/s wr, 14 op/s 2023-05-08T11:45:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:25 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:45:26.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:25 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:45:26.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:25 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:45:26.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:25 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:45:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:25 smithi186 ceph-mon[126480]: pgmap v15448: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 800 KiB/s rd, 819 KiB/s wr, 14 op/s 2023-05-08T11:45:26.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:25 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:45:26.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:25 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:45:26.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:25 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:45:26.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:25 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:45:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:25 smithi133 ceph-mon[125939]: pgmap v15448: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 800 KiB/s rd, 819 KiB/s wr, 14 op/s 2023-05-08T11:45:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:25 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:45:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:25 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:45:26.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:25 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:45:26.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:25 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:45:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:26 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:45:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:26 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T11:45:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:26 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T11:45:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:26 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:45:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:26 smithi186 ceph-mon[126480]: osdmap e1042: 12 total, 12 up, 12 in 2023-05-08T11:45:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:26 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:45:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:26 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T11:45:27.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:26 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T11:45:27.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:26 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:45:27.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:26 smithi133 ceph-mon[125939]: osdmap e1042: 12 total, 12 up, 12 in 2023-05-08T11:45:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:26 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:45:27.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:26 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T11:45:27.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:26 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T11:45:27.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:26 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:45:27.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:26 smithi096 ceph-mon[124666]: osdmap e1042: 12 total, 12 up, 12 in 2023-05-08T11:45:28.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:27 smithi186 ceph-mon[126480]: pgmap v15450: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 744 KiB/s rd, 702 KiB/s wr, 13 op/s 2023-05-08T11:45:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:27 smithi133 ceph-mon[125939]: pgmap v15450: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 744 KiB/s rd, 702 KiB/s wr, 13 op/s 2023-05-08T11:45:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:27 smithi096 ceph-mon[124666]: pgmap v15450: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 744 KiB/s rd, 702 KiB/s wr, 13 op/s 2023-05-08T11:45:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28868.227523 secs 2023-05-08T11:45:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:29 smithi186 ceph-mon[126480]: pgmap v15451: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 744 KiB/s rd, 702 KiB/s wr, 13 op/s 2023-05-08T11:45:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28868.227523 secs 2023-05-08T11:45:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:29 smithi133 ceph-mon[125939]: pgmap v15451: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 744 KiB/s rd, 702 KiB/s wr, 13 op/s 2023-05-08T11:45:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28868.227523 secs 2023-05-08T11:45:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:29 smithi096 ceph-mon[124666]: pgmap v15451: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 744 KiB/s rd, 702 KiB/s wr, 13 op/s 2023-05-08T11:45:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:31 smithi186 ceph-mon[126480]: pgmap v15452: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 380 KiB/s wr, 10 op/s 2023-05-08T11:45:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:31 smithi133 ceph-mon[125939]: pgmap v15452: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 380 KiB/s wr, 10 op/s 2023-05-08T11:45:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:31 smithi096 ceph-mon[124666]: pgmap v15452: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 380 KiB/s wr, 10 op/s 2023-05-08T11:45:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:33 smithi133 ceph-mon[125939]: pgmap v15453: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 380 KiB/s wr, 10 op/s 2023-05-08T11:45:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:33 smithi096 ceph-mon[124666]: pgmap v15453: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 380 KiB/s wr, 10 op/s 2023-05-08T11:45:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:33 smithi186 ceph-mon[126480]: pgmap v15453: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 380 KiB/s wr, 10 op/s 2023-05-08T11:45:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28873.227586 secs 2023-05-08T11:45:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28873.227586 secs 2023-05-08T11:45:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28873.227586 secs 2023-05-08T11:45:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:35 smithi133 ceph-mon[125939]: pgmap v15454: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 276 KiB/s wr, 8 op/s 2023-05-08T11:45:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:35 smithi133 ceph-mon[125939]: osdmap e1043: 12 total, 12 up, 12 in 2023-05-08T11:45:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:35 smithi096 ceph-mon[124666]: pgmap v15454: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 276 KiB/s wr, 8 op/s 2023-05-08T11:45:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:35 smithi096 ceph-mon[124666]: osdmap e1043: 12 total, 12 up, 12 in 2023-05-08T11:45:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:35 smithi186 ceph-mon[126480]: pgmap v15454: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 276 KiB/s wr, 8 op/s 2023-05-08T11:45:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:35 smithi186 ceph-mon[126480]: osdmap e1043: 12 total, 12 up, 12 in 2023-05-08T11:45:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28875.072800 secs 2023-05-08T11:45:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28875.072800 secs 2023-05-08T11:45:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28875.072800 secs 2023-05-08T11:45:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:37 smithi133 ceph-mon[125939]: pgmap v15456: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 546 KiB/s rd, 532 KiB/s wr, 9 op/s 2023-05-08T11:45:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:37 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:45:37.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:37 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:45:37.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:37 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:45:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:37 smithi096 ceph-mon[124666]: pgmap v15456: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 546 KiB/s rd, 532 KiB/s wr, 9 op/s 2023-05-08T11:45:38.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:37 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:45:38.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:37 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:45:38.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:37 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:45:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:37 smithi186 ceph-mon[126480]: pgmap v15456: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 546 KiB/s rd, 532 KiB/s wr, 9 op/s 2023-05-08T11:45:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:37 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:45:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:37 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:45:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:37 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:45:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28878.227700 secs 2023-05-08T11:45:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:39 smithi133 ceph-mon[125939]: pgmap v15457: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 546 KiB/s rd, 532 KiB/s wr, 9 op/s 2023-05-08T11:45:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28878.227700 secs 2023-05-08T11:45:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:39 smithi096 ceph-mon[124666]: pgmap v15457: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 546 KiB/s rd, 532 KiB/s wr, 9 op/s 2023-05-08T11:45:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28878.227700 secs 2023-05-08T11:45:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:39 smithi186 ceph-mon[126480]: pgmap v15457: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 546 KiB/s rd, 532 KiB/s wr, 9 op/s 2023-05-08T11:45:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28878.783679 secs 2023-05-08T11:45:41.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28878.783679 secs 2023-05-08T11:45:41.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28878.783679 secs 2023-05-08T11:45:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28880.072923 secs 2023-05-08T11:45:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:41 smithi096 ceph-mon[124666]: pgmap v15458: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 406 KiB/s wr, 10 op/s 2023-05-08T11:45:42.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:41 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:45:42.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:41 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:45:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28880.072923 secs 2023-05-08T11:45:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:41 smithi186 ceph-mon[126480]: pgmap v15458: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 406 KiB/s wr, 10 op/s 2023-05-08T11:45:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:41 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:45:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:41 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:45:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28880.072923 secs 2023-05-08T11:45:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:41 smithi133 ceph-mon[125939]: pgmap v15458: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 406 KiB/s wr, 10 op/s 2023-05-08T11:45:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:41 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:45:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:41 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:45:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:43 smithi096 ceph-mon[124666]: pgmap v15459: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 406 KiB/s wr, 10 op/s 2023-05-08T11:45:44.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:43 smithi186 ceph-mon[126480]: pgmap v15459: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 406 KiB/s wr, 10 op/s 2023-05-08T11:45:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:43 smithi133 ceph-mon[125939]: pgmap v15459: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 406 KiB/s wr, 10 op/s 2023-05-08T11:45:45.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28883.227814 secs 2023-05-08T11:45:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28883.227814 secs 2023-05-08T11:45:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28883.227814 secs 2023-05-08T11:45:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28883.783819 secs 2023-05-08T11:45:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:45 smithi186 ceph-mon[126480]: pgmap v15460: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 876 KiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T11:45:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:45 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:45:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28883.783819 secs 2023-05-08T11:45:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:45 smithi133 ceph-mon[125939]: pgmap v15460: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 876 KiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T11:45:46.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:45 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:45:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28883.783819 secs 2023-05-08T11:45:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:45 smithi096 ceph-mon[124666]: pgmap v15460: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 876 KiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T11:45:46.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:45 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:45:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:47 smithi186 ceph-mon[126480]: pgmap v15461: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 694 KiB/s wr, 9 op/s 2023-05-08T11:45:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:47 smithi133 ceph-mon[125939]: pgmap v15461: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 694 KiB/s wr, 9 op/s 2023-05-08T11:45:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:47 smithi096 ceph-mon[124666]: pgmap v15461: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 694 KiB/s wr, 9 op/s 2023-05-08T11:45:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:45:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:45:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:45:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28888.227898 secs 2023-05-08T11:45:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:49 smithi186 ceph-mon[126480]: pgmap v15462: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 641 KiB/s wr, 8 op/s 2023-05-08T11:45:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:45:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:45:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28888.227898 secs 2023-05-08T11:45:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:49 smithi133 ceph-mon[125939]: pgmap v15462: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 641 KiB/s wr, 8 op/s 2023-05-08T11:45:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:45:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:45:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28888.227898 secs 2023-05-08T11:45:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:49 smithi096 ceph-mon[124666]: pgmap v15462: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 641 KiB/s wr, 8 op/s 2023-05-08T11:45:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:45:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:45:51.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:45:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:45:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:45:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:51 smithi186 ceph-mon[126480]: pgmap v15463: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 858 KiB/s rd, 740 KiB/s wr, 14 op/s 2023-05-08T11:45:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:51 smithi133 ceph-mon[125939]: pgmap v15463: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 858 KiB/s rd, 740 KiB/s wr, 14 op/s 2023-05-08T11:45:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:51 smithi096 ceph-mon[124666]: pgmap v15463: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 858 KiB/s rd, 740 KiB/s wr, 14 op/s 2023-05-08T11:45:53.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:45:53.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:45:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:45:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:53 smithi186 ceph-mon[126480]: pgmap v15464: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 744 KiB/s rd, 627 KiB/s wr, 9 op/s 2023-05-08T11:45:54.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:45:54.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:45:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:53 smithi133 ceph-mon[125939]: pgmap v15464: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 744 KiB/s rd, 627 KiB/s wr, 9 op/s 2023-05-08T11:45:54.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:45:54.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:45:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:53 smithi096 ceph-mon[124666]: pgmap v15464: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 744 KiB/s rd, 627 KiB/s wr, 9 op/s 2023-05-08T11:45:54.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:45:54.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:45:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28893.228014 secs 2023-05-08T11:45:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28893.228014 secs 2023-05-08T11:45:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28893.228014 secs 2023-05-08T11:45:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:55 smithi186 ceph-mon[126480]: pgmap v15465: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 15 op/s 2023-05-08T11:45:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:55 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:45:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:55 smithi133 ceph-mon[125939]: pgmap v15465: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 15 op/s 2023-05-08T11:45:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:55 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:45:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:55 smithi096 ceph-mon[124666]: pgmap v15465: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 15 op/s 2023-05-08T11:45:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:55 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:45:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:57 smithi186 ceph-mon[126480]: pgmap v15466: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 892 KiB/s rd, 692 KiB/s wr, 11 op/s 2023-05-08T11:45:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:57 smithi133 ceph-mon[125939]: pgmap v15466: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 892 KiB/s rd, 692 KiB/s wr, 11 op/s 2023-05-08T11:45:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:57 smithi096 ceph-mon[124666]: pgmap v15466: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 892 KiB/s rd, 692 KiB/s wr, 11 op/s 2023-05-08T11:46:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28898.228138 secs 2023-05-08T11:46:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:45:59 smithi186 ceph-mon[126480]: pgmap v15467: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 892 KiB/s rd, 692 KiB/s wr, 11 op/s 2023-05-08T11:46:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28898.228138 secs 2023-05-08T11:46:00.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:45:59 smithi133 ceph-mon[125939]: pgmap v15467: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 892 KiB/s rd, 692 KiB/s wr, 11 op/s 2023-05-08T11:46:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28898.228138 secs 2023-05-08T11:46:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:45:59 smithi096 ceph-mon[124666]: pgmap v15467: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 892 KiB/s rd, 692 KiB/s wr, 11 op/s 2023-05-08T11:46:01.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:01 smithi186 ceph-mon[126480]: pgmap v15468: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 16 op/s 2023-05-08T11:46:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:01 smithi133 ceph-mon[125939]: pgmap v15468: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 16 op/s 2023-05-08T11:46:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:01 smithi096 ceph-mon[124666]: pgmap v15468: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 16 op/s 2023-05-08T11:46:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:03 smithi133 ceph-mon[125939]: pgmap v15469: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 999 KiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T11:46:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:03 smithi096 ceph-mon[124666]: pgmap v15469: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 999 KiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T11:46:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:03 smithi186 ceph-mon[126480]: pgmap v15469: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 999 KiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T11:46:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28903.228257 secs 2023-05-08T11:46:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28903.228257 secs 2023-05-08T11:46:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28903.228257 secs 2023-05-08T11:46:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28903.784334 secs 2023-05-08T11:46:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:05 smithi133 ceph-mon[125939]: pgmap v15470: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.4 MiB/s wr, 30 op/s 2023-05-08T11:46:05.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:05 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:46:05.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:46:05.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:46:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28903.784334 secs 2023-05-08T11:46:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:05 smithi096 ceph-mon[124666]: pgmap v15470: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.4 MiB/s wr, 30 op/s 2023-05-08T11:46:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:05 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:46:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:46:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:46:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28903.784334 secs 2023-05-08T11:46:06.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:05 smithi186 ceph-mon[126480]: pgmap v15470: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.4 MiB/s wr, 30 op/s 2023-05-08T11:46:06.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:05 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:46:06.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:46:06.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:46:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28905.073498 secs 2023-05-08T11:46:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28905.073498 secs 2023-05-08T11:46:07.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28905.073498 secs 2023-05-08T11:46:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:07 smithi133 ceph-mon[125939]: pgmap v15471: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 856 KiB/s wr, 24 op/s 2023-05-08T11:46:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:07 smithi096 ceph-mon[124666]: pgmap v15471: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 856 KiB/s wr, 24 op/s 2023-05-08T11:46:08.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:07 smithi186 ceph-mon[126480]: pgmap v15471: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 856 KiB/s wr, 24 op/s 2023-05-08T11:46:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28908.228376 secs 2023-05-08T11:46:10.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:09 smithi096 ceph-mon[124666]: pgmap v15472: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 857 KiB/s wr, 24 op/s 2023-05-08T11:46:10.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:46:10.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:46:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28908.228376 secs 2023-05-08T11:46:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:09 smithi186 ceph-mon[126480]: pgmap v15472: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 857 KiB/s wr, 24 op/s 2023-05-08T11:46:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:46:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:46:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28908.228376 secs 2023-05-08T11:46:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:09 smithi133 ceph-mon[125939]: pgmap v15472: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 857 KiB/s wr, 24 op/s 2023-05-08T11:46:10.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:46:10.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:46:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28908.784478 secs 2023-05-08T11:46:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:10 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:46:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28908.784478 secs 2023-05-08T11:46:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:10 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:46:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28908.784478 secs 2023-05-08T11:46:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:10 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:46:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28910.073609 secs 2023-05-08T11:46:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:11 smithi186 ceph-mon[126480]: pgmap v15473: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 28 op/s 2023-05-08T11:46:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:11 smithi186 ceph-mon[126480]: osdmap e1044: 12 total, 12 up, 12 in 2023-05-08T11:46:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28910.073609 secs 2023-05-08T11:46:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:11 smithi133 ceph-mon[125939]: pgmap v15473: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 28 op/s 2023-05-08T11:46:12.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:11 smithi133 ceph-mon[125939]: osdmap e1044: 12 total, 12 up, 12 in 2023-05-08T11:46:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28910.073609 secs 2023-05-08T11:46:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:11 smithi096 ceph-mon[124666]: pgmap v15473: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 28 op/s 2023-05-08T11:46:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:11 smithi096 ceph-mon[124666]: osdmap e1044: 12 total, 12 up, 12 in 2023-05-08T11:46:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:13 smithi186 ceph-mon[126480]: pgmap v15475: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 990 KiB/s rd, 748 KiB/s wr, 27 op/s 2023-05-08T11:46:14.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:13 smithi133 ceph-mon[125939]: pgmap v15475: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 990 KiB/s rd, 748 KiB/s wr, 27 op/s 2023-05-08T11:46:14.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:13 smithi096 ceph-mon[124666]: pgmap v15475: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 990 KiB/s rd, 748 KiB/s wr, 27 op/s 2023-05-08T11:46:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28913.228487 secs 2023-05-08T11:46:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28913.228487 secs 2023-05-08T11:46:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28913.228487 secs 2023-05-08T11:46:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28913.784566 secs 2023-05-08T11:46:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:15 smithi186 ceph-mon[126480]: pgmap v15476: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 410 KiB/s wr, 8 op/s 2023-05-08T11:46:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28913.784566 secs 2023-05-08T11:46:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:15 smithi133 ceph-mon[125939]: pgmap v15476: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 410 KiB/s wr, 8 op/s 2023-05-08T11:46:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28913.784566 secs 2023-05-08T11:46:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:15 smithi096 ceph-mon[124666]: pgmap v15476: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 410 KiB/s wr, 8 op/s 2023-05-08T11:46:17.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28915.073730 secs 2023-05-08T11:46:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28915.073730 secs 2023-05-08T11:46:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28915.073730 secs 2023-05-08T11:46:18.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:17 smithi186 ceph-mon[126480]: pgmap v15477: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 410 KiB/s wr, 8 op/s 2023-05-08T11:46:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:17 smithi133 ceph-mon[125939]: pgmap v15477: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 410 KiB/s wr, 8 op/s 2023-05-08T11:46:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:17 smithi096 ceph-mon[124666]: pgmap v15477: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 410 KiB/s wr, 8 op/s 2023-05-08T11:46:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28918.228568 secs 2023-05-08T11:46:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:19 smithi186 ceph-mon[126480]: pgmap v15478: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 410 KiB/s wr, 8 op/s 2023-05-08T11:46:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28918.228568 secs 2023-05-08T11:46:20.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:19 smithi133 ceph-mon[125939]: pgmap v15478: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 410 KiB/s wr, 8 op/s 2023-05-08T11:46:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28918.228568 secs 2023-05-08T11:46:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:19 smithi096 ceph-mon[124666]: pgmap v15478: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 410 KiB/s wr, 8 op/s 2023-05-08T11:46:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28918.784685 secs 2023-05-08T11:46:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:20 smithi186 ceph-mon[126480]: osdmap e1045: 12 total, 12 up, 12 in 2023-05-08T11:46:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28918.784685 secs 2023-05-08T11:46:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:20 smithi133 ceph-mon[125939]: osdmap e1045: 12 total, 12 up, 12 in 2023-05-08T11:46:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28918.784685 secs 2023-05-08T11:46:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:20 smithi096 ceph-mon[124666]: osdmap e1045: 12 total, 12 up, 12 in 2023-05-08T11:46:22.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28920.073849 secs 2023-05-08T11:46:22.123 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:21 smithi186 ceph-mon[126480]: pgmap v15480: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 275 KiB/s wr, 9 op/s 2023-05-08T11:46:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28920.073849 secs 2023-05-08T11:46:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:21 smithi133 ceph-mon[125939]: pgmap v15480: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 275 KiB/s wr, 9 op/s 2023-05-08T11:46:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28920.073849 secs 2023-05-08T11:46:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:21 smithi096 ceph-mon[124666]: pgmap v15480: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 275 KiB/s wr, 9 op/s 2023-05-08T11:46:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:23 smithi186 ceph-mon[126480]: pgmap v15481: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 515 KiB/s rd, 272 KiB/s wr, 9 op/s 2023-05-08T11:46:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:23 smithi133 ceph-mon[125939]: pgmap v15481: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 515 KiB/s rd, 272 KiB/s wr, 9 op/s 2023-05-08T11:46:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:23 smithi096 ceph-mon[124666]: pgmap v15481: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 515 KiB/s rd, 272 KiB/s wr, 9 op/s 2023-05-08T11:46:25.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28923.228691 secs 2023-05-08T11:46:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28923.228691 secs 2023-05-08T11:46:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28923.228691 secs 2023-05-08T11:46:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28923.784800 secs 2023-05-08T11:46:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:25 smithi186 ceph-mon[126480]: pgmap v15482: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 358 KiB/s wr, 10 op/s 2023-05-08T11:46:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:25 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:46:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28923.784800 secs 2023-05-08T11:46:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:25 smithi133 ceph-mon[125939]: pgmap v15482: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 358 KiB/s wr, 10 op/s 2023-05-08T11:46:26.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:25 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:46:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28923.784800 secs 2023-05-08T11:46:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:25 smithi096 ceph-mon[124666]: pgmap v15482: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 358 KiB/s wr, 10 op/s 2023-05-08T11:46:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:25 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:46:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:27 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28925.073972 secs 2023-05-08T11:46:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:46:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:46:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:46:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:46:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:46:27.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:46:27.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:46:27.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:46:27.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:46:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:27 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28925.073972 secs 2023-05-08T11:46:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:46:27.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:46:27.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:46:27.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:46:27.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:46:27.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:46:27.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:46:27.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:46:27.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:46:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:27 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28925.073972 secs 2023-05-08T11:46:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:46:27.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:46:27.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:46:27.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:46:27.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:46:27.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:46:27.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:46:27.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:46:27.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:46:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:28 smithi186 ceph-mon[126480]: pgmap v15483: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 358 KiB/s wr, 9 op/s 2023-05-08T11:46:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:28 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:46:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:28 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T11:46:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:28 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T11:46:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:28 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:46:28.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:28 smithi133 ceph-mon[125939]: pgmap v15483: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 358 KiB/s wr, 9 op/s 2023-05-08T11:46:28.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:28 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:46:28.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:28 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T11:46:28.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:28 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T11:46:28.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:28 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:46:28.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:28 smithi096 ceph-mon[124666]: pgmap v15483: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 358 KiB/s wr, 9 op/s 2023-05-08T11:46:28.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:28 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:46:28.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:28 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T11:46:28.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:28 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T11:46:28.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:28 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:46:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28928.228785 secs 2023-05-08T11:46:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:30 smithi186 ceph-mon[126480]: pgmap v15484: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 358 KiB/s wr, 9 op/s 2023-05-08T11:46:30.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28928.784915 secs 2023-05-08T11:46:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28928.228785 secs 2023-05-08T11:46:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:30 smithi133 ceph-mon[125939]: pgmap v15484: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 358 KiB/s wr, 9 op/s 2023-05-08T11:46:30.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28928.784915 secs 2023-05-08T11:46:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28928.228785 secs 2023-05-08T11:46:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:30 smithi096 ceph-mon[124666]: pgmap v15484: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 358 KiB/s wr, 9 op/s 2023-05-08T11:46:30.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28928.784915 secs 2023-05-08T11:46:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28930.074054 secs 2023-05-08T11:46:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:31 smithi186 ceph-mon[126480]: pgmap v15485: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 255 KiB/s rd, 209 KiB/s wr, 8 op/s 2023-05-08T11:46:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28930.074054 secs 2023-05-08T11:46:31.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:31 smithi133 ceph-mon[125939]: pgmap v15485: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 255 KiB/s rd, 209 KiB/s wr, 8 op/s 2023-05-08T11:46:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28930.074054 secs 2023-05-08T11:46:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:31 smithi096 ceph-mon[124666]: pgmap v15485: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 255 KiB/s rd, 209 KiB/s wr, 8 op/s 2023-05-08T11:46:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:33 smithi133 ceph-mon[125939]: pgmap v15486: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 176 KiB/s wr, 7 op/s 2023-05-08T11:46:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:33 smithi096 ceph-mon[124666]: pgmap v15486: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 176 KiB/s wr, 7 op/s 2023-05-08T11:46:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:33 smithi186 ceph-mon[126480]: pgmap v15486: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 176 KiB/s wr, 7 op/s 2023-05-08T11:46:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28933.228907 secs 2023-05-08T11:46:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28933.228907 secs 2023-05-08T11:46:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28933.228907 secs 2023-05-08T11:46:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28933.785035 secs 2023-05-08T11:46:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:35 smithi133 ceph-mon[125939]: pgmap v15487: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 284 KiB/s wr, 11 op/s 2023-05-08T11:46:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28933.785035 secs 2023-05-08T11:46:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:35 smithi096 ceph-mon[124666]: pgmap v15487: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 284 KiB/s wr, 11 op/s 2023-05-08T11:46:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28933.785035 secs 2023-05-08T11:46:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:35 smithi186 ceph-mon[126480]: pgmap v15487: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 284 KiB/s wr, 11 op/s 2023-05-08T11:46:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28935.074120 secs 2023-05-08T11:46:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28935.074120 secs 2023-05-08T11:46:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28935.074120 secs 2023-05-08T11:46:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:37 smithi096 ceph-mon[124666]: pgmap v15488: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 109 KiB/s wr, 7 op/s 2023-05-08T11:46:38.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:37 smithi186 ceph-mon[126480]: pgmap v15488: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 109 KiB/s wr, 7 op/s 2023-05-08T11:46:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:37 smithi133 ceph-mon[125939]: pgmap v15488: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 109 KiB/s wr, 7 op/s 2023-05-08T11:46:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28938.229040 secs 2023-05-08T11:46:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:39 smithi096 ceph-mon[124666]: pgmap v15489: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 109 KiB/s wr, 7 op/s 2023-05-08T11:46:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28938.229040 secs 2023-05-08T11:46:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:39 smithi186 ceph-mon[126480]: pgmap v15489: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 109 KiB/s wr, 7 op/s 2023-05-08T11:46:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28938.229040 secs 2023-05-08T11:46:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:39 smithi133 ceph-mon[125939]: pgmap v15489: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 109 KiB/s wr, 7 op/s 2023-05-08T11:46:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28938.785151 secs 2023-05-08T11:46:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28938.785151 secs 2023-05-08T11:46:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28938.785151 secs 2023-05-08T11:46:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28940.074246 secs 2023-05-08T11:46:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:41 smithi096 ceph-mon[124666]: pgmap v15490: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 321 KiB/s wr, 10 op/s 2023-05-08T11:46:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28940.074246 secs 2023-05-08T11:46:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:41 smithi186 ceph-mon[126480]: pgmap v15490: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 321 KiB/s wr, 10 op/s 2023-05-08T11:46:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28940.074246 secs 2023-05-08T11:46:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:41 smithi133 ceph-mon[125939]: pgmap v15490: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 321 KiB/s wr, 10 op/s 2023-05-08T11:46:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:43 smithi096 ceph-mon[124666]: pgmap v15491: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 320 KiB/s wr, 7 op/s 2023-05-08T11:46:44.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:43 smithi186 ceph-mon[126480]: pgmap v15491: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 320 KiB/s wr, 7 op/s 2023-05-08T11:46:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:43 smithi133 ceph-mon[125939]: pgmap v15491: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 320 KiB/s wr, 7 op/s 2023-05-08T11:46:45.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28943.229155 secs 2023-05-08T11:46:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28943.229155 secs 2023-05-08T11:46:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28943.229155 secs 2023-05-08T11:46:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28943.785268 secs 2023-05-08T11:46:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:45 smithi186 ceph-mon[126480]: pgmap v15492: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 442 KiB/s wr, 11 op/s 2023-05-08T11:46:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28943.785268 secs 2023-05-08T11:46:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:45 smithi133 ceph-mon[125939]: pgmap v15492: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 442 KiB/s wr, 11 op/s 2023-05-08T11:46:46.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28943.785268 secs 2023-05-08T11:46:46.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:45 smithi096 ceph-mon[124666]: pgmap v15492: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 442 KiB/s wr, 11 op/s 2023-05-08T11:46:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:47 smithi186 ceph-mon[126480]: pgmap v15493: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 334 KiB/s wr, 7 op/s 2023-05-08T11:46:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:47 smithi133 ceph-mon[125939]: pgmap v15493: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 334 KiB/s wr, 7 op/s 2023-05-08T11:46:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:47 smithi096 ceph-mon[124666]: pgmap v15493: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 334 KiB/s wr, 7 op/s 2023-05-08T11:46:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:46:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:46:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:46:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28948.229273 secs 2023-05-08T11:46:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:49 smithi186 ceph-mon[126480]: pgmap v15494: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 334 KiB/s wr, 7 op/s 2023-05-08T11:46:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:46:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:46:50.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:46:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28948.229273 secs 2023-05-08T11:46:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:49 smithi133 ceph-mon[125939]: pgmap v15494: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 334 KiB/s wr, 7 op/s 2023-05-08T11:46:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:46:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:46:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:46:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28948.229273 secs 2023-05-08T11:46:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:49 smithi096 ceph-mon[124666]: pgmap v15494: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 334 KiB/s wr, 7 op/s 2023-05-08T11:46:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:46:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:46:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:46:51.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28948.785338 secs 2023-05-08T11:46:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28948.785338 secs 2023-05-08T11:46:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28948.785338 secs 2023-05-08T11:46:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:51 smithi186 ceph-mon[126480]: pgmap v15495: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 834 KiB/s rd, 534 KiB/s wr, 11 op/s 2023-05-08T11:46:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:51 smithi133 ceph-mon[125939]: pgmap v15495: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 834 KiB/s rd, 534 KiB/s wr, 11 op/s 2023-05-08T11:46:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:51 smithi096 ceph-mon[124666]: pgmap v15495: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 834 KiB/s rd, 534 KiB/s wr, 11 op/s 2023-05-08T11:46:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:53 smithi186 ceph-mon[126480]: pgmap v15496: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 833 KiB/s rd, 321 KiB/s wr, 7 op/s 2023-05-08T11:46:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:53 smithi133 ceph-mon[125939]: pgmap v15496: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 833 KiB/s rd, 321 KiB/s wr, 7 op/s 2023-05-08T11:46:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:53 smithi096 ceph-mon[124666]: pgmap v15496: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 833 KiB/s rd, 321 KiB/s wr, 7 op/s 2023-05-08T11:46:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28953.229392 secs 2023-05-08T11:46:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28953.229392 secs 2023-05-08T11:46:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28953.229392 secs 2023-05-08T11:46:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:55 smithi186 ceph-mon[126480]: pgmap v15497: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 850 KiB/s wr, 17 op/s 2023-05-08T11:46:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:55 smithi133 ceph-mon[125939]: pgmap v15497: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 850 KiB/s wr, 17 op/s 2023-05-08T11:46:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:55 smithi096 ceph-mon[124666]: pgmap v15497: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 850 KiB/s wr, 17 op/s 2023-05-08T11:46:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:46:57.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:46:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:46:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:57 smithi186 ceph-mon[126480]: pgmap v15498: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 657 KiB/s rd, 729 KiB/s wr, 13 op/s 2023-05-08T11:46:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:57 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:46:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:46:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:46:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:57 smithi133 ceph-mon[125939]: pgmap v15498: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 657 KiB/s rd, 729 KiB/s wr, 13 op/s 2023-05-08T11:46:58.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:57 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:46:58.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:46:58.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:46:58.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:57 smithi096 ceph-mon[124666]: pgmap v15498: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 657 KiB/s rd, 729 KiB/s wr, 13 op/s 2023-05-08T11:46:58.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:57 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:46:58.259 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:46:58.259 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:47:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28958.229525 secs 2023-05-08T11:47:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:46:59 smithi186 ceph-mon[126480]: pgmap v15499: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 657 KiB/s rd, 729 KiB/s wr, 13 op/s 2023-05-08T11:47:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28958.229525 secs 2023-05-08T11:47:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:46:59 smithi133 ceph-mon[125939]: pgmap v15499: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 657 KiB/s rd, 729 KiB/s wr, 13 op/s 2023-05-08T11:47:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28958.229525 secs 2023-05-08T11:47:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:46:59 smithi096 ceph-mon[124666]: pgmap v15499: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 657 KiB/s rd, 729 KiB/s wr, 13 op/s 2023-05-08T11:47:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28958.785558 secs 2023-05-08T11:47:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28958.785558 secs 2023-05-08T11:47:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28958.785558 secs 2023-05-08T11:47:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:01 smithi186 ceph-mon[126480]: pgmap v15500: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 31 op/s 2023-05-08T11:47:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:47:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:47:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:01 smithi133 ceph-mon[125939]: pgmap v15500: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 31 op/s 2023-05-08T11:47:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:47:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:47:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:01 smithi096 ceph-mon[124666]: pgmap v15500: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 31 op/s 2023-05-08T11:47:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:47:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:47:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:03 smithi186 ceph-mon[126480]: pgmap v15501: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 968 KiB/s rd, 1.1 MiB/s wr, 27 op/s 2023-05-08T11:47:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:03 smithi133 ceph-mon[125939]: pgmap v15501: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 968 KiB/s rd, 1.1 MiB/s wr, 27 op/s 2023-05-08T11:47:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:03 smithi096 ceph-mon[124666]: pgmap v15501: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 968 KiB/s rd, 1.1 MiB/s wr, 27 op/s 2023-05-08T11:47:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28963.229650 secs 2023-05-08T11:47:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:04 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:47:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28963.229650 secs 2023-05-08T11:47:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:04 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:47:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28963.229650 secs 2023-05-08T11:47:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:04 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:47:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:05 smithi186 ceph-mon[126480]: pgmap v15502: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 44 op/s 2023-05-08T11:47:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:05 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:47:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:47:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:47:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:05 smithi133 ceph-mon[125939]: pgmap v15502: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 44 op/s 2023-05-08T11:47:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:05 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:47:06.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:47:06.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:47:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:05 smithi096 ceph-mon[124666]: pgmap v15502: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 44 op/s 2023-05-08T11:47:06.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:05 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:47:06.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:47:06.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:47:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:07 smithi186 ceph-mon[126480]: pgmap v15503: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 34 op/s 2023-05-08T11:47:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:07 smithi133 ceph-mon[125939]: pgmap v15503: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 34 op/s 2023-05-08T11:47:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:07 smithi096 ceph-mon[124666]: pgmap v15503: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 34 op/s 2023-05-08T11:47:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28968.229766 secs 2023-05-08T11:47:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:09 smithi186 ceph-mon[126480]: pgmap v15504: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 34 op/s 2023-05-08T11:47:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28968.229766 secs 2023-05-08T11:47:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:09 smithi133 ceph-mon[125939]: pgmap v15504: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 34 op/s 2023-05-08T11:47:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28968.229766 secs 2023-05-08T11:47:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:09 smithi096 ceph-mon[124666]: pgmap v15504: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 34 op/s 2023-05-08T11:47:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:11 smithi186 ceph-mon[126480]: pgmap v15505: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.3 MiB/s wr, 39 op/s 2023-05-08T11:47:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:11 smithi133 ceph-mon[125939]: pgmap v15505: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.3 MiB/s wr, 39 op/s 2023-05-08T11:47:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:11 smithi096 ceph-mon[124666]: pgmap v15505: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.3 MiB/s wr, 39 op/s 2023-05-08T11:47:14.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:13 smithi096 ceph-mon[124666]: pgmap v15506: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 782 KiB/s wr, 21 op/s 2023-05-08T11:47:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:13 smithi186 ceph-mon[126480]: pgmap v15506: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 782 KiB/s wr, 21 op/s 2023-05-08T11:47:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:13 smithi133 ceph-mon[125939]: pgmap v15506: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 782 KiB/s wr, 21 op/s 2023-05-08T11:47:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28973.229884 secs 2023-05-08T11:47:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28973.229884 secs 2023-05-08T11:47:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28973.229884 secs 2023-05-08T11:47:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:15 smithi096 ceph-mon[124666]: pgmap v15507: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 905 KiB/s wr, 25 op/s 2023-05-08T11:47:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:15 smithi186 ceph-mon[126480]: pgmap v15507: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 905 KiB/s wr, 25 op/s 2023-05-08T11:47:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:15 smithi133 ceph-mon[125939]: pgmap v15507: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 905 KiB/s wr, 25 op/s 2023-05-08T11:47:18.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:17 smithi186 ceph-mon[126480]: pgmap v15508: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 370 KiB/s wr, 8 op/s 2023-05-08T11:47:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:17 smithi133 ceph-mon[125939]: pgmap v15508: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 370 KiB/s wr, 8 op/s 2023-05-08T11:47:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:17 smithi096 ceph-mon[124666]: pgmap v15508: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 370 KiB/s wr, 8 op/s 2023-05-08T11:47:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28978.229980 secs 2023-05-08T11:47:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:19 smithi186 ceph-mon[126480]: pgmap v15509: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 370 KiB/s wr, 8 op/s 2023-05-08T11:47:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28978.229980 secs 2023-05-08T11:47:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:19 smithi133 ceph-mon[125939]: pgmap v15509: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 370 KiB/s wr, 8 op/s 2023-05-08T11:47:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28978.229980 secs 2023-05-08T11:47:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:19 smithi096 ceph-mon[124666]: pgmap v15509: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 370 KiB/s wr, 8 op/s 2023-05-08T11:47:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:21 smithi133 ceph-mon[125939]: pgmap v15510: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 477 KiB/s rd, 370 KiB/s wr, 12 op/s 2023-05-08T11:47:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:21 smithi096 ceph-mon[124666]: pgmap v15510: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 477 KiB/s rd, 370 KiB/s wr, 12 op/s 2023-05-08T11:47:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:21 smithi186 ceph-mon[126480]: pgmap v15510: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 477 KiB/s rd, 370 KiB/s wr, 12 op/s 2023-05-08T11:47:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:23 smithi096 ceph-mon[124666]: pgmap v15511: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 123 KiB/s wr, 8 op/s 2023-05-08T11:47:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:23 smithi186 ceph-mon[126480]: pgmap v15511: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 123 KiB/s wr, 8 op/s 2023-05-08T11:47:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:23 smithi133 ceph-mon[125939]: pgmap v15511: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 123 KiB/s wr, 8 op/s 2023-05-08T11:47:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28983.230119 secs 2023-05-08T11:47:25.150 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28983.230119 secs 2023-05-08T11:47:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28983.230119 secs 2023-05-08T11:47:26.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28983.786076 secs 2023-05-08T11:47:26.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:25 smithi096 ceph-mon[124666]: pgmap v15512: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 424 KiB/s wr, 15 op/s 2023-05-08T11:47:26.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:25 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:47:26.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:25 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:47:26.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:25 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:47:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28983.786076 secs 2023-05-08T11:47:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:25 smithi186 ceph-mon[126480]: pgmap v15512: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 424 KiB/s wr, 15 op/s 2023-05-08T11:47:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:25 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:47:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:25 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:47:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:25 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:47:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28983.786076 secs 2023-05-08T11:47:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:25 smithi133 ceph-mon[125939]: pgmap v15512: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 424 KiB/s wr, 15 op/s 2023-05-08T11:47:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:25 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:47:26.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:25 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:47:26.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:25 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:47:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28985.075309 secs 2023-05-08T11:47:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:26 smithi186 ceph-mon[126480]: osdmap e1046: 12 total, 12 up, 12 in 2023-05-08T11:47:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28985.075309 secs 2023-05-08T11:47:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:26 smithi133 ceph-mon[125939]: osdmap e1046: 12 total, 12 up, 12 in 2023-05-08T11:47:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28985.075309 secs 2023-05-08T11:47:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:26 smithi096 ceph-mon[124666]: osdmap e1046: 12 total, 12 up, 12 in 2023-05-08T11:47:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:27 smithi186 ceph-mon[126480]: pgmap v15514: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 362 KiB/s wr, 13 op/s 2023-05-08T11:47:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:47:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:47:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:47:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:47:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:27 smithi133 ceph-mon[125939]: pgmap v15514: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 362 KiB/s wr, 13 op/s 2023-05-08T11:47:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:47:28.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:47:28.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:47:28.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:47:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:27 smithi096 ceph-mon[124666]: pgmap v15514: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 362 KiB/s wr, 13 op/s 2023-05-08T11:47:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:47:28.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:47:28.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:47:28.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:47:29.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:28 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:47:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:28 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T11:47:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:28 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T11:47:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:28 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:47:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:28 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:47:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:28 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T11:47:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:28 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T11:47:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:28 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:47:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:28 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:47:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:28 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T11:47:29.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:28 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T11:47:29.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:28 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:47:30.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28988.230231 secs 2023-05-08T11:47:30.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:29 smithi186 ceph-mon[126480]: pgmap v15515: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 362 KiB/s wr, 13 op/s 2023-05-08T11:47:30.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:29 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:47:30.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:29 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:47:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28988.230231 secs 2023-05-08T11:47:30.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:29 smithi133 ceph-mon[125939]: pgmap v15515: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 362 KiB/s wr, 13 op/s 2023-05-08T11:47:30.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:29 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:47:30.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:29 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:47:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28988.230231 secs 2023-05-08T11:47:30.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:29 smithi096 ceph-mon[124666]: pgmap v15515: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 362 KiB/s wr, 13 op/s 2023-05-08T11:47:30.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:29 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:47:30.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:29 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:47:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28988.786150 secs 2023-05-08T11:47:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:30 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:47:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28988.786150 secs 2023-05-08T11:47:31.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:30 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:47:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28988.786150 secs 2023-05-08T11:47:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:30 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:47:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28990.075426 secs 2023-05-08T11:47:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:31 smithi186 ceph-mon[126480]: pgmap v15516: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 362 KiB/s wr, 13 op/s 2023-05-08T11:47:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28990.075426 secs 2023-05-08T11:47:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:31 smithi133 ceph-mon[125939]: pgmap v15516: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 362 KiB/s wr, 13 op/s 2023-05-08T11:47:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28990.075426 secs 2023-05-08T11:47:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:31 smithi096 ceph-mon[124666]: pgmap v15516: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 362 KiB/s wr, 13 op/s 2023-05-08T11:47:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:33 smithi186 ceph-mon[126480]: pgmap v15517: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 362 KiB/s wr, 13 op/s 2023-05-08T11:47:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:33 smithi133 ceph-mon[125939]: pgmap v15517: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 362 KiB/s wr, 13 op/s 2023-05-08T11:47:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:33 smithi096 ceph-mon[124666]: pgmap v15517: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 362 KiB/s wr, 13 op/s 2023-05-08T11:47:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28993.230365 secs 2023-05-08T11:47:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28993.230365 secs 2023-05-08T11:47:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28993.230365 secs 2023-05-08T11:47:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28993.786257 secs 2023-05-08T11:47:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:35 smithi186 ceph-mon[126480]: pgmap v15518: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 148 KiB/s wr, 9 op/s 2023-05-08T11:47:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:35 smithi186 ceph-mon[126480]: osdmap e1047: 12 total, 12 up, 12 in 2023-05-08T11:47:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28993.786257 secs 2023-05-08T11:47:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:35 smithi133 ceph-mon[125939]: pgmap v15518: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 148 KiB/s wr, 9 op/s 2023-05-08T11:47:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:35 smithi133 ceph-mon[125939]: osdmap e1047: 12 total, 12 up, 12 in 2023-05-08T11:47:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28993.786257 secs 2023-05-08T11:47:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:35 smithi096 ceph-mon[124666]: pgmap v15518: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 148 KiB/s wr, 9 op/s 2023-05-08T11:47:36.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:35 smithi096 ceph-mon[124666]: osdmap e1047: 12 total, 12 up, 12 in 2023-05-08T11:47:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28995.075529 secs 2023-05-08T11:47:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28995.075529 secs 2023-05-08T11:47:37.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28995.075529 secs 2023-05-08T11:47:38.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:37 smithi186 ceph-mon[126480]: pgmap v15520: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 148 KiB/s wr, 9 op/s 2023-05-08T11:47:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:37 smithi133 ceph-mon[125939]: pgmap v15520: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 148 KiB/s wr, 9 op/s 2023-05-08T11:47:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:37 smithi096 ceph-mon[124666]: pgmap v15520: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 148 KiB/s wr, 9 op/s 2023-05-08T11:47:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28998.230484 secs 2023-05-08T11:47:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:39 smithi186 ceph-mon[126480]: pgmap v15521: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 148 KiB/s wr, 9 op/s 2023-05-08T11:47:40.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28998.230484 secs 2023-05-08T11:47:40.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:39 smithi133 ceph-mon[125939]: pgmap v15521: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 148 KiB/s wr, 9 op/s 2023-05-08T11:47:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28998.230484 secs 2023-05-08T11:47:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:39 smithi096 ceph-mon[124666]: pgmap v15521: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 148 KiB/s wr, 9 op/s 2023-05-08T11:47:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 28998.786394 secs 2023-05-08T11:47:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 28998.786394 secs 2023-05-08T11:47:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 28998.786394 secs 2023-05-08T11:47:42.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29000.075649 secs 2023-05-08T11:47:42.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:41 smithi186 ceph-mon[126480]: pgmap v15522: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 410 KiB/s rd, 407 KiB/s wr, 9 op/s 2023-05-08T11:47:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29000.075649 secs 2023-05-08T11:47:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:41 smithi133 ceph-mon[125939]: pgmap v15522: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 410 KiB/s rd, 407 KiB/s wr, 9 op/s 2023-05-08T11:47:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29000.075649 secs 2023-05-08T11:47:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:41 smithi096 ceph-mon[124666]: pgmap v15522: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 410 KiB/s rd, 407 KiB/s wr, 9 op/s 2023-05-08T11:47:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:43 smithi186 ceph-mon[126480]: pgmap v15523: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 410 KiB/s rd, 407 KiB/s wr, 9 op/s 2023-05-08T11:47:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:43 smithi133 ceph-mon[125939]: pgmap v15523: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 410 KiB/s rd, 407 KiB/s wr, 9 op/s 2023-05-08T11:47:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:43 smithi096 ceph-mon[124666]: pgmap v15523: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 410 KiB/s rd, 407 KiB/s wr, 9 op/s 2023-05-08T11:47:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29003.230618 secs 2023-05-08T11:47:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29003.230618 secs 2023-05-08T11:47:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29003.230618 secs 2023-05-08T11:47:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29003.786505 secs 2023-05-08T11:47:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:45 smithi186 ceph-mon[126480]: pgmap v15524: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 352 KiB/s wr, 8 op/s 2023-05-08T11:47:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29003.786505 secs 2023-05-08T11:47:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:45 smithi133 ceph-mon[125939]: pgmap v15524: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 352 KiB/s wr, 8 op/s 2023-05-08T11:47:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29003.786505 secs 2023-05-08T11:47:46.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:45 smithi096 ceph-mon[124666]: pgmap v15524: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 352 KiB/s wr, 8 op/s 2023-05-08T11:47:47.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29005.075762 secs 2023-05-08T11:47:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29005.075762 secs 2023-05-08T11:47:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29005.075762 secs 2023-05-08T11:47:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:47 smithi186 ceph-mon[126480]: pgmap v15525: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 317 KiB/s wr, 7 op/s 2023-05-08T11:47:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:47 smithi133 ceph-mon[125939]: pgmap v15525: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 317 KiB/s wr, 7 op/s 2023-05-08T11:47:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:47 smithi096 ceph-mon[124666]: pgmap v15525: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 317 KiB/s wr, 7 op/s 2023-05-08T11:47:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29008.230731 secs 2023-05-08T11:47:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:49 smithi186 ceph-mon[126480]: pgmap v15526: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 293 KiB/s wr, 6 op/s 2023-05-08T11:47:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29008.230731 secs 2023-05-08T11:47:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:49 smithi133 ceph-mon[125939]: pgmap v15526: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 293 KiB/s wr, 6 op/s 2023-05-08T11:47:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29008.230731 secs 2023-05-08T11:47:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:49 smithi096 ceph-mon[124666]: pgmap v15526: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 293 KiB/s wr, 6 op/s 2023-05-08T11:47:51.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29008.786622 secs 2023-05-08T11:47:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29008.786622 secs 2023-05-08T11:47:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29008.786622 secs 2023-05-08T11:47:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29010.075884 secs 2023-05-08T11:47:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:51 smithi186 ceph-mon[126480]: pgmap v15527: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 557 KiB/s rd, 323 KiB/s wr, 10 op/s 2023-05-08T11:47:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29010.075884 secs 2023-05-08T11:47:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:51 smithi133 ceph-mon[125939]: pgmap v15527: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 557 KiB/s rd, 323 KiB/s wr, 10 op/s 2023-05-08T11:47:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29010.075884 secs 2023-05-08T11:47:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:51 smithi096 ceph-mon[124666]: pgmap v15527: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 557 KiB/s rd, 323 KiB/s wr, 10 op/s 2023-05-08T11:47:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:53 smithi186 ceph-mon[126480]: pgmap v15528: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 107 KiB/s wr, 6 op/s 2023-05-08T11:47:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:53 smithi133 ceph-mon[125939]: pgmap v15528: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 107 KiB/s wr, 6 op/s 2023-05-08T11:47:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:53 smithi096 ceph-mon[124666]: pgmap v15528: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 107 KiB/s wr, 6 op/s 2023-05-08T11:47:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29013.230828 secs 2023-05-08T11:47:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29013.230828 secs 2023-05-08T11:47:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29013.230828 secs 2023-05-08T11:47:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:55 smithi186 ceph-mon[126480]: pgmap v15529: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 785 KiB/s rd, 552 KiB/s wr, 11 op/s 2023-05-08T11:47:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:55 smithi133 ceph-mon[125939]: pgmap v15529: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 785 KiB/s rd, 552 KiB/s wr, 11 op/s 2023-05-08T11:47:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:55 smithi096 ceph-mon[124666]: pgmap v15529: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 785 KiB/s rd, 552 KiB/s wr, 11 op/s 2023-05-08T11:47:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29015.075958 secs 2023-05-08T11:47:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:47:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29015.075958 secs 2023-05-08T11:47:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:47:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29015.075958 secs 2023-05-08T11:47:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:47:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:57 smithi186 ceph-mon[126480]: pgmap v15530: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 630 KiB/s rd, 475 KiB/s wr, 8 op/s 2023-05-08T11:47:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:57 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:47:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:47:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:47:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:57 smithi133 ceph-mon[125939]: pgmap v15530: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 630 KiB/s rd, 475 KiB/s wr, 8 op/s 2023-05-08T11:47:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:57 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:47:58.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:47:58.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:47:58.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:57 smithi096 ceph-mon[124666]: pgmap v15530: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 630 KiB/s rd, 475 KiB/s wr, 8 op/s 2023-05-08T11:47:58.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:57 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:47:58.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:47:58.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:48:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29018.230944 secs 2023-05-08T11:48:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:47:59 smithi186 ceph-mon[126480]: pgmap v15531: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 630 KiB/s rd, 475 KiB/s wr, 8 op/s 2023-05-08T11:48:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29018.230944 secs 2023-05-08T11:48:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:47:59 smithi133 ceph-mon[125939]: pgmap v15531: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 630 KiB/s rd, 475 KiB/s wr, 8 op/s 2023-05-08T11:48:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29018.230944 secs 2023-05-08T11:48:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:47:59 smithi096 ceph-mon[124666]: pgmap v15531: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 630 KiB/s rd, 475 KiB/s wr, 8 op/s 2023-05-08T11:48:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29020.076098 secs 2023-05-08T11:48:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:01 smithi133 ceph-mon[125939]: pgmap v15532: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1015 KiB/s rd, 860 KiB/s wr, 13 op/s 2023-05-08T11:48:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29020.076098 secs 2023-05-08T11:48:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:01 smithi096 ceph-mon[124666]: pgmap v15532: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1015 KiB/s rd, 860 KiB/s wr, 13 op/s 2023-05-08T11:48:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29020.076098 secs 2023-05-08T11:48:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:01 smithi186 ceph-mon[126480]: pgmap v15532: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1015 KiB/s rd, 860 KiB/s wr, 13 op/s 2023-05-08T11:48:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:03 smithi186 ceph-mon[126480]: pgmap v15533: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 831 KiB/s rd, 830 KiB/s wr, 10 op/s 2023-05-08T11:48:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:03 smithi133 ceph-mon[125939]: pgmap v15533: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 831 KiB/s rd, 830 KiB/s wr, 10 op/s 2023-05-08T11:48:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:03 smithi096 ceph-mon[124666]: pgmap v15533: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 831 KiB/s rd, 830 KiB/s wr, 10 op/s 2023-05-08T11:48:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29023.231061 secs 2023-05-08T11:48:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29023.231061 secs 2023-05-08T11:48:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29023.231061 secs 2023-05-08T11:48:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29023.786975 secs 2023-05-08T11:48:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:05 smithi186 ceph-mon[126480]: pgmap v15534: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1021 KiB/s rd, 1.0 MiB/s wr, 27 op/s 2023-05-08T11:48:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:05 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:48:06.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:48:06.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:48:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29023.786975 secs 2023-05-08T11:48:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:05 smithi133 ceph-mon[125939]: pgmap v15534: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1021 KiB/s rd, 1.0 MiB/s wr, 27 op/s 2023-05-08T11:48:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:05 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:48:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:48:06.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:48:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29023.786975 secs 2023-05-08T11:48:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:05 smithi096 ceph-mon[124666]: pgmap v15534: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1021 KiB/s rd, 1.0 MiB/s wr, 27 op/s 2023-05-08T11:48:06.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:05 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:48:06.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:48:06.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:48:08.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:07 smithi186 ceph-mon[126480]: pgmap v15535: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 575 KiB/s rd, 588 KiB/s wr, 22 op/s 2023-05-08T11:48:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:07 smithi133 ceph-mon[125939]: pgmap v15535: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 575 KiB/s rd, 588 KiB/s wr, 22 op/s 2023-05-08T11:48:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:07 smithi096 ceph-mon[124666]: pgmap v15535: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 575 KiB/s rd, 588 KiB/s wr, 22 op/s 2023-05-08T11:48:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:08 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:48:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:08 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:48:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:08 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:48:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29028.231187 secs 2023-05-08T11:48:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:09 smithi186 ceph-mon[126480]: pgmap v15536: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 575 KiB/s rd, 588 KiB/s wr, 22 op/s 2023-05-08T11:48:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:48:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:48:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29028.231187 secs 2023-05-08T11:48:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:09 smithi133 ceph-mon[125939]: pgmap v15536: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 575 KiB/s rd, 588 KiB/s wr, 22 op/s 2023-05-08T11:48:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:48:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:48:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29028.231187 secs 2023-05-08T11:48:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:09 smithi096 ceph-mon[124666]: pgmap v15536: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 575 KiB/s rd, 588 KiB/s wr, 22 op/s 2023-05-08T11:48:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:48:10.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:48:11.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29028.787092 secs 2023-05-08T11:48:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:10 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:48:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29028.787092 secs 2023-05-08T11:48:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:10 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:48:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29028.787092 secs 2023-05-08T11:48:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:10 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:48:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:11 smithi186 ceph-mon[126480]: pgmap v15537: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 577 KiB/s rd, 672 KiB/s wr, 25 op/s 2023-05-08T11:48:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:11 smithi133 ceph-mon[125939]: pgmap v15537: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 577 KiB/s rd, 672 KiB/s wr, 25 op/s 2023-05-08T11:48:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:11 smithi096 ceph-mon[124666]: pgmap v15537: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 577 KiB/s rd, 672 KiB/s wr, 25 op/s 2023-05-08T11:48:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:13 smithi186 ceph-mon[126480]: pgmap v15538: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 287 KiB/s wr, 20 op/s 2023-05-08T11:48:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:13 smithi133 ceph-mon[125939]: pgmap v15538: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 287 KiB/s wr, 20 op/s 2023-05-08T11:48:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:13 smithi096 ceph-mon[124666]: pgmap v15538: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 287 KiB/s wr, 20 op/s 2023-05-08T11:48:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29033.231295 secs 2023-05-08T11:48:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29033.231295 secs 2023-05-08T11:48:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29033.231295 secs 2023-05-08T11:48:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29033.787206 secs 2023-05-08T11:48:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:15 smithi186 ceph-mon[126480]: pgmap v15539: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 328 KiB/s wr, 23 op/s 2023-05-08T11:48:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29033.787206 secs 2023-05-08T11:48:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:15 smithi133 ceph-mon[125939]: pgmap v15539: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 328 KiB/s wr, 23 op/s 2023-05-08T11:48:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29033.787206 secs 2023-05-08T11:48:16.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:15 smithi096 ceph-mon[124666]: pgmap v15539: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 328 KiB/s wr, 23 op/s 2023-05-08T11:48:18.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:17 smithi186 ceph-mon[126480]: pgmap v15540: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 339 KiB/s wr, 7 op/s 2023-05-08T11:48:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:17 smithi133 ceph-mon[125939]: pgmap v15540: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 339 KiB/s wr, 7 op/s 2023-05-08T11:48:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:17 smithi096 ceph-mon[124666]: pgmap v15540: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 339 KiB/s wr, 7 op/s 2023-05-08T11:48:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29038.231414 secs 2023-05-08T11:48:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:19 smithi186 ceph-mon[126480]: pgmap v15541: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 339 KiB/s wr, 7 op/s 2023-05-08T11:48:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29038.231414 secs 2023-05-08T11:48:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:19 smithi133 ceph-mon[125939]: pgmap v15541: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 339 KiB/s wr, 7 op/s 2023-05-08T11:48:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29038.231414 secs 2023-05-08T11:48:20.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:19 smithi096 ceph-mon[124666]: pgmap v15541: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 339 KiB/s wr, 7 op/s 2023-05-08T11:48:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29038.787328 secs 2023-05-08T11:48:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29038.787328 secs 2023-05-08T11:48:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29038.787328 secs 2023-05-08T11:48:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:21 smithi186 ceph-mon[126480]: pgmap v15542: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 384 KiB/s wr, 10 op/s 2023-05-08T11:48:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:21 smithi133 ceph-mon[125939]: pgmap v15542: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 384 KiB/s wr, 10 op/s 2023-05-08T11:48:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:21 smithi096 ceph-mon[124666]: pgmap v15542: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 384 KiB/s wr, 10 op/s 2023-05-08T11:48:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:23 smithi186 ceph-mon[126480]: pgmap v15543: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 340 KiB/s rd, 301 KiB/s wr, 7 op/s 2023-05-08T11:48:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:23 smithi133 ceph-mon[125939]: pgmap v15543: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 340 KiB/s rd, 301 KiB/s wr, 7 op/s 2023-05-08T11:48:24.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:23 smithi096 ceph-mon[124666]: pgmap v15543: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 340 KiB/s rd, 301 KiB/s wr, 7 op/s 2023-05-08T11:48:25.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29043.231559 secs 2023-05-08T11:48:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:24 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:48:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29043.231559 secs 2023-05-08T11:48:25.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:24 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:48:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29043.231559 secs 2023-05-08T11:48:25.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:24 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:48:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:25 smithi186 ceph-mon[126480]: pgmap v15544: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 742 KiB/s rd, 683 KiB/s wr, 13 op/s 2023-05-08T11:48:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:25 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:48:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:25 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:48:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:25 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:48:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:25 smithi133 ceph-mon[125939]: pgmap v15544: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 742 KiB/s rd, 683 KiB/s wr, 13 op/s 2023-05-08T11:48:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:25 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:48:26.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:25 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:48:26.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:25 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:48:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:25 smithi096 ceph-mon[124666]: pgmap v15544: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 742 KiB/s rd, 683 KiB/s wr, 13 op/s 2023-05-08T11:48:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:25 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:48:26.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:25 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:48:26.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:25 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:48:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:26 smithi186 ceph-mon[126480]: osdmap e1048: 12 total, 12 up, 12 in 2023-05-08T11:48:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:26 smithi133 ceph-mon[125939]: osdmap e1048: 12 total, 12 up, 12 in 2023-05-08T11:48:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:26 smithi096 ceph-mon[124666]: osdmap e1048: 12 total, 12 up, 12 in 2023-05-08T11:48:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:27 smithi186 ceph-mon[126480]: pgmap v15546: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 538 KiB/s rd, 514 KiB/s wr, 12 op/s 2023-05-08T11:48:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:48:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:27 smithi133 ceph-mon[125939]: pgmap v15546: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 538 KiB/s rd, 514 KiB/s wr, 12 op/s 2023-05-08T11:48:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:48:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:27 smithi096 ceph-mon[124666]: pgmap v15546: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 538 KiB/s rd, 514 KiB/s wr, 12 op/s 2023-05-08T11:48:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:48:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:28 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:48:29.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:28 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:48:29.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:28 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:48:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:28 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:48:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:28 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:48:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:28 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:48:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:28 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:48:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:28 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:48:29.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:28 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:48:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:29 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:48:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:29 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T11:48:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:29 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T11:48:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:29 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:48:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29048.231685 secs 2023-05-08T11:48:30.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:29 smithi186 ceph-mon[126480]: pgmap v15547: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 538 KiB/s rd, 514 KiB/s wr, 12 op/s 2023-05-08T11:48:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:29 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:48:30.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:29 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T11:48:30.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:29 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T11:48:30.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:29 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:48:30.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29048.231685 secs 2023-05-08T11:48:30.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:29 smithi133 ceph-mon[125939]: pgmap v15547: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 538 KiB/s rd, 514 KiB/s wr, 12 op/s 2023-05-08T11:48:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:29 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:48:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:29 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T11:48:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:29 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T11:48:30.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:29 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:48:30.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29048.231685 secs 2023-05-08T11:48:30.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:29 smithi096 ceph-mon[124666]: pgmap v15547: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 538 KiB/s rd, 514 KiB/s wr, 12 op/s 2023-05-08T11:48:31.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:31 smithi133 ceph-mon[125939]: pgmap v15548: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 865 KiB/s rd, 691 KiB/s wr, 13 op/s 2023-05-08T11:48:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:31 smithi096 ceph-mon[124666]: pgmap v15548: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 865 KiB/s rd, 691 KiB/s wr, 13 op/s 2023-05-08T11:48:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:31 smithi186 ceph-mon[126480]: pgmap v15548: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 865 KiB/s rd, 691 KiB/s wr, 13 op/s 2023-05-08T11:48:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:33 smithi186 ceph-mon[126480]: pgmap v15549: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 865 KiB/s rd, 691 KiB/s wr, 13 op/s 2023-05-08T11:48:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:33 smithi133 ceph-mon[125939]: pgmap v15549: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 865 KiB/s rd, 691 KiB/s wr, 13 op/s 2023-05-08T11:48:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:33 smithi096 ceph-mon[124666]: pgmap v15549: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 865 KiB/s rd, 691 KiB/s wr, 13 op/s 2023-05-08T11:48:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29053.231815 secs 2023-05-08T11:48:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29053.231815 secs 2023-05-08T11:48:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29053.231815 secs 2023-05-08T11:48:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:35 smithi186 ceph-mon[126480]: pgmap v15550: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 512 KiB/s rd, 359 KiB/s wr, 10 op/s 2023-05-08T11:48:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:35 smithi186 ceph-mon[126480]: osdmap e1049: 12 total, 12 up, 12 in 2023-05-08T11:48:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:35 smithi133 ceph-mon[125939]: pgmap v15550: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 512 KiB/s rd, 359 KiB/s wr, 10 op/s 2023-05-08T11:48:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:35 smithi133 ceph-mon[125939]: osdmap e1049: 12 total, 12 up, 12 in 2023-05-08T11:48:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:35 smithi096 ceph-mon[124666]: pgmap v15550: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 512 KiB/s rd, 359 KiB/s wr, 10 op/s 2023-05-08T11:48:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:35 smithi096 ceph-mon[124666]: osdmap e1049: 12 total, 12 up, 12 in 2023-05-08T11:48:38.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:37 smithi186 ceph-mon[126480]: pgmap v15552: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 359 KiB/s wr, 9 op/s 2023-05-08T11:48:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:37 smithi133 ceph-mon[125939]: pgmap v15552: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 359 KiB/s wr, 9 op/s 2023-05-08T11:48:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:37 smithi096 ceph-mon[124666]: pgmap v15552: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 359 KiB/s wr, 9 op/s 2023-05-08T11:48:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29058.231930 secs 2023-05-08T11:48:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:39 smithi186 ceph-mon[126480]: pgmap v15553: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 359 KiB/s wr, 9 op/s 2023-05-08T11:48:40.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29058.231930 secs 2023-05-08T11:48:40.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:39 smithi133 ceph-mon[125939]: pgmap v15553: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 359 KiB/s wr, 9 op/s 2023-05-08T11:48:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29058.231930 secs 2023-05-08T11:48:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:39 smithi096 ceph-mon[124666]: pgmap v15553: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 359 KiB/s wr, 9 op/s 2023-05-08T11:48:41.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29058.787794 secs 2023-05-08T11:48:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29058.787794 secs 2023-05-08T11:48:41.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29058.787794 secs 2023-05-08T11:48:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29060.077004 secs 2023-05-08T11:48:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:41 smithi186 ceph-mon[126480]: pgmap v15554: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 945 KiB/s wr, 10 op/s 2023-05-08T11:48:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:41 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:48:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:41 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:48:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:41 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:48:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29060.077004 secs 2023-05-08T11:48:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:41 smithi133 ceph-mon[125939]: pgmap v15554: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 945 KiB/s wr, 10 op/s 2023-05-08T11:48:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:41 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:48:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:41 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:48:42.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:41 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:48:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29060.077004 secs 2023-05-08T11:48:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:41 smithi096 ceph-mon[124666]: pgmap v15554: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 945 KiB/s wr, 10 op/s 2023-05-08T11:48:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:41 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:48:42.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:41 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:48:42.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:41 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:48:44.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:43 smithi186 ceph-mon[126480]: pgmap v15555: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 945 KiB/s wr, 10 op/s 2023-05-08T11:48:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:43 smithi133 ceph-mon[125939]: pgmap v15555: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 945 KiB/s wr, 10 op/s 2023-05-08T11:48:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:43 smithi096 ceph-mon[124666]: pgmap v15555: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 945 KiB/s wr, 10 op/s 2023-05-08T11:48:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29063.787916 secs 2023-05-08T11:48:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:45 smithi186 ceph-mon[126480]: pgmap v15556: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T11:48:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:45 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:48:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:45 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:48:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29063.787916 secs 2023-05-08T11:48:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:45 smithi133 ceph-mon[125939]: pgmap v15556: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T11:48:46.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:45 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:48:46.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:45 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:48:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29063.787916 secs 2023-05-08T11:48:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:45 smithi096 ceph-mon[124666]: pgmap v15556: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T11:48:46.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:45 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:48:46.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:45 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:48:47.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29065.077111 secs 2023-05-08T11:48:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29065.077111 secs 2023-05-08T11:48:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29065.077111 secs 2023-05-08T11:48:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:47 smithi186 ceph-mon[126480]: pgmap v15557: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T11:48:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:48:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:47 smithi133 ceph-mon[125939]: pgmap v15557: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T11:48:48.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:48:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:47 smithi096 ceph-mon[124666]: pgmap v15557: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T11:48:48.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:48:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:48 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:48:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T11:48:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:48:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:48 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:48:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T11:48:49.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:48:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:48 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:48:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T11:48:49.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:48:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29068.232151 secs 2023-05-08T11:48:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:49 smithi186 ceph-mon[126480]: pgmap v15558: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 960 KiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T11:48:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29068.232151 secs 2023-05-08T11:48:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:49 smithi133 ceph-mon[125939]: pgmap v15558: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 960 KiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T11:48:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29068.232151 secs 2023-05-08T11:48:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:49 smithi096 ceph-mon[124666]: pgmap v15558: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 960 KiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T11:48:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29070.077258 secs 2023-05-08T11:48:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:51 smithi133 ceph-mon[125939]: pgmap v15559: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 17 op/s 2023-05-08T11:48:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29070.077258 secs 2023-05-08T11:48:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:51 smithi096 ceph-mon[124666]: pgmap v15559: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 17 op/s 2023-05-08T11:48:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29070.077258 secs 2023-05-08T11:48:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:51 smithi186 ceph-mon[126480]: pgmap v15559: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 17 op/s 2023-05-08T11:48:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T11:48:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:48:52.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:48:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T11:48:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:48:53.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:48:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T11:48:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:48:53.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:48:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:48:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:48:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:53 smithi133 ceph-mon[125939]: pgmap v15560: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T11:48:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:48:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:48:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:53 smithi096 ceph-mon[124666]: pgmap v15560: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T11:48:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:48:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:48:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:53 smithi186 ceph-mon[126480]: pgmap v15560: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T11:48:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29073.232298 secs 2023-05-08T11:48:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29073.232298 secs 2023-05-08T11:48:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29073.232298 secs 2023-05-08T11:48:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29073.788165 secs 2023-05-08T11:48:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:55 smithi133 ceph-mon[125939]: pgmap v15561: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 17 op/s 2023-05-08T11:48:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29073.788165 secs 2023-05-08T11:48:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:55 smithi096 ceph-mon[124666]: pgmap v15561: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 17 op/s 2023-05-08T11:48:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29073.788165 secs 2023-05-08T11:48:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:55 smithi186 ceph-mon[126480]: pgmap v15561: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 17 op/s 2023-05-08T11:48:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:48:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:48:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:48:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:48:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:48:57.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:48:57.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:57 smithi133 ceph-mon[125939]: pgmap v15562: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T11:48:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:48:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:48:58.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:48:58.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:57 smithi096 ceph-mon[124666]: pgmap v15562: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T11:48:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:48:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:48:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:48:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:57 smithi186 ceph-mon[126480]: pgmap v15562: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T11:49:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29078.232407 secs 2023-05-08T11:49:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:48:59 smithi186 ceph-mon[126480]: pgmap v15563: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T11:49:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29078.232407 secs 2023-05-08T11:49:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:48:59 smithi133 ceph-mon[125939]: pgmap v15563: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T11:49:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29078.232407 secs 2023-05-08T11:49:00.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:48:59 smithi096 ceph-mon[124666]: pgmap v15563: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T11:49:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:00 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:49:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:00 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:49:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:00 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:49:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29080.077486 secs 2023-05-08T11:49:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:01 smithi186 ceph-mon[126480]: pgmap v15564: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.4 MiB/s wr, 17 op/s 2023-05-08T11:49:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:01 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:49:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:49:02.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:49:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29080.077486 secs 2023-05-08T11:49:02.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:01 smithi133 ceph-mon[125939]: pgmap v15564: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.4 MiB/s wr, 17 op/s 2023-05-08T11:49:02.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:01 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:49:02.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:49:02.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:49:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29080.077486 secs 2023-05-08T11:49:02.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:01 smithi096 ceph-mon[124666]: pgmap v15564: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.4 MiB/s wr, 17 op/s 2023-05-08T11:49:02.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:01 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:49:02.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:49:02.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:49:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:03 smithi186 ceph-mon[126480]: pgmap v15565: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 792 KiB/s rd, 773 KiB/s wr, 11 op/s 2023-05-08T11:49:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29083.232525 secs 2023-05-08T11:49:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:03 smithi133 ceph-mon[125939]: pgmap v15565: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 792 KiB/s rd, 773 KiB/s wr, 11 op/s 2023-05-08T11:49:04.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29083.232525 secs 2023-05-08T11:49:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:03 smithi096 ceph-mon[124666]: pgmap v15565: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 792 KiB/s rd, 773 KiB/s wr, 11 op/s 2023-05-08T11:49:04.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29083.232525 secs 2023-05-08T11:49:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29083.788370 secs 2023-05-08T11:49:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:05 smithi186 ceph-mon[126480]: pgmap v15566: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 30 op/s 2023-05-08T11:49:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:49:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:49:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:49:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29083.788370 secs 2023-05-08T11:49:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:05 smithi133 ceph-mon[125939]: pgmap v15566: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 30 op/s 2023-05-08T11:49:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:49:06.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:49:06.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:49:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29083.788370 secs 2023-05-08T11:49:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:05 smithi096 ceph-mon[124666]: pgmap v15566: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 30 op/s 2023-05-08T11:49:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:49:06.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:49:06.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:49:07.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29085.077587 secs 2023-05-08T11:49:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:06 smithi186 ceph-mon[126480]: osdmap e1050: 12 total, 12 up, 12 in 2023-05-08T11:49:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29085.077587 secs 2023-05-08T11:49:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:06 smithi133 ceph-mon[125939]: osdmap e1050: 12 total, 12 up, 12 in 2023-05-08T11:49:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29085.077587 secs 2023-05-08T11:49:07.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:06 smithi096 ceph-mon[124666]: osdmap e1050: 12 total, 12 up, 12 in 2023-05-08T11:49:08.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:07 smithi186 ceph-mon[126480]: pgmap v15568: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 801 KiB/s rd, 842 KiB/s wr, 29 op/s 2023-05-08T11:49:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:07 smithi133 ceph-mon[125939]: pgmap v15568: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 801 KiB/s rd, 842 KiB/s wr, 29 op/s 2023-05-08T11:49:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:07 smithi096 ceph-mon[124666]: pgmap v15568: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 801 KiB/s rd, 842 KiB/s wr, 29 op/s 2023-05-08T11:49:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29088.232628 secs 2023-05-08T11:49:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29088.232628 secs 2023-05-08T11:49:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29088.232628 secs 2023-05-08T11:49:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:09 smithi186 ceph-mon[126480]: pgmap v15569: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 801 KiB/s rd, 842 KiB/s wr, 29 op/s 2023-05-08T11:49:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:09 smithi133 ceph-mon[125939]: pgmap v15569: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 801 KiB/s rd, 842 KiB/s wr, 29 op/s 2023-05-08T11:49:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:09 smithi096 ceph-mon[124666]: pgmap v15569: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 801 KiB/s rd, 842 KiB/s wr, 29 op/s 2023-05-08T11:49:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29088.788505 secs 2023-05-08T11:49:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:10 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:49:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29088.788505 secs 2023-05-08T11:49:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:10 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:49:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29088.788505 secs 2023-05-08T11:49:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:10 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:49:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29090.077706 secs 2023-05-08T11:49:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:11 smithi186 ceph-mon[126480]: pgmap v15570: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 646 KiB/s rd, 525 KiB/s wr, 27 op/s 2023-05-08T11:49:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29090.077706 secs 2023-05-08T11:49:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:11 smithi133 ceph-mon[125939]: pgmap v15570: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 646 KiB/s rd, 525 KiB/s wr, 27 op/s 2023-05-08T11:49:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29090.077706 secs 2023-05-08T11:49:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:11 smithi096 ceph-mon[124666]: pgmap v15570: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 646 KiB/s rd, 525 KiB/s wr, 27 op/s 2023-05-08T11:49:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:13 smithi186 ceph-mon[126480]: pgmap v15571: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 646 KiB/s rd, 525 KiB/s wr, 27 op/s 2023-05-08T11:49:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29093.232745 secs 2023-05-08T11:49:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:13 smithi133 ceph-mon[125939]: pgmap v15571: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 646 KiB/s rd, 525 KiB/s wr, 27 op/s 2023-05-08T11:49:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29093.232745 secs 2023-05-08T11:49:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:13 smithi096 ceph-mon[124666]: pgmap v15571: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 646 KiB/s rd, 525 KiB/s wr, 27 op/s 2023-05-08T11:49:14.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29093.232745 secs 2023-05-08T11:49:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29093.788555 secs 2023-05-08T11:49:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:15 smithi186 ceph-mon[126480]: pgmap v15572: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 499 KiB/s rd, 512 KiB/s wr, 8 op/s 2023-05-08T11:49:16.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:15 smithi186 ceph-mon[126480]: osdmap e1051: 12 total, 12 up, 12 in 2023-05-08T11:49:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29093.788555 secs 2023-05-08T11:49:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:15 smithi133 ceph-mon[125939]: pgmap v15572: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 499 KiB/s rd, 512 KiB/s wr, 8 op/s 2023-05-08T11:49:16.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:15 smithi133 ceph-mon[125939]: osdmap e1051: 12 total, 12 up, 12 in 2023-05-08T11:49:16.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29093.788555 secs 2023-05-08T11:49:16.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:15 smithi096 ceph-mon[124666]: pgmap v15572: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 499 KiB/s rd, 512 KiB/s wr, 8 op/s 2023-05-08T11:49:16.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:15 smithi096 ceph-mon[124666]: osdmap e1051: 12 total, 12 up, 12 in 2023-05-08T11:49:17.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29095.077882 secs 2023-05-08T11:49:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29095.077882 secs 2023-05-08T11:49:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29095.077882 secs 2023-05-08T11:49:18.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:17 smithi186 ceph-mon[126480]: pgmap v15574: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 499 KiB/s rd, 512 KiB/s wr, 8 op/s 2023-05-08T11:49:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:17 smithi133 ceph-mon[125939]: pgmap v15574: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 499 KiB/s rd, 512 KiB/s wr, 8 op/s 2023-05-08T11:49:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:17 smithi096 ceph-mon[124666]: pgmap v15574: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 499 KiB/s rd, 512 KiB/s wr, 8 op/s 2023-05-08T11:49:19.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29098.232859 secs 2023-05-08T11:49:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29098.232859 secs 2023-05-08T11:49:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29098.232859 secs 2023-05-08T11:49:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:19 smithi186 ceph-mon[126480]: pgmap v15575: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 499 KiB/s rd, 512 KiB/s wr, 8 op/s 2023-05-08T11:49:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:19 smithi133 ceph-mon[125939]: pgmap v15575: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 499 KiB/s rd, 512 KiB/s wr, 8 op/s 2023-05-08T11:49:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:19 smithi096 ceph-mon[124666]: pgmap v15575: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 499 KiB/s rd, 512 KiB/s wr, 8 op/s 2023-05-08T11:49:21.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29098.788674 secs 2023-05-08T11:49:21.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29098.788674 secs 2023-05-08T11:49:21.259 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29098.788674 secs 2023-05-08T11:49:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29100.077966 secs 2023-05-08T11:49:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:21 smithi186 ceph-mon[126480]: pgmap v15576: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 407 KiB/s wr, 9 op/s 2023-05-08T11:49:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29100.077966 secs 2023-05-08T11:49:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:21 smithi133 ceph-mon[125939]: pgmap v15576: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 407 KiB/s wr, 9 op/s 2023-05-08T11:49:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29100.077966 secs 2023-05-08T11:49:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:21 smithi096 ceph-mon[124666]: pgmap v15576: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 407 KiB/s wr, 9 op/s 2023-05-08T11:49:24.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:23 smithi186 ceph-mon[126480]: pgmap v15577: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 407 KiB/s wr, 9 op/s 2023-05-08T11:49:24.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29103.232977 secs 2023-05-08T11:49:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:23 smithi133 ceph-mon[125939]: pgmap v15577: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 407 KiB/s wr, 9 op/s 2023-05-08T11:49:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29103.232977 secs 2023-05-08T11:49:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:23 smithi096 ceph-mon[124666]: pgmap v15577: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 407 KiB/s wr, 9 op/s 2023-05-08T11:49:24.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29103.232977 secs 2023-05-08T11:49:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29103.788759 secs 2023-05-08T11:49:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:25 smithi186 ceph-mon[126480]: pgmap v15578: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 45 KiB/s wr, 9 op/s 2023-05-08T11:49:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29103.788759 secs 2023-05-08T11:49:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:25 smithi133 ceph-mon[125939]: pgmap v15578: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 45 KiB/s wr, 9 op/s 2023-05-08T11:49:26.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29103.788759 secs 2023-05-08T11:49:26.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:25 smithi096 ceph-mon[124666]: pgmap v15578: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 45 KiB/s wr, 9 op/s 2023-05-08T11:49:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29105.078051 secs 2023-05-08T11:49:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29105.078051 secs 2023-05-08T11:49:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29105.078051 secs 2023-05-08T11:49:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:27 smithi186 ceph-mon[126480]: pgmap v15579: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 41 KiB/s wr, 9 op/s 2023-05-08T11:49:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:27 smithi133 ceph-mon[125939]: pgmap v15579: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 41 KiB/s wr, 9 op/s 2023-05-08T11:49:28.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:27 smithi096 ceph-mon[124666]: pgmap v15579: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 41 KiB/s wr, 9 op/s 2023-05-08T11:49:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:28 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:49:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29108.233073 secs 2023-05-08T11:49:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:28 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:49:29.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29108.233073 secs 2023-05-08T11:49:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:28 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:49:29.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29108.233073 secs 2023-05-08T11:49:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:29 smithi186 ceph-mon[126480]: pgmap v15580: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 38 KiB/s wr, 8 op/s 2023-05-08T11:49:30.140 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:29 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:49:30.140 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:29 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:49:30.141 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:29 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:49:30.141 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:29 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:49:30.141 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:29 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T11:49:30.141 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:29 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T11:49:30.142 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:29 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:49:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:29 smithi133 ceph-mon[125939]: pgmap v15580: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 38 KiB/s wr, 8 op/s 2023-05-08T11:49:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:29 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:49:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:29 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:49:30.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:29 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:49:30.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:29 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:49:30.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:29 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T11:49:30.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:29 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T11:49:30.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:29 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:49:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:29 smithi096 ceph-mon[124666]: pgmap v15580: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 38 KiB/s wr, 8 op/s 2023-05-08T11:49:30.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:29 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:49:30.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:29 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:49:30.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:29 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:49:30.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:29 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:49:30.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:29 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T11:49:30.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:29 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T11:49:30.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:29 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:49:31.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29108.788902 secs 2023-05-08T11:49:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29108.788902 secs 2023-05-08T11:49:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29108.788902 secs 2023-05-08T11:49:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29110.078176 secs 2023-05-08T11:49:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:31 smithi186 ceph-mon[126480]: pgmap v15581: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 256 KiB/s wr, 11 op/s 2023-05-08T11:49:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29110.078176 secs 2023-05-08T11:49:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:31 smithi133 ceph-mon[125939]: pgmap v15581: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 256 KiB/s wr, 11 op/s 2023-05-08T11:49:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29110.078176 secs 2023-05-08T11:49:32.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:31 smithi096 ceph-mon[124666]: pgmap v15581: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 256 KiB/s wr, 11 op/s 2023-05-08T11:49:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:33 smithi186 ceph-mon[126480]: pgmap v15582: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 219 KiB/s wr, 7 op/s 2023-05-08T11:49:34.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29113.233196 secs 2023-05-08T11:49:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:33 smithi133 ceph-mon[125939]: pgmap v15582: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 219 KiB/s wr, 7 op/s 2023-05-08T11:49:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29113.233196 secs 2023-05-08T11:49:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:33 smithi096 ceph-mon[124666]: pgmap v15582: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 219 KiB/s wr, 7 op/s 2023-05-08T11:49:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29113.233196 secs 2023-05-08T11:49:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29113.789020 secs 2023-05-08T11:49:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:35 smithi186 ceph-mon[126480]: pgmap v15583: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 220 KiB/s wr, 10 op/s 2023-05-08T11:49:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29113.789020 secs 2023-05-08T11:49:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:35 smithi133 ceph-mon[125939]: pgmap v15583: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 220 KiB/s wr, 10 op/s 2023-05-08T11:49:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29113.789020 secs 2023-05-08T11:49:36.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:35 smithi096 ceph-mon[124666]: pgmap v15583: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 220 KiB/s wr, 10 op/s 2023-05-08T11:49:37.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29115.078294 secs 2023-05-08T11:49:37.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29115.078294 secs 2023-05-08T11:49:37.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29115.078294 secs 2023-05-08T11:49:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:37 smithi133 ceph-mon[125939]: pgmap v15584: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 219 KiB/s wr, 6 op/s 2023-05-08T11:49:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:37 smithi096 ceph-mon[124666]: pgmap v15584: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 219 KiB/s wr, 6 op/s 2023-05-08T11:49:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:37 smithi186 ceph-mon[126480]: pgmap v15584: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 219 KiB/s wr, 6 op/s 2023-05-08T11:49:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29118.233296 secs 2023-05-08T11:49:39.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29118.233296 secs 2023-05-08T11:49:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29118.233296 secs 2023-05-08T11:49:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:39 smithi133 ceph-mon[125939]: pgmap v15585: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 219 KiB/s wr, 6 op/s 2023-05-08T11:49:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:39 smithi096 ceph-mon[124666]: pgmap v15585: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 219 KiB/s wr, 6 op/s 2023-05-08T11:49:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:39 smithi186 ceph-mon[126480]: pgmap v15585: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 219 KiB/s wr, 6 op/s 2023-05-08T11:49:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29118.789098 secs 2023-05-08T11:49:41.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29118.789098 secs 2023-05-08T11:49:41.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29118.789098 secs 2023-05-08T11:49:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29120.078411 secs 2023-05-08T11:49:42.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:41 smithi133 ceph-mon[125939]: pgmap v15586: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 219 KiB/s wr, 9 op/s 2023-05-08T11:49:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29120.078411 secs 2023-05-08T11:49:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:41 smithi096 ceph-mon[124666]: pgmap v15586: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 219 KiB/s wr, 9 op/s 2023-05-08T11:49:42.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29120.078411 secs 2023-05-08T11:49:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:41 smithi186 ceph-mon[126480]: pgmap v15586: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 219 KiB/s wr, 9 op/s 2023-05-08T11:49:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:43 smithi133 ceph-mon[125939]: pgmap v15587: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 255 B/s wr, 5 op/s 2023-05-08T11:49:44.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29123.233426 secs 2023-05-08T11:49:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:43 smithi096 ceph-mon[124666]: pgmap v15587: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 255 B/s wr, 5 op/s 2023-05-08T11:49:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29123.233426 secs 2023-05-08T11:49:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:43 smithi186 ceph-mon[126480]: pgmap v15587: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 255 B/s wr, 5 op/s 2023-05-08T11:49:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29123.233426 secs 2023-05-08T11:49:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29123.789237 secs 2023-05-08T11:49:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:45 smithi133 ceph-mon[125939]: pgmap v15588: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 111 KiB/s wr, 9 op/s 2023-05-08T11:49:46.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29123.789237 secs 2023-05-08T11:49:46.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:45 smithi096 ceph-mon[124666]: pgmap v15588: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 111 KiB/s wr, 9 op/s 2023-05-08T11:49:46.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29123.789237 secs 2023-05-08T11:49:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:45 smithi186 ceph-mon[126480]: pgmap v15588: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 111 KiB/s wr, 9 op/s 2023-05-08T11:49:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:47 smithi133 ceph-mon[125939]: pgmap v15589: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 111 KiB/s wr, 6 op/s 2023-05-08T11:49:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:47 smithi096 ceph-mon[124666]: pgmap v15589: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 111 KiB/s wr, 6 op/s 2023-05-08T11:49:48.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:47 smithi186 ceph-mon[126480]: pgmap v15589: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 111 KiB/s wr, 6 op/s 2023-05-08T11:49:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:49:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29128.233512 secs 2023-05-08T11:49:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:49:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29128.233512 secs 2023-05-08T11:49:49.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:49:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29128.233512 secs 2023-05-08T11:49:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:49 smithi133 ceph-mon[125939]: pgmap v15590: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 111 KiB/s wr, 6 op/s 2023-05-08T11:49:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:49:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:49:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:49:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:49 smithi096 ceph-mon[124666]: pgmap v15590: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 111 KiB/s wr, 6 op/s 2023-05-08T11:49:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:49:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:49:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:49:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:49 smithi186 ceph-mon[126480]: pgmap v15590: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 111 KiB/s wr, 6 op/s 2023-05-08T11:49:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:49:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:49:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:49:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29128.789352 secs 2023-05-08T11:49:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29128.789352 secs 2023-05-08T11:49:51.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29128.789352 secs 2023-05-08T11:49:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29130.078629 secs 2023-05-08T11:49:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:51 smithi133 ceph-mon[125939]: pgmap v15591: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 213 KiB/s wr, 9 op/s 2023-05-08T11:49:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29130.078629 secs 2023-05-08T11:49:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:51 smithi096 ceph-mon[124666]: pgmap v15591: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 213 KiB/s wr, 9 op/s 2023-05-08T11:49:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29130.078629 secs 2023-05-08T11:49:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:51 smithi186 ceph-mon[126480]: pgmap v15591: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 213 KiB/s wr, 9 op/s 2023-05-08T11:49:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:53 smithi133 ceph-mon[125939]: pgmap v15592: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 213 KiB/s wr, 7 op/s 2023-05-08T11:49:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:49:54.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:49:54.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29133.233607 secs 2023-05-08T11:49:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:53 smithi096 ceph-mon[124666]: pgmap v15592: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 213 KiB/s wr, 7 op/s 2023-05-08T11:49:54.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:49:54.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:49:54.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29133.233607 secs 2023-05-08T11:49:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:53 smithi186 ceph-mon[126480]: pgmap v15592: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 213 KiB/s wr, 7 op/s 2023-05-08T11:49:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:49:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:49:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29133.233607 secs 2023-05-08T11:49:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:55 smithi133 ceph-mon[125939]: pgmap v15593: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 662 KiB/s wr, 11 op/s 2023-05-08T11:49:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:55 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:49:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:55 smithi096 ceph-mon[124666]: pgmap v15593: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 662 KiB/s wr, 11 op/s 2023-05-08T11:49:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:55 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:49:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:55 smithi186 ceph-mon[126480]: pgmap v15593: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 662 KiB/s wr, 11 op/s 2023-05-08T11:49:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:55 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:49:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29135.078763 secs 2023-05-08T11:49:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:49:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29135.078763 secs 2023-05-08T11:49:57.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:49:57.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29135.078763 secs 2023-05-08T11:49:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:49:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:57 smithi133 ceph-mon[125939]: pgmap v15594: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 570 KiB/s rd, 551 KiB/s wr, 8 op/s 2023-05-08T11:49:58.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:49:58.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:49:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:57 smithi096 ceph-mon[124666]: pgmap v15594: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 570 KiB/s rd, 551 KiB/s wr, 8 op/s 2023-05-08T11:49:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:49:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:49:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:57 smithi186 ceph-mon[126480]: pgmap v15594: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 570 KiB/s rd, 551 KiB/s wr, 8 op/s 2023-05-08T11:49:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:49:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:49:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29138.233739 secs 2023-05-08T11:49:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29138.233739 secs 2023-05-08T11:49:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29138.233739 secs 2023-05-08T11:50:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:49:59 smithi133 ceph-mon[125939]: pgmap v15595: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 570 KiB/s rd, 551 KiB/s wr, 8 op/s 2023-05-08T11:50:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:49:59 smithi096 ceph-mon[124666]: pgmap v15595: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 570 KiB/s rd, 551 KiB/s wr, 8 op/s 2023-05-08T11:50:00.373 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:49:59 smithi186 ceph-mon[126480]: pgmap v15595: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 570 KiB/s rd, 551 KiB/s wr, 8 op/s 2023-05-08T11:50:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:00 smithi133 ceph-mon[125939]: Health detail: HEALTH_WARN 2 MDSs report slow requests 2023-05-08T11:50:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:00 smithi133 ceph-mon[125939]: [WRN] MDS_SLOW_REQUEST: 2 MDSs report slow requests 2023-05-08T11:50:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:00 smithi133 ceph-mon[125939]: mds.i(mds.1): 1 slow requests are blocked > 180 secs 2023-05-08T11:50:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:00 smithi133 ceph-mon[125939]: mds.b(mds.0): 1 slow requests are blocked > 180 secs 2023-05-08T11:50:01.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:00 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:50:01.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:00 smithi096 ceph-mon[124666]: Health detail: HEALTH_WARN 2 MDSs report slow requests 2023-05-08T11:50:01.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:00 smithi096 ceph-mon[124666]: [WRN] MDS_SLOW_REQUEST: 2 MDSs report slow requests 2023-05-08T11:50:01.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:00 smithi096 ceph-mon[124666]: mds.i(mds.1): 1 slow requests are blocked > 180 secs 2023-05-08T11:50:01.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:00 smithi096 ceph-mon[124666]: mds.b(mds.0): 1 slow requests are blocked > 180 secs 2023-05-08T11:50:01.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:00 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:50:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:00 smithi186 ceph-mon[126480]: Health detail: HEALTH_WARN 2 MDSs report slow requests 2023-05-08T11:50:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:00 smithi186 ceph-mon[126480]: [WRN] MDS_SLOW_REQUEST: 2 MDSs report slow requests 2023-05-08T11:50:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:00 smithi186 ceph-mon[126480]: mds.i(mds.1): 1 slow requests are blocked > 180 secs 2023-05-08T11:50:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:00 smithi186 ceph-mon[126480]: mds.b(mds.0): 1 slow requests are blocked > 180 secs 2023-05-08T11:50:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:00 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:50:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:01 smithi133 ceph-mon[125939]: pgmap v15596: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 727 KiB/s rd, 939 KiB/s wr, 13 op/s 2023-05-08T11:50:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:01 smithi096 ceph-mon[124666]: pgmap v15596: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 727 KiB/s rd, 939 KiB/s wr, 13 op/s 2023-05-08T11:50:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:01 smithi186 ceph-mon[126480]: pgmap v15596: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 727 KiB/s rd, 939 KiB/s wr, 13 op/s 2023-05-08T11:50:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:03 smithi133 ceph-mon[125939]: pgmap v15597: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 607 KiB/s rd, 837 KiB/s wr, 10 op/s 2023-05-08T11:50:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29143.233867 secs 2023-05-08T11:50:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:03 smithi096 ceph-mon[124666]: pgmap v15597: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 607 KiB/s rd, 837 KiB/s wr, 10 op/s 2023-05-08T11:50:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29143.233867 secs 2023-05-08T11:50:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:03 smithi186 ceph-mon[126480]: pgmap v15597: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 607 KiB/s rd, 837 KiB/s wr, 10 op/s 2023-05-08T11:50:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29143.233867 secs 2023-05-08T11:50:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29143.789726 secs 2023-05-08T11:50:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:04 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:50:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29143.789726 secs 2023-05-08T11:50:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:04 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:50:05.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29143.789726 secs 2023-05-08T11:50:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:04 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:50:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:05 smithi133 ceph-mon[125939]: pgmap v15598: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 29 op/s 2023-05-08T11:50:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:50:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:50:06.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:50:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:05 smithi096 ceph-mon[124666]: pgmap v15598: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 29 op/s 2023-05-08T11:50:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:50:06.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:50:06.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:50:06.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:05 smithi186 ceph-mon[126480]: pgmap v15598: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 29 op/s 2023-05-08T11:50:06.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:50:06.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:50:06.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:50:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:07 smithi133 ceph-mon[125939]: pgmap v15599: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 701 KiB/s rd, 724 KiB/s wr, 25 op/s 2023-05-08T11:50:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:07 smithi096 ceph-mon[124666]: pgmap v15599: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 701 KiB/s rd, 724 KiB/s wr, 25 op/s 2023-05-08T11:50:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:07 smithi186 ceph-mon[126480]: pgmap v15599: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 701 KiB/s rd, 724 KiB/s wr, 25 op/s 2023-05-08T11:50:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29148.234031 secs 2023-05-08T11:50:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29148.234031 secs 2023-05-08T11:50:09.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29148.234031 secs 2023-05-08T11:50:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:09 smithi133 ceph-mon[125939]: pgmap v15600: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 701 KiB/s rd, 724 KiB/s wr, 24 op/s 2023-05-08T11:50:10.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:09 smithi096 ceph-mon[124666]: pgmap v15600: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 701 KiB/s rd, 724 KiB/s wr, 24 op/s 2023-05-08T11:50:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:09 smithi186 ceph-mon[126480]: pgmap v15600: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 701 KiB/s rd, 724 KiB/s wr, 24 op/s 2023-05-08T11:50:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:11 smithi133 ceph-mon[125939]: pgmap v15601: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 912 KiB/s rd, 958 KiB/s wr, 29 op/s 2023-05-08T11:50:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:11 smithi133 ceph-mon[125939]: osdmap e1052: 12 total, 12 up, 12 in 2023-05-08T11:50:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:11 smithi096 ceph-mon[124666]: pgmap v15601: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 912 KiB/s rd, 958 KiB/s wr, 29 op/s 2023-05-08T11:50:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:11 smithi096 ceph-mon[124666]: osdmap e1052: 12 total, 12 up, 12 in 2023-05-08T11:50:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:11 smithi186 ceph-mon[126480]: pgmap v15601: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 912 KiB/s rd, 958 KiB/s wr, 29 op/s 2023-05-08T11:50:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:11 smithi186 ceph-mon[126480]: osdmap e1052: 12 total, 12 up, 12 in 2023-05-08T11:50:13.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:12 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:50:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:12 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:50:13.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:12 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:50:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:13 smithi133 ceph-mon[125939]: pgmap v15603: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 906 KiB/s rd, 684 KiB/s wr, 28 op/s 2023-05-08T11:50:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:13 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:50:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:50:14.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:13 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:50:14.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29153.234191 secs 2023-05-08T11:50:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:13 smithi096 ceph-mon[124666]: pgmap v15603: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 906 KiB/s rd, 684 KiB/s wr, 28 op/s 2023-05-08T11:50:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:13 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:50:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:50:14.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:13 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:50:14.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29153.234191 secs 2023-05-08T11:50:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:13 smithi186 ceph-mon[126480]: pgmap v15603: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 906 KiB/s rd, 684 KiB/s wr, 28 op/s 2023-05-08T11:50:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:13 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:50:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:50:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:13 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:50:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29153.234191 secs 2023-05-08T11:50:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:15 smithi133 ceph-mon[125939]: pgmap v15604: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 684 KiB/s rd, 583 KiB/s wr, 10 op/s 2023-05-08T11:50:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:15 smithi096 ceph-mon[124666]: pgmap v15604: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 684 KiB/s rd, 583 KiB/s wr, 10 op/s 2023-05-08T11:50:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:15 smithi186 ceph-mon[126480]: pgmap v15604: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 684 KiB/s rd, 583 KiB/s wr, 10 op/s 2023-05-08T11:50:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:17 smithi133 ceph-mon[125939]: pgmap v15605: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 684 KiB/s rd, 583 KiB/s wr, 10 op/s 2023-05-08T11:50:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:17 smithi096 ceph-mon[124666]: pgmap v15605: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 684 KiB/s rd, 583 KiB/s wr, 10 op/s 2023-05-08T11:50:18.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:17 smithi186 ceph-mon[126480]: pgmap v15605: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 684 KiB/s rd, 583 KiB/s wr, 10 op/s 2023-05-08T11:50:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29158.234290 secs 2023-05-08T11:50:19.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29158.234290 secs 2023-05-08T11:50:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29158.234290 secs 2023-05-08T11:50:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:19 smithi133 ceph-mon[125939]: pgmap v15606: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 684 KiB/s rd, 583 KiB/s wr, 10 op/s 2023-05-08T11:50:20.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:19 smithi096 ceph-mon[124666]: pgmap v15606: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 684 KiB/s rd, 583 KiB/s wr, 10 op/s 2023-05-08T11:50:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:19 smithi186 ceph-mon[126480]: pgmap v15606: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 684 KiB/s rd, 583 KiB/s wr, 10 op/s 2023-05-08T11:50:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:21 smithi133 ceph-mon[125939]: osdmap e1053: 12 total, 12 up, 12 in 2023-05-08T11:50:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:21 smithi133 ceph-mon[125939]: pgmap v15608: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 309 KiB/s wr, 9 op/s 2023-05-08T11:50:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:21 smithi096 ceph-mon[124666]: osdmap e1053: 12 total, 12 up, 12 in 2023-05-08T11:50:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:21 smithi096 ceph-mon[124666]: pgmap v15608: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 309 KiB/s wr, 9 op/s 2023-05-08T11:50:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:21 smithi186 ceph-mon[126480]: osdmap e1053: 12 total, 12 up, 12 in 2023-05-08T11:50:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:21 smithi186 ceph-mon[126480]: pgmap v15608: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 309 KiB/s wr, 9 op/s 2023-05-08T11:50:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:23 smithi186 ceph-mon[126480]: pgmap v15609: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 432 KiB/s rd, 303 KiB/s wr, 9 op/s 2023-05-08T11:50:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29163.234432 secs 2023-05-08T11:50:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:23 smithi133 ceph-mon[125939]: pgmap v15609: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 432 KiB/s rd, 303 KiB/s wr, 9 op/s 2023-05-08T11:50:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29163.234432 secs 2023-05-08T11:50:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:23 smithi096 ceph-mon[124666]: pgmap v15609: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 432 KiB/s rd, 303 KiB/s wr, 9 op/s 2023-05-08T11:50:24.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29163.234432 secs 2023-05-08T11:50:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:24 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:50:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:24 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:50:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:24 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:50:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:24 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:50:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:24 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:50:25.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:24 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:50:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:24 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:50:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:24 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:50:25.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:24 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:50:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29163.790144 secs 2023-05-08T11:50:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:25 smithi186 ceph-mon[126480]: pgmap v15610: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 442 KiB/s wr, 8 op/s 2023-05-08T11:50:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29163.790144 secs 2023-05-08T11:50:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:25 smithi133 ceph-mon[125939]: pgmap v15610: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 442 KiB/s wr, 8 op/s 2023-05-08T11:50:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29163.790144 secs 2023-05-08T11:50:26.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:25 smithi096 ceph-mon[124666]: pgmap v15610: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 442 KiB/s wr, 8 op/s 2023-05-08T11:50:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29165.079548 secs 2023-05-08T11:50:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29165.079548 secs 2023-05-08T11:50:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29165.079548 secs 2023-05-08T11:50:28.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:27 smithi186 ceph-mon[126480]: pgmap v15611: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 442 KiB/s wr, 8 op/s 2023-05-08T11:50:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:27 smithi133 ceph-mon[125939]: pgmap v15611: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 442 KiB/s wr, 8 op/s 2023-05-08T11:50:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:27 smithi096 ceph-mon[124666]: pgmap v15611: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 442 KiB/s wr, 8 op/s 2023-05-08T11:50:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29168.234550 secs 2023-05-08T11:50:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29168.234550 secs 2023-05-08T11:50:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29168.234550 secs 2023-05-08T11:50:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:29 smithi186 ceph-mon[126480]: pgmap v15612: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 442 KiB/s wr, 8 op/s 2023-05-08T11:50:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:29 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:50:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:29 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:50:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:29 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:50:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:29 smithi133 ceph-mon[125939]: pgmap v15612: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 442 KiB/s wr, 8 op/s 2023-05-08T11:50:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:29 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:50:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:29 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:50:30.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:29 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:50:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:29 smithi096 ceph-mon[124666]: pgmap v15612: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 442 KiB/s wr, 8 op/s 2023-05-08T11:50:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:29 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:50:30.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:29 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:50:30.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:29 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:50:30.984 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29168.790278 secs 2023-05-08T11:50:30.984 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:30 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:50:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29168.790278 secs 2023-05-08T11:50:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:30 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:50:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29168.790278 secs 2023-05-08T11:50:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:30 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:50:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29170.079650 secs 2023-05-08T11:50:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:31 smithi133 ceph-mon[125939]: pgmap v15613: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 591 KiB/s wr, 9 op/s 2023-05-08T11:50:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29170.079650 secs 2023-05-08T11:50:32.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:31 smithi096 ceph-mon[124666]: pgmap v15613: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 591 KiB/s wr, 9 op/s 2023-05-08T11:50:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29170.079650 secs 2023-05-08T11:50:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:31 smithi186 ceph-mon[126480]: pgmap v15613: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 591 KiB/s wr, 9 op/s 2023-05-08T11:50:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:33 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:50:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:33 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:50:33.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:33 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:50:33.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:33 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:50:33.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:33 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:50:33.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:33 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:50:33.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:33 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:50:33.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:33 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:50:33.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:33 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T11:50:33.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:33 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T11:50:33.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:33 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:50:33.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:33 smithi133 ceph-mon[125939]: pgmap v15614: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 497 KiB/s wr, 8 op/s 2023-05-08T11:50:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:33 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:50:33.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:33 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:50:33.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:33 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:50:33.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:33 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:50:33.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:33 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:50:33.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:33 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:50:33.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:33 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:50:33.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:33 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:50:33.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:33 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T11:50:33.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:33 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T11:50:33.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:33 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:50:33.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:33 smithi096 ceph-mon[124666]: pgmap v15614: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 497 KiB/s wr, 8 op/s 2023-05-08T11:50:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:33 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:50:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:33 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:50:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:33 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:50:33.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:33 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:50:33.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:33 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:50:33.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:33 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:50:33.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:33 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:50:33.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:33 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:50:33.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:33 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T11:50:33.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:33 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T11:50:33.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:33 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:50:33.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:33 smithi186 ceph-mon[126480]: pgmap v15614: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 497 KiB/s wr, 8 op/s 2023-05-08T11:50:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29173.234670 secs 2023-05-08T11:50:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29173.234670 secs 2023-05-08T11:50:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29173.234670 secs 2023-05-08T11:50:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29173.790393 secs 2023-05-08T11:50:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:35 smithi133 ceph-mon[125939]: pgmap v15615: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 715 KiB/s rd, 712 KiB/s wr, 11 op/s 2023-05-08T11:50:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29173.790393 secs 2023-05-08T11:50:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:35 smithi096 ceph-mon[124666]: pgmap v15615: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 715 KiB/s rd, 712 KiB/s wr, 11 op/s 2023-05-08T11:50:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29173.790393 secs 2023-05-08T11:50:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:35 smithi186 ceph-mon[126480]: pgmap v15615: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 715 KiB/s rd, 712 KiB/s wr, 11 op/s 2023-05-08T11:50:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29175.079768 secs 2023-05-08T11:50:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29175.079768 secs 2023-05-08T11:50:37.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29175.079768 secs 2023-05-08T11:50:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:37 smithi133 ceph-mon[125939]: pgmap v15616: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 713 KiB/s rd, 344 KiB/s wr, 8 op/s 2023-05-08T11:50:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:37 smithi096 ceph-mon[124666]: pgmap v15616: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 713 KiB/s rd, 344 KiB/s wr, 8 op/s 2023-05-08T11:50:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:37 smithi186 ceph-mon[126480]: pgmap v15616: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 713 KiB/s rd, 344 KiB/s wr, 8 op/s 2023-05-08T11:50:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29178.234778 secs 2023-05-08T11:50:39.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29178.234778 secs 2023-05-08T11:50:39.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29178.234778 secs 2023-05-08T11:50:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:39 smithi133 ceph-mon[125939]: pgmap v15617: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 713 KiB/s rd, 344 KiB/s wr, 8 op/s 2023-05-08T11:50:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:39 smithi096 ceph-mon[124666]: pgmap v15617: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 713 KiB/s rd, 344 KiB/s wr, 8 op/s 2023-05-08T11:50:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:39 smithi186 ceph-mon[126480]: pgmap v15617: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 713 KiB/s rd, 344 KiB/s wr, 8 op/s 2023-05-08T11:50:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29178.790507 secs 2023-05-08T11:50:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29178.790507 secs 2023-05-08T11:50:41.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29178.790507 secs 2023-05-08T11:50:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29180.079864 secs 2023-05-08T11:50:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:41 smithi133 ceph-mon[125939]: pgmap v15618: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 715 KiB/s rd, 454 KiB/s wr, 11 op/s 2023-05-08T11:50:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29180.079864 secs 2023-05-08T11:50:42.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:41 smithi096 ceph-mon[124666]: pgmap v15618: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 715 KiB/s rd, 454 KiB/s wr, 11 op/s 2023-05-08T11:50:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29180.079864 secs 2023-05-08T11:50:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:41 smithi186 ceph-mon[126480]: pgmap v15618: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 715 KiB/s rd, 454 KiB/s wr, 11 op/s 2023-05-08T11:50:44.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:43 smithi186 ceph-mon[126480]: pgmap v15619: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 325 KiB/s wr, 6 op/s 2023-05-08T11:50:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29183.234941 secs 2023-05-08T11:50:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:43 smithi133 ceph-mon[125939]: pgmap v15619: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 325 KiB/s wr, 6 op/s 2023-05-08T11:50:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29183.234941 secs 2023-05-08T11:50:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:43 smithi096 ceph-mon[124666]: pgmap v15619: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 325 KiB/s wr, 6 op/s 2023-05-08T11:50:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29183.234941 secs 2023-05-08T11:50:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29183.790602 secs 2023-05-08T11:50:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:45 smithi186 ceph-mon[126480]: pgmap v15620: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 653 KiB/s rd, 522 KiB/s wr, 10 op/s 2023-05-08T11:50:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29183.790602 secs 2023-05-08T11:50:46.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:45 smithi133 ceph-mon[125939]: pgmap v15620: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 653 KiB/s rd, 522 KiB/s wr, 10 op/s 2023-05-08T11:50:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29183.790602 secs 2023-05-08T11:50:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:45 smithi096 ceph-mon[124666]: pgmap v15620: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 653 KiB/s rd, 522 KiB/s wr, 10 op/s 2023-05-08T11:50:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:47 smithi186 ceph-mon[126480]: pgmap v15621: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 307 KiB/s wr, 6 op/s 2023-05-08T11:50:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:47 smithi133 ceph-mon[125939]: pgmap v15621: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 307 KiB/s wr, 6 op/s 2023-05-08T11:50:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:47 smithi096 ceph-mon[124666]: pgmap v15621: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 307 KiB/s wr, 6 op/s 2023-05-08T11:50:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:50:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29188.235079 secs 2023-05-08T11:50:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:50:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29188.235079 secs 2023-05-08T11:50:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:50:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29188.235079 secs 2023-05-08T11:50:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:49 smithi186 ceph-mon[126480]: pgmap v15622: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 307 KiB/s wr, 6 op/s 2023-05-08T11:50:50.146 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:50:50.146 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:50:50.147 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:50:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:49 smithi133 ceph-mon[125939]: pgmap v15622: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 307 KiB/s wr, 6 op/s 2023-05-08T11:50:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:50:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:50:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:50:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:49 smithi096 ceph-mon[124666]: pgmap v15622: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 307 KiB/s wr, 6 op/s 2023-05-08T11:50:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:50:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:50:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:50:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29188.790678 secs 2023-05-08T11:50:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29188.790678 secs 2023-05-08T11:50:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29188.790678 secs 2023-05-08T11:50:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29190.080088 secs 2023-05-08T11:50:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:51 smithi186 ceph-mon[126480]: pgmap v15623: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 436 KiB/s wr, 10 op/s 2023-05-08T11:50:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29190.080088 secs 2023-05-08T11:50:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:51 smithi133 ceph-mon[125939]: pgmap v15623: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 436 KiB/s wr, 10 op/s 2023-05-08T11:50:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29190.080088 secs 2023-05-08T11:50:52.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:51 smithi096 ceph-mon[124666]: pgmap v15623: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 436 KiB/s wr, 10 op/s 2023-05-08T11:50:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:53 smithi186 ceph-mon[126480]: pgmap v15624: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 326 KiB/s wr, 6 op/s 2023-05-08T11:50:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:50:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:50:54.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29193.235215 secs 2023-05-08T11:50:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:53 smithi133 ceph-mon[125939]: pgmap v15624: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 326 KiB/s wr, 6 op/s 2023-05-08T11:50:54.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:50:54.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:50:54.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29193.235215 secs 2023-05-08T11:50:54.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:53 smithi096 ceph-mon[124666]: pgmap v15624: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 326 KiB/s wr, 6 op/s 2023-05-08T11:50:54.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:50:54.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:50:54.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29193.235215 secs 2023-05-08T11:50:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:55 smithi186 ceph-mon[126480]: pgmap v15625: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 864 KiB/s rd, 647 KiB/s wr, 11 op/s 2023-05-08T11:50:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:55 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:50:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:55 smithi133 ceph-mon[125939]: pgmap v15625: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 864 KiB/s rd, 647 KiB/s wr, 11 op/s 2023-05-08T11:50:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:55 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:50:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:55 smithi096 ceph-mon[124666]: pgmap v15625: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 864 KiB/s rd, 647 KiB/s wr, 11 op/s 2023-05-08T11:50:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:55 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:50:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29195.080210 secs 2023-05-08T11:50:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:50:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29195.080210 secs 2023-05-08T11:50:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:50:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29195.080210 secs 2023-05-08T11:50:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:50:58.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:57 smithi186 ceph-mon[126480]: pgmap v15626: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 450 KiB/s wr, 7 op/s 2023-05-08T11:50:58.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:50:58.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:50:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:57 smithi133 ceph-mon[125939]: pgmap v15626: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 450 KiB/s wr, 7 op/s 2023-05-08T11:50:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:50:58.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:50:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:57 smithi096 ceph-mon[124666]: pgmap v15626: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 450 KiB/s wr, 7 op/s 2023-05-08T11:50:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:50:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:50:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29198.235349 secs 2023-05-08T11:50:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29198.235349 secs 2023-05-08T11:50:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29198.235349 secs 2023-05-08T11:51:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:50:59 smithi186 ceph-mon[126480]: pgmap v15627: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 450 KiB/s wr, 7 op/s 2023-05-08T11:51:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:50:59 smithi133 ceph-mon[125939]: pgmap v15627: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 450 KiB/s wr, 7 op/s 2023-05-08T11:51:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:50:59 smithi096 ceph-mon[124666]: pgmap v15627: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 450 KiB/s wr, 7 op/s 2023-05-08T11:51:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:00 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:51:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:00 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:51:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:00 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:51:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29200.080330 secs 2023-05-08T11:51:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:01 smithi186 ceph-mon[126480]: pgmap v15628: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 670 KiB/s rd, 839 KiB/s wr, 12 op/s 2023-05-08T11:51:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29200.080330 secs 2023-05-08T11:51:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:01 smithi133 ceph-mon[125939]: pgmap v15628: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 670 KiB/s rd, 839 KiB/s wr, 12 op/s 2023-05-08T11:51:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29200.080330 secs 2023-05-08T11:51:02.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:01 smithi096 ceph-mon[124666]: pgmap v15628: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 670 KiB/s rd, 839 KiB/s wr, 12 op/s 2023-05-08T11:51:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:03 smithi186 ceph-mon[126480]: pgmap v15629: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 710 KiB/s wr, 9 op/s 2023-05-08T11:51:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29203.235472 secs 2023-05-08T11:51:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:03 smithi133 ceph-mon[125939]: pgmap v15629: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 710 KiB/s wr, 9 op/s 2023-05-08T11:51:04.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29203.235472 secs 2023-05-08T11:51:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:03 smithi096 ceph-mon[124666]: pgmap v15629: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 710 KiB/s wr, 9 op/s 2023-05-08T11:51:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29203.235472 secs 2023-05-08T11:51:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29203.791014 secs 2023-05-08T11:51:06.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:05 smithi186 ceph-mon[126480]: pgmap v15630: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 27 op/s 2023-05-08T11:51:06.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:51:06.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:51:06.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:05 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:51:06.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29203.791014 secs 2023-05-08T11:51:06.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:05 smithi133 ceph-mon[125939]: pgmap v15630: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 27 op/s 2023-05-08T11:51:06.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:51:06.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:51:06.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:05 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:51:06.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29203.791014 secs 2023-05-08T11:51:06.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:05 smithi096 ceph-mon[124666]: pgmap v15630: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 27 op/s 2023-05-08T11:51:06.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:51:06.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:51:06.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:05 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:51:08.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:07 smithi186 ceph-mon[126480]: pgmap v15631: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 765 KiB/s rd, 704 KiB/s wr, 22 op/s 2023-05-08T11:51:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:07 smithi133 ceph-mon[125939]: pgmap v15631: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 765 KiB/s rd, 704 KiB/s wr, 22 op/s 2023-05-08T11:51:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:07 smithi096 ceph-mon[124666]: pgmap v15631: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 765 KiB/s rd, 704 KiB/s wr, 22 op/s 2023-05-08T11:51:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:08 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:51:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29208.235587 secs 2023-05-08T11:51:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:08 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:51:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29208.235587 secs 2023-05-08T11:51:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:08 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:51:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29208.235587 secs 2023-05-08T11:51:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:09 smithi133 ceph-mon[125939]: pgmap v15632: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 765 KiB/s rd, 704 KiB/s wr, 22 op/s 2023-05-08T11:51:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:51:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:51:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:09 smithi096 ceph-mon[124666]: pgmap v15632: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 765 KiB/s rd, 704 KiB/s wr, 22 op/s 2023-05-08T11:51:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:51:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:51:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:09 smithi186 ceph-mon[126480]: pgmap v15632: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 765 KiB/s rd, 704 KiB/s wr, 22 op/s 2023-05-08T11:51:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:51:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:51:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29208.791129 secs 2023-05-08T11:51:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:10 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:51:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29208.791129 secs 2023-05-08T11:51:11.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:10 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:51:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29208.791129 secs 2023-05-08T11:51:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:10 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:51:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:11 smithi133 ceph-mon[125939]: pgmap v15633: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 815 KiB/s rd, 754 KiB/s wr, 26 op/s 2023-05-08T11:51:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:11 smithi096 ceph-mon[124666]: pgmap v15633: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 815 KiB/s rd, 754 KiB/s wr, 26 op/s 2023-05-08T11:51:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:11 smithi186 ceph-mon[126480]: pgmap v15633: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 815 KiB/s rd, 754 KiB/s wr, 26 op/s 2023-05-08T11:51:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:13 smithi133 ceph-mon[125939]: pgmap v15634: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 701 KiB/s rd, 365 KiB/s wr, 21 op/s 2023-05-08T11:51:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29213.235716 secs 2023-05-08T11:51:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:13 smithi096 ceph-mon[124666]: pgmap v15634: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 701 KiB/s rd, 365 KiB/s wr, 21 op/s 2023-05-08T11:51:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29213.235716 secs 2023-05-08T11:51:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:13 smithi186 ceph-mon[126480]: pgmap v15634: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 701 KiB/s rd, 365 KiB/s wr, 21 op/s 2023-05-08T11:51:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29213.235716 secs 2023-05-08T11:51:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29213.791239 secs 2023-05-08T11:51:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:15 smithi133 ceph-mon[125939]: pgmap v15635: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 779 KiB/s rd, 442 KiB/s wr, 24 op/s 2023-05-08T11:51:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29213.791239 secs 2023-05-08T11:51:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:15 smithi096 ceph-mon[124666]: pgmap v15635: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 779 KiB/s rd, 442 KiB/s wr, 24 op/s 2023-05-08T11:51:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29213.791239 secs 2023-05-08T11:51:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:15 smithi186 ceph-mon[126480]: pgmap v15635: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 779 KiB/s rd, 442 KiB/s wr, 24 op/s 2023-05-08T11:51:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:17 smithi133 ceph-mon[125939]: pgmap v15636: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 343 KiB/s wr, 7 op/s 2023-05-08T11:51:18.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:17 smithi096 ceph-mon[124666]: pgmap v15636: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 343 KiB/s wr, 7 op/s 2023-05-08T11:51:18.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:17 smithi186 ceph-mon[126480]: pgmap v15636: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 343 KiB/s wr, 7 op/s 2023-05-08T11:51:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29218.235830 secs 2023-05-08T11:51:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29218.235830 secs 2023-05-08T11:51:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29218.235830 secs 2023-05-08T11:51:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:19 smithi133 ceph-mon[125939]: pgmap v15637: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 343 KiB/s wr, 7 op/s 2023-05-08T11:51:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:19 smithi096 ceph-mon[124666]: pgmap v15637: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 343 KiB/s wr, 7 op/s 2023-05-08T11:51:20.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:19 smithi186 ceph-mon[126480]: pgmap v15637: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 343 KiB/s wr, 7 op/s 2023-05-08T11:51:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:20 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:51:21.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:20 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:51:21.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:20 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:51:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:21 smithi133 ceph-mon[125939]: pgmap v15638: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 734 KiB/s wr, 14 op/s 2023-05-08T11:51:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:21 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:51:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:21 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:51:22.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:21 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:51:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:21 smithi096 ceph-mon[124666]: pgmap v15638: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 734 KiB/s wr, 14 op/s 2023-05-08T11:51:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:21 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:51:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:21 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:51:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:21 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:51:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:21 smithi186 ceph-mon[126480]: pgmap v15638: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 734 KiB/s wr, 14 op/s 2023-05-08T11:51:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:21 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:51:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:21 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:51:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:21 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:51:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:23 smithi133 ceph-mon[125939]: pgmap v15639: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 685 KiB/s wr, 10 op/s 2023-05-08T11:51:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29223.235961 secs 2023-05-08T11:51:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:23 smithi096 ceph-mon[124666]: pgmap v15639: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 685 KiB/s wr, 10 op/s 2023-05-08T11:51:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29223.235961 secs 2023-05-08T11:51:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:23 smithi186 ceph-mon[126480]: pgmap v15639: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 685 KiB/s wr, 10 op/s 2023-05-08T11:51:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29223.235961 secs 2023-05-08T11:51:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:25 smithi133 ceph-mon[125939]: pgmap v15640: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 669 KiB/s rd, 754 KiB/s wr, 14 op/s 2023-05-08T11:51:26.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:25 smithi096 ceph-mon[124666]: pgmap v15640: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 669 KiB/s rd, 754 KiB/s wr, 14 op/s 2023-05-08T11:51:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:25 smithi186 ceph-mon[126480]: pgmap v15640: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 669 KiB/s rd, 754 KiB/s wr, 14 op/s 2023-05-08T11:51:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:26 smithi133 ceph-mon[125939]: osdmap e1054: 12 total, 12 up, 12 in 2023-05-08T11:51:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:26 smithi096 ceph-mon[124666]: osdmap e1054: 12 total, 12 up, 12 in 2023-05-08T11:51:27.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:26 smithi186 ceph-mon[126480]: osdmap e1054: 12 total, 12 up, 12 in 2023-05-08T11:51:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:27 smithi133 ceph-mon[125939]: pgmap v15642: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 859 KiB/s wr, 12 op/s 2023-05-08T11:51:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:27 smithi096 ceph-mon[124666]: pgmap v15642: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 859 KiB/s wr, 12 op/s 2023-05-08T11:51:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:27 smithi186 ceph-mon[126480]: pgmap v15642: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 859 KiB/s wr, 12 op/s 2023-05-08T11:51:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29228.236077 secs 2023-05-08T11:51:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29228.236077 secs 2023-05-08T11:51:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29228.236077 secs 2023-05-08T11:51:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:29 smithi133 ceph-mon[125939]: pgmap v15643: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 859 KiB/s wr, 12 op/s 2023-05-08T11:51:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:29 smithi096 ceph-mon[124666]: pgmap v15643: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 859 KiB/s wr, 12 op/s 2023-05-08T11:51:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:29 smithi186 ceph-mon[126480]: pgmap v15643: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 859 KiB/s wr, 12 op/s 2023-05-08T11:51:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:31 smithi133 ceph-mon[125939]: pgmap v15644: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 789 KiB/s rd, 518 KiB/s wr, 10 op/s 2023-05-08T11:51:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:31 smithi096 ceph-mon[124666]: pgmap v15644: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 789 KiB/s rd, 518 KiB/s wr, 10 op/s 2023-05-08T11:51:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:31 smithi186 ceph-mon[126480]: pgmap v15644: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 789 KiB/s rd, 518 KiB/s wr, 10 op/s 2023-05-08T11:51:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:51:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:51:33.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:51:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:33 smithi133 ceph-mon[125939]: pgmap v15645: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 789 KiB/s rd, 518 KiB/s wr, 10 op/s 2023-05-08T11:51:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29233.236165 secs 2023-05-08T11:51:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:33 smithi096 ceph-mon[124666]: pgmap v15645: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 789 KiB/s rd, 518 KiB/s wr, 10 op/s 2023-05-08T11:51:34.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29233.236165 secs 2023-05-08T11:51:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:33 smithi186 ceph-mon[126480]: pgmap v15645: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 789 KiB/s rd, 518 KiB/s wr, 10 op/s 2023-05-08T11:51:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29233.236165 secs 2023-05-08T11:51:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:35 smithi186 ceph-mon[126480]: pgmap v15646: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 496 KiB/s rd, 457 KiB/s wr, 9 op/s 2023-05-08T11:51:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:35 smithi186 ceph-mon[126480]: osdmap e1055: 12 total, 12 up, 12 in 2023-05-08T11:51:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:35 smithi133 ceph-mon[125939]: pgmap v15646: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 496 KiB/s rd, 457 KiB/s wr, 9 op/s 2023-05-08T11:51:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:35 smithi133 ceph-mon[125939]: osdmap e1055: 12 total, 12 up, 12 in 2023-05-08T11:51:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:35 smithi096 ceph-mon[124666]: pgmap v15646: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 496 KiB/s rd, 457 KiB/s wr, 9 op/s 2023-05-08T11:51:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:35 smithi096 ceph-mon[124666]: osdmap e1055: 12 total, 12 up, 12 in 2023-05-08T11:51:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29235.081128 secs 2023-05-08T11:51:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:51:37.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:51:37.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:51:37.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:51:37.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:36 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:51:37.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:51:37.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:36 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T11:51:37.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:36 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T11:51:37.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:36 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:51:37.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29235.081128 secs 2023-05-08T11:51:37.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:51:37.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:51:37.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:51:37.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:51:37.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:36 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:51:37.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:51:37.259 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:36 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T11:51:37.259 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:36 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T11:51:37.259 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:36 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:51:37.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29235.081128 secs 2023-05-08T11:51:37.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:51:37.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:51:37.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:51:37.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:51:37.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:36 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:51:37.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:51:37.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:36 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T11:51:37.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:36 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T11:51:37.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:36 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:51:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:37 smithi133 ceph-mon[125939]: pgmap v15648: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 560 KiB/s wr, 10 op/s 2023-05-08T11:51:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:37 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:51:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:37 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:51:38.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:37 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:51:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:37 smithi096 ceph-mon[124666]: pgmap v15648: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 560 KiB/s wr, 10 op/s 2023-05-08T11:51:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:37 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:51:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:37 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:51:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:37 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:51:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:37 smithi186 ceph-mon[126480]: pgmap v15648: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 560 KiB/s wr, 10 op/s 2023-05-08T11:51:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:37 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:51:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:37 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:51:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:37 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:51:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29238.236314 secs 2023-05-08T11:51:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29238.236314 secs 2023-05-08T11:51:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29238.236314 secs 2023-05-08T11:51:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:39 smithi133 ceph-mon[125939]: pgmap v15649: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 560 KiB/s wr, 10 op/s 2023-05-08T11:51:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:39 smithi096 ceph-mon[124666]: pgmap v15649: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 560 KiB/s wr, 10 op/s 2023-05-08T11:51:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:39 smithi186 ceph-mon[126480]: pgmap v15649: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 560 KiB/s wr, 10 op/s 2023-05-08T11:51:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29238.791865 secs 2023-05-08T11:51:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29238.791865 secs 2023-05-08T11:51:41.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29238.791865 secs 2023-05-08T11:51:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29240.081238 secs 2023-05-08T11:51:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:41 smithi133 ceph-mon[125939]: pgmap v15650: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 812 KiB/s wr, 10 op/s 2023-05-08T11:51:42.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:41 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:51:42.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:41 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:51:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29240.081238 secs 2023-05-08T11:51:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:41 smithi096 ceph-mon[124666]: pgmap v15650: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 812 KiB/s wr, 10 op/s 2023-05-08T11:51:42.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:41 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:51:42.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:41 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:51:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29240.081238 secs 2023-05-08T11:51:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:41 smithi186 ceph-mon[126480]: pgmap v15650: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 812 KiB/s wr, 10 op/s 2023-05-08T11:51:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:41 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:51:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:41 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:51:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:43 smithi133 ceph-mon[125939]: pgmap v15651: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 812 KiB/s wr, 10 op/s 2023-05-08T11:51:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29243.236424 secs 2023-05-08T11:51:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:43 smithi096 ceph-mon[124666]: pgmap v15651: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 812 KiB/s wr, 10 op/s 2023-05-08T11:51:44.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29243.236424 secs 2023-05-08T11:51:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:43 smithi186 ceph-mon[126480]: pgmap v15651: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 812 KiB/s wr, 10 op/s 2023-05-08T11:51:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29243.236424 secs 2023-05-08T11:51:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29243.791986 secs 2023-05-08T11:51:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:45 smithi133 ceph-mon[125939]: pgmap v15652: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 13 op/s 2023-05-08T11:51:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:45 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:51:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29243.791986 secs 2023-05-08T11:51:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:45 smithi096 ceph-mon[124666]: pgmap v15652: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 13 op/s 2023-05-08T11:51:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:45 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:51:46.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29243.791986 secs 2023-05-08T11:51:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:45 smithi186 ceph-mon[126480]: pgmap v15652: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 13 op/s 2023-05-08T11:51:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:45 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:51:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29245.081350 secs 2023-05-08T11:51:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29245.081350 secs 2023-05-08T11:51:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29245.081350 secs 2023-05-08T11:51:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:47 smithi133 ceph-mon[125939]: pgmap v15653: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 855 KiB/s rd, 1004 KiB/s wr, 10 op/s 2023-05-08T11:51:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:47 smithi096 ceph-mon[124666]: pgmap v15653: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 855 KiB/s rd, 1004 KiB/s wr, 10 op/s 2023-05-08T11:51:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:47 smithi186 ceph-mon[126480]: pgmap v15653: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 855 KiB/s rd, 1004 KiB/s wr, 10 op/s 2023-05-08T11:51:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29248.236563 secs 2023-05-08T11:51:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29248.236563 secs 2023-05-08T11:51:49.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29248.236563 secs 2023-05-08T11:51:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:49 smithi133 ceph-mon[125939]: pgmap v15654: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 790 KiB/s rd, 928 KiB/s wr, 9 op/s 2023-05-08T11:51:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:49 smithi096 ceph-mon[124666]: pgmap v15654: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 790 KiB/s rd, 928 KiB/s wr, 9 op/s 2023-05-08T11:51:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:49 smithi186 ceph-mon[126480]: pgmap v15654: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 790 KiB/s rd, 928 KiB/s wr, 9 op/s 2023-05-08T11:51:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29250.081484 secs 2023-05-08T11:51:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:51 smithi133 ceph-mon[125939]: pgmap v15655: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 982 KiB/s rd, 950 KiB/s wr, 15 op/s 2023-05-08T11:51:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29250.081484 secs 2023-05-08T11:51:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:51 smithi096 ceph-mon[124666]: pgmap v15655: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 982 KiB/s rd, 950 KiB/s wr, 15 op/s 2023-05-08T11:51:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29250.081484 secs 2023-05-08T11:51:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:51 smithi186 ceph-mon[126480]: pgmap v15655: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 982 KiB/s rd, 950 KiB/s wr, 15 op/s 2023-05-08T11:51:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:51:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:51:53.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:51:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:53 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:51:53.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:51:53.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:51:53.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:53 smithi133 ceph-mon[125939]: pgmap v15656: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 647 KiB/s rd, 634 KiB/s wr, 10 op/s 2023-05-08T11:51:53.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29253.236657 secs 2023-05-08T11:51:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:53 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:51:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:51:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:51:54.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:53 smithi096 ceph-mon[124666]: pgmap v15656: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 647 KiB/s rd, 634 KiB/s wr, 10 op/s 2023-05-08T11:51:54.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29253.236657 secs 2023-05-08T11:51:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:53 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:51:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:51:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:51:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:53 smithi186 ceph-mon[126480]: pgmap v15656: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 647 KiB/s rd, 634 KiB/s wr, 10 op/s 2023-05-08T11:51:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29253.236657 secs 2023-05-08T11:51:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29253.792224 secs 2023-05-08T11:51:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:55 smithi186 ceph-mon[126480]: pgmap v15657: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 15 op/s 2023-05-08T11:51:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29253.792224 secs 2023-05-08T11:51:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:55 smithi133 ceph-mon[125939]: pgmap v15657: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 15 op/s 2023-05-08T11:51:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29253.792224 secs 2023-05-08T11:51:56.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:55 smithi096 ceph-mon[124666]: pgmap v15657: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 15 op/s 2023-05-08T11:51:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29255.081549 secs 2023-05-08T11:51:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29255.081549 secs 2023-05-08T11:51:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29255.081549 secs 2023-05-08T11:51:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:57 smithi186 ceph-mon[126480]: pgmap v15658: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 900 KiB/s rd, 991 KiB/s wr, 10 op/s 2023-05-08T11:51:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:51:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:51:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:57 smithi133 ceph-mon[125939]: pgmap v15658: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 900 KiB/s rd, 991 KiB/s wr, 10 op/s 2023-05-08T11:51:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:51:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:51:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:57 smithi096 ceph-mon[124666]: pgmap v15658: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 900 KiB/s rd, 991 KiB/s wr, 10 op/s 2023-05-08T11:51:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:51:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:51:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29258.236770 secs 2023-05-08T11:51:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29258.236770 secs 2023-05-08T11:51:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29258.236770 secs 2023-05-08T11:52:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:51:59 smithi186 ceph-mon[126480]: pgmap v15659: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 900 KiB/s rd, 992 KiB/s wr, 10 op/s 2023-05-08T11:52:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:51:59 smithi133 ceph-mon[125939]: pgmap v15659: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 900 KiB/s rd, 992 KiB/s wr, 10 op/s 2023-05-08T11:52:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:51:59 smithi096 ceph-mon[124666]: pgmap v15659: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 900 KiB/s rd, 992 KiB/s wr, 10 op/s 2023-05-08T11:52:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29258.792371 secs 2023-05-08T11:52:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:00 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:52:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29258.792371 secs 2023-05-08T11:52:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:00 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:52:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29258.792371 secs 2023-05-08T11:52:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:00 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:52:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29260.081674 secs 2023-05-08T11:52:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:01 smithi186 ceph-mon[126480]: pgmap v15660: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 16 op/s 2023-05-08T11:52:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29260.081674 secs 2023-05-08T11:52:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:01 smithi133 ceph-mon[125939]: pgmap v15660: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 16 op/s 2023-05-08T11:52:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29260.081674 secs 2023-05-08T11:52:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:01 smithi096 ceph-mon[124666]: pgmap v15660: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 16 op/s 2023-05-08T11:52:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:03 smithi186 ceph-mon[126480]: pgmap v15661: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 11 op/s 2023-05-08T11:52:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29263.236866 secs 2023-05-08T11:52:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:03 smithi133 ceph-mon[125939]: pgmap v15661: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 11 op/s 2023-05-08T11:52:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29263.236866 secs 2023-05-08T11:52:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:03 smithi096 ceph-mon[124666]: pgmap v15661: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 11 op/s 2023-05-08T11:52:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29263.236866 secs 2023-05-08T11:52:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29263.792512 secs 2023-05-08T11:52:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:05 smithi186 ceph-mon[126480]: pgmap v15662: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 30 op/s 2023-05-08T11:52:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29263.792512 secs 2023-05-08T11:52:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:05 smithi133 ceph-mon[125939]: pgmap v15662: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 30 op/s 2023-05-08T11:52:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29263.792512 secs 2023-05-08T11:52:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:05 smithi096 ceph-mon[124666]: pgmap v15662: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 30 op/s 2023-05-08T11:52:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29265.081810 secs 2023-05-08T11:52:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:06 smithi186 ceph-mon[126480]: osdmap e1056: 12 total, 12 up, 12 in 2023-05-08T11:52:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29265.081810 secs 2023-05-08T11:52:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:06 smithi133 ceph-mon[125939]: osdmap e1056: 12 total, 12 up, 12 in 2023-05-08T11:52:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29265.081810 secs 2023-05-08T11:52:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:06 smithi096 ceph-mon[124666]: osdmap e1056: 12 total, 12 up, 12 in 2023-05-08T11:52:08.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:07 smithi186 ceph-mon[126480]: pgmap v15664: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 30 op/s 2023-05-08T11:52:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:07 smithi133 ceph-mon[125939]: pgmap v15664: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 30 op/s 2023-05-08T11:52:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:07 smithi096 ceph-mon[124666]: pgmap v15664: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 30 op/s 2023-05-08T11:52:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29268.236967 secs 2023-05-08T11:52:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29268.236967 secs 2023-05-08T11:52:09.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29268.236967 secs 2023-05-08T11:52:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:09 smithi133 ceph-mon[125939]: pgmap v15665: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 30 op/s 2023-05-08T11:52:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:09 smithi096 ceph-mon[124666]: pgmap v15665: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 30 op/s 2023-05-08T11:52:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:09 smithi186 ceph-mon[126480]: pgmap v15665: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 30 op/s 2023-05-08T11:52:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29268.792614 secs 2023-05-08T11:52:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29268.792614 secs 2023-05-08T11:52:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29268.792614 secs 2023-05-08T11:52:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29270.081927 secs 2023-05-08T11:52:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:11 smithi133 ceph-mon[125939]: pgmap v15666: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 540 KiB/s rd, 585 KiB/s wr, 27 op/s 2023-05-08T11:52:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29270.081927 secs 2023-05-08T11:52:12.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:11 smithi096 ceph-mon[124666]: pgmap v15666: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 540 KiB/s rd, 585 KiB/s wr, 27 op/s 2023-05-08T11:52:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29270.081927 secs 2023-05-08T11:52:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:11 smithi186 ceph-mon[126480]: pgmap v15666: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 540 KiB/s rd, 585 KiB/s wr, 27 op/s 2023-05-08T11:52:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:13 smithi133 ceph-mon[125939]: pgmap v15667: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 540 KiB/s rd, 585 KiB/s wr, 27 op/s 2023-05-08T11:52:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29273.237109 secs 2023-05-08T11:52:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:13 smithi096 ceph-mon[124666]: pgmap v15667: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 540 KiB/s rd, 585 KiB/s wr, 27 op/s 2023-05-08T11:52:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29273.237109 secs 2023-05-08T11:52:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:13 smithi186 ceph-mon[126480]: pgmap v15667: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 540 KiB/s rd, 585 KiB/s wr, 27 op/s 2023-05-08T11:52:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29273.237109 secs 2023-05-08T11:52:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29273.792731 secs 2023-05-08T11:52:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:15 smithi133 ceph-mon[125939]: pgmap v15668: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 709 KiB/s rd, 496 KiB/s wr, 8 op/s 2023-05-08T11:52:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:15 smithi133 ceph-mon[125939]: osdmap e1057: 12 total, 12 up, 12 in 2023-05-08T11:52:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29273.792731 secs 2023-05-08T11:52:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:15 smithi096 ceph-mon[124666]: pgmap v15668: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 709 KiB/s rd, 496 KiB/s wr, 8 op/s 2023-05-08T11:52:16.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:15 smithi096 ceph-mon[124666]: osdmap e1057: 12 total, 12 up, 12 in 2023-05-08T11:52:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29273.792731 secs 2023-05-08T11:52:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:15 smithi186 ceph-mon[126480]: pgmap v15668: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 709 KiB/s rd, 496 KiB/s wr, 8 op/s 2023-05-08T11:52:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:15 smithi186 ceph-mon[126480]: osdmap e1057: 12 total, 12 up, 12 in 2023-05-08T11:52:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29275.082001 secs 2023-05-08T11:52:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29275.082001 secs 2023-05-08T11:52:17.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29275.082001 secs 2023-05-08T11:52:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:17 smithi133 ceph-mon[125939]: pgmap v15670: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 709 KiB/s rd, 496 KiB/s wr, 8 op/s 2023-05-08T11:52:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:17 smithi096 ceph-mon[124666]: pgmap v15670: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 709 KiB/s rd, 496 KiB/s wr, 8 op/s 2023-05-08T11:52:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:17 smithi186 ceph-mon[126480]: pgmap v15670: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 709 KiB/s rd, 496 KiB/s wr, 8 op/s 2023-05-08T11:52:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29278.237237 secs 2023-05-08T11:52:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29278.237237 secs 2023-05-08T11:52:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29278.237237 secs 2023-05-08T11:52:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:19 smithi133 ceph-mon[125939]: pgmap v15671: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 709 KiB/s rd, 496 KiB/s wr, 8 op/s 2023-05-08T11:52:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:19 smithi096 ceph-mon[124666]: pgmap v15671: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 709 KiB/s rd, 496 KiB/s wr, 8 op/s 2023-05-08T11:52:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:19 smithi186 ceph-mon[126480]: pgmap v15671: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 709 KiB/s rd, 496 KiB/s wr, 8 op/s 2023-05-08T11:52:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29278.792850 secs 2023-05-08T11:52:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29278.792850 secs 2023-05-08T11:52:21.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29278.792850 secs 2023-05-08T11:52:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29280.082074 secs 2023-05-08T11:52:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:21 smithi133 ceph-mon[125939]: pgmap v15672: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 604 KiB/s rd, 412 KiB/s wr, 8 op/s 2023-05-08T11:52:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29280.082074 secs 2023-05-08T11:52:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:21 smithi096 ceph-mon[124666]: pgmap v15672: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 604 KiB/s rd, 412 KiB/s wr, 8 op/s 2023-05-08T11:52:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29280.082074 secs 2023-05-08T11:52:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:21 smithi186 ceph-mon[126480]: pgmap v15672: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 604 KiB/s rd, 412 KiB/s wr, 8 op/s 2023-05-08T11:52:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:23 smithi133 ceph-mon[125939]: pgmap v15673: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 604 KiB/s rd, 412 KiB/s wr, 8 op/s 2023-05-08T11:52:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29283.237375 secs 2023-05-08T11:52:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:23 smithi096 ceph-mon[124666]: pgmap v15673: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 604 KiB/s rd, 412 KiB/s wr, 8 op/s 2023-05-08T11:52:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29283.237375 secs 2023-05-08T11:52:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:23 smithi186 ceph-mon[126480]: pgmap v15673: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 604 KiB/s rd, 412 KiB/s wr, 8 op/s 2023-05-08T11:52:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29283.237375 secs 2023-05-08T11:52:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29283.792995 secs 2023-05-08T11:52:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:25 smithi133 ceph-mon[125939]: pgmap v15674: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 45 KiB/s wr, 8 op/s 2023-05-08T11:52:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29283.792995 secs 2023-05-08T11:52:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:25 smithi096 ceph-mon[124666]: pgmap v15674: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 45 KiB/s wr, 8 op/s 2023-05-08T11:52:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29283.792995 secs 2023-05-08T11:52:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:25 smithi186 ceph-mon[126480]: pgmap v15674: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 45 KiB/s wr, 8 op/s 2023-05-08T11:52:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29285.082212 secs 2023-05-08T11:52:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29285.082212 secs 2023-05-08T11:52:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29285.082212 secs 2023-05-08T11:52:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:27 smithi133 ceph-mon[125939]: pgmap v15675: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 41 KiB/s wr, 7 op/s 2023-05-08T11:52:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:27 smithi096 ceph-mon[124666]: pgmap v15675: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 41 KiB/s wr, 7 op/s 2023-05-08T11:52:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:27 smithi186 ceph-mon[126480]: pgmap v15675: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 41 KiB/s wr, 7 op/s 2023-05-08T11:52:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29288.237421 secs 2023-05-08T11:52:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29288.237421 secs 2023-05-08T11:52:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29288.237421 secs 2023-05-08T11:52:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:29 smithi133 ceph-mon[125939]: pgmap v15676: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 38 KiB/s wr, 7 op/s 2023-05-08T11:52:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:29 smithi096 ceph-mon[124666]: pgmap v15676: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 38 KiB/s wr, 7 op/s 2023-05-08T11:52:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:29 smithi186 ceph-mon[126480]: pgmap v15676: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 38 KiB/s wr, 7 op/s 2023-05-08T11:52:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29288.793129 secs 2023-05-08T11:52:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29288.793129 secs 2023-05-08T11:52:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29288.793129 secs 2023-05-08T11:52:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29290.082335 secs 2023-05-08T11:52:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:31 smithi133 ceph-mon[125939]: pgmap v15677: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 56 KiB/s wr, 11 op/s 2023-05-08T11:52:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29290.082335 secs 2023-05-08T11:52:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:31 smithi096 ceph-mon[124666]: pgmap v15677: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 56 KiB/s wr, 11 op/s 2023-05-08T11:52:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29290.082335 secs 2023-05-08T11:52:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:31 smithi186 ceph-mon[126480]: pgmap v15677: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 56 KiB/s wr, 11 op/s 2023-05-08T11:52:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:33 smithi133 ceph-mon[125939]: pgmap v15678: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 38 KiB/s wr, 8 op/s 2023-05-08T11:52:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29293.237544 secs 2023-05-08T11:52:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:33 smithi096 ceph-mon[124666]: pgmap v15678: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 38 KiB/s wr, 8 op/s 2023-05-08T11:52:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29293.237544 secs 2023-05-08T11:52:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:33 smithi186 ceph-mon[126480]: pgmap v15678: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 38 KiB/s wr, 8 op/s 2023-05-08T11:52:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29293.237544 secs 2023-05-08T11:52:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29293.793221 secs 2023-05-08T11:52:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:35 smithi133 ceph-mon[125939]: pgmap v15679: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 132 KiB/s wr, 12 op/s 2023-05-08T11:52:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29293.793221 secs 2023-05-08T11:52:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:35 smithi096 ceph-mon[124666]: pgmap v15679: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 132 KiB/s wr, 12 op/s 2023-05-08T11:52:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29293.793221 secs 2023-05-08T11:52:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:35 smithi186 ceph-mon[126480]: pgmap v15679: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 132 KiB/s wr, 12 op/s 2023-05-08T11:52:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29295.082452 secs 2023-05-08T11:52:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:52:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:52:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:52:37.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:52:37.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29295.082452 secs 2023-05-08T11:52:37.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:52:37.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:52:37.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:52:37.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:52:37.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29295.082452 secs 2023-05-08T11:52:37.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:52:37.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:52:37.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:52:37.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:52:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:37 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:52:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:37 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T11:52:38.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:37 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T11:52:38.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:37 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:52:38.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:37 smithi133 ceph-mon[125939]: pgmap v15680: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 113 KiB/s wr, 8 op/s 2023-05-08T11:52:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:37 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:52:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:37 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T11:52:38.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:37 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T11:52:38.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:37 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:52:38.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:37 smithi096 ceph-mon[124666]: pgmap v15680: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 113 KiB/s wr, 8 op/s 2023-05-08T11:52:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:37 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:52:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:37 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T11:52:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:37 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T11:52:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:37 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:52:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:37 smithi186 ceph-mon[126480]: pgmap v15680: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 113 KiB/s wr, 8 op/s 2023-05-08T11:52:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29298.237640 secs 2023-05-08T11:52:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29298.237640 secs 2023-05-08T11:52:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29298.237640 secs 2023-05-08T11:52:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:39 smithi133 ceph-mon[125939]: pgmap v15681: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 113 KiB/s wr, 8 op/s 2023-05-08T11:52:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:39 smithi096 ceph-mon[124666]: pgmap v15681: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 113 KiB/s wr, 8 op/s 2023-05-08T11:52:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:39 smithi186 ceph-mon[126480]: pgmap v15681: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 113 KiB/s wr, 8 op/s 2023-05-08T11:52:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29298.793360 secs 2023-05-08T11:52:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29298.793360 secs 2023-05-08T11:52:41.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29298.793360 secs 2023-05-08T11:52:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29300.082596 secs 2023-05-08T11:52:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:41 smithi133 ceph-mon[125939]: pgmap v15682: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 113 KiB/s wr, 12 op/s 2023-05-08T11:52:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29300.082596 secs 2023-05-08T11:52:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:41 smithi096 ceph-mon[124666]: pgmap v15682: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 113 KiB/s wr, 12 op/s 2023-05-08T11:52:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29300.082596 secs 2023-05-08T11:52:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:41 smithi186 ceph-mon[126480]: pgmap v15682: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 113 KiB/s wr, 12 op/s 2023-05-08T11:52:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:43 smithi133 ceph-mon[125939]: pgmap v15683: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 94 KiB/s wr, 8 op/s 2023-05-08T11:52:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29303.237797 secs 2023-05-08T11:52:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:43 smithi096 ceph-mon[124666]: pgmap v15683: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 94 KiB/s wr, 8 op/s 2023-05-08T11:52:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29303.237797 secs 2023-05-08T11:52:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:43 smithi186 ceph-mon[126480]: pgmap v15683: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 94 KiB/s wr, 8 op/s 2023-05-08T11:52:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29303.237797 secs 2023-05-08T11:52:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29303.793494 secs 2023-05-08T11:52:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29303.793494 secs 2023-05-08T11:52:45.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29303.793494 secs 2023-05-08T11:52:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:45 smithi133 ceph-mon[125939]: pgmap v15684: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 343 KiB/s wr, 12 op/s 2023-05-08T11:52:46.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:45 smithi096 ceph-mon[124666]: pgmap v15684: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 343 KiB/s wr, 12 op/s 2023-05-08T11:52:46.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:45 smithi186 ceph-mon[126480]: pgmap v15684: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 343 KiB/s wr, 12 op/s 2023-05-08T11:52:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:47 smithi133 ceph-mon[125939]: pgmap v15685: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 249 KiB/s wr, 8 op/s 2023-05-08T11:52:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:47 smithi096 ceph-mon[124666]: pgmap v15685: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 249 KiB/s wr, 8 op/s 2023-05-08T11:52:48.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:47 smithi186 ceph-mon[126480]: pgmap v15685: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 249 KiB/s wr, 8 op/s 2023-05-08T11:52:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:52:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29308.237857 secs 2023-05-08T11:52:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:52:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29308.237857 secs 2023-05-08T11:52:49.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:52:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29308.237857 secs 2023-05-08T11:52:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:49 smithi133 ceph-mon[125939]: pgmap v15686: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 249 KiB/s wr, 8 op/s 2023-05-08T11:52:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:52:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:52:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:52:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29308.793603 secs 2023-05-08T11:52:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:49 smithi096 ceph-mon[124666]: pgmap v15686: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 249 KiB/s wr, 8 op/s 2023-05-08T11:52:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:52:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:52:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:52:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29308.793603 secs 2023-05-08T11:52:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:49 smithi186 ceph-mon[126480]: pgmap v15686: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 249 KiB/s wr, 8 op/s 2023-05-08T11:52:50.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:52:50.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:52:50.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:52:50.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29308.793603 secs 2023-05-08T11:52:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:51 smithi133 ceph-mon[125939]: pgmap v15687: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 331 KiB/s wr, 11 op/s 2023-05-08T11:52:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:51 smithi096 ceph-mon[124666]: pgmap v15687: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 331 KiB/s wr, 11 op/s 2023-05-08T11:52:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:51 smithi186 ceph-mon[126480]: pgmap v15687: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 331 KiB/s wr, 11 op/s 2023-05-08T11:52:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:53 smithi186 ceph-mon[126480]: pgmap v15688: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 331 KiB/s wr, 7 op/s 2023-05-08T11:52:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29313.238002 secs 2023-05-08T11:52:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:53 smithi133 ceph-mon[125939]: pgmap v15688: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 331 KiB/s wr, 7 op/s 2023-05-08T11:52:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29313.238002 secs 2023-05-08T11:52:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:53 smithi096 ceph-mon[124666]: pgmap v15688: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 331 KiB/s wr, 7 op/s 2023-05-08T11:52:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29313.238002 secs 2023-05-08T11:52:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:55 smithi186 ceph-mon[126480]: pgmap v15689: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 797 KiB/s wr, 12 op/s 2023-05-08T11:52:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:55 smithi133 ceph-mon[125939]: pgmap v15689: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 797 KiB/s wr, 12 op/s 2023-05-08T11:52:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:55 smithi096 ceph-mon[124666]: pgmap v15689: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 797 KiB/s wr, 12 op/s 2023-05-08T11:52:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:52:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:52:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:52:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:57 smithi186 ceph-mon[126480]: pgmap v15690: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 594 KiB/s rd, 549 KiB/s wr, 8 op/s 2023-05-08T11:52:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:57 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:52:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:52:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:52:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:57 smithi133 ceph-mon[125939]: pgmap v15690: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 594 KiB/s rd, 549 KiB/s wr, 8 op/s 2023-05-08T11:52:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:57 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:52:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:52:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:52:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:57 smithi096 ceph-mon[124666]: pgmap v15690: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 594 KiB/s rd, 549 KiB/s wr, 8 op/s 2023-05-08T11:52:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:57 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:52:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:52:58.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:52:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29318.238125 secs 2023-05-08T11:52:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29318.238125 secs 2023-05-08T11:52:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29318.238125 secs 2023-05-08T11:53:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:52:59 smithi186 ceph-mon[126480]: pgmap v15691: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 594 KiB/s rd, 549 KiB/s wr, 8 op/s 2023-05-08T11:53:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:52:59 smithi133 ceph-mon[125939]: pgmap v15691: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 594 KiB/s rd, 549 KiB/s wr, 8 op/s 2023-05-08T11:53:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:52:59 smithi096 ceph-mon[124666]: pgmap v15691: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 594 KiB/s rd, 549 KiB/s wr, 8 op/s 2023-05-08T11:53:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29320.083001 secs 2023-05-08T11:53:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:01 smithi133 ceph-mon[125939]: pgmap v15692: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1010 KiB/s rd, 943 KiB/s wr, 14 op/s 2023-05-08T11:53:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29320.083001 secs 2023-05-08T11:53:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:01 smithi096 ceph-mon[124666]: pgmap v15692: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1010 KiB/s rd, 943 KiB/s wr, 14 op/s 2023-05-08T11:53:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29320.083001 secs 2023-05-08T11:53:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:01 smithi186 ceph-mon[126480]: pgmap v15692: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1010 KiB/s rd, 943 KiB/s wr, 14 op/s 2023-05-08T11:53:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:03 smithi186 ceph-mon[126480]: pgmap v15693: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 873 KiB/s rd, 861 KiB/s wr, 10 op/s 2023-05-08T11:53:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29323.238273 secs 2023-05-08T11:53:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:03 smithi133 ceph-mon[125939]: pgmap v15693: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 873 KiB/s rd, 861 KiB/s wr, 10 op/s 2023-05-08T11:53:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29323.238273 secs 2023-05-08T11:53:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:03 smithi096 ceph-mon[124666]: pgmap v15693: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 873 KiB/s rd, 861 KiB/s wr, 10 op/s 2023-05-08T11:53:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29323.238273 secs 2023-05-08T11:53:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:04 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:53:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:04 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:53:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:04 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:53:05.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:04 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:53:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:04 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:53:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:04 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:53:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:04 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:53:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:04 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:53:05.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:04 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:53:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:04 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:53:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:04 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:53:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:04 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:53:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29323.793925 secs 2023-05-08T11:53:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:05 smithi133 ceph-mon[125939]: pgmap v15694: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 28 op/s 2023-05-08T11:53:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29323.793925 secs 2023-05-08T11:53:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:05 smithi096 ceph-mon[124666]: pgmap v15694: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 28 op/s 2023-05-08T11:53:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29323.793925 secs 2023-05-08T11:53:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:05 smithi186 ceph-mon[126480]: pgmap v15694: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 28 op/s 2023-05-08T11:53:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:07 smithi133 ceph-mon[125939]: pgmap v15695: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 721 KiB/s rd, 713 KiB/s wr, 23 op/s 2023-05-08T11:53:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:07 smithi096 ceph-mon[124666]: pgmap v15695: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 721 KiB/s rd, 713 KiB/s wr, 23 op/s 2023-05-08T11:53:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:07 smithi186 ceph-mon[126480]: pgmap v15695: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 721 KiB/s rd, 713 KiB/s wr, 23 op/s 2023-05-08T11:53:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:08 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:53:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29328.238388 secs 2023-05-08T11:53:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:08 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:53:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29328.238388 secs 2023-05-08T11:53:09.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:08 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:53:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29328.238388 secs 2023-05-08T11:53:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:09 smithi133 ceph-mon[125939]: pgmap v15696: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 721 KiB/s rd, 713 KiB/s wr, 23 op/s 2023-05-08T11:53:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:53:10.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:53:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:09 smithi096 ceph-mon[124666]: pgmap v15696: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 721 KiB/s rd, 713 KiB/s wr, 23 op/s 2023-05-08T11:53:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:53:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:53:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:09 smithi186 ceph-mon[126480]: pgmap v15696: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 721 KiB/s rd, 713 KiB/s wr, 23 op/s 2023-05-08T11:53:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:53:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:53:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29328.794021 secs 2023-05-08T11:53:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:10 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:53:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29328.794021 secs 2023-05-08T11:53:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:10 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:53:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29328.794021 secs 2023-05-08T11:53:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:10 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:53:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:11 smithi133 ceph-mon[125939]: pgmap v15697: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 724 KiB/s rd, 715 KiB/s wr, 27 op/s 2023-05-08T11:53:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:11 smithi096 ceph-mon[124666]: pgmap v15697: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 724 KiB/s rd, 715 KiB/s wr, 27 op/s 2023-05-08T11:53:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:11 smithi186 ceph-mon[126480]: pgmap v15697: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 724 KiB/s rd, 715 KiB/s wr, 27 op/s 2023-05-08T11:53:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:13 smithi133 ceph-mon[125939]: pgmap v15698: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 320 KiB/s wr, 21 op/s 2023-05-08T11:53:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29333.238505 secs 2023-05-08T11:53:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:13 smithi096 ceph-mon[124666]: pgmap v15698: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 320 KiB/s wr, 21 op/s 2023-05-08T11:53:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29333.238505 secs 2023-05-08T11:53:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:13 smithi186 ceph-mon[126480]: pgmap v15698: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 320 KiB/s wr, 21 op/s 2023-05-08T11:53:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29333.238505 secs 2023-05-08T11:53:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29333.794163 secs 2023-05-08T11:53:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:15 smithi133 ceph-mon[125939]: pgmap v15699: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 542 KiB/s rd, 553 KiB/s wr, 25 op/s 2023-05-08T11:53:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29333.794163 secs 2023-05-08T11:53:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:15 smithi096 ceph-mon[124666]: pgmap v15699: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 542 KiB/s rd, 553 KiB/s wr, 25 op/s 2023-05-08T11:53:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29333.794163 secs 2023-05-08T11:53:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:15 smithi186 ceph-mon[126480]: pgmap v15699: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 542 KiB/s rd, 553 KiB/s wr, 25 op/s 2023-05-08T11:53:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:17 smithi133 ceph-mon[125939]: pgmap v15700: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 235 KiB/s wr, 7 op/s 2023-05-08T11:53:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:17 smithi096 ceph-mon[124666]: pgmap v15700: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 235 KiB/s wr, 7 op/s 2023-05-08T11:53:18.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:17 smithi186 ceph-mon[126480]: pgmap v15700: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 235 KiB/s wr, 7 op/s 2023-05-08T11:53:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29338.238626 secs 2023-05-08T11:53:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29338.238626 secs 2023-05-08T11:53:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29338.238626 secs 2023-05-08T11:53:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:19 smithi133 ceph-mon[125939]: pgmap v15701: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 235 KiB/s wr, 7 op/s 2023-05-08T11:53:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:19 smithi096 ceph-mon[124666]: pgmap v15701: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 235 KiB/s wr, 7 op/s 2023-05-08T11:53:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:19 smithi186 ceph-mon[126480]: pgmap v15701: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 235 KiB/s wr, 7 op/s 2023-05-08T11:53:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:20 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:53:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:20 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:53:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:20 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:53:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:21 smithi133 ceph-mon[125939]: pgmap v15702: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 704 KiB/s rd, 742 KiB/s wr, 13 op/s 2023-05-08T11:53:22.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:21 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:53:22.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:21 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:53:22.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:21 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:53:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:21 smithi096 ceph-mon[124666]: pgmap v15702: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 704 KiB/s rd, 742 KiB/s wr, 13 op/s 2023-05-08T11:53:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:21 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:53:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:21 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:53:22.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:21 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:53:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:21 smithi186 ceph-mon[126480]: pgmap v15702: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 704 KiB/s rd, 742 KiB/s wr, 13 op/s 2023-05-08T11:53:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:21 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:53:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:21 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:53:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:21 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:53:24.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:23 smithi133 ceph-mon[125939]: pgmap v15703: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 701 KiB/s rd, 740 KiB/s wr, 10 op/s 2023-05-08T11:53:24.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29343.238757 secs 2023-05-08T11:53:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:23 smithi096 ceph-mon[124666]: pgmap v15703: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 701 KiB/s rd, 740 KiB/s wr, 10 op/s 2023-05-08T11:53:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29343.238757 secs 2023-05-08T11:53:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:23 smithi186 ceph-mon[126480]: pgmap v15703: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 701 KiB/s rd, 740 KiB/s wr, 10 op/s 2023-05-08T11:53:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29343.238757 secs 2023-05-08T11:53:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:25 smithi133 ceph-mon[125939]: pgmap v15704: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 723 KiB/s rd, 742 KiB/s wr, 14 op/s 2023-05-08T11:53:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:25 smithi096 ceph-mon[124666]: pgmap v15704: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 723 KiB/s rd, 742 KiB/s wr, 14 op/s 2023-05-08T11:53:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:25 smithi186 ceph-mon[126480]: pgmap v15704: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 723 KiB/s rd, 742 KiB/s wr, 14 op/s 2023-05-08T11:53:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:26 smithi133 ceph-mon[125939]: osdmap e1058: 12 total, 12 up, 12 in 2023-05-08T11:53:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:26 smithi096 ceph-mon[124666]: osdmap e1058: 12 total, 12 up, 12 in 2023-05-08T11:53:27.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:26 smithi186 ceph-mon[126480]: osdmap e1058: 12 total, 12 up, 12 in 2023-05-08T11:53:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:27 smithi133 ceph-mon[125939]: pgmap v15706: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 587 KiB/s rd, 611 KiB/s wr, 12 op/s 2023-05-08T11:53:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:27 smithi096 ceph-mon[124666]: pgmap v15706: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 587 KiB/s rd, 611 KiB/s wr, 12 op/s 2023-05-08T11:53:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:27 smithi186 ceph-mon[126480]: pgmap v15706: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 587 KiB/s rd, 611 KiB/s wr, 12 op/s 2023-05-08T11:53:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29348.238874 secs 2023-05-08T11:53:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29348.238874 secs 2023-05-08T11:53:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29348.238874 secs 2023-05-08T11:53:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:29 smithi133 ceph-mon[125939]: pgmap v15707: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 587 KiB/s rd, 611 KiB/s wr, 12 op/s 2023-05-08T11:53:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:29 smithi096 ceph-mon[124666]: pgmap v15707: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 587 KiB/s rd, 611 KiB/s wr, 12 op/s 2023-05-08T11:53:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:29 smithi186 ceph-mon[126480]: pgmap v15707: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 587 KiB/s rd, 611 KiB/s wr, 12 op/s 2023-05-08T11:53:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:31 smithi133 ceph-mon[125939]: pgmap v15708: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 153 KiB/s wr, 8 op/s 2023-05-08T11:53:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:31 smithi096 ceph-mon[124666]: pgmap v15708: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 153 KiB/s wr, 8 op/s 2023-05-08T11:53:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:31 smithi186 ceph-mon[126480]: pgmap v15708: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 153 KiB/s wr, 8 op/s 2023-05-08T11:53:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:33 smithi186 ceph-mon[126480]: pgmap v15709: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 153 KiB/s wr, 8 op/s 2023-05-08T11:53:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29353.239012 secs 2023-05-08T11:53:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:33 smithi133 ceph-mon[125939]: pgmap v15709: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 153 KiB/s wr, 8 op/s 2023-05-08T11:53:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29353.239012 secs 2023-05-08T11:53:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:33 smithi096 ceph-mon[124666]: pgmap v15709: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 153 KiB/s wr, 8 op/s 2023-05-08T11:53:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29353.239012 secs 2023-05-08T11:53:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:35 smithi186 ceph-mon[126480]: pgmap v15710: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 494 KiB/s rd, 568 KiB/s wr, 8 op/s 2023-05-08T11:53:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:35 smithi186 ceph-mon[126480]: osdmap e1059: 12 total, 12 up, 12 in 2023-05-08T11:53:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:35 smithi133 ceph-mon[125939]: pgmap v15710: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 494 KiB/s rd, 568 KiB/s wr, 8 op/s 2023-05-08T11:53:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:35 smithi133 ceph-mon[125939]: osdmap e1059: 12 total, 12 up, 12 in 2023-05-08T11:53:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:35 smithi096 ceph-mon[124666]: pgmap v15710: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 494 KiB/s rd, 568 KiB/s wr, 8 op/s 2023-05-08T11:53:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:35 smithi096 ceph-mon[124666]: osdmap e1059: 12 total, 12 up, 12 in 2023-05-08T11:53:37.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29355.083846 secs 2023-05-08T11:53:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29355.083846 secs 2023-05-08T11:53:37.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29355.083846 secs 2023-05-08T11:53:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:37 smithi186 ceph-mon[126480]: pgmap v15712: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 494 KiB/s rd, 568 KiB/s wr, 8 op/s 2023-05-08T11:53:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:37 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:53:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:37 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:53:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:37 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:53:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:37 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:53:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:37 smithi133 ceph-mon[125939]: pgmap v15712: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 494 KiB/s rd, 568 KiB/s wr, 8 op/s 2023-05-08T11:53:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:37 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:53:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:37 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:53:38.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:37 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:53:38.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:37 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:53:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:37 smithi096 ceph-mon[124666]: pgmap v15712: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 494 KiB/s rd, 568 KiB/s wr, 8 op/s 2023-05-08T11:53:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:37 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:53:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:37 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:53:38.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:37 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:53:38.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:37 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:53:39.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29358.239101 secs 2023-05-08T11:53:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29358.239101 secs 2023-05-08T11:53:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29358.239101 secs 2023-05-08T11:53:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:39 smithi186 ceph-mon[126480]: pgmap v15713: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 494 KiB/s rd, 568 KiB/s wr, 8 op/s 2023-05-08T11:53:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:53:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:53:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:53:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:53:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:53:40.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:53:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:39 smithi133 ceph-mon[125939]: pgmap v15713: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 494 KiB/s rd, 568 KiB/s wr, 8 op/s 2023-05-08T11:53:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:53:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:53:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:53:40.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:53:40.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:53:40.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:53:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:39 smithi096 ceph-mon[124666]: pgmap v15713: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 494 KiB/s rd, 568 KiB/s wr, 8 op/s 2023-05-08T11:53:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:53:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:53:40.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:53:40.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:53:40.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:53:40.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:53:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29358.794746 secs 2023-05-08T11:53:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:40 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:53:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:40 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:53:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:40 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:53:41.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:40 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:53:41.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:40 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:53:41.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:40 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:53:41.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:40 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:53:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29358.794746 secs 2023-05-08T11:53:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:40 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:53:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:40 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:53:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:40 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:53:41.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:40 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:53:41.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:40 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:53:41.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:40 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:53:41.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:40 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:53:41.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29358.794746 secs 2023-05-08T11:53:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:40 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:53:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:40 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:53:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:40 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:53:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:40 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:53:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:40 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:53:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:40 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:53:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:40 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:53:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29360.083977 secs 2023-05-08T11:53:42.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:41 smithi133 ceph-mon[125939]: pgmap v15714: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 814 KiB/s wr, 10 op/s 2023-05-08T11:53:42.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:41 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi186 to 154.7M 2023-05-08T11:53:42.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:41 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi186 to 162283081: error parsing value: Value '162283081' is below minimum 939524096 2023-05-08T11:53:42.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:53:42.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:41 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:53:42.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:41 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:53:42.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:53:42.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:53:42.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:53:42.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:53:42.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:53:42.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:53:42.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:53:42.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:41 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi133 to 163.9M 2023-05-08T11:53:42.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:41 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi133 to 171929555: error parsing value: Value '171929555' is below minimum 939524096 2023-05-08T11:53:42.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:53:42.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:53:42.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:41 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:53:42.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:53:42.244 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:41 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T11:53:42.244 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:41 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T11:53:42.244 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:41 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:53:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29360.083977 secs 2023-05-08T11:53:42.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:41 smithi096 ceph-mon[124666]: pgmap v15714: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 814 KiB/s wr, 10 op/s 2023-05-08T11:53:42.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:41 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi186 to 154.7M 2023-05-08T11:53:42.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:41 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi186 to 162283081: error parsing value: Value '162283081' is below minimum 939524096 2023-05-08T11:53:42.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:53:42.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:41 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:53:42.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:41 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:53:42.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:53:42.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:53:42.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:53:42.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:53:42.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:53:42.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:53:42.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:53:42.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:41 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi133 to 163.9M 2023-05-08T11:53:42.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:41 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi133 to 171929555: error parsing value: Value '171929555' is below minimum 939524096 2023-05-08T11:53:42.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:53:42.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:53:42.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:41 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:53:42.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:53:42.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:41 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T11:53:42.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:41 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T11:53:42.259 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:41 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:53:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29360.083977 secs 2023-05-08T11:53:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:41 smithi186 ceph-mon[126480]: pgmap v15714: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 814 KiB/s wr, 10 op/s 2023-05-08T11:53:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:41 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi186 to 154.7M 2023-05-08T11:53:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:41 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi186 to 162283081: error parsing value: Value '162283081' is below minimum 939524096 2023-05-08T11:53:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:53:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:41 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:53:42.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:41 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:53:42.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:53:42.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:53:42.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:53:42.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:53:42.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:53:42.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:53:42.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T11:53:42.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:41 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi133 to 163.9M 2023-05-08T11:53:42.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:41 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi133 to 171929555: error parsing value: Value '171929555' is below minimum 939524096 2023-05-08T11:53:42.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:53:42.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:53:42.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:41 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:53:42.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:53:42.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:41 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T11:53:42.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:41 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T11:53:42.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:41 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:53:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:43 smithi133 ceph-mon[125939]: pgmap v15715: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 814 KiB/s wr, 10 op/s 2023-05-08T11:53:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29363.239222 secs 2023-05-08T11:53:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:43 smithi096 ceph-mon[124666]: pgmap v15715: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 814 KiB/s wr, 10 op/s 2023-05-08T11:53:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29363.239222 secs 2023-05-08T11:53:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:43 smithi186 ceph-mon[126480]: pgmap v15715: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 814 KiB/s wr, 10 op/s 2023-05-08T11:53:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29363.239222 secs 2023-05-08T11:53:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29363.794864 secs 2023-05-08T11:53:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:45 smithi133 ceph-mon[125939]: pgmap v15716: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T11:53:46.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:45 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:53:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29363.794864 secs 2023-05-08T11:53:46.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:45 smithi096 ceph-mon[124666]: pgmap v15716: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T11:53:46.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:45 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:53:46.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29363.794864 secs 2023-05-08T11:53:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:45 smithi186 ceph-mon[126480]: pgmap v15716: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T11:53:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:45 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:53:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:47 smithi133 ceph-mon[125939]: pgmap v15717: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 979 KiB/s wr, 10 op/s 2023-05-08T11:53:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:47 smithi096 ceph-mon[124666]: pgmap v15717: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 979 KiB/s wr, 10 op/s 2023-05-08T11:53:48.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:47 smithi186 ceph-mon[126480]: pgmap v15717: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 979 KiB/s wr, 10 op/s 2023-05-08T11:53:49.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:53:49.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29368.239372 secs 2023-05-08T11:53:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:53:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29368.239372 secs 2023-05-08T11:53:49.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:53:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29368.239372 secs 2023-05-08T11:53:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:49 smithi133 ceph-mon[125939]: pgmap v15718: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 904 KiB/s wr, 9 op/s 2023-05-08T11:53:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:53:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:53:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:49 smithi096 ceph-mon[124666]: pgmap v15718: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 904 KiB/s wr, 9 op/s 2023-05-08T11:53:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:53:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:53:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:49 smithi186 ceph-mon[126480]: pgmap v15718: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 904 KiB/s wr, 9 op/s 2023-05-08T11:53:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:53:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:53:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:53:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:53:51.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:53:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:51 smithi133 ceph-mon[125939]: pgmap v15719: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 15 op/s 2023-05-08T11:53:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:51 smithi096 ceph-mon[124666]: pgmap v15719: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 15 op/s 2023-05-08T11:53:52.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:51 smithi186 ceph-mon[126480]: pgmap v15719: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 15 op/s 2023-05-08T11:53:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:53:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:53:53.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:53:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:53 smithi133 ceph-mon[125939]: pgmap v15720: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 829 KiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T11:53:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:53:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:53:54.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29373.239491 secs 2023-05-08T11:53:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:53 smithi096 ceph-mon[124666]: pgmap v15720: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 829 KiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T11:53:54.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:53:54.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:53:54.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29373.239491 secs 2023-05-08T11:53:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:53 smithi186 ceph-mon[126480]: pgmap v15720: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 829 KiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T11:53:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:53:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:53:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29373.239491 secs 2023-05-08T11:53:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29373.795137 secs 2023-05-08T11:53:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:55 smithi133 ceph-mon[125939]: pgmap v15721: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 16 op/s 2023-05-08T11:53:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:55 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:53:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29373.795137 secs 2023-05-08T11:53:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:55 smithi096 ceph-mon[124666]: pgmap v15721: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 16 op/s 2023-05-08T11:53:56.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:55 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:53:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29373.795137 secs 2023-05-08T11:53:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:55 smithi186 ceph-mon[126480]: pgmap v15721: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 16 op/s 2023-05-08T11:53:56.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:55 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:53:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29375.084311 secs 2023-05-08T11:53:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29375.084311 secs 2023-05-08T11:53:57.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29375.084311 secs 2023-05-08T11:53:58.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:57 smithi133 ceph-mon[125939]: pgmap v15722: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T11:53:58.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:53:58.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:53:58.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:53:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:57 smithi096 ceph-mon[124666]: pgmap v15722: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T11:53:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:53:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:53:58.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:53:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:57 smithi186 ceph-mon[126480]: pgmap v15722: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T11:53:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:53:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:53:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:53:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29378.239560 secs 2023-05-08T11:53:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29378.239560 secs 2023-05-08T11:53:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29378.239560 secs 2023-05-08T11:54:00.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:53:59 smithi133 ceph-mon[125939]: pgmap v15723: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T11:54:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:53:59 smithi096 ceph-mon[124666]: pgmap v15723: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T11:54:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:53:59 smithi186 ceph-mon[126480]: pgmap v15723: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T11:54:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29378.795218 secs 2023-05-08T11:54:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:00 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:54:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29378.795218 secs 2023-05-08T11:54:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:00 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:54:01.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29378.795218 secs 2023-05-08T11:54:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:00 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:54:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29380.084384 secs 2023-05-08T11:54:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:01 smithi133 ceph-mon[125939]: pgmap v15724: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 16 op/s 2023-05-08T11:54:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29380.084384 secs 2023-05-08T11:54:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:01 smithi096 ceph-mon[124666]: pgmap v15724: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 16 op/s 2023-05-08T11:54:02.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29380.084384 secs 2023-05-08T11:54:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:01 smithi186 ceph-mon[126480]: pgmap v15724: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 16 op/s 2023-05-08T11:54:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:03 smithi133 ceph-mon[125939]: pgmap v15725: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 528 KiB/s wr, 10 op/s 2023-05-08T11:54:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29383.239651 secs 2023-05-08T11:54:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:03 smithi096 ceph-mon[124666]: pgmap v15725: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 528 KiB/s wr, 10 op/s 2023-05-08T11:54:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29383.239651 secs 2023-05-08T11:54:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:03 smithi186 ceph-mon[126480]: pgmap v15725: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 528 KiB/s wr, 10 op/s 2023-05-08T11:54:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29383.239651 secs 2023-05-08T11:54:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:04 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:54:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:04 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:54:05.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:04 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:54:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:05 smithi133 ceph-mon[125939]: pgmap v15726: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.0 MiB/s wr, 26 op/s 2023-05-08T11:54:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:54:06.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:54:06.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:05 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:54:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:05 smithi096 ceph-mon[124666]: pgmap v15726: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.0 MiB/s wr, 26 op/s 2023-05-08T11:54:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:54:06.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:54:06.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:05 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:54:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:05 smithi186 ceph-mon[126480]: pgmap v15726: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.0 MiB/s wr, 26 op/s 2023-05-08T11:54:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:54:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:54:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:05 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:54:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:07 smithi133 ceph-mon[125939]: pgmap v15727: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 519 KiB/s wr, 20 op/s 2023-05-08T11:54:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:07 smithi096 ceph-mon[124666]: pgmap v15727: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 519 KiB/s wr, 20 op/s 2023-05-08T11:54:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:07 smithi186 ceph-mon[126480]: pgmap v15727: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 519 KiB/s wr, 20 op/s 2023-05-08T11:54:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:08 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:54:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29388.239769 secs 2023-05-08T11:54:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:08 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:54:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29388.239769 secs 2023-05-08T11:54:09.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:08 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:54:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29388.239769 secs 2023-05-08T11:54:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:09 smithi133 ceph-mon[125939]: pgmap v15728: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 519 KiB/s wr, 20 op/s 2023-05-08T11:54:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:54:10.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:54:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:09 smithi096 ceph-mon[124666]: pgmap v15728: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 519 KiB/s wr, 20 op/s 2023-05-08T11:54:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:54:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:54:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:09 smithi186 ceph-mon[126480]: pgmap v15728: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 519 KiB/s wr, 20 op/s 2023-05-08T11:54:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:54:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:54:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:10 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:54:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:10 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:54:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:10 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:54:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:11 smithi133 ceph-mon[125939]: pgmap v15729: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 673 KiB/s rd, 519 KiB/s wr, 24 op/s 2023-05-08T11:54:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:11 smithi096 ceph-mon[124666]: pgmap v15729: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 673 KiB/s rd, 519 KiB/s wr, 24 op/s 2023-05-08T11:54:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:11 smithi186 ceph-mon[126480]: pgmap v15729: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 673 KiB/s rd, 519 KiB/s wr, 24 op/s 2023-05-08T11:54:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:13 smithi133 ceph-mon[125939]: pgmap v15730: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 517 KiB/s wr, 20 op/s 2023-05-08T11:54:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29393.239896 secs 2023-05-08T11:54:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:13 smithi096 ceph-mon[124666]: pgmap v15730: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 517 KiB/s wr, 20 op/s 2023-05-08T11:54:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29393.239896 secs 2023-05-08T11:54:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:13 smithi186 ceph-mon[126480]: pgmap v15730: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 517 KiB/s wr, 20 op/s 2023-05-08T11:54:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29393.239896 secs 2023-05-08T11:54:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:15 smithi133 ceph-mon[125939]: pgmap v15731: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 631 KiB/s rd, 642 KiB/s wr, 23 op/s 2023-05-08T11:54:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:15 smithi096 ceph-mon[124666]: pgmap v15731: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 631 KiB/s rd, 642 KiB/s wr, 23 op/s 2023-05-08T11:54:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:15 smithi186 ceph-mon[126480]: pgmap v15731: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 631 KiB/s rd, 642 KiB/s wr, 23 op/s 2023-05-08T11:54:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:17 smithi133 ceph-mon[125939]: pgmap v15732: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 126 KiB/s wr, 6 op/s 2023-05-08T11:54:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:17 smithi096 ceph-mon[124666]: pgmap v15732: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 126 KiB/s wr, 6 op/s 2023-05-08T11:54:18.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:17 smithi186 ceph-mon[126480]: pgmap v15732: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 126 KiB/s wr, 6 op/s 2023-05-08T11:54:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29398.240020 secs 2023-05-08T11:54:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29398.240020 secs 2023-05-08T11:54:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29398.240020 secs 2023-05-08T11:54:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:19 smithi133 ceph-mon[125939]: pgmap v15733: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 126 KiB/s wr, 6 op/s 2023-05-08T11:54:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:19 smithi096 ceph-mon[124666]: pgmap v15733: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 126 KiB/s wr, 6 op/s 2023-05-08T11:54:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:19 smithi186 ceph-mon[126480]: pgmap v15733: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 126 KiB/s wr, 6 op/s 2023-05-08T11:54:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:21 smithi133 ceph-mon[125939]: pgmap v15734: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 145 KiB/s wr, 10 op/s 2023-05-08T11:54:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:21 smithi096 ceph-mon[124666]: pgmap v15734: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 145 KiB/s wr, 10 op/s 2023-05-08T11:54:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:21 smithi186 ceph-mon[126480]: pgmap v15734: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 145 KiB/s wr, 10 op/s 2023-05-08T11:54:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:23 smithi133 ceph-mon[125939]: pgmap v15735: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 144 KiB/s wr, 6 op/s 2023-05-08T11:54:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29403.240159 secs 2023-05-08T11:54:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:23 smithi096 ceph-mon[124666]: pgmap v15735: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 144 KiB/s wr, 6 op/s 2023-05-08T11:54:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29403.240159 secs 2023-05-08T11:54:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:23 smithi186 ceph-mon[126480]: pgmap v15735: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 144 KiB/s wr, 6 op/s 2023-05-08T11:54:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29403.240159 secs 2023-05-08T11:54:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:24 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:54:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:24 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:54:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:24 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:54:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:24 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:54:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:24 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:54:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:24 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:54:25.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:24 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:54:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:24 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:54:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:24 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:54:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29403.795813 secs 2023-05-08T11:54:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:25 smithi133 ceph-mon[125939]: pgmap v15736: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 583 KiB/s rd, 602 KiB/s wr, 14 op/s 2023-05-08T11:54:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29403.795813 secs 2023-05-08T11:54:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:25 smithi096 ceph-mon[124666]: pgmap v15736: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 583 KiB/s rd, 602 KiB/s wr, 14 op/s 2023-05-08T11:54:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29403.795813 secs 2023-05-08T11:54:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:25 smithi186 ceph-mon[126480]: pgmap v15736: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 583 KiB/s rd, 602 KiB/s wr, 14 op/s 2023-05-08T11:54:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29405.084986 secs 2023-05-08T11:54:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29405.084986 secs 2023-05-08T11:54:27.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29405.084986 secs 2023-05-08T11:54:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:27 smithi133 ceph-mon[125939]: pgmap v15737: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 456 KiB/s rd, 476 KiB/s wr, 11 op/s 2023-05-08T11:54:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:27 smithi096 ceph-mon[124666]: pgmap v15737: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 456 KiB/s rd, 476 KiB/s wr, 11 op/s 2023-05-08T11:54:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:27 smithi186 ceph-mon[126480]: pgmap v15737: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 456 KiB/s rd, 476 KiB/s wr, 11 op/s 2023-05-08T11:54:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29408.240293 secs 2023-05-08T11:54:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29408.240293 secs 2023-05-08T11:54:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29408.240293 secs 2023-05-08T11:54:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:29 smithi133 ceph-mon[125939]: pgmap v15738: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 456 KiB/s rd, 476 KiB/s wr, 11 op/s 2023-05-08T11:54:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:29 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:54:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:29 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:54:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:29 smithi096 ceph-mon[124666]: pgmap v15738: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 456 KiB/s rd, 476 KiB/s wr, 11 op/s 2023-05-08T11:54:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:29 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:54:30.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:29 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:54:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:29 smithi186 ceph-mon[126480]: pgmap v15738: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 456 KiB/s rd, 476 KiB/s wr, 11 op/s 2023-05-08T11:54:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:29 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:54:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:29 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:54:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29408.795926 secs 2023-05-08T11:54:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:30 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:54:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29408.795926 secs 2023-05-08T11:54:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:30 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:54:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29408.795926 secs 2023-05-08T11:54:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:30 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:54:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29410.085126 secs 2023-05-08T11:54:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:31 smithi133 ceph-mon[125939]: pgmap v15739: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 477 KiB/s wr, 15 op/s 2023-05-08T11:54:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:31 smithi133 ceph-mon[125939]: osdmap e1060: 12 total, 12 up, 12 in 2023-05-08T11:54:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29410.085126 secs 2023-05-08T11:54:32.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:31 smithi096 ceph-mon[124666]: pgmap v15739: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 477 KiB/s wr, 15 op/s 2023-05-08T11:54:32.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:31 smithi096 ceph-mon[124666]: osdmap e1060: 12 total, 12 up, 12 in 2023-05-08T11:54:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29410.085126 secs 2023-05-08T11:54:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:31 smithi186 ceph-mon[126480]: pgmap v15739: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 477 KiB/s wr, 15 op/s 2023-05-08T11:54:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:31 smithi186 ceph-mon[126480]: osdmap e1060: 12 total, 12 up, 12 in 2023-05-08T11:54:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:33 smithi133 ceph-mon[125939]: pgmap v15741: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 550 KiB/s wr, 14 op/s 2023-05-08T11:54:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29413.240393 secs 2023-05-08T11:54:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:33 smithi096 ceph-mon[124666]: pgmap v15741: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 550 KiB/s wr, 14 op/s 2023-05-08T11:54:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29413.240393 secs 2023-05-08T11:54:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:33 smithi186 ceph-mon[126480]: pgmap v15741: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 550 KiB/s wr, 14 op/s 2023-05-08T11:54:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29413.240393 secs 2023-05-08T11:54:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29413.796065 secs 2023-05-08T11:54:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29413.796065 secs 2023-05-08T11:54:35.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29413.796065 secs 2023-05-08T11:54:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:35 smithi133 ceph-mon[125939]: pgmap v15742: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 175 KiB/s wr, 9 op/s 2023-05-08T11:54:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:35 smithi096 ceph-mon[124666]: pgmap v15742: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 175 KiB/s wr, 9 op/s 2023-05-08T11:54:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:35 smithi186 ceph-mon[126480]: pgmap v15742: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 175 KiB/s wr, 9 op/s 2023-05-08T11:54:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29415.085265 secs 2023-05-08T11:54:37.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29415.085265 secs 2023-05-08T11:54:37.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29415.085265 secs 2023-05-08T11:54:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:37 smithi133 ceph-mon[125939]: pgmap v15743: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 175 KiB/s wr, 9 op/s 2023-05-08T11:54:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:37 smithi096 ceph-mon[124666]: pgmap v15743: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 175 KiB/s wr, 9 op/s 2023-05-08T11:54:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:37 smithi186 ceph-mon[126480]: pgmap v15743: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 175 KiB/s wr, 9 op/s 2023-05-08T11:54:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29418.240459 secs 2023-05-08T11:54:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29418.240459 secs 2023-05-08T11:54:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29418.240459 secs 2023-05-08T11:54:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:39 smithi133 ceph-mon[125939]: pgmap v15744: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 175 KiB/s wr, 9 op/s 2023-05-08T11:54:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29418.796181 secs 2023-05-08T11:54:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:39 smithi096 ceph-mon[124666]: pgmap v15744: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 175 KiB/s wr, 9 op/s 2023-05-08T11:54:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29418.796181 secs 2023-05-08T11:54:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:39 smithi186 ceph-mon[126480]: pgmap v15744: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 175 KiB/s wr, 9 op/s 2023-05-08T11:54:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29418.796181 secs 2023-05-08T11:54:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29420.085385 secs 2023-05-08T11:54:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:41 smithi133 ceph-mon[125939]: osdmap e1061: 12 total, 12 up, 12 in 2023-05-08T11:54:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:41 smithi133 ceph-mon[125939]: pgmap v15746: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 537 KiB/s wr, 8 op/s 2023-05-08T11:54:41.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:54:41.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:54:41.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:54:41.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:54:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29420.085385 secs 2023-05-08T11:54:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:41 smithi096 ceph-mon[124666]: osdmap e1061: 12 total, 12 up, 12 in 2023-05-08T11:54:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:41 smithi096 ceph-mon[124666]: pgmap v15746: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 537 KiB/s wr, 8 op/s 2023-05-08T11:54:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:54:42.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:54:42.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:54:42.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:54:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29420.085385 secs 2023-05-08T11:54:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:41 smithi186 ceph-mon[126480]: osdmap e1061: 12 total, 12 up, 12 in 2023-05-08T11:54:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:41 smithi186 ceph-mon[126480]: pgmap v15746: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 537 KiB/s wr, 8 op/s 2023-05-08T11:54:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:54:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:54:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:54:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:54:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:42 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:54:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:42 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T11:54:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:42 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T11:54:43.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:42 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:54:43.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:42 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:54:43.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:42 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T11:54:43.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:42 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T11:54:43.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:42 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:54:43.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:42 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:54:43.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:42 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T11:54:43.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:42 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T11:54:43.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:42 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:54:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:43 smithi096 ceph-mon[124666]: pgmap v15747: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 529 KiB/s wr, 8 op/s 2023-05-08T11:54:44.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29423.240548 secs 2023-05-08T11:54:44.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:43 smithi186 ceph-mon[126480]: pgmap v15747: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 529 KiB/s wr, 8 op/s 2023-05-08T11:54:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29423.240548 secs 2023-05-08T11:54:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:43 smithi133 ceph-mon[125939]: pgmap v15747: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 529 KiB/s wr, 8 op/s 2023-05-08T11:54:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29423.240548 secs 2023-05-08T11:54:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29423.796298 secs 2023-05-08T11:54:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:45 smithi133 ceph-mon[125939]: pgmap v15748: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 601 KiB/s rd, 455 KiB/s wr, 8 op/s 2023-05-08T11:54:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29423.796298 secs 2023-05-08T11:54:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:45 smithi096 ceph-mon[124666]: pgmap v15748: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 601 KiB/s rd, 455 KiB/s wr, 8 op/s 2023-05-08T11:54:46.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29423.796298 secs 2023-05-08T11:54:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:45 smithi186 ceph-mon[126480]: pgmap v15748: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 601 KiB/s rd, 455 KiB/s wr, 8 op/s 2023-05-08T11:54:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:47 smithi133 ceph-mon[125939]: pgmap v15749: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 601 KiB/s rd, 455 KiB/s wr, 8 op/s 2023-05-08T11:54:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:47 smithi096 ceph-mon[124666]: pgmap v15749: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 601 KiB/s rd, 455 KiB/s wr, 8 op/s 2023-05-08T11:54:48.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:47 smithi186 ceph-mon[126480]: pgmap v15749: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 601 KiB/s rd, 455 KiB/s wr, 8 op/s 2023-05-08T11:54:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:54:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29428.240661 secs 2023-05-08T11:54:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:54:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29428.240661 secs 2023-05-08T11:54:49.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:54:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29428.240661 secs 2023-05-08T11:54:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:49 smithi133 ceph-mon[125939]: pgmap v15750: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 601 KiB/s rd, 455 KiB/s wr, 8 op/s 2023-05-08T11:54:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:54:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:54:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:54:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:49 smithi096 ceph-mon[124666]: pgmap v15750: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 601 KiB/s rd, 455 KiB/s wr, 8 op/s 2023-05-08T11:54:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:54:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:54:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:54:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:49 smithi186 ceph-mon[126480]: pgmap v15750: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 601 KiB/s rd, 455 KiB/s wr, 8 op/s 2023-05-08T11:54:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:54:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:54:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:54:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29428.796395 secs 2023-05-08T11:54:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29428.796395 secs 2023-05-08T11:54:51.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29428.796395 secs 2023-05-08T11:54:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:51 smithi133 ceph-mon[125939]: pgmap v15751: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 693 KiB/s rd, 132 KiB/s wr, 8 op/s 2023-05-08T11:54:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:51 smithi096 ceph-mon[124666]: pgmap v15751: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 693 KiB/s rd, 132 KiB/s wr, 8 op/s 2023-05-08T11:54:52.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:51 smithi186 ceph-mon[126480]: pgmap v15751: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 693 KiB/s rd, 132 KiB/s wr, 8 op/s 2023-05-08T11:54:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:53 smithi133 ceph-mon[125939]: pgmap v15752: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 582 KiB/s rd, 111 KiB/s wr, 6 op/s 2023-05-08T11:54:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29433.240783 secs 2023-05-08T11:54:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:53 smithi096 ceph-mon[124666]: pgmap v15752: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 582 KiB/s rd, 111 KiB/s wr, 6 op/s 2023-05-08T11:54:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29433.240783 secs 2023-05-08T11:54:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:53 smithi186 ceph-mon[126480]: pgmap v15752: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 582 KiB/s rd, 111 KiB/s wr, 6 op/s 2023-05-08T11:54:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29433.240783 secs 2023-05-08T11:54:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:55 smithi133 ceph-mon[125939]: pgmap v15753: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 942 KiB/s wr, 12 op/s 2023-05-08T11:54:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:55 smithi096 ceph-mon[124666]: pgmap v15753: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 942 KiB/s wr, 12 op/s 2023-05-08T11:54:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:55 smithi186 ceph-mon[126480]: pgmap v15753: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 942 KiB/s wr, 12 op/s 2023-05-08T11:54:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:54:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:54:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:54:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:57 smithi133 ceph-mon[125939]: pgmap v15754: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 859 KiB/s wr, 9 op/s 2023-05-08T11:54:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:57 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:54:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:54:58.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:54:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:57 smithi096 ceph-mon[124666]: pgmap v15754: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 859 KiB/s wr, 9 op/s 2023-05-08T11:54:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:57 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:54:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:54:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:54:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:57 smithi186 ceph-mon[126480]: pgmap v15754: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 859 KiB/s wr, 9 op/s 2023-05-08T11:54:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:57 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:54:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:54:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:54:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29438.240922 secs 2023-05-08T11:54:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29438.240922 secs 2023-05-08T11:54:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29438.240922 secs 2023-05-08T11:55:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:54:59 smithi133 ceph-mon[125939]: pgmap v15755: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 859 KiB/s wr, 9 op/s 2023-05-08T11:55:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:54:59 smithi096 ceph-mon[124666]: pgmap v15755: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 859 KiB/s wr, 9 op/s 2023-05-08T11:55:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:54:59 smithi186 ceph-mon[126480]: pgmap v15755: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 859 KiB/s wr, 9 op/s 2023-05-08T11:55:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29438.796630 secs 2023-05-08T11:55:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29438.796630 secs 2023-05-08T11:55:01.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29438.796630 secs 2023-05-08T11:55:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29440.085932 secs 2023-05-08T11:55:02.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:01 smithi133 ceph-mon[125939]: pgmap v15756: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 15 op/s 2023-05-08T11:55:02.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:55:02.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:55:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29440.085932 secs 2023-05-08T11:55:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:01 smithi096 ceph-mon[124666]: pgmap v15756: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 15 op/s 2023-05-08T11:55:02.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:55:02.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:55:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29440.085932 secs 2023-05-08T11:55:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:01 smithi186 ceph-mon[126480]: pgmap v15756: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 15 op/s 2023-05-08T11:55:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:55:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:55:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:03 smithi133 ceph-mon[125939]: pgmap v15757: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T11:55:04.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29443.241061 secs 2023-05-08T11:55:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:03 smithi096 ceph-mon[124666]: pgmap v15757: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T11:55:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29443.241061 secs 2023-05-08T11:55:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:03 smithi186 ceph-mon[126480]: pgmap v15757: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T11:55:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29443.241061 secs 2023-05-08T11:55:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29443.796693 secs 2023-05-08T11:55:05.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:04 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:55:05.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:04 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:55:05.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:04 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:55:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29443.796693 secs 2023-05-08T11:55:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:04 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:55:05.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:04 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:55:05.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:04 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:55:05.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29443.796693 secs 2023-05-08T11:55:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:04 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:55:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:04 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:55:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:04 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:55:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:05 smithi133 ceph-mon[125939]: pgmap v15758: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.4 MiB/s wr, 17 op/s 2023-05-08T11:55:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:05 smithi096 ceph-mon[124666]: pgmap v15758: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.4 MiB/s wr, 17 op/s 2023-05-08T11:55:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:05 smithi186 ceph-mon[126480]: pgmap v15758: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.4 MiB/s wr, 17 op/s 2023-05-08T11:55:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29445.086057 secs 2023-05-08T11:55:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29445.086057 secs 2023-05-08T11:55:07.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29445.086057 secs 2023-05-08T11:55:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:07 smithi133 ceph-mon[125939]: pgmap v15759: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 615 KiB/s wr, 11 op/s 2023-05-08T11:55:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:07 smithi096 ceph-mon[124666]: pgmap v15759: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 615 KiB/s wr, 11 op/s 2023-05-08T11:55:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:07 smithi186 ceph-mon[126480]: pgmap v15759: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 615 KiB/s wr, 11 op/s 2023-05-08T11:55:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29448.241162 secs 2023-05-08T11:55:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29448.241162 secs 2023-05-08T11:55:09.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29448.241162 secs 2023-05-08T11:55:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:09 smithi096 ceph-mon[124666]: pgmap v15760: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 615 KiB/s wr, 11 op/s 2023-05-08T11:55:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:09 smithi186 ceph-mon[126480]: pgmap v15760: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 615 KiB/s wr, 11 op/s 2023-05-08T11:55:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:09 smithi133 ceph-mon[125939]: pgmap v15760: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 615 KiB/s wr, 11 op/s 2023-05-08T11:55:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:11 smithi096 ceph-mon[124666]: pgmap v15761: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.1 MiB/s wr, 27 op/s 2023-05-08T11:55:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:11 smithi186 ceph-mon[126480]: pgmap v15761: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.1 MiB/s wr, 27 op/s 2023-05-08T11:55:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:11 smithi133 ceph-mon[125939]: pgmap v15761: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.1 MiB/s wr, 27 op/s 2023-05-08T11:55:13.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:12 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:55:13.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:12 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:55:13.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:12 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:55:13.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:12 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:55:13.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:12 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:55:13.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:12 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:55:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:13 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:55:14.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:55:14.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:55:14.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:13 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:55:14.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:13 smithi096 ceph-mon[124666]: pgmap v15762: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 975 KiB/s rd, 631 KiB/s wr, 21 op/s 2023-05-08T11:55:14.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29453.241282 secs 2023-05-08T11:55:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:13 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:55:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:55:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:55:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:13 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:55:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:13 smithi186 ceph-mon[126480]: pgmap v15762: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 975 KiB/s rd, 631 KiB/s wr, 21 op/s 2023-05-08T11:55:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29453.241282 secs 2023-05-08T11:55:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:13 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:55:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:55:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:55:14.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:13 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:55:14.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:13 smithi133 ceph-mon[125939]: pgmap v15762: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 975 KiB/s rd, 631 KiB/s wr, 21 op/s 2023-05-08T11:55:14.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29453.241282 secs 2023-05-08T11:55:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:15 smithi133 ceph-mon[125939]: pgmap v15763: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 26 op/s 2023-05-08T11:55:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:15 smithi096 ceph-mon[124666]: pgmap v15763: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 26 op/s 2023-05-08T11:55:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:15 smithi186 ceph-mon[126480]: pgmap v15763: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 26 op/s 2023-05-08T11:55:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:17 smithi133 ceph-mon[125939]: pgmap v15764: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 706 KiB/s rd, 942 KiB/s wr, 20 op/s 2023-05-08T11:55:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:17 smithi096 ceph-mon[124666]: pgmap v15764: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 706 KiB/s rd, 942 KiB/s wr, 20 op/s 2023-05-08T11:55:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:17 smithi186 ceph-mon[126480]: pgmap v15764: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 706 KiB/s rd, 942 KiB/s wr, 20 op/s 2023-05-08T11:55:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29458.241396 secs 2023-05-08T11:55:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29458.241396 secs 2023-05-08T11:55:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29458.241396 secs 2023-05-08T11:55:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:19 smithi133 ceph-mon[125939]: pgmap v15765: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 706 KiB/s rd, 942 KiB/s wr, 20 op/s 2023-05-08T11:55:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:19 smithi096 ceph-mon[124666]: pgmap v15765: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 706 KiB/s rd, 942 KiB/s wr, 20 op/s 2023-05-08T11:55:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:19 smithi186 ceph-mon[126480]: pgmap v15765: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 706 KiB/s rd, 942 KiB/s wr, 20 op/s 2023-05-08T11:55:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:21 smithi096 ceph-mon[124666]: pgmap v15766: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 930 KiB/s rd, 942 KiB/s wr, 23 op/s 2023-05-08T11:55:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:21 smithi186 ceph-mon[126480]: pgmap v15766: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 930 KiB/s rd, 942 KiB/s wr, 23 op/s 2023-05-08T11:55:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:21 smithi133 ceph-mon[125939]: pgmap v15766: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 930 KiB/s rd, 942 KiB/s wr, 23 op/s 2023-05-08T11:55:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:23 smithi133 ceph-mon[125939]: pgmap v15767: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 439 KiB/s wr, 7 op/s 2023-05-08T11:55:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29463.241516 secs 2023-05-08T11:55:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:23 smithi096 ceph-mon[124666]: pgmap v15767: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 439 KiB/s wr, 7 op/s 2023-05-08T11:55:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29463.241516 secs 2023-05-08T11:55:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:23 smithi186 ceph-mon[126480]: pgmap v15767: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 439 KiB/s wr, 7 op/s 2023-05-08T11:55:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29463.241516 secs 2023-05-08T11:55:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:25 smithi133 ceph-mon[125939]: pgmap v15768: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 439 KiB/s wr, 10 op/s 2023-05-08T11:55:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:25 smithi096 ceph-mon[124666]: pgmap v15768: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 439 KiB/s wr, 10 op/s 2023-05-08T11:55:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:25 smithi186 ceph-mon[126480]: pgmap v15768: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 439 KiB/s wr, 10 op/s 2023-05-08T11:55:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:27 smithi133 ceph-mon[125939]: pgmap v15769: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T11:55:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:27 smithi096 ceph-mon[124666]: pgmap v15769: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T11:55:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:27 smithi186 ceph-mon[126480]: pgmap v15769: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T11:55:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29468.241629 secs 2023-05-08T11:55:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29468.241629 secs 2023-05-08T11:55:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29468.241629 secs 2023-05-08T11:55:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:29 smithi133 ceph-mon[125939]: pgmap v15770: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T11:55:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:29 smithi096 ceph-mon[124666]: pgmap v15770: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T11:55:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:29 smithi186 ceph-mon[126480]: pgmap v15770: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T11:55:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29468.797336 secs 2023-05-08T11:55:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29468.797336 secs 2023-05-08T11:55:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29468.797336 secs 2023-05-08T11:55:32.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29470.086664 secs 2023-05-08T11:55:32.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:31 smithi133 ceph-mon[125939]: pgmap v15771: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 603 KiB/s rd, 400 KiB/s wr, 13 op/s 2023-05-08T11:55:32.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29470.086664 secs 2023-05-08T11:55:32.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:31 smithi096 ceph-mon[124666]: pgmap v15771: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 603 KiB/s rd, 400 KiB/s wr, 13 op/s 2023-05-08T11:55:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29470.086664 secs 2023-05-08T11:55:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:31 smithi186 ceph-mon[126480]: pgmap v15771: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 603 KiB/s rd, 400 KiB/s wr, 13 op/s 2023-05-08T11:55:33.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:32 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:55:33.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:32 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:55:33.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:32 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:55:33.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:32 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:55:33.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:32 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:55:33.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:32 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:55:33.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:32 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:55:33.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:32 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:55:33.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:32 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:55:33.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:32 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:55:33.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:32 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:55:33.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:32 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:55:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:33 smithi133 ceph-mon[125939]: pgmap v15772: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 400 KiB/s wr, 9 op/s 2023-05-08T11:55:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29473.241745 secs 2023-05-08T11:55:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:33 smithi096 ceph-mon[124666]: pgmap v15772: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 400 KiB/s wr, 9 op/s 2023-05-08T11:55:34.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29473.241745 secs 2023-05-08T11:55:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:33 smithi186 ceph-mon[126480]: pgmap v15772: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 400 KiB/s wr, 9 op/s 2023-05-08T11:55:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29473.241745 secs 2023-05-08T11:55:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29473.797497 secs 2023-05-08T11:55:36.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:35 smithi133 ceph-mon[125939]: pgmap v15773: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 512 KiB/s wr, 13 op/s 2023-05-08T11:55:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29473.797497 secs 2023-05-08T11:55:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:35 smithi096 ceph-mon[124666]: pgmap v15773: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 512 KiB/s wr, 13 op/s 2023-05-08T11:55:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29473.797497 secs 2023-05-08T11:55:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:35 smithi186 ceph-mon[126480]: pgmap v15773: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 512 KiB/s wr, 13 op/s 2023-05-08T11:55:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29475.086828 secs 2023-05-08T11:55:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:36 smithi133 ceph-mon[125939]: osdmap e1062: 12 total, 12 up, 12 in 2023-05-08T11:55:37.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29475.086828 secs 2023-05-08T11:55:37.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:36 smithi096 ceph-mon[124666]: osdmap e1062: 12 total, 12 up, 12 in 2023-05-08T11:55:37.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29475.086828 secs 2023-05-08T11:55:37.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:36 smithi186 ceph-mon[126480]: osdmap e1062: 12 total, 12 up, 12 in 2023-05-08T11:55:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:37 smithi133 ceph-mon[125939]: pgmap v15775: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 456 KiB/s rd, 614 KiB/s wr, 13 op/s 2023-05-08T11:55:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:37 smithi096 ceph-mon[124666]: pgmap v15775: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 456 KiB/s rd, 614 KiB/s wr, 13 op/s 2023-05-08T11:55:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:37 smithi186 ceph-mon[126480]: pgmap v15775: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 456 KiB/s rd, 614 KiB/s wr, 13 op/s 2023-05-08T11:55:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29478.241882 secs 2023-05-08T11:55:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29478.241882 secs 2023-05-08T11:55:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29478.241882 secs 2023-05-08T11:55:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:39 smithi096 ceph-mon[124666]: pgmap v15776: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 456 KiB/s rd, 614 KiB/s wr, 13 op/s 2023-05-08T11:55:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29478.797629 secs 2023-05-08T11:55:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:39 smithi186 ceph-mon[126480]: pgmap v15776: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 456 KiB/s rd, 614 KiB/s wr, 13 op/s 2023-05-08T11:55:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29478.797629 secs 2023-05-08T11:55:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:39 smithi133 ceph-mon[125939]: pgmap v15776: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 456 KiB/s rd, 614 KiB/s wr, 13 op/s 2023-05-08T11:55:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29478.797629 secs 2023-05-08T11:55:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29480.086943 secs 2023-05-08T11:55:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:41 smithi186 ceph-mon[126480]: pgmap v15777: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 379 KiB/s wr, 9 op/s 2023-05-08T11:55:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29480.086943 secs 2023-05-08T11:55:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:41 smithi133 ceph-mon[125939]: pgmap v15777: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 379 KiB/s wr, 9 op/s 2023-05-08T11:55:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29480.086943 secs 2023-05-08T11:55:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:41 smithi096 ceph-mon[124666]: pgmap v15777: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 379 KiB/s wr, 9 op/s 2023-05-08T11:55:43.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:55:43.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:55:43.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:55:43.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:55:43.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:55:43.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:55:43.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:55:43.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:55:43.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:55:43.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:55:43.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:55:43.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:55:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:43 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:55:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:43 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T11:55:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:43 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T11:55:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:43 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:55:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:43 smithi186 ceph-mon[126480]: pgmap v15778: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 379 KiB/s wr, 9 op/s 2023-05-08T11:55:44.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29483.241991 secs 2023-05-08T11:55:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:43 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:55:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:43 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T11:55:44.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:43 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T11:55:44.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:43 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:55:44.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:43 smithi133 ceph-mon[125939]: pgmap v15778: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 379 KiB/s wr, 9 op/s 2023-05-08T11:55:44.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29483.241991 secs 2023-05-08T11:55:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:43 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:55:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:43 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T11:55:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:43 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T11:55:44.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:43 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:55:44.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:43 smithi096 ceph-mon[124666]: pgmap v15778: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 379 KiB/s wr, 9 op/s 2023-05-08T11:55:44.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29483.241991 secs 2023-05-08T11:55:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29483.797712 secs 2023-05-08T11:55:46.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:45 smithi133 ceph-mon[125939]: pgmap v15779: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 905 KiB/s rd, 645 KiB/s wr, 9 op/s 2023-05-08T11:55:46.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:45 smithi133 ceph-mon[125939]: osdmap e1063: 12 total, 12 up, 12 in 2023-05-08T11:55:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29483.797712 secs 2023-05-08T11:55:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:45 smithi096 ceph-mon[124666]: pgmap v15779: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 905 KiB/s rd, 645 KiB/s wr, 9 op/s 2023-05-08T11:55:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:45 smithi096 ceph-mon[124666]: osdmap e1063: 12 total, 12 up, 12 in 2023-05-08T11:55:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29483.797712 secs 2023-05-08T11:55:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:45 smithi186 ceph-mon[126480]: pgmap v15779: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 905 KiB/s rd, 645 KiB/s wr, 9 op/s 2023-05-08T11:55:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:45 smithi186 ceph-mon[126480]: osdmap e1063: 12 total, 12 up, 12 in 2023-05-08T11:55:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:47 smithi133 ceph-mon[125939]: pgmap v15781: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 905 KiB/s rd, 645 KiB/s wr, 9 op/s 2023-05-08T11:55:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:47 smithi096 ceph-mon[124666]: pgmap v15781: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 905 KiB/s rd, 645 KiB/s wr, 9 op/s 2023-05-08T11:55:48.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:47 smithi186 ceph-mon[126480]: pgmap v15781: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 905 KiB/s rd, 645 KiB/s wr, 9 op/s 2023-05-08T11:55:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:55:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29488.242104 secs 2023-05-08T11:55:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:55:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29488.242104 secs 2023-05-08T11:55:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:55:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29488.242104 secs 2023-05-08T11:55:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:49 smithi133 ceph-mon[125939]: pgmap v15782: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 905 KiB/s rd, 645 KiB/s wr, 9 op/s 2023-05-08T11:55:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:55:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:55:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:55:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:49 smithi096 ceph-mon[124666]: pgmap v15782: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 905 KiB/s rd, 645 KiB/s wr, 9 op/s 2023-05-08T11:55:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:55:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:55:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:55:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:49 smithi186 ceph-mon[126480]: pgmap v15782: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 905 KiB/s rd, 645 KiB/s wr, 9 op/s 2023-05-08T11:55:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:55:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:55:50.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:55:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:51 smithi096 ceph-mon[124666]: pgmap v15783: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 826 KiB/s wr, 10 op/s 2023-05-08T11:55:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:51 smithi186 ceph-mon[126480]: pgmap v15783: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 826 KiB/s wr, 10 op/s 2023-05-08T11:55:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:51 smithi133 ceph-mon[125939]: pgmap v15783: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 826 KiB/s wr, 10 op/s 2023-05-08T11:55:53.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:55:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:55:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:55:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:55:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:55:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:53 smithi186 ceph-mon[126480]: pgmap v15784: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 826 KiB/s wr, 10 op/s 2023-05-08T11:55:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29493.242169 secs 2023-05-08T11:55:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:55:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:55:54.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:53 smithi133 ceph-mon[125939]: pgmap v15784: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 826 KiB/s wr, 10 op/s 2023-05-08T11:55:54.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29493.242169 secs 2023-05-08T11:55:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:55:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:55:54.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:53 smithi096 ceph-mon[124666]: pgmap v15784: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 826 KiB/s wr, 10 op/s 2023-05-08T11:55:54.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29493.242169 secs 2023-05-08T11:55:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:55 smithi133 ceph-mon[125939]: pgmap v15785: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 632 KiB/s wr, 11 op/s 2023-05-08T11:55:56.246 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:55 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:55:56.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:55 smithi096 ceph-mon[124666]: pgmap v15785: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 632 KiB/s wr, 11 op/s 2023-05-08T11:55:56.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:55 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:55:56.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:55 smithi186 ceph-mon[126480]: pgmap v15785: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 632 KiB/s wr, 11 op/s 2023-05-08T11:55:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:55 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:55:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:57 smithi133 ceph-mon[125939]: pgmap v15786: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 697 KiB/s wr, 11 op/s 2023-05-08T11:55:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:57 smithi096 ceph-mon[124666]: pgmap v15786: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 697 KiB/s wr, 11 op/s 2023-05-08T11:55:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:57 smithi186 ceph-mon[126480]: pgmap v15786: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 697 KiB/s wr, 11 op/s 2023-05-08T11:55:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29498.242289 secs 2023-05-08T11:55:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29498.242289 secs 2023-05-08T11:55:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29498.242289 secs 2023-05-08T11:56:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:55:59 smithi133 ceph-mon[125939]: pgmap v15787: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 644 KiB/s wr, 10 op/s 2023-05-08T11:56:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:55:59 smithi096 ceph-mon[124666]: pgmap v15787: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 644 KiB/s wr, 10 op/s 2023-05-08T11:56:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:55:59 smithi186 ceph-mon[126480]: pgmap v15787: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 644 KiB/s wr, 10 op/s 2023-05-08T11:56:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29498.798048 secs 2023-05-08T11:56:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29498.798048 secs 2023-05-08T11:56:01.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29498.798048 secs 2023-05-08T11:56:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29500.087448 secs 2023-05-08T11:56:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:01 smithi133 ceph-mon[125939]: pgmap v15788: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 16 op/s 2023-05-08T11:56:02.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:01 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:56:02.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:56:02.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:56:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29500.087448 secs 2023-05-08T11:56:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:01 smithi096 ceph-mon[124666]: pgmap v15788: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 16 op/s 2023-05-08T11:56:02.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:01 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:56:02.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:56:02.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:56:02.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29500.087448 secs 2023-05-08T11:56:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:01 smithi186 ceph-mon[126480]: pgmap v15788: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 16 op/s 2023-05-08T11:56:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:01 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:56:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:56:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:56:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:03 smithi133 ceph-mon[125939]: pgmap v15789: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 983 KiB/s rd, 774 KiB/s wr, 11 op/s 2023-05-08T11:56:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29503.242421 secs 2023-05-08T11:56:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:03 smithi096 ceph-mon[124666]: pgmap v15789: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 983 KiB/s rd, 774 KiB/s wr, 11 op/s 2023-05-08T11:56:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29503.242421 secs 2023-05-08T11:56:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:03 smithi186 ceph-mon[126480]: pgmap v15789: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 983 KiB/s rd, 774 KiB/s wr, 11 op/s 2023-05-08T11:56:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29503.242421 secs 2023-05-08T11:56:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:04 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:56:05.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:04 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:56:05.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:04 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:56:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:05 smithi133 ceph-mon[125939]: pgmap v15790: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1004 KiB/s rd, 1.0 MiB/s wr, 15 op/s 2023-05-08T11:56:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:56:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:56:06.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:56:06.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:05 smithi096 ceph-mon[124666]: pgmap v15790: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1004 KiB/s rd, 1.0 MiB/s wr, 15 op/s 2023-05-08T11:56:06.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:56:06.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:56:06.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:56:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:05 smithi186 ceph-mon[126480]: pgmap v15790: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1004 KiB/s rd, 1.0 MiB/s wr, 15 op/s 2023-05-08T11:56:06.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:56:06.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:56:06.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:56:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29505.087568 secs 2023-05-08T11:56:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29505.087568 secs 2023-05-08T11:56:07.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29505.087568 secs 2023-05-08T11:56:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:07 smithi133 ceph-mon[125939]: pgmap v15791: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 912 KiB/s rd, 928 KiB/s wr, 12 op/s 2023-05-08T11:56:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:07 smithi096 ceph-mon[124666]: pgmap v15791: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 912 KiB/s rd, 928 KiB/s wr, 12 op/s 2023-05-08T11:56:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:07 smithi186 ceph-mon[126480]: pgmap v15791: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 912 KiB/s rd, 928 KiB/s wr, 12 op/s 2023-05-08T11:56:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29508.242529 secs 2023-05-08T11:56:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29508.242529 secs 2023-05-08T11:56:09.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29508.242529 secs 2023-05-08T11:56:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:09 smithi133 ceph-mon[125939]: pgmap v15792: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 811 KiB/s wr, 11 op/s 2023-05-08T11:56:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:09 smithi096 ceph-mon[124666]: pgmap v15792: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 811 KiB/s wr, 11 op/s 2023-05-08T11:56:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:09 smithi186 ceph-mon[126480]: pgmap v15792: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 811 KiB/s wr, 11 op/s 2023-05-08T11:56:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29508.798284 secs 2023-05-08T11:56:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29508.798284 secs 2023-05-08T11:56:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29508.798284 secs 2023-05-08T11:56:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29510.087634 secs 2023-05-08T11:56:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:11 smithi133 ceph-mon[125939]: pgmap v15793: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 842 KiB/s rd, 876 KiB/s wr, 28 op/s 2023-05-08T11:56:12.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:11 smithi133 ceph-mon[125939]: osdmap e1064: 12 total, 12 up, 12 in 2023-05-08T11:56:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29510.087634 secs 2023-05-08T11:56:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:11 smithi096 ceph-mon[124666]: pgmap v15793: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 842 KiB/s rd, 876 KiB/s wr, 28 op/s 2023-05-08T11:56:12.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:11 smithi096 ceph-mon[124666]: osdmap e1064: 12 total, 12 up, 12 in 2023-05-08T11:56:12.373 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29510.087634 secs 2023-05-08T11:56:12.374 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:11 smithi186 ceph-mon[126480]: pgmap v15793: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 842 KiB/s rd, 876 KiB/s wr, 28 op/s 2023-05-08T11:56:12.374 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:11 smithi186 ceph-mon[126480]: osdmap e1064: 12 total, 12 up, 12 in 2023-05-08T11:56:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:13 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:56:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:56:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:13 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:56:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:13 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:56:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:56:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:13 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:56:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:13 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:56:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:56:13.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:13 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:56:14.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:14 smithi186 ceph-mon[126480]: pgmap v15795: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 720 KiB/s rd, 470 KiB/s wr, 27 op/s 2023-05-08T11:56:14.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29513.242606 secs 2023-05-08T11:56:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:14 smithi133 ceph-mon[125939]: pgmap v15795: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 720 KiB/s rd, 470 KiB/s wr, 27 op/s 2023-05-08T11:56:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29513.242606 secs 2023-05-08T11:56:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:14 smithi096 ceph-mon[124666]: pgmap v15795: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 720 KiB/s rd, 470 KiB/s wr, 27 op/s 2023-05-08T11:56:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29513.242606 secs 2023-05-08T11:56:15.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29513.798388 secs 2023-05-08T11:56:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29513.798388 secs 2023-05-08T11:56:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29513.798388 secs 2023-05-08T11:56:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:16 smithi186 ceph-mon[126480]: pgmap v15796: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 599 KiB/s wr, 27 op/s 2023-05-08T11:56:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:16 smithi133 ceph-mon[125939]: pgmap v15796: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 599 KiB/s wr, 27 op/s 2023-05-08T11:56:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:16 smithi096 ceph-mon[124666]: pgmap v15796: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 599 KiB/s wr, 27 op/s 2023-05-08T11:56:17.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:17 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29515.087747 secs 2023-05-08T11:56:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:17 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29515.087747 secs 2023-05-08T11:56:17.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:17 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29515.087747 secs 2023-05-08T11:56:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:18 smithi186 ceph-mon[126480]: pgmap v15797: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 770 KiB/s rd, 521 KiB/s wr, 26 op/s 2023-05-08T11:56:18.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:18 smithi133 ceph-mon[125939]: pgmap v15797: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 770 KiB/s rd, 521 KiB/s wr, 26 op/s 2023-05-08T11:56:18.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:18 smithi096 ceph-mon[124666]: pgmap v15797: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 770 KiB/s rd, 521 KiB/s wr, 26 op/s 2023-05-08T11:56:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29518.242744 secs 2023-05-08T11:56:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29518.242744 secs 2023-05-08T11:56:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29518.242744 secs 2023-05-08T11:56:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:20 smithi186 ceph-mon[126480]: pgmap v15798: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 770 KiB/s rd, 521 KiB/s wr, 26 op/s 2023-05-08T11:56:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29518.798542 secs 2023-05-08T11:56:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:20 smithi133 ceph-mon[125939]: pgmap v15798: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 770 KiB/s rd, 521 KiB/s wr, 26 op/s 2023-05-08T11:56:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29518.798542 secs 2023-05-08T11:56:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:20 smithi096 ceph-mon[124666]: pgmap v15798: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 770 KiB/s rd, 521 KiB/s wr, 26 op/s 2023-05-08T11:56:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29518.798542 secs 2023-05-08T11:56:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29520.087871 secs 2023-05-08T11:56:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:21 smithi186 ceph-mon[126480]: osdmap e1065: 12 total, 12 up, 12 in 2023-05-08T11:56:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:21 smithi186 ceph-mon[126480]: pgmap v15800: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 450 KiB/s rd, 470 KiB/s wr, 9 op/s 2023-05-08T11:56:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29520.087871 secs 2023-05-08T11:56:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:21 smithi133 ceph-mon[125939]: osdmap e1065: 12 total, 12 up, 12 in 2023-05-08T11:56:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:21 smithi133 ceph-mon[125939]: pgmap v15800: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 450 KiB/s rd, 470 KiB/s wr, 9 op/s 2023-05-08T11:56:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29520.087871 secs 2023-05-08T11:56:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:21 smithi096 ceph-mon[124666]: osdmap e1065: 12 total, 12 up, 12 in 2023-05-08T11:56:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:21 smithi096 ceph-mon[124666]: pgmap v15800: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 450 KiB/s rd, 470 KiB/s wr, 9 op/s 2023-05-08T11:56:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:23 smithi133 ceph-mon[125939]: pgmap v15801: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 466 KiB/s wr, 9 op/s 2023-05-08T11:56:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29523.242861 secs 2023-05-08T11:56:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:23 smithi096 ceph-mon[124666]: pgmap v15801: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 466 KiB/s wr, 9 op/s 2023-05-08T11:56:24.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29523.242861 secs 2023-05-08T11:56:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:23 smithi186 ceph-mon[126480]: pgmap v15801: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 466 KiB/s wr, 9 op/s 2023-05-08T11:56:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29523.242861 secs 2023-05-08T11:56:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29523.798654 secs 2023-05-08T11:56:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:25 smithi133 ceph-mon[125939]: pgmap v15802: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 108 KiB/s wr, 8 op/s 2023-05-08T11:56:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29523.798654 secs 2023-05-08T11:56:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:25 smithi096 ceph-mon[124666]: pgmap v15802: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 108 KiB/s wr, 8 op/s 2023-05-08T11:56:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29523.798654 secs 2023-05-08T11:56:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:25 smithi186 ceph-mon[126480]: pgmap v15802: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 108 KiB/s wr, 8 op/s 2023-05-08T11:56:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29525.087994 secs 2023-05-08T11:56:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29525.087994 secs 2023-05-08T11:56:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29525.087994 secs 2023-05-08T11:56:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:27 smithi133 ceph-mon[125939]: pgmap v15803: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 108 KiB/s wr, 8 op/s 2023-05-08T11:56:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:27 smithi096 ceph-mon[124666]: pgmap v15803: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 108 KiB/s wr, 8 op/s 2023-05-08T11:56:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:27 smithi186 ceph-mon[126480]: pgmap v15803: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 108 KiB/s wr, 8 op/s 2023-05-08T11:56:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29528.242984 secs 2023-05-08T11:56:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29528.242984 secs 2023-05-08T11:56:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29528.242984 secs 2023-05-08T11:56:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:29 smithi133 ceph-mon[125939]: pgmap v15804: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 108 KiB/s wr, 8 op/s 2023-05-08T11:56:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:29 smithi096 ceph-mon[124666]: pgmap v15804: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 108 KiB/s wr, 8 op/s 2023-05-08T11:56:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:29 smithi186 ceph-mon[126480]: pgmap v15804: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 108 KiB/s wr, 8 op/s 2023-05-08T11:56:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29528.798735 secs 2023-05-08T11:56:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29528.798735 secs 2023-05-08T11:56:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29528.798735 secs 2023-05-08T11:56:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29530.088113 secs 2023-05-08T11:56:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:31 smithi133 ceph-mon[125939]: pgmap v15805: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 218 KiB/s wr, 7 op/s 2023-05-08T11:56:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29530.088113 secs 2023-05-08T11:56:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:31 smithi096 ceph-mon[124666]: pgmap v15805: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 218 KiB/s wr, 7 op/s 2023-05-08T11:56:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29530.088113 secs 2023-05-08T11:56:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:31 smithi186 ceph-mon[126480]: pgmap v15805: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 218 KiB/s wr, 7 op/s 2023-05-08T11:56:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:33 smithi133 ceph-mon[125939]: pgmap v15806: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 184 KiB/s wr, 6 op/s 2023-05-08T11:56:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29533.243128 secs 2023-05-08T11:56:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:33 smithi096 ceph-mon[124666]: pgmap v15806: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 184 KiB/s wr, 6 op/s 2023-05-08T11:56:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29533.243128 secs 2023-05-08T11:56:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:33 smithi186 ceph-mon[126480]: pgmap v15806: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 184 KiB/s wr, 6 op/s 2023-05-08T11:56:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29533.243128 secs 2023-05-08T11:56:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29533.798815 secs 2023-05-08T11:56:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:35 smithi133 ceph-mon[125939]: pgmap v15807: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 184 KiB/s wr, 10 op/s 2023-05-08T11:56:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29533.798815 secs 2023-05-08T11:56:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:35 smithi096 ceph-mon[124666]: pgmap v15807: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 184 KiB/s wr, 10 op/s 2023-05-08T11:56:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29533.798815 secs 2023-05-08T11:56:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:35 smithi186 ceph-mon[126480]: pgmap v15807: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 184 KiB/s wr, 10 op/s 2023-05-08T11:56:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29535.088237 secs 2023-05-08T11:56:37.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29535.088237 secs 2023-05-08T11:56:37.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29535.088237 secs 2023-05-08T11:56:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:37 smithi133 ceph-mon[125939]: pgmap v15808: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 113 KiB/s wr, 6 op/s 2023-05-08T11:56:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:37 smithi096 ceph-mon[124666]: pgmap v15808: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 113 KiB/s wr, 6 op/s 2023-05-08T11:56:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:37 smithi186 ceph-mon[126480]: pgmap v15808: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 113 KiB/s wr, 6 op/s 2023-05-08T11:56:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29538.243235 secs 2023-05-08T11:56:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29538.243235 secs 2023-05-08T11:56:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29538.243235 secs 2023-05-08T11:56:40.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:39 smithi133 ceph-mon[125939]: pgmap v15809: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 113 KiB/s wr, 6 op/s 2023-05-08T11:56:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:39 smithi096 ceph-mon[124666]: pgmap v15809: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 113 KiB/s wr, 6 op/s 2023-05-08T11:56:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:39 smithi186 ceph-mon[126480]: pgmap v15809: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 113 KiB/s wr, 6 op/s 2023-05-08T11:56:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29538.798956 secs 2023-05-08T11:56:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29538.798956 secs 2023-05-08T11:56:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29538.798956 secs 2023-05-08T11:56:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29540.088336 secs 2023-05-08T11:56:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:41 smithi133 ceph-mon[125939]: pgmap v15810: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 339 KiB/s wr, 10 op/s 2023-05-08T11:56:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29540.088336 secs 2023-05-08T11:56:42.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:41 smithi096 ceph-mon[124666]: pgmap v15810: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 339 KiB/s wr, 10 op/s 2023-05-08T11:56:42.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29540.088336 secs 2023-05-08T11:56:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:41 smithi186 ceph-mon[126480]: pgmap v15810: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 339 KiB/s wr, 10 op/s 2023-05-08T11:56:43.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:56:43.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:56:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:56:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:44 smithi186 ceph-mon[126480]: pgmap v15811: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 227 KiB/s wr, 7 op/s 2023-05-08T11:56:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:44 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:56:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:44 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:56:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:44 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:56:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:44 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:56:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:44 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:56:44.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:44 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:56:44.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29543.243329 secs 2023-05-08T11:56:44.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:44 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:56:44.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:44 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:56:44.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:44 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:56:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:44 smithi133 ceph-mon[125939]: pgmap v15811: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 227 KiB/s wr, 7 op/s 2023-05-08T11:56:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:44 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:56:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:44 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:56:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:44 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:56:44.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:44 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:56:44.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:44 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:56:44.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:44 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:56:44.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29543.243329 secs 2023-05-08T11:56:44.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:44 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:56:44.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:44 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:56:44.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:44 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:56:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:44 smithi096 ceph-mon[124666]: pgmap v15811: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 227 KiB/s wr, 7 op/s 2023-05-08T11:56:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:44 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:56:44.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:44 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:56:44.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:44 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:56:44.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:44 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:56:44.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:44 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:56:44.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:44 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:56:44.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29543.243329 secs 2023-05-08T11:56:44.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:44 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:56:44.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:44 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:56:44.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:44 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:56:45.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:45 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:56:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:45 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T11:56:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:45 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T11:56:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:45 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:56:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29543.799072 secs 2023-05-08T11:56:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:45 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:56:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:45 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T11:56:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:45 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T11:56:45.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:45 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:56:45.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29543.799072 secs 2023-05-08T11:56:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:45 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:56:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:45 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T11:56:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:45 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T11:56:45.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:45 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:56:45.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29543.799072 secs 2023-05-08T11:56:46.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:46 smithi186 ceph-mon[126480]: pgmap v15812: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 248 KiB/s wr, 11 op/s 2023-05-08T11:56:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:46 smithi133 ceph-mon[125939]: pgmap v15812: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 248 KiB/s wr, 11 op/s 2023-05-08T11:56:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:46 smithi096 ceph-mon[124666]: pgmap v15812: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 248 KiB/s wr, 11 op/s 2023-05-08T11:56:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:48 smithi186 ceph-mon[126480]: pgmap v15813: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 248 KiB/s wr, 7 op/s 2023-05-08T11:56:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:48 smithi133 ceph-mon[125939]: pgmap v15813: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 248 KiB/s wr, 7 op/s 2023-05-08T11:56:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:48 smithi096 ceph-mon[124666]: pgmap v15813: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 248 KiB/s wr, 7 op/s 2023-05-08T11:56:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:56:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29548.243430 secs 2023-05-08T11:56:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:56:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29548.243430 secs 2023-05-08T11:56:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:56:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29548.243430 secs 2023-05-08T11:56:50.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:50 smithi186 ceph-mon[126480]: pgmap v15814: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 248 KiB/s wr, 7 op/s 2023-05-08T11:56:50.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:56:50.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:56:50.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:56:50.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29548.799181 secs 2023-05-08T11:56:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:50 smithi133 ceph-mon[125939]: pgmap v15814: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 248 KiB/s wr, 7 op/s 2023-05-08T11:56:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:56:50.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:56:50.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:56:50.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29548.799181 secs 2023-05-08T11:56:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:50 smithi096 ceph-mon[124666]: pgmap v15814: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 248 KiB/s wr, 7 op/s 2023-05-08T11:56:50.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:56:50.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:56:50.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:56:50.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29548.799181 secs 2023-05-08T11:56:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:51 smithi186 ceph-mon[126480]: pgmap v15815: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 404 KiB/s rd, 338 KiB/s wr, 10 op/s 2023-05-08T11:56:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:51 smithi133 ceph-mon[125939]: pgmap v15815: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 404 KiB/s rd, 338 KiB/s wr, 10 op/s 2023-05-08T11:56:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:51 smithi096 ceph-mon[124666]: pgmap v15815: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 404 KiB/s rd, 338 KiB/s wr, 10 op/s 2023-05-08T11:56:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:53 smithi133 ceph-mon[125939]: pgmap v15816: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 112 KiB/s wr, 7 op/s 2023-05-08T11:56:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29553.243549 secs 2023-05-08T11:56:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:53 smithi096 ceph-mon[124666]: pgmap v15816: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 112 KiB/s wr, 7 op/s 2023-05-08T11:56:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29553.243549 secs 2023-05-08T11:56:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:53 smithi186 ceph-mon[126480]: pgmap v15816: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 112 KiB/s wr, 7 op/s 2023-05-08T11:56:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29553.243549 secs 2023-05-08T11:56:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:55 smithi133 ceph-mon[125939]: pgmap v15817: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 870 KiB/s rd, 578 KiB/s wr, 11 op/s 2023-05-08T11:56:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:55 smithi096 ceph-mon[124666]: pgmap v15817: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 870 KiB/s rd, 578 KiB/s wr, 11 op/s 2023-05-08T11:56:56.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:55 smithi186 ceph-mon[126480]: pgmap v15817: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 870 KiB/s rd, 578 KiB/s wr, 11 op/s 2023-05-08T11:56:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:56:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:56:57.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:56:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:57 smithi133 ceph-mon[125939]: pgmap v15818: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 556 KiB/s wr, 8 op/s 2023-05-08T11:56:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:57 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:56:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:56:58.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:56:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:57 smithi096 ceph-mon[124666]: pgmap v15818: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 556 KiB/s wr, 8 op/s 2023-05-08T11:56:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:57 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:56:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:56:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:56:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:57 smithi186 ceph-mon[126480]: pgmap v15818: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 556 KiB/s wr, 8 op/s 2023-05-08T11:56:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:57 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:56:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:56:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:56:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29558.243610 secs 2023-05-08T11:56:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29558.243610 secs 2023-05-08T11:56:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29558.243610 secs 2023-05-08T11:57:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:56:59 smithi133 ceph-mon[125939]: pgmap v15819: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 557 KiB/s wr, 8 op/s 2023-05-08T11:57:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:56:59 smithi096 ceph-mon[124666]: pgmap v15819: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 557 KiB/s wr, 8 op/s 2023-05-08T11:57:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:56:59 smithi186 ceph-mon[126480]: pgmap v15819: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 557 KiB/s wr, 8 op/s 2023-05-08T11:57:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:01 smithi186 ceph-mon[126480]: pgmap v15820: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1015 KiB/s rd, 1.0 MiB/s wr, 13 op/s 2023-05-08T11:57:02.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:01 smithi133 ceph-mon[125939]: pgmap v15820: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1015 KiB/s rd, 1.0 MiB/s wr, 13 op/s 2023-05-08T11:57:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:01 smithi096 ceph-mon[124666]: pgmap v15820: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1015 KiB/s rd, 1.0 MiB/s wr, 13 op/s 2023-05-08T11:57:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:03 smithi133 ceph-mon[125939]: pgmap v15821: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 881 KiB/s rd, 973 KiB/s wr, 10 op/s 2023-05-08T11:57:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29563.243730 secs 2023-05-08T11:57:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:03 smithi096 ceph-mon[124666]: pgmap v15821: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 881 KiB/s rd, 973 KiB/s wr, 10 op/s 2023-05-08T11:57:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29563.243730 secs 2023-05-08T11:57:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:03 smithi186 ceph-mon[126480]: pgmap v15821: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 881 KiB/s rd, 973 KiB/s wr, 10 op/s 2023-05-08T11:57:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29563.243730 secs 2023-05-08T11:57:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:04 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:57:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:04 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:57:05.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:04 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:57:05.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:04 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:57:05.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:04 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:57:05.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:04 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:57:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:04 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:57:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:04 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:57:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:04 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:57:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29563.799553 secs 2023-05-08T11:57:06.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:05 smithi133 ceph-mon[125939]: pgmap v15822: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 29 op/s 2023-05-08T11:57:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29563.799553 secs 2023-05-08T11:57:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:05 smithi096 ceph-mon[124666]: pgmap v15822: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 29 op/s 2023-05-08T11:57:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29563.799553 secs 2023-05-08T11:57:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:05 smithi186 ceph-mon[126480]: pgmap v15822: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 29 op/s 2023-05-08T11:57:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:07 smithi133 ceph-mon[125939]: pgmap v15823: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 727 KiB/s rd, 750 KiB/s wr, 25 op/s 2023-05-08T11:57:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:07 smithi096 ceph-mon[124666]: pgmap v15823: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 727 KiB/s rd, 750 KiB/s wr, 25 op/s 2023-05-08T11:57:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:07 smithi186 ceph-mon[126480]: pgmap v15823: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 727 KiB/s rd, 750 KiB/s wr, 25 op/s 2023-05-08T11:57:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29568.243839 secs 2023-05-08T11:57:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29568.243839 secs 2023-05-08T11:57:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29568.243839 secs 2023-05-08T11:57:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:09 smithi133 ceph-mon[125939]: pgmap v15824: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 727 KiB/s rd, 750 KiB/s wr, 24 op/s 2023-05-08T11:57:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:09 smithi096 ceph-mon[124666]: pgmap v15824: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 727 KiB/s rd, 750 KiB/s wr, 24 op/s 2023-05-08T11:57:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:09 smithi186 ceph-mon[126480]: pgmap v15824: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 727 KiB/s rd, 750 KiB/s wr, 24 op/s 2023-05-08T11:57:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:11 smithi096 ceph-mon[124666]: pgmap v15825: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 751 KiB/s rd, 1011 KiB/s wr, 29 op/s 2023-05-08T11:57:12.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:11 smithi096 ceph-mon[124666]: osdmap e1066: 12 total, 12 up, 12 in 2023-05-08T11:57:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:11 smithi186 ceph-mon[126480]: pgmap v15825: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 751 KiB/s rd, 1011 KiB/s wr, 29 op/s 2023-05-08T11:57:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:11 smithi186 ceph-mon[126480]: osdmap e1066: 12 total, 12 up, 12 in 2023-05-08T11:57:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:11 smithi133 ceph-mon[125939]: pgmap v15825: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 751 KiB/s rd, 1011 KiB/s wr, 29 op/s 2023-05-08T11:57:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:11 smithi133 ceph-mon[125939]: osdmap e1066: 12 total, 12 up, 12 in 2023-05-08T11:57:13.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:12 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:57:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:12 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:57:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:12 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:57:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:13 smithi096 ceph-mon[124666]: pgmap v15827: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 404 KiB/s rd, 605 KiB/s wr, 28 op/s 2023-05-08T11:57:14.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:13 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:57:14.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:57:14.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:13 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:57:14.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29573.243970 secs 2023-05-08T11:57:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:13 smithi186 ceph-mon[126480]: pgmap v15827: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 404 KiB/s rd, 605 KiB/s wr, 28 op/s 2023-05-08T11:57:14.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:13 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:57:14.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:57:14.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:13 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:57:14.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29573.243970 secs 2023-05-08T11:57:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:13 smithi133 ceph-mon[125939]: pgmap v15827: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 404 KiB/s rd, 605 KiB/s wr, 28 op/s 2023-05-08T11:57:14.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:13 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:57:14.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:57:14.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:13 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:57:14.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29573.243970 secs 2023-05-08T11:57:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:15 smithi096 ceph-mon[124666]: pgmap v15828: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 752 KiB/s rd, 625 KiB/s wr, 10 op/s 2023-05-08T11:57:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:15 smithi186 ceph-mon[126480]: pgmap v15828: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 752 KiB/s rd, 625 KiB/s wr, 10 op/s 2023-05-08T11:57:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:15 smithi133 ceph-mon[125939]: pgmap v15828: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 752 KiB/s rd, 625 KiB/s wr, 10 op/s 2023-05-08T11:57:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:17 smithi096 ceph-mon[124666]: pgmap v15829: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 625 KiB/s wr, 10 op/s 2023-05-08T11:57:18.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:17 smithi186 ceph-mon[126480]: pgmap v15829: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 625 KiB/s wr, 10 op/s 2023-05-08T11:57:18.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:17 smithi133 ceph-mon[125939]: pgmap v15829: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 625 KiB/s wr, 10 op/s 2023-05-08T11:57:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29578.244074 secs 2023-05-08T11:57:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29578.244074 secs 2023-05-08T11:57:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29578.244074 secs 2023-05-08T11:57:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:20 smithi096 ceph-mon[124666]: pgmap v15830: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 625 KiB/s wr, 10 op/s 2023-05-08T11:57:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:20 smithi186 ceph-mon[126480]: pgmap v15830: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 625 KiB/s wr, 10 op/s 2023-05-08T11:57:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:20 smithi133 ceph-mon[125939]: pgmap v15830: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 625 KiB/s wr, 10 op/s 2023-05-08T11:57:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:21 smithi186 ceph-mon[126480]: osdmap e1067: 12 total, 12 up, 12 in 2023-05-08T11:57:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:21 smithi186 ceph-mon[126480]: pgmap v15832: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 717 KiB/s rd, 426 KiB/s wr, 10 op/s 2023-05-08T11:57:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:21 smithi133 ceph-mon[125939]: osdmap e1067: 12 total, 12 up, 12 in 2023-05-08T11:57:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:21 smithi133 ceph-mon[125939]: pgmap v15832: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 717 KiB/s rd, 426 KiB/s wr, 10 op/s 2023-05-08T11:57:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:21 smithi096 ceph-mon[124666]: osdmap e1067: 12 total, 12 up, 12 in 2023-05-08T11:57:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:21 smithi096 ceph-mon[124666]: pgmap v15832: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 717 KiB/s rd, 426 KiB/s wr, 10 op/s 2023-05-08T11:57:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:23 smithi133 ceph-mon[125939]: pgmap v15833: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 708 KiB/s rd, 420 KiB/s wr, 10 op/s 2023-05-08T11:57:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29583.244146 secs 2023-05-08T11:57:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:23 smithi096 ceph-mon[124666]: pgmap v15833: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 708 KiB/s rd, 420 KiB/s wr, 10 op/s 2023-05-08T11:57:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29583.244146 secs 2023-05-08T11:57:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:23 smithi186 ceph-mon[126480]: pgmap v15833: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 708 KiB/s rd, 420 KiB/s wr, 10 op/s 2023-05-08T11:57:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29583.244146 secs 2023-05-08T11:57:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:24 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:57:25.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:24 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:57:25.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:24 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:57:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:24 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:57:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:24 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:57:25.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:24 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:57:25.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:24 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:57:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:24 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:57:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:24 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:57:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29583.799918 secs 2023-05-08T11:57:26.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:25 smithi133 ceph-mon[125939]: pgmap v15834: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 705 KiB/s rd, 725 KiB/s wr, 10 op/s 2023-05-08T11:57:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29583.799918 secs 2023-05-08T11:57:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:25 smithi096 ceph-mon[124666]: pgmap v15834: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 705 KiB/s rd, 725 KiB/s wr, 10 op/s 2023-05-08T11:57:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29583.799918 secs 2023-05-08T11:57:26.393 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:25 smithi186 ceph-mon[126480]: pgmap v15834: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 705 KiB/s rd, 725 KiB/s wr, 10 op/s 2023-05-08T11:57:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29585.089344 secs 2023-05-08T11:57:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29585.089344 secs 2023-05-08T11:57:27.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29585.089344 secs 2023-05-08T11:57:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:27 smithi133 ceph-mon[125939]: pgmap v15835: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 705 KiB/s rd, 725 KiB/s wr, 10 op/s 2023-05-08T11:57:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:27 smithi096 ceph-mon[124666]: pgmap v15835: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 705 KiB/s rd, 725 KiB/s wr, 10 op/s 2023-05-08T11:57:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:27 smithi186 ceph-mon[126480]: pgmap v15835: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 705 KiB/s rd, 725 KiB/s wr, 10 op/s 2023-05-08T11:57:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29588.244205 secs 2023-05-08T11:57:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29588.244205 secs 2023-05-08T11:57:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29588.244205 secs 2023-05-08T11:57:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:29 smithi096 ceph-mon[124666]: pgmap v15836: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 705 KiB/s rd, 725 KiB/s wr, 10 op/s 2023-05-08T11:57:30.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:29 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:57:30.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:29 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:57:30.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29588.800014 secs 2023-05-08T11:57:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:29 smithi186 ceph-mon[126480]: pgmap v15836: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 705 KiB/s rd, 725 KiB/s wr, 10 op/s 2023-05-08T11:57:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:29 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:57:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:29 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:57:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29588.800014 secs 2023-05-08T11:57:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:29 smithi133 ceph-mon[125939]: pgmap v15836: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 705 KiB/s rd, 725 KiB/s wr, 10 op/s 2023-05-08T11:57:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:29 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:57:30.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:29 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:57:30.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29588.800014 secs 2023-05-08T11:57:31.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:30 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:57:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:30 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:57:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:30 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:57:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29590.089463 secs 2023-05-08T11:57:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:31 smithi096 ceph-mon[124666]: pgmap v15837: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 749 KiB/s rd, 769 KiB/s wr, 10 op/s 2023-05-08T11:57:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29590.089463 secs 2023-05-08T11:57:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:31 smithi186 ceph-mon[126480]: pgmap v15837: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 749 KiB/s rd, 769 KiB/s wr, 10 op/s 2023-05-08T11:57:32.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29590.089463 secs 2023-05-08T11:57:32.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:31 smithi133 ceph-mon[125939]: pgmap v15837: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 749 KiB/s rd, 769 KiB/s wr, 10 op/s 2023-05-08T11:57:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:33 smithi096 ceph-mon[124666]: pgmap v15838: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 630 KiB/s rd, 647 KiB/s wr, 8 op/s 2023-05-08T11:57:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29593.244331 secs 2023-05-08T11:57:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:34 smithi186 ceph-mon[126480]: pgmap v15838: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 630 KiB/s rd, 647 KiB/s wr, 8 op/s 2023-05-08T11:57:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29593.244331 secs 2023-05-08T11:57:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:33 smithi133 ceph-mon[125939]: pgmap v15838: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 630 KiB/s rd, 647 KiB/s wr, 8 op/s 2023-05-08T11:57:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29593.244331 secs 2023-05-08T11:57:35.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29593.800153 secs 2023-05-08T11:57:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29593.800153 secs 2023-05-08T11:57:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29593.800153 secs 2023-05-08T11:57:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:36 smithi186 ceph-mon[126480]: pgmap v15839: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 873 KiB/s rd, 870 KiB/s wr, 12 op/s 2023-05-08T11:57:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:36 smithi133 ceph-mon[125939]: pgmap v15839: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 873 KiB/s rd, 870 KiB/s wr, 12 op/s 2023-05-08T11:57:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:36 smithi096 ceph-mon[124666]: pgmap v15839: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 873 KiB/s rd, 870 KiB/s wr, 12 op/s 2023-05-08T11:57:37.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:37 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29595.089583 secs 2023-05-08T11:57:37.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:37 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29595.089583 secs 2023-05-08T11:57:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:37 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29595.089583 secs 2023-05-08T11:57:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:38 smithi186 ceph-mon[126480]: pgmap v15840: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 355 KiB/s wr, 8 op/s 2023-05-08T11:57:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:38 smithi133 ceph-mon[125939]: pgmap v15840: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 355 KiB/s wr, 8 op/s 2023-05-08T11:57:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:38 smithi096 ceph-mon[124666]: pgmap v15840: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 355 KiB/s wr, 8 op/s 2023-05-08T11:57:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29598.244470 secs 2023-05-08T11:57:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29598.244470 secs 2023-05-08T11:57:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29598.244470 secs 2023-05-08T11:57:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:40 smithi186 ceph-mon[126480]: pgmap v15841: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 355 KiB/s wr, 7 op/s 2023-05-08T11:57:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29598.800273 secs 2023-05-08T11:57:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:40 smithi133 ceph-mon[125939]: pgmap v15841: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 355 KiB/s wr, 7 op/s 2023-05-08T11:57:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29598.800273 secs 2023-05-08T11:57:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:40 smithi096 ceph-mon[124666]: pgmap v15841: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 355 KiB/s wr, 7 op/s 2023-05-08T11:57:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29598.800273 secs 2023-05-08T11:57:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29600.089676 secs 2023-05-08T11:57:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:41 smithi186 ceph-mon[126480]: pgmap v15842: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 377 KiB/s rd, 355 KiB/s wr, 11 op/s 2023-05-08T11:57:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29600.089676 secs 2023-05-08T11:57:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:41 smithi133 ceph-mon[125939]: pgmap v15842: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 377 KiB/s rd, 355 KiB/s wr, 11 op/s 2023-05-08T11:57:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29600.089676 secs 2023-05-08T11:57:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:41 smithi096 ceph-mon[124666]: pgmap v15842: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 377 KiB/s rd, 355 KiB/s wr, 11 op/s 2023-05-08T11:57:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:43 smithi133 ceph-mon[125939]: pgmap v15843: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 223 KiB/s wr, 6 op/s 2023-05-08T11:57:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29603.244590 secs 2023-05-08T11:57:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:43 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:57:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:43 smithi096 ceph-mon[124666]: pgmap v15843: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 223 KiB/s wr, 6 op/s 2023-05-08T11:57:44.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29603.244590 secs 2023-05-08T11:57:44.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:43 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:57:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:43 smithi186 ceph-mon[126480]: pgmap v15843: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 223 KiB/s wr, 6 op/s 2023-05-08T11:57:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29603.244590 secs 2023-05-08T11:57:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:43 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:57:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:44 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:57:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:44 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:57:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:44 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:57:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:44 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:57:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:44 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:57:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:44 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:57:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:44 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:57:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:44 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:57:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:44 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:57:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29603.800339 secs 2023-05-08T11:57:46.421 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:45 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:57:46.421 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:45 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T11:57:46.421 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:45 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T11:57:46.421 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:45 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:57:46.422 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:45 smithi133 ceph-mon[125939]: pgmap v15844: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 671 KiB/s wr, 10 op/s 2023-05-08T11:57:46.422 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29603.800339 secs 2023-05-08T11:57:46.423 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:45 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:57:46.423 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:45 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T11:57:46.423 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:45 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T11:57:46.423 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:45 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:57:46.423 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:45 smithi186 ceph-mon[126480]: pgmap v15844: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 671 KiB/s wr, 10 op/s 2023-05-08T11:57:46.423 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29603.800339 secs 2023-05-08T11:57:46.423 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:45 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:57:46.424 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:45 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T11:57:46.424 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:45 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T11:57:46.424 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:45 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:57:46.424 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:45 smithi096 ceph-mon[124666]: pgmap v15844: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 671 KiB/s wr, 10 op/s 2023-05-08T11:57:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:47 smithi133 ceph-mon[125939]: pgmap v15845: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 448 KiB/s wr, 6 op/s 2023-05-08T11:57:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:47 smithi096 ceph-mon[124666]: pgmap v15845: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 448 KiB/s wr, 6 op/s 2023-05-08T11:57:48.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:47 smithi186 ceph-mon[126480]: pgmap v15845: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 448 KiB/s wr, 6 op/s 2023-05-08T11:57:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:57:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29608.244686 secs 2023-05-08T11:57:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:57:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29608.244686 secs 2023-05-08T11:57:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:57:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29608.244686 secs 2023-05-08T11:57:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:49 smithi133 ceph-mon[125939]: pgmap v15846: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 448 KiB/s wr, 6 op/s 2023-05-08T11:57:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:57:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:57:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:57:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:49 smithi096 ceph-mon[124666]: pgmap v15846: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 448 KiB/s wr, 6 op/s 2023-05-08T11:57:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:57:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:57:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:57:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:49 smithi186 ceph-mon[126480]: pgmap v15846: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 448 KiB/s wr, 6 op/s 2023-05-08T11:57:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:57:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:57:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:57:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:51 smithi186 ceph-mon[126480]: pgmap v15847: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 533 KiB/s rd, 486 KiB/s wr, 11 op/s 2023-05-08T11:57:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:51 smithi133 ceph-mon[125939]: pgmap v15847: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 533 KiB/s rd, 486 KiB/s wr, 11 op/s 2023-05-08T11:57:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:51 smithi096 ceph-mon[124666]: pgmap v15847: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 533 KiB/s rd, 486 KiB/s wr, 11 op/s 2023-05-08T11:57:53.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:57:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:57:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:57:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:57:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:57:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:53 smithi186 ceph-mon[126480]: pgmap v15848: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 532 KiB/s rd, 485 KiB/s wr, 8 op/s 2023-05-08T11:57:54.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29613.244756 secs 2023-05-08T11:57:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:57:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:57:54.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:53 smithi133 ceph-mon[125939]: pgmap v15848: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 532 KiB/s rd, 485 KiB/s wr, 8 op/s 2023-05-08T11:57:54.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29613.244756 secs 2023-05-08T11:57:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:57:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:57:54.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:53 smithi096 ceph-mon[124666]: pgmap v15848: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 532 KiB/s rd, 485 KiB/s wr, 8 op/s 2023-05-08T11:57:54.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29613.244756 secs 2023-05-08T11:57:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:55 smithi133 ceph-mon[125939]: pgmap v15849: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 941 KiB/s rd, 850 KiB/s wr, 13 op/s 2023-05-08T11:57:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:55 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:57:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:55 smithi096 ceph-mon[124666]: pgmap v15849: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 941 KiB/s rd, 850 KiB/s wr, 13 op/s 2023-05-08T11:57:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:55 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:57:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:55 smithi186 ceph-mon[126480]: pgmap v15849: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 941 KiB/s rd, 850 KiB/s wr, 13 op/s 2023-05-08T11:57:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:55 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:57:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:57 smithi133 ceph-mon[125939]: pgmap v15850: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 744 KiB/s wr, 11 op/s 2023-05-08T11:57:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:57 smithi096 ceph-mon[124666]: pgmap v15850: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 744 KiB/s wr, 11 op/s 2023-05-08T11:57:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:57 smithi186 ceph-mon[126480]: pgmap v15850: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 744 KiB/s wr, 11 op/s 2023-05-08T11:57:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29618.244859 secs 2023-05-08T11:57:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29618.244859 secs 2023-05-08T11:57:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29618.244859 secs 2023-05-08T11:58:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:57:59 smithi133 ceph-mon[125939]: pgmap v15851: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 744 KiB/s wr, 11 op/s 2023-05-08T11:58:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:57:59 smithi096 ceph-mon[124666]: pgmap v15851: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 744 KiB/s wr, 11 op/s 2023-05-08T11:58:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:57:59 smithi186 ceph-mon[126480]: pgmap v15851: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 744 KiB/s wr, 11 op/s 2023-05-08T11:58:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:01 smithi186 ceph-mon[126480]: pgmap v15852: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 925 KiB/s wr, 17 op/s 2023-05-08T11:58:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:01 smithi133 ceph-mon[125939]: pgmap v15852: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 925 KiB/s wr, 17 op/s 2023-05-08T11:58:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:01 smithi096 ceph-mon[124666]: pgmap v15852: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 925 KiB/s wr, 17 op/s 2023-05-08T11:58:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:03 smithi133 ceph-mon[125939]: pgmap v15853: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 935 KiB/s rd, 887 KiB/s wr, 13 op/s 2023-05-08T11:58:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29623.244973 secs 2023-05-08T11:58:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:03 smithi096 ceph-mon[124666]: pgmap v15853: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 935 KiB/s rd, 887 KiB/s wr, 13 op/s 2023-05-08T11:58:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29623.244973 secs 2023-05-08T11:58:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:03 smithi186 ceph-mon[126480]: pgmap v15853: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 935 KiB/s rd, 887 KiB/s wr, 13 op/s 2023-05-08T11:58:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29623.244973 secs 2023-05-08T11:58:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:04 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:58:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:04 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:58:05.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:04 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:58:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:04 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:58:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:04 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:58:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:04 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:58:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:04 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:58:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:04 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:58:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:04 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:58:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29623.800817 secs 2023-05-08T11:58:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:05 smithi096 ceph-mon[124666]: pgmap v15854: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 32 op/s 2023-05-08T11:58:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29623.800817 secs 2023-05-08T11:58:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:05 smithi186 ceph-mon[126480]: pgmap v15854: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 32 op/s 2023-05-08T11:58:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29623.800817 secs 2023-05-08T11:58:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:05 smithi133 ceph-mon[125939]: pgmap v15854: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 32 op/s 2023-05-08T11:58:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:07 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29625.090324 secs 2023-05-08T11:58:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:07 smithi186 ceph-mon[126480]: osdmap e1068: 12 total, 12 up, 12 in 2023-05-08T11:58:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:07 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29625.090324 secs 2023-05-08T11:58:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:07 smithi133 ceph-mon[125939]: osdmap e1068: 12 total, 12 up, 12 in 2023-05-08T11:58:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:07 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29625.090324 secs 2023-05-08T11:58:07.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:07 smithi096 ceph-mon[124666]: osdmap e1068: 12 total, 12 up, 12 in 2023-05-08T11:58:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:08 smithi186 ceph-mon[126480]: pgmap v15856: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 615 KiB/s wr, 31 op/s 2023-05-08T11:58:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:08 smithi133 ceph-mon[125939]: pgmap v15856: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 615 KiB/s wr, 31 op/s 2023-05-08T11:58:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:08 smithi096 ceph-mon[124666]: pgmap v15856: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 615 KiB/s wr, 31 op/s 2023-05-08T11:58:09.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29628.245083 secs 2023-05-08T11:58:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29628.245083 secs 2023-05-08T11:58:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29628.245083 secs 2023-05-08T11:58:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:10 smithi186 ceph-mon[126480]: pgmap v15857: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 615 KiB/s wr, 31 op/s 2023-05-08T11:58:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:10 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:58:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:10 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:58:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29628.800961 secs 2023-05-08T11:58:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:10 smithi133 ceph-mon[125939]: pgmap v15857: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 615 KiB/s wr, 31 op/s 2023-05-08T11:58:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:10 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:58:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:10 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:58:10.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29628.800961 secs 2023-05-08T11:58:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:10 smithi096 ceph-mon[124666]: pgmap v15857: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 615 KiB/s wr, 31 op/s 2023-05-08T11:58:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:10 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:58:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:10 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:58:10.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29628.800961 secs 2023-05-08T11:58:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:11 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:58:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:11 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:58:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:11 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:58:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:12 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29630.090451 secs 2023-05-08T11:58:12.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:12 smithi186 ceph-mon[126480]: pgmap v15858: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 398 KiB/s wr, 27 op/s 2023-05-08T11:58:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:12 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29630.090451 secs 2023-05-08T11:58:12.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:12 smithi133 ceph-mon[125939]: pgmap v15858: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 398 KiB/s wr, 27 op/s 2023-05-08T11:58:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:12 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29630.090451 secs 2023-05-08T11:58:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:12 smithi096 ceph-mon[124666]: pgmap v15858: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 398 KiB/s wr, 27 op/s 2023-05-08T11:58:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:14 smithi186 ceph-mon[126480]: pgmap v15859: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 398 KiB/s wr, 27 op/s 2023-05-08T11:58:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29633.245199 secs 2023-05-08T11:58:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:14 smithi133 ceph-mon[125939]: pgmap v15859: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 398 KiB/s wr, 27 op/s 2023-05-08T11:58:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29633.245199 secs 2023-05-08T11:58:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:14 smithi096 ceph-mon[124666]: pgmap v15859: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 398 KiB/s wr, 27 op/s 2023-05-08T11:58:14.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29633.245199 secs 2023-05-08T11:58:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29633.801077 secs 2023-05-08T11:58:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29633.801077 secs 2023-05-08T11:58:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29633.801077 secs 2023-05-08T11:58:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:16 smithi186 ceph-mon[126480]: pgmap v15860: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 292 KiB/s wr, 8 op/s 2023-05-08T11:58:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:16 smithi186 ceph-mon[126480]: osdmap e1069: 12 total, 12 up, 12 in 2023-05-08T11:58:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:16 smithi133 ceph-mon[125939]: pgmap v15860: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 292 KiB/s wr, 8 op/s 2023-05-08T11:58:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:16 smithi133 ceph-mon[125939]: osdmap e1069: 12 total, 12 up, 12 in 2023-05-08T11:58:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:16 smithi096 ceph-mon[124666]: pgmap v15860: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 292 KiB/s wr, 8 op/s 2023-05-08T11:58:16.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:16 smithi096 ceph-mon[124666]: osdmap e1069: 12 total, 12 up, 12 in 2023-05-08T11:58:17.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:17 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29635.090593 secs 2023-05-08T11:58:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:17 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29635.090593 secs 2023-05-08T11:58:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:17 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29635.090593 secs 2023-05-08T11:58:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:18 smithi186 ceph-mon[126480]: pgmap v15862: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 291 KiB/s wr, 8 op/s 2023-05-08T11:58:18.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:18 smithi133 ceph-mon[125939]: pgmap v15862: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 291 KiB/s wr, 8 op/s 2023-05-08T11:58:18.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:18 smithi096 ceph-mon[124666]: pgmap v15862: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 291 KiB/s wr, 8 op/s 2023-05-08T11:58:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29638.245321 secs 2023-05-08T11:58:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29638.245321 secs 2023-05-08T11:58:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29638.245321 secs 2023-05-08T11:58:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:20 smithi186 ceph-mon[126480]: pgmap v15863: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 291 KiB/s wr, 8 op/s 2023-05-08T11:58:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29638.801189 secs 2023-05-08T11:58:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:20 smithi133 ceph-mon[125939]: pgmap v15863: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 291 KiB/s wr, 8 op/s 2023-05-08T11:58:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29638.801189 secs 2023-05-08T11:58:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:20 smithi096 ceph-mon[124666]: pgmap v15863: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 291 KiB/s wr, 8 op/s 2023-05-08T11:58:20.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29638.801189 secs 2023-05-08T11:58:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29640.090710 secs 2023-05-08T11:58:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:21 smithi186 ceph-mon[126480]: pgmap v15864: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 294 KiB/s rd, 291 KiB/s wr, 6 op/s 2023-05-08T11:58:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29640.090710 secs 2023-05-08T11:58:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:21 smithi133 ceph-mon[125939]: pgmap v15864: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 294 KiB/s rd, 291 KiB/s wr, 6 op/s 2023-05-08T11:58:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29640.090710 secs 2023-05-08T11:58:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:21 smithi096 ceph-mon[124666]: pgmap v15864: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 294 KiB/s rd, 291 KiB/s wr, 6 op/s 2023-05-08T11:58:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:23 smithi133 ceph-mon[125939]: pgmap v15865: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 294 KiB/s rd, 291 KiB/s wr, 6 op/s 2023-05-08T11:58:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29643.245463 secs 2023-05-08T11:58:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:23 smithi096 ceph-mon[124666]: pgmap v15865: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 294 KiB/s rd, 291 KiB/s wr, 6 op/s 2023-05-08T11:58:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29643.245463 secs 2023-05-08T11:58:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:23 smithi186 ceph-mon[126480]: pgmap v15865: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 294 KiB/s rd, 291 KiB/s wr, 6 op/s 2023-05-08T11:58:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29643.245463 secs 2023-05-08T11:58:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29643.801302 secs 2023-05-08T11:58:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:25 smithi133 ceph-mon[125939]: pgmap v15866: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T11:58:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29643.801302 secs 2023-05-08T11:58:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:25 smithi096 ceph-mon[124666]: pgmap v15866: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T11:58:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29643.801302 secs 2023-05-08T11:58:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:25 smithi186 ceph-mon[126480]: pgmap v15866: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T11:58:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29645.090837 secs 2023-05-08T11:58:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29645.090837 secs 2023-05-08T11:58:27.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29645.090837 secs 2023-05-08T11:58:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:27 smithi133 ceph-mon[125939]: pgmap v15867: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-05-08T11:58:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:27 smithi096 ceph-mon[124666]: pgmap v15867: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-05-08T11:58:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:27 smithi186 ceph-mon[126480]: pgmap v15867: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-05-08T11:58:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29648.245593 secs 2023-05-08T11:58:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29648.245593 secs 2023-05-08T11:58:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29648.245593 secs 2023-05-08T11:58:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:29 smithi133 ceph-mon[125939]: pgmap v15868: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T11:58:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:29 smithi096 ceph-mon[124666]: pgmap v15868: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T11:58:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:29 smithi186 ceph-mon[126480]: pgmap v15868: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T11:58:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29648.801418 secs 2023-05-08T11:58:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29648.801418 secs 2023-05-08T11:58:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29648.801418 secs 2023-05-08T11:58:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29650.090963 secs 2023-05-08T11:58:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:31 smithi133 ceph-mon[125939]: pgmap v15869: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T11:58:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29650.090963 secs 2023-05-08T11:58:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:31 smithi096 ceph-mon[124666]: pgmap v15869: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T11:58:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29650.090963 secs 2023-05-08T11:58:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:31 smithi186 ceph-mon[126480]: pgmap v15869: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T11:58:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:33 smithi133 ceph-mon[125939]: pgmap v15870: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T11:58:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29653.245713 secs 2023-05-08T11:58:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:33 smithi096 ceph-mon[124666]: pgmap v15870: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T11:58:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29653.245713 secs 2023-05-08T11:58:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:33 smithi186 ceph-mon[126480]: pgmap v15870: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T11:58:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29653.245713 secs 2023-05-08T11:58:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29653.801485 secs 2023-05-08T11:58:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:35 smithi133 ceph-mon[125939]: pgmap v15871: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 32 KiB/s wr, 9 op/s 2023-05-08T11:58:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29653.801485 secs 2023-05-08T11:58:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:35 smithi096 ceph-mon[124666]: pgmap v15871: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 32 KiB/s wr, 9 op/s 2023-05-08T11:58:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29653.801485 secs 2023-05-08T11:58:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:35 smithi186 ceph-mon[126480]: pgmap v15871: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 32 KiB/s wr, 9 op/s 2023-05-08T11:58:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29655.091102 secs 2023-05-08T11:58:37.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29655.091102 secs 2023-05-08T11:58:37.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29655.091102 secs 2023-05-08T11:58:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:37 smithi133 ceph-mon[125939]: pgmap v15872: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T11:58:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:37 smithi096 ceph-mon[124666]: pgmap v15872: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T11:58:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:37 smithi186 ceph-mon[126480]: pgmap v15872: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T11:58:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:38 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29658.245835 secs 2023-05-08T11:58:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:38 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29658.245835 secs 2023-05-08T11:58:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:38 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29658.245835 secs 2023-05-08T11:58:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:39 smithi096 ceph-mon[124666]: pgmap v15873: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T11:58:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:39 smithi186 ceph-mon[126480]: pgmap v15873: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T11:58:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:39 smithi133 ceph-mon[125939]: pgmap v15873: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 32 KiB/s wr, 6 op/s 2023-05-08T11:58:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29658.801636 secs 2023-05-08T11:58:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29658.801636 secs 2023-05-08T11:58:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29658.801636 secs 2023-05-08T11:58:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29660.091197 secs 2023-05-08T11:58:42.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:41 smithi096 ceph-mon[124666]: pgmap v15874: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 338 KiB/s wr, 10 op/s 2023-05-08T11:58:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29660.091197 secs 2023-05-08T11:58:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:41 smithi186 ceph-mon[126480]: pgmap v15874: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 338 KiB/s wr, 10 op/s 2023-05-08T11:58:42.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29660.091197 secs 2023-05-08T11:58:42.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:41 smithi133 ceph-mon[125939]: pgmap v15874: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 338 KiB/s wr, 10 op/s 2023-05-08T11:58:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:43 smithi096 ceph-mon[124666]: pgmap v15875: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 337 KiB/s wr, 7 op/s 2023-05-08T11:58:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29663.245935 secs 2023-05-08T11:58:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:43 smithi186 ceph-mon[126480]: pgmap v15875: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 337 KiB/s wr, 7 op/s 2023-05-08T11:58:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29663.245935 secs 2023-05-08T11:58:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:43 smithi133 ceph-mon[125939]: pgmap v15875: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 337 KiB/s wr, 7 op/s 2023-05-08T11:58:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29663.245935 secs 2023-05-08T11:58:45.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29663.801775 secs 2023-05-08T11:58:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:58:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29663.801775 secs 2023-05-08T11:58:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:58:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29663.801775 secs 2023-05-08T11:58:45.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:58:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:46 smithi186 ceph-mon[126480]: pgmap v15876: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 374 KiB/s wr, 11 op/s 2023-05-08T11:58:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:46 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:58:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:46 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:58:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:46 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:58:46.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:46 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:58:46.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:46 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T11:58:46.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:46 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T11:58:46.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:46 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:58:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:46 smithi133 ceph-mon[125939]: pgmap v15876: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 374 KiB/s wr, 11 op/s 2023-05-08T11:58:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:46 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:58:46.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:46 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:58:46.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:46 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:58:46.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:46 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:58:46.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:46 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T11:58:46.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:46 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T11:58:46.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:46 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:58:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:46 smithi096 ceph-mon[124666]: pgmap v15876: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 374 KiB/s wr, 11 op/s 2023-05-08T11:58:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:46 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:58:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:46 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:58:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:46 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:58:46.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:46 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:58:46.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:46 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T11:58:46.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:46 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T11:58:46.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:46 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:58:48.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:48 smithi186 ceph-mon[126480]: pgmap v15877: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 342 KiB/s wr, 7 op/s 2023-05-08T11:58:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:48 smithi133 ceph-mon[125939]: pgmap v15877: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 342 KiB/s wr, 7 op/s 2023-05-08T11:58:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:48 smithi096 ceph-mon[124666]: pgmap v15877: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 342 KiB/s wr, 7 op/s 2023-05-08T11:58:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:58:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29668.246032 secs 2023-05-08T11:58:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:58:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29668.246032 secs 2023-05-08T11:58:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:58:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29668.246032 secs 2023-05-08T11:58:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:50 smithi186 ceph-mon[126480]: pgmap v15878: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 342 KiB/s wr, 7 op/s 2023-05-08T11:58:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:58:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:58:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:58:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29668.801850 secs 2023-05-08T11:58:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:50 smithi133 ceph-mon[125939]: pgmap v15878: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 342 KiB/s wr, 7 op/s 2023-05-08T11:58:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:58:50.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:58:50.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:58:50.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29668.801850 secs 2023-05-08T11:58:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:50 smithi096 ceph-mon[124666]: pgmap v15878: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 342 KiB/s wr, 7 op/s 2023-05-08T11:58:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:58:50.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:58:50.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:58:50.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29668.801850 secs 2023-05-08T11:58:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:51 smithi186 ceph-mon[126480]: pgmap v15879: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 926 KiB/s rd, 689 KiB/s wr, 11 op/s 2023-05-08T11:58:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:51 smithi133 ceph-mon[125939]: pgmap v15879: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 926 KiB/s rd, 689 KiB/s wr, 11 op/s 2023-05-08T11:58:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:51 smithi096 ceph-mon[124666]: pgmap v15879: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 926 KiB/s rd, 689 KiB/s wr, 11 op/s 2023-05-08T11:58:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:53 smithi133 ceph-mon[125939]: pgmap v15880: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 754 KiB/s rd, 384 KiB/s wr, 7 op/s 2023-05-08T11:58:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29673.246146 secs 2023-05-08T11:58:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:53 smithi096 ceph-mon[124666]: pgmap v15880: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 754 KiB/s rd, 384 KiB/s wr, 7 op/s 2023-05-08T11:58:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29673.246146 secs 2023-05-08T11:58:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:53 smithi186 ceph-mon[126480]: pgmap v15880: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 754 KiB/s rd, 384 KiB/s wr, 7 op/s 2023-05-08T11:58:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29673.246146 secs 2023-05-08T11:58:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:55 smithi133 ceph-mon[125939]: pgmap v15881: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 692 KiB/s wr, 12 op/s 2023-05-08T11:58:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:55 smithi096 ceph-mon[124666]: pgmap v15881: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 692 KiB/s wr, 12 op/s 2023-05-08T11:58:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:55 smithi186 ceph-mon[126480]: pgmap v15881: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 692 KiB/s wr, 12 op/s 2023-05-08T11:58:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:58:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:58:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:58:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:57 smithi133 ceph-mon[125939]: pgmap v15882: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 897 KiB/s rd, 664 KiB/s wr, 9 op/s 2023-05-08T11:58:58.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:57 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:58:58.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:58:58.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:58:58.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:57 smithi096 ceph-mon[124666]: pgmap v15882: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 897 KiB/s rd, 664 KiB/s wr, 9 op/s 2023-05-08T11:58:58.259 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:57 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:58:58.259 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:58:58.259 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:58:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:57 smithi186 ceph-mon[126480]: pgmap v15882: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 897 KiB/s rd, 664 KiB/s wr, 9 op/s 2023-05-08T11:58:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:57 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:58:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:58:58.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:58:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29678.246263 secs 2023-05-08T11:58:59.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29678.246263 secs 2023-05-08T11:58:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29678.246263 secs 2023-05-08T11:59:00.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:58:59 smithi133 ceph-mon[125939]: pgmap v15883: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 897 KiB/s rd, 664 KiB/s wr, 9 op/s 2023-05-08T11:59:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:58:59 smithi096 ceph-mon[124666]: pgmap v15883: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 897 KiB/s rd, 664 KiB/s wr, 9 op/s 2023-05-08T11:59:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:58:59 smithi186 ceph-mon[126480]: pgmap v15883: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 897 KiB/s rd, 664 KiB/s wr, 9 op/s 2023-05-08T11:59:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29678.802096 secs 2023-05-08T11:59:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29678.802096 secs 2023-05-08T11:59:01.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29678.802096 secs 2023-05-08T11:59:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:01 smithi133 ceph-mon[125939]: pgmap v15884: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 15 op/s 2023-05-08T11:59:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:59:02.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:59:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:01 smithi096 ceph-mon[124666]: pgmap v15884: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 15 op/s 2023-05-08T11:59:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:59:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:59:02.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:01 smithi186 ceph-mon[126480]: pgmap v15884: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 15 op/s 2023-05-08T11:59:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:59:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:59:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:03 smithi133 ceph-mon[125939]: pgmap v15885: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 733 KiB/s rd, 752 KiB/s wr, 11 op/s 2023-05-08T11:59:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29683.246379 secs 2023-05-08T11:59:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:03 smithi096 ceph-mon[124666]: pgmap v15885: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 733 KiB/s rd, 752 KiB/s wr, 11 op/s 2023-05-08T11:59:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29683.246379 secs 2023-05-08T11:59:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:03 smithi186 ceph-mon[126480]: pgmap v15885: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 733 KiB/s rd, 752 KiB/s wr, 11 op/s 2023-05-08T11:59:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29683.246379 secs 2023-05-08T11:59:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:04 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:59:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:04 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:59:05.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:04 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:59:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:05 smithi133 ceph-mon[125939]: pgmap v15886: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1015 KiB/s wr, 18 op/s 2023-05-08T11:59:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:05 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:59:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:59:06.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:59:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:05 smithi096 ceph-mon[124666]: pgmap v15886: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1015 KiB/s wr, 18 op/s 2023-05-08T11:59:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:05 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:59:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:59:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:59:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:05 smithi186 ceph-mon[126480]: pgmap v15886: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1015 KiB/s wr, 18 op/s 2023-05-08T11:59:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:05 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:59:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:59:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:59:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:07 smithi133 ceph-mon[125939]: pgmap v15887: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 709 KiB/s rd, 707 KiB/s wr, 14 op/s 2023-05-08T11:59:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:07 smithi096 ceph-mon[124666]: pgmap v15887: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 709 KiB/s rd, 707 KiB/s wr, 14 op/s 2023-05-08T11:59:08.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:07 smithi186 ceph-mon[126480]: pgmap v15887: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 709 KiB/s rd, 707 KiB/s wr, 14 op/s 2023-05-08T11:59:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:08 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29688.246474 secs 2023-05-08T11:59:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:08 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29688.246474 secs 2023-05-08T11:59:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:08 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29688.246474 secs 2023-05-08T11:59:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:09 smithi096 ceph-mon[124666]: pgmap v15888: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 695 KiB/s rd, 699 KiB/s wr, 14 op/s 2023-05-08T11:59:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:09 smithi186 ceph-mon[126480]: pgmap v15888: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 695 KiB/s rd, 699 KiB/s wr, 14 op/s 2023-05-08T11:59:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:09 smithi133 ceph-mon[125939]: pgmap v15888: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 695 KiB/s rd, 699 KiB/s wr, 14 op/s 2023-05-08T11:59:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29688.802351 secs 2023-05-08T11:59:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29688.802351 secs 2023-05-08T11:59:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29688.802351 secs 2023-05-08T11:59:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:12 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29690.091917 secs 2023-05-08T11:59:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:12 smithi186 ceph-mon[126480]: pgmap v15889: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 781 KiB/s rd, 1.0 MiB/s wr, 32 op/s 2023-05-08T11:59:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:12 smithi186 ceph-mon[126480]: osdmap e1070: 12 total, 12 up, 12 in 2023-05-08T11:59:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:12 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29690.091917 secs 2023-05-08T11:59:12.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:12 smithi133 ceph-mon[125939]: pgmap v15889: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 781 KiB/s rd, 1.0 MiB/s wr, 32 op/s 2023-05-08T11:59:12.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:12 smithi133 ceph-mon[125939]: osdmap e1070: 12 total, 12 up, 12 in 2023-05-08T11:59:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:12 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29690.091917 secs 2023-05-08T11:59:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:12 smithi096 ceph-mon[124666]: pgmap v15889: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 781 KiB/s rd, 1.0 MiB/s wr, 32 op/s 2023-05-08T11:59:12.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:12 smithi096 ceph-mon[124666]: osdmap e1070: 12 total, 12 up, 12 in 2023-05-08T11:59:13.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:13 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:59:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:59:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:59:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:13 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:59:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:13 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:59:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:59:13.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:59:13.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:13 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:59:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:13 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:59:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:59:13.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:59:13.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:13 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:59:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:14 smithi186 ceph-mon[126480]: pgmap v15891: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 592 KiB/s rd, 746 KiB/s wr, 31 op/s 2023-05-08T11:59:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29693.246611 secs 2023-05-08T11:59:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:14 smithi133 ceph-mon[125939]: pgmap v15891: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 592 KiB/s rd, 746 KiB/s wr, 31 op/s 2023-05-08T11:59:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29693.246611 secs 2023-05-08T11:59:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:14 smithi096 ceph-mon[124666]: pgmap v15891: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 592 KiB/s rd, 746 KiB/s wr, 31 op/s 2023-05-08T11:59:14.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29693.246611 secs 2023-05-08T11:59:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29693.802476 secs 2023-05-08T11:59:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29693.802476 secs 2023-05-08T11:59:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29693.802476 secs 2023-05-08T11:59:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:16 smithi186 ceph-mon[126480]: pgmap v15892: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 585 KiB/s rd, 583 KiB/s wr, 27 op/s 2023-05-08T11:59:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:16 smithi133 ceph-mon[125939]: pgmap v15892: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 585 KiB/s rd, 583 KiB/s wr, 27 op/s 2023-05-08T11:59:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:16 smithi096 ceph-mon[124666]: pgmap v15892: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 585 KiB/s rd, 583 KiB/s wr, 27 op/s 2023-05-08T11:59:17.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:17 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29695.092019 secs 2023-05-08T11:59:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:17 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29695.092019 secs 2023-05-08T11:59:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:17 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29695.092019 secs 2023-05-08T11:59:18.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:18 smithi186 ceph-mon[126480]: pgmap v15893: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 561 KiB/s rd, 583 KiB/s wr, 27 op/s 2023-05-08T11:59:18.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:18 smithi133 ceph-mon[125939]: pgmap v15893: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 561 KiB/s rd, 583 KiB/s wr, 27 op/s 2023-05-08T11:59:18.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:18 smithi096 ceph-mon[124666]: pgmap v15893: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 561 KiB/s rd, 583 KiB/s wr, 27 op/s 2023-05-08T11:59:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29698.246719 secs 2023-05-08T11:59:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29698.246719 secs 2023-05-08T11:59:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29698.246719 secs 2023-05-08T11:59:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:20 smithi186 ceph-mon[126480]: pgmap v15894: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 561 KiB/s rd, 583 KiB/s wr, 27 op/s 2023-05-08T11:59:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29698.802585 secs 2023-05-08T11:59:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:20 smithi133 ceph-mon[125939]: pgmap v15894: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 561 KiB/s rd, 583 KiB/s wr, 27 op/s 2023-05-08T11:59:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29698.802585 secs 2023-05-08T11:59:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:20 smithi096 ceph-mon[124666]: pgmap v15894: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 561 KiB/s rd, 583 KiB/s wr, 27 op/s 2023-05-08T11:59:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29698.802585 secs 2023-05-08T11:59:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29700.092144 secs 2023-05-08T11:59:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:21 smithi186 ceph-mon[126480]: osdmap e1071: 12 total, 12 up, 12 in 2023-05-08T11:59:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:21 smithi186 ceph-mon[126480]: pgmap v15896: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 572 KiB/s rd, 265 KiB/s wr, 9 op/s 2023-05-08T11:59:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29700.092144 secs 2023-05-08T11:59:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:21 smithi133 ceph-mon[125939]: osdmap e1071: 12 total, 12 up, 12 in 2023-05-08T11:59:22.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:21 smithi133 ceph-mon[125939]: pgmap v15896: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 572 KiB/s rd, 265 KiB/s wr, 9 op/s 2023-05-08T11:59:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29700.092144 secs 2023-05-08T11:59:22.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:21 smithi096 ceph-mon[124666]: osdmap e1071: 12 total, 12 up, 12 in 2023-05-08T11:59:22.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:21 smithi096 ceph-mon[124666]: pgmap v15896: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 572 KiB/s rd, 265 KiB/s wr, 9 op/s 2023-05-08T11:59:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:23 smithi133 ceph-mon[125939]: pgmap v15897: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 567 KiB/s rd, 262 KiB/s wr, 9 op/s 2023-05-08T11:59:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29703.246843 secs 2023-05-08T11:59:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:23 smithi096 ceph-mon[124666]: pgmap v15897: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 567 KiB/s rd, 262 KiB/s wr, 9 op/s 2023-05-08T11:59:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29703.246843 secs 2023-05-08T11:59:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:23 smithi186 ceph-mon[126480]: pgmap v15897: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 567 KiB/s rd, 262 KiB/s wr, 9 op/s 2023-05-08T11:59:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29703.246843 secs 2023-05-08T11:59:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29703.802691 secs 2023-05-08T11:59:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:25 smithi133 ceph-mon[125939]: pgmap v15898: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 108 KiB/s wr, 7 op/s 2023-05-08T11:59:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29703.802691 secs 2023-05-08T11:59:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:25 smithi096 ceph-mon[124666]: pgmap v15898: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 108 KiB/s wr, 7 op/s 2023-05-08T11:59:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29703.802691 secs 2023-05-08T11:59:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:25 smithi186 ceph-mon[126480]: pgmap v15898: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 108 KiB/s wr, 7 op/s 2023-05-08T11:59:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29705.092270 secs 2023-05-08T11:59:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29705.092270 secs 2023-05-08T11:59:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29705.092270 secs 2023-05-08T11:59:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:27 smithi133 ceph-mon[125939]: pgmap v15899: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 108 KiB/s wr, 7 op/s 2023-05-08T11:59:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:27 smithi096 ceph-mon[124666]: pgmap v15899: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 108 KiB/s wr, 7 op/s 2023-05-08T11:59:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:27 smithi186 ceph-mon[126480]: pgmap v15899: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 108 KiB/s wr, 7 op/s 2023-05-08T11:59:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29708.246952 secs 2023-05-08T11:59:29.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29708.246952 secs 2023-05-08T11:59:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29708.246952 secs 2023-05-08T11:59:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:29 smithi133 ceph-mon[125939]: pgmap v15900: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 108 KiB/s wr, 7 op/s 2023-05-08T11:59:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:29 smithi096 ceph-mon[124666]: pgmap v15900: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 108 KiB/s wr, 7 op/s 2023-05-08T11:59:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:29 smithi186 ceph-mon[126480]: pgmap v15900: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 108 KiB/s wr, 7 op/s 2023-05-08T11:59:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29708.802832 secs 2023-05-08T11:59:31.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29708.802832 secs 2023-05-08T11:59:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29708.802832 secs 2023-05-08T11:59:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29710.092389 secs 2023-05-08T11:59:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:31 smithi133 ceph-mon[125939]: pgmap v15901: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2023-05-08T11:59:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29710.092389 secs 2023-05-08T11:59:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:31 smithi096 ceph-mon[124666]: pgmap v15901: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2023-05-08T11:59:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29710.092389 secs 2023-05-08T11:59:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:31 smithi186 ceph-mon[126480]: pgmap v15901: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2023-05-08T11:59:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:33 smithi133 ceph-mon[125939]: pgmap v15902: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T11:59:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29713.247077 secs 2023-05-08T11:59:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:33 smithi096 ceph-mon[124666]: pgmap v15902: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T11:59:34.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29713.247077 secs 2023-05-08T11:59:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:33 smithi186 ceph-mon[126480]: pgmap v15902: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T11:59:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29713.247077 secs 2023-05-08T11:59:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29713.802949 secs 2023-05-08T11:59:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:35 smithi096 ceph-mon[124666]: pgmap v15903: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T11:59:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29713.802949 secs 2023-05-08T11:59:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:35 smithi186 ceph-mon[126480]: pgmap v15903: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T11:59:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29713.802949 secs 2023-05-08T11:59:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:35 smithi133 ceph-mon[125939]: pgmap v15903: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T11:59:37.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29715.092455 secs 2023-05-08T11:59:37.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29715.092455 secs 2023-05-08T11:59:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29715.092455 secs 2023-05-08T11:59:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:37 smithi096 ceph-mon[124666]: pgmap v15904: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T11:59:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:37 smithi186 ceph-mon[126480]: pgmap v15904: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T11:59:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:37 smithi133 ceph-mon[125939]: pgmap v15904: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T11:59:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29718.247219 secs 2023-05-08T11:59:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29718.247219 secs 2023-05-08T11:59:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29718.247219 secs 2023-05-08T11:59:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:40 smithi096 ceph-mon[124666]: pgmap v15905: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T11:59:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:40 smithi186 ceph-mon[126480]: pgmap v15905: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T11:59:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:40 smithi133 ceph-mon[125939]: pgmap v15905: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T11:59:41.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29718.803014 secs 2023-05-08T11:59:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29718.803014 secs 2023-05-08T11:59:41.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29718.803014 secs 2023-05-08T11:59:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:42 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29720.092576 secs 2023-05-08T11:59:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:42 smithi186 ceph-mon[126480]: pgmap v15906: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 229 KiB/s wr, 10 op/s 2023-05-08T11:59:42.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:42 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29720.092576 secs 2023-05-08T11:59:42.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:42 smithi133 ceph-mon[125939]: pgmap v15906: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 229 KiB/s wr, 10 op/s 2023-05-08T11:59:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:42 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29720.092576 secs 2023-05-08T11:59:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:42 smithi096 ceph-mon[124666]: pgmap v15906: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 229 KiB/s wr, 10 op/s 2023-05-08T11:59:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:44 smithi186 ceph-mon[126480]: pgmap v15907: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 229 KiB/s wr, 7 op/s 2023-05-08T11:59:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29723.247357 secs 2023-05-08T11:59:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:44 smithi133 ceph-mon[125939]: pgmap v15907: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 229 KiB/s wr, 7 op/s 2023-05-08T11:59:44.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29723.247357 secs 2023-05-08T11:59:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:44 smithi096 ceph-mon[124666]: pgmap v15907: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 229 KiB/s wr, 7 op/s 2023-05-08T11:59:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29723.247357 secs 2023-05-08T11:59:45.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29723.803124 secs 2023-05-08T11:59:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29723.803124 secs 2023-05-08T11:59:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29723.803124 secs 2023-05-08T11:59:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:46 smithi186 ceph-mon[126480]: pgmap v15908: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 265 KiB/s wr, 10 op/s 2023-05-08T11:59:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:46 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:59:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:46 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:59:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:46 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:59:46.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:46 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:59:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:46 smithi133 ceph-mon[125939]: pgmap v15908: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 265 KiB/s wr, 10 op/s 2023-05-08T11:59:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:46 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:59:46.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:46 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:59:46.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:46 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:59:46.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:46 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:59:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:46 smithi096 ceph-mon[124666]: pgmap v15908: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 265 KiB/s wr, 10 op/s 2023-05-08T11:59:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:46 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T11:59:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:46 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T11:59:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:46 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T11:59:46.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:46 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T11:59:47.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:47 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:59:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:47 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T11:59:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:47 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T11:59:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:47 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T11:59:47.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:47 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:59:47.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:47 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T11:59:47.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:47 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T11:59:47.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:47 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T11:59:47.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:47 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:59:47.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:47 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T11:59:47.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:47 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T11:59:47.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:47 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T11:59:48.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:48 smithi186 ceph-mon[126480]: pgmap v15909: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 264 KiB/s wr, 7 op/s 2023-05-08T11:59:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:48 smithi133 ceph-mon[125939]: pgmap v15909: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 264 KiB/s wr, 7 op/s 2023-05-08T11:59:48.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:48 smithi096 ceph-mon[124666]: pgmap v15909: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 264 KiB/s wr, 7 op/s 2023-05-08T11:59:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:59:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29728.247489 secs 2023-05-08T11:59:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:59:49.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29728.247489 secs 2023-05-08T11:59:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:59:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29728.247489 secs 2023-05-08T11:59:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:50 smithi186 ceph-mon[126480]: pgmap v15910: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 264 KiB/s wr, 7 op/s 2023-05-08T11:59:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:59:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:59:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:59:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29728.803222 secs 2023-05-08T11:59:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:50 smithi133 ceph-mon[125939]: pgmap v15910: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 264 KiB/s wr, 7 op/s 2023-05-08T11:59:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:59:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:59:50.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:59:50.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29728.803222 secs 2023-05-08T11:59:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:50 smithi096 ceph-mon[124666]: pgmap v15910: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 264 KiB/s wr, 7 op/s 2023-05-08T11:59:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:59:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T11:59:50.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:59:50.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29728.803222 secs 2023-05-08T11:59:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:51 smithi186 ceph-mon[126480]: pgmap v15911: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 449 KiB/s rd, 624 KiB/s wr, 11 op/s 2023-05-08T11:59:52.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:51 smithi133 ceph-mon[125939]: pgmap v15911: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 449 KiB/s rd, 624 KiB/s wr, 11 op/s 2023-05-08T11:59:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:51 smithi096 ceph-mon[124666]: pgmap v15911: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 449 KiB/s rd, 624 KiB/s wr, 11 op/s 2023-05-08T11:59:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:53 smithi133 ceph-mon[125939]: pgmap v15912: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 395 KiB/s wr, 7 op/s 2023-05-08T11:59:54.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29733.247647 secs 2023-05-08T11:59:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:53 smithi096 ceph-mon[124666]: pgmap v15912: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 395 KiB/s wr, 7 op/s 2023-05-08T11:59:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29733.247647 secs 2023-05-08T11:59:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:53 smithi186 ceph-mon[126480]: pgmap v15912: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 395 KiB/s wr, 7 op/s 2023-05-08T11:59:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29733.247647 secs 2023-05-08T11:59:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:55 smithi133 ceph-mon[125939]: pgmap v15913: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 694 KiB/s wr, 11 op/s 2023-05-08T11:59:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:55 smithi096 ceph-mon[124666]: pgmap v15913: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 694 KiB/s wr, 11 op/s 2023-05-08T11:59:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:55 smithi186 ceph-mon[126480]: pgmap v15913: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 694 KiB/s wr, 11 op/s 2023-05-08T11:59:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:59:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:59:57.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T11:59:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:57 smithi133 ceph-mon[125939]: pgmap v15914: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 768 KiB/s rd, 659 KiB/s wr, 8 op/s 2023-05-08T11:59:58.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:57 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:59:58.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:59:58.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:59:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:57 smithi096 ceph-mon[124666]: pgmap v15914: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 768 KiB/s rd, 659 KiB/s wr, 8 op/s 2023-05-08T11:59:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:57 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:59:58.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:59:58.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:59:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:57 smithi186 ceph-mon[126480]: pgmap v15914: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 768 KiB/s rd, 659 KiB/s wr, 8 op/s 2023-05-08T11:59:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:57 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T11:59:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T11:59:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T11:59:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29738.247776 secs 2023-05-08T11:59:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29738.247776 secs 2023-05-08T11:59:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29738.247776 secs 2023-05-08T12:00:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 11:59:59 smithi133 ceph-mon[125939]: pgmap v15915: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 768 KiB/s rd, 659 KiB/s wr, 8 op/s 2023-05-08T12:00:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 11:59:59 smithi096 ceph-mon[124666]: pgmap v15915: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 768 KiB/s rd, 659 KiB/s wr, 8 op/s 2023-05-08T12:00:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 11:59:59 smithi186 ceph-mon[126480]: pgmap v15915: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 768 KiB/s rd, 659 KiB/s wr, 8 op/s 2023-05-08T12:00:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29738.803425 secs 2023-05-08T12:00:01.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:00 smithi096 ceph-mon[124666]: Health detail: HEALTH_WARN 1 MDSs report slow requests 2023-05-08T12:00:01.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:00 smithi096 ceph-mon[124666]: [WRN] MDS_SLOW_REQUEST: 1 MDSs report slow requests 2023-05-08T12:00:01.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:00 smithi096 ceph-mon[124666]: mds.i(mds.1): 1 slow requests are blocked > 180 secs 2023-05-08T12:00:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29738.803425 secs 2023-05-08T12:00:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:00 smithi186 ceph-mon[126480]: Health detail: HEALTH_WARN 1 MDSs report slow requests 2023-05-08T12:00:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:00 smithi186 ceph-mon[126480]: [WRN] MDS_SLOW_REQUEST: 1 MDSs report slow requests 2023-05-08T12:00:01.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:00 smithi186 ceph-mon[126480]: mds.i(mds.1): 1 slow requests are blocked > 180 secs 2023-05-08T12:00:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29738.803425 secs 2023-05-08T12:00:01.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:00 smithi133 ceph-mon[125939]: Health detail: HEALTH_WARN 1 MDSs report slow requests 2023-05-08T12:00:01.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:00 smithi133 ceph-mon[125939]: [WRN] MDS_SLOW_REQUEST: 1 MDSs report slow requests 2023-05-08T12:00:01.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:00 smithi133 ceph-mon[125939]: mds.i(mds.1): 1 slow requests are blocked > 180 secs 2023-05-08T12:00:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29740.093064 secs 2023-05-08T12:00:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:01 smithi096 ceph-mon[124666]: pgmap v15916: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T12:00:02.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:00:02.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:00:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29740.093064 secs 2023-05-08T12:00:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:01 smithi186 ceph-mon[126480]: pgmap v15916: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T12:00:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:00:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:00:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29740.093064 secs 2023-05-08T12:00:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:01 smithi133 ceph-mon[125939]: pgmap v15916: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T12:00:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:00:02.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:00:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:03 smithi096 ceph-mon[124666]: pgmap v15917: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 929 KiB/s rd, 732 KiB/s wr, 11 op/s 2023-05-08T12:00:04.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29743.247874 secs 2023-05-08T12:00:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:03 smithi186 ceph-mon[126480]: pgmap v15917: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 929 KiB/s rd, 732 KiB/s wr, 11 op/s 2023-05-08T12:00:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29743.247874 secs 2023-05-08T12:00:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:03 smithi133 ceph-mon[125939]: pgmap v15917: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 929 KiB/s rd, 732 KiB/s wr, 11 op/s 2023-05-08T12:00:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29743.247874 secs 2023-05-08T12:00:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:05 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:00:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:05 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:00:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:05 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:00:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:06 smithi096 ceph-mon[124666]: pgmap v15918: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 996 KiB/s wr, 17 op/s 2023-05-08T12:00:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:00:06.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:00:06.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:00:06.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:06 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:00:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:06 smithi186 ceph-mon[126480]: pgmap v15918: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 996 KiB/s wr, 17 op/s 2023-05-08T12:00:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:00:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:00:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:00:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:06 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:00:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:06 smithi133 ceph-mon[125939]: pgmap v15918: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 996 KiB/s wr, 17 op/s 2023-05-08T12:00:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:00:06.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:00:06.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:00:06.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:06 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:00:07.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:07 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29745.093204 secs 2023-05-08T12:00:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:07 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29745.093204 secs 2023-05-08T12:00:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:07 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29745.093204 secs 2023-05-08T12:00:08.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:08 smithi186 ceph-mon[126480]: pgmap v15919: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 733 KiB/s rd, 698 KiB/s wr, 14 op/s 2023-05-08T12:00:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:08 smithi133 ceph-mon[125939]: pgmap v15919: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 733 KiB/s rd, 698 KiB/s wr, 14 op/s 2023-05-08T12:00:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:08 smithi096 ceph-mon[124666]: pgmap v15919: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 733 KiB/s rd, 698 KiB/s wr, 14 op/s 2023-05-08T12:00:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29748.248000 secs 2023-05-08T12:00:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29748.248000 secs 2023-05-08T12:00:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29748.248000 secs 2023-05-08T12:00:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:10 smithi186 ceph-mon[126480]: pgmap v15920: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 714 KiB/s rd, 697 KiB/s wr, 13 op/s 2023-05-08T12:00:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29748.803641 secs 2023-05-08T12:00:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:10 smithi133 ceph-mon[125939]: pgmap v15920: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 714 KiB/s rd, 697 KiB/s wr, 13 op/s 2023-05-08T12:00:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29748.803641 secs 2023-05-08T12:00:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:10 smithi096 ceph-mon[124666]: pgmap v15920: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 714 KiB/s rd, 697 KiB/s wr, 13 op/s 2023-05-08T12:00:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29748.803641 secs 2023-05-08T12:00:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:12 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29750.093328 secs 2023-05-08T12:00:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:12 smithi186 ceph-mon[126480]: pgmap v15921: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 31 op/s 2023-05-08T12:00:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:12 smithi186 ceph-mon[126480]: osdmap e1072: 12 total, 12 up, 12 in 2023-05-08T12:00:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:12 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29750.093328 secs 2023-05-08T12:00:12.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:12 smithi133 ceph-mon[125939]: pgmap v15921: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 31 op/s 2023-05-08T12:00:12.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:12 smithi133 ceph-mon[125939]: osdmap e1072: 12 total, 12 up, 12 in 2023-05-08T12:00:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:12 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29750.093328 secs 2023-05-08T12:00:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:12 smithi096 ceph-mon[124666]: pgmap v15921: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 31 op/s 2023-05-08T12:00:12.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:12 smithi096 ceph-mon[124666]: osdmap e1072: 12 total, 12 up, 12 in 2023-05-08T12:00:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:13 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:00:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:00:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:13 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:00:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:13 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:00:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:00:13.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:13 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:00:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:13 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:00:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:00:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:13 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:00:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:14 smithi186 ceph-mon[126480]: pgmap v15923: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 893 KiB/s rd, 748 KiB/s wr, 30 op/s 2023-05-08T12:00:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29753.248119 secs 2023-05-08T12:00:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:14 smithi133 ceph-mon[125939]: pgmap v15923: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 893 KiB/s rd, 748 KiB/s wr, 30 op/s 2023-05-08T12:00:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29753.248119 secs 2023-05-08T12:00:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:14 smithi096 ceph-mon[124666]: pgmap v15923: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 893 KiB/s rd, 748 KiB/s wr, 30 op/s 2023-05-08T12:00:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29753.248119 secs 2023-05-08T12:00:15.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29753.803713 secs 2023-05-08T12:00:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29753.803713 secs 2023-05-08T12:00:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29753.803713 secs 2023-05-08T12:00:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:16 smithi186 ceph-mon[126480]: pgmap v15924: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 585 KiB/s rd, 585 KiB/s wr, 27 op/s 2023-05-08T12:00:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:16 smithi133 ceph-mon[125939]: pgmap v15924: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 585 KiB/s rd, 585 KiB/s wr, 27 op/s 2023-05-08T12:00:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:16 smithi096 ceph-mon[124666]: pgmap v15924: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 585 KiB/s rd, 585 KiB/s wr, 27 op/s 2023-05-08T12:00:17.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:17 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29755.093451 secs 2023-05-08T12:00:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:17 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29755.093451 secs 2023-05-08T12:00:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:17 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29755.093451 secs 2023-05-08T12:00:18.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:18 smithi186 ceph-mon[126480]: pgmap v15925: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 585 KiB/s wr, 26 op/s 2023-05-08T12:00:18.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:18 smithi133 ceph-mon[125939]: pgmap v15925: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 585 KiB/s wr, 26 op/s 2023-05-08T12:00:18.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:18 smithi096 ceph-mon[124666]: pgmap v15925: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 585 KiB/s wr, 26 op/s 2023-05-08T12:00:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29758.248239 secs 2023-05-08T12:00:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29758.248239 secs 2023-05-08T12:00:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29758.248239 secs 2023-05-08T12:00:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:20 smithi186 ceph-mon[126480]: pgmap v15926: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 585 KiB/s wr, 26 op/s 2023-05-08T12:00:20.451 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29758.803834 secs 2023-05-08T12:00:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:20 smithi133 ceph-mon[125939]: pgmap v15926: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 585 KiB/s wr, 26 op/s 2023-05-08T12:00:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29758.803834 secs 2023-05-08T12:00:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:20 smithi096 ceph-mon[124666]: pgmap v15926: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 585 KiB/s wr, 26 op/s 2023-05-08T12:00:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29758.803834 secs 2023-05-08T12:00:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29760.093582 secs 2023-05-08T12:00:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:21 smithi186 ceph-mon[126480]: osdmap e1073: 12 total, 12 up, 12 in 2023-05-08T12:00:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:21 smithi186 ceph-mon[126480]: pgmap v15928: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 265 KiB/s wr, 9 op/s 2023-05-08T12:00:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29760.093582 secs 2023-05-08T12:00:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:21 smithi133 ceph-mon[125939]: osdmap e1073: 12 total, 12 up, 12 in 2023-05-08T12:00:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:21 smithi133 ceph-mon[125939]: pgmap v15928: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 265 KiB/s wr, 9 op/s 2023-05-08T12:00:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29760.093582 secs 2023-05-08T12:00:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:21 smithi096 ceph-mon[124666]: osdmap e1073: 12 total, 12 up, 12 in 2023-05-08T12:00:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:21 smithi096 ceph-mon[124666]: pgmap v15928: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 265 KiB/s wr, 9 op/s 2023-05-08T12:00:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:23 smithi133 ceph-mon[125939]: pgmap v15929: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 265 KiB/s rd, 263 KiB/s wr, 9 op/s 2023-05-08T12:00:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29763.248366 secs 2023-05-08T12:00:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:23 smithi096 ceph-mon[124666]: pgmap v15929: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 265 KiB/s rd, 263 KiB/s wr, 9 op/s 2023-05-08T12:00:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29763.248366 secs 2023-05-08T12:00:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:23 smithi186 ceph-mon[126480]: pgmap v15929: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 265 KiB/s rd, 263 KiB/s wr, 9 op/s 2023-05-08T12:00:24.373 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29763.248366 secs 2023-05-08T12:00:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29763.803957 secs 2023-05-08T12:00:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:25 smithi133 ceph-mon[125939]: pgmap v15930: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 108 KiB/s wr, 7 op/s 2023-05-08T12:00:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29763.803957 secs 2023-05-08T12:00:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:25 smithi096 ceph-mon[124666]: pgmap v15930: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 108 KiB/s wr, 7 op/s 2023-05-08T12:00:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29763.803957 secs 2023-05-08T12:00:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:25 smithi186 ceph-mon[126480]: pgmap v15930: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 108 KiB/s wr, 7 op/s 2023-05-08T12:00:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29765.093720 secs 2023-05-08T12:00:27.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29765.093720 secs 2023-05-08T12:00:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29765.093720 secs 2023-05-08T12:00:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:27 smithi096 ceph-mon[124666]: pgmap v15931: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 108 KiB/s wr, 7 op/s 2023-05-08T12:00:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:27 smithi186 ceph-mon[126480]: pgmap v15931: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 108 KiB/s wr, 7 op/s 2023-05-08T12:00:28.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:27 smithi133 ceph-mon[125939]: pgmap v15931: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 108 KiB/s wr, 7 op/s 2023-05-08T12:00:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:28 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29768.248486 secs 2023-05-08T12:00:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:28 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29768.248486 secs 2023-05-08T12:00:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:28 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29768.248486 secs 2023-05-08T12:00:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:29 smithi096 ceph-mon[124666]: pgmap v15932: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 108 KiB/s wr, 7 op/s 2023-05-08T12:00:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:30 smithi186 ceph-mon[126480]: pgmap v15932: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 108 KiB/s wr, 7 op/s 2023-05-08T12:00:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:30 smithi133 ceph-mon[125939]: pgmap v15932: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 108 KiB/s wr, 7 op/s 2023-05-08T12:00:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29768.804072 secs 2023-05-08T12:00:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29768.804072 secs 2023-05-08T12:00:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29768.804072 secs 2023-05-08T12:00:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:32 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29770.093859 secs 2023-05-08T12:00:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:32 smithi186 ceph-mon[126480]: pgmap v15933: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2023-05-08T12:00:32.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:32 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29770.093859 secs 2023-05-08T12:00:32.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:32 smithi133 ceph-mon[125939]: pgmap v15933: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2023-05-08T12:00:32.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:32 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29770.093859 secs 2023-05-08T12:00:32.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:32 smithi096 ceph-mon[124666]: pgmap v15933: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2023-05-08T12:00:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:34 smithi186 ceph-mon[126480]: pgmap v15934: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T12:00:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29773.248606 secs 2023-05-08T12:00:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:34 smithi133 ceph-mon[125939]: pgmap v15934: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T12:00:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29773.248606 secs 2023-05-08T12:00:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:34 smithi096 ceph-mon[124666]: pgmap v15934: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T12:00:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29773.248606 secs 2023-05-08T12:00:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29773.804138 secs 2023-05-08T12:00:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29773.804138 secs 2023-05-08T12:00:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29773.804138 secs 2023-05-08T12:00:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:36 smithi186 ceph-mon[126480]: pgmap v15935: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T12:00:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:36 smithi133 ceph-mon[125939]: pgmap v15935: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T12:00:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:36 smithi096 ceph-mon[124666]: pgmap v15935: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T12:00:37.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:37 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29775.093939 secs 2023-05-08T12:00:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:37 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29775.093939 secs 2023-05-08T12:00:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:37 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29775.093939 secs 2023-05-08T12:00:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:38 smithi186 ceph-mon[126480]: pgmap v15936: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T12:00:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:38 smithi133 ceph-mon[125939]: pgmap v15936: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T12:00:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:38 smithi096 ceph-mon[124666]: pgmap v15936: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T12:00:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29778.248706 secs 2023-05-08T12:00:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29778.248706 secs 2023-05-08T12:00:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29778.248706 secs 2023-05-08T12:00:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:40 smithi186 ceph-mon[126480]: pgmap v15937: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T12:00:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29778.804254 secs 2023-05-08T12:00:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:40 smithi133 ceph-mon[125939]: pgmap v15937: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T12:00:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29778.804254 secs 2023-05-08T12:00:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:40 smithi096 ceph-mon[124666]: pgmap v15937: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T12:00:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29778.804254 secs 2023-05-08T12:00:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29780.094004 secs 2023-05-08T12:00:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:41 smithi186 ceph-mon[126480]: pgmap v15938: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 339 KiB/s wr, 10 op/s 2023-05-08T12:00:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29780.094004 secs 2023-05-08T12:00:42.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:41 smithi133 ceph-mon[125939]: pgmap v15938: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 339 KiB/s wr, 10 op/s 2023-05-08T12:00:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29780.094004 secs 2023-05-08T12:00:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:41 smithi096 ceph-mon[124666]: pgmap v15938: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 339 KiB/s wr, 10 op/s 2023-05-08T12:00:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:43 smithi133 ceph-mon[125939]: pgmap v15939: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 339 KiB/s wr, 7 op/s 2023-05-08T12:00:44.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29783.248830 secs 2023-05-08T12:00:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:43 smithi096 ceph-mon[124666]: pgmap v15939: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 339 KiB/s wr, 7 op/s 2023-05-08T12:00:44.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29783.248830 secs 2023-05-08T12:00:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:43 smithi186 ceph-mon[126480]: pgmap v15939: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 339 KiB/s wr, 7 op/s 2023-05-08T12:00:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29783.248830 secs 2023-05-08T12:00:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29783.804372 secs 2023-05-08T12:00:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:45 smithi133 ceph-mon[125939]: pgmap v15940: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 340 KiB/s wr, 10 op/s 2023-05-08T12:00:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29783.804372 secs 2023-05-08T12:00:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:45 smithi096 ceph-mon[124666]: pgmap v15940: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 340 KiB/s wr, 10 op/s 2023-05-08T12:00:46.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29783.804372 secs 2023-05-08T12:00:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:45 smithi186 ceph-mon[126480]: pgmap v15940: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 340 KiB/s wr, 10 op/s 2023-05-08T12:00:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:46 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:00:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:46 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:00:47.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:46 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:00:47.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:46 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:00:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:46 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:00:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:46 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:00:47.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:46 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:00:47.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:46 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:00:47.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:46 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:00:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:46 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:00:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:46 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:00:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:46 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:00:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:47 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:00:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:47 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T12:00:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:47 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T12:00:48.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:47 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:00:48.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:47 smithi096 ceph-mon[124666]: pgmap v15941: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 339 KiB/s wr, 8 op/s 2023-05-08T12:00:48.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:47 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:00:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:47 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T12:00:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:47 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T12:00:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:47 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:00:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:47 smithi186 ceph-mon[126480]: pgmap v15941: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 339 KiB/s wr, 8 op/s 2023-05-08T12:00:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:47 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:00:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:47 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T12:00:48.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:47 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T12:00:48.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:47 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:00:48.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:47 smithi133 ceph-mon[125939]: pgmap v15941: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 339 KiB/s wr, 8 op/s 2023-05-08T12:00:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:00:49.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:48 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29788.248963 secs 2023-05-08T12:00:49.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:00:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:48 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29788.248963 secs 2023-05-08T12:00:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:00:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:48 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29788.248963 secs 2023-05-08T12:00:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:49 smithi096 ceph-mon[124666]: pgmap v15942: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 339 KiB/s wr, 7 op/s 2023-05-08T12:00:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:00:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:00:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:00:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:49 smithi186 ceph-mon[126480]: pgmap v15942: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 339 KiB/s wr, 7 op/s 2023-05-08T12:00:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:00:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:00:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:00:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:49 smithi133 ceph-mon[125939]: pgmap v15942: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 339 KiB/s wr, 7 op/s 2023-05-08T12:00:50.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:00:50.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:00:50.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:00:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29788.804502 secs 2023-05-08T12:00:51.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29788.804502 secs 2023-05-08T12:00:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29788.804502 secs 2023-05-08T12:00:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:51 smithi096 ceph-mon[124666]: pgmap v15943: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 698 KiB/s rd, 618 KiB/s wr, 11 op/s 2023-05-08T12:00:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:51 smithi186 ceph-mon[126480]: pgmap v15943: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 698 KiB/s rd, 618 KiB/s wr, 11 op/s 2023-05-08T12:00:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:51 smithi133 ceph-mon[125939]: pgmap v15943: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 698 KiB/s rd, 618 KiB/s wr, 11 op/s 2023-05-08T12:00:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:53 smithi096 ceph-mon[124666]: pgmap v15944: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 279 KiB/s wr, 7 op/s 2023-05-08T12:00:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29793.249094 secs 2023-05-08T12:00:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:54 smithi186 ceph-mon[126480]: pgmap v15944: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 279 KiB/s wr, 7 op/s 2023-05-08T12:00:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29793.249094 secs 2023-05-08T12:00:54.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:53 smithi133 ceph-mon[125939]: pgmap v15944: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 279 KiB/s wr, 7 op/s 2023-05-08T12:00:54.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29793.249094 secs 2023-05-08T12:00:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:56 smithi096 ceph-mon[124666]: pgmap v15945: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 842 KiB/s rd, 585 KiB/s wr, 11 op/s 2023-05-08T12:00:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:56 smithi186 ceph-mon[126480]: pgmap v15945: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 842 KiB/s rd, 585 KiB/s wr, 11 op/s 2023-05-08T12:00:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:56 smithi133 ceph-mon[125939]: pgmap v15945: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 842 KiB/s rd, 585 KiB/s wr, 11 op/s 2023-05-08T12:00:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:00:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:00:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:00:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:58 smithi096 ceph-mon[124666]: pgmap v15946: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 745 KiB/s rd, 585 KiB/s wr, 8 op/s 2023-05-08T12:00:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:58 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:00:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:00:58.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:00:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:58 smithi186 ceph-mon[126480]: pgmap v15946: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 745 KiB/s rd, 585 KiB/s wr, 8 op/s 2023-05-08T12:00:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:58 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:00:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:00:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:00:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:58 smithi133 ceph-mon[125939]: pgmap v15946: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 745 KiB/s rd, 585 KiB/s wr, 8 op/s 2023-05-08T12:00:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:58 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:00:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:00:58.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:00:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:00:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29798.249213 secs 2023-05-08T12:00:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:00:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29798.249213 secs 2023-05-08T12:00:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:00:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29798.249213 secs 2023-05-08T12:01:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:00 smithi186 ceph-mon[126480]: pgmap v15947: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 745 KiB/s rd, 585 KiB/s wr, 7 op/s 2023-05-08T12:01:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:00 smithi133 ceph-mon[125939]: pgmap v15947: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 745 KiB/s rd, 585 KiB/s wr, 7 op/s 2023-05-08T12:01:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:00 smithi096 ceph-mon[124666]: pgmap v15947: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 745 KiB/s rd, 585 KiB/s wr, 7 op/s 2023-05-08T12:01:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:01 smithi186 ceph-mon[126480]: pgmap v15948: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 993 KiB/s wr, 13 op/s 2023-05-08T12:01:02.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:01 smithi133 ceph-mon[125939]: pgmap v15948: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 993 KiB/s wr, 13 op/s 2023-05-08T12:01:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:01 smithi096 ceph-mon[124666]: pgmap v15948: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 993 KiB/s wr, 13 op/s 2023-05-08T12:01:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:03 smithi096 ceph-mon[124666]: pgmap v15949: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 809 KiB/s rd, 714 KiB/s wr, 10 op/s 2023-05-08T12:01:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29803.249311 secs 2023-05-08T12:01:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:03 smithi186 ceph-mon[126480]: pgmap v15949: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 809 KiB/s rd, 714 KiB/s wr, 10 op/s 2023-05-08T12:01:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29803.249311 secs 2023-05-08T12:01:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:03 smithi133 ceph-mon[125939]: pgmap v15949: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 809 KiB/s rd, 714 KiB/s wr, 10 op/s 2023-05-08T12:01:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29803.249311 secs 2023-05-08T12:01:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29803.804758 secs 2023-05-08T12:01:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:05 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:01:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:01:05.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:01:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29803.804758 secs 2023-05-08T12:01:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:05 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:01:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:01:05.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:01:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29803.804758 secs 2023-05-08T12:01:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:05 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:01:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:01:05.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:01:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:06 smithi186 ceph-mon[126480]: pgmap v15950: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 26 op/s 2023-05-08T12:01:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:06 smithi133 ceph-mon[125939]: pgmap v15950: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 26 op/s 2023-05-08T12:01:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:06 smithi096 ceph-mon[124666]: pgmap v15950: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 26 op/s 2023-05-08T12:01:08.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:08 smithi186 ceph-mon[126480]: pgmap v15951: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 754 KiB/s rd, 737 KiB/s wr, 23 op/s 2023-05-08T12:01:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:08 smithi133 ceph-mon[125939]: pgmap v15951: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 754 KiB/s rd, 737 KiB/s wr, 23 op/s 2023-05-08T12:01:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:08 smithi096 ceph-mon[124666]: pgmap v15951: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 754 KiB/s rd, 737 KiB/s wr, 23 op/s 2023-05-08T12:01:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29808.249420 secs 2023-05-08T12:01:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29808.249420 secs 2023-05-08T12:01:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29808.249420 secs 2023-05-08T12:01:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:10 smithi186 ceph-mon[126480]: pgmap v15952: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 735 KiB/s rd, 737 KiB/s wr, 22 op/s 2023-05-08T12:01:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29808.804861 secs 2023-05-08T12:01:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:10 smithi133 ceph-mon[125939]: pgmap v15952: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 735 KiB/s rd, 737 KiB/s wr, 22 op/s 2023-05-08T12:01:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29808.804861 secs 2023-05-08T12:01:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:10 smithi096 ceph-mon[124666]: pgmap v15952: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 735 KiB/s rd, 737 KiB/s wr, 22 op/s 2023-05-08T12:01:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29808.804861 secs 2023-05-08T12:01:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:11 smithi186 ceph-mon[126480]: pgmap v15953: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 739 KiB/s rd, 740 KiB/s wr, 26 op/s 2023-05-08T12:01:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:11 smithi133 ceph-mon[125939]: pgmap v15953: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 739 KiB/s rd, 740 KiB/s wr, 26 op/s 2023-05-08T12:01:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:11 smithi096 ceph-mon[124666]: pgmap v15953: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 739 KiB/s rd, 740 KiB/s wr, 26 op/s 2023-05-08T12:01:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:13 smithi096 ceph-mon[124666]: pgmap v15954: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 319 KiB/s rd, 332 KiB/s wr, 21 op/s 2023-05-08T12:01:14.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29813.249546 secs 2023-05-08T12:01:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:13 smithi186 ceph-mon[126480]: pgmap v15954: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 319 KiB/s rd, 332 KiB/s wr, 21 op/s 2023-05-08T12:01:14.380 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29813.249546 secs 2023-05-08T12:01:14.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:13 smithi133 ceph-mon[125939]: pgmap v15954: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 319 KiB/s rd, 332 KiB/s wr, 21 op/s 2023-05-08T12:01:14.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29813.249546 secs 2023-05-08T12:01:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29813.804950 secs 2023-05-08T12:01:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:15 smithi096 ceph-mon[124666]: pgmap v15955: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 676 KiB/s rd, 687 KiB/s wr, 24 op/s 2023-05-08T12:01:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29813.804950 secs 2023-05-08T12:01:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:15 smithi186 ceph-mon[126480]: pgmap v15955: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 676 KiB/s rd, 687 KiB/s wr, 24 op/s 2023-05-08T12:01:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29813.804950 secs 2023-05-08T12:01:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:15 smithi133 ceph-mon[125939]: pgmap v15955: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 676 KiB/s rd, 687 KiB/s wr, 24 op/s 2023-05-08T12:01:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:17 smithi096 ceph-mon[124666]: pgmap v15956: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 361 KiB/s wr, 8 op/s 2023-05-08T12:01:18.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:17 smithi186 ceph-mon[126480]: pgmap v15956: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 361 KiB/s wr, 8 op/s 2023-05-08T12:01:18.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:17 smithi133 ceph-mon[125939]: pgmap v15956: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 361 KiB/s wr, 8 op/s 2023-05-08T12:01:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29818.249662 secs 2023-05-08T12:01:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29818.249662 secs 2023-05-08T12:01:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29818.249662 secs 2023-05-08T12:01:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:20 smithi186 ceph-mon[126480]: pgmap v15957: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 361 KiB/s wr, 8 op/s 2023-05-08T12:01:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:20 smithi133 ceph-mon[125939]: pgmap v15957: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 361 KiB/s wr, 8 op/s 2023-05-08T12:01:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:20 smithi096 ceph-mon[124666]: pgmap v15957: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 361 KiB/s wr, 8 op/s 2023-05-08T12:01:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:21 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:01:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:21 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:01:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:21 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:01:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:22 smithi186 ceph-mon[126480]: pgmap v15958: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 749 KiB/s rd, 767 KiB/s wr, 14 op/s 2023-05-08T12:01:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:22 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:01:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:22 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:01:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:22 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:01:22.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:22 smithi133 ceph-mon[125939]: pgmap v15958: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 749 KiB/s rd, 767 KiB/s wr, 14 op/s 2023-05-08T12:01:22.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:22 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:01:22.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:22 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:01:22.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:22 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:01:22.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:22 smithi096 ceph-mon[124666]: pgmap v15958: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 749 KiB/s rd, 767 KiB/s wr, 14 op/s 2023-05-08T12:01:22.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:22 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:01:22.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:22 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:01:22.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:22 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:01:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:24 smithi186 ceph-mon[126480]: pgmap v15959: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 745 KiB/s rd, 765 KiB/s wr, 10 op/s 2023-05-08T12:01:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29823.249758 secs 2023-05-08T12:01:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:24 smithi133 ceph-mon[125939]: pgmap v15959: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 745 KiB/s rd, 765 KiB/s wr, 10 op/s 2023-05-08T12:01:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29823.249758 secs 2023-05-08T12:01:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:24 smithi096 ceph-mon[124666]: pgmap v15959: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 745 KiB/s rd, 765 KiB/s wr, 10 op/s 2023-05-08T12:01:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29823.249758 secs 2023-05-08T12:01:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:26 smithi186 ceph-mon[126480]: pgmap v15960: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 749 KiB/s rd, 767 KiB/s wr, 13 op/s 2023-05-08T12:01:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:26 smithi133 ceph-mon[125939]: pgmap v15960: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 749 KiB/s rd, 767 KiB/s wr, 13 op/s 2023-05-08T12:01:26.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:26 smithi096 ceph-mon[124666]: pgmap v15960: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 749 KiB/s rd, 767 KiB/s wr, 13 op/s 2023-05-08T12:01:27.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:27 smithi186 ceph-mon[126480]: osdmap e1074: 12 total, 12 up, 12 in 2023-05-08T12:01:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:27 smithi133 ceph-mon[125939]: osdmap e1074: 12 total, 12 up, 12 in 2023-05-08T12:01:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:27 smithi096 ceph-mon[124666]: osdmap e1074: 12 total, 12 up, 12 in 2023-05-08T12:01:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:28 smithi186 ceph-mon[126480]: pgmap v15962: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 895 KiB/s wr, 13 op/s 2023-05-08T12:01:28.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:28 smithi133 ceph-mon[125939]: pgmap v15962: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 895 KiB/s wr, 13 op/s 2023-05-08T12:01:28.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:28 smithi096 ceph-mon[124666]: pgmap v15962: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 895 KiB/s wr, 13 op/s 2023-05-08T12:01:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29828.249880 secs 2023-05-08T12:01:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29828.249880 secs 2023-05-08T12:01:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29828.249880 secs 2023-05-08T12:01:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:30 smithi186 ceph-mon[126480]: pgmap v15963: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 895 KiB/s wr, 13 op/s 2023-05-08T12:01:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:30 smithi133 ceph-mon[125939]: pgmap v15963: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 895 KiB/s wr, 13 op/s 2023-05-08T12:01:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:30 smithi096 ceph-mon[124666]: pgmap v15963: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 895 KiB/s wr, 13 op/s 2023-05-08T12:01:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:31 smithi186 ceph-mon[126480]: pgmap v15964: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 432 KiB/s rd, 436 KiB/s wr, 10 op/s 2023-05-08T12:01:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:31 smithi133 ceph-mon[125939]: pgmap v15964: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 432 KiB/s rd, 436 KiB/s wr, 10 op/s 2023-05-08T12:01:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:31 smithi096 ceph-mon[124666]: pgmap v15964: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 432 KiB/s rd, 436 KiB/s wr, 10 op/s 2023-05-08T12:01:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:33 smithi096 ceph-mon[124666]: pgmap v15965: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 432 KiB/s rd, 436 KiB/s wr, 10 op/s 2023-05-08T12:01:34.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29833.249999 secs 2023-05-08T12:01:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:34 smithi186 ceph-mon[126480]: pgmap v15965: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 432 KiB/s rd, 436 KiB/s wr, 10 op/s 2023-05-08T12:01:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29833.249999 secs 2023-05-08T12:01:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:33 smithi133 ceph-mon[125939]: pgmap v15965: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 432 KiB/s rd, 436 KiB/s wr, 10 op/s 2023-05-08T12:01:34.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29833.249999 secs 2023-05-08T12:01:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:36 smithi096 ceph-mon[124666]: pgmap v15966: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 996 KiB/s wr, 9 op/s 2023-05-08T12:01:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:36 smithi096 ceph-mon[124666]: osdmap e1075: 12 total, 12 up, 12 in 2023-05-08T12:01:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:36 smithi186 ceph-mon[126480]: pgmap v15966: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 996 KiB/s wr, 9 op/s 2023-05-08T12:01:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:36 smithi186 ceph-mon[126480]: osdmap e1075: 12 total, 12 up, 12 in 2023-05-08T12:01:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:36 smithi133 ceph-mon[125939]: pgmap v15966: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 996 KiB/s wr, 9 op/s 2023-05-08T12:01:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:36 smithi133 ceph-mon[125939]: osdmap e1075: 12 total, 12 up, 12 in 2023-05-08T12:01:37.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:37 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29835.095238 secs 2023-05-08T12:01:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:37 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29835.095238 secs 2023-05-08T12:01:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:37 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29835.095238 secs 2023-05-08T12:01:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:38 smithi186 ceph-mon[126480]: pgmap v15968: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 592 KiB/s wr, 10 op/s 2023-05-08T12:01:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:38 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:01:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:38 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:01:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:38 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:01:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:38 smithi133 ceph-mon[125939]: pgmap v15968: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 592 KiB/s wr, 10 op/s 2023-05-08T12:01:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:38 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:01:38.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:38 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:01:38.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:38 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:01:38.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:38 smithi096 ceph-mon[124666]: pgmap v15968: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 592 KiB/s wr, 10 op/s 2023-05-08T12:01:38.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:38 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:01:38.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:38 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:01:38.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:38 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:01:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29838.250141 secs 2023-05-08T12:01:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29838.250141 secs 2023-05-08T12:01:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29838.250141 secs 2023-05-08T12:01:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:40 smithi186 ceph-mon[126480]: pgmap v15969: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 593 KiB/s wr, 10 op/s 2023-05-08T12:01:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:40 smithi133 ceph-mon[125939]: pgmap v15969: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 593 KiB/s wr, 10 op/s 2023-05-08T12:01:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:40 smithi096 ceph-mon[124666]: pgmap v15969: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 593 KiB/s wr, 10 op/s 2023-05-08T12:01:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29838.805541 secs 2023-05-08T12:01:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29838.805541 secs 2023-05-08T12:01:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29838.805541 secs 2023-05-08T12:01:42.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:42 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29840.095389 secs 2023-05-08T12:01:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:42 smithi186 ceph-mon[126480]: pgmap v15970: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 848 KiB/s rd, 812 KiB/s wr, 10 op/s 2023-05-08T12:01:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:42 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:01:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:42 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:01:42.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:42 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29840.095389 secs 2023-05-08T12:01:42.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:42 smithi133 ceph-mon[125939]: pgmap v15970: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 848 KiB/s rd, 812 KiB/s wr, 10 op/s 2023-05-08T12:01:42.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:42 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:01:42.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:42 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:01:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:42 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29840.095389 secs 2023-05-08T12:01:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:42 smithi096 ceph-mon[124666]: pgmap v15970: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 848 KiB/s rd, 812 KiB/s wr, 10 op/s 2023-05-08T12:01:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:42 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:01:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:42 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:01:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:44 smithi186 ceph-mon[126480]: pgmap v15971: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 848 KiB/s rd, 812 KiB/s wr, 10 op/s 2023-05-08T12:01:44.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29843.250203 secs 2023-05-08T12:01:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:44 smithi133 ceph-mon[125939]: pgmap v15971: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 848 KiB/s rd, 812 KiB/s wr, 10 op/s 2023-05-08T12:01:44.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29843.250203 secs 2023-05-08T12:01:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:44 smithi096 ceph-mon[124666]: pgmap v15971: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 848 KiB/s rd, 812 KiB/s wr, 10 op/s 2023-05-08T12:01:44.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29843.250203 secs 2023-05-08T12:01:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29843.805663 secs 2023-05-08T12:01:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29843.805663 secs 2023-05-08T12:01:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29843.805663 secs 2023-05-08T12:01:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:46 smithi186 ceph-mon[126480]: pgmap v15972: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 979 KiB/s rd, 962 KiB/s wr, 11 op/s 2023-05-08T12:01:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:46 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:01:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:46 smithi133 ceph-mon[125939]: pgmap v15972: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 979 KiB/s rd, 962 KiB/s wr, 11 op/s 2023-05-08T12:01:46.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:46 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:01:46.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:46 smithi096 ceph-mon[124666]: pgmap v15972: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 979 KiB/s rd, 962 KiB/s wr, 11 op/s 2023-05-08T12:01:46.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:46 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:01:47.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:47 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:01:47.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:47 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:01:47.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:47 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:01:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:48 smithi186 ceph-mon[126480]: pgmap v15973: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 874 KiB/s rd, 890 KiB/s wr, 10 op/s 2023-05-08T12:01:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:48 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:01:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:48 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:01:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:48 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:01:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:48 smithi133 ceph-mon[125939]: pgmap v15973: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 874 KiB/s rd, 890 KiB/s wr, 10 op/s 2023-05-08T12:01:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:48 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:01:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:48 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:01:48.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:48 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:01:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:48 smithi096 ceph-mon[124666]: pgmap v15973: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 874 KiB/s rd, 890 KiB/s wr, 10 op/s 2023-05-08T12:01:48.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:48 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:01:48.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:48 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:01:48.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:48 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:01:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:49 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:01:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:49 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T12:01:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:49 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T12:01:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:49 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:01:49.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:01:49.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29848.250321 secs 2023-05-08T12:01:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:49 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:01:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:49 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T12:01:49.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:49 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T12:01:49.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:49 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:01:49.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:01:49.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29848.250321 secs 2023-05-08T12:01:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:49 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:01:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:49 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T12:01:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:49 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T12:01:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:49 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:01:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:01:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29848.250321 secs 2023-05-08T12:01:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:50 smithi186 ceph-mon[126480]: pgmap v15974: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 809 KiB/s rd, 823 KiB/s wr, 9 op/s 2023-05-08T12:01:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:01:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:01:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:50 smithi133 ceph-mon[125939]: pgmap v15974: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 809 KiB/s rd, 823 KiB/s wr, 9 op/s 2023-05-08T12:01:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:01:50.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:01:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:50 smithi096 ceph-mon[124666]: pgmap v15974: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 809 KiB/s rd, 823 KiB/s wr, 9 op/s 2023-05-08T12:01:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:01:50.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:01:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:51 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:01:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:51 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:01:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:51 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:01:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:52 smithi186 ceph-mon[126480]: pgmap v15975: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.3 MiB/s wr, 15 op/s 2023-05-08T12:01:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:52 smithi133 ceph-mon[125939]: pgmap v15975: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.3 MiB/s wr, 15 op/s 2023-05-08T12:01:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:52 smithi096 ceph-mon[124666]: pgmap v15975: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.3 MiB/s wr, 15 op/s 2023-05-08T12:01:53.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:53 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:01:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:53 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:01:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:53 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:01:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:54 smithi186 ceph-mon[126480]: pgmap v15976: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T12:01:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:54 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:01:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:54 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:01:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29853.250447 secs 2023-05-08T12:01:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:54 smithi133 ceph-mon[125939]: pgmap v15976: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T12:01:54.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:54 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:01:54.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:54 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:01:54.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29853.250447 secs 2023-05-08T12:01:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:54 smithi096 ceph-mon[124666]: pgmap v15976: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T12:01:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:54 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:01:54.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:54 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:01:54.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29853.250447 secs 2023-05-08T12:01:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29853.805916 secs 2023-05-08T12:01:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29853.805916 secs 2023-05-08T12:01:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29853.805916 secs 2023-05-08T12:01:56.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:56 smithi186 ceph-mon[126480]: pgmap v15977: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 16 op/s 2023-05-08T12:01:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:56 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:01:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:56 smithi133 ceph-mon[125939]: pgmap v15977: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 16 op/s 2023-05-08T12:01:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:56 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:01:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:56 smithi096 ceph-mon[124666]: pgmap v15977: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 16 op/s 2023-05-08T12:01:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:56 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:01:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:58 smithi186 ceph-mon[126480]: pgmap v15978: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.5 MiB/s wr, 13 op/s 2023-05-08T12:01:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:01:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:01:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:58 smithi133 ceph-mon[125939]: pgmap v15978: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.5 MiB/s wr, 13 op/s 2023-05-08T12:01:58.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:01:58.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:01:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:58 smithi096 ceph-mon[124666]: pgmap v15978: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.5 MiB/s wr, 13 op/s 2023-05-08T12:01:58.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:01:58.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:01:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:01:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29858.250566 secs 2023-05-08T12:01:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:01:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29858.250566 secs 2023-05-08T12:01:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:01:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29858.250566 secs 2023-05-08T12:02:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:00 smithi186 ceph-mon[126480]: pgmap v15979: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.5 MiB/s wr, 12 op/s 2023-05-08T12:02:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29858.806057 secs 2023-05-08T12:02:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:00 smithi133 ceph-mon[125939]: pgmap v15979: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.5 MiB/s wr, 12 op/s 2023-05-08T12:02:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29858.806057 secs 2023-05-08T12:02:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:00 smithi096 ceph-mon[124666]: pgmap v15979: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.5 MiB/s wr, 12 op/s 2023-05-08T12:02:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29858.806057 secs 2023-05-08T12:02:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:01 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:02:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:01 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:02:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:01 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:02:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:02 smithi186 ceph-mon[126480]: pgmap v15980: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.5 MiB/s wr, 17 op/s 2023-05-08T12:02:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:02 smithi133 ceph-mon[125939]: pgmap v15980: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.5 MiB/s wr, 17 op/s 2023-05-08T12:02:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:02 smithi096 ceph-mon[124666]: pgmap v15980: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.5 MiB/s wr, 17 op/s 2023-05-08T12:02:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:04 smithi186 ceph-mon[126480]: pgmap v15981: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T12:02:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29863.250651 secs 2023-05-08T12:02:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:04 smithi133 ceph-mon[125939]: pgmap v15981: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T12:02:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29863.250651 secs 2023-05-08T12:02:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:04 smithi096 ceph-mon[124666]: pgmap v15981: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T12:02:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29863.250651 secs 2023-05-08T12:02:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29863.806160 secs 2023-05-08T12:02:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29863.806160 secs 2023-05-08T12:02:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29863.806160 secs 2023-05-08T12:02:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:06 smithi186 ceph-mon[126480]: pgmap v15982: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.9 MiB/s wr, 31 op/s 2023-05-08T12:02:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:06 smithi133 ceph-mon[125939]: pgmap v15982: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.9 MiB/s wr, 31 op/s 2023-05-08T12:02:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:06 smithi096 ceph-mon[124666]: pgmap v15982: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.9 MiB/s wr, 31 op/s 2023-05-08T12:02:07.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:07 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29865.095908 secs 2023-05-08T12:02:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:07 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29865.095908 secs 2023-05-08T12:02:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:07 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29865.095908 secs 2023-05-08T12:02:08.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:08 smithi186 ceph-mon[126480]: pgmap v15983: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 26 op/s 2023-05-08T12:02:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:08 smithi133 ceph-mon[125939]: pgmap v15983: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 26 op/s 2023-05-08T12:02:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:08 smithi096 ceph-mon[124666]: pgmap v15983: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 26 op/s 2023-05-08T12:02:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29868.250779 secs 2023-05-08T12:02:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29868.250779 secs 2023-05-08T12:02:09.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29868.250779 secs 2023-05-08T12:02:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:10 smithi133 ceph-mon[125939]: pgmap v15984: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 974 KiB/s wr, 25 op/s 2023-05-08T12:02:10.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29868.806273 secs 2023-05-08T12:02:10.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:10 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:02:10.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:10 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:02:10.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:10 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:02:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:10 smithi096 ceph-mon[124666]: pgmap v15984: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 974 KiB/s wr, 25 op/s 2023-05-08T12:02:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29868.806273 secs 2023-05-08T12:02:10.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:10 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:02:10.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:10 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:02:10.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:10 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:02:10.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:10 smithi186 ceph-mon[126480]: pgmap v15984: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 974 KiB/s wr, 25 op/s 2023-05-08T12:02:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29868.806273 secs 2023-05-08T12:02:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:10 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:02:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:10 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:02:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:10 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:02:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:12 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29870.096024 secs 2023-05-08T12:02:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:12 smithi133 ceph-mon[125939]: pgmap v15985: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 29 op/s 2023-05-08T12:02:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:12 smithi133 ceph-mon[125939]: osdmap e1076: 12 total, 12 up, 12 in 2023-05-08T12:02:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:12 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29870.096024 secs 2023-05-08T12:02:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:12 smithi096 ceph-mon[124666]: pgmap v15985: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 29 op/s 2023-05-08T12:02:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:12 smithi096 ceph-mon[124666]: osdmap e1076: 12 total, 12 up, 12 in 2023-05-08T12:02:12.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:12 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29870.096024 secs 2023-05-08T12:02:12.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:12 smithi186 ceph-mon[126480]: pgmap v15985: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 29 op/s 2023-05-08T12:02:12.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:12 smithi186 ceph-mon[126480]: osdmap e1076: 12 total, 12 up, 12 in 2023-05-08T12:02:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:14 smithi133 ceph-mon[125939]: pgmap v15987: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 29 op/s 2023-05-08T12:02:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29873.250890 secs 2023-05-08T12:02:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:14 smithi096 ceph-mon[124666]: pgmap v15987: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 29 op/s 2023-05-08T12:02:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29873.250890 secs 2023-05-08T12:02:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:14 smithi186 ceph-mon[126480]: pgmap v15987: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 29 op/s 2023-05-08T12:02:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29873.250890 secs 2023-05-08T12:02:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29873.806408 secs 2023-05-08T12:02:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29873.806408 secs 2023-05-08T12:02:15.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29873.806408 secs 2023-05-08T12:02:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:16 smithi133 ceph-mon[125939]: pgmap v15988: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 439 KiB/s wr, 9 op/s 2023-05-08T12:02:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:16 smithi096 ceph-mon[124666]: pgmap v15988: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 439 KiB/s wr, 9 op/s 2023-05-08T12:02:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:16 smithi186 ceph-mon[126480]: pgmap v15988: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 439 KiB/s wr, 9 op/s 2023-05-08T12:02:17.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:17 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29875.096142 secs 2023-05-08T12:02:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:17 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29875.096142 secs 2023-05-08T12:02:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:17 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29875.096142 secs 2023-05-08T12:02:18.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:18 smithi133 ceph-mon[125939]: pgmap v15989: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 440 KiB/s wr, 9 op/s 2023-05-08T12:02:18.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:18 smithi096 ceph-mon[124666]: pgmap v15989: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 440 KiB/s wr, 9 op/s 2023-05-08T12:02:18.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:18 smithi186 ceph-mon[126480]: pgmap v15989: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 440 KiB/s wr, 9 op/s 2023-05-08T12:02:19.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29878.250985 secs 2023-05-08T12:02:19.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29878.250985 secs 2023-05-08T12:02:19.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29878.250985 secs 2023-05-08T12:02:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:20 smithi133 ceph-mon[125939]: pgmap v15990: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 440 KiB/s wr, 9 op/s 2023-05-08T12:02:20.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29878.806507 secs 2023-05-08T12:02:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:20 smithi096 ceph-mon[124666]: pgmap v15990: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 440 KiB/s wr, 9 op/s 2023-05-08T12:02:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29878.806507 secs 2023-05-08T12:02:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:20 smithi186 ceph-mon[126480]: pgmap v15990: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 440 KiB/s wr, 9 op/s 2023-05-08T12:02:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29878.806507 secs 2023-05-08T12:02:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29880.096266 secs 2023-05-08T12:02:22.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:21 smithi186 ceph-mon[126480]: osdmap e1077: 12 total, 12 up, 12 in 2023-05-08T12:02:22.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:21 smithi186 ceph-mon[126480]: pgmap v15992: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 301 KiB/s wr, 9 op/s 2023-05-08T12:02:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29880.096266 secs 2023-05-08T12:02:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:21 smithi133 ceph-mon[125939]: osdmap e1077: 12 total, 12 up, 12 in 2023-05-08T12:02:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:21 smithi133 ceph-mon[125939]: pgmap v15992: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 301 KiB/s wr, 9 op/s 2023-05-08T12:02:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29880.096266 secs 2023-05-08T12:02:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:21 smithi096 ceph-mon[124666]: osdmap e1077: 12 total, 12 up, 12 in 2023-05-08T12:02:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:21 smithi096 ceph-mon[124666]: pgmap v15992: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 301 KiB/s wr, 9 op/s 2023-05-08T12:02:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:24 smithi186 ceph-mon[126480]: pgmap v15993: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 296 KiB/s wr, 9 op/s 2023-05-08T12:02:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29883.251125 secs 2023-05-08T12:02:24.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:24 smithi133 ceph-mon[125939]: pgmap v15993: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 296 KiB/s wr, 9 op/s 2023-05-08T12:02:24.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29883.251125 secs 2023-05-08T12:02:24.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:24 smithi096 ceph-mon[124666]: pgmap v15993: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 296 KiB/s wr, 9 op/s 2023-05-08T12:02:24.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29883.251125 secs 2023-05-08T12:02:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29883.806622 secs 2023-05-08T12:02:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:26 smithi186 ceph-mon[126480]: pgmap v15994: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 222 KiB/s wr, 9 op/s 2023-05-08T12:02:26.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29883.806622 secs 2023-05-08T12:02:26.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:26 smithi133 ceph-mon[125939]: pgmap v15994: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 222 KiB/s wr, 9 op/s 2023-05-08T12:02:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29883.806622 secs 2023-05-08T12:02:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:26 smithi096 ceph-mon[124666]: pgmap v15994: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 222 KiB/s wr, 9 op/s 2023-05-08T12:02:27.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:27 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29885.096391 secs 2023-05-08T12:02:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:27 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29885.096391 secs 2023-05-08T12:02:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:27 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29885.096391 secs 2023-05-08T12:02:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:28 smithi186 ceph-mon[126480]: pgmap v15995: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 221 KiB/s wr, 9 op/s 2023-05-08T12:02:28.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:28 smithi133 ceph-mon[125939]: pgmap v15995: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 221 KiB/s wr, 9 op/s 2023-05-08T12:02:28.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:28 smithi096 ceph-mon[124666]: pgmap v15995: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 221 KiB/s wr, 9 op/s 2023-05-08T12:02:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29888.251236 secs 2023-05-08T12:02:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29888.251236 secs 2023-05-08T12:02:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29888.251236 secs 2023-05-08T12:02:30.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:30 smithi186 ceph-mon[126480]: pgmap v15996: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 221 KiB/s wr, 9 op/s 2023-05-08T12:02:30.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29888.806779 secs 2023-05-08T12:02:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:30 smithi133 ceph-mon[125939]: pgmap v15996: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 221 KiB/s wr, 9 op/s 2023-05-08T12:02:30.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29888.806779 secs 2023-05-08T12:02:30.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:30 smithi096 ceph-mon[124666]: pgmap v15996: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 221 KiB/s wr, 9 op/s 2023-05-08T12:02:30.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29888.806779 secs 2023-05-08T12:02:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29890.096509 secs 2023-05-08T12:02:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:31 smithi133 ceph-mon[125939]: pgmap v15997: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 496 KiB/s wr, 8 op/s 2023-05-08T12:02:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29890.096509 secs 2023-05-08T12:02:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:31 smithi096 ceph-mon[124666]: pgmap v15997: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 496 KiB/s wr, 8 op/s 2023-05-08T12:02:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29890.096509 secs 2023-05-08T12:02:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:31 smithi186 ceph-mon[126480]: pgmap v15997: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 496 KiB/s wr, 8 op/s 2023-05-08T12:02:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:34 smithi186 ceph-mon[126480]: pgmap v15998: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 418 KiB/s wr, 7 op/s 2023-05-08T12:02:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29893.251376 secs 2023-05-08T12:02:34.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:34 smithi133 ceph-mon[125939]: pgmap v15998: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 418 KiB/s wr, 7 op/s 2023-05-08T12:02:34.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29893.251376 secs 2023-05-08T12:02:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:34 smithi096 ceph-mon[124666]: pgmap v15998: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 418 KiB/s wr, 7 op/s 2023-05-08T12:02:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29893.251376 secs 2023-05-08T12:02:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29893.806911 secs 2023-05-08T12:02:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:36 smithi186 ceph-mon[126480]: pgmap v15999: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 492 KiB/s rd, 489 KiB/s wr, 10 op/s 2023-05-08T12:02:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29893.806911 secs 2023-05-08T12:02:36.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:36 smithi133 ceph-mon[125939]: pgmap v15999: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 492 KiB/s rd, 489 KiB/s wr, 10 op/s 2023-05-08T12:02:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29893.806911 secs 2023-05-08T12:02:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:36 smithi096 ceph-mon[124666]: pgmap v15999: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 492 KiB/s rd, 489 KiB/s wr, 10 op/s 2023-05-08T12:02:37.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:37 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29895.096631 secs 2023-05-08T12:02:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:37 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29895.096631 secs 2023-05-08T12:02:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:37 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29895.096631 secs 2023-05-08T12:02:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:38 smithi186 ceph-mon[126480]: pgmap v16000: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 324 KiB/s wr, 7 op/s 2023-05-08T12:02:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:38 smithi133 ceph-mon[125939]: pgmap v16000: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 324 KiB/s wr, 7 op/s 2023-05-08T12:02:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:38 smithi096 ceph-mon[124666]: pgmap v16000: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 324 KiB/s wr, 7 op/s 2023-05-08T12:02:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29898.251490 secs 2023-05-08T12:02:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29898.251490 secs 2023-05-08T12:02:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29898.251490 secs 2023-05-08T12:02:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:40 smithi186 ceph-mon[126480]: pgmap v16001: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 324 KiB/s wr, 6 op/s 2023-05-08T12:02:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29898.807051 secs 2023-05-08T12:02:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:40 smithi133 ceph-mon[125939]: pgmap v16001: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 324 KiB/s wr, 6 op/s 2023-05-08T12:02:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29898.807051 secs 2023-05-08T12:02:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:40 smithi096 ceph-mon[124666]: pgmap v16001: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 324 KiB/s wr, 6 op/s 2023-05-08T12:02:40.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29898.807051 secs 2023-05-08T12:02:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29900.096734 secs 2023-05-08T12:02:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:41 smithi133 ceph-mon[125939]: pgmap v16002: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 415 KiB/s wr, 10 op/s 2023-05-08T12:02:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29900.096734 secs 2023-05-08T12:02:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:41 smithi096 ceph-mon[124666]: pgmap v16002: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 415 KiB/s wr, 10 op/s 2023-05-08T12:02:42.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29900.096734 secs 2023-05-08T12:02:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:41 smithi186 ceph-mon[126480]: pgmap v16002: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 415 KiB/s wr, 10 op/s 2023-05-08T12:02:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:44 smithi186 ceph-mon[126480]: pgmap v16003: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 163 KiB/s wr, 6 op/s 2023-05-08T12:02:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29903.251565 secs 2023-05-08T12:02:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:44 smithi133 ceph-mon[125939]: pgmap v16003: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 163 KiB/s wr, 6 op/s 2023-05-08T12:02:44.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29903.251565 secs 2023-05-08T12:02:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:44 smithi096 ceph-mon[124666]: pgmap v16003: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 163 KiB/s wr, 6 op/s 2023-05-08T12:02:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29903.251565 secs 2023-05-08T12:02:46.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29903.807196 secs 2023-05-08T12:02:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:46 smithi186 ceph-mon[126480]: pgmap v16004: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 661 KiB/s wr, 10 op/s 2023-05-08T12:02:46.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29903.807196 secs 2023-05-08T12:02:46.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:46 smithi133 ceph-mon[125939]: pgmap v16004: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 661 KiB/s wr, 10 op/s 2023-05-08T12:02:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29903.807196 secs 2023-05-08T12:02:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:46 smithi096 ceph-mon[124666]: pgmap v16004: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 661 KiB/s wr, 10 op/s 2023-05-08T12:02:48.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:48 smithi186 ceph-mon[126480]: pgmap v16005: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 608 KiB/s wr, 8 op/s 2023-05-08T12:02:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:48 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:02:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:48 smithi133 ceph-mon[125939]: pgmap v16005: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 608 KiB/s wr, 8 op/s 2023-05-08T12:02:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:48 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:02:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:48 smithi096 ceph-mon[124666]: pgmap v16005: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 608 KiB/s wr, 8 op/s 2023-05-08T12:02:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:48 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:02:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:02:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:49 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:02:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:49 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:02:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:49 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:02:49.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:49 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:02:49.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:49 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T12:02:49.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:49 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T12:02:49.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:49 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:02:49.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29908.251662 secs 2023-05-08T12:02:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:02:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:49 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:02:49.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:49 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:02:49.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:49 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:02:49.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:49 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:02:49.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:49 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T12:02:49.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:49 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T12:02:49.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:49 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:02:49.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29908.251662 secs 2023-05-08T12:02:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:02:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:49 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:02:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:49 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:02:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:49 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:02:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:49 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:02:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:49 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T12:02:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:49 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T12:02:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:49 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:02:49.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29908.251662 secs 2023-05-08T12:02:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:50 smithi186 ceph-mon[126480]: pgmap v16006: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 608 KiB/s wr, 7 op/s 2023-05-08T12:02:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:02:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:02:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:02:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:50 smithi133 ceph-mon[125939]: pgmap v16006: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 608 KiB/s wr, 7 op/s 2023-05-08T12:02:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:02:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:02:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:02:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:50 smithi096 ceph-mon[124666]: pgmap v16006: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 608 KiB/s wr, 7 op/s 2023-05-08T12:02:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:02:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:02:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:02:52.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:51 smithi133 ceph-mon[125939]: pgmap v16007: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 943 KiB/s rd, 721 KiB/s wr, 12 op/s 2023-05-08T12:02:52.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:51 smithi096 ceph-mon[124666]: pgmap v16007: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 943 KiB/s rd, 721 KiB/s wr, 12 op/s 2023-05-08T12:02:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:51 smithi186 ceph-mon[126480]: pgmap v16007: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 943 KiB/s rd, 721 KiB/s wr, 12 op/s 2023-05-08T12:02:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:02:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:02:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:02:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:02:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:02:54.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:53 smithi133 ceph-mon[125939]: pgmap v16008: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 851 KiB/s rd, 630 KiB/s wr, 8 op/s 2023-05-08T12:02:54.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29913.251803 secs 2023-05-08T12:02:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:02:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:02:54.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:53 smithi096 ceph-mon[124666]: pgmap v16008: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 851 KiB/s rd, 630 KiB/s wr, 8 op/s 2023-05-08T12:02:54.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29913.251803 secs 2023-05-08T12:02:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:02:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:02:54.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:53 smithi186 ceph-mon[126480]: pgmap v16008: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 851 KiB/s rd, 630 KiB/s wr, 8 op/s 2023-05-08T12:02:54.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29913.251803 secs 2023-05-08T12:02:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:56 smithi186 ceph-mon[126480]: pgmap v16009: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T12:02:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:56 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:02:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:56 smithi133 ceph-mon[125939]: pgmap v16009: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T12:02:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:56 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:02:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:56 smithi096 ceph-mon[124666]: pgmap v16009: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T12:02:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:56 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:02:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:58 smithi186 ceph-mon[126480]: pgmap v16010: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 663 KiB/s wr, 11 op/s 2023-05-08T12:02:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:58 smithi133 ceph-mon[125939]: pgmap v16010: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 663 KiB/s wr, 11 op/s 2023-05-08T12:02:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:58 smithi096 ceph-mon[124666]: pgmap v16010: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 663 KiB/s wr, 11 op/s 2023-05-08T12:02:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:02:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29918.251916 secs 2023-05-08T12:02:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:02:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29918.251916 secs 2023-05-08T12:02:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:02:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29918.251916 secs 2023-05-08T12:03:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:00 smithi186 ceph-mon[126480]: pgmap v16011: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 644 KiB/s wr, 10 op/s 2023-05-08T12:03:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:00 smithi133 ceph-mon[125939]: pgmap v16011: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 644 KiB/s wr, 10 op/s 2023-05-08T12:03:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:00 smithi096 ceph-mon[124666]: pgmap v16011: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 644 KiB/s wr, 10 op/s 2023-05-08T12:03:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29920.097137 secs 2023-05-08T12:03:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:01 smithi133 ceph-mon[125939]: pgmap v16012: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 803 KiB/s wr, 16 op/s 2023-05-08T12:03:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29920.097137 secs 2023-05-08T12:03:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:01 smithi096 ceph-mon[124666]: pgmap v16012: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 803 KiB/s wr, 16 op/s 2023-05-08T12:03:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29920.097137 secs 2023-05-08T12:03:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:01 smithi186 ceph-mon[126480]: pgmap v16012: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 803 KiB/s wr, 16 op/s 2023-05-08T12:03:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:04 smithi186 ceph-mon[126480]: pgmap v16013: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 689 KiB/s wr, 11 op/s 2023-05-08T12:03:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29923.251977 secs 2023-05-08T12:03:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:04 smithi133 ceph-mon[125939]: pgmap v16013: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 689 KiB/s wr, 11 op/s 2023-05-08T12:03:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29923.251977 secs 2023-05-08T12:03:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:04 smithi096 ceph-mon[124666]: pgmap v16013: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 689 KiB/s wr, 11 op/s 2023-05-08T12:03:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29923.251977 secs 2023-05-08T12:03:05.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29923.807693 secs 2023-05-08T12:03:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:05 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:03:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:03:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:03:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:03:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29923.807693 secs 2023-05-08T12:03:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:05 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:03:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:03:05.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:03:05.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:03:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29923.807693 secs 2023-05-08T12:03:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:05 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:03:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:03:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:03:05.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:03:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:06 smithi186 ceph-mon[126480]: pgmap v16014: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 31 op/s 2023-05-08T12:03:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:06 smithi133 ceph-mon[125939]: pgmap v16014: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 31 op/s 2023-05-08T12:03:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:06 smithi096 ceph-mon[124666]: pgmap v16014: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 31 op/s 2023-05-08T12:03:07.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:07 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29925.097294 secs 2023-05-08T12:03:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:07 smithi186 ceph-mon[126480]: osdmap e1078: 12 total, 12 up, 12 in 2023-05-08T12:03:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:07 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29925.097294 secs 2023-05-08T12:03:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:07 smithi133 ceph-mon[125939]: osdmap e1078: 12 total, 12 up, 12 in 2023-05-08T12:03:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:07 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29925.097294 secs 2023-05-08T12:03:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:07 smithi096 ceph-mon[124666]: osdmap e1078: 12 total, 12 up, 12 in 2023-05-08T12:03:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:08 smithi186 ceph-mon[126480]: pgmap v16016: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 865 KiB/s rd, 738 KiB/s wr, 31 op/s 2023-05-08T12:03:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:08 smithi133 ceph-mon[125939]: pgmap v16016: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 865 KiB/s rd, 738 KiB/s wr, 31 op/s 2023-05-08T12:03:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:08 smithi096 ceph-mon[124666]: pgmap v16016: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 865 KiB/s rd, 738 KiB/s wr, 31 op/s 2023-05-08T12:03:09.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29928.252113 secs 2023-05-08T12:03:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29928.252113 secs 2023-05-08T12:03:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29928.252113 secs 2023-05-08T12:03:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:10 smithi186 ceph-mon[126480]: pgmap v16017: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 865 KiB/s rd, 738 KiB/s wr, 31 op/s 2023-05-08T12:03:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29928.807803 secs 2023-05-08T12:03:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:10 smithi133 ceph-mon[125939]: pgmap v16017: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 865 KiB/s rd, 738 KiB/s wr, 31 op/s 2023-05-08T12:03:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29928.807803 secs 2023-05-08T12:03:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:10 smithi096 ceph-mon[124666]: pgmap v16017: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 865 KiB/s rd, 738 KiB/s wr, 31 op/s 2023-05-08T12:03:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29928.807803 secs 2023-05-08T12:03:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29930.097419 secs 2023-05-08T12:03:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:11 smithi133 ceph-mon[125939]: pgmap v16018: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 548 KiB/s wr, 29 op/s 2023-05-08T12:03:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29930.097419 secs 2023-05-08T12:03:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:11 smithi096 ceph-mon[124666]: pgmap v16018: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 548 KiB/s wr, 29 op/s 2023-05-08T12:03:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29930.097419 secs 2023-05-08T12:03:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:11 smithi186 ceph-mon[126480]: pgmap v16018: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 548 KiB/s wr, 29 op/s 2023-05-08T12:03:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:14 smithi186 ceph-mon[126480]: pgmap v16019: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 548 KiB/s wr, 29 op/s 2023-05-08T12:03:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29933.252235 secs 2023-05-08T12:03:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:14 smithi133 ceph-mon[125939]: pgmap v16019: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 548 KiB/s wr, 29 op/s 2023-05-08T12:03:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29933.252235 secs 2023-05-08T12:03:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:14 smithi096 ceph-mon[124666]: pgmap v16019: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 548 KiB/s wr, 29 op/s 2023-05-08T12:03:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29933.252235 secs 2023-05-08T12:03:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29933.807926 secs 2023-05-08T12:03:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:16 smithi186 ceph-mon[126480]: pgmap v16020: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 465 KiB/s rd, 297 KiB/s wr, 9 op/s 2023-05-08T12:03:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:16 smithi186 ceph-mon[126480]: osdmap e1079: 12 total, 12 up, 12 in 2023-05-08T12:03:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29933.807926 secs 2023-05-08T12:03:16.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:16 smithi133 ceph-mon[125939]: pgmap v16020: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 465 KiB/s rd, 297 KiB/s wr, 9 op/s 2023-05-08T12:03:16.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:16 smithi133 ceph-mon[125939]: osdmap e1079: 12 total, 12 up, 12 in 2023-05-08T12:03:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29933.807926 secs 2023-05-08T12:03:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:16 smithi096 ceph-mon[124666]: pgmap v16020: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 465 KiB/s rd, 297 KiB/s wr, 9 op/s 2023-05-08T12:03:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:16 smithi096 ceph-mon[124666]: osdmap e1079: 12 total, 12 up, 12 in 2023-05-08T12:03:17.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:17 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29935.097557 secs 2023-05-08T12:03:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:17 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29935.097557 secs 2023-05-08T12:03:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:17 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29935.097557 secs 2023-05-08T12:03:18.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:18 smithi186 ceph-mon[126480]: pgmap v16022: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 465 KiB/s rd, 296 KiB/s wr, 9 op/s 2023-05-08T12:03:18.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:18 smithi133 ceph-mon[125939]: pgmap v16022: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 465 KiB/s rd, 296 KiB/s wr, 9 op/s 2023-05-08T12:03:18.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:18 smithi096 ceph-mon[124666]: pgmap v16022: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 465 KiB/s rd, 296 KiB/s wr, 9 op/s 2023-05-08T12:03:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29938.252364 secs 2023-05-08T12:03:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29938.252364 secs 2023-05-08T12:03:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29938.252364 secs 2023-05-08T12:03:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:20 smithi186 ceph-mon[126480]: pgmap v16023: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 465 KiB/s rd, 296 KiB/s wr, 9 op/s 2023-05-08T12:03:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29938.808041 secs 2023-05-08T12:03:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:20 smithi133 ceph-mon[125939]: pgmap v16023: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 465 KiB/s rd, 296 KiB/s wr, 9 op/s 2023-05-08T12:03:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29938.808041 secs 2023-05-08T12:03:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:20 smithi096 ceph-mon[124666]: pgmap v16023: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 465 KiB/s rd, 296 KiB/s wr, 9 op/s 2023-05-08T12:03:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29938.808041 secs 2023-05-08T12:03:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29940.097675 secs 2023-05-08T12:03:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:21 smithi133 ceph-mon[125939]: pgmap v16024: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 296 KiB/s wr, 8 op/s 2023-05-08T12:03:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29940.097675 secs 2023-05-08T12:03:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:21 smithi096 ceph-mon[124666]: pgmap v16024: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 296 KiB/s wr, 8 op/s 2023-05-08T12:03:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29940.097675 secs 2023-05-08T12:03:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:21 smithi186 ceph-mon[126480]: pgmap v16024: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 296 KiB/s wr, 8 op/s 2023-05-08T12:03:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:24 smithi186 ceph-mon[126480]: pgmap v16025: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 296 KiB/s wr, 8 op/s 2023-05-08T12:03:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29943.252453 secs 2023-05-08T12:03:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:24 smithi133 ceph-mon[125939]: pgmap v16025: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 296 KiB/s wr, 8 op/s 2023-05-08T12:03:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29943.252453 secs 2023-05-08T12:03:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:24 smithi096 ceph-mon[124666]: pgmap v16025: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 296 KiB/s wr, 8 op/s 2023-05-08T12:03:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29943.252453 secs 2023-05-08T12:03:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29943.808112 secs 2023-05-08T12:03:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:26 smithi186 ceph-mon[126480]: pgmap v16026: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 102 B/s wr, 7 op/s 2023-05-08T12:03:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29943.808112 secs 2023-05-08T12:03:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:26 smithi133 ceph-mon[125939]: pgmap v16026: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 102 B/s wr, 7 op/s 2023-05-08T12:03:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29943.808112 secs 2023-05-08T12:03:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:26 smithi096 ceph-mon[124666]: pgmap v16026: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 102 B/s wr, 7 op/s 2023-05-08T12:03:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:27 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29945.097812 secs 2023-05-08T12:03:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:27 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29945.097812 secs 2023-05-08T12:03:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:27 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29945.097812 secs 2023-05-08T12:03:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:28 smithi186 ceph-mon[126480]: pgmap v16027: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 92 B/s wr, 6 op/s 2023-05-08T12:03:28.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:28 smithi133 ceph-mon[125939]: pgmap v16027: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 92 B/s wr, 6 op/s 2023-05-08T12:03:28.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:28 smithi096 ceph-mon[124666]: pgmap v16027: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 92 B/s wr, 6 op/s 2023-05-08T12:03:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29948.252567 secs 2023-05-08T12:03:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29948.252567 secs 2023-05-08T12:03:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29948.252567 secs 2023-05-08T12:03:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:30 smithi186 ceph-mon[126480]: pgmap v16028: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 85 B/s wr, 6 op/s 2023-05-08T12:03:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29948.808236 secs 2023-05-08T12:03:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:30 smithi133 ceph-mon[125939]: pgmap v16028: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 85 B/s wr, 6 op/s 2023-05-08T12:03:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29948.808236 secs 2023-05-08T12:03:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:30 smithi096 ceph-mon[124666]: pgmap v16028: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 85 B/s wr, 6 op/s 2023-05-08T12:03:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29948.808236 secs 2023-05-08T12:03:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29950.097882 secs 2023-05-08T12:03:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29950.097882 secs 2023-05-08T12:03:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29950.097882 secs 2023-05-08T12:03:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:32 smithi186 ceph-mon[126480]: pgmap v16029: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 170 B/s wr, 9 op/s 2023-05-08T12:03:32.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:32 smithi133 ceph-mon[125939]: pgmap v16029: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 170 B/s wr, 9 op/s 2023-05-08T12:03:32.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:32 smithi096 ceph-mon[124666]: pgmap v16029: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 170 B/s wr, 9 op/s 2023-05-08T12:03:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:34 smithi186 ceph-mon[126480]: pgmap v16030: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 85 B/s wr, 6 op/s 2023-05-08T12:03:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29953.252633 secs 2023-05-08T12:03:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:34 smithi133 ceph-mon[125939]: pgmap v16030: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 85 B/s wr, 6 op/s 2023-05-08T12:03:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29953.252633 secs 2023-05-08T12:03:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:34 smithi096 ceph-mon[124666]: pgmap v16030: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 85 B/s wr, 6 op/s 2023-05-08T12:03:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29953.252633 secs 2023-05-08T12:03:35.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29953.808346 secs 2023-05-08T12:03:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29953.808346 secs 2023-05-08T12:03:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29953.808346 secs 2023-05-08T12:03:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:36 smithi186 ceph-mon[126480]: pgmap v16031: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 101 KiB/s wr, 9 op/s 2023-05-08T12:03:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29955.098015 secs 2023-05-08T12:03:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:36 smithi133 ceph-mon[125939]: pgmap v16031: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 101 KiB/s wr, 9 op/s 2023-05-08T12:03:36.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29955.098015 secs 2023-05-08T12:03:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:36 smithi096 ceph-mon[124666]: pgmap v16031: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 101 KiB/s wr, 9 op/s 2023-05-08T12:03:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29955.098015 secs 2023-05-08T12:03:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:38 smithi186 ceph-mon[126480]: pgmap v16032: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 101 KiB/s wr, 7 op/s 2023-05-08T12:03:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:38 smithi133 ceph-mon[125939]: pgmap v16032: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 101 KiB/s wr, 7 op/s 2023-05-08T12:03:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:38 smithi096 ceph-mon[124666]: pgmap v16032: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 101 KiB/s wr, 7 op/s 2023-05-08T12:03:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29958.252697 secs 2023-05-08T12:03:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29958.252697 secs 2023-05-08T12:03:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29958.252697 secs 2023-05-08T12:03:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:40 smithi186 ceph-mon[126480]: pgmap v16033: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 101 KiB/s wr, 7 op/s 2023-05-08T12:03:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29958.808446 secs 2023-05-08T12:03:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:40 smithi133 ceph-mon[125939]: pgmap v16033: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 101 KiB/s wr, 7 op/s 2023-05-08T12:03:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29958.808446 secs 2023-05-08T12:03:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:40 smithi096 ceph-mon[124666]: pgmap v16033: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 101 KiB/s wr, 7 op/s 2023-05-08T12:03:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29958.808446 secs 2023-05-08T12:03:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29960.098133 secs 2023-05-08T12:03:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29960.098133 secs 2023-05-08T12:03:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29960.098133 secs 2023-05-08T12:03:42.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:42 smithi186 ceph-mon[126480]: pgmap v16034: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 364 KiB/s wr, 11 op/s 2023-05-08T12:03:42.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:42 smithi133 ceph-mon[125939]: pgmap v16034: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 364 KiB/s wr, 11 op/s 2023-05-08T12:03:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:42 smithi096 ceph-mon[124666]: pgmap v16034: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 364 KiB/s wr, 11 op/s 2023-05-08T12:03:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:44 smithi186 ceph-mon[126480]: pgmap v16035: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 364 KiB/s wr, 7 op/s 2023-05-08T12:03:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29963.252815 secs 2023-05-08T12:03:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:44 smithi133 ceph-mon[125939]: pgmap v16035: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 364 KiB/s wr, 7 op/s 2023-05-08T12:03:44.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29963.252815 secs 2023-05-08T12:03:44.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:44 smithi096 ceph-mon[124666]: pgmap v16035: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 364 KiB/s wr, 7 op/s 2023-05-08T12:03:44.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29963.252815 secs 2023-05-08T12:03:45.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29963.808533 secs 2023-05-08T12:03:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29963.808533 secs 2023-05-08T12:03:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29963.808533 secs 2023-05-08T12:03:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:46 smithi186 ceph-mon[126480]: pgmap v16036: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 724 KiB/s rd, 443 KiB/s wr, 11 op/s 2023-05-08T12:03:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:46 smithi133 ceph-mon[125939]: pgmap v16036: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 724 KiB/s rd, 443 KiB/s wr, 11 op/s 2023-05-08T12:03:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:46 smithi096 ceph-mon[124666]: pgmap v16036: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 724 KiB/s rd, 443 KiB/s wr, 11 op/s 2023-05-08T12:03:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:48 smithi186 ceph-mon[126480]: pgmap v16037: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 623 KiB/s rd, 342 KiB/s wr, 8 op/s 2023-05-08T12:03:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:48 smithi133 ceph-mon[125939]: pgmap v16037: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 623 KiB/s rd, 342 KiB/s wr, 8 op/s 2023-05-08T12:03:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:48 smithi096 ceph-mon[124666]: pgmap v16037: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 623 KiB/s rd, 342 KiB/s wr, 8 op/s 2023-05-08T12:03:49.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:03:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:49 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:03:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29968.252907 secs 2023-05-08T12:03:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:03:49.508 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:49 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:03:49.508 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29968.252907 secs 2023-05-08T12:03:49.509 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:03:49.509 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:49 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:03:49.509 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29968.252907 secs 2023-05-08T12:03:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:50 smithi186 ceph-mon[126480]: pgmap v16038: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 622 KiB/s rd, 342 KiB/s wr, 7 op/s 2023-05-08T12:03:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29968.808598 secs 2023-05-08T12:03:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:03:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:03:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:03:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:50 smithi133 ceph-mon[125939]: pgmap v16038: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 622 KiB/s rd, 342 KiB/s wr, 7 op/s 2023-05-08T12:03:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29968.808598 secs 2023-05-08T12:03:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:03:50.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:03:50.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:03:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:50 smithi096 ceph-mon[124666]: pgmap v16038: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 622 KiB/s rd, 342 KiB/s wr, 7 op/s 2023-05-08T12:03:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29968.808598 secs 2023-05-08T12:03:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:03:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:03:50.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:03:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:52 smithi133 ceph-mon[125939]: pgmap v16039: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 703 KiB/s wr, 11 op/s 2023-05-08T12:03:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:03:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:03:52.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:03:52.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:03:52.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:03:52.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:03:52.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:03:52.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:03:52.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:03:52.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:03:52.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:03:52.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:03:52.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:03:52.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:03:52.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:03:52.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:03:52.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:03:52.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:03:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:52 smithi096 ceph-mon[124666]: pgmap v16039: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 703 KiB/s wr, 11 op/s 2023-05-08T12:03:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:03:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:03:52.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:03:52.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:03:52.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:03:52.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:03:52.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:03:52.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:03:52.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:03:52.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:03:52.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:03:52.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:03:52.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:03:52.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:03:52.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:03:52.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:03:52.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:03:52.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:03:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:52 smithi186 ceph-mon[126480]: pgmap v16039: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 703 KiB/s wr, 11 op/s 2023-05-08T12:03:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:03:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:03:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:03:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:03:52.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:03:52.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:03:52.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:03:52.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:03:52.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:03:52.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:03:52.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:03:52.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:03:52.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:03:52.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:03:52.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:03:52.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:03:52.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:03:52.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:03:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:53 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi186 to 148.8M 2023-05-08T12:03:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:53 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi186 to 156109066: error parsing value: Value '156109066' is below minimum 939524096 2023-05-08T12:03:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:53 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi133 to 158.3M 2023-05-08T12:03:53.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:53 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi133 to 166023975: error parsing value: Value '166023975' is below minimum 939524096 2023-05-08T12:03:53.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:53 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:03:53.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:53 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T12:03:53.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:53 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T12:03:53.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:53 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:03:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:53 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi186 to 148.8M 2023-05-08T12:03:53.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:53 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi186 to 156109066: error parsing value: Value '156109066' is below minimum 939524096 2023-05-08T12:03:53.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:53 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi133 to 158.3M 2023-05-08T12:03:53.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:53 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi133 to 166023975: error parsing value: Value '166023975' is below minimum 939524096 2023-05-08T12:03:53.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:53 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:03:53.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:53 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T12:03:53.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:53 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T12:03:53.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:53 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:03:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:53 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi186 to 148.8M 2023-05-08T12:03:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:53 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi186 to 156109066: error parsing value: Value '156109066' is below minimum 939524096 2023-05-08T12:03:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:53 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi133 to 158.3M 2023-05-08T12:03:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:53 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi133 to 166023975: error parsing value: Value '166023975' is below minimum 939524096 2023-05-08T12:03:53.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:53 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:03:53.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:53 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T12:03:53.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:53 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T12:03:53.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:53 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:03:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:54 smithi133 ceph-mon[125939]: pgmap v16040: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 986 KiB/s rd, 439 KiB/s wr, 7 op/s 2023-05-08T12:03:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29973.253052 secs 2023-05-08T12:03:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:54 smithi096 ceph-mon[124666]: pgmap v16040: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 986 KiB/s rd, 439 KiB/s wr, 7 op/s 2023-05-08T12:03:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29973.253052 secs 2023-05-08T12:03:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:54 smithi186 ceph-mon[126480]: pgmap v16040: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 986 KiB/s rd, 439 KiB/s wr, 7 op/s 2023-05-08T12:03:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29973.253052 secs 2023-05-08T12:03:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:56 smithi133 ceph-mon[125939]: pgmap v16041: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 704 KiB/s wr, 11 op/s 2023-05-08T12:03:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:56 smithi096 ceph-mon[124666]: pgmap v16041: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 704 KiB/s wr, 11 op/s 2023-05-08T12:03:56.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:56 smithi186 ceph-mon[126480]: pgmap v16041: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 704 KiB/s wr, 11 op/s 2023-05-08T12:03:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:03:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:03:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:03:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:58 smithi133 ceph-mon[125939]: pgmap v16042: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1013 KiB/s rd, 626 KiB/s wr, 8 op/s 2023-05-08T12:03:58.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:58 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:03:58.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:03:58.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:03:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:58 smithi096 ceph-mon[124666]: pgmap v16042: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1013 KiB/s rd, 626 KiB/s wr, 8 op/s 2023-05-08T12:03:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:58 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:03:58.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:03:58.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:03:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:58 smithi186 ceph-mon[126480]: pgmap v16042: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1013 KiB/s rd, 626 KiB/s wr, 8 op/s 2023-05-08T12:03:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:58 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:03:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:03:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:03:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:03:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29978.253174 secs 2023-05-08T12:03:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:03:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29978.253174 secs 2023-05-08T12:03:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:03:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29978.253174 secs 2023-05-08T12:04:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:00 smithi133 ceph-mon[125939]: pgmap v16043: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1013 KiB/s rd, 626 KiB/s wr, 8 op/s 2023-05-08T12:04:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29978.808826 secs 2023-05-08T12:04:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:00 smithi096 ceph-mon[124666]: pgmap v16043: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1013 KiB/s rd, 626 KiB/s wr, 8 op/s 2023-05-08T12:04:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29978.808826 secs 2023-05-08T12:04:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:00 smithi186 ceph-mon[126480]: pgmap v16043: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1013 KiB/s rd, 626 KiB/s wr, 8 op/s 2023-05-08T12:04:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29978.808826 secs 2023-05-08T12:04:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:02 smithi133 ceph-mon[125939]: pgmap v16044: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 15 op/s 2023-05-08T12:04:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:04:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:04:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:02 smithi096 ceph-mon[124666]: pgmap v16044: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 15 op/s 2023-05-08T12:04:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:04:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:04:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:02 smithi186 ceph-mon[126480]: pgmap v16044: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 15 op/s 2023-05-08T12:04:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:04:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:04:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:04 smithi133 ceph-mon[125939]: pgmap v16045: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 751 KiB/s rd, 727 KiB/s wr, 11 op/s 2023-05-08T12:04:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29983.253288 secs 2023-05-08T12:04:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:04 smithi096 ceph-mon[124666]: pgmap v16045: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 751 KiB/s rd, 727 KiB/s wr, 11 op/s 2023-05-08T12:04:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29983.253288 secs 2023-05-08T12:04:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:04 smithi186 ceph-mon[126480]: pgmap v16045: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 751 KiB/s rd, 727 KiB/s wr, 11 op/s 2023-05-08T12:04:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29983.253288 secs 2023-05-08T12:04:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:05 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:04:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:05 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:04:05.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:05 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:04:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:06 smithi133 ceph-mon[125939]: pgmap v16046: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 977 KiB/s wr, 17 op/s 2023-05-08T12:04:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:06 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:04:06.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:04:06.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:04:06.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29985.098766 secs 2023-05-08T12:04:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:06 smithi096 ceph-mon[124666]: pgmap v16046: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 977 KiB/s wr, 17 op/s 2023-05-08T12:04:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:06 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:04:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:04:06.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:04:06.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29985.098766 secs 2023-05-08T12:04:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:06 smithi186 ceph-mon[126480]: pgmap v16046: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 977 KiB/s wr, 17 op/s 2023-05-08T12:04:06.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:06 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:04:06.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:04:06.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:04:06.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29985.098766 secs 2023-05-08T12:04:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:08 smithi096 ceph-mon[124666]: pgmap v16047: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 726 KiB/s rd, 712 KiB/s wr, 14 op/s 2023-05-08T12:04:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:08 smithi186 ceph-mon[126480]: pgmap v16047: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 726 KiB/s rd, 712 KiB/s wr, 14 op/s 2023-05-08T12:04:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:08 smithi133 ceph-mon[125939]: pgmap v16047: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 726 KiB/s rd, 712 KiB/s wr, 14 op/s 2023-05-08T12:04:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29988.253376 secs 2023-05-08T12:04:09.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29988.253376 secs 2023-05-08T12:04:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29988.253376 secs 2023-05-08T12:04:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:10 smithi096 ceph-mon[124666]: pgmap v16048: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 707 KiB/s rd, 712 KiB/s wr, 13 op/s 2023-05-08T12:04:10.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29988.809055 secs 2023-05-08T12:04:10.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:10 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:04:10.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:10 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:04:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:10 smithi186 ceph-mon[126480]: pgmap v16048: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 707 KiB/s rd, 712 KiB/s wr, 13 op/s 2023-05-08T12:04:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29988.809055 secs 2023-05-08T12:04:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:10 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:04:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:10 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:04:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:10 smithi133 ceph-mon[125939]: pgmap v16048: 97 pgs: 97 active+clean; 6.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 707 KiB/s rd, 712 KiB/s wr, 13 op/s 2023-05-08T12:04:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29988.809055 secs 2023-05-08T12:04:10.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:10 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:04:10.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:10 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:04:11.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29990.098890 secs 2023-05-08T12:04:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:11 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:04:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29990.098890 secs 2023-05-08T12:04:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:11 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:04:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29990.098890 secs 2023-05-08T12:04:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:11 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:04:12.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:12 smithi186 ceph-mon[126480]: pgmap v16049: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 32 op/s 2023-05-08T12:04:12.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:12 smithi186 ceph-mon[126480]: osdmap e1080: 12 total, 12 up, 12 in 2023-05-08T12:04:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:12 smithi133 ceph-mon[125939]: pgmap v16049: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 32 op/s 2023-05-08T12:04:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:12 smithi133 ceph-mon[125939]: osdmap e1080: 12 total, 12 up, 12 in 2023-05-08T12:04:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:12 smithi096 ceph-mon[124666]: pgmap v16049: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 32 op/s 2023-05-08T12:04:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:12 smithi096 ceph-mon[124666]: osdmap e1080: 12 total, 12 up, 12 in 2023-05-08T12:04:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:14 smithi186 ceph-mon[126480]: pgmap v16051: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 871 KiB/s rd, 888 KiB/s wr, 30 op/s 2023-05-08T12:04:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:14 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:04:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:14 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:04:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29993.253495 secs 2023-05-08T12:04:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:14 smithi133 ceph-mon[125939]: pgmap v16051: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 871 KiB/s rd, 888 KiB/s wr, 30 op/s 2023-05-08T12:04:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:14 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:04:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:14 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:04:14.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29993.253495 secs 2023-05-08T12:04:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:14 smithi096 ceph-mon[124666]: pgmap v16051: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 871 KiB/s rd, 888 KiB/s wr, 30 op/s 2023-05-08T12:04:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:14 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:04:14.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:14 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:04:14.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29993.253495 secs 2023-05-08T12:04:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29993.809170 secs 2023-05-08T12:04:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29993.809170 secs 2023-05-08T12:04:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29993.809170 secs 2023-05-08T12:04:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:16 smithi186 ceph-mon[126480]: pgmap v16052: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 723 KiB/s rd, 722 KiB/s wr, 27 op/s 2023-05-08T12:04:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29995.099031 secs 2023-05-08T12:04:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:16 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:04:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:16 smithi133 ceph-mon[125939]: pgmap v16052: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 723 KiB/s rd, 722 KiB/s wr, 27 op/s 2023-05-08T12:04:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29995.099031 secs 2023-05-08T12:04:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:16 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:04:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:16 smithi096 ceph-mon[124666]: pgmap v16052: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 723 KiB/s rd, 722 KiB/s wr, 27 op/s 2023-05-08T12:04:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29995.099031 secs 2023-05-08T12:04:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:16 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:04:18.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:18 smithi186 ceph-mon[126480]: pgmap v16053: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 700 KiB/s rd, 721 KiB/s wr, 27 op/s 2023-05-08T12:04:18.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:18 smithi133 ceph-mon[125939]: pgmap v16053: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 700 KiB/s rd, 721 KiB/s wr, 27 op/s 2023-05-08T12:04:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:18 smithi096 ceph-mon[124666]: pgmap v16053: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 700 KiB/s rd, 721 KiB/s wr, 27 op/s 2023-05-08T12:04:19.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29998.253607 secs 2023-05-08T12:04:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29998.253607 secs 2023-05-08T12:04:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29998.253607 secs 2023-05-08T12:04:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:20 smithi186 ceph-mon[126480]: pgmap v16054: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 700 KiB/s rd, 721 KiB/s wr, 27 op/s 2023-05-08T12:04:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 29998.809287 secs 2023-05-08T12:04:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:20 smithi133 ceph-mon[125939]: pgmap v16054: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 700 KiB/s rd, 721 KiB/s wr, 27 op/s 2023-05-08T12:04:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 29998.809287 secs 2023-05-08T12:04:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:20 smithi096 ceph-mon[124666]: pgmap v16054: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 700 KiB/s rd, 721 KiB/s wr, 27 op/s 2023-05-08T12:04:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 29998.809287 secs 2023-05-08T12:04:21.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30000.099167 secs 2023-05-08T12:04:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:21 smithi186 ceph-mon[126480]: osdmap e1081: 12 total, 12 up, 12 in 2023-05-08T12:04:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30000.099167 secs 2023-05-08T12:04:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:21 smithi133 ceph-mon[125939]: osdmap e1081: 12 total, 12 up, 12 in 2023-05-08T12:04:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30000.099167 secs 2023-05-08T12:04:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:21 smithi096 ceph-mon[124666]: osdmap e1081: 12 total, 12 up, 12 in 2023-05-08T12:04:22.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:22 smithi186 ceph-mon[126480]: pgmap v16056: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 415 KiB/s wr, 9 op/s 2023-05-08T12:04:22.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:22 smithi133 ceph-mon[125939]: pgmap v16056: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 415 KiB/s wr, 9 op/s 2023-05-08T12:04:22.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:22 smithi096 ceph-mon[124666]: pgmap v16056: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 415 KiB/s wr, 9 op/s 2023-05-08T12:04:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:24 smithi186 ceph-mon[126480]: pgmap v16057: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 574 KiB/s rd, 404 KiB/s wr, 9 op/s 2023-05-08T12:04:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30003.253718 secs 2023-05-08T12:04:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:24 smithi133 ceph-mon[125939]: pgmap v16057: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 574 KiB/s rd, 404 KiB/s wr, 9 op/s 2023-05-08T12:04:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30003.253718 secs 2023-05-08T12:04:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:24 smithi096 ceph-mon[124666]: pgmap v16057: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 574 KiB/s rd, 404 KiB/s wr, 9 op/s 2023-05-08T12:04:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30003.253718 secs 2023-05-08T12:04:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30003.809420 secs 2023-05-08T12:04:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30003.809420 secs 2023-05-08T12:04:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30003.809420 secs 2023-05-08T12:04:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:26 smithi186 ceph-mon[126480]: pgmap v16058: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 271 KiB/s wr, 7 op/s 2023-05-08T12:04:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30005.099289 secs 2023-05-08T12:04:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:26 smithi133 ceph-mon[125939]: pgmap v16058: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 271 KiB/s wr, 7 op/s 2023-05-08T12:04:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30005.099289 secs 2023-05-08T12:04:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:26 smithi096 ceph-mon[124666]: pgmap v16058: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 271 KiB/s wr, 7 op/s 2023-05-08T12:04:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30005.099289 secs 2023-05-08T12:04:28.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:28 smithi186 ceph-mon[126480]: pgmap v16059: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 271 KiB/s wr, 7 op/s 2023-05-08T12:04:28.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:28 smithi133 ceph-mon[125939]: pgmap v16059: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 271 KiB/s wr, 7 op/s 2023-05-08T12:04:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:28 smithi096 ceph-mon[124666]: pgmap v16059: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 271 KiB/s wr, 7 op/s 2023-05-08T12:04:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30008.253834 secs 2023-05-08T12:04:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30008.253834 secs 2023-05-08T12:04:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30008.253834 secs 2023-05-08T12:04:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:30 smithi186 ceph-mon[126480]: pgmap v16060: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 271 KiB/s wr, 7 op/s 2023-05-08T12:04:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30008.809540 secs 2023-05-08T12:04:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:30 smithi133 ceph-mon[125939]: pgmap v16060: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 271 KiB/s wr, 7 op/s 2023-05-08T12:04:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30008.809540 secs 2023-05-08T12:04:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:30 smithi096 ceph-mon[124666]: pgmap v16060: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 271 KiB/s wr, 7 op/s 2023-05-08T12:04:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30008.809540 secs 2023-05-08T12:04:31.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30010.099410 secs 2023-05-08T12:04:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30010.099410 secs 2023-05-08T12:04:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30010.099410 secs 2023-05-08T12:04:32.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:32 smithi186 ceph-mon[126480]: pgmap v16061: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 108 KiB/s wr, 7 op/s 2023-05-08T12:04:32.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:32 smithi133 ceph-mon[125939]: pgmap v16061: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 108 KiB/s wr, 7 op/s 2023-05-08T12:04:32.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:32 smithi096 ceph-mon[124666]: pgmap v16061: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 108 KiB/s wr, 7 op/s 2023-05-08T12:04:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:34 smithi186 ceph-mon[126480]: pgmap v16062: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 91 KiB/s wr, 5 op/s 2023-05-08T12:04:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30013.253970 secs 2023-05-08T12:04:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:34 smithi133 ceph-mon[125939]: pgmap v16062: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 91 KiB/s wr, 5 op/s 2023-05-08T12:04:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30013.253970 secs 2023-05-08T12:04:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:34 smithi096 ceph-mon[124666]: pgmap v16062: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 91 KiB/s wr, 5 op/s 2023-05-08T12:04:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30013.253970 secs 2023-05-08T12:04:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30013.809616 secs 2023-05-08T12:04:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30013.809616 secs 2023-05-08T12:04:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30013.809616 secs 2023-05-08T12:04:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:36 smithi186 ceph-mon[126480]: pgmap v16063: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 92 KiB/s wr, 8 op/s 2023-05-08T12:04:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30015.099562 secs 2023-05-08T12:04:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:36 smithi133 ceph-mon[125939]: pgmap v16063: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 92 KiB/s wr, 8 op/s 2023-05-08T12:04:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30015.099562 secs 2023-05-08T12:04:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:36 smithi096 ceph-mon[124666]: pgmap v16063: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 92 KiB/s wr, 8 op/s 2023-05-08T12:04:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30015.099562 secs 2023-05-08T12:04:38.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:38 smithi186 ceph-mon[126480]: pgmap v16064: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 91 KiB/s wr, 6 op/s 2023-05-08T12:04:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:38 smithi133 ceph-mon[125939]: pgmap v16064: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 91 KiB/s wr, 6 op/s 2023-05-08T12:04:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:38 smithi096 ceph-mon[124666]: pgmap v16064: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 91 KiB/s wr, 6 op/s 2023-05-08T12:04:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30018.254046 secs 2023-05-08T12:04:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30018.254046 secs 2023-05-08T12:04:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30018.254046 secs 2023-05-08T12:04:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:40 smithi186 ceph-mon[126480]: pgmap v16065: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 91 KiB/s wr, 6 op/s 2023-05-08T12:04:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30018.809754 secs 2023-05-08T12:04:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:40 smithi133 ceph-mon[125939]: pgmap v16065: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 91 KiB/s wr, 6 op/s 2023-05-08T12:04:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30018.809754 secs 2023-05-08T12:04:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:40 smithi096 ceph-mon[124666]: pgmap v16065: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 91 KiB/s wr, 6 op/s 2023-05-08T12:04:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30018.809754 secs 2023-05-08T12:04:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30020.099712 secs 2023-05-08T12:04:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30020.099712 secs 2023-05-08T12:04:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30020.099712 secs 2023-05-08T12:04:42.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:42 smithi186 ceph-mon[126480]: pgmap v16066: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 324 KiB/s wr, 10 op/s 2023-05-08T12:04:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:42 smithi133 ceph-mon[125939]: pgmap v16066: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 324 KiB/s wr, 10 op/s 2023-05-08T12:04:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:42 smithi096 ceph-mon[124666]: pgmap v16066: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 324 KiB/s wr, 10 op/s 2023-05-08T12:04:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:44 smithi186 ceph-mon[126480]: pgmap v16067: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 233 KiB/s wr, 6 op/s 2023-05-08T12:04:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30023.254175 secs 2023-05-08T12:04:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:44 smithi133 ceph-mon[125939]: pgmap v16067: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 233 KiB/s wr, 6 op/s 2023-05-08T12:04:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30023.254175 secs 2023-05-08T12:04:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:44 smithi096 ceph-mon[124666]: pgmap v16067: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 233 KiB/s wr, 6 op/s 2023-05-08T12:04:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30023.254175 secs 2023-05-08T12:04:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30023.809849 secs 2023-05-08T12:04:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30023.809849 secs 2023-05-08T12:04:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30023.809849 secs 2023-05-08T12:04:46.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:46 smithi186 ceph-mon[126480]: pgmap v16068: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 281 KiB/s wr, 10 op/s 2023-05-08T12:04:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:46 smithi133 ceph-mon[125939]: pgmap v16068: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 281 KiB/s wr, 10 op/s 2023-05-08T12:04:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:46 smithi096 ceph-mon[124666]: pgmap v16068: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 281 KiB/s wr, 10 op/s 2023-05-08T12:04:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:48 smithi186 ceph-mon[126480]: pgmap v16069: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 281 KiB/s wr, 7 op/s 2023-05-08T12:04:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:04:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:48 smithi133 ceph-mon[125939]: pgmap v16069: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 281 KiB/s wr, 7 op/s 2023-05-08T12:04:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:04:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:48 smithi096 ceph-mon[124666]: pgmap v16069: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 281 KiB/s wr, 7 op/s 2023-05-08T12:04:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:04:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:04:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:04:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:04:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30028.254254 secs 2023-05-08T12:04:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:04:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:04:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:04:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30028.254254 secs 2023-05-08T12:04:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:04:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:04:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:04:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30028.254254 secs 2023-05-08T12:04:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:50 smithi186 ceph-mon[126480]: pgmap v16070: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 281 KiB/s wr, 7 op/s 2023-05-08T12:04:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30028.809943 secs 2023-05-08T12:04:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:50 smithi133 ceph-mon[125939]: pgmap v16070: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 281 KiB/s wr, 7 op/s 2023-05-08T12:04:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30028.809943 secs 2023-05-08T12:04:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:50 smithi096 ceph-mon[124666]: pgmap v16070: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 281 KiB/s wr, 7 op/s 2023-05-08T12:04:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30028.809943 secs 2023-05-08T12:04:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:51 smithi133 ceph-mon[125939]: pgmap v16071: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 787 KiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T12:04:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:51 smithi096 ceph-mon[124666]: pgmap v16071: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 787 KiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T12:04:52.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:51 smithi186 ceph-mon[126480]: pgmap v16071: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 787 KiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T12:04:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:04:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:04:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:04:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:04:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:04:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:04:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:04:53.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:04:53.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:04:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:04:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:04:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:04:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:53 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:04:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:53 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T12:04:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:53 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T12:04:54.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:53 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:04:54.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:53 smithi133 ceph-mon[125939]: pgmap v16072: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 786 KiB/s rd, 822 KiB/s wr, 7 op/s 2023-05-08T12:04:54.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30033.254348 secs 2023-05-08T12:04:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:53 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:04:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:53 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T12:04:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:53 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T12:04:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:53 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:04:54.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:53 smithi096 ceph-mon[124666]: pgmap v16072: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 786 KiB/s rd, 822 KiB/s wr, 7 op/s 2023-05-08T12:04:54.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30033.254348 secs 2023-05-08T12:04:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:53 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:04:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:53 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T12:04:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:53 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T12:04:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:53 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:04:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:53 smithi186 ceph-mon[126480]: pgmap v16072: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 786 KiB/s rd, 822 KiB/s wr, 7 op/s 2023-05-08T12:04:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30033.254348 secs 2023-05-08T12:04:56.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:56 smithi186 ceph-mon[126480]: pgmap v16073: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.0 MiB/s wr, 12 op/s 2023-05-08T12:04:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:56 smithi133 ceph-mon[125939]: pgmap v16073: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.0 MiB/s wr, 12 op/s 2023-05-08T12:04:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:56 smithi096 ceph-mon[124666]: pgmap v16073: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.0 MiB/s wr, 12 op/s 2023-05-08T12:04:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:04:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:04:57.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:04:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:58 smithi186 ceph-mon[126480]: pgmap v16074: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T12:04:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:58 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:04:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:04:58.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:04:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:58 smithi133 ceph-mon[125939]: pgmap v16074: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T12:04:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:58 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:04:58.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:04:58.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:04:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:58 smithi096 ceph-mon[124666]: pgmap v16074: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T12:04:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:58 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:04:58.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:04:58.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:04:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:04:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30038.254486 secs 2023-05-08T12:04:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:04:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30038.254486 secs 2023-05-08T12:04:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:04:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30038.254486 secs 2023-05-08T12:05:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:00 smithi186 ceph-mon[126480]: pgmap v16075: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 9 op/s 2023-05-08T12:05:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:00 smithi133 ceph-mon[125939]: pgmap v16075: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 9 op/s 2023-05-08T12:05:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:00 smithi096 ceph-mon[124666]: pgmap v16075: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 9 op/s 2023-05-08T12:05:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30040.100246 secs 2023-05-08T12:05:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30040.100246 secs 2023-05-08T12:05:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30040.100246 secs 2023-05-08T12:05:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:02 smithi186 ceph-mon[126480]: pgmap v16076: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 16 op/s 2023-05-08T12:05:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:02 smithi133 ceph-mon[125939]: pgmap v16076: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 16 op/s 2023-05-08T12:05:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:02 smithi096 ceph-mon[124666]: pgmap v16076: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 16 op/s 2023-05-08T12:05:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:04 smithi186 ceph-mon[126480]: pgmap v16077: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.0 MiB/s wr, 12 op/s 2023-05-08T12:05:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30043.254607 secs 2023-05-08T12:05:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:04 smithi133 ceph-mon[125939]: pgmap v16077: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.0 MiB/s wr, 12 op/s 2023-05-08T12:05:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30043.254607 secs 2023-05-08T12:05:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:04 smithi096 ceph-mon[124666]: pgmap v16077: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.0 MiB/s wr, 12 op/s 2023-05-08T12:05:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30043.254607 secs 2023-05-08T12:05:05.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30043.810253 secs 2023-05-08T12:05:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30043.810253 secs 2023-05-08T12:05:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30043.810253 secs 2023-05-08T12:05:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:06 smithi186 ceph-mon[126480]: pgmap v16078: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 30 op/s 2023-05-08T12:05:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:06 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:05:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:05:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:05:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:05:06.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30045.100369 secs 2023-05-08T12:05:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:06 smithi133 ceph-mon[125939]: pgmap v16078: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 30 op/s 2023-05-08T12:05:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:06 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:05:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:05:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:05:06.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:05:06.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30045.100369 secs 2023-05-08T12:05:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:06 smithi096 ceph-mon[124666]: pgmap v16078: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 30 op/s 2023-05-08T12:05:06.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:06 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:05:06.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:05:06.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:05:06.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:05:06.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30045.100369 secs 2023-05-08T12:05:08.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:08 smithi186 ceph-mon[126480]: pgmap v16079: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 950 KiB/s rd, 986 KiB/s wr, 27 op/s 2023-05-08T12:05:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:08 smithi133 ceph-mon[125939]: pgmap v16079: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 950 KiB/s rd, 986 KiB/s wr, 27 op/s 2023-05-08T12:05:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:08 smithi096 ceph-mon[124666]: pgmap v16079: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 950 KiB/s rd, 986 KiB/s wr, 27 op/s 2023-05-08T12:05:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30048.254709 secs 2023-05-08T12:05:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30048.254709 secs 2023-05-08T12:05:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30048.254709 secs 2023-05-08T12:05:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:10 smithi186 ceph-mon[126480]: pgmap v16080: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 950 KiB/s rd, 985 KiB/s wr, 26 op/s 2023-05-08T12:05:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30048.810352 secs 2023-05-08T12:05:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:10 smithi133 ceph-mon[125939]: pgmap v16080: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 950 KiB/s rd, 985 KiB/s wr, 26 op/s 2023-05-08T12:05:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30048.810352 secs 2023-05-08T12:05:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:10 smithi096 ceph-mon[124666]: pgmap v16080: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 950 KiB/s rd, 985 KiB/s wr, 26 op/s 2023-05-08T12:05:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30048.810352 secs 2023-05-08T12:05:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30050.100506 secs 2023-05-08T12:05:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30050.100506 secs 2023-05-08T12:05:11.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30050.100506 secs 2023-05-08T12:05:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:12 smithi186 ceph-mon[126480]: pgmap v16081: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 952 KiB/s rd, 1.1 MiB/s wr, 29 op/s 2023-05-08T12:05:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:12 smithi186 ceph-mon[126480]: osdmap e1082: 12 total, 12 up, 12 in 2023-05-08T12:05:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:12 smithi133 ceph-mon[125939]: pgmap v16081: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 952 KiB/s rd, 1.1 MiB/s wr, 29 op/s 2023-05-08T12:05:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:12 smithi133 ceph-mon[125939]: osdmap e1082: 12 total, 12 up, 12 in 2023-05-08T12:05:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:12 smithi096 ceph-mon[124666]: pgmap v16081: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 952 KiB/s rd, 1.1 MiB/s wr, 29 op/s 2023-05-08T12:05:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:12 smithi096 ceph-mon[124666]: osdmap e1082: 12 total, 12 up, 12 in 2023-05-08T12:05:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:14 smithi186 ceph-mon[126480]: pgmap v16083: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 387 KiB/s wr, 27 op/s 2023-05-08T12:05:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30053.254833 secs 2023-05-08T12:05:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:14 smithi133 ceph-mon[125939]: pgmap v16083: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 387 KiB/s wr, 27 op/s 2023-05-08T12:05:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30053.254833 secs 2023-05-08T12:05:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:14 smithi096 ceph-mon[124666]: pgmap v16083: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 387 KiB/s wr, 27 op/s 2023-05-08T12:05:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30053.254833 secs 2023-05-08T12:05:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30053.810489 secs 2023-05-08T12:05:15.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30053.810489 secs 2023-05-08T12:05:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30053.810489 secs 2023-05-08T12:05:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:16 smithi133 ceph-mon[125939]: pgmap v16084: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 139 KiB/s wr, 8 op/s 2023-05-08T12:05:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30055.100583 secs 2023-05-08T12:05:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:16 smithi096 ceph-mon[124666]: pgmap v16084: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 139 KiB/s wr, 8 op/s 2023-05-08T12:05:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30055.100583 secs 2023-05-08T12:05:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:16 smithi186 ceph-mon[126480]: pgmap v16084: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 139 KiB/s wr, 8 op/s 2023-05-08T12:05:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30055.100583 secs 2023-05-08T12:05:18.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:18 smithi133 ceph-mon[125939]: pgmap v16085: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 139 KiB/s wr, 7 op/s 2023-05-08T12:05:18.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:18 smithi096 ceph-mon[124666]: pgmap v16085: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 139 KiB/s wr, 7 op/s 2023-05-08T12:05:18.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:18 smithi186 ceph-mon[126480]: pgmap v16085: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 139 KiB/s wr, 7 op/s 2023-05-08T12:05:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30058.254937 secs 2023-05-08T12:05:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30058.254937 secs 2023-05-08T12:05:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30058.254937 secs 2023-05-08T12:05:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:20 smithi133 ceph-mon[125939]: pgmap v16086: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 139 KiB/s wr, 7 op/s 2023-05-08T12:05:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30058.810628 secs 2023-05-08T12:05:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:20 smithi096 ceph-mon[124666]: pgmap v16086: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 139 KiB/s wr, 7 op/s 2023-05-08T12:05:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30058.810628 secs 2023-05-08T12:05:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:20 smithi186 ceph-mon[126480]: pgmap v16086: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 139 KiB/s wr, 7 op/s 2023-05-08T12:05:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30058.810628 secs 2023-05-08T12:05:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30060.100687 secs 2023-05-08T12:05:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:21 smithi133 ceph-mon[125939]: osdmap e1083: 12 total, 12 up, 12 in 2023-05-08T12:05:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30060.100687 secs 2023-05-08T12:05:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:21 smithi096 ceph-mon[124666]: osdmap e1083: 12 total, 12 up, 12 in 2023-05-08T12:05:21.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30060.100687 secs 2023-05-08T12:05:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:21 smithi186 ceph-mon[126480]: osdmap e1083: 12 total, 12 up, 12 in 2023-05-08T12:05:22.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:22 smithi133 ceph-mon[125939]: pgmap v16088: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 619 B/s wr, 6 op/s 2023-05-08T12:05:22.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:22 smithi096 ceph-mon[124666]: pgmap v16088: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 619 B/s wr, 6 op/s 2023-05-08T12:05:22.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:22 smithi186 ceph-mon[126480]: pgmap v16088: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 619 B/s wr, 6 op/s 2023-05-08T12:05:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:24 smithi133 ceph-mon[125939]: pgmap v16089: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 614 B/s wr, 6 op/s 2023-05-08T12:05:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30063.255074 secs 2023-05-08T12:05:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:24 smithi096 ceph-mon[124666]: pgmap v16089: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 614 B/s wr, 6 op/s 2023-05-08T12:05:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30063.255074 secs 2023-05-08T12:05:24.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:24 smithi186 ceph-mon[126480]: pgmap v16089: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 614 B/s wr, 6 op/s 2023-05-08T12:05:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30063.255074 secs 2023-05-08T12:05:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30063.810745 secs 2023-05-08T12:05:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30063.810745 secs 2023-05-08T12:05:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30063.810745 secs 2023-05-08T12:05:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:26 smithi133 ceph-mon[125939]: pgmap v16090: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T12:05:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30065.100824 secs 2023-05-08T12:05:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:26 smithi096 ceph-mon[124666]: pgmap v16090: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T12:05:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30065.100824 secs 2023-05-08T12:05:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:26 smithi186 ceph-mon[126480]: pgmap v16090: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2023-05-08T12:05:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30065.100824 secs 2023-05-08T12:05:28.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:28 smithi133 ceph-mon[125939]: pgmap v16091: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T12:05:28.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:28 smithi096 ceph-mon[124666]: pgmap v16091: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T12:05:28.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:28 smithi186 ceph-mon[126480]: pgmap v16091: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T12:05:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30068.255195 secs 2023-05-08T12:05:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30068.255195 secs 2023-05-08T12:05:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30068.255195 secs 2023-05-08T12:05:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:30 smithi133 ceph-mon[125939]: pgmap v16092: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T12:05:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30068.810858 secs 2023-05-08T12:05:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:30 smithi096 ceph-mon[124666]: pgmap v16092: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T12:05:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30068.810858 secs 2023-05-08T12:05:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:30 smithi186 ceph-mon[126480]: pgmap v16092: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T12:05:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30068.810858 secs 2023-05-08T12:05:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30070.100910 secs 2023-05-08T12:05:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30070.100910 secs 2023-05-08T12:05:31.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30070.100910 secs 2023-05-08T12:05:32.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:32 smithi133 ceph-mon[125939]: pgmap v16093: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 77 KiB/s wr, 6 op/s 2023-05-08T12:05:32.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:32 smithi096 ceph-mon[124666]: pgmap v16093: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 77 KiB/s wr, 6 op/s 2023-05-08T12:05:32.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:32 smithi186 ceph-mon[126480]: pgmap v16093: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 77 KiB/s wr, 6 op/s 2023-05-08T12:05:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:34 smithi133 ceph-mon[125939]: pgmap v16094: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 65 KiB/s wr, 5 op/s 2023-05-08T12:05:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30073.255311 secs 2023-05-08T12:05:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:34 smithi096 ceph-mon[124666]: pgmap v16094: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 65 KiB/s wr, 5 op/s 2023-05-08T12:05:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30073.255311 secs 2023-05-08T12:05:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:34 smithi186 ceph-mon[126480]: pgmap v16094: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 65 KiB/s wr, 5 op/s 2023-05-08T12:05:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30073.255311 secs 2023-05-08T12:05:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30073.810981 secs 2023-05-08T12:05:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30073.810981 secs 2023-05-08T12:05:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30073.810981 secs 2023-05-08T12:05:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:36 smithi133 ceph-mon[125939]: pgmap v16095: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 345 KiB/s wr, 9 op/s 2023-05-08T12:05:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30075.101034 secs 2023-05-08T12:05:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:36 smithi096 ceph-mon[124666]: pgmap v16095: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 345 KiB/s wr, 9 op/s 2023-05-08T12:05:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30075.101034 secs 2023-05-08T12:05:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:36 smithi186 ceph-mon[126480]: pgmap v16095: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 345 KiB/s wr, 9 op/s 2023-05-08T12:05:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30075.101034 secs 2023-05-08T12:05:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:38 smithi133 ceph-mon[125939]: pgmap v16096: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 345 KiB/s wr, 7 op/s 2023-05-08T12:05:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:38 smithi096 ceph-mon[124666]: pgmap v16096: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 345 KiB/s wr, 7 op/s 2023-05-08T12:05:38.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:38 smithi186 ceph-mon[126480]: pgmap v16096: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 345 KiB/s wr, 7 op/s 2023-05-08T12:05:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30078.255436 secs 2023-05-08T12:05:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30078.255436 secs 2023-05-08T12:05:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30078.255436 secs 2023-05-08T12:05:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:40 smithi133 ceph-mon[125939]: pgmap v16097: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 345 KiB/s wr, 7 op/s 2023-05-08T12:05:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30078.811119 secs 2023-05-08T12:05:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:40 smithi096 ceph-mon[124666]: pgmap v16097: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 345 KiB/s wr, 7 op/s 2023-05-08T12:05:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30078.811119 secs 2023-05-08T12:05:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:40 smithi186 ceph-mon[126480]: pgmap v16097: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 345 KiB/s wr, 7 op/s 2023-05-08T12:05:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30078.811119 secs 2023-05-08T12:05:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30080.101139 secs 2023-05-08T12:05:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30080.101139 secs 2023-05-08T12:05:41.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30080.101139 secs 2023-05-08T12:05:42.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:42 smithi133 ceph-mon[125939]: pgmap v16098: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 346 KiB/s wr, 10 op/s 2023-05-08T12:05:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:42 smithi096 ceph-mon[124666]: pgmap v16098: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 346 KiB/s wr, 10 op/s 2023-05-08T12:05:42.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:42 smithi186 ceph-mon[126480]: pgmap v16098: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 346 KiB/s wr, 10 op/s 2023-05-08T12:05:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:44 smithi133 ceph-mon[125939]: pgmap v16099: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 281 KiB/s wr, 7 op/s 2023-05-08T12:05:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30083.255558 secs 2023-05-08T12:05:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:44 smithi096 ceph-mon[124666]: pgmap v16099: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 281 KiB/s wr, 7 op/s 2023-05-08T12:05:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30083.255558 secs 2023-05-08T12:05:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:44 smithi186 ceph-mon[126480]: pgmap v16099: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 281 KiB/s wr, 7 op/s 2023-05-08T12:05:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30083.255558 secs 2023-05-08T12:05:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30083.811241 secs 2023-05-08T12:05:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30083.811241 secs 2023-05-08T12:05:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30083.811241 secs 2023-05-08T12:05:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:46 smithi133 ceph-mon[125939]: pgmap v16100: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 537 KiB/s rd, 343 KiB/s wr, 10 op/s 2023-05-08T12:05:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:46 smithi096 ceph-mon[124666]: pgmap v16100: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 537 KiB/s rd, 343 KiB/s wr, 10 op/s 2023-05-08T12:05:46.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:46 smithi186 ceph-mon[126480]: pgmap v16100: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 537 KiB/s rd, 343 KiB/s wr, 10 op/s 2023-05-08T12:05:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:48 smithi133 ceph-mon[125939]: pgmap v16101: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 62 KiB/s wr, 7 op/s 2023-05-08T12:05:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:48 smithi096 ceph-mon[124666]: pgmap v16101: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 62 KiB/s wr, 7 op/s 2023-05-08T12:05:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:48 smithi186 ceph-mon[126480]: pgmap v16101: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 62 KiB/s wr, 7 op/s 2023-05-08T12:05:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:05:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30088.255702 secs 2023-05-08T12:05:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:05:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30088.255702 secs 2023-05-08T12:05:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:05:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30088.255702 secs 2023-05-08T12:05:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:50 smithi133 ceph-mon[125939]: pgmap v16102: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T12:05:50.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30088.811356 secs 2023-05-08T12:05:50.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:05:50.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:05:50.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:05:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:50 smithi096 ceph-mon[124666]: pgmap v16102: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T12:05:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30088.811356 secs 2023-05-08T12:05:50.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:05:50.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:05:50.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:05:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:50 smithi186 ceph-mon[126480]: pgmap v16102: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 62 KiB/s wr, 6 op/s 2023-05-08T12:05:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30088.811356 secs 2023-05-08T12:05:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:05:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:05:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:05:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:51 smithi133 ceph-mon[125939]: pgmap v16103: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 883 KiB/s rd, 423 KiB/s wr, 10 op/s 2023-05-08T12:05:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:51 smithi096 ceph-mon[124666]: pgmap v16103: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 883 KiB/s rd, 423 KiB/s wr, 10 op/s 2023-05-08T12:05:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:51 smithi186 ceph-mon[126480]: pgmap v16103: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 883 KiB/s rd, 423 KiB/s wr, 10 op/s 2023-05-08T12:05:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:05:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:05:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:05:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:53 smithi133 ceph-mon[125939]: pgmap v16104: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 648 KiB/s rd, 422 KiB/s wr, 6 op/s 2023-05-08T12:05:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:53 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:05:54.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:53 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:05:54.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:53 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:05:54.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30093.255825 secs 2023-05-08T12:05:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:53 smithi096 ceph-mon[124666]: pgmap v16104: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 648 KiB/s rd, 422 KiB/s wr, 6 op/s 2023-05-08T12:05:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:53 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:05:54.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:53 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:05:54.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:53 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:05:54.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30093.255825 secs 2023-05-08T12:05:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:53 smithi186 ceph-mon[126480]: pgmap v16104: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 648 KiB/s rd, 422 KiB/s wr, 6 op/s 2023-05-08T12:05:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:53 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:05:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:53 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:05:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:53 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:05:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30093.255825 secs 2023-05-08T12:05:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:54 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:05:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:54 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T12:05:55.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:54 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T12:05:55.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:54 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:05:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:54 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:05:55.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:54 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T12:05:55.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:54 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T12:05:55.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:54 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:05:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:54 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:05:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:54 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T12:05:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:54 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T12:05:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:54 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:05:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:55 smithi133 ceph-mon[125939]: pgmap v16105: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 709 KiB/s wr, 10 op/s 2023-05-08T12:05:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:55 smithi096 ceph-mon[124666]: pgmap v16105: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 709 KiB/s wr, 10 op/s 2023-05-08T12:05:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:55 smithi186 ceph-mon[126480]: pgmap v16105: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 709 KiB/s wr, 10 op/s 2023-05-08T12:05:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:05:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:05:57.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:05:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:57 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:05:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:05:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:05:58.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:57 smithi133 ceph-mon[125939]: pgmap v16106: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 945 KiB/s rd, 647 KiB/s wr, 8 op/s 2023-05-08T12:05:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:57 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:05:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:05:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:05:58.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:57 smithi096 ceph-mon[124666]: pgmap v16106: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 945 KiB/s rd, 647 KiB/s wr, 8 op/s 2023-05-08T12:05:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:57 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:05:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:05:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:05:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:57 smithi186 ceph-mon[126480]: pgmap v16106: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 945 KiB/s rd, 647 KiB/s wr, 8 op/s 2023-05-08T12:05:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30098.255942 secs 2023-05-08T12:05:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30098.255942 secs 2023-05-08T12:05:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30098.255942 secs 2023-05-08T12:06:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:05:59 smithi133 ceph-mon[125939]: pgmap v16107: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 945 KiB/s rd, 647 KiB/s wr, 8 op/s 2023-05-08T12:06:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:05:59 smithi096 ceph-mon[124666]: pgmap v16107: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 945 KiB/s rd, 647 KiB/s wr, 8 op/s 2023-05-08T12:06:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:05:59 smithi186 ceph-mon[126480]: pgmap v16107: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 945 KiB/s rd, 647 KiB/s wr, 8 op/s 2023-05-08T12:06:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30098.811630 secs 2023-05-08T12:06:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30098.811630 secs 2023-05-08T12:06:01.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30098.811630 secs 2023-05-08T12:06:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:06:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:06:02.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:01 smithi133 ceph-mon[125939]: pgmap v16108: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 15 op/s 2023-05-08T12:06:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:06:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:06:02.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:01 smithi096 ceph-mon[124666]: pgmap v16108: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 15 op/s 2023-05-08T12:06:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:06:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:06:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:01 smithi186 ceph-mon[126480]: pgmap v16108: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 15 op/s 2023-05-08T12:06:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:04 smithi186 ceph-mon[126480]: pgmap v16109: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 858 KiB/s rd, 727 KiB/s wr, 11 op/s 2023-05-08T12:06:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30103.256066 secs 2023-05-08T12:06:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:04 smithi133 ceph-mon[125939]: pgmap v16109: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 858 KiB/s rd, 727 KiB/s wr, 11 op/s 2023-05-08T12:06:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30103.256066 secs 2023-05-08T12:06:04.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:04 smithi096 ceph-mon[124666]: pgmap v16109: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 858 KiB/s rd, 727 KiB/s wr, 11 op/s 2023-05-08T12:06:04.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30103.256066 secs 2023-05-08T12:06:05.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:05 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:06:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:05 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:06:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:05 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:06:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:06 smithi186 ceph-mon[126480]: pgmap v16110: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1012 KiB/s wr, 17 op/s 2023-05-08T12:06:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:06 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:06:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:06:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:06:06.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30105.101731 secs 2023-05-08T12:06:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:06 smithi133 ceph-mon[125939]: pgmap v16110: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1012 KiB/s wr, 17 op/s 2023-05-08T12:06:06.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:06 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:06:06.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:06:06.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:06:06.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30105.101731 secs 2023-05-08T12:06:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:06 smithi096 ceph-mon[124666]: pgmap v16110: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1012 KiB/s wr, 17 op/s 2023-05-08T12:06:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:06 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:06:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:06:06.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:06:06.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30105.101731 secs 2023-05-08T12:06:08.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:08 smithi186 ceph-mon[126480]: pgmap v16111: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 740 KiB/s rd, 726 KiB/s wr, 14 op/s 2023-05-08T12:06:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:08 smithi133 ceph-mon[125939]: pgmap v16111: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 740 KiB/s rd, 726 KiB/s wr, 14 op/s 2023-05-08T12:06:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:08 smithi096 ceph-mon[124666]: pgmap v16111: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 740 KiB/s rd, 726 KiB/s wr, 14 op/s 2023-05-08T12:06:09.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30108.256183 secs 2023-05-08T12:06:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30108.256183 secs 2023-05-08T12:06:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30108.256183 secs 2023-05-08T12:06:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:10 smithi186 ceph-mon[126480]: pgmap v16112: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 721 KiB/s rd, 726 KiB/s wr, 13 op/s 2023-05-08T12:06:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30108.811848 secs 2023-05-08T12:06:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:10 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:06:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:10 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:06:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:10 smithi133 ceph-mon[125939]: pgmap v16112: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 721 KiB/s rd, 726 KiB/s wr, 13 op/s 2023-05-08T12:06:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30108.811848 secs 2023-05-08T12:06:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:10 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:06:10.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:10 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:06:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:10 smithi096 ceph-mon[124666]: pgmap v16112: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 721 KiB/s rd, 726 KiB/s wr, 13 op/s 2023-05-08T12:06:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30108.811848 secs 2023-05-08T12:06:10.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:10 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:06:10.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:10 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:06:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30110.101850 secs 2023-05-08T12:06:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:11 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:06:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30110.101850 secs 2023-05-08T12:06:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:11 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:06:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30110.101850 secs 2023-05-08T12:06:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:11 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:06:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:12 smithi186 ceph-mon[126480]: pgmap v16113: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 31 op/s 2023-05-08T12:06:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:12 smithi186 ceph-mon[126480]: osdmap e1084: 12 total, 12 up, 12 in 2023-05-08T12:06:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:12 smithi133 ceph-mon[125939]: pgmap v16113: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 31 op/s 2023-05-08T12:06:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:12 smithi133 ceph-mon[125939]: osdmap e1084: 12 total, 12 up, 12 in 2023-05-08T12:06:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:12 smithi096 ceph-mon[124666]: pgmap v16113: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 31 op/s 2023-05-08T12:06:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:12 smithi096 ceph-mon[124666]: osdmap e1084: 12 total, 12 up, 12 in 2023-05-08T12:06:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:14 smithi186 ceph-mon[126480]: pgmap v16115: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 758 KiB/s rd, 782 KiB/s wr, 30 op/s 2023-05-08T12:06:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:14 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:06:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:14 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:06:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30113.256308 secs 2023-05-08T12:06:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:14 smithi133 ceph-mon[125939]: pgmap v16115: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 758 KiB/s rd, 782 KiB/s wr, 30 op/s 2023-05-08T12:06:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:14 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:06:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:14 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:06:14.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30113.256308 secs 2023-05-08T12:06:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:14 smithi096 ceph-mon[124666]: pgmap v16115: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 758 KiB/s rd, 782 KiB/s wr, 30 op/s 2023-05-08T12:06:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:14 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:06:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:14 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:06:14.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30113.256308 secs 2023-05-08T12:06:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30113.811971 secs 2023-05-08T12:06:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30113.811971 secs 2023-05-08T12:06:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30113.811971 secs 2023-05-08T12:06:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:16 smithi133 ceph-mon[125939]: pgmap v16116: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 592 KiB/s rd, 596 KiB/s wr, 27 op/s 2023-05-08T12:06:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30115.101970 secs 2023-05-08T12:06:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:16 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:06:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:16 smithi096 ceph-mon[124666]: pgmap v16116: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 592 KiB/s rd, 596 KiB/s wr, 27 op/s 2023-05-08T12:06:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30115.101970 secs 2023-05-08T12:06:16.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:16 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:06:16.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:16 smithi186 ceph-mon[126480]: pgmap v16116: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 592 KiB/s rd, 596 KiB/s wr, 27 op/s 2023-05-08T12:06:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30115.101970 secs 2023-05-08T12:06:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:16 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:06:18.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:18 smithi133 ceph-mon[125939]: pgmap v16117: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 575 KiB/s rd, 596 KiB/s wr, 27 op/s 2023-05-08T12:06:18.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:18 smithi096 ceph-mon[124666]: pgmap v16117: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 575 KiB/s rd, 596 KiB/s wr, 27 op/s 2023-05-08T12:06:18.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:18 smithi186 ceph-mon[126480]: pgmap v16117: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 575 KiB/s rd, 596 KiB/s wr, 27 op/s 2023-05-08T12:06:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30118.256424 secs 2023-05-08T12:06:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30118.256424 secs 2023-05-08T12:06:19.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30118.256424 secs 2023-05-08T12:06:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:20 smithi133 ceph-mon[125939]: pgmap v16118: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 575 KiB/s rd, 596 KiB/s wr, 27 op/s 2023-05-08T12:06:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30118.812087 secs 2023-05-08T12:06:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:20 smithi096 ceph-mon[124666]: pgmap v16118: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 575 KiB/s rd, 596 KiB/s wr, 27 op/s 2023-05-08T12:06:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30118.812087 secs 2023-05-08T12:06:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:20 smithi186 ceph-mon[126480]: pgmap v16118: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 575 KiB/s rd, 596 KiB/s wr, 27 op/s 2023-05-08T12:06:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30118.812087 secs 2023-05-08T12:06:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30120.102089 secs 2023-05-08T12:06:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:21 smithi133 ceph-mon[125939]: osdmap e1085: 12 total, 12 up, 12 in 2023-05-08T12:06:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30120.102089 secs 2023-05-08T12:06:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:21 smithi096 ceph-mon[124666]: osdmap e1085: 12 total, 12 up, 12 in 2023-05-08T12:06:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30120.102089 secs 2023-05-08T12:06:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:21 smithi186 ceph-mon[126480]: osdmap e1085: 12 total, 12 up, 12 in 2023-05-08T12:06:22.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:22 smithi133 ceph-mon[125939]: pgmap v16120: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 412 KiB/s wr, 9 op/s 2023-05-08T12:06:22.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:22 smithi096 ceph-mon[124666]: pgmap v16120: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 412 KiB/s wr, 9 op/s 2023-05-08T12:06:22.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:22 smithi186 ceph-mon[126480]: pgmap v16120: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 412 KiB/s wr, 9 op/s 2023-05-08T12:06:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:24 smithi133 ceph-mon[125939]: pgmap v16121: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 409 KiB/s wr, 9 op/s 2023-05-08T12:06:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30123.256567 secs 2023-05-08T12:06:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:24 smithi096 ceph-mon[124666]: pgmap v16121: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 409 KiB/s wr, 9 op/s 2023-05-08T12:06:24.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30123.256567 secs 2023-05-08T12:06:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:24 smithi186 ceph-mon[126480]: pgmap v16121: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 409 KiB/s wr, 9 op/s 2023-05-08T12:06:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30123.256567 secs 2023-05-08T12:06:25.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30123.812206 secs 2023-05-08T12:06:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30123.812206 secs 2023-05-08T12:06:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30123.812206 secs 2023-05-08T12:06:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:26 smithi133 ceph-mon[125939]: pgmap v16122: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 255 KiB/s rd, 252 KiB/s wr, 7 op/s 2023-05-08T12:06:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30125.102199 secs 2023-05-08T12:06:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:26 smithi096 ceph-mon[124666]: pgmap v16122: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 255 KiB/s rd, 252 KiB/s wr, 7 op/s 2023-05-08T12:06:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30125.102199 secs 2023-05-08T12:06:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:26 smithi186 ceph-mon[126480]: pgmap v16122: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 255 KiB/s rd, 252 KiB/s wr, 7 op/s 2023-05-08T12:06:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30125.102199 secs 2023-05-08T12:06:28.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:28 smithi133 ceph-mon[125939]: pgmap v16123: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 255 KiB/s rd, 252 KiB/s wr, 6 op/s 2023-05-08T12:06:28.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:28 smithi096 ceph-mon[124666]: pgmap v16123: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 255 KiB/s rd, 252 KiB/s wr, 6 op/s 2023-05-08T12:06:28.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:28 smithi186 ceph-mon[126480]: pgmap v16123: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 255 KiB/s rd, 252 KiB/s wr, 6 op/s 2023-05-08T12:06:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30128.256681 secs 2023-05-08T12:06:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30128.256681 secs 2023-05-08T12:06:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30128.256681 secs 2023-05-08T12:06:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:30 smithi133 ceph-mon[125939]: pgmap v16124: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 255 KiB/s rd, 252 KiB/s wr, 6 op/s 2023-05-08T12:06:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30128.812329 secs 2023-05-08T12:06:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:30 smithi096 ceph-mon[124666]: pgmap v16124: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 255 KiB/s rd, 252 KiB/s wr, 6 op/s 2023-05-08T12:06:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30128.812329 secs 2023-05-08T12:06:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:30 smithi186 ceph-mon[126480]: pgmap v16124: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 255 KiB/s rd, 252 KiB/s wr, 6 op/s 2023-05-08T12:06:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30128.812329 secs 2023-05-08T12:06:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30130.102304 secs 2023-05-08T12:06:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30130.102304 secs 2023-05-08T12:06:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30130.102304 secs 2023-05-08T12:06:32.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:32 smithi133 ceph-mon[125939]: pgmap v16125: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T12:06:32.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:32 smithi096 ceph-mon[124666]: pgmap v16125: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T12:06:32.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:32 smithi186 ceph-mon[126480]: pgmap v16125: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T12:06:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:34 smithi133 ceph-mon[125939]: pgmap v16126: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T12:06:34.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30133.256807 secs 2023-05-08T12:06:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:34 smithi096 ceph-mon[124666]: pgmap v16126: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T12:06:34.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30133.256807 secs 2023-05-08T12:06:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:34 smithi186 ceph-mon[126480]: pgmap v16126: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T12:06:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30133.256807 secs 2023-05-08T12:06:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30133.812457 secs 2023-05-08T12:06:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30133.812457 secs 2023-05-08T12:06:35.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30133.812457 secs 2023-05-08T12:06:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:36 smithi133 ceph-mon[125939]: pgmap v16127: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 7 op/s 2023-05-08T12:06:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30135.102439 secs 2023-05-08T12:06:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:36 smithi096 ceph-mon[124666]: pgmap v16127: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 7 op/s 2023-05-08T12:06:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30135.102439 secs 2023-05-08T12:06:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:36 smithi186 ceph-mon[126480]: pgmap v16127: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 7 op/s 2023-05-08T12:06:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30135.102439 secs 2023-05-08T12:06:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:38 smithi133 ceph-mon[125939]: pgmap v16128: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T12:06:38.564 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:38 smithi096 ceph-mon[124666]: pgmap v16128: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T12:06:38.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:38 smithi186 ceph-mon[126480]: pgmap v16128: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T12:06:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30138.256917 secs 2023-05-08T12:06:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30138.256917 secs 2023-05-08T12:06:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30138.256917 secs 2023-05-08T12:06:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:40 smithi133 ceph-mon[125939]: pgmap v16129: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T12:06:40.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30138.812549 secs 2023-05-08T12:06:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:40 smithi096 ceph-mon[124666]: pgmap v16129: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T12:06:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30138.812549 secs 2023-05-08T12:06:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:40 smithi186 ceph-mon[126480]: pgmap v16129: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 5 op/s 2023-05-08T12:06:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30138.812549 secs 2023-05-08T12:06:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30140.102515 secs 2023-05-08T12:06:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30140.102515 secs 2023-05-08T12:06:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30140.102515 secs 2023-05-08T12:06:42.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:42 smithi133 ceph-mon[125939]: pgmap v16130: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 117 KiB/s wr, 8 op/s 2023-05-08T12:06:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:42 smithi096 ceph-mon[124666]: pgmap v16130: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 117 KiB/s wr, 8 op/s 2023-05-08T12:06:42.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:42 smithi186 ceph-mon[126480]: pgmap v16130: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 117 KiB/s wr, 8 op/s 2023-05-08T12:06:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:44 smithi133 ceph-mon[125939]: pgmap v16131: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 117 KiB/s wr, 6 op/s 2023-05-08T12:06:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30143.257025 secs 2023-05-08T12:06:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:44 smithi096 ceph-mon[124666]: pgmap v16131: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 117 KiB/s wr, 6 op/s 2023-05-08T12:06:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30143.257025 secs 2023-05-08T12:06:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:44 smithi186 ceph-mon[126480]: pgmap v16131: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 117 KiB/s wr, 6 op/s 2023-05-08T12:06:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30143.257025 secs 2023-05-08T12:06:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30143.812657 secs 2023-05-08T12:06:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30143.812657 secs 2023-05-08T12:06:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30143.812657 secs 2023-05-08T12:06:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:46 smithi133 ceph-mon[125939]: pgmap v16132: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 125 KiB/s wr, 10 op/s 2023-05-08T12:06:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:46 smithi096 ceph-mon[124666]: pgmap v16132: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 125 KiB/s wr, 10 op/s 2023-05-08T12:06:46.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:46 smithi186 ceph-mon[126480]: pgmap v16132: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 125 KiB/s wr, 10 op/s 2023-05-08T12:06:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:48 smithi133 ceph-mon[125939]: pgmap v16133: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 124 KiB/s wr, 7 op/s 2023-05-08T12:06:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:48 smithi096 ceph-mon[124666]: pgmap v16133: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 124 KiB/s wr, 7 op/s 2023-05-08T12:06:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:48 smithi186 ceph-mon[126480]: pgmap v16133: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 124 KiB/s wr, 7 op/s 2023-05-08T12:06:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:06:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30148.257148 secs 2023-05-08T12:06:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:06:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30148.257148 secs 2023-05-08T12:06:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:06:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30148.257148 secs 2023-05-08T12:06:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:50 smithi133 ceph-mon[125939]: pgmap v16134: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 124 KiB/s wr, 7 op/s 2023-05-08T12:06:50.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30148.812720 secs 2023-05-08T12:06:50.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:06:50.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:06:50.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:06:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:50 smithi096 ceph-mon[124666]: pgmap v16134: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 124 KiB/s wr, 7 op/s 2023-05-08T12:06:50.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30148.812720 secs 2023-05-08T12:06:50.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:06:50.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:06:50.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:06:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:50 smithi186 ceph-mon[126480]: pgmap v16134: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 124 KiB/s wr, 7 op/s 2023-05-08T12:06:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30148.812720 secs 2023-05-08T12:06:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:06:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:06:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:06:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:51 smithi133 ceph-mon[125939]: pgmap v16135: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 495 KiB/s rd, 807 KiB/s wr, 11 op/s 2023-05-08T12:06:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:51 smithi096 ceph-mon[124666]: pgmap v16135: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 495 KiB/s rd, 807 KiB/s wr, 11 op/s 2023-05-08T12:06:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:51 smithi186 ceph-mon[126480]: pgmap v16135: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 495 KiB/s rd, 807 KiB/s wr, 11 op/s 2023-05-08T12:06:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:54 smithi186 ceph-mon[126480]: pgmap v16136: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 494 KiB/s rd, 691 KiB/s wr, 7 op/s 2023-05-08T12:06:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30153.257268 secs 2023-05-08T12:06:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:06:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:06:54.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:06:54.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:06:54.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:06:54.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:06:54.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:06:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:54 smithi133 ceph-mon[125939]: pgmap v16136: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 494 KiB/s rd, 691 KiB/s wr, 7 op/s 2023-05-08T12:06:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30153.257268 secs 2023-05-08T12:06:54.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:06:54.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:06:54.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:06:54.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:06:54.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:06:54.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:06:54.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:06:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:54 smithi096 ceph-mon[124666]: pgmap v16136: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 494 KiB/s rd, 691 KiB/s wr, 7 op/s 2023-05-08T12:06:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30153.257268 secs 2023-05-08T12:06:54.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:06:54.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:06:54.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:06:54.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:06:54.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:06:54.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:06:54.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:06:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:55 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:06:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:55 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:06:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:55 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:06:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:55 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:06:55.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:55 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:06:55.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:55 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:06:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:55 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:06:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:55 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:06:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:55 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:06:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:56 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:06:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:56 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T12:06:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:56 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T12:06:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:56 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:06:56.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:56 smithi186 ceph-mon[126480]: pgmap v16137: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 641 KiB/s rd, 832 KiB/s wr, 12 op/s 2023-05-08T12:06:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:56 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:06:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:56 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T12:06:56.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:56 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T12:06:56.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:56 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:06:56.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:56 smithi133 ceph-mon[125939]: pgmap v16137: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 641 KiB/s rd, 832 KiB/s wr, 12 op/s 2023-05-08T12:06:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:56 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:06:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:56 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T12:06:56.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:56 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T12:06:56.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:56 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:06:56.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:56 smithi096 ceph-mon[124666]: pgmap v16137: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 641 KiB/s rd, 832 KiB/s wr, 12 op/s 2023-05-08T12:06:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:06:57.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:06:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:06:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:58 smithi186 ceph-mon[126480]: pgmap v16138: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 849 KiB/s rd, 824 KiB/s wr, 9 op/s 2023-05-08T12:06:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:58 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:06:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:06:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:06:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:58 smithi133 ceph-mon[125939]: pgmap v16138: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 849 KiB/s rd, 824 KiB/s wr, 9 op/s 2023-05-08T12:06:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:58 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:06:58.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:06:58.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:06:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:58 smithi096 ceph-mon[124666]: pgmap v16138: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 849 KiB/s rd, 824 KiB/s wr, 9 op/s 2023-05-08T12:06:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:58 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:06:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:06:58.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:06:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:06:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30158.257381 secs 2023-05-08T12:06:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:06:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30158.257381 secs 2023-05-08T12:06:59.509 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:06:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30158.257381 secs 2023-05-08T12:07:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:00 smithi186 ceph-mon[126480]: pgmap v16139: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 849 KiB/s rd, 824 KiB/s wr, 9 op/s 2023-05-08T12:07:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30158.812918 secs 2023-05-08T12:07:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:00 smithi133 ceph-mon[125939]: pgmap v16139: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 849 KiB/s rd, 824 KiB/s wr, 9 op/s 2023-05-08T12:07:00.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30158.812918 secs 2023-05-08T12:07:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:00 smithi096 ceph-mon[124666]: pgmap v16139: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 849 KiB/s rd, 824 KiB/s wr, 9 op/s 2023-05-08T12:07:00.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30158.812918 secs 2023-05-08T12:07:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:02 smithi186 ceph-mon[126480]: pgmap v16140: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 15 op/s 2023-05-08T12:07:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:07:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:07:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:02 smithi133 ceph-mon[125939]: pgmap v16140: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 15 op/s 2023-05-08T12:07:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:07:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:07:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:02 smithi096 ceph-mon[124666]: pgmap v16140: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 15 op/s 2023-05-08T12:07:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:07:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:07:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:04 smithi186 ceph-mon[126480]: pgmap v16141: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 926 KiB/s rd, 567 KiB/s wr, 11 op/s 2023-05-08T12:07:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30163.257539 secs 2023-05-08T12:07:04.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:04 smithi133 ceph-mon[125939]: pgmap v16141: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 926 KiB/s rd, 567 KiB/s wr, 11 op/s 2023-05-08T12:07:04.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30163.257539 secs 2023-05-08T12:07:04.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:04 smithi096 ceph-mon[124666]: pgmap v16141: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 926 KiB/s rd, 567 KiB/s wr, 11 op/s 2023-05-08T12:07:04.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30163.257539 secs 2023-05-08T12:07:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:05 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:07:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:05 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:07:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:05 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:07:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:06 smithi133 ceph-mon[125939]: pgmap v16142: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 766 KiB/s wr, 17 op/s 2023-05-08T12:07:06.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:06 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:07:06.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:07:06.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:07:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:06 smithi096 ceph-mon[124666]: pgmap v16142: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 766 KiB/s wr, 17 op/s 2023-05-08T12:07:06.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:06 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:07:06.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:07:06.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:07:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:06 smithi186 ceph-mon[126480]: pgmap v16142: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 766 KiB/s wr, 17 op/s 2023-05-08T12:07:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:06 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:07:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:07:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:07:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:08 smithi133 ceph-mon[125939]: pgmap v16143: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 625 KiB/s wr, 13 op/s 2023-05-08T12:07:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:08 smithi096 ceph-mon[124666]: pgmap v16143: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 625 KiB/s wr, 13 op/s 2023-05-08T12:07:08.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:08 smithi186 ceph-mon[126480]: pgmap v16143: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 625 KiB/s wr, 13 op/s 2023-05-08T12:07:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30168.257657 secs 2023-05-08T12:07:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30168.257657 secs 2023-05-08T12:07:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30168.257657 secs 2023-05-08T12:07:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:10 smithi133 ceph-mon[125939]: pgmap v16144: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 698 KiB/s rd, 625 KiB/s wr, 12 op/s 2023-05-08T12:07:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30168.813103 secs 2023-05-08T12:07:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:10 smithi096 ceph-mon[124666]: pgmap v16144: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 698 KiB/s rd, 625 KiB/s wr, 12 op/s 2023-05-08T12:07:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30168.813103 secs 2023-05-08T12:07:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:10 smithi186 ceph-mon[126480]: pgmap v16144: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 698 KiB/s rd, 625 KiB/s wr, 12 op/s 2023-05-08T12:07:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30168.813103 secs 2023-05-08T12:07:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30170.103169 secs 2023-05-08T12:07:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30170.103169 secs 2023-05-08T12:07:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30170.103169 secs 2023-05-08T12:07:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:12 smithi133 ceph-mon[125939]: pgmap v16145: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 965 KiB/s wr, 31 op/s 2023-05-08T12:07:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:12 smithi133 ceph-mon[125939]: osdmap e1086: 12 total, 12 up, 12 in 2023-05-08T12:07:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:12 smithi096 ceph-mon[124666]: pgmap v16145: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 965 KiB/s wr, 31 op/s 2023-05-08T12:07:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:12 smithi096 ceph-mon[124666]: osdmap e1086: 12 total, 12 up, 12 in 2023-05-08T12:07:12.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:12 smithi186 ceph-mon[126480]: pgmap v16145: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 965 KiB/s wr, 31 op/s 2023-05-08T12:07:12.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:12 smithi186 ceph-mon[126480]: osdmap e1086: 12 total, 12 up, 12 in 2023-05-08T12:07:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:13 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:07:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:07:13.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:07:13.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:13 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:07:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:13 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:07:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:07:13.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:07:13.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:13 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:07:13.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:13 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:07:13.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:07:13.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:07:13.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:13 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:07:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:14 smithi133 ceph-mon[125939]: pgmap v16147: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 761 KiB/s rd, 647 KiB/s wr, 30 op/s 2023-05-08T12:07:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30173.257785 secs 2023-05-08T12:07:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:14 smithi096 ceph-mon[124666]: pgmap v16147: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 761 KiB/s rd, 647 KiB/s wr, 30 op/s 2023-05-08T12:07:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30173.257785 secs 2023-05-08T12:07:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:14 smithi186 ceph-mon[126480]: pgmap v16147: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 761 KiB/s rd, 647 KiB/s wr, 30 op/s 2023-05-08T12:07:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30173.257785 secs 2023-05-08T12:07:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30173.813224 secs 2023-05-08T12:07:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30173.813224 secs 2023-05-08T12:07:15.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30173.813224 secs 2023-05-08T12:07:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:16 smithi133 ceph-mon[125939]: pgmap v16148: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 607 KiB/s rd, 566 KiB/s wr, 26 op/s 2023-05-08T12:07:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30175.103296 secs 2023-05-08T12:07:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:16 smithi096 ceph-mon[124666]: pgmap v16148: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 607 KiB/s rd, 566 KiB/s wr, 26 op/s 2023-05-08T12:07:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30175.103296 secs 2023-05-08T12:07:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:16 smithi186 ceph-mon[126480]: pgmap v16148: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 607 KiB/s rd, 566 KiB/s wr, 26 op/s 2023-05-08T12:07:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30175.103296 secs 2023-05-08T12:07:18.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:18 smithi133 ceph-mon[125939]: pgmap v16149: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 607 KiB/s rd, 566 KiB/s wr, 26 op/s 2023-05-08T12:07:18.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:18 smithi096 ceph-mon[124666]: pgmap v16149: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 607 KiB/s rd, 566 KiB/s wr, 26 op/s 2023-05-08T12:07:18.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:18 smithi186 ceph-mon[126480]: pgmap v16149: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 607 KiB/s rd, 566 KiB/s wr, 26 op/s 2023-05-08T12:07:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30178.257854 secs 2023-05-08T12:07:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30178.257854 secs 2023-05-08T12:07:19.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30178.257854 secs 2023-05-08T12:07:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:20 smithi133 ceph-mon[125939]: pgmap v16150: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 607 KiB/s rd, 566 KiB/s wr, 26 op/s 2023-05-08T12:07:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30178.813304 secs 2023-05-08T12:07:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:20 smithi096 ceph-mon[124666]: pgmap v16150: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 607 KiB/s rd, 566 KiB/s wr, 26 op/s 2023-05-08T12:07:20.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30178.813304 secs 2023-05-08T12:07:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:20 smithi186 ceph-mon[126480]: pgmap v16150: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 607 KiB/s rd, 566 KiB/s wr, 26 op/s 2023-05-08T12:07:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30178.813304 secs 2023-05-08T12:07:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30180.103417 secs 2023-05-08T12:07:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:21 smithi133 ceph-mon[125939]: osdmap e1087: 12 total, 12 up, 12 in 2023-05-08T12:07:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30180.103417 secs 2023-05-08T12:07:21.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:21 smithi096 ceph-mon[124666]: osdmap e1087: 12 total, 12 up, 12 in 2023-05-08T12:07:21.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30180.103417 secs 2023-05-08T12:07:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:21 smithi186 ceph-mon[126480]: osdmap e1087: 12 total, 12 up, 12 in 2023-05-08T12:07:22.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:22 smithi133 ceph-mon[125939]: pgmap v16152: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 414 KiB/s wr, 8 op/s 2023-05-08T12:07:22.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:22 smithi096 ceph-mon[124666]: pgmap v16152: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 414 KiB/s wr, 8 op/s 2023-05-08T12:07:22.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:22 smithi186 ceph-mon[126480]: pgmap v16152: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 414 KiB/s wr, 8 op/s 2023-05-08T12:07:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:24 smithi133 ceph-mon[125939]: pgmap v16153: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 410 KiB/s wr, 8 op/s 2023-05-08T12:07:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30183.257965 secs 2023-05-08T12:07:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:24 smithi096 ceph-mon[124666]: pgmap v16153: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 410 KiB/s wr, 8 op/s 2023-05-08T12:07:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30183.257965 secs 2023-05-08T12:07:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:24 smithi186 ceph-mon[126480]: pgmap v16153: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 410 KiB/s wr, 8 op/s 2023-05-08T12:07:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30183.257965 secs 2023-05-08T12:07:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30183.813439 secs 2023-05-08T12:07:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30183.813439 secs 2023-05-08T12:07:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30183.813439 secs 2023-05-08T12:07:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:26 smithi096 ceph-mon[124666]: pgmap v16154: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 253 KiB/s wr, 6 op/s 2023-05-08T12:07:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30185.103556 secs 2023-05-08T12:07:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:26 smithi186 ceph-mon[126480]: pgmap v16154: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 253 KiB/s wr, 6 op/s 2023-05-08T12:07:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30185.103556 secs 2023-05-08T12:07:26.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:26 smithi133 ceph-mon[125939]: pgmap v16154: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 253 KiB/s wr, 6 op/s 2023-05-08T12:07:26.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30185.103556 secs 2023-05-08T12:07:28.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:28 smithi096 ceph-mon[124666]: pgmap v16155: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 253 KiB/s wr, 6 op/s 2023-05-08T12:07:28.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:28 smithi186 ceph-mon[126480]: pgmap v16155: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 253 KiB/s wr, 6 op/s 2023-05-08T12:07:28.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:28 smithi133 ceph-mon[125939]: pgmap v16155: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 253 KiB/s wr, 6 op/s 2023-05-08T12:07:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30188.258103 secs 2023-05-08T12:07:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30188.258103 secs 2023-05-08T12:07:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30188.258103 secs 2023-05-08T12:07:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:30 smithi186 ceph-mon[126480]: pgmap v16156: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 253 KiB/s wr, 6 op/s 2023-05-08T12:07:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30188.813573 secs 2023-05-08T12:07:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:30 smithi133 ceph-mon[125939]: pgmap v16156: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 253 KiB/s wr, 6 op/s 2023-05-08T12:07:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30188.813573 secs 2023-05-08T12:07:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:30 smithi096 ceph-mon[124666]: pgmap v16156: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 253 KiB/s wr, 6 op/s 2023-05-08T12:07:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30188.813573 secs 2023-05-08T12:07:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30190.103699 secs 2023-05-08T12:07:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30190.103699 secs 2023-05-08T12:07:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30190.103699 secs 2023-05-08T12:07:32.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:32 smithi186 ceph-mon[126480]: pgmap v16157: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-05-08T12:07:32.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:32 smithi133 ceph-mon[125939]: pgmap v16157: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-05-08T12:07:32.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:32 smithi096 ceph-mon[124666]: pgmap v16157: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-05-08T12:07:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:34 smithi186 ceph-mon[126480]: pgmap v16158: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T12:07:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30193.258225 secs 2023-05-08T12:07:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:34 smithi133 ceph-mon[125939]: pgmap v16158: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T12:07:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30193.258225 secs 2023-05-08T12:07:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:34 smithi096 ceph-mon[124666]: pgmap v16158: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T12:07:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30193.258225 secs 2023-05-08T12:07:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30193.813691 secs 2023-05-08T12:07:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30193.813691 secs 2023-05-08T12:07:35.759 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30193.813691 secs 2023-05-08T12:07:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:36 smithi186 ceph-mon[126480]: pgmap v16159: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T12:07:36.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30195.103851 secs 2023-05-08T12:07:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:36 smithi133 ceph-mon[125939]: pgmap v16159: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T12:07:36.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30195.103851 secs 2023-05-08T12:07:36.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:36 smithi096 ceph-mon[124666]: pgmap v16159: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T12:07:36.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30195.103851 secs 2023-05-08T12:07:38.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:38 smithi186 ceph-mon[126480]: pgmap v16160: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T12:07:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:38 smithi133 ceph-mon[125939]: pgmap v16160: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T12:07:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:38 smithi096 ceph-mon[124666]: pgmap v16160: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T12:07:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30198.258357 secs 2023-05-08T12:07:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30198.258357 secs 2023-05-08T12:07:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30198.258357 secs 2023-05-08T12:07:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:40 smithi186 ceph-mon[126480]: pgmap v16161: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T12:07:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30198.813766 secs 2023-05-08T12:07:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:40 smithi133 ceph-mon[125939]: pgmap v16161: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T12:07:40.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30198.813766 secs 2023-05-08T12:07:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:40 smithi096 ceph-mon[124666]: pgmap v16161: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-05-08T12:07:40.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30198.813766 secs 2023-05-08T12:07:41.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30200.103969 secs 2023-05-08T12:07:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30200.103969 secs 2023-05-08T12:07:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30200.103969 secs 2023-05-08T12:07:42.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:42 smithi186 ceph-mon[126480]: pgmap v16162: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T12:07:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:42 smithi133 ceph-mon[125939]: pgmap v16162: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T12:07:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:42 smithi096 ceph-mon[124666]: pgmap v16162: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T12:07:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:44 smithi186 ceph-mon[126480]: pgmap v16163: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T12:07:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30203.258481 secs 2023-05-08T12:07:44.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:44 smithi133 ceph-mon[125939]: pgmap v16163: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T12:07:44.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30203.258481 secs 2023-05-08T12:07:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:44 smithi096 ceph-mon[124666]: pgmap v16163: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T12:07:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30203.258481 secs 2023-05-08T12:07:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30203.813887 secs 2023-05-08T12:07:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30203.813887 secs 2023-05-08T12:07:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30203.813887 secs 2023-05-08T12:07:46.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:46 smithi186 ceph-mon[126480]: pgmap v16164: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 351 KiB/s wr, 9 op/s 2023-05-08T12:07:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:46 smithi133 ceph-mon[125939]: pgmap v16164: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 351 KiB/s wr, 9 op/s 2023-05-08T12:07:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:46 smithi096 ceph-mon[124666]: pgmap v16164: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 351 KiB/s wr, 9 op/s 2023-05-08T12:07:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:48 smithi186 ceph-mon[126480]: pgmap v16165: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 351 KiB/s wr, 6 op/s 2023-05-08T12:07:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:48 smithi133 ceph-mon[125939]: pgmap v16165: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 351 KiB/s wr, 6 op/s 2023-05-08T12:07:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:48 smithi096 ceph-mon[124666]: pgmap v16165: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 351 KiB/s wr, 6 op/s 2023-05-08T12:07:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:07:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30208.258589 secs 2023-05-08T12:07:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:07:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30208.258589 secs 2023-05-08T12:07:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:07:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30208.258589 secs 2023-05-08T12:07:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:50 smithi186 ceph-mon[126480]: pgmap v16166: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 351 KiB/s wr, 6 op/s 2023-05-08T12:07:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:07:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:07:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:07:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:50 smithi133 ceph-mon[125939]: pgmap v16166: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 351 KiB/s wr, 6 op/s 2023-05-08T12:07:50.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:07:50.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:07:50.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:07:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:50 smithi096 ceph-mon[124666]: pgmap v16166: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 351 KiB/s wr, 6 op/s 2023-05-08T12:07:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:07:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:07:50.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:07:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:51 smithi133 ceph-mon[125939]: pgmap v16167: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 598 KiB/s rd, 428 KiB/s wr, 11 op/s 2023-05-08T12:07:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:51 smithi096 ceph-mon[124666]: pgmap v16167: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 598 KiB/s rd, 428 KiB/s wr, 11 op/s 2023-05-08T12:07:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:51 smithi186 ceph-mon[126480]: pgmap v16167: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 598 KiB/s rd, 428 KiB/s wr, 11 op/s 2023-05-08T12:07:53.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:07:53.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:07:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:07:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:07:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:07:54.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:53 smithi133 ceph-mon[125939]: pgmap v16168: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 597 KiB/s rd, 427 KiB/s wr, 8 op/s 2023-05-08T12:07:54.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30213.258706 secs 2023-05-08T12:07:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:07:54.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:07:54.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:53 smithi096 ceph-mon[124666]: pgmap v16168: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 597 KiB/s rd, 427 KiB/s wr, 8 op/s 2023-05-08T12:07:54.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30213.258706 secs 2023-05-08T12:07:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:07:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:07:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:53 smithi186 ceph-mon[126480]: pgmap v16168: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 597 KiB/s rd, 427 KiB/s wr, 8 op/s 2023-05-08T12:07:54.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30213.258706 secs 2023-05-08T12:07:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:07:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:07:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:07:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:55 smithi133 ceph-mon[125939]: pgmap v16169: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 13 op/s 2023-05-08T12:07:56.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:55 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:07:56.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:55 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:07:56.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:55 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:07:56.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:55 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:07:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:55 smithi096 ceph-mon[124666]: pgmap v16169: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 13 op/s 2023-05-08T12:07:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:55 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:07:56.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:55 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:07:56.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:55 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:07:56.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:55 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:07:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:55 smithi186 ceph-mon[126480]: pgmap v16169: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 13 op/s 2023-05-08T12:07:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:55 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:07:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:55 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:07:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:55 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:07:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:55 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:07:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:56 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:07:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:56 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T12:07:57.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:56 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T12:07:57.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:56 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:07:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:56 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:07:57.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:56 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T12:07:57.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:56 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T12:07:57.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:56 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:07:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:56 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:07:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:56 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T12:07:57.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:56 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T12:07:57.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:56 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:07:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:57 smithi096 ceph-mon[124666]: pgmap v16170: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1011 KiB/s rd, 674 KiB/s wr, 10 op/s 2023-05-08T12:07:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:57 smithi186 ceph-mon[126480]: pgmap v16170: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1011 KiB/s rd, 674 KiB/s wr, 10 op/s 2023-05-08T12:07:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:57 smithi133 ceph-mon[125939]: pgmap v16170: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1011 KiB/s rd, 674 KiB/s wr, 10 op/s 2023-05-08T12:07:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30218.258817 secs 2023-05-08T12:07:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30218.258817 secs 2023-05-08T12:07:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30218.258817 secs 2023-05-08T12:08:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:07:59 smithi096 ceph-mon[124666]: pgmap v16171: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1011 KiB/s rd, 674 KiB/s wr, 10 op/s 2023-05-08T12:08:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:07:59 smithi186 ceph-mon[126480]: pgmap v16171: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1011 KiB/s rd, 674 KiB/s wr, 10 op/s 2023-05-08T12:08:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:07:59 smithi133 ceph-mon[125939]: pgmap v16171: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1011 KiB/s rd, 674 KiB/s wr, 10 op/s 2023-05-08T12:08:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:01 smithi133 ceph-mon[125939]: pgmap v16172: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 955 KiB/s wr, 16 op/s 2023-05-08T12:08:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:01 smithi096 ceph-mon[124666]: pgmap v16172: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 955 KiB/s wr, 16 op/s 2023-05-08T12:08:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:01 smithi186 ceph-mon[126480]: pgmap v16172: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 955 KiB/s wr, 16 op/s 2023-05-08T12:08:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:04 smithi186 ceph-mon[126480]: pgmap v16173: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 878 KiB/s wr, 11 op/s 2023-05-08T12:08:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30223.258939 secs 2023-05-08T12:08:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:04 smithi133 ceph-mon[125939]: pgmap v16173: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 878 KiB/s wr, 11 op/s 2023-05-08T12:08:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30223.258939 secs 2023-05-08T12:08:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:04 smithi096 ceph-mon[124666]: pgmap v16173: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 878 KiB/s wr, 11 op/s 2023-05-08T12:08:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30223.258939 secs 2023-05-08T12:08:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30223.814374 secs 2023-05-08T12:08:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30223.814374 secs 2023-05-08T12:08:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30223.814374 secs 2023-05-08T12:08:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:06 smithi133 ceph-mon[125939]: pgmap v16174: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 31 op/s 2023-05-08T12:08:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:06 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:08:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:08:06.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:08:06.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30225.104583 secs 2023-05-08T12:08:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:06 smithi096 ceph-mon[124666]: pgmap v16174: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 31 op/s 2023-05-08T12:08:06.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:06 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:08:06.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:08:06.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:08:06.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30225.104583 secs 2023-05-08T12:08:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:06 smithi186 ceph-mon[126480]: pgmap v16174: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 31 op/s 2023-05-08T12:08:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:06 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:08:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:08:06.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:08:06.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30225.104583 secs 2023-05-08T12:08:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:07 smithi133 ceph-mon[125939]: osdmap e1088: 12 total, 12 up, 12 in 2023-05-08T12:08:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:07 smithi096 ceph-mon[124666]: osdmap e1088: 12 total, 12 up, 12 in 2023-05-08T12:08:07.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:07 smithi186 ceph-mon[126480]: osdmap e1088: 12 total, 12 up, 12 in 2023-05-08T12:08:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:08 smithi133 ceph-mon[125939]: pgmap v16176: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 875 KiB/s rd, 890 KiB/s wr, 30 op/s 2023-05-08T12:08:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:08 smithi096 ceph-mon[124666]: pgmap v16176: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 875 KiB/s rd, 890 KiB/s wr, 30 op/s 2023-05-08T12:08:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:08 smithi186 ceph-mon[126480]: pgmap v16176: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 875 KiB/s rd, 890 KiB/s wr, 30 op/s 2023-05-08T12:08:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30228.258995 secs 2023-05-08T12:08:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30228.258995 secs 2023-05-08T12:08:09.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30228.258995 secs 2023-05-08T12:08:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:10 smithi133 ceph-mon[125939]: pgmap v16177: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 875 KiB/s rd, 890 KiB/s wr, 30 op/s 2023-05-08T12:08:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30228.814493 secs 2023-05-08T12:08:10.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:10 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:08:10.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:10 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:08:10.515 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:10 smithi096 ceph-mon[124666]: pgmap v16177: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 875 KiB/s rd, 890 KiB/s wr, 30 op/s 2023-05-08T12:08:10.515 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30228.814493 secs 2023-05-08T12:08:10.516 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:10 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:08:10.516 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:10 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:08:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:10 smithi186 ceph-mon[126480]: pgmap v16177: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 875 KiB/s rd, 890 KiB/s wr, 30 op/s 2023-05-08T12:08:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30228.814493 secs 2023-05-08T12:08:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:10 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:08:10.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:10 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:08:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30230.104709 secs 2023-05-08T12:08:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:11 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:08:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30230.104709 secs 2023-05-08T12:08:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:11 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:08:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30230.104709 secs 2023-05-08T12:08:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:11 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:08:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:12 smithi133 ceph-mon[125939]: pgmap v16178: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 512 KiB/s rd, 552 KiB/s wr, 27 op/s 2023-05-08T12:08:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:12 smithi096 ceph-mon[124666]: pgmap v16178: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 512 KiB/s rd, 552 KiB/s wr, 27 op/s 2023-05-08T12:08:12.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:12 smithi186 ceph-mon[126480]: pgmap v16178: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 512 KiB/s rd, 552 KiB/s wr, 27 op/s 2023-05-08T12:08:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:14 smithi133 ceph-mon[125939]: pgmap v16179: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 512 KiB/s rd, 552 KiB/s wr, 27 op/s 2023-05-08T12:08:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30233.259109 secs 2023-05-08T12:08:14.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:14 smithi096 ceph-mon[124666]: pgmap v16179: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 512 KiB/s rd, 552 KiB/s wr, 27 op/s 2023-05-08T12:08:14.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30233.259109 secs 2023-05-08T12:08:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:14 smithi186 ceph-mon[126480]: pgmap v16179: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 512 KiB/s rd, 552 KiB/s wr, 27 op/s 2023-05-08T12:08:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30233.259109 secs 2023-05-08T12:08:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30233.814631 secs 2023-05-08T12:08:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30233.814631 secs 2023-05-08T12:08:15.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30233.814631 secs 2023-05-08T12:08:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:16 smithi133 ceph-mon[125939]: pgmap v16180: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 158 KiB/s wr, 8 op/s 2023-05-08T12:08:16.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30235.104851 secs 2023-05-08T12:08:16.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:16 smithi133 ceph-mon[125939]: osdmap e1089: 12 total, 12 up, 12 in 2023-05-08T12:08:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:16 smithi096 ceph-mon[124666]: pgmap v16180: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 158 KiB/s wr, 8 op/s 2023-05-08T12:08:16.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30235.104851 secs 2023-05-08T12:08:16.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:16 smithi096 ceph-mon[124666]: osdmap e1089: 12 total, 12 up, 12 in 2023-05-08T12:08:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:16 smithi186 ceph-mon[126480]: pgmap v16180: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 158 KiB/s wr, 8 op/s 2023-05-08T12:08:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30235.104851 secs 2023-05-08T12:08:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:16 smithi186 ceph-mon[126480]: osdmap e1089: 12 total, 12 up, 12 in 2023-05-08T12:08:18.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:18 smithi133 ceph-mon[125939]: pgmap v16182: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 158 KiB/s wr, 7 op/s 2023-05-08T12:08:18.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:18 smithi096 ceph-mon[124666]: pgmap v16182: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 158 KiB/s wr, 7 op/s 2023-05-08T12:08:18.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:18 smithi186 ceph-mon[126480]: pgmap v16182: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 158 KiB/s wr, 7 op/s 2023-05-08T12:08:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30238.259245 secs 2023-05-08T12:08:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30238.259245 secs 2023-05-08T12:08:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30238.259245 secs 2023-05-08T12:08:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:20 smithi133 ceph-mon[125939]: pgmap v16183: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 158 KiB/s wr, 7 op/s 2023-05-08T12:08:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30238.814741 secs 2023-05-08T12:08:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:20 smithi096 ceph-mon[124666]: pgmap v16183: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 158 KiB/s wr, 7 op/s 2023-05-08T12:08:20.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30238.814741 secs 2023-05-08T12:08:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:20 smithi186 ceph-mon[126480]: pgmap v16183: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 158 KiB/s wr, 7 op/s 2023-05-08T12:08:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30238.814741 secs 2023-05-08T12:08:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30240.104915 secs 2023-05-08T12:08:21.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30240.104915 secs 2023-05-08T12:08:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30240.104915 secs 2023-05-08T12:08:22.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:22 smithi133 ceph-mon[125939]: pgmap v16184: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 157 KiB/s wr, 6 op/s 2023-05-08T12:08:22.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:22 smithi096 ceph-mon[124666]: pgmap v16184: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 157 KiB/s wr, 6 op/s 2023-05-08T12:08:22.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:22 smithi186 ceph-mon[126480]: pgmap v16184: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 157 KiB/s wr, 6 op/s 2023-05-08T12:08:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:24 smithi133 ceph-mon[125939]: pgmap v16185: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 157 KiB/s wr, 6 op/s 2023-05-08T12:08:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30243.259384 secs 2023-05-08T12:08:24.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:24 smithi096 ceph-mon[124666]: pgmap v16185: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 157 KiB/s wr, 6 op/s 2023-05-08T12:08:24.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30243.259384 secs 2023-05-08T12:08:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:24 smithi186 ceph-mon[126480]: pgmap v16185: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 157 KiB/s wr, 6 op/s 2023-05-08T12:08:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30243.259384 secs 2023-05-08T12:08:25.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30243.814851 secs 2023-05-08T12:08:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30243.814851 secs 2023-05-08T12:08:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30243.814851 secs 2023-05-08T12:08:26.496 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:26 smithi133 ceph-mon[125939]: pgmap v16186: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T12:08:26.497 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30245.105013 secs 2023-05-08T12:08:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:26 smithi096 ceph-mon[124666]: pgmap v16186: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T12:08:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30245.105013 secs 2023-05-08T12:08:26.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:26 smithi186 ceph-mon[126480]: pgmap v16186: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T12:08:26.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30245.105013 secs 2023-05-08T12:08:28.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:28 smithi133 ceph-mon[125939]: pgmap v16187: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-05-08T12:08:28.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:28 smithi096 ceph-mon[124666]: pgmap v16187: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-05-08T12:08:28.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:28 smithi186 ceph-mon[126480]: pgmap v16187: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-05-08T12:08:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30248.259478 secs 2023-05-08T12:08:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30248.259478 secs 2023-05-08T12:08:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30248.259478 secs 2023-05-08T12:08:30.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:30 smithi133 ceph-mon[125939]: pgmap v16188: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T12:08:30.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30248.814947 secs 2023-05-08T12:08:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:30 smithi096 ceph-mon[124666]: pgmap v16188: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T12:08:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30248.814947 secs 2023-05-08T12:08:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:30 smithi186 ceph-mon[126480]: pgmap v16188: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T12:08:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30248.814947 secs 2023-05-08T12:08:31.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30250.105138 secs 2023-05-08T12:08:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30250.105138 secs 2023-05-08T12:08:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30250.105138 secs 2023-05-08T12:08:32.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:32 smithi133 ceph-mon[125939]: pgmap v16189: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T12:08:32.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:32 smithi096 ceph-mon[124666]: pgmap v16189: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T12:08:32.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:32 smithi186 ceph-mon[126480]: pgmap v16189: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T12:08:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:34 smithi133 ceph-mon[125939]: pgmap v16190: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T12:08:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30253.259598 secs 2023-05-08T12:08:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:34 smithi096 ceph-mon[124666]: pgmap v16190: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T12:08:34.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30253.259598 secs 2023-05-08T12:08:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:34 smithi186 ceph-mon[126480]: pgmap v16190: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T12:08:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30253.259598 secs 2023-05-08T12:08:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30253.815089 secs 2023-05-08T12:08:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30253.815089 secs 2023-05-08T12:08:35.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30253.815089 secs 2023-05-08T12:08:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:36 smithi133 ceph-mon[125939]: pgmap v16191: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 8 op/s 2023-05-08T12:08:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30255.105206 secs 2023-05-08T12:08:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:36 smithi096 ceph-mon[124666]: pgmap v16191: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 8 op/s 2023-05-08T12:08:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30255.105206 secs 2023-05-08T12:08:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:36 smithi186 ceph-mon[126480]: pgmap v16191: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 8 op/s 2023-05-08T12:08:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30255.105206 secs 2023-05-08T12:08:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:38 smithi133 ceph-mon[125939]: pgmap v16192: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T12:08:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:38 smithi096 ceph-mon[124666]: pgmap v16192: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T12:08:38.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:38 smithi186 ceph-mon[126480]: pgmap v16192: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T12:08:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30258.259734 secs 2023-05-08T12:08:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30258.259734 secs 2023-05-08T12:08:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30258.259734 secs 2023-05-08T12:08:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:40 smithi133 ceph-mon[125939]: pgmap v16193: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T12:08:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30258.815228 secs 2023-05-08T12:08:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:40 smithi096 ceph-mon[124666]: pgmap v16193: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T12:08:40.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30258.815228 secs 2023-05-08T12:08:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:40 smithi186 ceph-mon[126480]: pgmap v16193: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T12:08:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30258.815228 secs 2023-05-08T12:08:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30260.105318 secs 2023-05-08T12:08:41.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30260.105318 secs 2023-05-08T12:08:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30260.105318 secs 2023-05-08T12:08:42.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:42 smithi133 ceph-mon[125939]: pgmap v16194: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 22 KiB/s wr, 9 op/s 2023-05-08T12:08:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:42 smithi096 ceph-mon[124666]: pgmap v16194: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 22 KiB/s wr, 9 op/s 2023-05-08T12:08:42.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:42 smithi186 ceph-mon[126480]: pgmap v16194: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 22 KiB/s wr, 9 op/s 2023-05-08T12:08:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:44 smithi133 ceph-mon[125939]: pgmap v16195: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 22 KiB/s wr, 6 op/s 2023-05-08T12:08:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30263.259837 secs 2023-05-08T12:08:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:44 smithi096 ceph-mon[124666]: pgmap v16195: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 22 KiB/s wr, 6 op/s 2023-05-08T12:08:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30263.259837 secs 2023-05-08T12:08:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:44 smithi186 ceph-mon[126480]: pgmap v16195: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 22 KiB/s wr, 6 op/s 2023-05-08T12:08:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30263.259837 secs 2023-05-08T12:08:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30263.815348 secs 2023-05-08T12:08:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30263.815348 secs 2023-05-08T12:08:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30263.815348 secs 2023-05-08T12:08:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:46 smithi096 ceph-mon[124666]: pgmap v16196: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 464 KiB/s wr, 11 op/s 2023-05-08T12:08:46.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:46 smithi186 ceph-mon[126480]: pgmap v16196: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 464 KiB/s wr, 11 op/s 2023-05-08T12:08:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:46 smithi133 ceph-mon[125939]: pgmap v16196: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 464 KiB/s wr, 11 op/s 2023-05-08T12:08:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:48 smithi096 ceph-mon[124666]: pgmap v16197: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 464 KiB/s wr, 8 op/s 2023-05-08T12:08:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:48 smithi186 ceph-mon[126480]: pgmap v16197: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 464 KiB/s wr, 8 op/s 2023-05-08T12:08:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:48 smithi133 ceph-mon[125939]: pgmap v16197: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 464 KiB/s wr, 8 op/s 2023-05-08T12:08:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:08:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30268.259970 secs 2023-05-08T12:08:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:08:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30268.259970 secs 2023-05-08T12:08:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:08:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30268.259970 secs 2023-05-08T12:08:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:50 smithi096 ceph-mon[124666]: pgmap v16198: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 464 KiB/s wr, 8 op/s 2023-05-08T12:08:50.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:08:50.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:08:50.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:08:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:50 smithi186 ceph-mon[126480]: pgmap v16198: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 464 KiB/s wr, 8 op/s 2023-05-08T12:08:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:08:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:08:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:08:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:50 smithi133 ceph-mon[125939]: pgmap v16198: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 464 KiB/s wr, 8 op/s 2023-05-08T12:08:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:08:50.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:08:50.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:08:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:51 smithi133 ceph-mon[125939]: pgmap v16199: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 697 KiB/s rd, 608 KiB/s wr, 12 op/s 2023-05-08T12:08:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:51 smithi096 ceph-mon[124666]: pgmap v16199: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 697 KiB/s rd, 608 KiB/s wr, 12 op/s 2023-05-08T12:08:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:51 smithi186 ceph-mon[126480]: pgmap v16199: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 697 KiB/s rd, 608 KiB/s wr, 12 op/s 2023-05-08T12:08:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:08:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:08:53.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:08:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:08:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:08:54.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:53 smithi133 ceph-mon[125939]: pgmap v16200: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 631 KiB/s rd, 586 KiB/s wr, 8 op/s 2023-05-08T12:08:54.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30273.260056 secs 2023-05-08T12:08:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:08:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:08:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:53 smithi096 ceph-mon[124666]: pgmap v16200: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 631 KiB/s rd, 586 KiB/s wr, 8 op/s 2023-05-08T12:08:54.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30273.260056 secs 2023-05-08T12:08:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:08:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:08:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:53 smithi186 ceph-mon[126480]: pgmap v16200: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 631 KiB/s rd, 586 KiB/s wr, 8 op/s 2023-05-08T12:08:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30273.260056 secs 2023-05-08T12:08:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:56 smithi133 ceph-mon[125939]: pgmap v16201: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1010 KiB/s rd, 1.2 MiB/s wr, 14 op/s 2023-05-08T12:08:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:08:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:56 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:08:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:56 smithi096 ceph-mon[124666]: pgmap v16201: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1010 KiB/s rd, 1.2 MiB/s wr, 14 op/s 2023-05-08T12:08:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:08:56.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:56 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:08:56.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:56 smithi186 ceph-mon[126480]: pgmap v16201: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1010 KiB/s rd, 1.2 MiB/s wr, 14 op/s 2023-05-08T12:08:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:08:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:56 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:08:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:08:57.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:08:57.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:57 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:08:57.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:08:57.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:57 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T12:08:57.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:57 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T12:08:57.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:57 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:08:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:08:57.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:08:57.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:57 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:08:57.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:08:57.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:57 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T12:08:57.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:57 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T12:08:57.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:57 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:08:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:08:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:08:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:57 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:08:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:08:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:57 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T12:08:57.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:57 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T12:08:57.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:57 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:08:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:58 smithi186 ceph-mon[126480]: pgmap v16202: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 875 KiB/s rd, 795 KiB/s wr, 10 op/s 2023-05-08T12:08:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:58 smithi133 ceph-mon[125939]: pgmap v16202: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 875 KiB/s rd, 795 KiB/s wr, 10 op/s 2023-05-08T12:08:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:58 smithi096 ceph-mon[124666]: pgmap v16202: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 875 KiB/s rd, 795 KiB/s wr, 10 op/s 2023-05-08T12:08:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:08:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30278.260188 secs 2023-05-08T12:08:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:08:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30278.260188 secs 2023-05-08T12:08:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:08:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30278.260188 secs 2023-05-08T12:09:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:00 smithi186 ceph-mon[126480]: pgmap v16203: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 875 KiB/s rd, 795 KiB/s wr, 10 op/s 2023-05-08T12:09:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:00 smithi133 ceph-mon[125939]: pgmap v16203: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 875 KiB/s rd, 795 KiB/s wr, 10 op/s 2023-05-08T12:09:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:00 smithi096 ceph-mon[124666]: pgmap v16203: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 875 KiB/s rd, 795 KiB/s wr, 10 op/s 2023-05-08T12:09:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:01 smithi133 ceph-mon[125939]: pgmap v16204: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 962 KiB/s wr, 16 op/s 2023-05-08T12:09:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:01 smithi096 ceph-mon[124666]: pgmap v16204: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 962 KiB/s wr, 16 op/s 2023-05-08T12:09:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:01 smithi186 ceph-mon[126480]: pgmap v16204: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 962 KiB/s wr, 16 op/s 2023-05-08T12:09:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:04 smithi133 ceph-mon[125939]: pgmap v16205: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 828 KiB/s rd, 817 KiB/s wr, 11 op/s 2023-05-08T12:09:04.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30283.260305 secs 2023-05-08T12:09:04.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30283.815777 secs 2023-05-08T12:09:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:04 smithi096 ceph-mon[124666]: pgmap v16205: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 828 KiB/s rd, 817 KiB/s wr, 11 op/s 2023-05-08T12:09:04.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30283.260305 secs 2023-05-08T12:09:04.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30283.815777 secs 2023-05-08T12:09:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:04 smithi186 ceph-mon[126480]: pgmap v16205: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 828 KiB/s rd, 817 KiB/s wr, 11 op/s 2023-05-08T12:09:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30283.260305 secs 2023-05-08T12:09:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30283.815777 secs 2023-05-08T12:09:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:05 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:09:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:09:05.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:09:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:05 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:09:05.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:09:05.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:09:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:05 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:09:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:09:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:09:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:06 smithi133 ceph-mon[125939]: pgmap v16206: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 32 op/s 2023-05-08T12:09:06.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30285.105923 secs 2023-05-08T12:09:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:06 smithi096 ceph-mon[124666]: pgmap v16206: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 32 op/s 2023-05-08T12:09:06.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30285.105923 secs 2023-05-08T12:09:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:06 smithi186 ceph-mon[126480]: pgmap v16206: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 32 op/s 2023-05-08T12:09:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30285.105923 secs 2023-05-08T12:09:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:07 smithi133 ceph-mon[125939]: osdmap e1090: 12 total, 12 up, 12 in 2023-05-08T12:09:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:07 smithi096 ceph-mon[124666]: osdmap e1090: 12 total, 12 up, 12 in 2023-05-08T12:09:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:07 smithi186 ceph-mon[126480]: osdmap e1090: 12 total, 12 up, 12 in 2023-05-08T12:09:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:08 smithi133 ceph-mon[125939]: pgmap v16208: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 932 KiB/s rd, 945 KiB/s wr, 31 op/s 2023-05-08T12:09:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:08 smithi096 ceph-mon[124666]: pgmap v16208: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 932 KiB/s rd, 945 KiB/s wr, 31 op/s 2023-05-08T12:09:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:08 smithi186 ceph-mon[126480]: pgmap v16208: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 932 KiB/s rd, 945 KiB/s wr, 31 op/s 2023-05-08T12:09:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30288.260418 secs 2023-05-08T12:09:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30288.815895 secs 2023-05-08T12:09:09.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30288.260418 secs 2023-05-08T12:09:09.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30288.815895 secs 2023-05-08T12:09:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30288.260418 secs 2023-05-08T12:09:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30288.815895 secs 2023-05-08T12:09:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:10 smithi133 ceph-mon[125939]: pgmap v16209: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 932 KiB/s rd, 945 KiB/s wr, 31 op/s 2023-05-08T12:09:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:10 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:09:10.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:10 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:09:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:10 smithi096 ceph-mon[124666]: pgmap v16209: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 932 KiB/s rd, 945 KiB/s wr, 31 op/s 2023-05-08T12:09:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:10 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:09:10.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:10 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:09:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:10 smithi186 ceph-mon[126480]: pgmap v16209: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 932 KiB/s rd, 945 KiB/s wr, 31 op/s 2023-05-08T12:09:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:10 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:09:10.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:10 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:09:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30290.105988 secs 2023-05-08T12:09:11.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:11 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:09:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30290.105988 secs 2023-05-08T12:09:11.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:11 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:09:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30290.105988 secs 2023-05-08T12:09:11.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:11 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:09:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:12 smithi133 ceph-mon[125939]: pgmap v16210: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 708 KiB/s rd, 746 KiB/s wr, 29 op/s 2023-05-08T12:09:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:12 smithi096 ceph-mon[124666]: pgmap v16210: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 708 KiB/s rd, 746 KiB/s wr, 29 op/s 2023-05-08T12:09:12.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:12 smithi186 ceph-mon[126480]: pgmap v16210: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 708 KiB/s rd, 746 KiB/s wr, 29 op/s 2023-05-08T12:09:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:14 smithi133 ceph-mon[125939]: pgmap v16211: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 708 KiB/s rd, 746 KiB/s wr, 29 op/s 2023-05-08T12:09:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30293.260533 secs 2023-05-08T12:09:14.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30293.816010 secs 2023-05-08T12:09:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:14 smithi096 ceph-mon[124666]: pgmap v16211: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 708 KiB/s rd, 746 KiB/s wr, 29 op/s 2023-05-08T12:09:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30293.260533 secs 2023-05-08T12:09:14.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30293.816010 secs 2023-05-08T12:09:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:14 smithi186 ceph-mon[126480]: pgmap v16211: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 708 KiB/s rd, 746 KiB/s wr, 29 op/s 2023-05-08T12:09:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30293.260533 secs 2023-05-08T12:09:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30293.816010 secs 2023-05-08T12:09:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:16 smithi133 ceph-mon[125939]: pgmap v16212: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 158 KiB/s wr, 9 op/s 2023-05-08T12:09:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30295.106109 secs 2023-05-08T12:09:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:16 smithi133 ceph-mon[125939]: osdmap e1091: 12 total, 12 up, 12 in 2023-05-08T12:09:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:16 smithi096 ceph-mon[124666]: pgmap v16212: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 158 KiB/s wr, 9 op/s 2023-05-08T12:09:16.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30295.106109 secs 2023-05-08T12:09:16.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:16 smithi096 ceph-mon[124666]: osdmap e1091: 12 total, 12 up, 12 in 2023-05-08T12:09:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:16 smithi186 ceph-mon[126480]: pgmap v16212: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 158 KiB/s wr, 9 op/s 2023-05-08T12:09:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30295.106109 secs 2023-05-08T12:09:16.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:16 smithi186 ceph-mon[126480]: osdmap e1091: 12 total, 12 up, 12 in 2023-05-08T12:09:18.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:18 smithi133 ceph-mon[125939]: pgmap v16214: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 158 KiB/s wr, 9 op/s 2023-05-08T12:09:18.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:18 smithi096 ceph-mon[124666]: pgmap v16214: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 158 KiB/s wr, 9 op/s 2023-05-08T12:09:18.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:18 smithi186 ceph-mon[126480]: pgmap v16214: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 158 KiB/s wr, 9 op/s 2023-05-08T12:09:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30298.260623 secs 2023-05-08T12:09:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30298.816149 secs 2023-05-08T12:09:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30298.260623 secs 2023-05-08T12:09:19.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30298.816149 secs 2023-05-08T12:09:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30298.260623 secs 2023-05-08T12:09:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30298.816149 secs 2023-05-08T12:09:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:20 smithi133 ceph-mon[125939]: pgmap v16215: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 158 KiB/s wr, 9 op/s 2023-05-08T12:09:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:20 smithi096 ceph-mon[124666]: pgmap v16215: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 158 KiB/s wr, 9 op/s 2023-05-08T12:09:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:20 smithi186 ceph-mon[126480]: pgmap v16215: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 158 KiB/s wr, 9 op/s 2023-05-08T12:09:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30300.106233 secs 2023-05-08T12:09:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30300.106233 secs 2023-05-08T12:09:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30300.106233 secs 2023-05-08T12:09:22.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:22 smithi133 ceph-mon[125939]: pgmap v16216: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 157 KiB/s wr, 7 op/s 2023-05-08T12:09:22.509 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:22 smithi096 ceph-mon[124666]: pgmap v16216: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 157 KiB/s wr, 7 op/s 2023-05-08T12:09:22.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:22 smithi186 ceph-mon[126480]: pgmap v16216: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 157 KiB/s wr, 7 op/s 2023-05-08T12:09:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:24 smithi133 ceph-mon[125939]: pgmap v16217: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 157 KiB/s wr, 7 op/s 2023-05-08T12:09:24.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30303.260775 secs 2023-05-08T12:09:24.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30303.816284 secs 2023-05-08T12:09:24.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:24 smithi096 ceph-mon[124666]: pgmap v16217: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 157 KiB/s wr, 7 op/s 2023-05-08T12:09:24.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30303.260775 secs 2023-05-08T12:09:24.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30303.816284 secs 2023-05-08T12:09:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:24 smithi186 ceph-mon[126480]: pgmap v16217: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 157 KiB/s wr, 7 op/s 2023-05-08T12:09:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30303.260775 secs 2023-05-08T12:09:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30303.816284 secs 2023-05-08T12:09:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:26 smithi096 ceph-mon[124666]: pgmap v16218: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 111 KiB/s wr, 7 op/s 2023-05-08T12:09:26.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30305.106369 secs 2023-05-08T12:09:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:26 smithi186 ceph-mon[126480]: pgmap v16218: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 111 KiB/s wr, 7 op/s 2023-05-08T12:09:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30305.106369 secs 2023-05-08T12:09:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:26 smithi133 ceph-mon[125939]: pgmap v16218: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 111 KiB/s wr, 7 op/s 2023-05-08T12:09:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30305.106369 secs 2023-05-08T12:09:28.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:28 smithi096 ceph-mon[124666]: pgmap v16219: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 100 KiB/s wr, 7 op/s 2023-05-08T12:09:28.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:28 smithi186 ceph-mon[126480]: pgmap v16219: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 100 KiB/s wr, 7 op/s 2023-05-08T12:09:28.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:28 smithi133 ceph-mon[125939]: pgmap v16219: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 100 KiB/s wr, 7 op/s 2023-05-08T12:09:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30308.260911 secs 2023-05-08T12:09:29.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30308.816431 secs 2023-05-08T12:09:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30308.260911 secs 2023-05-08T12:09:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30308.816431 secs 2023-05-08T12:09:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30308.260911 secs 2023-05-08T12:09:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30308.816431 secs 2023-05-08T12:09:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:30 smithi096 ceph-mon[124666]: pgmap v16220: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 92 KiB/s wr, 6 op/s 2023-05-08T12:09:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:30 smithi186 ceph-mon[126480]: pgmap v16220: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 92 KiB/s wr, 6 op/s 2023-05-08T12:09:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:30 smithi133 ceph-mon[125939]: pgmap v16220: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 92 KiB/s wr, 6 op/s 2023-05-08T12:09:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30310.106510 secs 2023-05-08T12:09:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30310.106510 secs 2023-05-08T12:09:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30310.106510 secs 2023-05-08T12:09:32.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:32 smithi096 ceph-mon[124666]: pgmap v16221: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 92 KiB/s wr, 9 op/s 2023-05-08T12:09:32.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:32 smithi186 ceph-mon[126480]: pgmap v16221: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 92 KiB/s wr, 9 op/s 2023-05-08T12:09:32.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:32 smithi133 ceph-mon[125939]: pgmap v16221: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 92 KiB/s wr, 9 op/s 2023-05-08T12:09:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:34 smithi186 ceph-mon[126480]: pgmap v16222: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 92 KiB/s wr, 6 op/s 2023-05-08T12:09:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30313.261050 secs 2023-05-08T12:09:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30313.816489 secs 2023-05-08T12:09:34.744 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:34 smithi133 ceph-mon[125939]: pgmap v16222: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 92 KiB/s wr, 6 op/s 2023-05-08T12:09:34.744 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30313.261050 secs 2023-05-08T12:09:34.744 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30313.816489 secs 2023-05-08T12:09:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:34 smithi096 ceph-mon[124666]: pgmap v16222: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 92 KiB/s wr, 6 op/s 2023-05-08T12:09:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30313.261050 secs 2023-05-08T12:09:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30313.816489 secs 2023-05-08T12:09:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:36 smithi186 ceph-mon[126480]: pgmap v16223: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 92 KiB/s wr, 10 op/s 2023-05-08T12:09:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30315.106633 secs 2023-05-08T12:09:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:36 smithi133 ceph-mon[125939]: pgmap v16223: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 92 KiB/s wr, 10 op/s 2023-05-08T12:09:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30315.106633 secs 2023-05-08T12:09:36.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:36 smithi096 ceph-mon[124666]: pgmap v16223: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 92 KiB/s wr, 10 op/s 2023-05-08T12:09:36.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30315.106633 secs 2023-05-08T12:09:38.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:38 smithi186 ceph-mon[126480]: pgmap v16224: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T12:09:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:38 smithi133 ceph-mon[125939]: pgmap v16224: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T12:09:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:38 smithi096 ceph-mon[124666]: pgmap v16224: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T12:09:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30318.261182 secs 2023-05-08T12:09:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30318.816588 secs 2023-05-08T12:09:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30318.261182 secs 2023-05-08T12:09:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30318.816588 secs 2023-05-08T12:09:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30318.261182 secs 2023-05-08T12:09:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30318.816588 secs 2023-05-08T12:09:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:40 smithi186 ceph-mon[126480]: pgmap v16225: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T12:09:40.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:40 smithi133 ceph-mon[125939]: pgmap v16225: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T12:09:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:40 smithi096 ceph-mon[124666]: pgmap v16225: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T12:09:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30320.106754 secs 2023-05-08T12:09:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30320.106754 secs 2023-05-08T12:09:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30320.106754 secs 2023-05-08T12:09:42.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:42 smithi186 ceph-mon[126480]: pgmap v16226: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 938 B/s wr, 11 op/s 2023-05-08T12:09:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:42 smithi133 ceph-mon[125939]: pgmap v16226: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 938 B/s wr, 11 op/s 2023-05-08T12:09:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:42 smithi096 ceph-mon[124666]: pgmap v16226: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 938 B/s wr, 11 op/s 2023-05-08T12:09:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:44 smithi186 ceph-mon[126480]: pgmap v16227: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 938 B/s wr, 8 op/s 2023-05-08T12:09:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30323.261356 secs 2023-05-08T12:09:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30323.816705 secs 2023-05-08T12:09:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:44 smithi133 ceph-mon[125939]: pgmap v16227: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 938 B/s wr, 8 op/s 2023-05-08T12:09:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30323.261356 secs 2023-05-08T12:09:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30323.816705 secs 2023-05-08T12:09:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:44 smithi096 ceph-mon[124666]: pgmap v16227: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 938 B/s wr, 8 op/s 2023-05-08T12:09:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30323.261356 secs 2023-05-08T12:09:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30323.816705 secs 2023-05-08T12:09:46.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:46 smithi186 ceph-mon[126480]: pgmap v16228: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 353 KiB/s wr, 11 op/s 2023-05-08T12:09:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:46 smithi133 ceph-mon[125939]: pgmap v16228: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 353 KiB/s wr, 11 op/s 2023-05-08T12:09:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:46 smithi096 ceph-mon[124666]: pgmap v16228: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 353 KiB/s wr, 11 op/s 2023-05-08T12:09:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:48 smithi186 ceph-mon[126480]: pgmap v16229: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 355 KiB/s rd, 353 KiB/s wr, 8 op/s 2023-05-08T12:09:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:48 smithi133 ceph-mon[125939]: pgmap v16229: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 355 KiB/s rd, 353 KiB/s wr, 8 op/s 2023-05-08T12:09:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:48 smithi096 ceph-mon[124666]: pgmap v16229: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 355 KiB/s rd, 353 KiB/s wr, 8 op/s 2023-05-08T12:09:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:09:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30328.261420 secs 2023-05-08T12:09:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:09:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30328.261420 secs 2023-05-08T12:09:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:09:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30328.261420 secs 2023-05-08T12:09:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:50 smithi186 ceph-mon[126480]: pgmap v16230: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 355 KiB/s rd, 353 KiB/s wr, 8 op/s 2023-05-08T12:09:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:09:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:09:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:09:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:50 smithi133 ceph-mon[125939]: pgmap v16230: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 355 KiB/s rd, 353 KiB/s wr, 8 op/s 2023-05-08T12:09:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:09:50.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:09:50.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:09:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:50 smithi096 ceph-mon[124666]: pgmap v16230: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 355 KiB/s rd, 353 KiB/s wr, 8 op/s 2023-05-08T12:09:50.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:09:50.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:09:50.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:09:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:51 smithi096 ceph-mon[124666]: pgmap v16231: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 498 KiB/s wr, 12 op/s 2023-05-08T12:09:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:51 smithi186 ceph-mon[126480]: pgmap v16231: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 498 KiB/s wr, 12 op/s 2023-05-08T12:09:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:51 smithi133 ceph-mon[125939]: pgmap v16231: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 498 KiB/s wr, 12 op/s 2023-05-08T12:09:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:09:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:09:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:09:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:54 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:09:54.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:54 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:09:54.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:54 smithi096 ceph-mon[124666]: pgmap v16232: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 499 KiB/s rd, 498 KiB/s wr, 8 op/s 2023-05-08T12:09:54.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30333.261497 secs 2023-05-08T12:09:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:54 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:09:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:54 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:09:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:54 smithi186 ceph-mon[126480]: pgmap v16232: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 499 KiB/s rd, 498 KiB/s wr, 8 op/s 2023-05-08T12:09:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30333.261497 secs 2023-05-08T12:09:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:54 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:09:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:54 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:09:54.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:54 smithi133 ceph-mon[125939]: pgmap v16232: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 499 KiB/s rd, 498 KiB/s wr, 8 op/s 2023-05-08T12:09:54.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30333.261497 secs 2023-05-08T12:09:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:56 smithi133 ceph-mon[125939]: pgmap v16233: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1018 KiB/s wr, 14 op/s 2023-05-08T12:09:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:56 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:09:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:56 smithi096 ceph-mon[124666]: pgmap v16233: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1018 KiB/s wr, 14 op/s 2023-05-08T12:09:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:56 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:09:56.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:56 smithi186 ceph-mon[126480]: pgmap v16233: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1018 KiB/s wr, 14 op/s 2023-05-08T12:09:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:56 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:09:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:09:57.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:09:57.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:09:57.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:09:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:09:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:09:57.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:09:57.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:09:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:09:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:09:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:09:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:09:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:58 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:09:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:58 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T12:09:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:58 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T12:09:58.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:58 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:09:58.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:58 smithi133 ceph-mon[125939]: pgmap v16234: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 691 KiB/s rd, 921 KiB/s wr, 11 op/s 2023-05-08T12:09:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:58 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:09:58.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:58 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T12:09:58.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:58 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T12:09:58.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:58 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:09:58.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:58 smithi096 ceph-mon[124666]: pgmap v16234: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 691 KiB/s rd, 921 KiB/s wr, 11 op/s 2023-05-08T12:09:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:58 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:09:58.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:58 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T12:09:58.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:58 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T12:09:58.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:58 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:09:58.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:58 smithi186 ceph-mon[126480]: pgmap v16234: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 691 KiB/s rd, 921 KiB/s wr, 11 op/s 2023-05-08T12:09:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:09:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30338.261605 secs 2023-05-08T12:09:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:09:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30338.261605 secs 2023-05-08T12:09:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:09:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30338.261605 secs 2023-05-08T12:10:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:00 smithi133 ceph-mon[125939]: pgmap v16235: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 690 KiB/s rd, 921 KiB/s wr, 11 op/s 2023-05-08T12:10:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:00 smithi133 ceph-mon[125939]: overall HEALTH_WARN 1 MDSs report slow requests 2023-05-08T12:10:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:00 smithi096 ceph-mon[124666]: pgmap v16235: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 690 KiB/s rd, 921 KiB/s wr, 11 op/s 2023-05-08T12:10:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:00 smithi096 ceph-mon[124666]: overall HEALTH_WARN 1 MDSs report slow requests 2023-05-08T12:10:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:00 smithi186 ceph-mon[126480]: pgmap v16235: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 690 KiB/s rd, 921 KiB/s wr, 11 op/s 2023-05-08T12:10:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:00 smithi186 ceph-mon[126480]: overall HEALTH_WARN 1 MDSs report slow requests 2023-05-08T12:10:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:01 smithi096 ceph-mon[124666]: pgmap v16236: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 974 KiB/s rd, 1.2 MiB/s wr, 16 op/s 2023-05-08T12:10:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:01 smithi186 ceph-mon[126480]: pgmap v16236: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 974 KiB/s rd, 1.2 MiB/s wr, 16 op/s 2023-05-08T12:10:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:01 smithi133 ceph-mon[125939]: pgmap v16236: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 974 KiB/s rd, 1.2 MiB/s wr, 16 op/s 2023-05-08T12:10:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:04 smithi133 ceph-mon[125939]: pgmap v16237: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 828 KiB/s rd, 1.0 MiB/s wr, 12 op/s 2023-05-08T12:10:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30343.261724 secs 2023-05-08T12:10:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30343.817179 secs 2023-05-08T12:10:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:04 smithi096 ceph-mon[124666]: pgmap v16237: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 828 KiB/s rd, 1.0 MiB/s wr, 12 op/s 2023-05-08T12:10:04.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30343.261724 secs 2023-05-08T12:10:04.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30343.817179 secs 2023-05-08T12:10:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:04 smithi186 ceph-mon[126480]: pgmap v16237: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 828 KiB/s rd, 1.0 MiB/s wr, 12 op/s 2023-05-08T12:10:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30343.261724 secs 2023-05-08T12:10:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30343.817179 secs 2023-05-08T12:10:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:05 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:10:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:10:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:10:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:05 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:10:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:10:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:10:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:05 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:10:05.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:10:05.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:10:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:06 smithi133 ceph-mon[125939]: pgmap v16238: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 858 KiB/s rd, 1.1 MiB/s wr, 29 op/s 2023-05-08T12:10:06.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30345.107325 secs 2023-05-08T12:10:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:06 smithi096 ceph-mon[124666]: pgmap v16238: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 858 KiB/s rd, 1.1 MiB/s wr, 29 op/s 2023-05-08T12:10:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30345.107325 secs 2023-05-08T12:10:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:06 smithi186 ceph-mon[126480]: pgmap v16238: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 858 KiB/s rd, 1.1 MiB/s wr, 29 op/s 2023-05-08T12:10:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30345.107325 secs 2023-05-08T12:10:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:07 smithi133 ceph-mon[125939]: osdmap e1092: 12 total, 12 up, 12 in 2023-05-08T12:10:07.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:07 smithi096 ceph-mon[124666]: osdmap e1092: 12 total, 12 up, 12 in 2023-05-08T12:10:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:07 smithi186 ceph-mon[126480]: osdmap e1092: 12 total, 12 up, 12 in 2023-05-08T12:10:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:08 smithi133 ceph-mon[125939]: pgmap v16240: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 852 KiB/s rd, 603 KiB/s wr, 29 op/s 2023-05-08T12:10:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:08 smithi096 ceph-mon[124666]: pgmap v16240: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 852 KiB/s rd, 603 KiB/s wr, 29 op/s 2023-05-08T12:10:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:08 smithi186 ceph-mon[126480]: pgmap v16240: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 852 KiB/s rd, 603 KiB/s wr, 29 op/s 2023-05-08T12:10:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30348.261841 secs 2023-05-08T12:10:09.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30348.817301 secs 2023-05-08T12:10:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30348.261841 secs 2023-05-08T12:10:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30348.817301 secs 2023-05-08T12:10:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30348.261841 secs 2023-05-08T12:10:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30348.817301 secs 2023-05-08T12:10:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:10 smithi133 ceph-mon[125939]: pgmap v16241: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 852 KiB/s rd, 603 KiB/s wr, 29 op/s 2023-05-08T12:10:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:10 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:10:10.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:10 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:10:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:10 smithi096 ceph-mon[124666]: pgmap v16241: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 852 KiB/s rd, 603 KiB/s wr, 29 op/s 2023-05-08T12:10:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:10 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:10:10.509 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:10 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:10:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:10 smithi186 ceph-mon[126480]: pgmap v16241: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 852 KiB/s rd, 603 KiB/s wr, 29 op/s 2023-05-08T12:10:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:10 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:10:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:10 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:10:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30350.107450 secs 2023-05-08T12:10:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:11 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:10:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30350.107450 secs 2023-05-08T12:10:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:11 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:10:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30350.107450 secs 2023-05-08T12:10:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:11 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:10:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:12 smithi133 ceph-mon[125939]: pgmap v16242: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 289 KiB/s wr, 27 op/s 2023-05-08T12:10:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:12 smithi096 ceph-mon[124666]: pgmap v16242: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 289 KiB/s wr, 27 op/s 2023-05-08T12:10:12.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:12 smithi186 ceph-mon[126480]: pgmap v16242: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 289 KiB/s wr, 27 op/s 2023-05-08T12:10:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:14 smithi133 ceph-mon[125939]: pgmap v16243: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 289 KiB/s wr, 27 op/s 2023-05-08T12:10:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30353.261944 secs 2023-05-08T12:10:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30353.817447 secs 2023-05-08T12:10:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:14 smithi096 ceph-mon[124666]: pgmap v16243: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 289 KiB/s wr, 27 op/s 2023-05-08T12:10:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30353.261944 secs 2023-05-08T12:10:14.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30353.817447 secs 2023-05-08T12:10:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:14 smithi186 ceph-mon[126480]: pgmap v16243: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 289 KiB/s wr, 27 op/s 2023-05-08T12:10:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30353.261944 secs 2023-05-08T12:10:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30353.817447 secs 2023-05-08T12:10:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:16 smithi133 ceph-mon[125939]: pgmap v16244: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 602 KiB/s rd, 334 KiB/s wr, 9 op/s 2023-05-08T12:10:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30355.107592 secs 2023-05-08T12:10:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:16 smithi133 ceph-mon[125939]: osdmap e1093: 12 total, 12 up, 12 in 2023-05-08T12:10:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:16 smithi096 ceph-mon[124666]: pgmap v16244: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 602 KiB/s rd, 334 KiB/s wr, 9 op/s 2023-05-08T12:10:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30355.107592 secs 2023-05-08T12:10:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:16 smithi096 ceph-mon[124666]: osdmap e1093: 12 total, 12 up, 12 in 2023-05-08T12:10:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:16 smithi186 ceph-mon[126480]: pgmap v16244: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 602 KiB/s rd, 334 KiB/s wr, 9 op/s 2023-05-08T12:10:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30355.107592 secs 2023-05-08T12:10:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:16 smithi186 ceph-mon[126480]: osdmap e1093: 12 total, 12 up, 12 in 2023-05-08T12:10:18.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:18 smithi096 ceph-mon[124666]: pgmap v16246: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 163 KiB/s wr, 8 op/s 2023-05-08T12:10:18.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:18 smithi186 ceph-mon[126480]: pgmap v16246: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 163 KiB/s wr, 8 op/s 2023-05-08T12:10:18.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:18 smithi133 ceph-mon[125939]: pgmap v16246: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 163 KiB/s wr, 8 op/s 2023-05-08T12:10:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30358.262006 secs 2023-05-08T12:10:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30358.817563 secs 2023-05-08T12:10:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30358.262006 secs 2023-05-08T12:10:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30358.817563 secs 2023-05-08T12:10:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30358.262006 secs 2023-05-08T12:10:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30358.817563 secs 2023-05-08T12:10:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:20 smithi096 ceph-mon[124666]: pgmap v16247: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 163 KiB/s wr, 8 op/s 2023-05-08T12:10:20.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:20 smithi186 ceph-mon[126480]: pgmap v16247: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 163 KiB/s wr, 8 op/s 2023-05-08T12:10:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:20 smithi133 ceph-mon[125939]: pgmap v16247: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 163 KiB/s wr, 8 op/s 2023-05-08T12:10:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30360.107713 secs 2023-05-08T12:10:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30360.107713 secs 2023-05-08T12:10:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30360.107713 secs 2023-05-08T12:10:22.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:22 smithi096 ceph-mon[124666]: pgmap v16248: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 121 KiB/s wr, 7 op/s 2023-05-08T12:10:22.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:22 smithi186 ceph-mon[126480]: pgmap v16248: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 121 KiB/s wr, 7 op/s 2023-05-08T12:10:22.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:22 smithi133 ceph-mon[125939]: pgmap v16248: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 121 KiB/s wr, 7 op/s 2023-05-08T12:10:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:24 smithi186 ceph-mon[126480]: pgmap v16249: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 121 KiB/s wr, 7 op/s 2023-05-08T12:10:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30363.262123 secs 2023-05-08T12:10:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30363.817679 secs 2023-05-08T12:10:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:24 smithi133 ceph-mon[125939]: pgmap v16249: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 121 KiB/s wr, 7 op/s 2023-05-08T12:10:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30363.262123 secs 2023-05-08T12:10:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30363.817679 secs 2023-05-08T12:10:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:24 smithi096 ceph-mon[124666]: pgmap v16249: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 121 KiB/s wr, 7 op/s 2023-05-08T12:10:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30363.262123 secs 2023-05-08T12:10:24.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30363.817679 secs 2023-05-08T12:10:26.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:26 smithi186 ceph-mon[126480]: pgmap v16250: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 7 op/s 2023-05-08T12:10:26.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30365.107855 secs 2023-05-08T12:10:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:26 smithi133 ceph-mon[125939]: pgmap v16250: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 7 op/s 2023-05-08T12:10:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30365.107855 secs 2023-05-08T12:10:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:26 smithi096 ceph-mon[124666]: pgmap v16250: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 7 op/s 2023-05-08T12:10:26.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30365.107855 secs 2023-05-08T12:10:28.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:28 smithi186 ceph-mon[126480]: pgmap v16251: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2023-05-08T12:10:28.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:28 smithi133 ceph-mon[125939]: pgmap v16251: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2023-05-08T12:10:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:28 smithi096 ceph-mon[124666]: pgmap v16251: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2023-05-08T12:10:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30368.262269 secs 2023-05-08T12:10:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30368.817752 secs 2023-05-08T12:10:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30368.262269 secs 2023-05-08T12:10:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30368.817752 secs 2023-05-08T12:10:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30368.262269 secs 2023-05-08T12:10:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30368.817752 secs 2023-05-08T12:10:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:30 smithi186 ceph-mon[126480]: pgmap v16252: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T12:10:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:30 smithi133 ceph-mon[125939]: pgmap v16252: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T12:10:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:30 smithi096 ceph-mon[124666]: pgmap v16252: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T12:10:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30370.107975 secs 2023-05-08T12:10:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30370.107975 secs 2023-05-08T12:10:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30370.107975 secs 2023-05-08T12:10:32.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:32 smithi186 ceph-mon[126480]: pgmap v16253: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T12:10:32.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:32 smithi133 ceph-mon[125939]: pgmap v16253: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T12:10:32.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:32 smithi096 ceph-mon[124666]: pgmap v16253: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T12:10:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:34 smithi186 ceph-mon[126480]: pgmap v16254: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T12:10:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30373.262413 secs 2023-05-08T12:10:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30373.817869 secs 2023-05-08T12:10:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:34 smithi133 ceph-mon[125939]: pgmap v16254: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T12:10:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30373.262413 secs 2023-05-08T12:10:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30373.817869 secs 2023-05-08T12:10:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:34 smithi096 ceph-mon[124666]: pgmap v16254: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T12:10:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30373.262413 secs 2023-05-08T12:10:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30373.817869 secs 2023-05-08T12:10:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:36 smithi186 ceph-mon[126480]: pgmap v16255: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 8 op/s 2023-05-08T12:10:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30375.108043 secs 2023-05-08T12:10:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:36 smithi133 ceph-mon[125939]: pgmap v16255: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 8 op/s 2023-05-08T12:10:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30375.108043 secs 2023-05-08T12:10:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:36 smithi096 ceph-mon[124666]: pgmap v16255: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 8 op/s 2023-05-08T12:10:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30375.108043 secs 2023-05-08T12:10:38.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:38 smithi186 ceph-mon[126480]: pgmap v16256: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 6 op/s 2023-05-08T12:10:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:38 smithi133 ceph-mon[125939]: pgmap v16256: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 6 op/s 2023-05-08T12:10:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:38 smithi096 ceph-mon[124666]: pgmap v16256: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 6 op/s 2023-05-08T12:10:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30378.262517 secs 2023-05-08T12:10:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30378.818002 secs 2023-05-08T12:10:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30378.262517 secs 2023-05-08T12:10:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30378.818002 secs 2023-05-08T12:10:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30378.262517 secs 2023-05-08T12:10:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30378.818002 secs 2023-05-08T12:10:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:40 smithi186 ceph-mon[126480]: pgmap v16257: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 6 op/s 2023-05-08T12:10:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:40 smithi133 ceph-mon[125939]: pgmap v16257: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 6 op/s 2023-05-08T12:10:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:40 smithi096 ceph-mon[124666]: pgmap v16257: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 6 op/s 2023-05-08T12:10:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30380.108163 secs 2023-05-08T12:10:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30380.108163 secs 2023-05-08T12:10:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30380.108163 secs 2023-05-08T12:10:42.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:42 smithi186 ceph-mon[126480]: pgmap v16258: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 938 B/s wr, 10 op/s 2023-05-08T12:10:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:42 smithi133 ceph-mon[125939]: pgmap v16258: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 938 B/s wr, 10 op/s 2023-05-08T12:10:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:42 smithi096 ceph-mon[124666]: pgmap v16258: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 938 B/s wr, 10 op/s 2023-05-08T12:10:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:44 smithi186 ceph-mon[126480]: pgmap v16259: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 7 op/s 2023-05-08T12:10:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30383.262581 secs 2023-05-08T12:10:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30383.818117 secs 2023-05-08T12:10:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:44 smithi133 ceph-mon[125939]: pgmap v16259: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 7 op/s 2023-05-08T12:10:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30383.262581 secs 2023-05-08T12:10:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30383.818117 secs 2023-05-08T12:10:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:44 smithi096 ceph-mon[124666]: pgmap v16259: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 7 op/s 2023-05-08T12:10:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30383.262581 secs 2023-05-08T12:10:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30383.818117 secs 2023-05-08T12:10:46.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:46 smithi186 ceph-mon[126480]: pgmap v16260: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 594 KiB/s rd, 583 KiB/s wr, 11 op/s 2023-05-08T12:10:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:46 smithi133 ceph-mon[125939]: pgmap v16260: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 594 KiB/s rd, 583 KiB/s wr, 11 op/s 2023-05-08T12:10:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:46 smithi096 ceph-mon[124666]: pgmap v16260: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 594 KiB/s rd, 583 KiB/s wr, 11 op/s 2023-05-08T12:10:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:48 smithi186 ceph-mon[126480]: pgmap v16261: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 596 KiB/s rd, 711 KiB/s wr, 8 op/s 2023-05-08T12:10:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:48 smithi133 ceph-mon[125939]: pgmap v16261: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 596 KiB/s rd, 711 KiB/s wr, 8 op/s 2023-05-08T12:10:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:48 smithi096 ceph-mon[124666]: pgmap v16261: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 596 KiB/s rd, 711 KiB/s wr, 8 op/s 2023-05-08T12:10:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:10:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30388.262698 secs 2023-05-08T12:10:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:10:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30388.262698 secs 2023-05-08T12:10:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:10:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30388.262698 secs 2023-05-08T12:10:50.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:50 smithi186 ceph-mon[126480]: pgmap v16262: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 596 KiB/s rd, 711 KiB/s wr, 8 op/s 2023-05-08T12:10:50.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:10:50.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:10:50.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:10:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:50 smithi133 ceph-mon[125939]: pgmap v16262: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 596 KiB/s rd, 711 KiB/s wr, 8 op/s 2023-05-08T12:10:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:10:50.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:10:50.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:10:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:50 smithi096 ceph-mon[124666]: pgmap v16262: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 596 KiB/s rd, 711 KiB/s wr, 8 op/s 2023-05-08T12:10:50.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:10:50.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:10:50.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:10:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:52 smithi186 ceph-mon[126480]: pgmap v16263: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 742 KiB/s rd, 945 KiB/s wr, 13 op/s 2023-05-08T12:10:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:52 smithi133 ceph-mon[125939]: pgmap v16263: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 742 KiB/s rd, 945 KiB/s wr, 13 op/s 2023-05-08T12:10:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:52 smithi096 ceph-mon[124666]: pgmap v16263: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 742 KiB/s rd, 945 KiB/s wr, 13 op/s 2023-05-08T12:10:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:53 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:10:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:53 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:10:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:53 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:10:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:54 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:10:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:54 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:10:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:54 smithi186 ceph-mon[126480]: pgmap v16264: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 741 KiB/s rd, 944 KiB/s wr, 9 op/s 2023-05-08T12:10:54.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30393.262814 secs 2023-05-08T12:10:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:54 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:10:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:54 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:10:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:54 smithi133 ceph-mon[125939]: pgmap v16264: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 741 KiB/s rd, 944 KiB/s wr, 9 op/s 2023-05-08T12:10:54.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30393.262814 secs 2023-05-08T12:10:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:54 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:10:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:54 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:10:54.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:54 smithi096 ceph-mon[124666]: pgmap v16264: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 741 KiB/s rd, 944 KiB/s wr, 9 op/s 2023-05-08T12:10:54.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30393.262814 secs 2023-05-08T12:10:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:56 smithi133 ceph-mon[125939]: pgmap v16265: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2023-05-08T12:10:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:56 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:10:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:56 smithi096 ceph-mon[124666]: pgmap v16265: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2023-05-08T12:10:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:56 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:10:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:56 smithi186 ceph-mon[126480]: pgmap v16265: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2023-05-08T12:10:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:56 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:10:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:10:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:10:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:10:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:58 smithi133 ceph-mon[125939]: pgmap v16266: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 696 KiB/s rd, 684 KiB/s wr, 10 op/s 2023-05-08T12:10:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:10:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:10:58.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:10:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:58 smithi096 ceph-mon[124666]: pgmap v16266: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 696 KiB/s rd, 684 KiB/s wr, 10 op/s 2023-05-08T12:10:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:10:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:10:58.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:10:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:58 smithi186 ceph-mon[126480]: pgmap v16266: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 696 KiB/s rd, 684 KiB/s wr, 10 op/s 2023-05-08T12:10:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:10:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:10:58.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:10:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:59 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:10:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:59 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T12:10:59.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:59 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T12:10:59.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:59 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:10:59.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:10:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30398.262922 secs 2023-05-08T12:10:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:59 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:10:59.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:59 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T12:10:59.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:59 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T12:10:59.509 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:59 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:10:59.509 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:10:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30398.262922 secs 2023-05-08T12:10:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:59 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:10:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:59 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T12:10:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:59 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T12:10:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:59 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:10:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:10:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30398.262922 secs 2023-05-08T12:11:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:00 smithi133 ceph-mon[125939]: pgmap v16267: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 693 KiB/s rd, 555 KiB/s wr, 9 op/s 2023-05-08T12:11:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:00 smithi096 ceph-mon[124666]: pgmap v16267: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 693 KiB/s rd, 555 KiB/s wr, 9 op/s 2023-05-08T12:11:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:00 smithi186 ceph-mon[126480]: pgmap v16267: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 693 KiB/s rd, 555 KiB/s wr, 9 op/s 2023-05-08T12:11:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:02 smithi186 ceph-mon[126480]: pgmap v16268: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1013 KiB/s rd, 978 KiB/s wr, 16 op/s 2023-05-08T12:11:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:02 smithi133 ceph-mon[125939]: pgmap v16268: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1013 KiB/s rd, 978 KiB/s wr, 16 op/s 2023-05-08T12:11:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:02 smithi096 ceph-mon[124666]: pgmap v16268: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1013 KiB/s rd, 978 KiB/s wr, 16 op/s 2023-05-08T12:11:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:04 smithi133 ceph-mon[125939]: pgmap v16269: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 867 KiB/s rd, 744 KiB/s wr, 11 op/s 2023-05-08T12:11:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30403.263058 secs 2023-05-08T12:11:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30403.818575 secs 2023-05-08T12:11:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:04 smithi096 ceph-mon[124666]: pgmap v16269: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 867 KiB/s rd, 744 KiB/s wr, 11 op/s 2023-05-08T12:11:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30403.263058 secs 2023-05-08T12:11:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30403.818575 secs 2023-05-08T12:11:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:04 smithi186 ceph-mon[126480]: pgmap v16269: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 867 KiB/s rd, 744 KiB/s wr, 11 op/s 2023-05-08T12:11:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30403.263058 secs 2023-05-08T12:11:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30403.818575 secs 2023-05-08T12:11:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:05 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:11:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:11:05.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:11:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:05 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:11:05.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:11:05.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:11:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:05 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:11:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:11:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:11:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:06 smithi133 ceph-mon[125939]: pgmap v16270: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 30 op/s 2023-05-08T12:11:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30405.108829 secs 2023-05-08T12:11:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:06 smithi096 ceph-mon[124666]: pgmap v16270: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 30 op/s 2023-05-08T12:11:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30405.108829 secs 2023-05-08T12:11:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:06 smithi186 ceph-mon[126480]: pgmap v16270: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 30 op/s 2023-05-08T12:11:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30405.108829 secs 2023-05-08T12:11:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:07 smithi096 ceph-mon[124666]: osdmap e1094: 12 total, 12 up, 12 in 2023-05-08T12:11:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:07 smithi186 ceph-mon[126480]: osdmap e1094: 12 total, 12 up, 12 in 2023-05-08T12:11:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:07 smithi133 ceph-mon[125939]: osdmap e1094: 12 total, 12 up, 12 in 2023-05-08T12:11:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:08 smithi096 ceph-mon[124666]: pgmap v16272: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 945 KiB/s rd, 944 KiB/s wr, 30 op/s 2023-05-08T12:11:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:08 smithi186 ceph-mon[126480]: pgmap v16272: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 945 KiB/s rd, 944 KiB/s wr, 30 op/s 2023-05-08T12:11:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:08 smithi133 ceph-mon[125939]: pgmap v16272: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 945 KiB/s rd, 944 KiB/s wr, 30 op/s 2023-05-08T12:11:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30408.263193 secs 2023-05-08T12:11:09.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30408.818684 secs 2023-05-08T12:11:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30408.263193 secs 2023-05-08T12:11:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30408.818684 secs 2023-05-08T12:11:09.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30408.263193 secs 2023-05-08T12:11:09.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30408.818684 secs 2023-05-08T12:11:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:10 smithi096 ceph-mon[124666]: pgmap v16273: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 945 KiB/s rd, 944 KiB/s wr, 30 op/s 2023-05-08T12:11:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:10 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:11:10.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:10 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:11:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:10 smithi186 ceph-mon[126480]: pgmap v16273: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 945 KiB/s rd, 944 KiB/s wr, 30 op/s 2023-05-08T12:11:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:10 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:11:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:10 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:11:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:10 smithi133 ceph-mon[125939]: pgmap v16273: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 945 KiB/s rd, 944 KiB/s wr, 30 op/s 2023-05-08T12:11:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:10 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:11:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:10 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:11:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30410.108949 secs 2023-05-08T12:11:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:11 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:11:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30410.108949 secs 2023-05-08T12:11:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:11 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:11:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30410.108949 secs 2023-05-08T12:11:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:11 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:11:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:12 smithi096 ceph-mon[124666]: pgmap v16274: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 437 KiB/s wr, 27 op/s 2023-05-08T12:11:12.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:12 smithi186 ceph-mon[126480]: pgmap v16274: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 437 KiB/s wr, 27 op/s 2023-05-08T12:11:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:12 smithi133 ceph-mon[125939]: pgmap v16274: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 437 KiB/s wr, 27 op/s 2023-05-08T12:11:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:14 smithi186 ceph-mon[126480]: pgmap v16275: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 437 KiB/s wr, 27 op/s 2023-05-08T12:11:14.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30413.263284 secs 2023-05-08T12:11:14.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30413.818761 secs 2023-05-08T12:11:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:14 smithi133 ceph-mon[125939]: pgmap v16275: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 437 KiB/s wr, 27 op/s 2023-05-08T12:11:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30413.263284 secs 2023-05-08T12:11:14.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30413.818761 secs 2023-05-08T12:11:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:14 smithi096 ceph-mon[124666]: pgmap v16275: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 437 KiB/s wr, 27 op/s 2023-05-08T12:11:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30413.263284 secs 2023-05-08T12:11:14.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30413.818761 secs 2023-05-08T12:11:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:16 smithi186 ceph-mon[126480]: pgmap v16276: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 304 KiB/s wr, 9 op/s 2023-05-08T12:11:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30415.109070 secs 2023-05-08T12:11:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:16 smithi186 ceph-mon[126480]: osdmap e1095: 12 total, 12 up, 12 in 2023-05-08T12:11:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:16 smithi133 ceph-mon[125939]: pgmap v16276: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 304 KiB/s wr, 9 op/s 2023-05-08T12:11:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30415.109070 secs 2023-05-08T12:11:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:16 smithi133 ceph-mon[125939]: osdmap e1095: 12 total, 12 up, 12 in 2023-05-08T12:11:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:16 smithi096 ceph-mon[124666]: pgmap v16276: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 304 KiB/s wr, 9 op/s 2023-05-08T12:11:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30415.109070 secs 2023-05-08T12:11:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:16 smithi096 ceph-mon[124666]: osdmap e1095: 12 total, 12 up, 12 in 2023-05-08T12:11:18.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:18 smithi186 ceph-mon[126480]: pgmap v16278: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 304 KiB/s wr, 9 op/s 2023-05-08T12:11:18.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:18 smithi133 ceph-mon[125939]: pgmap v16278: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 304 KiB/s wr, 9 op/s 2023-05-08T12:11:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:18 smithi096 ceph-mon[124666]: pgmap v16278: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 304 KiB/s wr, 9 op/s 2023-05-08T12:11:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30418.263435 secs 2023-05-08T12:11:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30418.818882 secs 2023-05-08T12:11:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30418.263435 secs 2023-05-08T12:11:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30418.818882 secs 2023-05-08T12:11:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30418.263435 secs 2023-05-08T12:11:19.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30418.818882 secs 2023-05-08T12:11:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:20 smithi186 ceph-mon[126480]: pgmap v16279: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 304 KiB/s wr, 9 op/s 2023-05-08T12:11:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:20 smithi133 ceph-mon[125939]: pgmap v16279: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 304 KiB/s wr, 9 op/s 2023-05-08T12:11:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:20 smithi096 ceph-mon[124666]: pgmap v16279: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 304 KiB/s wr, 9 op/s 2023-05-08T12:11:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30420.109152 secs 2023-05-08T12:11:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30420.109152 secs 2023-05-08T12:11:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30420.109152 secs 2023-05-08T12:11:22.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:22 smithi186 ceph-mon[126480]: pgmap v16280: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 303 KiB/s wr, 7 op/s 2023-05-08T12:11:22.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:22 smithi133 ceph-mon[125939]: pgmap v16280: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 303 KiB/s wr, 7 op/s 2023-05-08T12:11:22.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:22 smithi096 ceph-mon[124666]: pgmap v16280: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 303 KiB/s wr, 7 op/s 2023-05-08T12:11:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:24 smithi186 ceph-mon[126480]: pgmap v16281: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 303 KiB/s wr, 7 op/s 2023-05-08T12:11:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30423.263552 secs 2023-05-08T12:11:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30423.818999 secs 2023-05-08T12:11:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:24 smithi133 ceph-mon[125939]: pgmap v16281: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 303 KiB/s wr, 7 op/s 2023-05-08T12:11:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30423.263552 secs 2023-05-08T12:11:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30423.818999 secs 2023-05-08T12:11:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:24 smithi096 ceph-mon[124666]: pgmap v16281: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 303 KiB/s wr, 7 op/s 2023-05-08T12:11:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30423.263552 secs 2023-05-08T12:11:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30423.818999 secs 2023-05-08T12:11:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:26 smithi186 ceph-mon[126480]: pgmap v16282: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 111 KiB/s wr, 6 op/s 2023-05-08T12:11:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30425.109264 secs 2023-05-08T12:11:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:26 smithi133 ceph-mon[125939]: pgmap v16282: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 111 KiB/s wr, 6 op/s 2023-05-08T12:11:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30425.109264 secs 2023-05-08T12:11:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:26 smithi096 ceph-mon[124666]: pgmap v16282: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 111 KiB/s wr, 6 op/s 2023-05-08T12:11:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30425.109264 secs 2023-05-08T12:11:28.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:28 smithi186 ceph-mon[126480]: pgmap v16283: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 100 KiB/s wr, 5 op/s 2023-05-08T12:11:28.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:28 smithi133 ceph-mon[125939]: pgmap v16283: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 100 KiB/s wr, 5 op/s 2023-05-08T12:11:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:28 smithi096 ceph-mon[124666]: pgmap v16283: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 100 KiB/s wr, 5 op/s 2023-05-08T12:11:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30428.263667 secs 2023-05-08T12:11:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30428.819115 secs 2023-05-08T12:11:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30428.263667 secs 2023-05-08T12:11:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30428.819115 secs 2023-05-08T12:11:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30428.263667 secs 2023-05-08T12:11:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30428.819115 secs 2023-05-08T12:11:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:30 smithi186 ceph-mon[126480]: pgmap v16284: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 92 KiB/s wr, 5 op/s 2023-05-08T12:11:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:30 smithi133 ceph-mon[125939]: pgmap v16284: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 92 KiB/s wr, 5 op/s 2023-05-08T12:11:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:30 smithi096 ceph-mon[124666]: pgmap v16284: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 92 KiB/s wr, 5 op/s 2023-05-08T12:11:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30430.109384 secs 2023-05-08T12:11:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30430.109384 secs 2023-05-08T12:11:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30430.109384 secs 2023-05-08T12:11:32.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:32 smithi186 ceph-mon[126480]: pgmap v16285: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 92 KiB/s wr, 7 op/s 2023-05-08T12:11:32.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:32 smithi133 ceph-mon[125939]: pgmap v16285: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 92 KiB/s wr, 7 op/s 2023-05-08T12:11:32.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:32 smithi096 ceph-mon[124666]: pgmap v16285: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 92 KiB/s wr, 7 op/s 2023-05-08T12:11:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:34 smithi186 ceph-mon[126480]: pgmap v16286: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 92 KiB/s wr, 5 op/s 2023-05-08T12:11:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30433.263793 secs 2023-05-08T12:11:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30433.819240 secs 2023-05-08T12:11:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:34 smithi133 ceph-mon[125939]: pgmap v16286: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 92 KiB/s wr, 5 op/s 2023-05-08T12:11:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30433.263793 secs 2023-05-08T12:11:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30433.819240 secs 2023-05-08T12:11:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:34 smithi096 ceph-mon[124666]: pgmap v16286: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 92 KiB/s wr, 5 op/s 2023-05-08T12:11:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30433.263793 secs 2023-05-08T12:11:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30433.819240 secs 2023-05-08T12:11:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:36 smithi186 ceph-mon[126480]: pgmap v16287: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 93 KiB/s wr, 8 op/s 2023-05-08T12:11:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30435.109510 secs 2023-05-08T12:11:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:36 smithi133 ceph-mon[125939]: pgmap v16287: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 93 KiB/s wr, 8 op/s 2023-05-08T12:11:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30435.109510 secs 2023-05-08T12:11:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:36 smithi096 ceph-mon[124666]: pgmap v16287: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 93 KiB/s wr, 8 op/s 2023-05-08T12:11:36.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30435.109510 secs 2023-05-08T12:11:38.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:38 smithi186 ceph-mon[126480]: pgmap v16288: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T12:11:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:38 smithi133 ceph-mon[125939]: pgmap v16288: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T12:11:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:38 smithi096 ceph-mon[124666]: pgmap v16288: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T12:11:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30438.263929 secs 2023-05-08T12:11:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30438.819356 secs 2023-05-08T12:11:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30438.263929 secs 2023-05-08T12:11:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30438.819356 secs 2023-05-08T12:11:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30438.263929 secs 2023-05-08T12:11:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30438.819356 secs 2023-05-08T12:11:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:40 smithi186 ceph-mon[126480]: pgmap v16289: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T12:11:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:40 smithi133 ceph-mon[125939]: pgmap v16289: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T12:11:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:40 smithi096 ceph-mon[124666]: pgmap v16289: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T12:11:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30440.109631 secs 2023-05-08T12:11:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30440.109631 secs 2023-05-08T12:11:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30440.109631 secs 2023-05-08T12:11:42.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:42 smithi186 ceph-mon[126480]: pgmap v16290: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 118 KiB/s wr, 9 op/s 2023-05-08T12:11:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:42 smithi133 ceph-mon[125939]: pgmap v16290: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 118 KiB/s wr, 9 op/s 2023-05-08T12:11:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:42 smithi096 ceph-mon[124666]: pgmap v16290: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 118 KiB/s wr, 9 op/s 2023-05-08T12:11:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:44 smithi186 ceph-mon[126480]: pgmap v16291: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 118 KiB/s wr, 6 op/s 2023-05-08T12:11:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30443.264049 secs 2023-05-08T12:11:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30443.819486 secs 2023-05-08T12:11:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:44 smithi133 ceph-mon[125939]: pgmap v16291: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 118 KiB/s wr, 6 op/s 2023-05-08T12:11:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30443.264049 secs 2023-05-08T12:11:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30443.819486 secs 2023-05-08T12:11:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:44 smithi096 ceph-mon[124666]: pgmap v16291: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 118 KiB/s wr, 6 op/s 2023-05-08T12:11:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30443.264049 secs 2023-05-08T12:11:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30443.819486 secs 2023-05-08T12:11:46.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:46 smithi186 ceph-mon[126480]: pgmap v16292: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 119 KiB/s wr, 10 op/s 2023-05-08T12:11:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:46 smithi133 ceph-mon[125939]: pgmap v16292: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 119 KiB/s wr, 10 op/s 2023-05-08T12:11:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:46 smithi096 ceph-mon[124666]: pgmap v16292: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 119 KiB/s wr, 10 op/s 2023-05-08T12:11:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:48 smithi186 ceph-mon[126480]: pgmap v16293: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 118 KiB/s wr, 7 op/s 2023-05-08T12:11:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:48 smithi133 ceph-mon[125939]: pgmap v16293: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 118 KiB/s wr, 7 op/s 2023-05-08T12:11:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:48 smithi096 ceph-mon[124666]: pgmap v16293: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 118 KiB/s wr, 7 op/s 2023-05-08T12:11:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:11:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30448.264181 secs 2023-05-08T12:11:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30448.819597 secs 2023-05-08T12:11:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:11:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30448.264181 secs 2023-05-08T12:11:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30448.819597 secs 2023-05-08T12:11:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:11:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30448.264181 secs 2023-05-08T12:11:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30448.819597 secs 2023-05-08T12:11:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:50 smithi186 ceph-mon[126480]: pgmap v16294: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 118 KiB/s wr, 7 op/s 2023-05-08T12:11:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:11:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:11:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:11:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:50 smithi133 ceph-mon[125939]: pgmap v16294: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 118 KiB/s wr, 7 op/s 2023-05-08T12:11:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:11:50.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:11:50.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:11:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:50 smithi096 ceph-mon[124666]: pgmap v16294: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 118 KiB/s wr, 7 op/s 2023-05-08T12:11:50.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:11:50.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:11:50.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:11:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:52 smithi186 ceph-mon[126480]: pgmap v16295: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 381 KiB/s wr, 10 op/s 2023-05-08T12:11:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:52 smithi133 ceph-mon[125939]: pgmap v16295: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 381 KiB/s wr, 10 op/s 2023-05-08T12:11:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:52 smithi096 ceph-mon[124666]: pgmap v16295: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 381 KiB/s wr, 10 op/s 2023-05-08T12:11:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:54 smithi133 ceph-mon[125939]: pgmap v16296: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 263 KiB/s wr, 7 op/s 2023-05-08T12:11:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30453.264319 secs 2023-05-08T12:11:54.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:54 smithi096 ceph-mon[124666]: pgmap v16296: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 263 KiB/s wr, 7 op/s 2023-05-08T12:11:54.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30453.264319 secs 2023-05-08T12:11:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:54 smithi186 ceph-mon[126480]: pgmap v16296: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 263 KiB/s wr, 7 op/s 2023-05-08T12:11:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30453.264319 secs 2023-05-08T12:11:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:56 smithi133 ceph-mon[125939]: pgmap v16297: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 975 KiB/s rd, 842 KiB/s wr, 12 op/s 2023-05-08T12:11:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:56 smithi096 ceph-mon[124666]: pgmap v16297: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 975 KiB/s rd, 842 KiB/s wr, 12 op/s 2023-05-08T12:11:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:56 smithi186 ceph-mon[126480]: pgmap v16297: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 975 KiB/s rd, 842 KiB/s wr, 12 op/s 2023-05-08T12:11:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:11:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:11:57.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:11:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:58 smithi133 ceph-mon[125939]: pgmap v16298: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 973 KiB/s rd, 842 KiB/s wr, 9 op/s 2023-05-08T12:11:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:58 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:11:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:11:58.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:11:58.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:11:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:58 smithi096 ceph-mon[124666]: pgmap v16298: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 973 KiB/s rd, 842 KiB/s wr, 9 op/s 2023-05-08T12:11:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:58 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:11:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:11:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:11:58.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:11:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:58 smithi186 ceph-mon[126480]: pgmap v16298: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 973 KiB/s rd, 842 KiB/s wr, 9 op/s 2023-05-08T12:11:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:58 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:11:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:11:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:11:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:11:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30458.264403 secs 2023-05-08T12:11:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:11:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:11:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:11:59.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:11:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30458.819814 secs 2023-05-08T12:11:59.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30458.264403 secs 2023-05-08T12:11:59.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:11:59.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:11:59.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:11:59.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:11:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30458.819814 secs 2023-05-08T12:11:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30458.264403 secs 2023-05-08T12:11:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:11:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:11:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:11:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:11:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30458.819814 secs 2023-05-08T12:12:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:00 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:12:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:00 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T12:12:00.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:00 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T12:12:00.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:00 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:12:00.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:00 smithi133 ceph-mon[125939]: pgmap v16299: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 973 KiB/s rd, 842 KiB/s wr, 9 op/s 2023-05-08T12:12:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:00 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:12:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:00 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T12:12:00.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:00 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T12:12:00.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:00 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:12:00.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:00 smithi096 ceph-mon[124666]: pgmap v16299: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 973 KiB/s rd, 842 KiB/s wr, 9 op/s 2023-05-08T12:12:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:00 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:12:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:00 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T12:12:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:00 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T12:12:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:00 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:12:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:00 smithi186 ceph-mon[126480]: pgmap v16299: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 973 KiB/s rd, 842 KiB/s wr, 9 op/s 2023-05-08T12:12:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:02 smithi133 ceph-mon[125939]: pgmap v16300: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 16 op/s 2023-05-08T12:12:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:12:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:12:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:02 smithi096 ceph-mon[124666]: pgmap v16300: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 16 op/s 2023-05-08T12:12:02.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:12:02.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:12:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:02 smithi186 ceph-mon[126480]: pgmap v16300: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 16 op/s 2023-05-08T12:12:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:12:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:12:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:04 smithi133 ceph-mon[125939]: pgmap v16301: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 12 op/s 2023-05-08T12:12:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30463.264516 secs 2023-05-08T12:12:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30463.819939 secs 2023-05-08T12:12:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:04 smithi096 ceph-mon[124666]: pgmap v16301: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 12 op/s 2023-05-08T12:12:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30463.264516 secs 2023-05-08T12:12:04.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30463.819939 secs 2023-05-08T12:12:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:04 smithi186 ceph-mon[126480]: pgmap v16301: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 12 op/s 2023-05-08T12:12:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30463.264516 secs 2023-05-08T12:12:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30463.819939 secs 2023-05-08T12:12:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:06 smithi133 ceph-mon[125939]: pgmap v16302: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 29 op/s 2023-05-08T12:12:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:06 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:12:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:06 smithi096 ceph-mon[124666]: pgmap v16302: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 29 op/s 2023-05-08T12:12:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:06 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:12:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:06 smithi186 ceph-mon[126480]: pgmap v16302: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 29 op/s 2023-05-08T12:12:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:06 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:12:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:08 smithi133 ceph-mon[125939]: pgmap v16303: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 752 KiB/s rd, 754 KiB/s wr, 24 op/s 2023-05-08T12:12:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:08 smithi096 ceph-mon[124666]: pgmap v16303: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 752 KiB/s rd, 754 KiB/s wr, 24 op/s 2023-05-08T12:12:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:08 smithi186 ceph-mon[126480]: pgmap v16303: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 752 KiB/s rd, 754 KiB/s wr, 24 op/s 2023-05-08T12:12:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30468.264630 secs 2023-05-08T12:12:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30468.820053 secs 2023-05-08T12:12:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30468.264630 secs 2023-05-08T12:12:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30468.820053 secs 2023-05-08T12:12:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30468.264630 secs 2023-05-08T12:12:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30468.820053 secs 2023-05-08T12:12:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:10 smithi133 ceph-mon[125939]: pgmap v16304: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 752 KiB/s rd, 754 KiB/s wr, 24 op/s 2023-05-08T12:12:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:10 smithi096 ceph-mon[124666]: pgmap v16304: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 752 KiB/s rd, 754 KiB/s wr, 24 op/s 2023-05-08T12:12:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:10 smithi186 ceph-mon[126480]: pgmap v16304: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 752 KiB/s rd, 754 KiB/s wr, 24 op/s 2023-05-08T12:12:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30470.110295 secs 2023-05-08T12:12:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30470.110295 secs 2023-05-08T12:12:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30470.110295 secs 2023-05-08T12:12:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:12 smithi133 ceph-mon[125939]: pgmap v16305: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 32 op/s 2023-05-08T12:12:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:12 smithi133 ceph-mon[125939]: osdmap e1096: 12 total, 12 up, 12 in 2023-05-08T12:12:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:12 smithi096 ceph-mon[124666]: pgmap v16305: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 32 op/s 2023-05-08T12:12:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:12 smithi096 ceph-mon[124666]: osdmap e1096: 12 total, 12 up, 12 in 2023-05-08T12:12:12.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:12 smithi186 ceph-mon[126480]: pgmap v16305: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 32 op/s 2023-05-08T12:12:12.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:12 smithi186 ceph-mon[126480]: osdmap e1096: 12 total, 12 up, 12 in 2023-05-08T12:12:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:13 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:12:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:12:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:13 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:12:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:13 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:12:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:12:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:13 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:12:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:13 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:12:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:12:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:13 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:12:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:14 smithi186 ceph-mon[126480]: pgmap v16307: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 790 KiB/s rd, 920 KiB/s wr, 29 op/s 2023-05-08T12:12:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30473.264742 secs 2023-05-08T12:12:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30473.820194 secs 2023-05-08T12:12:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:14 smithi133 ceph-mon[125939]: pgmap v16307: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 790 KiB/s rd, 920 KiB/s wr, 29 op/s 2023-05-08T12:12:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30473.264742 secs 2023-05-08T12:12:14.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30473.820194 secs 2023-05-08T12:12:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:14 smithi096 ceph-mon[124666]: pgmap v16307: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 790 KiB/s rd, 920 KiB/s wr, 29 op/s 2023-05-08T12:12:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30473.264742 secs 2023-05-08T12:12:14.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30473.820194 secs 2023-05-08T12:12:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:16 smithi186 ceph-mon[126480]: pgmap v16308: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 491 KiB/s rd, 607 KiB/s wr, 14 op/s 2023-05-08T12:12:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30475.110415 secs 2023-05-08T12:12:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:16 smithi133 ceph-mon[125939]: pgmap v16308: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 491 KiB/s rd, 607 KiB/s wr, 14 op/s 2023-05-08T12:12:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30475.110415 secs 2023-05-08T12:12:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:16 smithi096 ceph-mon[124666]: pgmap v16308: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 491 KiB/s rd, 607 KiB/s wr, 14 op/s 2023-05-08T12:12:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30475.110415 secs 2023-05-08T12:12:18.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:18 smithi186 ceph-mon[126480]: pgmap v16309: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 583 KiB/s rd, 629 KiB/s wr, 14 op/s 2023-05-08T12:12:18.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:18 smithi133 ceph-mon[125939]: pgmap v16309: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 583 KiB/s rd, 629 KiB/s wr, 14 op/s 2023-05-08T12:12:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:18 smithi096 ceph-mon[124666]: pgmap v16309: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 583 KiB/s rd, 629 KiB/s wr, 14 op/s 2023-05-08T12:12:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30478.264852 secs 2023-05-08T12:12:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30478.820338 secs 2023-05-08T12:12:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30478.264852 secs 2023-05-08T12:12:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30478.820338 secs 2023-05-08T12:12:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30478.264852 secs 2023-05-08T12:12:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30478.820338 secs 2023-05-08T12:12:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:20 smithi186 ceph-mon[126480]: pgmap v16310: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 673 KiB/s rd, 718 KiB/s wr, 16 op/s 2023-05-08T12:12:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:20 smithi133 ceph-mon[125939]: pgmap v16310: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 673 KiB/s rd, 718 KiB/s wr, 16 op/s 2023-05-08T12:12:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:20 smithi096 ceph-mon[124666]: pgmap v16310: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 673 KiB/s rd, 718 KiB/s wr, 16 op/s 2023-05-08T12:12:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30480.110556 secs 2023-05-08T12:12:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:21 smithi186 ceph-mon[126480]: osdmap e1097: 12 total, 12 up, 12 in 2023-05-08T12:12:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30480.110556 secs 2023-05-08T12:12:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:21 smithi133 ceph-mon[125939]: osdmap e1097: 12 total, 12 up, 12 in 2023-05-08T12:12:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30480.110556 secs 2023-05-08T12:12:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:21 smithi096 ceph-mon[124666]: osdmap e1097: 12 total, 12 up, 12 in 2023-05-08T12:12:22.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:22 smithi186 ceph-mon[126480]: pgmap v16312: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 113 KiB/s wr, 8 op/s 2023-05-08T12:12:22.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:22 smithi133 ceph-mon[125939]: pgmap v16312: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 113 KiB/s wr, 8 op/s 2023-05-08T12:12:22.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:22 smithi096 ceph-mon[124666]: pgmap v16312: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 113 KiB/s wr, 8 op/s 2023-05-08T12:12:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:24 smithi186 ceph-mon[126480]: pgmap v16313: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 112 KiB/s wr, 8 op/s 2023-05-08T12:12:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30483.264964 secs 2023-05-08T12:12:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30483.820461 secs 2023-05-08T12:12:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:24 smithi133 ceph-mon[125939]: pgmap v16313: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 112 KiB/s wr, 8 op/s 2023-05-08T12:12:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30483.264964 secs 2023-05-08T12:12:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30483.820461 secs 2023-05-08T12:12:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:24 smithi096 ceph-mon[124666]: pgmap v16313: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 112 KiB/s wr, 8 op/s 2023-05-08T12:12:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30483.264964 secs 2023-05-08T12:12:24.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30483.820461 secs 2023-05-08T12:12:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:26 smithi186 ceph-mon[126480]: pgmap v16314: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 111 KiB/s wr, 7 op/s 2023-05-08T12:12:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30485.110692 secs 2023-05-08T12:12:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:26 smithi133 ceph-mon[125939]: pgmap v16314: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 111 KiB/s wr, 7 op/s 2023-05-08T12:12:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30485.110692 secs 2023-05-08T12:12:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:26 smithi096 ceph-mon[124666]: pgmap v16314: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 111 KiB/s wr, 7 op/s 2023-05-08T12:12:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30485.110692 secs 2023-05-08T12:12:28.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:28 smithi186 ceph-mon[126480]: pgmap v16315: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 89 KiB/s wr, 6 op/s 2023-05-08T12:12:28.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:28 smithi133 ceph-mon[125939]: pgmap v16315: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 89 KiB/s wr, 6 op/s 2023-05-08T12:12:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:28 smithi096 ceph-mon[124666]: pgmap v16315: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 89 KiB/s wr, 6 op/s 2023-05-08T12:12:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30488.265098 secs 2023-05-08T12:12:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30488.820591 secs 2023-05-08T12:12:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30488.265098 secs 2023-05-08T12:12:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30488.820591 secs 2023-05-08T12:12:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30488.265098 secs 2023-05-08T12:12:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30488.820591 secs 2023-05-08T12:12:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:30 smithi186 ceph-mon[126480]: pgmap v16316: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7 op/s 2023-05-08T12:12:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:30 smithi133 ceph-mon[125939]: pgmap v16316: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7 op/s 2023-05-08T12:12:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:30 smithi096 ceph-mon[124666]: pgmap v16316: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7 op/s 2023-05-08T12:12:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30490.110820 secs 2023-05-08T12:12:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30490.110820 secs 2023-05-08T12:12:31.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30490.110820 secs 2023-05-08T12:12:32.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:32 smithi186 ceph-mon[126480]: pgmap v16317: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2023-05-08T12:12:32.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:32 smithi133 ceph-mon[125939]: pgmap v16317: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2023-05-08T12:12:32.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:32 smithi096 ceph-mon[124666]: pgmap v16317: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2023-05-08T12:12:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:34 smithi186 ceph-mon[126480]: pgmap v16318: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T12:12:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30493.265195 secs 2023-05-08T12:12:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30493.820711 secs 2023-05-08T12:12:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:34 smithi133 ceph-mon[125939]: pgmap v16318: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T12:12:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30493.265195 secs 2023-05-08T12:12:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30493.820711 secs 2023-05-08T12:12:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:34 smithi096 ceph-mon[124666]: pgmap v16318: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T12:12:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30493.265195 secs 2023-05-08T12:12:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30493.820711 secs 2023-05-08T12:12:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:36 smithi186 ceph-mon[126480]: pgmap v16319: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 8 op/s 2023-05-08T12:12:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30495.110939 secs 2023-05-08T12:12:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:36 smithi133 ceph-mon[125939]: pgmap v16319: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 8 op/s 2023-05-08T12:12:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30495.110939 secs 2023-05-08T12:12:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:36 smithi096 ceph-mon[124666]: pgmap v16319: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 8 op/s 2023-05-08T12:12:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30495.110939 secs 2023-05-08T12:12:38.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:38 smithi186 ceph-mon[126480]: pgmap v16320: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 6 op/s 2023-05-08T12:12:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:38 smithi133 ceph-mon[125939]: pgmap v16320: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 6 op/s 2023-05-08T12:12:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:38 smithi096 ceph-mon[124666]: pgmap v16320: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 6 op/s 2023-05-08T12:12:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30498.265313 secs 2023-05-08T12:12:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30498.820868 secs 2023-05-08T12:12:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30498.265313 secs 2023-05-08T12:12:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30498.820868 secs 2023-05-08T12:12:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30498.265313 secs 2023-05-08T12:12:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30498.820868 secs 2023-05-08T12:12:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:40 smithi186 ceph-mon[126480]: pgmap v16321: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 234 KiB/s wr, 9 op/s 2023-05-08T12:12:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:40 smithi133 ceph-mon[125939]: pgmap v16321: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 234 KiB/s wr, 9 op/s 2023-05-08T12:12:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:40 smithi096 ceph-mon[124666]: pgmap v16321: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 234 KiB/s wr, 9 op/s 2023-05-08T12:12:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30500.111067 secs 2023-05-08T12:12:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30500.111067 secs 2023-05-08T12:12:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30500.111067 secs 2023-05-08T12:12:42.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:42 smithi186 ceph-mon[126480]: pgmap v16322: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 318 KiB/s wr, 7 op/s 2023-05-08T12:12:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:42 smithi133 ceph-mon[125939]: pgmap v16322: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 318 KiB/s wr, 7 op/s 2023-05-08T12:12:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:42 smithi096 ceph-mon[124666]: pgmap v16322: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 318 KiB/s wr, 7 op/s 2023-05-08T12:12:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:44 smithi186 ceph-mon[126480]: pgmap v16323: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 318 KiB/s wr, 7 op/s 2023-05-08T12:12:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30503.265445 secs 2023-05-08T12:12:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30503.820992 secs 2023-05-08T12:12:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:44 smithi133 ceph-mon[125939]: pgmap v16323: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 318 KiB/s wr, 7 op/s 2023-05-08T12:12:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30503.265445 secs 2023-05-08T12:12:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30503.820992 secs 2023-05-08T12:12:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:44 smithi096 ceph-mon[124666]: pgmap v16323: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 318 KiB/s wr, 7 op/s 2023-05-08T12:12:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30503.265445 secs 2023-05-08T12:12:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30503.820992 secs 2023-05-08T12:12:46.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:46 smithi186 ceph-mon[126480]: pgmap v16324: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 355 KiB/s rd, 352 KiB/s wr, 10 op/s 2023-05-08T12:12:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:46 smithi133 ceph-mon[125939]: pgmap v16324: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 355 KiB/s rd, 352 KiB/s wr, 10 op/s 2023-05-08T12:12:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:46 smithi096 ceph-mon[124666]: pgmap v16324: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 355 KiB/s rd, 352 KiB/s wr, 10 op/s 2023-05-08T12:12:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:48 smithi186 ceph-mon[126480]: pgmap v16325: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 610 KiB/s wr, 8 op/s 2023-05-08T12:12:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:48 smithi133 ceph-mon[125939]: pgmap v16325: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 610 KiB/s wr, 8 op/s 2023-05-08T12:12:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:48 smithi096 ceph-mon[124666]: pgmap v16325: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 610 KiB/s wr, 8 op/s 2023-05-08T12:12:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:12:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30508.265561 secs 2023-05-08T12:12:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30508.821121 secs 2023-05-08T12:12:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:12:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30508.265561 secs 2023-05-08T12:12:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30508.821121 secs 2023-05-08T12:12:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:12:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30508.265561 secs 2023-05-08T12:12:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30508.821121 secs 2023-05-08T12:12:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:50 smithi186 ceph-mon[126480]: pgmap v16326: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 355 KiB/s rd, 610 KiB/s wr, 10 op/s 2023-05-08T12:12:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:12:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:12:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:12:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:50 smithi133 ceph-mon[125939]: pgmap v16326: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 355 KiB/s rd, 610 KiB/s wr, 10 op/s 2023-05-08T12:12:50.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:12:50.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:12:50.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:12:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:50 smithi096 ceph-mon[124666]: pgmap v16326: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 355 KiB/s rd, 610 KiB/s wr, 10 op/s 2023-05-08T12:12:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:12:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:12:50.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:12:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:52 smithi186 ceph-mon[126480]: pgmap v16327: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 376 KiB/s wr, 8 op/s 2023-05-08T12:12:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:52 smithi133 ceph-mon[125939]: pgmap v16327: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 376 KiB/s wr, 8 op/s 2023-05-08T12:12:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:52 smithi096 ceph-mon[124666]: pgmap v16327: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 376 KiB/s wr, 8 op/s 2023-05-08T12:12:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:54 smithi133 ceph-mon[125939]: pgmap v16328: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 293 KiB/s wr, 7 op/s 2023-05-08T12:12:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30513.265677 secs 2023-05-08T12:12:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:54 smithi096 ceph-mon[124666]: pgmap v16328: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 293 KiB/s wr, 7 op/s 2023-05-08T12:12:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30513.265677 secs 2023-05-08T12:12:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:54 smithi186 ceph-mon[126480]: pgmap v16328: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 293 KiB/s wr, 7 op/s 2023-05-08T12:12:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30513.265677 secs 2023-05-08T12:12:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:56 smithi133 ceph-mon[125939]: pgmap v16329: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 961 KiB/s rd, 880 KiB/s wr, 12 op/s 2023-05-08T12:12:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:56 smithi096 ceph-mon[124666]: pgmap v16329: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 961 KiB/s rd, 880 KiB/s wr, 12 op/s 2023-05-08T12:12:56.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:56 smithi186 ceph-mon[126480]: pgmap v16329: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 961 KiB/s rd, 880 KiB/s wr, 12 op/s 2023-05-08T12:12:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:12:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:12:57.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:12:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:58 smithi133 ceph-mon[125939]: pgmap v16330: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 945 KiB/s rd, 846 KiB/s wr, 9 op/s 2023-05-08T12:12:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:58 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:12:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:12:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:12:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:58 smithi096 ceph-mon[124666]: pgmap v16330: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 945 KiB/s rd, 846 KiB/s wr, 9 op/s 2023-05-08T12:12:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:58 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:12:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:12:58.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:12:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:58 smithi186 ceph-mon[126480]: pgmap v16330: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 945 KiB/s rd, 846 KiB/s wr, 9 op/s 2023-05-08T12:12:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:58 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:12:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:12:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:12:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30518.265824 secs 2023-05-08T12:12:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:12:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:12:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30518.821365 secs 2023-05-08T12:12:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30518.265824 secs 2023-05-08T12:12:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:12:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:12:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30518.821365 secs 2023-05-08T12:12:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30518.265824 secs 2023-05-08T12:12:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:12:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:12:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30518.821365 secs 2023-05-08T12:13:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:00 smithi133 ceph-mon[125939]: pgmap v16331: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1024 KiB/s wr, 14 op/s 2023-05-08T12:13:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:13:00.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:13:00.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:00 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:13:00.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:13:00.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:00 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T12:13:00.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:00 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T12:13:00.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:00 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:13:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:00 smithi096 ceph-mon[124666]: pgmap v16331: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1024 KiB/s wr, 14 op/s 2023-05-08T12:13:00.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:13:00.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:13:00.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:00 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:13:00.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:13:00.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:00 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T12:13:00.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:00 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T12:13:00.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:00 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:13:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:00 smithi186 ceph-mon[126480]: pgmap v16331: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1024 KiB/s wr, 14 op/s 2023-05-08T12:13:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:13:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:13:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:00 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:13:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:13:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:00 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T12:13:00.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:00 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T12:13:00.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:00 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:13:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:02 smithi133 ceph-mon[125939]: pgmap v16332: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1023 KiB/s wr, 11 op/s 2023-05-08T12:13:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:13:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:13:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:02 smithi096 ceph-mon[124666]: pgmap v16332: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1023 KiB/s wr, 11 op/s 2023-05-08T12:13:02.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:13:02.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:13:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:02 smithi186 ceph-mon[126480]: pgmap v16332: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1023 KiB/s wr, 11 op/s 2023-05-08T12:13:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:13:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:13:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:04 smithi133 ceph-mon[125939]: pgmap v16333: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 910 KiB/s rd, 1023 KiB/s wr, 11 op/s 2023-05-08T12:13:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30523.265955 secs 2023-05-08T12:13:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:04 smithi096 ceph-mon[124666]: pgmap v16333: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 910 KiB/s rd, 1023 KiB/s wr, 11 op/s 2023-05-08T12:13:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30523.265955 secs 2023-05-08T12:13:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:04 smithi186 ceph-mon[126480]: pgmap v16333: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 910 KiB/s rd, 1023 KiB/s wr, 11 op/s 2023-05-08T12:13:04.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30523.265955 secs 2023-05-08T12:13:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:05 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:13:05.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:05 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:13:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:05 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:13:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:06 smithi133 ceph-mon[125939]: pgmap v16334: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 17 op/s 2023-05-08T12:13:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:06 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:13:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:13:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:13:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:06 smithi096 ceph-mon[124666]: pgmap v16334: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 17 op/s 2023-05-08T12:13:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:06 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:13:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:13:06.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:13:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:06 smithi186 ceph-mon[126480]: pgmap v16334: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 17 op/s 2023-05-08T12:13:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:06 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:13:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:13:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:13:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:08 smithi096 ceph-mon[124666]: pgmap v16335: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 748 KiB/s rd, 715 KiB/s wr, 13 op/s 2023-05-08T12:13:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:08 smithi186 ceph-mon[126480]: pgmap v16335: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 748 KiB/s rd, 715 KiB/s wr, 13 op/s 2023-05-08T12:13:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:08 smithi133 ceph-mon[125939]: pgmap v16335: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 748 KiB/s rd, 715 KiB/s wr, 13 op/s 2023-05-08T12:13:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30528.266069 secs 2023-05-08T12:13:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30528.821592 secs 2023-05-08T12:13:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30528.266069 secs 2023-05-08T12:13:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30528.821592 secs 2023-05-08T12:13:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30528.266069 secs 2023-05-08T12:13:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30528.821592 secs 2023-05-08T12:13:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:10 smithi096 ceph-mon[124666]: pgmap v16336: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 30 op/s 2023-05-08T12:13:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:10 smithi186 ceph-mon[126480]: pgmap v16336: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 30 op/s 2023-05-08T12:13:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:10 smithi133 ceph-mon[125939]: pgmap v16336: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 30 op/s 2023-05-08T12:13:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30530.111753 secs 2023-05-08T12:13:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30530.111753 secs 2023-05-08T12:13:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30530.111753 secs 2023-05-08T12:13:12.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:12 smithi186 ceph-mon[126480]: pgmap v16337: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 750 KiB/s rd, 783 KiB/s wr, 24 op/s 2023-05-08T12:13:12.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:12 smithi186 ceph-mon[126480]: osdmap e1098: 12 total, 12 up, 12 in 2023-05-08T12:13:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:12 smithi133 ceph-mon[125939]: pgmap v16337: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 750 KiB/s rd, 783 KiB/s wr, 24 op/s 2023-05-08T12:13:12.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:12 smithi133 ceph-mon[125939]: osdmap e1098: 12 total, 12 up, 12 in 2023-05-08T12:13:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:12 smithi096 ceph-mon[124666]: pgmap v16337: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 750 KiB/s rd, 783 KiB/s wr, 24 op/s 2023-05-08T12:13:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:12 smithi096 ceph-mon[124666]: osdmap e1098: 12 total, 12 up, 12 in 2023-05-08T12:13:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:13 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:13:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:13:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:13:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:13 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:13:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:13 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:13:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:13:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:13:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:13 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:13:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:13 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:13:13.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:13:13.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:13:13.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:13 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:13:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:14 smithi186 ceph-mon[126480]: pgmap v16339: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 901 KiB/s rd, 940 KiB/s wr, 29 op/s 2023-05-08T12:13:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30533.266189 secs 2023-05-08T12:13:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30533.821729 secs 2023-05-08T12:13:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:14 smithi133 ceph-mon[125939]: pgmap v16339: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 901 KiB/s rd, 940 KiB/s wr, 29 op/s 2023-05-08T12:13:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30533.266189 secs 2023-05-08T12:13:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30533.821729 secs 2023-05-08T12:13:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:14 smithi096 ceph-mon[124666]: pgmap v16339: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 901 KiB/s rd, 940 KiB/s wr, 29 op/s 2023-05-08T12:13:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30533.266189 secs 2023-05-08T12:13:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30533.821729 secs 2023-05-08T12:13:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:16 smithi186 ceph-mon[126480]: pgmap v16340: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 723 KiB/s rd, 765 KiB/s wr, 27 op/s 2023-05-08T12:13:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30535.111884 secs 2023-05-08T12:13:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:16 smithi133 ceph-mon[125939]: pgmap v16340: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 723 KiB/s rd, 765 KiB/s wr, 27 op/s 2023-05-08T12:13:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30535.111884 secs 2023-05-08T12:13:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:16 smithi096 ceph-mon[124666]: pgmap v16340: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 723 KiB/s rd, 765 KiB/s wr, 27 op/s 2023-05-08T12:13:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30535.111884 secs 2023-05-08T12:13:18.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:18 smithi186 ceph-mon[126480]: pgmap v16341: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 723 KiB/s rd, 765 KiB/s wr, 27 op/s 2023-05-08T12:13:18.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:18 smithi133 ceph-mon[125939]: pgmap v16341: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 723 KiB/s rd, 765 KiB/s wr, 27 op/s 2023-05-08T12:13:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:18 smithi096 ceph-mon[124666]: pgmap v16341: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 723 KiB/s rd, 765 KiB/s wr, 27 op/s 2023-05-08T12:13:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30538.266225 secs 2023-05-08T12:13:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30538.821850 secs 2023-05-08T12:13:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30538.266225 secs 2023-05-08T12:13:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30538.821850 secs 2023-05-08T12:13:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30538.266225 secs 2023-05-08T12:13:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30538.821850 secs 2023-05-08T12:13:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:20 smithi186 ceph-mon[126480]: pgmap v16342: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 592 KiB/s rd, 418 KiB/s wr, 9 op/s 2023-05-08T12:13:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:20 smithi133 ceph-mon[125939]: pgmap v16342: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 592 KiB/s rd, 418 KiB/s wr, 9 op/s 2023-05-08T12:13:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:20 smithi096 ceph-mon[124666]: pgmap v16342: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 592 KiB/s rd, 418 KiB/s wr, 9 op/s 2023-05-08T12:13:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30540.112009 secs 2023-05-08T12:13:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:21 smithi186 ceph-mon[126480]: osdmap e1099: 12 total, 12 up, 12 in 2023-05-08T12:13:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30540.112009 secs 2023-05-08T12:13:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:21 smithi133 ceph-mon[125939]: osdmap e1099: 12 total, 12 up, 12 in 2023-05-08T12:13:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30540.112009 secs 2023-05-08T12:13:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:21 smithi096 ceph-mon[124666]: osdmap e1099: 12 total, 12 up, 12 in 2023-05-08T12:13:22.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:22 smithi186 ceph-mon[126480]: pgmap v16344: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 598 KiB/s rd, 423 KiB/s wr, 10 op/s 2023-05-08T12:13:22.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:22 smithi133 ceph-mon[125939]: pgmap v16344: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 598 KiB/s rd, 423 KiB/s wr, 10 op/s 2023-05-08T12:13:22.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:22 smithi096 ceph-mon[124666]: pgmap v16344: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 598 KiB/s rd, 423 KiB/s wr, 10 op/s 2023-05-08T12:13:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:24 smithi186 ceph-mon[126480]: pgmap v16345: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 592 KiB/s rd, 418 KiB/s wr, 9 op/s 2023-05-08T12:13:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30543.266350 secs 2023-05-08T12:13:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30543.821960 secs 2023-05-08T12:13:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:24 smithi133 ceph-mon[125939]: pgmap v16345: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 592 KiB/s rd, 418 KiB/s wr, 9 op/s 2023-05-08T12:13:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30543.266350 secs 2023-05-08T12:13:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30543.821960 secs 2023-05-08T12:13:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:24 smithi096 ceph-mon[124666]: pgmap v16345: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 592 KiB/s rd, 418 KiB/s wr, 9 op/s 2023-05-08T12:13:24.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30543.266350 secs 2023-05-08T12:13:24.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30543.821960 secs 2023-05-08T12:13:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:26 smithi186 ceph-mon[126480]: pgmap v16346: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 261 KiB/s rd, 258 KiB/s wr, 7 op/s 2023-05-08T12:13:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30545.112123 secs 2023-05-08T12:13:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:26 smithi133 ceph-mon[125939]: pgmap v16346: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 261 KiB/s rd, 258 KiB/s wr, 7 op/s 2023-05-08T12:13:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30545.112123 secs 2023-05-08T12:13:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:26 smithi096 ceph-mon[124666]: pgmap v16346: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 261 KiB/s rd, 258 KiB/s wr, 7 op/s 2023-05-08T12:13:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30545.112123 secs 2023-05-08T12:13:28.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:28 smithi186 ceph-mon[126480]: pgmap v16347: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 261 KiB/s rd, 258 KiB/s wr, 7 op/s 2023-05-08T12:13:28.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:28 smithi133 ceph-mon[125939]: pgmap v16347: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 261 KiB/s rd, 258 KiB/s wr, 7 op/s 2023-05-08T12:13:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:28 smithi096 ceph-mon[124666]: pgmap v16347: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 261 KiB/s rd, 258 KiB/s wr, 7 op/s 2023-05-08T12:13:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30548.266465 secs 2023-05-08T12:13:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30548.822096 secs 2023-05-08T12:13:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30548.266465 secs 2023-05-08T12:13:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30548.822096 secs 2023-05-08T12:13:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30548.266465 secs 2023-05-08T12:13:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30548.822096 secs 2023-05-08T12:13:30.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:30 smithi186 ceph-mon[126480]: pgmap v16348: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 0 B/s wr, 6 op/s 2023-05-08T12:13:30.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:30 smithi133 ceph-mon[125939]: pgmap v16348: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 0 B/s wr, 6 op/s 2023-05-08T12:13:30.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:30 smithi096 ceph-mon[124666]: pgmap v16348: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 0 B/s wr, 6 op/s 2023-05-08T12:13:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30550.112249 secs 2023-05-08T12:13:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30550.112249 secs 2023-05-08T12:13:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30550.112249 secs 2023-05-08T12:13:32.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:32 smithi186 ceph-mon[126480]: pgmap v16349: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 0 B/s wr, 6 op/s 2023-05-08T12:13:32.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:32 smithi133 ceph-mon[125939]: pgmap v16349: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 0 B/s wr, 6 op/s 2023-05-08T12:13:32.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:32 smithi096 ceph-mon[124666]: pgmap v16349: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 0 B/s wr, 6 op/s 2023-05-08T12:13:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:34 smithi186 ceph-mon[126480]: pgmap v16350: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2023-05-08T12:13:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30553.266586 secs 2023-05-08T12:13:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30553.822224 secs 2023-05-08T12:13:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:34 smithi133 ceph-mon[125939]: pgmap v16350: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2023-05-08T12:13:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30553.266586 secs 2023-05-08T12:13:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30553.822224 secs 2023-05-08T12:13:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:34 smithi096 ceph-mon[124666]: pgmap v16350: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2023-05-08T12:13:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30553.266586 secs 2023-05-08T12:13:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30553.822224 secs 2023-05-08T12:13:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:36 smithi186 ceph-mon[126480]: pgmap v16351: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T12:13:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30555.112381 secs 2023-05-08T12:13:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:36 smithi133 ceph-mon[125939]: pgmap v16351: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T12:13:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30555.112381 secs 2023-05-08T12:13:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:36 smithi096 ceph-mon[124666]: pgmap v16351: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T12:13:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30555.112381 secs 2023-05-08T12:13:38.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:38 smithi186 ceph-mon[126480]: pgmap v16352: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T12:13:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:38 smithi133 ceph-mon[125939]: pgmap v16352: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T12:13:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:38 smithi096 ceph-mon[124666]: pgmap v16352: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T12:13:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30558.266700 secs 2023-05-08T12:13:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30558.822351 secs 2023-05-08T12:13:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30558.266700 secs 2023-05-08T12:13:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30558.822351 secs 2023-05-08T12:13:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30558.266700 secs 2023-05-08T12:13:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30558.822351 secs 2023-05-08T12:13:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:40 smithi133 ceph-mon[125939]: pgmap v16353: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T12:13:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:40 smithi096 ceph-mon[124666]: pgmap v16353: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T12:13:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:40 smithi186 ceph-mon[126480]: pgmap v16353: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 511 B/s wr, 8 op/s 2023-05-08T12:13:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30560.112447 secs 2023-05-08T12:13:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30560.112447 secs 2023-05-08T12:13:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30560.112447 secs 2023-05-08T12:13:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:42 smithi133 ceph-mon[125939]: pgmap v16354: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T12:13:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:42 smithi096 ceph-mon[124666]: pgmap v16354: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T12:13:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:42 smithi186 ceph-mon[126480]: pgmap v16354: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T12:13:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:44 smithi133 ceph-mon[125939]: pgmap v16355: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T12:13:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30563.266815 secs 2023-05-08T12:13:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30563.822494 secs 2023-05-08T12:13:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:44 smithi096 ceph-mon[124666]: pgmap v16355: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T12:13:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30563.266815 secs 2023-05-08T12:13:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30563.822494 secs 2023-05-08T12:13:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:44 smithi186 ceph-mon[126480]: pgmap v16355: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2023-05-08T12:13:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30563.266815 secs 2023-05-08T12:13:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30563.822494 secs 2023-05-08T12:13:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:46 smithi133 ceph-mon[125939]: pgmap v16356: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 119 KiB/s wr, 10 op/s 2023-05-08T12:13:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:46 smithi096 ceph-mon[124666]: pgmap v16356: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 119 KiB/s wr, 10 op/s 2023-05-08T12:13:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:46 smithi186 ceph-mon[126480]: pgmap v16356: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 119 KiB/s wr, 10 op/s 2023-05-08T12:13:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:48 smithi133 ceph-mon[125939]: pgmap v16357: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 119 KiB/s wr, 7 op/s 2023-05-08T12:13:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:13:48.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:48 smithi096 ceph-mon[124666]: pgmap v16357: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 119 KiB/s wr, 7 op/s 2023-05-08T12:13:48.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:13:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:48 smithi186 ceph-mon[126480]: pgmap v16357: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 119 KiB/s wr, 7 op/s 2023-05-08T12:13:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:13:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:13:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:13:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:13:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30568.266931 secs 2023-05-08T12:13:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30568.822609 secs 2023-05-08T12:13:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:13:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:13:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:13:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30568.266931 secs 2023-05-08T12:13:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30568.822609 secs 2023-05-08T12:13:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:13:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:13:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:13:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30568.266931 secs 2023-05-08T12:13:49.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30568.822609 secs 2023-05-08T12:13:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:50 smithi133 ceph-mon[125939]: pgmap v16358: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 385 KiB/s wr, 11 op/s 2023-05-08T12:13:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:50 smithi096 ceph-mon[124666]: pgmap v16358: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 385 KiB/s wr, 11 op/s 2023-05-08T12:13:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:50 smithi186 ceph-mon[126480]: pgmap v16358: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 385 KiB/s wr, 11 op/s 2023-05-08T12:13:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:52 smithi186 ceph-mon[126480]: pgmap v16359: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 384 KiB/s wr, 8 op/s 2023-05-08T12:13:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:52 smithi133 ceph-mon[125939]: pgmap v16359: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 384 KiB/s wr, 8 op/s 2023-05-08T12:13:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:52 smithi096 ceph-mon[124666]: pgmap v16359: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 384 KiB/s wr, 8 op/s 2023-05-08T12:13:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:54 smithi133 ceph-mon[125939]: pgmap v16360: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 384 KiB/s wr, 8 op/s 2023-05-08T12:13:54.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30573.267078 secs 2023-05-08T12:13:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:54 smithi096 ceph-mon[124666]: pgmap v16360: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 384 KiB/s wr, 8 op/s 2023-05-08T12:13:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30573.267078 secs 2023-05-08T12:13:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:54 smithi186 ceph-mon[126480]: pgmap v16360: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 384 KiB/s wr, 8 op/s 2023-05-08T12:13:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30573.267078 secs 2023-05-08T12:13:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:56 smithi133 ceph-mon[125939]: pgmap v16361: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 968 KiB/s wr, 12 op/s 2023-05-08T12:13:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:56 smithi096 ceph-mon[124666]: pgmap v16361: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 968 KiB/s wr, 12 op/s 2023-05-08T12:13:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:56 smithi186 ceph-mon[126480]: pgmap v16361: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 968 KiB/s wr, 12 op/s 2023-05-08T12:13:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:13:57.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:13:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:13:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:58 smithi133 ceph-mon[125939]: pgmap v16362: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 978 KiB/s rd, 850 KiB/s wr, 8 op/s 2023-05-08T12:13:58.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:58 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:13:58.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:13:58.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:13:58.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:58 smithi096 ceph-mon[124666]: pgmap v16362: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 978 KiB/s rd, 850 KiB/s wr, 8 op/s 2023-05-08T12:13:58.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:58 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:13:58.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:13:58.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:13:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:58 smithi186 ceph-mon[126480]: pgmap v16362: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 978 KiB/s rd, 850 KiB/s wr, 8 op/s 2023-05-08T12:13:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:58 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:13:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:13:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:13:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30578.267173 secs 2023-05-08T12:13:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:13:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30578.822804 secs 2023-05-08T12:13:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30578.267173 secs 2023-05-08T12:13:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:13:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30578.822804 secs 2023-05-08T12:13:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30578.267173 secs 2023-05-08T12:13:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:13:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30578.822804 secs 2023-05-08T12:14:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:00 smithi133 ceph-mon[125939]: pgmap v16363: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T12:14:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:14:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:00 smithi096 ceph-mon[124666]: pgmap v16363: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T12:14:00.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:14:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:00 smithi186 ceph-mon[126480]: pgmap v16363: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T12:14:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:14:02.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:02 smithi096 ceph-mon[124666]: pgmap v16364: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1023 KiB/s wr, 10 op/s 2023-05-08T12:14:02.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:14:02.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:14:02.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:02 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:14:02.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:02 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:14:02.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:02 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:14:02.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:02 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:14:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:02 smithi186 ceph-mon[126480]: pgmap v16364: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1023 KiB/s wr, 10 op/s 2023-05-08T12:14:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:14:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:14:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:02 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:14:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:02 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:14:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:02 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:14:02.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:02 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:14:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:02 smithi133 ceph-mon[125939]: pgmap v16364: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1023 KiB/s wr, 10 op/s 2023-05-08T12:14:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:14:02.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:14:02.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:02 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:14:02.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:02 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:14:02.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:02 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:14:02.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:02 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:14:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:14:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:14:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:14:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:14:03.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:14:03.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:14:03.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:14:03.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:14:03.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:14:03.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:14:03.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:14:03.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:14:03.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:14:03.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:14:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:14:03.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:14:03.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:14:03.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:14:03.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:14:03.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:14:03.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:14:03.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:14:03.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:14:03.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:14:03.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:14:03.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:14:03.744 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:14:03.744 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:14:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:14:03.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:14:03.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:14:03.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:14:03.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:14:03.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:14:03.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:14:03.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:14:03.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:14:03.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:14:03.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:14:03.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:14:03.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:14:03.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:14:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:04 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi133 to 152.4M 2023-05-08T12:14:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:04 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi133 to 159849959: error parsing value: Value '159849959' is below minimum 939524096 2023-05-08T12:14:04.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:04 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi186 to 142.9M 2023-05-08T12:14:04.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:04 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi186 to 149935050: error parsing value: Value '149935050' is below minimum 939524096 2023-05-08T12:14:04.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:04 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:14:04.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:04 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T12:14:04.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:04 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T12:14:04.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:04 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:14:04.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:04 smithi186 ceph-mon[126480]: pgmap v16365: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1023 KiB/s wr, 10 op/s 2023-05-08T12:14:04.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30583.267268 secs 2023-05-08T12:14:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:04 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi133 to 152.4M 2023-05-08T12:14:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:04 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi133 to 159849959: error parsing value: Value '159849959' is below minimum 939524096 2023-05-08T12:14:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:04 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi186 to 142.9M 2023-05-08T12:14:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:04 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi186 to 149935050: error parsing value: Value '149935050' is below minimum 939524096 2023-05-08T12:14:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:04 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:14:04.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:04 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T12:14:04.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:04 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T12:14:04.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:04 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:14:04.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:04 smithi133 ceph-mon[125939]: pgmap v16365: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1023 KiB/s wr, 10 op/s 2023-05-08T12:14:04.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30583.267268 secs 2023-05-08T12:14:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:04 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi133 to 152.4M 2023-05-08T12:14:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:04 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi133 to 159849959: error parsing value: Value '159849959' is below minimum 939524096 2023-05-08T12:14:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:04 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi186 to 142.9M 2023-05-08T12:14:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:04 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi186 to 149935050: error parsing value: Value '149935050' is below minimum 939524096 2023-05-08T12:14:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:04 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:14:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:04 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T12:14:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:04 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T12:14:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:04 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:14:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:04 smithi096 ceph-mon[124666]: pgmap v16365: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1023 KiB/s wr, 10 op/s 2023-05-08T12:14:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30583.267268 secs 2023-05-08T12:14:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:05 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:14:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:05 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:14:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:05 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:14:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:06 smithi186 ceph-mon[126480]: pgmap v16366: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 17 op/s 2023-05-08T12:14:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:06 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:14:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:14:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:14:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:06 smithi133 ceph-mon[125939]: pgmap v16366: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 17 op/s 2023-05-08T12:14:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:06 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:14:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:14:06.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:14:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:06 smithi096 ceph-mon[124666]: pgmap v16366: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 17 op/s 2023-05-08T12:14:06.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:06 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:14:06.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:14:06.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:14:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:08 smithi186 ceph-mon[126480]: pgmap v16367: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 826 KiB/s rd, 720 KiB/s wr, 13 op/s 2023-05-08T12:14:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:08 smithi133 ceph-mon[125939]: pgmap v16367: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 826 KiB/s rd, 720 KiB/s wr, 13 op/s 2023-05-08T12:14:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:08 smithi096 ceph-mon[124666]: pgmap v16367: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 826 KiB/s rd, 720 KiB/s wr, 13 op/s 2023-05-08T12:14:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30588.267344 secs 2023-05-08T12:14:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30588.822984 secs 2023-05-08T12:14:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30588.267344 secs 2023-05-08T12:14:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30588.822984 secs 2023-05-08T12:14:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30588.267344 secs 2023-05-08T12:14:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30588.822984 secs 2023-05-08T12:14:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:10 smithi186 ceph-mon[126480]: pgmap v16368: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 918 KiB/s rd, 1.1 MiB/s wr, 31 op/s 2023-05-08T12:14:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:10 smithi133 ceph-mon[125939]: pgmap v16368: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 918 KiB/s rd, 1.1 MiB/s wr, 31 op/s 2023-05-08T12:14:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:10 smithi096 ceph-mon[124666]: pgmap v16368: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 918 KiB/s rd, 1.1 MiB/s wr, 31 op/s 2023-05-08T12:14:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30590.113086 secs 2023-05-08T12:14:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30590.113086 secs 2023-05-08T12:14:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30590.113086 secs 2023-05-08T12:14:12.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:12 smithi186 ceph-mon[126480]: pgmap v16369: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 674 KiB/s wr, 25 op/s 2023-05-08T12:14:12.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:12 smithi186 ceph-mon[126480]: osdmap e1100: 12 total, 12 up, 12 in 2023-05-08T12:14:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:12 smithi133 ceph-mon[125939]: pgmap v16369: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 674 KiB/s wr, 25 op/s 2023-05-08T12:14:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:12 smithi133 ceph-mon[125939]: osdmap e1100: 12 total, 12 up, 12 in 2023-05-08T12:14:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:12 smithi096 ceph-mon[124666]: pgmap v16369: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 674 KiB/s wr, 25 op/s 2023-05-08T12:14:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:12 smithi096 ceph-mon[124666]: osdmap e1100: 12 total, 12 up, 12 in 2023-05-08T12:14:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:13 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:14:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:14:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:14:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:13 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:14:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:13 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:14:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:14:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:14:13.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:13 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:14:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:13 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:14:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:14:13.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:14:13.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:13 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:14:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:14 smithi186 ceph-mon[126480]: pgmap v16371: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 623 KiB/s rd, 808 KiB/s wr, 30 op/s 2023-05-08T12:14:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30593.267447 secs 2023-05-08T12:14:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30593.823071 secs 2023-05-08T12:14:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:14 smithi133 ceph-mon[125939]: pgmap v16371: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 623 KiB/s rd, 808 KiB/s wr, 30 op/s 2023-05-08T12:14:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30593.267447 secs 2023-05-08T12:14:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30593.823071 secs 2023-05-08T12:14:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:14 smithi096 ceph-mon[124666]: pgmap v16371: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 623 KiB/s rd, 808 KiB/s wr, 30 op/s 2023-05-08T12:14:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30593.267447 secs 2023-05-08T12:14:14.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30593.823071 secs 2023-05-08T12:14:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:16 smithi186 ceph-mon[126480]: pgmap v16372: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 590 KiB/s rd, 632 KiB/s wr, 26 op/s 2023-05-08T12:14:16.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30595.113239 secs 2023-05-08T12:14:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:16 smithi133 ceph-mon[125939]: pgmap v16372: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 590 KiB/s rd, 632 KiB/s wr, 26 op/s 2023-05-08T12:14:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30595.113239 secs 2023-05-08T12:14:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:16 smithi096 ceph-mon[124666]: pgmap v16372: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 590 KiB/s rd, 632 KiB/s wr, 26 op/s 2023-05-08T12:14:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30595.113239 secs 2023-05-08T12:14:18.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:18 smithi133 ceph-mon[125939]: pgmap v16373: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 590 KiB/s rd, 632 KiB/s wr, 26 op/s 2023-05-08T12:14:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:18 smithi096 ceph-mon[124666]: pgmap v16373: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 590 KiB/s rd, 632 KiB/s wr, 26 op/s 2023-05-08T12:14:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:18 smithi186 ceph-mon[126480]: pgmap v16373: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 590 KiB/s rd, 632 KiB/s wr, 26 op/s 2023-05-08T12:14:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30598.267558 secs 2023-05-08T12:14:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30598.823166 secs 2023-05-08T12:14:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30598.267558 secs 2023-05-08T12:14:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30598.823166 secs 2023-05-08T12:14:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30598.267558 secs 2023-05-08T12:14:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30598.823166 secs 2023-05-08T12:14:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:20 smithi133 ceph-mon[125939]: pgmap v16374: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 593 KiB/s rd, 273 KiB/s wr, 9 op/s 2023-05-08T12:14:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:20 smithi096 ceph-mon[124666]: pgmap v16374: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 593 KiB/s rd, 273 KiB/s wr, 9 op/s 2023-05-08T12:14:20.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:20 smithi186 ceph-mon[126480]: pgmap v16374: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 593 KiB/s rd, 273 KiB/s wr, 9 op/s 2023-05-08T12:14:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30600.113308 secs 2023-05-08T12:14:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:21 smithi133 ceph-mon[125939]: osdmap e1101: 12 total, 12 up, 12 in 2023-05-08T12:14:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30600.113308 secs 2023-05-08T12:14:21.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:21 smithi096 ceph-mon[124666]: osdmap e1101: 12 total, 12 up, 12 in 2023-05-08T12:14:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30600.113308 secs 2023-05-08T12:14:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:21 smithi186 ceph-mon[126480]: osdmap e1101: 12 total, 12 up, 12 in 2023-05-08T12:14:22.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:22 smithi133 ceph-mon[125939]: pgmap v16376: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 601 KiB/s rd, 277 KiB/s wr, 9 op/s 2023-05-08T12:14:22.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:22 smithi096 ceph-mon[124666]: pgmap v16376: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 601 KiB/s rd, 277 KiB/s wr, 9 op/s 2023-05-08T12:14:22.876 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:22 smithi186 ceph-mon[126480]: pgmap v16376: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 601 KiB/s rd, 277 KiB/s wr, 9 op/s 2023-05-08T12:14:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:24 smithi133 ceph-mon[125939]: pgmap v16377: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 593 KiB/s rd, 273 KiB/s wr, 9 op/s 2023-05-08T12:14:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30603.267677 secs 2023-05-08T12:14:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30603.823325 secs 2023-05-08T12:14:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:24 smithi096 ceph-mon[124666]: pgmap v16377: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 593 KiB/s rd, 273 KiB/s wr, 9 op/s 2023-05-08T12:14:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30603.267677 secs 2023-05-08T12:14:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30603.823325 secs 2023-05-08T12:14:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:24 smithi186 ceph-mon[126480]: pgmap v16377: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 593 KiB/s rd, 273 KiB/s wr, 9 op/s 2023-05-08T12:14:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30603.267677 secs 2023-05-08T12:14:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30603.823325 secs 2023-05-08T12:14:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:26 smithi133 ceph-mon[125939]: pgmap v16378: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 112 KiB/s wr, 7 op/s 2023-05-08T12:14:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30605.113373 secs 2023-05-08T12:14:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:26 smithi096 ceph-mon[124666]: pgmap v16378: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 112 KiB/s wr, 7 op/s 2023-05-08T12:14:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30605.113373 secs 2023-05-08T12:14:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:26 smithi186 ceph-mon[126480]: pgmap v16378: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 112 KiB/s wr, 7 op/s 2023-05-08T12:14:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30605.113373 secs 2023-05-08T12:14:28.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:28 smithi133 ceph-mon[125939]: pgmap v16379: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 112 KiB/s wr, 7 op/s 2023-05-08T12:14:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:28 smithi096 ceph-mon[124666]: pgmap v16379: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 112 KiB/s wr, 7 op/s 2023-05-08T12:14:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:28 smithi186 ceph-mon[126480]: pgmap v16379: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 112 KiB/s wr, 7 op/s 2023-05-08T12:14:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30608.267808 secs 2023-05-08T12:14:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30608.823448 secs 2023-05-08T12:14:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30608.267808 secs 2023-05-08T12:14:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30608.823448 secs 2023-05-08T12:14:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30608.267808 secs 2023-05-08T12:14:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30608.823448 secs 2023-05-08T12:14:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:30 smithi133 ceph-mon[125939]: pgmap v16380: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 0 B/s wr, 7 op/s 2023-05-08T12:14:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:30 smithi096 ceph-mon[124666]: pgmap v16380: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 0 B/s wr, 7 op/s 2023-05-08T12:14:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:30 smithi186 ceph-mon[126480]: pgmap v16380: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 0 B/s wr, 7 op/s 2023-05-08T12:14:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30610.113510 secs 2023-05-08T12:14:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30610.113510 secs 2023-05-08T12:14:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30610.113510 secs 2023-05-08T12:14:32.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:32 smithi133 ceph-mon[125939]: pgmap v16381: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 0 B/s wr, 7 op/s 2023-05-08T12:14:32.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:32 smithi096 ceph-mon[124666]: pgmap v16381: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 0 B/s wr, 7 op/s 2023-05-08T12:14:32.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:32 smithi186 ceph-mon[126480]: pgmap v16381: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 0 B/s wr, 7 op/s 2023-05-08T12:14:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:34 smithi133 ceph-mon[125939]: pgmap v16382: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2023-05-08T12:14:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30613.267896 secs 2023-05-08T12:14:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30613.823592 secs 2023-05-08T12:14:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:34 smithi096 ceph-mon[124666]: pgmap v16382: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2023-05-08T12:14:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30613.267896 secs 2023-05-08T12:14:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30613.823592 secs 2023-05-08T12:14:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:34 smithi186 ceph-mon[126480]: pgmap v16382: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2023-05-08T12:14:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30613.267896 secs 2023-05-08T12:14:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30613.823592 secs 2023-05-08T12:14:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:36 smithi133 ceph-mon[125939]: pgmap v16383: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 9 op/s 2023-05-08T12:14:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30615.113631 secs 2023-05-08T12:14:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:36 smithi096 ceph-mon[124666]: pgmap v16383: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 9 op/s 2023-05-08T12:14:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30615.113631 secs 2023-05-08T12:14:36.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:36 smithi186 ceph-mon[126480]: pgmap v16383: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 9 op/s 2023-05-08T12:14:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30615.113631 secs 2023-05-08T12:14:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:38 smithi133 ceph-mon[125939]: pgmap v16384: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 6 op/s 2023-05-08T12:14:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:38 smithi096 ceph-mon[124666]: pgmap v16384: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 6 op/s 2023-05-08T12:14:38.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:38 smithi186 ceph-mon[126480]: pgmap v16384: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 6 op/s 2023-05-08T12:14:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30618.268027 secs 2023-05-08T12:14:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30618.823735 secs 2023-05-08T12:14:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30618.268027 secs 2023-05-08T12:14:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30618.823735 secs 2023-05-08T12:14:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30618.268027 secs 2023-05-08T12:14:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30618.823735 secs 2023-05-08T12:14:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:40 smithi133 ceph-mon[125939]: pgmap v16385: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 236 KiB/s wr, 9 op/s 2023-05-08T12:14:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:40 smithi096 ceph-mon[124666]: pgmap v16385: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 236 KiB/s wr, 9 op/s 2023-05-08T12:14:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:40 smithi186 ceph-mon[126480]: pgmap v16385: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 236 KiB/s wr, 9 op/s 2023-05-08T12:14:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30620.113768 secs 2023-05-08T12:14:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30620.113768 secs 2023-05-08T12:14:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30620.113768 secs 2023-05-08T12:14:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:42 smithi133 ceph-mon[125939]: pgmap v16386: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 236 KiB/s wr, 6 op/s 2023-05-08T12:14:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:42 smithi096 ceph-mon[124666]: pgmap v16386: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 236 KiB/s wr, 6 op/s 2023-05-08T12:14:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:42 smithi186 ceph-mon[126480]: pgmap v16386: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 236 KiB/s wr, 6 op/s 2023-05-08T12:14:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:44 smithi133 ceph-mon[125939]: pgmap v16387: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 236 KiB/s wr, 6 op/s 2023-05-08T12:14:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30623.268141 secs 2023-05-08T12:14:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30623.823839 secs 2023-05-08T12:14:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:44 smithi096 ceph-mon[124666]: pgmap v16387: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 236 KiB/s wr, 6 op/s 2023-05-08T12:14:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30623.268141 secs 2023-05-08T12:14:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30623.823839 secs 2023-05-08T12:14:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:44 smithi186 ceph-mon[126480]: pgmap v16387: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 236 KiB/s wr, 6 op/s 2023-05-08T12:14:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30623.268141 secs 2023-05-08T12:14:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30623.823839 secs 2023-05-08T12:14:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:46 smithi133 ceph-mon[125939]: pgmap v16388: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 355 KiB/s wr, 10 op/s 2023-05-08T12:14:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:46 smithi096 ceph-mon[124666]: pgmap v16388: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 355 KiB/s wr, 10 op/s 2023-05-08T12:14:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:46 smithi186 ceph-mon[126480]: pgmap v16388: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 355 KiB/s wr, 10 op/s 2023-05-08T12:14:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:48 smithi133 ceph-mon[125939]: pgmap v16389: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 355 KiB/s wr, 7 op/s 2023-05-08T12:14:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:14:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:48 smithi096 ceph-mon[124666]: pgmap v16389: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 355 KiB/s wr, 7 op/s 2023-05-08T12:14:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:14:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:48 smithi186 ceph-mon[126480]: pgmap v16389: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 355 KiB/s wr, 7 op/s 2023-05-08T12:14:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:14:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:14:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:14:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:14:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30628.268251 secs 2023-05-08T12:14:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30628.823967 secs 2023-05-08T12:14:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:14:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:14:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:14:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30628.268251 secs 2023-05-08T12:14:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30628.823967 secs 2023-05-08T12:14:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:14:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:14:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:14:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30628.268251 secs 2023-05-08T12:14:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30628.823967 secs 2023-05-08T12:14:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:50 smithi133 ceph-mon[125939]: pgmap v16390: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 681 KiB/s rd, 616 KiB/s wr, 11 op/s 2023-05-08T12:14:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:50 smithi096 ceph-mon[124666]: pgmap v16390: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 681 KiB/s rd, 616 KiB/s wr, 11 op/s 2023-05-08T12:14:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:50 smithi186 ceph-mon[126480]: pgmap v16390: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 681 KiB/s rd, 616 KiB/s wr, 11 op/s 2023-05-08T12:14:52.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:52 smithi186 ceph-mon[126480]: pgmap v16391: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 380 KiB/s wr, 7 op/s 2023-05-08T12:14:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:52 smithi133 ceph-mon[125939]: pgmap v16391: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 380 KiB/s wr, 7 op/s 2023-05-08T12:14:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:52 smithi096 ceph-mon[124666]: pgmap v16391: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 380 KiB/s wr, 7 op/s 2023-05-08T12:14:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:54 smithi096 ceph-mon[124666]: pgmap v16392: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 380 KiB/s wr, 7 op/s 2023-05-08T12:14:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30633.268361 secs 2023-05-08T12:14:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:54 smithi186 ceph-mon[126480]: pgmap v16392: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 380 KiB/s wr, 7 op/s 2023-05-08T12:14:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30633.268361 secs 2023-05-08T12:14:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:54 smithi133 ceph-mon[125939]: pgmap v16392: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 380 KiB/s wr, 7 op/s 2023-05-08T12:14:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30633.268361 secs 2023-05-08T12:14:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:56 smithi096 ceph-mon[124666]: pgmap v16393: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 980 KiB/s wr, 13 op/s 2023-05-08T12:14:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:56 smithi186 ceph-mon[126480]: pgmap v16393: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 980 KiB/s wr, 13 op/s 2023-05-08T12:14:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:56 smithi133 ceph-mon[125939]: pgmap v16393: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 980 KiB/s wr, 13 op/s 2023-05-08T12:14:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:14:57.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:14:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:14:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:58 smithi096 ceph-mon[124666]: pgmap v16394: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 972 KiB/s rd, 1023 KiB/s wr, 9 op/s 2023-05-08T12:14:58.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:58 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:14:58.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:14:58.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:14:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:58 smithi186 ceph-mon[126480]: pgmap v16394: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 972 KiB/s rd, 1023 KiB/s wr, 9 op/s 2023-05-08T12:14:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:58 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:14:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:14:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:14:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:58 smithi133 ceph-mon[125939]: pgmap v16394: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 972 KiB/s rd, 1023 KiB/s wr, 9 op/s 2023-05-08T12:14:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:58 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:14:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:14:58.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:14:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30638.268476 secs 2023-05-08T12:14:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:14:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30638.824223 secs 2023-05-08T12:14:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30638.268476 secs 2023-05-08T12:14:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:14:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30638.824223 secs 2023-05-08T12:14:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30638.268476 secs 2023-05-08T12:14:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:14:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30638.824223 secs 2023-05-08T12:15:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:00 smithi186 ceph-mon[126480]: pgmap v16395: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 15 op/s 2023-05-08T12:15:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:00 smithi133 ceph-mon[125939]: pgmap v16395: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 15 op/s 2023-05-08T12:15:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:00 smithi096 ceph-mon[124666]: pgmap v16395: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 15 op/s 2023-05-08T12:15:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30640.114170 secs 2023-05-08T12:15:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30640.114170 secs 2023-05-08T12:15:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30640.114170 secs 2023-05-08T12:15:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:02 smithi186 ceph-mon[126480]: pgmap v16396: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T12:15:02.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:15:02.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:15:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:02 smithi133 ceph-mon[125939]: pgmap v16396: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T12:15:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:15:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:15:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:02 smithi096 ceph-mon[124666]: pgmap v16396: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T12:15:02.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:15:02.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:15:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:03 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:15:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:03 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:15:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:03 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:15:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:04 smithi186 ceph-mon[126480]: pgmap v16397: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T12:15:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30643.268551 secs 2023-05-08T12:15:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:04 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:15:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:04 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:15:04.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:04 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:15:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:04 smithi133 ceph-mon[125939]: pgmap v16397: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T12:15:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30643.268551 secs 2023-05-08T12:15:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:04 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:15:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:04 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:15:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:04 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:15:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:04 smithi096 ceph-mon[124666]: pgmap v16397: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T12:15:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30643.268551 secs 2023-05-08T12:15:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:04 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:15:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:04 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:15:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:04 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:15:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:05 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:15:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:05 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T12:15:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:05 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T12:15:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:05 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:15:05.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:05 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:15:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:05 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:15:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:05 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T12:15:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:05 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T12:15:05.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:05 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:15:05.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:05 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:15:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:05 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:15:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:05 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T12:15:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:05 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T12:15:05.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:05 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:15:05.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:05 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:15:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:06 smithi186 ceph-mon[126480]: pgmap v16398: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 19 op/s 2023-05-08T12:15:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:15:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:15:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:15:06.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30645.114308 secs 2023-05-08T12:15:06.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:06 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:15:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:06 smithi133 ceph-mon[125939]: pgmap v16398: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 19 op/s 2023-05-08T12:15:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:15:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:15:06.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:15:06.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30645.114308 secs 2023-05-08T12:15:06.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:06 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:15:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:06 smithi096 ceph-mon[124666]: pgmap v16398: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 19 op/s 2023-05-08T12:15:06.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:15:06.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:15:06.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:15:06.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30645.114308 secs 2023-05-08T12:15:06.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:06 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:15:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:08 smithi186 ceph-mon[126480]: pgmap v16399: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 783 KiB/s rd, 809 KiB/s wr, 15 op/s 2023-05-08T12:15:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:08 smithi133 ceph-mon[125939]: pgmap v16399: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 783 KiB/s rd, 809 KiB/s wr, 15 op/s 2023-05-08T12:15:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:08 smithi096 ceph-mon[124666]: pgmap v16399: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 783 KiB/s rd, 809 KiB/s wr, 15 op/s 2023-05-08T12:15:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30648.268670 secs 2023-05-08T12:15:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30648.824476 secs 2023-05-08T12:15:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30648.268670 secs 2023-05-08T12:15:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30648.824476 secs 2023-05-08T12:15:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30648.268670 secs 2023-05-08T12:15:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30648.824476 secs 2023-05-08T12:15:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:10 smithi186 ceph-mon[126480]: pgmap v16400: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 906 KiB/s rd, 811 KiB/s wr, 32 op/s 2023-05-08T12:15:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:10 smithi133 ceph-mon[125939]: pgmap v16400: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 906 KiB/s rd, 811 KiB/s wr, 32 op/s 2023-05-08T12:15:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:10 smithi096 ceph-mon[124666]: pgmap v16400: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 906 KiB/s rd, 811 KiB/s wr, 32 op/s 2023-05-08T12:15:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30650.114428 secs 2023-05-08T12:15:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30650.114428 secs 2023-05-08T12:15:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30650.114428 secs 2023-05-08T12:15:12.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:12 smithi186 ceph-mon[126480]: pgmap v16401: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 984 KiB/s wr, 28 op/s 2023-05-08T12:15:12.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:12 smithi186 ceph-mon[126480]: osdmap e1102: 12 total, 12 up, 12 in 2023-05-08T12:15:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:12 smithi133 ceph-mon[125939]: pgmap v16401: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 984 KiB/s wr, 28 op/s 2023-05-08T12:15:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:12 smithi133 ceph-mon[125939]: osdmap e1102: 12 total, 12 up, 12 in 2023-05-08T12:15:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:12 smithi096 ceph-mon[124666]: pgmap v16401: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 984 KiB/s wr, 28 op/s 2023-05-08T12:15:12.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:12 smithi096 ceph-mon[124666]: osdmap e1102: 12 total, 12 up, 12 in 2023-05-08T12:15:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:13 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:15:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:15:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:13 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:15:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:13 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:15:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:15:13.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:13 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:15:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:13 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:15:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:15:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:13 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:15:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:14 smithi186 ceph-mon[126480]: pgmap v16403: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 911 KiB/s rd, 950 KiB/s wr, 31 op/s 2023-05-08T12:15:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30653.268791 secs 2023-05-08T12:15:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30653.824631 secs 2023-05-08T12:15:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:14 smithi133 ceph-mon[125939]: pgmap v16403: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 911 KiB/s rd, 950 KiB/s wr, 31 op/s 2023-05-08T12:15:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30653.268791 secs 2023-05-08T12:15:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30653.824631 secs 2023-05-08T12:15:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:14 smithi096 ceph-mon[124666]: pgmap v16403: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 911 KiB/s rd, 950 KiB/s wr, 31 op/s 2023-05-08T12:15:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30653.268791 secs 2023-05-08T12:15:14.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30653.824631 secs 2023-05-08T12:15:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:16 smithi186 ceph-mon[126480]: pgmap v16404: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 881 KiB/s rd, 920 KiB/s wr, 29 op/s 2023-05-08T12:15:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30655.114581 secs 2023-05-08T12:15:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:16 smithi133 ceph-mon[125939]: pgmap v16404: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 881 KiB/s rd, 920 KiB/s wr, 29 op/s 2023-05-08T12:15:16.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30655.114581 secs 2023-05-08T12:15:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:16 smithi096 ceph-mon[124666]: pgmap v16404: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 881 KiB/s rd, 920 KiB/s wr, 29 op/s 2023-05-08T12:15:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30655.114581 secs 2023-05-08T12:15:18.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:18 smithi186 ceph-mon[126480]: pgmap v16405: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 831 KiB/s rd, 826 KiB/s wr, 28 op/s 2023-05-08T12:15:18.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:18 smithi133 ceph-mon[125939]: pgmap v16405: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 831 KiB/s rd, 826 KiB/s wr, 28 op/s 2023-05-08T12:15:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:18 smithi096 ceph-mon[124666]: pgmap v16405: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 831 KiB/s rd, 826 KiB/s wr, 28 op/s 2023-05-08T12:15:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30658.268881 secs 2023-05-08T12:15:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30658.824740 secs 2023-05-08T12:15:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30658.268881 secs 2023-05-08T12:15:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30658.824740 secs 2023-05-08T12:15:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30658.268881 secs 2023-05-08T12:15:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30658.824740 secs 2023-05-08T12:15:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:20 smithi133 ceph-mon[125939]: pgmap v16406: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 790 KiB/s rd, 742 KiB/s wr, 11 op/s 2023-05-08T12:15:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:20 smithi096 ceph-mon[124666]: pgmap v16406: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 790 KiB/s rd, 742 KiB/s wr, 11 op/s 2023-05-08T12:15:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:20 smithi186 ceph-mon[126480]: pgmap v16406: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 790 KiB/s rd, 742 KiB/s wr, 11 op/s 2023-05-08T12:15:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30660.114680 secs 2023-05-08T12:15:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:21 smithi133 ceph-mon[125939]: osdmap e1103: 12 total, 12 up, 12 in 2023-05-08T12:15:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30660.114680 secs 2023-05-08T12:15:21.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:21 smithi096 ceph-mon[124666]: osdmap e1103: 12 total, 12 up, 12 in 2023-05-08T12:15:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30660.114680 secs 2023-05-08T12:15:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:21 smithi186 ceph-mon[126480]: osdmap e1103: 12 total, 12 up, 12 in 2023-05-08T12:15:22.744 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:22 smithi133 ceph-mon[125939]: pgmap v16408: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 382 KiB/s wr, 9 op/s 2023-05-08T12:15:22.770 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:22 smithi096 ceph-mon[124666]: pgmap v16408: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 382 KiB/s wr, 9 op/s 2023-05-08T12:15:22.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:22 smithi186 ceph-mon[126480]: pgmap v16408: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 382 KiB/s wr, 9 op/s 2023-05-08T12:15:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:24 smithi133 ceph-mon[125939]: pgmap v16409: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 378 KiB/s wr, 9 op/s 2023-05-08T12:15:24.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30663.268977 secs 2023-05-08T12:15:24.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30663.824865 secs 2023-05-08T12:15:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:24 smithi096 ceph-mon[124666]: pgmap v16409: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 378 KiB/s wr, 9 op/s 2023-05-08T12:15:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30663.268977 secs 2023-05-08T12:15:24.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30663.824865 secs 2023-05-08T12:15:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:24 smithi186 ceph-mon[126480]: pgmap v16409: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 378 KiB/s wr, 9 op/s 2023-05-08T12:15:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30663.268977 secs 2023-05-08T12:15:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30663.824865 secs 2023-05-08T12:15:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:26 smithi133 ceph-mon[125939]: pgmap v16410: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 113 KiB/s wr, 7 op/s 2023-05-08T12:15:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30665.114803 secs 2023-05-08T12:15:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:26 smithi096 ceph-mon[124666]: pgmap v16410: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 113 KiB/s wr, 7 op/s 2023-05-08T12:15:26.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30665.114803 secs 2023-05-08T12:15:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:26 smithi186 ceph-mon[126480]: pgmap v16410: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 113 KiB/s wr, 7 op/s 2023-05-08T12:15:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30665.114803 secs 2023-05-08T12:15:28.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:28 smithi133 ceph-mon[125939]: pgmap v16411: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 113 KiB/s wr, 6 op/s 2023-05-08T12:15:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:28 smithi096 ceph-mon[124666]: pgmap v16411: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 113 KiB/s wr, 6 op/s 2023-05-08T12:15:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:28 smithi186 ceph-mon[126480]: pgmap v16411: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 113 KiB/s wr, 6 op/s 2023-05-08T12:15:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30668.269094 secs 2023-05-08T12:15:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30668.824994 secs 2023-05-08T12:15:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30668.269094 secs 2023-05-08T12:15:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30668.824994 secs 2023-05-08T12:15:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30668.269094 secs 2023-05-08T12:15:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30668.824994 secs 2023-05-08T12:15:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:30 smithi133 ceph-mon[125939]: pgmap v16412: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T12:15:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:30 smithi096 ceph-mon[124666]: pgmap v16412: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T12:15:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:30 smithi186 ceph-mon[126480]: pgmap v16412: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T12:15:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30670.114932 secs 2023-05-08T12:15:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30670.114932 secs 2023-05-08T12:15:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30670.114932 secs 2023-05-08T12:15:32.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:32 smithi133 ceph-mon[125939]: pgmap v16413: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T12:15:32.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:32 smithi096 ceph-mon[124666]: pgmap v16413: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T12:15:32.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:32 smithi186 ceph-mon[126480]: pgmap v16413: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T12:15:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:34 smithi133 ceph-mon[125939]: pgmap v16414: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T12:15:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30673.269243 secs 2023-05-08T12:15:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30673.825115 secs 2023-05-08T12:15:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:34 smithi096 ceph-mon[124666]: pgmap v16414: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T12:15:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30673.269243 secs 2023-05-08T12:15:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30673.825115 secs 2023-05-08T12:15:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:34 smithi186 ceph-mon[126480]: pgmap v16414: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T12:15:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30673.269243 secs 2023-05-08T12:15:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30673.825115 secs 2023-05-08T12:15:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:36 smithi133 ceph-mon[125939]: pgmap v16415: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T12:15:36.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30675.115058 secs 2023-05-08T12:15:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:36 smithi096 ceph-mon[124666]: pgmap v16415: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T12:15:36.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30675.115058 secs 2023-05-08T12:15:36.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:36 smithi186 ceph-mon[126480]: pgmap v16415: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T12:15:36.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30675.115058 secs 2023-05-08T12:15:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:38 smithi133 ceph-mon[125939]: pgmap v16416: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2023-05-08T12:15:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:38 smithi096 ceph-mon[124666]: pgmap v16416: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2023-05-08T12:15:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:38 smithi186 ceph-mon[126480]: pgmap v16416: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2023-05-08T12:15:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30678.269394 secs 2023-05-08T12:15:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30678.825238 secs 2023-05-08T12:15:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30678.269394 secs 2023-05-08T12:15:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30678.825238 secs 2023-05-08T12:15:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30678.269394 secs 2023-05-08T12:15:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30678.825238 secs 2023-05-08T12:15:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:40 smithi133 ceph-mon[125939]: pgmap v16417: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 511 B/s wr, 7 op/s 2023-05-08T12:15:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:40 smithi096 ceph-mon[124666]: pgmap v16417: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 511 B/s wr, 7 op/s 2023-05-08T12:15:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:40 smithi186 ceph-mon[126480]: pgmap v16417: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 511 B/s wr, 7 op/s 2023-05-08T12:15:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30680.115173 secs 2023-05-08T12:15:41.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30680.115173 secs 2023-05-08T12:15:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30680.115173 secs 2023-05-08T12:15:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:42 smithi133 ceph-mon[125939]: pgmap v16418: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 767 B/s wr, 6 op/s 2023-05-08T12:15:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:42 smithi096 ceph-mon[124666]: pgmap v16418: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 767 B/s wr, 6 op/s 2023-05-08T12:15:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:42 smithi186 ceph-mon[126480]: pgmap v16418: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 767 B/s wr, 6 op/s 2023-05-08T12:15:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:44 smithi133 ceph-mon[125939]: pgmap v16419: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 767 B/s wr, 5 op/s 2023-05-08T12:15:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30683.269512 secs 2023-05-08T12:15:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30683.825354 secs 2023-05-08T12:15:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:44 smithi096 ceph-mon[124666]: pgmap v16419: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 767 B/s wr, 5 op/s 2023-05-08T12:15:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30683.269512 secs 2023-05-08T12:15:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30683.825354 secs 2023-05-08T12:15:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:44 smithi186 ceph-mon[126480]: pgmap v16419: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 767 B/s wr, 5 op/s 2023-05-08T12:15:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30683.269512 secs 2023-05-08T12:15:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30683.825354 secs 2023-05-08T12:15:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:46 smithi133 ceph-mon[125939]: pgmap v16420: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 120 KiB/s wr, 9 op/s 2023-05-08T12:15:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:46 smithi096 ceph-mon[124666]: pgmap v16420: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 120 KiB/s wr, 9 op/s 2023-05-08T12:15:46.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:46 smithi186 ceph-mon[126480]: pgmap v16420: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 120 KiB/s wr, 9 op/s 2023-05-08T12:15:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:48 smithi133 ceph-mon[125939]: pgmap v16421: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 120 KiB/s wr, 8 op/s 2023-05-08T12:15:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:15:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:48 smithi096 ceph-mon[124666]: pgmap v16421: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 120 KiB/s wr, 8 op/s 2023-05-08T12:15:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:15:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:48 smithi186 ceph-mon[126480]: pgmap v16421: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 120 KiB/s wr, 8 op/s 2023-05-08T12:15:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:15:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:15:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:15:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:15:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30688.269573 secs 2023-05-08T12:15:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:15:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:15:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:15:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30688.269573 secs 2023-05-08T12:15:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:15:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:15:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:15:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30688.269573 secs 2023-05-08T12:15:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:50 smithi133 ceph-mon[125939]: pgmap v16422: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 12 op/s 2023-05-08T12:15:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:50 smithi096 ceph-mon[124666]: pgmap v16422: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 12 op/s 2023-05-08T12:15:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:50 smithi186 ceph-mon[126480]: pgmap v16422: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 12 op/s 2023-05-08T12:15:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:52 smithi186 ceph-mon[126480]: pgmap v16423: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T12:15:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:52 smithi133 ceph-mon[125939]: pgmap v16423: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T12:15:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:52 smithi096 ceph-mon[124666]: pgmap v16423: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T12:15:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:53 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:15:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:53 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:15:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:53 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:15:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:54 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:15:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:54 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:15:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:54 smithi186 ceph-mon[126480]: pgmap v16424: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 9 op/s 2023-05-08T12:15:54.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30693.269704 secs 2023-05-08T12:15:54.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:54 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:15:54.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:54 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:15:54.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:54 smithi133 ceph-mon[125939]: pgmap v16424: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 9 op/s 2023-05-08T12:15:54.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30693.269704 secs 2023-05-08T12:15:54.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:54 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:15:54.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:54 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:15:54.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:54 smithi096 ceph-mon[124666]: pgmap v16424: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 9 op/s 2023-05-08T12:15:54.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30693.269704 secs 2023-05-08T12:15:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30693.825610 secs 2023-05-08T12:15:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30693.825610 secs 2023-05-08T12:15:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30693.825610 secs 2023-05-08T12:15:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:56 smithi133 ceph-mon[125939]: pgmap v16425: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.6 MiB/s wr, 15 op/s 2023-05-08T12:15:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30695.115582 secs 2023-05-08T12:15:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:56 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:15:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:56 smithi096 ceph-mon[124666]: pgmap v16425: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.6 MiB/s wr, 15 op/s 2023-05-08T12:15:56.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30695.115582 secs 2023-05-08T12:15:56.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:56 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:15:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:56 smithi186 ceph-mon[126480]: pgmap v16425: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.6 MiB/s wr, 15 op/s 2023-05-08T12:15:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30695.115582 secs 2023-05-08T12:15:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:56 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:15:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:15:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:15:58.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:15:58.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:58 smithi133 ceph-mon[125939]: pgmap v16426: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 12 op/s 2023-05-08T12:15:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:15:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:15:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:15:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:58 smithi096 ceph-mon[124666]: pgmap v16426: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 12 op/s 2023-05-08T12:15:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:15:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:15:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:15:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:58 smithi186 ceph-mon[126480]: pgmap v16426: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 12 op/s 2023-05-08T12:15:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:15:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30698.269818 secs 2023-05-08T12:15:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:15:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30698.269818 secs 2023-05-08T12:15:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:15:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30698.269818 secs 2023-05-08T12:16:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:00 smithi133 ceph-mon[125939]: pgmap v16427: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.7 MiB/s wr, 17 op/s 2023-05-08T12:16:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:00 smithi096 ceph-mon[124666]: pgmap v16427: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.7 MiB/s wr, 17 op/s 2023-05-08T12:16:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:00 smithi186 ceph-mon[126480]: pgmap v16427: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.7 MiB/s wr, 17 op/s 2023-05-08T12:16:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30700.115725 secs 2023-05-08T12:16:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:01 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:16:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:01 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:16:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30700.115725 secs 2023-05-08T12:16:01.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:01 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:16:01.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:01 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:16:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30700.115725 secs 2023-05-08T12:16:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:01 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:16:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:01 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:16:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:16:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:16:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:02 smithi133 ceph-mon[125939]: pgmap v16428: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 768 KiB/s wr, 13 op/s 2023-05-08T12:16:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:16:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:16:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:02 smithi096 ceph-mon[124666]: pgmap v16428: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 768 KiB/s wr, 13 op/s 2023-05-08T12:16:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:16:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:16:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:02 smithi186 ceph-mon[126480]: pgmap v16428: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 768 KiB/s wr, 13 op/s 2023-05-08T12:16:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:04 smithi186 ceph-mon[126480]: pgmap v16429: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 748 KiB/s wr, 13 op/s 2023-05-08T12:16:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30703.269902 secs 2023-05-08T12:16:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:04 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:16:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30703.825830 secs 2023-05-08T12:16:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:04 smithi133 ceph-mon[125939]: pgmap v16429: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 748 KiB/s wr, 13 op/s 2023-05-08T12:16:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30703.269902 secs 2023-05-08T12:16:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:04 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:16:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30703.825830 secs 2023-05-08T12:16:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:04 smithi096 ceph-mon[124666]: pgmap v16429: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 748 KiB/s wr, 13 op/s 2023-05-08T12:16:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30703.269902 secs 2023-05-08T12:16:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:04 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:16:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30703.825830 secs 2023-05-08T12:16:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:05 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:16:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:05 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:16:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:05 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:16:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:05 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:16:05.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:05 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T12:16:05.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:05 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T12:16:05.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:05 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:16:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:05 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:16:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:05 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:16:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:05 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:16:05.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:05 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:16:05.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:05 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T12:16:05.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:05 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T12:16:05.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:05 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:16:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:05 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:16:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:05 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:16:05.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:05 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:16:05.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:05 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:16:05.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:05 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T12:16:05.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:05 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T12:16:05.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:05 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:16:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:06 smithi133 ceph-mon[125939]: pgmap v16430: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.3 MiB/s wr, 32 op/s 2023-05-08T12:16:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30705.115891 secs 2023-05-08T12:16:06.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:16:06.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:16:06.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:06 smithi133 ceph-mon[125939]: osdmap e1104: 12 total, 12 up, 12 in 2023-05-08T12:16:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:06 smithi096 ceph-mon[124666]: pgmap v16430: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.3 MiB/s wr, 32 op/s 2023-05-08T12:16:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30705.115891 secs 2023-05-08T12:16:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:16:06.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:16:06.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:06 smithi096 ceph-mon[124666]: osdmap e1104: 12 total, 12 up, 12 in 2023-05-08T12:16:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:06 smithi186 ceph-mon[126480]: pgmap v16430: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.3 MiB/s wr, 32 op/s 2023-05-08T12:16:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30705.115891 secs 2023-05-08T12:16:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:16:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:16:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:06 smithi186 ceph-mon[126480]: osdmap e1104: 12 total, 12 up, 12 in 2023-05-08T12:16:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:08 smithi133 ceph-mon[125939]: pgmap v16432: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 855 KiB/s wr, 31 op/s 2023-05-08T12:16:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:08 smithi096 ceph-mon[124666]: pgmap v16432: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 855 KiB/s wr, 31 op/s 2023-05-08T12:16:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:08 smithi186 ceph-mon[126480]: pgmap v16432: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 855 KiB/s wr, 31 op/s 2023-05-08T12:16:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30708.269992 secs 2023-05-08T12:16:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30708.825912 secs 2023-05-08T12:16:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30708.269992 secs 2023-05-08T12:16:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30708.825912 secs 2023-05-08T12:16:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30708.269992 secs 2023-05-08T12:16:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30708.825912 secs 2023-05-08T12:16:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:10 smithi133 ceph-mon[125939]: pgmap v16433: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 906 KiB/s rd, 702 KiB/s wr, 28 op/s 2023-05-08T12:16:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:10 smithi096 ceph-mon[124666]: pgmap v16433: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 906 KiB/s rd, 702 KiB/s wr, 28 op/s 2023-05-08T12:16:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:10 smithi186 ceph-mon[126480]: pgmap v16433: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 906 KiB/s rd, 702 KiB/s wr, 28 op/s 2023-05-08T12:16:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30710.116013 secs 2023-05-08T12:16:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30710.116013 secs 2023-05-08T12:16:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30710.116013 secs 2023-05-08T12:16:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:12 smithi133 ceph-mon[125939]: pgmap v16434: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 906 KiB/s rd, 678 KiB/s wr, 28 op/s 2023-05-08T12:16:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:12 smithi096 ceph-mon[124666]: pgmap v16434: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 906 KiB/s rd, 678 KiB/s wr, 28 op/s 2023-05-08T12:16:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:12 smithi186 ceph-mon[126480]: pgmap v16434: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 906 KiB/s rd, 678 KiB/s wr, 28 op/s 2023-05-08T12:16:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:14 smithi133 ceph-mon[125939]: pgmap v16435: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 906 KiB/s rd, 677 KiB/s wr, 28 op/s 2023-05-08T12:16:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30713.270108 secs 2023-05-08T12:16:14.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30713.826031 secs 2023-05-08T12:16:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:14 smithi096 ceph-mon[124666]: pgmap v16435: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 906 KiB/s rd, 677 KiB/s wr, 28 op/s 2023-05-08T12:16:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30713.270108 secs 2023-05-08T12:16:14.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30713.826031 secs 2023-05-08T12:16:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:14 smithi186 ceph-mon[126480]: pgmap v16435: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 906 KiB/s rd, 677 KiB/s wr, 28 op/s 2023-05-08T12:16:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30713.270108 secs 2023-05-08T12:16:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30713.826031 secs 2023-05-08T12:16:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:16 smithi133 ceph-mon[125939]: pgmap v16436: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 162 KiB/s wr, 9 op/s 2023-05-08T12:16:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30715.116139 secs 2023-05-08T12:16:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:16 smithi133 ceph-mon[125939]: osdmap e1105: 12 total, 12 up, 12 in 2023-05-08T12:16:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:16 smithi096 ceph-mon[124666]: pgmap v16436: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 162 KiB/s wr, 9 op/s 2023-05-08T12:16:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30715.116139 secs 2023-05-08T12:16:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:16 smithi096 ceph-mon[124666]: osdmap e1105: 12 total, 12 up, 12 in 2023-05-08T12:16:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:16 smithi186 ceph-mon[126480]: pgmap v16436: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 162 KiB/s wr, 9 op/s 2023-05-08T12:16:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30715.116139 secs 2023-05-08T12:16:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:16 smithi186 ceph-mon[126480]: osdmap e1105: 12 total, 12 up, 12 in 2023-05-08T12:16:18.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:18 smithi133 ceph-mon[125939]: pgmap v16438: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 162 KiB/s wr, 8 op/s 2023-05-08T12:16:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:18 smithi096 ceph-mon[124666]: pgmap v16438: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 162 KiB/s wr, 8 op/s 2023-05-08T12:16:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:18 smithi186 ceph-mon[126480]: pgmap v16438: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 162 KiB/s wr, 8 op/s 2023-05-08T12:16:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30718.270241 secs 2023-05-08T12:16:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30718.826130 secs 2023-05-08T12:16:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30718.270241 secs 2023-05-08T12:16:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30718.826130 secs 2023-05-08T12:16:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30718.270241 secs 2023-05-08T12:16:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30718.826130 secs 2023-05-08T12:16:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:20 smithi133 ceph-mon[125939]: pgmap v16439: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 161 KiB/s wr, 7 op/s 2023-05-08T12:16:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:20 smithi096 ceph-mon[124666]: pgmap v16439: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 161 KiB/s wr, 7 op/s 2023-05-08T12:16:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:20 smithi186 ceph-mon[126480]: pgmap v16439: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 161 KiB/s wr, 7 op/s 2023-05-08T12:16:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30720.116269 secs 2023-05-08T12:16:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30720.116269 secs 2023-05-08T12:16:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30720.116269 secs 2023-05-08T12:16:22.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:22 smithi133 ceph-mon[125939]: pgmap v16440: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 161 KiB/s wr, 6 op/s 2023-05-08T12:16:22.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:22 smithi096 ceph-mon[124666]: pgmap v16440: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 161 KiB/s wr, 6 op/s 2023-05-08T12:16:22.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:22 smithi186 ceph-mon[126480]: pgmap v16440: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 161 KiB/s wr, 6 op/s 2023-05-08T12:16:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:24 smithi096 ceph-mon[124666]: pgmap v16441: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 161 KiB/s wr, 6 op/s 2023-05-08T12:16:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30723.270358 secs 2023-05-08T12:16:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30723.826248 secs 2023-05-08T12:16:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:24 smithi186 ceph-mon[126480]: pgmap v16441: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 161 KiB/s wr, 6 op/s 2023-05-08T12:16:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30723.270358 secs 2023-05-08T12:16:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30723.826248 secs 2023-05-08T12:16:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:24 smithi133 ceph-mon[125939]: pgmap v16441: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 161 KiB/s wr, 6 op/s 2023-05-08T12:16:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30723.270358 secs 2023-05-08T12:16:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30723.826248 secs 2023-05-08T12:16:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30725.116402 secs 2023-05-08T12:16:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30725.116402 secs 2023-05-08T12:16:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30725.116402 secs 2023-05-08T12:16:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:26 smithi096 ceph-mon[124666]: pgmap v16442: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 0 B/s wr, 6 op/s 2023-05-08T12:16:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:26 smithi186 ceph-mon[126480]: pgmap v16442: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 0 B/s wr, 6 op/s 2023-05-08T12:16:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:26 smithi133 ceph-mon[125939]: pgmap v16442: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 0 B/s wr, 6 op/s 2023-05-08T12:16:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:28 smithi186 ceph-mon[126480]: pgmap v16443: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 0 B/s wr, 5 op/s 2023-05-08T12:16:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:28 smithi133 ceph-mon[125939]: pgmap v16443: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 0 B/s wr, 5 op/s 2023-05-08T12:16:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:28 smithi096 ceph-mon[124666]: pgmap v16443: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 0 B/s wr, 5 op/s 2023-05-08T12:16:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30728.270398 secs 2023-05-08T12:16:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30728.826372 secs 2023-05-08T12:16:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30728.270398 secs 2023-05-08T12:16:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30728.826372 secs 2023-05-08T12:16:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30728.270398 secs 2023-05-08T12:16:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30728.826372 secs 2023-05-08T12:16:30.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:30 smithi186 ceph-mon[126480]: pgmap v16444: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 30 KiB/s wr, 7 op/s 2023-05-08T12:16:30.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30730.116536 secs 2023-05-08T12:16:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:30 smithi133 ceph-mon[125939]: pgmap v16444: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 30 KiB/s wr, 7 op/s 2023-05-08T12:16:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30730.116536 secs 2023-05-08T12:16:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:30 smithi096 ceph-mon[124666]: pgmap v16444: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 30 KiB/s wr, 7 op/s 2023-05-08T12:16:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30730.116536 secs 2023-05-08T12:16:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:32 smithi186 ceph-mon[126480]: pgmap v16445: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 114 KiB/s wr, 6 op/s 2023-05-08T12:16:32.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:32 smithi133 ceph-mon[125939]: pgmap v16445: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 114 KiB/s wr, 6 op/s 2023-05-08T12:16:32.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:32 smithi096 ceph-mon[124666]: pgmap v16445: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 114 KiB/s wr, 6 op/s 2023-05-08T12:16:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:34 smithi186 ceph-mon[126480]: pgmap v16446: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 114 KiB/s wr, 5 op/s 2023-05-08T12:16:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30733.270511 secs 2023-05-08T12:16:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30733.826518 secs 2023-05-08T12:16:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:34 smithi133 ceph-mon[125939]: pgmap v16446: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 114 KiB/s wr, 5 op/s 2023-05-08T12:16:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30733.270511 secs 2023-05-08T12:16:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30733.826518 secs 2023-05-08T12:16:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:34 smithi096 ceph-mon[124666]: pgmap v16446: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 114 KiB/s wr, 5 op/s 2023-05-08T12:16:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30733.270511 secs 2023-05-08T12:16:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30733.826518 secs 2023-05-08T12:16:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:36 smithi186 ceph-mon[126480]: pgmap v16447: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 114 KiB/s wr, 8 op/s 2023-05-08T12:16:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30735.116659 secs 2023-05-08T12:16:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:36 smithi133 ceph-mon[125939]: pgmap v16447: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 114 KiB/s wr, 8 op/s 2023-05-08T12:16:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30735.116659 secs 2023-05-08T12:16:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:36 smithi096 ceph-mon[124666]: pgmap v16447: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 114 KiB/s wr, 8 op/s 2023-05-08T12:16:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30735.116659 secs 2023-05-08T12:16:38.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:38 smithi186 ceph-mon[126480]: pgmap v16448: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 470 KiB/s rd, 348 KiB/s wr, 7 op/s 2023-05-08T12:16:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:38 smithi133 ceph-mon[125939]: pgmap v16448: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 470 KiB/s rd, 348 KiB/s wr, 7 op/s 2023-05-08T12:16:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:38 smithi096 ceph-mon[124666]: pgmap v16448: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 470 KiB/s rd, 348 KiB/s wr, 7 op/s 2023-05-08T12:16:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30738.270649 secs 2023-05-08T12:16:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30738.826586 secs 2023-05-08T12:16:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30738.270649 secs 2023-05-08T12:16:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30738.826586 secs 2023-05-08T12:16:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30738.270649 secs 2023-05-08T12:16:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30738.826586 secs 2023-05-08T12:16:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:40 smithi186 ceph-mon[126480]: pgmap v16449: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 348 KiB/s wr, 9 op/s 2023-05-08T12:16:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:40 smithi133 ceph-mon[125939]: pgmap v16449: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 348 KiB/s wr, 9 op/s 2023-05-08T12:16:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:40 smithi096 ceph-mon[124666]: pgmap v16449: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 348 KiB/s wr, 9 op/s 2023-05-08T12:16:41.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30740.116786 secs 2023-05-08T12:16:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30740.116786 secs 2023-05-08T12:16:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30740.116786 secs 2023-05-08T12:16:42.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:42 smithi186 ceph-mon[126480]: pgmap v16450: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 318 KiB/s wr, 8 op/s 2023-05-08T12:16:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:42 smithi133 ceph-mon[125939]: pgmap v16450: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 318 KiB/s wr, 8 op/s 2023-05-08T12:16:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:42 smithi096 ceph-mon[124666]: pgmap v16450: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 318 KiB/s wr, 8 op/s 2023-05-08T12:16:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:44 smithi186 ceph-mon[126480]: pgmap v16451: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 234 KiB/s wr, 7 op/s 2023-05-08T12:16:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30743.270800 secs 2023-05-08T12:16:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30743.826704 secs 2023-05-08T12:16:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:44 smithi133 ceph-mon[125939]: pgmap v16451: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 234 KiB/s wr, 7 op/s 2023-05-08T12:16:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30743.270800 secs 2023-05-08T12:16:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30743.826704 secs 2023-05-08T12:16:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:44 smithi096 ceph-mon[124666]: pgmap v16451: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 234 KiB/s wr, 7 op/s 2023-05-08T12:16:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30743.270800 secs 2023-05-08T12:16:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30743.826704 secs 2023-05-08T12:16:46.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:46 smithi186 ceph-mon[126480]: pgmap v16452: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 381 KiB/s rd, 234 KiB/s wr, 9 op/s 2023-05-08T12:16:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:46 smithi133 ceph-mon[125939]: pgmap v16452: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 381 KiB/s rd, 234 KiB/s wr, 9 op/s 2023-05-08T12:16:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:46 smithi096 ceph-mon[124666]: pgmap v16452: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 381 KiB/s rd, 234 KiB/s wr, 9 op/s 2023-05-08T12:16:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:48 smithi186 ceph-mon[126480]: pgmap v16453: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 393 KiB/s rd, 258 KiB/s wr, 7 op/s 2023-05-08T12:16:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:48 smithi133 ceph-mon[125939]: pgmap v16453: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 393 KiB/s rd, 258 KiB/s wr, 7 op/s 2023-05-08T12:16:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:48 smithi096 ceph-mon[124666]: pgmap v16453: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 393 KiB/s rd, 258 KiB/s wr, 7 op/s 2023-05-08T12:16:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:16:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30748.270928 secs 2023-05-08T12:16:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30748.826826 secs 2023-05-08T12:16:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:16:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30748.270928 secs 2023-05-08T12:16:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30748.826826 secs 2023-05-08T12:16:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:16:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30748.270928 secs 2023-05-08T12:16:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30748.826826 secs 2023-05-08T12:16:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:50 smithi186 ceph-mon[126480]: pgmap v16454: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 367 KiB/s wr, 9 op/s 2023-05-08T12:16:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:16:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:16:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:16:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:50 smithi133 ceph-mon[125939]: pgmap v16454: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 367 KiB/s wr, 9 op/s 2023-05-08T12:16:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:16:50.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:16:50.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:16:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:50 smithi096 ceph-mon[124666]: pgmap v16454: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 367 KiB/s wr, 9 op/s 2023-05-08T12:16:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:16:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:16:50.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:16:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:52 smithi186 ceph-mon[126480]: pgmap v16455: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 366 KiB/s wr, 7 op/s 2023-05-08T12:16:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:52 smithi133 ceph-mon[125939]: pgmap v16455: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 366 KiB/s wr, 7 op/s 2023-05-08T12:16:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:52 smithi096 ceph-mon[124666]: pgmap v16455: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 366 KiB/s wr, 7 op/s 2023-05-08T12:16:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:54 smithi186 ceph-mon[126480]: pgmap v16456: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 366 KiB/s wr, 6 op/s 2023-05-08T12:16:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30753.271064 secs 2023-05-08T12:16:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:54 smithi133 ceph-mon[125939]: pgmap v16456: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 366 KiB/s wr, 6 op/s 2023-05-08T12:16:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30753.271064 secs 2023-05-08T12:16:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:54 smithi096 ceph-mon[124666]: pgmap v16456: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 366 KiB/s wr, 6 op/s 2023-05-08T12:16:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30753.271064 secs 2023-05-08T12:16:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:56 smithi186 ceph-mon[126480]: pgmap v16457: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 879 KiB/s rd, 728 KiB/s wr, 10 op/s 2023-05-08T12:16:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:56 smithi133 ceph-mon[125939]: pgmap v16457: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 879 KiB/s rd, 728 KiB/s wr, 10 op/s 2023-05-08T12:16:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:56 smithi096 ceph-mon[124666]: pgmap v16457: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 879 KiB/s rd, 728 KiB/s wr, 10 op/s 2023-05-08T12:16:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:16:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:16:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:16:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:58 smithi186 ceph-mon[126480]: pgmap v16458: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 878 KiB/s rd, 749 KiB/s wr, 9 op/s 2023-05-08T12:16:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:58 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:16:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:16:58.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:16:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:58 smithi133 ceph-mon[125939]: pgmap v16458: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 878 KiB/s rd, 749 KiB/s wr, 9 op/s 2023-05-08T12:16:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:58 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:16:58.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:16:58.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:16:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:58 smithi096 ceph-mon[124666]: pgmap v16458: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 878 KiB/s rd, 749 KiB/s wr, 9 op/s 2023-05-08T12:16:58.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:58 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:16:58.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:16:58.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:16:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30758.271178 secs 2023-05-08T12:16:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:16:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30758.827016 secs 2023-05-08T12:16:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30758.271178 secs 2023-05-08T12:16:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:16:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30758.827016 secs 2023-05-08T12:16:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30758.271178 secs 2023-05-08T12:16:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:16:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30758.827016 secs 2023-05-08T12:17:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:00 smithi186 ceph-mon[126480]: pgmap v16459: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T12:17:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:00 smithi133 ceph-mon[125939]: pgmap v16459: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T12:17:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:00 smithi096 ceph-mon[124666]: pgmap v16459: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T12:17:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30760.117177 secs 2023-05-08T12:17:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30760.117177 secs 2023-05-08T12:17:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30760.117177 secs 2023-05-08T12:17:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:02 smithi186 ceph-mon[126480]: pgmap v16460: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 881 KiB/s wr, 11 op/s 2023-05-08T12:17:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:17:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:17:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:02 smithi133 ceph-mon[125939]: pgmap v16460: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 881 KiB/s wr, 11 op/s 2023-05-08T12:17:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:17:02.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:17:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:02 smithi096 ceph-mon[124666]: pgmap v16460: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 881 KiB/s wr, 11 op/s 2023-05-08T12:17:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:17:02.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:17:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:04 smithi186 ceph-mon[126480]: pgmap v16461: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1012 KiB/s rd, 881 KiB/s wr, 10 op/s 2023-05-08T12:17:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30763.271320 secs 2023-05-08T12:17:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:04 smithi133 ceph-mon[125939]: pgmap v16461: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1012 KiB/s rd, 881 KiB/s wr, 10 op/s 2023-05-08T12:17:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30763.271320 secs 2023-05-08T12:17:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:04 smithi096 ceph-mon[124666]: pgmap v16461: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1012 KiB/s rd, 881 KiB/s wr, 10 op/s 2023-05-08T12:17:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30763.271320 secs 2023-05-08T12:17:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:05 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:17:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:05 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:17:05.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:05 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:17:05.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:05 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:17:05.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:05 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:17:05.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:05 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:17:05.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:05 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:17:05.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:05 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:17:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:05 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:17:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:05 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:17:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:05 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:17:05.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:05 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:17:05.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:05 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:17:05.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:05 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:17:05.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:05 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:17:05.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:05 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:17:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:05 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:17:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:05 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:17:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:05 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:17:05.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:05 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:17:05.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:05 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:17:05.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:05 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:17:05.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:05 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:17:05.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:05 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:17:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:06 smithi186 ceph-mon[126480]: pgmap v16462: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.0 MiB/s wr, 16 op/s 2023-05-08T12:17:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:17:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:17:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:17:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30765.117305 secs 2023-05-08T12:17:06.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:06 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:17:06.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:06 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:17:06.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:06 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:17:06.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:06 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:17:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:06 smithi133 ceph-mon[125939]: pgmap v16462: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.0 MiB/s wr, 16 op/s 2023-05-08T12:17:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:17:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:17:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:17:06.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30765.117305 secs 2023-05-08T12:17:06.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:06 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:17:06.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:06 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:17:06.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:06 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:17:06.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:06 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:17:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:06 smithi096 ceph-mon[124666]: pgmap v16462: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.0 MiB/s wr, 16 op/s 2023-05-08T12:17:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:17:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:17:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:17:06.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30765.117305 secs 2023-05-08T12:17:06.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:06 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:17:06.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:06 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:17:06.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:06 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:17:06.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:06 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:17:07.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:07 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:17:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:07 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T12:17:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:07 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T12:17:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:07 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:17:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:07 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:17:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:07 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T12:17:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:07 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T12:17:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:07 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:17:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:07 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:17:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:07 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T12:17:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:07 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T12:17:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:07 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:17:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:08 smithi186 ceph-mon[126480]: pgmap v16463: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 757 KiB/s rd, 713 KiB/s wr, 13 op/s 2023-05-08T12:17:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:08 smithi133 ceph-mon[125939]: pgmap v16463: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 757 KiB/s rd, 713 KiB/s wr, 13 op/s 2023-05-08T12:17:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:08 smithi096 ceph-mon[124666]: pgmap v16463: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 757 KiB/s rd, 713 KiB/s wr, 13 op/s 2023-05-08T12:17:09.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30768.271426 secs 2023-05-08T12:17:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30768.827277 secs 2023-05-08T12:17:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30768.271426 secs 2023-05-08T12:17:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30768.827277 secs 2023-05-08T12:17:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30768.271426 secs 2023-05-08T12:17:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30768.827277 secs 2023-05-08T12:17:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:10 smithi186 ceph-mon[126480]: pgmap v16464: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 808 KiB/s rd, 1.0 MiB/s wr, 30 op/s 2023-05-08T12:17:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:10 smithi133 ceph-mon[125939]: pgmap v16464: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 808 KiB/s rd, 1.0 MiB/s wr, 30 op/s 2023-05-08T12:17:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:10 smithi096 ceph-mon[124666]: pgmap v16464: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 808 KiB/s rd, 1.0 MiB/s wr, 30 op/s 2023-05-08T12:17:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30770.117408 secs 2023-05-08T12:17:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30770.117408 secs 2023-05-08T12:17:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30770.117408 secs 2023-05-08T12:17:12.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:12 smithi186 ceph-mon[126480]: pgmap v16465: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 527 KiB/s rd, 542 KiB/s wr, 26 op/s 2023-05-08T12:17:12.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:12 smithi186 ceph-mon[126480]: osdmap e1106: 12 total, 12 up, 12 in 2023-05-08T12:17:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:12 smithi133 ceph-mon[125939]: pgmap v16465: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 527 KiB/s rd, 542 KiB/s wr, 26 op/s 2023-05-08T12:17:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:12 smithi133 ceph-mon[125939]: osdmap e1106: 12 total, 12 up, 12 in 2023-05-08T12:17:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:12 smithi096 ceph-mon[124666]: pgmap v16465: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 527 KiB/s rd, 542 KiB/s wr, 26 op/s 2023-05-08T12:17:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:12 smithi096 ceph-mon[124666]: osdmap e1106: 12 total, 12 up, 12 in 2023-05-08T12:17:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:13 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:17:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:17:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:13 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:17:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:13 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:17:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:17:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:13 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:17:13.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:13 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:17:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:17:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:13 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:17:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:14 smithi133 ceph-mon[125939]: pgmap v16467: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 605 KiB/s rd, 646 KiB/s wr, 30 op/s 2023-05-08T12:17:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30773.271576 secs 2023-05-08T12:17:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30773.827345 secs 2023-05-08T12:17:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:14 smithi096 ceph-mon[124666]: pgmap v16467: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 605 KiB/s rd, 646 KiB/s wr, 30 op/s 2023-05-08T12:17:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30773.271576 secs 2023-05-08T12:17:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30773.827345 secs 2023-05-08T12:17:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:14 smithi186 ceph-mon[126480]: pgmap v16467: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 605 KiB/s rd, 646 KiB/s wr, 30 op/s 2023-05-08T12:17:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30773.271576 secs 2023-05-08T12:17:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30773.827345 secs 2023-05-08T12:17:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:16 smithi133 ceph-mon[125939]: pgmap v16468: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 620 KiB/s wr, 27 op/s 2023-05-08T12:17:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30775.117529 secs 2023-05-08T12:17:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:16 smithi096 ceph-mon[124666]: pgmap v16468: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 620 KiB/s wr, 27 op/s 2023-05-08T12:17:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30775.117529 secs 2023-05-08T12:17:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:16 smithi186 ceph-mon[126480]: pgmap v16468: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 620 KiB/s wr, 27 op/s 2023-05-08T12:17:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30775.117529 secs 2023-05-08T12:17:18.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:18 smithi133 ceph-mon[125939]: pgmap v16469: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 557 KiB/s rd, 574 KiB/s wr, 27 op/s 2023-05-08T12:17:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:18 smithi096 ceph-mon[124666]: pgmap v16469: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 557 KiB/s rd, 574 KiB/s wr, 27 op/s 2023-05-08T12:17:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:18 smithi186 ceph-mon[126480]: pgmap v16469: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 557 KiB/s rd, 574 KiB/s wr, 27 op/s 2023-05-08T12:17:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30778.271691 secs 2023-05-08T12:17:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30778.827501 secs 2023-05-08T12:17:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30778.271691 secs 2023-05-08T12:17:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30778.827501 secs 2023-05-08T12:17:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30778.271691 secs 2023-05-08T12:17:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30778.827501 secs 2023-05-08T12:17:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:20 smithi133 ceph-mon[125939]: pgmap v16470: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 749 KiB/s rd, 414 KiB/s wr, 9 op/s 2023-05-08T12:17:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:20 smithi096 ceph-mon[124666]: pgmap v16470: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 749 KiB/s rd, 414 KiB/s wr, 9 op/s 2023-05-08T12:17:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:20 smithi186 ceph-mon[126480]: pgmap v16470: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 749 KiB/s rd, 414 KiB/s wr, 9 op/s 2023-05-08T12:17:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30780.117596 secs 2023-05-08T12:17:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:21 smithi133 ceph-mon[125939]: osdmap e1107: 12 total, 12 up, 12 in 2023-05-08T12:17:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30780.117596 secs 2023-05-08T12:17:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:21 smithi096 ceph-mon[124666]: osdmap e1107: 12 total, 12 up, 12 in 2023-05-08T12:17:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30780.117596 secs 2023-05-08T12:17:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:21 smithi186 ceph-mon[126480]: osdmap e1107: 12 total, 12 up, 12 in 2023-05-08T12:17:22.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:22 smithi133 ceph-mon[125939]: pgmap v16472: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 733 KiB/s rd, 419 KiB/s wr, 9 op/s 2023-05-08T12:17:22.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:22 smithi096 ceph-mon[124666]: pgmap v16472: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 733 KiB/s rd, 419 KiB/s wr, 9 op/s 2023-05-08T12:17:22.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:22 smithi186 ceph-mon[126480]: pgmap v16472: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 733 KiB/s rd, 419 KiB/s wr, 9 op/s 2023-05-08T12:17:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:24 smithi133 ceph-mon[125939]: pgmap v16473: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 725 KiB/s rd, 414 KiB/s wr, 9 op/s 2023-05-08T12:17:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30783.271797 secs 2023-05-08T12:17:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30783.827611 secs 2023-05-08T12:17:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:24 smithi096 ceph-mon[124666]: pgmap v16473: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 725 KiB/s rd, 414 KiB/s wr, 9 op/s 2023-05-08T12:17:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30783.271797 secs 2023-05-08T12:17:24.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30783.827611 secs 2023-05-08T12:17:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:24 smithi186 ceph-mon[126480]: pgmap v16473: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 725 KiB/s rd, 414 KiB/s wr, 9 op/s 2023-05-08T12:17:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30783.271797 secs 2023-05-08T12:17:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30783.827611 secs 2023-05-08T12:17:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:26 smithi133 ceph-mon[125939]: pgmap v16474: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 253 KiB/s wr, 6 op/s 2023-05-08T12:17:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30785.117746 secs 2023-05-08T12:17:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:26 smithi096 ceph-mon[124666]: pgmap v16474: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 253 KiB/s wr, 6 op/s 2023-05-08T12:17:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30785.117746 secs 2023-05-08T12:17:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:26 smithi186 ceph-mon[126480]: pgmap v16474: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 253 KiB/s wr, 6 op/s 2023-05-08T12:17:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30785.117746 secs 2023-05-08T12:17:28.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:28 smithi133 ceph-mon[125939]: pgmap v16475: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 253 KiB/s wr, 6 op/s 2023-05-08T12:17:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:28 smithi096 ceph-mon[124666]: pgmap v16475: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 253 KiB/s wr, 6 op/s 2023-05-08T12:17:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:28 smithi186 ceph-mon[126480]: pgmap v16475: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 253 KiB/s wr, 6 op/s 2023-05-08T12:17:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30788.271913 secs 2023-05-08T12:17:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30788.827706 secs 2023-05-08T12:17:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30788.271913 secs 2023-05-08T12:17:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30788.827706 secs 2023-05-08T12:17:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30788.271913 secs 2023-05-08T12:17:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30788.827706 secs 2023-05-08T12:17:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:30 smithi133 ceph-mon[125939]: pgmap v16476: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T12:17:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:30 smithi096 ceph-mon[124666]: pgmap v16476: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T12:17:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:30 smithi186 ceph-mon[126480]: pgmap v16476: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T12:17:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30790.117865 secs 2023-05-08T12:17:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30790.117865 secs 2023-05-08T12:17:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30790.117865 secs 2023-05-08T12:17:32.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:32 smithi133 ceph-mon[125939]: pgmap v16477: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T12:17:32.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:32 smithi096 ceph-mon[124666]: pgmap v16477: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T12:17:32.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:32 smithi186 ceph-mon[126480]: pgmap v16477: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T12:17:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:34 smithi133 ceph-mon[125939]: pgmap v16478: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T12:17:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30793.272033 secs 2023-05-08T12:17:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30793.827826 secs 2023-05-08T12:17:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:34 smithi096 ceph-mon[124666]: pgmap v16478: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T12:17:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30793.272033 secs 2023-05-08T12:17:34.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30793.827826 secs 2023-05-08T12:17:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:34 smithi186 ceph-mon[126480]: pgmap v16478: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T12:17:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30793.272033 secs 2023-05-08T12:17:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30793.827826 secs 2023-05-08T12:17:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:36 smithi133 ceph-mon[125939]: pgmap v16479: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T12:17:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30795.117989 secs 2023-05-08T12:17:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:36 smithi096 ceph-mon[124666]: pgmap v16479: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T12:17:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30795.117989 secs 2023-05-08T12:17:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:36 smithi186 ceph-mon[126480]: pgmap v16479: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T12:17:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30795.117989 secs 2023-05-08T12:17:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:38 smithi133 ceph-mon[125939]: pgmap v16480: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2023-05-08T12:17:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:38 smithi096 ceph-mon[124666]: pgmap v16480: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2023-05-08T12:17:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:38 smithi186 ceph-mon[126480]: pgmap v16480: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2023-05-08T12:17:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30798.272166 secs 2023-05-08T12:17:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30798.827969 secs 2023-05-08T12:17:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30798.272166 secs 2023-05-08T12:17:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30798.827969 secs 2023-05-08T12:17:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30798.272166 secs 2023-05-08T12:17:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30798.827969 secs 2023-05-08T12:17:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:40 smithi133 ceph-mon[125939]: pgmap v16481: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 511 B/s wr, 7 op/s 2023-05-08T12:17:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:40 smithi096 ceph-mon[124666]: pgmap v16481: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 511 B/s wr, 7 op/s 2023-05-08T12:17:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:40 smithi186 ceph-mon[126480]: pgmap v16481: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 511 B/s wr, 7 op/s 2023-05-08T12:17:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30800.118108 secs 2023-05-08T12:17:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30800.118108 secs 2023-05-08T12:17:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30800.118108 secs 2023-05-08T12:17:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:42 smithi133 ceph-mon[125939]: pgmap v16482: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 767 B/s wr, 6 op/s 2023-05-08T12:17:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:42 smithi096 ceph-mon[124666]: pgmap v16482: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 767 B/s wr, 6 op/s 2023-05-08T12:17:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:42 smithi186 ceph-mon[126480]: pgmap v16482: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 767 B/s wr, 6 op/s 2023-05-08T12:17:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:44 smithi133 ceph-mon[125939]: pgmap v16483: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 767 B/s wr, 6 op/s 2023-05-08T12:17:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30803.272289 secs 2023-05-08T12:17:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30803.828058 secs 2023-05-08T12:17:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:44 smithi096 ceph-mon[124666]: pgmap v16483: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 767 B/s wr, 6 op/s 2023-05-08T12:17:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30803.272289 secs 2023-05-08T12:17:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30803.828058 secs 2023-05-08T12:17:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:44 smithi186 ceph-mon[126480]: pgmap v16483: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 767 B/s wr, 6 op/s 2023-05-08T12:17:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30803.272289 secs 2023-05-08T12:17:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30803.828058 secs 2023-05-08T12:17:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:46 smithi133 ceph-mon[125939]: pgmap v16484: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 119 KiB/s wr, 9 op/s 2023-05-08T12:17:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:46 smithi096 ceph-mon[124666]: pgmap v16484: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 119 KiB/s wr, 9 op/s 2023-05-08T12:17:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:46 smithi186 ceph-mon[126480]: pgmap v16484: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 119 KiB/s wr, 9 op/s 2023-05-08T12:17:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:48 smithi133 ceph-mon[125939]: pgmap v16485: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 119 KiB/s wr, 7 op/s 2023-05-08T12:17:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:17:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:48 smithi096 ceph-mon[124666]: pgmap v16485: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 119 KiB/s wr, 7 op/s 2023-05-08T12:17:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:17:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:48 smithi186 ceph-mon[126480]: pgmap v16485: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 119 KiB/s wr, 7 op/s 2023-05-08T12:17:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:17:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:17:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:17:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:17:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30808.272382 secs 2023-05-08T12:17:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30808.828182 secs 2023-05-08T12:17:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:17:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:17:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:17:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30808.272382 secs 2023-05-08T12:17:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30808.828182 secs 2023-05-08T12:17:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:17:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:17:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:17:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30808.272382 secs 2023-05-08T12:17:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30808.828182 secs 2023-05-08T12:17:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:50 smithi133 ceph-mon[125939]: pgmap v16486: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 609 KiB/s rd, 436 KiB/s wr, 10 op/s 2023-05-08T12:17:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:50 smithi096 ceph-mon[124666]: pgmap v16486: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 609 KiB/s rd, 436 KiB/s wr, 10 op/s 2023-05-08T12:17:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:50 smithi186 ceph-mon[126480]: pgmap v16486: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 609 KiB/s rd, 436 KiB/s wr, 10 op/s 2023-05-08T12:17:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:52 smithi133 ceph-mon[125939]: pgmap v16487: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 607 KiB/s rd, 435 KiB/s wr, 8 op/s 2023-05-08T12:17:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:52 smithi096 ceph-mon[124666]: pgmap v16487: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 607 KiB/s rd, 435 KiB/s wr, 8 op/s 2023-05-08T12:17:52.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:52 smithi186 ceph-mon[126480]: pgmap v16487: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 607 KiB/s rd, 435 KiB/s wr, 8 op/s 2023-05-08T12:17:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:54 smithi186 ceph-mon[126480]: pgmap v16488: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 607 KiB/s rd, 435 KiB/s wr, 7 op/s 2023-05-08T12:17:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30813.272504 secs 2023-05-08T12:17:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:54 smithi133 ceph-mon[125939]: pgmap v16488: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 607 KiB/s rd, 435 KiB/s wr, 7 op/s 2023-05-08T12:17:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30813.272504 secs 2023-05-08T12:17:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:54 smithi096 ceph-mon[124666]: pgmap v16488: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 607 KiB/s rd, 435 KiB/s wr, 7 op/s 2023-05-08T12:17:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30813.272504 secs 2023-05-08T12:17:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:56 smithi186 ceph-mon[126480]: pgmap v16489: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 948 KiB/s wr, 12 op/s 2023-05-08T12:17:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:56 smithi133 ceph-mon[125939]: pgmap v16489: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 948 KiB/s wr, 12 op/s 2023-05-08T12:17:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:56 smithi096 ceph-mon[124666]: pgmap v16489: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 948 KiB/s wr, 12 op/s 2023-05-08T12:17:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:17:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:17:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:17:58.307 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:58 smithi186 ceph-mon[126480]: pgmap v16490: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 850 KiB/s wr, 9 op/s 2023-05-08T12:17:58.307 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:58 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:17:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:17:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:17:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:58 smithi133 ceph-mon[125939]: pgmap v16490: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 850 KiB/s wr, 9 op/s 2023-05-08T12:17:58.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:58 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:17:58.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:17:58.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:17:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:58 smithi096 ceph-mon[124666]: pgmap v16490: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 850 KiB/s wr, 9 op/s 2023-05-08T12:17:58.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:58 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:17:58.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:17:58.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:17:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30818.272624 secs 2023-05-08T12:17:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:17:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30818.828363 secs 2023-05-08T12:17:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30818.272624 secs 2023-05-08T12:17:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:17:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30818.828363 secs 2023-05-08T12:17:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30818.272624 secs 2023-05-08T12:17:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:17:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30818.828363 secs 2023-05-08T12:18:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:00 smithi186 ceph-mon[126480]: pgmap v16491: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T12:18:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:00 smithi133 ceph-mon[125939]: pgmap v16491: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T12:18:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:00 smithi096 ceph-mon[124666]: pgmap v16491: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T12:18:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:02 smithi186 ceph-mon[126480]: pgmap v16492: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 943 KiB/s rd, 933 KiB/s wr, 11 op/s 2023-05-08T12:18:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:18:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:18:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:02 smithi133 ceph-mon[125939]: pgmap v16492: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 943 KiB/s rd, 933 KiB/s wr, 11 op/s 2023-05-08T12:18:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:18:02.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:18:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:02 smithi096 ceph-mon[124666]: pgmap v16492: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 943 KiB/s rd, 933 KiB/s wr, 11 op/s 2023-05-08T12:18:02.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:18:02.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:18:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:04 smithi186 ceph-mon[126480]: pgmap v16493: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 943 KiB/s rd, 933 KiB/s wr, 10 op/s 2023-05-08T12:18:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30823.272713 secs 2023-05-08T12:18:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:04 smithi133 ceph-mon[125939]: pgmap v16493: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 943 KiB/s rd, 933 KiB/s wr, 10 op/s 2023-05-08T12:18:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30823.272713 secs 2023-05-08T12:18:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:04 smithi096 ceph-mon[124666]: pgmap v16493: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 943 KiB/s rd, 933 KiB/s wr, 10 op/s 2023-05-08T12:18:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30823.272713 secs 2023-05-08T12:18:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:05 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:18:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:05 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:18:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:05 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:18:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:06 smithi186 ceph-mon[126480]: pgmap v16494: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 16 op/s 2023-05-08T12:18:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:06 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:18:06.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:18:06.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:18:06.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30825.118689 secs 2023-05-08T12:18:06.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:06 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:18:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:06 smithi133 ceph-mon[125939]: pgmap v16494: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 16 op/s 2023-05-08T12:18:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:06 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:18:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:18:06.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:18:06.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30825.118689 secs 2023-05-08T12:18:06.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:06 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:18:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:06 smithi096 ceph-mon[124666]: pgmap v16494: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 16 op/s 2023-05-08T12:18:06.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:06 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:18:06.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:18:06.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:18:06.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30825.118689 secs 2023-05-08T12:18:06.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:06 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:18:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:07 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:18:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:07 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:18:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:07 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:18:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:07 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:18:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:07 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T12:18:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:07 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T12:18:07.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:07 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:18:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:07 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:18:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:07 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:18:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:07 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:18:07.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:07 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:18:07.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:07 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T12:18:07.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:07 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T12:18:07.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:07 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:18:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:07 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:18:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:07 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:18:07.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:07 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:18:07.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:07 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:18:07.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:07 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T12:18:07.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:07 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T12:18:07.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:07 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:18:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:08 smithi133 ceph-mon[125939]: pgmap v16495: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 611 KiB/s rd, 617 KiB/s wr, 13 op/s 2023-05-08T12:18:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:08 smithi096 ceph-mon[124666]: pgmap v16495: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 611 KiB/s rd, 617 KiB/s wr, 13 op/s 2023-05-08T12:18:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:08 smithi186 ceph-mon[126480]: pgmap v16495: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 611 KiB/s rd, 617 KiB/s wr, 13 op/s 2023-05-08T12:18:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:18:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:18:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30828.272828 secs 2023-05-08T12:18:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30828.828626 secs 2023-05-08T12:18:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:18:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:18:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30828.272828 secs 2023-05-08T12:18:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30828.828626 secs 2023-05-08T12:18:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:18:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:18:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30828.272828 secs 2023-05-08T12:18:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30828.828626 secs 2023-05-08T12:18:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:10 smithi186 ceph-mon[126480]: pgmap v16496: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 780 KiB/s rd, 940 KiB/s wr, 30 op/s 2023-05-08T12:18:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30830.118812 secs 2023-05-08T12:18:10.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:10 smithi133 ceph-mon[125939]: pgmap v16496: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 780 KiB/s rd, 940 KiB/s wr, 30 op/s 2023-05-08T12:18:10.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30830.118812 secs 2023-05-08T12:18:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:10 smithi096 ceph-mon[124666]: pgmap v16496: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 780 KiB/s rd, 940 KiB/s wr, 30 op/s 2023-05-08T12:18:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30830.118812 secs 2023-05-08T12:18:11.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:11 smithi186 ceph-mon[126480]: osdmap e1108: 12 total, 12 up, 12 in 2023-05-08T12:18:11.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:11 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:18:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:11 smithi133 ceph-mon[125939]: osdmap e1108: 12 total, 12 up, 12 in 2023-05-08T12:18:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:11 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:18:12.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:11 smithi096 ceph-mon[124666]: osdmap e1108: 12 total, 12 up, 12 in 2023-05-08T12:18:12.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:11 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:18:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:12 smithi186 ceph-mon[126480]: pgmap v16498: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 861 KiB/s rd, 758 KiB/s wr, 31 op/s 2023-05-08T12:18:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:12 smithi133 ceph-mon[125939]: pgmap v16498: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 861 KiB/s rd, 758 KiB/s wr, 31 op/s 2023-05-08T12:18:13.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:12 smithi096 ceph-mon[124666]: pgmap v16498: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 861 KiB/s rd, 758 KiB/s wr, 31 op/s 2023-05-08T12:18:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:14 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:18:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:14 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:18:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:14 smithi133 ceph-mon[125939]: pgmap v16499: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 861 KiB/s rd, 758 KiB/s wr, 31 op/s 2023-05-08T12:18:14.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30833.272943 secs 2023-05-08T12:18:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:14 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:18:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:14 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:18:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:14 smithi096 ceph-mon[124666]: pgmap v16499: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 861 KiB/s rd, 758 KiB/s wr, 31 op/s 2023-05-08T12:18:14.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30833.272943 secs 2023-05-08T12:18:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:14 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:18:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:14 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:18:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:14 smithi186 ceph-mon[126480]: pgmap v16499: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 861 KiB/s rd, 758 KiB/s wr, 31 op/s 2023-05-08T12:18:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30833.272943 secs 2023-05-08T12:18:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30833.828727 secs 2023-05-08T12:18:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30833.828727 secs 2023-05-08T12:18:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30833.828727 secs 2023-05-08T12:18:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:16 smithi133 ceph-mon[125939]: pgmap v16500: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 580 KiB/s rd, 620 KiB/s wr, 27 op/s 2023-05-08T12:18:16.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30835.118932 secs 2023-05-08T12:18:16.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:16 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:18:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:16 smithi096 ceph-mon[124666]: pgmap v16500: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 580 KiB/s rd, 620 KiB/s wr, 27 op/s 2023-05-08T12:18:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30835.118932 secs 2023-05-08T12:18:16.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:16 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:18:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:16 smithi186 ceph-mon[126480]: pgmap v16500: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 580 KiB/s rd, 620 KiB/s wr, 27 op/s 2023-05-08T12:18:16.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30835.118932 secs 2023-05-08T12:18:16.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:16 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:18:18.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:18 smithi186 ceph-mon[126480]: pgmap v16501: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 812 KiB/s rd, 827 KiB/s wr, 28 op/s 2023-05-08T12:18:18.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:18 smithi133 ceph-mon[125939]: pgmap v16501: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 812 KiB/s rd, 827 KiB/s wr, 28 op/s 2023-05-08T12:18:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:18 smithi096 ceph-mon[124666]: pgmap v16501: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 812 KiB/s rd, 827 KiB/s wr, 28 op/s 2023-05-08T12:18:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30838.273056 secs 2023-05-08T12:18:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30838.828851 secs 2023-05-08T12:18:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30838.273056 secs 2023-05-08T12:18:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30838.828851 secs 2023-05-08T12:18:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30838.273056 secs 2023-05-08T12:18:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30838.828851 secs 2023-05-08T12:18:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:20 smithi186 ceph-mon[126480]: pgmap v16502: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 611 KiB/s rd, 415 KiB/s wr, 9 op/s 2023-05-08T12:18:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:20 smithi133 ceph-mon[125939]: pgmap v16502: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 611 KiB/s rd, 415 KiB/s wr, 9 op/s 2023-05-08T12:18:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:20 smithi096 ceph-mon[124666]: pgmap v16502: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 611 KiB/s rd, 415 KiB/s wr, 9 op/s 2023-05-08T12:18:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30840.119081 secs 2023-05-08T12:18:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:21 smithi186 ceph-mon[126480]: osdmap e1109: 12 total, 12 up, 12 in 2023-05-08T12:18:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30840.119081 secs 2023-05-08T12:18:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:21 smithi133 ceph-mon[125939]: osdmap e1109: 12 total, 12 up, 12 in 2023-05-08T12:18:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30840.119081 secs 2023-05-08T12:18:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:21 smithi096 ceph-mon[124666]: osdmap e1109: 12 total, 12 up, 12 in 2023-05-08T12:18:22.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:22 smithi186 ceph-mon[126480]: pgmap v16504: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 477 KiB/s rd, 305 KiB/s wr, 9 op/s 2023-05-08T12:18:22.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:22 smithi133 ceph-mon[125939]: pgmap v16504: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 477 KiB/s rd, 305 KiB/s wr, 9 op/s 2023-05-08T12:18:22.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:22 smithi096 ceph-mon[124666]: pgmap v16504: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 477 KiB/s rd, 305 KiB/s wr, 9 op/s 2023-05-08T12:18:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:24 smithi186 ceph-mon[126480]: pgmap v16505: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 477 KiB/s rd, 305 KiB/s wr, 9 op/s 2023-05-08T12:18:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30843.273198 secs 2023-05-08T12:18:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30843.828971 secs 2023-05-08T12:18:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:24 smithi133 ceph-mon[125939]: pgmap v16505: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 477 KiB/s rd, 305 KiB/s wr, 9 op/s 2023-05-08T12:18:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30843.273198 secs 2023-05-08T12:18:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30843.828971 secs 2023-05-08T12:18:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:24 smithi096 ceph-mon[124666]: pgmap v16505: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 477 KiB/s rd, 305 KiB/s wr, 9 op/s 2023-05-08T12:18:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30843.273198 secs 2023-05-08T12:18:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30843.828971 secs 2023-05-08T12:18:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:26 smithi186 ceph-mon[126480]: pgmap v16506: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 253 KiB/s wr, 6 op/s 2023-05-08T12:18:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30845.119168 secs 2023-05-08T12:18:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:26 smithi133 ceph-mon[125939]: pgmap v16506: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 253 KiB/s wr, 6 op/s 2023-05-08T12:18:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30845.119168 secs 2023-05-08T12:18:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:26 smithi096 ceph-mon[124666]: pgmap v16506: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 253 KiB/s wr, 6 op/s 2023-05-08T12:18:26.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30845.119168 secs 2023-05-08T12:18:28.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:28 smithi186 ceph-mon[126480]: pgmap v16507: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T12:18:28.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:28 smithi133 ceph-mon[125939]: pgmap v16507: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T12:18:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:28 smithi096 ceph-mon[124666]: pgmap v16507: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 6 op/s 2023-05-08T12:18:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30848.273355 secs 2023-05-08T12:18:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30848.829108 secs 2023-05-08T12:18:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30848.273355 secs 2023-05-08T12:18:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30848.829108 secs 2023-05-08T12:18:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30848.273355 secs 2023-05-08T12:18:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30848.829108 secs 2023-05-08T12:18:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:30 smithi186 ceph-mon[126480]: pgmap v16508: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T12:18:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:30 smithi133 ceph-mon[125939]: pgmap v16508: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T12:18:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:30 smithi096 ceph-mon[124666]: pgmap v16508: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T12:18:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30850.119296 secs 2023-05-08T12:18:31.703 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30850.119296 secs 2023-05-08T12:18:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30850.119296 secs 2023-05-08T12:18:32.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:32 smithi186 ceph-mon[126480]: pgmap v16509: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T12:18:32.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:32 smithi133 ceph-mon[125939]: pgmap v16509: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T12:18:32.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:32 smithi096 ceph-mon[124666]: pgmap v16509: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T12:18:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:34 smithi186 ceph-mon[126480]: pgmap v16510: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T12:18:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30853.273471 secs 2023-05-08T12:18:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30853.829248 secs 2023-05-08T12:18:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:34 smithi133 ceph-mon[125939]: pgmap v16510: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T12:18:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30853.273471 secs 2023-05-08T12:18:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30853.829248 secs 2023-05-08T12:18:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:34 smithi096 ceph-mon[124666]: pgmap v16510: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T12:18:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30853.273471 secs 2023-05-08T12:18:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30853.829248 secs 2023-05-08T12:18:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:36 smithi186 ceph-mon[126480]: pgmap v16511: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2023-05-08T12:18:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30855.119422 secs 2023-05-08T12:18:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:36 smithi133 ceph-mon[125939]: pgmap v16511: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2023-05-08T12:18:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30855.119422 secs 2023-05-08T12:18:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:36 smithi096 ceph-mon[124666]: pgmap v16511: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2023-05-08T12:18:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30855.119422 secs 2023-05-08T12:18:38.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:38 smithi186 ceph-mon[126480]: pgmap v16512: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 39 KiB/s wr, 6 op/s 2023-05-08T12:18:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:38 smithi133 ceph-mon[125939]: pgmap v16512: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 39 KiB/s wr, 6 op/s 2023-05-08T12:18:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:38 smithi096 ceph-mon[124666]: pgmap v16512: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 39 KiB/s wr, 6 op/s 2023-05-08T12:18:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30858.273591 secs 2023-05-08T12:18:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30858.829364 secs 2023-05-08T12:18:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30858.273591 secs 2023-05-08T12:18:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30858.829364 secs 2023-05-08T12:18:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30858.273591 secs 2023-05-08T12:18:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30858.829364 secs 2023-05-08T12:18:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:40 smithi186 ceph-mon[126480]: pgmap v16513: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 115 KiB/s wr, 8 op/s 2023-05-08T12:18:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:40 smithi133 ceph-mon[125939]: pgmap v16513: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 115 KiB/s wr, 8 op/s 2023-05-08T12:18:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:40 smithi096 ceph-mon[124666]: pgmap v16513: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 115 KiB/s wr, 8 op/s 2023-05-08T12:18:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30860.119543 secs 2023-05-08T12:18:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30860.119543 secs 2023-05-08T12:18:41.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30860.119543 secs 2023-05-08T12:18:42.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:42 smithi186 ceph-mon[126480]: pgmap v16514: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 115 KiB/s wr, 7 op/s 2023-05-08T12:18:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:42 smithi133 ceph-mon[125939]: pgmap v16514: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 115 KiB/s wr, 7 op/s 2023-05-08T12:18:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:42 smithi096 ceph-mon[124666]: pgmap v16514: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 115 KiB/s wr, 7 op/s 2023-05-08T12:18:44.360 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:44 smithi133 ceph-mon[125939]: pgmap v16515: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 115 KiB/s wr, 6 op/s 2023-05-08T12:18:44.360 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30863.273711 secs 2023-05-08T12:18:44.360 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30863.829503 secs 2023-05-08T12:18:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:44 smithi186 ceph-mon[126480]: pgmap v16515: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 115 KiB/s wr, 6 op/s 2023-05-08T12:18:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30863.273711 secs 2023-05-08T12:18:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30863.829503 secs 2023-05-08T12:18:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:44 smithi096 ceph-mon[124666]: pgmap v16515: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 115 KiB/s wr, 6 op/s 2023-05-08T12:18:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30863.273711 secs 2023-05-08T12:18:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30863.829503 secs 2023-05-08T12:18:46.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:46 smithi186 ceph-mon[126480]: pgmap v16516: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 424 KiB/s rd, 382 KiB/s wr, 10 op/s 2023-05-08T12:18:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:46 smithi133 ceph-mon[125939]: pgmap v16516: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 424 KiB/s rd, 382 KiB/s wr, 10 op/s 2023-05-08T12:18:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:46 smithi096 ceph-mon[124666]: pgmap v16516: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 424 KiB/s rd, 382 KiB/s wr, 10 op/s 2023-05-08T12:18:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:48 smithi186 ceph-mon[126480]: pgmap v16517: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 422 KiB/s rd, 382 KiB/s wr, 9 op/s 2023-05-08T12:18:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:48 smithi133 ceph-mon[125939]: pgmap v16517: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 422 KiB/s rd, 382 KiB/s wr, 9 op/s 2023-05-08T12:18:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:48 smithi096 ceph-mon[124666]: pgmap v16517: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 422 KiB/s rd, 382 KiB/s wr, 9 op/s 2023-05-08T12:18:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:18:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30868.273797 secs 2023-05-08T12:18:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30868.829646 secs 2023-05-08T12:18:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:18:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30868.273797 secs 2023-05-08T12:18:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30868.829646 secs 2023-05-08T12:18:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:18:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30868.273797 secs 2023-05-08T12:18:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30868.829646 secs 2023-05-08T12:18:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:50 smithi186 ceph-mon[126480]: pgmap v16518: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 750 KiB/s rd, 684 KiB/s wr, 11 op/s 2023-05-08T12:18:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:18:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:18:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:18:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:50 smithi133 ceph-mon[125939]: pgmap v16518: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 750 KiB/s rd, 684 KiB/s wr, 11 op/s 2023-05-08T12:18:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:18:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:18:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:18:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:50 smithi096 ceph-mon[124666]: pgmap v16518: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 750 KiB/s rd, 684 KiB/s wr, 11 op/s 2023-05-08T12:18:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:18:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:18:50.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:18:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:52 smithi133 ceph-mon[125939]: pgmap v16519: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 673 KiB/s rd, 608 KiB/s wr, 8 op/s 2023-05-08T12:18:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:52 smithi096 ceph-mon[124666]: pgmap v16519: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 673 KiB/s rd, 608 KiB/s wr, 8 op/s 2023-05-08T12:18:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:52 smithi186 ceph-mon[126480]: pgmap v16519: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 673 KiB/s rd, 608 KiB/s wr, 8 op/s 2023-05-08T12:18:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:54 smithi186 ceph-mon[126480]: pgmap v16520: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 673 KiB/s rd, 608 KiB/s wr, 7 op/s 2023-05-08T12:18:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30873.273961 secs 2023-05-08T12:18:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:54 smithi133 ceph-mon[125939]: pgmap v16520: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 673 KiB/s rd, 608 KiB/s wr, 7 op/s 2023-05-08T12:18:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30873.273961 secs 2023-05-08T12:18:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:54 smithi096 ceph-mon[124666]: pgmap v16520: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 673 KiB/s rd, 608 KiB/s wr, 7 op/s 2023-05-08T12:18:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30873.273961 secs 2023-05-08T12:18:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:56 smithi186 ceph-mon[126480]: pgmap v16521: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 970 KiB/s wr, 11 op/s 2023-05-08T12:18:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:56 smithi133 ceph-mon[125939]: pgmap v16521: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 970 KiB/s wr, 11 op/s 2023-05-08T12:18:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:56 smithi096 ceph-mon[124666]: pgmap v16521: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 970 KiB/s wr, 11 op/s 2023-05-08T12:18:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:18:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:18:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:18:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:58 smithi186 ceph-mon[126480]: pgmap v16522: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 881 KiB/s rd, 725 KiB/s wr, 9 op/s 2023-05-08T12:18:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:58 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:18:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:18:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:18:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:58 smithi133 ceph-mon[125939]: pgmap v16522: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 881 KiB/s rd, 725 KiB/s wr, 9 op/s 2023-05-08T12:18:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:58 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:18:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:18:58.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:18:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:58 smithi096 ceph-mon[124666]: pgmap v16522: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 881 KiB/s rd, 725 KiB/s wr, 9 op/s 2023-05-08T12:18:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:58 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:18:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:18:58.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:18:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30878.274079 secs 2023-05-08T12:18:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:18:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30878.829871 secs 2023-05-08T12:18:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30878.274079 secs 2023-05-08T12:18:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:18:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30878.829871 secs 2023-05-08T12:18:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30878.274079 secs 2023-05-08T12:18:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:18:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30878.829871 secs 2023-05-08T12:19:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:00 smithi186 ceph-mon[126480]: pgmap v16523: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2023-05-08T12:19:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:00 smithi133 ceph-mon[125939]: pgmap v16523: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2023-05-08T12:19:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:00 smithi096 ceph-mon[124666]: pgmap v16523: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2023-05-08T12:19:01.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30880.120037 secs 2023-05-08T12:19:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30880.120037 secs 2023-05-08T12:19:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30880.120037 secs 2023-05-08T12:19:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:02 smithi186 ceph-mon[126480]: pgmap v16524: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 881 KiB/s wr, 11 op/s 2023-05-08T12:19:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:19:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:19:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:19:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:02 smithi133 ceph-mon[125939]: pgmap v16524: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 881 KiB/s wr, 11 op/s 2023-05-08T12:19:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:19:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:19:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:19:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:02 smithi096 ceph-mon[124666]: pgmap v16524: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 881 KiB/s wr, 11 op/s 2023-05-08T12:19:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:19:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:19:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:19:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:04 smithi186 ceph-mon[126480]: pgmap v16525: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 881 KiB/s wr, 11 op/s 2023-05-08T12:19:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30883.274196 secs 2023-05-08T12:19:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:04 smithi133 ceph-mon[125939]: pgmap v16525: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 881 KiB/s wr, 11 op/s 2023-05-08T12:19:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30883.274196 secs 2023-05-08T12:19:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:04 smithi096 ceph-mon[124666]: pgmap v16525: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 881 KiB/s wr, 11 op/s 2023-05-08T12:19:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30883.274196 secs 2023-05-08T12:19:05.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:05 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:19:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:05 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:19:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:05 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:19:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:06 smithi186 ceph-mon[126480]: pgmap v16526: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 17 op/s 2023-05-08T12:19:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:06 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:19:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:19:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:19:06.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30885.120159 secs 2023-05-08T12:19:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:06 smithi133 ceph-mon[125939]: pgmap v16526: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 17 op/s 2023-05-08T12:19:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:06 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:19:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:19:06.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:19:06.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30885.120159 secs 2023-05-08T12:19:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:06 smithi096 ceph-mon[124666]: pgmap v16526: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 17 op/s 2023-05-08T12:19:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:06 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:19:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:19:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:19:06.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30885.120159 secs 2023-05-08T12:19:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:07 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:19:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:07 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:19:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:07 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:19:07.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:07 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:19:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:07 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:19:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:07 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:19:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:07 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:19:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:07 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:19:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:07 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:19:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:07 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:19:07.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:07 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:19:07.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:07 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:19:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:08 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:19:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:08 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T12:19:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:08 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T12:19:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:08 smithi186 ceph-mon[126480]: pgmap v16527: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 748 KiB/s rd, 715 KiB/s wr, 14 op/s 2023-05-08T12:19:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:08 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:19:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:08 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:19:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:08 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T12:19:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:08 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T12:19:08.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:08 smithi133 ceph-mon[125939]: pgmap v16527: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 748 KiB/s rd, 715 KiB/s wr, 14 op/s 2023-05-08T12:19:08.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:08 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:19:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:08 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:19:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:08 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T12:19:08.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:08 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T12:19:08.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:08 smithi096 ceph-mon[124666]: pgmap v16527: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 748 KiB/s rd, 715 KiB/s wr, 14 op/s 2023-05-08T12:19:08.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:08 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:19:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30888.274291 secs 2023-05-08T12:19:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30888.830109 secs 2023-05-08T12:19:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30888.274291 secs 2023-05-08T12:19:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30888.830109 secs 2023-05-08T12:19:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30888.274291 secs 2023-05-08T12:19:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30888.830109 secs 2023-05-08T12:19:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:10 smithi186 ceph-mon[126480]: pgmap v16528: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 30 op/s 2023-05-08T12:19:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:10 smithi133 ceph-mon[125939]: pgmap v16528: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 30 op/s 2023-05-08T12:19:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:10 smithi096 ceph-mon[124666]: pgmap v16528: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 30 op/s 2023-05-08T12:19:11.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30890.120279 secs 2023-05-08T12:19:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30890.120279 secs 2023-05-08T12:19:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30890.120279 secs 2023-05-08T12:19:12.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:12 smithi186 ceph-mon[126480]: pgmap v16529: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 530 KiB/s rd, 544 KiB/s wr, 25 op/s 2023-05-08T12:19:12.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:12 smithi186 ceph-mon[126480]: osdmap e1110: 12 total, 12 up, 12 in 2023-05-08T12:19:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:12 smithi133 ceph-mon[125939]: pgmap v16529: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 530 KiB/s rd, 544 KiB/s wr, 25 op/s 2023-05-08T12:19:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:12 smithi133 ceph-mon[125939]: osdmap e1110: 12 total, 12 up, 12 in 2023-05-08T12:19:12.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:12 smithi096 ceph-mon[124666]: pgmap v16529: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 530 KiB/s rd, 544 KiB/s wr, 25 op/s 2023-05-08T12:19:12.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:12 smithi096 ceph-mon[124666]: osdmap e1110: 12 total, 12 up, 12 in 2023-05-08T12:19:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:13 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:19:13.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:19:13.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:13 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:19:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:13 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:19:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:19:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:13 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:19:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:13 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:19:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:19:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:13 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:19:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:14 smithi133 ceph-mon[125939]: pgmap v16531: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 650 KiB/s wr, 29 op/s 2023-05-08T12:19:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30893.274426 secs 2023-05-08T12:19:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30893.830253 secs 2023-05-08T12:19:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:14 smithi096 ceph-mon[124666]: pgmap v16531: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 650 KiB/s wr, 29 op/s 2023-05-08T12:19:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30893.274426 secs 2023-05-08T12:19:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30893.830253 secs 2023-05-08T12:19:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:14 smithi186 ceph-mon[126480]: pgmap v16531: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 650 KiB/s wr, 29 op/s 2023-05-08T12:19:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30893.274426 secs 2023-05-08T12:19:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30893.830253 secs 2023-05-08T12:19:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:16 smithi133 ceph-mon[125939]: pgmap v16532: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 581 KiB/s rd, 623 KiB/s wr, 27 op/s 2023-05-08T12:19:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30895.120397 secs 2023-05-08T12:19:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:16 smithi096 ceph-mon[124666]: pgmap v16532: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 581 KiB/s rd, 623 KiB/s wr, 27 op/s 2023-05-08T12:19:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30895.120397 secs 2023-05-08T12:19:16.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:16 smithi186 ceph-mon[126480]: pgmap v16532: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 581 KiB/s rd, 623 KiB/s wr, 27 op/s 2023-05-08T12:19:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30895.120397 secs 2023-05-08T12:19:18.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:18 smithi133 ceph-mon[125939]: pgmap v16533: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 577 KiB/s wr, 26 op/s 2023-05-08T12:19:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:18 smithi096 ceph-mon[124666]: pgmap v16533: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 577 KiB/s wr, 26 op/s 2023-05-08T12:19:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:18 smithi186 ceph-mon[126480]: pgmap v16533: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 577 KiB/s wr, 26 op/s 2023-05-08T12:19:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30898.274554 secs 2023-05-08T12:19:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30898.830390 secs 2023-05-08T12:19:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30898.274554 secs 2023-05-08T12:19:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30898.830390 secs 2023-05-08T12:19:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30898.274554 secs 2023-05-08T12:19:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30898.830390 secs 2023-05-08T12:19:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:20 smithi133 ceph-mon[125939]: pgmap v16534: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 416 KiB/s wr, 9 op/s 2023-05-08T12:19:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:20 smithi096 ceph-mon[124666]: pgmap v16534: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 416 KiB/s wr, 9 op/s 2023-05-08T12:19:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:20 smithi186 ceph-mon[126480]: pgmap v16534: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 416 KiB/s wr, 9 op/s 2023-05-08T12:19:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30900.120514 secs 2023-05-08T12:19:21.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:21 smithi133 ceph-mon[125939]: osdmap e1111: 12 total, 12 up, 12 in 2023-05-08T12:19:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30900.120514 secs 2023-05-08T12:19:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:21 smithi096 ceph-mon[124666]: osdmap e1111: 12 total, 12 up, 12 in 2023-05-08T12:19:21.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30900.120514 secs 2023-05-08T12:19:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:21 smithi186 ceph-mon[126480]: osdmap e1111: 12 total, 12 up, 12 in 2023-05-08T12:19:22.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:22 smithi133 ceph-mon[125939]: pgmap v16536: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 420 KiB/s wr, 8 op/s 2023-05-08T12:19:22.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:22 smithi096 ceph-mon[124666]: pgmap v16536: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 420 KiB/s wr, 8 op/s 2023-05-08T12:19:22.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:22 smithi186 ceph-mon[126480]: pgmap v16536: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 420 KiB/s wr, 8 op/s 2023-05-08T12:19:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:24 smithi133 ceph-mon[125939]: pgmap v16537: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 418 KiB/s rd, 416 KiB/s wr, 8 op/s 2023-05-08T12:19:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30903.274654 secs 2023-05-08T12:19:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30903.830530 secs 2023-05-08T12:19:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:24 smithi096 ceph-mon[124666]: pgmap v16537: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 418 KiB/s rd, 416 KiB/s wr, 8 op/s 2023-05-08T12:19:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30903.274654 secs 2023-05-08T12:19:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30903.830530 secs 2023-05-08T12:19:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:24 smithi186 ceph-mon[126480]: pgmap v16537: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 418 KiB/s rd, 416 KiB/s wr, 8 op/s 2023-05-08T12:19:24.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30903.274654 secs 2023-05-08T12:19:24.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30903.830530 secs 2023-05-08T12:19:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:26 smithi133 ceph-mon[125939]: pgmap v16538: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 254 KiB/s wr, 6 op/s 2023-05-08T12:19:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30905.120631 secs 2023-05-08T12:19:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:26 smithi096 ceph-mon[124666]: pgmap v16538: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 254 KiB/s wr, 6 op/s 2023-05-08T12:19:26.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30905.120631 secs 2023-05-08T12:19:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:26 smithi186 ceph-mon[126480]: pgmap v16538: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 254 KiB/s wr, 6 op/s 2023-05-08T12:19:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30905.120631 secs 2023-05-08T12:19:28.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:28 smithi133 ceph-mon[125939]: pgmap v16539: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 254 KiB/s wr, 6 op/s 2023-05-08T12:19:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:28 smithi096 ceph-mon[124666]: pgmap v16539: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 254 KiB/s wr, 6 op/s 2023-05-08T12:19:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:28 smithi186 ceph-mon[126480]: pgmap v16539: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 254 KiB/s wr, 6 op/s 2023-05-08T12:19:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30908.274771 secs 2023-05-08T12:19:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30908.830622 secs 2023-05-08T12:19:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30908.274771 secs 2023-05-08T12:19:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30908.830622 secs 2023-05-08T12:19:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30908.274771 secs 2023-05-08T12:19:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30908.830622 secs 2023-05-08T12:19:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:30 smithi133 ceph-mon[125939]: pgmap v16540: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T12:19:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:30 smithi096 ceph-mon[124666]: pgmap v16540: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T12:19:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:30 smithi186 ceph-mon[126480]: pgmap v16540: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T12:19:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30910.120736 secs 2023-05-08T12:19:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30910.120736 secs 2023-05-08T12:19:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30910.120736 secs 2023-05-08T12:19:32.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:32 smithi133 ceph-mon[125939]: pgmap v16541: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T12:19:32.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:32 smithi096 ceph-mon[124666]: pgmap v16541: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T12:19:32.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:32 smithi186 ceph-mon[126480]: pgmap v16541: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T12:19:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:34 smithi133 ceph-mon[125939]: pgmap v16542: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T12:19:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30913.274905 secs 2023-05-08T12:19:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30913.830699 secs 2023-05-08T12:19:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:34 smithi096 ceph-mon[124666]: pgmap v16542: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T12:19:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30913.274905 secs 2023-05-08T12:19:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30913.830699 secs 2023-05-08T12:19:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:34 smithi186 ceph-mon[126480]: pgmap v16542: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T12:19:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30913.274905 secs 2023-05-08T12:19:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30913.830699 secs 2023-05-08T12:19:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:36 smithi133 ceph-mon[125939]: pgmap v16543: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T12:19:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30915.120854 secs 2023-05-08T12:19:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:36 smithi096 ceph-mon[124666]: pgmap v16543: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T12:19:36.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30915.120854 secs 2023-05-08T12:19:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:36 smithi186 ceph-mon[126480]: pgmap v16543: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T12:19:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30915.120854 secs 2023-05-08T12:19:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:38 smithi133 ceph-mon[125939]: pgmap v16544: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2023-05-08T12:19:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:38 smithi096 ceph-mon[124666]: pgmap v16544: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2023-05-08T12:19:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:38 smithi186 ceph-mon[126480]: pgmap v16544: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2023-05-08T12:19:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30918.274990 secs 2023-05-08T12:19:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30918.830788 secs 2023-05-08T12:19:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30918.274990 secs 2023-05-08T12:19:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30918.830788 secs 2023-05-08T12:19:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30918.274990 secs 2023-05-08T12:19:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30918.830788 secs 2023-05-08T12:19:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:40 smithi133 ceph-mon[125939]: pgmap v16545: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 511 B/s wr, 7 op/s 2023-05-08T12:19:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:40 smithi096 ceph-mon[124666]: pgmap v16545: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 511 B/s wr, 7 op/s 2023-05-08T12:19:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:40 smithi186 ceph-mon[126480]: pgmap v16545: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 511 B/s wr, 7 op/s 2023-05-08T12:19:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30920.120933 secs 2023-05-08T12:19:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30920.120933 secs 2023-05-08T12:19:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30920.120933 secs 2023-05-08T12:19:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:42 smithi133 ceph-mon[125939]: pgmap v16546: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 767 B/s wr, 6 op/s 2023-05-08T12:19:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:42 smithi096 ceph-mon[124666]: pgmap v16546: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 767 B/s wr, 6 op/s 2023-05-08T12:19:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:42 smithi186 ceph-mon[126480]: pgmap v16546: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 767 B/s wr, 6 op/s 2023-05-08T12:19:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:44 smithi133 ceph-mon[125939]: pgmap v16547: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 767 B/s wr, 6 op/s 2023-05-08T12:19:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30923.275107 secs 2023-05-08T12:19:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30923.830909 secs 2023-05-08T12:19:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:44 smithi096 ceph-mon[124666]: pgmap v16547: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 767 B/s wr, 6 op/s 2023-05-08T12:19:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30923.275107 secs 2023-05-08T12:19:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30923.830909 secs 2023-05-08T12:19:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:44 smithi186 ceph-mon[126480]: pgmap v16547: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 767 B/s wr, 6 op/s 2023-05-08T12:19:44.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30923.275107 secs 2023-05-08T12:19:44.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30923.830909 secs 2023-05-08T12:19:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:46 smithi096 ceph-mon[124666]: pgmap v16548: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 119 KiB/s wr, 9 op/s 2023-05-08T12:19:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:46 smithi186 ceph-mon[126480]: pgmap v16548: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 119 KiB/s wr, 9 op/s 2023-05-08T12:19:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:46 smithi133 ceph-mon[125939]: pgmap v16548: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 119 KiB/s wr, 9 op/s 2023-05-08T12:19:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:48 smithi096 ceph-mon[124666]: pgmap v16549: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 119 KiB/s wr, 8 op/s 2023-05-08T12:19:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:19:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:48 smithi186 ceph-mon[126480]: pgmap v16549: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 119 KiB/s wr, 8 op/s 2023-05-08T12:19:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:19:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:48 smithi133 ceph-mon[125939]: pgmap v16549: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 119 KiB/s wr, 8 op/s 2023-05-08T12:19:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:19:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:19:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:19:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:19:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30928.275243 secs 2023-05-08T12:19:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30928.830974 secs 2023-05-08T12:19:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:19:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:19:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:19:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30928.275243 secs 2023-05-08T12:19:49.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30928.830974 secs 2023-05-08T12:19:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:19:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:19:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:19:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30928.275243 secs 2023-05-08T12:19:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30928.830974 secs 2023-05-08T12:19:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:50 smithi096 ceph-mon[124666]: pgmap v16550: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 670 KiB/s rd, 431 KiB/s wr, 10 op/s 2023-05-08T12:19:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:50 smithi186 ceph-mon[126480]: pgmap v16550: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 670 KiB/s rd, 431 KiB/s wr, 10 op/s 2023-05-08T12:19:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:50 smithi133 ceph-mon[125939]: pgmap v16550: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 670 KiB/s rd, 431 KiB/s wr, 10 op/s 2023-05-08T12:19:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:52 smithi133 ceph-mon[125939]: pgmap v16551: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 669 KiB/s rd, 431 KiB/s wr, 8 op/s 2023-05-08T12:19:52.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:52 smithi096 ceph-mon[124666]: pgmap v16551: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 669 KiB/s rd, 431 KiB/s wr, 8 op/s 2023-05-08T12:19:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:52 smithi186 ceph-mon[126480]: pgmap v16551: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 669 KiB/s rd, 431 KiB/s wr, 8 op/s 2023-05-08T12:19:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:54 smithi186 ceph-mon[126480]: pgmap v16552: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 669 KiB/s rd, 431 KiB/s wr, 8 op/s 2023-05-08T12:19:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30933.275395 secs 2023-05-08T12:19:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:54 smithi133 ceph-mon[125939]: pgmap v16552: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 669 KiB/s rd, 431 KiB/s wr, 8 op/s 2023-05-08T12:19:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30933.275395 secs 2023-05-08T12:19:54.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:54 smithi096 ceph-mon[124666]: pgmap v16552: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 669 KiB/s rd, 431 KiB/s wr, 8 op/s 2023-05-08T12:19:54.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30933.275395 secs 2023-05-08T12:19:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:56 smithi186 ceph-mon[126480]: pgmap v16553: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 953 KiB/s wr, 12 op/s 2023-05-08T12:19:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:56 smithi133 ceph-mon[125939]: pgmap v16553: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 953 KiB/s wr, 12 op/s 2023-05-08T12:19:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:56 smithi096 ceph-mon[124666]: pgmap v16553: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 953 KiB/s wr, 12 op/s 2023-05-08T12:19:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:19:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:19:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:19:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:58 smithi186 ceph-mon[126480]: pgmap v16554: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 858 KiB/s wr, 9 op/s 2023-05-08T12:19:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:58 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:19:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:19:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:19:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:58 smithi133 ceph-mon[125939]: pgmap v16554: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 858 KiB/s wr, 9 op/s 2023-05-08T12:19:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:58 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:19:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:19:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:19:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:58 smithi096 ceph-mon[124666]: pgmap v16554: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 858 KiB/s wr, 9 op/s 2023-05-08T12:19:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:58 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:19:58.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:19:58.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:19:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30938.275509 secs 2023-05-08T12:19:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:19:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30938.831104 secs 2023-05-08T12:19:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30938.275509 secs 2023-05-08T12:19:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:19:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30938.831104 secs 2023-05-08T12:19:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30938.275509 secs 2023-05-08T12:19:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:19:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30938.831104 secs 2023-05-08T12:20:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:00 smithi186 ceph-mon[126480]: pgmap v16555: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2023-05-08T12:20:00.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:00 smithi186 ceph-mon[126480]: overall HEALTH_WARN 1 MDSs report slow requests 2023-05-08T12:20:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:00 smithi133 ceph-mon[125939]: pgmap v16555: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2023-05-08T12:20:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:00 smithi133 ceph-mon[125939]: overall HEALTH_WARN 1 MDSs report slow requests 2023-05-08T12:20:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:00 smithi096 ceph-mon[124666]: pgmap v16555: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2023-05-08T12:20:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:00 smithi096 ceph-mon[124666]: overall HEALTH_WARN 1 MDSs report slow requests 2023-05-08T12:20:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30940.121353 secs 2023-05-08T12:20:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30940.121353 secs 2023-05-08T12:20:01.773 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30940.121353 secs 2023-05-08T12:20:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:02 smithi186 ceph-mon[126480]: pgmap v16556: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T12:20:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:20:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:20:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:20:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:02 smithi133 ceph-mon[125939]: pgmap v16556: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T12:20:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:20:02.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:20:02.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:20:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:02 smithi096 ceph-mon[124666]: pgmap v16556: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T12:20:02.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:20:02.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:20:02.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:20:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:04 smithi186 ceph-mon[126480]: pgmap v16557: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T12:20:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30943.275626 secs 2023-05-08T12:20:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:04 smithi133 ceph-mon[125939]: pgmap v16557: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T12:20:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30943.275626 secs 2023-05-08T12:20:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:04 smithi096 ceph-mon[124666]: pgmap v16557: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T12:20:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30943.275626 secs 2023-05-08T12:20:05.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:05 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:20:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:05 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:20:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:05 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:20:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:06 smithi133 ceph-mon[125939]: pgmap v16558: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 16 op/s 2023-05-08T12:20:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:06 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:20:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:20:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:20:06.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30945.121479 secs 2023-05-08T12:20:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:06 smithi096 ceph-mon[124666]: pgmap v16558: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 16 op/s 2023-05-08T12:20:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:06 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:20:06.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:20:06.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:20:06.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30945.121479 secs 2023-05-08T12:20:06.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:06 smithi186 ceph-mon[126480]: pgmap v16558: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 16 op/s 2023-05-08T12:20:06.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:06 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:20:06.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:20:06.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:20:06.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30945.121479 secs 2023-05-08T12:20:07.675 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:07 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:20:07.676 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:07 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:20:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:07 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:20:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:08 smithi133 ceph-mon[125939]: pgmap v16559: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 729 KiB/s rd, 759 KiB/s wr, 14 op/s 2023-05-08T12:20:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:08 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:20:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:08 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:20:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:08 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:20:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:08 smithi096 ceph-mon[124666]: pgmap v16559: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 729 KiB/s rd, 759 KiB/s wr, 14 op/s 2023-05-08T12:20:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:08 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:20:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:08 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:20:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:08 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:20:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:08 smithi186 ceph-mon[126480]: pgmap v16559: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 729 KiB/s rd, 759 KiB/s wr, 14 op/s 2023-05-08T12:20:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:08 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:20:08.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:08 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:20:08.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:08 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:20:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:09 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:20:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:09 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T12:20:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:09 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T12:20:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:09 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:20:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30948.275740 secs 2023-05-08T12:20:09.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30948.831274 secs 2023-05-08T12:20:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:09 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:20:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:09 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T12:20:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:09 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T12:20:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:09 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:20:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30948.275740 secs 2023-05-08T12:20:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30948.831274 secs 2023-05-08T12:20:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:09 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:20:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:09 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T12:20:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:09 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T12:20:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:09 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:20:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30948.275740 secs 2023-05-08T12:20:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30948.831274 secs 2023-05-08T12:20:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:10 smithi133 ceph-mon[125939]: pgmap v16560: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 758 KiB/s rd, 800 KiB/s wr, 29 op/s 2023-05-08T12:20:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:10 smithi096 ceph-mon[124666]: pgmap v16560: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 758 KiB/s rd, 800 KiB/s wr, 29 op/s 2023-05-08T12:20:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:10 smithi186 ceph-mon[126480]: pgmap v16560: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 758 KiB/s rd, 800 KiB/s wr, 29 op/s 2023-05-08T12:20:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30950.121595 secs 2023-05-08T12:20:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30950.121595 secs 2023-05-08T12:20:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30950.121595 secs 2023-05-08T12:20:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:12 smithi133 ceph-mon[125939]: pgmap v16561: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 571 KiB/s wr, 26 op/s 2023-05-08T12:20:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:12 smithi133 ceph-mon[125939]: osdmap e1112: 12 total, 12 up, 12 in 2023-05-08T12:20:12.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:12 smithi096 ceph-mon[124666]: pgmap v16561: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 571 KiB/s wr, 26 op/s 2023-05-08T12:20:12.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:12 smithi096 ceph-mon[124666]: osdmap e1112: 12 total, 12 up, 12 in 2023-05-08T12:20:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:12 smithi186 ceph-mon[126480]: pgmap v16561: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 571 KiB/s wr, 26 op/s 2023-05-08T12:20:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:12 smithi186 ceph-mon[126480]: osdmap e1112: 12 total, 12 up, 12 in 2023-05-08T12:20:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:13 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:20:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:20:13.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:13 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:20:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:13 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:20:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:20:13.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:13 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:20:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:13 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:20:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:20:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:13 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:20:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:14 smithi133 ceph-mon[125939]: pgmap v16563: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 610 KiB/s rd, 530 KiB/s wr, 30 op/s 2023-05-08T12:20:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30953.275879 secs 2023-05-08T12:20:14.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30953.831399 secs 2023-05-08T12:20:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:14 smithi096 ceph-mon[124666]: pgmap v16563: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 610 KiB/s rd, 530 KiB/s wr, 30 op/s 2023-05-08T12:20:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30953.275879 secs 2023-05-08T12:20:14.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30953.831399 secs 2023-05-08T12:20:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:14 smithi186 ceph-mon[126480]: pgmap v16563: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 610 KiB/s rd, 530 KiB/s wr, 30 op/s 2023-05-08T12:20:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30953.275879 secs 2023-05-08T12:20:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30953.831399 secs 2023-05-08T12:20:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:16 smithi133 ceph-mon[125939]: pgmap v16564: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 709 KiB/s rd, 630 KiB/s wr, 27 op/s 2023-05-08T12:20:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30955.121709 secs 2023-05-08T12:20:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:16 smithi096 ceph-mon[124666]: pgmap v16564: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 709 KiB/s rd, 630 KiB/s wr, 27 op/s 2023-05-08T12:20:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30955.121709 secs 2023-05-08T12:20:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:16 smithi186 ceph-mon[126480]: pgmap v16564: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 709 KiB/s rd, 630 KiB/s wr, 27 op/s 2023-05-08T12:20:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30955.121709 secs 2023-05-08T12:20:18.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:18 smithi133 ceph-mon[125939]: pgmap v16565: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 566 KiB/s rd, 557 KiB/s wr, 26 op/s 2023-05-08T12:20:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:18 smithi096 ceph-mon[124666]: pgmap v16565: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 566 KiB/s rd, 557 KiB/s wr, 26 op/s 2023-05-08T12:20:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:18 smithi186 ceph-mon[126480]: pgmap v16565: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 566 KiB/s rd, 557 KiB/s wr, 26 op/s 2023-05-08T12:20:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30958.275994 secs 2023-05-08T12:20:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30958.831516 secs 2023-05-08T12:20:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30958.275994 secs 2023-05-08T12:20:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30958.831516 secs 2023-05-08T12:20:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30958.275994 secs 2023-05-08T12:20:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30958.831516 secs 2023-05-08T12:20:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:20 smithi133 ceph-mon[125939]: pgmap v16566: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 647 KiB/s rd, 593 KiB/s wr, 10 op/s 2023-05-08T12:20:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:20 smithi096 ceph-mon[124666]: pgmap v16566: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 647 KiB/s rd, 593 KiB/s wr, 10 op/s 2023-05-08T12:20:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:20 smithi186 ceph-mon[126480]: pgmap v16566: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 647 KiB/s rd, 593 KiB/s wr, 10 op/s 2023-05-08T12:20:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30960.121831 secs 2023-05-08T12:20:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:21 smithi133 ceph-mon[125939]: osdmap e1113: 12 total, 12 up, 12 in 2023-05-08T12:20:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30960.121831 secs 2023-05-08T12:20:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:21 smithi096 ceph-mon[124666]: osdmap e1113: 12 total, 12 up, 12 in 2023-05-08T12:20:21.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30960.121831 secs 2023-05-08T12:20:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:21 smithi186 ceph-mon[126480]: osdmap e1113: 12 total, 12 up, 12 in 2023-05-08T12:20:22.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:22 smithi133 ceph-mon[125939]: pgmap v16568: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 393 KiB/s wr, 9 op/s 2023-05-08T12:20:22.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:22 smithi096 ceph-mon[124666]: pgmap v16568: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 393 KiB/s wr, 9 op/s 2023-05-08T12:20:22.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:22 smithi186 ceph-mon[126480]: pgmap v16568: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 393 KiB/s wr, 9 op/s 2023-05-08T12:20:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:24 smithi133 ceph-mon[125939]: pgmap v16569: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 425 KiB/s rd, 389 KiB/s wr, 9 op/s 2023-05-08T12:20:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30963.276107 secs 2023-05-08T12:20:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30963.831630 secs 2023-05-08T12:20:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:24 smithi096 ceph-mon[124666]: pgmap v16569: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 425 KiB/s rd, 389 KiB/s wr, 9 op/s 2023-05-08T12:20:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30963.276107 secs 2023-05-08T12:20:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30963.831630 secs 2023-05-08T12:20:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:24 smithi186 ceph-mon[126480]: pgmap v16569: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 425 KiB/s rd, 389 KiB/s wr, 9 op/s 2023-05-08T12:20:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30963.276107 secs 2023-05-08T12:20:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30963.831630 secs 2023-05-08T12:20:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:26 smithi133 ceph-mon[125939]: pgmap v16570: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 114 KiB/s wr, 8 op/s 2023-05-08T12:20:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30965.121952 secs 2023-05-08T12:20:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:26 smithi096 ceph-mon[124666]: pgmap v16570: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 114 KiB/s wr, 8 op/s 2023-05-08T12:20:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30965.121952 secs 2023-05-08T12:20:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:26 smithi186 ceph-mon[126480]: pgmap v16570: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 114 KiB/s wr, 8 op/s 2023-05-08T12:20:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30965.121952 secs 2023-05-08T12:20:28.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:28 smithi133 ceph-mon[125939]: pgmap v16571: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 114 KiB/s wr, 7 op/s 2023-05-08T12:20:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:28 smithi096 ceph-mon[124666]: pgmap v16571: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 114 KiB/s wr, 7 op/s 2023-05-08T12:20:28.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:28 smithi186 ceph-mon[126480]: pgmap v16571: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 114 KiB/s wr, 7 op/s 2023-05-08T12:20:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30968.276236 secs 2023-05-08T12:20:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30968.831739 secs 2023-05-08T12:20:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30968.276236 secs 2023-05-08T12:20:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30968.831739 secs 2023-05-08T12:20:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30968.276236 secs 2023-05-08T12:20:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30968.831739 secs 2023-05-08T12:20:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:30 smithi133 ceph-mon[125939]: pgmap v16572: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2023-05-08T12:20:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:30 smithi096 ceph-mon[124666]: pgmap v16572: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2023-05-08T12:20:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:30 smithi186 ceph-mon[126480]: pgmap v16572: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2023-05-08T12:20:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30970.122070 secs 2023-05-08T12:20:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30970.122070 secs 2023-05-08T12:20:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30970.122070 secs 2023-05-08T12:20:32.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:32 smithi133 ceph-mon[125939]: pgmap v16573: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2023-05-08T12:20:32.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:32 smithi096 ceph-mon[124666]: pgmap v16573: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2023-05-08T12:20:32.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:32 smithi186 ceph-mon[126480]: pgmap v16573: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2023-05-08T12:20:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:34 smithi133 ceph-mon[125939]: pgmap v16574: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T12:20:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30973.276360 secs 2023-05-08T12:20:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30973.831813 secs 2023-05-08T12:20:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:34 smithi096 ceph-mon[124666]: pgmap v16574: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T12:20:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30973.276360 secs 2023-05-08T12:20:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30973.831813 secs 2023-05-08T12:20:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:34 smithi186 ceph-mon[126480]: pgmap v16574: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T12:20:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30973.276360 secs 2023-05-08T12:20:34.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30973.831813 secs 2023-05-08T12:20:36.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:36 smithi096 ceph-mon[124666]: pgmap v16575: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T12:20:36.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30975.122181 secs 2023-05-08T12:20:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:36 smithi186 ceph-mon[126480]: pgmap v16575: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T12:20:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30975.122181 secs 2023-05-08T12:20:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:36 smithi133 ceph-mon[125939]: pgmap v16575: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T12:20:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30975.122181 secs 2023-05-08T12:20:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:38 smithi096 ceph-mon[124666]: pgmap v16576: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2023-05-08T12:20:38.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:38 smithi186 ceph-mon[126480]: pgmap v16576: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2023-05-08T12:20:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:38 smithi133 ceph-mon[125939]: pgmap v16576: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2023-05-08T12:20:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30978.276458 secs 2023-05-08T12:20:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30978.831930 secs 2023-05-08T12:20:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30978.276458 secs 2023-05-08T12:20:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30978.831930 secs 2023-05-08T12:20:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30978.276458 secs 2023-05-08T12:20:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30978.831930 secs 2023-05-08T12:20:40.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:40 smithi096 ceph-mon[124666]: pgmap v16577: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 23 KiB/s wr, 9 op/s 2023-05-08T12:20:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:40 smithi186 ceph-mon[126480]: pgmap v16577: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 23 KiB/s wr, 9 op/s 2023-05-08T12:20:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:40 smithi133 ceph-mon[125939]: pgmap v16577: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 23 KiB/s wr, 9 op/s 2023-05-08T12:20:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30980.122321 secs 2023-05-08T12:20:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30980.122321 secs 2023-05-08T12:20:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30980.122321 secs 2023-05-08T12:20:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:42 smithi096 ceph-mon[124666]: pgmap v16578: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 23 KiB/s wr, 6 op/s 2023-05-08T12:20:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:42 smithi186 ceph-mon[126480]: pgmap v16578: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 23 KiB/s wr, 6 op/s 2023-05-08T12:20:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:42 smithi133 ceph-mon[125939]: pgmap v16578: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 23 KiB/s wr, 6 op/s 2023-05-08T12:20:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:44 smithi186 ceph-mon[126480]: pgmap v16579: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 23 KiB/s wr, 6 op/s 2023-05-08T12:20:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30983.276602 secs 2023-05-08T12:20:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30983.832046 secs 2023-05-08T12:20:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:44 smithi133 ceph-mon[125939]: pgmap v16579: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 23 KiB/s wr, 6 op/s 2023-05-08T12:20:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30983.276602 secs 2023-05-08T12:20:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30983.832046 secs 2023-05-08T12:20:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:44 smithi096 ceph-mon[124666]: pgmap v16579: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 23 KiB/s wr, 6 op/s 2023-05-08T12:20:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30983.276602 secs 2023-05-08T12:20:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30983.832046 secs 2023-05-08T12:20:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:46 smithi186 ceph-mon[126480]: pgmap v16580: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 120 KiB/s wr, 10 op/s 2023-05-08T12:20:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:46 smithi133 ceph-mon[125939]: pgmap v16580: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 120 KiB/s wr, 10 op/s 2023-05-08T12:20:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:46 smithi096 ceph-mon[124666]: pgmap v16580: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 120 KiB/s wr, 10 op/s 2023-05-08T12:20:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:48 smithi186 ceph-mon[126480]: pgmap v16581: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 120 KiB/s wr, 7 op/s 2023-05-08T12:20:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:20:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:48 smithi133 ceph-mon[125939]: pgmap v16581: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 120 KiB/s wr, 7 op/s 2023-05-08T12:20:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:20:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:48 smithi096 ceph-mon[124666]: pgmap v16581: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 120 KiB/s wr, 7 op/s 2023-05-08T12:20:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:20:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:20:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:20:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:20:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30988.276667 secs 2023-05-08T12:20:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30988.832175 secs 2023-05-08T12:20:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:20:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:20:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:20:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30988.276667 secs 2023-05-08T12:20:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30988.832175 secs 2023-05-08T12:20:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:20:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:20:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:20:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30988.276667 secs 2023-05-08T12:20:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30988.832175 secs 2023-05-08T12:20:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:50 smithi186 ceph-mon[126480]: pgmap v16582: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 404 KiB/s rd, 386 KiB/s wr, 11 op/s 2023-05-08T12:20:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:50 smithi133 ceph-mon[125939]: pgmap v16582: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 404 KiB/s rd, 386 KiB/s wr, 11 op/s 2023-05-08T12:20:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:50 smithi096 ceph-mon[124666]: pgmap v16582: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 404 KiB/s rd, 386 KiB/s wr, 11 op/s 2023-05-08T12:20:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:52 smithi133 ceph-mon[125939]: pgmap v16583: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 363 KiB/s wr, 7 op/s 2023-05-08T12:20:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:52 smithi096 ceph-mon[124666]: pgmap v16583: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 363 KiB/s wr, 7 op/s 2023-05-08T12:20:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:52 smithi186 ceph-mon[126480]: pgmap v16583: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 363 KiB/s wr, 7 op/s 2023-05-08T12:20:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:54 smithi186 ceph-mon[126480]: pgmap v16584: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 363 KiB/s wr, 7 op/s 2023-05-08T12:20:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30993.276797 secs 2023-05-08T12:20:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:54 smithi133 ceph-mon[125939]: pgmap v16584: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 363 KiB/s wr, 7 op/s 2023-05-08T12:20:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30993.276797 secs 2023-05-08T12:20:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:54 smithi096 ceph-mon[124666]: pgmap v16584: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 363 KiB/s wr, 7 op/s 2023-05-08T12:20:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30993.276797 secs 2023-05-08T12:20:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:56 smithi186 ceph-mon[126480]: pgmap v16585: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 960 KiB/s wr, 13 op/s 2023-05-08T12:20:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30995.122700 secs 2023-05-08T12:20:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:56 smithi133 ceph-mon[125939]: pgmap v16585: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 960 KiB/s wr, 13 op/s 2023-05-08T12:20:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30995.122700 secs 2023-05-08T12:20:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:56 smithi096 ceph-mon[124666]: pgmap v16585: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 960 KiB/s wr, 13 op/s 2023-05-08T12:20:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30995.122700 secs 2023-05-08T12:20:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:20:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:20:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:20:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:58 smithi186 ceph-mon[126480]: pgmap v16586: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 924 KiB/s rd, 864 KiB/s wr, 9 op/s 2023-05-08T12:20:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:20:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:20:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:20:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:58 smithi133 ceph-mon[125939]: pgmap v16586: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 924 KiB/s rd, 864 KiB/s wr, 9 op/s 2023-05-08T12:20:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:20:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:20:58.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:20:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:58 smithi096 ceph-mon[124666]: pgmap v16586: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 924 KiB/s rd, 864 KiB/s wr, 9 op/s 2023-05-08T12:20:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:20:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:20:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:20:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:20:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 30998.276918 secs 2023-05-08T12:20:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:20:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 30998.276918 secs 2023-05-08T12:20:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:20:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 30998.276918 secs 2023-05-08T12:21:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:00 smithi133 ceph-mon[125939]: pgmap v16587: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 15 op/s 2023-05-08T12:21:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:00 smithi096 ceph-mon[124666]: pgmap v16587: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 15 op/s 2023-05-08T12:21:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:00 smithi186 ceph-mon[126480]: pgmap v16587: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 15 op/s 2023-05-08T12:21:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31000.122820 secs 2023-05-08T12:21:01.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31000.122820 secs 2023-05-08T12:21:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31000.122820 secs 2023-05-08T12:21:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:02 smithi133 ceph-mon[125939]: pgmap v16588: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T12:21:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:02 smithi096 ceph-mon[124666]: pgmap v16588: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T12:21:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:02 smithi186 ceph-mon[126480]: pgmap v16588: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T12:21:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:04 smithi133 ceph-mon[125939]: pgmap v16589: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T12:21:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31003.277040 secs 2023-05-08T12:21:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31003.832557 secs 2023-05-08T12:21:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:04 smithi096 ceph-mon[124666]: pgmap v16589: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T12:21:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31003.277040 secs 2023-05-08T12:21:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31003.832557 secs 2023-05-08T12:21:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:04 smithi186 ceph-mon[126480]: pgmap v16589: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T12:21:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31003.277040 secs 2023-05-08T12:21:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31003.832557 secs 2023-05-08T12:21:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:05 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:21:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:21:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:21:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:05 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:21:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:21:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:21:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:05 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:21:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:21:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:21:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:06 smithi133 ceph-mon[125939]: pgmap v16590: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 31 op/s 2023-05-08T12:21:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31005.122887 secs 2023-05-08T12:21:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:06 smithi133 ceph-mon[125939]: osdmap e1114: 12 total, 12 up, 12 in 2023-05-08T12:21:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:06 smithi096 ceph-mon[124666]: pgmap v16590: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 31 op/s 2023-05-08T12:21:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31005.122887 secs 2023-05-08T12:21:06.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:06 smithi096 ceph-mon[124666]: osdmap e1114: 12 total, 12 up, 12 in 2023-05-08T12:21:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:06 smithi186 ceph-mon[126480]: pgmap v16590: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 31 op/s 2023-05-08T12:21:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31005.122887 secs 2023-05-08T12:21:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:06 smithi186 ceph-mon[126480]: osdmap e1114: 12 total, 12 up, 12 in 2023-05-08T12:21:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:08 smithi133 ceph-mon[125939]: pgmap v16592: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1012 KiB/s rd, 1.1 MiB/s wr, 31 op/s 2023-05-08T12:21:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:08 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:21:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:08 smithi096 ceph-mon[124666]: pgmap v16592: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1012 KiB/s rd, 1.1 MiB/s wr, 31 op/s 2023-05-08T12:21:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:08 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:21:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:08 smithi186 ceph-mon[126480]: pgmap v16592: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1012 KiB/s rd, 1.1 MiB/s wr, 31 op/s 2023-05-08T12:21:08.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:08 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:21:09.688 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31008.277151 secs 2023-05-08T12:21:09.689 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31008.832703 secs 2023-05-08T12:21:09.689 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31008.277151 secs 2023-05-08T12:21:09.689 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31008.832703 secs 2023-05-08T12:21:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31008.277151 secs 2023-05-08T12:21:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31008.832703 secs 2023-05-08T12:21:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:10 smithi133 ceph-mon[125939]: pgmap v16593: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 670 KiB/s wr, 28 op/s 2023-05-08T12:21:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:10 smithi096 ceph-mon[124666]: pgmap v16593: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 670 KiB/s wr, 28 op/s 2023-05-08T12:21:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:10 smithi186 ceph-mon[126480]: pgmap v16593: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 670 KiB/s wr, 28 op/s 2023-05-08T12:21:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31010.122962 secs 2023-05-08T12:21:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:11 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:21:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:11 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:21:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31010.122962 secs 2023-05-08T12:21:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:11 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:21:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:11 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:21:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31010.122962 secs 2023-05-08T12:21:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:11 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:21:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:11 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:21:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:12 smithi096 ceph-mon[124666]: pgmap v16594: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 670 KiB/s wr, 28 op/s 2023-05-08T12:21:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:12 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:21:12.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:12 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:21:12.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:12 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:21:12.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:12 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:21:12.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:12 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:21:12.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:12 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:21:12.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:12 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T12:21:12.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:12 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T12:21:12.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:12 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:21:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:12 smithi186 ceph-mon[126480]: pgmap v16594: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 670 KiB/s wr, 28 op/s 2023-05-08T12:21:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:12 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:21:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:12 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:21:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:12 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:21:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:12 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:21:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:12 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:21:12.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:12 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:21:12.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:12 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T12:21:12.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:12 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T12:21:12.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:12 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:21:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:12 smithi133 ceph-mon[125939]: pgmap v16594: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 670 KiB/s wr, 28 op/s 2023-05-08T12:21:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:12 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:21:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:12 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:21:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:12 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:21:12.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:12 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:21:12.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:12 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:21:12.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:12 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:21:12.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:12 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T12:21:12.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:12 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T12:21:12.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:12 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:21:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:14 smithi096 ceph-mon[124666]: pgmap v16595: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 670 KiB/s wr, 28 op/s 2023-05-08T12:21:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31013.277280 secs 2023-05-08T12:21:14.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31013.832745 secs 2023-05-08T12:21:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:14 smithi186 ceph-mon[126480]: pgmap v16595: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 670 KiB/s wr, 28 op/s 2023-05-08T12:21:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31013.277280 secs 2023-05-08T12:21:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31013.832745 secs 2023-05-08T12:21:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:14 smithi133 ceph-mon[125939]: pgmap v16595: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 670 KiB/s wr, 28 op/s 2023-05-08T12:21:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31013.277280 secs 2023-05-08T12:21:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31013.832745 secs 2023-05-08T12:21:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:16 smithi096 ceph-mon[124666]: pgmap v16596: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 567 KiB/s rd, 449 KiB/s wr, 9 op/s 2023-05-08T12:21:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31015.123080 secs 2023-05-08T12:21:16.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:16 smithi096 ceph-mon[124666]: osdmap e1115: 12 total, 12 up, 12 in 2023-05-08T12:21:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:16 smithi186 ceph-mon[126480]: pgmap v16596: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 567 KiB/s rd, 449 KiB/s wr, 9 op/s 2023-05-08T12:21:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31015.123080 secs 2023-05-08T12:21:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:16 smithi186 ceph-mon[126480]: osdmap e1115: 12 total, 12 up, 12 in 2023-05-08T12:21:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:16 smithi133 ceph-mon[125939]: pgmap v16596: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 567 KiB/s rd, 449 KiB/s wr, 9 op/s 2023-05-08T12:21:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31015.123080 secs 2023-05-08T12:21:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:16 smithi133 ceph-mon[125939]: osdmap e1115: 12 total, 12 up, 12 in 2023-05-08T12:21:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:18 smithi096 ceph-mon[124666]: pgmap v16598: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 567 KiB/s rd, 449 KiB/s wr, 9 op/s 2023-05-08T12:21:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:18 smithi186 ceph-mon[126480]: pgmap v16598: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 567 KiB/s rd, 449 KiB/s wr, 9 op/s 2023-05-08T12:21:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:18 smithi133 ceph-mon[125939]: pgmap v16598: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 567 KiB/s rd, 449 KiB/s wr, 9 op/s 2023-05-08T12:21:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31018.277396 secs 2023-05-08T12:21:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31018.832813 secs 2023-05-08T12:21:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31018.277396 secs 2023-05-08T12:21:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31018.832813 secs 2023-05-08T12:21:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31018.277396 secs 2023-05-08T12:21:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31018.832813 secs 2023-05-08T12:21:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:20 smithi186 ceph-mon[126480]: pgmap v16599: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 425 KiB/s rd, 139 KiB/s wr, 8 op/s 2023-05-08T12:21:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:20 smithi133 ceph-mon[125939]: pgmap v16599: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 425 KiB/s rd, 139 KiB/s wr, 8 op/s 2023-05-08T12:21:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:20 smithi096 ceph-mon[124666]: pgmap v16599: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 425 KiB/s rd, 139 KiB/s wr, 8 op/s 2023-05-08T12:21:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31020.123198 secs 2023-05-08T12:21:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31020.123198 secs 2023-05-08T12:21:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31020.123198 secs 2023-05-08T12:21:22.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:22 smithi186 ceph-mon[126480]: pgmap v16600: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 425 KiB/s rd, 139 KiB/s wr, 8 op/s 2023-05-08T12:21:22.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:22 smithi133 ceph-mon[125939]: pgmap v16600: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 425 KiB/s rd, 139 KiB/s wr, 8 op/s 2023-05-08T12:21:23.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:22 smithi096 ceph-mon[124666]: pgmap v16600: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 425 KiB/s rd, 139 KiB/s wr, 8 op/s 2023-05-08T12:21:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:24 smithi186 ceph-mon[126480]: pgmap v16601: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 425 KiB/s rd, 139 KiB/s wr, 8 op/s 2023-05-08T12:21:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31023.277462 secs 2023-05-08T12:21:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31023.832916 secs 2023-05-08T12:21:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:24 smithi133 ceph-mon[125939]: pgmap v16601: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 425 KiB/s rd, 139 KiB/s wr, 8 op/s 2023-05-08T12:21:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31023.277462 secs 2023-05-08T12:21:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31023.832916 secs 2023-05-08T12:21:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:24 smithi096 ceph-mon[124666]: pgmap v16601: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 425 KiB/s rd, 139 KiB/s wr, 8 op/s 2023-05-08T12:21:25.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31023.277462 secs 2023-05-08T12:21:25.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31023.832916 secs 2023-05-08T12:21:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:26 smithi186 ceph-mon[126480]: pgmap v16602: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 7 op/s 2023-05-08T12:21:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31025.123311 secs 2023-05-08T12:21:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:26 smithi133 ceph-mon[125939]: pgmap v16602: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 7 op/s 2023-05-08T12:21:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31025.123311 secs 2023-05-08T12:21:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:26 smithi096 ceph-mon[124666]: pgmap v16602: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 7 op/s 2023-05-08T12:21:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31025.123311 secs 2023-05-08T12:21:28.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:28 smithi186 ceph-mon[126480]: pgmap v16603: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 184 B/s wr, 6 op/s 2023-05-08T12:21:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:28 smithi133 ceph-mon[125939]: pgmap v16603: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 184 B/s wr, 6 op/s 2023-05-08T12:21:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:28 smithi096 ceph-mon[124666]: pgmap v16603: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 184 B/s wr, 6 op/s 2023-05-08T12:21:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31028.277561 secs 2023-05-08T12:21:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31028.833030 secs 2023-05-08T12:21:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31028.277561 secs 2023-05-08T12:21:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31028.833030 secs 2023-05-08T12:21:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31028.277561 secs 2023-05-08T12:21:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31028.833030 secs 2023-05-08T12:21:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:30 smithi186 ceph-mon[126480]: pgmap v16604: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 255 B/s wr, 9 op/s 2023-05-08T12:21:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31030.123436 secs 2023-05-08T12:21:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:30 smithi133 ceph-mon[125939]: pgmap v16604: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 255 B/s wr, 9 op/s 2023-05-08T12:21:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31030.123436 secs 2023-05-08T12:21:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:30 smithi096 ceph-mon[124666]: pgmap v16604: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 255 B/s wr, 9 op/s 2023-05-08T12:21:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31030.123436 secs 2023-05-08T12:21:32.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:32 smithi133 ceph-mon[125939]: pgmap v16605: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 6 op/s 2023-05-08T12:21:32.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:32 smithi096 ceph-mon[124666]: pgmap v16605: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 6 op/s 2023-05-08T12:21:32.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:32 smithi186 ceph-mon[126480]: pgmap v16605: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 6 op/s 2023-05-08T12:21:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:34 smithi186 ceph-mon[126480]: pgmap v16606: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 6 op/s 2023-05-08T12:21:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31033.277708 secs 2023-05-08T12:21:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31033.833148 secs 2023-05-08T12:21:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:34 smithi133 ceph-mon[125939]: pgmap v16606: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 6 op/s 2023-05-08T12:21:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31033.277708 secs 2023-05-08T12:21:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31033.833148 secs 2023-05-08T12:21:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:34 smithi096 ceph-mon[124666]: pgmap v16606: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 6 op/s 2023-05-08T12:21:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31033.277708 secs 2023-05-08T12:21:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31033.833148 secs 2023-05-08T12:21:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:36 smithi186 ceph-mon[126480]: pgmap v16607: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 234 KiB/s wr, 9 op/s 2023-05-08T12:21:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31035.123573 secs 2023-05-08T12:21:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:36 smithi133 ceph-mon[125939]: pgmap v16607: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 234 KiB/s wr, 9 op/s 2023-05-08T12:21:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31035.123573 secs 2023-05-08T12:21:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:36 smithi096 ceph-mon[124666]: pgmap v16607: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 234 KiB/s wr, 9 op/s 2023-05-08T12:21:36.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31035.123573 secs 2023-05-08T12:21:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:38 smithi133 ceph-mon[125939]: pgmap v16608: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 234 KiB/s wr, 7 op/s 2023-05-08T12:21:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:38 smithi096 ceph-mon[124666]: pgmap v16608: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 234 KiB/s wr, 7 op/s 2023-05-08T12:21:38.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:38 smithi186 ceph-mon[126480]: pgmap v16608: 97 pgs: 97 active+clean; 6.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 234 KiB/s wr, 7 op/s 2023-05-08T12:21:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31038.277833 secs 2023-05-08T12:21:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31038.833263 secs 2023-05-08T12:21:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31038.277833 secs 2023-05-08T12:21:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31038.833263 secs 2023-05-08T12:21:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31038.277833 secs 2023-05-08T12:21:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31038.833263 secs 2023-05-08T12:21:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:40 smithi133 ceph-mon[125939]: pgmap v16609: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 353 KiB/s wr, 10 op/s 2023-05-08T12:21:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:40 smithi096 ceph-mon[124666]: pgmap v16609: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 353 KiB/s wr, 10 op/s 2023-05-08T12:21:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:40 smithi186 ceph-mon[126480]: pgmap v16609: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 353 KiB/s wr, 10 op/s 2023-05-08T12:21:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31040.123664 secs 2023-05-08T12:21:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31040.123664 secs 2023-05-08T12:21:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31040.123664 secs 2023-05-08T12:21:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:42 smithi133 ceph-mon[125939]: pgmap v16610: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 355 KiB/s rd, 353 KiB/s wr, 7 op/s 2023-05-08T12:21:42.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:42 smithi096 ceph-mon[124666]: pgmap v16610: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 355 KiB/s rd, 353 KiB/s wr, 7 op/s 2023-05-08T12:21:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:42 smithi186 ceph-mon[126480]: pgmap v16610: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 355 KiB/s rd, 353 KiB/s wr, 7 op/s 2023-05-08T12:21:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:44 smithi133 ceph-mon[125939]: pgmap v16611: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 355 KiB/s rd, 353 KiB/s wr, 7 op/s 2023-05-08T12:21:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31043.277969 secs 2023-05-08T12:21:44.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31043.833361 secs 2023-05-08T12:21:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:44 smithi096 ceph-mon[124666]: pgmap v16611: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 355 KiB/s rd, 353 KiB/s wr, 7 op/s 2023-05-08T12:21:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31043.277969 secs 2023-05-08T12:21:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31043.833361 secs 2023-05-08T12:21:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:44 smithi186 ceph-mon[126480]: pgmap v16611: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 355 KiB/s rd, 353 KiB/s wr, 7 op/s 2023-05-08T12:21:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31043.277969 secs 2023-05-08T12:21:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31043.833361 secs 2023-05-08T12:21:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:46 smithi133 ceph-mon[125939]: pgmap v16612: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 580 KiB/s rd, 577 KiB/s wr, 11 op/s 2023-05-08T12:21:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:46 smithi096 ceph-mon[124666]: pgmap v16612: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 580 KiB/s rd, 577 KiB/s wr, 11 op/s 2023-05-08T12:21:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:46 smithi186 ceph-mon[126480]: pgmap v16612: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 580 KiB/s rd, 577 KiB/s wr, 11 op/s 2023-05-08T12:21:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:48 smithi133 ceph-mon[125939]: pgmap v16613: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 344 KiB/s wr, 7 op/s 2023-05-08T12:21:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:48 smithi096 ceph-mon[124666]: pgmap v16613: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 344 KiB/s wr, 7 op/s 2023-05-08T12:21:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:48 smithi186 ceph-mon[126480]: pgmap v16613: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 344 KiB/s wr, 7 op/s 2023-05-08T12:21:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:21:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31048.278116 secs 2023-05-08T12:21:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31048.833429 secs 2023-05-08T12:21:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:21:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31048.278116 secs 2023-05-08T12:21:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31048.833429 secs 2023-05-08T12:21:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:21:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31048.278116 secs 2023-05-08T12:21:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31048.833429 secs 2023-05-08T12:21:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:50 smithi133 ceph-mon[125939]: pgmap v16614: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 683 KiB/s rd, 685 KiB/s wr, 11 op/s 2023-05-08T12:21:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:21:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:21:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:21:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:50 smithi096 ceph-mon[124666]: pgmap v16614: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 683 KiB/s rd, 685 KiB/s wr, 11 op/s 2023-05-08T12:21:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:21:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:21:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:21:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:50 smithi186 ceph-mon[126480]: pgmap v16614: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 683 KiB/s rd, 685 KiB/s wr, 11 op/s 2023-05-08T12:21:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:21:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:21:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:21:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:52 smithi133 ceph-mon[125939]: pgmap v16615: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 566 KiB/s wr, 7 op/s 2023-05-08T12:21:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:52 smithi096 ceph-mon[124666]: pgmap v16615: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 566 KiB/s wr, 7 op/s 2023-05-08T12:21:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:52 smithi186 ceph-mon[126480]: pgmap v16615: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 566 KiB/s wr, 7 op/s 2023-05-08T12:21:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:54 smithi133 ceph-mon[125939]: pgmap v16616: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 566 KiB/s wr, 7 op/s 2023-05-08T12:21:54.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31053.278245 secs 2023-05-08T12:21:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:54 smithi096 ceph-mon[124666]: pgmap v16616: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 566 KiB/s wr, 7 op/s 2023-05-08T12:21:54.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31053.278245 secs 2023-05-08T12:21:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:54 smithi186 ceph-mon[126480]: pgmap v16616: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 566 KiB/s wr, 7 op/s 2023-05-08T12:21:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31053.278245 secs 2023-05-08T12:21:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:56 smithi133 ceph-mon[125939]: pgmap v16617: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 840 KiB/s wr, 11 op/s 2023-05-08T12:21:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:56 smithi096 ceph-mon[124666]: pgmap v16617: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 840 KiB/s wr, 11 op/s 2023-05-08T12:21:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:56 smithi186 ceph-mon[126480]: pgmap v16617: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 840 KiB/s wr, 11 op/s 2023-05-08T12:21:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:21:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:21:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:21:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:58 smithi133 ceph-mon[125939]: pgmap v16618: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 615 KiB/s wr, 8 op/s 2023-05-08T12:21:58.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:58 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:21:58.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:21:58.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:21:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:58 smithi096 ceph-mon[124666]: pgmap v16618: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 615 KiB/s wr, 8 op/s 2023-05-08T12:21:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:58 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:21:58.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:21:58.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:21:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:58 smithi186 ceph-mon[126480]: pgmap v16618: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 615 KiB/s wr, 8 op/s 2023-05-08T12:21:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:58 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:21:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:21:58.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:21:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31058.278388 secs 2023-05-08T12:21:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:21:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31058.833684 secs 2023-05-08T12:21:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31058.278388 secs 2023-05-08T12:21:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:21:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31058.833684 secs 2023-05-08T12:21:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31058.278388 secs 2023-05-08T12:21:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:21:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31058.833684 secs 2023-05-08T12:22:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:00 smithi133 ceph-mon[125939]: pgmap v16619: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.0 MiB/s wr, 14 op/s 2023-05-08T12:22:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:00 smithi096 ceph-mon[124666]: pgmap v16619: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.0 MiB/s wr, 14 op/s 2023-05-08T12:22:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:00 smithi186 ceph-mon[126480]: pgmap v16619: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.0 MiB/s wr, 14 op/s 2023-05-08T12:22:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31060.124155 secs 2023-05-08T12:22:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31060.124155 secs 2023-05-08T12:22:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31060.124155 secs 2023-05-08T12:22:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:02 smithi133 ceph-mon[125939]: pgmap v16620: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 699 KiB/s wr, 10 op/s 2023-05-08T12:22:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:22:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:22:02.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:22:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:02 smithi096 ceph-mon[124666]: pgmap v16620: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 699 KiB/s wr, 10 op/s 2023-05-08T12:22:02.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:22:02.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:22:02.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:22:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:02 smithi186 ceph-mon[126480]: pgmap v16620: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 699 KiB/s wr, 10 op/s 2023-05-08T12:22:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:22:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:22:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:22:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:04 smithi133 ceph-mon[125939]: pgmap v16621: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 699 KiB/s wr, 10 op/s 2023-05-08T12:22:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31063.278513 secs 2023-05-08T12:22:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:04 smithi096 ceph-mon[124666]: pgmap v16621: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 699 KiB/s wr, 10 op/s 2023-05-08T12:22:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31063.278513 secs 2023-05-08T12:22:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:04 smithi186 ceph-mon[126480]: pgmap v16621: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 699 KiB/s wr, 10 op/s 2023-05-08T12:22:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31063.278513 secs 2023-05-08T12:22:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:05 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:22:05.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:05 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:22:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:05 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:22:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:06 smithi133 ceph-mon[125939]: pgmap v16622: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 987 KiB/s wr, 18 op/s 2023-05-08T12:22:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31065.124275 secs 2023-05-08T12:22:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:06 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:22:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:22:06.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:22:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:06 smithi096 ceph-mon[124666]: pgmap v16622: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 987 KiB/s wr, 18 op/s 2023-05-08T12:22:06.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31065.124275 secs 2023-05-08T12:22:06.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:06 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:22:06.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:22:06.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:22:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:06 smithi186 ceph-mon[126480]: pgmap v16622: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 987 KiB/s wr, 18 op/s 2023-05-08T12:22:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31065.124275 secs 2023-05-08T12:22:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:06 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:22:06.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:22:06.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:22:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:08 smithi133 ceph-mon[125939]: pgmap v16623: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 727 KiB/s rd, 756 KiB/s wr, 13 op/s 2023-05-08T12:22:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:08 smithi096 ceph-mon[124666]: pgmap v16623: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 727 KiB/s rd, 756 KiB/s wr, 13 op/s 2023-05-08T12:22:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:08 smithi186 ceph-mon[126480]: pgmap v16623: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 727 KiB/s rd, 756 KiB/s wr, 13 op/s 2023-05-08T12:22:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31068.278616 secs 2023-05-08T12:22:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31068.833876 secs 2023-05-08T12:22:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31068.278616 secs 2023-05-08T12:22:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31068.833876 secs 2023-05-08T12:22:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31068.278616 secs 2023-05-08T12:22:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31068.833876 secs 2023-05-08T12:22:10.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:10 smithi133 ceph-mon[125939]: pgmap v16624: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 889 KiB/s rd, 954 KiB/s wr, 31 op/s 2023-05-08T12:22:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:10 smithi096 ceph-mon[124666]: pgmap v16624: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 889 KiB/s rd, 954 KiB/s wr, 31 op/s 2023-05-08T12:22:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:10 smithi186 ceph-mon[126480]: pgmap v16624: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 889 KiB/s rd, 954 KiB/s wr, 31 op/s 2023-05-08T12:22:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31070.124393 secs 2023-05-08T12:22:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:11 smithi133 ceph-mon[125939]: osdmap e1116: 12 total, 12 up, 12 in 2023-05-08T12:22:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31070.124393 secs 2023-05-08T12:22:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:11 smithi096 ceph-mon[124666]: osdmap e1116: 12 total, 12 up, 12 in 2023-05-08T12:22:11.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31070.124393 secs 2023-05-08T12:22:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:11 smithi186 ceph-mon[126480]: osdmap e1116: 12 total, 12 up, 12 in 2023-05-08T12:22:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:12 smithi133 ceph-mon[125939]: pgmap v16626: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 994 KiB/s wr, 32 op/s 2023-05-08T12:22:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:12 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:22:12.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:12 smithi096 ceph-mon[124666]: pgmap v16626: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 994 KiB/s wr, 32 op/s 2023-05-08T12:22:12.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:12 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:22:12.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:12 smithi186 ceph-mon[126480]: pgmap v16626: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 994 KiB/s wr, 32 op/s 2023-05-08T12:22:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:12 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:22:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:13 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:22:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:22:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:13 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:22:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:13 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:22:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:22:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:13 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:22:13.790 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:13 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:22:13.790 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:22:13.791 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:13 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:22:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:14 smithi133 ceph-mon[125939]: pgmap v16627: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 994 KiB/s wr, 32 op/s 2023-05-08T12:22:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31073.278695 secs 2023-05-08T12:22:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31073.833962 secs 2023-05-08T12:22:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:14 smithi096 ceph-mon[124666]: pgmap v16627: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 994 KiB/s wr, 32 op/s 2023-05-08T12:22:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31073.278695 secs 2023-05-08T12:22:14.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31073.833962 secs 2023-05-08T12:22:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:14 smithi186 ceph-mon[126480]: pgmap v16627: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 994 KiB/s wr, 32 op/s 2023-05-08T12:22:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31073.278695 secs 2023-05-08T12:22:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31073.833962 secs 2023-05-08T12:22:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:15 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:22:16.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:15 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:22:16.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:15 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:22:16.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:15 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:22:16.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:15 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:22:16.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:15 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:22:16.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:15 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T12:22:16.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:15 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T12:22:16.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:15 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:22:16.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:15 smithi133 ceph-mon[125939]: pgmap v16628: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 821 KiB/s rd, 908 KiB/s wr, 28 op/s 2023-05-08T12:22:16.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31075.124532 secs 2023-05-08T12:22:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:15 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:22:16.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:15 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:22:16.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:15 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:22:16.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:15 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:22:16.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:15 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:22:16.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:15 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:22:16.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:15 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T12:22:16.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:15 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T12:22:16.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:15 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:22:16.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:15 smithi096 ceph-mon[124666]: pgmap v16628: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 821 KiB/s rd, 908 KiB/s wr, 28 op/s 2023-05-08T12:22:16.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31075.124532 secs 2023-05-08T12:22:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:15 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:22:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:15 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:22:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:15 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:22:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:15 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:22:16.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:15 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:22:16.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:15 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:22:16.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:15 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T12:22:16.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:15 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T12:22:16.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:15 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:22:16.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:15 smithi186 ceph-mon[126480]: pgmap v16628: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 821 KiB/s rd, 908 KiB/s wr, 28 op/s 2023-05-08T12:22:16.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31075.124532 secs 2023-05-08T12:22:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:17 smithi133 ceph-mon[125939]: osdmap e1117: 12 total, 12 up, 12 in 2023-05-08T12:22:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:17 smithi096 ceph-mon[124666]: osdmap e1117: 12 total, 12 up, 12 in 2023-05-08T12:22:17.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:17 smithi186 ceph-mon[126480]: osdmap e1117: 12 total, 12 up, 12 in 2023-05-08T12:22:18.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:18 smithi133 ceph-mon[125939]: pgmap v16630: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 839 KiB/s rd, 775 KiB/s wr, 8 op/s 2023-05-08T12:22:18.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:18 smithi096 ceph-mon[124666]: pgmap v16630: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 839 KiB/s rd, 775 KiB/s wr, 8 op/s 2023-05-08T12:22:18.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:18 smithi186 ceph-mon[126480]: pgmap v16630: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 839 KiB/s rd, 775 KiB/s wr, 8 op/s 2023-05-08T12:22:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31078.278796 secs 2023-05-08T12:22:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31078.278796 secs 2023-05-08T12:22:19.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31078.278796 secs 2023-05-08T12:22:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31078.834089 secs 2023-05-08T12:22:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:20 smithi133 ceph-mon[125939]: pgmap v16631: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 884 KiB/s rd, 825 KiB/s wr, 11 op/s 2023-05-08T12:22:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31078.834089 secs 2023-05-08T12:22:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:20 smithi096 ceph-mon[124666]: pgmap v16631: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 884 KiB/s rd, 825 KiB/s wr, 11 op/s 2023-05-08T12:22:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31078.834089 secs 2023-05-08T12:22:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:20 smithi186 ceph-mon[126480]: pgmap v16631: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 884 KiB/s rd, 825 KiB/s wr, 11 op/s 2023-05-08T12:22:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31080.124657 secs 2023-05-08T12:22:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31080.124657 secs 2023-05-08T12:22:21.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31080.124657 secs 2023-05-08T12:22:22.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:22 smithi133 ceph-mon[125939]: pgmap v16632: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 375 KiB/s wr, 9 op/s 2023-05-08T12:22:22.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:22 smithi096 ceph-mon[124666]: pgmap v16632: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 375 KiB/s wr, 9 op/s 2023-05-08T12:22:22.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:22 smithi186 ceph-mon[126480]: pgmap v16632: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 375 KiB/s wr, 9 op/s 2023-05-08T12:22:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:24 smithi133 ceph-mon[125939]: pgmap v16633: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 375 KiB/s wr, 9 op/s 2023-05-08T12:22:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31083.278914 secs 2023-05-08T12:22:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31083.834227 secs 2023-05-08T12:22:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:24 smithi096 ceph-mon[124666]: pgmap v16633: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 375 KiB/s wr, 9 op/s 2023-05-08T12:22:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31083.278914 secs 2023-05-08T12:22:24.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31083.834227 secs 2023-05-08T12:22:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:24 smithi186 ceph-mon[126480]: pgmap v16633: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 375 KiB/s wr, 9 op/s 2023-05-08T12:22:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31083.278914 secs 2023-05-08T12:22:24.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31083.834227 secs 2023-05-08T12:22:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:26 smithi133 ceph-mon[125939]: pgmap v16634: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 115 KiB/s wr, 7 op/s 2023-05-08T12:22:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31085.124766 secs 2023-05-08T12:22:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:26 smithi096 ceph-mon[124666]: pgmap v16634: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 115 KiB/s wr, 7 op/s 2023-05-08T12:22:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31085.124766 secs 2023-05-08T12:22:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:26 smithi186 ceph-mon[126480]: pgmap v16634: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 115 KiB/s wr, 7 op/s 2023-05-08T12:22:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31085.124766 secs 2023-05-08T12:22:28.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:28 smithi133 ceph-mon[125939]: pgmap v16635: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 103 KiB/s wr, 5 op/s 2023-05-08T12:22:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:28 smithi096 ceph-mon[124666]: pgmap v16635: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 103 KiB/s wr, 5 op/s 2023-05-08T12:22:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:28 smithi186 ceph-mon[126480]: pgmap v16635: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 103 KiB/s wr, 5 op/s 2023-05-08T12:22:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31088.279030 secs 2023-05-08T12:22:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31088.834335 secs 2023-05-08T12:22:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31088.279030 secs 2023-05-08T12:22:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31088.834335 secs 2023-05-08T12:22:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31088.279030 secs 2023-05-08T12:22:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31088.834335 secs 2023-05-08T12:22:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:30 smithi133 ceph-mon[125939]: pgmap v16636: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 95 KiB/s wr, 7 op/s 2023-05-08T12:22:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:30 smithi096 ceph-mon[124666]: pgmap v16636: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 95 KiB/s wr, 7 op/s 2023-05-08T12:22:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:30 smithi186 ceph-mon[126480]: pgmap v16636: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 95 KiB/s wr, 7 op/s 2023-05-08T12:22:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31090.124909 secs 2023-05-08T12:22:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31090.124909 secs 2023-05-08T12:22:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31090.124909 secs 2023-05-08T12:22:32.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:32 smithi133 ceph-mon[125939]: pgmap v16637: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T12:22:32.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:32 smithi096 ceph-mon[124666]: pgmap v16637: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T12:22:32.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:32 smithi186 ceph-mon[126480]: pgmap v16637: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T12:22:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:34 smithi133 ceph-mon[125939]: pgmap v16638: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T12:22:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31093.279153 secs 2023-05-08T12:22:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31093.834455 secs 2023-05-08T12:22:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:34 smithi096 ceph-mon[124666]: pgmap v16638: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T12:22:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31093.279153 secs 2023-05-08T12:22:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31093.834455 secs 2023-05-08T12:22:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:34 smithi186 ceph-mon[126480]: pgmap v16638: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T12:22:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31093.279153 secs 2023-05-08T12:22:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31093.834455 secs 2023-05-08T12:22:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:36 smithi133 ceph-mon[125939]: pgmap v16639: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T12:22:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31095.125041 secs 2023-05-08T12:22:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:36 smithi096 ceph-mon[124666]: pgmap v16639: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T12:22:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31095.125041 secs 2023-05-08T12:22:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:36 smithi186 ceph-mon[126480]: pgmap v16639: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2023-05-08T12:22:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31095.125041 secs 2023-05-08T12:22:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:38 smithi133 ceph-mon[125939]: pgmap v16640: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T12:22:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:38 smithi096 ceph-mon[124666]: pgmap v16640: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T12:22:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:38 smithi186 ceph-mon[126480]: pgmap v16640: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T12:22:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31098.279270 secs 2023-05-08T12:22:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31098.834580 secs 2023-05-08T12:22:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31098.279270 secs 2023-05-08T12:22:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31098.834580 secs 2023-05-08T12:22:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31098.279270 secs 2023-05-08T12:22:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31098.834580 secs 2023-05-08T12:22:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:40 smithi133 ceph-mon[125939]: pgmap v16641: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 8 op/s 2023-05-08T12:22:40.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:40 smithi096 ceph-mon[124666]: pgmap v16641: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 8 op/s 2023-05-08T12:22:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:40 smithi186 ceph-mon[126480]: pgmap v16641: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 8 op/s 2023-05-08T12:22:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31100.125144 secs 2023-05-08T12:22:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31100.125144 secs 2023-05-08T12:22:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31100.125144 secs 2023-05-08T12:22:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:42 smithi133 ceph-mon[125939]: pgmap v16642: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 6 op/s 2023-05-08T12:22:42.847 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:42 smithi096 ceph-mon[124666]: pgmap v16642: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 6 op/s 2023-05-08T12:22:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:42 smithi186 ceph-mon[126480]: pgmap v16642: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 6 op/s 2023-05-08T12:22:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:44 smithi133 ceph-mon[125939]: pgmap v16643: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 6 op/s 2023-05-08T12:22:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31103.279381 secs 2023-05-08T12:22:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31103.834644 secs 2023-05-08T12:22:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:44 smithi096 ceph-mon[124666]: pgmap v16643: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 6 op/s 2023-05-08T12:22:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31103.279381 secs 2023-05-08T12:22:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31103.834644 secs 2023-05-08T12:22:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:44 smithi186 ceph-mon[126480]: pgmap v16643: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 6 op/s 2023-05-08T12:22:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31103.279381 secs 2023-05-08T12:22:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31103.834644 secs 2023-05-08T12:22:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:46 smithi133 ceph-mon[125939]: pgmap v16644: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 120 KiB/s wr, 10 op/s 2023-05-08T12:22:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:46 smithi096 ceph-mon[124666]: pgmap v16644: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 120 KiB/s wr, 10 op/s 2023-05-08T12:22:46.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:46 smithi186 ceph-mon[126480]: pgmap v16644: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 120 KiB/s wr, 10 op/s 2023-05-08T12:22:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:48 smithi133 ceph-mon[125939]: pgmap v16645: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 120 KiB/s wr, 7 op/s 2023-05-08T12:22:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:22:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:48 smithi096 ceph-mon[124666]: pgmap v16645: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 120 KiB/s wr, 7 op/s 2023-05-08T12:22:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:22:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:48 smithi186 ceph-mon[126480]: pgmap v16645: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 120 KiB/s wr, 7 op/s 2023-05-08T12:22:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:22:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:22:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:22:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:22:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31108.279531 secs 2023-05-08T12:22:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31108.834792 secs 2023-05-08T12:22:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:22:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:22:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:22:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31108.279531 secs 2023-05-08T12:22:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31108.834792 secs 2023-05-08T12:22:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:22:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:22:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:22:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31108.279531 secs 2023-05-08T12:22:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31108.834792 secs 2023-05-08T12:22:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:50 smithi133 ceph-mon[125939]: pgmap v16646: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 409 KiB/s rd, 373 KiB/s wr, 11 op/s 2023-05-08T12:22:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:50 smithi096 ceph-mon[124666]: pgmap v16646: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 409 KiB/s rd, 373 KiB/s wr, 11 op/s 2023-05-08T12:22:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:50 smithi186 ceph-mon[126480]: pgmap v16646: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 409 KiB/s rd, 373 KiB/s wr, 11 op/s 2023-05-08T12:22:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:52 smithi133 ceph-mon[125939]: pgmap v16647: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 407 KiB/s rd, 372 KiB/s wr, 7 op/s 2023-05-08T12:22:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:52 smithi096 ceph-mon[124666]: pgmap v16647: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 407 KiB/s rd, 372 KiB/s wr, 7 op/s 2023-05-08T12:22:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:52 smithi186 ceph-mon[126480]: pgmap v16647: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 407 KiB/s rd, 372 KiB/s wr, 7 op/s 2023-05-08T12:22:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:54 smithi133 ceph-mon[125939]: pgmap v16648: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 407 KiB/s rd, 372 KiB/s wr, 7 op/s 2023-05-08T12:22:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31113.279647 secs 2023-05-08T12:22:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:54 smithi096 ceph-mon[124666]: pgmap v16648: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 407 KiB/s rd, 372 KiB/s wr, 7 op/s 2023-05-08T12:22:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31113.279647 secs 2023-05-08T12:22:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:54 smithi186 ceph-mon[126480]: pgmap v16648: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 407 KiB/s rd, 372 KiB/s wr, 7 op/s 2023-05-08T12:22:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31113.279647 secs 2023-05-08T12:22:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:56 smithi133 ceph-mon[125939]: pgmap v16649: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 965 KiB/s wr, 12 op/s 2023-05-08T12:22:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:56 smithi096 ceph-mon[124666]: pgmap v16649: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 965 KiB/s wr, 12 op/s 2023-05-08T12:22:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:56 smithi186 ceph-mon[126480]: pgmap v16649: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 965 KiB/s wr, 12 op/s 2023-05-08T12:22:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:22:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:22:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:22:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:58 smithi133 ceph-mon[125939]: pgmap v16650: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 929 KiB/s rd, 845 KiB/s wr, 8 op/s 2023-05-08T12:22:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:58 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:22:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:22:58.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:22:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:58 smithi096 ceph-mon[124666]: pgmap v16650: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 929 KiB/s rd, 845 KiB/s wr, 8 op/s 2023-05-08T12:22:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:58 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:22:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:22:58.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:22:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:58 smithi186 ceph-mon[126480]: pgmap v16650: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 929 KiB/s rd, 845 KiB/s wr, 8 op/s 2023-05-08T12:22:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:58 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:22:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:22:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:22:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31118.279763 secs 2023-05-08T12:22:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:22:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31118.834971 secs 2023-05-08T12:22:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31118.279763 secs 2023-05-08T12:22:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:22:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31118.834971 secs 2023-05-08T12:22:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31118.279763 secs 2023-05-08T12:22:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:22:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31118.834971 secs 2023-05-08T12:23:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:00 smithi133 ceph-mon[125939]: pgmap v16651: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 15 op/s 2023-05-08T12:23:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:00 smithi096 ceph-mon[124666]: pgmap v16651: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 15 op/s 2023-05-08T12:23:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:00 smithi186 ceph-mon[126480]: pgmap v16651: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 15 op/s 2023-05-08T12:23:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31120.125593 secs 2023-05-08T12:23:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31120.125593 secs 2023-05-08T12:23:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31120.125593 secs 2023-05-08T12:23:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:02 smithi133 ceph-mon[125939]: pgmap v16652: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 938 KiB/s rd, 1020 KiB/s wr, 11 op/s 2023-05-08T12:23:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:23:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:23:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:23:02.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:02 smithi096 ceph-mon[124666]: pgmap v16652: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 938 KiB/s rd, 1020 KiB/s wr, 11 op/s 2023-05-08T12:23:02.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:23:02.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:23:02.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:23:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:02 smithi186 ceph-mon[126480]: pgmap v16652: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 938 KiB/s rd, 1020 KiB/s wr, 11 op/s 2023-05-08T12:23:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:23:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:23:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:23:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:04 smithi133 ceph-mon[125939]: pgmap v16653: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 938 KiB/s rd, 1020 KiB/s wr, 11 op/s 2023-05-08T12:23:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31123.279880 secs 2023-05-08T12:23:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:04 smithi096 ceph-mon[124666]: pgmap v16653: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 938 KiB/s rd, 1020 KiB/s wr, 11 op/s 2023-05-08T12:23:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31123.279880 secs 2023-05-08T12:23:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:04 smithi186 ceph-mon[126480]: pgmap v16653: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 938 KiB/s rd, 1020 KiB/s wr, 11 op/s 2023-05-08T12:23:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31123.279880 secs 2023-05-08T12:23:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:05 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:23:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:05 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:23:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:05 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:23:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:06 smithi133 ceph-mon[125939]: pgmap v16654: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 22 op/s 2023-05-08T12:23:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31125.125697 secs 2023-05-08T12:23:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:06 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:23:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:23:06.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:23:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:06 smithi096 ceph-mon[124666]: pgmap v16654: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 22 op/s 2023-05-08T12:23:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31125.125697 secs 2023-05-08T12:23:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:06 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:23:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:23:06.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:23:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:06 smithi186 ceph-mon[126480]: pgmap v16654: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 22 op/s 2023-05-08T12:23:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31125.125697 secs 2023-05-08T12:23:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:06 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:23:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:23:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:23:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:08 smithi133 ceph-mon[125939]: pgmap v16655: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 719 KiB/s rd, 706 KiB/s wr, 17 op/s 2023-05-08T12:23:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:08 smithi096 ceph-mon[124666]: pgmap v16655: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 719 KiB/s rd, 706 KiB/s wr, 17 op/s 2023-05-08T12:23:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:08 smithi186 ceph-mon[126480]: pgmap v16655: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 719 KiB/s rd, 706 KiB/s wr, 17 op/s 2023-05-08T12:23:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31128.279990 secs 2023-05-08T12:23:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31128.835165 secs 2023-05-08T12:23:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31128.279990 secs 2023-05-08T12:23:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31128.835165 secs 2023-05-08T12:23:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31128.279990 secs 2023-05-08T12:23:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31128.835165 secs 2023-05-08T12:23:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:10 smithi133 ceph-mon[125939]: pgmap v16656: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 809 KiB/s rd, 1.1 MiB/s wr, 35 op/s 2023-05-08T12:23:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:10 smithi096 ceph-mon[124666]: pgmap v16656: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 809 KiB/s rd, 1.1 MiB/s wr, 35 op/s 2023-05-08T12:23:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:10 smithi186 ceph-mon[126480]: pgmap v16656: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 809 KiB/s rd, 1.1 MiB/s wr, 35 op/s 2023-05-08T12:23:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31130.125826 secs 2023-05-08T12:23:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:11 smithi133 ceph-mon[125939]: osdmap e1118: 12 total, 12 up, 12 in 2023-05-08T12:23:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31130.125826 secs 2023-05-08T12:23:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:11 smithi096 ceph-mon[124666]: osdmap e1118: 12 total, 12 up, 12 in 2023-05-08T12:23:11.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31130.125826 secs 2023-05-08T12:23:11.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:11 smithi186 ceph-mon[126480]: osdmap e1118: 12 total, 12 up, 12 in 2023-05-08T12:23:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:12 smithi133 ceph-mon[125939]: pgmap v16658: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 799 KiB/s wr, 35 op/s 2023-05-08T12:23:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:12 smithi096 ceph-mon[124666]: pgmap v16658: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 799 KiB/s wr, 35 op/s 2023-05-08T12:23:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:12 smithi186 ceph-mon[126480]: pgmap v16658: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 799 KiB/s wr, 35 op/s 2023-05-08T12:23:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:13 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:23:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:23:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:13 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:23:13.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:13 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:23:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:23:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:13 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:23:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:13 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:23:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:23:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:13 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:23:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:14 smithi096 ceph-mon[124666]: pgmap v16659: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 799 KiB/s wr, 35 op/s 2023-05-08T12:23:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31133.280113 secs 2023-05-08T12:23:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31133.835313 secs 2023-05-08T12:23:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:14 smithi186 ceph-mon[126480]: pgmap v16659: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 799 KiB/s wr, 35 op/s 2023-05-08T12:23:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31133.280113 secs 2023-05-08T12:23:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31133.835313 secs 2023-05-08T12:23:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:14 smithi133 ceph-mon[125939]: pgmap v16659: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 799 KiB/s wr, 35 op/s 2023-05-08T12:23:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31133.280113 secs 2023-05-08T12:23:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31133.835313 secs 2023-05-08T12:23:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:15 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:23:15.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:15 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:23:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:15 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:23:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:16 smithi096 ceph-mon[124666]: pgmap v16660: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 588 KiB/s rd, 630 KiB/s wr, 26 op/s 2023-05-08T12:23:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31135.125916 secs 2023-05-08T12:23:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:16 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:23:16.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:16 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:23:16.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:16 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:23:16.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:16 smithi096 ceph-mon[124666]: osdmap e1119: 12 total, 12 up, 12 in 2023-05-08T12:23:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:16 smithi186 ceph-mon[126480]: pgmap v16660: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 588 KiB/s rd, 630 KiB/s wr, 26 op/s 2023-05-08T12:23:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31135.125916 secs 2023-05-08T12:23:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:16 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:23:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:16 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:23:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:16 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:23:16.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:16 smithi186 ceph-mon[126480]: osdmap e1119: 12 total, 12 up, 12 in 2023-05-08T12:23:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:16 smithi133 ceph-mon[125939]: pgmap v16660: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 588 KiB/s rd, 630 KiB/s wr, 26 op/s 2023-05-08T12:23:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31135.125916 secs 2023-05-08T12:23:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:16 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:23:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:16 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:23:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:16 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:23:16.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:16 smithi133 ceph-mon[125939]: osdmap e1119: 12 total, 12 up, 12 in 2023-05-08T12:23:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:17 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:23:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:17 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T12:23:17.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:17 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T12:23:17.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:17 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:23:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:17 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:23:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:17 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T12:23:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:17 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T12:23:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:17 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:23:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:17 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:23:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:17 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T12:23:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:17 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T12:23:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:17 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:23:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:18 smithi096 ceph-mon[124666]: pgmap v16662: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 599 KiB/s rd, 205 KiB/s wr, 5 op/s 2023-05-08T12:23:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:18 smithi186 ceph-mon[126480]: pgmap v16662: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 599 KiB/s rd, 205 KiB/s wr, 5 op/s 2023-05-08T12:23:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:18 smithi133 ceph-mon[125939]: pgmap v16662: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 599 KiB/s rd, 205 KiB/s wr, 5 op/s 2023-05-08T12:23:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31138.280230 secs 2023-05-08T12:23:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31138.835440 secs 2023-05-08T12:23:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31138.280230 secs 2023-05-08T12:23:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31138.835440 secs 2023-05-08T12:23:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31138.280230 secs 2023-05-08T12:23:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31138.835440 secs 2023-05-08T12:23:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:20 smithi186 ceph-mon[126480]: pgmap v16663: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 669 KiB/s rd, 313 KiB/s wr, 9 op/s 2023-05-08T12:23:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:20 smithi133 ceph-mon[125939]: pgmap v16663: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 669 KiB/s rd, 313 KiB/s wr, 9 op/s 2023-05-08T12:23:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:20 smithi096 ceph-mon[124666]: pgmap v16663: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 669 KiB/s rd, 313 KiB/s wr, 9 op/s 2023-05-08T12:23:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31140.126040 secs 2023-05-08T12:23:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31140.126040 secs 2023-05-08T12:23:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31140.126040 secs 2023-05-08T12:23:22.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:22 smithi186 ceph-mon[126480]: pgmap v16664: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 596 KiB/s rd, 279 KiB/s wr, 8 op/s 2023-05-08T12:23:22.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:22 smithi133 ceph-mon[125939]: pgmap v16664: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 596 KiB/s rd, 279 KiB/s wr, 8 op/s 2023-05-08T12:23:23.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:22 smithi096 ceph-mon[124666]: pgmap v16664: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 596 KiB/s rd, 279 KiB/s wr, 8 op/s 2023-05-08T12:23:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:24 smithi186 ceph-mon[126480]: pgmap v16665: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 596 KiB/s rd, 279 KiB/s wr, 8 op/s 2023-05-08T12:23:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31143.280366 secs 2023-05-08T12:23:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31143.835580 secs 2023-05-08T12:23:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:24 smithi133 ceph-mon[125939]: pgmap v16665: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 596 KiB/s rd, 279 KiB/s wr, 8 op/s 2023-05-08T12:23:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31143.280366 secs 2023-05-08T12:23:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31143.835580 secs 2023-05-08T12:23:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:24 smithi096 ceph-mon[124666]: pgmap v16665: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 596 KiB/s rd, 279 KiB/s wr, 8 op/s 2023-05-08T12:23:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31143.280366 secs 2023-05-08T12:23:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31143.835580 secs 2023-05-08T12:23:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:26 smithi186 ceph-mon[126480]: pgmap v16666: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 115 KiB/s wr, 7 op/s 2023-05-08T12:23:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31145.126161 secs 2023-05-08T12:23:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:26 smithi133 ceph-mon[125939]: pgmap v16666: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 115 KiB/s wr, 7 op/s 2023-05-08T12:23:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31145.126161 secs 2023-05-08T12:23:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:26 smithi096 ceph-mon[124666]: pgmap v16666: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 115 KiB/s wr, 7 op/s 2023-05-08T12:23:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31145.126161 secs 2023-05-08T12:23:28.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:28 smithi186 ceph-mon[126480]: pgmap v16667: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 103 KiB/s wr, 6 op/s 2023-05-08T12:23:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:28 smithi133 ceph-mon[125939]: pgmap v16667: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 103 KiB/s wr, 6 op/s 2023-05-08T12:23:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:28 smithi096 ceph-mon[124666]: pgmap v16667: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 103 KiB/s wr, 6 op/s 2023-05-08T12:23:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31148.280526 secs 2023-05-08T12:23:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31148.835703 secs 2023-05-08T12:23:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31148.280526 secs 2023-05-08T12:23:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31148.835703 secs 2023-05-08T12:23:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31148.280526 secs 2023-05-08T12:23:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31148.835703 secs 2023-05-08T12:23:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:30 smithi186 ceph-mon[126480]: pgmap v16668: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 96 KiB/s wr, 9 op/s 2023-05-08T12:23:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:30 smithi133 ceph-mon[125939]: pgmap v16668: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 96 KiB/s wr, 9 op/s 2023-05-08T12:23:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:30 smithi096 ceph-mon[124666]: pgmap v16668: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 96 KiB/s wr, 9 op/s 2023-05-08T12:23:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31150.126253 secs 2023-05-08T12:23:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31150.126253 secs 2023-05-08T12:23:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31150.126253 secs 2023-05-08T12:23:32.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:32 smithi186 ceph-mon[126480]: pgmap v16669: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T12:23:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:32 smithi133 ceph-mon[125939]: pgmap v16669: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T12:23:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:32 smithi096 ceph-mon[124666]: pgmap v16669: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T12:23:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:34 smithi186 ceph-mon[126480]: pgmap v16670: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T12:23:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31153.280597 secs 2023-05-08T12:23:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31153.835790 secs 2023-05-08T12:23:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:34 smithi133 ceph-mon[125939]: pgmap v16670: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T12:23:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31153.280597 secs 2023-05-08T12:23:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31153.835790 secs 2023-05-08T12:23:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:34 smithi096 ceph-mon[124666]: pgmap v16670: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T12:23:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31153.280597 secs 2023-05-08T12:23:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31153.835790 secs 2023-05-08T12:23:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:36 smithi186 ceph-mon[126480]: pgmap v16671: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T12:23:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31155.126375 secs 2023-05-08T12:23:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:36 smithi133 ceph-mon[125939]: pgmap v16671: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T12:23:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31155.126375 secs 2023-05-08T12:23:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:36 smithi096 ceph-mon[124666]: pgmap v16671: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2023-05-08T12:23:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31155.126375 secs 2023-05-08T12:23:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:38 smithi186 ceph-mon[126480]: pgmap v16672: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T12:23:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:38 smithi133 ceph-mon[125939]: pgmap v16672: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T12:23:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:38 smithi096 ceph-mon[124666]: pgmap v16672: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-05-08T12:23:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31158.280674 secs 2023-05-08T12:23:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31158.835890 secs 2023-05-08T12:23:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31158.280674 secs 2023-05-08T12:23:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31158.835890 secs 2023-05-08T12:23:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31158.280674 secs 2023-05-08T12:23:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31158.835890 secs 2023-05-08T12:23:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:40 smithi186 ceph-mon[126480]: pgmap v16673: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 170 B/s wr, 9 op/s 2023-05-08T12:23:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31160.126500 secs 2023-05-08T12:23:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:40 smithi133 ceph-mon[125939]: pgmap v16673: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 170 B/s wr, 9 op/s 2023-05-08T12:23:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31160.126500 secs 2023-05-08T12:23:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:40 smithi096 ceph-mon[124666]: pgmap v16673: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 170 B/s wr, 9 op/s 2023-05-08T12:23:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31160.126500 secs 2023-05-08T12:23:42.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:42 smithi133 ceph-mon[125939]: pgmap v16674: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 170 B/s wr, 6 op/s 2023-05-08T12:23:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:42 smithi096 ceph-mon[124666]: pgmap v16674: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 170 B/s wr, 6 op/s 2023-05-08T12:23:42.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:42 smithi186 ceph-mon[126480]: pgmap v16674: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 170 B/s wr, 6 op/s 2023-05-08T12:23:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:44 smithi133 ceph-mon[125939]: pgmap v16675: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 170 B/s wr, 6 op/s 2023-05-08T12:23:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31163.280794 secs 2023-05-08T12:23:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31163.836015 secs 2023-05-08T12:23:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:44 smithi096 ceph-mon[124666]: pgmap v16675: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 170 B/s wr, 6 op/s 2023-05-08T12:23:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31163.280794 secs 2023-05-08T12:23:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31163.836015 secs 2023-05-08T12:23:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:44 smithi186 ceph-mon[126480]: pgmap v16675: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 170 B/s wr, 6 op/s 2023-05-08T12:23:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31163.280794 secs 2023-05-08T12:23:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31163.836015 secs 2023-05-08T12:23:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:46 smithi133 ceph-mon[125939]: pgmap v16676: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 237 KiB/s wr, 10 op/s 2023-05-08T12:23:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:46 smithi096 ceph-mon[124666]: pgmap v16676: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 237 KiB/s wr, 10 op/s 2023-05-08T12:23:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:46 smithi186 ceph-mon[126480]: pgmap v16676: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 237 KiB/s wr, 10 op/s 2023-05-08T12:23:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:48 smithi133 ceph-mon[125939]: pgmap v16677: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 237 KiB/s wr, 7 op/s 2023-05-08T12:23:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:48 smithi096 ceph-mon[124666]: pgmap v16677: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 237 KiB/s wr, 7 op/s 2023-05-08T12:23:48.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:48 smithi186 ceph-mon[126480]: pgmap v16677: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 237 KiB/s wr, 7 op/s 2023-05-08T12:23:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:23:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31168.280910 secs 2023-05-08T12:23:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31168.836117 secs 2023-05-08T12:23:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:23:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31168.280910 secs 2023-05-08T12:23:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31168.836117 secs 2023-05-08T12:23:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:23:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31168.280910 secs 2023-05-08T12:23:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31168.836117 secs 2023-05-08T12:23:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:50 smithi133 ceph-mon[125939]: pgmap v16678: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 499 KiB/s wr, 11 op/s 2023-05-08T12:23:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:23:50.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:23:50.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:23:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:50 smithi096 ceph-mon[124666]: pgmap v16678: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 499 KiB/s wr, 11 op/s 2023-05-08T12:23:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:23:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:23:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:23:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:50 smithi186 ceph-mon[126480]: pgmap v16678: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 499 KiB/s wr, 11 op/s 2023-05-08T12:23:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:23:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:23:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:23:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:52 smithi133 ceph-mon[125939]: pgmap v16679: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 499 KiB/s wr, 8 op/s 2023-05-08T12:23:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:52 smithi096 ceph-mon[124666]: pgmap v16679: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 499 KiB/s wr, 8 op/s 2023-05-08T12:23:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:52 smithi186 ceph-mon[126480]: pgmap v16679: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 499 KiB/s wr, 8 op/s 2023-05-08T12:23:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:54 smithi133 ceph-mon[125939]: pgmap v16680: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 499 KiB/s wr, 8 op/s 2023-05-08T12:23:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31173.280989 secs 2023-05-08T12:23:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:54 smithi096 ceph-mon[124666]: pgmap v16680: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 499 KiB/s wr, 8 op/s 2023-05-08T12:23:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31173.280989 secs 2023-05-08T12:23:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:54 smithi186 ceph-mon[126480]: pgmap v16680: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 499 KiB/s wr, 8 op/s 2023-05-08T12:23:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31173.280989 secs 2023-05-08T12:23:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:56 smithi133 ceph-mon[125939]: pgmap v16681: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T12:23:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31175.126829 secs 2023-05-08T12:23:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:56 smithi096 ceph-mon[124666]: pgmap v16681: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T12:23:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31175.126829 secs 2023-05-08T12:23:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:56 smithi186 ceph-mon[126480]: pgmap v16681: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T12:23:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31175.126829 secs 2023-05-08T12:23:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:23:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:23:57.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:23:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:58 smithi133 ceph-mon[125939]: pgmap v16682: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 919 KiB/s wr, 10 op/s 2023-05-08T12:23:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:23:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:23:58.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:23:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:58 smithi096 ceph-mon[124666]: pgmap v16682: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 919 KiB/s wr, 10 op/s 2023-05-08T12:23:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:23:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:23:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:23:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:58 smithi186 ceph-mon[126480]: pgmap v16682: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 919 KiB/s wr, 10 op/s 2023-05-08T12:23:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:23:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:23:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:23:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:23:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31178.281119 secs 2023-05-08T12:23:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:23:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31178.281119 secs 2023-05-08T12:23:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:23:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31178.281119 secs 2023-05-08T12:24:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:00 smithi133 ceph-mon[125939]: pgmap v16683: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 16 op/s 2023-05-08T12:24:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:00 smithi096 ceph-mon[124666]: pgmap v16683: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 16 op/s 2023-05-08T12:24:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:00 smithi186 ceph-mon[126480]: pgmap v16683: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 16 op/s 2023-05-08T12:24:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31180.126982 secs 2023-05-08T12:24:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31180.126982 secs 2023-05-08T12:24:01.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31180.126982 secs 2023-05-08T12:24:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:02 smithi133 ceph-mon[125939]: pgmap v16684: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 850 KiB/s rd, 838 KiB/s wr, 11 op/s 2023-05-08T12:24:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:02 smithi096 ceph-mon[124666]: pgmap v16684: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 850 KiB/s rd, 838 KiB/s wr, 11 op/s 2023-05-08T12:24:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:02 smithi186 ceph-mon[126480]: pgmap v16684: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 850 KiB/s rd, 838 KiB/s wr, 11 op/s 2023-05-08T12:24:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:04 smithi133 ceph-mon[125939]: pgmap v16685: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 850 KiB/s rd, 838 KiB/s wr, 11 op/s 2023-05-08T12:24:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31183.281243 secs 2023-05-08T12:24:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31183.836517 secs 2023-05-08T12:24:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:04 smithi096 ceph-mon[124666]: pgmap v16685: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 850 KiB/s rd, 838 KiB/s wr, 11 op/s 2023-05-08T12:24:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31183.281243 secs 2023-05-08T12:24:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31183.836517 secs 2023-05-08T12:24:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:04 smithi186 ceph-mon[126480]: pgmap v16685: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 850 KiB/s rd, 838 KiB/s wr, 11 op/s 2023-05-08T12:24:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31183.281243 secs 2023-05-08T12:24:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31183.836517 secs 2023-05-08T12:24:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:05 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:24:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:24:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:24:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:05 smithi133 ceph-mon[125939]: osdmap e1120: 12 total, 12 up, 12 in 2023-05-08T12:24:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:05 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:24:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:24:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:24:05.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:05 smithi096 ceph-mon[124666]: osdmap e1120: 12 total, 12 up, 12 in 2023-05-08T12:24:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:05 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:24:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:24:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:24:05.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:05 smithi186 ceph-mon[126480]: osdmap e1120: 12 total, 12 up, 12 in 2023-05-08T12:24:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:06 smithi133 ceph-mon[125939]: pgmap v16686: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 31 op/s 2023-05-08T12:24:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31185.127138 secs 2023-05-08T12:24:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:06 smithi096 ceph-mon[124666]: pgmap v16686: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 31 op/s 2023-05-08T12:24:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31185.127138 secs 2023-05-08T12:24:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:06 smithi186 ceph-mon[126480]: pgmap v16686: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 31 op/s 2023-05-08T12:24:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31185.127138 secs 2023-05-08T12:24:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:08 smithi133 ceph-mon[125939]: pgmap v16688: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 735 KiB/s rd, 776 KiB/s wr, 31 op/s 2023-05-08T12:24:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:08 smithi096 ceph-mon[124666]: pgmap v16688: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 735 KiB/s rd, 776 KiB/s wr, 31 op/s 2023-05-08T12:24:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:08 smithi186 ceph-mon[126480]: pgmap v16688: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 735 KiB/s rd, 776 KiB/s wr, 31 op/s 2023-05-08T12:24:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31188.281360 secs 2023-05-08T12:24:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31188.836644 secs 2023-05-08T12:24:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31188.281360 secs 2023-05-08T12:24:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31188.836644 secs 2023-05-08T12:24:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31188.281360 secs 2023-05-08T12:24:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31188.836644 secs 2023-05-08T12:24:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:10 smithi096 ceph-mon[124666]: pgmap v16689: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 711 KiB/s rd, 752 KiB/s wr, 28 op/s 2023-05-08T12:24:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:10 smithi186 ceph-mon[126480]: pgmap v16689: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 711 KiB/s rd, 752 KiB/s wr, 28 op/s 2023-05-08T12:24:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:10 smithi133 ceph-mon[125939]: pgmap v16689: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 711 KiB/s rd, 752 KiB/s wr, 28 op/s 2023-05-08T12:24:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31190.127242 secs 2023-05-08T12:24:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31190.127242 secs 2023-05-08T12:24:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31190.127242 secs 2023-05-08T12:24:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:12 smithi096 ceph-mon[124666]: pgmap v16690: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 711 KiB/s rd, 752 KiB/s wr, 28 op/s 2023-05-08T12:24:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:12 smithi186 ceph-mon[126480]: pgmap v16690: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 711 KiB/s rd, 752 KiB/s wr, 28 op/s 2023-05-08T12:24:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:12 smithi133 ceph-mon[125939]: pgmap v16690: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 711 KiB/s rd, 752 KiB/s wr, 28 op/s 2023-05-08T12:24:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:14 smithi096 ceph-mon[124666]: pgmap v16691: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 711 KiB/s rd, 752 KiB/s wr, 28 op/s 2023-05-08T12:24:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31193.281474 secs 2023-05-08T12:24:14.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31193.836738 secs 2023-05-08T12:24:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:14 smithi186 ceph-mon[126480]: pgmap v16691: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 711 KiB/s rd, 752 KiB/s wr, 28 op/s 2023-05-08T12:24:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31193.281474 secs 2023-05-08T12:24:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31193.836738 secs 2023-05-08T12:24:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:14 smithi133 ceph-mon[125939]: pgmap v16691: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 711 KiB/s rd, 752 KiB/s wr, 28 op/s 2023-05-08T12:24:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31193.281474 secs 2023-05-08T12:24:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31193.836738 secs 2023-05-08T12:24:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:16 smithi186 ceph-mon[126480]: pgmap v16692: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 359 KiB/s rd, 356 KiB/s wr, 8 op/s 2023-05-08T12:24:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31195.127359 secs 2023-05-08T12:24:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:16 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:24:16.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:16 smithi186 ceph-mon[126480]: osdmap e1121: 12 total, 12 up, 12 in 2023-05-08T12:24:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:16 smithi133 ceph-mon[125939]: pgmap v16692: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 359 KiB/s rd, 356 KiB/s wr, 8 op/s 2023-05-08T12:24:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31195.127359 secs 2023-05-08T12:24:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:16 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:24:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:16 smithi133 ceph-mon[125939]: osdmap e1121: 12 total, 12 up, 12 in 2023-05-08T12:24:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:16 smithi096 ceph-mon[124666]: pgmap v16692: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 359 KiB/s rd, 356 KiB/s wr, 8 op/s 2023-05-08T12:24:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31195.127359 secs 2023-05-08T12:24:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:16 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:24:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:16 smithi096 ceph-mon[124666]: osdmap e1121: 12 total, 12 up, 12 in 2023-05-08T12:24:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:18 smithi186 ceph-mon[126480]: pgmap v16694: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 359 KiB/s rd, 356 KiB/s wr, 8 op/s 2023-05-08T12:24:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:18 smithi133 ceph-mon[125939]: pgmap v16694: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 359 KiB/s rd, 356 KiB/s wr, 8 op/s 2023-05-08T12:24:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:18 smithi096 ceph-mon[124666]: pgmap v16694: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 359 KiB/s rd, 356 KiB/s wr, 8 op/s 2023-05-08T12:24:19.640 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31198.281554 secs 2023-05-08T12:24:19.641 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:19 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:24:19.641 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:19 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:24:19.641 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:19 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:24:19.641 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:19 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:24:19.641 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:19 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:24:19.641 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:19 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:24:19.642 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31198.836808 secs 2023-05-08T12:24:19.642 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:19 smithi096 ceph-mon[124666]: pgmap v16695: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 164 KiB/s wr, 6 op/s 2023-05-08T12:24:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31198.281554 secs 2023-05-08T12:24:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:19 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:24:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:19 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:24:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:19 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:24:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:19 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:24:19.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:19 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:24:19.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:19 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:24:19.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31198.836808 secs 2023-05-08T12:24:19.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:19 smithi133 ceph-mon[125939]: pgmap v16695: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 164 KiB/s wr, 6 op/s 2023-05-08T12:24:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31198.281554 secs 2023-05-08T12:24:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:19 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:24:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:19 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:24:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:19 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:24:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:19 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:24:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:19 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:24:20.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:19 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:24:20.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31198.836808 secs 2023-05-08T12:24:20.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:19 smithi186 ceph-mon[126480]: pgmap v16695: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 164 KiB/s wr, 6 op/s 2023-05-08T12:24:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:20 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:24:21.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:20 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:24:21.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:20 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:24:21.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:20 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:24:21.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:20 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:24:21.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:20 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:24:21.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:20 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:24:21.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:20 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:24:21.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:20 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:24:21.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:20 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:24:21.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:20 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:24:21.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:20 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:24:21.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:20 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:24:21.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:20 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi186 to 136.8M 2023-05-08T12:24:21.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:20 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:24:21.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:20 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi186 to 143492599: error parsing value: Value '143492599' is below minimum 939524096 2023-05-08T12:24:21.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:20 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:24:21.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:20 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi133 to 146.5M 2023-05-08T12:24:21.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:20 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi133 to 153675944: error parsing value: Value '153675944' is below minimum 939524096 2023-05-08T12:24:21.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:20 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:24:21.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:20 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:24:21.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:20 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:24:21.009 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:20 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:24:21.009 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:20 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T12:24:21.009 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:20 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T12:24:21.009 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:20 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:24:21.009 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31200.127484 secs 2023-05-08T12:24:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:20 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:24:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:20 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:24:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:20 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:24:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:20 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:24:21.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:20 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:24:21.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:20 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:24:21.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:20 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:24:21.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:20 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:24:21.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:20 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:24:21.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:20 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:24:21.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:20 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:24:21.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:20 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:24:21.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:20 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:24:21.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:20 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi186 to 136.8M 2023-05-08T12:24:21.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:20 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:24:21.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:20 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi186 to 143492599: error parsing value: Value '143492599' is below minimum 939524096 2023-05-08T12:24:21.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:20 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:24:21.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:20 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi133 to 146.5M 2023-05-08T12:24:21.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:20 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi133 to 153675944: error parsing value: Value '153675944' is below minimum 939524096 2023-05-08T12:24:21.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:20 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:24:21.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:20 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:24:21.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:20 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:24:21.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:20 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:24:21.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:20 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T12:24:21.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:20 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T12:24:21.123 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:20 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:24:21.123 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31200.127484 secs 2023-05-08T12:24:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:20 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:24:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:20 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:24:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:20 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:24:21.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:20 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:24:21.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:20 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:24:21.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:20 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:24:21.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:20 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:24:21.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:20 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:24:21.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:20 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:24:21.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:20 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:24:21.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:20 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:24:21.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:20 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:24:21.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:20 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:24:21.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:20 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi186 to 136.8M 2023-05-08T12:24:21.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:20 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:24:21.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:20 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi186 to 143492599: error parsing value: Value '143492599' is below minimum 939524096 2023-05-08T12:24:21.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:20 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:24:21.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:20 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi133 to 146.5M 2023-05-08T12:24:21.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:20 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi133 to 153675944: error parsing value: Value '153675944' is below minimum 939524096 2023-05-08T12:24:21.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:20 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:24:21.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:20 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:24:21.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:20 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:24:21.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:20 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:24:21.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:20 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T12:24:21.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:20 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T12:24:21.244 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:20 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:24:21.244 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31200.127484 secs 2023-05-08T12:24:22.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:22 smithi133 ceph-mon[125939]: pgmap v16696: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 164 KiB/s wr, 6 op/s 2023-05-08T12:24:22.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:22 smithi096 ceph-mon[124666]: pgmap v16696: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 164 KiB/s wr, 6 op/s 2023-05-08T12:24:22.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:22 smithi186 ceph-mon[126480]: pgmap v16696: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 164 KiB/s wr, 6 op/s 2023-05-08T12:24:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:24 smithi133 ceph-mon[125939]: pgmap v16697: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 164 KiB/s wr, 6 op/s 2023-05-08T12:24:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31203.281671 secs 2023-05-08T12:24:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31203.836917 secs 2023-05-08T12:24:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:24 smithi096 ceph-mon[124666]: pgmap v16697: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 164 KiB/s wr, 6 op/s 2023-05-08T12:24:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31203.281671 secs 2023-05-08T12:24:24.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31203.836917 secs 2023-05-08T12:24:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:24 smithi186 ceph-mon[126480]: pgmap v16697: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 164 KiB/s wr, 6 op/s 2023-05-08T12:24:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31203.281671 secs 2023-05-08T12:24:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31203.836917 secs 2023-05-08T12:24:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:26 smithi133 ceph-mon[125939]: pgmap v16698: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T12:24:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31205.127596 secs 2023-05-08T12:24:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:26 smithi096 ceph-mon[124666]: pgmap v16698: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T12:24:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31205.127596 secs 2023-05-08T12:24:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:26 smithi186 ceph-mon[126480]: pgmap v16698: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-05-08T12:24:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31205.127596 secs 2023-05-08T12:24:28.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:28 smithi133 ceph-mon[125939]: pgmap v16699: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-05-08T12:24:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:28 smithi096 ceph-mon[124666]: pgmap v16699: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-05-08T12:24:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:28 smithi186 ceph-mon[126480]: pgmap v16699: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-05-08T12:24:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31208.281786 secs 2023-05-08T12:24:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31208.837048 secs 2023-05-08T12:24:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31208.281786 secs 2023-05-08T12:24:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31208.837048 secs 2023-05-08T12:24:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31208.281786 secs 2023-05-08T12:24:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31208.837048 secs 2023-05-08T12:24:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:30 smithi133 ceph-mon[125939]: pgmap v16700: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T12:24:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:30 smithi096 ceph-mon[124666]: pgmap v16700: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T12:24:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:30 smithi186 ceph-mon[126480]: pgmap v16700: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-05-08T12:24:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31210.127716 secs 2023-05-08T12:24:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31210.127716 secs 2023-05-08T12:24:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31210.127716 secs 2023-05-08T12:24:32.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:32 smithi133 ceph-mon[125939]: pgmap v16701: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T12:24:32.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:32 smithi096 ceph-mon[124666]: pgmap v16701: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T12:24:32.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:32 smithi186 ceph-mon[126480]: pgmap v16701: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T12:24:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:34 smithi133 ceph-mon[125939]: pgmap v16702: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T12:24:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31213.281886 secs 2023-05-08T12:24:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31213.837173 secs 2023-05-08T12:24:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:34 smithi096 ceph-mon[124666]: pgmap v16702: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T12:24:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31213.281886 secs 2023-05-08T12:24:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31213.837173 secs 2023-05-08T12:24:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:34 smithi186 ceph-mon[126480]: pgmap v16702: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-05-08T12:24:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31213.281886 secs 2023-05-08T12:24:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31213.837173 secs 2023-05-08T12:24:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:36 smithi133 ceph-mon[125939]: pgmap v16703: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 8 op/s 2023-05-08T12:24:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31215.127837 secs 2023-05-08T12:24:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:36 smithi096 ceph-mon[124666]: pgmap v16703: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 8 op/s 2023-05-08T12:24:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31215.127837 secs 2023-05-08T12:24:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:36 smithi186 ceph-mon[126480]: pgmap v16703: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 8 op/s 2023-05-08T12:24:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31215.127837 secs 2023-05-08T12:24:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:38 smithi133 ceph-mon[125939]: pgmap v16704: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T12:24:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:38 smithi096 ceph-mon[124666]: pgmap v16704: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T12:24:38.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:38 smithi186 ceph-mon[126480]: pgmap v16704: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T12:24:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31218.282000 secs 2023-05-08T12:24:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31218.837298 secs 2023-05-08T12:24:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31218.282000 secs 2023-05-08T12:24:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31218.837298 secs 2023-05-08T12:24:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31218.282000 secs 2023-05-08T12:24:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31218.837298 secs 2023-05-08T12:24:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:40 smithi133 ceph-mon[125939]: pgmap v16705: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 42 KiB/s wr, 9 op/s 2023-05-08T12:24:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:40 smithi096 ceph-mon[124666]: pgmap v16705: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 42 KiB/s wr, 9 op/s 2023-05-08T12:24:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:40 smithi186 ceph-mon[126480]: pgmap v16705: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 42 KiB/s wr, 9 op/s 2023-05-08T12:24:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31220.127948 secs 2023-05-08T12:24:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31220.127948 secs 2023-05-08T12:24:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31220.127948 secs 2023-05-08T12:24:42.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:42 smithi133 ceph-mon[125939]: pgmap v16706: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 42 KiB/s wr, 6 op/s 2023-05-08T12:24:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:42 smithi096 ceph-mon[124666]: pgmap v16706: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 42 KiB/s wr, 6 op/s 2023-05-08T12:24:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:42 smithi186 ceph-mon[126480]: pgmap v16706: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 42 KiB/s wr, 6 op/s 2023-05-08T12:24:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:44 smithi133 ceph-mon[125939]: pgmap v16707: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 42 KiB/s wr, 6 op/s 2023-05-08T12:24:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31223.282122 secs 2023-05-08T12:24:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31223.837425 secs 2023-05-08T12:24:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:44 smithi096 ceph-mon[124666]: pgmap v16707: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 42 KiB/s wr, 6 op/s 2023-05-08T12:24:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31223.282122 secs 2023-05-08T12:24:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31223.837425 secs 2023-05-08T12:24:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:44 smithi186 ceph-mon[126480]: pgmap v16707: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 42 KiB/s wr, 6 op/s 2023-05-08T12:24:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31223.282122 secs 2023-05-08T12:24:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31223.837425 secs 2023-05-08T12:24:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:46 smithi133 ceph-mon[125939]: pgmap v16708: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 587 KiB/s rd, 378 KiB/s wr, 10 op/s 2023-05-08T12:24:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:46 smithi096 ceph-mon[124666]: pgmap v16708: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 587 KiB/s rd, 378 KiB/s wr, 10 op/s 2023-05-08T12:24:46.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:46 smithi186 ceph-mon[126480]: pgmap v16708: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 587 KiB/s rd, 378 KiB/s wr, 10 op/s 2023-05-08T12:24:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:48 smithi133 ceph-mon[125939]: pgmap v16709: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 586 KiB/s rd, 378 KiB/s wr, 7 op/s 2023-05-08T12:24:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:24:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:48 smithi096 ceph-mon[124666]: pgmap v16709: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 586 KiB/s rd, 378 KiB/s wr, 7 op/s 2023-05-08T12:24:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:24:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:48 smithi186 ceph-mon[126480]: pgmap v16709: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 586 KiB/s rd, 378 KiB/s wr, 7 op/s 2023-05-08T12:24:48.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:24:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:24:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:24:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:24:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31228.282236 secs 2023-05-08T12:24:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:24:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:24:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:24:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31228.282236 secs 2023-05-08T12:24:49.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:24:49.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:24:49.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:24:49.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31228.282236 secs 2023-05-08T12:24:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:50 smithi133 ceph-mon[125939]: pgmap v16710: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 623 KiB/s rd, 405 KiB/s wr, 12 op/s 2023-05-08T12:24:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:50 smithi096 ceph-mon[124666]: pgmap v16710: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 623 KiB/s rd, 405 KiB/s wr, 12 op/s 2023-05-08T12:24:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:50 smithi186 ceph-mon[126480]: pgmap v16710: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 623 KiB/s rd, 405 KiB/s wr, 12 op/s 2023-05-08T12:24:52.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:52 smithi096 ceph-mon[124666]: pgmap v16711: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 705 KiB/s wr, 9 op/s 2023-05-08T12:24:52.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:52 smithi186 ceph-mon[126480]: pgmap v16711: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 705 KiB/s wr, 9 op/s 2023-05-08T12:24:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:52 smithi133 ceph-mon[125939]: pgmap v16711: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 705 KiB/s wr, 9 op/s 2023-05-08T12:24:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:53 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:24:53.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:53 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:24:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:53 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:24:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:54 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:24:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:54 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:24:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:54 smithi186 ceph-mon[126480]: pgmap v16712: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 705 KiB/s wr, 9 op/s 2023-05-08T12:24:54.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31233.282364 secs 2023-05-08T12:24:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:54 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:24:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:54 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:24:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:54 smithi133 ceph-mon[125939]: pgmap v16712: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 705 KiB/s wr, 9 op/s 2023-05-08T12:24:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31233.282364 secs 2023-05-08T12:24:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:54 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:24:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:54 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:24:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:54 smithi096 ceph-mon[124666]: pgmap v16712: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 705 KiB/s wr, 9 op/s 2023-05-08T12:24:54.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31233.282364 secs 2023-05-08T12:24:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:56 smithi133 ceph-mon[125939]: pgmap v16713: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 832 KiB/s rd, 1.0 MiB/s wr, 14 op/s 2023-05-08T12:24:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31235.128245 secs 2023-05-08T12:24:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:56 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:24:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:56 smithi096 ceph-mon[124666]: pgmap v16713: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 832 KiB/s rd, 1.0 MiB/s wr, 14 op/s 2023-05-08T12:24:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31235.128245 secs 2023-05-08T12:24:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:56 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:24:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:56 smithi186 ceph-mon[126480]: pgmap v16713: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 832 KiB/s rd, 1.0 MiB/s wr, 14 op/s 2023-05-08T12:24:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31235.128245 secs 2023-05-08T12:24:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:56 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:24:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:24:58.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:24:58.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:58 smithi096 ceph-mon[124666]: pgmap v16714: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 753 KiB/s rd, 724 KiB/s wr, 10 op/s 2023-05-08T12:24:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:24:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:24:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:58 smithi186 ceph-mon[126480]: pgmap v16714: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 753 KiB/s rd, 724 KiB/s wr, 10 op/s 2023-05-08T12:24:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:24:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:24:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:58 smithi133 ceph-mon[125939]: pgmap v16714: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 753 KiB/s rd, 724 KiB/s wr, 10 op/s 2023-05-08T12:24:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:24:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31238.282500 secs 2023-05-08T12:24:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:24:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31238.282500 secs 2023-05-08T12:24:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:24:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31238.282500 secs 2023-05-08T12:25:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:00 smithi096 ceph-mon[124666]: pgmap v16715: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1007 KiB/s wr, 16 op/s 2023-05-08T12:25:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:00 smithi186 ceph-mon[126480]: pgmap v16715: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1007 KiB/s wr, 16 op/s 2023-05-08T12:25:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:00 smithi133 ceph-mon[125939]: pgmap v16715: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1007 KiB/s wr, 16 op/s 2023-05-08T12:25:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31240.128383 secs 2023-05-08T12:25:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:01 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:25:01.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31240.128383 secs 2023-05-08T12:25:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:01 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:25:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31240.128383 secs 2023-05-08T12:25:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:01 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:25:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:02 smithi096 ceph-mon[124666]: pgmap v16716: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 999 KiB/s rd, 980 KiB/s wr, 12 op/s 2023-05-08T12:25:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:02 smithi186 ceph-mon[126480]: pgmap v16716: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 999 KiB/s rd, 980 KiB/s wr, 12 op/s 2023-05-08T12:25:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:02 smithi133 ceph-mon[125939]: pgmap v16716: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 999 KiB/s rd, 980 KiB/s wr, 12 op/s 2023-05-08T12:25:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:04 smithi133 ceph-mon[125939]: pgmap v16717: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 999 KiB/s rd, 639 KiB/s wr, 12 op/s 2023-05-08T12:25:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31243.282567 secs 2023-05-08T12:25:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31243.837924 secs 2023-05-08T12:25:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:04 smithi096 ceph-mon[124666]: pgmap v16717: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 999 KiB/s rd, 639 KiB/s wr, 12 op/s 2023-05-08T12:25:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31243.282567 secs 2023-05-08T12:25:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31243.837924 secs 2023-05-08T12:25:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:04 smithi186 ceph-mon[126480]: pgmap v16717: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 999 KiB/s rd, 639 KiB/s wr, 12 op/s 2023-05-08T12:25:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31243.282567 secs 2023-05-08T12:25:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31243.837924 secs 2023-05-08T12:25:06.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:06 smithi133 ceph-mon[125939]: pgmap v16718: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 32 op/s 2023-05-08T12:25:06.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31245.128503 secs 2023-05-08T12:25:06.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:25:06.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:25:06.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:06 smithi133 ceph-mon[125939]: osdmap e1122: 12 total, 12 up, 12 in 2023-05-08T12:25:06.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:06 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:25:06.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:06 smithi096 ceph-mon[124666]: pgmap v16718: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 32 op/s 2023-05-08T12:25:06.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31245.128503 secs 2023-05-08T12:25:06.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:25:06.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:25:06.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:06 smithi096 ceph-mon[124666]: osdmap e1122: 12 total, 12 up, 12 in 2023-05-08T12:25:06.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:06 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:25:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:06 smithi186 ceph-mon[126480]: pgmap v16718: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 32 op/s 2023-05-08T12:25:06.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31245.128503 secs 2023-05-08T12:25:06.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:25:06.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:25:06.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:06 smithi186 ceph-mon[126480]: osdmap e1122: 12 total, 12 up, 12 in 2023-05-08T12:25:06.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:06 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:25:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:08 smithi133 ceph-mon[125939]: pgmap v16720: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 859 KiB/s rd, 901 KiB/s wr, 31 op/s 2023-05-08T12:25:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:08 smithi096 ceph-mon[124666]: pgmap v16720: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 859 KiB/s rd, 901 KiB/s wr, 31 op/s 2023-05-08T12:25:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:08 smithi186 ceph-mon[126480]: pgmap v16720: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 859 KiB/s rd, 901 KiB/s wr, 31 op/s 2023-05-08T12:25:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31248.282707 secs 2023-05-08T12:25:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31248.838049 secs 2023-05-08T12:25:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31248.282707 secs 2023-05-08T12:25:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31248.838049 secs 2023-05-08T12:25:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31248.282707 secs 2023-05-08T12:25:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31248.838049 secs 2023-05-08T12:25:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:10 smithi133 ceph-mon[125939]: pgmap v16721: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 521 KiB/s rd, 562 KiB/s wr, 28 op/s 2023-05-08T12:25:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:10 smithi096 ceph-mon[124666]: pgmap v16721: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 521 KiB/s rd, 562 KiB/s wr, 28 op/s 2023-05-08T12:25:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:10 smithi186 ceph-mon[126480]: pgmap v16721: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 521 KiB/s rd, 562 KiB/s wr, 28 op/s 2023-05-08T12:25:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31250.128583 secs 2023-05-08T12:25:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:11 smithi133 ceph-mon[125939]: osdmap e1123: 12 total, 12 up, 12 in 2023-05-08T12:25:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31250.128583 secs 2023-05-08T12:25:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:11 smithi096 ceph-mon[124666]: osdmap e1123: 12 total, 12 up, 12 in 2023-05-08T12:25:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31250.128583 secs 2023-05-08T12:25:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:11 smithi186 ceph-mon[126480]: osdmap e1123: 12 total, 12 up, 12 in 2023-05-08T12:25:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:12 smithi133 ceph-mon[125939]: pgmap v16723: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 703 KiB/s wr, 35 op/s 2023-05-08T12:25:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:12 smithi096 ceph-mon[124666]: pgmap v16723: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 703 KiB/s wr, 35 op/s 2023-05-08T12:25:12.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:12 smithi186 ceph-mon[126480]: pgmap v16723: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 703 KiB/s wr, 35 op/s 2023-05-08T12:25:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:14 smithi133 ceph-mon[125939]: pgmap v16724: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 767 B/s wr, 5 op/s 2023-05-08T12:25:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31253.282825 secs 2023-05-08T12:25:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31253.838166 secs 2023-05-08T12:25:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:14 smithi096 ceph-mon[124666]: pgmap v16724: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 767 B/s wr, 5 op/s 2023-05-08T12:25:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31253.282825 secs 2023-05-08T12:25:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31253.838166 secs 2023-05-08T12:25:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:14 smithi186 ceph-mon[126480]: pgmap v16724: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 767 B/s wr, 5 op/s 2023-05-08T12:25:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31253.282825 secs 2023-05-08T12:25:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31253.838166 secs 2023-05-08T12:25:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:16 smithi133 ceph-mon[125939]: pgmap v16725: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 310 KiB/s wr, 8 op/s 2023-05-08T12:25:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31255.128707 secs 2023-05-08T12:25:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:16 smithi096 ceph-mon[124666]: pgmap v16725: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 310 KiB/s wr, 8 op/s 2023-05-08T12:25:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31255.128707 secs 2023-05-08T12:25:16.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:16 smithi186 ceph-mon[126480]: pgmap v16725: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 310 KiB/s wr, 8 op/s 2023-05-08T12:25:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31255.128707 secs 2023-05-08T12:25:18.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:18 smithi133 ceph-mon[125939]: pgmap v16726: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 311 KiB/s rd, 308 KiB/s wr, 8 op/s 2023-05-08T12:25:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:18 smithi096 ceph-mon[124666]: pgmap v16726: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 311 KiB/s rd, 308 KiB/s wr, 8 op/s 2023-05-08T12:25:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:18 smithi186 ceph-mon[126480]: pgmap v16726: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 311 KiB/s rd, 308 KiB/s wr, 8 op/s 2023-05-08T12:25:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31258.282939 secs 2023-05-08T12:25:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31258.838304 secs 2023-05-08T12:25:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31258.282939 secs 2023-05-08T12:25:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31258.838304 secs 2023-05-08T12:25:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31258.282939 secs 2023-05-08T12:25:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31258.838304 secs 2023-05-08T12:25:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:20 smithi133 ceph-mon[125939]: pgmap v16727: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 311 KiB/s rd, 308 KiB/s wr, 7 op/s 2023-05-08T12:25:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:20 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:25:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:20 smithi096 ceph-mon[124666]: pgmap v16727: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 311 KiB/s rd, 308 KiB/s wr, 7 op/s 2023-05-08T12:25:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:20 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:25:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:20 smithi186 ceph-mon[126480]: pgmap v16727: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 311 KiB/s rd, 308 KiB/s wr, 7 op/s 2023-05-08T12:25:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:20 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:25:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31260.128805 secs 2023-05-08T12:25:21.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:25:21.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:25:21.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:21 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:25:21.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:25:21.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:21 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T12:25:21.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:21 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T12:25:21.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:21 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:25:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31260.128805 secs 2023-05-08T12:25:21.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:25:21.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:25:21.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:21 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:25:21.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:25:21.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:21 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T12:25:21.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:21 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T12:25:21.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:21 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:25:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31260.128805 secs 2023-05-08T12:25:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:25:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:25:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:21 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:25:21.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:25:21.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:21 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T12:25:21.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:21 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T12:25:21.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:21 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:25:22.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:22 smithi133 ceph-mon[125939]: pgmap v16728: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 304 KiB/s wr, 7 op/s 2023-05-08T12:25:22.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:22 smithi096 ceph-mon[124666]: pgmap v16728: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 304 KiB/s wr, 7 op/s 2023-05-08T12:25:22.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:22 smithi186 ceph-mon[126480]: pgmap v16728: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 304 KiB/s wr, 7 op/s 2023-05-08T12:25:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:24 smithi133 ceph-mon[125939]: pgmap v16729: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 256 KiB/s wr, 6 op/s 2023-05-08T12:25:24.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31263.283059 secs 2023-05-08T12:25:24.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31263.838458 secs 2023-05-08T12:25:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:24 smithi096 ceph-mon[124666]: pgmap v16729: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 256 KiB/s wr, 6 op/s 2023-05-08T12:25:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31263.283059 secs 2023-05-08T12:25:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31263.838458 secs 2023-05-08T12:25:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:24 smithi186 ceph-mon[126480]: pgmap v16729: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 256 KiB/s wr, 6 op/s 2023-05-08T12:25:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31263.283059 secs 2023-05-08T12:25:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31263.838458 secs 2023-05-08T12:25:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:26 smithi133 ceph-mon[125939]: pgmap v16730: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 352 KiB/s wr, 8 op/s 2023-05-08T12:25:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31265.128924 secs 2023-05-08T12:25:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:26 smithi096 ceph-mon[124666]: pgmap v16730: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 352 KiB/s wr, 8 op/s 2023-05-08T12:25:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31265.128924 secs 2023-05-08T12:25:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:26 smithi186 ceph-mon[126480]: pgmap v16730: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 352 KiB/s wr, 8 op/s 2023-05-08T12:25:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31265.128924 secs 2023-05-08T12:25:28.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:28 smithi133 ceph-mon[125939]: pgmap v16731: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 96 KiB/s wr, 5 op/s 2023-05-08T12:25:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:28 smithi096 ceph-mon[124666]: pgmap v16731: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 96 KiB/s wr, 5 op/s 2023-05-08T12:25:28.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:28 smithi186 ceph-mon[126480]: pgmap v16731: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 96 KiB/s wr, 5 op/s 2023-05-08T12:25:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31268.283194 secs 2023-05-08T12:25:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31268.838574 secs 2023-05-08T12:25:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31268.283194 secs 2023-05-08T12:25:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31268.838574 secs 2023-05-08T12:25:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31268.283194 secs 2023-05-08T12:25:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31268.838574 secs 2023-05-08T12:25:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:30 smithi096 ceph-mon[124666]: pgmap v16732: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 96 KiB/s wr, 7 op/s 2023-05-08T12:25:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:30 smithi186 ceph-mon[126480]: pgmap v16732: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 96 KiB/s wr, 7 op/s 2023-05-08T12:25:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:30 smithi133 ceph-mon[125939]: pgmap v16732: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 96 KiB/s wr, 7 op/s 2023-05-08T12:25:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31270.129034 secs 2023-05-08T12:25:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31270.129034 secs 2023-05-08T12:25:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31270.129034 secs 2023-05-08T12:25:32.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:32 smithi096 ceph-mon[124666]: pgmap v16733: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 96 KiB/s wr, 5 op/s 2023-05-08T12:25:32.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:32 smithi186 ceph-mon[126480]: pgmap v16733: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 96 KiB/s wr, 5 op/s 2023-05-08T12:25:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:32 smithi133 ceph-mon[125939]: pgmap v16733: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 96 KiB/s wr, 5 op/s 2023-05-08T12:25:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:34 smithi096 ceph-mon[124666]: pgmap v16734: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 96 KiB/s wr, 5 op/s 2023-05-08T12:25:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31273.283329 secs 2023-05-08T12:25:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31273.838658 secs 2023-05-08T12:25:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:34 smithi186 ceph-mon[126480]: pgmap v16734: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 96 KiB/s wr, 5 op/s 2023-05-08T12:25:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31273.283329 secs 2023-05-08T12:25:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31273.838658 secs 2023-05-08T12:25:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:34 smithi133 ceph-mon[125939]: pgmap v16734: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 96 KiB/s wr, 5 op/s 2023-05-08T12:25:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31273.283329 secs 2023-05-08T12:25:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31273.838658 secs 2023-05-08T12:25:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:36 smithi096 ceph-mon[124666]: pgmap v16735: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 96 KiB/s wr, 8 op/s 2023-05-08T12:25:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31275.129136 secs 2023-05-08T12:25:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:36 smithi186 ceph-mon[126480]: pgmap v16735: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 96 KiB/s wr, 8 op/s 2023-05-08T12:25:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31275.129136 secs 2023-05-08T12:25:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:36 smithi133 ceph-mon[125939]: pgmap v16735: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 96 KiB/s wr, 8 op/s 2023-05-08T12:25:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31275.129136 secs 2023-05-08T12:25:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:38 smithi186 ceph-mon[126480]: pgmap v16736: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T12:25:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:38 smithi133 ceph-mon[125939]: pgmap v16736: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T12:25:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:38 smithi096 ceph-mon[124666]: pgmap v16736: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-05-08T12:25:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31278.283443 secs 2023-05-08T12:25:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31278.838772 secs 2023-05-08T12:25:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31278.283443 secs 2023-05-08T12:25:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31278.838772 secs 2023-05-08T12:25:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31278.283443 secs 2023-05-08T12:25:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31278.838772 secs 2023-05-08T12:25:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:40 smithi186 ceph-mon[126480]: pgmap v16737: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 938 B/s wr, 8 op/s 2023-05-08T12:25:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:40 smithi133 ceph-mon[125939]: pgmap v16737: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 938 B/s wr, 8 op/s 2023-05-08T12:25:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:40 smithi096 ceph-mon[124666]: pgmap v16737: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 938 B/s wr, 8 op/s 2023-05-08T12:25:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31280.129258 secs 2023-05-08T12:25:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31280.129258 secs 2023-05-08T12:25:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31280.129258 secs 2023-05-08T12:25:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:42 smithi186 ceph-mon[126480]: pgmap v16738: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T12:25:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:42 smithi133 ceph-mon[125939]: pgmap v16738: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T12:25:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:42 smithi096 ceph-mon[124666]: pgmap v16738: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T12:25:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:44 smithi186 ceph-mon[126480]: pgmap v16739: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T12:25:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31283.283530 secs 2023-05-08T12:25:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31283.838863 secs 2023-05-08T12:25:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:44 smithi133 ceph-mon[125939]: pgmap v16739: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T12:25:44.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31283.283530 secs 2023-05-08T12:25:44.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31283.838863 secs 2023-05-08T12:25:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:44 smithi096 ceph-mon[124666]: pgmap v16739: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T12:25:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31283.283530 secs 2023-05-08T12:25:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31283.838863 secs 2023-05-08T12:25:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:46 smithi186 ceph-mon[126480]: pgmap v16740: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 263 KiB/s wr, 10 op/s 2023-05-08T12:25:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:46 smithi133 ceph-mon[125939]: pgmap v16740: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 263 KiB/s wr, 10 op/s 2023-05-08T12:25:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:46 smithi096 ceph-mon[124666]: pgmap v16740: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 263 KiB/s wr, 10 op/s 2023-05-08T12:25:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:48 smithi186 ceph-mon[126480]: pgmap v16741: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 263 KiB/s wr, 7 op/s 2023-05-08T12:25:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:25:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:48 smithi133 ceph-mon[125939]: pgmap v16741: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 263 KiB/s wr, 7 op/s 2023-05-08T12:25:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:25:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:48 smithi096 ceph-mon[124666]: pgmap v16741: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 263 KiB/s wr, 7 op/s 2023-05-08T12:25:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:25:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:25:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:25:49.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:25:49.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31288.283614 secs 2023-05-08T12:25:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:25:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:25:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:25:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31288.283614 secs 2023-05-08T12:25:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:25:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:25:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:25:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31288.283614 secs 2023-05-08T12:25:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:50 smithi186 ceph-mon[126480]: pgmap v16742: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 780 KiB/s rd, 400 KiB/s wr, 11 op/s 2023-05-08T12:25:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:50 smithi133 ceph-mon[125939]: pgmap v16742: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 780 KiB/s rd, 400 KiB/s wr, 11 op/s 2023-05-08T12:25:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:50 smithi096 ceph-mon[124666]: pgmap v16742: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 780 KiB/s rd, 400 KiB/s wr, 11 op/s 2023-05-08T12:25:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:52 smithi186 ceph-mon[126480]: pgmap v16743: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 778 KiB/s rd, 399 KiB/s wr, 8 op/s 2023-05-08T12:25:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:52 smithi133 ceph-mon[125939]: pgmap v16743: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 778 KiB/s rd, 399 KiB/s wr, 8 op/s 2023-05-08T12:25:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:52 smithi096 ceph-mon[124666]: pgmap v16743: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 778 KiB/s rd, 399 KiB/s wr, 8 op/s 2023-05-08T12:25:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:53 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:25:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:53 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:25:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:53 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:25:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:54 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:25:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:54 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:25:54.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:54 smithi186 ceph-mon[126480]: pgmap v16744: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 778 KiB/s rd, 399 KiB/s wr, 8 op/s 2023-05-08T12:25:54.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31293.283735 secs 2023-05-08T12:25:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:54 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:25:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:54 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:25:54.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:54 smithi133 ceph-mon[125939]: pgmap v16744: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 778 KiB/s rd, 399 KiB/s wr, 8 op/s 2023-05-08T12:25:54.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31293.283735 secs 2023-05-08T12:25:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:54 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:25:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:54 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:25:54.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:54 smithi096 ceph-mon[124666]: pgmap v16744: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 778 KiB/s rd, 399 KiB/s wr, 8 op/s 2023-05-08T12:25:54.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31293.283735 secs 2023-05-08T12:25:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:56 smithi133 ceph-mon[125939]: pgmap v16745: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 992 KiB/s wr, 14 op/s 2023-05-08T12:25:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31295.129653 secs 2023-05-08T12:25:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:56 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:25:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:56 smithi096 ceph-mon[124666]: pgmap v16745: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 992 KiB/s wr, 14 op/s 2023-05-08T12:25:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31295.129653 secs 2023-05-08T12:25:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:56 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:25:56.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:56 smithi186 ceph-mon[126480]: pgmap v16745: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 992 KiB/s wr, 14 op/s 2023-05-08T12:25:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31295.129653 secs 2023-05-08T12:25:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:56 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:25:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:25:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:25:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:58 smithi186 ceph-mon[126480]: pgmap v16746: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 730 KiB/s wr, 10 op/s 2023-05-08T12:25:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:25:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:25:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:58 smithi133 ceph-mon[125939]: pgmap v16746: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 730 KiB/s wr, 10 op/s 2023-05-08T12:25:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:25:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:25:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:58 smithi096 ceph-mon[124666]: pgmap v16746: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 730 KiB/s wr, 10 op/s 2023-05-08T12:25:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:25:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31298.283823 secs 2023-05-08T12:25:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:25:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31298.283823 secs 2023-05-08T12:25:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:25:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31298.283823 secs 2023-05-08T12:26:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:00 smithi186 ceph-mon[126480]: pgmap v16747: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1015 KiB/s wr, 16 op/s 2023-05-08T12:26:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:00 smithi133 ceph-mon[125939]: pgmap v16747: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1015 KiB/s wr, 16 op/s 2023-05-08T12:26:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:00 smithi096 ceph-mon[124666]: pgmap v16747: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1015 KiB/s wr, 16 op/s 2023-05-08T12:26:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31300.129802 secs 2023-05-08T12:26:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:01 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:26:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31300.129802 secs 2023-05-08T12:26:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:01 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:26:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31300.129802 secs 2023-05-08T12:26:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:01 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:26:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:02 smithi186 ceph-mon[126480]: pgmap v16748: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 878 KiB/s wr, 12 op/s 2023-05-08T12:26:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:02 smithi133 ceph-mon[125939]: pgmap v16748: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 878 KiB/s wr, 12 op/s 2023-05-08T12:26:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:02 smithi096 ceph-mon[124666]: pgmap v16748: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 878 KiB/s wr, 12 op/s 2023-05-08T12:26:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:04 smithi133 ceph-mon[125939]: pgmap v16749: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 878 KiB/s wr, 12 op/s 2023-05-08T12:26:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31303.283941 secs 2023-05-08T12:26:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31303.839360 secs 2023-05-08T12:26:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:04 smithi096 ceph-mon[124666]: pgmap v16749: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 878 KiB/s wr, 12 op/s 2023-05-08T12:26:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31303.283941 secs 2023-05-08T12:26:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31303.839360 secs 2023-05-08T12:26:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:04 smithi186 ceph-mon[126480]: pgmap v16749: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 878 KiB/s wr, 12 op/s 2023-05-08T12:26:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31303.283941 secs 2023-05-08T12:26:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31303.839360 secs 2023-05-08T12:26:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31305.129919 secs 2023-05-08T12:26:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:06 smithi133 ceph-mon[125939]: pgmap v16750: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 32 op/s 2023-05-08T12:26:06.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:26:06.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:26:06.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:06 smithi133 ceph-mon[125939]: osdmap e1124: 12 total, 12 up, 12 in 2023-05-08T12:26:06.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:06 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:26:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31305.129919 secs 2023-05-08T12:26:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:06 smithi096 ceph-mon[124666]: pgmap v16750: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 32 op/s 2023-05-08T12:26:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:26:06.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:26:06.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:06 smithi096 ceph-mon[124666]: osdmap e1124: 12 total, 12 up, 12 in 2023-05-08T12:26:06.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:06 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:26:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31305.129919 secs 2023-05-08T12:26:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:06 smithi186 ceph-mon[126480]: pgmap v16750: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 32 op/s 2023-05-08T12:26:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:26:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:26:06.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:06 smithi186 ceph-mon[126480]: osdmap e1124: 12 total, 12 up, 12 in 2023-05-08T12:26:06.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:06 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:26:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:08 smithi133 ceph-mon[125939]: pgmap v16752: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 868 KiB/s rd, 905 KiB/s wr, 30 op/s 2023-05-08T12:26:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:08 smithi096 ceph-mon[124666]: pgmap v16752: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 868 KiB/s rd, 905 KiB/s wr, 30 op/s 2023-05-08T12:26:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:08 smithi186 ceph-mon[126480]: pgmap v16752: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 868 KiB/s rd, 905 KiB/s wr, 30 op/s 2023-05-08T12:26:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31308.284055 secs 2023-05-08T12:26:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31308.839509 secs 2023-05-08T12:26:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31308.284055 secs 2023-05-08T12:26:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31308.839509 secs 2023-05-08T12:26:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31308.284055 secs 2023-05-08T12:26:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31308.839509 secs 2023-05-08T12:26:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:10 smithi133 ceph-mon[125939]: pgmap v16753: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 563 KiB/s wr, 27 op/s 2023-05-08T12:26:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:10 smithi096 ceph-mon[124666]: pgmap v16753: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 563 KiB/s wr, 27 op/s 2023-05-08T12:26:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:10 smithi186 ceph-mon[126480]: pgmap v16753: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 563 KiB/s wr, 27 op/s 2023-05-08T12:26:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31310.130014 secs 2023-05-08T12:26:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31310.130014 secs 2023-05-08T12:26:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31310.130014 secs 2023-05-08T12:26:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:12 smithi133 ceph-mon[125939]: pgmap v16754: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 563 KiB/s wr, 27 op/s 2023-05-08T12:26:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:12 smithi096 ceph-mon[124666]: pgmap v16754: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 563 KiB/s wr, 27 op/s 2023-05-08T12:26:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:12 smithi186 ceph-mon[126480]: pgmap v16754: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 563 KiB/s wr, 27 op/s 2023-05-08T12:26:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:14 smithi133 ceph-mon[125939]: pgmap v16755: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 563 KiB/s wr, 27 op/s 2023-05-08T12:26:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31313.284194 secs 2023-05-08T12:26:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31313.839576 secs 2023-05-08T12:26:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:14 smithi096 ceph-mon[124666]: pgmap v16755: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 563 KiB/s wr, 27 op/s 2023-05-08T12:26:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31313.284194 secs 2023-05-08T12:26:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31313.839576 secs 2023-05-08T12:26:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:14 smithi186 ceph-mon[126480]: pgmap v16755: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 563 KiB/s wr, 27 op/s 2023-05-08T12:26:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31313.284194 secs 2023-05-08T12:26:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31313.839576 secs 2023-05-08T12:26:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31315.130132 secs 2023-05-08T12:26:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:16 smithi133 ceph-mon[125939]: pgmap v16756: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 165 KiB/s wr, 7 op/s 2023-05-08T12:26:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:16 smithi133 ceph-mon[125939]: osdmap e1125: 12 total, 12 up, 12 in 2023-05-08T12:26:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31315.130132 secs 2023-05-08T12:26:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:16 smithi096 ceph-mon[124666]: pgmap v16756: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 165 KiB/s wr, 7 op/s 2023-05-08T12:26:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:16 smithi096 ceph-mon[124666]: osdmap e1125: 12 total, 12 up, 12 in 2023-05-08T12:26:16.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31315.130132 secs 2023-05-08T12:26:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:16 smithi186 ceph-mon[126480]: pgmap v16756: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 165 KiB/s wr, 7 op/s 2023-05-08T12:26:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:16 smithi186 ceph-mon[126480]: osdmap e1125: 12 total, 12 up, 12 in 2023-05-08T12:26:18.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:18 smithi133 ceph-mon[125939]: pgmap v16758: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 165 KiB/s wr, 7 op/s 2023-05-08T12:26:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:18 smithi096 ceph-mon[124666]: pgmap v16758: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 165 KiB/s wr, 7 op/s 2023-05-08T12:26:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:18 smithi186 ceph-mon[126480]: pgmap v16758: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 165 KiB/s wr, 7 op/s 2023-05-08T12:26:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31318.284285 secs 2023-05-08T12:26:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31318.839707 secs 2023-05-08T12:26:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31318.284285 secs 2023-05-08T12:26:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31318.839707 secs 2023-05-08T12:26:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31318.284285 secs 2023-05-08T12:26:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31318.839707 secs 2023-05-08T12:26:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:20 smithi133 ceph-mon[125939]: pgmap v16759: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 164 KiB/s wr, 6 op/s 2023-05-08T12:26:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:20 smithi096 ceph-mon[124666]: pgmap v16759: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 164 KiB/s wr, 6 op/s 2023-05-08T12:26:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:20 smithi186 ceph-mon[126480]: pgmap v16759: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 164 KiB/s wr, 6 op/s 2023-05-08T12:26:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31320.130256 secs 2023-05-08T12:26:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:26:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:26:21.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:26:21.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:26:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31320.130256 secs 2023-05-08T12:26:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:26:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:26:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:26:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:26:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31320.130256 secs 2023-05-08T12:26:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:26:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:26:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:26:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:26:22.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:22 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:26:22.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:22 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T12:26:22.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:22 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T12:26:22.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:22 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:26:22.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:22 smithi096 ceph-mon[124666]: pgmap v16760: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 164 KiB/s wr, 6 op/s 2023-05-08T12:26:22.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:22 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:26:22.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:22 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T12:26:22.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:22 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T12:26:22.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:22 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:26:22.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:22 smithi186 ceph-mon[126480]: pgmap v16760: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 164 KiB/s wr, 6 op/s 2023-05-08T12:26:22.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:22 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:26:22.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:22 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T12:26:22.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:22 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T12:26:22.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:22 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:26:22.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:22 smithi133 ceph-mon[125939]: pgmap v16760: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 164 KiB/s wr, 6 op/s 2023-05-08T12:26:24.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:24 smithi096 ceph-mon[124666]: pgmap v16761: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 164 KiB/s wr, 6 op/s 2023-05-08T12:26:24.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31323.284408 secs 2023-05-08T12:26:24.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31323.839837 secs 2023-05-08T12:26:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:24 smithi186 ceph-mon[126480]: pgmap v16761: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 164 KiB/s wr, 6 op/s 2023-05-08T12:26:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31323.284408 secs 2023-05-08T12:26:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31323.839837 secs 2023-05-08T12:26:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:24 smithi133 ceph-mon[125939]: pgmap v16761: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 164 KiB/s wr, 6 op/s 2023-05-08T12:26:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31323.284408 secs 2023-05-08T12:26:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31323.839837 secs 2023-05-08T12:26:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31325.130377 secs 2023-05-08T12:26:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:26 smithi096 ceph-mon[124666]: pgmap v16762: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 115 KiB/s wr, 6 op/s 2023-05-08T12:26:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31325.130377 secs 2023-05-08T12:26:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:26 smithi186 ceph-mon[126480]: pgmap v16762: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 115 KiB/s wr, 6 op/s 2023-05-08T12:26:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31325.130377 secs 2023-05-08T12:26:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:26 smithi133 ceph-mon[125939]: pgmap v16762: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 115 KiB/s wr, 6 op/s 2023-05-08T12:26:28.763 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:28 smithi096 ceph-mon[124666]: pgmap v16763: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 104 KiB/s wr, 6 op/s 2023-05-08T12:26:28.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:28 smithi186 ceph-mon[126480]: pgmap v16763: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 104 KiB/s wr, 6 op/s 2023-05-08T12:26:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:28 smithi133 ceph-mon[125939]: pgmap v16763: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 104 KiB/s wr, 6 op/s 2023-05-08T12:26:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31328.284521 secs 2023-05-08T12:26:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31328.839954 secs 2023-05-08T12:26:29.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31328.284521 secs 2023-05-08T12:26:29.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31328.839954 secs 2023-05-08T12:26:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31328.284521 secs 2023-05-08T12:26:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31328.839954 secs 2023-05-08T12:26:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:30 smithi186 ceph-mon[126480]: pgmap v16764: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 96 KiB/s wr, 9 op/s 2023-05-08T12:26:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:30 smithi133 ceph-mon[125939]: pgmap v16764: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 96 KiB/s wr, 9 op/s 2023-05-08T12:26:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:30 smithi096 ceph-mon[124666]: pgmap v16764: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 96 KiB/s wr, 9 op/s 2023-05-08T12:26:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31330.130493 secs 2023-05-08T12:26:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31330.130493 secs 2023-05-08T12:26:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31330.130493 secs 2023-05-08T12:26:32.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:32 smithi186 ceph-mon[126480]: pgmap v16765: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 96 KiB/s wr, 6 op/s 2023-05-08T12:26:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:32 smithi133 ceph-mon[125939]: pgmap v16765: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 96 KiB/s wr, 6 op/s 2023-05-08T12:26:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:32 smithi096 ceph-mon[124666]: pgmap v16765: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 96 KiB/s wr, 6 op/s 2023-05-08T12:26:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:34 smithi186 ceph-mon[126480]: pgmap v16766: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 96 KiB/s wr, 6 op/s 2023-05-08T12:26:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31333.284636 secs 2023-05-08T12:26:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31333.840051 secs 2023-05-08T12:26:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:34 smithi133 ceph-mon[125939]: pgmap v16766: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 96 KiB/s wr, 6 op/s 2023-05-08T12:26:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31333.284636 secs 2023-05-08T12:26:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31333.840051 secs 2023-05-08T12:26:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:34 smithi096 ceph-mon[124666]: pgmap v16766: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 96 KiB/s wr, 6 op/s 2023-05-08T12:26:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31333.284636 secs 2023-05-08T12:26:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31333.840051 secs 2023-05-08T12:26:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31335.130630 secs 2023-05-08T12:26:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:36 smithi186 ceph-mon[126480]: pgmap v16767: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 97 KiB/s wr, 10 op/s 2023-05-08T12:26:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31335.130630 secs 2023-05-08T12:26:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:36 smithi133 ceph-mon[125939]: pgmap v16767: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 97 KiB/s wr, 10 op/s 2023-05-08T12:26:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31335.130630 secs 2023-05-08T12:26:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:36 smithi096 ceph-mon[124666]: pgmap v16767: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 97 KiB/s wr, 10 op/s 2023-05-08T12:26:38.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:38 smithi186 ceph-mon[126480]: pgmap v16768: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2023-05-08T12:26:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:38 smithi133 ceph-mon[125939]: pgmap v16768: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2023-05-08T12:26:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:38 smithi096 ceph-mon[124666]: pgmap v16768: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2023-05-08T12:26:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31338.284752 secs 2023-05-08T12:26:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31338.840187 secs 2023-05-08T12:26:39.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31338.284752 secs 2023-05-08T12:26:39.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31338.840187 secs 2023-05-08T12:26:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31338.284752 secs 2023-05-08T12:26:40.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31338.840187 secs 2023-05-08T12:26:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:40 smithi186 ceph-mon[126480]: pgmap v16769: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 241 KiB/s wr, 10 op/s 2023-05-08T12:26:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:40 smithi133 ceph-mon[125939]: pgmap v16769: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 241 KiB/s wr, 10 op/s 2023-05-08T12:26:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:40 smithi096 ceph-mon[124666]: pgmap v16769: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 241 KiB/s wr, 10 op/s 2023-05-08T12:26:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31340.130728 secs 2023-05-08T12:26:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31340.130728 secs 2023-05-08T12:26:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31340.130728 secs 2023-05-08T12:26:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:42 smithi186 ceph-mon[126480]: pgmap v16770: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 241 KiB/s wr, 7 op/s 2023-05-08T12:26:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:42 smithi133 ceph-mon[125939]: pgmap v16770: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 241 KiB/s wr, 7 op/s 2023-05-08T12:26:43.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:42 smithi096 ceph-mon[124666]: pgmap v16770: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 241 KiB/s wr, 7 op/s 2023-05-08T12:26:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:44 smithi186 ceph-mon[126480]: pgmap v16771: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 241 KiB/s wr, 7 op/s 2023-05-08T12:26:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31343.284820 secs 2023-05-08T12:26:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31343.840307 secs 2023-05-08T12:26:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:44 smithi133 ceph-mon[125939]: pgmap v16771: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 241 KiB/s wr, 7 op/s 2023-05-08T12:26:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31343.284820 secs 2023-05-08T12:26:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31343.840307 secs 2023-05-08T12:26:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:44 smithi096 ceph-mon[124666]: pgmap v16771: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 241 KiB/s wr, 7 op/s 2023-05-08T12:26:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31343.284820 secs 2023-05-08T12:26:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31343.840307 secs 2023-05-08T12:26:46.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:46 smithi186 ceph-mon[126480]: pgmap v16772: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 288 KiB/s rd, 504 KiB/s wr, 10 op/s 2023-05-08T12:26:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:46 smithi133 ceph-mon[125939]: pgmap v16772: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 288 KiB/s rd, 504 KiB/s wr, 10 op/s 2023-05-08T12:26:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:46 smithi096 ceph-mon[124666]: pgmap v16772: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 288 KiB/s rd, 504 KiB/s wr, 10 op/s 2023-05-08T12:26:48.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:48 smithi186 ceph-mon[126480]: pgmap v16773: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 286 KiB/s rd, 504 KiB/s wr, 7 op/s 2023-05-08T12:26:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:26:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:48 smithi133 ceph-mon[125939]: pgmap v16773: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 286 KiB/s rd, 504 KiB/s wr, 7 op/s 2023-05-08T12:26:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:26:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:48 smithi096 ceph-mon[124666]: pgmap v16773: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 286 KiB/s rd, 504 KiB/s wr, 7 op/s 2023-05-08T12:26:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:26:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31348.284934 secs 2023-05-08T12:26:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:26:49.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:26:49.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:26:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31348.284934 secs 2023-05-08T12:26:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:26:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:26:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:26:50.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31348.284934 secs 2023-05-08T12:26:50.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:26:50.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:26:50.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:26:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:50 smithi186 ceph-mon[126480]: pgmap v16774: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 846 KiB/s rd, 625 KiB/s wr, 11 op/s 2023-05-08T12:26:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:50 smithi133 ceph-mon[125939]: pgmap v16774: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 846 KiB/s rd, 625 KiB/s wr, 11 op/s 2023-05-08T12:26:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:50 smithi096 ceph-mon[124666]: pgmap v16774: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 846 KiB/s rd, 625 KiB/s wr, 11 op/s 2023-05-08T12:26:52.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:52 smithi186 ceph-mon[126480]: pgmap v16775: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 605 KiB/s rd, 385 KiB/s wr, 7 op/s 2023-05-08T12:26:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:52 smithi133 ceph-mon[125939]: pgmap v16775: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 605 KiB/s rd, 385 KiB/s wr, 7 op/s 2023-05-08T12:26:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:52 smithi096 ceph-mon[124666]: pgmap v16775: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 605 KiB/s rd, 385 KiB/s wr, 7 op/s 2023-05-08T12:26:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:53 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:26:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:53 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:26:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:53 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:26:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:54 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:26:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:54 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:26:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:54 smithi186 ceph-mon[126480]: pgmap v16776: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 605 KiB/s rd, 385 KiB/s wr, 7 op/s 2023-05-08T12:26:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31353.285054 secs 2023-05-08T12:26:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:54 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:26:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:54 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:26:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:54 smithi133 ceph-mon[125939]: pgmap v16776: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 605 KiB/s rd, 385 KiB/s wr, 7 op/s 2023-05-08T12:26:54.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31353.285054 secs 2023-05-08T12:26:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:54 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:26:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:54 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:26:54.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:54 smithi096 ceph-mon[124666]: pgmap v16776: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 605 KiB/s rd, 385 KiB/s wr, 7 op/s 2023-05-08T12:26:54.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31353.285054 secs 2023-05-08T12:26:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31355.131080 secs 2023-05-08T12:26:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:56 smithi133 ceph-mon[125939]: pgmap v16777: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 990 KiB/s wr, 13 op/s 2023-05-08T12:26:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:56 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:26:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31355.131080 secs 2023-05-08T12:26:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:56 smithi096 ceph-mon[124666]: pgmap v16777: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 990 KiB/s wr, 13 op/s 2023-05-08T12:26:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:56 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:26:56.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31355.131080 secs 2023-05-08T12:26:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:56 smithi186 ceph-mon[126480]: pgmap v16777: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 990 KiB/s wr, 13 op/s 2023-05-08T12:26:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:56 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:26:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:26:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:26:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:58 smithi186 ceph-mon[126480]: pgmap v16778: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 727 KiB/s wr, 9 op/s 2023-05-08T12:26:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:26:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:26:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:58 smithi133 ceph-mon[125939]: pgmap v16778: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 727 KiB/s wr, 9 op/s 2023-05-08T12:26:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:26:58.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:26:58.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:58 smithi096 ceph-mon[124666]: pgmap v16778: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 727 KiB/s wr, 9 op/s 2023-05-08T12:26:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31358.285171 secs 2023-05-08T12:26:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:26:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31358.840663 secs 2023-05-08T12:26:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31358.285171 secs 2023-05-08T12:26:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:26:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31358.840663 secs 2023-05-08T12:26:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31358.285171 secs 2023-05-08T12:26:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:26:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31358.840663 secs 2023-05-08T12:27:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:00 smithi186 ceph-mon[126480]: pgmap v16779: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 846 KiB/s wr, 15 op/s 2023-05-08T12:27:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:00 smithi133 ceph-mon[125939]: pgmap v16779: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 846 KiB/s wr, 15 op/s 2023-05-08T12:27:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:00 smithi096 ceph-mon[124666]: pgmap v16779: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 846 KiB/s wr, 15 op/s 2023-05-08T12:27:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:01 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:27:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:01 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:27:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:01 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:27:01.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:01 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:27:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:01 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:27:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:01 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:27:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:27:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:27:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:27:02.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:02 smithi186 ceph-mon[126480]: pgmap v16780: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 725 KiB/s wr, 10 op/s 2023-05-08T12:27:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:27:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:27:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:27:02.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:02 smithi133 ceph-mon[125939]: pgmap v16780: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 725 KiB/s wr, 10 op/s 2023-05-08T12:27:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:27:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:27:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:27:02.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:02 smithi096 ceph-mon[124666]: pgmap v16780: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 725 KiB/s wr, 10 op/s 2023-05-08T12:27:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:04 smithi133 ceph-mon[125939]: pgmap v16781: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 725 KiB/s wr, 10 op/s 2023-05-08T12:27:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31363.285311 secs 2023-05-08T12:27:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31363.840788 secs 2023-05-08T12:27:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:04 smithi096 ceph-mon[124666]: pgmap v16781: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 725 KiB/s wr, 10 op/s 2023-05-08T12:27:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31363.285311 secs 2023-05-08T12:27:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31363.840788 secs 2023-05-08T12:27:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:04 smithi186 ceph-mon[126480]: pgmap v16781: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 725 KiB/s wr, 10 op/s 2023-05-08T12:27:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31363.285311 secs 2023-05-08T12:27:04.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31363.840788 secs 2023-05-08T12:27:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:06 smithi133 ceph-mon[125939]: pgmap v16782: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.2 MiB/s wr, 27 op/s 2023-05-08T12:27:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:06 smithi096 ceph-mon[124666]: pgmap v16782: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.2 MiB/s wr, 27 op/s 2023-05-08T12:27:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:06 smithi186 ceph-mon[126480]: pgmap v16782: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.2 MiB/s wr, 27 op/s 2023-05-08T12:27:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:08 smithi133 ceph-mon[125939]: pgmap v16783: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 619 KiB/s wr, 22 op/s 2023-05-08T12:27:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:08 smithi096 ceph-mon[124666]: pgmap v16783: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 619 KiB/s wr, 22 op/s 2023-05-08T12:27:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:08 smithi186 ceph-mon[126480]: pgmap v16783: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 619 KiB/s wr, 22 op/s 2023-05-08T12:27:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31368.285367 secs 2023-05-08T12:27:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31368.840924 secs 2023-05-08T12:27:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31368.285367 secs 2023-05-08T12:27:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31368.840924 secs 2023-05-08T12:27:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31368.285367 secs 2023-05-08T12:27:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31368.840924 secs 2023-05-08T12:27:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:10 smithi133 ceph-mon[125939]: pgmap v16784: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 739 KiB/s wr, 25 op/s 2023-05-08T12:27:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:10 smithi096 ceph-mon[124666]: pgmap v16784: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 739 KiB/s wr, 25 op/s 2023-05-08T12:27:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:10 smithi186 ceph-mon[126480]: pgmap v16784: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 739 KiB/s wr, 25 op/s 2023-05-08T12:27:12.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:12 smithi186 ceph-mon[126480]: pgmap v16785: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 619 KiB/s wr, 20 op/s 2023-05-08T12:27:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:12 smithi133 ceph-mon[125939]: pgmap v16785: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 619 KiB/s wr, 20 op/s 2023-05-08T12:27:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:12 smithi096 ceph-mon[124666]: pgmap v16785: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 619 KiB/s wr, 20 op/s 2023-05-08T12:27:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:14 smithi133 ceph-mon[125939]: pgmap v16786: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 619 KiB/s wr, 20 op/s 2023-05-08T12:27:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31373.285489 secs 2023-05-08T12:27:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31373.841046 secs 2023-05-08T12:27:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:14 smithi096 ceph-mon[124666]: pgmap v16786: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 619 KiB/s wr, 20 op/s 2023-05-08T12:27:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31373.285489 secs 2023-05-08T12:27:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31373.841046 secs 2023-05-08T12:27:14.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:14 smithi186 ceph-mon[126480]: pgmap v16786: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 619 KiB/s wr, 20 op/s 2023-05-08T12:27:14.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31373.285489 secs 2023-05-08T12:27:14.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31373.841046 secs 2023-05-08T12:27:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:16 smithi133 ceph-mon[125939]: pgmap v16787: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 876 KiB/s rd, 696 KiB/s wr, 23 op/s 2023-05-08T12:27:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:16 smithi096 ceph-mon[124666]: pgmap v16787: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 876 KiB/s rd, 696 KiB/s wr, 23 op/s 2023-05-08T12:27:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:16 smithi186 ceph-mon[126480]: pgmap v16787: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 876 KiB/s rd, 696 KiB/s wr, 23 op/s 2023-05-08T12:27:18.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:18 smithi133 ceph-mon[125939]: pgmap v16788: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 319 KiB/s rd, 196 KiB/s wr, 6 op/s 2023-05-08T12:27:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:18 smithi096 ceph-mon[124666]: pgmap v16788: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 319 KiB/s rd, 196 KiB/s wr, 6 op/s 2023-05-08T12:27:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:18 smithi186 ceph-mon[126480]: pgmap v16788: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 319 KiB/s rd, 196 KiB/s wr, 6 op/s 2023-05-08T12:27:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31378.285580 secs 2023-05-08T12:27:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31378.285580 secs 2023-05-08T12:27:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31378.285580 secs 2023-05-08T12:27:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:20 smithi133 ceph-mon[125939]: pgmap v16789: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 846 KiB/s rd, 863 KiB/s wr, 13 op/s 2023-05-08T12:27:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:20 smithi096 ceph-mon[124666]: pgmap v16789: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 846 KiB/s rd, 863 KiB/s wr, 13 op/s 2023-05-08T12:27:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:20 smithi186 ceph-mon[126480]: pgmap v16789: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 846 KiB/s rd, 863 KiB/s wr, 13 op/s 2023-05-08T12:27:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:21 smithi096 ceph-mon[124666]: osdmap e1126: 12 total, 12 up, 12 in 2023-05-08T12:27:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:21 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:27:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:27:21.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:21 smithi186 ceph-mon[126480]: osdmap e1126: 12 total, 12 up, 12 in 2023-05-08T12:27:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:21 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:27:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:27:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:21 smithi133 ceph-mon[125939]: osdmap e1126: 12 total, 12 up, 12 in 2023-05-08T12:27:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:21 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:27:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:27:22.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:22 smithi096 ceph-mon[124666]: pgmap v16791: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 891 KiB/s wr, 12 op/s 2023-05-08T12:27:22.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:22 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:27:22.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:22 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:27:22.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:22 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:27:22.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:22 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:27:22.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:22 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:27:22.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:22 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:27:22.759 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:22 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:27:22.759 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:22 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:27:22.759 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:22 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:27:22.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:22 smithi186 ceph-mon[126480]: pgmap v16791: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 891 KiB/s wr, 12 op/s 2023-05-08T12:27:22.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:22 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:27:22.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:22 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:27:22.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:22 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:27:22.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:22 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:27:22.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:22 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:27:22.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:22 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:27:22.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:22 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:27:22.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:22 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:27:22.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:22 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:27:22.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:22 smithi133 ceph-mon[125939]: pgmap v16791: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 891 KiB/s wr, 12 op/s 2023-05-08T12:27:22.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:22 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:27:22.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:22 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:27:22.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:22 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:27:22.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:22 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:27:22.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:22 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:27:22.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:22 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:27:22.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:22 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:27:22.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:22 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:27:22.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:22 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:27:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:27:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:27:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:23 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:27:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:27:23.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:23 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T12:27:23.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:23 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T12:27:23.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:23 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:27:23.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:27:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:27:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:23 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:27:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:27:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:23 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T12:27:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:23 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T12:27:23.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:23 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:27:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:27:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:27:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:23 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:27:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:27:23.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:23 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T12:27:23.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:23 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T12:27:23.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:23 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:27:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:24 smithi186 ceph-mon[126480]: pgmap v16792: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 891 KiB/s wr, 12 op/s 2023-05-08T12:27:24.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31383.285643 secs 2023-05-08T12:27:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:24 smithi133 ceph-mon[125939]: pgmap v16792: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 891 KiB/s wr, 12 op/s 2023-05-08T12:27:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31383.285643 secs 2023-05-08T12:27:25.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:24 smithi096 ceph-mon[124666]: pgmap v16792: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 891 KiB/s wr, 12 op/s 2023-05-08T12:27:25.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31383.285643 secs 2023-05-08T12:27:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:26 smithi186 ceph-mon[126480]: pgmap v16793: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 826 KiB/s rd, 874 KiB/s wr, 14 op/s 2023-05-08T12:27:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:26 smithi133 ceph-mon[125939]: pgmap v16793: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 826 KiB/s rd, 874 KiB/s wr, 14 op/s 2023-05-08T12:27:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:26 smithi096 ceph-mon[124666]: pgmap v16793: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 826 KiB/s rd, 874 KiB/s wr, 14 op/s 2023-05-08T12:27:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:28 smithi186 ceph-mon[126480]: pgmap v16794: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 826 KiB/s rd, 874 KiB/s wr, 14 op/s 2023-05-08T12:27:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:28 smithi133 ceph-mon[125939]: pgmap v16794: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 826 KiB/s rd, 874 KiB/s wr, 14 op/s 2023-05-08T12:27:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:28 smithi096 ceph-mon[124666]: pgmap v16794: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 826 KiB/s rd, 874 KiB/s wr, 14 op/s 2023-05-08T12:27:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31388.285765 secs 2023-05-08T12:27:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31388.285765 secs 2023-05-08T12:27:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31388.285765 secs 2023-05-08T12:27:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:30 smithi133 ceph-mon[125939]: pgmap v16795: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 505 KiB/s rd, 360 KiB/s wr, 9 op/s 2023-05-08T12:27:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:30 smithi096 ceph-mon[124666]: pgmap v16795: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 505 KiB/s rd, 360 KiB/s wr, 9 op/s 2023-05-08T12:27:31.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:30 smithi186 ceph-mon[126480]: pgmap v16795: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 505 KiB/s rd, 360 KiB/s wr, 9 op/s 2023-05-08T12:27:32.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:32 smithi186 ceph-mon[126480]: osdmap e1127: 12 total, 12 up, 12 in 2023-05-08T12:27:32.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:32 smithi186 ceph-mon[126480]: pgmap v16797: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 505 KiB/s rd, 360 KiB/s wr, 9 op/s 2023-05-08T12:27:32.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:32 smithi133 ceph-mon[125939]: osdmap e1127: 12 total, 12 up, 12 in 2023-05-08T12:27:32.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:32 smithi133 ceph-mon[125939]: pgmap v16797: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 505 KiB/s rd, 360 KiB/s wr, 9 op/s 2023-05-08T12:27:32.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:32 smithi096 ceph-mon[124666]: osdmap e1127: 12 total, 12 up, 12 in 2023-05-08T12:27:32.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:32 smithi096 ceph-mon[124666]: pgmap v16797: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 505 KiB/s rd, 360 KiB/s wr, 9 op/s 2023-05-08T12:27:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:34 smithi133 ceph-mon[125939]: pgmap v16798: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 505 KiB/s rd, 360 KiB/s wr, 9 op/s 2023-05-08T12:27:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31393.285882 secs 2023-05-08T12:27:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:34 smithi096 ceph-mon[124666]: pgmap v16798: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 505 KiB/s rd, 360 KiB/s wr, 9 op/s 2023-05-08T12:27:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31393.285882 secs 2023-05-08T12:27:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:34 smithi186 ceph-mon[126480]: pgmap v16798: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 505 KiB/s rd, 360 KiB/s wr, 9 op/s 2023-05-08T12:27:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31393.285882 secs 2023-05-08T12:27:36.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31395.132091 secs 2023-05-08T12:27:36.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:36 smithi133 ceph-mon[125939]: pgmap v16799: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 452 KiB/s wr, 8 op/s 2023-05-08T12:27:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31395.132091 secs 2023-05-08T12:27:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:36 smithi096 ceph-mon[124666]: pgmap v16799: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 452 KiB/s wr, 8 op/s 2023-05-08T12:27:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31395.132091 secs 2023-05-08T12:27:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:36 smithi186 ceph-mon[126480]: pgmap v16799: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 452 KiB/s wr, 8 op/s 2023-05-08T12:27:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:37 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:27:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:37 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:27:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:37 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:27:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:37 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:27:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:37 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:27:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:37 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:27:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:37 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:27:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:37 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:27:37.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:37 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:27:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:38 smithi133 ceph-mon[125939]: pgmap v16800: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 452 KiB/s wr, 8 op/s 2023-05-08T12:27:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:38 smithi096 ceph-mon[124666]: pgmap v16800: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 452 KiB/s wr, 8 op/s 2023-05-08T12:27:38.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:38 smithi186 ceph-mon[126480]: pgmap v16800: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 452 KiB/s wr, 8 op/s 2023-05-08T12:27:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31398.286000 secs 2023-05-08T12:27:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31398.841657 secs 2023-05-08T12:27:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31398.286000 secs 2023-05-08T12:27:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31398.841657 secs 2023-05-08T12:27:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31398.286000 secs 2023-05-08T12:27:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31398.841657 secs 2023-05-08T12:27:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:40 smithi133 ceph-mon[125939]: pgmap v16801: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 575 KiB/s rd, 574 KiB/s wr, 10 op/s 2023-05-08T12:27:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:40 smithi096 ceph-mon[124666]: pgmap v16801: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 575 KiB/s rd, 574 KiB/s wr, 10 op/s 2023-05-08T12:27:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:40 smithi186 ceph-mon[126480]: pgmap v16801: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 575 KiB/s rd, 574 KiB/s wr, 10 op/s 2023-05-08T12:27:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31400.132203 secs 2023-05-08T12:27:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31400.132203 secs 2023-05-08T12:27:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31400.132203 secs 2023-05-08T12:27:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:42 smithi096 ceph-mon[124666]: pgmap v16802: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 567 KiB/s rd, 566 KiB/s wr, 10 op/s 2023-05-08T12:27:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:42 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:27:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:42 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:27:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:42 smithi186 ceph-mon[126480]: pgmap v16802: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 567 KiB/s rd, 566 KiB/s wr, 10 op/s 2023-05-08T12:27:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:42 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:27:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:42 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:27:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:42 smithi133 ceph-mon[125939]: pgmap v16802: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 567 KiB/s rd, 566 KiB/s wr, 10 op/s 2023-05-08T12:27:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:42 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:27:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:42 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:27:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:44 smithi096 ceph-mon[124666]: pgmap v16803: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 478 KiB/s wr, 8 op/s 2023-05-08T12:27:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31403.286120 secs 2023-05-08T12:27:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31403.841774 secs 2023-05-08T12:27:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:44 smithi186 ceph-mon[126480]: pgmap v16803: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 478 KiB/s wr, 8 op/s 2023-05-08T12:27:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31403.286120 secs 2023-05-08T12:27:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31403.841774 secs 2023-05-08T12:27:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:44 smithi133 ceph-mon[125939]: pgmap v16803: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 478 KiB/s wr, 8 op/s 2023-05-08T12:27:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31403.286120 secs 2023-05-08T12:27:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31403.841774 secs 2023-05-08T12:27:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:46 smithi096 ceph-mon[124666]: pgmap v16804: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 502 KiB/s rd, 766 KiB/s wr, 12 op/s 2023-05-08T12:27:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:46 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:27:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:46 smithi186 ceph-mon[126480]: pgmap v16804: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 502 KiB/s rd, 766 KiB/s wr, 12 op/s 2023-05-08T12:27:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:46 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:27:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:46 smithi133 ceph-mon[125939]: pgmap v16804: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 502 KiB/s rd, 766 KiB/s wr, 12 op/s 2023-05-08T12:27:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:46 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:27:48.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:48 smithi186 ceph-mon[126480]: pgmap v16805: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 627 KiB/s wr, 8 op/s 2023-05-08T12:27:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:27:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:48 smithi133 ceph-mon[125939]: pgmap v16805: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 627 KiB/s wr, 8 op/s 2023-05-08T12:27:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:27:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:48 smithi096 ceph-mon[124666]: pgmap v16805: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 627 KiB/s wr, 8 op/s 2023-05-08T12:27:49.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:27:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:27:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:27:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31408.286200 secs 2023-05-08T12:27:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:27:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:27:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31408.286200 secs 2023-05-08T12:27:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:27:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:27:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31408.286200 secs 2023-05-08T12:27:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:50 smithi186 ceph-mon[126480]: pgmap v16806: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 917 KiB/s wr, 14 op/s 2023-05-08T12:27:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:50 smithi133 ceph-mon[125939]: pgmap v16806: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 917 KiB/s wr, 14 op/s 2023-05-08T12:27:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:50 smithi096 ceph-mon[124666]: pgmap v16806: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 917 KiB/s wr, 14 op/s 2023-05-08T12:27:51.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:51 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:27:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:51 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:27:52.009 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:51 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:27:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:52 smithi186 ceph-mon[126480]: pgmap v16807: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 611 KiB/s rd, 577 KiB/s wr, 9 op/s 2023-05-08T12:27:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:52 smithi133 ceph-mon[125939]: pgmap v16807: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 611 KiB/s rd, 577 KiB/s wr, 9 op/s 2023-05-08T12:27:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:52 smithi096 ceph-mon[124666]: pgmap v16807: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 611 KiB/s rd, 577 KiB/s wr, 9 op/s 2023-05-08T12:27:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:53 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:27:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:53 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:27:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:53 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:27:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:54 smithi186 ceph-mon[126480]: pgmap v16808: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 611 KiB/s rd, 577 KiB/s wr, 9 op/s 2023-05-08T12:27:54.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:54 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:27:54.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:54 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:27:54.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31413.286320 secs 2023-05-08T12:27:54.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31413.842003 secs 2023-05-08T12:27:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:54 smithi133 ceph-mon[125939]: pgmap v16808: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 611 KiB/s rd, 577 KiB/s wr, 9 op/s 2023-05-08T12:27:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:54 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:27:54.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:54 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:27:54.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31413.286320 secs 2023-05-08T12:27:54.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31413.842003 secs 2023-05-08T12:27:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:54 smithi096 ceph-mon[124666]: pgmap v16808: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 611 KiB/s rd, 577 KiB/s wr, 9 op/s 2023-05-08T12:27:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:54 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:27:55.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:54 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:27:55.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31413.286320 secs 2023-05-08T12:27:55.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31413.842003 secs 2023-05-08T12:27:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31415.132523 secs 2023-05-08T12:27:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:56 smithi186 ceph-mon[126480]: pgmap v16809: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 890 KiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T12:27:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:56 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:27:56.994 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31415.132523 secs 2023-05-08T12:27:56.994 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:56 smithi133 ceph-mon[125939]: pgmap v16809: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 890 KiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T12:27:56.994 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:56 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:27:57.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31415.132523 secs 2023-05-08T12:27:57.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:56 smithi096 ceph-mon[124666]: pgmap v16809: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 890 KiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T12:27:57.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:56 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:27:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:27:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:27:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:27:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:58 smithi186 ceph-mon[126480]: pgmap v16810: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T12:27:58.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:27:58.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:27:58.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:27:58.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:58 smithi133 ceph-mon[125939]: pgmap v16810: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T12:27:58.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:27:58.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:27:58.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:27:58.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:58 smithi096 ceph-mon[124666]: pgmap v16810: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T12:27:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31418.286387 secs 2023-05-08T12:27:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:27:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31418.842123 secs 2023-05-08T12:27:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31418.286387 secs 2023-05-08T12:27:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:27:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31418.842123 secs 2023-05-08T12:27:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31418.286387 secs 2023-05-08T12:27:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:27:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31418.842123 secs 2023-05-08T12:28:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:00 smithi186 ceph-mon[126480]: pgmap v16811: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 16 op/s 2023-05-08T12:28:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:00 smithi133 ceph-mon[125939]: pgmap v16811: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 16 op/s 2023-05-08T12:28:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:00 smithi096 ceph-mon[124666]: pgmap v16811: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 16 op/s 2023-05-08T12:28:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31420.132592 secs 2023-05-08T12:28:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:01 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:28:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31420.132592 secs 2023-05-08T12:28:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:01 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:28:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31420.132592 secs 2023-05-08T12:28:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:01 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:28:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:02 smithi186 ceph-mon[126480]: pgmap v16812: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T12:28:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:02 smithi133 ceph-mon[125939]: pgmap v16812: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T12:28:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:02 smithi096 ceph-mon[124666]: pgmap v16812: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T12:28:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:04 smithi133 ceph-mon[125939]: pgmap v16813: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 10 op/s 2023-05-08T12:28:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31423.286503 secs 2023-05-08T12:28:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31423.842220 secs 2023-05-08T12:28:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:04 smithi096 ceph-mon[124666]: pgmap v16813: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 10 op/s 2023-05-08T12:28:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31423.286503 secs 2023-05-08T12:28:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31423.842220 secs 2023-05-08T12:28:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:04 smithi186 ceph-mon[126480]: pgmap v16813: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 10 op/s 2023-05-08T12:28:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31423.286503 secs 2023-05-08T12:28:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31423.842220 secs 2023-05-08T12:28:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31425.132709 secs 2023-05-08T12:28:06.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:06 smithi096 ceph-mon[124666]: pgmap v16814: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 30 op/s 2023-05-08T12:28:06.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:06 smithi096 ceph-mon[124666]: osdmap e1128: 12 total, 12 up, 12 in 2023-05-08T12:28:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31425.132709 secs 2023-05-08T12:28:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:06 smithi186 ceph-mon[126480]: pgmap v16814: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 30 op/s 2023-05-08T12:28:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:06 smithi186 ceph-mon[126480]: osdmap e1128: 12 total, 12 up, 12 in 2023-05-08T12:28:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31425.132709 secs 2023-05-08T12:28:06.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:06 smithi133 ceph-mon[125939]: pgmap v16814: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 30 op/s 2023-05-08T12:28:06.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:06 smithi133 ceph-mon[125939]: osdmap e1128: 12 total, 12 up, 12 in 2023-05-08T12:28:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:08 smithi096 ceph-mon[124666]: pgmap v16816: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 29 op/s 2023-05-08T12:28:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:08 smithi186 ceph-mon[126480]: pgmap v16816: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 29 op/s 2023-05-08T12:28:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:08 smithi133 ceph-mon[125939]: pgmap v16816: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 29 op/s 2023-05-08T12:28:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31428.286564 secs 2023-05-08T12:28:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31428.842345 secs 2023-05-08T12:28:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31428.286564 secs 2023-05-08T12:28:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31428.842345 secs 2023-05-08T12:28:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31428.286564 secs 2023-05-08T12:28:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31428.842345 secs 2023-05-08T12:28:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:10 smithi096 ceph-mon[124666]: pgmap v16817: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 686 KiB/s wr, 27 op/s 2023-05-08T12:28:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:10 smithi186 ceph-mon[126480]: pgmap v16817: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 686 KiB/s wr, 27 op/s 2023-05-08T12:28:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:10 smithi133 ceph-mon[125939]: pgmap v16817: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 686 KiB/s wr, 27 op/s 2023-05-08T12:28:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31430.132825 secs 2023-05-08T12:28:11.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31430.132825 secs 2023-05-08T12:28:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31430.132825 secs 2023-05-08T12:28:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:12 smithi186 ceph-mon[126480]: pgmap v16818: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 686 KiB/s wr, 27 op/s 2023-05-08T12:28:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:12 smithi133 ceph-mon[125939]: pgmap v16818: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 686 KiB/s wr, 27 op/s 2023-05-08T12:28:13.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:12 smithi096 ceph-mon[124666]: pgmap v16818: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 686 KiB/s wr, 27 op/s 2023-05-08T12:28:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:14 smithi186 ceph-mon[126480]: pgmap v16819: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 686 KiB/s wr, 27 op/s 2023-05-08T12:28:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31433.286694 secs 2023-05-08T12:28:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31433.842492 secs 2023-05-08T12:28:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:14 smithi133 ceph-mon[125939]: pgmap v16819: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 686 KiB/s wr, 27 op/s 2023-05-08T12:28:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31433.286694 secs 2023-05-08T12:28:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31433.842492 secs 2023-05-08T12:28:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:14 smithi096 ceph-mon[124666]: pgmap v16819: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 686 KiB/s wr, 27 op/s 2023-05-08T12:28:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31433.286694 secs 2023-05-08T12:28:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31433.842492 secs 2023-05-08T12:28:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31435.132941 secs 2023-05-08T12:28:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:16 smithi186 ceph-mon[126480]: pgmap v16820: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 752 KiB/s rd, 429 KiB/s wr, 8 op/s 2023-05-08T12:28:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:16 smithi186 ceph-mon[126480]: osdmap e1129: 12 total, 12 up, 12 in 2023-05-08T12:28:16.997 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31435.132941 secs 2023-05-08T12:28:16.997 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:16 smithi133 ceph-mon[125939]: pgmap v16820: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 752 KiB/s rd, 429 KiB/s wr, 8 op/s 2023-05-08T12:28:16.998 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:16 smithi133 ceph-mon[125939]: osdmap e1129: 12 total, 12 up, 12 in 2023-05-08T12:28:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31435.132941 secs 2023-05-08T12:28:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:16 smithi096 ceph-mon[124666]: pgmap v16820: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 752 KiB/s rd, 429 KiB/s wr, 8 op/s 2023-05-08T12:28:17.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:16 smithi096 ceph-mon[124666]: osdmap e1129: 12 total, 12 up, 12 in 2023-05-08T12:28:18.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:18 smithi186 ceph-mon[126480]: pgmap v16822: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 752 KiB/s rd, 429 KiB/s wr, 8 op/s 2023-05-08T12:28:19.024 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:18 smithi096 ceph-mon[124666]: pgmap v16822: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 752 KiB/s rd, 429 KiB/s wr, 8 op/s 2023-05-08T12:28:19.024 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:18 smithi133 ceph-mon[125939]: pgmap v16822: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 752 KiB/s rd, 429 KiB/s wr, 8 op/s 2023-05-08T12:28:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31438.286813 secs 2023-05-08T12:28:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31438.842600 secs 2023-05-08T12:28:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31438.286813 secs 2023-05-08T12:28:19.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31438.842600 secs 2023-05-08T12:28:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31438.286813 secs 2023-05-08T12:28:20.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31438.842600 secs 2023-05-08T12:28:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:20 smithi186 ceph-mon[126480]: pgmap v16823: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 307 KiB/s wr, 8 op/s 2023-05-08T12:28:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:20 smithi133 ceph-mon[125939]: pgmap v16823: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 307 KiB/s wr, 8 op/s 2023-05-08T12:28:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:20 smithi096 ceph-mon[124666]: pgmap v16823: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 307 KiB/s wr, 8 op/s 2023-05-08T12:28:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31440.133021 secs 2023-05-08T12:28:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31440.133021 secs 2023-05-08T12:28:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31440.133021 secs 2023-05-08T12:28:22.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:22 smithi186 ceph-mon[126480]: pgmap v16824: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 307 KiB/s wr, 8 op/s 2023-05-08T12:28:22.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:22 smithi133 ceph-mon[125939]: pgmap v16824: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 307 KiB/s wr, 8 op/s 2023-05-08T12:28:23.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:22 smithi096 ceph-mon[124666]: pgmap v16824: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 307 KiB/s wr, 8 op/s 2023-05-08T12:28:23.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:28:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:28:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:28:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:28:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:28:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:28:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:28:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:28:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:28:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:28:24.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:28:24.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:28:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:24 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:28:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:24 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T12:28:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:24 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T12:28:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:24 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:28:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:24 smithi186 ceph-mon[126480]: pgmap v16825: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 307 KiB/s wr, 8 op/s 2023-05-08T12:28:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31443.286940 secs 2023-05-08T12:28:24.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31443.842678 secs 2023-05-08T12:28:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:24 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:28:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:24 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T12:28:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:24 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T12:28:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:24 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:28:24.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:24 smithi133 ceph-mon[125939]: pgmap v16825: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 307 KiB/s wr, 8 op/s 2023-05-08T12:28:24.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31443.286940 secs 2023-05-08T12:28:24.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31443.842678 secs 2023-05-08T12:28:25.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:24 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:28:25.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:24 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T12:28:25.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:24 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T12:28:25.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:24 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:28:25.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:24 smithi096 ceph-mon[124666]: pgmap v16825: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 307 KiB/s wr, 8 op/s 2023-05-08T12:28:25.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31443.286940 secs 2023-05-08T12:28:25.009 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31443.842678 secs 2023-05-08T12:28:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31445.133132 secs 2023-05-08T12:28:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:26 smithi186 ceph-mon[126480]: pgmap v16826: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 50 KiB/s wr, 9 op/s 2023-05-08T12:28:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31445.133132 secs 2023-05-08T12:28:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:26 smithi133 ceph-mon[125939]: pgmap v16826: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 50 KiB/s wr, 9 op/s 2023-05-08T12:28:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31445.133132 secs 2023-05-08T12:28:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:26 smithi096 ceph-mon[124666]: pgmap v16826: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 50 KiB/s wr, 9 op/s 2023-05-08T12:28:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:28 smithi186 ceph-mon[126480]: pgmap v16827: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 45 KiB/s wr, 8 op/s 2023-05-08T12:28:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:28 smithi133 ceph-mon[125939]: pgmap v16827: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 45 KiB/s wr, 8 op/s 2023-05-08T12:28:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:28 smithi096 ceph-mon[124666]: pgmap v16827: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 45 KiB/s wr, 8 op/s 2023-05-08T12:28:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31448.287092 secs 2023-05-08T12:28:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31448.842811 secs 2023-05-08T12:28:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31448.287092 secs 2023-05-08T12:28:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31448.842811 secs 2023-05-08T12:28:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31448.287092 secs 2023-05-08T12:28:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31448.842811 secs 2023-05-08T12:28:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:30 smithi186 ceph-mon[126480]: pgmap v16828: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 42 KiB/s wr, 11 op/s 2023-05-08T12:28:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:30 smithi133 ceph-mon[125939]: pgmap v16828: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 42 KiB/s wr, 11 op/s 2023-05-08T12:28:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:30 smithi096 ceph-mon[124666]: pgmap v16828: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 42 KiB/s wr, 11 op/s 2023-05-08T12:28:31.874 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31450.133250 secs 2023-05-08T12:28:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31450.133250 secs 2023-05-08T12:28:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31450.133250 secs 2023-05-08T12:28:32.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:32 smithi186 ceph-mon[126480]: pgmap v16829: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2023-05-08T12:28:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:32 smithi133 ceph-mon[125939]: pgmap v16829: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2023-05-08T12:28:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:32 smithi096 ceph-mon[124666]: pgmap v16829: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2023-05-08T12:28:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:34 smithi186 ceph-mon[126480]: pgmap v16830: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2023-05-08T12:28:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31453.287218 secs 2023-05-08T12:28:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31453.842867 secs 2023-05-08T12:28:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:34 smithi133 ceph-mon[125939]: pgmap v16830: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2023-05-08T12:28:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31453.287218 secs 2023-05-08T12:28:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31453.842867 secs 2023-05-08T12:28:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:34 smithi096 ceph-mon[124666]: pgmap v16830: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2023-05-08T12:28:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31453.287218 secs 2023-05-08T12:28:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31453.842867 secs 2023-05-08T12:28:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31455.133376 secs 2023-05-08T12:28:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:36 smithi186 ceph-mon[126480]: pgmap v16831: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 244 KiB/s wr, 11 op/s 2023-05-08T12:28:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31455.133376 secs 2023-05-08T12:28:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:36 smithi133 ceph-mon[125939]: pgmap v16831: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 244 KiB/s wr, 11 op/s 2023-05-08T12:28:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31455.133376 secs 2023-05-08T12:28:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:36 smithi096 ceph-mon[124666]: pgmap v16831: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 244 KiB/s wr, 11 op/s 2023-05-08T12:28:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:38 smithi186 ceph-mon[126480]: pgmap v16832: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 243 KiB/s wr, 7 op/s 2023-05-08T12:28:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:38 smithi133 ceph-mon[125939]: pgmap v16832: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 243 KiB/s wr, 7 op/s 2023-05-08T12:28:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:38 smithi096 ceph-mon[124666]: pgmap v16832: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 243 KiB/s wr, 7 op/s 2023-05-08T12:28:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31458.287341 secs 2023-05-08T12:28:39.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31458.843017 secs 2023-05-08T12:28:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31458.287341 secs 2023-05-08T12:28:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31458.843017 secs 2023-05-08T12:28:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31458.287341 secs 2023-05-08T12:28:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31458.843017 secs 2023-05-08T12:28:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:40 smithi186 ceph-mon[126480]: pgmap v16833: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 243 KiB/s wr, 9 op/s 2023-05-08T12:28:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:40 smithi133 ceph-mon[125939]: pgmap v16833: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 243 KiB/s wr, 9 op/s 2023-05-08T12:28:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:40 smithi096 ceph-mon[124666]: pgmap v16833: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 243 KiB/s wr, 9 op/s 2023-05-08T12:28:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31460.133496 secs 2023-05-08T12:28:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31460.133496 secs 2023-05-08T12:28:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31460.133496 secs 2023-05-08T12:28:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:42 smithi186 ceph-mon[126480]: pgmap v16834: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 243 KiB/s wr, 6 op/s 2023-05-08T12:28:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:42 smithi133 ceph-mon[125939]: pgmap v16834: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 243 KiB/s wr, 6 op/s 2023-05-08T12:28:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:42 smithi096 ceph-mon[124666]: pgmap v16834: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 243 KiB/s wr, 6 op/s 2023-05-08T12:28:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:44 smithi186 ceph-mon[126480]: pgmap v16835: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 243 KiB/s wr, 6 op/s 2023-05-08T12:28:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31463.287453 secs 2023-05-08T12:28:44.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31463.843162 secs 2023-05-08T12:28:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:44 smithi133 ceph-mon[125939]: pgmap v16835: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 243 KiB/s wr, 6 op/s 2023-05-08T12:28:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31463.287453 secs 2023-05-08T12:28:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31463.843162 secs 2023-05-08T12:28:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:44 smithi096 ceph-mon[124666]: pgmap v16835: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 243 KiB/s wr, 6 op/s 2023-05-08T12:28:45.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31463.287453 secs 2023-05-08T12:28:45.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31463.843162 secs 2023-05-08T12:28:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:46 smithi186 ceph-mon[126480]: pgmap v16836: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 300 KiB/s wr, 9 op/s 2023-05-08T12:28:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:46 smithi133 ceph-mon[125939]: pgmap v16836: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 300 KiB/s wr, 9 op/s 2023-05-08T12:28:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:46 smithi096 ceph-mon[124666]: pgmap v16836: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 300 KiB/s wr, 9 op/s 2023-05-08T12:28:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:48 smithi186 ceph-mon[126480]: pgmap v16837: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 57 KiB/s wr, 5 op/s 2023-05-08T12:28:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:28:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:48 smithi133 ceph-mon[125939]: pgmap v16837: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 57 KiB/s wr, 5 op/s 2023-05-08T12:28:48.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:28:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:48 smithi096 ceph-mon[124666]: pgmap v16837: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 57 KiB/s wr, 5 op/s 2023-05-08T12:28:49.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:28:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31468.287582 secs 2023-05-08T12:28:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:28:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:28:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:28:49.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31468.843303 secs 2023-05-08T12:28:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31468.287582 secs 2023-05-08T12:28:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:28:49.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:28:49.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:28:49.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31468.843303 secs 2023-05-08T12:28:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31468.287582 secs 2023-05-08T12:28:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:28:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:28:50.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:28:50.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31468.843303 secs 2023-05-08T12:28:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:50 smithi186 ceph-mon[126480]: pgmap v16838: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 120 KiB/s wr, 9 op/s 2023-05-08T12:28:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:50 smithi133 ceph-mon[125939]: pgmap v16838: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 120 KiB/s wr, 9 op/s 2023-05-08T12:28:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:50 smithi096 ceph-mon[124666]: pgmap v16838: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 120 KiB/s wr, 9 op/s 2023-05-08T12:28:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:52 smithi186 ceph-mon[126480]: pgmap v16839: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 120 KiB/s wr, 6 op/s 2023-05-08T12:28:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:52 smithi133 ceph-mon[125939]: pgmap v16839: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 120 KiB/s wr, 6 op/s 2023-05-08T12:28:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:52 smithi096 ceph-mon[124666]: pgmap v16839: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 120 KiB/s wr, 6 op/s 2023-05-08T12:28:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:54 smithi096 ceph-mon[124666]: pgmap v16840: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 120 KiB/s wr, 6 op/s 2023-05-08T12:28:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31473.287697 secs 2023-05-08T12:28:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:54 smithi186 ceph-mon[126480]: pgmap v16840: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 120 KiB/s wr, 6 op/s 2023-05-08T12:28:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31473.287697 secs 2023-05-08T12:28:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:54 smithi133 ceph-mon[125939]: pgmap v16840: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 120 KiB/s wr, 6 op/s 2023-05-08T12:28:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31473.287697 secs 2023-05-08T12:28:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:56 smithi186 ceph-mon[126480]: pgmap v16841: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 737 KiB/s rd, 620 KiB/s wr, 11 op/s 2023-05-08T12:28:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:56 smithi133 ceph-mon[125939]: pgmap v16841: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 737 KiB/s rd, 620 KiB/s wr, 11 op/s 2023-05-08T12:28:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:56 smithi096 ceph-mon[124666]: pgmap v16841: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 737 KiB/s rd, 620 KiB/s wr, 11 op/s 2023-05-08T12:28:57.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:28:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:28:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:28:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:58 smithi186 ceph-mon[126480]: pgmap v16842: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 564 KiB/s wr, 8 op/s 2023-05-08T12:28:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:58 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:28:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:28:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:28:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:58 smithi133 ceph-mon[125939]: pgmap v16842: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 564 KiB/s wr, 8 op/s 2023-05-08T12:28:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:58 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:28:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:28:58.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:28:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:58 smithi096 ceph-mon[124666]: pgmap v16842: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 564 KiB/s wr, 8 op/s 2023-05-08T12:28:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:58 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:28:59.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:28:59.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:28:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:28:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31478.287839 secs 2023-05-08T12:28:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:28:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31478.287839 secs 2023-05-08T12:29:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:28:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31478.287839 secs 2023-05-08T12:29:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:00 smithi186 ceph-mon[126480]: pgmap v16843: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 994 KiB/s wr, 13 op/s 2023-05-08T12:29:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:00 smithi133 ceph-mon[125939]: pgmap v16843: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 994 KiB/s wr, 13 op/s 2023-05-08T12:29:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:00 smithi096 ceph-mon[124666]: pgmap v16843: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 994 KiB/s wr, 13 op/s 2023-05-08T12:29:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:02 smithi186 ceph-mon[126480]: pgmap v16844: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 931 KiB/s wr, 10 op/s 2023-05-08T12:29:02.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:02 smithi133 ceph-mon[125939]: pgmap v16844: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 931 KiB/s wr, 10 op/s 2023-05-08T12:29:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:02 smithi096 ceph-mon[124666]: pgmap v16844: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 931 KiB/s wr, 10 op/s 2023-05-08T12:29:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:04 smithi096 ceph-mon[124666]: pgmap v16845: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 931 KiB/s wr, 10 op/s 2023-05-08T12:29:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31483.287988 secs 2023-05-08T12:29:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31483.843622 secs 2023-05-08T12:29:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:04 smithi186 ceph-mon[126480]: pgmap v16845: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 931 KiB/s wr, 10 op/s 2023-05-08T12:29:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31483.287988 secs 2023-05-08T12:29:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31483.843622 secs 2023-05-08T12:29:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:04 smithi133 ceph-mon[125939]: pgmap v16845: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 931 KiB/s wr, 10 op/s 2023-05-08T12:29:04.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31483.287988 secs 2023-05-08T12:29:04.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31483.843622 secs 2023-05-08T12:29:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:05 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:29:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:29:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:29:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:05 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:29:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:29:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:29:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:05 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:29:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:29:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:29:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:06 smithi186 ceph-mon[126480]: pgmap v16846: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.3 MiB/s wr, 29 op/s 2023-05-08T12:29:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:06 smithi133 ceph-mon[125939]: pgmap v16846: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.3 MiB/s wr, 29 op/s 2023-05-08T12:29:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:06 smithi096 ceph-mon[124666]: pgmap v16846: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.3 MiB/s wr, 29 op/s 2023-05-08T12:29:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:08 smithi186 ceph-mon[126480]: pgmap v16847: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 800 KiB/s wr, 25 op/s 2023-05-08T12:29:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:08 smithi133 ceph-mon[125939]: pgmap v16847: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 800 KiB/s wr, 25 op/s 2023-05-08T12:29:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:08 smithi096 ceph-mon[124666]: pgmap v16847: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 800 KiB/s wr, 25 op/s 2023-05-08T12:29:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31488.288099 secs 2023-05-08T12:29:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31488.288099 secs 2023-05-08T12:29:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31488.288099 secs 2023-05-08T12:29:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:10 smithi186 ceph-mon[126480]: pgmap v16848: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.2 MiB/s wr, 29 op/s 2023-05-08T12:29:10.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:10 smithi133 ceph-mon[125939]: pgmap v16848: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.2 MiB/s wr, 29 op/s 2023-05-08T12:29:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:10 smithi096 ceph-mon[124666]: pgmap v16848: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.2 MiB/s wr, 29 op/s 2023-05-08T12:29:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:11 smithi186 ceph-mon[126480]: osdmap e1130: 12 total, 12 up, 12 in 2023-05-08T12:29:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:11 smithi133 ceph-mon[125939]: osdmap e1130: 12 total, 12 up, 12 in 2023-05-08T12:29:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:11 smithi096 ceph-mon[124666]: osdmap e1130: 12 total, 12 up, 12 in 2023-05-08T12:29:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:12 smithi186 ceph-mon[126480]: pgmap v16850: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 955 KiB/s rd, 913 KiB/s wr, 29 op/s 2023-05-08T12:29:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:12 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:29:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:12 smithi133 ceph-mon[125939]: pgmap v16850: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 955 KiB/s rd, 913 KiB/s wr, 29 op/s 2023-05-08T12:29:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:12 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:29:13.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:12 smithi096 ceph-mon[124666]: pgmap v16850: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 955 KiB/s rd, 913 KiB/s wr, 29 op/s 2023-05-08T12:29:13.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:12 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:29:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:13 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:29:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:29:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:13 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:29:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:13 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:29:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:29:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:13 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:29:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:13 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:29:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:29:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:13 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:29:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:14 smithi186 ceph-mon[126480]: pgmap v16851: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 955 KiB/s rd, 913 KiB/s wr, 29 op/s 2023-05-08T12:29:14.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31493.288213 secs 2023-05-08T12:29:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:14 smithi133 ceph-mon[125939]: pgmap v16851: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 955 KiB/s rd, 913 KiB/s wr, 29 op/s 2023-05-08T12:29:14.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31493.288213 secs 2023-05-08T12:29:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:14 smithi096 ceph-mon[124666]: pgmap v16851: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 955 KiB/s rd, 913 KiB/s wr, 29 op/s 2023-05-08T12:29:15.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31493.288213 secs 2023-05-08T12:29:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:16 smithi186 ceph-mon[126480]: pgmap v16852: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 787 KiB/s wr, 10 op/s 2023-05-08T12:29:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:16 smithi133 ceph-mon[125939]: pgmap v16852: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 787 KiB/s wr, 10 op/s 2023-05-08T12:29:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:16 smithi096 ceph-mon[124666]: pgmap v16852: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 787 KiB/s wr, 10 op/s 2023-05-08T12:29:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:18 smithi186 ceph-mon[126480]: pgmap v16853: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 787 KiB/s wr, 10 op/s 2023-05-08T12:29:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:18 smithi133 ceph-mon[125939]: pgmap v16853: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 787 KiB/s wr, 10 op/s 2023-05-08T12:29:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:18 smithi096 ceph-mon[124666]: pgmap v16853: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 787 KiB/s wr, 10 op/s 2023-05-08T12:29:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31498.288332 secs 2023-05-08T12:29:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31498.288332 secs 2023-05-08T12:29:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31498.288332 secs 2023-05-08T12:29:20.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:20 smithi186 ceph-mon[126480]: pgmap v16854: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 770 KiB/s rd, 343 KiB/s wr, 9 op/s 2023-05-08T12:29:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:20 smithi133 ceph-mon[125939]: pgmap v16854: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 770 KiB/s rd, 343 KiB/s wr, 9 op/s 2023-05-08T12:29:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:20 smithi096 ceph-mon[124666]: pgmap v16854: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 770 KiB/s rd, 343 KiB/s wr, 9 op/s 2023-05-08T12:29:22.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:22 smithi186 ceph-mon[126480]: osdmap e1131: 12 total, 12 up, 12 in 2023-05-08T12:29:22.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:22 smithi186 ceph-mon[126480]: pgmap v16856: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 770 KiB/s rd, 343 KiB/s wr, 9 op/s 2023-05-08T12:29:22.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:22 smithi133 ceph-mon[125939]: osdmap e1131: 12 total, 12 up, 12 in 2023-05-08T12:29:22.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:22 smithi133 ceph-mon[125939]: pgmap v16856: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 770 KiB/s rd, 343 KiB/s wr, 9 op/s 2023-05-08T12:29:22.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:22 smithi096 ceph-mon[124666]: osdmap e1131: 12 total, 12 up, 12 in 2023-05-08T12:29:22.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:22 smithi096 ceph-mon[124666]: pgmap v16856: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 770 KiB/s rd, 343 KiB/s wr, 9 op/s 2023-05-08T12:29:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:29:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:29:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:29:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:24 smithi186 ceph-mon[126480]: pgmap v16857: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 770 KiB/s rd, 343 KiB/s wr, 9 op/s 2023-05-08T12:29:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31503.288364 secs 2023-05-08T12:29:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31503.844082 secs 2023-05-08T12:29:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:29:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:29:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:29:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:24 smithi133 ceph-mon[125939]: pgmap v16857: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 770 KiB/s rd, 343 KiB/s wr, 9 op/s 2023-05-08T12:29:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31503.288364 secs 2023-05-08T12:29:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31503.844082 secs 2023-05-08T12:29:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:29:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:29:24.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:29:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:24 smithi096 ceph-mon[124666]: pgmap v16857: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 770 KiB/s rd, 343 KiB/s wr, 9 op/s 2023-05-08T12:29:25.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31503.288364 secs 2023-05-08T12:29:25.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31503.844082 secs 2023-05-08T12:29:25.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:29:25.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:29:25.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:29:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:25 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:29:25.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:25 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T12:29:25.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:25 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T12:29:25.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:25 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:29:25.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:25 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:29:25.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:25 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:29:25.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:25 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:29:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:25 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:29:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:25 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T12:29:25.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:25 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T12:29:25.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:25 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:29:25.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:25 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:29:25.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:25 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:29:25.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:25 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:29:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:25 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:29:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:25 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T12:29:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:25 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T12:29:26.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:25 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:29:26.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:25 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:29:26.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:25 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:29:26.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:25 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:29:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31505.134521 secs 2023-05-08T12:29:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:26 smithi186 ceph-mon[126480]: pgmap v16858: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 664 KiB/s rd, 544 KiB/s wr, 9 op/s 2023-05-08T12:29:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31505.134521 secs 2023-05-08T12:29:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:26 smithi133 ceph-mon[125939]: pgmap v16858: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 664 KiB/s rd, 544 KiB/s wr, 9 op/s 2023-05-08T12:29:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31505.134521 secs 2023-05-08T12:29:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:26 smithi096 ceph-mon[124666]: pgmap v16858: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 664 KiB/s rd, 544 KiB/s wr, 9 op/s 2023-05-08T12:29:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:28 smithi186 ceph-mon[126480]: pgmap v16859: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 664 KiB/s rd, 544 KiB/s wr, 9 op/s 2023-05-08T12:29:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:28 smithi133 ceph-mon[125939]: pgmap v16859: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 664 KiB/s rd, 544 KiB/s wr, 9 op/s 2023-05-08T12:29:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:28 smithi096 ceph-mon[124666]: pgmap v16859: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 664 KiB/s rd, 544 KiB/s wr, 9 op/s 2023-05-08T12:29:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31508.288426 secs 2023-05-08T12:29:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:29 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:29:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:29 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:29:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31508.844176 secs 2023-05-08T12:29:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31508.288426 secs 2023-05-08T12:29:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:29 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:29:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:29 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:29:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31508.844176 secs 2023-05-08T12:29:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31508.288426 secs 2023-05-08T12:29:30.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:29 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:29:30.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:29 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:29:30.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31508.844176 secs 2023-05-08T12:29:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:30 smithi186 ceph-mon[126480]: pgmap v16860: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 666 KiB/s rd, 687 KiB/s wr, 10 op/s 2023-05-08T12:29:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:30 smithi133 ceph-mon[125939]: pgmap v16860: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 666 KiB/s rd, 687 KiB/s wr, 10 op/s 2023-05-08T12:29:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:30 smithi096 ceph-mon[124666]: pgmap v16860: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 666 KiB/s rd, 687 KiB/s wr, 10 op/s 2023-05-08T12:29:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31510.134631 secs 2023-05-08T12:29:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:31 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:29:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31510.134631 secs 2023-05-08T12:29:31.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:31 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:29:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31510.134631 secs 2023-05-08T12:29:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:31 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:29:32.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:32 smithi186 ceph-mon[126480]: pgmap v16861: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 657 KiB/s rd, 677 KiB/s wr, 10 op/s 2023-05-08T12:29:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:32 smithi133 ceph-mon[125939]: pgmap v16861: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 657 KiB/s rd, 677 KiB/s wr, 10 op/s 2023-05-08T12:29:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:32 smithi096 ceph-mon[124666]: pgmap v16861: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 657 KiB/s rd, 677 KiB/s wr, 10 op/s 2023-05-08T12:29:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:34 smithi186 ceph-mon[126480]: pgmap v16862: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 555 KiB/s rd, 572 KiB/s wr, 8 op/s 2023-05-08T12:29:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31513.288545 secs 2023-05-08T12:29:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31513.844306 secs 2023-05-08T12:29:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:34 smithi133 ceph-mon[125939]: pgmap v16862: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 555 KiB/s rd, 572 KiB/s wr, 8 op/s 2023-05-08T12:29:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31513.288545 secs 2023-05-08T12:29:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31513.844306 secs 2023-05-08T12:29:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:34 smithi096 ceph-mon[124666]: pgmap v16862: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 555 KiB/s rd, 572 KiB/s wr, 8 op/s 2023-05-08T12:29:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31513.288545 secs 2023-05-08T12:29:35.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31513.844306 secs 2023-05-08T12:29:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31515.134768 secs 2023-05-08T12:29:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:36 smithi186 ceph-mon[126480]: pgmap v16863: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 814 KiB/s rd, 933 KiB/s wr, 12 op/s 2023-05-08T12:29:36.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31515.134768 secs 2023-05-08T12:29:36.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:36 smithi133 ceph-mon[125939]: pgmap v16863: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 814 KiB/s rd, 933 KiB/s wr, 12 op/s 2023-05-08T12:29:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31515.134768 secs 2023-05-08T12:29:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:36 smithi096 ceph-mon[124666]: pgmap v16863: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 814 KiB/s rd, 933 KiB/s wr, 12 op/s 2023-05-08T12:29:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:38 smithi186 ceph-mon[126480]: pgmap v16864: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 405 KiB/s rd, 502 KiB/s wr, 8 op/s 2023-05-08T12:29:38.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:38 smithi133 ceph-mon[125939]: pgmap v16864: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 405 KiB/s rd, 502 KiB/s wr, 8 op/s 2023-05-08T12:29:39.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:38 smithi096 ceph-mon[124666]: pgmap v16864: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 405 KiB/s rd, 502 KiB/s wr, 8 op/s 2023-05-08T12:29:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31518.288666 secs 2023-05-08T12:29:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31518.844440 secs 2023-05-08T12:29:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31518.288666 secs 2023-05-08T12:29:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31518.844440 secs 2023-05-08T12:29:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31518.288666 secs 2023-05-08T12:29:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31518.844440 secs 2023-05-08T12:29:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:40 smithi186 ceph-mon[126480]: pgmap v16865: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 528 KiB/s rd, 502 KiB/s wr, 11 op/s 2023-05-08T12:29:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:40 smithi133 ceph-mon[125939]: pgmap v16865: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 528 KiB/s rd, 502 KiB/s wr, 11 op/s 2023-05-08T12:29:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:40 smithi096 ceph-mon[124666]: pgmap v16865: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 528 KiB/s rd, 502 KiB/s wr, 11 op/s 2023-05-08T12:29:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31520.134849 secs 2023-05-08T12:29:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31520.134849 secs 2023-05-08T12:29:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31520.134849 secs 2023-05-08T12:29:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:42 smithi186 ceph-mon[126480]: pgmap v16866: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 362 KiB/s wr, 7 op/s 2023-05-08T12:29:42.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:42 smithi133 ceph-mon[125939]: pgmap v16866: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 362 KiB/s wr, 7 op/s 2023-05-08T12:29:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:42 smithi096 ceph-mon[124666]: pgmap v16866: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 362 KiB/s wr, 7 op/s 2023-05-08T12:29:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:44 smithi186 ceph-mon[126480]: pgmap v16867: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 362 KiB/s wr, 7 op/s 2023-05-08T12:29:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31523.288782 secs 2023-05-08T12:29:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31523.844561 secs 2023-05-08T12:29:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:44 smithi133 ceph-mon[125939]: pgmap v16867: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 362 KiB/s wr, 7 op/s 2023-05-08T12:29:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31523.288782 secs 2023-05-08T12:29:44.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31523.844561 secs 2023-05-08T12:29:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:44 smithi096 ceph-mon[124666]: pgmap v16867: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 362 KiB/s wr, 7 op/s 2023-05-08T12:29:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31523.288782 secs 2023-05-08T12:29:45.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31523.844561 secs 2023-05-08T12:29:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:46 smithi186 ceph-mon[126480]: pgmap v16868: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 666 KiB/s wr, 10 op/s 2023-05-08T12:29:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:46 smithi133 ceph-mon[125939]: pgmap v16868: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 666 KiB/s wr, 10 op/s 2023-05-08T12:29:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:46 smithi096 ceph-mon[124666]: pgmap v16868: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 666 KiB/s wr, 10 op/s 2023-05-08T12:29:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:48 smithi186 ceph-mon[126480]: pgmap v16869: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 305 KiB/s wr, 6 op/s 2023-05-08T12:29:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:29:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:48 smithi133 ceph-mon[125939]: pgmap v16869: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 305 KiB/s wr, 6 op/s 2023-05-08T12:29:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:29:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:48 smithi096 ceph-mon[124666]: pgmap v16869: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 305 KiB/s wr, 6 op/s 2023-05-08T12:29:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:29:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31528.288900 secs 2023-05-08T12:29:49.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:29:49.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:29:49.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:29:49.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31528.844684 secs 2023-05-08T12:29:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31528.288900 secs 2023-05-08T12:29:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:29:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:29:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:29:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31528.844684 secs 2023-05-08T12:29:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31528.288900 secs 2023-05-08T12:29:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:29:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:29:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:29:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31528.844684 secs 2023-05-08T12:29:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:50 smithi133 ceph-mon[125939]: pgmap v16870: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 637 KiB/s rd, 340 KiB/s wr, 10 op/s 2023-05-08T12:29:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:50 smithi096 ceph-mon[124666]: pgmap v16870: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 637 KiB/s rd, 340 KiB/s wr, 10 op/s 2023-05-08T12:29:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:50 smithi186 ceph-mon[126480]: pgmap v16870: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 637 KiB/s rd, 340 KiB/s wr, 10 op/s 2023-05-08T12:29:52.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:52 smithi186 ceph-mon[126480]: pgmap v16871: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 339 KiB/s wr, 6 op/s 2023-05-08T12:29:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:52 smithi133 ceph-mon[125939]: pgmap v16871: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 339 KiB/s wr, 6 op/s 2023-05-08T12:29:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:52 smithi096 ceph-mon[124666]: pgmap v16871: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 339 KiB/s wr, 6 op/s 2023-05-08T12:29:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:54 smithi186 ceph-mon[126480]: pgmap v16872: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 339 KiB/s wr, 6 op/s 2023-05-08T12:29:54.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31533.289019 secs 2023-05-08T12:29:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:54 smithi133 ceph-mon[125939]: pgmap v16872: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 339 KiB/s wr, 6 op/s 2023-05-08T12:29:54.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31533.289019 secs 2023-05-08T12:29:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:54 smithi096 ceph-mon[124666]: pgmap v16872: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 339 KiB/s wr, 6 op/s 2023-05-08T12:29:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31533.289019 secs 2023-05-08T12:29:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:56 smithi186 ceph-mon[126480]: pgmap v16873: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1018 KiB/s rd, 843 KiB/s wr, 11 op/s 2023-05-08T12:29:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:56 smithi133 ceph-mon[125939]: pgmap v16873: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1018 KiB/s rd, 843 KiB/s wr, 11 op/s 2023-05-08T12:29:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:56 smithi096 ceph-mon[124666]: pgmap v16873: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1018 KiB/s rd, 843 KiB/s wr, 11 op/s 2023-05-08T12:29:57.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:29:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:29:58.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:29:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:58 smithi186 ceph-mon[126480]: pgmap v16874: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 712 KiB/s rd, 538 KiB/s wr, 8 op/s 2023-05-08T12:29:58.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:58 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:29:58.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:29:58.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:29:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:58 smithi133 ceph-mon[125939]: pgmap v16874: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 712 KiB/s rd, 538 KiB/s wr, 8 op/s 2023-05-08T12:29:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:58 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:29:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:29:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:29:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:58 smithi096 ceph-mon[124666]: pgmap v16874: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 712 KiB/s rd, 538 KiB/s wr, 8 op/s 2023-05-08T12:29:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:58 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:29:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:29:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:29:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:29:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31538.289179 secs 2023-05-08T12:29:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:29:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31538.289179 secs 2023-05-08T12:30:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:29:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31538.289179 secs 2023-05-08T12:30:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:00 smithi186 ceph-mon[126480]: pgmap v16875: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 971 KiB/s wr, 12 op/s 2023-05-08T12:30:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:00 smithi186 ceph-mon[126480]: overall HEALTH_WARN 1 MDSs report slow requests 2023-05-08T12:30:00.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:00 smithi133 ceph-mon[125939]: pgmap v16875: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 971 KiB/s wr, 12 op/s 2023-05-08T12:30:00.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:00 smithi133 ceph-mon[125939]: overall HEALTH_WARN 1 MDSs report slow requests 2023-05-08T12:30:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:00 smithi096 ceph-mon[124666]: pgmap v16875: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 971 KiB/s wr, 12 op/s 2023-05-08T12:30:01.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:00 smithi096 ceph-mon[124666]: overall HEALTH_WARN 1 MDSs report slow requests 2023-05-08T12:30:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:02 smithi186 ceph-mon[126480]: pgmap v16876: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 937 KiB/s rd, 936 KiB/s wr, 9 op/s 2023-05-08T12:30:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:02 smithi133 ceph-mon[125939]: pgmap v16876: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 937 KiB/s rd, 936 KiB/s wr, 9 op/s 2023-05-08T12:30:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:02 smithi096 ceph-mon[124666]: pgmap v16876: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 937 KiB/s rd, 936 KiB/s wr, 9 op/s 2023-05-08T12:30:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:04 smithi186 ceph-mon[126480]: pgmap v16877: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 937 KiB/s rd, 936 KiB/s wr, 9 op/s 2023-05-08T12:30:04.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31543.289269 secs 2023-05-08T12:30:04.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31543.845014 secs 2023-05-08T12:30:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:04 smithi133 ceph-mon[125939]: pgmap v16877: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 937 KiB/s rd, 936 KiB/s wr, 9 op/s 2023-05-08T12:30:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31543.289269 secs 2023-05-08T12:30:04.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31543.845014 secs 2023-05-08T12:30:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:04 smithi096 ceph-mon[124666]: pgmap v16877: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 937 KiB/s rd, 936 KiB/s wr, 9 op/s 2023-05-08T12:30:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31543.289269 secs 2023-05-08T12:30:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31543.845014 secs 2023-05-08T12:30:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:05 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:30:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:30:05.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:30:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:05 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:30:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:30:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:30:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:05 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:30:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:30:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:30:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:06 smithi186 ceph-mon[126480]: pgmap v16878: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 27 op/s 2023-05-08T12:30:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:06 smithi133 ceph-mon[125939]: pgmap v16878: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 27 op/s 2023-05-08T12:30:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:06 smithi096 ceph-mon[124666]: pgmap v16878: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 27 op/s 2023-05-08T12:30:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:08 smithi186 ceph-mon[126480]: pgmap v16879: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 768 KiB/s rd, 781 KiB/s wr, 22 op/s 2023-05-08T12:30:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:08 smithi133 ceph-mon[125939]: pgmap v16879: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 768 KiB/s rd, 781 KiB/s wr, 22 op/s 2023-05-08T12:30:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:08 smithi096 ceph-mon[124666]: pgmap v16879: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 768 KiB/s rd, 781 KiB/s wr, 22 op/s 2023-05-08T12:30:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31548.289395 secs 2023-05-08T12:30:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31548.845148 secs 2023-05-08T12:30:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31548.289395 secs 2023-05-08T12:30:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31548.845148 secs 2023-05-08T12:30:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31548.289395 secs 2023-05-08T12:30:10.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31548.845148 secs 2023-05-08T12:30:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:10 smithi186 ceph-mon[126480]: pgmap v16880: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 771 KiB/s rd, 783 KiB/s wr, 25 op/s 2023-05-08T12:30:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:10 smithi133 ceph-mon[125939]: pgmap v16880: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 771 KiB/s rd, 783 KiB/s wr, 25 op/s 2023-05-08T12:30:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:10 smithi096 ceph-mon[124666]: pgmap v16880: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 771 KiB/s rd, 783 KiB/s wr, 25 op/s 2023-05-08T12:30:12.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:12 smithi186 ceph-mon[126480]: pgmap v16881: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 350 KiB/s wr, 20 op/s 2023-05-08T12:30:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:12 smithi133 ceph-mon[125939]: pgmap v16881: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 350 KiB/s wr, 20 op/s 2023-05-08T12:30:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:12 smithi096 ceph-mon[124666]: pgmap v16881: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 350 KiB/s wr, 20 op/s 2023-05-08T12:30:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:14 smithi186 ceph-mon[126480]: pgmap v16882: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 350 KiB/s wr, 20 op/s 2023-05-08T12:30:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31553.289522 secs 2023-05-08T12:30:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31553.845270 secs 2023-05-08T12:30:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:14 smithi133 ceph-mon[125939]: pgmap v16882: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 350 KiB/s wr, 20 op/s 2023-05-08T12:30:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31553.289522 secs 2023-05-08T12:30:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31553.845270 secs 2023-05-08T12:30:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:14 smithi096 ceph-mon[124666]: pgmap v16882: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 350 KiB/s wr, 20 op/s 2023-05-08T12:30:15.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31553.289522 secs 2023-05-08T12:30:15.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31553.845270 secs 2023-05-08T12:30:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:16 smithi186 ceph-mon[126480]: pgmap v16883: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 719 KiB/s rd, 730 KiB/s wr, 24 op/s 2023-05-08T12:30:16.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:16 smithi133 ceph-mon[125939]: pgmap v16883: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 719 KiB/s rd, 730 KiB/s wr, 24 op/s 2023-05-08T12:30:17.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:16 smithi096 ceph-mon[124666]: pgmap v16883: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 719 KiB/s rd, 730 KiB/s wr, 24 op/s 2023-05-08T12:30:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:18 smithi186 ceph-mon[126480]: pgmap v16884: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 384 KiB/s rd, 381 KiB/s wr, 7 op/s 2023-05-08T12:30:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:18 smithi133 ceph-mon[125939]: pgmap v16884: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 384 KiB/s rd, 381 KiB/s wr, 7 op/s 2023-05-08T12:30:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:18 smithi096 ceph-mon[124666]: pgmap v16884: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 384 KiB/s rd, 381 KiB/s wr, 7 op/s 2023-05-08T12:30:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31558.289671 secs 2023-05-08T12:30:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31558.845388 secs 2023-05-08T12:30:19.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31558.289671 secs 2023-05-08T12:30:19.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31558.845388 secs 2023-05-08T12:30:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31558.289671 secs 2023-05-08T12:30:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31558.845388 secs 2023-05-08T12:30:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:20 smithi186 ceph-mon[126480]: pgmap v16885: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 382 KiB/s wr, 10 op/s 2023-05-08T12:30:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:20 smithi133 ceph-mon[125939]: pgmap v16885: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 382 KiB/s wr, 10 op/s 2023-05-08T12:30:21.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:20 smithi096 ceph-mon[124666]: pgmap v16885: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 382 KiB/s wr, 10 op/s 2023-05-08T12:30:22.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:22 smithi186 ceph-mon[126480]: pgmap v16886: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 380 KiB/s wr, 6 op/s 2023-05-08T12:30:22.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:22 smithi133 ceph-mon[125939]: pgmap v16886: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 380 KiB/s wr, 6 op/s 2023-05-08T12:30:22.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:22 smithi096 ceph-mon[124666]: pgmap v16886: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 380 KiB/s wr, 6 op/s 2023-05-08T12:30:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:24 smithi186 ceph-mon[126480]: pgmap v16887: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 380 KiB/s wr, 6 op/s 2023-05-08T12:30:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31563.289779 secs 2023-05-08T12:30:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:30:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:24 smithi133 ceph-mon[125939]: pgmap v16887: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 380 KiB/s wr, 6 op/s 2023-05-08T12:30:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31563.289779 secs 2023-05-08T12:30:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:30:25.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:24 smithi096 ceph-mon[124666]: pgmap v16887: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 380 KiB/s wr, 6 op/s 2023-05-08T12:30:25.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31563.289779 secs 2023-05-08T12:30:25.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:30:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:25 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:30:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:25 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:30:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:25 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:30:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:25 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:30:25.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:25 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:30:25.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:25 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:30:25.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:25 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:30:25.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:25 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:30:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:25 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:30:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:25 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:30:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:25 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:30:26.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:25 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:30:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:26 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:30:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:26 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T12:30:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:26 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T12:30:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:26 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:30:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:26 smithi186 ceph-mon[126480]: pgmap v16888: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 793 KiB/s rd, 812 KiB/s wr, 13 op/s 2023-05-08T12:30:26.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:26 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:30:26.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:26 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:30:26.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:26 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:30:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:26 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:30:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:26 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T12:30:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:26 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T12:30:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:26 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:30:26.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:26 smithi133 ceph-mon[125939]: pgmap v16888: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 793 KiB/s rd, 812 KiB/s wr, 13 op/s 2023-05-08T12:30:26.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:26 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:30:26.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:26 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:30:26.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:26 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:30:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:26 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:30:27.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:26 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T12:30:27.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:26 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T12:30:27.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:26 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:30:27.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:26 smithi096 ceph-mon[124666]: pgmap v16888: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 793 KiB/s rd, 812 KiB/s wr, 13 op/s 2023-05-08T12:30:27.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:26 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:30:27.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:26 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:30:27.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:26 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:30:28.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:28 smithi186 ceph-mon[126480]: pgmap v16889: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 432 KiB/s wr, 10 op/s 2023-05-08T12:30:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:28 smithi133 ceph-mon[125939]: pgmap v16889: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 432 KiB/s wr, 10 op/s 2023-05-08T12:30:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:28 smithi096 ceph-mon[124666]: pgmap v16889: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 432 KiB/s wr, 10 op/s 2023-05-08T12:30:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31568.289924 secs 2023-05-08T12:30:29.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31568.289924 secs 2023-05-08T12:30:30.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31568.289924 secs 2023-05-08T12:30:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:30 smithi186 ceph-mon[126480]: pgmap v16890: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 618 KiB/s rd, 500 KiB/s wr, 14 op/s 2023-05-08T12:30:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:30 smithi133 ceph-mon[125939]: pgmap v16890: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 618 KiB/s rd, 500 KiB/s wr, 14 op/s 2023-05-08T12:30:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:30 smithi096 ceph-mon[124666]: pgmap v16890: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 618 KiB/s rd, 500 KiB/s wr, 14 op/s 2023-05-08T12:30:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:31 smithi186 ceph-mon[126480]: osdmap e1132: 12 total, 12 up, 12 in 2023-05-08T12:30:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:31 smithi133 ceph-mon[125939]: osdmap e1132: 12 total, 12 up, 12 in 2023-05-08T12:30:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:31 smithi096 ceph-mon[124666]: osdmap e1132: 12 total, 12 up, 12 in 2023-05-08T12:30:32.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:32 smithi186 ceph-mon[126480]: pgmap v16892: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 740 KiB/s rd, 600 KiB/s wr, 13 op/s 2023-05-08T12:30:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:32 smithi133 ceph-mon[125939]: pgmap v16892: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 740 KiB/s rd, 600 KiB/s wr, 13 op/s 2023-05-08T12:30:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:32 smithi096 ceph-mon[124666]: pgmap v16892: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 740 KiB/s rd, 600 KiB/s wr, 13 op/s 2023-05-08T12:30:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:34 smithi186 ceph-mon[126480]: pgmap v16893: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 740 KiB/s rd, 600 KiB/s wr, 13 op/s 2023-05-08T12:30:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31573.290053 secs 2023-05-08T12:30:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:34 smithi133 ceph-mon[125939]: pgmap v16893: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 740 KiB/s rd, 600 KiB/s wr, 13 op/s 2023-05-08T12:30:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31573.290053 secs 2023-05-08T12:30:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:34 smithi096 ceph-mon[124666]: pgmap v16893: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 740 KiB/s rd, 600 KiB/s wr, 13 op/s 2023-05-08T12:30:35.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31573.290053 secs 2023-05-08T12:30:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:36 smithi186 ceph-mon[126480]: pgmap v16894: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 759 KiB/s rd, 483 KiB/s wr, 10 op/s 2023-05-08T12:30:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:36 smithi133 ceph-mon[125939]: pgmap v16894: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 759 KiB/s rd, 483 KiB/s wr, 10 op/s 2023-05-08T12:30:37.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:36 smithi096 ceph-mon[124666]: pgmap v16894: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 759 KiB/s rd, 483 KiB/s wr, 10 op/s 2023-05-08T12:30:38.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:38 smithi186 ceph-mon[126480]: pgmap v16895: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 759 KiB/s rd, 483 KiB/s wr, 9 op/s 2023-05-08T12:30:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:38 smithi133 ceph-mon[125939]: pgmap v16895: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 759 KiB/s rd, 483 KiB/s wr, 9 op/s 2023-05-08T12:30:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:38 smithi096 ceph-mon[124666]: pgmap v16895: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 759 KiB/s rd, 483 KiB/s wr, 9 op/s 2023-05-08T12:30:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31578.290176 secs 2023-05-08T12:30:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31578.290176 secs 2023-05-08T12:30:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31578.290176 secs 2023-05-08T12:30:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:40 smithi186 ceph-mon[126480]: pgmap v16896: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 857 KiB/s wr, 10 op/s 2023-05-08T12:30:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:40 smithi133 ceph-mon[125939]: pgmap v16896: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 857 KiB/s wr, 10 op/s 2023-05-08T12:30:41.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:40 smithi096 ceph-mon[124666]: pgmap v16896: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 857 KiB/s wr, 10 op/s 2023-05-08T12:30:41.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31580.136143 secs 2023-05-08T12:30:41.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:41 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:30:41.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:41 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:30:41.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:41 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:30:41.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:41 smithi186 ceph-mon[126480]: osdmap e1133: 12 total, 12 up, 12 in 2023-05-08T12:30:41.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31580.136143 secs 2023-05-08T12:30:41.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:41 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:30:41.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:41 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:30:41.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:41 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:30:41.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:41 smithi133 ceph-mon[125939]: osdmap e1133: 12 total, 12 up, 12 in 2023-05-08T12:30:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31580.136143 secs 2023-05-08T12:30:42.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:41 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:30:42.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:41 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:30:42.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:41 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:30:42.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:41 smithi096 ceph-mon[124666]: osdmap e1133: 12 total, 12 up, 12 in 2023-05-08T12:30:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:42 smithi186 ceph-mon[126480]: pgmap v16898: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 857 KiB/s wr, 10 op/s 2023-05-08T12:30:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:42 smithi133 ceph-mon[125939]: pgmap v16898: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 857 KiB/s wr, 10 op/s 2023-05-08T12:30:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:42 smithi096 ceph-mon[124666]: pgmap v16898: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 857 KiB/s wr, 10 op/s 2023-05-08T12:30:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:44 smithi186 ceph-mon[126480]: pgmap v16899: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 857 KiB/s wr, 10 op/s 2023-05-08T12:30:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31583.290278 secs 2023-05-08T12:30:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31583.845867 secs 2023-05-08T12:30:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:44 smithi133 ceph-mon[125939]: pgmap v16899: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 857 KiB/s wr, 10 op/s 2023-05-08T12:30:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31583.290278 secs 2023-05-08T12:30:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31583.845867 secs 2023-05-08T12:30:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:44 smithi096 ceph-mon[124666]: pgmap v16899: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 857 KiB/s wr, 10 op/s 2023-05-08T12:30:45.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31583.290278 secs 2023-05-08T12:30:45.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31583.845867 secs 2023-05-08T12:30:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:45 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:30:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:45 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:30:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:45 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:30:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:45 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:30:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:45 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:30:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:45 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:30:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:46 smithi186 ceph-mon[126480]: pgmap v16900: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T12:30:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:46 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:30:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:46 smithi133 ceph-mon[125939]: pgmap v16900: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T12:30:46.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:46 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:30:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:46 smithi096 ceph-mon[124666]: pgmap v16900: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T12:30:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:46 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:30:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:48 smithi186 ceph-mon[126480]: pgmap v16901: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T12:30:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:30:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:48 smithi133 ceph-mon[125939]: pgmap v16901: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T12:30:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:30:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:48 smithi096 ceph-mon[124666]: pgmap v16901: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T12:30:49.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:30:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31588.290424 secs 2023-05-08T12:30:49.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:30:49.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:30:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31588.290424 secs 2023-05-08T12:30:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:30:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:30:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31588.290424 secs 2023-05-08T12:30:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:30:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:30:50.874 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:50 smithi186 ceph-mon[126480]: pgmap v16902: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.9 MiB/s wr, 16 op/s 2023-05-08T12:30:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:50 smithi133 ceph-mon[125939]: pgmap v16902: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.9 MiB/s wr, 16 op/s 2023-05-08T12:30:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:50 smithi096 ceph-mon[124666]: pgmap v16902: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.9 MiB/s wr, 16 op/s 2023-05-08T12:30:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:51 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:30:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:51 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:30:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:51 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:30:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:52 smithi186 ceph-mon[126480]: pgmap v16903: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.9 MiB/s wr, 16 op/s 2023-05-08T12:30:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:30:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:52 smithi133 ceph-mon[125939]: pgmap v16903: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.9 MiB/s wr, 16 op/s 2023-05-08T12:30:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:30:53.011 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:52 smithi096 ceph-mon[124666]: pgmap v16903: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.9 MiB/s wr, 16 op/s 2023-05-08T12:30:53.012 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:30:54.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:54 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:30:54.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:54 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:30:54.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:54 smithi186 ceph-mon[126480]: pgmap v16904: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.6 MiB/s wr, 13 op/s 2023-05-08T12:30:54.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31593.846106 secs 2023-05-08T12:30:54.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:54 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:30:54.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:54 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:30:54.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:54 smithi133 ceph-mon[125939]: pgmap v16904: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.6 MiB/s wr, 13 op/s 2023-05-08T12:30:54.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31593.846106 secs 2023-05-08T12:30:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:54 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:30:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:54 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:30:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:54 smithi096 ceph-mon[124666]: pgmap v16904: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.6 MiB/s wr, 13 op/s 2023-05-08T12:30:54.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31593.846106 secs 2023-05-08T12:30:55.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:55 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:30:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:55 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:30:55.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:55 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:30:56.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:56 smithi186 ceph-mon[126480]: Health check cleared: MDS_SLOW_REQUEST (was: 1 MDSs report slow requests) 2023-05-08T12:30:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:56 smithi186 ceph-mon[126480]: Cluster is now healthy 2023-05-08T12:30:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T12:30:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:30:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:56 smithi186 ceph-mon[126480]: pgmap v16905: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.7 MiB/s wr, 19 op/s 2023-05-08T12:30:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:56 smithi133 ceph-mon[125939]: Health check cleared: MDS_SLOW_REQUEST (was: 1 MDSs report slow requests) 2023-05-08T12:30:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:56 smithi133 ceph-mon[125939]: Cluster is now healthy 2023-05-08T12:30:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T12:30:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:30:56.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:56 smithi133 ceph-mon[125939]: pgmap v16905: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.7 MiB/s wr, 19 op/s 2023-05-08T12:30:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:56 smithi096 ceph-mon[124666]: Health check cleared: MDS_SLOW_REQUEST (was: 1 MDSs report slow requests) 2023-05-08T12:30:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:56 smithi096 ceph-mon[124666]: Cluster is now healthy 2023-05-08T12:30:56.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T12:30:56.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:30:56.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:56 smithi096 ceph-mon[124666]: pgmap v16905: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.7 MiB/s wr, 19 op/s 2023-05-08T12:30:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:57 smithi133 ceph-mon[125939]: Health check failed: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:30:57.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:30:57.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:30:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:57 smithi096 ceph-mon[124666]: Health check failed: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:30:57.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:30:57.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:30:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:57 smithi186 ceph-mon[126480]: Health check failed: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:30:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:30:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:30:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:30:58 smithi133 ceph-mon[125939]: pgmap v16906: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T12:30:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:30:58 smithi096 ceph-mon[124666]: pgmap v16906: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T12:30:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:30:58 smithi186 ceph-mon[126480]: pgmap v16906: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T12:31:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:00 smithi186 ceph-mon[126480]: pgmap v16907: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.0 MiB/s wr, 17 op/s 2023-05-08T12:31:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:00 smithi133 ceph-mon[125939]: pgmap v16907: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.0 MiB/s wr, 17 op/s 2023-05-08T12:31:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:00 smithi096 ceph-mon[124666]: pgmap v16907: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.0 MiB/s wr, 17 op/s 2023-05-08T12:31:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31600.136625 secs 2023-05-08T12:31:01.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:31:01.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:31:01.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:01 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:31:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31600.136625 secs 2023-05-08T12:31:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:31:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:31:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:01 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:31:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31600.136625 secs 2023-05-08T12:31:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:31:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:31:02.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:01 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:31:02.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:02 smithi186 ceph-mon[126480]: pgmap v16908: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 353 KiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T12:31:02.979 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:31:02.980 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:31:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:02 smithi133 ceph-mon[125939]: pgmap v16908: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 353 KiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T12:31:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:31:02.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:31:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:02 smithi096 ceph-mon[124666]: pgmap v16908: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 353 KiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T12:31:03.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:31:03.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:31:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:04 smithi186 ceph-mon[126480]: pgmap v16909: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 353 KiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T12:31:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31603.290730 secs 2023-05-08T12:31:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31603.846344 secs 2023-05-08T12:31:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:04 smithi133 ceph-mon[125939]: pgmap v16909: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 353 KiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T12:31:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31603.290730 secs 2023-05-08T12:31:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31603.846344 secs 2023-05-08T12:31:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:04 smithi096 ceph-mon[124666]: pgmap v16909: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 353 KiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T12:31:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31603.290730 secs 2023-05-08T12:31:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31603.846344 secs 2023-05-08T12:31:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:05 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:31:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:31:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:31:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:05 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:31:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:31:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:31:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:05 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:31:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:31:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:31:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31605.136745 secs 2023-05-08T12:31:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:06 smithi186 ceph-mon[126480]: pgmap v16910: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 30 op/s 2023-05-08T12:31:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:06 smithi186 ceph-mon[126480]: osdmap e1134: 12 total, 12 up, 12 in 2023-05-08T12:31:06.997 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31605.136745 secs 2023-05-08T12:31:06.998 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:06 smithi133 ceph-mon[125939]: pgmap v16910: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 30 op/s 2023-05-08T12:31:06.998 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:06 smithi133 ceph-mon[125939]: osdmap e1134: 12 total, 12 up, 12 in 2023-05-08T12:31:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31605.136745 secs 2023-05-08T12:31:07.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:06 smithi096 ceph-mon[124666]: pgmap v16910: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 30 op/s 2023-05-08T12:31:07.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:06 smithi096 ceph-mon[124666]: osdmap e1134: 12 total, 12 up, 12 in 2023-05-08T12:31:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:08 smithi186 ceph-mon[126480]: pgmap v16912: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 28 op/s 2023-05-08T12:31:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T12:31:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:31:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:08 smithi133 ceph-mon[125939]: pgmap v16912: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 28 op/s 2023-05-08T12:31:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T12:31:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:31:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:08 smithi096 ceph-mon[124666]: pgmap v16912: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 28 op/s 2023-05-08T12:31:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T12:31:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:31:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31608.290857 secs 2023-05-08T12:31:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31608.846483 secs 2023-05-08T12:31:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31608.290857 secs 2023-05-08T12:31:09.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31608.846483 secs 2023-05-08T12:31:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31608.290857 secs 2023-05-08T12:31:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31608.846483 secs 2023-05-08T12:31:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:10 smithi186 ceph-mon[126480]: pgmap v16913: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 605 KiB/s wr, 27 op/s 2023-05-08T12:31:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:10 smithi133 ceph-mon[125939]: pgmap v16913: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 605 KiB/s wr, 27 op/s 2023-05-08T12:31:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:10 smithi096 ceph-mon[124666]: pgmap v16913: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 605 KiB/s wr, 27 op/s 2023-05-08T12:31:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31610.136875 secs 2023-05-08T12:31:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:11 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:31:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31610.136875 secs 2023-05-08T12:31:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:11 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:31:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31610.136875 secs 2023-05-08T12:31:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:11 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:31:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:12 smithi186 ceph-mon[126480]: pgmap v16914: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 605 KiB/s wr, 27 op/s 2023-05-08T12:31:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:12 smithi133 ceph-mon[125939]: pgmap v16914: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 605 KiB/s wr, 27 op/s 2023-05-08T12:31:13.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:12 smithi096 ceph-mon[124666]: pgmap v16914: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 605 KiB/s wr, 27 op/s 2023-05-08T12:31:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:14 smithi186 ceph-mon[126480]: pgmap v16915: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 605 KiB/s wr, 27 op/s 2023-05-08T12:31:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31613.290961 secs 2023-05-08T12:31:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31613.846599 secs 2023-05-08T12:31:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:14 smithi133 ceph-mon[125939]: pgmap v16915: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 605 KiB/s wr, 27 op/s 2023-05-08T12:31:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31613.290961 secs 2023-05-08T12:31:14.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31613.846599 secs 2023-05-08T12:31:15.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:14 smithi096 ceph-mon[124666]: pgmap v16915: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 605 KiB/s wr, 27 op/s 2023-05-08T12:31:15.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31613.290961 secs 2023-05-08T12:31:15.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31613.846599 secs 2023-05-08T12:31:16.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31615.136996 secs 2023-05-08T12:31:16.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:16 smithi186 ceph-mon[126480]: pgmap v16916: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 315 KiB/s wr, 8 op/s 2023-05-08T12:31:16.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:16 smithi186 ceph-mon[126480]: osdmap e1135: 12 total, 12 up, 12 in 2023-05-08T12:31:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31615.136996 secs 2023-05-08T12:31:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:16 smithi133 ceph-mon[125939]: pgmap v16916: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 315 KiB/s wr, 8 op/s 2023-05-08T12:31:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:16 smithi133 ceph-mon[125939]: osdmap e1135: 12 total, 12 up, 12 in 2023-05-08T12:31:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31615.136996 secs 2023-05-08T12:31:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:16 smithi096 ceph-mon[124666]: pgmap v16916: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 315 KiB/s wr, 8 op/s 2023-05-08T12:31:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:16 smithi096 ceph-mon[124666]: osdmap e1135: 12 total, 12 up, 12 in 2023-05-08T12:31:18.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:18 smithi186 ceph-mon[126480]: pgmap v16918: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 315 KiB/s wr, 8 op/s 2023-05-08T12:31:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:18 smithi133 ceph-mon[125939]: pgmap v16918: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 315 KiB/s wr, 8 op/s 2023-05-08T12:31:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:18 smithi096 ceph-mon[124666]: pgmap v16918: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 315 KiB/s wr, 8 op/s 2023-05-08T12:31:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31618.291081 secs 2023-05-08T12:31:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31618.846716 secs 2023-05-08T12:31:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31618.291081 secs 2023-05-08T12:31:19.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31618.846716 secs 2023-05-08T12:31:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31618.291081 secs 2023-05-08T12:31:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31618.846716 secs 2023-05-08T12:31:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:20 smithi186 ceph-mon[126480]: pgmap v16919: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 192 KiB/s wr, 8 op/s 2023-05-08T12:31:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:20 smithi133 ceph-mon[125939]: pgmap v16919: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 192 KiB/s wr, 8 op/s 2023-05-08T12:31:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:20 smithi096 ceph-mon[124666]: pgmap v16919: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 192 KiB/s wr, 8 op/s 2023-05-08T12:31:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31620.137107 secs 2023-05-08T12:31:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31620.137107 secs 2023-05-08T12:31:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31620.137107 secs 2023-05-08T12:31:22.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:22 smithi186 ceph-mon[126480]: pgmap v16920: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 192 KiB/s wr, 8 op/s 2023-05-08T12:31:22.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:22 smithi133 ceph-mon[125939]: pgmap v16920: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 192 KiB/s wr, 8 op/s 2023-05-08T12:31:23.010 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:22 smithi096 ceph-mon[124666]: pgmap v16920: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 192 KiB/s wr, 8 op/s 2023-05-08T12:31:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:24 smithi133 ceph-mon[125939]: pgmap v16921: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 192 KiB/s wr, 8 op/s 2023-05-08T12:31:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31623.291176 secs 2023-05-08T12:31:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31623.846831 secs 2023-05-08T12:31:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:24 smithi096 ceph-mon[124666]: pgmap v16921: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 192 KiB/s wr, 8 op/s 2023-05-08T12:31:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31623.291176 secs 2023-05-08T12:31:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31623.846831 secs 2023-05-08T12:31:25.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:24 smithi186 ceph-mon[126480]: pgmap v16921: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 192 KiB/s wr, 8 op/s 2023-05-08T12:31:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31623.291176 secs 2023-05-08T12:31:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31623.846831 secs 2023-05-08T12:31:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:25 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:31:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31625.137205 secs 2023-05-08T12:31:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:25 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:31:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31625.137205 secs 2023-05-08T12:31:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:25 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:31:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31625.137205 secs 2023-05-08T12:31:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:26 smithi133 ceph-mon[125939]: pgmap v16922: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 193 KiB/s wr, 9 op/s 2023-05-08T12:31:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:31:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:31:26.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:31:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:26 smithi096 ceph-mon[124666]: pgmap v16922: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 193 KiB/s wr, 9 op/s 2023-05-08T12:31:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:31:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:31:27.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:31:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:26 smithi186 ceph-mon[126480]: pgmap v16922: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 193 KiB/s wr, 9 op/s 2023-05-08T12:31:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:31:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:31:27.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:31:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:27 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:31:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:27 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T12:31:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:27 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T12:31:27.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:27 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:31:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:27 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:31:28.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:27 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T12:31:28.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:27 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T12:31:28.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:27 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:31:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:27 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:31:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:27 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T12:31:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:27 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T12:31:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:27 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:31:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:28 smithi133 ceph-mon[125939]: pgmap v16923: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 173 KiB/s wr, 8 op/s 2023-05-08T12:31:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:28 smithi096 ceph-mon[124666]: pgmap v16923: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 173 KiB/s wr, 8 op/s 2023-05-08T12:31:29.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:28 smithi186 ceph-mon[126480]: pgmap v16923: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 173 KiB/s wr, 8 op/s 2023-05-08T12:31:29.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31628.291282 secs 2023-05-08T12:31:29.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31628.846937 secs 2023-05-08T12:31:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31628.291282 secs 2023-05-08T12:31:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31628.846937 secs 2023-05-08T12:31:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31628.291282 secs 2023-05-08T12:31:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31628.846937 secs 2023-05-08T12:31:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:30 smithi133 ceph-mon[125939]: pgmap v16924: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 407 KiB/s wr, 11 op/s 2023-05-08T12:31:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31630.137317 secs 2023-05-08T12:31:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:30 smithi096 ceph-mon[124666]: pgmap v16924: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 407 KiB/s wr, 11 op/s 2023-05-08T12:31:31.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31630.137317 secs 2023-05-08T12:31:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:30 smithi186 ceph-mon[126480]: pgmap v16924: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 407 KiB/s wr, 11 op/s 2023-05-08T12:31:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31630.137317 secs 2023-05-08T12:31:32.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:32 smithi186 ceph-mon[126480]: pgmap v16925: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 247 KiB/s wr, 7 op/s 2023-05-08T12:31:32.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:32 smithi133 ceph-mon[125939]: pgmap v16925: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 247 KiB/s wr, 7 op/s 2023-05-08T12:31:32.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:32 smithi096 ceph-mon[124666]: pgmap v16925: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 247 KiB/s wr, 7 op/s 2023-05-08T12:31:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:34 smithi186 ceph-mon[126480]: pgmap v16926: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 247 KiB/s wr, 7 op/s 2023-05-08T12:31:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31633.291350 secs 2023-05-08T12:31:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31633.847045 secs 2023-05-08T12:31:34.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:34 smithi133 ceph-mon[125939]: pgmap v16926: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 247 KiB/s wr, 7 op/s 2023-05-08T12:31:34.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31633.291350 secs 2023-05-08T12:31:34.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31633.847045 secs 2023-05-08T12:31:35.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:34 smithi096 ceph-mon[124666]: pgmap v16926: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 247 KiB/s wr, 7 op/s 2023-05-08T12:31:35.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31633.291350 secs 2023-05-08T12:31:35.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31633.847045 secs 2023-05-08T12:31:36.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31635.137455 secs 2023-05-08T12:31:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:36 smithi186 ceph-mon[126480]: pgmap v16927: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 389 KiB/s rd, 247 KiB/s wr, 11 op/s 2023-05-08T12:31:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31635.137455 secs 2023-05-08T12:31:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:36 smithi133 ceph-mon[125939]: pgmap v16927: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 389 KiB/s rd, 247 KiB/s wr, 11 op/s 2023-05-08T12:31:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31635.137455 secs 2023-05-08T12:31:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:36 smithi096 ceph-mon[124666]: pgmap v16927: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 389 KiB/s rd, 247 KiB/s wr, 11 op/s 2023-05-08T12:31:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:38 smithi186 ceph-mon[126480]: pgmap v16928: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 246 KiB/s wr, 7 op/s 2023-05-08T12:31:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:38 smithi133 ceph-mon[125939]: pgmap v16928: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 246 KiB/s wr, 7 op/s 2023-05-08T12:31:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:38 smithi096 ceph-mon[124666]: pgmap v16928: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 246 KiB/s wr, 7 op/s 2023-05-08T12:31:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31638.291463 secs 2023-05-08T12:31:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31638.847160 secs 2023-05-08T12:31:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31638.291463 secs 2023-05-08T12:31:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31638.847160 secs 2023-05-08T12:31:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31638.291463 secs 2023-05-08T12:31:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31638.847160 secs 2023-05-08T12:31:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:40 smithi186 ceph-mon[126480]: pgmap v16929: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 492 KiB/s wr, 10 op/s 2023-05-08T12:31:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:40 smithi133 ceph-mon[125939]: pgmap v16929: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 492 KiB/s wr, 10 op/s 2023-05-08T12:31:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:40 smithi096 ceph-mon[124666]: pgmap v16929: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 492 KiB/s wr, 10 op/s 2023-05-08T12:31:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31640.137612 secs 2023-05-08T12:31:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31640.137612 secs 2023-05-08T12:31:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31640.137612 secs 2023-05-08T12:31:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:42 smithi186 ceph-mon[126480]: pgmap v16930: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 246 KiB/s wr, 6 op/s 2023-05-08T12:31:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:42 smithi133 ceph-mon[125939]: pgmap v16930: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 246 KiB/s wr, 6 op/s 2023-05-08T12:31:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:42 smithi096 ceph-mon[124666]: pgmap v16930: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 246 KiB/s wr, 6 op/s 2023-05-08T12:31:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:44 smithi186 ceph-mon[126480]: pgmap v16931: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 246 KiB/s wr, 6 op/s 2023-05-08T12:31:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31643.291605 secs 2023-05-08T12:31:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31643.847281 secs 2023-05-08T12:31:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:44 smithi133 ceph-mon[125939]: pgmap v16931: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 246 KiB/s wr, 6 op/s 2023-05-08T12:31:44.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31643.291605 secs 2023-05-08T12:31:44.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31643.847281 secs 2023-05-08T12:31:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:44 smithi096 ceph-mon[124666]: pgmap v16931: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 246 KiB/s wr, 6 op/s 2023-05-08T12:31:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31643.291605 secs 2023-05-08T12:31:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31643.847281 secs 2023-05-08T12:31:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:46 smithi186 ceph-mon[126480]: pgmap v16932: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 581 KiB/s rd, 332 KiB/s wr, 10 op/s 2023-05-08T12:31:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:46 smithi133 ceph-mon[125939]: pgmap v16932: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 581 KiB/s rd, 332 KiB/s wr, 10 op/s 2023-05-08T12:31:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:46 smithi096 ceph-mon[124666]: pgmap v16932: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 581 KiB/s rd, 332 KiB/s wr, 10 op/s 2023-05-08T12:31:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:48 smithi186 ceph-mon[126480]: pgmap v16933: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 332 KiB/s wr, 6 op/s 2023-05-08T12:31:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:31:48.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:48 smithi133 ceph-mon[125939]: pgmap v16933: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 332 KiB/s wr, 6 op/s 2023-05-08T12:31:48.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:31:49.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:48 smithi096 ceph-mon[124666]: pgmap v16933: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 332 KiB/s wr, 6 op/s 2023-05-08T12:31:49.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:31:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31648.291732 secs 2023-05-08T12:31:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:31:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:31:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:31:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31648.847401 secs 2023-05-08T12:31:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31648.291732 secs 2023-05-08T12:31:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:31:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:31:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:31:49.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31648.847401 secs 2023-05-08T12:31:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31648.291732 secs 2023-05-08T12:31:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:31:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:31:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:31:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31648.847401 secs 2023-05-08T12:31:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:50 smithi186 ceph-mon[126480]: pgmap v16934: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 772 KiB/s rd, 511 KiB/s wr, 10 op/s 2023-05-08T12:31:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:50 smithi133 ceph-mon[125939]: pgmap v16934: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 772 KiB/s rd, 511 KiB/s wr, 10 op/s 2023-05-08T12:31:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:50 smithi096 ceph-mon[124666]: pgmap v16934: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 772 KiB/s rd, 511 KiB/s wr, 10 op/s 2023-05-08T12:31:52.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:52 smithi186 ceph-mon[126480]: pgmap v16935: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 770 KiB/s rd, 266 KiB/s wr, 7 op/s 2023-05-08T12:31:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:52 smithi133 ceph-mon[125939]: pgmap v16935: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 770 KiB/s rd, 266 KiB/s wr, 7 op/s 2023-05-08T12:31:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:52 smithi096 ceph-mon[124666]: pgmap v16935: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 770 KiB/s rd, 266 KiB/s wr, 7 op/s 2023-05-08T12:31:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:54 smithi186 ceph-mon[126480]: pgmap v16936: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 771 KiB/s rd, 266 KiB/s wr, 7 op/s 2023-05-08T12:31:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31653.291827 secs 2023-05-08T12:31:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:54 smithi133 ceph-mon[125939]: pgmap v16936: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 771 KiB/s rd, 266 KiB/s wr, 7 op/s 2023-05-08T12:31:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31653.291827 secs 2023-05-08T12:31:55.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:54 smithi096 ceph-mon[124666]: pgmap v16936: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 771 KiB/s rd, 266 KiB/s wr, 7 op/s 2023-05-08T12:31:55.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31653.291827 secs 2023-05-08T12:31:56.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:56 smithi186 ceph-mon[126480]: pgmap v16937: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 670 KiB/s wr, 12 op/s 2023-05-08T12:31:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:31:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:56 smithi133 ceph-mon[125939]: pgmap v16937: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 670 KiB/s wr, 12 op/s 2023-05-08T12:31:56.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:31:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:56 smithi096 ceph-mon[124666]: pgmap v16937: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 670 KiB/s wr, 12 op/s 2023-05-08T12:31:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:31:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:57 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:31:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:31:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:31:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:57 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:31:57.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:31:57.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:31:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:57 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:31:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:31:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:31:58.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:58 smithi186 ceph-mon[126480]: pgmap v16938: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 843 KiB/s rd, 583 KiB/s wr, 8 op/s 2023-05-08T12:31:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:58 smithi133 ceph-mon[125939]: pgmap v16938: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 843 KiB/s rd, 583 KiB/s wr, 8 op/s 2023-05-08T12:31:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:58 smithi096 ceph-mon[124666]: pgmap v16938: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 843 KiB/s rd, 583 KiB/s wr, 8 op/s 2023-05-08T12:31:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:31:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31658.291942 secs 2023-05-08T12:31:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:31:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31658.291942 secs 2023-05-08T12:32:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:31:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31658.291942 secs 2023-05-08T12:32:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:00 smithi186 ceph-mon[126480]: pgmap v16939: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 14 op/s 2023-05-08T12:32:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:00 smithi133 ceph-mon[125939]: pgmap v16939: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 14 op/s 2023-05-08T12:32:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:00 smithi096 ceph-mon[124666]: pgmap v16939: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 14 op/s 2023-05-08T12:32:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:02 smithi186 ceph-mon[126480]: pgmap v16940: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 861 KiB/s wr, 10 op/s 2023-05-08T12:32:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:02 smithi133 ceph-mon[125939]: pgmap v16940: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 861 KiB/s wr, 10 op/s 2023-05-08T12:32:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:02 smithi096 ceph-mon[124666]: pgmap v16940: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 861 KiB/s wr, 10 op/s 2023-05-08T12:32:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:04 smithi186 ceph-mon[126480]: pgmap v16941: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 861 KiB/s wr, 10 op/s 2023-05-08T12:32:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31663.292067 secs 2023-05-08T12:32:04.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31663.847764 secs 2023-05-08T12:32:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:04 smithi133 ceph-mon[125939]: pgmap v16941: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 861 KiB/s wr, 10 op/s 2023-05-08T12:32:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31663.292067 secs 2023-05-08T12:32:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31663.847764 secs 2023-05-08T12:32:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:04 smithi096 ceph-mon[124666]: pgmap v16941: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 861 KiB/s wr, 10 op/s 2023-05-08T12:32:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31663.292067 secs 2023-05-08T12:32:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31663.847764 secs 2023-05-08T12:32:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:05 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:32:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:32:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:32:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:05 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:32:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:32:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:32:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:05 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:32:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:32:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:32:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:06 smithi186 ceph-mon[126480]: pgmap v16942: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 28 op/s 2023-05-08T12:32:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:06 smithi133 ceph-mon[125939]: pgmap v16942: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 28 op/s 2023-05-08T12:32:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:06 smithi096 ceph-mon[124666]: pgmap v16942: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 28 op/s 2023-05-08T12:32:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:08 smithi186 ceph-mon[126480]: pgmap v16943: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 786 KiB/s rd, 788 KiB/s wr, 23 op/s 2023-05-08T12:32:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:08 smithi133 ceph-mon[125939]: pgmap v16943: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 786 KiB/s rd, 788 KiB/s wr, 23 op/s 2023-05-08T12:32:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:08 smithi096 ceph-mon[124666]: pgmap v16943: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 786 KiB/s rd, 788 KiB/s wr, 23 op/s 2023-05-08T12:32:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31668.292185 secs 2023-05-08T12:32:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31668.847917 secs 2023-05-08T12:32:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31668.292185 secs 2023-05-08T12:32:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31668.847917 secs 2023-05-08T12:32:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31668.292185 secs 2023-05-08T12:32:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31668.847917 secs 2023-05-08T12:32:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:10 smithi186 ceph-mon[126480]: pgmap v16944: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 887 KiB/s rd, 888 KiB/s wr, 28 op/s 2023-05-08T12:32:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:10 smithi133 ceph-mon[125939]: pgmap v16944: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 887 KiB/s rd, 888 KiB/s wr, 28 op/s 2023-05-08T12:32:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:10 smithi096 ceph-mon[124666]: pgmap v16944: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 887 KiB/s rd, 888 KiB/s wr, 28 op/s 2023-05-08T12:32:12.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:12 smithi186 ceph-mon[126480]: pgmap v16945: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 691 KiB/s rd, 431 KiB/s wr, 22 op/s 2023-05-08T12:32:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:12 smithi133 ceph-mon[125939]: pgmap v16945: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 691 KiB/s rd, 431 KiB/s wr, 22 op/s 2023-05-08T12:32:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:12 smithi096 ceph-mon[124666]: pgmap v16945: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 691 KiB/s rd, 431 KiB/s wr, 22 op/s 2023-05-08T12:32:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:14 smithi186 ceph-mon[126480]: pgmap v16946: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 691 KiB/s rd, 431 KiB/s wr, 22 op/s 2023-05-08T12:32:14.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31673.292319 secs 2023-05-08T12:32:14.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31673.848041 secs 2023-05-08T12:32:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:14 smithi133 ceph-mon[125939]: pgmap v16946: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 691 KiB/s rd, 431 KiB/s wr, 22 op/s 2023-05-08T12:32:14.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31673.292319 secs 2023-05-08T12:32:14.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31673.848041 secs 2023-05-08T12:32:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:14 smithi096 ceph-mon[124666]: pgmap v16946: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 691 KiB/s rd, 431 KiB/s wr, 22 op/s 2023-05-08T12:32:15.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31673.292319 secs 2023-05-08T12:32:15.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31673.848041 secs 2023-05-08T12:32:16.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:16 smithi186 ceph-mon[126480]: pgmap v16947: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 935 KiB/s rd, 792 KiB/s wr, 26 op/s 2023-05-08T12:32:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:16 smithi133 ceph-mon[125939]: pgmap v16947: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 935 KiB/s rd, 792 KiB/s wr, 26 op/s 2023-05-08T12:32:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:16 smithi096 ceph-mon[124666]: pgmap v16947: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 935 KiB/s rd, 792 KiB/s wr, 26 op/s 2023-05-08T12:32:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:18 smithi186 ceph-mon[126480]: pgmap v16948: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 462 KiB/s wr, 8 op/s 2023-05-08T12:32:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:18 smithi133 ceph-mon[125939]: pgmap v16948: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 462 KiB/s wr, 8 op/s 2023-05-08T12:32:19.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:18 smithi096 ceph-mon[124666]: pgmap v16948: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 462 KiB/s wr, 8 op/s 2023-05-08T12:32:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31678.292434 secs 2023-05-08T12:32:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31678.848154 secs 2023-05-08T12:32:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31678.292434 secs 2023-05-08T12:32:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31678.848154 secs 2023-05-08T12:32:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31678.292434 secs 2023-05-08T12:32:20.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31678.848154 secs 2023-05-08T12:32:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:20 smithi186 ceph-mon[126480]: pgmap v16949: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 465 KiB/s rd, 462 KiB/s wr, 11 op/s 2023-05-08T12:32:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:20 smithi133 ceph-mon[125939]: pgmap v16949: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 465 KiB/s rd, 462 KiB/s wr, 11 op/s 2023-05-08T12:32:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:20 smithi096 ceph-mon[124666]: pgmap v16949: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 465 KiB/s rd, 462 KiB/s wr, 11 op/s 2023-05-08T12:32:22.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:22 smithi186 ceph-mon[126480]: pgmap v16950: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 362 KiB/s wr, 6 op/s 2023-05-08T12:32:22.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:22 smithi133 ceph-mon[125939]: pgmap v16950: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 362 KiB/s wr, 6 op/s 2023-05-08T12:32:22.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:22 smithi096 ceph-mon[124666]: pgmap v16950: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 362 KiB/s wr, 6 op/s 2023-05-08T12:32:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:24 smithi186 ceph-mon[126480]: pgmap v16951: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 362 KiB/s wr, 6 op/s 2023-05-08T12:32:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31683.292567 secs 2023-05-08T12:32:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:24 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:32:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:24 smithi133 ceph-mon[125939]: pgmap v16951: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 362 KiB/s wr, 6 op/s 2023-05-08T12:32:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31683.292567 secs 2023-05-08T12:32:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:24 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:32:25.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:24 smithi096 ceph-mon[124666]: pgmap v16951: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 362 KiB/s wr, 6 op/s 2023-05-08T12:32:25.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31683.292567 secs 2023-05-08T12:32:25.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:24 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:32:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:25 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:32:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:25 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:32:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:25 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:32:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:25 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:32:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:25 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:32:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:25 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:32:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:25 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:32:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:25 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:32:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:25 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:32:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:26 smithi186 ceph-mon[126480]: pgmap v16952: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 902 KiB/s rd, 921 KiB/s wr, 14 op/s 2023-05-08T12:32:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:32:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:32:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:32:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:32:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:26 smithi133 ceph-mon[125939]: pgmap v16952: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 902 KiB/s rd, 921 KiB/s wr, 14 op/s 2023-05-08T12:32:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:32:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:32:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:32:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:32:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:26 smithi096 ceph-mon[124666]: pgmap v16952: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 902 KiB/s rd, 921 KiB/s wr, 14 op/s 2023-05-08T12:32:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:32:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:32:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:32:27.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:32:27.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:27 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:32:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:27 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T12:32:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:27 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T12:32:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:27 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:32:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:27 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:32:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:27 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T12:32:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:27 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T12:32:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:27 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:32:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:27 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:32:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:27 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T12:32:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:27 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T12:32:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:27 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:32:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:28 smithi186 ceph-mon[126480]: pgmap v16953: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 659 KiB/s rd, 559 KiB/s wr, 10 op/s 2023-05-08T12:32:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:28 smithi133 ceph-mon[125939]: pgmap v16953: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 659 KiB/s rd, 559 KiB/s wr, 10 op/s 2023-05-08T12:32:29.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:28 smithi096 ceph-mon[124666]: pgmap v16953: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 659 KiB/s rd, 559 KiB/s wr, 10 op/s 2023-05-08T12:32:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31688.292681 secs 2023-05-08T12:32:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31688.292681 secs 2023-05-08T12:32:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31688.292681 secs 2023-05-08T12:32:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:30 smithi186 ceph-mon[126480]: pgmap v16954: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 662 KiB/s rd, 582 KiB/s wr, 13 op/s 2023-05-08T12:32:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:30 smithi133 ceph-mon[125939]: pgmap v16954: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 662 KiB/s rd, 582 KiB/s wr, 13 op/s 2023-05-08T12:32:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:30 smithi096 ceph-mon[124666]: pgmap v16954: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 662 KiB/s rd, 582 KiB/s wr, 13 op/s 2023-05-08T12:32:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:31 smithi186 ceph-mon[126480]: osdmap e1136: 12 total, 12 up, 12 in 2023-05-08T12:32:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:31 smithi133 ceph-mon[125939]: osdmap e1136: 12 total, 12 up, 12 in 2023-05-08T12:32:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:31 smithi096 ceph-mon[124666]: osdmap e1136: 12 total, 12 up, 12 in 2023-05-08T12:32:32.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:32 smithi186 ceph-mon[126480]: pgmap v16956: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 650 KiB/s rd, 698 KiB/s wr, 12 op/s 2023-05-08T12:32:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:32 smithi133 ceph-mon[125939]: pgmap v16956: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 650 KiB/s rd, 698 KiB/s wr, 12 op/s 2023-05-08T12:32:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:32 smithi096 ceph-mon[124666]: pgmap v16956: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 650 KiB/s rd, 698 KiB/s wr, 12 op/s 2023-05-08T12:32:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:34 smithi186 ceph-mon[126480]: pgmap v16957: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 650 KiB/s rd, 698 KiB/s wr, 12 op/s 2023-05-08T12:32:34.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31693.292765 secs 2023-05-08T12:32:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:34 smithi133 ceph-mon[125939]: pgmap v16957: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 650 KiB/s rd, 698 KiB/s wr, 12 op/s 2023-05-08T12:32:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31693.292765 secs 2023-05-08T12:32:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:34 smithi096 ceph-mon[124666]: pgmap v16957: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 650 KiB/s rd, 698 KiB/s wr, 12 op/s 2023-05-08T12:32:35.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31693.292765 secs 2023-05-08T12:32:36.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:36 smithi186 ceph-mon[126480]: pgmap v16958: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 170 KiB/s wr, 8 op/s 2023-05-08T12:32:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:36 smithi186 ceph-mon[126480]: osdmap e1137: 12 total, 12 up, 12 in 2023-05-08T12:32:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:36 smithi133 ceph-mon[125939]: pgmap v16958: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 170 KiB/s wr, 8 op/s 2023-05-08T12:32:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:36 smithi133 ceph-mon[125939]: osdmap e1137: 12 total, 12 up, 12 in 2023-05-08T12:32:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:36 smithi096 ceph-mon[124666]: pgmap v16958: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 170 KiB/s wr, 8 op/s 2023-05-08T12:32:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:36 smithi096 ceph-mon[124666]: osdmap e1137: 12 total, 12 up, 12 in 2023-05-08T12:32:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:38 smithi186 ceph-mon[126480]: pgmap v16960: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 179 KiB/s wr, 5 op/s 2023-05-08T12:32:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:38 smithi133 ceph-mon[125939]: pgmap v16960: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 179 KiB/s wr, 5 op/s 2023-05-08T12:32:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:38 smithi096 ceph-mon[124666]: pgmap v16960: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 179 KiB/s wr, 5 op/s 2023-05-08T12:32:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31698.292894 secs 2023-05-08T12:32:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31698.292894 secs 2023-05-08T12:32:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31698.292894 secs 2023-05-08T12:32:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:40 smithi133 ceph-mon[125939]: pgmap v16961: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 653 KiB/s wr, 9 op/s 2023-05-08T12:32:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:40 smithi096 ceph-mon[124666]: pgmap v16961: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 653 KiB/s wr, 9 op/s 2023-05-08T12:32:41.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:40 smithi186 ceph-mon[126480]: pgmap v16961: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 653 KiB/s wr, 9 op/s 2023-05-08T12:32:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31700.139004 secs 2023-05-08T12:32:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:41 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:32:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:41 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:32:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:41 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:32:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31700.139004 secs 2023-05-08T12:32:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:41 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:32:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:41 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:32:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:41 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:32:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31700.139004 secs 2023-05-08T12:32:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:41 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:32:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:41 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:32:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:41 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:32:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:42 smithi133 ceph-mon[125939]: pgmap v16962: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 582 KiB/s wr, 8 op/s 2023-05-08T12:32:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:42 smithi096 ceph-mon[124666]: pgmap v16962: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 582 KiB/s wr, 8 op/s 2023-05-08T12:32:43.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:42 smithi186 ceph-mon[126480]: pgmap v16962: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 582 KiB/s wr, 8 op/s 2023-05-08T12:32:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:44 smithi133 ceph-mon[125939]: pgmap v16963: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 582 KiB/s wr, 8 op/s 2023-05-08T12:32:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31703.292992 secs 2023-05-08T12:32:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31703.848714 secs 2023-05-08T12:32:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:44 smithi096 ceph-mon[124666]: pgmap v16963: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 582 KiB/s wr, 8 op/s 2023-05-08T12:32:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31703.292992 secs 2023-05-08T12:32:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31703.848714 secs 2023-05-08T12:32:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:44 smithi186 ceph-mon[126480]: pgmap v16963: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 582 KiB/s wr, 8 op/s 2023-05-08T12:32:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31703.292992 secs 2023-05-08T12:32:45.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31703.848714 secs 2023-05-08T12:32:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:45 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:32:46.159 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:45 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:32:46.160 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:45 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:32:46.161 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:45 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:32:46.161 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:45 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:32:46.161 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:45 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:32:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:46 smithi133 ceph-mon[125939]: pgmap v16964: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 914 KiB/s rd, 879 KiB/s wr, 11 op/s 2023-05-08T12:32:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:46 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:32:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:46 smithi096 ceph-mon[124666]: pgmap v16964: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 914 KiB/s rd, 879 KiB/s wr, 11 op/s 2023-05-08T12:32:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:46 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:32:47.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:46 smithi186 ceph-mon[126480]: pgmap v16964: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 914 KiB/s rd, 879 KiB/s wr, 11 op/s 2023-05-08T12:32:47.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:46 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:32:48.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:48 smithi133 ceph-mon[125939]: pgmap v16965: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 820 KiB/s rd, 788 KiB/s wr, 10 op/s 2023-05-08T12:32:48.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:32:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:48 smithi096 ceph-mon[124666]: pgmap v16965: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 820 KiB/s rd, 788 KiB/s wr, 10 op/s 2023-05-08T12:32:49.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:32:49.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:48 smithi186 ceph-mon[126480]: pgmap v16965: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 820 KiB/s rd, 788 KiB/s wr, 10 op/s 2023-05-08T12:32:49.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:32:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31708.293133 secs 2023-05-08T12:32:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:32:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:32:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31708.293133 secs 2023-05-08T12:32:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:32:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:32:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31708.293133 secs 2023-05-08T12:32:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:32:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:32:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:50 smithi133 ceph-mon[125939]: pgmap v16966: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 14 op/s 2023-05-08T12:32:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:50 smithi096 ceph-mon[124666]: pgmap v16966: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 14 op/s 2023-05-08T12:32:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:50 smithi186 ceph-mon[126480]: pgmap v16966: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 14 op/s 2023-05-08T12:32:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:51 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:32:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:51 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:32:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:51 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:32:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:52 smithi133 ceph-mon[125939]: pgmap v16967: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 10 op/s 2023-05-08T12:32:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:32:53.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:52 smithi096 ceph-mon[124666]: pgmap v16967: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 10 op/s 2023-05-08T12:32:53.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:32:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:52 smithi186 ceph-mon[126480]: pgmap v16967: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 10 op/s 2023-05-08T12:32:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:32:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:54 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:32:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:54 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:32:54.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:54 smithi133 ceph-mon[125939]: pgmap v16968: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 10 op/s 2023-05-08T12:32:54.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31713.293244 secs 2023-05-08T12:32:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:54 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:32:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:54 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:32:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:54 smithi096 ceph-mon[124666]: pgmap v16968: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 10 op/s 2023-05-08T12:32:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31713.293244 secs 2023-05-08T12:32:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:54 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:32:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:54 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:32:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:54 smithi186 ceph-mon[126480]: pgmap v16968: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 10 op/s 2023-05-08T12:32:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31713.293244 secs 2023-05-08T12:32:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:56 smithi186 ceph-mon[126480]: pgmap v16969: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.5 MiB/s wr, 16 op/s 2023-05-08T12:32:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:56 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:32:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:56 smithi133 ceph-mon[125939]: pgmap v16969: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.5 MiB/s wr, 16 op/s 2023-05-08T12:32:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:56 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:32:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:56 smithi096 ceph-mon[124666]: pgmap v16969: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.5 MiB/s wr, 16 op/s 2023-05-08T12:32:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:56 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:32:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:58 smithi186 ceph-mon[126480]: pgmap v16970: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T12:32:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:58 smithi133 ceph-mon[125939]: pgmap v16970: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T12:32:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:58 smithi096 ceph-mon[124666]: pgmap v16970: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T12:32:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31718.293361 secs 2023-05-08T12:32:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:32:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31718.848983 secs 2023-05-08T12:32:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31718.293361 secs 2023-05-08T12:32:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:32:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31718.848983 secs 2023-05-08T12:33:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31718.293361 secs 2023-05-08T12:33:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:32:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31718.848983 secs 2023-05-08T12:33:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:00 smithi186 ceph-mon[126480]: pgmap v16971: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 15 op/s 2023-05-08T12:33:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:00 smithi133 ceph-mon[125939]: pgmap v16971: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 15 op/s 2023-05-08T12:33:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:00 smithi096 ceph-mon[124666]: pgmap v16971: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 15 op/s 2023-05-08T12:33:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:33:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:33:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:01 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:33:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:33:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:33:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:01 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:33:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:33:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:33:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:01 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:33:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:02 smithi186 ceph-mon[126480]: pgmap v16972: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 759 KiB/s rd, 537 KiB/s wr, 10 op/s 2023-05-08T12:33:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:02 smithi133 ceph-mon[125939]: pgmap v16972: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 759 KiB/s rd, 537 KiB/s wr, 10 op/s 2023-05-08T12:33:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:02 smithi096 ceph-mon[124666]: pgmap v16972: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 759 KiB/s rd, 537 KiB/s wr, 10 op/s 2023-05-08T12:33:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:04 smithi186 ceph-mon[126480]: pgmap v16973: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 759 KiB/s rd, 537 KiB/s wr, 10 op/s 2023-05-08T12:33:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31723.293482 secs 2023-05-08T12:33:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:04 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:33:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:04 smithi133 ceph-mon[125939]: pgmap v16973: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 759 KiB/s rd, 537 KiB/s wr, 10 op/s 2023-05-08T12:33:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31723.293482 secs 2023-05-08T12:33:04.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:04 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:33:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:04 smithi096 ceph-mon[124666]: pgmap v16973: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 759 KiB/s rd, 537 KiB/s wr, 10 op/s 2023-05-08T12:33:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31723.293482 secs 2023-05-08T12:33:05.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:04 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:33:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:33:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:33:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:33:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:33:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:33:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:33:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:06 smithi186 ceph-mon[126480]: pgmap v16974: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1013 KiB/s wr, 27 op/s 2023-05-08T12:33:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:06 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:33:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:06 smithi133 ceph-mon[125939]: pgmap v16974: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1013 KiB/s wr, 27 op/s 2023-05-08T12:33:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:06 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:33:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:06 smithi096 ceph-mon[124666]: pgmap v16974: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1013 KiB/s wr, 27 op/s 2023-05-08T12:33:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:06 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:33:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:08 smithi186 ceph-mon[126480]: pgmap v16975: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 882 KiB/s wr, 22 op/s 2023-05-08T12:33:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:08 smithi133 ceph-mon[125939]: pgmap v16975: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 882 KiB/s wr, 22 op/s 2023-05-08T12:33:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:08 smithi096 ceph-mon[124666]: pgmap v16975: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 882 KiB/s wr, 22 op/s 2023-05-08T12:33:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31728.293591 secs 2023-05-08T12:33:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31728.293591 secs 2023-05-08T12:33:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31728.293591 secs 2023-05-08T12:33:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:10 smithi133 ceph-mon[125939]: pgmap v16976: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1010 KiB/s rd, 1022 KiB/s wr, 26 op/s 2023-05-08T12:33:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:10 smithi096 ceph-mon[124666]: pgmap v16976: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1010 KiB/s rd, 1022 KiB/s wr, 26 op/s 2023-05-08T12:33:11.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:10 smithi186 ceph-mon[126480]: pgmap v16976: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1010 KiB/s rd, 1022 KiB/s wr, 26 op/s 2023-05-08T12:33:12.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:12 smithi133 ceph-mon[125939]: pgmap v16977: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 603 KiB/s rd, 616 KiB/s wr, 21 op/s 2023-05-08T12:33:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:12 smithi096 ceph-mon[124666]: pgmap v16977: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 603 KiB/s rd, 616 KiB/s wr, 21 op/s 2023-05-08T12:33:12.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:12 smithi186 ceph-mon[126480]: pgmap v16977: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 603 KiB/s rd, 616 KiB/s wr, 21 op/s 2023-05-08T12:33:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:14 smithi186 ceph-mon[126480]: pgmap v16978: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 603 KiB/s rd, 616 KiB/s wr, 21 op/s 2023-05-08T12:33:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31733.293708 secs 2023-05-08T12:33:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:14 smithi133 ceph-mon[125939]: pgmap v16978: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 603 KiB/s rd, 616 KiB/s wr, 21 op/s 2023-05-08T12:33:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31733.293708 secs 2023-05-08T12:33:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:14 smithi096 ceph-mon[124666]: pgmap v16978: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 603 KiB/s rd, 616 KiB/s wr, 21 op/s 2023-05-08T12:33:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31733.293708 secs 2023-05-08T12:33:16.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:16 smithi186 ceph-mon[126480]: pgmap v16979: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 827 KiB/s rd, 838 KiB/s wr, 25 op/s 2023-05-08T12:33:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:16 smithi133 ceph-mon[125939]: pgmap v16979: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 827 KiB/s rd, 838 KiB/s wr, 25 op/s 2023-05-08T12:33:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:16 smithi096 ceph-mon[124666]: pgmap v16979: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 827 KiB/s rd, 838 KiB/s wr, 25 op/s 2023-05-08T12:33:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:18 smithi186 ceph-mon[126480]: pgmap v16980: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 363 KiB/s wr, 7 op/s 2023-05-08T12:33:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:18 smithi133 ceph-mon[125939]: pgmap v16980: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 363 KiB/s wr, 7 op/s 2023-05-08T12:33:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:18 smithi096 ceph-mon[124666]: pgmap v16980: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 363 KiB/s wr, 7 op/s 2023-05-08T12:33:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31738.293833 secs 2023-05-08T12:33:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31738.293833 secs 2023-05-08T12:33:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31738.293833 secs 2023-05-08T12:33:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:20 smithi186 ceph-mon[126480]: pgmap v16981: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 366 KiB/s rd, 736 KiB/s wr, 11 op/s 2023-05-08T12:33:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:20 smithi133 ceph-mon[125939]: pgmap v16981: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 366 KiB/s rd, 736 KiB/s wr, 11 op/s 2023-05-08T12:33:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:20 smithi096 ceph-mon[124666]: pgmap v16981: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 366 KiB/s rd, 736 KiB/s wr, 11 op/s 2023-05-08T12:33:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31740.139889 secs 2023-05-08T12:33:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:21 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:33:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:21 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:33:21.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:21 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:33:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31740.139889 secs 2023-05-08T12:33:21.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:21 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:33:21.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:21 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:33:21.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:21 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:33:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31740.139889 secs 2023-05-08T12:33:22.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:21 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:33:22.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:21 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:33:22.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:21 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:33:22.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:22 smithi186 ceph-mon[126480]: pgmap v16982: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 596 KiB/s wr, 7 op/s 2023-05-08T12:33:22.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:22 smithi133 ceph-mon[125939]: pgmap v16982: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 596 KiB/s wr, 7 op/s 2023-05-08T12:33:23.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:22 smithi096 ceph-mon[124666]: pgmap v16982: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 596 KiB/s wr, 7 op/s 2023-05-08T12:33:24.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:24 smithi186 ceph-mon[126480]: pgmap v16983: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 596 KiB/s wr, 7 op/s 2023-05-08T12:33:24.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31743.293941 secs 2023-05-08T12:33:24.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31743.849628 secs 2023-05-08T12:33:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:24 smithi133 ceph-mon[125939]: pgmap v16983: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 596 KiB/s wr, 7 op/s 2023-05-08T12:33:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31743.293941 secs 2023-05-08T12:33:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31743.849628 secs 2023-05-08T12:33:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:24 smithi096 ceph-mon[124666]: pgmap v16983: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 596 KiB/s wr, 7 op/s 2023-05-08T12:33:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31743.293941 secs 2023-05-08T12:33:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31743.849628 secs 2023-05-08T12:33:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:25 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:33:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:25 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:33:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:25 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:33:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:25 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:33:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:25 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:33:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:25 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:33:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31745.140013 secs 2023-05-08T12:33:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:26 smithi186 ceph-mon[126480]: pgmap v16984: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 786 KiB/s rd, 825 KiB/s wr, 14 op/s 2023-05-08T12:33:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:26 smithi186 ceph-mon[126480]: osdmap e1138: 12 total, 12 up, 12 in 2023-05-08T12:33:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:26 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:33:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31745.140013 secs 2023-05-08T12:33:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:26 smithi133 ceph-mon[125939]: pgmap v16984: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 786 KiB/s rd, 825 KiB/s wr, 14 op/s 2023-05-08T12:33:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:26 smithi133 ceph-mon[125939]: osdmap e1138: 12 total, 12 up, 12 in 2023-05-08T12:33:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:26 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:33:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31745.140013 secs 2023-05-08T12:33:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:26 smithi096 ceph-mon[124666]: pgmap v16984: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 786 KiB/s rd, 825 KiB/s wr, 14 op/s 2023-05-08T12:33:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:26 smithi096 ceph-mon[124666]: osdmap e1138: 12 total, 12 up, 12 in 2023-05-08T12:33:27.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:26 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:33:27.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:33:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:33:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:33:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:33:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:33:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:33:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:33:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:33:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:33:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:33:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:33:28.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:33:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:28 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:33:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:28 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T12:33:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:28 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T12:33:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:28 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:33:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:28 smithi133 ceph-mon[125939]: pgmap v16986: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 675 KiB/s rd, 724 KiB/s wr, 13 op/s 2023-05-08T12:33:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:28 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:33:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:28 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T12:33:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:28 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T12:33:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:28 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:33:29.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:28 smithi096 ceph-mon[124666]: pgmap v16986: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 675 KiB/s rd, 724 KiB/s wr, 13 op/s 2023-05-08T12:33:29.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:28 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:33:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:28 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T12:33:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:28 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T12:33:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:28 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:33:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:28 smithi186 ceph-mon[126480]: pgmap v16986: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 675 KiB/s rd, 724 KiB/s wr, 13 op/s 2023-05-08T12:33:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31748.294093 secs 2023-05-08T12:33:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31748.849696 secs 2023-05-08T12:33:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31748.294093 secs 2023-05-08T12:33:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31748.849696 secs 2023-05-08T12:33:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31748.294093 secs 2023-05-08T12:33:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31748.849696 secs 2023-05-08T12:33:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:30 smithi133 ceph-mon[125939]: pgmap v16987: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 818 KiB/s rd, 543 KiB/s wr, 13 op/s 2023-05-08T12:33:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:30 smithi096 ceph-mon[124666]: pgmap v16987: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 818 KiB/s rd, 543 KiB/s wr, 13 op/s 2023-05-08T12:33:31.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:30 smithi186 ceph-mon[126480]: pgmap v16987: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 818 KiB/s rd, 543 KiB/s wr, 13 op/s 2023-05-08T12:33:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31750.140092 secs 2023-05-08T12:33:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31750.140092 secs 2023-05-08T12:33:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31750.140092 secs 2023-05-08T12:33:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:32 smithi133 ceph-mon[125939]: pgmap v16988: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 818 KiB/s rd, 543 KiB/s wr, 13 op/s 2023-05-08T12:33:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:32 smithi096 ceph-mon[124666]: pgmap v16988: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 818 KiB/s rd, 543 KiB/s wr, 13 op/s 2023-05-08T12:33:33.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:32 smithi186 ceph-mon[126480]: pgmap v16988: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 818 KiB/s rd, 543 KiB/s wr, 13 op/s 2023-05-08T12:33:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:34 smithi133 ceph-mon[125939]: pgmap v16989: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 818 KiB/s rd, 543 KiB/s wr, 13 op/s 2023-05-08T12:33:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31753.294214 secs 2023-05-08T12:33:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31753.849800 secs 2023-05-08T12:33:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:34 smithi096 ceph-mon[124666]: pgmap v16989: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 818 KiB/s rd, 543 KiB/s wr, 13 op/s 2023-05-08T12:33:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31753.294214 secs 2023-05-08T12:33:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31753.849800 secs 2023-05-08T12:33:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:34 smithi186 ceph-mon[126480]: pgmap v16989: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 818 KiB/s rd, 543 KiB/s wr, 13 op/s 2023-05-08T12:33:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31753.294214 secs 2023-05-08T12:33:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31753.849800 secs 2023-05-08T12:33:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31755.140210 secs 2023-05-08T12:33:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:36 smithi133 ceph-mon[125939]: pgmap v16990: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 268 KiB/s wr, 8 op/s 2023-05-08T12:33:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:36 smithi133 ceph-mon[125939]: osdmap e1139: 12 total, 12 up, 12 in 2023-05-08T12:33:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31755.140210 secs 2023-05-08T12:33:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:36 smithi096 ceph-mon[124666]: pgmap v16990: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 268 KiB/s wr, 8 op/s 2023-05-08T12:33:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:36 smithi096 ceph-mon[124666]: osdmap e1139: 12 total, 12 up, 12 in 2023-05-08T12:33:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31755.140210 secs 2023-05-08T12:33:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:36 smithi186 ceph-mon[126480]: pgmap v16990: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 268 KiB/s wr, 8 op/s 2023-05-08T12:33:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:36 smithi186 ceph-mon[126480]: osdmap e1139: 12 total, 12 up, 12 in 2023-05-08T12:33:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:38 smithi133 ceph-mon[125939]: pgmap v16992: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 268 KiB/s wr, 8 op/s 2023-05-08T12:33:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:38 smithi096 ceph-mon[124666]: pgmap v16992: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 268 KiB/s wr, 8 op/s 2023-05-08T12:33:39.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:38 smithi186 ceph-mon[126480]: pgmap v16992: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 268 KiB/s wr, 8 op/s 2023-05-08T12:33:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31758.294360 secs 2023-05-08T12:33:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31758.849869 secs 2023-05-08T12:33:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31758.294360 secs 2023-05-08T12:33:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31758.849869 secs 2023-05-08T12:33:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31758.294360 secs 2023-05-08T12:33:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31758.849869 secs 2023-05-08T12:33:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:40 smithi133 ceph-mon[125939]: pgmap v16993: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 295 KiB/s wr, 8 op/s 2023-05-08T12:33:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31760.140334 secs 2023-05-08T12:33:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:40 smithi096 ceph-mon[124666]: pgmap v16993: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 295 KiB/s wr, 8 op/s 2023-05-08T12:33:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31760.140334 secs 2023-05-08T12:33:41.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:40 smithi186 ceph-mon[126480]: pgmap v16993: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 295 KiB/s wr, 8 op/s 2023-05-08T12:33:41.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31760.140334 secs 2023-05-08T12:33:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:42 smithi133 ceph-mon[125939]: pgmap v16994: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 295 KiB/s wr, 8 op/s 2023-05-08T12:33:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:42 smithi096 ceph-mon[124666]: pgmap v16994: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 295 KiB/s wr, 8 op/s 2023-05-08T12:33:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:42 smithi186 ceph-mon[126480]: pgmap v16994: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 295 KiB/s wr, 8 op/s 2023-05-08T12:33:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:44 smithi186 ceph-mon[126480]: pgmap v16995: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 295 KiB/s wr, 8 op/s 2023-05-08T12:33:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31763.294406 secs 2023-05-08T12:33:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31763.849958 secs 2023-05-08T12:33:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:44 smithi133 ceph-mon[125939]: pgmap v16995: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 295 KiB/s wr, 8 op/s 2023-05-08T12:33:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31763.294406 secs 2023-05-08T12:33:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31763.849958 secs 2023-05-08T12:33:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:44 smithi096 ceph-mon[124666]: pgmap v16995: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 295 KiB/s wr, 8 op/s 2023-05-08T12:33:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31763.294406 secs 2023-05-08T12:33:45.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31763.849958 secs 2023-05-08T12:33:46.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:46 smithi186 ceph-mon[126480]: pgmap v16996: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 385 KiB/s wr, 8 op/s 2023-05-08T12:33:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:46 smithi133 ceph-mon[125939]: pgmap v16996: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 385 KiB/s wr, 8 op/s 2023-05-08T12:33:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:46 smithi096 ceph-mon[124666]: pgmap v16996: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 385 KiB/s wr, 8 op/s 2023-05-08T12:33:48.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:48 smithi186 ceph-mon[126480]: pgmap v16997: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 348 KiB/s rd, 345 KiB/s wr, 7 op/s 2023-05-08T12:33:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:33:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:48 smithi133 ceph-mon[125939]: pgmap v16997: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 348 KiB/s rd, 345 KiB/s wr, 7 op/s 2023-05-08T12:33:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:33:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:48 smithi096 ceph-mon[124666]: pgmap v16997: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 348 KiB/s rd, 345 KiB/s wr, 7 op/s 2023-05-08T12:33:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:33:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31768.294523 secs 2023-05-08T12:33:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:33:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:33:49.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:33:49.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31768.850090 secs 2023-05-08T12:33:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31768.294523 secs 2023-05-08T12:33:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:33:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:33:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:33:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31768.850090 secs 2023-05-08T12:33:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31768.294523 secs 2023-05-08T12:33:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:33:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:33:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:33:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31768.850090 secs 2023-05-08T12:33:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:50 smithi186 ceph-mon[126480]: pgmap v16998: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 368 KiB/s wr, 10 op/s 2023-05-08T12:33:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:50 smithi133 ceph-mon[125939]: pgmap v16998: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 368 KiB/s wr, 10 op/s 2023-05-08T12:33:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:50 smithi096 ceph-mon[124666]: pgmap v16998: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 368 KiB/s wr, 10 op/s 2023-05-08T12:33:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:52 smithi133 ceph-mon[125939]: pgmap v16999: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 123 KiB/s wr, 7 op/s 2023-05-08T12:33:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:52 smithi096 ceph-mon[124666]: pgmap v16999: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 123 KiB/s wr, 7 op/s 2023-05-08T12:33:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:52 smithi186 ceph-mon[126480]: pgmap v16999: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 123 KiB/s wr, 7 op/s 2023-05-08T12:33:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:54 smithi186 ceph-mon[126480]: pgmap v17000: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 123 KiB/s wr, 6 op/s 2023-05-08T12:33:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31773.294647 secs 2023-05-08T12:33:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:54 smithi133 ceph-mon[125939]: pgmap v17000: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 123 KiB/s wr, 6 op/s 2023-05-08T12:33:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31773.294647 secs 2023-05-08T12:33:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:54 smithi096 ceph-mon[124666]: pgmap v17000: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 123 KiB/s wr, 6 op/s 2023-05-08T12:33:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31773.294647 secs 2023-05-08T12:33:56.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:56 smithi186 ceph-mon[126480]: pgmap v17001: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T12:33:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:33:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:56 smithi133 ceph-mon[125939]: pgmap v17001: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T12:33:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:33:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:56 smithi096 ceph-mon[124666]: pgmap v17001: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T12:33:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:33:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:57 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:33:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:33:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:33:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:57 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:33:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:33:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:33:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:57 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:33:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:33:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:33:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:58 smithi186 ceph-mon[126480]: pgmap v17002: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 9 op/s 2023-05-08T12:33:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:58 smithi133 ceph-mon[125939]: pgmap v17002: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 9 op/s 2023-05-08T12:33:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:58 smithi096 ceph-mon[124666]: pgmap v17002: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 9 op/s 2023-05-08T12:33:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31778.294770 secs 2023-05-08T12:33:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:33:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31778.850322 secs 2023-05-08T12:33:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31778.294770 secs 2023-05-08T12:33:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:33:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31778.850322 secs 2023-05-08T12:34:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31778.294770 secs 2023-05-08T12:34:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:33:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31778.850322 secs 2023-05-08T12:34:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:00 smithi186 ceph-mon[126480]: pgmap v17003: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 15 op/s 2023-05-08T12:34:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:00 smithi133 ceph-mon[125939]: pgmap v17003: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 15 op/s 2023-05-08T12:34:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:00 smithi096 ceph-mon[124666]: pgmap v17003: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 15 op/s 2023-05-08T12:34:01.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:34:01.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:34:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:34:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:34:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:34:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:34:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:02 smithi186 ceph-mon[126480]: pgmap v17004: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 12 op/s 2023-05-08T12:34:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:02 smithi133 ceph-mon[125939]: pgmap v17004: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 12 op/s 2023-05-08T12:34:03.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:02 smithi096 ceph-mon[124666]: pgmap v17004: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 12 op/s 2023-05-08T12:34:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:04 smithi133 ceph-mon[125939]: pgmap v17005: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 12 op/s 2023-05-08T12:34:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31783.294881 secs 2023-05-08T12:34:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31783.850436 secs 2023-05-08T12:34:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:04 smithi096 ceph-mon[124666]: pgmap v17005: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 12 op/s 2023-05-08T12:34:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31783.294881 secs 2023-05-08T12:34:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31783.850436 secs 2023-05-08T12:34:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:04 smithi186 ceph-mon[126480]: pgmap v17005: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 12 op/s 2023-05-08T12:34:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31783.294881 secs 2023-05-08T12:34:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31783.850436 secs 2023-05-08T12:34:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:06 smithi133 ceph-mon[125939]: pgmap v17006: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 18 op/s 2023-05-08T12:34:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:06 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:34:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:06 smithi096 ceph-mon[124666]: pgmap v17006: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 18 op/s 2023-05-08T12:34:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:06 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:34:07.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:06 smithi186 ceph-mon[126480]: pgmap v17006: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 18 op/s 2023-05-08T12:34:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:06 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:34:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:08 smithi133 ceph-mon[125939]: pgmap v17007: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 809 KiB/s rd, 710 KiB/s wr, 12 op/s 2023-05-08T12:34:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:08 smithi096 ceph-mon[124666]: pgmap v17007: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 809 KiB/s rd, 710 KiB/s wr, 12 op/s 2023-05-08T12:34:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:08 smithi186 ceph-mon[126480]: pgmap v17007: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 809 KiB/s rd, 710 KiB/s wr, 12 op/s 2023-05-08T12:34:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31788.295019 secs 2023-05-08T12:34:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31788.295019 secs 2023-05-08T12:34:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31788.295019 secs 2023-05-08T12:34:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:10 smithi133 ceph-mon[125939]: pgmap v17008: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 27 op/s 2023-05-08T12:34:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:10 smithi096 ceph-mon[124666]: pgmap v17008: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 27 op/s 2023-05-08T12:34:11.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:10 smithi186 ceph-mon[126480]: pgmap v17008: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 27 op/s 2023-05-08T12:34:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:12 smithi133 ceph-mon[125939]: pgmap v17009: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 683 KiB/s rd, 599 KiB/s wr, 22 op/s 2023-05-08T12:34:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:12 smithi096 ceph-mon[124666]: pgmap v17009: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 683 KiB/s rd, 599 KiB/s wr, 22 op/s 2023-05-08T12:34:12.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:12 smithi186 ceph-mon[126480]: pgmap v17009: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 683 KiB/s rd, 599 KiB/s wr, 22 op/s 2023-05-08T12:34:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:13 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:34:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:13 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:34:13.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:13 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:34:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:14 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:34:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:14 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:34:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:14 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:34:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:14 smithi133 ceph-mon[125939]: pgmap v17010: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 586 KiB/s rd, 599 KiB/s wr, 21 op/s 2023-05-08T12:34:14.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31793.295165 secs 2023-05-08T12:34:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:14 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:34:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:14 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:34:14.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:14 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:34:14.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:14 smithi096 ceph-mon[124666]: pgmap v17010: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 586 KiB/s rd, 599 KiB/s wr, 21 op/s 2023-05-08T12:34:14.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31793.295165 secs 2023-05-08T12:34:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:14 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:34:14.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:14 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:34:14.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:14 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:34:14.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:14 smithi186 ceph-mon[126480]: pgmap v17010: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 586 KiB/s rd, 599 KiB/s wr, 21 op/s 2023-05-08T12:34:14.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31793.295165 secs 2023-05-08T12:34:16.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:16 smithi186 ceph-mon[126480]: pgmap v17011: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 811 KiB/s rd, 823 KiB/s wr, 25 op/s 2023-05-08T12:34:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:16 smithi133 ceph-mon[125939]: pgmap v17011: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 811 KiB/s rd, 823 KiB/s wr, 25 op/s 2023-05-08T12:34:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:16 smithi096 ceph-mon[124666]: pgmap v17011: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 811 KiB/s rd, 823 KiB/s wr, 25 op/s 2023-05-08T12:34:18.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:18 smithi186 ceph-mon[126480]: pgmap v17012: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 667 KiB/s rd, 680 KiB/s wr, 19 op/s 2023-05-08T12:34:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:18 smithi133 ceph-mon[125939]: pgmap v17012: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 667 KiB/s rd, 680 KiB/s wr, 19 op/s 2023-05-08T12:34:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:18 smithi096 ceph-mon[124666]: pgmap v17012: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 667 KiB/s rd, 680 KiB/s wr, 19 op/s 2023-05-08T12:34:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31798.295282 secs 2023-05-08T12:34:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31798.295282 secs 2023-05-08T12:34:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31798.295282 secs 2023-05-08T12:34:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:20 smithi186 ceph-mon[126480]: pgmap v17013: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 798 KiB/s rd, 821 KiB/s wr, 23 op/s 2023-05-08T12:34:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:20 smithi133 ceph-mon[125939]: pgmap v17013: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 798 KiB/s rd, 821 KiB/s wr, 23 op/s 2023-05-08T12:34:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:20 smithi096 ceph-mon[124666]: pgmap v17013: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 798 KiB/s rd, 821 KiB/s wr, 23 op/s 2023-05-08T12:34:22.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:22 smithi133 ceph-mon[125939]: pgmap v17014: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 365 KiB/s wr, 8 op/s 2023-05-08T12:34:22.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:22 smithi096 ceph-mon[124666]: pgmap v17014: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 365 KiB/s wr, 8 op/s 2023-05-08T12:34:22.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:22 smithi186 ceph-mon[126480]: pgmap v17014: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 365 KiB/s wr, 8 op/s 2023-05-08T12:34:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:24 smithi186 ceph-mon[126480]: pgmap v17015: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 365 KiB/s wr, 8 op/s 2023-05-08T12:34:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31803.295403 secs 2023-05-08T12:34:24.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:24 smithi133 ceph-mon[125939]: pgmap v17015: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 365 KiB/s wr, 8 op/s 2023-05-08T12:34:24.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31803.295403 secs 2023-05-08T12:34:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:24 smithi096 ceph-mon[124666]: pgmap v17015: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 365 KiB/s wr, 8 op/s 2023-05-08T12:34:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31803.295403 secs 2023-05-08T12:34:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:26 smithi186 ceph-mon[126480]: pgmap v17016: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 374 KiB/s wr, 12 op/s 2023-05-08T12:34:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:26 smithi133 ceph-mon[125939]: pgmap v17016: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 374 KiB/s wr, 12 op/s 2023-05-08T12:34:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:26 smithi096 ceph-mon[124666]: pgmap v17016: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 374 KiB/s wr, 12 op/s 2023-05-08T12:34:27.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:34:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:34:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:34:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:28 smithi186 ceph-mon[126480]: pgmap v17017: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 150 KiB/s wr, 8 op/s 2023-05-08T12:34:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:28 smithi133 ceph-mon[125939]: pgmap v17017: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 150 KiB/s wr, 8 op/s 2023-05-08T12:34:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:28 smithi096 ceph-mon[124666]: pgmap v17017: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 150 KiB/s wr, 8 op/s 2023-05-08T12:34:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31808.295474 secs 2023-05-08T12:34:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31808.850897 secs 2023-05-08T12:34:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31808.295474 secs 2023-05-08T12:34:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31808.850897 secs 2023-05-08T12:34:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31808.295474 secs 2023-05-08T12:34:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31808.850897 secs 2023-05-08T12:34:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:30 smithi186 ceph-mon[126480]: pgmap v17018: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 728 KiB/s rd, 737 KiB/s wr, 16 op/s 2023-05-08T12:34:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:34:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:34:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:34:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:34:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:34:30.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:34:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:30 smithi133 ceph-mon[125939]: pgmap v17018: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 728 KiB/s rd, 737 KiB/s wr, 16 op/s 2023-05-08T12:34:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:34:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:34:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:34:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:34:30.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:34:30.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:34:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:30 smithi096 ceph-mon[124666]: pgmap v17018: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 728 KiB/s rd, 737 KiB/s wr, 16 op/s 2023-05-08T12:34:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:34:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:34:31.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:34:31.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:34:31.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:34:31.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:34:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31810.141433 secs 2023-05-08T12:34:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:31 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:34:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:31 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:34:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:31 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:34:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:31 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:34:31.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:31 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:34:31.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:31 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:34:31.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:31 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:34:31.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:31 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:34:31.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:31 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:34:31.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:31 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:34:31.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:31 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:34:31.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:31 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:34:31.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:31 smithi186 ceph-mon[126480]: osdmap e1140: 12 total, 12 up, 12 in 2023-05-08T12:34:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31810.141433 secs 2023-05-08T12:34:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:31 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:34:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:31 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:34:31.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:31 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:34:31.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:31 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:34:31.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:31 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:34:31.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:31 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:34:31.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:31 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:34:31.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:31 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:34:31.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:31 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:34:31.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:31 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:34:31.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:31 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:34:31.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:31 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:34:31.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:31 smithi133 ceph-mon[125939]: osdmap e1140: 12 total, 12 up, 12 in 2023-05-08T12:34:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31810.141433 secs 2023-05-08T12:34:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:31 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:34:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:31 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:34:32.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:31 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:34:32.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:31 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:34:32.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:31 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:34:32.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:31 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:34:32.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:31 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:34:32.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:31 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:34:32.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:31 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:34:32.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:31 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:34:32.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:31 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:34:32.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:31 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:34:32.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:31 smithi096 ceph-mon[124666]: osdmap e1140: 12 total, 12 up, 12 in 2023-05-08T12:34:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:32 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi186 to 130.9M 2023-05-08T12:34:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:32 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi186 to 137318584: error parsing value: Value '137318584' is below minimum 939524096 2023-05-08T12:34:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:32 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi133 to 140.9M 2023-05-08T12:34:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:32 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi133 to 147770364: error parsing value: Value '147770364' is below minimum 939524096 2023-05-08T12:34:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:32 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:34:32.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:32 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T12:34:32.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:32 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T12:34:32.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:32 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:34:32.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:32 smithi133 ceph-mon[125939]: pgmap v17020: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 716 KiB/s rd, 716 KiB/s wr, 14 op/s 2023-05-08T12:34:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:32 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi186 to 130.9M 2023-05-08T12:34:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:32 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi186 to 137318584: error parsing value: Value '137318584' is below minimum 939524096 2023-05-08T12:34:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:32 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi133 to 140.9M 2023-05-08T12:34:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:32 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi133 to 147770364: error parsing value: Value '147770364' is below minimum 939524096 2023-05-08T12:34:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:32 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:34:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:32 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T12:34:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:32 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T12:34:33.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:32 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:34:33.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:32 smithi096 ceph-mon[124666]: pgmap v17020: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 716 KiB/s rd, 716 KiB/s wr, 14 op/s 2023-05-08T12:34:33.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:32 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi186 to 130.9M 2023-05-08T12:34:33.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:32 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi186 to 137318584: error parsing value: Value '137318584' is below minimum 939524096 2023-05-08T12:34:33.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:32 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi133 to 140.9M 2023-05-08T12:34:33.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:32 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi133 to 147770364: error parsing value: Value '147770364' is below minimum 939524096 2023-05-08T12:34:33.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:32 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:34:33.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:32 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T12:34:33.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:32 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T12:34:33.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:32 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:34:33.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:32 smithi186 ceph-mon[126480]: pgmap v17020: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 716 KiB/s rd, 716 KiB/s wr, 14 op/s 2023-05-08T12:34:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:33 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:34:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:33 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:34:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:33 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:34:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:33 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:34:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:33 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:34:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:33 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:34:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:33 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:34:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:33 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:34:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:33 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:34:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:33 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:34:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:33 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:34:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:33 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:34:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:34 smithi133 ceph-mon[125939]: pgmap v17021: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 716 KiB/s rd, 716 KiB/s wr, 14 op/s 2023-05-08T12:34:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31813.295538 secs 2023-05-08T12:34:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31813.851029 secs 2023-05-08T12:34:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:34 smithi096 ceph-mon[124666]: pgmap v17021: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 716 KiB/s rd, 716 KiB/s wr, 14 op/s 2023-05-08T12:34:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31813.295538 secs 2023-05-08T12:34:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31813.851029 secs 2023-05-08T12:34:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:34 smithi186 ceph-mon[126480]: pgmap v17021: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 716 KiB/s rd, 716 KiB/s wr, 14 op/s 2023-05-08T12:34:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31813.295538 secs 2023-05-08T12:34:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31813.851029 secs 2023-05-08T12:34:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31815.141502 secs 2023-05-08T12:34:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:36 smithi133 ceph-mon[125939]: pgmap v17022: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 768 KiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T12:34:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:36 smithi133 ceph-mon[125939]: osdmap e1141: 12 total, 12 up, 12 in 2023-05-08T12:34:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31815.141502 secs 2023-05-08T12:34:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:36 smithi096 ceph-mon[124666]: pgmap v17022: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 768 KiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T12:34:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:36 smithi096 ceph-mon[124666]: osdmap e1141: 12 total, 12 up, 12 in 2023-05-08T12:34:37.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31815.141502 secs 2023-05-08T12:34:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:36 smithi186 ceph-mon[126480]: pgmap v17022: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 768 KiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T12:34:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:36 smithi186 ceph-mon[126480]: osdmap e1141: 12 total, 12 up, 12 in 2023-05-08T12:34:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:38 smithi133 ceph-mon[125939]: pgmap v17024: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 555 KiB/s wr, 6 op/s 2023-05-08T12:34:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:38 smithi096 ceph-mon[124666]: pgmap v17024: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 555 KiB/s wr, 6 op/s 2023-05-08T12:34:39.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:38 smithi186 ceph-mon[126480]: pgmap v17024: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 555 KiB/s wr, 6 op/s 2023-05-08T12:34:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31818.295605 secs 2023-05-08T12:34:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31818.851167 secs 2023-05-08T12:34:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31818.295605 secs 2023-05-08T12:34:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31818.851167 secs 2023-05-08T12:34:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31818.295605 secs 2023-05-08T12:34:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31818.851167 secs 2023-05-08T12:34:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:40 smithi133 ceph-mon[125939]: pgmap v17025: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 536 KiB/s wr, 10 op/s 2023-05-08T12:34:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:40 smithi096 ceph-mon[124666]: pgmap v17025: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 536 KiB/s wr, 10 op/s 2023-05-08T12:34:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:40 smithi186 ceph-mon[126480]: pgmap v17025: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 536 KiB/s wr, 10 op/s 2023-05-08T12:34:41.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31820.141651 secs 2023-05-08T12:34:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31820.141651 secs 2023-05-08T12:34:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31820.141651 secs 2023-05-08T12:34:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:42 smithi133 ceph-mon[125939]: pgmap v17026: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 445 KiB/s wr, 9 op/s 2023-05-08T12:34:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:42 smithi096 ceph-mon[124666]: pgmap v17026: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 445 KiB/s wr, 9 op/s 2023-05-08T12:34:43.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:42 smithi186 ceph-mon[126480]: pgmap v17026: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 445 KiB/s wr, 9 op/s 2023-05-08T12:34:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:44 smithi133 ceph-mon[125939]: pgmap v17027: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 445 KiB/s wr, 9 op/s 2023-05-08T12:34:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31823.295726 secs 2023-05-08T12:34:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31823.851285 secs 2023-05-08T12:34:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:44 smithi096 ceph-mon[124666]: pgmap v17027: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 445 KiB/s wr, 9 op/s 2023-05-08T12:34:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31823.295726 secs 2023-05-08T12:34:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31823.851285 secs 2023-05-08T12:34:45.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:44 smithi186 ceph-mon[126480]: pgmap v17027: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 445 KiB/s wr, 9 op/s 2023-05-08T12:34:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31823.295726 secs 2023-05-08T12:34:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31823.851285 secs 2023-05-08T12:34:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:46 smithi133 ceph-mon[125939]: pgmap v17028: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 735 KiB/s rd, 326 KiB/s wr, 8 op/s 2023-05-08T12:34:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:46 smithi096 ceph-mon[124666]: pgmap v17028: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 735 KiB/s rd, 326 KiB/s wr, 8 op/s 2023-05-08T12:34:47.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:46 smithi186 ceph-mon[126480]: pgmap v17028: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 735 KiB/s rd, 326 KiB/s wr, 8 op/s 2023-05-08T12:34:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:48 smithi133 ceph-mon[125939]: pgmap v17029: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 659 KiB/s rd, 293 KiB/s wr, 7 op/s 2023-05-08T12:34:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:34:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:48 smithi096 ceph-mon[124666]: pgmap v17029: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 659 KiB/s rd, 293 KiB/s wr, 7 op/s 2023-05-08T12:34:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:34:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:48 smithi186 ceph-mon[126480]: pgmap v17029: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 659 KiB/s rd, 293 KiB/s wr, 7 op/s 2023-05-08T12:34:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:34:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31828.295835 secs 2023-05-08T12:34:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:34:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:34:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:34:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31828.295835 secs 2023-05-08T12:34:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:34:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:34:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:34:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31828.295835 secs 2023-05-08T12:34:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:34:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:34:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:34:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:50 smithi133 ceph-mon[125939]: pgmap v17030: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 743 KiB/s rd, 398 KiB/s wr, 11 op/s 2023-05-08T12:34:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:50 smithi096 ceph-mon[124666]: pgmap v17030: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 743 KiB/s rd, 398 KiB/s wr, 11 op/s 2023-05-08T12:34:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:50 smithi186 ceph-mon[126480]: pgmap v17030: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 743 KiB/s rd, 398 KiB/s wr, 11 op/s 2023-05-08T12:34:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:52 smithi133 ceph-mon[125939]: pgmap v17031: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 680 KiB/s rd, 398 KiB/s wr, 8 op/s 2023-05-08T12:34:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:52 smithi096 ceph-mon[124666]: pgmap v17031: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 680 KiB/s rd, 398 KiB/s wr, 8 op/s 2023-05-08T12:34:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:52 smithi186 ceph-mon[126480]: pgmap v17031: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 680 KiB/s rd, 398 KiB/s wr, 8 op/s 2023-05-08T12:34:53.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:53 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:34:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:53 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:34:53.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:53 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:34:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:54 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:34:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:54 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:34:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:54 smithi133 ceph-mon[125939]: pgmap v17032: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 398 KiB/s wr, 7 op/s 2023-05-08T12:34:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31833.295956 secs 2023-05-08T12:34:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:54 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:34:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:54 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:34:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:54 smithi096 ceph-mon[124666]: pgmap v17032: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 398 KiB/s wr, 7 op/s 2023-05-08T12:34:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31833.295956 secs 2023-05-08T12:34:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:54 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:34:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:54 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:34:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:54 smithi186 ceph-mon[126480]: pgmap v17032: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 398 KiB/s wr, 7 op/s 2023-05-08T12:34:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31833.295956 secs 2023-05-08T12:34:56.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:56 smithi186 ceph-mon[126480]: pgmap v17033: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1007 KiB/s rd, 1008 KiB/s wr, 13 op/s 2023-05-08T12:34:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:56 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:34:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:56 smithi133 ceph-mon[125939]: pgmap v17033: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1007 KiB/s rd, 1008 KiB/s wr, 13 op/s 2023-05-08T12:34:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:56 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:34:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:56 smithi096 ceph-mon[124666]: pgmap v17033: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1007 KiB/s rd, 1008 KiB/s wr, 13 op/s 2023-05-08T12:34:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:56 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:34:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:58 smithi186 ceph-mon[126480]: pgmap v17034: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 702 KiB/s rd, 737 KiB/s wr, 9 op/s 2023-05-08T12:34:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:58 smithi133 ceph-mon[125939]: pgmap v17034: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 702 KiB/s rd, 737 KiB/s wr, 9 op/s 2023-05-08T12:34:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:58 smithi096 ceph-mon[124666]: pgmap v17034: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 702 KiB/s rd, 737 KiB/s wr, 9 op/s 2023-05-08T12:34:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31838.296045 secs 2023-05-08T12:34:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:34:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31838.851656 secs 2023-05-08T12:34:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31838.296045 secs 2023-05-08T12:34:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:34:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31838.851656 secs 2023-05-08T12:35:00.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31838.296045 secs 2023-05-08T12:35:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:34:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31838.851656 secs 2023-05-08T12:35:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:00 smithi133 ceph-mon[125939]: pgmap v17035: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 907 KiB/s rd, 852 KiB/s wr, 15 op/s 2023-05-08T12:35:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:00 smithi096 ceph-mon[124666]: pgmap v17035: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 907 KiB/s rd, 852 KiB/s wr, 15 op/s 2023-05-08T12:35:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:00 smithi186 ceph-mon[126480]: pgmap v17035: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 907 KiB/s rd, 852 KiB/s wr, 15 op/s 2023-05-08T12:35:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:35:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:35:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:01 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:35:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:35:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:35:02.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:01 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:35:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:35:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:35:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:01 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:35:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:02 smithi133 ceph-mon[125939]: pgmap v17036: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T12:35:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:02 smithi096 ceph-mon[124666]: pgmap v17036: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T12:35:03.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:02 smithi186 ceph-mon[126480]: pgmap v17036: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T12:35:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31843.296187 secs 2023-05-08T12:35:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:04 smithi133 ceph-mon[125939]: pgmap v17037: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T12:35:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:04 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:35:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31843.296187 secs 2023-05-08T12:35:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:04 smithi096 ceph-mon[124666]: pgmap v17037: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T12:35:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:04 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:35:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31843.296187 secs 2023-05-08T12:35:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:04 smithi186 ceph-mon[126480]: pgmap v17037: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T12:35:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:04 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:35:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:35:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:35:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:35:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:35:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:35:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:35:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31845.142204 secs 2023-05-08T12:35:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:06 smithi133 ceph-mon[125939]: pgmap v17038: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 17 op/s 2023-05-08T12:35:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:06 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:35:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31845.142204 secs 2023-05-08T12:35:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:06 smithi096 ceph-mon[124666]: pgmap v17038: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 17 op/s 2023-05-08T12:35:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:06 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:35:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31845.142204 secs 2023-05-08T12:35:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:06 smithi186 ceph-mon[126480]: pgmap v17038: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 17 op/s 2023-05-08T12:35:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:06 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:35:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:08 smithi133 ceph-mon[125939]: pgmap v17039: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 810 KiB/s rd, 892 KiB/s wr, 12 op/s 2023-05-08T12:35:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:08 smithi096 ceph-mon[124666]: pgmap v17039: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 810 KiB/s rd, 892 KiB/s wr, 12 op/s 2023-05-08T12:35:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:08 smithi186 ceph-mon[126480]: pgmap v17039: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 810 KiB/s rd, 892 KiB/s wr, 12 op/s 2023-05-08T12:35:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31848.296356 secs 2023-05-08T12:35:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:35:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:35:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31848.851862 secs 2023-05-08T12:35:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31848.296356 secs 2023-05-08T12:35:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:35:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:35:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31848.851862 secs 2023-05-08T12:35:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31848.296356 secs 2023-05-08T12:35:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:35:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:35:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31848.851862 secs 2023-05-08T12:35:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:10 smithi133 ceph-mon[125939]: pgmap v17040: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 30 op/s 2023-05-08T12:35:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31850.142316 secs 2023-05-08T12:35:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:10 smithi096 ceph-mon[124666]: pgmap v17040: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 30 op/s 2023-05-08T12:35:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31850.142316 secs 2023-05-08T12:35:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:10 smithi186 ceph-mon[126480]: pgmap v17040: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 30 op/s 2023-05-08T12:35:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31850.142316 secs 2023-05-08T12:35:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:11 smithi133 ceph-mon[125939]: osdmap e1142: 12 total, 12 up, 12 in 2023-05-08T12:35:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:11 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:35:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:11 smithi096 ceph-mon[124666]: osdmap e1142: 12 total, 12 up, 12 in 2023-05-08T12:35:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:11 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:35:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:11 smithi186 ceph-mon[126480]: osdmap e1142: 12 total, 12 up, 12 in 2023-05-08T12:35:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:11 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:35:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:12 smithi133 ceph-mon[125939]: pgmap v17042: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 846 KiB/s rd, 832 KiB/s wr, 29 op/s 2023-05-08T12:35:13.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:12 smithi096 ceph-mon[124666]: pgmap v17042: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 846 KiB/s rd, 832 KiB/s wr, 29 op/s 2023-05-08T12:35:13.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:12 smithi186 ceph-mon[126480]: pgmap v17042: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 846 KiB/s rd, 832 KiB/s wr, 29 op/s 2023-05-08T12:35:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:14 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:35:14.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:14 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:35:14.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31853.296437 secs 2023-05-08T12:35:14.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:14 smithi133 ceph-mon[125939]: pgmap v17043: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 846 KiB/s rd, 832 KiB/s wr, 29 op/s 2023-05-08T12:35:14.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31853.851976 secs 2023-05-08T12:35:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:14 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:35:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:14 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:35:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31853.296437 secs 2023-05-08T12:35:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:14 smithi096 ceph-mon[124666]: pgmap v17043: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 846 KiB/s rd, 832 KiB/s wr, 29 op/s 2023-05-08T12:35:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31853.851976 secs 2023-05-08T12:35:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:14 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:35:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:14 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:35:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31853.296437 secs 2023-05-08T12:35:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:14 smithi186 ceph-mon[126480]: pgmap v17043: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 846 KiB/s rd, 832 KiB/s wr, 29 op/s 2023-05-08T12:35:14.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31853.851976 secs 2023-05-08T12:35:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31855.142412 secs 2023-05-08T12:35:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:16 smithi186 ceph-mon[126480]: pgmap v17044: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 797 KiB/s rd, 776 KiB/s wr, 26 op/s 2023-05-08T12:35:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:16 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:35:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:16 smithi186 ceph-mon[126480]: osdmap e1143: 12 total, 12 up, 12 in 2023-05-08T12:35:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31855.142412 secs 2023-05-08T12:35:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:16 smithi133 ceph-mon[125939]: pgmap v17044: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 797 KiB/s rd, 776 KiB/s wr, 26 op/s 2023-05-08T12:35:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:16 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:35:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:16 smithi133 ceph-mon[125939]: osdmap e1143: 12 total, 12 up, 12 in 2023-05-08T12:35:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31855.142412 secs 2023-05-08T12:35:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:16 smithi096 ceph-mon[124666]: pgmap v17044: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 797 KiB/s rd, 776 KiB/s wr, 26 op/s 2023-05-08T12:35:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:16 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:35:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:16 smithi096 ceph-mon[124666]: osdmap e1143: 12 total, 12 up, 12 in 2023-05-08T12:35:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:18 smithi133 ceph-mon[125939]: pgmap v17046: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 405 KiB/s rd, 585 KiB/s wr, 6 op/s 2023-05-08T12:35:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:18 smithi096 ceph-mon[124666]: pgmap v17046: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 405 KiB/s rd, 585 KiB/s wr, 6 op/s 2023-05-08T12:35:19.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:18 smithi186 ceph-mon[126480]: pgmap v17046: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 405 KiB/s rd, 585 KiB/s wr, 6 op/s 2023-05-08T12:35:19.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31858.296547 secs 2023-05-08T12:35:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31858.852107 secs 2023-05-08T12:35:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31858.296547 secs 2023-05-08T12:35:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31858.852107 secs 2023-05-08T12:35:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31858.296547 secs 2023-05-08T12:35:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31858.852107 secs 2023-05-08T12:35:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:20 smithi133 ceph-mon[125939]: pgmap v17047: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 527 KiB/s rd, 552 KiB/s wr, 10 op/s 2023-05-08T12:35:21.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:20 smithi096 ceph-mon[124666]: pgmap v17047: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 527 KiB/s rd, 552 KiB/s wr, 10 op/s 2023-05-08T12:35:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:20 smithi186 ceph-mon[126480]: pgmap v17047: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 527 KiB/s rd, 552 KiB/s wr, 10 op/s 2023-05-08T12:35:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31860.142476 secs 2023-05-08T12:35:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31860.142476 secs 2023-05-08T12:35:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31860.142476 secs 2023-05-08T12:35:22.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:22 smithi133 ceph-mon[125939]: pgmap v17048: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 494 KiB/s rd, 516 KiB/s wr, 9 op/s 2023-05-08T12:35:23.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:22 smithi096 ceph-mon[124666]: pgmap v17048: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 494 KiB/s rd, 516 KiB/s wr, 9 op/s 2023-05-08T12:35:23.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:22 smithi186 ceph-mon[126480]: pgmap v17048: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 494 KiB/s rd, 516 KiB/s wr, 9 op/s 2023-05-08T12:35:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31863.296658 secs 2023-05-08T12:35:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:24 smithi133 ceph-mon[125939]: pgmap v17049: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 494 KiB/s rd, 516 KiB/s wr, 9 op/s 2023-05-08T12:35:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31863.852232 secs 2023-05-08T12:35:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31863.296658 secs 2023-05-08T12:35:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:24 smithi096 ceph-mon[124666]: pgmap v17049: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 494 KiB/s rd, 516 KiB/s wr, 9 op/s 2023-05-08T12:35:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31863.852232 secs 2023-05-08T12:35:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31863.296658 secs 2023-05-08T12:35:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:24 smithi186 ceph-mon[126480]: pgmap v17049: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 494 KiB/s rd, 516 KiB/s wr, 9 op/s 2023-05-08T12:35:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31863.852232 secs 2023-05-08T12:35:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31865.142599 secs 2023-05-08T12:35:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:26 smithi133 ceph-mon[125939]: pgmap v17050: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 292 KiB/s rd, 144 KiB/s wr, 9 op/s 2023-05-08T12:35:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31865.142599 secs 2023-05-08T12:35:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:26 smithi096 ceph-mon[124666]: pgmap v17050: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 292 KiB/s rd, 144 KiB/s wr, 9 op/s 2023-05-08T12:35:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31865.142599 secs 2023-05-08T12:35:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:26 smithi186 ceph-mon[126480]: pgmap v17050: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 292 KiB/s rd, 144 KiB/s wr, 9 op/s 2023-05-08T12:35:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:28 smithi133 ceph-mon[125939]: pgmap v17051: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 129 KiB/s wr, 8 op/s 2023-05-08T12:35:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:28 smithi096 ceph-mon[124666]: pgmap v17051: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 129 KiB/s wr, 8 op/s 2023-05-08T12:35:29.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:28 smithi186 ceph-mon[126480]: pgmap v17051: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 129 KiB/s wr, 8 op/s 2023-05-08T12:35:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31868.296781 secs 2023-05-08T12:35:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31868.852299 secs 2023-05-08T12:35:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31868.296781 secs 2023-05-08T12:35:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31868.852299 secs 2023-05-08T12:35:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31868.296781 secs 2023-05-08T12:35:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31868.852299 secs 2023-05-08T12:35:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:30 smithi133 ceph-mon[125939]: pgmap v17052: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 491 KiB/s wr, 11 op/s 2023-05-08T12:35:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:30 smithi096 ceph-mon[124666]: pgmap v17052: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 491 KiB/s wr, 11 op/s 2023-05-08T12:35:31.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:30 smithi186 ceph-mon[126480]: pgmap v17052: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 491 KiB/s wr, 11 op/s 2023-05-08T12:35:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31870.142716 secs 2023-05-08T12:35:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:31 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:35:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:31 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:35:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:31 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:35:31.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:31 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:35:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31870.142716 secs 2023-05-08T12:35:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:31 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:35:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:31 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:35:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:31 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:35:32.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:31 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:35:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31870.142716 secs 2023-05-08T12:35:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:31 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:35:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:31 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:35:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:31 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:35:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:31 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:35:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:32 smithi133 ceph-mon[125939]: pgmap v17053: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 469 KiB/s wr, 8 op/s 2023-05-08T12:35:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:32 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:35:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:32 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T12:35:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:32 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T12:35:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:32 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:35:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:32 smithi096 ceph-mon[124666]: pgmap v17053: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 469 KiB/s wr, 8 op/s 2023-05-08T12:35:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:32 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:35:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:32 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T12:35:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:32 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T12:35:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:32 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:35:33.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:32 smithi186 ceph-mon[126480]: pgmap v17053: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 469 KiB/s wr, 8 op/s 2023-05-08T12:35:33.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:32 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:35:33.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:32 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T12:35:33.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:32 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T12:35:33.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:32 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:35:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31873.296900 secs 2023-05-08T12:35:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:34 smithi133 ceph-mon[125939]: pgmap v17054: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 449 KiB/s wr, 7 op/s 2023-05-08T12:35:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31873.852423 secs 2023-05-08T12:35:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31873.296900 secs 2023-05-08T12:35:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:34 smithi096 ceph-mon[124666]: pgmap v17054: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 449 KiB/s wr, 7 op/s 2023-05-08T12:35:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31873.852423 secs 2023-05-08T12:35:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31873.296900 secs 2023-05-08T12:35:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:34 smithi186 ceph-mon[126480]: pgmap v17054: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 449 KiB/s wr, 7 op/s 2023-05-08T12:35:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31873.852423 secs 2023-05-08T12:35:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31875.142835 secs 2023-05-08T12:35:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31875.142835 secs 2023-05-08T12:35:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31875.142835 secs 2023-05-08T12:35:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:36 smithi133 ceph-mon[125939]: pgmap v17055: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 450 KiB/s wr, 11 op/s 2023-05-08T12:35:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:36 smithi096 ceph-mon[124666]: pgmap v17055: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 450 KiB/s wr, 11 op/s 2023-05-08T12:35:37.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:36 smithi186 ceph-mon[126480]: pgmap v17055: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 450 KiB/s wr, 11 op/s 2023-05-08T12:35:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:38 smithi133 ceph-mon[125939]: pgmap v17056: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 371 KiB/s wr, 7 op/s 2023-05-08T12:35:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:38 smithi096 ceph-mon[124666]: pgmap v17056: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 371 KiB/s wr, 7 op/s 2023-05-08T12:35:39.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:38 smithi186 ceph-mon[126480]: pgmap v17056: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 371 KiB/s wr, 7 op/s 2023-05-08T12:35:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31878.297021 secs 2023-05-08T12:35:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31878.852554 secs 2023-05-08T12:35:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31878.297021 secs 2023-05-08T12:35:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31878.852554 secs 2023-05-08T12:35:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31878.297021 secs 2023-05-08T12:35:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31878.852554 secs 2023-05-08T12:35:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:40 smithi133 ceph-mon[125939]: pgmap v17057: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 621 KiB/s wr, 10 op/s 2023-05-08T12:35:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31880.142912 secs 2023-05-08T12:35:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:40 smithi096 ceph-mon[124666]: pgmap v17057: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 621 KiB/s wr, 10 op/s 2023-05-08T12:35:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31880.142912 secs 2023-05-08T12:35:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:40 smithi186 ceph-mon[126480]: pgmap v17057: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 621 KiB/s wr, 10 op/s 2023-05-08T12:35:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31880.142912 secs 2023-05-08T12:35:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:42 smithi133 ceph-mon[125939]: pgmap v17058: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 251 KiB/s wr, 7 op/s 2023-05-08T12:35:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:42 smithi096 ceph-mon[124666]: pgmap v17058: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 251 KiB/s wr, 7 op/s 2023-05-08T12:35:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:42 smithi186 ceph-mon[126480]: pgmap v17058: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 251 KiB/s wr, 7 op/s 2023-05-08T12:35:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31883.297137 secs 2023-05-08T12:35:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:44 smithi133 ceph-mon[125939]: pgmap v17059: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 251 KiB/s wr, 6 op/s 2023-05-08T12:35:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31883.852678 secs 2023-05-08T12:35:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31883.297137 secs 2023-05-08T12:35:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:44 smithi096 ceph-mon[124666]: pgmap v17059: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 251 KiB/s wr, 6 op/s 2023-05-08T12:35:45.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31883.852678 secs 2023-05-08T12:35:45.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31883.297137 secs 2023-05-08T12:35:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:44 smithi186 ceph-mon[126480]: pgmap v17059: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 251 KiB/s wr, 6 op/s 2023-05-08T12:35:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31883.852678 secs 2023-05-08T12:35:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:46 smithi133 ceph-mon[125939]: pgmap v17060: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 640 KiB/s rd, 266 KiB/s wr, 10 op/s 2023-05-08T12:35:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:46 smithi096 ceph-mon[124666]: pgmap v17060: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 640 KiB/s rd, 266 KiB/s wr, 10 op/s 2023-05-08T12:35:47.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:46 smithi186 ceph-mon[126480]: pgmap v17060: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 640 KiB/s rd, 266 KiB/s wr, 10 op/s 2023-05-08T12:35:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:48 smithi133 ceph-mon[125939]: pgmap v17061: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 266 KiB/s wr, 6 op/s 2023-05-08T12:35:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:35:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:48 smithi096 ceph-mon[124666]: pgmap v17061: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 266 KiB/s wr, 6 op/s 2023-05-08T12:35:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:35:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:48 smithi186 ceph-mon[126480]: pgmap v17061: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 266 KiB/s wr, 6 op/s 2023-05-08T12:35:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:35:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31888.297261 secs 2023-05-08T12:35:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:35:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:35:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:35:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31888.297261 secs 2023-05-08T12:35:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:35:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:35:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:35:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31888.297261 secs 2023-05-08T12:35:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:35:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:35:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:35:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:50 smithi133 ceph-mon[125939]: pgmap v17062: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 818 KiB/s rd, 771 KiB/s wr, 10 op/s 2023-05-08T12:35:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:50 smithi096 ceph-mon[124666]: pgmap v17062: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 818 KiB/s rd, 771 KiB/s wr, 10 op/s 2023-05-08T12:35:51.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:50 smithi186 ceph-mon[126480]: pgmap v17062: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 818 KiB/s rd, 771 KiB/s wr, 10 op/s 2023-05-08T12:35:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:52 smithi133 ceph-mon[125939]: pgmap v17063: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 817 KiB/s rd, 542 KiB/s wr, 8 op/s 2023-05-08T12:35:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:52 smithi096 ceph-mon[124666]: pgmap v17063: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 817 KiB/s rd, 542 KiB/s wr, 8 op/s 2023-05-08T12:35:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:52 smithi186 ceph-mon[126480]: pgmap v17063: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 817 KiB/s rd, 542 KiB/s wr, 8 op/s 2023-05-08T12:35:53.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:53 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:35:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:53 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:35:53.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:53 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:35:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:54 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:35:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:54 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:35:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31893.297322 secs 2023-05-08T12:35:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:54 smithi133 ceph-mon[125939]: pgmap v17064: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 817 KiB/s rd, 542 KiB/s wr, 8 op/s 2023-05-08T12:35:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:54 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:35:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:54 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:35:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31893.297322 secs 2023-05-08T12:35:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:54 smithi096 ceph-mon[124666]: pgmap v17064: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 817 KiB/s rd, 542 KiB/s wr, 8 op/s 2023-05-08T12:35:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:54 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:35:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:54 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:35:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31893.297322 secs 2023-05-08T12:35:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:54 smithi186 ceph-mon[126480]: pgmap v17064: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 817 KiB/s rd, 542 KiB/s wr, 8 op/s 2023-05-08T12:35:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:56 smithi133 ceph-mon[125939]: pgmap v17065: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 997 KiB/s rd, 988 KiB/s wr, 13 op/s 2023-05-08T12:35:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:56 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:35:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:56 smithi096 ceph-mon[124666]: pgmap v17065: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 997 KiB/s rd, 988 KiB/s wr, 13 op/s 2023-05-08T12:35:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:56 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:35:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:56 smithi186 ceph-mon[126480]: pgmap v17065: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 997 KiB/s rd, 988 KiB/s wr, 13 op/s 2023-05-08T12:35:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:56 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:35:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:58 smithi133 ceph-mon[125939]: pgmap v17066: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 730 KiB/s rd, 973 KiB/s wr, 10 op/s 2023-05-08T12:35:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:58 smithi096 ceph-mon[124666]: pgmap v17066: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 730 KiB/s rd, 973 KiB/s wr, 10 op/s 2023-05-08T12:35:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:58 smithi186 ceph-mon[126480]: pgmap v17066: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 730 KiB/s rd, 973 KiB/s wr, 10 op/s 2023-05-08T12:35:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31898.297445 secs 2023-05-08T12:35:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:35:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31898.852995 secs 2023-05-08T12:36:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31898.297445 secs 2023-05-08T12:36:00.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:35:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31898.852995 secs 2023-05-08T12:36:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31898.297445 secs 2023-05-08T12:36:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:35:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31898.852995 secs 2023-05-08T12:36:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:00 smithi133 ceph-mon[125939]: pgmap v17067: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T12:36:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:00 smithi096 ceph-mon[124666]: pgmap v17067: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T12:36:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:00 smithi186 ceph-mon[126480]: pgmap v17067: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T12:36:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:36:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:36:01.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:01 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:36:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:36:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:36:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:01 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:36:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:36:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:36:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:01 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:36:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:02 smithi133 ceph-mon[125939]: pgmap v17068: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 823 KiB/s rd, 585 KiB/s wr, 11 op/s 2023-05-08T12:36:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:02 smithi096 ceph-mon[124666]: pgmap v17068: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 823 KiB/s rd, 585 KiB/s wr, 11 op/s 2023-05-08T12:36:03.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:02 smithi186 ceph-mon[126480]: pgmap v17068: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 823 KiB/s rd, 585 KiB/s wr, 11 op/s 2023-05-08T12:36:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31903.297548 secs 2023-05-08T12:36:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:04 smithi133 ceph-mon[125939]: pgmap v17069: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 823 KiB/s rd, 563 KiB/s wr, 10 op/s 2023-05-08T12:36:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31903.853132 secs 2023-05-08T12:36:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31903.297548 secs 2023-05-08T12:36:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:04 smithi096 ceph-mon[124666]: pgmap v17069: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 823 KiB/s rd, 563 KiB/s wr, 10 op/s 2023-05-08T12:36:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31903.853132 secs 2023-05-08T12:36:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31903.297548 secs 2023-05-08T12:36:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:04 smithi186 ceph-mon[126480]: pgmap v17069: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 823 KiB/s rd, 563 KiB/s wr, 10 op/s 2023-05-08T12:36:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31903.853132 secs 2023-05-08T12:36:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:06 smithi133 ceph-mon[125939]: pgmap v17070: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 924 KiB/s wr, 27 op/s 2023-05-08T12:36:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:06 smithi096 ceph-mon[124666]: pgmap v17070: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 924 KiB/s wr, 27 op/s 2023-05-08T12:36:07.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:06 smithi186 ceph-mon[126480]: pgmap v17070: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 924 KiB/s wr, 27 op/s 2023-05-08T12:36:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:08 smithi133 ceph-mon[125939]: pgmap v17071: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 479 KiB/s wr, 21 op/s 2023-05-08T12:36:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:08 smithi096 ceph-mon[124666]: pgmap v17071: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 479 KiB/s wr, 21 op/s 2023-05-08T12:36:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:08 smithi186 ceph-mon[126480]: pgmap v17071: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 479 KiB/s wr, 21 op/s 2023-05-08T12:36:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31908.297668 secs 2023-05-08T12:36:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31908.853274 secs 2023-05-08T12:36:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31908.297668 secs 2023-05-08T12:36:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31908.853274 secs 2023-05-08T12:36:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31908.297668 secs 2023-05-08T12:36:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31908.853274 secs 2023-05-08T12:36:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:10 smithi133 ceph-mon[125939]: pgmap v17072: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 600 KiB/s wr, 23 op/s 2023-05-08T12:36:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:10 smithi096 ceph-mon[124666]: pgmap v17072: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 600 KiB/s wr, 23 op/s 2023-05-08T12:36:11.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:10 smithi186 ceph-mon[126480]: pgmap v17072: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 600 KiB/s wr, 23 op/s 2023-05-08T12:36:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:12 smithi133 ceph-mon[125939]: pgmap v17073: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 595 KiB/s rd, 483 KiB/s wr, 19 op/s 2023-05-08T12:36:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:12 smithi096 ceph-mon[124666]: pgmap v17073: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 595 KiB/s rd, 483 KiB/s wr, 19 op/s 2023-05-08T12:36:12.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:12 smithi186 ceph-mon[126480]: pgmap v17073: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 595 KiB/s rd, 483 KiB/s wr, 19 op/s 2023-05-08T12:36:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31913.297751 secs 2023-05-08T12:36:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:14 smithi133 ceph-mon[125939]: pgmap v17074: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 574 KiB/s rd, 483 KiB/s wr, 18 op/s 2023-05-08T12:36:14.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31913.853373 secs 2023-05-08T12:36:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31913.297751 secs 2023-05-08T12:36:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:14 smithi096 ceph-mon[124666]: pgmap v17074: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 574 KiB/s rd, 483 KiB/s wr, 18 op/s 2023-05-08T12:36:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31913.853373 secs 2023-05-08T12:36:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31913.297751 secs 2023-05-08T12:36:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:14 smithi186 ceph-mon[126480]: pgmap v17074: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 574 KiB/s rd, 483 KiB/s wr, 18 op/s 2023-05-08T12:36:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31913.853373 secs 2023-05-08T12:36:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:16 smithi133 ceph-mon[125939]: pgmap v17075: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 883 KiB/s rd, 670 KiB/s wr, 22 op/s 2023-05-08T12:36:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:16 smithi096 ceph-mon[124666]: pgmap v17075: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 883 KiB/s rd, 670 KiB/s wr, 22 op/s 2023-05-08T12:36:17.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:16 smithi186 ceph-mon[126480]: pgmap v17075: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 883 KiB/s rd, 670 KiB/s wr, 22 op/s 2023-05-08T12:36:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:18 smithi133 ceph-mon[125939]: pgmap v17076: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 311 KiB/s rd, 308 KiB/s wr, 6 op/s 2023-05-08T12:36:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:18 smithi096 ceph-mon[124666]: pgmap v17076: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 311 KiB/s rd, 308 KiB/s wr, 6 op/s 2023-05-08T12:36:19.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:18 smithi186 ceph-mon[126480]: pgmap v17076: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 311 KiB/s rd, 308 KiB/s wr, 6 op/s 2023-05-08T12:36:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31918.297884 secs 2023-05-08T12:36:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31918.297884 secs 2023-05-08T12:36:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31918.297884 secs 2023-05-08T12:36:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:20 smithi133 ceph-mon[125939]: pgmap v17077: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 860 KiB/s rd, 878 KiB/s wr, 13 op/s 2023-05-08T12:36:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:20 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:36:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:20 smithi096 ceph-mon[124666]: pgmap v17077: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 860 KiB/s rd, 878 KiB/s wr, 13 op/s 2023-05-08T12:36:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:20 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:36:21.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:20 smithi186 ceph-mon[126480]: pgmap v17077: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 860 KiB/s rd, 878 KiB/s wr, 13 op/s 2023-05-08T12:36:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:20 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:36:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31920.143734 secs 2023-05-08T12:36:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:21 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:36:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:21 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:36:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:21 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:36:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31920.143734 secs 2023-05-08T12:36:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:21 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:36:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:21 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:36:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:21 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:36:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31920.143734 secs 2023-05-08T12:36:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:21 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:36:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:21 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:36:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:21 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:36:22.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:22 smithi133 ceph-mon[125939]: pgmap v17078: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 858 KiB/s rd, 756 KiB/s wr, 12 op/s 2023-05-08T12:36:23.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:22 smithi096 ceph-mon[124666]: pgmap v17078: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 858 KiB/s rd, 756 KiB/s wr, 12 op/s 2023-05-08T12:36:23.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:22 smithi186 ceph-mon[126480]: pgmap v17078: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 858 KiB/s rd, 756 KiB/s wr, 12 op/s 2023-05-08T12:36:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31923.298015 secs 2023-05-08T12:36:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:24 smithi133 ceph-mon[125939]: pgmap v17079: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 858 KiB/s rd, 756 KiB/s wr, 11 op/s 2023-05-08T12:36:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31923.298015 secs 2023-05-08T12:36:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:24 smithi096 ceph-mon[124666]: pgmap v17079: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 858 KiB/s rd, 756 KiB/s wr, 11 op/s 2023-05-08T12:36:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31923.298015 secs 2023-05-08T12:36:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:24 smithi186 ceph-mon[126480]: pgmap v17079: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 858 KiB/s rd, 756 KiB/s wr, 11 op/s 2023-05-08T12:36:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31925.143853 secs 2023-05-08T12:36:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31925.143853 secs 2023-05-08T12:36:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31925.143853 secs 2023-05-08T12:36:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:26 smithi133 ceph-mon[125939]: pgmap v17080: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 882 KiB/s rd, 779 KiB/s wr, 15 op/s 2023-05-08T12:36:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:26 smithi133 ceph-mon[125939]: osdmap e1144: 12 total, 12 up, 12 in 2023-05-08T12:36:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:26 smithi096 ceph-mon[124666]: pgmap v17080: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 882 KiB/s rd, 779 KiB/s wr, 15 op/s 2023-05-08T12:36:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:26 smithi096 ceph-mon[124666]: osdmap e1144: 12 total, 12 up, 12 in 2023-05-08T12:36:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:26 smithi186 ceph-mon[126480]: pgmap v17080: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 882 KiB/s rd, 779 KiB/s wr, 15 op/s 2023-05-08T12:36:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:26 smithi186 ceph-mon[126480]: osdmap e1144: 12 total, 12 up, 12 in 2023-05-08T12:36:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:28 smithi133 ceph-mon[125939]: pgmap v17082: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 711 KiB/s wr, 13 op/s 2023-05-08T12:36:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:28 smithi096 ceph-mon[124666]: pgmap v17082: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 711 KiB/s wr, 13 op/s 2023-05-08T12:36:29.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:28 smithi186 ceph-mon[126480]: pgmap v17082: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 711 KiB/s wr, 13 op/s 2023-05-08T12:36:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31928.298151 secs 2023-05-08T12:36:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31928.298151 secs 2023-05-08T12:36:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31928.298151 secs 2023-05-08T12:36:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:30 smithi133 ceph-mon[125939]: pgmap v17083: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 257 KiB/s wr, 8 op/s 2023-05-08T12:36:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31930.143976 secs 2023-05-08T12:36:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:30 smithi096 ceph-mon[124666]: pgmap v17083: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 257 KiB/s wr, 8 op/s 2023-05-08T12:36:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31930.143976 secs 2023-05-08T12:36:31.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:30 smithi186 ceph-mon[126480]: pgmap v17083: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 257 KiB/s wr, 8 op/s 2023-05-08T12:36:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31930.143976 secs 2023-05-08T12:36:32.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:32 smithi133 ceph-mon[125939]: pgmap v17084: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 257 KiB/s wr, 8 op/s 2023-05-08T12:36:32.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:36:32.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:36:32.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:36:32.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:36:32.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:32 smithi096 ceph-mon[124666]: pgmap v17084: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 257 KiB/s wr, 8 op/s 2023-05-08T12:36:32.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:36:32.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:36:32.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:36:32.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:36:32.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:32 smithi186 ceph-mon[126480]: pgmap v17084: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 257 KiB/s wr, 8 op/s 2023-05-08T12:36:32.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:36:32.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:36:32.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:36:32.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:36:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:33 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:36:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:33 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T12:36:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:33 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T12:36:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:33 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:36:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:33 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:36:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:33 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T12:36:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:33 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T12:36:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:33 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:36:33.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:33 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:36:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:33 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T12:36:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:33 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T12:36:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:33 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:36:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31933.298219 secs 2023-05-08T12:36:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:34 smithi133 ceph-mon[125939]: pgmap v17085: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 257 KiB/s wr, 8 op/s 2023-05-08T12:36:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31933.298219 secs 2023-05-08T12:36:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:34 smithi096 ceph-mon[124666]: pgmap v17085: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 257 KiB/s wr, 8 op/s 2023-05-08T12:36:34.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31933.298219 secs 2023-05-08T12:36:34.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:34 smithi186 ceph-mon[126480]: pgmap v17085: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 257 KiB/s wr, 8 op/s 2023-05-08T12:36:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31935.144119 secs 2023-05-08T12:36:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:36 smithi133 ceph-mon[125939]: pgmap v17086: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 487 KiB/s rd, 766 KiB/s wr, 9 op/s 2023-05-08T12:36:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:36 smithi133 ceph-mon[125939]: osdmap e1145: 12 total, 12 up, 12 in 2023-05-08T12:36:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31935.144119 secs 2023-05-08T12:36:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:36 smithi096 ceph-mon[124666]: pgmap v17086: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 487 KiB/s rd, 766 KiB/s wr, 9 op/s 2023-05-08T12:36:37.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:36 smithi096 ceph-mon[124666]: osdmap e1145: 12 total, 12 up, 12 in 2023-05-08T12:36:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31935.144119 secs 2023-05-08T12:36:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:36 smithi186 ceph-mon[126480]: pgmap v17086: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 487 KiB/s rd, 766 KiB/s wr, 9 op/s 2023-05-08T12:36:37.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:36 smithi186 ceph-mon[126480]: osdmap e1145: 12 total, 12 up, 12 in 2023-05-08T12:36:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:38 smithi133 ceph-mon[125939]: pgmap v17088: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 487 KiB/s rd, 766 KiB/s wr, 9 op/s 2023-05-08T12:36:39.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:38 smithi096 ceph-mon[124666]: pgmap v17088: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 487 KiB/s rd, 766 KiB/s wr, 9 op/s 2023-05-08T12:36:39.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:38 smithi186 ceph-mon[126480]: pgmap v17088: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 487 KiB/s rd, 766 KiB/s wr, 9 op/s 2023-05-08T12:36:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31938.298347 secs 2023-05-08T12:36:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31938.853923 secs 2023-05-08T12:36:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31938.298347 secs 2023-05-08T12:36:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31938.853923 secs 2023-05-08T12:36:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31938.298347 secs 2023-05-08T12:36:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31938.853923 secs 2023-05-08T12:36:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:40 smithi133 ceph-mon[125939]: pgmap v17089: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 959 KiB/s wr, 11 op/s 2023-05-08T12:36:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:40 smithi096 ceph-mon[124666]: pgmap v17089: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 959 KiB/s wr, 11 op/s 2023-05-08T12:36:41.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:40 smithi186 ceph-mon[126480]: pgmap v17089: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 959 KiB/s wr, 11 op/s 2023-05-08T12:36:41.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31940.144237 secs 2023-05-08T12:36:41.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:41 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:36:41.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:41 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:36:41.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:41 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:36:42.009 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31940.144237 secs 2023-05-08T12:36:42.009 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:41 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:36:42.010 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:41 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:36:42.010 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:41 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:36:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31940.144237 secs 2023-05-08T12:36:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:41 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:36:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:41 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:36:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:41 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:36:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:42 smithi133 ceph-mon[125939]: pgmap v17090: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 959 KiB/s wr, 11 op/s 2023-05-08T12:36:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:42 smithi096 ceph-mon[124666]: pgmap v17090: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 959 KiB/s wr, 11 op/s 2023-05-08T12:36:43.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:42 smithi186 ceph-mon[126480]: pgmap v17090: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 959 KiB/s wr, 11 op/s 2023-05-08T12:36:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31943.298465 secs 2023-05-08T12:36:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:44 smithi133 ceph-mon[125939]: pgmap v17091: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 959 KiB/s wr, 11 op/s 2023-05-08T12:36:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31943.854006 secs 2023-05-08T12:36:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31943.298465 secs 2023-05-08T12:36:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:44 smithi096 ceph-mon[124666]: pgmap v17091: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 959 KiB/s wr, 11 op/s 2023-05-08T12:36:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31943.854006 secs 2023-05-08T12:36:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31943.298465 secs 2023-05-08T12:36:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:44 smithi186 ceph-mon[126480]: pgmap v17091: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 959 KiB/s wr, 11 op/s 2023-05-08T12:36:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31943.854006 secs 2023-05-08T12:36:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:46 smithi133 ceph-mon[125939]: pgmap v17092: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T12:36:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:46 smithi096 ceph-mon[124666]: pgmap v17092: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T12:36:47.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:46 smithi186 ceph-mon[126480]: pgmap v17092: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T12:36:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:48 smithi133 ceph-mon[125939]: pgmap v17093: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T12:36:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:36:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:48 smithi096 ceph-mon[124666]: pgmap v17093: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T12:36:49.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:36:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:48 smithi186 ceph-mon[126480]: pgmap v17093: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T12:36:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:36:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31948.298584 secs 2023-05-08T12:36:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:36:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:36:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:36:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31948.298584 secs 2023-05-08T12:36:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:36:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:36:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:36:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31948.298584 secs 2023-05-08T12:36:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:36:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:36:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:36:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:50 smithi133 ceph-mon[125939]: pgmap v17094: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 15 op/s 2023-05-08T12:36:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:50 smithi096 ceph-mon[124666]: pgmap v17094: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 15 op/s 2023-05-08T12:36:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:50 smithi186 ceph-mon[126480]: pgmap v17094: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 15 op/s 2023-05-08T12:36:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:52 smithi133 ceph-mon[125939]: pgmap v17095: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 860 KiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T12:36:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:52 smithi096 ceph-mon[124666]: pgmap v17095: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 860 KiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T12:36:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:52 smithi186 ceph-mon[126480]: pgmap v17095: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 860 KiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T12:36:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:53 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:36:53.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:53 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:36:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:53 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:36:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:54 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:36:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:54 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:36:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31953.298696 secs 2023-05-08T12:36:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:54 smithi133 ceph-mon[125939]: pgmap v17096: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 860 KiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T12:36:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31953.854267 secs 2023-05-08T12:36:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:54 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:36:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:54 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:36:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31953.298696 secs 2023-05-08T12:36:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:54 smithi096 ceph-mon[124666]: pgmap v17096: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 860 KiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T12:36:54.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31953.854267 secs 2023-05-08T12:36:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:54 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:36:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:54 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:36:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31953.298696 secs 2023-05-08T12:36:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:54 smithi186 ceph-mon[126480]: pgmap v17096: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 860 KiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T12:36:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31953.854267 secs 2023-05-08T12:36:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:56 smithi133 ceph-mon[125939]: pgmap v17097: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 17 op/s 2023-05-08T12:36:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:56 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:36:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:56 smithi096 ceph-mon[124666]: pgmap v17097: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 17 op/s 2023-05-08T12:36:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:56 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:36:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:56 smithi186 ceph-mon[126480]: pgmap v17097: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 17 op/s 2023-05-08T12:36:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:56 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:36:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:36:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:36:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:58 smithi133 ceph-mon[125939]: pgmap v17098: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T12:36:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:36:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:36:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:58 smithi096 ceph-mon[124666]: pgmap v17098: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T12:36:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:36:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:36:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:58 smithi186 ceph-mon[126480]: pgmap v17098: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T12:36:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31958.298778 secs 2023-05-08T12:36:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:36:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31958.854403 secs 2023-05-08T12:36:59.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31958.298778 secs 2023-05-08T12:36:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:36:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31958.854403 secs 2023-05-08T12:36:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31958.298778 secs 2023-05-08T12:36:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:36:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31958.854403 secs 2023-05-08T12:37:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:00 smithi133 ceph-mon[125939]: pgmap v17099: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 16 op/s 2023-05-08T12:37:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:00 smithi096 ceph-mon[124666]: pgmap v17099: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 16 op/s 2023-05-08T12:37:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:00 smithi186 ceph-mon[126480]: pgmap v17099: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 16 op/s 2023-05-08T12:37:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31960.144812 secs 2023-05-08T12:37:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:01 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:37:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31960.144812 secs 2023-05-08T12:37:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:01 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:37:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31960.144812 secs 2023-05-08T12:37:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:01 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:37:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:37:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:37:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:02 smithi133 ceph-mon[125939]: pgmap v17100: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 935 KiB/s wr, 12 op/s 2023-05-08T12:37:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:37:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:37:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:02 smithi096 ceph-mon[124666]: pgmap v17100: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 935 KiB/s wr, 12 op/s 2023-05-08T12:37:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:37:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:37:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:02 smithi186 ceph-mon[126480]: pgmap v17100: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 935 KiB/s wr, 12 op/s 2023-05-08T12:37:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31963.298897 secs 2023-05-08T12:37:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:04 smithi133 ceph-mon[125939]: pgmap v17101: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 915 KiB/s wr, 11 op/s 2023-05-08T12:37:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31963.854525 secs 2023-05-08T12:37:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31963.298897 secs 2023-05-08T12:37:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:04 smithi096 ceph-mon[124666]: pgmap v17101: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 915 KiB/s wr, 11 op/s 2023-05-08T12:37:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31963.854525 secs 2023-05-08T12:37:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31963.298897 secs 2023-05-08T12:37:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:04 smithi186 ceph-mon[126480]: pgmap v17101: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 915 KiB/s wr, 11 op/s 2023-05-08T12:37:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31963.854525 secs 2023-05-08T12:37:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31965.144909 secs 2023-05-08T12:37:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:06 smithi133 ceph-mon[125939]: pgmap v17102: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 30 op/s 2023-05-08T12:37:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:06 smithi133 ceph-mon[125939]: osdmap e1146: 12 total, 12 up, 12 in 2023-05-08T12:37:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:06 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:37:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31965.144909 secs 2023-05-08T12:37:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:06 smithi096 ceph-mon[124666]: pgmap v17102: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 30 op/s 2023-05-08T12:37:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:06 smithi096 ceph-mon[124666]: osdmap e1146: 12 total, 12 up, 12 in 2023-05-08T12:37:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:06 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:37:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31965.144909 secs 2023-05-08T12:37:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:06 smithi186 ceph-mon[126480]: pgmap v17102: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 30 op/s 2023-05-08T12:37:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:06 smithi186 ceph-mon[126480]: osdmap e1146: 12 total, 12 up, 12 in 2023-05-08T12:37:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:06 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:37:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:08 smithi133 ceph-mon[125939]: pgmap v17104: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1007 KiB/s wr, 28 op/s 2023-05-08T12:37:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:08 smithi096 ceph-mon[124666]: pgmap v17104: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1007 KiB/s wr, 28 op/s 2023-05-08T12:37:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:08 smithi186 ceph-mon[126480]: pgmap v17104: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1007 KiB/s wr, 28 op/s 2023-05-08T12:37:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31968.299015 secs 2023-05-08T12:37:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31968.854580 secs 2023-05-08T12:37:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31968.299015 secs 2023-05-08T12:37:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31968.854580 secs 2023-05-08T12:37:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31968.299015 secs 2023-05-08T12:37:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31968.854580 secs 2023-05-08T12:37:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:10 smithi133 ceph-mon[125939]: pgmap v17105: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 972 KiB/s wr, 28 op/s 2023-05-08T12:37:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:10 smithi096 ceph-mon[124666]: pgmap v17105: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 972 KiB/s wr, 28 op/s 2023-05-08T12:37:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:10 smithi186 ceph-mon[126480]: pgmap v17105: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 972 KiB/s wr, 28 op/s 2023-05-08T12:37:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31970.145030 secs 2023-05-08T12:37:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31970.145030 secs 2023-05-08T12:37:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31970.145030 secs 2023-05-08T12:37:12.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:12 smithi133 ceph-mon[125939]: pgmap v17106: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 972 KiB/s wr, 27 op/s 2023-05-08T12:37:13.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:12 smithi096 ceph-mon[124666]: pgmap v17106: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 972 KiB/s wr, 27 op/s 2023-05-08T12:37:13.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:12 smithi186 ceph-mon[126480]: pgmap v17106: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 972 KiB/s wr, 27 op/s 2023-05-08T12:37:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31973.299153 secs 2023-05-08T12:37:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:14 smithi133 ceph-mon[125939]: pgmap v17107: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 972 KiB/s wr, 27 op/s 2023-05-08T12:37:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31973.854694 secs 2023-05-08T12:37:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31973.299153 secs 2023-05-08T12:37:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:14 smithi096 ceph-mon[124666]: pgmap v17107: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 972 KiB/s wr, 27 op/s 2023-05-08T12:37:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31973.854694 secs 2023-05-08T12:37:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31973.299153 secs 2023-05-08T12:37:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:14 smithi186 ceph-mon[126480]: pgmap v17107: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 972 KiB/s wr, 27 op/s 2023-05-08T12:37:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31973.854694 secs 2023-05-08T12:37:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31975.145150 secs 2023-05-08T12:37:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31975.145150 secs 2023-05-08T12:37:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31975.145150 secs 2023-05-08T12:37:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:16 smithi133 ceph-mon[125939]: pgmap v17108: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 844 KiB/s rd, 394 KiB/s wr, 8 op/s 2023-05-08T12:37:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:16 smithi133 ceph-mon[125939]: osdmap e1147: 12 total, 12 up, 12 in 2023-05-08T12:37:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:16 smithi096 ceph-mon[124666]: pgmap v17108: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 844 KiB/s rd, 394 KiB/s wr, 8 op/s 2023-05-08T12:37:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:16 smithi096 ceph-mon[124666]: osdmap e1147: 12 total, 12 up, 12 in 2023-05-08T12:37:17.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:16 smithi186 ceph-mon[126480]: pgmap v17108: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 844 KiB/s rd, 394 KiB/s wr, 8 op/s 2023-05-08T12:37:17.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:16 smithi186 ceph-mon[126480]: osdmap e1147: 12 total, 12 up, 12 in 2023-05-08T12:37:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:18 smithi133 ceph-mon[125939]: pgmap v17110: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 844 KiB/s rd, 394 KiB/s wr, 8 op/s 2023-05-08T12:37:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:18 smithi096 ceph-mon[124666]: pgmap v17110: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 844 KiB/s rd, 394 KiB/s wr, 8 op/s 2023-05-08T12:37:19.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:18 smithi186 ceph-mon[126480]: pgmap v17110: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 844 KiB/s rd, 394 KiB/s wr, 8 op/s 2023-05-08T12:37:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31978.299277 secs 2023-05-08T12:37:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31978.854790 secs 2023-05-08T12:37:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31978.299277 secs 2023-05-08T12:37:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31978.854790 secs 2023-05-08T12:37:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31978.299277 secs 2023-05-08T12:37:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31978.854790 secs 2023-05-08T12:37:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:20 smithi133 ceph-mon[125939]: pgmap v17111: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 272 KiB/s wr, 8 op/s 2023-05-08T12:37:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31980.145301 secs 2023-05-08T12:37:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:20 smithi096 ceph-mon[124666]: pgmap v17111: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 272 KiB/s wr, 8 op/s 2023-05-08T12:37:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31980.145301 secs 2023-05-08T12:37:21.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:20 smithi186 ceph-mon[126480]: pgmap v17111: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 272 KiB/s wr, 8 op/s 2023-05-08T12:37:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31980.145301 secs 2023-05-08T12:37:22.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:22 smithi133 ceph-mon[125939]: pgmap v17112: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 297 KiB/s wr, 8 op/s 2023-05-08T12:37:22.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:22 smithi096 ceph-mon[124666]: pgmap v17112: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 297 KiB/s wr, 8 op/s 2023-05-08T12:37:22.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:22 smithi186 ceph-mon[126480]: pgmap v17112: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 297 KiB/s wr, 8 op/s 2023-05-08T12:37:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31983.299366 secs 2023-05-08T12:37:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:24 smithi133 ceph-mon[125939]: pgmap v17113: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 297 KiB/s wr, 8 op/s 2023-05-08T12:37:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31983.854886 secs 2023-05-08T12:37:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31983.299366 secs 2023-05-08T12:37:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:24 smithi096 ceph-mon[124666]: pgmap v17113: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 297 KiB/s wr, 8 op/s 2023-05-08T12:37:25.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31983.854886 secs 2023-05-08T12:37:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31983.299366 secs 2023-05-08T12:37:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:24 smithi186 ceph-mon[126480]: pgmap v17113: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 297 KiB/s wr, 8 op/s 2023-05-08T12:37:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31983.854886 secs 2023-05-08T12:37:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31985.145446 secs 2023-05-08T12:37:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:26 smithi133 ceph-mon[125939]: pgmap v17114: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 51 KiB/s wr, 9 op/s 2023-05-08T12:37:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31985.145446 secs 2023-05-08T12:37:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:26 smithi096 ceph-mon[124666]: pgmap v17114: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 51 KiB/s wr, 9 op/s 2023-05-08T12:37:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31985.145446 secs 2023-05-08T12:37:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:26 smithi186 ceph-mon[126480]: pgmap v17114: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 51 KiB/s wr, 9 op/s 2023-05-08T12:37:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:28 smithi133 ceph-mon[125939]: pgmap v17115: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 46 KiB/s wr, 8 op/s 2023-05-08T12:37:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:28 smithi096 ceph-mon[124666]: pgmap v17115: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 46 KiB/s wr, 8 op/s 2023-05-08T12:37:29.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:28 smithi186 ceph-mon[126480]: pgmap v17115: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 46 KiB/s wr, 8 op/s 2023-05-08T12:37:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31988.299485 secs 2023-05-08T12:37:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31988.854998 secs 2023-05-08T12:37:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31988.299485 secs 2023-05-08T12:37:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31988.854998 secs 2023-05-08T12:37:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31988.299485 secs 2023-05-08T12:37:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31988.854998 secs 2023-05-08T12:37:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:30 smithi133 ceph-mon[125939]: pgmap v17116: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 168 KiB/s wr, 10 op/s 2023-05-08T12:37:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:30 smithi096 ceph-mon[124666]: pgmap v17116: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 168 KiB/s wr, 10 op/s 2023-05-08T12:37:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:30 smithi186 ceph-mon[126480]: pgmap v17116: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 168 KiB/s wr, 10 op/s 2023-05-08T12:37:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31990.145590 secs 2023-05-08T12:37:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31990.145590 secs 2023-05-08T12:37:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31990.145590 secs 2023-05-08T12:37:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:32 smithi133 ceph-mon[125939]: pgmap v17117: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 147 KiB/s wr, 8 op/s 2023-05-08T12:37:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:37:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:32 smithi096 ceph-mon[124666]: pgmap v17117: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 147 KiB/s wr, 8 op/s 2023-05-08T12:37:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:37:33.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:32 smithi186 ceph-mon[126480]: pgmap v17117: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 147 KiB/s wr, 8 op/s 2023-05-08T12:37:33.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:37:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:33 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:37:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:33 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:37:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:33 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:37:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:33 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:37:34.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:33 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:37:34.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:33 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:37:34.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31993.299574 secs 2023-05-08T12:37:34.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:33 smithi133 ceph-mon[125939]: pgmap v17118: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 127 KiB/s wr, 7 op/s 2023-05-08T12:37:34.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:33 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:37:34.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:33 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:37:34.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:33 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:37:34.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:33 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:37:34.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:33 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T12:37:34.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:33 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T12:37:34.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:33 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:37:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:33 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:37:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:33 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:37:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:33 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:37:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:33 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:37:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:33 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:37:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:33 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:37:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31993.299574 secs 2023-05-08T12:37:34.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:33 smithi096 ceph-mon[124666]: pgmap v17118: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 127 KiB/s wr, 7 op/s 2023-05-08T12:37:34.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:33 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:37:34.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:33 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:37:34.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:33 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:37:34.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:33 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:37:34.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:33 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T12:37:34.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:33 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T12:37:34.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:33 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:37:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:33 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:37:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:33 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:37:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:33 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:37:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:33 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:37:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:33 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:37:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:33 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:37:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31993.299574 secs 2023-05-08T12:37:34.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:33 smithi186 ceph-mon[126480]: pgmap v17118: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 127 KiB/s wr, 7 op/s 2023-05-08T12:37:34.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:33 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:37:34.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:33 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:37:34.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:33 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:37:34.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:33 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:37:34.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:33 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T12:37:34.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:33 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T12:37:34.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:33 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:37:35.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31993.855147 secs 2023-05-08T12:37:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31993.855147 secs 2023-05-08T12:37:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31993.855147 secs 2023-05-08T12:37:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31995.145720 secs 2023-05-08T12:37:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:36 smithi186 ceph-mon[126480]: pgmap v17119: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 127 KiB/s wr, 10 op/s 2023-05-08T12:37:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31995.145720 secs 2023-05-08T12:37:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:36 smithi133 ceph-mon[125939]: pgmap v17119: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 127 KiB/s wr, 10 op/s 2023-05-08T12:37:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31995.145720 secs 2023-05-08T12:37:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:36 smithi096 ceph-mon[124666]: pgmap v17119: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 127 KiB/s wr, 10 op/s 2023-05-08T12:37:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:38 smithi133 ceph-mon[125939]: pgmap v17120: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 126 KiB/s wr, 6 op/s 2023-05-08T12:37:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:38 smithi096 ceph-mon[124666]: pgmap v17120: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 126 KiB/s wr, 6 op/s 2023-05-08T12:37:39.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:38 smithi186 ceph-mon[126480]: pgmap v17120: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 126 KiB/s wr, 6 op/s 2023-05-08T12:37:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31998.299650 secs 2023-05-08T12:37:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 31998.855302 secs 2023-05-08T12:37:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31998.299650 secs 2023-05-08T12:37:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 31998.855302 secs 2023-05-08T12:37:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31998.299650 secs 2023-05-08T12:37:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 31998.855302 secs 2023-05-08T12:37:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:40 smithi133 ceph-mon[125939]: pgmap v17121: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 126 KiB/s wr, 9 op/s 2023-05-08T12:37:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:40 smithi096 ceph-mon[124666]: pgmap v17121: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 126 KiB/s wr, 9 op/s 2023-05-08T12:37:41.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:40 smithi186 ceph-mon[126480]: pgmap v17121: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 126 KiB/s wr, 9 op/s 2023-05-08T12:37:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32000.145848 secs 2023-05-08T12:37:42.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32000.145848 secs 2023-05-08T12:37:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32000.145848 secs 2023-05-08T12:37:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:42 smithi133 ceph-mon[125939]: pgmap v17122: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 597 B/s wr, 7 op/s 2023-05-08T12:37:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:42 smithi096 ceph-mon[124666]: pgmap v17122: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 597 B/s wr, 7 op/s 2023-05-08T12:37:43.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:42 smithi186 ceph-mon[126480]: pgmap v17122: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 597 B/s wr, 7 op/s 2023-05-08T12:37:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32003.299765 secs 2023-05-08T12:37:44.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:44 smithi133 ceph-mon[125939]: pgmap v17123: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 6 op/s 2023-05-08T12:37:44.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32003.855451 secs 2023-05-08T12:37:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32003.299765 secs 2023-05-08T12:37:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:44 smithi096 ceph-mon[124666]: pgmap v17123: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 6 op/s 2023-05-08T12:37:45.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32003.855451 secs 2023-05-08T12:37:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32003.299765 secs 2023-05-08T12:37:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:44 smithi186 ceph-mon[126480]: pgmap v17123: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 6 op/s 2023-05-08T12:37:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32003.855451 secs 2023-05-08T12:37:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:46 smithi133 ceph-mon[125939]: pgmap v17124: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 426 B/s wr, 10 op/s 2023-05-08T12:37:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:46 smithi096 ceph-mon[124666]: pgmap v17124: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 426 B/s wr, 10 op/s 2023-05-08T12:37:47.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:46 smithi186 ceph-mon[126480]: pgmap v17124: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 426 B/s wr, 10 op/s 2023-05-08T12:37:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:48 smithi133 ceph-mon[125939]: pgmap v17125: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 6 op/s 2023-05-08T12:37:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:37:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:48 smithi096 ceph-mon[124666]: pgmap v17125: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 6 op/s 2023-05-08T12:37:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:37:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:48 smithi186 ceph-mon[126480]: pgmap v17125: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 6 op/s 2023-05-08T12:37:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:37:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32008.299916 secs 2023-05-08T12:37:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:37:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:37:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:37:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32008.855565 secs 2023-05-08T12:37:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32008.299916 secs 2023-05-08T12:37:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:37:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:37:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:37:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32008.855565 secs 2023-05-08T12:37:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32008.299916 secs 2023-05-08T12:37:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:37:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:37:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:37:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32008.855565 secs 2023-05-08T12:37:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:50 smithi133 ceph-mon[125939]: pgmap v17126: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 468 KiB/s rd, 305 KiB/s wr, 9 op/s 2023-05-08T12:37:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:50 smithi096 ceph-mon[124666]: pgmap v17126: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 468 KiB/s rd, 305 KiB/s wr, 9 op/s 2023-05-08T12:37:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:50 smithi186 ceph-mon[126480]: pgmap v17126: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 468 KiB/s rd, 305 KiB/s wr, 9 op/s 2023-05-08T12:37:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:52 smithi133 ceph-mon[125939]: pgmap v17127: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 305 KiB/s wr, 7 op/s 2023-05-08T12:37:52.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:52 smithi096 ceph-mon[124666]: pgmap v17127: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 305 KiB/s wr, 7 op/s 2023-05-08T12:37:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:52 smithi186 ceph-mon[126480]: pgmap v17127: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 305 KiB/s wr, 7 op/s 2023-05-08T12:37:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32013.300058 secs 2023-05-08T12:37:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:54 smithi133 ceph-mon[125939]: pgmap v17128: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 305 KiB/s wr, 6 op/s 2023-05-08T12:37:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32013.300058 secs 2023-05-08T12:37:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:54 smithi096 ceph-mon[124666]: pgmap v17128: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 305 KiB/s wr, 6 op/s 2023-05-08T12:37:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32013.300058 secs 2023-05-08T12:37:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:54 smithi186 ceph-mon[126480]: pgmap v17128: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 305 KiB/s wr, 6 op/s 2023-05-08T12:37:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:56 smithi133 ceph-mon[125939]: pgmap v17129: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1003 KiB/s rd, 689 KiB/s wr, 11 op/s 2023-05-08T12:37:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:37:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:56 smithi096 ceph-mon[124666]: pgmap v17129: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1003 KiB/s rd, 689 KiB/s wr, 11 op/s 2023-05-08T12:37:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:37:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:56 smithi186 ceph-mon[126480]: pgmap v17129: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1003 KiB/s rd, 689 KiB/s wr, 11 op/s 2023-05-08T12:37:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:37:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:57 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:37:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:37:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:37:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:57 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:37:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:37:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:37:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:57 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:37:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:37:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:37:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:58 smithi133 ceph-mon[125939]: pgmap v17130: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1002 KiB/s rd, 688 KiB/s wr, 8 op/s 2023-05-08T12:37:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:58 smithi096 ceph-mon[124666]: pgmap v17130: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1002 KiB/s rd, 688 KiB/s wr, 8 op/s 2023-05-08T12:37:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:58 smithi186 ceph-mon[126480]: pgmap v17130: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1002 KiB/s rd, 688 KiB/s wr, 8 op/s 2023-05-08T12:37:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:37:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32018.300176 secs 2023-05-08T12:38:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:37:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32018.300176 secs 2023-05-08T12:38:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:37:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32018.300176 secs 2023-05-08T12:38:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:00 smithi133 ceph-mon[125939]: pgmap v17131: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T12:38:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:00 smithi096 ceph-mon[124666]: pgmap v17131: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T12:38:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:00 smithi186 ceph-mon[126480]: pgmap v17131: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T12:38:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:02 smithi133 ceph-mon[125939]: pgmap v17132: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 938 KiB/s wr, 11 op/s 2023-05-08T12:38:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:02 smithi096 ceph-mon[124666]: pgmap v17132: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 938 KiB/s wr, 11 op/s 2023-05-08T12:38:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:02 smithi186 ceph-mon[126480]: pgmap v17132: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 938 KiB/s wr, 11 op/s 2023-05-08T12:38:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32023.300308 secs 2023-05-08T12:38:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:04 smithi133 ceph-mon[125939]: pgmap v17133: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 938 KiB/s wr, 10 op/s 2023-05-08T12:38:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32023.855920 secs 2023-05-08T12:38:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32023.300308 secs 2023-05-08T12:38:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:04 smithi096 ceph-mon[124666]: pgmap v17133: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 938 KiB/s wr, 10 op/s 2023-05-08T12:38:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32023.855920 secs 2023-05-08T12:38:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32023.300308 secs 2023-05-08T12:38:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:04 smithi186 ceph-mon[126480]: pgmap v17133: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 938 KiB/s wr, 10 op/s 2023-05-08T12:38:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32023.855920 secs 2023-05-08T12:38:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:05 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:38:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:38:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:38:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:05 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:38:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:38:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:38:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:05 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:38:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:38:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:38:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:06 smithi133 ceph-mon[125939]: pgmap v17134: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 28 op/s 2023-05-08T12:38:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:06 smithi096 ceph-mon[124666]: pgmap v17134: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 28 op/s 2023-05-08T12:38:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:06 smithi186 ceph-mon[126480]: pgmap v17134: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 28 op/s 2023-05-08T12:38:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:08 smithi133 ceph-mon[125939]: pgmap v17135: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 958 KiB/s rd, 895 KiB/s wr, 23 op/s 2023-05-08T12:38:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:08 smithi096 ceph-mon[124666]: pgmap v17135: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 958 KiB/s rd, 895 KiB/s wr, 23 op/s 2023-05-08T12:38:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:08 smithi186 ceph-mon[126480]: pgmap v17135: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 958 KiB/s rd, 895 KiB/s wr, 23 op/s 2023-05-08T12:38:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32028.300429 secs 2023-05-08T12:38:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32028.856043 secs 2023-05-08T12:38:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32028.300429 secs 2023-05-08T12:38:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32028.856043 secs 2023-05-08T12:38:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32028.300429 secs 2023-05-08T12:38:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32028.856043 secs 2023-05-08T12:38:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:10 smithi133 ceph-mon[125939]: pgmap v17136: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 962 KiB/s rd, 897 KiB/s wr, 26 op/s 2023-05-08T12:38:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:10 smithi096 ceph-mon[124666]: pgmap v17136: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 962 KiB/s rd, 897 KiB/s wr, 26 op/s 2023-05-08T12:38:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:10 smithi186 ceph-mon[126480]: pgmap v17136: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 962 KiB/s rd, 897 KiB/s wr, 26 op/s 2023-05-08T12:38:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:12 smithi133 ceph-mon[125939]: pgmap v17137: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 364 KiB/s wr, 21 op/s 2023-05-08T12:38:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:12 smithi096 ceph-mon[124666]: pgmap v17137: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 364 KiB/s wr, 21 op/s 2023-05-08T12:38:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:12 smithi186 ceph-mon[126480]: pgmap v17137: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 364 KiB/s wr, 21 op/s 2023-05-08T12:38:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32033.300544 secs 2023-05-08T12:38:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:14 smithi133 ceph-mon[125939]: pgmap v17138: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 343 KiB/s wr, 21 op/s 2023-05-08T12:38:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32033.856164 secs 2023-05-08T12:38:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32033.300544 secs 2023-05-08T12:38:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:14 smithi096 ceph-mon[124666]: pgmap v17138: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 343 KiB/s wr, 21 op/s 2023-05-08T12:38:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32033.856164 secs 2023-05-08T12:38:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32033.300544 secs 2023-05-08T12:38:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:14 smithi186 ceph-mon[126480]: pgmap v17138: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 343 KiB/s wr, 21 op/s 2023-05-08T12:38:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32033.856164 secs 2023-05-08T12:38:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:16 smithi133 ceph-mon[125939]: pgmap v17139: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 607 KiB/s wr, 24 op/s 2023-05-08T12:38:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:16 smithi096 ceph-mon[124666]: pgmap v17139: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 607 KiB/s wr, 24 op/s 2023-05-08T12:38:17.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:16 smithi186 ceph-mon[126480]: pgmap v17139: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 607 KiB/s wr, 24 op/s 2023-05-08T12:38:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:18 smithi133 ceph-mon[125939]: pgmap v17140: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 267 KiB/s wr, 6 op/s 2023-05-08T12:38:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:18 smithi096 ceph-mon[124666]: pgmap v17140: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 267 KiB/s wr, 6 op/s 2023-05-08T12:38:19.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:18 smithi186 ceph-mon[126480]: pgmap v17140: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 267 KiB/s wr, 6 op/s 2023-05-08T12:38:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32038.300670 secs 2023-05-08T12:38:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32038.856320 secs 2023-05-08T12:38:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32038.300670 secs 2023-05-08T12:38:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32038.856320 secs 2023-05-08T12:38:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32038.300670 secs 2023-05-08T12:38:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32038.856320 secs 2023-05-08T12:38:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:20 smithi133 ceph-mon[125939]: pgmap v17141: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 268 KiB/s wr, 9 op/s 2023-05-08T12:38:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:20 smithi096 ceph-mon[124666]: pgmap v17141: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 268 KiB/s wr, 9 op/s 2023-05-08T12:38:21.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:20 smithi186 ceph-mon[126480]: pgmap v17141: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 268 KiB/s wr, 9 op/s 2023-05-08T12:38:22.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:22 smithi133 ceph-mon[125939]: pgmap v17142: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 265 KiB/s wr, 7 op/s 2023-05-08T12:38:22.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:22 smithi096 ceph-mon[124666]: pgmap v17142: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 265 KiB/s wr, 7 op/s 2023-05-08T12:38:22.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:22 smithi186 ceph-mon[126480]: pgmap v17142: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 265 KiB/s wr, 7 op/s 2023-05-08T12:38:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32043.300804 secs 2023-05-08T12:38:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:24 smithi133 ceph-mon[125939]: pgmap v17143: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 265 KiB/s wr, 6 op/s 2023-05-08T12:38:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:24 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:38:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32043.300804 secs 2023-05-08T12:38:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:24 smithi096 ceph-mon[124666]: pgmap v17143: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 265 KiB/s wr, 6 op/s 2023-05-08T12:38:25.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:24 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:38:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32043.300804 secs 2023-05-08T12:38:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:24 smithi186 ceph-mon[126480]: pgmap v17143: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 265 KiB/s wr, 6 op/s 2023-05-08T12:38:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:24 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:38:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:25 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:38:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:25 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:38:25.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:25 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:38:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:25 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:38:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:25 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:38:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:25 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:38:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:25 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:38:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:25 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:38:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:25 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:38:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32045.146852 secs 2023-05-08T12:38:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:26 smithi133 ceph-mon[125939]: pgmap v17144: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 821 KiB/s rd, 839 KiB/s wr, 13 op/s 2023-05-08T12:38:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32045.146852 secs 2023-05-08T12:38:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:26 smithi096 ceph-mon[124666]: pgmap v17144: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 821 KiB/s rd, 839 KiB/s wr, 13 op/s 2023-05-08T12:38:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32045.146852 secs 2023-05-08T12:38:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:26 smithi186 ceph-mon[126480]: pgmap v17144: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 821 KiB/s rd, 839 KiB/s wr, 13 op/s 2023-05-08T12:38:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:28 smithi133 ceph-mon[125939]: pgmap v17145: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 555 KiB/s rd, 574 KiB/s wr, 10 op/s 2023-05-08T12:38:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:28 smithi096 ceph-mon[124666]: pgmap v17145: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 555 KiB/s rd, 574 KiB/s wr, 10 op/s 2023-05-08T12:38:29.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:28 smithi186 ceph-mon[126480]: pgmap v17145: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 555 KiB/s rd, 574 KiB/s wr, 10 op/s 2023-05-08T12:38:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32048.300939 secs 2023-05-08T12:38:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:29 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:38:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:29 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:38:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32048.300939 secs 2023-05-08T12:38:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:29 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:38:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:29 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:38:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32048.300939 secs 2023-05-08T12:38:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:29 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:38:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:29 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:38:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:30 smithi133 ceph-mon[125939]: pgmap v17146: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 579 KiB/s rd, 598 KiB/s wr, 13 op/s 2023-05-08T12:38:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32050.146934 secs 2023-05-08T12:38:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:30 smithi096 ceph-mon[124666]: pgmap v17146: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 579 KiB/s rd, 598 KiB/s wr, 13 op/s 2023-05-08T12:38:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32050.146934 secs 2023-05-08T12:38:31.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:30 smithi186 ceph-mon[126480]: pgmap v17146: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 579 KiB/s rd, 598 KiB/s wr, 13 op/s 2023-05-08T12:38:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32050.146934 secs 2023-05-08T12:38:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:31 smithi133 ceph-mon[125939]: osdmap e1148: 12 total, 12 up, 12 in 2023-05-08T12:38:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:31 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:38:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:31 smithi096 ceph-mon[124666]: osdmap e1148: 12 total, 12 up, 12 in 2023-05-08T12:38:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:31 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:38:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:31 smithi186 ceph-mon[126480]: osdmap e1148: 12 total, 12 up, 12 in 2023-05-08T12:38:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:31 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:38:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:32 smithi133 ceph-mon[125939]: pgmap v17148: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 694 KiB/s rd, 717 KiB/s wr, 13 op/s 2023-05-08T12:38:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:32 smithi096 ceph-mon[124666]: pgmap v17148: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 694 KiB/s rd, 717 KiB/s wr, 13 op/s 2023-05-08T12:38:33.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:32 smithi186 ceph-mon[126480]: pgmap v17148: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 694 KiB/s rd, 717 KiB/s wr, 13 op/s 2023-05-08T12:38:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32053.301075 secs 2023-05-08T12:38:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:34 smithi133 ceph-mon[125939]: pgmap v17149: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 694 KiB/s rd, 717 KiB/s wr, 13 op/s 2023-05-08T12:38:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:34 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:38:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:34 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:38:34.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:34 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:38:34.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:34 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:38:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32053.301075 secs 2023-05-08T12:38:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:34 smithi096 ceph-mon[124666]: pgmap v17149: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 694 KiB/s rd, 717 KiB/s wr, 13 op/s 2023-05-08T12:38:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:34 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:38:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:34 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:38:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:34 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:38:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:34 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:38:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32053.301075 secs 2023-05-08T12:38:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:34 smithi186 ceph-mon[126480]: pgmap v17149: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 694 KiB/s rd, 717 KiB/s wr, 13 op/s 2023-05-08T12:38:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:34 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:38:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:34 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:38:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:34 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:38:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:34 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:38:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:35 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:38:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:35 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T12:38:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:35 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T12:38:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:35 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:38:35.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32055.147039 secs 2023-05-08T12:38:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:35 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:38:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:35 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T12:38:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:35 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T12:38:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:35 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:38:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32055.147039 secs 2023-05-08T12:38:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:35 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:38:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:35 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T12:38:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:35 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T12:38:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:35 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:38:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32055.147039 secs 2023-05-08T12:38:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:36 smithi133 ceph-mon[125939]: pgmap v17150: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 328 KiB/s wr, 9 op/s 2023-05-08T12:38:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:36 smithi133 ceph-mon[125939]: osdmap e1149: 12 total, 12 up, 12 in 2023-05-08T12:38:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:36 smithi096 ceph-mon[124666]: pgmap v17150: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 328 KiB/s wr, 9 op/s 2023-05-08T12:38:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:36 smithi096 ceph-mon[124666]: osdmap e1149: 12 total, 12 up, 12 in 2023-05-08T12:38:37.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:36 smithi186 ceph-mon[126480]: pgmap v17150: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 328 KiB/s wr, 9 op/s 2023-05-08T12:38:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:36 smithi186 ceph-mon[126480]: osdmap e1149: 12 total, 12 up, 12 in 2023-05-08T12:38:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:38 smithi133 ceph-mon[125939]: pgmap v17152: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 375 KiB/s wr, 6 op/s 2023-05-08T12:38:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:38 smithi096 ceph-mon[124666]: pgmap v17152: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 375 KiB/s wr, 6 op/s 2023-05-08T12:38:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:38 smithi186 ceph-mon[126480]: pgmap v17152: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 375 KiB/s wr, 6 op/s 2023-05-08T12:38:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32058.301188 secs 2023-05-08T12:38:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32058.301188 secs 2023-05-08T12:38:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32058.301188 secs 2023-05-08T12:38:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:40 smithi133 ceph-mon[125939]: pgmap v17153: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 998 KiB/s wr, 9 op/s 2023-05-08T12:38:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32060.147160 secs 2023-05-08T12:38:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:40 smithi096 ceph-mon[124666]: pgmap v17153: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 998 KiB/s wr, 9 op/s 2023-05-08T12:38:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32060.147160 secs 2023-05-08T12:38:41.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:40 smithi186 ceph-mon[126480]: pgmap v17153: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 998 KiB/s wr, 9 op/s 2023-05-08T12:38:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32060.147160 secs 2023-05-08T12:38:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:42 smithi133 ceph-mon[125939]: pgmap v17154: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 914 KiB/s wr, 9 op/s 2023-05-08T12:38:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:42 smithi096 ceph-mon[124666]: pgmap v17154: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 914 KiB/s wr, 9 op/s 2023-05-08T12:38:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:42 smithi186 ceph-mon[126480]: pgmap v17154: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 914 KiB/s wr, 9 op/s 2023-05-08T12:38:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32063.301292 secs 2023-05-08T12:38:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:44 smithi133 ceph-mon[125939]: pgmap v17155: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 914 KiB/s wr, 9 op/s 2023-05-08T12:38:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32063.856859 secs 2023-05-08T12:38:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32063.301292 secs 2023-05-08T12:38:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:44 smithi096 ceph-mon[124666]: pgmap v17155: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 914 KiB/s wr, 9 op/s 2023-05-08T12:38:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32063.856859 secs 2023-05-08T12:38:45.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32063.301292 secs 2023-05-08T12:38:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:44 smithi186 ceph-mon[126480]: pgmap v17155: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 914 KiB/s wr, 9 op/s 2023-05-08T12:38:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32063.856859 secs 2023-05-08T12:38:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:45 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:38:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:45 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:38:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:45 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:38:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:45 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:38:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:45 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:38:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:45 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:38:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:45 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:38:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:45 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:38:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:45 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:38:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:46 smithi133 ceph-mon[125939]: pgmap v17156: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T12:38:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:46 smithi096 ceph-mon[124666]: pgmap v17156: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T12:38:47.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:46 smithi186 ceph-mon[126480]: pgmap v17156: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T12:38:48.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:48 smithi133 ceph-mon[125939]: pgmap v17157: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 921 KiB/s rd, 919 KiB/s wr, 9 op/s 2023-05-08T12:38:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:38:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:48 smithi096 ceph-mon[124666]: pgmap v17157: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 921 KiB/s rd, 919 KiB/s wr, 9 op/s 2023-05-08T12:38:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:38:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:48 smithi186 ceph-mon[126480]: pgmap v17157: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 921 KiB/s rd, 919 KiB/s wr, 9 op/s 2023-05-08T12:38:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:38:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32068.301402 secs 2023-05-08T12:38:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:38:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:38:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32068.301402 secs 2023-05-08T12:38:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:38:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:38:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32068.301402 secs 2023-05-08T12:38:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:38:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:38:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:50 smithi133 ceph-mon[125939]: pgmap v17158: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 13 op/s 2023-05-08T12:38:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:50 smithi096 ceph-mon[124666]: pgmap v17158: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 13 op/s 2023-05-08T12:38:51.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:50 smithi186 ceph-mon[126480]: pgmap v17158: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 13 op/s 2023-05-08T12:38:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:51 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:38:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:51 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:38:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:51 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:38:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:52 smithi133 ceph-mon[125939]: pgmap v17159: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T12:38:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:38:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:52 smithi096 ceph-mon[124666]: pgmap v17159: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T12:38:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:38:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:52 smithi186 ceph-mon[126480]: pgmap v17159: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T12:38:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:38:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:54 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:38:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:54 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:38:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32073.301522 secs 2023-05-08T12:38:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:54 smithi133 ceph-mon[125939]: pgmap v17160: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T12:38:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:54 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:38:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:54 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:38:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32073.301522 secs 2023-05-08T12:38:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:54 smithi096 ceph-mon[124666]: pgmap v17160: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T12:38:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:54 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:38:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:54 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:38:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32073.301522 secs 2023-05-08T12:38:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:54 smithi186 ceph-mon[126480]: pgmap v17160: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T12:38:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:56 smithi133 ceph-mon[125939]: pgmap v17161: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 1.8 MiB/s wr, 16 op/s 2023-05-08T12:38:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:56 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:38:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:56 smithi096 ceph-mon[124666]: pgmap v17161: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 1.8 MiB/s wr, 16 op/s 2023-05-08T12:38:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:56 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:38:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:56 smithi186 ceph-mon[126480]: pgmap v17161: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 1.8 MiB/s wr, 16 op/s 2023-05-08T12:38:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:56 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:38:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:58 smithi133 ceph-mon[125939]: pgmap v17162: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2023-05-08T12:38:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:58 smithi096 ceph-mon[124666]: pgmap v17162: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2023-05-08T12:38:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:58 smithi186 ceph-mon[126480]: pgmap v17162: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2023-05-08T12:38:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32078.301659 secs 2023-05-08T12:38:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:38:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32078.857270 secs 2023-05-08T12:39:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32078.301659 secs 2023-05-08T12:39:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:38:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32078.857270 secs 2023-05-08T12:39:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32078.301659 secs 2023-05-08T12:39:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:38:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32078.857270 secs 2023-05-08T12:39:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:00 smithi133 ceph-mon[125939]: pgmap v17163: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.5 MiB/s wr, 16 op/s 2023-05-08T12:39:01.194 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:00 smithi186 ceph-mon[126480]: pgmap v17163: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.5 MiB/s wr, 16 op/s 2023-05-08T12:39:01.194 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:00 smithi096 ceph-mon[124666]: pgmap v17163: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.5 MiB/s wr, 16 op/s 2023-05-08T12:39:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:39:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:39:01.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:01 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:39:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:39:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:39:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:01 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:39:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:39:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:39:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:01 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:39:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:02 smithi133 ceph-mon[125939]: pgmap v17164: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1008 KiB/s rd, 824 KiB/s wr, 12 op/s 2023-05-08T12:39:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:02 smithi096 ceph-mon[124666]: pgmap v17164: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1008 KiB/s rd, 824 KiB/s wr, 12 op/s 2023-05-08T12:39:03.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:02 smithi186 ceph-mon[126480]: pgmap v17164: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1008 KiB/s rd, 824 KiB/s wr, 12 op/s 2023-05-08T12:39:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32083.301780 secs 2023-05-08T12:39:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:04 smithi133 ceph-mon[125939]: pgmap v17165: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 988 KiB/s rd, 803 KiB/s wr, 11 op/s 2023-05-08T12:39:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32083.857394 secs 2023-05-08T12:39:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32083.301780 secs 2023-05-08T12:39:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:04 smithi096 ceph-mon[124666]: pgmap v17165: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 988 KiB/s rd, 803 KiB/s wr, 11 op/s 2023-05-08T12:39:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32083.857394 secs 2023-05-08T12:39:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32083.301780 secs 2023-05-08T12:39:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:04 smithi186 ceph-mon[126480]: pgmap v17165: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 988 KiB/s rd, 803 KiB/s wr, 11 op/s 2023-05-08T12:39:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32083.857394 secs 2023-05-08T12:39:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32085.147763 secs 2023-05-08T12:39:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32085.147763 secs 2023-05-08T12:39:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32085.147763 secs 2023-05-08T12:39:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:06 smithi133 ceph-mon[125939]: pgmap v17166: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 30 op/s 2023-05-08T12:39:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:06 smithi133 ceph-mon[125939]: osdmap e1150: 12 total, 12 up, 12 in 2023-05-08T12:39:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:06 smithi096 ceph-mon[124666]: pgmap v17166: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 30 op/s 2023-05-08T12:39:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:06 smithi096 ceph-mon[124666]: osdmap e1150: 12 total, 12 up, 12 in 2023-05-08T12:39:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:06 smithi186 ceph-mon[126480]: pgmap v17166: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 30 op/s 2023-05-08T12:39:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:06 smithi186 ceph-mon[126480]: osdmap e1150: 12 total, 12 up, 12 in 2023-05-08T12:39:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:08 smithi133 ceph-mon[125939]: pgmap v17168: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 29 op/s 2023-05-08T12:39:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:08 smithi096 ceph-mon[124666]: pgmap v17168: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 29 op/s 2023-05-08T12:39:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:08 smithi186 ceph-mon[126480]: pgmap v17168: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 29 op/s 2023-05-08T12:39:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32088.301896 secs 2023-05-08T12:39:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:09 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:39:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:39:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:39:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32088.857546 secs 2023-05-08T12:39:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32088.301896 secs 2023-05-08T12:39:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:09 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:39:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:39:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:39:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32088.857546 secs 2023-05-08T12:39:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32088.301896 secs 2023-05-08T12:39:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:09 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:39:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:39:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:39:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32088.857546 secs 2023-05-08T12:39:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:10 smithi133 ceph-mon[125939]: pgmap v17169: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 29 op/s 2023-05-08T12:39:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32090.147885 secs 2023-05-08T12:39:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:10 smithi096 ceph-mon[124666]: pgmap v17169: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 29 op/s 2023-05-08T12:39:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32090.147885 secs 2023-05-08T12:39:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:10 smithi186 ceph-mon[126480]: pgmap v17169: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 29 op/s 2023-05-08T12:39:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32090.147885 secs 2023-05-08T12:39:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:12 smithi133 ceph-mon[125939]: pgmap v17170: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.3 MiB/s wr, 28 op/s 2023-05-08T12:39:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:12 smithi096 ceph-mon[124666]: pgmap v17170: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.3 MiB/s wr, 28 op/s 2023-05-08T12:39:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:12 smithi186 ceph-mon[126480]: pgmap v17170: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.3 MiB/s wr, 28 op/s 2023-05-08T12:39:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32093.302027 secs 2023-05-08T12:39:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:14 smithi133 ceph-mon[125939]: pgmap v17171: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.3 MiB/s wr, 28 op/s 2023-05-08T12:39:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32093.857671 secs 2023-05-08T12:39:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32093.302027 secs 2023-05-08T12:39:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:14 smithi096 ceph-mon[124666]: pgmap v17171: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.3 MiB/s wr, 28 op/s 2023-05-08T12:39:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32093.857671 secs 2023-05-08T12:39:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32093.302027 secs 2023-05-08T12:39:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:14 smithi186 ceph-mon[126480]: pgmap v17171: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.3 MiB/s wr, 28 op/s 2023-05-08T12:39:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32093.857671 secs 2023-05-08T12:39:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32095.147964 secs 2023-05-08T12:39:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32095.147964 secs 2023-05-08T12:39:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32095.147964 secs 2023-05-08T12:39:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:16 smithi096 ceph-mon[124666]: pgmap v17172: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 572 KiB/s wr, 9 op/s 2023-05-08T12:39:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:16 smithi096 ceph-mon[124666]: osdmap e1151: 12 total, 12 up, 12 in 2023-05-08T12:39:17.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:16 smithi186 ceph-mon[126480]: pgmap v17172: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 572 KiB/s wr, 9 op/s 2023-05-08T12:39:17.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:16 smithi186 ceph-mon[126480]: osdmap e1151: 12 total, 12 up, 12 in 2023-05-08T12:39:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:16 smithi133 ceph-mon[125939]: pgmap v17172: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 572 KiB/s wr, 9 op/s 2023-05-08T12:39:17.410 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:16 smithi133 ceph-mon[125939]: osdmap e1151: 12 total, 12 up, 12 in 2023-05-08T12:39:18.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:17 smithi096 ceph-mon[124666]: pgmap v17174: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 572 KiB/s wr, 9 op/s 2023-05-08T12:39:18.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:17 smithi186 ceph-mon[126480]: pgmap v17174: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 572 KiB/s wr, 9 op/s 2023-05-08T12:39:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:17 smithi133 ceph-mon[125939]: pgmap v17174: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 572 KiB/s wr, 9 op/s 2023-05-08T12:39:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32098.302146 secs 2023-05-08T12:39:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32098.302146 secs 2023-05-08T12:39:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32098.302146 secs 2023-05-08T12:39:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32098.857803 secs 2023-05-08T12:39:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:20 smithi186 ceph-mon[126480]: pgmap v17175: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 172 KiB/s wr, 9 op/s 2023-05-08T12:39:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32098.857803 secs 2023-05-08T12:39:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:20 smithi133 ceph-mon[125939]: pgmap v17175: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 172 KiB/s wr, 9 op/s 2023-05-08T12:39:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32098.857803 secs 2023-05-08T12:39:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:20 smithi096 ceph-mon[124666]: pgmap v17175: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 172 KiB/s wr, 9 op/s 2023-05-08T12:39:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32100.148089 secs 2023-05-08T12:39:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32100.148089 secs 2023-05-08T12:39:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32100.148089 secs 2023-05-08T12:39:22.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:22 smithi133 ceph-mon[125939]: pgmap v17176: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 171 KiB/s wr, 9 op/s 2023-05-08T12:39:22.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:22 smithi096 ceph-mon[124666]: pgmap v17176: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 171 KiB/s wr, 9 op/s 2023-05-08T12:39:22.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:22 smithi186 ceph-mon[126480]: pgmap v17176: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 171 KiB/s wr, 9 op/s 2023-05-08T12:39:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32103.302280 secs 2023-05-08T12:39:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:24 smithi133 ceph-mon[125939]: pgmap v17177: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 171 KiB/s wr, 9 op/s 2023-05-08T12:39:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32103.857938 secs 2023-05-08T12:39:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32103.302280 secs 2023-05-08T12:39:25.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:24 smithi096 ceph-mon[124666]: pgmap v17177: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 171 KiB/s wr, 9 op/s 2023-05-08T12:39:25.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32103.857938 secs 2023-05-08T12:39:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32103.302280 secs 2023-05-08T12:39:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:24 smithi186 ceph-mon[126480]: pgmap v17177: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 171 KiB/s wr, 9 op/s 2023-05-08T12:39:25.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32103.857938 secs 2023-05-08T12:39:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32105.148228 secs 2023-05-08T12:39:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32105.148228 secs 2023-05-08T12:39:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32105.148228 secs 2023-05-08T12:39:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:26 smithi133 ceph-mon[125939]: pgmap v17178: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 62 KiB/s wr, 9 op/s 2023-05-08T12:39:27.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:26 smithi096 ceph-mon[124666]: pgmap v17178: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 62 KiB/s wr, 9 op/s 2023-05-08T12:39:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:26 smithi186 ceph-mon[126480]: pgmap v17178: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 62 KiB/s wr, 9 op/s 2023-05-08T12:39:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:28 smithi133 ceph-mon[125939]: pgmap v17179: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 55 KiB/s wr, 8 op/s 2023-05-08T12:39:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:28 smithi096 ceph-mon[124666]: pgmap v17179: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 55 KiB/s wr, 8 op/s 2023-05-08T12:39:29.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:28 smithi186 ceph-mon[126480]: pgmap v17179: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 55 KiB/s wr, 8 op/s 2023-05-08T12:39:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32108.302405 secs 2023-05-08T12:39:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32108.858073 secs 2023-05-08T12:39:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32108.302405 secs 2023-05-08T12:39:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32108.858073 secs 2023-05-08T12:39:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32108.302405 secs 2023-05-08T12:39:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32108.858073 secs 2023-05-08T12:39:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:30 smithi133 ceph-mon[125939]: pgmap v17180: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 307 KiB/s wr, 12 op/s 2023-05-08T12:39:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32110.148354 secs 2023-05-08T12:39:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:30 smithi096 ceph-mon[124666]: pgmap v17180: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 307 KiB/s wr, 12 op/s 2023-05-08T12:39:31.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32110.148354 secs 2023-05-08T12:39:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:30 smithi186 ceph-mon[126480]: pgmap v17180: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 307 KiB/s wr, 12 op/s 2023-05-08T12:39:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32110.148354 secs 2023-05-08T12:39:32.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:32 smithi096 ceph-mon[124666]: pgmap v17181: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 285 KiB/s wr, 9 op/s 2023-05-08T12:39:32.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:32 smithi186 ceph-mon[126480]: pgmap v17181: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 285 KiB/s wr, 9 op/s 2023-05-08T12:39:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:32 smithi133 ceph-mon[125939]: pgmap v17181: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 285 KiB/s wr, 9 op/s 2023-05-08T12:39:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32113.302521 secs 2023-05-08T12:39:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:34 smithi133 ceph-mon[125939]: pgmap v17182: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 285 KiB/s wr, 8 op/s 2023-05-08T12:39:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32113.858206 secs 2023-05-08T12:39:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:34 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:39:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32113.302521 secs 2023-05-08T12:39:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:34 smithi096 ceph-mon[124666]: pgmap v17182: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 285 KiB/s wr, 8 op/s 2023-05-08T12:39:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32113.858206 secs 2023-05-08T12:39:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:34 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:39:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32113.302521 secs 2023-05-08T12:39:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:34 smithi186 ceph-mon[126480]: pgmap v17182: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 285 KiB/s wr, 8 op/s 2023-05-08T12:39:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32113.858206 secs 2023-05-08T12:39:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:34 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:39:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:39:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:39:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:39:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32115.148467 secs 2023-05-08T12:39:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:39:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:39:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:39:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32115.148467 secs 2023-05-08T12:39:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:39:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:39:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:39:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32115.148467 secs 2023-05-08T12:39:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:36 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:39:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:36 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T12:39:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:36 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T12:39:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:36 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:39:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:36 smithi133 ceph-mon[125939]: pgmap v17183: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 286 KiB/s wr, 12 op/s 2023-05-08T12:39:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:36 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:39:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:36 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T12:39:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:36 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T12:39:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:36 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:39:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:36 smithi096 ceph-mon[124666]: pgmap v17183: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 286 KiB/s wr, 12 op/s 2023-05-08T12:39:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:36 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:39:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:36 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T12:39:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:36 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T12:39:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:36 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:39:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:36 smithi186 ceph-mon[126480]: pgmap v17183: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 286 KiB/s wr, 12 op/s 2023-05-08T12:39:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:38 smithi133 ceph-mon[125939]: pgmap v17184: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 256 KiB/s wr, 8 op/s 2023-05-08T12:39:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:38 smithi096 ceph-mon[124666]: pgmap v17184: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 256 KiB/s wr, 8 op/s 2023-05-08T12:39:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:38 smithi186 ceph-mon[126480]: pgmap v17184: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 256 KiB/s wr, 8 op/s 2023-05-08T12:39:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32118.302611 secs 2023-05-08T12:39:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32118.858360 secs 2023-05-08T12:39:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32118.302611 secs 2023-05-08T12:39:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32118.858360 secs 2023-05-08T12:39:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32118.302611 secs 2023-05-08T12:39:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32118.858360 secs 2023-05-08T12:39:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:40 smithi133 ceph-mon[125939]: pgmap v17185: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 534 KiB/s wr, 10 op/s 2023-05-08T12:39:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32120.148565 secs 2023-05-08T12:39:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:40 smithi096 ceph-mon[124666]: pgmap v17185: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 534 KiB/s wr, 10 op/s 2023-05-08T12:39:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32120.148565 secs 2023-05-08T12:39:41.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:40 smithi186 ceph-mon[126480]: pgmap v17185: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 534 KiB/s wr, 10 op/s 2023-05-08T12:39:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32120.148565 secs 2023-05-08T12:39:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:42 smithi133 ceph-mon[125939]: pgmap v17186: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 279 KiB/s wr, 7 op/s 2023-05-08T12:39:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:42 smithi096 ceph-mon[124666]: pgmap v17186: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 279 KiB/s wr, 7 op/s 2023-05-08T12:39:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:42 smithi186 ceph-mon[126480]: pgmap v17186: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 279 KiB/s wr, 7 op/s 2023-05-08T12:39:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32123.302689 secs 2023-05-08T12:39:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:44 smithi133 ceph-mon[125939]: pgmap v17187: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 279 KiB/s wr, 6 op/s 2023-05-08T12:39:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32123.858498 secs 2023-05-08T12:39:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32123.302689 secs 2023-05-08T12:39:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:44 smithi096 ceph-mon[124666]: pgmap v17187: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 279 KiB/s wr, 6 op/s 2023-05-08T12:39:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32123.858498 secs 2023-05-08T12:39:45.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32123.302689 secs 2023-05-08T12:39:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:44 smithi186 ceph-mon[126480]: pgmap v17187: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 279 KiB/s wr, 6 op/s 2023-05-08T12:39:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32123.858498 secs 2023-05-08T12:39:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32125.148710 secs 2023-05-08T12:39:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32125.148710 secs 2023-05-08T12:39:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32125.148710 secs 2023-05-08T12:39:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:46 smithi133 ceph-mon[125939]: pgmap v17188: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 583 KiB/s rd, 326 KiB/s wr, 10 op/s 2023-05-08T12:39:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:46 smithi096 ceph-mon[124666]: pgmap v17188: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 583 KiB/s rd, 326 KiB/s wr, 10 op/s 2023-05-08T12:39:47.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:46 smithi186 ceph-mon[126480]: pgmap v17188: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 583 KiB/s rd, 326 KiB/s wr, 10 op/s 2023-05-08T12:39:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:48 smithi133 ceph-mon[125939]: pgmap v17189: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 325 KiB/s wr, 6 op/s 2023-05-08T12:39:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:48 smithi096 ceph-mon[124666]: pgmap v17189: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 325 KiB/s wr, 6 op/s 2023-05-08T12:39:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:48 smithi186 ceph-mon[126480]: pgmap v17189: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 325 KiB/s wr, 6 op/s 2023-05-08T12:39:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32128.302808 secs 2023-05-08T12:39:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32128.858551 secs 2023-05-08T12:39:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32128.302808 secs 2023-05-08T12:39:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32128.858551 secs 2023-05-08T12:39:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32128.302808 secs 2023-05-08T12:39:50.133 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32128.858551 secs 2023-05-08T12:39:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:50 smithi133 ceph-mon[125939]: pgmap v17190: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 774 KiB/s rd, 632 KiB/s wr, 9 op/s 2023-05-08T12:39:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32130.148816 secs 2023-05-08T12:39:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:50 smithi096 ceph-mon[124666]: pgmap v17190: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 774 KiB/s rd, 632 KiB/s wr, 9 op/s 2023-05-08T12:39:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32130.148816 secs 2023-05-08T12:39:51.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:50 smithi186 ceph-mon[126480]: pgmap v17190: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 774 KiB/s rd, 632 KiB/s wr, 9 op/s 2023-05-08T12:39:51.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32130.148816 secs 2023-05-08T12:39:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:52 smithi096 ceph-mon[124666]: pgmap v17191: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 773 KiB/s rd, 596 KiB/s wr, 8 op/s 2023-05-08T12:39:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:52 smithi186 ceph-mon[126480]: pgmap v17191: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 773 KiB/s rd, 596 KiB/s wr, 8 op/s 2023-05-08T12:39:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:52 smithi133 ceph-mon[125939]: pgmap v17191: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 773 KiB/s rd, 596 KiB/s wr, 8 op/s 2023-05-08T12:39:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32133.302867 secs 2023-05-08T12:39:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:54 smithi133 ceph-mon[125939]: pgmap v17192: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 773 KiB/s rd, 596 KiB/s wr, 7 op/s 2023-05-08T12:39:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32133.302867 secs 2023-05-08T12:39:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:54 smithi096 ceph-mon[124666]: pgmap v17192: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 773 KiB/s rd, 596 KiB/s wr, 7 op/s 2023-05-08T12:39:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32133.302867 secs 2023-05-08T12:39:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:54 smithi186 ceph-mon[126480]: pgmap v17192: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 773 KiB/s rd, 596 KiB/s wr, 7 op/s 2023-05-08T12:39:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:56 smithi133 ceph-mon[125939]: pgmap v17193: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T12:39:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:39:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:39:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:56 smithi096 ceph-mon[124666]: pgmap v17193: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T12:39:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:39:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:39:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:56 smithi186 ceph-mon[126480]: pgmap v17193: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T12:39:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:39:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:39:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:57 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:39:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:39:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:39:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:39:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:57 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:39:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:39:58.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:39:58.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:39:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:57 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:39:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:39:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:39:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:39:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:58 smithi133 ceph-mon[125939]: pgmap v17194: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 1.0 MiB/s wr, 9 op/s 2023-05-08T12:39:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:58 smithi096 ceph-mon[124666]: pgmap v17194: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 1.0 MiB/s wr, 9 op/s 2023-05-08T12:39:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:58 smithi186 ceph-mon[126480]: pgmap v17194: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 1.0 MiB/s wr, 9 op/s 2023-05-08T12:39:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32138.302950 secs 2023-05-08T12:39:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:39:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32138.858752 secs 2023-05-08T12:40:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32138.302950 secs 2023-05-08T12:40:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:39:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32138.858752 secs 2023-05-08T12:40:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32138.302950 secs 2023-05-08T12:40:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:39:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32138.858752 secs 2023-05-08T12:40:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:00 smithi133 ceph-mon[125939]: pgmap v17195: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 15 op/s 2023-05-08T12:40:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:00 smithi133 ceph-mon[125939]: overall HEALTH_WARN 1 MDSs report slow requests 2023-05-08T12:40:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:00 smithi096 ceph-mon[124666]: pgmap v17195: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 15 op/s 2023-05-08T12:40:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:00 smithi096 ceph-mon[124666]: overall HEALTH_WARN 1 MDSs report slow requests 2023-05-08T12:40:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:00 smithi186 ceph-mon[126480]: pgmap v17195: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 15 op/s 2023-05-08T12:40:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:00 smithi186 ceph-mon[126480]: overall HEALTH_WARN 1 MDSs report slow requests 2023-05-08T12:40:01.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:40:01.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:40:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:40:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:40:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:40:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:40:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:02 smithi133 ceph-mon[125939]: pgmap v17196: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2023-05-08T12:40:03.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:02 smithi096 ceph-mon[124666]: pgmap v17196: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2023-05-08T12:40:03.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:02 smithi186 ceph-mon[126480]: pgmap v17196: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2023-05-08T12:40:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32143.303073 secs 2023-05-08T12:40:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:04 smithi133 ceph-mon[125939]: pgmap v17197: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T12:40:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32143.858853 secs 2023-05-08T12:40:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32143.303073 secs 2023-05-08T12:40:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:04 smithi096 ceph-mon[124666]: pgmap v17197: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T12:40:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32143.858853 secs 2023-05-08T12:40:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32143.303073 secs 2023-05-08T12:40:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:04 smithi186 ceph-mon[126480]: pgmap v17197: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T12:40:05.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32143.858853 secs 2023-05-08T12:40:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:06 smithi133 ceph-mon[125939]: pgmap v17198: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 18 op/s 2023-05-08T12:40:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:06 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:40:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:06 smithi096 ceph-mon[124666]: pgmap v17198: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 18 op/s 2023-05-08T12:40:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:06 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:40:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:06 smithi186 ceph-mon[126480]: pgmap v17198: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 18 op/s 2023-05-08T12:40:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:06 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:40:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:08 smithi133 ceph-mon[125939]: pgmap v17199: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 767 KiB/s wr, 12 op/s 2023-05-08T12:40:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:08 smithi096 ceph-mon[124666]: pgmap v17199: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 767 KiB/s wr, 12 op/s 2023-05-08T12:40:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:08 smithi186 ceph-mon[126480]: pgmap v17199: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 767 KiB/s wr, 12 op/s 2023-05-08T12:40:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32148.303192 secs 2023-05-08T12:40:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32148.303192 secs 2023-05-08T12:40:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32148.303192 secs 2023-05-08T12:40:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:10 smithi133 ceph-mon[125939]: pgmap v17200: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 28 op/s 2023-05-08T12:40:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:10 smithi096 ceph-mon[124666]: pgmap v17200: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 28 op/s 2023-05-08T12:40:11.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:10 smithi186 ceph-mon[126480]: pgmap v17200: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 28 op/s 2023-05-08T12:40:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:12 smithi096 ceph-mon[124666]: pgmap v17201: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 857 KiB/s rd, 765 KiB/s wr, 22 op/s 2023-05-08T12:40:12.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:12 smithi186 ceph-mon[126480]: pgmap v17201: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 857 KiB/s rd, 765 KiB/s wr, 22 op/s 2023-05-08T12:40:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:12 smithi133 ceph-mon[125939]: pgmap v17201: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 857 KiB/s rd, 765 KiB/s wr, 22 op/s 2023-05-08T12:40:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:13 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:40:13.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:13 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:40:13.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:13 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:40:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:14 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:40:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:14 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:40:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:14 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:40:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32153.303307 secs 2023-05-08T12:40:14.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:14 smithi096 ceph-mon[124666]: pgmap v17202: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 858 KiB/s rd, 765 KiB/s wr, 22 op/s 2023-05-08T12:40:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:14 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:40:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:14 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:40:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:14 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:40:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32153.303307 secs 2023-05-08T12:40:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:14 smithi186 ceph-mon[126480]: pgmap v17202: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 858 KiB/s rd, 765 KiB/s wr, 22 op/s 2023-05-08T12:40:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:14 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:40:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:14 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:40:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:14 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:40:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32153.303307 secs 2023-05-08T12:40:14.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:14 smithi133 ceph-mon[125939]: pgmap v17202: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 858 KiB/s rd, 765 KiB/s wr, 22 op/s 2023-05-08T12:40:16.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:16 smithi133 ceph-mon[125939]: pgmap v17203: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 887 KiB/s wr, 26 op/s 2023-05-08T12:40:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:16 smithi096 ceph-mon[124666]: pgmap v17203: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 887 KiB/s wr, 26 op/s 2023-05-08T12:40:17.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:16 smithi186 ceph-mon[126480]: pgmap v17203: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 887 KiB/s wr, 26 op/s 2023-05-08T12:40:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:18 smithi133 ceph-mon[125939]: pgmap v17204: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 867 KiB/s rd, 762 KiB/s wr, 19 op/s 2023-05-08T12:40:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:18 smithi096 ceph-mon[124666]: pgmap v17204: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 867 KiB/s rd, 762 KiB/s wr, 19 op/s 2023-05-08T12:40:19.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:18 smithi186 ceph-mon[126480]: pgmap v17204: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 867 KiB/s rd, 762 KiB/s wr, 19 op/s 2023-05-08T12:40:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32158.303400 secs 2023-05-08T12:40:20.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32158.303400 secs 2023-05-08T12:40:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32158.303400 secs 2023-05-08T12:40:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:20 smithi133 ceph-mon[125939]: pgmap v17205: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 23 op/s 2023-05-08T12:40:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:20 smithi096 ceph-mon[124666]: pgmap v17205: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 23 op/s 2023-05-08T12:40:21.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:20 smithi186 ceph-mon[126480]: pgmap v17205: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 23 op/s 2023-05-08T12:40:22.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:22 smithi096 ceph-mon[124666]: pgmap v17206: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 738 KiB/s rd, 645 KiB/s wr, 8 op/s 2023-05-08T12:40:22.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:22 smithi186 ceph-mon[126480]: pgmap v17206: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 738 KiB/s rd, 645 KiB/s wr, 8 op/s 2023-05-08T12:40:22.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:22 smithi133 ceph-mon[125939]: pgmap v17206: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 738 KiB/s rd, 645 KiB/s wr, 8 op/s 2023-05-08T12:40:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32163.303529 secs 2023-05-08T12:40:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:24 smithi133 ceph-mon[125939]: pgmap v17207: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 738 KiB/s rd, 645 KiB/s wr, 8 op/s 2023-05-08T12:40:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32163.303529 secs 2023-05-08T12:40:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:24 smithi096 ceph-mon[124666]: pgmap v17207: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 738 KiB/s rd, 645 KiB/s wr, 8 op/s 2023-05-08T12:40:25.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32163.303529 secs 2023-05-08T12:40:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:24 smithi186 ceph-mon[126480]: pgmap v17207: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 738 KiB/s rd, 645 KiB/s wr, 8 op/s 2023-05-08T12:40:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:26 smithi133 ceph-mon[125939]: pgmap v17208: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 991 KiB/s rd, 645 KiB/s wr, 12 op/s 2023-05-08T12:40:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:26 smithi096 ceph-mon[124666]: pgmap v17208: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 991 KiB/s rd, 645 KiB/s wr, 12 op/s 2023-05-08T12:40:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:26 smithi186 ceph-mon[126480]: pgmap v17208: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 991 KiB/s rd, 645 KiB/s wr, 12 op/s 2023-05-08T12:40:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:28 smithi133 ceph-mon[125939]: pgmap v17209: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 525 KiB/s rd, 523 KiB/s wr, 8 op/s 2023-05-08T12:40:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:28 smithi096 ceph-mon[124666]: pgmap v17209: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 525 KiB/s rd, 523 KiB/s wr, 8 op/s 2023-05-08T12:40:29.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:28 smithi186 ceph-mon[126480]: pgmap v17209: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 525 KiB/s rd, 523 KiB/s wr, 8 op/s 2023-05-08T12:40:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32168.303646 secs 2023-05-08T12:40:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32168.859502 secs 2023-05-08T12:40:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32168.303646 secs 2023-05-08T12:40:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32168.859502 secs 2023-05-08T12:40:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32168.303646 secs 2023-05-08T12:40:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32168.859502 secs 2023-05-08T12:40:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:30 smithi133 ceph-mon[125939]: pgmap v17210: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 977 KiB/s rd, 995 KiB/s wr, 15 op/s 2023-05-08T12:40:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32170.149598 secs 2023-05-08T12:40:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:30 smithi096 ceph-mon[124666]: pgmap v17210: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 977 KiB/s rd, 995 KiB/s wr, 15 op/s 2023-05-08T12:40:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32170.149598 secs 2023-05-08T12:40:31.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:30 smithi186 ceph-mon[126480]: pgmap v17210: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 977 KiB/s rd, 995 KiB/s wr, 15 op/s 2023-05-08T12:40:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32170.149598 secs 2023-05-08T12:40:31.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:31 smithi133 ceph-mon[125939]: osdmap e1152: 12 total, 12 up, 12 in 2023-05-08T12:40:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:31 smithi096 ceph-mon[124666]: osdmap e1152: 12 total, 12 up, 12 in 2023-05-08T12:40:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:31 smithi186 ceph-mon[126480]: osdmap e1152: 12 total, 12 up, 12 in 2023-05-08T12:40:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:32 smithi133 ceph-mon[125939]: pgmap v17212: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 845 KiB/s rd, 567 KiB/s wr, 13 op/s 2023-05-08T12:40:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:32 smithi096 ceph-mon[124666]: pgmap v17212: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 845 KiB/s rd, 567 KiB/s wr, 13 op/s 2023-05-08T12:40:33.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:32 smithi186 ceph-mon[126480]: pgmap v17212: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 845 KiB/s rd, 567 KiB/s wr, 13 op/s 2023-05-08T12:40:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:33 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:40:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:33 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:40:33.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:33 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:40:33.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:33 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:40:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:33 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:40:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:33 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:40:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:33 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:40:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:33 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:40:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:33 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:40:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:33 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:40:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:33 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:40:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:33 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:40:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32173.303756 secs 2023-05-08T12:40:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:34 smithi133 ceph-mon[125939]: pgmap v17213: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 845 KiB/s rd, 567 KiB/s wr, 13 op/s 2023-05-08T12:40:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32173.859546 secs 2023-05-08T12:40:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32173.303756 secs 2023-05-08T12:40:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:34 smithi096 ceph-mon[124666]: pgmap v17213: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 845 KiB/s rd, 567 KiB/s wr, 13 op/s 2023-05-08T12:40:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32173.859546 secs 2023-05-08T12:40:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32173.303756 secs 2023-05-08T12:40:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:34 smithi186 ceph-mon[126480]: pgmap v17213: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 845 KiB/s rd, 567 KiB/s wr, 13 op/s 2023-05-08T12:40:35.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32173.859546 secs 2023-05-08T12:40:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:40:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32175.149738 secs 2023-05-08T12:40:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:40:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32175.149738 secs 2023-05-08T12:40:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:40:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32175.149738 secs 2023-05-08T12:40:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:36 smithi096 ceph-mon[124666]: pgmap v17214: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 571 KiB/s wr, 13 op/s 2023-05-08T12:40:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:40:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:40:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:40:37.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:36 smithi096 ceph-mon[124666]: osdmap e1153: 12 total, 12 up, 12 in 2023-05-08T12:40:37.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:36 smithi186 ceph-mon[126480]: pgmap v17214: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 571 KiB/s wr, 13 op/s 2023-05-08T12:40:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:40:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:40:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:40:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:36 smithi186 ceph-mon[126480]: osdmap e1153: 12 total, 12 up, 12 in 2023-05-08T12:40:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:36 smithi133 ceph-mon[125939]: pgmap v17214: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 571 KiB/s wr, 13 op/s 2023-05-08T12:40:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:40:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:40:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:40:37.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:36 smithi133 ceph-mon[125939]: osdmap e1153: 12 total, 12 up, 12 in 2023-05-08T12:40:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:37 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:40:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:37 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T12:40:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:37 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T12:40:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:37 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:40:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:37 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:40:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:37 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T12:40:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:37 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T12:40:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:37 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:40:38.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:37 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:40:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:37 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T12:40:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:37 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T12:40:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:37 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:40:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:38 smithi096 ceph-mon[124666]: pgmap v17216: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2023-05-08T12:40:39.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:38 smithi186 ceph-mon[126480]: pgmap v17216: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2023-05-08T12:40:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:38 smithi133 ceph-mon[125939]: pgmap v17216: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2023-05-08T12:40:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32178.303873 secs 2023-05-08T12:40:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32178.859668 secs 2023-05-08T12:40:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32178.303873 secs 2023-05-08T12:40:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32178.859668 secs 2023-05-08T12:40:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32178.303873 secs 2023-05-08T12:40:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32178.859668 secs 2023-05-08T12:40:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:40 smithi096 ceph-mon[124666]: pgmap v17217: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 513 KiB/s wr, 11 op/s 2023-05-08T12:40:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32180.149856 secs 2023-05-08T12:40:41.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:40 smithi186 ceph-mon[126480]: pgmap v17217: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 513 KiB/s wr, 11 op/s 2023-05-08T12:40:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32180.149856 secs 2023-05-08T12:40:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:40 smithi133 ceph-mon[125939]: pgmap v17217: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 513 KiB/s wr, 11 op/s 2023-05-08T12:40:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32180.149856 secs 2023-05-08T12:40:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:42 smithi186 ceph-mon[126480]: pgmap v17218: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 458 KiB/s wr, 10 op/s 2023-05-08T12:40:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:42 smithi133 ceph-mon[125939]: pgmap v17218: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 458 KiB/s wr, 10 op/s 2023-05-08T12:40:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:42 smithi096 ceph-mon[124666]: pgmap v17218: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 458 KiB/s wr, 10 op/s 2023-05-08T12:40:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32183.303992 secs 2023-05-08T12:40:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:44 smithi133 ceph-mon[125939]: pgmap v17219: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 458 KiB/s wr, 10 op/s 2023-05-08T12:40:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32183.859741 secs 2023-05-08T12:40:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32183.303992 secs 2023-05-08T12:40:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:44 smithi096 ceph-mon[124666]: pgmap v17219: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 458 KiB/s wr, 10 op/s 2023-05-08T12:40:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32183.859741 secs 2023-05-08T12:40:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32183.303992 secs 2023-05-08T12:40:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:44 smithi186 ceph-mon[126480]: pgmap v17219: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 458 KiB/s wr, 10 op/s 2023-05-08T12:40:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32183.859741 secs 2023-05-08T12:40:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32185.149939 secs 2023-05-08T12:40:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32185.149939 secs 2023-05-08T12:40:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32185.149939 secs 2023-05-08T12:40:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:46 smithi133 ceph-mon[125939]: pgmap v17220: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 821 KiB/s rd, 815 KiB/s wr, 9 op/s 2023-05-08T12:40:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:46 smithi096 ceph-mon[124666]: pgmap v17220: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 821 KiB/s rd, 815 KiB/s wr, 9 op/s 2023-05-08T12:40:47.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:46 smithi186 ceph-mon[126480]: pgmap v17220: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 821 KiB/s rd, 815 KiB/s wr, 9 op/s 2023-05-08T12:40:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:48 smithi133 ceph-mon[125939]: pgmap v17221: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 736 KiB/s rd, 731 KiB/s wr, 8 op/s 2023-05-08T12:40:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:48 smithi096 ceph-mon[124666]: pgmap v17221: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 736 KiB/s rd, 731 KiB/s wr, 8 op/s 2023-05-08T12:40:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:48 smithi186 ceph-mon[126480]: pgmap v17221: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 736 KiB/s rd, 731 KiB/s wr, 8 op/s 2023-05-08T12:40:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32188.304137 secs 2023-05-08T12:40:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32188.304137 secs 2023-05-08T12:40:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32188.304137 secs 2023-05-08T12:40:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:50 smithi133 ceph-mon[125939]: pgmap v17222: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 941 KiB/s rd, 935 KiB/s wr, 12 op/s 2023-05-08T12:40:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32190.150031 secs 2023-05-08T12:40:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:50 smithi096 ceph-mon[124666]: pgmap v17222: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 941 KiB/s rd, 935 KiB/s wr, 12 op/s 2023-05-08T12:40:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32190.150031 secs 2023-05-08T12:40:51.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:50 smithi186 ceph-mon[126480]: pgmap v17222: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 941 KiB/s rd, 935 KiB/s wr, 12 op/s 2023-05-08T12:40:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32190.150031 secs 2023-05-08T12:40:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:52 smithi186 ceph-mon[126480]: pgmap v17223: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 815 KiB/s rd, 557 KiB/s wr, 8 op/s 2023-05-08T12:40:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:52 smithi133 ceph-mon[125939]: pgmap v17223: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 815 KiB/s rd, 557 KiB/s wr, 8 op/s 2023-05-08T12:40:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:52 smithi096 ceph-mon[124666]: pgmap v17223: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 815 KiB/s rd, 557 KiB/s wr, 8 op/s 2023-05-08T12:40:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:53 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:40:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:53 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:40:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:53 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:40:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:54 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:40:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:54 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:40:54.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:54 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:40:54.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32193.304273 secs 2023-05-08T12:40:54.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:54 smithi186 ceph-mon[126480]: pgmap v17224: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 815 KiB/s rd, 557 KiB/s wr, 8 op/s 2023-05-08T12:40:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:54 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:40:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:54 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:40:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:54 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:40:54.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32193.304273 secs 2023-05-08T12:40:54.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:54 smithi133 ceph-mon[125939]: pgmap v17224: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 815 KiB/s rd, 557 KiB/s wr, 8 op/s 2023-05-08T12:40:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:54 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:40:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:54 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:40:55.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:54 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:40:55.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32193.304273 secs 2023-05-08T12:40:55.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:54 smithi096 ceph-mon[124666]: pgmap v17224: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 815 KiB/s rd, 557 KiB/s wr, 8 op/s 2023-05-08T12:40:56.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:56 smithi133 ceph-mon[125939]: pgmap v17225: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 14 op/s 2023-05-08T12:40:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:40:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:56 smithi096 ceph-mon[124666]: pgmap v17225: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 14 op/s 2023-05-08T12:40:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:40:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:56 smithi186 ceph-mon[126480]: pgmap v17225: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 14 op/s 2023-05-08T12:40:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:40:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:40:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:40:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:58 smithi186 ceph-mon[126480]: pgmap v17226: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 767 KiB/s rd, 755 KiB/s wr, 10 op/s 2023-05-08T12:40:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:40:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:40:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:58 smithi133 ceph-mon[125939]: pgmap v17226: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 767 KiB/s rd, 755 KiB/s wr, 10 op/s 2023-05-08T12:40:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:40:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:40:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:58 smithi096 ceph-mon[124666]: pgmap v17226: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 767 KiB/s rd, 755 KiB/s wr, 10 op/s 2023-05-08T12:40:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32198.304396 secs 2023-05-08T12:40:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:40:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32198.860060 secs 2023-05-08T12:40:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32198.304396 secs 2023-05-08T12:40:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:40:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32198.860060 secs 2023-05-08T12:41:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32198.304396 secs 2023-05-08T12:41:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:40:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32198.860060 secs 2023-05-08T12:41:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:00 smithi186 ceph-mon[126480]: pgmap v17227: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 16 op/s 2023-05-08T12:41:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:00 smithi133 ceph-mon[125939]: pgmap v17227: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 16 op/s 2023-05-08T12:41:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:00 smithi096 ceph-mon[124666]: pgmap v17227: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 16 op/s 2023-05-08T12:41:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:01 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:41:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:01 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:41:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:01 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:41:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:41:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:41:02.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:02 smithi186 ceph-mon[126480]: pgmap v17228: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 932 KiB/s rd, 920 KiB/s wr, 11 op/s 2023-05-08T12:41:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:41:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:41:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:02 smithi133 ceph-mon[125939]: pgmap v17228: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 932 KiB/s rd, 920 KiB/s wr, 11 op/s 2023-05-08T12:41:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:41:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:41:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:02 smithi096 ceph-mon[124666]: pgmap v17228: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 932 KiB/s rd, 920 KiB/s wr, 11 op/s 2023-05-08T12:41:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32203.304509 secs 2023-05-08T12:41:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:04 smithi133 ceph-mon[125939]: pgmap v17229: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 932 KiB/s rd, 920 KiB/s wr, 11 op/s 2023-05-08T12:41:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:04 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:41:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32203.304509 secs 2023-05-08T12:41:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:04 smithi096 ceph-mon[124666]: pgmap v17229: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 932 KiB/s rd, 920 KiB/s wr, 11 op/s 2023-05-08T12:41:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:04 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:41:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32203.304509 secs 2023-05-08T12:41:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:04 smithi186 ceph-mon[126480]: pgmap v17229: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 932 KiB/s rd, 920 KiB/s wr, 11 op/s 2023-05-08T12:41:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:04 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:41:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:41:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:41:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32205.150406 secs 2023-05-08T12:41:06.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:41:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:41:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32205.150406 secs 2023-05-08T12:41:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:41:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:41:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32205.150406 secs 2023-05-08T12:41:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:06 smithi133 ceph-mon[125939]: pgmap v17230: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 19 op/s 2023-05-08T12:41:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:06 smithi096 ceph-mon[124666]: pgmap v17230: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 19 op/s 2023-05-08T12:41:07.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:06 smithi186 ceph-mon[126480]: pgmap v17230: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 19 op/s 2023-05-08T12:41:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:08 smithi133 ceph-mon[125939]: pgmap v17231: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 852 KiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T12:41:09.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:08 smithi096 ceph-mon[124666]: pgmap v17231: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 852 KiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T12:41:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:08 smithi186 ceph-mon[126480]: pgmap v17231: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 852 KiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T12:41:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32208.304626 secs 2023-05-08T12:41:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:09 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:41:09.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:41:09.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:41:09.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32208.860349 secs 2023-05-08T12:41:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32208.304626 secs 2023-05-08T12:41:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:09 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:41:10.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:41:10.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:41:10.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32208.860349 secs 2023-05-08T12:41:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32208.304626 secs 2023-05-08T12:41:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:09 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:41:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:41:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:41:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32208.860349 secs 2023-05-08T12:41:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:10 smithi096 ceph-mon[124666]: pgmap v17232: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 29 op/s 2023-05-08T12:41:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32210.150524 secs 2023-05-08T12:41:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:10 smithi186 ceph-mon[126480]: pgmap v17232: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 29 op/s 2023-05-08T12:41:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32210.150524 secs 2023-05-08T12:41:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:10 smithi133 ceph-mon[125939]: pgmap v17232: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 29 op/s 2023-05-08T12:41:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32210.150524 secs 2023-05-08T12:41:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:11 smithi096 ceph-mon[124666]: osdmap e1154: 12 total, 12 up, 12 in 2023-05-08T12:41:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:11 smithi186 ceph-mon[126480]: osdmap e1154: 12 total, 12 up, 12 in 2023-05-08T12:41:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:11 smithi133 ceph-mon[125939]: osdmap e1154: 12 total, 12 up, 12 in 2023-05-08T12:41:13.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:12 smithi186 ceph-mon[126480]: pgmap v17234: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1021 KiB/s rd, 1.0 MiB/s wr, 28 op/s 2023-05-08T12:41:13.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:12 smithi133 ceph-mon[125939]: pgmap v17234: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1021 KiB/s rd, 1.0 MiB/s wr, 28 op/s 2023-05-08T12:41:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:12 smithi096 ceph-mon[124666]: pgmap v17234: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1021 KiB/s rd, 1.0 MiB/s wr, 28 op/s 2023-05-08T12:41:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:14 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:41:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:14 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:41:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32213.304748 secs 2023-05-08T12:41:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:14 smithi186 ceph-mon[126480]: pgmap v17235: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1020 KiB/s rd, 1.0 MiB/s wr, 28 op/s 2023-05-08T12:41:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32213.860466 secs 2023-05-08T12:41:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:14 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:41:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:14 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:41:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32213.304748 secs 2023-05-08T12:41:14.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:14 smithi133 ceph-mon[125939]: pgmap v17235: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1020 KiB/s rd, 1.0 MiB/s wr, 28 op/s 2023-05-08T12:41:14.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32213.860466 secs 2023-05-08T12:41:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:14 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:41:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:14 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:41:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32213.304748 secs 2023-05-08T12:41:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:14 smithi096 ceph-mon[124666]: pgmap v17235: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1020 KiB/s rd, 1.0 MiB/s wr, 28 op/s 2023-05-08T12:41:15.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32213.860466 secs 2023-05-08T12:41:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32215.150661 secs 2023-05-08T12:41:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32215.150661 secs 2023-05-08T12:41:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32215.150661 secs 2023-05-08T12:41:17.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:16 smithi186 ceph-mon[126480]: pgmap v17236: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 827 KiB/s rd, 435 KiB/s wr, 23 op/s 2023-05-08T12:41:17.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:16 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:41:17.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:16 smithi186 ceph-mon[126480]: osdmap e1155: 12 total, 12 up, 12 in 2023-05-08T12:41:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:16 smithi133 ceph-mon[125939]: pgmap v17236: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 827 KiB/s rd, 435 KiB/s wr, 23 op/s 2023-05-08T12:41:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:16 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:41:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:16 smithi133 ceph-mon[125939]: osdmap e1155: 12 total, 12 up, 12 in 2023-05-08T12:41:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:16 smithi096 ceph-mon[124666]: pgmap v17236: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 827 KiB/s rd, 435 KiB/s wr, 23 op/s 2023-05-08T12:41:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:16 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:41:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:16 smithi096 ceph-mon[124666]: osdmap e1155: 12 total, 12 up, 12 in 2023-05-08T12:41:18.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:17 smithi186 ceph-mon[126480]: pgmap v17238: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 404 KiB/s rd, 402 KiB/s wr, 5 op/s 2023-05-08T12:41:18.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:17 smithi133 ceph-mon[125939]: pgmap v17238: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 404 KiB/s rd, 402 KiB/s wr, 5 op/s 2023-05-08T12:41:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:17 smithi096 ceph-mon[124666]: pgmap v17238: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 404 KiB/s rd, 402 KiB/s wr, 5 op/s 2023-05-08T12:41:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32218.304862 secs 2023-05-08T12:41:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32218.304862 secs 2023-05-08T12:41:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32218.304862 secs 2023-05-08T12:41:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32218.860595 secs 2023-05-08T12:41:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:20 smithi186 ceph-mon[126480]: pgmap v17239: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 417 KiB/s wr, 9 op/s 2023-05-08T12:41:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32218.860595 secs 2023-05-08T12:41:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:20 smithi133 ceph-mon[125939]: pgmap v17239: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 417 KiB/s wr, 9 op/s 2023-05-08T12:41:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32218.860595 secs 2023-05-08T12:41:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:20 smithi096 ceph-mon[124666]: pgmap v17239: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 417 KiB/s wr, 9 op/s 2023-05-08T12:41:21.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32220.150787 secs 2023-05-08T12:41:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32220.150787 secs 2023-05-08T12:41:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32220.150787 secs 2023-05-08T12:41:22.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:22 smithi186 ceph-mon[126480]: pgmap v17240: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 372 KiB/s wr, 9 op/s 2023-05-08T12:41:22.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:22 smithi133 ceph-mon[125939]: pgmap v17240: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 372 KiB/s wr, 9 op/s 2023-05-08T12:41:23.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:22 smithi096 ceph-mon[124666]: pgmap v17240: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 372 KiB/s wr, 9 op/s 2023-05-08T12:41:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32223.305005 secs 2023-05-08T12:41:24.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:24 smithi133 ceph-mon[125939]: pgmap v17241: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 372 KiB/s wr, 9 op/s 2023-05-08T12:41:24.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32223.860719 secs 2023-05-08T12:41:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32223.305005 secs 2023-05-08T12:41:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:24 smithi096 ceph-mon[124666]: pgmap v17241: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 372 KiB/s wr, 9 op/s 2023-05-08T12:41:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32223.860719 secs 2023-05-08T12:41:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32223.305005 secs 2023-05-08T12:41:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:24 smithi186 ceph-mon[126480]: pgmap v17241: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 372 KiB/s wr, 9 op/s 2023-05-08T12:41:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32223.860719 secs 2023-05-08T12:41:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32225.150911 secs 2023-05-08T12:41:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32225.150911 secs 2023-05-08T12:41:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32225.150911 secs 2023-05-08T12:41:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:26 smithi133 ceph-mon[125939]: pgmap v17242: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 302 KiB/s wr, 9 op/s 2023-05-08T12:41:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:26 smithi096 ceph-mon[124666]: pgmap v17242: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 302 KiB/s wr, 9 op/s 2023-05-08T12:41:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:26 smithi186 ceph-mon[126480]: pgmap v17242: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 302 KiB/s wr, 9 op/s 2023-05-08T12:41:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:28 smithi133 ceph-mon[125939]: pgmap v17243: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 271 KiB/s wr, 8 op/s 2023-05-08T12:41:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:28 smithi096 ceph-mon[124666]: pgmap v17243: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 271 KiB/s wr, 8 op/s 2023-05-08T12:41:29.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:28 smithi186 ceph-mon[126480]: pgmap v17243: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 271 KiB/s wr, 8 op/s 2023-05-08T12:41:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32228.305120 secs 2023-05-08T12:41:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32228.860840 secs 2023-05-08T12:41:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32228.305120 secs 2023-05-08T12:41:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32228.860840 secs 2023-05-08T12:41:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32228.305120 secs 2023-05-08T12:41:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32228.860840 secs 2023-05-08T12:41:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:30 smithi096 ceph-mon[124666]: pgmap v17244: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 255 KiB/s rd, 379 KiB/s wr, 11 op/s 2023-05-08T12:41:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32230.150997 secs 2023-05-08T12:41:31.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:30 smithi186 ceph-mon[126480]: pgmap v17244: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 255 KiB/s rd, 379 KiB/s wr, 11 op/s 2023-05-08T12:41:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32230.150997 secs 2023-05-08T12:41:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:30 smithi133 ceph-mon[125939]: pgmap v17244: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 255 KiB/s rd, 379 KiB/s wr, 11 op/s 2023-05-08T12:41:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32230.150997 secs 2023-05-08T12:41:32.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:32 smithi186 ceph-mon[126480]: pgmap v17245: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 337 KiB/s wr, 7 op/s 2023-05-08T12:41:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:32 smithi133 ceph-mon[125939]: pgmap v17245: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 337 KiB/s wr, 7 op/s 2023-05-08T12:41:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:32 smithi096 ceph-mon[124666]: pgmap v17245: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 337 KiB/s wr, 7 op/s 2023-05-08T12:41:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32233.305238 secs 2023-05-08T12:41:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:34 smithi133 ceph-mon[125939]: pgmap v17246: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 337 KiB/s wr, 7 op/s 2023-05-08T12:41:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32233.860959 secs 2023-05-08T12:41:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32233.305238 secs 2023-05-08T12:41:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:34 smithi096 ceph-mon[124666]: pgmap v17246: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 337 KiB/s wr, 7 op/s 2023-05-08T12:41:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32233.860959 secs 2023-05-08T12:41:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32233.305238 secs 2023-05-08T12:41:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:34 smithi186 ceph-mon[126480]: pgmap v17246: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 337 KiB/s wr, 7 op/s 2023-05-08T12:41:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32233.860959 secs 2023-05-08T12:41:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32235.151141 secs 2023-05-08T12:41:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32235.151141 secs 2023-05-08T12:41:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32235.151141 secs 2023-05-08T12:41:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:36 smithi133 ceph-mon[125939]: pgmap v17247: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 512 KiB/s rd, 489 KiB/s wr, 11 op/s 2023-05-08T12:41:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:41:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:36 smithi096 ceph-mon[124666]: pgmap v17247: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 512 KiB/s rd, 489 KiB/s wr, 11 op/s 2023-05-08T12:41:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:41:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:36 smithi186 ceph-mon[126480]: pgmap v17247: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 512 KiB/s rd, 489 KiB/s wr, 11 op/s 2023-05-08T12:41:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:41:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:37 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:41:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:37 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:41:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:37 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:41:38.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:37 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:41:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:37 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:41:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:37 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:41:38.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:37 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:41:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:37 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:41:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:37 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:41:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:38 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:41:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:38 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T12:41:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:38 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T12:41:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:38 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:41:39.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:38 smithi096 ceph-mon[124666]: pgmap v17248: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 279 KiB/s wr, 7 op/s 2023-05-08T12:41:39.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:38 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:41:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:38 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T12:41:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:38 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T12:41:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:38 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:41:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:38 smithi186 ceph-mon[126480]: pgmap v17248: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 279 KiB/s wr, 7 op/s 2023-05-08T12:41:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:38 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:41:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:38 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T12:41:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:38 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T12:41:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:38 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:41:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:38 smithi133 ceph-mon[125939]: pgmap v17248: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 279 KiB/s wr, 7 op/s 2023-05-08T12:41:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32238.305374 secs 2023-05-08T12:41:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32238.861082 secs 2023-05-08T12:41:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32238.305374 secs 2023-05-08T12:41:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32238.861082 secs 2023-05-08T12:41:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32238.305374 secs 2023-05-08T12:41:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32238.861082 secs 2023-05-08T12:41:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:40 smithi096 ceph-mon[124666]: pgmap v17249: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 380 KiB/s wr, 10 op/s 2023-05-08T12:41:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32240.151264 secs 2023-05-08T12:41:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:40 smithi186 ceph-mon[126480]: pgmap v17249: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 380 KiB/s wr, 10 op/s 2023-05-08T12:41:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32240.151264 secs 2023-05-08T12:41:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:40 smithi133 ceph-mon[125939]: pgmap v17249: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 380 KiB/s wr, 10 op/s 2023-05-08T12:41:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32240.151264 secs 2023-05-08T12:41:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:42 smithi186 ceph-mon[126480]: pgmap v17250: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 253 KiB/s wr, 7 op/s 2023-05-08T12:41:42.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:42 smithi133 ceph-mon[125939]: pgmap v17250: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 253 KiB/s wr, 7 op/s 2023-05-08T12:41:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:42 smithi096 ceph-mon[124666]: pgmap v17250: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 253 KiB/s wr, 7 op/s 2023-05-08T12:41:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32243.305510 secs 2023-05-08T12:41:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:44 smithi133 ceph-mon[125939]: pgmap v17251: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 253 KiB/s wr, 7 op/s 2023-05-08T12:41:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32243.861197 secs 2023-05-08T12:41:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32243.305510 secs 2023-05-08T12:41:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:44 smithi096 ceph-mon[124666]: pgmap v17251: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 253 KiB/s wr, 7 op/s 2023-05-08T12:41:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32243.861197 secs 2023-05-08T12:41:45.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32243.305510 secs 2023-05-08T12:41:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:44 smithi186 ceph-mon[126480]: pgmap v17251: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 253 KiB/s wr, 7 op/s 2023-05-08T12:41:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32243.861197 secs 2023-05-08T12:41:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32245.151404 secs 2023-05-08T12:41:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32245.151404 secs 2023-05-08T12:41:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32245.151404 secs 2023-05-08T12:41:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:46 smithi133 ceph-mon[125939]: pgmap v17252: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 700 KiB/s rd, 570 KiB/s wr, 11 op/s 2023-05-08T12:41:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:46 smithi096 ceph-mon[124666]: pgmap v17252: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 700 KiB/s rd, 570 KiB/s wr, 11 op/s 2023-05-08T12:41:47.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:46 smithi186 ceph-mon[126480]: pgmap v17252: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 700 KiB/s rd, 570 KiB/s wr, 11 op/s 2023-05-08T12:41:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:48 smithi096 ceph-mon[124666]: pgmap v17253: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 420 KiB/s rd, 418 KiB/s wr, 7 op/s 2023-05-08T12:41:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:48 smithi186 ceph-mon[126480]: pgmap v17253: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 420 KiB/s rd, 418 KiB/s wr, 7 op/s 2023-05-08T12:41:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:48 smithi133 ceph-mon[125939]: pgmap v17253: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 420 KiB/s rd, 418 KiB/s wr, 7 op/s 2023-05-08T12:41:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32248.305657 secs 2023-05-08T12:41:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32248.861316 secs 2023-05-08T12:41:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32248.305657 secs 2023-05-08T12:41:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32248.861316 secs 2023-05-08T12:41:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32248.305657 secs 2023-05-08T12:41:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32248.861316 secs 2023-05-08T12:41:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:50 smithi096 ceph-mon[124666]: pgmap v17254: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 484 KiB/s wr, 10 op/s 2023-05-08T12:41:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32250.151502 secs 2023-05-08T12:41:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:50 smithi186 ceph-mon[126480]: pgmap v17254: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 484 KiB/s wr, 10 op/s 2023-05-08T12:41:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32250.151502 secs 2023-05-08T12:41:51.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:50 smithi133 ceph-mon[125939]: pgmap v17254: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 484 KiB/s wr, 10 op/s 2023-05-08T12:41:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32250.151502 secs 2023-05-08T12:41:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:52 smithi186 ceph-mon[126480]: pgmap v17255: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 384 KiB/s wr, 7 op/s 2023-05-08T12:41:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:52 smithi133 ceph-mon[125939]: pgmap v17255: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 384 KiB/s wr, 7 op/s 2023-05-08T12:41:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:52 smithi096 ceph-mon[124666]: pgmap v17255: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 384 KiB/s wr, 7 op/s 2023-05-08T12:41:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32253.305781 secs 2023-05-08T12:41:54.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:54 smithi133 ceph-mon[125939]: pgmap v17256: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 384 KiB/s wr, 7 op/s 2023-05-08T12:41:55.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32253.305781 secs 2023-05-08T12:41:55.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:54 smithi096 ceph-mon[124666]: pgmap v17256: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 384 KiB/s wr, 7 op/s 2023-05-08T12:41:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32253.305781 secs 2023-05-08T12:41:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:54 smithi186 ceph-mon[126480]: pgmap v17256: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 384 KiB/s wr, 7 op/s 2023-05-08T12:41:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32255.151620 secs 2023-05-08T12:41:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32255.151620 secs 2023-05-08T12:41:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32255.151620 secs 2023-05-08T12:41:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:56 smithi096 ceph-mon[124666]: pgmap v17257: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 913 KiB/s wr, 11 op/s 2023-05-08T12:41:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:41:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:56 smithi186 ceph-mon[126480]: pgmap v17257: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 913 KiB/s wr, 11 op/s 2023-05-08T12:41:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:41:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:56 smithi133 ceph-mon[125939]: pgmap v17257: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 913 KiB/s wr, 11 op/s 2023-05-08T12:41:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:41:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:57 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:41:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:41:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:41:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:57 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:41:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:41:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:41:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:57 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:41:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:41:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:41:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:58 smithi096 ceph-mon[124666]: pgmap v17258: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 596 KiB/s wr, 8 op/s 2023-05-08T12:41:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:58 smithi186 ceph-mon[126480]: pgmap v17258: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 596 KiB/s wr, 8 op/s 2023-05-08T12:41:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:58 smithi133 ceph-mon[125939]: pgmap v17258: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 596 KiB/s wr, 8 op/s 2023-05-08T12:42:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:41:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32258.305878 secs 2023-05-08T12:42:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:41:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32258.305878 secs 2023-05-08T12:42:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:41:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32258.305878 secs 2023-05-08T12:42:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:00 smithi096 ceph-mon[124666]: pgmap v17259: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 13 op/s 2023-05-08T12:42:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:00 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:42:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:00 smithi186 ceph-mon[126480]: pgmap v17259: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 13 op/s 2023-05-08T12:42:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:00 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:42:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:00 smithi133 ceph-mon[125939]: pgmap v17259: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 13 op/s 2023-05-08T12:42:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:00 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:42:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:42:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:42:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:42:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:42:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:42:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:42:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:02 smithi186 ceph-mon[126480]: pgmap v17260: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1000 KiB/s rd, 987 KiB/s wr, 10 op/s 2023-05-08T12:42:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:02 smithi133 ceph-mon[125939]: pgmap v17260: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1000 KiB/s rd, 987 KiB/s wr, 10 op/s 2023-05-08T12:42:03.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:02 smithi096 ceph-mon[124666]: pgmap v17260: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1000 KiB/s rd, 987 KiB/s wr, 10 op/s 2023-05-08T12:42:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32263.306002 secs 2023-05-08T12:42:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:04 smithi186 ceph-mon[126480]: pgmap v17261: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1000 KiB/s rd, 987 KiB/s wr, 10 op/s 2023-05-08T12:42:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32263.861696 secs 2023-05-08T12:42:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32263.306002 secs 2023-05-08T12:42:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:04 smithi133 ceph-mon[125939]: pgmap v17261: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1000 KiB/s rd, 987 KiB/s wr, 10 op/s 2023-05-08T12:42:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32263.861696 secs 2023-05-08T12:42:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32263.306002 secs 2023-05-08T12:42:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:04 smithi096 ceph-mon[124666]: pgmap v17261: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1000 KiB/s rd, 987 KiB/s wr, 10 op/s 2023-05-08T12:42:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32263.861696 secs 2023-05-08T12:42:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:05 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:42:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:42:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:42:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32265.151815 secs 2023-05-08T12:42:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:05 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:42:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:42:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:42:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32265.151815 secs 2023-05-08T12:42:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:05 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:42:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:42:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:42:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32265.151815 secs 2023-05-08T12:42:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:06 smithi186 ceph-mon[126480]: pgmap v17262: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 29 op/s 2023-05-08T12:42:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:06 smithi133 ceph-mon[125939]: pgmap v17262: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 29 op/s 2023-05-08T12:42:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:06 smithi096 ceph-mon[124666]: pgmap v17262: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 29 op/s 2023-05-08T12:42:08.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:07 smithi186 ceph-mon[126480]: pgmap v17263: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 824 KiB/s rd, 847 KiB/s wr, 25 op/s 2023-05-08T12:42:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:07 smithi133 ceph-mon[125939]: pgmap v17263: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 824 KiB/s rd, 847 KiB/s wr, 25 op/s 2023-05-08T12:42:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:07 smithi096 ceph-mon[124666]: pgmap v17263: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 824 KiB/s rd, 847 KiB/s wr, 25 op/s 2023-05-08T12:42:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32268.306076 secs 2023-05-08T12:42:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:42:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:42:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:09 smithi186 ceph-mon[126480]: pgmap v17264: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 961 KiB/s rd, 901 KiB/s wr, 29 op/s 2023-05-08T12:42:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32268.306076 secs 2023-05-08T12:42:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:42:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:42:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:09 smithi133 ceph-mon[125939]: pgmap v17264: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 961 KiB/s rd, 901 KiB/s wr, 29 op/s 2023-05-08T12:42:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32268.306076 secs 2023-05-08T12:42:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:42:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:42:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:09 smithi096 ceph-mon[124666]: pgmap v17264: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 961 KiB/s rd, 901 KiB/s wr, 29 op/s 2023-05-08T12:42:11.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32270.151937 secs 2023-05-08T12:42:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32270.151937 secs 2023-05-08T12:42:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32270.151937 secs 2023-05-08T12:42:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:11 smithi186 ceph-mon[126480]: osdmap e1156: 12 total, 12 up, 12 in 2023-05-08T12:42:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:11 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:42:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:11 smithi186 ceph-mon[126480]: pgmap v17266: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 706 KiB/s rd, 941 KiB/s wr, 29 op/s 2023-05-08T12:42:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:11 smithi133 ceph-mon[125939]: osdmap e1156: 12 total, 12 up, 12 in 2023-05-08T12:42:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:11 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:42:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:11 smithi133 ceph-mon[125939]: pgmap v17266: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 706 KiB/s rd, 941 KiB/s wr, 29 op/s 2023-05-08T12:42:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:11 smithi096 ceph-mon[124666]: osdmap e1156: 12 total, 12 up, 12 in 2023-05-08T12:42:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:11 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:42:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:11 smithi096 ceph-mon[124666]: pgmap v17266: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 706 KiB/s rd, 941 KiB/s wr, 29 op/s 2023-05-08T12:42:13.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:13 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:42:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:13 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:42:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:13 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:42:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:14 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:42:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:14 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:42:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32273.306189 secs 2023-05-08T12:42:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:14 smithi186 ceph-mon[126480]: pgmap v17267: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 707 KiB/s rd, 941 KiB/s wr, 29 op/s 2023-05-08T12:42:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:14 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:42:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:14 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:42:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32273.306189 secs 2023-05-08T12:42:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:14 smithi133 ceph-mon[125939]: pgmap v17267: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 707 KiB/s rd, 941 KiB/s wr, 29 op/s 2023-05-08T12:42:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:14 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:42:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:14 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:42:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32273.306189 secs 2023-05-08T12:42:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:14 smithi096 ceph-mon[124666]: pgmap v17267: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 707 KiB/s rd, 941 KiB/s wr, 29 op/s 2023-05-08T12:42:16.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32275.152047 secs 2023-05-08T12:42:16.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:15 smithi186 ceph-mon[126480]: pgmap v17268: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 645 KiB/s rd, 667 KiB/s wr, 10 op/s 2023-05-08T12:42:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32275.152047 secs 2023-05-08T12:42:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:15 smithi133 ceph-mon[125939]: pgmap v17268: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 645 KiB/s rd, 667 KiB/s wr, 10 op/s 2023-05-08T12:42:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32275.152047 secs 2023-05-08T12:42:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:15 smithi096 ceph-mon[124666]: pgmap v17268: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 645 KiB/s rd, 667 KiB/s wr, 10 op/s 2023-05-08T12:42:17.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:16 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:42:17.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:16 smithi186 ceph-mon[126480]: osdmap e1157: 12 total, 12 up, 12 in 2023-05-08T12:42:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:16 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:42:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:16 smithi133 ceph-mon[125939]: osdmap e1157: 12 total, 12 up, 12 in 2023-05-08T12:42:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:16 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:42:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:16 smithi096 ceph-mon[124666]: osdmap e1157: 12 total, 12 up, 12 in 2023-05-08T12:42:18.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:17 smithi186 ceph-mon[126480]: pgmap v17270: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 753 KiB/s wr, 6 op/s 2023-05-08T12:42:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:17 smithi133 ceph-mon[125939]: pgmap v17270: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 753 KiB/s wr, 6 op/s 2023-05-08T12:42:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:17 smithi096 ceph-mon[124666]: pgmap v17270: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 753 KiB/s wr, 6 op/s 2023-05-08T12:42:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32278.306310 secs 2023-05-08T12:42:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32278.306310 secs 2023-05-08T12:42:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32278.306310 secs 2023-05-08T12:42:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:20 smithi186 ceph-mon[126480]: pgmap v17271: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 586 KiB/s rd, 246 KiB/s wr, 10 op/s 2023-05-08T12:42:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:20 smithi133 ceph-mon[125939]: pgmap v17271: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 586 KiB/s rd, 246 KiB/s wr, 10 op/s 2023-05-08T12:42:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:20 smithi096 ceph-mon[124666]: pgmap v17271: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 586 KiB/s rd, 246 KiB/s wr, 10 op/s 2023-05-08T12:42:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32280.152168 secs 2023-05-08T12:42:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32280.152168 secs 2023-05-08T12:42:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32280.152168 secs 2023-05-08T12:42:22.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:22 smithi186 ceph-mon[126480]: pgmap v17272: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 219 KiB/s wr, 8 op/s 2023-05-08T12:42:22.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:22 smithi133 ceph-mon[125939]: pgmap v17272: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 219 KiB/s wr, 8 op/s 2023-05-08T12:42:23.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:22 smithi096 ceph-mon[124666]: pgmap v17272: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 219 KiB/s wr, 8 op/s 2023-05-08T12:42:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32283.306422 secs 2023-05-08T12:42:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:24 smithi096 ceph-mon[124666]: pgmap v17273: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 219 KiB/s wr, 8 op/s 2023-05-08T12:42:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32283.862097 secs 2023-05-08T12:42:25.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32283.306422 secs 2023-05-08T12:42:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:24 smithi186 ceph-mon[126480]: pgmap v17273: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 219 KiB/s wr, 8 op/s 2023-05-08T12:42:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32283.862097 secs 2023-05-08T12:42:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32283.306422 secs 2023-05-08T12:42:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:24 smithi133 ceph-mon[125939]: pgmap v17273: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 219 KiB/s wr, 8 op/s 2023-05-08T12:42:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32283.862097 secs 2023-05-08T12:42:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:25 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:42:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:25 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:42:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:25 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:42:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32285.152264 secs 2023-05-08T12:42:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:25 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:42:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:25 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:42:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:25 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:42:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32285.152264 secs 2023-05-08T12:42:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:25 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:42:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:25 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:42:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:25 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:42:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32285.152264 secs 2023-05-08T12:42:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:26 smithi096 ceph-mon[124666]: pgmap v17274: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 239 KiB/s wr, 8 op/s 2023-05-08T12:42:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:26 smithi186 ceph-mon[126480]: pgmap v17274: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 239 KiB/s wr, 8 op/s 2023-05-08T12:42:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:26 smithi133 ceph-mon[125939]: pgmap v17274: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 239 KiB/s wr, 8 op/s 2023-05-08T12:42:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:28 smithi186 ceph-mon[126480]: pgmap v17275: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 215 KiB/s wr, 7 op/s 2023-05-08T12:42:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:28 smithi133 ceph-mon[125939]: pgmap v17275: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 215 KiB/s wr, 7 op/s 2023-05-08T12:42:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:28 smithi096 ceph-mon[124666]: pgmap v17275: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 215 KiB/s wr, 7 op/s 2023-05-08T12:42:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32288.306540 secs 2023-05-08T12:42:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32288.862223 secs 2023-05-08T12:42:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32288.306540 secs 2023-05-08T12:42:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32288.862223 secs 2023-05-08T12:42:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32288.306540 secs 2023-05-08T12:42:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32288.862223 secs 2023-05-08T12:42:31.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:30 smithi186 ceph-mon[126480]: pgmap v17276: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 227 KiB/s wr, 11 op/s 2023-05-08T12:42:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32290.152403 secs 2023-05-08T12:42:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:30 smithi133 ceph-mon[125939]: pgmap v17276: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 227 KiB/s wr, 11 op/s 2023-05-08T12:42:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32290.152403 secs 2023-05-08T12:42:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:30 smithi096 ceph-mon[124666]: pgmap v17276: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 227 KiB/s wr, 11 op/s 2023-05-08T12:42:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32290.152403 secs 2023-05-08T12:42:32.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:32 smithi186 ceph-mon[126480]: pgmap v17277: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 547 KiB/s wr, 8 op/s 2023-05-08T12:42:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:32 smithi133 ceph-mon[125939]: pgmap v17277: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 547 KiB/s wr, 8 op/s 2023-05-08T12:42:33.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:32 smithi096 ceph-mon[124666]: pgmap v17277: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 547 KiB/s wr, 8 op/s 2023-05-08T12:42:35.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32293.306625 secs 2023-05-08T12:42:35.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:34 smithi096 ceph-mon[124666]: pgmap v17278: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 547 KiB/s wr, 8 op/s 2023-05-08T12:42:35.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32293.862350 secs 2023-05-08T12:42:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32293.306625 secs 2023-05-08T12:42:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:34 smithi186 ceph-mon[126480]: pgmap v17278: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 547 KiB/s wr, 8 op/s 2023-05-08T12:42:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32293.862350 secs 2023-05-08T12:42:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32293.306625 secs 2023-05-08T12:42:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:34 smithi133 ceph-mon[125939]: pgmap v17278: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 547 KiB/s wr, 8 op/s 2023-05-08T12:42:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32293.862350 secs 2023-05-08T12:42:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32295.152519 secs 2023-05-08T12:42:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32295.152519 secs 2023-05-08T12:42:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32295.152519 secs 2023-05-08T12:42:37.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:36 smithi186 ceph-mon[126480]: pgmap v17279: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 625 KiB/s rd, 602 KiB/s wr, 12 op/s 2023-05-08T12:42:37.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:36 smithi133 ceph-mon[125939]: pgmap v17279: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 625 KiB/s rd, 602 KiB/s wr, 12 op/s 2023-05-08T12:42:37.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:36 smithi096 ceph-mon[124666]: pgmap v17279: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 625 KiB/s rd, 602 KiB/s wr, 12 op/s 2023-05-08T12:42:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:37 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:42:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:37 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:42:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:37 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:42:38.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:37 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:42:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:37 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:42:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:37 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:42:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:37 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:42:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:37 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:42:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:37 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:42:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:37 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:42:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:37 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:42:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:37 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:42:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:38 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:42:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:38 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T12:42:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:38 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T12:42:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:38 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:42:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:38 smithi186 ceph-mon[126480]: pgmap v17280: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 582 KiB/s rd, 424 KiB/s wr, 8 op/s 2023-05-08T12:42:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:38 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:42:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:38 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T12:42:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:38 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T12:42:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:38 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:42:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:38 smithi133 ceph-mon[125939]: pgmap v17280: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 582 KiB/s rd, 424 KiB/s wr, 8 op/s 2023-05-08T12:42:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:38 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:42:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:38 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T12:42:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:38 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T12:42:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:38 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:42:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:38 smithi096 ceph-mon[124666]: pgmap v17280: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 582 KiB/s rd, 424 KiB/s wr, 8 op/s 2023-05-08T12:42:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32298.306741 secs 2023-05-08T12:42:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32298.862488 secs 2023-05-08T12:42:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32298.306741 secs 2023-05-08T12:42:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32298.862488 secs 2023-05-08T12:42:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32298.306741 secs 2023-05-08T12:42:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32298.862488 secs 2023-05-08T12:42:41.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:40 smithi186 ceph-mon[126480]: pgmap v17281: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 583 KiB/s rd, 424 KiB/s wr, 11 op/s 2023-05-08T12:42:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32300.152659 secs 2023-05-08T12:42:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:40 smithi133 ceph-mon[125939]: pgmap v17281: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 583 KiB/s rd, 424 KiB/s wr, 11 op/s 2023-05-08T12:42:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32300.152659 secs 2023-05-08T12:42:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:40 smithi096 ceph-mon[124666]: pgmap v17281: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 583 KiB/s rd, 424 KiB/s wr, 11 op/s 2023-05-08T12:42:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32300.152659 secs 2023-05-08T12:42:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:42 smithi186 ceph-mon[126480]: pgmap v17282: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 397 KiB/s wr, 8 op/s 2023-05-08T12:42:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:42 smithi133 ceph-mon[125939]: pgmap v17282: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 397 KiB/s wr, 8 op/s 2023-05-08T12:42:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:42 smithi096 ceph-mon[124666]: pgmap v17282: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 397 KiB/s wr, 8 op/s 2023-05-08T12:42:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32303.306873 secs 2023-05-08T12:42:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:44 smithi096 ceph-mon[124666]: pgmap v17283: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 55 KiB/s wr, 7 op/s 2023-05-08T12:42:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32303.862593 secs 2023-05-08T12:42:45.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32303.306873 secs 2023-05-08T12:42:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:44 smithi186 ceph-mon[126480]: pgmap v17283: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 55 KiB/s wr, 7 op/s 2023-05-08T12:42:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32303.862593 secs 2023-05-08T12:42:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32303.306873 secs 2023-05-08T12:42:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:44 smithi133 ceph-mon[125939]: pgmap v17283: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 55 KiB/s wr, 7 op/s 2023-05-08T12:42:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32303.862593 secs 2023-05-08T12:42:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32305.152782 secs 2023-05-08T12:42:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32305.152782 secs 2023-05-08T12:42:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32305.152782 secs 2023-05-08T12:42:47.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:46 smithi186 ceph-mon[126480]: pgmap v17284: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 580 KiB/s rd, 361 KiB/s wr, 10 op/s 2023-05-08T12:42:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:46 smithi133 ceph-mon[125939]: pgmap v17284: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 580 KiB/s rd, 361 KiB/s wr, 10 op/s 2023-05-08T12:42:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:46 smithi096 ceph-mon[124666]: pgmap v17284: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 580 KiB/s rd, 361 KiB/s wr, 10 op/s 2023-05-08T12:42:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:48 smithi186 ceph-mon[126480]: pgmap v17285: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 261 KiB/s rd, 306 KiB/s wr, 6 op/s 2023-05-08T12:42:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:48 smithi133 ceph-mon[125939]: pgmap v17285: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 261 KiB/s rd, 306 KiB/s wr, 6 op/s 2023-05-08T12:42:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:48 smithi096 ceph-mon[124666]: pgmap v17285: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 261 KiB/s rd, 306 KiB/s wr, 6 op/s 2023-05-08T12:42:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32308.307006 secs 2023-05-08T12:42:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32308.862718 secs 2023-05-08T12:42:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32308.307006 secs 2023-05-08T12:42:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32308.862718 secs 2023-05-08T12:42:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32308.307006 secs 2023-05-08T12:42:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32308.862718 secs 2023-05-08T12:42:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:50 smithi186 ceph-mon[126480]: pgmap v17286: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 485 KiB/s rd, 386 KiB/s wr, 10 op/s 2023-05-08T12:42:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32310.152873 secs 2023-05-08T12:42:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:50 smithi133 ceph-mon[125939]: pgmap v17286: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 485 KiB/s rd, 386 KiB/s wr, 10 op/s 2023-05-08T12:42:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32310.152873 secs 2023-05-08T12:42:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:50 smithi096 ceph-mon[124666]: pgmap v17286: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 485 KiB/s rd, 386 KiB/s wr, 10 op/s 2023-05-08T12:42:51.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32310.152873 secs 2023-05-08T12:42:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:52 smithi186 ceph-mon[126480]: pgmap v17287: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 483 KiB/s rd, 385 KiB/s wr, 6 op/s 2023-05-08T12:42:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:52 smithi133 ceph-mon[125939]: pgmap v17287: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 483 KiB/s rd, 385 KiB/s wr, 6 op/s 2023-05-08T12:42:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:52 smithi096 ceph-mon[124666]: pgmap v17287: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 483 KiB/s rd, 385 KiB/s wr, 6 op/s 2023-05-08T12:42:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32313.307122 secs 2023-05-08T12:42:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:54 smithi096 ceph-mon[124666]: pgmap v17288: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 483 KiB/s rd, 385 KiB/s wr, 6 op/s 2023-05-08T12:42:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32313.307122 secs 2023-05-08T12:42:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:54 smithi186 ceph-mon[126480]: pgmap v17288: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 483 KiB/s rd, 385 KiB/s wr, 6 op/s 2023-05-08T12:42:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32313.307122 secs 2023-05-08T12:42:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:54 smithi133 ceph-mon[125939]: pgmap v17288: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 483 KiB/s rd, 385 KiB/s wr, 6 op/s 2023-05-08T12:42:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32315.152970 secs 2023-05-08T12:42:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32315.152970 secs 2023-05-08T12:42:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32315.152970 secs 2023-05-08T12:42:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:56 smithi186 ceph-mon[126480]: pgmap v17289: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1016 KiB/s rd, 917 KiB/s wr, 11 op/s 2023-05-08T12:42:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:42:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:56 smithi133 ceph-mon[125939]: pgmap v17289: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1016 KiB/s rd, 917 KiB/s wr, 11 op/s 2023-05-08T12:42:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:42:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:56 smithi096 ceph-mon[124666]: pgmap v17289: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1016 KiB/s rd, 917 KiB/s wr, 11 op/s 2023-05-08T12:42:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:42:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:57 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:42:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:42:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:42:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:57 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:42:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:42:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:42:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:57 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:42:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:42:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:42:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:58 smithi186 ceph-mon[126480]: pgmap v17290: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 757 KiB/s rd, 611 KiB/s wr, 8 op/s 2023-05-08T12:42:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:58 smithi133 ceph-mon[125939]: pgmap v17290: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 757 KiB/s rd, 611 KiB/s wr, 8 op/s 2023-05-08T12:42:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:58 smithi096 ceph-mon[124666]: pgmap v17290: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 757 KiB/s rd, 611 KiB/s wr, 8 op/s 2023-05-08T12:43:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:42:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32318.307223 secs 2023-05-08T12:43:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:42:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32318.307223 secs 2023-05-08T12:43:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:42:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32318.307223 secs 2023-05-08T12:43:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:00 smithi186 ceph-mon[126480]: pgmap v17291: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1008 KiB/s rd, 1.0 MiB/s wr, 13 op/s 2023-05-08T12:43:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:00 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:43:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:00 smithi133 ceph-mon[125939]: pgmap v17291: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1008 KiB/s rd, 1.0 MiB/s wr, 13 op/s 2023-05-08T12:43:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:00 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:43:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:00 smithi096 ceph-mon[124666]: pgmap v17291: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1008 KiB/s rd, 1.0 MiB/s wr, 13 op/s 2023-05-08T12:43:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:00 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:43:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:43:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:43:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:01 smithi186 ceph-mon[126480]: pgmap v17292: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 784 KiB/s rd, 990 KiB/s wr, 9 op/s 2023-05-08T12:43:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:43:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:43:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:01 smithi133 ceph-mon[125939]: pgmap v17292: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 784 KiB/s rd, 990 KiB/s wr, 9 op/s 2023-05-08T12:43:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:43:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:43:02.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:01 smithi096 ceph-mon[124666]: pgmap v17292: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 784 KiB/s rd, 990 KiB/s wr, 9 op/s 2023-05-08T12:43:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32323.307375 secs 2023-05-08T12:43:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:04 smithi186 ceph-mon[126480]: pgmap v17293: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 784 KiB/s rd, 990 KiB/s wr, 9 op/s 2023-05-08T12:43:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32323.863043 secs 2023-05-08T12:43:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32323.307375 secs 2023-05-08T12:43:05.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:04 smithi133 ceph-mon[125939]: pgmap v17293: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 784 KiB/s rd, 990 KiB/s wr, 9 op/s 2023-05-08T12:43:05.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32323.863043 secs 2023-05-08T12:43:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32323.307375 secs 2023-05-08T12:43:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:04 smithi096 ceph-mon[124666]: pgmap v17293: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 784 KiB/s rd, 990 KiB/s wr, 9 op/s 2023-05-08T12:43:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32323.863043 secs 2023-05-08T12:43:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:05 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:43:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:43:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:43:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:05 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:43:06.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:43:06.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:43:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:05 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:43:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:43:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:43:07.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:06 smithi186 ceph-mon[126480]: pgmap v17294: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 26 op/s 2023-05-08T12:43:07.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:06 smithi133 ceph-mon[125939]: pgmap v17294: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 26 op/s 2023-05-08T12:43:07.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:06 smithi096 ceph-mon[124666]: pgmap v17294: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 26 op/s 2023-05-08T12:43:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:08 smithi186 ceph-mon[126480]: pgmap v17295: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1017 KiB/s rd, 831 KiB/s wr, 22 op/s 2023-05-08T12:43:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:08 smithi133 ceph-mon[125939]: pgmap v17295: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1017 KiB/s rd, 831 KiB/s wr, 22 op/s 2023-05-08T12:43:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:08 smithi096 ceph-mon[124666]: pgmap v17295: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1017 KiB/s rd, 831 KiB/s wr, 22 op/s 2023-05-08T12:43:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32328.307453 secs 2023-05-08T12:43:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32328.863097 secs 2023-05-08T12:43:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32328.307453 secs 2023-05-08T12:43:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32328.863097 secs 2023-05-08T12:43:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32328.307453 secs 2023-05-08T12:43:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32328.863097 secs 2023-05-08T12:43:11.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:10 smithi186 ceph-mon[126480]: pgmap v17296: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1021 KiB/s rd, 834 KiB/s wr, 26 op/s 2023-05-08T12:43:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:10 smithi133 ceph-mon[125939]: pgmap v17296: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1021 KiB/s rd, 834 KiB/s wr, 26 op/s 2023-05-08T12:43:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:10 smithi096 ceph-mon[124666]: pgmap v17296: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1021 KiB/s rd, 834 KiB/s wr, 26 op/s 2023-05-08T12:43:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:12 smithi186 ceph-mon[126480]: pgmap v17297: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 769 KiB/s rd, 376 KiB/s wr, 21 op/s 2023-05-08T12:43:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:12 smithi133 ceph-mon[125939]: pgmap v17297: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 769 KiB/s rd, 376 KiB/s wr, 21 op/s 2023-05-08T12:43:13.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:12 smithi096 ceph-mon[124666]: pgmap v17297: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 769 KiB/s rd, 376 KiB/s wr, 21 op/s 2023-05-08T12:43:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32333.307555 secs 2023-05-08T12:43:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:14 smithi186 ceph-mon[126480]: pgmap v17298: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 769 KiB/s rd, 376 KiB/s wr, 21 op/s 2023-05-08T12:43:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32333.863237 secs 2023-05-08T12:43:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32333.307555 secs 2023-05-08T12:43:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:14 smithi133 ceph-mon[125939]: pgmap v17298: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 769 KiB/s rd, 376 KiB/s wr, 21 op/s 2023-05-08T12:43:15.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32333.863237 secs 2023-05-08T12:43:15.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32333.307555 secs 2023-05-08T12:43:15.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:14 smithi096 ceph-mon[124666]: pgmap v17298: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 769 KiB/s rd, 376 KiB/s wr, 21 op/s 2023-05-08T12:43:15.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32333.863237 secs 2023-05-08T12:43:17.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:16 smithi186 ceph-mon[126480]: pgmap v17299: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 775 KiB/s wr, 25 op/s 2023-05-08T12:43:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:16 smithi133 ceph-mon[125939]: pgmap v17299: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 775 KiB/s wr, 25 op/s 2023-05-08T12:43:17.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:16 smithi096 ceph-mon[124666]: pgmap v17299: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 775 KiB/s wr, 25 op/s 2023-05-08T12:43:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:18 smithi186 ceph-mon[126480]: pgmap v17300: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 403 KiB/s wr, 7 op/s 2023-05-08T12:43:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:18 smithi133 ceph-mon[125939]: pgmap v17300: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 403 KiB/s wr, 7 op/s 2023-05-08T12:43:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:18 smithi096 ceph-mon[124666]: pgmap v17300: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 403 KiB/s wr, 7 op/s 2023-05-08T12:43:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32338.307670 secs 2023-05-08T12:43:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32338.863395 secs 2023-05-08T12:43:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32338.307670 secs 2023-05-08T12:43:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32338.863395 secs 2023-05-08T12:43:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32338.307670 secs 2023-05-08T12:43:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32338.863395 secs 2023-05-08T12:43:21.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:20 smithi186 ceph-mon[126480]: pgmap v17301: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 403 KiB/s wr, 11 op/s 2023-05-08T12:43:21.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:20 smithi133 ceph-mon[125939]: pgmap v17301: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 403 KiB/s wr, 11 op/s 2023-05-08T12:43:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:20 smithi096 ceph-mon[124666]: pgmap v17301: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 403 KiB/s wr, 11 op/s 2023-05-08T12:43:22.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:22 smithi186 ceph-mon[126480]: pgmap v17302: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 400 KiB/s wr, 7 op/s 2023-05-08T12:43:22.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:22 smithi133 ceph-mon[125939]: pgmap v17302: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 400 KiB/s wr, 7 op/s 2023-05-08T12:43:23.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:22 smithi096 ceph-mon[124666]: pgmap v17302: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 400 KiB/s wr, 7 op/s 2023-05-08T12:43:25.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32343.307759 secs 2023-05-08T12:43:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:24 smithi186 ceph-mon[126480]: pgmap v17303: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 400 KiB/s wr, 7 op/s 2023-05-08T12:43:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:24 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:43:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32343.307759 secs 2023-05-08T12:43:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:24 smithi133 ceph-mon[125939]: pgmap v17303: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 400 KiB/s wr, 7 op/s 2023-05-08T12:43:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:24 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:43:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32343.307759 secs 2023-05-08T12:43:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:24 smithi096 ceph-mon[124666]: pgmap v17303: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 400 KiB/s wr, 7 op/s 2023-05-08T12:43:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:24 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:43:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:25 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:43:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:25 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:43:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:25 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:43:26.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:25 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:43:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:25 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:43:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:25 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:43:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:25 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:43:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:25 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:43:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:25 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:43:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:26 smithi186 ceph-mon[126480]: pgmap v17304: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 967 KiB/s rd, 986 KiB/s wr, 13 op/s 2023-05-08T12:43:27.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:26 smithi133 ceph-mon[125939]: pgmap v17304: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 967 KiB/s rd, 986 KiB/s wr, 13 op/s 2023-05-08T12:43:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:26 smithi096 ceph-mon[124666]: pgmap v17304: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 967 KiB/s rd, 986 KiB/s wr, 13 op/s 2023-05-08T12:43:28.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:27 smithi186 ceph-mon[126480]: pgmap v17305: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 691 KiB/s rd, 586 KiB/s wr, 10 op/s 2023-05-08T12:43:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:27 smithi133 ceph-mon[125939]: pgmap v17305: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 691 KiB/s rd, 586 KiB/s wr, 10 op/s 2023-05-08T12:43:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:27 smithi096 ceph-mon[124666]: pgmap v17305: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 691 KiB/s rd, 586 KiB/s wr, 10 op/s 2023-05-08T12:43:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32348.307858 secs 2023-05-08T12:43:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32348.307858 secs 2023-05-08T12:43:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32348.307858 secs 2023-05-08T12:43:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:30 smithi186 ceph-mon[126480]: pgmap v17306: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 695 KiB/s rd, 610 KiB/s wr, 14 op/s 2023-05-08T12:43:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:30 smithi133 ceph-mon[125939]: pgmap v17306: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 695 KiB/s rd, 610 KiB/s wr, 14 op/s 2023-05-08T12:43:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:30 smithi096 ceph-mon[124666]: pgmap v17306: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 695 KiB/s rd, 610 KiB/s wr, 14 op/s 2023-05-08T12:43:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:32 smithi186 ceph-mon[126480]: osdmap e1158: 12 total, 12 up, 12 in 2023-05-08T12:43:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:32 smithi186 ceph-mon[126480]: pgmap v17308: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 683 KiB/s rd, 732 KiB/s wr, 12 op/s 2023-05-08T12:43:32.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:32 smithi133 ceph-mon[125939]: osdmap e1158: 12 total, 12 up, 12 in 2023-05-08T12:43:32.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:32 smithi133 ceph-mon[125939]: pgmap v17308: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 683 KiB/s rd, 732 KiB/s wr, 12 op/s 2023-05-08T12:43:32.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:32 smithi096 ceph-mon[124666]: osdmap e1158: 12 total, 12 up, 12 in 2023-05-08T12:43:32.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:32 smithi096 ceph-mon[124666]: pgmap v17308: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 683 KiB/s rd, 732 KiB/s wr, 12 op/s 2023-05-08T12:43:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32353.307931 secs 2023-05-08T12:43:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:34 smithi186 ceph-mon[126480]: pgmap v17309: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 683 KiB/s rd, 732 KiB/s wr, 12 op/s 2023-05-08T12:43:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32353.307931 secs 2023-05-08T12:43:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:34 smithi133 ceph-mon[125939]: pgmap v17309: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 683 KiB/s rd, 732 KiB/s wr, 12 op/s 2023-05-08T12:43:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32353.307931 secs 2023-05-08T12:43:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:34 smithi096 ceph-mon[124666]: pgmap v17309: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 683 KiB/s rd, 732 KiB/s wr, 12 op/s 2023-05-08T12:43:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:36 smithi186 ceph-mon[126480]: pgmap v17310: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 335 KiB/s wr, 9 op/s 2023-05-08T12:43:37.127 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:36 smithi186 ceph-mon[126480]: osdmap e1159: 12 total, 12 up, 12 in 2023-05-08T12:43:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:36 smithi133 ceph-mon[125939]: pgmap v17310: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 335 KiB/s wr, 9 op/s 2023-05-08T12:43:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:36 smithi133 ceph-mon[125939]: osdmap e1159: 12 total, 12 up, 12 in 2023-05-08T12:43:37.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:36 smithi096 ceph-mon[124666]: pgmap v17310: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 335 KiB/s wr, 9 op/s 2023-05-08T12:43:37.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:36 smithi096 ceph-mon[124666]: osdmap e1159: 12 total, 12 up, 12 in 2023-05-08T12:43:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:37 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:43:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:37 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:43:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:37 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:43:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:38 smithi186 ceph-mon[126480]: pgmap v17312: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 382 KiB/s wr, 5 op/s 2023-05-08T12:43:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:43:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:43:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:38 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:43:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:43:39.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:38 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T12:43:39.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:38 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T12:43:39.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:38 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:43:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:38 smithi133 ceph-mon[125939]: pgmap v17312: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 382 KiB/s wr, 5 op/s 2023-05-08T12:43:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:43:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:43:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:38 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:43:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:43:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:38 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T12:43:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:38 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T12:43:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:38 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:43:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:38 smithi096 ceph-mon[124666]: pgmap v17312: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 382 KiB/s wr, 5 op/s 2023-05-08T12:43:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:43:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:43:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:38 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:43:39.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:43:39.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:38 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T12:43:39.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:38 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T12:43:39.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:38 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:43:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32358.308079 secs 2023-05-08T12:43:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:39 smithi186 ceph-mon[126480]: pgmap v17313: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 358 KiB/s wr, 11 op/s 2023-05-08T12:43:40.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32358.308079 secs 2023-05-08T12:43:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:39 smithi133 ceph-mon[125939]: pgmap v17313: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 358 KiB/s wr, 11 op/s 2023-05-08T12:43:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32358.308079 secs 2023-05-08T12:43:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:39 smithi096 ceph-mon[124666]: pgmap v17313: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 358 KiB/s wr, 11 op/s 2023-05-08T12:43:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32360.154089 secs 2023-05-08T12:43:41.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32360.154089 secs 2023-05-08T12:43:41.259 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32360.154089 secs 2023-05-08T12:43:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:41 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:43:42.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:41 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:43:42.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:41 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:43:42.123 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:41 smithi186 ceph-mon[126480]: pgmap v17314: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 309 KiB/s wr, 9 op/s 2023-05-08T12:43:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:41 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:43:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:41 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:43:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:41 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:43:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:41 smithi133 ceph-mon[125939]: pgmap v17314: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 309 KiB/s wr, 9 op/s 2023-05-08T12:43:42.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:41 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:43:42.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:41 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:43:42.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:41 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:43:42.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:41 smithi096 ceph-mon[124666]: pgmap v17314: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 309 KiB/s wr, 9 op/s 2023-05-08T12:43:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32363.308213 secs 2023-05-08T12:43:45.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:44 smithi186 ceph-mon[126480]: pgmap v17315: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 309 KiB/s wr, 9 op/s 2023-05-08T12:43:45.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32363.863962 secs 2023-05-08T12:43:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32363.308213 secs 2023-05-08T12:43:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:44 smithi133 ceph-mon[125939]: pgmap v17315: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 309 KiB/s wr, 9 op/s 2023-05-08T12:43:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32363.863962 secs 2023-05-08T12:43:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32363.308213 secs 2023-05-08T12:43:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:44 smithi096 ceph-mon[124666]: pgmap v17315: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 309 KiB/s wr, 9 op/s 2023-05-08T12:43:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32363.863962 secs 2023-05-08T12:43:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:45 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:43:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:45 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:43:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32365.154227 secs 2023-05-08T12:43:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:45 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:43:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:45 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:43:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32365.154227 secs 2023-05-08T12:43:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:45 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:43:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:45 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:43:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32365.154227 secs 2023-05-08T12:43:47.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:46 smithi186 ceph-mon[126480]: pgmap v17316: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T12:43:47.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:46 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:43:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:46 smithi133 ceph-mon[125939]: pgmap v17316: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T12:43:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:46 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:43:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:46 smithi096 ceph-mon[124666]: pgmap v17316: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T12:43:47.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:46 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:43:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:47 smithi186 ceph-mon[126480]: pgmap v17317: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 957 KiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T12:43:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:47 smithi133 ceph-mon[125939]: pgmap v17317: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 957 KiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T12:43:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:47 smithi096 ceph-mon[124666]: pgmap v17317: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 957 KiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T12:43:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32368.308365 secs 2023-05-08T12:43:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32368.308365 secs 2023-05-08T12:43:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32368.308365 secs 2023-05-08T12:43:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:50 smithi186 ceph-mon[126480]: pgmap v17318: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 16 op/s 2023-05-08T12:43:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:50 smithi133 ceph-mon[125939]: pgmap v17318: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 16 op/s 2023-05-08T12:43:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:50 smithi096 ceph-mon[124666]: pgmap v17318: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 16 op/s 2023-05-08T12:43:51.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32370.154321 secs 2023-05-08T12:43:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32370.154321 secs 2023-05-08T12:43:51.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32370.154321 secs 2023-05-08T12:43:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:52 smithi186 ceph-mon[126480]: pgmap v17319: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 12 op/s 2023-05-08T12:43:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:52 smithi133 ceph-mon[125939]: pgmap v17319: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 12 op/s 2023-05-08T12:43:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:52 smithi096 ceph-mon[124666]: pgmap v17319: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 12 op/s 2023-05-08T12:43:53.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:53 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:43:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:53 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:43:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:53 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:43:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:54 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:43:54.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32373.308434 secs 2023-05-08T12:43:54.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:54 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:43:54.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:54 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:43:54.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:54 smithi186 ceph-mon[126480]: pgmap v17320: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 12 op/s 2023-05-08T12:43:54.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32373.864210 secs 2023-05-08T12:43:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:54 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:43:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32373.308434 secs 2023-05-08T12:43:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:54 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:43:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:54 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:43:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:54 smithi133 ceph-mon[125939]: pgmap v17320: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 12 op/s 2023-05-08T12:43:54.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32373.864210 secs 2023-05-08T12:43:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:54 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:43:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32373.308434 secs 2023-05-08T12:43:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:54 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:43:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:54 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:43:55.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:54 smithi096 ceph-mon[124666]: pgmap v17320: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 12 op/s 2023-05-08T12:43:55.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32373.864210 secs 2023-05-08T12:43:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32375.154441 secs 2023-05-08T12:43:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:55 smithi186 ceph-mon[126480]: pgmap v17321: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 18 op/s 2023-05-08T12:43:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32375.154441 secs 2023-05-08T12:43:56.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:55 smithi133 ceph-mon[125939]: pgmap v17321: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 18 op/s 2023-05-08T12:43:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32375.154441 secs 2023-05-08T12:43:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:55 smithi096 ceph-mon[124666]: pgmap v17321: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 18 op/s 2023-05-08T12:43:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:43:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:43:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:58 smithi186 ceph-mon[126480]: pgmap v17322: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T12:43:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:43:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:43:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:58 smithi133 ceph-mon[125939]: pgmap v17322: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T12:43:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:43:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:43:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:58 smithi096 ceph-mon[124666]: pgmap v17322: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T12:43:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:43:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32378.308501 secs 2023-05-08T12:43:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:43:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32378.308501 secs 2023-05-08T12:44:00.012 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:43:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32378.308501 secs 2023-05-08T12:44:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:00 smithi186 ceph-mon[126480]: pgmap v17323: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 17 op/s 2023-05-08T12:44:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:00 smithi133 ceph-mon[125939]: pgmap v17323: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 17 op/s 2023-05-08T12:44:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:00 smithi096 ceph-mon[124666]: pgmap v17323: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 17 op/s 2023-05-08T12:44:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32380.154599 secs 2023-05-08T12:44:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:01 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:44:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:01 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:44:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32380.154599 secs 2023-05-08T12:44:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:01 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:44:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:01 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:44:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32380.154599 secs 2023-05-08T12:44:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:01 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:44:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:01 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:44:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:44:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:44:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:02 smithi186 ceph-mon[126480]: pgmap v17324: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T12:44:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:44:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:44:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:02 smithi133 ceph-mon[125939]: pgmap v17324: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T12:44:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:44:03.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:44:03.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:02 smithi096 ceph-mon[124666]: pgmap v17324: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T12:44:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32383.308655 secs 2023-05-08T12:44:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:04 smithi186 ceph-mon[126480]: pgmap v17325: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T12:44:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32383.864475 secs 2023-05-08T12:44:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32383.308655 secs 2023-05-08T12:44:05.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:04 smithi133 ceph-mon[125939]: pgmap v17325: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T12:44:05.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32383.864475 secs 2023-05-08T12:44:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32383.308655 secs 2023-05-08T12:44:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:04 smithi096 ceph-mon[124666]: pgmap v17325: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T12:44:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32383.864475 secs 2023-05-08T12:44:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:44:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:44:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32385.154739 secs 2023-05-08T12:44:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:44:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:44:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32385.154739 secs 2023-05-08T12:44:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:44:06.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:44:06.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32385.154739 secs 2023-05-08T12:44:07.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:06 smithi186 ceph-mon[126480]: pgmap v17326: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.7 MiB/s wr, 31 op/s 2023-05-08T12:44:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:06 smithi186 ceph-mon[126480]: osdmap e1160: 12 total, 12 up, 12 in 2023-05-08T12:44:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:06 smithi133 ceph-mon[125939]: pgmap v17326: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.7 MiB/s wr, 31 op/s 2023-05-08T12:44:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:06 smithi133 ceph-mon[125939]: osdmap e1160: 12 total, 12 up, 12 in 2023-05-08T12:44:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:06 smithi096 ceph-mon[124666]: pgmap v17326: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.7 MiB/s wr, 31 op/s 2023-05-08T12:44:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:06 smithi096 ceph-mon[124666]: osdmap e1160: 12 total, 12 up, 12 in 2023-05-08T12:44:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:07 smithi186 ceph-mon[126480]: pgmap v17328: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 30 op/s 2023-05-08T12:44:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:07 smithi133 ceph-mon[125939]: pgmap v17328: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 30 op/s 2023-05-08T12:44:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:07 smithi096 ceph-mon[124666]: pgmap v17328: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 30 op/s 2023-05-08T12:44:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32388.308751 secs 2023-05-08T12:44:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32388.308751 secs 2023-05-08T12:44:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32388.308751 secs 2023-05-08T12:44:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32388.864538 secs 2023-05-08T12:44:10.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:10 smithi186 ceph-mon[126480]: pgmap v17329: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 887 KiB/s wr, 29 op/s 2023-05-08T12:44:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32388.864538 secs 2023-05-08T12:44:10.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:10 smithi133 ceph-mon[125939]: pgmap v17329: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 887 KiB/s wr, 29 op/s 2023-05-08T12:44:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32388.864538 secs 2023-05-08T12:44:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:10 smithi096 ceph-mon[124666]: pgmap v17329: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 887 KiB/s wr, 29 op/s 2023-05-08T12:44:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32390.154869 secs 2023-05-08T12:44:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32390.154869 secs 2023-05-08T12:44:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32390.154869 secs 2023-05-08T12:44:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:12 smithi186 ceph-mon[126480]: pgmap v17330: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 887 KiB/s wr, 29 op/s 2023-05-08T12:44:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:12 smithi133 ceph-mon[125939]: pgmap v17330: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 887 KiB/s wr, 29 op/s 2023-05-08T12:44:13.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:12 smithi096 ceph-mon[124666]: pgmap v17330: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 887 KiB/s wr, 29 op/s 2023-05-08T12:44:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32393.308869 secs 2023-05-08T12:44:15.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:14 smithi186 ceph-mon[126480]: pgmap v17331: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 887 KiB/s wr, 29 op/s 2023-05-08T12:44:15.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32393.864655 secs 2023-05-08T12:44:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32393.308869 secs 2023-05-08T12:44:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:14 smithi133 ceph-mon[125939]: pgmap v17331: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 887 KiB/s wr, 29 op/s 2023-05-08T12:44:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32393.864655 secs 2023-05-08T12:44:15.259 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32393.308869 secs 2023-05-08T12:44:15.259 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:14 smithi096 ceph-mon[124666]: pgmap v17331: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 887 KiB/s wr, 29 op/s 2023-05-08T12:44:15.259 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32393.864655 secs 2023-05-08T12:44:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32395.154983 secs 2023-05-08T12:44:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32395.154983 secs 2023-05-08T12:44:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32395.154983 secs 2023-05-08T12:44:17.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:16 smithi186 ceph-mon[126480]: pgmap v17332: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 635 KiB/s rd, 482 KiB/s wr, 10 op/s 2023-05-08T12:44:17.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:16 smithi186 ceph-mon[126480]: osdmap e1161: 12 total, 12 up, 12 in 2023-05-08T12:44:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:16 smithi133 ceph-mon[125939]: pgmap v17332: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 635 KiB/s rd, 482 KiB/s wr, 10 op/s 2023-05-08T12:44:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:16 smithi133 ceph-mon[125939]: osdmap e1161: 12 total, 12 up, 12 in 2023-05-08T12:44:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:16 smithi096 ceph-mon[124666]: pgmap v17332: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 635 KiB/s rd, 482 KiB/s wr, 10 op/s 2023-05-08T12:44:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:16 smithi096 ceph-mon[124666]: osdmap e1161: 12 total, 12 up, 12 in 2023-05-08T12:44:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:18 smithi186 ceph-mon[126480]: pgmap v17334: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 635 KiB/s rd, 482 KiB/s wr, 10 op/s 2023-05-08T12:44:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:18 smithi133 ceph-mon[125939]: pgmap v17334: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 635 KiB/s rd, 482 KiB/s wr, 10 op/s 2023-05-08T12:44:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:18 smithi096 ceph-mon[124666]: pgmap v17334: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 635 KiB/s rd, 482 KiB/s wr, 10 op/s 2023-05-08T12:44:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32398.308974 secs 2023-05-08T12:44:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32398.864770 secs 2023-05-08T12:44:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32398.308974 secs 2023-05-08T12:44:20.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32398.864770 secs 2023-05-08T12:44:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32398.308974 secs 2023-05-08T12:44:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32398.864770 secs 2023-05-08T12:44:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:20 smithi186 ceph-mon[126480]: pgmap v17335: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 482 KiB/s wr, 10 op/s 2023-05-08T12:44:21.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32400.155116 secs 2023-05-08T12:44:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:20 smithi133 ceph-mon[125939]: pgmap v17335: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 482 KiB/s wr, 10 op/s 2023-05-08T12:44:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32400.155116 secs 2023-05-08T12:44:21.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:20 smithi096 ceph-mon[124666]: pgmap v17335: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 482 KiB/s wr, 10 op/s 2023-05-08T12:44:21.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32400.155116 secs 2023-05-08T12:44:22.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:22 smithi186 ceph-mon[126480]: pgmap v17336: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 482 KiB/s wr, 10 op/s 2023-05-08T12:44:22.997 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:22 smithi133 ceph-mon[125939]: pgmap v17336: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 482 KiB/s wr, 10 op/s 2023-05-08T12:44:23.014 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:22 smithi096 ceph-mon[124666]: pgmap v17336: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 482 KiB/s wr, 10 op/s 2023-05-08T12:44:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32403.309108 secs 2023-05-08T12:44:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:24 smithi186 ceph-mon[126480]: pgmap v17337: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 482 KiB/s wr, 10 op/s 2023-05-08T12:44:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32403.864900 secs 2023-05-08T12:44:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32403.309108 secs 2023-05-08T12:44:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:24 smithi133 ceph-mon[125939]: pgmap v17337: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 482 KiB/s wr, 10 op/s 2023-05-08T12:44:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32403.864900 secs 2023-05-08T12:44:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32403.309108 secs 2023-05-08T12:44:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:24 smithi096 ceph-mon[124666]: pgmap v17337: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 482 KiB/s wr, 10 op/s 2023-05-08T12:44:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32403.864900 secs 2023-05-08T12:44:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32405.155249 secs 2023-05-08T12:44:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32405.155249 secs 2023-05-08T12:44:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32405.155249 secs 2023-05-08T12:44:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:26 smithi186 ceph-mon[126480]: pgmap v17338: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 374 KiB/s wr, 11 op/s 2023-05-08T12:44:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:26 smithi133 ceph-mon[125939]: pgmap v17338: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 374 KiB/s wr, 11 op/s 2023-05-08T12:44:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:26 smithi096 ceph-mon[124666]: pgmap v17338: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 374 KiB/s wr, 11 op/s 2023-05-08T12:44:28.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:27 smithi186 ceph-mon[126480]: pgmap v17339: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 335 KiB/s wr, 10 op/s 2023-05-08T12:44:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:27 smithi133 ceph-mon[125939]: pgmap v17339: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 335 KiB/s wr, 10 op/s 2023-05-08T12:44:28.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:27 smithi096 ceph-mon[124666]: pgmap v17339: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 335 KiB/s wr, 10 op/s 2023-05-08T12:44:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32408.309226 secs 2023-05-08T12:44:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32408.309226 secs 2023-05-08T12:44:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32408.309226 secs 2023-05-08T12:44:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32408.864973 secs 2023-05-08T12:44:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:30 smithi186 ceph-mon[126480]: pgmap v17340: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 572 KiB/s wr, 12 op/s 2023-05-08T12:44:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32408.864973 secs 2023-05-08T12:44:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:30 smithi133 ceph-mon[125939]: pgmap v17340: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 572 KiB/s wr, 12 op/s 2023-05-08T12:44:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32408.864973 secs 2023-05-08T12:44:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:30 smithi096 ceph-mon[124666]: pgmap v17340: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 572 KiB/s wr, 12 op/s 2023-05-08T12:44:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32410.155408 secs 2023-05-08T12:44:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32410.155408 secs 2023-05-08T12:44:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32410.155408 secs 2023-05-08T12:44:32.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:32 smithi186 ceph-mon[126480]: pgmap v17341: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 292 KiB/s rd, 293 KiB/s wr, 8 op/s 2023-05-08T12:44:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:32 smithi133 ceph-mon[125939]: pgmap v17341: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 292 KiB/s rd, 293 KiB/s wr, 8 op/s 2023-05-08T12:44:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:32 smithi096 ceph-mon[124666]: pgmap v17341: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 292 KiB/s rd, 293 KiB/s wr, 8 op/s 2023-05-08T12:44:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32413.309360 secs 2023-05-08T12:44:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:34 smithi186 ceph-mon[126480]: pgmap v17342: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 292 KiB/s rd, 293 KiB/s wr, 8 op/s 2023-05-08T12:44:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32413.865093 secs 2023-05-08T12:44:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32413.309360 secs 2023-05-08T12:44:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:34 smithi133 ceph-mon[125939]: pgmap v17342: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 292 KiB/s rd, 293 KiB/s wr, 8 op/s 2023-05-08T12:44:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32413.865093 secs 2023-05-08T12:44:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32413.309360 secs 2023-05-08T12:44:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:34 smithi096 ceph-mon[124666]: pgmap v17342: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 292 KiB/s rd, 293 KiB/s wr, 8 op/s 2023-05-08T12:44:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32413.865093 secs 2023-05-08T12:44:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32415.155552 secs 2023-05-08T12:44:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32415.155552 secs 2023-05-08T12:44:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32415.155552 secs 2023-05-08T12:44:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:36 smithi186 ceph-mon[126480]: pgmap v17343: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 553 KiB/s rd, 294 KiB/s wr, 12 op/s 2023-05-08T12:44:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:36 smithi133 ceph-mon[125939]: pgmap v17343: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 553 KiB/s rd, 294 KiB/s wr, 12 op/s 2023-05-08T12:44:37.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:36 smithi096 ceph-mon[124666]: pgmap v17343: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 553 KiB/s rd, 294 KiB/s wr, 12 op/s 2023-05-08T12:44:38.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:37 smithi186 ceph-mon[126480]: pgmap v17344: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 261 KiB/s wr, 7 op/s 2023-05-08T12:44:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:37 smithi133 ceph-mon[125939]: pgmap v17344: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 261 KiB/s wr, 7 op/s 2023-05-08T12:44:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:37 smithi096 ceph-mon[124666]: pgmap v17344: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 261 KiB/s wr, 7 op/s 2023-05-08T12:44:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:44:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:44:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:44:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32418.309430 secs 2023-05-08T12:44:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32418.865209 secs 2023-05-08T12:44:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:39 smithi186 ceph-mon[126480]: pgmap v17345: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 261 KiB/s wr, 10 op/s 2023-05-08T12:44:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32418.309430 secs 2023-05-08T12:44:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32418.865209 secs 2023-05-08T12:44:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:39 smithi133 ceph-mon[125939]: pgmap v17345: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 261 KiB/s wr, 10 op/s 2023-05-08T12:44:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32418.309430 secs 2023-05-08T12:44:40.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32418.865209 secs 2023-05-08T12:44:40.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:39 smithi096 ceph-mon[124666]: pgmap v17345: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 261 KiB/s wr, 10 op/s 2023-05-08T12:44:41.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32420.155672 secs 2023-05-08T12:44:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32420.155672 secs 2023-05-08T12:44:41.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32420.155672 secs 2023-05-08T12:44:42.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:44:42.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:44:42.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:44:42.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:44:42.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:44:42.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:44:42.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:42 smithi133 ceph-mon[125939]: pgmap v17346: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T12:44:42.494 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:44:42.494 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:44:42.494 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:44:42.495 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:44:42.495 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:44:42.495 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:44:42.495 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:44:42.495 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:44:42.495 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:44:42.496 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:44:42.496 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:44:42.496 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:44:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:44:42.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:44:42.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:44:42.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:44:42.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:44:42.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:44:42.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:42 smithi096 ceph-mon[124666]: pgmap v17346: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T12:44:42.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:44:42.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:44:42.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:44:42.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:44:42.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:44:42.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:44:42.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:44:42.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:44:42.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:44:42.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:44:42.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:44:42.509 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:44:42.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:44:42.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:44:42.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:44:42.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:44:42.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:44:42.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:44:42.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:42 smithi186 ceph-mon[126480]: pgmap v17346: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T12:44:42.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:44:42.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:44:42.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:44:42.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:44:42.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:44:42.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:44:42.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:44:42.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:44:42.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:44:42.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:44:42.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:44:42.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:44:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:43 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi186 to 125.0M 2023-05-08T12:44:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:43 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi186 to 131144568: error parsing value: Value '131144568' is below minimum 939524096 2023-05-08T12:44:43.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:43 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi133 to 135.0M 2023-05-08T12:44:43.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:43 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi133 to 141596348: error parsing value: Value '141596348' is below minimum 939524096 2023-05-08T12:44:43.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:43 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:44:43.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:43 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T12:44:43.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:43 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T12:44:43.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:43 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:44:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:43 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi186 to 125.0M 2023-05-08T12:44:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:43 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi186 to 131144568: error parsing value: Value '131144568' is below minimum 939524096 2023-05-08T12:44:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:43 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi133 to 135.0M 2023-05-08T12:44:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:43 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi133 to 141596348: error parsing value: Value '141596348' is below minimum 939524096 2023-05-08T12:44:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:43 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:44:43.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:43 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T12:44:43.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:43 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T12:44:43.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:43 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:44:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:43 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi186 to 125.0M 2023-05-08T12:44:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:43 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi186 to 131144568: error parsing value: Value '131144568' is below minimum 939524096 2023-05-08T12:44:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:43 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi133 to 135.0M 2023-05-08T12:44:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:43 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi133 to 141596348: error parsing value: Value '141596348' is below minimum 939524096 2023-05-08T12:44:44.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:43 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:44:44.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:43 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T12:44:44.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:43 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T12:44:44.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:43 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:44:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32423.309548 secs 2023-05-08T12:44:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:44 smithi186 ceph-mon[126480]: pgmap v17347: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T12:44:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32423.865292 secs 2023-05-08T12:44:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32423.309548 secs 2023-05-08T12:44:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:44 smithi133 ceph-mon[125939]: pgmap v17347: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T12:44:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32423.865292 secs 2023-05-08T12:44:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32423.309548 secs 2023-05-08T12:44:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:44 smithi096 ceph-mon[124666]: pgmap v17347: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 938 B/s wr, 6 op/s 2023-05-08T12:44:45.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32423.865292 secs 2023-05-08T12:44:47.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:46 smithi186 ceph-mon[126480]: pgmap v17348: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 129 KiB/s wr, 10 op/s 2023-05-08T12:44:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:46 smithi133 ceph-mon[125939]: pgmap v17348: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 129 KiB/s wr, 10 op/s 2023-05-08T12:44:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:46 smithi096 ceph-mon[124666]: pgmap v17348: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 129 KiB/s wr, 10 op/s 2023-05-08T12:44:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:47 smithi186 ceph-mon[126480]: pgmap v17349: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 129 KiB/s wr, 7 op/s 2023-05-08T12:44:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:47 smithi133 ceph-mon[125939]: pgmap v17349: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 129 KiB/s wr, 7 op/s 2023-05-08T12:44:48.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:47 smithi096 ceph-mon[124666]: pgmap v17349: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 129 KiB/s wr, 7 op/s 2023-05-08T12:44:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:44:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:44:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:44:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32428.309661 secs 2023-05-08T12:44:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:44:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:44:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:44:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32428.865413 secs 2023-05-08T12:44:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:49 smithi186 ceph-mon[126480]: pgmap v17350: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 422 KiB/s rd, 396 KiB/s wr, 10 op/s 2023-05-08T12:44:50.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32428.309661 secs 2023-05-08T12:44:50.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:44:50.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:44:50.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:44:50.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32428.865413 secs 2023-05-08T12:44:50.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:49 smithi133 ceph-mon[125939]: pgmap v17350: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 422 KiB/s rd, 396 KiB/s wr, 10 op/s 2023-05-08T12:44:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32428.309661 secs 2023-05-08T12:44:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:44:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:44:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:44:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32428.865413 secs 2023-05-08T12:44:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:49 smithi096 ceph-mon[124666]: pgmap v17350: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 422 KiB/s rd, 396 KiB/s wr, 10 op/s 2023-05-08T12:44:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32430.155943 secs 2023-05-08T12:44:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32430.155943 secs 2023-05-08T12:44:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32430.155943 secs 2023-05-08T12:44:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:52 smithi186 ceph-mon[126480]: pgmap v17351: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 420 KiB/s rd, 396 KiB/s wr, 7 op/s 2023-05-08T12:44:52.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:52 smithi133 ceph-mon[125939]: pgmap v17351: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 420 KiB/s rd, 396 KiB/s wr, 7 op/s 2023-05-08T12:44:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:52 smithi096 ceph-mon[124666]: pgmap v17351: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 420 KiB/s rd, 396 KiB/s wr, 7 op/s 2023-05-08T12:44:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:44:53.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:44:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:44:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:44:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:44:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:44:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32433.309777 secs 2023-05-08T12:44:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:54 smithi186 ceph-mon[126480]: pgmap v17352: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 420 KiB/s rd, 396 KiB/s wr, 7 op/s 2023-05-08T12:44:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32433.309777 secs 2023-05-08T12:44:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:54 smithi133 ceph-mon[125939]: pgmap v17352: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 420 KiB/s rd, 396 KiB/s wr, 7 op/s 2023-05-08T12:44:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32433.309777 secs 2023-05-08T12:44:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:54 smithi096 ceph-mon[124666]: pgmap v17352: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 420 KiB/s rd, 396 KiB/s wr, 7 op/s 2023-05-08T12:44:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32435.156096 secs 2023-05-08T12:44:56.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:55 smithi186 ceph-mon[126480]: pgmap v17353: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 966 KiB/s rd, 926 KiB/s wr, 12 op/s 2023-05-08T12:44:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32435.156096 secs 2023-05-08T12:44:56.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:55 smithi133 ceph-mon[125939]: pgmap v17353: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 966 KiB/s rd, 926 KiB/s wr, 12 op/s 2023-05-08T12:44:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32435.156096 secs 2023-05-08T12:44:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:55 smithi096 ceph-mon[124666]: pgmap v17353: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 966 KiB/s rd, 926 KiB/s wr, 12 op/s 2023-05-08T12:44:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:56 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:44:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:44:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:56 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:44:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:44:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:56 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:44:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:44:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:44:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:44:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:58 smithi186 ceph-mon[126480]: pgmap v17354: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 837 KiB/s rd, 798 KiB/s wr, 8 op/s 2023-05-08T12:44:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:44:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:44:58.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:58 smithi133 ceph-mon[125939]: pgmap v17354: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 837 KiB/s rd, 798 KiB/s wr, 8 op/s 2023-05-08T12:44:59.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:44:59.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:44:59.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:58 smithi096 ceph-mon[124666]: pgmap v17354: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 837 KiB/s rd, 798 KiB/s wr, 8 op/s 2023-05-08T12:44:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:44:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32438.309872 secs 2023-05-08T12:44:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:44:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32438.309872 secs 2023-05-08T12:45:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:44:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32438.309872 secs 2023-05-08T12:45:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:00 smithi186 ceph-mon[126480]: pgmap v17355: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T12:45:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:00 smithi133 ceph-mon[125939]: pgmap v17355: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T12:45:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:00 smithi096 ceph-mon[124666]: pgmap v17355: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T12:45:01.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32440.156225 secs 2023-05-08T12:45:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:01 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:45:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32440.156225 secs 2023-05-08T12:45:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:01 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:45:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32440.156225 secs 2023-05-08T12:45:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:01 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:45:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:02 smithi186 ceph-mon[126480]: pgmap v17356: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1022 KiB/s rd, 995 KiB/s wr, 10 op/s 2023-05-08T12:45:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:02 smithi133 ceph-mon[125939]: pgmap v17356: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1022 KiB/s rd, 995 KiB/s wr, 10 op/s 2023-05-08T12:45:03.011 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:02 smithi096 ceph-mon[124666]: pgmap v17356: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1022 KiB/s rd, 995 KiB/s wr, 10 op/s 2023-05-08T12:45:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:03 smithi186 ceph-mon[126480]: pgmap v17357: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1022 KiB/s rd, 995 KiB/s wr, 10 op/s 2023-05-08T12:45:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:03 smithi133 ceph-mon[125939]: pgmap v17357: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1022 KiB/s rd, 995 KiB/s wr, 10 op/s 2023-05-08T12:45:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:03 smithi096 ceph-mon[124666]: pgmap v17357: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1022 KiB/s rd, 995 KiB/s wr, 10 op/s 2023-05-08T12:45:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32443.310010 secs 2023-05-08T12:45:05.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32443.865732 secs 2023-05-08T12:45:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32443.310010 secs 2023-05-08T12:45:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32443.865732 secs 2023-05-08T12:45:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32443.310010 secs 2023-05-08T12:45:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32443.865732 secs 2023-05-08T12:45:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:45:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:45:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:05 smithi186 ceph-mon[126480]: pgmap v17358: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 27 op/s 2023-05-08T12:45:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:45:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:45:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:05 smithi133 ceph-mon[125939]: pgmap v17358: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 27 op/s 2023-05-08T12:45:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:45:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:45:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:05 smithi096 ceph-mon[124666]: pgmap v17358: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 27 op/s 2023-05-08T12:45:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:06 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:45:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:06 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:45:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:06 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:45:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:07 smithi186 ceph-mon[126480]: pgmap v17359: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 834 KiB/s rd, 835 KiB/s wr, 22 op/s 2023-05-08T12:45:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:07 smithi133 ceph-mon[125939]: pgmap v17359: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 834 KiB/s rd, 835 KiB/s wr, 22 op/s 2023-05-08T12:45:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:07 smithi096 ceph-mon[124666]: pgmap v17359: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 834 KiB/s rd, 835 KiB/s wr, 22 op/s 2023-05-08T12:45:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:08 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:45:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:08 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:45:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:08 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:45:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32448.310169 secs 2023-05-08T12:45:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:45:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:45:10.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32448.865833 secs 2023-05-08T12:45:10.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:09 smithi133 ceph-mon[125939]: pgmap v17360: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 838 KiB/s rd, 839 KiB/s wr, 26 op/s 2023-05-08T12:45:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32448.310169 secs 2023-05-08T12:45:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:45:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:45:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32448.865833 secs 2023-05-08T12:45:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:09 smithi096 ceph-mon[124666]: pgmap v17360: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 838 KiB/s rd, 839 KiB/s wr, 26 op/s 2023-05-08T12:45:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32448.310169 secs 2023-05-08T12:45:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:45:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:45:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32448.865833 secs 2023-05-08T12:45:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:09 smithi186 ceph-mon[126480]: pgmap v17360: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 838 KiB/s rd, 839 KiB/s wr, 26 op/s 2023-05-08T12:45:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:11 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:45:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:11 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:45:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:11 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:45:12.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:12 smithi133 ceph-mon[125939]: pgmap v17361: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 374 KiB/s wr, 21 op/s 2023-05-08T12:45:13.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:12 smithi096 ceph-mon[124666]: pgmap v17361: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 374 KiB/s wr, 21 op/s 2023-05-08T12:45:13.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:12 smithi186 ceph-mon[126480]: pgmap v17361: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 374 KiB/s wr, 21 op/s 2023-05-08T12:45:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:13 smithi186 ceph-mon[126480]: pgmap v17362: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 374 KiB/s wr, 21 op/s 2023-05-08T12:45:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:13 smithi133 ceph-mon[125939]: pgmap v17362: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 374 KiB/s wr, 21 op/s 2023-05-08T12:45:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:13 smithi096 ceph-mon[124666]: pgmap v17362: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 374 KiB/s wr, 21 op/s 2023-05-08T12:45:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32453.310305 secs 2023-05-08T12:45:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32453.865909 secs 2023-05-08T12:45:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32453.310305 secs 2023-05-08T12:45:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32453.865909 secs 2023-05-08T12:45:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32453.310305 secs 2023-05-08T12:45:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32453.865909 secs 2023-05-08T12:45:16.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:15 smithi186 ceph-mon[126480]: pgmap v17363: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 765 KiB/s rd, 777 KiB/s wr, 24 op/s 2023-05-08T12:45:16.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:15 smithi133 ceph-mon[125939]: pgmap v17363: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 765 KiB/s rd, 777 KiB/s wr, 24 op/s 2023-05-08T12:45:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:15 smithi096 ceph-mon[124666]: pgmap v17363: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 765 KiB/s rd, 777 KiB/s wr, 24 op/s 2023-05-08T12:45:18.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:17 smithi186 ceph-mon[126480]: pgmap v17364: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 408 KiB/s rd, 406 KiB/s wr, 7 op/s 2023-05-08T12:45:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:17 smithi133 ceph-mon[125939]: pgmap v17364: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 408 KiB/s rd, 406 KiB/s wr, 7 op/s 2023-05-08T12:45:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:17 smithi096 ceph-mon[124666]: pgmap v17364: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 408 KiB/s rd, 406 KiB/s wr, 7 op/s 2023-05-08T12:45:19.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32458.310439 secs 2023-05-08T12:45:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32458.310439 secs 2023-05-08T12:45:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32458.310439 secs 2023-05-08T12:45:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32458.865981 secs 2023-05-08T12:45:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:20 smithi186 ceph-mon[126480]: pgmap v17365: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 530 KiB/s wr, 11 op/s 2023-05-08T12:45:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32458.865981 secs 2023-05-08T12:45:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:20 smithi133 ceph-mon[125939]: pgmap v17365: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 530 KiB/s wr, 11 op/s 2023-05-08T12:45:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32458.865981 secs 2023-05-08T12:45:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:20 smithi096 ceph-mon[124666]: pgmap v17365: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 530 KiB/s wr, 11 op/s 2023-05-08T12:45:22.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:22 smithi186 ceph-mon[126480]: pgmap v17366: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 527 KiB/s wr, 7 op/s 2023-05-08T12:45:22.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:22 smithi133 ceph-mon[125939]: pgmap v17366: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 527 KiB/s wr, 7 op/s 2023-05-08T12:45:23.010 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:22 smithi096 ceph-mon[124666]: pgmap v17366: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 527 KiB/s wr, 7 op/s 2023-05-08T12:45:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:23 smithi186 ceph-mon[126480]: pgmap v17367: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 527 KiB/s wr, 7 op/s 2023-05-08T12:45:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:23 smithi133 ceph-mon[125939]: pgmap v17367: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 527 KiB/s wr, 7 op/s 2023-05-08T12:45:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:23 smithi096 ceph-mon[124666]: pgmap v17367: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 527 KiB/s wr, 7 op/s 2023-05-08T12:45:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32463.310563 secs 2023-05-08T12:45:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:24 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:45:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32463.310563 secs 2023-05-08T12:45:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:24 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:45:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32463.310563 secs 2023-05-08T12:45:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:24 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:45:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:25 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:45:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:25 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:45:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:25 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:45:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:25 smithi186 ceph-mon[126480]: pgmap v17368: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T12:45:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:25 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:45:26.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:25 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:45:26.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:25 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:45:26.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:25 smithi133 ceph-mon[125939]: pgmap v17368: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T12:45:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:25 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:45:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:25 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:45:26.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:25 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:45:26.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:25 smithi096 ceph-mon[124666]: pgmap v17368: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T12:45:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:27 smithi186 ceph-mon[126480]: pgmap v17369: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 721 KiB/s rd, 714 KiB/s wr, 10 op/s 2023-05-08T12:45:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:27 smithi133 ceph-mon[125939]: pgmap v17369: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 721 KiB/s rd, 714 KiB/s wr, 10 op/s 2023-05-08T12:45:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:27 smithi096 ceph-mon[124666]: pgmap v17369: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 721 KiB/s rd, 714 KiB/s wr, 10 op/s 2023-05-08T12:45:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32468.310704 secs 2023-05-08T12:45:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32468.310704 secs 2023-05-08T12:45:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32468.310704 secs 2023-05-08T12:45:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:30 smithi186 ceph-mon[126480]: pgmap v17370: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 747 KiB/s rd, 739 KiB/s wr, 15 op/s 2023-05-08T12:45:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:30 smithi133 ceph-mon[125939]: pgmap v17370: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 747 KiB/s rd, 739 KiB/s wr, 15 op/s 2023-05-08T12:45:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:30 smithi096 ceph-mon[124666]: pgmap v17370: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 747 KiB/s rd, 739 KiB/s wr, 15 op/s 2023-05-08T12:45:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:32 smithi186 ceph-mon[126480]: osdmap e1162: 12 total, 12 up, 12 in 2023-05-08T12:45:32.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:32 smithi186 ceph-mon[126480]: pgmap v17372: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 714 KiB/s rd, 737 KiB/s wr, 13 op/s 2023-05-08T12:45:32.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:32 smithi133 ceph-mon[125939]: osdmap e1162: 12 total, 12 up, 12 in 2023-05-08T12:45:32.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:32 smithi133 ceph-mon[125939]: pgmap v17372: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 714 KiB/s rd, 737 KiB/s wr, 13 op/s 2023-05-08T12:45:32.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:32 smithi096 ceph-mon[124666]: osdmap e1162: 12 total, 12 up, 12 in 2023-05-08T12:45:32.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:32 smithi096 ceph-mon[124666]: pgmap v17372: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 714 KiB/s rd, 737 KiB/s wr, 13 op/s 2023-05-08T12:45:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:33 smithi186 ceph-mon[126480]: pgmap v17373: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 714 KiB/s rd, 737 KiB/s wr, 13 op/s 2023-05-08T12:45:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:33 smithi133 ceph-mon[125939]: pgmap v17373: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 714 KiB/s rd, 737 KiB/s wr, 13 op/s 2023-05-08T12:45:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:33 smithi096 ceph-mon[124666]: pgmap v17373: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 714 KiB/s rd, 737 KiB/s wr, 13 op/s 2023-05-08T12:45:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32473.310832 secs 2023-05-08T12:45:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32473.310832 secs 2023-05-08T12:45:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32473.310832 secs 2023-05-08T12:45:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:35 smithi186 ceph-mon[126480]: pgmap v17374: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 337 KiB/s wr, 9 op/s 2023-05-08T12:45:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:35 smithi133 ceph-mon[125939]: pgmap v17374: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 337 KiB/s wr, 9 op/s 2023-05-08T12:45:36.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:35 smithi096 ceph-mon[124666]: pgmap v17374: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 337 KiB/s wr, 9 op/s 2023-05-08T12:45:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:37 smithi186 ceph-mon[126480]: osdmap e1163: 12 total, 12 up, 12 in 2023-05-08T12:45:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:37 smithi133 ceph-mon[125939]: osdmap e1163: 12 total, 12 up, 12 in 2023-05-08T12:45:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:37 smithi096 ceph-mon[124666]: osdmap e1163: 12 total, 12 up, 12 in 2023-05-08T12:45:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:38 smithi186 ceph-mon[126480]: pgmap v17376: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 386 KiB/s rd, 385 KiB/s wr, 5 op/s 2023-05-08T12:45:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:38 smithi133 ceph-mon[125939]: pgmap v17376: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 386 KiB/s rd, 385 KiB/s wr, 5 op/s 2023-05-08T12:45:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:38 smithi096 ceph-mon[124666]: pgmap v17376: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 386 KiB/s rd, 385 KiB/s wr, 5 op/s 2023-05-08T12:45:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32478.310960 secs 2023-05-08T12:45:39.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32478.310960 secs 2023-05-08T12:45:40.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32478.310960 secs 2023-05-08T12:45:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:40 smithi186 ceph-mon[126480]: pgmap v17377: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 525 KiB/s wr, 10 op/s 2023-05-08T12:45:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:40 smithi133 ceph-mon[125939]: pgmap v17377: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 525 KiB/s wr, 10 op/s 2023-05-08T12:45:41.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:40 smithi096 ceph-mon[124666]: pgmap v17377: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 525 KiB/s wr, 10 op/s 2023-05-08T12:45:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32480.157177 secs 2023-05-08T12:45:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:41 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:45:41.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:41 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:45:41.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:41 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:45:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32480.157177 secs 2023-05-08T12:45:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:41 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:45:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:41 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:45:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:41 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:45:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32480.157177 secs 2023-05-08T12:45:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:41 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:45:42.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:41 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:45:42.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:41 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:45:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:42 smithi186 ceph-mon[126480]: pgmap v17378: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 896 KiB/s rd, 455 KiB/s wr, 9 op/s 2023-05-08T12:45:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:45:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:42 smithi133 ceph-mon[125939]: pgmap v17378: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 896 KiB/s rd, 455 KiB/s wr, 9 op/s 2023-05-08T12:45:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:45:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:42 smithi096 ceph-mon[124666]: pgmap v17378: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 896 KiB/s rd, 455 KiB/s wr, 9 op/s 2023-05-08T12:45:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:45:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:43 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:45:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:43 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:45:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:43 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:45:43.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:43 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:45:43.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:43 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T12:45:43.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:43 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T12:45:43.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:43 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:45:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:43 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:45:43.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:43 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:45:43.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:43 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:45:43.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:43 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:45:43.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:43 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T12:45:43.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:43 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T12:45:43.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:43 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:45:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:43 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:45:44.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:43 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:45:44.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:43 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:45:44.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:43 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:45:44.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:43 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T12:45:44.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:43 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T12:45:44.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:43 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:45:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32483.311085 secs 2023-05-08T12:45:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:44 smithi186 ceph-mon[126480]: pgmap v17379: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 896 KiB/s rd, 455 KiB/s wr, 9 op/s 2023-05-08T12:45:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32483.866562 secs 2023-05-08T12:45:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32483.311085 secs 2023-05-08T12:45:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:44 smithi133 ceph-mon[125939]: pgmap v17379: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 896 KiB/s rd, 455 KiB/s wr, 9 op/s 2023-05-08T12:45:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32483.866562 secs 2023-05-08T12:45:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32483.311085 secs 2023-05-08T12:45:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:44 smithi096 ceph-mon[124666]: pgmap v17379: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 896 KiB/s rd, 455 KiB/s wr, 9 op/s 2023-05-08T12:45:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32483.866562 secs 2023-05-08T12:45:45.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:45 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:45:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:45 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:45:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:45 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:45:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:45 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:45:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:45 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:45:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:45 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:45:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:45 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:45:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:45 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:45:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:45 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:45:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:46 smithi133 ceph-mon[125939]: pgmap v17380: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1007 KiB/s wr, 11 op/s 2023-05-08T12:45:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:46 smithi096 ceph-mon[124666]: pgmap v17380: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1007 KiB/s wr, 11 op/s 2023-05-08T12:45:47.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:46 smithi186 ceph-mon[126480]: pgmap v17380: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1007 KiB/s wr, 11 op/s 2023-05-08T12:45:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:47 smithi186 ceph-mon[126480]: pgmap v17381: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 902 KiB/s wr, 10 op/s 2023-05-08T12:45:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:47 smithi133 ceph-mon[125939]: pgmap v17381: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 902 KiB/s wr, 10 op/s 2023-05-08T12:45:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:47 smithi096 ceph-mon[124666]: pgmap v17381: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 902 KiB/s wr, 10 op/s 2023-05-08T12:45:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:45:49.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:45:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:45:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32488.311226 secs 2023-05-08T12:45:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:45:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:45:50.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:49 smithi186 ceph-mon[126480]: pgmap v17382: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2023-05-08T12:45:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32488.311226 secs 2023-05-08T12:45:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:45:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:45:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:49 smithi133 ceph-mon[125939]: pgmap v17382: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2023-05-08T12:45:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32488.311226 secs 2023-05-08T12:45:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:45:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:45:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:49 smithi096 ceph-mon[124666]: pgmap v17382: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2023-05-08T12:45:51.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32490.157451 secs 2023-05-08T12:45:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32490.157451 secs 2023-05-08T12:45:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32490.157451 secs 2023-05-08T12:45:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:51 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:45:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:51 smithi133 ceph-mon[125939]: pgmap v17383: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 10 op/s 2023-05-08T12:45:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:51 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:45:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:51 smithi096 ceph-mon[124666]: pgmap v17383: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 10 op/s 2023-05-08T12:45:52.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:51 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:45:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:51 smithi186 ceph-mon[126480]: pgmap v17383: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 10 op/s 2023-05-08T12:45:53.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:53 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:45:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:45:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:45:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:45:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:53 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:45:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:45:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:45:53.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:45:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:53 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:45:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:45:54.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:45:54.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:45:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32493.311310 secs 2023-05-08T12:45:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:54 smithi186 ceph-mon[126480]: pgmap v17384: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 10 op/s 2023-05-08T12:45:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32493.311310 secs 2023-05-08T12:45:54.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:54 smithi133 ceph-mon[125939]: pgmap v17384: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 10 op/s 2023-05-08T12:45:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32493.311310 secs 2023-05-08T12:45:55.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:54 smithi096 ceph-mon[124666]: pgmap v17384: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 10 op/s 2023-05-08T12:45:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32495.157568 secs 2023-05-08T12:45:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:55 smithi186 ceph-mon[126480]: pgmap v17385: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.9 MiB/s wr, 16 op/s 2023-05-08T12:45:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32495.157568 secs 2023-05-08T12:45:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:55 smithi133 ceph-mon[125939]: pgmap v17385: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.9 MiB/s wr, 16 op/s 2023-05-08T12:45:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32495.157568 secs 2023-05-08T12:45:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:55 smithi096 ceph-mon[124666]: pgmap v17385: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.9 MiB/s wr, 16 op/s 2023-05-08T12:45:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:57 smithi186 ceph-mon[126480]: pgmap v17386: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T12:45:58.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:57 smithi133 ceph-mon[125939]: pgmap v17386: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T12:45:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:57 smithi096 ceph-mon[124666]: pgmap v17386: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T12:45:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:45:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32498.311439 secs 2023-05-08T12:45:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:45:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32498.311439 secs 2023-05-08T12:45:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:45:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32498.311439 secs 2023-05-08T12:46:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32498.866947 secs 2023-05-08T12:46:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:00 smithi186 ceph-mon[126480]: pgmap v17387: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 16 op/s 2023-05-08T12:46:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32498.866947 secs 2023-05-08T12:46:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:00 smithi133 ceph-mon[125939]: pgmap v17387: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 16 op/s 2023-05-08T12:46:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32498.866947 secs 2023-05-08T12:46:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:00 smithi096 ceph-mon[124666]: pgmap v17387: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 16 op/s 2023-05-08T12:46:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:01 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:46:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:01 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:46:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:01 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:46:02.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:46:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:46:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:46:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:02 smithi186 ceph-mon[126480]: pgmap v17388: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T12:46:02.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:46:02.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:46:02.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:46:02.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:02 smithi133 ceph-mon[125939]: pgmap v17388: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T12:46:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:46:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:46:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:46:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:02 smithi096 ceph-mon[124666]: pgmap v17388: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T12:46:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:03 smithi186 ceph-mon[126480]: pgmap v17389: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 782 KiB/s rd, 770 KiB/s wr, 10 op/s 2023-05-08T12:46:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:03 smithi133 ceph-mon[125939]: pgmap v17389: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 782 KiB/s rd, 770 KiB/s wr, 10 op/s 2023-05-08T12:46:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:03 smithi096 ceph-mon[124666]: pgmap v17389: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 782 KiB/s rd, 770 KiB/s wr, 10 op/s 2023-05-08T12:46:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32503.311538 secs 2023-05-08T12:46:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32503.867075 secs 2023-05-08T12:46:05.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32503.311538 secs 2023-05-08T12:46:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32503.867075 secs 2023-05-08T12:46:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32503.311538 secs 2023-05-08T12:46:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32503.867075 secs 2023-05-08T12:46:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:05 smithi186 ceph-mon[126480]: pgmap v17390: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 27 op/s 2023-05-08T12:46:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:05 smithi133 ceph-mon[125939]: pgmap v17390: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 27 op/s 2023-05-08T12:46:06.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:05 smithi096 ceph-mon[124666]: pgmap v17390: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 27 op/s 2023-05-08T12:46:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:07 smithi186 ceph-mon[126480]: pgmap v17391: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 870 KiB/s rd, 882 KiB/s wr, 22 op/s 2023-05-08T12:46:08.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:07 smithi133 ceph-mon[125939]: pgmap v17391: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 870 KiB/s rd, 882 KiB/s wr, 22 op/s 2023-05-08T12:46:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:07 smithi096 ceph-mon[124666]: pgmap v17391: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 870 KiB/s rd, 882 KiB/s wr, 22 op/s 2023-05-08T12:46:09.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32508.311650 secs 2023-05-08T12:46:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32508.311650 secs 2023-05-08T12:46:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32508.311650 secs 2023-05-08T12:46:10.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32508.867192 secs 2023-05-08T12:46:10.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:10 smithi186 ceph-mon[126480]: pgmap v17392: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 26 op/s 2023-05-08T12:46:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32508.867192 secs 2023-05-08T12:46:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:10 smithi133 ceph-mon[125939]: pgmap v17392: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 26 op/s 2023-05-08T12:46:10.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32508.867192 secs 2023-05-08T12:46:10.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:10 smithi096 ceph-mon[124666]: pgmap v17392: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 26 op/s 2023-05-08T12:46:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:12 smithi186 ceph-mon[126480]: pgmap v17393: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 720 KiB/s rd, 733 KiB/s wr, 20 op/s 2023-05-08T12:46:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:12 smithi133 ceph-mon[125939]: pgmap v17393: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 720 KiB/s rd, 733 KiB/s wr, 20 op/s 2023-05-08T12:46:13.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:12 smithi096 ceph-mon[124666]: pgmap v17393: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 720 KiB/s rd, 733 KiB/s wr, 20 op/s 2023-05-08T12:46:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:13 smithi186 ceph-mon[126480]: pgmap v17394: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 720 KiB/s rd, 733 KiB/s wr, 20 op/s 2023-05-08T12:46:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:13 smithi133 ceph-mon[125939]: pgmap v17394: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 720 KiB/s rd, 733 KiB/s wr, 20 op/s 2023-05-08T12:46:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:13 smithi096 ceph-mon[124666]: pgmap v17394: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 720 KiB/s rd, 733 KiB/s wr, 20 op/s 2023-05-08T12:46:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32513.311766 secs 2023-05-08T12:46:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32513.867315 secs 2023-05-08T12:46:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32513.311766 secs 2023-05-08T12:46:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32513.867315 secs 2023-05-08T12:46:15.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32513.311766 secs 2023-05-08T12:46:15.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32513.867315 secs 2023-05-08T12:46:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:15 smithi186 ceph-mon[126480]: pgmap v17395: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 722 KiB/s rd, 733 KiB/s wr, 23 op/s 2023-05-08T12:46:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:15 smithi133 ceph-mon[125939]: pgmap v17395: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 722 KiB/s rd, 733 KiB/s wr, 23 op/s 2023-05-08T12:46:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:15 smithi096 ceph-mon[124666]: pgmap v17395: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 722 KiB/s rd, 733 KiB/s wr, 23 op/s 2023-05-08T12:46:18.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:17 smithi186 ceph-mon[126480]: pgmap v17396: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 279 KiB/s wr, 7 op/s 2023-05-08T12:46:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:17 smithi133 ceph-mon[125939]: pgmap v17396: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 279 KiB/s wr, 7 op/s 2023-05-08T12:46:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:17 smithi096 ceph-mon[124666]: pgmap v17396: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 279 KiB/s wr, 7 op/s 2023-05-08T12:46:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32518.311849 secs 2023-05-08T12:46:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32518.311849 secs 2023-05-08T12:46:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32518.311849 secs 2023-05-08T12:46:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:20 smithi186 ceph-mon[126480]: pgmap v17397: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 723 KiB/s rd, 741 KiB/s wr, 13 op/s 2023-05-08T12:46:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:20 smithi133 ceph-mon[125939]: pgmap v17397: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 723 KiB/s rd, 741 KiB/s wr, 13 op/s 2023-05-08T12:46:20.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:20 smithi096 ceph-mon[124666]: pgmap v17397: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 723 KiB/s rd, 741 KiB/s wr, 13 op/s 2023-05-08T12:46:21.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:21 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:46:21.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:21 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:46:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:21 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:46:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:22 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:46:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:22 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:46:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:22 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:46:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:22 smithi186 ceph-mon[126480]: pgmap v17398: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 463 KiB/s wr, 9 op/s 2023-05-08T12:46:22.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:22 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:46:22.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:22 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:46:22.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:22 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:46:22.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:22 smithi133 ceph-mon[125939]: pgmap v17398: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 463 KiB/s wr, 9 op/s 2023-05-08T12:46:22.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:22 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:46:22.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:22 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:46:22.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:22 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:46:22.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:22 smithi096 ceph-mon[124666]: pgmap v17398: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 463 KiB/s wr, 9 op/s 2023-05-08T12:46:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:23 smithi186 ceph-mon[126480]: pgmap v17399: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 463 KiB/s wr, 9 op/s 2023-05-08T12:46:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:23 smithi133 ceph-mon[125939]: pgmap v17399: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 463 KiB/s wr, 9 op/s 2023-05-08T12:46:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:23 smithi096 ceph-mon[124666]: pgmap v17399: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 463 KiB/s wr, 9 op/s 2023-05-08T12:46:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32523.311987 secs 2023-05-08T12:46:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32523.311987 secs 2023-05-08T12:46:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32523.311987 secs 2023-05-08T12:46:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:25 smithi186 ceph-mon[126480]: pgmap v17400: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 467 KiB/s rd, 486 KiB/s wr, 13 op/s 2023-05-08T12:46:26.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:25 smithi133 ceph-mon[125939]: pgmap v17400: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 467 KiB/s rd, 486 KiB/s wr, 13 op/s 2023-05-08T12:46:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:25 smithi096 ceph-mon[124666]: pgmap v17400: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 467 KiB/s rd, 486 KiB/s wr, 13 op/s 2023-05-08T12:46:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:26 smithi186 ceph-mon[126480]: osdmap e1164: 12 total, 12 up, 12 in 2023-05-08T12:46:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:26 smithi133 ceph-mon[125939]: osdmap e1164: 12 total, 12 up, 12 in 2023-05-08T12:46:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:26 smithi096 ceph-mon[124666]: osdmap e1164: 12 total, 12 up, 12 in 2023-05-08T12:46:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:27 smithi133 ceph-mon[125939]: pgmap v17402: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 583 KiB/s wr, 12 op/s 2023-05-08T12:46:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:27 smithi096 ceph-mon[124666]: pgmap v17402: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 583 KiB/s wr, 12 op/s 2023-05-08T12:46:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:27 smithi186 ceph-mon[126480]: pgmap v17402: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 583 KiB/s wr, 12 op/s 2023-05-08T12:46:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32528.312105 secs 2023-05-08T12:46:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32528.312105 secs 2023-05-08T12:46:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32528.312105 secs 2023-05-08T12:46:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:30 smithi186 ceph-mon[126480]: pgmap v17403: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 337 KiB/s wr, 9 op/s 2023-05-08T12:46:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:30 smithi133 ceph-mon[125939]: pgmap v17403: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 337 KiB/s wr, 9 op/s 2023-05-08T12:46:30.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:30 smithi096 ceph-mon[124666]: pgmap v17403: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 337 KiB/s wr, 9 op/s 2023-05-08T12:46:32.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:32 smithi186 ceph-mon[126480]: pgmap v17404: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 337 KiB/s wr, 9 op/s 2023-05-08T12:46:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:32 smithi133 ceph-mon[125939]: pgmap v17404: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 337 KiB/s wr, 9 op/s 2023-05-08T12:46:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:32 smithi096 ceph-mon[124666]: pgmap v17404: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 337 KiB/s wr, 9 op/s 2023-05-08T12:46:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:33 smithi186 ceph-mon[126480]: pgmap v17405: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 337 KiB/s wr, 9 op/s 2023-05-08T12:46:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:33 smithi133 ceph-mon[125939]: pgmap v17405: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 337 KiB/s wr, 9 op/s 2023-05-08T12:46:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:33 smithi096 ceph-mon[124666]: pgmap v17405: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 337 KiB/s wr, 9 op/s 2023-05-08T12:46:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32533.312222 secs 2023-05-08T12:46:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32533.312222 secs 2023-05-08T12:46:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32533.312222 secs 2023-05-08T12:46:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32535.158605 secs 2023-05-08T12:46:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:35 smithi186 ceph-mon[126480]: pgmap v17406: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 314 KiB/s wr, 9 op/s 2023-05-08T12:46:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32535.158605 secs 2023-05-08T12:46:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:35 smithi133 ceph-mon[125939]: pgmap v17406: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 314 KiB/s wr, 9 op/s 2023-05-08T12:46:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32535.158605 secs 2023-05-08T12:46:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:35 smithi096 ceph-mon[124666]: pgmap v17406: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 314 KiB/s wr, 9 op/s 2023-05-08T12:46:37.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:37 smithi186 ceph-mon[126480]: osdmap e1165: 12 total, 12 up, 12 in 2023-05-08T12:46:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:37 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:46:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:37 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:46:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:37 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:46:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:37 smithi133 ceph-mon[125939]: osdmap e1165: 12 total, 12 up, 12 in 2023-05-08T12:46:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:37 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:46:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:37 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:46:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:37 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:46:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:37 smithi096 ceph-mon[124666]: osdmap e1165: 12 total, 12 up, 12 in 2023-05-08T12:46:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:37 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:46:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:37 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:46:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:37 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:46:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:38 smithi186 ceph-mon[126480]: pgmap v17408: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 314 KiB/s wr, 9 op/s 2023-05-08T12:46:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:38 smithi133 ceph-mon[125939]: pgmap v17408: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 314 KiB/s wr, 9 op/s 2023-05-08T12:46:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:38 smithi096 ceph-mon[124666]: pgmap v17408: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 314 KiB/s wr, 9 op/s 2023-05-08T12:46:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32538.312326 secs 2023-05-08T12:46:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32538.867833 secs 2023-05-08T12:46:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32538.312326 secs 2023-05-08T12:46:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32538.867833 secs 2023-05-08T12:46:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32538.312326 secs 2023-05-08T12:46:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32538.867833 secs 2023-05-08T12:46:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:40 smithi133 ceph-mon[125939]: pgmap v17409: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 470 KiB/s rd, 541 KiB/s wr, 10 op/s 2023-05-08T12:46:41.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:40 smithi096 ceph-mon[124666]: pgmap v17409: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 470 KiB/s rd, 541 KiB/s wr, 10 op/s 2023-05-08T12:46:41.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:40 smithi186 ceph-mon[126480]: pgmap v17409: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 470 KiB/s rd, 541 KiB/s wr, 10 op/s 2023-05-08T12:46:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32540.158721 secs 2023-05-08T12:46:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32540.158721 secs 2023-05-08T12:46:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32540.158721 secs 2023-05-08T12:46:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:42 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:46:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:42 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:46:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:42 smithi133 ceph-mon[125939]: pgmap v17410: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 929 KiB/s wr, 10 op/s 2023-05-08T12:46:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:42 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:46:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:42 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:46:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:42 smithi096 ceph-mon[124666]: pgmap v17410: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 929 KiB/s wr, 10 op/s 2023-05-08T12:46:43.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:42 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:46:43.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:42 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:46:43.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:42 smithi186 ceph-mon[126480]: pgmap v17410: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 929 KiB/s wr, 10 op/s 2023-05-08T12:46:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:43 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:46:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:43 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:46:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:43 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:46:43.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:43 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:46:44.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:43 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:46:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:43 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:46:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:43 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:46:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:43 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:46:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:43 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:46:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:43 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:46:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:43 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:46:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:43 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:46:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:44 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:46:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:44 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T12:46:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:44 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T12:46:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:44 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:46:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32543.312421 secs 2023-05-08T12:46:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:44 smithi133 ceph-mon[125939]: pgmap v17411: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 929 KiB/s wr, 10 op/s 2023-05-08T12:46:44.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32543.867914 secs 2023-05-08T12:46:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:44 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:46:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:44 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T12:46:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:44 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T12:46:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:44 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:46:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32543.312421 secs 2023-05-08T12:46:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:44 smithi096 ceph-mon[124666]: pgmap v17411: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 929 KiB/s wr, 10 op/s 2023-05-08T12:46:45.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32543.867914 secs 2023-05-08T12:46:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:44 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:46:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:44 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T12:46:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:44 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T12:46:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:44 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:46:45.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32543.312421 secs 2023-05-08T12:46:45.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:44 smithi186 ceph-mon[126480]: pgmap v17411: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 929 KiB/s wr, 10 op/s 2023-05-08T12:46:45.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32543.867914 secs 2023-05-08T12:46:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:45 smithi186 ceph-mon[126480]: pgmap v17412: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 953 KiB/s rd, 947 KiB/s wr, 10 op/s 2023-05-08T12:46:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:45 smithi133 ceph-mon[125939]: pgmap v17412: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 953 KiB/s rd, 947 KiB/s wr, 10 op/s 2023-05-08T12:46:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:45 smithi096 ceph-mon[124666]: pgmap v17412: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 953 KiB/s rd, 947 KiB/s wr, 10 op/s 2023-05-08T12:46:47.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:46 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:46:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:46 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:46:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:46 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:46:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:47 smithi186 ceph-mon[126480]: pgmap v17413: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 853 KiB/s rd, 848 KiB/s wr, 9 op/s 2023-05-08T12:46:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:47 smithi133 ceph-mon[125939]: pgmap v17413: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 853 KiB/s rd, 848 KiB/s wr, 9 op/s 2023-05-08T12:46:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:47 smithi096 ceph-mon[124666]: pgmap v17413: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 853 KiB/s rd, 848 KiB/s wr, 9 op/s 2023-05-08T12:46:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:46:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:46:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:46:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32548.312517 secs 2023-05-08T12:46:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:46:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:46:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:49 smithi133 ceph-mon[125939]: pgmap v17414: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T12:46:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32548.312517 secs 2023-05-08T12:46:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:46:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:46:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:49 smithi096 ceph-mon[124666]: pgmap v17414: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T12:46:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32548.312517 secs 2023-05-08T12:46:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:46:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:46:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:49 smithi186 ceph-mon[126480]: pgmap v17414: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T12:46:51.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32550.158930 secs 2023-05-08T12:46:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32550.158930 secs 2023-05-08T12:46:51.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32550.158930 secs 2023-05-08T12:46:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:51 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:46:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:51 smithi133 ceph-mon[125939]: pgmap v17415: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 899 KiB/s rd, 706 KiB/s wr, 9 op/s 2023-05-08T12:46:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:51 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:46:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:51 smithi096 ceph-mon[124666]: pgmap v17415: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 899 KiB/s rd, 706 KiB/s wr, 9 op/s 2023-05-08T12:46:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:51 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:46:52.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:51 smithi186 ceph-mon[126480]: pgmap v17415: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 899 KiB/s rd, 706 KiB/s wr, 9 op/s 2023-05-08T12:46:53.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:53 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:46:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:46:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:46:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:46:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:53 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:46:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:46:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:46:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:46:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:53 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:46:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:46:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:46:54.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:46:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32553.312638 secs 2023-05-08T12:46:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:54 smithi186 ceph-mon[126480]: pgmap v17416: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 833 KiB/s rd, 383 KiB/s wr, 8 op/s 2023-05-08T12:46:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32553.312638 secs 2023-05-08T12:46:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:54 smithi133 ceph-mon[125939]: pgmap v17416: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 833 KiB/s rd, 383 KiB/s wr, 8 op/s 2023-05-08T12:46:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32553.312638 secs 2023-05-08T12:46:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:54 smithi096 ceph-mon[124666]: pgmap v17416: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 833 KiB/s rd, 383 KiB/s wr, 8 op/s 2023-05-08T12:46:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32555.159015 secs 2023-05-08T12:46:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:55 smithi186 ceph-mon[126480]: pgmap v17417: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T12:46:56.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32555.159015 secs 2023-05-08T12:46:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:55 smithi133 ceph-mon[125939]: pgmap v17417: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T12:46:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32555.159015 secs 2023-05-08T12:46:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:55 smithi096 ceph-mon[124666]: pgmap v17417: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T12:46:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:57 smithi186 ceph-mon[126480]: pgmap v17418: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T12:46:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:57 smithi133 ceph-mon[125939]: pgmap v17418: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T12:46:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:57 smithi096 ceph-mon[124666]: pgmap v17418: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T12:46:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:46:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32558.312753 secs 2023-05-08T12:46:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:46:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32558.312753 secs 2023-05-08T12:46:59.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:46:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32558.312753 secs 2023-05-08T12:47:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32558.868266 secs 2023-05-08T12:47:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:00 smithi186 ceph-mon[126480]: pgmap v17419: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.2 MiB/s wr, 15 op/s 2023-05-08T12:47:00.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32558.868266 secs 2023-05-08T12:47:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:00 smithi133 ceph-mon[125939]: pgmap v17419: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.2 MiB/s wr, 15 op/s 2023-05-08T12:47:00.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32558.868266 secs 2023-05-08T12:47:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:00 smithi096 ceph-mon[124666]: pgmap v17419: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.2 MiB/s wr, 15 op/s 2023-05-08T12:47:01.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32560.159100 secs 2023-05-08T12:47:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32560.159100 secs 2023-05-08T12:47:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32560.159100 secs 2023-05-08T12:47:02.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:02 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:47:02.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:47:02.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:47:02.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:02 smithi186 ceph-mon[126480]: pgmap v17420: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 888 KiB/s wr, 10 op/s 2023-05-08T12:47:02.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:02 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:47:02.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:47:02.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:47:02.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:02 smithi133 ceph-mon[125939]: pgmap v17420: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 888 KiB/s wr, 10 op/s 2023-05-08T12:47:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:02 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:47:02.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:47:02.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:47:02.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:02 smithi096 ceph-mon[124666]: pgmap v17420: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 888 KiB/s wr, 10 op/s 2023-05-08T12:47:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:03 smithi186 ceph-mon[126480]: pgmap v17421: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 888 KiB/s wr, 10 op/s 2023-05-08T12:47:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:03 smithi133 ceph-mon[125939]: pgmap v17421: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 888 KiB/s wr, 10 op/s 2023-05-08T12:47:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:03 smithi096 ceph-mon[124666]: pgmap v17421: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 888 KiB/s wr, 10 op/s 2023-05-08T12:47:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32563.312867 secs 2023-05-08T12:47:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:04 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:47:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32563.312867 secs 2023-05-08T12:47:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:04 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:47:05.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32563.312867 secs 2023-05-08T12:47:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:04 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:47:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:47:06.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:47:06.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:05 smithi133 ceph-mon[125939]: pgmap v17422: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 28 op/s 2023-05-08T12:47:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:47:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:47:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:05 smithi096 ceph-mon[124666]: pgmap v17422: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 28 op/s 2023-05-08T12:47:06.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:47:06.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:47:06.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:05 smithi186 ceph-mon[126480]: pgmap v17422: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 28 op/s 2023-05-08T12:47:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:06 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:47:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:06 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:47:07.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:06 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:47:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:07 smithi133 ceph-mon[125939]: pgmap v17423: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 966 KiB/s rd, 698 KiB/s wr, 22 op/s 2023-05-08T12:47:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:07 smithi096 ceph-mon[124666]: pgmap v17423: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 966 KiB/s rd, 698 KiB/s wr, 22 op/s 2023-05-08T12:47:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:07 smithi186 ceph-mon[126480]: pgmap v17423: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 966 KiB/s rd, 698 KiB/s wr, 22 op/s 2023-05-08T12:47:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:08 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:47:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:08 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:47:09.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:08 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:47:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32568.312965 secs 2023-05-08T12:47:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:47:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:47:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:09 smithi133 ceph-mon[125939]: pgmap v17424: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 970 KiB/s rd, 827 KiB/s wr, 26 op/s 2023-05-08T12:47:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32568.312965 secs 2023-05-08T12:47:10.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:47:10.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:47:10.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:09 smithi096 ceph-mon[124666]: pgmap v17424: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 970 KiB/s rd, 827 KiB/s wr, 26 op/s 2023-05-08T12:47:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32568.312965 secs 2023-05-08T12:47:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:47:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:47:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:09 smithi186 ceph-mon[126480]: pgmap v17424: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 970 KiB/s rd, 827 KiB/s wr, 26 op/s 2023-05-08T12:47:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:11 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:47:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:11 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:47:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:11 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:47:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:12 smithi133 ceph-mon[125939]: pgmap v17425: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 580 KiB/s rd, 667 KiB/s wr, 21 op/s 2023-05-08T12:47:13.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:12 smithi096 ceph-mon[124666]: pgmap v17425: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 580 KiB/s rd, 667 KiB/s wr, 21 op/s 2023-05-08T12:47:13.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:12 smithi186 ceph-mon[126480]: pgmap v17425: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 580 KiB/s rd, 667 KiB/s wr, 21 op/s 2023-05-08T12:47:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:13 smithi186 ceph-mon[126480]: pgmap v17426: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 580 KiB/s rd, 667 KiB/s wr, 21 op/s 2023-05-08T12:47:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:13 smithi133 ceph-mon[125939]: pgmap v17426: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 580 KiB/s rd, 667 KiB/s wr, 21 op/s 2023-05-08T12:47:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:13 smithi096 ceph-mon[124666]: pgmap v17426: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 580 KiB/s rd, 667 KiB/s wr, 21 op/s 2023-05-08T12:47:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32573.313060 secs 2023-05-08T12:47:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32573.313060 secs 2023-05-08T12:47:15.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32573.313060 secs 2023-05-08T12:47:16.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:15 smithi133 ceph-mon[125939]: pgmap v17427: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 966 KiB/s rd, 925 KiB/s wr, 26 op/s 2023-05-08T12:47:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:15 smithi096 ceph-mon[124666]: pgmap v17427: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 966 KiB/s rd, 925 KiB/s wr, 26 op/s 2023-05-08T12:47:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:15 smithi186 ceph-mon[126480]: pgmap v17427: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 966 KiB/s rd, 925 KiB/s wr, 26 op/s 2023-05-08T12:47:18.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:17 smithi186 ceph-mon[126480]: pgmap v17428: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 388 KiB/s wr, 8 op/s 2023-05-08T12:47:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:17 smithi133 ceph-mon[125939]: pgmap v17428: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 388 KiB/s wr, 8 op/s 2023-05-08T12:47:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:17 smithi096 ceph-mon[124666]: pgmap v17428: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 388 KiB/s wr, 8 op/s 2023-05-08T12:47:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32578.313184 secs 2023-05-08T12:47:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32578.313184 secs 2023-05-08T12:47:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32578.313184 secs 2023-05-08T12:47:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:20 smithi186 ceph-mon[126480]: pgmap v17429: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 410 KiB/s wr, 12 op/s 2023-05-08T12:47:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:20 smithi133 ceph-mon[125939]: pgmap v17429: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 410 KiB/s wr, 12 op/s 2023-05-08T12:47:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:20 smithi096 ceph-mon[124666]: pgmap v17429: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 410 KiB/s wr, 12 op/s 2023-05-08T12:47:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32580.159610 secs 2023-05-08T12:47:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32580.159610 secs 2023-05-08T12:47:21.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32580.159610 secs 2023-05-08T12:47:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:22 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:47:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:22 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:47:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:22 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:47:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:22 smithi186 ceph-mon[126480]: pgmap v17430: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 409 KiB/s rd, 280 KiB/s wr, 8 op/s 2023-05-08T12:47:22.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:22 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:47:22.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:22 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:47:22.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:22 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:47:22.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:22 smithi133 ceph-mon[125939]: pgmap v17430: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 409 KiB/s rd, 280 KiB/s wr, 8 op/s 2023-05-08T12:47:22.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:22 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:47:22.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:22 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:47:22.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:22 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:47:22.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:22 smithi096 ceph-mon[124666]: pgmap v17430: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 409 KiB/s rd, 280 KiB/s wr, 8 op/s 2023-05-08T12:47:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:23 smithi186 ceph-mon[126480]: pgmap v17431: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 409 KiB/s rd, 280 KiB/s wr, 8 op/s 2023-05-08T12:47:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:23 smithi133 ceph-mon[125939]: pgmap v17431: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 409 KiB/s rd, 280 KiB/s wr, 8 op/s 2023-05-08T12:47:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:23 smithi096 ceph-mon[124666]: pgmap v17431: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 409 KiB/s rd, 280 KiB/s wr, 8 op/s 2023-05-08T12:47:25.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32583.313297 secs 2023-05-08T12:47:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32583.868852 secs 2023-05-08T12:47:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32583.313297 secs 2023-05-08T12:47:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32583.868852 secs 2023-05-08T12:47:25.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32583.313297 secs 2023-05-08T12:47:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32583.868852 secs 2023-05-08T12:47:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:25 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:47:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:25 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:47:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32585.159710 secs 2023-05-08T12:47:26.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:25 smithi133 ceph-mon[125939]: pgmap v17432: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 957 KiB/s wr, 15 op/s 2023-05-08T12:47:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:25 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:47:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:25 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:47:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32585.159710 secs 2023-05-08T12:47:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:25 smithi096 ceph-mon[124666]: pgmap v17432: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 957 KiB/s wr, 15 op/s 2023-05-08T12:47:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:25 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:47:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:25 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:47:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32585.159710 secs 2023-05-08T12:47:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:25 smithi186 ceph-mon[126480]: pgmap v17432: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 957 KiB/s wr, 15 op/s 2023-05-08T12:47:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:26 smithi133 ceph-mon[125939]: osdmap e1166: 12 total, 12 up, 12 in 2023-05-08T12:47:27.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:26 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:47:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:26 smithi096 ceph-mon[124666]: osdmap e1166: 12 total, 12 up, 12 in 2023-05-08T12:47:27.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:26 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:47:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:26 smithi186 ceph-mon[126480]: osdmap e1166: 12 total, 12 up, 12 in 2023-05-08T12:47:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:26 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:47:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:27 smithi133 ceph-mon[125939]: pgmap v17434: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 815 KiB/s rd, 839 KiB/s wr, 13 op/s 2023-05-08T12:47:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:27 smithi096 ceph-mon[124666]: pgmap v17434: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 815 KiB/s rd, 839 KiB/s wr, 13 op/s 2023-05-08T12:47:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:27 smithi186 ceph-mon[126480]: pgmap v17434: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 815 KiB/s rd, 839 KiB/s wr, 13 op/s 2023-05-08T12:47:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32588.313419 secs 2023-05-08T12:47:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32588.313419 secs 2023-05-08T12:47:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32588.313419 secs 2023-05-08T12:47:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32588.868978 secs 2023-05-08T12:47:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:30 smithi186 ceph-mon[126480]: pgmap v17435: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 915 KiB/s rd, 939 KiB/s wr, 13 op/s 2023-05-08T12:47:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32588.868978 secs 2023-05-08T12:47:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:30 smithi133 ceph-mon[125939]: pgmap v17435: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 915 KiB/s rd, 939 KiB/s wr, 13 op/s 2023-05-08T12:47:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32588.868978 secs 2023-05-08T12:47:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:30 smithi096 ceph-mon[124666]: pgmap v17435: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 915 KiB/s rd, 939 KiB/s wr, 13 op/s 2023-05-08T12:47:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32590.159833 secs 2023-05-08T12:47:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32590.159833 secs 2023-05-08T12:47:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32590.159833 secs 2023-05-08T12:47:32.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:32 smithi133 ceph-mon[125939]: pgmap v17436: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 915 KiB/s rd, 939 KiB/s wr, 13 op/s 2023-05-08T12:47:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:32 smithi096 ceph-mon[124666]: pgmap v17436: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 915 KiB/s rd, 939 KiB/s wr, 13 op/s 2023-05-08T12:47:33.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:32 smithi186 ceph-mon[126480]: pgmap v17436: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 915 KiB/s rd, 939 KiB/s wr, 13 op/s 2023-05-08T12:47:34.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:33 smithi133 ceph-mon[125939]: pgmap v17437: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 915 KiB/s rd, 939 KiB/s wr, 13 op/s 2023-05-08T12:47:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:33 smithi096 ceph-mon[124666]: pgmap v17437: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 915 KiB/s rd, 939 KiB/s wr, 13 op/s 2023-05-08T12:47:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:33 smithi186 ceph-mon[126480]: pgmap v17437: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 915 KiB/s rd, 939 KiB/s wr, 13 op/s 2023-05-08T12:47:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32593.313538 secs 2023-05-08T12:47:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32593.869099 secs 2023-05-08T12:47:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32593.313538 secs 2023-05-08T12:47:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32593.869099 secs 2023-05-08T12:47:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32593.313538 secs 2023-05-08T12:47:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32593.869099 secs 2023-05-08T12:47:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32595.159954 secs 2023-05-08T12:47:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:35 smithi133 ceph-mon[125939]: pgmap v17438: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 521 KiB/s rd, 518 KiB/s wr, 10 op/s 2023-05-08T12:47:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32595.159954 secs 2023-05-08T12:47:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:35 smithi096 ceph-mon[124666]: pgmap v17438: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 521 KiB/s rd, 518 KiB/s wr, 10 op/s 2023-05-08T12:47:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32595.159954 secs 2023-05-08T12:47:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:35 smithi186 ceph-mon[126480]: pgmap v17438: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 521 KiB/s rd, 518 KiB/s wr, 10 op/s 2023-05-08T12:47:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:37 smithi133 ceph-mon[125939]: osdmap e1167: 12 total, 12 up, 12 in 2023-05-08T12:47:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:37 smithi096 ceph-mon[124666]: osdmap e1167: 12 total, 12 up, 12 in 2023-05-08T12:47:38.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:37 smithi186 ceph-mon[126480]: osdmap e1167: 12 total, 12 up, 12 in 2023-05-08T12:47:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:38 smithi133 ceph-mon[125939]: pgmap v17440: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 521 KiB/s rd, 518 KiB/s wr, 10 op/s 2023-05-08T12:47:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:38 smithi096 ceph-mon[124666]: pgmap v17440: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 521 KiB/s rd, 518 KiB/s wr, 10 op/s 2023-05-08T12:47:39.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:38 smithi186 ceph-mon[126480]: pgmap v17440: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 521 KiB/s rd, 518 KiB/s wr, 10 op/s 2023-05-08T12:47:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32598.313655 secs 2023-05-08T12:47:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32598.869240 secs 2023-05-08T12:47:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32598.313655 secs 2023-05-08T12:47:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32598.869240 secs 2023-05-08T12:47:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32598.313655 secs 2023-05-08T12:47:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32598.869240 secs 2023-05-08T12:47:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:40 smithi133 ceph-mon[125939]: pgmap v17441: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 392 KiB/s wr, 8 op/s 2023-05-08T12:47:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:40 smithi096 ceph-mon[124666]: pgmap v17441: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 392 KiB/s wr, 8 op/s 2023-05-08T12:47:41.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:40 smithi186 ceph-mon[126480]: pgmap v17441: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 392 KiB/s wr, 8 op/s 2023-05-08T12:47:41.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32600.160073 secs 2023-05-08T12:47:42.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32600.160073 secs 2023-05-08T12:47:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32600.160073 secs 2023-05-08T12:47:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:42 smithi133 ceph-mon[125939]: pgmap v17442: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 392 KiB/s wr, 8 op/s 2023-05-08T12:47:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:42 smithi096 ceph-mon[124666]: pgmap v17442: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 392 KiB/s wr, 8 op/s 2023-05-08T12:47:43.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:42 smithi186 ceph-mon[126480]: pgmap v17442: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 392 KiB/s wr, 8 op/s 2023-05-08T12:47:43.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:43 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:47:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:43 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:47:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:43 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:47:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32603.313772 secs 2023-05-08T12:47:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:44 smithi133 ceph-mon[125939]: pgmap v17443: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 392 KiB/s wr, 8 op/s 2023-05-08T12:47:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:44 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:47:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:44 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:47:44.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32603.869332 secs 2023-05-08T12:47:44.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:44 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:47:44.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:44 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:47:44.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:44 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:47:44.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:44 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:47:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32603.313772 secs 2023-05-08T12:47:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:44 smithi096 ceph-mon[124666]: pgmap v17443: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 392 KiB/s wr, 8 op/s 2023-05-08T12:47:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:44 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:47:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:44 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:47:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32603.869332 secs 2023-05-08T12:47:45.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:44 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:47:45.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:44 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:47:45.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:44 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:47:45.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:44 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:47:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32603.313772 secs 2023-05-08T12:47:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:44 smithi186 ceph-mon[126480]: pgmap v17443: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 392 KiB/s wr, 8 op/s 2023-05-08T12:47:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:44 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:47:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:44 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:47:45.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32603.869332 secs 2023-05-08T12:47:45.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:44 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:47:45.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:44 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:47:45.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:44 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:47:45.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:44 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:47:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:47:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:47:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:45 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:47:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:47:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:45 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T12:47:45.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:45 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T12:47:45.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:45 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:47:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:47:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:47:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:45 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:47:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:47:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:45 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T12:47:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:45 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T12:47:46.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:45 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:47:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:47:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:47:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:45 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:47:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:47:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:45 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T12:47:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:45 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T12:47:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:45 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:47:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:46 smithi133 ceph-mon[125939]: pgmap v17444: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 409 B/s wr, 7 op/s 2023-05-08T12:47:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:46 smithi096 ceph-mon[124666]: pgmap v17444: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 409 B/s wr, 7 op/s 2023-05-08T12:47:47.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:46 smithi186 ceph-mon[126480]: pgmap v17444: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 409 B/s wr, 7 op/s 2023-05-08T12:47:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:47 smithi133 ceph-mon[125939]: pgmap v17445: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 366 B/s wr, 6 op/s 2023-05-08T12:47:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:47 smithi096 ceph-mon[124666]: pgmap v17445: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 366 B/s wr, 6 op/s 2023-05-08T12:47:48.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:47 smithi186 ceph-mon[126480]: pgmap v17445: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 366 B/s wr, 6 op/s 2023-05-08T12:47:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:47:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:47:49.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:47:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32608.313877 secs 2023-05-08T12:47:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:47:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:47:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:47:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32608.869426 secs 2023-05-08T12:47:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:49 smithi133 ceph-mon[125939]: pgmap v17446: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 305 KiB/s wr, 9 op/s 2023-05-08T12:47:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32608.313877 secs 2023-05-08T12:47:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:47:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:47:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:47:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32608.869426 secs 2023-05-08T12:47:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:49 smithi096 ceph-mon[124666]: pgmap v17446: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 305 KiB/s wr, 9 op/s 2023-05-08T12:47:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32608.313877 secs 2023-05-08T12:47:50.429 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:47:50.429 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:47:50.429 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:47:50.430 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32608.869426 secs 2023-05-08T12:47:50.430 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:49 smithi186 ceph-mon[126480]: pgmap v17446: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 305 KiB/s wr, 9 op/s 2023-05-08T12:47:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:52 smithi133 ceph-mon[125939]: pgmap v17447: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 305 KiB/s wr, 6 op/s 2023-05-08T12:47:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:52 smithi096 ceph-mon[124666]: pgmap v17447: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 305 KiB/s wr, 6 op/s 2023-05-08T12:47:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:52 smithi186 ceph-mon[126480]: pgmap v17447: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 305 KiB/s wr, 6 op/s 2023-05-08T12:47:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:53 smithi133 ceph-mon[125939]: pgmap v17448: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 305 KiB/s wr, 6 op/s 2023-05-08T12:47:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:53 smithi096 ceph-mon[124666]: pgmap v17448: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 305 KiB/s wr, 6 op/s 2023-05-08T12:47:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:53 smithi186 ceph-mon[126480]: pgmap v17448: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 305 KiB/s wr, 6 op/s 2023-05-08T12:47:55.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32613.313992 secs 2023-05-08T12:47:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32613.313992 secs 2023-05-08T12:47:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32613.313992 secs 2023-05-08T12:47:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:55 smithi133 ceph-mon[125939]: pgmap v17449: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 975 KiB/s rd, 809 KiB/s wr, 11 op/s 2023-05-08T12:47:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:55 smithi096 ceph-mon[124666]: pgmap v17449: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 975 KiB/s rd, 809 KiB/s wr, 11 op/s 2023-05-08T12:47:56.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:55 smithi186 ceph-mon[126480]: pgmap v17449: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 975 KiB/s rd, 809 KiB/s wr, 11 op/s 2023-05-08T12:47:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:47:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:47:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:47:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:58 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:47:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:47:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:47:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:58 smithi133 ceph-mon[125939]: pgmap v17450: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 973 KiB/s rd, 809 KiB/s wr, 8 op/s 2023-05-08T12:47:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:58 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:47:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:47:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:47:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:58 smithi096 ceph-mon[124666]: pgmap v17450: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 973 KiB/s rd, 809 KiB/s wr, 8 op/s 2023-05-08T12:47:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:58 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:47:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:47:59.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:47:59.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:58 smithi186 ceph-mon[126480]: pgmap v17450: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 973 KiB/s rd, 809 KiB/s wr, 8 op/s 2023-05-08T12:47:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:47:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32618.314128 secs 2023-05-08T12:48:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:47:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32618.314128 secs 2023-05-08T12:48:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:47:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32618.314128 secs 2023-05-08T12:48:00.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:00 smithi133 ceph-mon[125939]: pgmap v17451: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T12:48:01.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:00 smithi096 ceph-mon[124666]: pgmap v17451: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T12:48:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:00 smithi186 ceph-mon[126480]: pgmap v17451: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T12:48:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32620.160513 secs 2023-05-08T12:48:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:48:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:48:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32620.160513 secs 2023-05-08T12:48:02.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:48:02.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:48:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32620.160513 secs 2023-05-08T12:48:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:48:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:48:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:02 smithi133 ceph-mon[125939]: pgmap v17452: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 772 KiB/s rd, 975 KiB/s wr, 10 op/s 2023-05-08T12:48:03.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:02 smithi096 ceph-mon[124666]: pgmap v17452: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 772 KiB/s rd, 975 KiB/s wr, 10 op/s 2023-05-08T12:48:03.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:02 smithi186 ceph-mon[126480]: pgmap v17452: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 772 KiB/s rd, 975 KiB/s wr, 10 op/s 2023-05-08T12:48:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:03 smithi133 ceph-mon[125939]: pgmap v17453: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 772 KiB/s rd, 975 KiB/s wr, 10 op/s 2023-05-08T12:48:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:03 smithi096 ceph-mon[124666]: pgmap v17453: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 772 KiB/s rd, 975 KiB/s wr, 10 op/s 2023-05-08T12:48:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:03 smithi186 ceph-mon[126480]: pgmap v17453: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 772 KiB/s rd, 975 KiB/s wr, 10 op/s 2023-05-08T12:48:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32623.314264 secs 2023-05-08T12:48:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32623.869737 secs 2023-05-08T12:48:05.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32623.314264 secs 2023-05-08T12:48:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32623.869737 secs 2023-05-08T12:48:05.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32623.314264 secs 2023-05-08T12:48:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32623.869737 secs 2023-05-08T12:48:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:05 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:48:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:48:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:48:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:05 smithi133 ceph-mon[125939]: pgmap v17454: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 27 op/s 2023-05-08T12:48:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:05 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:48:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:48:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:48:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:05 smithi096 ceph-mon[124666]: pgmap v17454: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 27 op/s 2023-05-08T12:48:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:05 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:48:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:48:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:48:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:05 smithi186 ceph-mon[126480]: pgmap v17454: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 27 op/s 2023-05-08T12:48:08.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:07 smithi133 ceph-mon[125939]: pgmap v17455: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 849 KiB/s rd, 850 KiB/s wr, 23 op/s 2023-05-08T12:48:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:07 smithi096 ceph-mon[124666]: pgmap v17455: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 849 KiB/s rd, 850 KiB/s wr, 23 op/s 2023-05-08T12:48:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:07 smithi186 ceph-mon[126480]: pgmap v17455: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 849 KiB/s rd, 850 KiB/s wr, 23 op/s 2023-05-08T12:48:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:08 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:48:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:08 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:48:09.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:08 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:48:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32628.314390 secs 2023-05-08T12:48:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:48:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:48:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32628.869857 secs 2023-05-08T12:48:10.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:09 smithi133 ceph-mon[125939]: pgmap v17456: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 853 KiB/s rd, 980 KiB/s wr, 27 op/s 2023-05-08T12:48:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32628.314390 secs 2023-05-08T12:48:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:48:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:48:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32628.869857 secs 2023-05-08T12:48:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:09 smithi096 ceph-mon[124666]: pgmap v17456: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 853 KiB/s rd, 980 KiB/s wr, 27 op/s 2023-05-08T12:48:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32628.314390 secs 2023-05-08T12:48:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:48:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:48:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32628.869857 secs 2023-05-08T12:48:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:09 smithi186 ceph-mon[126480]: pgmap v17456: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 853 KiB/s rd, 980 KiB/s wr, 27 op/s 2023-05-08T12:48:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:11 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:48:12.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:11 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:48:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:11 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:48:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:12 smithi133 ceph-mon[125939]: pgmap v17457: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 667 KiB/s rd, 509 KiB/s wr, 22 op/s 2023-05-08T12:48:13.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:12 smithi096 ceph-mon[124666]: pgmap v17457: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 667 KiB/s rd, 509 KiB/s wr, 22 op/s 2023-05-08T12:48:13.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:12 smithi186 ceph-mon[126480]: pgmap v17457: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 667 KiB/s rd, 509 KiB/s wr, 22 op/s 2023-05-08T12:48:14.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:13 smithi133 ceph-mon[125939]: pgmap v17458: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 667 KiB/s rd, 509 KiB/s wr, 22 op/s 2023-05-08T12:48:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:13 smithi096 ceph-mon[124666]: pgmap v17458: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 667 KiB/s rd, 509 KiB/s wr, 22 op/s 2023-05-08T12:48:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:13 smithi186 ceph-mon[126480]: pgmap v17458: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 667 KiB/s rd, 509 KiB/s wr, 22 op/s 2023-05-08T12:48:15.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32633.314508 secs 2023-05-08T12:48:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32633.869924 secs 2023-05-08T12:48:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32633.314508 secs 2023-05-08T12:48:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32633.869924 secs 2023-05-08T12:48:15.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32633.314508 secs 2023-05-08T12:48:15.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32633.869924 secs 2023-05-08T12:48:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:15 smithi133 ceph-mon[125939]: pgmap v17459: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 917 KiB/s wr, 26 op/s 2023-05-08T12:48:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:15 smithi096 ceph-mon[124666]: pgmap v17459: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 917 KiB/s wr, 26 op/s 2023-05-08T12:48:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:15 smithi186 ceph-mon[126480]: pgmap v17459: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 917 KiB/s wr, 26 op/s 2023-05-08T12:48:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:17 smithi133 ceph-mon[125939]: pgmap v17460: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 538 KiB/s wr, 8 op/s 2023-05-08T12:48:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:17 smithi096 ceph-mon[124666]: pgmap v17460: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 538 KiB/s wr, 8 op/s 2023-05-08T12:48:18.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:17 smithi186 ceph-mon[126480]: pgmap v17460: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 538 KiB/s wr, 8 op/s 2023-05-08T12:48:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32638.314601 secs 2023-05-08T12:48:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32638.314601 secs 2023-05-08T12:48:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32638.314601 secs 2023-05-08T12:48:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32638.869988 secs 2023-05-08T12:48:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:20 smithi186 ceph-mon[126480]: pgmap v17461: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 541 KiB/s rd, 538 KiB/s wr, 12 op/s 2023-05-08T12:48:20.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32638.869988 secs 2023-05-08T12:48:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:20 smithi133 ceph-mon[125939]: pgmap v17461: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 541 KiB/s rd, 538 KiB/s wr, 12 op/s 2023-05-08T12:48:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32638.869988 secs 2023-05-08T12:48:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:20 smithi096 ceph-mon[124666]: pgmap v17461: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 541 KiB/s rd, 538 KiB/s wr, 12 op/s 2023-05-08T12:48:22.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:22 smithi133 ceph-mon[125939]: pgmap v17462: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 409 KiB/s wr, 7 op/s 2023-05-08T12:48:23.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:22 smithi096 ceph-mon[124666]: pgmap v17462: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 409 KiB/s wr, 7 op/s 2023-05-08T12:48:23.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:22 smithi186 ceph-mon[126480]: pgmap v17462: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 409 KiB/s wr, 7 op/s 2023-05-08T12:48:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:23 smithi133 ceph-mon[125939]: pgmap v17463: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 409 KiB/s wr, 7 op/s 2023-05-08T12:48:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:23 smithi096 ceph-mon[124666]: pgmap v17463: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 409 KiB/s wr, 7 op/s 2023-05-08T12:48:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:23 smithi186 ceph-mon[126480]: pgmap v17463: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 409 KiB/s wr, 7 op/s 2023-05-08T12:48:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32643.314727 secs 2023-05-08T12:48:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:24 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:48:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32643.314727 secs 2023-05-08T12:48:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:24 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:48:25.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32643.314727 secs 2023-05-08T12:48:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:24 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:48:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:25 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:48:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:25 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:48:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:25 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:48:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:25 smithi133 ceph-mon[125939]: pgmap v17464: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1009 KiB/s wr, 14 op/s 2023-05-08T12:48:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:25 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:48:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:25 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:48:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:25 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:48:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:25 smithi096 ceph-mon[124666]: pgmap v17464: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1009 KiB/s wr, 14 op/s 2023-05-08T12:48:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:25 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:48:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:25 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:48:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:25 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:48:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:25 smithi186 ceph-mon[126480]: pgmap v17464: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1009 KiB/s wr, 14 op/s 2023-05-08T12:48:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:27 smithi133 ceph-mon[125939]: pgmap v17465: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 707 KiB/s rd, 600 KiB/s wr, 10 op/s 2023-05-08T12:48:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:27 smithi096 ceph-mon[124666]: pgmap v17465: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 707 KiB/s rd, 600 KiB/s wr, 10 op/s 2023-05-08T12:48:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:27 smithi186 ceph-mon[126480]: pgmap v17465: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 707 KiB/s rd, 600 KiB/s wr, 10 op/s 2023-05-08T12:48:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32648.314819 secs 2023-05-08T12:48:29.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32648.314819 secs 2023-05-08T12:48:29.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32648.314819 secs 2023-05-08T12:48:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:30 smithi186 ceph-mon[126480]: pgmap v17466: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 712 KiB/s rd, 625 KiB/s wr, 14 op/s 2023-05-08T12:48:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:30 smithi133 ceph-mon[125939]: pgmap v17466: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 712 KiB/s rd, 625 KiB/s wr, 14 op/s 2023-05-08T12:48:30.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:30 smithi096 ceph-mon[124666]: pgmap v17466: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 712 KiB/s rd, 625 KiB/s wr, 14 op/s 2023-05-08T12:48:32.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:32 smithi133 ceph-mon[125939]: osdmap e1168: 12 total, 12 up, 12 in 2023-05-08T12:48:32.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:32 smithi133 ceph-mon[125939]: pgmap v17468: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 700 KiB/s rd, 749 KiB/s wr, 12 op/s 2023-05-08T12:48:32.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:32 smithi096 ceph-mon[124666]: osdmap e1168: 12 total, 12 up, 12 in 2023-05-08T12:48:32.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:32 smithi096 ceph-mon[124666]: pgmap v17468: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 700 KiB/s rd, 749 KiB/s wr, 12 op/s 2023-05-08T12:48:32.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:32 smithi186 ceph-mon[126480]: osdmap e1168: 12 total, 12 up, 12 in 2023-05-08T12:48:32.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:32 smithi186 ceph-mon[126480]: pgmap v17468: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 700 KiB/s rd, 749 KiB/s wr, 12 op/s 2023-05-08T12:48:34.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:33 smithi133 ceph-mon[125939]: pgmap v17469: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 700 KiB/s rd, 749 KiB/s wr, 12 op/s 2023-05-08T12:48:34.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:33 smithi096 ceph-mon[124666]: pgmap v17469: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 700 KiB/s rd, 749 KiB/s wr, 12 op/s 2023-05-08T12:48:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:33 smithi186 ceph-mon[126480]: pgmap v17469: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 700 KiB/s rd, 749 KiB/s wr, 12 op/s 2023-05-08T12:48:35.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32653.314961 secs 2023-05-08T12:48:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32653.314961 secs 2023-05-08T12:48:35.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32653.314961 secs 2023-05-08T12:48:36.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:35 smithi133 ceph-mon[125939]: pgmap v17470: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 348 KiB/s rd, 345 KiB/s wr, 9 op/s 2023-05-08T12:48:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:35 smithi096 ceph-mon[124666]: pgmap v17470: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 348 KiB/s rd, 345 KiB/s wr, 9 op/s 2023-05-08T12:48:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:35 smithi186 ceph-mon[126480]: pgmap v17470: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 348 KiB/s rd, 345 KiB/s wr, 9 op/s 2023-05-08T12:48:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:37 smithi133 ceph-mon[125939]: osdmap e1169: 12 total, 12 up, 12 in 2023-05-08T12:48:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:37 smithi096 ceph-mon[124666]: osdmap e1169: 12 total, 12 up, 12 in 2023-05-08T12:48:38.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:37 smithi186 ceph-mon[126480]: osdmap e1169: 12 total, 12 up, 12 in 2023-05-08T12:48:38.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:38 smithi133 ceph-mon[125939]: pgmap v17472: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 394 KiB/s wr, 5 op/s 2023-05-08T12:48:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:38 smithi096 ceph-mon[124666]: pgmap v17472: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 394 KiB/s wr, 5 op/s 2023-05-08T12:48:39.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:38 smithi186 ceph-mon[126480]: pgmap v17472: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 394 KiB/s wr, 5 op/s 2023-05-08T12:48:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32658.315070 secs 2023-05-08T12:48:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32658.870351 secs 2023-05-08T12:48:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32658.315070 secs 2023-05-08T12:48:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32658.870351 secs 2023-05-08T12:48:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32658.315070 secs 2023-05-08T12:48:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32658.870351 secs 2023-05-08T12:48:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:40 smithi133 ceph-mon[125939]: pgmap v17473: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T12:48:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:40 smithi096 ceph-mon[124666]: pgmap v17473: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T12:48:41.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:40 smithi186 ceph-mon[126480]: pgmap v17473: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T12:48:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32660.161531 secs 2023-05-08T12:48:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:41 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:48:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:41 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:48:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:41 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:48:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32660.161531 secs 2023-05-08T12:48:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:41 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:48:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:41 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:48:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:41 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:48:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32660.161531 secs 2023-05-08T12:48:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:41 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:48:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:41 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:48:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:41 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:48:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:42 smithi133 ceph-mon[125939]: pgmap v17474: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T12:48:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:42 smithi096 ceph-mon[124666]: pgmap v17474: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T12:48:43.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:42 smithi186 ceph-mon[126480]: pgmap v17474: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T12:48:44.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:43 smithi133 ceph-mon[125939]: pgmap v17475: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T12:48:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:43 smithi096 ceph-mon[124666]: pgmap v17475: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T12:48:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:43 smithi186 ceph-mon[126480]: pgmap v17475: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T12:48:45.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32663.315137 secs 2023-05-08T12:48:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32663.870507 secs 2023-05-08T12:48:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32663.315137 secs 2023-05-08T12:48:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32663.870507 secs 2023-05-08T12:48:45.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32663.315137 secs 2023-05-08T12:48:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32663.870507 secs 2023-05-08T12:48:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:45 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:48:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:45 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:48:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:48:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:48:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:48:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:45 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:48:46.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:48:46.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:45 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T12:48:46.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:45 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T12:48:46.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:45 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:48:46.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:45 smithi133 ceph-mon[125939]: pgmap v17476: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2023-05-08T12:48:46.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:45 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:48:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:45 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:48:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:48:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:48:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:48:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:45 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:48:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:48:46.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:45 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T12:48:46.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:45 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T12:48:46.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:45 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:48:46.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:45 smithi096 ceph-mon[124666]: pgmap v17476: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2023-05-08T12:48:46.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:45 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:48:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:45 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:48:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:48:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:48:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:48:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:45 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:48:46.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:48:46.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:45 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T12:48:46.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:45 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T12:48:46.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:45 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:48:46.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:45 smithi186 ceph-mon[126480]: pgmap v17476: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2023-05-08T12:48:47.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:47 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:48:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:47 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:48:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:47 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:48:48.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:48 smithi186 ceph-mon[126480]: pgmap v17477: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T12:48:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:48 smithi133 ceph-mon[125939]: pgmap v17477: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T12:48:49.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:48 smithi096 ceph-mon[124666]: pgmap v17477: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T12:48:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32668.315203 secs 2023-05-08T12:48:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:48:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32668.315203 secs 2023-05-08T12:48:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:48:50.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32668.315203 secs 2023-05-08T12:48:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:48:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:48:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:48:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:50 smithi186 ceph-mon[126480]: pgmap v17478: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.0 MiB/s wr, 16 op/s 2023-05-08T12:48:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:48:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:48:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:50 smithi133 ceph-mon[125939]: pgmap v17478: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.0 MiB/s wr, 16 op/s 2023-05-08T12:48:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:48:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:48:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:50 smithi096 ceph-mon[124666]: pgmap v17478: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.0 MiB/s wr, 16 op/s 2023-05-08T12:48:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32670.161743 secs 2023-05-08T12:48:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32670.161743 secs 2023-05-08T12:48:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32670.161743 secs 2023-05-08T12:48:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:52 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:48:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:52 smithi186 ceph-mon[126480]: pgmap v17479: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 11 op/s 2023-05-08T12:48:52.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:52 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:48:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:52 smithi133 ceph-mon[125939]: pgmap v17479: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 11 op/s 2023-05-08T12:48:53.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:52 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:48:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:52 smithi096 ceph-mon[124666]: pgmap v17479: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 11 op/s 2023-05-08T12:48:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:48:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:48:54.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:48:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:48:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:48:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:48:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32673.315330 secs 2023-05-08T12:48:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:54 smithi133 ceph-mon[125939]: pgmap v17480: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 11 op/s 2023-05-08T12:48:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32673.870706 secs 2023-05-08T12:48:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32673.315330 secs 2023-05-08T12:48:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:54 smithi096 ceph-mon[124666]: pgmap v17480: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 11 op/s 2023-05-08T12:48:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32673.870706 secs 2023-05-08T12:48:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32673.315330 secs 2023-05-08T12:48:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:54 smithi186 ceph-mon[126480]: pgmap v17480: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 11 op/s 2023-05-08T12:48:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32673.870706 secs 2023-05-08T12:48:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32675.161841 secs 2023-05-08T12:48:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:55 smithi186 ceph-mon[126480]: pgmap v17481: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.1 MiB/s wr, 18 op/s 2023-05-08T12:48:56.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32675.161841 secs 2023-05-08T12:48:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:55 smithi133 ceph-mon[125939]: pgmap v17481: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.1 MiB/s wr, 18 op/s 2023-05-08T12:48:56.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32675.161841 secs 2023-05-08T12:48:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:55 smithi096 ceph-mon[124666]: pgmap v17481: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.1 MiB/s wr, 18 op/s 2023-05-08T12:48:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:56 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:48:57.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:56 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:48:57.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:56 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:48:58.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:57 smithi133 ceph-mon[125939]: pgmap v17482: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 13 op/s 2023-05-08T12:48:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:57 smithi096 ceph-mon[124666]: pgmap v17482: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 13 op/s 2023-05-08T12:48:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:57 smithi186 ceph-mon[126480]: pgmap v17482: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 13 op/s 2023-05-08T12:48:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:48:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32678.315431 secs 2023-05-08T12:48:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:48:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32678.315431 secs 2023-05-08T12:48:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:48:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32678.315431 secs 2023-05-08T12:49:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:00 smithi133 ceph-mon[125939]: pgmap v17483: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 19 op/s 2023-05-08T12:49:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:00 smithi096 ceph-mon[124666]: pgmap v17483: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 19 op/s 2023-05-08T12:49:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:00 smithi186 ceph-mon[126480]: pgmap v17483: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 19 op/s 2023-05-08T12:49:01.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32680.161960 secs 2023-05-08T12:49:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:01 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:49:01.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32680.161960 secs 2023-05-08T12:49:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:01 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:49:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32680.161960 secs 2023-05-08T12:49:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:01 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:49:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:49:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:49:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:02 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:49:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:02 smithi133 ceph-mon[125939]: pgmap v17484: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 12 op/s 2023-05-08T12:49:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:49:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:49:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:02 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:49:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:02 smithi096 ceph-mon[124666]: pgmap v17484: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 12 op/s 2023-05-08T12:49:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:49:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:49:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:02 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:49:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:02 smithi186 ceph-mon[126480]: pgmap v17484: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 12 op/s 2023-05-08T12:49:04.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:03 smithi133 ceph-mon[125939]: pgmap v17485: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 12 op/s 2023-05-08T12:49:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:03 smithi096 ceph-mon[124666]: pgmap v17485: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 12 op/s 2023-05-08T12:49:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:03 smithi186 ceph-mon[126480]: pgmap v17485: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 12 op/s 2023-05-08T12:49:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32683.315555 secs 2023-05-08T12:49:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32683.870930 secs 2023-05-08T12:49:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32683.315555 secs 2023-05-08T12:49:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32683.870930 secs 2023-05-08T12:49:05.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32683.315555 secs 2023-05-08T12:49:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32683.870930 secs 2023-05-08T12:49:06.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:49:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:49:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32685.162046 secs 2023-05-08T12:49:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:05 smithi133 ceph-mon[125939]: pgmap v17486: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 32 op/s 2023-05-08T12:49:06.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:49:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:49:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32685.162046 secs 2023-05-08T12:49:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:05 smithi096 ceph-mon[124666]: pgmap v17486: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 32 op/s 2023-05-08T12:49:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:49:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:49:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32685.162046 secs 2023-05-08T12:49:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:05 smithi186 ceph-mon[126480]: pgmap v17486: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 32 op/s 2023-05-08T12:49:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:06 smithi133 ceph-mon[125939]: osdmap e1170: 12 total, 12 up, 12 in 2023-05-08T12:49:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:06 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:49:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:06 smithi096 ceph-mon[124666]: osdmap e1170: 12 total, 12 up, 12 in 2023-05-08T12:49:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:06 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:49:07.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:06 smithi186 ceph-mon[126480]: osdmap e1170: 12 total, 12 up, 12 in 2023-05-08T12:49:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:06 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:49:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:07 smithi133 ceph-mon[125939]: pgmap v17488: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.4 MiB/s wr, 30 op/s 2023-05-08T12:49:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:07 smithi096 ceph-mon[124666]: pgmap v17488: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.4 MiB/s wr, 30 op/s 2023-05-08T12:49:08.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:07 smithi186 ceph-mon[126480]: pgmap v17488: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.4 MiB/s wr, 30 op/s 2023-05-08T12:49:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32688.315675 secs 2023-05-08T12:49:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32688.315675 secs 2023-05-08T12:49:09.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32688.315675 secs 2023-05-08T12:49:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32688.871052 secs 2023-05-08T12:49:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:10 smithi133 ceph-mon[125939]: pgmap v17489: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 703 KiB/s rd, 1.0 MiB/s wr, 27 op/s 2023-05-08T12:49:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32688.871052 secs 2023-05-08T12:49:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:10 smithi096 ceph-mon[124666]: pgmap v17489: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 703 KiB/s rd, 1.0 MiB/s wr, 27 op/s 2023-05-08T12:49:10.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32688.871052 secs 2023-05-08T12:49:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:10 smithi186 ceph-mon[126480]: pgmap v17489: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 703 KiB/s rd, 1.0 MiB/s wr, 27 op/s 2023-05-08T12:49:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32690.162173 secs 2023-05-08T12:49:11.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32690.162173 secs 2023-05-08T12:49:11.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32690.162173 secs 2023-05-08T12:49:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:12 smithi133 ceph-mon[125939]: pgmap v17490: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1016 KiB/s rd, 1.1 MiB/s wr, 28 op/s 2023-05-08T12:49:13.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:12 smithi096 ceph-mon[124666]: pgmap v17490: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1016 KiB/s rd, 1.1 MiB/s wr, 28 op/s 2023-05-08T12:49:13.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:12 smithi186 ceph-mon[126480]: pgmap v17490: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1016 KiB/s rd, 1.1 MiB/s wr, 28 op/s 2023-05-08T12:49:14.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:13 smithi133 ceph-mon[125939]: pgmap v17491: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1016 KiB/s rd, 1.1 MiB/s wr, 28 op/s 2023-05-08T12:49:14.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:13 smithi096 ceph-mon[124666]: pgmap v17491: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1016 KiB/s rd, 1.1 MiB/s wr, 28 op/s 2023-05-08T12:49:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:13 smithi186 ceph-mon[126480]: pgmap v17491: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1016 KiB/s rd, 1.1 MiB/s wr, 28 op/s 2023-05-08T12:49:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32693.315799 secs 2023-05-08T12:49:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32693.871163 secs 2023-05-08T12:49:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32693.315799 secs 2023-05-08T12:49:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32693.871163 secs 2023-05-08T12:49:15.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32693.315799 secs 2023-05-08T12:49:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32693.871163 secs 2023-05-08T12:49:16.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32695.162266 secs 2023-05-08T12:49:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:15 smithi133 ceph-mon[125939]: pgmap v17492: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 630 KiB/s rd, 314 KiB/s wr, 8 op/s 2023-05-08T12:49:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32695.162266 secs 2023-05-08T12:49:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:15 smithi096 ceph-mon[124666]: pgmap v17492: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 630 KiB/s rd, 314 KiB/s wr, 8 op/s 2023-05-08T12:49:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32695.162266 secs 2023-05-08T12:49:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:15 smithi186 ceph-mon[126480]: pgmap v17492: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 630 KiB/s rd, 314 KiB/s wr, 8 op/s 2023-05-08T12:49:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:17 smithi133 ceph-mon[125939]: osdmap e1171: 12 total, 12 up, 12 in 2023-05-08T12:49:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:17 smithi096 ceph-mon[124666]: osdmap e1171: 12 total, 12 up, 12 in 2023-05-08T12:49:18.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:17 smithi186 ceph-mon[126480]: osdmap e1171: 12 total, 12 up, 12 in 2023-05-08T12:49:18.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:18 smithi133 ceph-mon[125939]: pgmap v17494: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 630 KiB/s rd, 314 KiB/s wr, 8 op/s 2023-05-08T12:49:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:18 smithi096 ceph-mon[124666]: pgmap v17494: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 630 KiB/s rd, 314 KiB/s wr, 8 op/s 2023-05-08T12:49:19.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:18 smithi186 ceph-mon[126480]: pgmap v17494: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 630 KiB/s rd, 314 KiB/s wr, 8 op/s 2023-05-08T12:49:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32698.315917 secs 2023-05-08T12:49:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32698.871290 secs 2023-05-08T12:49:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32698.315917 secs 2023-05-08T12:49:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32698.871290 secs 2023-05-08T12:49:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32698.315917 secs 2023-05-08T12:49:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32698.871290 secs 2023-05-08T12:49:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:20 smithi133 ceph-mon[125939]: pgmap v17495: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 650 KiB/s rd, 340 KiB/s wr, 9 op/s 2023-05-08T12:49:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:20 smithi096 ceph-mon[124666]: pgmap v17495: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 650 KiB/s rd, 340 KiB/s wr, 9 op/s 2023-05-08T12:49:21.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:20 smithi186 ceph-mon[126480]: pgmap v17495: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 650 KiB/s rd, 340 KiB/s wr, 9 op/s 2023-05-08T12:49:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32700.162390 secs 2023-05-08T12:49:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32700.162390 secs 2023-05-08T12:49:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32700.162390 secs 2023-05-08T12:49:22.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:22 smithi133 ceph-mon[125939]: pgmap v17496: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 272 KiB/s wr, 8 op/s 2023-05-08T12:49:23.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:22 smithi096 ceph-mon[124666]: pgmap v17496: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 272 KiB/s wr, 8 op/s 2023-05-08T12:49:23.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:22 smithi186 ceph-mon[126480]: pgmap v17496: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 272 KiB/s wr, 8 op/s 2023-05-08T12:49:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:23 smithi133 ceph-mon[125939]: pgmap v17497: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 272 KiB/s wr, 8 op/s 2023-05-08T12:49:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:23 smithi096 ceph-mon[124666]: pgmap v17497: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 272 KiB/s wr, 8 op/s 2023-05-08T12:49:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:23 smithi186 ceph-mon[126480]: pgmap v17497: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 272 KiB/s wr, 8 op/s 2023-05-08T12:49:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32703.316013 secs 2023-05-08T12:49:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32703.871399 secs 2023-05-08T12:49:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32703.316013 secs 2023-05-08T12:49:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32703.871399 secs 2023-05-08T12:49:25.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32703.316013 secs 2023-05-08T12:49:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32703.871399 secs 2023-05-08T12:49:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32705.162527 secs 2023-05-08T12:49:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:25 smithi133 ceph-mon[125939]: pgmap v17498: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 188 KiB/s wr, 9 op/s 2023-05-08T12:49:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32705.162527 secs 2023-05-08T12:49:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:25 smithi096 ceph-mon[124666]: pgmap v17498: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 188 KiB/s wr, 9 op/s 2023-05-08T12:49:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32705.162527 secs 2023-05-08T12:49:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:25 smithi186 ceph-mon[126480]: pgmap v17498: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 188 KiB/s wr, 9 op/s 2023-05-08T12:49:28.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:27 smithi133 ceph-mon[125939]: pgmap v17499: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 168 KiB/s wr, 8 op/s 2023-05-08T12:49:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:27 smithi096 ceph-mon[124666]: pgmap v17499: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 168 KiB/s wr, 8 op/s 2023-05-08T12:49:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:27 smithi186 ceph-mon[126480]: pgmap v17499: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 168 KiB/s wr, 8 op/s 2023-05-08T12:49:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32708.316128 secs 2023-05-08T12:49:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32708.316128 secs 2023-05-08T12:49:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32708.316128 secs 2023-05-08T12:49:30.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32708.871542 secs 2023-05-08T12:49:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:30 smithi133 ceph-mon[125939]: pgmap v17500: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 288 KiB/s wr, 12 op/s 2023-05-08T12:49:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32708.871542 secs 2023-05-08T12:49:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:30 smithi096 ceph-mon[124666]: pgmap v17500: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 288 KiB/s wr, 12 op/s 2023-05-08T12:49:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32708.871542 secs 2023-05-08T12:49:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:30 smithi186 ceph-mon[126480]: pgmap v17500: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 288 KiB/s wr, 12 op/s 2023-05-08T12:49:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32710.162647 secs 2023-05-08T12:49:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32710.162647 secs 2023-05-08T12:49:31.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32710.162647 secs 2023-05-08T12:49:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:32 smithi133 ceph-mon[125939]: pgmap v17501: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 265 KiB/s wr, 8 op/s 2023-05-08T12:49:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:32 smithi096 ceph-mon[124666]: pgmap v17501: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 265 KiB/s wr, 8 op/s 2023-05-08T12:49:33.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:32 smithi186 ceph-mon[126480]: pgmap v17501: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 265 KiB/s wr, 8 op/s 2023-05-08T12:49:34.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:33 smithi133 ceph-mon[125939]: pgmap v17502: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 265 KiB/s wr, 8 op/s 2023-05-08T12:49:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:33 smithi096 ceph-mon[124666]: pgmap v17502: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 265 KiB/s wr, 8 op/s 2023-05-08T12:49:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:33 smithi186 ceph-mon[126480]: pgmap v17502: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 265 KiB/s wr, 8 op/s 2023-05-08T12:49:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32713.316242 secs 2023-05-08T12:49:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32713.871643 secs 2023-05-08T12:49:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32713.316242 secs 2023-05-08T12:49:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32713.871643 secs 2023-05-08T12:49:35.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32713.316242 secs 2023-05-08T12:49:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32713.871643 secs 2023-05-08T12:49:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32715.162785 secs 2023-05-08T12:49:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:35 smithi133 ceph-mon[125939]: pgmap v17503: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 290 KiB/s rd, 266 KiB/s wr, 12 op/s 2023-05-08T12:49:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32715.162785 secs 2023-05-08T12:49:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:35 smithi096 ceph-mon[124666]: pgmap v17503: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 290 KiB/s rd, 266 KiB/s wr, 12 op/s 2023-05-08T12:49:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32715.162785 secs 2023-05-08T12:49:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:35 smithi186 ceph-mon[126480]: pgmap v17503: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 290 KiB/s rd, 266 KiB/s wr, 12 op/s 2023-05-08T12:49:38.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:37 smithi133 ceph-mon[125939]: pgmap v17504: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 132 KiB/s wr, 7 op/s 2023-05-08T12:49:38.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:37 smithi096 ceph-mon[124666]: pgmap v17504: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 132 KiB/s wr, 7 op/s 2023-05-08T12:49:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:37 smithi186 ceph-mon[126480]: pgmap v17504: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 132 KiB/s wr, 7 op/s 2023-05-08T12:49:39.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32718.316411 secs 2023-05-08T12:49:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32718.316411 secs 2023-05-08T12:49:39.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32718.316411 secs 2023-05-08T12:49:40.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32718.871727 secs 2023-05-08T12:49:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:40 smithi133 ceph-mon[125939]: pgmap v17505: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 132 KiB/s wr, 11 op/s 2023-05-08T12:49:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32718.871727 secs 2023-05-08T12:49:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:40 smithi096 ceph-mon[124666]: pgmap v17505: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 132 KiB/s wr, 11 op/s 2023-05-08T12:49:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32718.871727 secs 2023-05-08T12:49:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:40 smithi186 ceph-mon[126480]: pgmap v17505: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 132 KiB/s wr, 11 op/s 2023-05-08T12:49:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32720.162905 secs 2023-05-08T12:49:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32720.162905 secs 2023-05-08T12:49:41.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32720.162905 secs 2023-05-08T12:49:42.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:42 smithi133 ceph-mon[125939]: pgmap v17506: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 7 op/s 2023-05-08T12:49:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:42 smithi096 ceph-mon[124666]: pgmap v17506: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 7 op/s 2023-05-08T12:49:43.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:42 smithi186 ceph-mon[126480]: pgmap v17506: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 7 op/s 2023-05-08T12:49:44.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:43 smithi133 ceph-mon[125939]: pgmap v17507: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 7 op/s 2023-05-08T12:49:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:43 smithi096 ceph-mon[124666]: pgmap v17507: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 7 op/s 2023-05-08T12:49:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:43 smithi186 ceph-mon[126480]: pgmap v17507: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 7 op/s 2023-05-08T12:49:45.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32723.316523 secs 2023-05-08T12:49:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32723.871820 secs 2023-05-08T12:49:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32723.316523 secs 2023-05-08T12:49:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32723.871820 secs 2023-05-08T12:49:45.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32723.316523 secs 2023-05-08T12:49:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32723.871820 secs 2023-05-08T12:49:46.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:49:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:45 smithi133 ceph-mon[125939]: pgmap v17508: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 245 KiB/s wr, 10 op/s 2023-05-08T12:49:46.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:49:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:45 smithi096 ceph-mon[124666]: pgmap v17508: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 245 KiB/s wr, 10 op/s 2023-05-08T12:49:46.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:49:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:45 smithi186 ceph-mon[126480]: pgmap v17508: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 245 KiB/s wr, 10 op/s 2023-05-08T12:49:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:46 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:49:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:46 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:49:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:46 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:49:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:46 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:49:47.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:46 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T12:49:47.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:46 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T12:49:47.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:46 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:49:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:46 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:49:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:46 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:49:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:46 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:49:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:46 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:49:47.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:46 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T12:49:47.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:46 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T12:49:47.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:46 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:49:47.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:46 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:49:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:46 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:49:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:46 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:49:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:46 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:49:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:46 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T12:49:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:46 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T12:49:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:46 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:49:48.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:47 smithi133 ceph-mon[125939]: pgmap v17509: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 245 KiB/s wr, 6 op/s 2023-05-08T12:49:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:47 smithi096 ceph-mon[124666]: pgmap v17509: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 245 KiB/s wr, 6 op/s 2023-05-08T12:49:48.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:47 smithi186 ceph-mon[126480]: pgmap v17509: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 245 KiB/s wr, 6 op/s 2023-05-08T12:49:49.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:49:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:49:49.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:49:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32728.316612 secs 2023-05-08T12:49:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:49:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:49:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:49:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32728.871941 secs 2023-05-08T12:49:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:49 smithi133 ceph-mon[125939]: pgmap v17510: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 267 KiB/s wr, 10 op/s 2023-05-08T12:49:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32728.316612 secs 2023-05-08T12:49:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:49:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:49:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:49:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32728.871941 secs 2023-05-08T12:49:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:49 smithi096 ceph-mon[124666]: pgmap v17510: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 267 KiB/s wr, 10 op/s 2023-05-08T12:49:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32728.316612 secs 2023-05-08T12:49:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:49:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:49:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:49:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32728.871941 secs 2023-05-08T12:49:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:49 smithi186 ceph-mon[126480]: pgmap v17510: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 267 KiB/s wr, 10 op/s 2023-05-08T12:49:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:52 smithi133 ceph-mon[125939]: pgmap v17511: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 502 KiB/s rd, 267 KiB/s wr, 7 op/s 2023-05-08T12:49:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:52 smithi096 ceph-mon[124666]: pgmap v17511: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 502 KiB/s rd, 267 KiB/s wr, 7 op/s 2023-05-08T12:49:53.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:52 smithi186 ceph-mon[126480]: pgmap v17511: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 502 KiB/s rd, 267 KiB/s wr, 7 op/s 2023-05-08T12:49:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:53 smithi133 ceph-mon[125939]: pgmap v17512: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 502 KiB/s rd, 267 KiB/s wr, 7 op/s 2023-05-08T12:49:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:53 smithi096 ceph-mon[124666]: pgmap v17512: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 502 KiB/s rd, 267 KiB/s wr, 7 op/s 2023-05-08T12:49:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:53 smithi186 ceph-mon[126480]: pgmap v17512: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 502 KiB/s rd, 267 KiB/s wr, 7 op/s 2023-05-08T12:49:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32733.316710 secs 2023-05-08T12:49:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32733.316710 secs 2023-05-08T12:49:55.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32733.316710 secs 2023-05-08T12:49:56.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:55 smithi133 ceph-mon[125939]: pgmap v17513: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 817 KiB/s wr, 11 op/s 2023-05-08T12:49:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:55 smithi096 ceph-mon[124666]: pgmap v17513: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 817 KiB/s wr, 11 op/s 2023-05-08T12:49:56.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:55 smithi186 ceph-mon[126480]: pgmap v17513: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 817 KiB/s wr, 11 op/s 2023-05-08T12:49:57.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:49:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:49:57.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:49:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:57 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:49:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:49:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:49:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:57 smithi133 ceph-mon[125939]: pgmap v17514: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 807 KiB/s rd, 572 KiB/s wr, 8 op/s 2023-05-08T12:49:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:57 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:49:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:49:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:49:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:57 smithi096 ceph-mon[124666]: pgmap v17514: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 807 KiB/s rd, 572 KiB/s wr, 8 op/s 2023-05-08T12:49:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:57 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:49:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:49:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:49:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:57 smithi186 ceph-mon[126480]: pgmap v17514: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 807 KiB/s rd, 572 KiB/s wr, 8 op/s 2023-05-08T12:49:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:49:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32738.316813 secs 2023-05-08T12:49:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:49:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32738.316813 secs 2023-05-08T12:49:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:49:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32738.316813 secs 2023-05-08T12:50:00.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:00 smithi133 ceph-mon[125939]: pgmap v17515: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.0 MiB/s wr, 13 op/s 2023-05-08T12:50:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:00 smithi133 ceph-mon[125939]: overall HEALTH_WARN 1 MDSs report slow requests 2023-05-08T12:50:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:00 smithi096 ceph-mon[124666]: pgmap v17515: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.0 MiB/s wr, 13 op/s 2023-05-08T12:50:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:00 smithi096 ceph-mon[124666]: overall HEALTH_WARN 1 MDSs report slow requests 2023-05-08T12:50:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:00 smithi186 ceph-mon[126480]: pgmap v17515: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.0 MiB/s wr, 13 op/s 2023-05-08T12:50:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:00 smithi186 ceph-mon[126480]: overall HEALTH_WARN 1 MDSs report slow requests 2023-05-08T12:50:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32740.163343 secs 2023-05-08T12:50:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32740.163343 secs 2023-05-08T12:50:01.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32740.163343 secs 2023-05-08T12:50:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:50:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:50:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:02 smithi133 ceph-mon[125939]: pgmap v17516: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 9 op/s 2023-05-08T12:50:02.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:50:02.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:50:02.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:02 smithi096 ceph-mon[124666]: pgmap v17516: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 9 op/s 2023-05-08T12:50:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:50:02.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:50:02.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:02 smithi186 ceph-mon[126480]: pgmap v17516: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 9 op/s 2023-05-08T12:50:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:03 smithi133 ceph-mon[125939]: pgmap v17517: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 9 op/s 2023-05-08T12:50:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:03 smithi096 ceph-mon[124666]: pgmap v17517: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 9 op/s 2023-05-08T12:50:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:03 smithi186 ceph-mon[126480]: pgmap v17517: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 9 op/s 2023-05-08T12:50:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32743.316978 secs 2023-05-08T12:50:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32743.872321 secs 2023-05-08T12:50:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32743.316978 secs 2023-05-08T12:50:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32743.872321 secs 2023-05-08T12:50:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32743.316978 secs 2023-05-08T12:50:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32743.872321 secs 2023-05-08T12:50:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:05 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:50:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:50:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:50:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:05 smithi133 ceph-mon[125939]: pgmap v17518: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.4 MiB/s wr, 27 op/s 2023-05-08T12:50:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:05 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:50:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:50:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:50:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:05 smithi096 ceph-mon[124666]: pgmap v17518: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.4 MiB/s wr, 27 op/s 2023-05-08T12:50:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:05 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:50:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:50:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:50:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:05 smithi186 ceph-mon[126480]: pgmap v17518: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.4 MiB/s wr, 27 op/s 2023-05-08T12:50:08.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:07 smithi133 ceph-mon[125939]: pgmap v17519: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 853 KiB/s wr, 22 op/s 2023-05-08T12:50:08.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:07 smithi096 ceph-mon[124666]: pgmap v17519: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 853 KiB/s wr, 22 op/s 2023-05-08T12:50:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:07 smithi186 ceph-mon[126480]: pgmap v17519: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 853 KiB/s wr, 22 op/s 2023-05-08T12:50:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:08 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:50:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:08 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:50:09.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:08 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:50:10.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32748.317112 secs 2023-05-08T12:50:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:50:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:50:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32748.872389 secs 2023-05-08T12:50:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:09 smithi133 ceph-mon[125939]: pgmap v17520: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 983 KiB/s wr, 27 op/s 2023-05-08T12:50:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32748.317112 secs 2023-05-08T12:50:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:50:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:50:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32748.872389 secs 2023-05-08T12:50:10.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:09 smithi096 ceph-mon[124666]: pgmap v17520: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 983 KiB/s wr, 27 op/s 2023-05-08T12:50:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32748.317112 secs 2023-05-08T12:50:10.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:50:10.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:50:10.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32748.872389 secs 2023-05-08T12:50:10.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:09 smithi186 ceph-mon[126480]: pgmap v17520: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 983 KiB/s wr, 27 op/s 2023-05-08T12:50:11.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:11 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:50:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:11 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:50:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:11 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:50:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:12 smithi133 ceph-mon[125939]: pgmap v17521: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 509 KiB/s wr, 21 op/s 2023-05-08T12:50:13.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:12 smithi096 ceph-mon[124666]: pgmap v17521: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 509 KiB/s wr, 21 op/s 2023-05-08T12:50:13.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:12 smithi186 ceph-mon[126480]: pgmap v17521: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 509 KiB/s wr, 21 op/s 2023-05-08T12:50:14.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:13 smithi133 ceph-mon[125939]: pgmap v17522: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 509 KiB/s wr, 21 op/s 2023-05-08T12:50:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:13 smithi096 ceph-mon[124666]: pgmap v17522: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 509 KiB/s wr, 21 op/s 2023-05-08T12:50:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:13 smithi186 ceph-mon[126480]: pgmap v17522: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 509 KiB/s wr, 21 op/s 2023-05-08T12:50:15.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32753.317234 secs 2023-05-08T12:50:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32753.872494 secs 2023-05-08T12:50:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32753.317234 secs 2023-05-08T12:50:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32753.872494 secs 2023-05-08T12:50:15.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32753.317234 secs 2023-05-08T12:50:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32753.872494 secs 2023-05-08T12:50:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:15 smithi133 ceph-mon[125939]: pgmap v17523: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 885 KiB/s rd, 793 KiB/s wr, 26 op/s 2023-05-08T12:50:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:15 smithi096 ceph-mon[124666]: pgmap v17523: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 885 KiB/s rd, 793 KiB/s wr, 26 op/s 2023-05-08T12:50:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:15 smithi186 ceph-mon[126480]: pgmap v17523: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 885 KiB/s rd, 793 KiB/s wr, 26 op/s 2023-05-08T12:50:18.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:17 smithi133 ceph-mon[125939]: pgmap v17524: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 413 KiB/s wr, 8 op/s 2023-05-08T12:50:18.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:17 smithi096 ceph-mon[124666]: pgmap v17524: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 413 KiB/s wr, 8 op/s 2023-05-08T12:50:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:17 smithi186 ceph-mon[126480]: pgmap v17524: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 413 KiB/s wr, 8 op/s 2023-05-08T12:50:19.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32758.317364 secs 2023-05-08T12:50:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32758.317364 secs 2023-05-08T12:50:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32758.317364 secs 2023-05-08T12:50:20.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32758.872638 secs 2023-05-08T12:50:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:20 smithi133 ceph-mon[125939]: pgmap v17525: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 521 KiB/s rd, 414 KiB/s wr, 12 op/s 2023-05-08T12:50:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32758.872638 secs 2023-05-08T12:50:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:20 smithi096 ceph-mon[124666]: pgmap v17525: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 521 KiB/s rd, 414 KiB/s wr, 12 op/s 2023-05-08T12:50:20.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32758.872638 secs 2023-05-08T12:50:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:20 smithi186 ceph-mon[126480]: pgmap v17525: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 521 KiB/s rd, 414 KiB/s wr, 12 op/s 2023-05-08T12:50:22.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:22 smithi133 ceph-mon[125939]: pgmap v17526: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 284 KiB/s wr, 7 op/s 2023-05-08T12:50:23.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:22 smithi096 ceph-mon[124666]: pgmap v17526: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 284 KiB/s wr, 7 op/s 2023-05-08T12:50:23.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:22 smithi186 ceph-mon[126480]: pgmap v17526: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 284 KiB/s wr, 7 op/s 2023-05-08T12:50:24.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:23 smithi133 ceph-mon[125939]: pgmap v17527: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 284 KiB/s wr, 7 op/s 2023-05-08T12:50:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:23 smithi096 ceph-mon[124666]: pgmap v17527: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 284 KiB/s wr, 7 op/s 2023-05-08T12:50:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:23 smithi186 ceph-mon[126480]: pgmap v17527: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 284 KiB/s wr, 7 op/s 2023-05-08T12:50:25.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32763.317477 secs 2023-05-08T12:50:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:24 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:50:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32763.317477 secs 2023-05-08T12:50:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:24 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:50:25.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32763.317477 secs 2023-05-08T12:50:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:24 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:50:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:25 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:50:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:25 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:50:26.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:25 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:50:26.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:25 smithi133 ceph-mon[125939]: pgmap v17528: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 995 KiB/s rd, 888 KiB/s wr, 14 op/s 2023-05-08T12:50:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:25 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:50:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:25 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:50:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:25 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:50:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:25 smithi096 ceph-mon[124666]: pgmap v17528: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 995 KiB/s rd, 888 KiB/s wr, 14 op/s 2023-05-08T12:50:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:25 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:50:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:25 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:50:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:25 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:50:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:25 smithi186 ceph-mon[126480]: pgmap v17528: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 995 KiB/s rd, 888 KiB/s wr, 14 op/s 2023-05-08T12:50:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:27 smithi133 ceph-mon[125939]: pgmap v17529: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 584 KiB/s rd, 604 KiB/s wr, 10 op/s 2023-05-08T12:50:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:27 smithi096 ceph-mon[124666]: pgmap v17529: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 584 KiB/s rd, 604 KiB/s wr, 10 op/s 2023-05-08T12:50:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:27 smithi186 ceph-mon[126480]: pgmap v17529: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 584 KiB/s rd, 604 KiB/s wr, 10 op/s 2023-05-08T12:50:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32768.317564 secs 2023-05-08T12:50:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32768.317564 secs 2023-05-08T12:50:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32768.317564 secs 2023-05-08T12:50:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:30 smithi133 ceph-mon[125939]: pgmap v17530: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 629 KiB/s wr, 13 op/s 2023-05-08T12:50:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:30 smithi096 ceph-mon[124666]: pgmap v17530: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 629 KiB/s wr, 13 op/s 2023-05-08T12:50:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:30 smithi186 ceph-mon[126480]: pgmap v17530: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 629 KiB/s wr, 13 op/s 2023-05-08T12:50:32.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:32 smithi133 ceph-mon[125939]: osdmap e1172: 12 total, 12 up, 12 in 2023-05-08T12:50:32.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:32 smithi133 ceph-mon[125939]: pgmap v17532: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 705 KiB/s rd, 754 KiB/s wr, 12 op/s 2023-05-08T12:50:32.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:32 smithi096 ceph-mon[124666]: osdmap e1172: 12 total, 12 up, 12 in 2023-05-08T12:50:32.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:32 smithi096 ceph-mon[124666]: pgmap v17532: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 705 KiB/s rd, 754 KiB/s wr, 12 op/s 2023-05-08T12:50:32.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:32 smithi186 ceph-mon[126480]: osdmap e1172: 12 total, 12 up, 12 in 2023-05-08T12:50:32.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:32 smithi186 ceph-mon[126480]: pgmap v17532: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 705 KiB/s rd, 754 KiB/s wr, 12 op/s 2023-05-08T12:50:34.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:33 smithi133 ceph-mon[125939]: pgmap v17533: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 705 KiB/s rd, 754 KiB/s wr, 12 op/s 2023-05-08T12:50:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:33 smithi096 ceph-mon[124666]: pgmap v17533: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 705 KiB/s rd, 754 KiB/s wr, 12 op/s 2023-05-08T12:50:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:33 smithi186 ceph-mon[126480]: pgmap v17533: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 705 KiB/s rd, 754 KiB/s wr, 12 op/s 2023-05-08T12:50:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32773.317639 secs 2023-05-08T12:50:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32773.317639 secs 2023-05-08T12:50:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32773.317639 secs 2023-05-08T12:50:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:35 smithi133 ceph-mon[125939]: pgmap v17534: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 345 KiB/s wr, 8 op/s 2023-05-08T12:50:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:35 smithi096 ceph-mon[124666]: pgmap v17534: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 345 KiB/s wr, 8 op/s 2023-05-08T12:50:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:35 smithi186 ceph-mon[126480]: pgmap v17534: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 345 KiB/s wr, 8 op/s 2023-05-08T12:50:37.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:37 smithi133 ceph-mon[125939]: osdmap e1173: 12 total, 12 up, 12 in 2023-05-08T12:50:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:37 smithi096 ceph-mon[124666]: osdmap e1173: 12 total, 12 up, 12 in 2023-05-08T12:50:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:37 smithi186 ceph-mon[126480]: osdmap e1173: 12 total, 12 up, 12 in 2023-05-08T12:50:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:38 smithi133 ceph-mon[125939]: pgmap v17536: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 427 KiB/s rd, 394 KiB/s wr, 5 op/s 2023-05-08T12:50:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:38 smithi096 ceph-mon[124666]: pgmap v17536: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 427 KiB/s rd, 394 KiB/s wr, 5 op/s 2023-05-08T12:50:39.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:38 smithi186 ceph-mon[126480]: pgmap v17536: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 427 KiB/s rd, 394 KiB/s wr, 5 op/s 2023-05-08T12:50:39.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32778.317787 secs 2023-05-08T12:50:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32778.317787 secs 2023-05-08T12:50:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32778.317787 secs 2023-05-08T12:50:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:40 smithi133 ceph-mon[125939]: pgmap v17537: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 363 KiB/s wr, 9 op/s 2023-05-08T12:50:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:40 smithi096 ceph-mon[124666]: pgmap v17537: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 363 KiB/s wr, 9 op/s 2023-05-08T12:50:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:40 smithi186 ceph-mon[126480]: pgmap v17537: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 363 KiB/s wr, 9 op/s 2023-05-08T12:50:41.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32780.164210 secs 2023-05-08T12:50:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:41 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:50:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:41 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:50:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:41 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:50:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32780.164210 secs 2023-05-08T12:50:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:41 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:50:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:41 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:50:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:41 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:50:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32780.164210 secs 2023-05-08T12:50:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:41 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:50:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:41 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:50:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:41 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:50:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:42 smithi133 ceph-mon[125939]: pgmap v17538: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 315 KiB/s wr, 8 op/s 2023-05-08T12:50:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:42 smithi096 ceph-mon[124666]: pgmap v17538: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 315 KiB/s wr, 8 op/s 2023-05-08T12:50:43.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:42 smithi186 ceph-mon[126480]: pgmap v17538: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 315 KiB/s wr, 8 op/s 2023-05-08T12:50:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:43 smithi133 ceph-mon[125939]: pgmap v17539: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 315 KiB/s wr, 8 op/s 2023-05-08T12:50:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:43 smithi096 ceph-mon[124666]: pgmap v17539: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 315 KiB/s wr, 8 op/s 2023-05-08T12:50:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:43 smithi186 ceph-mon[126480]: pgmap v17539: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 315 KiB/s wr, 8 op/s 2023-05-08T12:50:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32783.317930 secs 2023-05-08T12:50:45.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32783.873173 secs 2023-05-08T12:50:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32783.317930 secs 2023-05-08T12:50:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32783.873173 secs 2023-05-08T12:50:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32783.317930 secs 2023-05-08T12:50:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32783.873173 secs 2023-05-08T12:50:46.244 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:45 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:50:46.244 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:45 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:50:46.244 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:45 smithi133 ceph-mon[125939]: pgmap v17540: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 978 KiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T12:50:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:45 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:50:46.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:45 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:50:46.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:45 smithi096 ceph-mon[124666]: pgmap v17540: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 978 KiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T12:50:46.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:45 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:50:46.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:45 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:50:46.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:45 smithi186 ceph-mon[126480]: pgmap v17540: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 978 KiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T12:50:47.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:46 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:50:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:46 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:50:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:46 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:50:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:46 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:50:47.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:46 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:50:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:46 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:50:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:47 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:50:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:47 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:50:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:47 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:50:48.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:47 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:50:48.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:47 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T12:50:48.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:47 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T12:50:48.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:47 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:50:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:47 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:50:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:47 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:50:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:47 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:50:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:47 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:50:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:47 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T12:50:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:47 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T12:50:48.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:47 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:50:48.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:47 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:50:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:47 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:50:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:47 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:50:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:47 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:50:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:47 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T12:50:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:47 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T12:50:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:47 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:50:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:48 smithi133 ceph-mon[125939]: pgmap v17541: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 876 KiB/s rd, 927 KiB/s wr, 9 op/s 2023-05-08T12:50:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:50:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:48 smithi096 ceph-mon[124666]: pgmap v17541: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 876 KiB/s rd, 927 KiB/s wr, 9 op/s 2023-05-08T12:50:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:50:49.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:48 smithi186 ceph-mon[126480]: pgmap v17541: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 876 KiB/s rd, 927 KiB/s wr, 9 op/s 2023-05-08T12:50:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:50:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32788.318049 secs 2023-05-08T12:50:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:50:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:50:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32788.318049 secs 2023-05-08T12:50:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:50:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:50:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32788.318049 secs 2023-05-08T12:50:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:50:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:50:51.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:51 smithi133 ceph-mon[125939]: pgmap v17542: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 14 op/s 2023-05-08T12:50:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:51 smithi096 ceph-mon[124666]: pgmap v17542: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 14 op/s 2023-05-08T12:50:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:51 smithi186 ceph-mon[126480]: pgmap v17542: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 14 op/s 2023-05-08T12:50:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:52 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:50:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:52 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:50:52.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:52 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:50:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:53 smithi133 ceph-mon[125939]: pgmap v17543: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 10 op/s 2023-05-08T12:50:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:53 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:50:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:53 smithi096 ceph-mon[124666]: pgmap v17543: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 10 op/s 2023-05-08T12:50:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:53 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:50:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:53 smithi186 ceph-mon[126480]: pgmap v17543: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 10 op/s 2023-05-08T12:50:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:53 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:50:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:54 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:50:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:54 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:50:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32793.318162 secs 2023-05-08T12:50:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:54 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:50:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:54 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:50:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32793.318162 secs 2023-05-08T12:50:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:54 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:50:54.783 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:54 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:50:54.784 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32793.318162 secs 2023-05-08T12:50:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:55 smithi133 ceph-mon[125939]: pgmap v17544: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 10 op/s 2023-05-08T12:50:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:55 smithi096 ceph-mon[124666]: pgmap v17544: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 10 op/s 2023-05-08T12:50:55.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:55 smithi186 ceph-mon[126480]: pgmap v17544: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 10 op/s 2023-05-08T12:50:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32795.164600 secs 2023-05-08T12:50:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32795.164600 secs 2023-05-08T12:50:56.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32795.164600 secs 2023-05-08T12:50:57.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:57 smithi133 ceph-mon[125939]: pgmap v17545: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 17 op/s 2023-05-08T12:50:57.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:57 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:50:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:57 smithi096 ceph-mon[124666]: pgmap v17545: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 17 op/s 2023-05-08T12:50:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:57 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:50:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:57 smithi186 ceph-mon[126480]: pgmap v17545: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 17 op/s 2023-05-08T12:50:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:57 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:50:58.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:50:58.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:50:58.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:50:58.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:50:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:50:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:50:59.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:59 smithi133 ceph-mon[125939]: pgmap v17546: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T12:50:59.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:50:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32798.318280 secs 2023-05-08T12:50:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:59 smithi096 ceph-mon[124666]: pgmap v17546: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T12:50:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:50:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32798.318280 secs 2023-05-08T12:50:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:59 smithi186 ceph-mon[126480]: pgmap v17546: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T12:50:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:50:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32798.318280 secs 2023-05-08T12:51:00.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32798.873498 secs 2023-05-08T12:51:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32798.873498 secs 2023-05-08T12:51:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32798.873498 secs 2023-05-08T12:51:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:01 smithi133 ceph-mon[125939]: pgmap v17547: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 16 op/s 2023-05-08T12:51:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:01 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:51:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:01 smithi096 ceph-mon[124666]: pgmap v17547: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 16 op/s 2023-05-08T12:51:01.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:01 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:51:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:01 smithi186 ceph-mon[126480]: pgmap v17547: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 16 op/s 2023-05-08T12:51:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:01 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:51:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:51:02.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:51:02.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:51:02.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:02 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:51:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:51:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:51:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:51:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:02 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:51:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:51:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:51:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:51:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:02 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:51:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:03 smithi133 ceph-mon[125939]: pgmap v17548: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 788 KiB/s wr, 11 op/s 2023-05-08T12:51:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:03 smithi096 ceph-mon[124666]: pgmap v17548: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 788 KiB/s wr, 11 op/s 2023-05-08T12:51:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:03 smithi186 ceph-mon[126480]: pgmap v17548: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 788 KiB/s wr, 11 op/s 2023-05-08T12:51:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32803.318410 secs 2023-05-08T12:51:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32803.873615 secs 2023-05-08T12:51:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32803.318410 secs 2023-05-08T12:51:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32803.873615 secs 2023-05-08T12:51:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32803.318410 secs 2023-05-08T12:51:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32803.873615 secs 2023-05-08T12:51:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:05 smithi133 ceph-mon[125939]: pgmap v17549: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 788 KiB/s wr, 11 op/s 2023-05-08T12:51:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:05 smithi096 ceph-mon[124666]: pgmap v17549: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 788 KiB/s wr, 11 op/s 2023-05-08T12:51:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:05 smithi186 ceph-mon[126480]: pgmap v17549: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 788 KiB/s wr, 11 op/s 2023-05-08T12:51:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:07 smithi133 ceph-mon[125939]: pgmap v17550: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.2 MiB/s wr, 28 op/s 2023-05-08T12:51:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:07 smithi096 ceph-mon[124666]: pgmap v17550: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.2 MiB/s wr, 28 op/s 2023-05-08T12:51:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:07 smithi186 ceph-mon[126480]: pgmap v17550: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.2 MiB/s wr, 28 op/s 2023-05-08T12:51:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:09 smithi133 ceph-mon[125939]: pgmap v17551: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 799 KiB/s rd, 902 KiB/s wr, 21 op/s 2023-05-08T12:51:09.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32808.318512 secs 2023-05-08T12:51:09.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32808.873752 secs 2023-05-08T12:51:10.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:09 smithi096 ceph-mon[124666]: pgmap v17551: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 799 KiB/s rd, 902 KiB/s wr, 21 op/s 2023-05-08T12:51:10.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32808.318512 secs 2023-05-08T12:51:10.009 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32808.873752 secs 2023-05-08T12:51:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:09 smithi186 ceph-mon[126480]: pgmap v17551: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 799 KiB/s rd, 902 KiB/s wr, 21 op/s 2023-05-08T12:51:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32808.318512 secs 2023-05-08T12:51:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32808.873752 secs 2023-05-08T12:51:11.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:11 smithi133 ceph-mon[125939]: pgmap v17552: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 25 op/s 2023-05-08T12:51:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:11 smithi096 ceph-mon[124666]: pgmap v17552: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 25 op/s 2023-05-08T12:51:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:11 smithi186 ceph-mon[126480]: pgmap v17552: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 25 op/s 2023-05-08T12:51:13.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:13 smithi133 ceph-mon[125939]: pgmap v17553: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 775 KiB/s rd, 749 KiB/s wr, 20 op/s 2023-05-08T12:51:14.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:13 smithi096 ceph-mon[124666]: pgmap v17553: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 775 KiB/s rd, 749 KiB/s wr, 20 op/s 2023-05-08T12:51:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:13 smithi186 ceph-mon[126480]: pgmap v17553: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 775 KiB/s rd, 749 KiB/s wr, 20 op/s 2023-05-08T12:51:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32813.318631 secs 2023-05-08T12:51:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32813.873874 secs 2023-05-08T12:51:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32813.318631 secs 2023-05-08T12:51:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32813.873874 secs 2023-05-08T12:51:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32813.318631 secs 2023-05-08T12:51:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32813.873874 secs 2023-05-08T12:51:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:15 smithi133 ceph-mon[125939]: pgmap v17554: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 775 KiB/s rd, 749 KiB/s wr, 20 op/s 2023-05-08T12:51:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:15 smithi096 ceph-mon[124666]: pgmap v17554: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 775 KiB/s rd, 749 KiB/s wr, 20 op/s 2023-05-08T12:51:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:15 smithi186 ceph-mon[126480]: pgmap v17554: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 775 KiB/s rd, 749 KiB/s wr, 20 op/s 2023-05-08T12:51:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:17 smithi133 ceph-mon[125939]: pgmap v17555: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 777 KiB/s rd, 749 KiB/s wr, 23 op/s 2023-05-08T12:51:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:17 smithi096 ceph-mon[124666]: pgmap v17555: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 777 KiB/s rd, 749 KiB/s wr, 23 op/s 2023-05-08T12:51:18.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:17 smithi186 ceph-mon[126480]: pgmap v17555: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 777 KiB/s rd, 749 KiB/s wr, 23 op/s 2023-05-08T12:51:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:19 smithi133 ceph-mon[125939]: pgmap v17556: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 285 KiB/s wr, 7 op/s 2023-05-08T12:51:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32818.318749 secs 2023-05-08T12:51:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:19 smithi096 ceph-mon[124666]: pgmap v17556: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 285 KiB/s wr, 7 op/s 2023-05-08T12:51:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32818.318749 secs 2023-05-08T12:51:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:19 smithi186 ceph-mon[126480]: pgmap v17556: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 285 KiB/s wr, 7 op/s 2023-05-08T12:51:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32818.318749 secs 2023-05-08T12:51:20.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:20 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:51:21.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:20 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:51:21.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:20 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:51:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:21 smithi133 ceph-mon[125939]: pgmap v17557: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1002 KiB/s rd, 894 KiB/s wr, 14 op/s 2023-05-08T12:51:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:21 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:51:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:21 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:51:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:21 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:51:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:21 smithi096 ceph-mon[124666]: pgmap v17557: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1002 KiB/s rd, 894 KiB/s wr, 14 op/s 2023-05-08T12:51:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:21 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:51:22.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:21 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:51:22.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:21 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:51:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:21 smithi186 ceph-mon[126480]: pgmap v17557: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1002 KiB/s rd, 894 KiB/s wr, 14 op/s 2023-05-08T12:51:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:21 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:51:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:21 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:51:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:21 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:51:23.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:23 smithi133 ceph-mon[125939]: pgmap v17558: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 588 KiB/s rd, 609 KiB/s wr, 10 op/s 2023-05-08T12:51:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:23 smithi096 ceph-mon[124666]: pgmap v17558: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 588 KiB/s rd, 609 KiB/s wr, 10 op/s 2023-05-08T12:51:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:23 smithi186 ceph-mon[126480]: pgmap v17558: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 588 KiB/s rd, 609 KiB/s wr, 10 op/s 2023-05-08T12:51:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32823.318867 secs 2023-05-08T12:51:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32823.318867 secs 2023-05-08T12:51:25.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32823.318867 secs 2023-05-08T12:51:26.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:25 smithi096 ceph-mon[124666]: pgmap v17559: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 588 KiB/s rd, 609 KiB/s wr, 10 op/s 2023-05-08T12:51:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:25 smithi186 ceph-mon[126480]: pgmap v17559: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 588 KiB/s rd, 609 KiB/s wr, 10 op/s 2023-05-08T12:51:26.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:25 smithi133 ceph-mon[125939]: pgmap v17559: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 588 KiB/s rd, 609 KiB/s wr, 10 op/s 2023-05-08T12:51:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:26 smithi096 ceph-mon[124666]: osdmap e1174: 12 total, 12 up, 12 in 2023-05-08T12:51:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:26 smithi186 ceph-mon[126480]: osdmap e1174: 12 total, 12 up, 12 in 2023-05-08T12:51:27.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:26 smithi133 ceph-mon[125939]: osdmap e1174: 12 total, 12 up, 12 in 2023-05-08T12:51:28.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:27 smithi096 ceph-mon[124666]: pgmap v17561: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 712 KiB/s rd, 759 KiB/s wr, 13 op/s 2023-05-08T12:51:28.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:27 smithi186 ceph-mon[126480]: pgmap v17561: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 712 KiB/s rd, 759 KiB/s wr, 13 op/s 2023-05-08T12:51:28.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:27 smithi133 ceph-mon[125939]: pgmap v17561: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 712 KiB/s rd, 759 KiB/s wr, 13 op/s 2023-05-08T12:51:30.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:29 smithi096 ceph-mon[124666]: pgmap v17562: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 712 KiB/s rd, 759 KiB/s wr, 13 op/s 2023-05-08T12:51:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32828.318998 secs 2023-05-08T12:51:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:29 smithi186 ceph-mon[126480]: pgmap v17562: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 712 KiB/s rd, 759 KiB/s wr, 13 op/s 2023-05-08T12:51:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32828.318998 secs 2023-05-08T12:51:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:29 smithi133 ceph-mon[125939]: pgmap v17562: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 712 KiB/s rd, 759 KiB/s wr, 13 op/s 2023-05-08T12:51:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32828.318998 secs 2023-05-08T12:51:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:31 smithi186 ceph-mon[126480]: pgmap v17563: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 180 KiB/s wr, 9 op/s 2023-05-08T12:51:32.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:31 smithi133 ceph-mon[125939]: pgmap v17563: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 180 KiB/s wr, 9 op/s 2023-05-08T12:51:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:31 smithi096 ceph-mon[124666]: pgmap v17563: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 180 KiB/s wr, 9 op/s 2023-05-08T12:51:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:33 smithi186 ceph-mon[126480]: pgmap v17564: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 180 KiB/s wr, 9 op/s 2023-05-08T12:51:34.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:33 smithi133 ceph-mon[125939]: pgmap v17564: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 180 KiB/s wr, 9 op/s 2023-05-08T12:51:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:33 smithi096 ceph-mon[124666]: pgmap v17564: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 180 KiB/s wr, 9 op/s 2023-05-08T12:51:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32833.319109 secs 2023-05-08T12:51:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32833.319109 secs 2023-05-08T12:51:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32833.319109 secs 2023-05-08T12:51:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:35 smithi186 ceph-mon[126480]: pgmap v17565: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 180 KiB/s wr, 9 op/s 2023-05-08T12:51:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:35 smithi133 ceph-mon[125939]: pgmap v17565: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 180 KiB/s wr, 9 op/s 2023-05-08T12:51:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:35 smithi096 ceph-mon[124666]: pgmap v17565: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 180 KiB/s wr, 9 op/s 2023-05-08T12:51:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32835.165639 secs 2023-05-08T12:51:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:36 smithi186 ceph-mon[126480]: osdmap e1175: 12 total, 12 up, 12 in 2023-05-08T12:51:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32835.165639 secs 2023-05-08T12:51:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:36 smithi133 ceph-mon[125939]: osdmap e1175: 12 total, 12 up, 12 in 2023-05-08T12:51:37.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32835.165639 secs 2023-05-08T12:51:37.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:36 smithi096 ceph-mon[124666]: osdmap e1175: 12 total, 12 up, 12 in 2023-05-08T12:51:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:37 smithi186 ceph-mon[126480]: pgmap v17566: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 153 KiB/s wr, 8 op/s 2023-05-08T12:51:38.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:37 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:51:38.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:37 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:51:38.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:37 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:51:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:37 smithi133 ceph-mon[125939]: pgmap v17566: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 153 KiB/s wr, 8 op/s 2023-05-08T12:51:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:37 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:51:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:37 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:51:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:37 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:51:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:37 smithi096 ceph-mon[124666]: pgmap v17566: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 153 KiB/s wr, 8 op/s 2023-05-08T12:51:38.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:37 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:51:38.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:37 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:51:38.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:37 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:51:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:39 smithi186 ceph-mon[126480]: pgmap v17568: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 155 KiB/s wr, 8 op/s 2023-05-08T12:51:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32838.319225 secs 2023-05-08T12:51:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32838.874511 secs 2023-05-08T12:51:40.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:39 smithi133 ceph-mon[125939]: pgmap v17568: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 155 KiB/s wr, 8 op/s 2023-05-08T12:51:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32838.319225 secs 2023-05-08T12:51:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32838.874511 secs 2023-05-08T12:51:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:39 smithi096 ceph-mon[124666]: pgmap v17568: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 155 KiB/s wr, 8 op/s 2023-05-08T12:51:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32838.319225 secs 2023-05-08T12:51:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32838.874511 secs 2023-05-08T12:51:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:41 smithi186 ceph-mon[126480]: pgmap v17569: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 479 KiB/s wr, 9 op/s 2023-05-08T12:51:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32840.165766 secs 2023-05-08T12:51:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:41 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:51:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:41 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:51:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:41 smithi133 ceph-mon[125939]: pgmap v17569: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 479 KiB/s wr, 9 op/s 2023-05-08T12:51:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32840.165766 secs 2023-05-08T12:51:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:41 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:51:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:41 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:51:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:41 smithi096 ceph-mon[124666]: pgmap v17569: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 479 KiB/s wr, 9 op/s 2023-05-08T12:51:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32840.165766 secs 2023-05-08T12:51:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:41 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:51:42.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:41 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:51:44.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:43 smithi186 ceph-mon[126480]: pgmap v17570: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 799 KiB/s rd, 886 KiB/s wr, 10 op/s 2023-05-08T12:51:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:43 smithi133 ceph-mon[125939]: pgmap v17570: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 799 KiB/s rd, 886 KiB/s wr, 10 op/s 2023-05-08T12:51:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:43 smithi096 ceph-mon[124666]: pgmap v17570: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 799 KiB/s rd, 886 KiB/s wr, 10 op/s 2023-05-08T12:51:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32843.319359 secs 2023-05-08T12:51:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32843.874555 secs 2023-05-08T12:51:45.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32843.319359 secs 2023-05-08T12:51:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32843.874555 secs 2023-05-08T12:51:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32843.319359 secs 2023-05-08T12:51:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32843.874555 secs 2023-05-08T12:51:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:45 smithi186 ceph-mon[126480]: pgmap v17571: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 799 KiB/s rd, 886 KiB/s wr, 10 op/s 2023-05-08T12:51:46.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:45 smithi133 ceph-mon[125939]: pgmap v17571: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 799 KiB/s rd, 886 KiB/s wr, 10 op/s 2023-05-08T12:51:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:45 smithi096 ceph-mon[124666]: pgmap v17571: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 799 KiB/s rd, 886 KiB/s wr, 10 op/s 2023-05-08T12:51:47.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:46 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:51:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:46 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:51:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:46 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:51:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:47 smithi186 ceph-mon[126480]: pgmap v17572: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 951 KiB/s rd, 947 KiB/s wr, 11 op/s 2023-05-08T12:51:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:47 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:51:48.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:47 smithi133 ceph-mon[125939]: pgmap v17572: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 951 KiB/s rd, 947 KiB/s wr, 11 op/s 2023-05-08T12:51:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:47 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:51:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:47 smithi096 ceph-mon[124666]: pgmap v17572: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 951 KiB/s rd, 947 KiB/s wr, 11 op/s 2023-05-08T12:51:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:47 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:51:49.072 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:51:49.085 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:51:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:51:49.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:49 smithi133 ceph-mon[125939]: pgmap v17573: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 851 KiB/s rd, 847 KiB/s wr, 9 op/s 2023-05-08T12:51:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32848.319493 secs 2023-05-08T12:51:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:51:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:51:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:49 smithi186 ceph-mon[126480]: pgmap v17573: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 851 KiB/s rd, 847 KiB/s wr, 9 op/s 2023-05-08T12:51:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32848.319493 secs 2023-05-08T12:51:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:51:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:51:50.151 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:49 smithi096 ceph-mon[124666]: pgmap v17573: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 851 KiB/s rd, 847 KiB/s wr, 9 op/s 2023-05-08T12:51:50.152 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32848.319493 secs 2023-05-08T12:51:50.152 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:51:50.152 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:51:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:51 smithi186 ceph-mon[126480]: pgmap v17574: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 15 op/s 2023-05-08T12:51:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:51 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:51:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:51 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:51:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:51 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:51:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:51 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:51:51.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:51 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:51:51.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:51 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:51:51.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:51 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:51:51.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:51 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:51:51.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:51 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T12:51:51.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:51 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T12:51:51.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:51 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:51:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:51 smithi133 ceph-mon[125939]: pgmap v17574: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 15 op/s 2023-05-08T12:51:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:51 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:51:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:51 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:51:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:51 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:51:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:51 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:51:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:51 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:51:51.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:51 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:51:51.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:51 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:51:51.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:51 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:51:51.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:51 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T12:51:51.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:51 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T12:51:51.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:51 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:51:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:51 smithi096 ceph-mon[124666]: pgmap v17574: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 15 op/s 2023-05-08T12:51:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:51 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:51:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:51 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:51:52.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:51 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:51:52.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:51 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:51:52.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:51 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:51:52.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:51 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:51:52.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:51 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:51:52.009 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:51 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:51:52.009 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:51 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T12:51:52.009 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:51 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T12:51:52.009 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:51 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:51:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:52 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:51:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:52 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:51:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:52 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:51:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:53 smithi186 ceph-mon[126480]: pgmap v17575: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T12:51:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:53 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:51:53.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:53 smithi133 ceph-mon[125939]: pgmap v17575: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T12:51:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:53 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:51:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:53 smithi096 ceph-mon[124666]: pgmap v17575: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T12:51:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:53 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:51:54.873 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:54 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:51:54.873 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:54 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:51:54.873 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32853.319603 secs 2023-05-08T12:51:54.874 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32853.874748 secs 2023-05-08T12:51:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:54 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:51:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:54 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:51:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32853.319603 secs 2023-05-08T12:51:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32853.874748 secs 2023-05-08T12:51:55.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:54 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:51:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:54 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:51:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32853.319603 secs 2023-05-08T12:51:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32853.874748 secs 2023-05-08T12:51:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:55 smithi186 ceph-mon[126480]: pgmap v17576: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 885 KiB/s rd, 803 KiB/s wr, 10 op/s 2023-05-08T12:51:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:55 smithi133 ceph-mon[125939]: pgmap v17576: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 885 KiB/s rd, 803 KiB/s wr, 10 op/s 2023-05-08T12:51:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:55 smithi096 ceph-mon[124666]: pgmap v17576: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 885 KiB/s rd, 803 KiB/s wr, 10 op/s 2023-05-08T12:51:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32855.166128 secs 2023-05-08T12:51:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:51:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32855.166128 secs 2023-05-08T12:51:56.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:51:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32855.166128 secs 2023-05-08T12:51:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:51:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:57 smithi186 ceph-mon[126480]: pgmap v17577: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.0 MiB/s wr, 17 op/s 2023-05-08T12:51:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:57 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:51:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:57 smithi133 ceph-mon[125939]: pgmap v17577: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.0 MiB/s wr, 17 op/s 2023-05-08T12:51:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:57 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:51:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:57 smithi096 ceph-mon[124666]: pgmap v17577: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.0 MiB/s wr, 17 op/s 2023-05-08T12:51:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:57 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:51:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:51:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:51:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:51:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:51:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:51:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:51:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:51:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:51:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:51:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:59 smithi133 ceph-mon[125939]: pgmap v17578: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.9 MiB/s wr, 12 op/s 2023-05-08T12:51:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32858.319722 secs 2023-05-08T12:51:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:59 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:51:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:51:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32858.874865 secs 2023-05-08T12:52:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:59 smithi096 ceph-mon[124666]: pgmap v17578: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.9 MiB/s wr, 12 op/s 2023-05-08T12:52:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32858.319722 secs 2023-05-08T12:52:00.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:59 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:52:00.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:51:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32858.874865 secs 2023-05-08T12:52:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:59 smithi186 ceph-mon[126480]: pgmap v17578: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.9 MiB/s wr, 12 op/s 2023-05-08T12:52:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32858.319722 secs 2023-05-08T12:52:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:59 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:52:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:51:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32858.874865 secs 2023-05-08T12:52:01.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:01 smithi133 ceph-mon[125939]: pgmap v17579: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.7 MiB/s wr, 20 op/s 2023-05-08T12:52:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32860.166277 secs 2023-05-08T12:52:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:52:02.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:01 smithi096 ceph-mon[124666]: pgmap v17579: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.7 MiB/s wr, 20 op/s 2023-05-08T12:52:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32860.166277 secs 2023-05-08T12:52:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:52:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:01 smithi186 ceph-mon[126480]: pgmap v17579: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.7 MiB/s wr, 20 op/s 2023-05-08T12:52:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32860.166277 secs 2023-05-08T12:52:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:52:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:02 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:52:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:02 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:52:03.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:02 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:52:03.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:03 smithi133 ceph-mon[125939]: pgmap v17580: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 14 op/s 2023-05-08T12:52:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:03 smithi096 ceph-mon[124666]: pgmap v17580: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 14 op/s 2023-05-08T12:52:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:03 smithi186 ceph-mon[126480]: pgmap v17580: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 14 op/s 2023-05-08T12:52:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32863.319862 secs 2023-05-08T12:52:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:04 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:52:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32863.874941 secs 2023-05-08T12:52:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32863.319862 secs 2023-05-08T12:52:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:04 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:52:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32863.874941 secs 2023-05-08T12:52:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32863.319862 secs 2023-05-08T12:52:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:04 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:52:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32863.874941 secs 2023-05-08T12:52:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:05 smithi133 ceph-mon[125939]: pgmap v17581: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 13 op/s 2023-05-08T12:52:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:05 smithi096 ceph-mon[124666]: pgmap v17581: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 13 op/s 2023-05-08T12:52:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:05 smithi186 ceph-mon[126480]: pgmap v17581: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 13 op/s 2023-05-08T12:52:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32865.166403 secs 2023-05-08T12:52:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:06 smithi133 ceph-mon[125939]: osdmap e1176: 12 total, 12 up, 12 in 2023-05-08T12:52:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32865.166403 secs 2023-05-08T12:52:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:06 smithi096 ceph-mon[124666]: osdmap e1176: 12 total, 12 up, 12 in 2023-05-08T12:52:07.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32865.166403 secs 2023-05-08T12:52:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:06 smithi186 ceph-mon[126480]: osdmap e1176: 12 total, 12 up, 12 in 2023-05-08T12:52:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:07 smithi133 ceph-mon[125939]: pgmap v17583: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.6 MiB/s wr, 32 op/s 2023-05-08T12:52:08.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:07 smithi096 ceph-mon[124666]: pgmap v17583: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.6 MiB/s wr, 32 op/s 2023-05-08T12:52:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:07 smithi186 ceph-mon[126480]: pgmap v17583: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.6 MiB/s wr, 32 op/s 2023-05-08T12:52:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:09 smithi133 ceph-mon[125939]: pgmap v17584: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.6 MiB/s wr, 32 op/s 2023-05-08T12:52:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32868.319995 secs 2023-05-08T12:52:09.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32868.875086 secs 2023-05-08T12:52:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:09 smithi096 ceph-mon[124666]: pgmap v17584: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.6 MiB/s wr, 32 op/s 2023-05-08T12:52:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32868.319995 secs 2023-05-08T12:52:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32868.875086 secs 2023-05-08T12:52:10.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:09 smithi186 ceph-mon[126480]: pgmap v17584: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.6 MiB/s wr, 32 op/s 2023-05-08T12:52:10.123 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32868.319995 secs 2023-05-08T12:52:10.123 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32868.875086 secs 2023-05-08T12:52:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:11 smithi133 ceph-mon[125939]: pgmap v17585: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 938 KiB/s wr, 28 op/s 2023-05-08T12:52:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32870.166532 secs 2023-05-08T12:52:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:11 smithi096 ceph-mon[124666]: pgmap v17585: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 938 KiB/s wr, 28 op/s 2023-05-08T12:52:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32870.166532 secs 2023-05-08T12:52:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:11 smithi186 ceph-mon[126480]: pgmap v17585: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 938 KiB/s wr, 28 op/s 2023-05-08T12:52:12.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32870.166532 secs 2023-05-08T12:52:13.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:13 smithi133 ceph-mon[125939]: pgmap v17586: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 938 KiB/s wr, 28 op/s 2023-05-08T12:52:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:13 smithi096 ceph-mon[124666]: pgmap v17586: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 938 KiB/s wr, 28 op/s 2023-05-08T12:52:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:13 smithi186 ceph-mon[126480]: pgmap v17586: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 938 KiB/s wr, 28 op/s 2023-05-08T12:52:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32873.320114 secs 2023-05-08T12:52:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32873.875208 secs 2023-05-08T12:52:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32873.320114 secs 2023-05-08T12:52:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32873.875208 secs 2023-05-08T12:52:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32873.320114 secs 2023-05-08T12:52:15.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32873.875208 secs 2023-05-08T12:52:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:15 smithi096 ceph-mon[124666]: pgmap v17587: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 938 KiB/s wr, 28 op/s 2023-05-08T12:52:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:15 smithi186 ceph-mon[126480]: pgmap v17587: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 938 KiB/s wr, 28 op/s 2023-05-08T12:52:16.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:15 smithi133 ceph-mon[125939]: pgmap v17587: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 938 KiB/s wr, 28 op/s 2023-05-08T12:52:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32875.166659 secs 2023-05-08T12:52:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:16 smithi096 ceph-mon[124666]: osdmap e1177: 12 total, 12 up, 12 in 2023-05-08T12:52:17.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32875.166659 secs 2023-05-08T12:52:17.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:16 smithi186 ceph-mon[126480]: osdmap e1177: 12 total, 12 up, 12 in 2023-05-08T12:52:17.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32875.166659 secs 2023-05-08T12:52:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:16 smithi133 ceph-mon[125939]: osdmap e1177: 12 total, 12 up, 12 in 2023-05-08T12:52:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:17 smithi096 ceph-mon[124666]: pgmap v17588: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 820 KiB/s rd, 465 KiB/s wr, 8 op/s 2023-05-08T12:52:18.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:17 smithi186 ceph-mon[126480]: pgmap v17588: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 820 KiB/s rd, 465 KiB/s wr, 8 op/s 2023-05-08T12:52:18.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:17 smithi133 ceph-mon[125939]: pgmap v17588: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 820 KiB/s rd, 465 KiB/s wr, 8 op/s 2023-05-08T12:52:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:19 smithi096 ceph-mon[124666]: pgmap v17590: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 832 KiB/s rd, 472 KiB/s wr, 8 op/s 2023-05-08T12:52:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32878.320255 secs 2023-05-08T12:52:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32878.875336 secs 2023-05-08T12:52:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:19 smithi186 ceph-mon[126480]: pgmap v17590: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 832 KiB/s rd, 472 KiB/s wr, 8 op/s 2023-05-08T12:52:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32878.320255 secs 2023-05-08T12:52:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32878.875336 secs 2023-05-08T12:52:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:19 smithi133 ceph-mon[125939]: pgmap v17590: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 832 KiB/s rd, 472 KiB/s wr, 8 op/s 2023-05-08T12:52:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32878.320255 secs 2023-05-08T12:52:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32878.875336 secs 2023-05-08T12:52:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:21 smithi186 ceph-mon[126480]: pgmap v17591: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 343 KiB/s wr, 8 op/s 2023-05-08T12:52:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32880.166801 secs 2023-05-08T12:52:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:21 smithi133 ceph-mon[125939]: pgmap v17591: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 343 KiB/s wr, 8 op/s 2023-05-08T12:52:22.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32880.166801 secs 2023-05-08T12:52:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:21 smithi096 ceph-mon[124666]: pgmap v17591: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 343 KiB/s wr, 8 op/s 2023-05-08T12:52:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32880.166801 secs 2023-05-08T12:52:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:23 smithi186 ceph-mon[126480]: pgmap v17592: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 344 KiB/s wr, 8 op/s 2023-05-08T12:52:24.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:23 smithi133 ceph-mon[125939]: pgmap v17592: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 344 KiB/s wr, 8 op/s 2023-05-08T12:52:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:23 smithi096 ceph-mon[124666]: pgmap v17592: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 344 KiB/s wr, 8 op/s 2023-05-08T12:52:25.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32883.320372 secs 2023-05-08T12:52:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32883.875498 secs 2023-05-08T12:52:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32883.320372 secs 2023-05-08T12:52:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32883.875498 secs 2023-05-08T12:52:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32883.320372 secs 2023-05-08T12:52:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32883.875498 secs 2023-05-08T12:52:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:25 smithi186 ceph-mon[126480]: pgmap v17593: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 344 KiB/s wr, 8 op/s 2023-05-08T12:52:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:25 smithi133 ceph-mon[125939]: pgmap v17593: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 344 KiB/s wr, 8 op/s 2023-05-08T12:52:26.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:25 smithi096 ceph-mon[124666]: pgmap v17593: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 344 KiB/s wr, 8 op/s 2023-05-08T12:52:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32885.166919 secs 2023-05-08T12:52:27.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32885.166919 secs 2023-05-08T12:52:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32885.166919 secs 2023-05-08T12:52:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:27 smithi186 ceph-mon[126480]: pgmap v17594: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 KiB/s wr, 8 op/s 2023-05-08T12:52:28.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:27 smithi133 ceph-mon[125939]: pgmap v17594: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 KiB/s wr, 8 op/s 2023-05-08T12:52:28.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:27 smithi096 ceph-mon[124666]: pgmap v17594: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 KiB/s wr, 8 op/s 2023-05-08T12:52:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:29 smithi186 ceph-mon[126480]: pgmap v17595: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 47 KiB/s wr, 7 op/s 2023-05-08T12:52:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32888.320489 secs 2023-05-08T12:52:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32888.875642 secs 2023-05-08T12:52:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:29 smithi133 ceph-mon[125939]: pgmap v17595: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 47 KiB/s wr, 7 op/s 2023-05-08T12:52:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32888.320489 secs 2023-05-08T12:52:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32888.875642 secs 2023-05-08T12:52:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:29 smithi096 ceph-mon[124666]: pgmap v17595: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 47 KiB/s wr, 7 op/s 2023-05-08T12:52:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32888.320489 secs 2023-05-08T12:52:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32888.875642 secs 2023-05-08T12:52:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:31 smithi186 ceph-mon[126480]: pgmap v17596: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 44 KiB/s wr, 10 op/s 2023-05-08T12:52:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32890.167014 secs 2023-05-08T12:52:32.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:31 smithi133 ceph-mon[125939]: pgmap v17596: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 44 KiB/s wr, 10 op/s 2023-05-08T12:52:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32890.167014 secs 2023-05-08T12:52:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:31 smithi096 ceph-mon[124666]: pgmap v17596: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 44 KiB/s wr, 10 op/s 2023-05-08T12:52:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32890.167014 secs 2023-05-08T12:52:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:33 smithi186 ceph-mon[126480]: pgmap v17597: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 7 op/s 2023-05-08T12:52:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:33 smithi133 ceph-mon[125939]: pgmap v17597: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 7 op/s 2023-05-08T12:52:34.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:33 smithi096 ceph-mon[124666]: pgmap v17597: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 7 op/s 2023-05-08T12:52:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32893.320603 secs 2023-05-08T12:52:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32893.875707 secs 2023-05-08T12:52:35.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32893.320603 secs 2023-05-08T12:52:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32893.875707 secs 2023-05-08T12:52:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32893.320603 secs 2023-05-08T12:52:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32893.875707 secs 2023-05-08T12:52:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:35 smithi186 ceph-mon[126480]: pgmap v17598: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 6 op/s 2023-05-08T12:52:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:35 smithi133 ceph-mon[125939]: pgmap v17598: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 6 op/s 2023-05-08T12:52:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:35 smithi096 ceph-mon[124666]: pgmap v17598: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 6 op/s 2023-05-08T12:52:37.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32895.167096 secs 2023-05-08T12:52:37.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32895.167096 secs 2023-05-08T12:52:37.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32895.167096 secs 2023-05-08T12:52:38.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:37 smithi186 ceph-mon[126480]: pgmap v17599: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 155 KiB/s wr, 10 op/s 2023-05-08T12:52:38.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:37 smithi133 ceph-mon[125939]: pgmap v17599: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 155 KiB/s wr, 10 op/s 2023-05-08T12:52:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:37 smithi096 ceph-mon[124666]: pgmap v17599: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 155 KiB/s wr, 10 op/s 2023-05-08T12:52:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:39 smithi186 ceph-mon[126480]: pgmap v17600: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 133 KiB/s wr, 7 op/s 2023-05-08T12:52:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32898.320719 secs 2023-05-08T12:52:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32898.875830 secs 2023-05-08T12:52:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:39 smithi133 ceph-mon[125939]: pgmap v17600: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 133 KiB/s wr, 7 op/s 2023-05-08T12:52:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32898.320719 secs 2023-05-08T12:52:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32898.875830 secs 2023-05-08T12:52:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:39 smithi096 ceph-mon[124666]: pgmap v17600: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 133 KiB/s wr, 7 op/s 2023-05-08T12:52:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32898.320719 secs 2023-05-08T12:52:40.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32898.875830 secs 2023-05-08T12:52:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:41 smithi186 ceph-mon[126480]: pgmap v17601: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 134 KiB/s wr, 10 op/s 2023-05-08T12:52:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32900.167248 secs 2023-05-08T12:52:42.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:41 smithi133 ceph-mon[125939]: pgmap v17601: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 134 KiB/s wr, 10 op/s 2023-05-08T12:52:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32900.167248 secs 2023-05-08T12:52:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:41 smithi096 ceph-mon[124666]: pgmap v17601: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 134 KiB/s wr, 10 op/s 2023-05-08T12:52:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32900.167248 secs 2023-05-08T12:52:44.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:43 smithi186 ceph-mon[126480]: pgmap v17602: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 133 KiB/s wr, 7 op/s 2023-05-08T12:52:44.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:43 smithi133 ceph-mon[125939]: pgmap v17602: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 133 KiB/s wr, 7 op/s 2023-05-08T12:52:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:43 smithi096 ceph-mon[124666]: pgmap v17602: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 133 KiB/s wr, 7 op/s 2023-05-08T12:52:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32903.320869 secs 2023-05-08T12:52:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32903.875931 secs 2023-05-08T12:52:45.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32903.320869 secs 2023-05-08T12:52:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32903.875931 secs 2023-05-08T12:52:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32903.320869 secs 2023-05-08T12:52:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32903.875931 secs 2023-05-08T12:52:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:45 smithi186 ceph-mon[126480]: pgmap v17603: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 133 KiB/s wr, 7 op/s 2023-05-08T12:52:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:45 smithi133 ceph-mon[125939]: pgmap v17603: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 133 KiB/s wr, 7 op/s 2023-05-08T12:52:46.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:45 smithi096 ceph-mon[124666]: pgmap v17603: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 133 KiB/s wr, 7 op/s 2023-05-08T12:52:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:47 smithi186 ceph-mon[126480]: pgmap v17604: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 133 KiB/s wr, 10 op/s 2023-05-08T12:52:48.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:47 smithi133 ceph-mon[125939]: pgmap v17604: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 133 KiB/s wr, 10 op/s 2023-05-08T12:52:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:47 smithi096 ceph-mon[124666]: pgmap v17604: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 133 KiB/s wr, 10 op/s 2023-05-08T12:52:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:52:49.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:52:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:52:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:49 smithi186 ceph-mon[126480]: pgmap v17605: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T12:52:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32908.321009 secs 2023-05-08T12:52:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:52:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:52:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:52:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:49 smithi133 ceph-mon[125939]: pgmap v17605: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T12:52:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32908.321009 secs 2023-05-08T12:52:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:52:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:52:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:52:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:49 smithi096 ceph-mon[124666]: pgmap v17605: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T12:52:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32908.321009 secs 2023-05-08T12:52:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:52:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:52:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:52:51.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:52:51.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:52:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:52:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:51 smithi186 ceph-mon[126480]: pgmap v17606: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 470 KiB/s rd, 356 KiB/s wr, 11 op/s 2023-05-08T12:52:52.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:51 smithi133 ceph-mon[125939]: pgmap v17606: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 470 KiB/s rd, 356 KiB/s wr, 11 op/s 2023-05-08T12:52:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:51 smithi096 ceph-mon[124666]: pgmap v17606: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 470 KiB/s rd, 356 KiB/s wr, 11 op/s 2023-05-08T12:52:53.110 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:52:53.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:52:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:52:53.993 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:53 smithi186 ceph-mon[126480]: pgmap v17607: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 809 KiB/s rd, 697 KiB/s wr, 8 op/s 2023-05-08T12:52:53.994 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:52:53.994 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:52:54.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:53 smithi133 ceph-mon[125939]: pgmap v17607: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 809 KiB/s rd, 697 KiB/s wr, 8 op/s 2023-05-08T12:52:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:52:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:52:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:53 smithi096 ceph-mon[124666]: pgmap v17607: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 809 KiB/s rd, 697 KiB/s wr, 8 op/s 2023-05-08T12:52:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:52:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:52:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32913.321097 secs 2023-05-08T12:52:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:55 smithi186 ceph-mon[126480]: pgmap v17608: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 809 KiB/s rd, 697 KiB/s wr, 8 op/s 2023-05-08T12:52:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:55 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:52:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:55 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:52:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:55 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:52:55.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:55 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:52:55.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:55 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:52:55.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:55 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:52:55.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:55 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T12:52:55.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:55 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T12:52:55.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:55 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:52:55.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32913.876168 secs 2023-05-08T12:52:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32913.321097 secs 2023-05-08T12:52:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:55 smithi133 ceph-mon[125939]: pgmap v17608: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 809 KiB/s rd, 697 KiB/s wr, 8 op/s 2023-05-08T12:52:55.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:55 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:52:55.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:55 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:52:55.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:55 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:52:55.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:55 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:52:55.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:55 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:52:55.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:55 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:52:55.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:55 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T12:52:55.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:55 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T12:52:55.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:55 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:52:55.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32913.876168 secs 2023-05-08T12:52:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32913.321097 secs 2023-05-08T12:52:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:55 smithi096 ceph-mon[124666]: pgmap v17608: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 809 KiB/s rd, 697 KiB/s wr, 8 op/s 2023-05-08T12:52:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:55 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:52:55.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:55 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:52:55.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:55 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:52:55.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:55 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:52:55.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:55 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:52:55.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:55 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:52:55.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:55 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T12:52:55.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:55 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T12:52:55.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:55 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:52:55.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32913.876168 secs 2023-05-08T12:52:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32915.167624 secs 2023-05-08T12:52:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32915.167624 secs 2023-05-08T12:52:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32915.167624 secs 2023-05-08T12:52:57.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:57 smithi186 ceph-mon[126480]: pgmap v17609: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 15 op/s 2023-05-08T12:52:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:57 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:52:57.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:57 smithi133 ceph-mon[125939]: pgmap v17609: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 15 op/s 2023-05-08T12:52:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:57 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:52:57.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:57 smithi096 ceph-mon[124666]: pgmap v17609: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 15 op/s 2023-05-08T12:52:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:57 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:52:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:52:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:52:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:52:58.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:52:58.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:52:58.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:52:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:52:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:52:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:52:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:52:59 smithi186 ceph-mon[126480]: pgmap v17610: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2023-05-08T12:52:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:52:59 smithi133 ceph-mon[125939]: pgmap v17610: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2023-05-08T12:52:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:52:59 smithi096 ceph-mon[124666]: pgmap v17610: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2023-05-08T12:53:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32918.321215 secs 2023-05-08T12:53:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32918.876293 secs 2023-05-08T12:53:00.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32918.321215 secs 2023-05-08T12:53:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32918.876293 secs 2023-05-08T12:53:00.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32918.321215 secs 2023-05-08T12:53:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32918.876293 secs 2023-05-08T12:53:01.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:01 smithi186 ceph-mon[126480]: pgmap v17611: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 16 op/s 2023-05-08T12:53:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:01 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:53:01.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:01 smithi133 ceph-mon[125939]: pgmap v17611: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 16 op/s 2023-05-08T12:53:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:01 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:53:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:01 smithi096 ceph-mon[124666]: pgmap v17611: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 16 op/s 2023-05-08T12:53:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:01 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:53:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:53:02.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:53:02.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:02 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:53:02.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:53:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:53:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:02 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:53:02.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:53:02.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:53:02.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:02 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:53:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:03 smithi133 ceph-mon[125939]: pgmap v17612: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T12:53:04.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:03 smithi096 ceph-mon[124666]: pgmap v17612: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T12:53:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:03 smithi186 ceph-mon[126480]: pgmap v17612: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T12:53:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32923.321366 secs 2023-05-08T12:53:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:04 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:53:05.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32923.321366 secs 2023-05-08T12:53:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:04 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:53:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32923.321366 secs 2023-05-08T12:53:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:04 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:53:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:05 smithi133 ceph-mon[125939]: pgmap v17613: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 740 KiB/s rd, 707 KiB/s wr, 11 op/s 2023-05-08T12:53:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:53:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:53:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:05 smithi096 ceph-mon[124666]: pgmap v17613: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 740 KiB/s rd, 707 KiB/s wr, 11 op/s 2023-05-08T12:53:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:53:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:53:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:05 smithi186 ceph-mon[126480]: pgmap v17613: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 740 KiB/s rd, 707 KiB/s wr, 11 op/s 2023-05-08T12:53:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:53:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:53:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:06 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:53:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:06 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:53:07.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:06 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:53:07.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:07 smithi133 ceph-mon[125939]: pgmap v17614: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 28 op/s 2023-05-08T12:53:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:07 smithi096 ceph-mon[124666]: pgmap v17614: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 28 op/s 2023-05-08T12:53:08.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:07 smithi186 ceph-mon[126480]: pgmap v17614: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 28 op/s 2023-05-08T12:53:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:09 smithi133 ceph-mon[125939]: pgmap v17615: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 950 KiB/s rd, 738 KiB/s wr, 22 op/s 2023-05-08T12:53:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32928.321478 secs 2023-05-08T12:53:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:09 smithi096 ceph-mon[124666]: pgmap v17615: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 950 KiB/s rd, 738 KiB/s wr, 22 op/s 2023-05-08T12:53:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32928.321478 secs 2023-05-08T12:53:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:09 smithi186 ceph-mon[126480]: pgmap v17615: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 950 KiB/s rd, 738 KiB/s wr, 22 op/s 2023-05-08T12:53:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32928.321478 secs 2023-05-08T12:53:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:11 smithi133 ceph-mon[125939]: pgmap v17616: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 918 KiB/s wr, 26 op/s 2023-05-08T12:53:12.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:11 smithi096 ceph-mon[124666]: pgmap v17616: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 918 KiB/s wr, 26 op/s 2023-05-08T12:53:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:11 smithi186 ceph-mon[126480]: pgmap v17616: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 918 KiB/s wr, 26 op/s 2023-05-08T12:53:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:13 smithi096 ceph-mon[124666]: pgmap v17617: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 907 KiB/s wr, 22 op/s 2023-05-08T12:53:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:13 smithi186 ceph-mon[126480]: pgmap v17617: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 907 KiB/s wr, 22 op/s 2023-05-08T12:53:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:13 smithi133 ceph-mon[125939]: pgmap v17617: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 907 KiB/s wr, 22 op/s 2023-05-08T12:53:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32933.321594 secs 2023-05-08T12:53:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32933.321594 secs 2023-05-08T12:53:15.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32933.321594 secs 2023-05-08T12:53:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:15 smithi096 ceph-mon[124666]: pgmap v17618: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 907 KiB/s wr, 21 op/s 2023-05-08T12:53:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:15 smithi186 ceph-mon[126480]: pgmap v17618: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 907 KiB/s wr, 21 op/s 2023-05-08T12:53:16.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:15 smithi133 ceph-mon[125939]: pgmap v17618: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 907 KiB/s wr, 21 op/s 2023-05-08T12:53:18.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:17 smithi186 ceph-mon[126480]: pgmap v17619: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.0 MiB/s wr, 25 op/s 2023-05-08T12:53:18.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:17 smithi133 ceph-mon[125939]: pgmap v17619: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.0 MiB/s wr, 25 op/s 2023-05-08T12:53:18.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:17 smithi096 ceph-mon[124666]: pgmap v17619: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.0 MiB/s wr, 25 op/s 2023-05-08T12:53:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:19 smithi186 ceph-mon[126480]: pgmap v17620: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 505 KiB/s rd, 332 KiB/s wr, 7 op/s 2023-05-08T12:53:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32938.321735 secs 2023-05-08T12:53:20.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32938.876767 secs 2023-05-08T12:53:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:19 smithi133 ceph-mon[125939]: pgmap v17620: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 505 KiB/s rd, 332 KiB/s wr, 7 op/s 2023-05-08T12:53:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32938.321735 secs 2023-05-08T12:53:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32938.876767 secs 2023-05-08T12:53:20.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:19 smithi096 ceph-mon[124666]: pgmap v17620: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 505 KiB/s rd, 332 KiB/s wr, 7 op/s 2023-05-08T12:53:20.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32938.321735 secs 2023-05-08T12:53:20.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32938.876767 secs 2023-05-08T12:53:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:20 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:53:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:20 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:53:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:20 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:53:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:20 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:53:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:20 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:53:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:20 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:53:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:20 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:53:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:20 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:53:21.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:20 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:53:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:20 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:53:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:20 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:53:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:20 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:53:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:21 smithi186 ceph-mon[126480]: pgmap v17621: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 15 op/s 2023-05-08T12:53:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32940.168216 secs 2023-05-08T12:53:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:21 smithi133 ceph-mon[125939]: pgmap v17621: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 15 op/s 2023-05-08T12:53:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32940.168216 secs 2023-05-08T12:53:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:21 smithi096 ceph-mon[124666]: pgmap v17621: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 15 op/s 2023-05-08T12:53:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32940.168216 secs 2023-05-08T12:53:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:23 smithi186 ceph-mon[126480]: pgmap v17622: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1011 KiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T12:53:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:23 smithi133 ceph-mon[125939]: pgmap v17622: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1011 KiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T12:53:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:23 smithi096 ceph-mon[124666]: pgmap v17622: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1011 KiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T12:53:25.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32943.321854 secs 2023-05-08T12:53:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32943.876892 secs 2023-05-08T12:53:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32943.321854 secs 2023-05-08T12:53:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32943.876892 secs 2023-05-08T12:53:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32943.321854 secs 2023-05-08T12:53:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32943.876892 secs 2023-05-08T12:53:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:25 smithi186 ceph-mon[126480]: pgmap v17623: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1011 KiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T12:53:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32945.168335 secs 2023-05-08T12:53:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:25 smithi133 ceph-mon[125939]: pgmap v17623: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1011 KiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T12:53:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32945.168335 secs 2023-05-08T12:53:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:25 smithi096 ceph-mon[124666]: pgmap v17623: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1011 KiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T12:53:26.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32945.168335 secs 2023-05-08T12:53:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:26 smithi186 ceph-mon[126480]: osdmap e1178: 12 total, 12 up, 12 in 2023-05-08T12:53:27.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:26 smithi133 ceph-mon[125939]: osdmap e1178: 12 total, 12 up, 12 in 2023-05-08T12:53:27.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:26 smithi096 ceph-mon[124666]: osdmap e1178: 12 total, 12 up, 12 in 2023-05-08T12:53:28.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:27 smithi186 ceph-mon[126480]: pgmap v17625: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T12:53:28.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:27 smithi133 ceph-mon[125939]: pgmap v17625: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T12:53:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:27 smithi096 ceph-mon[124666]: pgmap v17625: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T12:53:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:29 smithi186 ceph-mon[126480]: pgmap v17626: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T12:53:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32948.321943 secs 2023-05-08T12:53:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32948.877016 secs 2023-05-08T12:53:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:29 smithi133 ceph-mon[125939]: pgmap v17626: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T12:53:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32948.321943 secs 2023-05-08T12:53:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32948.877016 secs 2023-05-08T12:53:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:29 smithi096 ceph-mon[124666]: pgmap v17626: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T12:53:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32948.321943 secs 2023-05-08T12:53:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32948.877016 secs 2023-05-08T12:53:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32950.168435 secs 2023-05-08T12:53:31.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32950.168435 secs 2023-05-08T12:53:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32950.168435 secs 2023-05-08T12:53:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:31 smithi186 ceph-mon[126480]: pgmap v17627: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 160 KiB/s wr, 9 op/s 2023-05-08T12:53:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:31 smithi133 ceph-mon[125939]: pgmap v17627: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 160 KiB/s wr, 9 op/s 2023-05-08T12:53:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:31 smithi096 ceph-mon[124666]: pgmap v17627: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 160 KiB/s wr, 9 op/s 2023-05-08T12:53:34.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:33 smithi186 ceph-mon[126480]: pgmap v17628: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 160 KiB/s wr, 9 op/s 2023-05-08T12:53:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:33 smithi133 ceph-mon[125939]: pgmap v17628: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 160 KiB/s wr, 9 op/s 2023-05-08T12:53:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:33 smithi096 ceph-mon[124666]: pgmap v17628: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 160 KiB/s wr, 9 op/s 2023-05-08T12:53:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32953.322058 secs 2023-05-08T12:53:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32953.877142 secs 2023-05-08T12:53:35.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32953.322058 secs 2023-05-08T12:53:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32953.877142 secs 2023-05-08T12:53:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32953.322058 secs 2023-05-08T12:53:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32953.877142 secs 2023-05-08T12:53:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:35 smithi186 ceph-mon[126480]: pgmap v17629: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 160 KiB/s wr, 9 op/s 2023-05-08T12:53:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32955.168554 secs 2023-05-08T12:53:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:35 smithi133 ceph-mon[125939]: pgmap v17629: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 160 KiB/s wr, 9 op/s 2023-05-08T12:53:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32955.168554 secs 2023-05-08T12:53:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:35 smithi096 ceph-mon[124666]: pgmap v17629: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 160 KiB/s wr, 9 op/s 2023-05-08T12:53:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32955.168554 secs 2023-05-08T12:53:37.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:37 smithi133 ceph-mon[125939]: pgmap v17630: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 660 KiB/s rd, 657 KiB/s wr, 10 op/s 2023-05-08T12:53:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:37 smithi133 ceph-mon[125939]: osdmap e1179: 12 total, 12 up, 12 in 2023-05-08T12:53:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:37 smithi096 ceph-mon[124666]: pgmap v17630: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 660 KiB/s rd, 657 KiB/s wr, 10 op/s 2023-05-08T12:53:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:37 smithi096 ceph-mon[124666]: osdmap e1179: 12 total, 12 up, 12 in 2023-05-08T12:53:38.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:37 smithi186 ceph-mon[126480]: pgmap v17630: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 660 KiB/s rd, 657 KiB/s wr, 10 op/s 2023-05-08T12:53:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:37 smithi186 ceph-mon[126480]: osdmap e1179: 12 total, 12 up, 12 in 2023-05-08T12:53:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:39 smithi133 ceph-mon[125939]: pgmap v17632: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 664 KiB/s rd, 661 KiB/s wr, 10 op/s 2023-05-08T12:53:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32958.322175 secs 2023-05-08T12:53:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32958.877265 secs 2023-05-08T12:53:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:39 smithi096 ceph-mon[124666]: pgmap v17632: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 664 KiB/s rd, 661 KiB/s wr, 10 op/s 2023-05-08T12:53:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32958.322175 secs 2023-05-08T12:53:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32958.877265 secs 2023-05-08T12:53:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:39 smithi186 ceph-mon[126480]: pgmap v17632: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 664 KiB/s rd, 661 KiB/s wr, 10 op/s 2023-05-08T12:53:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32958.322175 secs 2023-05-08T12:53:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32958.877265 secs 2023-05-08T12:53:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:41 smithi133 ceph-mon[125939]: pgmap v17633: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 633 KiB/s rd, 631 KiB/s wr, 11 op/s 2023-05-08T12:53:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32960.168678 secs 2023-05-08T12:53:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:41 smithi096 ceph-mon[124666]: pgmap v17633: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 633 KiB/s rd, 631 KiB/s wr, 11 op/s 2023-05-08T12:53:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32960.168678 secs 2023-05-08T12:53:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:41 smithi186 ceph-mon[126480]: pgmap v17633: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 633 KiB/s rd, 631 KiB/s wr, 11 op/s 2023-05-08T12:53:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32960.168678 secs 2023-05-08T12:53:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:43 smithi133 ceph-mon[125939]: pgmap v17634: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 633 KiB/s rd, 631 KiB/s wr, 11 op/s 2023-05-08T12:53:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:43 smithi096 ceph-mon[124666]: pgmap v17634: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 633 KiB/s rd, 631 KiB/s wr, 11 op/s 2023-05-08T12:53:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:43 smithi186 ceph-mon[126480]: pgmap v17634: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 633 KiB/s rd, 631 KiB/s wr, 11 op/s 2023-05-08T12:53:44.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32963.877333 secs 2023-05-08T12:53:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32963.877333 secs 2023-05-08T12:53:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32963.877333 secs 2023-05-08T12:53:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:45 smithi096 ceph-mon[124666]: pgmap v17635: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 633 KiB/s rd, 631 KiB/s wr, 11 op/s 2023-05-08T12:53:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:45 smithi186 ceph-mon[126480]: pgmap v17635: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 633 KiB/s rd, 631 KiB/s wr, 11 op/s 2023-05-08T12:53:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:45 smithi133 ceph-mon[125939]: pgmap v17635: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 633 KiB/s rd, 631 KiB/s wr, 11 op/s 2023-05-08T12:53:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:47 smithi096 ceph-mon[124666]: pgmap v17636: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 433 KiB/s wr, 9 op/s 2023-05-08T12:53:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:47 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:53:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:47 smithi186 ceph-mon[126480]: pgmap v17636: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 433 KiB/s wr, 9 op/s 2023-05-08T12:53:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:47 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:53:48.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:47 smithi133 ceph-mon[125939]: pgmap v17636: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 433 KiB/s wr, 9 op/s 2023-05-08T12:53:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:47 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:53:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:48 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:53:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:48 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T12:53:49.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:48 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:53:49.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:53:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:48 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:53:49.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:48 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T12:53:49.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:48 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:53:49.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:53:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:48 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:53:49.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:48 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T12:53:49.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:48 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:53:49.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:53:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:49 smithi186 ceph-mon[126480]: pgmap v17637: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 388 KiB/s wr, 8 op/s 2023-05-08T12:53:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:53:50.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:53:50.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32968.877460 secs 2023-05-08T12:53:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:49 smithi133 ceph-mon[125939]: pgmap v17637: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 388 KiB/s wr, 8 op/s 2023-05-08T12:53:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:53:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:53:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32968.877460 secs 2023-05-08T12:53:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:49 smithi096 ceph-mon[124666]: pgmap v17637: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 388 KiB/s wr, 8 op/s 2023-05-08T12:53:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:53:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:53:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32968.877460 secs 2023-05-08T12:53:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:51 smithi186 ceph-mon[126480]: pgmap v17638: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 630 KiB/s rd, 378 KiB/s wr, 12 op/s 2023-05-08T12:53:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32970.168934 secs 2023-05-08T12:53:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:51 smithi133 ceph-mon[125939]: pgmap v17638: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 630 KiB/s rd, 378 KiB/s wr, 12 op/s 2023-05-08T12:53:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32970.168934 secs 2023-05-08T12:53:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:51 smithi096 ceph-mon[124666]: pgmap v17638: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 630 KiB/s rd, 378 KiB/s wr, 12 op/s 2023-05-08T12:53:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32970.168934 secs 2023-05-08T12:53:53.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:52 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:53:53.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:52 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:53:53.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:52 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:53:53.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:52 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:53:53.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:52 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:53:53.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:52 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:53:53.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:52 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:53:53.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:52 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:53:53.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:52 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:53:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:53 smithi186 ceph-mon[126480]: pgmap v17639: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 272 KiB/s wr, 7 op/s 2023-05-08T12:53:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:53 smithi133 ceph-mon[125939]: pgmap v17639: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 272 KiB/s wr, 7 op/s 2023-05-08T12:53:54.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:53 smithi096 ceph-mon[124666]: pgmap v17639: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 272 KiB/s wr, 7 op/s 2023-05-08T12:53:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32973.322518 secs 2023-05-08T12:53:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:53:55.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32973.322518 secs 2023-05-08T12:53:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:53:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32973.322518 secs 2023-05-08T12:53:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:53:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:55 smithi186 ceph-mon[126480]: pgmap v17640: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 272 KiB/s wr, 7 op/s 2023-05-08T12:53:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:55 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:53:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:55 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:53:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:55 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:53:56.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:55 smithi133 ceph-mon[125939]: pgmap v17640: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 272 KiB/s wr, 7 op/s 2023-05-08T12:53:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:55 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:53:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:55 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:53:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:55 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:53:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:55 smithi096 ceph-mon[124666]: pgmap v17640: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 272 KiB/s wr, 7 op/s 2023-05-08T12:53:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:55 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:53:56.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:55 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:53:56.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:55 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:53:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:56 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:53:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:56 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T12:53:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:56 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T12:53:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:56 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:53:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32975.168993 secs 2023-05-08T12:53:57.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T12:53:57.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:53:57.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:53:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:56 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:53:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:56 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T12:53:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:56 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T12:53:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:56 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:53:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32975.168993 secs 2023-05-08T12:53:57.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T12:53:57.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:53:57.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:53:57.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:56 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:53:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:56 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T12:53:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:56 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T12:53:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:56 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:53:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32975.168993 secs 2023-05-08T12:53:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T12:53:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:53:57.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:53:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:57 smithi186 ceph-mon[126480]: pgmap v17641: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 831 KiB/s wr, 12 op/s 2023-05-08T12:53:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:53:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:53:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:57 smithi133 ceph-mon[125939]: pgmap v17641: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 831 KiB/s wr, 12 op/s 2023-05-08T12:53:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:53:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:53:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:57 smithi096 ceph-mon[124666]: pgmap v17641: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 831 KiB/s wr, 12 op/s 2023-05-08T12:53:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:53:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:54:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:59 smithi186 ceph-mon[126480]: pgmap v17642: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 827 KiB/s rd, 577 KiB/s wr, 9 op/s 2023-05-08T12:54:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32978.322626 secs 2023-05-08T12:54:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:53:59 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:54:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:59 smithi133 ceph-mon[125939]: pgmap v17642: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 827 KiB/s rd, 577 KiB/s wr, 9 op/s 2023-05-08T12:54:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32978.322626 secs 2023-05-08T12:54:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:53:59 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:54:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:59 smithi096 ceph-mon[124666]: pgmap v17642: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 827 KiB/s rd, 577 KiB/s wr, 9 op/s 2023-05-08T12:54:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32978.322626 secs 2023-05-08T12:54:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:53:59 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:54:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32980.169107 secs 2023-05-08T12:54:01.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32980.169107 secs 2023-05-08T12:54:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32980.169107 secs 2023-05-08T12:54:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:01 smithi186 ceph-mon[126480]: pgmap v17643: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2023-05-08T12:54:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:01 smithi133 ceph-mon[125939]: pgmap v17643: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2023-05-08T12:54:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:01 smithi096 ceph-mon[124666]: pgmap v17643: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2023-05-08T12:54:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:03 smithi186 ceph-mon[126480]: pgmap v17644: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T12:54:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:03 smithi133 ceph-mon[125939]: pgmap v17644: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T12:54:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:03 smithi096 ceph-mon[124666]: pgmap v17644: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T12:54:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32983.322742 secs 2023-05-08T12:54:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32983.877741 secs 2023-05-08T12:54:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32983.322742 secs 2023-05-08T12:54:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32983.877741 secs 2023-05-08T12:54:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32983.322742 secs 2023-05-08T12:54:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32983.877741 secs 2023-05-08T12:54:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:05 smithi186 ceph-mon[126480]: pgmap v17645: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T12:54:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:05 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:54:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:54:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:54:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:05 smithi133 ceph-mon[125939]: pgmap v17645: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T12:54:06.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:05 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:54:06.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:54:06.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:54:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:05 smithi096 ceph-mon[124666]: pgmap v17645: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T12:54:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:05 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:54:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:54:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:54:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:07 smithi186 ceph-mon[126480]: pgmap v17646: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 28 op/s 2023-05-08T12:54:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:07 smithi133 ceph-mon[125939]: pgmap v17646: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 28 op/s 2023-05-08T12:54:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:07 smithi096 ceph-mon[124666]: pgmap v17646: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 28 op/s 2023-05-08T12:54:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:08 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:54:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:08 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:54:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:08 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:54:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:09 smithi186 ceph-mon[126480]: pgmap v17647: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 23 op/s 2023-05-08T12:54:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32988.322861 secs 2023-05-08T12:54:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:54:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:54:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32988.877859 secs 2023-05-08T12:54:10.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:09 smithi133 ceph-mon[125939]: pgmap v17647: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 23 op/s 2023-05-08T12:54:10.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32988.322861 secs 2023-05-08T12:54:10.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:54:10.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:54:10.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32988.877859 secs 2023-05-08T12:54:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:09 smithi096 ceph-mon[124666]: pgmap v17647: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 23 op/s 2023-05-08T12:54:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32988.322861 secs 2023-05-08T12:54:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:54:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:54:10.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32988.877859 secs 2023-05-08T12:54:12.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:11 smithi133 ceph-mon[125939]: pgmap v17648: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 26 op/s 2023-05-08T12:54:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:11 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:54:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:11 smithi096 ceph-mon[124666]: pgmap v17648: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 26 op/s 2023-05-08T12:54:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:11 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:54:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:11 smithi186 ceph-mon[126480]: pgmap v17648: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 26 op/s 2023-05-08T12:54:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:11 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:54:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:13 smithi133 ceph-mon[125939]: pgmap v17649: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 508 KiB/s rd, 555 KiB/s wr, 21 op/s 2023-05-08T12:54:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:13 smithi096 ceph-mon[124666]: pgmap v17649: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 508 KiB/s rd, 555 KiB/s wr, 21 op/s 2023-05-08T12:54:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:13 smithi186 ceph-mon[126480]: pgmap v17649: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 508 KiB/s rd, 555 KiB/s wr, 21 op/s 2023-05-08T12:54:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32993.322980 secs 2023-05-08T12:54:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32993.877981 secs 2023-05-08T12:54:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32993.322980 secs 2023-05-08T12:54:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32993.877981 secs 2023-05-08T12:54:15.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32993.322980 secs 2023-05-08T12:54:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32993.877981 secs 2023-05-08T12:54:16.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:15 smithi133 ceph-mon[125939]: pgmap v17650: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 508 KiB/s rd, 518 KiB/s wr, 21 op/s 2023-05-08T12:54:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:15 smithi096 ceph-mon[124666]: pgmap v17650: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 508 KiB/s rd, 518 KiB/s wr, 21 op/s 2023-05-08T12:54:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:15 smithi186 ceph-mon[126480]: pgmap v17650: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 508 KiB/s rd, 518 KiB/s wr, 21 op/s 2023-05-08T12:54:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:17 smithi133 ceph-mon[125939]: pgmap v17651: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 927 KiB/s rd, 902 KiB/s wr, 25 op/s 2023-05-08T12:54:18.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:17 smithi096 ceph-mon[124666]: pgmap v17651: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 927 KiB/s rd, 902 KiB/s wr, 25 op/s 2023-05-08T12:54:18.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:17 smithi186 ceph-mon[126480]: pgmap v17651: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 927 KiB/s rd, 902 KiB/s wr, 25 op/s 2023-05-08T12:54:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:19 smithi096 ceph-mon[124666]: pgmap v17652: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 547 KiB/s wr, 7 op/s 2023-05-08T12:54:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32998.323096 secs 2023-05-08T12:54:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 32998.878104 secs 2023-05-08T12:54:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:19 smithi186 ceph-mon[126480]: pgmap v17652: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 547 KiB/s wr, 7 op/s 2023-05-08T12:54:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32998.323096 secs 2023-05-08T12:54:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 32998.878104 secs 2023-05-08T12:54:20.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:19 smithi133 ceph-mon[125939]: pgmap v17652: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 547 KiB/s wr, 7 op/s 2023-05-08T12:54:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32998.323096 secs 2023-05-08T12:54:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 32998.878104 secs 2023-05-08T12:54:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:21 smithi096 ceph-mon[124666]: pgmap v17653: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 553 KiB/s rd, 548 KiB/s wr, 11 op/s 2023-05-08T12:54:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:21 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:54:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:21 smithi186 ceph-mon[126480]: pgmap v17653: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 553 KiB/s rd, 548 KiB/s wr, 11 op/s 2023-05-08T12:54:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:21 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:54:22.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:21 smithi133 ceph-mon[125939]: pgmap v17653: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 553 KiB/s rd, 548 KiB/s wr, 11 op/s 2023-05-08T12:54:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:21 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:54:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:23 smithi096 ceph-mon[124666]: pgmap v17654: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 819 KiB/s wr, 8 op/s 2023-05-08T12:54:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:23 smithi186 ceph-mon[126480]: pgmap v17654: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 819 KiB/s wr, 8 op/s 2023-05-08T12:54:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:23 smithi133 ceph-mon[125939]: pgmap v17654: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 819 KiB/s wr, 8 op/s 2023-05-08T12:54:25.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33003.323196 secs 2023-05-08T12:54:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:24 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:54:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:24 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:54:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33003.323196 secs 2023-05-08T12:54:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:24 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:54:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:24 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:54:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33003.323196 secs 2023-05-08T12:54:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:24 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:54:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:24 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:54:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:25 smithi186 ceph-mon[126480]: pgmap v17655: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 421 KiB/s rd, 656 KiB/s wr, 7 op/s 2023-05-08T12:54:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:25 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:54:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:25 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:54:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:25 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:54:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:25 smithi133 ceph-mon[125939]: pgmap v17655: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 421 KiB/s rd, 656 KiB/s wr, 7 op/s 2023-05-08T12:54:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:25 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:54:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:25 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:54:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:25 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:54:26.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:25 smithi096 ceph-mon[124666]: pgmap v17655: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 421 KiB/s rd, 656 KiB/s wr, 7 op/s 2023-05-08T12:54:26.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:25 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:54:26.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:25 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:54:26.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:25 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:54:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:26 smithi186 ceph-mon[126480]: osdmap e1180: 12 total, 12 up, 12 in 2023-05-08T12:54:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:26 smithi133 ceph-mon[125939]: osdmap e1180: 12 total, 12 up, 12 in 2023-05-08T12:54:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:26 smithi096 ceph-mon[124666]: osdmap e1180: 12 total, 12 up, 12 in 2023-05-08T12:54:28.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:27 smithi186 ceph-mon[126480]: pgmap v17657: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 891 KiB/s rd, 834 KiB/s wr, 13 op/s 2023-05-08T12:54:28.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:27 smithi133 ceph-mon[125939]: pgmap v17657: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 891 KiB/s rd, 834 KiB/s wr, 13 op/s 2023-05-08T12:54:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:27 smithi096 ceph-mon[124666]: pgmap v17657: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 891 KiB/s rd, 834 KiB/s wr, 13 op/s 2023-05-08T12:54:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:29 smithi186 ceph-mon[126480]: pgmap v17658: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 891 KiB/s rd, 834 KiB/s wr, 13 op/s 2023-05-08T12:54:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33008.323331 secs 2023-05-08T12:54:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:29 smithi133 ceph-mon[125939]: pgmap v17658: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 891 KiB/s rd, 834 KiB/s wr, 13 op/s 2023-05-08T12:54:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33008.323331 secs 2023-05-08T12:54:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:29 smithi096 ceph-mon[124666]: pgmap v17658: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 891 KiB/s rd, 834 KiB/s wr, 13 op/s 2023-05-08T12:54:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33008.323331 secs 2023-05-08T12:54:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:31 smithi186 ceph-mon[126480]: pgmap v17659: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T12:54:32.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:31 smithi133 ceph-mon[125939]: pgmap v17659: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T12:54:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:31 smithi096 ceph-mon[124666]: pgmap v17659: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T12:54:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:33 smithi186 ceph-mon[126480]: pgmap v17660: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 778 KiB/s wr, 14 op/s 2023-05-08T12:54:34.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:33 smithi133 ceph-mon[125939]: pgmap v17660: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 778 KiB/s wr, 14 op/s 2023-05-08T12:54:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:33 smithi096 ceph-mon[124666]: pgmap v17660: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 778 KiB/s wr, 14 op/s 2023-05-08T12:54:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33013.323460 secs 2023-05-08T12:54:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33013.323460 secs 2023-05-08T12:54:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33013.323460 secs 2023-05-08T12:54:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:35 smithi186 ceph-mon[126480]: pgmap v17661: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 778 KiB/s wr, 14 op/s 2023-05-08T12:54:36.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:35 smithi133 ceph-mon[125939]: pgmap v17661: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 778 KiB/s wr, 14 op/s 2023-05-08T12:54:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:35 smithi096 ceph-mon[124666]: pgmap v17661: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 778 KiB/s wr, 14 op/s 2023-05-08T12:54:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:37 smithi096 ceph-mon[124666]: pgmap v17662: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 502 KiB/s rd, 421 KiB/s wr, 9 op/s 2023-05-08T12:54:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:37 smithi096 ceph-mon[124666]: osdmap e1181: 12 total, 12 up, 12 in 2023-05-08T12:54:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:37 smithi186 ceph-mon[126480]: pgmap v17662: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 502 KiB/s rd, 421 KiB/s wr, 9 op/s 2023-05-08T12:54:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:37 smithi186 ceph-mon[126480]: osdmap e1181: 12 total, 12 up, 12 in 2023-05-08T12:54:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:37 smithi133 ceph-mon[125939]: pgmap v17662: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 502 KiB/s rd, 421 KiB/s wr, 9 op/s 2023-05-08T12:54:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:37 smithi133 ceph-mon[125939]: osdmap e1181: 12 total, 12 up, 12 in 2023-05-08T12:54:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:39 smithi096 ceph-mon[124666]: pgmap v17664: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 509 KiB/s rd, 427 KiB/s wr, 9 op/s 2023-05-08T12:54:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33018.323561 secs 2023-05-08T12:54:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33018.878604 secs 2023-05-08T12:54:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:39 smithi186 ceph-mon[126480]: pgmap v17664: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 509 KiB/s rd, 427 KiB/s wr, 9 op/s 2023-05-08T12:54:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33018.323561 secs 2023-05-08T12:54:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33018.878604 secs 2023-05-08T12:54:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:39 smithi133 ceph-mon[125939]: pgmap v17664: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 509 KiB/s rd, 427 KiB/s wr, 9 op/s 2023-05-08T12:54:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33018.323561 secs 2023-05-08T12:54:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33018.878604 secs 2023-05-08T12:54:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:40 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:54:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:40 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:54:41.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:40 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:54:41.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:40 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:54:41.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:40 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:54:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:40 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:54:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:40 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:54:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:40 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:54:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:40 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:54:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:40 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:54:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:40 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:54:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:40 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:54:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:41 smithi186 ceph-mon[126480]: pgmap v17665: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 286 KiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T12:54:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33020.170112 secs 2023-05-08T12:54:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:41 smithi133 ceph-mon[125939]: pgmap v17665: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 286 KiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T12:54:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33020.170112 secs 2023-05-08T12:54:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:41 smithi096 ceph-mon[124666]: pgmap v17665: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 286 KiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T12:54:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33020.170112 secs 2023-05-08T12:54:44.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:43 smithi186 ceph-mon[126480]: pgmap v17666: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T12:54:44.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:43 smithi133 ceph-mon[125939]: pgmap v17666: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T12:54:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:43 smithi096 ceph-mon[124666]: pgmap v17666: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T12:54:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33023.323680 secs 2023-05-08T12:54:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33023.878729 secs 2023-05-08T12:54:45.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33023.323680 secs 2023-05-08T12:54:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33023.878729 secs 2023-05-08T12:54:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33023.323680 secs 2023-05-08T12:54:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33023.878729 secs 2023-05-08T12:54:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:45 smithi186 ceph-mon[126480]: pgmap v17667: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T12:54:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:45 smithi133 ceph-mon[125939]: pgmap v17667: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T12:54:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:45 smithi096 ceph-mon[124666]: pgmap v17667: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T12:54:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:47 smithi186 ceph-mon[126480]: pgmap v17668: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T12:54:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:47 smithi133 ceph-mon[125939]: pgmap v17668: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T12:54:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:47 smithi096 ceph-mon[124666]: pgmap v17668: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T12:54:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:54:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:54:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:54:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:49 smithi186 ceph-mon[126480]: pgmap v17669: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T12:54:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33028.323844 secs 2023-05-08T12:54:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:54:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:54:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:54:50.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:49 smithi133 ceph-mon[125939]: pgmap v17669: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T12:54:50.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33028.323844 secs 2023-05-08T12:54:50.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:54:50.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:54:50.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:54:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:49 smithi096 ceph-mon[124666]: pgmap v17669: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T12:54:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33028.323844 secs 2023-05-08T12:54:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:54:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:54:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:54:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:51 smithi186 ceph-mon[126480]: pgmap v17670: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.2 MiB/s wr, 16 op/s 2023-05-08T12:54:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33030.170320 secs 2023-05-08T12:54:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:51 smithi133 ceph-mon[125939]: pgmap v17670: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.2 MiB/s wr, 16 op/s 2023-05-08T12:54:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33030.170320 secs 2023-05-08T12:54:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:51 smithi096 ceph-mon[124666]: pgmap v17670: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.2 MiB/s wr, 16 op/s 2023-05-08T12:54:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33030.170320 secs 2023-05-08T12:54:53.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:54:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:54:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:54:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:53 smithi186 ceph-mon[126480]: pgmap v17671: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T12:54:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:54:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:54:54.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:54:54.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:53 smithi133 ceph-mon[125939]: pgmap v17671: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T12:54:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:54:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:54:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:54:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:53 smithi096 ceph-mon[124666]: pgmap v17671: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T12:54:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:54:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:54:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:54:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33033.323921 secs 2023-05-08T12:54:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33033.879021 secs 2023-05-08T12:54:55.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33033.323921 secs 2023-05-08T12:54:55.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33033.879021 secs 2023-05-08T12:54:55.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33033.323921 secs 2023-05-08T12:54:55.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33033.879021 secs 2023-05-08T12:54:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:55 smithi186 ceph-mon[126480]: pgmap v17672: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T12:54:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:55 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:54:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33035.170403 secs 2023-05-08T12:54:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:55 smithi133 ceph-mon[125939]: pgmap v17672: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T12:54:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:55 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:54:56.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33035.170403 secs 2023-05-08T12:54:56.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:55 smithi096 ceph-mon[124666]: pgmap v17672: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T12:54:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:55 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:54:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33035.170403 secs 2023-05-08T12:54:58.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:57 smithi096 ceph-mon[124666]: pgmap v17673: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 18 op/s 2023-05-08T12:54:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:57 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:54:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:54:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:54:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:57 smithi186 ceph-mon[126480]: pgmap v17673: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 18 op/s 2023-05-08T12:54:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:57 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:54:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:54:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:54:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:57 smithi133 ceph-mon[125939]: pgmap v17673: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 18 op/s 2023-05-08T12:54:58.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:57 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:54:58.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:54:58.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:54:59.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:54:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:54:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:54:59.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:54:59.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:54:59.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:54:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:54:59.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:54:59.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:54:59.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:54:59.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:54:59.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:54:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:54:59.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:54:59.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:54:59.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:54:59.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:54:59.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:55:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:59 smithi133 ceph-mon[125939]: pgmap v17674: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.3 MiB/s wr, 12 op/s 2023-05-08T12:55:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33038.324000 secs 2023-05-08T12:55:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:55:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:55:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:55:00.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:55:00.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:55:00.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:55:00.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:55:00.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:55:00.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:55:00.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:55:00.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:55:00.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:55:00.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:55:00.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:55:00.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:55:00.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:55:00.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:55:00.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:55:00.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:54:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33038.879169 secs 2023-05-08T12:55:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:59 smithi096 ceph-mon[124666]: pgmap v17674: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.3 MiB/s wr, 12 op/s 2023-05-08T12:55:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33038.324000 secs 2023-05-08T12:55:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:55:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:55:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:55:00.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:55:00.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:55:00.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:55:00.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:55:00.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:55:00.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:55:00.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:55:00.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:55:00.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:55:00.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:55:00.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:55:00.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:55:00.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:55:00.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:55:00.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:55:00.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:54:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33038.879169 secs 2023-05-08T12:55:00.374 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:59 smithi186 ceph-mon[126480]: pgmap v17674: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.3 MiB/s wr, 12 op/s 2023-05-08T12:55:00.374 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33038.324000 secs 2023-05-08T12:55:00.375 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:55:00.375 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:55:00.375 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:55:00.375 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:55:00.375 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:55:00.375 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:55:00.375 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:55:00.375 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:55:00.376 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:55:00.376 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:55:00.376 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:55:00.376 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:55:00.376 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:55:00.376 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:55:00.376 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T12:55:00.377 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:55:00.377 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:55:00.377 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:55:00.377 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:54:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33038.879169 secs 2023-05-08T12:55:01.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:00 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi133 to 129.6M 2023-05-08T12:55:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:00 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi186 to 119.1M 2023-05-08T12:55:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:00 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi133 to 135959203: error parsing value: Value '135959203' is below minimum 939524096 2023-05-08T12:55:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:00 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi186 to 124970553: error parsing value: Value '124970553' is below minimum 939524096 2023-05-08T12:55:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:00 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:55:01.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:00 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T12:55:01.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:00 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T12:55:01.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:00 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:55:01.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33040.170537 secs 2023-05-08T12:55:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:00 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi133 to 129.6M 2023-05-08T12:55:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:00 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi186 to 119.1M 2023-05-08T12:55:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:00 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi133 to 135959203: error parsing value: Value '135959203' is below minimum 939524096 2023-05-08T12:55:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:00 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi186 to 124970553: error parsing value: Value '124970553' is below minimum 939524096 2023-05-08T12:55:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:00 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:55:01.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:00 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T12:55:01.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:00 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T12:55:01.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:00 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:55:01.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33040.170537 secs 2023-05-08T12:55:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:00 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi133 to 129.6M 2023-05-08T12:55:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:00 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi186 to 119.1M 2023-05-08T12:55:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:00 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi133 to 135959203: error parsing value: Value '135959203' is below minimum 939524096 2023-05-08T12:55:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:00 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi186 to 124970553: error parsing value: Value '124970553' is below minimum 939524096 2023-05-08T12:55:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:00 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:55:01.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:00 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T12:55:01.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:00 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T12:55:01.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:00 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:55:01.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33040.170537 secs 2023-05-08T12:55:02.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:01 smithi133 ceph-mon[125939]: pgmap v17675: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 18 op/s 2023-05-08T12:55:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:01 smithi096 ceph-mon[124666]: pgmap v17675: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 18 op/s 2023-05-08T12:55:02.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:01 smithi186 ceph-mon[126480]: pgmap v17675: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 18 op/s 2023-05-08T12:55:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:03 smithi133 ceph-mon[125939]: pgmap v17676: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T12:55:04.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:03 smithi096 ceph-mon[124666]: pgmap v17676: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T12:55:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:03 smithi186 ceph-mon[126480]: pgmap v17676: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T12:55:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33043.324125 secs 2023-05-08T12:55:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33043.879293 secs 2023-05-08T12:55:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33043.324125 secs 2023-05-08T12:55:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33043.879293 secs 2023-05-08T12:55:05.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33043.324125 secs 2023-05-08T12:55:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33043.879293 secs 2023-05-08T12:55:06.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:05 smithi133 ceph-mon[125939]: pgmap v17677: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T12:55:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33045.170682 secs 2023-05-08T12:55:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:05 smithi096 ceph-mon[124666]: pgmap v17677: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T12:55:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33045.170682 secs 2023-05-08T12:55:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:05 smithi186 ceph-mon[126480]: pgmap v17677: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T12:55:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33045.170682 secs 2023-05-08T12:55:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:07 smithi096 ceph-mon[124666]: pgmap v17678: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 32 op/s 2023-05-08T12:55:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:07 smithi186 ceph-mon[126480]: pgmap v17678: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 32 op/s 2023-05-08T12:55:08.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:07 smithi133 ceph-mon[125939]: pgmap v17678: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 32 op/s 2023-05-08T12:55:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:09 smithi096 ceph-mon[124666]: pgmap v17679: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 25 op/s 2023-05-08T12:55:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33048.324260 secs 2023-05-08T12:55:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33048.879417 secs 2023-05-08T12:55:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:09 smithi186 ceph-mon[126480]: pgmap v17679: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 25 op/s 2023-05-08T12:55:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33048.324260 secs 2023-05-08T12:55:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33048.879417 secs 2023-05-08T12:55:10.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:09 smithi133 ceph-mon[125939]: pgmap v17679: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 25 op/s 2023-05-08T12:55:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33048.324260 secs 2023-05-08T12:55:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33048.879417 secs 2023-05-08T12:55:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:11 smithi186 ceph-mon[126480]: pgmap v17680: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.5 MiB/s wr, 30 op/s 2023-05-08T12:55:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33050.170807 secs 2023-05-08T12:55:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:11 smithi186 ceph-mon[126480]: osdmap e1182: 12 total, 12 up, 12 in 2023-05-08T12:55:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:11 smithi133 ceph-mon[125939]: pgmap v17680: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.5 MiB/s wr, 30 op/s 2023-05-08T12:55:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33050.170807 secs 2023-05-08T12:55:12.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:11 smithi133 ceph-mon[125939]: osdmap e1182: 12 total, 12 up, 12 in 2023-05-08T12:55:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:11 smithi096 ceph-mon[124666]: pgmap v17680: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.5 MiB/s wr, 30 op/s 2023-05-08T12:55:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33050.170807 secs 2023-05-08T12:55:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:11 smithi096 ceph-mon[124666]: osdmap e1182: 12 total, 12 up, 12 in 2023-05-08T12:55:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:13 smithi186 ceph-mon[126480]: pgmap v17682: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 29 op/s 2023-05-08T12:55:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:13 smithi133 ceph-mon[125939]: pgmap v17682: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 29 op/s 2023-05-08T12:55:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:13 smithi096 ceph-mon[124666]: pgmap v17682: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 29 op/s 2023-05-08T12:55:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33053.324324 secs 2023-05-08T12:55:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33053.879443 secs 2023-05-08T12:55:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33053.324324 secs 2023-05-08T12:55:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33053.879443 secs 2023-05-08T12:55:15.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33053.324324 secs 2023-05-08T12:55:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33053.879443 secs 2023-05-08T12:55:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:15 smithi186 ceph-mon[126480]: pgmap v17683: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 29 op/s 2023-05-08T12:55:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:15 smithi133 ceph-mon[125939]: pgmap v17683: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 29 op/s 2023-05-08T12:55:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:15 smithi096 ceph-mon[124666]: pgmap v17683: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 29 op/s 2023-05-08T12:55:17.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33055.170935 secs 2023-05-08T12:55:17.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33055.170935 secs 2023-05-08T12:55:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33055.170935 secs 2023-05-08T12:55:18.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:17 smithi186 ceph-mon[126480]: pgmap v17684: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 834 KiB/s wr, 11 op/s 2023-05-08T12:55:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:17 smithi133 ceph-mon[125939]: pgmap v17684: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 834 KiB/s wr, 11 op/s 2023-05-08T12:55:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:17 smithi096 ceph-mon[124666]: pgmap v17684: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 834 KiB/s wr, 11 op/s 2023-05-08T12:55:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:19 smithi186 ceph-mon[126480]: pgmap v17685: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 834 KiB/s wr, 11 op/s 2023-05-08T12:55:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33058.324414 secs 2023-05-08T12:55:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33058.879548 secs 2023-05-08T12:55:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:19 smithi133 ceph-mon[125939]: pgmap v17685: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 834 KiB/s wr, 11 op/s 2023-05-08T12:55:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33058.324414 secs 2023-05-08T12:55:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33058.879548 secs 2023-05-08T12:55:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:19 smithi096 ceph-mon[124666]: pgmap v17685: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 834 KiB/s wr, 11 op/s 2023-05-08T12:55:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33058.324414 secs 2023-05-08T12:55:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33058.879548 secs 2023-05-08T12:55:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:21 smithi186 ceph-mon[126480]: pgmap v17686: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 709 KiB/s rd, 344 KiB/s wr, 9 op/s 2023-05-08T12:55:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33060.171058 secs 2023-05-08T12:55:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:21 smithi186 ceph-mon[126480]: osdmap e1183: 12 total, 12 up, 12 in 2023-05-08T12:55:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:21 smithi133 ceph-mon[125939]: pgmap v17686: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 709 KiB/s rd, 344 KiB/s wr, 9 op/s 2023-05-08T12:55:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33060.171058 secs 2023-05-08T12:55:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:21 smithi133 ceph-mon[125939]: osdmap e1183: 12 total, 12 up, 12 in 2023-05-08T12:55:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:21 smithi096 ceph-mon[124666]: pgmap v17686: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 709 KiB/s rd, 344 KiB/s wr, 9 op/s 2023-05-08T12:55:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33060.171058 secs 2023-05-08T12:55:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:21 smithi096 ceph-mon[124666]: osdmap e1183: 12 total, 12 up, 12 in 2023-05-08T12:55:24.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:23 smithi186 ceph-mon[126480]: pgmap v17688: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 709 KiB/s rd, 344 KiB/s wr, 9 op/s 2023-05-08T12:55:24.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:23 smithi133 ceph-mon[125939]: pgmap v17688: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 709 KiB/s rd, 344 KiB/s wr, 9 op/s 2023-05-08T12:55:24.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:23 smithi096 ceph-mon[124666]: pgmap v17688: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 709 KiB/s rd, 344 KiB/s wr, 9 op/s 2023-05-08T12:55:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33063.324509 secs 2023-05-08T12:55:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33063.879669 secs 2023-05-08T12:55:25.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33063.324509 secs 2023-05-08T12:55:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33063.879669 secs 2023-05-08T12:55:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33063.324509 secs 2023-05-08T12:55:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33063.879669 secs 2023-05-08T12:55:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:25 smithi186 ceph-mon[126480]: pgmap v17689: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 709 KiB/s rd, 344 KiB/s wr, 9 op/s 2023-05-08T12:55:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:25 smithi133 ceph-mon[125939]: pgmap v17689: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 709 KiB/s rd, 344 KiB/s wr, 9 op/s 2023-05-08T12:55:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:25 smithi096 ceph-mon[124666]: pgmap v17689: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 709 KiB/s rd, 344 KiB/s wr, 9 op/s 2023-05-08T12:55:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33065.171180 secs 2023-05-08T12:55:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33065.171180 secs 2023-05-08T12:55:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33065.171180 secs 2023-05-08T12:55:28.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:27 smithi186 ceph-mon[126480]: pgmap v17690: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 179 KiB/s wr, 9 op/s 2023-05-08T12:55:28.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:27 smithi133 ceph-mon[125939]: pgmap v17690: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 179 KiB/s wr, 9 op/s 2023-05-08T12:55:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:27 smithi096 ceph-mon[124666]: pgmap v17690: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 179 KiB/s wr, 9 op/s 2023-05-08T12:55:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:29 smithi186 ceph-mon[126480]: pgmap v17691: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 179 KiB/s wr, 9 op/s 2023-05-08T12:55:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33068.324645 secs 2023-05-08T12:55:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33068.879789 secs 2023-05-08T12:55:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:29 smithi133 ceph-mon[125939]: pgmap v17691: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 179 KiB/s wr, 9 op/s 2023-05-08T12:55:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33068.324645 secs 2023-05-08T12:55:30.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33068.879789 secs 2023-05-08T12:55:30.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:29 smithi096 ceph-mon[124666]: pgmap v17691: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 179 KiB/s wr, 9 op/s 2023-05-08T12:55:30.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33068.324645 secs 2023-05-08T12:55:30.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33068.879789 secs 2023-05-08T12:55:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:31 smithi186 ceph-mon[126480]: pgmap v17692: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 153 KiB/s wr, 9 op/s 2023-05-08T12:55:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33070.171303 secs 2023-05-08T12:55:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:31 smithi133 ceph-mon[125939]: pgmap v17692: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 153 KiB/s wr, 9 op/s 2023-05-08T12:55:32.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33070.171303 secs 2023-05-08T12:55:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:31 smithi096 ceph-mon[124666]: pgmap v17692: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 153 KiB/s wr, 9 op/s 2023-05-08T12:55:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33070.171303 secs 2023-05-08T12:55:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:33 smithi186 ceph-mon[126480]: pgmap v17693: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 151 KiB/s wr, 9 op/s 2023-05-08T12:55:34.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:33 smithi133 ceph-mon[125939]: pgmap v17693: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 151 KiB/s wr, 9 op/s 2023-05-08T12:55:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:33 smithi096 ceph-mon[124666]: pgmap v17693: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 151 KiB/s wr, 9 op/s 2023-05-08T12:55:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33073.324790 secs 2023-05-08T12:55:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33073.879869 secs 2023-05-08T12:55:35.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33073.324790 secs 2023-05-08T12:55:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33073.879869 secs 2023-05-08T12:55:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33073.324790 secs 2023-05-08T12:55:35.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33073.879869 secs 2023-05-08T12:55:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:35 smithi186 ceph-mon[126480]: pgmap v17694: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 128 KiB/s wr, 7 op/s 2023-05-08T12:55:36.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:35 smithi133 ceph-mon[125939]: pgmap v17694: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 128 KiB/s wr, 7 op/s 2023-05-08T12:55:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:35 smithi096 ceph-mon[124666]: pgmap v17694: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 128 KiB/s wr, 7 op/s 2023-05-08T12:55:37.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33075.171425 secs 2023-05-08T12:55:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33075.171425 secs 2023-05-08T12:55:37.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33075.171425 secs 2023-05-08T12:55:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:37 smithi186 ceph-mon[126480]: pgmap v17695: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 405 KiB/s rd, 402 KiB/s wr, 11 op/s 2023-05-08T12:55:38.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:37 smithi133 ceph-mon[125939]: pgmap v17695: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 405 KiB/s rd, 402 KiB/s wr, 11 op/s 2023-05-08T12:55:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:37 smithi096 ceph-mon[124666]: pgmap v17695: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 405 KiB/s rd, 402 KiB/s wr, 11 op/s 2023-05-08T12:55:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:39 smithi186 ceph-mon[126480]: pgmap v17696: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 275 KiB/s wr, 7 op/s 2023-05-08T12:55:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33078.324915 secs 2023-05-08T12:55:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33078.879991 secs 2023-05-08T12:55:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:39 smithi133 ceph-mon[125939]: pgmap v17696: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 275 KiB/s wr, 7 op/s 2023-05-08T12:55:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33078.324915 secs 2023-05-08T12:55:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33078.879991 secs 2023-05-08T12:55:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:39 smithi096 ceph-mon[124666]: pgmap v17696: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 275 KiB/s wr, 7 op/s 2023-05-08T12:55:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33078.324915 secs 2023-05-08T12:55:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33078.879991 secs 2023-05-08T12:55:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33080.171555 secs 2023-05-08T12:55:41.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33080.171555 secs 2023-05-08T12:55:41.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33080.171555 secs 2023-05-08T12:55:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:41 smithi186 ceph-mon[126480]: pgmap v17697: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 405 KiB/s wr, 10 op/s 2023-05-08T12:55:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:41 smithi133 ceph-mon[125939]: pgmap v17697: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 405 KiB/s wr, 10 op/s 2023-05-08T12:55:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:41 smithi096 ceph-mon[124666]: pgmap v17697: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 405 KiB/s wr, 10 op/s 2023-05-08T12:55:44.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:43 smithi186 ceph-mon[126480]: pgmap v17698: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 405 KiB/s wr, 6 op/s 2023-05-08T12:55:44.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:43 smithi133 ceph-mon[125939]: pgmap v17698: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 405 KiB/s wr, 6 op/s 2023-05-08T12:55:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:43 smithi096 ceph-mon[124666]: pgmap v17698: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 405 KiB/s wr, 6 op/s 2023-05-08T12:55:45.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33083.325026 secs 2023-05-08T12:55:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33083.880107 secs 2023-05-08T12:55:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33083.325026 secs 2023-05-08T12:55:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33083.880107 secs 2023-05-08T12:55:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33083.325026 secs 2023-05-08T12:55:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33083.880107 secs 2023-05-08T12:55:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:45 smithi186 ceph-mon[126480]: pgmap v17699: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 405 KiB/s wr, 6 op/s 2023-05-08T12:55:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:45 smithi133 ceph-mon[125939]: pgmap v17699: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 405 KiB/s wr, 6 op/s 2023-05-08T12:55:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:45 smithi096 ceph-mon[124666]: pgmap v17699: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 405 KiB/s wr, 6 op/s 2023-05-08T12:55:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:47 smithi186 ceph-mon[126480]: pgmap v17700: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 673 KiB/s rd, 670 KiB/s wr, 10 op/s 2023-05-08T12:55:48.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:47 smithi133 ceph-mon[125939]: pgmap v17700: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 673 KiB/s rd, 670 KiB/s wr, 10 op/s 2023-05-08T12:55:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:47 smithi096 ceph-mon[124666]: pgmap v17700: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 673 KiB/s rd, 670 KiB/s wr, 10 op/s 2023-05-08T12:55:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:55:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:55:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:55:50.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:49 smithi133 ceph-mon[125939]: pgmap v17701: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 398 KiB/s rd, 395 KiB/s wr, 6 op/s 2023-05-08T12:55:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33088.325080 secs 2023-05-08T12:55:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:55:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:55:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:55:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33088.880235 secs 2023-05-08T12:55:50.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:49 smithi096 ceph-mon[124666]: pgmap v17701: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 398 KiB/s rd, 395 KiB/s wr, 6 op/s 2023-05-08T12:55:50.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33088.325080 secs 2023-05-08T12:55:50.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:55:50.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:55:50.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:55:50.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33088.880235 secs 2023-05-08T12:55:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:49 smithi186 ceph-mon[126480]: pgmap v17701: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 398 KiB/s rd, 395 KiB/s wr, 6 op/s 2023-05-08T12:55:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33088.325080 secs 2023-05-08T12:55:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:55:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:55:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:55:50.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33088.880235 secs 2023-05-08T12:55:52.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:51 smithi133 ceph-mon[125939]: pgmap v17702: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 874 KiB/s rd, 679 KiB/s wr, 10 op/s 2023-05-08T12:55:52.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:51 smithi096 ceph-mon[124666]: pgmap v17702: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 874 KiB/s rd, 679 KiB/s wr, 10 op/s 2023-05-08T12:55:52.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:51 smithi186 ceph-mon[126480]: pgmap v17702: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 874 KiB/s rd, 679 KiB/s wr, 10 op/s 2023-05-08T12:55:54.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:53 smithi133 ceph-mon[125939]: pgmap v17703: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 873 KiB/s rd, 548 KiB/s wr, 7 op/s 2023-05-08T12:55:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:53 smithi096 ceph-mon[124666]: pgmap v17703: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 873 KiB/s rd, 548 KiB/s wr, 7 op/s 2023-05-08T12:55:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:53 smithi186 ceph-mon[126480]: pgmap v17703: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 873 KiB/s rd, 548 KiB/s wr, 7 op/s 2023-05-08T12:55:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33093.325196 secs 2023-05-08T12:55:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33093.325196 secs 2023-05-08T12:55:55.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33093.325196 secs 2023-05-08T12:55:56.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:55 smithi133 ceph-mon[125939]: pgmap v17704: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 873 KiB/s rd, 548 KiB/s wr, 7 op/s 2023-05-08T12:55:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33095.171972 secs 2023-05-08T12:55:56.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:55 smithi096 ceph-mon[124666]: pgmap v17704: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 873 KiB/s rd, 548 KiB/s wr, 7 op/s 2023-05-08T12:55:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33095.171972 secs 2023-05-08T12:55:56.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:55 smithi186 ceph-mon[126480]: pgmap v17704: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 873 KiB/s rd, 548 KiB/s wr, 7 op/s 2023-05-08T12:55:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33095.171972 secs 2023-05-08T12:55:57.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:55:57.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:55:57.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:55:58.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:57 smithi133 ceph-mon[125939]: pgmap v17705: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 13 op/s 2023-05-08T12:55:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:55:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:55:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:55:58.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:57 smithi096 ceph-mon[124666]: pgmap v17705: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 13 op/s 2023-05-08T12:55:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:55:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:55:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:55:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:57 smithi186 ceph-mon[126480]: pgmap v17705: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 13 op/s 2023-05-08T12:55:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:55:58.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:55:58.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:55:59.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:58 smithi133 ceph-mon[125939]: pgmap v17706: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 833 KiB/s rd, 1.0 MiB/s wr, 9 op/s 2023-05-08T12:55:59.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:58 smithi096 ceph-mon[124666]: pgmap v17706: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 833 KiB/s rd, 1.0 MiB/s wr, 9 op/s 2023-05-08T12:55:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:58 smithi186 ceph-mon[126480]: pgmap v17706: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 833 KiB/s rd, 1.0 MiB/s wr, 9 op/s 2023-05-08T12:56:00.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33098.325359 secs 2023-05-08T12:56:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:56:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33098.880499 secs 2023-05-08T12:56:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:56:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:56:00.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:59 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:56:00.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:56:00.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:59 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T12:56:00.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:59 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T12:56:00.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:55:59 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:56:00.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33098.325359 secs 2023-05-08T12:56:00.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:56:00.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33098.880499 secs 2023-05-08T12:56:00.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:56:00.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:56:00.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:59 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:56:00.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:56:00.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:59 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T12:56:00.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:59 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T12:56:00.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:55:59 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:56:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33098.325359 secs 2023-05-08T12:56:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:56:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33098.880499 secs 2023-05-08T12:56:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:56:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:56:00.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:59 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:56:00.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:56:00.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:59 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T12:56:00.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:59 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T12:56:00.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:55:59 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:56:01.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:00 smithi133 ceph-mon[125939]: pgmap v17707: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 16 op/s 2023-05-08T12:56:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33100.172048 secs 2023-05-08T12:56:01.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:00 smithi096 ceph-mon[124666]: pgmap v17707: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 16 op/s 2023-05-08T12:56:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33100.172048 secs 2023-05-08T12:56:01.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:00 smithi186 ceph-mon[126480]: pgmap v17707: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 16 op/s 2023-05-08T12:56:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33100.172048 secs 2023-05-08T12:56:02.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:01 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:56:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:56:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:56:02.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:01 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:56:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:56:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:56:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:01 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:56:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:56:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:56:03.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:02 smithi133 ceph-mon[125939]: pgmap v17708: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 12 op/s 2023-05-08T12:56:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:02 smithi096 ceph-mon[124666]: pgmap v17708: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 12 op/s 2023-05-08T12:56:03.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:02 smithi186 ceph-mon[126480]: pgmap v17708: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 12 op/s 2023-05-08T12:56:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33103.325476 secs 2023-05-08T12:56:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:04 smithi096 ceph-mon[124666]: pgmap v17709: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 12 op/s 2023-05-08T12:56:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:04 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:56:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33103.325476 secs 2023-05-08T12:56:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:04 smithi186 ceph-mon[126480]: pgmap v17709: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 12 op/s 2023-05-08T12:56:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:04 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:56:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33103.325476 secs 2023-05-08T12:56:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:04 smithi133 ceph-mon[125939]: pgmap v17709: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 12 op/s 2023-05-08T12:56:05.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:04 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:56:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:56:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:56:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:56:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:56:06.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:56:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:56:07.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:07 smithi186 ceph-mon[126480]: pgmap v17710: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 30 op/s 2023-05-08T12:56:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:07 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:56:07.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:07 smithi133 ceph-mon[125939]: pgmap v17710: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 30 op/s 2023-05-08T12:56:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:07 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:56:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:07 smithi096 ceph-mon[124666]: pgmap v17710: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 30 op/s 2023-05-08T12:56:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:07 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:56:09.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:09 smithi186 ceph-mon[126480]: pgmap v17711: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.4 MiB/s wr, 24 op/s 2023-05-08T12:56:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:09 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:56:09.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:09 smithi133 ceph-mon[125939]: pgmap v17711: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.4 MiB/s wr, 24 op/s 2023-05-08T12:56:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:09 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:56:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:09 smithi096 ceph-mon[124666]: pgmap v17711: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.4 MiB/s wr, 24 op/s 2023-05-08T12:56:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:09 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:56:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33108.325605 secs 2023-05-08T12:56:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:10 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:56:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:10 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:56:10.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33108.325605 secs 2023-05-08T12:56:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:10 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:56:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:10 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:56:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33108.325605 secs 2023-05-08T12:56:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:10 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:56:10.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:10 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:56:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:11 smithi186 ceph-mon[126480]: pgmap v17712: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.1 MiB/s wr, 29 op/s 2023-05-08T12:56:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:11 smithi133 ceph-mon[125939]: pgmap v17712: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.1 MiB/s wr, 29 op/s 2023-05-08T12:56:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:11 smithi096 ceph-mon[124666]: pgmap v17712: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.1 MiB/s wr, 29 op/s 2023-05-08T12:56:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:12 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:56:12.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:12 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:56:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:12 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:56:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:13 smithi186 ceph-mon[126480]: pgmap v17713: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 23 op/s 2023-05-08T12:56:14.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:13 smithi133 ceph-mon[125939]: pgmap v17713: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 23 op/s 2023-05-08T12:56:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:13 smithi096 ceph-mon[124666]: pgmap v17713: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 23 op/s 2023-05-08T12:56:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33113.325700 secs 2023-05-08T12:56:15.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33113.325700 secs 2023-05-08T12:56:15.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33113.325700 secs 2023-05-08T12:56:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:15 smithi186 ceph-mon[126480]: pgmap v17714: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 23 op/s 2023-05-08T12:56:16.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:15 smithi133 ceph-mon[125939]: pgmap v17714: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 23 op/s 2023-05-08T12:56:16.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:15 smithi096 ceph-mon[124666]: pgmap v17714: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 23 op/s 2023-05-08T12:56:18.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:17 smithi186 ceph-mon[126480]: pgmap v17715: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 27 op/s 2023-05-08T12:56:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:17 smithi133 ceph-mon[125939]: pgmap v17715: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 27 op/s 2023-05-08T12:56:18.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:17 smithi096 ceph-mon[124666]: pgmap v17715: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 27 op/s 2023-05-08T12:56:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:19 smithi186 ceph-mon[126480]: pgmap v17716: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 803 KiB/s rd, 801 KiB/s wr, 8 op/s 2023-05-08T12:56:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33118.325823 secs 2023-05-08T12:56:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33118.881001 secs 2023-05-08T12:56:20.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:19 smithi133 ceph-mon[125939]: pgmap v17716: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 803 KiB/s rd, 801 KiB/s wr, 8 op/s 2023-05-08T12:56:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33118.325823 secs 2023-05-08T12:56:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33118.881001 secs 2023-05-08T12:56:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:19 smithi096 ceph-mon[124666]: pgmap v17716: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 803 KiB/s rd, 801 KiB/s wr, 8 op/s 2023-05-08T12:56:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33118.325823 secs 2023-05-08T12:56:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33118.881001 secs 2023-05-08T12:56:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:20 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:56:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:20 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:56:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:20 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:56:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:20 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:56:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:20 smithi186 ceph-mon[126480]: osdmap e1184: 12 total, 12 up, 12 in 2023-05-08T12:56:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:20 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:56:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:20 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:56:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:20 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:56:21.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:20 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:56:21.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:20 smithi133 ceph-mon[125939]: osdmap e1184: 12 total, 12 up, 12 in 2023-05-08T12:56:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:20 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:56:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:20 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:56:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:20 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:56:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:20 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:56:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:20 smithi096 ceph-mon[124666]: osdmap e1184: 12 total, 12 up, 12 in 2023-05-08T12:56:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:21 smithi186 ceph-mon[126480]: pgmap v17717: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 17 op/s 2023-05-08T12:56:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33120.172554 secs 2023-05-08T12:56:22.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:21 smithi133 ceph-mon[125939]: pgmap v17717: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 17 op/s 2023-05-08T12:56:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33120.172554 secs 2023-05-08T12:56:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:21 smithi096 ceph-mon[124666]: pgmap v17717: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 17 op/s 2023-05-08T12:56:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33120.172554 secs 2023-05-08T12:56:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:23 smithi186 ceph-mon[126480]: pgmap v17719: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 14 op/s 2023-05-08T12:56:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:23 smithi133 ceph-mon[125939]: pgmap v17719: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 14 op/s 2023-05-08T12:56:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:23 smithi096 ceph-mon[124666]: pgmap v17719: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 14 op/s 2023-05-08T12:56:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33123.325938 secs 2023-05-08T12:56:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33123.881096 secs 2023-05-08T12:56:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33123.325938 secs 2023-05-08T12:56:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33123.881096 secs 2023-05-08T12:56:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33123.325938 secs 2023-05-08T12:56:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33123.881096 secs 2023-05-08T12:56:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:25 smithi186 ceph-mon[126480]: pgmap v17720: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 14 op/s 2023-05-08T12:56:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33125.172675 secs 2023-05-08T12:56:26.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:25 smithi133 ceph-mon[125939]: pgmap v17720: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 14 op/s 2023-05-08T12:56:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33125.172675 secs 2023-05-08T12:56:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:25 smithi096 ceph-mon[124666]: pgmap v17720: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 14 op/s 2023-05-08T12:56:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33125.172675 secs 2023-05-08T12:56:28.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:27 smithi186 ceph-mon[126480]: pgmap v17721: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 15 op/s 2023-05-08T12:56:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:27 smithi133 ceph-mon[125939]: pgmap v17721: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 15 op/s 2023-05-08T12:56:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:27 smithi096 ceph-mon[124666]: pgmap v17721: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 15 op/s 2023-05-08T12:56:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:29 smithi186 ceph-mon[126480]: pgmap v17722: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 15 op/s 2023-05-08T12:56:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33128.326068 secs 2023-05-08T12:56:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33128.881240 secs 2023-05-08T12:56:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:29 smithi133 ceph-mon[125939]: pgmap v17722: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 15 op/s 2023-05-08T12:56:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33128.326068 secs 2023-05-08T12:56:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33128.881240 secs 2023-05-08T12:56:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:29 smithi096 ceph-mon[124666]: pgmap v17722: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 15 op/s 2023-05-08T12:56:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33128.326068 secs 2023-05-08T12:56:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33128.881240 secs 2023-05-08T12:56:31.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33130.172821 secs 2023-05-08T12:56:31.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33130.172821 secs 2023-05-08T12:56:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33130.172821 secs 2023-05-08T12:56:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:31 smithi186 ceph-mon[126480]: pgmap v17723: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 159 KiB/s wr, 9 op/s 2023-05-08T12:56:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:31 smithi186 ceph-mon[126480]: osdmap e1185: 12 total, 12 up, 12 in 2023-05-08T12:56:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:31 smithi133 ceph-mon[125939]: pgmap v17723: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 159 KiB/s wr, 9 op/s 2023-05-08T12:56:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:31 smithi133 ceph-mon[125939]: osdmap e1185: 12 total, 12 up, 12 in 2023-05-08T12:56:32.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:31 smithi096 ceph-mon[124666]: pgmap v17723: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 159 KiB/s wr, 9 op/s 2023-05-08T12:56:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:31 smithi096 ceph-mon[124666]: osdmap e1185: 12 total, 12 up, 12 in 2023-05-08T12:56:34.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:33 smithi133 ceph-mon[125939]: pgmap v17725: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 158 KiB/s wr, 8 op/s 2023-05-08T12:56:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:33 smithi096 ceph-mon[124666]: pgmap v17725: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 158 KiB/s wr, 8 op/s 2023-05-08T12:56:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:33 smithi186 ceph-mon[126480]: pgmap v17725: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 158 KiB/s wr, 8 op/s 2023-05-08T12:56:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33133.326177 secs 2023-05-08T12:56:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33133.881362 secs 2023-05-08T12:56:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33133.326177 secs 2023-05-08T12:56:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33133.881362 secs 2023-05-08T12:56:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33133.326177 secs 2023-05-08T12:56:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33133.881362 secs 2023-05-08T12:56:36.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:35 smithi133 ceph-mon[125939]: pgmap v17726: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 158 KiB/s wr, 8 op/s 2023-05-08T12:56:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33135.172873 secs 2023-05-08T12:56:36.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:35 smithi096 ceph-mon[124666]: pgmap v17726: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 158 KiB/s wr, 8 op/s 2023-05-08T12:56:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33135.172873 secs 2023-05-08T12:56:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:35 smithi186 ceph-mon[126480]: pgmap v17726: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 158 KiB/s wr, 8 op/s 2023-05-08T12:56:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33135.172873 secs 2023-05-08T12:56:38.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:37 smithi133 ceph-mon[125939]: pgmap v17727: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 339 KiB/s wr, 8 op/s 2023-05-08T12:56:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:37 smithi096 ceph-mon[124666]: pgmap v17727: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 339 KiB/s wr, 8 op/s 2023-05-08T12:56:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:37 smithi186 ceph-mon[126480]: pgmap v17727: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 339 KiB/s wr, 8 op/s 2023-05-08T12:56:40.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:39 smithi133 ceph-mon[125939]: pgmap v17728: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 339 KiB/s wr, 8 op/s 2023-05-08T12:56:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33138.326297 secs 2023-05-08T12:56:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33138.881461 secs 2023-05-08T12:56:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:39 smithi096 ceph-mon[124666]: pgmap v17728: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 339 KiB/s wr, 8 op/s 2023-05-08T12:56:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33138.326297 secs 2023-05-08T12:56:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33138.881461 secs 2023-05-08T12:56:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:39 smithi186 ceph-mon[126480]: pgmap v17728: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 339 KiB/s wr, 8 op/s 2023-05-08T12:56:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33138.326297 secs 2023-05-08T12:56:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33138.881461 secs 2023-05-08T12:56:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33140.172936 secs 2023-05-08T12:56:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33140.172936 secs 2023-05-08T12:56:41.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33140.172936 secs 2023-05-08T12:56:42.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:41 smithi133 ceph-mon[125939]: pgmap v17729: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 515 KiB/s rd, 512 KiB/s wr, 9 op/s 2023-05-08T12:56:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:41 smithi096 ceph-mon[124666]: pgmap v17729: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 515 KiB/s rd, 512 KiB/s wr, 9 op/s 2023-05-08T12:56:42.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:41 smithi186 ceph-mon[126480]: pgmap v17729: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 515 KiB/s rd, 512 KiB/s wr, 9 op/s 2023-05-08T12:56:44.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:43 smithi133 ceph-mon[125939]: pgmap v17730: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 503 KiB/s wr, 9 op/s 2023-05-08T12:56:44.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:43 smithi096 ceph-mon[124666]: pgmap v17730: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 503 KiB/s wr, 9 op/s 2023-05-08T12:56:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:43 smithi186 ceph-mon[126480]: pgmap v17730: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 503 KiB/s wr, 9 op/s 2023-05-08T12:56:45.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33143.326437 secs 2023-05-08T12:56:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33143.881531 secs 2023-05-08T12:56:45.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33143.326437 secs 2023-05-08T12:56:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33143.881531 secs 2023-05-08T12:56:45.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33143.326437 secs 2023-05-08T12:56:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33143.881531 secs 2023-05-08T12:56:46.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:45 smithi133 ceph-mon[125939]: pgmap v17731: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 427 KiB/s wr, 8 op/s 2023-05-08T12:56:46.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:45 smithi096 ceph-mon[124666]: pgmap v17731: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 427 KiB/s wr, 8 op/s 2023-05-08T12:56:46.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:45 smithi186 ceph-mon[126480]: pgmap v17731: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 427 KiB/s wr, 8 op/s 2023-05-08T12:56:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:47 smithi186 ceph-mon[126480]: pgmap v17732: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 430 KiB/s rd, 427 KiB/s wr, 11 op/s 2023-05-08T12:56:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:47 smithi133 ceph-mon[125939]: pgmap v17732: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 430 KiB/s rd, 427 KiB/s wr, 11 op/s 2023-05-08T12:56:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:47 smithi096 ceph-mon[124666]: pgmap v17732: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 430 KiB/s rd, 427 KiB/s wr, 11 op/s 2023-05-08T12:56:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:56:49.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:56:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:56:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:49 smithi186 ceph-mon[126480]: pgmap v17733: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 276 KiB/s wr, 7 op/s 2023-05-08T12:56:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33148.326617 secs 2023-05-08T12:56:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:56:50.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:56:50.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:56:50.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33148.881603 secs 2023-05-08T12:56:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:49 smithi133 ceph-mon[125939]: pgmap v17733: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 276 KiB/s wr, 7 op/s 2023-05-08T12:56:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33148.326617 secs 2023-05-08T12:56:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:56:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:56:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:56:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33148.881603 secs 2023-05-08T12:56:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:49 smithi096 ceph-mon[124666]: pgmap v17733: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 276 KiB/s wr, 7 op/s 2023-05-08T12:56:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33148.326617 secs 2023-05-08T12:56:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:56:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:56:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:56:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33148.881603 secs 2023-05-08T12:56:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:51 smithi186 ceph-mon[126480]: pgmap v17734: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 602 KiB/s rd, 563 KiB/s wr, 10 op/s 2023-05-08T12:56:52.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:51 smithi133 ceph-mon[125939]: pgmap v17734: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 602 KiB/s rd, 563 KiB/s wr, 10 op/s 2023-05-08T12:56:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:51 smithi096 ceph-mon[124666]: pgmap v17734: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 602 KiB/s rd, 563 KiB/s wr, 10 op/s 2023-05-08T12:56:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:53 smithi186 ceph-mon[126480]: pgmap v17735: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 287 KiB/s wr, 6 op/s 2023-05-08T12:56:54.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:53 smithi133 ceph-mon[125939]: pgmap v17735: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 287 KiB/s wr, 6 op/s 2023-05-08T12:56:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:53 smithi096 ceph-mon[124666]: pgmap v17735: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 287 KiB/s wr, 6 op/s 2023-05-08T12:56:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33153.326709 secs 2023-05-08T12:56:55.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33153.326709 secs 2023-05-08T12:56:55.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33153.326709 secs 2023-05-08T12:56:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:55 smithi186 ceph-mon[126480]: pgmap v17736: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 287 KiB/s wr, 6 op/s 2023-05-08T12:56:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:55 smithi133 ceph-mon[125939]: pgmap v17736: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 287 KiB/s wr, 6 op/s 2023-05-08T12:56:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:55 smithi096 ceph-mon[124666]: pgmap v17736: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 287 KiB/s wr, 6 op/s 2023-05-08T12:56:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:56:57.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:56:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:56:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:57 smithi186 ceph-mon[126480]: pgmap v17737: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 904 KiB/s rd, 842 KiB/s wr, 11 op/s 2023-05-08T12:56:58.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:57 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:56:58.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:56:58.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:56:58.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:57 smithi133 ceph-mon[125939]: pgmap v17737: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 904 KiB/s rd, 842 KiB/s wr, 11 op/s 2023-05-08T12:56:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:57 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:56:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:56:58.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:56:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:57 smithi096 ceph-mon[124666]: pgmap v17737: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 904 KiB/s rd, 842 KiB/s wr, 11 op/s 2023-05-08T12:56:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:57 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:56:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:56:58.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:57:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:59 smithi186 ceph-mon[126480]: pgmap v17738: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 903 KiB/s rd, 842 KiB/s wr, 8 op/s 2023-05-08T12:57:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:56:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33158.326819 secs 2023-05-08T12:57:00.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:59 smithi133 ceph-mon[125939]: pgmap v17738: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 903 KiB/s rd, 842 KiB/s wr, 8 op/s 2023-05-08T12:57:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:56:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33158.326819 secs 2023-05-08T12:57:00.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:59 smithi096 ceph-mon[124666]: pgmap v17738: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 903 KiB/s rd, 842 KiB/s wr, 8 op/s 2023-05-08T12:57:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:56:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33158.326819 secs 2023-05-08T12:57:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:57:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:57:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:57:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:57:01.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:57:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:57:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:57:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:57:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:57:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:57:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:57:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:57:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:01 smithi186 ceph-mon[126480]: pgmap v17739: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.3 MiB/s wr, 13 op/s 2023-05-08T12:57:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33160.173407 secs 2023-05-08T12:57:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:01 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:57:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:01 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T12:57:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:01 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T12:57:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:01 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:57:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:57:02.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:57:02.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:01 smithi133 ceph-mon[125939]: pgmap v17739: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.3 MiB/s wr, 13 op/s 2023-05-08T12:57:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33160.173407 secs 2023-05-08T12:57:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:01 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:57:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:01 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T12:57:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:01 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T12:57:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:01 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:57:02.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:57:02.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:57:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:01 smithi096 ceph-mon[124666]: pgmap v17739: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.3 MiB/s wr, 13 op/s 2023-05-08T12:57:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33160.173407 secs 2023-05-08T12:57:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:01 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:57:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:01 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T12:57:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:01 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T12:57:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:01 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:57:02.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:57:02.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:57:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:03 smithi186 ceph-mon[126480]: pgmap v17740: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T12:57:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:03 smithi133 ceph-mon[125939]: pgmap v17740: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T12:57:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:03 smithi096 ceph-mon[124666]: pgmap v17740: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T12:57:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33163.326943 secs 2023-05-08T12:57:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33163.881785 secs 2023-05-08T12:57:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33163.326943 secs 2023-05-08T12:57:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33163.881785 secs 2023-05-08T12:57:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33163.326943 secs 2023-05-08T12:57:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33163.881785 secs 2023-05-08T12:57:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:05 smithi186 ceph-mon[126480]: pgmap v17741: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T12:57:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:05 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:57:06.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:57:06.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:57:06.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:05 smithi133 ceph-mon[125939]: pgmap v17741: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T12:57:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:05 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:57:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:57:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:57:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:05 smithi096 ceph-mon[124666]: pgmap v17741: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T12:57:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:05 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:57:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:57:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:57:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:07 smithi186 ceph-mon[126480]: pgmap v17742: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.4 MiB/s wr, 27 op/s 2023-05-08T12:57:08.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:07 smithi133 ceph-mon[125939]: pgmap v17742: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.4 MiB/s wr, 27 op/s 2023-05-08T12:57:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:07 smithi096 ceph-mon[124666]: pgmap v17742: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.4 MiB/s wr, 27 op/s 2023-05-08T12:57:09.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:08 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:57:09.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:08 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:57:09.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:08 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:57:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:09 smithi186 ceph-mon[126480]: pgmap v17743: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 885 KiB/s wr, 23 op/s 2023-05-08T12:57:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33168.327123 secs 2023-05-08T12:57:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:57:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:57:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33168.881883 secs 2023-05-08T12:57:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:09 smithi133 ceph-mon[125939]: pgmap v17743: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 885 KiB/s wr, 23 op/s 2023-05-08T12:57:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33168.327123 secs 2023-05-08T12:57:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:57:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:57:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33168.881883 secs 2023-05-08T12:57:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:09 smithi096 ceph-mon[124666]: pgmap v17743: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 885 KiB/s wr, 23 op/s 2023-05-08T12:57:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33168.327123 secs 2023-05-08T12:57:10.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:57:10.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:57:10.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33168.881883 secs 2023-05-08T12:57:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:11 smithi186 ceph-mon[126480]: pgmap v17744: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 885 KiB/s wr, 26 op/s 2023-05-08T12:57:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:11 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:57:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:11 smithi133 ceph-mon[125939]: pgmap v17744: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 885 KiB/s wr, 26 op/s 2023-05-08T12:57:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:11 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:57:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:11 smithi096 ceph-mon[124666]: pgmap v17744: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 885 KiB/s wr, 26 op/s 2023-05-08T12:57:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:11 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:57:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:13 smithi186 ceph-mon[126480]: pgmap v17745: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 411 KiB/s wr, 21 op/s 2023-05-08T12:57:14.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:13 smithi133 ceph-mon[125939]: pgmap v17745: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 411 KiB/s wr, 21 op/s 2023-05-08T12:57:14.313 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:13 smithi096 ceph-mon[124666]: pgmap v17745: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 411 KiB/s wr, 21 op/s 2023-05-08T12:57:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33173.327246 secs 2023-05-08T12:57:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33173.882002 secs 2023-05-08T12:57:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33173.327246 secs 2023-05-08T12:57:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33173.882002 secs 2023-05-08T12:57:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33173.327246 secs 2023-05-08T12:57:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33173.882002 secs 2023-05-08T12:57:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:15 smithi186 ceph-mon[126480]: pgmap v17746: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 137 KiB/s wr, 21 op/s 2023-05-08T12:57:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:15 smithi133 ceph-mon[125939]: pgmap v17746: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 137 KiB/s wr, 21 op/s 2023-05-08T12:57:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:15 smithi096 ceph-mon[124666]: pgmap v17746: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 137 KiB/s wr, 21 op/s 2023-05-08T12:57:18.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:17 smithi186 ceph-mon[126480]: pgmap v17747: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 807 KiB/s rd, 545 KiB/s wr, 24 op/s 2023-05-08T12:57:18.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:17 smithi133 ceph-mon[125939]: pgmap v17747: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 807 KiB/s rd, 545 KiB/s wr, 24 op/s 2023-05-08T12:57:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:17 smithi096 ceph-mon[124666]: pgmap v17747: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 807 KiB/s rd, 545 KiB/s wr, 24 op/s 2023-05-08T12:57:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:19 smithi186 ceph-mon[126480]: pgmap v17748: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 424 KiB/s wr, 7 op/s 2023-05-08T12:57:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33178.327404 secs 2023-05-08T12:57:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33178.882133 secs 2023-05-08T12:57:20.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:19 smithi133 ceph-mon[125939]: pgmap v17748: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 424 KiB/s wr, 7 op/s 2023-05-08T12:57:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33178.327404 secs 2023-05-08T12:57:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33178.882133 secs 2023-05-08T12:57:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:19 smithi096 ceph-mon[124666]: pgmap v17748: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 424 KiB/s wr, 7 op/s 2023-05-08T12:57:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33178.327404 secs 2023-05-08T12:57:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33178.882133 secs 2023-05-08T12:57:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:21 smithi186 ceph-mon[126480]: pgmap v17749: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 431 KiB/s rd, 424 KiB/s wr, 10 op/s 2023-05-08T12:57:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:21 smithi133 ceph-mon[125939]: pgmap v17749: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 431 KiB/s rd, 424 KiB/s wr, 10 op/s 2023-05-08T12:57:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:21 smithi096 ceph-mon[124666]: pgmap v17749: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 431 KiB/s rd, 424 KiB/s wr, 10 op/s 2023-05-08T12:57:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:23 smithi186 ceph-mon[126480]: pgmap v17750: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 424 KiB/s wr, 7 op/s 2023-05-08T12:57:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:23 smithi133 ceph-mon[125939]: pgmap v17750: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 424 KiB/s wr, 7 op/s 2023-05-08T12:57:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:23 smithi096 ceph-mon[124666]: pgmap v17750: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 424 KiB/s wr, 7 op/s 2023-05-08T12:57:25.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33183.327461 secs 2023-05-08T12:57:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:24 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:57:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33183.327461 secs 2023-05-08T12:57:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:24 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:57:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33183.327461 secs 2023-05-08T12:57:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:24 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:57:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:25 smithi133 ceph-mon[125939]: pgmap v17751: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 408 KiB/s wr, 6 op/s 2023-05-08T12:57:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:25 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:57:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:25 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:57:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:25 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:57:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:25 smithi096 ceph-mon[124666]: pgmap v17751: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 408 KiB/s wr, 6 op/s 2023-05-08T12:57:26.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:25 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:57:26.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:25 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:57:26.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:25 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:57:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:25 smithi186 ceph-mon[126480]: pgmap v17751: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 408 KiB/s wr, 6 op/s 2023-05-08T12:57:26.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:25 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:57:26.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:25 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:57:26.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:25 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:57:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:26 smithi133 ceph-mon[125939]: osdmap e1186: 12 total, 12 up, 12 in 2023-05-08T12:57:27.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:26 smithi096 ceph-mon[124666]: osdmap e1186: 12 total, 12 up, 12 in 2023-05-08T12:57:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:26 smithi186 ceph-mon[126480]: osdmap e1186: 12 total, 12 up, 12 in 2023-05-08T12:57:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:27 smithi133 ceph-mon[125939]: pgmap v17753: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T12:57:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:27 smithi096 ceph-mon[124666]: pgmap v17753: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T12:57:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:27 smithi186 ceph-mon[126480]: pgmap v17753: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T12:57:30.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:29 smithi133 ceph-mon[125939]: pgmap v17754: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T12:57:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33188.327595 secs 2023-05-08T12:57:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:29 smithi096 ceph-mon[124666]: pgmap v17754: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T12:57:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33188.327595 secs 2023-05-08T12:57:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:29 smithi186 ceph-mon[126480]: pgmap v17754: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T12:57:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33188.327595 secs 2023-05-08T12:57:32.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:31 smithi133 ceph-mon[125939]: pgmap v17755: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2023-05-08T12:57:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:31 smithi096 ceph-mon[124666]: pgmap v17755: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2023-05-08T12:57:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:31 smithi186 ceph-mon[126480]: pgmap v17755: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2023-05-08T12:57:34.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:33 smithi133 ceph-mon[125939]: pgmap v17756: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 14 op/s 2023-05-08T12:57:34.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:33 smithi096 ceph-mon[124666]: pgmap v17756: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 14 op/s 2023-05-08T12:57:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:33 smithi186 ceph-mon[126480]: pgmap v17756: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 14 op/s 2023-05-08T12:57:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33193.327734 secs 2023-05-08T12:57:35.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33193.327734 secs 2023-05-08T12:57:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33193.327734 secs 2023-05-08T12:57:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:35 smithi133 ceph-mon[125939]: pgmap v17757: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 14 op/s 2023-05-08T12:57:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33195.174285 secs 2023-05-08T12:57:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:35 smithi096 ceph-mon[124666]: pgmap v17757: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 14 op/s 2023-05-08T12:57:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33195.174285 secs 2023-05-08T12:57:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:35 smithi186 ceph-mon[126480]: pgmap v17757: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 14 op/s 2023-05-08T12:57:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33195.174285 secs 2023-05-08T12:57:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:37 smithi186 ceph-mon[126480]: pgmap v17758: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 793 KiB/s rd, 694 KiB/s wr, 10 op/s 2023-05-08T12:57:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:37 smithi186 ceph-mon[126480]: osdmap e1187: 12 total, 12 up, 12 in 2023-05-08T12:57:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:37 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:57:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:37 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:57:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:37 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:57:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:37 smithi133 ceph-mon[125939]: pgmap v17758: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 793 KiB/s rd, 694 KiB/s wr, 10 op/s 2023-05-08T12:57:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:37 smithi133 ceph-mon[125939]: osdmap e1187: 12 total, 12 up, 12 in 2023-05-08T12:57:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:37 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:57:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:37 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:57:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:37 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:57:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:37 smithi096 ceph-mon[124666]: pgmap v17758: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 793 KiB/s rd, 694 KiB/s wr, 10 op/s 2023-05-08T12:57:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:37 smithi096 ceph-mon[124666]: osdmap e1187: 12 total, 12 up, 12 in 2023-05-08T12:57:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:37 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:57:38.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:37 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:57:38.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:37 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:57:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:39 smithi186 ceph-mon[126480]: pgmap v17760: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 800 KiB/s rd, 700 KiB/s wr, 10 op/s 2023-05-08T12:57:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33198.327836 secs 2023-05-08T12:57:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33198.882607 secs 2023-05-08T12:57:40.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:39 smithi133 ceph-mon[125939]: pgmap v17760: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 800 KiB/s rd, 700 KiB/s wr, 10 op/s 2023-05-08T12:57:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33198.327836 secs 2023-05-08T12:57:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33198.882607 secs 2023-05-08T12:57:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:39 smithi096 ceph-mon[124666]: pgmap v17760: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 800 KiB/s rd, 700 KiB/s wr, 10 op/s 2023-05-08T12:57:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33198.327836 secs 2023-05-08T12:57:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33198.882607 secs 2023-05-08T12:57:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:41 smithi186 ceph-mon[126480]: pgmap v17761: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T12:57:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33200.174379 secs 2023-05-08T12:57:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:41 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:57:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:41 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:57:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:41 smithi133 ceph-mon[125939]: pgmap v17761: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T12:57:42.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33200.174379 secs 2023-05-08T12:57:42.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:41 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:57:42.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:41 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:57:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:41 smithi096 ceph-mon[124666]: pgmap v17761: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T12:57:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33200.174379 secs 2023-05-08T12:57:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:41 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:57:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:41 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:57:44.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:43 smithi186 ceph-mon[126480]: pgmap v17762: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T12:57:44.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:43 smithi133 ceph-mon[125939]: pgmap v17762: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T12:57:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:43 smithi096 ceph-mon[124666]: pgmap v17762: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T12:57:45.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33203.328000 secs 2023-05-08T12:57:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33203.882671 secs 2023-05-08T12:57:45.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33203.328000 secs 2023-05-08T12:57:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33203.882671 secs 2023-05-08T12:57:45.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33203.328000 secs 2023-05-08T12:57:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33203.882671 secs 2023-05-08T12:57:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:45 smithi186 ceph-mon[126480]: pgmap v17763: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T12:57:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:45 smithi133 ceph-mon[125939]: pgmap v17763: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T12:57:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:45 smithi096 ceph-mon[124666]: pgmap v17763: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T12:57:47.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:46 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:57:47.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:46 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:57:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:46 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:57:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:47 smithi186 ceph-mon[126480]: pgmap v17764: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T12:57:48.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:47 smithi133 ceph-mon[125939]: pgmap v17764: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T12:57:48.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:47 smithi096 ceph-mon[124666]: pgmap v17764: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T12:57:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:57:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:57:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:57:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:49 smithi186 ceph-mon[126480]: pgmap v17765: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T12:57:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33208.328158 secs 2023-05-08T12:57:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:57:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:57:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:49 smithi133 ceph-mon[125939]: pgmap v17765: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T12:57:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33208.328158 secs 2023-05-08T12:57:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:57:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:57:50.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:49 smithi096 ceph-mon[124666]: pgmap v17765: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T12:57:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33208.328158 secs 2023-05-08T12:57:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:57:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:57:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:51 smithi186 ceph-mon[126480]: pgmap v17766: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.4 MiB/s wr, 16 op/s 2023-05-08T12:57:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:51 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:57:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:51 smithi133 ceph-mon[125939]: pgmap v17766: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.4 MiB/s wr, 16 op/s 2023-05-08T12:57:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:51 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:57:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:51 smithi096 ceph-mon[124666]: pgmap v17766: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.4 MiB/s wr, 16 op/s 2023-05-08T12:57:52.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:51 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:57:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:57:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:57:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:57:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:53 smithi186 ceph-mon[126480]: pgmap v17767: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 986 KiB/s wr, 12 op/s 2023-05-08T12:57:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:57:54.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:57:54.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:53 smithi133 ceph-mon[125939]: pgmap v17767: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 986 KiB/s wr, 12 op/s 2023-05-08T12:57:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:57:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:57:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:53 smithi096 ceph-mon[124666]: pgmap v17767: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 986 KiB/s wr, 12 op/s 2023-05-08T12:57:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:57:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:57:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33213.328292 secs 2023-05-08T12:57:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33213.882808 secs 2023-05-08T12:57:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33213.328292 secs 2023-05-08T12:57:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33213.882808 secs 2023-05-08T12:57:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33213.328292 secs 2023-05-08T12:57:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33213.882808 secs 2023-05-08T12:57:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:55 smithi186 ceph-mon[126480]: pgmap v17768: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 964 KiB/s wr, 11 op/s 2023-05-08T12:57:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:55 smithi133 ceph-mon[125939]: pgmap v17768: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 964 KiB/s wr, 11 op/s 2023-05-08T12:57:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:55 smithi096 ceph-mon[124666]: pgmap v17768: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 964 KiB/s wr, 11 op/s 2023-05-08T12:57:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33215.174802 secs 2023-05-08T12:57:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:56 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:57:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33215.174802 secs 2023-05-08T12:57:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:56 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:57:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33215.174802 secs 2023-05-08T12:57:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:56 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:57:58.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:57 smithi133 ceph-mon[125939]: pgmap v17769: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.8 MiB/s wr, 16 op/s 2023-05-08T12:57:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:57:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:57:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:57:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:57 smithi096 ceph-mon[124666]: pgmap v17769: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.8 MiB/s wr, 16 op/s 2023-05-08T12:57:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:57:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:57:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:57:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:57 smithi186 ceph-mon[126480]: pgmap v17769: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.8 MiB/s wr, 16 op/s 2023-05-08T12:57:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:57:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:57:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:58:00.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:59 smithi133 ceph-mon[125939]: pgmap v17770: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T12:58:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33218.328401 secs 2023-05-08T12:58:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:57:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33218.882880 secs 2023-05-08T12:58:00.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:59 smithi096 ceph-mon[124666]: pgmap v17770: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T12:58:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33218.328401 secs 2023-05-08T12:58:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:57:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33218.882880 secs 2023-05-08T12:58:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:59 smithi186 ceph-mon[126480]: pgmap v17770: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T12:58:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33218.328401 secs 2023-05-08T12:58:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:57:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33218.882880 secs 2023-05-08T12:58:01.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33220.174888 secs 2023-05-08T12:58:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:58:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33220.174888 secs 2023-05-08T12:58:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:58:01.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33220.174888 secs 2023-05-08T12:58:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:58:01.884 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:01 smithi186 ceph-mon[126480]: pgmap v17771: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 18 op/s 2023-05-08T12:58:01.884 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:01 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:58:01.885 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:01 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:58:01.885 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:01 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:58:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:01 smithi133 ceph-mon[125939]: pgmap v17771: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 18 op/s 2023-05-08T12:58:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:01 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:58:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:01 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:58:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:01 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:58:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:01 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:58:02.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:01 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:58:02.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:01 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:58:02.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:01 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:58:02.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:01 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:58:02.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:01 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:58:02.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:01 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:58:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:01 smithi096 ceph-mon[124666]: pgmap v17771: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 18 op/s 2023-05-08T12:58:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:01 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:58:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:01 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:58:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:01 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:58:02.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:01 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:58:02.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:01 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:58:02.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:01 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:58:02.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:01 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:58:02.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:01 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:58:02.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:01 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:58:02.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:01 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:58:02.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:01 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:58:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:01 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:58:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:01 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:58:02.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:01 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:58:02.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:01 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:58:02.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:01 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:58:02.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:01 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:58:03.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:02 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:58:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:02 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T12:58:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:02 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T12:58:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:02 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:58:03.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:02 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:58:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:02 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T12:58:03.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:02 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T12:58:03.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:02 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:58:03.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:02 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:58:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:02 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T12:58:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:02 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T12:58:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:02 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:58:04.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:03 smithi133 ceph-mon[125939]: pgmap v17772: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 12 op/s 2023-05-08T12:58:04.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:03 smithi096 ceph-mon[124666]: pgmap v17772: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 12 op/s 2023-05-08T12:58:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:03 smithi186 ceph-mon[126480]: pgmap v17772: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 12 op/s 2023-05-08T12:58:05.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33223.328505 secs 2023-05-08T12:58:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33223.883016 secs 2023-05-08T12:58:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33223.328505 secs 2023-05-08T12:58:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33223.883016 secs 2023-05-08T12:58:05.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33223.328505 secs 2023-05-08T12:58:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33223.883016 secs 2023-05-08T12:58:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:05 smithi133 ceph-mon[125939]: pgmap v17773: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 12 op/s 2023-05-08T12:58:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33225.174962 secs 2023-05-08T12:58:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:05 smithi096 ceph-mon[124666]: pgmap v17773: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 12 op/s 2023-05-08T12:58:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33225.174962 secs 2023-05-08T12:58:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:05 smithi186 ceph-mon[126480]: pgmap v17773: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 12 op/s 2023-05-08T12:58:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33225.174962 secs 2023-05-08T12:58:07.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:06 smithi133 ceph-mon[125939]: osdmap e1188: 12 total, 12 up, 12 in 2023-05-08T12:58:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:06 smithi096 ceph-mon[124666]: osdmap e1188: 12 total, 12 up, 12 in 2023-05-08T12:58:07.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:06 smithi186 ceph-mon[126480]: osdmap e1188: 12 total, 12 up, 12 in 2023-05-08T12:58:08.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:07 smithi133 ceph-mon[125939]: pgmap v17775: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.7 MiB/s wr, 31 op/s 2023-05-08T12:58:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:07 smithi096 ceph-mon[124666]: pgmap v17775: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.7 MiB/s wr, 31 op/s 2023-05-08T12:58:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:07 smithi186 ceph-mon[126480]: pgmap v17775: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.7 MiB/s wr, 31 op/s 2023-05-08T12:58:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:08 smithi133 ceph-mon[125939]: pgmap v17776: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.7 MiB/s wr, 31 op/s 2023-05-08T12:58:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:08 smithi096 ceph-mon[124666]: pgmap v17776: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.7 MiB/s wr, 31 op/s 2023-05-08T12:58:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:08 smithi186 ceph-mon[126480]: pgmap v17776: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.7 MiB/s wr, 31 op/s 2023-05-08T12:58:10.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33228.328609 secs 2023-05-08T12:58:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33228.883172 secs 2023-05-08T12:58:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33228.328609 secs 2023-05-08T12:58:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33228.883172 secs 2023-05-08T12:58:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33228.328609 secs 2023-05-08T12:58:10.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33228.883172 secs 2023-05-08T12:58:11.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:10 smithi133 ceph-mon[125939]: pgmap v17777: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 435 KiB/s wr, 27 op/s 2023-05-08T12:58:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33230.175045 secs 2023-05-08T12:58:11.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:10 smithi096 ceph-mon[124666]: pgmap v17777: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 435 KiB/s wr, 27 op/s 2023-05-08T12:58:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33230.175045 secs 2023-05-08T12:58:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:10 smithi186 ceph-mon[126480]: pgmap v17777: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 435 KiB/s wr, 27 op/s 2023-05-08T12:58:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33230.175045 secs 2023-05-08T12:58:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:13 smithi186 ceph-mon[126480]: pgmap v17778: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 435 KiB/s wr, 27 op/s 2023-05-08T12:58:14.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:13 smithi133 ceph-mon[125939]: pgmap v17778: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 435 KiB/s wr, 27 op/s 2023-05-08T12:58:14.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:13 smithi096 ceph-mon[124666]: pgmap v17778: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 435 KiB/s wr, 27 op/s 2023-05-08T12:58:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33233.328767 secs 2023-05-08T12:58:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33233.883321 secs 2023-05-08T12:58:15.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33233.328767 secs 2023-05-08T12:58:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33233.883321 secs 2023-05-08T12:58:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33233.328767 secs 2023-05-08T12:58:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33233.883321 secs 2023-05-08T12:58:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:15 smithi186 ceph-mon[126480]: pgmap v17779: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 435 KiB/s wr, 27 op/s 2023-05-08T12:58:16.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:15 smithi133 ceph-mon[125939]: pgmap v17779: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 435 KiB/s wr, 27 op/s 2023-05-08T12:58:16.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:15 smithi096 ceph-mon[124666]: pgmap v17779: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 435 KiB/s wr, 27 op/s 2023-05-08T12:58:17.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33235.175157 secs 2023-05-08T12:58:17.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:16 smithi186 ceph-mon[126480]: osdmap e1189: 12 total, 12 up, 12 in 2023-05-08T12:58:17.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33235.175157 secs 2023-05-08T12:58:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:16 smithi133 ceph-mon[125939]: osdmap e1189: 12 total, 12 up, 12 in 2023-05-08T12:58:17.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33235.175157 secs 2023-05-08T12:58:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:16 smithi096 ceph-mon[124666]: osdmap e1189: 12 total, 12 up, 12 in 2023-05-08T12:58:18.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:17 smithi186 ceph-mon[126480]: pgmap v17780: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 495 KiB/s rd, 622 KiB/s wr, 8 op/s 2023-05-08T12:58:18.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:17 smithi133 ceph-mon[125939]: pgmap v17780: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 495 KiB/s rd, 622 KiB/s wr, 8 op/s 2023-05-08T12:58:18.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:17 smithi096 ceph-mon[124666]: pgmap v17780: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 495 KiB/s rd, 622 KiB/s wr, 8 op/s 2023-05-08T12:58:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:19 smithi186 ceph-mon[126480]: pgmap v17782: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 626 KiB/s wr, 8 op/s 2023-05-08T12:58:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33238.328893 secs 2023-05-08T12:58:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33238.883457 secs 2023-05-08T12:58:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:19 smithi133 ceph-mon[125939]: pgmap v17782: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 626 KiB/s wr, 8 op/s 2023-05-08T12:58:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33238.328893 secs 2023-05-08T12:58:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33238.883457 secs 2023-05-08T12:58:20.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:19 smithi096 ceph-mon[124666]: pgmap v17782: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 626 KiB/s wr, 8 op/s 2023-05-08T12:58:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33238.328893 secs 2023-05-08T12:58:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33238.883457 secs 2023-05-08T12:58:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:21 smithi186 ceph-mon[126480]: pgmap v17783: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 629 KiB/s rd, 653 KiB/s wr, 9 op/s 2023-05-08T12:58:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33240.175249 secs 2023-05-08T12:58:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:21 smithi133 ceph-mon[125939]: pgmap v17783: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 629 KiB/s rd, 653 KiB/s wr, 9 op/s 2023-05-08T12:58:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33240.175249 secs 2023-05-08T12:58:22.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:21 smithi096 ceph-mon[124666]: pgmap v17783: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 629 KiB/s rd, 653 KiB/s wr, 9 op/s 2023-05-08T12:58:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33240.175249 secs 2023-05-08T12:58:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:23 smithi186 ceph-mon[126480]: pgmap v17784: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 629 KiB/s rd, 653 KiB/s wr, 9 op/s 2023-05-08T12:58:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:23 smithi133 ceph-mon[125939]: pgmap v17784: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 629 KiB/s rd, 653 KiB/s wr, 9 op/s 2023-05-08T12:58:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:23 smithi096 ceph-mon[124666]: pgmap v17784: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 629 KiB/s rd, 653 KiB/s wr, 9 op/s 2023-05-08T12:58:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33243.329047 secs 2023-05-08T12:58:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33243.883484 secs 2023-05-08T12:58:25.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33243.329047 secs 2023-05-08T12:58:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33243.883484 secs 2023-05-08T12:58:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33243.329047 secs 2023-05-08T12:58:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33243.883484 secs 2023-05-08T12:58:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:25 smithi186 ceph-mon[126480]: pgmap v17785: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 629 KiB/s rd, 653 KiB/s wr, 9 op/s 2023-05-08T12:58:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:25 smithi133 ceph-mon[125939]: pgmap v17785: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 629 KiB/s rd, 653 KiB/s wr, 9 op/s 2023-05-08T12:58:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:25 smithi096 ceph-mon[124666]: pgmap v17785: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 629 KiB/s rd, 653 KiB/s wr, 9 op/s 2023-05-08T12:58:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33245.175368 secs 2023-05-08T12:58:27.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33245.175368 secs 2023-05-08T12:58:27.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33245.175368 secs 2023-05-08T12:58:28.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:27 smithi186 ceph-mon[126480]: pgmap v17786: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 384 KiB/s rd, 54 KiB/s wr, 8 op/s 2023-05-08T12:58:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:27 smithi133 ceph-mon[125939]: pgmap v17786: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 384 KiB/s rd, 54 KiB/s wr, 8 op/s 2023-05-08T12:58:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:27 smithi096 ceph-mon[124666]: pgmap v17786: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 384 KiB/s rd, 54 KiB/s wr, 8 op/s 2023-05-08T12:58:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:29 smithi186 ceph-mon[126480]: pgmap v17787: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 48 KiB/s wr, 8 op/s 2023-05-08T12:58:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33248.329136 secs 2023-05-08T12:58:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33248.883550 secs 2023-05-08T12:58:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:29 smithi133 ceph-mon[125939]: pgmap v17787: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 48 KiB/s wr, 8 op/s 2023-05-08T12:58:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33248.329136 secs 2023-05-08T12:58:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33248.883550 secs 2023-05-08T12:58:30.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:29 smithi096 ceph-mon[124666]: pgmap v17787: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 48 KiB/s wr, 8 op/s 2023-05-08T12:58:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33248.329136 secs 2023-05-08T12:58:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33248.883550 secs 2023-05-08T12:58:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:31 smithi186 ceph-mon[126480]: pgmap v17788: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 181 KiB/s wr, 11 op/s 2023-05-08T12:58:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33250.175513 secs 2023-05-08T12:58:32.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:31 smithi133 ceph-mon[125939]: pgmap v17788: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 181 KiB/s wr, 11 op/s 2023-05-08T12:58:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33250.175513 secs 2023-05-08T12:58:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:31 smithi096 ceph-mon[124666]: pgmap v17788: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 181 KiB/s wr, 11 op/s 2023-05-08T12:58:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33250.175513 secs 2023-05-08T12:58:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:33 smithi186 ceph-mon[126480]: pgmap v17789: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 158 KiB/s wr, 7 op/s 2023-05-08T12:58:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:33 smithi133 ceph-mon[125939]: pgmap v17789: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 158 KiB/s wr, 7 op/s 2023-05-08T12:58:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:33 smithi096 ceph-mon[124666]: pgmap v17789: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 158 KiB/s wr, 7 op/s 2023-05-08T12:58:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33253.329276 secs 2023-05-08T12:58:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33253.883642 secs 2023-05-08T12:58:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33253.329276 secs 2023-05-08T12:58:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33253.883642 secs 2023-05-08T12:58:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33253.329276 secs 2023-05-08T12:58:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33253.883642 secs 2023-05-08T12:58:36.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:35 smithi133 ceph-mon[125939]: pgmap v17790: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 158 KiB/s wr, 7 op/s 2023-05-08T12:58:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33255.175615 secs 2023-05-08T12:58:36.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:35 smithi096 ceph-mon[124666]: pgmap v17790: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 158 KiB/s wr, 7 op/s 2023-05-08T12:58:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33255.175615 secs 2023-05-08T12:58:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:35 smithi186 ceph-mon[126480]: pgmap v17790: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 158 KiB/s wr, 7 op/s 2023-05-08T12:58:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33255.175615 secs 2023-05-08T12:58:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:37 smithi133 ceph-mon[125939]: pgmap v17791: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 435 KiB/s wr, 11 op/s 2023-05-08T12:58:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:37 smithi096 ceph-mon[124666]: pgmap v17791: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 435 KiB/s wr, 11 op/s 2023-05-08T12:58:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:37 smithi186 ceph-mon[126480]: pgmap v17791: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 435 KiB/s wr, 11 op/s 2023-05-08T12:58:40.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:39 smithi133 ceph-mon[125939]: pgmap v17792: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 413 KiB/s wr, 7 op/s 2023-05-08T12:58:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33258.329418 secs 2023-05-08T12:58:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33258.883756 secs 2023-05-08T12:58:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:39 smithi096 ceph-mon[124666]: pgmap v17792: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 413 KiB/s wr, 7 op/s 2023-05-08T12:58:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33258.329418 secs 2023-05-08T12:58:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33258.883756 secs 2023-05-08T12:58:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:39 smithi186 ceph-mon[126480]: pgmap v17792: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 413 KiB/s wr, 7 op/s 2023-05-08T12:58:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33258.329418 secs 2023-05-08T12:58:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33258.883756 secs 2023-05-08T12:58:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33260.175695 secs 2023-05-08T12:58:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33260.175695 secs 2023-05-08T12:58:41.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33260.175695 secs 2023-05-08T12:58:42.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:41 smithi133 ceph-mon[125939]: pgmap v17793: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 414 KiB/s wr, 11 op/s 2023-05-08T12:58:42.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:41 smithi096 ceph-mon[124666]: pgmap v17793: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 414 KiB/s wr, 11 op/s 2023-05-08T12:58:42.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:41 smithi186 ceph-mon[126480]: pgmap v17793: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 414 KiB/s wr, 11 op/s 2023-05-08T12:58:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:43 smithi133 ceph-mon[125939]: pgmap v17794: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 549 KiB/s wr, 7 op/s 2023-05-08T12:58:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:43 smithi096 ceph-mon[124666]: pgmap v17794: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 549 KiB/s wr, 7 op/s 2023-05-08T12:58:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:43 smithi186 ceph-mon[126480]: pgmap v17794: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 549 KiB/s wr, 7 op/s 2023-05-08T12:58:44.899 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33263.329544 secs 2023-05-08T12:58:44.900 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33263.883873 secs 2023-05-08T12:58:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33263.329544 secs 2023-05-08T12:58:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33263.883873 secs 2023-05-08T12:58:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33263.329544 secs 2023-05-08T12:58:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33263.883873 secs 2023-05-08T12:58:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:45 smithi133 ceph-mon[125939]: pgmap v17795: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 549 KiB/s wr, 7 op/s 2023-05-08T12:58:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:45 smithi096 ceph-mon[124666]: pgmap v17795: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 549 KiB/s wr, 7 op/s 2023-05-08T12:58:46.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:45 smithi186 ceph-mon[126480]: pgmap v17795: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 549 KiB/s wr, 7 op/s 2023-05-08T12:58:48.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:47 smithi133 ceph-mon[125939]: pgmap v17796: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 613 KiB/s rd, 579 KiB/s wr, 11 op/s 2023-05-08T12:58:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:47 smithi096 ceph-mon[124666]: pgmap v17796: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 613 KiB/s rd, 579 KiB/s wr, 11 op/s 2023-05-08T12:58:48.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:47 smithi186 ceph-mon[126480]: pgmap v17796: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 613 KiB/s rd, 579 KiB/s wr, 11 op/s 2023-05-08T12:58:49.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:58:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:58:49.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:58:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:49 smithi133 ceph-mon[125939]: pgmap v17797: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 302 KiB/s wr, 7 op/s 2023-05-08T12:58:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33268.329665 secs 2023-05-08T12:58:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:58:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:58:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:58:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:49 smithi096 ceph-mon[124666]: pgmap v17797: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 302 KiB/s wr, 7 op/s 2023-05-08T12:58:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33268.329665 secs 2023-05-08T12:58:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:58:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:58:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:58:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:49 smithi186 ceph-mon[126480]: pgmap v17797: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 302 KiB/s wr, 7 op/s 2023-05-08T12:58:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33268.329665 secs 2023-05-08T12:58:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:58:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:58:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:58:52.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:51 smithi133 ceph-mon[125939]: pgmap v17798: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 861 KiB/s wr, 11 op/s 2023-05-08T12:58:52.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:51 smithi096 ceph-mon[124666]: pgmap v17798: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 861 KiB/s wr, 11 op/s 2023-05-08T12:58:52.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:51 smithi186 ceph-mon[126480]: pgmap v17798: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 861 KiB/s wr, 11 op/s 2023-05-08T12:58:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:58:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:58:53.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:58:54.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:53 smithi133 ceph-mon[125939]: pgmap v17799: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 912 KiB/s rd, 860 KiB/s wr, 8 op/s 2023-05-08T12:58:54.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:58:54.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:58:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:53 smithi096 ceph-mon[124666]: pgmap v17799: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 912 KiB/s rd, 860 KiB/s wr, 8 op/s 2023-05-08T12:58:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:58:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:58:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:53 smithi186 ceph-mon[126480]: pgmap v17799: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 912 KiB/s rd, 860 KiB/s wr, 8 op/s 2023-05-08T12:58:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:58:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:58:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33273.329832 secs 2023-05-08T12:58:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:54 smithi133 ceph-mon[125939]: pgmap v17800: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 912 KiB/s rd, 590 KiB/s wr, 8 op/s 2023-05-08T12:58:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33273.329832 secs 2023-05-08T12:58:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:54 smithi096 ceph-mon[124666]: pgmap v17800: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 912 KiB/s rd, 590 KiB/s wr, 8 op/s 2023-05-08T12:58:55.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33273.329832 secs 2023-05-08T12:58:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:54 smithi186 ceph-mon[126480]: pgmap v17800: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 912 KiB/s rd, 590 KiB/s wr, 8 op/s 2023-05-08T12:58:56.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33275.176100 secs 2023-05-08T12:58:56.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33275.176100 secs 2023-05-08T12:58:56.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33275.176100 secs 2023-05-08T12:58:57.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:56 smithi133 ceph-mon[125939]: pgmap v17801: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T12:58:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:56 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:58:57.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:56 smithi096 ceph-mon[124666]: pgmap v17801: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T12:58:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:56 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:58:57.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:56 smithi186 ceph-mon[126480]: pgmap v17801: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T12:58:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:56 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:58:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:58:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:58:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:58:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:58:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:58:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:58:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:58 smithi133 ceph-mon[125939]: pgmap v17802: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 784 KiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T12:58:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:58 smithi096 ceph-mon[124666]: pgmap v17802: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 784 KiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T12:58:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:58 smithi186 ceph-mon[126480]: pgmap v17802: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 784 KiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T12:59:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33278.329971 secs 2023-05-08T12:59:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:58:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33278.884229 secs 2023-05-08T12:59:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33278.329971 secs 2023-05-08T12:59:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:58:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33278.884229 secs 2023-05-08T12:59:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33278.329971 secs 2023-05-08T12:59:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:58:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33278.884229 secs 2023-05-08T12:59:01.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:00 smithi133 ceph-mon[125939]: pgmap v17803: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 16 op/s 2023-05-08T12:59:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33280.176202 secs 2023-05-08T12:59:01.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:00 smithi096 ceph-mon[124666]: pgmap v17803: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 16 op/s 2023-05-08T12:59:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33280.176202 secs 2023-05-08T12:59:01.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:00 smithi186 ceph-mon[126480]: pgmap v17803: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 16 op/s 2023-05-08T12:59:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33280.176202 secs 2023-05-08T12:59:02.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:59:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:59:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:01 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:59:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:59:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:59:02.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:01 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:59:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:59:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:59:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:01 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:59:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:02 smithi133 ceph-mon[125939]: pgmap v17804: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 662 KiB/s rd, 546 KiB/s wr, 11 op/s 2023-05-08T12:59:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:02 smithi096 ceph-mon[124666]: pgmap v17804: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 662 KiB/s rd, 546 KiB/s wr, 11 op/s 2023-05-08T12:59:03.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:02 smithi186 ceph-mon[126480]: pgmap v17804: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 662 KiB/s rd, 546 KiB/s wr, 11 op/s 2023-05-08T12:59:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33283.330102 secs 2023-05-08T12:59:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:05 smithi186 ceph-mon[126480]: pgmap v17805: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 631 KiB/s rd, 546 KiB/s wr, 11 op/s 2023-05-08T12:59:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33283.884366 secs 2023-05-08T12:59:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33283.330102 secs 2023-05-08T12:59:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:05 smithi133 ceph-mon[125939]: pgmap v17805: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 631 KiB/s rd, 546 KiB/s wr, 11 op/s 2023-05-08T12:59:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33283.884366 secs 2023-05-08T12:59:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33283.330102 secs 2023-05-08T12:59:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:05 smithi096 ceph-mon[124666]: pgmap v17805: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 631 KiB/s rd, 546 KiB/s wr, 11 op/s 2023-05-08T12:59:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33283.884366 secs 2023-05-08T12:59:08.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:07 smithi186 ceph-mon[126480]: pgmap v17806: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 28 op/s 2023-05-08T12:59:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:07 smithi133 ceph-mon[125939]: pgmap v17806: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 28 op/s 2023-05-08T12:59:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:07 smithi096 ceph-mon[124666]: pgmap v17806: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 28 op/s 2023-05-08T12:59:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:08 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:59:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:08 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:59:09.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:08 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:59:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:09 smithi186 ceph-mon[126480]: pgmap v17807: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 690 KiB/s wr, 22 op/s 2023-05-08T12:59:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33288.330266 secs 2023-05-08T12:59:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:09 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:59:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:09 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:59:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:09 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:59:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33288.884501 secs 2023-05-08T12:59:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:09 smithi133 ceph-mon[125939]: pgmap v17807: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 690 KiB/s wr, 22 op/s 2023-05-08T12:59:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33288.330266 secs 2023-05-08T12:59:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:09 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:59:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:09 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:59:10.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:09 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:59:10.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33288.884501 secs 2023-05-08T12:59:10.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:09 smithi096 ceph-mon[124666]: pgmap v17807: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 690 KiB/s wr, 22 op/s 2023-05-08T12:59:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33288.330266 secs 2023-05-08T12:59:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:09 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:59:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:09 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:59:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:09 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:59:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33288.884501 secs 2023-05-08T12:59:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:11 smithi186 ceph-mon[126480]: pgmap v17808: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 822 KiB/s wr, 25 op/s 2023-05-08T12:59:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:11 smithi133 ceph-mon[125939]: pgmap v17808: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 822 KiB/s wr, 25 op/s 2023-05-08T12:59:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:11 smithi096 ceph-mon[124666]: pgmap v17808: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 822 KiB/s wr, 25 op/s 2023-05-08T12:59:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:13 smithi186 ceph-mon[126480]: pgmap v17809: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 668 KiB/s rd, 772 KiB/s wr, 20 op/s 2023-05-08T12:59:14.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:13 smithi133 ceph-mon[125939]: pgmap v17809: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 668 KiB/s rd, 772 KiB/s wr, 20 op/s 2023-05-08T12:59:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:13 smithi096 ceph-mon[124666]: pgmap v17809: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 668 KiB/s rd, 772 KiB/s wr, 20 op/s 2023-05-08T12:59:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33293.330424 secs 2023-05-08T12:59:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33293.884613 secs 2023-05-08T12:59:15.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33293.330424 secs 2023-05-08T12:59:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33293.884613 secs 2023-05-08T12:59:15.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33293.330424 secs 2023-05-08T12:59:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33293.884613 secs 2023-05-08T12:59:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:15 smithi186 ceph-mon[126480]: pgmap v17810: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 668 KiB/s rd, 772 KiB/s wr, 20 op/s 2023-05-08T12:59:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:15 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:59:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:15 smithi133 ceph-mon[125939]: pgmap v17810: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 668 KiB/s rd, 772 KiB/s wr, 20 op/s 2023-05-08T12:59:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:15 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:59:16.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:15 smithi096 ceph-mon[124666]: pgmap v17810: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 668 KiB/s rd, 772 KiB/s wr, 20 op/s 2023-05-08T12:59:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:15 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T12:59:17.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:16 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:59:17.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:16 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:59:17.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:16 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:59:17.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:16 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:59:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:16 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:59:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:16 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:59:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:16 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T12:59:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:16 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T12:59:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:16 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T12:59:18.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:17 smithi186 ceph-mon[126480]: pgmap v17811: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1008 KiB/s rd, 978 KiB/s wr, 24 op/s 2023-05-08T12:59:18.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:17 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:59:18.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:17 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T12:59:18.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:17 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T12:59:18.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:17 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T12:59:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:17 smithi133 ceph-mon[125939]: pgmap v17811: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1008 KiB/s rd, 978 KiB/s wr, 24 op/s 2023-05-08T12:59:18.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:17 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:59:18.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:17 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T12:59:18.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:17 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T12:59:18.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:17 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T12:59:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:17 smithi096 ceph-mon[124666]: pgmap v17811: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1008 KiB/s rd, 978 KiB/s wr, 24 op/s 2023-05-08T12:59:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:17 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:59:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:17 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T12:59:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:17 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T12:59:18.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:17 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T12:59:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:19 smithi186 ceph-mon[126480]: pgmap v17812: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 339 KiB/s wr, 6 op/s 2023-05-08T12:59:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33298.330503 secs 2023-05-08T12:59:20.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:19 smithi133 ceph-mon[125939]: pgmap v17812: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 339 KiB/s wr, 6 op/s 2023-05-08T12:59:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33298.330503 secs 2023-05-08T12:59:20.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:19 smithi096 ceph-mon[124666]: pgmap v17812: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 339 KiB/s wr, 6 op/s 2023-05-08T12:59:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33298.330503 secs 2023-05-08T12:59:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:20 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:59:21.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:20 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:59:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:20 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:59:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:21 smithi186 ceph-mon[126480]: pgmap v17813: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 949 KiB/s rd, 968 KiB/s wr, 14 op/s 2023-05-08T12:59:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:21 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:59:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:21 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:59:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:21 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:59:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:21 smithi133 ceph-mon[125939]: pgmap v17813: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 949 KiB/s rd, 968 KiB/s wr, 14 op/s 2023-05-08T12:59:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:21 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:59:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:21 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:59:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:21 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:59:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:21 smithi096 ceph-mon[124666]: pgmap v17813: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 949 KiB/s rd, 968 KiB/s wr, 14 op/s 2023-05-08T12:59:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:21 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:59:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:21 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:59:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:21 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:59:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:23 smithi186 ceph-mon[126480]: pgmap v17814: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 948 KiB/s rd, 835 KiB/s wr, 11 op/s 2023-05-08T12:59:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:23 smithi133 ceph-mon[125939]: pgmap v17814: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 948 KiB/s rd, 835 KiB/s wr, 11 op/s 2023-05-08T12:59:24.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:23 smithi096 ceph-mon[124666]: pgmap v17814: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 948 KiB/s rd, 835 KiB/s wr, 11 op/s 2023-05-08T12:59:25.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33303.330651 secs 2023-05-08T12:59:25.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33303.330651 secs 2023-05-08T12:59:25.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33303.330651 secs 2023-05-08T12:59:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:25 smithi186 ceph-mon[126480]: pgmap v17815: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 948 KiB/s rd, 835 KiB/s wr, 11 op/s 2023-05-08T12:59:26.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:25 smithi133 ceph-mon[125939]: pgmap v17815: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 948 KiB/s rd, 835 KiB/s wr, 11 op/s 2023-05-08T12:59:26.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:25 smithi096 ceph-mon[124666]: pgmap v17815: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 948 KiB/s rd, 835 KiB/s wr, 11 op/s 2023-05-08T12:59:27.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:26 smithi133 ceph-mon[125939]: osdmap e1190: 12 total, 12 up, 12 in 2023-05-08T12:59:27.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:26 smithi096 ceph-mon[124666]: osdmap e1190: 12 total, 12 up, 12 in 2023-05-08T12:59:27.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:26 smithi186 ceph-mon[126480]: osdmap e1190: 12 total, 12 up, 12 in 2023-05-08T12:59:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:27 smithi133 ceph-mon[125939]: pgmap v17817: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 737 KiB/s rd, 786 KiB/s wr, 14 op/s 2023-05-08T12:59:28.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:27 smithi096 ceph-mon[124666]: pgmap v17817: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 737 KiB/s rd, 786 KiB/s wr, 14 op/s 2023-05-08T12:59:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:27 smithi186 ceph-mon[126480]: pgmap v17817: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 737 KiB/s rd, 786 KiB/s wr, 14 op/s 2023-05-08T12:59:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:29 smithi133 ceph-mon[125939]: pgmap v17818: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 737 KiB/s rd, 786 KiB/s wr, 14 op/s 2023-05-08T12:59:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33308.330819 secs 2023-05-08T12:59:30.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:29 smithi096 ceph-mon[124666]: pgmap v17818: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 737 KiB/s rd, 786 KiB/s wr, 14 op/s 2023-05-08T12:59:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33308.330819 secs 2023-05-08T12:59:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:29 smithi186 ceph-mon[126480]: pgmap v17818: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 737 KiB/s rd, 786 KiB/s wr, 14 op/s 2023-05-08T12:59:30.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33308.330819 secs 2023-05-08T12:59:32.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:31 smithi133 ceph-mon[125939]: pgmap v17819: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 187 KiB/s wr, 8 op/s 2023-05-08T12:59:32.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:31 smithi096 ceph-mon[124666]: pgmap v17819: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 187 KiB/s wr, 8 op/s 2023-05-08T12:59:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:31 smithi186 ceph-mon[126480]: pgmap v17819: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 187 KiB/s wr, 8 op/s 2023-05-08T12:59:34.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:33 smithi133 ceph-mon[125939]: pgmap v17820: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 187 KiB/s wr, 8 op/s 2023-05-08T12:59:34.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:33 smithi096 ceph-mon[124666]: pgmap v17820: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 187 KiB/s wr, 8 op/s 2023-05-08T12:59:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:33 smithi186 ceph-mon[126480]: pgmap v17820: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 187 KiB/s wr, 8 op/s 2023-05-08T12:59:35.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33313.330946 secs 2023-05-08T12:59:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33313.330946 secs 2023-05-08T12:59:35.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33313.330946 secs 2023-05-08T12:59:36.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:35 smithi133 ceph-mon[125939]: pgmap v17821: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 187 KiB/s wr, 8 op/s 2023-05-08T12:59:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33315.177011 secs 2023-05-08T12:59:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:35 smithi096 ceph-mon[124666]: pgmap v17821: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 187 KiB/s wr, 8 op/s 2023-05-08T12:59:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33315.177011 secs 2023-05-08T12:59:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:35 smithi186 ceph-mon[126480]: pgmap v17821: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 187 KiB/s wr, 8 op/s 2023-05-08T12:59:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33315.177011 secs 2023-05-08T12:59:38.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:37 smithi186 ceph-mon[126480]: pgmap v17822: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 352 KiB/s rd, 197 KiB/s wr, 8 op/s 2023-05-08T12:59:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:37 smithi186 ceph-mon[126480]: osdmap e1191: 12 total, 12 up, 12 in 2023-05-08T12:59:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:37 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:59:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:37 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:59:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:37 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:59:38.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:37 smithi133 ceph-mon[125939]: pgmap v17822: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 352 KiB/s rd, 197 KiB/s wr, 8 op/s 2023-05-08T12:59:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:37 smithi133 ceph-mon[125939]: osdmap e1191: 12 total, 12 up, 12 in 2023-05-08T12:59:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:37 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:59:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:37 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:59:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:37 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:59:38.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:37 smithi096 ceph-mon[124666]: pgmap v17822: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 352 KiB/s rd, 197 KiB/s wr, 8 op/s 2023-05-08T12:59:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:37 smithi096 ceph-mon[124666]: osdmap e1191: 12 total, 12 up, 12 in 2023-05-08T12:59:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:37 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:59:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:37 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:59:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:37 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:59:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:39 smithi186 ceph-mon[126480]: pgmap v17824: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 199 KiB/s wr, 8 op/s 2023-05-08T12:59:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33318.331054 secs 2023-05-08T12:59:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33318.885216 secs 2023-05-08T12:59:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:39 smithi133 ceph-mon[125939]: pgmap v17824: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 199 KiB/s wr, 8 op/s 2023-05-08T12:59:40.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33318.331054 secs 2023-05-08T12:59:40.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33318.885216 secs 2023-05-08T12:59:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:39 smithi096 ceph-mon[124666]: pgmap v17824: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 199 KiB/s wr, 8 op/s 2023-05-08T12:59:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33318.331054 secs 2023-05-08T12:59:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33318.885216 secs 2023-05-08T12:59:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:41 smithi186 ceph-mon[126480]: pgmap v17825: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 985 KiB/s wr, 11 op/s 2023-05-08T12:59:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33320.177125 secs 2023-05-08T12:59:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:41 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:59:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:41 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:59:42.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:41 smithi133 ceph-mon[125939]: pgmap v17825: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 985 KiB/s wr, 11 op/s 2023-05-08T12:59:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33320.177125 secs 2023-05-08T12:59:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:41 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:59:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:41 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:59:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:41 smithi096 ceph-mon[124666]: pgmap v17825: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 985 KiB/s wr, 11 op/s 2023-05-08T12:59:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33320.177125 secs 2023-05-08T12:59:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:41 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:59:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:41 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:59:44.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:43 smithi186 ceph-mon[126480]: pgmap v17826: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 985 KiB/s wr, 11 op/s 2023-05-08T12:59:44.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:43 smithi133 ceph-mon[125939]: pgmap v17826: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 985 KiB/s wr, 11 op/s 2023-05-08T12:59:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:43 smithi096 ceph-mon[124666]: pgmap v17826: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 985 KiB/s wr, 11 op/s 2023-05-08T12:59:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33323.331212 secs 2023-05-08T12:59:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33323.885341 secs 2023-05-08T12:59:45.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33323.331212 secs 2023-05-08T12:59:45.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33323.885341 secs 2023-05-08T12:59:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33323.331212 secs 2023-05-08T12:59:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33323.885341 secs 2023-05-08T12:59:46.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:45 smithi133 ceph-mon[125939]: pgmap v17827: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 985 KiB/s wr, 11 op/s 2023-05-08T12:59:46.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:45 smithi096 ceph-mon[124666]: pgmap v17827: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 985 KiB/s wr, 11 op/s 2023-05-08T12:59:46.327 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:45 smithi186 ceph-mon[126480]: pgmap v17827: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 985 KiB/s wr, 11 op/s 2023-05-08T12:59:47.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:46 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:59:47.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:46 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:59:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:46 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:59:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:47 smithi186 ceph-mon[126480]: pgmap v17828: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 12 op/s 2023-05-08T12:59:48.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:47 smithi133 ceph-mon[125939]: pgmap v17828: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 12 op/s 2023-05-08T12:59:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:47 smithi096 ceph-mon[124666]: pgmap v17828: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 12 op/s 2023-05-08T12:59:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:59:49.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:59:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:59:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:49 smithi186 ceph-mon[126480]: pgmap v17829: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T12:59:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33328.331357 secs 2023-05-08T12:59:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:59:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:59:50.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:49 smithi133 ceph-mon[125939]: pgmap v17829: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T12:59:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33328.331357 secs 2023-05-08T12:59:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:59:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:59:50.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:49 smithi096 ceph-mon[124666]: pgmap v17829: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T12:59:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33328.331357 secs 2023-05-08T12:59:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:59:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:59:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:51 smithi186 ceph-mon[126480]: pgmap v17830: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 16 op/s 2023-05-08T12:59:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:51 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:59:52.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:51 smithi133 ceph-mon[125939]: pgmap v17830: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 16 op/s 2023-05-08T12:59:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:51 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:59:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:51 smithi096 ceph-mon[124666]: pgmap v17830: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 16 op/s 2023-05-08T12:59:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:51 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:59:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:59:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:59:53.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T12:59:54.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:53 smithi133 ceph-mon[125939]: pgmap v17831: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 850 KiB/s rd, 838 KiB/s wr, 10 op/s 2023-05-08T12:59:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:59:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:59:54.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:53 smithi096 ceph-mon[124666]: pgmap v17831: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 850 KiB/s rd, 838 KiB/s wr, 10 op/s 2023-05-08T12:59:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:59:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:59:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:53 smithi186 ceph-mon[126480]: pgmap v17831: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 850 KiB/s rd, 838 KiB/s wr, 10 op/s 2023-05-08T12:59:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T12:59:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:59:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33333.331456 secs 2023-05-08T12:59:55.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33333.331456 secs 2023-05-08T12:59:55.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33333.331456 secs 2023-05-08T12:59:56.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:55 smithi133 ceph-mon[125939]: pgmap v17832: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 850 KiB/s rd, 838 KiB/s wr, 10 op/s 2023-05-08T12:59:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33335.177502 secs 2023-05-08T12:59:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:55 smithi096 ceph-mon[124666]: pgmap v17832: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 850 KiB/s rd, 838 KiB/s wr, 10 op/s 2023-05-08T12:59:56.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33335.177502 secs 2023-05-08T12:59:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:55 smithi186 ceph-mon[126480]: pgmap v17832: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 850 KiB/s rd, 838 KiB/s wr, 10 op/s 2023-05-08T12:59:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33335.177502 secs 2023-05-08T12:59:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:56 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:59:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:56 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:59:57.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:56 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T12:59:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:57 smithi133 ceph-mon[125939]: pgmap v17833: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2023-05-08T12:59:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:59:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:59:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:57 smithi096 ceph-mon[124666]: pgmap v17833: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2023-05-08T12:59:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:59:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T12:59:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:57 smithi186 ceph-mon[126480]: pgmap v17833: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2023-05-08T12:59:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T12:59:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:00:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:59 smithi133 ceph-mon[125939]: pgmap v17834: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 705 KiB/s rd, 670 KiB/s wr, 9 op/s 2023-05-08T13:00:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 12:59:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33338.331552 secs 2023-05-08T13:00:00.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:59 smithi096 ceph-mon[124666]: pgmap v17834: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 705 KiB/s rd, 670 KiB/s wr, 9 op/s 2023-05-08T13:00:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 12:59:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33338.331552 secs 2023-05-08T13:00:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:59 smithi186 ceph-mon[126480]: pgmap v17834: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 705 KiB/s rd, 670 KiB/s wr, 9 op/s 2023-05-08T13:00:00.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 12:59:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33338.331552 secs 2023-05-08T13:00:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:00 smithi133 ceph-mon[125939]: Health detail: HEALTH_WARN 2 MDSs report slow requests 2023-05-08T13:00:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:00 smithi133 ceph-mon[125939]: [WRN] MDS_SLOW_REQUEST: 2 MDSs report slow requests 2023-05-08T13:00:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:00 smithi133 ceph-mon[125939]: mds.i(mds.1): 1 slow requests are blocked > 180 secs 2023-05-08T13:00:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:00 smithi133 ceph-mon[125939]: mds.b(mds.0): 1 slow requests are blocked > 180 secs 2023-05-08T13:00:01.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33340.177640 secs 2023-05-08T13:00:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:00 smithi096 ceph-mon[124666]: Health detail: HEALTH_WARN 2 MDSs report slow requests 2023-05-08T13:00:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:00 smithi096 ceph-mon[124666]: [WRN] MDS_SLOW_REQUEST: 2 MDSs report slow requests 2023-05-08T13:00:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:00 smithi096 ceph-mon[124666]: mds.i(mds.1): 1 slow requests are blocked > 180 secs 2023-05-08T13:00:01.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:00 smithi096 ceph-mon[124666]: mds.b(mds.0): 1 slow requests are blocked > 180 secs 2023-05-08T13:00:01.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33340.177640 secs 2023-05-08T13:00:01.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:00 smithi186 ceph-mon[126480]: Health detail: HEALTH_WARN 2 MDSs report slow requests 2023-05-08T13:00:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:00 smithi186 ceph-mon[126480]: [WRN] MDS_SLOW_REQUEST: 2 MDSs report slow requests 2023-05-08T13:00:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:00 smithi186 ceph-mon[126480]: mds.i(mds.1): 1 slow requests are blocked > 180 secs 2023-05-08T13:00:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:00 smithi186 ceph-mon[126480]: mds.b(mds.0): 1 slow requests are blocked > 180 secs 2023-05-08T13:00:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33340.177640 secs 2023-05-08T13:00:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:01 smithi133 ceph-mon[125939]: pgmap v17835: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.8 MiB/s wr, 16 op/s 2023-05-08T13:00:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:01 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:00:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:01 smithi096 ceph-mon[124666]: pgmap v17835: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.8 MiB/s wr, 16 op/s 2023-05-08T13:00:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:01 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:00:02.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:01 smithi186 ceph-mon[126480]: pgmap v17835: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.8 MiB/s wr, 16 op/s 2023-05-08T13:00:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:01 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:00:04.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:03 smithi133 ceph-mon[125939]: pgmap v17836: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 10 op/s 2023-05-08T13:00:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:03 smithi096 ceph-mon[124666]: pgmap v17836: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 10 op/s 2023-05-08T13:00:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:03 smithi186 ceph-mon[126480]: pgmap v17836: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 10 op/s 2023-05-08T13:00:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33343.331623 secs 2023-05-08T13:00:05.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33343.885849 secs 2023-05-08T13:00:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33343.331623 secs 2023-05-08T13:00:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33343.885849 secs 2023-05-08T13:00:05.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33343.331623 secs 2023-05-08T13:00:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33343.885849 secs 2023-05-08T13:00:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:05 smithi133 ceph-mon[125939]: pgmap v17837: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 10 op/s 2023-05-08T13:00:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:00:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:00:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33345.177734 secs 2023-05-08T13:00:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:05 smithi096 ceph-mon[124666]: pgmap v17837: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 10 op/s 2023-05-08T13:00:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:00:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:00:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33345.177734 secs 2023-05-08T13:00:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:05 smithi186 ceph-mon[126480]: pgmap v17837: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 10 op/s 2023-05-08T13:00:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:00:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:00:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33345.177734 secs 2023-05-08T13:00:07.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:06 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:00:07.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:06 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:00:07.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:06 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:00:08.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:07 smithi133 ceph-mon[125939]: pgmap v17838: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 30 op/s 2023-05-08T13:00:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:07 smithi096 ceph-mon[124666]: pgmap v17838: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 30 op/s 2023-05-08T13:00:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:07 smithi186 ceph-mon[126480]: pgmap v17838: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 30 op/s 2023-05-08T13:00:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:09 smithi133 ceph-mon[125939]: pgmap v17839: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 26 op/s 2023-05-08T13:00:10.270 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33348.331687 secs 2023-05-08T13:00:10.270 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33348.885964 secs 2023-05-08T13:00:10.270 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:09 smithi096 ceph-mon[124666]: pgmap v17839: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 26 op/s 2023-05-08T13:00:10.271 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33348.331687 secs 2023-05-08T13:00:10.271 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33348.885964 secs 2023-05-08T13:00:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:09 smithi186 ceph-mon[126480]: pgmap v17839: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 26 op/s 2023-05-08T13:00:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33348.331687 secs 2023-05-08T13:00:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33348.885964 secs 2023-05-08T13:00:11.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33350.177865 secs 2023-05-08T13:00:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33350.177865 secs 2023-05-08T13:00:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33350.177865 secs 2023-05-08T13:00:12.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:11 smithi133 ceph-mon[125939]: pgmap v17840: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.8 MiB/s wr, 29 op/s 2023-05-08T13:00:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:11 smithi133 ceph-mon[125939]: osdmap e1192: 12 total, 12 up, 12 in 2023-05-08T13:00:12.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:11 smithi096 ceph-mon[124666]: pgmap v17840: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.8 MiB/s wr, 29 op/s 2023-05-08T13:00:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:11 smithi096 ceph-mon[124666]: osdmap e1192: 12 total, 12 up, 12 in 2023-05-08T13:00:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:11 smithi186 ceph-mon[126480]: pgmap v17840: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.8 MiB/s wr, 29 op/s 2023-05-08T13:00:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:11 smithi186 ceph-mon[126480]: osdmap e1192: 12 total, 12 up, 12 in 2023-05-08T13:00:14.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:13 smithi133 ceph-mon[125939]: pgmap v17842: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 772 KiB/s rd, 787 KiB/s wr, 28 op/s 2023-05-08T13:00:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:13 smithi096 ceph-mon[124666]: pgmap v17842: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 772 KiB/s rd, 787 KiB/s wr, 28 op/s 2023-05-08T13:00:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:13 smithi186 ceph-mon[126480]: pgmap v17842: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 772 KiB/s rd, 787 KiB/s wr, 28 op/s 2023-05-08T13:00:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33353.331807 secs 2023-05-08T13:00:15.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33353.886121 secs 2023-05-08T13:00:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33353.331807 secs 2023-05-08T13:00:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33353.886121 secs 2023-05-08T13:00:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33353.331807 secs 2023-05-08T13:00:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33353.886121 secs 2023-05-08T13:00:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:15 smithi133 ceph-mon[125939]: pgmap v17843: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 772 KiB/s rd, 787 KiB/s wr, 28 op/s 2023-05-08T13:00:16.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33355.177953 secs 2023-05-08T13:00:16.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:15 smithi096 ceph-mon[124666]: pgmap v17843: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 772 KiB/s rd, 787 KiB/s wr, 28 op/s 2023-05-08T13:00:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33355.177953 secs 2023-05-08T13:00:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:15 smithi186 ceph-mon[126480]: pgmap v17843: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 772 KiB/s rd, 787 KiB/s wr, 28 op/s 2023-05-08T13:00:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33355.177953 secs 2023-05-08T13:00:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:16 smithi133 ceph-mon[125939]: pgmap v17844: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 355 KiB/s wr, 8 op/s 2023-05-08T13:00:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:16 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:00:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:16 smithi096 ceph-mon[124666]: pgmap v17844: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 355 KiB/s wr, 8 op/s 2023-05-08T13:00:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:16 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:00:17.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:16 smithi186 ceph-mon[126480]: pgmap v17844: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 355 KiB/s wr, 8 op/s 2023-05-08T13:00:17.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:16 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:00:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:17 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:00:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:17 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:00:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:17 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:00:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:17 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:00:18.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:17 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T13:00:18.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:17 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T13:00:18.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:17 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:00:18.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:17 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:00:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:17 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:00:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:17 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:00:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:17 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:00:18.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:17 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T13:00:18.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:17 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T13:00:18.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:17 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:00:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:17 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:00:18.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:17 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:00:18.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:17 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:00:18.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:17 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:00:18.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:17 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T13:00:18.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:17 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T13:00:18.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:17 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:00:19.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:18 smithi133 ceph-mon[125939]: pgmap v17845: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 355 KiB/s wr, 8 op/s 2023-05-08T13:00:19.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:18 smithi096 ceph-mon[124666]: pgmap v17845: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 355 KiB/s wr, 8 op/s 2023-05-08T13:00:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:18 smithi186 ceph-mon[126480]: pgmap v17845: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 355 KiB/s wr, 8 op/s 2023-05-08T13:00:20.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33358.331948 secs 2023-05-08T13:00:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33358.886253 secs 2023-05-08T13:00:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33358.331948 secs 2023-05-08T13:00:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33358.886253 secs 2023-05-08T13:00:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33358.331948 secs 2023-05-08T13:00:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33358.886253 secs 2023-05-08T13:00:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:20 smithi133 ceph-mon[125939]: pgmap v17846: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 355 KiB/s wr, 9 op/s 2023-05-08T13:00:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33360.178100 secs 2023-05-08T13:00:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:20 smithi096 ceph-mon[124666]: pgmap v17846: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 355 KiB/s wr, 9 op/s 2023-05-08T13:00:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33360.178100 secs 2023-05-08T13:00:21.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:20 smithi186 ceph-mon[126480]: pgmap v17846: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 355 KiB/s wr, 9 op/s 2023-05-08T13:00:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33360.178100 secs 2023-05-08T13:00:23.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:22 smithi186 ceph-mon[126480]: osdmap e1193: 12 total, 12 up, 12 in 2023-05-08T13:00:23.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:22 smithi133 ceph-mon[125939]: osdmap e1193: 12 total, 12 up, 12 in 2023-05-08T13:00:23.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:22 smithi096 ceph-mon[124666]: osdmap e1193: 12 total, 12 up, 12 in 2023-05-08T13:00:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:23 smithi186 ceph-mon[126480]: pgmap v17848: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 355 KiB/s wr, 9 op/s 2023-05-08T13:00:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:23 smithi133 ceph-mon[125939]: pgmap v17848: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 355 KiB/s wr, 9 op/s 2023-05-08T13:00:24.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:23 smithi096 ceph-mon[124666]: pgmap v17848: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 355 KiB/s wr, 9 op/s 2023-05-08T13:00:25.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33363.332091 secs 2023-05-08T13:00:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33363.886317 secs 2023-05-08T13:00:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33363.332091 secs 2023-05-08T13:00:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33363.886317 secs 2023-05-08T13:00:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33363.332091 secs 2023-05-08T13:00:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33363.886317 secs 2023-05-08T13:00:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:25 smithi186 ceph-mon[126480]: pgmap v17849: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 355 KiB/s wr, 9 op/s 2023-05-08T13:00:26.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:25 smithi133 ceph-mon[125939]: pgmap v17849: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 355 KiB/s wr, 9 op/s 2023-05-08T13:00:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:25 smithi096 ceph-mon[124666]: pgmap v17849: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 355 KiB/s wr, 9 op/s 2023-05-08T13:00:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33365.178252 secs 2023-05-08T13:00:27.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33365.178252 secs 2023-05-08T13:00:27.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33365.178252 secs 2023-05-08T13:00:28.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:27 smithi186 ceph-mon[126480]: pgmap v17850: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 381 KiB/s wr, 9 op/s 2023-05-08T13:00:28.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:27 smithi133 ceph-mon[125939]: pgmap v17850: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 381 KiB/s wr, 9 op/s 2023-05-08T13:00:28.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:27 smithi096 ceph-mon[124666]: pgmap v17850: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 381 KiB/s wr, 9 op/s 2023-05-08T13:00:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:29 smithi186 ceph-mon[126480]: pgmap v17851: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 381 KiB/s wr, 9 op/s 2023-05-08T13:00:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33368.332240 secs 2023-05-08T13:00:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33368.886436 secs 2023-05-08T13:00:30.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:29 smithi133 ceph-mon[125939]: pgmap v17851: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 381 KiB/s wr, 9 op/s 2023-05-08T13:00:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33368.332240 secs 2023-05-08T13:00:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33368.886436 secs 2023-05-08T13:00:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:29 smithi096 ceph-mon[124666]: pgmap v17851: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 381 KiB/s wr, 9 op/s 2023-05-08T13:00:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33368.332240 secs 2023-05-08T13:00:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33368.886436 secs 2023-05-08T13:00:32.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:31 smithi133 ceph-mon[125939]: pgmap v17852: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 521 KiB/s rd, 519 KiB/s wr, 9 op/s 2023-05-08T13:00:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33370.178372 secs 2023-05-08T13:00:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:31 smithi096 ceph-mon[124666]: pgmap v17852: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 521 KiB/s rd, 519 KiB/s wr, 9 op/s 2023-05-08T13:00:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33370.178372 secs 2023-05-08T13:00:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:31 smithi186 ceph-mon[126480]: pgmap v17852: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 521 KiB/s rd, 519 KiB/s wr, 9 op/s 2023-05-08T13:00:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33370.178372 secs 2023-05-08T13:00:34.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:33 smithi133 ceph-mon[125939]: pgmap v17853: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 512 KiB/s rd, 509 KiB/s wr, 9 op/s 2023-05-08T13:00:34.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:33 smithi096 ceph-mon[124666]: pgmap v17853: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 512 KiB/s rd, 509 KiB/s wr, 9 op/s 2023-05-08T13:00:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:33 smithi186 ceph-mon[126480]: pgmap v17853: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 512 KiB/s rd, 509 KiB/s wr, 9 op/s 2023-05-08T13:00:35.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33373.332365 secs 2023-05-08T13:00:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33373.886597 secs 2023-05-08T13:00:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33373.332365 secs 2023-05-08T13:00:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33373.886597 secs 2023-05-08T13:00:35.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33373.332365 secs 2023-05-08T13:00:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33373.886597 secs 2023-05-08T13:00:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:35 smithi133 ceph-mon[125939]: pgmap v17854: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 434 KiB/s rd, 432 KiB/s wr, 7 op/s 2023-05-08T13:00:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:35 smithi096 ceph-mon[124666]: pgmap v17854: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 434 KiB/s rd, 432 KiB/s wr, 7 op/s 2023-05-08T13:00:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:35 smithi186 ceph-mon[126480]: pgmap v17854: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 434 KiB/s rd, 432 KiB/s wr, 7 op/s 2023-05-08T13:00:37.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33375.178526 secs 2023-05-08T13:00:37.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33375.178526 secs 2023-05-08T13:00:37.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33375.178526 secs 2023-05-08T13:00:38.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:37 smithi133 ceph-mon[125939]: pgmap v17855: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 740 KiB/s rd, 737 KiB/s wr, 11 op/s 2023-05-08T13:00:38.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:37 smithi096 ceph-mon[124666]: pgmap v17855: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 740 KiB/s rd, 737 KiB/s wr, 11 op/s 2023-05-08T13:00:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:37 smithi186 ceph-mon[126480]: pgmap v17855: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 740 KiB/s rd, 737 KiB/s wr, 11 op/s 2023-05-08T13:00:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:39 smithi133 ceph-mon[125939]: pgmap v17856: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 587 KiB/s rd, 585 KiB/s wr, 7 op/s 2023-05-08T13:00:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33378.332490 secs 2023-05-08T13:00:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33378.886716 secs 2023-05-08T13:00:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:39 smithi096 ceph-mon[124666]: pgmap v17856: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 587 KiB/s rd, 585 KiB/s wr, 7 op/s 2023-05-08T13:00:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33378.332490 secs 2023-05-08T13:00:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33378.886716 secs 2023-05-08T13:00:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:39 smithi186 ceph-mon[126480]: pgmap v17856: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 587 KiB/s rd, 585 KiB/s wr, 7 op/s 2023-05-08T13:00:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33378.332490 secs 2023-05-08T13:00:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33378.886716 secs 2023-05-08T13:00:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33380.178648 secs 2023-05-08T13:00:41.286 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33380.178648 secs 2023-05-08T13:00:41.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33380.178648 secs 2023-05-08T13:00:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:41 smithi133 ceph-mon[125939]: pgmap v17857: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 586 KiB/s wr, 11 op/s 2023-05-08T13:00:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:41 smithi096 ceph-mon[124666]: pgmap v17857: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 586 KiB/s wr, 11 op/s 2023-05-08T13:00:42.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:41 smithi186 ceph-mon[126480]: pgmap v17857: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 586 KiB/s wr, 11 op/s 2023-05-08T13:00:43.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:43 smithi133 ceph-mon[125939]: pgmap v17858: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 306 KiB/s wr, 7 op/s 2023-05-08T13:00:43.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:43 smithi096 ceph-mon[124666]: pgmap v17858: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 306 KiB/s wr, 7 op/s 2023-05-08T13:00:43.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:43 smithi186 ceph-mon[126480]: pgmap v17858: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 306 KiB/s wr, 7 op/s 2023-05-08T13:00:45.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33383.332578 secs 2023-05-08T13:00:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:45 smithi133 ceph-mon[125939]: pgmap v17859: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 306 KiB/s wr, 7 op/s 2023-05-08T13:00:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33383.886804 secs 2023-05-08T13:00:45.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33383.332578 secs 2023-05-08T13:00:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:45 smithi096 ceph-mon[124666]: pgmap v17859: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 306 KiB/s wr, 7 op/s 2023-05-08T13:00:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33383.886804 secs 2023-05-08T13:00:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33383.332578 secs 2023-05-08T13:00:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:45 smithi186 ceph-mon[126480]: pgmap v17859: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 306 KiB/s wr, 7 op/s 2023-05-08T13:00:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33383.886804 secs 2023-05-08T13:00:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:47 smithi186 ceph-mon[126480]: pgmap v17860: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 694 KiB/s rd, 691 KiB/s wr, 11 op/s 2023-05-08T13:00:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:47 smithi133 ceph-mon[125939]: pgmap v17860: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 694 KiB/s rd, 691 KiB/s wr, 11 op/s 2023-05-08T13:00:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:47 smithi096 ceph-mon[124666]: pgmap v17860: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 694 KiB/s rd, 691 KiB/s wr, 11 op/s 2023-05-08T13:00:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:00:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:00:49.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:00:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:49 smithi186 ceph-mon[126480]: pgmap v17861: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 386 KiB/s wr, 7 op/s 2023-05-08T13:00:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33388.332703 secs 2023-05-08T13:00:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:00:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:00:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:00:50.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:49 smithi133 ceph-mon[125939]: pgmap v17861: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 386 KiB/s wr, 7 op/s 2023-05-08T13:00:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33388.332703 secs 2023-05-08T13:00:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:00:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:00:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:00:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:49 smithi096 ceph-mon[124666]: pgmap v17861: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 386 KiB/s wr, 7 op/s 2023-05-08T13:00:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33388.332703 secs 2023-05-08T13:00:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:00:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:00:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:00:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:51 smithi186 ceph-mon[126480]: pgmap v17862: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T13:00:52.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:51 smithi133 ceph-mon[125939]: pgmap v17862: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T13:00:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:51 smithi096 ceph-mon[124666]: pgmap v17862: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T13:00:53.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:00:53.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:00:53.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:00:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:53 smithi133 ceph-mon[125939]: pgmap v17863: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 8 op/s 2023-05-08T13:00:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:00:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:00:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:53 smithi096 ceph-mon[124666]: pgmap v17863: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 8 op/s 2023-05-08T13:00:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:00:54.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:00:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:53 smithi186 ceph-mon[126480]: pgmap v17863: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 8 op/s 2023-05-08T13:00:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:00:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:00:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33393.332836 secs 2023-05-08T13:00:55.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33393.332836 secs 2023-05-08T13:00:55.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33393.332836 secs 2023-05-08T13:00:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:55 smithi133 ceph-mon[125939]: pgmap v17864: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 8 op/s 2023-05-08T13:00:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:55 smithi096 ceph-mon[124666]: pgmap v17864: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 8 op/s 2023-05-08T13:00:56.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:55 smithi186 ceph-mon[126480]: pgmap v17864: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 8 op/s 2023-05-08T13:00:57.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:56 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:00:57.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:56 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:00:57.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:56 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:00:58.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:57 smithi133 ceph-mon[125939]: pgmap v17865: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 14 op/s 2023-05-08T13:00:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:57 smithi096 ceph-mon[124666]: pgmap v17865: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 14 op/s 2023-05-08T13:00:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:57 smithi186 ceph-mon[126480]: pgmap v17865: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 14 op/s 2023-05-08T13:01:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:59 smithi133 ceph-mon[125939]: pgmap v17866: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T13:01:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33398.332980 secs 2023-05-08T13:01:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:00:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33398.887132 secs 2023-05-08T13:01:00.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:59 smithi096 ceph-mon[124666]: pgmap v17866: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T13:01:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33398.332980 secs 2023-05-08T13:01:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:00:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33398.887132 secs 2023-05-08T13:01:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:59 smithi186 ceph-mon[126480]: pgmap v17866: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T13:01:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33398.332980 secs 2023-05-08T13:01:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:00:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33398.887132 secs 2023-05-08T13:01:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:01 smithi133 ceph-mon[125939]: pgmap v17867: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.7 MiB/s wr, 15 op/s 2023-05-08T13:01:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:01:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:01:02.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:01 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:01:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:01 smithi096 ceph-mon[124666]: pgmap v17867: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.7 MiB/s wr, 15 op/s 2023-05-08T13:01:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:01:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:01:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:01 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:01:02.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:01 smithi186 ceph-mon[126480]: pgmap v17867: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.7 MiB/s wr, 15 op/s 2023-05-08T13:01:02.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:01:02.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:01:02.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:01 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:01:04.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:03 smithi133 ceph-mon[125939]: pgmap v17868: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 931 KiB/s wr, 11 op/s 2023-05-08T13:01:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:03 smithi096 ceph-mon[124666]: pgmap v17868: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 931 KiB/s wr, 11 op/s 2023-05-08T13:01:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:03 smithi186 ceph-mon[126480]: pgmap v17868: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 931 KiB/s wr, 11 op/s 2023-05-08T13:01:05.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33403.333084 secs 2023-05-08T13:01:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:04 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:01:05.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33403.333084 secs 2023-05-08T13:01:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:04 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:01:05.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33403.333084 secs 2023-05-08T13:01:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:04 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:01:06.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:05 smithi133 ceph-mon[125939]: pgmap v17869: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 931 KiB/s wr, 11 op/s 2023-05-08T13:01:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:01:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:01:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:05 smithi096 ceph-mon[124666]: pgmap v17869: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 931 KiB/s wr, 11 op/s 2023-05-08T13:01:06.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:01:06.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:01:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:05 smithi186 ceph-mon[126480]: pgmap v17869: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 931 KiB/s wr, 11 op/s 2023-05-08T13:01:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:01:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:01:07.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:06 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:01:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:06 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:01:07.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:06 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:01:08.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:07 smithi133 ceph-mon[125939]: pgmap v17870: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.1 MiB/s wr, 29 op/s 2023-05-08T13:01:08.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:07 smithi096 ceph-mon[124666]: pgmap v17870: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.1 MiB/s wr, 29 op/s 2023-05-08T13:01:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:07 smithi186 ceph-mon[126480]: pgmap v17870: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.1 MiB/s wr, 29 op/s 2023-05-08T13:01:10.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:09 smithi133 ceph-mon[125939]: pgmap v17871: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.7 MiB/s wr, 23 op/s 2023-05-08T13:01:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33408.333216 secs 2023-05-08T13:01:10.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:09 smithi096 ceph-mon[124666]: pgmap v17871: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.7 MiB/s wr, 23 op/s 2023-05-08T13:01:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33408.333216 secs 2023-05-08T13:01:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:09 smithi186 ceph-mon[126480]: pgmap v17871: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.7 MiB/s wr, 23 op/s 2023-05-08T13:01:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33408.333216 secs 2023-05-08T13:01:12.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:11 smithi133 ceph-mon[125939]: pgmap v17872: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.7 MiB/s wr, 26 op/s 2023-05-08T13:01:12.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:11 smithi096 ceph-mon[124666]: pgmap v17872: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.7 MiB/s wr, 26 op/s 2023-05-08T13:01:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:11 smithi186 ceph-mon[126480]: pgmap v17872: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.7 MiB/s wr, 26 op/s 2023-05-08T13:01:14.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:13 smithi133 ceph-mon[125939]: pgmap v17873: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 21 op/s 2023-05-08T13:01:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:13 smithi096 ceph-mon[124666]: pgmap v17873: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 21 op/s 2023-05-08T13:01:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:13 smithi186 ceph-mon[126480]: pgmap v17873: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 21 op/s 2023-05-08T13:01:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33413.333360 secs 2023-05-08T13:01:15.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33413.333360 secs 2023-05-08T13:01:15.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33413.333360 secs 2023-05-08T13:01:16.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:15 smithi133 ceph-mon[125939]: pgmap v17874: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 21 op/s 2023-05-08T13:01:16.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:15 smithi096 ceph-mon[124666]: pgmap v17874: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 21 op/s 2023-05-08T13:01:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:15 smithi186 ceph-mon[126480]: pgmap v17874: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 21 op/s 2023-05-08T13:01:18.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:17 smithi186 ceph-mon[126480]: pgmap v17875: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 24 op/s 2023-05-08T13:01:18.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:17 smithi133 ceph-mon[125939]: pgmap v17875: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 24 op/s 2023-05-08T13:01:18.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:17 smithi096 ceph-mon[124666]: pgmap v17875: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 24 op/s 2023-05-08T13:01:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:19 smithi186 ceph-mon[126480]: pgmap v17876: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 107 KiB/s wr, 6 op/s 2023-05-08T13:01:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33418.333459 secs 2023-05-08T13:01:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:19 smithi133 ceph-mon[125939]: pgmap v17876: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 107 KiB/s wr, 6 op/s 2023-05-08T13:01:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33418.333459 secs 2023-05-08T13:01:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:19 smithi096 ceph-mon[124666]: pgmap v17876: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 107 KiB/s wr, 6 op/s 2023-05-08T13:01:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33418.333459 secs 2023-05-08T13:01:21.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:20 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:01:21.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:20 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:01:21.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:20 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:01:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:21 smithi186 ceph-mon[126480]: pgmap v17877: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 130 KiB/s wr, 9 op/s 2023-05-08T13:01:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:01:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:01:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:01:22.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:21 smithi133 ceph-mon[125939]: pgmap v17877: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 130 KiB/s wr, 9 op/s 2023-05-08T13:01:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:01:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:01:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:01:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:21 smithi096 ceph-mon[124666]: pgmap v17877: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 130 KiB/s wr, 9 op/s 2023-05-08T13:01:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:01:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:01:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:01:23.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:22 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:01:23.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:22 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T13:01:23.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:22 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T13:01:23.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:22 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:01:23.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:22 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:01:23.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:22 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T13:01:23.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:22 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T13:01:23.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:22 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:01:23.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:22 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:01:23.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:22 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T13:01:23.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:22 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T13:01:23.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:22 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:01:24.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:23 smithi133 ceph-mon[125939]: pgmap v17878: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 130 KiB/s wr, 6 op/s 2023-05-08T13:01:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:23 smithi096 ceph-mon[124666]: pgmap v17878: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 130 KiB/s wr, 6 op/s 2023-05-08T13:01:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:23 smithi186 ceph-mon[126480]: pgmap v17878: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 130 KiB/s wr, 6 op/s 2023-05-08T13:01:25.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33423.333598 secs 2023-05-08T13:01:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33423.887770 secs 2023-05-08T13:01:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33423.333598 secs 2023-05-08T13:01:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33423.887770 secs 2023-05-08T13:01:25.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33423.333598 secs 2023-05-08T13:01:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33423.887770 secs 2023-05-08T13:01:26.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:25 smithi133 ceph-mon[125939]: pgmap v17879: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 130 KiB/s wr, 6 op/s 2023-05-08T13:01:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:25 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:01:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:25 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:01:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:25 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:01:26.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:25 smithi096 ceph-mon[124666]: pgmap v17879: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 130 KiB/s wr, 6 op/s 2023-05-08T13:01:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:25 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:01:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:25 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:01:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:25 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:01:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:25 smithi186 ceph-mon[126480]: pgmap v17879: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 130 KiB/s wr, 6 op/s 2023-05-08T13:01:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:25 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:01:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:25 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:01:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:25 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:01:27.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33425.179750 secs 2023-05-08T13:01:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:26 smithi133 ceph-mon[125939]: osdmap e1194: 12 total, 12 up, 12 in 2023-05-08T13:01:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33425.179750 secs 2023-05-08T13:01:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:26 smithi096 ceph-mon[124666]: osdmap e1194: 12 total, 12 up, 12 in 2023-05-08T13:01:27.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33425.179750 secs 2023-05-08T13:01:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:26 smithi186 ceph-mon[126480]: osdmap e1194: 12 total, 12 up, 12 in 2023-05-08T13:01:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:27 smithi133 ceph-mon[125939]: pgmap v17881: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 491 KiB/s rd, 515 KiB/s wr, 12 op/s 2023-05-08T13:01:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:27 smithi096 ceph-mon[124666]: pgmap v17881: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 491 KiB/s rd, 515 KiB/s wr, 12 op/s 2023-05-08T13:01:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:27 smithi186 ceph-mon[126480]: pgmap v17881: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 491 KiB/s rd, 515 KiB/s wr, 12 op/s 2023-05-08T13:01:30.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:29 smithi133 ceph-mon[125939]: pgmap v17882: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 491 KiB/s rd, 515 KiB/s wr, 12 op/s 2023-05-08T13:01:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33428.333741 secs 2023-05-08T13:01:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:29 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:01:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:29 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:01:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33428.887890 secs 2023-05-08T13:01:30.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:29 smithi096 ceph-mon[124666]: pgmap v17882: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 491 KiB/s rd, 515 KiB/s wr, 12 op/s 2023-05-08T13:01:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33428.333741 secs 2023-05-08T13:01:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:29 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:01:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:29 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:01:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33428.887890 secs 2023-05-08T13:01:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:29 smithi186 ceph-mon[126480]: pgmap v17882: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 491 KiB/s rd, 515 KiB/s wr, 12 op/s 2023-05-08T13:01:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33428.333741 secs 2023-05-08T13:01:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:29 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:01:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:29 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:01:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33428.887890 secs 2023-05-08T13:01:31.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33430.179835 secs 2023-05-08T13:01:31.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33430.179835 secs 2023-05-08T13:01:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33430.179835 secs 2023-05-08T13:01:32.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:31 smithi133 ceph-mon[125939]: pgmap v17883: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 465 KiB/s rd, 489 KiB/s wr, 13 op/s 2023-05-08T13:01:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:31 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:01:32.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:31 smithi096 ceph-mon[124666]: pgmap v17883: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 465 KiB/s rd, 489 KiB/s wr, 13 op/s 2023-05-08T13:01:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:31 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:01:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:31 smithi186 ceph-mon[126480]: pgmap v17883: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 465 KiB/s rd, 489 KiB/s wr, 13 op/s 2023-05-08T13:01:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:31 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:01:34.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:33 smithi133 ceph-mon[125939]: pgmap v17884: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 465 KiB/s rd, 489 KiB/s wr, 12 op/s 2023-05-08T13:01:34.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:33 smithi096 ceph-mon[124666]: pgmap v17884: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 465 KiB/s rd, 489 KiB/s wr, 12 op/s 2023-05-08T13:01:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:33 smithi186 ceph-mon[126480]: pgmap v17884: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 465 KiB/s rd, 489 KiB/s wr, 12 op/s 2023-05-08T13:01:35.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33433.333841 secs 2023-05-08T13:01:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33433.888038 secs 2023-05-08T13:01:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33433.333841 secs 2023-05-08T13:01:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33433.888038 secs 2023-05-08T13:01:35.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33433.333841 secs 2023-05-08T13:01:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33433.888038 secs 2023-05-08T13:01:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:35 smithi133 ceph-mon[125939]: pgmap v17885: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 465 KiB/s rd, 489 KiB/s wr, 12 op/s 2023-05-08T13:01:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33435.179938 secs 2023-05-08T13:01:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:35 smithi096 ceph-mon[124666]: pgmap v17885: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 465 KiB/s rd, 489 KiB/s wr, 12 op/s 2023-05-08T13:01:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33435.179938 secs 2023-05-08T13:01:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:35 smithi186 ceph-mon[126480]: pgmap v17885: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 465 KiB/s rd, 489 KiB/s wr, 12 op/s 2023-05-08T13:01:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33435.179938 secs 2023-05-08T13:01:38.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:37 smithi186 ceph-mon[126480]: pgmap v17886: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 156 KiB/s wr, 9 op/s 2023-05-08T13:01:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:37 smithi186 ceph-mon[126480]: osdmap e1195: 12 total, 12 up, 12 in 2023-05-08T13:01:38.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:37 smithi133 ceph-mon[125939]: pgmap v17886: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 156 KiB/s wr, 9 op/s 2023-05-08T13:01:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:37 smithi133 ceph-mon[125939]: osdmap e1195: 12 total, 12 up, 12 in 2023-05-08T13:01:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:37 smithi096 ceph-mon[124666]: pgmap v17886: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 156 KiB/s wr, 9 op/s 2023-05-08T13:01:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:37 smithi096 ceph-mon[124666]: osdmap e1195: 12 total, 12 up, 12 in 2023-05-08T13:01:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:39 smithi186 ceph-mon[126480]: pgmap v17888: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 158 KiB/s wr, 9 op/s 2023-05-08T13:01:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33438.333965 secs 2023-05-08T13:01:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33438.888173 secs 2023-05-08T13:01:40.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:39 smithi133 ceph-mon[125939]: pgmap v17888: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 158 KiB/s wr, 9 op/s 2023-05-08T13:01:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33438.333965 secs 2023-05-08T13:01:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33438.888173 secs 2023-05-08T13:01:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:39 smithi096 ceph-mon[124666]: pgmap v17888: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 158 KiB/s wr, 9 op/s 2023-05-08T13:01:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33438.333965 secs 2023-05-08T13:01:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33438.888173 secs 2023-05-08T13:01:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:41 smithi186 ceph-mon[126480]: pgmap v17889: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 497 KiB/s rd, 494 KiB/s wr, 9 op/s 2023-05-08T13:01:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33440.180061 secs 2023-05-08T13:01:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:41 smithi133 ceph-mon[125939]: pgmap v17889: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 497 KiB/s rd, 494 KiB/s wr, 9 op/s 2023-05-08T13:01:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33440.180061 secs 2023-05-08T13:01:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:41 smithi096 ceph-mon[124666]: pgmap v17889: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 497 KiB/s rd, 494 KiB/s wr, 9 op/s 2023-05-08T13:01:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33440.180061 secs 2023-05-08T13:01:44.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:43 smithi133 ceph-mon[125939]: pgmap v17890: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 497 KiB/s rd, 494 KiB/s wr, 9 op/s 2023-05-08T13:01:44.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:43 smithi096 ceph-mon[124666]: pgmap v17890: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 497 KiB/s rd, 494 KiB/s wr, 9 op/s 2023-05-08T13:01:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:43 smithi186 ceph-mon[126480]: pgmap v17890: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 497 KiB/s rd, 494 KiB/s wr, 9 op/s 2023-05-08T13:01:45.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33443.334077 secs 2023-05-08T13:01:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33443.888304 secs 2023-05-08T13:01:45.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33443.334077 secs 2023-05-08T13:01:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33443.888304 secs 2023-05-08T13:01:45.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33443.334077 secs 2023-05-08T13:01:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33443.888304 secs 2023-05-08T13:01:46.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:45 smithi133 ceph-mon[125939]: pgmap v17891: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 497 KiB/s rd, 494 KiB/s wr, 9 op/s 2023-05-08T13:01:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:45 smithi096 ceph-mon[124666]: pgmap v17891: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 497 KiB/s rd, 494 KiB/s wr, 9 op/s 2023-05-08T13:01:46.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:45 smithi186 ceph-mon[126480]: pgmap v17891: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 497 KiB/s rd, 494 KiB/s wr, 9 op/s 2023-05-08T13:01:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:47 smithi133 ceph-mon[125939]: pgmap v17892: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 642 KiB/s rd, 1008 KiB/s wr, 8 op/s 2023-05-08T13:01:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:47 smithi096 ceph-mon[124666]: pgmap v17892: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 642 KiB/s rd, 1008 KiB/s wr, 8 op/s 2023-05-08T13:01:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:47 smithi186 ceph-mon[126480]: pgmap v17892: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 642 KiB/s rd, 1008 KiB/s wr, 8 op/s 2023-05-08T13:01:49.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:01:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:01:49.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:01:50.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:49 smithi133 ceph-mon[125939]: pgmap v17893: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 574 KiB/s rd, 901 KiB/s wr, 7 op/s 2023-05-08T13:01:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33448.334217 secs 2023-05-08T13:01:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:01:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:01:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:01:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:49 smithi096 ceph-mon[124666]: pgmap v17893: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 574 KiB/s rd, 901 KiB/s wr, 7 op/s 2023-05-08T13:01:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33448.334217 secs 2023-05-08T13:01:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:01:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:01:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:01:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:49 smithi186 ceph-mon[126480]: pgmap v17893: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 574 KiB/s rd, 901 KiB/s wr, 7 op/s 2023-05-08T13:01:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33448.334217 secs 2023-05-08T13:01:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:01:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:01:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:01:52.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:51 smithi133 ceph-mon[125939]: pgmap v17894: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 946 KiB/s wr, 11 op/s 2023-05-08T13:01:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:51 smithi096 ceph-mon[124666]: pgmap v17894: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 946 KiB/s wr, 11 op/s 2023-05-08T13:01:52.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:51 smithi186 ceph-mon[126480]: pgmap v17894: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 946 KiB/s wr, 11 op/s 2023-05-08T13:01:53.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:01:53.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:01:53.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:01:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:53 smithi133 ceph-mon[125939]: pgmap v17895: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 820 KiB/s rd, 1007 KiB/s wr, 8 op/s 2023-05-08T13:01:54.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:01:54.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:01:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:53 smithi096 ceph-mon[124666]: pgmap v17895: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 820 KiB/s rd, 1007 KiB/s wr, 8 op/s 2023-05-08T13:01:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:01:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:01:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:53 smithi186 ceph-mon[126480]: pgmap v17895: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 820 KiB/s rd, 1007 KiB/s wr, 8 op/s 2023-05-08T13:01:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:01:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:01:55.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33453.334387 secs 2023-05-08T13:01:55.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33453.334387 secs 2023-05-08T13:01:55.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33453.334387 secs 2023-05-08T13:01:56.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:55 smithi133 ceph-mon[125939]: pgmap v17896: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 820 KiB/s rd, 1007 KiB/s wr, 8 op/s 2023-05-08T13:01:56.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:55 smithi096 ceph-mon[124666]: pgmap v17896: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 820 KiB/s rd, 1007 KiB/s wr, 8 op/s 2023-05-08T13:01:56.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:55 smithi186 ceph-mon[126480]: pgmap v17896: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 820 KiB/s rd, 1007 KiB/s wr, 8 op/s 2023-05-08T13:01:57.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:56 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:01:57.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:56 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:01:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:56 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:01:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:57 smithi133 ceph-mon[125939]: pgmap v17897: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 13 op/s 2023-05-08T13:01:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:57 smithi096 ceph-mon[124666]: pgmap v17897: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 13 op/s 2023-05-08T13:01:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:57 smithi186 ceph-mon[126480]: pgmap v17897: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 13 op/s 2023-05-08T13:02:00.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:59 smithi133 ceph-mon[125939]: pgmap v17898: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 995 KiB/s wr, 10 op/s 2023-05-08T13:02:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33458.888623 secs 2023-05-08T13:02:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:01:59 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:02:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:59 smithi096 ceph-mon[124666]: pgmap v17898: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 995 KiB/s wr, 10 op/s 2023-05-08T13:02:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33458.888623 secs 2023-05-08T13:02:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:01:59 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:02:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:59 smithi186 ceph-mon[126480]: pgmap v17898: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 995 KiB/s wr, 10 op/s 2023-05-08T13:02:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33458.888623 secs 2023-05-08T13:02:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:01:59 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:02:01.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:00 smithi133 ceph-mon[125939]: Health check cleared: MDS_SLOW_REQUEST (was: 1 MDSs report slow requests) 2023-05-08T13:02:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:00 smithi133 ceph-mon[125939]: Cluster is now healthy 2023-05-08T13:02:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:00 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T13:02:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:00 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:02:01.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:00 smithi096 ceph-mon[124666]: Health check cleared: MDS_SLOW_REQUEST (was: 1 MDSs report slow requests) 2023-05-08T13:02:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:00 smithi096 ceph-mon[124666]: Cluster is now healthy 2023-05-08T13:02:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:00 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T13:02:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:00 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:02:01.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:00 smithi186 ceph-mon[126480]: Health check cleared: MDS_SLOW_REQUEST (was: 1 MDSs report slow requests) 2023-05-08T13:02:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:00 smithi186 ceph-mon[126480]: Cluster is now healthy 2023-05-08T13:02:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:00 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T13:02:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:00 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:02:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:01 smithi133 ceph-mon[125939]: pgmap v17899: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.3 MiB/s wr, 16 op/s 2023-05-08T13:02:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:01 smithi133 ceph-mon[125939]: Health check failed: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:02:02.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:02:02.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:02:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:01 smithi096 ceph-mon[124666]: pgmap v17899: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.3 MiB/s wr, 16 op/s 2023-05-08T13:02:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:01 smithi096 ceph-mon[124666]: Health check failed: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:02:02.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:02:02.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:02:02.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:01 smithi186 ceph-mon[126480]: pgmap v17899: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.3 MiB/s wr, 16 op/s 2023-05-08T13:02:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:01 smithi186 ceph-mon[126480]: Health check failed: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:02:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:02:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:02:04.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:03 smithi133 ceph-mon[125939]: pgmap v17900: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T13:02:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:03 smithi096 ceph-mon[124666]: pgmap v17900: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T13:02:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:03 smithi186 ceph-mon[126480]: pgmap v17900: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T13:02:05.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33463.334584 secs 2023-05-08T13:02:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:04 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:02:05.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33463.334584 secs 2023-05-08T13:02:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:04 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:02:05.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33463.334584 secs 2023-05-08T13:02:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:04 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:02:06.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:05 smithi133 ceph-mon[125939]: pgmap v17901: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 848 KiB/s wr, 11 op/s 2023-05-08T13:02:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:05 smithi133 ceph-mon[125939]: Health check cleared: MDS_SLOW_REQUEST (was: 1 MDSs report slow requests) 2023-05-08T13:02:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:05 smithi133 ceph-mon[125939]: Cluster is now healthy 2023-05-08T13:02:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:02:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:02:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:05 smithi096 ceph-mon[124666]: pgmap v17901: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 848 KiB/s wr, 11 op/s 2023-05-08T13:02:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:05 smithi096 ceph-mon[124666]: Health check cleared: MDS_SLOW_REQUEST (was: 1 MDSs report slow requests) 2023-05-08T13:02:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:05 smithi096 ceph-mon[124666]: Cluster is now healthy 2023-05-08T13:02:06.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:02:06.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:02:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:05 smithi186 ceph-mon[126480]: pgmap v17901: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 848 KiB/s wr, 11 op/s 2023-05-08T13:02:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:05 smithi186 ceph-mon[126480]: Health check cleared: MDS_SLOW_REQUEST (was: 1 MDSs report slow requests) 2023-05-08T13:02:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:05 smithi186 ceph-mon[126480]: Cluster is now healthy 2023-05-08T13:02:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:02:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:02:08.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:07 smithi133 ceph-mon[125939]: pgmap v17902: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.4 MiB/s wr, 28 op/s 2023-05-08T13:02:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:07 smithi096 ceph-mon[124666]: pgmap v17902: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.4 MiB/s wr, 28 op/s 2023-05-08T13:02:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:07 smithi186 ceph-mon[126480]: pgmap v17902: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.4 MiB/s wr, 28 op/s 2023-05-08T13:02:09.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:08 smithi133 ceph-mon[125939]: Health check failed: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:02:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:08 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T13:02:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:08 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:02:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:08 smithi096 ceph-mon[124666]: Health check failed: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:02:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:08 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T13:02:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:08 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:02:09.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:08 smithi186 ceph-mon[126480]: Health check failed: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:02:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:08 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T13:02:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:08 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:02:10.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:09 smithi133 ceph-mon[125939]: pgmap v17903: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 865 KiB/s wr, 23 op/s 2023-05-08T13:02:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33468.334661 secs 2023-05-08T13:02:10.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:09 smithi096 ceph-mon[124666]: pgmap v17903: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 865 KiB/s wr, 23 op/s 2023-05-08T13:02:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33468.334661 secs 2023-05-08T13:02:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:09 smithi186 ceph-mon[126480]: pgmap v17903: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 865 KiB/s wr, 23 op/s 2023-05-08T13:02:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33468.334661 secs 2023-05-08T13:02:12.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:11 smithi133 ceph-mon[125939]: pgmap v17904: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 865 KiB/s wr, 27 op/s 2023-05-08T13:02:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:11 smithi096 ceph-mon[124666]: pgmap v17904: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 865 KiB/s wr, 27 op/s 2023-05-08T13:02:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:11 smithi186 ceph-mon[126480]: pgmap v17904: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 865 KiB/s wr, 27 op/s 2023-05-08T13:02:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:12 smithi096 ceph-mon[124666]: pgmap v17905: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 822 KiB/s rd, 563 KiB/s wr, 21 op/s 2023-05-08T13:02:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:12 smithi186 ceph-mon[126480]: pgmap v17905: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 822 KiB/s rd, 563 KiB/s wr, 21 op/s 2023-05-08T13:02:13.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:13 smithi133 ceph-mon[125939]: pgmap v17905: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 822 KiB/s rd, 563 KiB/s wr, 21 op/s 2023-05-08T13:02:15.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33473.334797 secs 2023-05-08T13:02:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:15 smithi186 ceph-mon[126480]: pgmap v17906: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 822 KiB/s rd, 563 KiB/s wr, 21 op/s 2023-05-08T13:02:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33473.334797 secs 2023-05-08T13:02:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:15 smithi133 ceph-mon[125939]: pgmap v17906: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 822 KiB/s rd, 563 KiB/s wr, 21 op/s 2023-05-08T13:02:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33473.334797 secs 2023-05-08T13:02:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:15 smithi096 ceph-mon[124666]: pgmap v17906: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 822 KiB/s rd, 563 KiB/s wr, 21 op/s 2023-05-08T13:02:18.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:17 smithi133 ceph-mon[125939]: pgmap v17907: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 991 KiB/s wr, 25 op/s 2023-05-08T13:02:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:17 smithi096 ceph-mon[124666]: pgmap v17907: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 991 KiB/s wr, 25 op/s 2023-05-08T13:02:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:17 smithi186 ceph-mon[126480]: pgmap v17907: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 991 KiB/s wr, 25 op/s 2023-05-08T13:02:20.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:19 smithi133 ceph-mon[125939]: pgmap v17908: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 428 KiB/s wr, 7 op/s 2023-05-08T13:02:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33478.334867 secs 2023-05-08T13:02:20.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:19 smithi096 ceph-mon[124666]: pgmap v17908: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 428 KiB/s wr, 7 op/s 2023-05-08T13:02:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33478.334867 secs 2023-05-08T13:02:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:19 smithi186 ceph-mon[126480]: pgmap v17908: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 428 KiB/s wr, 7 op/s 2023-05-08T13:02:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33478.334867 secs 2023-05-08T13:02:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33480.181017 secs 2023-05-08T13:02:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:20 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:02:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:20 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:02:21.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:20 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:02:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33480.181017 secs 2023-05-08T13:02:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:20 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:02:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:20 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:02:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:20 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:02:21.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33480.181017 secs 2023-05-08T13:02:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:20 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:02:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:20 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:02:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:20 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:02:22.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:21 smithi133 ceph-mon[125939]: pgmap v17909: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 451 KiB/s wr, 12 op/s 2023-05-08T13:02:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:02:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:21 smithi096 ceph-mon[124666]: pgmap v17909: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 451 KiB/s wr, 12 op/s 2023-05-08T13:02:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:02:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:21 smithi186 ceph-mon[126480]: pgmap v17909: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 451 KiB/s wr, 12 op/s 2023-05-08T13:02:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:02:23.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:22 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:02:23.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:22 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:02:23.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:22 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:02:23.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:22 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:02:23.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:22 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:02:23.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:22 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:02:23.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:22 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:02:23.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:22 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:02:23.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:22 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:02:24.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:23 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:02:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:23 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T13:02:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:23 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T13:02:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:23 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:02:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:23 smithi133 ceph-mon[125939]: pgmap v17910: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 451 KiB/s wr, 8 op/s 2023-05-08T13:02:24.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:23 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:02:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:23 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T13:02:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:23 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T13:02:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:23 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:02:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:23 smithi096 ceph-mon[124666]: pgmap v17910: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 451 KiB/s wr, 8 op/s 2023-05-08T13:02:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:23 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:02:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:23 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T13:02:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:23 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T13:02:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:23 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:02:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:23 smithi186 ceph-mon[126480]: pgmap v17910: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 451 KiB/s wr, 8 op/s 2023-05-08T13:02:25.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33483.334993 secs 2023-05-08T13:02:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33483.889239 secs 2023-05-08T13:02:25.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33483.334993 secs 2023-05-08T13:02:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33483.889239 secs 2023-05-08T13:02:25.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33483.334993 secs 2023-05-08T13:02:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33483.889239 secs 2023-05-08T13:02:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:25 smithi133 ceph-mon[125939]: pgmap v17911: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 451 KiB/s wr, 8 op/s 2023-05-08T13:02:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:25 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:02:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:25 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:02:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33485.181099 secs 2023-05-08T13:02:26.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:25 smithi096 ceph-mon[124666]: pgmap v17911: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 451 KiB/s wr, 8 op/s 2023-05-08T13:02:26.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:25 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:02:26.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:25 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:02:26.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33485.181099 secs 2023-05-08T13:02:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:25 smithi186 ceph-mon[126480]: pgmap v17911: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 451 KiB/s wr, 8 op/s 2023-05-08T13:02:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:25 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:02:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:25 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:02:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33485.181099 secs 2023-05-08T13:02:27.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:26 smithi133 ceph-mon[125939]: osdmap e1196: 12 total, 12 up, 12 in 2023-05-08T13:02:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:26 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:02:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:26 smithi096 ceph-mon[124666]: osdmap e1196: 12 total, 12 up, 12 in 2023-05-08T13:02:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:26 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:02:27.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:26 smithi186 ceph-mon[126480]: osdmap e1196: 12 total, 12 up, 12 in 2023-05-08T13:02:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:26 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:02:28.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:27 smithi133 ceph-mon[125939]: pgmap v17913: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 898 KiB/s wr, 14 op/s 2023-05-08T13:02:28.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:27 smithi096 ceph-mon[124666]: pgmap v17913: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 898 KiB/s wr, 14 op/s 2023-05-08T13:02:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:27 smithi186 ceph-mon[126480]: pgmap v17913: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 898 KiB/s wr, 14 op/s 2023-05-08T13:02:29.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:28 smithi133 ceph-mon[125939]: pgmap v17914: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 898 KiB/s wr, 14 op/s 2023-05-08T13:02:29.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:28 smithi096 ceph-mon[124666]: pgmap v17914: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 898 KiB/s wr, 14 op/s 2023-05-08T13:02:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:28 smithi186 ceph-mon[126480]: pgmap v17914: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 898 KiB/s wr, 14 op/s 2023-05-08T13:02:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33488.335073 secs 2023-05-08T13:02:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33488.889357 secs 2023-05-08T13:02:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33488.335073 secs 2023-05-08T13:02:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33488.889357 secs 2023-05-08T13:02:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33488.335073 secs 2023-05-08T13:02:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33488.889357 secs 2023-05-08T13:02:31.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:30 smithi133 ceph-mon[125939]: pgmap v17915: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 14 op/s 2023-05-08T13:02:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33490.181177 secs 2023-05-08T13:02:31.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:30 smithi096 ceph-mon[124666]: pgmap v17915: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 14 op/s 2023-05-08T13:02:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33490.181177 secs 2023-05-08T13:02:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:30 smithi186 ceph-mon[126480]: pgmap v17915: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 14 op/s 2023-05-08T13:02:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33490.181177 secs 2023-05-08T13:02:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:33 smithi133 ceph-mon[125939]: pgmap v17916: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 14 op/s 2023-05-08T13:02:34.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:33 smithi096 ceph-mon[124666]: pgmap v17916: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 14 op/s 2023-05-08T13:02:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:33 smithi186 ceph-mon[126480]: pgmap v17916: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 14 op/s 2023-05-08T13:02:35.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33493.335189 secs 2023-05-08T13:02:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33493.889509 secs 2023-05-08T13:02:35.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33493.335189 secs 2023-05-08T13:02:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33493.889509 secs 2023-05-08T13:02:35.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33493.335189 secs 2023-05-08T13:02:35.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33493.889509 secs 2023-05-08T13:02:36.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:35 smithi133 ceph-mon[125939]: pgmap v17917: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 14 op/s 2023-05-08T13:02:36.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:35 smithi096 ceph-mon[124666]: pgmap v17917: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 14 op/s 2023-05-08T13:02:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:35 smithi186 ceph-mon[126480]: pgmap v17917: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 14 op/s 2023-05-08T13:02:37.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33495.181299 secs 2023-05-08T13:02:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:36 smithi133 ceph-mon[125939]: osdmap e1197: 12 total, 12 up, 12 in 2023-05-08T13:02:37.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33495.181299 secs 2023-05-08T13:02:37.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:36 smithi096 ceph-mon[124666]: osdmap e1197: 12 total, 12 up, 12 in 2023-05-08T13:02:37.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33495.181299 secs 2023-05-08T13:02:37.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:36 smithi186 ceph-mon[126480]: osdmap e1197: 12 total, 12 up, 12 in 2023-05-08T13:02:38.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:37 smithi133 ceph-mon[125939]: pgmap v17918: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 820 KiB/s rd, 814 KiB/s wr, 10 op/s 2023-05-08T13:02:38.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:37 smithi096 ceph-mon[124666]: pgmap v17918: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 820 KiB/s rd, 814 KiB/s wr, 10 op/s 2023-05-08T13:02:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:37 smithi186 ceph-mon[126480]: pgmap v17918: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 820 KiB/s rd, 814 KiB/s wr, 10 op/s 2023-05-08T13:02:40.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:39 smithi133 ceph-mon[125939]: pgmap v17920: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 828 KiB/s rd, 823 KiB/s wr, 10 op/s 2023-05-08T13:02:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33498.335310 secs 2023-05-08T13:02:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33498.889624 secs 2023-05-08T13:02:40.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:39 smithi096 ceph-mon[124666]: pgmap v17920: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 828 KiB/s rd, 823 KiB/s wr, 10 op/s 2023-05-08T13:02:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33498.335310 secs 2023-05-08T13:02:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33498.889624 secs 2023-05-08T13:02:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:39 smithi186 ceph-mon[126480]: pgmap v17920: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 828 KiB/s rd, 823 KiB/s wr, 10 op/s 2023-05-08T13:02:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33498.335310 secs 2023-05-08T13:02:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33498.889624 secs 2023-05-08T13:02:42.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:41 smithi133 ceph-mon[125939]: pgmap v17921: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 267 KiB/s wr, 8 op/s 2023-05-08T13:02:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33500.181432 secs 2023-05-08T13:02:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:41 smithi096 ceph-mon[124666]: pgmap v17921: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 267 KiB/s wr, 8 op/s 2023-05-08T13:02:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33500.181432 secs 2023-05-08T13:02:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:41 smithi186 ceph-mon[126480]: pgmap v17921: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 267 KiB/s wr, 8 op/s 2023-05-08T13:02:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33500.181432 secs 2023-05-08T13:02:44.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:43 smithi133 ceph-mon[125939]: pgmap v17922: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 267 KiB/s wr, 8 op/s 2023-05-08T13:02:44.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:43 smithi096 ceph-mon[124666]: pgmap v17922: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 267 KiB/s wr, 8 op/s 2023-05-08T13:02:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:43 smithi186 ceph-mon[126480]: pgmap v17922: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 267 KiB/s wr, 8 op/s 2023-05-08T13:02:45.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33503.335433 secs 2023-05-08T13:02:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33503.889721 secs 2023-05-08T13:02:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33503.335433 secs 2023-05-08T13:02:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33503.889721 secs 2023-05-08T13:02:45.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33503.335433 secs 2023-05-08T13:02:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33503.889721 secs 2023-05-08T13:02:46.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:45 smithi133 ceph-mon[125939]: pgmap v17923: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 267 KiB/s wr, 8 op/s 2023-05-08T13:02:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:45 smithi096 ceph-mon[124666]: pgmap v17923: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 267 KiB/s wr, 8 op/s 2023-05-08T13:02:46.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:45 smithi186 ceph-mon[126480]: pgmap v17923: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 267 KiB/s wr, 8 op/s 2023-05-08T13:02:48.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:47 smithi133 ceph-mon[125939]: pgmap v17924: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 7 op/s 2023-05-08T13:02:48.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:47 smithi096 ceph-mon[124666]: pgmap v17924: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 7 op/s 2023-05-08T13:02:48.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:47 smithi186 ceph-mon[126480]: pgmap v17924: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 7 op/s 2023-05-08T13:02:49.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:02:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:02:49.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:02:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:49 smithi133 ceph-mon[125939]: pgmap v17925: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2023-05-08T13:02:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33508.335510 secs 2023-05-08T13:02:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:02:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:02:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:02:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33508.889859 secs 2023-05-08T13:02:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:49 smithi096 ceph-mon[124666]: pgmap v17925: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2023-05-08T13:02:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33508.335510 secs 2023-05-08T13:02:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:02:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:02:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:02:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33508.889859 secs 2023-05-08T13:02:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:49 smithi186 ceph-mon[126480]: pgmap v17925: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2023-05-08T13:02:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33508.335510 secs 2023-05-08T13:02:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:02:50.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:02:50.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:02:50.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33508.889859 secs 2023-05-08T13:02:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:51 smithi133 ceph-mon[125939]: pgmap v17926: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 331 KiB/s wr, 9 op/s 2023-05-08T13:02:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:51 smithi096 ceph-mon[124666]: pgmap v17926: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 331 KiB/s wr, 9 op/s 2023-05-08T13:02:52.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:51 smithi186 ceph-mon[126480]: pgmap v17926: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 331 KiB/s wr, 9 op/s 2023-05-08T13:02:54.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:53 smithi133 ceph-mon[125939]: pgmap v17927: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 331 KiB/s wr, 6 op/s 2023-05-08T13:02:54.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:53 smithi096 ceph-mon[124666]: pgmap v17927: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 331 KiB/s wr, 6 op/s 2023-05-08T13:02:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:53 smithi186 ceph-mon[126480]: pgmap v17927: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 331 KiB/s wr, 6 op/s 2023-05-08T13:02:55.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33513.335635 secs 2023-05-08T13:02:55.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33513.335635 secs 2023-05-08T13:02:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33513.335635 secs 2023-05-08T13:02:56.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:55 smithi133 ceph-mon[125939]: pgmap v17928: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 331 KiB/s wr, 6 op/s 2023-05-08T13:02:56.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:55 smithi096 ceph-mon[124666]: pgmap v17928: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 331 KiB/s wr, 6 op/s 2023-05-08T13:02:56.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:55 smithi186 ceph-mon[126480]: pgmap v17928: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 331 KiB/s wr, 6 op/s 2023-05-08T13:02:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:02:57.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:02:57.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:02:58.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:57 smithi133 ceph-mon[125939]: pgmap v17929: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 864 KiB/s wr, 12 op/s 2023-05-08T13:02:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:57 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:02:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:02:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:02:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:57 smithi096 ceph-mon[124666]: pgmap v17929: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 864 KiB/s wr, 12 op/s 2023-05-08T13:02:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:57 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:02:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:02:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:02:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:57 smithi186 ceph-mon[126480]: pgmap v17929: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 864 KiB/s wr, 12 op/s 2023-05-08T13:02:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:57 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:02:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:02:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:03:00.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:59 smithi133 ceph-mon[125939]: pgmap v17930: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 864 KiB/s wr, 9 op/s 2023-05-08T13:03:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:02:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33518.335762 secs 2023-05-08T13:03:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:59 smithi096 ceph-mon[124666]: pgmap v17930: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 864 KiB/s wr, 9 op/s 2023-05-08T13:03:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:02:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33518.335762 secs 2023-05-08T13:03:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:59 smithi186 ceph-mon[126480]: pgmap v17930: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 864 KiB/s wr, 9 op/s 2023-05-08T13:03:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:02:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33518.335762 secs 2023-05-08T13:03:02.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:01 smithi133 ceph-mon[125939]: pgmap v17931: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T13:03:02.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:01 smithi096 ceph-mon[124666]: pgmap v17931: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T13:03:02.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:01 smithi186 ceph-mon[126480]: pgmap v17931: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T13:03:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:03 smithi133 ceph-mon[125939]: pgmap v17932: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 826 KiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T13:03:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:03 smithi096 ceph-mon[124666]: pgmap v17932: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 826 KiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T13:03:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:03 smithi186 ceph-mon[126480]: pgmap v17932: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 826 KiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T13:03:05.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33523.335879 secs 2023-05-08T13:03:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33523.890232 secs 2023-05-08T13:03:05.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33523.335879 secs 2023-05-08T13:03:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33523.890232 secs 2023-05-08T13:03:05.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33523.335879 secs 2023-05-08T13:03:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33523.890232 secs 2023-05-08T13:03:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:05 smithi133 ceph-mon[125939]: pgmap v17933: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 826 KiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T13:03:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:05 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:03:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:03:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:03:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:05 smithi096 ceph-mon[124666]: pgmap v17933: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 826 KiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T13:03:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:05 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:03:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:03:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:03:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:05 smithi186 ceph-mon[126480]: pgmap v17933: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 826 KiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T13:03:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:05 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:03:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:03:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:03:08.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:07 smithi133 ceph-mon[125939]: pgmap v17934: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 28 op/s 2023-05-08T13:03:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:07 smithi096 ceph-mon[124666]: pgmap v17934: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 28 op/s 2023-05-08T13:03:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:07 smithi186 ceph-mon[126480]: pgmap v17934: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 28 op/s 2023-05-08T13:03:10.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:09 smithi133 ceph-mon[125939]: pgmap v17935: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 904 KiB/s rd, 906 KiB/s wr, 22 op/s 2023-05-08T13:03:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33528.335968 secs 2023-05-08T13:03:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33528.890345 secs 2023-05-08T13:03:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:09 smithi096 ceph-mon[124666]: pgmap v17935: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 904 KiB/s rd, 906 KiB/s wr, 22 op/s 2023-05-08T13:03:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33528.335968 secs 2023-05-08T13:03:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33528.890345 secs 2023-05-08T13:03:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:09 smithi186 ceph-mon[126480]: pgmap v17935: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 904 KiB/s rd, 906 KiB/s wr, 22 op/s 2023-05-08T13:03:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33528.335968 secs 2023-05-08T13:03:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33528.890345 secs 2023-05-08T13:03:12.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:11 smithi133 ceph-mon[125939]: pgmap v17936: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 910 KiB/s rd, 910 KiB/s wr, 27 op/s 2023-05-08T13:03:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:11 smithi096 ceph-mon[124666]: pgmap v17936: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 910 KiB/s rd, 910 KiB/s wr, 27 op/s 2023-05-08T13:03:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:11 smithi186 ceph-mon[126480]: pgmap v17936: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 910 KiB/s rd, 910 KiB/s wr, 27 op/s 2023-05-08T13:03:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:13 smithi133 ceph-mon[125939]: pgmap v17937: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 713 KiB/s rd, 406 KiB/s wr, 21 op/s 2023-05-08T13:03:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:13 smithi096 ceph-mon[124666]: pgmap v17937: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 713 KiB/s rd, 406 KiB/s wr, 21 op/s 2023-05-08T13:03:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:13 smithi186 ceph-mon[126480]: pgmap v17937: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 713 KiB/s rd, 406 KiB/s wr, 21 op/s 2023-05-08T13:03:15.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33533.336120 secs 2023-05-08T13:03:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:14 smithi133 ceph-mon[125939]: pgmap v17938: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 713 KiB/s rd, 406 KiB/s wr, 21 op/s 2023-05-08T13:03:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33533.890442 secs 2023-05-08T13:03:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33533.336120 secs 2023-05-08T13:03:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:14 smithi096 ceph-mon[124666]: pgmap v17938: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 713 KiB/s rd, 406 KiB/s wr, 21 op/s 2023-05-08T13:03:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33533.890442 secs 2023-05-08T13:03:15.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33533.336120 secs 2023-05-08T13:03:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:14 smithi186 ceph-mon[126480]: pgmap v17938: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 713 KiB/s rd, 406 KiB/s wr, 21 op/s 2023-05-08T13:03:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33533.890442 secs 2023-05-08T13:03:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:17 smithi133 ceph-mon[125939]: pgmap v17939: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1013 KiB/s rd, 839 KiB/s wr, 25 op/s 2023-05-08T13:03:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:17 smithi096 ceph-mon[124666]: pgmap v17939: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1013 KiB/s rd, 839 KiB/s wr, 25 op/s 2023-05-08T13:03:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:17 smithi186 ceph-mon[126480]: pgmap v17939: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1013 KiB/s rd, 839 KiB/s wr, 25 op/s 2023-05-08T13:03:20.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:19 smithi133 ceph-mon[125939]: pgmap v17940: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 438 KiB/s wr, 7 op/s 2023-05-08T13:03:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33538.336240 secs 2023-05-08T13:03:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33538.890571 secs 2023-05-08T13:03:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:19 smithi096 ceph-mon[124666]: pgmap v17940: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 438 KiB/s wr, 7 op/s 2023-05-08T13:03:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33538.336240 secs 2023-05-08T13:03:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33538.890571 secs 2023-05-08T13:03:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:19 smithi186 ceph-mon[126480]: pgmap v17940: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 438 KiB/s wr, 7 op/s 2023-05-08T13:03:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33538.336240 secs 2023-05-08T13:03:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33538.890571 secs 2023-05-08T13:03:22.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:21 smithi133 ceph-mon[125939]: pgmap v17941: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 438 KiB/s wr, 11 op/s 2023-05-08T13:03:22.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:21 smithi096 ceph-mon[124666]: pgmap v17941: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 438 KiB/s wr, 11 op/s 2023-05-08T13:03:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:21 smithi186 ceph-mon[126480]: pgmap v17941: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 438 KiB/s wr, 11 op/s 2023-05-08T13:03:23.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:22 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:03:23.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:22 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:03:23.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:22 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:03:23.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:22 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:03:23.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:22 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:03:23.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:22 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:03:23.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:22 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:03:23.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:22 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:03:23.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:22 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:03:23.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:22 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:03:23.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:22 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:03:23.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:22 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:03:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:23 smithi133 ceph-mon[125939]: pgmap v17942: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 433 KiB/s wr, 7 op/s 2023-05-08T13:03:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:23 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:03:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:23 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T13:03:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:23 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T13:03:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:23 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:03:24.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:23 smithi096 ceph-mon[124666]: pgmap v17942: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 433 KiB/s wr, 7 op/s 2023-05-08T13:03:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:23 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:03:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:23 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T13:03:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:23 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T13:03:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:23 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:03:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:23 smithi186 ceph-mon[126480]: pgmap v17942: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 433 KiB/s wr, 7 op/s 2023-05-08T13:03:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:23 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:03:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:23 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T13:03:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:23 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T13:03:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:23 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:03:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33543.336367 secs 2023-05-08T13:03:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:24 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:03:25.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33543.336367 secs 2023-05-08T13:03:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:24 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:03:25.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33543.336367 secs 2023-05-08T13:03:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:24 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:03:26.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:25 smithi133 ceph-mon[125939]: pgmap v17943: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 433 KiB/s wr, 7 op/s 2023-05-08T13:03:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:25 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:03:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:25 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:03:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:25 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:03:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:25 smithi096 ceph-mon[124666]: pgmap v17943: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 433 KiB/s wr, 7 op/s 2023-05-08T13:03:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:25 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:03:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:25 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:03:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:25 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:03:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:25 smithi186 ceph-mon[126480]: pgmap v17943: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 433 KiB/s wr, 7 op/s 2023-05-08T13:03:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:25 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:03:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:25 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:03:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:25 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:03:27.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:26 smithi133 ceph-mon[125939]: osdmap e1198: 12 total, 12 up, 12 in 2023-05-08T13:03:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:26 smithi096 ceph-mon[124666]: osdmap e1198: 12 total, 12 up, 12 in 2023-05-08T13:03:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:26 smithi186 ceph-mon[126480]: osdmap e1198: 12 total, 12 up, 12 in 2023-05-08T13:03:28.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:27 smithi133 ceph-mon[125939]: pgmap v17945: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 938 KiB/s rd, 781 KiB/s wr, 13 op/s 2023-05-08T13:03:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:27 smithi096 ceph-mon[124666]: pgmap v17945: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 938 KiB/s rd, 781 KiB/s wr, 13 op/s 2023-05-08T13:03:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:27 smithi186 ceph-mon[126480]: pgmap v17945: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 938 KiB/s rd, 781 KiB/s wr, 13 op/s 2023-05-08T13:03:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:29 smithi133 ceph-mon[125939]: pgmap v17946: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 938 KiB/s rd, 781 KiB/s wr, 13 op/s 2023-05-08T13:03:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33548.336449 secs 2023-05-08T13:03:30.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:29 smithi096 ceph-mon[124666]: pgmap v17946: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 938 KiB/s rd, 781 KiB/s wr, 13 op/s 2023-05-08T13:03:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33548.336449 secs 2023-05-08T13:03:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:29 smithi186 ceph-mon[126480]: pgmap v17946: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 938 KiB/s rd, 781 KiB/s wr, 13 op/s 2023-05-08T13:03:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33548.336449 secs 2023-05-08T13:03:32.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:31 smithi133 ceph-mon[125939]: pgmap v17947: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T13:03:32.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:31 smithi096 ceph-mon[124666]: pgmap v17947: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T13:03:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:31 smithi186 ceph-mon[126480]: pgmap v17947: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T13:03:34.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:33 smithi133 ceph-mon[125939]: pgmap v17948: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T13:03:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:33 smithi096 ceph-mon[124666]: pgmap v17948: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T13:03:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:33 smithi186 ceph-mon[126480]: pgmap v17948: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T13:03:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33553.336561 secs 2023-05-08T13:03:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33553.336561 secs 2023-05-08T13:03:35.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33553.336561 secs 2023-05-08T13:03:36.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:35 smithi133 ceph-mon[125939]: pgmap v17949: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T13:03:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:35 smithi096 ceph-mon[124666]: pgmap v17949: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T13:03:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:35 smithi186 ceph-mon[126480]: pgmap v17949: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T13:03:38.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:37 smithi133 ceph-mon[125939]: pgmap v17950: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 698 KiB/s rd, 676 KiB/s wr, 10 op/s 2023-05-08T13:03:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:37 smithi133 ceph-mon[125939]: osdmap e1199: 12 total, 12 up, 12 in 2023-05-08T13:03:38.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:37 smithi096 ceph-mon[124666]: pgmap v17950: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 698 KiB/s rd, 676 KiB/s wr, 10 op/s 2023-05-08T13:03:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:37 smithi096 ceph-mon[124666]: osdmap e1199: 12 total, 12 up, 12 in 2023-05-08T13:03:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:37 smithi186 ceph-mon[126480]: pgmap v17950: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 698 KiB/s rd, 676 KiB/s wr, 10 op/s 2023-05-08T13:03:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:37 smithi186 ceph-mon[126480]: osdmap e1199: 12 total, 12 up, 12 in 2023-05-08T13:03:40.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:39 smithi133 ceph-mon[125939]: pgmap v17952: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 709 KiB/s rd, 687 KiB/s wr, 10 op/s 2023-05-08T13:03:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33558.336646 secs 2023-05-08T13:03:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33558.891016 secs 2023-05-08T13:03:40.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:39 smithi096 ceph-mon[124666]: pgmap v17952: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 709 KiB/s rd, 687 KiB/s wr, 10 op/s 2023-05-08T13:03:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33558.336646 secs 2023-05-08T13:03:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33558.891016 secs 2023-05-08T13:03:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:39 smithi186 ceph-mon[126480]: pgmap v17952: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 709 KiB/s rd, 687 KiB/s wr, 10 op/s 2023-05-08T13:03:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33558.336646 secs 2023-05-08T13:03:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33558.891016 secs 2023-05-08T13:03:41.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33560.183017 secs 2023-05-08T13:03:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:40 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:03:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:40 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:03:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:40 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:03:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:40 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:03:41.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33560.183017 secs 2023-05-08T13:03:41.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:40 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:03:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:40 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:03:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:40 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:03:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:40 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:03:41.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33560.183017 secs 2023-05-08T13:03:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:40 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:03:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:40 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:03:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:40 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:03:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:40 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:03:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:41 smithi133 ceph-mon[125939]: pgmap v17953: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T13:03:42.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:41 smithi096 ceph-mon[124666]: pgmap v17953: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T13:03:42.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:41 smithi186 ceph-mon[126480]: pgmap v17953: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T13:03:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:43 smithi133 ceph-mon[125939]: pgmap v17954: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T13:03:44.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:43 smithi096 ceph-mon[124666]: pgmap v17954: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T13:03:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:43 smithi186 ceph-mon[126480]: pgmap v17954: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T13:03:45.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33563.336765 secs 2023-05-08T13:03:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33563.891098 secs 2023-05-08T13:03:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33563.336765 secs 2023-05-08T13:03:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33563.891098 secs 2023-05-08T13:03:45.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33563.336765 secs 2023-05-08T13:03:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33563.891098 secs 2023-05-08T13:03:46.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:45 smithi133 ceph-mon[125939]: pgmap v17955: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T13:03:46.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:45 smithi096 ceph-mon[124666]: pgmap v17955: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T13:03:46.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:45 smithi186 ceph-mon[126480]: pgmap v17955: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T13:03:48.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:47 smithi133 ceph-mon[125939]: pgmap v17956: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 12 op/s 2023-05-08T13:03:48.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:47 smithi096 ceph-mon[124666]: pgmap v17956: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 12 op/s 2023-05-08T13:03:48.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:47 smithi186 ceph-mon[126480]: pgmap v17956: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 12 op/s 2023-05-08T13:03:49.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:03:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:03:49.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:03:50.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:49 smithi133 ceph-mon[125939]: pgmap v17957: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T13:03:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33568.336921 secs 2023-05-08T13:03:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:03:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:03:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:03:50.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:49 smithi096 ceph-mon[124666]: pgmap v17957: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T13:03:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33568.336921 secs 2023-05-08T13:03:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:03:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:03:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:03:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:49 smithi186 ceph-mon[126480]: pgmap v17957: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T13:03:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33568.336921 secs 2023-05-08T13:03:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:03:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:03:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:03:52.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:51 smithi133 ceph-mon[125939]: pgmap v17958: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 17 op/s 2023-05-08T13:03:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:51 smithi096 ceph-mon[124666]: pgmap v17958: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 17 op/s 2023-05-08T13:03:52.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:51 smithi186 ceph-mon[126480]: pgmap v17958: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 17 op/s 2023-05-08T13:03:53.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:03:53.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:03:53.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:03:54.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:53 smithi133 ceph-mon[125939]: pgmap v17959: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 12 op/s 2023-05-08T13:03:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:03:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:03:54.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:53 smithi096 ceph-mon[124666]: pgmap v17959: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 12 op/s 2023-05-08T13:03:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:03:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:03:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:53 smithi186 ceph-mon[126480]: pgmap v17959: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 12 op/s 2023-05-08T13:03:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:03:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:03:55.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33573.337057 secs 2023-05-08T13:03:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33573.891341 secs 2023-05-08T13:03:55.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33573.337057 secs 2023-05-08T13:03:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33573.891341 secs 2023-05-08T13:03:55.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33573.337057 secs 2023-05-08T13:03:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33573.891341 secs 2023-05-08T13:03:56.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:55 smithi133 ceph-mon[125939]: pgmap v17960: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 12 op/s 2023-05-08T13:03:56.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:55 smithi096 ceph-mon[124666]: pgmap v17960: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 12 op/s 2023-05-08T13:03:56.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:55 smithi186 ceph-mon[126480]: pgmap v17960: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 12 op/s 2023-05-08T13:03:57.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:56 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:03:57.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:56 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:03:57.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:56 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:03:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:57 smithi133 ceph-mon[125939]: pgmap v17961: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 19 op/s 2023-05-08T13:03:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:03:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:03:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:57 smithi096 ceph-mon[124666]: pgmap v17961: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 19 op/s 2023-05-08T13:03:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:03:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:03:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:57 smithi186 ceph-mon[126480]: pgmap v17961: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 19 op/s 2023-05-08T13:03:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:03:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:04:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:59 smithi133 ceph-mon[125939]: pgmap v17962: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.7 MiB/s wr, 14 op/s 2023-05-08T13:04:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:03:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33578.337180 secs 2023-05-08T13:04:00.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:59 smithi096 ceph-mon[124666]: pgmap v17962: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.7 MiB/s wr, 14 op/s 2023-05-08T13:04:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:03:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33578.337180 secs 2023-05-08T13:04:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:59 smithi186 ceph-mon[126480]: pgmap v17962: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.7 MiB/s wr, 14 op/s 2023-05-08T13:04:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:03:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33578.337180 secs 2023-05-08T13:04:01.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33580.183488 secs 2023-05-08T13:04:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:00 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:04:01.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33580.183488 secs 2023-05-08T13:04:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:00 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:04:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33580.183488 secs 2023-05-08T13:04:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:00 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:04:02.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:01 smithi133 ceph-mon[125939]: pgmap v17963: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.0 MiB/s wr, 19 op/s 2023-05-08T13:04:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:04:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:04:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:04:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:01 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:04:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:01 smithi096 ceph-mon[124666]: pgmap v17963: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.0 MiB/s wr, 19 op/s 2023-05-08T13:04:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:04:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:04:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:04:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:01 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:04:02.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:01 smithi186 ceph-mon[126480]: pgmap v17963: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.0 MiB/s wr, 19 op/s 2023-05-08T13:04:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:04:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:04:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:04:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:01 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:04:04.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:03 smithi133 ceph-mon[125939]: pgmap v17964: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T13:04:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:03 smithi096 ceph-mon[124666]: pgmap v17964: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T13:04:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:03 smithi186 ceph-mon[126480]: pgmap v17964: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T13:04:05.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33583.337292 secs 2023-05-08T13:04:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33583.891579 secs 2023-05-08T13:04:05.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33583.337292 secs 2023-05-08T13:04:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33583.891579 secs 2023-05-08T13:04:05.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33583.337292 secs 2023-05-08T13:04:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33583.891579 secs 2023-05-08T13:04:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:05 smithi133 ceph-mon[125939]: pgmap v17965: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T13:04:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:04:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:04:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33585.183634 secs 2023-05-08T13:04:06.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:05 smithi096 ceph-mon[124666]: pgmap v17965: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T13:04:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:04:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:04:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33585.183634 secs 2023-05-08T13:04:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:05 smithi186 ceph-mon[126480]: pgmap v17965: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T13:04:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:04:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:04:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33585.183634 secs 2023-05-08T13:04:07.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:06 smithi133 ceph-mon[125939]: osdmap e1200: 12 total, 12 up, 12 in 2023-05-08T13:04:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:06 smithi133 ceph-mon[125939]: pgmap v17967: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 30 op/s 2023-05-08T13:04:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:06 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:04:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:06 smithi096 ceph-mon[124666]: osdmap e1200: 12 total, 12 up, 12 in 2023-05-08T13:04:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:06 smithi096 ceph-mon[124666]: pgmap v17967: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 30 op/s 2023-05-08T13:04:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:06 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:04:07.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:06 smithi186 ceph-mon[126480]: osdmap e1200: 12 total, 12 up, 12 in 2023-05-08T13:04:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:06 smithi186 ceph-mon[126480]: pgmap v17967: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 30 op/s 2023-05-08T13:04:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:06 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:04:09.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:09 smithi133 ceph-mon[125939]: pgmap v17968: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 30 op/s 2023-05-08T13:04:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:09 smithi096 ceph-mon[124666]: pgmap v17968: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 30 op/s 2023-05-08T13:04:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:09 smithi186 ceph-mon[126480]: pgmap v17968: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 30 op/s 2023-05-08T13:04:10.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33588.337387 secs 2023-05-08T13:04:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33588.891697 secs 2023-05-08T13:04:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33588.337387 secs 2023-05-08T13:04:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33588.891697 secs 2023-05-08T13:04:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33588.337387 secs 2023-05-08T13:04:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33588.891697 secs 2023-05-08T13:04:11.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:11 smithi133 ceph-mon[125939]: pgmap v17969: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 28 op/s 2023-05-08T13:04:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33590.183820 secs 2023-05-08T13:04:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:11 smithi096 ceph-mon[124666]: pgmap v17969: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 28 op/s 2023-05-08T13:04:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33590.183820 secs 2023-05-08T13:04:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:11 smithi186 ceph-mon[126480]: pgmap v17969: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 28 op/s 2023-05-08T13:04:11.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33590.183820 secs 2023-05-08T13:04:14.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:13 smithi133 ceph-mon[125939]: pgmap v17970: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 28 op/s 2023-05-08T13:04:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:13 smithi096 ceph-mon[124666]: pgmap v17970: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 28 op/s 2023-05-08T13:04:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:13 smithi186 ceph-mon[126480]: pgmap v17970: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 28 op/s 2023-05-08T13:04:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33593.337466 secs 2023-05-08T13:04:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33593.891762 secs 2023-05-08T13:04:15.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33593.337466 secs 2023-05-08T13:04:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33593.891762 secs 2023-05-08T13:04:15.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33593.337466 secs 2023-05-08T13:04:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33593.891762 secs 2023-05-08T13:04:16.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:15 smithi133 ceph-mon[125939]: pgmap v17971: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 28 op/s 2023-05-08T13:04:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:15 smithi096 ceph-mon[124666]: pgmap v17971: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 28 op/s 2023-05-08T13:04:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:15 smithi186 ceph-mon[126480]: pgmap v17971: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 28 op/s 2023-05-08T13:04:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33595.183894 secs 2023-05-08T13:04:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:16 smithi133 ceph-mon[125939]: osdmap e1201: 12 total, 12 up, 12 in 2023-05-08T13:04:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33595.183894 secs 2023-05-08T13:04:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:16 smithi096 ceph-mon[124666]: osdmap e1201: 12 total, 12 up, 12 in 2023-05-08T13:04:17.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33595.183894 secs 2023-05-08T13:04:17.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:16 smithi186 ceph-mon[126480]: osdmap e1201: 12 total, 12 up, 12 in 2023-05-08T13:04:18.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:17 smithi133 ceph-mon[125939]: pgmap v17972: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 560 KiB/s wr, 9 op/s 2023-05-08T13:04:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:17 smithi096 ceph-mon[124666]: pgmap v17972: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 560 KiB/s wr, 9 op/s 2023-05-08T13:04:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:17 smithi186 ceph-mon[126480]: pgmap v17972: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 560 KiB/s wr, 9 op/s 2023-05-08T13:04:20.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:19 smithi133 ceph-mon[125939]: pgmap v17974: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 570 KiB/s rd, 567 KiB/s wr, 9 op/s 2023-05-08T13:04:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33598.337580 secs 2023-05-08T13:04:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33598.891886 secs 2023-05-08T13:04:20.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:19 smithi096 ceph-mon[124666]: pgmap v17974: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 570 KiB/s rd, 567 KiB/s wr, 9 op/s 2023-05-08T13:04:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33598.337580 secs 2023-05-08T13:04:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33598.891886 secs 2023-05-08T13:04:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:19 smithi186 ceph-mon[126480]: pgmap v17974: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 570 KiB/s rd, 567 KiB/s wr, 9 op/s 2023-05-08T13:04:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33598.337580 secs 2023-05-08T13:04:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33598.891886 secs 2023-05-08T13:04:21.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33600.184011 secs 2023-05-08T13:04:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33600.184011 secs 2023-05-08T13:04:21.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33600.184011 secs 2023-05-08T13:04:22.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:21 smithi133 ceph-mon[125939]: pgmap v17975: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 776 KiB/s rd, 800 KiB/s wr, 9 op/s 2023-05-08T13:04:22.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:21 smithi096 ceph-mon[124666]: pgmap v17975: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 776 KiB/s rd, 800 KiB/s wr, 9 op/s 2023-05-08T13:04:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:21 smithi186 ceph-mon[126480]: pgmap v17975: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 776 KiB/s rd, 800 KiB/s wr, 9 op/s 2023-05-08T13:04:23.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:22 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:04:23.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:22 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:04:23.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:22 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:04:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:23 smithi133 ceph-mon[125939]: pgmap v17976: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 776 KiB/s rd, 800 KiB/s wr, 10 op/s 2023-05-08T13:04:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:04:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:04:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:04:24.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:23 smithi096 ceph-mon[124666]: pgmap v17976: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 776 KiB/s rd, 800 KiB/s wr, 10 op/s 2023-05-08T13:04:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:04:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:04:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:04:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:23 smithi186 ceph-mon[126480]: pgmap v17976: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 776 KiB/s rd, 800 KiB/s wr, 10 op/s 2023-05-08T13:04:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:04:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:04:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:04:25.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:24 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:04:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:24 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T13:04:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:24 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T13:04:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:24 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:04:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33603.337657 secs 2023-05-08T13:04:25.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33603.892005 secs 2023-05-08T13:04:25.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:24 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:04:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:24 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T13:04:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:24 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T13:04:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:24 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:04:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33603.337657 secs 2023-05-08T13:04:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33603.892005 secs 2023-05-08T13:04:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:24 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:04:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:24 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T13:04:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:24 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T13:04:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:24 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:04:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33603.337657 secs 2023-05-08T13:04:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33603.892005 secs 2023-05-08T13:04:26.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:25 smithi133 ceph-mon[125939]: pgmap v17977: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 776 KiB/s rd, 800 KiB/s wr, 10 op/s 2023-05-08T13:04:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33605.184129 secs 2023-05-08T13:04:26.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:25 smithi096 ceph-mon[124666]: pgmap v17977: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 776 KiB/s rd, 800 KiB/s wr, 10 op/s 2023-05-08T13:04:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33605.184129 secs 2023-05-08T13:04:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:25 smithi186 ceph-mon[126480]: pgmap v17977: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 776 KiB/s rd, 800 KiB/s wr, 10 op/s 2023-05-08T13:04:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33605.184129 secs 2023-05-08T13:04:28.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:27 smithi133 ceph-mon[125939]: pgmap v17978: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 497 KiB/s rd, 495 KiB/s wr, 11 op/s 2023-05-08T13:04:28.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:27 smithi096 ceph-mon[124666]: pgmap v17978: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 497 KiB/s rd, 495 KiB/s wr, 11 op/s 2023-05-08T13:04:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:27 smithi186 ceph-mon[126480]: pgmap v17978: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 497 KiB/s rd, 495 KiB/s wr, 11 op/s 2023-05-08T13:04:30.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:29 smithi133 ceph-mon[125939]: pgmap v17979: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 444 KiB/s rd, 443 KiB/s wr, 10 op/s 2023-05-08T13:04:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33608.337720 secs 2023-05-08T13:04:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33608.892072 secs 2023-05-08T13:04:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:29 smithi096 ceph-mon[124666]: pgmap v17979: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 444 KiB/s rd, 443 KiB/s wr, 10 op/s 2023-05-08T13:04:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33608.337720 secs 2023-05-08T13:04:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33608.892072 secs 2023-05-08T13:04:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:29 smithi186 ceph-mon[126480]: pgmap v17979: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 444 KiB/s rd, 443 KiB/s wr, 10 op/s 2023-05-08T13:04:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33608.337720 secs 2023-05-08T13:04:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33608.892072 secs 2023-05-08T13:04:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33610.184245 secs 2023-05-08T13:04:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33610.184245 secs 2023-05-08T13:04:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33610.184245 secs 2023-05-08T13:04:32.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:31 smithi133 ceph-mon[125939]: pgmap v17980: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 699 KiB/s rd, 697 KiB/s wr, 12 op/s 2023-05-08T13:04:32.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:31 smithi096 ceph-mon[124666]: pgmap v17980: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 699 KiB/s rd, 697 KiB/s wr, 12 op/s 2023-05-08T13:04:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:31 smithi186 ceph-mon[126480]: pgmap v17980: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 699 KiB/s rd, 697 KiB/s wr, 12 op/s 2023-05-08T13:04:34.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:33 smithi133 ceph-mon[125939]: pgmap v17981: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 371 KiB/s wr, 8 op/s 2023-05-08T13:04:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:33 smithi096 ceph-mon[124666]: pgmap v17981: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 371 KiB/s wr, 8 op/s 2023-05-08T13:04:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:33 smithi186 ceph-mon[126480]: pgmap v17981: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 371 KiB/s wr, 8 op/s 2023-05-08T13:04:35.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33613.337841 secs 2023-05-08T13:04:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33613.892209 secs 2023-05-08T13:04:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33613.337841 secs 2023-05-08T13:04:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33613.892209 secs 2023-05-08T13:04:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33613.337841 secs 2023-05-08T13:04:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33613.892209 secs 2023-05-08T13:04:36.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:35 smithi133 ceph-mon[125939]: pgmap v17982: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 404 KiB/s wr, 10 op/s 2023-05-08T13:04:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33615.184363 secs 2023-05-08T13:04:36.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:35 smithi096 ceph-mon[124666]: pgmap v17982: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 404 KiB/s wr, 10 op/s 2023-05-08T13:04:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33615.184363 secs 2023-05-08T13:04:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:35 smithi186 ceph-mon[126480]: pgmap v17982: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 404 KiB/s wr, 10 op/s 2023-05-08T13:04:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33615.184363 secs 2023-05-08T13:04:38.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:37 smithi133 ceph-mon[125939]: pgmap v17983: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 417 KiB/s wr, 12 op/s 2023-05-08T13:04:38.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:37 smithi096 ceph-mon[124666]: pgmap v17983: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 417 KiB/s wr, 12 op/s 2023-05-08T13:04:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:37 smithi186 ceph-mon[126480]: pgmap v17983: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 417 KiB/s wr, 12 op/s 2023-05-08T13:04:40.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:39 smithi133 ceph-mon[125939]: pgmap v17984: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 330 KiB/s wr, 7 op/s 2023-05-08T13:04:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33618.337955 secs 2023-05-08T13:04:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33618.892334 secs 2023-05-08T13:04:40.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:39 smithi096 ceph-mon[124666]: pgmap v17984: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 330 KiB/s wr, 7 op/s 2023-05-08T13:04:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33618.337955 secs 2023-05-08T13:04:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33618.892334 secs 2023-05-08T13:04:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:39 smithi186 ceph-mon[126480]: pgmap v17984: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 330 KiB/s wr, 7 op/s 2023-05-08T13:04:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33618.337955 secs 2023-05-08T13:04:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33618.892334 secs 2023-05-08T13:04:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:41 smithi133 ceph-mon[125939]: pgmap v17985: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 330 KiB/s wr, 10 op/s 2023-05-08T13:04:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33620.184488 secs 2023-05-08T13:04:42.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:41 smithi096 ceph-mon[124666]: pgmap v17985: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 330 KiB/s wr, 10 op/s 2023-05-08T13:04:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33620.184488 secs 2023-05-08T13:04:42.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:41 smithi186 ceph-mon[126480]: pgmap v17985: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 330 KiB/s wr, 10 op/s 2023-05-08T13:04:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33620.184488 secs 2023-05-08T13:04:44.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:43 smithi133 ceph-mon[125939]: pgmap v17986: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 46 KiB/s wr, 7 op/s 2023-05-08T13:04:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:43 smithi096 ceph-mon[124666]: pgmap v17986: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 46 KiB/s wr, 7 op/s 2023-05-08T13:04:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:43 smithi186 ceph-mon[126480]: pgmap v17986: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 46 KiB/s wr, 7 op/s 2023-05-08T13:04:45.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33623.338097 secs 2023-05-08T13:04:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33623.892456 secs 2023-05-08T13:04:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33623.338097 secs 2023-05-08T13:04:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33623.892456 secs 2023-05-08T13:04:45.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33623.338097 secs 2023-05-08T13:04:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33623.892456 secs 2023-05-08T13:04:46.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:45 smithi133 ceph-mon[125939]: pgmap v17987: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 46 KiB/s wr, 8 op/s 2023-05-08T13:04:46.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:45 smithi096 ceph-mon[124666]: pgmap v17987: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 46 KiB/s wr, 8 op/s 2023-05-08T13:04:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:45 smithi186 ceph-mon[126480]: pgmap v17987: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 46 KiB/s wr, 8 op/s 2023-05-08T13:04:48.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:47 smithi133 ceph-mon[125939]: pgmap v17988: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 8 op/s 2023-05-08T13:04:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:47 smithi096 ceph-mon[124666]: pgmap v17988: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 8 op/s 2023-05-08T13:04:48.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:47 smithi186 ceph-mon[126480]: pgmap v17988: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 8 op/s 2023-05-08T13:04:49.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:04:49.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:04:49.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:04:50.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:49 smithi133 ceph-mon[125939]: pgmap v17989: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 6 op/s 2023-05-08T13:04:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33628.338232 secs 2023-05-08T13:04:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:04:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:04:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:04:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33628.892591 secs 2023-05-08T13:04:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:49 smithi096 ceph-mon[124666]: pgmap v17989: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 6 op/s 2023-05-08T13:04:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33628.338232 secs 2023-05-08T13:04:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:04:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:04:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:04:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33628.892591 secs 2023-05-08T13:04:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:49 smithi186 ceph-mon[126480]: pgmap v17989: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 6 op/s 2023-05-08T13:04:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33628.338232 secs 2023-05-08T13:04:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:04:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:04:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:04:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33628.892591 secs 2023-05-08T13:04:52.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:51 smithi133 ceph-mon[125939]: pgmap v17990: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 463 KiB/s rd, 329 KiB/s wr, 10 op/s 2023-05-08T13:04:52.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:51 smithi096 ceph-mon[124666]: pgmap v17990: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 463 KiB/s rd, 329 KiB/s wr, 10 op/s 2023-05-08T13:04:52.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:51 smithi186 ceph-mon[126480]: pgmap v17990: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 463 KiB/s rd, 329 KiB/s wr, 10 op/s 2023-05-08T13:04:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:53 smithi133 ceph-mon[125939]: pgmap v17991: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 329 KiB/s wr, 6 op/s 2023-05-08T13:04:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:53 smithi096 ceph-mon[124666]: pgmap v17991: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 329 KiB/s wr, 6 op/s 2023-05-08T13:04:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:53 smithi186 ceph-mon[126480]: pgmap v17991: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 329 KiB/s wr, 6 op/s 2023-05-08T13:04:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33633.338374 secs 2023-05-08T13:04:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33633.338374 secs 2023-05-08T13:04:55.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33633.338374 secs 2023-05-08T13:04:56.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:55 smithi133 ceph-mon[125939]: pgmap v17992: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 804 KiB/s rd, 670 KiB/s wr, 8 op/s 2023-05-08T13:04:56.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:55 smithi096 ceph-mon[124666]: pgmap v17992: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 804 KiB/s rd, 670 KiB/s wr, 8 op/s 2023-05-08T13:04:56.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:55 smithi186 ceph-mon[126480]: pgmap v17992: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 804 KiB/s rd, 670 KiB/s wr, 8 op/s 2023-05-08T13:04:57.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:04:57.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:04:57.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:04:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:57 smithi133 ceph-mon[125939]: pgmap v17993: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 871 KiB/s wr, 10 op/s 2023-05-08T13:04:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:57 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:04:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:04:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:04:58.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:57 smithi096 ceph-mon[124666]: pgmap v17993: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 871 KiB/s wr, 10 op/s 2023-05-08T13:04:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:57 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:04:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:04:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:04:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:57 smithi186 ceph-mon[126480]: pgmap v17993: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 871 KiB/s wr, 10 op/s 2023-05-08T13:04:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:57 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:04:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:04:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:05:00.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:59 smithi133 ceph-mon[125939]: pgmap v17994: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 871 KiB/s wr, 8 op/s 2023-05-08T13:05:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:04:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33638.338454 secs 2023-05-08T13:05:00.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:59 smithi096 ceph-mon[124666]: pgmap v17994: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 871 KiB/s wr, 8 op/s 2023-05-08T13:05:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:04:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33638.338454 secs 2023-05-08T13:05:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:59 smithi186 ceph-mon[126480]: pgmap v17994: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 871 KiB/s wr, 8 op/s 2023-05-08T13:05:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:04:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33638.338454 secs 2023-05-08T13:05:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:01 smithi133 ceph-mon[125939]: pgmap v17995: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T13:05:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:01 smithi096 ceph-mon[124666]: pgmap v17995: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T13:05:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:01 smithi186 ceph-mon[126480]: pgmap v17995: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T13:05:04.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:03 smithi133 ceph-mon[125939]: pgmap v17996: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T13:05:04.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:03 smithi096 ceph-mon[124666]: pgmap v17996: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T13:05:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:03 smithi186 ceph-mon[126480]: pgmap v17996: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T13:05:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33643.338566 secs 2023-05-08T13:05:05.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33643.892945 secs 2023-05-08T13:05:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33643.338566 secs 2023-05-08T13:05:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33643.892945 secs 2023-05-08T13:05:05.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33643.338566 secs 2023-05-08T13:05:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33643.892945 secs 2023-05-08T13:05:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:05 smithi133 ceph-mon[125939]: pgmap v17997: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T13:05:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:05 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:05:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:05:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:05:06.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:05 smithi096 ceph-mon[124666]: pgmap v17997: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T13:05:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:05 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:05:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:05:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:05:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:05 smithi186 ceph-mon[126480]: pgmap v17997: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T13:05:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:05 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:05:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:05:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:05:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:07 smithi133 ceph-mon[125939]: pgmap v17998: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.1 MiB/s wr, 26 op/s 2023-05-08T13:05:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:07 smithi096 ceph-mon[124666]: pgmap v17998: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.1 MiB/s wr, 26 op/s 2023-05-08T13:05:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:07 smithi186 ceph-mon[126480]: pgmap v17998: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.1 MiB/s wr, 26 op/s 2023-05-08T13:05:10.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:09 smithi133 ceph-mon[125939]: pgmap v17999: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 916 KiB/s wr, 23 op/s 2023-05-08T13:05:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33648.338659 secs 2023-05-08T13:05:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33648.893087 secs 2023-05-08T13:05:10.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:09 smithi096 ceph-mon[124666]: pgmap v17999: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 916 KiB/s wr, 23 op/s 2023-05-08T13:05:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33648.338659 secs 2023-05-08T13:05:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33648.893087 secs 2023-05-08T13:05:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:09 smithi186 ceph-mon[126480]: pgmap v17999: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 916 KiB/s wr, 23 op/s 2023-05-08T13:05:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33648.338659 secs 2023-05-08T13:05:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33648.893087 secs 2023-05-08T13:05:12.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:11 smithi133 ceph-mon[125939]: pgmap v18000: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.0 MiB/s wr, 27 op/s 2023-05-08T13:05:12.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:11 smithi096 ceph-mon[124666]: pgmap v18000: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.0 MiB/s wr, 27 op/s 2023-05-08T13:05:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:11 smithi186 ceph-mon[126480]: pgmap v18000: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.0 MiB/s wr, 27 op/s 2023-05-08T13:05:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:13 smithi133 ceph-mon[125939]: pgmap v18001: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 555 KiB/s wr, 22 op/s 2023-05-08T13:05:14.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:13 smithi096 ceph-mon[124666]: pgmap v18001: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 555 KiB/s wr, 22 op/s 2023-05-08T13:05:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:13 smithi186 ceph-mon[126480]: pgmap v18001: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 555 KiB/s wr, 22 op/s 2023-05-08T13:05:15.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33653.338784 secs 2023-05-08T13:05:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33653.893248 secs 2023-05-08T13:05:15.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33653.338784 secs 2023-05-08T13:05:15.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33653.893248 secs 2023-05-08T13:05:15.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33653.338784 secs 2023-05-08T13:05:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33653.893248 secs 2023-05-08T13:05:16.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:15 smithi133 ceph-mon[125939]: pgmap v18002: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 555 KiB/s wr, 23 op/s 2023-05-08T13:05:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:15 smithi096 ceph-mon[124666]: pgmap v18002: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 555 KiB/s wr, 23 op/s 2023-05-08T13:05:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:15 smithi186 ceph-mon[126480]: pgmap v18002: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 555 KiB/s wr, 23 op/s 2023-05-08T13:05:18.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:17 smithi133 ceph-mon[125939]: pgmap v18003: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 850 KiB/s rd, 844 KiB/s wr, 25 op/s 2023-05-08T13:05:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:17 smithi096 ceph-mon[124666]: pgmap v18003: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 850 KiB/s rd, 844 KiB/s wr, 25 op/s 2023-05-08T13:05:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:17 smithi186 ceph-mon[126480]: pgmap v18003: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 850 KiB/s rd, 844 KiB/s wr, 25 op/s 2023-05-08T13:05:20.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:19 smithi133 ceph-mon[125939]: pgmap v18004: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 437 KiB/s wr, 8 op/s 2023-05-08T13:05:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33658.338846 secs 2023-05-08T13:05:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33658.893373 secs 2023-05-08T13:05:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:19 smithi096 ceph-mon[124666]: pgmap v18004: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 437 KiB/s wr, 8 op/s 2023-05-08T13:05:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33658.338846 secs 2023-05-08T13:05:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33658.893373 secs 2023-05-08T13:05:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:19 smithi186 ceph-mon[126480]: pgmap v18004: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 437 KiB/s wr, 8 op/s 2023-05-08T13:05:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33658.338846 secs 2023-05-08T13:05:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33658.893373 secs 2023-05-08T13:05:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:21 smithi133 ceph-mon[125939]: pgmap v18005: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 437 KiB/s wr, 11 op/s 2023-05-08T13:05:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:21 smithi096 ceph-mon[124666]: pgmap v18005: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 437 KiB/s wr, 11 op/s 2023-05-08T13:05:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:21 smithi186 ceph-mon[126480]: pgmap v18005: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 437 KiB/s wr, 11 op/s 2023-05-08T13:05:24.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:23 smithi133 ceph-mon[125939]: pgmap v18006: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 292 KiB/s rd, 536 KiB/s wr, 7 op/s 2023-05-08T13:05:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:05:24.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:23 smithi096 ceph-mon[124666]: pgmap v18006: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 292 KiB/s rd, 536 KiB/s wr, 7 op/s 2023-05-08T13:05:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:05:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:23 smithi186 ceph-mon[126480]: pgmap v18006: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 292 KiB/s rd, 536 KiB/s wr, 7 op/s 2023-05-08T13:05:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:05:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33663.338963 secs 2023-05-08T13:05:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:24 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:05:25.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33663.338963 secs 2023-05-08T13:05:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:24 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:05:25.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33663.338963 secs 2023-05-08T13:05:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:24 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:05:26.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:25 smithi133 ceph-mon[125939]: pgmap v18007: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 878 KiB/s wr, 9 op/s 2023-05-08T13:05:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:25 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:05:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:25 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:05:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:25 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:05:26.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:25 smithi096 ceph-mon[124666]: pgmap v18007: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 878 KiB/s wr, 9 op/s 2023-05-08T13:05:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:25 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:05:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:25 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:05:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:25 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:05:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:25 smithi186 ceph-mon[126480]: pgmap v18007: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 878 KiB/s wr, 9 op/s 2023-05-08T13:05:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:25 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:05:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:25 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:05:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:25 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:05:27.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:27 smithi186 ceph-mon[126480]: pgmap v18008: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T13:05:27.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:05:27.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:05:27.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:05:27.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:05:27.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:05:27.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:05:27.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:05:27.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:05:27.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:05:27.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:05:27.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:05:27.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:05:27.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:05:27.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:05:27.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:05:27.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:05:27.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:05:27.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:05:27.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:27 smithi133 ceph-mon[125939]: pgmap v18008: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T13:05:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:05:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:05:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:05:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:05:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:05:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:05:27.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:05:27.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:05:27.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:05:27.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:05:27.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:05:27.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:05:27.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:05:27.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:05:27.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:05:27.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:05:27.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:05:27.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:05:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:27 smithi096 ceph-mon[124666]: pgmap v18008: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T13:05:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:05:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:05:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:05:28.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:05:28.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:05:28.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:05:28.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:05:28.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:05:28.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:05:28.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:05:28.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:05:28.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:05:28.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:05:28.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:05:28.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:05:28.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:05:28.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:05:28.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:05:28.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:28 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi133 to 125.3M 2023-05-08T13:05:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:28 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi133 to 131395801: error parsing value: Value '131395801' is below minimum 939524096 2023-05-08T13:05:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:28 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi186 to 114.3M 2023-05-08T13:05:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:28 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi186 to 119870279: error parsing value: Value '119870279' is below minimum 939524096 2023-05-08T13:05:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:28 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:05:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:28 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T13:05:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:28 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T13:05:28.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:28 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:05:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:28 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi133 to 125.3M 2023-05-08T13:05:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:28 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi133 to 131395801: error parsing value: Value '131395801' is below minimum 939524096 2023-05-08T13:05:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:28 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi186 to 114.3M 2023-05-08T13:05:28.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:28 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi186 to 119870279: error parsing value: Value '119870279' is below minimum 939524096 2023-05-08T13:05:28.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:28 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:05:28.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:28 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T13:05:28.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:28 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T13:05:28.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:28 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:05:29.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:28 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi133 to 125.3M 2023-05-08T13:05:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:28 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi133 to 131395801: error parsing value: Value '131395801' is below minimum 939524096 2023-05-08T13:05:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:28 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi186 to 114.3M 2023-05-08T13:05:29.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:28 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi186 to 119870279: error parsing value: Value '119870279' is below minimum 939524096 2023-05-08T13:05:29.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:28 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:05:29.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:28 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T13:05:29.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:28 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T13:05:29.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:28 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:05:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:29 smithi186 ceph-mon[126480]: pgmap v18009: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 770 KiB/s rd, 790 KiB/s wr, 11 op/s 2023-05-08T13:05:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33668.339099 secs 2023-05-08T13:05:29.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:29 smithi133 ceph-mon[125939]: pgmap v18009: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 770 KiB/s rd, 790 KiB/s wr, 11 op/s 2023-05-08T13:05:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33668.339099 secs 2023-05-08T13:05:30.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:29 smithi096 ceph-mon[124666]: pgmap v18009: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 770 KiB/s rd, 790 KiB/s wr, 11 op/s 2023-05-08T13:05:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33668.339099 secs 2023-05-08T13:05:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:31 smithi186 ceph-mon[126480]: pgmap v18010: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 776 KiB/s rd, 822 KiB/s wr, 15 op/s 2023-05-08T13:05:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:31 smithi186 ceph-mon[126480]: osdmap e1202: 12 total, 12 up, 12 in 2023-05-08T13:05:31.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:31 smithi133 ceph-mon[125939]: pgmap v18010: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 776 KiB/s rd, 822 KiB/s wr, 15 op/s 2023-05-08T13:05:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:31 smithi133 ceph-mon[125939]: osdmap e1202: 12 total, 12 up, 12 in 2023-05-08T13:05:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:31 smithi096 ceph-mon[124666]: pgmap v18010: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 776 KiB/s rd, 822 KiB/s wr, 15 op/s 2023-05-08T13:05:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:31 smithi096 ceph-mon[124666]: osdmap e1202: 12 total, 12 up, 12 in 2023-05-08T13:05:34.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:33 smithi133 ceph-mon[125939]: pgmap v18012: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 930 KiB/s rd, 690 KiB/s wr, 13 op/s 2023-05-08T13:05:34.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:33 smithi096 ceph-mon[124666]: pgmap v18012: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 930 KiB/s rd, 690 KiB/s wr, 13 op/s 2023-05-08T13:05:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:33 smithi186 ceph-mon[126480]: pgmap v18012: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 930 KiB/s rd, 690 KiB/s wr, 13 op/s 2023-05-08T13:05:35.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33673.339195 secs 2023-05-08T13:05:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33673.339195 secs 2023-05-08T13:05:35.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33673.339195 secs 2023-05-08T13:05:36.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:35 smithi133 ceph-mon[125939]: pgmap v18013: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 520 KiB/s rd, 280 KiB/s wr, 12 op/s 2023-05-08T13:05:36.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:35 smithi096 ceph-mon[124666]: pgmap v18013: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 520 KiB/s rd, 280 KiB/s wr, 12 op/s 2023-05-08T13:05:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:35 smithi186 ceph-mon[126480]: pgmap v18013: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 520 KiB/s rd, 280 KiB/s wr, 12 op/s 2023-05-08T13:05:38.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:37 smithi133 ceph-mon[125939]: pgmap v18014: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 197 KiB/s wr, 8 op/s 2023-05-08T13:05:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:37 smithi096 ceph-mon[124666]: pgmap v18014: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 197 KiB/s wr, 8 op/s 2023-05-08T13:05:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:37 smithi186 ceph-mon[126480]: pgmap v18014: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 197 KiB/s wr, 8 op/s 2023-05-08T13:05:40.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:39 smithi133 ceph-mon[125939]: pgmap v18015: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 197 KiB/s wr, 8 op/s 2023-05-08T13:05:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33678.339358 secs 2023-05-08T13:05:40.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:39 smithi096 ceph-mon[124666]: pgmap v18015: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 197 KiB/s wr, 8 op/s 2023-05-08T13:05:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33678.339358 secs 2023-05-08T13:05:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:39 smithi186 ceph-mon[126480]: pgmap v18015: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 197 KiB/s wr, 8 op/s 2023-05-08T13:05:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33678.339358 secs 2023-05-08T13:05:41.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33680.185962 secs 2023-05-08T13:05:41.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33680.185962 secs 2023-05-08T13:05:41.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33680.185962 secs 2023-05-08T13:05:42.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:41 smithi133 ceph-mon[125939]: pgmap v18016: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 327 KiB/s wr, 8 op/s 2023-05-08T13:05:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:41 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:05:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:41 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:05:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:41 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:05:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:41 smithi133 ceph-mon[125939]: osdmap e1203: 12 total, 12 up, 12 in 2023-05-08T13:05:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:41 smithi096 ceph-mon[124666]: pgmap v18016: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 327 KiB/s wr, 8 op/s 2023-05-08T13:05:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:41 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:05:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:41 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:05:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:41 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:05:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:41 smithi096 ceph-mon[124666]: osdmap e1203: 12 total, 12 up, 12 in 2023-05-08T13:05:42.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:41 smithi186 ceph-mon[126480]: pgmap v18016: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 327 KiB/s wr, 8 op/s 2023-05-08T13:05:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:41 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:05:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:41 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:05:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:41 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:05:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:41 smithi186 ceph-mon[126480]: osdmap e1203: 12 total, 12 up, 12 in 2023-05-08T13:05:44.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:43 smithi133 ceph-mon[125939]: pgmap v18018: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 327 KiB/s wr, 8 op/s 2023-05-08T13:05:44.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:43 smithi096 ceph-mon[124666]: pgmap v18018: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 327 KiB/s wr, 8 op/s 2023-05-08T13:05:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:43 smithi186 ceph-mon[126480]: pgmap v18018: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 327 KiB/s wr, 8 op/s 2023-05-08T13:05:45.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33683.339484 secs 2023-05-08T13:05:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33683.894087 secs 2023-05-08T13:05:45.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33683.339484 secs 2023-05-08T13:05:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33683.894087 secs 2023-05-08T13:05:45.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33683.339484 secs 2023-05-08T13:05:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33683.894087 secs 2023-05-08T13:05:46.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:45 smithi133 ceph-mon[125939]: pgmap v18019: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 496 KiB/s rd, 736 KiB/s wr, 9 op/s 2023-05-08T13:05:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:45 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:05:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:45 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:05:46.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:45 smithi096 ceph-mon[124666]: pgmap v18019: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 496 KiB/s rd, 736 KiB/s wr, 9 op/s 2023-05-08T13:05:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:45 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:05:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:45 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:05:46.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:45 smithi186 ceph-mon[126480]: pgmap v18019: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 496 KiB/s rd, 736 KiB/s wr, 9 op/s 2023-05-08T13:05:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:45 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:05:46.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:45 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:05:47.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:46 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:05:47.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:46 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:05:47.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:46 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:05:48.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:47 smithi133 ceph-mon[125939]: pgmap v18020: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T13:05:48.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:47 smithi096 ceph-mon[124666]: pgmap v18020: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T13:05:48.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:47 smithi186 ceph-mon[126480]: pgmap v18020: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T13:05:49.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:05:49.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:05:49.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:05:50.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:49 smithi133 ceph-mon[125939]: pgmap v18021: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T13:05:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33688.339602 secs 2023-05-08T13:05:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:05:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:05:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:49 smithi096 ceph-mon[124666]: pgmap v18021: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T13:05:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33688.339602 secs 2023-05-08T13:05:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:05:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:05:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:49 smithi186 ceph-mon[126480]: pgmap v18021: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T13:05:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33688.339602 secs 2023-05-08T13:05:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:05:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:05:51.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:51 smithi186 ceph-mon[126480]: pgmap v18022: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.4 MiB/s wr, 13 op/s 2023-05-08T13:05:51.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:51 smithi133 ceph-mon[125939]: pgmap v18022: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.4 MiB/s wr, 13 op/s 2023-05-08T13:05:51.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:51 smithi096 ceph-mon[124666]: pgmap v18022: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.4 MiB/s wr, 13 op/s 2023-05-08T13:05:52.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:52 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:05:52.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:52 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:05:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:52 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:05:53.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:53 smithi186 ceph-mon[126480]: pgmap v18023: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.3 MiB/s wr, 13 op/s 2023-05-08T13:05:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:53 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:05:53.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:53 smithi133 ceph-mon[125939]: pgmap v18023: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.3 MiB/s wr, 13 op/s 2023-05-08T13:05:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:53 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:05:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:53 smithi096 ceph-mon[124666]: pgmap v18023: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.3 MiB/s wr, 13 op/s 2023-05-08T13:05:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:53 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:05:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:54 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:05:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:54 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:05:54.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:54 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:05:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:54 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:05:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:54 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:05:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:54 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:05:55.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33693.339726 secs 2023-05-08T13:05:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:55 smithi186 ceph-mon[126480]: pgmap v18024: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.3 MiB/s wr, 14 op/s 2023-05-08T13:05:55.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33693.339726 secs 2023-05-08T13:05:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:55 smithi133 ceph-mon[125939]: pgmap v18024: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.3 MiB/s wr, 14 op/s 2023-05-08T13:05:55.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33693.339726 secs 2023-05-08T13:05:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:55 smithi096 ceph-mon[124666]: pgmap v18024: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.3 MiB/s wr, 14 op/s 2023-05-08T13:05:57.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:57 smithi133 ceph-mon[125939]: pgmap v18025: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.0 MiB/s wr, 16 op/s 2023-05-08T13:05:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:57 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:05:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:57 smithi096 ceph-mon[124666]: pgmap v18025: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.0 MiB/s wr, 16 op/s 2023-05-08T13:05:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:57 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:05:57.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:57 smithi186 ceph-mon[126480]: pgmap v18025: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.0 MiB/s wr, 16 op/s 2023-05-08T13:05:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:57 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:05:59.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:05:59 smithi133 ceph-mon[125939]: pgmap v18026: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.4 MiB/s wr, 11 op/s 2023-05-08T13:05:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:05:59 smithi096 ceph-mon[124666]: pgmap v18026: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.4 MiB/s wr, 11 op/s 2023-05-08T13:05:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:05:59 smithi186 ceph-mon[126480]: pgmap v18026: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.4 MiB/s wr, 11 op/s 2023-05-08T13:06:00.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33698.339870 secs 2023-05-08T13:06:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33698.894429 secs 2023-05-08T13:06:00.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33698.339870 secs 2023-05-08T13:06:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33698.894429 secs 2023-05-08T13:06:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33698.339870 secs 2023-05-08T13:06:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33698.894429 secs 2023-05-08T13:06:01.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:01 smithi133 ceph-mon[125939]: pgmap v18027: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.7 MiB/s wr, 16 op/s 2023-05-08T13:06:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:01 smithi096 ceph-mon[124666]: pgmap v18027: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.7 MiB/s wr, 16 op/s 2023-05-08T13:06:01.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:01 smithi186 ceph-mon[126480]: pgmap v18027: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.7 MiB/s wr, 16 op/s 2023-05-08T13:06:02.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:06:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:06:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:02 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:06:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:06:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:06:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:02 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:06:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:06:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:06:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:02 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:06:04.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:03 smithi133 ceph-mon[125939]: pgmap v18028: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 731 KiB/s wr, 11 op/s 2023-05-08T13:06:04.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:03 smithi096 ceph-mon[124666]: pgmap v18028: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 731 KiB/s wr, 11 op/s 2023-05-08T13:06:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:03 smithi186 ceph-mon[126480]: pgmap v18028: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 731 KiB/s wr, 11 op/s 2023-05-08T13:06:05.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33703.340014 secs 2023-05-08T13:06:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33703.894545 secs 2023-05-08T13:06:05.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33703.340014 secs 2023-05-08T13:06:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33703.894545 secs 2023-05-08T13:06:05.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33703.340014 secs 2023-05-08T13:06:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33703.894545 secs 2023-05-08T13:06:06.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:05 smithi133 ceph-mon[125939]: pgmap v18029: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2023-05-08T13:06:06.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:05 smithi096 ceph-mon[124666]: pgmap v18029: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2023-05-08T13:06:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:05 smithi186 ceph-mon[126480]: pgmap v18029: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2023-05-08T13:06:08.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:07 smithi133 ceph-mon[125939]: pgmap v18030: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 869 KiB/s wr, 25 op/s 2023-05-08T13:06:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:07 smithi096 ceph-mon[124666]: pgmap v18030: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 869 KiB/s wr, 25 op/s 2023-05-08T13:06:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:07 smithi186 ceph-mon[126480]: pgmap v18030: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 869 KiB/s wr, 25 op/s 2023-05-08T13:06:10.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:09 smithi133 ceph-mon[125939]: pgmap v18031: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 845 KiB/s wr, 21 op/s 2023-05-08T13:06:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33708.340152 secs 2023-05-08T13:06:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33708.894623 secs 2023-05-08T13:06:10.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:09 smithi096 ceph-mon[124666]: pgmap v18031: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 845 KiB/s wr, 21 op/s 2023-05-08T13:06:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33708.340152 secs 2023-05-08T13:06:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33708.894623 secs 2023-05-08T13:06:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:09 smithi186 ceph-mon[126480]: pgmap v18031: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 845 KiB/s wr, 21 op/s 2023-05-08T13:06:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33708.340152 secs 2023-05-08T13:06:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33708.894623 secs 2023-05-08T13:06:12.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:11 smithi133 ceph-mon[125939]: pgmap v18032: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.1 MiB/s wr, 25 op/s 2023-05-08T13:06:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:11 smithi096 ceph-mon[124666]: pgmap v18032: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.1 MiB/s wr, 25 op/s 2023-05-08T13:06:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:11 smithi186 ceph-mon[126480]: pgmap v18032: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.1 MiB/s wr, 25 op/s 2023-05-08T13:06:14.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:13 smithi133 ceph-mon[125939]: pgmap v18033: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 794 KiB/s rd, 783 KiB/s wr, 20 op/s 2023-05-08T13:06:14.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:13 smithi096 ceph-mon[124666]: pgmap v18033: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 794 KiB/s rd, 783 KiB/s wr, 20 op/s 2023-05-08T13:06:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:13 smithi186 ceph-mon[126480]: pgmap v18033: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 794 KiB/s rd, 783 KiB/s wr, 20 op/s 2023-05-08T13:06:15.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33713.340270 secs 2023-05-08T13:06:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33713.894696 secs 2023-05-08T13:06:15.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33713.340270 secs 2023-05-08T13:06:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33713.894696 secs 2023-05-08T13:06:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33713.340270 secs 2023-05-08T13:06:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33713.894696 secs 2023-05-08T13:06:16.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:15 smithi133 ceph-mon[125939]: pgmap v18034: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 795 KiB/s rd, 783 KiB/s wr, 22 op/s 2023-05-08T13:06:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:15 smithi096 ceph-mon[124666]: pgmap v18034: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 795 KiB/s rd, 783 KiB/s wr, 22 op/s 2023-05-08T13:06:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:15 smithi186 ceph-mon[126480]: pgmap v18034: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 795 KiB/s rd, 783 KiB/s wr, 22 op/s 2023-05-08T13:06:18.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:17 smithi133 ceph-mon[125939]: pgmap v18035: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 492 KiB/s wr, 21 op/s 2023-05-08T13:06:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:17 smithi096 ceph-mon[124666]: pgmap v18035: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 492 KiB/s wr, 21 op/s 2023-05-08T13:06:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:17 smithi186 ceph-mon[126480]: pgmap v18035: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 492 KiB/s wr, 21 op/s 2023-05-08T13:06:20.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:19 smithi133 ceph-mon[125939]: pgmap v18036: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 470 KiB/s wr, 7 op/s 2023-05-08T13:06:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33718.340411 secs 2023-05-08T13:06:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:19 smithi096 ceph-mon[124666]: pgmap v18036: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 470 KiB/s wr, 7 op/s 2023-05-08T13:06:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33718.340411 secs 2023-05-08T13:06:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:19 smithi186 ceph-mon[126480]: pgmap v18036: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 470 KiB/s wr, 7 op/s 2023-05-08T13:06:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33718.340411 secs 2023-05-08T13:06:21.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:20 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:06:21.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:20 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:06:21.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:20 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:06:22.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:21 smithi133 ceph-mon[125939]: pgmap v18037: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 730 KiB/s rd, 782 KiB/s wr, 13 op/s 2023-05-08T13:06:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:21 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:06:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:21 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:06:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:21 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:06:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:21 smithi096 ceph-mon[124666]: pgmap v18037: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 730 KiB/s rd, 782 KiB/s wr, 13 op/s 2023-05-08T13:06:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:21 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:06:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:21 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:06:22.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:21 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:06:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:21 smithi186 ceph-mon[126480]: pgmap v18037: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 730 KiB/s rd, 782 KiB/s wr, 13 op/s 2023-05-08T13:06:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:21 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:06:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:21 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:06:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:21 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:06:24.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:23 smithi133 ceph-mon[125939]: pgmap v18038: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 631 KiB/s rd, 654 KiB/s wr, 10 op/s 2023-05-08T13:06:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:23 smithi096 ceph-mon[124666]: pgmap v18038: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 631 KiB/s rd, 654 KiB/s wr, 10 op/s 2023-05-08T13:06:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:23 smithi186 ceph-mon[126480]: pgmap v18038: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 631 KiB/s rd, 654 KiB/s wr, 10 op/s 2023-05-08T13:06:25.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33723.340542 secs 2023-05-08T13:06:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33723.340542 secs 2023-05-08T13:06:25.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33723.340542 secs 2023-05-08T13:06:26.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:25 smithi133 ceph-mon[125939]: pgmap v18039: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 632 KiB/s rd, 654 KiB/s wr, 11 op/s 2023-05-08T13:06:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:25 smithi096 ceph-mon[124666]: pgmap v18039: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 632 KiB/s rd, 654 KiB/s wr, 11 op/s 2023-05-08T13:06:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:25 smithi186 ceph-mon[126480]: pgmap v18039: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 632 KiB/s rd, 654 KiB/s wr, 11 op/s 2023-05-08T13:06:27.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:26 smithi133 ceph-mon[125939]: osdmap e1204: 12 total, 12 up, 12 in 2023-05-08T13:06:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:26 smithi096 ceph-mon[124666]: osdmap e1204: 12 total, 12 up, 12 in 2023-05-08T13:06:27.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:26 smithi186 ceph-mon[126480]: osdmap e1204: 12 total, 12 up, 12 in 2023-05-08T13:06:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:27 smithi133 ceph-mon[125939]: pgmap v18041: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 763 KiB/s rd, 611 KiB/s wr, 13 op/s 2023-05-08T13:06:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:06:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:06:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:06:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:27 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:06:28.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:06:28.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:27 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T13:06:28.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:27 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T13:06:28.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:27 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:06:28.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:27 smithi096 ceph-mon[124666]: pgmap v18041: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 763 KiB/s rd, 611 KiB/s wr, 13 op/s 2023-05-08T13:06:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:06:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:06:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:06:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:27 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:06:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:06:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:27 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T13:06:28.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:27 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T13:06:28.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:27 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:06:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:27 smithi186 ceph-mon[126480]: pgmap v18041: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 763 KiB/s rd, 611 KiB/s wr, 13 op/s 2023-05-08T13:06:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:06:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:06:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:06:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:27 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:06:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:06:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:27 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T13:06:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:27 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T13:06:28.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:27 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:06:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:28 smithi096 ceph-mon[124666]: pgmap v18042: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 763 KiB/s rd, 611 KiB/s wr, 13 op/s 2023-05-08T13:06:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:28 smithi186 ceph-mon[126480]: pgmap v18042: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 763 KiB/s rd, 611 KiB/s wr, 13 op/s 2023-05-08T13:06:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:28 smithi133 ceph-mon[125939]: pgmap v18042: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 763 KiB/s rd, 611 KiB/s wr, 13 op/s 2023-05-08T13:06:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33728.340639 secs 2023-05-08T13:06:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33728.340639 secs 2023-05-08T13:06:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33728.340639 secs 2023-05-08T13:06:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:31 smithi096 ceph-mon[124666]: pgmap v18043: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 599 KiB/s rd, 394 KiB/s wr, 9 op/s 2023-05-08T13:06:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:31 smithi186 ceph-mon[126480]: pgmap v18043: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 599 KiB/s rd, 394 KiB/s wr, 9 op/s 2023-05-08T13:06:31.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:31 smithi133 ceph-mon[125939]: pgmap v18043: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 599 KiB/s rd, 394 KiB/s wr, 9 op/s 2023-05-08T13:06:34.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:33 smithi133 ceph-mon[125939]: pgmap v18044: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 185 KiB/s wr, 9 op/s 2023-05-08T13:06:34.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:33 smithi096 ceph-mon[124666]: pgmap v18044: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 185 KiB/s wr, 9 op/s 2023-05-08T13:06:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:33 smithi186 ceph-mon[126480]: pgmap v18044: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 185 KiB/s wr, 9 op/s 2023-05-08T13:06:35.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33733.340762 secs 2023-05-08T13:06:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33733.340762 secs 2023-05-08T13:06:35.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33733.340762 secs 2023-05-08T13:06:36.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:35 smithi133 ceph-mon[125939]: pgmap v18045: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 362 KiB/s wr, 9 op/s 2023-05-08T13:06:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33735.187220 secs 2023-05-08T13:06:36.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:35 smithi096 ceph-mon[124666]: pgmap v18045: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 362 KiB/s wr, 9 op/s 2023-05-08T13:06:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33735.187220 secs 2023-05-08T13:06:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:35 smithi186 ceph-mon[126480]: pgmap v18045: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 362 KiB/s wr, 9 op/s 2023-05-08T13:06:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33735.187220 secs 2023-05-08T13:06:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:37 smithi133 ceph-mon[125939]: pgmap v18046: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 359 KiB/s wr, 8 op/s 2023-05-08T13:06:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:37 smithi133 ceph-mon[125939]: osdmap e1205: 12 total, 12 up, 12 in 2023-05-08T13:06:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:37 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:06:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:37 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:06:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:37 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:06:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:37 smithi096 ceph-mon[124666]: pgmap v18046: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 359 KiB/s wr, 8 op/s 2023-05-08T13:06:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:37 smithi096 ceph-mon[124666]: osdmap e1205: 12 total, 12 up, 12 in 2023-05-08T13:06:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:37 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:06:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:37 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:06:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:37 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:06:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:37 smithi186 ceph-mon[126480]: pgmap v18046: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 359 KiB/s wr, 8 op/s 2023-05-08T13:06:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:37 smithi186 ceph-mon[126480]: osdmap e1205: 12 total, 12 up, 12 in 2023-05-08T13:06:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:37 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:06:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:37 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:06:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:37 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:06:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:39 smithi133 ceph-mon[125939]: pgmap v18048: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 363 KiB/s wr, 8 op/s 2023-05-08T13:06:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33738.340883 secs 2023-05-08T13:06:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33738.895257 secs 2023-05-08T13:06:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:39 smithi096 ceph-mon[124666]: pgmap v18048: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 363 KiB/s wr, 8 op/s 2023-05-08T13:06:40.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33738.340883 secs 2023-05-08T13:06:40.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33738.895257 secs 2023-05-08T13:06:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:39 smithi186 ceph-mon[126480]: pgmap v18048: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 363 KiB/s wr, 8 op/s 2023-05-08T13:06:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33738.340883 secs 2023-05-08T13:06:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33738.895257 secs 2023-05-08T13:06:41.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33740.187343 secs 2023-05-08T13:06:41.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33740.187343 secs 2023-05-08T13:06:41.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33740.187343 secs 2023-05-08T13:06:42.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:41 smithi133 ceph-mon[125939]: pgmap v18049: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 855 KiB/s wr, 11 op/s 2023-05-08T13:06:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:41 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:06:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:41 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:06:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:41 smithi096 ceph-mon[124666]: pgmap v18049: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 855 KiB/s wr, 11 op/s 2023-05-08T13:06:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:41 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:06:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:41 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:06:42.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:41 smithi186 ceph-mon[126480]: pgmap v18049: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 855 KiB/s wr, 11 op/s 2023-05-08T13:06:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:41 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:06:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:41 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:06:44.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:43 smithi133 ceph-mon[125939]: pgmap v18050: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 940 KiB/s wr, 11 op/s 2023-05-08T13:06:44.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:43 smithi096 ceph-mon[124666]: pgmap v18050: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 940 KiB/s wr, 11 op/s 2023-05-08T13:06:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:43 smithi186 ceph-mon[126480]: pgmap v18050: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 940 KiB/s wr, 11 op/s 2023-05-08T13:06:45.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33743.340978 secs 2023-05-08T13:06:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33743.895372 secs 2023-05-08T13:06:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33743.340978 secs 2023-05-08T13:06:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33743.895372 secs 2023-05-08T13:06:45.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33743.340978 secs 2023-05-08T13:06:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33743.895372 secs 2023-05-08T13:06:46.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:45 smithi133 ceph-mon[125939]: pgmap v18051: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 515 KiB/s rd, 762 KiB/s wr, 10 op/s 2023-05-08T13:06:46.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:45 smithi096 ceph-mon[124666]: pgmap v18051: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 515 KiB/s rd, 762 KiB/s wr, 10 op/s 2023-05-08T13:06:46.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:45 smithi186 ceph-mon[126480]: pgmap v18051: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 515 KiB/s rd, 762 KiB/s wr, 10 op/s 2023-05-08T13:06:47.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:46 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:06:47.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:46 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:06:47.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:46 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:06:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:47 smithi133 ceph-mon[125939]: pgmap v18052: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T13:06:48.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:47 smithi096 ceph-mon[124666]: pgmap v18052: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T13:06:48.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:47 smithi186 ceph-mon[126480]: pgmap v18052: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T13:06:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:06:49.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:06:49.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:06:50.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:49 smithi133 ceph-mon[125939]: pgmap v18053: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T13:06:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33748.341103 secs 2023-05-08T13:06:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:06:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:06:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:49 smithi096 ceph-mon[124666]: pgmap v18053: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T13:06:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33748.341103 secs 2023-05-08T13:06:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:06:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:06:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:49 smithi186 ceph-mon[126480]: pgmap v18053: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T13:06:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33748.341103 secs 2023-05-08T13:06:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:06:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:06:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:51 smithi133 ceph-mon[125939]: pgmap v18054: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 15 op/s 2023-05-08T13:06:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:51 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:06:52.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:51 smithi096 ceph-mon[124666]: pgmap v18054: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 15 op/s 2023-05-08T13:06:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:51 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:06:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:51 smithi186 ceph-mon[126480]: pgmap v18054: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 15 op/s 2023-05-08T13:06:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:51 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:06:53.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:06:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:06:53.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:06:54.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:53 smithi133 ceph-mon[125939]: pgmap v18055: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 920 KiB/s rd, 778 KiB/s wr, 9 op/s 2023-05-08T13:06:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:06:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:06:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:53 smithi096 ceph-mon[124666]: pgmap v18055: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 920 KiB/s rd, 778 KiB/s wr, 9 op/s 2023-05-08T13:06:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:06:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:06:54.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:53 smithi186 ceph-mon[126480]: pgmap v18055: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 920 KiB/s rd, 778 KiB/s wr, 9 op/s 2023-05-08T13:06:54.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:06:54.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:06:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33753.341241 secs 2023-05-08T13:06:55.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33753.341241 secs 2023-05-08T13:06:55.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33753.341241 secs 2023-05-08T13:06:56.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:55 smithi096 ceph-mon[124666]: pgmap v18056: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T13:06:56.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:55 smithi186 ceph-mon[126480]: pgmap v18056: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T13:06:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:55 smithi133 ceph-mon[125939]: pgmap v18056: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T13:06:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:57 smithi096 ceph-mon[124666]: pgmap v18057: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 15 op/s 2023-05-08T13:06:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:57 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:06:57.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:57 smithi186 ceph-mon[126480]: pgmap v18057: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 15 op/s 2023-05-08T13:06:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:57 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:06:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:57 smithi133 ceph-mon[125939]: pgmap v18057: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 15 op/s 2023-05-08T13:06:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:57 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:06:59.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:06:59 smithi133 ceph-mon[125939]: pgmap v18058: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T13:06:59.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:06:59 smithi096 ceph-mon[124666]: pgmap v18058: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T13:06:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:06:59 smithi186 ceph-mon[126480]: pgmap v18058: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T13:07:00.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33758.341379 secs 2023-05-08T13:07:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33758.895767 secs 2023-05-08T13:07:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33758.341379 secs 2023-05-08T13:07:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33758.895767 secs 2023-05-08T13:07:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33758.341379 secs 2023-05-08T13:07:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33758.895767 secs 2023-05-08T13:07:01.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:01 smithi133 ceph-mon[125939]: pgmap v18059: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 16 op/s 2023-05-08T13:07:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:01 smithi096 ceph-mon[124666]: pgmap v18059: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 16 op/s 2023-05-08T13:07:01.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:01 smithi186 ceph-mon[126480]: pgmap v18059: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 16 op/s 2023-05-08T13:07:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:07:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:07:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:02 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:07:02.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:07:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:07:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:02 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:07:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:07:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:07:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:02 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:07:04.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:03 smithi133 ceph-mon[125939]: pgmap v18060: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T13:07:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:03 smithi096 ceph-mon[124666]: pgmap v18060: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T13:07:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:03 smithi186 ceph-mon[126480]: pgmap v18060: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T13:07:05.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33763.341506 secs 2023-05-08T13:07:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33763.895871 secs 2023-05-08T13:07:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33763.341506 secs 2023-05-08T13:07:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33763.895871 secs 2023-05-08T13:07:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33763.341506 secs 2023-05-08T13:07:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33763.895871 secs 2023-05-08T13:07:06.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:05 smithi133 ceph-mon[125939]: pgmap v18061: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 14 op/s 2023-05-08T13:07:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:05 smithi096 ceph-mon[124666]: pgmap v18061: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 14 op/s 2023-05-08T13:07:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:05 smithi186 ceph-mon[126480]: pgmap v18061: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 14 op/s 2023-05-08T13:07:08.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:07 smithi133 ceph-mon[125939]: pgmap v18062: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 25 op/s 2023-05-08T13:07:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:07 smithi096 ceph-mon[124666]: pgmap v18062: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 25 op/s 2023-05-08T13:07:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:07 smithi186 ceph-mon[126480]: pgmap v18062: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 25 op/s 2023-05-08T13:07:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:09 smithi133 ceph-mon[125939]: pgmap v18063: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 895 KiB/s rd, 577 KiB/s wr, 21 op/s 2023-05-08T13:07:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33768.341581 secs 2023-05-08T13:07:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33768.895991 secs 2023-05-08T13:07:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:09 smithi096 ceph-mon[124666]: pgmap v18063: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 895 KiB/s rd, 577 KiB/s wr, 21 op/s 2023-05-08T13:07:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33768.341581 secs 2023-05-08T13:07:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33768.895991 secs 2023-05-08T13:07:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:09 smithi186 ceph-mon[126480]: pgmap v18063: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 895 KiB/s rd, 577 KiB/s wr, 21 op/s 2023-05-08T13:07:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33768.341581 secs 2023-05-08T13:07:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33768.895991 secs 2023-05-08T13:07:12.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:11 smithi133 ceph-mon[125939]: pgmap v18064: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 749 KiB/s wr, 24 op/s 2023-05-08T13:07:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:11 smithi096 ceph-mon[124666]: pgmap v18064: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 749 KiB/s wr, 24 op/s 2023-05-08T13:07:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:11 smithi186 ceph-mon[126480]: pgmap v18064: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 749 KiB/s wr, 24 op/s 2023-05-08T13:07:14.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:13 smithi133 ceph-mon[125939]: pgmap v18065: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 726 KiB/s wr, 20 op/s 2023-05-08T13:07:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:13 smithi096 ceph-mon[124666]: pgmap v18065: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 726 KiB/s wr, 20 op/s 2023-05-08T13:07:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:13 smithi186 ceph-mon[126480]: pgmap v18065: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 726 KiB/s wr, 20 op/s 2023-05-08T13:07:15.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33773.341711 secs 2023-05-08T13:07:15.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33773.341711 secs 2023-05-08T13:07:15.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33773.341711 secs 2023-05-08T13:07:16.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:15 smithi133 ceph-mon[125939]: pgmap v18066: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 857 KiB/s rd, 705 KiB/s wr, 21 op/s 2023-05-08T13:07:16.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:15 smithi096 ceph-mon[124666]: pgmap v18066: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 857 KiB/s rd, 705 KiB/s wr, 21 op/s 2023-05-08T13:07:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:15 smithi186 ceph-mon[126480]: pgmap v18066: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 857 KiB/s rd, 705 KiB/s wr, 21 op/s 2023-05-08T13:07:17.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:16 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:07:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:16 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:07:17.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:16 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:07:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:17 smithi133 ceph-mon[125939]: pgmap v18067: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 783 KiB/s rd, 653 KiB/s wr, 24 op/s 2023-05-08T13:07:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:17 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:07:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:17 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:07:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:17 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:07:18.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:17 smithi096 ceph-mon[124666]: pgmap v18067: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 783 KiB/s rd, 653 KiB/s wr, 24 op/s 2023-05-08T13:07:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:17 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:07:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:17 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:07:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:17 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:07:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:17 smithi186 ceph-mon[126480]: pgmap v18067: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 783 KiB/s rd, 653 KiB/s wr, 24 op/s 2023-05-08T13:07:18.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:17 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:07:18.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:17 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:07:18.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:17 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:07:20.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:19 smithi133 ceph-mon[125939]: pgmap v18068: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 611 KiB/s rd, 631 KiB/s wr, 9 op/s 2023-05-08T13:07:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33778.341834 secs 2023-05-08T13:07:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:19 smithi096 ceph-mon[124666]: pgmap v18068: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 611 KiB/s rd, 631 KiB/s wr, 9 op/s 2023-05-08T13:07:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33778.341834 secs 2023-05-08T13:07:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:19 smithi186 ceph-mon[126480]: pgmap v18068: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 611 KiB/s rd, 631 KiB/s wr, 9 op/s 2023-05-08T13:07:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33778.341834 secs 2023-05-08T13:07:22.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:21 smithi096 ceph-mon[124666]: pgmap v18069: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 617 KiB/s rd, 659 KiB/s wr, 13 op/s 2023-05-08T13:07:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:21 smithi096 ceph-mon[124666]: osdmap e1206: 12 total, 12 up, 12 in 2023-05-08T13:07:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:21 smithi186 ceph-mon[126480]: pgmap v18069: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 617 KiB/s rd, 659 KiB/s wr, 13 op/s 2023-05-08T13:07:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:21 smithi186 ceph-mon[126480]: osdmap e1206: 12 total, 12 up, 12 in 2023-05-08T13:07:22.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:21 smithi133 ceph-mon[125939]: pgmap v18069: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 617 KiB/s rd, 659 KiB/s wr, 13 op/s 2023-05-08T13:07:22.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:21 smithi133 ceph-mon[125939]: osdmap e1206: 12 total, 12 up, 12 in 2023-05-08T13:07:23.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:23 smithi186 ceph-mon[126480]: pgmap v18071: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 533 KiB/s rd, 585 KiB/s wr, 12 op/s 2023-05-08T13:07:23.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:23 smithi133 ceph-mon[125939]: pgmap v18071: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 533 KiB/s rd, 585 KiB/s wr, 12 op/s 2023-05-08T13:07:23.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:23 smithi096 ceph-mon[124666]: pgmap v18071: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 533 KiB/s rd, 585 KiB/s wr, 12 op/s 2023-05-08T13:07:25.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33783.341958 secs 2023-05-08T13:07:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:25 smithi133 ceph-mon[125939]: pgmap v18072: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 667 KiB/s rd, 718 KiB/s wr, 12 op/s 2023-05-08T13:07:25.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33783.341958 secs 2023-05-08T13:07:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:25 smithi096 ceph-mon[124666]: pgmap v18072: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 667 KiB/s rd, 718 KiB/s wr, 12 op/s 2023-05-08T13:07:25.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33783.341958 secs 2023-05-08T13:07:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:25 smithi186 ceph-mon[126480]: pgmap v18072: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 667 KiB/s rd, 718 KiB/s wr, 12 op/s 2023-05-08T13:07:28.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:27 smithi133 ceph-mon[125939]: pgmap v18073: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 420 KiB/s wr, 10 op/s 2023-05-08T13:07:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:27 smithi133 ceph-mon[125939]: osdmap e1207: 12 total, 12 up, 12 in 2023-05-08T13:07:28.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:27 smithi096 ceph-mon[124666]: pgmap v18073: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 420 KiB/s wr, 10 op/s 2023-05-08T13:07:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:27 smithi096 ceph-mon[124666]: osdmap e1207: 12 total, 12 up, 12 in 2023-05-08T13:07:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:27 smithi186 ceph-mon[126480]: pgmap v18073: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 420 KiB/s wr, 10 op/s 2023-05-08T13:07:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:27 smithi186 ceph-mon[126480]: osdmap e1207: 12 total, 12 up, 12 in 2023-05-08T13:07:29.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:28 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:07:29.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:28 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:07:29.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:28 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:07:29.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:28 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:07:29.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:28 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:07:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:28 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:07:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:28 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:07:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:28 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:07:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:28 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:07:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:28 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:07:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:28 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:07:29.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:28 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:07:30.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:29 smithi133 ceph-mon[125939]: pgmap v18075: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 520 KiB/s rd, 483 KiB/s wr, 6 op/s 2023-05-08T13:07:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33788.342061 secs 2023-05-08T13:07:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:29 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:07:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:29 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T13:07:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:29 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T13:07:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:29 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:07:30.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:29 smithi096 ceph-mon[124666]: pgmap v18075: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 520 KiB/s rd, 483 KiB/s wr, 6 op/s 2023-05-08T13:07:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33788.342061 secs 2023-05-08T13:07:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:29 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:07:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:29 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T13:07:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:29 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T13:07:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:29 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:07:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:29 smithi186 ceph-mon[126480]: pgmap v18075: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 520 KiB/s rd, 483 KiB/s wr, 6 op/s 2023-05-08T13:07:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33788.342061 secs 2023-05-08T13:07:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:29 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:07:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:29 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T13:07:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:29 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T13:07:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:29 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:07:31.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33790.188474 secs 2023-05-08T13:07:31.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33790.188474 secs 2023-05-08T13:07:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33790.188474 secs 2023-05-08T13:07:32.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:31 smithi133 ceph-mon[125939]: pgmap v18076: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 456 KiB/s rd, 453 KiB/s wr, 10 op/s 2023-05-08T13:07:32.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:31 smithi096 ceph-mon[124666]: pgmap v18076: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 456 KiB/s rd, 453 KiB/s wr, 10 op/s 2023-05-08T13:07:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:31 smithi186 ceph-mon[126480]: pgmap v18076: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 456 KiB/s rd, 453 KiB/s wr, 10 op/s 2023-05-08T13:07:33.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:33 smithi186 ceph-mon[126480]: pgmap v18077: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 414 KiB/s wr, 9 op/s 2023-05-08T13:07:33.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:33 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:07:33.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:33 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:07:33.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:33 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:07:33.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:33 smithi133 ceph-mon[125939]: pgmap v18077: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 414 KiB/s wr, 9 op/s 2023-05-08T13:07:33.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:33 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:07:33.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:33 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:07:33.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:33 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:07:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:33 smithi096 ceph-mon[124666]: pgmap v18077: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 414 KiB/s wr, 9 op/s 2023-05-08T13:07:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:33 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:07:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:33 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:07:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:33 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:07:35.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33793.342214 secs 2023-05-08T13:07:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:35 smithi133 ceph-mon[125939]: pgmap v18078: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 619 KiB/s rd, 616 KiB/s wr, 10 op/s 2023-05-08T13:07:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33793.896580 secs 2023-05-08T13:07:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33793.342214 secs 2023-05-08T13:07:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:35 smithi096 ceph-mon[124666]: pgmap v18078: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 619 KiB/s rd, 616 KiB/s wr, 10 op/s 2023-05-08T13:07:35.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33793.896580 secs 2023-05-08T13:07:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33793.342214 secs 2023-05-08T13:07:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:35 smithi186 ceph-mon[126480]: pgmap v18078: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 619 KiB/s rd, 616 KiB/s wr, 10 op/s 2023-05-08T13:07:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33793.896580 secs 2023-05-08T13:07:36.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33795.188592 secs 2023-05-08T13:07:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33795.188592 secs 2023-05-08T13:07:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33795.188592 secs 2023-05-08T13:07:38.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:37 smithi133 ceph-mon[125939]: pgmap v18079: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 537 KiB/s rd, 536 KiB/s wr, 10 op/s 2023-05-08T13:07:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:37 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:07:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:37 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:07:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:37 smithi096 ceph-mon[124666]: pgmap v18079: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 537 KiB/s rd, 536 KiB/s wr, 10 op/s 2023-05-08T13:07:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:37 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:07:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:37 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:07:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:37 smithi186 ceph-mon[126480]: pgmap v18079: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 537 KiB/s rd, 536 KiB/s wr, 10 op/s 2023-05-08T13:07:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:37 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:07:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:37 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:07:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:39 smithi133 ceph-mon[125939]: pgmap v18080: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 479 KiB/s wr, 9 op/s 2023-05-08T13:07:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33798.342276 secs 2023-05-08T13:07:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33798.896696 secs 2023-05-08T13:07:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:39 smithi096 ceph-mon[124666]: pgmap v18080: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 479 KiB/s wr, 9 op/s 2023-05-08T13:07:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33798.342276 secs 2023-05-08T13:07:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33798.896696 secs 2023-05-08T13:07:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:39 smithi186 ceph-mon[126480]: pgmap v18080: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 479 KiB/s wr, 9 op/s 2023-05-08T13:07:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33798.342276 secs 2023-05-08T13:07:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33798.896696 secs 2023-05-08T13:07:41.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33800.188684 secs 2023-05-08T13:07:41.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33800.188684 secs 2023-05-08T13:07:41.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33800.188684 secs 2023-05-08T13:07:42.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:41 smithi133 ceph-mon[125939]: pgmap v18081: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 867 KiB/s rd, 1.0 MiB/s wr, 13 op/s 2023-05-08T13:07:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:41 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:07:42.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:41 smithi096 ceph-mon[124666]: pgmap v18081: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 867 KiB/s rd, 1.0 MiB/s wr, 13 op/s 2023-05-08T13:07:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:41 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:07:42.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:41 smithi186 ceph-mon[126480]: pgmap v18081: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 867 KiB/s rd, 1.0 MiB/s wr, 13 op/s 2023-05-08T13:07:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:41 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:07:44.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:43 smithi133 ceph-mon[125939]: pgmap v18082: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 865 KiB/s rd, 1.0 MiB/s wr, 9 op/s 2023-05-08T13:07:44.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:43 smithi096 ceph-mon[124666]: pgmap v18082: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 865 KiB/s rd, 1.0 MiB/s wr, 9 op/s 2023-05-08T13:07:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:43 smithi186 ceph-mon[126480]: pgmap v18082: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 865 KiB/s rd, 1.0 MiB/s wr, 9 op/s 2023-05-08T13:07:45.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33803.342385 secs 2023-05-08T13:07:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33803.896796 secs 2023-05-08T13:07:45.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33803.342385 secs 2023-05-08T13:07:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33803.896796 secs 2023-05-08T13:07:45.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33803.342385 secs 2023-05-08T13:07:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33803.896796 secs 2023-05-08T13:07:46.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:45 smithi133 ceph-mon[125939]: pgmap v18083: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 866 KiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T13:07:46.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:45 smithi096 ceph-mon[124666]: pgmap v18083: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 866 KiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T13:07:46.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:45 smithi186 ceph-mon[126480]: pgmap v18083: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 866 KiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T13:07:48.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:47 smithi133 ceph-mon[125939]: pgmap v18084: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 739 KiB/s rd, 714 KiB/s wr, 10 op/s 2023-05-08T13:07:48.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:47 smithi096 ceph-mon[124666]: pgmap v18084: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 739 KiB/s rd, 714 KiB/s wr, 10 op/s 2023-05-08T13:07:48.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:47 smithi186 ceph-mon[126480]: pgmap v18084: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 739 KiB/s rd, 714 KiB/s wr, 10 op/s 2023-05-08T13:07:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:07:49.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:07:49.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:07:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:49 smithi096 ceph-mon[124666]: pgmap v18085: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 716 KiB/s rd, 714 KiB/s wr, 8 op/s 2023-05-08T13:07:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33808.342466 secs 2023-05-08T13:07:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:07:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:07:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:07:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33808.896915 secs 2023-05-08T13:07:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:49 smithi186 ceph-mon[126480]: pgmap v18085: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 716 KiB/s rd, 714 KiB/s wr, 8 op/s 2023-05-08T13:07:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33808.342466 secs 2023-05-08T13:07:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:07:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:07:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:07:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33808.896915 secs 2023-05-08T13:07:50.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:49 smithi133 ceph-mon[125939]: pgmap v18085: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 716 KiB/s rd, 714 KiB/s wr, 8 op/s 2023-05-08T13:07:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33808.342466 secs 2023-05-08T13:07:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:07:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:07:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:07:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33808.896915 secs 2023-05-08T13:07:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:51 smithi096 ceph-mon[124666]: pgmap v18086: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T13:07:52.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:51 smithi186 ceph-mon[126480]: pgmap v18086: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T13:07:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:51 smithi133 ceph-mon[125939]: pgmap v18086: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T13:07:54.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:53 smithi096 ceph-mon[124666]: pgmap v18087: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 697 KiB/s rd, 486 KiB/s wr, 8 op/s 2023-05-08T13:07:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:53 smithi186 ceph-mon[126480]: pgmap v18087: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 697 KiB/s rd, 486 KiB/s wr, 8 op/s 2023-05-08T13:07:54.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:53 smithi133 ceph-mon[125939]: pgmap v18087: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 697 KiB/s rd, 486 KiB/s wr, 8 op/s 2023-05-08T13:07:55.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33813.342583 secs 2023-05-08T13:07:55.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33813.342583 secs 2023-05-08T13:07:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33813.342583 secs 2023-05-08T13:07:56.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:56 smithi186 ceph-mon[126480]: pgmap v18088: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 709 KiB/s rd, 486 KiB/s wr, 9 op/s 2023-05-08T13:07:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:56 smithi133 ceph-mon[125939]: pgmap v18088: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 709 KiB/s rd, 486 KiB/s wr, 9 op/s 2023-05-08T13:07:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:56 smithi096 ceph-mon[124666]: pgmap v18088: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 709 KiB/s rd, 486 KiB/s wr, 9 op/s 2023-05-08T13:07:57.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:57 smithi186 ceph-mon[126480]: pgmap v18089: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 13 op/s 2023-05-08T13:07:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:07:57.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:57 smithi133 ceph-mon[125939]: pgmap v18089: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 13 op/s 2023-05-08T13:07:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:07:57.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:57 smithi096 ceph-mon[124666]: pgmap v18089: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 13 op/s 2023-05-08T13:07:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:07:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:58 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:07:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:07:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:07:58.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:58 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:07:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:07:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:07:58.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:58 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:07:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:07:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:07:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:07:59 smithi186 ceph-mon[126480]: pgmap v18090: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 10 op/s 2023-05-08T13:07:59.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:07:59 smithi133 ceph-mon[125939]: pgmap v18090: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 10 op/s 2023-05-08T13:07:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:07:59 smithi096 ceph-mon[124666]: pgmap v18090: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 10 op/s 2023-05-08T13:08:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33818.342693 secs 2023-05-08T13:08:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33818.897149 secs 2023-05-08T13:08:00.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33818.342693 secs 2023-05-08T13:08:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33818.897149 secs 2023-05-08T13:08:00.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33818.342693 secs 2023-05-08T13:08:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33818.897149 secs 2023-05-08T13:08:01.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:01 smithi186 ceph-mon[126480]: pgmap v18091: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 16 op/s 2023-05-08T13:08:01.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:01 smithi133 ceph-mon[125939]: pgmap v18091: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 16 op/s 2023-05-08T13:08:01.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:01 smithi096 ceph-mon[124666]: pgmap v18091: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 16 op/s 2023-05-08T13:08:02.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:08:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:08:02.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:08:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:08:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:08:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:08:03.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:03 smithi186 ceph-mon[126480]: pgmap v18092: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 12 op/s 2023-05-08T13:08:03.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:03 smithi133 ceph-mon[125939]: pgmap v18092: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 12 op/s 2023-05-08T13:08:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:03 smithi096 ceph-mon[124666]: pgmap v18092: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 12 op/s 2023-05-08T13:08:05.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33823.342862 secs 2023-05-08T13:08:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:05 smithi133 ceph-mon[125939]: pgmap v18093: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 14 op/s 2023-05-08T13:08:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33823.897260 secs 2023-05-08T13:08:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33823.342862 secs 2023-05-08T13:08:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:05 smithi096 ceph-mon[124666]: pgmap v18093: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 14 op/s 2023-05-08T13:08:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33823.897260 secs 2023-05-08T13:08:05.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33823.342862 secs 2023-05-08T13:08:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:05 smithi186 ceph-mon[126480]: pgmap v18093: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 14 op/s 2023-05-08T13:08:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33823.897260 secs 2023-05-08T13:08:07.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:07 smithi133 ceph-mon[125939]: pgmap v18094: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 16 op/s 2023-05-08T13:08:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:07 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:08:07.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:07 smithi096 ceph-mon[124666]: pgmap v18094: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 16 op/s 2023-05-08T13:08:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:07 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:08:07.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:07 smithi186 ceph-mon[126480]: pgmap v18094: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 16 op/s 2023-05-08T13:08:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:07 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:08:09.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:09 smithi133 ceph-mon[125939]: pgmap v18095: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 928 KiB/s rd, 926 KiB/s wr, 11 op/s 2023-05-08T13:08:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:09 smithi096 ceph-mon[124666]: pgmap v18095: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 928 KiB/s rd, 926 KiB/s wr, 11 op/s 2023-05-08T13:08:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:09 smithi186 ceph-mon[126480]: pgmap v18095: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 928 KiB/s rd, 926 KiB/s wr, 11 op/s 2023-05-08T13:08:10.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33828.343026 secs 2023-05-08T13:08:10.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33828.343026 secs 2023-05-08T13:08:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33828.343026 secs 2023-05-08T13:08:11.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:11 smithi133 ceph-mon[125939]: pgmap v18096: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 27 op/s 2023-05-08T13:08:11.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:11 smithi096 ceph-mon[124666]: pgmap v18096: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 27 op/s 2023-05-08T13:08:11.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:11 smithi186 ceph-mon[126480]: pgmap v18096: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 27 op/s 2023-05-08T13:08:13.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:12 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:08:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:12 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:08:13.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:12 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:08:14.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:13 smithi133 ceph-mon[125939]: pgmap v18097: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 473 KiB/s wr, 20 op/s 2023-05-08T13:08:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:13 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:08:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:08:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:13 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:08:14.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:13 smithi096 ceph-mon[124666]: pgmap v18097: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 473 KiB/s wr, 20 op/s 2023-05-08T13:08:14.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:13 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:08:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:08:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:13 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:08:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:13 smithi186 ceph-mon[126480]: pgmap v18097: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 473 KiB/s wr, 20 op/s 2023-05-08T13:08:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:13 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:08:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:08:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:13 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:08:15.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33833.343137 secs 2023-05-08T13:08:15.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33833.343137 secs 2023-05-08T13:08:15.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33833.343137 secs 2023-05-08T13:08:16.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:15 smithi133 ceph-mon[125939]: pgmap v18098: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 473 KiB/s wr, 21 op/s 2023-05-08T13:08:16.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:15 smithi096 ceph-mon[124666]: pgmap v18098: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 473 KiB/s wr, 21 op/s 2023-05-08T13:08:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:15 smithi186 ceph-mon[126480]: pgmap v18098: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 473 KiB/s wr, 21 op/s 2023-05-08T13:08:18.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:17 smithi133 ceph-mon[125939]: pgmap v18099: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 508 KiB/s rd, 521 KiB/s wr, 22 op/s 2023-05-08T13:08:18.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:17 smithi096 ceph-mon[124666]: pgmap v18099: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 508 KiB/s rd, 521 KiB/s wr, 22 op/s 2023-05-08T13:08:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:17 smithi186 ceph-mon[126480]: pgmap v18099: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 508 KiB/s rd, 521 KiB/s wr, 22 op/s 2023-05-08T13:08:20.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:19 smithi133 ceph-mon[125939]: pgmap v18100: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 520 KiB/s wr, 19 op/s 2023-05-08T13:08:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33838.343295 secs 2023-05-08T13:08:20.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:19 smithi096 ceph-mon[124666]: pgmap v18100: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 520 KiB/s wr, 19 op/s 2023-05-08T13:08:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33838.343295 secs 2023-05-08T13:08:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:19 smithi186 ceph-mon[126480]: pgmap v18100: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 520 KiB/s wr, 19 op/s 2023-05-08T13:08:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33838.343295 secs 2023-05-08T13:08:22.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:21 smithi133 ceph-mon[125939]: pgmap v18101: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 813 KiB/s rd, 826 KiB/s wr, 23 op/s 2023-05-08T13:08:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:21 smithi096 ceph-mon[124666]: pgmap v18101: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 813 KiB/s rd, 826 KiB/s wr, 23 op/s 2023-05-08T13:08:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:21 smithi186 ceph-mon[126480]: pgmap v18101: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 813 KiB/s rd, 826 KiB/s wr, 23 op/s 2023-05-08T13:08:24.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:23 smithi096 ceph-mon[124666]: pgmap v18102: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 492 KiB/s rd, 490 KiB/s wr, 8 op/s 2023-05-08T13:08:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:23 smithi186 ceph-mon[126480]: pgmap v18102: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 492 KiB/s rd, 490 KiB/s wr, 8 op/s 2023-05-08T13:08:24.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:23 smithi133 ceph-mon[125939]: pgmap v18102: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 492 KiB/s rd, 490 KiB/s wr, 8 op/s 2023-05-08T13:08:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33843.343461 secs 2023-05-08T13:08:25.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33843.343461 secs 2023-05-08T13:08:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33843.343461 secs 2023-05-08T13:08:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:25 smithi096 ceph-mon[124666]: pgmap v18103: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 490 KiB/s wr, 10 op/s 2023-05-08T13:08:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:25 smithi186 ceph-mon[126480]: pgmap v18103: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 490 KiB/s wr, 10 op/s 2023-05-08T13:08:26.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:25 smithi133 ceph-mon[125939]: pgmap v18103: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 490 KiB/s wr, 10 op/s 2023-05-08T13:08:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:28 smithi096 ceph-mon[124666]: pgmap v18104: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 503 KiB/s rd, 500 KiB/s wr, 11 op/s 2023-05-08T13:08:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:28 smithi186 ceph-mon[126480]: pgmap v18104: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 503 KiB/s rd, 500 KiB/s wr, 11 op/s 2023-05-08T13:08:28.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:28 smithi133 ceph-mon[125939]: pgmap v18104: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 503 KiB/s rd, 500 KiB/s wr, 11 op/s 2023-05-08T13:08:29.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:29 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:08:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:29 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:08:29.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:29 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:08:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:30 smithi186 ceph-mon[126480]: pgmap v18105: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 316 KiB/s wr, 8 op/s 2023-05-08T13:08:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33848.343573 secs 2023-05-08T13:08:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33848.897828 secs 2023-05-08T13:08:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:08:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:08:30.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:08:30.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:08:30.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:08:30.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:08:30.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:08:30.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:08:30.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:08:30.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:30 smithi133 ceph-mon[125939]: pgmap v18105: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 316 KiB/s wr, 8 op/s 2023-05-08T13:08:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33848.343573 secs 2023-05-08T13:08:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33848.897828 secs 2023-05-08T13:08:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:08:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:08:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:08:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:08:30.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:08:30.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:08:30.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:08:30.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:08:30.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:08:30.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:30 smithi096 ceph-mon[124666]: pgmap v18105: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 316 KiB/s wr, 8 op/s 2023-05-08T13:08:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33848.343573 secs 2023-05-08T13:08:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33848.897828 secs 2023-05-08T13:08:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:08:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:08:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:08:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:08:30.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:08:30.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:08:30.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:08:30.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:08:30.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:08:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:31 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:08:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:31 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T13:08:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:31 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T13:08:31.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:31 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:08:31.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:31 smithi186 ceph-mon[126480]: pgmap v18106: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 816 KiB/s rd, 835 KiB/s wr, 15 op/s 2023-05-08T13:08:31.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33850.189907 secs 2023-05-08T13:08:31.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:31 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:08:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:31 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T13:08:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:31 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T13:08:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:31 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:08:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:31 smithi133 ceph-mon[125939]: pgmap v18106: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 816 KiB/s rd, 835 KiB/s wr, 15 op/s 2023-05-08T13:08:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33850.189907 secs 2023-05-08T13:08:31.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:31 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:08:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:31 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T13:08:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:31 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T13:08:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:31 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:08:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:31 smithi096 ceph-mon[124666]: pgmap v18106: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 816 KiB/s rd, 835 KiB/s wr, 15 op/s 2023-05-08T13:08:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33850.189907 secs 2023-05-08T13:08:33.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:33 smithi186 ceph-mon[126480]: pgmap v18107: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 509 KiB/s rd, 530 KiB/s wr, 11 op/s 2023-05-08T13:08:33.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:33 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:08:33.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:33 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:08:33.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:33 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:08:33.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:33 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:08:33.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:33 smithi133 ceph-mon[125939]: pgmap v18107: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 509 KiB/s rd, 530 KiB/s wr, 11 op/s 2023-05-08T13:08:33.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:33 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:08:33.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:33 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:08:33.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:33 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:08:33.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:33 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:08:33.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:33 smithi096 ceph-mon[124666]: pgmap v18107: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 509 KiB/s rd, 530 KiB/s wr, 11 op/s 2023-05-08T13:08:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:33 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:08:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:33 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:08:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:33 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:08:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:33 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:08:35.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33853.343730 secs 2023-05-08T13:08:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:35 smithi133 ceph-mon[125939]: pgmap v18108: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 510 KiB/s rd, 530 KiB/s wr, 12 op/s 2023-05-08T13:08:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33853.897919 secs 2023-05-08T13:08:35.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33853.343730 secs 2023-05-08T13:08:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:35 smithi096 ceph-mon[124666]: pgmap v18108: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 510 KiB/s rd, 530 KiB/s wr, 12 op/s 2023-05-08T13:08:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33853.897919 secs 2023-05-08T13:08:35.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33853.343730 secs 2023-05-08T13:08:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:35 smithi186 ceph-mon[126480]: pgmap v18108: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 510 KiB/s rd, 530 KiB/s wr, 12 op/s 2023-05-08T13:08:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33853.897919 secs 2023-05-08T13:08:36.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33855.190007 secs 2023-05-08T13:08:36.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33855.190007 secs 2023-05-08T13:08:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33855.190007 secs 2023-05-08T13:08:37.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:37 smithi133 ceph-mon[125939]: pgmap v18109: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 510 KiB/s rd, 530 KiB/s wr, 13 op/s 2023-05-08T13:08:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:37 smithi133 ceph-mon[125939]: osdmap e1208: 12 total, 12 up, 12 in 2023-05-08T13:08:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:37 smithi096 ceph-mon[124666]: pgmap v18109: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 510 KiB/s rd, 530 KiB/s wr, 13 op/s 2023-05-08T13:08:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:37 smithi096 ceph-mon[124666]: osdmap e1208: 12 total, 12 up, 12 in 2023-05-08T13:08:37.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:37 smithi186 ceph-mon[126480]: pgmap v18109: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 510 KiB/s rd, 530 KiB/s wr, 13 op/s 2023-05-08T13:08:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:37 smithi186 ceph-mon[126480]: osdmap e1208: 12 total, 12 up, 12 in 2023-05-08T13:08:39.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:39 smithi133 ceph-mon[125939]: pgmap v18111: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 624 KiB/s wr, 13 op/s 2023-05-08T13:08:39.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:39 smithi096 ceph-mon[124666]: pgmap v18111: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 624 KiB/s wr, 13 op/s 2023-05-08T13:08:39.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:39 smithi186 ceph-mon[126480]: pgmap v18111: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 624 KiB/s wr, 13 op/s 2023-05-08T13:08:40.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33858.343852 secs 2023-05-08T13:08:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33858.898044 secs 2023-05-08T13:08:40.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33858.343852 secs 2023-05-08T13:08:40.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33858.898044 secs 2023-05-08T13:08:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33858.343852 secs 2023-05-08T13:08:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33858.898044 secs 2023-05-08T13:08:41.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:41 smithi133 ceph-mon[125939]: pgmap v18112: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 540 KiB/s rd, 537 KiB/s wr, 9 op/s 2023-05-08T13:08:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33860.190134 secs 2023-05-08T13:08:41.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:41 smithi096 ceph-mon[124666]: pgmap v18112: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 540 KiB/s rd, 537 KiB/s wr, 9 op/s 2023-05-08T13:08:41.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33860.190134 secs 2023-05-08T13:08:41.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:41 smithi186 ceph-mon[126480]: pgmap v18112: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 540 KiB/s rd, 537 KiB/s wr, 9 op/s 2023-05-08T13:08:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33860.190134 secs 2023-05-08T13:08:44.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:43 smithi133 ceph-mon[125939]: pgmap v18113: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 540 KiB/s rd, 537 KiB/s wr, 9 op/s 2023-05-08T13:08:44.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:43 smithi096 ceph-mon[124666]: pgmap v18113: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 540 KiB/s rd, 537 KiB/s wr, 9 op/s 2023-05-08T13:08:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:43 smithi186 ceph-mon[126480]: pgmap v18113: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 540 KiB/s rd, 537 KiB/s wr, 9 op/s 2023-05-08T13:08:45.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33863.343981 secs 2023-05-08T13:08:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33863.898157 secs 2023-05-08T13:08:45.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33863.343981 secs 2023-05-08T13:08:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33863.898157 secs 2023-05-08T13:08:45.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33863.343981 secs 2023-05-08T13:08:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33863.898157 secs 2023-05-08T13:08:46.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:45 smithi096 ceph-mon[124666]: pgmap v18114: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 540 KiB/s rd, 537 KiB/s wr, 8 op/s 2023-05-08T13:08:46.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:45 smithi186 ceph-mon[126480]: pgmap v18114: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 540 KiB/s rd, 537 KiB/s wr, 8 op/s 2023-05-08T13:08:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:45 smithi133 ceph-mon[125939]: pgmap v18114: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 540 KiB/s rd, 537 KiB/s wr, 8 op/s 2023-05-08T13:08:48.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:47 smithi133 ceph-mon[125939]: pgmap v18115: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 703 KiB/s rd, 700 KiB/s wr, 9 op/s 2023-05-08T13:08:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:47 smithi133 ceph-mon[125939]: osdmap e1209: 12 total, 12 up, 12 in 2023-05-08T13:08:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:47 smithi096 ceph-mon[124666]: pgmap v18115: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 703 KiB/s rd, 700 KiB/s wr, 9 op/s 2023-05-08T13:08:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:47 smithi096 ceph-mon[124666]: osdmap e1209: 12 total, 12 up, 12 in 2023-05-08T13:08:48.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:47 smithi186 ceph-mon[126480]: pgmap v18115: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 703 KiB/s rd, 700 KiB/s wr, 9 op/s 2023-05-08T13:08:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:47 smithi186 ceph-mon[126480]: osdmap e1209: 12 total, 12 up, 12 in 2023-05-08T13:08:49.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:08:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:08:49.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:08:50.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:49 smithi133 ceph-mon[125939]: pgmap v18117: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 703 KiB/s rd, 700 KiB/s wr, 9 op/s 2023-05-08T13:08:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33868.344121 secs 2023-05-08T13:08:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:08:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:08:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:08:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33868.898280 secs 2023-05-08T13:08:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:49 smithi096 ceph-mon[124666]: pgmap v18117: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 703 KiB/s rd, 700 KiB/s wr, 9 op/s 2023-05-08T13:08:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33868.344121 secs 2023-05-08T13:08:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:08:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:08:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:08:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33868.898280 secs 2023-05-08T13:08:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:49 smithi186 ceph-mon[126480]: pgmap v18117: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 703 KiB/s rd, 700 KiB/s wr, 9 op/s 2023-05-08T13:08:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33868.344121 secs 2023-05-08T13:08:50.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:08:50.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:08:50.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:08:50.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33868.898280 secs 2023-05-08T13:08:52.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:51 smithi133 ceph-mon[125939]: pgmap v18118: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 839 KiB/s rd, 474 KiB/s wr, 8 op/s 2023-05-08T13:08:52.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:51 smithi096 ceph-mon[124666]: pgmap v18118: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 839 KiB/s rd, 474 KiB/s wr, 8 op/s 2023-05-08T13:08:52.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:51 smithi186 ceph-mon[126480]: pgmap v18118: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 839 KiB/s rd, 474 KiB/s wr, 8 op/s 2023-05-08T13:08:54.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:53 smithi133 ceph-mon[125939]: pgmap v18119: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 839 KiB/s rd, 474 KiB/s wr, 8 op/s 2023-05-08T13:08:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:53 smithi096 ceph-mon[124666]: pgmap v18119: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 839 KiB/s rd, 474 KiB/s wr, 8 op/s 2023-05-08T13:08:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:53 smithi186 ceph-mon[126480]: pgmap v18119: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 839 KiB/s rd, 474 KiB/s wr, 8 op/s 2023-05-08T13:08:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33873.344272 secs 2023-05-08T13:08:55.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33873.344272 secs 2023-05-08T13:08:55.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33873.344272 secs 2023-05-08T13:08:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:55 smithi096 ceph-mon[124666]: pgmap v18120: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 839 KiB/s rd, 474 KiB/s wr, 8 op/s 2023-05-08T13:08:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:56 smithi186 ceph-mon[126480]: pgmap v18120: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 839 KiB/s rd, 474 KiB/s wr, 8 op/s 2023-05-08T13:08:56.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:56 smithi133 ceph-mon[125939]: pgmap v18120: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 839 KiB/s rd, 474 KiB/s wr, 8 op/s 2023-05-08T13:08:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:08:57.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:08:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:08:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:58 smithi186 ceph-mon[126480]: pgmap v18121: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 752 KiB/s wr, 9 op/s 2023-05-08T13:08:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:58 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:08:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:08:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:08:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:08:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:58 smithi133 ceph-mon[125939]: pgmap v18121: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 752 KiB/s wr, 9 op/s 2023-05-08T13:08:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:58 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:08:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:08:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:08:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:08:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:58 smithi096 ceph-mon[124666]: pgmap v18121: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 752 KiB/s wr, 9 op/s 2023-05-08T13:08:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:58 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:08:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:08:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:08:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:09:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:00 smithi186 ceph-mon[126480]: pgmap v18122: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 672 KiB/s wr, 8 op/s 2023-05-08T13:09:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33878.344354 secs 2023-05-08T13:09:00.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:00 smithi133 ceph-mon[125939]: pgmap v18122: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 672 KiB/s wr, 8 op/s 2023-05-08T13:09:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33878.344354 secs 2023-05-08T13:09:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:00 smithi096 ceph-mon[124666]: pgmap v18122: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 672 KiB/s wr, 8 op/s 2023-05-08T13:09:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33878.344354 secs 2023-05-08T13:09:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:01 smithi186 ceph-mon[126480]: pgmap v18123: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2023-05-08T13:09:01.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:01 smithi133 ceph-mon[125939]: pgmap v18123: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2023-05-08T13:09:01.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:01 smithi096 ceph-mon[124666]: pgmap v18123: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2023-05-08T13:09:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:03 smithi133 ceph-mon[125939]: pgmap v18124: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1018 KiB/s wr, 10 op/s 2023-05-08T13:09:04.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:03 smithi096 ceph-mon[124666]: pgmap v18124: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1018 KiB/s wr, 10 op/s 2023-05-08T13:09:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:03 smithi186 ceph-mon[126480]: pgmap v18124: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1018 KiB/s wr, 10 op/s 2023-05-08T13:09:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33883.344457 secs 2023-05-08T13:09:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33883.898596 secs 2023-05-08T13:09:05.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33883.344457 secs 2023-05-08T13:09:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33883.898596 secs 2023-05-08T13:09:05.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33883.344457 secs 2023-05-08T13:09:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33883.898596 secs 2023-05-08T13:09:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:05 smithi096 ceph-mon[124666]: pgmap v18125: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1018 KiB/s wr, 12 op/s 2023-05-08T13:09:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:05 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:09:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:09:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:09:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:05 smithi186 ceph-mon[126480]: pgmap v18125: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1018 KiB/s wr, 12 op/s 2023-05-08T13:09:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:05 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:09:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:09:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:09:06.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:05 smithi133 ceph-mon[125939]: pgmap v18125: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1018 KiB/s wr, 12 op/s 2023-05-08T13:09:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:05 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:09:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:09:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:09:08.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:07 smithi096 ceph-mon[124666]: pgmap v18126: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.4 MiB/s wr, 27 op/s 2023-05-08T13:09:08.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:07 smithi186 ceph-mon[126480]: pgmap v18126: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.4 MiB/s wr, 27 op/s 2023-05-08T13:09:08.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:07 smithi133 ceph-mon[125939]: pgmap v18126: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.4 MiB/s wr, 27 op/s 2023-05-08T13:09:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:10 smithi096 ceph-mon[124666]: pgmap v18127: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 24 op/s 2023-05-08T13:09:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33888.344570 secs 2023-05-08T13:09:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33888.898658 secs 2023-05-08T13:09:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:10 smithi186 ceph-mon[126480]: pgmap v18127: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 24 op/s 2023-05-08T13:09:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33888.344570 secs 2023-05-08T13:09:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33888.898658 secs 2023-05-08T13:09:10.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:10 smithi133 ceph-mon[125939]: pgmap v18127: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 24 op/s 2023-05-08T13:09:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33888.344570 secs 2023-05-08T13:09:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33888.898658 secs 2023-05-08T13:09:12.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:12 smithi096 ceph-mon[124666]: pgmap v18128: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 27 op/s 2023-05-08T13:09:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:12 smithi186 ceph-mon[126480]: pgmap v18128: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 27 op/s 2023-05-08T13:09:12.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:12 smithi133 ceph-mon[125939]: pgmap v18128: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 27 op/s 2023-05-08T13:09:14.284 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:14 smithi096 ceph-mon[124666]: pgmap v18129: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 416 KiB/s wr, 21 op/s 2023-05-08T13:09:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:14 smithi186 ceph-mon[126480]: pgmap v18129: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 416 KiB/s wr, 21 op/s 2023-05-08T13:09:14.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:14 smithi133 ceph-mon[125939]: pgmap v18129: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 416 KiB/s wr, 21 op/s 2023-05-08T13:09:15.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33893.344690 secs 2023-05-08T13:09:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33893.898741 secs 2023-05-08T13:09:15.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33893.344690 secs 2023-05-08T13:09:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33893.898741 secs 2023-05-08T13:09:15.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33893.344690 secs 2023-05-08T13:09:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33893.898741 secs 2023-05-08T13:09:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:16 smithi186 ceph-mon[126480]: pgmap v18130: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 404 KiB/s rd, 416 KiB/s wr, 21 op/s 2023-05-08T13:09:16.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:16 smithi133 ceph-mon[125939]: pgmap v18130: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 404 KiB/s rd, 416 KiB/s wr, 21 op/s 2023-05-08T13:09:16.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:16 smithi096 ceph-mon[124666]: pgmap v18130: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 404 KiB/s rd, 416 KiB/s wr, 21 op/s 2023-05-08T13:09:18.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:17 smithi133 ceph-mon[125939]: pgmap v18131: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 710 KiB/s rd, 723 KiB/s wr, 22 op/s 2023-05-08T13:09:18.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:17 smithi096 ceph-mon[124666]: pgmap v18131: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 710 KiB/s rd, 723 KiB/s wr, 22 op/s 2023-05-08T13:09:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:17 smithi186 ceph-mon[126480]: pgmap v18131: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 710 KiB/s rd, 723 KiB/s wr, 22 op/s 2023-05-08T13:09:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:19 smithi096 ceph-mon[124666]: pgmap v18132: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 311 KiB/s wr, 6 op/s 2023-05-08T13:09:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33898.344790 secs 2023-05-08T13:09:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33898.898823 secs 2023-05-08T13:09:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:19 smithi186 ceph-mon[126480]: pgmap v18132: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 311 KiB/s wr, 6 op/s 2023-05-08T13:09:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33898.344790 secs 2023-05-08T13:09:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33898.898823 secs 2023-05-08T13:09:20.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:19 smithi133 ceph-mon[125939]: pgmap v18132: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 311 KiB/s wr, 6 op/s 2023-05-08T13:09:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33898.344790 secs 2023-05-08T13:09:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33898.898823 secs 2023-05-08T13:09:22.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:21 smithi096 ceph-mon[124666]: pgmap v18133: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 312 KiB/s wr, 9 op/s 2023-05-08T13:09:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:21 smithi186 ceph-mon[126480]: pgmap v18133: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 312 KiB/s wr, 9 op/s 2023-05-08T13:09:22.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:21 smithi133 ceph-mon[125939]: pgmap v18133: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 312 KiB/s wr, 9 op/s 2023-05-08T13:09:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:23 smithi096 ceph-mon[124666]: pgmap v18134: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 307 KiB/s wr, 6 op/s 2023-05-08T13:09:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:23 smithi186 ceph-mon[126480]: pgmap v18134: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 307 KiB/s wr, 6 op/s 2023-05-08T13:09:24.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:23 smithi133 ceph-mon[125939]: pgmap v18134: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 307 KiB/s wr, 6 op/s 2023-05-08T13:09:25.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33903.344910 secs 2023-05-08T13:09:25.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:25 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:09:25.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33903.344910 secs 2023-05-08T13:09:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:25 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:09:25.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33903.344910 secs 2023-05-08T13:09:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:25 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:09:26.290 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:26 smithi096 ceph-mon[124666]: pgmap v18135: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 574 KiB/s rd, 571 KiB/s wr, 8 op/s 2023-05-08T13:09:26.290 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:26 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:09:26.290 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:26 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:09:26.290 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:26 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:09:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:26 smithi186 ceph-mon[126480]: pgmap v18135: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 574 KiB/s rd, 571 KiB/s wr, 8 op/s 2023-05-08T13:09:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:26 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:09:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:26 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:09:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:26 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:09:26.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:26 smithi133 ceph-mon[125939]: pgmap v18135: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 574 KiB/s rd, 571 KiB/s wr, 8 op/s 2023-05-08T13:09:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:26 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:09:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:26 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:09:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:26 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:09:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:28 smithi186 ceph-mon[126480]: pgmap v18136: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 661 KiB/s rd, 680 KiB/s wr, 12 op/s 2023-05-08T13:09:28.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:28 smithi133 ceph-mon[125939]: pgmap v18136: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 661 KiB/s rd, 680 KiB/s wr, 12 op/s 2023-05-08T13:09:28.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:28 smithi096 ceph-mon[124666]: pgmap v18136: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 661 KiB/s rd, 680 KiB/s wr, 12 op/s 2023-05-08T13:09:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:29 smithi186 ceph-mon[126480]: pgmap v18137: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 373 KiB/s wr, 10 op/s 2023-05-08T13:09:29.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:29 smithi133 ceph-mon[125939]: pgmap v18137: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 373 KiB/s wr, 10 op/s 2023-05-08T13:09:29.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:29 smithi096 ceph-mon[124666]: pgmap v18137: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 373 KiB/s wr, 10 op/s 2023-05-08T13:09:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33908.345050 secs 2023-05-08T13:09:30.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33908.345050 secs 2023-05-08T13:09:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33908.345050 secs 2023-05-08T13:09:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:31 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:09:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:31 smithi186 ceph-mon[126480]: pgmap v18138: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 402 KiB/s wr, 13 op/s 2023-05-08T13:09:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:31 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:09:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:31 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:09:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:31 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:09:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:31 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:09:31.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:31 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T13:09:31.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:31 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T13:09:31.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:31 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:09:31.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:31 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:09:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:31 smithi133 ceph-mon[125939]: pgmap v18138: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 402 KiB/s wr, 13 op/s 2023-05-08T13:09:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:31 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:09:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:31 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:09:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:31 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:09:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:31 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:09:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:31 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T13:09:31.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:31 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T13:09:31.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:31 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:09:31.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:31 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:09:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:31 smithi096 ceph-mon[124666]: pgmap v18138: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 402 KiB/s wr, 13 op/s 2023-05-08T13:09:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:31 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:09:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:31 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:09:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:31 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:09:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:31 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:09:31.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:31 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T13:09:31.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:31 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T13:09:31.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:31 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:09:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:32 smithi186 ceph-mon[126480]: osdmap e1210: 12 total, 12 up, 12 in 2023-05-08T13:09:32.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:32 smithi133 ceph-mon[125939]: osdmap e1210: 12 total, 12 up, 12 in 2023-05-08T13:09:32.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:32 smithi096 ceph-mon[124666]: osdmap e1210: 12 total, 12 up, 12 in 2023-05-08T13:09:33.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:33 smithi186 ceph-mon[126480]: pgmap v18140: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 481 KiB/s wr, 12 op/s 2023-05-08T13:09:33.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:33 smithi133 ceph-mon[125939]: pgmap v18140: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 481 KiB/s wr, 12 op/s 2023-05-08T13:09:33.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:33 smithi096 ceph-mon[124666]: pgmap v18140: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 481 KiB/s wr, 12 op/s 2023-05-08T13:09:35.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33913.345201 secs 2023-05-08T13:09:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:35 smithi133 ceph-mon[125939]: pgmap v18141: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 354 KiB/s wr, 12 op/s 2023-05-08T13:09:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33913.345201 secs 2023-05-08T13:09:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:35 smithi096 ceph-mon[124666]: pgmap v18141: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 354 KiB/s wr, 12 op/s 2023-05-08T13:09:35.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33913.345201 secs 2023-05-08T13:09:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:35 smithi186 ceph-mon[126480]: pgmap v18141: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 354 KiB/s wr, 12 op/s 2023-05-08T13:09:38.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:37 smithi096 ceph-mon[124666]: pgmap v18142: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 223 KiB/s wr, 8 op/s 2023-05-08T13:09:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:37 smithi096 ceph-mon[124666]: osdmap e1211: 12 total, 12 up, 12 in 2023-05-08T13:09:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:37 smithi186 ceph-mon[126480]: pgmap v18142: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 223 KiB/s wr, 8 op/s 2023-05-08T13:09:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:37 smithi186 ceph-mon[126480]: osdmap e1211: 12 total, 12 up, 12 in 2023-05-08T13:09:38.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:37 smithi133 ceph-mon[125939]: pgmap v18142: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 223 KiB/s wr, 8 op/s 2023-05-08T13:09:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:37 smithi133 ceph-mon[125939]: osdmap e1211: 12 total, 12 up, 12 in 2023-05-08T13:09:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:39 smithi096 ceph-mon[124666]: pgmap v18144: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 237 KiB/s wr, 5 op/s 2023-05-08T13:09:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33918.345324 secs 2023-05-08T13:09:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:39 smithi186 ceph-mon[126480]: pgmap v18144: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 237 KiB/s wr, 5 op/s 2023-05-08T13:09:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33918.345324 secs 2023-05-08T13:09:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:39 smithi133 ceph-mon[125939]: pgmap v18144: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 237 KiB/s wr, 5 op/s 2023-05-08T13:09:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33918.345324 secs 2023-05-08T13:09:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33920.191544 secs 2023-05-08T13:09:41.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33920.191544 secs 2023-05-08T13:09:41.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33920.191544 secs 2023-05-08T13:09:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:42 smithi096 ceph-mon[124666]: pgmap v18145: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 834 KiB/s rd, 578 KiB/s wr, 9 op/s 2023-05-08T13:09:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:42 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:09:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:42 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:09:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:42 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:09:42.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:42 smithi186 ceph-mon[126480]: pgmap v18145: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 834 KiB/s rd, 578 KiB/s wr, 9 op/s 2023-05-08T13:09:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:42 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:09:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:42 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:09:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:42 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:09:42.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:42 smithi133 ceph-mon[125939]: pgmap v18145: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 834 KiB/s rd, 578 KiB/s wr, 9 op/s 2023-05-08T13:09:42.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:42 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:09:42.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:42 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:09:42.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:42 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:09:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:44 smithi186 ceph-mon[126480]: pgmap v18146: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 936 KiB/s wr, 9 op/s 2023-05-08T13:09:44.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:44 smithi133 ceph-mon[125939]: pgmap v18146: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 936 KiB/s wr, 9 op/s 2023-05-08T13:09:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:44 smithi096 ceph-mon[124666]: pgmap v18146: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 936 KiB/s wr, 9 op/s 2023-05-08T13:09:45.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33923.345446 secs 2023-05-08T13:09:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33923.899455 secs 2023-05-08T13:09:45.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33923.345446 secs 2023-05-08T13:09:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33923.899455 secs 2023-05-08T13:09:45.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33923.345446 secs 2023-05-08T13:09:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33923.899455 secs 2023-05-08T13:09:46.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:46 smithi186 ceph-mon[126480]: pgmap v18147: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 747 KiB/s wr, 9 op/s 2023-05-08T13:09:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:46 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:09:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:46 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:09:46.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:46 smithi133 ceph-mon[125939]: pgmap v18147: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 747 KiB/s wr, 9 op/s 2023-05-08T13:09:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:46 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:09:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:46 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:09:46.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:46 smithi096 ceph-mon[124666]: pgmap v18147: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 747 KiB/s wr, 9 op/s 2023-05-08T13:09:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:46 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:09:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:46 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:09:47.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:47 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:09:47.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:47 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:09:47.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:47 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:09:48.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:48 smithi186 ceph-mon[126480]: pgmap v18148: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T13:09:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:48 smithi133 ceph-mon[125939]: pgmap v18148: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T13:09:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:48 smithi096 ceph-mon[124666]: pgmap v18148: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T13:09:49.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:49 smithi186 ceph-mon[126480]: pgmap v18149: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 9 op/s 2023-05-08T13:09:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:09:49.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:49 smithi133 ceph-mon[125939]: pgmap v18149: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 9 op/s 2023-05-08T13:09:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:09:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:49 smithi096 ceph-mon[124666]: pgmap v18149: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 9 op/s 2023-05-08T13:09:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:09:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33928.345520 secs 2023-05-08T13:09:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:09:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:09:50.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33928.345520 secs 2023-05-08T13:09:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:09:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:09:50.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33928.345520 secs 2023-05-08T13:09:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:09:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:09:51.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:51 smithi186 ceph-mon[126480]: pgmap v18150: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 14 op/s 2023-05-08T13:09:51.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:51 smithi133 ceph-mon[125939]: pgmap v18150: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 14 op/s 2023-05-08T13:09:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:51 smithi096 ceph-mon[124666]: pgmap v18150: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 14 op/s 2023-05-08T13:09:52.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:52 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:09:52.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:52 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:09:52.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:52 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:09:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:53 smithi186 ceph-mon[126480]: pgmap v18151: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 11 op/s 2023-05-08T13:09:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:53 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:09:53.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:53 smithi133 ceph-mon[125939]: pgmap v18151: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 11 op/s 2023-05-08T13:09:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:53 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:09:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:53 smithi096 ceph-mon[124666]: pgmap v18151: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 11 op/s 2023-05-08T13:09:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:53 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:09:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:54 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:09:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:54 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:09:54.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:54 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:09:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:54 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:09:54.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:54 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:09:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:54 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:09:55.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33933.345639 secs 2023-05-08T13:09:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:55 smithi186 ceph-mon[126480]: pgmap v18152: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 12 op/s 2023-05-08T13:09:55.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33933.345639 secs 2023-05-08T13:09:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:55 smithi133 ceph-mon[125939]: pgmap v18152: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 12 op/s 2023-05-08T13:09:55.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33933.345639 secs 2023-05-08T13:09:55.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:55 smithi096 ceph-mon[124666]: pgmap v18152: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 12 op/s 2023-05-08T13:09:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:57 smithi096 ceph-mon[124666]: pgmap v18153: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.7 MiB/s wr, 15 op/s 2023-05-08T13:09:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:57 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:09:57.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:57 smithi186 ceph-mon[126480]: pgmap v18153: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.7 MiB/s wr, 15 op/s 2023-05-08T13:09:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:57 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:09:57.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:57 smithi133 ceph-mon[125939]: pgmap v18153: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.7 MiB/s wr, 15 op/s 2023-05-08T13:09:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:57 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:09:59.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:09:59 smithi096 ceph-mon[124666]: pgmap v18154: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2023-05-08T13:09:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:09:59 smithi186 ceph-mon[126480]: pgmap v18154: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2023-05-08T13:09:59.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:09:59 smithi133 ceph-mon[125939]: pgmap v18154: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2023-05-08T13:10:00.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33938.345788 secs 2023-05-08T13:10:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33938.899741 secs 2023-05-08T13:10:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:00 smithi096 ceph-mon[124666]: Health detail: HEALTH_WARN 1 MDSs report slow requests 2023-05-08T13:10:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:00 smithi096 ceph-mon[124666]: [WRN] MDS_SLOW_REQUEST: 1 MDSs report slow requests 2023-05-08T13:10:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:00 smithi096 ceph-mon[124666]: mds.i(mds.1): 1 slow requests are blocked > 180 secs 2023-05-08T13:10:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33938.345788 secs 2023-05-08T13:10:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33938.899741 secs 2023-05-08T13:10:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:00 smithi186 ceph-mon[126480]: Health detail: HEALTH_WARN 1 MDSs report slow requests 2023-05-08T13:10:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:00 smithi186 ceph-mon[126480]: [WRN] MDS_SLOW_REQUEST: 1 MDSs report slow requests 2023-05-08T13:10:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:00 smithi186 ceph-mon[126480]: mds.i(mds.1): 1 slow requests are blocked > 180 secs 2023-05-08T13:10:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33938.345788 secs 2023-05-08T13:10:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33938.899741 secs 2023-05-08T13:10:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:00 smithi133 ceph-mon[125939]: Health detail: HEALTH_WARN 1 MDSs report slow requests 2023-05-08T13:10:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:00 smithi133 ceph-mon[125939]: [WRN] MDS_SLOW_REQUEST: 1 MDSs report slow requests 2023-05-08T13:10:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:00 smithi133 ceph-mon[125939]: mds.i(mds.1): 1 slow requests are blocked > 180 secs 2023-05-08T13:10:01.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:01 smithi186 ceph-mon[126480]: pgmap v18155: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 1.9 MiB/s wr, 17 op/s 2023-05-08T13:10:01.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:01 smithi133 ceph-mon[125939]: pgmap v18155: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 1.9 MiB/s wr, 17 op/s 2023-05-08T13:10:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:01 smithi096 ceph-mon[124666]: pgmap v18155: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 1.9 MiB/s wr, 17 op/s 2023-05-08T13:10:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:10:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:10:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:02 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:10:02.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:10:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:10:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:02 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:10:02.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:10:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:10:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:02 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:10:04.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:04 smithi096 ceph-mon[124666]: pgmap v18156: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1005 KiB/s wr, 12 op/s 2023-05-08T13:10:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:04 smithi186 ceph-mon[126480]: pgmap v18156: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1005 KiB/s wr, 12 op/s 2023-05-08T13:10:04.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:04 smithi133 ceph-mon[125939]: pgmap v18156: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1005 KiB/s wr, 12 op/s 2023-05-08T13:10:05.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33943.345907 secs 2023-05-08T13:10:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:05 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:10:05.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33943.345907 secs 2023-05-08T13:10:05.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:05 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:10:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33943.345907 secs 2023-05-08T13:10:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:05 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:10:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:06 smithi186 ceph-mon[126480]: pgmap v18157: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 823 KiB/s wr, 13 op/s 2023-05-08T13:10:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:10:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:10:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:06 smithi133 ceph-mon[125939]: pgmap v18157: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 823 KiB/s wr, 13 op/s 2023-05-08T13:10:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:10:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:10:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:06 smithi096 ceph-mon[124666]: pgmap v18157: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 823 KiB/s wr, 13 op/s 2023-05-08T13:10:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:10:06.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:10:07.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:07 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:10:07.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:07 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:10:07.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:07 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:10:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:08 smithi186 ceph-mon[126480]: pgmap v18158: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 26 op/s 2023-05-08T13:10:08.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:08 smithi133 ceph-mon[125939]: pgmap v18158: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 26 op/s 2023-05-08T13:10:08.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:08 smithi096 ceph-mon[124666]: pgmap v18158: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 26 op/s 2023-05-08T13:10:09.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:09 smithi186 ceph-mon[126480]: pgmap v18159: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.7 MiB/s wr, 22 op/s 2023-05-08T13:10:09.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:09 smithi133 ceph-mon[125939]: pgmap v18159: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.7 MiB/s wr, 22 op/s 2023-05-08T13:10:09.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:09 smithi096 ceph-mon[124666]: pgmap v18159: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.7 MiB/s wr, 22 op/s 2023-05-08T13:10:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33948.346042 secs 2023-05-08T13:10:10.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33948.346042 secs 2023-05-08T13:10:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33948.346042 secs 2023-05-08T13:10:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:11 smithi186 ceph-mon[126480]: pgmap v18160: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.0 MiB/s wr, 26 op/s 2023-05-08T13:10:11.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:11 smithi133 ceph-mon[125939]: pgmap v18160: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.0 MiB/s wr, 26 op/s 2023-05-08T13:10:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:11 smithi096 ceph-mon[124666]: pgmap v18160: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.0 MiB/s wr, 26 op/s 2023-05-08T13:10:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:14 smithi186 ceph-mon[126480]: pgmap v18161: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 21 op/s 2023-05-08T13:10:14.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:14 smithi133 ceph-mon[125939]: pgmap v18161: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 21 op/s 2023-05-08T13:10:14.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:14 smithi096 ceph-mon[124666]: pgmap v18161: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 21 op/s 2023-05-08T13:10:15.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33953.346165 secs 2023-05-08T13:10:15.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33953.346165 secs 2023-05-08T13:10:15.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33953.346165 secs 2023-05-08T13:10:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:16 smithi186 ceph-mon[126480]: pgmap v18162: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 22 op/s 2023-05-08T13:10:16.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:16 smithi133 ceph-mon[125939]: pgmap v18162: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 22 op/s 2023-05-08T13:10:16.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:16 smithi096 ceph-mon[124666]: pgmap v18162: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 22 op/s 2023-05-08T13:10:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:18 smithi186 ceph-mon[126480]: pgmap v18163: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 22 op/s 2023-05-08T13:10:18.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:18 smithi133 ceph-mon[125939]: pgmap v18163: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 22 op/s 2023-05-08T13:10:18.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:18 smithi096 ceph-mon[124666]: pgmap v18163: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 22 op/s 2023-05-08T13:10:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:19 smithi186 ceph-mon[126480]: pgmap v18164: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 312 KiB/s wr, 7 op/s 2023-05-08T13:10:19.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:19 smithi133 ceph-mon[125939]: pgmap v18164: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 312 KiB/s wr, 7 op/s 2023-05-08T13:10:19.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:19 smithi096 ceph-mon[124666]: pgmap v18164: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 312 KiB/s wr, 7 op/s 2023-05-08T13:10:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33958.346295 secs 2023-05-08T13:10:20.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33958.346295 secs 2023-05-08T13:10:20.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33958.346295 secs 2023-05-08T13:10:21.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:21 smithi186 ceph-mon[126480]: pgmap v18165: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 485 KiB/s wr, 10 op/s 2023-05-08T13:10:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33960.192510 secs 2023-05-08T13:10:21.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:21 smithi133 ceph-mon[125939]: pgmap v18165: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 485 KiB/s wr, 10 op/s 2023-05-08T13:10:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33960.192510 secs 2023-05-08T13:10:21.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:21 smithi096 ceph-mon[124666]: pgmap v18165: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 485 KiB/s wr, 10 op/s 2023-05-08T13:10:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33960.192510 secs 2023-05-08T13:10:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:22 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:10:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:22 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:10:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:22 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:10:22.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:22 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:10:22.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:22 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:10:22.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:22 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:10:22.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:22 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:10:22.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:22 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:10:22.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:22 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:10:23.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:23 smithi186 ceph-mon[126480]: pgmap v18166: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 172 KiB/s wr, 6 op/s 2023-05-08T13:10:23.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:23 smithi133 ceph-mon[125939]: pgmap v18166: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 172 KiB/s wr, 6 op/s 2023-05-08T13:10:23.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:23 smithi096 ceph-mon[124666]: pgmap v18166: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 172 KiB/s wr, 6 op/s 2023-05-08T13:10:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33963.346388 secs 2023-05-08T13:10:25.530 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33963.900334 secs 2023-05-08T13:10:25.531 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:25 smithi096 ceph-mon[124666]: pgmap v18167: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 193 KiB/s wr, 7 op/s 2023-05-08T13:10:25.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33963.346388 secs 2023-05-08T13:10:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33963.900334 secs 2023-05-08T13:10:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:25 smithi186 ceph-mon[126480]: pgmap v18167: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 193 KiB/s wr, 7 op/s 2023-05-08T13:10:25.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33963.346388 secs 2023-05-08T13:10:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33963.900334 secs 2023-05-08T13:10:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:25 smithi133 ceph-mon[125939]: pgmap v18167: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 193 KiB/s wr, 7 op/s 2023-05-08T13:10:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:26 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:10:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:26 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:10:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33965.192632 secs 2023-05-08T13:10:26.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:26 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:10:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:26 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:10:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33965.192632 secs 2023-05-08T13:10:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:26 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:10:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:26 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:10:26.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33965.192632 secs 2023-05-08T13:10:27.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:27 smithi186 ceph-mon[126480]: pgmap v18168: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 421 KiB/s wr, 11 op/s 2023-05-08T13:10:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:27 smithi186 ceph-mon[126480]: osdmap e1212: 12 total, 12 up, 12 in 2023-05-08T13:10:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:27 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:10:27.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:27 smithi133 ceph-mon[125939]: pgmap v18168: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 421 KiB/s wr, 11 op/s 2023-05-08T13:10:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:27 smithi133 ceph-mon[125939]: osdmap e1212: 12 total, 12 up, 12 in 2023-05-08T13:10:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:27 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:10:27.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:27 smithi096 ceph-mon[124666]: pgmap v18168: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 421 KiB/s wr, 11 op/s 2023-05-08T13:10:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:27 smithi096 ceph-mon[124666]: osdmap e1212: 12 total, 12 up, 12 in 2023-05-08T13:10:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:27 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:10:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:29 smithi186 ceph-mon[126480]: pgmap v18170: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 505 KiB/s wr, 12 op/s 2023-05-08T13:10:29.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:29 smithi133 ceph-mon[125939]: pgmap v18170: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 505 KiB/s wr, 12 op/s 2023-05-08T13:10:29.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:29 smithi096 ceph-mon[124666]: pgmap v18170: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 505 KiB/s wr, 12 op/s 2023-05-08T13:10:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33968.346500 secs 2023-05-08T13:10:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33968.900493 secs 2023-05-08T13:10:30.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33968.346500 secs 2023-05-08T13:10:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33968.900493 secs 2023-05-08T13:10:30.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33968.346500 secs 2023-05-08T13:10:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33968.900493 secs 2023-05-08T13:10:31.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:31 smithi133 ceph-mon[125939]: pgmap v18171: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 642 KiB/s rd, 758 KiB/s wr, 13 op/s 2023-05-08T13:10:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33970.192758 secs 2023-05-08T13:10:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:31 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:10:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:31 smithi186 ceph-mon[126480]: pgmap v18171: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 642 KiB/s rd, 758 KiB/s wr, 13 op/s 2023-05-08T13:10:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33970.192758 secs 2023-05-08T13:10:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:31 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:10:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:31 smithi096 ceph-mon[124666]: pgmap v18171: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 642 KiB/s rd, 758 KiB/s wr, 13 op/s 2023-05-08T13:10:31.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33970.192758 secs 2023-05-08T13:10:31.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:31 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:10:32.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:10:32.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:10:32.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:32 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:10:32.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:10:32.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:32 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T13:10:32.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:32 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T13:10:32.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:32 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:10:32.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:10:32.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:10:32.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:32 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:10:32.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:10:32.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:32 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T13:10:32.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:32 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T13:10:32.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:32 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:10:32.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:10:32.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:10:32.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:32 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:10:32.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:10:32.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:32 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T13:10:32.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:32 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T13:10:32.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:32 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:10:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:34 smithi186 ceph-mon[126480]: pgmap v18172: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 642 KiB/s rd, 758 KiB/s wr, 13 op/s 2023-05-08T13:10:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:34 smithi133 ceph-mon[125939]: pgmap v18172: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 642 KiB/s rd, 758 KiB/s wr, 13 op/s 2023-05-08T13:10:34.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:34 smithi096 ceph-mon[124666]: pgmap v18172: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 642 KiB/s rd, 758 KiB/s wr, 13 op/s 2023-05-08T13:10:35.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33973.346614 secs 2023-05-08T13:10:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33973.900638 secs 2023-05-08T13:10:35.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33973.346614 secs 2023-05-08T13:10:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33973.900638 secs 2023-05-08T13:10:35.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33973.346614 secs 2023-05-08T13:10:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33973.900638 secs 2023-05-08T13:10:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:36 smithi186 ceph-mon[126480]: pgmap v18173: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 618 KiB/s rd, 733 KiB/s wr, 12 op/s 2023-05-08T13:10:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33975.192885 secs 2023-05-08T13:10:36.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:36 smithi133 ceph-mon[125939]: pgmap v18173: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 618 KiB/s rd, 733 KiB/s wr, 12 op/s 2023-05-08T13:10:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33975.192885 secs 2023-05-08T13:10:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:36 smithi096 ceph-mon[124666]: pgmap v18173: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 618 KiB/s rd, 733 KiB/s wr, 12 op/s 2023-05-08T13:10:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33975.192885 secs 2023-05-08T13:10:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:38 smithi186 ceph-mon[126480]: pgmap v18174: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 572 KiB/s rd, 542 KiB/s wr, 9 op/s 2023-05-08T13:10:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:38 smithi186 ceph-mon[126480]: osdmap e1213: 12 total, 12 up, 12 in 2023-05-08T13:10:38.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:38 smithi133 ceph-mon[125939]: pgmap v18174: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 572 KiB/s rd, 542 KiB/s wr, 9 op/s 2023-05-08T13:10:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:38 smithi133 ceph-mon[125939]: osdmap e1213: 12 total, 12 up, 12 in 2023-05-08T13:10:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:38 smithi096 ceph-mon[124666]: pgmap v18174: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 572 KiB/s rd, 542 KiB/s wr, 9 op/s 2023-05-08T13:10:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:38 smithi096 ceph-mon[124666]: osdmap e1213: 12 total, 12 up, 12 in 2023-05-08T13:10:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:40 smithi186 ceph-mon[126480]: pgmap v18176: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 572 KiB/s rd, 542 KiB/s wr, 9 op/s 2023-05-08T13:10:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33978.346686 secs 2023-05-08T13:10:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33978.900724 secs 2023-05-08T13:10:40.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:40 smithi133 ceph-mon[125939]: pgmap v18176: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 572 KiB/s rd, 542 KiB/s wr, 9 op/s 2023-05-08T13:10:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33978.346686 secs 2023-05-08T13:10:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33978.900724 secs 2023-05-08T13:10:40.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:40 smithi096 ceph-mon[124666]: pgmap v18176: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 572 KiB/s rd, 542 KiB/s wr, 9 op/s 2023-05-08T13:10:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33978.346686 secs 2023-05-08T13:10:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33978.900724 secs 2023-05-08T13:10:41.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33980.192979 secs 2023-05-08T13:10:41.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33980.192979 secs 2023-05-08T13:10:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33980.192979 secs 2023-05-08T13:10:42.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:42 smithi186 ceph-mon[126480]: pgmap v18177: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 428 KiB/s wr, 7 op/s 2023-05-08T13:10:42.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:42 smithi133 ceph-mon[125939]: pgmap v18177: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 428 KiB/s wr, 7 op/s 2023-05-08T13:10:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:42 smithi096 ceph-mon[124666]: pgmap v18177: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 428 KiB/s wr, 7 op/s 2023-05-08T13:10:43.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:43 smithi186 ceph-mon[126480]: pgmap v18178: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 428 KiB/s wr, 7 op/s 2023-05-08T13:10:43.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:43 smithi133 ceph-mon[125939]: pgmap v18178: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 428 KiB/s wr, 7 op/s 2023-05-08T13:10:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:43 smithi096 ceph-mon[124666]: pgmap v18178: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 428 KiB/s wr, 7 op/s 2023-05-08T13:10:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33983.346783 secs 2023-05-08T13:10:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33983.900805 secs 2023-05-08T13:10:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:45 smithi186 ceph-mon[126480]: pgmap v18179: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 428 KiB/s wr, 8 op/s 2023-05-08T13:10:45.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33983.346783 secs 2023-05-08T13:10:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33983.900805 secs 2023-05-08T13:10:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:45 smithi133 ceph-mon[125939]: pgmap v18179: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 428 KiB/s wr, 8 op/s 2023-05-08T13:10:45.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33983.346783 secs 2023-05-08T13:10:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33983.900805 secs 2023-05-08T13:10:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:45 smithi096 ceph-mon[124666]: pgmap v18179: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 428 KiB/s wr, 8 op/s 2023-05-08T13:10:48.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:48 smithi186 ceph-mon[126480]: pgmap v18180: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 347 KiB/s wr, 8 op/s 2023-05-08T13:10:48.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:48 smithi133 ceph-mon[125939]: pgmap v18180: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 347 KiB/s wr, 8 op/s 2023-05-08T13:10:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:48 smithi096 ceph-mon[124666]: pgmap v18180: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 347 KiB/s wr, 8 op/s 2023-05-08T13:10:49.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:10:49.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:10:49.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:10:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:50 smithi186 ceph-mon[126480]: pgmap v18181: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 310 KiB/s wr, 7 op/s 2023-05-08T13:10:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:10:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:10:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:10:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33988.900903 secs 2023-05-08T13:10:50.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:50 smithi133 ceph-mon[125939]: pgmap v18181: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 310 KiB/s wr, 7 op/s 2023-05-08T13:10:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:10:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:10:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:10:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33988.900903 secs 2023-05-08T13:10:50.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:50 smithi096 ceph-mon[124666]: pgmap v18181: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 310 KiB/s wr, 7 op/s 2023-05-08T13:10:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:10:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:10:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:10:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33988.900903 secs 2023-05-08T13:10:52.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:52 smithi186 ceph-mon[126480]: pgmap v18182: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 691 KiB/s rd, 609 KiB/s wr, 10 op/s 2023-05-08T13:10:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:10:52.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:52 smithi133 ceph-mon[125939]: pgmap v18182: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 691 KiB/s rd, 609 KiB/s wr, 10 op/s 2023-05-08T13:10:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:10:52.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:52 smithi096 ceph-mon[124666]: pgmap v18182: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 691 KiB/s rd, 609 KiB/s wr, 10 op/s 2023-05-08T13:10:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:10:53.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T13:10:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:10:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:53 smithi186 ceph-mon[126480]: pgmap v18183: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 690 KiB/s rd, 321 KiB/s wr, 7 op/s 2023-05-08T13:10:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T13:10:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:10:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:53 smithi133 ceph-mon[125939]: pgmap v18183: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 690 KiB/s rd, 321 KiB/s wr, 7 op/s 2023-05-08T13:10:53.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T13:10:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:10:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:53 smithi096 ceph-mon[124666]: pgmap v18183: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 690 KiB/s rd, 321 KiB/s wr, 7 op/s 2023-05-08T13:10:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33993.347035 secs 2023-05-08T13:10:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:55 smithi186 ceph-mon[126480]: pgmap v18184: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 662 KiB/s wr, 10 op/s 2023-05-08T13:10:55.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33993.347035 secs 2023-05-08T13:10:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:55 smithi133 ceph-mon[125939]: pgmap v18184: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 662 KiB/s wr, 10 op/s 2023-05-08T13:10:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33993.347035 secs 2023-05-08T13:10:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:55 smithi096 ceph-mon[124666]: pgmap v18184: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 662 KiB/s wr, 10 op/s 2023-05-08T13:10:56.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:56 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:10:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T13:10:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:10:56.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:56 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:10:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T13:10:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:10:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:56 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:10:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T13:10:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:10:57.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:57 smithi186 ceph-mon[126480]: pgmap v18185: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2023-05-08T13:10:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:10:57.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:57 smithi133 ceph-mon[125939]: pgmap v18185: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2023-05-08T13:10:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:10:57.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:57 smithi096 ceph-mon[124666]: pgmap v18185: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2023-05-08T13:10:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:10:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:10:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:10:58.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:10:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:10:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:10:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:10:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:59 smithi186 ceph-mon[126480]: pgmap v18186: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 10 op/s 2023-05-08T13:10:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:10:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33998.347190 secs 2023-05-08T13:10:59.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:59 smithi133 ceph-mon[125939]: pgmap v18186: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 10 op/s 2023-05-08T13:10:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:10:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33998.347190 secs 2023-05-08T13:10:59.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:59 smithi096 ceph-mon[124666]: pgmap v18186: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 10 op/s 2023-05-08T13:10:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:10:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33998.347190 secs 2023-05-08T13:11:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 33998.901143 secs 2023-05-08T13:11:00.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 33998.901143 secs 2023-05-08T13:11:00.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 33998.901143 secs 2023-05-08T13:11:01.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:01 smithi186 ceph-mon[126480]: pgmap v18187: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 17 op/s 2023-05-08T13:11:01.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:01 smithi133 ceph-mon[125939]: pgmap v18187: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 17 op/s 2023-05-08T13:11:01.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:01 smithi096 ceph-mon[124666]: pgmap v18187: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 17 op/s 2023-05-08T13:11:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:02 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:11:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:11:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:11:02.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:02 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:11:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:11:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:11:02.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:02 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:11:02.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:11:02.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:11:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:04 smithi186 ceph-mon[126480]: pgmap v18188: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 13 op/s 2023-05-08T13:11:04.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:04 smithi133 ceph-mon[125939]: pgmap v18188: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 13 op/s 2023-05-08T13:11:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:04 smithi096 ceph-mon[124666]: pgmap v18188: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 13 op/s 2023-05-08T13:11:05.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34003.347312 secs 2023-05-08T13:11:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:05 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:11:05.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34003.347312 secs 2023-05-08T13:11:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:05 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:11:05.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34003.347312 secs 2023-05-08T13:11:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:05 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:11:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:06 smithi186 ceph-mon[126480]: pgmap v18189: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 15 op/s 2023-05-08T13:11:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:11:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:11:06.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:06 smithi133 ceph-mon[125939]: pgmap v18189: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 15 op/s 2023-05-08T13:11:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:11:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:11:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:06 smithi096 ceph-mon[124666]: pgmap v18189: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 15 op/s 2023-05-08T13:11:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:11:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:11:07.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:07 smithi186 ceph-mon[126480]: pgmap v18190: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 17 op/s 2023-05-08T13:11:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:07 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:11:07.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:07 smithi133 ceph-mon[125939]: pgmap v18190: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 17 op/s 2023-05-08T13:11:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:07 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:11:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:07 smithi096 ceph-mon[124666]: pgmap v18190: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 17 op/s 2023-05-08T13:11:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:07 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:11:09.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:09 smithi186 ceph-mon[126480]: pgmap v18191: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2023-05-08T13:11:09.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:09 smithi133 ceph-mon[125939]: pgmap v18191: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2023-05-08T13:11:09.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:09 smithi096 ceph-mon[124666]: pgmap v18191: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2023-05-08T13:11:10.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34008.347415 secs 2023-05-08T13:11:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34008.901426 secs 2023-05-08T13:11:10.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34008.347415 secs 2023-05-08T13:11:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34008.901426 secs 2023-05-08T13:11:10.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34008.347415 secs 2023-05-08T13:11:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34008.901426 secs 2023-05-08T13:11:11.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:11 smithi186 ceph-mon[126480]: pgmap v18192: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.7 MiB/s wr, 32 op/s 2023-05-08T13:11:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34010.193707 secs 2023-05-08T13:11:11.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:11 smithi133 ceph-mon[125939]: pgmap v18192: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.7 MiB/s wr, 32 op/s 2023-05-08T13:11:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34010.193707 secs 2023-05-08T13:11:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:11 smithi096 ceph-mon[124666]: pgmap v18192: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.7 MiB/s wr, 32 op/s 2023-05-08T13:11:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34010.193707 secs 2023-05-08T13:11:12.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:12 smithi186 ceph-mon[126480]: osdmap e1214: 12 total, 12 up, 12 in 2023-05-08T13:11:12.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:12 smithi133 ceph-mon[125939]: osdmap e1214: 12 total, 12 up, 12 in 2023-05-08T13:11:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:12 smithi096 ceph-mon[124666]: osdmap e1214: 12 total, 12 up, 12 in 2023-05-08T13:11:13.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:13 smithi186 ceph-mon[126480]: pgmap v18194: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 948 KiB/s rd, 1.1 MiB/s wr, 29 op/s 2023-05-08T13:11:13.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:13 smithi133 ceph-mon[125939]: pgmap v18194: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 948 KiB/s rd, 1.1 MiB/s wr, 29 op/s 2023-05-08T13:11:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:13 smithi096 ceph-mon[124666]: pgmap v18194: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 948 KiB/s rd, 1.1 MiB/s wr, 29 op/s 2023-05-08T13:11:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:14 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:11:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:14 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:11:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:14 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:11:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:14 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:11:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34013.347539 secs 2023-05-08T13:11:14.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:14 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:11:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:14 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:11:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:14 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:11:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:14 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:11:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34013.347539 secs 2023-05-08T13:11:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:14 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:11:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:14 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:11:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:14 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:11:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:14 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:11:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34013.347539 secs 2023-05-08T13:11:15.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34013.901551 secs 2023-05-08T13:11:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:15 smithi186 ceph-mon[126480]: pgmap v18195: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 942 KiB/s rd, 1.1 MiB/s wr, 29 op/s 2023-05-08T13:11:15.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34013.901551 secs 2023-05-08T13:11:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:15 smithi133 ceph-mon[125939]: pgmap v18195: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 942 KiB/s rd, 1.1 MiB/s wr, 29 op/s 2023-05-08T13:11:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34013.901551 secs 2023-05-08T13:11:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:15 smithi096 ceph-mon[124666]: pgmap v18195: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 942 KiB/s rd, 1.1 MiB/s wr, 29 op/s 2023-05-08T13:11:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34015.193854 secs 2023-05-08T13:11:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34015.193854 secs 2023-05-08T13:11:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34015.193854 secs 2023-05-08T13:11:18.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:18 smithi186 ceph-mon[126480]: pgmap v18196: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 721 KiB/s rd, 1.1 MiB/s wr, 26 op/s 2023-05-08T13:11:18.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:18 smithi186 ceph-mon[126480]: osdmap e1215: 12 total, 12 up, 12 in 2023-05-08T13:11:18.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:18 smithi133 ceph-mon[125939]: pgmap v18196: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 721 KiB/s rd, 1.1 MiB/s wr, 26 op/s 2023-05-08T13:11:18.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:18 smithi133 ceph-mon[125939]: osdmap e1215: 12 total, 12 up, 12 in 2023-05-08T13:11:18.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:18 smithi096 ceph-mon[124666]: pgmap v18196: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 721 KiB/s rd, 1.1 MiB/s wr, 26 op/s 2023-05-08T13:11:18.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:18 smithi096 ceph-mon[124666]: osdmap e1215: 12 total, 12 up, 12 in 2023-05-08T13:11:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:19 smithi186 ceph-mon[126480]: pgmap v18198: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 631 KiB/s wr, 6 op/s 2023-05-08T13:11:19.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:19 smithi133 ceph-mon[125939]: pgmap v18198: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 631 KiB/s wr, 6 op/s 2023-05-08T13:11:19.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:19 smithi096 ceph-mon[124666]: pgmap v18198: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 631 KiB/s wr, 6 op/s 2023-05-08T13:11:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34018.347663 secs 2023-05-08T13:11:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34018.901648 secs 2023-05-08T13:11:20.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34018.347663 secs 2023-05-08T13:11:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34018.901648 secs 2023-05-08T13:11:20.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34018.347663 secs 2023-05-08T13:11:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34018.901648 secs 2023-05-08T13:11:21.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:21 smithi186 ceph-mon[126480]: pgmap v18199: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 494 KiB/s wr, 9 op/s 2023-05-08T13:11:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34020.193942 secs 2023-05-08T13:11:21.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:21 smithi133 ceph-mon[125939]: pgmap v18199: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 494 KiB/s wr, 9 op/s 2023-05-08T13:11:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34020.193942 secs 2023-05-08T13:11:21.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:21 smithi096 ceph-mon[124666]: pgmap v18199: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 494 KiB/s wr, 9 op/s 2023-05-08T13:11:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34020.193942 secs 2023-05-08T13:11:23.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:23 smithi186 ceph-mon[126480]: pgmap v18200: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 442 KiB/s wr, 9 op/s 2023-05-08T13:11:23.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:23 smithi133 ceph-mon[125939]: pgmap v18200: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 442 KiB/s wr, 9 op/s 2023-05-08T13:11:23.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:23 smithi096 ceph-mon[124666]: pgmap v18200: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 442 KiB/s wr, 9 op/s 2023-05-08T13:11:25.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34023.347788 secs 2023-05-08T13:11:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34023.901763 secs 2023-05-08T13:11:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:25 smithi186 ceph-mon[126480]: pgmap v18201: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 441 KiB/s wr, 8 op/s 2023-05-08T13:11:25.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34023.347788 secs 2023-05-08T13:11:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34023.901763 secs 2023-05-08T13:11:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:25 smithi133 ceph-mon[125939]: pgmap v18201: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 441 KiB/s wr, 8 op/s 2023-05-08T13:11:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34023.347788 secs 2023-05-08T13:11:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34023.901763 secs 2023-05-08T13:11:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:25 smithi096 ceph-mon[124666]: pgmap v18201: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 441 KiB/s wr, 8 op/s 2023-05-08T13:11:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34025.194039 secs 2023-05-08T13:11:26.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34025.194039 secs 2023-05-08T13:11:26.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34025.194039 secs 2023-05-08T13:11:27.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:27 smithi186 ceph-mon[126480]: pgmap v18202: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 29 KiB/s wr, 7 op/s 2023-05-08T13:11:27.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:27 smithi133 ceph-mon[125939]: pgmap v18202: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 29 KiB/s wr, 7 op/s 2023-05-08T13:11:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:27 smithi096 ceph-mon[124666]: pgmap v18202: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 29 KiB/s wr, 7 op/s 2023-05-08T13:11:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:29 smithi186 ceph-mon[126480]: pgmap v18203: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 26 KiB/s wr, 6 op/s 2023-05-08T13:11:29.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:29 smithi133 ceph-mon[125939]: pgmap v18203: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 26 KiB/s wr, 6 op/s 2023-05-08T13:11:29.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:29 smithi096 ceph-mon[124666]: pgmap v18203: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 26 KiB/s wr, 6 op/s 2023-05-08T13:11:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34028.347944 secs 2023-05-08T13:11:30.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34028.901880 secs 2023-05-08T13:11:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34028.347944 secs 2023-05-08T13:11:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34028.901880 secs 2023-05-08T13:11:30.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34028.347944 secs 2023-05-08T13:11:30.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34028.901880 secs 2023-05-08T13:11:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:31 smithi186 ceph-mon[126480]: pgmap v18204: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 290 KiB/s rd, 25 KiB/s wr, 8 op/s 2023-05-08T13:11:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34030.194160 secs 2023-05-08T13:11:31.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:31 smithi133 ceph-mon[125939]: pgmap v18204: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 290 KiB/s rd, 25 KiB/s wr, 8 op/s 2023-05-08T13:11:31.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34030.194160 secs 2023-05-08T13:11:31.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:31 smithi096 ceph-mon[124666]: pgmap v18204: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 290 KiB/s rd, 25 KiB/s wr, 8 op/s 2023-05-08T13:11:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34030.194160 secs 2023-05-08T13:11:32.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:11:32.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:11:32.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:11:33.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:33 smithi186 ceph-mon[126480]: pgmap v18205: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 265 KiB/s rd, 682 B/s wr, 6 op/s 2023-05-08T13:11:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:33 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:11:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:33 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:11:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:33 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:11:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:33 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:11:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:33 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T13:11:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:33 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T13:11:33.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:33 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:11:33.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:33 smithi133 ceph-mon[125939]: pgmap v18205: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 265 KiB/s rd, 682 B/s wr, 6 op/s 2023-05-08T13:11:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:33 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:11:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:33 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:11:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:33 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:11:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:33 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:11:33.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:33 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T13:11:33.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:33 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T13:11:33.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:33 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:11:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:33 smithi096 ceph-mon[124666]: pgmap v18205: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 265 KiB/s rd, 682 B/s wr, 6 op/s 2023-05-08T13:11:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:33 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:11:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:33 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:11:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:33 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:11:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:33 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:11:33.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:33 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T13:11:33.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:33 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T13:11:33.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:33 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:11:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34033.348088 secs 2023-05-08T13:11:34.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34033.348088 secs 2023-05-08T13:11:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34033.348088 secs 2023-05-08T13:11:35.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34033.902001 secs 2023-05-08T13:11:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:35 smithi186 ceph-mon[126480]: pgmap v18206: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 23 KiB/s wr, 7 op/s 2023-05-08T13:11:35.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34033.902001 secs 2023-05-08T13:11:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:35 smithi133 ceph-mon[125939]: pgmap v18206: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 23 KiB/s wr, 7 op/s 2023-05-08T13:11:35.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34033.902001 secs 2023-05-08T13:11:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:35 smithi096 ceph-mon[124666]: pgmap v18206: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 23 KiB/s wr, 7 op/s 2023-05-08T13:11:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34035.194280 secs 2023-05-08T13:11:36.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34035.194280 secs 2023-05-08T13:11:36.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34035.194280 secs 2023-05-08T13:11:37.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:37 smithi186 ceph-mon[126480]: pgmap v18207: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 8 op/s 2023-05-08T13:11:37.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:37 smithi133 ceph-mon[125939]: pgmap v18207: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 8 op/s 2023-05-08T13:11:37.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:37 smithi096 ceph-mon[124666]: pgmap v18207: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 8 op/s 2023-05-08T13:11:39.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:39 smithi186 ceph-mon[126480]: pgmap v18208: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 6 op/s 2023-05-08T13:11:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34038.348180 secs 2023-05-08T13:11:39.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:39 smithi133 ceph-mon[125939]: pgmap v18208: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 6 op/s 2023-05-08T13:11:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34038.348180 secs 2023-05-08T13:11:39.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:39 smithi096 ceph-mon[124666]: pgmap v18208: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 6 op/s 2023-05-08T13:11:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34038.348180 secs 2023-05-08T13:11:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34038.902117 secs 2023-05-08T13:11:40.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34038.902117 secs 2023-05-08T13:11:40.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34038.902117 secs 2023-05-08T13:11:41.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:41 smithi186 ceph-mon[126480]: pgmap v18209: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 165 KiB/s wr, 10 op/s 2023-05-08T13:11:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34040.194396 secs 2023-05-08T13:11:41.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:41 smithi133 ceph-mon[125939]: pgmap v18209: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 165 KiB/s wr, 10 op/s 2023-05-08T13:11:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34040.194396 secs 2023-05-08T13:11:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:41 smithi096 ceph-mon[124666]: pgmap v18209: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 165 KiB/s wr, 10 op/s 2023-05-08T13:11:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34040.194396 secs 2023-05-08T13:11:43.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:43 smithi186 ceph-mon[126480]: pgmap v18210: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 165 KiB/s wr, 8 op/s 2023-05-08T13:11:43.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:43 smithi133 ceph-mon[125939]: pgmap v18210: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 165 KiB/s wr, 8 op/s 2023-05-08T13:11:43.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:43 smithi096 ceph-mon[124666]: pgmap v18210: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 165 KiB/s wr, 8 op/s 2023-05-08T13:11:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34043.348315 secs 2023-05-08T13:11:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34043.902236 secs 2023-05-08T13:11:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:45 smithi186 ceph-mon[126480]: pgmap v18211: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 368 KiB/s wr, 9 op/s 2023-05-08T13:11:45.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34043.348315 secs 2023-05-08T13:11:45.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34043.902236 secs 2023-05-08T13:11:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:45 smithi133 ceph-mon[125939]: pgmap v18211: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 368 KiB/s wr, 9 op/s 2023-05-08T13:11:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34043.348315 secs 2023-05-08T13:11:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34043.902236 secs 2023-05-08T13:11:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:45 smithi096 ceph-mon[124666]: pgmap v18211: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 368 KiB/s wr, 9 op/s 2023-05-08T13:11:47.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:47 smithi186 ceph-mon[126480]: pgmap v18212: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 348 KiB/s rd, 345 KiB/s wr, 9 op/s 2023-05-08T13:11:47.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:47 smithi133 ceph-mon[125939]: pgmap v18212: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 348 KiB/s rd, 345 KiB/s wr, 9 op/s 2023-05-08T13:11:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:47 smithi096 ceph-mon[124666]: pgmap v18212: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 348 KiB/s rd, 345 KiB/s wr, 9 op/s 2023-05-08T13:11:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:49 smithi186 ceph-mon[126480]: pgmap v18213: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 342 KiB/s wr, 7 op/s 2023-05-08T13:11:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:11:49.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:49 smithi133 ceph-mon[125939]: pgmap v18213: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 342 KiB/s wr, 7 op/s 2023-05-08T13:11:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:11:49.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:49 smithi096 ceph-mon[124666]: pgmap v18213: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 342 KiB/s wr, 7 op/s 2023-05-08T13:11:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:11:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34048.348452 secs 2023-05-08T13:11:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:11:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:11:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:11:50.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34048.348452 secs 2023-05-08T13:11:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:11:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:11:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:11:50.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34048.348452 secs 2023-05-08T13:11:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:11:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:11:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:11:51.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:51 smithi186 ceph-mon[126480]: pgmap v18214: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 949 KiB/s rd, 708 KiB/s wr, 12 op/s 2023-05-08T13:11:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:51 smithi133 ceph-mon[125939]: pgmap v18214: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 949 KiB/s rd, 708 KiB/s wr, 12 op/s 2023-05-08T13:11:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:51 smithi096 ceph-mon[124666]: pgmap v18214: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 949 KiB/s rd, 708 KiB/s wr, 12 op/s 2023-05-08T13:11:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:53 smithi186 ceph-mon[126480]: pgmap v18215: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 809 KiB/s rd, 569 KiB/s wr, 8 op/s 2023-05-08T13:11:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:53 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:11:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:53 smithi133 ceph-mon[125939]: pgmap v18215: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 809 KiB/s rd, 569 KiB/s wr, 8 op/s 2023-05-08T13:11:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:53 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:11:53.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:53 smithi096 ceph-mon[124666]: pgmap v18215: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 809 KiB/s rd, 569 KiB/s wr, 8 op/s 2023-05-08T13:11:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:53 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:11:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:54 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:11:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:54 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:11:54.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:54 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:11:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:54 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:11:54.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:54 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:11:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:54 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:11:55.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34053.348535 secs 2023-05-08T13:11:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:55 smithi186 ceph-mon[126480]: pgmap v18216: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T13:11:55.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34053.348535 secs 2023-05-08T13:11:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:55 smithi133 ceph-mon[125939]: pgmap v18216: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T13:11:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34053.348535 secs 2023-05-08T13:11:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:55 smithi096 ceph-mon[124666]: pgmap v18216: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T13:11:57.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:57 smithi186 ceph-mon[126480]: pgmap v18217: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T13:11:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:57 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:11:57.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:57 smithi133 ceph-mon[125939]: pgmap v18217: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T13:11:57.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:57 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:11:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:57 smithi096 ceph-mon[124666]: pgmap v18217: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T13:11:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:57 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:11:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:11:59 smithi186 ceph-mon[126480]: pgmap v18218: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T13:11:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:11:59 smithi133 ceph-mon[125939]: pgmap v18218: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T13:11:59.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:11:59 smithi096 ceph-mon[124666]: pgmap v18218: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T13:12:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34058.348663 secs 2023-05-08T13:12:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34058.902558 secs 2023-05-08T13:12:00.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34058.348663 secs 2023-05-08T13:12:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34058.902558 secs 2023-05-08T13:12:00.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34058.348663 secs 2023-05-08T13:12:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34058.902558 secs 2023-05-08T13:12:01.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:01 smithi186 ceph-mon[126480]: pgmap v18219: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.4 MiB/s wr, 16 op/s 2023-05-08T13:12:01.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:01 smithi133 ceph-mon[125939]: pgmap v18219: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.4 MiB/s wr, 16 op/s 2023-05-08T13:12:01.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:01 smithi096 ceph-mon[124666]: pgmap v18219: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.4 MiB/s wr, 16 op/s 2023-05-08T13:12:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:12:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:12:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:02 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:12:02.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:12:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:12:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:02 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:12:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:12:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:12:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:02 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:12:03.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:03 smithi186 ceph-mon[126480]: pgmap v18220: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T13:12:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:03 smithi133 ceph-mon[125939]: pgmap v18220: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T13:12:03.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:03 smithi096 ceph-mon[124666]: pgmap v18220: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T13:12:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34063.348795 secs 2023-05-08T13:12:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34063.348795 secs 2023-05-08T13:12:04.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34063.348795 secs 2023-05-08T13:12:05.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34063.902680 secs 2023-05-08T13:12:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:05 smithi186 ceph-mon[126480]: pgmap v18221: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.0 MiB/s wr, 13 op/s 2023-05-08T13:12:05.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34063.902680 secs 2023-05-08T13:12:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:05 smithi133 ceph-mon[125939]: pgmap v18221: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.0 MiB/s wr, 13 op/s 2023-05-08T13:12:05.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34063.902680 secs 2023-05-08T13:12:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:05 smithi096 ceph-mon[124666]: pgmap v18221: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.0 MiB/s wr, 13 op/s 2023-05-08T13:12:07.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:07 smithi186 ceph-mon[126480]: pgmap v18222: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T13:12:07.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:07 smithi133 ceph-mon[125939]: pgmap v18222: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T13:12:07.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:07 smithi096 ceph-mon[124666]: pgmap v18222: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T13:12:09.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:09 smithi186 ceph-mon[126480]: pgmap v18223: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 931 KiB/s rd, 829 KiB/s wr, 11 op/s 2023-05-08T13:12:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34068.348920 secs 2023-05-08T13:12:09.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:09 smithi133 ceph-mon[125939]: pgmap v18223: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 931 KiB/s rd, 829 KiB/s wr, 11 op/s 2023-05-08T13:12:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34068.348920 secs 2023-05-08T13:12:09.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:09 smithi096 ceph-mon[124666]: pgmap v18223: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 931 KiB/s rd, 829 KiB/s wr, 11 op/s 2023-05-08T13:12:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34068.348920 secs 2023-05-08T13:12:11.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:11 smithi186 ceph-mon[126480]: pgmap v18224: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.4 MiB/s wr, 27 op/s 2023-05-08T13:12:11.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:11 smithi133 ceph-mon[125939]: pgmap v18224: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.4 MiB/s wr, 27 op/s 2023-05-08T13:12:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:11 smithi096 ceph-mon[124666]: pgmap v18224: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.4 MiB/s wr, 27 op/s 2023-05-08T13:12:13.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:13 smithi186 ceph-mon[126480]: pgmap v18225: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 22 op/s 2023-05-08T13:12:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:13 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:12:13.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:13 smithi133 ceph-mon[125939]: pgmap v18225: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 22 op/s 2023-05-08T13:12:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:13 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:12:13.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:13 smithi096 ceph-mon[124666]: pgmap v18225: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 22 op/s 2023-05-08T13:12:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:13 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:12:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:14 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:12:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:14 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:12:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:14 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:12:14.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:14 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:12:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:14 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:12:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:14 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:12:14.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:14 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:12:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:14 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:12:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:14 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:12:15.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34073.349039 secs 2023-05-08T13:12:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:15 smithi186 ceph-mon[126480]: pgmap v18226: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 24 op/s 2023-05-08T13:12:15.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34073.349039 secs 2023-05-08T13:12:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:15 smithi133 ceph-mon[125939]: pgmap v18226: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 24 op/s 2023-05-08T13:12:15.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34073.349039 secs 2023-05-08T13:12:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:15 smithi096 ceph-mon[124666]: pgmap v18226: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 24 op/s 2023-05-08T13:12:17.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:17 smithi186 ceph-mon[126480]: pgmap v18227: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 25 op/s 2023-05-08T13:12:17.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:17 smithi133 ceph-mon[125939]: pgmap v18227: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 25 op/s 2023-05-08T13:12:17.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:17 smithi096 ceph-mon[124666]: pgmap v18227: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 25 op/s 2023-05-08T13:12:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:19 smithi186 ceph-mon[126480]: pgmap v18228: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 949 KiB/s wr, 20 op/s 2023-05-08T13:12:19.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:19 smithi133 ceph-mon[125939]: pgmap v18228: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 949 KiB/s wr, 20 op/s 2023-05-08T13:12:19.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:19 smithi096 ceph-mon[124666]: pgmap v18228: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 949 KiB/s wr, 20 op/s 2023-05-08T13:12:20.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34078.349187 secs 2023-05-08T13:12:20.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34078.349187 secs 2023-05-08T13:12:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34078.349187 secs 2023-05-08T13:12:21.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:21 smithi186 ceph-mon[126480]: pgmap v18229: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.0 MiB/s wr, 24 op/s 2023-05-08T13:12:21.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:21 smithi133 ceph-mon[125939]: pgmap v18229: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.0 MiB/s wr, 24 op/s 2023-05-08T13:12:21.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:21 smithi096 ceph-mon[124666]: pgmap v18229: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.0 MiB/s wr, 24 op/s 2023-05-08T13:12:23.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:23 smithi186 ceph-mon[126480]: pgmap v18230: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 763 KiB/s rd, 480 KiB/s wr, 7 op/s 2023-05-08T13:12:23.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:23 smithi133 ceph-mon[125939]: pgmap v18230: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 763 KiB/s rd, 480 KiB/s wr, 7 op/s 2023-05-08T13:12:23.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:23 smithi096 ceph-mon[124666]: pgmap v18230: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 763 KiB/s rd, 480 KiB/s wr, 7 op/s 2023-05-08T13:12:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34083.349327 secs 2023-05-08T13:12:25.625 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34083.903147 secs 2023-05-08T13:12:25.626 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:25 smithi186 ceph-mon[126480]: pgmap v18231: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.2 MiB/s wr, 15 op/s 2023-05-08T13:12:25.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34083.349327 secs 2023-05-08T13:12:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34083.903147 secs 2023-05-08T13:12:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:25 smithi133 ceph-mon[125939]: pgmap v18231: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.2 MiB/s wr, 15 op/s 2023-05-08T13:12:25.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34083.349327 secs 2023-05-08T13:12:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34083.903147 secs 2023-05-08T13:12:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:25 smithi096 ceph-mon[124666]: pgmap v18231: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.2 MiB/s wr, 15 op/s 2023-05-08T13:12:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:26 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:12:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:26 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:12:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:26 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:12:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34085.195454 secs 2023-05-08T13:12:26.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:26 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:12:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:26 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:12:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:26 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:12:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34085.195454 secs 2023-05-08T13:12:26.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:26 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:12:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:26 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:12:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:26 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:12:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34085.195454 secs 2023-05-08T13:12:27.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:27 smithi186 ceph-mon[126480]: pgmap v18232: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1021 KiB/s wr, 13 op/s 2023-05-08T13:12:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:27 smithi186 ceph-mon[126480]: osdmap e1216: 12 total, 12 up, 12 in 2023-05-08T13:12:27.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:27 smithi133 ceph-mon[125939]: pgmap v18232: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1021 KiB/s wr, 13 op/s 2023-05-08T13:12:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:27 smithi133 ceph-mon[125939]: osdmap e1216: 12 total, 12 up, 12 in 2023-05-08T13:12:27.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:27 smithi096 ceph-mon[124666]: pgmap v18232: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1021 KiB/s wr, 13 op/s 2023-05-08T13:12:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:27 smithi096 ceph-mon[124666]: osdmap e1216: 12 total, 12 up, 12 in 2023-05-08T13:12:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:29 smithi186 ceph-mon[126480]: pgmap v18234: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T13:12:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34088.349459 secs 2023-05-08T13:12:29.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:29 smithi133 ceph-mon[125939]: pgmap v18234: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T13:12:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34088.349459 secs 2023-05-08T13:12:29.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:29 smithi096 ceph-mon[124666]: pgmap v18234: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T13:12:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34088.349459 secs 2023-05-08T13:12:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34088.903264 secs 2023-05-08T13:12:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:30 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:12:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:30 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:12:30.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34088.903264 secs 2023-05-08T13:12:30.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:30 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:12:30.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:30 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:12:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34088.903264 secs 2023-05-08T13:12:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:30 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:12:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:30 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:12:31.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:31 smithi186 ceph-mon[126480]: pgmap v18235: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T13:12:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34090.195573 secs 2023-05-08T13:12:31.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:31 smithi133 ceph-mon[125939]: pgmap v18235: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T13:12:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34090.195573 secs 2023-05-08T13:12:31.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:31 smithi096 ceph-mon[124666]: pgmap v18235: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T13:12:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34090.195573 secs 2023-05-08T13:12:32.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:32 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:12:32.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:32 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:12:32.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:32 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:12:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:33 smithi186 ceph-mon[126480]: pgmap v18236: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T13:12:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:33 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:12:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:33 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:12:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:33 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:12:33.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:33 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:12:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:33 smithi133 ceph-mon[125939]: pgmap v18236: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T13:12:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:33 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:12:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:33 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:12:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:33 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:12:33.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:33 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:12:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:33 smithi096 ceph-mon[124666]: pgmap v18236: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T13:12:33.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:33 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:12:33.759 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:33 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:12:33.759 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:33 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:12:33.759 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:33 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:12:34.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:34 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:12:34.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:34 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T13:12:34.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:34 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T13:12:34.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:34 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:12:34.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34093.349581 secs 2023-05-08T13:12:34.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:34 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:12:34.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:34 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T13:12:34.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:34 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T13:12:34.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:34 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:12:34.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34093.349581 secs 2023-05-08T13:12:34.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:34 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:12:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:34 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T13:12:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:34 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T13:12:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:34 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:12:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34093.349581 secs 2023-05-08T13:12:35.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34093.903400 secs 2023-05-08T13:12:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:35 smithi186 ceph-mon[126480]: pgmap v18237: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T13:12:35.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34093.903400 secs 2023-05-08T13:12:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:35 smithi133 ceph-mon[125939]: pgmap v18237: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T13:12:35.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34093.903400 secs 2023-05-08T13:12:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:35 smithi096 ceph-mon[124666]: pgmap v18237: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T13:12:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34095.195724 secs 2023-05-08T13:12:36.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34095.195724 secs 2023-05-08T13:12:36.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34095.195724 secs 2023-05-08T13:12:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:37 smithi186 ceph-mon[126480]: pgmap v18238: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T13:12:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:37 smithi186 ceph-mon[126480]: osdmap e1217: 12 total, 12 up, 12 in 2023-05-08T13:12:37.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:37 smithi133 ceph-mon[125939]: pgmap v18238: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T13:12:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:37 smithi133 ceph-mon[125939]: osdmap e1217: 12 total, 12 up, 12 in 2023-05-08T13:12:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:37 smithi096 ceph-mon[124666]: pgmap v18238: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T13:12:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:37 smithi096 ceph-mon[124666]: osdmap e1217: 12 total, 12 up, 12 in 2023-05-08T13:12:39.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:39 smithi186 ceph-mon[126480]: pgmap v18240: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T13:12:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34098.349740 secs 2023-05-08T13:12:39.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:39 smithi133 ceph-mon[125939]: pgmap v18240: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T13:12:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34098.349740 secs 2023-05-08T13:12:39.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:39 smithi096 ceph-mon[124666]: pgmap v18240: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T13:12:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34098.349740 secs 2023-05-08T13:12:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34098.903521 secs 2023-05-08T13:12:40.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34098.903521 secs 2023-05-08T13:12:40.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34098.903521 secs 2023-05-08T13:12:41.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:41 smithi186 ceph-mon[126480]: pgmap v18241: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 829 KiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T13:12:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34100.195819 secs 2023-05-08T13:12:41.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:41 smithi133 ceph-mon[125939]: pgmap v18241: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 829 KiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T13:12:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34100.195819 secs 2023-05-08T13:12:41.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:41 smithi096 ceph-mon[124666]: pgmap v18241: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 829 KiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T13:12:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34100.195819 secs 2023-05-08T13:12:43.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:43 smithi186 ceph-mon[126480]: pgmap v18242: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 829 KiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T13:12:43.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:43 smithi133 ceph-mon[125939]: pgmap v18242: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 829 KiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T13:12:43.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:43 smithi096 ceph-mon[124666]: pgmap v18242: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 829 KiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T13:12:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34103.349862 secs 2023-05-08T13:12:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34103.903637 secs 2023-05-08T13:12:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:45 smithi186 ceph-mon[126480]: pgmap v18243: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 607 KiB/s wr, 9 op/s 2023-05-08T13:12:45.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34103.349862 secs 2023-05-08T13:12:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34103.903637 secs 2023-05-08T13:12:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:45 smithi133 ceph-mon[125939]: pgmap v18243: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 607 KiB/s wr, 9 op/s 2023-05-08T13:12:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34103.349862 secs 2023-05-08T13:12:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34103.903637 secs 2023-05-08T13:12:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:45 smithi096 ceph-mon[124666]: pgmap v18243: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 607 KiB/s wr, 9 op/s 2023-05-08T13:12:47.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:47 smithi186 ceph-mon[126480]: pgmap v18244: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 607 KiB/s wr, 9 op/s 2023-05-08T13:12:47.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:47 smithi133 ceph-mon[125939]: pgmap v18244: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 607 KiB/s wr, 9 op/s 2023-05-08T13:12:47.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:47 smithi096 ceph-mon[124666]: pgmap v18244: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 607 KiB/s wr, 9 op/s 2023-05-08T13:12:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:49 smithi186 ceph-mon[126480]: pgmap v18245: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 396 KiB/s rd, 543 KiB/s wr, 8 op/s 2023-05-08T13:12:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34108.349991 secs 2023-05-08T13:12:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:12:49.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:49 smithi133 ceph-mon[125939]: pgmap v18245: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 396 KiB/s rd, 543 KiB/s wr, 8 op/s 2023-05-08T13:12:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34108.349991 secs 2023-05-08T13:12:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:12:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:49 smithi096 ceph-mon[124666]: pgmap v18245: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 396 KiB/s rd, 543 KiB/s wr, 8 op/s 2023-05-08T13:12:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34108.349991 secs 2023-05-08T13:12:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:12:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34108.903729 secs 2023-05-08T13:12:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:12:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:12:50.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:12:50.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34108.903729 secs 2023-05-08T13:12:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:12:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:12:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:12:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34108.903729 secs 2023-05-08T13:12:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:12:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:12:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:12:51.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:51 smithi186 ceph-mon[126480]: pgmap v18246: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 781 KiB/s rd, 778 KiB/s wr, 11 op/s 2023-05-08T13:12:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:51 smithi133 ceph-mon[125939]: pgmap v18246: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 781 KiB/s rd, 778 KiB/s wr, 11 op/s 2023-05-08T13:12:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:51 smithi096 ceph-mon[124666]: pgmap v18246: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 781 KiB/s rd, 778 KiB/s wr, 11 op/s 2023-05-08T13:12:53.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:53 smithi186 ceph-mon[126480]: pgmap v18247: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 725 KiB/s rd, 471 KiB/s wr, 7 op/s 2023-05-08T13:12:53.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:53 smithi133 ceph-mon[125939]: pgmap v18247: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 725 KiB/s rd, 471 KiB/s wr, 7 op/s 2023-05-08T13:12:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:53 smithi096 ceph-mon[124666]: pgmap v18247: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 725 KiB/s rd, 471 KiB/s wr, 7 op/s 2023-05-08T13:12:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34113.350115 secs 2023-05-08T13:12:54.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34113.350115 secs 2023-05-08T13:12:54.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34113.350115 secs 2023-05-08T13:12:55.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:55 smithi186 ceph-mon[126480]: pgmap v18248: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 955 KiB/s wr, 12 op/s 2023-05-08T13:12:55.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:55 smithi133 ceph-mon[125939]: pgmap v18248: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 955 KiB/s wr, 12 op/s 2023-05-08T13:12:55.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:55 smithi096 ceph-mon[124666]: pgmap v18248: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 955 KiB/s wr, 12 op/s 2023-05-08T13:12:57.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:57 smithi186 ceph-mon[126480]: pgmap v18249: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 923 KiB/s rd, 783 KiB/s wr, 9 op/s 2023-05-08T13:12:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:12:57.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:57 smithi133 ceph-mon[125939]: pgmap v18249: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 923 KiB/s rd, 783 KiB/s wr, 9 op/s 2023-05-08T13:12:57.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:12:57.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:57 smithi096 ceph-mon[124666]: pgmap v18249: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 923 KiB/s rd, 783 KiB/s wr, 9 op/s 2023-05-08T13:12:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:12:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:58 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:12:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:12:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:12:58.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:58 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:12:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:12:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:12:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:58 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:12:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:12:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:12:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:59 smithi186 ceph-mon[126480]: pgmap v18250: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 923 KiB/s rd, 783 KiB/s wr, 9 op/s 2023-05-08T13:12:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:12:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34118.350214 secs 2023-05-08T13:12:59.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:59 smithi133 ceph-mon[125939]: pgmap v18250: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 923 KiB/s rd, 783 KiB/s wr, 9 op/s 2023-05-08T13:12:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:12:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34118.350214 secs 2023-05-08T13:12:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:59 smithi096 ceph-mon[124666]: pgmap v18250: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 923 KiB/s rd, 783 KiB/s wr, 9 op/s 2023-05-08T13:12:59.806 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:12:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34118.350214 secs 2023-05-08T13:13:01.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:01 smithi186 ceph-mon[126480]: pgmap v18251: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 14 op/s 2023-05-08T13:13:01.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:01 smithi133 ceph-mon[125939]: pgmap v18251: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 14 op/s 2023-05-08T13:13:01.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:01 smithi096 ceph-mon[124666]: pgmap v18251: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 14 op/s 2023-05-08T13:13:03.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:03 smithi186 ceph-mon[126480]: pgmap v18252: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 771 KiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T13:13:03.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:03 smithi133 ceph-mon[125939]: pgmap v18252: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 771 KiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T13:13:03.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:03 smithi096 ceph-mon[124666]: pgmap v18252: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 771 KiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T13:13:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34123.350370 secs 2023-05-08T13:13:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34123.350370 secs 2023-05-08T13:13:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34123.350370 secs 2023-05-08T13:13:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34123.904093 secs 2023-05-08T13:13:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:05 smithi186 ceph-mon[126480]: pgmap v18253: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 31 op/s 2023-05-08T13:13:05.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34123.904093 secs 2023-05-08T13:13:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:05 smithi133 ceph-mon[125939]: pgmap v18253: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 31 op/s 2023-05-08T13:13:05.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34123.904093 secs 2023-05-08T13:13:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:05 smithi096 ceph-mon[124666]: pgmap v18253: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 31 op/s 2023-05-08T13:13:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:06 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:13:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:13:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:13:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34125.196409 secs 2023-05-08T13:13:06.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:06 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:13:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:13:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:13:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34125.196409 secs 2023-05-08T13:13:06.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:06 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:13:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:13:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:13:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34125.196409 secs 2023-05-08T13:13:07.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:07 smithi186 ceph-mon[126480]: pgmap v18254: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 27 op/s 2023-05-08T13:13:07.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:07 smithi133 ceph-mon[125939]: pgmap v18254: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 27 op/s 2023-05-08T13:13:07.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:07 smithi096 ceph-mon[124666]: pgmap v18254: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 27 op/s 2023-05-08T13:13:09.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:09 smithi186 ceph-mon[126480]: pgmap v18255: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 26 op/s 2023-05-08T13:13:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34128.350485 secs 2023-05-08T13:13:09.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:09 smithi133 ceph-mon[125939]: pgmap v18255: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 26 op/s 2023-05-08T13:13:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34128.350485 secs 2023-05-08T13:13:09.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:09 smithi096 ceph-mon[124666]: pgmap v18255: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 26 op/s 2023-05-08T13:13:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34128.350485 secs 2023-05-08T13:13:10.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:10 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:13:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:10 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:13:10.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:10 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:13:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:10 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:13:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:10 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:13:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:10 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:13:11.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:11 smithi133 ceph-mon[125939]: pgmap v18256: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 30 op/s 2023-05-08T13:13:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34130.196512 secs 2023-05-08T13:13:11.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:11 smithi096 ceph-mon[124666]: pgmap v18256: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 30 op/s 2023-05-08T13:13:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34130.196512 secs 2023-05-08T13:13:11.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:11 smithi186 ceph-mon[126480]: pgmap v18256: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 30 op/s 2023-05-08T13:13:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34130.196512 secs 2023-05-08T13:13:12.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:12 smithi133 ceph-mon[125939]: osdmap e1218: 12 total, 12 up, 12 in 2023-05-08T13:13:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:12 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:13:12.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:12 smithi096 ceph-mon[124666]: osdmap e1218: 12 total, 12 up, 12 in 2023-05-08T13:13:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:12 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:13:12.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:12 smithi186 ceph-mon[126480]: osdmap e1218: 12 total, 12 up, 12 in 2023-05-08T13:13:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:12 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:13:13.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:13 smithi133 ceph-mon[125939]: pgmap v18258: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 30 op/s 2023-05-08T13:13:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:13 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:13:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:13 smithi096 ceph-mon[124666]: pgmap v18258: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 30 op/s 2023-05-08T13:13:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:13 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:13:13.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:13 smithi186 ceph-mon[126480]: pgmap v18258: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 30 op/s 2023-05-08T13:13:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:13 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:13:14.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:14 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:13:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:14 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:13:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34133.350605 secs 2023-05-08T13:13:14.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:14 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:13:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:14 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:13:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34133.350605 secs 2023-05-08T13:13:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:14 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:13:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:14 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:13:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34133.350605 secs 2023-05-08T13:13:15.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:15 smithi133 ceph-mon[125939]: pgmap v18259: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 933 KiB/s rd, 777 KiB/s wr, 10 op/s 2023-05-08T13:13:15.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:15 smithi096 ceph-mon[124666]: pgmap v18259: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 933 KiB/s rd, 777 KiB/s wr, 10 op/s 2023-05-08T13:13:15.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:15 smithi186 ceph-mon[126480]: pgmap v18259: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 933 KiB/s rd, 777 KiB/s wr, 10 op/s 2023-05-08T13:13:16.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34135.196663 secs 2023-05-08T13:13:16.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34135.196663 secs 2023-05-08T13:13:16.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34135.196663 secs 2023-05-08T13:13:17.744 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:17 smithi133 ceph-mon[125939]: pgmap v18260: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 933 KiB/s rd, 745 KiB/s wr, 10 op/s 2023-05-08T13:13:17.744 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:17 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:13:17.744 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:17 smithi133 ceph-mon[125939]: osdmap e1219: 12 total, 12 up, 12 in 2023-05-08T13:13:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:17 smithi096 ceph-mon[124666]: pgmap v18260: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 933 KiB/s rd, 745 KiB/s wr, 10 op/s 2023-05-08T13:13:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:17 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:13:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:17 smithi096 ceph-mon[124666]: osdmap e1219: 12 total, 12 up, 12 in 2023-05-08T13:13:17.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:17 smithi186 ceph-mon[126480]: pgmap v18260: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 933 KiB/s rd, 745 KiB/s wr, 10 op/s 2023-05-08T13:13:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:17 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:13:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:17 smithi186 ceph-mon[126480]: osdmap e1219: 12 total, 12 up, 12 in 2023-05-08T13:13:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:19 smithi133 ceph-mon[125939]: pgmap v18262: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 791 KiB/s rd, 203 KiB/s wr, 6 op/s 2023-05-08T13:13:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34138.350705 secs 2023-05-08T13:13:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:19 smithi096 ceph-mon[124666]: pgmap v18262: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 791 KiB/s rd, 203 KiB/s wr, 6 op/s 2023-05-08T13:13:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34138.350705 secs 2023-05-08T13:13:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:19 smithi186 ceph-mon[126480]: pgmap v18262: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 791 KiB/s rd, 203 KiB/s wr, 6 op/s 2023-05-08T13:13:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34138.350705 secs 2023-05-08T13:13:21.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:21 smithi133 ceph-mon[125939]: pgmap v18263: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 537 KiB/s wr, 10 op/s 2023-05-08T13:13:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34140.196804 secs 2023-05-08T13:13:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:21 smithi096 ceph-mon[124666]: pgmap v18263: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 537 KiB/s wr, 10 op/s 2023-05-08T13:13:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34140.196804 secs 2023-05-08T13:13:21.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:21 smithi186 ceph-mon[126480]: pgmap v18263: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 537 KiB/s wr, 10 op/s 2023-05-08T13:13:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34140.196804 secs 2023-05-08T13:13:23.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:23 smithi186 ceph-mon[126480]: pgmap v18264: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 944 KiB/s rd, 505 KiB/s wr, 9 op/s 2023-05-08T13:13:23.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:23 smithi133 ceph-mon[125939]: pgmap v18264: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 944 KiB/s rd, 505 KiB/s wr, 9 op/s 2023-05-08T13:13:23.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:23 smithi096 ceph-mon[124666]: pgmap v18264: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 944 KiB/s rd, 505 KiB/s wr, 9 op/s 2023-05-08T13:13:24.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34143.350833 secs 2023-05-08T13:13:24.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34143.350833 secs 2023-05-08T13:13:24.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34143.350833 secs 2023-05-08T13:13:25.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34143.904606 secs 2023-05-08T13:13:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:25 smithi186 ceph-mon[126480]: pgmap v18265: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 738 KiB/s wr, 10 op/s 2023-05-08T13:13:25.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34143.904606 secs 2023-05-08T13:13:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:25 smithi133 ceph-mon[125939]: pgmap v18265: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 738 KiB/s wr, 10 op/s 2023-05-08T13:13:25.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34143.904606 secs 2023-05-08T13:13:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:25 smithi096 ceph-mon[124666]: pgmap v18265: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 738 KiB/s wr, 10 op/s 2023-05-08T13:13:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:26 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:13:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:26 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:13:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:26 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:13:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34145.196867 secs 2023-05-08T13:13:26.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:26 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:13:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:26 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:13:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:26 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:13:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34145.196867 secs 2023-05-08T13:13:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:26 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:13:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:26 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:13:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:26 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:13:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34145.196867 secs 2023-05-08T13:13:27.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:27 smithi186 ceph-mon[126480]: pgmap v18266: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 747 KiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T13:13:27.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:27 smithi133 ceph-mon[125939]: pgmap v18266: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 747 KiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T13:13:27.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:27 smithi096 ceph-mon[124666]: pgmap v18266: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 747 KiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T13:13:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:29 smithi186 ceph-mon[126480]: pgmap v18267: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 668 KiB/s rd, 995 KiB/s wr, 9 op/s 2023-05-08T13:13:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34148.350949 secs 2023-05-08T13:13:29.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:29 smithi133 ceph-mon[125939]: pgmap v18267: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 668 KiB/s rd, 995 KiB/s wr, 9 op/s 2023-05-08T13:13:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34148.350949 secs 2023-05-08T13:13:29.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:29 smithi096 ceph-mon[124666]: pgmap v18267: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 668 KiB/s rd, 995 KiB/s wr, 9 op/s 2023-05-08T13:13:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34148.350949 secs 2023-05-08T13:13:30.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34148.904723 secs 2023-05-08T13:13:30.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34148.904723 secs 2023-05-08T13:13:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34148.904723 secs 2023-05-08T13:13:31.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:31 smithi133 ceph-mon[125939]: pgmap v18268: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 931 KiB/s rd, 1.0 MiB/s wr, 12 op/s 2023-05-08T13:13:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34150.196945 secs 2023-05-08T13:13:31.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:31 smithi096 ceph-mon[124666]: pgmap v18268: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 931 KiB/s rd, 1.0 MiB/s wr, 12 op/s 2023-05-08T13:13:31.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34150.196945 secs 2023-05-08T13:13:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:31 smithi186 ceph-mon[126480]: pgmap v18268: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 931 KiB/s rd, 1.0 MiB/s wr, 12 op/s 2023-05-08T13:13:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34150.196945 secs 2023-05-08T13:13:33.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:33 smithi186 ceph-mon[126480]: pgmap v18269: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 697 KiB/s rd, 810 KiB/s wr, 9 op/s 2023-05-08T13:13:33.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:33 smithi133 ceph-mon[125939]: pgmap v18269: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 697 KiB/s rd, 810 KiB/s wr, 9 op/s 2023-05-08T13:13:33.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:33 smithi096 ceph-mon[124666]: pgmap v18269: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 697 KiB/s rd, 810 KiB/s wr, 9 op/s 2023-05-08T13:13:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:34 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:13:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:34 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:13:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:34 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:13:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:34 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:13:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:34 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:13:34.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:34 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T13:13:34.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:34 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T13:13:34.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:34 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:13:34.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:34 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:13:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:34 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:13:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:34 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:13:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:34 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:13:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:34 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:13:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:34 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T13:13:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:34 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T13:13:34.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:34 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:13:34.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:34 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:13:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:34 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:13:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:34 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:13:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:34 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:13:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:34 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:13:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:34 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T13:13:34.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:34 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T13:13:34.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:34 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:13:35.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34153.351089 secs 2023-05-08T13:13:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34153.904836 secs 2023-05-08T13:13:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:35 smithi186 ceph-mon[126480]: pgmap v18270: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 12 op/s 2023-05-08T13:13:35.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34153.351089 secs 2023-05-08T13:13:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34153.904836 secs 2023-05-08T13:13:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:35 smithi133 ceph-mon[125939]: pgmap v18270: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 12 op/s 2023-05-08T13:13:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34153.351089 secs 2023-05-08T13:13:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34153.904836 secs 2023-05-08T13:13:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:35 smithi096 ceph-mon[124666]: pgmap v18270: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 12 op/s 2023-05-08T13:13:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34155.197055 secs 2023-05-08T13:13:36.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34155.197055 secs 2023-05-08T13:13:36.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34155.197055 secs 2023-05-08T13:13:37.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:37 smithi186 ceph-mon[126480]: pgmap v18271: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 744 KiB/s wr, 10 op/s 2023-05-08T13:13:37.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:37 smithi133 ceph-mon[125939]: pgmap v18271: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 744 KiB/s wr, 10 op/s 2023-05-08T13:13:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:37 smithi096 ceph-mon[124666]: pgmap v18271: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 744 KiB/s wr, 10 op/s 2023-05-08T13:13:39.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:39 smithi186 ceph-mon[126480]: pgmap v18272: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 739 KiB/s rd, 431 KiB/s wr, 9 op/s 2023-05-08T13:13:39.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34158.351235 secs 2023-05-08T13:13:39.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:39 smithi133 ceph-mon[125939]: pgmap v18272: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 739 KiB/s rd, 431 KiB/s wr, 9 op/s 2023-05-08T13:13:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34158.351235 secs 2023-05-08T13:13:39.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:39 smithi096 ceph-mon[124666]: pgmap v18272: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 739 KiB/s rd, 431 KiB/s wr, 9 op/s 2023-05-08T13:13:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34158.351235 secs 2023-05-08T13:13:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34158.904948 secs 2023-05-08T13:13:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34158.904948 secs 2023-05-08T13:13:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34158.904948 secs 2023-05-08T13:13:41.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:41 smithi186 ceph-mon[126480]: pgmap v18273: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 740 KiB/s rd, 726 KiB/s wr, 11 op/s 2023-05-08T13:13:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34160.197148 secs 2023-05-08T13:13:41.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:41 smithi133 ceph-mon[125939]: pgmap v18273: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 740 KiB/s rd, 726 KiB/s wr, 11 op/s 2023-05-08T13:13:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34160.197148 secs 2023-05-08T13:13:41.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:41 smithi096 ceph-mon[124666]: pgmap v18273: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 740 KiB/s rd, 726 KiB/s wr, 11 op/s 2023-05-08T13:13:41.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34160.197148 secs 2023-05-08T13:13:43.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:43 smithi186 ceph-mon[126480]: pgmap v18274: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 432 KiB/s rd, 611 KiB/s wr, 8 op/s 2023-05-08T13:13:43.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:43 smithi133 ceph-mon[125939]: pgmap v18274: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 432 KiB/s rd, 611 KiB/s wr, 8 op/s 2023-05-08T13:13:43.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:43 smithi096 ceph-mon[124666]: pgmap v18274: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 432 KiB/s rd, 611 KiB/s wr, 8 op/s 2023-05-08T13:13:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34163.351378 secs 2023-05-08T13:13:44.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34163.351378 secs 2023-05-08T13:13:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34163.351378 secs 2023-05-08T13:13:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34163.905070 secs 2023-05-08T13:13:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:45 smithi186 ceph-mon[126480]: pgmap v18275: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 700 KiB/s rd, 592 KiB/s wr, 10 op/s 2023-05-08T13:13:45.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34163.905070 secs 2023-05-08T13:13:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:45 smithi133 ceph-mon[125939]: pgmap v18275: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 700 KiB/s rd, 592 KiB/s wr, 10 op/s 2023-05-08T13:13:45.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34163.905070 secs 2023-05-08T13:13:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:45 smithi096 ceph-mon[124666]: pgmap v18275: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 700 KiB/s rd, 592 KiB/s wr, 10 op/s 2023-05-08T13:13:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34165.197270 secs 2023-05-08T13:13:46.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34165.197270 secs 2023-05-08T13:13:46.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34165.197270 secs 2023-05-08T13:13:47.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:47 smithi186 ceph-mon[126480]: pgmap v18276: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 329 KiB/s wr, 7 op/s 2023-05-08T13:13:47.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:47 smithi133 ceph-mon[125939]: pgmap v18276: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 329 KiB/s wr, 7 op/s 2023-05-08T13:13:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:47 smithi096 ceph-mon[124666]: pgmap v18276: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 329 KiB/s wr, 7 op/s 2023-05-08T13:13:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:49 smithi186 ceph-mon[126480]: pgmap v18277: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 329 KiB/s wr, 6 op/s 2023-05-08T13:13:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34168.351471 secs 2023-05-08T13:13:49.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:49 smithi133 ceph-mon[125939]: pgmap v18277: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 329 KiB/s wr, 6 op/s 2023-05-08T13:13:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34168.351471 secs 2023-05-08T13:13:49.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:49 smithi096 ceph-mon[124666]: pgmap v18277: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 329 KiB/s wr, 6 op/s 2023-05-08T13:13:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34168.351471 secs 2023-05-08T13:13:51.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:51 smithi186 ceph-mon[126480]: pgmap v18278: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 912 KiB/s rd, 914 KiB/s wr, 10 op/s 2023-05-08T13:13:51.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:51 smithi133 ceph-mon[125939]: pgmap v18278: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 912 KiB/s rd, 914 KiB/s wr, 10 op/s 2023-05-08T13:13:51.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:51 smithi096 ceph-mon[124666]: pgmap v18278: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 912 KiB/s rd, 914 KiB/s wr, 10 op/s 2023-05-08T13:13:53.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:53 smithi186 ceph-mon[126480]: pgmap v18279: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 934 KiB/s rd, 619 KiB/s wr, 8 op/s 2023-05-08T13:13:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:53 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:13:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:53 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:13:53.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:53 smithi133 ceph-mon[125939]: pgmap v18279: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 934 KiB/s rd, 619 KiB/s wr, 8 op/s 2023-05-08T13:13:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:53 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:13:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:53 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:13:53.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:53 smithi096 ceph-mon[124666]: pgmap v18279: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 934 KiB/s rd, 619 KiB/s wr, 8 op/s 2023-05-08T13:13:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:53 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:13:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:53 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:13:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:54 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:13:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:54 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:13:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:54 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:13:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:54 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:13:54.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:54 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:13:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:54 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:13:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:54 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:13:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:54 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:13:54.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:54 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:13:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:54 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:13:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:54 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:13:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:54 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:13:55.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34173.351590 secs 2023-05-08T13:13:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:55 smithi186 ceph-mon[126480]: pgmap v18280: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T13:13:55.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34173.351590 secs 2023-05-08T13:13:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:55 smithi133 ceph-mon[125939]: pgmap v18280: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T13:13:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34173.351590 secs 2023-05-08T13:13:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:55 smithi096 ceph-mon[124666]: pgmap v18280: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T13:13:57.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:57 smithi186 ceph-mon[126480]: pgmap v18281: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 958 KiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T13:13:57.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:57 smithi133 ceph-mon[125939]: pgmap v18281: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 958 KiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T13:13:57.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:57 smithi096 ceph-mon[124666]: pgmap v18281: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 958 KiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T13:13:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:59 smithi186 ceph-mon[126480]: pgmap v18282: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 958 KiB/s rd, 1.2 MiB/s wr, 9 op/s 2023-05-08T13:13:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:13:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34178.351670 secs 2023-05-08T13:13:59.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:59 smithi133 ceph-mon[125939]: pgmap v18282: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 958 KiB/s rd, 1.2 MiB/s wr, 9 op/s 2023-05-08T13:13:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:13:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34178.351670 secs 2023-05-08T13:13:59.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:59 smithi096 ceph-mon[124666]: pgmap v18282: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 958 KiB/s rd, 1.2 MiB/s wr, 9 op/s 2023-05-08T13:13:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:13:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34178.351670 secs 2023-05-08T13:14:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34178.905489 secs 2023-05-08T13:14:00.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34178.905489 secs 2023-05-08T13:14:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34178.905489 secs 2023-05-08T13:14:01.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:01 smithi186 ceph-mon[126480]: pgmap v18283: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.4 MiB/s wr, 14 op/s 2023-05-08T13:14:01.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:01 smithi133 ceph-mon[125939]: pgmap v18283: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.4 MiB/s wr, 14 op/s 2023-05-08T13:14:01.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:01 smithi096 ceph-mon[124666]: pgmap v18283: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.4 MiB/s wr, 14 op/s 2023-05-08T13:14:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:02 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:14:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:14:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:14:02.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:02 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:14:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:14:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:14:02.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:02 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:14:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:14:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:14:03.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:03 smithi186 ceph-mon[126480]: pgmap v18284: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 828 KiB/s wr, 11 op/s 2023-05-08T13:14:03.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:03 smithi133 ceph-mon[125939]: pgmap v18284: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 828 KiB/s wr, 11 op/s 2023-05-08T13:14:03.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:03 smithi096 ceph-mon[124666]: pgmap v18284: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 828 KiB/s wr, 11 op/s 2023-05-08T13:14:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34183.351801 secs 2023-05-08T13:14:04.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34183.351801 secs 2023-05-08T13:14:04.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34183.351801 secs 2023-05-08T13:14:05.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34183.905574 secs 2023-05-08T13:14:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:05 smithi186 ceph-mon[126480]: pgmap v18285: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.1 MiB/s wr, 15 op/s 2023-05-08T13:14:05.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34183.905574 secs 2023-05-08T13:14:05.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:05 smithi133 ceph-mon[125939]: pgmap v18285: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.1 MiB/s wr, 15 op/s 2023-05-08T13:14:05.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34183.905574 secs 2023-05-08T13:14:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:05 smithi096 ceph-mon[124666]: pgmap v18285: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.1 MiB/s wr, 15 op/s 2023-05-08T13:14:07.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:07 smithi186 ceph-mon[126480]: pgmap v18286: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 513 KiB/s wr, 11 op/s 2023-05-08T13:14:07.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:07 smithi133 ceph-mon[125939]: pgmap v18286: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 513 KiB/s wr, 11 op/s 2023-05-08T13:14:07.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:07 smithi096 ceph-mon[124666]: pgmap v18286: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 513 KiB/s wr, 11 op/s 2023-05-08T13:14:09.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:09 smithi186 ceph-mon[126480]: pgmap v18287: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 513 KiB/s wr, 11 op/s 2023-05-08T13:14:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34188.351922 secs 2023-05-08T13:14:09.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:09 smithi133 ceph-mon[125939]: pgmap v18287: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 513 KiB/s wr, 11 op/s 2023-05-08T13:14:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34188.351922 secs 2023-05-08T13:14:09.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:09 smithi096 ceph-mon[124666]: pgmap v18287: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 513 KiB/s wr, 11 op/s 2023-05-08T13:14:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34188.351922 secs 2023-05-08T13:14:11.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:11 smithi186 ceph-mon[126480]: pgmap v18288: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.2 MiB/s wr, 26 op/s 2023-05-08T13:14:11.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:11 smithi133 ceph-mon[125939]: pgmap v18288: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.2 MiB/s wr, 26 op/s 2023-05-08T13:14:11.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:11 smithi096 ceph-mon[124666]: pgmap v18288: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.2 MiB/s wr, 26 op/s 2023-05-08T13:14:13.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:13 smithi186 ceph-mon[126480]: pgmap v18289: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 22 op/s 2023-05-08T13:14:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:13 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:14:13.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:13 smithi133 ceph-mon[125939]: pgmap v18289: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 22 op/s 2023-05-08T13:14:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:13 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:14:13.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:13 smithi096 ceph-mon[124666]: pgmap v18289: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 22 op/s 2023-05-08T13:14:13.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:13 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:14:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:14 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:14:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:14 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:14:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:14 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:14:14.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:14 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:14:14.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:14 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:14:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:14 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:14:14.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:14 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:14:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:14 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:14:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:14 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:14:15.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34193.352039 secs 2023-05-08T13:14:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:15 smithi186 ceph-mon[126480]: pgmap v18290: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 25 op/s 2023-05-08T13:14:15.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34193.352039 secs 2023-05-08T13:14:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:15 smithi133 ceph-mon[125939]: pgmap v18290: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 25 op/s 2023-05-08T13:14:15.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34193.352039 secs 2023-05-08T13:14:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:15 smithi096 ceph-mon[124666]: pgmap v18290: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 25 op/s 2023-05-08T13:14:17.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:17 smithi186 ceph-mon[126480]: pgmap v18291: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 826 KiB/s rd, 835 KiB/s wr, 20 op/s 2023-05-08T13:14:17.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:17 smithi133 ceph-mon[125939]: pgmap v18291: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 826 KiB/s rd, 835 KiB/s wr, 20 op/s 2023-05-08T13:14:17.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:17 smithi096 ceph-mon[124666]: pgmap v18291: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 826 KiB/s rd, 835 KiB/s wr, 20 op/s 2023-05-08T13:14:19.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:19 smithi186 ceph-mon[126480]: pgmap v18292: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 802 KiB/s rd, 811 KiB/s wr, 19 op/s 2023-05-08T13:14:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34198.352157 secs 2023-05-08T13:14:19.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:19 smithi133 ceph-mon[125939]: pgmap v18292: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 802 KiB/s rd, 811 KiB/s wr, 19 op/s 2023-05-08T13:14:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34198.352157 secs 2023-05-08T13:14:19.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:19 smithi096 ceph-mon[124666]: pgmap v18292: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 802 KiB/s rd, 811 KiB/s wr, 19 op/s 2023-05-08T13:14:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34198.352157 secs 2023-05-08T13:14:21.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:21 smithi186 ceph-mon[126480]: pgmap v18293: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 22 op/s 2023-05-08T13:14:21.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:21 smithi133 ceph-mon[125939]: pgmap v18293: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 22 op/s 2023-05-08T13:14:21.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:21 smithi096 ceph-mon[124666]: pgmap v18293: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 22 op/s 2023-05-08T13:14:23.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:23 smithi186 ceph-mon[126480]: pgmap v18294: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 826 KiB/s rd, 396 KiB/s wr, 7 op/s 2023-05-08T13:14:23.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:23 smithi133 ceph-mon[125939]: pgmap v18294: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 826 KiB/s rd, 396 KiB/s wr, 7 op/s 2023-05-08T13:14:23.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:23 smithi096 ceph-mon[124666]: pgmap v18294: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 826 KiB/s rd, 396 KiB/s wr, 7 op/s 2023-05-08T13:14:24.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34203.352256 secs 2023-05-08T13:14:24.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34203.352256 secs 2023-05-08T13:14:24.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34203.352256 secs 2023-05-08T13:14:25.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34203.906031 secs 2023-05-08T13:14:25.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:25 smithi186 ceph-mon[126480]: pgmap v18295: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 949 KiB/s wr, 14 op/s 2023-05-08T13:14:25.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34203.906031 secs 2023-05-08T13:14:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:25 smithi133 ceph-mon[125939]: pgmap v18295: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 949 KiB/s wr, 14 op/s 2023-05-08T13:14:25.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34203.906031 secs 2023-05-08T13:14:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:25 smithi096 ceph-mon[124666]: pgmap v18295: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 949 KiB/s wr, 14 op/s 2023-05-08T13:14:26.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:26 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:14:26.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:26 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:14:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:26 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:14:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34205.198192 secs 2023-05-08T13:14:26.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:26 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:14:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:26 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:14:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:26 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:14:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34205.198192 secs 2023-05-08T13:14:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:26 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:14:26.923 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:26 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:14:26.923 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:26 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:14:26.924 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34205.198192 secs 2023-05-08T13:14:27.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:27 smithi133 ceph-mon[125939]: pgmap v18296: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 814 KiB/s wr, 12 op/s 2023-05-08T13:14:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:27 smithi096 ceph-mon[124666]: pgmap v18296: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 814 KiB/s wr, 12 op/s 2023-05-08T13:14:27.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:27 smithi186 ceph-mon[126480]: pgmap v18296: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 814 KiB/s wr, 12 op/s 2023-05-08T13:14:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:29 smithi133 ceph-mon[125939]: pgmap v18297: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 814 KiB/s wr, 11 op/s 2023-05-08T13:14:29.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34208.352427 secs 2023-05-08T13:14:29.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:29 smithi096 ceph-mon[124666]: pgmap v18297: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 814 KiB/s wr, 11 op/s 2023-05-08T13:14:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34208.352427 secs 2023-05-08T13:14:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:29 smithi186 ceph-mon[126480]: pgmap v18297: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 814 KiB/s wr, 11 op/s 2023-05-08T13:14:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34208.352427 secs 2023-05-08T13:14:30.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34208.906169 secs 2023-05-08T13:14:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:30 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:14:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:30 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:14:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34208.906169 secs 2023-05-08T13:14:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:30 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:14:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:30 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:14:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34208.906169 secs 2023-05-08T13:14:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:30 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:14:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:30 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:14:31.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:31 smithi133 ceph-mon[125939]: pgmap v18298: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 998 KiB/s wr, 15 op/s 2023-05-08T13:14:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34210.198317 secs 2023-05-08T13:14:31.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:31 smithi096 ceph-mon[124666]: pgmap v18298: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 998 KiB/s wr, 15 op/s 2023-05-08T13:14:31.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34210.198317 secs 2023-05-08T13:14:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:31 smithi186 ceph-mon[126480]: pgmap v18298: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 998 KiB/s wr, 15 op/s 2023-05-08T13:14:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34210.198317 secs 2023-05-08T13:14:32.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:32 smithi133 ceph-mon[125939]: osdmap e1220: 12 total, 12 up, 12 in 2023-05-08T13:14:32.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:32 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:14:32.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:32 smithi096 ceph-mon[124666]: osdmap e1220: 12 total, 12 up, 12 in 2023-05-08T13:14:32.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:32 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:14:32.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:32 smithi186 ceph-mon[126480]: osdmap e1220: 12 total, 12 up, 12 in 2023-05-08T13:14:32.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:32 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:14:33.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:33 smithi133 ceph-mon[125939]: pgmap v18300: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 886 KiB/s wr, 14 op/s 2023-05-08T13:14:33.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:33 smithi096 ceph-mon[124666]: pgmap v18300: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 886 KiB/s wr, 14 op/s 2023-05-08T13:14:33.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:33 smithi186 ceph-mon[126480]: pgmap v18300: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 886 KiB/s wr, 14 op/s 2023-05-08T13:14:34.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34213.352544 secs 2023-05-08T13:14:34.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:34 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:14:34.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34213.352544 secs 2023-05-08T13:14:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:34 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:14:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34213.352544 secs 2023-05-08T13:14:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:34 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:14:35.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34213.906268 secs 2023-05-08T13:14:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:35 smithi133 ceph-mon[125939]: pgmap v18301: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 752 KiB/s rd, 750 KiB/s wr, 11 op/s 2023-05-08T13:14:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:14:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:14:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:35 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:14:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:14:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:35 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T13:14:35.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:35 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T13:14:35.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:35 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:14:35.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34213.906268 secs 2023-05-08T13:14:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:35 smithi096 ceph-mon[124666]: pgmap v18301: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 752 KiB/s rd, 750 KiB/s wr, 11 op/s 2023-05-08T13:14:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:14:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:14:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:35 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:14:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:14:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:35 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T13:14:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:35 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T13:14:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:35 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:14:35.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34213.906268 secs 2023-05-08T13:14:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:35 smithi186 ceph-mon[126480]: pgmap v18301: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 752 KiB/s rd, 750 KiB/s wr, 11 op/s 2023-05-08T13:14:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:14:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:14:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:35 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:14:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:14:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:35 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T13:14:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:35 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T13:14:35.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:35 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:14:36.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34215.198434 secs 2023-05-08T13:14:36.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34215.198434 secs 2023-05-08T13:14:36.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34215.198434 secs 2023-05-08T13:14:37.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:37 smithi133 ceph-mon[125939]: pgmap v18302: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 753 KiB/s rd, 751 KiB/s wr, 11 op/s 2023-05-08T13:14:37.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:37 smithi133 ceph-mon[125939]: osdmap e1221: 12 total, 12 up, 12 in 2023-05-08T13:14:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:37 smithi096 ceph-mon[124666]: pgmap v18302: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 753 KiB/s rd, 751 KiB/s wr, 11 op/s 2023-05-08T13:14:37.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:37 smithi096 ceph-mon[124666]: osdmap e1221: 12 total, 12 up, 12 in 2023-05-08T13:14:37.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:37 smithi186 ceph-mon[126480]: pgmap v18302: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 753 KiB/s rd, 751 KiB/s wr, 11 op/s 2023-05-08T13:14:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:37 smithi186 ceph-mon[126480]: osdmap e1221: 12 total, 12 up, 12 in 2023-05-08T13:14:39.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:39 smithi133 ceph-mon[125939]: pgmap v18304: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 663 KiB/s rd, 662 KiB/s wr, 7 op/s 2023-05-08T13:14:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34218.352658 secs 2023-05-08T13:14:39.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:39 smithi096 ceph-mon[124666]: pgmap v18304: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 663 KiB/s rd, 662 KiB/s wr, 7 op/s 2023-05-08T13:14:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34218.352658 secs 2023-05-08T13:14:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:39 smithi186 ceph-mon[126480]: pgmap v18304: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 663 KiB/s rd, 662 KiB/s wr, 7 op/s 2023-05-08T13:14:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34218.352658 secs 2023-05-08T13:14:40.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34218.906388 secs 2023-05-08T13:14:40.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34218.906388 secs 2023-05-08T13:14:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34218.906388 secs 2023-05-08T13:14:41.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:41 smithi133 ceph-mon[125939]: pgmap v18305: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T13:14:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34220.198535 secs 2023-05-08T13:14:41.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:41 smithi096 ceph-mon[124666]: pgmap v18305: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T13:14:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34220.198535 secs 2023-05-08T13:14:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:41 smithi186 ceph-mon[126480]: pgmap v18305: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T13:14:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34220.198535 secs 2023-05-08T13:14:43.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:43 smithi186 ceph-mon[126480]: pgmap v18306: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T13:14:43.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:43 smithi133 ceph-mon[125939]: pgmap v18306: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T13:14:43.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:43 smithi096 ceph-mon[124666]: pgmap v18306: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T13:14:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34223.352739 secs 2023-05-08T13:14:44.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34223.352739 secs 2023-05-08T13:14:44.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34223.352739 secs 2023-05-08T13:14:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34223.906505 secs 2023-05-08T13:14:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:45 smithi186 ceph-mon[126480]: pgmap v18307: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 817 KiB/s rd, 815 KiB/s wr, 9 op/s 2023-05-08T13:14:45.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34223.906505 secs 2023-05-08T13:14:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:45 smithi133 ceph-mon[125939]: pgmap v18307: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 817 KiB/s rd, 815 KiB/s wr, 9 op/s 2023-05-08T13:14:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34223.906505 secs 2023-05-08T13:14:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:45 smithi096 ceph-mon[124666]: pgmap v18307: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 817 KiB/s rd, 815 KiB/s wr, 9 op/s 2023-05-08T13:14:46.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34225.198676 secs 2023-05-08T13:14:46.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34225.198676 secs 2023-05-08T13:14:46.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34225.198676 secs 2023-05-08T13:14:47.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:47 smithi133 ceph-mon[125939]: pgmap v18308: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 817 KiB/s rd, 815 KiB/s wr, 9 op/s 2023-05-08T13:14:47.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:47 smithi096 ceph-mon[124666]: pgmap v18308: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 817 KiB/s rd, 815 KiB/s wr, 9 op/s 2023-05-08T13:14:47.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:47 smithi186 ceph-mon[126480]: pgmap v18308: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 817 KiB/s rd, 815 KiB/s wr, 9 op/s 2023-05-08T13:14:49.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:49 smithi133 ceph-mon[125939]: pgmap v18309: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 730 KiB/s rd, 728 KiB/s wr, 8 op/s 2023-05-08T13:14:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34228.352839 secs 2023-05-08T13:14:49.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:49 smithi096 ceph-mon[124666]: pgmap v18309: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 730 KiB/s rd, 728 KiB/s wr, 8 op/s 2023-05-08T13:14:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34228.352839 secs 2023-05-08T13:14:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:49 smithi186 ceph-mon[126480]: pgmap v18309: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 730 KiB/s rd, 728 KiB/s wr, 8 op/s 2023-05-08T13:14:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34228.352839 secs 2023-05-08T13:14:50.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34228.906618 secs 2023-05-08T13:14:50.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34228.906618 secs 2023-05-08T13:14:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34228.906618 secs 2023-05-08T13:14:51.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:51 smithi133 ceph-mon[125939]: pgmap v18310: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 917 KiB/s wr, 10 op/s 2023-05-08T13:14:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34230.198817 secs 2023-05-08T13:14:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:51 smithi096 ceph-mon[124666]: pgmap v18310: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 917 KiB/s wr, 10 op/s 2023-05-08T13:14:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34230.198817 secs 2023-05-08T13:14:51.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:51 smithi186 ceph-mon[126480]: pgmap v18310: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 917 KiB/s wr, 10 op/s 2023-05-08T13:14:51.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34230.198817 secs 2023-05-08T13:14:53.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:53 smithi186 ceph-mon[126480]: pgmap v18311: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 607 KiB/s rd, 574 KiB/s wr, 8 op/s 2023-05-08T13:14:53.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:53 smithi133 ceph-mon[125939]: pgmap v18311: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 607 KiB/s rd, 574 KiB/s wr, 8 op/s 2023-05-08T13:14:53.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:53 smithi096 ceph-mon[124666]: pgmap v18311: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 607 KiB/s rd, 574 KiB/s wr, 8 op/s 2023-05-08T13:14:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34233.352918 secs 2023-05-08T13:14:54.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34233.352918 secs 2023-05-08T13:14:54.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34233.352918 secs 2023-05-08T13:14:55.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:55 smithi186 ceph-mon[126480]: pgmap v18312: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 915 KiB/s wr, 11 op/s 2023-05-08T13:14:55.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:55 smithi133 ceph-mon[125939]: pgmap v18312: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 915 KiB/s wr, 11 op/s 2023-05-08T13:14:55.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:55 smithi096 ceph-mon[124666]: pgmap v18312: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 915 KiB/s wr, 11 op/s 2023-05-08T13:14:56.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34235.198917 secs 2023-05-08T13:14:56.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34235.198917 secs 2023-05-08T13:14:56.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34235.198917 secs 2023-05-08T13:14:57.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:57 smithi133 ceph-mon[125939]: pgmap v18313: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 946 KiB/s wr, 9 op/s 2023-05-08T13:14:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:14:57.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:57 smithi096 ceph-mon[124666]: pgmap v18313: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 946 KiB/s wr, 9 op/s 2023-05-08T13:14:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:14:57.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:57 smithi186 ceph-mon[126480]: pgmap v18313: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 946 KiB/s wr, 9 op/s 2023-05-08T13:14:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:14:58.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:58 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:14:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:14:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:14:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:58 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:14:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:14:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:14:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:58 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:14:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:14:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:14:59.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:59 smithi133 ceph-mon[125939]: pgmap v18314: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 946 KiB/s wr, 8 op/s 2023-05-08T13:14:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:14:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34238.353039 secs 2023-05-08T13:14:59.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:59 smithi096 ceph-mon[124666]: pgmap v18314: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 946 KiB/s wr, 8 op/s 2023-05-08T13:14:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:14:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34238.353039 secs 2023-05-08T13:14:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:59 smithi186 ceph-mon[126480]: pgmap v18314: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 946 KiB/s wr, 8 op/s 2023-05-08T13:14:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:14:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34238.353039 secs 2023-05-08T13:15:01.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:01 smithi133 ceph-mon[125939]: pgmap v18315: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 13 op/s 2023-05-08T13:15:01.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:01 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:15:01.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:01 smithi096 ceph-mon[124666]: pgmap v18315: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 13 op/s 2023-05-08T13:15:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:01 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:15:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:01 smithi186 ceph-mon[126480]: pgmap v18315: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 13 op/s 2023-05-08T13:15:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:01 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:15:02.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:15:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:15:02.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:15:02.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:15:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:15:02.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:15:03.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:03 smithi133 ceph-mon[125939]: pgmap v18316: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T13:15:03.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:03 smithi096 ceph-mon[124666]: pgmap v18316: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T13:15:03.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:03 smithi186 ceph-mon[126480]: pgmap v18316: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T13:15:04.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34243.353150 secs 2023-05-08T13:15:04.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34243.353150 secs 2023-05-08T13:15:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34243.353150 secs 2023-05-08T13:15:05.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34243.906997 secs 2023-05-08T13:15:05.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:05 smithi133 ceph-mon[125939]: pgmap v18317: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 30 op/s 2023-05-08T13:15:05.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34243.906997 secs 2023-05-08T13:15:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:05 smithi096 ceph-mon[124666]: pgmap v18317: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 30 op/s 2023-05-08T13:15:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34243.906997 secs 2023-05-08T13:15:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:05 smithi186 ceph-mon[126480]: pgmap v18317: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 30 op/s 2023-05-08T13:15:06.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:06 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:15:06.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:15:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:15:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34245.199122 secs 2023-05-08T13:15:06.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:06 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:15:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:15:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:15:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34245.199122 secs 2023-05-08T13:15:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:06 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:15:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:15:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:15:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34245.199122 secs 2023-05-08T13:15:07.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:07 smithi133 ceph-mon[125939]: pgmap v18318: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 27 op/s 2023-05-08T13:15:07.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:07 smithi096 ceph-mon[124666]: pgmap v18318: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 27 op/s 2023-05-08T13:15:07.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:07 smithi186 ceph-mon[126480]: pgmap v18318: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 27 op/s 2023-05-08T13:15:09.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:09 smithi133 ceph-mon[125939]: pgmap v18319: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1010 KiB/s wr, 25 op/s 2023-05-08T13:15:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34248.353274 secs 2023-05-08T13:15:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:09 smithi096 ceph-mon[124666]: pgmap v18319: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1010 KiB/s wr, 25 op/s 2023-05-08T13:15:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34248.353274 secs 2023-05-08T13:15:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:09 smithi186 ceph-mon[126480]: pgmap v18319: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1010 KiB/s wr, 25 op/s 2023-05-08T13:15:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34248.353274 secs 2023-05-08T13:15:10.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:10 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:15:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:10 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:15:10.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:10 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:15:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:10 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:15:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:10 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:15:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:10 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:15:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:11 smithi133 ceph-mon[125939]: pgmap v18320: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.4 MiB/s wr, 30 op/s 2023-05-08T13:15:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34250.199241 secs 2023-05-08T13:15:11.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:11 smithi096 ceph-mon[124666]: pgmap v18320: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.4 MiB/s wr, 30 op/s 2023-05-08T13:15:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34250.199241 secs 2023-05-08T13:15:11.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:11 smithi186 ceph-mon[126480]: pgmap v18320: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.4 MiB/s wr, 30 op/s 2023-05-08T13:15:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34250.199241 secs 2023-05-08T13:15:12.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:12 smithi133 ceph-mon[125939]: osdmap e1222: 12 total, 12 up, 12 in 2023-05-08T13:15:12.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:12 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:15:12.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:12 smithi096 ceph-mon[124666]: osdmap e1222: 12 total, 12 up, 12 in 2023-05-08T13:15:12.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:12 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:15:12.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:12 smithi186 ceph-mon[126480]: osdmap e1222: 12 total, 12 up, 12 in 2023-05-08T13:15:12.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:12 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:15:13.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:13 smithi133 ceph-mon[125939]: pgmap v18322: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.3 MiB/s wr, 30 op/s 2023-05-08T13:15:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:13 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:15:13.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:13 smithi096 ceph-mon[124666]: pgmap v18322: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.3 MiB/s wr, 30 op/s 2023-05-08T13:15:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:13 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:15:13.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:13 smithi186 ceph-mon[126480]: pgmap v18322: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.3 MiB/s wr, 30 op/s 2023-05-08T13:15:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:13 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:15:14.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:14 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:15:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:14 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:15:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34253.353415 secs 2023-05-08T13:15:14.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:14 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:15:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:14 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:15:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34253.353415 secs 2023-05-08T13:15:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:14 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:15:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:14 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:15:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34253.353415 secs 2023-05-08T13:15:15.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:15 smithi133 ceph-mon[125939]: pgmap v18323: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 945 KiB/s wr, 12 op/s 2023-05-08T13:15:15.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:15 smithi096 ceph-mon[124666]: pgmap v18323: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 945 KiB/s wr, 12 op/s 2023-05-08T13:15:15.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:15 smithi186 ceph-mon[126480]: pgmap v18323: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 945 KiB/s wr, 12 op/s 2023-05-08T13:15:16.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34255.199360 secs 2023-05-08T13:15:16.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34255.199360 secs 2023-05-08T13:15:16.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34255.199360 secs 2023-05-08T13:15:17.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:17 smithi133 ceph-mon[125939]: pgmap v18324: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 916 KiB/s wr, 11 op/s 2023-05-08T13:15:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:17 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:15:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:17 smithi133 ceph-mon[125939]: osdmap e1223: 12 total, 12 up, 12 in 2023-05-08T13:15:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:17 smithi096 ceph-mon[124666]: pgmap v18324: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 916 KiB/s wr, 11 op/s 2023-05-08T13:15:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:17 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:15:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:17 smithi096 ceph-mon[124666]: osdmap e1223: 12 total, 12 up, 12 in 2023-05-08T13:15:17.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:17 smithi186 ceph-mon[126480]: pgmap v18324: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 916 KiB/s wr, 11 op/s 2023-05-08T13:15:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:17 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:15:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:17 smithi186 ceph-mon[126480]: osdmap e1223: 12 total, 12 up, 12 in 2023-05-08T13:15:19.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:19 smithi133 ceph-mon[125939]: pgmap v18326: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 477 KiB/s rd, 475 KiB/s wr, 7 op/s 2023-05-08T13:15:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34258.353526 secs 2023-05-08T13:15:19.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:19 smithi096 ceph-mon[124666]: pgmap v18326: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 477 KiB/s rd, 475 KiB/s wr, 7 op/s 2023-05-08T13:15:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34258.353526 secs 2023-05-08T13:15:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:19 smithi186 ceph-mon[126480]: pgmap v18326: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 477 KiB/s rd, 475 KiB/s wr, 7 op/s 2023-05-08T13:15:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34258.353526 secs 2023-05-08T13:15:21.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:21 smithi133 ceph-mon[125939]: pgmap v18327: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 430 KiB/s wr, 10 op/s 2023-05-08T13:15:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34260.199422 secs 2023-05-08T13:15:21.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:21 smithi096 ceph-mon[124666]: pgmap v18327: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 430 KiB/s wr, 10 op/s 2023-05-08T13:15:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34260.199422 secs 2023-05-08T13:15:21.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:21 smithi186 ceph-mon[126480]: pgmap v18327: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 430 KiB/s wr, 10 op/s 2023-05-08T13:15:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34260.199422 secs 2023-05-08T13:15:23.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:23 smithi186 ceph-mon[126480]: pgmap v18328: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 409 KiB/s wr, 10 op/s 2023-05-08T13:15:23.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:23 smithi133 ceph-mon[125939]: pgmap v18328: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 409 KiB/s wr, 10 op/s 2023-05-08T13:15:23.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:23 smithi096 ceph-mon[124666]: pgmap v18328: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 409 KiB/s wr, 10 op/s 2023-05-08T13:15:24.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34263.353618 secs 2023-05-08T13:15:24.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34263.353618 secs 2023-05-08T13:15:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34263.353618 secs 2023-05-08T13:15:25.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34263.907444 secs 2023-05-08T13:15:25.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:25 smithi133 ceph-mon[125939]: pgmap v18329: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 811 KiB/s rd, 809 KiB/s wr, 10 op/s 2023-05-08T13:15:25.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34263.907444 secs 2023-05-08T13:15:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:25 smithi096 ceph-mon[124666]: pgmap v18329: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 811 KiB/s rd, 809 KiB/s wr, 10 op/s 2023-05-08T13:15:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34263.907444 secs 2023-05-08T13:15:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:25 smithi186 ceph-mon[126480]: pgmap v18329: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 811 KiB/s rd, 809 KiB/s wr, 10 op/s 2023-05-08T13:15:26.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:26 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:15:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:26 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:15:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:26 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:15:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34265.199524 secs 2023-05-08T13:15:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:26 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:15:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:26 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:15:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:26 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:15:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34265.199524 secs 2023-05-08T13:15:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:26 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:15:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:26 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:15:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:26 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:15:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34265.199524 secs 2023-05-08T13:15:27.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:27 smithi133 ceph-mon[125939]: pgmap v18330: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 811 KiB/s rd, 809 KiB/s wr, 10 op/s 2023-05-08T13:15:27.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:27 smithi096 ceph-mon[124666]: pgmap v18330: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 811 KiB/s rd, 809 KiB/s wr, 10 op/s 2023-05-08T13:15:27.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:27 smithi186 ceph-mon[126480]: pgmap v18330: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 811 KiB/s rd, 809 KiB/s wr, 10 op/s 2023-05-08T13:15:29.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:29 smithi133 ceph-mon[125939]: pgmap v18331: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 724 KiB/s rd, 722 KiB/s wr, 9 op/s 2023-05-08T13:15:29.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34268.353736 secs 2023-05-08T13:15:29.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:29 smithi096 ceph-mon[124666]: pgmap v18331: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 724 KiB/s rd, 722 KiB/s wr, 9 op/s 2023-05-08T13:15:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34268.353736 secs 2023-05-08T13:15:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:29 smithi186 ceph-mon[126480]: pgmap v18331: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 724 KiB/s rd, 722 KiB/s wr, 9 op/s 2023-05-08T13:15:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34268.353736 secs 2023-05-08T13:15:30.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34268.907561 secs 2023-05-08T13:15:30.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34268.907561 secs 2023-05-08T13:15:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34268.907561 secs 2023-05-08T13:15:31.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:31 smithi133 ceph-mon[125939]: pgmap v18332: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 843 KiB/s rd, 841 KiB/s wr, 12 op/s 2023-05-08T13:15:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34270.199622 secs 2023-05-08T13:15:31.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:31 smithi096 ceph-mon[124666]: pgmap v18332: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 843 KiB/s rd, 841 KiB/s wr, 12 op/s 2023-05-08T13:15:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34270.199622 secs 2023-05-08T13:15:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:31 smithi186 ceph-mon[126480]: pgmap v18332: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 843 KiB/s rd, 841 KiB/s wr, 12 op/s 2023-05-08T13:15:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34270.199622 secs 2023-05-08T13:15:33.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:33 smithi186 ceph-mon[126480]: pgmap v18333: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 842 KiB/s rd, 840 KiB/s wr, 9 op/s 2023-05-08T13:15:33.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:33 smithi133 ceph-mon[125939]: pgmap v18333: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 842 KiB/s rd, 840 KiB/s wr, 9 op/s 2023-05-08T13:15:33.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:33 smithi096 ceph-mon[124666]: pgmap v18333: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 842 KiB/s rd, 840 KiB/s wr, 9 op/s 2023-05-08T13:15:34.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34273.353852 secs 2023-05-08T13:15:34.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34273.353852 secs 2023-05-08T13:15:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34273.353852 secs 2023-05-08T13:15:35.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34273.907699 secs 2023-05-08T13:15:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:35 smithi133 ceph-mon[125939]: pgmap v18334: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T13:15:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:15:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34273.907699 secs 2023-05-08T13:15:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:35 smithi096 ceph-mon[124666]: pgmap v18334: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T13:15:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:15:35.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34273.907699 secs 2023-05-08T13:15:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:35 smithi186 ceph-mon[126480]: pgmap v18334: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T13:15:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:15:36.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34275.199769 secs 2023-05-08T13:15:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34275.199769 secs 2023-05-08T13:15:36.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34275.199769 secs 2023-05-08T13:15:37.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:37 smithi133 ceph-mon[125939]: pgmap v18335: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 434 KiB/s wr, 8 op/s 2023-05-08T13:15:37.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:37 smithi096 ceph-mon[124666]: pgmap v18335: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 434 KiB/s wr, 8 op/s 2023-05-08T13:15:37.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:37 smithi186 ceph-mon[126480]: pgmap v18335: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 434 KiB/s wr, 8 op/s 2023-05-08T13:15:38.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:15:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:15:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:15:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:15:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:15:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:15:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:15:38.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:15:38.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:15:38.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:15:38.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:15:38.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:15:38.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:15:38.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:15:38.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:15:38.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:15:38.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:15:38.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:15:38.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:15:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:15:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:15:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:15:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:15:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:15:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:15:38.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:15:38.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:15:38.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:15:38.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:15:38.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:15:38.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:15:38.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:15:38.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:15:38.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:15:38.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:15:38.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:15:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:15:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:15:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:15:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:15:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:15:39.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:15:39.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:15:39.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:15:39.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:15:39.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:15:39.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:15:39.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:15:39.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:15:39.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:15:39.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:15:39.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:15:39.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:15:39.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:15:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:39 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi186 to 109.1M 2023-05-08T13:15:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:39 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi186 to 114501570: error parsing value: Value '114501570' is below minimum 939524096 2023-05-08T13:15:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:39 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi133 to 120.4M 2023-05-08T13:15:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:39 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi133 to 126295527: error parsing value: Value '126295527' is below minimum 939524096 2023-05-08T13:15:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:39 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:15:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:39 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T13:15:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:39 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T13:15:39.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:39 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:15:39.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:39 smithi186 ceph-mon[126480]: pgmap v18336: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 434 KiB/s wr, 8 op/s 2023-05-08T13:15:39.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34278.353968 secs 2023-05-08T13:15:39.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:39 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi186 to 109.1M 2023-05-08T13:15:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:39 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi186 to 114501570: error parsing value: Value '114501570' is below minimum 939524096 2023-05-08T13:15:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:39 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi133 to 120.4M 2023-05-08T13:15:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:39 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi133 to 126295527: error parsing value: Value '126295527' is below minimum 939524096 2023-05-08T13:15:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:39 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:15:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:39 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T13:15:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:39 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T13:15:39.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:39 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:15:39.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:39 smithi133 ceph-mon[125939]: pgmap v18336: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 434 KiB/s wr, 8 op/s 2023-05-08T13:15:39.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34278.353968 secs 2023-05-08T13:15:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:39 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi186 to 109.1M 2023-05-08T13:15:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:39 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi186 to 114501570: error parsing value: Value '114501570' is below minimum 939524096 2023-05-08T13:15:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:39 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi133 to 120.4M 2023-05-08T13:15:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:39 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi133 to 126295527: error parsing value: Value '126295527' is below minimum 939524096 2023-05-08T13:15:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:39 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:15:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:39 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T13:15:40.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:39 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T13:15:40.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:39 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:15:40.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:39 smithi096 ceph-mon[124666]: pgmap v18336: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 434 KiB/s wr, 8 op/s 2023-05-08T13:15:40.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34278.353968 secs 2023-05-08T13:15:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34278.907783 secs 2023-05-08T13:15:40.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34278.907783 secs 2023-05-08T13:15:41.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34278.907783 secs 2023-05-08T13:15:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:41 smithi186 ceph-mon[126480]: pgmap v18337: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 434 KiB/s wr, 11 op/s 2023-05-08T13:15:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34280.199909 secs 2023-05-08T13:15:41.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:41 smithi133 ceph-mon[125939]: pgmap v18337: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 434 KiB/s wr, 11 op/s 2023-05-08T13:15:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34280.199909 secs 2023-05-08T13:15:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:41 smithi096 ceph-mon[124666]: pgmap v18337: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 434 KiB/s wr, 11 op/s 2023-05-08T13:15:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34280.199909 secs 2023-05-08T13:15:43.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:43 smithi186 ceph-mon[126480]: pgmap v18338: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 268 KiB/s wr, 8 op/s 2023-05-08T13:15:43.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:43 smithi133 ceph-mon[125939]: pgmap v18338: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 268 KiB/s wr, 8 op/s 2023-05-08T13:15:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:43 smithi096 ceph-mon[124666]: pgmap v18338: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 268 KiB/s wr, 8 op/s 2023-05-08T13:15:44.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34283.354086 secs 2023-05-08T13:15:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34283.354086 secs 2023-05-08T13:15:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34283.354086 secs 2023-05-08T13:15:45.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34283.907891 secs 2023-05-08T13:15:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:45 smithi133 ceph-mon[125939]: pgmap v18339: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 655 KiB/s rd, 652 KiB/s wr, 10 op/s 2023-05-08T13:15:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34283.907891 secs 2023-05-08T13:15:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:45 smithi096 ceph-mon[124666]: pgmap v18339: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 655 KiB/s rd, 652 KiB/s wr, 10 op/s 2023-05-08T13:15:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34283.907891 secs 2023-05-08T13:15:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:45 smithi186 ceph-mon[126480]: pgmap v18339: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 655 KiB/s rd, 652 KiB/s wr, 10 op/s 2023-05-08T13:15:46.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34285.200026 secs 2023-05-08T13:15:46.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34285.200026 secs 2023-05-08T13:15:46.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34285.200026 secs 2023-05-08T13:15:47.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:47 smithi133 ceph-mon[125939]: pgmap v18340: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 409 KiB/s wr, 7 op/s 2023-05-08T13:15:47.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:47 smithi096 ceph-mon[124666]: pgmap v18340: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 409 KiB/s wr, 7 op/s 2023-05-08T13:15:47.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:47 smithi186 ceph-mon[126480]: pgmap v18340: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 409 KiB/s wr, 7 op/s 2023-05-08T13:15:49.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:49 smithi133 ceph-mon[125939]: pgmap v18341: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 409 KiB/s wr, 7 op/s 2023-05-08T13:15:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34288.354222 secs 2023-05-08T13:15:49.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:49 smithi096 ceph-mon[124666]: pgmap v18341: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 409 KiB/s wr, 7 op/s 2023-05-08T13:15:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34288.354222 secs 2023-05-08T13:15:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:49 smithi186 ceph-mon[126480]: pgmap v18341: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 409 KiB/s wr, 7 op/s 2023-05-08T13:15:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34288.354222 secs 2023-05-08T13:15:51.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:51 smithi133 ceph-mon[125939]: pgmap v18342: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 922 KiB/s wr, 11 op/s 2023-05-08T13:15:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34290.200124 secs 2023-05-08T13:15:51.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:51 smithi096 ceph-mon[124666]: pgmap v18342: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 922 KiB/s wr, 11 op/s 2023-05-08T13:15:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34290.200124 secs 2023-05-08T13:15:51.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:51 smithi186 ceph-mon[126480]: pgmap v18342: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 922 KiB/s wr, 11 op/s 2023-05-08T13:15:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34290.200124 secs 2023-05-08T13:15:53.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:53 smithi186 ceph-mon[126480]: pgmap v18343: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 922 KiB/s wr, 9 op/s 2023-05-08T13:15:53.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:53 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:15:53.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:53 smithi133 ceph-mon[125939]: pgmap v18343: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 922 KiB/s wr, 9 op/s 2023-05-08T13:15:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:53 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:15:53.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:53 smithi096 ceph-mon[124666]: pgmap v18343: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 922 KiB/s wr, 9 op/s 2023-05-08T13:15:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:53 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:15:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:54 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:15:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:54 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:15:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:54 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:15:54.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:54 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:15:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:54 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:15:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:54 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:15:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:54 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:15:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:54 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:15:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:54 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:15:55.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34293.354356 secs 2023-05-08T13:15:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:55 smithi186 ceph-mon[126480]: pgmap v18344: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2023-05-08T13:15:55.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34293.354356 secs 2023-05-08T13:15:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:55 smithi133 ceph-mon[125939]: pgmap v18344: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2023-05-08T13:15:55.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34293.354356 secs 2023-05-08T13:15:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:55 smithi096 ceph-mon[124666]: pgmap v18344: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2023-05-08T13:15:57.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:57 smithi186 ceph-mon[126480]: pgmap v18345: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T13:15:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:15:57.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:57 smithi133 ceph-mon[125939]: pgmap v18345: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T13:15:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:15:57.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:57 smithi096 ceph-mon[124666]: pgmap v18345: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T13:15:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:15:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:15:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:15:58.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:15:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:15:58.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:15:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:15:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:59 smithi186 ceph-mon[126480]: pgmap v18346: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T13:15:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:15:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34298.354477 secs 2023-05-08T13:15:59.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:59 smithi133 ceph-mon[125939]: pgmap v18346: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T13:15:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:15:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34298.354477 secs 2023-05-08T13:15:59.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:59 smithi096 ceph-mon[124666]: pgmap v18346: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T13:15:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:15:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34298.354477 secs 2023-05-08T13:16:00.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34298.908194 secs 2023-05-08T13:16:00.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34298.908194 secs 2023-05-08T13:16:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34298.908194 secs 2023-05-08T13:16:01.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:01 smithi133 ceph-mon[125939]: pgmap v18347: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.4 MiB/s wr, 14 op/s 2023-05-08T13:16:01.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:01 smithi096 ceph-mon[124666]: pgmap v18347: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.4 MiB/s wr, 14 op/s 2023-05-08T13:16:01.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:01 smithi186 ceph-mon[126480]: pgmap v18347: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.4 MiB/s wr, 14 op/s 2023-05-08T13:16:02.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:02 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:16:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:16:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:16:02.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:02 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:16:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:16:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:16:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:02 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:16:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:16:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:16:03.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:03 smithi133 ceph-mon[125939]: pgmap v18348: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 982 KiB/s rd, 925 KiB/s wr, 11 op/s 2023-05-08T13:16:03.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:03 smithi096 ceph-mon[124666]: pgmap v18348: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 982 KiB/s rd, 925 KiB/s wr, 11 op/s 2023-05-08T13:16:03.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:03 smithi186 ceph-mon[126480]: pgmap v18348: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 982 KiB/s rd, 925 KiB/s wr, 11 op/s 2023-05-08T13:16:04.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34303.354565 secs 2023-05-08T13:16:04.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34303.354565 secs 2023-05-08T13:16:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34303.354565 secs 2023-05-08T13:16:05.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:05 smithi133 ceph-mon[125939]: pgmap v18349: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 16 op/s 2023-05-08T13:16:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:05 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:16:05.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:05 smithi096 ceph-mon[124666]: pgmap v18349: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 16 op/s 2023-05-08T13:16:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:05 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:16:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:05 smithi186 ceph-mon[126480]: pgmap v18349: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 16 op/s 2023-05-08T13:16:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:05 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:16:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:16:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:16:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34305.200506 secs 2023-05-08T13:16:06.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:16:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:16:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34305.200506 secs 2023-05-08T13:16:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:16:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:16:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34305.200506 secs 2023-05-08T13:16:07.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:07 smithi133 ceph-mon[125939]: pgmap v18350: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T13:16:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:07 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:16:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:07 smithi096 ceph-mon[124666]: pgmap v18350: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T13:16:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:07 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:16:07.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:07 smithi186 ceph-mon[126480]: pgmap v18350: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T13:16:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:07 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:16:09.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:09 smithi133 ceph-mon[125939]: pgmap v18351: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T13:16:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34308.354629 secs 2023-05-08T13:16:09.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:09 smithi096 ceph-mon[124666]: pgmap v18351: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T13:16:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34308.354629 secs 2023-05-08T13:16:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:09 smithi186 ceph-mon[126480]: pgmap v18351: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T13:16:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34308.354629 secs 2023-05-08T13:16:10.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34308.908462 secs 2023-05-08T13:16:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:10 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:16:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:10 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:16:10.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34308.908462 secs 2023-05-08T13:16:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:10 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:16:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:10 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:16:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34308.908462 secs 2023-05-08T13:16:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:10 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:16:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:10 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:16:11.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:11 smithi133 ceph-mon[125939]: pgmap v18352: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 28 op/s 2023-05-08T13:16:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34310.200622 secs 2023-05-08T13:16:11.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:11 smithi096 ceph-mon[124666]: pgmap v18352: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 28 op/s 2023-05-08T13:16:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34310.200622 secs 2023-05-08T13:16:11.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:11 smithi186 ceph-mon[126480]: pgmap v18352: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 28 op/s 2023-05-08T13:16:11.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34310.200622 secs 2023-05-08T13:16:12.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:12 smithi133 ceph-mon[125939]: osdmap e1224: 12 total, 12 up, 12 in 2023-05-08T13:16:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:12 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:16:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:12 smithi096 ceph-mon[124666]: osdmap e1224: 12 total, 12 up, 12 in 2023-05-08T13:16:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:12 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:16:12.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:12 smithi186 ceph-mon[126480]: osdmap e1224: 12 total, 12 up, 12 in 2023-05-08T13:16:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:12 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:16:13.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:13 smithi133 ceph-mon[125939]: pgmap v18354: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 30 op/s 2023-05-08T13:16:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:13 smithi096 ceph-mon[124666]: pgmap v18354: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 30 op/s 2023-05-08T13:16:13.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:13 smithi186 ceph-mon[126480]: pgmap v18354: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 30 op/s 2023-05-08T13:16:14.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:14 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:16:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:14 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:16:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34313.354748 secs 2023-05-08T13:16:14.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:14 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:16:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:14 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:16:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34313.354748 secs 2023-05-08T13:16:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:14 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:16:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:14 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:16:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34313.354748 secs 2023-05-08T13:16:15.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34313.908578 secs 2023-05-08T13:16:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:15 smithi133 ceph-mon[125939]: pgmap v18355: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 895 KiB/s rd, 959 KiB/s wr, 25 op/s 2023-05-08T13:16:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34313.908578 secs 2023-05-08T13:16:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:15 smithi096 ceph-mon[124666]: pgmap v18355: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 895 KiB/s rd, 959 KiB/s wr, 25 op/s 2023-05-08T13:16:15.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34313.908578 secs 2023-05-08T13:16:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:15 smithi186 ceph-mon[126480]: pgmap v18355: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 895 KiB/s rd, 959 KiB/s wr, 25 op/s 2023-05-08T13:16:16.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34315.200733 secs 2023-05-08T13:16:16.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34315.200733 secs 2023-05-08T13:16:16.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34315.200733 secs 2023-05-08T13:16:17.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:17 smithi133 ceph-mon[125939]: pgmap v18356: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 594 KiB/s wr, 25 op/s 2023-05-08T13:16:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:17 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:16:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:17 smithi133 ceph-mon[125939]: osdmap e1225: 12 total, 12 up, 12 in 2023-05-08T13:16:17.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:17 smithi096 ceph-mon[124666]: pgmap v18356: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 594 KiB/s wr, 25 op/s 2023-05-08T13:16:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:17 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:16:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:17 smithi096 ceph-mon[124666]: osdmap e1225: 12 total, 12 up, 12 in 2023-05-08T13:16:17.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:17 smithi186 ceph-mon[126480]: pgmap v18356: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 594 KiB/s wr, 25 op/s 2023-05-08T13:16:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:17 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:16:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:17 smithi186 ceph-mon[126480]: osdmap e1225: 12 total, 12 up, 12 in 2023-05-08T13:16:19.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:19 smithi133 ceph-mon[125939]: pgmap v18358: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 473 KiB/s wr, 7 op/s 2023-05-08T13:16:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34318.354873 secs 2023-05-08T13:16:19.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:19 smithi096 ceph-mon[124666]: pgmap v18358: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 473 KiB/s wr, 7 op/s 2023-05-08T13:16:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34318.354873 secs 2023-05-08T13:16:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:19 smithi186 ceph-mon[126480]: pgmap v18358: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 473 KiB/s wr, 7 op/s 2023-05-08T13:16:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34318.354873 secs 2023-05-08T13:16:20.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34318.908693 secs 2023-05-08T13:16:20.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34318.908693 secs 2023-05-08T13:16:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34318.908693 secs 2023-05-08T13:16:21.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:21 smithi133 ceph-mon[125939]: pgmap v18359: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 375 KiB/s wr, 8 op/s 2023-05-08T13:16:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34320.200852 secs 2023-05-08T13:16:21.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:21 smithi096 ceph-mon[124666]: pgmap v18359: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 375 KiB/s wr, 8 op/s 2023-05-08T13:16:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34320.200852 secs 2023-05-08T13:16:21.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:21 smithi186 ceph-mon[126480]: pgmap v18359: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 375 KiB/s wr, 8 op/s 2023-05-08T13:16:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34320.200852 secs 2023-05-08T13:16:23.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:23 smithi186 ceph-mon[126480]: pgmap v18360: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 410 KiB/s rd, 362 KiB/s wr, 8 op/s 2023-05-08T13:16:23.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:23 smithi133 ceph-mon[125939]: pgmap v18360: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 410 KiB/s rd, 362 KiB/s wr, 8 op/s 2023-05-08T13:16:23.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:23 smithi096 ceph-mon[124666]: pgmap v18360: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 410 KiB/s rd, 362 KiB/s wr, 8 op/s 2023-05-08T13:16:24.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34323.354996 secs 2023-05-08T13:16:24.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34323.354996 secs 2023-05-08T13:16:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34323.354996 secs 2023-05-08T13:16:25.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34323.908812 secs 2023-05-08T13:16:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:25 smithi133 ceph-mon[125939]: pgmap v18361: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 164 KiB/s wr, 8 op/s 2023-05-08T13:16:25.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34323.908812 secs 2023-05-08T13:16:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:25 smithi096 ceph-mon[124666]: pgmap v18361: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 164 KiB/s wr, 8 op/s 2023-05-08T13:16:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34323.908812 secs 2023-05-08T13:16:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:25 smithi186 ceph-mon[126480]: pgmap v18361: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 164 KiB/s wr, 8 op/s 2023-05-08T13:16:26.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34325.200975 secs 2023-05-08T13:16:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34325.200975 secs 2023-05-08T13:16:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34325.200975 secs 2023-05-08T13:16:27.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:27 smithi133 ceph-mon[125939]: pgmap v18362: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 164 KiB/s wr, 8 op/s 2023-05-08T13:16:27.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:27 smithi096 ceph-mon[124666]: pgmap v18362: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 164 KiB/s wr, 8 op/s 2023-05-08T13:16:27.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:27 smithi186 ceph-mon[126480]: pgmap v18362: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 164 KiB/s wr, 8 op/s 2023-05-08T13:16:29.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:29 smithi133 ceph-mon[125939]: pgmap v18363: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 147 KiB/s wr, 7 op/s 2023-05-08T13:16:29.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34328.355141 secs 2023-05-08T13:16:29.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:29 smithi096 ceph-mon[124666]: pgmap v18363: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 147 KiB/s wr, 7 op/s 2023-05-08T13:16:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34328.355141 secs 2023-05-08T13:16:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:29 smithi186 ceph-mon[126480]: pgmap v18363: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 147 KiB/s wr, 7 op/s 2023-05-08T13:16:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34328.355141 secs 2023-05-08T13:16:30.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34328.908928 secs 2023-05-08T13:16:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34328.908928 secs 2023-05-08T13:16:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34328.908928 secs 2023-05-08T13:16:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:31 smithi133 ceph-mon[125939]: pgmap v18364: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 160 KiB/s wr, 10 op/s 2023-05-08T13:16:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34330.201092 secs 2023-05-08T13:16:31.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:31 smithi096 ceph-mon[124666]: pgmap v18364: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 160 KiB/s wr, 10 op/s 2023-05-08T13:16:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34330.201092 secs 2023-05-08T13:16:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:31 smithi186 ceph-mon[126480]: pgmap v18364: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 160 KiB/s wr, 10 op/s 2023-05-08T13:16:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34330.201092 secs 2023-05-08T13:16:33.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:33 smithi186 ceph-mon[126480]: pgmap v18365: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 159 KiB/s wr, 8 op/s 2023-05-08T13:16:33.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:33 smithi133 ceph-mon[125939]: pgmap v18365: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 159 KiB/s wr, 8 op/s 2023-05-08T13:16:33.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:33 smithi096 ceph-mon[124666]: pgmap v18365: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 159 KiB/s wr, 8 op/s 2023-05-08T13:16:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34333.355288 secs 2023-05-08T13:16:34.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34333.355288 secs 2023-05-08T13:16:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34333.355288 secs 2023-05-08T13:16:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34333.909046 secs 2023-05-08T13:16:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:35 smithi133 ceph-mon[125939]: pgmap v18366: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 136 KiB/s wr, 10 op/s 2023-05-08T13:16:35.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34333.909046 secs 2023-05-08T13:16:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:35 smithi096 ceph-mon[124666]: pgmap v18366: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 136 KiB/s wr, 10 op/s 2023-05-08T13:16:35.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34333.909046 secs 2023-05-08T13:16:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:35 smithi186 ceph-mon[126480]: pgmap v18366: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 136 KiB/s wr, 10 op/s 2023-05-08T13:16:36.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34335.201193 secs 2023-05-08T13:16:36.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34335.201193 secs 2023-05-08T13:16:36.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34335.201193 secs 2023-05-08T13:16:37.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:37 smithi133 ceph-mon[125939]: pgmap v18367: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 8 op/s 2023-05-08T13:16:37.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:37 smithi096 ceph-mon[124666]: pgmap v18367: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 8 op/s 2023-05-08T13:16:37.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:37 smithi186 ceph-mon[126480]: pgmap v18367: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 8 op/s 2023-05-08T13:16:38.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:16:38.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:16:38.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:16:39.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:39 smithi133 ceph-mon[125939]: pgmap v18368: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 7 op/s 2023-05-08T13:16:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34338.355443 secs 2023-05-08T13:16:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:16:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:16:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:39 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:16:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:16:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:39 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T13:16:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:39 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T13:16:39.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:39 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:16:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:39 smithi096 ceph-mon[124666]: pgmap v18368: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 7 op/s 2023-05-08T13:16:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34338.355443 secs 2023-05-08T13:16:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:16:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:16:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:39 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:16:39.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:16:39.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:39 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T13:16:39.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:39 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T13:16:39.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:39 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:16:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:39 smithi186 ceph-mon[126480]: pgmap v18368: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 7 op/s 2023-05-08T13:16:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34338.355443 secs 2023-05-08T13:16:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:16:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:16:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:39 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:16:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:16:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:39 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T13:16:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:39 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T13:16:39.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:39 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:16:40.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34338.909130 secs 2023-05-08T13:16:40.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34338.909130 secs 2023-05-08T13:16:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34338.909130 secs 2023-05-08T13:16:41.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:41 smithi133 ceph-mon[125939]: pgmap v18369: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 322 KiB/s wr, 10 op/s 2023-05-08T13:16:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34340.201326 secs 2023-05-08T13:16:41.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:41 smithi096 ceph-mon[124666]: pgmap v18369: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 322 KiB/s wr, 10 op/s 2023-05-08T13:16:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34340.201326 secs 2023-05-08T13:16:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:41 smithi186 ceph-mon[126480]: pgmap v18369: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 322 KiB/s wr, 10 op/s 2023-05-08T13:16:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34340.201326 secs 2023-05-08T13:16:43.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:43 smithi133 ceph-mon[125939]: pgmap v18370: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 299 KiB/s wr, 8 op/s 2023-05-08T13:16:43.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:43 smithi096 ceph-mon[124666]: pgmap v18370: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 299 KiB/s wr, 8 op/s 2023-05-08T13:16:43.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:43 smithi186 ceph-mon[126480]: pgmap v18370: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 299 KiB/s wr, 8 op/s 2023-05-08T13:16:44.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34343.355559 secs 2023-05-08T13:16:44.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34343.355559 secs 2023-05-08T13:16:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34343.355559 secs 2023-05-08T13:16:45.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34343.909227 secs 2023-05-08T13:16:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:45 smithi133 ceph-mon[125939]: pgmap v18371: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 300 KiB/s wr, 10 op/s 2023-05-08T13:16:45.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34343.909227 secs 2023-05-08T13:16:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:45 smithi096 ceph-mon[124666]: pgmap v18371: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 300 KiB/s wr, 10 op/s 2023-05-08T13:16:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34343.909227 secs 2023-05-08T13:16:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:45 smithi186 ceph-mon[126480]: pgmap v18371: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 300 KiB/s wr, 10 op/s 2023-05-08T13:16:46.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34345.201472 secs 2023-05-08T13:16:46.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34345.201472 secs 2023-05-08T13:16:46.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34345.201472 secs 2023-05-08T13:16:47.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:47 smithi133 ceph-mon[125939]: pgmap v18372: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 324 KiB/s wr, 7 op/s 2023-05-08T13:16:47.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:47 smithi096 ceph-mon[124666]: pgmap v18372: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 324 KiB/s wr, 7 op/s 2023-05-08T13:16:47.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:47 smithi186 ceph-mon[126480]: pgmap v18372: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 324 KiB/s wr, 7 op/s 2023-05-08T13:16:49.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:49 smithi133 ceph-mon[125939]: pgmap v18373: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 323 KiB/s wr, 7 op/s 2023-05-08T13:16:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34348.355687 secs 2023-05-08T13:16:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:49 smithi096 ceph-mon[124666]: pgmap v18373: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 323 KiB/s wr, 7 op/s 2023-05-08T13:16:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34348.355687 secs 2023-05-08T13:16:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:49 smithi186 ceph-mon[126480]: pgmap v18373: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 323 KiB/s wr, 7 op/s 2023-05-08T13:16:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34348.355687 secs 2023-05-08T13:16:51.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:51 smithi133 ceph-mon[125939]: pgmap v18374: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 803 KiB/s rd, 820 KiB/s wr, 11 op/s 2023-05-08T13:16:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34350.201557 secs 2023-05-08T13:16:51.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:51 smithi096 ceph-mon[124666]: pgmap v18374: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 803 KiB/s rd, 820 KiB/s wr, 11 op/s 2023-05-08T13:16:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34350.201557 secs 2023-05-08T13:16:51.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:51 smithi186 ceph-mon[126480]: pgmap v18374: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 803 KiB/s rd, 820 KiB/s wr, 11 op/s 2023-05-08T13:16:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34350.201557 secs 2023-05-08T13:16:53.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:53 smithi133 ceph-mon[125939]: pgmap v18375: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 528 KiB/s rd, 522 KiB/s wr, 8 op/s 2023-05-08T13:16:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:53 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:16:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:53 smithi096 ceph-mon[124666]: pgmap v18375: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 528 KiB/s rd, 522 KiB/s wr, 8 op/s 2023-05-08T13:16:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:53 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:16:53.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:53 smithi186 ceph-mon[126480]: pgmap v18375: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 528 KiB/s rd, 522 KiB/s wr, 8 op/s 2023-05-08T13:16:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:53 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:16:54.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:54 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:16:54.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:54 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:16:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:54 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:16:54.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:54 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:16:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:54 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:16:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:54 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:16:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:54 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:16:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:54 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:16:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:54 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:16:55.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34353.355819 secs 2023-05-08T13:16:55.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:55 smithi133 ceph-mon[125939]: pgmap v18376: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1024 KiB/s rd, 1.4 MiB/s wr, 13 op/s 2023-05-08T13:16:55.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34353.355819 secs 2023-05-08T13:16:55.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:55 smithi096 ceph-mon[124666]: pgmap v18376: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1024 KiB/s rd, 1.4 MiB/s wr, 13 op/s 2023-05-08T13:16:55.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34353.355819 secs 2023-05-08T13:16:55.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:55 smithi186 ceph-mon[126480]: pgmap v18376: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1024 KiB/s rd, 1.4 MiB/s wr, 13 op/s 2023-05-08T13:16:57.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:57 smithi133 ceph-mon[125939]: pgmap v18377: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1022 KiB/s rd, 1.4 MiB/s wr, 11 op/s 2023-05-08T13:16:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:16:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:57 smithi096 ceph-mon[124666]: pgmap v18377: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1022 KiB/s rd, 1.4 MiB/s wr, 11 op/s 2023-05-08T13:16:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:16:57.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:57 smithi186 ceph-mon[126480]: pgmap v18377: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1022 KiB/s rd, 1.4 MiB/s wr, 11 op/s 2023-05-08T13:16:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:16:58.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:16:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:16:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:16:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:16:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:16:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:16:59.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:59 smithi133 ceph-mon[125939]: pgmap v18378: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1022 KiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T13:16:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:16:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34358.355944 secs 2023-05-08T13:16:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:59 smithi096 ceph-mon[124666]: pgmap v18378: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1022 KiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T13:16:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:16:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34358.355944 secs 2023-05-08T13:16:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:59 smithi186 ceph-mon[126480]: pgmap v18378: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1022 KiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T13:16:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:16:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34358.355944 secs 2023-05-08T13:17:00.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:17:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34358.909604 secs 2023-05-08T13:17:00.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:17:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34358.909604 secs 2023-05-08T13:17:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:17:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34358.909604 secs 2023-05-08T13:17:01.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:17:01 smithi133 ceph-mon[125939]: pgmap v18379: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 15 op/s 2023-05-08T13:17:01.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:17:01 smithi096 ceph-mon[124666]: pgmap v18379: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 15 op/s 2023-05-08T13:17:01.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:17:01 smithi186 ceph-mon[126480]: pgmap v18379: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 15 op/s 2023-05-08T13:17:02.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:17:02 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:17:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:17:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:17:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:17:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:17:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:17:02 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:17:02.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:17:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:17:02.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:17:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:17:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:17:02 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:17:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:17:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:17:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:17:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:17:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:17:03 smithi133 ceph-mon[125939]: pgmap v18380: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 957 KiB/s rd, 912 KiB/s wr, 11 op/s 2023-05-08T13:17:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:17:03 smithi096 ceph-mon[124666]: pgmap v18380: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 957 KiB/s rd, 912 KiB/s wr, 11 op/s 2023-05-08T13:17:03.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:17:03 smithi186 ceph-mon[126480]: pgmap v18380: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 957 KiB/s rd, 912 KiB/s wr, 11 op/s 2023-05-08T13:17:04.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:17:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34363.356044 secs 2023-05-08T13:17:04.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:17:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34363.356044 secs 2023-05-08T13:17:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:17:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34363.356044 secs 2023-05-08T13:17:05.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:17:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34363.909711 secs 2023-05-08T13:17:05.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:17:05 smithi133 ceph-mon[125939]: pgmap v18381: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 27 op/s 2023-05-08T13:17:05.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:17:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34363.909711 secs 2023-05-08T13:17:05.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:17:05 smithi096 ceph-mon[124666]: pgmap v18381: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 27 op/s 2023-05-08T13:17:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:17:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34363.909711 secs 2023-05-08T13:17:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:17:05 smithi186 ceph-mon[126480]: pgmap v18381: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 27 op/s 2023-05-08T13:17:07.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:17:07 smithi133 ceph-mon[125939]: pgmap v18382: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 667 KiB/s wr, 22 op/s 2023-05-08T13:17:07.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:17:07 smithi096 ceph-mon[124666]: pgmap v18382: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 667 KiB/s wr, 22 op/s 2023-05-08T13:17:07.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:17:07 smithi186 ceph-mon[126480]: pgmap v18382: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 667 KiB/s wr, 22 op/s 2023-05-08T13:17:09.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:17:09 smithi133 ceph-mon[125939]: pgmap v18383: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 667 KiB/s wr, 22 op/s 2023-05-08T13:17:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:17:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34368.356184 secs 2023-05-08T13:17:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:17:09 smithi096 ceph-mon[124666]: pgmap v18383: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 667 KiB/s wr, 22 op/s 2023-05-08T13:17:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:17:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34368.356184 secs 2023-05-08T13:17:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:17:09 smithi186 ceph-mon[126480]: pgmap v18383: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 667 KiB/s wr, 22 op/s 2023-05-08T13:17:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:17:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34368.356184 secs 2023-05-08T13:17:10.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:17:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34368.909825 secs 2023-05-08T13:17:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:17:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34368.909825 secs 2023-05-08T13:17:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:17:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34368.909825 secs 2023-05-08T13:17:11.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:17:11 smithi133 ceph-mon[125939]: pgmap v18384: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 882 KiB/s wr, 25 op/s 2023-05-08T13:17:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:17:11 smithi096 ceph-mon[124666]: pgmap v18384: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 882 KiB/s wr, 25 op/s 2023-05-08T13:17:11.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:17:11 smithi186 ceph-mon[126480]: pgmap v18384: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 882 KiB/s wr, 25 op/s 2023-05-08T13:17:13.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:17:13 smithi133 ceph-mon[125939]: pgmap v18385: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 704 KiB/s rd, 844 KiB/s wr, 21 op/s 2023-05-08T13:17:13.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:17:13 smithi096 ceph-mon[124666]: pgmap v18385: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 704 KiB/s rd, 844 KiB/s wr, 21 op/s 2023-05-08T13:17:13.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:17:13 smithi186 ceph-mon[126480]: pgmap v18385: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 704 KiB/s rd, 844 KiB/s wr, 21 op/s 2023-05-08T13:17:14.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:17:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34373.356302 secs 2023-05-08T13:17:14.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:17:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34373.356302 secs 2023-05-08T13:17:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:17:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34373.356302 secs 2023-05-08T13:17:15.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:17:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34373.909936 secs 2023-05-08T13:17:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:17:15 smithi133 ceph-mon[125939]: pgmap v18386: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 24 op/s 2023-05-08T13:17:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:17:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34373.909936 secs 2023-05-08T13:17:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:17:15 smithi096 ceph-mon[124666]: pgmap v18386: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 24 op/s 2023-05-08T13:17:15.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:17:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34373.909936 secs 2023-05-08T13:17:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:17:15 smithi186 ceph-mon[126480]: pgmap v18386: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 24 op/s 2023-05-08T13:17:17.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:17:17 smithi133 ceph-mon[125939]: pgmap v18387: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 504 KiB/s wr, 8 op/s 2023-05-08T13:17:17.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:17:17 smithi096 ceph-mon[124666]: pgmap v18387: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 504 KiB/s wr, 8 op/s 2023-05-08T13:17:17.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:17:17 smithi186 ceph-mon[126480]: pgmap v18387: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 504 KiB/s wr, 8 op/s 2023-05-08T13:17:19.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:17:19 smithi133 ceph-mon[125939]: pgmap v18388: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 505 KiB/s rd, 503 KiB/s wr, 7 op/s 2023-05-08T13:17:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:17:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34378.356397 secs 2023-05-08T13:17:19.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:17:19 smithi096 ceph-mon[124666]: pgmap v18388: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 505 KiB/s rd, 503 KiB/s wr, 7 op/s 2023-05-08T13:17:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:17:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34378.356397 secs 2023-05-08T13:17:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:17:19 smithi186 ceph-mon[126480]: pgmap v18388: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 505 KiB/s rd, 503 KiB/s wr, 7 op/s 2023-05-08T13:17:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:17:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34378.356397 secs 2023-05-08T13:17:20.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:17:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34378.910052 secs 2023-05-08T13:17:20.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:17:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34378.910052 secs 2023-05-08T13:17:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:17:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34378.910052 secs 2023-05-08T13:17:21.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:17:21 smithi133 ceph-mon[125939]: pgmap v18389: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 774 KiB/s rd, 771 KiB/s wr, 11 op/s 2023-05-08T13:17:21.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:17:21 smithi096 ceph-mon[124666]: pgmap v18389: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 774 KiB/s rd, 771 KiB/s wr, 11 op/s 2023-05-08T13:17:21.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:17:21 smithi186 ceph-mon[126480]: pgmap v18389: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 774 KiB/s rd, 771 KiB/s wr, 11 op/s 2023-05-08T13:17:23.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:17:23 smithi133 ceph-mon[125939]: pgmap v18390: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 699 KiB/s rd, 579 KiB/s wr, 8 op/s 2023-05-08T13:17:23.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:17:23 smithi096 ceph-mon[124666]: pgmap v18390: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 699 KiB/s rd, 579 KiB/s wr, 8 op/s 2023-05-08T13:17:23.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:17:23 smithi186 ceph-mon[126480]: pgmap v18390: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 699 KiB/s rd, 579 KiB/s wr, 8 op/s 2023-05-08T13:17:24.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:17:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34383.356533 secs 2023-05-08T13:17:24.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:17:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34383.356533 secs 2023-05-08T13:17:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:17:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34383.356533 secs 2023-05-08T13:17:25.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:17:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34383.910200 secs 2023-05-08T13:17:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:17:25 smithi133 ceph-mon[125939]: pgmap v18391: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 15 op/s 2023-05-08T13:17:25.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:17:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34383.910200 secs 2023-05-08T13:17:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:17:25 smithi096 ceph-mon[124666]: pgmap v18391: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 15 op/s 2023-05-08T13:17:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:17:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34383.910200 secs 2023-05-08T13:17:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:17:25 smithi186 ceph-mon[126480]: pgmap v18391: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 15 op/s 2023-05-08T13:17:27.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:17:27 smithi133 ceph-mon[125939]: pgmap v18392: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 934 KiB/s rd, 953 KiB/s wr, 12 op/s 2023-05-08T13:17:27.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:17:27 smithi096 ceph-mon[124666]: pgmap v18392: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 934 KiB/s rd, 953 KiB/s wr, 12 op/s 2023-05-08T13:17:27.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:17:27 smithi186 ceph-mon[126480]: pgmap v18392: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 934 KiB/s rd, 953 KiB/s wr, 12 op/s 2023-05-08T13:17:29.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:17:29 smithi133 ceph-mon[125939]: pgmap v18393: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 934 KiB/s rd, 953 KiB/s wr, 11 op/s 2023-05-08T13:17:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:17:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34388.356653 secs 2023-05-08T13:17:29.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:17:29 smithi096 ceph-mon[124666]: pgmap v18393: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 934 KiB/s rd, 953 KiB/s wr, 11 op/s 2023-05-08T13:17:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:17:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34388.356653 secs 2023-05-08T13:17:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:17:29 smithi186 ceph-mon[126480]: pgmap v18393: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 934 KiB/s rd, 953 KiB/s wr, 11 op/s 2023-05-08T13:17:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:17:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34388.356653 secs 2023-05-08T13:17:30.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:17:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34388.910301 secs 2023-05-08T13:17:30.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:17:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34388.910301 secs 2023-05-08T13:17:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:17:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34388.910301 secs 2023-05-08T13:17:31.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:17:31 smithi133 ceph-mon[125939]: pgmap v18394: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 967 KiB/s rd, 986 KiB/s wr, 15 op/s 2023-05-08T13:17:31.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:17:31 smithi096 ceph-mon[124666]: pgmap v18394: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 967 KiB/s rd, 986 KiB/s wr, 15 op/s 2023-05-08T13:17:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:17:31 smithi186 ceph-mon[126480]: pgmap v18394: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 967 KiB/s rd, 986 KiB/s wr, 15 op/s 2023-05-08T13:17:32.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:17:32 smithi133 ceph-mon[125939]: osdmap e1226: 12 total, 12 up, 12 in 2023-05-08T13:17:32.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:17:32 smithi096 ceph-mon[124666]: osdmap e1226: 12 total, 12 up, 12 in 2023-05-08T13:17:32.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:17:32 smithi186 ceph-mon[126480]: osdmap e1226: 12 total, 12 up, 12 in 2023-05-08T13:17:33.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:17:33 smithi133 ceph-mon[125939]: pgmap v18396: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 838 KiB/s rd, 834 KiB/s wr, 14 op/s 2023-05-08T13:17:33.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:17:33 smithi096 ceph-mon[124666]: pgmap v18396: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 838 KiB/s rd, 834 KiB/s wr, 14 op/s 2023-05-08T13:17:33.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:17:33 smithi186 ceph-mon[126480]: pgmap v18396: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 838 KiB/s rd, 834 KiB/s wr, 14 op/s 2023-05-08T13:17:34.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:17:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34393.356801 secs 2023-05-08T13:17:34.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:17:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34393.356801 secs 2023-05-08T13:17:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:17:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34393.356801 secs 2023-05-08T13:17:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:17:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34393.910427 secs 2023-05-08T13:17:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:17:35 smithi133 ceph-mon[125939]: pgmap v18397: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 629 KiB/s rd, 495 KiB/s wr, 11 op/s 2023-05-08T13:17:35.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:17:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34393.910427 secs 2023-05-08T13:17:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:17:35 smithi096 ceph-mon[124666]: pgmap v18397: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 629 KiB/s rd, 495 KiB/s wr, 11 op/s 2023-05-08T13:17:35.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:17:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34393.910427 secs 2023-05-08T13:17:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:17:35 smithi186 ceph-mon[126480]: pgmap v18397: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 629 KiB/s rd, 495 KiB/s wr, 11 op/s 2023-05-08T13:17:37.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:17:37 smithi133 ceph-mon[125939]: pgmap v18398: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 602 KiB/s rd, 495 KiB/s wr, 10 op/s 2023-05-08T13:17:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:17:37 smithi133 ceph-mon[125939]: osdmap e1227: 12 total, 12 up, 12 in 2023-05-08T13:17:37.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:17:37 smithi096 ceph-mon[124666]: pgmap v18398: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 602 KiB/s rd, 495 KiB/s wr, 10 op/s 2023-05-08T13:17:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:17:37 smithi096 ceph-mon[124666]: osdmap e1227: 12 total, 12 up, 12 in 2023-05-08T13:17:37.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:17:37 smithi186 ceph-mon[126480]: pgmap v18398: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 602 KiB/s rd, 495 KiB/s wr, 10 op/s 2023-05-08T13:17:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:17:37 smithi186 ceph-mon[126480]: osdmap e1227: 12 total, 12 up, 12 in 2023-05-08T13:17:39.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:17:39 smithi133 ceph-mon[125939]: pgmap v18400: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 702 KiB/s rd, 570 KiB/s wr, 6 op/s 2023-05-08T13:17:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:17:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34398.356939 secs 2023-05-08T13:17:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:17:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:17:39.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:17:39 smithi096 ceph-mon[124666]: pgmap v18400: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 702 KiB/s rd, 570 KiB/s wr, 6 op/s 2023-05-08T13:17:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:17:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34398.356939 secs 2023-05-08T13:17:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:17:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:17:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:17:39 smithi186 ceph-mon[126480]: pgmap v18400: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 702 KiB/s rd, 570 KiB/s wr, 6 op/s 2023-05-08T13:17:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:17:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34398.356939 secs 2023-05-08T13:17:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:17:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:17:40.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:17:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34398.910514 secs 2023-05-08T13:17:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:17:40 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:17:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:17:40 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:17:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:17:40 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:17:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:17:40 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:17:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:17:40 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T13:17:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:17:40 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T13:17:40.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:17:40 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:17:40.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:17:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34398.910514 secs 2023-05-08T13:17:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:17:40 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:17:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:17:40 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:17:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:17:40 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:17:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:17:40 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:17:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:17:40 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T13:17:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:17:40 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T13:17:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:17:40 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:17:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:17:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34398.910514 secs 2023-05-08T13:17:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:17:40 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:17:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:17:40 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:17:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:17:40 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:17:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:17:40 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:17:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:17:40 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T13:17:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:17:40 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T13:17:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:17:40 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:17:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:17:41 smithi186 ceph-mon[126480]: pgmap v18401: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 817 KiB/s rd, 580 KiB/s wr, 10 op/s 2023-05-08T13:17:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:17:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34400.202802 secs 2023-05-08T13:17:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:17:41 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:17:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:17:41 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:17:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:17:41 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:17:42.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:17:41 smithi133 ceph-mon[125939]: pgmap v18401: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 817 KiB/s rd, 580 KiB/s wr, 10 op/s 2023-05-08T13:17:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:17:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34400.202802 secs 2023-05-08T13:17:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:17:41 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:17:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:17:41 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:17:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:17:41 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:17:42.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:17:41 smithi096 ceph-mon[124666]: pgmap v18401: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 817 KiB/s rd, 580 KiB/s wr, 10 op/s 2023-05-08T13:17:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:17:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34400.202802 secs 2023-05-08T13:17:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:17:41 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:17:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:17:41 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:17:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:17:41 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:17:43.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:17:43 smithi133 ceph-mon[125939]: pgmap v18402: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 729 KiB/s rd, 517 KiB/s wr, 9 op/s 2023-05-08T13:17:43.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:17:43 smithi096 ceph-mon[124666]: pgmap v18402: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 729 KiB/s rd, 517 KiB/s wr, 9 op/s 2023-05-08T13:17:43.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:17:43 smithi186 ceph-mon[126480]: pgmap v18402: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 729 KiB/s rd, 517 KiB/s wr, 9 op/s 2023-05-08T13:17:44.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:17:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34403.357080 secs 2023-05-08T13:17:44.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:17:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34403.357080 secs 2023-05-08T13:17:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:17:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34403.357080 secs 2023-05-08T13:17:45.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:17:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34403.910612 secs 2023-05-08T13:17:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:17:45 smithi133 ceph-mon[125939]: pgmap v18403: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T13:17:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:17:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34403.910612 secs 2023-05-08T13:17:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:17:45 smithi096 ceph-mon[124666]: pgmap v18403: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T13:17:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:17:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34403.910612 secs 2023-05-08T13:17:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:17:45 smithi186 ceph-mon[126480]: pgmap v18403: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T13:17:46.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:17:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34405.202936 secs 2023-05-08T13:17:46.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:17:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34405.202936 secs 2023-05-08T13:17:46.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:17:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34405.202936 secs 2023-05-08T13:17:47.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:17:47 smithi133 ceph-mon[125939]: pgmap v18404: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T13:17:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:17:47 smithi096 ceph-mon[124666]: pgmap v18404: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T13:17:47.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:17:47 smithi186 ceph-mon[126480]: pgmap v18404: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T13:17:49.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:17:49 smithi133 ceph-mon[125939]: pgmap v18405: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 967 KiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T13:17:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:17:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34408.357248 secs 2023-05-08T13:17:49.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:17:49 smithi096 ceph-mon[124666]: pgmap v18405: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 967 KiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T13:17:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:17:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34408.357248 secs 2023-05-08T13:17:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:17:49 smithi186 ceph-mon[126480]: pgmap v18405: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 967 KiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T13:17:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:17:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34408.357248 secs 2023-05-08T13:17:51.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:17:51 smithi133 ceph-mon[125939]: pgmap v18406: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 MiB/s wr, 15 op/s 2023-05-08T13:17:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:17:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34410.203052 secs 2023-05-08T13:17:51.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:17:51 smithi096 ceph-mon[124666]: pgmap v18406: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 MiB/s wr, 15 op/s 2023-05-08T13:17:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:17:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34410.203052 secs 2023-05-08T13:17:51.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:17:51 smithi186 ceph-mon[126480]: pgmap v18406: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 MiB/s wr, 15 op/s 2023-05-08T13:17:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:17:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34410.203052 secs 2023-05-08T13:17:53.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:17:53 smithi133 ceph-mon[125939]: pgmap v18407: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.0 MiB/s wr, 11 op/s 2023-05-08T13:17:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:17:53 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:17:53.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:17:53 smithi096 ceph-mon[124666]: pgmap v18407: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.0 MiB/s wr, 11 op/s 2023-05-08T13:17:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:17:53 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:17:53.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:17:53 smithi186 ceph-mon[126480]: pgmap v18407: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.0 MiB/s wr, 11 op/s 2023-05-08T13:17:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:17:53 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:17:54.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:17:54 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:17:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:17:54 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:17:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:17:54 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:17:54.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:17:54 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:17:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:17:54 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:17:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:17:54 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:17:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:17:54 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:17:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:17:54 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:17:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:17:54 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:17:55.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:17:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34413.357452 secs 2023-05-08T13:17:55.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:17:55 smithi133 ceph-mon[125939]: pgmap v18408: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.4 MiB/s wr, 17 op/s 2023-05-08T13:17:55.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:17:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34413.357452 secs 2023-05-08T13:17:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:17:55 smithi096 ceph-mon[124666]: pgmap v18408: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.4 MiB/s wr, 17 op/s 2023-05-08T13:17:55.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:17:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34413.357452 secs 2023-05-08T13:17:55.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:17:55 smithi186 ceph-mon[126480]: pgmap v18408: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.4 MiB/s wr, 17 op/s 2023-05-08T13:17:56.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:17:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34415.203168 secs 2023-05-08T13:17:56.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:17:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34415.203168 secs 2023-05-08T13:17:56.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:17:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34415.203168 secs 2023-05-08T13:17:57.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:17:57 smithi133 ceph-mon[125939]: pgmap v18409: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T13:17:57.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:17:57 smithi096 ceph-mon[124666]: pgmap v18409: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T13:17:57.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:17:57 smithi186 ceph-mon[126480]: pgmap v18409: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T13:17:59.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:17:59 smithi133 ceph-mon[125939]: pgmap v18410: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T13:17:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:17:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34418.357546 secs 2023-05-08T13:17:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:17:59 smithi096 ceph-mon[124666]: pgmap v18410: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T13:17:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:17:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34418.357546 secs 2023-05-08T13:17:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:17:59 smithi186 ceph-mon[126480]: pgmap v18410: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T13:17:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:17:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34418.357546 secs 2023-05-08T13:18:00.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34418.910938 secs 2023-05-08T13:18:00.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34418.910938 secs 2023-05-08T13:18:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34418.910938 secs 2023-05-08T13:18:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:01 smithi133 ceph-mon[125939]: pgmap v18411: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.3 MiB/s wr, 17 op/s 2023-05-08T13:18:01.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:01 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:18:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:01 smithi096 ceph-mon[124666]: pgmap v18411: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.3 MiB/s wr, 17 op/s 2023-05-08T13:18:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:01 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:18:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:01 smithi186 ceph-mon[126480]: pgmap v18411: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.3 MiB/s wr, 17 op/s 2023-05-08T13:18:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:01 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:18:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:18:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:18:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:18:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:18:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:18:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:18:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:18:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:18:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:18:03.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:03 smithi133 ceph-mon[125939]: pgmap v18412: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T13:18:03.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:03 smithi096 ceph-mon[124666]: pgmap v18412: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T13:18:03.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:03 smithi186 ceph-mon[126480]: pgmap v18412: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T13:18:04.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34423.357658 secs 2023-05-08T13:18:04.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34423.357658 secs 2023-05-08T13:18:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34423.357658 secs 2023-05-08T13:18:05.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:05 smithi133 ceph-mon[125939]: pgmap v18413: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 1.4 MiB/s wr, 18 op/s 2023-05-08T13:18:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:05 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:18:05.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:05 smithi096 ceph-mon[124666]: pgmap v18413: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 1.4 MiB/s wr, 18 op/s 2023-05-08T13:18:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:05 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:18:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:05 smithi186 ceph-mon[126480]: pgmap v18413: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 1.4 MiB/s wr, 18 op/s 2023-05-08T13:18:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:05 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:18:06.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:06 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:18:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:18:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:18:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34425.203365 secs 2023-05-08T13:18:06.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:06 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:18:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:18:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:18:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34425.203365 secs 2023-05-08T13:18:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:06 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:18:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:18:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:18:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34425.203365 secs 2023-05-08T13:18:07.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:07 smithi133 ceph-mon[125939]: pgmap v18414: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 12 op/s 2023-05-08T13:18:07.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:07 smithi096 ceph-mon[124666]: pgmap v18414: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 12 op/s 2023-05-08T13:18:07.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:07 smithi186 ceph-mon[126480]: pgmap v18414: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 12 op/s 2023-05-08T13:18:09.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:09 smithi133 ceph-mon[125939]: pgmap v18415: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 12 op/s 2023-05-08T13:18:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34428.357784 secs 2023-05-08T13:18:09.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:09 smithi096 ceph-mon[124666]: pgmap v18415: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 12 op/s 2023-05-08T13:18:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34428.357784 secs 2023-05-08T13:18:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:09 smithi186 ceph-mon[126480]: pgmap v18415: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 12 op/s 2023-05-08T13:18:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34428.357784 secs 2023-05-08T13:18:10.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34428.911157 secs 2023-05-08T13:18:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:10 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:18:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:10 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:18:10.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34428.911157 secs 2023-05-08T13:18:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:10 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:18:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:10 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:18:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34428.911157 secs 2023-05-08T13:18:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:10 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:18:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:10 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:18:11.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:11 smithi133 ceph-mon[125939]: pgmap v18416: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.1 MiB/s wr, 31 op/s 2023-05-08T13:18:11.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34430.203483 secs 2023-05-08T13:18:11.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:11 smithi096 ceph-mon[124666]: pgmap v18416: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.1 MiB/s wr, 31 op/s 2023-05-08T13:18:11.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34430.203483 secs 2023-05-08T13:18:11.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:11 smithi186 ceph-mon[126480]: pgmap v18416: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.1 MiB/s wr, 31 op/s 2023-05-08T13:18:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34430.203483 secs 2023-05-08T13:18:12.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:12 smithi133 ceph-mon[125939]: osdmap e1228: 12 total, 12 up, 12 in 2023-05-08T13:18:12.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:12 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:18:12.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:12 smithi096 ceph-mon[124666]: osdmap e1228: 12 total, 12 up, 12 in 2023-05-08T13:18:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:12 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:18:12.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:12 smithi186 ceph-mon[126480]: osdmap e1228: 12 total, 12 up, 12 in 2023-05-08T13:18:12.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:12 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:18:13.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:13 smithi133 ceph-mon[125939]: pgmap v18418: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.4 MiB/s wr, 30 op/s 2023-05-08T13:18:13.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:13 smithi096 ceph-mon[124666]: pgmap v18418: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.4 MiB/s wr, 30 op/s 2023-05-08T13:18:13.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:13 smithi186 ceph-mon[126480]: pgmap v18418: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.4 MiB/s wr, 30 op/s 2023-05-08T13:18:14.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:14 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:18:14.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:14 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:18:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34433.357852 secs 2023-05-08T13:18:14.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:14 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:18:14.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:14 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:18:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34433.357852 secs 2023-05-08T13:18:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:14 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:18:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:14 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:18:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34433.357852 secs 2023-05-08T13:18:15.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34433.911280 secs 2023-05-08T13:18:15.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:15 smithi133 ceph-mon[125939]: pgmap v18419: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 26 op/s 2023-05-08T13:18:15.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34433.911280 secs 2023-05-08T13:18:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:15 smithi096 ceph-mon[124666]: pgmap v18419: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 26 op/s 2023-05-08T13:18:15.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34433.911280 secs 2023-05-08T13:18:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:15 smithi186 ceph-mon[126480]: pgmap v18419: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 26 op/s 2023-05-08T13:18:16.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34435.203616 secs 2023-05-08T13:18:16.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34435.203616 secs 2023-05-08T13:18:16.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34435.203616 secs 2023-05-08T13:18:17.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:17 smithi133 ceph-mon[125939]: pgmap v18420: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 26 op/s 2023-05-08T13:18:17.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:17 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:18:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:17 smithi133 ceph-mon[125939]: osdmap e1229: 12 total, 12 up, 12 in 2023-05-08T13:18:17.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:17 smithi096 ceph-mon[124666]: pgmap v18420: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 26 op/s 2023-05-08T13:18:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:17 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:18:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:17 smithi096 ceph-mon[124666]: osdmap e1229: 12 total, 12 up, 12 in 2023-05-08T13:18:17.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:17 smithi186 ceph-mon[126480]: pgmap v18420: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 26 op/s 2023-05-08T13:18:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:17 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:18:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:17 smithi186 ceph-mon[126480]: osdmap e1229: 12 total, 12 up, 12 in 2023-05-08T13:18:19.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:19 smithi133 ceph-mon[125939]: pgmap v18422: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 895 B/s wr, 5 op/s 2023-05-08T13:18:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34438.357988 secs 2023-05-08T13:18:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:19 smithi096 ceph-mon[124666]: pgmap v18422: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 895 B/s wr, 5 op/s 2023-05-08T13:18:19.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34438.357988 secs 2023-05-08T13:18:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:19 smithi186 ceph-mon[126480]: pgmap v18422: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 895 B/s wr, 5 op/s 2023-05-08T13:18:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34438.357988 secs 2023-05-08T13:18:20.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34438.911414 secs 2023-05-08T13:18:20.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34438.911414 secs 2023-05-08T13:18:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34438.911414 secs 2023-05-08T13:18:21.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:21 smithi133 ceph-mon[125939]: pgmap v18423: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 152 KiB/s wr, 9 op/s 2023-05-08T13:18:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34440.203731 secs 2023-05-08T13:18:21.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:21 smithi096 ceph-mon[124666]: pgmap v18423: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 152 KiB/s wr, 9 op/s 2023-05-08T13:18:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34440.203731 secs 2023-05-08T13:18:21.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:21 smithi186 ceph-mon[126480]: pgmap v18423: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 152 KiB/s wr, 9 op/s 2023-05-08T13:18:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34440.203731 secs 2023-05-08T13:18:23.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:23 smithi133 ceph-mon[125939]: pgmap v18424: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 136 KiB/s wr, 8 op/s 2023-05-08T13:18:23.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:23 smithi096 ceph-mon[124666]: pgmap v18424: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 136 KiB/s wr, 8 op/s 2023-05-08T13:18:23.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:23 smithi186 ceph-mon[126480]: pgmap v18424: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 136 KiB/s wr, 8 op/s 2023-05-08T13:18:24.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34443.358052 secs 2023-05-08T13:18:24.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34443.358052 secs 2023-05-08T13:18:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34443.358052 secs 2023-05-08T13:18:25.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34443.911541 secs 2023-05-08T13:18:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:25 smithi133 ceph-mon[125939]: pgmap v18425: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 136 KiB/s wr, 8 op/s 2023-05-08T13:18:25.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34443.911541 secs 2023-05-08T13:18:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:25 smithi096 ceph-mon[124666]: pgmap v18425: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 136 KiB/s wr, 8 op/s 2023-05-08T13:18:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34443.911541 secs 2023-05-08T13:18:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:25 smithi186 ceph-mon[126480]: pgmap v18425: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 136 KiB/s wr, 8 op/s 2023-05-08T13:18:26.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34445.203846 secs 2023-05-08T13:18:26.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34445.203846 secs 2023-05-08T13:18:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34445.203846 secs 2023-05-08T13:18:27.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:27 smithi133 ceph-mon[125939]: pgmap v18426: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 136 KiB/s wr, 8 op/s 2023-05-08T13:18:27.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:27 smithi096 ceph-mon[124666]: pgmap v18426: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 136 KiB/s wr, 8 op/s 2023-05-08T13:18:27.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:27 smithi186 ceph-mon[126480]: pgmap v18426: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 136 KiB/s wr, 8 op/s 2023-05-08T13:18:29.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:29 smithi133 ceph-mon[125939]: pgmap v18427: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 121 KiB/s wr, 7 op/s 2023-05-08T13:18:29.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34448.358122 secs 2023-05-08T13:18:29.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:29 smithi096 ceph-mon[124666]: pgmap v18427: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 121 KiB/s wr, 7 op/s 2023-05-08T13:18:29.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34448.358122 secs 2023-05-08T13:18:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:29 smithi186 ceph-mon[126480]: pgmap v18427: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 121 KiB/s wr, 7 op/s 2023-05-08T13:18:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34448.358122 secs 2023-05-08T13:18:30.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34448.911654 secs 2023-05-08T13:18:30.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34448.911654 secs 2023-05-08T13:18:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34448.911654 secs 2023-05-08T13:18:31.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:31 smithi133 ceph-mon[125939]: pgmap v18428: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 136 KiB/s wr, 11 op/s 2023-05-08T13:18:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34450.203959 secs 2023-05-08T13:18:31.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:31 smithi096 ceph-mon[124666]: pgmap v18428: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 136 KiB/s wr, 11 op/s 2023-05-08T13:18:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34450.203959 secs 2023-05-08T13:18:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:31 smithi186 ceph-mon[126480]: pgmap v18428: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 136 KiB/s wr, 11 op/s 2023-05-08T13:18:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34450.203959 secs 2023-05-08T13:18:33.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:33 smithi133 ceph-mon[125939]: pgmap v18429: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 7 op/s 2023-05-08T13:18:33.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:33 smithi096 ceph-mon[124666]: pgmap v18429: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 7 op/s 2023-05-08T13:18:33.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:33 smithi186 ceph-mon[126480]: pgmap v18429: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 7 op/s 2023-05-08T13:18:34.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34453.358265 secs 2023-05-08T13:18:34.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34453.358265 secs 2023-05-08T13:18:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34453.358265 secs 2023-05-08T13:18:35.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34453.911773 secs 2023-05-08T13:18:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:35 smithi133 ceph-mon[125939]: pgmap v18430: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 325 KiB/s wr, 11 op/s 2023-05-08T13:18:35.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34453.911773 secs 2023-05-08T13:18:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:35 smithi096 ceph-mon[124666]: pgmap v18430: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 325 KiB/s wr, 11 op/s 2023-05-08T13:18:35.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34453.911773 secs 2023-05-08T13:18:35.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:35 smithi186 ceph-mon[126480]: pgmap v18430: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 325 KiB/s wr, 11 op/s 2023-05-08T13:18:36.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34455.204071 secs 2023-05-08T13:18:36.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34455.204071 secs 2023-05-08T13:18:36.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34455.204071 secs 2023-05-08T13:18:37.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:37 smithi133 ceph-mon[125939]: pgmap v18431: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 325 KiB/s wr, 8 op/s 2023-05-08T13:18:37.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:37 smithi096 ceph-mon[124666]: pgmap v18431: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 325 KiB/s wr, 8 op/s 2023-05-08T13:18:37.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:37 smithi186 ceph-mon[126480]: pgmap v18431: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 325 KiB/s wr, 8 op/s 2023-05-08T13:18:39.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:39 smithi133 ceph-mon[125939]: pgmap v18432: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 325 KiB/s wr, 8 op/s 2023-05-08T13:18:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34458.358384 secs 2023-05-08T13:18:39.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:39 smithi096 ceph-mon[124666]: pgmap v18432: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 325 KiB/s wr, 8 op/s 2023-05-08T13:18:39.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34458.358384 secs 2023-05-08T13:18:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:39 smithi186 ceph-mon[126480]: pgmap v18432: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 325 KiB/s wr, 8 op/s 2023-05-08T13:18:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34458.358384 secs 2023-05-08T13:18:40.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34458.911863 secs 2023-05-08T13:18:40.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:40 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:18:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:40 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:18:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:40 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:18:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:40 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:18:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:40 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:18:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:40 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:18:40.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:40 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:18:40.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34458.911863 secs 2023-05-08T13:18:40.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:40 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:18:40.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:40 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:18:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:40 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:18:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:40 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:18:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:40 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:18:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:40 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:18:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:40 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:18:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34458.911863 secs 2023-05-08T13:18:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:40 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:18:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:40 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:18:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:40 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:18:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:40 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:18:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:40 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:18:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:40 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:18:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:40 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:18:41.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:41 smithi133 ceph-mon[125939]: pgmap v18433: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 625 KiB/s rd, 622 KiB/s wr, 11 op/s 2023-05-08T13:18:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34460.204155 secs 2023-05-08T13:18:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:18:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:18:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:41 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:18:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:18:41.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:41 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T13:18:41.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:41 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T13:18:41.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:41 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:18:41.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:41 smithi096 ceph-mon[124666]: pgmap v18433: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 625 KiB/s rd, 622 KiB/s wr, 11 op/s 2023-05-08T13:18:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34460.204155 secs 2023-05-08T13:18:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:18:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:18:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:41 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:18:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:18:41.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:41 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T13:18:41.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:41 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T13:18:41.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:41 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:18:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:41 smithi186 ceph-mon[126480]: pgmap v18433: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 625 KiB/s rd, 622 KiB/s wr, 11 op/s 2023-05-08T13:18:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34460.204155 secs 2023-05-08T13:18:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:18:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:18:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:41 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:18:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:18:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:41 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T13:18:41.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:41 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T13:18:41.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:41 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:18:43.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:43 smithi133 ceph-mon[125939]: pgmap v18434: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 601 KiB/s rd, 599 KiB/s wr, 7 op/s 2023-05-08T13:18:43.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:43 smithi096 ceph-mon[124666]: pgmap v18434: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 601 KiB/s rd, 599 KiB/s wr, 7 op/s 2023-05-08T13:18:43.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:43 smithi186 ceph-mon[126480]: pgmap v18434: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 601 KiB/s rd, 599 KiB/s wr, 7 op/s 2023-05-08T13:18:44.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34463.358471 secs 2023-05-08T13:18:44.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34463.358471 secs 2023-05-08T13:18:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34463.358471 secs 2023-05-08T13:18:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34463.911992 secs 2023-05-08T13:18:45.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:45 smithi133 ceph-mon[125939]: pgmap v18435: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 631 KiB/s wr, 10 op/s 2023-05-08T13:18:45.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34463.911992 secs 2023-05-08T13:18:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:45 smithi096 ceph-mon[124666]: pgmap v18435: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 631 KiB/s wr, 10 op/s 2023-05-08T13:18:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34463.911992 secs 2023-05-08T13:18:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:45 smithi186 ceph-mon[126480]: pgmap v18435: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 631 KiB/s wr, 10 op/s 2023-05-08T13:18:46.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34465.204227 secs 2023-05-08T13:18:46.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34465.204227 secs 2023-05-08T13:18:46.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34465.204227 secs 2023-05-08T13:18:47.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:47 smithi133 ceph-mon[125939]: pgmap v18436: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 330 KiB/s wr, 7 op/s 2023-05-08T13:18:47.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:47 smithi096 ceph-mon[124666]: pgmap v18436: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 330 KiB/s wr, 7 op/s 2023-05-08T13:18:47.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:47 smithi186 ceph-mon[126480]: pgmap v18436: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 330 KiB/s wr, 7 op/s 2023-05-08T13:18:49.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:49 smithi133 ceph-mon[125939]: pgmap v18437: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 330 KiB/s wr, 7 op/s 2023-05-08T13:18:49.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34468.358587 secs 2023-05-08T13:18:49.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:49 smithi096 ceph-mon[124666]: pgmap v18437: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 330 KiB/s wr, 7 op/s 2023-05-08T13:18:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34468.358587 secs 2023-05-08T13:18:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:49 smithi186 ceph-mon[126480]: pgmap v18437: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 330 KiB/s wr, 7 op/s 2023-05-08T13:18:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34468.358587 secs 2023-05-08T13:18:50.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34468.912123 secs 2023-05-08T13:18:50.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34468.912123 secs 2023-05-08T13:18:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34468.912123 secs 2023-05-08T13:18:51.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:51 smithi133 ceph-mon[125939]: pgmap v18438: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 749 KiB/s rd, 746 KiB/s wr, 11 op/s 2023-05-08T13:18:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34470.204330 secs 2023-05-08T13:18:51.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:51 smithi096 ceph-mon[124666]: pgmap v18438: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 749 KiB/s rd, 746 KiB/s wr, 11 op/s 2023-05-08T13:18:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34470.204330 secs 2023-05-08T13:18:51.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:51 smithi186 ceph-mon[126480]: pgmap v18438: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 749 KiB/s rd, 746 KiB/s wr, 11 op/s 2023-05-08T13:18:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34470.204330 secs 2023-05-08T13:18:53.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:53 smithi133 ceph-mon[125939]: pgmap v18439: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 449 KiB/s wr, 8 op/s 2023-05-08T13:18:53.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:53 smithi096 ceph-mon[124666]: pgmap v18439: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 449 KiB/s wr, 8 op/s 2023-05-08T13:18:53.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:53 smithi186 ceph-mon[126480]: pgmap v18439: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 449 KiB/s wr, 8 op/s 2023-05-08T13:18:54.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34473.358671 secs 2023-05-08T13:18:54.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34473.358671 secs 2023-05-08T13:18:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34473.358671 secs 2023-05-08T13:18:55.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:55 smithi133 ceph-mon[125939]: pgmap v18440: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2023-05-08T13:18:55.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:55 smithi096 ceph-mon[124666]: pgmap v18440: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2023-05-08T13:18:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:55 smithi186 ceph-mon[126480]: pgmap v18440: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2023-05-08T13:18:56.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34475.204446 secs 2023-05-08T13:18:56.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34475.204446 secs 2023-05-08T13:18:56.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34475.204446 secs 2023-05-08T13:18:57.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:57 smithi133 ceph-mon[125939]: pgmap v18441: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 10 op/s 2023-05-08T13:18:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:18:57.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:57 smithi096 ceph-mon[124666]: pgmap v18441: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 10 op/s 2023-05-08T13:18:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:18:57.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:57 smithi186 ceph-mon[126480]: pgmap v18441: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 10 op/s 2023-05-08T13:18:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:18:58.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:58 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:18:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:18:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:18:58.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:58 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:18:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:18:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:18:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:58 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:18:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:18:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:18:59.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:59 smithi133 ceph-mon[125939]: pgmap v18442: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 10 op/s 2023-05-08T13:18:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:18:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34478.358780 secs 2023-05-08T13:18:59.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:59 smithi096 ceph-mon[124666]: pgmap v18442: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 10 op/s 2023-05-08T13:18:59.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:18:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34478.358780 secs 2023-05-08T13:18:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:59 smithi186 ceph-mon[126480]: pgmap v18442: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 10 op/s 2023-05-08T13:18:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:18:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34478.358780 secs 2023-05-08T13:19:00.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34478.912383 secs 2023-05-08T13:19:00.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34478.912383 secs 2023-05-08T13:19:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34478.912383 secs 2023-05-08T13:19:01.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:01 smithi133 ceph-mon[125939]: pgmap v18443: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.3 MiB/s wr, 16 op/s 2023-05-08T13:19:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:01 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:19:01.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:01 smithi096 ceph-mon[124666]: pgmap v18443: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.3 MiB/s wr, 16 op/s 2023-05-08T13:19:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:01 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:19:01.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:01 smithi186 ceph-mon[126480]: pgmap v18443: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.3 MiB/s wr, 16 op/s 2023-05-08T13:19:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:01 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:19:02.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:19:02.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:19:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:19:02.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:19:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:19:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:19:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:19:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:19:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:19:03.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:03 smithi133 ceph-mon[125939]: pgmap v18444: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.9 MiB/s wr, 12 op/s 2023-05-08T13:19:03.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:03 smithi096 ceph-mon[124666]: pgmap v18444: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.9 MiB/s wr, 12 op/s 2023-05-08T13:19:03.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:03 smithi186 ceph-mon[126480]: pgmap v18444: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.9 MiB/s wr, 12 op/s 2023-05-08T13:19:04.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34483.358899 secs 2023-05-08T13:19:04.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34483.358899 secs 2023-05-08T13:19:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34483.358899 secs 2023-05-08T13:19:05.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34483.912499 secs 2023-05-08T13:19:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:05 smithi133 ceph-mon[125939]: pgmap v18445: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.3 MiB/s wr, 30 op/s 2023-05-08T13:19:05.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34483.912499 secs 2023-05-08T13:19:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:05 smithi096 ceph-mon[124666]: pgmap v18445: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.3 MiB/s wr, 30 op/s 2023-05-08T13:19:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34483.912499 secs 2023-05-08T13:19:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:05 smithi186 ceph-mon[126480]: pgmap v18445: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.3 MiB/s wr, 30 op/s 2023-05-08T13:19:07.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:07 smithi133 ceph-mon[125939]: pgmap v18446: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 24 op/s 2023-05-08T13:19:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:07 smithi096 ceph-mon[124666]: pgmap v18446: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 24 op/s 2023-05-08T13:19:07.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:07 smithi186 ceph-mon[126480]: pgmap v18446: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 24 op/s 2023-05-08T13:19:09.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:09 smithi133 ceph-mon[125939]: pgmap v18447: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 23 op/s 2023-05-08T13:19:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:09 smithi096 ceph-mon[124666]: pgmap v18447: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 23 op/s 2023-05-08T13:19:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:09 smithi186 ceph-mon[126480]: pgmap v18447: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 23 op/s 2023-05-08T13:19:10.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34488.912608 secs 2023-05-08T13:19:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34488.912608 secs 2023-05-08T13:19:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34488.912608 secs 2023-05-08T13:19:11.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:11 smithi133 ceph-mon[125939]: pgmap v18448: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 27 op/s 2023-05-08T13:19:11.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:11 smithi096 ceph-mon[124666]: pgmap v18448: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 27 op/s 2023-05-08T13:19:11.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:11 smithi186 ceph-mon[126480]: pgmap v18448: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 27 op/s 2023-05-08T13:19:12.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:12 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:19:12.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:12 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:19:12.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:12 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:19:13.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:13 smithi133 ceph-mon[125939]: pgmap v18449: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 915 KiB/s rd, 766 KiB/s wr, 22 op/s 2023-05-08T13:19:13.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:13 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:19:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T13:19:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:13 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:19:13.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:13 smithi096 ceph-mon[124666]: pgmap v18449: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 915 KiB/s rd, 766 KiB/s wr, 22 op/s 2023-05-08T13:19:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:13 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:19:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T13:19:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:13 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:19:13.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:13 smithi186 ceph-mon[126480]: pgmap v18449: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 915 KiB/s rd, 766 KiB/s wr, 22 op/s 2023-05-08T13:19:13.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:13 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:19:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T13:19:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:13 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:19:15.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34493.912683 secs 2023-05-08T13:19:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:15 smithi133 ceph-mon[125939]: pgmap v18450: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 778 KiB/s rd, 767 KiB/s wr, 25 op/s 2023-05-08T13:19:15.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34493.912683 secs 2023-05-08T13:19:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:15 smithi096 ceph-mon[124666]: pgmap v18450: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 778 KiB/s rd, 767 KiB/s wr, 25 op/s 2023-05-08T13:19:15.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34493.912683 secs 2023-05-08T13:19:15.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:15 smithi186 ceph-mon[126480]: pgmap v18450: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 778 KiB/s rd, 767 KiB/s wr, 25 op/s 2023-05-08T13:19:17.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:17 smithi133 ceph-mon[125939]: pgmap v18451: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 389 KiB/s wr, 7 op/s 2023-05-08T13:19:17.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:17 smithi096 ceph-mon[124666]: pgmap v18451: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 389 KiB/s wr, 7 op/s 2023-05-08T13:19:17.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:17 smithi186 ceph-mon[126480]: pgmap v18451: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 389 KiB/s wr, 7 op/s 2023-05-08T13:19:19.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:19 smithi133 ceph-mon[125939]: pgmap v18452: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 389 KiB/s wr, 7 op/s 2023-05-08T13:19:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34498.359234 secs 2023-05-08T13:19:19.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:19 smithi096 ceph-mon[124666]: pgmap v18452: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 389 KiB/s wr, 7 op/s 2023-05-08T13:19:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34498.359234 secs 2023-05-08T13:19:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:19 smithi186 ceph-mon[126480]: pgmap v18452: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 389 KiB/s wr, 7 op/s 2023-05-08T13:19:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34498.359234 secs 2023-05-08T13:19:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:20 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:19:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:20 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T13:19:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:20 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:19:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:20 smithi186 ceph-mon[126480]: osdmap e1230: 12 total, 12 up, 12 in 2023-05-08T13:19:20.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:20 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:19:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:20 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T13:19:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:20 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:19:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:20 smithi133 ceph-mon[125939]: osdmap e1230: 12 total, 12 up, 12 in 2023-05-08T13:19:21.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:20 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:19:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:20 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T13:19:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:20 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:19:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:20 smithi096 ceph-mon[124666]: osdmap e1230: 12 total, 12 up, 12 in 2023-05-08T13:19:21.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:21 smithi186 ceph-mon[126480]: pgmap v18453: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T13:19:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:21 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:19:21.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:21 smithi133 ceph-mon[125939]: pgmap v18453: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T13:19:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:21 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:19:22.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:21 smithi096 ceph-mon[124666]: pgmap v18453: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T13:19:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:21 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:19:22.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:22 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:19:22.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:22 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:19:22.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:22 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:19:22.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:22 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:19:23.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:22 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:19:23.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:22 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:19:23.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:23 smithi186 ceph-mon[126480]: pgmap v18455: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 854 KiB/s wr, 12 op/s 2023-05-08T13:19:23.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:23 smithi133 ceph-mon[125939]: pgmap v18455: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 854 KiB/s wr, 12 op/s 2023-05-08T13:19:24.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:23 smithi096 ceph-mon[124666]: pgmap v18455: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 854 KiB/s wr, 12 op/s 2023-05-08T13:19:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34503.359369 secs 2023-05-08T13:19:24.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34503.359369 secs 2023-05-08T13:19:25.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34503.359369 secs 2023-05-08T13:19:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:25 smithi186 ceph-mon[126480]: pgmap v18456: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 14 op/s 2023-05-08T13:19:25.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:25 smithi133 ceph-mon[125939]: pgmap v18456: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 14 op/s 2023-05-08T13:19:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:25 smithi096 ceph-mon[124666]: pgmap v18456: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 14 op/s 2023-05-08T13:19:27.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:27 smithi186 ceph-mon[126480]: pgmap v18457: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 14 op/s 2023-05-08T13:19:27.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:27 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:19:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:27 smithi186 ceph-mon[126480]: osdmap e1231: 12 total, 12 up, 12 in 2023-05-08T13:19:27.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:27 smithi133 ceph-mon[125939]: pgmap v18457: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 14 op/s 2023-05-08T13:19:27.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:27 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:19:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:27 smithi133 ceph-mon[125939]: osdmap e1231: 12 total, 12 up, 12 in 2023-05-08T13:19:28.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:27 smithi096 ceph-mon[124666]: pgmap v18457: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 14 op/s 2023-05-08T13:19:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:27 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:19:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:27 smithi096 ceph-mon[124666]: osdmap e1231: 12 total, 12 up, 12 in 2023-05-08T13:19:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:29 smithi186 ceph-mon[126480]: pgmap v18459: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 986 KiB/s rd, 796 KiB/s wr, 6 op/s 2023-05-08T13:19:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34508.359489 secs 2023-05-08T13:19:29.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:29 smithi133 ceph-mon[125939]: pgmap v18459: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 986 KiB/s rd, 796 KiB/s wr, 6 op/s 2023-05-08T13:19:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34508.359489 secs 2023-05-08T13:19:30.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:29 smithi096 ceph-mon[124666]: pgmap v18459: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 986 KiB/s rd, 796 KiB/s wr, 6 op/s 2023-05-08T13:19:30.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34508.359489 secs 2023-05-08T13:19:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:31 smithi186 ceph-mon[126480]: pgmap v18460: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 801 KiB/s rd, 646 KiB/s wr, 9 op/s 2023-05-08T13:19:31.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:31 smithi133 ceph-mon[125939]: pgmap v18460: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 801 KiB/s rd, 646 KiB/s wr, 9 op/s 2023-05-08T13:19:32.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:31 smithi096 ceph-mon[124666]: pgmap v18460: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 801 KiB/s rd, 646 KiB/s wr, 9 op/s 2023-05-08T13:19:33.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:33 smithi133 ceph-mon[125939]: pgmap v18461: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 790 KiB/s rd, 637 KiB/s wr, 9 op/s 2023-05-08T13:19:33.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:33 smithi096 ceph-mon[124666]: pgmap v18461: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 790 KiB/s rd, 637 KiB/s wr, 9 op/s 2023-05-08T13:19:33.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:33 smithi186 ceph-mon[126480]: pgmap v18461: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 790 KiB/s rd, 637 KiB/s wr, 9 op/s 2023-05-08T13:19:34.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34513.359556 secs 2023-05-08T13:19:34.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34513.359556 secs 2023-05-08T13:19:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34513.359556 secs 2023-05-08T13:19:35.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:35 smithi133 ceph-mon[125939]: pgmap v18462: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 818 B/s wr, 7 op/s 2023-05-08T13:19:35.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:35 smithi096 ceph-mon[124666]: pgmap v18462: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 818 B/s wr, 7 op/s 2023-05-08T13:19:35.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:35 smithi186 ceph-mon[126480]: pgmap v18462: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 818 B/s wr, 7 op/s 2023-05-08T13:19:36.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34515.205368 secs 2023-05-08T13:19:36.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34515.205368 secs 2023-05-08T13:19:36.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34515.205368 secs 2023-05-08T13:19:37.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:37 smithi133 ceph-mon[125939]: pgmap v18463: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 818 B/s wr, 7 op/s 2023-05-08T13:19:37.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:37 smithi096 ceph-mon[124666]: pgmap v18463: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 818 B/s wr, 7 op/s 2023-05-08T13:19:37.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:37 smithi186 ceph-mon[126480]: pgmap v18463: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 818 B/s wr, 7 op/s 2023-05-08T13:19:38.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:38 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:19:38.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:38 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:19:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:38 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:19:38.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:38 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:19:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:38 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:19:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:38 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:19:38.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:38 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:19:38.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:38 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:19:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:38 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:19:39.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:39 smithi133 ceph-mon[125939]: pgmap v18464: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 731 B/s wr, 6 op/s 2023-05-08T13:19:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34518.359670 secs 2023-05-08T13:19:39.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:39 smithi096 ceph-mon[124666]: pgmap v18464: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 731 B/s wr, 6 op/s 2023-05-08T13:19:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34518.359670 secs 2023-05-08T13:19:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:39 smithi186 ceph-mon[126480]: pgmap v18464: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 731 B/s wr, 6 op/s 2023-05-08T13:19:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34518.359670 secs 2023-05-08T13:19:40.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34518.913244 secs 2023-05-08T13:19:40.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34518.913244 secs 2023-05-08T13:19:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34518.913244 secs 2023-05-08T13:19:41.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:41 smithi133 ceph-mon[125939]: pgmap v18465: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 210 KiB/s wr, 11 op/s 2023-05-08T13:19:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34520.205485 secs 2023-05-08T13:19:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:19:41.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:41 smithi096 ceph-mon[124666]: pgmap v18465: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 210 KiB/s wr, 11 op/s 2023-05-08T13:19:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34520.205485 secs 2023-05-08T13:19:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:19:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:41 smithi186 ceph-mon[126480]: pgmap v18465: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 210 KiB/s wr, 11 op/s 2023-05-08T13:19:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34520.205485 secs 2023-05-08T13:19:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:19:42.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:42 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:19:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:42 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:19:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:19:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:19:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:42 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:19:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:19:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:42 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T13:19:42.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:42 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T13:19:42.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:42 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:19:42.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:42 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:19:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:42 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:19:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:19:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:19:42.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:42 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:19:42.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:19:42.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:42 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T13:19:42.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:42 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T13:19:42.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:42 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:19:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:42 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:19:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:42 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:19:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:19:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:19:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:42 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:19:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:19:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:42 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T13:19:42.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:42 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T13:19:42.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:42 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:19:43.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:43 smithi133 ceph-mon[125939]: pgmap v18466: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 209 KiB/s wr, 8 op/s 2023-05-08T13:19:43.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:43 smithi096 ceph-mon[124666]: pgmap v18466: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 209 KiB/s wr, 8 op/s 2023-05-08T13:19:43.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:43 smithi186 ceph-mon[126480]: pgmap v18466: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 209 KiB/s wr, 8 op/s 2023-05-08T13:19:44.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34523.359789 secs 2023-05-08T13:19:44.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34523.359789 secs 2023-05-08T13:19:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34523.359789 secs 2023-05-08T13:19:45.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34523.913382 secs 2023-05-08T13:19:45.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:45 smithi133 ceph-mon[125939]: pgmap v18467: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 829 KiB/s rd, 827 KiB/s wr, 12 op/s 2023-05-08T13:19:45.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34523.913382 secs 2023-05-08T13:19:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:45 smithi096 ceph-mon[124666]: pgmap v18467: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 829 KiB/s rd, 827 KiB/s wr, 12 op/s 2023-05-08T13:19:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34523.913382 secs 2023-05-08T13:19:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:45 smithi186 ceph-mon[126480]: pgmap v18467: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 829 KiB/s rd, 827 KiB/s wr, 12 op/s 2023-05-08T13:19:46.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34525.205577 secs 2023-05-08T13:19:46.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34525.205577 secs 2023-05-08T13:19:46.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34525.205577 secs 2023-05-08T13:19:47.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:47 smithi133 ceph-mon[125939]: pgmap v18468: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 828 KiB/s rd, 826 KiB/s wr, 9 op/s 2023-05-08T13:19:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:47 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:19:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:47 smithi096 ceph-mon[124666]: pgmap v18468: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 828 KiB/s rd, 826 KiB/s wr, 9 op/s 2023-05-08T13:19:47.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:47 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:19:47.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:47 smithi186 ceph-mon[126480]: pgmap v18468: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 828 KiB/s rd, 826 KiB/s wr, 9 op/s 2023-05-08T13:19:47.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:47 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:19:49.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:49 smithi133 ceph-mon[125939]: pgmap v18469: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 828 KiB/s rd, 826 KiB/s wr, 9 op/s 2023-05-08T13:19:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34528.359884 secs 2023-05-08T13:19:49.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:49 smithi096 ceph-mon[124666]: pgmap v18469: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 828 KiB/s rd, 826 KiB/s wr, 9 op/s 2023-05-08T13:19:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34528.359884 secs 2023-05-08T13:19:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:49 smithi186 ceph-mon[126480]: pgmap v18469: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 828 KiB/s rd, 826 KiB/s wr, 9 op/s 2023-05-08T13:19:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34528.359884 secs 2023-05-08T13:19:51.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:51 smithi133 ceph-mon[125939]: pgmap v18470: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 13 op/s 2023-05-08T13:19:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34530.205697 secs 2023-05-08T13:19:51.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:51 smithi096 ceph-mon[124666]: pgmap v18470: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 13 op/s 2023-05-08T13:19:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34530.205697 secs 2023-05-08T13:19:51.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:51 smithi186 ceph-mon[126480]: pgmap v18470: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 13 op/s 2023-05-08T13:19:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34530.205697 secs 2023-05-08T13:19:53.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:53 smithi133 ceph-mon[125939]: pgmap v18471: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 853 KiB/s rd, 851 KiB/s wr, 9 op/s 2023-05-08T13:19:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:53 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:19:53.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:53 smithi096 ceph-mon[124666]: pgmap v18471: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 853 KiB/s rd, 851 KiB/s wr, 9 op/s 2023-05-08T13:19:53.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:53 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:19:53.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:53 smithi186 ceph-mon[126480]: pgmap v18471: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 853 KiB/s rd, 851 KiB/s wr, 9 op/s 2023-05-08T13:19:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:53 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:19:54.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:54 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:19:54.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:54 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:19:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:54 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:19:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:54 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:19:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:54 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:19:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:54 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:19:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:54 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:19:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:54 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:19:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:54 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:19:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34533.360007 secs 2023-05-08T13:19:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:55 smithi133 ceph-mon[125939]: pgmap v18472: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 14 op/s 2023-05-08T13:19:55.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34533.360007 secs 2023-05-08T13:19:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:55 smithi096 ceph-mon[124666]: pgmap v18472: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 14 op/s 2023-05-08T13:19:55.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34533.360007 secs 2023-05-08T13:19:55.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:55 smithi186 ceph-mon[126480]: pgmap v18472: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 14 op/s 2023-05-08T13:19:57.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:57 smithi133 ceph-mon[125939]: pgmap v18473: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 873 KiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T13:19:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:19:57.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:57 smithi096 ceph-mon[124666]: pgmap v18473: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 873 KiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T13:19:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:19:57.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:57 smithi186 ceph-mon[126480]: pgmap v18473: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 873 KiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T13:19:57.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:19:58.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:19:58.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:19:58.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:19:58.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:19:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:19:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:19:59.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:59 smithi133 ceph-mon[125939]: pgmap v18474: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 873 KiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T13:19:59.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:19:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34538.360127 secs 2023-05-08T13:19:59.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:59 smithi096 ceph-mon[124666]: pgmap v18474: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 873 KiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T13:19:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:19:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34538.360127 secs 2023-05-08T13:19:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:59 smithi186 ceph-mon[126480]: pgmap v18474: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 873 KiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T13:19:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:19:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34538.360127 secs 2023-05-08T13:20:00.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34538.913678 secs 2023-05-08T13:20:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:00 smithi133 ceph-mon[125939]: overall HEALTH_WARN 1 MDSs report slow requests 2023-05-08T13:20:00.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34538.913678 secs 2023-05-08T13:20:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:00 smithi096 ceph-mon[124666]: overall HEALTH_WARN 1 MDSs report slow requests 2023-05-08T13:20:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34538.913678 secs 2023-05-08T13:20:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:00 smithi186 ceph-mon[126480]: overall HEALTH_WARN 1 MDSs report slow requests 2023-05-08T13:20:01.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:01 smithi133 ceph-mon[125939]: pgmap v18475: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 15 op/s 2023-05-08T13:20:01.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:01 smithi096 ceph-mon[124666]: pgmap v18475: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 15 op/s 2023-05-08T13:20:01.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:01 smithi186 ceph-mon[126480]: pgmap v18475: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 15 op/s 2023-05-08T13:20:02.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:02 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:20:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:20:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:20:02.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:02 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:20:02.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:20:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:20:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:02 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:20:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:20:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:20:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:03 smithi133 ceph-mon[125939]: pgmap v18476: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T13:20:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:03 smithi096 ceph-mon[124666]: pgmap v18476: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T13:20:03.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:03 smithi186 ceph-mon[126480]: pgmap v18476: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T13:20:04.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34543.360262 secs 2023-05-08T13:20:04.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34543.360262 secs 2023-05-08T13:20:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34543.360262 secs 2023-05-08T13:20:05.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:05 smithi133 ceph-mon[125939]: pgmap v18477: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.8 MiB/s wr, 17 op/s 2023-05-08T13:20:05.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:05 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:20:05.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:05 smithi096 ceph-mon[124666]: pgmap v18477: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.8 MiB/s wr, 17 op/s 2023-05-08T13:20:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:05 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:20:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:05 smithi186 ceph-mon[126480]: pgmap v18477: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.8 MiB/s wr, 17 op/s 2023-05-08T13:20:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:05 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:20:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34545.206076 secs 2023-05-08T13:20:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:20:06.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:20:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34545.206076 secs 2023-05-08T13:20:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:20:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:20:06.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34545.206076 secs 2023-05-08T13:20:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:20:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:20:07.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:07 smithi096 ceph-mon[124666]: pgmap v18478: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 994 KiB/s wr, 12 op/s 2023-05-08T13:20:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:07 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:20:07.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:07 smithi186 ceph-mon[126480]: pgmap v18478: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 994 KiB/s wr, 12 op/s 2023-05-08T13:20:07.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:07 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:20:07.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:07 smithi133 ceph-mon[125939]: pgmap v18478: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 994 KiB/s wr, 12 op/s 2023-05-08T13:20:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:07 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:20:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:09 smithi186 ceph-mon[126480]: pgmap v18479: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 818 KiB/s wr, 11 op/s 2023-05-08T13:20:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34548.360378 secs 2023-05-08T13:20:09.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:09 smithi133 ceph-mon[125939]: pgmap v18479: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 818 KiB/s wr, 11 op/s 2023-05-08T13:20:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34548.360378 secs 2023-05-08T13:20:10.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:09 smithi096 ceph-mon[124666]: pgmap v18479: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 818 KiB/s wr, 11 op/s 2023-05-08T13:20:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34548.360378 secs 2023-05-08T13:20:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34548.913855 secs 2023-05-08T13:20:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:10 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:20:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:10 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:20:10.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34548.913855 secs 2023-05-08T13:20:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:10 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:20:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:10 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:20:11.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34548.913855 secs 2023-05-08T13:20:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:10 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:20:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:10 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:20:11.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:11 smithi186 ceph-mon[126480]: pgmap v18480: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.4 MiB/s wr, 30 op/s 2023-05-08T13:20:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34550.206204 secs 2023-05-08T13:20:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:11 smithi186 ceph-mon[126480]: osdmap e1232: 12 total, 12 up, 12 in 2023-05-08T13:20:11.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:11 smithi133 ceph-mon[125939]: pgmap v18480: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.4 MiB/s wr, 30 op/s 2023-05-08T13:20:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34550.206204 secs 2023-05-08T13:20:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:11 smithi133 ceph-mon[125939]: osdmap e1232: 12 total, 12 up, 12 in 2023-05-08T13:20:12.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:11 smithi096 ceph-mon[124666]: pgmap v18480: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.4 MiB/s wr, 30 op/s 2023-05-08T13:20:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34550.206204 secs 2023-05-08T13:20:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:11 smithi096 ceph-mon[124666]: osdmap e1232: 12 total, 12 up, 12 in 2023-05-08T13:20:12.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:12 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:20:12.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:12 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:20:13.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:12 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:20:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:13 smithi186 ceph-mon[126480]: pgmap v18482: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 30 op/s 2023-05-08T13:20:13.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:13 smithi133 ceph-mon[125939]: pgmap v18482: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 30 op/s 2023-05-08T13:20:14.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:13 smithi096 ceph-mon[124666]: pgmap v18482: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 30 op/s 2023-05-08T13:20:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:14 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:20:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:14 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:20:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34553.360471 secs 2023-05-08T13:20:14.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:14 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:20:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:14 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:20:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34553.360471 secs 2023-05-08T13:20:15.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:14 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:20:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:14 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:20:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34553.360471 secs 2023-05-08T13:20:15.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34553.913917 secs 2023-05-08T13:20:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:15 smithi186 ceph-mon[126480]: pgmap v18483: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1000 KiB/s rd, 1.4 MiB/s wr, 27 op/s 2023-05-08T13:20:15.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34553.913917 secs 2023-05-08T13:20:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:15 smithi133 ceph-mon[125939]: pgmap v18483: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1000 KiB/s rd, 1.4 MiB/s wr, 27 op/s 2023-05-08T13:20:16.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34553.913917 secs 2023-05-08T13:20:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:15 smithi096 ceph-mon[124666]: pgmap v18483: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1000 KiB/s rd, 1.4 MiB/s wr, 27 op/s 2023-05-08T13:20:16.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34555.206325 secs 2023-05-08T13:20:16.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34555.206325 secs 2023-05-08T13:20:17.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34555.206325 secs 2023-05-08T13:20:17.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:17 smithi186 ceph-mon[126480]: pgmap v18484: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1000 KiB/s rd, 1.4 MiB/s wr, 27 op/s 2023-05-08T13:20:17.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:17 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:20:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:17 smithi186 ceph-mon[126480]: osdmap e1233: 12 total, 12 up, 12 in 2023-05-08T13:20:17.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:17 smithi133 ceph-mon[125939]: pgmap v18484: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1000 KiB/s rd, 1.4 MiB/s wr, 27 op/s 2023-05-08T13:20:17.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:17 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:20:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:17 smithi133 ceph-mon[125939]: osdmap e1233: 12 total, 12 up, 12 in 2023-05-08T13:20:18.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:17 smithi096 ceph-mon[124666]: pgmap v18484: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1000 KiB/s rd, 1.4 MiB/s wr, 27 op/s 2023-05-08T13:20:18.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:17 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:20:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:17 smithi096 ceph-mon[124666]: osdmap e1233: 12 total, 12 up, 12 in 2023-05-08T13:20:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:19 smithi186 ceph-mon[126480]: pgmap v18486: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 755 KiB/s wr, 5 op/s 2023-05-08T13:20:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34558.360574 secs 2023-05-08T13:20:19.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:19 smithi133 ceph-mon[125939]: pgmap v18486: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 755 KiB/s wr, 5 op/s 2023-05-08T13:20:19.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34558.360574 secs 2023-05-08T13:20:20.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:19 smithi096 ceph-mon[124666]: pgmap v18486: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 755 KiB/s wr, 5 op/s 2023-05-08T13:20:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34558.360574 secs 2023-05-08T13:20:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34558.914017 secs 2023-05-08T13:20:20.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34558.914017 secs 2023-05-08T13:20:21.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34558.914017 secs 2023-05-08T13:20:21.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:21 smithi186 ceph-mon[126480]: pgmap v18487: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 642 KiB/s wr, 8 op/s 2023-05-08T13:20:21.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34560.206427 secs 2023-05-08T13:20:21.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:21 smithi133 ceph-mon[125939]: pgmap v18487: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 642 KiB/s wr, 8 op/s 2023-05-08T13:20:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34560.206427 secs 2023-05-08T13:20:22.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:21 smithi096 ceph-mon[124666]: pgmap v18487: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 642 KiB/s wr, 8 op/s 2023-05-08T13:20:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34560.206427 secs 2023-05-08T13:20:23.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:23 smithi133 ceph-mon[125939]: pgmap v18488: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 607 KiB/s rd, 710 KiB/s wr, 9 op/s 2023-05-08T13:20:23.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:23 smithi096 ceph-mon[124666]: pgmap v18488: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 607 KiB/s rd, 710 KiB/s wr, 9 op/s 2023-05-08T13:20:23.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:23 smithi186 ceph-mon[126480]: pgmap v18488: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 607 KiB/s rd, 710 KiB/s wr, 9 op/s 2023-05-08T13:20:24.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34563.360657 secs 2023-05-08T13:20:24.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34563.360657 secs 2023-05-08T13:20:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34563.360657 secs 2023-05-08T13:20:25.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34563.914141 secs 2023-05-08T13:20:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:25 smithi133 ceph-mon[125939]: pgmap v18489: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 422 KiB/s rd, 139 KiB/s wr, 9 op/s 2023-05-08T13:20:25.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34563.914141 secs 2023-05-08T13:20:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:25 smithi096 ceph-mon[124666]: pgmap v18489: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 422 KiB/s rd, 139 KiB/s wr, 9 op/s 2023-05-08T13:20:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34563.914141 secs 2023-05-08T13:20:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:25 smithi186 ceph-mon[126480]: pgmap v18489: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 422 KiB/s rd, 139 KiB/s wr, 9 op/s 2023-05-08T13:20:26.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34565.206547 secs 2023-05-08T13:20:26.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34565.206547 secs 2023-05-08T13:20:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34565.206547 secs 2023-05-08T13:20:27.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:27 smithi133 ceph-mon[125939]: pgmap v18490: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 499 KiB/s rd, 139 KiB/s wr, 9 op/s 2023-05-08T13:20:27.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:27 smithi096 ceph-mon[124666]: pgmap v18490: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 499 KiB/s rd, 139 KiB/s wr, 9 op/s 2023-05-08T13:20:27.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:27 smithi186 ceph-mon[126480]: pgmap v18490: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 499 KiB/s rd, 139 KiB/s wr, 9 op/s 2023-05-08T13:20:29.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:29 smithi133 ceph-mon[125939]: pgmap v18491: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 124 KiB/s wr, 8 op/s 2023-05-08T13:20:29.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34568.360776 secs 2023-05-08T13:20:29.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:29 smithi096 ceph-mon[124666]: pgmap v18491: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 124 KiB/s wr, 8 op/s 2023-05-08T13:20:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34568.360776 secs 2023-05-08T13:20:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:29 smithi186 ceph-mon[126480]: pgmap v18491: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 124 KiB/s wr, 8 op/s 2023-05-08T13:20:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34568.360776 secs 2023-05-08T13:20:30.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34568.914268 secs 2023-05-08T13:20:30.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34568.914268 secs 2023-05-08T13:20:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34568.914268 secs 2023-05-08T13:20:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:31 smithi133 ceph-mon[125939]: pgmap v18492: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 418 KiB/s rd, 116 KiB/s wr, 11 op/s 2023-05-08T13:20:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34570.206665 secs 2023-05-08T13:20:31.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:31 smithi096 ceph-mon[124666]: pgmap v18492: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 418 KiB/s rd, 116 KiB/s wr, 11 op/s 2023-05-08T13:20:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34570.206665 secs 2023-05-08T13:20:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:31 smithi186 ceph-mon[126480]: pgmap v18492: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 418 KiB/s rd, 116 KiB/s wr, 11 op/s 2023-05-08T13:20:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34570.206665 secs 2023-05-08T13:20:33.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:33 smithi133 ceph-mon[125939]: pgmap v18493: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 369 KiB/s wr, 8 op/s 2023-05-08T13:20:33.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:33 smithi096 ceph-mon[124666]: pgmap v18493: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 369 KiB/s wr, 8 op/s 2023-05-08T13:20:33.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:33 smithi186 ceph-mon[126480]: pgmap v18493: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 369 KiB/s wr, 8 op/s 2023-05-08T13:20:34.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34573.360904 secs 2023-05-08T13:20:34.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34573.360904 secs 2023-05-08T13:20:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34573.360904 secs 2023-05-08T13:20:35.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34573.914383 secs 2023-05-08T13:20:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:35 smithi133 ceph-mon[125939]: pgmap v18494: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 422 KiB/s rd, 331 KiB/s wr, 12 op/s 2023-05-08T13:20:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34573.914383 secs 2023-05-08T13:20:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:35 smithi096 ceph-mon[124666]: pgmap v18494: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 422 KiB/s rd, 331 KiB/s wr, 12 op/s 2023-05-08T13:20:35.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34573.914383 secs 2023-05-08T13:20:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:35 smithi186 ceph-mon[126480]: pgmap v18494: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 422 KiB/s rd, 331 KiB/s wr, 12 op/s 2023-05-08T13:20:36.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34575.206810 secs 2023-05-08T13:20:36.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34575.206810 secs 2023-05-08T13:20:36.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34575.206810 secs 2023-05-08T13:20:37.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:37 smithi133 ceph-mon[125939]: pgmap v18495: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 304 KiB/s wr, 8 op/s 2023-05-08T13:20:37.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:37 smithi096 ceph-mon[124666]: pgmap v18495: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 304 KiB/s wr, 8 op/s 2023-05-08T13:20:37.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:37 smithi186 ceph-mon[126480]: pgmap v18495: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 304 KiB/s wr, 8 op/s 2023-05-08T13:20:39.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:39 smithi133 ceph-mon[125939]: pgmap v18496: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 304 KiB/s wr, 7 op/s 2023-05-08T13:20:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34578.361047 secs 2023-05-08T13:20:39.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:39 smithi096 ceph-mon[124666]: pgmap v18496: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 304 KiB/s wr, 7 op/s 2023-05-08T13:20:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34578.361047 secs 2023-05-08T13:20:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:39 smithi186 ceph-mon[126480]: pgmap v18496: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 304 KiB/s wr, 7 op/s 2023-05-08T13:20:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34578.361047 secs 2023-05-08T13:20:40.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34578.914502 secs 2023-05-08T13:20:40.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34578.914502 secs 2023-05-08T13:20:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34578.914502 secs 2023-05-08T13:20:41.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:41 smithi133 ceph-mon[125939]: pgmap v18497: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 304 KiB/s wr, 10 op/s 2023-05-08T13:20:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34580.206923 secs 2023-05-08T13:20:41.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:41 smithi096 ceph-mon[124666]: pgmap v18497: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 304 KiB/s wr, 10 op/s 2023-05-08T13:20:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34580.206923 secs 2023-05-08T13:20:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:41 smithi186 ceph-mon[126480]: pgmap v18497: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 304 KiB/s wr, 10 op/s 2023-05-08T13:20:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34580.206923 secs 2023-05-08T13:20:42.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:42 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:20:42.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:42 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:20:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:42 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:20:43.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:43 smithi133 ceph-mon[125939]: pgmap v18498: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 304 KiB/s wr, 7 op/s 2023-05-08T13:20:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:43 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:20:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:43 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:20:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:43 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:20:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:43 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:20:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:43 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T13:20:43.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:43 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T13:20:43.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:43 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:20:43.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:43 smithi096 ceph-mon[124666]: pgmap v18498: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 304 KiB/s wr, 7 op/s 2023-05-08T13:20:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:43 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:20:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:43 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:20:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:43 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:20:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:43 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:20:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:43 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T13:20:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:43 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T13:20:43.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:43 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:20:43.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:43 smithi186 ceph-mon[126480]: pgmap v18498: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 304 KiB/s wr, 7 op/s 2023-05-08T13:20:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:43 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:20:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:43 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:20:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:43 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:20:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:43 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:20:43.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:43 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T13:20:43.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:43 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T13:20:43.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:43 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:20:44.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34583.361160 secs 2023-05-08T13:20:44.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34583.361160 secs 2023-05-08T13:20:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34583.361160 secs 2023-05-08T13:20:45.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34583.914625 secs 2023-05-08T13:20:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:45 smithi133 ceph-mon[125939]: pgmap v18499: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 333 KiB/s rd, 342 KiB/s wr, 10 op/s 2023-05-08T13:20:45.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34583.914625 secs 2023-05-08T13:20:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:45 smithi096 ceph-mon[124666]: pgmap v18499: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 333 KiB/s rd, 342 KiB/s wr, 10 op/s 2023-05-08T13:20:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34583.914625 secs 2023-05-08T13:20:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:45 smithi186 ceph-mon[126480]: pgmap v18499: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 333 KiB/s rd, 342 KiB/s wr, 10 op/s 2023-05-08T13:20:46.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34585.206997 secs 2023-05-08T13:20:46.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34585.206997 secs 2023-05-08T13:20:46.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34585.206997 secs 2023-05-08T13:20:47.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:47 smithi133 ceph-mon[125939]: pgmap v18500: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 316 KiB/s wr, 6 op/s 2023-05-08T13:20:47.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:47 smithi096 ceph-mon[124666]: pgmap v18500: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 316 KiB/s wr, 6 op/s 2023-05-08T13:20:47.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:47 smithi186 ceph-mon[126480]: pgmap v18500: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 316 KiB/s wr, 6 op/s 2023-05-08T13:20:49.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:49 smithi133 ceph-mon[125939]: pgmap v18501: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 316 KiB/s wr, 6 op/s 2023-05-08T13:20:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34588.361240 secs 2023-05-08T13:20:49.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:49 smithi096 ceph-mon[124666]: pgmap v18501: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 316 KiB/s wr, 6 op/s 2023-05-08T13:20:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34588.361240 secs 2023-05-08T13:20:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:49 smithi186 ceph-mon[126480]: pgmap v18501: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 316 KiB/s wr, 6 op/s 2023-05-08T13:20:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34588.361240 secs 2023-05-08T13:20:51.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:51 smithi096 ceph-mon[124666]: pgmap v18502: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 967 KiB/s rd, 938 KiB/s wr, 11 op/s 2023-05-08T13:20:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34590.207121 secs 2023-05-08T13:20:51.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:51 smithi186 ceph-mon[126480]: pgmap v18502: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 967 KiB/s rd, 938 KiB/s wr, 11 op/s 2023-05-08T13:20:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34590.207121 secs 2023-05-08T13:20:51.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:51 smithi133 ceph-mon[125939]: pgmap v18502: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 967 KiB/s rd, 938 KiB/s wr, 11 op/s 2023-05-08T13:20:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34590.207121 secs 2023-05-08T13:20:53.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:53 smithi133 ceph-mon[125939]: pgmap v18503: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 965 KiB/s rd, 938 KiB/s wr, 8 op/s 2023-05-08T13:20:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:53 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:20:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:53 smithi096 ceph-mon[124666]: pgmap v18503: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 965 KiB/s rd, 938 KiB/s wr, 8 op/s 2023-05-08T13:20:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:53 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:20:53.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:53 smithi186 ceph-mon[126480]: pgmap v18503: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 965 KiB/s rd, 938 KiB/s wr, 8 op/s 2023-05-08T13:20:53.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:53 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:20:54.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:54 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:20:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:54 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:20:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:54 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:20:54.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:54 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:20:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:54 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:20:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:54 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:20:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:54 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:20:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:54 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:20:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:54 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:20:55.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34593.361368 secs 2023-05-08T13:20:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:55 smithi133 ceph-mon[125939]: pgmap v18504: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2023-05-08T13:20:55.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34593.361368 secs 2023-05-08T13:20:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:55 smithi096 ceph-mon[124666]: pgmap v18504: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2023-05-08T13:20:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34593.361368 secs 2023-05-08T13:20:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:55 smithi186 ceph-mon[126480]: pgmap v18504: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2023-05-08T13:20:56.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34595.207260 secs 2023-05-08T13:20:56.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34595.207260 secs 2023-05-08T13:20:56.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34595.207260 secs 2023-05-08T13:20:57.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:57 smithi133 ceph-mon[125939]: pgmap v18505: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1001 KiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T13:20:57.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:57 smithi096 ceph-mon[124666]: pgmap v18505: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1001 KiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T13:20:57.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:57 smithi186 ceph-mon[126480]: pgmap v18505: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1001 KiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T13:20:59.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:59 smithi133 ceph-mon[125939]: pgmap v18506: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1001 KiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T13:20:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:20:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34598.361488 secs 2023-05-08T13:20:59.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:59 smithi096 ceph-mon[124666]: pgmap v18506: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1001 KiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T13:20:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:20:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34598.361488 secs 2023-05-08T13:20:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:59 smithi186 ceph-mon[126480]: pgmap v18506: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1001 KiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T13:20:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:20:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34598.361488 secs 2023-05-08T13:21:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:21:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34598.914939 secs 2023-05-08T13:21:00.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:21:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34598.914939 secs 2023-05-08T13:21:00.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:21:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34598.914939 secs 2023-05-08T13:21:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:21:01 smithi133 ceph-mon[125939]: pgmap v18507: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 15 op/s 2023-05-08T13:21:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:21:01 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:21:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:21:01 smithi096 ceph-mon[124666]: pgmap v18507: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 15 op/s 2023-05-08T13:21:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:21:01 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:21:01.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:21:01 smithi186 ceph-mon[126480]: pgmap v18507: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 15 op/s 2023-05-08T13:21:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:21:01 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:21:02.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:21:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:21:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:21:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:21:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:21:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:21:02.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:21:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:21:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:21:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:21:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:21:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:21:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:21:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:21:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:21:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:21:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:21:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:21:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:21:03 smithi133 ceph-mon[125939]: pgmap v18508: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 992 KiB/s rd, 815 KiB/s wr, 10 op/s 2023-05-08T13:21:03.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:21:03 smithi096 ceph-mon[124666]: pgmap v18508: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 992 KiB/s rd, 815 KiB/s wr, 10 op/s 2023-05-08T13:21:03.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:21:03 smithi186 ceph-mon[126480]: pgmap v18508: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 992 KiB/s rd, 815 KiB/s wr, 10 op/s 2023-05-08T13:21:04.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:21:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34603.361625 secs 2023-05-08T13:21:04.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:21:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34603.361625 secs 2023-05-08T13:21:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:21:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34603.361625 secs 2023-05-08T13:21:05.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:21:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34603.915076 secs 2023-05-08T13:21:05.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:21:05 smithi133 ceph-mon[125939]: pgmap v18509: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.3 MiB/s wr, 27 op/s 2023-05-08T13:21:05.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:21:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34603.915076 secs 2023-05-08T13:21:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:21:05 smithi096 ceph-mon[124666]: pgmap v18509: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.3 MiB/s wr, 27 op/s 2023-05-08T13:21:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:21:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34603.915076 secs 2023-05-08T13:21:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:21:05 smithi186 ceph-mon[126480]: pgmap v18509: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.3 MiB/s wr, 27 op/s 2023-05-08T13:21:07.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:21:07 smithi133 ceph-mon[125939]: pgmap v18510: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 833 KiB/s wr, 22 op/s 2023-05-08T13:21:07.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:21:07 smithi096 ceph-mon[124666]: pgmap v18510: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 833 KiB/s wr, 22 op/s 2023-05-08T13:21:07.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:21:07 smithi186 ceph-mon[126480]: pgmap v18510: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 833 KiB/s wr, 22 op/s 2023-05-08T13:21:09.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:21:09 smithi133 ceph-mon[125939]: pgmap v18511: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 833 KiB/s wr, 22 op/s 2023-05-08T13:21:09.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:21:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34608.361762 secs 2023-05-08T13:21:09.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:21:09 smithi096 ceph-mon[124666]: pgmap v18511: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 833 KiB/s wr, 22 op/s 2023-05-08T13:21:09.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:21:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34608.361762 secs 2023-05-08T13:21:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:21:09 smithi186 ceph-mon[126480]: pgmap v18511: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 833 KiB/s wr, 22 op/s 2023-05-08T13:21:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:21:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34608.361762 secs 2023-05-08T13:21:10.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:21:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34608.915197 secs 2023-05-08T13:21:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:21:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34608.915197 secs 2023-05-08T13:21:10.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:21:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34608.915197 secs 2023-05-08T13:21:11.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:21:11 smithi133 ceph-mon[125939]: pgmap v18512: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.3 MiB/s wr, 26 op/s 2023-05-08T13:21:11.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:21:11 smithi096 ceph-mon[124666]: pgmap v18512: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.3 MiB/s wr, 26 op/s 2023-05-08T13:21:11.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:21:11 smithi186 ceph-mon[126480]: pgmap v18512: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.3 MiB/s wr, 26 op/s 2023-05-08T13:21:13.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:21:13 smithi133 ceph-mon[125939]: pgmap v18513: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 21 op/s 2023-05-08T13:21:13.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:21:13 smithi096 ceph-mon[124666]: pgmap v18513: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 21 op/s 2023-05-08T13:21:13.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:21:13 smithi186 ceph-mon[126480]: pgmap v18513: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 21 op/s 2023-05-08T13:21:14.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:21:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34613.361884 secs 2023-05-08T13:21:14.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:21:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34613.361884 secs 2023-05-08T13:21:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:21:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34613.361884 secs 2023-05-08T13:21:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:21:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34613.915324 secs 2023-05-08T13:21:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:21:15 smithi133 ceph-mon[125939]: pgmap v18514: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.3 MiB/s wr, 25 op/s 2023-05-08T13:21:15.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:21:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34613.915324 secs 2023-05-08T13:21:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:21:15 smithi096 ceph-mon[124666]: pgmap v18514: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.3 MiB/s wr, 25 op/s 2023-05-08T13:21:15.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:21:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34613.915324 secs 2023-05-08T13:21:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:21:15 smithi186 ceph-mon[126480]: pgmap v18514: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.3 MiB/s wr, 25 op/s 2023-05-08T13:21:17.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:21:17 smithi133 ceph-mon[125939]: pgmap v18515: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1016 KiB/s rd, 740 KiB/s wr, 7 op/s 2023-05-08T13:21:17.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:21:17 smithi096 ceph-mon[124666]: pgmap v18515: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1016 KiB/s rd, 740 KiB/s wr, 7 op/s 2023-05-08T13:21:17.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:21:17 smithi186 ceph-mon[126480]: pgmap v18515: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1016 KiB/s rd, 740 KiB/s wr, 7 op/s 2023-05-08T13:21:19.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:21:19 smithi133 ceph-mon[125939]: pgmap v18516: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1016 KiB/s rd, 740 KiB/s wr, 7 op/s 2023-05-08T13:21:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:21:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34618.362004 secs 2023-05-08T13:21:19.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:21:19 smithi096 ceph-mon[124666]: pgmap v18516: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1016 KiB/s rd, 740 KiB/s wr, 7 op/s 2023-05-08T13:21:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:21:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34618.362004 secs 2023-05-08T13:21:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:21:19 smithi186 ceph-mon[126480]: pgmap v18516: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1016 KiB/s rd, 740 KiB/s wr, 7 op/s 2023-05-08T13:21:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:21:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34618.362004 secs 2023-05-08T13:21:20.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:21:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34618.915488 secs 2023-05-08T13:21:20.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:21:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34618.915488 secs 2023-05-08T13:21:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:21:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34618.915488 secs 2023-05-08T13:21:21.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:21:21 smithi133 ceph-mon[125939]: pgmap v18517: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 879 KiB/s wr, 11 op/s 2023-05-08T13:21:21.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:21:21 smithi096 ceph-mon[124666]: pgmap v18517: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 879 KiB/s wr, 11 op/s 2023-05-08T13:21:21.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:21:21 smithi186 ceph-mon[126480]: pgmap v18517: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 879 KiB/s wr, 11 op/s 2023-05-08T13:21:23.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:21:23 smithi133 ceph-mon[125939]: pgmap v18518: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 826 KiB/s rd, 386 KiB/s wr, 7 op/s 2023-05-08T13:21:23.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:21:23 smithi096 ceph-mon[124666]: pgmap v18518: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 826 KiB/s rd, 386 KiB/s wr, 7 op/s 2023-05-08T13:21:23.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:21:23 smithi186 ceph-mon[126480]: pgmap v18518: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 826 KiB/s rd, 386 KiB/s wr, 7 op/s 2023-05-08T13:21:24.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:21:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34623.362068 secs 2023-05-08T13:21:24.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:21:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34623.362068 secs 2023-05-08T13:21:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:21:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34623.362068 secs 2023-05-08T13:21:25.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:21:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34623.915608 secs 2023-05-08T13:21:25.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:21:25 smithi133 ceph-mon[125939]: pgmap v18519: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.2 MiB/s wr, 15 op/s 2023-05-08T13:21:25.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:21:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34623.915608 secs 2023-05-08T13:21:25.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:21:25 smithi096 ceph-mon[124666]: pgmap v18519: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.2 MiB/s wr, 15 op/s 2023-05-08T13:21:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:21:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34623.915608 secs 2023-05-08T13:21:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:21:25 smithi186 ceph-mon[126480]: pgmap v18519: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.2 MiB/s wr, 15 op/s 2023-05-08T13:21:27.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:21:27 smithi133 ceph-mon[125939]: pgmap v18520: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 961 KiB/s rd, 980 KiB/s wr, 11 op/s 2023-05-08T13:21:27.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:21:27 smithi096 ceph-mon[124666]: pgmap v18520: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 961 KiB/s rd, 980 KiB/s wr, 11 op/s 2023-05-08T13:21:27.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:21:27 smithi186 ceph-mon[126480]: pgmap v18520: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 961 KiB/s rd, 980 KiB/s wr, 11 op/s 2023-05-08T13:21:29.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:21:29 smithi133 ceph-mon[125939]: pgmap v18521: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 961 KiB/s rd, 980 KiB/s wr, 11 op/s 2023-05-08T13:21:29.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:21:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34628.362200 secs 2023-05-08T13:21:29.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:21:29 smithi096 ceph-mon[124666]: pgmap v18521: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 961 KiB/s rd, 980 KiB/s wr, 11 op/s 2023-05-08T13:21:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:21:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34628.362200 secs 2023-05-08T13:21:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:21:29 smithi186 ceph-mon[126480]: pgmap v18521: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 961 KiB/s rd, 980 KiB/s wr, 11 op/s 2023-05-08T13:21:29.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:21:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34628.362200 secs 2023-05-08T13:21:30.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:21:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34628.915748 secs 2023-05-08T13:21:30.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:21:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34628.915748 secs 2023-05-08T13:21:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:21:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34628.915748 secs 2023-05-08T13:21:31.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:21:31 smithi133 ceph-mon[125939]: pgmap v18522: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 968 KiB/s rd, 1010 KiB/s wr, 15 op/s 2023-05-08T13:21:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:21:31 smithi096 ceph-mon[124666]: pgmap v18522: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 968 KiB/s rd, 1010 KiB/s wr, 15 op/s 2023-05-08T13:21:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:21:31 smithi186 ceph-mon[126480]: pgmap v18522: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 968 KiB/s rd, 1010 KiB/s wr, 15 op/s 2023-05-08T13:21:32.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:21:32 smithi133 ceph-mon[125939]: osdmap e1234: 12 total, 12 up, 12 in 2023-05-08T13:21:32.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:21:32 smithi096 ceph-mon[124666]: osdmap e1234: 12 total, 12 up, 12 in 2023-05-08T13:21:32.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:21:32 smithi186 ceph-mon[126480]: osdmap e1234: 12 total, 12 up, 12 in 2023-05-08T13:21:33.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:21:33 smithi133 ceph-mon[125939]: pgmap v18524: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 994 KiB/s rd, 1.0 MiB/s wr, 14 op/s 2023-05-08T13:21:33.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:21:33 smithi096 ceph-mon[124666]: pgmap v18524: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 994 KiB/s rd, 1.0 MiB/s wr, 14 op/s 2023-05-08T13:21:33.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:21:33 smithi186 ceph-mon[126480]: pgmap v18524: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 994 KiB/s rd, 1.0 MiB/s wr, 14 op/s 2023-05-08T13:21:34.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:21:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34633.362362 secs 2023-05-08T13:21:34.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:21:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34633.362362 secs 2023-05-08T13:21:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:21:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34633.362362 secs 2023-05-08T13:21:35.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:21:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34633.915830 secs 2023-05-08T13:21:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:21:35 smithi133 ceph-mon[125939]: pgmap v18525: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 203 KiB/s wr, 9 op/s 2023-05-08T13:21:35.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:21:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34633.915830 secs 2023-05-08T13:21:35.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:21:35 smithi096 ceph-mon[124666]: pgmap v18525: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 203 KiB/s wr, 9 op/s 2023-05-08T13:21:35.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:21:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34633.915830 secs 2023-05-08T13:21:35.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:21:35 smithi186 ceph-mon[126480]: pgmap v18525: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 203 KiB/s wr, 9 op/s 2023-05-08T13:21:37.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:21:37 smithi096 ceph-mon[124666]: pgmap v18526: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 203 KiB/s wr, 9 op/s 2023-05-08T13:21:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:21:37 smithi096 ceph-mon[124666]: osdmap e1235: 12 total, 12 up, 12 in 2023-05-08T13:21:37.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:21:37 smithi186 ceph-mon[126480]: pgmap v18526: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 203 KiB/s wr, 9 op/s 2023-05-08T13:21:37.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:21:37 smithi186 ceph-mon[126480]: osdmap e1235: 12 total, 12 up, 12 in 2023-05-08T13:21:37.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:21:37 smithi133 ceph-mon[125939]: pgmap v18526: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 203 KiB/s wr, 9 op/s 2023-05-08T13:21:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:21:37 smithi133 ceph-mon[125939]: osdmap e1235: 12 total, 12 up, 12 in 2023-05-08T13:21:39.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:21:39 smithi096 ceph-mon[124666]: pgmap v18528: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 208 KiB/s wr, 5 op/s 2023-05-08T13:21:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:21:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34638.362466 secs 2023-05-08T13:21:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:21:39 smithi186 ceph-mon[126480]: pgmap v18528: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 208 KiB/s wr, 5 op/s 2023-05-08T13:21:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:21:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34638.362466 secs 2023-05-08T13:21:39.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:21:39 smithi133 ceph-mon[125939]: pgmap v18528: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 208 KiB/s wr, 5 op/s 2023-05-08T13:21:39.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:21:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34638.362466 secs 2023-05-08T13:21:40.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:21:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34638.915951 secs 2023-05-08T13:21:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:21:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34638.915951 secs 2023-05-08T13:21:40.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:21:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34638.915951 secs 2023-05-08T13:21:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:21:41 smithi186 ceph-mon[126480]: pgmap v18529: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 188 KiB/s wr, 8 op/s 2023-05-08T13:21:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:21:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34640.208393 secs 2023-05-08T13:21:41.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:21:41 smithi133 ceph-mon[125939]: pgmap v18529: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 188 KiB/s wr, 8 op/s 2023-05-08T13:21:41.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:21:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34640.208393 secs 2023-05-08T13:21:42.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:21:41 smithi096 ceph-mon[124666]: pgmap v18529: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 188 KiB/s wr, 8 op/s 2023-05-08T13:21:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:21:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34640.208393 secs 2023-05-08T13:21:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:21:42 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:21:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:21:42 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:21:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:21:42 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:21:42.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:21:42 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:21:42.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:21:42 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:21:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:21:42 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:21:43.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:21:42 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:21:43.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:21:42 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:21:43.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:21:42 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:21:43.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:21:43 smithi186 ceph-mon[126480]: pgmap v18530: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 167 KiB/s wr, 7 op/s 2023-05-08T13:21:43.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:21:43 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:21:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:21:43 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:21:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:21:43 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:21:43.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:21:43 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:21:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:21:43 smithi133 ceph-mon[125939]: pgmap v18530: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 167 KiB/s wr, 7 op/s 2023-05-08T13:21:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:21:43 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:21:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:21:43 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:21:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:21:43 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:21:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:21:43 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:21:44.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:21:43 smithi096 ceph-mon[124666]: pgmap v18530: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 167 KiB/s wr, 7 op/s 2023-05-08T13:21:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:21:43 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:21:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:21:43 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:21:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:21:43 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:21:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:21:43 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:21:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:21:44 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:21:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:21:44 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T13:21:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:21:44 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T13:21:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:21:44 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:21:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:21:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34643.362541 secs 2023-05-08T13:21:44.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:21:44 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:21:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:21:44 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T13:21:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:21:44 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T13:21:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:21:44 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:21:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:21:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34643.362541 secs 2023-05-08T13:21:45.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:21:44 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:21:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:21:44 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T13:21:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:21:44 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T13:21:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:21:44 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:21:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:21:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34643.362541 secs 2023-05-08T13:21:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:21:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34643.916063 secs 2023-05-08T13:21:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:21:45 smithi186 ceph-mon[126480]: pgmap v18531: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 932 KiB/s rd, 930 KiB/s wr, 10 op/s 2023-05-08T13:21:45.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:21:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34643.916063 secs 2023-05-08T13:21:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:21:45 smithi133 ceph-mon[125939]: pgmap v18531: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 932 KiB/s rd, 930 KiB/s wr, 10 op/s 2023-05-08T13:21:46.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:21:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34643.916063 secs 2023-05-08T13:21:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:21:45 smithi096 ceph-mon[124666]: pgmap v18531: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 932 KiB/s rd, 930 KiB/s wr, 10 op/s 2023-05-08T13:21:46.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:21:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34645.208491 secs 2023-05-08T13:21:46.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:21:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34645.208491 secs 2023-05-08T13:21:47.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:21:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34645.208491 secs 2023-05-08T13:21:47.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:21:47 smithi186 ceph-mon[126480]: pgmap v18532: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 932 KiB/s rd, 930 KiB/s wr, 10 op/s 2023-05-08T13:21:47.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:21:47 smithi133 ceph-mon[125939]: pgmap v18532: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 932 KiB/s rd, 930 KiB/s wr, 10 op/s 2023-05-08T13:21:48.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:21:47 smithi096 ceph-mon[124666]: pgmap v18532: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 932 KiB/s rd, 930 KiB/s wr, 10 op/s 2023-05-08T13:21:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:21:49 smithi186 ceph-mon[126480]: pgmap v18533: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 832 KiB/s rd, 830 KiB/s wr, 9 op/s 2023-05-08T13:21:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:21:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34648.362661 secs 2023-05-08T13:21:49.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:21:49 smithi133 ceph-mon[125939]: pgmap v18533: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 832 KiB/s rd, 830 KiB/s wr, 9 op/s 2023-05-08T13:21:49.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:21:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34648.362661 secs 2023-05-08T13:21:50.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:21:49 smithi096 ceph-mon[124666]: pgmap v18533: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 832 KiB/s rd, 830 KiB/s wr, 9 op/s 2023-05-08T13:21:50.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:21:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34648.362661 secs 2023-05-08T13:21:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:21:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34648.916197 secs 2023-05-08T13:21:50.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:21:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34648.916197 secs 2023-05-08T13:21:51.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:21:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34648.916197 secs 2023-05-08T13:21:51.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:21:51 smithi186 ceph-mon[126480]: pgmap v18534: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T13:21:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:21:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34650.208627 secs 2023-05-08T13:21:51.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:21:51 smithi133 ceph-mon[125939]: pgmap v18534: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T13:21:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:21:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34650.208627 secs 2023-05-08T13:21:52.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:21:51 smithi096 ceph-mon[124666]: pgmap v18534: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T13:21:52.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:21:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34650.208627 secs 2023-05-08T13:21:53.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:21:53 smithi133 ceph-mon[125939]: pgmap v18535: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T13:21:53.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:21:53 smithi096 ceph-mon[124666]: pgmap v18535: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T13:21:53.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:21:53 smithi186 ceph-mon[126480]: pgmap v18535: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T13:21:54.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:21:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34653.362785 secs 2023-05-08T13:21:54.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:21:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34653.362785 secs 2023-05-08T13:21:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:21:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34653.362785 secs 2023-05-08T13:21:55.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:21:55 smithi133 ceph-mon[125939]: pgmap v18536: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 15 op/s 2023-05-08T13:21:55.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:21:55 smithi096 ceph-mon[124666]: pgmap v18536: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 15 op/s 2023-05-08T13:21:55.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:21:55 smithi186 ceph-mon[126480]: pgmap v18536: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 15 op/s 2023-05-08T13:21:56.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:21:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34655.208772 secs 2023-05-08T13:21:56.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:21:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34655.208772 secs 2023-05-08T13:21:56.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:21:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34655.208772 secs 2023-05-08T13:21:57.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:21:57 smithi133 ceph-mon[125939]: pgmap v18537: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 887 KiB/s rd, 863 KiB/s wr, 10 op/s 2023-05-08T13:21:57.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:21:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:21:57.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:21:57 smithi096 ceph-mon[124666]: pgmap v18537: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 887 KiB/s rd, 863 KiB/s wr, 10 op/s 2023-05-08T13:21:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:21:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:21:57.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:21:57 smithi186 ceph-mon[126480]: pgmap v18537: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 887 KiB/s rd, 863 KiB/s wr, 10 op/s 2023-05-08T13:21:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:21:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:21:58.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:21:58 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:21:58.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:21:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:21:58.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:21:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:21:58.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:21:58 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:21:58.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:21:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:21:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:21:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:21:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:21:58 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:21:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:21:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:21:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:21:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:21:59.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:21:59 smithi133 ceph-mon[125939]: pgmap v18538: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 887 KiB/s rd, 863 KiB/s wr, 10 op/s 2023-05-08T13:21:59.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:21:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34658.362922 secs 2023-05-08T13:21:59.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:21:59 smithi096 ceph-mon[124666]: pgmap v18538: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 887 KiB/s rd, 863 KiB/s wr, 10 op/s 2023-05-08T13:21:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:21:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34658.362922 secs 2023-05-08T13:21:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:21:59 smithi186 ceph-mon[126480]: pgmap v18538: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 887 KiB/s rd, 863 KiB/s wr, 10 op/s 2023-05-08T13:21:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:21:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34658.362922 secs 2023-05-08T13:22:00.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34658.916436 secs 2023-05-08T13:22:00.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34658.916436 secs 2023-05-08T13:22:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34658.916436 secs 2023-05-08T13:22:01.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:01 smithi133 ceph-mon[125939]: pgmap v18539: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 16 op/s 2023-05-08T13:22:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:01 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:22:01.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:01 smithi096 ceph-mon[124666]: pgmap v18539: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 16 op/s 2023-05-08T13:22:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:01 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:22:01.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:01 smithi186 ceph-mon[126480]: pgmap v18539: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 16 op/s 2023-05-08T13:22:01.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:01 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:22:02.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:22:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:22:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:22:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:22:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:22:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:22:02.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:22:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:22:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:22:03.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:03 smithi096 ceph-mon[124666]: pgmap v18540: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 11 op/s 2023-05-08T13:22:03.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:03 smithi186 ceph-mon[126480]: pgmap v18540: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 11 op/s 2023-05-08T13:22:03.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:03 smithi133 ceph-mon[125939]: pgmap v18540: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 11 op/s 2023-05-08T13:22:04.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34663.363040 secs 2023-05-08T13:22:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34663.363040 secs 2023-05-08T13:22:04.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34663.363040 secs 2023-05-08T13:22:05.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:05 smithi096 ceph-mon[124666]: pgmap v18541: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.1 MiB/s wr, 19 op/s 2023-05-08T13:22:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:05 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:22:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:05 smithi186 ceph-mon[126480]: pgmap v18541: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.1 MiB/s wr, 19 op/s 2023-05-08T13:22:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:05 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:22:05.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:05 smithi133 ceph-mon[125939]: pgmap v18541: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.1 MiB/s wr, 19 op/s 2023-05-08T13:22:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:05 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:22:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:06 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:22:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:22:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:22:06.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:06 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:22:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:22:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:22:07.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:06 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:22:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:22:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:22:07.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:07 smithi186 ceph-mon[126480]: pgmap v18542: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 13 op/s 2023-05-08T13:22:07.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:07 smithi133 ceph-mon[125939]: pgmap v18542: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 13 op/s 2023-05-08T13:22:08.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:07 smithi096 ceph-mon[124666]: pgmap v18542: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 13 op/s 2023-05-08T13:22:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:09 smithi186 ceph-mon[126480]: pgmap v18543: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 13 op/s 2023-05-08T13:22:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34668.363166 secs 2023-05-08T13:22:09.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:09 smithi133 ceph-mon[125939]: pgmap v18543: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 13 op/s 2023-05-08T13:22:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34668.363166 secs 2023-05-08T13:22:10.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:09 smithi096 ceph-mon[124666]: pgmap v18543: 97 pgs: 97 active+clean; 6.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 13 op/s 2023-05-08T13:22:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34668.363166 secs 2023-05-08T13:22:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34668.916647 secs 2023-05-08T13:22:10.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34668.916647 secs 2023-05-08T13:22:11.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34668.916647 secs 2023-05-08T13:22:11.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:11 smithi186 ceph-mon[126480]: pgmap v18544: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.3 MiB/s wr, 32 op/s 2023-05-08T13:22:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34670.209136 secs 2023-05-08T13:22:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:11 smithi186 ceph-mon[126480]: osdmap e1236: 12 total, 12 up, 12 in 2023-05-08T13:22:11.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:11 smithi133 ceph-mon[125939]: pgmap v18544: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.3 MiB/s wr, 32 op/s 2023-05-08T13:22:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34670.209136 secs 2023-05-08T13:22:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:11 smithi133 ceph-mon[125939]: osdmap e1236: 12 total, 12 up, 12 in 2023-05-08T13:22:12.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:11 smithi096 ceph-mon[124666]: pgmap v18544: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.3 MiB/s wr, 32 op/s 2023-05-08T13:22:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34670.209136 secs 2023-05-08T13:22:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:11 smithi096 ceph-mon[124666]: osdmap e1236: 12 total, 12 up, 12 in 2023-05-08T13:22:13.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:13 smithi133 ceph-mon[125939]: pgmap v18546: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.3 MiB/s wr, 31 op/s 2023-05-08T13:22:13.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:13 smithi096 ceph-mon[124666]: pgmap v18546: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.3 MiB/s wr, 31 op/s 2023-05-08T13:22:13.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:13 smithi186 ceph-mon[126480]: pgmap v18546: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.3 MiB/s wr, 31 op/s 2023-05-08T13:22:14.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:14 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:22:14.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:14 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:22:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:14 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:22:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:14 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:22:14.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:14 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:22:14.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:14 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:22:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:14 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:22:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:14 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:22:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:14 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:22:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:14 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:22:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:14 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:22:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:14 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:22:15.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34673.363299 secs 2023-05-08T13:22:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34673.916774 secs 2023-05-08T13:22:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:15 smithi133 ceph-mon[125939]: pgmap v18547: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 27 op/s 2023-05-08T13:22:15.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34673.363299 secs 2023-05-08T13:22:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34673.916774 secs 2023-05-08T13:22:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:15 smithi096 ceph-mon[124666]: pgmap v18547: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 27 op/s 2023-05-08T13:22:15.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34673.363299 secs 2023-05-08T13:22:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34673.916774 secs 2023-05-08T13:22:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:15 smithi186 ceph-mon[126480]: pgmap v18547: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 27 op/s 2023-05-08T13:22:16.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34675.209265 secs 2023-05-08T13:22:16.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34675.209265 secs 2023-05-08T13:22:16.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34675.209265 secs 2023-05-08T13:22:17.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:17 smithi133 ceph-mon[125939]: pgmap v18548: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 27 op/s 2023-05-08T13:22:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:17 smithi133 ceph-mon[125939]: osdmap e1237: 12 total, 12 up, 12 in 2023-05-08T13:22:17.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:17 smithi096 ceph-mon[124666]: pgmap v18548: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 27 op/s 2023-05-08T13:22:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:17 smithi096 ceph-mon[124666]: osdmap e1237: 12 total, 12 up, 12 in 2023-05-08T13:22:17.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:17 smithi186 ceph-mon[126480]: pgmap v18548: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 27 op/s 2023-05-08T13:22:17.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:17 smithi186 ceph-mon[126480]: osdmap e1237: 12 total, 12 up, 12 in 2023-05-08T13:22:19.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:19 smithi133 ceph-mon[125939]: pgmap v18550: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 453 KiB/s wr, 6 op/s 2023-05-08T13:22:19.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34678.363421 secs 2023-05-08T13:22:19.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:19 smithi096 ceph-mon[124666]: pgmap v18550: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 453 KiB/s wr, 6 op/s 2023-05-08T13:22:19.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34678.363421 secs 2023-05-08T13:22:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:19 smithi186 ceph-mon[126480]: pgmap v18550: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 453 KiB/s wr, 6 op/s 2023-05-08T13:22:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34678.363421 secs 2023-05-08T13:22:20.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34678.916848 secs 2023-05-08T13:22:20.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34678.916848 secs 2023-05-08T13:22:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34678.916848 secs 2023-05-08T13:22:21.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:21 smithi133 ceph-mon[125939]: pgmap v18551: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 538 KiB/s rd, 565 KiB/s wr, 10 op/s 2023-05-08T13:22:21.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34680.209339 secs 2023-05-08T13:22:21.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:21 smithi096 ceph-mon[124666]: pgmap v18551: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 538 KiB/s rd, 565 KiB/s wr, 10 op/s 2023-05-08T13:22:21.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34680.209339 secs 2023-05-08T13:22:21.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:21 smithi186 ceph-mon[126480]: pgmap v18551: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 538 KiB/s rd, 565 KiB/s wr, 10 op/s 2023-05-08T13:22:21.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34680.209339 secs 2023-05-08T13:22:23.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:23 smithi133 ceph-mon[125939]: pgmap v18552: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 558 KiB/s wr, 9 op/s 2023-05-08T13:22:23.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:23 smithi096 ceph-mon[124666]: pgmap v18552: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 558 KiB/s wr, 9 op/s 2023-05-08T13:22:23.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:23 smithi186 ceph-mon[126480]: pgmap v18552: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 558 KiB/s wr, 9 op/s 2023-05-08T13:22:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34683.363485 secs 2023-05-08T13:22:24.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34683.363485 secs 2023-05-08T13:22:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34683.363485 secs 2023-05-08T13:22:25.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34683.916960 secs 2023-05-08T13:22:25.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:25 smithi133 ceph-mon[125939]: pgmap v18553: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 196 KiB/s wr, 9 op/s 2023-05-08T13:22:25.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34683.916960 secs 2023-05-08T13:22:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:25 smithi096 ceph-mon[124666]: pgmap v18553: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 196 KiB/s wr, 9 op/s 2023-05-08T13:22:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34683.916960 secs 2023-05-08T13:22:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:25 smithi186 ceph-mon[126480]: pgmap v18553: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 196 KiB/s wr, 9 op/s 2023-05-08T13:22:26.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34685.209446 secs 2023-05-08T13:22:26.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34685.209446 secs 2023-05-08T13:22:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34685.209446 secs 2023-05-08T13:22:27.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:27 smithi133 ceph-mon[125939]: pgmap v18554: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 196 KiB/s wr, 9 op/s 2023-05-08T13:22:27.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:27 smithi096 ceph-mon[124666]: pgmap v18554: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 196 KiB/s wr, 9 op/s 2023-05-08T13:22:27.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:27 smithi186 ceph-mon[126480]: pgmap v18554: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 196 KiB/s wr, 9 op/s 2023-05-08T13:22:29.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:29 smithi133 ceph-mon[125939]: pgmap v18555: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 175 KiB/s wr, 8 op/s 2023-05-08T13:22:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34688.363554 secs 2023-05-08T13:22:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:29 smithi096 ceph-mon[124666]: pgmap v18555: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 175 KiB/s wr, 8 op/s 2023-05-08T13:22:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34688.363554 secs 2023-05-08T13:22:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:29 smithi186 ceph-mon[126480]: pgmap v18555: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 175 KiB/s wr, 8 op/s 2023-05-08T13:22:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34688.363554 secs 2023-05-08T13:22:30.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34688.917077 secs 2023-05-08T13:22:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34688.917077 secs 2023-05-08T13:22:30.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34688.917077 secs 2023-05-08T13:22:31.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:31 smithi096 ceph-mon[124666]: pgmap v18556: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 487 KiB/s rd, 483 KiB/s wr, 11 op/s 2023-05-08T13:22:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34690.209578 secs 2023-05-08T13:22:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:31 smithi186 ceph-mon[126480]: pgmap v18556: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 487 KiB/s rd, 483 KiB/s wr, 11 op/s 2023-05-08T13:22:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34690.209578 secs 2023-05-08T13:22:31.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:31 smithi133 ceph-mon[125939]: pgmap v18556: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 487 KiB/s rd, 483 KiB/s wr, 11 op/s 2023-05-08T13:22:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34690.209578 secs 2023-05-08T13:22:33.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:33 smithi133 ceph-mon[125939]: pgmap v18557: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 320 KiB/s wr, 7 op/s 2023-05-08T13:22:33.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:33 smithi096 ceph-mon[124666]: pgmap v18557: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 320 KiB/s wr, 7 op/s 2023-05-08T13:22:33.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:33 smithi186 ceph-mon[126480]: pgmap v18557: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 320 KiB/s wr, 7 op/s 2023-05-08T13:22:34.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34693.363656 secs 2023-05-08T13:22:34.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34693.363656 secs 2023-05-08T13:22:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34693.363656 secs 2023-05-08T13:22:35.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34693.917168 secs 2023-05-08T13:22:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:35 smithi133 ceph-mon[125939]: pgmap v18558: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 653 KiB/s rd, 626 KiB/s wr, 11 op/s 2023-05-08T13:22:35.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34693.917168 secs 2023-05-08T13:22:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:35 smithi096 ceph-mon[124666]: pgmap v18558: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 653 KiB/s rd, 626 KiB/s wr, 11 op/s 2023-05-08T13:22:35.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34693.917168 secs 2023-05-08T13:22:35.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:35 smithi186 ceph-mon[126480]: pgmap v18558: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 653 KiB/s rd, 626 KiB/s wr, 11 op/s 2023-05-08T13:22:36.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34695.209723 secs 2023-05-08T13:22:36.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34695.209723 secs 2023-05-08T13:22:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34695.209723 secs 2023-05-08T13:22:37.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:37 smithi133 ceph-mon[125939]: pgmap v18559: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 625 KiB/s wr, 8 op/s 2023-05-08T13:22:37.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:37 smithi096 ceph-mon[124666]: pgmap v18559: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 625 KiB/s wr, 8 op/s 2023-05-08T13:22:37.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:37 smithi186 ceph-mon[126480]: pgmap v18559: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 625 KiB/s wr, 8 op/s 2023-05-08T13:22:39.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:39 smithi096 ceph-mon[124666]: pgmap v18560: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 625 KiB/s wr, 8 op/s 2023-05-08T13:22:39.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34698.363741 secs 2023-05-08T13:22:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:39 smithi186 ceph-mon[126480]: pgmap v18560: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 625 KiB/s wr, 8 op/s 2023-05-08T13:22:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34698.363741 secs 2023-05-08T13:22:39.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:39 smithi133 ceph-mon[125939]: pgmap v18560: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 625 KiB/s wr, 8 op/s 2023-05-08T13:22:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34698.363741 secs 2023-05-08T13:22:40.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34698.917302 secs 2023-05-08T13:22:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34698.917302 secs 2023-05-08T13:22:40.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34698.917302 secs 2023-05-08T13:22:41.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:41 smithi096 ceph-mon[124666]: pgmap v18561: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 934 KiB/s rd, 931 KiB/s wr, 11 op/s 2023-05-08T13:22:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34700.209858 secs 2023-05-08T13:22:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:41 smithi186 ceph-mon[126480]: pgmap v18561: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 934 KiB/s rd, 931 KiB/s wr, 11 op/s 2023-05-08T13:22:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34700.209858 secs 2023-05-08T13:22:41.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:41 smithi133 ceph-mon[125939]: pgmap v18561: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 934 KiB/s rd, 931 KiB/s wr, 11 op/s 2023-05-08T13:22:41.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34700.209858 secs 2023-05-08T13:22:43.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:43 smithi133 ceph-mon[125939]: pgmap v18562: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 613 KiB/s rd, 611 KiB/s wr, 7 op/s 2023-05-08T13:22:43.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:43 smithi096 ceph-mon[124666]: pgmap v18562: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 613 KiB/s rd, 611 KiB/s wr, 7 op/s 2023-05-08T13:22:43.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:43 smithi186 ceph-mon[126480]: pgmap v18562: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 613 KiB/s rd, 611 KiB/s wr, 7 op/s 2023-05-08T13:22:44.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:44 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:22:44.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:44 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:22:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:44 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:22:45.456 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34703.363827 secs 2023-05-08T13:22:45.457 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34703.917416 secs 2023-05-08T13:22:45.457 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:45 smithi096 ceph-mon[124666]: pgmap v18563: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 622 KiB/s rd, 619 KiB/s wr, 10 op/s 2023-05-08T13:22:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34703.363827 secs 2023-05-08T13:22:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34703.917416 secs 2023-05-08T13:22:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:45 smithi133 ceph-mon[125939]: pgmap v18563: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 622 KiB/s rd, 619 KiB/s wr, 10 op/s 2023-05-08T13:22:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34703.363827 secs 2023-05-08T13:22:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34703.917416 secs 2023-05-08T13:22:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:45 smithi186 ceph-mon[126480]: pgmap v18563: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 622 KiB/s rd, 619 KiB/s wr, 10 op/s 2023-05-08T13:22:48.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:47 smithi133 ceph-mon[125939]: pgmap v18564: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 313 KiB/s wr, 6 op/s 2023-05-08T13:22:48.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:47 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:22:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:47 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:22:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:47 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:22:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:47 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:22:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:47 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:22:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:47 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:22:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:47 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:22:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:47 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:22:48.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:47 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T13:22:48.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:47 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T13:22:48.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:47 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:22:48.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:47 smithi096 ceph-mon[124666]: pgmap v18564: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 313 KiB/s wr, 6 op/s 2023-05-08T13:22:48.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:47 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:22:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:47 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:22:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:47 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:22:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:47 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:22:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:47 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:22:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:47 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:22:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:47 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:22:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:47 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:22:48.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:47 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T13:22:48.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:47 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T13:22:48.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:47 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:22:48.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:47 smithi186 ceph-mon[126480]: pgmap v18564: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 313 KiB/s wr, 6 op/s 2023-05-08T13:22:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:47 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:22:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:47 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:22:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:47 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:22:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:47 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:22:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:47 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:22:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:47 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:22:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:47 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:22:48.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:47 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:22:48.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:47 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T13:22:48.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:47 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T13:22:48.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:47 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:22:49.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:48 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:22:49.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:48 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:22:49.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:48 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:22:50.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:49 smithi133 ceph-mon[125939]: pgmap v18565: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 313 KiB/s wr, 6 op/s 2023-05-08T13:22:50.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34708.363960 secs 2023-05-08T13:22:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:49 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:22:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:49 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:22:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:49 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:22:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34708.917563 secs 2023-05-08T13:22:50.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:49 smithi096 ceph-mon[124666]: pgmap v18565: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 313 KiB/s wr, 6 op/s 2023-05-08T13:22:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34708.363960 secs 2023-05-08T13:22:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:49 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:22:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:49 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:22:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:49 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:22:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34708.917563 secs 2023-05-08T13:22:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:49 smithi186 ceph-mon[126480]: pgmap v18565: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 313 KiB/s wr, 6 op/s 2023-05-08T13:22:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34708.363960 secs 2023-05-08T13:22:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:49 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:22:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:49 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:22:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:49 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:22:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34708.917563 secs 2023-05-08T13:22:52.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:51 smithi133 ceph-mon[125939]: pgmap v18566: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 800 KiB/s rd, 655 KiB/s wr, 10 op/s 2023-05-08T13:22:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34710.210043 secs 2023-05-08T13:22:52.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:51 smithi096 ceph-mon[124666]: pgmap v18566: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 800 KiB/s rd, 655 KiB/s wr, 10 op/s 2023-05-08T13:22:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34710.210043 secs 2023-05-08T13:22:52.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:51 smithi186 ceph-mon[126480]: pgmap v18566: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 800 KiB/s rd, 655 KiB/s wr, 10 op/s 2023-05-08T13:22:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34710.210043 secs 2023-05-08T13:22:53.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:53 smithi133 ceph-mon[125939]: pgmap v18567: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 494 KiB/s rd, 350 KiB/s wr, 7 op/s 2023-05-08T13:22:53.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:53 smithi096 ceph-mon[124666]: pgmap v18567: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 494 KiB/s rd, 350 KiB/s wr, 7 op/s 2023-05-08T13:22:53.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:53 smithi186 ceph-mon[126480]: pgmap v18567: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 494 KiB/s rd, 350 KiB/s wr, 7 op/s 2023-05-08T13:22:54.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:54 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:22:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:54 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:22:54.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:54 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:22:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:54 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:22:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:54 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:22:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:54 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:22:55.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34713.364033 secs 2023-05-08T13:22:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:55 smithi133 ceph-mon[125939]: pgmap v18568: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 938 KiB/s wr, 12 op/s 2023-05-08T13:22:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34713.364033 secs 2023-05-08T13:22:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:55 smithi096 ceph-mon[124666]: pgmap v18568: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 938 KiB/s wr, 12 op/s 2023-05-08T13:22:55.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34713.364033 secs 2023-05-08T13:22:55.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:55 smithi186 ceph-mon[126480]: pgmap v18568: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 938 KiB/s wr, 12 op/s 2023-05-08T13:22:56.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34715.210161 secs 2023-05-08T13:22:56.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34715.210161 secs 2023-05-08T13:22:56.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34715.210161 secs 2023-05-08T13:22:57.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:57 smithi133 ceph-mon[125939]: pgmap v18569: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 930 KiB/s wr, 9 op/s 2023-05-08T13:22:57.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:22:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:57 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:22:57.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:57 smithi096 ceph-mon[124666]: pgmap v18569: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 930 KiB/s wr, 9 op/s 2023-05-08T13:22:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:22:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:57 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:22:57.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:57 smithi186 ceph-mon[126480]: pgmap v18569: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 930 KiB/s wr, 9 op/s 2023-05-08T13:22:57.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:22:57.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:57 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:22:58.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:22:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:22:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:22:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:22:58.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:22:58.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:22:59.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:22:59 smithi096 ceph-mon[124666]: pgmap v18570: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 930 KiB/s wr, 9 op/s 2023-05-08T13:22:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:22:59 smithi186 ceph-mon[126480]: pgmap v18570: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 930 KiB/s wr, 9 op/s 2023-05-08T13:22:59.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:22:59 smithi133 ceph-mon[125939]: pgmap v18570: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 930 KiB/s wr, 9 op/s 2023-05-08T13:23:00.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34718.364169 secs 2023-05-08T13:23:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34718.364169 secs 2023-05-08T13:23:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34718.364169 secs 2023-05-08T13:23:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:01 smithi096 ceph-mon[124666]: pgmap v18571: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 15 op/s 2023-05-08T13:23:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34720.210283 secs 2023-05-08T13:23:01.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:01 smithi186 ceph-mon[126480]: pgmap v18571: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 15 op/s 2023-05-08T13:23:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34720.210283 secs 2023-05-08T13:23:01.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:01 smithi133 ceph-mon[125939]: pgmap v18571: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 15 op/s 2023-05-08T13:23:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34720.210283 secs 2023-05-08T13:23:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:02 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:23:02.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:02 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:23:02.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:02 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:23:03.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:03 smithi186 ceph-mon[126480]: pgmap v18572: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T13:23:03.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:03 smithi133 ceph-mon[125939]: pgmap v18572: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T13:23:03.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:03 smithi096 ceph-mon[124666]: pgmap v18572: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T13:23:04.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34723.364302 secs 2023-05-08T13:23:04.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34723.364302 secs 2023-05-08T13:23:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34723.364302 secs 2023-05-08T13:23:05.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34723.917928 secs 2023-05-08T13:23:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:05 smithi133 ceph-mon[125939]: pgmap v18573: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 29 op/s 2023-05-08T13:23:05.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34723.917928 secs 2023-05-08T13:23:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:05 smithi096 ceph-mon[124666]: pgmap v18573: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 29 op/s 2023-05-08T13:23:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34723.917928 secs 2023-05-08T13:23:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:05 smithi186 ceph-mon[126480]: pgmap v18573: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 29 op/s 2023-05-08T13:23:06.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:23:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:23:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:23:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:23:06.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:23:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:23:07.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:07 smithi096 ceph-mon[124666]: pgmap v18574: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 24 op/s 2023-05-08T13:23:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:07 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:23:07.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:07 smithi186 ceph-mon[126480]: pgmap v18574: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 24 op/s 2023-05-08T13:23:07.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:07 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:23:07.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:07 smithi133 ceph-mon[125939]: pgmap v18574: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 24 op/s 2023-05-08T13:23:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:07 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:23:09.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:09 smithi096 ceph-mon[124666]: pgmap v18575: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 24 op/s 2023-05-08T13:23:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34728.364434 secs 2023-05-08T13:23:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:09 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:23:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:09 smithi186 ceph-mon[126480]: pgmap v18575: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 24 op/s 2023-05-08T13:23:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34728.364434 secs 2023-05-08T13:23:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:09 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:23:09.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:09 smithi133 ceph-mon[125939]: pgmap v18575: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 24 op/s 2023-05-08T13:23:09.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34728.364434 secs 2023-05-08T13:23:09.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:09 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:23:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34728.918051 secs 2023-05-08T13:23:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:10 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:23:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:10 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:23:10.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34728.918051 secs 2023-05-08T13:23:10.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:10 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:23:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:10 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:23:11.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34728.918051 secs 2023-05-08T13:23:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:10 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:23:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:10 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:23:11.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:11 smithi186 ceph-mon[126480]: pgmap v18576: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 27 op/s 2023-05-08T13:23:11.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:11 smithi133 ceph-mon[125939]: pgmap v18576: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 27 op/s 2023-05-08T13:23:12.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:11 smithi096 ceph-mon[124666]: pgmap v18576: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 27 op/s 2023-05-08T13:23:12.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:12 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:23:12.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:12 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:23:13.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:12 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:23:13.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:13 smithi186 ceph-mon[126480]: pgmap v18577: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 425 KiB/s rd, 438 KiB/s wr, 21 op/s 2023-05-08T13:23:13.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:13 smithi133 ceph-mon[125939]: pgmap v18577: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 425 KiB/s rd, 438 KiB/s wr, 21 op/s 2023-05-08T13:23:14.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:13 smithi096 ceph-mon[124666]: pgmap v18577: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 425 KiB/s rd, 438 KiB/s wr, 21 op/s 2023-05-08T13:23:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34733.364557 secs 2023-05-08T13:23:14.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34733.364557 secs 2023-05-08T13:23:15.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34733.364557 secs 2023-05-08T13:23:15.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34733.918176 secs 2023-05-08T13:23:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:15 smithi186 ceph-mon[126480]: pgmap v18578: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 892 KiB/s rd, 903 KiB/s wr, 25 op/s 2023-05-08T13:23:15.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34733.918176 secs 2023-05-08T13:23:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:15 smithi133 ceph-mon[125939]: pgmap v18578: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 892 KiB/s rd, 903 KiB/s wr, 25 op/s 2023-05-08T13:23:16.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34733.918176 secs 2023-05-08T13:23:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:15 smithi096 ceph-mon[124666]: pgmap v18578: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 892 KiB/s rd, 903 KiB/s wr, 25 op/s 2023-05-08T13:23:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:17 smithi186 ceph-mon[126480]: pgmap v18579: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 471 KiB/s wr, 7 op/s 2023-05-08T13:23:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:17 smithi133 ceph-mon[125939]: pgmap v18579: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 471 KiB/s wr, 7 op/s 2023-05-08T13:23:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:17 smithi096 ceph-mon[124666]: pgmap v18579: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 471 KiB/s wr, 7 op/s 2023-05-08T13:23:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:19 smithi186 ceph-mon[126480]: pgmap v18580: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 471 KiB/s wr, 7 op/s 2023-05-08T13:23:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34738.364699 secs 2023-05-08T13:23:19.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:19 smithi133 ceph-mon[125939]: pgmap v18580: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 471 KiB/s wr, 7 op/s 2023-05-08T13:23:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34738.364699 secs 2023-05-08T13:23:20.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:19 smithi096 ceph-mon[124666]: pgmap v18580: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 471 KiB/s wr, 7 op/s 2023-05-08T13:23:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34738.364699 secs 2023-05-08T13:23:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34738.918300 secs 2023-05-08T13:23:20.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34738.918300 secs 2023-05-08T13:23:21.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34738.918300 secs 2023-05-08T13:23:21.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:21 smithi186 ceph-mon[126480]: pgmap v18581: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 472 KiB/s wr, 11 op/s 2023-05-08T13:23:21.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:21 smithi133 ceph-mon[125939]: pgmap v18581: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 472 KiB/s wr, 11 op/s 2023-05-08T13:23:22.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:21 smithi096 ceph-mon[124666]: pgmap v18581: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 472 KiB/s wr, 11 op/s 2023-05-08T13:23:23.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:23 smithi133 ceph-mon[125939]: pgmap v18582: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 468 KiB/s rd, 807 KiB/s wr, 7 op/s 2023-05-08T13:23:23.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:23 smithi096 ceph-mon[124666]: pgmap v18582: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 468 KiB/s rd, 807 KiB/s wr, 7 op/s 2023-05-08T13:23:23.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:23 smithi186 ceph-mon[126480]: pgmap v18582: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 468 KiB/s rd, 807 KiB/s wr, 7 op/s 2023-05-08T13:23:24.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34743.364789 secs 2023-05-08T13:23:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34743.364789 secs 2023-05-08T13:23:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34743.364789 secs 2023-05-08T13:23:25.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:25 smithi096 ceph-mon[124666]: pgmap v18583: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 953 KiB/s rd, 1.3 MiB/s wr, 13 op/s 2023-05-08T13:23:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:25 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:23:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:25 smithi186 ceph-mon[126480]: pgmap v18583: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 953 KiB/s rd, 1.3 MiB/s wr, 13 op/s 2023-05-08T13:23:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:25 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:23:25.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:25 smithi133 ceph-mon[125939]: pgmap v18583: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 953 KiB/s rd, 1.3 MiB/s wr, 13 op/s 2023-05-08T13:23:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:25 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:23:26.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:26 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:23:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:26 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:23:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:26 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:23:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:26 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:23:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:26 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:23:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:26 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:23:26.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:26 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:23:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:26 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:23:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:26 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:23:27.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:27 smithi186 ceph-mon[126480]: pgmap v18584: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 828 KiB/s rd, 848 KiB/s wr, 10 op/s 2023-05-08T13:23:27.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:27 smithi133 ceph-mon[125939]: pgmap v18584: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 828 KiB/s rd, 848 KiB/s wr, 10 op/s 2023-05-08T13:23:28.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:27 smithi096 ceph-mon[124666]: pgmap v18584: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 828 KiB/s rd, 848 KiB/s wr, 10 op/s 2023-05-08T13:23:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:29 smithi186 ceph-mon[126480]: pgmap v18585: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 828 KiB/s rd, 848 KiB/s wr, 10 op/s 2023-05-08T13:23:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34748.364927 secs 2023-05-08T13:23:29.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:29 smithi133 ceph-mon[125939]: pgmap v18585: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 828 KiB/s rd, 848 KiB/s wr, 10 op/s 2023-05-08T13:23:29.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34748.364927 secs 2023-05-08T13:23:30.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:29 smithi096 ceph-mon[124666]: pgmap v18585: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 828 KiB/s rd, 848 KiB/s wr, 10 op/s 2023-05-08T13:23:30.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34748.364927 secs 2023-05-08T13:23:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:31 smithi186 ceph-mon[126480]: pgmap v18586: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 835 KiB/s rd, 878 KiB/s wr, 14 op/s 2023-05-08T13:23:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:31 smithi186 ceph-mon[126480]: osdmap e1238: 12 total, 12 up, 12 in 2023-05-08T13:23:31.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:31 smithi133 ceph-mon[125939]: pgmap v18586: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 835 KiB/s rd, 878 KiB/s wr, 14 op/s 2023-05-08T13:23:31.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:31 smithi133 ceph-mon[125939]: osdmap e1238: 12 total, 12 up, 12 in 2023-05-08T13:23:32.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:31 smithi096 ceph-mon[124666]: pgmap v18586: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 835 KiB/s rd, 878 KiB/s wr, 14 op/s 2023-05-08T13:23:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:31 smithi096 ceph-mon[124666]: osdmap e1238: 12 total, 12 up, 12 in 2023-05-08T13:23:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:33 smithi096 ceph-mon[124666]: pgmap v18588: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1001 KiB/s rd, 643 KiB/s wr, 13 op/s 2023-05-08T13:23:33.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:33 smithi186 ceph-mon[126480]: pgmap v18588: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1001 KiB/s rd, 643 KiB/s wr, 13 op/s 2023-05-08T13:23:33.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:33 smithi133 ceph-mon[125939]: pgmap v18588: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1001 KiB/s rd, 643 KiB/s wr, 13 op/s 2023-05-08T13:23:34.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34753.365062 secs 2023-05-08T13:23:34.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34753.365062 secs 2023-05-08T13:23:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34753.365062 secs 2023-05-08T13:23:35.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:35 smithi096 ceph-mon[124666]: pgmap v18589: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 615 KiB/s rd, 203 KiB/s wr, 8 op/s 2023-05-08T13:23:35.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:35 smithi186 ceph-mon[126480]: pgmap v18589: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 615 KiB/s rd, 203 KiB/s wr, 8 op/s 2023-05-08T13:23:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:35 smithi133 ceph-mon[125939]: pgmap v18589: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 615 KiB/s rd, 203 KiB/s wr, 8 op/s 2023-05-08T13:23:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:37 smithi096 ceph-mon[124666]: pgmap v18590: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 203 KiB/s wr, 8 op/s 2023-05-08T13:23:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:37 smithi096 ceph-mon[124666]: osdmap e1239: 12 total, 12 up, 12 in 2023-05-08T13:23:37.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:37 smithi186 ceph-mon[126480]: pgmap v18590: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 203 KiB/s wr, 8 op/s 2023-05-08T13:23:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:37 smithi186 ceph-mon[126480]: osdmap e1239: 12 total, 12 up, 12 in 2023-05-08T13:23:37.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:37 smithi133 ceph-mon[125939]: pgmap v18590: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 203 KiB/s wr, 8 op/s 2023-05-08T13:23:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:37 smithi133 ceph-mon[125939]: osdmap e1239: 12 total, 12 up, 12 in 2023-05-08T13:23:39.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:39 smithi096 ceph-mon[124666]: pgmap v18592: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 209 KiB/s wr, 4 op/s 2023-05-08T13:23:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34758.365183 secs 2023-05-08T13:23:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:39 smithi186 ceph-mon[126480]: pgmap v18592: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 209 KiB/s wr, 4 op/s 2023-05-08T13:23:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34758.365183 secs 2023-05-08T13:23:39.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:39 smithi133 ceph-mon[125939]: pgmap v18592: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 209 KiB/s wr, 4 op/s 2023-05-08T13:23:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34758.365183 secs 2023-05-08T13:23:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:41 smithi186 ceph-mon[126480]: pgmap v18593: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 201 KiB/s wr, 8 op/s 2023-05-08T13:23:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34760.211331 secs 2023-05-08T13:23:41.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:41 smithi133 ceph-mon[125939]: pgmap v18593: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 201 KiB/s wr, 8 op/s 2023-05-08T13:23:41.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34760.211331 secs 2023-05-08T13:23:42.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:41 smithi096 ceph-mon[124666]: pgmap v18593: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 201 KiB/s wr, 8 op/s 2023-05-08T13:23:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34760.211331 secs 2023-05-08T13:23:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:42 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:23:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:42 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:23:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:42 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:23:42.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:42 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:23:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:42 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:23:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:42 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:23:43.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:42 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:23:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:42 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:23:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:42 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:23:43.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:43 smithi186 ceph-mon[126480]: pgmap v18594: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 200 KiB/s wr, 7 op/s 2023-05-08T13:23:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:43 smithi133 ceph-mon[125939]: pgmap v18594: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 200 KiB/s wr, 7 op/s 2023-05-08T13:23:44.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:43 smithi096 ceph-mon[124666]: pgmap v18594: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 200 KiB/s wr, 7 op/s 2023-05-08T13:23:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34763.365270 secs 2023-05-08T13:23:44.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34763.365270 secs 2023-05-08T13:23:45.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34763.365270 secs 2023-05-08T13:23:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34763.918911 secs 2023-05-08T13:23:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:45 smithi186 ceph-mon[126480]: pgmap v18595: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T13:23:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34763.918911 secs 2023-05-08T13:23:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:45 smithi133 ceph-mon[125939]: pgmap v18595: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T13:23:46.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34763.918911 secs 2023-05-08T13:23:46.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:45 smithi096 ceph-mon[124666]: pgmap v18595: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T13:23:46.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34765.211452 secs 2023-05-08T13:23:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:46 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:23:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:46 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:23:46.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34765.211452 secs 2023-05-08T13:23:46.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:46 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:23:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:46 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:23:47.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34765.211452 secs 2023-05-08T13:23:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:46 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:23:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:46 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:23:47.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:47 smithi186 ceph-mon[126480]: pgmap v18596: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T13:23:47.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:47 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:23:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:47 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:23:47.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:47 smithi133 ceph-mon[125939]: pgmap v18596: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T13:23:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:47 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:23:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:47 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:23:48.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:47 smithi096 ceph-mon[124666]: pgmap v18596: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T13:23:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:47 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:23:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:47 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:23:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:49 smithi186 ceph-mon[126480]: pgmap v18597: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T13:23:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34768.365370 secs 2023-05-08T13:23:49.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:49 smithi133 ceph-mon[125939]: pgmap v18597: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T13:23:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34768.365370 secs 2023-05-08T13:23:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:49 smithi096 ceph-mon[124666]: pgmap v18597: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T13:23:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34768.365370 secs 2023-05-08T13:23:51.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:51 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:23:51.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:51 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:23:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:51 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:23:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:51 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:23:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:51 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:23:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:51 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:23:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:51 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T13:23:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:51 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T13:23:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:51 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:23:51.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:51 smithi186 ceph-mon[126480]: pgmap v18598: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.2 MiB/s wr, 15 op/s 2023-05-08T13:23:51.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34770.211589 secs 2023-05-08T13:23:51.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:51 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:23:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:51 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:23:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:51 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:23:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:51 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:23:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:51 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:23:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:51 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:23:51.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:51 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T13:23:51.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:51 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T13:23:51.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:51 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:23:51.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:51 smithi133 ceph-mon[125939]: pgmap v18598: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.2 MiB/s wr, 15 op/s 2023-05-08T13:23:51.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34770.211589 secs 2023-05-08T13:23:51.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:51 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:23:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:51 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:23:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:51 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:23:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:51 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:23:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:51 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:23:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:51 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:23:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:51 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T13:23:51.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:51 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T13:23:51.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:51 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:23:51.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:51 smithi096 ceph-mon[124666]: pgmap v18598: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.2 MiB/s wr, 15 op/s 2023-05-08T13:23:51.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34770.211589 secs 2023-05-08T13:23:53.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:53 smithi096 ceph-mon[124666]: pgmap v18599: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.2 MiB/s wr, 12 op/s 2023-05-08T13:23:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:53 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:23:53.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:53 smithi186 ceph-mon[126480]: pgmap v18599: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.2 MiB/s wr, 12 op/s 2023-05-08T13:23:53.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:53 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:23:53.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:53 smithi133 ceph-mon[125939]: pgmap v18599: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.2 MiB/s wr, 12 op/s 2023-05-08T13:23:53.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:53 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:23:54.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:54 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:23:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:54 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:23:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:54 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:23:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:54 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:23:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:54 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:23:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:54 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:23:54.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:54 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:23:54.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:54 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:23:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:54 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:23:55.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34773.365432 secs 2023-05-08T13:23:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:55 smithi096 ceph-mon[124666]: pgmap v18600: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.7 MiB/s wr, 19 op/s 2023-05-08T13:23:55.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34773.365432 secs 2023-05-08T13:23:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:55 smithi186 ceph-mon[126480]: pgmap v18600: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.7 MiB/s wr, 19 op/s 2023-05-08T13:23:55.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34773.365432 secs 2023-05-08T13:23:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:55 smithi133 ceph-mon[125939]: pgmap v18600: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.7 MiB/s wr, 19 op/s 2023-05-08T13:23:56.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34775.211709 secs 2023-05-08T13:23:56.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34775.211709 secs 2023-05-08T13:23:56.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34775.211709 secs 2023-05-08T13:23:57.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:57 smithi096 ceph-mon[124666]: pgmap v18601: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.7 MiB/s wr, 13 op/s 2023-05-08T13:23:57.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:57 smithi186 ceph-mon[126480]: pgmap v18601: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.7 MiB/s wr, 13 op/s 2023-05-08T13:23:57.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:57 smithi133 ceph-mon[125939]: pgmap v18601: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.7 MiB/s wr, 13 op/s 2023-05-08T13:23:59.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:59 smithi096 ceph-mon[124666]: pgmap v18602: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.7 MiB/s wr, 13 op/s 2023-05-08T13:23:59.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:23:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34778.365560 secs 2023-05-08T13:23:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:59 smithi186 ceph-mon[126480]: pgmap v18602: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.7 MiB/s wr, 13 op/s 2023-05-08T13:23:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:23:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34778.365560 secs 2023-05-08T13:23:59.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:59 smithi133 ceph-mon[125939]: pgmap v18602: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.7 MiB/s wr, 13 op/s 2023-05-08T13:23:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:23:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34778.365560 secs 2023-05-08T13:24:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34778.919256 secs 2023-05-08T13:24:00.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34778.919256 secs 2023-05-08T13:24:01.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34778.919256 secs 2023-05-08T13:24:01.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:01 smithi186 ceph-mon[126480]: pgmap v18603: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.2 MiB/s wr, 18 op/s 2023-05-08T13:24:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34780.211849 secs 2023-05-08T13:24:01.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:01 smithi133 ceph-mon[125939]: pgmap v18603: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.2 MiB/s wr, 18 op/s 2023-05-08T13:24:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34780.211849 secs 2023-05-08T13:24:02.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:01 smithi096 ceph-mon[124666]: pgmap v18603: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.2 MiB/s wr, 18 op/s 2023-05-08T13:24:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34780.211849 secs 2023-05-08T13:24:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:02 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:24:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:24:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:24:02.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:02 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:24:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:24:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:24:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:02 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:24:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:24:03.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:24:03.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:03 smithi186 ceph-mon[126480]: pgmap v18604: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 1.0 MiB/s wr, 13 op/s 2023-05-08T13:24:03.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:03 smithi133 ceph-mon[125939]: pgmap v18604: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 1.0 MiB/s wr, 13 op/s 2023-05-08T13:24:04.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:03 smithi096 ceph-mon[124666]: pgmap v18604: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 1.0 MiB/s wr, 13 op/s 2023-05-08T13:24:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34783.365700 secs 2023-05-08T13:24:04.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34783.365700 secs 2023-05-08T13:24:05.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34783.365700 secs 2023-05-08T13:24:05.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:05 smithi186 ceph-mon[126480]: pgmap v18605: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.3 MiB/s wr, 30 op/s 2023-05-08T13:24:05.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:05 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:24:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:05 smithi133 ceph-mon[125939]: pgmap v18605: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.3 MiB/s wr, 30 op/s 2023-05-08T13:24:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:05 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:24:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:05 smithi096 ceph-mon[124666]: pgmap v18605: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.3 MiB/s wr, 30 op/s 2023-05-08T13:24:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:05 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:24:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:24:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:24:06.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:24:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:24:07.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:24:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:24:07.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:07 smithi186 ceph-mon[126480]: pgmap v18606: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.8 MiB/s wr, 22 op/s 2023-05-08T13:24:07.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:07 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:24:07.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:07 smithi133 ceph-mon[125939]: pgmap v18606: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.8 MiB/s wr, 22 op/s 2023-05-08T13:24:07.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:07 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:24:08.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:07 smithi096 ceph-mon[124666]: pgmap v18606: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.8 MiB/s wr, 22 op/s 2023-05-08T13:24:08.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:07 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:24:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:09 smithi186 ceph-mon[126480]: pgmap v18607: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.8 MiB/s wr, 22 op/s 2023-05-08T13:24:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34788.365814 secs 2023-05-08T13:24:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:09 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:24:09.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:09 smithi133 ceph-mon[125939]: pgmap v18607: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.8 MiB/s wr, 22 op/s 2023-05-08T13:24:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34788.365814 secs 2023-05-08T13:24:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:09 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:24:10.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:09 smithi096 ceph-mon[124666]: pgmap v18607: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.8 MiB/s wr, 22 op/s 2023-05-08T13:24:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34788.365814 secs 2023-05-08T13:24:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:09 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:24:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:10 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:24:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:10 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:24:10.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:10 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:24:10.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:10 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:24:11.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:10 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:24:11.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:10 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:24:11.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:11 smithi186 ceph-mon[126480]: pgmap v18608: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.1 MiB/s wr, 27 op/s 2023-05-08T13:24:11.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:11 smithi133 ceph-mon[125939]: pgmap v18608: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.1 MiB/s wr, 27 op/s 2023-05-08T13:24:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:11 smithi096 ceph-mon[124666]: pgmap v18608: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.1 MiB/s wr, 27 op/s 2023-05-08T13:24:12.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:12 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:24:12.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:12 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:24:13.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:12 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:24:13.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:13 smithi186 ceph-mon[126480]: pgmap v18609: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.6 MiB/s wr, 22 op/s 2023-05-08T13:24:13.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:13 smithi133 ceph-mon[125939]: pgmap v18609: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.6 MiB/s wr, 22 op/s 2023-05-08T13:24:14.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:13 smithi096 ceph-mon[124666]: pgmap v18609: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.6 MiB/s wr, 22 op/s 2023-05-08T13:24:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34793.365926 secs 2023-05-08T13:24:14.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34793.365926 secs 2023-05-08T13:24:15.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34793.365926 secs 2023-05-08T13:24:15.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:15 smithi186 ceph-mon[126480]: pgmap v18610: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.6 MiB/s wr, 25 op/s 2023-05-08T13:24:15.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:15 smithi133 ceph-mon[125939]: pgmap v18610: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.6 MiB/s wr, 25 op/s 2023-05-08T13:24:16.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:15 smithi096 ceph-mon[124666]: pgmap v18610: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.6 MiB/s wr, 25 op/s 2023-05-08T13:24:17.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:17 smithi186 ceph-mon[126480]: pgmap v18611: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 329 KiB/s wr, 8 op/s 2023-05-08T13:24:17.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:17 smithi133 ceph-mon[125939]: pgmap v18611: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 329 KiB/s wr, 8 op/s 2023-05-08T13:24:18.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:17 smithi096 ceph-mon[124666]: pgmap v18611: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 329 KiB/s wr, 8 op/s 2023-05-08T13:24:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:19 smithi186 ceph-mon[126480]: pgmap v18612: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 296 KiB/s wr, 8 op/s 2023-05-08T13:24:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34798.366059 secs 2023-05-08T13:24:19.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:19 smithi133 ceph-mon[125939]: pgmap v18612: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 296 KiB/s wr, 8 op/s 2023-05-08T13:24:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34798.366059 secs 2023-05-08T13:24:20.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:19 smithi096 ceph-mon[124666]: pgmap v18612: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 296 KiB/s wr, 8 op/s 2023-05-08T13:24:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34798.366059 secs 2023-05-08T13:24:21.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:21 smithi186 ceph-mon[126480]: pgmap v18613: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 320 KiB/s wr, 11 op/s 2023-05-08T13:24:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34800.212256 secs 2023-05-08T13:24:21.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:21 smithi133 ceph-mon[125939]: pgmap v18613: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 320 KiB/s wr, 11 op/s 2023-05-08T13:24:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34800.212256 secs 2023-05-08T13:24:22.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:21 smithi096 ceph-mon[124666]: pgmap v18613: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 320 KiB/s wr, 11 op/s 2023-05-08T13:24:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34800.212256 secs 2023-05-08T13:24:22.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:22 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:24:22.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:22 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:24:22.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:22 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:24:22.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:22 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:24:22.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:22 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:24:22.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:22 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:24:23.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:22 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:24:23.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:22 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:24:23.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:22 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:24:23.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:23 smithi186 ceph-mon[126480]: pgmap v18614: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 333 KiB/s wr, 7 op/s 2023-05-08T13:24:23.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:23 smithi133 ceph-mon[125939]: pgmap v18614: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 333 KiB/s wr, 7 op/s 2023-05-08T13:24:24.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:23 smithi096 ceph-mon[124666]: pgmap v18614: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 333 KiB/s wr, 7 op/s 2023-05-08T13:24:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34803.366197 secs 2023-05-08T13:24:24.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34803.366197 secs 2023-05-08T13:24:25.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34803.366197 secs 2023-05-08T13:24:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34803.919732 secs 2023-05-08T13:24:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:25 smithi186 ceph-mon[126480]: pgmap v18615: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 576 KiB/s wr, 13 op/s 2023-05-08T13:24:25.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34803.919732 secs 2023-05-08T13:24:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:25 smithi133 ceph-mon[125939]: pgmap v18615: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 576 KiB/s wr, 13 op/s 2023-05-08T13:24:26.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34803.919732 secs 2023-05-08T13:24:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:25 smithi096 ceph-mon[124666]: pgmap v18615: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 576 KiB/s wr, 13 op/s 2023-05-08T13:24:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34805.212375 secs 2023-05-08T13:24:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:26 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:24:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:26 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:24:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:26 smithi186 ceph-mon[126480]: osdmap e1240: 12 total, 12 up, 12 in 2023-05-08T13:24:26.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34805.212375 secs 2023-05-08T13:24:26.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:26 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:24:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:26 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:24:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:26 smithi133 ceph-mon[125939]: osdmap e1240: 12 total, 12 up, 12 in 2023-05-08T13:24:27.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34805.212375 secs 2023-05-08T13:24:27.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:26 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:24:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:26 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:24:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:26 smithi096 ceph-mon[124666]: osdmap e1240: 12 total, 12 up, 12 in 2023-05-08T13:24:27.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:27 smithi186 ceph-mon[126480]: pgmap v18617: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 668 KiB/s rd, 691 KiB/s wr, 12 op/s 2023-05-08T13:24:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:27 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:24:27.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:27 smithi133 ceph-mon[125939]: pgmap v18617: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 668 KiB/s rd, 691 KiB/s wr, 12 op/s 2023-05-08T13:24:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:27 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:24:28.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:27 smithi096 ceph-mon[124666]: pgmap v18617: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 668 KiB/s rd, 691 KiB/s wr, 12 op/s 2023-05-08T13:24:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:27 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:24:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:29 smithi186 ceph-mon[126480]: pgmap v18618: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 668 KiB/s rd, 691 KiB/s wr, 12 op/s 2023-05-08T13:24:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34808.366359 secs 2023-05-08T13:24:29.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:29 smithi133 ceph-mon[125939]: pgmap v18618: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 668 KiB/s rd, 691 KiB/s wr, 12 op/s 2023-05-08T13:24:29.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34808.366359 secs 2023-05-08T13:24:30.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:29 smithi096 ceph-mon[124666]: pgmap v18618: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 668 KiB/s rd, 691 KiB/s wr, 12 op/s 2023-05-08T13:24:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34808.366359 secs 2023-05-08T13:24:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34808.919838 secs 2023-05-08T13:24:30.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34808.919838 secs 2023-05-08T13:24:31.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34808.919838 secs 2023-05-08T13:24:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:31 smithi186 ceph-mon[126480]: pgmap v18619: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 864 KiB/s rd, 888 KiB/s wr, 14 op/s 2023-05-08T13:24:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34810.212493 secs 2023-05-08T13:24:31.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:31 smithi133 ceph-mon[125939]: pgmap v18619: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 864 KiB/s rd, 888 KiB/s wr, 14 op/s 2023-05-08T13:24:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34810.212493 secs 2023-05-08T13:24:32.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:31 smithi096 ceph-mon[124666]: pgmap v18619: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 864 KiB/s rd, 888 KiB/s wr, 14 op/s 2023-05-08T13:24:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34810.212493 secs 2023-05-08T13:24:33.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:33 smithi096 ceph-mon[124666]: osdmap e1241: 12 total, 12 up, 12 in 2023-05-08T13:24:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:33 smithi096 ceph-mon[124666]: pgmap v18621: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 284 KiB/s rd, 282 KiB/s wr, 6 op/s 2023-05-08T13:24:33.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:33 smithi186 ceph-mon[126480]: osdmap e1241: 12 total, 12 up, 12 in 2023-05-08T13:24:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:33 smithi186 ceph-mon[126480]: pgmap v18621: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 284 KiB/s rd, 282 KiB/s wr, 6 op/s 2023-05-08T13:24:33.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:33 smithi133 ceph-mon[125939]: osdmap e1241: 12 total, 12 up, 12 in 2023-05-08T13:24:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:33 smithi133 ceph-mon[125939]: pgmap v18621: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 284 KiB/s rd, 282 KiB/s wr, 6 op/s 2023-05-08T13:24:34.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34813.366413 secs 2023-05-08T13:24:34.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34813.366413 secs 2023-05-08T13:24:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34813.366413 secs 2023-05-08T13:24:35.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34813.919957 secs 2023-05-08T13:24:35.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:35 smithi186 ceph-mon[126480]: pgmap v18622: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 675 KiB/s rd, 673 KiB/s wr, 10 op/s 2023-05-08T13:24:35.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34813.919957 secs 2023-05-08T13:24:35.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:35 smithi133 ceph-mon[125939]: pgmap v18622: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 675 KiB/s rd, 673 KiB/s wr, 10 op/s 2023-05-08T13:24:36.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34813.919957 secs 2023-05-08T13:24:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:35 smithi096 ceph-mon[124666]: pgmap v18622: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 675 KiB/s rd, 673 KiB/s wr, 10 op/s 2023-05-08T13:24:36.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34815.212606 secs 2023-05-08T13:24:36.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34815.212606 secs 2023-05-08T13:24:37.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34815.212606 secs 2023-05-08T13:24:37.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:37 smithi186 ceph-mon[126480]: pgmap v18623: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 598 KiB/s rd, 596 KiB/s wr, 9 op/s 2023-05-08T13:24:37.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:37 smithi133 ceph-mon[125939]: pgmap v18623: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 598 KiB/s rd, 596 KiB/s wr, 9 op/s 2023-05-08T13:24:38.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:37 smithi096 ceph-mon[124666]: pgmap v18623: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 598 KiB/s rd, 596 KiB/s wr, 9 op/s 2023-05-08T13:24:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:39 smithi186 ceph-mon[126480]: pgmap v18624: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 598 KiB/s rd, 596 KiB/s wr, 9 op/s 2023-05-08T13:24:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34818.366523 secs 2023-05-08T13:24:39.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:39 smithi133 ceph-mon[125939]: pgmap v18624: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 598 KiB/s rd, 596 KiB/s wr, 9 op/s 2023-05-08T13:24:39.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34818.366523 secs 2023-05-08T13:24:40.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:39 smithi096 ceph-mon[124666]: pgmap v18624: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 598 KiB/s rd, 596 KiB/s wr, 9 op/s 2023-05-08T13:24:40.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34818.366523 secs 2023-05-08T13:24:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34818.920068 secs 2023-05-08T13:24:40.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34818.920068 secs 2023-05-08T13:24:41.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34818.920068 secs 2023-05-08T13:24:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:41 smithi186 ceph-mon[126480]: pgmap v18625: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 543 KiB/s wr, 7 op/s 2023-05-08T13:24:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34820.212725 secs 2023-05-08T13:24:41.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:41 smithi133 ceph-mon[125939]: pgmap v18625: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 543 KiB/s wr, 7 op/s 2023-05-08T13:24:41.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34820.212725 secs 2023-05-08T13:24:42.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:41 smithi096 ceph-mon[124666]: pgmap v18625: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 543 KiB/s wr, 7 op/s 2023-05-08T13:24:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34820.212725 secs 2023-05-08T13:24:43.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:43 smithi186 ceph-mon[126480]: pgmap v18626: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 532 KiB/s wr, 7 op/s 2023-05-08T13:24:43.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:43 smithi133 ceph-mon[125939]: pgmap v18626: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 532 KiB/s wr, 7 op/s 2023-05-08T13:24:43.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:43 smithi096 ceph-mon[124666]: pgmap v18626: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 532 KiB/s wr, 7 op/s 2023-05-08T13:24:44.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34823.366610 secs 2023-05-08T13:24:44.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34823.366610 secs 2023-05-08T13:24:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34823.366610 secs 2023-05-08T13:24:45.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34823.920209 secs 2023-05-08T13:24:45.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:45 smithi133 ceph-mon[125939]: pgmap v18627: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 456 KiB/s rd, 664 KiB/s wr, 9 op/s 2023-05-08T13:24:45.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34823.920209 secs 2023-05-08T13:24:45.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:45 smithi096 ceph-mon[124666]: pgmap v18627: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 456 KiB/s rd, 664 KiB/s wr, 9 op/s 2023-05-08T13:24:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34823.920209 secs 2023-05-08T13:24:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:45 smithi186 ceph-mon[126480]: pgmap v18627: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 456 KiB/s rd, 664 KiB/s wr, 9 op/s 2023-05-08T13:24:47.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:47 smithi133 ceph-mon[125939]: pgmap v18628: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 356 KiB/s wr, 6 op/s 2023-05-08T13:24:47.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:47 smithi096 ceph-mon[124666]: pgmap v18628: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 356 KiB/s wr, 6 op/s 2023-05-08T13:24:47.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:47 smithi186 ceph-mon[126480]: pgmap v18628: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 356 KiB/s wr, 6 op/s 2023-05-08T13:24:49.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:49 smithi133 ceph-mon[125939]: pgmap v18629: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 356 KiB/s wr, 6 op/s 2023-05-08T13:24:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34828.366735 secs 2023-05-08T13:24:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:24:49.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:49 smithi096 ceph-mon[124666]: pgmap v18629: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 356 KiB/s wr, 6 op/s 2023-05-08T13:24:49.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34828.366735 secs 2023-05-08T13:24:49.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:24:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:49 smithi186 ceph-mon[126480]: pgmap v18629: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 356 KiB/s wr, 6 op/s 2023-05-08T13:24:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34828.366735 secs 2023-05-08T13:24:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:24:50.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:24:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:24:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:24:50.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:24:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:24:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:24:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:24:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:24:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:24:51.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:51 smithi133 ceph-mon[125939]: pgmap v18630: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 949 KiB/s wr, 11 op/s 2023-05-08T13:24:51.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34830.212940 secs 2023-05-08T13:24:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:51 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:24:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:51 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:24:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:51 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:24:51.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:51 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:24:51.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:51 smithi096 ceph-mon[124666]: pgmap v18630: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 949 KiB/s wr, 11 op/s 2023-05-08T13:24:51.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34830.212940 secs 2023-05-08T13:24:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:51 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:24:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:51 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:24:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:51 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:24:51.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:51 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:24:51.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:51 smithi186 ceph-mon[126480]: pgmap v18630: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 949 KiB/s wr, 11 op/s 2023-05-08T13:24:51.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34830.212940 secs 2023-05-08T13:24:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:51 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:24:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:51 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:24:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:51 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:24:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:51 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:24:52.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:52 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:24:52.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:52 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T13:24:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:52 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T13:24:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:52 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:24:52.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:52 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:24:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:52 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T13:24:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:52 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T13:24:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:52 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:24:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:52 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:24:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:52 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T13:24:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:52 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T13:24:52.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:52 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:24:53.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:53 smithi096 ceph-mon[124666]: pgmap v18631: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 805 KiB/s wr, 9 op/s 2023-05-08T13:24:53.858 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:53 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:24:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:53 smithi186 ceph-mon[126480]: pgmap v18631: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 805 KiB/s wr, 9 op/s 2023-05-08T13:24:53.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:53 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:24:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:53 smithi133 ceph-mon[125939]: pgmap v18631: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 805 KiB/s wr, 9 op/s 2023-05-08T13:24:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:53 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:24:54.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:54 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:24:54.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:54 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:24:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:54 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:24:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34833.366863 secs 2023-05-08T13:24:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:54 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:24:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:54 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:24:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:54 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:24:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34833.366863 secs 2023-05-08T13:24:54.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:54 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:24:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:54 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:24:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:54 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:24:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34833.366863 secs 2023-05-08T13:24:55.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:55 smithi096 ceph-mon[124666]: pgmap v18632: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 14 op/s 2023-05-08T13:24:55.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:55 smithi186 ceph-mon[126480]: pgmap v18632: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 14 op/s 2023-05-08T13:24:55.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:55 smithi133 ceph-mon[125939]: pgmap v18632: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 14 op/s 2023-05-08T13:24:56.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34835.213058 secs 2023-05-08T13:24:56.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34835.213058 secs 2023-05-08T13:24:56.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34835.213058 secs 2023-05-08T13:24:57.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:57 smithi186 ceph-mon[126480]: pgmap v18633: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T13:24:57.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:57 smithi133 ceph-mon[125939]: pgmap v18633: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T13:24:58.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:57 smithi096 ceph-mon[124666]: pgmap v18633: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T13:24:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:59 smithi186 ceph-mon[126480]: pgmap v18634: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T13:24:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:24:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34838.367012 secs 2023-05-08T13:24:59.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:59 smithi133 ceph-mon[125939]: pgmap v18634: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T13:24:59.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:24:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34838.367012 secs 2023-05-08T13:25:00.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:59 smithi096 ceph-mon[124666]: pgmap v18634: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T13:25:00.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:24:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34838.367012 secs 2023-05-08T13:25:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34838.920598 secs 2023-05-08T13:25:00.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34838.920598 secs 2023-05-08T13:25:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34838.920598 secs 2023-05-08T13:25:01.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:01 smithi186 ceph-mon[126480]: pgmap v18635: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.4 MiB/s wr, 16 op/s 2023-05-08T13:25:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34840.213140 secs 2023-05-08T13:25:01.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:01 smithi133 ceph-mon[125939]: pgmap v18635: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.4 MiB/s wr, 16 op/s 2023-05-08T13:25:01.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34840.213140 secs 2023-05-08T13:25:02.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:01 smithi096 ceph-mon[124666]: pgmap v18635: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.4 MiB/s wr, 16 op/s 2023-05-08T13:25:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34840.213140 secs 2023-05-08T13:25:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:02 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:25:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:25:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:25:02.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:02 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:25:02.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:25:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:25:03.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:02 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:25:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:25:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:25:03.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:03 smithi186 ceph-mon[126480]: pgmap v18636: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 844 KiB/s wr, 10 op/s 2023-05-08T13:25:03.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:03 smithi133 ceph-mon[125939]: pgmap v18636: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 844 KiB/s wr, 10 op/s 2023-05-08T13:25:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:03 smithi096 ceph-mon[124666]: pgmap v18636: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 844 KiB/s wr, 10 op/s 2023-05-08T13:25:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34843.367140 secs 2023-05-08T13:25:04.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34843.367140 secs 2023-05-08T13:25:05.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34843.367140 secs 2023-05-08T13:25:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34843.920714 secs 2023-05-08T13:25:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:05 smithi186 ceph-mon[126480]: pgmap v18637: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 16 op/s 2023-05-08T13:25:05.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34843.920714 secs 2023-05-08T13:25:05.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:05 smithi133 ceph-mon[125939]: pgmap v18637: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 16 op/s 2023-05-08T13:25:06.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34843.920714 secs 2023-05-08T13:25:06.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:05 smithi096 ceph-mon[124666]: pgmap v18637: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 16 op/s 2023-05-08T13:25:07.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:07 smithi186 ceph-mon[126480]: pgmap v18638: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 724 KiB/s wr, 11 op/s 2023-05-08T13:25:07.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:07 smithi133 ceph-mon[125939]: pgmap v18638: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 724 KiB/s wr, 11 op/s 2023-05-08T13:25:08.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:07 smithi096 ceph-mon[124666]: pgmap v18638: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 724 KiB/s wr, 11 op/s 2023-05-08T13:25:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:09 smithi186 ceph-mon[126480]: pgmap v18639: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 724 KiB/s wr, 10 op/s 2023-05-08T13:25:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34848.367255 secs 2023-05-08T13:25:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:09 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:25:09.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:09 smithi133 ceph-mon[125939]: pgmap v18639: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 724 KiB/s wr, 10 op/s 2023-05-08T13:25:09.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34848.367255 secs 2023-05-08T13:25:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:09 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:25:10.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:09 smithi096 ceph-mon[124666]: pgmap v18639: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 724 KiB/s wr, 10 op/s 2023-05-08T13:25:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34848.367255 secs 2023-05-08T13:25:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:09 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:25:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34848.920838 secs 2023-05-08T13:25:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:10 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:25:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:10 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:25:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:10 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:25:10.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34848.920838 secs 2023-05-08T13:25:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:10 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:25:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:10 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:25:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:10 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:25:11.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34848.920838 secs 2023-05-08T13:25:11.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:10 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:25:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:10 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:25:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:10 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:25:11.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:11 smithi186 ceph-mon[126480]: pgmap v18640: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.1 MiB/s wr, 26 op/s 2023-05-08T13:25:11.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:11 smithi133 ceph-mon[125939]: pgmap v18640: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.1 MiB/s wr, 26 op/s 2023-05-08T13:25:12.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:11 smithi096 ceph-mon[124666]: pgmap v18640: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.1 MiB/s wr, 26 op/s 2023-05-08T13:25:13.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:13 smithi186 ceph-mon[126480]: pgmap v18641: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 21 op/s 2023-05-08T13:25:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:13 smithi133 ceph-mon[125939]: pgmap v18641: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 21 op/s 2023-05-08T13:25:13.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:13 smithi096 ceph-mon[124666]: pgmap v18641: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 21 op/s 2023-05-08T13:25:14.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34853.367415 secs 2023-05-08T13:25:14.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34853.367415 secs 2023-05-08T13:25:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34853.367415 secs 2023-05-08T13:25:15.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34853.920938 secs 2023-05-08T13:25:15.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:15 smithi133 ceph-mon[125939]: pgmap v18642: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 25 op/s 2023-05-08T13:25:15.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34853.920938 secs 2023-05-08T13:25:15.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:15 smithi096 ceph-mon[124666]: pgmap v18642: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 25 op/s 2023-05-08T13:25:15.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34853.920938 secs 2023-05-08T13:25:15.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:15 smithi186 ceph-mon[126480]: pgmap v18642: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 25 op/s 2023-05-08T13:25:17.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:17 smithi186 ceph-mon[126480]: pgmap v18643: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1019 KiB/s wr, 19 op/s 2023-05-08T13:25:17.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:17 smithi133 ceph-mon[125939]: pgmap v18643: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1019 KiB/s wr, 19 op/s 2023-05-08T13:25:18.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:17 smithi096 ceph-mon[124666]: pgmap v18643: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1019 KiB/s wr, 19 op/s 2023-05-08T13:25:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:19 smithi186 ceph-mon[126480]: pgmap v18644: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1019 KiB/s wr, 19 op/s 2023-05-08T13:25:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34858.367489 secs 2023-05-08T13:25:19.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:19 smithi133 ceph-mon[125939]: pgmap v18644: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1019 KiB/s wr, 19 op/s 2023-05-08T13:25:19.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34858.367489 secs 2023-05-08T13:25:20.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:19 smithi096 ceph-mon[124666]: pgmap v18644: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1019 KiB/s wr, 19 op/s 2023-05-08T13:25:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34858.367489 secs 2023-05-08T13:25:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34858.921037 secs 2023-05-08T13:25:20.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34858.921037 secs 2023-05-08T13:25:21.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34858.921037 secs 2023-05-08T13:25:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:21 smithi186 ceph-mon[126480]: pgmap v18645: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.1 MiB/s wr, 24 op/s 2023-05-08T13:25:21.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:21 smithi133 ceph-mon[125939]: pgmap v18645: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.1 MiB/s wr, 24 op/s 2023-05-08T13:25:22.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:21 smithi096 ceph-mon[124666]: pgmap v18645: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.1 MiB/s wr, 24 op/s 2023-05-08T13:25:23.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:23 smithi186 ceph-mon[126480]: pgmap v18646: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 8 op/s 2023-05-08T13:25:23.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:23 smithi133 ceph-mon[125939]: pgmap v18646: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 8 op/s 2023-05-08T13:25:23.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:23 smithi096 ceph-mon[124666]: pgmap v18646: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 8 op/s 2023-05-08T13:25:24.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34863.367571 secs 2023-05-08T13:25:24.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34863.367571 secs 2023-05-08T13:25:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34863.367571 secs 2023-05-08T13:25:25.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34863.921162 secs 2023-05-08T13:25:25.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:25 smithi133 ceph-mon[125939]: pgmap v18647: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T13:25:25.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34863.921162 secs 2023-05-08T13:25:25.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:25 smithi096 ceph-mon[124666]: pgmap v18647: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T13:25:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34863.921162 secs 2023-05-08T13:25:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:25 smithi186 ceph-mon[126480]: pgmap v18647: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T13:25:26.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34865.213650 secs 2023-05-08T13:25:26.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34865.213650 secs 2023-05-08T13:25:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34865.213650 secs 2023-05-08T13:25:27.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:27 smithi133 ceph-mon[125939]: pgmap v18648: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 758 KiB/s wr, 11 op/s 2023-05-08T13:25:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:27 smithi133 ceph-mon[125939]: osdmap e1242: 12 total, 12 up, 12 in 2023-05-08T13:25:27.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:27 smithi096 ceph-mon[124666]: pgmap v18648: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 758 KiB/s wr, 11 op/s 2023-05-08T13:25:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:27 smithi096 ceph-mon[124666]: osdmap e1242: 12 total, 12 up, 12 in 2023-05-08T13:25:27.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:27 smithi186 ceph-mon[126480]: pgmap v18648: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 758 KiB/s wr, 11 op/s 2023-05-08T13:25:27.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:27 smithi186 ceph-mon[126480]: osdmap e1242: 12 total, 12 up, 12 in 2023-05-08T13:25:29.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:29 smithi096 ceph-mon[124666]: pgmap v18650: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 910 KiB/s wr, 13 op/s 2023-05-08T13:25:29.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34868.367685 secs 2023-05-08T13:25:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:29 smithi186 ceph-mon[126480]: pgmap v18650: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 910 KiB/s wr, 13 op/s 2023-05-08T13:25:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34868.367685 secs 2023-05-08T13:25:29.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:29 smithi133 ceph-mon[125939]: pgmap v18650: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 910 KiB/s wr, 13 op/s 2023-05-08T13:25:29.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34868.367685 secs 2023-05-08T13:25:30.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34868.921300 secs 2023-05-08T13:25:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:30 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:25:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:30 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:25:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:30 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:25:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34868.921300 secs 2023-05-08T13:25:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:30 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:25:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:30 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:25:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:30 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:25:30.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34868.921300 secs 2023-05-08T13:25:30.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:30 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:25:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:30 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:25:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:30 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:25:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:31 smithi186 ceph-mon[126480]: pgmap v18651: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 912 KiB/s wr, 14 op/s 2023-05-08T13:25:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34870.213769 secs 2023-05-08T13:25:31.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:31 smithi133 ceph-mon[125939]: pgmap v18651: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 912 KiB/s wr, 14 op/s 2023-05-08T13:25:31.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34870.213769 secs 2023-05-08T13:25:32.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:31 smithi096 ceph-mon[124666]: pgmap v18651: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 912 KiB/s wr, 14 op/s 2023-05-08T13:25:32.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34870.213769 secs 2023-05-08T13:25:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:33 smithi186 ceph-mon[126480]: pgmap v18652: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 502 KiB/s wr, 13 op/s 2023-05-08T13:25:33.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:33 smithi133 ceph-mon[125939]: pgmap v18652: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 502 KiB/s wr, 13 op/s 2023-05-08T13:25:33.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:33 smithi096 ceph-mon[124666]: pgmap v18652: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 502 KiB/s wr, 13 op/s 2023-05-08T13:25:34.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34873.367789 secs 2023-05-08T13:25:34.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34873.367789 secs 2023-05-08T13:25:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34873.367789 secs 2023-05-08T13:25:35.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34873.921369 secs 2023-05-08T13:25:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:35 smithi133 ceph-mon[125939]: pgmap v18653: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 908 KiB/s wr, 11 op/s 2023-05-08T13:25:35.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34873.921369 secs 2023-05-08T13:25:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:35 smithi096 ceph-mon[124666]: pgmap v18653: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 908 KiB/s wr, 11 op/s 2023-05-08T13:25:35.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34873.921369 secs 2023-05-08T13:25:35.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:35 smithi186 ceph-mon[126480]: pgmap v18653: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 908 KiB/s wr, 11 op/s 2023-05-08T13:25:36.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34875.213829 secs 2023-05-08T13:25:36.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34875.213829 secs 2023-05-08T13:25:36.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34875.213829 secs 2023-05-08T13:25:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:37 smithi133 ceph-mon[125939]: pgmap v18654: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 909 KiB/s rd, 908 KiB/s wr, 10 op/s 2023-05-08T13:25:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:37 smithi133 ceph-mon[125939]: osdmap e1243: 12 total, 12 up, 12 in 2023-05-08T13:25:37.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:37 smithi096 ceph-mon[124666]: pgmap v18654: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 909 KiB/s rd, 908 KiB/s wr, 10 op/s 2023-05-08T13:25:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:37 smithi096 ceph-mon[124666]: osdmap e1243: 12 total, 12 up, 12 in 2023-05-08T13:25:37.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:37 smithi186 ceph-mon[126480]: pgmap v18654: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 909 KiB/s rd, 908 KiB/s wr, 10 op/s 2023-05-08T13:25:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:37 smithi186 ceph-mon[126480]: osdmap e1243: 12 total, 12 up, 12 in 2023-05-08T13:25:39.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:39 smithi133 ceph-mon[125939]: pgmap v18656: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 910 KiB/s rd, 908 KiB/s wr, 10 op/s 2023-05-08T13:25:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34878.367906 secs 2023-05-08T13:25:39.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:39 smithi096 ceph-mon[124666]: pgmap v18656: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 910 KiB/s rd, 908 KiB/s wr, 10 op/s 2023-05-08T13:25:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34878.367906 secs 2023-05-08T13:25:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:39 smithi186 ceph-mon[126480]: pgmap v18656: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 910 KiB/s rd, 908 KiB/s wr, 10 op/s 2023-05-08T13:25:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34878.367906 secs 2023-05-08T13:25:40.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34878.921500 secs 2023-05-08T13:25:40.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34878.921500 secs 2023-05-08T13:25:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34878.921500 secs 2023-05-08T13:25:41.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34880.213915 secs 2023-05-08T13:25:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:41 smithi096 ceph-mon[124666]: pgmap v18657: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T13:25:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34880.213915 secs 2023-05-08T13:25:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:41 smithi186 ceph-mon[126480]: pgmap v18657: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T13:25:41.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34880.213915 secs 2023-05-08T13:25:41.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:41 smithi133 ceph-mon[125939]: pgmap v18657: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T13:25:43.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:43 smithi186 ceph-mon[126480]: pgmap v18658: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T13:25:43.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:43 smithi133 ceph-mon[125939]: pgmap v18658: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T13:25:43.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:43 smithi096 ceph-mon[124666]: pgmap v18658: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T13:25:44.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34883.368022 secs 2023-05-08T13:25:44.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34883.368022 secs 2023-05-08T13:25:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34883.368022 secs 2023-05-08T13:25:45.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34883.921617 secs 2023-05-08T13:25:45.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:45 smithi133 ceph-mon[125939]: pgmap v18659: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 879 KiB/s rd, 877 KiB/s wr, 9 op/s 2023-05-08T13:25:45.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34883.921617 secs 2023-05-08T13:25:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:45 smithi096 ceph-mon[124666]: pgmap v18659: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 879 KiB/s rd, 877 KiB/s wr, 9 op/s 2023-05-08T13:25:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34883.921617 secs 2023-05-08T13:25:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:45 smithi186 ceph-mon[126480]: pgmap v18659: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 879 KiB/s rd, 877 KiB/s wr, 9 op/s 2023-05-08T13:25:47.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:47 smithi186 ceph-mon[126480]: pgmap v18660: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 879 KiB/s rd, 877 KiB/s wr, 9 op/s 2023-05-08T13:25:47.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:47 smithi133 ceph-mon[125939]: pgmap v18660: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 879 KiB/s rd, 877 KiB/s wr, 9 op/s 2023-05-08T13:25:48.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:47 smithi096 ceph-mon[124666]: pgmap v18660: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 879 KiB/s rd, 877 KiB/s wr, 9 op/s 2023-05-08T13:25:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:49 smithi186 ceph-mon[126480]: pgmap v18661: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 784 KiB/s rd, 782 KiB/s wr, 8 op/s 2023-05-08T13:25:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34888.368158 secs 2023-05-08T13:25:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:25:49.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:49 smithi133 ceph-mon[125939]: pgmap v18661: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 784 KiB/s rd, 782 KiB/s wr, 8 op/s 2023-05-08T13:25:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34888.368158 secs 2023-05-08T13:25:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:25:50.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:49 smithi096 ceph-mon[124666]: pgmap v18661: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 784 KiB/s rd, 782 KiB/s wr, 8 op/s 2023-05-08T13:25:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34888.368158 secs 2023-05-08T13:25:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:25:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34888.921758 secs 2023-05-08T13:25:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:25:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:25:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:25:50.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34888.921758 secs 2023-05-08T13:25:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:25:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:25:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:25:51.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34888.921758 secs 2023-05-08T13:25:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:25:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:25:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:25:51.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:51 smithi186 ceph-mon[126480]: pgmap v18662: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 906 KiB/s rd, 903 KiB/s wr, 11 op/s 2023-05-08T13:25:51.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:51 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:25:51.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:51 smithi133 ceph-mon[125939]: pgmap v18662: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 906 KiB/s rd, 903 KiB/s wr, 11 op/s 2023-05-08T13:25:51.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:51 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:25:52.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:51 smithi096 ceph-mon[124666]: pgmap v18662: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 906 KiB/s rd, 903 KiB/s wr, 11 op/s 2023-05-08T13:25:52.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:51 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:25:53.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:53 smithi186 ceph-mon[126480]: pgmap v18663: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 478 KiB/s wr, 7 op/s 2023-05-08T13:25:53.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:53 smithi133 ceph-mon[125939]: pgmap v18663: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 478 KiB/s wr, 7 op/s 2023-05-08T13:25:53.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:53 smithi096 ceph-mon[124666]: pgmap v18663: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 478 KiB/s wr, 7 op/s 2023-05-08T13:25:55.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34893.368225 secs 2023-05-08T13:25:55.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:55 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:25:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:55 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:25:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:55 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:25:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:55 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:25:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:55 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:25:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:55 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:25:55.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34893.368225 secs 2023-05-08T13:25:55.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:55 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:25:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:55 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:25:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:55 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:25:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:55 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:25:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:55 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:25:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:55 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:25:55.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34893.368225 secs 2023-05-08T13:25:55.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:55 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:25:55.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:55 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:25:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:55 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:25:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:55 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:25:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:55 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:25:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:55 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:25:56.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:56 smithi133 ceph-mon[125939]: pgmap v18664: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 957 KiB/s rd, 954 KiB/s wr, 11 op/s 2023-05-08T13:25:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:25:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:25:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:25:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:25:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:25:56.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:25:56.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:25:56.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:25:56.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:25:56.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:56 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi133 to 115.3M 2023-05-08T13:25:56.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:56 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi133 to 120926818: error parsing value: Value '120926818' is below minimum 939524096 2023-05-08T13:25:56.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:25:56.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:25:56.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:25:56.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:25:56.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:25:56.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:25:56.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:25:56.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:25:56.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:25:56.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:56 smithi096 ceph-mon[124666]: pgmap v18664: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 957 KiB/s rd, 954 KiB/s wr, 11 op/s 2023-05-08T13:25:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:25:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:25:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:25:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:25:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:25:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:25:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:25:56.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:25:56.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:25:56.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:56 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi133 to 115.3M 2023-05-08T13:25:56.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:56 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi133 to 120926818: error parsing value: Value '120926818' is below minimum 939524096 2023-05-08T13:25:56.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:25:56.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:25:56.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:25:56.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:25:56.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:25:56.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:25:56.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:25:56.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:25:56.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:25:56.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:56 smithi186 ceph-mon[126480]: pgmap v18664: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 957 KiB/s rd, 954 KiB/s wr, 11 op/s 2023-05-08T13:25:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:25:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:25:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:25:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:25:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:25:56.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:25:56.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:25:56.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:25:56.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:25:56.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:56 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi133 to 115.3M 2023-05-08T13:25:56.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:56 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi133 to 120926818: error parsing value: Value '120926818' is below minimum 939524096 2023-05-08T13:25:56.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:25:56.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:25:56.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:25:56.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:25:56.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:25:56.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:25:56.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:25:56.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:25:56.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:25:57.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:57 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi186 to 103.8M 2023-05-08T13:25:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:57 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi186 to 108864426: error parsing value: Value '108864426' is below minimum 939524096 2023-05-08T13:25:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:57 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:25:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:57 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T13:25:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:57 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T13:25:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:57 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:25:57.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:25:57.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:57 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi186 to 103.8M 2023-05-08T13:25:57.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:57 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi186 to 108864426: error parsing value: Value '108864426' is below minimum 939524096 2023-05-08T13:25:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:57 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:25:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:57 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T13:25:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:57 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T13:25:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:57 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:25:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:25:57.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:57 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi186 to 103.8M 2023-05-08T13:25:57.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:57 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi186 to 108864426: error parsing value: Value '108864426' is below minimum 939524096 2023-05-08T13:25:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:57 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:25:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:57 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T13:25:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:57 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T13:25:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:57 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:25:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:25:58.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:58 smithi133 ceph-mon[125939]: pgmap v18665: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 650 KiB/s rd, 649 KiB/s wr, 7 op/s 2023-05-08T13:25:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:58 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:25:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:25:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:25:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:25:58.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:58 smithi096 ceph-mon[124666]: pgmap v18665: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 650 KiB/s rd, 649 KiB/s wr, 7 op/s 2023-05-08T13:25:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:58 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:25:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:25:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:25:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:25:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:58 smithi186 ceph-mon[126480]: pgmap v18665: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 650 KiB/s rd, 649 KiB/s wr, 7 op/s 2023-05-08T13:25:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:58 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:25:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:25:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:25:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:26:00.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:00 smithi133 ceph-mon[125939]: pgmap v18666: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 650 KiB/s rd, 649 KiB/s wr, 7 op/s 2023-05-08T13:26:00.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34898.368352 secs 2023-05-08T13:26:00.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:00 smithi096 ceph-mon[124666]: pgmap v18666: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 650 KiB/s rd, 649 KiB/s wr, 7 op/s 2023-05-08T13:26:00.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34898.368352 secs 2023-05-08T13:26:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:00 smithi186 ceph-mon[126480]: pgmap v18666: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 650 KiB/s rd, 649 KiB/s wr, 7 op/s 2023-05-08T13:26:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34898.368352 secs 2023-05-08T13:26:01.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34900.214303 secs 2023-05-08T13:26:01.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34900.214303 secs 2023-05-08T13:26:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34900.214303 secs 2023-05-08T13:26:02.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:02 smithi133 ceph-mon[125939]: pgmap v18667: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2023-05-08T13:26:02.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:26:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:26:02.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:02 smithi096 ceph-mon[124666]: pgmap v18667: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2023-05-08T13:26:02.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:26:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:26:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:02 smithi186 ceph-mon[126480]: pgmap v18667: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2023-05-08T13:26:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:26:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:26:03.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:03 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:26:03.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:03 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:26:03.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:03 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:26:04.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:04 smithi133 ceph-mon[125939]: pgmap v18668: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 9 op/s 2023-05-08T13:26:04.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:04 smithi096 ceph-mon[124666]: pgmap v18668: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 9 op/s 2023-05-08T13:26:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:04 smithi186 ceph-mon[126480]: pgmap v18668: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 9 op/s 2023-05-08T13:26:05.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34903.368403 secs 2023-05-08T13:26:05.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34903.922089 secs 2023-05-08T13:26:05.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34903.368403 secs 2023-05-08T13:26:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34903.922089 secs 2023-05-08T13:26:05.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34903.368403 secs 2023-05-08T13:26:05.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34903.922089 secs 2023-05-08T13:26:06.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:06 smithi133 ceph-mon[125939]: pgmap v18669: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 30 op/s 2023-05-08T13:26:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:26:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:26:06.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:06 smithi096 ceph-mon[124666]: pgmap v18669: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 30 op/s 2023-05-08T13:26:06.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:26:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:26:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:06 smithi186 ceph-mon[126480]: pgmap v18669: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 30 op/s 2023-05-08T13:26:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:26:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:26:08.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:08 smithi133 ceph-mon[125939]: pgmap v18670: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 26 op/s 2023-05-08T13:26:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:08 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:26:08.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:08 smithi096 ceph-mon[124666]: pgmap v18670: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 26 op/s 2023-05-08T13:26:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:08 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:26:08.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:08 smithi186 ceph-mon[126480]: pgmap v18670: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 26 op/s 2023-05-08T13:26:08.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:08 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:26:09.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:09 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:26:09.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:09 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:26:09.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:09 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:26:10.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:10 smithi133 ceph-mon[125939]: pgmap v18671: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 26 op/s 2023-05-08T13:26:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34908.368485 secs 2023-05-08T13:26:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:10 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:26:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:10 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:26:10.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:10 smithi096 ceph-mon[124666]: pgmap v18671: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 26 op/s 2023-05-08T13:26:10.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34908.368485 secs 2023-05-08T13:26:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:10 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:26:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:10 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:26:10.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:10 smithi186 ceph-mon[126480]: pgmap v18671: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 26 op/s 2023-05-08T13:26:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34908.368485 secs 2023-05-08T13:26:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:10 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:26:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:10 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:26:12.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:12 smithi133 ceph-mon[125939]: pgmap v18672: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.8 MiB/s wr, 31 op/s 2023-05-08T13:26:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:12 smithi133 ceph-mon[125939]: osdmap e1244: 12 total, 12 up, 12 in 2023-05-08T13:26:12.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:12 smithi096 ceph-mon[124666]: pgmap v18672: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.8 MiB/s wr, 31 op/s 2023-05-08T13:26:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:12 smithi096 ceph-mon[124666]: osdmap e1244: 12 total, 12 up, 12 in 2023-05-08T13:26:12.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:12 smithi186 ceph-mon[126480]: pgmap v18672: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.8 MiB/s wr, 31 op/s 2023-05-08T13:26:12.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:12 smithi186 ceph-mon[126480]: osdmap e1244: 12 total, 12 up, 12 in 2023-05-08T13:26:13.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:13 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:26:13.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:13 smithi133 ceph-mon[125939]: pgmap v18674: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.3 MiB/s wr, 31 op/s 2023-05-08T13:26:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:13 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:26:13.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:13 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:26:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:13 smithi096 ceph-mon[124666]: pgmap v18674: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.3 MiB/s wr, 31 op/s 2023-05-08T13:26:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:13 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:26:13.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:13 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:26:13.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:13 smithi186 ceph-mon[126480]: pgmap v18674: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.3 MiB/s wr, 31 op/s 2023-05-08T13:26:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:13 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:26:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:14 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:26:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:14 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:26:14.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:14 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:26:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:14 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:26:14.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:14 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:26:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:14 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:26:15.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34913.368560 secs 2023-05-08T13:26:15.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:15 smithi186 ceph-mon[126480]: pgmap v18675: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 984 KiB/s wr, 11 op/s 2023-05-08T13:26:15.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34913.368560 secs 2023-05-08T13:26:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:15 smithi133 ceph-mon[125939]: pgmap v18675: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 984 KiB/s wr, 11 op/s 2023-05-08T13:26:15.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34913.368560 secs 2023-05-08T13:26:15.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:15 smithi096 ceph-mon[124666]: pgmap v18675: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 984 KiB/s wr, 11 op/s 2023-05-08T13:26:17.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:17 smithi186 ceph-mon[126480]: pgmap v18676: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 984 KiB/s wr, 11 op/s 2023-05-08T13:26:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:17 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:26:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:17 smithi186 ceph-mon[126480]: osdmap e1245: 12 total, 12 up, 12 in 2023-05-08T13:26:17.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:17 smithi133 ceph-mon[125939]: pgmap v18676: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 984 KiB/s wr, 11 op/s 2023-05-08T13:26:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:17 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:26:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:17 smithi133 ceph-mon[125939]: osdmap e1245: 12 total, 12 up, 12 in 2023-05-08T13:26:18.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:17 smithi096 ceph-mon[124666]: pgmap v18676: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 984 KiB/s wr, 11 op/s 2023-05-08T13:26:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:17 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:26:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:17 smithi096 ceph-mon[124666]: osdmap e1245: 12 total, 12 up, 12 in 2023-05-08T13:26:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:19 smithi186 ceph-mon[126480]: pgmap v18678: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 491 KiB/s rd, 497 KiB/s wr, 6 op/s 2023-05-08T13:26:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34918.368669 secs 2023-05-08T13:26:19.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:19 smithi133 ceph-mon[125939]: pgmap v18678: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 491 KiB/s rd, 497 KiB/s wr, 6 op/s 2023-05-08T13:26:19.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34918.368669 secs 2023-05-08T13:26:20.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:19 smithi096 ceph-mon[124666]: pgmap v18678: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 491 KiB/s rd, 497 KiB/s wr, 6 op/s 2023-05-08T13:26:20.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34918.368669 secs 2023-05-08T13:26:21.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:21 smithi186 ceph-mon[126480]: pgmap v18679: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 459 KiB/s wr, 10 op/s 2023-05-08T13:26:21.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:21 smithi133 ceph-mon[125939]: pgmap v18679: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 459 KiB/s wr, 10 op/s 2023-05-08T13:26:22.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:21 smithi096 ceph-mon[124666]: pgmap v18679: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 459 KiB/s wr, 10 op/s 2023-05-08T13:26:23.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:23 smithi186 ceph-mon[126480]: pgmap v18680: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 467 KiB/s rd, 427 KiB/s wr, 10 op/s 2023-05-08T13:26:23.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:23 smithi133 ceph-mon[125939]: pgmap v18680: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 467 KiB/s rd, 427 KiB/s wr, 10 op/s 2023-05-08T13:26:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:23 smithi096 ceph-mon[124666]: pgmap v18680: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 467 KiB/s rd, 427 KiB/s wr, 10 op/s 2023-05-08T13:26:24.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34923.368806 secs 2023-05-08T13:26:24.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34923.368806 secs 2023-05-08T13:26:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34923.368806 secs 2023-05-08T13:26:25.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34923.922635 secs 2023-05-08T13:26:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:25 smithi133 ceph-mon[125939]: pgmap v18681: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 852 KiB/s wr, 10 op/s 2023-05-08T13:26:25.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34923.922635 secs 2023-05-08T13:26:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:25 smithi096 ceph-mon[124666]: pgmap v18681: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 852 KiB/s wr, 10 op/s 2023-05-08T13:26:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34923.922635 secs 2023-05-08T13:26:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:25 smithi186 ceph-mon[126480]: pgmap v18681: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 852 KiB/s wr, 10 op/s 2023-05-08T13:26:26.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:26 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:26:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34925.214814 secs 2023-05-08T13:26:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:26 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:26:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:26 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:26:26.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:26 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:26:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34925.214814 secs 2023-05-08T13:26:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:26 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:26:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:26 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:26:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:26 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:26:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34925.214814 secs 2023-05-08T13:26:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:26 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:26:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:26 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:26:27.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:27 smithi096 ceph-mon[124666]: pgmap v18682: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 852 KiB/s wr, 10 op/s 2023-05-08T13:26:27.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:27 smithi186 ceph-mon[126480]: pgmap v18682: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 852 KiB/s wr, 10 op/s 2023-05-08T13:26:27.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:27 smithi133 ceph-mon[125939]: pgmap v18682: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 852 KiB/s wr, 10 op/s 2023-05-08T13:26:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:29 smithi186 ceph-mon[126480]: pgmap v18683: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 775 KiB/s rd, 760 KiB/s wr, 9 op/s 2023-05-08T13:26:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34928.368912 secs 2023-05-08T13:26:29.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:29 smithi133 ceph-mon[125939]: pgmap v18683: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 775 KiB/s rd, 760 KiB/s wr, 9 op/s 2023-05-08T13:26:29.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34928.368912 secs 2023-05-08T13:26:30.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:29 smithi096 ceph-mon[124666]: pgmap v18683: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 775 KiB/s rd, 760 KiB/s wr, 9 op/s 2023-05-08T13:26:30.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34928.368912 secs 2023-05-08T13:26:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34928.922762 secs 2023-05-08T13:26:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:30 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:26:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:30 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:26:30.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34928.922762 secs 2023-05-08T13:26:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:30 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:26:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:30 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:26:31.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34928.922762 secs 2023-05-08T13:26:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:30 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:26:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:30 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:26:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34930.214960 secs 2023-05-08T13:26:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:31 smithi186 ceph-mon[126480]: pgmap v18684: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 898 KiB/s rd, 860 KiB/s wr, 13 op/s 2023-05-08T13:26:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34930.214960 secs 2023-05-08T13:26:32.037 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:31 smithi133 ceph-mon[125939]: pgmap v18684: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 898 KiB/s rd, 860 KiB/s wr, 13 op/s 2023-05-08T13:26:32.038 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34930.214960 secs 2023-05-08T13:26:32.039 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:31 smithi096 ceph-mon[124666]: pgmap v18684: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 898 KiB/s rd, 860 KiB/s wr, 13 op/s 2023-05-08T13:26:32.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:32 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:26:32.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:32 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:26:33.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:32 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:26:33.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:33 smithi186 ceph-mon[126480]: pgmap v18685: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 836 KiB/s rd, 835 KiB/s wr, 9 op/s 2023-05-08T13:26:33.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:33 smithi133 ceph-mon[125939]: pgmap v18685: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 836 KiB/s rd, 835 KiB/s wr, 9 op/s 2023-05-08T13:26:34.096 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:33 smithi096 ceph-mon[124666]: pgmap v18685: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 836 KiB/s rd, 835 KiB/s wr, 9 op/s 2023-05-08T13:26:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34933.369034 secs 2023-05-08T13:26:34.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34933.369034 secs 2023-05-08T13:26:35.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34933.369034 secs 2023-05-08T13:26:35.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34933.922879 secs 2023-05-08T13:26:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:35 smithi186 ceph-mon[126480]: pgmap v18686: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T13:26:35.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34933.922879 secs 2023-05-08T13:26:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:35 smithi133 ceph-mon[125939]: pgmap v18686: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T13:26:36.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34933.922879 secs 2023-05-08T13:26:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:35 smithi096 ceph-mon[124666]: pgmap v18686: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T13:26:36.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34935.215099 secs 2023-05-08T13:26:36.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34935.215099 secs 2023-05-08T13:26:37.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34935.215099 secs 2023-05-08T13:26:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:37 smithi186 ceph-mon[126480]: pgmap v18687: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 450 KiB/s wr, 9 op/s 2023-05-08T13:26:37.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:37 smithi133 ceph-mon[125939]: pgmap v18687: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 450 KiB/s wr, 9 op/s 2023-05-08T13:26:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:37 smithi096 ceph-mon[124666]: pgmap v18687: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 450 KiB/s wr, 9 op/s 2023-05-08T13:26:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:39 smithi186 ceph-mon[126480]: pgmap v18688: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 450 KiB/s wr, 9 op/s 2023-05-08T13:26:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34938.369160 secs 2023-05-08T13:26:39.996 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:39 smithi133 ceph-mon[125939]: pgmap v18688: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 450 KiB/s wr, 9 op/s 2023-05-08T13:26:39.997 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34938.369160 secs 2023-05-08T13:26:40.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:39 smithi096 ceph-mon[124666]: pgmap v18688: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 450 KiB/s wr, 9 op/s 2023-05-08T13:26:40.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34938.369160 secs 2023-05-08T13:26:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34938.923003 secs 2023-05-08T13:26:40.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34938.923003 secs 2023-05-08T13:26:41.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34938.923003 secs 2023-05-08T13:26:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34940.215206 secs 2023-05-08T13:26:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:41 smithi186 ceph-mon[126480]: pgmap v18689: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 787 KiB/s rd, 760 KiB/s wr, 12 op/s 2023-05-08T13:26:41.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34940.215206 secs 2023-05-08T13:26:41.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:41 smithi133 ceph-mon[125939]: pgmap v18689: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 787 KiB/s rd, 760 KiB/s wr, 12 op/s 2023-05-08T13:26:42.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34940.215206 secs 2023-05-08T13:26:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:41 smithi096 ceph-mon[124666]: pgmap v18689: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 787 KiB/s rd, 760 KiB/s wr, 12 op/s 2023-05-08T13:26:43.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:43 smithi186 ceph-mon[126480]: pgmap v18690: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 613 KiB/s rd, 610 KiB/s wr, 7 op/s 2023-05-08T13:26:43.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:43 smithi133 ceph-mon[125939]: pgmap v18690: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 613 KiB/s rd, 610 KiB/s wr, 7 op/s 2023-05-08T13:26:43.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:43 smithi096 ceph-mon[124666]: pgmap v18690: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 613 KiB/s rd, 610 KiB/s wr, 7 op/s 2023-05-08T13:26:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34943.369294 secs 2023-05-08T13:26:44.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34943.369294 secs 2023-05-08T13:26:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34943.369294 secs 2023-05-08T13:26:45.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34943.923107 secs 2023-05-08T13:26:45.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:45 smithi133 ceph-mon[125939]: pgmap v18691: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 629 KiB/s rd, 626 KiB/s wr, 11 op/s 2023-05-08T13:26:45.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34943.923107 secs 2023-05-08T13:26:45.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:45 smithi096 ceph-mon[124666]: pgmap v18691: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 629 KiB/s rd, 626 KiB/s wr, 11 op/s 2023-05-08T13:26:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34943.923107 secs 2023-05-08T13:26:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:45 smithi186 ceph-mon[126480]: pgmap v18691: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 629 KiB/s rd, 626 KiB/s wr, 11 op/s 2023-05-08T13:26:47.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:47 smithi186 ceph-mon[126480]: pgmap v18692: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 326 KiB/s wr, 6 op/s 2023-05-08T13:26:47.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:47 smithi133 ceph-mon[125939]: pgmap v18692: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 326 KiB/s wr, 6 op/s 2023-05-08T13:26:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:47 smithi096 ceph-mon[124666]: pgmap v18692: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 326 KiB/s wr, 6 op/s 2023-05-08T13:26:49.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:49 smithi186 ceph-mon[126480]: pgmap v18693: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 326 KiB/s wr, 6 op/s 2023-05-08T13:26:49.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34948.369420 secs 2023-05-08T13:26:49.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:26:49.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:49 smithi133 ceph-mon[125939]: pgmap v18693: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 326 KiB/s wr, 6 op/s 2023-05-08T13:26:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34948.369420 secs 2023-05-08T13:26:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:26:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:49 smithi096 ceph-mon[124666]: pgmap v18693: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 326 KiB/s wr, 6 op/s 2023-05-08T13:26:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34948.369420 secs 2023-05-08T13:26:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:26:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:26:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:26:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:26:50.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:26:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:26:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:26:51.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:26:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:26:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:26:51.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:51 smithi186 ceph-mon[126480]: pgmap v18694: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 996 KiB/s rd, 963 KiB/s wr, 11 op/s 2023-05-08T13:26:51.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:51 smithi133 ceph-mon[125939]: pgmap v18694: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 996 KiB/s rd, 963 KiB/s wr, 11 op/s 2023-05-08T13:26:52.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:51 smithi096 ceph-mon[124666]: pgmap v18694: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 996 KiB/s rd, 963 KiB/s wr, 11 op/s 2023-05-08T13:26:53.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:53 smithi186 ceph-mon[126480]: pgmap v18695: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 685 KiB/s rd, 653 KiB/s wr, 8 op/s 2023-05-08T13:26:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:53 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:26:53.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:53 smithi133 ceph-mon[125939]: pgmap v18695: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 685 KiB/s rd, 653 KiB/s wr, 8 op/s 2023-05-08T13:26:53.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:53 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:26:53.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:53 smithi096 ceph-mon[124666]: pgmap v18695: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 685 KiB/s rd, 653 KiB/s wr, 8 op/s 2023-05-08T13:26:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:53 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:26:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:54 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:26:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:54 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:26:54.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:54 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:26:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:54 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:26:54.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:54 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:26:54.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:54 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:26:55.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34953.369515 secs 2023-05-08T13:26:55.660 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:55 smithi186 ceph-mon[126480]: pgmap v18696: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1024 KiB/s rd, 1.3 MiB/s wr, 13 op/s 2023-05-08T13:26:55.660 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:55 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:26:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34953.369515 secs 2023-05-08T13:26:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:55 smithi133 ceph-mon[125939]: pgmap v18696: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1024 KiB/s rd, 1.3 MiB/s wr, 13 op/s 2023-05-08T13:26:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:55 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:26:55.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34953.369515 secs 2023-05-08T13:26:55.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:55 smithi096 ceph-mon[124666]: pgmap v18696: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1024 KiB/s rd, 1.3 MiB/s wr, 13 op/s 2023-05-08T13:26:55.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:55 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:26:56.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34955.215554 secs 2023-05-08T13:26:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:26:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:26:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:56 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:26:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:26:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:56 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T13:26:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:56 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T13:26:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:56 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:26:56.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34955.215554 secs 2023-05-08T13:26:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:26:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:26:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:56 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:26:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:26:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:56 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T13:26:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:56 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T13:26:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:56 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:26:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34955.215554 secs 2023-05-08T13:26:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:26:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:26:56.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:56 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:26:56.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:26:56.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:56 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T13:26:56.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:56 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T13:26:56.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:56 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:26:57.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:57 smithi186 ceph-mon[126480]: pgmap v18697: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1007 KiB/s rd, 1.3 MiB/s wr, 9 op/s 2023-05-08T13:26:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:57 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:26:57.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:57 smithi133 ceph-mon[125939]: pgmap v18697: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1007 KiB/s rd, 1.3 MiB/s wr, 9 op/s 2023-05-08T13:26:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:57 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:26:57.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:57 smithi096 ceph-mon[124666]: pgmap v18697: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1007 KiB/s rd, 1.3 MiB/s wr, 9 op/s 2023-05-08T13:26:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:57 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:26:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:26:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:26:58.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:26:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:26:58.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:26:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:26:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:26:59 smithi186 ceph-mon[126480]: pgmap v18698: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1007 KiB/s rd, 1.3 MiB/s wr, 9 op/s 2023-05-08T13:26:59.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:26:59 smithi133 ceph-mon[125939]: pgmap v18698: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1007 KiB/s rd, 1.3 MiB/s wr, 9 op/s 2023-05-08T13:26:59.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:26:59 smithi096 ceph-mon[124666]: pgmap v18698: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1007 KiB/s rd, 1.3 MiB/s wr, 9 op/s 2023-05-08T13:27:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34958.923498 secs 2023-05-08T13:27:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:00 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:27:00.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34958.923498 secs 2023-05-08T13:27:00.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:00 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:27:00.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34958.923498 secs 2023-05-08T13:27:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:00 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:27:01.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T13:27:01.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:27:01.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34960.215672 secs 2023-05-08T13:27:01.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:01 smithi186 ceph-mon[126480]: pgmap v18699: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 15 op/s 2023-05-08T13:27:01.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T13:27:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:27:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34960.215672 secs 2023-05-08T13:27:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:01 smithi133 ceph-mon[125939]: pgmap v18699: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 15 op/s 2023-05-08T13:27:01.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T13:27:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:27:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34960.215672 secs 2023-05-08T13:27:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:01 smithi096 ceph-mon[124666]: pgmap v18699: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 15 op/s 2023-05-08T13:27:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:27:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:27:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:02 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:27:02.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:27:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:27:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:02 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:27:02.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:27:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:27:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:02 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:27:03.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:03 smithi186 ceph-mon[126480]: pgmap v18700: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 906 KiB/s rd, 804 KiB/s wr, 10 op/s 2023-05-08T13:27:03.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:03 smithi133 ceph-mon[125939]: pgmap v18700: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 906 KiB/s rd, 804 KiB/s wr, 10 op/s 2023-05-08T13:27:03.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:03 smithi096 ceph-mon[124666]: pgmap v18700: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 906 KiB/s rd, 804 KiB/s wr, 10 op/s 2023-05-08T13:27:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34963.923608 secs 2023-05-08T13:27:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:05 smithi186 ceph-mon[126480]: pgmap v18701: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.4 MiB/s wr, 17 op/s 2023-05-08T13:27:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34963.923608 secs 2023-05-08T13:27:05.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:05 smithi133 ceph-mon[125939]: pgmap v18701: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.4 MiB/s wr, 17 op/s 2023-05-08T13:27:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34963.923608 secs 2023-05-08T13:27:06.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:05 smithi096 ceph-mon[124666]: pgmap v18701: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.4 MiB/s wr, 17 op/s 2023-05-08T13:27:07.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:07 smithi186 ceph-mon[126480]: pgmap v18702: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 731 KiB/s wr, 12 op/s 2023-05-08T13:27:07.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:07 smithi133 ceph-mon[125939]: pgmap v18702: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 731 KiB/s wr, 12 op/s 2023-05-08T13:27:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:07 smithi096 ceph-mon[124666]: pgmap v18702: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 731 KiB/s wr, 12 op/s 2023-05-08T13:27:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:09 smithi186 ceph-mon[126480]: pgmap v18703: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 731 KiB/s wr, 12 op/s 2023-05-08T13:27:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34968.369822 secs 2023-05-08T13:27:09.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:09 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:27:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:09 smithi133 ceph-mon[125939]: pgmap v18703: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 731 KiB/s wr, 12 op/s 2023-05-08T13:27:10.013 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34968.369822 secs 2023-05-08T13:27:10.015 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:09 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:27:10.016 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:09 smithi096 ceph-mon[124666]: pgmap v18703: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 731 KiB/s wr, 12 op/s 2023-05-08T13:27:10.016 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34968.369822 secs 2023-05-08T13:27:10.016 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:09 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:27:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:10 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:27:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:10 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:27:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:10 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:27:10.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:10 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:27:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:10 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:27:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:10 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:27:11.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:10 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:27:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:10 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:27:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:10 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:27:11.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:11 smithi186 ceph-mon[126480]: pgmap v18704: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.2 MiB/s wr, 28 op/s 2023-05-08T13:27:11.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:11 smithi133 ceph-mon[125939]: pgmap v18704: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.2 MiB/s wr, 28 op/s 2023-05-08T13:27:12.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:11 smithi096 ceph-mon[124666]: pgmap v18704: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.2 MiB/s wr, 28 op/s 2023-05-08T13:27:13.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:13 smithi186 ceph-mon[126480]: pgmap v18705: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 22 op/s 2023-05-08T13:27:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:13 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T13:27:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:13 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:27:13.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:13 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:27:13.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:13 smithi133 ceph-mon[125939]: pgmap v18705: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 22 op/s 2023-05-08T13:27:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:13 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T13:27:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:13 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:27:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:13 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:27:14.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:13 smithi096 ceph-mon[124666]: pgmap v18705: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 22 op/s 2023-05-08T13:27:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:13 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T13:27:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:13 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:27:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:13 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:27:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:14 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:27:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:14 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:27:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34973.369923 secs 2023-05-08T13:27:14.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:14 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:27:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:14 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:27:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34973.369923 secs 2023-05-08T13:27:15.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:14 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:27:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:14 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:27:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34973.369923 secs 2023-05-08T13:27:15.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:15 smithi186 ceph-mon[126480]: pgmap v18706: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 26 op/s 2023-05-08T13:27:15.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:15 smithi133 ceph-mon[125939]: pgmap v18706: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 26 op/s 2023-05-08T13:27:16.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:15 smithi096 ceph-mon[124666]: pgmap v18706: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 26 op/s 2023-05-08T13:27:17.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:17 smithi186 ceph-mon[126480]: pgmap v18707: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 856 KiB/s rd, 869 KiB/s wr, 20 op/s 2023-05-08T13:27:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:17 smithi133 ceph-mon[125939]: pgmap v18707: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 856 KiB/s rd, 869 KiB/s wr, 20 op/s 2023-05-08T13:27:18.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:17 smithi096 ceph-mon[124666]: pgmap v18707: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 856 KiB/s rd, 869 KiB/s wr, 20 op/s 2023-05-08T13:27:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:19 smithi186 ceph-mon[126480]: pgmap v18708: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 856 KiB/s rd, 869 KiB/s wr, 20 op/s 2023-05-08T13:27:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34978.370041 secs 2023-05-08T13:27:19.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:19 smithi133 ceph-mon[125939]: pgmap v18708: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 856 KiB/s rd, 869 KiB/s wr, 20 op/s 2023-05-08T13:27:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34978.370041 secs 2023-05-08T13:27:20.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:19 smithi096 ceph-mon[124666]: pgmap v18708: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 856 KiB/s rd, 869 KiB/s wr, 20 op/s 2023-05-08T13:27:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34978.370041 secs 2023-05-08T13:27:21.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:21 smithi186 ceph-mon[126480]: pgmap v18709: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 24 op/s 2023-05-08T13:27:21.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:21 smithi133 ceph-mon[125939]: pgmap v18709: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 24 op/s 2023-05-08T13:27:22.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:21 smithi096 ceph-mon[124666]: pgmap v18709: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 24 op/s 2023-05-08T13:27:23.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:23 smithi186 ceph-mon[126480]: pgmap v18710: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 930 KiB/s rd, 593 KiB/s wr, 8 op/s 2023-05-08T13:27:23.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:23 smithi133 ceph-mon[125939]: pgmap v18710: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 930 KiB/s rd, 593 KiB/s wr, 8 op/s 2023-05-08T13:27:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:23 smithi096 ceph-mon[124666]: pgmap v18710: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 930 KiB/s rd, 593 KiB/s wr, 8 op/s 2023-05-08T13:27:24.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34983.370183 secs 2023-05-08T13:27:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34983.370183 secs 2023-05-08T13:27:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34983.370183 secs 2023-05-08T13:27:25.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34983.924073 secs 2023-05-08T13:27:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:25 smithi096 ceph-mon[124666]: pgmap v18711: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.2 MiB/s wr, 15 op/s 2023-05-08T13:27:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34983.924073 secs 2023-05-08T13:27:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:25 smithi186 ceph-mon[126480]: pgmap v18711: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.2 MiB/s wr, 15 op/s 2023-05-08T13:27:25.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34983.924073 secs 2023-05-08T13:27:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:25 smithi133 ceph-mon[125939]: pgmap v18711: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.2 MiB/s wr, 15 op/s 2023-05-08T13:27:26.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34985.216373 secs 2023-05-08T13:27:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:26 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:27:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:26 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:27:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:26 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:27:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34985.216373 secs 2023-05-08T13:27:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:26 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:27:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:26 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:27:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:26 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:27:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34985.216373 secs 2023-05-08T13:27:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:26 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:27:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:26 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:27:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:26 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:27:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:27 smithi096 ceph-mon[124666]: pgmap v18712: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 855 KiB/s wr, 11 op/s 2023-05-08T13:27:27.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:27 smithi186 ceph-mon[126480]: pgmap v18712: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 855 KiB/s wr, 11 op/s 2023-05-08T13:27:27.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:27 smithi133 ceph-mon[125939]: pgmap v18712: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 855 KiB/s wr, 11 op/s 2023-05-08T13:27:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:29 smithi186 ceph-mon[126480]: pgmap v18713: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 855 KiB/s wr, 11 op/s 2023-05-08T13:27:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34988.370318 secs 2023-05-08T13:27:29.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:29 smithi133 ceph-mon[125939]: pgmap v18713: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 855 KiB/s wr, 11 op/s 2023-05-08T13:27:29.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34988.370318 secs 2023-05-08T13:27:30.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:29 smithi096 ceph-mon[124666]: pgmap v18713: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 855 KiB/s wr, 11 op/s 2023-05-08T13:27:30.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34988.370318 secs 2023-05-08T13:27:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34988.924199 secs 2023-05-08T13:27:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:30 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:27:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:30 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:27:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34988.924199 secs 2023-05-08T13:27:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:30 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:27:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:30 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:27:31.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34988.924199 secs 2023-05-08T13:27:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:30 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:27:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:30 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:27:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34990.216508 secs 2023-05-08T13:27:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:31 smithi186 ceph-mon[126480]: pgmap v18714: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 998 KiB/s wr, 17 op/s 2023-05-08T13:27:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:31 smithi186 ceph-mon[126480]: osdmap e1246: 12 total, 12 up, 12 in 2023-05-08T13:27:31.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34990.216508 secs 2023-05-08T13:27:31.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:31 smithi133 ceph-mon[125939]: pgmap v18714: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 998 KiB/s wr, 17 op/s 2023-05-08T13:27:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:31 smithi133 ceph-mon[125939]: osdmap e1246: 12 total, 12 up, 12 in 2023-05-08T13:27:32.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34990.216508 secs 2023-05-08T13:27:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:31 smithi096 ceph-mon[124666]: pgmap v18714: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 998 KiB/s wr, 17 op/s 2023-05-08T13:27:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:31 smithi096 ceph-mon[124666]: osdmap e1246: 12 total, 12 up, 12 in 2023-05-08T13:27:32.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:32 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:27:32.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:32 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:27:33.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:32 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:27:33.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:33 smithi186 ceph-mon[126480]: pgmap v18716: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 878 KiB/s wr, 15 op/s 2023-05-08T13:27:33.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:33 smithi133 ceph-mon[125939]: pgmap v18716: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 878 KiB/s wr, 15 op/s 2023-05-08T13:27:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:33 smithi096 ceph-mon[124666]: pgmap v18716: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 878 KiB/s wr, 15 op/s 2023-05-08T13:27:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34993.370444 secs 2023-05-08T13:27:34.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34993.370444 secs 2023-05-08T13:27:35.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34993.370444 secs 2023-05-08T13:27:35.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34993.924323 secs 2023-05-08T13:27:35.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:35 smithi186 ceph-mon[126480]: pgmap v18717: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 925 KiB/s rd, 923 KiB/s wr, 12 op/s 2023-05-08T13:27:35.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34993.924323 secs 2023-05-08T13:27:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:35 smithi133 ceph-mon[125939]: pgmap v18717: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 925 KiB/s rd, 923 KiB/s wr, 12 op/s 2023-05-08T13:27:36.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34993.924323 secs 2023-05-08T13:27:36.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:35 smithi096 ceph-mon[124666]: pgmap v18717: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 925 KiB/s rd, 923 KiB/s wr, 12 op/s 2023-05-08T13:27:36.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34995.216640 secs 2023-05-08T13:27:36.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34995.216640 secs 2023-05-08T13:27:37.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34995.216640 secs 2023-05-08T13:27:37.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:37 smithi186 ceph-mon[126480]: pgmap v18718: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 925 KiB/s rd, 923 KiB/s wr, 12 op/s 2023-05-08T13:27:38.008 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:37 smithi186 ceph-mon[126480]: osdmap e1247: 12 total, 12 up, 12 in 2023-05-08T13:27:38.009 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:37 smithi096 ceph-mon[124666]: pgmap v18718: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 925 KiB/s rd, 923 KiB/s wr, 12 op/s 2023-05-08T13:27:38.009 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:37 smithi096 ceph-mon[124666]: osdmap e1247: 12 total, 12 up, 12 in 2023-05-08T13:27:38.010 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:37 smithi133 ceph-mon[125939]: pgmap v18718: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 925 KiB/s rd, 923 KiB/s wr, 12 op/s 2023-05-08T13:27:38.010 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:37 smithi133 ceph-mon[125939]: osdmap e1247: 12 total, 12 up, 12 in 2023-05-08T13:27:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:39 smithi186 ceph-mon[126480]: pgmap v18720: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 941 KiB/s rd, 939 KiB/s wr, 7 op/s 2023-05-08T13:27:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34998.370572 secs 2023-05-08T13:27:39.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:39 smithi133 ceph-mon[125939]: pgmap v18720: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 941 KiB/s rd, 939 KiB/s wr, 7 op/s 2023-05-08T13:27:39.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34998.370572 secs 2023-05-08T13:27:40.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:39 smithi096 ceph-mon[124666]: pgmap v18720: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 941 KiB/s rd, 939 KiB/s wr, 7 op/s 2023-05-08T13:27:40.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34998.370572 secs 2023-05-08T13:27:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 34998.924442 secs 2023-05-08T13:27:40.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 34998.924442 secs 2023-05-08T13:27:41.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 34998.924442 secs 2023-05-08T13:27:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35000.216767 secs 2023-05-08T13:27:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:41 smithi186 ceph-mon[126480]: pgmap v18721: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 900 KiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T13:27:41.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35000.216767 secs 2023-05-08T13:27:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:41 smithi133 ceph-mon[125939]: pgmap v18721: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 900 KiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T13:27:42.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35000.216767 secs 2023-05-08T13:27:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:41 smithi096 ceph-mon[124666]: pgmap v18721: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 900 KiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T13:27:43.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:43 smithi186 ceph-mon[126480]: pgmap v18722: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 894 KiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T13:27:43.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:43 smithi133 ceph-mon[125939]: pgmap v18722: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 894 KiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T13:27:43.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:43 smithi096 ceph-mon[124666]: pgmap v18722: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 894 KiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T13:27:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35003.370683 secs 2023-05-08T13:27:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35003.370683 secs 2023-05-08T13:27:44.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35003.370683 secs 2023-05-08T13:27:45.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35003.924545 secs 2023-05-08T13:27:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:45 smithi096 ceph-mon[124666]: pgmap v18723: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 517 KiB/s rd, 891 KiB/s wr, 10 op/s 2023-05-08T13:27:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35003.924545 secs 2023-05-08T13:27:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:45 smithi186 ceph-mon[126480]: pgmap v18723: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 517 KiB/s rd, 891 KiB/s wr, 10 op/s 2023-05-08T13:27:45.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35003.924545 secs 2023-05-08T13:27:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:45 smithi133 ceph-mon[125939]: pgmap v18723: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 517 KiB/s rd, 891 KiB/s wr, 10 op/s 2023-05-08T13:27:47.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:47 smithi186 ceph-mon[126480]: pgmap v18724: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 517 KiB/s rd, 891 KiB/s wr, 10 op/s 2023-05-08T13:27:47.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:47 smithi133 ceph-mon[125939]: pgmap v18724: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 517 KiB/s rd, 891 KiB/s wr, 10 op/s 2023-05-08T13:27:48.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:47 smithi096 ceph-mon[124666]: pgmap v18724: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 517 KiB/s rd, 891 KiB/s wr, 10 op/s 2023-05-08T13:27:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:49 smithi186 ceph-mon[126480]: pgmap v18725: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 795 KiB/s wr, 9 op/s 2023-05-08T13:27:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35008.370842 secs 2023-05-08T13:27:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:27:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:49 smithi133 ceph-mon[125939]: pgmap v18725: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 795 KiB/s wr, 9 op/s 2023-05-08T13:27:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35008.370842 secs 2023-05-08T13:27:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:27:50.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:49 smithi096 ceph-mon[124666]: pgmap v18725: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 795 KiB/s wr, 9 op/s 2023-05-08T13:27:50.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35008.370842 secs 2023-05-08T13:27:50.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:27:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35008.924672 secs 2023-05-08T13:27:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:27:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:27:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:27:50.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35008.924672 secs 2023-05-08T13:27:50.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:27:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:27:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:27:51.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35008.924672 secs 2023-05-08T13:27:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:27:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:27:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:27:51.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:51 smithi186 ceph-mon[126480]: pgmap v18726: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 752 KiB/s rd, 748 KiB/s wr, 12 op/s 2023-05-08T13:27:51.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:51 smithi133 ceph-mon[125939]: pgmap v18726: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 752 KiB/s rd, 748 KiB/s wr, 12 op/s 2023-05-08T13:27:52.106 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:51 smithi096 ceph-mon[124666]: pgmap v18726: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 752 KiB/s rd, 748 KiB/s wr, 12 op/s 2023-05-08T13:27:53.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:53 smithi186 ceph-mon[126480]: pgmap v18727: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 320 KiB/s wr, 7 op/s 2023-05-08T13:27:53.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:53 smithi133 ceph-mon[125939]: pgmap v18727: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 320 KiB/s wr, 7 op/s 2023-05-08T13:27:53.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:53 smithi096 ceph-mon[124666]: pgmap v18727: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 320 KiB/s wr, 7 op/s 2023-05-08T13:27:54.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35013.370959 secs 2023-05-08T13:27:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35013.370959 secs 2023-05-08T13:27:54.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35013.370959 secs 2023-05-08T13:27:55.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:55 smithi096 ceph-mon[124666]: pgmap v18728: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 939 KiB/s wr, 12 op/s 2023-05-08T13:27:55.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:55 smithi186 ceph-mon[126480]: pgmap v18728: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 939 KiB/s wr, 12 op/s 2023-05-08T13:27:55.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:55 smithi133 ceph-mon[125939]: pgmap v18728: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 939 KiB/s wr, 12 op/s 2023-05-08T13:27:56.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:27:56.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:27:56.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:27:57.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:57 smithi186 ceph-mon[126480]: pgmap v18729: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 940 KiB/s rd, 625 KiB/s wr, 8 op/s 2023-05-08T13:27:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:27:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:27:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:57 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:27:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:27:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:57 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T13:27:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:57 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T13:27:57.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:57 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:27:57.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:27:57.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:57 smithi133 ceph-mon[125939]: pgmap v18729: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 940 KiB/s rd, 625 KiB/s wr, 8 op/s 2023-05-08T13:27:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:27:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:27:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:57 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:27:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:27:57.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:57 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T13:27:57.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:57 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T13:27:57.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:57 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:27:57.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:27:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:57 smithi096 ceph-mon[124666]: pgmap v18729: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 940 KiB/s rd, 625 KiB/s wr, 8 op/s 2023-05-08T13:27:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:27:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:27:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:57 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:27:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:27:58.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:57 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T13:27:58.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:57 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T13:27:58.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:57 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:27:58.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:27:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:58 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:27:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:27:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:27:58.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:58 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:27:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:27:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:27:59.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:58 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:27:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:27:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:27:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:59 smithi186 ceph-mon[126480]: pgmap v18730: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 940 KiB/s rd, 625 KiB/s wr, 8 op/s 2023-05-08T13:27:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:27:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35018.371085 secs 2023-05-08T13:27:59.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:59 smithi133 ceph-mon[125939]: pgmap v18730: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 940 KiB/s rd, 625 KiB/s wr, 8 op/s 2023-05-08T13:27:59.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:27:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35018.371085 secs 2023-05-08T13:28:00.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:59 smithi096 ceph-mon[124666]: pgmap v18730: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 940 KiB/s rd, 625 KiB/s wr, 8 op/s 2023-05-08T13:28:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:27:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35018.371085 secs 2023-05-08T13:28:01.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35020.217278 secs 2023-05-08T13:28:01.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:01 smithi186 ceph-mon[126480]: pgmap v18731: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T13:28:01.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35020.217278 secs 2023-05-08T13:28:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:01 smithi133 ceph-mon[125939]: pgmap v18731: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T13:28:02.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35020.217278 secs 2023-05-08T13:28:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:01 smithi096 ceph-mon[124666]: pgmap v18731: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T13:28:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:28:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:28:02.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:28:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:28:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:28:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:28:03.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:03 smithi186 ceph-mon[126480]: pgmap v18732: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 824 KiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T13:28:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:03 smithi133 ceph-mon[125939]: pgmap v18732: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 824 KiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T13:28:04.010 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:03 smithi096 ceph-mon[124666]: pgmap v18732: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 824 KiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T13:28:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35023.371198 secs 2023-05-08T13:28:04.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35023.371198 secs 2023-05-08T13:28:05.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35023.371198 secs 2023-05-08T13:28:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35023.925026 secs 2023-05-08T13:28:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:05 smithi186 ceph-mon[126480]: pgmap v18733: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 30 op/s 2023-05-08T13:28:05.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35023.925026 secs 2023-05-08T13:28:05.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:05 smithi133 ceph-mon[125939]: pgmap v18733: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 30 op/s 2023-05-08T13:28:06.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35023.925026 secs 2023-05-08T13:28:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:05 smithi096 ceph-mon[124666]: pgmap v18733: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 30 op/s 2023-05-08T13:28:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:06 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:28:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:28:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:28:06.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:06 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:28:06.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:28:06.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:28:07.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:06 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:28:07.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:28:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:28:07.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:07 smithi186 ceph-mon[126480]: pgmap v18734: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 25 op/s 2023-05-08T13:28:07.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:07 smithi133 ceph-mon[125939]: pgmap v18734: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 25 op/s 2023-05-08T13:28:08.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:07 smithi096 ceph-mon[124666]: pgmap v18734: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 25 op/s 2023-05-08T13:28:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:09 smithi186 ceph-mon[126480]: pgmap v18735: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 25 op/s 2023-05-08T13:28:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35028.371313 secs 2023-05-08T13:28:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:09 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:28:09.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:09 smithi133 ceph-mon[125939]: pgmap v18735: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 25 op/s 2023-05-08T13:28:09.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35028.371313 secs 2023-05-08T13:28:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:09 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:28:10.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:09 smithi096 ceph-mon[124666]: pgmap v18735: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 25 op/s 2023-05-08T13:28:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35028.371313 secs 2023-05-08T13:28:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:09 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:28:10.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:10 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:28:10.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:10 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:28:11.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:10 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:28:11.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:10 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:28:11.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:10 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:28:11.155 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:10 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:28:11.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:11 smithi133 ceph-mon[125939]: pgmap v18736: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 30 op/s 2023-05-08T13:28:11.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:11 smithi133 ceph-mon[125939]: osdmap e1248: 12 total, 12 up, 12 in 2023-05-08T13:28:12.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:11 smithi096 ceph-mon[124666]: pgmap v18736: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 30 op/s 2023-05-08T13:28:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:11 smithi096 ceph-mon[124666]: osdmap e1248: 12 total, 12 up, 12 in 2023-05-08T13:28:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:11 smithi186 ceph-mon[126480]: pgmap v18736: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 30 op/s 2023-05-08T13:28:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:11 smithi186 ceph-mon[126480]: osdmap e1248: 12 total, 12 up, 12 in 2023-05-08T13:28:12.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:12 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:28:13.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:12 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:28:13.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:12 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:28:13.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:13 smithi133 ceph-mon[125939]: pgmap v18738: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 658 KiB/s wr, 29 op/s 2023-05-08T13:28:13.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:13 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:28:14.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:13 smithi096 ceph-mon[124666]: pgmap v18738: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 658 KiB/s wr, 29 op/s 2023-05-08T13:28:14.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:13 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:28:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:13 smithi186 ceph-mon[126480]: pgmap v18738: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 658 KiB/s wr, 29 op/s 2023-05-08T13:28:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:13 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:28:14.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35033.371390 secs 2023-05-08T13:28:14.992 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:14 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:28:14.993 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:14 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:28:15.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35033.371390 secs 2023-05-08T13:28:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:14 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:28:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:14 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:28:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35033.371390 secs 2023-05-08T13:28:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:14 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:28:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:14 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:28:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:15 smithi133 ceph-mon[125939]: pgmap v18739: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1018 KiB/s rd, 917 KiB/s wr, 11 op/s 2023-05-08T13:28:16.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:15 smithi096 ceph-mon[124666]: pgmap v18739: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1018 KiB/s rd, 917 KiB/s wr, 11 op/s 2023-05-08T13:28:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:15 smithi186 ceph-mon[126480]: pgmap v18739: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1018 KiB/s rd, 917 KiB/s wr, 11 op/s 2023-05-08T13:28:17.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:17 smithi133 ceph-mon[125939]: pgmap v18740: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1018 KiB/s rd, 917 KiB/s wr, 11 op/s 2023-05-08T13:28:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:17 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:28:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:17 smithi133 ceph-mon[125939]: osdmap e1249: 12 total, 12 up, 12 in 2023-05-08T13:28:18.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:17 smithi096 ceph-mon[124666]: pgmap v18740: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1018 KiB/s rd, 917 KiB/s wr, 11 op/s 2023-05-08T13:28:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:17 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:28:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:17 smithi096 ceph-mon[124666]: osdmap e1249: 12 total, 12 up, 12 in 2023-05-08T13:28:18.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:17 smithi186 ceph-mon[126480]: pgmap v18740: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1018 KiB/s rd, 917 KiB/s wr, 11 op/s 2023-05-08T13:28:18.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:17 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:28:18.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:17 smithi186 ceph-mon[126480]: osdmap e1249: 12 total, 12 up, 12 in 2023-05-08T13:28:19.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:19 smithi133 ceph-mon[125939]: pgmap v18742: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 968 KiB/s wr, 6 op/s 2023-05-08T13:28:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35038.371514 secs 2023-05-08T13:28:20.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:19 smithi096 ceph-mon[124666]: pgmap v18742: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 968 KiB/s wr, 6 op/s 2023-05-08T13:28:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35038.371514 secs 2023-05-08T13:28:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:19 smithi186 ceph-mon[126480]: pgmap v18742: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 968 KiB/s wr, 6 op/s 2023-05-08T13:28:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35038.371514 secs 2023-05-08T13:28:21.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:21 smithi133 ceph-mon[125939]: pgmap v18743: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 926 KiB/s rd, 812 KiB/s wr, 9 op/s 2023-05-08T13:28:22.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:21 smithi096 ceph-mon[124666]: pgmap v18743: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 926 KiB/s rd, 812 KiB/s wr, 9 op/s 2023-05-08T13:28:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:21 smithi186 ceph-mon[126480]: pgmap v18743: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 926 KiB/s rd, 812 KiB/s wr, 9 op/s 2023-05-08T13:28:23.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:23 smithi186 ceph-mon[126480]: pgmap v18744: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 917 KiB/s rd, 804 KiB/s wr, 9 op/s 2023-05-08T13:28:23.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:23 smithi133 ceph-mon[125939]: pgmap v18744: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 917 KiB/s rd, 804 KiB/s wr, 9 op/s 2023-05-08T13:28:23.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:23 smithi096 ceph-mon[124666]: pgmap v18744: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 917 KiB/s rd, 804 KiB/s wr, 9 op/s 2023-05-08T13:28:24.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35043.371628 secs 2023-05-08T13:28:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35043.371628 secs 2023-05-08T13:28:24.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35043.371628 secs 2023-05-08T13:28:25.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35043.925510 secs 2023-05-08T13:28:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:25 smithi096 ceph-mon[124666]: pgmap v18745: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 819 KiB/s wr, 9 op/s 2023-05-08T13:28:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35043.925510 secs 2023-05-08T13:28:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:25 smithi186 ceph-mon[126480]: pgmap v18745: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 819 KiB/s wr, 9 op/s 2023-05-08T13:28:25.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35043.925510 secs 2023-05-08T13:28:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:25 smithi133 ceph-mon[125939]: pgmap v18745: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 819 KiB/s wr, 9 op/s 2023-05-08T13:28:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:26 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:28:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:26 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:28:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:26 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:28:26.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:26 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:28:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:26 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:28:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:26 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:28:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:26 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:28:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:26 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:28:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:26 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:28:27.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:27 smithi186 ceph-mon[126480]: pgmap v18746: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 819 KiB/s wr, 9 op/s 2023-05-08T13:28:27.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:27 smithi133 ceph-mon[125939]: pgmap v18746: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 819 KiB/s wr, 9 op/s 2023-05-08T13:28:28.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:27 smithi096 ceph-mon[124666]: pgmap v18746: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 819 KiB/s wr, 9 op/s 2023-05-08T13:28:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:29 smithi186 ceph-mon[126480]: pgmap v18747: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 730 KiB/s wr, 8 op/s 2023-05-08T13:28:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35048.371727 secs 2023-05-08T13:28:29.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:29 smithi133 ceph-mon[125939]: pgmap v18747: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 730 KiB/s wr, 8 op/s 2023-05-08T13:28:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35048.371727 secs 2023-05-08T13:28:30.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:29 smithi096 ceph-mon[124666]: pgmap v18747: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 730 KiB/s wr, 8 op/s 2023-05-08T13:28:30.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35048.371727 secs 2023-05-08T13:28:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35048.925607 secs 2023-05-08T13:28:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35048.925607 secs 2023-05-08T13:28:31.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35048.925607 secs 2023-05-08T13:28:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:31 smithi186 ceph-mon[126480]: pgmap v18748: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 966 KiB/s rd, 1.0 MiB/s wr, 13 op/s 2023-05-08T13:28:31.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:31 smithi133 ceph-mon[125939]: pgmap v18748: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 966 KiB/s rd, 1.0 MiB/s wr, 13 op/s 2023-05-08T13:28:32.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:31 smithi096 ceph-mon[124666]: pgmap v18748: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 966 KiB/s rd, 1.0 MiB/s wr, 13 op/s 2023-05-08T13:28:33.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:33 smithi186 ceph-mon[126480]: pgmap v18749: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 655 KiB/s rd, 1022 KiB/s wr, 9 op/s 2023-05-08T13:28:33.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:33 smithi133 ceph-mon[125939]: pgmap v18749: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 655 KiB/s rd, 1022 KiB/s wr, 9 op/s 2023-05-08T13:28:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:33 smithi096 ceph-mon[124666]: pgmap v18749: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 655 KiB/s rd, 1022 KiB/s wr, 9 op/s 2023-05-08T13:28:34.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35053.371853 secs 2023-05-08T13:28:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35053.371853 secs 2023-05-08T13:28:34.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35053.371853 secs 2023-05-08T13:28:35.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35053.925675 secs 2023-05-08T13:28:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:35 smithi096 ceph-mon[124666]: pgmap v18750: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T13:28:35.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35053.925675 secs 2023-05-08T13:28:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:35 smithi186 ceph-mon[126480]: pgmap v18750: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T13:28:35.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35053.925675 secs 2023-05-08T13:28:36.078 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:35 smithi133 ceph-mon[125939]: pgmap v18750: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T13:28:36.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35055.218168 secs 2023-05-08T13:28:36.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35055.218168 secs 2023-05-08T13:28:37.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35055.218168 secs 2023-05-08T13:28:37.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:37 smithi186 ceph-mon[126480]: pgmap v18751: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 481 KiB/s wr, 10 op/s 2023-05-08T13:28:37.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:37 smithi133 ceph-mon[125939]: pgmap v18751: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 481 KiB/s wr, 10 op/s 2023-05-08T13:28:38.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:37 smithi096 ceph-mon[124666]: pgmap v18751: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 481 KiB/s wr, 10 op/s 2023-05-08T13:28:38.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:38 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:28:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:38 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:28:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:38 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:28:38.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:38 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:28:38.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:38 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:28:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:38 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:28:39.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:38 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:28:39.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:38 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:28:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:38 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:28:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:39 smithi186 ceph-mon[126480]: pgmap v18752: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 481 KiB/s wr, 10 op/s 2023-05-08T13:28:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35058.371970 secs 2023-05-08T13:28:39.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:39 smithi133 ceph-mon[125939]: pgmap v18752: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 481 KiB/s wr, 10 op/s 2023-05-08T13:28:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35058.371970 secs 2023-05-08T13:28:40.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:39 smithi096 ceph-mon[124666]: pgmap v18752: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 481 KiB/s wr, 10 op/s 2023-05-08T13:28:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35058.371970 secs 2023-05-08T13:28:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35058.925807 secs 2023-05-08T13:28:40.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35058.925807 secs 2023-05-08T13:28:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35058.925807 secs 2023-05-08T13:28:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35060.218296 secs 2023-05-08T13:28:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:41 smithi186 ceph-mon[126480]: pgmap v18753: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 625 KiB/s wr, 13 op/s 2023-05-08T13:28:41.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35060.218296 secs 2023-05-08T13:28:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:41 smithi133 ceph-mon[125939]: pgmap v18753: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 625 KiB/s wr, 13 op/s 2023-05-08T13:28:42.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35060.218296 secs 2023-05-08T13:28:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:41 smithi096 ceph-mon[124666]: pgmap v18753: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 625 KiB/s wr, 13 op/s 2023-05-08T13:28:43.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:43 smithi186 ceph-mon[126480]: pgmap v18754: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 626 KiB/s rd, 261 KiB/s wr, 8 op/s 2023-05-08T13:28:43.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:43 smithi133 ceph-mon[125939]: pgmap v18754: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 626 KiB/s rd, 261 KiB/s wr, 8 op/s 2023-05-08T13:28:43.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:43 smithi096 ceph-mon[124666]: pgmap v18754: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 626 KiB/s rd, 261 KiB/s wr, 8 op/s 2023-05-08T13:28:44.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35063.372089 secs 2023-05-08T13:28:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35063.372089 secs 2023-05-08T13:28:44.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35063.372089 secs 2023-05-08T13:28:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35063.925947 secs 2023-05-08T13:28:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:45 smithi186 ceph-mon[126480]: pgmap v18755: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 772 KiB/s rd, 435 KiB/s wr, 11 op/s 2023-05-08T13:28:45.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35063.925947 secs 2023-05-08T13:28:45.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:45 smithi133 ceph-mon[125939]: pgmap v18755: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 772 KiB/s rd, 435 KiB/s wr, 11 op/s 2023-05-08T13:28:46.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35063.925947 secs 2023-05-08T13:28:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:45 smithi096 ceph-mon[124666]: pgmap v18755: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 772 KiB/s rd, 435 KiB/s wr, 11 op/s 2023-05-08T13:28:47.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:47 smithi186 ceph-mon[126480]: pgmap v18756: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 291 KiB/s rd, 318 KiB/s wr, 6 op/s 2023-05-08T13:28:47.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:47 smithi133 ceph-mon[125939]: pgmap v18756: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 291 KiB/s rd, 318 KiB/s wr, 6 op/s 2023-05-08T13:28:48.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:47 smithi096 ceph-mon[124666]: pgmap v18756: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 291 KiB/s rd, 318 KiB/s wr, 6 op/s 2023-05-08T13:28:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:49 smithi186 ceph-mon[126480]: pgmap v18757: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 291 KiB/s rd, 318 KiB/s wr, 6 op/s 2023-05-08T13:28:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35068.372212 secs 2023-05-08T13:28:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:28:49.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:49 smithi133 ceph-mon[125939]: pgmap v18757: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 291 KiB/s rd, 318 KiB/s wr, 6 op/s 2023-05-08T13:28:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35068.372212 secs 2023-05-08T13:28:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:28:50.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:49 smithi096 ceph-mon[124666]: pgmap v18757: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 291 KiB/s rd, 318 KiB/s wr, 6 op/s 2023-05-08T13:28:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35068.372212 secs 2023-05-08T13:28:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:28:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:28:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:28:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:28:50.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:28:50.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:28:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:28:51.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:28:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:28:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:28:51.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:51 smithi186 ceph-mon[126480]: pgmap v18758: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 919 KiB/s rd, 1.0 MiB/s wr, 13 op/s 2023-05-08T13:28:51.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:51 smithi133 ceph-mon[125939]: pgmap v18758: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 919 KiB/s rd, 1.0 MiB/s wr, 13 op/s 2023-05-08T13:28:52.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:51 smithi096 ceph-mon[124666]: pgmap v18758: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 919 KiB/s rd, 1.0 MiB/s wr, 13 op/s 2023-05-08T13:28:53.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:53 smithi186 ceph-mon[126480]: pgmap v18759: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 774 KiB/s rd, 914 KiB/s wr, 9 op/s 2023-05-08T13:28:53.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:53 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:28:53.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:53 smithi133 ceph-mon[125939]: pgmap v18759: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 774 KiB/s rd, 914 KiB/s wr, 9 op/s 2023-05-08T13:28:53.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:53 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:28:53.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:53 smithi096 ceph-mon[124666]: pgmap v18759: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 774 KiB/s rd, 914 KiB/s wr, 9 op/s 2023-05-08T13:28:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:53 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:28:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:54 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:28:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:54 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:28:54.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:54 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:28:54.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:54 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:28:54.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:54 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:28:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:54 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:28:55.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35073.372330 secs 2023-05-08T13:28:55.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35073.926160 secs 2023-05-08T13:28:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:55 smithi186 ceph-mon[126480]: pgmap v18760: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 15 op/s 2023-05-08T13:28:55.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35073.372330 secs 2023-05-08T13:28:55.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35073.926160 secs 2023-05-08T13:28:55.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:55 smithi133 ceph-mon[125939]: pgmap v18760: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 15 op/s 2023-05-08T13:28:55.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35073.372330 secs 2023-05-08T13:28:55.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35073.926160 secs 2023-05-08T13:28:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:55 smithi096 ceph-mon[124666]: pgmap v18760: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 15 op/s 2023-05-08T13:28:56.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35075.218722 secs 2023-05-08T13:28:56.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35075.218722 secs 2023-05-08T13:28:56.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35075.218722 secs 2023-05-08T13:28:57.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:28:57.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:57 smithi186 ceph-mon[126480]: pgmap v18761: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2023-05-08T13:28:57.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:28:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:28:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:28:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:28:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:28:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:57 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:28:57.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:28:57.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:57 smithi133 ceph-mon[125939]: pgmap v18761: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2023-05-08T13:28:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:28:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:28:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:28:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:28:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:28:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:57 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:28:57.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:28:57.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:57 smithi096 ceph-mon[124666]: pgmap v18761: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2023-05-08T13:28:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:28:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:28:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:28:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:28:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:28:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:57 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:28:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:28:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:28:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:28:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:28:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:28:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:28:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:28:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:58 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:28:58.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:28:58.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:58 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T13:28:58.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:58 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T13:28:58.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:58 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:28:58.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:28:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:28:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:28:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:28:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:28:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:28:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:28:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:58 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:28:58.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:28:58.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:58 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T13:28:58.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:58 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T13:28:58.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:58 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:28:58.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:28:58.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:28:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:28:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:28:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:28:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:28:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:28:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:58 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:28:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:28:58.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:58 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T13:28:58.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:58 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T13:28:58.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:58 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:28:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:28:59 smithi186 ceph-mon[126480]: pgmap v18762: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2023-05-08T13:28:59.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:28:59 smithi133 ceph-mon[125939]: pgmap v18762: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2023-05-08T13:28:59.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:28:59 smithi096 ceph-mon[124666]: pgmap v18762: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2023-05-08T13:29:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35078.372416 secs 2023-05-08T13:29:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35078.926295 secs 2023-05-08T13:29:00.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35078.372416 secs 2023-05-08T13:29:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35078.926295 secs 2023-05-08T13:29:00.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35078.372416 secs 2023-05-08T13:29:00.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35078.926295 secs 2023-05-08T13:29:01.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:01 smithi186 ceph-mon[126480]: pgmap v18763: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 20 op/s 2023-05-08T13:29:01.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:01 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:29:01.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:01 smithi133 ceph-mon[125939]: pgmap v18763: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 20 op/s 2023-05-08T13:29:01.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:01 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:29:01.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:01 smithi096 ceph-mon[124666]: pgmap v18763: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 20 op/s 2023-05-08T13:29:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:01 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:29:02.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:29:02.768 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:29:02.769 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:02 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:29:02.769 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:29:02.770 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:29:02.770 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:02 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:29:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:29:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:29:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:02 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:29:03.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:03 smithi133 ceph-mon[125939]: pgmap v18764: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2023-05-08T13:29:03.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:03 smithi096 ceph-mon[124666]: pgmap v18764: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2023-05-08T13:29:03.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:03 smithi186 ceph-mon[126480]: pgmap v18764: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2023-05-08T13:29:04.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35083.372540 secs 2023-05-08T13:29:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35083.372540 secs 2023-05-08T13:29:04.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35083.372540 secs 2023-05-08T13:29:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35083.926415 secs 2023-05-08T13:29:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:05 smithi186 ceph-mon[126480]: pgmap v18765: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 34 op/s 2023-05-08T13:29:05.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35083.926415 secs 2023-05-08T13:29:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:05 smithi133 ceph-mon[125939]: pgmap v18765: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 34 op/s 2023-05-08T13:29:06.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35083.926415 secs 2023-05-08T13:29:06.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:05 smithi096 ceph-mon[124666]: pgmap v18765: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 34 op/s 2023-05-08T13:29:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:06 smithi186 ceph-mon[126480]: osdmap e1250: 12 total, 12 up, 12 in 2023-05-08T13:29:06.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:06 smithi133 ceph-mon[125939]: osdmap e1250: 12 total, 12 up, 12 in 2023-05-08T13:29:07.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:06 smithi096 ceph-mon[124666]: osdmap e1250: 12 total, 12 up, 12 in 2023-05-08T13:29:07.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:07 smithi186 ceph-mon[126480]: pgmap v18767: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 33 op/s 2023-05-08T13:29:07.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:07 smithi133 ceph-mon[125939]: pgmap v18767: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 33 op/s 2023-05-08T13:29:08.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:07 smithi096 ceph-mon[124666]: pgmap v18767: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 33 op/s 2023-05-08T13:29:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:09 smithi186 ceph-mon[126480]: pgmap v18768: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 33 op/s 2023-05-08T13:29:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35088.372616 secs 2023-05-08T13:29:09.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:09 smithi133 ceph-mon[125939]: pgmap v18768: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 33 op/s 2023-05-08T13:29:09.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35088.372616 secs 2023-05-08T13:29:10.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:09 smithi096 ceph-mon[124666]: pgmap v18768: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 33 op/s 2023-05-08T13:29:10.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35088.372616 secs 2023-05-08T13:29:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35088.926569 secs 2023-05-08T13:29:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:10 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:29:10.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35088.926569 secs 2023-05-08T13:29:10.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:10 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:29:11.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35088.926569 secs 2023-05-08T13:29:11.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:10 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:29:11.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35090.219128 secs 2023-05-08T13:29:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:11 smithi186 ceph-mon[126480]: pgmap v18769: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.0 MiB/s wr, 33 op/s 2023-05-08T13:29:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:11 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:29:11.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35090.219128 secs 2023-05-08T13:29:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:11 smithi133 ceph-mon[125939]: pgmap v18769: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.0 MiB/s wr, 33 op/s 2023-05-08T13:29:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:11 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:29:12.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35090.219128 secs 2023-05-08T13:29:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:11 smithi096 ceph-mon[124666]: pgmap v18769: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.0 MiB/s wr, 33 op/s 2023-05-08T13:29:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:11 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:29:13.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:13 smithi186 ceph-mon[126480]: osdmap e1251: 12 total, 12 up, 12 in 2023-05-08T13:29:13.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:13 smithi186 ceph-mon[126480]: pgmap v18771: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 10 op/s 2023-05-08T13:29:13.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:13 smithi133 ceph-mon[125939]: osdmap e1251: 12 total, 12 up, 12 in 2023-05-08T13:29:13.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:13 smithi133 ceph-mon[125939]: pgmap v18771: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 10 op/s 2023-05-08T13:29:13.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:13 smithi096 ceph-mon[124666]: osdmap e1251: 12 total, 12 up, 12 in 2023-05-08T13:29:13.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:13 smithi096 ceph-mon[124666]: pgmap v18771: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 10 op/s 2023-05-08T13:29:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:14 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:29:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:14 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:29:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:14 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:29:14.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:14 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:29:14.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:14 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:29:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:14 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:29:14.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:14 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:29:14.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:14 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:29:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:14 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:29:15.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35093.372735 secs 2023-05-08T13:29:15.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:15 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:29:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:15 smithi186 ceph-mon[126480]: pgmap v18772: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.6 MiB/s wr, 20 op/s 2023-05-08T13:29:15.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35093.372735 secs 2023-05-08T13:29:15.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:15 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:29:15.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:15 smithi133 ceph-mon[125939]: pgmap v18772: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.6 MiB/s wr, 20 op/s 2023-05-08T13:29:15.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35093.372735 secs 2023-05-08T13:29:15.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:15 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:29:15.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:15 smithi096 ceph-mon[124666]: pgmap v18772: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.6 MiB/s wr, 20 op/s 2023-05-08T13:29:16.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35095.219261 secs 2023-05-08T13:29:16.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35095.219261 secs 2023-05-08T13:29:16.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35095.219261 secs 2023-05-08T13:29:17.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:17 smithi186 ceph-mon[126480]: pgmap v18773: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.2 MiB/s wr, 18 op/s 2023-05-08T13:29:17.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:17 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:29:17.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:17 smithi133 ceph-mon[125939]: pgmap v18773: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.2 MiB/s wr, 18 op/s 2023-05-08T13:29:17.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:17 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:29:17.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:17 smithi096 ceph-mon[124666]: pgmap v18773: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.2 MiB/s wr, 18 op/s 2023-05-08T13:29:17.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:17 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:29:18.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:18 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:29:18.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:18 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:29:18.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:18 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:29:18.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:18 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:29:18.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:18 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:29:18.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:18 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:29:19.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:19 smithi133 ceph-mon[125939]: pgmap v18774: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.2 MiB/s wr, 18 op/s 2023-05-08T13:29:19.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:19 smithi096 ceph-mon[124666]: pgmap v18774: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.2 MiB/s wr, 18 op/s 2023-05-08T13:29:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:19 smithi186 ceph-mon[126480]: pgmap v18774: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.2 MiB/s wr, 18 op/s 2023-05-08T13:29:20.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35098.372857 secs 2023-05-08T13:29:20.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35098.926737 secs 2023-05-08T13:29:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:20 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:29:20.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35098.372857 secs 2023-05-08T13:29:20.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35098.926737 secs 2023-05-08T13:29:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:20 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:29:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35098.372857 secs 2023-05-08T13:29:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35098.926737 secs 2023-05-08T13:29:20.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:20 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:29:21.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35100.219403 secs 2023-05-08T13:29:21.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:21 smithi133 ceph-mon[125939]: pgmap v18775: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 16 op/s 2023-05-08T13:29:21.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35100.219403 secs 2023-05-08T13:29:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:21 smithi096 ceph-mon[124666]: pgmap v18775: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 16 op/s 2023-05-08T13:29:21.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35100.219403 secs 2023-05-08T13:29:21.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:21 smithi186 ceph-mon[126480]: pgmap v18775: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 16 op/s 2023-05-08T13:29:22.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:22 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:29:22.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:22 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:29:22.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:22 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:29:22.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:22 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:29:22.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:22 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:29:22.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:22 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:29:22.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:22 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:29:22.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:22 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:29:22.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:22 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:29:23.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:23 smithi133 ceph-mon[125939]: pgmap v18776: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 16 op/s 2023-05-08T13:29:23.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:23 smithi096 ceph-mon[124666]: pgmap v18776: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 16 op/s 2023-05-08T13:29:23.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:23 smithi186 ceph-mon[126480]: pgmap v18776: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 16 op/s 2023-05-08T13:29:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35103.372974 secs 2023-05-08T13:29:24.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35103.372974 secs 2023-05-08T13:29:25.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35103.372974 secs 2023-05-08T13:29:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35103.926862 secs 2023-05-08T13:29:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:25 smithi186 ceph-mon[126480]: pgmap v18777: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 17 op/s 2023-05-08T13:29:25.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35103.926862 secs 2023-05-08T13:29:25.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:25 smithi133 ceph-mon[125939]: pgmap v18777: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 17 op/s 2023-05-08T13:29:26.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35103.926862 secs 2023-05-08T13:29:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:25 smithi096 ceph-mon[124666]: pgmap v18777: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 17 op/s 2023-05-08T13:29:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35105.219527 secs 2023-05-08T13:29:26.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35105.219527 secs 2023-05-08T13:29:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35105.219527 secs 2023-05-08T13:29:27.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:27 smithi186 ceph-mon[126480]: pgmap v18778: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 327 KiB/s wr, 8 op/s 2023-05-08T13:29:27.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:27 smithi133 ceph-mon[125939]: pgmap v18778: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 327 KiB/s wr, 8 op/s 2023-05-08T13:29:28.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:27 smithi096 ceph-mon[124666]: pgmap v18778: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 327 KiB/s wr, 8 op/s 2023-05-08T13:29:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:29 smithi186 ceph-mon[126480]: pgmap v18779: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 327 KiB/s wr, 8 op/s 2023-05-08T13:29:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35108.373112 secs 2023-05-08T13:29:29.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:29 smithi133 ceph-mon[125939]: pgmap v18779: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 327 KiB/s wr, 8 op/s 2023-05-08T13:29:29.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35108.373112 secs 2023-05-08T13:29:30.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:29 smithi096 ceph-mon[124666]: pgmap v18779: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 327 KiB/s wr, 8 op/s 2023-05-08T13:29:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35108.373112 secs 2023-05-08T13:29:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35108.926989 secs 2023-05-08T13:29:30.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35108.926989 secs 2023-05-08T13:29:31.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35108.926989 secs 2023-05-08T13:29:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35110.219657 secs 2023-05-08T13:29:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:31 smithi186 ceph-mon[126480]: pgmap v18780: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 353 KiB/s rd, 351 KiB/s wr, 12 op/s 2023-05-08T13:29:31.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35110.219657 secs 2023-05-08T13:29:31.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:31 smithi133 ceph-mon[125939]: pgmap v18780: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 353 KiB/s rd, 351 KiB/s wr, 12 op/s 2023-05-08T13:29:32.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35110.219657 secs 2023-05-08T13:29:32.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:31 smithi096 ceph-mon[124666]: pgmap v18780: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 353 KiB/s rd, 351 KiB/s wr, 12 op/s 2023-05-08T13:29:33.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:33 smithi186 ceph-mon[126480]: pgmap v18781: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 24 KiB/s wr, 6 op/s 2023-05-08T13:29:33.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:33 smithi133 ceph-mon[125939]: pgmap v18781: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 24 KiB/s wr, 6 op/s 2023-05-08T13:29:33.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:33 smithi096 ceph-mon[124666]: pgmap v18781: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 24 KiB/s wr, 6 op/s 2023-05-08T13:29:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35113.373230 secs 2023-05-08T13:29:34.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35113.373230 secs 2023-05-08T13:29:35.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35113.373230 secs 2023-05-08T13:29:35.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35113.927103 secs 2023-05-08T13:29:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:35 smithi186 ceph-mon[126480]: pgmap v18782: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 170 KiB/s wr, 10 op/s 2023-05-08T13:29:35.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35113.927103 secs 2023-05-08T13:29:35.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:35 smithi133 ceph-mon[125939]: pgmap v18782: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 170 KiB/s wr, 10 op/s 2023-05-08T13:29:36.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35113.927103 secs 2023-05-08T13:29:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:35 smithi096 ceph-mon[124666]: pgmap v18782: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 170 KiB/s wr, 10 op/s 2023-05-08T13:29:36.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35115.219837 secs 2023-05-08T13:29:36.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35115.219837 secs 2023-05-08T13:29:37.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35115.219837 secs 2023-05-08T13:29:37.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:37 smithi186 ceph-mon[126480]: pgmap v18783: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 169 KiB/s wr, 7 op/s 2023-05-08T13:29:37.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:37 smithi133 ceph-mon[125939]: pgmap v18783: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 169 KiB/s wr, 7 op/s 2023-05-08T13:29:38.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:37 smithi096 ceph-mon[124666]: pgmap v18783: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 169 KiB/s wr, 7 op/s 2023-05-08T13:29:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:39 smithi186 ceph-mon[126480]: pgmap v18784: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 169 KiB/s wr, 7 op/s 2023-05-08T13:29:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35118.373365 secs 2023-05-08T13:29:39.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:39 smithi133 ceph-mon[125939]: pgmap v18784: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 169 KiB/s wr, 7 op/s 2023-05-08T13:29:39.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35118.373365 secs 2023-05-08T13:29:40.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:39 smithi096 ceph-mon[124666]: pgmap v18784: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 169 KiB/s wr, 7 op/s 2023-05-08T13:29:40.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35118.373365 secs 2023-05-08T13:29:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35118.927240 secs 2023-05-08T13:29:40.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35118.927240 secs 2023-05-08T13:29:41.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35118.927240 secs 2023-05-08T13:29:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35120.219968 secs 2023-05-08T13:29:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:41 smithi186 ceph-mon[126480]: pgmap v18785: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 170 KiB/s wr, 11 op/s 2023-05-08T13:29:41.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35120.219968 secs 2023-05-08T13:29:41.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:41 smithi133 ceph-mon[125939]: pgmap v18785: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 170 KiB/s wr, 11 op/s 2023-05-08T13:29:42.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35120.219968 secs 2023-05-08T13:29:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:41 smithi096 ceph-mon[124666]: pgmap v18785: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 170 KiB/s wr, 11 op/s 2023-05-08T13:29:43.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:43 smithi186 ceph-mon[126480]: pgmap v18786: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 146 KiB/s wr, 7 op/s 2023-05-08T13:29:43.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:43 smithi133 ceph-mon[125939]: pgmap v18786: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 146 KiB/s wr, 7 op/s 2023-05-08T13:29:43.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:43 smithi096 ceph-mon[124666]: pgmap v18786: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 146 KiB/s wr, 7 op/s 2023-05-08T13:29:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35123.373434 secs 2023-05-08T13:29:44.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35123.373434 secs 2023-05-08T13:29:45.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35123.373434 secs 2023-05-08T13:29:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35123.927358 secs 2023-05-08T13:29:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:45 smithi186 ceph-mon[126480]: pgmap v18787: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 436 KiB/s wr, 11 op/s 2023-05-08T13:29:45.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35123.927358 secs 2023-05-08T13:29:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:45 smithi133 ceph-mon[125939]: pgmap v18787: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 436 KiB/s wr, 11 op/s 2023-05-08T13:29:46.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35123.927358 secs 2023-05-08T13:29:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:45 smithi096 ceph-mon[124666]: pgmap v18787: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 436 KiB/s wr, 11 op/s 2023-05-08T13:29:47.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:47 smithi186 ceph-mon[126480]: pgmap v18788: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 292 KiB/s rd, 290 KiB/s wr, 6 op/s 2023-05-08T13:29:47.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:47 smithi133 ceph-mon[125939]: pgmap v18788: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 292 KiB/s rd, 290 KiB/s wr, 6 op/s 2023-05-08T13:29:48.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:47 smithi096 ceph-mon[124666]: pgmap v18788: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 292 KiB/s rd, 290 KiB/s wr, 6 op/s 2023-05-08T13:29:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:49 smithi186 ceph-mon[126480]: pgmap v18789: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 292 KiB/s rd, 290 KiB/s wr, 6 op/s 2023-05-08T13:29:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35128.373552 secs 2023-05-08T13:29:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:29:49.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:49 smithi133 ceph-mon[125939]: pgmap v18789: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 292 KiB/s rd, 290 KiB/s wr, 6 op/s 2023-05-08T13:29:49.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35128.373552 secs 2023-05-08T13:29:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:29:50.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:49 smithi096 ceph-mon[124666]: pgmap v18789: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 292 KiB/s rd, 290 KiB/s wr, 6 op/s 2023-05-08T13:29:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35128.373552 secs 2023-05-08T13:29:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:29:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:29:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:29:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:29:50.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:29:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:29:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:29:51.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:29:51.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:29:51.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:29:51.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:51 smithi133 ceph-mon[125939]: pgmap v18790: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 991 KiB/s wr, 11 op/s 2023-05-08T13:29:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:51 smithi096 ceph-mon[124666]: pgmap v18790: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 991 KiB/s wr, 11 op/s 2023-05-08T13:29:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:51 smithi186 ceph-mon[126480]: pgmap v18790: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 991 KiB/s wr, 11 op/s 2023-05-08T13:29:53.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:53 smithi186 ceph-mon[126480]: pgmap v18791: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 991 KiB/s wr, 7 op/s 2023-05-08T13:29:53.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:53 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:29:53.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:53 smithi133 ceph-mon[125939]: pgmap v18791: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 991 KiB/s wr, 7 op/s 2023-05-08T13:29:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:53 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:29:53.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:53 smithi096 ceph-mon[124666]: pgmap v18791: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 991 KiB/s wr, 7 op/s 2023-05-08T13:29:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:53 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:29:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:54 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:29:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:54 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:29:54.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:54 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:29:54.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:54 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:29:54.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:54 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:29:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:54 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:29:55.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35133.373675 secs 2023-05-08T13:29:55.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:55 smithi186 ceph-mon[126480]: pgmap v18792: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 14 op/s 2023-05-08T13:29:55.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35133.373675 secs 2023-05-08T13:29:55.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:55 smithi133 ceph-mon[125939]: pgmap v18792: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 14 op/s 2023-05-08T13:29:55.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35133.373675 secs 2023-05-08T13:29:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:55 smithi096 ceph-mon[124666]: pgmap v18792: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 14 op/s 2023-05-08T13:29:57.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:57 smithi186 ceph-mon[126480]: pgmap v18793: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 11 op/s 2023-05-08T13:29:57.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:57 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:29:57.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:57 smithi133 ceph-mon[125939]: pgmap v18793: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 11 op/s 2023-05-08T13:29:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:57 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:29:58.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:57 smithi096 ceph-mon[124666]: pgmap v18793: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 11 op/s 2023-05-08T13:29:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:57 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:29:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:29:58.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:29:59.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:29:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:59 smithi186 ceph-mon[126480]: pgmap v18794: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 11 op/s 2023-05-08T13:29:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35138.373806 secs 2023-05-08T13:29:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:29:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:29:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:59 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:29:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:29:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:59 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T13:29:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:59 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T13:29:59.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:29:59 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:29:59.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:59 smithi133 ceph-mon[125939]: pgmap v18794: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 11 op/s 2023-05-08T13:29:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35138.373806 secs 2023-05-08T13:29:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:29:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:29:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:59 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:29:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:29:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:59 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T13:29:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:59 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T13:29:59.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:29:59 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:30:00.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:59 smithi096 ceph-mon[124666]: pgmap v18794: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 11 op/s 2023-05-08T13:30:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35138.373806 secs 2023-05-08T13:30:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:30:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:30:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:59 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:30:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:30:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:59 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T13:30:00.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:59 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T13:30:00.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:29:59 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:30:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35138.927768 secs 2023-05-08T13:30:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:00 smithi186 ceph-mon[126480]: overall HEALTH_WARN 1 MDSs report slow requests 2023-05-08T13:30:00.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35138.927768 secs 2023-05-08T13:30:00.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:00 smithi133 ceph-mon[125939]: overall HEALTH_WARN 1 MDSs report slow requests 2023-05-08T13:30:01.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35138.927768 secs 2023-05-08T13:30:01.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:00 smithi096 ceph-mon[124666]: overall HEALTH_WARN 1 MDSs report slow requests 2023-05-08T13:30:01.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:01 smithi133 ceph-mon[125939]: pgmap v18795: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 17 op/s 2023-05-08T13:30:02.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:01 smithi096 ceph-mon[124666]: pgmap v18795: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 17 op/s 2023-05-08T13:30:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:01 smithi186 ceph-mon[126480]: pgmap v18795: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 17 op/s 2023-05-08T13:30:02.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:30:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:30:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:02 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:30:03.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:30:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:30:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:02 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:30:03.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:30:03.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:30:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:02 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:30:03.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:03 smithi133 ceph-mon[125939]: pgmap v18796: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 13 op/s 2023-05-08T13:30:04.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:03 smithi096 ceph-mon[124666]: pgmap v18796: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 13 op/s 2023-05-08T13:30:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:03 smithi186 ceph-mon[126480]: pgmap v18796: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 13 op/s 2023-05-08T13:30:04.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35143.373888 secs 2023-05-08T13:30:05.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35143.373888 secs 2023-05-08T13:30:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35143.373888 secs 2023-05-08T13:30:05.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35143.927886 secs 2023-05-08T13:30:05.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:05 smithi133 ceph-mon[125939]: pgmap v18797: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.3 MiB/s wr, 33 op/s 2023-05-08T13:30:06.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35143.927886 secs 2023-05-08T13:30:06.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:05 smithi096 ceph-mon[124666]: pgmap v18797: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.3 MiB/s wr, 33 op/s 2023-05-08T13:30:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35143.927886 secs 2023-05-08T13:30:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:05 smithi186 ceph-mon[126480]: pgmap v18797: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.3 MiB/s wr, 33 op/s 2023-05-08T13:30:06.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35145.220620 secs 2023-05-08T13:30:07.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35145.220620 secs 2023-05-08T13:30:07.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35145.220620 secs 2023-05-08T13:30:07.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:07 smithi133 ceph-mon[125939]: pgmap v18798: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.3 MiB/s wr, 27 op/s 2023-05-08T13:30:08.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:07 smithi096 ceph-mon[124666]: pgmap v18798: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.3 MiB/s wr, 27 op/s 2023-05-08T13:30:08.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:07 smithi186 ceph-mon[126480]: pgmap v18798: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.3 MiB/s wr, 27 op/s 2023-05-08T13:30:09.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:09 smithi133 ceph-mon[125939]: pgmap v18799: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.3 MiB/s wr, 26 op/s 2023-05-08T13:30:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35148.374004 secs 2023-05-08T13:30:10.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:09 smithi096 ceph-mon[124666]: pgmap v18799: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.3 MiB/s wr, 26 op/s 2023-05-08T13:30:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35148.374004 secs 2023-05-08T13:30:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:09 smithi186 ceph-mon[126480]: pgmap v18799: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.3 MiB/s wr, 26 op/s 2023-05-08T13:30:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35148.374004 secs 2023-05-08T13:30:10.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35148.928001 secs 2023-05-08T13:30:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:10 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:30:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:10 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:30:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:10 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:30:11.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35148.928001 secs 2023-05-08T13:30:11.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:10 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:30:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:10 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:30:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:10 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:30:11.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35148.928001 secs 2023-05-08T13:30:11.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:10 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:30:11.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:10 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:30:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:10 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:30:11.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35150.220738 secs 2023-05-08T13:30:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:11 smithi133 ceph-mon[125939]: pgmap v18800: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 30 op/s 2023-05-08T13:30:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:11 smithi133 ceph-mon[125939]: osdmap e1252: 12 total, 12 up, 12 in 2023-05-08T13:30:12.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35150.220738 secs 2023-05-08T13:30:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:11 smithi096 ceph-mon[124666]: pgmap v18800: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 30 op/s 2023-05-08T13:30:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:11 smithi096 ceph-mon[124666]: osdmap e1252: 12 total, 12 up, 12 in 2023-05-08T13:30:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35150.220738 secs 2023-05-08T13:30:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:11 smithi186 ceph-mon[126480]: pgmap v18800: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 30 op/s 2023-05-08T13:30:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:11 smithi186 ceph-mon[126480]: osdmap e1252: 12 total, 12 up, 12 in 2023-05-08T13:30:13.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:13 smithi186 ceph-mon[126480]: pgmap v18802: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 29 op/s 2023-05-08T13:30:13.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:13 smithi133 ceph-mon[125939]: pgmap v18802: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 29 op/s 2023-05-08T13:30:13.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:13 smithi096 ceph-mon[124666]: pgmap v18802: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 29 op/s 2023-05-08T13:30:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35153.374139 secs 2023-05-08T13:30:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35153.374139 secs 2023-05-08T13:30:15.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35153.374139 secs 2023-05-08T13:30:15.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35153.928122 secs 2023-05-08T13:30:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:15 smithi186 ceph-mon[126480]: pgmap v18803: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 587 KiB/s rd, 585 KiB/s wr, 9 op/s 2023-05-08T13:30:15.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35153.928122 secs 2023-05-08T13:30:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:15 smithi133 ceph-mon[125939]: pgmap v18803: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 587 KiB/s rd, 585 KiB/s wr, 9 op/s 2023-05-08T13:30:16.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35153.928122 secs 2023-05-08T13:30:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:15 smithi096 ceph-mon[124666]: pgmap v18803: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 587 KiB/s rd, 585 KiB/s wr, 9 op/s 2023-05-08T13:30:16.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35155.220857 secs 2023-05-08T13:30:16.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35155.220857 secs 2023-05-08T13:30:17.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35155.220857 secs 2023-05-08T13:30:17.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:17 smithi186 ceph-mon[126480]: pgmap v18804: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 587 KiB/s rd, 585 KiB/s wr, 9 op/s 2023-05-08T13:30:17.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:17 smithi133 ceph-mon[125939]: pgmap v18804: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 587 KiB/s rd, 585 KiB/s wr, 9 op/s 2023-05-08T13:30:18.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:17 smithi096 ceph-mon[124666]: pgmap v18804: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 587 KiB/s rd, 585 KiB/s wr, 9 op/s 2023-05-08T13:30:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:19 smithi186 ceph-mon[126480]: pgmap v18805: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 587 KiB/s rd, 585 KiB/s wr, 9 op/s 2023-05-08T13:30:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35158.374256 secs 2023-05-08T13:30:19.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:19 smithi133 ceph-mon[125939]: pgmap v18805: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 587 KiB/s rd, 585 KiB/s wr, 9 op/s 2023-05-08T13:30:19.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35158.374256 secs 2023-05-08T13:30:20.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:19 smithi096 ceph-mon[124666]: pgmap v18805: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 587 KiB/s rd, 585 KiB/s wr, 9 op/s 2023-05-08T13:30:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35158.374256 secs 2023-05-08T13:30:20.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35158.928257 secs 2023-05-08T13:30:21.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35158.928257 secs 2023-05-08T13:30:21.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35158.928257 secs 2023-05-08T13:30:21.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35160.220974 secs 2023-05-08T13:30:21.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:21 smithi133 ceph-mon[125939]: pgmap v18806: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 900 KiB/s rd, 544 KiB/s wr, 9 op/s 2023-05-08T13:30:22.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35160.220974 secs 2023-05-08T13:30:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:21 smithi096 ceph-mon[124666]: pgmap v18806: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 900 KiB/s rd, 544 KiB/s wr, 9 op/s 2023-05-08T13:30:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35160.220974 secs 2023-05-08T13:30:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:21 smithi186 ceph-mon[126480]: pgmap v18806: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 900 KiB/s rd, 544 KiB/s wr, 9 op/s 2023-05-08T13:30:23.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:23 smithi186 ceph-mon[126480]: osdmap e1253: 12 total, 12 up, 12 in 2023-05-08T13:30:23.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:23 smithi186 ceph-mon[126480]: pgmap v18808: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 900 KiB/s rd, 544 KiB/s wr, 9 op/s 2023-05-08T13:30:23.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:23 smithi133 ceph-mon[125939]: osdmap e1253: 12 total, 12 up, 12 in 2023-05-08T13:30:23.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:23 smithi133 ceph-mon[125939]: pgmap v18808: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 900 KiB/s rd, 544 KiB/s wr, 9 op/s 2023-05-08T13:30:23.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:23 smithi096 ceph-mon[124666]: osdmap e1253: 12 total, 12 up, 12 in 2023-05-08T13:30:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:23 smithi096 ceph-mon[124666]: pgmap v18808: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 900 KiB/s rd, 544 KiB/s wr, 9 op/s 2023-05-08T13:30:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35163.374391 secs 2023-05-08T13:30:24.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35163.374391 secs 2023-05-08T13:30:25.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35163.374391 secs 2023-05-08T13:30:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35163.928363 secs 2023-05-08T13:30:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:25 smithi186 ceph-mon[126480]: pgmap v18809: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 343 KiB/s wr, 7 op/s 2023-05-08T13:30:25.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35163.928363 secs 2023-05-08T13:30:25.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:25 smithi133 ceph-mon[125939]: pgmap v18809: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 343 KiB/s wr, 7 op/s 2023-05-08T13:30:26.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35163.928363 secs 2023-05-08T13:30:26.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:25 smithi096 ceph-mon[124666]: pgmap v18809: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 343 KiB/s wr, 7 op/s 2023-05-08T13:30:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35165.221071 secs 2023-05-08T13:30:26.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35165.221071 secs 2023-05-08T13:30:27.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35165.221071 secs 2023-05-08T13:30:27.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:27 smithi186 ceph-mon[126480]: pgmap v18810: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 343 KiB/s wr, 7 op/s 2023-05-08T13:30:27.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:27 smithi133 ceph-mon[125939]: pgmap v18810: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 343 KiB/s wr, 7 op/s 2023-05-08T13:30:28.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:27 smithi096 ceph-mon[124666]: pgmap v18810: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 343 KiB/s wr, 7 op/s 2023-05-08T13:30:29.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:29 smithi133 ceph-mon[125939]: pgmap v18811: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 343 KiB/s wr, 7 op/s 2023-05-08T13:30:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35168.374510 secs 2023-05-08T13:30:30.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:29 smithi096 ceph-mon[124666]: pgmap v18811: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 343 KiB/s wr, 7 op/s 2023-05-08T13:30:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35168.374510 secs 2023-05-08T13:30:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:29 smithi186 ceph-mon[126480]: pgmap v18811: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 343 KiB/s wr, 7 op/s 2023-05-08T13:30:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35168.374510 secs 2023-05-08T13:30:30.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35168.928466 secs 2023-05-08T13:30:31.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35168.928466 secs 2023-05-08T13:30:31.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35168.928466 secs 2023-05-08T13:30:31.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35170.221150 secs 2023-05-08T13:30:31.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:31 smithi133 ceph-mon[125939]: pgmap v18812: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 28 KiB/s wr, 7 op/s 2023-05-08T13:30:32.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35170.221150 secs 2023-05-08T13:30:32.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:31 smithi096 ceph-mon[124666]: pgmap v18812: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 28 KiB/s wr, 7 op/s 2023-05-08T13:30:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35170.221150 secs 2023-05-08T13:30:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:31 smithi186 ceph-mon[126480]: pgmap v18812: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 28 KiB/s wr, 7 op/s 2023-05-08T13:30:33.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:33 smithi186 ceph-mon[126480]: pgmap v18813: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 28 KiB/s wr, 7 op/s 2023-05-08T13:30:33.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:33 smithi133 ceph-mon[125939]: pgmap v18813: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 28 KiB/s wr, 7 op/s 2023-05-08T13:30:33.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:33 smithi096 ceph-mon[124666]: pgmap v18813: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 28 KiB/s wr, 7 op/s 2023-05-08T13:30:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35173.374602 secs 2023-05-08T13:30:34.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35173.374602 secs 2023-05-08T13:30:35.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35173.374602 secs 2023-05-08T13:30:35.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35173.928594 secs 2023-05-08T13:30:35.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:35 smithi186 ceph-mon[126480]: pgmap v18814: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 24 KiB/s wr, 9 op/s 2023-05-08T13:30:35.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35173.928594 secs 2023-05-08T13:30:35.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:35 smithi133 ceph-mon[125939]: pgmap v18814: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 24 KiB/s wr, 9 op/s 2023-05-08T13:30:36.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35173.928594 secs 2023-05-08T13:30:36.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:35 smithi096 ceph-mon[124666]: pgmap v18814: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 24 KiB/s wr, 9 op/s 2023-05-08T13:30:36.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35175.221247 secs 2023-05-08T13:30:36.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35175.221247 secs 2023-05-08T13:30:37.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35175.221247 secs 2023-05-08T13:30:37.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:37 smithi186 ceph-mon[126480]: pgmap v18815: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 7 op/s 2023-05-08T13:30:37.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:37 smithi133 ceph-mon[125939]: pgmap v18815: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 7 op/s 2023-05-08T13:30:38.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:37 smithi096 ceph-mon[124666]: pgmap v18815: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 7 op/s 2023-05-08T13:30:39.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:39 smithi133 ceph-mon[125939]: pgmap v18816: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 7 op/s 2023-05-08T13:30:39.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35178.374742 secs 2023-05-08T13:30:40.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:39 smithi096 ceph-mon[124666]: pgmap v18816: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 7 op/s 2023-05-08T13:30:40.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35178.374742 secs 2023-05-08T13:30:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:39 smithi186 ceph-mon[126480]: pgmap v18816: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 7 op/s 2023-05-08T13:30:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35178.374742 secs 2023-05-08T13:30:40.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35178.928707 secs 2023-05-08T13:30:41.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35178.928707 secs 2023-05-08T13:30:41.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35178.928707 secs 2023-05-08T13:30:41.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35180.221358 secs 2023-05-08T13:30:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:41 smithi133 ceph-mon[125939]: pgmap v18817: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 170 KiB/s wr, 11 op/s 2023-05-08T13:30:42.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35180.221358 secs 2023-05-08T13:30:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:41 smithi096 ceph-mon[124666]: pgmap v18817: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 170 KiB/s wr, 11 op/s 2023-05-08T13:30:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35180.221358 secs 2023-05-08T13:30:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:41 smithi186 ceph-mon[126480]: pgmap v18817: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 170 KiB/s wr, 11 op/s 2023-05-08T13:30:43.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:43 smithi133 ceph-mon[125939]: pgmap v18818: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 147 KiB/s wr, 7 op/s 2023-05-08T13:30:43.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:43 smithi096 ceph-mon[124666]: pgmap v18818: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 147 KiB/s wr, 7 op/s 2023-05-08T13:30:43.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:43 smithi186 ceph-mon[126480]: pgmap v18818: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 147 KiB/s wr, 7 op/s 2023-05-08T13:30:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35183.374855 secs 2023-05-08T13:30:44.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35183.374855 secs 2023-05-08T13:30:45.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35183.374855 secs 2023-05-08T13:30:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35183.928834 secs 2023-05-08T13:30:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:45 smithi186 ceph-mon[126480]: pgmap v18819: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 405 KiB/s wr, 11 op/s 2023-05-08T13:30:45.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35183.928834 secs 2023-05-08T13:30:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:45 smithi133 ceph-mon[125939]: pgmap v18819: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 405 KiB/s wr, 11 op/s 2023-05-08T13:30:46.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35183.928834 secs 2023-05-08T13:30:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:45 smithi096 ceph-mon[124666]: pgmap v18819: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 405 KiB/s wr, 11 op/s 2023-05-08T13:30:47.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:47 smithi133 ceph-mon[125939]: pgmap v18820: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 405 KiB/s wr, 7 op/s 2023-05-08T13:30:48.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:47 smithi096 ceph-mon[124666]: pgmap v18820: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 405 KiB/s wr, 7 op/s 2023-05-08T13:30:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:47 smithi186 ceph-mon[126480]: pgmap v18820: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 405 KiB/s wr, 7 op/s 2023-05-08T13:30:49.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:49 smithi133 ceph-mon[125939]: pgmap v18821: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 405 KiB/s wr, 7 op/s 2023-05-08T13:30:49.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35188.374924 secs 2023-05-08T13:30:49.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:30:50.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:49 smithi096 ceph-mon[124666]: pgmap v18821: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 405 KiB/s wr, 7 op/s 2023-05-08T13:30:50.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35188.374924 secs 2023-05-08T13:30:50.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:30:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:49 smithi186 ceph-mon[126480]: pgmap v18821: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 405 KiB/s wr, 7 op/s 2023-05-08T13:30:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35188.374924 secs 2023-05-08T13:30:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:30:50.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35188.928958 secs 2023-05-08T13:30:50.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:30:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:30:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:30:51.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35188.928958 secs 2023-05-08T13:30:51.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:30:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:30:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:30:51.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35188.928958 secs 2023-05-08T13:30:51.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:30:51.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:30:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:30:51.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:51 smithi133 ceph-mon[125939]: pgmap v18822: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 670 KiB/s rd, 434 KiB/s wr, 11 op/s 2023-05-08T13:30:52.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:51 smithi096 ceph-mon[124666]: pgmap v18822: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 670 KiB/s rd, 434 KiB/s wr, 11 op/s 2023-05-08T13:30:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:51 smithi186 ceph-mon[126480]: pgmap v18822: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 670 KiB/s rd, 434 KiB/s wr, 11 op/s 2023-05-08T13:30:53.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:53 smithi133 ceph-mon[125939]: pgmap v18823: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 288 KiB/s wr, 7 op/s 2023-05-08T13:30:53.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:53 smithi096 ceph-mon[124666]: pgmap v18823: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 288 KiB/s wr, 7 op/s 2023-05-08T13:30:53.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:53 smithi186 ceph-mon[126480]: pgmap v18823: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 288 KiB/s wr, 7 op/s 2023-05-08T13:30:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35193.374988 secs 2023-05-08T13:30:54.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35193.374988 secs 2023-05-08T13:30:55.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35193.374988 secs 2023-05-08T13:30:55.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:55 smithi186 ceph-mon[126480]: pgmap v18824: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 897 KiB/s wr, 12 op/s 2023-05-08T13:30:55.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:55 smithi133 ceph-mon[125939]: pgmap v18824: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 897 KiB/s wr, 12 op/s 2023-05-08T13:30:56.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:55 smithi096 ceph-mon[124666]: pgmap v18824: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 897 KiB/s wr, 12 op/s 2023-05-08T13:30:57.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:57 smithi133 ceph-mon[125939]: pgmap v18825: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 639 KiB/s wr, 8 op/s 2023-05-08T13:30:57.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:30:58.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:57 smithi096 ceph-mon[124666]: pgmap v18825: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 639 KiB/s wr, 8 op/s 2023-05-08T13:30:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:30:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:57 smithi186 ceph-mon[126480]: pgmap v18825: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 639 KiB/s wr, 8 op/s 2023-05-08T13:30:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:30:58.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:58 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:30:58.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:30:58.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:30:59.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:58 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:30:59.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:30:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:30:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:58 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:30:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:30:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:30:59.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:59 smithi133 ceph-mon[125939]: pgmap v18826: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 639 KiB/s wr, 8 op/s 2023-05-08T13:30:59.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35198.375076 secs 2023-05-08T13:30:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:30:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:30:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:30:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:30:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:31:00.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:59 smithi096 ceph-mon[124666]: pgmap v18826: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 639 KiB/s wr, 8 op/s 2023-05-08T13:31:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35198.375076 secs 2023-05-08T13:31:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:31:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:31:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:31:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:30:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:31:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:59 smithi186 ceph-mon[126480]: pgmap v18826: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 639 KiB/s wr, 8 op/s 2023-05-08T13:31:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35198.375076 secs 2023-05-08T13:31:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:31:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:31:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:31:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:30:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:31:00.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:00 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:31:00.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:00 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T13:31:00.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:00 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T13:31:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:00 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:31:01.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:00 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:31:01.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:00 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T13:31:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:00 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T13:31:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:00 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:31:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:00 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:31:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:00 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T13:31:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:00 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T13:31:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:00 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:31:01.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:01 smithi133 ceph-mon[125939]: pgmap v18827: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T13:31:02.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:01 smithi096 ceph-mon[124666]: pgmap v18827: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T13:31:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:01 smithi186 ceph-mon[126480]: pgmap v18827: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T13:31:03.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:03 smithi133 ceph-mon[125939]: pgmap v18828: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 833 KiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T13:31:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:03 smithi096 ceph-mon[124666]: pgmap v18828: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 833 KiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T13:31:03.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:03 smithi186 ceph-mon[126480]: pgmap v18828: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 833 KiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T13:31:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35203.375203 secs 2023-05-08T13:31:04.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35203.375203 secs 2023-05-08T13:31:05.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35203.375203 secs 2023-05-08T13:31:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35203.929383 secs 2023-05-08T13:31:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:05 smithi186 ceph-mon[126480]: pgmap v18829: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 29 op/s 2023-05-08T13:31:05.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35203.929383 secs 2023-05-08T13:31:05.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:05 smithi133 ceph-mon[125939]: pgmap v18829: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 29 op/s 2023-05-08T13:31:06.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35203.929383 secs 2023-05-08T13:31:06.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:05 smithi096 ceph-mon[124666]: pgmap v18829: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 29 op/s 2023-05-08T13:31:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:06 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:31:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:31:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:31:06.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:06 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:31:06.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:31:06.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:31:07.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:06 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:31:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:31:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:31:07.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:07 smithi186 ceph-mon[126480]: pgmap v18830: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 25 op/s 2023-05-08T13:31:07.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:07 smithi133 ceph-mon[125939]: pgmap v18830: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 25 op/s 2023-05-08T13:31:08.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:07 smithi096 ceph-mon[124666]: pgmap v18830: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 25 op/s 2023-05-08T13:31:09.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:09 smithi133 ceph-mon[125939]: pgmap v18831: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 25 op/s 2023-05-08T13:31:09.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35208.375274 secs 2023-05-08T13:31:10.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:09 smithi096 ceph-mon[124666]: pgmap v18831: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 25 op/s 2023-05-08T13:31:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35208.375274 secs 2023-05-08T13:31:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:09 smithi186 ceph-mon[126480]: pgmap v18831: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 25 op/s 2023-05-08T13:31:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35208.375274 secs 2023-05-08T13:31:10.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35208.929530 secs 2023-05-08T13:31:11.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35208.929530 secs 2023-05-08T13:31:11.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35208.929530 secs 2023-05-08T13:31:11.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:11 smithi133 ceph-mon[125939]: pgmap v18832: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 30 op/s 2023-05-08T13:31:12.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:11 smithi096 ceph-mon[124666]: pgmap v18832: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 30 op/s 2023-05-08T13:31:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:11 smithi186 ceph-mon[126480]: pgmap v18832: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 30 op/s 2023-05-08T13:31:13.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:13 smithi133 ceph-mon[125939]: pgmap v18833: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 846 KiB/s wr, 24 op/s 2023-05-08T13:31:13.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:13 smithi096 ceph-mon[124666]: pgmap v18833: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 846 KiB/s wr, 24 op/s 2023-05-08T13:31:13.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:13 smithi186 ceph-mon[126480]: pgmap v18833: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 846 KiB/s wr, 24 op/s 2023-05-08T13:31:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35213.375413 secs 2023-05-08T13:31:14.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35213.375413 secs 2023-05-08T13:31:15.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35213.375413 secs 2023-05-08T13:31:15.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35213.929653 secs 2023-05-08T13:31:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:15 smithi186 ceph-mon[126480]: pgmap v18834: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.3 MiB/s wr, 28 op/s 2023-05-08T13:31:15.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35213.929653 secs 2023-05-08T13:31:15.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:15 smithi133 ceph-mon[125939]: pgmap v18834: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.3 MiB/s wr, 28 op/s 2023-05-08T13:31:16.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35213.929653 secs 2023-05-08T13:31:16.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:15 smithi096 ceph-mon[124666]: pgmap v18834: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.3 MiB/s wr, 28 op/s 2023-05-08T13:31:17.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:17 smithi133 ceph-mon[125939]: pgmap v18835: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 889 KiB/s wr, 9 op/s 2023-05-08T13:31:18.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:17 smithi096 ceph-mon[124666]: pgmap v18835: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 889 KiB/s wr, 9 op/s 2023-05-08T13:31:18.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:17 smithi186 ceph-mon[126480]: pgmap v18835: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 889 KiB/s wr, 9 op/s 2023-05-08T13:31:19.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:19 smithi133 ceph-mon[125939]: pgmap v18836: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 889 KiB/s wr, 9 op/s 2023-05-08T13:31:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35218.375479 secs 2023-05-08T13:31:20.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:19 smithi096 ceph-mon[124666]: pgmap v18836: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 889 KiB/s wr, 9 op/s 2023-05-08T13:31:20.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35218.375479 secs 2023-05-08T13:31:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:19 smithi186 ceph-mon[126480]: pgmap v18836: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 889 KiB/s wr, 9 op/s 2023-05-08T13:31:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35218.375479 secs 2023-05-08T13:31:20.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35218.929752 secs 2023-05-08T13:31:21.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35218.929752 secs 2023-05-08T13:31:21.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35218.929752 secs 2023-05-08T13:31:21.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:21 smithi133 ceph-mon[125939]: pgmap v18837: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 893 KiB/s wr, 13 op/s 2023-05-08T13:31:22.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:21 smithi096 ceph-mon[124666]: pgmap v18837: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 893 KiB/s wr, 13 op/s 2023-05-08T13:31:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:21 smithi186 ceph-mon[126480]: pgmap v18837: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 893 KiB/s wr, 13 op/s 2023-05-08T13:31:23.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:23 smithi133 ceph-mon[125939]: pgmap v18838: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 891 KiB/s rd, 461 KiB/s wr, 8 op/s 2023-05-08T13:31:23.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:23 smithi096 ceph-mon[124666]: pgmap v18838: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 891 KiB/s rd, 461 KiB/s wr, 8 op/s 2023-05-08T13:31:23.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:23 smithi186 ceph-mon[126480]: pgmap v18838: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 891 KiB/s rd, 461 KiB/s wr, 8 op/s 2023-05-08T13:31:25.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35223.375594 secs 2023-05-08T13:31:25.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:25 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:31:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:25 smithi133 ceph-mon[125939]: pgmap v18839: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 15 op/s 2023-05-08T13:31:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:25 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:31:25.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35223.375594 secs 2023-05-08T13:31:25.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:25 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:31:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:25 smithi096 ceph-mon[124666]: pgmap v18839: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 15 op/s 2023-05-08T13:31:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:25 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:31:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35223.375594 secs 2023-05-08T13:31:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:25 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:31:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:25 smithi186 ceph-mon[126480]: pgmap v18839: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 15 op/s 2023-05-08T13:31:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:25 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:31:26.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:26 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:31:26.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:26 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:31:26.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:26 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:31:26.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:26 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:31:26.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:26 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:31:26.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:26 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:31:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:26 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:31:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:26 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:31:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:26 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:31:27.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:27 smithi133 ceph-mon[125939]: osdmap e1254: 12 total, 12 up, 12 in 2023-05-08T13:31:27.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:27 smithi133 ceph-mon[125939]: pgmap v18841: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T13:31:27.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:27 smithi096 ceph-mon[124666]: osdmap e1254: 12 total, 12 up, 12 in 2023-05-08T13:31:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:27 smithi096 ceph-mon[124666]: pgmap v18841: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T13:31:27.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:27 smithi186 ceph-mon[126480]: osdmap e1254: 12 total, 12 up, 12 in 2023-05-08T13:31:27.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:27 smithi186 ceph-mon[126480]: pgmap v18841: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T13:31:29.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:29 smithi133 ceph-mon[125939]: pgmap v18842: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T13:31:29.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35228.375699 secs 2023-05-08T13:31:30.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:29 smithi096 ceph-mon[124666]: pgmap v18842: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T13:31:30.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35228.375699 secs 2023-05-08T13:31:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:29 smithi186 ceph-mon[126480]: pgmap v18842: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T13:31:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35228.375699 secs 2023-05-08T13:31:31.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:31 smithi133 ceph-mon[125939]: pgmap v18843: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T13:31:32.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:31 smithi096 ceph-mon[124666]: pgmap v18843: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T13:31:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:31 smithi186 ceph-mon[126480]: pgmap v18843: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T13:31:33.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:33 smithi133 ceph-mon[125939]: osdmap e1255: 12 total, 12 up, 12 in 2023-05-08T13:31:33.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:33 smithi133 ceph-mon[125939]: pgmap v18845: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 431 KiB/s rd, 204 KiB/s wr, 6 op/s 2023-05-08T13:31:33.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:33 smithi096 ceph-mon[124666]: osdmap e1255: 12 total, 12 up, 12 in 2023-05-08T13:31:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:33 smithi096 ceph-mon[124666]: pgmap v18845: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 431 KiB/s rd, 204 KiB/s wr, 6 op/s 2023-05-08T13:31:33.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:33 smithi186 ceph-mon[126480]: osdmap e1255: 12 total, 12 up, 12 in 2023-05-08T13:31:33.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:33 smithi186 ceph-mon[126480]: pgmap v18845: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 431 KiB/s rd, 204 KiB/s wr, 6 op/s 2023-05-08T13:31:35.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35233.375790 secs 2023-05-08T13:31:35.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:35 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:31:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:35 smithi133 ceph-mon[125939]: pgmap v18846: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 121 KiB/s wr, 10 op/s 2023-05-08T13:31:35.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35233.375790 secs 2023-05-08T13:31:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:35 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:31:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:35 smithi096 ceph-mon[124666]: pgmap v18846: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 121 KiB/s wr, 10 op/s 2023-05-08T13:31:35.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35233.375790 secs 2023-05-08T13:31:35.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:35 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:31:35.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:35 smithi186 ceph-mon[126480]: pgmap v18846: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 121 KiB/s wr, 10 op/s 2023-05-08T13:31:37.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:37 smithi133 ceph-mon[125939]: pgmap v18847: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 587 KiB/s rd, 375 KiB/s wr, 9 op/s 2023-05-08T13:31:38.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:37 smithi096 ceph-mon[124666]: pgmap v18847: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 587 KiB/s rd, 375 KiB/s wr, 9 op/s 2023-05-08T13:31:38.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:37 smithi186 ceph-mon[126480]: pgmap v18847: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 587 KiB/s rd, 375 KiB/s wr, 9 op/s 2023-05-08T13:31:39.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:39 smithi133 ceph-mon[125939]: pgmap v18848: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 587 KiB/s rd, 375 KiB/s wr, 9 op/s 2023-05-08T13:31:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35238.375915 secs 2023-05-08T13:31:40.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:39 smithi096 ceph-mon[124666]: pgmap v18848: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 587 KiB/s rd, 375 KiB/s wr, 9 op/s 2023-05-08T13:31:40.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35238.375915 secs 2023-05-08T13:31:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:39 smithi186 ceph-mon[126480]: pgmap v18848: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 587 KiB/s rd, 375 KiB/s wr, 9 op/s 2023-05-08T13:31:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35238.375915 secs 2023-05-08T13:31:41.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35240.222858 secs 2023-05-08T13:31:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:41 smithi133 ceph-mon[125939]: pgmap v18849: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 687 KiB/s wr, 9 op/s 2023-05-08T13:31:42.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35240.222858 secs 2023-05-08T13:31:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:41 smithi096 ceph-mon[124666]: pgmap v18849: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 687 KiB/s wr, 9 op/s 2023-05-08T13:31:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35240.222858 secs 2023-05-08T13:31:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:41 smithi186 ceph-mon[126480]: pgmap v18849: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 687 KiB/s wr, 9 op/s 2023-05-08T13:31:42.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:42 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:31:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:42 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:31:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:42 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:31:43.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:42 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:31:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:42 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:31:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:42 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:31:43.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:42 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:31:43.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:42 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:31:43.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:42 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:31:43.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:43 smithi133 ceph-mon[125939]: pgmap v18850: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 673 KiB/s wr, 9 op/s 2023-05-08T13:31:44.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:43 smithi096 ceph-mon[124666]: pgmap v18850: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 673 KiB/s wr, 9 op/s 2023-05-08T13:31:44.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:43 smithi186 ceph-mon[126480]: pgmap v18850: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 673 KiB/s wr, 9 op/s 2023-05-08T13:31:45.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35243.376029 secs 2023-05-08T13:31:45.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35243.930370 secs 2023-05-08T13:31:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:45 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:31:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:45 smithi133 ceph-mon[125939]: pgmap v18851: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T13:31:45.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35243.376029 secs 2023-05-08T13:31:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35243.930370 secs 2023-05-08T13:31:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:45 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:31:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:45 smithi096 ceph-mon[124666]: pgmap v18851: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T13:31:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35243.376029 secs 2023-05-08T13:31:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35243.930370 secs 2023-05-08T13:31:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:45 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:31:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:45 smithi186 ceph-mon[126480]: pgmap v18851: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T13:31:46.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:46 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:31:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:46 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:31:46.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:46 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:31:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:46 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:31:46.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:46 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:31:46.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:46 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:31:47.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:47 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:31:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:47 smithi133 ceph-mon[125939]: pgmap v18852: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T13:31:47.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:47 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:31:47.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:47 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:31:47.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:47 smithi096 ceph-mon[124666]: pgmap v18852: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T13:31:47.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:47 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:31:47.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:47 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:31:47.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:47 smithi186 ceph-mon[126480]: pgmap v18852: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T13:31:47.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:47 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:31:49.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:49 smithi133 ceph-mon[125939]: pgmap v18853: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T13:31:49.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35248.376148 secs 2023-05-08T13:31:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:31:50.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:49 smithi096 ceph-mon[124666]: pgmap v18853: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T13:31:50.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35248.376148 secs 2023-05-08T13:31:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:31:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:49 smithi186 ceph-mon[126480]: pgmap v18853: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T13:31:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35248.376148 secs 2023-05-08T13:31:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:31:50.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:31:50.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:31:51.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:31:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:31:51.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:31:51.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:31:51.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:51 smithi133 ceph-mon[125939]: pgmap v18854: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.2 MiB/s wr, 15 op/s 2023-05-08T13:31:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:51 smithi096 ceph-mon[124666]: pgmap v18854: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.2 MiB/s wr, 15 op/s 2023-05-08T13:31:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:51 smithi186 ceph-mon[126480]: pgmap v18854: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.2 MiB/s wr, 15 op/s 2023-05-08T13:31:52.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:52 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:31:53.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:52 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:31:53.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:52 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:31:53.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:53 smithi133 ceph-mon[125939]: pgmap v18855: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 11 op/s 2023-05-08T13:31:53.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:53 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:31:54.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:53 smithi096 ceph-mon[124666]: pgmap v18855: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 11 op/s 2023-05-08T13:31:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:53 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:31:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:53 smithi186 ceph-mon[126480]: pgmap v18855: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 11 op/s 2023-05-08T13:31:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:53 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:31:54.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35253.376263 secs 2023-05-08T13:31:54.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:54 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:31:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:54 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:31:55.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35253.376263 secs 2023-05-08T13:31:55.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:54 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:31:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:54 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:31:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35253.376263 secs 2023-05-08T13:31:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:54 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:31:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:54 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:31:55.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35253.930649 secs 2023-05-08T13:31:55.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:55 smithi133 ceph-mon[125939]: pgmap v18856: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 17 op/s 2023-05-08T13:31:56.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35253.930649 secs 2023-05-08T13:31:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:55 smithi096 ceph-mon[124666]: pgmap v18856: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 17 op/s 2023-05-08T13:31:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35253.930649 secs 2023-05-08T13:31:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:55 smithi186 ceph-mon[126480]: pgmap v18856: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 17 op/s 2023-05-08T13:31:57.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:57 smithi133 ceph-mon[125939]: pgmap v18857: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T13:31:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:57 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:31:58.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:57 smithi096 ceph-mon[124666]: pgmap v18857: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T13:31:58.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:57 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:31:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:57 smithi186 ceph-mon[126480]: pgmap v18857: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T13:31:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:57 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:31:58.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:31:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:31:59.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:31:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:31:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:31:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:31:59.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:59 smithi133 ceph-mon[125939]: pgmap v18858: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T13:31:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35258.376407 secs 2023-05-08T13:31:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:31:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:32:00.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:59 smithi096 ceph-mon[124666]: pgmap v18858: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T13:32:00.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35258.376407 secs 2023-05-08T13:32:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:31:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:32:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:59 smithi186 ceph-mon[126480]: pgmap v18858: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T13:32:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35258.376407 secs 2023-05-08T13:32:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:31:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:32:00.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35258.930769 secs 2023-05-08T13:32:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:32:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:32:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:32:01.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35258.930769 secs 2023-05-08T13:32:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:32:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:32:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:32:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35258.930769 secs 2023-05-08T13:32:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:32:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:32:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:32:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:01 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:32:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:01 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T13:32:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:01 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T13:32:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:01 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:32:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:01 smithi133 ceph-mon[125939]: pgmap v18859: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.3 MiB/s wr, 16 op/s 2023-05-08T13:32:02.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:01 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:32:02.178 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:01 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T13:32:02.179 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:01 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T13:32:02.179 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:01 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:32:02.179 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:01 smithi096 ceph-mon[124666]: pgmap v18859: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.3 MiB/s wr, 16 op/s 2023-05-08T13:32:02.180 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:01 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:32:02.180 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:01 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T13:32:02.180 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:01 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T13:32:02.180 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:01 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:32:02.180 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:01 smithi186 ceph-mon[126480]: pgmap v18859: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.3 MiB/s wr, 16 op/s 2023-05-08T13:32:02.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:02 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:32:03.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:02 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:32:03.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:02 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:32:03.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:03 smithi133 ceph-mon[125939]: pgmap v18860: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T13:32:04.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:03 smithi096 ceph-mon[124666]: pgmap v18860: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T13:32:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:03 smithi186 ceph-mon[126480]: pgmap v18860: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T13:32:04.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35263.376503 secs 2023-05-08T13:32:05.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35263.376503 secs 2023-05-08T13:32:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35263.376503 secs 2023-05-08T13:32:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:05 smithi133 ceph-mon[125939]: pgmap v18861: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.6 MiB/s wr, 29 op/s 2023-05-08T13:32:05.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:05 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:32:06.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:05 smithi096 ceph-mon[124666]: pgmap v18861: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.6 MiB/s wr, 29 op/s 2023-05-08T13:32:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:05 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:32:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:05 smithi186 ceph-mon[126480]: pgmap v18861: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.6 MiB/s wr, 29 op/s 2023-05-08T13:32:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:05 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:32:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:32:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:32:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:32:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:32:07.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:32:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:32:07.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:07 smithi133 ceph-mon[125939]: pgmap v18862: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 23 op/s 2023-05-08T13:32:07.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:07 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:32:08.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:07 smithi096 ceph-mon[124666]: pgmap v18862: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 23 op/s 2023-05-08T13:32:08.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:07 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:32:08.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:07 smithi186 ceph-mon[126480]: pgmap v18862: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 23 op/s 2023-05-08T13:32:08.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:07 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:32:09.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:09 smithi133 ceph-mon[125939]: pgmap v18863: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 23 op/s 2023-05-08T13:32:09.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35268.376634 secs 2023-05-08T13:32:10.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:09 smithi096 ceph-mon[124666]: pgmap v18863: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 23 op/s 2023-05-08T13:32:10.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35268.376634 secs 2023-05-08T13:32:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:09 smithi186 ceph-mon[126480]: pgmap v18863: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 23 op/s 2023-05-08T13:32:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35268.376634 secs 2023-05-08T13:32:11.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:11 smithi133 ceph-mon[125939]: pgmap v18864: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 27 op/s 2023-05-08T13:32:12.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:11 smithi096 ceph-mon[124666]: pgmap v18864: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 27 op/s 2023-05-08T13:32:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:11 smithi186 ceph-mon[126480]: pgmap v18864: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 27 op/s 2023-05-08T13:32:13.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:13 smithi133 ceph-mon[125939]: pgmap v18865: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 910 KiB/s rd, 796 KiB/s wr, 22 op/s 2023-05-08T13:32:13.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:13 smithi096 ceph-mon[124666]: pgmap v18865: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 910 KiB/s rd, 796 KiB/s wr, 22 op/s 2023-05-08T13:32:13.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:13 smithi186 ceph-mon[126480]: pgmap v18865: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 910 KiB/s rd, 796 KiB/s wr, 22 op/s 2023-05-08T13:32:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35273.376728 secs 2023-05-08T13:32:14.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35273.376728 secs 2023-05-08T13:32:15.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35273.376728 secs 2023-05-08T13:32:15.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:15 smithi186 ceph-mon[126480]: pgmap v18866: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 911 KiB/s rd, 796 KiB/s wr, 24 op/s 2023-05-08T13:32:15.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:15 smithi133 ceph-mon[125939]: pgmap v18866: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 911 KiB/s rd, 796 KiB/s wr, 24 op/s 2023-05-08T13:32:16.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:15 smithi096 ceph-mon[124666]: pgmap v18866: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 911 KiB/s rd, 796 KiB/s wr, 24 op/s 2023-05-08T13:32:17.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:17 smithi133 ceph-mon[125939]: pgmap v18867: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 363 KiB/s wr, 7 op/s 2023-05-08T13:32:18.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:17 smithi096 ceph-mon[124666]: pgmap v18867: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 363 KiB/s wr, 7 op/s 2023-05-08T13:32:18.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:17 smithi186 ceph-mon[126480]: pgmap v18867: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 363 KiB/s wr, 7 op/s 2023-05-08T13:32:19.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:19 smithi133 ceph-mon[125939]: pgmap v18868: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 314 KiB/s wr, 6 op/s 2023-05-08T13:32:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35278.376840 secs 2023-05-08T13:32:20.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:19 smithi096 ceph-mon[124666]: pgmap v18868: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 314 KiB/s wr, 6 op/s 2023-05-08T13:32:20.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35278.376840 secs 2023-05-08T13:32:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:19 smithi186 ceph-mon[126480]: pgmap v18868: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 314 KiB/s wr, 6 op/s 2023-05-08T13:32:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35278.376840 secs 2023-05-08T13:32:21.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35280.223901 secs 2023-05-08T13:32:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:21 smithi133 ceph-mon[125939]: pgmap v18869: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 633 KiB/s rd, 630 KiB/s wr, 10 op/s 2023-05-08T13:32:22.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35280.223901 secs 2023-05-08T13:32:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:21 smithi096 ceph-mon[124666]: pgmap v18869: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 633 KiB/s rd, 630 KiB/s wr, 10 op/s 2023-05-08T13:32:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35280.223901 secs 2023-05-08T13:32:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:21 smithi186 ceph-mon[126480]: pgmap v18869: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 633 KiB/s rd, 630 KiB/s wr, 10 op/s 2023-05-08T13:32:22.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:22 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:32:22.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:22 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:32:22.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:22 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:32:23.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:22 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:32:23.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:22 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:32:23.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:22 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:32:23.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:22 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:32:23.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:22 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:32:23.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:22 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:32:23.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:23 smithi133 ceph-mon[125939]: pgmap v18870: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 317 KiB/s wr, 6 op/s 2023-05-08T13:32:24.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:23 smithi096 ceph-mon[124666]: pgmap v18870: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 317 KiB/s wr, 6 op/s 2023-05-08T13:32:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:23 smithi186 ceph-mon[126480]: pgmap v18870: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 317 KiB/s wr, 6 op/s 2023-05-08T13:32:24.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35283.376939 secs 2023-05-08T13:32:25.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35283.376939 secs 2023-05-08T13:32:25.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35283.376939 secs 2023-05-08T13:32:25.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35283.931392 secs 2023-05-08T13:32:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:25 smithi133 ceph-mon[125939]: pgmap v18871: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 664 KiB/s rd, 683 KiB/s wr, 12 op/s 2023-05-08T13:32:26.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35283.931392 secs 2023-05-08T13:32:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:25 smithi096 ceph-mon[124666]: pgmap v18871: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 664 KiB/s rd, 683 KiB/s wr, 12 op/s 2023-05-08T13:32:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35283.931392 secs 2023-05-08T13:32:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:25 smithi186 ceph-mon[126480]: pgmap v18871: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 664 KiB/s rd, 683 KiB/s wr, 12 op/s 2023-05-08T13:32:26.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35285.224036 secs 2023-05-08T13:32:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:26 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:32:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:26 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:32:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:26 smithi133 ceph-mon[125939]: osdmap e1256: 12 total, 12 up, 12 in 2023-05-08T13:32:27.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35285.224036 secs 2023-05-08T13:32:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:26 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:32:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:26 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:32:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:26 smithi096 ceph-mon[124666]: osdmap e1256: 12 total, 12 up, 12 in 2023-05-08T13:32:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35285.224036 secs 2023-05-08T13:32:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:26 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:32:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:26 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:32:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:26 smithi186 ceph-mon[126480]: osdmap e1256: 12 total, 12 up, 12 in 2023-05-08T13:32:27.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:27 smithi133 ceph-mon[125939]: pgmap v18873: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 796 KiB/s rd, 819 KiB/s wr, 12 op/s 2023-05-08T13:32:27.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:27 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:32:28.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:27 smithi096 ceph-mon[124666]: pgmap v18873: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 796 KiB/s rd, 819 KiB/s wr, 12 op/s 2023-05-08T13:32:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:27 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:32:28.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:27 smithi186 ceph-mon[126480]: pgmap v18873: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 796 KiB/s rd, 819 KiB/s wr, 12 op/s 2023-05-08T13:32:28.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:27 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:32:29.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:29 smithi133 ceph-mon[125939]: pgmap v18874: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 796 KiB/s rd, 819 KiB/s wr, 12 op/s 2023-05-08T13:32:29.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35288.377079 secs 2023-05-08T13:32:30.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:29 smithi096 ceph-mon[124666]: pgmap v18874: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 796 KiB/s rd, 819 KiB/s wr, 12 op/s 2023-05-08T13:32:30.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35288.377079 secs 2023-05-08T13:32:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:29 smithi186 ceph-mon[126480]: pgmap v18874: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 796 KiB/s rd, 819 KiB/s wr, 12 op/s 2023-05-08T13:32:30.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35288.377079 secs 2023-05-08T13:32:30.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35288.931482 secs 2023-05-08T13:32:31.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35288.931482 secs 2023-05-08T13:32:31.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35288.931482 secs 2023-05-08T13:32:31.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35290.224179 secs 2023-05-08T13:32:31.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:31 smithi133 ceph-mon[125939]: pgmap v18875: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 586 KiB/s rd, 609 KiB/s wr, 13 op/s 2023-05-08T13:32:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35290.224179 secs 2023-05-08T13:32:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:31 smithi096 ceph-mon[124666]: pgmap v18875: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 586 KiB/s rd, 609 KiB/s wr, 13 op/s 2023-05-08T13:32:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35290.224179 secs 2023-05-08T13:32:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:31 smithi186 ceph-mon[126480]: pgmap v18875: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 586 KiB/s rd, 609 KiB/s wr, 13 op/s 2023-05-08T13:32:33.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:33 smithi186 ceph-mon[126480]: osdmap e1257: 12 total, 12 up, 12 in 2023-05-08T13:32:33.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:33 smithi186 ceph-mon[126480]: pgmap v18877: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 212 KiB/s wr, 7 op/s 2023-05-08T13:32:33.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:33 smithi133 ceph-mon[125939]: osdmap e1257: 12 total, 12 up, 12 in 2023-05-08T13:32:33.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:33 smithi133 ceph-mon[125939]: pgmap v18877: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 212 KiB/s wr, 7 op/s 2023-05-08T13:32:33.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:33 smithi096 ceph-mon[124666]: osdmap e1257: 12 total, 12 up, 12 in 2023-05-08T13:32:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:33 smithi096 ceph-mon[124666]: pgmap v18877: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 212 KiB/s wr, 7 op/s 2023-05-08T13:32:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35293.377154 secs 2023-05-08T13:32:34.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35293.377154 secs 2023-05-08T13:32:35.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35293.377154 secs 2023-05-08T13:32:35.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35293.931571 secs 2023-05-08T13:32:35.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:35 smithi186 ceph-mon[126480]: pgmap v18878: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 588 KiB/s rd, 585 KiB/s wr, 11 op/s 2023-05-08T13:32:35.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35293.931571 secs 2023-05-08T13:32:35.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:35 smithi133 ceph-mon[125939]: pgmap v18878: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 588 KiB/s rd, 585 KiB/s wr, 11 op/s 2023-05-08T13:32:36.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35293.931571 secs 2023-05-08T13:32:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:35 smithi096 ceph-mon[124666]: pgmap v18878: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 588 KiB/s rd, 585 KiB/s wr, 11 op/s 2023-05-08T13:32:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35295.224286 secs 2023-05-08T13:32:36.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35295.224286 secs 2023-05-08T13:32:37.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35295.224286 secs 2023-05-08T13:32:37.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:37 smithi186 ceph-mon[126480]: pgmap v18879: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 522 KiB/s wr, 9 op/s 2023-05-08T13:32:37.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:37 smithi133 ceph-mon[125939]: pgmap v18879: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 522 KiB/s wr, 9 op/s 2023-05-08T13:32:38.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:37 smithi096 ceph-mon[124666]: pgmap v18879: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 522 KiB/s wr, 9 op/s 2023-05-08T13:32:39.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:39 smithi133 ceph-mon[125939]: pgmap v18880: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 522 KiB/s wr, 9 op/s 2023-05-08T13:32:39.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35298.377235 secs 2023-05-08T13:32:40.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:39 smithi096 ceph-mon[124666]: pgmap v18880: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 522 KiB/s wr, 9 op/s 2023-05-08T13:32:40.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35298.377235 secs 2023-05-08T13:32:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:39 smithi186 ceph-mon[126480]: pgmap v18880: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 522 KiB/s wr, 9 op/s 2023-05-08T13:32:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35298.377235 secs 2023-05-08T13:32:40.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35298.931687 secs 2023-05-08T13:32:41.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35298.931687 secs 2023-05-08T13:32:41.088 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35298.931687 secs 2023-05-08T13:32:41.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35300.224389 secs 2023-05-08T13:32:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:41 smithi133 ceph-mon[125939]: pgmap v18881: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 703 KiB/s rd, 701 KiB/s wr, 8 op/s 2023-05-08T13:32:42.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35300.224389 secs 2023-05-08T13:32:42.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:41 smithi096 ceph-mon[124666]: pgmap v18881: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 703 KiB/s rd, 701 KiB/s wr, 8 op/s 2023-05-08T13:32:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35300.224389 secs 2023-05-08T13:32:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:41 smithi186 ceph-mon[126480]: pgmap v18881: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 703 KiB/s rd, 701 KiB/s wr, 8 op/s 2023-05-08T13:32:43.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:43 smithi133 ceph-mon[125939]: pgmap v18882: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 689 KiB/s rd, 686 KiB/s wr, 8 op/s 2023-05-08T13:32:43.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:43 smithi096 ceph-mon[124666]: pgmap v18882: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 689 KiB/s rd, 686 KiB/s wr, 8 op/s 2023-05-08T13:32:43.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:43 smithi186 ceph-mon[126480]: pgmap v18882: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 689 KiB/s rd, 686 KiB/s wr, 8 op/s 2023-05-08T13:32:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35303.377320 secs 2023-05-08T13:32:44.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35303.377320 secs 2023-05-08T13:32:45.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35303.377320 secs 2023-05-08T13:32:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35303.931780 secs 2023-05-08T13:32:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:45 smithi186 ceph-mon[126480]: pgmap v18883: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 587 KiB/s rd, 617 KiB/s wr, 9 op/s 2023-05-08T13:32:45.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35303.931780 secs 2023-05-08T13:32:45.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:45 smithi133 ceph-mon[125939]: pgmap v18883: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 587 KiB/s rd, 617 KiB/s wr, 9 op/s 2023-05-08T13:32:46.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35303.931780 secs 2023-05-08T13:32:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:45 smithi096 ceph-mon[124666]: pgmap v18883: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 587 KiB/s rd, 617 KiB/s wr, 9 op/s 2023-05-08T13:32:47.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:47 smithi133 ceph-mon[125939]: pgmap v18884: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 323 KiB/s wr, 5 op/s 2023-05-08T13:32:48.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:47 smithi096 ceph-mon[124666]: pgmap v18884: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 323 KiB/s wr, 5 op/s 2023-05-08T13:32:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:47 smithi186 ceph-mon[126480]: pgmap v18884: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 323 KiB/s wr, 5 op/s 2023-05-08T13:32:49.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:49 smithi133 ceph-mon[125939]: pgmap v18885: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 323 KiB/s wr, 5 op/s 2023-05-08T13:32:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35308.377418 secs 2023-05-08T13:32:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:32:50.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:49 smithi096 ceph-mon[124666]: pgmap v18885: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 323 KiB/s wr, 5 op/s 2023-05-08T13:32:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35308.377418 secs 2023-05-08T13:32:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:32:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:49 smithi186 ceph-mon[126480]: pgmap v18885: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 323 KiB/s wr, 5 op/s 2023-05-08T13:32:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35308.377418 secs 2023-05-08T13:32:50.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:32:50.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:32:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:32:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:32:51.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:32:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:32:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:32:51.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:32:51.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:32:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:32:51.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:51 smithi133 ceph-mon[125939]: pgmap v18886: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 933 KiB/s rd, 897 KiB/s wr, 10 op/s 2023-05-08T13:32:52.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:51 smithi096 ceph-mon[124666]: pgmap v18886: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 933 KiB/s rd, 897 KiB/s wr, 10 op/s 2023-05-08T13:32:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:51 smithi186 ceph-mon[126480]: pgmap v18886: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 933 KiB/s rd, 897 KiB/s wr, 10 op/s 2023-05-08T13:32:53.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:53 smithi133 ceph-mon[125939]: pgmap v18887: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 641 KiB/s rd, 607 KiB/s wr, 7 op/s 2023-05-08T13:32:53.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:53 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:32:53.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:53 smithi096 ceph-mon[124666]: pgmap v18887: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 641 KiB/s rd, 607 KiB/s wr, 7 op/s 2023-05-08T13:32:53.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:53 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:32:53.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:53 smithi186 ceph-mon[126480]: pgmap v18887: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 641 KiB/s rd, 607 KiB/s wr, 7 op/s 2023-05-08T13:32:53.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:53 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:32:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:54 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:32:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:54 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:32:54.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:54 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:32:54.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:54 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:32:54.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:54 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:32:54.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:54 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:32:55.731 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35313.377562 secs 2023-05-08T13:32:55.732 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:55 smithi186 ceph-mon[126480]: pgmap v18888: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 13 op/s 2023-05-08T13:32:55.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35313.377562 secs 2023-05-08T13:32:55.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:55 smithi133 ceph-mon[125939]: pgmap v18888: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 13 op/s 2023-05-08T13:32:55.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35313.377562 secs 2023-05-08T13:32:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:55 smithi096 ceph-mon[124666]: pgmap v18888: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 13 op/s 2023-05-08T13:32:57.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:57 smithi133 ceph-mon[125939]: pgmap v18889: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T13:32:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:57 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:32:58.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:57 smithi096 ceph-mon[124666]: pgmap v18889: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T13:32:58.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:57 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:32:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:57 smithi186 ceph-mon[126480]: pgmap v18889: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T13:32:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:57 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:32:59.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:59 smithi133 ceph-mon[125939]: pgmap v18890: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T13:32:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:32:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35318.377674 secs 2023-05-08T13:33:00.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:59 smithi096 ceph-mon[124666]: pgmap v18890: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T13:33:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:32:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35318.377674 secs 2023-05-08T13:33:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:59 smithi186 ceph-mon[126480]: pgmap v18890: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T13:33:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:32:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35318.377674 secs 2023-05-08T13:33:00.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35318.932209 secs 2023-05-08T13:33:00.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:33:01.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35318.932209 secs 2023-05-08T13:33:01.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:33:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35318.932209 secs 2023-05-08T13:33:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:33:01.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:01 smithi133 ceph-mon[125939]: pgmap v18891: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 15 op/s 2023-05-08T13:33:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:01 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:33:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:01 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:33:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:01 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:33:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:01 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:33:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:01 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T13:33:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:01 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T13:33:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:01 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:33:02.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:01 smithi096 ceph-mon[124666]: pgmap v18891: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 15 op/s 2023-05-08T13:33:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:01 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:33:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:01 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:33:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:01 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:33:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:01 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:33:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:01 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T13:33:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:01 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T13:33:02.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:01 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:33:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:01 smithi186 ceph-mon[126480]: pgmap v18891: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 15 op/s 2023-05-08T13:33:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:01 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:33:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:01 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:33:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:01 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:33:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:01 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:33:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:01 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T13:33:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:01 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T13:33:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:01 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:33:02.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:33:02.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:33:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:02 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:33:03.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:33:03.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:33:03.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:02 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:33:03.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:33:03.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:33:03.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:02 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:33:03.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:03 smithi133 ceph-mon[125939]: pgmap v18892: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 731 KiB/s rd, 718 KiB/s wr, 10 op/s 2023-05-08T13:33:04.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:03 smithi096 ceph-mon[124666]: pgmap v18892: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 731 KiB/s rd, 718 KiB/s wr, 10 op/s 2023-05-08T13:33:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:03 smithi186 ceph-mon[126480]: pgmap v18892: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 731 KiB/s rd, 718 KiB/s wr, 10 op/s 2023-05-08T13:33:04.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35323.377813 secs 2023-05-08T13:33:05.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35323.377813 secs 2023-05-08T13:33:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35323.377813 secs 2023-05-08T13:33:05.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:05 smithi133 ceph-mon[125939]: pgmap v18893: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 17 op/s 2023-05-08T13:33:05.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:05 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:33:06.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:05 smithi096 ceph-mon[124666]: pgmap v18893: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 17 op/s 2023-05-08T13:33:06.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:05 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:33:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:05 smithi186 ceph-mon[126480]: pgmap v18893: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 17 op/s 2023-05-08T13:33:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:05 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:33:06.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35325.224952 secs 2023-05-08T13:33:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:33:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:33:07.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35325.224952 secs 2023-05-08T13:33:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:33:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:33:07.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35325.224952 secs 2023-05-08T13:33:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:33:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:33:07.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:07 smithi133 ceph-mon[125939]: pgmap v18894: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 736 KiB/s rd, 730 KiB/s wr, 11 op/s 2023-05-08T13:33:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:07 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:33:08.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:07 smithi096 ceph-mon[124666]: pgmap v18894: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 736 KiB/s rd, 730 KiB/s wr, 11 op/s 2023-05-08T13:33:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:07 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:33:08.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:07 smithi186 ceph-mon[126480]: pgmap v18894: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 736 KiB/s rd, 730 KiB/s wr, 11 op/s 2023-05-08T13:33:08.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:07 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:33:09.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:09 smithi133 ceph-mon[125939]: pgmap v18895: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 736 KiB/s rd, 730 KiB/s wr, 11 op/s 2023-05-08T13:33:09.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35328.377931 secs 2023-05-08T13:33:10.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:09 smithi096 ceph-mon[124666]: pgmap v18895: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 736 KiB/s rd, 730 KiB/s wr, 11 op/s 2023-05-08T13:33:10.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35328.377931 secs 2023-05-08T13:33:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:09 smithi186 ceph-mon[126480]: pgmap v18895: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 736 KiB/s rd, 730 KiB/s wr, 11 op/s 2023-05-08T13:33:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35328.377931 secs 2023-05-08T13:33:10.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35328.932507 secs 2023-05-08T13:33:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:10 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:33:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:10 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:33:11.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35328.932507 secs 2023-05-08T13:33:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:10 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:33:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:10 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:33:11.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35328.932507 secs 2023-05-08T13:33:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:10 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:33:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:10 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:33:11.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35330.225095 secs 2023-05-08T13:33:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:11 smithi133 ceph-mon[125939]: pgmap v18896: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 29 op/s 2023-05-08T13:33:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:11 smithi133 ceph-mon[125939]: osdmap e1258: 12 total, 12 up, 12 in 2023-05-08T13:33:12.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35330.225095 secs 2023-05-08T13:33:12.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:11 smithi096 ceph-mon[124666]: pgmap v18896: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 29 op/s 2023-05-08T13:33:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:11 smithi096 ceph-mon[124666]: osdmap e1258: 12 total, 12 up, 12 in 2023-05-08T13:33:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35330.225095 secs 2023-05-08T13:33:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:11 smithi186 ceph-mon[126480]: pgmap v18896: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 29 op/s 2023-05-08T13:33:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:11 smithi186 ceph-mon[126480]: osdmap e1258: 12 total, 12 up, 12 in 2023-05-08T13:33:12.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:12 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:33:13.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:12 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:33:13.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:12 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:33:13.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:13 smithi133 ceph-mon[125939]: pgmap v18898: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 30 op/s 2023-05-08T13:33:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:13 smithi096 ceph-mon[124666]: pgmap v18898: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 30 op/s 2023-05-08T13:33:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:13 smithi186 ceph-mon[126480]: pgmap v18898: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 30 op/s 2023-05-08T13:33:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35333.378068 secs 2023-05-08T13:33:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:14 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:33:15.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:14 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:33:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35333.378068 secs 2023-05-08T13:33:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:14 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:33:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:14 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:33:15.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35333.378068 secs 2023-05-08T13:33:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:14 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:33:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:14 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:33:16.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35333.932640 secs 2023-05-08T13:33:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:15 smithi096 ceph-mon[124666]: pgmap v18899: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 982 KiB/s rd, 1024 KiB/s wr, 26 op/s 2023-05-08T13:33:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35333.932640 secs 2023-05-08T13:33:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:15 smithi186 ceph-mon[126480]: pgmap v18899: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 982 KiB/s rd, 1024 KiB/s wr, 26 op/s 2023-05-08T13:33:16.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35333.932640 secs 2023-05-08T13:33:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:15 smithi133 ceph-mon[125939]: pgmap v18899: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 982 KiB/s rd, 1024 KiB/s wr, 26 op/s 2023-05-08T13:33:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35335.225225 secs 2023-05-08T13:33:17.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35335.225225 secs 2023-05-08T13:33:17.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35335.225225 secs 2023-05-08T13:33:18.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:17 smithi096 ceph-mon[124666]: pgmap v18900: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 982 KiB/s rd, 1024 KiB/s wr, 26 op/s 2023-05-08T13:33:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:17 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:33:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:17 smithi096 ceph-mon[124666]: osdmap e1259: 12 total, 12 up, 12 in 2023-05-08T13:33:18.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:17 smithi186 ceph-mon[126480]: pgmap v18900: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 982 KiB/s rd, 1024 KiB/s wr, 26 op/s 2023-05-08T13:33:18.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:17 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:33:18.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:17 smithi186 ceph-mon[126480]: osdmap e1259: 12 total, 12 up, 12 in 2023-05-08T13:33:18.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:17 smithi133 ceph-mon[125939]: pgmap v18900: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 982 KiB/s rd, 1024 KiB/s wr, 26 op/s 2023-05-08T13:33:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:17 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:33:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:17 smithi133 ceph-mon[125939]: osdmap e1259: 12 total, 12 up, 12 in 2023-05-08T13:33:20.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:19 smithi096 ceph-mon[124666]: pgmap v18902: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 473 KiB/s wr, 5 op/s 2023-05-08T13:33:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35338.378164 secs 2023-05-08T13:33:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:19 smithi186 ceph-mon[126480]: pgmap v18902: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 473 KiB/s wr, 5 op/s 2023-05-08T13:33:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35338.378164 secs 2023-05-08T13:33:20.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:19 smithi133 ceph-mon[125939]: pgmap v18902: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 473 KiB/s wr, 5 op/s 2023-05-08T13:33:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35338.378164 secs 2023-05-08T13:33:21.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35338.932737 secs 2023-05-08T13:33:21.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35338.932737 secs 2023-05-08T13:33:21.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35338.932737 secs 2023-05-08T13:33:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35340.225369 secs 2023-05-08T13:33:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:21 smithi186 ceph-mon[126480]: pgmap v18903: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 413 KiB/s wr, 9 op/s 2023-05-08T13:33:22.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35340.225369 secs 2023-05-08T13:33:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:21 smithi133 ceph-mon[125939]: pgmap v18903: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 413 KiB/s wr, 9 op/s 2023-05-08T13:33:22.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35340.225369 secs 2023-05-08T13:33:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:21 smithi096 ceph-mon[124666]: pgmap v18903: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 413 KiB/s wr, 9 op/s 2023-05-08T13:33:23.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:23 smithi133 ceph-mon[125939]: pgmap v18904: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 411 KiB/s rd, 409 KiB/s wr, 9 op/s 2023-05-08T13:33:23.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:23 smithi096 ceph-mon[124666]: pgmap v18904: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 411 KiB/s rd, 409 KiB/s wr, 9 op/s 2023-05-08T13:33:23.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:23 smithi186 ceph-mon[126480]: pgmap v18904: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 411 KiB/s rd, 409 KiB/s wr, 9 op/s 2023-05-08T13:33:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35343.378318 secs 2023-05-08T13:33:24.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35343.378318 secs 2023-05-08T13:33:25.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35343.378318 secs 2023-05-08T13:33:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35343.932909 secs 2023-05-08T13:33:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:25 smithi186 ceph-mon[126480]: pgmap v18905: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 141 KiB/s wr, 8 op/s 2023-05-08T13:33:25.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35343.932909 secs 2023-05-08T13:33:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:25 smithi133 ceph-mon[125939]: pgmap v18905: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 141 KiB/s wr, 8 op/s 2023-05-08T13:33:26.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35343.932909 secs 2023-05-08T13:33:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:25 smithi096 ceph-mon[124666]: pgmap v18905: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 141 KiB/s wr, 8 op/s 2023-05-08T13:33:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35345.225505 secs 2023-05-08T13:33:26.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35345.225505 secs 2023-05-08T13:33:27.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35345.225505 secs 2023-05-08T13:33:27.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:27 smithi186 ceph-mon[126480]: pgmap v18906: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 141 KiB/s wr, 8 op/s 2023-05-08T13:33:27.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:27 smithi133 ceph-mon[125939]: pgmap v18906: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 141 KiB/s wr, 8 op/s 2023-05-08T13:33:28.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:27 smithi096 ceph-mon[124666]: pgmap v18906: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 141 KiB/s wr, 8 op/s 2023-05-08T13:33:29.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:29 smithi133 ceph-mon[125939]: pgmap v18907: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 126 KiB/s wr, 7 op/s 2023-05-08T13:33:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35348.378441 secs 2023-05-08T13:33:30.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:29 smithi096 ceph-mon[124666]: pgmap v18907: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 126 KiB/s wr, 7 op/s 2023-05-08T13:33:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35348.378441 secs 2023-05-08T13:33:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:29 smithi186 ceph-mon[126480]: pgmap v18907: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 126 KiB/s wr, 7 op/s 2023-05-08T13:33:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35348.378441 secs 2023-05-08T13:33:30.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35348.933039 secs 2023-05-08T13:33:31.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35348.933039 secs 2023-05-08T13:33:31.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35348.933039 secs 2023-05-08T13:33:31.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35350.225658 secs 2023-05-08T13:33:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:31 smithi133 ceph-mon[125939]: pgmap v18908: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 141 KiB/s wr, 10 op/s 2023-05-08T13:33:32.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35350.225658 secs 2023-05-08T13:33:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:31 smithi096 ceph-mon[124666]: pgmap v18908: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 141 KiB/s wr, 10 op/s 2023-05-08T13:33:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35350.225658 secs 2023-05-08T13:33:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:31 smithi186 ceph-mon[126480]: pgmap v18908: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 141 KiB/s wr, 10 op/s 2023-05-08T13:33:33.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:33 smithi133 ceph-mon[125939]: pgmap v18909: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 116 KiB/s wr, 7 op/s 2023-05-08T13:33:33.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:33 smithi096 ceph-mon[124666]: pgmap v18909: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 116 KiB/s wr, 7 op/s 2023-05-08T13:33:33.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:33 smithi186 ceph-mon[126480]: pgmap v18909: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 116 KiB/s wr, 7 op/s 2023-05-08T13:33:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35353.378552 secs 2023-05-08T13:33:34.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35353.378552 secs 2023-05-08T13:33:35.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35353.378552 secs 2023-05-08T13:33:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35353.933130 secs 2023-05-08T13:33:35.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:35 smithi186 ceph-mon[126480]: pgmap v18910: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 117 KiB/s wr, 11 op/s 2023-05-08T13:33:35.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35353.933130 secs 2023-05-08T13:33:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:35 smithi133 ceph-mon[125939]: pgmap v18910: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 117 KiB/s wr, 11 op/s 2023-05-08T13:33:36.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35353.933130 secs 2023-05-08T13:33:36.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:35 smithi096 ceph-mon[124666]: pgmap v18910: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 117 KiB/s wr, 11 op/s 2023-05-08T13:33:36.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35355.225809 secs 2023-05-08T13:33:36.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35355.225809 secs 2023-05-08T13:33:37.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35355.225809 secs 2023-05-08T13:33:37.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:37 smithi186 ceph-mon[126480]: pgmap v18911: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 7 op/s 2023-05-08T13:33:37.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:37 smithi133 ceph-mon[125939]: pgmap v18911: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 7 op/s 2023-05-08T13:33:38.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:37 smithi096 ceph-mon[124666]: pgmap v18911: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 7 op/s 2023-05-08T13:33:39.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:39 smithi133 ceph-mon[125939]: pgmap v18912: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 7 op/s 2023-05-08T13:33:39.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35358.378651 secs 2023-05-08T13:33:40.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:39 smithi096 ceph-mon[124666]: pgmap v18912: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 7 op/s 2023-05-08T13:33:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35358.378651 secs 2023-05-08T13:33:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:39 smithi186 ceph-mon[126480]: pgmap v18912: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 7 op/s 2023-05-08T13:33:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35358.378651 secs 2023-05-08T13:33:40.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35358.933261 secs 2023-05-08T13:33:41.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35358.933261 secs 2023-05-08T13:33:41.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35358.933261 secs 2023-05-08T13:33:41.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35360.225890 secs 2023-05-08T13:33:41.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:41 smithi133 ceph-mon[125939]: pgmap v18913: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 318 KiB/s wr, 11 op/s 2023-05-08T13:33:42.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35360.225890 secs 2023-05-08T13:33:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:41 smithi096 ceph-mon[124666]: pgmap v18913: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 318 KiB/s wr, 11 op/s 2023-05-08T13:33:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35360.225890 secs 2023-05-08T13:33:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:41 smithi186 ceph-mon[126480]: pgmap v18913: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 318 KiB/s wr, 11 op/s 2023-05-08T13:33:43.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:43 smithi133 ceph-mon[125939]: pgmap v18914: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 295 KiB/s wr, 7 op/s 2023-05-08T13:33:43.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:43 smithi096 ceph-mon[124666]: pgmap v18914: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 295 KiB/s wr, 7 op/s 2023-05-08T13:33:43.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:43 smithi186 ceph-mon[126480]: pgmap v18914: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 295 KiB/s wr, 7 op/s 2023-05-08T13:33:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35363.378811 secs 2023-05-08T13:33:44.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35363.378811 secs 2023-05-08T13:33:45.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35363.378811 secs 2023-05-08T13:33:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35363.933398 secs 2023-05-08T13:33:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:45 smithi186 ceph-mon[126480]: pgmap v18915: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 300 KiB/s wr, 10 op/s 2023-05-08T13:33:45.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35363.933398 secs 2023-05-08T13:33:45.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:45 smithi133 ceph-mon[125939]: pgmap v18915: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 300 KiB/s wr, 10 op/s 2023-05-08T13:33:46.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35363.933398 secs 2023-05-08T13:33:46.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:45 smithi096 ceph-mon[124666]: pgmap v18915: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 300 KiB/s wr, 10 op/s 2023-05-08T13:33:47.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:47 smithi133 ceph-mon[125939]: pgmap v18916: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 299 KiB/s wr, 6 op/s 2023-05-08T13:33:48.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:47 smithi096 ceph-mon[124666]: pgmap v18916: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 299 KiB/s wr, 6 op/s 2023-05-08T13:33:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:47 smithi186 ceph-mon[126480]: pgmap v18916: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 299 KiB/s wr, 6 op/s 2023-05-08T13:33:49.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:49 smithi133 ceph-mon[125939]: pgmap v18917: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 299 KiB/s wr, 6 op/s 2023-05-08T13:33:49.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35368.378958 secs 2023-05-08T13:33:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:33:50.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:49 smithi096 ceph-mon[124666]: pgmap v18917: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 299 KiB/s wr, 6 op/s 2023-05-08T13:33:50.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35368.378958 secs 2023-05-08T13:33:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:33:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:49 smithi186 ceph-mon[126480]: pgmap v18917: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 299 KiB/s wr, 6 op/s 2023-05-08T13:33:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35368.378958 secs 2023-05-08T13:33:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:33:50.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:33:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:33:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:33:51.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:33:51.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:33:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:33:51.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:33:51.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:33:51.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:33:51.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:51 smithi133 ceph-mon[125939]: pgmap v18918: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 721 KiB/s rd, 666 KiB/s wr, 11 op/s 2023-05-08T13:33:52.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:51 smithi096 ceph-mon[124666]: pgmap v18918: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 721 KiB/s rd, 666 KiB/s wr, 11 op/s 2023-05-08T13:33:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:51 smithi186 ceph-mon[126480]: pgmap v18918: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 721 KiB/s rd, 666 KiB/s wr, 11 op/s 2023-05-08T13:33:53.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:53 smithi133 ceph-mon[125939]: pgmap v18919: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 372 KiB/s wr, 7 op/s 2023-05-08T13:33:53.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:53 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:33:53.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:53 smithi096 ceph-mon[124666]: pgmap v18919: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 372 KiB/s wr, 7 op/s 2023-05-08T13:33:53.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:53 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:33:53.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:53 smithi186 ceph-mon[126480]: pgmap v18919: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 372 KiB/s wr, 7 op/s 2023-05-08T13:33:53.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:53 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:33:54.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:54 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:33:54.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:54 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:33:54.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:54 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:33:54.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:54 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:33:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:54 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:33:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:54 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:33:55.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35373.379102 secs 2023-05-08T13:33:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:55 smithi133 ceph-mon[125939]: pgmap v18920: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 13 op/s 2023-05-08T13:33:55.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35373.379102 secs 2023-05-08T13:33:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:55 smithi096 ceph-mon[124666]: pgmap v18920: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 13 op/s 2023-05-08T13:33:55.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35373.379102 secs 2023-05-08T13:33:55.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:55 smithi186 ceph-mon[126480]: pgmap v18920: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 13 op/s 2023-05-08T13:33:57.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:57 smithi133 ceph-mon[125939]: pgmap v18921: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T13:33:57.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:57 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:33:58.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:57 smithi096 ceph-mon[124666]: pgmap v18921: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T13:33:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:57 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:33:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:57 smithi186 ceph-mon[126480]: pgmap v18921: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T13:33:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:57 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:33:59.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:59 smithi133 ceph-mon[125939]: pgmap v18922: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T13:33:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:33:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35378.379241 secs 2023-05-08T13:34:00.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:59 smithi096 ceph-mon[124666]: pgmap v18922: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T13:34:00.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:33:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35378.379241 secs 2023-05-08T13:34:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:59 smithi186 ceph-mon[126480]: pgmap v18922: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T13:34:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:33:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35378.379241 secs 2023-05-08T13:34:00.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35378.933793 secs 2023-05-08T13:34:01.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35378.933793 secs 2023-05-08T13:34:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35378.933793 secs 2023-05-08T13:34:01.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:01 smithi133 ceph-mon[125939]: pgmap v18923: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.4 MiB/s wr, 16 op/s 2023-05-08T13:34:02.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:01 smithi096 ceph-mon[124666]: pgmap v18923: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.4 MiB/s wr, 16 op/s 2023-05-08T13:34:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:01 smithi186 ceph-mon[126480]: pgmap v18923: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.4 MiB/s wr, 16 op/s 2023-05-08T13:34:02.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:34:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:34:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:02 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:34:03.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:34:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:34:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:02 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:34:03.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:34:03.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:34:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:02 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:34:03.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:03 smithi133 ceph-mon[125939]: pgmap v18924: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T13:34:04.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:03 smithi096 ceph-mon[124666]: pgmap v18924: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T13:34:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:03 smithi186 ceph-mon[126480]: pgmap v18924: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T13:34:04.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35383.379369 secs 2023-05-08T13:34:05.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35383.379369 secs 2023-05-08T13:34:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35383.379369 secs 2023-05-08T13:34:05.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35383.933931 secs 2023-05-08T13:34:05.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:05 smithi133 ceph-mon[125939]: pgmap v18925: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.7 MiB/s wr, 28 op/s 2023-05-08T13:34:06.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35383.933931 secs 2023-05-08T13:34:06.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:05 smithi096 ceph-mon[124666]: pgmap v18925: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.7 MiB/s wr, 28 op/s 2023-05-08T13:34:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35383.933931 secs 2023-05-08T13:34:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:05 smithi186 ceph-mon[126480]: pgmap v18925: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.7 MiB/s wr, 28 op/s 2023-05-08T13:34:07.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:07 smithi133 ceph-mon[125939]: pgmap v18926: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 751 KiB/s wr, 23 op/s 2023-05-08T13:34:08.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:07 smithi096 ceph-mon[124666]: pgmap v18926: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 751 KiB/s wr, 23 op/s 2023-05-08T13:34:08.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:07 smithi186 ceph-mon[126480]: pgmap v18926: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 751 KiB/s wr, 23 op/s 2023-05-08T13:34:09.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:09 smithi133 ceph-mon[125939]: pgmap v18927: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 751 KiB/s wr, 22 op/s 2023-05-08T13:34:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35388.379497 secs 2023-05-08T13:34:10.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:09 smithi096 ceph-mon[124666]: pgmap v18927: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 751 KiB/s wr, 22 op/s 2023-05-08T13:34:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35388.379497 secs 2023-05-08T13:34:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:09 smithi186 ceph-mon[126480]: pgmap v18927: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 751 KiB/s wr, 22 op/s 2023-05-08T13:34:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35388.379497 secs 2023-05-08T13:34:10.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35388.934035 secs 2023-05-08T13:34:11.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35388.934035 secs 2023-05-08T13:34:11.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35388.934035 secs 2023-05-08T13:34:11.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:11 smithi133 ceph-mon[125939]: pgmap v18928: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 896 KiB/s wr, 26 op/s 2023-05-08T13:34:12.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:11 smithi096 ceph-mon[124666]: pgmap v18928: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 896 KiB/s wr, 26 op/s 2023-05-08T13:34:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:11 smithi186 ceph-mon[126480]: pgmap v18928: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 896 KiB/s wr, 26 op/s 2023-05-08T13:34:13.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:13 smithi133 ceph-mon[125939]: pgmap v18929: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 838 KiB/s rd, 806 KiB/s wr, 20 op/s 2023-05-08T13:34:13.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:13 smithi096 ceph-mon[124666]: pgmap v18929: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 838 KiB/s rd, 806 KiB/s wr, 20 op/s 2023-05-08T13:34:13.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:13 smithi186 ceph-mon[126480]: pgmap v18929: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 838 KiB/s rd, 806 KiB/s wr, 20 op/s 2023-05-08T13:34:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35393.379631 secs 2023-05-08T13:34:14.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35393.379631 secs 2023-05-08T13:34:15.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35393.379631 secs 2023-05-08T13:34:15.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35393.934165 secs 2023-05-08T13:34:15.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:15 smithi186 ceph-mon[126480]: pgmap v18930: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 24 op/s 2023-05-08T13:34:15.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35393.934165 secs 2023-05-08T13:34:15.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:15 smithi133 ceph-mon[125939]: pgmap v18930: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 24 op/s 2023-05-08T13:34:16.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35393.934165 secs 2023-05-08T13:34:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:15 smithi096 ceph-mon[124666]: pgmap v18930: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 24 op/s 2023-05-08T13:34:16.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:16 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:34:16.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:16 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:34:16.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:16 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:34:16.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:16 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:34:16.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:16 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:34:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:16 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:34:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:16 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:34:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:16 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:34:17.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:16 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:34:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:16 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:34:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:16 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:34:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:16 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:34:17.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:17 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:34:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:17 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T13:34:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:17 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T13:34:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:17 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:34:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:17 smithi186 ceph-mon[126480]: pgmap v18931: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 384 KiB/s wr, 7 op/s 2023-05-08T13:34:17.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:17 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:34:17.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:17 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T13:34:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:17 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T13:34:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:17 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:34:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:17 smithi133 ceph-mon[125939]: pgmap v18931: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 384 KiB/s wr, 7 op/s 2023-05-08T13:34:18.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:17 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:34:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:17 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T13:34:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:17 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T13:34:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:17 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:34:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:17 smithi096 ceph-mon[124666]: pgmap v18931: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 384 KiB/s wr, 7 op/s 2023-05-08T13:34:19.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:19 smithi133 ceph-mon[125939]: pgmap v18932: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 384 KiB/s wr, 7 op/s 2023-05-08T13:34:20.011 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35398.379752 secs 2023-05-08T13:34:20.012 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:19 smithi096 ceph-mon[124666]: pgmap v18932: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 384 KiB/s wr, 7 op/s 2023-05-08T13:34:20.012 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35398.379752 secs 2023-05-08T13:34:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:19 smithi186 ceph-mon[126480]: pgmap v18932: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 384 KiB/s wr, 7 op/s 2023-05-08T13:34:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35398.379752 secs 2023-05-08T13:34:21.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:21 smithi133 ceph-mon[125939]: pgmap v18933: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 14 op/s 2023-05-08T13:34:22.055 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:21 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:34:22.056 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:21 smithi096 ceph-mon[124666]: pgmap v18933: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 14 op/s 2023-05-08T13:34:22.056 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:21 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:34:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:21 smithi186 ceph-mon[126480]: pgmap v18933: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 14 op/s 2023-05-08T13:34:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:21 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:34:22.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:22 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:34:22.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:22 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:34:22.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:22 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:34:23.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:22 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:34:23.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:22 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:34:23.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:22 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:34:23.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:22 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:34:23.127 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:22 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:34:23.127 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:22 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:34:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:23 smithi133 ceph-mon[125939]: pgmap v18934: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 904 KiB/s wr, 11 op/s 2023-05-08T13:34:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:23 smithi096 ceph-mon[124666]: pgmap v18934: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 904 KiB/s wr, 11 op/s 2023-05-08T13:34:24.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:23 smithi186 ceph-mon[126480]: pgmap v18934: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 904 KiB/s wr, 11 op/s 2023-05-08T13:34:24.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35403.379870 secs 2023-05-08T13:34:25.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35403.379870 secs 2023-05-08T13:34:25.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35403.379870 secs 2023-05-08T13:34:25.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:25 smithi133 ceph-mon[125939]: pgmap v18935: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 979 KiB/s wr, 15 op/s 2023-05-08T13:34:26.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:25 smithi096 ceph-mon[124666]: pgmap v18935: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 979 KiB/s wr, 15 op/s 2023-05-08T13:34:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:25 smithi186 ceph-mon[126480]: pgmap v18935: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 979 KiB/s wr, 15 op/s 2023-05-08T13:34:26.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:26 smithi133 ceph-mon[125939]: osdmap e1260: 12 total, 12 up, 12 in 2023-05-08T13:34:27.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:26 smithi096 ceph-mon[124666]: osdmap e1260: 12 total, 12 up, 12 in 2023-05-08T13:34:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:26 smithi186 ceph-mon[126480]: osdmap e1260: 12 total, 12 up, 12 in 2023-05-08T13:34:27.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:27 smithi133 ceph-mon[125939]: pgmap v18937: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 864 KiB/s rd, 887 KiB/s wr, 13 op/s 2023-05-08T13:34:28.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:27 smithi096 ceph-mon[124666]: pgmap v18937: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 864 KiB/s rd, 887 KiB/s wr, 13 op/s 2023-05-08T13:34:28.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:27 smithi186 ceph-mon[126480]: pgmap v18937: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 864 KiB/s rd, 887 KiB/s wr, 13 op/s 2023-05-08T13:34:29.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:29 smithi133 ceph-mon[125939]: pgmap v18938: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 864 KiB/s rd, 887 KiB/s wr, 13 op/s 2023-05-08T13:34:29.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35408.379950 secs 2023-05-08T13:34:30.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:29 smithi096 ceph-mon[124666]: pgmap v18938: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 864 KiB/s rd, 887 KiB/s wr, 13 op/s 2023-05-08T13:34:30.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35408.379950 secs 2023-05-08T13:34:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:29 smithi186 ceph-mon[126480]: pgmap v18938: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 864 KiB/s rd, 887 KiB/s wr, 13 op/s 2023-05-08T13:34:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35408.379950 secs 2023-05-08T13:34:31.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:31 smithi133 ceph-mon[125939]: pgmap v18939: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 440 KiB/s wr, 9 op/s 2023-05-08T13:34:32.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:31 smithi096 ceph-mon[124666]: pgmap v18939: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 440 KiB/s wr, 9 op/s 2023-05-08T13:34:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:31 smithi186 ceph-mon[126480]: pgmap v18939: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 440 KiB/s wr, 9 op/s 2023-05-08T13:34:33.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:33 smithi133 ceph-mon[125939]: osdmap e1261: 12 total, 12 up, 12 in 2023-05-08T13:34:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:33 smithi133 ceph-mon[125939]: pgmap v18941: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 436 KiB/s wr, 5 op/s 2023-05-08T13:34:33.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:33 smithi096 ceph-mon[124666]: osdmap e1261: 12 total, 12 up, 12 in 2023-05-08T13:34:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:33 smithi096 ceph-mon[124666]: pgmap v18941: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 436 KiB/s wr, 5 op/s 2023-05-08T13:34:33.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:33 smithi186 ceph-mon[126480]: osdmap e1261: 12 total, 12 up, 12 in 2023-05-08T13:34:33.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:33 smithi186 ceph-mon[126480]: pgmap v18941: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 436 KiB/s wr, 5 op/s 2023-05-08T13:34:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35413.380068 secs 2023-05-08T13:34:34.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35413.380068 secs 2023-05-08T13:34:35.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35413.380068 secs 2023-05-08T13:34:35.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:35 smithi186 ceph-mon[126480]: pgmap v18942: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 670 KiB/s rd, 484 KiB/s wr, 9 op/s 2023-05-08T13:34:35.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:35 smithi133 ceph-mon[125939]: pgmap v18942: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 670 KiB/s rd, 484 KiB/s wr, 9 op/s 2023-05-08T13:34:36.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:35 smithi096 ceph-mon[124666]: pgmap v18942: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 670 KiB/s rd, 484 KiB/s wr, 9 op/s 2023-05-08T13:34:36.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35415.238498 secs 2023-05-08T13:34:36.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35415.238498 secs 2023-05-08T13:34:37.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35415.238498 secs 2023-05-08T13:34:37.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:37 smithi186 ceph-mon[126480]: pgmap v18943: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 598 KiB/s rd, 432 KiB/s wr, 8 op/s 2023-05-08T13:34:37.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:37 smithi133 ceph-mon[125939]: pgmap v18943: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 598 KiB/s rd, 432 KiB/s wr, 8 op/s 2023-05-08T13:34:38.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:37 smithi096 ceph-mon[124666]: pgmap v18943: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 598 KiB/s rd, 432 KiB/s wr, 8 op/s 2023-05-08T13:34:38.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:38 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:34:38.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:38 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:34:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:38 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:34:38.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:38 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:34:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:38 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:34:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:38 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:34:39.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:38 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:34:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:38 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:34:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:38 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:34:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35418.380186 secs 2023-05-08T13:34:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:39 smithi186 ceph-mon[126480]: pgmap v18944: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 598 KiB/s rd, 432 KiB/s wr, 8 op/s 2023-05-08T13:34:39.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35418.380186 secs 2023-05-08T13:34:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:39 smithi133 ceph-mon[125939]: pgmap v18944: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 598 KiB/s rd, 432 KiB/s wr, 8 op/s 2023-05-08T13:34:40.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35418.380186 secs 2023-05-08T13:34:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:39 smithi096 ceph-mon[124666]: pgmap v18944: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 598 KiB/s rd, 432 KiB/s wr, 8 op/s 2023-05-08T13:34:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35418.934650 secs 2023-05-08T13:34:40.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35418.934650 secs 2023-05-08T13:34:41.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35418.934650 secs 2023-05-08T13:34:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35420.238622 secs 2023-05-08T13:34:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:41 smithi186 ceph-mon[126480]: pgmap v18945: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T13:34:41.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35420.238622 secs 2023-05-08T13:34:41.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:41 smithi133 ceph-mon[125939]: pgmap v18945: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T13:34:42.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35420.238622 secs 2023-05-08T13:34:42.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:41 smithi096 ceph-mon[124666]: pgmap v18945: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T13:34:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:42 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:34:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:42 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:34:42.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:42 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:34:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:42 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:34:43.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:42 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:34:43.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:42 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:34:43.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:43 smithi186 ceph-mon[126480]: pgmap v18946: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T13:34:43.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:43 smithi133 ceph-mon[125939]: pgmap v18946: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T13:34:44.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:43 smithi096 ceph-mon[124666]: pgmap v18946: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T13:34:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35423.380355 secs 2023-05-08T13:34:44.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35423.380355 secs 2023-05-08T13:34:45.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35423.380355 secs 2023-05-08T13:34:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35423.934710 secs 2023-05-08T13:34:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:45 smithi186 ceph-mon[126480]: pgmap v18947: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2023-05-08T13:34:45.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35423.934710 secs 2023-05-08T13:34:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:45 smithi133 ceph-mon[125939]: pgmap v18947: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2023-05-08T13:34:46.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35423.934710 secs 2023-05-08T13:34:46.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:45 smithi096 ceph-mon[124666]: pgmap v18947: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2023-05-08T13:34:47.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:47 smithi133 ceph-mon[125939]: pgmap v18948: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 9 op/s 2023-05-08T13:34:47.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:47 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:34:48.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:47 smithi096 ceph-mon[124666]: pgmap v18948: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 9 op/s 2023-05-08T13:34:48.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:47 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:34:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:47 smithi186 ceph-mon[126480]: pgmap v18948: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 9 op/s 2023-05-08T13:34:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:47 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:34:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35428.380446 secs 2023-05-08T13:34:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:49 smithi133 ceph-mon[125939]: pgmap v18949: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 9 op/s 2023-05-08T13:34:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:34:50.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35428.380446 secs 2023-05-08T13:34:50.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:49 smithi096 ceph-mon[124666]: pgmap v18949: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 9 op/s 2023-05-08T13:34:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:34:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35428.380446 secs 2023-05-08T13:34:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:49 smithi186 ceph-mon[126480]: pgmap v18949: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 9 op/s 2023-05-08T13:34:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:34:50.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:34:50.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:34:51.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:34:51.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:34:51.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:34:51.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:34:51.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:51 smithi133 ceph-mon[125939]: pgmap v18950: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 15 op/s 2023-05-08T13:34:52.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:51 smithi096 ceph-mon[124666]: pgmap v18950: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 15 op/s 2023-05-08T13:34:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:51 smithi186 ceph-mon[126480]: pgmap v18950: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 15 op/s 2023-05-08T13:34:52.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:52 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:34:53.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:52 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:34:53.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:52 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:34:53.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:53 smithi133 ceph-mon[125939]: pgmap v18951: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 793 KiB/s rd, 791 KiB/s wr, 9 op/s 2023-05-08T13:34:53.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:53 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:34:54.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:53 smithi096 ceph-mon[124666]: pgmap v18951: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 793 KiB/s rd, 791 KiB/s wr, 9 op/s 2023-05-08T13:34:54.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:53 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:34:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:53 smithi186 ceph-mon[126480]: pgmap v18951: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 793 KiB/s rd, 791 KiB/s wr, 9 op/s 2023-05-08T13:34:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:53 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:34:54.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35433.380543 secs 2023-05-08T13:34:54.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:54 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:34:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:54 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:34:55.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35433.380543 secs 2023-05-08T13:34:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:54 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:34:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:54 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:34:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35433.380543 secs 2023-05-08T13:34:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:54 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:34:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:54 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:34:55.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35433.934966 secs 2023-05-08T13:34:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:55 smithi133 ceph-mon[125939]: pgmap v18952: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 16 op/s 2023-05-08T13:34:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35433.934966 secs 2023-05-08T13:34:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:55 smithi096 ceph-mon[124666]: pgmap v18952: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 16 op/s 2023-05-08T13:34:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35433.934966 secs 2023-05-08T13:34:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:55 smithi186 ceph-mon[126480]: pgmap v18952: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 16 op/s 2023-05-08T13:34:57.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:57 smithi133 ceph-mon[125939]: pgmap v18953: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T13:34:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:57 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:34:58.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:57 smithi096 ceph-mon[124666]: pgmap v18953: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T13:34:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:57 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:34:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:57 smithi186 ceph-mon[126480]: pgmap v18953: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T13:34:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:57 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:34:59.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:34:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:34:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:34:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:34:59.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:34:59.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:35:00.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35438.380668 secs 2023-05-08T13:35:00.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:34:59 smithi096 ceph-mon[124666]: pgmap v18954: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T13:35:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35438.380668 secs 2023-05-08T13:35:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:34:59 smithi186 ceph-mon[126480]: pgmap v18954: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T13:35:00.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35438.380668 secs 2023-05-08T13:35:00.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:34:59 smithi133 ceph-mon[125939]: pgmap v18954: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T13:35:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35440.239112 secs 2023-05-08T13:35:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:01 smithi186 ceph-mon[126480]: pgmap v18955: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 19 op/s 2023-05-08T13:35:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:01 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:35:02.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35440.239112 secs 2023-05-08T13:35:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:01 smithi133 ceph-mon[125939]: pgmap v18955: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 19 op/s 2023-05-08T13:35:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:01 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:35:02.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35440.239112 secs 2023-05-08T13:35:02.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:01 smithi096 ceph-mon[124666]: pgmap v18955: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 19 op/s 2023-05-08T13:35:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:01 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:35:03.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:35:03.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:35:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:35:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:02 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:35:03.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:35:03.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:35:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:35:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:02 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:35:03.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:35:03.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:35:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:35:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:02 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:35:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:03 smithi186 ceph-mon[126480]: pgmap v18956: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.2 MiB/s wr, 13 op/s 2023-05-08T13:35:04.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:03 smithi133 ceph-mon[125939]: pgmap v18956: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.2 MiB/s wr, 13 op/s 2023-05-08T13:35:04.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:03 smithi096 ceph-mon[124666]: pgmap v18956: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.2 MiB/s wr, 13 op/s 2023-05-08T13:35:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35443.380779 secs 2023-05-08T13:35:05.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35443.380779 secs 2023-05-08T13:35:05.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35443.380779 secs 2023-05-08T13:35:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35443.935219 secs 2023-05-08T13:35:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:05 smithi186 ceph-mon[126480]: pgmap v18957: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.5 MiB/s wr, 33 op/s 2023-05-08T13:35:06.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35443.935219 secs 2023-05-08T13:35:06.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:05 smithi133 ceph-mon[125939]: pgmap v18957: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.5 MiB/s wr, 33 op/s 2023-05-08T13:35:06.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35443.935219 secs 2023-05-08T13:35:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:05 smithi096 ceph-mon[124666]: pgmap v18957: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.5 MiB/s wr, 33 op/s 2023-05-08T13:35:07.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35445.239229 secs 2023-05-08T13:35:07.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:35:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:35:07.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35445.239229 secs 2023-05-08T13:35:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:35:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:35:07.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35445.239229 secs 2023-05-08T13:35:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:35:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:35:08.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:07 smithi186 ceph-mon[126480]: pgmap v18958: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.7 MiB/s wr, 27 op/s 2023-05-08T13:35:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:07 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:35:08.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:07 smithi133 ceph-mon[125939]: pgmap v18958: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.7 MiB/s wr, 27 op/s 2023-05-08T13:35:08.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:07 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:35:08.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:07 smithi096 ceph-mon[124666]: pgmap v18958: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.7 MiB/s wr, 27 op/s 2023-05-08T13:35:08.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:07 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:35:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35448.380900 secs 2023-05-08T13:35:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:09 smithi186 ceph-mon[126480]: pgmap v18959: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.4 MiB/s wr, 26 op/s 2023-05-08T13:35:10.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35448.380900 secs 2023-05-08T13:35:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:09 smithi133 ceph-mon[125939]: pgmap v18959: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.4 MiB/s wr, 26 op/s 2023-05-08T13:35:10.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35448.380900 secs 2023-05-08T13:35:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:09 smithi096 ceph-mon[124666]: pgmap v18959: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.4 MiB/s wr, 26 op/s 2023-05-08T13:35:11.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35448.935354 secs 2023-05-08T13:35:11.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35448.935354 secs 2023-05-08T13:35:11.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35448.935354 secs 2023-05-08T13:35:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35450.239354 secs 2023-05-08T13:35:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:11 smithi186 ceph-mon[126480]: pgmap v18960: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.6 MiB/s wr, 31 op/s 2023-05-08T13:35:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:11 smithi186 ceph-mon[126480]: osdmap e1262: 12 total, 12 up, 12 in 2023-05-08T13:35:12.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35450.239354 secs 2023-05-08T13:35:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:11 smithi133 ceph-mon[125939]: pgmap v18960: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.6 MiB/s wr, 31 op/s 2023-05-08T13:35:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:11 smithi133 ceph-mon[125939]: osdmap e1262: 12 total, 12 up, 12 in 2023-05-08T13:35:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35450.239354 secs 2023-05-08T13:35:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:11 smithi096 ceph-mon[124666]: pgmap v18960: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.6 MiB/s wr, 31 op/s 2023-05-08T13:35:12.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:11 smithi096 ceph-mon[124666]: osdmap e1262: 12 total, 12 up, 12 in 2023-05-08T13:35:13.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:13 smithi133 ceph-mon[125939]: pgmap v18962: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 625 KiB/s wr, 29 op/s 2023-05-08T13:35:13.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:13 smithi096 ceph-mon[124666]: pgmap v18962: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 625 KiB/s wr, 29 op/s 2023-05-08T13:35:13.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:13 smithi186 ceph-mon[126480]: pgmap v18962: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 625 KiB/s wr, 29 op/s 2023-05-08T13:35:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35453.381023 secs 2023-05-08T13:35:14.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35453.381023 secs 2023-05-08T13:35:15.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35453.381023 secs 2023-05-08T13:35:15.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35453.935503 secs 2023-05-08T13:35:15.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:15 smithi186 ceph-mon[126480]: pgmap v18963: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 586 KiB/s wr, 10 op/s 2023-05-08T13:35:15.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35453.935503 secs 2023-05-08T13:35:15.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:15 smithi133 ceph-mon[125939]: pgmap v18963: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 586 KiB/s wr, 10 op/s 2023-05-08T13:35:16.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35453.935503 secs 2023-05-08T13:35:16.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:15 smithi096 ceph-mon[124666]: pgmap v18963: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 586 KiB/s wr, 10 op/s 2023-05-08T13:35:16.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35455.239471 secs 2023-05-08T13:35:16.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:16 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:35:16.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35455.239471 secs 2023-05-08T13:35:16.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:16 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:35:17.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35455.239471 secs 2023-05-08T13:35:17.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:16 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:35:17.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:17 smithi186 ceph-mon[126480]: pgmap v18964: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 498 KiB/s wr, 10 op/s 2023-05-08T13:35:17.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:17 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:35:17.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:17 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:35:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:17 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:35:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:17 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:35:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:17 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T13:35:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:17 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T13:35:17.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:17 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:35:17.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:17 smithi133 ceph-mon[125939]: pgmap v18964: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 498 KiB/s wr, 10 op/s 2023-05-08T13:35:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:17 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:35:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:17 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:35:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:17 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:35:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:17 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:35:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:17 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T13:35:17.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:17 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T13:35:17.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:17 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:35:18.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:17 smithi096 ceph-mon[124666]: pgmap v18964: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 498 KiB/s wr, 10 op/s 2023-05-08T13:35:18.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:17 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:35:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:17 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:35:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:17 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:35:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:17 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:35:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:17 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T13:35:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:17 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T13:35:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:17 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:35:19.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35458.381140 secs 2023-05-08T13:35:19.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:19 smithi133 ceph-mon[125939]: pgmap v18965: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 498 KiB/s wr, 10 op/s 2023-05-08T13:35:20.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35458.381140 secs 2023-05-08T13:35:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:19 smithi096 ceph-mon[124666]: pgmap v18965: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 498 KiB/s wr, 10 op/s 2023-05-08T13:35:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35458.381140 secs 2023-05-08T13:35:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:19 smithi186 ceph-mon[126480]: pgmap v18965: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 498 KiB/s wr, 10 op/s 2023-05-08T13:35:20.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35458.935648 secs 2023-05-08T13:35:21.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35458.935648 secs 2023-05-08T13:35:21.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35458.935648 secs 2023-05-08T13:35:21.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35460.239565 secs 2023-05-08T13:35:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:21 smithi133 ceph-mon[125939]: pgmap v18966: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 530 KiB/s rd, 350 KiB/s wr, 9 op/s 2023-05-08T13:35:22.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35460.239565 secs 2023-05-08T13:35:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:21 smithi096 ceph-mon[124666]: pgmap v18966: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 530 KiB/s rd, 350 KiB/s wr, 9 op/s 2023-05-08T13:35:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35460.239565 secs 2023-05-08T13:35:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:21 smithi186 ceph-mon[126480]: pgmap v18966: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 530 KiB/s rd, 350 KiB/s wr, 9 op/s 2023-05-08T13:35:23.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:23 smithi133 ceph-mon[125939]: osdmap e1263: 12 total, 12 up, 12 in 2023-05-08T13:35:23.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:23 smithi133 ceph-mon[125939]: pgmap v18968: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 530 KiB/s rd, 350 KiB/s wr, 9 op/s 2023-05-08T13:35:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:23 smithi096 ceph-mon[124666]: osdmap e1263: 12 total, 12 up, 12 in 2023-05-08T13:35:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:23 smithi096 ceph-mon[124666]: pgmap v18968: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 530 KiB/s rd, 350 KiB/s wr, 9 op/s 2023-05-08T13:35:23.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:23 smithi186 ceph-mon[126480]: osdmap e1263: 12 total, 12 up, 12 in 2023-05-08T13:35:23.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:23 smithi186 ceph-mon[126480]: pgmap v18968: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 530 KiB/s rd, 350 KiB/s wr, 9 op/s 2023-05-08T13:35:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35463.381214 secs 2023-05-08T13:35:24.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35463.381214 secs 2023-05-08T13:35:25.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35463.381214 secs 2023-05-08T13:35:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35463.935770 secs 2023-05-08T13:35:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:25 smithi186 ceph-mon[126480]: pgmap v18969: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 59 KiB/s wr, 8 op/s 2023-05-08T13:35:25.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35463.935770 secs 2023-05-08T13:35:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:25 smithi133 ceph-mon[125939]: pgmap v18969: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 59 KiB/s wr, 8 op/s 2023-05-08T13:35:26.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35463.935770 secs 2023-05-08T13:35:26.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:25 smithi096 ceph-mon[124666]: pgmap v18969: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 59 KiB/s wr, 8 op/s 2023-05-08T13:35:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35465.239720 secs 2023-05-08T13:35:26.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35465.239720 secs 2023-05-08T13:35:27.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35465.239720 secs 2023-05-08T13:35:27.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:27 smithi186 ceph-mon[126480]: pgmap v18970: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 59 KiB/s wr, 8 op/s 2023-05-08T13:35:27.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:27 smithi133 ceph-mon[125939]: pgmap v18970: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 59 KiB/s wr, 8 op/s 2023-05-08T13:35:28.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:27 smithi096 ceph-mon[124666]: pgmap v18970: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 59 KiB/s wr, 8 op/s 2023-05-08T13:35:29.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35468.381329 secs 2023-05-08T13:35:29.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:29 smithi133 ceph-mon[125939]: pgmap v18971: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 59 KiB/s wr, 8 op/s 2023-05-08T13:35:30.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35468.381329 secs 2023-05-08T13:35:30.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:29 smithi096 ceph-mon[124666]: pgmap v18971: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 59 KiB/s wr, 8 op/s 2023-05-08T13:35:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35468.381329 secs 2023-05-08T13:35:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:29 smithi186 ceph-mon[126480]: pgmap v18971: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 59 KiB/s wr, 8 op/s 2023-05-08T13:35:30.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35468.935845 secs 2023-05-08T13:35:31.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35468.935845 secs 2023-05-08T13:35:31.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35468.935845 secs 2023-05-08T13:35:31.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35470.239841 secs 2023-05-08T13:35:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:31 smithi133 ceph-mon[125939]: pgmap v18972: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 8 op/s 2023-05-08T13:35:32.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35470.239841 secs 2023-05-08T13:35:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:31 smithi096 ceph-mon[124666]: pgmap v18972: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 8 op/s 2023-05-08T13:35:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35470.239841 secs 2023-05-08T13:35:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:31 smithi186 ceph-mon[126480]: pgmap v18972: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 8 op/s 2023-05-08T13:35:33.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:33 smithi133 ceph-mon[125939]: pgmap v18973: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 8 op/s 2023-05-08T13:35:33.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:33 smithi096 ceph-mon[124666]: pgmap v18973: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 8 op/s 2023-05-08T13:35:33.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:33 smithi186 ceph-mon[126480]: pgmap v18973: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 8 op/s 2023-05-08T13:35:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35473.381448 secs 2023-05-08T13:35:34.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35473.381448 secs 2023-05-08T13:35:35.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35473.381448 secs 2023-05-08T13:35:35.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35473.935969 secs 2023-05-08T13:35:35.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:35 smithi186 ceph-mon[126480]: pgmap v18974: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 173 KiB/s wr, 10 op/s 2023-05-08T13:35:35.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35473.935969 secs 2023-05-08T13:35:35.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:35 smithi133 ceph-mon[125939]: pgmap v18974: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 173 KiB/s wr, 10 op/s 2023-05-08T13:35:36.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35473.935969 secs 2023-05-08T13:35:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:35 smithi096 ceph-mon[124666]: pgmap v18974: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 173 KiB/s wr, 10 op/s 2023-05-08T13:35:36.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35475.239923 secs 2023-05-08T13:35:36.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35475.239923 secs 2023-05-08T13:35:37.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35475.239923 secs 2023-05-08T13:35:37.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:37 smithi186 ceph-mon[126480]: pgmap v18975: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 149 KiB/s wr, 6 op/s 2023-05-08T13:35:37.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:37 smithi133 ceph-mon[125939]: pgmap v18975: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 149 KiB/s wr, 6 op/s 2023-05-08T13:35:38.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:37 smithi096 ceph-mon[124666]: pgmap v18975: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 149 KiB/s wr, 6 op/s 2023-05-08T13:35:39.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35478.381563 secs 2023-05-08T13:35:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:39 smithi133 ceph-mon[125939]: pgmap v18976: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 149 KiB/s wr, 6 op/s 2023-05-08T13:35:40.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35478.381563 secs 2023-05-08T13:35:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:39 smithi096 ceph-mon[124666]: pgmap v18976: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 149 KiB/s wr, 6 op/s 2023-05-08T13:35:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35478.381563 secs 2023-05-08T13:35:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:39 smithi186 ceph-mon[126480]: pgmap v18976: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 149 KiB/s wr, 6 op/s 2023-05-08T13:35:40.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35478.936093 secs 2023-05-08T13:35:41.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35478.936093 secs 2023-05-08T13:35:41.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35478.936093 secs 2023-05-08T13:35:41.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35480.240040 secs 2023-05-08T13:35:41.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:41 smithi133 ceph-mon[125939]: pgmap v18977: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 149 KiB/s wr, 9 op/s 2023-05-08T13:35:42.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35480.240040 secs 2023-05-08T13:35:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:41 smithi096 ceph-mon[124666]: pgmap v18977: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 149 KiB/s wr, 9 op/s 2023-05-08T13:35:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35480.240040 secs 2023-05-08T13:35:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:41 smithi186 ceph-mon[126480]: pgmap v18977: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 149 KiB/s wr, 9 op/s 2023-05-08T13:35:43.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:43 smithi133 ceph-mon[125939]: pgmap v18978: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 148 KiB/s wr, 6 op/s 2023-05-08T13:35:43.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:43 smithi096 ceph-mon[124666]: pgmap v18978: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 148 KiB/s wr, 6 op/s 2023-05-08T13:35:43.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:43 smithi186 ceph-mon[126480]: pgmap v18978: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 148 KiB/s wr, 6 op/s 2023-05-08T13:35:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35483.381682 secs 2023-05-08T13:35:44.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35483.381682 secs 2023-05-08T13:35:45.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35483.381682 secs 2023-05-08T13:35:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35483.936214 secs 2023-05-08T13:35:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:45 smithi186 ceph-mon[126480]: pgmap v18979: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 735 KiB/s wr, 10 op/s 2023-05-08T13:35:45.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35483.936214 secs 2023-05-08T13:35:45.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:45 smithi133 ceph-mon[125939]: pgmap v18979: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 735 KiB/s wr, 10 op/s 2023-05-08T13:35:46.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35483.936214 secs 2023-05-08T13:35:46.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:45 smithi096 ceph-mon[124666]: pgmap v18979: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 735 KiB/s wr, 10 op/s 2023-05-08T13:35:47.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:47 smithi133 ceph-mon[125939]: pgmap v18980: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 586 KiB/s wr, 7 op/s 2023-05-08T13:35:48.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:47 smithi096 ceph-mon[124666]: pgmap v18980: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 586 KiB/s wr, 7 op/s 2023-05-08T13:35:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:47 smithi186 ceph-mon[126480]: pgmap v18980: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 586 KiB/s wr, 7 op/s 2023-05-08T13:35:49.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35488.381812 secs 2023-05-08T13:35:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:49 smithi133 ceph-mon[125939]: pgmap v18981: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 586 KiB/s wr, 7 op/s 2023-05-08T13:35:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:35:50.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35488.381812 secs 2023-05-08T13:35:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:49 smithi096 ceph-mon[124666]: pgmap v18981: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 586 KiB/s wr, 7 op/s 2023-05-08T13:35:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:35:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35488.381812 secs 2023-05-08T13:35:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:49 smithi186 ceph-mon[126480]: pgmap v18981: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 586 KiB/s wr, 7 op/s 2023-05-08T13:35:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:35:50.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35488.936337 secs 2023-05-08T13:35:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:35:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:35:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:35:51.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35488.936337 secs 2023-05-08T13:35:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:35:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:35:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:35:51.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35488.936337 secs 2023-05-08T13:35:51.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:35:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:35:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:35:51.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:51 smithi133 ceph-mon[125939]: pgmap v18982: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 739 KiB/s rd, 590 KiB/s wr, 11 op/s 2023-05-08T13:35:52.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:51 smithi096 ceph-mon[124666]: pgmap v18982: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 739 KiB/s rd, 590 KiB/s wr, 11 op/s 2023-05-08T13:35:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:51 smithi186 ceph-mon[126480]: pgmap v18982: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 739 KiB/s rd, 590 KiB/s wr, 11 op/s 2023-05-08T13:35:53.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:53 smithi133 ceph-mon[125939]: pgmap v18983: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 738 KiB/s rd, 590 KiB/s wr, 7 op/s 2023-05-08T13:35:53.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:53 smithi096 ceph-mon[124666]: pgmap v18983: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 738 KiB/s rd, 590 KiB/s wr, 7 op/s 2023-05-08T13:35:53.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:53 smithi186 ceph-mon[126480]: pgmap v18983: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 738 KiB/s rd, 590 KiB/s wr, 7 op/s 2023-05-08T13:35:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35493.381940 secs 2023-05-08T13:35:54.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35493.381940 secs 2023-05-08T13:35:55.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35493.381940 secs 2023-05-08T13:35:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:55 smithi186 ceph-mon[126480]: pgmap v18984: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T13:35:55.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:55 smithi133 ceph-mon[125939]: pgmap v18984: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T13:35:56.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:55 smithi096 ceph-mon[124666]: pgmap v18984: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T13:35:57.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:57 smithi133 ceph-mon[125939]: pgmap v18985: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 616 KiB/s wr, 8 op/s 2023-05-08T13:35:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:35:58.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:57 smithi096 ceph-mon[124666]: pgmap v18985: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 616 KiB/s wr, 8 op/s 2023-05-08T13:35:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:35:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:57 smithi186 ceph-mon[126480]: pgmap v18985: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 616 KiB/s wr, 8 op/s 2023-05-08T13:35:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:35:58.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:58 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:35:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:35:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:35:59.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:58 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:35:59.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:35:59.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:35:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:58 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:35:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:35:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:35:59.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35498.382061 secs 2023-05-08T13:35:59.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:35:59 smithi133 ceph-mon[125939]: pgmap v18986: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 616 KiB/s wr, 8 op/s 2023-05-08T13:36:00.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35498.382061 secs 2023-05-08T13:36:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:35:59 smithi096 ceph-mon[124666]: pgmap v18986: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 616 KiB/s wr, 8 op/s 2023-05-08T13:36:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35498.382061 secs 2023-05-08T13:36:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:35:59 smithi186 ceph-mon[126480]: pgmap v18986: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 616 KiB/s wr, 8 op/s 2023-05-08T13:36:01.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:01 smithi133 ceph-mon[125939]: pgmap v18987: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T13:36:02.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:01 smithi096 ceph-mon[124666]: pgmap v18987: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T13:36:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:01 smithi186 ceph-mon[126480]: pgmap v18987: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T13:36:03.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:03 smithi133 ceph-mon[125939]: pgmap v18988: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T13:36:03.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:03 smithi096 ceph-mon[124666]: pgmap v18988: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T13:36:03.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:03 smithi186 ceph-mon[126480]: pgmap v18988: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T13:36:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35503.382197 secs 2023-05-08T13:36:04.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35503.382197 secs 2023-05-08T13:36:05.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35503.382197 secs 2023-05-08T13:36:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35503.936691 secs 2023-05-08T13:36:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:05 smithi186 ceph-mon[126480]: pgmap v18989: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 28 op/s 2023-05-08T13:36:05.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35503.936691 secs 2023-05-08T13:36:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:05 smithi133 ceph-mon[125939]: pgmap v18989: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 28 op/s 2023-05-08T13:36:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35503.936691 secs 2023-05-08T13:36:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:05 smithi096 ceph-mon[124666]: pgmap v18989: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 28 op/s 2023-05-08T13:36:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:06 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:36:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:36:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:36:06.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:06 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:36:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:36:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:36:07.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:06 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:36:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:36:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:36:07.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:07 smithi186 ceph-mon[126480]: pgmap v18990: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 23 op/s 2023-05-08T13:36:07.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:07 smithi133 ceph-mon[125939]: pgmap v18990: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 23 op/s 2023-05-08T13:36:08.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:07 smithi096 ceph-mon[124666]: pgmap v18990: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 23 op/s 2023-05-08T13:36:09.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35508.382318 secs 2023-05-08T13:36:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:09 smithi133 ceph-mon[125939]: pgmap v18991: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 23 op/s 2023-05-08T13:36:10.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35508.382318 secs 2023-05-08T13:36:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:09 smithi096 ceph-mon[124666]: pgmap v18991: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 23 op/s 2023-05-08T13:36:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35508.382318 secs 2023-05-08T13:36:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:09 smithi186 ceph-mon[126480]: pgmap v18991: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 23 op/s 2023-05-08T13:36:10.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35508.936815 secs 2023-05-08T13:36:11.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35508.936815 secs 2023-05-08T13:36:11.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35508.936815 secs 2023-05-08T13:36:11.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:11 smithi133 ceph-mon[125939]: pgmap v18992: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 28 op/s 2023-05-08T13:36:12.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:11 smithi096 ceph-mon[124666]: pgmap v18992: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 28 op/s 2023-05-08T13:36:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:11 smithi186 ceph-mon[126480]: pgmap v18992: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 28 op/s 2023-05-08T13:36:13.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:13 smithi133 ceph-mon[125939]: pgmap v18993: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 727 KiB/s rd, 740 KiB/s wr, 22 op/s 2023-05-08T13:36:13.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:13 smithi096 ceph-mon[124666]: pgmap v18993: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 727 KiB/s rd, 740 KiB/s wr, 22 op/s 2023-05-08T13:36:13.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:13 smithi186 ceph-mon[126480]: pgmap v18993: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 727 KiB/s rd, 740 KiB/s wr, 22 op/s 2023-05-08T13:36:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35513.382416 secs 2023-05-08T13:36:14.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35513.382416 secs 2023-05-08T13:36:15.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35513.382416 secs 2023-05-08T13:36:15.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35513.936944 secs 2023-05-08T13:36:15.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:15 smithi186 ceph-mon[126480]: pgmap v18994: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 26 op/s 2023-05-08T13:36:15.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35513.936944 secs 2023-05-08T13:36:15.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:15 smithi133 ceph-mon[125939]: pgmap v18994: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 26 op/s 2023-05-08T13:36:16.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35513.936944 secs 2023-05-08T13:36:16.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:15 smithi096 ceph-mon[124666]: pgmap v18994: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 26 op/s 2023-05-08T13:36:17.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:17 smithi133 ceph-mon[125939]: pgmap v18995: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 491 KiB/s wr, 8 op/s 2023-05-08T13:36:18.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:17 smithi096 ceph-mon[124666]: pgmap v18995: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 491 KiB/s wr, 8 op/s 2023-05-08T13:36:18.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:17 smithi186 ceph-mon[126480]: pgmap v18995: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 491 KiB/s wr, 8 op/s 2023-05-08T13:36:19.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35518.382554 secs 2023-05-08T13:36:19.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:19 smithi133 ceph-mon[125939]: pgmap v18996: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 491 KiB/s wr, 8 op/s 2023-05-08T13:36:20.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35518.382554 secs 2023-05-08T13:36:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:19 smithi096 ceph-mon[124666]: pgmap v18996: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 491 KiB/s wr, 8 op/s 2023-05-08T13:36:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35518.382554 secs 2023-05-08T13:36:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:19 smithi186 ceph-mon[126480]: pgmap v18996: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 491 KiB/s wr, 8 op/s 2023-05-08T13:36:20.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35518.937044 secs 2023-05-08T13:36:20.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:20 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:36:21.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35518.937044 secs 2023-05-08T13:36:21.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:20 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:36:21.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35518.937044 secs 2023-05-08T13:36:21.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:20 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:36:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:21 smithi133 ceph-mon[125939]: pgmap v18997: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 495 KiB/s rd, 492 KiB/s wr, 11 op/s 2023-05-08T13:36:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:21 smithi096 ceph-mon[124666]: pgmap v18997: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 495 KiB/s rd, 492 KiB/s wr, 11 op/s 2023-05-08T13:36:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:21 smithi186 ceph-mon[126480]: pgmap v18997: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 495 KiB/s rd, 492 KiB/s wr, 11 op/s 2023-05-08T13:36:23.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:23 smithi133 ceph-mon[125939]: pgmap v18998: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 318 KiB/s wr, 7 op/s 2023-05-08T13:36:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:36:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:36:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:36:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:36:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:36:23.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:36:23.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:23 smithi096 ceph-mon[124666]: pgmap v18998: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 318 KiB/s wr, 7 op/s 2023-05-08T13:36:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:36:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:36:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:36:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:36:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:36:23.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:36:23.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:23 smithi186 ceph-mon[126480]: pgmap v18998: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 318 KiB/s wr, 7 op/s 2023-05-08T13:36:23.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:36:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:36:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:36:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:36:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:36:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:36:24.468 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:36:24.468 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:36:24.468 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:36:24.468 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:36:24.468 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:36:24.469 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:24 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi133 to 111.4M 2023-05-08T13:36:24.469 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:24 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi133 to 116900286: error parsing value: Value '116900286' is below minimum 939524096 2023-05-08T13:36:24.469 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:36:24.469 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:36:24.469 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:36:24.469 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:36:24.469 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:24 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi186 to 99.72M 2023-05-08T13:36:24.470 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:24 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi186 to 104569458: error parsing value: Value '104569458' is below minimum 939524096 2023-05-08T13:36:24.470 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:36:24.470 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:36:24.470 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:24 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:36:24.470 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:36:24.470 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:24 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T13:36:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:36:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:36:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:36:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:36:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:36:24.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:24 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi133 to 111.4M 2023-05-08T13:36:24.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:24 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi133 to 116900286: error parsing value: Value '116900286' is below minimum 939524096 2023-05-08T13:36:24.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:36:24.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:36:24.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:36:24.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:36:24.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:24 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi186 to 99.72M 2023-05-08T13:36:24.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:24 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi186 to 104569458: error parsing value: Value '104569458' is below minimum 939524096 2023-05-08T13:36:24.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:36:24.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:36:24.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:24 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:36:24.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:36:24.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:24 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T13:36:24.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:24 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T13:36:24.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:24 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:36:24.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:36:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:36:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:36:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:36:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:36:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:24 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi133 to 111.4M 2023-05-08T13:36:24.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:24 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi133 to 116900286: error parsing value: Value '116900286' is below minimum 939524096 2023-05-08T13:36:24.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:36:24.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:36:24.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:36:24.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:36:24.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:24 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi186 to 99.72M 2023-05-08T13:36:24.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:24 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi186 to 104569458: error parsing value: Value '104569458' is below minimum 939524096 2023-05-08T13:36:24.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:36:24.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:36:24.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:24 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:36:24.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:36:24.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:24 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T13:36:24.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:24 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T13:36:24.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:24 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:36:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:24 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T13:36:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:24 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:36:25.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35523.382642 secs 2023-05-08T13:36:25.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:25 smithi133 ceph-mon[125939]: pgmap v18999: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 922 KiB/s rd, 940 KiB/s wr, 14 op/s 2023-05-08T13:36:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:25 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:36:25.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35523.382642 secs 2023-05-08T13:36:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:25 smithi096 ceph-mon[124666]: pgmap v18999: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 922 KiB/s rd, 940 KiB/s wr, 14 op/s 2023-05-08T13:36:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:25 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:36:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35523.382642 secs 2023-05-08T13:36:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:25 smithi186 ceph-mon[126480]: pgmap v18999: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 922 KiB/s rd, 940 KiB/s wr, 14 op/s 2023-05-08T13:36:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:25 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:36:26.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:26 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:36:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:26 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:36:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:26 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:36:26.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:26 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:36:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:26 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:36:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:26 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:36:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:26 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:36:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:26 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:36:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:26 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:36:27.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:27 smithi133 ceph-mon[125939]: pgmap v19000: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 603 KiB/s rd, 623 KiB/s wr, 10 op/s 2023-05-08T13:36:27.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:27 smithi096 ceph-mon[124666]: pgmap v19000: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 603 KiB/s rd, 623 KiB/s wr, 10 op/s 2023-05-08T13:36:27.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:27 smithi186 ceph-mon[126480]: pgmap v19000: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 603 KiB/s rd, 623 KiB/s wr, 10 op/s 2023-05-08T13:36:29.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35528.382736 secs 2023-05-08T13:36:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:29 smithi133 ceph-mon[125939]: pgmap v19001: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 603 KiB/s rd, 623 KiB/s wr, 10 op/s 2023-05-08T13:36:30.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35528.382736 secs 2023-05-08T13:36:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:29 smithi096 ceph-mon[124666]: pgmap v19001: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 603 KiB/s rd, 623 KiB/s wr, 10 op/s 2023-05-08T13:36:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35528.382736 secs 2023-05-08T13:36:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:29 smithi186 ceph-mon[126480]: pgmap v19001: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 603 KiB/s rd, 623 KiB/s wr, 10 op/s 2023-05-08T13:36:31.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:31 smithi133 ceph-mon[125939]: pgmap v19002: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 606 KiB/s rd, 649 KiB/s wr, 14 op/s 2023-05-08T13:36:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:31 smithi133 ceph-mon[125939]: osdmap e1264: 12 total, 12 up, 12 in 2023-05-08T13:36:32.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:31 smithi096 ceph-mon[124666]: pgmap v19002: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 606 KiB/s rd, 649 KiB/s wr, 14 op/s 2023-05-08T13:36:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:31 smithi096 ceph-mon[124666]: osdmap e1264: 12 total, 12 up, 12 in 2023-05-08T13:36:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:31 smithi186 ceph-mon[126480]: pgmap v19002: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 606 KiB/s rd, 649 KiB/s wr, 14 op/s 2023-05-08T13:36:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:31 smithi186 ceph-mon[126480]: osdmap e1264: 12 total, 12 up, 12 in 2023-05-08T13:36:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:33 smithi133 ceph-mon[125939]: pgmap v19004: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 726 KiB/s rd, 778 KiB/s wr, 12 op/s 2023-05-08T13:36:33.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:33 smithi096 ceph-mon[124666]: pgmap v19004: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 726 KiB/s rd, 778 KiB/s wr, 12 op/s 2023-05-08T13:36:33.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:33 smithi186 ceph-mon[126480]: pgmap v19004: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 726 KiB/s rd, 778 KiB/s wr, 12 op/s 2023-05-08T13:36:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35533.382887 secs 2023-05-08T13:36:34.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35533.382887 secs 2023-05-08T13:36:35.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35533.382887 secs 2023-05-08T13:36:35.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:35 smithi186 ceph-mon[126480]: pgmap v19005: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 436 KiB/s wr, 8 op/s 2023-05-08T13:36:35.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:35 smithi133 ceph-mon[125939]: pgmap v19005: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 436 KiB/s wr, 8 op/s 2023-05-08T13:36:36.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:35 smithi096 ceph-mon[124666]: pgmap v19005: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 436 KiB/s wr, 8 op/s 2023-05-08T13:36:37.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:37 smithi133 ceph-mon[125939]: pgmap v19006: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 436 KiB/s wr, 8 op/s 2023-05-08T13:36:37.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:37 smithi133 ceph-mon[125939]: osdmap e1265: 12 total, 12 up, 12 in 2023-05-08T13:36:38.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:37 smithi096 ceph-mon[124666]: pgmap v19006: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 436 KiB/s wr, 8 op/s 2023-05-08T13:36:38.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:37 smithi096 ceph-mon[124666]: osdmap e1265: 12 total, 12 up, 12 in 2023-05-08T13:36:38.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:37 smithi186 ceph-mon[126480]: pgmap v19006: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 436 KiB/s wr, 8 op/s 2023-05-08T13:36:38.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:37 smithi186 ceph-mon[126480]: osdmap e1265: 12 total, 12 up, 12 in 2023-05-08T13:36:39.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35538.383008 secs 2023-05-08T13:36:39.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:39 smithi133 ceph-mon[125939]: pgmap v19008: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 505 KiB/s wr, 5 op/s 2023-05-08T13:36:40.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35538.383008 secs 2023-05-08T13:36:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:39 smithi096 ceph-mon[124666]: pgmap v19008: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 505 KiB/s wr, 5 op/s 2023-05-08T13:36:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35538.383008 secs 2023-05-08T13:36:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:39 smithi186 ceph-mon[126480]: pgmap v19008: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 505 KiB/s wr, 5 op/s 2023-05-08T13:36:42.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35540.241443 secs 2023-05-08T13:36:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:41 smithi096 ceph-mon[124666]: pgmap v19009: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 738 KiB/s rd, 482 KiB/s wr, 9 op/s 2023-05-08T13:36:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35540.241443 secs 2023-05-08T13:36:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:41 smithi186 ceph-mon[126480]: pgmap v19009: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 738 KiB/s rd, 482 KiB/s wr, 9 op/s 2023-05-08T13:36:42.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35540.241443 secs 2023-05-08T13:36:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:41 smithi133 ceph-mon[125939]: pgmap v19009: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 738 KiB/s rd, 482 KiB/s wr, 9 op/s 2023-05-08T13:36:43.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:42 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:36:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:42 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:36:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:42 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:36:43.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:42 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:36:43.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:42 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:36:43.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:42 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:36:43.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:42 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:36:43.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:42 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:36:43.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:42 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:36:44.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:43 smithi096 ceph-mon[124666]: pgmap v19010: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 734 KiB/s rd, 479 KiB/s wr, 9 op/s 2023-05-08T13:36:44.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:43 smithi186 ceph-mon[126480]: pgmap v19010: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 734 KiB/s rd, 479 KiB/s wr, 9 op/s 2023-05-08T13:36:44.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:43 smithi133 ceph-mon[125939]: pgmap v19010: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 734 KiB/s rd, 479 KiB/s wr, 9 op/s 2023-05-08T13:36:45.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35543.383131 secs 2023-05-08T13:36:45.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35543.383131 secs 2023-05-08T13:36:45.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35543.383131 secs 2023-05-08T13:36:46.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35543.937630 secs 2023-05-08T13:36:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:45 smithi096 ceph-mon[124666]: pgmap v19011: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T13:36:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35543.937630 secs 2023-05-08T13:36:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:45 smithi186 ceph-mon[126480]: pgmap v19011: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T13:36:46.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35543.937630 secs 2023-05-08T13:36:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:45 smithi133 ceph-mon[125939]: pgmap v19011: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T13:36:47.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:46 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:36:47.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:46 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:36:47.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:46 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:36:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:46 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:36:47.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:46 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:36:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:46 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:36:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:47 smithi186 ceph-mon[126480]: pgmap v19012: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T13:36:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:47 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:36:48.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:47 smithi133 ceph-mon[125939]: pgmap v19012: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T13:36:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:47 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:36:48.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:47 smithi096 ceph-mon[124666]: pgmap v19012: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T13:36:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:47 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:36:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35548.383251 secs 2023-05-08T13:36:50.224 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:49 smithi186 ceph-mon[126480]: pgmap v19013: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T13:36:50.225 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:36:50.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35548.383251 secs 2023-05-08T13:36:50.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:49 smithi133 ceph-mon[125939]: pgmap v19013: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T13:36:50.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:36:50.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35548.383251 secs 2023-05-08T13:36:50.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:49 smithi096 ceph-mon[124666]: pgmap v19013: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T13:36:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:36:51.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:36:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:36:51.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:36:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:36:51.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:36:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:36:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:51 smithi186 ceph-mon[126480]: pgmap v19014: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.2 MiB/s wr, 15 op/s 2023-05-08T13:36:52.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:51 smithi133 ceph-mon[125939]: pgmap v19014: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.2 MiB/s wr, 15 op/s 2023-05-08T13:36:52.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:51 smithi096 ceph-mon[124666]: pgmap v19014: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.2 MiB/s wr, 15 op/s 2023-05-08T13:36:53.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:52 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:36:53.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:52 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:36:53.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:52 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:36:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:53 smithi186 ceph-mon[126480]: pgmap v19015: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 11 op/s 2023-05-08T13:36:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:53 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:36:54.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:53 smithi133 ceph-mon[125939]: pgmap v19015: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 11 op/s 2023-05-08T13:36:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:53 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:36:54.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:53 smithi096 ceph-mon[124666]: pgmap v19015: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 11 op/s 2023-05-08T13:36:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:53 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:36:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35553.383387 secs 2023-05-08T13:36:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:54 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:36:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:54 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:36:55.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35553.383387 secs 2023-05-08T13:36:55.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:54 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:36:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:54 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:36:55.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35553.383387 secs 2023-05-08T13:36:55.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:54 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:36:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:54 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:36:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:55 smithi186 ceph-mon[126480]: pgmap v19016: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.4 MiB/s wr, 17 op/s 2023-05-08T13:36:56.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:55 smithi133 ceph-mon[125939]: pgmap v19016: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.4 MiB/s wr, 17 op/s 2023-05-08T13:36:56.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:55 smithi096 ceph-mon[124666]: pgmap v19016: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.4 MiB/s wr, 17 op/s 2023-05-08T13:36:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:57 smithi186 ceph-mon[126480]: pgmap v19017: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 12 op/s 2023-05-08T13:36:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:57 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:36:58.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:57 smithi133 ceph-mon[125939]: pgmap v19017: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 12 op/s 2023-05-08T13:36:58.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:57 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:36:58.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:57 smithi096 ceph-mon[124666]: pgmap v19017: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 12 op/s 2023-05-08T13:36:58.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:57 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:37:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35558.383504 secs 2023-05-08T13:37:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:36:59 smithi186 ceph-mon[126480]: pgmap v19018: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 12 op/s 2023-05-08T13:37:00.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35558.383504 secs 2023-05-08T13:37:00.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:36:59 smithi133 ceph-mon[125939]: pgmap v19018: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 12 op/s 2023-05-08T13:37:00.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35558.383504 secs 2023-05-08T13:37:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:36:59 smithi096 ceph-mon[124666]: pgmap v19018: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 12 op/s 2023-05-08T13:37:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35558.938001 secs 2023-05-08T13:37:01.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35558.938001 secs 2023-05-08T13:37:01.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35558.938001 secs 2023-05-08T13:37:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:01 smithi186 ceph-mon[126480]: pgmap v19019: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 17 op/s 2023-05-08T13:37:02.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:01 smithi133 ceph-mon[125939]: pgmap v19019: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 17 op/s 2023-05-08T13:37:02.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:01 smithi096 ceph-mon[124666]: pgmap v19019: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 17 op/s 2023-05-08T13:37:03.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:37:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:37:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:02 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:37:03.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:37:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:37:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:02 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:37:03.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:37:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:37:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:02 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:37:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:03 smithi186 ceph-mon[126480]: pgmap v19020: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 898 KiB/s wr, 11 op/s 2023-05-08T13:37:04.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:03 smithi133 ceph-mon[125939]: pgmap v19020: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 898 KiB/s wr, 11 op/s 2023-05-08T13:37:04.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:03 smithi096 ceph-mon[124666]: pgmap v19020: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 898 KiB/s wr, 11 op/s 2023-05-08T13:37:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35563.383626 secs 2023-05-08T13:37:05.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35563.383626 secs 2023-05-08T13:37:05.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35563.383626 secs 2023-05-08T13:37:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:05 smithi186 ceph-mon[126480]: pgmap v19021: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 28 op/s 2023-05-08T13:37:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:05 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:37:06.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:05 smithi133 ceph-mon[125939]: pgmap v19021: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 28 op/s 2023-05-08T13:37:06.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:05 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:37:06.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:05 smithi096 ceph-mon[124666]: pgmap v19021: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 28 op/s 2023-05-08T13:37:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:05 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:37:07.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:37:07.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:37:07.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:37:07.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:37:07.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:37:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:37:08.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:07 smithi186 ceph-mon[126480]: pgmap v19022: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.6 MiB/s wr, 22 op/s 2023-05-08T13:37:08.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:07 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:37:08.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:07 smithi133 ceph-mon[125939]: pgmap v19022: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.6 MiB/s wr, 22 op/s 2023-05-08T13:37:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:07 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:37:08.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:07 smithi096 ceph-mon[124666]: pgmap v19022: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.6 MiB/s wr, 22 op/s 2023-05-08T13:37:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:07 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:37:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35568.383744 secs 2023-05-08T13:37:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:09 smithi186 ceph-mon[126480]: pgmap v19023: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.6 MiB/s wr, 22 op/s 2023-05-08T13:37:10.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35568.383744 secs 2023-05-08T13:37:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:09 smithi133 ceph-mon[125939]: pgmap v19023: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.6 MiB/s wr, 22 op/s 2023-05-08T13:37:10.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35568.383744 secs 2023-05-08T13:37:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:09 smithi096 ceph-mon[124666]: pgmap v19023: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.6 MiB/s wr, 22 op/s 2023-05-08T13:37:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:11 smithi186 ceph-mon[126480]: pgmap v19024: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 27 op/s 2023-05-08T13:37:12.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:11 smithi133 ceph-mon[125939]: pgmap v19024: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 27 op/s 2023-05-08T13:37:12.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:11 smithi096 ceph-mon[124666]: pgmap v19024: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 27 op/s 2023-05-08T13:37:13.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:13 smithi133 ceph-mon[125939]: pgmap v19025: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 22 op/s 2023-05-08T13:37:13.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:13 smithi096 ceph-mon[124666]: pgmap v19025: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 22 op/s 2023-05-08T13:37:13.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:13 smithi186 ceph-mon[126480]: pgmap v19025: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 22 op/s 2023-05-08T13:37:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35573.383861 secs 2023-05-08T13:37:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35573.383861 secs 2023-05-08T13:37:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35573.383861 secs 2023-05-08T13:37:15.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:15 smithi186 ceph-mon[126480]: pgmap v19026: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 26 op/s 2023-05-08T13:37:15.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:15 smithi133 ceph-mon[125939]: pgmap v19026: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 26 op/s 2023-05-08T13:37:16.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:15 smithi096 ceph-mon[124666]: pgmap v19026: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 26 op/s 2023-05-08T13:37:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:17 smithi096 ceph-mon[124666]: pgmap v19027: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 834 KiB/s wr, 10 op/s 2023-05-08T13:37:18.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:17 smithi186 ceph-mon[126480]: pgmap v19027: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 834 KiB/s wr, 10 op/s 2023-05-08T13:37:18.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:17 smithi133 ceph-mon[125939]: pgmap v19027: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 834 KiB/s wr, 10 op/s 2023-05-08T13:37:20.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35578.383978 secs 2023-05-08T13:37:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:19 smithi096 ceph-mon[124666]: pgmap v19028: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 493 KiB/s wr, 9 op/s 2023-05-08T13:37:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35578.383978 secs 2023-05-08T13:37:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:19 smithi186 ceph-mon[126480]: pgmap v19028: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 493 KiB/s wr, 9 op/s 2023-05-08T13:37:20.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35578.383978 secs 2023-05-08T13:37:20.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:19 smithi133 ceph-mon[125939]: pgmap v19028: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 493 KiB/s wr, 9 op/s 2023-05-08T13:37:22.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35580.242325 secs 2023-05-08T13:37:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:21 smithi096 ceph-mon[124666]: pgmap v19029: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 668 KiB/s wr, 13 op/s 2023-05-08T13:37:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35580.242325 secs 2023-05-08T13:37:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:21 smithi186 ceph-mon[126480]: pgmap v19029: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 668 KiB/s wr, 13 op/s 2023-05-08T13:37:22.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35580.242325 secs 2023-05-08T13:37:22.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:21 smithi133 ceph-mon[125939]: pgmap v19029: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 668 KiB/s wr, 13 op/s 2023-05-08T13:37:23.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:22 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:37:23.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:22 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:37:23.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:22 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:37:23.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:22 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:37:23.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:22 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:37:23.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:22 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:37:23.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:22 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:37:23.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:22 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:37:23.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:22 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:37:24.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:23 smithi096 ceph-mon[124666]: pgmap v19030: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 203 KiB/s wr, 8 op/s 2023-05-08T13:37:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:23 smithi186 ceph-mon[126480]: pgmap v19030: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 203 KiB/s wr, 8 op/s 2023-05-08T13:37:24.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:23 smithi133 ceph-mon[125939]: pgmap v19030: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 203 KiB/s wr, 8 op/s 2023-05-08T13:37:25.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35583.384101 secs 2023-05-08T13:37:25.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:37:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:37:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:37:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:37:25.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35583.384101 secs 2023-05-08T13:37:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:37:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:37:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:37:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:37:25.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35583.384101 secs 2023-05-08T13:37:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:37:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:37:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:37:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:37:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35583.938510 secs 2023-05-08T13:37:26.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:25 smithi186 ceph-mon[126480]: pgmap v19031: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 411 KiB/s rd, 430 KiB/s wr, 14 op/s 2023-05-08T13:37:26.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:25 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:37:26.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:25 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T13:37:26.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:25 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T13:37:26.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:25 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:37:26.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35583.938510 secs 2023-05-08T13:37:26.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:25 smithi133 ceph-mon[125939]: pgmap v19031: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 411 KiB/s rd, 430 KiB/s wr, 14 op/s 2023-05-08T13:37:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:25 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:37:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:25 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T13:37:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:25 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T13:37:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:25 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:37:26.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35583.938510 secs 2023-05-08T13:37:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:25 smithi096 ceph-mon[124666]: pgmap v19031: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 411 KiB/s rd, 430 KiB/s wr, 14 op/s 2023-05-08T13:37:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:25 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:37:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:25 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T13:37:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:25 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T13:37:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:25 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:37:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35585.242438 secs 2023-05-08T13:37:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:26 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:37:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:26 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:37:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:26 smithi186 ceph-mon[126480]: osdmap e1266: 12 total, 12 up, 12 in 2023-05-08T13:37:27.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35585.242438 secs 2023-05-08T13:37:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:26 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:37:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:26 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:37:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:26 smithi133 ceph-mon[125939]: osdmap e1266: 12 total, 12 up, 12 in 2023-05-08T13:37:27.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35585.242438 secs 2023-05-08T13:37:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:26 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:37:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:26 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:37:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:26 smithi096 ceph-mon[124666]: osdmap e1266: 12 total, 12 up, 12 in 2023-05-08T13:37:28.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:27 smithi186 ceph-mon[126480]: pgmap v19033: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 483 KiB/s wr, 12 op/s 2023-05-08T13:37:28.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:27 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:37:28.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:27 smithi133 ceph-mon[125939]: pgmap v19033: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 483 KiB/s wr, 12 op/s 2023-05-08T13:37:28.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:27 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:37:28.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:27 smithi096 ceph-mon[124666]: pgmap v19033: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 483 KiB/s wr, 12 op/s 2023-05-08T13:37:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:27 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:37:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35588.384217 secs 2023-05-08T13:37:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:29 smithi186 ceph-mon[126480]: pgmap v19034: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 483 KiB/s wr, 12 op/s 2023-05-08T13:37:30.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35588.384217 secs 2023-05-08T13:37:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:29 smithi133 ceph-mon[125939]: pgmap v19034: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 483 KiB/s wr, 12 op/s 2023-05-08T13:37:30.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35588.384217 secs 2023-05-08T13:37:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:29 smithi096 ceph-mon[124666]: pgmap v19034: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 483 KiB/s wr, 12 op/s 2023-05-08T13:37:31.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35588.938629 secs 2023-05-08T13:37:31.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35588.938629 secs 2023-05-08T13:37:31.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35588.938629 secs 2023-05-08T13:37:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35590.242579 secs 2023-05-08T13:37:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:31 smithi186 ceph-mon[126480]: pgmap v19035: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 871 KiB/s rd, 685 KiB/s wr, 13 op/s 2023-05-08T13:37:32.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35590.242579 secs 2023-05-08T13:37:32.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:31 smithi133 ceph-mon[125939]: pgmap v19035: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 871 KiB/s rd, 685 KiB/s wr, 13 op/s 2023-05-08T13:37:32.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35590.242579 secs 2023-05-08T13:37:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:31 smithi096 ceph-mon[124666]: pgmap v19035: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 871 KiB/s rd, 685 KiB/s wr, 13 op/s 2023-05-08T13:37:33.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:33 smithi133 ceph-mon[125939]: osdmap e1267: 12 total, 12 up, 12 in 2023-05-08T13:37:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:33 smithi133 ceph-mon[125939]: pgmap v19037: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 516 KiB/s wr, 6 op/s 2023-05-08T13:37:33.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:33 smithi096 ceph-mon[124666]: osdmap e1267: 12 total, 12 up, 12 in 2023-05-08T13:37:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:33 smithi096 ceph-mon[124666]: pgmap v19037: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 516 KiB/s wr, 6 op/s 2023-05-08T13:37:33.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:33 smithi186 ceph-mon[126480]: osdmap e1267: 12 total, 12 up, 12 in 2023-05-08T13:37:33.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:33 smithi186 ceph-mon[126480]: pgmap v19037: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 516 KiB/s wr, 6 op/s 2023-05-08T13:37:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35593.384362 secs 2023-05-08T13:37:34.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35593.384362 secs 2023-05-08T13:37:35.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35593.384362 secs 2023-05-08T13:37:35.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35593.938692 secs 2023-05-08T13:37:35.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:35 smithi186 ceph-mon[126480]: pgmap v19038: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 667 KiB/s rd, 664 KiB/s wr, 11 op/s 2023-05-08T13:37:35.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35593.938692 secs 2023-05-08T13:37:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:35 smithi133 ceph-mon[125939]: pgmap v19038: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 667 KiB/s rd, 664 KiB/s wr, 11 op/s 2023-05-08T13:37:36.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35593.938692 secs 2023-05-08T13:37:36.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:35 smithi096 ceph-mon[124666]: pgmap v19038: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 667 KiB/s rd, 664 KiB/s wr, 11 op/s 2023-05-08T13:37:36.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35595.242697 secs 2023-05-08T13:37:36.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35595.242697 secs 2023-05-08T13:37:37.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35595.242697 secs 2023-05-08T13:37:37.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:37 smithi186 ceph-mon[126480]: pgmap v19039: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 595 KiB/s rd, 593 KiB/s wr, 10 op/s 2023-05-08T13:37:37.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:37 smithi133 ceph-mon[125939]: pgmap v19039: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 595 KiB/s rd, 593 KiB/s wr, 10 op/s 2023-05-08T13:37:38.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:37 smithi096 ceph-mon[124666]: pgmap v19039: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 595 KiB/s rd, 593 KiB/s wr, 10 op/s 2023-05-08T13:37:40.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35598.384456 secs 2023-05-08T13:37:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:39 smithi096 ceph-mon[124666]: pgmap v19040: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 595 KiB/s rd, 593 KiB/s wr, 10 op/s 2023-05-08T13:37:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35598.384456 secs 2023-05-08T13:37:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:39 smithi186 ceph-mon[126480]: pgmap v19040: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 595 KiB/s rd, 593 KiB/s wr, 10 op/s 2023-05-08T13:37:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35598.384456 secs 2023-05-08T13:37:40.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:39 smithi133 ceph-mon[125939]: pgmap v19040: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 595 KiB/s rd, 593 KiB/s wr, 10 op/s 2023-05-08T13:37:41.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35598.938819 secs 2023-05-08T13:37:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35598.938819 secs 2023-05-08T13:37:41.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35598.938819 secs 2023-05-08T13:37:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35600.242813 secs 2023-05-08T13:37:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:41 smithi186 ceph-mon[126480]: pgmap v19041: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 535 KiB/s wr, 8 op/s 2023-05-08T13:37:42.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35600.242813 secs 2023-05-08T13:37:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:41 smithi133 ceph-mon[125939]: pgmap v19041: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 535 KiB/s wr, 8 op/s 2023-05-08T13:37:42.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35600.242813 secs 2023-05-08T13:37:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:41 smithi096 ceph-mon[124666]: pgmap v19041: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 535 KiB/s wr, 8 op/s 2023-05-08T13:37:43.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:43 smithi096 ceph-mon[124666]: pgmap v19042: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 524 KiB/s wr, 7 op/s 2023-05-08T13:37:43.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:43 smithi186 ceph-mon[126480]: pgmap v19042: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 524 KiB/s wr, 7 op/s 2023-05-08T13:37:43.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:43 smithi133 ceph-mon[125939]: pgmap v19042: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 524 KiB/s wr, 7 op/s 2023-05-08T13:37:44.586 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35603.384585 secs 2023-05-08T13:37:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35603.384585 secs 2023-05-08T13:37:45.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35603.384585 secs 2023-05-08T13:37:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35603.938935 secs 2023-05-08T13:37:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:45 smithi186 ceph-mon[126480]: pgmap v19043: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 449 KiB/s rd, 715 KiB/s wr, 10 op/s 2023-05-08T13:37:45.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35603.938935 secs 2023-05-08T13:37:45.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:45 smithi133 ceph-mon[125939]: pgmap v19043: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 449 KiB/s rd, 715 KiB/s wr, 10 op/s 2023-05-08T13:37:46.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35603.938935 secs 2023-05-08T13:37:46.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:45 smithi096 ceph-mon[124666]: pgmap v19043: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 449 KiB/s rd, 715 KiB/s wr, 10 op/s 2023-05-08T13:37:48.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:47 smithi096 ceph-mon[124666]: pgmap v19044: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 565 KiB/s wr, 6 op/s 2023-05-08T13:37:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:47 smithi186 ceph-mon[126480]: pgmap v19044: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 565 KiB/s wr, 6 op/s 2023-05-08T13:37:48.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:47 smithi133 ceph-mon[125939]: pgmap v19044: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 565 KiB/s wr, 6 op/s 2023-05-08T13:37:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35608.384735 secs 2023-05-08T13:37:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:49 smithi186 ceph-mon[126480]: pgmap v19045: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 565 KiB/s wr, 6 op/s 2023-05-08T13:37:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:37:50.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35608.384735 secs 2023-05-08T13:37:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:49 smithi133 ceph-mon[125939]: pgmap v19045: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 565 KiB/s wr, 6 op/s 2023-05-08T13:37:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:37:50.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35608.384735 secs 2023-05-08T13:37:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:49 smithi096 ceph-mon[124666]: pgmap v19045: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 565 KiB/s wr, 6 op/s 2023-05-08T13:37:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:37:51.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35608.939057 secs 2023-05-08T13:37:51.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:37:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:37:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:37:51.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35608.939057 secs 2023-05-08T13:37:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:37:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:37:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:37:51.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35608.939057 secs 2023-05-08T13:37:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:37:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:37:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:37:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:51 smithi186 ceph-mon[126480]: pgmap v19046: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 844 KiB/s rd, 593 KiB/s wr, 10 op/s 2023-05-08T13:37:52.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:51 smithi133 ceph-mon[125939]: pgmap v19046: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 844 KiB/s rd, 593 KiB/s wr, 10 op/s 2023-05-08T13:37:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:51 smithi096 ceph-mon[124666]: pgmap v19046: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 844 KiB/s rd, 593 KiB/s wr, 10 op/s 2023-05-08T13:37:53.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:53 smithi096 ceph-mon[124666]: pgmap v19047: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 842 KiB/s rd, 297 KiB/s wr, 7 op/s 2023-05-08T13:37:53.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:53 smithi186 ceph-mon[126480]: pgmap v19047: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 842 KiB/s rd, 297 KiB/s wr, 7 op/s 2023-05-08T13:37:53.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:53 smithi133 ceph-mon[125939]: pgmap v19047: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 842 KiB/s rd, 297 KiB/s wr, 7 op/s 2023-05-08T13:37:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35613.384876 secs 2023-05-08T13:37:54.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35613.384876 secs 2023-05-08T13:37:55.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35613.384876 secs 2023-05-08T13:37:55.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:55 smithi186 ceph-mon[126480]: pgmap v19048: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 13 op/s 2023-05-08T13:37:55.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:55 smithi133 ceph-mon[125939]: pgmap v19048: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 13 op/s 2023-05-08T13:37:56.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:55 smithi096 ceph-mon[124666]: pgmap v19048: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 13 op/s 2023-05-08T13:37:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:57 smithi186 ceph-mon[126480]: pgmap v19049: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 9 op/s 2023-05-08T13:37:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:37:58.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:57 smithi133 ceph-mon[125939]: pgmap v19049: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 9 op/s 2023-05-08T13:37:58.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:37:58.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:57 smithi096 ceph-mon[124666]: pgmap v19049: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 9 op/s 2023-05-08T13:37:58.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:37:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:58 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:37:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:37:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:37:59.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:58 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:37:59.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:37:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:37:59.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:58 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:37:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:37:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:38:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35618.384951 secs 2023-05-08T13:38:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:37:59 smithi186 ceph-mon[126480]: pgmap v19050: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 9 op/s 2023-05-08T13:38:00.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35618.384951 secs 2023-05-08T13:38:00.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:37:59 smithi133 ceph-mon[125939]: pgmap v19050: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 9 op/s 2023-05-08T13:38:00.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35618.384951 secs 2023-05-08T13:38:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:37:59 smithi096 ceph-mon[124666]: pgmap v19050: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 9 op/s 2023-05-08T13:38:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35618.939303 secs 2023-05-08T13:38:01.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35618.939303 secs 2023-05-08T13:38:01.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35618.939303 secs 2023-05-08T13:38:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:01 smithi186 ceph-mon[126480]: pgmap v19051: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.0 MiB/s wr, 15 op/s 2023-05-08T13:38:02.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:01 smithi133 ceph-mon[125939]: pgmap v19051: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.0 MiB/s wr, 15 op/s 2023-05-08T13:38:02.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:01 smithi096 ceph-mon[124666]: pgmap v19051: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.0 MiB/s wr, 15 op/s 2023-05-08T13:38:03.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:38:03.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:38:03.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:38:03.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:38:03.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:38:03.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:38:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:03 smithi186 ceph-mon[126480]: pgmap v19052: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 11 op/s 2023-05-08T13:38:04.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:03 smithi133 ceph-mon[125939]: pgmap v19052: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 11 op/s 2023-05-08T13:38:04.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:03 smithi096 ceph-mon[124666]: pgmap v19052: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 11 op/s 2023-05-08T13:38:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35623.385046 secs 2023-05-08T13:38:05.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35623.385046 secs 2023-05-08T13:38:05.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35623.385046 secs 2023-05-08T13:38:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:05 smithi186 ceph-mon[126480]: pgmap v19053: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.1 MiB/s wr, 31 op/s 2023-05-08T13:38:06.198 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:05 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:38:06.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:05 smithi133 ceph-mon[125939]: pgmap v19053: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.1 MiB/s wr, 31 op/s 2023-05-08T13:38:06.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:05 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:38:06.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:05 smithi096 ceph-mon[124666]: pgmap v19053: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.1 MiB/s wr, 31 op/s 2023-05-08T13:38:06.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:05 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:38:07.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:06 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:38:07.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:38:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:38:07.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:06 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:38:07.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:38:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:38:07.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:06 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:38:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:38:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:38:08.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:07 smithi186 ceph-mon[126480]: pgmap v19054: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.7 MiB/s wr, 25 op/s 2023-05-08T13:38:08.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:07 smithi133 ceph-mon[125939]: pgmap v19054: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.7 MiB/s wr, 25 op/s 2023-05-08T13:38:08.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:07 smithi096 ceph-mon[124666]: pgmap v19054: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.7 MiB/s wr, 25 op/s 2023-05-08T13:38:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35628.385164 secs 2023-05-08T13:38:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:09 smithi186 ceph-mon[126480]: pgmap v19055: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.7 MiB/s wr, 25 op/s 2023-05-08T13:38:10.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35628.385164 secs 2023-05-08T13:38:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:09 smithi133 ceph-mon[125939]: pgmap v19055: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.7 MiB/s wr, 25 op/s 2023-05-08T13:38:10.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35628.385164 secs 2023-05-08T13:38:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:09 smithi096 ceph-mon[124666]: pgmap v19055: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.7 MiB/s wr, 25 op/s 2023-05-08T13:38:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:11 smithi186 ceph-mon[126480]: pgmap v19056: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 2.0 MiB/s wr, 29 op/s 2023-05-08T13:38:12.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:11 smithi133 ceph-mon[125939]: pgmap v19056: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 2.0 MiB/s wr, 29 op/s 2023-05-08T13:38:12.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:11 smithi096 ceph-mon[124666]: pgmap v19056: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 2.0 MiB/s wr, 29 op/s 2023-05-08T13:38:13.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:13 smithi096 ceph-mon[124666]: pgmap v19057: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.4 MiB/s wr, 23 op/s 2023-05-08T13:38:13.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:13 smithi186 ceph-mon[126480]: pgmap v19057: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.4 MiB/s wr, 23 op/s 2023-05-08T13:38:13.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:13 smithi133 ceph-mon[125939]: pgmap v19057: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.4 MiB/s wr, 23 op/s 2023-05-08T13:38:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35633.385288 secs 2023-05-08T13:38:14.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35633.385288 secs 2023-05-08T13:38:15.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35633.385288 secs 2023-05-08T13:38:15.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:15 smithi186 ceph-mon[126480]: pgmap v19058: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 1.5 MiB/s wr, 27 op/s 2023-05-08T13:38:15.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:15 smithi133 ceph-mon[125939]: pgmap v19058: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 1.5 MiB/s wr, 27 op/s 2023-05-08T13:38:16.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:15 smithi096 ceph-mon[124666]: pgmap v19058: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 1.5 MiB/s wr, 27 op/s 2023-05-08T13:38:18.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:17 smithi186 ceph-mon[126480]: pgmap v19059: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 817 KiB/s rd, 435 KiB/s wr, 8 op/s 2023-05-08T13:38:18.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:17 smithi133 ceph-mon[125939]: pgmap v19059: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 817 KiB/s rd, 435 KiB/s wr, 8 op/s 2023-05-08T13:38:18.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:17 smithi096 ceph-mon[124666]: pgmap v19059: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 817 KiB/s rd, 435 KiB/s wr, 8 op/s 2023-05-08T13:38:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35638.385387 secs 2023-05-08T13:38:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:19 smithi186 ceph-mon[126480]: pgmap v19060: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 817 KiB/s rd, 435 KiB/s wr, 8 op/s 2023-05-08T13:38:20.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35638.385387 secs 2023-05-08T13:38:20.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:19 smithi133 ceph-mon[125939]: pgmap v19060: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 817 KiB/s rd, 435 KiB/s wr, 8 op/s 2023-05-08T13:38:20.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35638.385387 secs 2023-05-08T13:38:20.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:19 smithi096 ceph-mon[124666]: pgmap v19060: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 817 KiB/s rd, 435 KiB/s wr, 8 op/s 2023-05-08T13:38:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:21 smithi186 ceph-mon[126480]: pgmap v19061: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 818 KiB/s rd, 461 KiB/s wr, 12 op/s 2023-05-08T13:38:22.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:21 smithi133 ceph-mon[125939]: pgmap v19061: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 818 KiB/s rd, 461 KiB/s wr, 12 op/s 2023-05-08T13:38:22.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:21 smithi096 ceph-mon[124666]: pgmap v19061: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 818 KiB/s rd, 461 KiB/s wr, 12 op/s 2023-05-08T13:38:23.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:23 smithi096 ceph-mon[124666]: pgmap v19062: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 145 KiB/s wr, 7 op/s 2023-05-08T13:38:23.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:23 smithi186 ceph-mon[126480]: pgmap v19062: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 145 KiB/s wr, 7 op/s 2023-05-08T13:38:23.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:23 smithi133 ceph-mon[125939]: pgmap v19062: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 145 KiB/s wr, 7 op/s 2023-05-08T13:38:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35643.385470 secs 2023-05-08T13:38:24.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35643.385470 secs 2023-05-08T13:38:25.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35643.385470 secs 2023-05-08T13:38:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35643.939868 secs 2023-05-08T13:38:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:25 smithi186 ceph-mon[126480]: pgmap v19063: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 967 KiB/s wr, 15 op/s 2023-05-08T13:38:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:25 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:38:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:25 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:38:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:25 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:38:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:25 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:38:25.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35643.939868 secs 2023-05-08T13:38:25.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:25 smithi133 ceph-mon[125939]: pgmap v19063: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 967 KiB/s wr, 15 op/s 2023-05-08T13:38:25.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:25 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:38:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:25 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:38:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:25 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:38:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:25 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:38:26.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35643.939868 secs 2023-05-08T13:38:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:25 smithi096 ceph-mon[124666]: pgmap v19063: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 967 KiB/s wr, 15 op/s 2023-05-08T13:38:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:25 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:38:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:25 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:38:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:25 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:38:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:25 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:38:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35645.243834 secs 2023-05-08T13:38:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:26 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:38:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:26 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T13:38:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:26 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T13:38:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:26 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:38:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:26 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:38:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:26 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:38:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:26 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:38:26.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35645.243834 secs 2023-05-08T13:38:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:26 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:38:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:26 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T13:38:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:26 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T13:38:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:26 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:38:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:26 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:38:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:26 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:38:26.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:26 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:38:27.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35645.243834 secs 2023-05-08T13:38:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:26 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:38:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:26 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T13:38:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:26 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T13:38:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:26 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:38:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:26 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:38:27.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:26 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:38:27.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:26 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:38:27.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:27 smithi186 ceph-mon[126480]: pgmap v19064: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 829 KiB/s rd, 848 KiB/s wr, 11 op/s 2023-05-08T13:38:27.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:27 smithi133 ceph-mon[125939]: pgmap v19064: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 829 KiB/s rd, 848 KiB/s wr, 11 op/s 2023-05-08T13:38:28.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:27 smithi096 ceph-mon[124666]: pgmap v19064: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 829 KiB/s rd, 848 KiB/s wr, 11 op/s 2023-05-08T13:38:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35648.385587 secs 2023-05-08T13:38:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:29 smithi186 ceph-mon[126480]: pgmap v19065: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 829 KiB/s rd, 848 KiB/s wr, 11 op/s 2023-05-08T13:38:30.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35648.385587 secs 2023-05-08T13:38:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:29 smithi133 ceph-mon[125939]: pgmap v19065: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 829 KiB/s rd, 848 KiB/s wr, 11 op/s 2023-05-08T13:38:30.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35648.385587 secs 2023-05-08T13:38:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:29 smithi096 ceph-mon[124666]: pgmap v19065: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 829 KiB/s rd, 848 KiB/s wr, 11 op/s 2023-05-08T13:38:31.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35648.939951 secs 2023-05-08T13:38:31.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:30 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:38:31.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:30 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:38:31.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35648.939951 secs 2023-05-08T13:38:31.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:30 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:38:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:30 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:38:31.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35648.939951 secs 2023-05-08T13:38:31.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:30 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:38:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:30 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:38:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35650.243967 secs 2023-05-08T13:38:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:31 smithi186 ceph-mon[126480]: pgmap v19066: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 830 KiB/s rd, 849 KiB/s wr, 15 op/s 2023-05-08T13:38:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:31 smithi186 ceph-mon[126480]: osdmap e1268: 12 total, 12 up, 12 in 2023-05-08T13:38:32.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35650.243967 secs 2023-05-08T13:38:32.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:31 smithi133 ceph-mon[125939]: pgmap v19066: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 830 KiB/s rd, 849 KiB/s wr, 15 op/s 2023-05-08T13:38:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:31 smithi133 ceph-mon[125939]: osdmap e1268: 12 total, 12 up, 12 in 2023-05-08T13:38:32.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35650.243967 secs 2023-05-08T13:38:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:31 smithi096 ceph-mon[124666]: pgmap v19066: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 830 KiB/s rd, 849 KiB/s wr, 15 op/s 2023-05-08T13:38:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:31 smithi096 ceph-mon[124666]: osdmap e1268: 12 total, 12 up, 12 in 2023-05-08T13:38:33.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:32 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:38:33.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:32 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:38:33.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:32 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:38:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:33 smithi186 ceph-mon[126480]: pgmap v19068: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 995 KiB/s rd, 988 KiB/s wr, 13 op/s 2023-05-08T13:38:34.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:33 smithi133 ceph-mon[125939]: pgmap v19068: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 995 KiB/s rd, 988 KiB/s wr, 13 op/s 2023-05-08T13:38:34.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:33 smithi096 ceph-mon[124666]: pgmap v19068: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 995 KiB/s rd, 988 KiB/s wr, 13 op/s 2023-05-08T13:38:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35653.385663 secs 2023-05-08T13:38:35.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35653.385663 secs 2023-05-08T13:38:35.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35653.385663 secs 2023-05-08T13:38:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35653.940098 secs 2023-05-08T13:38:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:35 smithi186 ceph-mon[126480]: pgmap v19069: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 174 KiB/s wr, 9 op/s 2023-05-08T13:38:36.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35653.940098 secs 2023-05-08T13:38:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:35 smithi133 ceph-mon[125939]: pgmap v19069: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 174 KiB/s wr, 9 op/s 2023-05-08T13:38:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35653.940098 secs 2023-05-08T13:38:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:35 smithi096 ceph-mon[124666]: pgmap v19069: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 174 KiB/s wr, 9 op/s 2023-05-08T13:38:37.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35655.244082 secs 2023-05-08T13:38:37.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35655.244082 secs 2023-05-08T13:38:37.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35655.244082 secs 2023-05-08T13:38:38.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:37 smithi186 ceph-mon[126480]: pgmap v19070: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 174 KiB/s wr, 9 op/s 2023-05-08T13:38:38.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:37 smithi186 ceph-mon[126480]: osdmap e1269: 12 total, 12 up, 12 in 2023-05-08T13:38:38.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:37 smithi133 ceph-mon[125939]: pgmap v19070: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 174 KiB/s wr, 9 op/s 2023-05-08T13:38:38.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:37 smithi133 ceph-mon[125939]: osdmap e1269: 12 total, 12 up, 12 in 2023-05-08T13:38:38.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:37 smithi096 ceph-mon[124666]: pgmap v19070: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 174 KiB/s wr, 9 op/s 2023-05-08T13:38:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:37 smithi096 ceph-mon[124666]: osdmap e1269: 12 total, 12 up, 12 in 2023-05-08T13:38:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35658.385775 secs 2023-05-08T13:38:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:39 smithi186 ceph-mon[126480]: pgmap v19072: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 216 KiB/s wr, 5 op/s 2023-05-08T13:38:40.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35658.385775 secs 2023-05-08T13:38:40.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:39 smithi133 ceph-mon[125939]: pgmap v19072: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 216 KiB/s wr, 5 op/s 2023-05-08T13:38:40.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35658.385775 secs 2023-05-08T13:38:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:39 smithi096 ceph-mon[124666]: pgmap v19072: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 216 KiB/s wr, 5 op/s 2023-05-08T13:38:41.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35658.940220 secs 2023-05-08T13:38:41.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35658.940220 secs 2023-05-08T13:38:41.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35658.940220 secs 2023-05-08T13:38:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35660.244196 secs 2023-05-08T13:38:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:41 smithi186 ceph-mon[126480]: pgmap v19073: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 355 KiB/s wr, 9 op/s 2023-05-08T13:38:42.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35660.244196 secs 2023-05-08T13:38:42.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:41 smithi133 ceph-mon[125939]: pgmap v19073: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 355 KiB/s wr, 9 op/s 2023-05-08T13:38:42.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35660.244196 secs 2023-05-08T13:38:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:41 smithi096 ceph-mon[124666]: pgmap v19073: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 355 KiB/s wr, 9 op/s 2023-05-08T13:38:43.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:43 smithi186 ceph-mon[126480]: pgmap v19074: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 355 KiB/s rd, 352 KiB/s wr, 8 op/s 2023-05-08T13:38:43.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:43 smithi133 ceph-mon[125939]: pgmap v19074: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 355 KiB/s rd, 352 KiB/s wr, 8 op/s 2023-05-08T13:38:44.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:43 smithi096 ceph-mon[124666]: pgmap v19074: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 355 KiB/s rd, 352 KiB/s wr, 8 op/s 2023-05-08T13:38:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35663.385896 secs 2023-05-08T13:38:44.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35663.385896 secs 2023-05-08T13:38:45.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35663.385896 secs 2023-05-08T13:38:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35663.940345 secs 2023-05-08T13:38:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:45 smithi186 ceph-mon[126480]: pgmap v19075: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 452 KiB/s wr, 8 op/s 2023-05-08T13:38:45.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35663.940345 secs 2023-05-08T13:38:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:45 smithi133 ceph-mon[125939]: pgmap v19075: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 452 KiB/s wr, 8 op/s 2023-05-08T13:38:46.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35663.940345 secs 2023-05-08T13:38:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:45 smithi096 ceph-mon[124666]: pgmap v19075: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 452 KiB/s wr, 8 op/s 2023-05-08T13:38:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:47 smithi186 ceph-mon[126480]: pgmap v19076: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 452 KiB/s wr, 8 op/s 2023-05-08T13:38:48.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:47 smithi133 ceph-mon[125939]: pgmap v19076: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 452 KiB/s wr, 8 op/s 2023-05-08T13:38:48.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:47 smithi096 ceph-mon[124666]: pgmap v19076: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 452 KiB/s wr, 8 op/s 2023-05-08T13:38:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35668.385976 secs 2023-05-08T13:38:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:49 smithi186 ceph-mon[126480]: pgmap v19077: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 403 KiB/s wr, 7 op/s 2023-05-08T13:38:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:38:50.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35668.385976 secs 2023-05-08T13:38:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:49 smithi133 ceph-mon[125939]: pgmap v19077: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 403 KiB/s wr, 7 op/s 2023-05-08T13:38:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:38:50.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35668.385976 secs 2023-05-08T13:38:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:49 smithi096 ceph-mon[124666]: pgmap v19077: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 403 KiB/s wr, 7 op/s 2023-05-08T13:38:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:38:51.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:38:51.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:38:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:38:51.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:38:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:38:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:38:51.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:38:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:38:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:38:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:51 smithi186 ceph-mon[126480]: pgmap v19078: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1005 KiB/s rd, 922 KiB/s wr, 12 op/s 2023-05-08T13:38:52.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:51 smithi133 ceph-mon[125939]: pgmap v19078: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1005 KiB/s rd, 922 KiB/s wr, 12 op/s 2023-05-08T13:38:52.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:51 smithi096 ceph-mon[124666]: pgmap v19078: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1005 KiB/s rd, 922 KiB/s wr, 12 op/s 2023-05-08T13:38:53.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:53 smithi186 ceph-mon[126480]: pgmap v19079: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 854 KiB/s rd, 772 KiB/s wr, 8 op/s 2023-05-08T13:38:53.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:53 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:38:53.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:53 smithi133 ceph-mon[125939]: pgmap v19079: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 854 KiB/s rd, 772 KiB/s wr, 8 op/s 2023-05-08T13:38:53.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:53 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:38:54.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:53 smithi096 ceph-mon[124666]: pgmap v19079: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 854 KiB/s rd, 772 KiB/s wr, 8 op/s 2023-05-08T13:38:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:53 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:38:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:54 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:38:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:54 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:38:54.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:54 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:38:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:54 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:38:55.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:54 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:38:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:54 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:38:55.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35673.386093 secs 2023-05-08T13:38:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:55 smithi186 ceph-mon[126480]: pgmap v19080: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T13:38:55.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35673.386093 secs 2023-05-08T13:38:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:55 smithi133 ceph-mon[125939]: pgmap v19080: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T13:38:56.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35673.386093 secs 2023-05-08T13:38:56.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:55 smithi096 ceph-mon[124666]: pgmap v19080: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T13:38:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:57 smithi186 ceph-mon[126480]: pgmap v19081: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T13:38:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:57 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:38:58.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:57 smithi133 ceph-mon[125939]: pgmap v19081: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T13:38:58.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:57 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:38:58.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:57 smithi096 ceph-mon[124666]: pgmap v19081: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T13:38:58.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:57 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:39:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35678.386192 secs 2023-05-08T13:39:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:38:59 smithi186 ceph-mon[126480]: pgmap v19082: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T13:39:00.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35678.386192 secs 2023-05-08T13:39:00.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:38:59 smithi133 ceph-mon[125939]: pgmap v19082: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T13:39:00.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35678.386192 secs 2023-05-08T13:39:00.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:38:59 smithi096 ceph-mon[124666]: pgmap v19082: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T13:39:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35678.940654 secs 2023-05-08T13:39:01.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35678.940654 secs 2023-05-08T13:39:01.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35678.940654 secs 2023-05-08T13:39:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:01 smithi186 ceph-mon[126480]: pgmap v19083: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.2 MiB/s wr, 15 op/s 2023-05-08T13:39:02.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:01 smithi133 ceph-mon[125939]: pgmap v19083: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.2 MiB/s wr, 15 op/s 2023-05-08T13:39:02.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:01 smithi096 ceph-mon[124666]: pgmap v19083: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.2 MiB/s wr, 15 op/s 2023-05-08T13:39:03.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:39:03.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:39:03.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:02 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:39:03.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:39:03.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:39:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:02 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:39:03.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:39:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:39:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:02 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:39:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:03 smithi186 ceph-mon[126480]: pgmap v19084: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 764 KiB/s rd, 716 KiB/s wr, 10 op/s 2023-05-08T13:39:04.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:03 smithi133 ceph-mon[125939]: pgmap v19084: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 764 KiB/s rd, 716 KiB/s wr, 10 op/s 2023-05-08T13:39:04.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:03 smithi096 ceph-mon[124666]: pgmap v19084: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 764 KiB/s rd, 716 KiB/s wr, 10 op/s 2023-05-08T13:39:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35683.386333 secs 2023-05-08T13:39:05.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35683.386333 secs 2023-05-08T13:39:05.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35683.386333 secs 2023-05-08T13:39:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35683.940732 secs 2023-05-08T13:39:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:05 smithi186 ceph-mon[126480]: pgmap v19085: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 27 op/s 2023-05-08T13:39:06.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35683.940732 secs 2023-05-08T13:39:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:05 smithi133 ceph-mon[125939]: pgmap v19085: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 27 op/s 2023-05-08T13:39:06.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35683.940732 secs 2023-05-08T13:39:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:05 smithi096 ceph-mon[124666]: pgmap v19085: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 27 op/s 2023-05-08T13:39:08.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:07 smithi186 ceph-mon[126480]: pgmap v19086: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 918 KiB/s rd, 751 KiB/s wr, 22 op/s 2023-05-08T13:39:08.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:07 smithi133 ceph-mon[125939]: pgmap v19086: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 918 KiB/s rd, 751 KiB/s wr, 22 op/s 2023-05-08T13:39:08.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:07 smithi096 ceph-mon[124666]: pgmap v19086: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 918 KiB/s rd, 751 KiB/s wr, 22 op/s 2023-05-08T13:39:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35688.386450 secs 2023-05-08T13:39:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:09 smithi186 ceph-mon[126480]: pgmap v19087: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 918 KiB/s rd, 751 KiB/s wr, 22 op/s 2023-05-08T13:39:10.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35688.386450 secs 2023-05-08T13:39:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:09 smithi133 ceph-mon[125939]: pgmap v19087: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 918 KiB/s rd, 751 KiB/s wr, 22 op/s 2023-05-08T13:39:10.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35688.386450 secs 2023-05-08T13:39:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:09 smithi096 ceph-mon[124666]: pgmap v19087: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 918 KiB/s rd, 751 KiB/s wr, 22 op/s 2023-05-08T13:39:11.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35688.940798 secs 2023-05-08T13:39:11.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35688.940798 secs 2023-05-08T13:39:11.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35688.940798 secs 2023-05-08T13:39:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:11 smithi186 ceph-mon[126480]: pgmap v19088: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 25 op/s 2023-05-08T13:39:12.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:11 smithi133 ceph-mon[125939]: pgmap v19088: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 25 op/s 2023-05-08T13:39:12.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:11 smithi096 ceph-mon[124666]: pgmap v19088: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 25 op/s 2023-05-08T13:39:13.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:13 smithi186 ceph-mon[126480]: pgmap v19089: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 851 KiB/s rd, 864 KiB/s wr, 20 op/s 2023-05-08T13:39:13.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:13 smithi133 ceph-mon[125939]: pgmap v19089: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 851 KiB/s rd, 864 KiB/s wr, 20 op/s 2023-05-08T13:39:14.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:13 smithi096 ceph-mon[124666]: pgmap v19089: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 851 KiB/s rd, 864 KiB/s wr, 20 op/s 2023-05-08T13:39:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35693.386561 secs 2023-05-08T13:39:14.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35693.386561 secs 2023-05-08T13:39:15.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35693.386561 secs 2023-05-08T13:39:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35693.940915 secs 2023-05-08T13:39:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:15 smithi186 ceph-mon[126480]: pgmap v19090: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 924 KiB/s rd, 936 KiB/s wr, 24 op/s 2023-05-08T13:39:15.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35693.940915 secs 2023-05-08T13:39:15.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:15 smithi133 ceph-mon[125939]: pgmap v19090: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 924 KiB/s rd, 936 KiB/s wr, 24 op/s 2023-05-08T13:39:16.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35693.940915 secs 2023-05-08T13:39:16.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:15 smithi096 ceph-mon[124666]: pgmap v19090: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 924 KiB/s rd, 936 KiB/s wr, 24 op/s 2023-05-08T13:39:18.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:17 smithi186 ceph-mon[126480]: pgmap v19091: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 370 KiB/s wr, 7 op/s 2023-05-08T13:39:18.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:17 smithi133 ceph-mon[125939]: pgmap v19091: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 370 KiB/s wr, 7 op/s 2023-05-08T13:39:18.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:17 smithi096 ceph-mon[124666]: pgmap v19091: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 370 KiB/s wr, 7 op/s 2023-05-08T13:39:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35698.386638 secs 2023-05-08T13:39:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:19 smithi186 ceph-mon[126480]: pgmap v19092: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 370 KiB/s wr, 7 op/s 2023-05-08T13:39:20.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35698.386638 secs 2023-05-08T13:39:20.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:19 smithi133 ceph-mon[125939]: pgmap v19092: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 370 KiB/s wr, 7 op/s 2023-05-08T13:39:20.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35698.386638 secs 2023-05-08T13:39:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:19 smithi096 ceph-mon[124666]: pgmap v19092: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 370 KiB/s wr, 7 op/s 2023-05-08T13:39:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35700.245091 secs 2023-05-08T13:39:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:21 smithi186 ceph-mon[126480]: pgmap v19093: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 14 op/s 2023-05-08T13:39:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:21 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:39:22.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35700.245091 secs 2023-05-08T13:39:22.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:21 smithi133 ceph-mon[125939]: pgmap v19093: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 14 op/s 2023-05-08T13:39:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:21 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:39:22.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35700.245091 secs 2023-05-08T13:39:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:21 smithi096 ceph-mon[124666]: pgmap v19093: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 14 op/s 2023-05-08T13:39:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:21 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:39:23.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:22 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:39:23.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:22 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:39:23.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:22 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:39:23.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:22 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:39:23.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:22 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:39:23.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:22 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:39:23.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:22 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:39:23.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:22 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:39:23.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:22 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:39:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:23 smithi186 ceph-mon[126480]: pgmap v19094: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 730 KiB/s rd, 750 KiB/s wr, 11 op/s 2023-05-08T13:39:24.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:23 smithi133 ceph-mon[125939]: pgmap v19094: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 730 KiB/s rd, 750 KiB/s wr, 11 op/s 2023-05-08T13:39:24.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:23 smithi096 ceph-mon[124666]: pgmap v19094: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 730 KiB/s rd, 750 KiB/s wr, 11 op/s 2023-05-08T13:39:25.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35703.386764 secs 2023-05-08T13:39:25.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35703.386764 secs 2023-05-08T13:39:25.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35703.386764 secs 2023-05-08T13:39:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:25 smithi186 ceph-mon[126480]: pgmap v19095: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 733 KiB/s rd, 777 KiB/s wr, 15 op/s 2023-05-08T13:39:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:25 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:39:26.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:25 smithi133 ceph-mon[125939]: pgmap v19095: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 733 KiB/s rd, 777 KiB/s wr, 15 op/s 2023-05-08T13:39:26.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:25 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:39:26.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:25 smithi096 ceph-mon[124666]: pgmap v19095: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 733 KiB/s rd, 777 KiB/s wr, 15 op/s 2023-05-08T13:39:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:25 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:39:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35705.245170 secs 2023-05-08T13:39:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:26 smithi186 ceph-mon[126480]: osdmap e1270: 12 total, 12 up, 12 in 2023-05-08T13:39:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:39:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:39:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:39:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:39:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:39:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:39:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:39:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:39:27.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:39:27.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35705.245170 secs 2023-05-08T13:39:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:26 smithi133 ceph-mon[125939]: osdmap e1270: 12 total, 12 up, 12 in 2023-05-08T13:39:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:39:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:39:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:39:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:39:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:39:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:39:27.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:39:27.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:39:27.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:39:27.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35705.245170 secs 2023-05-08T13:39:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:26 smithi096 ceph-mon[124666]: osdmap e1270: 12 total, 12 up, 12 in 2023-05-08T13:39:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:39:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:39:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:39:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:39:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:39:27.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:39:27.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:39:27.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:39:27.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:39:28.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:28 smithi133 ceph-mon[125939]: pgmap v19097: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 792 KiB/s rd, 846 KiB/s wr, 13 op/s 2023-05-08T13:39:28.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:28 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:39:28.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:28 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T13:39:28.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:28 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T13:39:28.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:28 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:39:28.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:28 smithi096 ceph-mon[124666]: pgmap v19097: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 792 KiB/s rd, 846 KiB/s wr, 13 op/s 2023-05-08T13:39:28.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:28 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:39:28.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:28 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T13:39:28.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:28 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T13:39:28.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:28 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:39:28.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:28 smithi186 ceph-mon[126480]: pgmap v19097: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 792 KiB/s rd, 846 KiB/s wr, 13 op/s 2023-05-08T13:39:28.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:28 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:39:28.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:28 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T13:39:28.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:28 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T13:39:28.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:28 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:39:30.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35708.386912 secs 2023-05-08T13:39:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:30 smithi133 ceph-mon[125939]: pgmap v19098: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 792 KiB/s rd, 846 KiB/s wr, 13 op/s 2023-05-08T13:39:30.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35708.386912 secs 2023-05-08T13:39:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:30 smithi096 ceph-mon[124666]: pgmap v19098: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 792 KiB/s rd, 846 KiB/s wr, 13 op/s 2023-05-08T13:39:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35708.386912 secs 2023-05-08T13:39:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:30 smithi186 ceph-mon[126480]: pgmap v19098: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 792 KiB/s rd, 846 KiB/s wr, 13 op/s 2023-05-08T13:39:32.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:32 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35710.245309 secs 2023-05-08T13:39:32.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:32 smithi133 ceph-mon[125939]: pgmap v19099: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 208 KiB/s wr, 9 op/s 2023-05-08T13:39:32.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:32 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35710.245309 secs 2023-05-08T13:39:32.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:32 smithi096 ceph-mon[124666]: pgmap v19099: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 208 KiB/s wr, 9 op/s 2023-05-08T13:39:32.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:32 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35710.245309 secs 2023-05-08T13:39:32.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:32 smithi186 ceph-mon[126480]: pgmap v19099: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 208 KiB/s wr, 9 op/s 2023-05-08T13:39:33.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:33 smithi186 ceph-mon[126480]: osdmap e1271: 12 total, 12 up, 12 in 2023-05-08T13:39:33.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:33 smithi186 ceph-mon[126480]: pgmap v19101: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 219 KiB/s wr, 6 op/s 2023-05-08T13:39:33.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:33 smithi133 ceph-mon[125939]: osdmap e1271: 12 total, 12 up, 12 in 2023-05-08T13:39:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:33 smithi133 ceph-mon[125939]: pgmap v19101: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 219 KiB/s wr, 6 op/s 2023-05-08T13:39:34.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:33 smithi096 ceph-mon[124666]: osdmap e1271: 12 total, 12 up, 12 in 2023-05-08T13:39:34.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:33 smithi096 ceph-mon[124666]: pgmap v19101: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 219 KiB/s wr, 6 op/s 2023-05-08T13:39:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35713.387065 secs 2023-05-08T13:39:34.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35713.387065 secs 2023-05-08T13:39:35.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35713.387065 secs 2023-05-08T13:39:35.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:35 smithi186 ceph-mon[126480]: pgmap v19102: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 737 KiB/s rd, 489 KiB/s wr, 11 op/s 2023-05-08T13:39:35.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:35 smithi133 ceph-mon[125939]: pgmap v19102: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 737 KiB/s rd, 489 KiB/s wr, 11 op/s 2023-05-08T13:39:36.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:35 smithi096 ceph-mon[124666]: pgmap v19102: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 737 KiB/s rd, 489 KiB/s wr, 11 op/s 2023-05-08T13:39:36.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35715.245384 secs 2023-05-08T13:39:36.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35715.245384 secs 2023-05-08T13:39:37.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35715.245384 secs 2023-05-08T13:39:37.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:37 smithi186 ceph-mon[126480]: pgmap v19103: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 657 KiB/s rd, 436 KiB/s wr, 10 op/s 2023-05-08T13:39:37.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:37 smithi133 ceph-mon[125939]: pgmap v19103: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 657 KiB/s rd, 436 KiB/s wr, 10 op/s 2023-05-08T13:39:38.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:37 smithi096 ceph-mon[124666]: pgmap v19103: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 657 KiB/s rd, 436 KiB/s wr, 10 op/s 2023-05-08T13:39:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35718.387212 secs 2023-05-08T13:39:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:39 smithi186 ceph-mon[126480]: pgmap v19104: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 657 KiB/s rd, 436 KiB/s wr, 10 op/s 2023-05-08T13:39:40.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35718.387212 secs 2023-05-08T13:39:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:39 smithi133 ceph-mon[125939]: pgmap v19104: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 657 KiB/s rd, 436 KiB/s wr, 10 op/s 2023-05-08T13:39:40.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35718.387212 secs 2023-05-08T13:39:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:39 smithi096 ceph-mon[124666]: pgmap v19104: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 657 KiB/s rd, 436 KiB/s wr, 10 op/s 2023-05-08T13:39:41.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35718.941499 secs 2023-05-08T13:39:41.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35718.941499 secs 2023-05-08T13:39:41.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35718.941499 secs 2023-05-08T13:39:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35720.245500 secs 2023-05-08T13:39:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:41 smithi186 ceph-mon[126480]: pgmap v19105: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.6 MiB/s wr, 12 op/s 2023-05-08T13:39:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35720.245500 secs 2023-05-08T13:39:42.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:41 smithi133 ceph-mon[125939]: pgmap v19105: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.6 MiB/s wr, 12 op/s 2023-05-08T13:39:42.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35720.245500 secs 2023-05-08T13:39:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:41 smithi096 ceph-mon[124666]: pgmap v19105: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.6 MiB/s wr, 12 op/s 2023-05-08T13:39:43.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:42 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:39:43.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:42 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:39:43.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:42 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:39:43.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:42 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:39:43.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:42 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:39:43.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:42 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:39:43.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:42 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:39:43.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:42 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:39:43.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:42 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:39:44.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:43 smithi186 ceph-mon[126480]: pgmap v19106: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 12 op/s 2023-05-08T13:39:44.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:43 smithi133 ceph-mon[125939]: pgmap v19106: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 12 op/s 2023-05-08T13:39:44.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:43 smithi096 ceph-mon[124666]: pgmap v19106: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 12 op/s 2023-05-08T13:39:45.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35723.387365 secs 2023-05-08T13:39:45.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35723.387365 secs 2023-05-08T13:39:45.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35723.387365 secs 2023-05-08T13:39:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35723.941551 secs 2023-05-08T13:39:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:45 smithi186 ceph-mon[126480]: pgmap v19107: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 15 op/s 2023-05-08T13:39:46.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35723.941551 secs 2023-05-08T13:39:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:45 smithi133 ceph-mon[125939]: pgmap v19107: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 15 op/s 2023-05-08T13:39:46.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35723.941551 secs 2023-05-08T13:39:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:45 smithi096 ceph-mon[124666]: pgmap v19107: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 15 op/s 2023-05-08T13:39:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:47 smithi186 ceph-mon[126480]: pgmap v19108: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 10 op/s 2023-05-08T13:39:48.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:47 smithi133 ceph-mon[125939]: pgmap v19108: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 10 op/s 2023-05-08T13:39:48.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:47 smithi096 ceph-mon[124666]: pgmap v19108: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 10 op/s 2023-05-08T13:39:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35728.387439 secs 2023-05-08T13:39:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:49 smithi186 ceph-mon[126480]: pgmap v19109: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 10 op/s 2023-05-08T13:39:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:39:50.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35728.387439 secs 2023-05-08T13:39:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:49 smithi133 ceph-mon[125939]: pgmap v19109: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 10 op/s 2023-05-08T13:39:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:39:50.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35728.387439 secs 2023-05-08T13:39:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:49 smithi096 ceph-mon[124666]: pgmap v19109: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 10 op/s 2023-05-08T13:39:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:39:51.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:39:51.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:39:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:39:51.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:39:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:39:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:39:51.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:39:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:39:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:39:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:51 smithi186 ceph-mon[126480]: pgmap v19110: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.1 MiB/s wr, 16 op/s 2023-05-08T13:39:52.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:51 smithi133 ceph-mon[125939]: pgmap v19110: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.1 MiB/s wr, 16 op/s 2023-05-08T13:39:52.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:51 smithi096 ceph-mon[124666]: pgmap v19110: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.1 MiB/s wr, 16 op/s 2023-05-08T13:39:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:53 smithi186 ceph-mon[126480]: pgmap v19111: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 942 KiB/s wr, 10 op/s 2023-05-08T13:39:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:53 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:39:53.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:53 smithi133 ceph-mon[125939]: pgmap v19111: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 942 KiB/s wr, 10 op/s 2023-05-08T13:39:53.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:53 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:39:54.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:53 smithi096 ceph-mon[124666]: pgmap v19111: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 942 KiB/s wr, 10 op/s 2023-05-08T13:39:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:53 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:39:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:54 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:39:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:54 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:39:54.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:54 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:39:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:54 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:39:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:54 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:39:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:54 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:39:55.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35733.387532 secs 2023-05-08T13:39:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:55 smithi186 ceph-mon[126480]: pgmap v19112: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.9 MiB/s wr, 16 op/s 2023-05-08T13:39:55.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35733.387532 secs 2023-05-08T13:39:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:55 smithi133 ceph-mon[125939]: pgmap v19112: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.9 MiB/s wr, 16 op/s 2023-05-08T13:39:56.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35733.387532 secs 2023-05-08T13:39:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:55 smithi096 ceph-mon[124666]: pgmap v19112: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.9 MiB/s wr, 16 op/s 2023-05-08T13:39:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:57 smithi186 ceph-mon[126480]: pgmap v19113: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T13:39:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:57 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:39:58.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:57 smithi133 ceph-mon[125939]: pgmap v19113: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T13:39:58.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:57 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:39:58.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:57 smithi096 ceph-mon[124666]: pgmap v19113: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T13:39:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:57 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:40:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35738.387596 secs 2023-05-08T13:40:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:39:59 smithi186 ceph-mon[126480]: pgmap v19114: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T13:40:00.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35738.387596 secs 2023-05-08T13:40:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:39:59 smithi133 ceph-mon[125939]: pgmap v19114: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T13:40:00.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35738.387596 secs 2023-05-08T13:40:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:39:59 smithi096 ceph-mon[124666]: pgmap v19114: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T13:40:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35738.941865 secs 2023-05-08T13:40:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:00 smithi186 ceph-mon[126480]: overall HEALTH_WARN 1 MDSs report slow requests 2023-05-08T13:40:01.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35738.941865 secs 2023-05-08T13:40:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:00 smithi133 ceph-mon[125939]: overall HEALTH_WARN 1 MDSs report slow requests 2023-05-08T13:40:01.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35738.941865 secs 2023-05-08T13:40:01.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:00 smithi096 ceph-mon[124666]: overall HEALTH_WARN 1 MDSs report slow requests 2023-05-08T13:40:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:01 smithi186 ceph-mon[126480]: pgmap v19115: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 1.6 MiB/s wr, 17 op/s 2023-05-08T13:40:02.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:01 smithi133 ceph-mon[125939]: pgmap v19115: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 1.6 MiB/s wr, 17 op/s 2023-05-08T13:40:02.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:01 smithi096 ceph-mon[124666]: pgmap v19115: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 1.6 MiB/s wr, 17 op/s 2023-05-08T13:40:03.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:40:03.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:40:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:02 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:40:03.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:40:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:40:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:02 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:40:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:40:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:40:03.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:02 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:40:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:03 smithi186 ceph-mon[126480]: pgmap v19116: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2023-05-08T13:40:04.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:03 smithi133 ceph-mon[125939]: pgmap v19116: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2023-05-08T13:40:04.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:03 smithi096 ceph-mon[124666]: pgmap v19116: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2023-05-08T13:40:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35743.387685 secs 2023-05-08T13:40:05.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35743.387685 secs 2023-05-08T13:40:05.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35743.387685 secs 2023-05-08T13:40:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:05 smithi186 ceph-mon[126480]: pgmap v19117: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.9 MiB/s wr, 29 op/s 2023-05-08T13:40:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:05 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:40:06.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:05 smithi133 ceph-mon[125939]: pgmap v19117: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.9 MiB/s wr, 29 op/s 2023-05-08T13:40:06.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:05 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:40:06.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:05 smithi096 ceph-mon[124666]: pgmap v19117: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.9 MiB/s wr, 29 op/s 2023-05-08T13:40:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:05 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:40:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:40:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:40:07.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:40:07.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:40:07.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:40:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:40:08.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:07 smithi186 ceph-mon[126480]: pgmap v19118: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 998 KiB/s wr, 23 op/s 2023-05-08T13:40:08.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:07 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:40:08.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:07 smithi133 ceph-mon[125939]: pgmap v19118: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 998 KiB/s wr, 23 op/s 2023-05-08T13:40:08.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:07 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:40:08.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:07 smithi096 ceph-mon[124666]: pgmap v19118: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 998 KiB/s wr, 23 op/s 2023-05-08T13:40:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:07 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:40:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35748.387790 secs 2023-05-08T13:40:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:09 smithi186 ceph-mon[126480]: pgmap v19119: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 998 KiB/s wr, 23 op/s 2023-05-08T13:40:10.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35748.387790 secs 2023-05-08T13:40:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:09 smithi133 ceph-mon[125939]: pgmap v19119: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 998 KiB/s wr, 23 op/s 2023-05-08T13:40:10.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35748.387790 secs 2023-05-08T13:40:10.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:09 smithi096 ceph-mon[124666]: pgmap v19119: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 998 KiB/s wr, 23 op/s 2023-05-08T13:40:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:11 smithi186 ceph-mon[126480]: pgmap v19120: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 26 op/s 2023-05-08T13:40:12.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:11 smithi133 ceph-mon[125939]: pgmap v19120: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 26 op/s 2023-05-08T13:40:12.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:11 smithi096 ceph-mon[124666]: pgmap v19120: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 26 op/s 2023-05-08T13:40:13.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:13 smithi186 ceph-mon[126480]: pgmap v19121: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 735 KiB/s rd, 748 KiB/s wr, 21 op/s 2023-05-08T13:40:13.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:13 smithi133 ceph-mon[125939]: pgmap v19121: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 735 KiB/s rd, 748 KiB/s wr, 21 op/s 2023-05-08T13:40:14.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:13 smithi096 ceph-mon[124666]: pgmap v19121: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 735 KiB/s rd, 748 KiB/s wr, 21 op/s 2023-05-08T13:40:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35753.387905 secs 2023-05-08T13:40:14.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35753.387905 secs 2023-05-08T13:40:15.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35753.387905 secs 2023-05-08T13:40:15.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:15 smithi186 ceph-mon[126480]: pgmap v19122: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 25 op/s 2023-05-08T13:40:15.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:15 smithi133 ceph-mon[125939]: pgmap v19122: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 25 op/s 2023-05-08T13:40:16.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:15 smithi096 ceph-mon[124666]: pgmap v19122: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 25 op/s 2023-05-08T13:40:18.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:17 smithi186 ceph-mon[126480]: pgmap v19123: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 545 KiB/s rd, 543 KiB/s wr, 7 op/s 2023-05-08T13:40:18.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:17 smithi133 ceph-mon[125939]: pgmap v19123: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 545 KiB/s rd, 543 KiB/s wr, 7 op/s 2023-05-08T13:40:18.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:17 smithi096 ceph-mon[124666]: pgmap v19123: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 545 KiB/s rd, 543 KiB/s wr, 7 op/s 2023-05-08T13:40:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35758.388016 secs 2023-05-08T13:40:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:19 smithi186 ceph-mon[126480]: pgmap v19124: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 545 KiB/s rd, 543 KiB/s wr, 7 op/s 2023-05-08T13:40:20.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35758.388016 secs 2023-05-08T13:40:20.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:19 smithi133 ceph-mon[125939]: pgmap v19124: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 545 KiB/s rd, 543 KiB/s wr, 7 op/s 2023-05-08T13:40:20.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35758.388016 secs 2023-05-08T13:40:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:19 smithi096 ceph-mon[124666]: pgmap v19124: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 545 KiB/s rd, 543 KiB/s wr, 7 op/s 2023-05-08T13:40:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35760.246443 secs 2023-05-08T13:40:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:21 smithi186 ceph-mon[126480]: pgmap v19125: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 568 KiB/s wr, 11 op/s 2023-05-08T13:40:22.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35760.246443 secs 2023-05-08T13:40:22.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:21 smithi133 ceph-mon[125939]: pgmap v19125: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 568 KiB/s wr, 11 op/s 2023-05-08T13:40:22.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35760.246443 secs 2023-05-08T13:40:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:21 smithi096 ceph-mon[124666]: pgmap v19125: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 568 KiB/s wr, 11 op/s 2023-05-08T13:40:23.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:22 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:40:23.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:22 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:40:23.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:22 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:40:23.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:22 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:40:23.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:22 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:40:23.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:22 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:40:23.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:22 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:40:23.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:22 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:40:23.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:22 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:40:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:23 smithi186 ceph-mon[126480]: pgmap v19126: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 322 KiB/s rd, 345 KiB/s wr, 7 op/s 2023-05-08T13:40:24.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:23 smithi133 ceph-mon[125939]: pgmap v19126: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 322 KiB/s rd, 345 KiB/s wr, 7 op/s 2023-05-08T13:40:24.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:23 smithi096 ceph-mon[124666]: pgmap v19126: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 322 KiB/s rd, 345 KiB/s wr, 7 op/s 2023-05-08T13:40:25.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35763.388155 secs 2023-05-08T13:40:25.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35763.388155 secs 2023-05-08T13:40:25.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35763.388155 secs 2023-05-08T13:40:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35763.942315 secs 2023-05-08T13:40:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:25 smithi186 ceph-mon[126480]: pgmap v19127: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 15 op/s 2023-05-08T13:40:26.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35763.942315 secs 2023-05-08T13:40:26.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:25 smithi133 ceph-mon[125939]: pgmap v19127: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 15 op/s 2023-05-08T13:40:26.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35763.942315 secs 2023-05-08T13:40:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:25 smithi096 ceph-mon[124666]: pgmap v19127: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 15 op/s 2023-05-08T13:40:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35765.246555 secs 2023-05-08T13:40:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:26 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:40:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:26 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:40:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:26 smithi186 ceph-mon[126480]: osdmap e1272: 12 total, 12 up, 12 in 2023-05-08T13:40:27.202 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35765.246555 secs 2023-05-08T13:40:27.202 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:26 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:40:27.202 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:26 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:40:27.202 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:26 smithi133 ceph-mon[125939]: osdmap e1272: 12 total, 12 up, 12 in 2023-05-08T13:40:27.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35765.246555 secs 2023-05-08T13:40:27.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:26 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:40:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:26 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:40:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:26 smithi096 ceph-mon[124666]: osdmap e1272: 12 total, 12 up, 12 in 2023-05-08T13:40:28.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:27 smithi186 ceph-mon[126480]: pgmap v19129: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 935 KiB/s rd, 963 KiB/s wr, 13 op/s 2023-05-08T13:40:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:40:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:27 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:40:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:40:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:40:28.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:40:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:27 smithi133 ceph-mon[125939]: pgmap v19129: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 935 KiB/s rd, 963 KiB/s wr, 13 op/s 2023-05-08T13:40:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:40:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:27 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:40:28.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:40:28.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:40:28.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:40:28.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:27 smithi096 ceph-mon[124666]: pgmap v19129: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 935 KiB/s rd, 963 KiB/s wr, 13 op/s 2023-05-08T13:40:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:40:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:27 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:40:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:40:28.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:40:28.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:40:29.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:28 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:40:29.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:28 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T13:40:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:28 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T13:40:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:28 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:40:29.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:28 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:40:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:28 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T13:40:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:28 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T13:40:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:28 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:40:29.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:28 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:40:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:28 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T13:40:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:28 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T13:40:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:28 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:40:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35768.388274 secs 2023-05-08T13:40:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:29 smithi186 ceph-mon[126480]: pgmap v19130: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 935 KiB/s rd, 963 KiB/s wr, 13 op/s 2023-05-08T13:40:30.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35768.388274 secs 2023-05-08T13:40:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:29 smithi133 ceph-mon[125939]: pgmap v19130: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 935 KiB/s rd, 963 KiB/s wr, 13 op/s 2023-05-08T13:40:30.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35768.388274 secs 2023-05-08T13:40:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:29 smithi096 ceph-mon[124666]: pgmap v19130: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 935 KiB/s rd, 963 KiB/s wr, 13 op/s 2023-05-08T13:40:31.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35768.942423 secs 2023-05-08T13:40:31.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35768.942423 secs 2023-05-08T13:40:31.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35768.942423 secs 2023-05-08T13:40:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35770.246676 secs 2023-05-08T13:40:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:31 smithi186 ceph-mon[126480]: pgmap v19131: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2023-05-08T13:40:32.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35770.246676 secs 2023-05-08T13:40:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:31 smithi133 ceph-mon[125939]: pgmap v19131: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2023-05-08T13:40:32.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35770.246676 secs 2023-05-08T13:40:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:31 smithi096 ceph-mon[124666]: pgmap v19131: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2023-05-08T13:40:33.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:33 smithi186 ceph-mon[126480]: osdmap e1273: 12 total, 12 up, 12 in 2023-05-08T13:40:33.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:33 smithi186 ceph-mon[126480]: pgmap v19133: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 408 KiB/s wr, 6 op/s 2023-05-08T13:40:33.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:33 smithi133 ceph-mon[125939]: osdmap e1273: 12 total, 12 up, 12 in 2023-05-08T13:40:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:33 smithi133 ceph-mon[125939]: pgmap v19133: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 408 KiB/s wr, 6 op/s 2023-05-08T13:40:34.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:33 smithi096 ceph-mon[124666]: osdmap e1273: 12 total, 12 up, 12 in 2023-05-08T13:40:34.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:33 smithi096 ceph-mon[124666]: pgmap v19133: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 408 KiB/s wr, 6 op/s 2023-05-08T13:40:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35773.388395 secs 2023-05-08T13:40:34.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35773.388395 secs 2023-05-08T13:40:35.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35773.388395 secs 2023-05-08T13:40:35.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35773.942545 secs 2023-05-08T13:40:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:35 smithi133 ceph-mon[125939]: pgmap v19134: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 605 KiB/s rd, 598 KiB/s wr, 10 op/s 2023-05-08T13:40:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35773.942545 secs 2023-05-08T13:40:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:35 smithi096 ceph-mon[124666]: pgmap v19134: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 605 KiB/s rd, 598 KiB/s wr, 10 op/s 2023-05-08T13:40:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35773.942545 secs 2023-05-08T13:40:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:35 smithi186 ceph-mon[126480]: pgmap v19134: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 605 KiB/s rd, 598 KiB/s wr, 10 op/s 2023-05-08T13:40:36.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35775.246815 secs 2023-05-08T13:40:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35775.246815 secs 2023-05-08T13:40:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35775.246815 secs 2023-05-08T13:40:37.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:37 smithi133 ceph-mon[125939]: pgmap v19135: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 540 KiB/s rd, 534 KiB/s wr, 9 op/s 2023-05-08T13:40:38.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:37 smithi096 ceph-mon[124666]: pgmap v19135: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 540 KiB/s rd, 534 KiB/s wr, 9 op/s 2023-05-08T13:40:38.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:37 smithi186 ceph-mon[126480]: pgmap v19135: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 540 KiB/s rd, 534 KiB/s wr, 9 op/s 2023-05-08T13:40:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35778.388533 secs 2023-05-08T13:40:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:39 smithi186 ceph-mon[126480]: pgmap v19136: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 540 KiB/s rd, 534 KiB/s wr, 9 op/s 2023-05-08T13:40:40.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35778.388533 secs 2023-05-08T13:40:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:39 smithi133 ceph-mon[125939]: pgmap v19136: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 540 KiB/s rd, 534 KiB/s wr, 9 op/s 2023-05-08T13:40:40.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35778.388533 secs 2023-05-08T13:40:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:39 smithi096 ceph-mon[124666]: pgmap v19136: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 540 KiB/s rd, 534 KiB/s wr, 9 op/s 2023-05-08T13:40:41.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35778.942608 secs 2023-05-08T13:40:41.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35778.942608 secs 2023-05-08T13:40:41.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35778.942608 secs 2023-05-08T13:40:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35780.246888 secs 2023-05-08T13:40:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:41 smithi186 ceph-mon[126480]: pgmap v19137: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 645 KiB/s rd, 447 KiB/s wr, 8 op/s 2023-05-08T13:40:42.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35780.246888 secs 2023-05-08T13:40:42.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:41 smithi133 ceph-mon[125939]: pgmap v19137: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 645 KiB/s rd, 447 KiB/s wr, 8 op/s 2023-05-08T13:40:42.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35780.246888 secs 2023-05-08T13:40:42.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:41 smithi096 ceph-mon[124666]: pgmap v19137: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 645 KiB/s rd, 447 KiB/s wr, 8 op/s 2023-05-08T13:40:43.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:43 smithi186 ceph-mon[126480]: pgmap v19138: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 631 KiB/s rd, 438 KiB/s wr, 7 op/s 2023-05-08T13:40:43.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:43 smithi133 ceph-mon[125939]: pgmap v19138: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 631 KiB/s rd, 438 KiB/s wr, 7 op/s 2023-05-08T13:40:44.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:43 smithi096 ceph-mon[124666]: pgmap v19138: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 631 KiB/s rd, 438 KiB/s wr, 7 op/s 2023-05-08T13:40:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35783.388621 secs 2023-05-08T13:40:44.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35783.388621 secs 2023-05-08T13:40:45.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35783.388621 secs 2023-05-08T13:40:45.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35783.942730 secs 2023-05-08T13:40:45.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:45 smithi133 ceph-mon[125939]: pgmap v19139: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 745 KiB/s rd, 471 KiB/s wr, 10 op/s 2023-05-08T13:40:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35783.942730 secs 2023-05-08T13:40:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:45 smithi096 ceph-mon[124666]: pgmap v19139: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 745 KiB/s rd, 471 KiB/s wr, 10 op/s 2023-05-08T13:40:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35783.942730 secs 2023-05-08T13:40:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:45 smithi186 ceph-mon[126480]: pgmap v19139: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 745 KiB/s rd, 471 KiB/s wr, 10 op/s 2023-05-08T13:40:46.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35785.247033 secs 2023-05-08T13:40:47.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35785.247033 secs 2023-05-08T13:40:47.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35785.247033 secs 2023-05-08T13:40:47.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:47 smithi133 ceph-mon[125939]: pgmap v19140: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 298 KiB/s wr, 6 op/s 2023-05-08T13:40:48.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:47 smithi096 ceph-mon[124666]: pgmap v19140: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 298 KiB/s wr, 6 op/s 2023-05-08T13:40:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:47 smithi186 ceph-mon[126480]: pgmap v19140: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 298 KiB/s wr, 6 op/s 2023-05-08T13:40:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35788.388687 secs 2023-05-08T13:40:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:49 smithi186 ceph-mon[126480]: pgmap v19141: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 298 KiB/s wr, 6 op/s 2023-05-08T13:40:50.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35788.388687 secs 2023-05-08T13:40:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:49 smithi133 ceph-mon[125939]: pgmap v19141: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 298 KiB/s wr, 6 op/s 2023-05-08T13:40:50.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35788.388687 secs 2023-05-08T13:40:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:49 smithi096 ceph-mon[124666]: pgmap v19141: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 298 KiB/s wr, 6 op/s 2023-05-08T13:40:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:51 smithi186 ceph-mon[126480]: pgmap v19142: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T13:40:52.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:51 smithi133 ceph-mon[125939]: pgmap v19142: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T13:40:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:51 smithi096 ceph-mon[124666]: pgmap v19142: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T13:40:53.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:53 smithi186 ceph-mon[126480]: pgmap v19143: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 877 KiB/s wr, 8 op/s 2023-05-08T13:40:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:53 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:40:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:53 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:40:53.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:53 smithi133 ceph-mon[125939]: pgmap v19143: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 877 KiB/s wr, 8 op/s 2023-05-08T13:40:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:53 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:40:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:53 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:40:54.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:53 smithi096 ceph-mon[124666]: pgmap v19143: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 877 KiB/s wr, 8 op/s 2023-05-08T13:40:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:53 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:40:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:53 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:40:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:54 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:40:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:54 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:40:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:54 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:40:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:54 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:40:54.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:54 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:40:54.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:54 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:40:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:54 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:40:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:54 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:40:55.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:54 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:40:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:54 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:40:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:54 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:40:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:54 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:40:55.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35793.388808 secs 2023-05-08T13:40:55.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:55 smithi186 ceph-mon[126480]: pgmap v19144: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2023-05-08T13:40:55.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35793.388808 secs 2023-05-08T13:40:55.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:55 smithi133 ceph-mon[125939]: pgmap v19144: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2023-05-08T13:40:56.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35793.388808 secs 2023-05-08T13:40:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:55 smithi096 ceph-mon[124666]: pgmap v19144: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2023-05-08T13:40:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:57 smithi186 ceph-mon[126480]: pgmap v19145: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T13:40:58.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:57 smithi133 ceph-mon[125939]: pgmap v19145: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T13:40:58.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:57 smithi096 ceph-mon[124666]: pgmap v19145: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T13:41:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35798.388927 secs 2023-05-08T13:41:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:40:59 smithi186 ceph-mon[126480]: pgmap v19146: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T13:41:00.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35798.388927 secs 2023-05-08T13:41:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:40:59 smithi133 ceph-mon[125939]: pgmap v19146: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T13:41:00.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35798.388927 secs 2023-05-08T13:41:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:40:59 smithi096 ceph-mon[124666]: pgmap v19146: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T13:41:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35798.943048 secs 2023-05-08T13:41:01.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35798.943048 secs 2023-05-08T13:41:01.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35798.943048 secs 2023-05-08T13:41:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:01 smithi186 ceph-mon[126480]: pgmap v19147: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 15 op/s 2023-05-08T13:41:02.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:01 smithi133 ceph-mon[125939]: pgmap v19147: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 15 op/s 2023-05-08T13:41:02.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:01 smithi096 ceph-mon[124666]: pgmap v19147: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 15 op/s 2023-05-08T13:41:03.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:02 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:41:03.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:41:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:41:03.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:02 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:41:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:41:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:41:03.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:02 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:41:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:41:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:41:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:03 smithi186 ceph-mon[126480]: pgmap v19148: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 719 KiB/s rd, 717 KiB/s wr, 10 op/s 2023-05-08T13:41:04.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:03 smithi133 ceph-mon[125939]: pgmap v19148: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 719 KiB/s rd, 717 KiB/s wr, 10 op/s 2023-05-08T13:41:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:03 smithi096 ceph-mon[124666]: pgmap v19148: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 719 KiB/s rd, 717 KiB/s wr, 10 op/s 2023-05-08T13:41:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35803.389045 secs 2023-05-08T13:41:05.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35803.389045 secs 2023-05-08T13:41:05.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35803.389045 secs 2023-05-08T13:41:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35803.943138 secs 2023-05-08T13:41:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:05 smithi186 ceph-mon[126480]: pgmap v19149: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 15 op/s 2023-05-08T13:41:06.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35803.943138 secs 2023-05-08T13:41:06.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:05 smithi133 ceph-mon[125939]: pgmap v19149: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 15 op/s 2023-05-08T13:41:06.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35803.943138 secs 2023-05-08T13:41:06.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:05 smithi096 ceph-mon[124666]: pgmap v19149: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 15 op/s 2023-05-08T13:41:08.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:07 smithi186 ceph-mon[126480]: pgmap v19150: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 503 KiB/s rd, 500 KiB/s wr, 10 op/s 2023-05-08T13:41:08.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:07 smithi133 ceph-mon[125939]: pgmap v19150: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 503 KiB/s rd, 500 KiB/s wr, 10 op/s 2023-05-08T13:41:08.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:07 smithi096 ceph-mon[124666]: pgmap v19150: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 503 KiB/s rd, 500 KiB/s wr, 10 op/s 2023-05-08T13:41:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35808.389192 secs 2023-05-08T13:41:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:09 smithi186 ceph-mon[126480]: pgmap v19151: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 503 KiB/s rd, 500 KiB/s wr, 10 op/s 2023-05-08T13:41:10.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35808.389192 secs 2023-05-08T13:41:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:09 smithi133 ceph-mon[125939]: pgmap v19151: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 503 KiB/s rd, 500 KiB/s wr, 10 op/s 2023-05-08T13:41:10.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35808.389192 secs 2023-05-08T13:41:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:09 smithi096 ceph-mon[124666]: pgmap v19151: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 503 KiB/s rd, 500 KiB/s wr, 10 op/s 2023-05-08T13:41:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:11 smithi186 ceph-mon[126480]: pgmap v19152: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 26 op/s 2023-05-08T13:41:12.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:11 smithi133 ceph-mon[125939]: pgmap v19152: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 26 op/s 2023-05-08T13:41:12.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:11 smithi096 ceph-mon[124666]: pgmap v19152: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 26 op/s 2023-05-08T13:41:13.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:13 smithi186 ceph-mon[126480]: pgmap v19153: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 872 KiB/s rd, 1.0 MiB/s wr, 22 op/s 2023-05-08T13:41:13.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:13 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:41:13.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:13 smithi133 ceph-mon[125939]: pgmap v19153: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 872 KiB/s rd, 1.0 MiB/s wr, 22 op/s 2023-05-08T13:41:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:13 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:41:14.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:13 smithi096 ceph-mon[124666]: pgmap v19153: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 872 KiB/s rd, 1.0 MiB/s wr, 22 op/s 2023-05-08T13:41:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:13 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:41:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:14 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:41:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:14 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:41:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:14 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:41:14.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:14 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:41:14.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:14 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:41:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:14 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:41:15.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:14 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:41:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:14 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:41:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:14 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:41:15.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35813.389325 secs 2023-05-08T13:41:15.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:15 smithi186 ceph-mon[126480]: pgmap v19154: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 26 op/s 2023-05-08T13:41:15.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35813.389325 secs 2023-05-08T13:41:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:15 smithi133 ceph-mon[125939]: pgmap v19154: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 26 op/s 2023-05-08T13:41:16.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35813.389325 secs 2023-05-08T13:41:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:15 smithi096 ceph-mon[124666]: pgmap v19154: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 26 op/s 2023-05-08T13:41:18.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:17 smithi186 ceph-mon[126480]: pgmap v19155: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 998 KiB/s rd, 1012 KiB/s wr, 20 op/s 2023-05-08T13:41:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:17 smithi133 ceph-mon[125939]: pgmap v19155: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 998 KiB/s rd, 1012 KiB/s wr, 20 op/s 2023-05-08T13:41:18.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:17 smithi096 ceph-mon[124666]: pgmap v19155: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 998 KiB/s rd, 1012 KiB/s wr, 20 op/s 2023-05-08T13:41:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35818.389442 secs 2023-05-08T13:41:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:19 smithi186 ceph-mon[126480]: pgmap v19156: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 998 KiB/s rd, 1012 KiB/s wr, 20 op/s 2023-05-08T13:41:20.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35818.389442 secs 2023-05-08T13:41:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:19 smithi133 ceph-mon[125939]: pgmap v19156: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 998 KiB/s rd, 1012 KiB/s wr, 20 op/s 2023-05-08T13:41:20.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35818.389442 secs 2023-05-08T13:41:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:19 smithi096 ceph-mon[124666]: pgmap v19156: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 998 KiB/s rd, 1012 KiB/s wr, 20 op/s 2023-05-08T13:41:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:21 smithi186 ceph-mon[126480]: pgmap v19157: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 24 op/s 2023-05-08T13:41:22.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:21 smithi133 ceph-mon[125939]: pgmap v19157: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 24 op/s 2023-05-08T13:41:22.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:21 smithi096 ceph-mon[124666]: pgmap v19157: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 24 op/s 2023-05-08T13:41:23.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:23 smithi186 ceph-mon[126480]: pgmap v19158: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 991 KiB/s rd, 595 KiB/s wr, 8 op/s 2023-05-08T13:41:23.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:23 smithi133 ceph-mon[125939]: pgmap v19158: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 991 KiB/s rd, 595 KiB/s wr, 8 op/s 2023-05-08T13:41:24.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:23 smithi096 ceph-mon[124666]: pgmap v19158: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 991 KiB/s rd, 595 KiB/s wr, 8 op/s 2023-05-08T13:41:24.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35823.389528 secs 2023-05-08T13:41:25.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35823.389528 secs 2023-05-08T13:41:25.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35823.389528 secs 2023-05-08T13:41:25.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35823.943593 secs 2023-05-08T13:41:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:25 smithi133 ceph-mon[125939]: pgmap v19159: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.4 MiB/s wr, 16 op/s 2023-05-08T13:41:26.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35823.943593 secs 2023-05-08T13:41:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:25 smithi096 ceph-mon[124666]: pgmap v19159: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.4 MiB/s wr, 16 op/s 2023-05-08T13:41:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35823.943593 secs 2023-05-08T13:41:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:25 smithi186 ceph-mon[126480]: pgmap v19159: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.4 MiB/s wr, 16 op/s 2023-05-08T13:41:26.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35825.248068 secs 2023-05-08T13:41:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:26 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:41:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:26 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:41:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:26 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:41:27.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35825.248068 secs 2023-05-08T13:41:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:26 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:41:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:26 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:41:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:26 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:41:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35825.248068 secs 2023-05-08T13:41:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:26 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:41:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:26 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:41:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:26 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:41:27.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:27 smithi133 ceph-mon[125939]: pgmap v19160: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T13:41:28.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:27 smithi096 ceph-mon[124666]: pgmap v19160: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T13:41:28.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:27 smithi186 ceph-mon[126480]: pgmap v19160: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T13:41:28.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:28 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:41:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:28 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:41:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:28 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:41:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:28 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:41:29.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:28 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:41:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:28 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:41:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:28 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:41:29.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:28 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:41:29.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:28 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:41:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:28 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:41:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:28 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:41:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:28 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:41:29.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:29 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:41:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:29 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T13:41:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:29 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T13:41:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:29 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:41:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35828.389587 secs 2023-05-08T13:41:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:29 smithi133 ceph-mon[125939]: pgmap v19161: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T13:41:30.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:29 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:41:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:29 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T13:41:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:29 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T13:41:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:29 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:41:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35828.389587 secs 2023-05-08T13:41:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:29 smithi096 ceph-mon[124666]: pgmap v19161: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T13:41:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:29 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:41:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:29 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T13:41:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:29 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T13:41:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:29 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:41:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35828.389587 secs 2023-05-08T13:41:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:29 smithi186 ceph-mon[126480]: pgmap v19161: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T13:41:30.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35828.943664 secs 2023-05-08T13:41:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:30 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:41:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:30 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:41:31.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35828.943664 secs 2023-05-08T13:41:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:30 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:41:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:30 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:41:31.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35828.943664 secs 2023-05-08T13:41:31.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:30 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:41:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:30 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:41:31.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35830.248184 secs 2023-05-08T13:41:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:31 smithi133 ceph-mon[125939]: osdmap e1274: 12 total, 12 up, 12 in 2023-05-08T13:41:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:31 smithi133 ceph-mon[125939]: pgmap v19163: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.2 MiB/s wr, 15 op/s 2023-05-08T13:41:32.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35830.248184 secs 2023-05-08T13:41:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:31 smithi096 ceph-mon[124666]: osdmap e1274: 12 total, 12 up, 12 in 2023-05-08T13:41:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:31 smithi096 ceph-mon[124666]: pgmap v19163: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.2 MiB/s wr, 15 op/s 2023-05-08T13:41:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35830.248184 secs 2023-05-08T13:41:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:31 smithi186 ceph-mon[126480]: osdmap e1274: 12 total, 12 up, 12 in 2023-05-08T13:41:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:31 smithi186 ceph-mon[126480]: pgmap v19163: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.2 MiB/s wr, 15 op/s 2023-05-08T13:41:32.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:32 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:41:33.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:32 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:41:33.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:32 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:41:33.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:33 smithi133 ceph-mon[125939]: pgmap v19164: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.2 MiB/s wr, 15 op/s 2023-05-08T13:41:34.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:33 smithi096 ceph-mon[124666]: pgmap v19164: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.2 MiB/s wr, 15 op/s 2023-05-08T13:41:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:33 smithi186 ceph-mon[126480]: pgmap v19164: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.2 MiB/s wr, 15 op/s 2023-05-08T13:41:34.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35833.389721 secs 2023-05-08T13:41:35.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35833.389721 secs 2023-05-08T13:41:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35833.389721 secs 2023-05-08T13:41:35.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35833.943735 secs 2023-05-08T13:41:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:35 smithi133 ceph-mon[125939]: pgmap v19165: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 757 KiB/s rd, 756 KiB/s wr, 11 op/s 2023-05-08T13:41:36.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35833.943735 secs 2023-05-08T13:41:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:35 smithi096 ceph-mon[124666]: pgmap v19165: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 757 KiB/s rd, 756 KiB/s wr, 11 op/s 2023-05-08T13:41:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35833.943735 secs 2023-05-08T13:41:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:35 smithi186 ceph-mon[126480]: pgmap v19165: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 757 KiB/s rd, 756 KiB/s wr, 11 op/s 2023-05-08T13:41:36.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35835.248322 secs 2023-05-08T13:41:37.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35835.248322 secs 2023-05-08T13:41:37.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35835.248322 secs 2023-05-08T13:41:37.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:37 smithi133 ceph-mon[125939]: pgmap v19166: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 757 KiB/s rd, 756 KiB/s wr, 11 op/s 2023-05-08T13:41:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:37 smithi096 ceph-mon[124666]: pgmap v19166: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 757 KiB/s rd, 756 KiB/s wr, 11 op/s 2023-05-08T13:41:38.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:37 smithi186 ceph-mon[126480]: pgmap v19166: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 757 KiB/s rd, 756 KiB/s wr, 11 op/s 2023-05-08T13:41:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35838.389821 secs 2023-05-08T13:41:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:39 smithi186 ceph-mon[126480]: pgmap v19167: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 757 KiB/s rd, 756 KiB/s wr, 11 op/s 2023-05-08T13:41:40.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35838.389821 secs 2023-05-08T13:41:40.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:39 smithi133 ceph-mon[125939]: pgmap v19167: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 757 KiB/s rd, 756 KiB/s wr, 11 op/s 2023-05-08T13:41:40.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35838.389821 secs 2023-05-08T13:41:40.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:39 smithi096 ceph-mon[124666]: pgmap v19167: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 757 KiB/s rd, 756 KiB/s wr, 11 op/s 2023-05-08T13:41:41.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35838.943807 secs 2023-05-08T13:41:41.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35838.943807 secs 2023-05-08T13:41:41.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35838.943807 secs 2023-05-08T13:41:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35840.248444 secs 2023-05-08T13:41:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:41 smithi186 ceph-mon[126480]: pgmap v19168: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 756 KiB/s rd, 934 KiB/s wr, 10 op/s 2023-05-08T13:41:42.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35840.248444 secs 2023-05-08T13:41:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:41 smithi133 ceph-mon[125939]: pgmap v19168: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 756 KiB/s rd, 934 KiB/s wr, 10 op/s 2023-05-08T13:41:42.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35840.248444 secs 2023-05-08T13:41:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:41 smithi096 ceph-mon[124666]: pgmap v19168: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 756 KiB/s rd, 934 KiB/s wr, 10 op/s 2023-05-08T13:41:43.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:43 smithi186 ceph-mon[126480]: osdmap e1275: 12 total, 12 up, 12 in 2023-05-08T13:41:43.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:43 smithi186 ceph-mon[126480]: pgmap v19170: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 765 KiB/s rd, 945 KiB/s wr, 10 op/s 2023-05-08T13:41:43.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:43 smithi133 ceph-mon[125939]: osdmap e1275: 12 total, 12 up, 12 in 2023-05-08T13:41:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:43 smithi133 ceph-mon[125939]: pgmap v19170: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 765 KiB/s rd, 945 KiB/s wr, 10 op/s 2023-05-08T13:41:44.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:43 smithi096 ceph-mon[124666]: osdmap e1275: 12 total, 12 up, 12 in 2023-05-08T13:41:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:43 smithi096 ceph-mon[124666]: pgmap v19170: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 765 KiB/s rd, 945 KiB/s wr, 10 op/s 2023-05-08T13:41:44.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35843.389968 secs 2023-05-08T13:41:45.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35843.389968 secs 2023-05-08T13:41:45.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35843.389968 secs 2023-05-08T13:41:45.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35843.943872 secs 2023-05-08T13:41:45.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:45 smithi133 ceph-mon[125939]: pgmap v19171: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 727 KiB/s wr, 9 op/s 2023-05-08T13:41:46.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35843.943872 secs 2023-05-08T13:41:46.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:45 smithi096 ceph-mon[124666]: pgmap v19171: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 727 KiB/s wr, 9 op/s 2023-05-08T13:41:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35843.943872 secs 2023-05-08T13:41:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:45 smithi186 ceph-mon[126480]: pgmap v19171: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 727 KiB/s wr, 9 op/s 2023-05-08T13:41:46.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35845.248583 secs 2023-05-08T13:41:47.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35845.248583 secs 2023-05-08T13:41:47.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35845.248583 secs 2023-05-08T13:41:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:47 smithi133 ceph-mon[125939]: pgmap v19172: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 727 KiB/s wr, 9 op/s 2023-05-08T13:41:48.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:47 smithi096 ceph-mon[124666]: pgmap v19172: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 727 KiB/s wr, 9 op/s 2023-05-08T13:41:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:47 smithi186 ceph-mon[126480]: pgmap v19172: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 727 KiB/s wr, 9 op/s 2023-05-08T13:41:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35848.390084 secs 2023-05-08T13:41:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:49 smithi186 ceph-mon[126480]: pgmap v19173: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 727 KiB/s wr, 9 op/s 2023-05-08T13:41:50.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35848.390084 secs 2023-05-08T13:41:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:49 smithi133 ceph-mon[125939]: pgmap v19173: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 727 KiB/s wr, 9 op/s 2023-05-08T13:41:50.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35848.390084 secs 2023-05-08T13:41:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:49 smithi096 ceph-mon[124666]: pgmap v19173: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 727 KiB/s wr, 9 op/s 2023-05-08T13:41:51.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35848.943999 secs 2023-05-08T13:41:51.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35848.943999 secs 2023-05-08T13:41:51.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35848.943999 secs 2023-05-08T13:41:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35850.248676 secs 2023-05-08T13:41:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:51 smithi186 ceph-mon[126480]: pgmap v19174: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 733 KiB/s rd, 549 KiB/s wr, 8 op/s 2023-05-08T13:41:52.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35850.248676 secs 2023-05-08T13:41:52.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:51 smithi133 ceph-mon[125939]: pgmap v19174: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 733 KiB/s rd, 549 KiB/s wr, 8 op/s 2023-05-08T13:41:52.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35850.248676 secs 2023-05-08T13:41:52.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:51 smithi096 ceph-mon[124666]: pgmap v19174: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 733 KiB/s rd, 549 KiB/s wr, 8 op/s 2023-05-08T13:41:53.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:53 smithi186 ceph-mon[126480]: pgmap v19175: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 537 KiB/s wr, 8 op/s 2023-05-08T13:41:53.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:53 smithi133 ceph-mon[125939]: pgmap v19175: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 537 KiB/s wr, 8 op/s 2023-05-08T13:41:54.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:53 smithi096 ceph-mon[124666]: pgmap v19175: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 537 KiB/s wr, 8 op/s 2023-05-08T13:41:54.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35853.390201 secs 2023-05-08T13:41:55.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35853.390201 secs 2023-05-08T13:41:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35853.390201 secs 2023-05-08T13:41:55.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:55 smithi133 ceph-mon[125939]: pgmap v19176: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 932 KiB/s wr, 11 op/s 2023-05-08T13:41:56.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:55 smithi096 ceph-mon[124666]: pgmap v19176: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 932 KiB/s wr, 11 op/s 2023-05-08T13:41:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:55 smithi186 ceph-mon[126480]: pgmap v19176: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 932 KiB/s wr, 11 op/s 2023-05-08T13:41:56.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35855.248815 secs 2023-05-08T13:41:57.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35855.248815 secs 2023-05-08T13:41:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35855.248815 secs 2023-05-08T13:41:57.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:57 smithi133 ceph-mon[125939]: pgmap v19177: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 934 KiB/s rd, 631 KiB/s wr, 8 op/s 2023-05-08T13:41:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:41:58.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:57 smithi096 ceph-mon[124666]: pgmap v19177: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 934 KiB/s rd, 631 KiB/s wr, 8 op/s 2023-05-08T13:41:58.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:41:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:57 smithi186 ceph-mon[126480]: pgmap v19177: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 934 KiB/s rd, 631 KiB/s wr, 8 op/s 2023-05-08T13:41:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:41:58.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:58 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:41:58.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:41:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:41:59.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:58 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:41:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:41:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:41:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:58 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:41:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:41:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:41:59.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35858.390319 secs 2023-05-08T13:41:59.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:41:59 smithi133 ceph-mon[125939]: pgmap v19178: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 934 KiB/s rd, 631 KiB/s wr, 8 op/s 2023-05-08T13:42:00.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35858.390319 secs 2023-05-08T13:42:00.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:41:59 smithi096 ceph-mon[124666]: pgmap v19178: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 934 KiB/s rd, 631 KiB/s wr, 8 op/s 2023-05-08T13:42:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35858.390319 secs 2023-05-08T13:42:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:41:59 smithi186 ceph-mon[126480]: pgmap v19178: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 934 KiB/s rd, 631 KiB/s wr, 8 op/s 2023-05-08T13:42:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:01 smithi186 ceph-mon[126480]: pgmap v19179: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 13 op/s 2023-05-08T13:42:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:01 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:42:02.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:01 smithi133 ceph-mon[125939]: pgmap v19179: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 13 op/s 2023-05-08T13:42:02.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:01 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:42:02.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:01 smithi096 ceph-mon[124666]: pgmap v19179: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 13 op/s 2023-05-08T13:42:02.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:01 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:42:03.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:42:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:42:03.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:42:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:42:03.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:42:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:42:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:03 smithi186 ceph-mon[126480]: pgmap v19180: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 1.2 MiB/s wr, 9 op/s 2023-05-08T13:42:04.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:03 smithi133 ceph-mon[125939]: pgmap v19180: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 1.2 MiB/s wr, 9 op/s 2023-05-08T13:42:04.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:03 smithi096 ceph-mon[124666]: pgmap v19180: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 1.2 MiB/s wr, 9 op/s 2023-05-08T13:42:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35863.390407 secs 2023-05-08T13:42:05.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35863.390407 secs 2023-05-08T13:42:05.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35863.390407 secs 2023-05-08T13:42:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:05 smithi186 ceph-mon[126480]: pgmap v19181: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 31 op/s 2023-05-08T13:42:06.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:05 smithi133 ceph-mon[125939]: pgmap v19181: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 31 op/s 2023-05-08T13:42:06.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:05 smithi096 ceph-mon[124666]: pgmap v19181: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 31 op/s 2023-05-08T13:42:07.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35865.248991 secs 2023-05-08T13:42:07.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:06 smithi186 ceph-mon[126480]: osdmap e1276: 12 total, 12 up, 12 in 2023-05-08T13:42:07.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35865.248991 secs 2023-05-08T13:42:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:06 smithi133 ceph-mon[125939]: osdmap e1276: 12 total, 12 up, 12 in 2023-05-08T13:42:07.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35865.248991 secs 2023-05-08T13:42:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:06 smithi096 ceph-mon[124666]: osdmap e1276: 12 total, 12 up, 12 in 2023-05-08T13:42:08.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:07 smithi133 ceph-mon[125939]: pgmap v19183: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 32 op/s 2023-05-08T13:42:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:07 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:42:08.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:07 smithi096 ceph-mon[124666]: pgmap v19183: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 32 op/s 2023-05-08T13:42:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:07 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:42:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:07 smithi186 ceph-mon[126480]: pgmap v19183: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 32 op/s 2023-05-08T13:42:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:07 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:42:10.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35868.390496 secs 2023-05-08T13:42:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:09 smithi133 ceph-mon[125939]: pgmap v19184: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 32 op/s 2023-05-08T13:42:10.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35868.390496 secs 2023-05-08T13:42:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:09 smithi096 ceph-mon[124666]: pgmap v19184: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 32 op/s 2023-05-08T13:42:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35868.390496 secs 2023-05-08T13:42:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:09 smithi186 ceph-mon[126480]: pgmap v19184: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 32 op/s 2023-05-08T13:42:11.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:10 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:42:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:10 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:42:11.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:10 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:42:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:10 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:42:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:10 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:42:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:10 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:42:12.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35870.249067 secs 2023-05-08T13:42:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:11 smithi133 ceph-mon[125939]: pgmap v19185: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 1.8 MiB/s wr, 30 op/s 2023-05-08T13:42:12.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35870.249067 secs 2023-05-08T13:42:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:11 smithi096 ceph-mon[124666]: pgmap v19185: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 1.8 MiB/s wr, 30 op/s 2023-05-08T13:42:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35870.249067 secs 2023-05-08T13:42:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:11 smithi186 ceph-mon[126480]: pgmap v19185: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 1.8 MiB/s wr, 30 op/s 2023-05-08T13:42:13.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:12 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:42:13.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:12 smithi133 ceph-mon[125939]: osdmap e1277: 12 total, 12 up, 12 in 2023-05-08T13:42:13.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:12 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:42:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:12 smithi096 ceph-mon[124666]: osdmap e1277: 12 total, 12 up, 12 in 2023-05-08T13:42:13.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:12 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:42:13.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:12 smithi186 ceph-mon[126480]: osdmap e1277: 12 total, 12 up, 12 in 2023-05-08T13:42:14.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:13 smithi133 ceph-mon[125939]: pgmap v19187: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 579 KiB/s rd, 552 KiB/s wr, 6 op/s 2023-05-08T13:42:14.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:13 smithi096 ceph-mon[124666]: pgmap v19187: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 579 KiB/s rd, 552 KiB/s wr, 6 op/s 2023-05-08T13:42:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:13 smithi186 ceph-mon[126480]: pgmap v19187: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 579 KiB/s rd, 552 KiB/s wr, 6 op/s 2023-05-08T13:42:15.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35873.390557 secs 2023-05-08T13:42:15.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35873.390557 secs 2023-05-08T13:42:15.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35873.390557 secs 2023-05-08T13:42:16.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:15 smithi133 ceph-mon[125939]: pgmap v19188: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 934 KiB/s wr, 11 op/s 2023-05-08T13:42:16.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:15 smithi096 ceph-mon[124666]: pgmap v19188: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 934 KiB/s wr, 11 op/s 2023-05-08T13:42:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:15 smithi186 ceph-mon[126480]: pgmap v19188: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 934 KiB/s wr, 11 op/s 2023-05-08T13:42:17.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35875.249186 secs 2023-05-08T13:42:17.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35875.249186 secs 2023-05-08T13:42:17.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35875.249186 secs 2023-05-08T13:42:18.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:17 smithi133 ceph-mon[125939]: pgmap v19189: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 833 KiB/s wr, 10 op/s 2023-05-08T13:42:18.299 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:17 smithi096 ceph-mon[124666]: pgmap v19189: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 833 KiB/s wr, 10 op/s 2023-05-08T13:42:18.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:17 smithi186 ceph-mon[126480]: pgmap v19189: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 833 KiB/s wr, 10 op/s 2023-05-08T13:42:20.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35878.390663 secs 2023-05-08T13:42:20.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:19 smithi133 ceph-mon[125939]: pgmap v19190: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 833 KiB/s wr, 10 op/s 2023-05-08T13:42:20.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35878.390663 secs 2023-05-08T13:42:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:19 smithi096 ceph-mon[124666]: pgmap v19190: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 833 KiB/s wr, 10 op/s 2023-05-08T13:42:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35878.390663 secs 2023-05-08T13:42:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:19 smithi186 ceph-mon[126480]: pgmap v19190: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 833 KiB/s wr, 10 op/s 2023-05-08T13:42:22.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35880.249314 secs 2023-05-08T13:42:22.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:21 smithi133 ceph-mon[125939]: pgmap v19191: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 603 KiB/s rd, 422 KiB/s wr, 8 op/s 2023-05-08T13:42:22.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35880.249314 secs 2023-05-08T13:42:22.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:21 smithi096 ceph-mon[124666]: pgmap v19191: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 603 KiB/s rd, 422 KiB/s wr, 8 op/s 2023-05-08T13:42:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35880.249314 secs 2023-05-08T13:42:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:21 smithi186 ceph-mon[126480]: pgmap v19191: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 603 KiB/s rd, 422 KiB/s wr, 8 op/s 2023-05-08T13:42:23.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:23 smithi186 ceph-mon[126480]: pgmap v19192: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 590 KiB/s rd, 413 KiB/s wr, 8 op/s 2023-05-08T13:42:23.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:23 smithi133 ceph-mon[125939]: pgmap v19192: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 590 KiB/s rd, 413 KiB/s wr, 8 op/s 2023-05-08T13:42:24.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:23 smithi096 ceph-mon[124666]: pgmap v19192: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 590 KiB/s rd, 413 KiB/s wr, 8 op/s 2023-05-08T13:42:24.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35883.390783 secs 2023-05-08T13:42:25.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35883.390783 secs 2023-05-08T13:42:25.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35883.390783 secs 2023-05-08T13:42:25.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35883.944858 secs 2023-05-08T13:42:25.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:25 smithi133 ceph-mon[125939]: pgmap v19193: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T13:42:26.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35883.944858 secs 2023-05-08T13:42:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:25 smithi096 ceph-mon[124666]: pgmap v19193: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T13:42:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35883.944858 secs 2023-05-08T13:42:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:25 smithi186 ceph-mon[126480]: pgmap v19193: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T13:42:26.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35885.249406 secs 2023-05-08T13:42:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:26 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:42:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:26 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:42:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:26 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:42:27.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35885.249406 secs 2023-05-08T13:42:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:26 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:42:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:26 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:42:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:26 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:42:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35885.249406 secs 2023-05-08T13:42:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:26 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:42:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:26 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:42:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:26 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:42:27.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:27 smithi133 ceph-mon[125939]: pgmap v19194: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 843 KiB/s rd, 841 KiB/s wr, 8 op/s 2023-05-08T13:42:28.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:27 smithi096 ceph-mon[124666]: pgmap v19194: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 843 KiB/s rd, 841 KiB/s wr, 8 op/s 2023-05-08T13:42:28.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:27 smithi186 ceph-mon[126480]: pgmap v19194: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 843 KiB/s rd, 841 KiB/s wr, 8 op/s 2023-05-08T13:42:28.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:28 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:42:29.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:28 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:42:29.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:28 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:42:29.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35888.390855 secs 2023-05-08T13:42:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:29 smithi133 ceph-mon[125939]: pgmap v19195: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 843 KiB/s rd, 841 KiB/s wr, 8 op/s 2023-05-08T13:42:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:29 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:42:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:29 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:42:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:29 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:42:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:29 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:42:29.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:29 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T13:42:29.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:29 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T13:42:29.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:29 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:42:30.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35888.390855 secs 2023-05-08T13:42:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:29 smithi096 ceph-mon[124666]: pgmap v19195: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 843 KiB/s rd, 841 KiB/s wr, 8 op/s 2023-05-08T13:42:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:29 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:42:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:29 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:42:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:29 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:42:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:29 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:42:30.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:29 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T13:42:30.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:29 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T13:42:30.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:29 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:42:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35888.390855 secs 2023-05-08T13:42:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:29 smithi186 ceph-mon[126480]: pgmap v19195: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 843 KiB/s rd, 841 KiB/s wr, 8 op/s 2023-05-08T13:42:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:29 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:42:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:29 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:42:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:29 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:42:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:29 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:42:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:29 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T13:42:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:29 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T13:42:30.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:29 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:42:30.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35888.944921 secs 2023-05-08T13:42:31.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35888.944921 secs 2023-05-08T13:42:31.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35888.944921 secs 2023-05-08T13:42:31.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35890.249544 secs 2023-05-08T13:42:31.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:31 smithi133 ceph-mon[125939]: pgmap v19196: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T13:42:32.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35890.249544 secs 2023-05-08T13:42:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:31 smithi096 ceph-mon[124666]: pgmap v19196: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T13:42:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35890.249544 secs 2023-05-08T13:42:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:31 smithi186 ceph-mon[126480]: pgmap v19196: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T13:42:33.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:33 smithi186 ceph-mon[126480]: pgmap v19197: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 8 op/s 2023-05-08T13:42:33.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:33 smithi133 ceph-mon[125939]: pgmap v19197: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 8 op/s 2023-05-08T13:42:34.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:33 smithi096 ceph-mon[124666]: pgmap v19197: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 8 op/s 2023-05-08T13:42:34.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35893.390991 secs 2023-05-08T13:42:35.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35893.390991 secs 2023-05-08T13:42:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35893.390991 secs 2023-05-08T13:42:35.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35893.945037 secs 2023-05-08T13:42:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:35 smithi133 ceph-mon[125939]: pgmap v19198: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T13:42:36.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35893.945037 secs 2023-05-08T13:42:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:35 smithi096 ceph-mon[124666]: pgmap v19198: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T13:42:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35893.945037 secs 2023-05-08T13:42:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:35 smithi186 ceph-mon[126480]: pgmap v19198: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T13:42:36.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35895.249686 secs 2023-05-08T13:42:37.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35895.249686 secs 2023-05-08T13:42:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35895.249686 secs 2023-05-08T13:42:37.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:37 smithi133 ceph-mon[125939]: pgmap v19199: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 300 KiB/s wr, 8 op/s 2023-05-08T13:42:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:37 smithi096 ceph-mon[124666]: pgmap v19199: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 300 KiB/s wr, 8 op/s 2023-05-08T13:42:38.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:37 smithi186 ceph-mon[126480]: pgmap v19199: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 300 KiB/s wr, 8 op/s 2023-05-08T13:42:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35898.391088 secs 2023-05-08T13:42:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:39 smithi186 ceph-mon[126480]: pgmap v19200: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 300 KiB/s wr, 8 op/s 2023-05-08T13:42:40.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35898.391088 secs 2023-05-08T13:42:40.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:39 smithi133 ceph-mon[125939]: pgmap v19200: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 300 KiB/s wr, 8 op/s 2023-05-08T13:42:40.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35898.391088 secs 2023-05-08T13:42:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:39 smithi096 ceph-mon[124666]: pgmap v19200: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 300 KiB/s wr, 8 op/s 2023-05-08T13:42:41.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35898.945154 secs 2023-05-08T13:42:41.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35898.945154 secs 2023-05-08T13:42:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35898.945154 secs 2023-05-08T13:42:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35900.249827 secs 2023-05-08T13:42:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:41 smithi186 ceph-mon[126480]: pgmap v19201: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 605 KiB/s wr, 11 op/s 2023-05-08T13:42:42.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35900.249827 secs 2023-05-08T13:42:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:41 smithi133 ceph-mon[125939]: pgmap v19201: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 605 KiB/s wr, 11 op/s 2023-05-08T13:42:42.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35900.249827 secs 2023-05-08T13:42:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:41 smithi096 ceph-mon[124666]: pgmap v19201: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 605 KiB/s wr, 11 op/s 2023-05-08T13:42:43.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:43 smithi186 ceph-mon[126480]: pgmap v19202: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 333 KiB/s rd, 331 KiB/s wr, 7 op/s 2023-05-08T13:42:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:43 smithi133 ceph-mon[125939]: pgmap v19202: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 333 KiB/s rd, 331 KiB/s wr, 7 op/s 2023-05-08T13:42:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:43 smithi096 ceph-mon[124666]: pgmap v19202: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 333 KiB/s rd, 331 KiB/s wr, 7 op/s 2023-05-08T13:42:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35903.391193 secs 2023-05-08T13:42:44.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35903.391193 secs 2023-05-08T13:42:45.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35903.391193 secs 2023-05-08T13:42:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35903.945287 secs 2023-05-08T13:42:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:45 smithi186 ceph-mon[126480]: pgmap v19203: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 331 KiB/s wr, 10 op/s 2023-05-08T13:42:45.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35903.945287 secs 2023-05-08T13:42:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:45 smithi133 ceph-mon[125939]: pgmap v19203: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 331 KiB/s wr, 10 op/s 2023-05-08T13:42:46.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35903.945287 secs 2023-05-08T13:42:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:45 smithi096 ceph-mon[124666]: pgmap v19203: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 331 KiB/s wr, 10 op/s 2023-05-08T13:42:46.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35905.249909 secs 2023-05-08T13:42:46.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35905.249909 secs 2023-05-08T13:42:47.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35905.249909 secs 2023-05-08T13:42:47.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:47 smithi186 ceph-mon[126480]: pgmap v19204: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 306 KiB/s wr, 6 op/s 2023-05-08T13:42:47.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:47 smithi133 ceph-mon[125939]: pgmap v19204: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 306 KiB/s wr, 6 op/s 2023-05-08T13:42:48.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:47 smithi096 ceph-mon[124666]: pgmap v19204: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 306 KiB/s wr, 6 op/s 2023-05-08T13:42:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35908.391326 secs 2023-05-08T13:42:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:49 smithi186 ceph-mon[126480]: pgmap v19205: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 306 KiB/s wr, 6 op/s 2023-05-08T13:42:50.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35908.391326 secs 2023-05-08T13:42:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:49 smithi133 ceph-mon[125939]: pgmap v19205: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 306 KiB/s wr, 6 op/s 2023-05-08T13:42:50.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35908.391326 secs 2023-05-08T13:42:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:49 smithi096 ceph-mon[124666]: pgmap v19205: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 306 KiB/s wr, 6 op/s 2023-05-08T13:42:51.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35908.945422 secs 2023-05-08T13:42:51.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35908.945422 secs 2023-05-08T13:42:51.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35908.945422 secs 2023-05-08T13:42:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35910.250027 secs 2023-05-08T13:42:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:51 smithi186 ceph-mon[126480]: pgmap v19206: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 705 KiB/s rd, 633 KiB/s wr, 9 op/s 2023-05-08T13:42:52.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35910.250027 secs 2023-05-08T13:42:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:51 smithi133 ceph-mon[125939]: pgmap v19206: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 705 KiB/s rd, 633 KiB/s wr, 9 op/s 2023-05-08T13:42:52.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35910.250027 secs 2023-05-08T13:42:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:51 smithi096 ceph-mon[124666]: pgmap v19206: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 705 KiB/s rd, 633 KiB/s wr, 9 op/s 2023-05-08T13:42:53.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:53 smithi186 ceph-mon[126480]: pgmap v19207: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 327 KiB/s wr, 6 op/s 2023-05-08T13:42:53.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:53 smithi133 ceph-mon[125939]: pgmap v19207: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 327 KiB/s wr, 6 op/s 2023-05-08T13:42:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:53 smithi096 ceph-mon[124666]: pgmap v19207: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 327 KiB/s wr, 6 op/s 2023-05-08T13:42:54.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35913.391409 secs 2023-05-08T13:42:55.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35913.391409 secs 2023-05-08T13:42:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35913.391409 secs 2023-05-08T13:42:55.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:55 smithi133 ceph-mon[125939]: pgmap v19208: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 933 KiB/s wr, 11 op/s 2023-05-08T13:42:56.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:55 smithi096 ceph-mon[124666]: pgmap v19208: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 933 KiB/s wr, 11 op/s 2023-05-08T13:42:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:55 smithi186 ceph-mon[126480]: pgmap v19208: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 933 KiB/s wr, 11 op/s 2023-05-08T13:42:56.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35915.250153 secs 2023-05-08T13:42:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35915.250153 secs 2023-05-08T13:42:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35915.250153 secs 2023-05-08T13:42:57.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:57 smithi133 ceph-mon[125939]: pgmap v19209: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 933 KiB/s wr, 8 op/s 2023-05-08T13:42:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:42:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:57 smithi096 ceph-mon[124666]: pgmap v19209: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 933 KiB/s wr, 8 op/s 2023-05-08T13:42:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:42:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:57 smithi186 ceph-mon[126480]: pgmap v19209: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 933 KiB/s wr, 8 op/s 2023-05-08T13:42:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:42:58.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:58 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:42:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:42:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:42:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:58 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:42:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:42:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:42:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:58 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:42:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:42:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:42:59.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35918.391475 secs 2023-05-08T13:42:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:42:59 smithi133 ceph-mon[125939]: pgmap v19210: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 933 KiB/s wr, 8 op/s 2023-05-08T13:43:00.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35918.391475 secs 2023-05-08T13:43:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:42:59 smithi096 ceph-mon[124666]: pgmap v19210: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 933 KiB/s wr, 8 op/s 2023-05-08T13:43:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35918.391475 secs 2023-05-08T13:43:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:42:59 smithi186 ceph-mon[126480]: pgmap v19210: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 933 KiB/s wr, 8 op/s 2023-05-08T13:43:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:01 smithi186 ceph-mon[126480]: pgmap v19211: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 14 op/s 2023-05-08T13:43:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:01 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:43:02.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:01 smithi133 ceph-mon[125939]: pgmap v19211: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 14 op/s 2023-05-08T13:43:02.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:01 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:43:02.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:01 smithi096 ceph-mon[124666]: pgmap v19211: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 14 op/s 2023-05-08T13:43:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:01 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:43:03.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:43:03.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:43:03.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:43:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:43:03.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:43:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:43:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:03 smithi186 ceph-mon[126480]: pgmap v19212: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T13:43:04.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:03 smithi133 ceph-mon[125939]: pgmap v19212: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T13:43:04.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:03 smithi096 ceph-mon[124666]: pgmap v19212: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T13:43:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35923.391538 secs 2023-05-08T13:43:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35923.391538 secs 2023-05-08T13:43:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35923.391538 secs 2023-05-08T13:43:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35923.945712 secs 2023-05-08T13:43:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:05 smithi186 ceph-mon[126480]: pgmap v19213: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 28 op/s 2023-05-08T13:43:06.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35923.945712 secs 2023-05-08T13:43:06.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:05 smithi133 ceph-mon[125939]: pgmap v19213: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 28 op/s 2023-05-08T13:43:06.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35923.945712 secs 2023-05-08T13:43:06.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:05 smithi096 ceph-mon[124666]: pgmap v19213: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 28 op/s 2023-05-08T13:43:07.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:06 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:43:07.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:43:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:43:07.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:06 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:43:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:43:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:43:07.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:06 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:43:07.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:43:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:43:08.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:07 smithi133 ceph-mon[125939]: pgmap v19214: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 23 op/s 2023-05-08T13:43:08.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:07 smithi096 ceph-mon[124666]: pgmap v19214: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 23 op/s 2023-05-08T13:43:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:07 smithi186 ceph-mon[126480]: pgmap v19214: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 23 op/s 2023-05-08T13:43:10.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35928.391618 secs 2023-05-08T13:43:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:09 smithi133 ceph-mon[125939]: pgmap v19215: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 23 op/s 2023-05-08T13:43:10.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35928.391618 secs 2023-05-08T13:43:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:09 smithi096 ceph-mon[124666]: pgmap v19215: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 23 op/s 2023-05-08T13:43:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35928.391618 secs 2023-05-08T13:43:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:09 smithi186 ceph-mon[126480]: pgmap v19215: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 23 op/s 2023-05-08T13:43:11.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35928.945830 secs 2023-05-08T13:43:11.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35928.945830 secs 2023-05-08T13:43:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35928.945830 secs 2023-05-08T13:43:12.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:11 smithi133 ceph-mon[125939]: pgmap v19216: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 28 op/s 2023-05-08T13:43:12.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:11 smithi096 ceph-mon[124666]: pgmap v19216: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 28 op/s 2023-05-08T13:43:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:11 smithi186 ceph-mon[126480]: pgmap v19216: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 28 op/s 2023-05-08T13:43:13.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:13 smithi186 ceph-mon[126480]: pgmap v19217: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 441 KiB/s wr, 22 op/s 2023-05-08T13:43:13.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:13 smithi133 ceph-mon[125939]: pgmap v19217: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 441 KiB/s wr, 22 op/s 2023-05-08T13:43:14.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:13 smithi096 ceph-mon[124666]: pgmap v19217: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 441 KiB/s wr, 22 op/s 2023-05-08T13:43:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35933.391684 secs 2023-05-08T13:43:14.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35933.391684 secs 2023-05-08T13:43:15.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35933.391684 secs 2023-05-08T13:43:15.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35933.945950 secs 2023-05-08T13:43:15.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:15 smithi186 ceph-mon[126480]: pgmap v19218: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 905 KiB/s rd, 917 KiB/s wr, 26 op/s 2023-05-08T13:43:15.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35933.945950 secs 2023-05-08T13:43:15.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:15 smithi133 ceph-mon[125939]: pgmap v19218: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 905 KiB/s rd, 917 KiB/s wr, 26 op/s 2023-05-08T13:43:16.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35933.945950 secs 2023-05-08T13:43:16.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:15 smithi096 ceph-mon[124666]: pgmap v19218: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 905 KiB/s rd, 917 KiB/s wr, 26 op/s 2023-05-08T13:43:18.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:17 smithi186 ceph-mon[126480]: pgmap v19219: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 479 KiB/s wr, 8 op/s 2023-05-08T13:43:18.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:17 smithi133 ceph-mon[125939]: pgmap v19219: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 479 KiB/s wr, 8 op/s 2023-05-08T13:43:18.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:17 smithi096 ceph-mon[124666]: pgmap v19219: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 479 KiB/s wr, 8 op/s 2023-05-08T13:43:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35938.391802 secs 2023-05-08T13:43:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:19 smithi186 ceph-mon[126480]: pgmap v19220: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 479 KiB/s wr, 8 op/s 2023-05-08T13:43:20.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35938.391802 secs 2023-05-08T13:43:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:19 smithi133 ceph-mon[125939]: pgmap v19220: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 479 KiB/s wr, 8 op/s 2023-05-08T13:43:20.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35938.391802 secs 2023-05-08T13:43:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:19 smithi096 ceph-mon[124666]: pgmap v19220: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 479 KiB/s wr, 8 op/s 2023-05-08T13:43:21.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35938.946092 secs 2023-05-08T13:43:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35938.946092 secs 2023-05-08T13:43:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35938.946092 secs 2023-05-08T13:43:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:21 smithi186 ceph-mon[126480]: pgmap v19221: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 482 KiB/s rd, 479 KiB/s wr, 12 op/s 2023-05-08T13:43:22.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:21 smithi133 ceph-mon[125939]: pgmap v19221: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 482 KiB/s rd, 479 KiB/s wr, 12 op/s 2023-05-08T13:43:22.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:21 smithi096 ceph-mon[124666]: pgmap v19221: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 482 KiB/s rd, 479 KiB/s wr, 12 op/s 2023-05-08T13:43:23.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:23 smithi186 ceph-mon[126480]: pgmap v19222: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 476 KiB/s wr, 8 op/s 2023-05-08T13:43:23.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:23 smithi133 ceph-mon[125939]: pgmap v19222: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 476 KiB/s wr, 8 op/s 2023-05-08T13:43:24.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:23 smithi096 ceph-mon[124666]: pgmap v19222: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 476 KiB/s wr, 8 op/s 2023-05-08T13:43:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35943.391897 secs 2023-05-08T13:43:24.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35943.391897 secs 2023-05-08T13:43:25.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35943.391897 secs 2023-05-08T13:43:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:25 smithi186 ceph-mon[126480]: pgmap v19223: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T13:43:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:25 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:43:25.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:25 smithi133 ceph-mon[125939]: pgmap v19223: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T13:43:25.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:25 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:43:26.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:25 smithi096 ceph-mon[124666]: pgmap v19223: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T13:43:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:25 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:43:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35945.250823 secs 2023-05-08T13:43:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:26 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:43:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:26 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:43:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:26 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:43:26.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35945.250823 secs 2023-05-08T13:43:26.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:26 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:43:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:26 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:43:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:26 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:43:27.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35945.250823 secs 2023-05-08T13:43:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:26 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:43:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:26 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:43:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:26 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:43:27.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:27 smithi186 ceph-mon[126480]: pgmap v19224: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 823 KiB/s rd, 844 KiB/s wr, 11 op/s 2023-05-08T13:43:27.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:27 smithi133 ceph-mon[125939]: pgmap v19224: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 823 KiB/s rd, 844 KiB/s wr, 11 op/s 2023-05-08T13:43:28.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:27 smithi096 ceph-mon[124666]: pgmap v19224: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 823 KiB/s rd, 844 KiB/s wr, 11 op/s 2023-05-08T13:43:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35948.392012 secs 2023-05-08T13:43:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:29 smithi186 ceph-mon[126480]: pgmap v19225: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 823 KiB/s rd, 844 KiB/s wr, 11 op/s 2023-05-08T13:43:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:29 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:43:30.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35948.392012 secs 2023-05-08T13:43:30.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:29 smithi133 ceph-mon[125939]: pgmap v19225: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 823 KiB/s rd, 844 KiB/s wr, 11 op/s 2023-05-08T13:43:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:29 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:43:30.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35948.392012 secs 2023-05-08T13:43:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:29 smithi096 ceph-mon[124666]: pgmap v19225: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 823 KiB/s rd, 844 KiB/s wr, 11 op/s 2023-05-08T13:43:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:29 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:43:31.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:30 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:43:31.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:30 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:43:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:43:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:43:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:30 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:43:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:43:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:30 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T13:43:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:30 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T13:43:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:30 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:43:31.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:30 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:43:31.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:30 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:43:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:43:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:43:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:30 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:43:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:43:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:30 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T13:43:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:30 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T13:43:31.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:30 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:43:31.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:30 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:43:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:30 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:43:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:43:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:43:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:30 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:43:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:43:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:30 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T13:43:31.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:30 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T13:43:31.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:30 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:43:32.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35950.250958 secs 2023-05-08T13:43:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:31 smithi133 ceph-mon[125939]: pgmap v19226: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 852 KiB/s rd, 1.3 MiB/s wr, 16 op/s 2023-05-08T13:43:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:31 smithi133 ceph-mon[125939]: osdmap e1278: 12 total, 12 up, 12 in 2023-05-08T13:43:32.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35950.250958 secs 2023-05-08T13:43:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:31 smithi096 ceph-mon[124666]: pgmap v19226: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 852 KiB/s rd, 1.3 MiB/s wr, 16 op/s 2023-05-08T13:43:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:31 smithi096 ceph-mon[124666]: osdmap e1278: 12 total, 12 up, 12 in 2023-05-08T13:43:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35950.250958 secs 2023-05-08T13:43:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:31 smithi186 ceph-mon[126480]: pgmap v19226: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 852 KiB/s rd, 1.3 MiB/s wr, 16 op/s 2023-05-08T13:43:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:31 smithi186 ceph-mon[126480]: osdmap e1278: 12 total, 12 up, 12 in 2023-05-08T13:43:33.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:32 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:43:33.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:32 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:43:33.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:32 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:43:34.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:33 smithi133 ceph-mon[125939]: pgmap v19228: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1020 KiB/s rd, 1.5 MiB/s wr, 14 op/s 2023-05-08T13:43:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:33 smithi096 ceph-mon[124666]: pgmap v19228: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1020 KiB/s rd, 1.5 MiB/s wr, 14 op/s 2023-05-08T13:43:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:33 smithi186 ceph-mon[126480]: pgmap v19228: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1020 KiB/s rd, 1.5 MiB/s wr, 14 op/s 2023-05-08T13:43:35.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35953.392129 secs 2023-05-08T13:43:35.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35953.392129 secs 2023-05-08T13:43:35.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35953.392129 secs 2023-05-08T13:43:36.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:35 smithi133 ceph-mon[125939]: pgmap v19229: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 783 KiB/s wr, 9 op/s 2023-05-08T13:43:36.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:35 smithi096 ceph-mon[124666]: pgmap v19229: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 783 KiB/s wr, 9 op/s 2023-05-08T13:43:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:35 smithi186 ceph-mon[126480]: pgmap v19229: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 783 KiB/s wr, 9 op/s 2023-05-08T13:43:37.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35955.251081 secs 2023-05-08T13:43:37.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35955.251081 secs 2023-05-08T13:43:37.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35955.251081 secs 2023-05-08T13:43:38.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:37 smithi133 ceph-mon[125939]: pgmap v19230: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 575 KiB/s rd, 638 KiB/s wr, 10 op/s 2023-05-08T13:43:38.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:37 smithi133 ceph-mon[125939]: osdmap e1279: 12 total, 12 up, 12 in 2023-05-08T13:43:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:37 smithi096 ceph-mon[124666]: pgmap v19230: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 575 KiB/s rd, 638 KiB/s wr, 10 op/s 2023-05-08T13:43:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:37 smithi096 ceph-mon[124666]: osdmap e1279: 12 total, 12 up, 12 in 2023-05-08T13:43:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:37 smithi186 ceph-mon[126480]: pgmap v19230: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 575 KiB/s rd, 638 KiB/s wr, 10 op/s 2023-05-08T13:43:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:37 smithi186 ceph-mon[126480]: osdmap e1279: 12 total, 12 up, 12 in 2023-05-08T13:43:40.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35958.392245 secs 2023-05-08T13:43:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:39 smithi133 ceph-mon[125939]: pgmap v19232: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 676 KiB/s rd, 85 KiB/s wr, 5 op/s 2023-05-08T13:43:40.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35958.392245 secs 2023-05-08T13:43:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:39 smithi096 ceph-mon[124666]: pgmap v19232: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 676 KiB/s rd, 85 KiB/s wr, 5 op/s 2023-05-08T13:43:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35958.392245 secs 2023-05-08T13:43:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:39 smithi186 ceph-mon[126480]: pgmap v19232: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 676 KiB/s rd, 85 KiB/s wr, 5 op/s 2023-05-08T13:43:42.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35960.251202 secs 2023-05-08T13:43:42.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:41 smithi133 ceph-mon[125939]: pgmap v19233: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 894 KiB/s rd, 73 KiB/s wr, 9 op/s 2023-05-08T13:43:42.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35960.251202 secs 2023-05-08T13:43:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:41 smithi096 ceph-mon[124666]: pgmap v19233: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 894 KiB/s rd, 73 KiB/s wr, 9 op/s 2023-05-08T13:43:42.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35960.251202 secs 2023-05-08T13:43:42.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:41 smithi186 ceph-mon[126480]: pgmap v19233: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 894 KiB/s rd, 73 KiB/s wr, 9 op/s 2023-05-08T13:43:43.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:43 smithi186 ceph-mon[126480]: pgmap v19234: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 883 KiB/s rd, 72 KiB/s wr, 9 op/s 2023-05-08T13:43:43.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:43 smithi133 ceph-mon[125939]: pgmap v19234: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 883 KiB/s rd, 72 KiB/s wr, 9 op/s 2023-05-08T13:43:44.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:43 smithi096 ceph-mon[124666]: pgmap v19234: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 883 KiB/s rd, 72 KiB/s wr, 9 op/s 2023-05-08T13:43:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35963.392366 secs 2023-05-08T13:43:44.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35963.392366 secs 2023-05-08T13:43:45.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35963.392366 secs 2023-05-08T13:43:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35963.946647 secs 2023-05-08T13:43:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:45 smithi186 ceph-mon[126480]: pgmap v19235: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.4 MiB/s wr, 14 op/s 2023-05-08T13:43:45.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35963.946647 secs 2023-05-08T13:43:45.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:45 smithi133 ceph-mon[125939]: pgmap v19235: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.4 MiB/s wr, 14 op/s 2023-05-08T13:43:46.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35963.946647 secs 2023-05-08T13:43:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:45 smithi096 ceph-mon[124666]: pgmap v19235: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.4 MiB/s wr, 14 op/s 2023-05-08T13:43:46.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35965.251328 secs 2023-05-08T13:43:46.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:46 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:43:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:46 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:43:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:46 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:43:46.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35965.251328 secs 2023-05-08T13:43:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:46 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:43:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:46 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:43:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:46 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:43:47.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35965.251328 secs 2023-05-08T13:43:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:46 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:43:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:46 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:43:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:46 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:43:47.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:47 smithi186 ceph-mon[126480]: pgmap v19236: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2023-05-08T13:43:47.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:47 smithi133 ceph-mon[125939]: pgmap v19236: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2023-05-08T13:43:48.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:47 smithi096 ceph-mon[124666]: pgmap v19236: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2023-05-08T13:43:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35968.392407 secs 2023-05-08T13:43:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:49 smithi186 ceph-mon[126480]: pgmap v19237: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T13:43:50.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35968.392407 secs 2023-05-08T13:43:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:49 smithi133 ceph-mon[125939]: pgmap v19237: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T13:43:50.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35968.392407 secs 2023-05-08T13:43:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:49 smithi096 ceph-mon[124666]: pgmap v19237: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T13:43:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:51 smithi186 ceph-mon[126480]: pgmap v19238: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.1 MiB/s wr, 15 op/s 2023-05-08T13:43:52.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:51 smithi133 ceph-mon[125939]: pgmap v19238: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.1 MiB/s wr, 15 op/s 2023-05-08T13:43:52.323 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:51 smithi096 ceph-mon[124666]: pgmap v19238: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.1 MiB/s wr, 15 op/s 2023-05-08T13:43:53.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:53 smithi186 ceph-mon[126480]: pgmap v19239: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 MiB/s wr, 11 op/s 2023-05-08T13:43:53.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:53 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:43:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:53 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:43:53.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:53 smithi133 ceph-mon[125939]: pgmap v19239: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 MiB/s wr, 11 op/s 2023-05-08T13:43:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:53 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:43:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:53 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:43:54.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:53 smithi096 ceph-mon[124666]: pgmap v19239: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 MiB/s wr, 11 op/s 2023-05-08T13:43:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:53 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:43:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:53 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:43:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:54 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:43:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:54 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:43:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:54 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:43:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:54 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:43:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35973.392523 secs 2023-05-08T13:43:54.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:54 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:43:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:54 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:43:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:54 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:43:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:54 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:43:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35973.392523 secs 2023-05-08T13:43:55.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:54 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:43:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:54 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:43:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:54 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:43:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:54 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:43:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35973.392523 secs 2023-05-08T13:43:55.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:55 smithi186 ceph-mon[126480]: pgmap v19240: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 18 op/s 2023-05-08T13:43:55.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:55 smithi133 ceph-mon[125939]: pgmap v19240: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 18 op/s 2023-05-08T13:43:56.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:55 smithi096 ceph-mon[124666]: pgmap v19240: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 18 op/s 2023-05-08T13:43:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:57 smithi186 ceph-mon[126480]: pgmap v19241: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T13:43:58.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:57 smithi133 ceph-mon[125939]: pgmap v19241: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T13:43:58.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:57 smithi096 ceph-mon[124666]: pgmap v19241: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T13:44:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35978.392641 secs 2023-05-08T13:44:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:43:59 smithi186 ceph-mon[126480]: pgmap v19242: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T13:44:00.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35978.392641 secs 2023-05-08T13:44:00.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:43:59 smithi133 ceph-mon[125939]: pgmap v19242: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T13:44:00.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35978.392641 secs 2023-05-08T13:44:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:43:59 smithi096 ceph-mon[124666]: pgmap v19242: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T13:44:01.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35978.947040 secs 2023-05-08T13:44:01.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35978.947040 secs 2023-05-08T13:44:01.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35978.947040 secs 2023-05-08T13:44:02.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:01 smithi133 ceph-mon[125939]: pgmap v19243: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 17 op/s 2023-05-08T13:44:02.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:01 smithi096 ceph-mon[124666]: pgmap v19243: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 17 op/s 2023-05-08T13:44:02.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:01 smithi186 ceph-mon[126480]: pgmap v19243: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 17 op/s 2023-05-08T13:44:03.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:02 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:44:03.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:44:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:44:03.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:02 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:44:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:44:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:44:03.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:02 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:44:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:44:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:44:04.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:03 smithi133 ceph-mon[125939]: pgmap v19244: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2023-05-08T13:44:04.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:03 smithi096 ceph-mon[124666]: pgmap v19244: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2023-05-08T13:44:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:03 smithi186 ceph-mon[126480]: pgmap v19244: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2023-05-08T13:44:05.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35983.392758 secs 2023-05-08T13:44:05.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35983.392758 secs 2023-05-08T13:44:05.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35983.392758 secs 2023-05-08T13:44:06.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35983.947155 secs 2023-05-08T13:44:06.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:05 smithi133 ceph-mon[125939]: pgmap v19245: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.4 MiB/s wr, 32 op/s 2023-05-08T13:44:06.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35983.947155 secs 2023-05-08T13:44:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:05 smithi096 ceph-mon[124666]: pgmap v19245: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.4 MiB/s wr, 32 op/s 2023-05-08T13:44:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35983.947155 secs 2023-05-08T13:44:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:05 smithi186 ceph-mon[126480]: pgmap v19245: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.4 MiB/s wr, 32 op/s 2023-05-08T13:44:07.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35985.251772 secs 2023-05-08T13:44:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:06 smithi133 ceph-mon[125939]: osdmap e1280: 12 total, 12 up, 12 in 2023-05-08T13:44:07.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35985.251772 secs 2023-05-08T13:44:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:06 smithi096 ceph-mon[124666]: osdmap e1280: 12 total, 12 up, 12 in 2023-05-08T13:44:07.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35985.251772 secs 2023-05-08T13:44:07.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:06 smithi186 ceph-mon[126480]: osdmap e1280: 12 total, 12 up, 12 in 2023-05-08T13:44:08.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:07 smithi133 ceph-mon[125939]: pgmap v19247: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.2 MiB/s wr, 31 op/s 2023-05-08T13:44:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:07 smithi096 ceph-mon[124666]: pgmap v19247: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.2 MiB/s wr, 31 op/s 2023-05-08T13:44:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:07 smithi186 ceph-mon[126480]: pgmap v19247: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.2 MiB/s wr, 31 op/s 2023-05-08T13:44:10.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35988.392881 secs 2023-05-08T13:44:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:09 smithi133 ceph-mon[125939]: pgmap v19248: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.2 MiB/s wr, 31 op/s 2023-05-08T13:44:10.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35988.392881 secs 2023-05-08T13:44:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:09 smithi096 ceph-mon[124666]: pgmap v19248: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.2 MiB/s wr, 31 op/s 2023-05-08T13:44:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35988.392881 secs 2023-05-08T13:44:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:09 smithi186 ceph-mon[126480]: pgmap v19248: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.2 MiB/s wr, 31 op/s 2023-05-08T13:44:11.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35988.947308 secs 2023-05-08T13:44:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:10 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:44:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:10 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:44:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:10 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:44:11.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35988.947308 secs 2023-05-08T13:44:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:10 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:44:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:10 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:44:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:10 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:44:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35988.947308 secs 2023-05-08T13:44:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:10 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:44:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:10 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:44:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:10 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:44:12.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35990.251896 secs 2023-05-08T13:44:12.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:11 smithi133 ceph-mon[125939]: pgmap v19249: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 30 op/s 2023-05-08T13:44:12.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35990.251896 secs 2023-05-08T13:44:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:11 smithi096 ceph-mon[124666]: pgmap v19249: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 30 op/s 2023-05-08T13:44:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35990.251896 secs 2023-05-08T13:44:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:11 smithi186 ceph-mon[126480]: pgmap v19249: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 30 op/s 2023-05-08T13:44:13.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:13 smithi186 ceph-mon[126480]: osdmap e1281: 12 total, 12 up, 12 in 2023-05-08T13:44:13.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:13 smithi186 ceph-mon[126480]: pgmap v19251: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 770 KiB/s wr, 9 op/s 2023-05-08T13:44:13.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:13 smithi133 ceph-mon[125939]: osdmap e1281: 12 total, 12 up, 12 in 2023-05-08T13:44:13.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:13 smithi133 ceph-mon[125939]: pgmap v19251: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 770 KiB/s wr, 9 op/s 2023-05-08T13:44:14.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:13 smithi096 ceph-mon[124666]: osdmap e1281: 12 total, 12 up, 12 in 2023-05-08T13:44:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:13 smithi096 ceph-mon[124666]: pgmap v19251: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 770 KiB/s wr, 9 op/s 2023-05-08T13:44:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35993.392980 secs 2023-05-08T13:44:14.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35993.392980 secs 2023-05-08T13:44:15.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35993.392980 secs 2023-05-08T13:44:15.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35993.947431 secs 2023-05-08T13:44:15.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:15 smithi186 ceph-mon[126480]: pgmap v19252: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.0 MiB/s wr, 12 op/s 2023-05-08T13:44:15.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35993.947431 secs 2023-05-08T13:44:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:15 smithi133 ceph-mon[125939]: pgmap v19252: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.0 MiB/s wr, 12 op/s 2023-05-08T13:44:16.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35993.947431 secs 2023-05-08T13:44:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:15 smithi096 ceph-mon[124666]: pgmap v19252: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.0 MiB/s wr, 12 op/s 2023-05-08T13:44:16.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35995.252015 secs 2023-05-08T13:44:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35995.252015 secs 2023-05-08T13:44:17.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35995.252015 secs 2023-05-08T13:44:17.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:17 smithi133 ceph-mon[125939]: pgmap v19253: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 947 KiB/s wr, 10 op/s 2023-05-08T13:44:18.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:17 smithi096 ceph-mon[124666]: pgmap v19253: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 947 KiB/s wr, 10 op/s 2023-05-08T13:44:18.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:17 smithi186 ceph-mon[126480]: pgmap v19253: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 947 KiB/s wr, 10 op/s 2023-05-08T13:44:20.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35998.393098 secs 2023-05-08T13:44:20.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:19 smithi133 ceph-mon[125939]: pgmap v19254: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 947 KiB/s wr, 10 op/s 2023-05-08T13:44:20.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35998.393098 secs 2023-05-08T13:44:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:19 smithi096 ceph-mon[124666]: pgmap v19254: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 947 KiB/s wr, 10 op/s 2023-05-08T13:44:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35998.393098 secs 2023-05-08T13:44:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:19 smithi186 ceph-mon[126480]: pgmap v19254: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 947 KiB/s wr, 10 op/s 2023-05-08T13:44:21.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 35998.947489 secs 2023-05-08T13:44:21.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 35998.947489 secs 2023-05-08T13:44:21.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 35998.947489 secs 2023-05-08T13:44:22.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36000.252132 secs 2023-05-08T13:44:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:21 smithi133 ceph-mon[125939]: pgmap v19255: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 362 KiB/s wr, 7 op/s 2023-05-08T13:44:22.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36000.252132 secs 2023-05-08T13:44:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:21 smithi096 ceph-mon[124666]: pgmap v19255: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 362 KiB/s wr, 7 op/s 2023-05-08T13:44:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36000.252132 secs 2023-05-08T13:44:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:21 smithi186 ceph-mon[126480]: pgmap v19255: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 362 KiB/s wr, 7 op/s 2023-05-08T13:44:23.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:23 smithi186 ceph-mon[126480]: pgmap v19256: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 354 KiB/s wr, 7 op/s 2023-05-08T13:44:23.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:23 smithi133 ceph-mon[125939]: pgmap v19256: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 354 KiB/s wr, 7 op/s 2023-05-08T13:44:24.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:23 smithi096 ceph-mon[124666]: pgmap v19256: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 354 KiB/s wr, 7 op/s 2023-05-08T13:44:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36003.393237 secs 2023-05-08T13:44:24.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36003.393237 secs 2023-05-08T13:44:25.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36003.393237 secs 2023-05-08T13:44:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36003.947552 secs 2023-05-08T13:44:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:25 smithi186 ceph-mon[126480]: pgmap v19257: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 302 KiB/s wr, 9 op/s 2023-05-08T13:44:25.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36003.947552 secs 2023-05-08T13:44:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:25 smithi133 ceph-mon[125939]: pgmap v19257: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 302 KiB/s wr, 9 op/s 2023-05-08T13:44:26.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36003.947552 secs 2023-05-08T13:44:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:25 smithi096 ceph-mon[124666]: pgmap v19257: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 302 KiB/s wr, 9 op/s 2023-05-08T13:44:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36005.252253 secs 2023-05-08T13:44:26.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36005.252253 secs 2023-05-08T13:44:27.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36005.252253 secs 2023-05-08T13:44:27.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:27 smithi133 ceph-mon[125939]: pgmap v19258: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 6 op/s 2023-05-08T13:44:28.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:27 smithi096 ceph-mon[124666]: pgmap v19258: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 6 op/s 2023-05-08T13:44:28.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:27 smithi186 ceph-mon[126480]: pgmap v19258: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 6 op/s 2023-05-08T13:44:30.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36008.393370 secs 2023-05-08T13:44:30.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:29 smithi133 ceph-mon[125939]: pgmap v19259: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 6 op/s 2023-05-08T13:44:30.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36008.393370 secs 2023-05-08T13:44:30.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:29 smithi096 ceph-mon[124666]: pgmap v19259: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 6 op/s 2023-05-08T13:44:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36008.393370 secs 2023-05-08T13:44:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:29 smithi186 ceph-mon[126480]: pgmap v19259: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 6 op/s 2023-05-08T13:44:31.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36008.947617 secs 2023-05-08T13:44:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:44:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:44:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:44:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:44:31.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36008.947617 secs 2023-05-08T13:44:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:44:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:44:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:44:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:44:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36008.947617 secs 2023-05-08T13:44:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:44:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:44:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:44:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:44:32.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36010.252371 secs 2023-05-08T13:44:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:31 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:44:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:31 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T13:44:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:31 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T13:44:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:31 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:44:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:31 smithi133 ceph-mon[125939]: pgmap v19260: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 9 op/s 2023-05-08T13:44:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36010.252371 secs 2023-05-08T13:44:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:31 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:44:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:31 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T13:44:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:31 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T13:44:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:31 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:44:32.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:31 smithi096 ceph-mon[124666]: pgmap v19260: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 9 op/s 2023-05-08T13:44:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36010.252371 secs 2023-05-08T13:44:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:31 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:44:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:31 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T13:44:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:31 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T13:44:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:31 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:44:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:31 smithi186 ceph-mon[126480]: pgmap v19260: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 9 op/s 2023-05-08T13:44:33.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:33 smithi186 ceph-mon[126480]: pgmap v19261: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 26 KiB/s wr, 6 op/s 2023-05-08T13:44:33.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:33 smithi133 ceph-mon[125939]: pgmap v19261: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 26 KiB/s wr, 6 op/s 2023-05-08T13:44:34.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:33 smithi096 ceph-mon[124666]: pgmap v19261: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 26 KiB/s wr, 6 op/s 2023-05-08T13:44:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36013.393487 secs 2023-05-08T13:44:34.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36013.393487 secs 2023-05-08T13:44:35.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36013.393487 secs 2023-05-08T13:44:35.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36013.947731 secs 2023-05-08T13:44:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:35 smithi133 ceph-mon[125939]: pgmap v19262: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 179 KiB/s wr, 10 op/s 2023-05-08T13:44:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36013.947731 secs 2023-05-08T13:44:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:35 smithi096 ceph-mon[124666]: pgmap v19262: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 179 KiB/s wr, 10 op/s 2023-05-08T13:44:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36013.947731 secs 2023-05-08T13:44:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:35 smithi186 ceph-mon[126480]: pgmap v19262: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 179 KiB/s wr, 10 op/s 2023-05-08T13:44:36.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36015.252550 secs 2023-05-08T13:44:37.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36015.252550 secs 2023-05-08T13:44:37.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36015.252550 secs 2023-05-08T13:44:37.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:37 smithi133 ceph-mon[125939]: pgmap v19263: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 179 KiB/s wr, 7 op/s 2023-05-08T13:44:38.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:37 smithi096 ceph-mon[124666]: pgmap v19263: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 179 KiB/s wr, 7 op/s 2023-05-08T13:44:38.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:37 smithi186 ceph-mon[126480]: pgmap v19263: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 179 KiB/s wr, 7 op/s 2023-05-08T13:44:40.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36018.393550 secs 2023-05-08T13:44:40.276 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:39 smithi133 ceph-mon[125939]: pgmap v19264: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 179 KiB/s wr, 7 op/s 2023-05-08T13:44:40.277 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36018.393550 secs 2023-05-08T13:44:40.277 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:39 smithi096 ceph-mon[124666]: pgmap v19264: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 179 KiB/s wr, 7 op/s 2023-05-08T13:44:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36018.393550 secs 2023-05-08T13:44:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:39 smithi186 ceph-mon[126480]: pgmap v19264: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 179 KiB/s wr, 7 op/s 2023-05-08T13:44:41.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36018.947853 secs 2023-05-08T13:44:41.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36018.947853 secs 2023-05-08T13:44:41.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36018.947853 secs 2023-05-08T13:44:42.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36020.252723 secs 2023-05-08T13:44:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:41 smithi133 ceph-mon[125939]: pgmap v19265: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 483 KiB/s wr, 11 op/s 2023-05-08T13:44:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36020.252723 secs 2023-05-08T13:44:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:41 smithi096 ceph-mon[124666]: pgmap v19265: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 483 KiB/s wr, 11 op/s 2023-05-08T13:44:42.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36020.252723 secs 2023-05-08T13:44:42.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:41 smithi186 ceph-mon[126480]: pgmap v19265: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 483 KiB/s wr, 11 op/s 2023-05-08T13:44:43.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:43 smithi186 ceph-mon[126480]: pgmap v19266: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 458 KiB/s wr, 7 op/s 2023-05-08T13:44:43.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:43 smithi133 ceph-mon[125939]: pgmap v19266: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 458 KiB/s wr, 7 op/s 2023-05-08T13:44:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:43 smithi096 ceph-mon[124666]: pgmap v19266: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 458 KiB/s wr, 7 op/s 2023-05-08T13:44:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36023.393677 secs 2023-05-08T13:44:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36023.393677 secs 2023-05-08T13:44:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36023.393677 secs 2023-05-08T13:44:45.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36023.947939 secs 2023-05-08T13:44:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:45 smithi133 ceph-mon[125939]: pgmap v19267: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 647 KiB/s rd, 644 KiB/s wr, 11 op/s 2023-05-08T13:44:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36023.947939 secs 2023-05-08T13:44:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:45 smithi096 ceph-mon[124666]: pgmap v19267: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 647 KiB/s rd, 644 KiB/s wr, 11 op/s 2023-05-08T13:44:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36023.947939 secs 2023-05-08T13:44:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:45 smithi186 ceph-mon[126480]: pgmap v19267: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 647 KiB/s rd, 644 KiB/s wr, 11 op/s 2023-05-08T13:44:46.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36025.252859 secs 2023-05-08T13:44:47.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36025.252859 secs 2023-05-08T13:44:47.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36025.252859 secs 2023-05-08T13:44:47.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:47 smithi133 ceph-mon[125939]: pgmap v19268: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 491 KiB/s wr, 7 op/s 2023-05-08T13:44:48.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:47 smithi096 ceph-mon[124666]: pgmap v19268: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 491 KiB/s wr, 7 op/s 2023-05-08T13:44:48.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:47 smithi186 ceph-mon[126480]: pgmap v19268: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 491 KiB/s wr, 7 op/s 2023-05-08T13:44:50.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36028.393807 secs 2023-05-08T13:44:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:49 smithi133 ceph-mon[125939]: pgmap v19269: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 491 KiB/s wr, 7 op/s 2023-05-08T13:44:50.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36028.393807 secs 2023-05-08T13:44:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:49 smithi096 ceph-mon[124666]: pgmap v19269: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 491 KiB/s wr, 7 op/s 2023-05-08T13:44:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36028.393807 secs 2023-05-08T13:44:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:49 smithi186 ceph-mon[126480]: pgmap v19269: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 491 KiB/s wr, 7 op/s 2023-05-08T13:44:51.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36028.948065 secs 2023-05-08T13:44:51.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36028.948065 secs 2023-05-08T13:44:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36028.948065 secs 2023-05-08T13:44:52.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36030.252979 secs 2023-05-08T13:44:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:51 smithi133 ceph-mon[125939]: pgmap v19270: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 918 KiB/s wr, 12 op/s 2023-05-08T13:44:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36030.252979 secs 2023-05-08T13:44:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:51 smithi096 ceph-mon[124666]: pgmap v19270: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 918 KiB/s wr, 12 op/s 2023-05-08T13:44:52.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36030.252979 secs 2023-05-08T13:44:52.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:51 smithi186 ceph-mon[126480]: pgmap v19270: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 918 KiB/s wr, 12 op/s 2023-05-08T13:44:53.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:53 smithi186 ceph-mon[126480]: pgmap v19271: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 614 KiB/s wr, 8 op/s 2023-05-08T13:44:53.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:53 smithi133 ceph-mon[125939]: pgmap v19271: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 614 KiB/s wr, 8 op/s 2023-05-08T13:44:54.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:53 smithi096 ceph-mon[124666]: pgmap v19271: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 614 KiB/s wr, 8 op/s 2023-05-08T13:44:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36033.393929 secs 2023-05-08T13:44:54.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36033.393929 secs 2023-05-08T13:44:55.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36033.393929 secs 2023-05-08T13:44:55.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:55 smithi133 ceph-mon[125939]: pgmap v19272: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 14 op/s 2023-05-08T13:44:56.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:55 smithi096 ceph-mon[124666]: pgmap v19272: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 14 op/s 2023-05-08T13:44:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:55 smithi186 ceph-mon[126480]: pgmap v19272: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 14 op/s 2023-05-08T13:44:58.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:57 smithi133 ceph-mon[125939]: pgmap v19273: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.4 MiB/s wr, 10 op/s 2023-05-08T13:44:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:44:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:44:58.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:57 smithi096 ceph-mon[124666]: pgmap v19273: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.4 MiB/s wr, 10 op/s 2023-05-08T13:44:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:44:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:44:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:57 smithi186 ceph-mon[126480]: pgmap v19273: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.4 MiB/s wr, 10 op/s 2023-05-08T13:44:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:44:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:44:59.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:58 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:44:59.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:44:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:44:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:44:59.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:58 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:44:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:44:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:44:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:44:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:58 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:44:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:44:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:44:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:45:00.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36038.393993 secs 2023-05-08T13:45:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:44:59 smithi133 ceph-mon[125939]: pgmap v19274: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.4 MiB/s wr, 10 op/s 2023-05-08T13:45:00.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36038.393993 secs 2023-05-08T13:45:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:44:59 smithi096 ceph-mon[124666]: pgmap v19274: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.4 MiB/s wr, 10 op/s 2023-05-08T13:45:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36038.393993 secs 2023-05-08T13:45:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:44:59 smithi186 ceph-mon[126480]: pgmap v19274: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.4 MiB/s wr, 10 op/s 2023-05-08T13:45:01.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36038.948294 secs 2023-05-08T13:45:01.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36038.948294 secs 2023-05-08T13:45:01.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36038.948294 secs 2023-05-08T13:45:02.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:01 smithi133 ceph-mon[125939]: pgmap v19275: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.4 MiB/s wr, 16 op/s 2023-05-08T13:45:02.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:01 smithi096 ceph-mon[124666]: pgmap v19275: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.4 MiB/s wr, 16 op/s 2023-05-08T13:45:02.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:01 smithi186 ceph-mon[126480]: pgmap v19275: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.4 MiB/s wr, 16 op/s 2023-05-08T13:45:03.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:45:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:45:03.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:45:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:45:03.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:45:03.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:45:04.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:03 smithi133 ceph-mon[125939]: pgmap v19276: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.0 MiB/s wr, 11 op/s 2023-05-08T13:45:04.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:03 smithi096 ceph-mon[124666]: pgmap v19276: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.0 MiB/s wr, 11 op/s 2023-05-08T13:45:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:03 smithi186 ceph-mon[126480]: pgmap v19276: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.0 MiB/s wr, 11 op/s 2023-05-08T13:45:05.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36043.394114 secs 2023-05-08T13:45:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36043.394114 secs 2023-05-08T13:45:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36043.394114 secs 2023-05-08T13:45:06.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:05 smithi133 ceph-mon[125939]: pgmap v19277: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.5 MiB/s wr, 29 op/s 2023-05-08T13:45:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:05 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:45:06.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:05 smithi096 ceph-mon[124666]: pgmap v19277: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.5 MiB/s wr, 29 op/s 2023-05-08T13:45:06.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:05 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:45:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:05 smithi186 ceph-mon[126480]: pgmap v19277: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.5 MiB/s wr, 29 op/s 2023-05-08T13:45:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:05 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:45:07.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:06 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:45:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:45:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:45:07.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:06 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:45:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:45:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:45:07.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:06 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:45:07.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:45:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:45:08.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:07 smithi133 ceph-mon[125939]: pgmap v19278: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 24 op/s 2023-05-08T13:45:08.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:07 smithi096 ceph-mon[124666]: pgmap v19278: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 24 op/s 2023-05-08T13:45:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:07 smithi186 ceph-mon[126480]: pgmap v19278: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 24 op/s 2023-05-08T13:45:10.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36048.394222 secs 2023-05-08T13:45:10.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:09 smithi133 ceph-mon[125939]: pgmap v19279: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 24 op/s 2023-05-08T13:45:10.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36048.394222 secs 2023-05-08T13:45:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:09 smithi096 ceph-mon[124666]: pgmap v19279: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 24 op/s 2023-05-08T13:45:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36048.394222 secs 2023-05-08T13:45:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:09 smithi186 ceph-mon[126480]: pgmap v19279: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 24 op/s 2023-05-08T13:45:12.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:11 smithi133 ceph-mon[125939]: pgmap v19280: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.1 MiB/s wr, 29 op/s 2023-05-08T13:45:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:11 smithi096 ceph-mon[124666]: pgmap v19280: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.1 MiB/s wr, 29 op/s 2023-05-08T13:45:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:11 smithi186 ceph-mon[126480]: pgmap v19280: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.1 MiB/s wr, 29 op/s 2023-05-08T13:45:13.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:13 smithi133 ceph-mon[125939]: pgmap v19281: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.2 MiB/s wr, 23 op/s 2023-05-08T13:45:14.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:13 smithi096 ceph-mon[124666]: pgmap v19281: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.2 MiB/s wr, 23 op/s 2023-05-08T13:45:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:13 smithi186 ceph-mon[126480]: pgmap v19281: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.2 MiB/s wr, 23 op/s 2023-05-08T13:45:14.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36053.394288 secs 2023-05-08T13:45:15.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36053.394288 secs 2023-05-08T13:45:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36053.394288 secs 2023-05-08T13:45:15.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:15 smithi133 ceph-mon[125939]: pgmap v19282: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.8 MiB/s wr, 27 op/s 2023-05-08T13:45:16.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:15 smithi096 ceph-mon[124666]: pgmap v19282: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.8 MiB/s wr, 27 op/s 2023-05-08T13:45:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:15 smithi186 ceph-mon[126480]: pgmap v19282: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.8 MiB/s wr, 27 op/s 2023-05-08T13:45:18.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:17 smithi133 ceph-mon[125939]: pgmap v19283: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.3 MiB/s wr, 9 op/s 2023-05-08T13:45:18.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:17 smithi096 ceph-mon[124666]: pgmap v19283: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.3 MiB/s wr, 9 op/s 2023-05-08T13:45:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:17 smithi186 ceph-mon[126480]: pgmap v19283: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.3 MiB/s wr, 9 op/s 2023-05-08T13:45:20.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36058.394405 secs 2023-05-08T13:45:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:19 smithi133 ceph-mon[125939]: pgmap v19284: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 9 op/s 2023-05-08T13:45:20.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36058.394405 secs 2023-05-08T13:45:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:19 smithi096 ceph-mon[124666]: pgmap v19284: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 9 op/s 2023-05-08T13:45:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36058.394405 secs 2023-05-08T13:45:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:19 smithi186 ceph-mon[126480]: pgmap v19284: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 9 op/s 2023-05-08T13:45:21.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36058.948745 secs 2023-05-08T13:45:21.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36058.948745 secs 2023-05-08T13:45:21.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36058.948745 secs 2023-05-08T13:45:22.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36060.253671 secs 2023-05-08T13:45:22.331 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:21 smithi133 ceph-mon[125939]: pgmap v19285: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.1 MiB/s wr, 16 op/s 2023-05-08T13:45:22.332 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:21 smithi133 ceph-mon[125939]: osdmap e1282: 12 total, 12 up, 12 in 2023-05-08T13:45:22.332 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36060.253671 secs 2023-05-08T13:45:22.333 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:21 smithi096 ceph-mon[124666]: pgmap v19285: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.1 MiB/s wr, 16 op/s 2023-05-08T13:45:22.333 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:21 smithi096 ceph-mon[124666]: osdmap e1282: 12 total, 12 up, 12 in 2023-05-08T13:45:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36060.253671 secs 2023-05-08T13:45:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:21 smithi186 ceph-mon[126480]: pgmap v19285: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.1 MiB/s wr, 16 op/s 2023-05-08T13:45:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:21 smithi186 ceph-mon[126480]: osdmap e1282: 12 total, 12 up, 12 in 2023-05-08T13:45:23.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:22 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:45:23.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:22 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:45:23.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:22 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:45:23.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:22 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:45:23.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:22 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:45:23.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:22 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:45:23.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:22 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:45:23.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:22 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:45:23.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:22 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:45:23.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:22 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:45:23.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:22 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:45:23.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:22 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:45:24.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:23 smithi133 ceph-mon[125939]: pgmap v19287: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 800 KiB/s rd, 2.0 MiB/s wr, 13 op/s 2023-05-08T13:45:24.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:23 smithi096 ceph-mon[124666]: pgmap v19287: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 800 KiB/s rd, 2.0 MiB/s wr, 13 op/s 2023-05-08T13:45:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:23 smithi186 ceph-mon[126480]: pgmap v19287: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 800 KiB/s rd, 2.0 MiB/s wr, 13 op/s 2023-05-08T13:45:25.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36063.394473 secs 2023-05-08T13:45:25.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36063.394473 secs 2023-05-08T13:45:25.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36063.394473 secs 2023-05-08T13:45:26.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36063.948888 secs 2023-05-08T13:45:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:25 smithi133 ceph-mon[125939]: pgmap v19288: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T13:45:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36063.948888 secs 2023-05-08T13:45:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:25 smithi096 ceph-mon[124666]: pgmap v19288: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T13:45:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36063.948888 secs 2023-05-08T13:45:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:25 smithi186 ceph-mon[126480]: pgmap v19288: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T13:45:27.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36065.253811 secs 2023-05-08T13:45:27.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36065.253811 secs 2023-05-08T13:45:27.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36065.253811 secs 2023-05-08T13:45:28.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:27 smithi133 ceph-mon[125939]: pgmap v19289: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T13:45:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:27 smithi133 ceph-mon[125939]: osdmap e1283: 12 total, 12 up, 12 in 2023-05-08T13:45:28.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:27 smithi096 ceph-mon[124666]: pgmap v19289: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T13:45:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:27 smithi096 ceph-mon[124666]: osdmap e1283: 12 total, 12 up, 12 in 2023-05-08T13:45:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:27 smithi186 ceph-mon[126480]: pgmap v19289: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T13:45:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:27 smithi186 ceph-mon[126480]: osdmap e1283: 12 total, 12 up, 12 in 2023-05-08T13:45:30.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36068.394615 secs 2023-05-08T13:45:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:29 smithi133 ceph-mon[125939]: pgmap v19291: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 145 KiB/s wr, 7 op/s 2023-05-08T13:45:30.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36068.394615 secs 2023-05-08T13:45:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:29 smithi096 ceph-mon[124666]: pgmap v19291: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 145 KiB/s wr, 7 op/s 2023-05-08T13:45:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36068.394615 secs 2023-05-08T13:45:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:29 smithi186 ceph-mon[126480]: pgmap v19291: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 145 KiB/s wr, 7 op/s 2023-05-08T13:45:31.253 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36068.949027 secs 2023-05-08T13:45:31.253 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:45:31.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36068.949027 secs 2023-05-08T13:45:31.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:45:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36068.949027 secs 2023-05-08T13:45:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:45:32.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36070.253929 secs 2023-05-08T13:45:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:31 smithi133 ceph-mon[125939]: pgmap v19292: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 487 KiB/s wr, 10 op/s 2023-05-08T13:45:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:31 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:45:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:31 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:45:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:31 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:45:32.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36070.253929 secs 2023-05-08T13:45:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:31 smithi096 ceph-mon[124666]: pgmap v19292: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 487 KiB/s wr, 10 op/s 2023-05-08T13:45:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:31 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:45:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:31 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:45:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:31 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:45:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36070.253929 secs 2023-05-08T13:45:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:31 smithi186 ceph-mon[126480]: pgmap v19292: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 487 KiB/s wr, 10 op/s 2023-05-08T13:45:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:31 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:45:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:31 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:45:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:31 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:45:33.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:32 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:45:33.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:32 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T13:45:33.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:32 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T13:45:33.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:32 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:45:33.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:32 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:45:33.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:32 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T13:45:33.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:32 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T13:45:33.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:32 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:45:33.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:32 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:45:33.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:32 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T13:45:33.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:32 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T13:45:33.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:32 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:45:34.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:33 smithi133 ceph-mon[125939]: pgmap v19293: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 484 KiB/s wr, 10 op/s 2023-05-08T13:45:34.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:33 smithi096 ceph-mon[124666]: pgmap v19293: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 484 KiB/s wr, 10 op/s 2023-05-08T13:45:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:33 smithi186 ceph-mon[126480]: pgmap v19293: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 484 KiB/s wr, 10 op/s 2023-05-08T13:45:35.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36073.394690 secs 2023-05-08T13:45:35.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36073.394690 secs 2023-05-08T13:45:35.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36073.394690 secs 2023-05-08T13:45:36.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36073.949112 secs 2023-05-08T13:45:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:35 smithi133 ceph-mon[125939]: pgmap v19294: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 766 KiB/s rd, 764 KiB/s wr, 10 op/s 2023-05-08T13:45:36.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36073.949112 secs 2023-05-08T13:45:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:35 smithi096 ceph-mon[124666]: pgmap v19294: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 766 KiB/s rd, 764 KiB/s wr, 10 op/s 2023-05-08T13:45:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36073.949112 secs 2023-05-08T13:45:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:35 smithi186 ceph-mon[126480]: pgmap v19294: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 766 KiB/s rd, 764 KiB/s wr, 10 op/s 2023-05-08T13:45:37.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36075.254049 secs 2023-05-08T13:45:37.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36075.254049 secs 2023-05-08T13:45:37.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36075.254049 secs 2023-05-08T13:45:38.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:37 smithi133 ceph-mon[125939]: pgmap v19295: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 766 KiB/s rd, 764 KiB/s wr, 10 op/s 2023-05-08T13:45:38.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:37 smithi096 ceph-mon[124666]: pgmap v19295: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 766 KiB/s rd, 764 KiB/s wr, 10 op/s 2023-05-08T13:45:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:37 smithi186 ceph-mon[126480]: pgmap v19295: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 766 KiB/s rd, 764 KiB/s wr, 10 op/s 2023-05-08T13:45:40.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36078.394785 secs 2023-05-08T13:45:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:39 smithi133 ceph-mon[125939]: pgmap v19296: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 683 KiB/s rd, 681 KiB/s wr, 9 op/s 2023-05-08T13:45:40.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36078.394785 secs 2023-05-08T13:45:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:39 smithi096 ceph-mon[124666]: pgmap v19296: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 683 KiB/s rd, 681 KiB/s wr, 9 op/s 2023-05-08T13:45:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36078.394785 secs 2023-05-08T13:45:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:39 smithi186 ceph-mon[126480]: pgmap v19296: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 683 KiB/s rd, 681 KiB/s wr, 9 op/s 2023-05-08T13:45:41.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36078.949210 secs 2023-05-08T13:45:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36078.949210 secs 2023-05-08T13:45:41.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36078.949210 secs 2023-05-08T13:45:42.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36080.254125 secs 2023-05-08T13:45:42.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:41 smithi133 ceph-mon[125939]: pgmap v19297: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 949 KiB/s rd, 950 KiB/s wr, 12 op/s 2023-05-08T13:45:42.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36080.254125 secs 2023-05-08T13:45:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:41 smithi096 ceph-mon[124666]: pgmap v19297: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 949 KiB/s rd, 950 KiB/s wr, 12 op/s 2023-05-08T13:45:42.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36080.254125 secs 2023-05-08T13:45:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:41 smithi186 ceph-mon[126480]: pgmap v19297: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 949 KiB/s rd, 950 KiB/s wr, 12 op/s 2023-05-08T13:45:43.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:43 smithi133 ceph-mon[125939]: pgmap v19298: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 641 KiB/s rd, 643 KiB/s wr, 8 op/s 2023-05-08T13:45:44.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:43 smithi096 ceph-mon[124666]: pgmap v19298: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 641 KiB/s rd, 643 KiB/s wr, 8 op/s 2023-05-08T13:45:44.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:43 smithi186 ceph-mon[126480]: pgmap v19298: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 641 KiB/s rd, 643 KiB/s wr, 8 op/s 2023-05-08T13:45:44.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36083.394880 secs 2023-05-08T13:45:45.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36083.394880 secs 2023-05-08T13:45:45.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36083.394880 secs 2023-05-08T13:45:45.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36083.949326 secs 2023-05-08T13:45:45.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:45 smithi133 ceph-mon[125939]: pgmap v19299: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 642 KiB/s rd, 644 KiB/s wr, 11 op/s 2023-05-08T13:45:46.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36083.949326 secs 2023-05-08T13:45:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:45 smithi096 ceph-mon[124666]: pgmap v19299: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 642 KiB/s rd, 644 KiB/s wr, 11 op/s 2023-05-08T13:45:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36083.949326 secs 2023-05-08T13:45:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:45 smithi186 ceph-mon[126480]: pgmap v19299: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 642 KiB/s rd, 644 KiB/s wr, 11 op/s 2023-05-08T13:45:46.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36085.254256 secs 2023-05-08T13:45:47.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36085.254256 secs 2023-05-08T13:45:47.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36085.254256 secs 2023-05-08T13:45:47.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:47 smithi133 ceph-mon[125939]: pgmap v19300: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 314 KiB/s wr, 6 op/s 2023-05-08T13:45:48.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:47 smithi096 ceph-mon[124666]: pgmap v19300: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 314 KiB/s wr, 6 op/s 2023-05-08T13:45:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:47 smithi186 ceph-mon[126480]: pgmap v19300: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 314 KiB/s wr, 6 op/s 2023-05-08T13:45:50.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36088.395006 secs 2023-05-08T13:45:50.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:49 smithi133 ceph-mon[125939]: pgmap v19301: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 314 KiB/s wr, 6 op/s 2023-05-08T13:45:50.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36088.395006 secs 2023-05-08T13:45:50.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:49 smithi096 ceph-mon[124666]: pgmap v19301: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 314 KiB/s wr, 6 op/s 2023-05-08T13:45:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36088.395006 secs 2023-05-08T13:45:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:49 smithi186 ceph-mon[126480]: pgmap v19301: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 314 KiB/s wr, 6 op/s 2023-05-08T13:45:52.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36090.254379 secs 2023-05-08T13:45:52.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:51 smithi133 ceph-mon[125939]: pgmap v19302: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 976 KiB/s rd, 955 KiB/s wr, 11 op/s 2023-05-08T13:45:52.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36090.254379 secs 2023-05-08T13:45:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:51 smithi096 ceph-mon[124666]: pgmap v19302: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 976 KiB/s rd, 955 KiB/s wr, 11 op/s 2023-05-08T13:45:52.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36090.254379 secs 2023-05-08T13:45:52.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:51 smithi186 ceph-mon[126480]: pgmap v19302: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 976 KiB/s rd, 955 KiB/s wr, 11 op/s 2023-05-08T13:45:53.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:53 smithi133 ceph-mon[125939]: pgmap v19303: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 666 KiB/s rd, 641 KiB/s wr, 7 op/s 2023-05-08T13:45:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:53 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:45:54.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:53 smithi096 ceph-mon[124666]: pgmap v19303: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 666 KiB/s rd, 641 KiB/s wr, 7 op/s 2023-05-08T13:45:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:53 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:45:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:53 smithi186 ceph-mon[126480]: pgmap v19303: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 666 KiB/s rd, 641 KiB/s wr, 7 op/s 2023-05-08T13:45:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:53 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:45:54.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:54 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:45:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:54 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:45:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:54 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:45:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36093.395129 secs 2023-05-08T13:45:55.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:54 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:45:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:54 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:45:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:54 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:45:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36093.395129 secs 2023-05-08T13:45:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:54 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:45:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:54 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:45:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:54 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:45:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36093.395129 secs 2023-05-08T13:45:55.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:55 smithi133 ceph-mon[125939]: pgmap v19304: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T13:45:56.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:55 smithi096 ceph-mon[124666]: pgmap v19304: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T13:45:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:55 smithi186 ceph-mon[126480]: pgmap v19304: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T13:45:58.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:57 smithi133 ceph-mon[125939]: pgmap v19305: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T13:45:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:45:58.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:57 smithi096 ceph-mon[124666]: pgmap v19305: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T13:45:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:45:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:57 smithi186 ceph-mon[126480]: pgmap v19305: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T13:45:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:45:59.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:45:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:45:59.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:45:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:45:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:45:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:46:00.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36098.395249 secs 2023-05-08T13:46:00.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:45:59 smithi133 ceph-mon[125939]: pgmap v19306: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T13:46:00.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36098.395249 secs 2023-05-08T13:46:00.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:45:59 smithi096 ceph-mon[124666]: pgmap v19306: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T13:46:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36098.395249 secs 2023-05-08T13:46:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:45:59 smithi186 ceph-mon[126480]: pgmap v19306: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T13:46:01.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36098.949644 secs 2023-05-08T13:46:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36098.949644 secs 2023-05-08T13:46:01.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36098.949644 secs 2023-05-08T13:46:02.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:01 smithi133 ceph-mon[125939]: pgmap v19307: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.4 MiB/s wr, 14 op/s 2023-05-08T13:46:02.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:01 smithi096 ceph-mon[124666]: pgmap v19307: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.4 MiB/s wr, 14 op/s 2023-05-08T13:46:02.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:01 smithi186 ceph-mon[126480]: pgmap v19307: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.4 MiB/s wr, 14 op/s 2023-05-08T13:46:03.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:02 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:46:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:46:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:46:03.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:02 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:46:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:46:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:46:03.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:02 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:46:03.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:46:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:46:04.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:03 smithi133 ceph-mon[125939]: pgmap v19308: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 825 KiB/s wr, 9 op/s 2023-05-08T13:46:04.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:03 smithi096 ceph-mon[124666]: pgmap v19308: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 825 KiB/s wr, 9 op/s 2023-05-08T13:46:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:03 smithi186 ceph-mon[126480]: pgmap v19308: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 825 KiB/s wr, 9 op/s 2023-05-08T13:46:05.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36103.395371 secs 2023-05-08T13:46:05.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36103.395371 secs 2023-05-08T13:46:05.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36103.395371 secs 2023-05-08T13:46:06.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36103.949761 secs 2023-05-08T13:46:06.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:05 smithi133 ceph-mon[125939]: pgmap v19309: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.2 MiB/s wr, 16 op/s 2023-05-08T13:46:06.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36103.949761 secs 2023-05-08T13:46:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:05 smithi096 ceph-mon[124666]: pgmap v19309: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.2 MiB/s wr, 16 op/s 2023-05-08T13:46:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36103.949761 secs 2023-05-08T13:46:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:05 smithi186 ceph-mon[126480]: pgmap v19309: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.2 MiB/s wr, 16 op/s 2023-05-08T13:46:08.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:07 smithi133 ceph-mon[125939]: pgmap v19310: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 969 KiB/s rd, 510 KiB/s wr, 11 op/s 2023-05-08T13:46:08.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:07 smithi096 ceph-mon[124666]: pgmap v19310: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 969 KiB/s rd, 510 KiB/s wr, 11 op/s 2023-05-08T13:46:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:07 smithi186 ceph-mon[126480]: pgmap v19310: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 969 KiB/s rd, 510 KiB/s wr, 11 op/s 2023-05-08T13:46:10.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36108.395509 secs 2023-05-08T13:46:10.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:09 smithi133 ceph-mon[125939]: pgmap v19311: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 969 KiB/s rd, 510 KiB/s wr, 11 op/s 2023-05-08T13:46:10.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36108.395509 secs 2023-05-08T13:46:10.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:09 smithi096 ceph-mon[124666]: pgmap v19311: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 969 KiB/s rd, 510 KiB/s wr, 11 op/s 2023-05-08T13:46:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36108.395509 secs 2023-05-08T13:46:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:09 smithi186 ceph-mon[126480]: pgmap v19311: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 969 KiB/s rd, 510 KiB/s wr, 11 op/s 2023-05-08T13:46:12.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:11 smithi133 ceph-mon[125939]: pgmap v19312: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.2 MiB/s wr, 27 op/s 2023-05-08T13:46:12.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:11 smithi096 ceph-mon[124666]: pgmap v19312: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.2 MiB/s wr, 27 op/s 2023-05-08T13:46:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:11 smithi186 ceph-mon[126480]: pgmap v19312: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.2 MiB/s wr, 27 op/s 2023-05-08T13:46:13.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:13 smithi133 ceph-mon[125939]: pgmap v19313: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 23 op/s 2023-05-08T13:46:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:13 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:46:14.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:13 smithi096 ceph-mon[124666]: pgmap v19313: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 23 op/s 2023-05-08T13:46:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:13 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:46:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:13 smithi186 ceph-mon[126480]: pgmap v19313: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 23 op/s 2023-05-08T13:46:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:13 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:46:14.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:14 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:46:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:14 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:46:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:14 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:46:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36113.395587 secs 2023-05-08T13:46:15.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:14 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:46:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:14 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:46:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:14 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:46:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36113.395587 secs 2023-05-08T13:46:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:14 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:46:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:14 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:46:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:14 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:46:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36113.395587 secs 2023-05-08T13:46:15.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:15 smithi133 ceph-mon[125939]: pgmap v19314: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 27 op/s 2023-05-08T13:46:16.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:15 smithi096 ceph-mon[124666]: pgmap v19314: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 27 op/s 2023-05-08T13:46:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:15 smithi186 ceph-mon[126480]: pgmap v19314: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 27 op/s 2023-05-08T13:46:18.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:17 smithi133 ceph-mon[125939]: pgmap v19315: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 20 op/s 2023-05-08T13:46:18.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:17 smithi096 ceph-mon[124666]: pgmap v19315: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 20 op/s 2023-05-08T13:46:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:17 smithi186 ceph-mon[126480]: pgmap v19315: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 20 op/s 2023-05-08T13:46:20.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36118.395703 secs 2023-05-08T13:46:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:19 smithi133 ceph-mon[125939]: pgmap v19316: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 20 op/s 2023-05-08T13:46:20.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36118.395703 secs 2023-05-08T13:46:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:19 smithi096 ceph-mon[124666]: pgmap v19316: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 20 op/s 2023-05-08T13:46:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36118.395703 secs 2023-05-08T13:46:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:19 smithi186 ceph-mon[126480]: pgmap v19316: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 20 op/s 2023-05-08T13:46:22.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:21 smithi133 ceph-mon[125939]: pgmap v19317: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.4 MiB/s wr, 24 op/s 2023-05-08T13:46:22.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:21 smithi096 ceph-mon[124666]: pgmap v19317: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.4 MiB/s wr, 24 op/s 2023-05-08T13:46:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:21 smithi186 ceph-mon[126480]: pgmap v19317: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.4 MiB/s wr, 24 op/s 2023-05-08T13:46:23.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:23 smithi133 ceph-mon[125939]: pgmap v19318: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1013 KiB/s rd, 639 KiB/s wr, 7 op/s 2023-05-08T13:46:24.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:23 smithi096 ceph-mon[124666]: pgmap v19318: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1013 KiB/s rd, 639 KiB/s wr, 7 op/s 2023-05-08T13:46:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:23 smithi186 ceph-mon[126480]: pgmap v19318: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1013 KiB/s rd, 639 KiB/s wr, 7 op/s 2023-05-08T13:46:24.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36123.395830 secs 2023-05-08T13:46:25.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36123.395830 secs 2023-05-08T13:46:25.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36123.395830 secs 2023-05-08T13:46:25.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36123.950222 secs 2023-05-08T13:46:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:25 smithi133 ceph-mon[125939]: pgmap v19319: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1019 KiB/s wr, 15 op/s 2023-05-08T13:46:26.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36123.950222 secs 2023-05-08T13:46:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:25 smithi096 ceph-mon[124666]: pgmap v19319: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1019 KiB/s wr, 15 op/s 2023-05-08T13:46:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36123.950222 secs 2023-05-08T13:46:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:25 smithi186 ceph-mon[126480]: pgmap v19319: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1019 KiB/s wr, 15 op/s 2023-05-08T13:46:26.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36125.255176 secs 2023-05-08T13:46:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:26 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:46:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:26 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:46:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:26 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:46:27.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36125.255176 secs 2023-05-08T13:46:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:26 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:46:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:26 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:46:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:26 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:46:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36125.255176 secs 2023-05-08T13:46:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:26 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:46:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:26 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:46:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:26 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:46:27.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:27 smithi133 ceph-mon[125939]: pgmap v19320: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 688 KiB/s wr, 11 op/s 2023-05-08T13:46:28.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:27 smithi096 ceph-mon[124666]: pgmap v19320: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 688 KiB/s wr, 11 op/s 2023-05-08T13:46:28.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:27 smithi186 ceph-mon[126480]: pgmap v19320: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 688 KiB/s wr, 11 op/s 2023-05-08T13:46:30.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36128.395949 secs 2023-05-08T13:46:30.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:29 smithi133 ceph-mon[125939]: pgmap v19321: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 688 KiB/s wr, 11 op/s 2023-05-08T13:46:30.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36128.395949 secs 2023-05-08T13:46:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:29 smithi096 ceph-mon[124666]: pgmap v19321: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 688 KiB/s wr, 11 op/s 2023-05-08T13:46:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36128.395949 secs 2023-05-08T13:46:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:29 smithi186 ceph-mon[126480]: pgmap v19321: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 688 KiB/s wr, 11 op/s 2023-05-08T13:46:31.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36128.950338 secs 2023-05-08T13:46:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:30 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:46:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:30 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:46:31.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36128.950338 secs 2023-05-08T13:46:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:30 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:46:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:30 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:46:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36128.950338 secs 2023-05-08T13:46:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:30 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:46:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:30 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:46:32.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36130.255317 secs 2023-05-08T13:46:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:31 smithi133 ceph-mon[125939]: pgmap v19322: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 842 KiB/s wr, 16 op/s 2023-05-08T13:46:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:31 smithi133 ceph-mon[125939]: osdmap e1284: 12 total, 12 up, 12 in 2023-05-08T13:46:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:31 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:46:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36130.255317 secs 2023-05-08T13:46:32.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:31 smithi096 ceph-mon[124666]: pgmap v19322: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 842 KiB/s wr, 16 op/s 2023-05-08T13:46:32.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:31 smithi096 ceph-mon[124666]: osdmap e1284: 12 total, 12 up, 12 in 2023-05-08T13:46:32.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:31 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:46:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36130.255317 secs 2023-05-08T13:46:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:31 smithi186 ceph-mon[126480]: pgmap v19322: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 842 KiB/s wr, 16 op/s 2023-05-08T13:46:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:31 smithi186 ceph-mon[126480]: osdmap e1284: 12 total, 12 up, 12 in 2023-05-08T13:46:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:31 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:46:33.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:32 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:46:33.295 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:32 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:46:33.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:32 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:46:34.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:33 smithi133 ceph-mon[125939]: pgmap v19324: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 965 KiB/s rd, 641 KiB/s wr, 15 op/s 2023-05-08T13:46:34.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:33 smithi096 ceph-mon[124666]: pgmap v19324: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 965 KiB/s rd, 641 KiB/s wr, 15 op/s 2023-05-08T13:46:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:33 smithi186 ceph-mon[126480]: pgmap v19324: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 965 KiB/s rd, 641 KiB/s wr, 15 op/s 2023-05-08T13:46:35.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36133.396045 secs 2023-05-08T13:46:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36133.950451 secs 2023-05-08T13:46:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:46:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:46:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:46:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:46:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:46:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:46:35.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:46:35.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:46:35.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:46:35.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:46:35.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:46:35.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36133.396045 secs 2023-05-08T13:46:35.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36133.950451 secs 2023-05-08T13:46:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:46:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:46:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:46:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:46:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:46:35.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:46:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:46:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:46:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:46:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:46:35.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:46:35.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36133.396045 secs 2023-05-08T13:46:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36133.950451 secs 2023-05-08T13:46:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:46:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:46:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:46:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:46:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:46:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:46:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:46:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:46:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:46:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:46:35.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:46:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:36 smithi186 ceph-mon[126480]: pgmap v19325: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 901 KiB/s rd, 899 KiB/s wr, 12 op/s 2023-05-08T13:46:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:36 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi186 to 97662k 2023-05-08T13:46:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:36 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi186 to 100006056: error parsing value: Value '100006056' is below minimum 939524096 2023-05-08T13:46:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:46:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:46:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:46:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:46:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:46:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:46:36.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:46:36.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:36 smithi133 ceph-mon[125939]: pgmap v19325: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 901 KiB/s rd, 899 KiB/s wr, 12 op/s 2023-05-08T13:46:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:36 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi186 to 97662k 2023-05-08T13:46:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:36 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi186 to 100006056: error parsing value: Value '100006056' is below minimum 939524096 2023-05-08T13:46:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:46:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:46:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:46:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:46:36.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:46:36.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:46:36.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:46:36.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:36 smithi096 ceph-mon[124666]: pgmap v19325: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 901 KiB/s rd, 899 KiB/s wr, 12 op/s 2023-05-08T13:46:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:36 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi186 to 97662k 2023-05-08T13:46:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:36 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi186 to 100006056: error parsing value: Value '100006056' is below minimum 939524096 2023-05-08T13:46:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:46:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:46:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:46:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:46:36.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:46:36.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:46:36.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:46:37.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:37 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi133 to 108.9M 2023-05-08T13:46:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:37 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi133 to 114215932: error parsing value: Value '114215932' is below minimum 939524096 2023-05-08T13:46:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:37 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:46:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:37 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T13:46:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:37 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T13:46:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:37 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:46:37.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:37 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36135.255450 secs 2023-05-08T13:46:37.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:37 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi133 to 108.9M 2023-05-08T13:46:37.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:37 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi133 to 114215932: error parsing value: Value '114215932' is below minimum 939524096 2023-05-08T13:46:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:37 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:46:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:37 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T13:46:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:37 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T13:46:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:37 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:46:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:37 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36135.255450 secs 2023-05-08T13:46:37.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:37 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi133 to 108.9M 2023-05-08T13:46:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:37 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi133 to 114215932: error parsing value: Value '114215932' is below minimum 939524096 2023-05-08T13:46:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:37 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:46:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:37 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T13:46:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:37 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T13:46:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:37 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:46:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:37 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36135.255450 secs 2023-05-08T13:46:38.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:38 smithi186 ceph-mon[126480]: pgmap v19326: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 901 KiB/s rd, 899 KiB/s wr, 12 op/s 2023-05-08T13:46:38.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:38 smithi186 ceph-mon[126480]: osdmap e1285: 12 total, 12 up, 12 in 2023-05-08T13:46:38.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:38 smithi133 ceph-mon[125939]: pgmap v19326: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 901 KiB/s rd, 899 KiB/s wr, 12 op/s 2023-05-08T13:46:38.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:38 smithi133 ceph-mon[125939]: osdmap e1285: 12 total, 12 up, 12 in 2023-05-08T13:46:38.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:38 smithi096 ceph-mon[124666]: pgmap v19326: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 901 KiB/s rd, 899 KiB/s wr, 12 op/s 2023-05-08T13:46:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:38 smithi096 ceph-mon[124666]: osdmap e1285: 12 total, 12 up, 12 in 2023-05-08T13:46:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36138.396164 secs 2023-05-08T13:46:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:40 smithi186 ceph-mon[126480]: pgmap v19328: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 894 KiB/s rd, 893 KiB/s wr, 7 op/s 2023-05-08T13:46:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36138.950570 secs 2023-05-08T13:46:40.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36138.396164 secs 2023-05-08T13:46:40.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:40 smithi133 ceph-mon[125939]: pgmap v19328: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 894 KiB/s rd, 893 KiB/s wr, 7 op/s 2023-05-08T13:46:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36138.950570 secs 2023-05-08T13:46:40.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36138.396164 secs 2023-05-08T13:46:40.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:40 smithi096 ceph-mon[124666]: pgmap v19328: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 894 KiB/s rd, 893 KiB/s wr, 7 op/s 2023-05-08T13:46:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36138.950570 secs 2023-05-08T13:46:42.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:42 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36140.255577 secs 2023-05-08T13:46:42.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:42 smithi186 ceph-mon[126480]: pgmap v19329: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T13:46:42.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:42 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36140.255577 secs 2023-05-08T13:46:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:42 smithi133 ceph-mon[125939]: pgmap v19329: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T13:46:42.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:42 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36140.255577 secs 2023-05-08T13:46:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:42 smithi096 ceph-mon[124666]: pgmap v19329: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T13:46:43.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:43 smithi133 ceph-mon[125939]: pgmap v19330: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T13:46:44.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:43 smithi096 ceph-mon[124666]: pgmap v19330: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T13:46:44.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:43 smithi186 ceph-mon[126480]: pgmap v19330: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T13:46:44.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36143.396301 secs 2023-05-08T13:46:45.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36143.396301 secs 2023-05-08T13:46:45.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36143.396301 secs 2023-05-08T13:46:45.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36143.950692 secs 2023-05-08T13:46:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:45 smithi133 ceph-mon[125939]: pgmap v19331: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 515 KiB/s wr, 9 op/s 2023-05-08T13:46:46.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36143.950692 secs 2023-05-08T13:46:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:45 smithi096 ceph-mon[124666]: pgmap v19331: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 515 KiB/s wr, 9 op/s 2023-05-08T13:46:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36143.950692 secs 2023-05-08T13:46:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:45 smithi186 ceph-mon[126480]: pgmap v19331: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 515 KiB/s wr, 9 op/s 2023-05-08T13:46:46.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36145.255697 secs 2023-05-08T13:46:47.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36145.255697 secs 2023-05-08T13:46:47.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36145.255697 secs 2023-05-08T13:46:47.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:47 smithi133 ceph-mon[125939]: pgmap v19332: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 515 KiB/s wr, 9 op/s 2023-05-08T13:46:48.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:47 smithi096 ceph-mon[124666]: pgmap v19332: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 515 KiB/s wr, 9 op/s 2023-05-08T13:46:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:47 smithi186 ceph-mon[126480]: pgmap v19332: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 515 KiB/s wr, 9 op/s 2023-05-08T13:46:50.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36148.396415 secs 2023-05-08T13:46:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:49 smithi133 ceph-mon[125939]: pgmap v19333: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 459 KiB/s wr, 8 op/s 2023-05-08T13:46:50.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36148.396415 secs 2023-05-08T13:46:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:49 smithi096 ceph-mon[124666]: pgmap v19333: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 459 KiB/s wr, 8 op/s 2023-05-08T13:46:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36148.396415 secs 2023-05-08T13:46:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:49 smithi186 ceph-mon[126480]: pgmap v19333: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 459 KiB/s wr, 8 op/s 2023-05-08T13:46:52.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36150.255813 secs 2023-05-08T13:46:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:51 smithi133 ceph-mon[125939]: pgmap v19334: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T13:46:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36150.255813 secs 2023-05-08T13:46:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:51 smithi096 ceph-mon[124666]: pgmap v19334: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T13:46:52.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36150.255813 secs 2023-05-08T13:46:52.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:51 smithi186 ceph-mon[126480]: pgmap v19334: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T13:46:53.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:53 smithi133 ceph-mon[125939]: pgmap v19335: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 855 KiB/s rd, 801 KiB/s wr, 8 op/s 2023-05-08T13:46:53.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:53 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:46:54.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:53 smithi096 ceph-mon[124666]: pgmap v19335: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 855 KiB/s rd, 801 KiB/s wr, 8 op/s 2023-05-08T13:46:54.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:53 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:46:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:53 smithi186 ceph-mon[126480]: pgmap v19335: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 855 KiB/s rd, 801 KiB/s wr, 8 op/s 2023-05-08T13:46:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:53 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:46:54.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:54 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:46:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:54 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:46:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:54 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:46:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36153.396481 secs 2023-05-08T13:46:55.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:54 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:46:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:54 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:46:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:54 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:46:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36153.396481 secs 2023-05-08T13:46:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:54 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:46:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:54 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:46:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:54 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:46:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36153.396481 secs 2023-05-08T13:46:55.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:55 smithi133 ceph-mon[125939]: pgmap v19336: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 14 op/s 2023-05-08T13:46:56.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:55 smithi096 ceph-mon[124666]: pgmap v19336: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 14 op/s 2023-05-08T13:46:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:55 smithi186 ceph-mon[126480]: pgmap v19336: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 14 op/s 2023-05-08T13:46:58.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:57 smithi133 ceph-mon[125939]: pgmap v19337: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T13:46:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:46:58.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:57 smithi096 ceph-mon[124666]: pgmap v19337: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T13:46:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:46:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:57 smithi186 ceph-mon[126480]: pgmap v19337: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T13:46:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:46:59.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:46:59.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:46:59.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:46:59.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:46:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:46:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:47:00.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36158.396632 secs 2023-05-08T13:47:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:46:59 smithi133 ceph-mon[125939]: pgmap v19338: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T13:47:00.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36158.396632 secs 2023-05-08T13:47:00.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:46:59 smithi096 ceph-mon[124666]: pgmap v19338: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T13:47:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36158.396632 secs 2023-05-08T13:47:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:46:59 smithi186 ceph-mon[126480]: pgmap v19338: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T13:47:01.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36158.951009 secs 2023-05-08T13:47:01.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36158.951009 secs 2023-05-08T13:47:01.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36158.951009 secs 2023-05-08T13:47:02.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:01 smithi133 ceph-mon[125939]: pgmap v19339: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.6 MiB/s wr, 16 op/s 2023-05-08T13:47:02.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:01 smithi096 ceph-mon[124666]: pgmap v19339: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.6 MiB/s wr, 16 op/s 2023-05-08T13:47:02.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:01 smithi186 ceph-mon[126480]: pgmap v19339: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.6 MiB/s wr, 16 op/s 2023-05-08T13:47:03.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:02 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:47:03.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:47:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:47:03.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:02 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:47:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:47:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:47:03.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:02 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:47:03.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:47:03.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:47:04.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:03 smithi133 ceph-mon[125939]: pgmap v19340: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 849 KiB/s wr, 11 op/s 2023-05-08T13:47:04.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:03 smithi096 ceph-mon[124666]: pgmap v19340: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 849 KiB/s wr, 11 op/s 2023-05-08T13:47:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:03 smithi186 ceph-mon[126480]: pgmap v19340: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 849 KiB/s wr, 11 op/s 2023-05-08T13:47:05.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36163.396752 secs 2023-05-08T13:47:05.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36163.396752 secs 2023-05-08T13:47:05.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36163.396752 secs 2023-05-08T13:47:06.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36163.951147 secs 2023-05-08T13:47:06.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:05 smithi133 ceph-mon[125939]: pgmap v19341: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.5 MiB/s wr, 28 op/s 2023-05-08T13:47:06.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36163.951147 secs 2023-05-08T13:47:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:05 smithi096 ceph-mon[124666]: pgmap v19341: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.5 MiB/s wr, 28 op/s 2023-05-08T13:47:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36163.951147 secs 2023-05-08T13:47:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:05 smithi186 ceph-mon[126480]: pgmap v19341: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.5 MiB/s wr, 28 op/s 2023-05-08T13:47:08.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:07 smithi133 ceph-mon[125939]: pgmap v19342: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 769 KiB/s wr, 22 op/s 2023-05-08T13:47:08.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:07 smithi096 ceph-mon[124666]: pgmap v19342: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 769 KiB/s wr, 22 op/s 2023-05-08T13:47:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:07 smithi186 ceph-mon[126480]: pgmap v19342: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 769 KiB/s wr, 22 op/s 2023-05-08T13:47:10.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36168.396891 secs 2023-05-08T13:47:10.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:09 smithi133 ceph-mon[125939]: pgmap v19343: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 769 KiB/s wr, 22 op/s 2023-05-08T13:47:10.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36168.396891 secs 2023-05-08T13:47:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:09 smithi096 ceph-mon[124666]: pgmap v19343: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 769 KiB/s wr, 22 op/s 2023-05-08T13:47:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36168.396891 secs 2023-05-08T13:47:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:09 smithi186 ceph-mon[126480]: pgmap v19343: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 769 KiB/s wr, 22 op/s 2023-05-08T13:47:11.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36168.951284 secs 2023-05-08T13:47:11.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36168.951284 secs 2023-05-08T13:47:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36168.951284 secs 2023-05-08T13:47:12.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:11 smithi133 ceph-mon[125939]: pgmap v19344: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 797 KiB/s wr, 25 op/s 2023-05-08T13:47:12.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:11 smithi096 ceph-mon[124666]: pgmap v19344: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 797 KiB/s wr, 25 op/s 2023-05-08T13:47:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:11 smithi186 ceph-mon[126480]: pgmap v19344: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 797 KiB/s wr, 25 op/s 2023-05-08T13:47:13.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:13 smithi133 ceph-mon[125939]: pgmap v19345: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 807 KiB/s rd, 687 KiB/s wr, 20 op/s 2023-05-08T13:47:14.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:13 smithi096 ceph-mon[124666]: pgmap v19345: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 807 KiB/s rd, 687 KiB/s wr, 20 op/s 2023-05-08T13:47:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:13 smithi186 ceph-mon[126480]: pgmap v19345: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 807 KiB/s rd, 687 KiB/s wr, 20 op/s 2023-05-08T13:47:14.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36173.396983 secs 2023-05-08T13:47:15.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36173.396983 secs 2023-05-08T13:47:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36173.396983 secs 2023-05-08T13:47:15.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36173.951423 secs 2023-05-08T13:47:15.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:15 smithi133 ceph-mon[125939]: pgmap v19346: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 854 KiB/s rd, 733 KiB/s wr, 22 op/s 2023-05-08T13:47:16.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36173.951423 secs 2023-05-08T13:47:16.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:15 smithi096 ceph-mon[124666]: pgmap v19346: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 854 KiB/s rd, 733 KiB/s wr, 22 op/s 2023-05-08T13:47:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36173.951423 secs 2023-05-08T13:47:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:15 smithi186 ceph-mon[126480]: pgmap v19346: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 854 KiB/s rd, 733 KiB/s wr, 22 op/s 2023-05-08T13:47:18.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:17 smithi133 ceph-mon[125939]: pgmap v19347: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 387 KiB/s wr, 6 op/s 2023-05-08T13:47:18.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:17 smithi096 ceph-mon[124666]: pgmap v19347: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 387 KiB/s wr, 6 op/s 2023-05-08T13:47:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:17 smithi186 ceph-mon[126480]: pgmap v19347: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 387 KiB/s wr, 6 op/s 2023-05-08T13:47:20.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36178.397101 secs 2023-05-08T13:47:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:19 smithi133 ceph-mon[125939]: pgmap v19348: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 387 KiB/s wr, 6 op/s 2023-05-08T13:47:20.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36178.397101 secs 2023-05-08T13:47:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:19 smithi096 ceph-mon[124666]: pgmap v19348: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 387 KiB/s wr, 6 op/s 2023-05-08T13:47:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36178.397101 secs 2023-05-08T13:47:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:19 smithi186 ceph-mon[126480]: pgmap v19348: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 387 KiB/s wr, 6 op/s 2023-05-08T13:47:21.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:20 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:47:21.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:20 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:47:21.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:20 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:47:21.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:20 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:47:21.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:20 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:47:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:20 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:47:21.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:20 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:47:21.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:20 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:47:21.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:20 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:47:22.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36180.275721 secs 2023-05-08T13:47:22.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:21 smithi133 ceph-mon[125939]: pgmap v19349: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 606 KiB/s rd, 625 KiB/s wr, 13 op/s 2023-05-08T13:47:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:21 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:47:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36180.275721 secs 2023-05-08T13:47:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:21 smithi096 ceph-mon[124666]: pgmap v19349: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 606 KiB/s rd, 625 KiB/s wr, 13 op/s 2023-05-08T13:47:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:21 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:47:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36180.275721 secs 2023-05-08T13:47:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:21 smithi186 ceph-mon[126480]: pgmap v19349: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 606 KiB/s rd, 625 KiB/s wr, 13 op/s 2023-05-08T13:47:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:21 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:47:23.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:22 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:47:23.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:22 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:47:23.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:22 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:47:23.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:22 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:47:23.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:22 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:47:23.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:22 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:47:24.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:23 smithi096 ceph-mon[124666]: pgmap v19350: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 605 KiB/s rd, 596 KiB/s wr, 10 op/s 2023-05-08T13:47:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:23 smithi186 ceph-mon[126480]: pgmap v19350: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 605 KiB/s rd, 596 KiB/s wr, 10 op/s 2023-05-08T13:47:24.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:23 smithi133 ceph-mon[125939]: pgmap v19350: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 605 KiB/s rd, 596 KiB/s wr, 10 op/s 2023-05-08T13:47:25.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36183.397193 secs 2023-05-08T13:47:25.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36183.397193 secs 2023-05-08T13:47:25.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36183.397193 secs 2023-05-08T13:47:26.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:25 smithi096 ceph-mon[124666]: pgmap v19351: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 760 KiB/s rd, 775 KiB/s wr, 14 op/s 2023-05-08T13:47:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:25 smithi186 ceph-mon[126480]: pgmap v19351: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 760 KiB/s rd, 775 KiB/s wr, 14 op/s 2023-05-08T13:47:26.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:25 smithi133 ceph-mon[125939]: pgmap v19351: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 760 KiB/s rd, 775 KiB/s wr, 14 op/s 2023-05-08T13:47:27.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:27 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36185.275845 secs 2023-05-08T13:47:27.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:27 smithi186 ceph-mon[126480]: osdmap e1286: 12 total, 12 up, 12 in 2023-05-08T13:47:27.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:27 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36185.275845 secs 2023-05-08T13:47:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:27 smithi133 ceph-mon[125939]: osdmap e1286: 12 total, 12 up, 12 in 2023-05-08T13:47:27.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:27 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36185.275845 secs 2023-05-08T13:47:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:27 smithi096 ceph-mon[124666]: osdmap e1286: 12 total, 12 up, 12 in 2023-05-08T13:47:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:28 smithi186 ceph-mon[126480]: pgmap v19353: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 823 KiB/s rd, 500 KiB/s wr, 13 op/s 2023-05-08T13:47:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:28 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:47:28.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:28 smithi133 ceph-mon[125939]: pgmap v19353: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 823 KiB/s rd, 500 KiB/s wr, 13 op/s 2023-05-08T13:47:28.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:28 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:47:28.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:28 smithi096 ceph-mon[124666]: pgmap v19353: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 823 KiB/s rd, 500 KiB/s wr, 13 op/s 2023-05-08T13:47:28.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:28 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:47:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36188.397290 secs 2023-05-08T13:47:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:30 smithi186 ceph-mon[126480]: pgmap v19354: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 823 KiB/s rd, 500 KiB/s wr, 13 op/s 2023-05-08T13:47:30.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36188.397290 secs 2023-05-08T13:47:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:30 smithi133 ceph-mon[125939]: pgmap v19354: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 823 KiB/s rd, 500 KiB/s wr, 13 op/s 2023-05-08T13:47:30.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36188.397290 secs 2023-05-08T13:47:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:30 smithi096 ceph-mon[124666]: pgmap v19354: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 823 KiB/s rd, 500 KiB/s wr, 13 op/s 2023-05-08T13:47:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:32 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36190.275989 secs 2023-05-08T13:47:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:32 smithi186 ceph-mon[126480]: pgmap v19355: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 645 KiB/s wr, 10 op/s 2023-05-08T13:47:32.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:32 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36190.275989 secs 2023-05-08T13:47:32.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:32 smithi133 ceph-mon[125939]: pgmap v19355: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 645 KiB/s wr, 10 op/s 2023-05-08T13:47:32.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:32 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36190.275989 secs 2023-05-08T13:47:32.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:32 smithi096 ceph-mon[124666]: pgmap v19355: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 645 KiB/s wr, 10 op/s 2023-05-08T13:47:33.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:33 smithi133 ceph-mon[125939]: osdmap e1287: 12 total, 12 up, 12 in 2023-05-08T13:47:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:33 smithi133 ceph-mon[125939]: pgmap v19357: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 582 KiB/s rd, 538 KiB/s wr, 6 op/s 2023-05-08T13:47:34.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:33 smithi096 ceph-mon[124666]: osdmap e1287: 12 total, 12 up, 12 in 2023-05-08T13:47:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:33 smithi096 ceph-mon[124666]: pgmap v19357: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 582 KiB/s rd, 538 KiB/s wr, 6 op/s 2023-05-08T13:47:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:33 smithi186 ceph-mon[126480]: osdmap e1287: 12 total, 12 up, 12 in 2023-05-08T13:47:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:33 smithi186 ceph-mon[126480]: pgmap v19357: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 582 KiB/s rd, 538 KiB/s wr, 6 op/s 2023-05-08T13:47:34.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36193.397403 secs 2023-05-08T13:47:35.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36193.397403 secs 2023-05-08T13:47:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36193.397403 secs 2023-05-08T13:47:35.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:35 smithi133 ceph-mon[125939]: pgmap v19358: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 744 KiB/s rd, 703 KiB/s wr, 11 op/s 2023-05-08T13:47:35.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:47:36.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:35 smithi096 ceph-mon[124666]: pgmap v19358: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 744 KiB/s rd, 703 KiB/s wr, 11 op/s 2023-05-08T13:47:36.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:47:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:35 smithi186 ceph-mon[126480]: pgmap v19358: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 744 KiB/s rd, 703 KiB/s wr, 11 op/s 2023-05-08T13:47:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:47:36.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36195.276111 secs 2023-05-08T13:47:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:47:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:47:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:36 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:47:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:47:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:36 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T13:47:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:36 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T13:47:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:36 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:47:37.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36195.276111 secs 2023-05-08T13:47:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:47:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:47:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:36 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:47:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:47:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:36 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T13:47:37.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:36 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T13:47:37.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:36 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:47:37.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36195.276111 secs 2023-05-08T13:47:37.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:47:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:47:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:36 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:47:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:47:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:36 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T13:47:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:36 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T13:47:37.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:36 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:47:37.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:37 smithi133 ceph-mon[125939]: pgmap v19359: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 660 KiB/s rd, 623 KiB/s wr, 10 op/s 2023-05-08T13:47:38.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:37 smithi096 ceph-mon[124666]: pgmap v19359: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 660 KiB/s rd, 623 KiB/s wr, 10 op/s 2023-05-08T13:47:38.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:37 smithi186 ceph-mon[126480]: pgmap v19359: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 660 KiB/s rd, 623 KiB/s wr, 10 op/s 2023-05-08T13:47:40.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36198.397517 secs 2023-05-08T13:47:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:39 smithi133 ceph-mon[125939]: pgmap v19360: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 660 KiB/s rd, 623 KiB/s wr, 10 op/s 2023-05-08T13:47:40.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36198.397517 secs 2023-05-08T13:47:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:39 smithi096 ceph-mon[124666]: pgmap v19360: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 660 KiB/s rd, 623 KiB/s wr, 10 op/s 2023-05-08T13:47:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36198.397517 secs 2023-05-08T13:47:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:39 smithi186 ceph-mon[126480]: pgmap v19360: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 660 KiB/s rd, 623 KiB/s wr, 10 op/s 2023-05-08T13:47:41.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36198.952073 secs 2023-05-08T13:47:41.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36198.952073 secs 2023-05-08T13:47:41.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36198.952073 secs 2023-05-08T13:47:42.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36200.276225 secs 2023-05-08T13:47:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:41 smithi133 ceph-mon[125939]: pgmap v19361: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T13:47:42.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36200.276225 secs 2023-05-08T13:47:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:41 smithi096 ceph-mon[124666]: pgmap v19361: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T13:47:42.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36200.276225 secs 2023-05-08T13:47:42.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:41 smithi186 ceph-mon[126480]: pgmap v19361: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T13:47:43.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:42 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:47:43.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:42 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:47:43.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:42 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:47:43.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:42 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:47:43.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:42 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:47:43.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:42 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:47:43.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:42 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:47:43.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:42 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:47:43.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:42 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:47:44.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:43 smithi133 ceph-mon[125939]: pgmap v19362: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T13:47:44.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:43 smithi096 ceph-mon[124666]: pgmap v19362: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T13:47:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:43 smithi186 ceph-mon[126480]: pgmap v19362: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T13:47:45.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36203.397578 secs 2023-05-08T13:47:45.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36203.397578 secs 2023-05-08T13:47:45.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36203.397578 secs 2023-05-08T13:47:46.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36203.952204 secs 2023-05-08T13:47:46.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:45 smithi133 ceph-mon[125939]: pgmap v19363: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 14 op/s 2023-05-08T13:47:46.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36203.952204 secs 2023-05-08T13:47:46.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:45 smithi096 ceph-mon[124666]: pgmap v19363: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 14 op/s 2023-05-08T13:47:46.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36203.952204 secs 2023-05-08T13:47:46.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:45 smithi186 ceph-mon[126480]: pgmap v19363: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 14 op/s 2023-05-08T13:47:47.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36205.276341 secs 2023-05-08T13:47:47.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36205.276341 secs 2023-05-08T13:47:47.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36205.276341 secs 2023-05-08T13:47:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:47 smithi133 ceph-mon[125939]: pgmap v19364: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 10 op/s 2023-05-08T13:47:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:47 smithi096 ceph-mon[124666]: pgmap v19364: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 10 op/s 2023-05-08T13:47:48.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:47 smithi186 ceph-mon[126480]: pgmap v19364: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 10 op/s 2023-05-08T13:47:50.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36208.397702 secs 2023-05-08T13:47:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:49 smithi133 ceph-mon[125939]: pgmap v19365: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 10 op/s 2023-05-08T13:47:50.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36208.397702 secs 2023-05-08T13:47:50.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:49 smithi096 ceph-mon[124666]: pgmap v19365: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 10 op/s 2023-05-08T13:47:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36208.397702 secs 2023-05-08T13:47:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:49 smithi186 ceph-mon[126480]: pgmap v19365: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 10 op/s 2023-05-08T13:47:51.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36208.952332 secs 2023-05-08T13:47:51.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36208.952332 secs 2023-05-08T13:47:51.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36208.952332 secs 2023-05-08T13:47:52.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36210.276457 secs 2023-05-08T13:47:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:51 smithi133 ceph-mon[125939]: pgmap v19366: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 14 op/s 2023-05-08T13:47:52.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36210.276457 secs 2023-05-08T13:47:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:51 smithi096 ceph-mon[124666]: pgmap v19366: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 14 op/s 2023-05-08T13:47:52.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36210.276457 secs 2023-05-08T13:47:52.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:51 smithi186 ceph-mon[126480]: pgmap v19366: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 14 op/s 2023-05-08T13:47:53.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:53 smithi133 ceph-mon[125939]: pgmap v19367: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 928 KiB/s wr, 9 op/s 2023-05-08T13:47:54.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:53 smithi096 ceph-mon[124666]: pgmap v19367: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 928 KiB/s wr, 9 op/s 2023-05-08T13:47:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:53 smithi186 ceph-mon[126480]: pgmap v19367: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 928 KiB/s wr, 9 op/s 2023-05-08T13:47:54.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36213.397811 secs 2023-05-08T13:47:55.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36213.397811 secs 2023-05-08T13:47:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36213.397811 secs 2023-05-08T13:47:55.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:55 smithi133 ceph-mon[125939]: pgmap v19368: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.3 MiB/s wr, 15 op/s 2023-05-08T13:47:56.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:55 smithi096 ceph-mon[124666]: pgmap v19368: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.3 MiB/s wr, 15 op/s 2023-05-08T13:47:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:55 smithi186 ceph-mon[126480]: pgmap v19368: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.3 MiB/s wr, 15 op/s 2023-05-08T13:47:56.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36215.276571 secs 2023-05-08T13:47:57.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36215.276571 secs 2023-05-08T13:47:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36215.276571 secs 2023-05-08T13:47:57.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:57 smithi133 ceph-mon[125939]: pgmap v19369: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 11 op/s 2023-05-08T13:47:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:47:58.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:57 smithi096 ceph-mon[124666]: pgmap v19369: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 11 op/s 2023-05-08T13:47:58.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:47:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:57 smithi186 ceph-mon[126480]: pgmap v19369: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 11 op/s 2023-05-08T13:47:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:47:58.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:58 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:47:58.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:47:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:47:59.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:58 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:47:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:47:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:47:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:58 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:47:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:47:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:47:59.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36218.397916 secs 2023-05-08T13:47:59.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:47:59 smithi133 ceph-mon[125939]: pgmap v19370: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 11 op/s 2023-05-08T13:48:00.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36218.397916 secs 2023-05-08T13:48:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:47:59 smithi096 ceph-mon[124666]: pgmap v19370: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 11 op/s 2023-05-08T13:48:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36218.397916 secs 2023-05-08T13:48:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:47:59 smithi186 ceph-mon[126480]: pgmap v19370: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 11 op/s 2023-05-08T13:48:00.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36218.952577 secs 2023-05-08T13:48:01.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36218.952577 secs 2023-05-08T13:48:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36218.952577 secs 2023-05-08T13:48:01.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:01 smithi133 ceph-mon[125939]: pgmap v19371: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.0 MiB/s wr, 18 op/s 2023-05-08T13:48:01.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:01 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:48:02.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:01 smithi096 ceph-mon[124666]: pgmap v19371: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.0 MiB/s wr, 18 op/s 2023-05-08T13:48:02.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:01 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:48:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:01 smithi186 ceph-mon[126480]: pgmap v19371: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.0 MiB/s wr, 18 op/s 2023-05-08T13:48:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:01 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:48:02.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:48:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:48:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:48:03.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:48:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:48:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:48:03.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:48:03.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:48:03.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:48:03.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:03 smithi133 ceph-mon[125939]: pgmap v19372: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.7 MiB/s wr, 13 op/s 2023-05-08T13:48:04.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:03 smithi096 ceph-mon[124666]: pgmap v19372: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.7 MiB/s wr, 13 op/s 2023-05-08T13:48:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:03 smithi186 ceph-mon[126480]: pgmap v19372: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.7 MiB/s wr, 13 op/s 2023-05-08T13:48:04.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36223.398046 secs 2023-05-08T13:48:05.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36223.398046 secs 2023-05-08T13:48:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36223.398046 secs 2023-05-08T13:48:05.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36223.952695 secs 2023-05-08T13:48:05.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:05 smithi133 ceph-mon[125939]: pgmap v19373: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 2.8 MiB/s wr, 20 op/s 2023-05-08T13:48:06.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36223.952695 secs 2023-05-08T13:48:06.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:05 smithi096 ceph-mon[124666]: pgmap v19373: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 2.8 MiB/s wr, 20 op/s 2023-05-08T13:48:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36223.952695 secs 2023-05-08T13:48:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:05 smithi186 ceph-mon[126480]: pgmap v19373: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 2.8 MiB/s wr, 20 op/s 2023-05-08T13:48:08.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:07 smithi133 ceph-mon[125939]: pgmap v19374: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 1.5 MiB/s wr, 13 op/s 2023-05-08T13:48:08.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:07 smithi096 ceph-mon[124666]: pgmap v19374: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 1.5 MiB/s wr, 13 op/s 2023-05-08T13:48:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:07 smithi186 ceph-mon[126480]: pgmap v19374: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 1.5 MiB/s wr, 13 op/s 2023-05-08T13:48:10.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36228.398188 secs 2023-05-08T13:48:10.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:09 smithi133 ceph-mon[125939]: pgmap v19375: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 1.5 MiB/s wr, 13 op/s 2023-05-08T13:48:10.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36228.398188 secs 2023-05-08T13:48:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:09 smithi096 ceph-mon[124666]: pgmap v19375: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 1.5 MiB/s wr, 13 op/s 2023-05-08T13:48:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36228.398188 secs 2023-05-08T13:48:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:09 smithi186 ceph-mon[126480]: pgmap v19375: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 1.5 MiB/s wr, 13 op/s 2023-05-08T13:48:12.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:11 smithi133 ceph-mon[125939]: pgmap v19376: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.7 MiB/s wr, 29 op/s 2023-05-08T13:48:12.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:11 smithi096 ceph-mon[124666]: pgmap v19376: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.7 MiB/s wr, 29 op/s 2023-05-08T13:48:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:11 smithi186 ceph-mon[126480]: pgmap v19376: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.7 MiB/s wr, 29 op/s 2023-05-08T13:48:13.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:13 smithi133 ceph-mon[125939]: pgmap v19377: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 475 KiB/s wr, 22 op/s 2023-05-08T13:48:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:13 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:48:14.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:13 smithi096 ceph-mon[124666]: pgmap v19377: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 475 KiB/s wr, 22 op/s 2023-05-08T13:48:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:13 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:48:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:13 smithi186 ceph-mon[126480]: pgmap v19377: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 475 KiB/s wr, 22 op/s 2023-05-08T13:48:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:13 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:48:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36233.398325 secs 2023-05-08T13:48:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:14 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:48:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:14 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:48:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:14 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:48:15.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36233.398325 secs 2023-05-08T13:48:15.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:14 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:48:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:14 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:48:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:14 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:48:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36233.398325 secs 2023-05-08T13:48:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:14 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:48:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:14 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:48:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:14 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:48:15.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:15 smithi133 ceph-mon[125939]: pgmap v19378: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 902 KiB/s wr, 26 op/s 2023-05-08T13:48:16.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:15 smithi096 ceph-mon[124666]: pgmap v19378: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 902 KiB/s wr, 26 op/s 2023-05-08T13:48:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:15 smithi186 ceph-mon[126480]: pgmap v19378: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 902 KiB/s wr, 26 op/s 2023-05-08T13:48:18.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:17 smithi133 ceph-mon[125939]: pgmap v19379: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 831 KiB/s rd, 724 KiB/s wr, 19 op/s 2023-05-08T13:48:18.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:17 smithi096 ceph-mon[124666]: pgmap v19379: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 831 KiB/s rd, 724 KiB/s wr, 19 op/s 2023-05-08T13:48:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:17 smithi186 ceph-mon[126480]: pgmap v19379: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 831 KiB/s rd, 724 KiB/s wr, 19 op/s 2023-05-08T13:48:20.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36238.398388 secs 2023-05-08T13:48:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:19 smithi133 ceph-mon[125939]: pgmap v19380: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 831 KiB/s rd, 724 KiB/s wr, 19 op/s 2023-05-08T13:48:20.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36238.398388 secs 2023-05-08T13:48:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:19 smithi096 ceph-mon[124666]: pgmap v19380: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 831 KiB/s rd, 724 KiB/s wr, 19 op/s 2023-05-08T13:48:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36238.398388 secs 2023-05-08T13:48:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:19 smithi186 ceph-mon[126480]: pgmap v19380: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 831 KiB/s rd, 724 KiB/s wr, 19 op/s 2023-05-08T13:48:22.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:21 smithi133 ceph-mon[125939]: pgmap v19381: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 24 op/s 2023-05-08T13:48:22.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:21 smithi096 ceph-mon[124666]: pgmap v19381: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 24 op/s 2023-05-08T13:48:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:21 smithi186 ceph-mon[126480]: pgmap v19381: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 24 op/s 2023-05-08T13:48:23.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:23 smithi133 ceph-mon[125939]: pgmap v19382: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 797 KiB/s rd, 761 KiB/s wr, 8 op/s 2023-05-08T13:48:24.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:23 smithi096 ceph-mon[124666]: pgmap v19382: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 797 KiB/s rd, 761 KiB/s wr, 8 op/s 2023-05-08T13:48:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:23 smithi186 ceph-mon[126480]: pgmap v19382: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 797 KiB/s rd, 761 KiB/s wr, 8 op/s 2023-05-08T13:48:24.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36243.398484 secs 2023-05-08T13:48:25.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36243.398484 secs 2023-05-08T13:48:25.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36243.398484 secs 2023-05-08T13:48:25.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:25 smithi133 ceph-mon[125939]: pgmap v19383: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 825 KiB/s rd, 761 KiB/s wr, 12 op/s 2023-05-08T13:48:26.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:25 smithi096 ceph-mon[124666]: pgmap v19383: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 825 KiB/s rd, 761 KiB/s wr, 12 op/s 2023-05-08T13:48:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:25 smithi186 ceph-mon[126480]: pgmap v19383: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 825 KiB/s rd, 761 KiB/s wr, 12 op/s 2023-05-08T13:48:28.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:27 smithi133 ceph-mon[125939]: pgmap v19384: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 333 KiB/s wr, 8 op/s 2023-05-08T13:48:28.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:27 smithi096 ceph-mon[124666]: pgmap v19384: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 333 KiB/s wr, 8 op/s 2023-05-08T13:48:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:27 smithi186 ceph-mon[126480]: pgmap v19384: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 333 KiB/s wr, 8 op/s 2023-05-08T13:48:30.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36248.398602 secs 2023-05-08T13:48:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:29 smithi133 ceph-mon[125939]: pgmap v19385: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 333 KiB/s wr, 8 op/s 2023-05-08T13:48:30.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36248.398602 secs 2023-05-08T13:48:30.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:29 smithi096 ceph-mon[124666]: pgmap v19385: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 333 KiB/s wr, 8 op/s 2023-05-08T13:48:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36248.398602 secs 2023-05-08T13:48:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:29 smithi186 ceph-mon[126480]: pgmap v19385: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 333 KiB/s wr, 8 op/s 2023-05-08T13:48:31.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36248.953288 secs 2023-05-08T13:48:31.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36248.953288 secs 2023-05-08T13:48:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36248.953288 secs 2023-05-08T13:48:32.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36250.277354 secs 2023-05-08T13:48:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:31 smithi133 ceph-mon[125939]: pgmap v19386: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 867 KiB/s rd, 886 KiB/s wr, 15 op/s 2023-05-08T13:48:32.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36250.277354 secs 2023-05-08T13:48:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:31 smithi096 ceph-mon[124666]: pgmap v19386: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 867 KiB/s rd, 886 KiB/s wr, 15 op/s 2023-05-08T13:48:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36250.277354 secs 2023-05-08T13:48:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:31 smithi186 ceph-mon[126480]: pgmap v19386: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 867 KiB/s rd, 886 KiB/s wr, 15 op/s 2023-05-08T13:48:33.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:33 smithi133 ceph-mon[125939]: pgmap v19387: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 559 KiB/s rd, 553 KiB/s wr, 10 op/s 2023-05-08T13:48:34.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:33 smithi096 ceph-mon[124666]: pgmap v19387: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 559 KiB/s rd, 553 KiB/s wr, 10 op/s 2023-05-08T13:48:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:33 smithi186 ceph-mon[126480]: pgmap v19387: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 559 KiB/s rd, 553 KiB/s wr, 10 op/s 2023-05-08T13:48:34.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36253.398709 secs 2023-05-08T13:48:34.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:34 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:48:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:34 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:48:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:34 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:48:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:34 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:48:35.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36253.398709 secs 2023-05-08T13:48:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:34 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:48:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:34 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:48:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:34 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:48:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:34 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:48:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36253.398709 secs 2023-05-08T13:48:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:34 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:48:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:34 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:48:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:34 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:48:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:34 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:48:35.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36253.953407 secs 2023-05-08T13:48:35.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:35 smithi133 ceph-mon[125939]: pgmap v19388: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 561 KiB/s rd, 554 KiB/s wr, 14 op/s 2023-05-08T13:48:36.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36253.953407 secs 2023-05-08T13:48:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:35 smithi096 ceph-mon[124666]: pgmap v19388: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 561 KiB/s rd, 554 KiB/s wr, 14 op/s 2023-05-08T13:48:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36253.953407 secs 2023-05-08T13:48:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:35 smithi186 ceph-mon[126480]: pgmap v19388: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 561 KiB/s rd, 554 KiB/s wr, 14 op/s 2023-05-08T13:48:36.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36255.277503 secs 2023-05-08T13:48:36.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:36 smithi133 ceph-mon[125939]: osdmap e1288: 12 total, 12 up, 12 in 2023-05-08T13:48:36.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:48:37.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36255.277503 secs 2023-05-08T13:48:37.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:36 smithi096 ceph-mon[124666]: osdmap e1288: 12 total, 12 up, 12 in 2023-05-08T13:48:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:48:37.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36255.277503 secs 2023-05-08T13:48:37.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:36 smithi186 ceph-mon[126480]: osdmap e1288: 12 total, 12 up, 12 in 2023-05-08T13:48:37.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:48:37.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:37 smithi133 ceph-mon[125939]: pgmap v19390: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 641 KiB/s rd, 690 KiB/s wr, 12 op/s 2023-05-08T13:48:37.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:37 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:48:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:37 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:48:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:37 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:48:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:37 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:48:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:37 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T13:48:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:37 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T13:48:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:37 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:48:38.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:37 smithi096 ceph-mon[124666]: pgmap v19390: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 641 KiB/s rd, 690 KiB/s wr, 12 op/s 2023-05-08T13:48:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:37 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:48:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:37 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:48:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:37 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:48:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:37 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:48:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:37 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T13:48:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:37 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T13:48:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:37 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:48:38.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:37 smithi186 ceph-mon[126480]: pgmap v19390: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 641 KiB/s rd, 690 KiB/s wr, 12 op/s 2023-05-08T13:48:38.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:37 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:48:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:37 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:48:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:37 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:48:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:37 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:48:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:37 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T13:48:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:37 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T13:48:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:37 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:48:40.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36258.398833 secs 2023-05-08T13:48:40.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:39 smithi133 ceph-mon[125939]: pgmap v19391: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 641 KiB/s rd, 690 KiB/s wr, 12 op/s 2023-05-08T13:48:40.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36258.398833 secs 2023-05-08T13:48:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:39 smithi096 ceph-mon[124666]: pgmap v19391: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 641 KiB/s rd, 690 KiB/s wr, 12 op/s 2023-05-08T13:48:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36258.398833 secs 2023-05-08T13:48:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:39 smithi186 ceph-mon[126480]: pgmap v19391: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 641 KiB/s rd, 690 KiB/s wr, 12 op/s 2023-05-08T13:48:41.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36258.953532 secs 2023-05-08T13:48:41.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36258.953532 secs 2023-05-08T13:48:41.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36258.953532 secs 2023-05-08T13:48:42.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36260.277601 secs 2023-05-08T13:48:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:41 smithi133 ceph-mon[125939]: pgmap v19392: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 591 KiB/s rd, 778 KiB/s wr, 10 op/s 2023-05-08T13:48:42.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36260.277601 secs 2023-05-08T13:48:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:41 smithi096 ceph-mon[124666]: pgmap v19392: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 591 KiB/s rd, 778 KiB/s wr, 10 op/s 2023-05-08T13:48:42.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36260.277601 secs 2023-05-08T13:48:42.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:41 smithi186 ceph-mon[126480]: pgmap v19392: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 591 KiB/s rd, 778 KiB/s wr, 10 op/s 2023-05-08T13:48:43.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:43 smithi133 ceph-mon[125939]: osdmap e1289: 12 total, 12 up, 12 in 2023-05-08T13:48:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:43 smithi133 ceph-mon[125939]: pgmap v19394: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 736 KiB/s rd, 971 KiB/s wr, 7 op/s 2023-05-08T13:48:44.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:43 smithi096 ceph-mon[124666]: osdmap e1289: 12 total, 12 up, 12 in 2023-05-08T13:48:44.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:43 smithi096 ceph-mon[124666]: pgmap v19394: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 736 KiB/s rd, 971 KiB/s wr, 7 op/s 2023-05-08T13:48:44.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:43 smithi186 ceph-mon[126480]: osdmap e1289: 12 total, 12 up, 12 in 2023-05-08T13:48:44.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:43 smithi186 ceph-mon[126480]: pgmap v19394: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 736 KiB/s rd, 971 KiB/s wr, 7 op/s 2023-05-08T13:48:44.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36263.398969 secs 2023-05-08T13:48:45.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36263.398969 secs 2023-05-08T13:48:45.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36263.398969 secs 2023-05-08T13:48:45.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36263.953686 secs 2023-05-08T13:48:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:45 smithi133 ceph-mon[125939]: pgmap v19395: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 642 KiB/s rd, 817 KiB/s wr, 9 op/s 2023-05-08T13:48:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36263.953686 secs 2023-05-08T13:48:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:45 smithi096 ceph-mon[124666]: pgmap v19395: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 642 KiB/s rd, 817 KiB/s wr, 9 op/s 2023-05-08T13:48:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36263.953686 secs 2023-05-08T13:48:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:45 smithi186 ceph-mon[126480]: pgmap v19395: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 642 KiB/s rd, 817 KiB/s wr, 9 op/s 2023-05-08T13:48:46.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36265.277722 secs 2023-05-08T13:48:47.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36265.277722 secs 2023-05-08T13:48:47.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36265.277722 secs 2023-05-08T13:48:47.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:47 smithi133 ceph-mon[125939]: pgmap v19396: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 962 KiB/s rd, 946 KiB/s wr, 10 op/s 2023-05-08T13:48:48.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:47 smithi096 ceph-mon[124666]: pgmap v19396: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 962 KiB/s rd, 946 KiB/s wr, 10 op/s 2023-05-08T13:48:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:47 smithi186 ceph-mon[126480]: pgmap v19396: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 962 KiB/s rd, 946 KiB/s wr, 10 op/s 2023-05-08T13:48:50.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36268.399086 secs 2023-05-08T13:48:50.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:49 smithi133 ceph-mon[125939]: pgmap v19397: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 962 KiB/s rd, 946 KiB/s wr, 10 op/s 2023-05-08T13:48:50.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36268.399086 secs 2023-05-08T13:48:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:49 smithi096 ceph-mon[124666]: pgmap v19397: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 962 KiB/s rd, 946 KiB/s wr, 10 op/s 2023-05-08T13:48:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36268.399086 secs 2023-05-08T13:48:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:49 smithi186 ceph-mon[126480]: pgmap v19397: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 962 KiB/s rd, 946 KiB/s wr, 10 op/s 2023-05-08T13:48:51.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36268.953798 secs 2023-05-08T13:48:51.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36268.953798 secs 2023-05-08T13:48:51.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36268.953798 secs 2023-05-08T13:48:52.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36270.277847 secs 2023-05-08T13:48:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:51 smithi133 ceph-mon[125939]: pgmap v19398: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 195 KiB/s wr, 8 op/s 2023-05-08T13:48:52.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36270.277847 secs 2023-05-08T13:48:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:51 smithi096 ceph-mon[124666]: pgmap v19398: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 195 KiB/s wr, 8 op/s 2023-05-08T13:48:52.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36270.277847 secs 2023-05-08T13:48:52.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:51 smithi186 ceph-mon[126480]: pgmap v19398: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 195 KiB/s wr, 8 op/s 2023-05-08T13:48:53.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:53 smithi133 ceph-mon[125939]: pgmap v19399: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 191 KiB/s wr, 8 op/s 2023-05-08T13:48:54.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:53 smithi096 ceph-mon[124666]: pgmap v19399: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 191 KiB/s wr, 8 op/s 2023-05-08T13:48:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:53 smithi186 ceph-mon[126480]: pgmap v19399: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 191 KiB/s wr, 8 op/s 2023-05-08T13:48:54.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36273.399180 secs 2023-05-08T13:48:55.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36273.399180 secs 2023-05-08T13:48:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36273.399180 secs 2023-05-08T13:48:55.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:55 smithi133 ceph-mon[125939]: pgmap v19400: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 987 KiB/s rd, 802 KiB/s wr, 10 op/s 2023-05-08T13:48:56.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:55 smithi096 ceph-mon[124666]: pgmap v19400: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 987 KiB/s rd, 802 KiB/s wr, 10 op/s 2023-05-08T13:48:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:55 smithi186 ceph-mon[126480]: pgmap v19400: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 987 KiB/s rd, 802 KiB/s wr, 10 op/s 2023-05-08T13:48:56.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36275.277988 secs 2023-05-08T13:48:57.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36275.277988 secs 2023-05-08T13:48:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36275.277988 secs 2023-05-08T13:48:57.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:57 smithi133 ceph-mon[125939]: pgmap v19401: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 991 KiB/s rd, 802 KiB/s wr, 8 op/s 2023-05-08T13:48:57.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:48:58.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:57 smithi096 ceph-mon[124666]: pgmap v19401: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 991 KiB/s rd, 802 KiB/s wr, 8 op/s 2023-05-08T13:48:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:48:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:57 smithi186 ceph-mon[126480]: pgmap v19401: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 991 KiB/s rd, 802 KiB/s wr, 8 op/s 2023-05-08T13:48:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:48:58.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:58 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:48:58.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:48:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:48:59.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:58 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:48:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:48:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:48:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:58 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:48:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:48:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:48:59.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36278.399321 secs 2023-05-08T13:48:59.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:48:59 smithi133 ceph-mon[125939]: pgmap v19402: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 682 KiB/s rd, 640 KiB/s wr, 7 op/s 2023-05-08T13:49:00.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36278.399321 secs 2023-05-08T13:49:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:48:59 smithi096 ceph-mon[124666]: pgmap v19402: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 682 KiB/s rd, 640 KiB/s wr, 7 op/s 2023-05-08T13:49:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36278.399321 secs 2023-05-08T13:49:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:48:59 smithi186 ceph-mon[126480]: pgmap v19402: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 682 KiB/s rd, 640 KiB/s wr, 7 op/s 2023-05-08T13:49:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:00 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:49:01.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:00 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:49:01.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:00 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:49:02.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:01 smithi133 ceph-mon[125939]: pgmap v19403: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2023-05-08T13:49:02.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:49:02.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:49:02.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:01 smithi096 ceph-mon[124666]: pgmap v19403: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2023-05-08T13:49:02.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:49:02.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:49:02.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:01 smithi186 ceph-mon[126480]: pgmap v19403: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2023-05-08T13:49:02.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:49:02.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:49:03.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:03 smithi133 ceph-mon[125939]: pgmap v19404: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 10 op/s 2023-05-08T13:49:04.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:03 smithi096 ceph-mon[124666]: pgmap v19404: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 10 op/s 2023-05-08T13:49:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:03 smithi186 ceph-mon[126480]: pgmap v19404: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 10 op/s 2023-05-08T13:49:04.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36283.399437 secs 2023-05-08T13:49:05.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36283.399437 secs 2023-05-08T13:49:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36283.399437 secs 2023-05-08T13:49:05.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36283.954111 secs 2023-05-08T13:49:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:05 smithi133 ceph-mon[125939]: pgmap v19405: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.9 MiB/s wr, 28 op/s 2023-05-08T13:49:06.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36283.954111 secs 2023-05-08T13:49:06.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:05 smithi096 ceph-mon[124666]: pgmap v19405: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.9 MiB/s wr, 28 op/s 2023-05-08T13:49:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36283.954111 secs 2023-05-08T13:49:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:05 smithi186 ceph-mon[126480]: pgmap v19405: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.9 MiB/s wr, 28 op/s 2023-05-08T13:49:06.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:06 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:49:06.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:49:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:49:07.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:06 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:49:07.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:49:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:49:07.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:06 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:49:07.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:49:07.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:49:07.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:07 smithi133 ceph-mon[125939]: pgmap v19406: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 24 op/s 2023-05-08T13:49:08.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:07 smithi096 ceph-mon[124666]: pgmap v19406: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 24 op/s 2023-05-08T13:49:08.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:07 smithi186 ceph-mon[126480]: pgmap v19406: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 24 op/s 2023-05-08T13:49:10.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36288.399510 secs 2023-05-08T13:49:10.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:09 smithi133 ceph-mon[125939]: pgmap v19407: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 24 op/s 2023-05-08T13:49:10.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36288.399510 secs 2023-05-08T13:49:10.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:09 smithi096 ceph-mon[124666]: pgmap v19407: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 24 op/s 2023-05-08T13:49:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36288.399510 secs 2023-05-08T13:49:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:09 smithi186 ceph-mon[126480]: pgmap v19407: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 24 op/s 2023-05-08T13:49:11.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36288.954229 secs 2023-05-08T13:49:11.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36288.954229 secs 2023-05-08T13:49:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36288.954229 secs 2023-05-08T13:49:12.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:11 smithi133 ceph-mon[125939]: pgmap v19408: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 28 op/s 2023-05-08T13:49:12.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:11 smithi096 ceph-mon[124666]: pgmap v19408: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 28 op/s 2023-05-08T13:49:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:11 smithi186 ceph-mon[126480]: pgmap v19408: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 28 op/s 2023-05-08T13:49:13.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:13 smithi133 ceph-mon[125939]: pgmap v19409: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 590 KiB/s rd, 603 KiB/s wr, 22 op/s 2023-05-08T13:49:14.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:13 smithi096 ceph-mon[124666]: pgmap v19409: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 590 KiB/s rd, 603 KiB/s wr, 22 op/s 2023-05-08T13:49:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:13 smithi186 ceph-mon[126480]: pgmap v19409: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 590 KiB/s rd, 603 KiB/s wr, 22 op/s 2023-05-08T13:49:14.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36293.399629 secs 2023-05-08T13:49:15.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36293.399629 secs 2023-05-08T13:49:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36293.399629 secs 2023-05-08T13:49:15.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36293.954316 secs 2023-05-08T13:49:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:15 smithi133 ceph-mon[125939]: pgmap v19410: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 26 op/s 2023-05-08T13:49:16.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36293.954316 secs 2023-05-08T13:49:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:15 smithi096 ceph-mon[124666]: pgmap v19410: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 26 op/s 2023-05-08T13:49:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36293.954316 secs 2023-05-08T13:49:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:15 smithi186 ceph-mon[126480]: pgmap v19410: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 26 op/s 2023-05-08T13:49:18.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:17 smithi133 ceph-mon[125939]: pgmap v19411: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 489 KiB/s rd, 487 KiB/s wr, 8 op/s 2023-05-08T13:49:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:17 smithi096 ceph-mon[124666]: pgmap v19411: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 489 KiB/s rd, 487 KiB/s wr, 8 op/s 2023-05-08T13:49:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:17 smithi186 ceph-mon[126480]: pgmap v19411: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 489 KiB/s rd, 487 KiB/s wr, 8 op/s 2023-05-08T13:49:20.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36298.399701 secs 2023-05-08T13:49:20.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:19 smithi133 ceph-mon[125939]: pgmap v19412: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 489 KiB/s rd, 487 KiB/s wr, 8 op/s 2023-05-08T13:49:20.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36298.399701 secs 2023-05-08T13:49:20.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:19 smithi096 ceph-mon[124666]: pgmap v19412: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 489 KiB/s rd, 487 KiB/s wr, 8 op/s 2023-05-08T13:49:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36298.399701 secs 2023-05-08T13:49:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:19 smithi186 ceph-mon[126480]: pgmap v19412: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 489 KiB/s rd, 487 KiB/s wr, 8 op/s 2023-05-08T13:49:21.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36298.954447 secs 2023-05-08T13:49:21.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36298.954447 secs 2023-05-08T13:49:21.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36298.954447 secs 2023-05-08T13:49:22.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:21 smithi133 ceph-mon[125939]: pgmap v19413: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 491 KiB/s rd, 829 KiB/s wr, 11 op/s 2023-05-08T13:49:22.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:21 smithi096 ceph-mon[124666]: pgmap v19413: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 491 KiB/s rd, 829 KiB/s wr, 11 op/s 2023-05-08T13:49:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:21 smithi186 ceph-mon[126480]: pgmap v19413: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 491 KiB/s rd, 829 KiB/s wr, 11 op/s 2023-05-08T13:49:23.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:23 smithi133 ceph-mon[125939]: pgmap v19414: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 487 KiB/s rd, 826 KiB/s wr, 7 op/s 2023-05-08T13:49:24.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:23 smithi096 ceph-mon[124666]: pgmap v19414: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 487 KiB/s rd, 826 KiB/s wr, 7 op/s 2023-05-08T13:49:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:23 smithi186 ceph-mon[126480]: pgmap v19414: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 487 KiB/s rd, 826 KiB/s wr, 7 op/s 2023-05-08T13:49:24.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36303.399838 secs 2023-05-08T13:49:25.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36303.399838 secs 2023-05-08T13:49:25.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36303.399838 secs 2023-05-08T13:49:25.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:25 smithi133 ceph-mon[125939]: pgmap v19415: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 831 KiB/s rd, 1.2 MiB/s wr, 14 op/s 2023-05-08T13:49:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:25 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:49:26.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:25 smithi096 ceph-mon[124666]: pgmap v19415: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 831 KiB/s rd, 1.2 MiB/s wr, 14 op/s 2023-05-08T13:49:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:25 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:49:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:25 smithi186 ceph-mon[126480]: pgmap v19415: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 831 KiB/s rd, 1.2 MiB/s wr, 14 op/s 2023-05-08T13:49:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:25 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:49:26.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36305.278707 secs 2023-05-08T13:49:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:26 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:49:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:26 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:49:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:26 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:49:27.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36305.278707 secs 2023-05-08T13:49:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:26 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:49:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:26 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:49:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:26 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:49:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36305.278707 secs 2023-05-08T13:49:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:26 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:49:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:26 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:49:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:26 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:49:27.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:27 smithi133 ceph-mon[125939]: pgmap v19416: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 706 KiB/s wr, 10 op/s 2023-05-08T13:49:28.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:27 smithi096 ceph-mon[124666]: pgmap v19416: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 706 KiB/s wr, 10 op/s 2023-05-08T13:49:28.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:27 smithi186 ceph-mon[126480]: pgmap v19416: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 706 KiB/s wr, 10 op/s 2023-05-08T13:49:30.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36308.399948 secs 2023-05-08T13:49:30.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:29 smithi133 ceph-mon[125939]: pgmap v19417: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 706 KiB/s wr, 10 op/s 2023-05-08T13:49:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:29 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:49:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:29 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:49:30.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36308.399948 secs 2023-05-08T13:49:30.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:29 smithi096 ceph-mon[124666]: pgmap v19417: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 706 KiB/s wr, 10 op/s 2023-05-08T13:49:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:29 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:49:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:29 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:49:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36308.399948 secs 2023-05-08T13:49:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:29 smithi186 ceph-mon[126480]: pgmap v19417: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 706 KiB/s wr, 10 op/s 2023-05-08T13:49:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:29 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:49:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:29 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:49:32.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36310.278826 secs 2023-05-08T13:49:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:31 smithi133 ceph-mon[125939]: pgmap v19418: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 717 KiB/s rd, 735 KiB/s wr, 14 op/s 2023-05-08T13:49:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:31 smithi133 ceph-mon[125939]: osdmap e1290: 12 total, 12 up, 12 in 2023-05-08T13:49:32.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36310.278826 secs 2023-05-08T13:49:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:31 smithi096 ceph-mon[124666]: pgmap v19418: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 717 KiB/s rd, 735 KiB/s wr, 14 op/s 2023-05-08T13:49:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:31 smithi096 ceph-mon[124666]: osdmap e1290: 12 total, 12 up, 12 in 2023-05-08T13:49:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36310.278826 secs 2023-05-08T13:49:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:31 smithi186 ceph-mon[126480]: pgmap v19418: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 717 KiB/s rd, 735 KiB/s wr, 14 op/s 2023-05-08T13:49:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:31 smithi186 ceph-mon[126480]: osdmap e1290: 12 total, 12 up, 12 in 2023-05-08T13:49:33.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:32 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:49:33.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:32 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:49:33.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:32 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:49:34.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:33 smithi096 ceph-mon[124666]: pgmap v19420: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 858 KiB/s rd, 472 KiB/s wr, 12 op/s 2023-05-08T13:49:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:33 smithi186 ceph-mon[126480]: pgmap v19420: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 858 KiB/s rd, 472 KiB/s wr, 12 op/s 2023-05-08T13:49:34.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:33 smithi133 ceph-mon[125939]: pgmap v19420: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 858 KiB/s rd, 472 KiB/s wr, 12 op/s 2023-05-08T13:49:35.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36313.400081 secs 2023-05-08T13:49:35.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36313.400081 secs 2023-05-08T13:49:35.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36313.400081 secs 2023-05-08T13:49:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:36 smithi186 ceph-mon[126480]: pgmap v19421: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 215 KiB/s wr, 9 op/s 2023-05-08T13:49:36.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:36 smithi133 ceph-mon[125939]: pgmap v19421: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 215 KiB/s wr, 9 op/s 2023-05-08T13:49:36.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:36 smithi096 ceph-mon[124666]: pgmap v19421: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 215 KiB/s wr, 9 op/s 2023-05-08T13:49:37.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:37 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36315.278937 secs 2023-05-08T13:49:37.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:37 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36315.278937 secs 2023-05-08T13:49:37.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:37 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36315.278937 secs 2023-05-08T13:49:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:38 smithi186 ceph-mon[126480]: pgmap v19422: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 215 KiB/s wr, 8 op/s 2023-05-08T13:49:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:49:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:49:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:49:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:49:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:49:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:38 smithi186 ceph-mon[126480]: osdmap e1291: 12 total, 12 up, 12 in 2023-05-08T13:49:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:49:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:49:38.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:38 smithi133 ceph-mon[125939]: pgmap v19422: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 215 KiB/s wr, 8 op/s 2023-05-08T13:49:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:49:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:49:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:49:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:49:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:49:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:38 smithi133 ceph-mon[125939]: osdmap e1291: 12 total, 12 up, 12 in 2023-05-08T13:49:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:49:38.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:49:38.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:38 smithi096 ceph-mon[124666]: pgmap v19422: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 215 KiB/s wr, 8 op/s 2023-05-08T13:49:38.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:49:38.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:49:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:49:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:49:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:49:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:38 smithi096 ceph-mon[124666]: osdmap e1291: 12 total, 12 up, 12 in 2023-05-08T13:49:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:49:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:49:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:49:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:49:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:49:39.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:49:39.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:49:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:49:39.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:49:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:49:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:49:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:40 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:49:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:40 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T13:49:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:40 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T13:49:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:40 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:49:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36318.400229 secs 2023-05-08T13:49:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:40 smithi186 ceph-mon[126480]: pgmap v19424: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 225 KiB/s wr, 5 op/s 2023-05-08T13:49:40.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:40 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:49:40.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:40 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T13:49:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:40 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T13:49:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:40 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:49:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36318.400229 secs 2023-05-08T13:49:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:40 smithi133 ceph-mon[125939]: pgmap v19424: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 225 KiB/s wr, 5 op/s 2023-05-08T13:49:40.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:40 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:49:40.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:40 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T13:49:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:40 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T13:49:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:40 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:49:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36318.400229 secs 2023-05-08T13:49:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:40 smithi096 ceph-mon[124666]: pgmap v19424: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 225 KiB/s wr, 5 op/s 2023-05-08T13:49:42.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:42 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36320.279017 secs 2023-05-08T13:49:42.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:42 smithi186 ceph-mon[126480]: pgmap v19425: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 746 KiB/s rd, 467 KiB/s wr, 9 op/s 2023-05-08T13:49:42.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:42 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36320.279017 secs 2023-05-08T13:49:42.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:42 smithi133 ceph-mon[125939]: pgmap v19425: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 746 KiB/s rd, 467 KiB/s wr, 9 op/s 2023-05-08T13:49:42.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:42 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36320.279017 secs 2023-05-08T13:49:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:42 smithi096 ceph-mon[124666]: pgmap v19425: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 746 KiB/s rd, 467 KiB/s wr, 9 op/s 2023-05-08T13:49:43.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:43 smithi133 ceph-mon[125939]: pgmap v19426: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 740 KiB/s rd, 463 KiB/s wr, 9 op/s 2023-05-08T13:49:44.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:43 smithi096 ceph-mon[124666]: pgmap v19426: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 740 KiB/s rd, 463 KiB/s wr, 9 op/s 2023-05-08T13:49:44.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:43 smithi186 ceph-mon[126480]: pgmap v19426: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 740 KiB/s rd, 463 KiB/s wr, 9 op/s 2023-05-08T13:49:44.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36323.400363 secs 2023-05-08T13:49:45.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36323.400363 secs 2023-05-08T13:49:45.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36323.400363 secs 2023-05-08T13:49:45.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36323.955044 secs 2023-05-08T13:49:45.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:45 smithi133 ceph-mon[125939]: pgmap v19427: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 10 op/s 2023-05-08T13:49:46.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36323.955044 secs 2023-05-08T13:49:46.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:45 smithi096 ceph-mon[124666]: pgmap v19427: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 10 op/s 2023-05-08T13:49:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36323.955044 secs 2023-05-08T13:49:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:45 smithi186 ceph-mon[126480]: pgmap v19427: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 10 op/s 2023-05-08T13:49:46.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36325.279093 secs 2023-05-08T13:49:46.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:46 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:49:46.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:46 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:49:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:46 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:49:47.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36325.279093 secs 2023-05-08T13:49:47.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:46 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:49:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:46 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:49:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:46 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:49:47.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36325.279093 secs 2023-05-08T13:49:47.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:46 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:49:47.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:46 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:49:47.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:46 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:49:47.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:47 smithi133 ceph-mon[125939]: pgmap v19428: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 10 op/s 2023-05-08T13:49:48.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:47 smithi096 ceph-mon[124666]: pgmap v19428: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 10 op/s 2023-05-08T13:49:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:47 smithi186 ceph-mon[126480]: pgmap v19428: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 10 op/s 2023-05-08T13:49:50.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36328.400475 secs 2023-05-08T13:49:50.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:49 smithi133 ceph-mon[125939]: pgmap v19429: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.3 MiB/s wr, 9 op/s 2023-05-08T13:49:50.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36328.400475 secs 2023-05-08T13:49:50.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:49 smithi096 ceph-mon[124666]: pgmap v19429: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.3 MiB/s wr, 9 op/s 2023-05-08T13:49:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36328.400475 secs 2023-05-08T13:49:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:49 smithi186 ceph-mon[126480]: pgmap v19429: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.3 MiB/s wr, 9 op/s 2023-05-08T13:49:52.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36330.279208 secs 2023-05-08T13:49:52.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:51 smithi133 ceph-mon[125939]: pgmap v19430: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.5 MiB/s wr, 15 op/s 2023-05-08T13:49:52.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36330.279208 secs 2023-05-08T13:49:52.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:51 smithi096 ceph-mon[124666]: pgmap v19430: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.5 MiB/s wr, 15 op/s 2023-05-08T13:49:52.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36330.279208 secs 2023-05-08T13:49:52.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:51 smithi186 ceph-mon[126480]: pgmap v19430: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.5 MiB/s wr, 15 op/s 2023-05-08T13:49:53.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:53 smithi133 ceph-mon[125939]: pgmap v19431: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 11 op/s 2023-05-08T13:49:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:53 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:49:54.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:53 smithi096 ceph-mon[124666]: pgmap v19431: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 11 op/s 2023-05-08T13:49:54.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:53 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:49:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:53 smithi186 ceph-mon[126480]: pgmap v19431: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 11 op/s 2023-05-08T13:49:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:53 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:49:54.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36333.400584 secs 2023-05-08T13:49:54.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:54 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:49:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:54 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:49:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:54 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:49:55.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36333.400584 secs 2023-05-08T13:49:55.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:54 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:49:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:54 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:49:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:54 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:49:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36333.400584 secs 2023-05-08T13:49:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:54 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:49:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:54 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:49:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:54 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:49:55.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:55 smithi133 ceph-mon[125939]: pgmap v19432: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.7 MiB/s wr, 17 op/s 2023-05-08T13:49:56.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:55 smithi096 ceph-mon[124666]: pgmap v19432: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.7 MiB/s wr, 17 op/s 2023-05-08T13:49:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:55 smithi186 ceph-mon[126480]: pgmap v19432: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.7 MiB/s wr, 17 op/s 2023-05-08T13:49:57.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:56 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:49:57.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:56 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:49:57.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:56 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:49:58.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:57 smithi133 ceph-mon[125939]: pgmap v19433: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.8 MiB/s wr, 12 op/s 2023-05-08T13:49:58.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:57 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:49:58.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:57 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:49:58.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:57 smithi096 ceph-mon[124666]: pgmap v19433: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.8 MiB/s wr, 12 op/s 2023-05-08T13:49:58.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:57 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:49:58.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:57 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:49:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:57 smithi186 ceph-mon[126480]: pgmap v19433: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.8 MiB/s wr, 12 op/s 2023-05-08T13:49:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:57 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:49:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:57 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:50:00.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36338.400719 secs 2023-05-08T13:50:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:49:59 smithi096 ceph-mon[124666]: pgmap v19434: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.8 MiB/s wr, 12 op/s 2023-05-08T13:50:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36338.400719 secs 2023-05-08T13:50:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:49:59 smithi186 ceph-mon[126480]: pgmap v19434: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.8 MiB/s wr, 12 op/s 2023-05-08T13:50:00.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36338.400719 secs 2023-05-08T13:50:00.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:49:59 smithi133 ceph-mon[125939]: pgmap v19434: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.8 MiB/s wr, 12 op/s 2023-05-08T13:50:01.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36338.955363 secs 2023-05-08T13:50:01.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:00 smithi096 ceph-mon[124666]: overall HEALTH_WARN 1 MDSs report slow requests 2023-05-08T13:50:01.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36338.955363 secs 2023-05-08T13:50:01.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:00 smithi186 ceph-mon[126480]: overall HEALTH_WARN 1 MDSs report slow requests 2023-05-08T13:50:01.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36338.955363 secs 2023-05-08T13:50:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:00 smithi133 ceph-mon[125939]: overall HEALTH_WARN 1 MDSs report slow requests 2023-05-08T13:50:02.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:01 smithi096 ceph-mon[124666]: pgmap v19435: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.3 MiB/s wr, 17 op/s 2023-05-08T13:50:02.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:01 smithi186 ceph-mon[126480]: pgmap v19435: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.3 MiB/s wr, 17 op/s 2023-05-08T13:50:02.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:01 smithi133 ceph-mon[125939]: pgmap v19435: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.3 MiB/s wr, 17 op/s 2023-05-08T13:50:03.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:02 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:50:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:50:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:50:03.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:03 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:50:03.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:50:03.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:03 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:50:03.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:03 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:50:03.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:50:03.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:03 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:50:04.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:04 smithi096 ceph-mon[124666]: pgmap v19436: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T13:50:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:04 smithi186 ceph-mon[126480]: pgmap v19436: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T13:50:04.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:04 smithi133 ceph-mon[125939]: pgmap v19436: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T13:50:05.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36343.400785 secs 2023-05-08T13:50:05.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36343.400785 secs 2023-05-08T13:50:05.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36343.400785 secs 2023-05-08T13:50:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:06 smithi186 ceph-mon[126480]: pgmap v19437: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 1.7 MiB/s wr, 28 op/s 2023-05-08T13:50:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:06 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:50:06.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:06 smithi133 ceph-mon[125939]: pgmap v19437: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 1.7 MiB/s wr, 28 op/s 2023-05-08T13:50:06.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:06 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:50:06.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:06 smithi096 ceph-mon[124666]: pgmap v19437: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 1.7 MiB/s wr, 28 op/s 2023-05-08T13:50:06.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:06 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:50:07.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:07 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:50:07.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:07 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:50:07.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:07 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:50:07.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:07 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:50:07.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:07 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:50:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:07 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:50:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:08 smithi186 ceph-mon[126480]: pgmap v19438: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.5 MiB/s wr, 22 op/s 2023-05-08T13:50:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:08 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:50:08.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:08 smithi133 ceph-mon[125939]: pgmap v19438: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.5 MiB/s wr, 22 op/s 2023-05-08T13:50:08.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:08 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:50:08.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:08 smithi096 ceph-mon[124666]: pgmap v19438: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.5 MiB/s wr, 22 op/s 2023-05-08T13:50:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:08 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:50:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36348.400934 secs 2023-05-08T13:50:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:10 smithi186 ceph-mon[126480]: pgmap v19439: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.5 MiB/s wr, 22 op/s 2023-05-08T13:50:10.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36348.400934 secs 2023-05-08T13:50:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:10 smithi133 ceph-mon[125939]: pgmap v19439: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.5 MiB/s wr, 22 op/s 2023-05-08T13:50:10.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36348.400934 secs 2023-05-08T13:50:10.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:10 smithi096 ceph-mon[124666]: pgmap v19439: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.5 MiB/s wr, 22 op/s 2023-05-08T13:50:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:12 smithi186 ceph-mon[126480]: pgmap v19440: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.0 MiB/s wr, 27 op/s 2023-05-08T13:50:12.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:12 smithi133 ceph-mon[125939]: pgmap v19440: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.0 MiB/s wr, 27 op/s 2023-05-08T13:50:12.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:12 smithi096 ceph-mon[124666]: pgmap v19440: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.0 MiB/s wr, 27 op/s 2023-05-08T13:50:13.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:13 smithi133 ceph-mon[125939]: pgmap v19441: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 22 op/s 2023-05-08T13:50:14.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:13 smithi096 ceph-mon[124666]: pgmap v19441: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 22 op/s 2023-05-08T13:50:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:13 smithi186 ceph-mon[126480]: pgmap v19441: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 22 op/s 2023-05-08T13:50:14.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36353.401049 secs 2023-05-08T13:50:15.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36353.401049 secs 2023-05-08T13:50:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36353.401049 secs 2023-05-08T13:50:15.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:15 smithi133 ceph-mon[125939]: pgmap v19442: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 25 op/s 2023-05-08T13:50:16.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:15 smithi096 ceph-mon[124666]: pgmap v19442: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 25 op/s 2023-05-08T13:50:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:15 smithi186 ceph-mon[126480]: pgmap v19442: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 25 op/s 2023-05-08T13:50:18.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:17 smithi133 ceph-mon[125939]: pgmap v19443: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 987 KiB/s rd, 839 KiB/s wr, 8 op/s 2023-05-08T13:50:18.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:17 smithi096 ceph-mon[124666]: pgmap v19443: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 987 KiB/s rd, 839 KiB/s wr, 8 op/s 2023-05-08T13:50:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:17 smithi186 ceph-mon[126480]: pgmap v19443: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 987 KiB/s rd, 839 KiB/s wr, 8 op/s 2023-05-08T13:50:20.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36358.401191 secs 2023-05-08T13:50:20.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:19 smithi133 ceph-mon[125939]: pgmap v19444: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 645 KiB/s rd, 498 KiB/s wr, 7 op/s 2023-05-08T13:50:20.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36358.401191 secs 2023-05-08T13:50:20.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:19 smithi096 ceph-mon[124666]: pgmap v19444: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 645 KiB/s rd, 498 KiB/s wr, 7 op/s 2023-05-08T13:50:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36358.401191 secs 2023-05-08T13:50:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:19 smithi186 ceph-mon[126480]: pgmap v19444: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 645 KiB/s rd, 498 KiB/s wr, 7 op/s 2023-05-08T13:50:21.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:21 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:50:21.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:21 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:50:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:21 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:50:21.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:21 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:50:21.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:21 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:50:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:21 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:50:21.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:21 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:50:21.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:21 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:50:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:21 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:50:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:22 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36360.279850 secs 2023-05-08T13:50:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:22 smithi186 ceph-mon[126480]: pgmap v19445: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 673 KiB/s rd, 524 KiB/s wr, 10 op/s 2023-05-08T13:50:22.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:22 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36360.279850 secs 2023-05-08T13:50:22.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:22 smithi133 ceph-mon[125939]: pgmap v19445: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 673 KiB/s rd, 524 KiB/s wr, 10 op/s 2023-05-08T13:50:22.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:22 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36360.279850 secs 2023-05-08T13:50:22.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:22 smithi096 ceph-mon[124666]: pgmap v19445: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 673 KiB/s rd, 524 KiB/s wr, 10 op/s 2023-05-08T13:50:23.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:23 smithi133 ceph-mon[125939]: pgmap v19446: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 6 op/s 2023-05-08T13:50:24.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:23 smithi096 ceph-mon[124666]: pgmap v19446: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 6 op/s 2023-05-08T13:50:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:23 smithi186 ceph-mon[126480]: pgmap v19446: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 6 op/s 2023-05-08T13:50:24.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36363.401356 secs 2023-05-08T13:50:25.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36363.401356 secs 2023-05-08T13:50:25.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36363.401356 secs 2023-05-08T13:50:25.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36363.956000 secs 2023-05-08T13:50:25.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:25 smithi133 ceph-mon[125939]: pgmap v19447: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 407 KiB/s rd, 425 KiB/s wr, 12 op/s 2023-05-08T13:50:26.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36363.956000 secs 2023-05-08T13:50:26.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:25 smithi096 ceph-mon[124666]: pgmap v19447: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 407 KiB/s rd, 425 KiB/s wr, 12 op/s 2023-05-08T13:50:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36363.956000 secs 2023-05-08T13:50:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:25 smithi186 ceph-mon[126480]: pgmap v19447: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 407 KiB/s rd, 425 KiB/s wr, 12 op/s 2023-05-08T13:50:26.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36365.279912 secs 2023-05-08T13:50:26.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:26 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:50:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:26 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:50:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:26 smithi133 ceph-mon[125939]: osdmap e1292: 12 total, 12 up, 12 in 2023-05-08T13:50:27.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36365.279912 secs 2023-05-08T13:50:27.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:26 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:50:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:26 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:50:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:26 smithi096 ceph-mon[124666]: osdmap e1292: 12 total, 12 up, 12 in 2023-05-08T13:50:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36365.279912 secs 2023-05-08T13:50:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:26 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:50:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:26 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:50:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:26 smithi186 ceph-mon[126480]: osdmap e1292: 12 total, 12 up, 12 in 2023-05-08T13:50:27.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:27 smithi133 ceph-mon[125939]: pgmap v19449: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 487 KiB/s rd, 510 KiB/s wr, 12 op/s 2023-05-08T13:50:27.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:27 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:50:28.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:27 smithi096 ceph-mon[124666]: pgmap v19449: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 487 KiB/s rd, 510 KiB/s wr, 12 op/s 2023-05-08T13:50:28.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:27 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:50:28.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:27 smithi186 ceph-mon[126480]: pgmap v19449: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 487 KiB/s rd, 510 KiB/s wr, 12 op/s 2023-05-08T13:50:28.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:27 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:50:30.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36368.401454 secs 2023-05-08T13:50:30.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:29 smithi133 ceph-mon[125939]: pgmap v19450: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 487 KiB/s rd, 510 KiB/s wr, 12 op/s 2023-05-08T13:50:30.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36368.401454 secs 2023-05-08T13:50:30.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:29 smithi096 ceph-mon[124666]: pgmap v19450: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 487 KiB/s rd, 510 KiB/s wr, 12 op/s 2023-05-08T13:50:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36368.401454 secs 2023-05-08T13:50:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:29 smithi186 ceph-mon[126480]: pgmap v19450: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 487 KiB/s rd, 510 KiB/s wr, 12 op/s 2023-05-08T13:50:31.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36368.956117 secs 2023-05-08T13:50:31.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36368.956117 secs 2023-05-08T13:50:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36368.956117 secs 2023-05-08T13:50:32.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36370.280030 secs 2023-05-08T13:50:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:31 smithi133 ceph-mon[125939]: pgmap v19451: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 699 KiB/s rd, 722 KiB/s wr, 13 op/s 2023-05-08T13:50:32.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36370.280030 secs 2023-05-08T13:50:32.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:31 smithi096 ceph-mon[124666]: pgmap v19451: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 699 KiB/s rd, 722 KiB/s wr, 13 op/s 2023-05-08T13:50:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36370.280030 secs 2023-05-08T13:50:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:31 smithi186 ceph-mon[126480]: pgmap v19451: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 699 KiB/s rd, 722 KiB/s wr, 13 op/s 2023-05-08T13:50:33.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:33 smithi133 ceph-mon[125939]: osdmap e1293: 12 total, 12 up, 12 in 2023-05-08T13:50:33.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:33 smithi133 ceph-mon[125939]: pgmap v19453: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 305 KiB/s wr, 6 op/s 2023-05-08T13:50:34.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:33 smithi096 ceph-mon[124666]: osdmap e1293: 12 total, 12 up, 12 in 2023-05-08T13:50:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:33 smithi096 ceph-mon[124666]: pgmap v19453: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 305 KiB/s wr, 6 op/s 2023-05-08T13:50:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:33 smithi186 ceph-mon[126480]: osdmap e1293: 12 total, 12 up, 12 in 2023-05-08T13:50:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:33 smithi186 ceph-mon[126480]: pgmap v19453: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 305 KiB/s wr, 6 op/s 2023-05-08T13:50:34.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36373.401553 secs 2023-05-08T13:50:35.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36373.401553 secs 2023-05-08T13:50:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36373.401553 secs 2023-05-08T13:50:35.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36373.956252 secs 2023-05-08T13:50:35.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:35 smithi133 ceph-mon[125939]: pgmap v19454: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 677 KiB/s wr, 10 op/s 2023-05-08T13:50:36.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36373.956252 secs 2023-05-08T13:50:36.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:35 smithi096 ceph-mon[124666]: pgmap v19454: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 677 KiB/s wr, 10 op/s 2023-05-08T13:50:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36373.956252 secs 2023-05-08T13:50:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:35 smithi186 ceph-mon[126480]: pgmap v19454: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 677 KiB/s wr, 10 op/s 2023-05-08T13:50:36.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36375.280169 secs 2023-05-08T13:50:37.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36375.280169 secs 2023-05-08T13:50:37.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36375.280169 secs 2023-05-08T13:50:37.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:37 smithi133 ceph-mon[125939]: pgmap v19455: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 626 KiB/s rd, 623 KiB/s wr, 9 op/s 2023-05-08T13:50:38.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:37 smithi096 ceph-mon[124666]: pgmap v19455: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 626 KiB/s rd, 623 KiB/s wr, 9 op/s 2023-05-08T13:50:38.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:37 smithi186 ceph-mon[126480]: pgmap v19455: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 626 KiB/s rd, 623 KiB/s wr, 9 op/s 2023-05-08T13:50:38.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:50:39.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:50:39.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:50:39.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36378.401617 secs 2023-05-08T13:50:39.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:39 smithi133 ceph-mon[125939]: pgmap v19456: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 626 KiB/s rd, 623 KiB/s wr, 9 op/s 2023-05-08T13:50:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:50:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:50:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:39 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:50:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:50:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:39 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T13:50:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:39 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T13:50:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:39 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:50:40.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36378.401617 secs 2023-05-08T13:50:40.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:39 smithi096 ceph-mon[124666]: pgmap v19456: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 626 KiB/s rd, 623 KiB/s wr, 9 op/s 2023-05-08T13:50:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:50:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:50:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:39 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:50:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:50:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:39 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T13:50:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:39 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T13:50:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:39 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:50:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36378.401617 secs 2023-05-08T13:50:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:39 smithi186 ceph-mon[126480]: pgmap v19456: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 626 KiB/s rd, 623 KiB/s wr, 9 op/s 2023-05-08T13:50:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:50:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:50:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:39 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:50:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:50:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:39 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T13:50:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:39 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T13:50:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:39 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:50:40.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36378.956403 secs 2023-05-08T13:50:41.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36378.956403 secs 2023-05-08T13:50:41.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36378.956403 secs 2023-05-08T13:50:42.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36380.280286 secs 2023-05-08T13:50:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:41 smithi096 ceph-mon[124666]: pgmap v19457: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 754 KiB/s wr, 8 op/s 2023-05-08T13:50:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36380.280286 secs 2023-05-08T13:50:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:41 smithi186 ceph-mon[126480]: pgmap v19457: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 754 KiB/s wr, 8 op/s 2023-05-08T13:50:42.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36380.280286 secs 2023-05-08T13:50:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:41 smithi133 ceph-mon[125939]: pgmap v19457: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 754 KiB/s wr, 8 op/s 2023-05-08T13:50:43.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:43 smithi133 ceph-mon[125939]: pgmap v19458: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 738 KiB/s wr, 7 op/s 2023-05-08T13:50:44.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:43 smithi096 ceph-mon[124666]: pgmap v19458: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 738 KiB/s wr, 7 op/s 2023-05-08T13:50:44.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:43 smithi186 ceph-mon[126480]: pgmap v19458: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 738 KiB/s wr, 7 op/s 2023-05-08T13:50:44.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36383.401707 secs 2023-05-08T13:50:45.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36383.401707 secs 2023-05-08T13:50:45.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36383.401707 secs 2023-05-08T13:50:45.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36383.956514 secs 2023-05-08T13:50:45.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:45 smithi133 ceph-mon[125939]: pgmap v19459: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 632 KiB/s rd, 629 KiB/s wr, 10 op/s 2023-05-08T13:50:46.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36383.956514 secs 2023-05-08T13:50:46.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:45 smithi096 ceph-mon[124666]: pgmap v19459: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 632 KiB/s rd, 629 KiB/s wr, 10 op/s 2023-05-08T13:50:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36383.956514 secs 2023-05-08T13:50:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:45 smithi186 ceph-mon[126480]: pgmap v19459: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 632 KiB/s rd, 629 KiB/s wr, 10 op/s 2023-05-08T13:50:46.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36385.280383 secs 2023-05-08T13:50:47.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36385.280383 secs 2023-05-08T13:50:47.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36385.280383 secs 2023-05-08T13:50:47.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:47 smithi133 ceph-mon[125939]: pgmap v19460: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 313 KiB/s wr, 6 op/s 2023-05-08T13:50:48.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:47 smithi096 ceph-mon[124666]: pgmap v19460: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 313 KiB/s wr, 6 op/s 2023-05-08T13:50:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:47 smithi186 ceph-mon[126480]: pgmap v19460: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 313 KiB/s wr, 6 op/s 2023-05-08T13:50:50.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36388.401809 secs 2023-05-08T13:50:50.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:49 smithi133 ceph-mon[125939]: pgmap v19461: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 313 KiB/s wr, 6 op/s 2023-05-08T13:50:50.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36388.401809 secs 2023-05-08T13:50:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:49 smithi096 ceph-mon[124666]: pgmap v19461: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 313 KiB/s wr, 6 op/s 2023-05-08T13:50:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36388.401809 secs 2023-05-08T13:50:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:49 smithi186 ceph-mon[126480]: pgmap v19461: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 313 KiB/s wr, 6 op/s 2023-05-08T13:50:52.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36390.280539 secs 2023-05-08T13:50:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:51 smithi096 ceph-mon[124666]: pgmap v19462: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T13:50:52.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36390.280539 secs 2023-05-08T13:50:52.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:51 smithi186 ceph-mon[126480]: pgmap v19462: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T13:50:52.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36390.280539 secs 2023-05-08T13:50:52.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:51 smithi133 ceph-mon[125939]: pgmap v19462: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T13:50:53.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:53 smithi133 ceph-mon[125939]: pgmap v19463: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 841 KiB/s wr, 8 op/s 2023-05-08T13:50:53.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:53 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:50:54.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:53 smithi096 ceph-mon[124666]: pgmap v19463: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 841 KiB/s wr, 8 op/s 2023-05-08T13:50:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:53 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:50:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:53 smithi186 ceph-mon[126480]: pgmap v19463: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 841 KiB/s wr, 8 op/s 2023-05-08T13:50:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:53 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:50:54.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36393.401915 secs 2023-05-08T13:50:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:54 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:50:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:54 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:50:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:54 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:50:55.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36393.401915 secs 2023-05-08T13:50:55.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:54 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:50:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:54 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:50:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:54 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:50:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36393.401915 secs 2023-05-08T13:50:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:54 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:50:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:54 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:50:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:54 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:50:55.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:55 smithi133 ceph-mon[125939]: pgmap v19464: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T13:50:56.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:55 smithi096 ceph-mon[124666]: pgmap v19464: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T13:50:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:55 smithi186 ceph-mon[126480]: pgmap v19464: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T13:50:56.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36395.280620 secs 2023-05-08T13:50:57.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36395.280620 secs 2023-05-08T13:50:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36395.280620 secs 2023-05-08T13:50:57.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:57 smithi133 ceph-mon[125939]: pgmap v19465: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 12 op/s 2023-05-08T13:50:58.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:57 smithi096 ceph-mon[124666]: pgmap v19465: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 12 op/s 2023-05-08T13:50:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:57 smithi186 ceph-mon[126480]: pgmap v19465: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 12 op/s 2023-05-08T13:51:00.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36398.402038 secs 2023-05-08T13:51:00.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:50:59 smithi096 ceph-mon[124666]: pgmap v19466: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 12 op/s 2023-05-08T13:51:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36398.402038 secs 2023-05-08T13:51:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:50:59 smithi186 ceph-mon[126480]: pgmap v19466: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 12 op/s 2023-05-08T13:51:00.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36398.402038 secs 2023-05-08T13:51:00.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:50:59 smithi133 ceph-mon[125939]: pgmap v19466: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 12 op/s 2023-05-08T13:51:01.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36398.956800 secs 2023-05-08T13:51:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:00 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:51:01.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36398.956800 secs 2023-05-08T13:51:01.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:00 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:51:01.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36398.956800 secs 2023-05-08T13:51:01.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:00 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:51:02.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:01 smithi096 ceph-mon[124666]: pgmap v19467: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.7 MiB/s wr, 17 op/s 2023-05-08T13:51:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:01 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:51:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:51:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:51:02.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:01 smithi186 ceph-mon[126480]: pgmap v19467: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.7 MiB/s wr, 17 op/s 2023-05-08T13:51:02.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:01 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:51:02.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:51:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:51:02.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:01 smithi133 ceph-mon[125939]: pgmap v19467: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.7 MiB/s wr, 17 op/s 2023-05-08T13:51:02.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:01 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:51:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:51:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:51:03.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:51:03.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:03 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:51:03.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:51:03.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:03 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:51:03.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:51:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:03 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:51:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:04 smithi186 ceph-mon[126480]: pgmap v19468: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 860 KiB/s wr, 12 op/s 2023-05-08T13:51:04.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:04 smithi133 ceph-mon[125939]: pgmap v19468: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 860 KiB/s wr, 12 op/s 2023-05-08T13:51:04.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:04 smithi096 ceph-mon[124666]: pgmap v19468: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 860 KiB/s wr, 12 op/s 2023-05-08T13:51:05.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36403.402151 secs 2023-05-08T13:51:05.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36403.402151 secs 2023-05-08T13:51:05.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36403.402151 secs 2023-05-08T13:51:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36403.956919 secs 2023-05-08T13:51:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:06 smithi186 ceph-mon[126480]: pgmap v19469: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.2 MiB/s wr, 18 op/s 2023-05-08T13:51:06.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36403.956919 secs 2023-05-08T13:51:06.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:06 smithi133 ceph-mon[125939]: pgmap v19469: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.2 MiB/s wr, 18 op/s 2023-05-08T13:51:06.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36403.956919 secs 2023-05-08T13:51:06.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:06 smithi096 ceph-mon[124666]: pgmap v19469: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.2 MiB/s wr, 18 op/s 2023-05-08T13:51:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:08 smithi186 ceph-mon[126480]: pgmap v19470: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 767 KiB/s wr, 13 op/s 2023-05-08T13:51:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:08 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:51:08.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:08 smithi133 ceph-mon[125939]: pgmap v19470: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 767 KiB/s wr, 13 op/s 2023-05-08T13:51:08.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:08 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:51:08.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:08 smithi096 ceph-mon[124666]: pgmap v19470: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 767 KiB/s wr, 13 op/s 2023-05-08T13:51:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:08 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:51:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36408.402242 secs 2023-05-08T13:51:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:10 smithi186 ceph-mon[126480]: pgmap v19471: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 396 KiB/s wr, 11 op/s 2023-05-08T13:51:10.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36408.402242 secs 2023-05-08T13:51:10.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:10 smithi133 ceph-mon[125939]: pgmap v19471: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 396 KiB/s wr, 11 op/s 2023-05-08T13:51:10.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36408.402242 secs 2023-05-08T13:51:10.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:10 smithi096 ceph-mon[124666]: pgmap v19471: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 396 KiB/s wr, 11 op/s 2023-05-08T13:51:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:12 smithi186 ceph-mon[126480]: pgmap v19472: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.4 MiB/s wr, 28 op/s 2023-05-08T13:51:12.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:12 smithi133 ceph-mon[125939]: pgmap v19472: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.4 MiB/s wr, 28 op/s 2023-05-08T13:51:12.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:12 smithi096 ceph-mon[124666]: pgmap v19472: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.4 MiB/s wr, 28 op/s 2023-05-08T13:51:13.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:13 smithi133 ceph-mon[125939]: pgmap v19473: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 23 op/s 2023-05-08T13:51:13.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:13 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:51:14.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:13 smithi096 ceph-mon[124666]: pgmap v19473: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 23 op/s 2023-05-08T13:51:14.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:13 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:51:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:13 smithi186 ceph-mon[126480]: pgmap v19473: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 23 op/s 2023-05-08T13:51:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:13 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:51:14.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36413.402340 secs 2023-05-08T13:51:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:14 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:51:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:14 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:51:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:14 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:51:15.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36413.402340 secs 2023-05-08T13:51:15.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:14 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:51:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:14 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:51:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:14 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:51:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36413.402340 secs 2023-05-08T13:51:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:14 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:51:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:14 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:51:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:14 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:51:15.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:15 smithi133 ceph-mon[125939]: pgmap v19474: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.8 MiB/s wr, 28 op/s 2023-05-08T13:51:16.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:15 smithi096 ceph-mon[124666]: pgmap v19474: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.8 MiB/s wr, 28 op/s 2023-05-08T13:51:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:15 smithi186 ceph-mon[126480]: pgmap v19474: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.8 MiB/s wr, 28 op/s 2023-05-08T13:51:18.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:17 smithi096 ceph-mon[124666]: pgmap v19475: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.4 MiB/s wr, 23 op/s 2023-05-08T13:51:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:17 smithi186 ceph-mon[126480]: pgmap v19475: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.4 MiB/s wr, 23 op/s 2023-05-08T13:51:18.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:17 smithi133 ceph-mon[125939]: pgmap v19475: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.4 MiB/s wr, 23 op/s 2023-05-08T13:51:20.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36418.402413 secs 2023-05-08T13:51:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:19 smithi096 ceph-mon[124666]: pgmap v19476: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 21 op/s 2023-05-08T13:51:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36418.402413 secs 2023-05-08T13:51:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:19 smithi186 ceph-mon[126480]: pgmap v19476: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 21 op/s 2023-05-08T13:51:20.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36418.402413 secs 2023-05-08T13:51:20.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:19 smithi133 ceph-mon[125939]: pgmap v19476: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 21 op/s 2023-05-08T13:51:22.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:22 smithi096 ceph-mon[124666]: pgmap v19477: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.7 MiB/s wr, 26 op/s 2023-05-08T13:51:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:22 smithi186 ceph-mon[126480]: pgmap v19477: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.7 MiB/s wr, 26 op/s 2023-05-08T13:51:22.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:22 smithi133 ceph-mon[125939]: pgmap v19477: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.7 MiB/s wr, 26 op/s 2023-05-08T13:51:23.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:23 smithi133 ceph-mon[125939]: pgmap v19478: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 676 KiB/s wr, 9 op/s 2023-05-08T13:51:24.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:23 smithi096 ceph-mon[124666]: pgmap v19478: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 676 KiB/s wr, 9 op/s 2023-05-08T13:51:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:23 smithi186 ceph-mon[126480]: pgmap v19478: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 676 KiB/s wr, 9 op/s 2023-05-08T13:51:24.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36423.402483 secs 2023-05-08T13:51:25.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36423.402483 secs 2023-05-08T13:51:25.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36423.402483 secs 2023-05-08T13:51:25.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36423.957487 secs 2023-05-08T13:51:25.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:25 smithi133 ceph-mon[125939]: pgmap v19479: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 1.6 MiB/s wr, 16 op/s 2023-05-08T13:51:26.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36423.957487 secs 2023-05-08T13:51:26.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:25 smithi096 ceph-mon[124666]: pgmap v19479: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 1.6 MiB/s wr, 16 op/s 2023-05-08T13:51:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36423.957487 secs 2023-05-08T13:51:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:25 smithi186 ceph-mon[126480]: pgmap v19479: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 1.6 MiB/s wr, 16 op/s 2023-05-08T13:51:26.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36425.281311 secs 2023-05-08T13:51:26.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:26 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:51:26.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:26 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:51:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:26 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:51:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:26 smithi133 ceph-mon[125939]: osdmap e1294: 12 total, 12 up, 12 in 2023-05-08T13:51:27.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36425.281311 secs 2023-05-08T13:51:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:26 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:51:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:26 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:51:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:26 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:51:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:26 smithi096 ceph-mon[124666]: osdmap e1294: 12 total, 12 up, 12 in 2023-05-08T13:51:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36425.281311 secs 2023-05-08T13:51:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:26 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:51:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:26 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:51:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:26 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:51:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:26 smithi186 ceph-mon[126480]: osdmap e1294: 12 total, 12 up, 12 in 2023-05-08T13:51:27.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:27 smithi133 ceph-mon[125939]: pgmap v19481: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.5 MiB/s wr, 15 op/s 2023-05-08T13:51:28.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:27 smithi096 ceph-mon[124666]: pgmap v19481: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.5 MiB/s wr, 15 op/s 2023-05-08T13:51:28.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:27 smithi186 ceph-mon[126480]: pgmap v19481: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.5 MiB/s wr, 15 op/s 2023-05-08T13:51:30.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36428.402583 secs 2023-05-08T13:51:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:29 smithi096 ceph-mon[124666]: pgmap v19482: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.5 MiB/s wr, 15 op/s 2023-05-08T13:51:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:29 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:51:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:29 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:51:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36428.402583 secs 2023-05-08T13:51:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:29 smithi186 ceph-mon[126480]: pgmap v19482: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.5 MiB/s wr, 15 op/s 2023-05-08T13:51:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:29 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:51:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:29 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:51:30.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36428.402583 secs 2023-05-08T13:51:30.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:29 smithi133 ceph-mon[125939]: pgmap v19482: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.5 MiB/s wr, 15 op/s 2023-05-08T13:51:30.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:29 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:51:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:29 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:51:31.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36428.957585 secs 2023-05-08T13:51:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36428.957585 secs 2023-05-08T13:51:31.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36428.957585 secs 2023-05-08T13:51:32.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36430.281425 secs 2023-05-08T13:51:32.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:31 smithi096 ceph-mon[124666]: pgmap v19483: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.3 MiB/s wr, 15 op/s 2023-05-08T13:51:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:32 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36430.281425 secs 2023-05-08T13:51:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:32 smithi186 ceph-mon[126480]: pgmap v19483: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.3 MiB/s wr, 15 op/s 2023-05-08T13:51:32.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:32 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36430.281425 secs 2023-05-08T13:51:32.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:32 smithi133 ceph-mon[125939]: pgmap v19483: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.3 MiB/s wr, 15 op/s 2023-05-08T13:51:33.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:33 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:51:33.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:33 smithi096 ceph-mon[124666]: osdmap e1295: 12 total, 12 up, 12 in 2023-05-08T13:51:33.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:33 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:51:33.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:33 smithi186 ceph-mon[126480]: osdmap e1295: 12 total, 12 up, 12 in 2023-05-08T13:51:33.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:33 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:51:33.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:33 smithi133 ceph-mon[125939]: osdmap e1295: 12 total, 12 up, 12 in 2023-05-08T13:51:34.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:34 smithi096 ceph-mon[124666]: pgmap v19485: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 228 KiB/s wr, 7 op/s 2023-05-08T13:51:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:34 smithi186 ceph-mon[126480]: pgmap v19485: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 228 KiB/s wr, 7 op/s 2023-05-08T13:51:34.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:34 smithi133 ceph-mon[125939]: pgmap v19485: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 228 KiB/s wr, 7 op/s 2023-05-08T13:51:35.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36433.402680 secs 2023-05-08T13:51:35.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36433.402680 secs 2023-05-08T13:51:35.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36433.402680 secs 2023-05-08T13:51:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36433.957718 secs 2023-05-08T13:51:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:36 smithi186 ceph-mon[126480]: pgmap v19486: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T13:51:36.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36433.957718 secs 2023-05-08T13:51:36.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:36 smithi133 ceph-mon[125939]: pgmap v19486: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T13:51:36.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36433.957718 secs 2023-05-08T13:51:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:36 smithi096 ceph-mon[124666]: pgmap v19486: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T13:51:37.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:37 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36435.281543 secs 2023-05-08T13:51:37.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:37 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36435.281543 secs 2023-05-08T13:51:37.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:37 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36435.281543 secs 2023-05-08T13:51:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:38 smithi186 ceph-mon[126480]: pgmap v19487: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1001 KiB/s rd, 999 KiB/s wr, 11 op/s 2023-05-08T13:51:38.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:38 smithi133 ceph-mon[125939]: pgmap v19487: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1001 KiB/s rd, 999 KiB/s wr, 11 op/s 2023-05-08T13:51:38.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:38 smithi096 ceph-mon[124666]: pgmap v19487: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1001 KiB/s rd, 999 KiB/s wr, 11 op/s 2023-05-08T13:51:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36438.402775 secs 2023-05-08T13:51:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:40 smithi186 ceph-mon[126480]: pgmap v19488: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1001 KiB/s rd, 999 KiB/s wr, 11 op/s 2023-05-08T13:51:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:40 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:51:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:40 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:51:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:40 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:51:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:40 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:51:40.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36438.402775 secs 2023-05-08T13:51:40.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:40 smithi133 ceph-mon[125939]: pgmap v19488: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1001 KiB/s rd, 999 KiB/s wr, 11 op/s 2023-05-08T13:51:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:40 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:51:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:40 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:51:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:40 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:51:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:40 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:51:40.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36438.402775 secs 2023-05-08T13:51:40.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:40 smithi096 ceph-mon[124666]: pgmap v19488: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1001 KiB/s rd, 999 KiB/s wr, 11 op/s 2023-05-08T13:51:40.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:40 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:51:40.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:40 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:51:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:40 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:51:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:40 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:51:41.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36438.957849 secs 2023-05-08T13:51:41.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:41 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:51:41.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:41 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T13:51:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:41 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T13:51:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:41 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:51:41.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36438.957849 secs 2023-05-08T13:51:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:41 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:51:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:41 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T13:51:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:41 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T13:51:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:41 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:51:41.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36438.957849 secs 2023-05-08T13:51:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:41 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:51:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:41 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T13:51:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:41 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T13:51:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:41 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:51:42.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:42 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36440.281640 secs 2023-05-08T13:51:42.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:42 smithi186 ceph-mon[126480]: pgmap v19489: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 820 KiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T13:51:42.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:42 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36440.281640 secs 2023-05-08T13:51:42.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:42 smithi133 ceph-mon[125939]: pgmap v19489: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 820 KiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T13:51:42.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:42 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36440.281640 secs 2023-05-08T13:51:42.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:42 smithi096 ceph-mon[124666]: pgmap v19489: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 820 KiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T13:51:43.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:43 smithi133 ceph-mon[125939]: pgmap v19490: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 802 KiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T13:51:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36443.402847 secs 2023-05-08T13:51:44.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:43 smithi096 ceph-mon[124666]: pgmap v19490: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 802 KiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T13:51:44.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36443.402847 secs 2023-05-08T13:51:44.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:43 smithi186 ceph-mon[126480]: pgmap v19490: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 802 KiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T13:51:44.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36443.402847 secs 2023-05-08T13:51:46.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36443.957987 secs 2023-05-08T13:51:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:46 smithi096 ceph-mon[124666]: pgmap v19491: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2023-05-08T13:51:46.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36443.957987 secs 2023-05-08T13:51:46.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:46 smithi186 ceph-mon[126480]: pgmap v19491: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2023-05-08T13:51:46.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36443.957987 secs 2023-05-08T13:51:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:46 smithi133 ceph-mon[125939]: pgmap v19491: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2023-05-08T13:51:47.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:47 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36445.281797 secs 2023-05-08T13:51:47.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:47 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36445.281797 secs 2023-05-08T13:51:47.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:47 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36445.281797 secs 2023-05-08T13:51:48.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:48 smithi186 ceph-mon[126480]: pgmap v19492: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 555 KiB/s rd, 706 KiB/s wr, 7 op/s 2023-05-08T13:51:48.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:48 smithi133 ceph-mon[125939]: pgmap v19492: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 555 KiB/s rd, 706 KiB/s wr, 7 op/s 2023-05-08T13:51:48.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:48 smithi096 ceph-mon[124666]: pgmap v19492: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 555 KiB/s rd, 706 KiB/s wr, 7 op/s 2023-05-08T13:51:49.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36448.402914 secs 2023-05-08T13:51:49.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36448.402914 secs 2023-05-08T13:51:49.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36448.402914 secs 2023-05-08T13:51:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:50 smithi186 ceph-mon[126480]: pgmap v19493: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 555 KiB/s rd, 706 KiB/s wr, 7 op/s 2023-05-08T13:51:50.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:50 smithi133 ceph-mon[125939]: pgmap v19493: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 555 KiB/s rd, 706 KiB/s wr, 7 op/s 2023-05-08T13:51:50.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:50 smithi096 ceph-mon[124666]: pgmap v19493: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 555 KiB/s rd, 706 KiB/s wr, 7 op/s 2023-05-08T13:51:51.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36448.958118 secs 2023-05-08T13:51:51.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36448.958118 secs 2023-05-08T13:51:51.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36448.958118 secs 2023-05-08T13:51:52.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:52 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36450.281915 secs 2023-05-08T13:51:52.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:52 smithi186 ceph-mon[126480]: pgmap v19494: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 983 KiB/s wr, 11 op/s 2023-05-08T13:51:52.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:52 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36450.281915 secs 2023-05-08T13:51:52.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:52 smithi133 ceph-mon[125939]: pgmap v19494: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 983 KiB/s wr, 11 op/s 2023-05-08T13:51:52.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:52 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36450.281915 secs 2023-05-08T13:51:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:52 smithi096 ceph-mon[124666]: pgmap v19494: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 983 KiB/s wr, 11 op/s 2023-05-08T13:51:53.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:53 smithi133 ceph-mon[125939]: pgmap v19495: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 665 KiB/s wr, 7 op/s 2023-05-08T13:51:53.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36453.402997 secs 2023-05-08T13:51:54.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:53 smithi096 ceph-mon[124666]: pgmap v19495: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 665 KiB/s wr, 7 op/s 2023-05-08T13:51:54.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36453.402997 secs 2023-05-08T13:51:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:53 smithi186 ceph-mon[126480]: pgmap v19495: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 665 KiB/s wr, 7 op/s 2023-05-08T13:51:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36453.402997 secs 2023-05-08T13:51:56.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:56 smithi186 ceph-mon[126480]: pgmap v19496: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T13:51:56.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:56 smithi133 ceph-mon[125939]: pgmap v19496: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T13:51:56.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:56 smithi096 ceph-mon[124666]: pgmap v19496: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T13:51:57.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:57 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36455.282055 secs 2023-05-08T13:51:57.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:57 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36455.282055 secs 2023-05-08T13:51:57.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:57 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36455.282055 secs 2023-05-08T13:51:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:58 smithi186 ceph-mon[126480]: pgmap v19497: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 856 KiB/s wr, 9 op/s 2023-05-08T13:51:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:58 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:51:58.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:58 smithi133 ceph-mon[125939]: pgmap v19497: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 856 KiB/s wr, 9 op/s 2023-05-08T13:51:58.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:58 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:51:58.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:58 smithi096 ceph-mon[124666]: pgmap v19497: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 856 KiB/s wr, 9 op/s 2023-05-08T13:51:58.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:58 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:51:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:59 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:51:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:59 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:51:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:59 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:51:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:51:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36458.403117 secs 2023-05-08T13:51:59.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:59 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:51:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:59 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:51:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:59 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:51:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:51:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36458.403117 secs 2023-05-08T13:51:59.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:59 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:51:59.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:59 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:51:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:59 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:51:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:51:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36458.403117 secs 2023-05-08T13:52:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:00 smithi186 ceph-mon[126480]: pgmap v19498: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 856 KiB/s wr, 9 op/s 2023-05-08T13:52:00.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:00 smithi133 ceph-mon[125939]: pgmap v19498: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 856 KiB/s wr, 9 op/s 2023-05-08T13:52:00.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:00 smithi096 ceph-mon[124666]: pgmap v19498: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 856 KiB/s wr, 9 op/s 2023-05-08T13:52:01.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:01 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:52:01.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:01 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:52:01.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:01 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:52:02.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:02 smithi186 ceph-mon[126480]: pgmap v19499: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.6 MiB/s wr, 16 op/s 2023-05-08T13:52:02.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:52:02.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:52:02.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:02 smithi133 ceph-mon[125939]: pgmap v19499: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.6 MiB/s wr, 16 op/s 2023-05-08T13:52:02.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:52:02.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:52:02.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:02 smithi096 ceph-mon[124666]: pgmap v19499: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.6 MiB/s wr, 16 op/s 2023-05-08T13:52:02.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:52:02.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:52:03.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:03 smithi133 ceph-mon[125939]: pgmap v19500: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T13:52:03.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36463.403237 secs 2023-05-08T13:52:04.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:03 smithi096 ceph-mon[124666]: pgmap v19500: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T13:52:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36463.403237 secs 2023-05-08T13:52:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:03 smithi186 ceph-mon[126480]: pgmap v19500: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T13:52:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36463.403237 secs 2023-05-08T13:52:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36463.958561 secs 2023-05-08T13:52:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:06 smithi186 ceph-mon[126480]: pgmap v19501: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.7 MiB/s wr, 32 op/s 2023-05-08T13:52:06.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36463.958561 secs 2023-05-08T13:52:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:06 smithi133 ceph-mon[125939]: pgmap v19501: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.7 MiB/s wr, 32 op/s 2023-05-08T13:52:06.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36463.958561 secs 2023-05-08T13:52:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:06 smithi096 ceph-mon[124666]: pgmap v19501: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.7 MiB/s wr, 32 op/s 2023-05-08T13:52:07.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:07 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:52:07.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:07 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:52:07.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:07 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:52:07.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:07 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:52:07.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:07 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:52:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:07 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:52:07.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:07 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:52:07.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:07 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:52:07.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:07 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:52:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:08 smithi186 ceph-mon[126480]: pgmap v19502: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.2 MiB/s wr, 28 op/s 2023-05-08T13:52:08.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:08 smithi133 ceph-mon[125939]: pgmap v19502: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.2 MiB/s wr, 28 op/s 2023-05-08T13:52:08.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:08 smithi096 ceph-mon[124666]: pgmap v19502: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.2 MiB/s wr, 28 op/s 2023-05-08T13:52:09.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36468.403383 secs 2023-05-08T13:52:09.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36468.403383 secs 2023-05-08T13:52:09.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36468.403383 secs 2023-05-08T13:52:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:10 smithi186 ceph-mon[126480]: pgmap v19503: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.2 MiB/s wr, 27 op/s 2023-05-08T13:52:10.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:10 smithi133 ceph-mon[125939]: pgmap v19503: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.2 MiB/s wr, 27 op/s 2023-05-08T13:52:10.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:10 smithi096 ceph-mon[124666]: pgmap v19503: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.2 MiB/s wr, 27 op/s 2023-05-08T13:52:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:12 smithi186 ceph-mon[126480]: pgmap v19504: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.0 MiB/s wr, 32 op/s 2023-05-08T13:52:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:12 smithi186 ceph-mon[126480]: osdmap e1296: 12 total, 12 up, 12 in 2023-05-08T13:52:12.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:12 smithi133 ceph-mon[125939]: pgmap v19504: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.0 MiB/s wr, 32 op/s 2023-05-08T13:52:12.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:12 smithi133 ceph-mon[125939]: osdmap e1296: 12 total, 12 up, 12 in 2023-05-08T13:52:12.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:12 smithi096 ceph-mon[124666]: pgmap v19504: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.0 MiB/s wr, 32 op/s 2023-05-08T13:52:12.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:12 smithi096 ceph-mon[124666]: osdmap e1296: 12 total, 12 up, 12 in 2023-05-08T13:52:13.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:13 smithi133 ceph-mon[125939]: pgmap v19506: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 30 op/s 2023-05-08T13:52:13.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:13 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:52:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36473.403478 secs 2023-05-08T13:52:14.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:13 smithi096 ceph-mon[124666]: pgmap v19506: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 30 op/s 2023-05-08T13:52:14.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:13 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:52:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36473.403478 secs 2023-05-08T13:52:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:13 smithi186 ceph-mon[126480]: pgmap v19506: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 30 op/s 2023-05-08T13:52:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:13 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:52:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36473.403478 secs 2023-05-08T13:52:14.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:14 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:52:14.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:14 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:52:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:14 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:52:15.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:14 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:52:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:14 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:52:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:14 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:52:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:14 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:52:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:14 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:52:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:14 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:52:16.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:15 smithi096 ceph-mon[124666]: pgmap v19507: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 847 KiB/s rd, 1012 KiB/s wr, 9 op/s 2023-05-08T13:52:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:15 smithi186 ceph-mon[126480]: pgmap v19507: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 847 KiB/s rd, 1012 KiB/s wr, 9 op/s 2023-05-08T13:52:16.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:15 smithi133 ceph-mon[125939]: pgmap v19507: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 847 KiB/s rd, 1012 KiB/s wr, 9 op/s 2023-05-08T13:52:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:18 smithi186 ceph-mon[126480]: pgmap v19508: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T13:52:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:18 smithi186 ceph-mon[126480]: osdmap e1297: 12 total, 12 up, 12 in 2023-05-08T13:52:18.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:18 smithi133 ceph-mon[125939]: pgmap v19508: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T13:52:18.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:18 smithi133 ceph-mon[125939]: osdmap e1297: 12 total, 12 up, 12 in 2023-05-08T13:52:18.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:18 smithi096 ceph-mon[124666]: pgmap v19508: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T13:52:18.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:18 smithi096 ceph-mon[124666]: osdmap e1297: 12 total, 12 up, 12 in 2023-05-08T13:52:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36478.403592 secs 2023-05-08T13:52:19.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36478.403592 secs 2023-05-08T13:52:19.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36478.403592 secs 2023-05-08T13:52:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:20 smithi186 ceph-mon[126480]: pgmap v19510: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 751 KiB/s rd, 242 KiB/s wr, 5 op/s 2023-05-08T13:52:20.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:20 smithi133 ceph-mon[125939]: pgmap v19510: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 751 KiB/s rd, 242 KiB/s wr, 5 op/s 2023-05-08T13:52:20.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:20 smithi096 ceph-mon[124666]: pgmap v19510: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 751 KiB/s rd, 242 KiB/s wr, 5 op/s 2023-05-08T13:52:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:22 smithi186 ceph-mon[126480]: pgmap v19511: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 607 KiB/s rd, 228 KiB/s wr, 8 op/s 2023-05-08T13:52:22.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:22 smithi133 ceph-mon[125939]: pgmap v19511: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 607 KiB/s rd, 228 KiB/s wr, 8 op/s 2023-05-08T13:52:22.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:22 smithi096 ceph-mon[124666]: pgmap v19511: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 607 KiB/s rd, 228 KiB/s wr, 8 op/s 2023-05-08T13:52:24.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:23 smithi096 ceph-mon[124666]: pgmap v19512: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 603 KiB/s rd, 226 KiB/s wr, 8 op/s 2023-05-08T13:52:24.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36483.403661 secs 2023-05-08T13:52:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:23 smithi186 ceph-mon[126480]: pgmap v19512: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 603 KiB/s rd, 226 KiB/s wr, 8 op/s 2023-05-08T13:52:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36483.403661 secs 2023-05-08T13:52:24.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:23 smithi133 ceph-mon[125939]: pgmap v19512: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 603 KiB/s rd, 226 KiB/s wr, 8 op/s 2023-05-08T13:52:24.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36483.403661 secs 2023-05-08T13:52:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36483.959057 secs 2023-05-08T13:52:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:26 smithi186 ceph-mon[126480]: pgmap v19513: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T13:52:26.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36483.959057 secs 2023-05-08T13:52:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:26 smithi133 ceph-mon[125939]: pgmap v19513: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T13:52:26.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36483.959057 secs 2023-05-08T13:52:26.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:26 smithi096 ceph-mon[124666]: pgmap v19513: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T13:52:27.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:27 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36485.282737 secs 2023-05-08T13:52:27.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:27 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:52:27.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:27 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:52:27.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:27 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:52:27.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:27 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36485.282737 secs 2023-05-08T13:52:27.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:27 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:52:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:27 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:52:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:27 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:52:27.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:27 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36485.282737 secs 2023-05-08T13:52:27.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:27 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:52:27.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:27 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:52:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:27 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:52:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:28 smithi186 ceph-mon[126480]: pgmap v19514: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 9 op/s 2023-05-08T13:52:28.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:28 smithi133 ceph-mon[125939]: pgmap v19514: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 9 op/s 2023-05-08T13:52:28.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:28 smithi096 ceph-mon[124666]: pgmap v19514: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 9 op/s 2023-05-08T13:52:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36488.403725 secs 2023-05-08T13:52:29.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36488.403725 secs 2023-05-08T13:52:29.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36488.403725 secs 2023-05-08T13:52:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:30 smithi186 ceph-mon[126480]: pgmap v19515: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 8 op/s 2023-05-08T13:52:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:30 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:52:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:30 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:52:30.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:30 smithi133 ceph-mon[125939]: pgmap v19515: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 8 op/s 2023-05-08T13:52:30.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:30 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:52:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:30 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:52:30.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:30 smithi096 ceph-mon[124666]: pgmap v19515: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 8 op/s 2023-05-08T13:52:30.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:30 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:52:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:30 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:52:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36488.959217 secs 2023-05-08T13:52:31.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36488.959217 secs 2023-05-08T13:52:31.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36488.959217 secs 2023-05-08T13:52:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:32 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36490.282870 secs 2023-05-08T13:52:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:32 smithi186 ceph-mon[126480]: pgmap v19516: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T13:52:32.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:32 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36490.282870 secs 2023-05-08T13:52:32.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:32 smithi133 ceph-mon[125939]: pgmap v19516: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T13:52:32.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:32 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36490.282870 secs 2023-05-08T13:52:32.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:32 smithi096 ceph-mon[124666]: pgmap v19516: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T13:52:33.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:33 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:52:33.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:33 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:52:33.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:33 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:52:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:34 smithi186 ceph-mon[126480]: pgmap v19517: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 9 op/s 2023-05-08T13:52:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36493.403847 secs 2023-05-08T13:52:34.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:34 smithi133 ceph-mon[125939]: pgmap v19517: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 9 op/s 2023-05-08T13:52:34.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36493.403847 secs 2023-05-08T13:52:34.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:34 smithi096 ceph-mon[124666]: pgmap v19517: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 9 op/s 2023-05-08T13:52:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36493.403847 secs 2023-05-08T13:52:35.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36493.959376 secs 2023-05-08T13:52:35.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36493.959376 secs 2023-05-08T13:52:35.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36493.959376 secs 2023-05-08T13:52:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:36 smithi186 ceph-mon[126480]: pgmap v19518: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 13 op/s 2023-05-08T13:52:36.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:36 smithi133 ceph-mon[125939]: pgmap v19518: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 13 op/s 2023-05-08T13:52:36.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:36 smithi096 ceph-mon[124666]: pgmap v19518: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 13 op/s 2023-05-08T13:52:37.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:37 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36495.282976 secs 2023-05-08T13:52:37.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:37 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36495.282976 secs 2023-05-08T13:52:37.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:37 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36495.282976 secs 2023-05-08T13:52:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:38 smithi186 ceph-mon[126480]: pgmap v19519: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 640 KiB/s rd, 639 KiB/s wr, 10 op/s 2023-05-08T13:52:38.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:38 smithi133 ceph-mon[125939]: pgmap v19519: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 640 KiB/s rd, 639 KiB/s wr, 10 op/s 2023-05-08T13:52:38.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:38 smithi096 ceph-mon[124666]: pgmap v19519: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 640 KiB/s rd, 639 KiB/s wr, 10 op/s 2023-05-08T13:52:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36498.403972 secs 2023-05-08T13:52:39.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36498.403972 secs 2023-05-08T13:52:39.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36498.403972 secs 2023-05-08T13:52:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:40 smithi186 ceph-mon[126480]: pgmap v19520: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 499 KiB/s wr, 9 op/s 2023-05-08T13:52:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36498.959536 secs 2023-05-08T13:52:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:40 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:52:40.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:40 smithi133 ceph-mon[125939]: pgmap v19520: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 499 KiB/s wr, 9 op/s 2023-05-08T13:52:40.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36498.959536 secs 2023-05-08T13:52:40.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:40 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:52:40.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:40 smithi096 ceph-mon[124666]: pgmap v19520: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 499 KiB/s wr, 9 op/s 2023-05-08T13:52:40.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36498.959536 secs 2023-05-08T13:52:40.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:40 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:52:41.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:52:41.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:52:41.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:52:41.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:52:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:52:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:52:41.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:52:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:52:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:52:42.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:42 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36500.283046 secs 2023-05-08T13:52:42.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:42 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:52:42.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:42 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T13:52:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:42 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T13:52:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:42 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:52:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:42 smithi186 ceph-mon[126480]: pgmap v19521: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 847 KiB/s rd, 845 KiB/s wr, 13 op/s 2023-05-08T13:52:42.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:42 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36500.283046 secs 2023-05-08T13:52:42.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:42 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:52:42.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:42 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T13:52:42.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:42 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T13:52:42.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:42 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:52:42.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:42 smithi133 ceph-mon[125939]: pgmap v19521: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 847 KiB/s rd, 845 KiB/s wr, 13 op/s 2023-05-08T13:52:42.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:42 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36500.283046 secs 2023-05-08T13:52:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:42 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:52:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:42 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T13:52:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:42 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T13:52:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:42 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:52:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:42 smithi096 ceph-mon[124666]: pgmap v19521: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 847 KiB/s rd, 845 KiB/s wr, 13 op/s 2023-05-08T13:52:44.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:43 smithi096 ceph-mon[124666]: pgmap v19522: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 664 KiB/s rd, 662 KiB/s wr, 8 op/s 2023-05-08T13:52:44.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36503.404093 secs 2023-05-08T13:52:44.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:43 smithi186 ceph-mon[126480]: pgmap v19522: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 664 KiB/s rd, 662 KiB/s wr, 8 op/s 2023-05-08T13:52:44.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36503.404093 secs 2023-05-08T13:52:44.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:43 smithi133 ceph-mon[125939]: pgmap v19522: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 664 KiB/s rd, 662 KiB/s wr, 8 op/s 2023-05-08T13:52:44.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36503.404093 secs 2023-05-08T13:52:46.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36503.959659 secs 2023-05-08T13:52:46.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:46 smithi186 ceph-mon[126480]: pgmap v19523: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 951 KiB/s rd, 948 KiB/s wr, 11 op/s 2023-05-08T13:52:46.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36503.959659 secs 2023-05-08T13:52:46.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:46 smithi133 ceph-mon[125939]: pgmap v19523: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 951 KiB/s rd, 948 KiB/s wr, 11 op/s 2023-05-08T13:52:46.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36503.959659 secs 2023-05-08T13:52:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:46 smithi096 ceph-mon[124666]: pgmap v19523: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 951 KiB/s rd, 948 KiB/s wr, 11 op/s 2023-05-08T13:52:48.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:48 smithi186 ceph-mon[126480]: pgmap v19524: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 632 KiB/s wr, 7 op/s 2023-05-08T13:52:48.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:48 smithi133 ceph-mon[125939]: pgmap v19524: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 632 KiB/s wr, 7 op/s 2023-05-08T13:52:48.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:48 smithi096 ceph-mon[124666]: pgmap v19524: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 632 KiB/s wr, 7 op/s 2023-05-08T13:52:49.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36508.404202 secs 2023-05-08T13:52:49.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:52:49.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36508.404202 secs 2023-05-08T13:52:49.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:52:49.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36508.404202 secs 2023-05-08T13:52:49.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:52:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:50 smithi186 ceph-mon[126480]: pgmap v19525: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 631 KiB/s wr, 7 op/s 2023-05-08T13:52:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:52:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:52:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:52:50.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:50 smithi133 ceph-mon[125939]: pgmap v19525: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 631 KiB/s wr, 7 op/s 2023-05-08T13:52:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:52:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:52:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:52:50.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:50 smithi096 ceph-mon[124666]: pgmap v19525: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 631 KiB/s wr, 7 op/s 2023-05-08T13:52:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:52:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:52:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:52:52.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:52 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36510.283287 secs 2023-05-08T13:52:52.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:52 smithi186 ceph-mon[126480]: pgmap v19526: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T13:52:52.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:52 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36510.283287 secs 2023-05-08T13:52:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:52 smithi133 ceph-mon[125939]: pgmap v19526: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T13:52:52.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:52 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36510.283287 secs 2023-05-08T13:52:52.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:52 smithi096 ceph-mon[124666]: pgmap v19526: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T13:52:54.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:53 smithi096 ceph-mon[124666]: pgmap v19527: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1003 KiB/s rd, 972 KiB/s wr, 8 op/s 2023-05-08T13:52:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:53 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:52:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36513.404327 secs 2023-05-08T13:52:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:53 smithi186 ceph-mon[126480]: pgmap v19527: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1003 KiB/s rd, 972 KiB/s wr, 8 op/s 2023-05-08T13:52:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:53 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:52:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36513.404327 secs 2023-05-08T13:52:54.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:53 smithi133 ceph-mon[125939]: pgmap v19527: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1003 KiB/s rd, 972 KiB/s wr, 8 op/s 2023-05-08T13:52:54.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:53 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:52:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36513.404327 secs 2023-05-08T13:52:55.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:54 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:52:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:54 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:52:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:54 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:52:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:54 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:52:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:54 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:52:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:54 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:52:55.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:54 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:52:55.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:54 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:52:55.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:54 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:52:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:55 smithi186 ceph-mon[126480]: pgmap v19528: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 13 op/s 2023-05-08T13:52:56.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:55 smithi133 ceph-mon[125939]: pgmap v19528: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 13 op/s 2023-05-08T13:52:56.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:55 smithi096 ceph-mon[124666]: pgmap v19528: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 13 op/s 2023-05-08T13:52:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36515.283411 secs 2023-05-08T13:52:57.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36515.283411 secs 2023-05-08T13:52:57.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36515.283411 secs 2023-05-08T13:52:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:57 smithi186 ceph-mon[126480]: pgmap v19529: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 11 op/s 2023-05-08T13:52:58.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:57 smithi133 ceph-mon[125939]: pgmap v19529: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 11 op/s 2023-05-08T13:52:58.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:57 smithi096 ceph-mon[124666]: pgmap v19529: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 11 op/s 2023-05-08T13:52:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36518.404454 secs 2023-05-08T13:52:59.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36518.404454 secs 2023-05-08T13:52:59.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36518.404454 secs 2023-05-08T13:53:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:52:59 smithi186 ceph-mon[126480]: pgmap v19530: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 11 op/s 2023-05-08T13:53:00.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:52:59 smithi133 ceph-mon[125939]: pgmap v19530: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 11 op/s 2023-05-08T13:53:00.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:52:59 smithi096 ceph-mon[124666]: pgmap v19530: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 11 op/s 2023-05-08T13:53:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36518.960015 secs 2023-05-08T13:53:01.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36518.960015 secs 2023-05-08T13:53:01.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36518.960015 secs 2023-05-08T13:53:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36520.283552 secs 2023-05-08T13:53:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:01 smithi186 ceph-mon[126480]: pgmap v19531: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 16 op/s 2023-05-08T13:53:02.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36520.283552 secs 2023-05-08T13:53:02.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:01 smithi133 ceph-mon[125939]: pgmap v19531: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 16 op/s 2023-05-08T13:53:02.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36520.283552 secs 2023-05-08T13:53:02.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:01 smithi096 ceph-mon[124666]: pgmap v19531: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 16 op/s 2023-05-08T13:53:03.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:02 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:53:03.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:53:03.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:53:03.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:02 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:53:03.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:53:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:53:03.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:02 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:53:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:53:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:53:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:03 smithi186 ceph-mon[126480]: pgmap v19532: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 949 KiB/s rd, 787 KiB/s wr, 11 op/s 2023-05-08T13:53:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36523.404579 secs 2023-05-08T13:53:04.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:03 smithi133 ceph-mon[125939]: pgmap v19532: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 949 KiB/s rd, 787 KiB/s wr, 11 op/s 2023-05-08T13:53:04.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36523.404579 secs 2023-05-08T13:53:04.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:03 smithi096 ceph-mon[124666]: pgmap v19532: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 949 KiB/s rd, 787 KiB/s wr, 11 op/s 2023-05-08T13:53:04.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36523.404579 secs 2023-05-08T13:53:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36523.960123 secs 2023-05-08T13:53:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:06 smithi186 ceph-mon[126480]: pgmap v19533: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 16 op/s 2023-05-08T13:53:06.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36523.960123 secs 2023-05-08T13:53:06.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:06 smithi133 ceph-mon[125939]: pgmap v19533: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 16 op/s 2023-05-08T13:53:06.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36523.960123 secs 2023-05-08T13:53:06.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:06 smithi096 ceph-mon[124666]: pgmap v19533: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 16 op/s 2023-05-08T13:53:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:08 smithi186 ceph-mon[126480]: pgmap v19534: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 795 KiB/s rd, 525 KiB/s wr, 11 op/s 2023-05-08T13:53:08.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:08 smithi133 ceph-mon[125939]: pgmap v19534: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 795 KiB/s rd, 525 KiB/s wr, 11 op/s 2023-05-08T13:53:08.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:08 smithi096 ceph-mon[124666]: pgmap v19534: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 795 KiB/s rd, 525 KiB/s wr, 11 op/s 2023-05-08T13:53:09.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36528.404700 secs 2023-05-08T13:53:09.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:09 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:53:09.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36528.404700 secs 2023-05-08T13:53:09.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:09 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:53:09.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36528.404700 secs 2023-05-08T13:53:09.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:09 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:53:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:10 smithi186 ceph-mon[126480]: pgmap v19535: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 770 KiB/s rd, 500 KiB/s wr, 10 op/s 2023-05-08T13:53:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:10 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:53:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:10 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:53:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:10 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:53:10.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:10 smithi133 ceph-mon[125939]: pgmap v19535: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 770 KiB/s rd, 500 KiB/s wr, 10 op/s 2023-05-08T13:53:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:10 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:53:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:10 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:53:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:10 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:53:10.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:10 smithi096 ceph-mon[124666]: pgmap v19535: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 770 KiB/s rd, 500 KiB/s wr, 10 op/s 2023-05-08T13:53:10.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:10 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:53:10.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:10 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:53:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:10 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:53:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:12 smithi186 ceph-mon[126480]: pgmap v19536: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 26 op/s 2023-05-08T13:53:12.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:12 smithi133 ceph-mon[125939]: pgmap v19536: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 26 op/s 2023-05-08T13:53:12.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:12 smithi096 ceph-mon[124666]: pgmap v19536: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 26 op/s 2023-05-08T13:53:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:13 smithi186 ceph-mon[126480]: pgmap v19537: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 22 op/s 2023-05-08T13:53:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:13 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:53:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36533.404787 secs 2023-05-08T13:53:14.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:13 smithi133 ceph-mon[125939]: pgmap v19537: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 22 op/s 2023-05-08T13:53:14.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:13 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:53:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36533.404787 secs 2023-05-08T13:53:14.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:13 smithi096 ceph-mon[124666]: pgmap v19537: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 22 op/s 2023-05-08T13:53:14.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:13 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:53:14.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36533.404787 secs 2023-05-08T13:53:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:14 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:53:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:14 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:53:15.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:14 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:53:15.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:14 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:53:15.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:14 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:53:15.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:14 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:53:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:15 smithi186 ceph-mon[126480]: pgmap v19538: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 25 op/s 2023-05-08T13:53:16.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:15 smithi133 ceph-mon[125939]: pgmap v19538: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 25 op/s 2023-05-08T13:53:16.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:15 smithi096 ceph-mon[124666]: pgmap v19538: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 25 op/s 2023-05-08T13:53:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:18 smithi186 ceph-mon[126480]: pgmap v19539: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 20 op/s 2023-05-08T13:53:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:18 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:53:18.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:18 smithi133 ceph-mon[125939]: pgmap v19539: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 20 op/s 2023-05-08T13:53:18.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:18 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:53:18.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:18 smithi096 ceph-mon[124666]: pgmap v19539: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 20 op/s 2023-05-08T13:53:18.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:18 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:53:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36538.404902 secs 2023-05-08T13:53:19.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36538.404902 secs 2023-05-08T13:53:19.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36538.404902 secs 2023-05-08T13:53:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:20 smithi186 ceph-mon[126480]: pgmap v19540: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 19 op/s 2023-05-08T13:53:20.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:20 smithi133 ceph-mon[125939]: pgmap v19540: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 19 op/s 2023-05-08T13:53:20.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:20 smithi096 ceph-mon[124666]: pgmap v19540: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 19 op/s 2023-05-08T13:53:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:22 smithi186 ceph-mon[126480]: pgmap v19541: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 24 op/s 2023-05-08T13:53:22.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:22 smithi133 ceph-mon[125939]: pgmap v19541: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 24 op/s 2023-05-08T13:53:22.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:22 smithi096 ceph-mon[124666]: pgmap v19541: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 24 op/s 2023-05-08T13:53:24.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:23 smithi096 ceph-mon[124666]: pgmap v19542: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 884 KiB/s rd, 960 KiB/s wr, 7 op/s 2023-05-08T13:53:24.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36543.405027 secs 2023-05-08T13:53:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:23 smithi186 ceph-mon[126480]: pgmap v19542: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 884 KiB/s rd, 960 KiB/s wr, 7 op/s 2023-05-08T13:53:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36543.405027 secs 2023-05-08T13:53:24.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:23 smithi133 ceph-mon[125939]: pgmap v19542: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 884 KiB/s rd, 960 KiB/s wr, 7 op/s 2023-05-08T13:53:24.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36543.405027 secs 2023-05-08T13:53:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36543.960668 secs 2023-05-08T13:53:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:26 smithi186 ceph-mon[126480]: pgmap v19543: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T13:53:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:26 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:53:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:26 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:53:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:26 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:53:26.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36543.960668 secs 2023-05-08T13:53:26.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:26 smithi133 ceph-mon[125939]: pgmap v19543: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T13:53:26.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:26 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:53:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:26 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:53:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:26 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:53:26.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36543.960668 secs 2023-05-08T13:53:26.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:26 smithi096 ceph-mon[124666]: pgmap v19543: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T13:53:26.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:26 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:53:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:26 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:53:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:26 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:53:27.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:27 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36545.284167 secs 2023-05-08T13:53:27.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:27 smithi186 ceph-mon[126480]: osdmap e1298: 12 total, 12 up, 12 in 2023-05-08T13:53:27.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:27 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36545.284167 secs 2023-05-08T13:53:27.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:27 smithi133 ceph-mon[125939]: osdmap e1298: 12 total, 12 up, 12 in 2023-05-08T13:53:27.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:27 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36545.284167 secs 2023-05-08T13:53:27.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:27 smithi096 ceph-mon[124666]: osdmap e1298: 12 total, 12 up, 12 in 2023-05-08T13:53:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:28 smithi186 ceph-mon[126480]: pgmap v19545: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2023-05-08T13:53:28.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:28 smithi133 ceph-mon[125939]: pgmap v19545: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2023-05-08T13:53:28.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:28 smithi096 ceph-mon[124666]: pgmap v19545: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2023-05-08T13:53:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36548.405144 secs 2023-05-08T13:53:29.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36548.405144 secs 2023-05-08T13:53:29.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36548.405144 secs 2023-05-08T13:53:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:30 smithi186 ceph-mon[126480]: pgmap v19546: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2023-05-08T13:53:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:30 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:53:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:30 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:53:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36548.960752 secs 2023-05-08T13:53:30.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:30 smithi133 ceph-mon[125939]: pgmap v19546: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2023-05-08T13:53:30.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:30 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:53:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:30 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:53:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36548.960752 secs 2023-05-08T13:53:30.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:30 smithi096 ceph-mon[124666]: pgmap v19546: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2023-05-08T13:53:30.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:30 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:53:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:30 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:53:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36548.960752 secs 2023-05-08T13:53:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:32 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36550.284287 secs 2023-05-08T13:53:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:32 smithi186 ceph-mon[126480]: pgmap v19547: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 827 KiB/s wr, 15 op/s 2023-05-08T13:53:32.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:32 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36550.284287 secs 2023-05-08T13:53:32.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:32 smithi133 ceph-mon[125939]: pgmap v19547: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 827 KiB/s wr, 15 op/s 2023-05-08T13:53:32.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:32 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36550.284287 secs 2023-05-08T13:53:32.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:32 smithi096 ceph-mon[124666]: pgmap v19547: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 827 KiB/s wr, 15 op/s 2023-05-08T13:53:33.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:33 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:53:33.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:33 smithi186 ceph-mon[126480]: osdmap e1299: 12 total, 12 up, 12 in 2023-05-08T13:53:33.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:33 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:53:33.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:33 smithi133 ceph-mon[125939]: osdmap e1299: 12 total, 12 up, 12 in 2023-05-08T13:53:33.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:33 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:53:33.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:33 smithi096 ceph-mon[124666]: osdmap e1299: 12 total, 12 up, 12 in 2023-05-08T13:53:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:34 smithi186 ceph-mon[126480]: pgmap v19549: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 488 KiB/s wr, 9 op/s 2023-05-08T13:53:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36553.405305 secs 2023-05-08T13:53:34.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:34 smithi133 ceph-mon[125939]: pgmap v19549: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 488 KiB/s wr, 9 op/s 2023-05-08T13:53:34.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36553.405305 secs 2023-05-08T13:53:34.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:34 smithi096 ceph-mon[124666]: pgmap v19549: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 488 KiB/s wr, 9 op/s 2023-05-08T13:53:34.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36553.405305 secs 2023-05-08T13:53:35.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36553.960875 secs 2023-05-08T13:53:35.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36553.960875 secs 2023-05-08T13:53:35.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36553.960875 secs 2023-05-08T13:53:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:36 smithi186 ceph-mon[126480]: pgmap v19550: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T13:53:36.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:36 smithi133 ceph-mon[125939]: pgmap v19550: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T13:53:36.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:36 smithi096 ceph-mon[124666]: pgmap v19550: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T13:53:37.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:37 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36555.284434 secs 2023-05-08T13:53:37.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:37 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36555.284434 secs 2023-05-08T13:53:37.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:37 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36555.284434 secs 2023-05-08T13:53:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:38 smithi186 ceph-mon[126480]: pgmap v19551: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 964 KiB/s wr, 11 op/s 2023-05-08T13:53:38.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:38 smithi133 ceph-mon[125939]: pgmap v19551: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 964 KiB/s wr, 11 op/s 2023-05-08T13:53:38.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:38 smithi096 ceph-mon[124666]: pgmap v19551: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 964 KiB/s wr, 11 op/s 2023-05-08T13:53:39.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36558.405412 secs 2023-05-08T13:53:39.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36558.405412 secs 2023-05-08T13:53:39.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36558.405412 secs 2023-05-08T13:53:40.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:40 smithi133 ceph-mon[125939]: pgmap v19552: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 964 KiB/s wr, 11 op/s 2023-05-08T13:53:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36558.961001 secs 2023-05-08T13:53:40.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:40 smithi096 ceph-mon[124666]: pgmap v19552: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 964 KiB/s wr, 11 op/s 2023-05-08T13:53:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36558.961001 secs 2023-05-08T13:53:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:40 smithi186 ceph-mon[126480]: pgmap v19552: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 964 KiB/s wr, 11 op/s 2023-05-08T13:53:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36558.961001 secs 2023-05-08T13:53:41.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:53:41.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:53:41.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:53:42.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:42 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36560.284554 secs 2023-05-08T13:53:42.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:42 smithi133 ceph-mon[125939]: pgmap v19553: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 577 KiB/s rd, 953 KiB/s wr, 9 op/s 2023-05-08T13:53:42.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:42 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36560.284554 secs 2023-05-08T13:53:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:42 smithi096 ceph-mon[124666]: pgmap v19553: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 577 KiB/s rd, 953 KiB/s wr, 9 op/s 2023-05-08T13:53:42.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:42 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36560.284554 secs 2023-05-08T13:53:42.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:42 smithi186 ceph-mon[126480]: pgmap v19553: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 577 KiB/s rd, 953 KiB/s wr, 9 op/s 2023-05-08T13:53:43.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:43 smithi133 ceph-mon[125939]: pgmap v19554: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 564 KiB/s rd, 932 KiB/s wr, 9 op/s 2023-05-08T13:53:43.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36563.405538 secs 2023-05-08T13:53:44.068 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:43 smithi096 ceph-mon[124666]: pgmap v19554: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 564 KiB/s rd, 932 KiB/s wr, 9 op/s 2023-05-08T13:53:44.068 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36563.405538 secs 2023-05-08T13:53:44.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:43 smithi186 ceph-mon[126480]: pgmap v19554: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 564 KiB/s rd, 932 KiB/s wr, 9 op/s 2023-05-08T13:53:44.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36563.405538 secs 2023-05-08T13:53:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36563.961117 secs 2023-05-08T13:53:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:53:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:53:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:53:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:53:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:53:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:53:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:53:45.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36563.961117 secs 2023-05-08T13:53:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:53:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:53:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:53:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:53:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:53:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:53:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:53:45.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36563.961117 secs 2023-05-08T13:53:45.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:53:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:53:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:53:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:53:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:53:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:53:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:53:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:46 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:53:46.647 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:46 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T13:53:46.648 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:46 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T13:53:46.648 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:46 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:53:46.648 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:46 smithi186 ceph-mon[126480]: pgmap v19555: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 798 KiB/s rd, 794 KiB/s wr, 11 op/s 2023-05-08T13:53:46.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:46 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:53:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:46 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T13:53:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:46 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T13:53:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:46 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:53:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:46 smithi133 ceph-mon[125939]: pgmap v19555: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 798 KiB/s rd, 794 KiB/s wr, 11 op/s 2023-05-08T13:53:46.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:46 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:53:46.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:46 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T13:53:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:46 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T13:53:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:46 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:53:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:46 smithi096 ceph-mon[124666]: pgmap v19555: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 798 KiB/s rd, 794 KiB/s wr, 11 op/s 2023-05-08T13:53:48.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:48 smithi186 ceph-mon[126480]: pgmap v19556: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 319 KiB/s rd, 317 KiB/s wr, 7 op/s 2023-05-08T13:53:48.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:48 smithi133 ceph-mon[125939]: pgmap v19556: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 319 KiB/s rd, 317 KiB/s wr, 7 op/s 2023-05-08T13:53:48.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:48 smithi096 ceph-mon[124666]: pgmap v19556: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 319 KiB/s rd, 317 KiB/s wr, 7 op/s 2023-05-08T13:53:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36568.405662 secs 2023-05-08T13:53:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:53:49.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36568.405662 secs 2023-05-08T13:53:49.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:53:49.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36568.405662 secs 2023-05-08T13:53:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:53:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:50 smithi186 ceph-mon[126480]: pgmap v19557: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 316 KiB/s wr, 6 op/s 2023-05-08T13:53:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:53:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:53:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:53:50.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:50 smithi133 ceph-mon[125939]: pgmap v19557: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 316 KiB/s wr, 6 op/s 2023-05-08T13:53:50.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:53:50.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:53:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:53:50.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:50 smithi096 ceph-mon[124666]: pgmap v19557: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 316 KiB/s wr, 6 op/s 2023-05-08T13:53:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:53:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:53:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:53:52.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:52 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36570.284815 secs 2023-05-08T13:53:52.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:52 smithi186 ceph-mon[126480]: pgmap v19558: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T13:53:52.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:52 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36570.284815 secs 2023-05-08T13:53:52.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:52 smithi133 ceph-mon[125939]: pgmap v19558: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T13:53:52.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:52 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36570.284815 secs 2023-05-08T13:53:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:52 smithi096 ceph-mon[124666]: pgmap v19558: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T13:53:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:53 smithi186 ceph-mon[126480]: pgmap v19559: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 852 KiB/s wr, 8 op/s 2023-05-08T13:53:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:53 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:53:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36573.405795 secs 2023-05-08T13:53:54.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:53 smithi133 ceph-mon[125939]: pgmap v19559: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 852 KiB/s wr, 8 op/s 2023-05-08T13:53:54.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:53 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:53:54.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36573.405795 secs 2023-05-08T13:53:54.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:53 smithi096 ceph-mon[124666]: pgmap v19559: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 852 KiB/s wr, 8 op/s 2023-05-08T13:53:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:53 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:53:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36573.405795 secs 2023-05-08T13:53:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:54 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:53:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:54 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:53:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:54 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:53:55.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:54 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:53:55.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:54 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:53:55.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:54 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:53:55.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:54 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:53:55.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:54 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:53:55.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:54 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:53:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:55 smithi186 ceph-mon[126480]: pgmap v19560: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 13 op/s 2023-05-08T13:53:56.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:55 smithi133 ceph-mon[125939]: pgmap v19560: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 13 op/s 2023-05-08T13:53:56.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:55 smithi096 ceph-mon[124666]: pgmap v19560: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 13 op/s 2023-05-08T13:53:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36575.284933 secs 2023-05-08T13:53:57.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36575.284933 secs 2023-05-08T13:53:57.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36575.284933 secs 2023-05-08T13:53:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:57 smithi186 ceph-mon[126480]: pgmap v19561: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 11 op/s 2023-05-08T13:53:58.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:57 smithi133 ceph-mon[125939]: pgmap v19561: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 11 op/s 2023-05-08T13:53:58.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:57 smithi096 ceph-mon[124666]: pgmap v19561: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 11 op/s 2023-05-08T13:53:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36578.405919 secs 2023-05-08T13:53:59.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36578.405919 secs 2023-05-08T13:53:59.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36578.405919 secs 2023-05-08T13:54:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:53:59 smithi186 ceph-mon[126480]: pgmap v19562: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 11 op/s 2023-05-08T13:54:00.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:53:59 smithi133 ceph-mon[125939]: pgmap v19562: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 11 op/s 2023-05-08T13:54:00.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:53:59 smithi096 ceph-mon[124666]: pgmap v19562: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 11 op/s 2023-05-08T13:54:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36578.961512 secs 2023-05-08T13:54:01.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36578.961512 secs 2023-05-08T13:54:01.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36578.961512 secs 2023-05-08T13:54:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:01 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:54:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:01 smithi186 ceph-mon[126480]: pgmap v19563: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 16 op/s 2023-05-08T13:54:02.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:01 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:54:02.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:01 smithi133 ceph-mon[125939]: pgmap v19563: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 16 op/s 2023-05-08T13:54:02.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:01 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:54:02.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:01 smithi096 ceph-mon[124666]: pgmap v19563: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 16 op/s 2023-05-08T13:54:03.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:54:03.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:54:03.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:54:03.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:54:03.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:54:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:54:03.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:54:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:54:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:54:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:03 smithi186 ceph-mon[126480]: pgmap v19564: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 841 KiB/s wr, 11 op/s 2023-05-08T13:54:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36583.406069 secs 2023-05-08T13:54:04.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:03 smithi133 ceph-mon[125939]: pgmap v19564: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 841 KiB/s wr, 11 op/s 2023-05-08T13:54:04.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36583.406069 secs 2023-05-08T13:54:04.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:03 smithi096 ceph-mon[124666]: pgmap v19564: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 841 KiB/s wr, 11 op/s 2023-05-08T13:54:04.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36583.406069 secs 2023-05-08T13:54:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36583.961558 secs 2023-05-08T13:54:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:06 smithi186 ceph-mon[126480]: pgmap v19565: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.5 MiB/s wr, 27 op/s 2023-05-08T13:54:06.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36583.961558 secs 2023-05-08T13:54:06.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:06 smithi133 ceph-mon[125939]: pgmap v19565: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.5 MiB/s wr, 27 op/s 2023-05-08T13:54:06.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36583.961558 secs 2023-05-08T13:54:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:06 smithi096 ceph-mon[124666]: pgmap v19565: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.5 MiB/s wr, 27 op/s 2023-05-08T13:54:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:08 smithi186 ceph-mon[126480]: pgmap v19566: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 791 KiB/s wr, 22 op/s 2023-05-08T13:54:08.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:08 smithi133 ceph-mon[125939]: pgmap v19566: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 791 KiB/s wr, 22 op/s 2023-05-08T13:54:08.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:08 smithi096 ceph-mon[124666]: pgmap v19566: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 791 KiB/s wr, 22 op/s 2023-05-08T13:54:09.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36588.406192 secs 2023-05-08T13:54:09.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36588.406192 secs 2023-05-08T13:54:09.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36588.406192 secs 2023-05-08T13:54:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:10 smithi186 ceph-mon[126480]: pgmap v19567: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 766 KiB/s wr, 21 op/s 2023-05-08T13:54:10.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:10 smithi133 ceph-mon[125939]: pgmap v19567: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 766 KiB/s wr, 21 op/s 2023-05-08T13:54:10.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:10 smithi096 ceph-mon[124666]: pgmap v19567: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 766 KiB/s wr, 21 op/s 2023-05-08T13:54:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36588.961671 secs 2023-05-08T13:54:11.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36588.961671 secs 2023-05-08T13:54:11.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36588.961671 secs 2023-05-08T13:54:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:12 smithi186 ceph-mon[126480]: pgmap v19568: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 766 KiB/s wr, 24 op/s 2023-05-08T13:54:12.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:12 smithi133 ceph-mon[125939]: pgmap v19568: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 766 KiB/s wr, 24 op/s 2023-05-08T13:54:12.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:12 smithi096 ceph-mon[124666]: pgmap v19568: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 766 KiB/s wr, 24 op/s 2023-05-08T13:54:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:13 smithi186 ceph-mon[126480]: pgmap v19569: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 898 KiB/s rd, 685 KiB/s wr, 19 op/s 2023-05-08T13:54:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36593.406367 secs 2023-05-08T13:54:14.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:13 smithi133 ceph-mon[125939]: pgmap v19569: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 898 KiB/s rd, 685 KiB/s wr, 19 op/s 2023-05-08T13:54:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36593.406367 secs 2023-05-08T13:54:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:13 smithi096 ceph-mon[124666]: pgmap v19569: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 898 KiB/s rd, 685 KiB/s wr, 19 op/s 2023-05-08T13:54:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36593.406367 secs 2023-05-08T13:54:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36593.961766 secs 2023-05-08T13:54:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:16 smithi186 ceph-mon[126480]: pgmap v19570: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 974 KiB/s rd, 760 KiB/s wr, 22 op/s 2023-05-08T13:54:16.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36593.961766 secs 2023-05-08T13:54:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:16 smithi133 ceph-mon[125939]: pgmap v19570: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 974 KiB/s rd, 760 KiB/s wr, 22 op/s 2023-05-08T13:54:16.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36593.961766 secs 2023-05-08T13:54:16.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:16 smithi096 ceph-mon[124666]: pgmap v19570: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 974 KiB/s rd, 760 KiB/s wr, 22 op/s 2023-05-08T13:54:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:18 smithi186 ceph-mon[126480]: pgmap v19571: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 75 KiB/s wr, 6 op/s 2023-05-08T13:54:18.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:18 smithi133 ceph-mon[125939]: pgmap v19571: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 75 KiB/s wr, 6 op/s 2023-05-08T13:54:18.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:18 smithi096 ceph-mon[124666]: pgmap v19571: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 75 KiB/s wr, 6 op/s 2023-05-08T13:54:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36598.406496 secs 2023-05-08T13:54:19.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36598.406496 secs 2023-05-08T13:54:19.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36598.406496 secs 2023-05-08T13:54:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:20 smithi186 ceph-mon[126480]: pgmap v19572: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 75 KiB/s wr, 6 op/s 2023-05-08T13:54:20.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:20 smithi133 ceph-mon[125939]: pgmap v19572: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 75 KiB/s wr, 6 op/s 2023-05-08T13:54:20.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:20 smithi096 ceph-mon[124666]: pgmap v19572: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 75 KiB/s wr, 6 op/s 2023-05-08T13:54:21.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:21 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:54:21.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:21 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:54:21.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:21 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:54:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:22 smithi186 ceph-mon[126480]: pgmap v19573: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 626 KiB/s rd, 644 KiB/s wr, 13 op/s 2023-05-08T13:54:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:22 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:54:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:22 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:54:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:22 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:54:22.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:22 smithi133 ceph-mon[125939]: pgmap v19573: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 626 KiB/s rd, 644 KiB/s wr, 13 op/s 2023-05-08T13:54:22.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:22 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:54:22.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:22 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:54:22.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:22 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:54:22.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:22 smithi096 ceph-mon[124666]: pgmap v19573: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 626 KiB/s rd, 644 KiB/s wr, 13 op/s 2023-05-08T13:54:22.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:22 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:54:22.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:22 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:54:22.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:22 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:54:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:23 smithi186 ceph-mon[126480]: pgmap v19574: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 625 KiB/s rd, 644 KiB/s wr, 10 op/s 2023-05-08T13:54:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36603.406595 secs 2023-05-08T13:54:24.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:23 smithi133 ceph-mon[125939]: pgmap v19574: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 625 KiB/s rd, 644 KiB/s wr, 10 op/s 2023-05-08T13:54:24.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36603.406595 secs 2023-05-08T13:54:24.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:23 smithi096 ceph-mon[124666]: pgmap v19574: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 625 KiB/s rd, 644 KiB/s wr, 10 op/s 2023-05-08T13:54:24.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36603.406595 secs 2023-05-08T13:54:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:26 smithi186 ceph-mon[126480]: pgmap v19575: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 629 KiB/s rd, 674 KiB/s wr, 13 op/s 2023-05-08T13:54:26.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:26 smithi133 ceph-mon[125939]: pgmap v19575: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 629 KiB/s rd, 674 KiB/s wr, 13 op/s 2023-05-08T13:54:26.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:26 smithi096 ceph-mon[124666]: pgmap v19575: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 629 KiB/s rd, 674 KiB/s wr, 13 op/s 2023-05-08T13:54:27.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:27 smithi186 ceph-mon[126480]: osdmap e1300: 12 total, 12 up, 12 in 2023-05-08T13:54:27.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:27 smithi133 ceph-mon[125939]: osdmap e1300: 12 total, 12 up, 12 in 2023-05-08T13:54:27.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:27 smithi096 ceph-mon[124666]: osdmap e1300: 12 total, 12 up, 12 in 2023-05-08T13:54:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:28 smithi186 ceph-mon[126480]: pgmap v19577: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 663 KiB/s rd, 719 KiB/s wr, 13 op/s 2023-05-08T13:54:28.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:28 smithi133 ceph-mon[125939]: pgmap v19577: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 663 KiB/s rd, 719 KiB/s wr, 13 op/s 2023-05-08T13:54:28.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:28 smithi096 ceph-mon[124666]: pgmap v19577: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 663 KiB/s rd, 719 KiB/s wr, 13 op/s 2023-05-08T13:54:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36608.406718 secs 2023-05-08T13:54:29.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36608.406718 secs 2023-05-08T13:54:29.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36608.406718 secs 2023-05-08T13:54:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:30 smithi186 ceph-mon[126480]: pgmap v19578: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 663 KiB/s rd, 719 KiB/s wr, 13 op/s 2023-05-08T13:54:30.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:30 smithi133 ceph-mon[125939]: pgmap v19578: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 663 KiB/s rd, 719 KiB/s wr, 13 op/s 2023-05-08T13:54:30.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:30 smithi096 ceph-mon[124666]: pgmap v19578: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 663 KiB/s rd, 719 KiB/s wr, 13 op/s 2023-05-08T13:54:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:32 smithi186 ceph-mon[126480]: pgmap v19579: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 573 KiB/s wr, 8 op/s 2023-05-08T13:54:32.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:32 smithi133 ceph-mon[125939]: pgmap v19579: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 573 KiB/s wr, 8 op/s 2023-05-08T13:54:32.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:32 smithi096 ceph-mon[124666]: pgmap v19579: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 573 KiB/s wr, 8 op/s 2023-05-08T13:54:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:33 smithi186 ceph-mon[126480]: osdmap e1301: 12 total, 12 up, 12 in 2023-05-08T13:54:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:33 smithi186 ceph-mon[126480]: pgmap v19581: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 672 KiB/s wr, 6 op/s 2023-05-08T13:54:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36613.406846 secs 2023-05-08T13:54:34.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:33 smithi133 ceph-mon[125939]: osdmap e1301: 12 total, 12 up, 12 in 2023-05-08T13:54:34.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:33 smithi133 ceph-mon[125939]: pgmap v19581: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 672 KiB/s wr, 6 op/s 2023-05-08T13:54:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36613.406846 secs 2023-05-08T13:54:34.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:33 smithi096 ceph-mon[124666]: osdmap e1301: 12 total, 12 up, 12 in 2023-05-08T13:54:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:33 smithi096 ceph-mon[124666]: pgmap v19581: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 672 KiB/s wr, 6 op/s 2023-05-08T13:54:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36613.406846 secs 2023-05-08T13:54:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:36 smithi186 ceph-mon[126480]: pgmap v19582: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T13:54:36.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:36 smithi133 ceph-mon[125939]: pgmap v19582: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T13:54:36.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:36 smithi096 ceph-mon[124666]: pgmap v19582: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T13:54:37.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:37 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36615.302220 secs 2023-05-08T13:54:37.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:37 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36615.302220 secs 2023-05-08T13:54:37.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:37 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36615.302220 secs 2023-05-08T13:54:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:38 smithi186 ceph-mon[126480]: pgmap v19583: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T13:54:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:38 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:54:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:38 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:54:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:38 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:54:38.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:38 smithi133 ceph-mon[125939]: pgmap v19583: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T13:54:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:38 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:54:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:38 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:54:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:38 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:54:38.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:38 smithi096 ceph-mon[124666]: pgmap v19583: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T13:54:38.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:38 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:54:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:38 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:54:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:38 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:54:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36618.406968 secs 2023-05-08T13:54:39.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36618.406968 secs 2023-05-08T13:54:39.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36618.406968 secs 2023-05-08T13:54:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:40 smithi186 ceph-mon[126480]: pgmap v19584: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T13:54:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36618.962362 secs 2023-05-08T13:54:40.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:40 smithi133 ceph-mon[125939]: pgmap v19584: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T13:54:40.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36618.962362 secs 2023-05-08T13:54:40.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:40 smithi096 ceph-mon[124666]: pgmap v19584: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T13:54:40.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36618.962362 secs 2023-05-08T13:54:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:42 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36620.302333 secs 2023-05-08T13:54:42.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:42 smithi186 ceph-mon[126480]: pgmap v19585: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T13:54:42.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:42 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:54:42.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:42 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:54:42.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:42 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36620.302333 secs 2023-05-08T13:54:42.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:42 smithi133 ceph-mon[125939]: pgmap v19585: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T13:54:42.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:42 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:54:42.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:42 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:54:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:42 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36620.302333 secs 2023-05-08T13:54:42.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:42 smithi096 ceph-mon[124666]: pgmap v19585: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T13:54:42.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:42 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:54:42.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:42 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:54:43.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:43 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:54:43.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:43 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:54:43.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:43 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:54:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:44 smithi186 ceph-mon[126480]: pgmap v19586: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T13:54:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36623.407071 secs 2023-05-08T13:54:44.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:44 smithi133 ceph-mon[125939]: pgmap v19586: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T13:54:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36623.407071 secs 2023-05-08T13:54:44.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:44 smithi096 ceph-mon[124666]: pgmap v19586: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T13:54:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36623.407071 secs 2023-05-08T13:54:45.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36623.962485 secs 2023-05-08T13:54:45.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:54:45.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36623.962485 secs 2023-05-08T13:54:45.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:54:45.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36623.962485 secs 2023-05-08T13:54:45.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:54:46.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:46 smithi186 ceph-mon[126480]: pgmap v19587: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.5 MiB/s wr, 12 op/s 2023-05-08T13:54:46.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:46 smithi133 ceph-mon[125939]: pgmap v19587: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.5 MiB/s wr, 12 op/s 2023-05-08T13:54:46.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:46 smithi096 ceph-mon[124666]: pgmap v19587: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.5 MiB/s wr, 12 op/s 2023-05-08T13:54:48.301 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:48 smithi186 ceph-mon[126480]: pgmap v19588: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 988 KiB/s rd, 1.2 MiB/s wr, 9 op/s 2023-05-08T13:54:48.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:48 smithi133 ceph-mon[125939]: pgmap v19588: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 988 KiB/s rd, 1.2 MiB/s wr, 9 op/s 2023-05-08T13:54:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:48 smithi096 ceph-mon[124666]: pgmap v19588: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 988 KiB/s rd, 1.2 MiB/s wr, 9 op/s 2023-05-08T13:54:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:49 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:54:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:49 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:54:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:49 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:54:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:49 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:54:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:49 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:54:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:49 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:54:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:49 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T13:54:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:49 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T13:54:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:49 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:54:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36628.407229 secs 2023-05-08T13:54:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:54:49.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:49 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:54:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:49 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:54:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:49 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:54:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:49 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:54:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:49 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:54:49.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:49 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:54:49.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:49 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T13:54:49.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:49 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T13:54:49.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:49 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:54:49.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36628.407229 secs 2023-05-08T13:54:49.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:54:49.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:49 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:54:49.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:49 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:54:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:49 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:54:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:49 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:54:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:49 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:54:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:49 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:54:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:49 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T13:54:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:49 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T13:54:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:49 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:54:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36628.407229 secs 2023-05-08T13:54:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:54:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:50 smithi186 ceph-mon[126480]: pgmap v19589: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 639 KiB/s rd, 843 KiB/s wr, 8 op/s 2023-05-08T13:54:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36628.962537 secs 2023-05-08T13:54:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:54:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:54:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:54:50.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:50 smithi133 ceph-mon[125939]: pgmap v19589: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 639 KiB/s rd, 843 KiB/s wr, 8 op/s 2023-05-08T13:54:50.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36628.962537 secs 2023-05-08T13:54:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:54:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:54:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:54:50.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:50 smithi096 ceph-mon[124666]: pgmap v19589: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 639 KiB/s rd, 843 KiB/s wr, 8 op/s 2023-05-08T13:54:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36628.962537 secs 2023-05-08T13:54:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:54:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:54:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:54:52.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:52 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36630.302512 secs 2023-05-08T13:54:52.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:52 smithi186 ceph-mon[126480]: pgmap v19590: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2023-05-08T13:54:52.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:52 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36630.302512 secs 2023-05-08T13:54:52.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:52 smithi133 ceph-mon[125939]: pgmap v19590: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2023-05-08T13:54:52.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:52 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36630.302512 secs 2023-05-08T13:54:52.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:52 smithi096 ceph-mon[124666]: pgmap v19590: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2023-05-08T13:54:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:53 smithi186 ceph-mon[126480]: pgmap v19591: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.0 MiB/s wr, 8 op/s 2023-05-08T13:54:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36633.407321 secs 2023-05-08T13:54:54.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:53 smithi133 ceph-mon[125939]: pgmap v19591: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.0 MiB/s wr, 8 op/s 2023-05-08T13:54:54.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36633.407321 secs 2023-05-08T13:54:54.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:53 smithi096 ceph-mon[124666]: pgmap v19591: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.0 MiB/s wr, 8 op/s 2023-05-08T13:54:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36633.407321 secs 2023-05-08T13:54:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:54 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:54:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:54 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:54:55.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:54 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:54:55.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:54 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:54:55.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:54 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:54:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:54 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:54:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:55 smithi186 ceph-mon[126480]: pgmap v19592: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 14 op/s 2023-05-08T13:54:56.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:55 smithi133 ceph-mon[125939]: pgmap v19592: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 14 op/s 2023-05-08T13:54:56.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:55 smithi096 ceph-mon[124666]: pgmap v19592: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 14 op/s 2023-05-08T13:54:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36635.302632 secs 2023-05-08T13:54:57.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36635.302632 secs 2023-05-08T13:54:57.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36635.302632 secs 2023-05-08T13:54:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:57 smithi186 ceph-mon[126480]: pgmap v19593: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.9 MiB/s wr, 12 op/s 2023-05-08T13:54:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:54:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:57 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:54:58.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:57 smithi133 ceph-mon[125939]: pgmap v19593: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.9 MiB/s wr, 12 op/s 2023-05-08T13:54:58.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:54:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:57 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:54:58.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:57 smithi096 ceph-mon[124666]: pgmap v19593: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.9 MiB/s wr, 12 op/s 2023-05-08T13:54:58.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:54:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:57 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:54:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:54:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:54:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:58 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36638.407465 secs 2023-05-08T13:54:59.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:54:59.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:54:59.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:58 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36638.407465 secs 2023-05-08T13:54:59.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:54:59.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:54:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:58 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36638.407465 secs 2023-05-08T13:55:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:54:59 smithi186 ceph-mon[126480]: pgmap v19594: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.9 MiB/s wr, 11 op/s 2023-05-08T13:55:00.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:54:59 smithi133 ceph-mon[125939]: pgmap v19594: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.9 MiB/s wr, 11 op/s 2023-05-08T13:55:00.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:54:59 smithi096 ceph-mon[124666]: pgmap v19594: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.9 MiB/s wr, 11 op/s 2023-05-08T13:55:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36638.962779 secs 2023-05-08T13:55:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36638.962779 secs 2023-05-08T13:55:01.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36638.962779 secs 2023-05-08T13:55:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36640.302748 secs 2023-05-08T13:55:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:01 smithi186 ceph-mon[126480]: pgmap v19595: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 2.6 MiB/s wr, 19 op/s 2023-05-08T13:55:02.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36640.302748 secs 2023-05-08T13:55:02.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:01 smithi133 ceph-mon[125939]: pgmap v19595: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 2.6 MiB/s wr, 19 op/s 2023-05-08T13:55:02.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36640.302748 secs 2023-05-08T13:55:02.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:01 smithi096 ceph-mon[124666]: pgmap v19595: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 2.6 MiB/s wr, 19 op/s 2023-05-08T13:55:03.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:55:03.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:55:03.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:55:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:55:03.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:55:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:55:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:03 smithi186 ceph-mon[126480]: pgmap v19596: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.1 MiB/s wr, 13 op/s 2023-05-08T13:55:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36643.407606 secs 2023-05-08T13:55:04.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:03 smithi133 ceph-mon[125939]: pgmap v19596: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.1 MiB/s wr, 13 op/s 2023-05-08T13:55:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36643.407606 secs 2023-05-08T13:55:04.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:03 smithi096 ceph-mon[124666]: pgmap v19596: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.1 MiB/s wr, 13 op/s 2023-05-08T13:55:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36643.407606 secs 2023-05-08T13:55:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36643.962855 secs 2023-05-08T13:55:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:06 smithi186 ceph-mon[126480]: pgmap v19597: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.4 MiB/s wr, 35 op/s 2023-05-08T13:55:06.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36643.962855 secs 2023-05-08T13:55:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:06 smithi133 ceph-mon[125939]: pgmap v19597: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.4 MiB/s wr, 35 op/s 2023-05-08T13:55:06.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36643.962855 secs 2023-05-08T13:55:06.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:06 smithi096 ceph-mon[124666]: pgmap v19597: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.4 MiB/s wr, 35 op/s 2023-05-08T13:55:07.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:07 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36645.302867 secs 2023-05-08T13:55:07.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:07 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36645.302867 secs 2023-05-08T13:55:07.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:07 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36645.302867 secs 2023-05-08T13:55:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:08 smithi186 ceph-mon[126480]: pgmap v19598: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.3 MiB/s wr, 29 op/s 2023-05-08T13:55:08.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:08 smithi133 ceph-mon[125939]: pgmap v19598: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.3 MiB/s wr, 29 op/s 2023-05-08T13:55:08.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:08 smithi096 ceph-mon[124666]: pgmap v19598: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.3 MiB/s wr, 29 op/s 2023-05-08T13:55:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36648.407724 secs 2023-05-08T13:55:09.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36648.407724 secs 2023-05-08T13:55:09.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36648.407724 secs 2023-05-08T13:55:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:10 smithi186 ceph-mon[126480]: pgmap v19599: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.0 MiB/s wr, 29 op/s 2023-05-08T13:55:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36648.962979 secs 2023-05-08T13:55:10.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:10 smithi133 ceph-mon[125939]: pgmap v19599: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.0 MiB/s wr, 29 op/s 2023-05-08T13:55:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36648.962979 secs 2023-05-08T13:55:10.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:10 smithi096 ceph-mon[124666]: pgmap v19599: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.0 MiB/s wr, 29 op/s 2023-05-08T13:55:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36648.962979 secs 2023-05-08T13:55:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:12 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36650.303002 secs 2023-05-08T13:55:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:12 smithi186 ceph-mon[126480]: pgmap v19600: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 2.4 MiB/s wr, 34 op/s 2023-05-08T13:55:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:12 smithi186 ceph-mon[126480]: osdmap e1302: 12 total, 12 up, 12 in 2023-05-08T13:55:12.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:12 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36650.303002 secs 2023-05-08T13:55:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:12 smithi133 ceph-mon[125939]: pgmap v19600: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 2.4 MiB/s wr, 34 op/s 2023-05-08T13:55:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:12 smithi133 ceph-mon[125939]: osdmap e1302: 12 total, 12 up, 12 in 2023-05-08T13:55:12.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:12 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36650.303002 secs 2023-05-08T13:55:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:12 smithi096 ceph-mon[124666]: pgmap v19600: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 2.4 MiB/s wr, 34 op/s 2023-05-08T13:55:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:12 smithi096 ceph-mon[124666]: osdmap e1302: 12 total, 12 up, 12 in 2023-05-08T13:55:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:13 smithi186 ceph-mon[126480]: pgmap v19602: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 32 op/s 2023-05-08T13:55:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36653.407841 secs 2023-05-08T13:55:14.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:13 smithi133 ceph-mon[125939]: pgmap v19602: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 32 op/s 2023-05-08T13:55:14.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36653.407841 secs 2023-05-08T13:55:14.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:13 smithi096 ceph-mon[124666]: pgmap v19602: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 32 op/s 2023-05-08T13:55:14.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36653.407841 secs 2023-05-08T13:55:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36653.963043 secs 2023-05-08T13:55:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:16 smithi186 ceph-mon[126480]: pgmap v19603: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 676 KiB/s rd, 674 KiB/s wr, 11 op/s 2023-05-08T13:55:16.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36653.963043 secs 2023-05-08T13:55:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:16 smithi133 ceph-mon[125939]: pgmap v19603: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 676 KiB/s rd, 674 KiB/s wr, 11 op/s 2023-05-08T13:55:16.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36653.963043 secs 2023-05-08T13:55:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:16 smithi096 ceph-mon[124666]: pgmap v19603: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 676 KiB/s rd, 674 KiB/s wr, 11 op/s 2023-05-08T13:55:17.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:17 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36655.303099 secs 2023-05-08T13:55:17.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:17 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36655.303099 secs 2023-05-08T13:55:17.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:17 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36655.303099 secs 2023-05-08T13:55:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:18 smithi186 ceph-mon[126480]: pgmap v19604: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 676 KiB/s rd, 674 KiB/s wr, 11 op/s 2023-05-08T13:55:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:18 smithi186 ceph-mon[126480]: osdmap e1303: 12 total, 12 up, 12 in 2023-05-08T13:55:18.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:18 smithi133 ceph-mon[125939]: pgmap v19604: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 676 KiB/s rd, 674 KiB/s wr, 11 op/s 2023-05-08T13:55:18.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:18 smithi133 ceph-mon[125939]: osdmap e1303: 12 total, 12 up, 12 in 2023-05-08T13:55:18.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:18 smithi096 ceph-mon[124666]: pgmap v19604: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 676 KiB/s rd, 674 KiB/s wr, 11 op/s 2023-05-08T13:55:18.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:18 smithi096 ceph-mon[124666]: osdmap e1303: 12 total, 12 up, 12 in 2023-05-08T13:55:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36658.407984 secs 2023-05-08T13:55:19.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36658.407984 secs 2023-05-08T13:55:19.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36658.407984 secs 2023-05-08T13:55:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:20 smithi186 ceph-mon[126480]: pgmap v19606: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 265 KiB/s wr, 6 op/s 2023-05-08T13:55:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36658.963179 secs 2023-05-08T13:55:20.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:20 smithi133 ceph-mon[125939]: pgmap v19606: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 265 KiB/s wr, 6 op/s 2023-05-08T13:55:20.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36658.963179 secs 2023-05-08T13:55:20.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:20 smithi096 ceph-mon[124666]: pgmap v19606: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 265 KiB/s wr, 6 op/s 2023-05-08T13:55:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36658.963179 secs 2023-05-08T13:55:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:22 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36660.303224 secs 2023-05-08T13:55:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:22 smithi186 ceph-mon[126480]: pgmap v19607: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 444 KiB/s wr, 9 op/s 2023-05-08T13:55:22.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:22 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36660.303224 secs 2023-05-08T13:55:22.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:22 smithi133 ceph-mon[125939]: pgmap v19607: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 444 KiB/s wr, 9 op/s 2023-05-08T13:55:22.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:22 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36660.303224 secs 2023-05-08T13:55:22.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:22 smithi096 ceph-mon[124666]: pgmap v19607: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 444 KiB/s wr, 9 op/s 2023-05-08T13:55:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:23 smithi186 ceph-mon[126480]: pgmap v19608: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 410 KiB/s rd, 440 KiB/s wr, 9 op/s 2023-05-08T13:55:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36663.408101 secs 2023-05-08T13:55:24.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:23 smithi133 ceph-mon[125939]: pgmap v19608: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 410 KiB/s rd, 440 KiB/s wr, 9 op/s 2023-05-08T13:55:24.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36663.408101 secs 2023-05-08T13:55:24.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:23 smithi096 ceph-mon[124666]: pgmap v19608: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 410 KiB/s rd, 440 KiB/s wr, 9 op/s 2023-05-08T13:55:24.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36663.408101 secs 2023-05-08T13:55:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36663.963313 secs 2023-05-08T13:55:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:26 smithi186 ceph-mon[126480]: pgmap v19609: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 412 KiB/s wr, 8 op/s 2023-05-08T13:55:26.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36663.963313 secs 2023-05-08T13:55:26.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:26 smithi133 ceph-mon[125939]: pgmap v19609: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 412 KiB/s wr, 8 op/s 2023-05-08T13:55:26.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36663.963313 secs 2023-05-08T13:55:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:26 smithi096 ceph-mon[124666]: pgmap v19609: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 412 KiB/s wr, 8 op/s 2023-05-08T13:55:27.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:27 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36665.303347 secs 2023-05-08T13:55:27.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:27 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36665.303347 secs 2023-05-08T13:55:27.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:27 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36665.303347 secs 2023-05-08T13:55:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:28 smithi186 ceph-mon[126480]: pgmap v19610: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 412 KiB/s wr, 8 op/s 2023-05-08T13:55:28.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:28 smithi133 ceph-mon[125939]: pgmap v19610: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 412 KiB/s wr, 8 op/s 2023-05-08T13:55:28.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:28 smithi096 ceph-mon[124666]: pgmap v19610: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 412 KiB/s wr, 8 op/s 2023-05-08T13:55:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36668.408233 secs 2023-05-08T13:55:29.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36668.408233 secs 2023-05-08T13:55:29.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36668.408233 secs 2023-05-08T13:55:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:30 smithi186 ceph-mon[126480]: pgmap v19611: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 367 KiB/s wr, 7 op/s 2023-05-08T13:55:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36668.963431 secs 2023-05-08T13:55:30.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:30 smithi133 ceph-mon[125939]: pgmap v19611: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 367 KiB/s wr, 7 op/s 2023-05-08T13:55:30.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36668.963431 secs 2023-05-08T13:55:30.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:30 smithi096 ceph-mon[124666]: pgmap v19611: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 367 KiB/s wr, 7 op/s 2023-05-08T13:55:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36668.963431 secs 2023-05-08T13:55:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:32 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36670.303468 secs 2023-05-08T13:55:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:32 smithi186 ceph-mon[126480]: pgmap v19612: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 368 KiB/s wr, 11 op/s 2023-05-08T13:55:32.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:32 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36670.303468 secs 2023-05-08T13:55:32.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:32 smithi133 ceph-mon[125939]: pgmap v19612: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 368 KiB/s wr, 11 op/s 2023-05-08T13:55:32.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:32 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36670.303468 secs 2023-05-08T13:55:32.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:32 smithi096 ceph-mon[124666]: pgmap v19612: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 368 KiB/s wr, 11 op/s 2023-05-08T13:55:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:33 smithi186 ceph-mon[126480]: pgmap v19613: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 178 KiB/s wr, 7 op/s 2023-05-08T13:55:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36673.408330 secs 2023-05-08T13:55:34.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:33 smithi133 ceph-mon[125939]: pgmap v19613: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 178 KiB/s wr, 7 op/s 2023-05-08T13:55:34.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36673.408330 secs 2023-05-08T13:55:34.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:33 smithi096 ceph-mon[124666]: pgmap v19613: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 178 KiB/s wr, 7 op/s 2023-05-08T13:55:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36673.408330 secs 2023-05-08T13:55:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36673.963545 secs 2023-05-08T13:55:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:36 smithi186 ceph-mon[126480]: pgmap v19614: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 530 KiB/s rd, 500 KiB/s wr, 11 op/s 2023-05-08T13:55:36.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36673.963545 secs 2023-05-08T13:55:36.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:36 smithi133 ceph-mon[125939]: pgmap v19614: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 530 KiB/s rd, 500 KiB/s wr, 11 op/s 2023-05-08T13:55:36.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36673.963545 secs 2023-05-08T13:55:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:36 smithi096 ceph-mon[124666]: pgmap v19614: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 530 KiB/s rd, 500 KiB/s wr, 11 op/s 2023-05-08T13:55:37.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:37 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36675.303593 secs 2023-05-08T13:55:37.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:37 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36675.303593 secs 2023-05-08T13:55:37.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:37 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36675.303593 secs 2023-05-08T13:55:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:38 smithi186 ceph-mon[126480]: pgmap v19615: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 347 KiB/s wr, 8 op/s 2023-05-08T13:55:38.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:38 smithi133 ceph-mon[125939]: pgmap v19615: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 347 KiB/s wr, 8 op/s 2023-05-08T13:55:38.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:38 smithi096 ceph-mon[124666]: pgmap v19615: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 347 KiB/s wr, 8 op/s 2023-05-08T13:55:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36678.408446 secs 2023-05-08T13:55:39.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36678.408446 secs 2023-05-08T13:55:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36678.408446 secs 2023-05-08T13:55:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:40 smithi186 ceph-mon[126480]: pgmap v19616: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 347 KiB/s wr, 8 op/s 2023-05-08T13:55:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36678.963677 secs 2023-05-08T13:55:40.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:40 smithi133 ceph-mon[125939]: pgmap v19616: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 347 KiB/s wr, 8 op/s 2023-05-08T13:55:40.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36678.963677 secs 2023-05-08T13:55:40.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:40 smithi096 ceph-mon[124666]: pgmap v19616: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 347 KiB/s wr, 8 op/s 2023-05-08T13:55:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36678.963677 secs 2023-05-08T13:55:42.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:42 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36680.303711 secs 2023-05-08T13:55:42.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:42 smithi186 ceph-mon[126480]: pgmap v19617: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 348 KiB/s wr, 11 op/s 2023-05-08T13:55:42.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:42 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36680.303711 secs 2023-05-08T13:55:42.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:42 smithi133 ceph-mon[125939]: pgmap v19617: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 348 KiB/s wr, 11 op/s 2023-05-08T13:55:42.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:42 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36680.303711 secs 2023-05-08T13:55:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:42 smithi096 ceph-mon[124666]: pgmap v19617: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 348 KiB/s wr, 11 op/s 2023-05-08T13:55:44.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:43 smithi186 ceph-mon[126480]: pgmap v19618: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 322 KiB/s wr, 7 op/s 2023-05-08T13:55:44.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36683.408583 secs 2023-05-08T13:55:44.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:43 smithi133 ceph-mon[125939]: pgmap v19618: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 322 KiB/s wr, 7 op/s 2023-05-08T13:55:44.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36683.408583 secs 2023-05-08T13:55:44.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:43 smithi096 ceph-mon[124666]: pgmap v19618: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 322 KiB/s wr, 7 op/s 2023-05-08T13:55:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36683.408583 secs 2023-05-08T13:55:45.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36683.963788 secs 2023-05-08T13:55:45.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36683.963788 secs 2023-05-08T13:55:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36683.963788 secs 2023-05-08T13:55:46.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:46 smithi133 ceph-mon[125939]: pgmap v19619: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 322 KiB/s wr, 10 op/s 2023-05-08T13:55:46.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:46 smithi096 ceph-mon[124666]: pgmap v19619: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 322 KiB/s wr, 10 op/s 2023-05-08T13:55:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:46 smithi186 ceph-mon[126480]: pgmap v19619: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 322 KiB/s wr, 10 op/s 2023-05-08T13:55:48.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:48 smithi133 ceph-mon[125939]: pgmap v19620: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T13:55:48.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:48 smithi096 ceph-mon[124666]: pgmap v19620: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T13:55:48.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:48 smithi186 ceph-mon[126480]: pgmap v19620: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 511 B/s wr, 6 op/s 2023-05-08T13:55:49.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:49 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:55:49.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36688.408666 secs 2023-05-08T13:55:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:55:49.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:49 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:55:49.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36688.408666 secs 2023-05-08T13:55:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:55:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:49 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:55:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36688.408666 secs 2023-05-08T13:55:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:55:50.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:50 smithi133 ceph-mon[125939]: pgmap v19621: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 426 B/s wr, 6 op/s 2023-05-08T13:55:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:55:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:55:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:55:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:55:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:55:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:50 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:55:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36688.963872 secs 2023-05-08T13:55:50.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:55:50.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:50 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T13:55:50.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:50 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T13:55:50.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:50 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:55:50.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:50 smithi096 ceph-mon[124666]: pgmap v19621: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 426 B/s wr, 6 op/s 2023-05-08T13:55:50.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:55:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:55:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:55:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:55:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:55:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:50 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:55:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36688.963872 secs 2023-05-08T13:55:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:55:50.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:50 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T13:55:50.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:50 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T13:55:50.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:50 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:55:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:50 smithi186 ceph-mon[126480]: pgmap v19621: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 426 B/s wr, 6 op/s 2023-05-08T13:55:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:55:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:55:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:55:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:55:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:55:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:50 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:55:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36688.963872 secs 2023-05-08T13:55:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:55:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:50 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T13:55:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:50 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T13:55:50.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:50 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:55:52.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:52 smithi133 ceph-mon[125939]: pgmap v19622: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 485 KiB/s rd, 348 KiB/s wr, 10 op/s 2023-05-08T13:55:52.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:52 smithi096 ceph-mon[124666]: pgmap v19622: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 485 KiB/s rd, 348 KiB/s wr, 10 op/s 2023-05-08T13:55:52.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:52 smithi186 ceph-mon[126480]: pgmap v19622: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 485 KiB/s rd, 348 KiB/s wr, 10 op/s 2023-05-08T13:55:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:53 smithi186 ceph-mon[126480]: pgmap v19623: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 483 KiB/s rd, 347 KiB/s wr, 7 op/s 2023-05-08T13:55:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36693.408782 secs 2023-05-08T13:55:54.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:53 smithi133 ceph-mon[125939]: pgmap v19623: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 483 KiB/s rd, 347 KiB/s wr, 7 op/s 2023-05-08T13:55:54.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36693.408782 secs 2023-05-08T13:55:54.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:53 smithi096 ceph-mon[124666]: pgmap v19623: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 483 KiB/s rd, 347 KiB/s wr, 7 op/s 2023-05-08T13:55:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36693.408782 secs 2023-05-08T13:55:56.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:56 smithi186 ceph-mon[126480]: pgmap v19624: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 985 KiB/s wr, 11 op/s 2023-05-08T13:55:56.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:56 smithi133 ceph-mon[125939]: pgmap v19624: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 985 KiB/s wr, 11 op/s 2023-05-08T13:55:56.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:56 smithi096 ceph-mon[124666]: pgmap v19624: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 985 KiB/s wr, 11 op/s 2023-05-08T13:55:57.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:55:57.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:55:57.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:55:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:58 smithi186 ceph-mon[126480]: pgmap v19625: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1000 KiB/s wr, 9 op/s 2023-05-08T13:55:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:58 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:55:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:55:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:55:58.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:58 smithi133 ceph-mon[125939]: pgmap v19625: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1000 KiB/s wr, 9 op/s 2023-05-08T13:55:58.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:58 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:55:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:55:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:55:58.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:58 smithi096 ceph-mon[124666]: pgmap v19625: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1000 KiB/s wr, 9 op/s 2023-05-08T13:55:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:58 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:55:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:55:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:55:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:55:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36698.408901 secs 2023-05-08T13:55:59.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:55:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36698.408901 secs 2023-05-08T13:55:59.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:55:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36698.408901 secs 2023-05-08T13:56:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:00 smithi186 ceph-mon[126480]: pgmap v19626: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1000 KiB/s wr, 9 op/s 2023-05-08T13:56:00.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:00 smithi133 ceph-mon[125939]: pgmap v19626: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1000 KiB/s wr, 9 op/s 2023-05-08T13:56:00.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:00 smithi096 ceph-mon[124666]: pgmap v19626: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1000 KiB/s wr, 9 op/s 2023-05-08T13:56:02.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:02 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36700.304257 secs 2023-05-08T13:56:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:02 smithi186 ceph-mon[126480]: pgmap v19627: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 15 op/s 2023-05-08T13:56:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:56:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:56:02.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:02 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36700.304257 secs 2023-05-08T13:56:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:02 smithi133 ceph-mon[125939]: pgmap v19627: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 15 op/s 2023-05-08T13:56:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:56:02.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:56:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:02 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36700.304257 secs 2023-05-08T13:56:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:02 smithi096 ceph-mon[124666]: pgmap v19627: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 15 op/s 2023-05-08T13:56:02.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:56:02.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:56:03.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:03 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:56:03.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:03 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:56:03.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:03 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:56:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:04 smithi186 ceph-mon[126480]: pgmap v19628: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 11 op/s 2023-05-08T13:56:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36703.409004 secs 2023-05-08T13:56:04.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:04 smithi133 ceph-mon[125939]: pgmap v19628: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 11 op/s 2023-05-08T13:56:04.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36703.409004 secs 2023-05-08T13:56:04.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:04 smithi096 ceph-mon[124666]: pgmap v19628: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 11 op/s 2023-05-08T13:56:04.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36703.409004 secs 2023-05-08T13:56:05.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36703.964233 secs 2023-05-08T13:56:05.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36703.964233 secs 2023-05-08T13:56:05.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36703.964233 secs 2023-05-08T13:56:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:06 smithi186 ceph-mon[126480]: pgmap v19629: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 29 op/s 2023-05-08T13:56:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:56:06.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:56:06.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:06 smithi133 ceph-mon[125939]: pgmap v19629: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 29 op/s 2023-05-08T13:56:06.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:56:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:56:06.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:06 smithi096 ceph-mon[124666]: pgmap v19629: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 29 op/s 2023-05-08T13:56:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:56:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:56:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:08 smithi186 ceph-mon[126480]: pgmap v19630: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 25 op/s 2023-05-08T13:56:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:08 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:56:08.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:08 smithi133 ceph-mon[125939]: pgmap v19630: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 25 op/s 2023-05-08T13:56:08.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:08 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:56:08.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:08 smithi096 ceph-mon[124666]: pgmap v19630: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 25 op/s 2023-05-08T13:56:08.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:08 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:56:09.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36708.409120 secs 2023-05-08T13:56:09.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:09 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:56:09.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36708.409120 secs 2023-05-08T13:56:09.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:09 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:56:09.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36708.409120 secs 2023-05-08T13:56:09.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:09 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:56:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:10 smithi186 ceph-mon[126480]: pgmap v19631: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 24 op/s 2023-05-08T13:56:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:10 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:56:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:10 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:56:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36708.964334 secs 2023-05-08T13:56:10.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:10 smithi133 ceph-mon[125939]: pgmap v19631: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 24 op/s 2023-05-08T13:56:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:10 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:56:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:10 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:56:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36708.964334 secs 2023-05-08T13:56:10.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:10 smithi096 ceph-mon[124666]: pgmap v19631: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 24 op/s 2023-05-08T13:56:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:10 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:56:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:10 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:56:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36708.964334 secs 2023-05-08T13:56:12.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:12 smithi133 ceph-mon[125939]: pgmap v19632: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 28 op/s 2023-05-08T13:56:12.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:12 smithi096 ceph-mon[124666]: pgmap v19632: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 28 op/s 2023-05-08T13:56:12.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:12 smithi186 ceph-mon[126480]: pgmap v19632: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 28 op/s 2023-05-08T13:56:13.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:13 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:56:13.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:13 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:56:13.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:13 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:56:14.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:14 smithi133 ceph-mon[125939]: pgmap v19633: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 607 KiB/s rd, 675 KiB/s wr, 22 op/s 2023-05-08T13:56:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36713.409234 secs 2023-05-08T13:56:14.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:14 smithi096 ceph-mon[124666]: pgmap v19633: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 607 KiB/s rd, 675 KiB/s wr, 22 op/s 2023-05-08T13:56:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36713.409234 secs 2023-05-08T13:56:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:14 smithi186 ceph-mon[126480]: pgmap v19633: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 607 KiB/s rd, 675 KiB/s wr, 22 op/s 2023-05-08T13:56:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36713.409234 secs 2023-05-08T13:56:15.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36713.964430 secs 2023-05-08T13:56:15.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36713.964430 secs 2023-05-08T13:56:15.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36713.964430 secs 2023-05-08T13:56:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:16 smithi133 ceph-mon[125939]: pgmap v19634: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 766 KiB/s rd, 832 KiB/s wr, 25 op/s 2023-05-08T13:56:16.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:16 smithi096 ceph-mon[124666]: pgmap v19634: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 766 KiB/s rd, 832 KiB/s wr, 25 op/s 2023-05-08T13:56:16.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:16 smithi186 ceph-mon[126480]: pgmap v19634: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 766 KiB/s rd, 832 KiB/s wr, 25 op/s 2023-05-08T13:56:18.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:18 smithi133 ceph-mon[125939]: pgmap v19635: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 503 KiB/s wr, 8 op/s 2023-05-08T13:56:18.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:18 smithi096 ceph-mon[124666]: pgmap v19635: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 503 KiB/s wr, 8 op/s 2023-05-08T13:56:18.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:18 smithi186 ceph-mon[126480]: pgmap v19635: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 503 KiB/s wr, 8 op/s 2023-05-08T13:56:19.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36718.409369 secs 2023-05-08T13:56:19.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36718.409369 secs 2023-05-08T13:56:19.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36718.409369 secs 2023-05-08T13:56:20.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:20 smithi133 ceph-mon[125939]: pgmap v19636: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 502 KiB/s wr, 8 op/s 2023-05-08T13:56:20.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36718.964549 secs 2023-05-08T13:56:20.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:20 smithi096 ceph-mon[124666]: pgmap v19636: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 502 KiB/s wr, 8 op/s 2023-05-08T13:56:20.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36718.964549 secs 2023-05-08T13:56:20.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:20 smithi186 ceph-mon[126480]: pgmap v19636: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 502 KiB/s wr, 8 op/s 2023-05-08T13:56:20.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36718.964549 secs 2023-05-08T13:56:22.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:22 smithi133 ceph-mon[125939]: pgmap v19637: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 535 KiB/s rd, 874 KiB/s wr, 11 op/s 2023-05-08T13:56:22.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:22 smithi096 ceph-mon[124666]: pgmap v19637: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 535 KiB/s rd, 874 KiB/s wr, 11 op/s 2023-05-08T13:56:22.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:22 smithi186 ceph-mon[126480]: pgmap v19637: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 535 KiB/s rd, 874 KiB/s wr, 11 op/s 2023-05-08T13:56:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:23 smithi186 ceph-mon[126480]: pgmap v19638: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 816 KiB/s wr, 7 op/s 2023-05-08T13:56:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36723.409464 secs 2023-05-08T13:56:24.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:23 smithi133 ceph-mon[125939]: pgmap v19638: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 816 KiB/s wr, 7 op/s 2023-05-08T13:56:24.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36723.409464 secs 2023-05-08T13:56:24.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:23 smithi096 ceph-mon[124666]: pgmap v19638: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 816 KiB/s wr, 7 op/s 2023-05-08T13:56:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36723.409464 secs 2023-05-08T13:56:25.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:25 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:56:25.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:25 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:56:25.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:25 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:56:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:26 smithi186 ceph-mon[126480]: pgmap v19639: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.3 MiB/s wr, 13 op/s 2023-05-08T13:56:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:26 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:56:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:26 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:56:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:26 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:56:26.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:26 smithi133 ceph-mon[125939]: pgmap v19639: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.3 MiB/s wr, 13 op/s 2023-05-08T13:56:26.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:26 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:56:26.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:26 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:56:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:26 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:56:26.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:26 smithi096 ceph-mon[124666]: pgmap v19639: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.3 MiB/s wr, 13 op/s 2023-05-08T13:56:26.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:26 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:56:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:26 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:56:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:26 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:56:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:28 smithi186 ceph-mon[126480]: pgmap v19640: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T13:56:28.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:28 smithi133 ceph-mon[125939]: pgmap v19640: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T13:56:28.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:28 smithi096 ceph-mon[124666]: pgmap v19640: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T13:56:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36728.409530 secs 2023-05-08T13:56:29.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36728.409530 secs 2023-05-08T13:56:29.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36728.409530 secs 2023-05-08T13:56:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:30 smithi186 ceph-mon[126480]: pgmap v19641: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 872 KiB/s rd, 891 KiB/s wr, 10 op/s 2023-05-08T13:56:30.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:30 smithi133 ceph-mon[125939]: pgmap v19641: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 872 KiB/s rd, 891 KiB/s wr, 10 op/s 2023-05-08T13:56:30.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:30 smithi096 ceph-mon[124666]: pgmap v19641: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 872 KiB/s rd, 891 KiB/s wr, 10 op/s 2023-05-08T13:56:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:32 smithi186 ceph-mon[126480]: pgmap v19642: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 903 KiB/s rd, 922 KiB/s wr, 14 op/s 2023-05-08T13:56:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:32 smithi186 ceph-mon[126480]: osdmap e1304: 12 total, 12 up, 12 in 2023-05-08T13:56:32.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:32 smithi133 ceph-mon[125939]: pgmap v19642: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 903 KiB/s rd, 922 KiB/s wr, 14 op/s 2023-05-08T13:56:32.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:32 smithi133 ceph-mon[125939]: osdmap e1304: 12 total, 12 up, 12 in 2023-05-08T13:56:32.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:32 smithi096 ceph-mon[124666]: pgmap v19642: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 903 KiB/s rd, 922 KiB/s wr, 14 op/s 2023-05-08T13:56:32.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:32 smithi096 ceph-mon[124666]: osdmap e1304: 12 total, 12 up, 12 in 2023-05-08T13:56:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:33 smithi186 ceph-mon[126480]: pgmap v19644: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 661 KiB/s wr, 13 op/s 2023-05-08T13:56:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36733.409647 secs 2023-05-08T13:56:34.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:33 smithi133 ceph-mon[125939]: pgmap v19644: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 661 KiB/s wr, 13 op/s 2023-05-08T13:56:34.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36733.409647 secs 2023-05-08T13:56:34.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:33 smithi096 ceph-mon[124666]: pgmap v19644: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 661 KiB/s wr, 13 op/s 2023-05-08T13:56:34.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36733.409647 secs 2023-05-08T13:56:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:36 smithi186 ceph-mon[126480]: pgmap v19645: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 633 KiB/s rd, 417 KiB/s wr, 10 op/s 2023-05-08T13:56:36.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:36 smithi133 ceph-mon[125939]: pgmap v19645: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 633 KiB/s rd, 417 KiB/s wr, 10 op/s 2023-05-08T13:56:36.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:36 smithi096 ceph-mon[124666]: pgmap v19645: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 633 KiB/s rd, 417 KiB/s wr, 10 op/s 2023-05-08T13:56:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:38 smithi186 ceph-mon[126480]: pgmap v19646: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 417 KiB/s wr, 9 op/s 2023-05-08T13:56:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:38 smithi186 ceph-mon[126480]: osdmap e1305: 12 total, 12 up, 12 in 2023-05-08T13:56:38.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:38 smithi133 ceph-mon[125939]: pgmap v19646: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 417 KiB/s wr, 9 op/s 2023-05-08T13:56:38.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:38 smithi133 ceph-mon[125939]: osdmap e1305: 12 total, 12 up, 12 in 2023-05-08T13:56:38.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:38 smithi096 ceph-mon[124666]: pgmap v19646: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 417 KiB/s wr, 9 op/s 2023-05-08T13:56:38.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:38 smithi096 ceph-mon[124666]: osdmap e1305: 12 total, 12 up, 12 in 2023-05-08T13:56:39.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36738.409740 secs 2023-05-08T13:56:39.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36738.409740 secs 2023-05-08T13:56:39.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36738.409740 secs 2023-05-08T13:56:40.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:40 smithi186 ceph-mon[126480]: pgmap v19648: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 476 KiB/s wr, 5 op/s 2023-05-08T13:56:40.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:40 smithi133 ceph-mon[125939]: pgmap v19648: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 476 KiB/s wr, 5 op/s 2023-05-08T13:56:40.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:40 smithi096 ceph-mon[124666]: pgmap v19648: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 476 KiB/s wr, 5 op/s 2023-05-08T13:56:41.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:41 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:56:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:41 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:56:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:41 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:56:41.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:41 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:56:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:41 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:56:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:41 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:56:41.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:41 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:56:41.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:41 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:56:41.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:41 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:56:42.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:42 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36740.305179 secs 2023-05-08T13:56:42.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:42 smithi133 ceph-mon[125939]: pgmap v19649: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 570 KiB/s wr, 8 op/s 2023-05-08T13:56:42.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:42 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36740.305179 secs 2023-05-08T13:56:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:42 smithi096 ceph-mon[124666]: pgmap v19649: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 570 KiB/s wr, 8 op/s 2023-05-08T13:56:42.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:42 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36740.305179 secs 2023-05-08T13:56:42.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:42 smithi186 ceph-mon[126480]: pgmap v19649: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 570 KiB/s wr, 8 op/s 2023-05-08T13:56:44.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:43 smithi186 ceph-mon[126480]: pgmap v19650: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 384 KiB/s rd, 566 KiB/s wr, 8 op/s 2023-05-08T13:56:44.143 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36743.409863 secs 2023-05-08T13:56:44.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:43 smithi133 ceph-mon[125939]: pgmap v19650: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 384 KiB/s rd, 566 KiB/s wr, 8 op/s 2023-05-08T13:56:44.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36743.409863 secs 2023-05-08T13:56:44.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:43 smithi096 ceph-mon[124666]: pgmap v19650: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 384 KiB/s rd, 566 KiB/s wr, 8 op/s 2023-05-08T13:56:44.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36743.409863 secs 2023-05-08T13:56:45.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36743.965052 secs 2023-05-08T13:56:45.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:45 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:56:45.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:45 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:56:45.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36743.965052 secs 2023-05-08T13:56:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:45 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:56:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:45 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:56:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36743.965052 secs 2023-05-08T13:56:45.671 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:45 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:56:45.672 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:45 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:56:46.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:46 smithi133 ceph-mon[125939]: pgmap v19651: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 11 op/s 2023-05-08T13:56:46.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:46 smithi096 ceph-mon[124666]: pgmap v19651: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 11 op/s 2023-05-08T13:56:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:46 smithi186 ceph-mon[126480]: pgmap v19651: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 11 op/s 2023-05-08T13:56:48.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:48 smithi133 ceph-mon[125939]: pgmap v19652: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.8 MiB/s wr, 12 op/s 2023-05-08T13:56:48.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:48 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:56:48.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:48 smithi096 ceph-mon[124666]: pgmap v19652: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.8 MiB/s wr, 12 op/s 2023-05-08T13:56:48.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:48 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:56:48.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:48 smithi186 ceph-mon[126480]: pgmap v19652: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.8 MiB/s wr, 12 op/s 2023-05-08T13:56:48.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:48 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:56:49.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36748.409984 secs 2023-05-08T13:56:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:56:49.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36748.409984 secs 2023-05-08T13:56:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:56:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36748.409984 secs 2023-05-08T13:56:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:56:50.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:50 smithi133 ceph-mon[125939]: pgmap v19653: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 11 op/s 2023-05-08T13:56:50.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:56:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:56:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36748.965167 secs 2023-05-08T13:56:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:56:50.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:50 smithi096 ceph-mon[124666]: pgmap v19653: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 11 op/s 2023-05-08T13:56:50.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:56:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:56:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36748.965167 secs 2023-05-08T13:56:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:56:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:50 smithi186 ceph-mon[126480]: pgmap v19653: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 11 op/s 2023-05-08T13:56:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:56:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:56:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36748.965167 secs 2023-05-08T13:56:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:56:52.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:52 smithi133 ceph-mon[125939]: pgmap v19654: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 15 op/s 2023-05-08T13:56:52.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:56:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:56:52.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:52 smithi096 ceph-mon[124666]: pgmap v19654: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 15 op/s 2023-05-08T13:56:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:56:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:56:52.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:52 smithi186 ceph-mon[126480]: pgmap v19654: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 15 op/s 2023-05-08T13:56:52.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:56:52.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:56:53.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:53 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:56:53.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:53 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:56:53.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:53 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:56:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:53 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:56:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:53 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:56:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:53 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:56:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:53 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:56:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:53 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:56:53.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:53 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:56:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:53 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:56:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:53 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:56:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:53 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:56:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:53 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:56:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:53 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:56:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:53 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:56:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:53 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:56:53.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:53 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:56:53.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:53 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:56:53.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:53 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:56:53.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:53 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:56:53.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:53 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:56:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:53 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:56:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:53 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:56:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:53 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:56:54.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:54 smithi133 ceph-mon[125939]: pgmap v19655: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 11 op/s 2023-05-08T13:56:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:56:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:56:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:56:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:56:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:56:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:56:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:54 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi186 to 92681k 2023-05-08T13:56:54.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:54 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi186 to 94905782: error parsing value: Value '94905782' is below minimum 939524096 2023-05-08T13:56:54.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:56:54.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:56:54.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:56:54.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:56:54.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:56:54.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:56:54.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:56:54.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:56:54.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:56:54.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36753.410072 secs 2023-05-08T13:56:54.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:54 smithi096 ceph-mon[124666]: pgmap v19655: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 11 op/s 2023-05-08T13:56:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:56:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:56:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:56:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:56:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:56:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:56:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:54 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi186 to 92681k 2023-05-08T13:56:54.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:54 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi186 to 94905782: error parsing value: Value '94905782' is below minimum 939524096 2023-05-08T13:56:54.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:56:54.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:56:54.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:56:54.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:56:54.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:56:54.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:56:54.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:56:54.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:56:54.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:56:54.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36753.410072 secs 2023-05-08T13:56:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:54 smithi186 ceph-mon[126480]: pgmap v19655: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 11 op/s 2023-05-08T13:56:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:56:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:56:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:56:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:56:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:56:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:56:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:54 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi186 to 92681k 2023-05-08T13:56:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:54 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi186 to 94905782: error parsing value: Value '94905782' is below minimum 939524096 2023-05-08T13:56:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:56:54.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:56:54.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:56:54.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:56:54.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:56:54.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T13:56:54.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:56:54.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:56:54.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:56:54.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36753.410072 secs 2023-05-08T13:56:55.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:55 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi133 to 109.1M 2023-05-08T13:56:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:55 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi133 to 114484367: error parsing value: Value '114484367' is below minimum 939524096 2023-05-08T13:56:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:55 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:56:55.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:55 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T13:56:55.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:55 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T13:56:55.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:55 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:56:55.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:55 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi133 to 109.1M 2023-05-08T13:56:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:55 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi133 to 114484367: error parsing value: Value '114484367' is below minimum 939524096 2023-05-08T13:56:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:55 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:56:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:55 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T13:56:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:55 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T13:56:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:55 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:56:55.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:55 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi133 to 109.1M 2023-05-08T13:56:55.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:55 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi133 to 114484367: error parsing value: Value '114484367' is below minimum 939524096 2023-05-08T13:56:55.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:55 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:56:55.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:55 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T13:56:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:55 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T13:56:55.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:55 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:56:56.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:56 smithi133 ceph-mon[125939]: pgmap v19656: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 17 op/s 2023-05-08T13:56:56.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:56 smithi096 ceph-mon[124666]: pgmap v19656: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 17 op/s 2023-05-08T13:56:56.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:56 smithi186 ceph-mon[126480]: pgmap v19656: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 17 op/s 2023-05-08T13:56:57.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:57 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36755.305465 secs 2023-05-08T13:56:57.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:56:57.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:57 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36755.305465 secs 2023-05-08T13:56:57.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:56:57.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:57 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36755.305465 secs 2023-05-08T13:56:57.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:56:58.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:58 smithi133 ceph-mon[125939]: pgmap v19657: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 12 op/s 2023-05-08T13:56:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:56:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:56:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:56:58.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:58 smithi096 ceph-mon[124666]: pgmap v19657: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 12 op/s 2023-05-08T13:56:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:56:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:56:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:56:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:58 smithi186 ceph-mon[126480]: pgmap v19657: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 12 op/s 2023-05-08T13:56:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:56:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:56:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:56:59.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:56:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36758.410195 secs 2023-05-08T13:56:59.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:56:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36758.410195 secs 2023-05-08T13:56:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:56:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36758.410195 secs 2023-05-08T13:57:00.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:00 smithi133 ceph-mon[125939]: pgmap v19658: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T13:57:00.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36758.965374 secs 2023-05-08T13:57:00.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:00 smithi096 ceph-mon[124666]: pgmap v19658: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T13:57:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36758.965374 secs 2023-05-08T13:57:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:00 smithi186 ceph-mon[126480]: pgmap v19658: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T13:57:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36758.965374 secs 2023-05-08T13:57:01.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:01 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:57:01.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:01 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:57:01.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:01 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:57:01.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:01 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:57:01.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:01 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:57:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:01 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:57:01.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:01 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:57:01.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:01 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:57:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:01 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:57:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:02 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36760.305608 secs 2023-05-08T13:57:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:02 smithi186 ceph-mon[126480]: pgmap v19659: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 1.8 MiB/s wr, 17 op/s 2023-05-08T13:57:02.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:02 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36760.305608 secs 2023-05-08T13:57:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:02 smithi133 ceph-mon[125939]: pgmap v19659: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 1.8 MiB/s wr, 17 op/s 2023-05-08T13:57:02.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:02 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36760.305608 secs 2023-05-08T13:57:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:02 smithi096 ceph-mon[124666]: pgmap v19659: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 1.8 MiB/s wr, 17 op/s 2023-05-08T13:57:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:03 smithi186 ceph-mon[126480]: pgmap v19660: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.8 MiB/s wr, 12 op/s 2023-05-08T13:57:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36763.410308 secs 2023-05-08T13:57:04.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:03 smithi133 ceph-mon[125939]: pgmap v19660: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.8 MiB/s wr, 12 op/s 2023-05-08T13:57:04.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36763.410308 secs 2023-05-08T13:57:04.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:03 smithi096 ceph-mon[124666]: pgmap v19660: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.8 MiB/s wr, 12 op/s 2023-05-08T13:57:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36763.410308 secs 2023-05-08T13:57:05.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36763.965500 secs 2023-05-08T13:57:05.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36763.965500 secs 2023-05-08T13:57:05.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36763.965500 secs 2023-05-08T13:57:06.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:06 smithi133 ceph-mon[125939]: pgmap v19661: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.1 MiB/s wr, 31 op/s 2023-05-08T13:57:06.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:06 smithi096 ceph-mon[124666]: pgmap v19661: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.1 MiB/s wr, 31 op/s 2023-05-08T13:57:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:06 smithi186 ceph-mon[126480]: pgmap v19661: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.1 MiB/s wr, 31 op/s 2023-05-08T13:57:07.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:07 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36765.305702 secs 2023-05-08T13:57:07.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:07 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36765.305702 secs 2023-05-08T13:57:07.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:07 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36765.305702 secs 2023-05-08T13:57:08.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:08 smithi133 ceph-mon[125939]: pgmap v19662: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.1 MiB/s wr, 26 op/s 2023-05-08T13:57:08.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:08 smithi096 ceph-mon[124666]: pgmap v19662: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.1 MiB/s wr, 26 op/s 2023-05-08T13:57:08.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:08 smithi186 ceph-mon[126480]: pgmap v19662: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.1 MiB/s wr, 26 op/s 2023-05-08T13:57:09.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36768.410406 secs 2023-05-08T13:57:09.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36768.410406 secs 2023-05-08T13:57:09.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36768.410406 secs 2023-05-08T13:57:10.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:10 smithi133 ceph-mon[125939]: pgmap v19663: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 884 KiB/s wr, 25 op/s 2023-05-08T13:57:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36768.965541 secs 2023-05-08T13:57:10.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:10 smithi096 ceph-mon[124666]: pgmap v19663: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 884 KiB/s wr, 25 op/s 2023-05-08T13:57:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36768.965541 secs 2023-05-08T13:57:10.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:10 smithi186 ceph-mon[126480]: pgmap v19663: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 884 KiB/s wr, 25 op/s 2023-05-08T13:57:10.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36768.965541 secs 2023-05-08T13:57:12.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:12 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36770.305820 secs 2023-05-08T13:57:12.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:12 smithi133 ceph-mon[125939]: pgmap v19664: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.2 MiB/s wr, 29 op/s 2023-05-08T13:57:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:12 smithi133 ceph-mon[125939]: osdmap e1306: 12 total, 12 up, 12 in 2023-05-08T13:57:12.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:12 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36770.305820 secs 2023-05-08T13:57:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:12 smithi096 ceph-mon[124666]: pgmap v19664: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.2 MiB/s wr, 29 op/s 2023-05-08T13:57:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:12 smithi096 ceph-mon[124666]: osdmap e1306: 12 total, 12 up, 12 in 2023-05-08T13:57:12.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:12 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36770.305820 secs 2023-05-08T13:57:12.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:12 smithi186 ceph-mon[126480]: pgmap v19664: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.2 MiB/s wr, 29 op/s 2023-05-08T13:57:12.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:12 smithi186 ceph-mon[126480]: osdmap e1306: 12 total, 12 up, 12 in 2023-05-08T13:57:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:13 smithi186 ceph-mon[126480]: pgmap v19666: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 845 KiB/s rd, 808 KiB/s wr, 27 op/s 2023-05-08T13:57:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36773.410487 secs 2023-05-08T13:57:14.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:13 smithi133 ceph-mon[125939]: pgmap v19666: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 845 KiB/s rd, 808 KiB/s wr, 27 op/s 2023-05-08T13:57:14.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36773.410487 secs 2023-05-08T13:57:14.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:13 smithi096 ceph-mon[124666]: pgmap v19666: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 845 KiB/s rd, 808 KiB/s wr, 27 op/s 2023-05-08T13:57:14.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36773.410487 secs 2023-05-08T13:57:15.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36773.965659 secs 2023-05-08T13:57:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36773.965659 secs 2023-05-08T13:57:15.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36773.965659 secs 2023-05-08T13:57:16.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:16 smithi133 ceph-mon[125939]: pgmap v19667: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 878 KiB/s rd, 876 KiB/s wr, 10 op/s 2023-05-08T13:57:16.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:16 smithi096 ceph-mon[124666]: pgmap v19667: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 878 KiB/s rd, 876 KiB/s wr, 10 op/s 2023-05-08T13:57:16.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:16 smithi186 ceph-mon[126480]: pgmap v19667: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 878 KiB/s rd, 876 KiB/s wr, 10 op/s 2023-05-08T13:57:17.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:17 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36775.305946 secs 2023-05-08T13:57:17.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:17 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36775.305946 secs 2023-05-08T13:57:17.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:17 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36775.305946 secs 2023-05-08T13:57:18.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:18 smithi133 ceph-mon[125939]: pgmap v19668: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 878 KiB/s rd, 876 KiB/s wr, 10 op/s 2023-05-08T13:57:18.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:18 smithi133 ceph-mon[125939]: osdmap e1307: 12 total, 12 up, 12 in 2023-05-08T13:57:18.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:18 smithi096 ceph-mon[124666]: pgmap v19668: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 878 KiB/s rd, 876 KiB/s wr, 10 op/s 2023-05-08T13:57:18.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:18 smithi096 ceph-mon[124666]: osdmap e1307: 12 total, 12 up, 12 in 2023-05-08T13:57:18.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:18 smithi186 ceph-mon[126480]: pgmap v19668: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 878 KiB/s rd, 876 KiB/s wr, 10 op/s 2023-05-08T13:57:18.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:18 smithi186 ceph-mon[126480]: osdmap e1307: 12 total, 12 up, 12 in 2023-05-08T13:57:19.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36778.410550 secs 2023-05-08T13:57:19.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36778.410550 secs 2023-05-08T13:57:19.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36778.410550 secs 2023-05-08T13:57:20.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:20 smithi133 ceph-mon[125939]: pgmap v19670: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1014 KiB/s rd, 1.0 MiB/s wr, 8 op/s 2023-05-08T13:57:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36778.965773 secs 2023-05-08T13:57:20.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:20 smithi096 ceph-mon[124666]: pgmap v19670: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1014 KiB/s rd, 1.0 MiB/s wr, 8 op/s 2023-05-08T13:57:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36778.965773 secs 2023-05-08T13:57:20.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:20 smithi186 ceph-mon[126480]: pgmap v19670: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1014 KiB/s rd, 1.0 MiB/s wr, 8 op/s 2023-05-08T13:57:20.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36778.965773 secs 2023-05-08T13:57:22.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:22 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36780.306065 secs 2023-05-08T13:57:22.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:22 smithi133 ceph-mon[125939]: pgmap v19671: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 855 KiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T13:57:22.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:22 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36780.306065 secs 2023-05-08T13:57:22.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:22 smithi096 ceph-mon[124666]: pgmap v19671: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 855 KiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T13:57:22.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:22 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36780.306065 secs 2023-05-08T13:57:22.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:22 smithi186 ceph-mon[126480]: pgmap v19671: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 855 KiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T13:57:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:23 smithi186 ceph-mon[126480]: pgmap v19672: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 845 KiB/s rd, 1013 KiB/s wr, 10 op/s 2023-05-08T13:57:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36783.410613 secs 2023-05-08T13:57:24.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:23 smithi133 ceph-mon[125939]: pgmap v19672: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 845 KiB/s rd, 1013 KiB/s wr, 10 op/s 2023-05-08T13:57:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36783.410613 secs 2023-05-08T13:57:24.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:23 smithi096 ceph-mon[124666]: pgmap v19672: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 845 KiB/s rd, 1013 KiB/s wr, 10 op/s 2023-05-08T13:57:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36783.410613 secs 2023-05-08T13:57:25.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36783.965908 secs 2023-05-08T13:57:25.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36783.965908 secs 2023-05-08T13:57:25.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36783.965908 secs 2023-05-08T13:57:26.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:26 smithi133 ceph-mon[125939]: pgmap v19673: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 569 KiB/s wr, 9 op/s 2023-05-08T13:57:26.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:26 smithi096 ceph-mon[124666]: pgmap v19673: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 569 KiB/s wr, 9 op/s 2023-05-08T13:57:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:26 smithi186 ceph-mon[126480]: pgmap v19673: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 569 KiB/s wr, 9 op/s 2023-05-08T13:57:27.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:27 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36785.306200 secs 2023-05-08T13:57:27.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:27 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36785.306200 secs 2023-05-08T13:57:27.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:27 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36785.306200 secs 2023-05-08T13:57:28.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:28 smithi133 ceph-mon[125939]: pgmap v19674: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 569 KiB/s wr, 9 op/s 2023-05-08T13:57:28.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:28 smithi096 ceph-mon[124666]: pgmap v19674: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 569 KiB/s wr, 9 op/s 2023-05-08T13:57:28.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:28 smithi186 ceph-mon[126480]: pgmap v19674: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 569 KiB/s wr, 9 op/s 2023-05-08T13:57:29.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36788.410734 secs 2023-05-08T13:57:29.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36788.410734 secs 2023-05-08T13:57:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36788.410734 secs 2023-05-08T13:57:30.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:30 smithi133 ceph-mon[125939]: pgmap v19675: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 508 KiB/s rd, 507 KiB/s wr, 8 op/s 2023-05-08T13:57:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36788.965976 secs 2023-05-08T13:57:30.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:30 smithi096 ceph-mon[124666]: pgmap v19675: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 508 KiB/s rd, 507 KiB/s wr, 8 op/s 2023-05-08T13:57:30.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36788.965976 secs 2023-05-08T13:57:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:30 smithi186 ceph-mon[126480]: pgmap v19675: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 508 KiB/s rd, 507 KiB/s wr, 8 op/s 2023-05-08T13:57:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36788.965976 secs 2023-05-08T13:57:32.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:32 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36790.306313 secs 2023-05-08T13:57:32.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:32 smithi133 ceph-mon[125939]: pgmap v19676: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 449 KiB/s wr, 11 op/s 2023-05-08T13:57:32.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:32 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36790.306313 secs 2023-05-08T13:57:32.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:32 smithi096 ceph-mon[124666]: pgmap v19676: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 449 KiB/s wr, 11 op/s 2023-05-08T13:57:32.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:32 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36790.306313 secs 2023-05-08T13:57:32.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:32 smithi186 ceph-mon[126480]: pgmap v19676: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 449 KiB/s wr, 11 op/s 2023-05-08T13:57:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:33 smithi186 ceph-mon[126480]: pgmap v19677: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 289 KiB/s wr, 8 op/s 2023-05-08T13:57:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36793.410869 secs 2023-05-08T13:57:34.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:33 smithi133 ceph-mon[125939]: pgmap v19677: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 289 KiB/s wr, 8 op/s 2023-05-08T13:57:34.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36793.410869 secs 2023-05-08T13:57:34.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:33 smithi096 ceph-mon[124666]: pgmap v19677: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 289 KiB/s wr, 8 op/s 2023-05-08T13:57:34.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36793.410869 secs 2023-05-08T13:57:35.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36793.966093 secs 2023-05-08T13:57:35.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36793.966093 secs 2023-05-08T13:57:35.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36793.966093 secs 2023-05-08T13:57:36.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:36 smithi133 ceph-mon[125939]: pgmap v19678: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 772 KiB/s rd, 613 KiB/s wr, 12 op/s 2023-05-08T13:57:36.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:36 smithi096 ceph-mon[124666]: pgmap v19678: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 772 KiB/s rd, 613 KiB/s wr, 12 op/s 2023-05-08T13:57:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:36 smithi186 ceph-mon[126480]: pgmap v19678: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 772 KiB/s rd, 613 KiB/s wr, 12 op/s 2023-05-08T13:57:37.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:37 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36795.306475 secs 2023-05-08T13:57:37.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:37 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36795.306475 secs 2023-05-08T13:57:37.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:37 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36795.306475 secs 2023-05-08T13:57:38.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:38 smithi133 ceph-mon[125939]: pgmap v19679: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 615 KiB/s rd, 613 KiB/s wr, 9 op/s 2023-05-08T13:57:38.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:38 smithi096 ceph-mon[124666]: pgmap v19679: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 615 KiB/s rd, 613 KiB/s wr, 9 op/s 2023-05-08T13:57:38.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:38 smithi186 ceph-mon[126480]: pgmap v19679: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 615 KiB/s rd, 613 KiB/s wr, 9 op/s 2023-05-08T13:57:39.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36798.410989 secs 2023-05-08T13:57:39.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36798.410989 secs 2023-05-08T13:57:39.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36798.410989 secs 2023-05-08T13:57:40.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:40 smithi133 ceph-mon[125939]: pgmap v19680: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 615 KiB/s rd, 613 KiB/s wr, 9 op/s 2023-05-08T13:57:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36798.966170 secs 2023-05-08T13:57:40.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:40 smithi096 ceph-mon[124666]: pgmap v19680: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 615 KiB/s rd, 613 KiB/s wr, 9 op/s 2023-05-08T13:57:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36798.966170 secs 2023-05-08T13:57:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:40 smithi186 ceph-mon[126480]: pgmap v19680: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 615 KiB/s rd, 613 KiB/s wr, 9 op/s 2023-05-08T13:57:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36798.966170 secs 2023-05-08T13:57:42.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:42 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36800.306553 secs 2023-05-08T13:57:42.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:42 smithi133 ceph-mon[125939]: pgmap v19681: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 613 KiB/s wr, 11 op/s 2023-05-08T13:57:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:42 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36800.306553 secs 2023-05-08T13:57:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:42 smithi096 ceph-mon[124666]: pgmap v19681: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 613 KiB/s wr, 11 op/s 2023-05-08T13:57:42.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:42 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36800.306553 secs 2023-05-08T13:57:42.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:42 smithi186 ceph-mon[126480]: pgmap v19681: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 613 KiB/s wr, 11 op/s 2023-05-08T13:57:44.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:43 smithi186 ceph-mon[126480]: pgmap v19682: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 324 KiB/s wr, 7 op/s 2023-05-08T13:57:44.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36803.411096 secs 2023-05-08T13:57:44.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:43 smithi133 ceph-mon[125939]: pgmap v19682: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 324 KiB/s wr, 7 op/s 2023-05-08T13:57:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36803.411096 secs 2023-05-08T13:57:44.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:43 smithi096 ceph-mon[124666]: pgmap v19682: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 324 KiB/s wr, 7 op/s 2023-05-08T13:57:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36803.411096 secs 2023-05-08T13:57:45.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36803.966295 secs 2023-05-08T13:57:45.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36803.966295 secs 2023-05-08T13:57:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36803.966295 secs 2023-05-08T13:57:46.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:46 smithi133 ceph-mon[125939]: pgmap v19683: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 651 KiB/s rd, 648 KiB/s wr, 10 op/s 2023-05-08T13:57:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:46 smithi096 ceph-mon[124666]: pgmap v19683: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 651 KiB/s rd, 648 KiB/s wr, 10 op/s 2023-05-08T13:57:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:46 smithi186 ceph-mon[126480]: pgmap v19683: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 651 KiB/s rd, 648 KiB/s wr, 10 op/s 2023-05-08T13:57:48.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:48 smithi133 ceph-mon[125939]: pgmap v19684: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 324 KiB/s wr, 7 op/s 2023-05-08T13:57:48.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:48 smithi096 ceph-mon[124666]: pgmap v19684: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 324 KiB/s wr, 7 op/s 2023-05-08T13:57:48.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:48 smithi186 ceph-mon[126480]: pgmap v19684: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 324 KiB/s wr, 7 op/s 2023-05-08T13:57:49.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36808.411209 secs 2023-05-08T13:57:49.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:57:49.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36808.411209 secs 2023-05-08T13:57:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:57:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36808.411209 secs 2023-05-08T13:57:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:57:50.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:50 smithi133 ceph-mon[125939]: pgmap v19685: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 324 KiB/s wr, 7 op/s 2023-05-08T13:57:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:57:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:57:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:57:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36808.966442 secs 2023-05-08T13:57:50.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:50 smithi096 ceph-mon[124666]: pgmap v19685: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 324 KiB/s wr, 7 op/s 2023-05-08T13:57:50.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:57:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:57:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:57:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36808.966442 secs 2023-05-08T13:57:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:50 smithi186 ceph-mon[126480]: pgmap v19685: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 324 KiB/s wr, 7 op/s 2023-05-08T13:57:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:57:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:57:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:57:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36808.966442 secs 2023-05-08T13:57:52.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:52 smithi133 ceph-mon[125939]: pgmap v19686: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 654 KiB/s rd, 648 KiB/s wr, 10 op/s 2023-05-08T13:57:52.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:52 smithi096 ceph-mon[124666]: pgmap v19686: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 654 KiB/s rd, 648 KiB/s wr, 10 op/s 2023-05-08T13:57:52.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:52 smithi186 ceph-mon[126480]: pgmap v19686: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 654 KiB/s rd, 648 KiB/s wr, 10 op/s 2023-05-08T13:57:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:53 smithi186 ceph-mon[126480]: pgmap v19687: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 653 KiB/s rd, 648 KiB/s wr, 8 op/s 2023-05-08T13:57:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36813.411328 secs 2023-05-08T13:57:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:53 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:57:54.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:53 smithi133 ceph-mon[125939]: pgmap v19687: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 653 KiB/s rd, 648 KiB/s wr, 8 op/s 2023-05-08T13:57:54.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36813.411328 secs 2023-05-08T13:57:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:53 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:57:54.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:53 smithi096 ceph-mon[124666]: pgmap v19687: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 653 KiB/s rd, 648 KiB/s wr, 8 op/s 2023-05-08T13:57:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36813.411328 secs 2023-05-08T13:57:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:53 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:57:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:57:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:57:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:57:55.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:57:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:57:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:57:55.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:57:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:57:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:57:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:55 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:57:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:55 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T13:57:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:55 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T13:57:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:55 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:57:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:55 smithi186 ceph-mon[126480]: pgmap v19688: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T13:57:56.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:55 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:57:56.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:55 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T13:57:56.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:55 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T13:57:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:55 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:57:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:55 smithi133 ceph-mon[125939]: pgmap v19688: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T13:57:56.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:55 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:57:56.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:55 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T13:57:56.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:55 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T13:57:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:55 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:57:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:55 smithi096 ceph-mon[124666]: pgmap v19688: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T13:57:57.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:57:57.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:57 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:57:57.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:57:57.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:57 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:57:57.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:57:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:57 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:57:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:58 smithi186 ceph-mon[126480]: pgmap v19689: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 997 KiB/s rd, 992 KiB/s wr, 9 op/s 2023-05-08T13:57:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:57:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:57:58.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:58 smithi133 ceph-mon[125939]: pgmap v19689: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 997 KiB/s rd, 992 KiB/s wr, 9 op/s 2023-05-08T13:57:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:57:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:57:58.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:58 smithi096 ceph-mon[124666]: pgmap v19689: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 997 KiB/s rd, 992 KiB/s wr, 9 op/s 2023-05-08T13:57:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:57:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:57:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:57:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36818.411459 secs 2023-05-08T13:57:59.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:57:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36818.411459 secs 2023-05-08T13:57:59.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:57:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36818.411459 secs 2023-05-08T13:58:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:00 smithi186 ceph-mon[126480]: pgmap v19690: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T13:58:00.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:00 smithi133 ceph-mon[125939]: pgmap v19690: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T13:58:00.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:00 smithi096 ceph-mon[124666]: pgmap v19690: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T13:58:02.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:02 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36820.306948 secs 2023-05-08T13:58:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:02 smithi133 ceph-mon[125939]: pgmap v19691: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 13 op/s 2023-05-08T13:58:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:58:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:58:02.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:02 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36820.306948 secs 2023-05-08T13:58:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:02 smithi096 ceph-mon[124666]: pgmap v19691: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 13 op/s 2023-05-08T13:58:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:58:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:58:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:02 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36820.306948 secs 2023-05-08T13:58:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:02 smithi186 ceph-mon[126480]: pgmap v19691: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 13 op/s 2023-05-08T13:58:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:58:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:58:03.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:03 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:58:03.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:03 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:58:03.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:03 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:58:04.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:04 smithi133 ceph-mon[125939]: pgmap v19692: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 761 KiB/s rd, 1.2 MiB/s wr, 9 op/s 2023-05-08T13:58:04.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36823.411578 secs 2023-05-08T13:58:04.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:04 smithi096 ceph-mon[124666]: pgmap v19692: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 761 KiB/s rd, 1.2 MiB/s wr, 9 op/s 2023-05-08T13:58:04.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36823.411578 secs 2023-05-08T13:58:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:04 smithi186 ceph-mon[126480]: pgmap v19692: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 761 KiB/s rd, 1.2 MiB/s wr, 9 op/s 2023-05-08T13:58:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36823.411578 secs 2023-05-08T13:58:05.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36823.966797 secs 2023-05-08T13:58:05.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36823.966797 secs 2023-05-08T13:58:05.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36823.966797 secs 2023-05-08T13:58:06.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:06 smithi133 ceph-mon[125939]: pgmap v19693: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 27 op/s 2023-05-08T13:58:06.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:58:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:58:06.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:06 smithi096 ceph-mon[124666]: pgmap v19693: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 27 op/s 2023-05-08T13:58:06.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:58:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:58:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:06 smithi186 ceph-mon[126480]: pgmap v19693: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 27 op/s 2023-05-08T13:58:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:58:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:58:08.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:08 smithi133 ceph-mon[125939]: pgmap v19694: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 24 op/s 2023-05-08T13:58:08.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:08 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:58:08.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:08 smithi096 ceph-mon[124666]: pgmap v19694: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 24 op/s 2023-05-08T13:58:08.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:08 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:58:08.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:08 smithi186 ceph-mon[126480]: pgmap v19694: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 24 op/s 2023-05-08T13:58:08.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:08 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:58:09.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36828.411701 secs 2023-05-08T13:58:09.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:09 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:58:09.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36828.411701 secs 2023-05-08T13:58:09.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:09 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:58:09.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36828.411701 secs 2023-05-08T13:58:09.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:09 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:58:10.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:10 smithi133 ceph-mon[125939]: pgmap v19695: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 25 op/s 2023-05-08T13:58:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:10 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:58:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:10 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:58:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36828.966903 secs 2023-05-08T13:58:10.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:10 smithi096 ceph-mon[124666]: pgmap v19695: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 25 op/s 2023-05-08T13:58:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:10 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:58:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:10 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:58:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36828.966903 secs 2023-05-08T13:58:10.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:10 smithi186 ceph-mon[126480]: pgmap v19695: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 25 op/s 2023-05-08T13:58:10.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:10 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:58:10.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:10 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:58:10.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36828.966903 secs 2023-05-08T13:58:12.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:12 smithi133 ceph-mon[125939]: pgmap v19696: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 25 op/s 2023-05-08T13:58:12.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:12 smithi096 ceph-mon[124666]: pgmap v19696: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 25 op/s 2023-05-08T13:58:12.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:12 smithi186 ceph-mon[126480]: pgmap v19696: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 25 op/s 2023-05-08T13:58:13.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:13 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:58:13.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:13 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:58:13.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:13 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:58:14.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:14 smithi133 ceph-mon[125939]: pgmap v19697: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 789 KiB/s wr, 22 op/s 2023-05-08T13:58:14.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36833.411842 secs 2023-05-08T13:58:14.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:14 smithi096 ceph-mon[124666]: pgmap v19697: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 789 KiB/s wr, 22 op/s 2023-05-08T13:58:14.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36833.411842 secs 2023-05-08T13:58:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:14 smithi186 ceph-mon[126480]: pgmap v19697: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 789 KiB/s wr, 22 op/s 2023-05-08T13:58:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36833.411842 secs 2023-05-08T13:58:15.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36833.967012 secs 2023-05-08T13:58:15.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36833.967012 secs 2023-05-08T13:58:15.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36833.967012 secs 2023-05-08T13:58:16.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:16 smithi133 ceph-mon[125939]: pgmap v19698: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 25 op/s 2023-05-08T13:58:16.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:16 smithi096 ceph-mon[124666]: pgmap v19698: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 25 op/s 2023-05-08T13:58:16.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:16 smithi186 ceph-mon[126480]: pgmap v19698: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 25 op/s 2023-05-08T13:58:18.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:18 smithi133 ceph-mon[125939]: pgmap v19699: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 506 KiB/s wr, 8 op/s 2023-05-08T13:58:18.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:18 smithi096 ceph-mon[124666]: pgmap v19699: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 506 KiB/s wr, 8 op/s 2023-05-08T13:58:18.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:18 smithi186 ceph-mon[126480]: pgmap v19699: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 506 KiB/s wr, 8 op/s 2023-05-08T13:58:19.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36838.411952 secs 2023-05-08T13:58:19.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36838.411952 secs 2023-05-08T13:58:19.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36838.411952 secs 2023-05-08T13:58:20.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:20 smithi133 ceph-mon[125939]: pgmap v19700: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 505 KiB/s wr, 8 op/s 2023-05-08T13:58:20.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36838.967124 secs 2023-05-08T13:58:20.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:20 smithi096 ceph-mon[124666]: pgmap v19700: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 505 KiB/s wr, 8 op/s 2023-05-08T13:58:20.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36838.967124 secs 2023-05-08T13:58:20.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:20 smithi186 ceph-mon[126480]: pgmap v19700: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 505 KiB/s wr, 8 op/s 2023-05-08T13:58:20.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36838.967124 secs 2023-05-08T13:58:22.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:22 smithi133 ceph-mon[125939]: pgmap v19701: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 503 KiB/s wr, 9 op/s 2023-05-08T13:58:22.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:22 smithi096 ceph-mon[124666]: pgmap v19701: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 503 KiB/s wr, 9 op/s 2023-05-08T13:58:22.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:22 smithi186 ceph-mon[126480]: pgmap v19701: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 503 KiB/s wr, 9 op/s 2023-05-08T13:58:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:23 smithi186 ceph-mon[126480]: pgmap v19702: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 502 KiB/s wr, 7 op/s 2023-05-08T13:58:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36843.412097 secs 2023-05-08T13:58:24.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:23 smithi133 ceph-mon[125939]: pgmap v19702: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 502 KiB/s wr, 7 op/s 2023-05-08T13:58:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36843.412097 secs 2023-05-08T13:58:24.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:23 smithi096 ceph-mon[124666]: pgmap v19702: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 502 KiB/s wr, 7 op/s 2023-05-08T13:58:24.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36843.412097 secs 2023-05-08T13:58:25.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:25 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:58:25.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:25 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:58:25.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:25 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:58:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:26 smithi186 ceph-mon[126480]: pgmap v19703: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 13 op/s 2023-05-08T13:58:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:26 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:58:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:26 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:58:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:26 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:58:26.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:26 smithi133 ceph-mon[125939]: pgmap v19703: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 13 op/s 2023-05-08T13:58:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:26 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:58:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:26 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:58:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:26 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:58:26.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:26 smithi096 ceph-mon[124666]: pgmap v19703: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 13 op/s 2023-05-08T13:58:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:26 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:58:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:26 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:58:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:26 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:58:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:28 smithi186 ceph-mon[126480]: pgmap v19704: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 895 KiB/s wr, 11 op/s 2023-05-08T13:58:28.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:28 smithi133 ceph-mon[125939]: pgmap v19704: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 895 KiB/s wr, 11 op/s 2023-05-08T13:58:28.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:28 smithi096 ceph-mon[124666]: pgmap v19704: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 895 KiB/s wr, 11 op/s 2023-05-08T13:58:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36848.412240 secs 2023-05-08T13:58:29.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36848.412240 secs 2023-05-08T13:58:29.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36848.412240 secs 2023-05-08T13:58:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:30 smithi186 ceph-mon[126480]: pgmap v19705: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 895 KiB/s wr, 11 op/s 2023-05-08T13:58:30.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:30 smithi133 ceph-mon[125939]: pgmap v19705: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 895 KiB/s wr, 11 op/s 2023-05-08T13:58:30.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:30 smithi096 ceph-mon[124666]: pgmap v19705: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 895 KiB/s wr, 11 op/s 2023-05-08T13:58:32.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:32 smithi133 ceph-mon[125939]: pgmap v19706: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 925 KiB/s wr, 14 op/s 2023-05-08T13:58:32.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:32 smithi133 ceph-mon[125939]: osdmap e1308: 12 total, 12 up, 12 in 2023-05-08T13:58:32.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:32 smithi096 ceph-mon[124666]: pgmap v19706: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 925 KiB/s wr, 14 op/s 2023-05-08T13:58:32.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:32 smithi096 ceph-mon[124666]: osdmap e1308: 12 total, 12 up, 12 in 2023-05-08T13:58:32.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:32 smithi186 ceph-mon[126480]: pgmap v19706: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 925 KiB/s wr, 14 op/s 2023-05-08T13:58:32.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:32 smithi186 ceph-mon[126480]: osdmap e1308: 12 total, 12 up, 12 in 2023-05-08T13:58:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:33 smithi186 ceph-mon[126480]: pgmap v19708: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T13:58:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36853.412381 secs 2023-05-08T13:58:34.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:33 smithi133 ceph-mon[125939]: pgmap v19708: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T13:58:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36853.412381 secs 2023-05-08T13:58:34.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:33 smithi096 ceph-mon[124666]: pgmap v19708: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T13:58:34.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36853.412381 secs 2023-05-08T13:58:36.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:36 smithi133 ceph-mon[125939]: pgmap v19709: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 254 KiB/s wr, 9 op/s 2023-05-08T13:58:36.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:36 smithi096 ceph-mon[124666]: pgmap v19709: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 254 KiB/s wr, 9 op/s 2023-05-08T13:58:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:36 smithi186 ceph-mon[126480]: pgmap v19709: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 254 KiB/s wr, 9 op/s 2023-05-08T13:58:38.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:38 smithi133 ceph-mon[125939]: pgmap v19710: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 222 KiB/s wr, 9 op/s 2023-05-08T13:58:38.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:38 smithi133 ceph-mon[125939]: osdmap e1309: 12 total, 12 up, 12 in 2023-05-08T13:58:38.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:38 smithi096 ceph-mon[124666]: pgmap v19710: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 222 KiB/s wr, 9 op/s 2023-05-08T13:58:38.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:38 smithi096 ceph-mon[124666]: osdmap e1309: 12 total, 12 up, 12 in 2023-05-08T13:58:38.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:38 smithi186 ceph-mon[126480]: pgmap v19710: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 222 KiB/s wr, 9 op/s 2023-05-08T13:58:38.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:38 smithi186 ceph-mon[126480]: osdmap e1309: 12 total, 12 up, 12 in 2023-05-08T13:58:39.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36858.412520 secs 2023-05-08T13:58:39.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36858.412520 secs 2023-05-08T13:58:39.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36858.412520 secs 2023-05-08T13:58:40.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:40 smithi133 ceph-mon[125939]: pgmap v19712: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 231 KiB/s wr, 6 op/s 2023-05-08T13:58:40.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:40 smithi096 ceph-mon[124666]: pgmap v19712: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 231 KiB/s wr, 6 op/s 2023-05-08T13:58:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:40 smithi186 ceph-mon[126480]: pgmap v19712: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 231 KiB/s wr, 6 op/s 2023-05-08T13:58:41.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:41 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:58:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:41 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:58:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:41 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:58:41.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:41 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:58:41.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:41 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:58:41.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:41 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:58:41.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:41 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:58:41.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:41 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:58:41.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:41 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:58:42.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:42 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36860.307919 secs 2023-05-08T13:58:42.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:42 smithi133 ceph-mon[125939]: pgmap v19713: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 572 KiB/s wr, 9 op/s 2023-05-08T13:58:42.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:42 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36860.307919 secs 2023-05-08T13:58:42.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:42 smithi096 ceph-mon[124666]: pgmap v19713: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 572 KiB/s wr, 9 op/s 2023-05-08T13:58:42.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:42 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36860.307919 secs 2023-05-08T13:58:42.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:42 smithi186 ceph-mon[126480]: pgmap v19713: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 572 KiB/s wr, 9 op/s 2023-05-08T13:58:44.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:43 smithi186 ceph-mon[126480]: pgmap v19714: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 569 KiB/s wr, 9 op/s 2023-05-08T13:58:44.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36863.412590 secs 2023-05-08T13:58:44.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:43 smithi133 ceph-mon[125939]: pgmap v19714: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 569 KiB/s wr, 9 op/s 2023-05-08T13:58:44.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36863.412590 secs 2023-05-08T13:58:44.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:43 smithi096 ceph-mon[124666]: pgmap v19714: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 569 KiB/s wr, 9 op/s 2023-05-08T13:58:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36863.412590 secs 2023-05-08T13:58:46.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36863.967649 secs 2023-05-08T13:58:46.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:46 smithi186 ceph-mon[126480]: pgmap v19715: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.6 MiB/s wr, 12 op/s 2023-05-08T13:58:46.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:46 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:58:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:46 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:58:46.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36863.967649 secs 2023-05-08T13:58:46.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:46 smithi133 ceph-mon[125939]: pgmap v19715: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.6 MiB/s wr, 12 op/s 2023-05-08T13:58:46.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:46 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:58:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:46 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:58:46.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36863.967649 secs 2023-05-08T13:58:46.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:46 smithi096 ceph-mon[124666]: pgmap v19715: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.6 MiB/s wr, 12 op/s 2023-05-08T13:58:46.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:46 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:58:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:46 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:58:48.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:48 smithi186 ceph-mon[126480]: pgmap v19716: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 1.7 MiB/s wr, 13 op/s 2023-05-08T13:58:48.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:48 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:58:48.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:48 smithi133 ceph-mon[125939]: pgmap v19716: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 1.7 MiB/s wr, 13 op/s 2023-05-08T13:58:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:48 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:58:48.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:48 smithi096 ceph-mon[124666]: pgmap v19716: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 1.7 MiB/s wr, 13 op/s 2023-05-08T13:58:48.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:48 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:58:49.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36868.413030 secs 2023-05-08T13:58:49.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:58:49.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36868.413030 secs 2023-05-08T13:58:49.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:58:49.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36868.413030 secs 2023-05-08T13:58:49.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:58:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:50 smithi186 ceph-mon[126480]: pgmap v19717: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.5 MiB/s wr, 12 op/s 2023-05-08T13:58:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:58:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:58:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36868.967726 secs 2023-05-08T13:58:50.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:50 smithi133 ceph-mon[125939]: pgmap v19717: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.5 MiB/s wr, 12 op/s 2023-05-08T13:58:50.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:58:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:58:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36868.967726 secs 2023-05-08T13:58:50.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:50 smithi096 ceph-mon[124666]: pgmap v19717: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.5 MiB/s wr, 12 op/s 2023-05-08T13:58:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:58:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:58:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36868.967726 secs 2023-05-08T13:58:52.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:52 smithi133 ceph-mon[125939]: pgmap v19718: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 1.8 MiB/s wr, 15 op/s 2023-05-08T13:58:52.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:52 smithi096 ceph-mon[124666]: pgmap v19718: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 1.8 MiB/s wr, 15 op/s 2023-05-08T13:58:52.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:52 smithi186 ceph-mon[126480]: pgmap v19718: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 1.8 MiB/s wr, 15 op/s 2023-05-08T13:58:53.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:53 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:58:53.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:53 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:58:53.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:53 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:58:54.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:54 smithi133 ceph-mon[125939]: pgmap v19719: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 12 op/s 2023-05-08T13:58:54.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36873.413103 secs 2023-05-08T13:58:54.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:54 smithi096 ceph-mon[124666]: pgmap v19719: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 12 op/s 2023-05-08T13:58:54.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36873.413103 secs 2023-05-08T13:58:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:54 smithi186 ceph-mon[126480]: pgmap v19719: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 12 op/s 2023-05-08T13:58:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36873.413103 secs 2023-05-08T13:58:55.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:55 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:58:55.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:55 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:58:55.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:55 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:58:56.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:56 smithi133 ceph-mon[125939]: pgmap v19720: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 18 op/s 2023-05-08T13:58:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:58:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:58:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:56 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:58:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:58:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:56 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T13:58:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:56 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T13:58:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:56 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:58:56.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:56 smithi096 ceph-mon[124666]: pgmap v19720: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 18 op/s 2023-05-08T13:58:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:58:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:58:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:56 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:58:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:58:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:56 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T13:58:56.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:56 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T13:58:56.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:56 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:58:56.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:56 smithi186 ceph-mon[126480]: pgmap v19720: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 18 op/s 2023-05-08T13:58:56.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:58:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:58:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:56 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:58:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:58:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:56 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T13:58:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:56 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T13:58:56.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:56 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:58:57.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:58:57.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:58:57.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:58:58.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:58 smithi133 ceph-mon[125939]: pgmap v19721: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T13:58:58.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:58:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:58:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:58 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:58:58.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:58 smithi096 ceph-mon[124666]: pgmap v19721: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T13:58:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:58:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:58:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:58 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:58:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:58 smithi186 ceph-mon[126480]: pgmap v19721: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T13:58:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:58:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:58:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:58 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:58:59.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:58:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36878.413186 secs 2023-05-08T13:58:59.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:58:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36878.413186 secs 2023-05-08T13:58:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:58:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36878.413186 secs 2023-05-08T13:59:00.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:00 smithi133 ceph-mon[125939]: pgmap v19722: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 13 op/s 2023-05-08T13:59:00.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36878.967963 secs 2023-05-08T13:59:00.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:00 smithi096 ceph-mon[124666]: pgmap v19722: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 13 op/s 2023-05-08T13:59:00.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36878.967963 secs 2023-05-08T13:59:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:00 smithi186 ceph-mon[126480]: pgmap v19722: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 13 op/s 2023-05-08T13:59:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36878.967963 secs 2023-05-08T13:59:02.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:02 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36880.308422 secs 2023-05-08T13:59:02.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:02 smithi133 ceph-mon[125939]: pgmap v19723: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.0 MiB/s wr, 17 op/s 2023-05-08T13:59:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:59:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:59:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:59:02.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:02 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36880.308422 secs 2023-05-08T13:59:02.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:02 smithi096 ceph-mon[124666]: pgmap v19723: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.0 MiB/s wr, 17 op/s 2023-05-08T13:59:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:59:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:59:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:59:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:02 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36880.308422 secs 2023-05-08T13:59:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:02 smithi186 ceph-mon[126480]: pgmap v19723: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.0 MiB/s wr, 17 op/s 2023-05-08T13:59:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:59:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:59:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:59:03.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:03 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:59:03.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:03 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:59:03.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:03 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:59:04.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:04 smithi133 ceph-mon[125939]: pgmap v19724: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 13 op/s 2023-05-08T13:59:04.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36883.413260 secs 2023-05-08T13:59:04.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:04 smithi096 ceph-mon[124666]: pgmap v19724: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 13 op/s 2023-05-08T13:59:04.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36883.413260 secs 2023-05-08T13:59:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:04 smithi186 ceph-mon[126480]: pgmap v19724: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 13 op/s 2023-05-08T13:59:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36883.413260 secs 2023-05-08T13:59:05.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36883.968079 secs 2023-05-08T13:59:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36883.968079 secs 2023-05-08T13:59:05.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36883.968079 secs 2023-05-08T13:59:06.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:06 smithi133 ceph-mon[125939]: pgmap v19725: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 32 op/s 2023-05-08T13:59:06.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:06 smithi096 ceph-mon[124666]: pgmap v19725: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 32 op/s 2023-05-08T13:59:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:06 smithi186 ceph-mon[126480]: pgmap v19725: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 32 op/s 2023-05-08T13:59:07.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:07 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36885.308519 secs 2023-05-08T13:59:07.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:07 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36885.308519 secs 2023-05-08T13:59:07.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:07 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36885.308519 secs 2023-05-08T13:59:08.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:08 smithi133 ceph-mon[125939]: pgmap v19726: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 26 op/s 2023-05-08T13:59:08.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:08 smithi096 ceph-mon[124666]: pgmap v19726: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 26 op/s 2023-05-08T13:59:08.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:08 smithi186 ceph-mon[126480]: pgmap v19726: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 26 op/s 2023-05-08T13:59:09.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36888.413324 secs 2023-05-08T13:59:09.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36888.413324 secs 2023-05-08T13:59:09.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36888.413324 secs 2023-05-08T13:59:10.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:10 smithi133 ceph-mon[125939]: pgmap v19727: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 26 op/s 2023-05-08T13:59:10.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36888.968205 secs 2023-05-08T13:59:10.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:10 smithi096 ceph-mon[124666]: pgmap v19727: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 26 op/s 2023-05-08T13:59:10.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36888.968205 secs 2023-05-08T13:59:10.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:10 smithi186 ceph-mon[126480]: pgmap v19727: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 26 op/s 2023-05-08T13:59:10.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36888.968205 secs 2023-05-08T13:59:12.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:12 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36890.308635 secs 2023-05-08T13:59:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:12 smithi133 ceph-mon[125939]: pgmap v19728: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 29 op/s 2023-05-08T13:59:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:12 smithi133 ceph-mon[125939]: osdmap e1310: 12 total, 12 up, 12 in 2023-05-08T13:59:12.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:12 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36890.308635 secs 2023-05-08T13:59:12.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:12 smithi096 ceph-mon[124666]: pgmap v19728: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 29 op/s 2023-05-08T13:59:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:12 smithi096 ceph-mon[124666]: osdmap e1310: 12 total, 12 up, 12 in 2023-05-08T13:59:12.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:12 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36890.308635 secs 2023-05-08T13:59:12.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:12 smithi186 ceph-mon[126480]: pgmap v19728: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 29 op/s 2023-05-08T13:59:12.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:12 smithi186 ceph-mon[126480]: osdmap e1310: 12 total, 12 up, 12 in 2023-05-08T13:59:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:13 smithi186 ceph-mon[126480]: pgmap v19730: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 863 KiB/s rd, 903 KiB/s wr, 28 op/s 2023-05-08T13:59:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36893.413406 secs 2023-05-08T13:59:14.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:13 smithi133 ceph-mon[125939]: pgmap v19730: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 863 KiB/s rd, 903 KiB/s wr, 28 op/s 2023-05-08T13:59:14.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36893.413406 secs 2023-05-08T13:59:14.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:13 smithi096 ceph-mon[124666]: pgmap v19730: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 863 KiB/s rd, 903 KiB/s wr, 28 op/s 2023-05-08T13:59:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36893.413406 secs 2023-05-08T13:59:15.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36893.968323 secs 2023-05-08T13:59:15.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36893.968323 secs 2023-05-08T13:59:15.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36893.968323 secs 2023-05-08T13:59:16.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:16 smithi133 ceph-mon[125939]: pgmap v19731: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 851 KiB/s rd, 848 KiB/s wr, 9 op/s 2023-05-08T13:59:16.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:16 smithi096 ceph-mon[124666]: pgmap v19731: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 851 KiB/s rd, 848 KiB/s wr, 9 op/s 2023-05-08T13:59:16.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:16 smithi186 ceph-mon[126480]: pgmap v19731: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 851 KiB/s rd, 848 KiB/s wr, 9 op/s 2023-05-08T13:59:17.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:17 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36895.308756 secs 2023-05-08T13:59:17.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:17 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36895.308756 secs 2023-05-08T13:59:17.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:17 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36895.308756 secs 2023-05-08T13:59:18.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:18 smithi133 ceph-mon[125939]: pgmap v19732: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 851 KiB/s rd, 848 KiB/s wr, 9 op/s 2023-05-08T13:59:18.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:18 smithi133 ceph-mon[125939]: osdmap e1311: 12 total, 12 up, 12 in 2023-05-08T13:59:18.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:18 smithi096 ceph-mon[124666]: pgmap v19732: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 851 KiB/s rd, 848 KiB/s wr, 9 op/s 2023-05-08T13:59:18.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:18 smithi096 ceph-mon[124666]: osdmap e1311: 12 total, 12 up, 12 in 2023-05-08T13:59:18.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:18 smithi186 ceph-mon[126480]: pgmap v19732: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 851 KiB/s rd, 848 KiB/s wr, 9 op/s 2023-05-08T13:59:18.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:18 smithi186 ceph-mon[126480]: osdmap e1311: 12 total, 12 up, 12 in 2023-05-08T13:59:19.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36898.413577 secs 2023-05-08T13:59:19.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36898.413577 secs 2023-05-08T13:59:19.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36898.413577 secs 2023-05-08T13:59:20.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:20 smithi133 ceph-mon[125939]: pgmap v19734: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 404 KiB/s wr, 5 op/s 2023-05-08T13:59:20.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36898.968448 secs 2023-05-08T13:59:20.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:20 smithi096 ceph-mon[124666]: pgmap v19734: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 404 KiB/s wr, 5 op/s 2023-05-08T13:59:20.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36898.968448 secs 2023-05-08T13:59:20.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:20 smithi186 ceph-mon[126480]: pgmap v19734: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 404 KiB/s wr, 5 op/s 2023-05-08T13:59:20.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36898.968448 secs 2023-05-08T13:59:22.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:22 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36900.308895 secs 2023-05-08T13:59:22.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:22 smithi133 ceph-mon[125939]: pgmap v19735: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 773 KiB/s rd, 714 KiB/s wr, 10 op/s 2023-05-08T13:59:22.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:22 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36900.308895 secs 2023-05-08T13:59:22.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:22 smithi096 ceph-mon[124666]: pgmap v19735: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 773 KiB/s rd, 714 KiB/s wr, 10 op/s 2023-05-08T13:59:22.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:22 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36900.308895 secs 2023-05-08T13:59:22.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:22 smithi186 ceph-mon[126480]: pgmap v19735: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 773 KiB/s rd, 714 KiB/s wr, 10 op/s 2023-05-08T13:59:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:23 smithi186 ceph-mon[126480]: pgmap v19736: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 765 KiB/s rd, 707 KiB/s wr, 9 op/s 2023-05-08T13:59:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36903.413712 secs 2023-05-08T13:59:24.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:23 smithi133 ceph-mon[125939]: pgmap v19736: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 765 KiB/s rd, 707 KiB/s wr, 9 op/s 2023-05-08T13:59:24.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36903.413712 secs 2023-05-08T13:59:24.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:23 smithi096 ceph-mon[124666]: pgmap v19736: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 765 KiB/s rd, 707 KiB/s wr, 9 op/s 2023-05-08T13:59:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36903.413712 secs 2023-05-08T13:59:25.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36903.968581 secs 2023-05-08T13:59:25.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36903.968581 secs 2023-05-08T13:59:25.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36903.968581 secs 2023-05-08T13:59:26.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:26 smithi133 ceph-mon[125939]: pgmap v19737: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 384 KiB/s wr, 9 op/s 2023-05-08T13:59:26.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:26 smithi096 ceph-mon[124666]: pgmap v19737: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 384 KiB/s wr, 9 op/s 2023-05-08T13:59:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:26 smithi186 ceph-mon[126480]: pgmap v19737: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 384 KiB/s wr, 9 op/s 2023-05-08T13:59:27.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:27 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36905.309037 secs 2023-05-08T13:59:27.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:27 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36905.309037 secs 2023-05-08T13:59:27.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:27 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36905.309037 secs 2023-05-08T13:59:28.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:28 smithi133 ceph-mon[125939]: pgmap v19738: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 455 KiB/s rd, 398 KiB/s wr, 10 op/s 2023-05-08T13:59:28.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:28 smithi096 ceph-mon[124666]: pgmap v19738: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 455 KiB/s rd, 398 KiB/s wr, 10 op/s 2023-05-08T13:59:28.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:28 smithi186 ceph-mon[126480]: pgmap v19738: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 455 KiB/s rd, 398 KiB/s wr, 10 op/s 2023-05-08T13:59:29.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36908.413817 secs 2023-05-08T13:59:29.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36908.413817 secs 2023-05-08T13:59:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36908.413817 secs 2023-05-08T13:59:30.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:30 smithi133 ceph-mon[125939]: pgmap v19739: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 410 KiB/s rd, 359 KiB/s wr, 9 op/s 2023-05-08T13:59:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36908.968718 secs 2023-05-08T13:59:30.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:30 smithi096 ceph-mon[124666]: pgmap v19739: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 410 KiB/s rd, 359 KiB/s wr, 9 op/s 2023-05-08T13:59:30.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36908.968718 secs 2023-05-08T13:59:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:30 smithi186 ceph-mon[126480]: pgmap v19739: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 410 KiB/s rd, 359 KiB/s wr, 9 op/s 2023-05-08T13:59:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36908.968718 secs 2023-05-08T13:59:32.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:32 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36910.309156 secs 2023-05-08T13:59:32.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:32 smithi133 ceph-mon[125939]: pgmap v19740: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 532 KiB/s rd, 483 KiB/s wr, 12 op/s 2023-05-08T13:59:32.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:32 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36910.309156 secs 2023-05-08T13:59:32.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:32 smithi096 ceph-mon[124666]: pgmap v19740: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 532 KiB/s rd, 483 KiB/s wr, 12 op/s 2023-05-08T13:59:32.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:32 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36910.309156 secs 2023-05-08T13:59:32.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:32 smithi186 ceph-mon[126480]: pgmap v19740: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 532 KiB/s rd, 483 KiB/s wr, 12 op/s 2023-05-08T13:59:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:33 smithi186 ceph-mon[126480]: pgmap v19741: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 164 KiB/s wr, 8 op/s 2023-05-08T13:59:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36913.413958 secs 2023-05-08T13:59:34.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:33 smithi133 ceph-mon[125939]: pgmap v19741: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 164 KiB/s wr, 8 op/s 2023-05-08T13:59:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36913.413958 secs 2023-05-08T13:59:34.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:33 smithi096 ceph-mon[124666]: pgmap v19741: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 164 KiB/s wr, 8 op/s 2023-05-08T13:59:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36913.413958 secs 2023-05-08T13:59:35.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36913.968826 secs 2023-05-08T13:59:35.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36913.968826 secs 2023-05-08T13:59:35.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36913.968826 secs 2023-05-08T13:59:36.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:36 smithi133 ceph-mon[125939]: pgmap v19742: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 492 KiB/s rd, 490 KiB/s wr, 11 op/s 2023-05-08T13:59:36.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:36 smithi096 ceph-mon[124666]: pgmap v19742: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 492 KiB/s rd, 490 KiB/s wr, 11 op/s 2023-05-08T13:59:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:36 smithi186 ceph-mon[126480]: pgmap v19742: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 492 KiB/s rd, 490 KiB/s wr, 11 op/s 2023-05-08T13:59:37.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:37 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36915.309280 secs 2023-05-08T13:59:37.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:37 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36915.309280 secs 2023-05-08T13:59:37.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:37 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36915.309280 secs 2023-05-08T13:59:38.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:38 smithi133 ceph-mon[125939]: pgmap v19743: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 491 KiB/s rd, 489 KiB/s wr, 9 op/s 2023-05-08T13:59:38.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:38 smithi096 ceph-mon[124666]: pgmap v19743: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 491 KiB/s rd, 489 KiB/s wr, 9 op/s 2023-05-08T13:59:38.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:38 smithi186 ceph-mon[126480]: pgmap v19743: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 491 KiB/s rd, 489 KiB/s wr, 9 op/s 2023-05-08T13:59:39.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36918.414125 secs 2023-05-08T13:59:39.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36918.414125 secs 2023-05-08T13:59:39.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36918.414125 secs 2023-05-08T13:59:40.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:40 smithi133 ceph-mon[125939]: pgmap v19744: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 478 KiB/s wr, 8 op/s 2023-05-08T13:59:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36918.968947 secs 2023-05-08T13:59:40.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:40 smithi096 ceph-mon[124666]: pgmap v19744: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 478 KiB/s wr, 8 op/s 2023-05-08T13:59:40.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36918.968947 secs 2023-05-08T13:59:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:40 smithi186 ceph-mon[126480]: pgmap v19744: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 478 KiB/s wr, 8 op/s 2023-05-08T13:59:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36918.968947 secs 2023-05-08T13:59:42.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:42 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36920.309398 secs 2023-05-08T13:59:42.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:42 smithi133 ceph-mon[125939]: pgmap v19745: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 477 KiB/s rd, 474 KiB/s wr, 10 op/s 2023-05-08T13:59:42.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:42 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36920.309398 secs 2023-05-08T13:59:42.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:42 smithi096 ceph-mon[124666]: pgmap v19745: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 477 KiB/s rd, 474 KiB/s wr, 10 op/s 2023-05-08T13:59:42.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:42 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36920.309398 secs 2023-05-08T13:59:42.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:42 smithi186 ceph-mon[126480]: pgmap v19745: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 477 KiB/s rd, 474 KiB/s wr, 10 op/s 2023-05-08T13:59:44.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:43 smithi186 ceph-mon[126480]: pgmap v19746: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 329 KiB/s rd, 327 KiB/s wr, 6 op/s 2023-05-08T13:59:44.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36923.414257 secs 2023-05-08T13:59:44.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:43 smithi133 ceph-mon[125939]: pgmap v19746: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 329 KiB/s rd, 327 KiB/s wr, 6 op/s 2023-05-08T13:59:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36923.414257 secs 2023-05-08T13:59:44.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:43 smithi096 ceph-mon[124666]: pgmap v19746: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 329 KiB/s rd, 327 KiB/s wr, 6 op/s 2023-05-08T13:59:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36923.414257 secs 2023-05-08T13:59:45.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36923.969051 secs 2023-05-08T13:59:45.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36923.969051 secs 2023-05-08T13:59:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36923.969051 secs 2023-05-08T13:59:46.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:46 smithi133 ceph-mon[125939]: pgmap v19747: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T13:59:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:46 smithi096 ceph-mon[124666]: pgmap v19747: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T13:59:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:46 smithi186 ceph-mon[126480]: pgmap v19747: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T13:59:48.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:48 smithi133 ceph-mon[125939]: pgmap v19748: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 735 KiB/s rd, 803 KiB/s wr, 8 op/s 2023-05-08T13:59:48.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:48 smithi096 ceph-mon[124666]: pgmap v19748: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 735 KiB/s rd, 803 KiB/s wr, 8 op/s 2023-05-08T13:59:48.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:48 smithi186 ceph-mon[126480]: pgmap v19748: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 735 KiB/s rd, 803 KiB/s wr, 8 op/s 2023-05-08T13:59:49.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36928.414427 secs 2023-05-08T13:59:49.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:59:49.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36928.414427 secs 2023-05-08T13:59:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:59:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36928.414427 secs 2023-05-08T13:59:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:59:50.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:50 smithi133 ceph-mon[125939]: pgmap v19749: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 9 op/s 2023-05-08T13:59:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:59:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:59:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:59:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36928.969170 secs 2023-05-08T13:59:50.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:50 smithi096 ceph-mon[124666]: pgmap v19749: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 9 op/s 2023-05-08T13:59:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:59:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:59:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:59:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36928.969170 secs 2023-05-08T13:59:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:50 smithi186 ceph-mon[126480]: pgmap v19749: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 9 op/s 2023-05-08T13:59:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:59:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T13:59:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:59:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36928.969170 secs 2023-05-08T13:59:52.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:52 smithi133 ceph-mon[125939]: pgmap v19750: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T13:59:52.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:52 smithi096 ceph-mon[124666]: pgmap v19750: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T13:59:52.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:52 smithi186 ceph-mon[126480]: pgmap v19750: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T13:59:54.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:53 smithi133 ceph-mon[125939]: pgmap v19751: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 9 op/s 2023-05-08T13:59:54.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36933.414527 secs 2023-05-08T13:59:54.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:53 smithi096 ceph-mon[124666]: pgmap v19751: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 9 op/s 2023-05-08T13:59:54.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36933.414527 secs 2023-05-08T13:59:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:53 smithi186 ceph-mon[126480]: pgmap v19751: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 9 op/s 2023-05-08T13:59:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36933.414527 secs 2023-05-08T13:59:56.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:56 smithi133 ceph-mon[125939]: pgmap v19752: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.6 MiB/s wr, 13 op/s 2023-05-08T13:59:56.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:59:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:59:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:59:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:59:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:59:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:59:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:59:56.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:56 smithi096 ceph-mon[124666]: pgmap v19752: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.6 MiB/s wr, 13 op/s 2023-05-08T13:59:56.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:59:56.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:59:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:59:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:59:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:59:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:59:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:59:56.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:56 smithi186 ceph-mon[126480]: pgmap v19752: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.6 MiB/s wr, 13 op/s 2023-05-08T13:59:56.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T13:59:56.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:59:56.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:59:56.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:59:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:59:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:59:56.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:59:57.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:59:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:59:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:59:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:59:57.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:59:57.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:59:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:59:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:59:57.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T13:59:57.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T13:59:57.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T13:59:57.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T13:59:58.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:58 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:59:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:58 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T13:59:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:58 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T13:59:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:58 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T13:59:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:58 smithi133 ceph-mon[125939]: pgmap v19753: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 847 KiB/s wr, 10 op/s 2023-05-08T13:59:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:58 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:59:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:59:58.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:59:58.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:58 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:59:58.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:58 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T13:59:58.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:58 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T13:59:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:58 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T13:59:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:58 smithi096 ceph-mon[124666]: pgmap v19753: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 847 KiB/s wr, 10 op/s 2023-05-08T13:59:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:58 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:59:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:59:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:59:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:58 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:59:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:58 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T13:59:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:58 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T13:59:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:58 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T13:59:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:58 smithi186 ceph-mon[126480]: pgmap v19753: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 847 KiB/s wr, 10 op/s 2023-05-08T13:59:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:58 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T13:59:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T13:59:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T13:59:59.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 13:59:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36938.414660 secs 2023-05-08T13:59:59.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 13:59:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36938.414660 secs 2023-05-08T13:59:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 13:59:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36938.414660 secs 2023-05-08T14:00:00.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:00 smithi133 ceph-mon[125939]: pgmap v19754: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T14:00:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:00 smithi133 ceph-mon[125939]: overall HEALTH_WARN 1 MDSs report slow requests 2023-05-08T14:00:00.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:00 smithi096 ceph-mon[124666]: pgmap v19754: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T14:00:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:00 smithi096 ceph-mon[124666]: overall HEALTH_WARN 1 MDSs report slow requests 2023-05-08T14:00:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:00 smithi186 ceph-mon[126480]: pgmap v19754: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T14:00:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:00 smithi186 ceph-mon[126480]: overall HEALTH_WARN 1 MDSs report slow requests 2023-05-08T14:00:02.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:02 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36940.309812 secs 2023-05-08T14:00:02.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:02 smithi133 ceph-mon[125939]: pgmap v19755: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.3 MiB/s wr, 13 op/s 2023-05-08T14:00:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:00:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:00:02.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:02 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36940.309812 secs 2023-05-08T14:00:02.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:02 smithi096 ceph-mon[124666]: pgmap v19755: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.3 MiB/s wr, 13 op/s 2023-05-08T14:00:02.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:00:02.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:00:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:02 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36940.309812 secs 2023-05-08T14:00:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:02 smithi186 ceph-mon[126480]: pgmap v19755: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.3 MiB/s wr, 13 op/s 2023-05-08T14:00:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:00:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:00:03.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:03 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:00:03.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:03 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:00:03.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:03 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:00:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:04 smithi133 ceph-mon[125939]: pgmap v19756: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 KiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T14:00:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36943.414787 secs 2023-05-08T14:00:04.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:04 smithi096 ceph-mon[124666]: pgmap v19756: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 KiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T14:00:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36943.414787 secs 2023-05-08T14:00:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:04 smithi186 ceph-mon[126480]: pgmap v19756: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 KiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T14:00:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36943.414787 secs 2023-05-08T14:00:05.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36943.969513 secs 2023-05-08T14:00:05.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36943.969513 secs 2023-05-08T14:00:05.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36943.969513 secs 2023-05-08T14:00:06.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:06 smithi133 ceph-mon[125939]: pgmap v19757: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 30 op/s 2023-05-08T14:00:06.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:00:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:00:06.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:06 smithi096 ceph-mon[124666]: pgmap v19757: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 30 op/s 2023-05-08T14:00:06.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:00:06.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:00:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:06 smithi186 ceph-mon[126480]: pgmap v19757: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 30 op/s 2023-05-08T14:00:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:00:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:00:08.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:08 smithi133 ceph-mon[125939]: pgmap v19758: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 27 op/s 2023-05-08T14:00:08.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:08 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:00:08.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:08 smithi096 ceph-mon[124666]: pgmap v19758: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 27 op/s 2023-05-08T14:00:08.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:08 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:00:08.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:08 smithi186 ceph-mon[126480]: pgmap v19758: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 27 op/s 2023-05-08T14:00:08.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:08 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:00:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36948.414962 secs 2023-05-08T14:00:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:09 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:00:09.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36948.414962 secs 2023-05-08T14:00:09.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:09 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:00:09.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36948.414962 secs 2023-05-08T14:00:09.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:09 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:00:10.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:10 smithi133 ceph-mon[125939]: pgmap v19759: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 26 op/s 2023-05-08T14:00:10.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:10 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:00:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:10 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:00:10.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:10 smithi096 ceph-mon[124666]: pgmap v19759: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 26 op/s 2023-05-08T14:00:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:10 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:00:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:10 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:00:10.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:10 smithi186 ceph-mon[126480]: pgmap v19759: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 26 op/s 2023-05-08T14:00:10.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:10 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:00:10.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:10 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:00:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:12 smithi133 ceph-mon[125939]: pgmap v19760: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 986 KiB/s wr, 29 op/s 2023-05-08T14:00:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:12 smithi133 ceph-mon[125939]: osdmap e1312: 12 total, 12 up, 12 in 2023-05-08T14:00:12.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:12 smithi096 ceph-mon[124666]: pgmap v19760: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 986 KiB/s wr, 29 op/s 2023-05-08T14:00:12.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:12 smithi096 ceph-mon[124666]: osdmap e1312: 12 total, 12 up, 12 in 2023-05-08T14:00:12.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:12 smithi186 ceph-mon[126480]: pgmap v19760: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 986 KiB/s wr, 29 op/s 2023-05-08T14:00:12.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:12 smithi186 ceph-mon[126480]: osdmap e1312: 12 total, 12 up, 12 in 2023-05-08T14:00:13.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:13 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:00:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:13 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:00:13.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:13 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:00:13.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:13 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:00:13.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:13 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:00:13.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:13 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:00:14.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:14 smithi133 ceph-mon[125939]: pgmap v19762: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 818 KiB/s wr, 31 op/s 2023-05-08T14:00:14.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36953.415092 secs 2023-05-08T14:00:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:14 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:00:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:14 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:00:14.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:14 smithi096 ceph-mon[124666]: pgmap v19762: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 818 KiB/s wr, 31 op/s 2023-05-08T14:00:14.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36953.415092 secs 2023-05-08T14:00:14.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:14 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:00:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:14 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:00:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:14 smithi186 ceph-mon[126480]: pgmap v19762: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 818 KiB/s wr, 31 op/s 2023-05-08T14:00:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36953.415092 secs 2023-05-08T14:00:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:14 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:00:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:14 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:00:16.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:16 smithi133 ceph-mon[125939]: pgmap v19763: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 649 KiB/s rd, 647 KiB/s wr, 11 op/s 2023-05-08T14:00:16.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:16 smithi096 ceph-mon[124666]: pgmap v19763: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 649 KiB/s rd, 647 KiB/s wr, 11 op/s 2023-05-08T14:00:16.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:16 smithi186 ceph-mon[126480]: pgmap v19763: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 649 KiB/s rd, 647 KiB/s wr, 11 op/s 2023-05-08T14:00:18.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:18 smithi133 ceph-mon[125939]: pgmap v19764: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 649 KiB/s rd, 647 KiB/s wr, 10 op/s 2023-05-08T14:00:18.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:18 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:00:18.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:18 smithi133 ceph-mon[125939]: osdmap e1313: 12 total, 12 up, 12 in 2023-05-08T14:00:18.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:18 smithi096 ceph-mon[124666]: pgmap v19764: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 649 KiB/s rd, 647 KiB/s wr, 10 op/s 2023-05-08T14:00:18.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:18 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:00:18.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:18 smithi096 ceph-mon[124666]: osdmap e1313: 12 total, 12 up, 12 in 2023-05-08T14:00:18.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:18 smithi186 ceph-mon[126480]: pgmap v19764: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 649 KiB/s rd, 647 KiB/s wr, 10 op/s 2023-05-08T14:00:18.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:18 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:00:18.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:18 smithi186 ceph-mon[126480]: osdmap e1313: 12 total, 12 up, 12 in 2023-05-08T14:00:19.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36958.415230 secs 2023-05-08T14:00:19.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36958.415230 secs 2023-05-08T14:00:19.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36958.415230 secs 2023-05-08T14:00:20.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:20 smithi133 ceph-mon[125939]: pgmap v19766: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1008 KiB/s rd, 1007 KiB/s wr, 7 op/s 2023-05-08T14:00:20.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:20 smithi096 ceph-mon[124666]: pgmap v19766: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1008 KiB/s rd, 1007 KiB/s wr, 7 op/s 2023-05-08T14:00:20.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:20 smithi186 ceph-mon[126480]: pgmap v19766: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1008 KiB/s rd, 1007 KiB/s wr, 7 op/s 2023-05-08T14:00:22.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:22 smithi133 ceph-mon[125939]: pgmap v19767: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 848 KiB/s rd, 846 KiB/s wr, 10 op/s 2023-05-08T14:00:22.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:22 smithi096 ceph-mon[124666]: pgmap v19767: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 848 KiB/s rd, 846 KiB/s wr, 10 op/s 2023-05-08T14:00:22.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:22 smithi186 ceph-mon[126480]: pgmap v19767: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 848 KiB/s rd, 846 KiB/s wr, 10 op/s 2023-05-08T14:00:24.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:23 smithi133 ceph-mon[125939]: pgmap v19768: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 840 KiB/s rd, 838 KiB/s wr, 10 op/s 2023-05-08T14:00:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36963.415380 secs 2023-05-08T14:00:24.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:23 smithi096 ceph-mon[124666]: pgmap v19768: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 840 KiB/s rd, 838 KiB/s wr, 10 op/s 2023-05-08T14:00:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36963.415380 secs 2023-05-08T14:00:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:23 smithi186 ceph-mon[126480]: pgmap v19768: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 840 KiB/s rd, 838 KiB/s wr, 10 op/s 2023-05-08T14:00:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36963.415380 secs 2023-05-08T14:00:25.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36963.969938 secs 2023-05-08T14:00:25.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:25 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:00:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:25 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:00:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:25 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:00:25.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36963.969938 secs 2023-05-08T14:00:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:25 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:00:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:25 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:00:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:25 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:00:25.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36963.969938 secs 2023-05-08T14:00:25.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:25 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:00:25.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:25 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:00:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:25 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:00:26.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:26 smithi133 ceph-mon[125939]: pgmap v19769: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 500 KiB/s wr, 9 op/s 2023-05-08T14:00:26.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:26 smithi096 ceph-mon[124666]: pgmap v19769: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 500 KiB/s wr, 9 op/s 2023-05-08T14:00:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:26 smithi186 ceph-mon[126480]: pgmap v19769: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 500 KiB/s wr, 9 op/s 2023-05-08T14:00:27.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:27 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36965.310405 secs 2023-05-08T14:00:27.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:27 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36965.310405 secs 2023-05-08T14:00:27.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:27 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36965.310405 secs 2023-05-08T14:00:28.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:28 smithi133 ceph-mon[125939]: pgmap v19770: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 500 KiB/s wr, 9 op/s 2023-05-08T14:00:28.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:28 smithi096 ceph-mon[124666]: pgmap v19770: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 500 KiB/s wr, 9 op/s 2023-05-08T14:00:28.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:28 smithi186 ceph-mon[126480]: pgmap v19770: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 500 KiB/s wr, 9 op/s 2023-05-08T14:00:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36968.415483 secs 2023-05-08T14:00:29.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36968.415483 secs 2023-05-08T14:00:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36968.415483 secs 2023-05-08T14:00:30.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:30 smithi133 ceph-mon[125939]: pgmap v19771: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 393 KiB/s rd, 457 KiB/s wr, 9 op/s 2023-05-08T14:00:30.520 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:30 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:00:30.520 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:30 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:00:30.520 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36968.970071 secs 2023-05-08T14:00:30.521 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:30 smithi096 ceph-mon[124666]: pgmap v19771: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 393 KiB/s rd, 457 KiB/s wr, 9 op/s 2023-05-08T14:00:30.521 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:30 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:00:30.521 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:30 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:00:30.521 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36968.970071 secs 2023-05-08T14:00:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:30 smithi186 ceph-mon[126480]: pgmap v19771: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 393 KiB/s rd, 457 KiB/s wr, 9 op/s 2023-05-08T14:00:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:30 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:00:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:30 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:00:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36968.970071 secs 2023-05-08T14:00:32.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:32 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36970.310503 secs 2023-05-08T14:00:32.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:32 smithi133 ceph-mon[125939]: pgmap v19772: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 581 KiB/s wr, 11 op/s 2023-05-08T14:00:32.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:32 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36970.310503 secs 2023-05-08T14:00:32.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:32 smithi096 ceph-mon[124666]: pgmap v19772: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 581 KiB/s wr, 11 op/s 2023-05-08T14:00:32.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:32 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36970.310503 secs 2023-05-08T14:00:32.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:32 smithi186 ceph-mon[126480]: pgmap v19772: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 581 KiB/s wr, 11 op/s 2023-05-08T14:00:33.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:33 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:00:33.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:33 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:00:33.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:33 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:00:34.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:34 smithi133 ceph-mon[125939]: pgmap v19773: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 554 KiB/s wr, 8 op/s 2023-05-08T14:00:34.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36973.415600 secs 2023-05-08T14:00:34.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:34 smithi096 ceph-mon[124666]: pgmap v19773: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 554 KiB/s wr, 8 op/s 2023-05-08T14:00:34.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36973.415600 secs 2023-05-08T14:00:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:34 smithi186 ceph-mon[126480]: pgmap v19773: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 554 KiB/s wr, 8 op/s 2023-05-08T14:00:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36973.415600 secs 2023-05-08T14:00:35.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36973.970189 secs 2023-05-08T14:00:35.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36973.970189 secs 2023-05-08T14:00:35.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36973.970189 secs 2023-05-08T14:00:36.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:36 smithi133 ceph-mon[125939]: pgmap v19774: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 927 KiB/s rd, 925 KiB/s wr, 12 op/s 2023-05-08T14:00:36.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:36 smithi096 ceph-mon[124666]: pgmap v19774: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 927 KiB/s rd, 925 KiB/s wr, 12 op/s 2023-05-08T14:00:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:36 smithi186 ceph-mon[126480]: pgmap v19774: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 927 KiB/s rd, 925 KiB/s wr, 12 op/s 2023-05-08T14:00:37.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:37 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36975.310639 secs 2023-05-08T14:00:37.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:37 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36975.310639 secs 2023-05-08T14:00:37.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:37 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36975.310639 secs 2023-05-08T14:00:38.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:38 smithi133 ceph-mon[125939]: pgmap v19775: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 926 KiB/s rd, 701 KiB/s wr, 9 op/s 2023-05-08T14:00:38.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:38 smithi096 ceph-mon[124666]: pgmap v19775: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 926 KiB/s rd, 701 KiB/s wr, 9 op/s 2023-05-08T14:00:38.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:38 smithi186 ceph-mon[126480]: pgmap v19775: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 926 KiB/s rd, 701 KiB/s wr, 9 op/s 2023-05-08T14:00:39.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36978.415741 secs 2023-05-08T14:00:39.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36978.415741 secs 2023-05-08T14:00:39.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36978.415741 secs 2023-05-08T14:00:40.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:40 smithi133 ceph-mon[125939]: pgmap v19776: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 926 KiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T14:00:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36978.970317 secs 2023-05-08T14:00:40.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:40 smithi096 ceph-mon[124666]: pgmap v19776: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 926 KiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T14:00:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36978.970317 secs 2023-05-08T14:00:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:40 smithi186 ceph-mon[126480]: pgmap v19776: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 926 KiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T14:00:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36978.970317 secs 2023-05-08T14:00:42.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:42 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36980.310756 secs 2023-05-08T14:00:42.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:42 smithi133 ceph-mon[125939]: pgmap v19777: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 755 KiB/s rd, 1017 KiB/s wr, 11 op/s 2023-05-08T14:00:42.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:42 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36980.310756 secs 2023-05-08T14:00:42.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:42 smithi096 ceph-mon[124666]: pgmap v19777: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 755 KiB/s rd, 1017 KiB/s wr, 11 op/s 2023-05-08T14:00:42.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:42 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36980.310756 secs 2023-05-08T14:00:42.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:42 smithi186 ceph-mon[126480]: pgmap v19777: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 755 KiB/s rd, 1017 KiB/s wr, 11 op/s 2023-05-08T14:00:44.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:43 smithi133 ceph-mon[125939]: pgmap v19778: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 700 KiB/s rd, 698 KiB/s wr, 7 op/s 2023-05-08T14:00:44.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36983.415893 secs 2023-05-08T14:00:44.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:43 smithi096 ceph-mon[124666]: pgmap v19778: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 700 KiB/s rd, 698 KiB/s wr, 7 op/s 2023-05-08T14:00:44.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36983.415893 secs 2023-05-08T14:00:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:43 smithi186 ceph-mon[126480]: pgmap v19778: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 700 KiB/s rd, 698 KiB/s wr, 7 op/s 2023-05-08T14:00:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36983.415893 secs 2023-05-08T14:00:45.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36983.970379 secs 2023-05-08T14:00:45.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36983.970379 secs 2023-05-08T14:00:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36983.970379 secs 2023-05-08T14:00:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:46 smithi133 ceph-mon[125939]: pgmap v19779: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 698 KiB/s wr, 10 op/s 2023-05-08T14:00:46.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:46 smithi096 ceph-mon[124666]: pgmap v19779: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 698 KiB/s wr, 10 op/s 2023-05-08T14:00:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:46 smithi186 ceph-mon[126480]: pgmap v19779: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 698 KiB/s wr, 10 op/s 2023-05-08T14:00:48.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:48 smithi133 ceph-mon[125939]: pgmap v19780: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 327 KiB/s wr, 7 op/s 2023-05-08T14:00:48.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:48 smithi096 ceph-mon[124666]: pgmap v19780: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 327 KiB/s wr, 7 op/s 2023-05-08T14:00:48.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:48 smithi186 ceph-mon[126480]: pgmap v19780: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 327 KiB/s wr, 7 op/s 2023-05-08T14:00:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36988.416005 secs 2023-05-08T14:00:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:00:49.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36988.416005 secs 2023-05-08T14:00:49.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:00:49.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36988.416005 secs 2023-05-08T14:00:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:00:50.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:50 smithi133 ceph-mon[125939]: pgmap v19781: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 692 KiB/s rd, 666 KiB/s wr, 7 op/s 2023-05-08T14:00:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:00:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:00:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:00:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36988.970546 secs 2023-05-08T14:00:50.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:50 smithi096 ceph-mon[124666]: pgmap v19781: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 692 KiB/s rd, 666 KiB/s wr, 7 op/s 2023-05-08T14:00:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:00:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:00:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:00:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36988.970546 secs 2023-05-08T14:00:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:50 smithi186 ceph-mon[126480]: pgmap v19781: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 692 KiB/s rd, 666 KiB/s wr, 7 op/s 2023-05-08T14:00:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:00:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:00:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:00:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36988.970546 secs 2023-05-08T14:00:52.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:52 smithi133 ceph-mon[125939]: pgmap v19782: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 694 KiB/s rd, 340 KiB/s wr, 9 op/s 2023-05-08T14:00:52.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:52 smithi096 ceph-mon[124666]: pgmap v19782: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 694 KiB/s rd, 340 KiB/s wr, 9 op/s 2023-05-08T14:00:52.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:52 smithi186 ceph-mon[126480]: pgmap v19782: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 694 KiB/s rd, 340 KiB/s wr, 9 op/s 2023-05-08T14:00:54.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:53 smithi133 ceph-mon[125939]: pgmap v19783: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 693 KiB/s rd, 339 KiB/s wr, 6 op/s 2023-05-08T14:00:54.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36993.416126 secs 2023-05-08T14:00:54.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:53 smithi096 ceph-mon[124666]: pgmap v19783: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 693 KiB/s rd, 339 KiB/s wr, 6 op/s 2023-05-08T14:00:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36993.416126 secs 2023-05-08T14:00:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:53 smithi186 ceph-mon[126480]: pgmap v19783: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 693 KiB/s rd, 339 KiB/s wr, 6 op/s 2023-05-08T14:00:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36993.416126 secs 2023-05-08T14:00:56.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:56 smithi133 ceph-mon[125939]: pgmap v19784: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 974 KiB/s wr, 10 op/s 2023-05-08T14:00:56.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:56 smithi096 ceph-mon[124666]: pgmap v19784: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 974 KiB/s wr, 10 op/s 2023-05-08T14:00:56.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:56 smithi186 ceph-mon[126480]: pgmap v19784: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 974 KiB/s wr, 10 op/s 2023-05-08T14:00:57.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:00:57.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:00:57.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:00:57.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:00:57.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:00:57.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:00:58.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:58 smithi133 ceph-mon[125939]: pgmap v19785: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1001 KiB/s wr, 8 op/s 2023-05-08T14:00:58.566 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:58 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:00:58.567 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:00:58.567 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:00:58.567 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:00:58.567 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:00:58.567 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:58 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:00:58.568 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:00:58.568 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:58 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T14:00:58.568 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:58 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T14:00:58.568 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:58 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:00:58.569 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:58 smithi096 ceph-mon[124666]: pgmap v19785: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1001 KiB/s wr, 8 op/s 2023-05-08T14:00:58.569 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:58 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:00:58.569 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:00:58.569 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:00:58.569 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:00:58.569 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:00:58.570 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:58 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:00:58.570 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:00:58.570 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:58 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T14:00:58.570 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:58 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T14:00:58.570 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:58 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:00:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:58 smithi186 ceph-mon[126480]: pgmap v19785: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1001 KiB/s wr, 8 op/s 2023-05-08T14:00:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:58 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:00:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:00:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:00:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:00:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:00:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:58 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:00:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:00:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:58 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T14:00:58.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:58 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T14:00:58.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:58 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:00:59.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:00:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 36998.416250 secs 2023-05-08T14:00:59.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:00:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 36998.416250 secs 2023-05-08T14:00:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:00:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 36998.416250 secs 2023-05-08T14:01:00.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:00 smithi133 ceph-mon[125939]: pgmap v19786: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 8 op/s 2023-05-08T14:01:00.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:00 smithi096 ceph-mon[124666]: pgmap v19786: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 8 op/s 2023-05-08T14:01:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:00 smithi186 ceph-mon[126480]: pgmap v19786: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 8 op/s 2023-05-08T14:01:02.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:02 smithi133 ceph-mon[125939]: pgmap v19787: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 803 KiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T14:01:02.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:02 smithi096 ceph-mon[124666]: pgmap v19787: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 803 KiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T14:01:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:02 smithi186 ceph-mon[126480]: pgmap v19787: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 803 KiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T14:01:04.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:03 smithi133 ceph-mon[125939]: pgmap v19788: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 802 KiB/s rd, 1.2 MiB/s wr, 9 op/s 2023-05-08T14:01:04.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37003.416374 secs 2023-05-08T14:01:04.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:03 smithi096 ceph-mon[124666]: pgmap v19788: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 802 KiB/s rd, 1.2 MiB/s wr, 9 op/s 2023-05-08T14:01:04.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37003.416374 secs 2023-05-08T14:01:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:03 smithi186 ceph-mon[126480]: pgmap v19788: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 802 KiB/s rd, 1.2 MiB/s wr, 9 op/s 2023-05-08T14:01:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37003.416374 secs 2023-05-08T14:01:05.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37003.970918 secs 2023-05-08T14:01:05.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:05 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:01:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:01:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:01:05.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37003.970918 secs 2023-05-08T14:01:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:05 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:01:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:01:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:01:05.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37003.970918 secs 2023-05-08T14:01:05.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:05 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:01:05.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:01:05.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:01:06.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:06 smithi133 ceph-mon[125939]: pgmap v19789: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 27 op/s 2023-05-08T14:01:06.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:06 smithi096 ceph-mon[124666]: pgmap v19789: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 27 op/s 2023-05-08T14:01:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:06 smithi186 ceph-mon[126480]: pgmap v19789: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 27 op/s 2023-05-08T14:01:08.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:08 smithi133 ceph-mon[125939]: pgmap v19790: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 24 op/s 2023-05-08T14:01:08.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:08 smithi096 ceph-mon[124666]: pgmap v19790: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 24 op/s 2023-05-08T14:01:08.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:08 smithi186 ceph-mon[126480]: pgmap v19790: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 24 op/s 2023-05-08T14:01:09.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37008.416503 secs 2023-05-08T14:01:09.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37008.416503 secs 2023-05-08T14:01:09.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37008.416503 secs 2023-05-08T14:01:10.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:10 smithi133 ceph-mon[125939]: pgmap v19791: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 24 op/s 2023-05-08T14:01:10.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37008.971035 secs 2023-05-08T14:01:10.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:10 smithi096 ceph-mon[124666]: pgmap v19791: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 24 op/s 2023-05-08T14:01:10.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37008.971035 secs 2023-05-08T14:01:10.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:10 smithi186 ceph-mon[126480]: pgmap v19791: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 24 op/s 2023-05-08T14:01:10.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37008.971035 secs 2023-05-08T14:01:12.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:12 smithi133 ceph-mon[125939]: pgmap v19792: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 27 op/s 2023-05-08T14:01:12.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:12 smithi096 ceph-mon[124666]: pgmap v19792: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 27 op/s 2023-05-08T14:01:12.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:12 smithi186 ceph-mon[126480]: pgmap v19792: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 27 op/s 2023-05-08T14:01:14.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:13 smithi133 ceph-mon[125939]: pgmap v19793: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 797 KiB/s wr, 22 op/s 2023-05-08T14:01:14.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37013.416631 secs 2023-05-08T14:01:14.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:13 smithi096 ceph-mon[124666]: pgmap v19793: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 797 KiB/s wr, 22 op/s 2023-05-08T14:01:14.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37013.416631 secs 2023-05-08T14:01:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:13 smithi186 ceph-mon[126480]: pgmap v19793: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 797 KiB/s wr, 22 op/s 2023-05-08T14:01:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37013.416631 secs 2023-05-08T14:01:15.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37013.971148 secs 2023-05-08T14:01:15.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37013.971148 secs 2023-05-08T14:01:15.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37013.971148 secs 2023-05-08T14:01:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:16 smithi133 ceph-mon[125939]: pgmap v19794: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 25 op/s 2023-05-08T14:01:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:16 smithi096 ceph-mon[124666]: pgmap v19794: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 25 op/s 2023-05-08T14:01:16.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:16 smithi186 ceph-mon[126480]: pgmap v19794: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 25 op/s 2023-05-08T14:01:18.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:18 smithi133 ceph-mon[125939]: pgmap v19795: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 510 KiB/s wr, 8 op/s 2023-05-08T14:01:18.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:18 smithi096 ceph-mon[124666]: pgmap v19795: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 510 KiB/s wr, 8 op/s 2023-05-08T14:01:18.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:18 smithi186 ceph-mon[126480]: pgmap v19795: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 510 KiB/s wr, 8 op/s 2023-05-08T14:01:19.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37018.416786 secs 2023-05-08T14:01:19.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37018.416786 secs 2023-05-08T14:01:19.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37018.416786 secs 2023-05-08T14:01:20.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:20 smithi133 ceph-mon[125939]: pgmap v19796: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 510 KiB/s wr, 8 op/s 2023-05-08T14:01:20.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37018.971294 secs 2023-05-08T14:01:20.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:20 smithi096 ceph-mon[124666]: pgmap v19796: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 510 KiB/s wr, 8 op/s 2023-05-08T14:01:20.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37018.971294 secs 2023-05-08T14:01:20.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:20 smithi186 ceph-mon[126480]: pgmap v19796: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 510 KiB/s wr, 8 op/s 2023-05-08T14:01:20.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37018.971294 secs 2023-05-08T14:01:22.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:22 smithi133 ceph-mon[125939]: pgmap v19797: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 510 KiB/s rd, 507 KiB/s wr, 10 op/s 2023-05-08T14:01:22.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:22 smithi096 ceph-mon[124666]: pgmap v19797: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 510 KiB/s rd, 507 KiB/s wr, 10 op/s 2023-05-08T14:01:22.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:22 smithi186 ceph-mon[126480]: pgmap v19797: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 510 KiB/s rd, 507 KiB/s wr, 10 op/s 2023-05-08T14:01:24.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:23 smithi133 ceph-mon[125939]: pgmap v19798: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 508 KiB/s rd, 506 KiB/s wr, 7 op/s 2023-05-08T14:01:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37023.416944 secs 2023-05-08T14:01:24.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:23 smithi096 ceph-mon[124666]: pgmap v19798: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 508 KiB/s rd, 506 KiB/s wr, 7 op/s 2023-05-08T14:01:24.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37023.416944 secs 2023-05-08T14:01:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:23 smithi186 ceph-mon[126480]: pgmap v19798: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 508 KiB/s rd, 506 KiB/s wr, 7 op/s 2023-05-08T14:01:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37023.416944 secs 2023-05-08T14:01:25.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:25 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:01:25.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:25 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:01:25.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:25 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:01:26.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:26 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:01:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:26 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:01:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:26 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:01:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:26 smithi133 ceph-mon[125939]: pgmap v19799: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 13 op/s 2023-05-08T14:01:26.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:26 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:01:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:26 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:01:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:26 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:01:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:26 smithi096 ceph-mon[124666]: pgmap v19799: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 13 op/s 2023-05-08T14:01:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:26 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:01:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:26 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:01:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:26 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:01:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:26 smithi186 ceph-mon[126480]: pgmap v19799: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 13 op/s 2023-05-08T14:01:28.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:28 smithi133 ceph-mon[125939]: pgmap v19800: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 903 KiB/s wr, 11 op/s 2023-05-08T14:01:28.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:28 smithi096 ceph-mon[124666]: pgmap v19800: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 903 KiB/s wr, 11 op/s 2023-05-08T14:01:28.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:28 smithi186 ceph-mon[126480]: pgmap v19800: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 903 KiB/s wr, 11 op/s 2023-05-08T14:01:29.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37028.417082 secs 2023-05-08T14:01:29.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37028.417082 secs 2023-05-08T14:01:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37028.417082 secs 2023-05-08T14:01:30.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:30 smithi133 ceph-mon[125939]: pgmap v19801: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 906 KiB/s wr, 11 op/s 2023-05-08T14:01:30.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:30 smithi096 ceph-mon[124666]: pgmap v19801: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 906 KiB/s wr, 11 op/s 2023-05-08T14:01:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:30 smithi186 ceph-mon[126480]: pgmap v19801: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 906 KiB/s wr, 11 op/s 2023-05-08T14:01:32.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:32 smithi133 ceph-mon[125939]: pgmap v19802: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 934 KiB/s wr, 14 op/s 2023-05-08T14:01:32.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:32 smithi133 ceph-mon[125939]: osdmap e1314: 12 total, 12 up, 12 in 2023-05-08T14:01:32.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:32 smithi096 ceph-mon[124666]: pgmap v19802: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 934 KiB/s wr, 14 op/s 2023-05-08T14:01:32.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:32 smithi096 ceph-mon[124666]: osdmap e1314: 12 total, 12 up, 12 in 2023-05-08T14:01:32.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:32 smithi186 ceph-mon[126480]: pgmap v19802: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 934 KiB/s wr, 14 op/s 2023-05-08T14:01:32.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:32 smithi186 ceph-mon[126480]: osdmap e1314: 12 total, 12 up, 12 in 2023-05-08T14:01:34.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:33 smithi133 ceph-mon[125939]: pgmap v19804: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T14:01:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37033.417215 secs 2023-05-08T14:01:34.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:33 smithi096 ceph-mon[124666]: pgmap v19804: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T14:01:34.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37033.417215 secs 2023-05-08T14:01:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:33 smithi186 ceph-mon[126480]: pgmap v19804: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T14:01:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37033.417215 secs 2023-05-08T14:01:36.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:36 smithi133 ceph-mon[125939]: pgmap v19805: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 456 KiB/s wr, 10 op/s 2023-05-08T14:01:36.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:36 smithi096 ceph-mon[124666]: pgmap v19805: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 456 KiB/s wr, 10 op/s 2023-05-08T14:01:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:36 smithi186 ceph-mon[126480]: pgmap v19805: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 456 KiB/s wr, 10 op/s 2023-05-08T14:01:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:38 smithi133 ceph-mon[125939]: pgmap v19806: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 430 KiB/s rd, 428 KiB/s wr, 10 op/s 2023-05-08T14:01:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:38 smithi133 ceph-mon[125939]: osdmap e1315: 12 total, 12 up, 12 in 2023-05-08T14:01:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:38 smithi096 ceph-mon[124666]: pgmap v19806: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 430 KiB/s rd, 428 KiB/s wr, 10 op/s 2023-05-08T14:01:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:38 smithi096 ceph-mon[124666]: osdmap e1315: 12 total, 12 up, 12 in 2023-05-08T14:01:38.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:38 smithi186 ceph-mon[126480]: pgmap v19806: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 430 KiB/s rd, 428 KiB/s wr, 10 op/s 2023-05-08T14:01:38.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:38 smithi186 ceph-mon[126480]: osdmap e1315: 12 total, 12 up, 12 in 2023-05-08T14:01:39.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37038.417361 secs 2023-05-08T14:01:39.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37038.417361 secs 2023-05-08T14:01:39.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37038.417361 secs 2023-05-08T14:01:40.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:40 smithi133 ceph-mon[125939]: pgmap v19808: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 489 KiB/s wr, 6 op/s 2023-05-08T14:01:40.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:40 smithi096 ceph-mon[124666]: pgmap v19808: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 489 KiB/s wr, 6 op/s 2023-05-08T14:01:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:40 smithi186 ceph-mon[126480]: pgmap v19808: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 489 KiB/s wr, 6 op/s 2023-05-08T14:01:41.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:41 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:01:41.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:41 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:01:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:41 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:01:41.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:41 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:01:41.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:41 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:01:41.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:41 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:01:41.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:41 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:01:41.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:41 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:01:41.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:41 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:01:42.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:42 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37040.312093 secs 2023-05-08T14:01:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:42 smithi096 ceph-mon[124666]: pgmap v19809: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 392 KiB/s wr, 9 op/s 2023-05-08T14:01:42.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:42 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37040.312093 secs 2023-05-08T14:01:42.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:42 smithi186 ceph-mon[126480]: pgmap v19809: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 392 KiB/s wr, 9 op/s 2023-05-08T14:01:42.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:42 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37040.312093 secs 2023-05-08T14:01:42.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:42 smithi133 ceph-mon[125939]: pgmap v19809: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 392 KiB/s wr, 9 op/s 2023-05-08T14:01:44.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:43 smithi133 ceph-mon[125939]: pgmap v19810: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 394 KiB/s rd, 391 KiB/s wr, 9 op/s 2023-05-08T14:01:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37043.417464 secs 2023-05-08T14:01:44.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:43 smithi096 ceph-mon[124666]: pgmap v19810: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 394 KiB/s rd, 391 KiB/s wr, 9 op/s 2023-05-08T14:01:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37043.417464 secs 2023-05-08T14:01:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:43 smithi186 ceph-mon[126480]: pgmap v19810: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 394 KiB/s rd, 391 KiB/s wr, 9 op/s 2023-05-08T14:01:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37043.417464 secs 2023-05-08T14:01:46.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37043.971865 secs 2023-05-08T14:01:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:46 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:01:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:46 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:01:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:46 smithi133 ceph-mon[125939]: pgmap v19811: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 588 KiB/s rd, 1010 KiB/s wr, 11 op/s 2023-05-08T14:01:46.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37043.971865 secs 2023-05-08T14:01:46.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:46 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:01:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:46 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:01:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:46 smithi096 ceph-mon[124666]: pgmap v19811: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 588 KiB/s rd, 1010 KiB/s wr, 11 op/s 2023-05-08T14:01:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37043.971865 secs 2023-05-08T14:01:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:46 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:01:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:46 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:01:46.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:46 smithi186 ceph-mon[126480]: pgmap v19811: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 588 KiB/s rd, 1010 KiB/s wr, 11 op/s 2023-05-08T14:01:48.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:48 smithi133 ceph-mon[125939]: pgmap v19812: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 584 KiB/s rd, 1006 KiB/s wr, 11 op/s 2023-05-08T14:01:48.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:48 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:01:48.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:48 smithi096 ceph-mon[124666]: pgmap v19812: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 584 KiB/s rd, 1006 KiB/s wr, 11 op/s 2023-05-08T14:01:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:48 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:01:48.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:48 smithi186 ceph-mon[126480]: pgmap v19812: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 584 KiB/s rd, 1006 KiB/s wr, 11 op/s 2023-05-08T14:01:48.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:48 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:01:49.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37048.417589 secs 2023-05-08T14:01:49.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:01:49.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37048.417589 secs 2023-05-08T14:01:49.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:01:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37048.417589 secs 2023-05-08T14:01:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:01:50.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:50 smithi133 ceph-mon[125939]: pgmap v19813: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T14:01:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:01:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:01:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37048.972020 secs 2023-05-08T14:01:50.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:50 smithi096 ceph-mon[124666]: pgmap v19813: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T14:01:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:01:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:01:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37048.972020 secs 2023-05-08T14:01:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:50 smithi186 ceph-mon[126480]: pgmap v19813: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T14:01:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:01:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:01:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37048.972020 secs 2023-05-08T14:01:52.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:52 smithi133 ceph-mon[125939]: pgmap v19814: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T14:01:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:52 smithi096 ceph-mon[124666]: pgmap v19814: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T14:01:52.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:52 smithi186 ceph-mon[126480]: pgmap v19814: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T14:01:53.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:53 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:01:53.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:53 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:01:53.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:53 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:01:54.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:54 smithi133 ceph-mon[125939]: pgmap v19815: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T14:01:54.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37053.417679 secs 2023-05-08T14:01:54.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:54 smithi096 ceph-mon[124666]: pgmap v19815: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T14:01:54.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37053.417679 secs 2023-05-08T14:01:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:54 smithi186 ceph-mon[126480]: pgmap v19815: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T14:01:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37053.417679 secs 2023-05-08T14:01:56.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:56 smithi133 ceph-mon[125939]: pgmap v19816: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 15 op/s 2023-05-08T14:01:56.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:56 smithi096 ceph-mon[124666]: pgmap v19816: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 15 op/s 2023-05-08T14:01:56.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:56 smithi186 ceph-mon[126480]: pgmap v19816: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 15 op/s 2023-05-08T14:01:57.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:01:57.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:01:57.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:01:58.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:58 smithi133 ceph-mon[125939]: pgmap v19817: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T14:01:58.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:01:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:01:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:01:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:58 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:01:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:01:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:01:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:01:58.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:58 smithi096 ceph-mon[124666]: pgmap v19817: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T14:01:58.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:01:58.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:01:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:01:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:58 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:01:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:01:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:01:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:01:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:58 smithi186 ceph-mon[126480]: pgmap v19817: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T14:01:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:01:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:01:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:01:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:58 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:01:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:01:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:01:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:01:59.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:59 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:01:59.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:59 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T14:01:59.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:59 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T14:01:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:59 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:01:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:01:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37058.417788 secs 2023-05-08T14:01:59.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:59 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:01:59.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:59 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T14:01:59.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:59 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T14:01:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:59 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:01:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:01:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37058.417788 secs 2023-05-08T14:01:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:59 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:01:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:59 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T14:01:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:59 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T14:01:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:59 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:01:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:01:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37058.417788 secs 2023-05-08T14:02:00.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:00 smithi133 ceph-mon[125939]: pgmap v19818: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 13 op/s 2023-05-08T14:02:00.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37058.972303 secs 2023-05-08T14:02:00.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:00 smithi096 ceph-mon[124666]: pgmap v19818: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 13 op/s 2023-05-08T14:02:00.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37058.972303 secs 2023-05-08T14:02:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:00 smithi186 ceph-mon[126480]: pgmap v19818: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 13 op/s 2023-05-08T14:02:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37058.972303 secs 2023-05-08T14:02:02.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:02 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37060.312610 secs 2023-05-08T14:02:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:02 smithi133 ceph-mon[125939]: pgmap v19819: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 15 op/s 2023-05-08T14:02:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:02:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:02:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:02:02.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:02 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37060.312610 secs 2023-05-08T14:02:02.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:02 smithi096 ceph-mon[124666]: pgmap v19819: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 15 op/s 2023-05-08T14:02:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:02:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:02:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:02:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:02 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37060.312610 secs 2023-05-08T14:02:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:02 smithi186 ceph-mon[126480]: pgmap v19819: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 15 op/s 2023-05-08T14:02:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:02:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:02:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:02:03.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:03 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:02:03.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:03 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:02:03.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:03 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:02:04.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:04 smithi133 ceph-mon[125939]: pgmap v19820: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 12 op/s 2023-05-08T14:02:04.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37063.417920 secs 2023-05-08T14:02:04.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:04 smithi096 ceph-mon[124666]: pgmap v19820: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 12 op/s 2023-05-08T14:02:04.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37063.417920 secs 2023-05-08T14:02:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:04 smithi186 ceph-mon[126480]: pgmap v19820: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 12 op/s 2023-05-08T14:02:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37063.417920 secs 2023-05-08T14:02:05.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:05 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:02:05.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:05 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:02:05.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:05 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:02:06.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:06 smithi133 ceph-mon[125939]: pgmap v19821: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 19 op/s 2023-05-08T14:02:06.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:02:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:02:06.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:06 smithi096 ceph-mon[124666]: pgmap v19821: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 19 op/s 2023-05-08T14:02:06.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:02:06.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:02:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:06 smithi186 ceph-mon[126480]: pgmap v19821: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 19 op/s 2023-05-08T14:02:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:02:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:02:07.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:07 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37065.312729 secs 2023-05-08T14:02:07.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:07 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37065.312729 secs 2023-05-08T14:02:07.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:07 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37065.312729 secs 2023-05-08T14:02:08.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:08 smithi096 ceph-mon[124666]: pgmap v19822: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 15 op/s 2023-05-08T14:02:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:08 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:02:08.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:08 smithi186 ceph-mon[126480]: pgmap v19822: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 15 op/s 2023-05-08T14:02:08.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:08 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:02:08.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:08 smithi133 ceph-mon[125939]: pgmap v19822: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 15 op/s 2023-05-08T14:02:08.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:08 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:02:09.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37068.418074 secs 2023-05-08T14:02:09.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37068.418074 secs 2023-05-08T14:02:09.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37068.418074 secs 2023-05-08T14:02:10.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:10 smithi096 ceph-mon[124666]: pgmap v19823: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 18 op/s 2023-05-08T14:02:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37068.972592 secs 2023-05-08T14:02:10.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:10 smithi186 ceph-mon[126480]: pgmap v19823: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 18 op/s 2023-05-08T14:02:10.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37068.972592 secs 2023-05-08T14:02:10.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:10 smithi133 ceph-mon[125939]: pgmap v19823: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 18 op/s 2023-05-08T14:02:10.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37068.972592 secs 2023-05-08T14:02:12.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:12 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37070.312853 secs 2023-05-08T14:02:12.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:12 smithi186 ceph-mon[126480]: pgmap v19824: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.8 MiB/s wr, 31 op/s 2023-05-08T14:02:12.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:12 smithi186 ceph-mon[126480]: osdmap e1316: 12 total, 12 up, 12 in 2023-05-08T14:02:12.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:12 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37070.312853 secs 2023-05-08T14:02:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:12 smithi133 ceph-mon[125939]: pgmap v19824: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.8 MiB/s wr, 31 op/s 2023-05-08T14:02:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:12 smithi133 ceph-mon[125939]: osdmap e1316: 12 total, 12 up, 12 in 2023-05-08T14:02:12.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:12 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37070.312853 secs 2023-05-08T14:02:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:12 smithi096 ceph-mon[124666]: pgmap v19824: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.8 MiB/s wr, 31 op/s 2023-05-08T14:02:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:12 smithi096 ceph-mon[124666]: osdmap e1316: 12 total, 12 up, 12 in 2023-05-08T14:02:14.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:13 smithi133 ceph-mon[125939]: pgmap v19826: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.7 MiB/s wr, 32 op/s 2023-05-08T14:02:14.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37073.418213 secs 2023-05-08T14:02:14.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:13 smithi096 ceph-mon[124666]: pgmap v19826: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.7 MiB/s wr, 32 op/s 2023-05-08T14:02:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37073.418213 secs 2023-05-08T14:02:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:13 smithi186 ceph-mon[126480]: pgmap v19826: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.7 MiB/s wr, 32 op/s 2023-05-08T14:02:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37073.418213 secs 2023-05-08T14:02:15.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:14 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:02:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:14 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:02:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:14 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:02:15.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:14 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:02:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:14 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:02:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:14 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:02:15.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:14 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:02:15.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:14 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:02:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:14 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:02:16.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37073.972710 secs 2023-05-08T14:02:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:15 smithi133 ceph-mon[125939]: pgmap v19827: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 27 op/s 2023-05-08T14:02:16.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37073.972710 secs 2023-05-08T14:02:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:15 smithi096 ceph-mon[124666]: pgmap v19827: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 27 op/s 2023-05-08T14:02:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37073.972710 secs 2023-05-08T14:02:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:15 smithi186 ceph-mon[126480]: pgmap v19827: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 27 op/s 2023-05-08T14:02:17.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37075.312974 secs 2023-05-08T14:02:17.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37075.312974 secs 2023-05-08T14:02:17.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37075.312974 secs 2023-05-08T14:02:18.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:17 smithi133 ceph-mon[125939]: pgmap v19828: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 28 op/s 2023-05-08T14:02:18.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:17 smithi096 ceph-mon[124666]: pgmap v19828: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 28 op/s 2023-05-08T14:02:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:17 smithi186 ceph-mon[126480]: pgmap v19828: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 28 op/s 2023-05-08T14:02:19.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:18 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37078.418360 secs 2023-05-08T14:02:19.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:18 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37078.418360 secs 2023-05-08T14:02:19.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:18 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37078.418360 secs 2023-05-08T14:02:20.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:19 smithi133 ceph-mon[125939]: pgmap v19829: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 555 KiB/s wr, 23 op/s 2023-05-08T14:02:20.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:19 smithi096 ceph-mon[124666]: pgmap v19829: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 555 KiB/s wr, 23 op/s 2023-05-08T14:02:20.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:19 smithi186 ceph-mon[126480]: pgmap v19829: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 555 KiB/s wr, 23 op/s 2023-05-08T14:02:21.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37078.972869 secs 2023-05-08T14:02:21.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37078.972869 secs 2023-05-08T14:02:21.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37078.972869 secs 2023-05-08T14:02:22.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37080.313092 secs 2023-05-08T14:02:22.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:21 smithi133 ceph-mon[125939]: pgmap v19830: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 938 KiB/s rd, 936 KiB/s wr, 11 op/s 2023-05-08T14:02:22.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37080.313092 secs 2023-05-08T14:02:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:21 smithi096 ceph-mon[124666]: pgmap v19830: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 938 KiB/s rd, 936 KiB/s wr, 11 op/s 2023-05-08T14:02:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37080.313092 secs 2023-05-08T14:02:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:21 smithi186 ceph-mon[126480]: pgmap v19830: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 938 KiB/s rd, 936 KiB/s wr, 11 op/s 2023-05-08T14:02:24.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:23 smithi133 ceph-mon[125939]: osdmap e1317: 12 total, 12 up, 12 in 2023-05-08T14:02:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:23 smithi133 ceph-mon[125939]: pgmap v19832: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 938 KiB/s rd, 936 KiB/s wr, 11 op/s 2023-05-08T14:02:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37083.418450 secs 2023-05-08T14:02:24.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:23 smithi096 ceph-mon[124666]: osdmap e1317: 12 total, 12 up, 12 in 2023-05-08T14:02:24.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:23 smithi096 ceph-mon[124666]: pgmap v19832: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 938 KiB/s rd, 936 KiB/s wr, 11 op/s 2023-05-08T14:02:24.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37083.418450 secs 2023-05-08T14:02:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:23 smithi186 ceph-mon[126480]: osdmap e1317: 12 total, 12 up, 12 in 2023-05-08T14:02:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:23 smithi186 ceph-mon[126480]: pgmap v19832: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 938 KiB/s rd, 936 KiB/s wr, 11 op/s 2023-05-08T14:02:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37083.418450 secs 2023-05-08T14:02:25.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37083.972997 secs 2023-05-08T14:02:25.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37083.972997 secs 2023-05-08T14:02:25.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37083.972997 secs 2023-05-08T14:02:26.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:26 smithi133 ceph-mon[125939]: pgmap v19833: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 890 KiB/s rd, 888 KiB/s wr, 10 op/s 2023-05-08T14:02:26.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:26 smithi096 ceph-mon[124666]: pgmap v19833: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 890 KiB/s rd, 888 KiB/s wr, 10 op/s 2023-05-08T14:02:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:26 smithi186 ceph-mon[126480]: pgmap v19833: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 890 KiB/s rd, 888 KiB/s wr, 10 op/s 2023-05-08T14:02:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:27 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37085.313208 secs 2023-05-08T14:02:27.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:27 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37085.313208 secs 2023-05-08T14:02:27.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:27 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37085.313208 secs 2023-05-08T14:02:28.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:28 smithi133 ceph-mon[125939]: pgmap v19834: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 846 KiB/s rd, 843 KiB/s wr, 9 op/s 2023-05-08T14:02:28.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:28 smithi096 ceph-mon[124666]: pgmap v19834: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 846 KiB/s rd, 843 KiB/s wr, 9 op/s 2023-05-08T14:02:28.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:28 smithi186 ceph-mon[126480]: pgmap v19834: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 846 KiB/s rd, 843 KiB/s wr, 9 op/s 2023-05-08T14:02:29.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37088.418519 secs 2023-05-08T14:02:29.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37088.418519 secs 2023-05-08T14:02:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37088.418519 secs 2023-05-08T14:02:30.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:30 smithi133 ceph-mon[125939]: pgmap v19835: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 808 KiB/s rd, 805 KiB/s wr, 9 op/s 2023-05-08T14:02:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37088.973136 secs 2023-05-08T14:02:30.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:30 smithi096 ceph-mon[124666]: pgmap v19835: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 808 KiB/s rd, 805 KiB/s wr, 9 op/s 2023-05-08T14:02:30.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37088.973136 secs 2023-05-08T14:02:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:30 smithi186 ceph-mon[126480]: pgmap v19835: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 808 KiB/s rd, 805 KiB/s wr, 9 op/s 2023-05-08T14:02:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37088.973136 secs 2023-05-08T14:02:32.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:32 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37090.313317 secs 2023-05-08T14:02:32.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:32 smithi133 ceph-mon[125939]: pgmap v19836: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 7 op/s 2023-05-08T14:02:32.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:32 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37090.313317 secs 2023-05-08T14:02:32.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:32 smithi096 ceph-mon[124666]: pgmap v19836: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 7 op/s 2023-05-08T14:02:32.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:32 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37090.313317 secs 2023-05-08T14:02:32.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:32 smithi186 ceph-mon[126480]: pgmap v19836: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 7 op/s 2023-05-08T14:02:34.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:33 smithi133 ceph-mon[125939]: pgmap v19837: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 7 op/s 2023-05-08T14:02:34.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37093.418638 secs 2023-05-08T14:02:34.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:33 smithi096 ceph-mon[124666]: pgmap v19837: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 7 op/s 2023-05-08T14:02:34.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37093.418638 secs 2023-05-08T14:02:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:33 smithi186 ceph-mon[126480]: pgmap v19837: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 7 op/s 2023-05-08T14:02:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37093.418638 secs 2023-05-08T14:02:35.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37093.973259 secs 2023-05-08T14:02:35.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37093.973259 secs 2023-05-08T14:02:35.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37093.973259 secs 2023-05-08T14:02:36.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:36 smithi133 ceph-mon[125939]: pgmap v19838: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 355 KiB/s wr, 10 op/s 2023-05-08T14:02:36.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:36 smithi096 ceph-mon[124666]: pgmap v19838: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 355 KiB/s wr, 10 op/s 2023-05-08T14:02:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:36 smithi186 ceph-mon[126480]: pgmap v19838: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 355 KiB/s wr, 10 op/s 2023-05-08T14:02:37.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:37 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37095.313452 secs 2023-05-08T14:02:37.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:37 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37095.313452 secs 2023-05-08T14:02:37.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:37 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37095.313452 secs 2023-05-08T14:02:38.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:38 smithi133 ceph-mon[125939]: pgmap v19839: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 355 KiB/s wr, 7 op/s 2023-05-08T14:02:38.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:38 smithi096 ceph-mon[124666]: pgmap v19839: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 355 KiB/s wr, 7 op/s 2023-05-08T14:02:38.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:38 smithi186 ceph-mon[126480]: pgmap v19839: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 355 KiB/s wr, 7 op/s 2023-05-08T14:02:39.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37098.418753 secs 2023-05-08T14:02:39.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37098.418753 secs 2023-05-08T14:02:39.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37098.418753 secs 2023-05-08T14:02:40.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:40 smithi133 ceph-mon[125939]: pgmap v19840: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 355 KiB/s wr, 7 op/s 2023-05-08T14:02:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37098.973388 secs 2023-05-08T14:02:40.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:40 smithi096 ceph-mon[124666]: pgmap v19840: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 355 KiB/s wr, 7 op/s 2023-05-08T14:02:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37098.973388 secs 2023-05-08T14:02:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:40 smithi186 ceph-mon[126480]: pgmap v19840: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 355 KiB/s wr, 7 op/s 2023-05-08T14:02:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37098.973388 secs 2023-05-08T14:02:42.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:42 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37100.313593 secs 2023-05-08T14:02:42.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:42 smithi133 ceph-mon[125939]: pgmap v19841: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 684 KiB/s wr, 10 op/s 2023-05-08T14:02:42.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:42 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37100.313593 secs 2023-05-08T14:02:42.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:42 smithi096 ceph-mon[124666]: pgmap v19841: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 684 KiB/s wr, 10 op/s 2023-05-08T14:02:42.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:42 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37100.313593 secs 2023-05-08T14:02:42.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:42 smithi186 ceph-mon[126480]: pgmap v19841: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 684 KiB/s wr, 10 op/s 2023-05-08T14:02:44.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:43 smithi133 ceph-mon[125939]: pgmap v19842: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 661 KiB/s rd, 659 KiB/s wr, 7 op/s 2023-05-08T14:02:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37103.418860 secs 2023-05-08T14:02:44.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:43 smithi096 ceph-mon[124666]: pgmap v19842: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 661 KiB/s rd, 659 KiB/s wr, 7 op/s 2023-05-08T14:02:44.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37103.418860 secs 2023-05-08T14:02:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:43 smithi186 ceph-mon[126480]: pgmap v19842: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 661 KiB/s rd, 659 KiB/s wr, 7 op/s 2023-05-08T14:02:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37103.418860 secs 2023-05-08T14:02:45.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37103.973513 secs 2023-05-08T14:02:45.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37103.973513 secs 2023-05-08T14:02:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37103.973513 secs 2023-05-08T14:02:46.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:46 smithi133 ceph-mon[125939]: pgmap v19843: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 662 KiB/s rd, 659 KiB/s wr, 10 op/s 2023-05-08T14:02:46.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:46 smithi096 ceph-mon[124666]: pgmap v19843: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 662 KiB/s rd, 659 KiB/s wr, 10 op/s 2023-05-08T14:02:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:46 smithi186 ceph-mon[126480]: pgmap v19843: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 662 KiB/s rd, 659 KiB/s wr, 10 op/s 2023-05-08T14:02:48.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:48 smithi133 ceph-mon[125939]: pgmap v19844: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 330 KiB/s wr, 7 op/s 2023-05-08T14:02:48.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:48 smithi096 ceph-mon[124666]: pgmap v19844: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 330 KiB/s wr, 7 op/s 2023-05-08T14:02:48.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:48 smithi186 ceph-mon[126480]: pgmap v19844: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 330 KiB/s wr, 7 op/s 2023-05-08T14:02:49.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37108.419014 secs 2023-05-08T14:02:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:02:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37108.419014 secs 2023-05-08T14:02:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:02:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37108.419014 secs 2023-05-08T14:02:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:02:50.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:50 smithi133 ceph-mon[125939]: pgmap v19845: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 330 KiB/s wr, 6 op/s 2023-05-08T14:02:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:02:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:02:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:02:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37108.973632 secs 2023-05-08T14:02:50.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:50 smithi096 ceph-mon[124666]: pgmap v19845: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 330 KiB/s wr, 6 op/s 2023-05-08T14:02:50.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:02:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:02:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:02:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37108.973632 secs 2023-05-08T14:02:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:50 smithi186 ceph-mon[126480]: pgmap v19845: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 330 KiB/s wr, 6 op/s 2023-05-08T14:02:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:02:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:02:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:02:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37108.973632 secs 2023-05-08T14:02:52.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:52 smithi133 ceph-mon[125939]: pgmap v19846: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 685 KiB/s rd, 664 KiB/s wr, 10 op/s 2023-05-08T14:02:52.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:52 smithi096 ceph-mon[124666]: pgmap v19846: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 685 KiB/s rd, 664 KiB/s wr, 10 op/s 2023-05-08T14:02:52.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:52 smithi186 ceph-mon[126480]: pgmap v19846: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 685 KiB/s rd, 664 KiB/s wr, 10 op/s 2023-05-08T14:02:54.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:53 smithi133 ceph-mon[125939]: pgmap v19847: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 335 KiB/s wr, 7 op/s 2023-05-08T14:02:54.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37113.419129 secs 2023-05-08T14:02:54.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:53 smithi096 ceph-mon[124666]: pgmap v19847: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 335 KiB/s wr, 7 op/s 2023-05-08T14:02:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37113.419129 secs 2023-05-08T14:02:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:53 smithi186 ceph-mon[126480]: pgmap v19847: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 335 KiB/s wr, 7 op/s 2023-05-08T14:02:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37113.419129 secs 2023-05-08T14:02:56.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:56 smithi133 ceph-mon[125939]: pgmap v19848: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1013 KiB/s rd, 981 KiB/s wr, 11 op/s 2023-05-08T14:02:56.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:56 smithi096 ceph-mon[124666]: pgmap v19848: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1013 KiB/s rd, 981 KiB/s wr, 11 op/s 2023-05-08T14:02:56.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:56 smithi186 ceph-mon[126480]: pgmap v19848: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1013 KiB/s rd, 981 KiB/s wr, 11 op/s 2023-05-08T14:02:57.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:02:57.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:02:57.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:02:58.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:58 smithi133 ceph-mon[125939]: pgmap v19849: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1008 KiB/s wr, 9 op/s 2023-05-08T14:02:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:58 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:02:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:02:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:02:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:02:58.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:58 smithi096 ceph-mon[124666]: pgmap v19849: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1008 KiB/s wr, 9 op/s 2023-05-08T14:02:58.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:58 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:02:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:02:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:02:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:02:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:58 smithi186 ceph-mon[126480]: pgmap v19849: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1008 KiB/s wr, 9 op/s 2023-05-08T14:02:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:58 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:02:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:02:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:02:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:02:59.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37118.419196 secs 2023-05-08T14:02:59.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:02:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:02:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:02:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:02:59.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37118.419196 secs 2023-05-08T14:02:59.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:02:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:02:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:02:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:02:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37118.419196 secs 2023-05-08T14:02:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:02:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:02:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:02:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:03:00.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:00 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:03:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:00 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T14:03:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:00 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T14:03:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:00 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:03:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:00 smithi133 ceph-mon[125939]: pgmap v19850: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 9 op/s 2023-05-08T14:03:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37118.973823 secs 2023-05-08T14:03:00.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:00 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:03:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:00 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T14:03:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:00 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T14:03:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:00 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:03:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:00 smithi096 ceph-mon[124666]: pgmap v19850: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 9 op/s 2023-05-08T14:03:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37118.973823 secs 2023-05-08T14:03:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:00 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:03:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:00 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T14:03:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:00 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T14:03:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:00 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:03:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:00 smithi186 ceph-mon[126480]: pgmap v19850: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 9 op/s 2023-05-08T14:03:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37118.973823 secs 2023-05-08T14:03:02.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:02 smithi133 ceph-mon[125939]: pgmap v19851: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 14 op/s 2023-05-08T14:03:02.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:03:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:03:02.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:02 smithi096 ceph-mon[124666]: pgmap v19851: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 14 op/s 2023-05-08T14:03:02.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:03:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:03:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:02 smithi186 ceph-mon[126480]: pgmap v19851: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 14 op/s 2023-05-08T14:03:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:03:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:03:03.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:03 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:03:03.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:03 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:03:03.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:03 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:03:04.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:04 smithi133 ceph-mon[125939]: pgmap v19852: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 11 op/s 2023-05-08T14:03:04.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37123.419318 secs 2023-05-08T14:03:04.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:04 smithi096 ceph-mon[124666]: pgmap v19852: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 11 op/s 2023-05-08T14:03:04.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37123.419318 secs 2023-05-08T14:03:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:04 smithi186 ceph-mon[126480]: pgmap v19852: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 11 op/s 2023-05-08T14:03:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37123.419318 secs 2023-05-08T14:03:05.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37123.973960 secs 2023-05-08T14:03:05.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37123.973960 secs 2023-05-08T14:03:05.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37123.973960 secs 2023-05-08T14:03:06.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:06 smithi133 ceph-mon[125939]: pgmap v19853: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 17 op/s 2023-05-08T14:03:06.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:06 smithi096 ceph-mon[124666]: pgmap v19853: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 17 op/s 2023-05-08T14:03:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:06 smithi186 ceph-mon[126480]: pgmap v19853: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 17 op/s 2023-05-08T14:03:08.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:08 smithi096 ceph-mon[124666]: pgmap v19854: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T14:03:08.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:08 smithi186 ceph-mon[126480]: pgmap v19854: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T14:03:08.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:08 smithi133 ceph-mon[125939]: pgmap v19854: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T14:03:09.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37128.419412 secs 2023-05-08T14:03:09.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37128.419412 secs 2023-05-08T14:03:09.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37128.419412 secs 2023-05-08T14:03:10.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:10 smithi096 ceph-mon[124666]: pgmap v19855: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T14:03:10.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:10 smithi186 ceph-mon[126480]: pgmap v19855: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T14:03:10.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:10 smithi133 ceph-mon[125939]: pgmap v19855: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T14:03:12.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:12 smithi096 ceph-mon[124666]: pgmap v19856: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 27 op/s 2023-05-08T14:03:12.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:12 smithi186 ceph-mon[126480]: pgmap v19856: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 27 op/s 2023-05-08T14:03:12.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:12 smithi133 ceph-mon[125939]: pgmap v19856: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 27 op/s 2023-05-08T14:03:14.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:13 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:03:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:13 smithi133 ceph-mon[125939]: pgmap v19857: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 792 KiB/s rd, 805 KiB/s wr, 22 op/s 2023-05-08T14:03:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37133.419526 secs 2023-05-08T14:03:14.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:13 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:03:14.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:13 smithi096 ceph-mon[124666]: pgmap v19857: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 792 KiB/s rd, 805 KiB/s wr, 22 op/s 2023-05-08T14:03:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37133.419526 secs 2023-05-08T14:03:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:13 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:03:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:13 smithi186 ceph-mon[126480]: pgmap v19857: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 792 KiB/s rd, 805 KiB/s wr, 22 op/s 2023-05-08T14:03:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37133.419526 secs 2023-05-08T14:03:15.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:14 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:03:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:14 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:03:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:14 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:03:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:14 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:03:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:14 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:03:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:14 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:03:15.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:14 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:03:15.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:14 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:03:15.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:14 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:03:16.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:15 smithi133 ceph-mon[125939]: pgmap v19858: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 949 KiB/s rd, 961 KiB/s wr, 25 op/s 2023-05-08T14:03:16.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:15 smithi096 ceph-mon[124666]: pgmap v19858: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 949 KiB/s rd, 961 KiB/s wr, 25 op/s 2023-05-08T14:03:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:15 smithi186 ceph-mon[126480]: pgmap v19858: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 949 KiB/s rd, 961 KiB/s wr, 25 op/s 2023-05-08T14:03:18.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:18 smithi133 ceph-mon[125939]: pgmap v19859: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 761 KiB/s rd, 795 KiB/s wr, 19 op/s 2023-05-08T14:03:18.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:18 smithi096 ceph-mon[124666]: pgmap v19859: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 761 KiB/s rd, 795 KiB/s wr, 19 op/s 2023-05-08T14:03:18.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:18 smithi186 ceph-mon[126480]: pgmap v19859: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 761 KiB/s rd, 795 KiB/s wr, 19 op/s 2023-05-08T14:03:19.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37138.419613 secs 2023-05-08T14:03:19.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37138.419613 secs 2023-05-08T14:03:19.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37138.419613 secs 2023-05-08T14:03:20.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:20 smithi133 ceph-mon[125939]: pgmap v19860: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 20 op/s 2023-05-08T14:03:20.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:20 smithi096 ceph-mon[124666]: pgmap v19860: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 20 op/s 2023-05-08T14:03:20.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:20 smithi186 ceph-mon[126480]: pgmap v19860: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 20 op/s 2023-05-08T14:03:22.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:22 smithi133 ceph-mon[125939]: pgmap v19861: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 22 op/s 2023-05-08T14:03:22.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:22 smithi096 ceph-mon[124666]: pgmap v19861: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 22 op/s 2023-05-08T14:03:22.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:22 smithi186 ceph-mon[126480]: pgmap v19861: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 22 op/s 2023-05-08T14:03:24.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:23 smithi133 ceph-mon[125939]: pgmap v19862: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 580 KiB/s rd, 457 KiB/s wr, 7 op/s 2023-05-08T14:03:24.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37143.419738 secs 2023-05-08T14:03:24.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:23 smithi096 ceph-mon[124666]: pgmap v19862: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 580 KiB/s rd, 457 KiB/s wr, 7 op/s 2023-05-08T14:03:24.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37143.419738 secs 2023-05-08T14:03:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:23 smithi186 ceph-mon[126480]: pgmap v19862: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 580 KiB/s rd, 457 KiB/s wr, 7 op/s 2023-05-08T14:03:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37143.419738 secs 2023-05-08T14:03:25.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37143.974408 secs 2023-05-08T14:03:25.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:25 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:03:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:25 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:03:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:25 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:03:25.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37143.974408 secs 2023-05-08T14:03:25.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:25 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:03:25.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:25 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:03:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:25 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:03:25.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37143.974408 secs 2023-05-08T14:03:25.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:25 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:03:25.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:25 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:03:25.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:25 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:03:26.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:26 smithi133 ceph-mon[125939]: pgmap v19863: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 15 op/s 2023-05-08T14:03:26.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:26 smithi096 ceph-mon[124666]: pgmap v19863: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 15 op/s 2023-05-08T14:03:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:26 smithi186 ceph-mon[126480]: pgmap v19863: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 15 op/s 2023-05-08T14:03:27.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:27 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37145.314686 secs 2023-05-08T14:03:27.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:27 smithi133 ceph-mon[125939]: osdmap e1318: 12 total, 12 up, 12 in 2023-05-08T14:03:27.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:27 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37145.314686 secs 2023-05-08T14:03:27.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:27 smithi096 ceph-mon[124666]: osdmap e1318: 12 total, 12 up, 12 in 2023-05-08T14:03:27.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:27 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37145.314686 secs 2023-05-08T14:03:27.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:27 smithi186 ceph-mon[126480]: osdmap e1318: 12 total, 12 up, 12 in 2023-05-08T14:03:28.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:28 smithi133 ceph-mon[125939]: pgmap v19865: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 14 op/s 2023-05-08T14:03:28.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:28 smithi096 ceph-mon[124666]: pgmap v19865: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 14 op/s 2023-05-08T14:03:28.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:28 smithi186 ceph-mon[126480]: pgmap v19865: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 14 op/s 2023-05-08T14:03:29.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37148.419865 secs 2023-05-08T14:03:29.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37148.419865 secs 2023-05-08T14:03:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37148.419865 secs 2023-05-08T14:03:30.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:30 smithi133 ceph-mon[125939]: pgmap v19866: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 15 op/s 2023-05-08T14:03:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:30 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:03:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:30 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:03:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37148.974542 secs 2023-05-08T14:03:30.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:30 smithi096 ceph-mon[124666]: pgmap v19866: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 15 op/s 2023-05-08T14:03:30.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:30 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:03:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:30 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:03:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37148.974542 secs 2023-05-08T14:03:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:30 smithi186 ceph-mon[126480]: pgmap v19866: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 15 op/s 2023-05-08T14:03:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:30 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:03:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:30 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:03:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37148.974542 secs 2023-05-08T14:03:32.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:32 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37150.314749 secs 2023-05-08T14:03:32.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:32 smithi133 ceph-mon[125939]: pgmap v19867: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 15 op/s 2023-05-08T14:03:32.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:32 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37150.314749 secs 2023-05-08T14:03:32.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:32 smithi096 ceph-mon[124666]: pgmap v19867: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 15 op/s 2023-05-08T14:03:32.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:32 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37150.314749 secs 2023-05-08T14:03:32.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:32 smithi186 ceph-mon[126480]: pgmap v19867: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 15 op/s 2023-05-08T14:03:33.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:33 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:03:33.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:33 smithi133 ceph-mon[125939]: osdmap e1319: 12 total, 12 up, 12 in 2023-05-08T14:03:33.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:33 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:03:33.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:33 smithi096 ceph-mon[124666]: osdmap e1319: 12 total, 12 up, 12 in 2023-05-08T14:03:33.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:33 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:03:33.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:33 smithi186 ceph-mon[126480]: osdmap e1319: 12 total, 12 up, 12 in 2023-05-08T14:03:34.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:34 smithi133 ceph-mon[125939]: pgmap v19869: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 234 KiB/s wr, 7 op/s 2023-05-08T14:03:34.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37153.420010 secs 2023-05-08T14:03:34.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:34 smithi096 ceph-mon[124666]: pgmap v19869: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 234 KiB/s wr, 7 op/s 2023-05-08T14:03:34.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37153.420010 secs 2023-05-08T14:03:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:34 smithi186 ceph-mon[126480]: pgmap v19869: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 234 KiB/s wr, 7 op/s 2023-05-08T14:03:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37153.420010 secs 2023-05-08T14:03:35.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37153.974611 secs 2023-05-08T14:03:35.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37153.974611 secs 2023-05-08T14:03:35.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37153.974611 secs 2023-05-08T14:03:36.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:36 smithi133 ceph-mon[125939]: pgmap v19870: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2023-05-08T14:03:36.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:36 smithi096 ceph-mon[124666]: pgmap v19870: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2023-05-08T14:03:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:36 smithi186 ceph-mon[126480]: pgmap v19870: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2023-05-08T14:03:37.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:37 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37155.314854 secs 2023-05-08T14:03:37.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:37 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37155.314854 secs 2023-05-08T14:03:37.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:37 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37155.314854 secs 2023-05-08T14:03:38.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:38 smithi133 ceph-mon[125939]: pgmap v19871: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T14:03:38.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:38 smithi096 ceph-mon[124666]: pgmap v19871: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T14:03:38.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:38 smithi186 ceph-mon[126480]: pgmap v19871: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T14:03:39.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37158.420146 secs 2023-05-08T14:03:39.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37158.420146 secs 2023-05-08T14:03:39.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37158.420146 secs 2023-05-08T14:03:40.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:40 smithi096 ceph-mon[124666]: pgmap v19872: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T14:03:40.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37158.974681 secs 2023-05-08T14:03:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:40 smithi186 ceph-mon[126480]: pgmap v19872: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T14:03:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37158.974681 secs 2023-05-08T14:03:40.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:40 smithi133 ceph-mon[125939]: pgmap v19872: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T14:03:40.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37158.974681 secs 2023-05-08T14:03:42.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:42 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37160.314958 secs 2023-05-08T14:03:42.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:42 smithi096 ceph-mon[124666]: pgmap v19873: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T14:03:42.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:42 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37160.314958 secs 2023-05-08T14:03:42.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:42 smithi186 ceph-mon[126480]: pgmap v19873: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T14:03:42.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:42 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37160.314958 secs 2023-05-08T14:03:42.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:42 smithi133 ceph-mon[125939]: pgmap v19873: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T14:03:44.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:43 smithi133 ceph-mon[125939]: pgmap v19874: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T14:03:44.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37163.420265 secs 2023-05-08T14:03:44.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:43 smithi096 ceph-mon[124666]: pgmap v19874: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T14:03:44.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37163.420265 secs 2023-05-08T14:03:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:43 smithi186 ceph-mon[126480]: pgmap v19874: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T14:03:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37163.420265 secs 2023-05-08T14:03:45.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37163.974761 secs 2023-05-08T14:03:45.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37163.974761 secs 2023-05-08T14:03:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37163.974761 secs 2023-05-08T14:03:46.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:46 smithi133 ceph-mon[125939]: pgmap v19875: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T14:03:46.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:46 smithi096 ceph-mon[124666]: pgmap v19875: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T14:03:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:46 smithi186 ceph-mon[126480]: pgmap v19875: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T14:03:48.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:48 smithi133 ceph-mon[125939]: pgmap v19876: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 410 KiB/s rd, 408 KiB/s wr, 7 op/s 2023-05-08T14:03:48.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:48 smithi096 ceph-mon[124666]: pgmap v19876: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 410 KiB/s rd, 408 KiB/s wr, 7 op/s 2023-05-08T14:03:48.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:48 smithi186 ceph-mon[126480]: pgmap v19876: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 410 KiB/s rd, 408 KiB/s wr, 7 op/s 2023-05-08T14:03:49.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37168.420355 secs 2023-05-08T14:03:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:03:49.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37168.420355 secs 2023-05-08T14:03:49.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:03:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37168.420355 secs 2023-05-08T14:03:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:03:50.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:50 smithi133 ceph-mon[125939]: pgmap v19877: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 410 KiB/s rd, 408 KiB/s wr, 8 op/s 2023-05-08T14:03:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:03:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:03:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:03:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37168.974914 secs 2023-05-08T14:03:50.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:50 smithi096 ceph-mon[124666]: pgmap v19877: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 410 KiB/s rd, 408 KiB/s wr, 8 op/s 2023-05-08T14:03:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:03:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:03:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:03:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37168.974914 secs 2023-05-08T14:03:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:50 smithi186 ceph-mon[126480]: pgmap v19877: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 410 KiB/s rd, 408 KiB/s wr, 8 op/s 2023-05-08T14:03:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:03:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:03:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:03:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37168.974914 secs 2023-05-08T14:03:52.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:52 smithi133 ceph-mon[125939]: pgmap v19878: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 742 KiB/s rd, 581 KiB/s wr, 10 op/s 2023-05-08T14:03:52.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:52 smithi096 ceph-mon[124666]: pgmap v19878: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 742 KiB/s rd, 581 KiB/s wr, 10 op/s 2023-05-08T14:03:52.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:52 smithi186 ceph-mon[126480]: pgmap v19878: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 742 KiB/s rd, 581 KiB/s wr, 10 op/s 2023-05-08T14:03:54.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:53 smithi133 ceph-mon[125939]: pgmap v19879: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 741 KiB/s rd, 580 KiB/s wr, 8 op/s 2023-05-08T14:03:54.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37173.420474 secs 2023-05-08T14:03:54.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:53 smithi096 ceph-mon[124666]: pgmap v19879: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 741 KiB/s rd, 580 KiB/s wr, 8 op/s 2023-05-08T14:03:54.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37173.420474 secs 2023-05-08T14:03:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:53 smithi186 ceph-mon[126480]: pgmap v19879: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 741 KiB/s rd, 580 KiB/s wr, 8 op/s 2023-05-08T14:03:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37173.420474 secs 2023-05-08T14:03:56.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:56 smithi133 ceph-mon[125939]: pgmap v19880: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T14:03:56.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:56 smithi096 ceph-mon[124666]: pgmap v19880: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T14:03:56.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:56 smithi186 ceph-mon[126480]: pgmap v19880: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T14:03:57.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:03:57.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:03:57.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:03:58.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:58 smithi133 ceph-mon[125939]: pgmap v19881: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 8 op/s 2023-05-08T14:03:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:58 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:03:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:03:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:03:58.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:58 smithi096 ceph-mon[124666]: pgmap v19881: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 8 op/s 2023-05-08T14:03:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:58 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:03:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:03:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:03:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:58 smithi186 ceph-mon[126480]: pgmap v19881: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 8 op/s 2023-05-08T14:03:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:58 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:03:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:03:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:03:59.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37178.420591 secs 2023-05-08T14:03:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:03:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:03:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37178.420591 secs 2023-05-08T14:03:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:03:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:03:59.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37178.420591 secs 2023-05-08T14:03:59.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:03:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:04:00.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:00 smithi096 ceph-mon[124666]: pgmap v19882: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 11 op/s 2023-05-08T14:04:00.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:04:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:04:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:04:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:00 smithi186 ceph-mon[126480]: pgmap v19882: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 11 op/s 2023-05-08T14:04:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:04:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:04:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:04:00.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:00 smithi133 ceph-mon[125939]: pgmap v19882: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 11 op/s 2023-05-08T14:04:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:04:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:04:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:04:01.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:01 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:04:01.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:01 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T14:04:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:01 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T14:04:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:01 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:04:01.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:01 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:04:01.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:01 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T14:04:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:01 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T14:04:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:01 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:04:01.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:01 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:04:01.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:01 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T14:04:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:01 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T14:04:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:01 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:04:02.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:02 smithi096 ceph-mon[124666]: pgmap v19883: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 13 op/s 2023-05-08T14:04:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:02 smithi186 ceph-mon[126480]: pgmap v19883: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 13 op/s 2023-05-08T14:04:02.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:02 smithi133 ceph-mon[125939]: pgmap v19883: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 13 op/s 2023-05-08T14:04:04.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:03 smithi133 ceph-mon[125939]: pgmap v19884: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 10 op/s 2023-05-08T14:04:04.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:03 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37183.420711 secs 2023-05-08T14:04:04.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:03 smithi096 ceph-mon[124666]: pgmap v19884: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 10 op/s 2023-05-08T14:04:04.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:03 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37183.420711 secs 2023-05-08T14:04:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:03 smithi186 ceph-mon[126480]: pgmap v19884: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 10 op/s 2023-05-08T14:04:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:03 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37183.420711 secs 2023-05-08T14:04:05.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37183.975256 secs 2023-05-08T14:04:05.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:05 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:04:05.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:04:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:04:05.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37183.975256 secs 2023-05-08T14:04:05.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:05 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:04:05.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:04:05.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:04:05.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37183.975256 secs 2023-05-08T14:04:05.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:05 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:04:05.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:04:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:04:06.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:06 smithi133 ceph-mon[125939]: pgmap v19885: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.0 MiB/s wr, 30 op/s 2023-05-08T14:04:06.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:06 smithi096 ceph-mon[124666]: pgmap v19885: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.0 MiB/s wr, 30 op/s 2023-05-08T14:04:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:06 smithi186 ceph-mon[126480]: pgmap v19885: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.0 MiB/s wr, 30 op/s 2023-05-08T14:04:08.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:08 smithi133 ceph-mon[125939]: pgmap v19886: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 25 op/s 2023-05-08T14:04:08.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:08 smithi096 ceph-mon[124666]: pgmap v19886: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 25 op/s 2023-05-08T14:04:08.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:08 smithi186 ceph-mon[126480]: pgmap v19886: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 25 op/s 2023-05-08T14:04:09.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37188.420791 secs 2023-05-08T14:04:09.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37188.420791 secs 2023-05-08T14:04:09.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37188.420791 secs 2023-05-08T14:04:10.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:10 smithi133 ceph-mon[125939]: pgmap v19887: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 27 op/s 2023-05-08T14:04:10.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:10 smithi096 ceph-mon[124666]: pgmap v19887: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 27 op/s 2023-05-08T14:04:10.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:10 smithi186 ceph-mon[126480]: pgmap v19887: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 27 op/s 2023-05-08T14:04:12.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:12 smithi133 ceph-mon[125939]: pgmap v19888: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 28 op/s 2023-05-08T14:04:12.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:12 smithi133 ceph-mon[125939]: osdmap e1320: 12 total, 12 up, 12 in 2023-05-08T14:04:12.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:12 smithi096 ceph-mon[124666]: pgmap v19888: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 28 op/s 2023-05-08T14:04:12.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:12 smithi096 ceph-mon[124666]: osdmap e1320: 12 total, 12 up, 12 in 2023-05-08T14:04:12.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:12 smithi186 ceph-mon[126480]: pgmap v19888: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 28 op/s 2023-05-08T14:04:12.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:12 smithi186 ceph-mon[126480]: osdmap e1320: 12 total, 12 up, 12 in 2023-05-08T14:04:14.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:13 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:04:14.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:13 smithi133 ceph-mon[125939]: pgmap v19890: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 912 KiB/s wr, 29 op/s 2023-05-08T14:04:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37193.420887 secs 2023-05-08T14:04:14.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:13 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:04:14.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:13 smithi096 ceph-mon[124666]: pgmap v19890: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 912 KiB/s wr, 29 op/s 2023-05-08T14:04:14.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37193.420887 secs 2023-05-08T14:04:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:13 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:04:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:13 smithi186 ceph-mon[126480]: pgmap v19890: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 912 KiB/s wr, 29 op/s 2023-05-08T14:04:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37193.420887 secs 2023-05-08T14:04:15.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:14 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:04:15.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:14 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:04:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:14 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:04:15.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:14 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:04:15.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:14 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:04:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:14 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:04:15.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:14 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:04:15.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:14 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:04:15.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:14 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:04:16.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:15 smithi133 ceph-mon[125939]: pgmap v19891: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 907 KiB/s rd, 655 KiB/s wr, 11 op/s 2023-05-08T14:04:16.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:15 smithi096 ceph-mon[124666]: pgmap v19891: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 907 KiB/s rd, 655 KiB/s wr, 11 op/s 2023-05-08T14:04:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:15 smithi186 ceph-mon[126480]: pgmap v19891: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 907 KiB/s rd, 655 KiB/s wr, 11 op/s 2023-05-08T14:04:18.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:18 smithi133 ceph-mon[125939]: pgmap v19892: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 907 KiB/s rd, 655 KiB/s wr, 11 op/s 2023-05-08T14:04:18.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:18 smithi133 ceph-mon[125939]: osdmap e1321: 12 total, 12 up, 12 in 2023-05-08T14:04:18.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:18 smithi096 ceph-mon[124666]: pgmap v19892: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 907 KiB/s rd, 655 KiB/s wr, 11 op/s 2023-05-08T14:04:18.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:18 smithi096 ceph-mon[124666]: osdmap e1321: 12 total, 12 up, 12 in 2023-05-08T14:04:18.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:18 smithi186 ceph-mon[126480]: pgmap v19892: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 907 KiB/s rd, 655 KiB/s wr, 11 op/s 2023-05-08T14:04:18.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:18 smithi186 ceph-mon[126480]: osdmap e1321: 12 total, 12 up, 12 in 2023-05-08T14:04:19.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37198.421036 secs 2023-05-08T14:04:19.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37198.421036 secs 2023-05-08T14:04:19.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37198.421036 secs 2023-05-08T14:04:20.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:20 smithi096 ceph-mon[124666]: pgmap v19894: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 809 KiB/s rd, 703 KiB/s wr, 8 op/s 2023-05-08T14:04:20.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:20 smithi186 ceph-mon[126480]: pgmap v19894: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 809 KiB/s rd, 703 KiB/s wr, 8 op/s 2023-05-08T14:04:20.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:20 smithi133 ceph-mon[125939]: pgmap v19894: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 809 KiB/s rd, 703 KiB/s wr, 8 op/s 2023-05-08T14:04:22.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:22 smithi096 ceph-mon[124666]: pgmap v19895: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 854 KiB/s rd, 768 KiB/s wr, 10 op/s 2023-05-08T14:04:22.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:22 smithi186 ceph-mon[126480]: pgmap v19895: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 854 KiB/s rd, 768 KiB/s wr, 10 op/s 2023-05-08T14:04:22.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:22 smithi133 ceph-mon[125939]: pgmap v19895: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 854 KiB/s rd, 768 KiB/s wr, 10 op/s 2023-05-08T14:04:24.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:23 smithi133 ceph-mon[125939]: pgmap v19896: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 851 KiB/s rd, 766 KiB/s wr, 10 op/s 2023-05-08T14:04:24.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37203.421117 secs 2023-05-08T14:04:24.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:23 smithi096 ceph-mon[124666]: pgmap v19896: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 851 KiB/s rd, 766 KiB/s wr, 10 op/s 2023-05-08T14:04:24.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37203.421117 secs 2023-05-08T14:04:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:23 smithi186 ceph-mon[126480]: pgmap v19896: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 851 KiB/s rd, 766 KiB/s wr, 10 op/s 2023-05-08T14:04:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37203.421117 secs 2023-05-08T14:04:25.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37203.975712 secs 2023-05-08T14:04:25.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:25 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:04:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:25 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:04:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:25 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:04:25.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37203.975712 secs 2023-05-08T14:04:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:25 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:04:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:25 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:04:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:25 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:04:25.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37203.975712 secs 2023-05-08T14:04:25.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:25 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:04:25.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:25 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:04:25.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:25 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:04:26.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:26 smithi133 ceph-mon[125939]: pgmap v19897: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 11 op/s 2023-05-08T14:04:26.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:26 smithi096 ceph-mon[124666]: pgmap v19897: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 11 op/s 2023-05-08T14:04:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:26 smithi186 ceph-mon[126480]: pgmap v19897: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 11 op/s 2023-05-08T14:04:27.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:27 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37205.316081 secs 2023-05-08T14:04:27.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:27 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37205.316081 secs 2023-05-08T14:04:27.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:27 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37205.316081 secs 2023-05-08T14:04:28.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:28 smithi133 ceph-mon[125939]: pgmap v19898: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 11 op/s 2023-05-08T14:04:28.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:28 smithi096 ceph-mon[124666]: pgmap v19898: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 11 op/s 2023-05-08T14:04:28.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:28 smithi186 ceph-mon[126480]: pgmap v19898: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 11 op/s 2023-05-08T14:04:29.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37208.421215 secs 2023-05-08T14:04:29.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37208.421215 secs 2023-05-08T14:04:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37208.421215 secs 2023-05-08T14:04:30.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:30 smithi133 ceph-mon[125939]: pgmap v19899: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T14:04:30.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:30 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:04:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:30 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:04:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37208.975829 secs 2023-05-08T14:04:30.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:30 smithi096 ceph-mon[124666]: pgmap v19899: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T14:04:30.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:30 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:04:30.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:30 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:04:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37208.975829 secs 2023-05-08T14:04:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:30 smithi186 ceph-mon[126480]: pgmap v19899: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T14:04:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:30 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:04:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:30 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:04:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37208.975829 secs 2023-05-08T14:04:32.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:32 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37210.316220 secs 2023-05-08T14:04:32.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:32 smithi133 ceph-mon[125939]: pgmap v19900: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2023-05-08T14:04:32.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:32 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37210.316220 secs 2023-05-08T14:04:32.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:32 smithi096 ceph-mon[124666]: pgmap v19900: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2023-05-08T14:04:32.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:32 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37210.316220 secs 2023-05-08T14:04:32.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:32 smithi186 ceph-mon[126480]: pgmap v19900: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2023-05-08T14:04:33.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:33 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:04:33.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:33 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:04:33.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:33 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:04:34.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:34 smithi133 ceph-mon[125939]: pgmap v19901: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T14:04:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37213.421372 secs 2023-05-08T14:04:34.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:34 smithi096 ceph-mon[124666]: pgmap v19901: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T14:04:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37213.421372 secs 2023-05-08T14:04:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:34 smithi186 ceph-mon[126480]: pgmap v19901: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T14:04:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37213.421372 secs 2023-05-08T14:04:35.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37213.975949 secs 2023-05-08T14:04:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37213.975949 secs 2023-05-08T14:04:35.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37213.975949 secs 2023-05-08T14:04:36.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:36 smithi133 ceph-mon[125939]: pgmap v19902: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 14 op/s 2023-05-08T14:04:36.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:36 smithi096 ceph-mon[124666]: pgmap v19902: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 14 op/s 2023-05-08T14:04:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:36 smithi186 ceph-mon[126480]: pgmap v19902: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 14 op/s 2023-05-08T14:04:37.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:37 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37215.316284 secs 2023-05-08T14:04:37.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:37 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37215.316284 secs 2023-05-08T14:04:37.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:37 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37215.316284 secs 2023-05-08T14:04:38.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:38 smithi133 ceph-mon[125939]: pgmap v19903: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 355 KiB/s wr, 9 op/s 2023-05-08T14:04:38.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:38 smithi096 ceph-mon[124666]: pgmap v19903: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 355 KiB/s wr, 9 op/s 2023-05-08T14:04:38.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:38 smithi186 ceph-mon[126480]: pgmap v19903: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 355 KiB/s wr, 9 op/s 2023-05-08T14:04:39.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37218.421512 secs 2023-05-08T14:04:39.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37218.421512 secs 2023-05-08T14:04:39.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37218.421512 secs 2023-05-08T14:04:40.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:40 smithi096 ceph-mon[124666]: pgmap v19904: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 735 KiB/s rd, 571 KiB/s wr, 10 op/s 2023-05-08T14:04:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37218.976074 secs 2023-05-08T14:04:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:40 smithi186 ceph-mon[126480]: pgmap v19904: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 735 KiB/s rd, 571 KiB/s wr, 10 op/s 2023-05-08T14:04:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37218.976074 secs 2023-05-08T14:04:40.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:40 smithi133 ceph-mon[125939]: pgmap v19904: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 735 KiB/s rd, 571 KiB/s wr, 10 op/s 2023-05-08T14:04:40.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37218.976074 secs 2023-05-08T14:04:42.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:42 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37220.316403 secs 2023-05-08T14:04:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:42 smithi096 ceph-mon[124666]: pgmap v19905: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 852 KiB/s rd, 1011 KiB/s wr, 12 op/s 2023-05-08T14:04:42.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:42 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37220.316403 secs 2023-05-08T14:04:42.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:42 smithi186 ceph-mon[126480]: pgmap v19905: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 852 KiB/s rd, 1011 KiB/s wr, 12 op/s 2023-05-08T14:04:42.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:42 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37220.316403 secs 2023-05-08T14:04:42.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:42 smithi133 ceph-mon[125939]: pgmap v19905: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 852 KiB/s rd, 1011 KiB/s wr, 12 op/s 2023-05-08T14:04:44.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:43 smithi133 ceph-mon[125939]: pgmap v19906: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 1010 KiB/s wr, 8 op/s 2023-05-08T14:04:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37223.421630 secs 2023-05-08T14:04:44.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:43 smithi096 ceph-mon[124666]: pgmap v19906: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 1010 KiB/s wr, 8 op/s 2023-05-08T14:04:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37223.421630 secs 2023-05-08T14:04:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:43 smithi186 ceph-mon[126480]: pgmap v19906: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 1010 KiB/s wr, 8 op/s 2023-05-08T14:04:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37223.421630 secs 2023-05-08T14:04:45.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37223.976212 secs 2023-05-08T14:04:45.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37223.976212 secs 2023-05-08T14:04:45.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37223.976212 secs 2023-05-08T14:04:46.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:46 smithi096 ceph-mon[124666]: pgmap v19907: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T14:04:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:46 smithi186 ceph-mon[126480]: pgmap v19907: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T14:04:46.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:46 smithi133 ceph-mon[125939]: pgmap v19907: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T14:04:48.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:48 smithi096 ceph-mon[124666]: pgmap v19908: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 956 KiB/s rd, 954 KiB/s wr, 7 op/s 2023-05-08T14:04:48.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:48 smithi186 ceph-mon[126480]: pgmap v19908: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 956 KiB/s rd, 954 KiB/s wr, 7 op/s 2023-05-08T14:04:48.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:48 smithi133 ceph-mon[125939]: pgmap v19908: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 956 KiB/s rd, 954 KiB/s wr, 7 op/s 2023-05-08T14:04:49.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37228.421722 secs 2023-05-08T14:04:49.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:04:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37228.421722 secs 2023-05-08T14:04:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:04:49.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37228.421722 secs 2023-05-08T14:04:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:04:50.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:50 smithi096 ceph-mon[124666]: pgmap v19909: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 10 op/s 2023-05-08T14:04:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:04:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:04:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:04:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:50 smithi186 ceph-mon[126480]: pgmap v19909: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 10 op/s 2023-05-08T14:04:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:04:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:04:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:04:50.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:50 smithi133 ceph-mon[125939]: pgmap v19909: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 10 op/s 2023-05-08T14:04:50.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:04:50.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:04:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:04:52.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:52 smithi096 ceph-mon[124666]: pgmap v19910: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 12 op/s 2023-05-08T14:04:52.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:52 smithi186 ceph-mon[126480]: pgmap v19910: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 12 op/s 2023-05-08T14:04:52.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:52 smithi133 ceph-mon[125939]: pgmap v19910: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 12 op/s 2023-05-08T14:04:54.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:53 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:04:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:53 smithi133 ceph-mon[125939]: pgmap v19911: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.1 MiB/s wr, 9 op/s 2023-05-08T14:04:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37233.421824 secs 2023-05-08T14:04:54.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:53 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:04:54.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:53 smithi096 ceph-mon[124666]: pgmap v19911: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.1 MiB/s wr, 9 op/s 2023-05-08T14:04:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37233.421824 secs 2023-05-08T14:04:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:53 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:04:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:53 smithi186 ceph-mon[126480]: pgmap v19911: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.1 MiB/s wr, 9 op/s 2023-05-08T14:04:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37233.421824 secs 2023-05-08T14:04:55.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:54 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:04:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:54 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:04:55.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:54 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:04:55.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:54 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:04:55.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:54 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:04:55.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:54 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:04:56.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:55 smithi133 ceph-mon[125939]: pgmap v19912: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 14 op/s 2023-05-08T14:04:56.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:55 smithi096 ceph-mon[124666]: pgmap v19912: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 14 op/s 2023-05-08T14:04:56.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:55 smithi186 ceph-mon[126480]: pgmap v19912: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 14 op/s 2023-05-08T14:04:58.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:58 smithi096 ceph-mon[124666]: pgmap v19913: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 10 op/s 2023-05-08T14:04:58.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:58 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:04:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:58 smithi186 ceph-mon[126480]: pgmap v19913: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 10 op/s 2023-05-08T14:04:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:58 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:04:58.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:58 smithi133 ceph-mon[125939]: pgmap v19913: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 10 op/s 2023-05-08T14:04:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:58 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:04:59.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:04:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37238.421961 secs 2023-05-08T14:04:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:04:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37238.421961 secs 2023-05-08T14:04:59.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:04:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37238.421961 secs 2023-05-08T14:05:00.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:00 smithi096 ceph-mon[124666]: pgmap v19914: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 11 op/s 2023-05-08T14:05:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37238.976465 secs 2023-05-08T14:05:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:05:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:00 smithi186 ceph-mon[126480]: pgmap v19914: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 11 op/s 2023-05-08T14:05:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37238.976465 secs 2023-05-08T14:05:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:05:00.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:00 smithi133 ceph-mon[125939]: pgmap v19914: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 11 op/s 2023-05-08T14:05:00.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37238.976465 secs 2023-05-08T14:05:00.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:05:01.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:01 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:05:01.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:01 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:05:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:01 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:05:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:01 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:05:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:01 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T14:05:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:01 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T14:05:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:01 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:05:01.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:01 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:05:01.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:01 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:05:01.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:01 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:05:01.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:01 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:05:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:01 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T14:05:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:01 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T14:05:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:01 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:05:01.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:01 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:05:01.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:01 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:05:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:01 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:05:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:01 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:05:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:01 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T14:05:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:01 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T14:05:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:01 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:05:02.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:02 smithi133 ceph-mon[125939]: pgmap v19915: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 873 KiB/s wr, 12 op/s 2023-05-08T14:05:02.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:05:02.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:05:02.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:02 smithi096 ceph-mon[124666]: pgmap v19915: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 873 KiB/s wr, 12 op/s 2023-05-08T14:05:02.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:05:02.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:05:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:02 smithi186 ceph-mon[126480]: pgmap v19915: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 873 KiB/s wr, 12 op/s 2023-05-08T14:05:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:05:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:05:03.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:03 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:05:03.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:03 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:05:03.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:03 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:05:04.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:04 smithi133 ceph-mon[125939]: pgmap v19916: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 873 KiB/s wr, 10 op/s 2023-05-08T14:05:04.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37243.422061 secs 2023-05-08T14:05:04.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:04 smithi096 ceph-mon[124666]: pgmap v19916: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 873 KiB/s wr, 10 op/s 2023-05-08T14:05:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37243.422061 secs 2023-05-08T14:05:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:04 smithi186 ceph-mon[126480]: pgmap v19916: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 873 KiB/s wr, 10 op/s 2023-05-08T14:05:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37243.422061 secs 2023-05-08T14:05:05.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37243.976595 secs 2023-05-08T14:05:05.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37243.976595 secs 2023-05-08T14:05:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37243.976595 secs 2023-05-08T14:05:06.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:06 smithi133 ceph-mon[125939]: pgmap v19917: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.3 MiB/s wr, 16 op/s 2023-05-08T14:05:06.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:06 smithi096 ceph-mon[124666]: pgmap v19917: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.3 MiB/s wr, 16 op/s 2023-05-08T14:05:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:06 smithi186 ceph-mon[126480]: pgmap v19917: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.3 MiB/s wr, 16 op/s 2023-05-08T14:05:08.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:08 smithi133 ceph-mon[125939]: pgmap v19918: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 546 KiB/s wr, 11 op/s 2023-05-08T14:05:08.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:08 smithi096 ceph-mon[124666]: pgmap v19918: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 546 KiB/s wr, 11 op/s 2023-05-08T14:05:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:08 smithi186 ceph-mon[126480]: pgmap v19918: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 546 KiB/s wr, 11 op/s 2023-05-08T14:05:09.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37248.422149 secs 2023-05-08T14:05:09.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37248.422149 secs 2023-05-08T14:05:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37248.422149 secs 2023-05-08T14:05:10.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:10 smithi133 ceph-mon[125939]: pgmap v19919: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.2 MiB/s wr, 15 op/s 2023-05-08T14:05:10.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:10 smithi096 ceph-mon[124666]: pgmap v19919: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.2 MiB/s wr, 15 op/s 2023-05-08T14:05:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:10 smithi186 ceph-mon[126480]: pgmap v19919: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.2 MiB/s wr, 15 op/s 2023-05-08T14:05:12.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:12 smithi133 ceph-mon[125939]: pgmap v19920: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.5 MiB/s wr, 27 op/s 2023-05-08T14:05:12.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:12 smithi096 ceph-mon[124666]: pgmap v19920: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.5 MiB/s wr, 27 op/s 2023-05-08T14:05:12.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:12 smithi186 ceph-mon[126480]: pgmap v19920: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.5 MiB/s wr, 27 op/s 2023-05-08T14:05:14.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:13 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:05:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:13 smithi133 ceph-mon[125939]: pgmap v19921: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 23 op/s 2023-05-08T14:05:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37253.422278 secs 2023-05-08T14:05:14.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:13 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:05:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:13 smithi096 ceph-mon[124666]: pgmap v19921: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 23 op/s 2023-05-08T14:05:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37253.422278 secs 2023-05-08T14:05:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:13 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:05:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:13 smithi186 ceph-mon[126480]: pgmap v19921: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 23 op/s 2023-05-08T14:05:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37253.422278 secs 2023-05-08T14:05:15.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:14 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:05:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:14 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:05:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:14 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:05:15.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:14 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:05:15.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:14 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:05:15.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:14 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:05:15.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:14 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:05:15.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:14 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:05:15.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:14 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:05:16.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:15 smithi133 ceph-mon[125939]: pgmap v19922: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 27 op/s 2023-05-08T14:05:16.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:15 smithi096 ceph-mon[124666]: pgmap v19922: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 27 op/s 2023-05-08T14:05:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:15 smithi186 ceph-mon[126480]: pgmap v19922: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 27 op/s 2023-05-08T14:05:18.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:18 smithi096 ceph-mon[124666]: pgmap v19923: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 20 op/s 2023-05-08T14:05:18.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:18 smithi186 ceph-mon[126480]: pgmap v19923: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 20 op/s 2023-05-08T14:05:18.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:18 smithi133 ceph-mon[125939]: pgmap v19923: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 20 op/s 2023-05-08T14:05:19.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37258.422398 secs 2023-05-08T14:05:19.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37258.422398 secs 2023-05-08T14:05:19.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37258.422398 secs 2023-05-08T14:05:20.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:20 smithi186 ceph-mon[126480]: pgmap v19924: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 23 op/s 2023-05-08T14:05:20.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:20 smithi133 ceph-mon[125939]: pgmap v19924: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 23 op/s 2023-05-08T14:05:20.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:20 smithi096 ceph-mon[124666]: pgmap v19924: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 23 op/s 2023-05-08T14:05:22.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:22 smithi186 ceph-mon[126480]: pgmap v19925: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 643 KiB/s rd, 645 KiB/s wr, 20 op/s 2023-05-08T14:05:22.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:22 smithi133 ceph-mon[125939]: pgmap v19925: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 643 KiB/s rd, 645 KiB/s wr, 20 op/s 2023-05-08T14:05:22.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:22 smithi096 ceph-mon[124666]: pgmap v19925: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 643 KiB/s rd, 645 KiB/s wr, 20 op/s 2023-05-08T14:05:24.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:23 smithi133 ceph-mon[125939]: pgmap v19926: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 381 KiB/s wr, 7 op/s 2023-05-08T14:05:24.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37263.422543 secs 2023-05-08T14:05:24.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:23 smithi096 ceph-mon[124666]: pgmap v19926: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 381 KiB/s wr, 7 op/s 2023-05-08T14:05:24.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37263.422543 secs 2023-05-08T14:05:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:23 smithi186 ceph-mon[126480]: pgmap v19926: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 381 KiB/s wr, 7 op/s 2023-05-08T14:05:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37263.422543 secs 2023-05-08T14:05:25.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37263.977095 secs 2023-05-08T14:05:25.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:25 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:05:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:25 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:05:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:25 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:05:25.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37263.977095 secs 2023-05-08T14:05:25.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:25 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:05:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:25 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:05:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:25 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:05:25.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37263.977095 secs 2023-05-08T14:05:25.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:25 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:05:25.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:25 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:05:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:25 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:05:26.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:26 smithi133 ceph-mon[125939]: pgmap v19927: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 746 KiB/s rd, 765 KiB/s wr, 14 op/s 2023-05-08T14:05:26.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:26 smithi096 ceph-mon[124666]: pgmap v19927: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 746 KiB/s rd, 765 KiB/s wr, 14 op/s 2023-05-08T14:05:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:26 smithi186 ceph-mon[126480]: pgmap v19927: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 746 KiB/s rd, 765 KiB/s wr, 14 op/s 2023-05-08T14:05:27.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:27 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37265.317450 secs 2023-05-08T14:05:27.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:27 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37265.317450 secs 2023-05-08T14:05:27.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:27 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37265.317450 secs 2023-05-08T14:05:28.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:28 smithi133 ceph-mon[125939]: pgmap v19928: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 717 KiB/s rd, 737 KiB/s wr, 10 op/s 2023-05-08T14:05:28.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:28 smithi096 ceph-mon[124666]: pgmap v19928: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 717 KiB/s rd, 737 KiB/s wr, 10 op/s 2023-05-08T14:05:28.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:28 smithi186 ceph-mon[126480]: pgmap v19928: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 717 KiB/s rd, 737 KiB/s wr, 10 op/s 2023-05-08T14:05:29.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37268.422605 secs 2023-05-08T14:05:29.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37268.422605 secs 2023-05-08T14:05:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37268.422605 secs 2023-05-08T14:05:30.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:30 smithi133 ceph-mon[125939]: pgmap v19929: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T14:05:30.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:30 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:05:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:30 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:05:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37268.977214 secs 2023-05-08T14:05:30.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:30 smithi096 ceph-mon[124666]: pgmap v19929: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T14:05:30.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:30 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:05:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:30 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:05:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37268.977214 secs 2023-05-08T14:05:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:30 smithi186 ceph-mon[126480]: pgmap v19929: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T14:05:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:30 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:05:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:30 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:05:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37268.977214 secs 2023-05-08T14:05:32.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:32 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37270.317566 secs 2023-05-08T14:05:32.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:32 smithi133 ceph-mon[125939]: pgmap v19930: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 12 op/s 2023-05-08T14:05:32.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:32 smithi133 ceph-mon[125939]: osdmap e1322: 12 total, 12 up, 12 in 2023-05-08T14:05:32.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:32 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37270.317566 secs 2023-05-08T14:05:32.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:32 smithi096 ceph-mon[124666]: pgmap v19930: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 12 op/s 2023-05-08T14:05:32.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:32 smithi096 ceph-mon[124666]: osdmap e1322: 12 total, 12 up, 12 in 2023-05-08T14:05:32.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:32 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37270.317566 secs 2023-05-08T14:05:32.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:32 smithi186 ceph-mon[126480]: pgmap v19930: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 12 op/s 2023-05-08T14:05:32.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:32 smithi186 ceph-mon[126480]: osdmap e1322: 12 total, 12 up, 12 in 2023-05-08T14:05:33.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:33 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:05:33.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:33 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:05:33.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:33 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:05:34.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:34 smithi133 ceph-mon[125939]: pgmap v19932: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T14:05:34.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37273.422725 secs 2023-05-08T14:05:34.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:34 smithi096 ceph-mon[124666]: pgmap v19932: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T14:05:34.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37273.422725 secs 2023-05-08T14:05:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:34 smithi186 ceph-mon[126480]: pgmap v19932: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T14:05:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37273.422725 secs 2023-05-08T14:05:35.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37273.977335 secs 2023-05-08T14:05:35.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37273.977335 secs 2023-05-08T14:05:35.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37273.977335 secs 2023-05-08T14:05:36.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:36 smithi133 ceph-mon[125939]: pgmap v19933: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 12 op/s 2023-05-08T14:05:36.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:36 smithi096 ceph-mon[124666]: pgmap v19933: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 12 op/s 2023-05-08T14:05:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:36 smithi186 ceph-mon[126480]: pgmap v19933: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 12 op/s 2023-05-08T14:05:37.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:37 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37275.317691 secs 2023-05-08T14:05:37.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:37 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37275.317691 secs 2023-05-08T14:05:37.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:37 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37275.317691 secs 2023-05-08T14:05:38.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:38 smithi096 ceph-mon[124666]: pgmap v19934: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T14:05:38.538 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:38 smithi096 ceph-mon[124666]: osdmap e1323: 12 total, 12 up, 12 in 2023-05-08T14:05:38.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:38 smithi186 ceph-mon[126480]: pgmap v19934: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T14:05:38.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:38 smithi186 ceph-mon[126480]: osdmap e1323: 12 total, 12 up, 12 in 2023-05-08T14:05:38.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:38 smithi133 ceph-mon[125939]: pgmap v19934: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T14:05:38.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:38 smithi133 ceph-mon[125939]: osdmap e1323: 12 total, 12 up, 12 in 2023-05-08T14:05:39.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37278.422861 secs 2023-05-08T14:05:39.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37278.422861 secs 2023-05-08T14:05:39.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37278.422861 secs 2023-05-08T14:05:40.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:40 smithi096 ceph-mon[124666]: pgmap v19936: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 11 op/s 2023-05-08T14:05:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37278.977402 secs 2023-05-08T14:05:40.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:40 smithi186 ceph-mon[126480]: pgmap v19936: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 11 op/s 2023-05-08T14:05:40.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37278.977402 secs 2023-05-08T14:05:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:40 smithi133 ceph-mon[125939]: pgmap v19936: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 11 op/s 2023-05-08T14:05:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37278.977402 secs 2023-05-08T14:05:42.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:42 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37280.317811 secs 2023-05-08T14:05:42.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:42 smithi096 ceph-mon[124666]: pgmap v19937: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 10 op/s 2023-05-08T14:05:42.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:42 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37280.317811 secs 2023-05-08T14:05:42.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:42 smithi186 ceph-mon[126480]: pgmap v19937: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 10 op/s 2023-05-08T14:05:42.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:42 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37280.317811 secs 2023-05-08T14:05:42.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:42 smithi133 ceph-mon[125939]: pgmap v19937: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 10 op/s 2023-05-08T14:05:44.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:43 smithi133 ceph-mon[125939]: pgmap v19938: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 10 op/s 2023-05-08T14:05:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37283.422989 secs 2023-05-08T14:05:44.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:43 smithi096 ceph-mon[124666]: pgmap v19938: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 10 op/s 2023-05-08T14:05:44.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37283.422989 secs 2023-05-08T14:05:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:43 smithi186 ceph-mon[126480]: pgmap v19938: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 10 op/s 2023-05-08T14:05:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37283.422989 secs 2023-05-08T14:05:45.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37283.977518 secs 2023-05-08T14:05:45.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37283.977518 secs 2023-05-08T14:05:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37283.977518 secs 2023-05-08T14:05:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:46 smithi186 ceph-mon[126480]: pgmap v19939: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 756 KiB/s rd, 753 KiB/s wr, 8 op/s 2023-05-08T14:05:46.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:46 smithi133 ceph-mon[125939]: pgmap v19939: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 756 KiB/s rd, 753 KiB/s wr, 8 op/s 2023-05-08T14:05:46.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:46 smithi096 ceph-mon[124666]: pgmap v19939: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 756 KiB/s rd, 753 KiB/s wr, 8 op/s 2023-05-08T14:05:48.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:48 smithi186 ceph-mon[126480]: pgmap v19940: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 756 KiB/s rd, 753 KiB/s wr, 8 op/s 2023-05-08T14:05:48.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:48 smithi133 ceph-mon[125939]: pgmap v19940: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 756 KiB/s rd, 753 KiB/s wr, 8 op/s 2023-05-08T14:05:48.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:48 smithi096 ceph-mon[124666]: pgmap v19940: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 756 KiB/s rd, 753 KiB/s wr, 8 op/s 2023-05-08T14:05:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37288.423124 secs 2023-05-08T14:05:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:05:49.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37288.423124 secs 2023-05-08T14:05:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:05:49.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37288.423124 secs 2023-05-08T14:05:49.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:05:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:50 smithi186 ceph-mon[126480]: pgmap v19941: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 11 op/s 2023-05-08T14:05:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:05:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:05:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:05:50.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:50 smithi133 ceph-mon[125939]: pgmap v19941: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 11 op/s 2023-05-08T14:05:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:05:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:05:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:05:50.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:50 smithi096 ceph-mon[124666]: pgmap v19941: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 11 op/s 2023-05-08T14:05:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:05:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:05:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:05:52.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:52 smithi186 ceph-mon[126480]: pgmap v19942: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1024 KiB/s rd, 863 KiB/s wr, 8 op/s 2023-05-08T14:05:52.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:52 smithi133 ceph-mon[125939]: pgmap v19942: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1024 KiB/s rd, 863 KiB/s wr, 8 op/s 2023-05-08T14:05:52.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:52 smithi096 ceph-mon[124666]: pgmap v19942: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1024 KiB/s rd, 863 KiB/s wr, 8 op/s 2023-05-08T14:05:54.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:53 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:05:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:53 smithi133 ceph-mon[125939]: pgmap v19943: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 KiB/s rd, 863 KiB/s wr, 7 op/s 2023-05-08T14:05:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37293.423246 secs 2023-05-08T14:05:54.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:53 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:05:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:53 smithi096 ceph-mon[124666]: pgmap v19943: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 KiB/s rd, 863 KiB/s wr, 7 op/s 2023-05-08T14:05:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37293.423246 secs 2023-05-08T14:05:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:53 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:05:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:53 smithi186 ceph-mon[126480]: pgmap v19943: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 KiB/s rd, 863 KiB/s wr, 7 op/s 2023-05-08T14:05:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37293.423246 secs 2023-05-08T14:05:55.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:54 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:05:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:54 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:05:55.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:54 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:05:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:54 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:05:55.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:54 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:05:55.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:54 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:05:56.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:55 smithi133 ceph-mon[125939]: pgmap v19944: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 14 op/s 2023-05-08T14:05:56.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:55 smithi096 ceph-mon[124666]: pgmap v19944: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 14 op/s 2023-05-08T14:05:56.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:55 smithi186 ceph-mon[126480]: pgmap v19944: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 14 op/s 2023-05-08T14:05:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:58 smithi186 ceph-mon[126480]: pgmap v19945: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 11 op/s 2023-05-08T14:05:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:58 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:05:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:58 smithi133 ceph-mon[125939]: pgmap v19945: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 11 op/s 2023-05-08T14:05:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:58 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:05:58.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:58 smithi096 ceph-mon[124666]: pgmap v19945: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 11 op/s 2023-05-08T14:05:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:58 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:05:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:05:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37298.423389 secs 2023-05-08T14:05:59.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:05:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37298.423389 secs 2023-05-08T14:05:59.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:05:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37298.423389 secs 2023-05-08T14:06:00.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:00 smithi186 ceph-mon[126480]: pgmap v19946: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.7 MiB/s wr, 15 op/s 2023-05-08T14:06:00.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37298.977851 secs 2023-05-08T14:06:00.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:00 smithi133 ceph-mon[125939]: pgmap v19946: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.7 MiB/s wr, 15 op/s 2023-05-08T14:06:00.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37298.977851 secs 2023-05-08T14:06:00.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:00 smithi096 ceph-mon[124666]: pgmap v19946: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.7 MiB/s wr, 15 op/s 2023-05-08T14:06:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37298.977851 secs 2023-05-08T14:06:01.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:01 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:06:01.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:01 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:06:01.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:01 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:06:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:02 smithi186 ceph-mon[126480]: pgmap v19947: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T14:06:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:06:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:06:02.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:02 smithi133 ceph-mon[125939]: pgmap v19947: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T14:06:02.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:06:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:06:02.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:02 smithi096 ceph-mon[124666]: pgmap v19947: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T14:06:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:06:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:06:03.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:03 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:06:03.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:03 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:06:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:03 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:06:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:04 smithi186 ceph-mon[126480]: pgmap v19948: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 904 KiB/s wr, 12 op/s 2023-05-08T14:06:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37303.423481 secs 2023-05-08T14:06:04.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:04 smithi133 ceph-mon[125939]: pgmap v19948: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 904 KiB/s wr, 12 op/s 2023-05-08T14:06:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37303.423481 secs 2023-05-08T14:06:04.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:04 smithi096 ceph-mon[124666]: pgmap v19948: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 904 KiB/s wr, 12 op/s 2023-05-08T14:06:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37303.423481 secs 2023-05-08T14:06:05.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37303.977997 secs 2023-05-08T14:06:05.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37303.977997 secs 2023-05-08T14:06:05.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37303.977997 secs 2023-05-08T14:06:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:06 smithi186 ceph-mon[126480]: pgmap v19949: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.3 MiB/s wr, 29 op/s 2023-05-08T14:06:06.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:06 smithi133 ceph-mon[125939]: pgmap v19949: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.3 MiB/s wr, 29 op/s 2023-05-08T14:06:06.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:06 smithi096 ceph-mon[124666]: pgmap v19949: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.3 MiB/s wr, 29 op/s 2023-05-08T14:06:08.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:08 smithi186 ceph-mon[126480]: pgmap v19950: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 927 KiB/s rd, 577 KiB/s wr, 22 op/s 2023-05-08T14:06:08.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:08 smithi133 ceph-mon[125939]: pgmap v19950: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 927 KiB/s rd, 577 KiB/s wr, 22 op/s 2023-05-08T14:06:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:08 smithi096 ceph-mon[124666]: pgmap v19950: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 927 KiB/s rd, 577 KiB/s wr, 22 op/s 2023-05-08T14:06:09.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37308.423569 secs 2023-05-08T14:06:09.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37308.423569 secs 2023-05-08T14:06:09.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37308.423569 secs 2023-05-08T14:06:10.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:10 smithi186 ceph-mon[126480]: pgmap v19951: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 778 KiB/s wr, 25 op/s 2023-05-08T14:06:10.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37308.978114 secs 2023-05-08T14:06:10.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:10 smithi133 ceph-mon[125939]: pgmap v19951: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 778 KiB/s wr, 25 op/s 2023-05-08T14:06:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37308.978114 secs 2023-05-08T14:06:10.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:10 smithi096 ceph-mon[124666]: pgmap v19951: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 778 KiB/s wr, 25 op/s 2023-05-08T14:06:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37308.978114 secs 2023-05-08T14:06:12.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:12 smithi186 ceph-mon[126480]: pgmap v19952: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 830 KiB/s rd, 698 KiB/s wr, 22 op/s 2023-05-08T14:06:12.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:12 smithi133 ceph-mon[125939]: pgmap v19952: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 830 KiB/s rd, 698 KiB/s wr, 22 op/s 2023-05-08T14:06:12.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:12 smithi096 ceph-mon[124666]: pgmap v19952: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 830 KiB/s rd, 698 KiB/s wr, 22 op/s 2023-05-08T14:06:14.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:13 smithi133 ceph-mon[125939]: pgmap v19953: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 801 KiB/s rd, 669 KiB/s wr, 21 op/s 2023-05-08T14:06:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37313.423672 secs 2023-05-08T14:06:14.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:13 smithi096 ceph-mon[124666]: pgmap v19953: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 801 KiB/s rd, 669 KiB/s wr, 21 op/s 2023-05-08T14:06:14.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37313.423672 secs 2023-05-08T14:06:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:13 smithi186 ceph-mon[126480]: pgmap v19953: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 801 KiB/s rd, 669 KiB/s wr, 21 op/s 2023-05-08T14:06:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37313.423672 secs 2023-05-08T14:06:15.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37313.978204 secs 2023-05-08T14:06:15.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37313.978204 secs 2023-05-08T14:06:15.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37313.978204 secs 2023-05-08T14:06:16.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:16 smithi186 ceph-mon[126480]: pgmap v19954: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 959 KiB/s rd, 825 KiB/s wr, 24 op/s 2023-05-08T14:06:16.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:16 smithi133 ceph-mon[125939]: pgmap v19954: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 959 KiB/s rd, 825 KiB/s wr, 24 op/s 2023-05-08T14:06:16.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:16 smithi096 ceph-mon[124666]: pgmap v19954: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 959 KiB/s rd, 825 KiB/s wr, 24 op/s 2023-05-08T14:06:18.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:18 smithi186 ceph-mon[126480]: pgmap v19955: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 358 KiB/s wr, 7 op/s 2023-05-08T14:06:18.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:18 smithi133 ceph-mon[125939]: pgmap v19955: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 358 KiB/s wr, 7 op/s 2023-05-08T14:06:18.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:18 smithi096 ceph-mon[124666]: pgmap v19955: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 358 KiB/s wr, 7 op/s 2023-05-08T14:06:19.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37318.423796 secs 2023-05-08T14:06:19.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37318.423796 secs 2023-05-08T14:06:19.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37318.423796 secs 2023-05-08T14:06:20.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:20 smithi186 ceph-mon[126480]: pgmap v19956: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 359 KiB/s wr, 10 op/s 2023-05-08T14:06:20.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37318.978301 secs 2023-05-08T14:06:20.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:20 smithi133 ceph-mon[125939]: pgmap v19956: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 359 KiB/s wr, 10 op/s 2023-05-08T14:06:20.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37318.978301 secs 2023-05-08T14:06:20.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:20 smithi096 ceph-mon[124666]: pgmap v19956: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 359 KiB/s wr, 10 op/s 2023-05-08T14:06:20.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37318.978301 secs 2023-05-08T14:06:21.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:06:21.758 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:06:21.758 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:06:21.759 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:06:21.759 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:06:21.759 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:06:21.759 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:06:21.760 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:06:21.760 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:06:22.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:22 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:06:22.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:22 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T14:06:22.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:22 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T14:06:22.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:22 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:06:22.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:22 smithi186 ceph-mon[126480]: pgmap v19957: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 157 KiB/s wr, 8 op/s 2023-05-08T14:06:22.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:22 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:06:22.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:22 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T14:06:22.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:22 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T14:06:22.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:22 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:06:22.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:22 smithi133 ceph-mon[125939]: pgmap v19957: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 157 KiB/s wr, 8 op/s 2023-05-08T14:06:22.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:22 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:06:22.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:22 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T14:06:22.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:22 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T14:06:22.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:22 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:06:22.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:22 smithi096 ceph-mon[124666]: pgmap v19957: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 157 KiB/s wr, 8 op/s 2023-05-08T14:06:24.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:23 smithi133 ceph-mon[125939]: pgmap v19958: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 157 KiB/s wr, 7 op/s 2023-05-08T14:06:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37323.423915 secs 2023-05-08T14:06:24.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:23 smithi096 ceph-mon[124666]: pgmap v19958: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 157 KiB/s wr, 7 op/s 2023-05-08T14:06:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37323.423915 secs 2023-05-08T14:06:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:23 smithi186 ceph-mon[126480]: pgmap v19958: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 157 KiB/s wr, 7 op/s 2023-05-08T14:06:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37323.423915 secs 2023-05-08T14:06:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:25 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:06:25.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:25 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:06:25.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:25 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:06:26.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:26 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:06:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:26 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:06:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:26 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:06:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:26 smithi133 ceph-mon[125939]: pgmap v19959: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 431 KiB/s wr, 14 op/s 2023-05-08T14:06:26.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:26 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:06:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:26 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:06:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:26 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:06:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:26 smithi096 ceph-mon[124666]: pgmap v19959: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 431 KiB/s wr, 14 op/s 2023-05-08T14:06:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:26 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:06:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:26 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:06:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:26 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:06:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:26 smithi186 ceph-mon[126480]: pgmap v19959: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 431 KiB/s wr, 14 op/s 2023-05-08T14:06:28.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:28 smithi186 ceph-mon[126480]: pgmap v19960: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 574 KiB/s rd, 593 KiB/s wr, 11 op/s 2023-05-08T14:06:28.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:28 smithi133 ceph-mon[125939]: pgmap v19960: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 574 KiB/s rd, 593 KiB/s wr, 11 op/s 2023-05-08T14:06:28.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:28 smithi096 ceph-mon[124666]: pgmap v19960: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 574 KiB/s rd, 593 KiB/s wr, 11 op/s 2023-05-08T14:06:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37328.424062 secs 2023-05-08T14:06:29.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37328.424062 secs 2023-05-08T14:06:29.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37328.424062 secs 2023-05-08T14:06:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:30 smithi186 ceph-mon[126480]: pgmap v19961: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 602 KiB/s rd, 620 KiB/s wr, 14 op/s 2023-05-08T14:06:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:30 smithi133 ceph-mon[125939]: pgmap v19961: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 602 KiB/s rd, 620 KiB/s wr, 14 op/s 2023-05-08T14:06:30.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:30 smithi096 ceph-mon[124666]: pgmap v19961: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 602 KiB/s rd, 620 KiB/s wr, 14 op/s 2023-05-08T14:06:32.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:32 smithi186 ceph-mon[126480]: pgmap v19962: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 604 KiB/s rd, 624 KiB/s wr, 11 op/s 2023-05-08T14:06:32.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:32 smithi186 ceph-mon[126480]: osdmap e1324: 12 total, 12 up, 12 in 2023-05-08T14:06:32.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:32 smithi133 ceph-mon[125939]: pgmap v19962: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 604 KiB/s rd, 624 KiB/s wr, 11 op/s 2023-05-08T14:06:32.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:32 smithi133 ceph-mon[125939]: osdmap e1324: 12 total, 12 up, 12 in 2023-05-08T14:06:32.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:32 smithi096 ceph-mon[124666]: pgmap v19962: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 604 KiB/s rd, 624 KiB/s wr, 11 op/s 2023-05-08T14:06:32.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:32 smithi096 ceph-mon[124666]: osdmap e1324: 12 total, 12 up, 12 in 2023-05-08T14:06:34.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:33 smithi133 ceph-mon[125939]: pgmap v19964: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 725 KiB/s rd, 749 KiB/s wr, 13 op/s 2023-05-08T14:06:34.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37333.424207 secs 2023-05-08T14:06:34.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:33 smithi096 ceph-mon[124666]: pgmap v19964: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 725 KiB/s rd, 749 KiB/s wr, 13 op/s 2023-05-08T14:06:34.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37333.424207 secs 2023-05-08T14:06:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:33 smithi186 ceph-mon[126480]: pgmap v19964: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 725 KiB/s rd, 749 KiB/s wr, 13 op/s 2023-05-08T14:06:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37333.424207 secs 2023-05-08T14:06:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:36 smithi186 ceph-mon[126480]: pgmap v19965: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 825 KiB/s rd, 824 KiB/s wr, 9 op/s 2023-05-08T14:06:36.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:36 smithi133 ceph-mon[125939]: pgmap v19965: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 825 KiB/s rd, 824 KiB/s wr, 9 op/s 2023-05-08T14:06:36.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:36 smithi096 ceph-mon[124666]: pgmap v19965: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 825 KiB/s rd, 824 KiB/s wr, 9 op/s 2023-05-08T14:06:38.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:38 smithi186 ceph-mon[126480]: pgmap v19966: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 467 KiB/s rd, 465 KiB/s wr, 9 op/s 2023-05-08T14:06:38.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:38 smithi186 ceph-mon[126480]: osdmap e1325: 12 total, 12 up, 12 in 2023-05-08T14:06:38.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:38 smithi133 ceph-mon[125939]: pgmap v19966: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 467 KiB/s rd, 465 KiB/s wr, 9 op/s 2023-05-08T14:06:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:38 smithi133 ceph-mon[125939]: osdmap e1325: 12 total, 12 up, 12 in 2023-05-08T14:06:38.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:38 smithi096 ceph-mon[124666]: pgmap v19966: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 467 KiB/s rd, 465 KiB/s wr, 9 op/s 2023-05-08T14:06:38.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:38 smithi096 ceph-mon[124666]: osdmap e1325: 12 total, 12 up, 12 in 2023-05-08T14:06:39.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37338.424376 secs 2023-05-08T14:06:39.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37338.424376 secs 2023-05-08T14:06:39.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37338.424376 secs 2023-05-08T14:06:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:40 smithi186 ceph-mon[126480]: pgmap v19968: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 12 op/s 2023-05-08T14:06:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37338.978774 secs 2023-05-08T14:06:40.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:40 smithi133 ceph-mon[125939]: pgmap v19968: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 12 op/s 2023-05-08T14:06:40.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37338.978774 secs 2023-05-08T14:06:40.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:40 smithi096 ceph-mon[124666]: pgmap v19968: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 12 op/s 2023-05-08T14:06:40.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37338.978774 secs 2023-05-08T14:06:41.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:41 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:06:41.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:41 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:06:41.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:41 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:06:41.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:41 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:06:41.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:41 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:06:41.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:41 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:06:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:41 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:06:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:41 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:06:41.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:41 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:06:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:41 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:06:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:41 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:06:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:41 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:06:42.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:42 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37340.319213 secs 2023-05-08T14:06:42.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:42 smithi186 ceph-mon[126480]: pgmap v19969: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 10 op/s 2023-05-08T14:06:42.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:42 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37340.319213 secs 2023-05-08T14:06:42.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:42 smithi133 ceph-mon[125939]: pgmap v19969: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 10 op/s 2023-05-08T14:06:42.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:42 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37340.319213 secs 2023-05-08T14:06:42.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:42 smithi096 ceph-mon[124666]: pgmap v19969: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 10 op/s 2023-05-08T14:06:44.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:43 smithi133 ceph-mon[125939]: pgmap v19970: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 10 op/s 2023-05-08T14:06:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37343.424442 secs 2023-05-08T14:06:44.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:43 smithi096 ceph-mon[124666]: pgmap v19970: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 10 op/s 2023-05-08T14:06:44.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37343.424442 secs 2023-05-08T14:06:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:43 smithi186 ceph-mon[126480]: pgmap v19970: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 10 op/s 2023-05-08T14:06:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37343.424442 secs 2023-05-08T14:06:45.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37343.978886 secs 2023-05-08T14:06:45.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37343.978886 secs 2023-05-08T14:06:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37343.978886 secs 2023-05-08T14:06:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:46 smithi186 ceph-mon[126480]: pgmap v19971: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T14:06:46.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:46 smithi133 ceph-mon[125939]: pgmap v19971: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T14:06:46.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:46 smithi096 ceph-mon[124666]: pgmap v19971: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T14:06:48.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:48 smithi186 ceph-mon[126480]: pgmap v19972: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 KiB/s rd, 1022 KiB/s wr, 10 op/s 2023-05-08T14:06:48.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:48 smithi133 ceph-mon[125939]: pgmap v19972: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 KiB/s rd, 1022 KiB/s wr, 10 op/s 2023-05-08T14:06:48.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:48 smithi096 ceph-mon[124666]: pgmap v19972: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 KiB/s rd, 1022 KiB/s wr, 10 op/s 2023-05-08T14:06:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37348.424574 secs 2023-05-08T14:06:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:06:49.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37348.424574 secs 2023-05-08T14:06:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:06:49.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37348.424574 secs 2023-05-08T14:06:49.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:06:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:50 smithi186 ceph-mon[126480]: pgmap v19973: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 13 op/s 2023-05-08T14:06:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37348.978980 secs 2023-05-08T14:06:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:06:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:06:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:06:50.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:50 smithi133 ceph-mon[125939]: pgmap v19973: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 13 op/s 2023-05-08T14:06:50.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37348.978980 secs 2023-05-08T14:06:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:06:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:06:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:06:50.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:50 smithi096 ceph-mon[124666]: pgmap v19973: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 13 op/s 2023-05-08T14:06:50.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37348.978980 secs 2023-05-08T14:06:50.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:06:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:06:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:06:52.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:52 smithi186 ceph-mon[126480]: pgmap v19974: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 643 KiB/s rd, 573 KiB/s wr, 9 op/s 2023-05-08T14:06:52.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:52 smithi133 ceph-mon[125939]: pgmap v19974: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 643 KiB/s rd, 573 KiB/s wr, 9 op/s 2023-05-08T14:06:52.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:52 smithi096 ceph-mon[124666]: pgmap v19974: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 643 KiB/s rd, 573 KiB/s wr, 9 op/s 2023-05-08T14:06:54.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:53 smithi133 ceph-mon[125939]: pgmap v19975: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 643 KiB/s rd, 548 KiB/s wr, 8 op/s 2023-05-08T14:06:54.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:53 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37353.424695 secs 2023-05-08T14:06:54.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:53 smithi096 ceph-mon[124666]: pgmap v19975: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 643 KiB/s rd, 548 KiB/s wr, 8 op/s 2023-05-08T14:06:54.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:53 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37353.424695 secs 2023-05-08T14:06:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:53 smithi186 ceph-mon[126480]: pgmap v19975: 97 pgs: 97 active+clean; 6.7 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 643 KiB/s rd, 548 KiB/s wr, 8 op/s 2023-05-08T14:06:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:53 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37353.424695 secs 2023-05-08T14:06:56.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:56 smithi186 ceph-mon[126480]: pgmap v19976: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 15 op/s 2023-05-08T14:06:56.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:56 smithi133 ceph-mon[125939]: pgmap v19976: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 15 op/s 2023-05-08T14:06:56.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:56 smithi096 ceph-mon[124666]: pgmap v19976: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 15 op/s 2023-05-08T14:06:57.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:06:57.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:06:57.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:06:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:58 smithi186 ceph-mon[126480]: pgmap v19977: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 11 op/s 2023-05-08T14:06:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:58 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:06:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:06:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:06:58.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:58 smithi133 ceph-mon[125939]: pgmap v19977: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 11 op/s 2023-05-08T14:06:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:58 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:06:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:06:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:06:58.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:58 smithi096 ceph-mon[124666]: pgmap v19977: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 11 op/s 2023-05-08T14:06:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:58 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:06:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:06:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:06:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:06:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37358.424830 secs 2023-05-08T14:06:59.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:06:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37358.424830 secs 2023-05-08T14:06:59.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:06:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37358.424830 secs 2023-05-08T14:07:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:00 smithi186 ceph-mon[126480]: pgmap v19978: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.2 MiB/s wr, 14 op/s 2023-05-08T14:07:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37358.979202 secs 2023-05-08T14:07:00.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:00 smithi133 ceph-mon[125939]: pgmap v19978: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.2 MiB/s wr, 14 op/s 2023-05-08T14:07:00.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37358.979202 secs 2023-05-08T14:07:00.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:00 smithi096 ceph-mon[124666]: pgmap v19978: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.2 MiB/s wr, 14 op/s 2023-05-08T14:07:00.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37358.979202 secs 2023-05-08T14:07:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:02 smithi186 ceph-mon[126480]: pgmap v19979: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 13 op/s 2023-05-08T14:07:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:07:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:07:02.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:02 smithi133 ceph-mon[125939]: pgmap v19979: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 13 op/s 2023-05-08T14:07:02.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:07:02.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:07:02.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:02 smithi096 ceph-mon[124666]: pgmap v19979: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 13 op/s 2023-05-08T14:07:02.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:07:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:07:03.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:03 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:07:03.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:03 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:07:03.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:03 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:07:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:04 smithi186 ceph-mon[126480]: pgmap v19980: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 12 op/s 2023-05-08T14:07:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37363.424936 secs 2023-05-08T14:07:04.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:04 smithi133 ceph-mon[125939]: pgmap v19980: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 12 op/s 2023-05-08T14:07:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37363.424936 secs 2023-05-08T14:07:04.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:04 smithi096 ceph-mon[124666]: pgmap v19980: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 12 op/s 2023-05-08T14:07:04.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37363.424936 secs 2023-05-08T14:07:05.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37363.979335 secs 2023-05-08T14:07:05.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37363.979335 secs 2023-05-08T14:07:05.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37363.979335 secs 2023-05-08T14:07:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:06 smithi186 ceph-mon[126480]: pgmap v19981: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.7 MiB/s wr, 33 op/s 2023-05-08T14:07:06.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:06 smithi133 ceph-mon[125939]: pgmap v19981: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.7 MiB/s wr, 33 op/s 2023-05-08T14:07:06.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:06 smithi096 ceph-mon[124666]: pgmap v19981: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.7 MiB/s wr, 33 op/s 2023-05-08T14:07:07.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:07 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37365.319809 secs 2023-05-08T14:07:07.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:07 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37365.319809 secs 2023-05-08T14:07:07.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:07 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37365.319809 secs 2023-05-08T14:07:08.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:08 smithi186 ceph-mon[126480]: pgmap v19982: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 26 op/s 2023-05-08T14:07:08.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:08 smithi133 ceph-mon[125939]: pgmap v19982: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 26 op/s 2023-05-08T14:07:08.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:08 smithi096 ceph-mon[124666]: pgmap v19982: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 26 op/s 2023-05-08T14:07:09.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37368.425075 secs 2023-05-08T14:07:09.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37368.425075 secs 2023-05-08T14:07:09.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37368.425075 secs 2023-05-08T14:07:10.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:10 smithi186 ceph-mon[126480]: pgmap v19983: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 30 op/s 2023-05-08T14:07:10.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37368.979433 secs 2023-05-08T14:07:10.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:10 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:07:10.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:10 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:07:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:10 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:07:10.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:10 smithi133 ceph-mon[125939]: pgmap v19983: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 30 op/s 2023-05-08T14:07:10.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37368.979433 secs 2023-05-08T14:07:10.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:10 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:07:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:10 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:07:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:10 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:07:10.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:10 smithi096 ceph-mon[124666]: pgmap v19983: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 30 op/s 2023-05-08T14:07:10.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37368.979433 secs 2023-05-08T14:07:10.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:10 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:07:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:10 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:07:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:10 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:07:12.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:12 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37370.319930 secs 2023-05-08T14:07:12.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:12 smithi186 ceph-mon[126480]: pgmap v19984: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.7 MiB/s wr, 27 op/s 2023-05-08T14:07:12.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:12 smithi186 ceph-mon[126480]: osdmap e1326: 12 total, 12 up, 12 in 2023-05-08T14:07:12.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:12 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37370.319930 secs 2023-05-08T14:07:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:12 smithi133 ceph-mon[125939]: pgmap v19984: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.7 MiB/s wr, 27 op/s 2023-05-08T14:07:12.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:12 smithi133 ceph-mon[125939]: osdmap e1326: 12 total, 12 up, 12 in 2023-05-08T14:07:12.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:12 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37370.319930 secs 2023-05-08T14:07:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:12 smithi096 ceph-mon[124666]: pgmap v19984: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.7 MiB/s wr, 27 op/s 2023-05-08T14:07:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:12 smithi096 ceph-mon[124666]: osdmap e1326: 12 total, 12 up, 12 in 2023-05-08T14:07:14.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:13 smithi096 ceph-mon[124666]: pgmap v19986: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.8 MiB/s wr, 30 op/s 2023-05-08T14:07:14.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:13 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37373.425210 secs 2023-05-08T14:07:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:13 smithi186 ceph-mon[126480]: pgmap v19986: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.8 MiB/s wr, 30 op/s 2023-05-08T14:07:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:13 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37373.425210 secs 2023-05-08T14:07:14.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:13 smithi133 ceph-mon[125939]: pgmap v19986: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.8 MiB/s wr, 30 op/s 2023-05-08T14:07:14.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:13 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37373.425210 secs 2023-05-08T14:07:15.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37373.979563 secs 2023-05-08T14:07:15.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37373.979563 secs 2023-05-08T14:07:15.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37373.979563 secs 2023-05-08T14:07:16.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:16 smithi133 ceph-mon[125939]: pgmap v19987: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T14:07:16.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:16 smithi096 ceph-mon[124666]: pgmap v19987: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T14:07:16.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:16 smithi186 ceph-mon[126480]: pgmap v19987: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T14:07:17.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:17 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37375.320050 secs 2023-05-08T14:07:17.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:17 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37375.320050 secs 2023-05-08T14:07:17.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:17 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37375.320050 secs 2023-05-08T14:07:18.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:18 smithi096 ceph-mon[124666]: pgmap v19988: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 11 op/s 2023-05-08T14:07:18.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:18 smithi096 ceph-mon[124666]: osdmap e1327: 12 total, 12 up, 12 in 2023-05-08T14:07:18.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:18 smithi186 ceph-mon[126480]: pgmap v19988: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 11 op/s 2023-05-08T14:07:18.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:18 smithi186 ceph-mon[126480]: osdmap e1327: 12 total, 12 up, 12 in 2023-05-08T14:07:18.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:18 smithi133 ceph-mon[125939]: pgmap v19988: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 11 op/s 2023-05-08T14:07:18.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:18 smithi133 ceph-mon[125939]: osdmap e1327: 12 total, 12 up, 12 in 2023-05-08T14:07:19.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37378.425311 secs 2023-05-08T14:07:19.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37378.425311 secs 2023-05-08T14:07:19.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37378.425311 secs 2023-05-08T14:07:20.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:20 smithi096 ceph-mon[124666]: pgmap v19990: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T14:07:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37378.979628 secs 2023-05-08T14:07:20.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:20 smithi186 ceph-mon[126480]: pgmap v19990: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T14:07:20.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37378.979628 secs 2023-05-08T14:07:20.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:20 smithi133 ceph-mon[125939]: pgmap v19990: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T14:07:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37378.979628 secs 2023-05-08T14:07:21.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:07:21.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:07:21.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:07:22.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:22 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37380.320150 secs 2023-05-08T14:07:22.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:22 smithi186 ceph-mon[126480]: pgmap v19991: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 989 KiB/s wr, 11 op/s 2023-05-08T14:07:22.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:22 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37380.320150 secs 2023-05-08T14:07:22.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:22 smithi133 ceph-mon[125939]: pgmap v19991: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 989 KiB/s wr, 11 op/s 2023-05-08T14:07:22.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:22 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37380.320150 secs 2023-05-08T14:07:22.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:22 smithi096 ceph-mon[124666]: pgmap v19991: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 989 KiB/s wr, 11 op/s 2023-05-08T14:07:24.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:23 smithi096 ceph-mon[124666]: pgmap v19992: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 979 KiB/s wr, 11 op/s 2023-05-08T14:07:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:23 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37383.425446 secs 2023-05-08T14:07:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:07:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:07:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:07:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:07:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:07:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:07:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:23 smithi186 ceph-mon[126480]: pgmap v19992: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 979 KiB/s wr, 11 op/s 2023-05-08T14:07:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:23 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37383.425446 secs 2023-05-08T14:07:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:07:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:07:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:07:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:07:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:07:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:07:24.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:23 smithi133 ceph-mon[125939]: pgmap v19992: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 979 KiB/s wr, 11 op/s 2023-05-08T14:07:24.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:23 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37383.425446 secs 2023-05-08T14:07:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:07:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:07:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:07:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:07:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:07:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:07:25.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:07:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:07:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:07:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:07:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:07:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:24 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi186 to 87438k 2023-05-08T14:07:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:24 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi186 to 89537073: error parsing value: Value '89537073' is below minimum 939524096 2023-05-08T14:07:25.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:07:25.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:07:25.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:07:25.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:07:25.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:24 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi133 to 109.9M 2023-05-08T14:07:25.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:24 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi133 to 115289673: error parsing value: Value '115289673' is below minimum 939524096 2023-05-08T14:07:25.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:07:25.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:07:25.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:24 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:07:25.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:07:25.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:24 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T14:07:25.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:24 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T14:07:25.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:24 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:07:25.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:07:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:07:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:07:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:07:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:07:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:24 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi186 to 87438k 2023-05-08T14:07:25.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:24 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi186 to 89537073: error parsing value: Value '89537073' is below minimum 939524096 2023-05-08T14:07:25.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:07:25.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:07:25.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:07:25.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:07:25.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:24 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi133 to 109.9M 2023-05-08T14:07:25.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:24 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi133 to 115289673: error parsing value: Value '115289673' is below minimum 939524096 2023-05-08T14:07:25.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:07:25.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:07:25.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:24 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:07:25.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:07:25.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:24 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T14:07:25.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:24 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T14:07:25.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:24 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:07:25.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:07:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:07:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:07:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:07:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:07:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:24 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi186 to 87438k 2023-05-08T14:07:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:24 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi186 to 89537073: error parsing value: Value '89537073' is below minimum 939524096 2023-05-08T14:07:25.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:07:25.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:07:25.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:07:25.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:07:25.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:24 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi133 to 109.9M 2023-05-08T14:07:25.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:24 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi133 to 115289673: error parsing value: Value '115289673' is below minimum 939524096 2023-05-08T14:07:25.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:07:25.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:07:25.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:24 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:07:25.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:07:25.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:24 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T14:07:25.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:24 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T14:07:25.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:24 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:07:26.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37383.979719 secs 2023-05-08T14:07:26.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:26 smithi096 ceph-mon[124666]: pgmap v19993: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1009 KiB/s rd, 568 KiB/s wr, 10 op/s 2023-05-08T14:07:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37383.979719 secs 2023-05-08T14:07:26.406 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:26 smithi186 ceph-mon[126480]: pgmap v19993: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1009 KiB/s rd, 568 KiB/s wr, 10 op/s 2023-05-08T14:07:26.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37383.979719 secs 2023-05-08T14:07:26.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:26 smithi133 ceph-mon[125939]: pgmap v19993: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1009 KiB/s rd, 568 KiB/s wr, 10 op/s 2023-05-08T14:07:27.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:27 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37385.320261 secs 2023-05-08T14:07:27.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:27 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37385.320261 secs 2023-05-08T14:07:27.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:27 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37385.320261 secs 2023-05-08T14:07:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:28 smithi186 ceph-mon[126480]: pgmap v19994: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 849 KiB/s rd, 407 KiB/s wr, 9 op/s 2023-05-08T14:07:28.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:28 smithi133 ceph-mon[125939]: pgmap v19994: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 849 KiB/s rd, 407 KiB/s wr, 9 op/s 2023-05-08T14:07:28.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:28 smithi096 ceph-mon[124666]: pgmap v19994: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 849 KiB/s rd, 407 KiB/s wr, 9 op/s 2023-05-08T14:07:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37388.425574 secs 2023-05-08T14:07:29.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37388.425574 secs 2023-05-08T14:07:29.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37388.425574 secs 2023-05-08T14:07:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:30 smithi186 ceph-mon[126480]: pgmap v19995: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 784 KiB/s rd, 390 KiB/s wr, 13 op/s 2023-05-08T14:07:30.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:30 smithi133 ceph-mon[125939]: pgmap v19995: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 784 KiB/s rd, 390 KiB/s wr, 13 op/s 2023-05-08T14:07:30.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:30 smithi096 ceph-mon[124666]: pgmap v19995: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 784 KiB/s rd, 390 KiB/s wr, 13 op/s 2023-05-08T14:07:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37388.979837 secs 2023-05-08T14:07:31.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37388.979837 secs 2023-05-08T14:07:31.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37388.979837 secs 2023-05-08T14:07:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:32 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37390.320378 secs 2023-05-08T14:07:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:32 smithi186 ceph-mon[126480]: pgmap v19996: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 38 KiB/s wr, 8 op/s 2023-05-08T14:07:32.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:32 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37390.320378 secs 2023-05-08T14:07:32.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:32 smithi133 ceph-mon[125939]: pgmap v19996: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 38 KiB/s wr, 8 op/s 2023-05-08T14:07:32.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:32 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37390.320378 secs 2023-05-08T14:07:32.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:32 smithi096 ceph-mon[124666]: pgmap v19996: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 38 KiB/s wr, 8 op/s 2023-05-08T14:07:34.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:33 smithi096 ceph-mon[124666]: pgmap v19997: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 KiB/s wr, 7 op/s 2023-05-08T14:07:34.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:33 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37393.425685 secs 2023-05-08T14:07:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:33 smithi186 ceph-mon[126480]: pgmap v19997: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 KiB/s wr, 7 op/s 2023-05-08T14:07:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:33 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37393.425685 secs 2023-05-08T14:07:34.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:33 smithi133 ceph-mon[125939]: pgmap v19997: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 KiB/s wr, 7 op/s 2023-05-08T14:07:34.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:33 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37393.425685 secs 2023-05-08T14:07:35.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37393.979915 secs 2023-05-08T14:07:35.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37393.979915 secs 2023-05-08T14:07:35.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37393.979915 secs 2023-05-08T14:07:36.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:36 smithi133 ceph-mon[125939]: pgmap v19998: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 202 KiB/s wr, 11 op/s 2023-05-08T14:07:36.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:36 smithi096 ceph-mon[124666]: pgmap v19998: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 202 KiB/s wr, 11 op/s 2023-05-08T14:07:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:36 smithi186 ceph-mon[126480]: pgmap v19998: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 202 KiB/s wr, 11 op/s 2023-05-08T14:07:37.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:37 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37395.320482 secs 2023-05-08T14:07:37.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:37 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37395.320482 secs 2023-05-08T14:07:37.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:37 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37395.320482 secs 2023-05-08T14:07:38.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:38 smithi186 ceph-mon[126480]: pgmap v19999: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 190 KiB/s wr, 7 op/s 2023-05-08T14:07:38.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:38 smithi133 ceph-mon[125939]: pgmap v19999: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 190 KiB/s wr, 7 op/s 2023-05-08T14:07:38.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:38 smithi096 ceph-mon[124666]: pgmap v19999: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 190 KiB/s wr, 7 op/s 2023-05-08T14:07:39.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37398.425784 secs 2023-05-08T14:07:39.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37398.425784 secs 2023-05-08T14:07:39.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37398.425784 secs 2023-05-08T14:07:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:40 smithi186 ceph-mon[126480]: pgmap v20000: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 190 KiB/s wr, 10 op/s 2023-05-08T14:07:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37398.980032 secs 2023-05-08T14:07:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:40 smithi133 ceph-mon[125939]: pgmap v20000: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 190 KiB/s wr, 10 op/s 2023-05-08T14:07:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37398.980032 secs 2023-05-08T14:07:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:40 smithi096 ceph-mon[124666]: pgmap v20000: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 190 KiB/s wr, 10 op/s 2023-05-08T14:07:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37398.980032 secs 2023-05-08T14:07:42.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:42 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37400.320622 secs 2023-05-08T14:07:42.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:42 smithi186 ceph-mon[126480]: pgmap v20001: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 293 KiB/s wr, 7 op/s 2023-05-08T14:07:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:42 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37400.320622 secs 2023-05-08T14:07:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:42 smithi133 ceph-mon[125939]: pgmap v20001: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 293 KiB/s wr, 7 op/s 2023-05-08T14:07:42.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:42 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37400.320622 secs 2023-05-08T14:07:42.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:42 smithi096 ceph-mon[124666]: pgmap v20001: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 293 KiB/s wr, 7 op/s 2023-05-08T14:07:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:43 smithi096 ceph-mon[124666]: pgmap v20002: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 293 KiB/s wr, 7 op/s 2023-05-08T14:07:44.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:43 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37403.425915 secs 2023-05-08T14:07:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:43 smithi186 ceph-mon[126480]: pgmap v20002: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 293 KiB/s wr, 7 op/s 2023-05-08T14:07:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:43 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37403.425915 secs 2023-05-08T14:07:44.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:43 smithi133 ceph-mon[125939]: pgmap v20002: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 293 KiB/s wr, 7 op/s 2023-05-08T14:07:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:43 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37403.425915 secs 2023-05-08T14:07:45.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37403.980169 secs 2023-05-08T14:07:45.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37403.980169 secs 2023-05-08T14:07:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37403.980169 secs 2023-05-08T14:07:46.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:46 smithi096 ceph-mon[124666]: pgmap v20003: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 503 KiB/s rd, 500 KiB/s wr, 10 op/s 2023-05-08T14:07:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:46 smithi186 ceph-mon[126480]: pgmap v20003: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 503 KiB/s rd, 500 KiB/s wr, 10 op/s 2023-05-08T14:07:46.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:46 smithi133 ceph-mon[125939]: pgmap v20003: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 503 KiB/s rd, 500 KiB/s wr, 10 op/s 2023-05-08T14:07:48.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:48 smithi186 ceph-mon[126480]: pgmap v20004: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 548 KiB/s wr, 7 op/s 2023-05-08T14:07:48.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:48 smithi133 ceph-mon[125939]: pgmap v20004: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 548 KiB/s wr, 7 op/s 2023-05-08T14:07:48.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:48 smithi096 ceph-mon[124666]: pgmap v20004: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 548 KiB/s wr, 7 op/s 2023-05-08T14:07:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37408.426065 secs 2023-05-08T14:07:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:07:49.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37408.426065 secs 2023-05-08T14:07:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:07:49.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37408.426065 secs 2023-05-08T14:07:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:07:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:50 smithi186 ceph-mon[126480]: pgmap v20005: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 674 KiB/s rd, 671 KiB/s wr, 10 op/s 2023-05-08T14:07:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37408.980305 secs 2023-05-08T14:07:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:07:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:07:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:07:50.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:50 smithi133 ceph-mon[125939]: pgmap v20005: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 674 KiB/s rd, 671 KiB/s wr, 10 op/s 2023-05-08T14:07:50.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37408.980305 secs 2023-05-08T14:07:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:07:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:07:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:07:50.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:50 smithi096 ceph-mon[124666]: pgmap v20005: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 674 KiB/s rd, 671 KiB/s wr, 10 op/s 2023-05-08T14:07:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37408.980305 secs 2023-05-08T14:07:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:07:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:07:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:07:52.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:52 smithi186 ceph-mon[126480]: pgmap v20006: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 725 KiB/s rd, 671 KiB/s wr, 8 op/s 2023-05-08T14:07:52.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:52 smithi133 ceph-mon[125939]: pgmap v20006: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 725 KiB/s rd, 671 KiB/s wr, 8 op/s 2023-05-08T14:07:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:52 smithi096 ceph-mon[124666]: pgmap v20006: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 725 KiB/s rd, 671 KiB/s wr, 8 op/s 2023-05-08T14:07:54.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:54 smithi096 ceph-mon[124666]: pgmap v20007: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 597 KiB/s rd, 542 KiB/s wr, 7 op/s 2023-05-08T14:07:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37413.426155 secs 2023-05-08T14:07:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:54 smithi186 ceph-mon[126480]: pgmap v20007: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 597 KiB/s rd, 542 KiB/s wr, 7 op/s 2023-05-08T14:07:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37413.426155 secs 2023-05-08T14:07:54.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:54 smithi133 ceph-mon[125939]: pgmap v20007: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 597 KiB/s rd, 542 KiB/s wr, 7 op/s 2023-05-08T14:07:54.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37413.426155 secs 2023-05-08T14:07:56.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:56 smithi186 ceph-mon[126480]: pgmap v20008: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T14:07:56.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:56 smithi133 ceph-mon[125939]: pgmap v20008: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T14:07:56.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:56 smithi096 ceph-mon[124666]: pgmap v20008: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T14:07:57.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:07:57.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:07:57.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:07:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:58 smithi186 ceph-mon[126480]: pgmap v20009: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 926 KiB/s rd, 872 KiB/s wr, 8 op/s 2023-05-08T14:07:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:58 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:07:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:07:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:07:58.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:58 smithi133 ceph-mon[125939]: pgmap v20009: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 926 KiB/s rd, 872 KiB/s wr, 8 op/s 2023-05-08T14:07:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:58 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:07:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:07:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:07:58.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:58 smithi096 ceph-mon[124666]: pgmap v20009: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 926 KiB/s rd, 872 KiB/s wr, 8 op/s 2023-05-08T14:07:58.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:58 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:07:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:07:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:07:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:07:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37418.426277 secs 2023-05-08T14:07:59.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:07:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37418.426277 secs 2023-05-08T14:07:59.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:07:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37418.426277 secs 2023-05-08T14:08:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:00 smithi186 ceph-mon[126480]: pgmap v20010: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 943 KiB/s rd, 1.4 MiB/s wr, 14 op/s 2023-05-08T14:08:00.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:00 smithi133 ceph-mon[125939]: pgmap v20010: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 943 KiB/s rd, 1.4 MiB/s wr, 14 op/s 2023-05-08T14:08:00.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:00 smithi096 ceph-mon[124666]: pgmap v20010: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 943 KiB/s rd, 1.4 MiB/s wr, 14 op/s 2023-05-08T14:08:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:02 smithi186 ceph-mon[126480]: pgmap v20011: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 820 KiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T14:08:02.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:02 smithi133 ceph-mon[125939]: pgmap v20011: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 820 KiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T14:08:02.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:02 smithi096 ceph-mon[124666]: pgmap v20011: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 820 KiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T14:08:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:04 smithi186 ceph-mon[126480]: pgmap v20012: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 767 KiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T14:08:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37423.426375 secs 2023-05-08T14:08:04.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:04 smithi133 ceph-mon[125939]: pgmap v20012: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 767 KiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T14:08:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37423.426375 secs 2023-05-08T14:08:04.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:04 smithi096 ceph-mon[124666]: pgmap v20012: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 767 KiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T14:08:04.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37423.426375 secs 2023-05-08T14:08:05.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37423.980618 secs 2023-05-08T14:08:05.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:05 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:08:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:08:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:08:05.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37423.980618 secs 2023-05-08T14:08:05.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:05 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:08:05.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:08:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:08:05.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37423.980618 secs 2023-05-08T14:08:05.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:05 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:08:05.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:08:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:08:06.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:06 smithi133 ceph-mon[125939]: pgmap v20013: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 28 op/s 2023-05-08T14:08:06.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:06 smithi096 ceph-mon[124666]: pgmap v20013: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 28 op/s 2023-05-08T14:08:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:06 smithi186 ceph-mon[126480]: pgmap v20013: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 28 op/s 2023-05-08T14:08:08.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:08 smithi186 ceph-mon[126480]: pgmap v20014: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 24 op/s 2023-05-08T14:08:08.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:08 smithi133 ceph-mon[125939]: pgmap v20014: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 24 op/s 2023-05-08T14:08:08.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:08 smithi096 ceph-mon[124666]: pgmap v20014: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 24 op/s 2023-05-08T14:08:09.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37428.426503 secs 2023-05-08T14:08:09.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37428.426503 secs 2023-05-08T14:08:09.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37428.426503 secs 2023-05-08T14:08:10.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:10 smithi186 ceph-mon[126480]: pgmap v20015: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 28 op/s 2023-05-08T14:08:10.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37428.980684 secs 2023-05-08T14:08:10.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:10 smithi133 ceph-mon[125939]: pgmap v20015: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 28 op/s 2023-05-08T14:08:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37428.980684 secs 2023-05-08T14:08:10.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:10 smithi096 ceph-mon[124666]: pgmap v20015: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 28 op/s 2023-05-08T14:08:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37428.980684 secs 2023-05-08T14:08:12.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:12 smithi186 ceph-mon[126480]: pgmap v20016: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 728 KiB/s wr, 22 op/s 2023-05-08T14:08:12.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:12 smithi133 ceph-mon[125939]: pgmap v20016: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 728 KiB/s wr, 22 op/s 2023-05-08T14:08:12.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:12 smithi096 ceph-mon[124666]: pgmap v20016: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 728 KiB/s wr, 22 op/s 2023-05-08T14:08:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:14 smithi186 ceph-mon[126480]: pgmap v20017: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 728 KiB/s wr, 22 op/s 2023-05-08T14:08:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37433.426593 secs 2023-05-08T14:08:14.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:14 smithi133 ceph-mon[125939]: pgmap v20017: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 728 KiB/s wr, 22 op/s 2023-05-08T14:08:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37433.426593 secs 2023-05-08T14:08:14.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:14 smithi096 ceph-mon[124666]: pgmap v20017: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 728 KiB/s wr, 22 op/s 2023-05-08T14:08:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37433.426593 secs 2023-05-08T14:08:15.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37433.980805 secs 2023-05-08T14:08:15.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37433.980805 secs 2023-05-08T14:08:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37433.980805 secs 2023-05-08T14:08:16.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:16 smithi096 ceph-mon[124666]: pgmap v20018: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 26 op/s 2023-05-08T14:08:16.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:16 smithi186 ceph-mon[126480]: pgmap v20018: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 26 op/s 2023-05-08T14:08:16.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:16 smithi133 ceph-mon[125939]: pgmap v20018: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 26 op/s 2023-05-08T14:08:18.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:18 smithi186 ceph-mon[126480]: pgmap v20019: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 683 KiB/s rd, 850 KiB/s wr, 8 op/s 2023-05-08T14:08:18.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:18 smithi133 ceph-mon[125939]: pgmap v20019: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 683 KiB/s rd, 850 KiB/s wr, 8 op/s 2023-05-08T14:08:18.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:18 smithi096 ceph-mon[124666]: pgmap v20019: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 683 KiB/s rd, 850 KiB/s wr, 8 op/s 2023-05-08T14:08:19.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37438.426668 secs 2023-05-08T14:08:19.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37438.426668 secs 2023-05-08T14:08:19.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37438.426668 secs 2023-05-08T14:08:20.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:20 smithi186 ceph-mon[126480]: pgmap v20020: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1016 KiB/s rd, 851 KiB/s wr, 12 op/s 2023-05-08T14:08:20.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37438.980937 secs 2023-05-08T14:08:20.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:20 smithi133 ceph-mon[125939]: pgmap v20020: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1016 KiB/s rd, 851 KiB/s wr, 12 op/s 2023-05-08T14:08:20.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37438.980937 secs 2023-05-08T14:08:20.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:20 smithi096 ceph-mon[124666]: pgmap v20020: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1016 KiB/s rd, 851 KiB/s wr, 12 op/s 2023-05-08T14:08:20.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37438.980937 secs 2023-05-08T14:08:22.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:22 smithi186 ceph-mon[126480]: pgmap v20021: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 848 KiB/s rd, 765 KiB/s wr, 7 op/s 2023-05-08T14:08:22.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:22 smithi133 ceph-mon[125939]: pgmap v20021: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 848 KiB/s rd, 765 KiB/s wr, 7 op/s 2023-05-08T14:08:22.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:22 smithi096 ceph-mon[124666]: pgmap v20021: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 848 KiB/s rd, 765 KiB/s wr, 7 op/s 2023-05-08T14:08:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:24 smithi186 ceph-mon[126480]: pgmap v20022: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 848 KiB/s rd, 765 KiB/s wr, 7 op/s 2023-05-08T14:08:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37443.426776 secs 2023-05-08T14:08:24.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:24 smithi133 ceph-mon[125939]: pgmap v20022: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 848 KiB/s rd, 765 KiB/s wr, 7 op/s 2023-05-08T14:08:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37443.426776 secs 2023-05-08T14:08:24.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:24 smithi096 ceph-mon[124666]: pgmap v20022: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 848 KiB/s rd, 765 KiB/s wr, 7 op/s 2023-05-08T14:08:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37443.426776 secs 2023-05-08T14:08:25.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:25 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:08:25.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:25 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:08:25.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:25 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:08:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:26 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:08:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:08:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:08:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:26 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:08:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:08:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:26 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T14:08:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:26 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T14:08:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:26 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:08:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:26 smithi186 ceph-mon[126480]: pgmap v20023: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 15 op/s 2023-05-08T14:08:26.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:26 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:08:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:08:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:08:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:26 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:08:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:08:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:26 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T14:08:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:26 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T14:08:26.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:26 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:08:26.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:26 smithi133 ceph-mon[125939]: pgmap v20023: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 15 op/s 2023-05-08T14:08:26.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:26 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:08:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:08:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:08:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:26 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:08:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:08:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:26 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T14:08:26.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:26 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T14:08:26.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:26 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:08:26.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:26 smithi096 ceph-mon[124666]: pgmap v20023: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 15 op/s 2023-05-08T14:08:27.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:27 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:08:27.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:27 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:08:27.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:27 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:08:27.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:27 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:08:27.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:27 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:08:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:27 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:08:27.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:27 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:08:27.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:27 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:08:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:27 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:08:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:28 smithi186 ceph-mon[126480]: pgmap v20024: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 925 KiB/s wr, 11 op/s 2023-05-08T14:08:28.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:28 smithi133 ceph-mon[125939]: pgmap v20024: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 925 KiB/s wr, 11 op/s 2023-05-08T14:08:28.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:28 smithi096 ceph-mon[124666]: pgmap v20024: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 925 KiB/s wr, 11 op/s 2023-05-08T14:08:29.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37448.426913 secs 2023-05-08T14:08:29.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37448.426913 secs 2023-05-08T14:08:29.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37448.426913 secs 2023-05-08T14:08:30.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:30 smithi186 ceph-mon[126480]: pgmap v20025: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 956 KiB/s wr, 14 op/s 2023-05-08T14:08:30.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:30 smithi133 ceph-mon[125939]: pgmap v20025: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 956 KiB/s wr, 14 op/s 2023-05-08T14:08:30.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:30 smithi096 ceph-mon[124666]: pgmap v20025: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 956 KiB/s wr, 14 op/s 2023-05-08T14:08:32.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:32 smithi186 ceph-mon[126480]: osdmap e1328: 12 total, 12 up, 12 in 2023-05-08T14:08:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:32 smithi186 ceph-mon[126480]: pgmap v20027: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T14:08:32.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:32 smithi133 ceph-mon[125939]: osdmap e1328: 12 total, 12 up, 12 in 2023-05-08T14:08:32.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:32 smithi133 ceph-mon[125939]: pgmap v20027: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T14:08:32.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:32 smithi096 ceph-mon[124666]: osdmap e1328: 12 total, 12 up, 12 in 2023-05-08T14:08:32.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:32 smithi096 ceph-mon[124666]: pgmap v20027: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T14:08:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:34 smithi186 ceph-mon[126480]: pgmap v20028: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T14:08:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37453.427026 secs 2023-05-08T14:08:34.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:34 smithi133 ceph-mon[125939]: pgmap v20028: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T14:08:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37453.427026 secs 2023-05-08T14:08:34.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:34 smithi096 ceph-mon[124666]: pgmap v20028: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T14:08:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37453.427026 secs 2023-05-08T14:08:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:36 smithi186 ceph-mon[126480]: pgmap v20029: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 433 KiB/s wr, 8 op/s 2023-05-08T14:08:36.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:36 smithi133 ceph-mon[125939]: pgmap v20029: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 433 KiB/s wr, 8 op/s 2023-05-08T14:08:36.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:36 smithi096 ceph-mon[124666]: pgmap v20029: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 433 KiB/s wr, 8 op/s 2023-05-08T14:08:38.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:38 smithi186 ceph-mon[126480]: pgmap v20030: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 433 KiB/s wr, 8 op/s 2023-05-08T14:08:38.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:38 smithi186 ceph-mon[126480]: osdmap e1329: 12 total, 12 up, 12 in 2023-05-08T14:08:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:38 smithi133 ceph-mon[125939]: pgmap v20030: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 433 KiB/s wr, 8 op/s 2023-05-08T14:08:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:38 smithi133 ceph-mon[125939]: osdmap e1329: 12 total, 12 up, 12 in 2023-05-08T14:08:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:38 smithi096 ceph-mon[124666]: pgmap v20030: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 433 KiB/s wr, 8 op/s 2023-05-08T14:08:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:38 smithi096 ceph-mon[124666]: osdmap e1329: 12 total, 12 up, 12 in 2023-05-08T14:08:39.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37458.427168 secs 2023-05-08T14:08:39.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37458.427168 secs 2023-05-08T14:08:39.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37458.427168 secs 2023-05-08T14:08:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:40 smithi186 ceph-mon[126480]: pgmap v20032: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 963 KiB/s rd, 592 KiB/s wr, 11 op/s 2023-05-08T14:08:40.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:40 smithi133 ceph-mon[125939]: pgmap v20032: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 963 KiB/s rd, 592 KiB/s wr, 11 op/s 2023-05-08T14:08:40.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:40 smithi096 ceph-mon[124666]: pgmap v20032: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 963 KiB/s rd, 592 KiB/s wr, 11 op/s 2023-05-08T14:08:41.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:41 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:08:41.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:41 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:08:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:41 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:08:41.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:41 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:08:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:41 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:08:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:41 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:08:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:41 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:08:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:41 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:08:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:41 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:08:42.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:42 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37460.322066 secs 2023-05-08T14:08:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:42 smithi133 ceph-mon[125939]: pgmap v20033: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 793 KiB/s rd, 487 KiB/s wr, 9 op/s 2023-05-08T14:08:42.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:42 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37460.322066 secs 2023-05-08T14:08:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:42 smithi096 ceph-mon[124666]: pgmap v20033: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 793 KiB/s rd, 487 KiB/s wr, 9 op/s 2023-05-08T14:08:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:42 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37460.322066 secs 2023-05-08T14:08:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:42 smithi186 ceph-mon[126480]: pgmap v20033: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 793 KiB/s rd, 487 KiB/s wr, 9 op/s 2023-05-08T14:08:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:44 smithi186 ceph-mon[126480]: pgmap v20034: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 793 KiB/s rd, 487 KiB/s wr, 9 op/s 2023-05-08T14:08:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37463.427285 secs 2023-05-08T14:08:44.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:44 smithi133 ceph-mon[125939]: pgmap v20034: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 793 KiB/s rd, 487 KiB/s wr, 9 op/s 2023-05-08T14:08:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37463.427285 secs 2023-05-08T14:08:44.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:44 smithi096 ceph-mon[124666]: pgmap v20034: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 793 KiB/s rd, 487 KiB/s wr, 9 op/s 2023-05-08T14:08:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37463.427285 secs 2023-05-08T14:08:46.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37463.981492 secs 2023-05-08T14:08:46.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:46 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:08:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:46 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:08:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:46 smithi133 ceph-mon[125939]: pgmap v20035: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.4 MiB/s wr, 11 op/s 2023-05-08T14:08:46.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37463.981492 secs 2023-05-08T14:08:46.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:46 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:08:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:46 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:08:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:46 smithi096 ceph-mon[124666]: pgmap v20035: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.4 MiB/s wr, 11 op/s 2023-05-08T14:08:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37463.981492 secs 2023-05-08T14:08:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:46 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:08:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:46 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:08:46.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:46 smithi186 ceph-mon[126480]: pgmap v20035: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.4 MiB/s wr, 11 op/s 2023-05-08T14:08:48.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:48 smithi186 ceph-mon[126480]: pgmap v20036: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.8 MiB/s wr, 12 op/s 2023-05-08T14:08:48.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:48 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:08:48.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:48 smithi133 ceph-mon[125939]: pgmap v20036: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.8 MiB/s wr, 12 op/s 2023-05-08T14:08:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:48 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:08:48.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:48 smithi096 ceph-mon[124666]: pgmap v20036: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.8 MiB/s wr, 12 op/s 2023-05-08T14:08:48.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:48 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:08:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37468.427412 secs 2023-05-08T14:08:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:08:49.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37468.427412 secs 2023-05-08T14:08:49.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:08:49.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37468.427412 secs 2023-05-08T14:08:49.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:08:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37468.981542 secs 2023-05-08T14:08:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:50 smithi186 ceph-mon[126480]: pgmap v20037: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.9 MiB/s wr, 16 op/s 2023-05-08T14:08:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:08:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:08:50.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37468.981542 secs 2023-05-08T14:08:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:50 smithi133 ceph-mon[125939]: pgmap v20037: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.9 MiB/s wr, 16 op/s 2023-05-08T14:08:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:08:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:08:50.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37468.981542 secs 2023-05-08T14:08:50.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:50 smithi096 ceph-mon[124666]: pgmap v20037: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.9 MiB/s wr, 16 op/s 2023-05-08T14:08:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:08:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:08:52.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:52 smithi186 ceph-mon[126480]: pgmap v20038: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 10 op/s 2023-05-08T14:08:52.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:52 smithi133 ceph-mon[125939]: pgmap v20038: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 10 op/s 2023-05-08T14:08:52.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:52 smithi096 ceph-mon[124666]: pgmap v20038: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 10 op/s 2023-05-08T14:08:53.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:53 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:08:53.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:53 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:08:53.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:53 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:08:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:54 smithi186 ceph-mon[126480]: pgmap v20039: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 10 op/s 2023-05-08T14:08:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37473.427528 secs 2023-05-08T14:08:54.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:54 smithi133 ceph-mon[125939]: pgmap v20039: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 10 op/s 2023-05-08T14:08:54.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37473.427528 secs 2023-05-08T14:08:54.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:54 smithi096 ceph-mon[124666]: pgmap v20039: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 10 op/s 2023-05-08T14:08:54.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37473.427528 secs 2023-05-08T14:08:56.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:56 smithi186 ceph-mon[126480]: pgmap v20040: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.4 MiB/s wr, 17 op/s 2023-05-08T14:08:56.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:56 smithi133 ceph-mon[125939]: pgmap v20040: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.4 MiB/s wr, 17 op/s 2023-05-08T14:08:56.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:56 smithi096 ceph-mon[124666]: pgmap v20040: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.4 MiB/s wr, 17 op/s 2023-05-08T14:08:57.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:08:57.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:08:57.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:08:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:58 smithi186 ceph-mon[126480]: pgmap v20041: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2023-05-08T14:08:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:08:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:08:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:58 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:08:58.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:58 smithi133 ceph-mon[125939]: pgmap v20041: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2023-05-08T14:08:58.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:08:58.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:08:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:58 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:08:58.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:58 smithi096 ceph-mon[124666]: pgmap v20041: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2023-05-08T14:08:58.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:08:58.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:08:58.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:58 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:08:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:08:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37478.427617 secs 2023-05-08T14:08:59.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:08:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37478.427617 secs 2023-05-08T14:08:59.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:08:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37478.427617 secs 2023-05-08T14:09:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37478.981786 secs 2023-05-08T14:09:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:00 smithi186 ceph-mon[126480]: pgmap v20042: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.4 MiB/s wr, 17 op/s 2023-05-08T14:09:00.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37478.981786 secs 2023-05-08T14:09:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:00 smithi133 ceph-mon[125939]: pgmap v20042: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.4 MiB/s wr, 17 op/s 2023-05-08T14:09:00.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37478.981786 secs 2023-05-08T14:09:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:00 smithi096 ceph-mon[124666]: pgmap v20042: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.4 MiB/s wr, 17 op/s 2023-05-08T14:09:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:02 smithi186 ceph-mon[126480]: pgmap v20043: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.1 MiB/s wr, 12 op/s 2023-05-08T14:09:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:09:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:09:02.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:02 smithi133 ceph-mon[125939]: pgmap v20043: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.1 MiB/s wr, 12 op/s 2023-05-08T14:09:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:09:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:09:02.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:02 smithi096 ceph-mon[124666]: pgmap v20043: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.1 MiB/s wr, 12 op/s 2023-05-08T14:09:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:09:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:09:03.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:03 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:09:03.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:03 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:09:03.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:03 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:09:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:04 smithi186 ceph-mon[126480]: pgmap v20044: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.1 MiB/s wr, 12 op/s 2023-05-08T14:09:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37483.427754 secs 2023-05-08T14:09:04.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:04 smithi133 ceph-mon[125939]: pgmap v20044: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.1 MiB/s wr, 12 op/s 2023-05-08T14:09:04.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37483.427754 secs 2023-05-08T14:09:04.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:04 smithi096 ceph-mon[124666]: pgmap v20044: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.1 MiB/s wr, 12 op/s 2023-05-08T14:09:04.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37483.427754 secs 2023-05-08T14:09:05.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:05 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:09:05.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:05 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:09:05.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:05 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:09:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:06 smithi186 ceph-mon[126480]: pgmap v20045: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 2.8 MiB/s wr, 31 op/s 2023-05-08T14:09:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:09:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:09:06.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:06 smithi133 ceph-mon[125939]: pgmap v20045: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 2.8 MiB/s wr, 31 op/s 2023-05-08T14:09:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:09:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:09:06.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:06 smithi096 ceph-mon[124666]: pgmap v20045: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 2.8 MiB/s wr, 31 op/s 2023-05-08T14:09:06.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:09:06.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:09:08.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:08 smithi186 ceph-mon[126480]: pgmap v20046: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.1 MiB/s wr, 24 op/s 2023-05-08T14:09:08.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:08 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:09:08.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:08 smithi133 ceph-mon[125939]: pgmap v20046: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.1 MiB/s wr, 24 op/s 2023-05-08T14:09:08.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:08 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:09:08.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:08 smithi096 ceph-mon[124666]: pgmap v20046: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.1 MiB/s wr, 24 op/s 2023-05-08T14:09:08.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:08 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:09:09.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37488.427840 secs 2023-05-08T14:09:09.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37488.427840 secs 2023-05-08T14:09:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37488.427840 secs 2023-05-08T14:09:10.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:10 smithi133 ceph-mon[125939]: pgmap v20047: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 2.8 MiB/s wr, 29 op/s 2023-05-08T14:09:10.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:10 smithi096 ceph-mon[124666]: pgmap v20047: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 2.8 MiB/s wr, 29 op/s 2023-05-08T14:09:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:10 smithi186 ceph-mon[126480]: pgmap v20047: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 2.8 MiB/s wr, 29 op/s 2023-05-08T14:09:12.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:12 smithi133 ceph-mon[125939]: pgmap v20048: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.4 MiB/s wr, 24 op/s 2023-05-08T14:09:12.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:12 smithi096 ceph-mon[124666]: pgmap v20048: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.4 MiB/s wr, 24 op/s 2023-05-08T14:09:12.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:12 smithi186 ceph-mon[126480]: pgmap v20048: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.4 MiB/s wr, 24 op/s 2023-05-08T14:09:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:14 smithi186 ceph-mon[126480]: pgmap v20049: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.4 MiB/s wr, 24 op/s 2023-05-08T14:09:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37493.427955 secs 2023-05-08T14:09:14.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:14 smithi133 ceph-mon[125939]: pgmap v20049: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.4 MiB/s wr, 24 op/s 2023-05-08T14:09:14.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37493.427955 secs 2023-05-08T14:09:14.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:14 smithi096 ceph-mon[124666]: pgmap v20049: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.4 MiB/s wr, 24 op/s 2023-05-08T14:09:14.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37493.427955 secs 2023-05-08T14:09:16.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:16 smithi186 ceph-mon[126480]: pgmap v20050: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 1.7 MiB/s wr, 27 op/s 2023-05-08T14:09:16.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:16 smithi133 ceph-mon[125939]: pgmap v20050: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 1.7 MiB/s wr, 27 op/s 2023-05-08T14:09:16.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:16 smithi096 ceph-mon[124666]: pgmap v20050: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 1.7 MiB/s wr, 27 op/s 2023-05-08T14:09:18.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:18 smithi186 ceph-mon[126480]: pgmap v20051: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.0 MiB/s wr, 9 op/s 2023-05-08T14:09:18.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:18 smithi133 ceph-mon[125939]: pgmap v20051: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.0 MiB/s wr, 9 op/s 2023-05-08T14:09:18.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:18 smithi096 ceph-mon[124666]: pgmap v20051: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.0 MiB/s wr, 9 op/s 2023-05-08T14:09:19.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37498.428072 secs 2023-05-08T14:09:19.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37498.428072 secs 2023-05-08T14:09:19.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37498.428072 secs 2023-05-08T14:09:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:20 smithi186 ceph-mon[126480]: pgmap v20052: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T14:09:20.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:20 smithi133 ceph-mon[125939]: pgmap v20052: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T14:09:20.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:20 smithi096 ceph-mon[124666]: pgmap v20052: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T14:09:22.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:22 smithi186 ceph-mon[126480]: pgmap v20053: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 637 KiB/s rd, 662 KiB/s wr, 7 op/s 2023-05-08T14:09:22.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:22 smithi133 ceph-mon[125939]: pgmap v20053: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 637 KiB/s rd, 662 KiB/s wr, 7 op/s 2023-05-08T14:09:22.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:22 smithi096 ceph-mon[124666]: pgmap v20053: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 637 KiB/s rd, 662 KiB/s wr, 7 op/s 2023-05-08T14:09:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:24 smithi186 ceph-mon[126480]: pgmap v20054: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 637 KiB/s rd, 662 KiB/s wr, 7 op/s 2023-05-08T14:09:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37503.428188 secs 2023-05-08T14:09:24.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:24 smithi133 ceph-mon[125939]: pgmap v20054: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 637 KiB/s rd, 662 KiB/s wr, 7 op/s 2023-05-08T14:09:24.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37503.428188 secs 2023-05-08T14:09:24.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:24 smithi096 ceph-mon[124666]: pgmap v20054: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 637 KiB/s rd, 662 KiB/s wr, 7 op/s 2023-05-08T14:09:24.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37503.428188 secs 2023-05-08T14:09:25.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37503.982374 secs 2023-05-08T14:09:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:25 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:09:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:25 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:09:25.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:25 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:09:25.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37503.982374 secs 2023-05-08T14:09:25.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:25 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:09:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:25 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:09:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:25 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:09:25.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37503.982374 secs 2023-05-08T14:09:25.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:25 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:09:25.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:25 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:09:25.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:25 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:09:26.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:26 smithi133 ceph-mon[125939]: pgmap v20055: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 15 op/s 2023-05-08T14:09:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:09:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:09:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:09:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:09:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:26 smithi096 ceph-mon[124666]: pgmap v20055: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 15 op/s 2023-05-08T14:09:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:09:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:09:26.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:09:26.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:09:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:26 smithi186 ceph-mon[126480]: pgmap v20055: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 15 op/s 2023-05-08T14:09:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:09:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:09:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:09:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:09:27.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:27 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37505.323332 secs 2023-05-08T14:09:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:27 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:09:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:27 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T14:09:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:27 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T14:09:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:27 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:09:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:27 smithi133 ceph-mon[125939]: osdmap e1330: 12 total, 12 up, 12 in 2023-05-08T14:09:27.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:27 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37505.323332 secs 2023-05-08T14:09:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:27 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:09:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:27 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T14:09:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:27 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T14:09:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:27 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:09:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:27 smithi096 ceph-mon[124666]: osdmap e1330: 12 total, 12 up, 12 in 2023-05-08T14:09:27.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:27 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37505.323332 secs 2023-05-08T14:09:27.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:27 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:09:27.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:27 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T14:09:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:27 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T14:09:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:27 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:09:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:27 smithi186 ceph-mon[126480]: osdmap e1330: 12 total, 12 up, 12 in 2023-05-08T14:09:28.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:28 smithi133 ceph-mon[125939]: pgmap v20057: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T14:09:28.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:28 smithi096 ceph-mon[124666]: pgmap v20057: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T14:09:28.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:28 smithi186 ceph-mon[126480]: pgmap v20057: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T14:09:29.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37508.428316 secs 2023-05-08T14:09:29.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37508.428316 secs 2023-05-08T14:09:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37508.428316 secs 2023-05-08T14:09:30.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:30 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:09:30.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:30 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:09:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37508.982525 secs 2023-05-08T14:09:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:30 smithi096 ceph-mon[124666]: pgmap v20058: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 15 op/s 2023-05-08T14:09:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:30 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:09:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:30 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:09:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37508.982525 secs 2023-05-08T14:09:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:30 smithi186 ceph-mon[126480]: pgmap v20058: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 15 op/s 2023-05-08T14:09:30.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:30 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:09:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:30 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:09:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37508.982525 secs 2023-05-08T14:09:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:30 smithi133 ceph-mon[125939]: pgmap v20058: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 15 op/s 2023-05-08T14:09:32.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:32 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37510.323452 secs 2023-05-08T14:09:32.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:32 smithi186 ceph-mon[126480]: pgmap v20059: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 15 op/s 2023-05-08T14:09:32.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:32 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37510.323452 secs 2023-05-08T14:09:32.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:32 smithi133 ceph-mon[125939]: pgmap v20059: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 15 op/s 2023-05-08T14:09:32.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:32 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37510.323452 secs 2023-05-08T14:09:32.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:32 smithi096 ceph-mon[124666]: pgmap v20059: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 15 op/s 2023-05-08T14:09:33.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:33 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:09:33.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:33 smithi186 ceph-mon[126480]: osdmap e1331: 12 total, 12 up, 12 in 2023-05-08T14:09:33.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:33 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:09:33.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:33 smithi133 ceph-mon[125939]: osdmap e1331: 12 total, 12 up, 12 in 2023-05-08T14:09:33.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:33 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:09:33.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:33 smithi096 ceph-mon[124666]: osdmap e1331: 12 total, 12 up, 12 in 2023-05-08T14:09:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:34 smithi186 ceph-mon[126480]: pgmap v20061: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 633 KiB/s rd, 627 KiB/s wr, 7 op/s 2023-05-08T14:09:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37513.428437 secs 2023-05-08T14:09:34.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:34 smithi133 ceph-mon[125939]: pgmap v20061: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 633 KiB/s rd, 627 KiB/s wr, 7 op/s 2023-05-08T14:09:34.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37513.428437 secs 2023-05-08T14:09:34.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:34 smithi096 ceph-mon[124666]: pgmap v20061: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 633 KiB/s rd, 627 KiB/s wr, 7 op/s 2023-05-08T14:09:34.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37513.428437 secs 2023-05-08T14:09:35.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37513.982648 secs 2023-05-08T14:09:35.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37513.982648 secs 2023-05-08T14:09:35.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37513.982648 secs 2023-05-08T14:09:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:36 smithi186 ceph-mon[126480]: pgmap v20062: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 731 KiB/s rd, 724 KiB/s wr, 12 op/s 2023-05-08T14:09:36.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:36 smithi133 ceph-mon[125939]: pgmap v20062: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 731 KiB/s rd, 724 KiB/s wr, 12 op/s 2023-05-08T14:09:36.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:36 smithi096 ceph-mon[124666]: pgmap v20062: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 731 KiB/s rd, 724 KiB/s wr, 12 op/s 2023-05-08T14:09:37.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:37 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37515.323570 secs 2023-05-08T14:09:37.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:37 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37515.323570 secs 2023-05-08T14:09:37.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:37 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37515.323570 secs 2023-05-08T14:09:38.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:38 smithi186 ceph-mon[126480]: pgmap v20063: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 925 KiB/s rd, 920 KiB/s wr, 11 op/s 2023-05-08T14:09:38.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:38 smithi133 ceph-mon[125939]: pgmap v20063: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 925 KiB/s rd, 920 KiB/s wr, 11 op/s 2023-05-08T14:09:38.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:38 smithi096 ceph-mon[124666]: pgmap v20063: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 925 KiB/s rd, 920 KiB/s wr, 11 op/s 2023-05-08T14:09:39.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37518.428519 secs 2023-05-08T14:09:39.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37518.428519 secs 2023-05-08T14:09:39.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37518.428519 secs 2023-05-08T14:09:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37518.982765 secs 2023-05-08T14:09:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:40 smithi186 ceph-mon[126480]: pgmap v20064: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 566 KiB/s rd, 968 KiB/s wr, 10 op/s 2023-05-08T14:09:40.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37518.982765 secs 2023-05-08T14:09:40.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:40 smithi133 ceph-mon[125939]: pgmap v20064: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 566 KiB/s rd, 968 KiB/s wr, 10 op/s 2023-05-08T14:09:40.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37518.982765 secs 2023-05-08T14:09:40.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:40 smithi096 ceph-mon[124666]: pgmap v20064: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 566 KiB/s rd, 968 KiB/s wr, 10 op/s 2023-05-08T14:09:42.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:42 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37520.323706 secs 2023-05-08T14:09:42.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:42 smithi186 ceph-mon[126480]: pgmap v20065: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 421 KiB/s rd, 823 KiB/s wr, 10 op/s 2023-05-08T14:09:42.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:42 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37520.323706 secs 2023-05-08T14:09:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:42 smithi133 ceph-mon[125939]: pgmap v20065: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 421 KiB/s rd, 823 KiB/s wr, 10 op/s 2023-05-08T14:09:42.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:42 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37520.323706 secs 2023-05-08T14:09:42.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:42 smithi096 ceph-mon[124666]: pgmap v20065: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 421 KiB/s rd, 823 KiB/s wr, 10 op/s 2023-05-08T14:09:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:44 smithi186 ceph-mon[126480]: pgmap v20066: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 411 KiB/s rd, 803 KiB/s wr, 10 op/s 2023-05-08T14:09:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37523.428613 secs 2023-05-08T14:09:44.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:44 smithi133 ceph-mon[125939]: pgmap v20066: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 411 KiB/s rd, 803 KiB/s wr, 10 op/s 2023-05-08T14:09:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37523.428613 secs 2023-05-08T14:09:44.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:44 smithi096 ceph-mon[124666]: pgmap v20066: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 411 KiB/s rd, 803 KiB/s wr, 10 op/s 2023-05-08T14:09:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37523.428613 secs 2023-05-08T14:09:45.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37523.982875 secs 2023-05-08T14:09:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37523.982875 secs 2023-05-08T14:09:45.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37523.982875 secs 2023-05-08T14:09:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:46 smithi186 ceph-mon[126480]: pgmap v20067: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 689 KiB/s rd, 686 KiB/s wr, 12 op/s 2023-05-08T14:09:46.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:46 smithi133 ceph-mon[125939]: pgmap v20067: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 689 KiB/s rd, 686 KiB/s wr, 12 op/s 2023-05-08T14:09:46.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:46 smithi096 ceph-mon[124666]: pgmap v20067: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 689 KiB/s rd, 686 KiB/s wr, 12 op/s 2023-05-08T14:09:48.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:48 smithi186 ceph-mon[126480]: pgmap v20068: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 561 KiB/s rd, 558 KiB/s wr, 8 op/s 2023-05-08T14:09:48.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:48 smithi133 ceph-mon[125939]: pgmap v20068: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 561 KiB/s rd, 558 KiB/s wr, 8 op/s 2023-05-08T14:09:48.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:48 smithi096 ceph-mon[124666]: pgmap v20068: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 561 KiB/s rd, 558 KiB/s wr, 8 op/s 2023-05-08T14:09:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37528.428736 secs 2023-05-08T14:09:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:09:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37528.428736 secs 2023-05-08T14:09:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:09:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37528.428736 secs 2023-05-08T14:09:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:09:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37528.982976 secs 2023-05-08T14:09:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:50 smithi186 ceph-mon[126480]: pgmap v20069: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 781 KiB/s rd, 677 KiB/s wr, 11 op/s 2023-05-08T14:09:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:09:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:09:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:09:50.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37528.982976 secs 2023-05-08T14:09:50.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:50 smithi133 ceph-mon[125939]: pgmap v20069: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 781 KiB/s rd, 677 KiB/s wr, 11 op/s 2023-05-08T14:09:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:09:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:09:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:09:50.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37528.982976 secs 2023-05-08T14:09:50.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:50 smithi096 ceph-mon[124666]: pgmap v20069: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 781 KiB/s rd, 677 KiB/s wr, 11 op/s 2023-05-08T14:09:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:09:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:09:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:09:52.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:52 smithi186 ceph-mon[126480]: pgmap v20070: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 780 KiB/s rd, 339 KiB/s wr, 7 op/s 2023-05-08T14:09:52.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:52 smithi133 ceph-mon[125939]: pgmap v20070: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 780 KiB/s rd, 339 KiB/s wr, 7 op/s 2023-05-08T14:09:52.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:52 smithi096 ceph-mon[124666]: pgmap v20070: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 780 KiB/s rd, 339 KiB/s wr, 7 op/s 2023-05-08T14:09:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:54 smithi186 ceph-mon[126480]: pgmap v20071: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 780 KiB/s rd, 339 KiB/s wr, 7 op/s 2023-05-08T14:09:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37533.428824 secs 2023-05-08T14:09:54.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:54 smithi133 ceph-mon[125939]: pgmap v20071: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 780 KiB/s rd, 339 KiB/s wr, 7 op/s 2023-05-08T14:09:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37533.428824 secs 2023-05-08T14:09:54.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:54 smithi096 ceph-mon[124666]: pgmap v20071: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 780 KiB/s rd, 339 KiB/s wr, 7 op/s 2023-05-08T14:09:54.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37533.428824 secs 2023-05-08T14:09:56.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:56 smithi186 ceph-mon[126480]: pgmap v20072: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 877 KiB/s wr, 11 op/s 2023-05-08T14:09:56.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:56 smithi133 ceph-mon[125939]: pgmap v20072: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 877 KiB/s wr, 11 op/s 2023-05-08T14:09:56.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:56 smithi096 ceph-mon[124666]: pgmap v20072: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 877 KiB/s wr, 11 op/s 2023-05-08T14:09:57.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:09:57.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:09:57.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:09:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:58 smithi186 ceph-mon[126480]: pgmap v20073: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 980 KiB/s rd, 877 KiB/s wr, 8 op/s 2023-05-08T14:09:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:58 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:09:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:09:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:09:58.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:58 smithi133 ceph-mon[125939]: pgmap v20073: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 980 KiB/s rd, 877 KiB/s wr, 8 op/s 2023-05-08T14:09:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:58 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:09:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:09:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:09:58.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:58 smithi096 ceph-mon[124666]: pgmap v20073: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 980 KiB/s rd, 877 KiB/s wr, 8 op/s 2023-05-08T14:09:58.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:58 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:09:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:09:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:09:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:09:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37538.428888 secs 2023-05-08T14:09:59.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:09:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37538.428888 secs 2023-05-08T14:09:59.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:09:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37538.428888 secs 2023-05-08T14:10:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:00 smithi186 ceph-mon[126480]: pgmap v20074: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2023-05-08T14:10:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:00 smithi186 ceph-mon[126480]: overall HEALTH_WARN 1 MDSs report slow requests 2023-05-08T14:10:00.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:00 smithi133 ceph-mon[125939]: pgmap v20074: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2023-05-08T14:10:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:00 smithi133 ceph-mon[125939]: overall HEALTH_WARN 1 MDSs report slow requests 2023-05-08T14:10:00.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:00 smithi096 ceph-mon[124666]: pgmap v20074: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2023-05-08T14:10:00.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:00 smithi096 ceph-mon[124666]: overall HEALTH_WARN 1 MDSs report slow requests 2023-05-08T14:10:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:02 smithi186 ceph-mon[126480]: pgmap v20075: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T14:10:02.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:02 smithi133 ceph-mon[125939]: pgmap v20075: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T14:10:02.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:02 smithi096 ceph-mon[124666]: pgmap v20075: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T14:10:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:04 smithi186 ceph-mon[126480]: pgmap v20076: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T14:10:04.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37543.429007 secs 2023-05-08T14:10:04.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:04 smithi133 ceph-mon[125939]: pgmap v20076: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T14:10:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37543.429007 secs 2023-05-08T14:10:04.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:04 smithi096 ceph-mon[124666]: pgmap v20076: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T14:10:04.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37543.429007 secs 2023-05-08T14:10:05.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37543.983326 secs 2023-05-08T14:10:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:05 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:10:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:10:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:10:05.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37543.983326 secs 2023-05-08T14:10:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:05 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:10:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:10:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:10:05.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37543.983326 secs 2023-05-08T14:10:05.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:05 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:10:05.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:10:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:10:06.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:06 smithi133 ceph-mon[125939]: pgmap v20077: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.9 MiB/s wr, 28 op/s 2023-05-08T14:10:06.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:06 smithi096 ceph-mon[124666]: pgmap v20077: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.9 MiB/s wr, 28 op/s 2023-05-08T14:10:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:06 smithi186 ceph-mon[126480]: pgmap v20077: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.9 MiB/s wr, 28 op/s 2023-05-08T14:10:08.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:08 smithi186 ceph-mon[126480]: pgmap v20078: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 23 op/s 2023-05-08T14:10:08.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:08 smithi133 ceph-mon[125939]: pgmap v20078: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 23 op/s 2023-05-08T14:10:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:08 smithi096 ceph-mon[124666]: pgmap v20078: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 23 op/s 2023-05-08T14:10:09.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37548.429098 secs 2023-05-08T14:10:09.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37548.429098 secs 2023-05-08T14:10:09.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37548.429098 secs 2023-05-08T14:10:10.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37548.983419 secs 2023-05-08T14:10:10.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:10 smithi186 ceph-mon[126480]: pgmap v20079: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 27 op/s 2023-05-08T14:10:10.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37548.983419 secs 2023-05-08T14:10:10.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:10 smithi133 ceph-mon[125939]: pgmap v20079: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 27 op/s 2023-05-08T14:10:10.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37548.983419 secs 2023-05-08T14:10:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:10 smithi096 ceph-mon[124666]: pgmap v20079: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 27 op/s 2023-05-08T14:10:12.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:12 smithi186 ceph-mon[126480]: pgmap v20080: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1009 KiB/s rd, 825 KiB/s wr, 22 op/s 2023-05-08T14:10:12.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:12 smithi133 ceph-mon[125939]: pgmap v20080: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1009 KiB/s rd, 825 KiB/s wr, 22 op/s 2023-05-08T14:10:12.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:12 smithi096 ceph-mon[124666]: pgmap v20080: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1009 KiB/s rd, 825 KiB/s wr, 22 op/s 2023-05-08T14:10:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:14 smithi186 ceph-mon[126480]: pgmap v20081: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1009 KiB/s rd, 825 KiB/s wr, 22 op/s 2023-05-08T14:10:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37553.429219 secs 2023-05-08T14:10:14.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:14 smithi133 ceph-mon[125939]: pgmap v20081: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1009 KiB/s rd, 825 KiB/s wr, 22 op/s 2023-05-08T14:10:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37553.429219 secs 2023-05-08T14:10:14.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:14 smithi096 ceph-mon[124666]: pgmap v20081: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1009 KiB/s rd, 825 KiB/s wr, 22 op/s 2023-05-08T14:10:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37553.429219 secs 2023-05-08T14:10:15.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37553.983581 secs 2023-05-08T14:10:15.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37553.983581 secs 2023-05-08T14:10:15.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37553.983581 secs 2023-05-08T14:10:16.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:16 smithi186 ceph-mon[126480]: pgmap v20082: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 25 op/s 2023-05-08T14:10:16.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:16 smithi133 ceph-mon[125939]: pgmap v20082: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 25 op/s 2023-05-08T14:10:16.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:16 smithi096 ceph-mon[124666]: pgmap v20082: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 25 op/s 2023-05-08T14:10:18.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:18 smithi186 ceph-mon[126480]: pgmap v20083: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 525 KiB/s wr, 7 op/s 2023-05-08T14:10:18.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:18 smithi133 ceph-mon[125939]: pgmap v20083: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 525 KiB/s wr, 7 op/s 2023-05-08T14:10:18.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:18 smithi096 ceph-mon[124666]: pgmap v20083: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 525 KiB/s wr, 7 op/s 2023-05-08T14:10:19.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37558.429316 secs 2023-05-08T14:10:19.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37558.429316 secs 2023-05-08T14:10:19.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37558.429316 secs 2023-05-08T14:10:20.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37558.983643 secs 2023-05-08T14:10:20.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:20 smithi186 ceph-mon[126480]: pgmap v20084: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 529 KiB/s rd, 526 KiB/s wr, 11 op/s 2023-05-08T14:10:20.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37558.983643 secs 2023-05-08T14:10:20.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:20 smithi133 ceph-mon[125939]: pgmap v20084: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 529 KiB/s rd, 526 KiB/s wr, 11 op/s 2023-05-08T14:10:20.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37558.983643 secs 2023-05-08T14:10:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:20 smithi096 ceph-mon[124666]: pgmap v20084: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 529 KiB/s rd, 526 KiB/s wr, 11 op/s 2023-05-08T14:10:22.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:22 smithi186 ceph-mon[126480]: pgmap v20085: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 521 KiB/s wr, 7 op/s 2023-05-08T14:10:22.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:22 smithi133 ceph-mon[125939]: pgmap v20085: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 521 KiB/s wr, 7 op/s 2023-05-08T14:10:22.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:22 smithi096 ceph-mon[124666]: pgmap v20085: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 521 KiB/s wr, 7 op/s 2023-05-08T14:10:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:24 smithi186 ceph-mon[126480]: pgmap v20086: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 521 KiB/s wr, 7 op/s 2023-05-08T14:10:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37563.429440 secs 2023-05-08T14:10:24.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:24 smithi133 ceph-mon[125939]: pgmap v20086: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 521 KiB/s wr, 7 op/s 2023-05-08T14:10:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37563.429440 secs 2023-05-08T14:10:24.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:24 smithi096 ceph-mon[124666]: pgmap v20086: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 521 KiB/s wr, 7 op/s 2023-05-08T14:10:24.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37563.429440 secs 2023-05-08T14:10:25.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:25 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:10:25.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:25 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:10:25.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:25 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:10:26.452 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:26 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:10:26.453 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:26 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:10:26.453 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:26 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:10:26.453 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:26 smithi133 ceph-mon[125939]: pgmap v20087: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2023-05-08T14:10:26.453 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:10:26.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:26 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:10:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:26 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:10:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:26 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:10:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:26 smithi096 ceph-mon[124666]: pgmap v20087: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2023-05-08T14:10:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:10:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:26 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:10:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:26 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:10:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:26 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:10:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:26 smithi186 ceph-mon[126480]: pgmap v20087: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2023-05-08T14:10:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:10:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:27 smithi133 ceph-mon[125939]: osdmap e1332: 12 total, 12 up, 12 in 2023-05-08T14:10:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:10:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:10:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:10:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:10:27.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:10:27.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:10:27.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:27 smithi096 ceph-mon[124666]: osdmap e1332: 12 total, 12 up, 12 in 2023-05-08T14:10:27.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:10:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:10:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:10:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:10:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:10:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:10:27.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:27 smithi186 ceph-mon[126480]: osdmap e1332: 12 total, 12 up, 12 in 2023-05-08T14:10:27.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:10:27.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:10:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:10:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:10:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:10:27.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:10:28.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:28 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:10:28.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:28 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:10:28.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:28 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:10:28.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:28 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:10:28.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:28 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T14:10:28.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:28 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T14:10:28.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:28 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:10:28.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:28 smithi133 ceph-mon[125939]: pgmap v20089: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T14:10:28.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:28 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:10:28.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:28 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:10:28.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:28 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:10:28.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:28 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:10:28.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:28 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T14:10:28.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:28 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T14:10:28.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:28 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:10:28.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:28 smithi096 ceph-mon[124666]: pgmap v20089: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T14:10:28.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:28 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:10:28.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:28 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:10:28.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:28 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:10:28.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:28 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:10:28.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:28 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T14:10:28.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:28 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T14:10:28.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:28 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:10:28.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:28 smithi186 ceph-mon[126480]: pgmap v20089: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T14:10:29.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37568.429560 secs 2023-05-08T14:10:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37568.429560 secs 2023-05-08T14:10:29.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37568.429560 secs 2023-05-08T14:10:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:30 smithi186 ceph-mon[126480]: pgmap v20090: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 14 op/s 2023-05-08T14:10:30.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:30 smithi133 ceph-mon[125939]: pgmap v20090: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 14 op/s 2023-05-08T14:10:30.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:30 smithi096 ceph-mon[124666]: pgmap v20090: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 14 op/s 2023-05-08T14:10:32.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:32 smithi186 ceph-mon[126480]: pgmap v20091: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 14 op/s 2023-05-08T14:10:32.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:32 smithi133 ceph-mon[125939]: pgmap v20091: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 14 op/s 2023-05-08T14:10:32.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:32 smithi096 ceph-mon[124666]: pgmap v20091: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 14 op/s 2023-05-08T14:10:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:34 smithi186 ceph-mon[126480]: osdmap e1333: 12 total, 12 up, 12 in 2023-05-08T14:10:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:34 smithi186 ceph-mon[126480]: pgmap v20093: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 947 KiB/s wr, 8 op/s 2023-05-08T14:10:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37573.429666 secs 2023-05-08T14:10:34.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:34 smithi133 ceph-mon[125939]: osdmap e1333: 12 total, 12 up, 12 in 2023-05-08T14:10:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:34 smithi133 ceph-mon[125939]: pgmap v20093: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 947 KiB/s wr, 8 op/s 2023-05-08T14:10:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37573.429666 secs 2023-05-08T14:10:34.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:34 smithi096 ceph-mon[124666]: osdmap e1333: 12 total, 12 up, 12 in 2023-05-08T14:10:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:34 smithi096 ceph-mon[124666]: pgmap v20093: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 947 KiB/s wr, 8 op/s 2023-05-08T14:10:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37573.429666 secs 2023-05-08T14:10:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:36 smithi186 ceph-mon[126480]: pgmap v20094: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 871 KiB/s rd, 591 KiB/s wr, 11 op/s 2023-05-08T14:10:36.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:36 smithi133 ceph-mon[125939]: pgmap v20094: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 871 KiB/s rd, 591 KiB/s wr, 11 op/s 2023-05-08T14:10:36.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:36 smithi096 ceph-mon[124666]: pgmap v20094: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 871 KiB/s rd, 591 KiB/s wr, 11 op/s 2023-05-08T14:10:38.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:38 smithi186 ceph-mon[126480]: pgmap v20095: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 793 KiB/s rd, 538 KiB/s wr, 10 op/s 2023-05-08T14:10:38.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:38 smithi133 ceph-mon[125939]: pgmap v20095: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 793 KiB/s rd, 538 KiB/s wr, 10 op/s 2023-05-08T14:10:38.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:38 smithi096 ceph-mon[124666]: pgmap v20095: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 793 KiB/s rd, 538 KiB/s wr, 10 op/s 2023-05-08T14:10:39.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37578.429791 secs 2023-05-08T14:10:39.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37578.429791 secs 2023-05-08T14:10:39.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37578.429791 secs 2023-05-08T14:10:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:40 smithi186 ceph-mon[126480]: pgmap v20096: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 191 KiB/s wr, 9 op/s 2023-05-08T14:10:40.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:40 smithi133 ceph-mon[125939]: pgmap v20096: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 191 KiB/s wr, 9 op/s 2023-05-08T14:10:40.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:40 smithi096 ceph-mon[124666]: pgmap v20096: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 191 KiB/s wr, 9 op/s 2023-05-08T14:10:41.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:41 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:10:41.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:41 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:10:41.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:41 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:10:41.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:41 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:10:41.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:41 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:10:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:41 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:10:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:41 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:10:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:41 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:10:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:41 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:10:42.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:42 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37580.325052 secs 2023-05-08T14:10:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:42 smithi133 ceph-mon[125939]: pgmap v20097: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 191 KiB/s wr, 10 op/s 2023-05-08T14:10:42.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:42 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37580.325052 secs 2023-05-08T14:10:42.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:42 smithi096 ceph-mon[124666]: pgmap v20097: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 191 KiB/s wr, 10 op/s 2023-05-08T14:10:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:42 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37580.325052 secs 2023-05-08T14:10:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:42 smithi186 ceph-mon[126480]: pgmap v20097: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 191 KiB/s wr, 10 op/s 2023-05-08T14:10:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:44 smithi186 ceph-mon[126480]: pgmap v20098: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 186 KiB/s wr, 9 op/s 2023-05-08T14:10:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37583.429839 secs 2023-05-08T14:10:44.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:44 smithi133 ceph-mon[125939]: pgmap v20098: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 186 KiB/s wr, 9 op/s 2023-05-08T14:10:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37583.429839 secs 2023-05-08T14:10:44.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:44 smithi096 ceph-mon[124666]: pgmap v20098: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 186 KiB/s wr, 9 op/s 2023-05-08T14:10:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37583.429839 secs 2023-05-08T14:10:46.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37583.984179 secs 2023-05-08T14:10:46.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:46 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:10:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:46 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:10:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:46 smithi133 ceph-mon[125939]: pgmap v20099: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2023-05-08T14:10:46.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37583.984179 secs 2023-05-08T14:10:46.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:46 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:10:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:46 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:10:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:46 smithi096 ceph-mon[124666]: pgmap v20099: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2023-05-08T14:10:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37583.984179 secs 2023-05-08T14:10:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:46 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:10:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:46 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:10:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:46 smithi186 ceph-mon[126480]: pgmap v20099: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2023-05-08T14:10:48.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:48 smithi186 ceph-mon[126480]: pgmap v20100: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T14:10:48.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:48 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:10:48.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:48 smithi133 ceph-mon[125939]: pgmap v20100: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T14:10:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:48 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:10:48.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:48 smithi096 ceph-mon[124666]: pgmap v20100: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T14:10:48.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:48 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:10:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37588.429961 secs 2023-05-08T14:10:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:10:49.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37588.429961 secs 2023-05-08T14:10:49.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:10:49.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37588.429961 secs 2023-05-08T14:10:49.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:10:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:50 smithi186 ceph-mon[126480]: pgmap v20101: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.3 MiB/s wr, 15 op/s 2023-05-08T14:10:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:10:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:10:50.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:50 smithi133 ceph-mon[125939]: pgmap v20101: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.3 MiB/s wr, 15 op/s 2023-05-08T14:10:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:10:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:10:50.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:50 smithi096 ceph-mon[124666]: pgmap v20101: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.3 MiB/s wr, 15 op/s 2023-05-08T14:10:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:10:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:10:52.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:52 smithi186 ceph-mon[126480]: pgmap v20102: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.3 MiB/s wr, 11 op/s 2023-05-08T14:10:52.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:52 smithi133 ceph-mon[125939]: pgmap v20102: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.3 MiB/s wr, 11 op/s 2023-05-08T14:10:52.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:52 smithi096 ceph-mon[124666]: pgmap v20102: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.3 MiB/s wr, 11 op/s 2023-05-08T14:10:53.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:53 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:10:53.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:53 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:10:53.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:53 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:10:53.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:53 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:10:53.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:53 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:10:53.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:53 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:10:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:54 smithi186 ceph-mon[126480]: pgmap v20103: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.3 MiB/s wr, 11 op/s 2023-05-08T14:10:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37593.430069 secs 2023-05-08T14:10:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:54 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:10:54.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:54 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:10:54.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:54 smithi133 ceph-mon[125939]: pgmap v20103: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.3 MiB/s wr, 11 op/s 2023-05-08T14:10:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37593.430069 secs 2023-05-08T14:10:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:54 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:10:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:54 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:10:54.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:54 smithi096 ceph-mon[124666]: pgmap v20103: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.3 MiB/s wr, 11 op/s 2023-05-08T14:10:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37593.430069 secs 2023-05-08T14:10:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:54 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:10:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:54 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:10:56.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:56 smithi133 ceph-mon[125939]: pgmap v20104: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.8 MiB/s wr, 18 op/s 2023-05-08T14:10:56.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:56 smithi096 ceph-mon[124666]: pgmap v20104: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.8 MiB/s wr, 18 op/s 2023-05-08T14:10:56.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:56 smithi186 ceph-mon[126480]: pgmap v20104: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.8 MiB/s wr, 18 op/s 2023-05-08T14:10:58.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:58 smithi133 ceph-mon[125939]: pgmap v20105: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 12 op/s 2023-05-08T14:10:58.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:58 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:10:58.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:58 smithi096 ceph-mon[124666]: pgmap v20105: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 12 op/s 2023-05-08T14:10:58.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:58 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:10:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:58 smithi186 ceph-mon[126480]: pgmap v20105: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 12 op/s 2023-05-08T14:10:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:58 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:10:59.745 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:10:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37598.430186 secs 2023-05-08T14:10:59.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:10:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37598.430186 secs 2023-05-08T14:10:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:10:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37598.430186 secs 2023-05-08T14:11:00.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37598.984551 secs 2023-05-08T14:11:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:00 smithi133 ceph-mon[125939]: pgmap v20106: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.4 MiB/s wr, 17 op/s 2023-05-08T14:11:00.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37598.984551 secs 2023-05-08T14:11:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:00 smithi096 ceph-mon[124666]: pgmap v20106: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.4 MiB/s wr, 17 op/s 2023-05-08T14:11:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37598.984551 secs 2023-05-08T14:11:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:00 smithi186 ceph-mon[126480]: pgmap v20106: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.4 MiB/s wr, 17 op/s 2023-05-08T14:11:02.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:02 smithi133 ceph-mon[125939]: pgmap v20107: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T14:11:02.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:11:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:11:02.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:02 smithi096 ceph-mon[124666]: pgmap v20107: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T14:11:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:11:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:11:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:02 smithi186 ceph-mon[126480]: pgmap v20107: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T14:11:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:11:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:11:03.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:03 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:11:03.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:03 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:11:03.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:03 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:11:04.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:04 smithi133 ceph-mon[125939]: pgmap v20108: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T14:11:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37603.430307 secs 2023-05-08T14:11:04.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:04 smithi096 ceph-mon[124666]: pgmap v20108: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T14:11:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37603.430307 secs 2023-05-08T14:11:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:04 smithi186 ceph-mon[126480]: pgmap v20108: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T14:11:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37603.430307 secs 2023-05-08T14:11:05.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:05 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:11:05.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:05 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:11:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:05 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:11:06.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:06 smithi133 ceph-mon[125939]: pgmap v20109: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.1 MiB/s wr, 29 op/s 2023-05-08T14:11:06.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:11:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:11:06.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:06 smithi096 ceph-mon[124666]: pgmap v20109: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.1 MiB/s wr, 29 op/s 2023-05-08T14:11:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:11:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:11:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:06 smithi186 ceph-mon[126480]: pgmap v20109: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.1 MiB/s wr, 29 op/s 2023-05-08T14:11:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:11:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:11:08.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:08 smithi133 ceph-mon[125939]: pgmap v20110: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 22 op/s 2023-05-08T14:11:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:08 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:11:08.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:08 smithi096 ceph-mon[124666]: pgmap v20110: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 22 op/s 2023-05-08T14:11:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:08 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:11:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:08 smithi186 ceph-mon[126480]: pgmap v20110: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 22 op/s 2023-05-08T14:11:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:08 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:11:09.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37608.430453 secs 2023-05-08T14:11:09.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37608.430453 secs 2023-05-08T14:11:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37608.430453 secs 2023-05-08T14:11:10.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:10 smithi133 ceph-mon[125939]: pgmap v20111: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.3 MiB/s wr, 27 op/s 2023-05-08T14:11:10.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:10 smithi096 ceph-mon[124666]: pgmap v20111: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.3 MiB/s wr, 27 op/s 2023-05-08T14:11:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:10 smithi186 ceph-mon[126480]: pgmap v20111: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.3 MiB/s wr, 27 op/s 2023-05-08T14:11:12.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:12 smithi133 ceph-mon[125939]: pgmap v20112: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 22 op/s 2023-05-08T14:11:12.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:12 smithi096 ceph-mon[124666]: pgmap v20112: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 22 op/s 2023-05-08T14:11:12.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:12 smithi186 ceph-mon[126480]: pgmap v20112: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 22 op/s 2023-05-08T14:11:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:14 smithi186 ceph-mon[126480]: pgmap v20113: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 22 op/s 2023-05-08T14:11:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37613.430586 secs 2023-05-08T14:11:14.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:14 smithi133 ceph-mon[125939]: pgmap v20113: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 22 op/s 2023-05-08T14:11:14.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37613.430586 secs 2023-05-08T14:11:14.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:14 smithi096 ceph-mon[124666]: pgmap v20113: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 22 op/s 2023-05-08T14:11:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37613.430586 secs 2023-05-08T14:11:16.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:16 smithi186 ceph-mon[126480]: pgmap v20114: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.8 MiB/s wr, 25 op/s 2023-05-08T14:11:16.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:16 smithi133 ceph-mon[125939]: pgmap v20114: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.8 MiB/s wr, 25 op/s 2023-05-08T14:11:16.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:16 smithi096 ceph-mon[124666]: pgmap v20114: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.8 MiB/s wr, 25 op/s 2023-05-08T14:11:18.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:18 smithi186 ceph-mon[126480]: pgmap v20115: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 819 KiB/s wr, 8 op/s 2023-05-08T14:11:18.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:18 smithi133 ceph-mon[125939]: pgmap v20115: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 819 KiB/s wr, 8 op/s 2023-05-08T14:11:18.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:18 smithi096 ceph-mon[124666]: pgmap v20115: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 819 KiB/s wr, 8 op/s 2023-05-08T14:11:19.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37618.430711 secs 2023-05-08T14:11:19.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37618.430711 secs 2023-05-08T14:11:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37618.430711 secs 2023-05-08T14:11:20.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:20 smithi133 ceph-mon[125939]: pgmap v20116: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 820 KiB/s wr, 11 op/s 2023-05-08T14:11:20.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:20 smithi096 ceph-mon[124666]: pgmap v20116: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 820 KiB/s wr, 11 op/s 2023-05-08T14:11:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:20 smithi186 ceph-mon[126480]: pgmap v20116: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 820 KiB/s wr, 11 op/s 2023-05-08T14:11:21.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:21 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:11:21.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:21 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:11:21.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:21 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:11:21.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:21 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:11:21.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:21 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:11:21.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:21 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:11:21.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:21 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:11:21.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:21 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:11:21.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:21 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:11:22.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:22 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37620.325918 secs 2023-05-08T14:11:22.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:22 smithi133 ceph-mon[125939]: pgmap v20117: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 159 KiB/s wr, 6 op/s 2023-05-08T14:11:22.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:22 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37620.325918 secs 2023-05-08T14:11:22.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:22 smithi096 ceph-mon[124666]: pgmap v20117: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 159 KiB/s wr, 6 op/s 2023-05-08T14:11:22.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:22 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37620.325918 secs 2023-05-08T14:11:22.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:22 smithi186 ceph-mon[126480]: pgmap v20117: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 159 KiB/s wr, 6 op/s 2023-05-08T14:11:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:24 smithi186 ceph-mon[126480]: pgmap v20118: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 159 KiB/s wr, 6 op/s 2023-05-08T14:11:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37623.430830 secs 2023-05-08T14:11:24.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:24 smithi133 ceph-mon[125939]: pgmap v20118: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 159 KiB/s wr, 6 op/s 2023-05-08T14:11:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37623.430830 secs 2023-05-08T14:11:24.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:24 smithi096 ceph-mon[124666]: pgmap v20118: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 159 KiB/s wr, 6 op/s 2023-05-08T14:11:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37623.430830 secs 2023-05-08T14:11:26.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37623.985153 secs 2023-05-08T14:11:26.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:26 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:11:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:26 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:11:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:26 smithi133 ceph-mon[125939]: pgmap v20119: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 974 KiB/s rd, 963 KiB/s wr, 15 op/s 2023-05-08T14:11:26.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37623.985153 secs 2023-05-08T14:11:26.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:26 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:11:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:26 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:11:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:26 smithi096 ceph-mon[124666]: pgmap v20119: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 974 KiB/s rd, 963 KiB/s wr, 15 op/s 2023-05-08T14:11:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37623.985153 secs 2023-05-08T14:11:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:26 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:11:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:26 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:11:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:26 smithi186 ceph-mon[126480]: pgmap v20119: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 974 KiB/s rd, 963 KiB/s wr, 15 op/s 2023-05-08T14:11:27.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:27 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37625.326037 secs 2023-05-08T14:11:27.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:27 smithi133 ceph-mon[125939]: osdmap e1334: 12 total, 12 up, 12 in 2023-05-08T14:11:27.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:27 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37625.326037 secs 2023-05-08T14:11:27.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:27 smithi096 ceph-mon[124666]: osdmap e1334: 12 total, 12 up, 12 in 2023-05-08T14:11:27.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:27 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37625.326037 secs 2023-05-08T14:11:27.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:27 smithi186 ceph-mon[126480]: osdmap e1334: 12 total, 12 up, 12 in 2023-05-08T14:11:28.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:28 smithi133 ceph-mon[125939]: pgmap v20121: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 977 KiB/s rd, 965 KiB/s wr, 13 op/s 2023-05-08T14:11:28.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:28 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:11:28.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:28 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:11:28.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:28 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:11:28.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:28 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:11:28.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:28 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:11:28.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:28 smithi096 ceph-mon[124666]: pgmap v20121: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 977 KiB/s rd, 965 KiB/s wr, 13 op/s 2023-05-08T14:11:28.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:28 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:11:28.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:28 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:11:28.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:28 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:11:28.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:28 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:11:28.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:28 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:11:28.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:28 smithi186 ceph-mon[126480]: pgmap v20121: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 977 KiB/s rd, 965 KiB/s wr, 13 op/s 2023-05-08T14:11:28.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:28 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:11:28.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:28 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:11:28.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:28 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:11:28.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:28 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:11:28.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:28 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:11:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:29 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:11:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:29 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T14:11:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:29 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T14:11:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:29 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:11:29.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37628.430967 secs 2023-05-08T14:11:29.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:29 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:11:29.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:29 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T14:11:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:29 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T14:11:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:29 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:11:29.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37628.430967 secs 2023-05-08T14:11:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:29 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:11:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:29 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T14:11:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:29 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T14:11:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:29 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:11:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37628.430967 secs 2023-05-08T14:11:30.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:30 smithi133 ceph-mon[125939]: pgmap v20122: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 15 op/s 2023-05-08T14:11:30.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:30 smithi096 ceph-mon[124666]: pgmap v20122: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 15 op/s 2023-05-08T14:11:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:30 smithi186 ceph-mon[126480]: pgmap v20122: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 15 op/s 2023-05-08T14:11:31.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37628.985274 secs 2023-05-08T14:11:31.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37628.985274 secs 2023-05-08T14:11:31.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37628.985274 secs 2023-05-08T14:11:32.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:32 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37630.326191 secs 2023-05-08T14:11:32.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:32 smithi133 ceph-mon[125939]: pgmap v20123: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 15 op/s 2023-05-08T14:11:32.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:32 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37630.326191 secs 2023-05-08T14:11:32.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:32 smithi096 ceph-mon[124666]: pgmap v20123: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 15 op/s 2023-05-08T14:11:32.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:32 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37630.326191 secs 2023-05-08T14:11:32.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:32 smithi186 ceph-mon[126480]: pgmap v20123: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 15 op/s 2023-05-08T14:11:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:34 smithi186 ceph-mon[126480]: osdmap e1335: 12 total, 12 up, 12 in 2023-05-08T14:11:34.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:34 smithi186 ceph-mon[126480]: pgmap v20125: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 303 KiB/s wr, 7 op/s 2023-05-08T14:11:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37633.431090 secs 2023-05-08T14:11:34.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:34 smithi133 ceph-mon[125939]: osdmap e1335: 12 total, 12 up, 12 in 2023-05-08T14:11:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:34 smithi133 ceph-mon[125939]: pgmap v20125: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 303 KiB/s wr, 7 op/s 2023-05-08T14:11:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37633.431090 secs 2023-05-08T14:11:34.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:34 smithi096 ceph-mon[124666]: osdmap e1335: 12 total, 12 up, 12 in 2023-05-08T14:11:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:34 smithi096 ceph-mon[124666]: pgmap v20125: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 303 KiB/s wr, 7 op/s 2023-05-08T14:11:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37633.431090 secs 2023-05-08T14:11:35.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37633.985393 secs 2023-05-08T14:11:35.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37633.985393 secs 2023-05-08T14:11:35.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37633.985393 secs 2023-05-08T14:11:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:36 smithi186 ceph-mon[126480]: pgmap v20126: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 783 KiB/s rd, 745 KiB/s wr, 12 op/s 2023-05-08T14:11:36.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:36 smithi133 ceph-mon[125939]: pgmap v20126: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 783 KiB/s rd, 745 KiB/s wr, 12 op/s 2023-05-08T14:11:36.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:36 smithi096 ceph-mon[124666]: pgmap v20126: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 783 KiB/s rd, 745 KiB/s wr, 12 op/s 2023-05-08T14:11:37.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:37 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37635.326347 secs 2023-05-08T14:11:37.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:37 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37635.326347 secs 2023-05-08T14:11:37.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:37 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37635.326347 secs 2023-05-08T14:11:38.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:38 smithi186 ceph-mon[126480]: pgmap v20127: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 714 KiB/s rd, 679 KiB/s wr, 11 op/s 2023-05-08T14:11:38.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:38 smithi133 ceph-mon[125939]: pgmap v20127: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 714 KiB/s rd, 679 KiB/s wr, 11 op/s 2023-05-08T14:11:38.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:38 smithi096 ceph-mon[124666]: pgmap v20127: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 714 KiB/s rd, 679 KiB/s wr, 11 op/s 2023-05-08T14:11:39.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37638.431241 secs 2023-05-08T14:11:39.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37638.431241 secs 2023-05-08T14:11:39.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37638.431241 secs 2023-05-08T14:11:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37638.985513 secs 2023-05-08T14:11:40.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:40 smithi186 ceph-mon[126480]: pgmap v20128: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 1.1 MiB/s wr, 9 op/s 2023-05-08T14:11:40.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37638.985513 secs 2023-05-08T14:11:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:40 smithi133 ceph-mon[125939]: pgmap v20128: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 1.1 MiB/s wr, 9 op/s 2023-05-08T14:11:40.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37638.985513 secs 2023-05-08T14:11:40.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:40 smithi096 ceph-mon[124666]: pgmap v20128: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 1.1 MiB/s wr, 9 op/s 2023-05-08T14:11:42.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:42 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37640.326466 secs 2023-05-08T14:11:42.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:42 smithi133 ceph-mon[125939]: pgmap v20129: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 1.1 MiB/s wr, 9 op/s 2023-05-08T14:11:42.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:42 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37640.326466 secs 2023-05-08T14:11:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:42 smithi096 ceph-mon[124666]: pgmap v20129: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 1.1 MiB/s wr, 9 op/s 2023-05-08T14:11:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:42 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37640.326466 secs 2023-05-08T14:11:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:42 smithi186 ceph-mon[126480]: pgmap v20129: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 1.1 MiB/s wr, 9 op/s 2023-05-08T14:11:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:44 smithi186 ceph-mon[126480]: pgmap v20130: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 1.0 MiB/s wr, 9 op/s 2023-05-08T14:11:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37643.431391 secs 2023-05-08T14:11:44.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:44 smithi133 ceph-mon[125939]: pgmap v20130: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 1.0 MiB/s wr, 9 op/s 2023-05-08T14:11:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37643.431391 secs 2023-05-08T14:11:44.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:44 smithi096 ceph-mon[124666]: pgmap v20130: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 1.0 MiB/s wr, 9 op/s 2023-05-08T14:11:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37643.431391 secs 2023-05-08T14:11:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37643.985635 secs 2023-05-08T14:11:45.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37643.985635 secs 2023-05-08T14:11:45.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37643.985635 secs 2023-05-08T14:11:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:46 smithi186 ceph-mon[126480]: pgmap v20131: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 925 KiB/s rd, 911 KiB/s wr, 12 op/s 2023-05-08T14:11:46.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:46 smithi133 ceph-mon[125939]: pgmap v20131: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 925 KiB/s rd, 911 KiB/s wr, 12 op/s 2023-05-08T14:11:46.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:46 smithi096 ceph-mon[124666]: pgmap v20131: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 925 KiB/s rd, 911 KiB/s wr, 12 op/s 2023-05-08T14:11:48.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:48 smithi133 ceph-mon[125939]: pgmap v20132: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 549 KiB/s rd, 547 KiB/s wr, 7 op/s 2023-05-08T14:11:48.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:48 smithi096 ceph-mon[124666]: pgmap v20132: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 549 KiB/s rd, 547 KiB/s wr, 7 op/s 2023-05-08T14:11:48.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:48 smithi186 ceph-mon[126480]: pgmap v20132: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 549 KiB/s rd, 547 KiB/s wr, 7 op/s 2023-05-08T14:11:49.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37648.431510 secs 2023-05-08T14:11:49.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:11:49.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37648.431510 secs 2023-05-08T14:11:49.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:11:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37648.431510 secs 2023-05-08T14:11:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:11:50.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37648.985770 secs 2023-05-08T14:11:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:50 smithi133 ceph-mon[125939]: pgmap v20133: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 941 KiB/s wr, 11 op/s 2023-05-08T14:11:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:11:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:11:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:11:50.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37648.985770 secs 2023-05-08T14:11:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:50 smithi096 ceph-mon[124666]: pgmap v20133: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 941 KiB/s wr, 11 op/s 2023-05-08T14:11:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:11:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:11:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:11:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37648.985770 secs 2023-05-08T14:11:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:50 smithi186 ceph-mon[126480]: pgmap v20133: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 941 KiB/s wr, 11 op/s 2023-05-08T14:11:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:11:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:11:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:11:52.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:52 smithi133 ceph-mon[125939]: pgmap v20134: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 394 KiB/s wr, 8 op/s 2023-05-08T14:11:52.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:52 smithi096 ceph-mon[124666]: pgmap v20134: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 394 KiB/s wr, 8 op/s 2023-05-08T14:11:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:52 smithi186 ceph-mon[126480]: pgmap v20134: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 394 KiB/s wr, 8 op/s 2023-05-08T14:11:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:54 smithi186 ceph-mon[126480]: pgmap v20135: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 394 KiB/s wr, 8 op/s 2023-05-08T14:11:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37653.431637 secs 2023-05-08T14:11:54.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:54 smithi133 ceph-mon[125939]: pgmap v20135: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 394 KiB/s wr, 8 op/s 2023-05-08T14:11:54.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37653.431637 secs 2023-05-08T14:11:54.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:54 smithi096 ceph-mon[124666]: pgmap v20135: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 394 KiB/s wr, 8 op/s 2023-05-08T14:11:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37653.431637 secs 2023-05-08T14:11:56.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:56 smithi133 ceph-mon[125939]: pgmap v20136: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.5 MiB/s wr, 18 op/s 2023-05-08T14:11:56.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:56 smithi096 ceph-mon[124666]: pgmap v20136: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.5 MiB/s wr, 18 op/s 2023-05-08T14:11:56.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:56 smithi186 ceph-mon[126480]: pgmap v20136: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.5 MiB/s wr, 18 op/s 2023-05-08T14:11:57.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:11:57.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:11:57.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:11:58.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:58 smithi133 ceph-mon[125939]: pgmap v20137: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 13 op/s 2023-05-08T14:11:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:58 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:11:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:11:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:11:58.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:58 smithi096 ceph-mon[124666]: pgmap v20137: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 13 op/s 2023-05-08T14:11:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:58 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:11:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:11:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:11:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:58 smithi186 ceph-mon[126480]: pgmap v20137: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 13 op/s 2023-05-08T14:11:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:58 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:11:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:11:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:11:59.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:11:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37658.431757 secs 2023-05-08T14:11:59.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:11:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37658.431757 secs 2023-05-08T14:11:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:11:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37658.431757 secs 2023-05-08T14:12:00.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37658.986020 secs 2023-05-08T14:12:00.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:00 smithi133 ceph-mon[125939]: pgmap v20138: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.5 MiB/s wr, 32 op/s 2023-05-08T14:12:00.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37658.986020 secs 2023-05-08T14:12:00.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:00 smithi096 ceph-mon[124666]: pgmap v20138: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.5 MiB/s wr, 32 op/s 2023-05-08T14:12:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37658.986020 secs 2023-05-08T14:12:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:00 smithi186 ceph-mon[126480]: pgmap v20138: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.5 MiB/s wr, 32 op/s 2023-05-08T14:12:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:02 smithi133 ceph-mon[125939]: pgmap v20139: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 28 op/s 2023-05-08T14:12:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:12:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:12:02.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:02 smithi096 ceph-mon[124666]: pgmap v20139: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 28 op/s 2023-05-08T14:12:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:12:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:12:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:02 smithi186 ceph-mon[126480]: pgmap v20139: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 28 op/s 2023-05-08T14:12:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:12:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:12:03.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:03 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:12:03.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:03 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:12:03.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:03 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:12:04.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:04 smithi133 ceph-mon[125939]: pgmap v20140: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 28 op/s 2023-05-08T14:12:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37663.431850 secs 2023-05-08T14:12:04.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:04 smithi096 ceph-mon[124666]: pgmap v20140: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 28 op/s 2023-05-08T14:12:04.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37663.431850 secs 2023-05-08T14:12:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:04 smithi186 ceph-mon[126480]: pgmap v20140: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 28 op/s 2023-05-08T14:12:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37663.431850 secs 2023-05-08T14:12:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:05 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:12:05.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:05 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:12:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:05 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:12:06.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:06 smithi133 ceph-mon[125939]: pgmap v20141: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.5 MiB/s wr, 48 op/s 2023-05-08T14:12:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:12:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:12:06.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:06 smithi096 ceph-mon[124666]: pgmap v20141: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.5 MiB/s wr, 48 op/s 2023-05-08T14:12:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:12:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:12:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:06 smithi186 ceph-mon[126480]: pgmap v20141: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.5 MiB/s wr, 48 op/s 2023-05-08T14:12:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:12:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:12:08.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:08 smithi133 ceph-mon[125939]: pgmap v20142: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.4 MiB/s wr, 38 op/s 2023-05-08T14:12:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:08 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:12:08.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:08 smithi096 ceph-mon[124666]: pgmap v20142: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.4 MiB/s wr, 38 op/s 2023-05-08T14:12:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:08 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:12:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:08 smithi186 ceph-mon[126480]: pgmap v20142: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.4 MiB/s wr, 38 op/s 2023-05-08T14:12:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:08 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:12:09.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37668.431967 secs 2023-05-08T14:12:09.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37668.431967 secs 2023-05-08T14:12:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37668.431967 secs 2023-05-08T14:12:10.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:10 smithi133 ceph-mon[125939]: pgmap v20143: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.5 MiB/s wr, 42 op/s 2023-05-08T14:12:10.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:10 smithi096 ceph-mon[124666]: pgmap v20143: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.5 MiB/s wr, 42 op/s 2023-05-08T14:12:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:10 smithi186 ceph-mon[126480]: pgmap v20143: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.5 MiB/s wr, 42 op/s 2023-05-08T14:12:12.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:12 smithi133 ceph-mon[125939]: pgmap v20144: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.8 MiB/s wr, 24 op/s 2023-05-08T14:12:12.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:12 smithi096 ceph-mon[124666]: pgmap v20144: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.8 MiB/s wr, 24 op/s 2023-05-08T14:12:12.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:12 smithi186 ceph-mon[126480]: pgmap v20144: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.8 MiB/s wr, 24 op/s 2023-05-08T14:12:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:14 smithi186 ceph-mon[126480]: pgmap v20145: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.8 MiB/s wr, 24 op/s 2023-05-08T14:12:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37673.432077 secs 2023-05-08T14:12:14.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:14 smithi133 ceph-mon[125939]: pgmap v20145: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.8 MiB/s wr, 24 op/s 2023-05-08T14:12:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37673.432077 secs 2023-05-08T14:12:14.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:14 smithi096 ceph-mon[124666]: pgmap v20145: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.8 MiB/s wr, 24 op/s 2023-05-08T14:12:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37673.432077 secs 2023-05-08T14:12:16.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:16 smithi133 ceph-mon[125939]: pgmap v20146: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.0 MiB/s wr, 27 op/s 2023-05-08T14:12:16.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:16 smithi096 ceph-mon[124666]: pgmap v20146: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.0 MiB/s wr, 27 op/s 2023-05-08T14:12:16.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:16 smithi186 ceph-mon[126480]: pgmap v20146: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.0 MiB/s wr, 27 op/s 2023-05-08T14:12:18.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:18 smithi133 ceph-mon[125939]: pgmap v20147: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1011 KiB/s rd, 760 KiB/s wr, 9 op/s 2023-05-08T14:12:18.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:18 smithi096 ceph-mon[124666]: pgmap v20147: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1011 KiB/s rd, 760 KiB/s wr, 9 op/s 2023-05-08T14:12:18.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:18 smithi186 ceph-mon[126480]: pgmap v20147: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1011 KiB/s rd, 760 KiB/s wr, 9 op/s 2023-05-08T14:12:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37678.432195 secs 2023-05-08T14:12:19.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37678.432195 secs 2023-05-08T14:12:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37678.432195 secs 2023-05-08T14:12:20.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:20 smithi133 ceph-mon[125939]: pgmap v20148: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 787 KiB/s wr, 12 op/s 2023-05-08T14:12:20.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:20 smithi096 ceph-mon[124666]: pgmap v20148: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 787 KiB/s wr, 12 op/s 2023-05-08T14:12:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:20 smithi186 ceph-mon[126480]: pgmap v20148: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 787 KiB/s wr, 12 op/s 2023-05-08T14:12:22.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:22 smithi133 ceph-mon[125939]: pgmap v20149: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 676 KiB/s rd, 674 KiB/s wr, 8 op/s 2023-05-08T14:12:22.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:22 smithi096 ceph-mon[124666]: pgmap v20149: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 676 KiB/s rd, 674 KiB/s wr, 8 op/s 2023-05-08T14:12:22.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:22 smithi186 ceph-mon[126480]: pgmap v20149: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 676 KiB/s rd, 674 KiB/s wr, 8 op/s 2023-05-08T14:12:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:24 smithi186 ceph-mon[126480]: pgmap v20150: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 333 KiB/s wr, 7 op/s 2023-05-08T14:12:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37683.432352 secs 2023-05-08T14:12:24.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:24 smithi133 ceph-mon[125939]: pgmap v20150: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 333 KiB/s wr, 7 op/s 2023-05-08T14:12:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37683.432352 secs 2023-05-08T14:12:24.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:24 smithi096 ceph-mon[124666]: pgmap v20150: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 333 KiB/s wr, 7 op/s 2023-05-08T14:12:24.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37683.432352 secs 2023-05-08T14:12:25.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37683.986571 secs 2023-05-08T14:12:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:25 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:12:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:25 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:12:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:25 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:12:25.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37683.986571 secs 2023-05-08T14:12:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:25 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:12:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:25 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:12:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:25 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:12:25.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37683.986571 secs 2023-05-08T14:12:25.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:25 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:12:25.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:25 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:12:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:25 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:12:26.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:26 smithi096 ceph-mon[124666]: pgmap v20151: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 952 KiB/s rd, 971 KiB/s wr, 14 op/s 2023-05-08T14:12:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:26 smithi186 ceph-mon[126480]: pgmap v20151: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 952 KiB/s rd, 971 KiB/s wr, 14 op/s 2023-05-08T14:12:26.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:26 smithi133 ceph-mon[125939]: pgmap v20151: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 952 KiB/s rd, 971 KiB/s wr, 14 op/s 2023-05-08T14:12:27.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:27 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37685.327563 secs 2023-05-08T14:12:27.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:27 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37685.327563 secs 2023-05-08T14:12:27.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:27 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37685.327563 secs 2023-05-08T14:12:28.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:28 smithi096 ceph-mon[124666]: pgmap v20152: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 986 KiB/s rd, 1007 KiB/s wr, 11 op/s 2023-05-08T14:12:28.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:28 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:12:28.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:28 smithi186 ceph-mon[126480]: pgmap v20152: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 986 KiB/s rd, 1007 KiB/s wr, 11 op/s 2023-05-08T14:12:28.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:28 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:12:28.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:28 smithi133 ceph-mon[125939]: pgmap v20152: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 986 KiB/s rd, 1007 KiB/s wr, 11 op/s 2023-05-08T14:12:28.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:28 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:12:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37688.432451 secs 2023-05-08T14:12:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:29 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:12:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:29 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:12:29.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:29 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:12:29.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37688.432451 secs 2023-05-08T14:12:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:29 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:12:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:29 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:12:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:29 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:12:29.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37688.432451 secs 2023-05-08T14:12:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:29 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:12:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:29 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:12:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:29 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:12:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:30 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:12:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:30 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T14:12:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:30 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T14:12:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:30 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:12:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37688.986635 secs 2023-05-08T14:12:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:30 smithi186 ceph-mon[126480]: pgmap v20153: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 911 KiB/s rd, 932 KiB/s wr, 14 op/s 2023-05-08T14:12:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:30 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:12:30.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:30 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:12:30.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:30 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:12:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:30 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T14:12:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:30 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T14:12:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:30 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:12:30.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37688.986635 secs 2023-05-08T14:12:30.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:30 smithi133 ceph-mon[125939]: pgmap v20153: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 911 KiB/s rd, 932 KiB/s wr, 14 op/s 2023-05-08T14:12:30.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:30 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:12:30.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:30 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:12:30.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:30 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:12:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:30 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T14:12:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:30 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T14:12:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:30 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:12:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37688.986635 secs 2023-05-08T14:12:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:30 smithi096 ceph-mon[124666]: pgmap v20153: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 911 KiB/s rd, 932 KiB/s wr, 14 op/s 2023-05-08T14:12:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:30 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:12:30.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:30 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:12:32.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:32 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37690.327687 secs 2023-05-08T14:12:32.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:32 smithi186 ceph-mon[126480]: osdmap e1336: 12 total, 12 up, 12 in 2023-05-08T14:12:32.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:32 smithi186 ceph-mon[126480]: pgmap v20155: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T14:12:32.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:32 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37690.327687 secs 2023-05-08T14:12:32.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:32 smithi133 ceph-mon[125939]: osdmap e1336: 12 total, 12 up, 12 in 2023-05-08T14:12:32.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:32 smithi133 ceph-mon[125939]: pgmap v20155: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T14:12:32.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:32 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37690.327687 secs 2023-05-08T14:12:32.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:32 smithi096 ceph-mon[124666]: osdmap e1336: 12 total, 12 up, 12 in 2023-05-08T14:12:32.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:32 smithi096 ceph-mon[124666]: pgmap v20155: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T14:12:33.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:33 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:12:33.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:33 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:12:33.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:33 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:12:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:34 smithi186 ceph-mon[126480]: pgmap v20156: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T14:12:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37693.432572 secs 2023-05-08T14:12:34.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:34 smithi133 ceph-mon[125939]: pgmap v20156: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T14:12:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37693.432572 secs 2023-05-08T14:12:34.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:34 smithi096 ceph-mon[124666]: pgmap v20156: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T14:12:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37693.432572 secs 2023-05-08T14:12:35.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37693.986714 secs 2023-05-08T14:12:35.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37693.986714 secs 2023-05-08T14:12:35.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37693.986714 secs 2023-05-08T14:12:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:36 smithi186 ceph-mon[126480]: pgmap v20157: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 476 KiB/s wr, 10 op/s 2023-05-08T14:12:36.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:36 smithi133 ceph-mon[125939]: pgmap v20157: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 476 KiB/s wr, 10 op/s 2023-05-08T14:12:36.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:36 smithi096 ceph-mon[124666]: pgmap v20157: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 476 KiB/s wr, 10 op/s 2023-05-08T14:12:37.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:37 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37695.327806 secs 2023-05-08T14:12:37.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:37 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37695.327806 secs 2023-05-08T14:12:37.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:37 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37695.327806 secs 2023-05-08T14:12:38.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:38 smithi186 ceph-mon[126480]: pgmap v20158: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 159 KiB/s wr, 9 op/s 2023-05-08T14:12:38.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:38 smithi133 ceph-mon[125939]: pgmap v20158: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 159 KiB/s wr, 9 op/s 2023-05-08T14:12:38.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:38 smithi096 ceph-mon[124666]: pgmap v20158: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 159 KiB/s wr, 9 op/s 2023-05-08T14:12:39.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37698.432727 secs 2023-05-08T14:12:39.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37698.432727 secs 2023-05-08T14:12:39.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37698.432727 secs 2023-05-08T14:12:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37698.986830 secs 2023-05-08T14:12:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:40 smithi186 ceph-mon[126480]: pgmap v20159: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 548 KiB/s wr, 9 op/s 2023-05-08T14:12:40.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37698.986830 secs 2023-05-08T14:12:40.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:40 smithi133 ceph-mon[125939]: pgmap v20159: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 548 KiB/s wr, 9 op/s 2023-05-08T14:12:40.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37698.986830 secs 2023-05-08T14:12:40.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:40 smithi096 ceph-mon[124666]: pgmap v20159: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 548 KiB/s wr, 9 op/s 2023-05-08T14:12:42.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:42 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37700.327933 secs 2023-05-08T14:12:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:42 smithi133 ceph-mon[125939]: pgmap v20160: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 544 KiB/s wr, 9 op/s 2023-05-08T14:12:42.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:42 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37700.327933 secs 2023-05-08T14:12:42.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:42 smithi096 ceph-mon[124666]: pgmap v20160: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 544 KiB/s wr, 9 op/s 2023-05-08T14:12:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:42 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37700.327933 secs 2023-05-08T14:12:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:42 smithi186 ceph-mon[126480]: pgmap v20160: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 544 KiB/s wr, 9 op/s 2023-05-08T14:12:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:44 smithi186 ceph-mon[126480]: osdmap e1337: 12 total, 12 up, 12 in 2023-05-08T14:12:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:44 smithi186 ceph-mon[126480]: pgmap v20162: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 548 KiB/s wr, 9 op/s 2023-05-08T14:12:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37703.432806 secs 2023-05-08T14:12:44.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:44 smithi133 ceph-mon[125939]: osdmap e1337: 12 total, 12 up, 12 in 2023-05-08T14:12:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:44 smithi133 ceph-mon[125939]: pgmap v20162: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 548 KiB/s wr, 9 op/s 2023-05-08T14:12:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37703.432806 secs 2023-05-08T14:12:44.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:44 smithi096 ceph-mon[124666]: osdmap e1337: 12 total, 12 up, 12 in 2023-05-08T14:12:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:44 smithi096 ceph-mon[124666]: pgmap v20162: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 548 KiB/s wr, 9 op/s 2023-05-08T14:12:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37703.432806 secs 2023-05-08T14:12:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37703.986948 secs 2023-05-08T14:12:45.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37703.986948 secs 2023-05-08T14:12:45.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37703.986948 secs 2023-05-08T14:12:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:46 smithi186 ceph-mon[126480]: pgmap v20163: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 393 KiB/s rd, 391 KiB/s wr, 7 op/s 2023-05-08T14:12:46.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:46 smithi133 ceph-mon[125939]: pgmap v20163: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 393 KiB/s rd, 391 KiB/s wr, 7 op/s 2023-05-08T14:12:46.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:46 smithi096 ceph-mon[124666]: pgmap v20163: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 393 KiB/s rd, 391 KiB/s wr, 7 op/s 2023-05-08T14:12:47.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:47 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37705.328051 secs 2023-05-08T14:12:47.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:47 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37705.328051 secs 2023-05-08T14:12:47.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:47 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37705.328051 secs 2023-05-08T14:12:48.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:48 smithi186 ceph-mon[126480]: pgmap v20164: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 393 KiB/s rd, 391 KiB/s wr, 7 op/s 2023-05-08T14:12:48.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:48 smithi133 ceph-mon[125939]: pgmap v20164: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 393 KiB/s rd, 391 KiB/s wr, 7 op/s 2023-05-08T14:12:48.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:48 smithi096 ceph-mon[124666]: pgmap v20164: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 393 KiB/s rd, 391 KiB/s wr, 7 op/s 2023-05-08T14:12:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37708.432960 secs 2023-05-08T14:12:49.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37708.432960 secs 2023-05-08T14:12:49.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37708.432960 secs 2023-05-08T14:12:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37708.987063 secs 2023-05-08T14:12:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:50 smithi186 ceph-mon[126480]: pgmap v20165: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 583 KiB/s rd, 388 KiB/s wr, 7 op/s 2023-05-08T14:12:50.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37708.987063 secs 2023-05-08T14:12:50.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:50 smithi133 ceph-mon[125939]: pgmap v20165: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 583 KiB/s rd, 388 KiB/s wr, 7 op/s 2023-05-08T14:12:50.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37708.987063 secs 2023-05-08T14:12:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:50 smithi096 ceph-mon[124666]: pgmap v20165: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 583 KiB/s rd, 388 KiB/s wr, 7 op/s 2023-05-08T14:12:52.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:52 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37710.328183 secs 2023-05-08T14:12:52.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:52 smithi133 ceph-mon[125939]: pgmap v20166: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 583 KiB/s rd, 388 KiB/s wr, 7 op/s 2023-05-08T14:12:52.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:52 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37710.328183 secs 2023-05-08T14:12:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:52 smithi096 ceph-mon[124666]: pgmap v20166: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 583 KiB/s rd, 388 KiB/s wr, 7 op/s 2023-05-08T14:12:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:52 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37710.328183 secs 2023-05-08T14:12:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:52 smithi186 ceph-mon[126480]: pgmap v20166: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 583 KiB/s rd, 388 KiB/s wr, 7 op/s 2023-05-08T14:12:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:54 smithi186 ceph-mon[126480]: pgmap v20167: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 569 KiB/s rd, 378 KiB/s wr, 7 op/s 2023-05-08T14:12:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37713.433037 secs 2023-05-08T14:12:54.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:54 smithi133 ceph-mon[125939]: pgmap v20167: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 569 KiB/s rd, 378 KiB/s wr, 7 op/s 2023-05-08T14:12:54.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37713.433037 secs 2023-05-08T14:12:54.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:54 smithi096 ceph-mon[124666]: pgmap v20167: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 569 KiB/s rd, 378 KiB/s wr, 7 op/s 2023-05-08T14:12:54.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37713.433037 secs 2023-05-08T14:12:56.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:56 smithi133 ceph-mon[125939]: pgmap v20168: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 888 KiB/s rd, 691 KiB/s wr, 10 op/s 2023-05-08T14:12:56.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:56 smithi096 ceph-mon[124666]: pgmap v20168: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 888 KiB/s rd, 691 KiB/s wr, 10 op/s 2023-05-08T14:12:56.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:56 smithi186 ceph-mon[126480]: pgmap v20168: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 888 KiB/s rd, 691 KiB/s wr, 10 op/s 2023-05-08T14:12:57.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:57 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37715.328299 secs 2023-05-08T14:12:57.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:12:57.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:57 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37715.328299 secs 2023-05-08T14:12:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:12:57.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:57 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37715.328299 secs 2023-05-08T14:12:57.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:12:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:58 smithi133 ceph-mon[125939]: pgmap v20169: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 886 KiB/s rd, 690 KiB/s wr, 8 op/s 2023-05-08T14:12:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:58 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:12:58.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:12:58.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:12:58.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:58 smithi096 ceph-mon[124666]: pgmap v20169: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 886 KiB/s rd, 690 KiB/s wr, 8 op/s 2023-05-08T14:12:58.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:58 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:12:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:12:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:12:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:58 smithi186 ceph-mon[126480]: pgmap v20169: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 886 KiB/s rd, 690 KiB/s wr, 8 op/s 2023-05-08T14:12:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:58 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:12:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:12:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:12:59.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:12:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37718.433134 secs 2023-05-08T14:12:59.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:12:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37718.433134 secs 2023-05-08T14:12:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:12:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37718.433134 secs 2023-05-08T14:13:00.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:00 smithi133 ceph-mon[125939]: pgmap v20170: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2023-05-08T14:13:00.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:00 smithi096 ceph-mon[124666]: pgmap v20170: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2023-05-08T14:13:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:00 smithi186 ceph-mon[126480]: pgmap v20170: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2023-05-08T14:13:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:01 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:13:01.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:01 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:13:01.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:01 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:13:02.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:02 smithi133 ceph-mon[125939]: pgmap v20171: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 825 KiB/s rd, 1.1 MiB/s wr, 9 op/s 2023-05-08T14:13:02.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:13:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:13:02.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:02 smithi096 ceph-mon[124666]: pgmap v20171: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 825 KiB/s rd, 1.1 MiB/s wr, 9 op/s 2023-05-08T14:13:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:13:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:13:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:02 smithi186 ceph-mon[126480]: pgmap v20171: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 825 KiB/s rd, 1.1 MiB/s wr, 9 op/s 2023-05-08T14:13:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:13:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:13:03.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:03 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:13:03.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:03 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:13:03.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:03 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:13:04.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:04 smithi133 ceph-mon[125939]: pgmap v20172: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 825 KiB/s rd, 1.1 MiB/s wr, 9 op/s 2023-05-08T14:13:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37723.433210 secs 2023-05-08T14:13:04.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:04 smithi096 ceph-mon[124666]: pgmap v20172: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 825 KiB/s rd, 1.1 MiB/s wr, 9 op/s 2023-05-08T14:13:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37723.433210 secs 2023-05-08T14:13:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:04 smithi186 ceph-mon[126480]: pgmap v20172: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 825 KiB/s rd, 1.1 MiB/s wr, 9 op/s 2023-05-08T14:13:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37723.433210 secs 2023-05-08T14:13:05.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37723.987490 secs 2023-05-08T14:13:05.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37723.987490 secs 2023-05-08T14:13:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37723.987490 secs 2023-05-08T14:13:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:06 smithi133 ceph-mon[125939]: pgmap v20173: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 27 op/s 2023-05-08T14:13:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:13:06.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:13:06.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:06 smithi096 ceph-mon[124666]: pgmap v20173: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 27 op/s 2023-05-08T14:13:06.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:13:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:13:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:06 smithi186 ceph-mon[126480]: pgmap v20173: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 27 op/s 2023-05-08T14:13:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:13:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:13:08.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:08 smithi133 ceph-mon[125939]: pgmap v20174: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 23 op/s 2023-05-08T14:13:08.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:08 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:13:08.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:08 smithi096 ceph-mon[124666]: pgmap v20174: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 23 op/s 2023-05-08T14:13:08.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:08 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:13:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:08 smithi186 ceph-mon[126480]: pgmap v20174: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 23 op/s 2023-05-08T14:13:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:08 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:13:09.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37728.433304 secs 2023-05-08T14:13:09.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37728.433304 secs 2023-05-08T14:13:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37728.433304 secs 2023-05-08T14:13:10.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37728.987618 secs 2023-05-08T14:13:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:10 smithi133 ceph-mon[125939]: pgmap v20175: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 27 op/s 2023-05-08T14:13:10.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37728.987618 secs 2023-05-08T14:13:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:10 smithi096 ceph-mon[124666]: pgmap v20175: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 27 op/s 2023-05-08T14:13:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37728.987618 secs 2023-05-08T14:13:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:10 smithi186 ceph-mon[126480]: pgmap v20175: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 27 op/s 2023-05-08T14:13:12.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:12 smithi133 ceph-mon[125939]: pgmap v20176: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 967 KiB/s rd, 621 KiB/s wr, 22 op/s 2023-05-08T14:13:12.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:12 smithi096 ceph-mon[124666]: pgmap v20176: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 967 KiB/s rd, 621 KiB/s wr, 22 op/s 2023-05-08T14:13:12.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:12 smithi186 ceph-mon[126480]: pgmap v20176: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 967 KiB/s rd, 621 KiB/s wr, 22 op/s 2023-05-08T14:13:14.095 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:14 smithi096 ceph-mon[124666]: pgmap v20177: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 967 KiB/s rd, 621 KiB/s wr, 22 op/s 2023-05-08T14:13:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:14 smithi186 ceph-mon[126480]: pgmap v20177: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 967 KiB/s rd, 621 KiB/s wr, 22 op/s 2023-05-08T14:13:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37733.433452 secs 2023-05-08T14:13:14.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:14 smithi133 ceph-mon[125939]: pgmap v20177: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 967 KiB/s rd, 621 KiB/s wr, 22 op/s 2023-05-08T14:13:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37733.433452 secs 2023-05-08T14:13:14.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37733.433452 secs 2023-05-08T14:13:15.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37733.987718 secs 2023-05-08T14:13:15.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37733.987718 secs 2023-05-08T14:13:15.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37733.987718 secs 2023-05-08T14:13:16.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:16 smithi186 ceph-mon[126480]: pgmap v20178: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 25 op/s 2023-05-08T14:13:16.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:16 smithi133 ceph-mon[125939]: pgmap v20178: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 25 op/s 2023-05-08T14:13:16.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:16 smithi096 ceph-mon[124666]: pgmap v20178: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 25 op/s 2023-05-08T14:13:18.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:18 smithi133 ceph-mon[125939]: pgmap v20179: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 513 KiB/s wr, 7 op/s 2023-05-08T14:13:18.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:18 smithi096 ceph-mon[124666]: pgmap v20179: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 513 KiB/s wr, 7 op/s 2023-05-08T14:13:18.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:18 smithi186 ceph-mon[126480]: pgmap v20179: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 513 KiB/s wr, 7 op/s 2023-05-08T14:13:19.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37738.433546 secs 2023-05-08T14:13:19.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37738.433546 secs 2023-05-08T14:13:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37738.433546 secs 2023-05-08T14:13:20.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37738.987834 secs 2023-05-08T14:13:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:20 smithi133 ceph-mon[125939]: pgmap v20180: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 516 KiB/s rd, 513 KiB/s wr, 11 op/s 2023-05-08T14:13:20.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37738.987834 secs 2023-05-08T14:13:20.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:20 smithi096 ceph-mon[124666]: pgmap v20180: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 516 KiB/s rd, 513 KiB/s wr, 11 op/s 2023-05-08T14:13:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37738.987834 secs 2023-05-08T14:13:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:20 smithi186 ceph-mon[126480]: pgmap v20180: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 516 KiB/s rd, 513 KiB/s wr, 11 op/s 2023-05-08T14:13:22.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:22 smithi133 ceph-mon[125939]: pgmap v20181: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 512 KiB/s wr, 7 op/s 2023-05-08T14:13:22.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:22 smithi096 ceph-mon[124666]: pgmap v20181: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 512 KiB/s wr, 7 op/s 2023-05-08T14:13:22.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:22 smithi186 ceph-mon[126480]: pgmap v20181: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 512 KiB/s wr, 7 op/s 2023-05-08T14:13:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:24 smithi186 ceph-mon[126480]: pgmap v20182: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 512 KiB/s wr, 7 op/s 2023-05-08T14:13:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37743.433639 secs 2023-05-08T14:13:24.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:24 smithi133 ceph-mon[125939]: pgmap v20182: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 512 KiB/s wr, 7 op/s 2023-05-08T14:13:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37743.433639 secs 2023-05-08T14:13:24.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:24 smithi096 ceph-mon[124666]: pgmap v20182: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 512 KiB/s wr, 7 op/s 2023-05-08T14:13:24.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37743.433639 secs 2023-05-08T14:13:25.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:25 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:13:25.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:25 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:13:25.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:25 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:13:26.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:26 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:13:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:26 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:13:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:26 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:13:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:26 smithi133 ceph-mon[125939]: pgmap v20183: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 14 op/s 2023-05-08T14:13:26.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:26 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:13:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:26 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:13:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:26 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:13:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:26 smithi096 ceph-mon[124666]: pgmap v20183: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 14 op/s 2023-05-08T14:13:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:26 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:13:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:26 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:13:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:26 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:13:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:26 smithi186 ceph-mon[126480]: pgmap v20183: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 14 op/s 2023-05-08T14:13:27.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:27 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37745.329055 secs 2023-05-08T14:13:27.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:27 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37745.329055 secs 2023-05-08T14:13:27.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:27 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37745.329055 secs 2023-05-08T14:13:28.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:28 smithi133 ceph-mon[125939]: pgmap v20184: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 895 KiB/s wr, 10 op/s 2023-05-08T14:13:28.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:28 smithi096 ceph-mon[124666]: pgmap v20184: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 895 KiB/s wr, 10 op/s 2023-05-08T14:13:28.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:28 smithi186 ceph-mon[126480]: pgmap v20184: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 895 KiB/s wr, 10 op/s 2023-05-08T14:13:29.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37748.433729 secs 2023-05-08T14:13:29.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:29 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:13:29.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37748.433729 secs 2023-05-08T14:13:29.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:29 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:13:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37748.433729 secs 2023-05-08T14:13:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:29 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:13:30.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:30 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:13:30.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:30 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:13:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:30 smithi133 ceph-mon[125939]: pgmap v20185: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 924 KiB/s wr, 15 op/s 2023-05-08T14:13:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:13:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:13:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:30 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:13:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:13:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:30 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T14:13:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:30 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T14:13:30.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:30 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:13:30.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:30 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:13:30.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:30 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:13:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:30 smithi096 ceph-mon[124666]: pgmap v20185: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 924 KiB/s wr, 15 op/s 2023-05-08T14:13:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:13:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:13:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:30 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:13:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:13:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:30 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T14:13:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:30 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T14:13:30.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:30 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:13:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:30 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:13:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:30 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:13:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:30 smithi186 ceph-mon[126480]: pgmap v20185: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 924 KiB/s wr, 15 op/s 2023-05-08T14:13:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:13:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:13:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:30 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:13:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:13:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:30 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T14:13:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:30 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T14:13:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:30 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:13:32.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:32 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37750.329138 secs 2023-05-08T14:13:32.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:32 smithi133 ceph-mon[125939]: osdmap e1338: 12 total, 12 up, 12 in 2023-05-08T14:13:32.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:32 smithi133 ceph-mon[125939]: pgmap v20187: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T14:13:32.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:32 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37750.329138 secs 2023-05-08T14:13:32.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:32 smithi096 ceph-mon[124666]: osdmap e1338: 12 total, 12 up, 12 in 2023-05-08T14:13:32.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:32 smithi096 ceph-mon[124666]: pgmap v20187: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T14:13:32.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:32 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37750.329138 secs 2023-05-08T14:13:32.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:32 smithi186 ceph-mon[126480]: osdmap e1338: 12 total, 12 up, 12 in 2023-05-08T14:13:32.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:32 smithi186 ceph-mon[126480]: pgmap v20187: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T14:13:33.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:33 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:13:33.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:33 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:13:33.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:33 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:13:34.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:34 smithi133 ceph-mon[125939]: pgmap v20188: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T14:13:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37753.433851 secs 2023-05-08T14:13:34.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:34 smithi096 ceph-mon[124666]: pgmap v20188: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T14:13:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37753.433851 secs 2023-05-08T14:13:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:34 smithi186 ceph-mon[126480]: pgmap v20188: 97 pgs: 97 active+clean; 6.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T14:13:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37753.433851 secs 2023-05-08T14:13:36.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:36 smithi133 ceph-mon[125939]: pgmap v20189: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 425 KiB/s rd, 423 KiB/s wr, 9 op/s 2023-05-08T14:13:36.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:36 smithi096 ceph-mon[124666]: pgmap v20189: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 425 KiB/s rd, 423 KiB/s wr, 9 op/s 2023-05-08T14:13:36.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:36 smithi186 ceph-mon[126480]: pgmap v20189: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 425 KiB/s rd, 423 KiB/s wr, 9 op/s 2023-05-08T14:13:37.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:37 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37755.329220 secs 2023-05-08T14:13:37.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:37 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37755.329220 secs 2023-05-08T14:13:37.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:37 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37755.329220 secs 2023-05-08T14:13:38.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:38 smithi133 ceph-mon[125939]: pgmap v20190: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 425 KiB/s rd, 422 KiB/s wr, 9 op/s 2023-05-08T14:13:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:38 smithi133 ceph-mon[125939]: osdmap e1339: 12 total, 12 up, 12 in 2023-05-08T14:13:38.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:38 smithi096 ceph-mon[124666]: pgmap v20190: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 425 KiB/s rd, 422 KiB/s wr, 9 op/s 2023-05-08T14:13:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:38 smithi096 ceph-mon[124666]: osdmap e1339: 12 total, 12 up, 12 in 2023-05-08T14:13:38.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:38 smithi186 ceph-mon[126480]: pgmap v20190: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 425 KiB/s rd, 422 KiB/s wr, 9 op/s 2023-05-08T14:13:38.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:38 smithi186 ceph-mon[126480]: osdmap e1339: 12 total, 12 up, 12 in 2023-05-08T14:13:39.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37758.433976 secs 2023-05-08T14:13:39.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37758.433976 secs 2023-05-08T14:13:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37758.433976 secs 2023-05-08T14:13:40.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:40 smithi133 ceph-mon[125939]: pgmap v20192: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 673 KiB/s wr, 11 op/s 2023-05-08T14:13:40.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:40 smithi096 ceph-mon[124666]: pgmap v20192: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 673 KiB/s wr, 11 op/s 2023-05-08T14:13:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:40 smithi186 ceph-mon[126480]: pgmap v20192: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 673 KiB/s wr, 11 op/s 2023-05-08T14:13:42.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:42 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37760.329289 secs 2023-05-08T14:13:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:42 smithi133 ceph-mon[125939]: pgmap v20193: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 856 KiB/s rd, 547 KiB/s wr, 9 op/s 2023-05-08T14:13:42.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:42 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37760.329289 secs 2023-05-08T14:13:42.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:42 smithi096 ceph-mon[124666]: pgmap v20193: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 856 KiB/s rd, 547 KiB/s wr, 9 op/s 2023-05-08T14:13:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:42 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37760.329289 secs 2023-05-08T14:13:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:42 smithi186 ceph-mon[126480]: pgmap v20193: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 856 KiB/s rd, 547 KiB/s wr, 9 op/s 2023-05-08T14:13:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:44 smithi186 ceph-mon[126480]: pgmap v20194: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 856 KiB/s rd, 547 KiB/s wr, 9 op/s 2023-05-08T14:13:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37763.434110 secs 2023-05-08T14:13:44.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:44 smithi133 ceph-mon[125939]: pgmap v20194: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 856 KiB/s rd, 547 KiB/s wr, 9 op/s 2023-05-08T14:13:44.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37763.434110 secs 2023-05-08T14:13:44.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:44 smithi096 ceph-mon[124666]: pgmap v20194: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 856 KiB/s rd, 547 KiB/s wr, 9 op/s 2023-05-08T14:13:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37763.434110 secs 2023-05-08T14:13:45.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37763.988506 secs 2023-05-08T14:13:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:45 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:13:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:45 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:13:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:45 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:13:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37763.988506 secs 2023-05-08T14:13:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:45 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:13:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:45 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:13:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:45 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:13:45.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37763.988506 secs 2023-05-08T14:13:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:45 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:13:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:45 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:13:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:45 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:13:46.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:46 smithi096 ceph-mon[124666]: pgmap v20195: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 13 op/s 2023-05-08T14:13:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:46 smithi186 ceph-mon[126480]: pgmap v20195: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 13 op/s 2023-05-08T14:13:46.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:46 smithi133 ceph-mon[125939]: pgmap v20195: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 13 op/s 2023-05-08T14:13:47.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:47 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37765.329406 secs 2023-05-08T14:13:47.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:47 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37765.329406 secs 2023-05-08T14:13:47.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:47 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37765.329406 secs 2023-05-08T14:13:48.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:48 smithi186 ceph-mon[126480]: pgmap v20196: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 13 op/s 2023-05-08T14:13:48.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:48 smithi133 ceph-mon[125939]: pgmap v20196: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 13 op/s 2023-05-08T14:13:48.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:48 smithi096 ceph-mon[124666]: pgmap v20196: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 13 op/s 2023-05-08T14:13:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37768.434232 secs 2023-05-08T14:13:49.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37768.434232 secs 2023-05-08T14:13:49.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37768.434232 secs 2023-05-08T14:13:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37768.988572 secs 2023-05-08T14:13:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:50 smithi186 ceph-mon[126480]: pgmap v20197: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.7 MiB/s wr, 17 op/s 2023-05-08T14:13:50.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37768.988572 secs 2023-05-08T14:13:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:50 smithi133 ceph-mon[125939]: pgmap v20197: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.7 MiB/s wr, 17 op/s 2023-05-08T14:13:50.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37768.988572 secs 2023-05-08T14:13:50.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:50 smithi096 ceph-mon[124666]: pgmap v20197: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.7 MiB/s wr, 17 op/s 2023-05-08T14:13:52.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:52 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37770.329541 secs 2023-05-08T14:13:52.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:52 smithi133 ceph-mon[125939]: pgmap v20198: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T14:13:52.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:52 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37770.329541 secs 2023-05-08T14:13:52.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:52 smithi096 ceph-mon[124666]: pgmap v20198: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T14:13:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:52 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37770.329541 secs 2023-05-08T14:13:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:52 smithi186 ceph-mon[126480]: pgmap v20198: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T14:13:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:54 smithi186 ceph-mon[126480]: pgmap v20199: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T14:13:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37773.434355 secs 2023-05-08T14:13:54.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:54 smithi133 ceph-mon[125939]: pgmap v20199: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T14:13:54.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37773.434355 secs 2023-05-08T14:13:54.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:54 smithi096 ceph-mon[124666]: pgmap v20199: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T14:13:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37773.434355 secs 2023-05-08T14:13:56.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:56 smithi133 ceph-mon[125939]: pgmap v20200: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.4 MiB/s wr, 19 op/s 2023-05-08T14:13:56.803 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:56 smithi096 ceph-mon[124666]: pgmap v20200: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.4 MiB/s wr, 19 op/s 2023-05-08T14:13:56.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:56 smithi186 ceph-mon[126480]: pgmap v20200: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.4 MiB/s wr, 19 op/s 2023-05-08T14:13:57.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:13:57.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:13:57.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:13:57.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:13:57.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:13:57.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:13:58.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:58 smithi133 ceph-mon[125939]: pgmap v20201: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T14:13:58.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:58 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:13:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:13:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:13:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:13:58.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:58 smithi096 ceph-mon[124666]: pgmap v20201: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T14:13:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:58 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:13:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:13:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:13:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:13:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:58 smithi186 ceph-mon[126480]: pgmap v20201: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T14:13:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:58 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:13:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:13:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:13:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:13:59.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:13:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37778.434420 secs 2023-05-08T14:13:59.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:13:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37778.434420 secs 2023-05-08T14:13:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:13:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37778.434420 secs 2023-05-08T14:14:00.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37778.988832 secs 2023-05-08T14:14:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:00 smithi133 ceph-mon[125939]: pgmap v20202: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 17 op/s 2023-05-08T14:14:00.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37778.988832 secs 2023-05-08T14:14:00.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:00 smithi096 ceph-mon[124666]: pgmap v20202: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 17 op/s 2023-05-08T14:14:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37778.988832 secs 2023-05-08T14:14:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:00 smithi186 ceph-mon[126480]: pgmap v20202: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 17 op/s 2023-05-08T14:14:02.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:02 smithi133 ceph-mon[125939]: pgmap v20203: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.0 MiB/s wr, 12 op/s 2023-05-08T14:14:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:14:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:14:02.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:02 smithi096 ceph-mon[124666]: pgmap v20203: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.0 MiB/s wr, 12 op/s 2023-05-08T14:14:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:14:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:14:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:02 smithi186 ceph-mon[126480]: pgmap v20203: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.0 MiB/s wr, 12 op/s 2023-05-08T14:14:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:14:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:14:03.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:03 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:14:03.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:03 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:14:03.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:03 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:14:04.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:04 smithi133 ceph-mon[125939]: pgmap v20204: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.0 MiB/s wr, 12 op/s 2023-05-08T14:14:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37783.434498 secs 2023-05-08T14:14:04.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:04 smithi096 ceph-mon[124666]: pgmap v20204: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.0 MiB/s wr, 12 op/s 2023-05-08T14:14:04.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37783.434498 secs 2023-05-08T14:14:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:04 smithi186 ceph-mon[126480]: pgmap v20204: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.0 MiB/s wr, 12 op/s 2023-05-08T14:14:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37783.434498 secs 2023-05-08T14:14:05.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:05 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:14:05.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:05 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:14:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:05 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:14:06.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:06 smithi133 ceph-mon[125939]: pgmap v20205: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.7 MiB/s wr, 31 op/s 2023-05-08T14:14:06.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:14:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:14:06.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:06 smithi096 ceph-mon[124666]: pgmap v20205: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.7 MiB/s wr, 31 op/s 2023-05-08T14:14:06.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:14:06.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:14:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:06 smithi186 ceph-mon[126480]: pgmap v20205: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.7 MiB/s wr, 31 op/s 2023-05-08T14:14:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:14:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:14:08.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:08 smithi133 ceph-mon[125939]: pgmap v20206: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.7 MiB/s wr, 24 op/s 2023-05-08T14:14:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:08 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:14:08.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:08 smithi096 ceph-mon[124666]: pgmap v20206: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.7 MiB/s wr, 24 op/s 2023-05-08T14:14:08.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:08 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:14:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:08 smithi186 ceph-mon[126480]: pgmap v20206: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.7 MiB/s wr, 24 op/s 2023-05-08T14:14:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:08 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:14:09.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37788.434614 secs 2023-05-08T14:14:09.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37788.434614 secs 2023-05-08T14:14:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37788.434614 secs 2023-05-08T14:14:10.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:10 smithi133 ceph-mon[125939]: pgmap v20207: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 29 op/s 2023-05-08T14:14:10.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:10 smithi096 ceph-mon[124666]: pgmap v20207: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 29 op/s 2023-05-08T14:14:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:10 smithi186 ceph-mon[126480]: pgmap v20207: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 29 op/s 2023-05-08T14:14:12.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:12 smithi133 ceph-mon[125939]: pgmap v20208: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.4 MiB/s wr, 24 op/s 2023-05-08T14:14:12.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:12 smithi096 ceph-mon[124666]: pgmap v20208: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.4 MiB/s wr, 24 op/s 2023-05-08T14:14:12.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:12 smithi186 ceph-mon[126480]: pgmap v20208: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.4 MiB/s wr, 24 op/s 2023-05-08T14:14:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:14 smithi186 ceph-mon[126480]: pgmap v20209: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.4 MiB/s wr, 24 op/s 2023-05-08T14:14:14.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37793.434733 secs 2023-05-08T14:14:14.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:14 smithi133 ceph-mon[125939]: pgmap v20209: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.4 MiB/s wr, 24 op/s 2023-05-08T14:14:14.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37793.434733 secs 2023-05-08T14:14:14.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:14 smithi096 ceph-mon[124666]: pgmap v20209: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.4 MiB/s wr, 24 op/s 2023-05-08T14:14:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37793.434733 secs 2023-05-08T14:14:16.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:16 smithi133 ceph-mon[125939]: pgmap v20210: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 1.8 MiB/s wr, 28 op/s 2023-05-08T14:14:16.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:16 smithi096 ceph-mon[124666]: pgmap v20210: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 1.8 MiB/s wr, 28 op/s 2023-05-08T14:14:16.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:16 smithi186 ceph-mon[126480]: pgmap v20210: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 1.8 MiB/s wr, 28 op/s 2023-05-08T14:14:18.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:18 smithi133 ceph-mon[125939]: pgmap v20211: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 9 op/s 2023-05-08T14:14:18.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:18 smithi096 ceph-mon[124666]: pgmap v20211: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 9 op/s 2023-05-08T14:14:18.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:18 smithi186 ceph-mon[126480]: pgmap v20211: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 9 op/s 2023-05-08T14:14:19.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37798.434827 secs 2023-05-08T14:14:19.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37798.434827 secs 2023-05-08T14:14:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37798.434827 secs 2023-05-08T14:14:20.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:20 smithi133 ceph-mon[125939]: pgmap v20212: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T14:14:20.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:20 smithi096 ceph-mon[124666]: pgmap v20212: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T14:14:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:20 smithi186 ceph-mon[126480]: pgmap v20212: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T14:14:22.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:22 smithi133 ceph-mon[125939]: pgmap v20213: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 757 KiB/s rd, 431 KiB/s wr, 7 op/s 2023-05-08T14:14:22.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:22 smithi096 ceph-mon[124666]: pgmap v20213: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 757 KiB/s rd, 431 KiB/s wr, 7 op/s 2023-05-08T14:14:22.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:22 smithi186 ceph-mon[126480]: pgmap v20213: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 757 KiB/s rd, 431 KiB/s wr, 7 op/s 2023-05-08T14:14:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:24 smithi186 ceph-mon[126480]: pgmap v20214: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 757 KiB/s rd, 431 KiB/s wr, 7 op/s 2023-05-08T14:14:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37803.434966 secs 2023-05-08T14:14:24.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:24 smithi133 ceph-mon[125939]: pgmap v20214: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 757 KiB/s rd, 431 KiB/s wr, 7 op/s 2023-05-08T14:14:24.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37803.434966 secs 2023-05-08T14:14:24.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:24 smithi096 ceph-mon[124666]: pgmap v20214: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 757 KiB/s rd, 431 KiB/s wr, 7 op/s 2023-05-08T14:14:24.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37803.434966 secs 2023-05-08T14:14:25.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:25 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:14:25.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:25 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:14:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:25 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:14:25.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:25 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:14:25.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:25 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:14:25.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:25 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:14:25.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:25 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:14:25.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:25 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:14:25.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:25 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:14:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37803.989508 secs 2023-05-08T14:14:26.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:26 smithi096 ceph-mon[124666]: pgmap v20215: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T14:14:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37803.989508 secs 2023-05-08T14:14:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:26 smithi186 ceph-mon[126480]: pgmap v20215: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T14:14:26.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37803.989508 secs 2023-05-08T14:14:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:26 smithi133 ceph-mon[125939]: pgmap v20215: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T14:14:27.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:27 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37805.330307 secs 2023-05-08T14:14:27.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:27 smithi096 ceph-mon[124666]: osdmap e1340: 12 total, 12 up, 12 in 2023-05-08T14:14:27.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:27 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37805.330307 secs 2023-05-08T14:14:27.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:27 smithi186 ceph-mon[126480]: osdmap e1340: 12 total, 12 up, 12 in 2023-05-08T14:14:27.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:27 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37805.330307 secs 2023-05-08T14:14:27.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:27 smithi133 ceph-mon[125939]: osdmap e1340: 12 total, 12 up, 12 in 2023-05-08T14:14:28.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:28 smithi096 ceph-mon[124666]: pgmap v20217: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T14:14:28.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:28 smithi186 ceph-mon[126480]: pgmap v20217: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T14:14:28.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:28 smithi133 ceph-mon[125939]: pgmap v20217: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T14:14:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37808.435080 secs 2023-05-08T14:14:29.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37808.435080 secs 2023-05-08T14:14:29.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37808.435080 secs 2023-05-08T14:14:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37808.989575 secs 2023-05-08T14:14:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:30 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:14:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:30 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:14:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:30 smithi186 ceph-mon[126480]: pgmap v20218: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T14:14:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:30 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:14:30.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37808.989575 secs 2023-05-08T14:14:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:30 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:14:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:30 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:14:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:30 smithi133 ceph-mon[125939]: pgmap v20218: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T14:14:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:30 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:14:30.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37808.989575 secs 2023-05-08T14:14:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:30 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:14:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:30 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:14:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:30 smithi096 ceph-mon[124666]: pgmap v20218: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T14:14:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:30 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:14:31.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:31 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:14:31.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:31 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:14:31.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:31 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:14:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:31 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:14:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:31 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T14:14:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:31 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T14:14:31.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:31 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:14:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:31 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:14:31.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:31 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:14:31.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:31 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:14:31.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:31 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:14:31.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:31 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T14:14:31.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:31 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T14:14:31.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:31 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:14:31.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:31 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:14:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:31 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:14:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:31 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:14:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:31 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:14:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:31 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T14:14:31.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:31 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T14:14:31.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:31 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:14:32.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:32 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37810.330422 secs 2023-05-08T14:14:32.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:32 smithi186 ceph-mon[126480]: pgmap v20219: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T14:14:32.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:32 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37810.330422 secs 2023-05-08T14:14:32.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:32 smithi133 ceph-mon[125939]: pgmap v20219: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T14:14:32.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:32 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37810.330422 secs 2023-05-08T14:14:32.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:32 smithi096 ceph-mon[124666]: pgmap v20219: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T14:14:33.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:33 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:14:33.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:33 smithi186 ceph-mon[126480]: osdmap e1341: 12 total, 12 up, 12 in 2023-05-08T14:14:33.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:33 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:14:33.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:33 smithi133 ceph-mon[125939]: osdmap e1341: 12 total, 12 up, 12 in 2023-05-08T14:14:33.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:33 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:14:33.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:33 smithi096 ceph-mon[124666]: osdmap e1341: 12 total, 12 up, 12 in 2023-05-08T14:14:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:34 smithi186 ceph-mon[126480]: pgmap v20221: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 40 KiB/s wr, 6 op/s 2023-05-08T14:14:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37813.435224 secs 2023-05-08T14:14:34.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:34 smithi133 ceph-mon[125939]: pgmap v20221: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 40 KiB/s wr, 6 op/s 2023-05-08T14:14:34.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37813.435224 secs 2023-05-08T14:14:34.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:34 smithi096 ceph-mon[124666]: pgmap v20221: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 40 KiB/s wr, 6 op/s 2023-05-08T14:14:34.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37813.435224 secs 2023-05-08T14:14:35.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37813.989646 secs 2023-05-08T14:14:35.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37813.989646 secs 2023-05-08T14:14:35.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37813.989646 secs 2023-05-08T14:14:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:36 smithi186 ceph-mon[126480]: pgmap v20222: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 644 KiB/s rd, 641 KiB/s wr, 11 op/s 2023-05-08T14:14:36.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:36 smithi133 ceph-mon[125939]: pgmap v20222: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 644 KiB/s rd, 641 KiB/s wr, 11 op/s 2023-05-08T14:14:36.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:36 smithi096 ceph-mon[124666]: pgmap v20222: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 644 KiB/s rd, 641 KiB/s wr, 11 op/s 2023-05-08T14:14:37.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:37 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37815.330545 secs 2023-05-08T14:14:37.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:37 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37815.330545 secs 2023-05-08T14:14:37.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:37 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37815.330545 secs 2023-05-08T14:14:38.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:38 smithi186 ceph-mon[126480]: pgmap v20223: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 587 KiB/s rd, 584 KiB/s wr, 10 op/s 2023-05-08T14:14:38.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:38 smithi133 ceph-mon[125939]: pgmap v20223: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 587 KiB/s rd, 584 KiB/s wr, 10 op/s 2023-05-08T14:14:38.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:38 smithi096 ceph-mon[124666]: pgmap v20223: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 587 KiB/s rd, 584 KiB/s wr, 10 op/s 2023-05-08T14:14:39.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37818.435364 secs 2023-05-08T14:14:39.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37818.435364 secs 2023-05-08T14:14:39.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37818.435364 secs 2023-05-08T14:14:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37818.989712 secs 2023-05-08T14:14:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:40 smithi186 ceph-mon[126480]: pgmap v20224: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 949 KiB/s rd, 946 KiB/s wr, 10 op/s 2023-05-08T14:14:40.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37818.989712 secs 2023-05-08T14:14:40.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:40 smithi133 ceph-mon[125939]: pgmap v20224: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 949 KiB/s rd, 946 KiB/s wr, 10 op/s 2023-05-08T14:14:40.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37818.989712 secs 2023-05-08T14:14:40.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:40 smithi096 ceph-mon[124666]: pgmap v20224: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 949 KiB/s rd, 946 KiB/s wr, 10 op/s 2023-05-08T14:14:42.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:42 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37820.330680 secs 2023-05-08T14:14:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:42 smithi133 ceph-mon[125939]: pgmap v20225: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 949 KiB/s rd, 946 KiB/s wr, 10 op/s 2023-05-08T14:14:42.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:42 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37820.330680 secs 2023-05-08T14:14:42.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:42 smithi096 ceph-mon[124666]: pgmap v20225: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 949 KiB/s rd, 946 KiB/s wr, 10 op/s 2023-05-08T14:14:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:42 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37820.330680 secs 2023-05-08T14:14:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:42 smithi186 ceph-mon[126480]: pgmap v20225: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 949 KiB/s rd, 946 KiB/s wr, 10 op/s 2023-05-08T14:14:44.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:44 smithi186 ceph-mon[126480]: pgmap v20226: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 925 KiB/s rd, 922 KiB/s wr, 9 op/s 2023-05-08T14:14:44.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37823.435509 secs 2023-05-08T14:14:44.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:44 smithi133 ceph-mon[125939]: pgmap v20226: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 925 KiB/s rd, 922 KiB/s wr, 9 op/s 2023-05-08T14:14:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37823.435509 secs 2023-05-08T14:14:44.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:44 smithi096 ceph-mon[124666]: pgmap v20226: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 925 KiB/s rd, 922 KiB/s wr, 9 op/s 2023-05-08T14:14:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37823.435509 secs 2023-05-08T14:14:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37823.989844 secs 2023-05-08T14:14:45.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37823.989844 secs 2023-05-08T14:14:45.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37823.989844 secs 2023-05-08T14:14:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:46 smithi186 ceph-mon[126480]: pgmap v20227: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 792 KiB/s rd, 789 KiB/s wr, 11 op/s 2023-05-08T14:14:46.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:46 smithi133 ceph-mon[125939]: pgmap v20227: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 792 KiB/s rd, 789 KiB/s wr, 11 op/s 2023-05-08T14:14:46.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:46 smithi096 ceph-mon[124666]: pgmap v20227: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 792 KiB/s rd, 789 KiB/s wr, 11 op/s 2023-05-08T14:14:47.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:47 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37825.330827 secs 2023-05-08T14:14:47.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:47 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37825.330827 secs 2023-05-08T14:14:47.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:47 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37825.330827 secs 2023-05-08T14:14:48.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:48 smithi186 ceph-mon[126480]: pgmap v20228: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 329 KiB/s wr, 6 op/s 2023-05-08T14:14:48.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:48 smithi133 ceph-mon[125939]: pgmap v20228: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 329 KiB/s wr, 6 op/s 2023-05-08T14:14:48.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:48 smithi096 ceph-mon[124666]: pgmap v20228: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 329 KiB/s wr, 6 op/s 2023-05-08T14:14:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37828.435641 secs 2023-05-08T14:14:49.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37828.435641 secs 2023-05-08T14:14:49.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37828.435641 secs 2023-05-08T14:14:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37828.989974 secs 2023-05-08T14:14:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:50 smithi186 ceph-mon[126480]: pgmap v20229: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 752 KiB/s rd, 619 KiB/s wr, 10 op/s 2023-05-08T14:14:50.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37828.989974 secs 2023-05-08T14:14:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:50 smithi133 ceph-mon[125939]: pgmap v20229: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 752 KiB/s rd, 619 KiB/s wr, 10 op/s 2023-05-08T14:14:50.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37828.989974 secs 2023-05-08T14:14:50.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:50 smithi096 ceph-mon[124666]: pgmap v20229: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 752 KiB/s rd, 619 KiB/s wr, 10 op/s 2023-05-08T14:14:52.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:52 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37830.330939 secs 2023-05-08T14:14:52.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:52 smithi133 ceph-mon[125939]: pgmap v20230: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 326 KiB/s wr, 6 op/s 2023-05-08T14:14:52.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:52 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37830.330939 secs 2023-05-08T14:14:52.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:52 smithi096 ceph-mon[124666]: pgmap v20230: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 326 KiB/s wr, 6 op/s 2023-05-08T14:14:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:52 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37830.330939 secs 2023-05-08T14:14:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:52 smithi186 ceph-mon[126480]: pgmap v20230: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 326 KiB/s wr, 6 op/s 2023-05-08T14:14:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:54 smithi186 ceph-mon[126480]: pgmap v20231: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 326 KiB/s wr, 6 op/s 2023-05-08T14:14:54.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37833.435747 secs 2023-05-08T14:14:54.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:54 smithi133 ceph-mon[125939]: pgmap v20231: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 326 KiB/s wr, 6 op/s 2023-05-08T14:14:54.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37833.435747 secs 2023-05-08T14:14:54.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:54 smithi096 ceph-mon[124666]: pgmap v20231: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 326 KiB/s wr, 6 op/s 2023-05-08T14:14:54.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37833.435747 secs 2023-05-08T14:14:56.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:56 smithi133 ceph-mon[125939]: pgmap v20232: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 670 KiB/s rd, 537 KiB/s wr, 10 op/s 2023-05-08T14:14:56.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:56 smithi096 ceph-mon[124666]: pgmap v20232: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 670 KiB/s rd, 537 KiB/s wr, 10 op/s 2023-05-08T14:14:56.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:56 smithi186 ceph-mon[126480]: pgmap v20232: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 670 KiB/s rd, 537 KiB/s wr, 10 op/s 2023-05-08T14:14:57.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:57 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37835.331074 secs 2023-05-08T14:14:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:14:57.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:57 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37835.331074 secs 2023-05-08T14:14:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:14:57.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:57 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37835.331074 secs 2023-05-08T14:14:57.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:14:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:58 smithi133 ceph-mon[125939]: pgmap v20233: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 974 KiB/s rd, 843 KiB/s wr, 8 op/s 2023-05-08T14:14:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:58 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:14:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:14:58.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:14:58.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:58 smithi096 ceph-mon[124666]: pgmap v20233: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 974 KiB/s rd, 843 KiB/s wr, 8 op/s 2023-05-08T14:14:58.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:58 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:14:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:14:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:14:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:58 smithi186 ceph-mon[126480]: pgmap v20233: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 974 KiB/s rd, 843 KiB/s wr, 8 op/s 2023-05-08T14:14:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:58 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:14:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:14:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:14:59.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:14:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37838.435877 secs 2023-05-08T14:14:59.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:14:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37838.435877 secs 2023-05-08T14:14:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:14:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37838.435877 secs 2023-05-08T14:15:00.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:00 smithi133 ceph-mon[125939]: pgmap v20234: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2023-05-08T14:15:00.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:00 smithi096 ceph-mon[124666]: pgmap v20234: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2023-05-08T14:15:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:00 smithi186 ceph-mon[126480]: pgmap v20234: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2023-05-08T14:15:01.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:01 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:15:01.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:01 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:15:01.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:01 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:15:02.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:02 smithi133 ceph-mon[125939]: pgmap v20235: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T14:15:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:15:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:15:02.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:02 smithi096 ceph-mon[124666]: pgmap v20235: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T14:15:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:15:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:15:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:02 smithi186 ceph-mon[126480]: pgmap v20235: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T14:15:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:15:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:15:03.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:03 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:15:03.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:03 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:15:03.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:03 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:15:04.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:04 smithi133 ceph-mon[125939]: pgmap v20236: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T14:15:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37843.436004 secs 2023-05-08T14:15:04.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:04 smithi096 ceph-mon[124666]: pgmap v20236: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T14:15:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37843.436004 secs 2023-05-08T14:15:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:04 smithi186 ceph-mon[126480]: pgmap v20236: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T14:15:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37843.436004 secs 2023-05-08T14:15:05.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37843.990309 secs 2023-05-08T14:15:05.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37843.990309 secs 2023-05-08T14:15:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37843.990309 secs 2023-05-08T14:15:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:06 smithi133 ceph-mon[125939]: pgmap v20237: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.7 MiB/s wr, 27 op/s 2023-05-08T14:15:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:15:06.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:15:06.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:06 smithi096 ceph-mon[124666]: pgmap v20237: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.7 MiB/s wr, 27 op/s 2023-05-08T14:15:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:15:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:15:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:06 smithi186 ceph-mon[126480]: pgmap v20237: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.7 MiB/s wr, 27 op/s 2023-05-08T14:15:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:15:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:15:08.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:08 smithi133 ceph-mon[125939]: pgmap v20238: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 23 op/s 2023-05-08T14:15:08.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:08 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:15:08.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:08 smithi096 ceph-mon[124666]: pgmap v20238: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 23 op/s 2023-05-08T14:15:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:08 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:15:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:08 smithi186 ceph-mon[126480]: pgmap v20238: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 23 op/s 2023-05-08T14:15:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:08 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:15:09.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37848.436105 secs 2023-05-08T14:15:09.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37848.436105 secs 2023-05-08T14:15:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37848.436105 secs 2023-05-08T14:15:10.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37848.990429 secs 2023-05-08T14:15:10.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:10 smithi133 ceph-mon[125939]: pgmap v20239: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.2 MiB/s wr, 27 op/s 2023-05-08T14:15:10.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37848.990429 secs 2023-05-08T14:15:10.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:10 smithi096 ceph-mon[124666]: pgmap v20239: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.2 MiB/s wr, 27 op/s 2023-05-08T14:15:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37848.990429 secs 2023-05-08T14:15:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:10 smithi186 ceph-mon[126480]: pgmap v20239: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.2 MiB/s wr, 27 op/s 2023-05-08T14:15:12.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:12 smithi133 ceph-mon[125939]: pgmap v20240: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 614 KiB/s rd, 627 KiB/s wr, 21 op/s 2023-05-08T14:15:12.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:12 smithi096 ceph-mon[124666]: pgmap v20240: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 614 KiB/s rd, 627 KiB/s wr, 21 op/s 2023-05-08T14:15:12.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:12 smithi186 ceph-mon[126480]: pgmap v20240: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 614 KiB/s rd, 627 KiB/s wr, 21 op/s 2023-05-08T14:15:14.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:14 smithi133 ceph-mon[125939]: pgmap v20241: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 614 KiB/s rd, 627 KiB/s wr, 21 op/s 2023-05-08T14:15:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37853.436243 secs 2023-05-08T14:15:14.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:14 smithi096 ceph-mon[124666]: pgmap v20241: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 614 KiB/s rd, 627 KiB/s wr, 21 op/s 2023-05-08T14:15:14.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37853.436243 secs 2023-05-08T14:15:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:14 smithi186 ceph-mon[126480]: pgmap v20241: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 614 KiB/s rd, 627 KiB/s wr, 21 op/s 2023-05-08T14:15:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37853.436243 secs 2023-05-08T14:15:15.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37853.990574 secs 2023-05-08T14:15:15.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37853.990574 secs 2023-05-08T14:15:15.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37853.990574 secs 2023-05-08T14:15:16.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:16 smithi186 ceph-mon[126480]: pgmap v20242: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 25 op/s 2023-05-08T14:15:16.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:16 smithi133 ceph-mon[125939]: pgmap v20242: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 25 op/s 2023-05-08T14:15:16.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:16 smithi096 ceph-mon[124666]: pgmap v20242: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 25 op/s 2023-05-08T14:15:18.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:18 smithi133 ceph-mon[125939]: pgmap v20243: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 517 KiB/s wr, 8 op/s 2023-05-08T14:15:18.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:18 smithi096 ceph-mon[124666]: pgmap v20243: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 517 KiB/s wr, 8 op/s 2023-05-08T14:15:18.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:18 smithi186 ceph-mon[126480]: pgmap v20243: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 517 KiB/s wr, 8 op/s 2023-05-08T14:15:19.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37858.436374 secs 2023-05-08T14:15:19.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37858.436374 secs 2023-05-08T14:15:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37858.436374 secs 2023-05-08T14:15:20.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37858.990672 secs 2023-05-08T14:15:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:20 smithi133 ceph-mon[125939]: pgmap v20244: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 520 KiB/s rd, 517 KiB/s wr, 11 op/s 2023-05-08T14:15:20.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37858.990672 secs 2023-05-08T14:15:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:20 smithi096 ceph-mon[124666]: pgmap v20244: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 520 KiB/s rd, 517 KiB/s wr, 11 op/s 2023-05-08T14:15:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37858.990672 secs 2023-05-08T14:15:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:20 smithi186 ceph-mon[126480]: pgmap v20244: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 520 KiB/s rd, 517 KiB/s wr, 11 op/s 2023-05-08T14:15:22.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:22 smithi133 ceph-mon[125939]: pgmap v20245: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 517 KiB/s rd, 515 KiB/s wr, 7 op/s 2023-05-08T14:15:22.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:22 smithi096 ceph-mon[124666]: pgmap v20245: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 517 KiB/s rd, 515 KiB/s wr, 7 op/s 2023-05-08T14:15:22.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:22 smithi186 ceph-mon[126480]: pgmap v20245: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 517 KiB/s rd, 515 KiB/s wr, 7 op/s 2023-05-08T14:15:24.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:24 smithi133 ceph-mon[125939]: pgmap v20246: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 517 KiB/s rd, 516 KiB/s wr, 7 op/s 2023-05-08T14:15:24.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37863.436409 secs 2023-05-08T14:15:24.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:24 smithi096 ceph-mon[124666]: pgmap v20246: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 517 KiB/s rd, 516 KiB/s wr, 7 op/s 2023-05-08T14:15:24.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37863.436409 secs 2023-05-08T14:15:24.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:24 smithi186 ceph-mon[126480]: pgmap v20246: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 517 KiB/s rd, 516 KiB/s wr, 7 op/s 2023-05-08T14:15:24.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37863.436409 secs 2023-05-08T14:15:25.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:25 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:15:25.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:25 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:15:25.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:25 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:15:26.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:26 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:15:26.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:26 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:15:26.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:26 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:15:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:26 smithi133 ceph-mon[125939]: pgmap v20247: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 14 op/s 2023-05-08T14:15:26.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:26 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:15:26.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:26 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:15:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:26 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:15:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:26 smithi096 ceph-mon[124666]: pgmap v20247: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 14 op/s 2023-05-08T14:15:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:26 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:15:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:26 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:15:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:26 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:15:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:26 smithi186 ceph-mon[126480]: pgmap v20247: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 14 op/s 2023-05-08T14:15:28.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:28 smithi133 ceph-mon[125939]: pgmap v20248: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 883 KiB/s rd, 903 KiB/s wr, 10 op/s 2023-05-08T14:15:28.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:28 smithi096 ceph-mon[124666]: pgmap v20248: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 883 KiB/s rd, 903 KiB/s wr, 10 op/s 2023-05-08T14:15:28.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:28 smithi186 ceph-mon[126480]: pgmap v20248: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 883 KiB/s rd, 903 KiB/s wr, 10 op/s 2023-05-08T14:15:29.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37868.436524 secs 2023-05-08T14:15:29.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37868.436524 secs 2023-05-08T14:15:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37868.436524 secs 2023-05-08T14:15:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:30 smithi133 ceph-mon[125939]: pgmap v20249: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 982 KiB/s wr, 15 op/s 2023-05-08T14:15:30.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:30 smithi096 ceph-mon[124666]: pgmap v20249: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 982 KiB/s wr, 15 op/s 2023-05-08T14:15:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:30 smithi186 ceph-mon[126480]: pgmap v20249: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 982 KiB/s wr, 15 op/s 2023-05-08T14:15:31.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:31 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:15:31.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:31 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:15:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:31 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:15:31.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:31 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:15:31.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:31 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:15:31.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:31 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:15:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:31 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:15:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:31 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:15:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:31 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:15:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:31 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:15:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:31 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:15:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:31 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:15:32.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:32 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:15:32.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:32 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T14:15:32.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:32 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T14:15:32.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:32 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:15:32.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:32 smithi133 ceph-mon[125939]: pgmap v20250: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 982 KiB/s wr, 12 op/s 2023-05-08T14:15:32.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:32 smithi133 ceph-mon[125939]: osdmap e1342: 12 total, 12 up, 12 in 2023-05-08T14:15:32.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:32 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:15:32.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:32 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T14:15:32.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:32 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T14:15:32.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:32 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:15:32.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:32 smithi096 ceph-mon[124666]: pgmap v20250: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 982 KiB/s wr, 12 op/s 2023-05-08T14:15:32.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:32 smithi096 ceph-mon[124666]: osdmap e1342: 12 total, 12 up, 12 in 2023-05-08T14:15:32.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:32 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:15:32.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:32 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T14:15:32.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:32 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T14:15:32.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:32 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:15:32.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:32 smithi186 ceph-mon[126480]: pgmap v20250: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 982 KiB/s wr, 12 op/s 2023-05-08T14:15:32.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:32 smithi186 ceph-mon[126480]: osdmap e1342: 12 total, 12 up, 12 in 2023-05-08T14:15:34.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:34 smithi133 ceph-mon[125939]: pgmap v20252: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2023-05-08T14:15:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37873.436672 secs 2023-05-08T14:15:34.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:34 smithi096 ceph-mon[124666]: pgmap v20252: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2023-05-08T14:15:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37873.436672 secs 2023-05-08T14:15:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:34 smithi186 ceph-mon[126480]: pgmap v20252: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2023-05-08T14:15:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37873.436672 secs 2023-05-08T14:15:36.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:36 smithi133 ceph-mon[125939]: pgmap v20253: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 918 KiB/s rd, 619 KiB/s wr, 11 op/s 2023-05-08T14:15:36.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:36 smithi096 ceph-mon[124666]: pgmap v20253: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 918 KiB/s rd, 619 KiB/s wr, 11 op/s 2023-05-08T14:15:36.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:36 smithi186 ceph-mon[126480]: pgmap v20253: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 918 KiB/s rd, 619 KiB/s wr, 11 op/s 2023-05-08T14:15:38.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:38 smithi133 ceph-mon[125939]: pgmap v20254: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 918 KiB/s rd, 619 KiB/s wr, 11 op/s 2023-05-08T14:15:38.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:38 smithi133 ceph-mon[125939]: osdmap e1343: 12 total, 12 up, 12 in 2023-05-08T14:15:38.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:38 smithi096 ceph-mon[124666]: pgmap v20254: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 918 KiB/s rd, 619 KiB/s wr, 11 op/s 2023-05-08T14:15:38.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:38 smithi096 ceph-mon[124666]: osdmap e1343: 12 total, 12 up, 12 in 2023-05-08T14:15:38.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:38 smithi186 ceph-mon[126480]: pgmap v20254: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 918 KiB/s rd, 619 KiB/s wr, 11 op/s 2023-05-08T14:15:38.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:38 smithi186 ceph-mon[126480]: osdmap e1343: 12 total, 12 up, 12 in 2023-05-08T14:15:39.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37878.436794 secs 2023-05-08T14:15:39.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37878.436794 secs 2023-05-08T14:15:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37878.436794 secs 2023-05-08T14:15:40.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:40 smithi133 ceph-mon[125939]: pgmap v20256: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 920 KiB/s wr, 14 op/s 2023-05-08T14:15:40.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:40 smithi096 ceph-mon[124666]: pgmap v20256: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 920 KiB/s wr, 14 op/s 2023-05-08T14:15:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:40 smithi186 ceph-mon[126480]: pgmap v20256: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 920 KiB/s wr, 14 op/s 2023-05-08T14:15:41.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:41 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:15:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:41 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:15:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:41 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:15:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:41 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:15:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:41 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:15:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:41 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:15:41.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:41 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:15:41.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:41 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:15:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:41 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:15:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:42 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37880.332117 secs 2023-05-08T14:15:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:42 smithi096 ceph-mon[124666]: pgmap v20257: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 883 KiB/s rd, 742 KiB/s wr, 11 op/s 2023-05-08T14:15:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:42 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37880.332117 secs 2023-05-08T14:15:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:42 smithi186 ceph-mon[126480]: pgmap v20257: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 883 KiB/s rd, 742 KiB/s wr, 11 op/s 2023-05-08T14:15:42.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:42 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37880.332117 secs 2023-05-08T14:15:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:42 smithi133 ceph-mon[125939]: pgmap v20257: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 883 KiB/s rd, 742 KiB/s wr, 11 op/s 2023-05-08T14:15:44.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:44 smithi133 ceph-mon[125939]: pgmap v20258: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 876 KiB/s rd, 736 KiB/s wr, 11 op/s 2023-05-08T14:15:44.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37883.436921 secs 2023-05-08T14:15:44.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:44 smithi096 ceph-mon[124666]: pgmap v20258: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 876 KiB/s rd, 736 KiB/s wr, 11 op/s 2023-05-08T14:15:44.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37883.436921 secs 2023-05-08T14:15:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:44 smithi186 ceph-mon[126480]: pgmap v20258: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 876 KiB/s rd, 736 KiB/s wr, 11 op/s 2023-05-08T14:15:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37883.436921 secs 2023-05-08T14:15:46.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37883.991306 secs 2023-05-08T14:15:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:46 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:15:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:46 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:15:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:46 smithi133 ceph-mon[125939]: pgmap v20259: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T14:15:46.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37883.991306 secs 2023-05-08T14:15:46.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:46 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:15:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:46 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:15:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:46 smithi096 ceph-mon[124666]: pgmap v20259: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T14:15:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37883.991306 secs 2023-05-08T14:15:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:46 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:15:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:46 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:15:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:46 smithi186 ceph-mon[126480]: pgmap v20259: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T14:15:47.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:47 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37885.332259 secs 2023-05-08T14:15:47.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:47 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37885.332259 secs 2023-05-08T14:15:47.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:47 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37885.332259 secs 2023-05-08T14:15:48.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:48 smithi133 ceph-mon[125939]: pgmap v20260: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T14:15:48.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:48 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:15:48.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:48 smithi096 ceph-mon[124666]: pgmap v20260: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T14:15:48.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:48 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:15:48.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:48 smithi186 ceph-mon[126480]: pgmap v20260: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T14:15:48.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:48 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:15:49.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37888.437068 secs 2023-05-08T14:15:49.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37888.437068 secs 2023-05-08T14:15:49.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37888.437068 secs 2023-05-08T14:15:50.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:50 smithi133 ceph-mon[125939]: pgmap v20261: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 MiB/s wr, 15 op/s 2023-05-08T14:15:50.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:50 smithi096 ceph-mon[124666]: pgmap v20261: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 MiB/s wr, 15 op/s 2023-05-08T14:15:50.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:50 smithi186 ceph-mon[126480]: pgmap v20261: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 MiB/s wr, 15 op/s 2023-05-08T14:15:52.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:52 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37890.332378 secs 2023-05-08T14:15:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:52 smithi133 ceph-mon[125939]: pgmap v20262: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 11 op/s 2023-05-08T14:15:52.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:52 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37890.332378 secs 2023-05-08T14:15:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:52 smithi096 ceph-mon[124666]: pgmap v20262: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 11 op/s 2023-05-08T14:15:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:52 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37890.332378 secs 2023-05-08T14:15:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:52 smithi186 ceph-mon[126480]: pgmap v20262: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 11 op/s 2023-05-08T14:15:54.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:54 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:15:54.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:54 smithi133 ceph-mon[125939]: pgmap v20263: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 10 op/s 2023-05-08T14:15:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37893.437184 secs 2023-05-08T14:15:54.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:54 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:15:54.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:54 smithi096 ceph-mon[124666]: pgmap v20263: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 10 op/s 2023-05-08T14:15:54.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37893.437184 secs 2023-05-08T14:15:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:54 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:15:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:54 smithi186 ceph-mon[126480]: pgmap v20263: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 10 op/s 2023-05-08T14:15:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37893.437184 secs 2023-05-08T14:15:55.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:55 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:15:55.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:55 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:15:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:55 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:15:55.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:55 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:15:55.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:55 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:15:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:55 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:15:55.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:55 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:15:55.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:55 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:15:55.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:55 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:15:56.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:56 smithi133 ceph-mon[125939]: pgmap v20264: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.5 MiB/s wr, 16 op/s 2023-05-08T14:15:56.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:56 smithi096 ceph-mon[124666]: pgmap v20264: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.5 MiB/s wr, 16 op/s 2023-05-08T14:15:56.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:56 smithi186 ceph-mon[126480]: pgmap v20264: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.5 MiB/s wr, 16 op/s 2023-05-08T14:15:57.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:57 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37895.332475 secs 2023-05-08T14:15:57.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:57 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37895.332475 secs 2023-05-08T14:15:57.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:57 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37895.332475 secs 2023-05-08T14:15:58.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:58 smithi133 ceph-mon[125939]: pgmap v20265: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 11 op/s 2023-05-08T14:15:58.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:58 smithi096 ceph-mon[124666]: pgmap v20265: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 11 op/s 2023-05-08T14:15:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:58 smithi186 ceph-mon[126480]: pgmap v20265: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 11 op/s 2023-05-08T14:15:59.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:15:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37898.437307 secs 2023-05-08T14:15:59.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:15:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37898.437307 secs 2023-05-08T14:15:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:15:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37898.437307 secs 2023-05-08T14:16:00.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:00 smithi133 ceph-mon[125939]: pgmap v20266: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.2 MiB/s wr, 16 op/s 2023-05-08T14:16:00.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:00 smithi096 ceph-mon[124666]: pgmap v20266: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.2 MiB/s wr, 16 op/s 2023-05-08T14:16:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:00 smithi186 ceph-mon[126480]: pgmap v20266: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.2 MiB/s wr, 16 op/s 2023-05-08T14:16:01.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37898.991648 secs 2023-05-08T14:16:01.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37898.991648 secs 2023-05-08T14:16:01.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37898.991648 secs 2023-05-08T14:16:02.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:02 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37900.332586 secs 2023-05-08T14:16:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:02 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:16:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:16:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:16:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:02 smithi133 ceph-mon[125939]: pgmap v20267: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T14:16:02.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:02 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37900.332586 secs 2023-05-08T14:16:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:02 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:16:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:16:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:16:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:02 smithi096 ceph-mon[124666]: pgmap v20267: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T14:16:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:02 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37900.332586 secs 2023-05-08T14:16:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:02 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:16:02.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:16:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:16:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:02 smithi186 ceph-mon[126480]: pgmap v20267: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T14:16:04.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:04 smithi133 ceph-mon[125939]: pgmap v20268: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 933 KiB/s wr, 11 op/s 2023-05-08T14:16:04.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37903.437434 secs 2023-05-08T14:16:04.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:04 smithi096 ceph-mon[124666]: pgmap v20268: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 933 KiB/s wr, 11 op/s 2023-05-08T14:16:04.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37903.437434 secs 2023-05-08T14:16:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:04 smithi186 ceph-mon[126480]: pgmap v20268: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 933 KiB/s wr, 11 op/s 2023-05-08T14:16:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37903.437434 secs 2023-05-08T14:16:05.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:05 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:16:05.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:05 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:16:05.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:05 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:16:06.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:16:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:16:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:06 smithi133 ceph-mon[125939]: pgmap v20269: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.1 MiB/s wr, 29 op/s 2023-05-08T14:16:06.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:16:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:16:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:06 smithi096 ceph-mon[124666]: pgmap v20269: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.1 MiB/s wr, 29 op/s 2023-05-08T14:16:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:16:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:16:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:06 smithi186 ceph-mon[126480]: pgmap v20269: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.1 MiB/s wr, 29 op/s 2023-05-08T14:16:08.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:08 smithi133 ceph-mon[125939]: pgmap v20270: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 23 op/s 2023-05-08T14:16:08.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:08 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:16:08.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:08 smithi096 ceph-mon[124666]: pgmap v20270: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 23 op/s 2023-05-08T14:16:08.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:08 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:16:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:08 smithi186 ceph-mon[126480]: pgmap v20270: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 23 op/s 2023-05-08T14:16:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:08 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:16:09.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37908.437500 secs 2023-05-08T14:16:09.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:09 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:16:09.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37908.437500 secs 2023-05-08T14:16:09.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:09 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:16:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37908.437500 secs 2023-05-08T14:16:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:09 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:16:10.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:10 smithi133 ceph-mon[125939]: pgmap v20271: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.0 MiB/s wr, 28 op/s 2023-05-08T14:16:10.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:10 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:16:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:10 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:16:10.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:10 smithi096 ceph-mon[124666]: pgmap v20271: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.0 MiB/s wr, 28 op/s 2023-05-08T14:16:10.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:10 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:16:10.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:10 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:16:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:10 smithi186 ceph-mon[126480]: pgmap v20271: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.0 MiB/s wr, 28 op/s 2023-05-08T14:16:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:10 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:16:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:10 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:16:12.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:12 smithi133 ceph-mon[125939]: pgmap v20272: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 22 op/s 2023-05-08T14:16:12.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:12 smithi096 ceph-mon[124666]: pgmap v20272: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 22 op/s 2023-05-08T14:16:12.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:12 smithi186 ceph-mon[126480]: pgmap v20272: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 22 op/s 2023-05-08T14:16:13.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:13 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:16:13.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:13 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:16:13.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:13 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:16:14.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:14 smithi133 ceph-mon[125939]: pgmap v20273: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 22 op/s 2023-05-08T14:16:14.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37913.437589 secs 2023-05-08T14:16:14.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:14 smithi096 ceph-mon[124666]: pgmap v20273: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 22 op/s 2023-05-08T14:16:14.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37913.437589 secs 2023-05-08T14:16:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:14 smithi186 ceph-mon[126480]: pgmap v20273: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 22 op/s 2023-05-08T14:16:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37913.437589 secs 2023-05-08T14:16:16.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:16 smithi133 ceph-mon[125939]: pgmap v20274: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 25 op/s 2023-05-08T14:16:16.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:16 smithi096 ceph-mon[124666]: pgmap v20274: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 25 op/s 2023-05-08T14:16:16.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:16 smithi186 ceph-mon[126480]: pgmap v20274: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 25 op/s 2023-05-08T14:16:18.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:18 smithi133 ceph-mon[125939]: pgmap v20275: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 682 KiB/s wr, 8 op/s 2023-05-08T14:16:18.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:18 smithi096 ceph-mon[124666]: pgmap v20275: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 682 KiB/s wr, 8 op/s 2023-05-08T14:16:18.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:18 smithi186 ceph-mon[126480]: pgmap v20275: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 682 KiB/s wr, 8 op/s 2023-05-08T14:16:19.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37918.437719 secs 2023-05-08T14:16:19.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37918.437719 secs 2023-05-08T14:16:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37918.437719 secs 2023-05-08T14:16:20.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:20 smithi133 ceph-mon[125939]: pgmap v20276: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 682 KiB/s wr, 11 op/s 2023-05-08T14:16:20.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:20 smithi096 ceph-mon[124666]: pgmap v20276: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 682 KiB/s wr, 11 op/s 2023-05-08T14:16:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:20 smithi186 ceph-mon[126480]: pgmap v20276: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 682 KiB/s wr, 11 op/s 2023-05-08T14:16:21.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:21 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:16:21.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:21 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:16:21.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:21 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:16:21.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:21 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:16:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:21 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:16:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:21 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:16:22.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:21 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:16:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:21 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:16:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:21 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:16:22.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:22 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37920.333017 secs 2023-05-08T14:16:22.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:22 smithi186 ceph-mon[126480]: pgmap v20277: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 326 KiB/s wr, 6 op/s 2023-05-08T14:16:22.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:22 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37920.333017 secs 2023-05-08T14:16:22.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:22 smithi133 ceph-mon[125939]: pgmap v20277: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 326 KiB/s wr, 6 op/s 2023-05-08T14:16:23.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:22 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37920.333017 secs 2023-05-08T14:16:23.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:22 smithi096 ceph-mon[124666]: pgmap v20277: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 326 KiB/s wr, 6 op/s 2023-05-08T14:16:24.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:24 smithi133 ceph-mon[125939]: pgmap v20278: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 326 KiB/s wr, 6 op/s 2023-05-08T14:16:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37923.437836 secs 2023-05-08T14:16:24.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:24 smithi096 ceph-mon[124666]: pgmap v20278: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 326 KiB/s wr, 6 op/s 2023-05-08T14:16:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37923.437836 secs 2023-05-08T14:16:24.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:24 smithi186 ceph-mon[126480]: pgmap v20278: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 326 KiB/s wr, 6 op/s 2023-05-08T14:16:24.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37923.437836 secs 2023-05-08T14:16:26.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37923.992202 secs 2023-05-08T14:16:26.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:26 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:16:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:26 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:16:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:26 smithi133 ceph-mon[125939]: pgmap v20279: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 886 KiB/s rd, 933 KiB/s wr, 13 op/s 2023-05-08T14:16:26.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37923.992202 secs 2023-05-08T14:16:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:26 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:16:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:26 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:16:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:26 smithi096 ceph-mon[124666]: pgmap v20279: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 886 KiB/s rd, 933 KiB/s wr, 13 op/s 2023-05-08T14:16:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37923.992202 secs 2023-05-08T14:16:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:26 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:16:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:26 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:16:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:26 smithi186 ceph-mon[126480]: pgmap v20279: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 886 KiB/s rd, 933 KiB/s wr, 13 op/s 2023-05-08T14:16:27.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:27 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37925.333137 secs 2023-05-08T14:16:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:27 smithi133 ceph-mon[125939]: osdmap e1344: 12 total, 12 up, 12 in 2023-05-08T14:16:27.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:27 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37925.333137 secs 2023-05-08T14:16:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:27 smithi096 ceph-mon[124666]: osdmap e1344: 12 total, 12 up, 12 in 2023-05-08T14:16:27.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:27 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37925.333137 secs 2023-05-08T14:16:27.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:27 smithi186 ceph-mon[126480]: osdmap e1344: 12 total, 12 up, 12 in 2023-05-08T14:16:28.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:28 smithi133 ceph-mon[125939]: pgmap v20281: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 671 KiB/s rd, 728 KiB/s wr, 12 op/s 2023-05-08T14:16:28.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:28 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:16:28.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:28 smithi096 ceph-mon[124666]: pgmap v20281: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 671 KiB/s rd, 728 KiB/s wr, 12 op/s 2023-05-08T14:16:28.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:28 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:16:28.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:28 smithi186 ceph-mon[126480]: pgmap v20281: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 671 KiB/s rd, 728 KiB/s wr, 12 op/s 2023-05-08T14:16:28.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:28 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:16:29.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37928.437974 secs 2023-05-08T14:16:29.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37928.437974 secs 2023-05-08T14:16:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37928.437974 secs 2023-05-08T14:16:30.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:30 smithi133 ceph-mon[125939]: pgmap v20282: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 937 KiB/s rd, 961 KiB/s wr, 14 op/s 2023-05-08T14:16:30.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:30 smithi096 ceph-mon[124666]: pgmap v20282: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 937 KiB/s rd, 961 KiB/s wr, 14 op/s 2023-05-08T14:16:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:30 smithi186 ceph-mon[126480]: pgmap v20282: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 937 KiB/s rd, 961 KiB/s wr, 14 op/s 2023-05-08T14:16:31.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37928.992318 secs 2023-05-08T14:16:31.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37928.992318 secs 2023-05-08T14:16:31.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37928.992318 secs 2023-05-08T14:16:32.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:32 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37930.333279 secs 2023-05-08T14:16:32.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:16:32.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:32 smithi096 ceph-mon[124666]: pgmap v20283: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 937 KiB/s rd, 960 KiB/s wr, 14 op/s 2023-05-08T14:16:32.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:16:32.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:16:32.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:16:32.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:32 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37930.333279 secs 2023-05-08T14:16:32.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:16:32.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:32 smithi186 ceph-mon[126480]: pgmap v20283: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 937 KiB/s rd, 960 KiB/s wr, 14 op/s 2023-05-08T14:16:32.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:16:32.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:16:32.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:16:32.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:32 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37930.333279 secs 2023-05-08T14:16:32.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:16:32.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:32 smithi133 ceph-mon[125939]: pgmap v20283: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 937 KiB/s rd, 960 KiB/s wr, 14 op/s 2023-05-08T14:16:32.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:16:32.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:16:32.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:16:33.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:33 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:16:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:33 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T14:16:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:33 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T14:16:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:33 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:16:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:33 smithi096 ceph-mon[124666]: osdmap e1345: 12 total, 12 up, 12 in 2023-05-08T14:16:33.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:33 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:16:33.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:33 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T14:16:33.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:33 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T14:16:33.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:33 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:16:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:33 smithi186 ceph-mon[126480]: osdmap e1345: 12 total, 12 up, 12 in 2023-05-08T14:16:33.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:33 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:16:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:33 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T14:16:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:33 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T14:16:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:33 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:16:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:33 smithi133 ceph-mon[125939]: osdmap e1345: 12 total, 12 up, 12 in 2023-05-08T14:16:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:34 smithi186 ceph-mon[126480]: pgmap v20285: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 291 KiB/s wr, 6 op/s 2023-05-08T14:16:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37933.438111 secs 2023-05-08T14:16:34.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:34 smithi133 ceph-mon[125939]: pgmap v20285: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 291 KiB/s wr, 6 op/s 2023-05-08T14:16:34.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37933.438111 secs 2023-05-08T14:16:34.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:34 smithi096 ceph-mon[124666]: pgmap v20285: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 291 KiB/s wr, 6 op/s 2023-05-08T14:16:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37933.438111 secs 2023-05-08T14:16:35.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37933.992446 secs 2023-05-08T14:16:35.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37933.992446 secs 2023-05-08T14:16:35.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37933.992446 secs 2023-05-08T14:16:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:36 smithi186 ceph-mon[126480]: pgmap v20286: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 755 KiB/s rd, 717 KiB/s wr, 11 op/s 2023-05-08T14:16:36.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:36 smithi133 ceph-mon[125939]: pgmap v20286: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 755 KiB/s rd, 717 KiB/s wr, 11 op/s 2023-05-08T14:16:36.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:36 smithi096 ceph-mon[124666]: pgmap v20286: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 755 KiB/s rd, 717 KiB/s wr, 11 op/s 2023-05-08T14:16:37.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:37 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37935.333377 secs 2023-05-08T14:16:37.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:37 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37935.333377 secs 2023-05-08T14:16:37.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:37 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37935.333377 secs 2023-05-08T14:16:38.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:38 smithi186 ceph-mon[126480]: pgmap v20287: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 694 KiB/s rd, 659 KiB/s wr, 10 op/s 2023-05-08T14:16:38.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:38 smithi133 ceph-mon[125939]: pgmap v20287: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 694 KiB/s rd, 659 KiB/s wr, 10 op/s 2023-05-08T14:16:38.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:38 smithi096 ceph-mon[124666]: pgmap v20287: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 694 KiB/s rd, 659 KiB/s wr, 10 op/s 2023-05-08T14:16:39.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37938.438242 secs 2023-05-08T14:16:39.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37938.992546 secs 2023-05-08T14:16:39.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37938.438242 secs 2023-05-08T14:16:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37938.992546 secs 2023-05-08T14:16:39.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37938.438242 secs 2023-05-08T14:16:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37938.992546 secs 2023-05-08T14:16:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:40 smithi186 ceph-mon[126480]: pgmap v20288: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 1.0 MiB/s wr, 8 op/s 2023-05-08T14:16:40.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:40 smithi133 ceph-mon[125939]: pgmap v20288: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 1.0 MiB/s wr, 8 op/s 2023-05-08T14:16:40.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:40 smithi096 ceph-mon[124666]: pgmap v20288: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 1.0 MiB/s wr, 8 op/s 2023-05-08T14:16:42.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:42 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37940.333477 secs 2023-05-08T14:16:42.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:42 smithi133 ceph-mon[125939]: pgmap v20289: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 1.0 MiB/s wr, 8 op/s 2023-05-08T14:16:42.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:42 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37940.333477 secs 2023-05-08T14:16:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:42 smithi096 ceph-mon[124666]: pgmap v20289: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 1.0 MiB/s wr, 8 op/s 2023-05-08T14:16:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:42 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37940.333477 secs 2023-05-08T14:16:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:42 smithi186 ceph-mon[126480]: pgmap v20289: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 1.0 MiB/s wr, 8 op/s 2023-05-08T14:16:44.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:44 smithi133 ceph-mon[125939]: pgmap v20290: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 418 KiB/s rd, 1.0 MiB/s wr, 8 op/s 2023-05-08T14:16:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37943.438367 secs 2023-05-08T14:16:44.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:44 smithi096 ceph-mon[124666]: pgmap v20290: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 418 KiB/s rd, 1.0 MiB/s wr, 8 op/s 2023-05-08T14:16:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37943.438367 secs 2023-05-08T14:16:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:44 smithi186 ceph-mon[126480]: pgmap v20290: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 418 KiB/s rd, 1.0 MiB/s wr, 8 op/s 2023-05-08T14:16:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37943.438367 secs 2023-05-08T14:16:45.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37943.992671 secs 2023-05-08T14:16:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37943.992671 secs 2023-05-08T14:16:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37943.992671 secs 2023-05-08T14:16:46.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:46 smithi133 ceph-mon[125939]: pgmap v20291: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 885 KiB/s rd, 882 KiB/s wr, 11 op/s 2023-05-08T14:16:46.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:46 smithi096 ceph-mon[124666]: pgmap v20291: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 885 KiB/s rd, 882 KiB/s wr, 11 op/s 2023-05-08T14:16:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:46 smithi186 ceph-mon[126480]: pgmap v20291: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 885 KiB/s rd, 882 KiB/s wr, 11 op/s 2023-05-08T14:16:48.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:48 smithi133 ceph-mon[125939]: pgmap v20292: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 529 KiB/s rd, 527 KiB/s wr, 6 op/s 2023-05-08T14:16:48.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:48 smithi096 ceph-mon[124666]: pgmap v20292: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 529 KiB/s rd, 527 KiB/s wr, 6 op/s 2023-05-08T14:16:48.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:48 smithi186 ceph-mon[126480]: pgmap v20292: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 529 KiB/s rd, 527 KiB/s wr, 6 op/s 2023-05-08T14:16:49.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37948.438507 secs 2023-05-08T14:16:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:16:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37948.992799 secs 2023-05-08T14:16:49.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37948.438507 secs 2023-05-08T14:16:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:16:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37948.992799 secs 2023-05-08T14:16:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37948.438507 secs 2023-05-08T14:16:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:16:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37948.992799 secs 2023-05-08T14:16:50.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:50 smithi133 ceph-mon[125939]: pgmap v20293: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 909 KiB/s wr, 10 op/s 2023-05-08T14:16:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:16:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:16:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:16:50.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:50 smithi096 ceph-mon[124666]: pgmap v20293: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 909 KiB/s wr, 10 op/s 2023-05-08T14:16:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:16:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:16:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:16:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:50 smithi186 ceph-mon[126480]: pgmap v20293: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 909 KiB/s wr, 10 op/s 2023-05-08T14:16:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:16:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:16:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:16:52.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:52 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37950.333716 secs 2023-05-08T14:16:52.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:52 smithi133 ceph-mon[125939]: pgmap v20294: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 383 KiB/s wr, 7 op/s 2023-05-08T14:16:52.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:52 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37950.333716 secs 2023-05-08T14:16:52.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:52 smithi096 ceph-mon[124666]: pgmap v20294: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 383 KiB/s wr, 7 op/s 2023-05-08T14:16:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:52 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37950.333716 secs 2023-05-08T14:16:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:52 smithi186 ceph-mon[126480]: pgmap v20294: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 383 KiB/s wr, 7 op/s 2023-05-08T14:16:54.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:54 smithi133 ceph-mon[125939]: pgmap v20295: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 383 KiB/s wr, 7 op/s 2023-05-08T14:16:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:54 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:16:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:54 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:16:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37953.438644 secs 2023-05-08T14:16:54.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:54 smithi096 ceph-mon[124666]: pgmap v20295: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 383 KiB/s wr, 7 op/s 2023-05-08T14:16:54.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:54 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:16:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:54 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:16:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37953.438644 secs 2023-05-08T14:16:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:54 smithi186 ceph-mon[126480]: pgmap v20295: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 383 KiB/s wr, 7 op/s 2023-05-08T14:16:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:54 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:16:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:54 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:16:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37953.438644 secs 2023-05-08T14:16:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:56 smithi133 ceph-mon[125939]: pgmap v20296: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 16 op/s 2023-05-08T14:16:56.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:56 smithi096 ceph-mon[124666]: pgmap v20296: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 16 op/s 2023-05-08T14:16:56.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:56 smithi186 ceph-mon[126480]: pgmap v20296: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 16 op/s 2023-05-08T14:16:57.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:16:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:16:57.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:16:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:16:57.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:16:57.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:16:58.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:58 smithi133 ceph-mon[125939]: pgmap v20297: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 886 KiB/s rd, 1.5 MiB/s wr, 12 op/s 2023-05-08T14:16:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:58 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:16:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:16:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:16:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:16:58.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:58 smithi096 ceph-mon[124666]: pgmap v20297: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 886 KiB/s rd, 1.5 MiB/s wr, 12 op/s 2023-05-08T14:16:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:58 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:16:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:16:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:16:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:16:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:58 smithi186 ceph-mon[126480]: pgmap v20297: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 886 KiB/s rd, 1.5 MiB/s wr, 12 op/s 2023-05-08T14:16:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:58 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:16:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:16:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:16:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:16:59.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37958.438725 secs 2023-05-08T14:16:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:16:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37958.993032 secs 2023-05-08T14:16:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37958.438725 secs 2023-05-08T14:16:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:16:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37958.993032 secs 2023-05-08T14:16:59.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37958.438725 secs 2023-05-08T14:16:59.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:16:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37958.993032 secs 2023-05-08T14:17:00.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:00 smithi096 ceph-mon[124666]: pgmap v20298: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 33 op/s 2023-05-08T14:17:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:00 smithi186 ceph-mon[126480]: pgmap v20298: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 33 op/s 2023-05-08T14:17:00.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:00 smithi133 ceph-mon[125939]: pgmap v20298: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 33 op/s 2023-05-08T14:17:02.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:02 smithi096 ceph-mon[124666]: pgmap v20299: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 28 op/s 2023-05-08T14:17:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:17:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:17:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:02 smithi186 ceph-mon[126480]: pgmap v20299: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 28 op/s 2023-05-08T14:17:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:17:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:17:02.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:02 smithi133 ceph-mon[125939]: pgmap v20299: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 28 op/s 2023-05-08T14:17:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:17:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:17:03.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:03 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:17:03.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:03 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:17:03.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:03 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:17:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:04 smithi186 ceph-mon[126480]: pgmap v20300: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 28 op/s 2023-05-08T14:17:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37963.438879 secs 2023-05-08T14:17:04.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:04 smithi133 ceph-mon[125939]: pgmap v20300: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 28 op/s 2023-05-08T14:17:04.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37963.438879 secs 2023-05-08T14:17:05.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:04 smithi096 ceph-mon[124666]: pgmap v20300: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 28 op/s 2023-05-08T14:17:05.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37963.438879 secs 2023-05-08T14:17:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:05 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:17:05.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:05 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:17:06.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:05 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:17:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:06 smithi186 ceph-mon[126480]: pgmap v20301: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.2 MiB/s wr, 47 op/s 2023-05-08T14:17:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:17:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:17:06.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:06 smithi133 ceph-mon[125939]: pgmap v20301: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.2 MiB/s wr, 47 op/s 2023-05-08T14:17:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:17:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:17:07.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:06 smithi096 ceph-mon[124666]: pgmap v20301: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.2 MiB/s wr, 47 op/s 2023-05-08T14:17:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:17:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:17:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:08 smithi186 ceph-mon[126480]: pgmap v20302: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 38 op/s 2023-05-08T14:17:08.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:08 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:17:08.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:08 smithi133 ceph-mon[125939]: pgmap v20302: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 38 op/s 2023-05-08T14:17:08.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:08 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:17:09.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:08 smithi096 ceph-mon[124666]: pgmap v20302: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 38 op/s 2023-05-08T14:17:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:08 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:17:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37968.438950 secs 2023-05-08T14:17:09.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37968.438950 secs 2023-05-08T14:17:10.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37968.438950 secs 2023-05-08T14:17:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:10 smithi186 ceph-mon[126480]: pgmap v20303: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 2.4 MiB/s wr, 44 op/s 2023-05-08T14:17:10.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:10 smithi133 ceph-mon[125939]: pgmap v20303: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 2.4 MiB/s wr, 44 op/s 2023-05-08T14:17:11.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:10 smithi096 ceph-mon[124666]: pgmap v20303: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 2.4 MiB/s wr, 44 op/s 2023-05-08T14:17:12.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:12 smithi186 ceph-mon[126480]: pgmap v20304: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.5 MiB/s wr, 23 op/s 2023-05-08T14:17:12.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:12 smithi133 ceph-mon[125939]: pgmap v20304: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.5 MiB/s wr, 23 op/s 2023-05-08T14:17:13.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:12 smithi096 ceph-mon[124666]: pgmap v20304: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.5 MiB/s wr, 23 op/s 2023-05-08T14:17:14.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:14 smithi133 ceph-mon[125939]: pgmap v20305: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.5 MiB/s wr, 23 op/s 2023-05-08T14:17:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37973.439069 secs 2023-05-08T14:17:14.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:14 smithi096 ceph-mon[124666]: pgmap v20305: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.5 MiB/s wr, 23 op/s 2023-05-08T14:17:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37973.439069 secs 2023-05-08T14:17:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:14 smithi186 ceph-mon[126480]: pgmap v20305: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.5 MiB/s wr, 23 op/s 2023-05-08T14:17:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37973.439069 secs 2023-05-08T14:17:16.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:16 smithi133 ceph-mon[125939]: pgmap v20306: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 1.9 MiB/s wr, 27 op/s 2023-05-08T14:17:16.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:16 smithi096 ceph-mon[124666]: pgmap v20306: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 1.9 MiB/s wr, 27 op/s 2023-05-08T14:17:16.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:16 smithi186 ceph-mon[126480]: pgmap v20306: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 1.9 MiB/s wr, 27 op/s 2023-05-08T14:17:18.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:18 smithi133 ceph-mon[125939]: pgmap v20307: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 781 KiB/s wr, 9 op/s 2023-05-08T14:17:18.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:18 smithi096 ceph-mon[124666]: pgmap v20307: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 781 KiB/s wr, 9 op/s 2023-05-08T14:17:18.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:18 smithi186 ceph-mon[126480]: pgmap v20307: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 781 KiB/s wr, 9 op/s 2023-05-08T14:17:19.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37978.439168 secs 2023-05-08T14:17:19.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37978.439168 secs 2023-05-08T14:17:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37978.439168 secs 2023-05-08T14:17:20.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:20 smithi133 ceph-mon[125939]: pgmap v20308: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T14:17:20.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:20 smithi096 ceph-mon[124666]: pgmap v20308: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T14:17:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:20 smithi186 ceph-mon[126480]: pgmap v20308: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T14:17:22.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:22 smithi133 ceph-mon[125939]: pgmap v20309: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 873 KiB/s rd, 817 KiB/s wr, 8 op/s 2023-05-08T14:17:22.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:22 smithi096 ceph-mon[124666]: pgmap v20309: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 873 KiB/s rd, 817 KiB/s wr, 8 op/s 2023-05-08T14:17:22.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:22 smithi186 ceph-mon[126480]: pgmap v20309: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 873 KiB/s rd, 817 KiB/s wr, 8 op/s 2023-05-08T14:17:24.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:24 smithi133 ceph-mon[125939]: pgmap v20310: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 873 KiB/s rd, 817 KiB/s wr, 8 op/s 2023-05-08T14:17:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37983.439268 secs 2023-05-08T14:17:24.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:24 smithi096 ceph-mon[124666]: pgmap v20310: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 873 KiB/s rd, 817 KiB/s wr, 8 op/s 2023-05-08T14:17:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37983.439268 secs 2023-05-08T14:17:24.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:24 smithi186 ceph-mon[126480]: pgmap v20310: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 873 KiB/s rd, 817 KiB/s wr, 8 op/s 2023-05-08T14:17:24.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37983.439268 secs 2023-05-08T14:17:25.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37983.993576 secs 2023-05-08T14:17:25.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37983.993576 secs 2023-05-08T14:17:25.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37983.993576 secs 2023-05-08T14:17:26.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:26 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:17:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:26 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:17:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:26 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:17:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:26 smithi133 ceph-mon[125939]: pgmap v20311: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 15 op/s 2023-05-08T14:17:26.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:26 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:17:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:26 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:17:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:26 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:17:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:26 smithi096 ceph-mon[124666]: pgmap v20311: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 15 op/s 2023-05-08T14:17:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:26 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:17:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:26 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:17:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:26 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:17:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:26 smithi186 ceph-mon[126480]: pgmap v20311: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 15 op/s 2023-05-08T14:17:27.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:27 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37985.334510 secs 2023-05-08T14:17:27.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:27 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37985.334510 secs 2023-05-08T14:17:27.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:27 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37985.334510 secs 2023-05-08T14:17:28.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:28 smithi133 ceph-mon[125939]: pgmap v20312: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T14:17:28.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:28 smithi096 ceph-mon[124666]: pgmap v20312: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T14:17:28.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:28 smithi186 ceph-mon[126480]: pgmap v20312: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T14:17:29.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37988.439341 secs 2023-05-08T14:17:29.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37988.439341 secs 2023-05-08T14:17:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37988.439341 secs 2023-05-08T14:17:30.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:30 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:17:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:30 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:17:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37988.993692 secs 2023-05-08T14:17:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:30 smithi133 ceph-mon[125939]: pgmap v20313: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.2 MiB/s wr, 16 op/s 2023-05-08T14:17:30.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:30 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:17:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:30 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:17:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37988.993692 secs 2023-05-08T14:17:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:30 smithi096 ceph-mon[124666]: pgmap v20313: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.2 MiB/s wr, 16 op/s 2023-05-08T14:17:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:30 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:17:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:30 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:17:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37988.993692 secs 2023-05-08T14:17:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:30 smithi186 ceph-mon[126480]: pgmap v20313: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.2 MiB/s wr, 16 op/s 2023-05-08T14:17:32.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:32 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37990.334652 secs 2023-05-08T14:17:32.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:32 smithi133 ceph-mon[125939]: osdmap e1346: 12 total, 12 up, 12 in 2023-05-08T14:17:32.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:32 smithi133 ceph-mon[125939]: pgmap v20315: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T14:17:32.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:17:32.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:32 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37990.334652 secs 2023-05-08T14:17:32.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:32 smithi096 ceph-mon[124666]: osdmap e1346: 12 total, 12 up, 12 in 2023-05-08T14:17:32.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:32 smithi096 ceph-mon[124666]: pgmap v20315: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T14:17:32.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:17:32.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:32 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37990.334652 secs 2023-05-08T14:17:32.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:32 smithi186 ceph-mon[126480]: osdmap e1346: 12 total, 12 up, 12 in 2023-05-08T14:17:32.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:32 smithi186 ceph-mon[126480]: pgmap v20315: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T14:17:32.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:17:33.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:33 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:17:33.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:33 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:17:33.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:33 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:17:34.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:34 smithi133 ceph-mon[125939]: pgmap v20316: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T14:17:34.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37993.439462 secs 2023-05-08T14:17:34.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:34 smithi096 ceph-mon[124666]: pgmap v20316: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T14:17:34.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37993.439462 secs 2023-05-08T14:17:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:34 smithi186 ceph-mon[126480]: pgmap v20316: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T14:17:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37993.439462 secs 2023-05-08T14:17:35.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37993.993776 secs 2023-05-08T14:17:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:17:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:17:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:17:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:17:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:17:35.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:17:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37993.993776 secs 2023-05-08T14:17:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:17:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:17:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:17:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:17:35.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:17:35.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:17:35.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37993.993776 secs 2023-05-08T14:17:35.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:17:35.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:17:35.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:17:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:17:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:17:35.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:17:36.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:17:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:36 smithi133 ceph-mon[125939]: pgmap v20317: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 196 KiB/s wr, 9 op/s 2023-05-08T14:17:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:17:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:17:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:17:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:17:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:36 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi186 to 83506k 2023-05-08T14:17:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:36 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi186 to 85510541: error parsing value: Value '85510541' is below minimum 939524096 2023-05-08T14:17:36.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:17:36.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:17:36.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:17:36.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:17:36.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:17:36.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:17:36.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:17:36.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:17:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:36 smithi096 ceph-mon[124666]: pgmap v20317: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 196 KiB/s wr, 9 op/s 2023-05-08T14:17:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:17:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:17:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:17:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:17:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:36 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi186 to 83506k 2023-05-08T14:17:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:36 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi186 to 85510541: error parsing value: Value '85510541' is below minimum 939524096 2023-05-08T14:17:36.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:17:36.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:17:36.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:17:36.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:17:36.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:17:36.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:17:36.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:17:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:17:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:36 smithi186 ceph-mon[126480]: pgmap v20317: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 196 KiB/s wr, 9 op/s 2023-05-08T14:17:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:17:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:17:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:17:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:17:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:36 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi186 to 83506k 2023-05-08T14:17:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:36 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi186 to 85510541: error parsing value: Value '85510541' is below minimum 939524096 2023-05-08T14:17:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:17:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:17:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:17:36.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:17:36.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:17:36.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:17:36.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:17:37.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:37 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37995.334769 secs 2023-05-08T14:17:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:37 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi133 to 110.9M 2023-05-08T14:17:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:37 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi133 to 116363415: error parsing value: Value '116363415' is below minimum 939524096 2023-05-08T14:17:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:37 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:17:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:37 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T14:17:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:37 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T14:17:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:37 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:17:37.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:37 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37995.334769 secs 2023-05-08T14:17:37.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:37 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi133 to 110.9M 2023-05-08T14:17:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:37 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi133 to 116363415: error parsing value: Value '116363415' is below minimum 939524096 2023-05-08T14:17:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:37 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:17:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:37 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T14:17:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:37 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T14:17:37.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:37 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:17:37.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:37 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37995.334769 secs 2023-05-08T14:17:37.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:37 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi133 to 110.9M 2023-05-08T14:17:37.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:37 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi133 to 116363415: error parsing value: Value '116363415' is below minimum 939524096 2023-05-08T14:17:37.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:37 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:17:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:37 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T14:17:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:37 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T14:17:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:37 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:17:38.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:38 smithi096 ceph-mon[124666]: pgmap v20318: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 196 KiB/s wr, 9 op/s 2023-05-08T14:17:38.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:38 smithi186 ceph-mon[126480]: pgmap v20318: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 196 KiB/s wr, 9 op/s 2023-05-08T14:17:38.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:38 smithi133 ceph-mon[125939]: pgmap v20318: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 196 KiB/s wr, 9 op/s 2023-05-08T14:17:39.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37998.439533 secs 2023-05-08T14:17:39.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37998.439533 secs 2023-05-08T14:17:39.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37998.439533 secs 2023-05-08T14:17:40.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 37998.993841 secs 2023-05-08T14:17:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:40 smithi096 ceph-mon[124666]: pgmap v20319: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 596 KiB/s rd, 594 KiB/s wr, 9 op/s 2023-05-08T14:17:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 37998.993841 secs 2023-05-08T14:17:40.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:40 smithi186 ceph-mon[126480]: pgmap v20319: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 596 KiB/s rd, 594 KiB/s wr, 9 op/s 2023-05-08T14:17:40.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 37998.993841 secs 2023-05-08T14:17:40.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:40 smithi133 ceph-mon[125939]: pgmap v20319: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 596 KiB/s rd, 594 KiB/s wr, 9 op/s 2023-05-08T14:17:42.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:42 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38000.334890 secs 2023-05-08T14:17:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:42 smithi133 ceph-mon[125939]: pgmap v20320: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 584 KiB/s rd, 581 KiB/s wr, 9 op/s 2023-05-08T14:17:42.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:42 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38000.334890 secs 2023-05-08T14:17:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:42 smithi096 ceph-mon[124666]: pgmap v20320: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 584 KiB/s rd, 581 KiB/s wr, 9 op/s 2023-05-08T14:17:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:42 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38000.334890 secs 2023-05-08T14:17:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:42 smithi186 ceph-mon[126480]: pgmap v20320: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 584 KiB/s rd, 581 KiB/s wr, 9 op/s 2023-05-08T14:17:44.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:44 smithi133 ceph-mon[125939]: osdmap e1347: 12 total, 12 up, 12 in 2023-05-08T14:17:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:44 smithi133 ceph-mon[125939]: pgmap v20322: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 596 KiB/s rd, 594 KiB/s wr, 9 op/s 2023-05-08T14:17:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38003.439671 secs 2023-05-08T14:17:44.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:44 smithi096 ceph-mon[124666]: osdmap e1347: 12 total, 12 up, 12 in 2023-05-08T14:17:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:44 smithi096 ceph-mon[124666]: pgmap v20322: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 596 KiB/s rd, 594 KiB/s wr, 9 op/s 2023-05-08T14:17:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38003.439671 secs 2023-05-08T14:17:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:44 smithi186 ceph-mon[126480]: osdmap e1347: 12 total, 12 up, 12 in 2023-05-08T14:17:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:44 smithi186 ceph-mon[126480]: pgmap v20322: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 596 KiB/s rd, 594 KiB/s wr, 9 op/s 2023-05-08T14:17:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38003.439671 secs 2023-05-08T14:17:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38003.993964 secs 2023-05-08T14:17:45.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38003.993964 secs 2023-05-08T14:17:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38003.993964 secs 2023-05-08T14:17:46.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:46 smithi133 ceph-mon[125939]: pgmap v20323: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 760 KiB/s rd, 757 KiB/s wr, 8 op/s 2023-05-08T14:17:46.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:46 smithi096 ceph-mon[124666]: pgmap v20323: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 760 KiB/s rd, 757 KiB/s wr, 8 op/s 2023-05-08T14:17:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:46 smithi186 ceph-mon[126480]: pgmap v20323: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 760 KiB/s rd, 757 KiB/s wr, 8 op/s 2023-05-08T14:17:48.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:48 smithi133 ceph-mon[125939]: pgmap v20324: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 760 KiB/s rd, 757 KiB/s wr, 8 op/s 2023-05-08T14:17:48.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:48 smithi096 ceph-mon[124666]: pgmap v20324: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 760 KiB/s rd, 757 KiB/s wr, 8 op/s 2023-05-08T14:17:48.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:48 smithi186 ceph-mon[126480]: pgmap v20324: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 760 KiB/s rd, 757 KiB/s wr, 8 op/s 2023-05-08T14:17:49.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38008.439824 secs 2023-05-08T14:17:49.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:17:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38008.994088 secs 2023-05-08T14:17:49.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38008.439824 secs 2023-05-08T14:17:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:17:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38008.994088 secs 2023-05-08T14:17:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38008.439824 secs 2023-05-08T14:17:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:17:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38008.994088 secs 2023-05-08T14:17:50.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:50 smithi133 ceph-mon[125939]: pgmap v20325: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 735 KiB/s rd, 733 KiB/s wr, 8 op/s 2023-05-08T14:17:50.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:17:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:17:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:17:50.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:50 smithi096 ceph-mon[124666]: pgmap v20325: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 735 KiB/s rd, 733 KiB/s wr, 8 op/s 2023-05-08T14:17:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:17:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:17:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:17:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:50 smithi186 ceph-mon[126480]: pgmap v20325: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 735 KiB/s rd, 733 KiB/s wr, 8 op/s 2023-05-08T14:17:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:17:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:17:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:17:52.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:52 smithi096 ceph-mon[124666]: pgmap v20326: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 757 KiB/s rd, 755 KiB/s wr, 8 op/s 2023-05-08T14:17:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:52 smithi186 ceph-mon[126480]: pgmap v20326: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 757 KiB/s rd, 755 KiB/s wr, 8 op/s 2023-05-08T14:17:52.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:52 smithi133 ceph-mon[125939]: pgmap v20326: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 757 KiB/s rd, 755 KiB/s wr, 8 op/s 2023-05-08T14:17:54.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:54 smithi133 ceph-mon[125939]: pgmap v20327: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 738 KiB/s rd, 736 KiB/s wr, 8 op/s 2023-05-08T14:17:54.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38013.439947 secs 2023-05-08T14:17:54.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:54 smithi096 ceph-mon[124666]: pgmap v20327: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 738 KiB/s rd, 736 KiB/s wr, 8 op/s 2023-05-08T14:17:54.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38013.439947 secs 2023-05-08T14:17:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:54 smithi186 ceph-mon[126480]: pgmap v20327: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 738 KiB/s rd, 736 KiB/s wr, 8 op/s 2023-05-08T14:17:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38013.439947 secs 2023-05-08T14:17:56.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:56 smithi133 ceph-mon[125939]: pgmap v20328: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 833 KiB/s rd, 830 KiB/s wr, 11 op/s 2023-05-08T14:17:56.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:56 smithi096 ceph-mon[124666]: pgmap v20328: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 833 KiB/s rd, 830 KiB/s wr, 11 op/s 2023-05-08T14:17:56.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:56 smithi186 ceph-mon[126480]: pgmap v20328: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 833 KiB/s rd, 830 KiB/s wr, 11 op/s 2023-05-08T14:17:57.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:17:57.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:17:57.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:17:58.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:58 smithi133 ceph-mon[125939]: pgmap v20329: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 856 KiB/s rd, 854 KiB/s wr, 8 op/s 2023-05-08T14:17:58.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:58 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:17:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:17:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:17:58.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:58 smithi096 ceph-mon[124666]: pgmap v20329: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 856 KiB/s rd, 854 KiB/s wr, 8 op/s 2023-05-08T14:17:58.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:58 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:17:58.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:17:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:17:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:58 smithi186 ceph-mon[126480]: pgmap v20329: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 856 KiB/s rd, 854 KiB/s wr, 8 op/s 2023-05-08T14:17:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:58 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:17:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:17:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:17:59.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:17:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38018.440074 secs 2023-05-08T14:17:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:17:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38018.440074 secs 2023-05-08T14:17:59.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:17:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38018.440074 secs 2023-05-08T14:18:00.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:00 smithi096 ceph-mon[124666]: pgmap v20330: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 14 op/s 2023-05-08T14:18:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:00 smithi186 ceph-mon[126480]: pgmap v20330: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 14 op/s 2023-05-08T14:18:00.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:00 smithi133 ceph-mon[125939]: pgmap v20330: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 14 op/s 2023-05-08T14:18:02.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:02 smithi096 ceph-mon[124666]: pgmap v20331: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T14:18:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:02 smithi186 ceph-mon[126480]: pgmap v20331: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T14:18:02.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:02 smithi133 ceph-mon[125939]: pgmap v20331: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T14:18:04.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:04 smithi133 ceph-mon[125939]: pgmap v20332: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T14:18:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38023.440200 secs 2023-05-08T14:18:04.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:04 smithi096 ceph-mon[124666]: pgmap v20332: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T14:18:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38023.440200 secs 2023-05-08T14:18:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:04 smithi186 ceph-mon[126480]: pgmap v20332: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T14:18:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38023.440200 secs 2023-05-08T14:18:05.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38023.994492 secs 2023-05-08T14:18:05.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38023.994492 secs 2023-05-08T14:18:05.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38023.994492 secs 2023-05-08T14:18:06.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:06 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:18:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:18:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:18:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:06 smithi133 ceph-mon[125939]: pgmap v20333: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 27 op/s 2023-05-08T14:18:06.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:06 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:18:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:18:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:18:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:06 smithi096 ceph-mon[124666]: pgmap v20333: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 27 op/s 2023-05-08T14:18:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:06 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:18:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:18:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:18:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:06 smithi186 ceph-mon[126480]: pgmap v20333: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 27 op/s 2023-05-08T14:18:08.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:08 smithi133 ceph-mon[125939]: pgmap v20334: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 24 op/s 2023-05-08T14:18:08.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:08 smithi096 ceph-mon[124666]: pgmap v20334: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 24 op/s 2023-05-08T14:18:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:08 smithi186 ceph-mon[126480]: pgmap v20334: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 24 op/s 2023-05-08T14:18:09.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38028.440324 secs 2023-05-08T14:18:09.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38028.994620 secs 2023-05-08T14:18:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38028.440324 secs 2023-05-08T14:18:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38028.994620 secs 2023-05-08T14:18:09.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38028.440324 secs 2023-05-08T14:18:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38028.994620 secs 2023-05-08T14:18:10.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:10 smithi096 ceph-mon[124666]: pgmap v20335: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 27 op/s 2023-05-08T14:18:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:10 smithi186 ceph-mon[126480]: pgmap v20335: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 27 op/s 2023-05-08T14:18:10.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:10 smithi133 ceph-mon[125939]: pgmap v20335: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 27 op/s 2023-05-08T14:18:12.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:12 smithi096 ceph-mon[124666]: pgmap v20336: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 470 KiB/s wr, 22 op/s 2023-05-08T14:18:12.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:12 smithi186 ceph-mon[126480]: pgmap v20336: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 470 KiB/s wr, 22 op/s 2023-05-08T14:18:12.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:12 smithi133 ceph-mon[125939]: pgmap v20336: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 470 KiB/s wr, 22 op/s 2023-05-08T14:18:14.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:14 smithi133 ceph-mon[125939]: pgmap v20337: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 470 KiB/s wr, 22 op/s 2023-05-08T14:18:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38033.440445 secs 2023-05-08T14:18:14.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:14 smithi096 ceph-mon[124666]: pgmap v20337: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 470 KiB/s wr, 22 op/s 2023-05-08T14:18:14.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38033.440445 secs 2023-05-08T14:18:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:14 smithi186 ceph-mon[126480]: pgmap v20337: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 470 KiB/s wr, 22 op/s 2023-05-08T14:18:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38033.440445 secs 2023-05-08T14:18:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38033.994707 secs 2023-05-08T14:18:15.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38033.994707 secs 2023-05-08T14:18:15.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38033.994707 secs 2023-05-08T14:18:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:16 smithi133 ceph-mon[125939]: pgmap v20338: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 979 KiB/s rd, 991 KiB/s wr, 26 op/s 2023-05-08T14:18:16.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:16 smithi096 ceph-mon[124666]: pgmap v20338: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 979 KiB/s rd, 991 KiB/s wr, 26 op/s 2023-05-08T14:18:16.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:16 smithi186 ceph-mon[126480]: pgmap v20338: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 979 KiB/s rd, 991 KiB/s wr, 26 op/s 2023-05-08T14:18:18.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:18 smithi096 ceph-mon[124666]: pgmap v20339: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 525 KiB/s rd, 523 KiB/s wr, 8 op/s 2023-05-08T14:18:18.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:18 smithi186 ceph-mon[126480]: pgmap v20339: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 525 KiB/s rd, 523 KiB/s wr, 8 op/s 2023-05-08T14:18:18.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:18 smithi133 ceph-mon[125939]: pgmap v20339: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 525 KiB/s rd, 523 KiB/s wr, 8 op/s 2023-05-08T14:18:19.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38038.440576 secs 2023-05-08T14:18:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38038.994773 secs 2023-05-08T14:18:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38038.440576 secs 2023-05-08T14:18:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38038.994773 secs 2023-05-08T14:18:19.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38038.440576 secs 2023-05-08T14:18:19.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38038.994773 secs 2023-05-08T14:18:20.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:20 smithi096 ceph-mon[124666]: pgmap v20340: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 526 KiB/s rd, 523 KiB/s wr, 11 op/s 2023-05-08T14:18:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:20 smithi186 ceph-mon[126480]: pgmap v20340: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 526 KiB/s rd, 523 KiB/s wr, 11 op/s 2023-05-08T14:18:20.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:20 smithi133 ceph-mon[125939]: pgmap v20340: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 526 KiB/s rd, 523 KiB/s wr, 11 op/s 2023-05-08T14:18:22.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:22 smithi096 ceph-mon[124666]: pgmap v20341: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 521 KiB/s wr, 7 op/s 2023-05-08T14:18:22.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:22 smithi186 ceph-mon[126480]: pgmap v20341: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 521 KiB/s wr, 7 op/s 2023-05-08T14:18:22.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:22 smithi133 ceph-mon[125939]: pgmap v20341: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 521 KiB/s wr, 7 op/s 2023-05-08T14:18:24.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:24 smithi133 ceph-mon[125939]: pgmap v20342: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 521 KiB/s wr, 7 op/s 2023-05-08T14:18:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38043.440705 secs 2023-05-08T14:18:24.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:24 smithi096 ceph-mon[124666]: pgmap v20342: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 521 KiB/s wr, 7 op/s 2023-05-08T14:18:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38043.440705 secs 2023-05-08T14:18:24.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:24 smithi186 ceph-mon[126480]: pgmap v20342: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 521 KiB/s wr, 7 op/s 2023-05-08T14:18:24.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38043.440705 secs 2023-05-08T14:18:25.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:25 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:18:25.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:25 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:18:25.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:25 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:18:26.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:26 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:18:26.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:26 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:18:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:26 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:18:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:26 smithi133 ceph-mon[125939]: pgmap v20343: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 14 op/s 2023-05-08T14:18:26.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:26 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:18:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:26 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:18:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:26 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:18:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:26 smithi096 ceph-mon[124666]: pgmap v20343: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 14 op/s 2023-05-08T14:18:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:26 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:18:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:26 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:18:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:26 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:18:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:26 smithi186 ceph-mon[126480]: pgmap v20343: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 14 op/s 2023-05-08T14:18:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:28 smithi096 ceph-mon[124666]: pgmap v20344: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 894 KiB/s rd, 914 KiB/s wr, 10 op/s 2023-05-08T14:18:28.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:28 smithi186 ceph-mon[126480]: pgmap v20344: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 894 KiB/s rd, 914 KiB/s wr, 10 op/s 2023-05-08T14:18:28.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:28 smithi133 ceph-mon[125939]: pgmap v20344: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 894 KiB/s rd, 914 KiB/s wr, 10 op/s 2023-05-08T14:18:29.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38048.440829 secs 2023-05-08T14:18:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38048.440829 secs 2023-05-08T14:18:29.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38048.440829 secs 2023-05-08T14:18:30.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:30 smithi096 ceph-mon[124666]: pgmap v20345: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 898 KiB/s rd, 944 KiB/s wr, 14 op/s 2023-05-08T14:18:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:30 smithi186 ceph-mon[126480]: pgmap v20345: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 898 KiB/s rd, 944 KiB/s wr, 14 op/s 2023-05-08T14:18:30.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:30 smithi133 ceph-mon[125939]: pgmap v20345: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 898 KiB/s rd, 944 KiB/s wr, 14 op/s 2023-05-08T14:18:32.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:32 smithi186 ceph-mon[126480]: pgmap v20346: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 897 KiB/s rd, 944 KiB/s wr, 11 op/s 2023-05-08T14:18:32.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:32 smithi186 ceph-mon[126480]: osdmap e1348: 12 total, 12 up, 12 in 2023-05-08T14:18:32.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:32 smithi133 ceph-mon[125939]: pgmap v20346: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 897 KiB/s rd, 944 KiB/s wr, 11 op/s 2023-05-08T14:18:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:32 smithi133 ceph-mon[125939]: osdmap e1348: 12 total, 12 up, 12 in 2023-05-08T14:18:33.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:32 smithi096 ceph-mon[124666]: pgmap v20346: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 897 KiB/s rd, 944 KiB/s wr, 11 op/s 2023-05-08T14:18:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:32 smithi096 ceph-mon[124666]: osdmap e1348: 12 total, 12 up, 12 in 2023-05-08T14:18:34.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:34 smithi133 ceph-mon[125939]: pgmap v20348: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T14:18:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38053.440937 secs 2023-05-08T14:18:34.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:34 smithi096 ceph-mon[124666]: pgmap v20348: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T14:18:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38053.440937 secs 2023-05-08T14:18:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:34 smithi186 ceph-mon[126480]: pgmap v20348: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T14:18:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38053.440937 secs 2023-05-08T14:18:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:36 smithi096 ceph-mon[124666]: pgmap v20349: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 436 KiB/s wr, 9 op/s 2023-05-08T14:18:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:18:36.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:36 smithi186 ceph-mon[126480]: pgmap v20349: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 436 KiB/s wr, 9 op/s 2023-05-08T14:18:36.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:18:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:36 smithi133 ceph-mon[125939]: pgmap v20349: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 436 KiB/s wr, 9 op/s 2023-05-08T14:18:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:18:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:37 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:18:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:37 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:18:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:37 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:18:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:37 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:18:37.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:37 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T14:18:37.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:37 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T14:18:37.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:37 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:18:37.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:37 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:18:37.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:37 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:18:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:37 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:18:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:37 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:18:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:37 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T14:18:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:37 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T14:18:37.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:37 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:18:37.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:37 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:18:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:37 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:18:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:37 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:18:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:37 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:18:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:37 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T14:18:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:37 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T14:18:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:37 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:18:38.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:38 smithi186 ceph-mon[126480]: pgmap v20350: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 436 KiB/s wr, 9 op/s 2023-05-08T14:18:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:38 smithi186 ceph-mon[126480]: osdmap e1349: 12 total, 12 up, 12 in 2023-05-08T14:18:38.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:38 smithi133 ceph-mon[125939]: pgmap v20350: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 436 KiB/s wr, 9 op/s 2023-05-08T14:18:38.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:38 smithi133 ceph-mon[125939]: osdmap e1349: 12 total, 12 up, 12 in 2023-05-08T14:18:39.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:38 smithi096 ceph-mon[124666]: pgmap v20350: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 436 KiB/s wr, 9 op/s 2023-05-08T14:18:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:38 smithi096 ceph-mon[124666]: osdmap e1349: 12 total, 12 up, 12 in 2023-05-08T14:18:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38058.441064 secs 2023-05-08T14:18:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38058.995216 secs 2023-05-08T14:18:39.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38058.441064 secs 2023-05-08T14:18:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38058.995216 secs 2023-05-08T14:18:40.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38058.441064 secs 2023-05-08T14:18:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38058.995216 secs 2023-05-08T14:18:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:40 smithi186 ceph-mon[126480]: pgmap v20352: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.2 MiB/s wr, 14 op/s 2023-05-08T14:18:40.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:40 smithi133 ceph-mon[125939]: pgmap v20352: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.2 MiB/s wr, 14 op/s 2023-05-08T14:18:41.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:40 smithi096 ceph-mon[124666]: pgmap v20352: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.2 MiB/s wr, 14 op/s 2023-05-08T14:18:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38060.336339 secs 2023-05-08T14:18:41.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38060.336339 secs 2023-05-08T14:18:42.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38060.336339 secs 2023-05-08T14:18:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:42 smithi186 ceph-mon[126480]: pgmap v20353: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.8 MiB/s wr, 11 op/s 2023-05-08T14:18:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:42 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:18:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:42 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:18:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:42 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:18:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:42 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:18:42.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:42 smithi133 ceph-mon[125939]: pgmap v20353: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.8 MiB/s wr, 11 op/s 2023-05-08T14:18:42.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:42 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:18:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:42 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:18:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:42 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:18:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:42 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:18:43.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:42 smithi096 ceph-mon[124666]: pgmap v20353: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.8 MiB/s wr, 11 op/s 2023-05-08T14:18:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:42 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:18:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:42 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:18:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:42 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:18:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:42 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:18:44.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:44 smithi133 ceph-mon[125939]: pgmap v20354: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 11 op/s 2023-05-08T14:18:44.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38063.441139 secs 2023-05-08T14:18:44.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:44 smithi096 ceph-mon[124666]: pgmap v20354: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 11 op/s 2023-05-08T14:18:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38063.441139 secs 2023-05-08T14:18:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:44 smithi186 ceph-mon[126480]: pgmap v20354: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 11 op/s 2023-05-08T14:18:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38063.441139 secs 2023-05-08T14:18:45.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38063.995340 secs 2023-05-08T14:18:45.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38063.995340 secs 2023-05-08T14:18:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38063.995340 secs 2023-05-08T14:18:46.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:46 smithi133 ceph-mon[125939]: pgmap v20355: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 13 op/s 2023-05-08T14:18:46.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:46 smithi096 ceph-mon[124666]: pgmap v20355: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 13 op/s 2023-05-08T14:18:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:46 smithi186 ceph-mon[126480]: pgmap v20355: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 13 op/s 2023-05-08T14:18:48.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:48 smithi096 ceph-mon[124666]: pgmap v20356: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 13 op/s 2023-05-08T14:18:48.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:48 smithi186 ceph-mon[126480]: pgmap v20356: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 13 op/s 2023-05-08T14:18:48.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:48 smithi133 ceph-mon[125939]: pgmap v20356: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 13 op/s 2023-05-08T14:18:49.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38068.441288 secs 2023-05-08T14:18:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:18:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38068.995447 secs 2023-05-08T14:18:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38068.441288 secs 2023-05-08T14:18:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:18:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38068.995447 secs 2023-05-08T14:18:49.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38068.441288 secs 2023-05-08T14:18:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:18:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38068.995447 secs 2023-05-08T14:18:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:50 smithi186 ceph-mon[126480]: pgmap v20357: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 17 op/s 2023-05-08T14:18:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:18:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:18:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:18:50.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:50 smithi133 ceph-mon[125939]: pgmap v20357: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 17 op/s 2023-05-08T14:18:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:18:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:18:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:18:51.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:50 smithi096 ceph-mon[124666]: pgmap v20357: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 17 op/s 2023-05-08T14:18:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:18:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:18:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:18:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:52 smithi186 ceph-mon[126480]: pgmap v20358: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T14:18:52.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:52 smithi133 ceph-mon[125939]: pgmap v20358: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T14:18:53.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:52 smithi096 ceph-mon[124666]: pgmap v20358: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T14:18:54.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:54 smithi133 ceph-mon[125939]: pgmap v20359: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T14:18:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38073.441415 secs 2023-05-08T14:18:54.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:54 smithi096 ceph-mon[124666]: pgmap v20359: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T14:18:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38073.441415 secs 2023-05-08T14:18:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:54 smithi186 ceph-mon[126480]: pgmap v20359: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T14:18:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38073.441415 secs 2023-05-08T14:18:56.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:56 smithi096 ceph-mon[124666]: pgmap v20360: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 16 op/s 2023-05-08T14:18:56.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:56 smithi186 ceph-mon[126480]: pgmap v20360: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 16 op/s 2023-05-08T14:18:56.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:56 smithi133 ceph-mon[125939]: pgmap v20360: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 16 op/s 2023-05-08T14:18:57.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:18:57.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:18:57.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:18:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:58 smithi186 ceph-mon[126480]: pgmap v20361: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 11 op/s 2023-05-08T14:18:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:58 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:18:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:18:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:18:58.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:58 smithi133 ceph-mon[125939]: pgmap v20361: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 11 op/s 2023-05-08T14:18:58.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:58 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:18:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:18:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:18:59.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:58 smithi096 ceph-mon[124666]: pgmap v20361: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 11 op/s 2023-05-08T14:18:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:58 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:18:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:18:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:18:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38078.441515 secs 2023-05-08T14:18:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:18:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38078.995666 secs 2023-05-08T14:18:59.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38078.441515 secs 2023-05-08T14:18:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:18:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38078.995666 secs 2023-05-08T14:19:00.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38078.441515 secs 2023-05-08T14:19:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:18:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38078.995666 secs 2023-05-08T14:19:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:00 smithi186 ceph-mon[126480]: pgmap v20362: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.3 MiB/s wr, 17 op/s 2023-05-08T14:19:00.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:00 smithi133 ceph-mon[125939]: pgmap v20362: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.3 MiB/s wr, 17 op/s 2023-05-08T14:19:01.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:00 smithi096 ceph-mon[124666]: pgmap v20362: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.3 MiB/s wr, 17 op/s 2023-05-08T14:19:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:02 smithi186 ceph-mon[126480]: pgmap v20363: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 12 op/s 2023-05-08T14:19:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:19:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:19:02.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:02 smithi133 ceph-mon[125939]: pgmap v20363: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 12 op/s 2023-05-08T14:19:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:19:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:19:03.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:02 smithi096 ceph-mon[124666]: pgmap v20363: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 12 op/s 2023-05-08T14:19:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:19:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:19:03.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:03 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:19:03.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:03 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:19:04.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:03 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:19:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:04 smithi186 ceph-mon[126480]: pgmap v20364: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 12 op/s 2023-05-08T14:19:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38083.441636 secs 2023-05-08T14:19:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38083.995789 secs 2023-05-08T14:19:04.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:04 smithi133 ceph-mon[125939]: pgmap v20364: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 12 op/s 2023-05-08T14:19:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38083.441636 secs 2023-05-08T14:19:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38083.995789 secs 2023-05-08T14:19:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:04 smithi096 ceph-mon[124666]: pgmap v20364: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 12 op/s 2023-05-08T14:19:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38083.441636 secs 2023-05-08T14:19:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38083.995789 secs 2023-05-08T14:19:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:06 smithi186 ceph-mon[126480]: pgmap v20365: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 33 op/s 2023-05-08T14:19:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38085.337014 secs 2023-05-08T14:19:06.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:06 smithi133 ceph-mon[125939]: pgmap v20365: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 33 op/s 2023-05-08T14:19:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38085.337014 secs 2023-05-08T14:19:07.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:06 smithi096 ceph-mon[124666]: pgmap v20365: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 33 op/s 2023-05-08T14:19:07.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38085.337014 secs 2023-05-08T14:19:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:08 smithi186 ceph-mon[126480]: pgmap v20366: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 27 op/s 2023-05-08T14:19:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:08 smithi133 ceph-mon[125939]: pgmap v20366: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 27 op/s 2023-05-08T14:19:09.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:08 smithi096 ceph-mon[124666]: pgmap v20366: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 27 op/s 2023-05-08T14:19:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38088.441761 secs 2023-05-08T14:19:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38088.995901 secs 2023-05-08T14:19:09.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38088.441761 secs 2023-05-08T14:19:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38088.995901 secs 2023-05-08T14:19:10.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38088.441761 secs 2023-05-08T14:19:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38088.995901 secs 2023-05-08T14:19:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:10 smithi186 ceph-mon[126480]: pgmap v20367: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 31 op/s 2023-05-08T14:19:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:10 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:19:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:10 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:19:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:10 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:19:10.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:10 smithi133 ceph-mon[125939]: pgmap v20367: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 31 op/s 2023-05-08T14:19:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:10 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:19:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:10 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:19:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:10 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:19:11.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:10 smithi096 ceph-mon[124666]: pgmap v20367: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 31 op/s 2023-05-08T14:19:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:10 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:19:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:10 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:19:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:10 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:19:11.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38090.337081 secs 2023-05-08T14:19:11.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38090.337081 secs 2023-05-08T14:19:12.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38090.337081 secs 2023-05-08T14:19:12.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:12 smithi186 ceph-mon[126480]: pgmap v20368: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 949 KiB/s wr, 25 op/s 2023-05-08T14:19:12.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:12 smithi186 ceph-mon[126480]: osdmap e1350: 12 total, 12 up, 12 in 2023-05-08T14:19:12.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:12 smithi133 ceph-mon[125939]: pgmap v20368: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 949 KiB/s wr, 25 op/s 2023-05-08T14:19:12.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:12 smithi133 ceph-mon[125939]: osdmap e1350: 12 total, 12 up, 12 in 2023-05-08T14:19:13.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:12 smithi096 ceph-mon[124666]: pgmap v20368: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 949 KiB/s wr, 25 op/s 2023-05-08T14:19:13.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:12 smithi096 ceph-mon[124666]: osdmap e1350: 12 total, 12 up, 12 in 2023-05-08T14:19:14.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:14 smithi133 ceph-mon[125939]: pgmap v20370: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 31 op/s 2023-05-08T14:19:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38093.441892 secs 2023-05-08T14:19:14.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:14 smithi096 ceph-mon[124666]: pgmap v20370: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 31 op/s 2023-05-08T14:19:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38093.441892 secs 2023-05-08T14:19:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:14 smithi186 ceph-mon[126480]: pgmap v20370: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 31 op/s 2023-05-08T14:19:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38093.441892 secs 2023-05-08T14:19:15.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38093.996030 secs 2023-05-08T14:19:15.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38093.996030 secs 2023-05-08T14:19:15.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38093.996030 secs 2023-05-08T14:19:16.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:16 smithi133 ceph-mon[125939]: pgmap v20371: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 889 KiB/s rd, 873 KiB/s wr, 11 op/s 2023-05-08T14:19:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38095.337198 secs 2023-05-08T14:19:16.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:16 smithi096 ceph-mon[124666]: pgmap v20371: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 889 KiB/s rd, 873 KiB/s wr, 11 op/s 2023-05-08T14:19:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38095.337198 secs 2023-05-08T14:19:16.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:16 smithi186 ceph-mon[126480]: pgmap v20371: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 889 KiB/s rd, 873 KiB/s wr, 11 op/s 2023-05-08T14:19:16.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38095.337198 secs 2023-05-08T14:19:18.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:18 smithi186 ceph-mon[126480]: pgmap v20372: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 889 KiB/s rd, 873 KiB/s wr, 11 op/s 2023-05-08T14:19:18.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:18 smithi186 ceph-mon[126480]: osdmap e1351: 12 total, 12 up, 12 in 2023-05-08T14:19:18.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:18 smithi133 ceph-mon[125939]: pgmap v20372: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 889 KiB/s rd, 873 KiB/s wr, 11 op/s 2023-05-08T14:19:18.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:18 smithi133 ceph-mon[125939]: osdmap e1351: 12 total, 12 up, 12 in 2023-05-08T14:19:19.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:18 smithi096 ceph-mon[124666]: pgmap v20372: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 889 KiB/s rd, 873 KiB/s wr, 11 op/s 2023-05-08T14:19:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:18 smithi096 ceph-mon[124666]: osdmap e1351: 12 total, 12 up, 12 in 2023-05-08T14:19:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38098.442016 secs 2023-05-08T14:19:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38098.996100 secs 2023-05-08T14:19:19.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38098.442016 secs 2023-05-08T14:19:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38098.996100 secs 2023-05-08T14:19:20.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38098.442016 secs 2023-05-08T14:19:20.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38098.996100 secs 2023-05-08T14:19:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:20 smithi186 ceph-mon[126480]: pgmap v20374: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 13 op/s 2023-05-08T14:19:20.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:20 smithi133 ceph-mon[125939]: pgmap v20374: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 13 op/s 2023-05-08T14:19:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:20 smithi096 ceph-mon[124666]: pgmap v20374: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 13 op/s 2023-05-08T14:19:21.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38100.337317 secs 2023-05-08T14:19:21.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38100.337317 secs 2023-05-08T14:19:22.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38100.337317 secs 2023-05-08T14:19:22.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:22 smithi186 ceph-mon[126480]: pgmap v20375: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T14:19:22.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:22 smithi133 ceph-mon[125939]: pgmap v20375: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T14:19:23.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:22 smithi096 ceph-mon[124666]: pgmap v20375: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T14:19:24.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:24 smithi133 ceph-mon[125939]: pgmap v20376: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T14:19:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38103.442141 secs 2023-05-08T14:19:24.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:24 smithi096 ceph-mon[124666]: pgmap v20376: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T14:19:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38103.442141 secs 2023-05-08T14:19:24.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:24 smithi186 ceph-mon[126480]: pgmap v20376: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T14:19:24.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38103.442141 secs 2023-05-08T14:19:25.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38103.996246 secs 2023-05-08T14:19:25.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38103.996246 secs 2023-05-08T14:19:25.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38103.996246 secs 2023-05-08T14:19:26.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:26 smithi133 ceph-mon[125939]: pgmap v20377: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 990 KiB/s rd, 988 KiB/s wr, 9 op/s 2023-05-08T14:19:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38105.337463 secs 2023-05-08T14:19:26.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:26 smithi096 ceph-mon[124666]: pgmap v20377: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 990 KiB/s rd, 988 KiB/s wr, 9 op/s 2023-05-08T14:19:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38105.337463 secs 2023-05-08T14:19:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:26 smithi186 ceph-mon[126480]: pgmap v20377: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 990 KiB/s rd, 988 KiB/s wr, 9 op/s 2023-05-08T14:19:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38105.337463 secs 2023-05-08T14:19:28.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:28 smithi186 ceph-mon[126480]: pgmap v20378: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 990 KiB/s rd, 988 KiB/s wr, 10 op/s 2023-05-08T14:19:28.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:28 smithi133 ceph-mon[125939]: pgmap v20378: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 990 KiB/s rd, 988 KiB/s wr, 10 op/s 2023-05-08T14:19:29.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:28 smithi096 ceph-mon[124666]: pgmap v20378: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 990 KiB/s rd, 988 KiB/s wr, 10 op/s 2023-05-08T14:19:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38108.442286 secs 2023-05-08T14:19:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38108.996398 secs 2023-05-08T14:19:29.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38108.442286 secs 2023-05-08T14:19:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38108.996398 secs 2023-05-08T14:19:30.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38108.442286 secs 2023-05-08T14:19:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38108.996398 secs 2023-05-08T14:19:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:30 smithi186 ceph-mon[126480]: pgmap v20379: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 909 KiB/s rd, 906 KiB/s wr, 12 op/s 2023-05-08T14:19:30.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:30 smithi133 ceph-mon[125939]: pgmap v20379: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 909 KiB/s rd, 906 KiB/s wr, 12 op/s 2023-05-08T14:19:31.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:30 smithi096 ceph-mon[124666]: pgmap v20379: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 909 KiB/s rd, 906 KiB/s wr, 12 op/s 2023-05-08T14:19:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38110.337580 secs 2023-05-08T14:19:31.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38110.337580 secs 2023-05-08T14:19:32.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38110.337580 secs 2023-05-08T14:19:32.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:32 smithi186 ceph-mon[126480]: pgmap v20380: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 369 KiB/s wr, 8 op/s 2023-05-08T14:19:32.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:32 smithi133 ceph-mon[125939]: pgmap v20380: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 369 KiB/s wr, 8 op/s 2023-05-08T14:19:33.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:32 smithi096 ceph-mon[124666]: pgmap v20380: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 369 KiB/s wr, 8 op/s 2023-05-08T14:19:34.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:34 smithi133 ceph-mon[125939]: pgmap v20381: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 485 KiB/s rd, 247 KiB/s wr, 7 op/s 2023-05-08T14:19:34.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38113.442368 secs 2023-05-08T14:19:34.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:34 smithi096 ceph-mon[124666]: pgmap v20381: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 485 KiB/s rd, 247 KiB/s wr, 7 op/s 2023-05-08T14:19:34.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38113.442368 secs 2023-05-08T14:19:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:34 smithi186 ceph-mon[126480]: pgmap v20381: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 485 KiB/s rd, 247 KiB/s wr, 7 op/s 2023-05-08T14:19:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38113.442368 secs 2023-05-08T14:19:35.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38113.996514 secs 2023-05-08T14:19:35.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38113.996514 secs 2023-05-08T14:19:35.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38113.996514 secs 2023-05-08T14:19:36.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:36 smithi133 ceph-mon[125939]: pgmap v20382: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 602 KiB/s rd, 362 KiB/s wr, 11 op/s 2023-05-08T14:19:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38115.337718 secs 2023-05-08T14:19:36.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:36 smithi096 ceph-mon[124666]: pgmap v20382: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 602 KiB/s rd, 362 KiB/s wr, 11 op/s 2023-05-08T14:19:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38115.337718 secs 2023-05-08T14:19:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:36 smithi186 ceph-mon[126480]: pgmap v20382: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 602 KiB/s rd, 362 KiB/s wr, 11 op/s 2023-05-08T14:19:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38115.337718 secs 2023-05-08T14:19:37.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:37 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:19:37.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:37 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:19:37.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:37 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:19:38.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:19:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:19:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:38 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:19:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:19:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:38 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T14:19:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:38 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T14:19:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:38 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:19:38.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:38 smithi133 ceph-mon[125939]: pgmap v20383: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 362 KiB/s wr, 7 op/s 2023-05-08T14:19:38.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:19:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:19:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:38 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:19:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:19:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:38 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T14:19:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:38 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T14:19:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:38 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:19:38.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:38 smithi096 ceph-mon[124666]: pgmap v20383: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 362 KiB/s wr, 7 op/s 2023-05-08T14:19:38.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:19:38.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:19:38.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:38 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:19:38.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:19:38.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:38 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T14:19:38.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:38 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T14:19:38.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:38 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:19:38.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:38 smithi186 ceph-mon[126480]: pgmap v20383: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 362 KiB/s wr, 7 op/s 2023-05-08T14:19:39.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38118.442491 secs 2023-05-08T14:19:39.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38118.996638 secs 2023-05-08T14:19:39.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38118.442491 secs 2023-05-08T14:19:39.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38118.996638 secs 2023-05-08T14:19:39.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38118.442491 secs 2023-05-08T14:19:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38118.996638 secs 2023-05-08T14:19:40.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:40 smithi133 ceph-mon[125939]: pgmap v20384: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 366 KiB/s rd, 362 KiB/s wr, 10 op/s 2023-05-08T14:19:40.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:40 smithi096 ceph-mon[124666]: pgmap v20384: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 366 KiB/s rd, 362 KiB/s wr, 10 op/s 2023-05-08T14:19:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:40 smithi186 ceph-mon[126480]: pgmap v20384: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 366 KiB/s rd, 362 KiB/s wr, 10 op/s 2023-05-08T14:19:41.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38120.337842 secs 2023-05-08T14:19:41.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38120.337842 secs 2023-05-08T14:19:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38120.337842 secs 2023-05-08T14:19:42.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:42 smithi133 ceph-mon[125939]: pgmap v20385: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 335 KiB/s wr, 7 op/s 2023-05-08T14:19:42.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:42 smithi096 ceph-mon[124666]: pgmap v20385: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 335 KiB/s wr, 7 op/s 2023-05-08T14:19:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:42 smithi186 ceph-mon[126480]: pgmap v20385: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 335 KiB/s wr, 7 op/s 2023-05-08T14:19:44.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:44 smithi133 ceph-mon[125939]: pgmap v20386: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 116 KiB/s wr, 6 op/s 2023-05-08T14:19:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38123.442607 secs 2023-05-08T14:19:44.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:44 smithi096 ceph-mon[124666]: pgmap v20386: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 116 KiB/s wr, 6 op/s 2023-05-08T14:19:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38123.442607 secs 2023-05-08T14:19:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:44 smithi186 ceph-mon[126480]: pgmap v20386: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 116 KiB/s wr, 6 op/s 2023-05-08T14:19:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38123.442607 secs 2023-05-08T14:19:45.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38123.996712 secs 2023-05-08T14:19:45.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38123.996712 secs 2023-05-08T14:19:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38123.996712 secs 2023-05-08T14:19:46.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:46 smithi133 ceph-mon[125939]: pgmap v20387: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 450 KiB/s wr, 10 op/s 2023-05-08T14:19:46.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:46 smithi096 ceph-mon[124666]: pgmap v20387: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 450 KiB/s wr, 10 op/s 2023-05-08T14:19:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:46 smithi186 ceph-mon[126480]: pgmap v20387: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 450 KiB/s wr, 10 op/s 2023-05-08T14:19:48.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:48 smithi186 ceph-mon[126480]: pgmap v20388: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 335 KiB/s wr, 6 op/s 2023-05-08T14:19:48.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:48 smithi133 ceph-mon[125939]: pgmap v20388: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 335 KiB/s wr, 6 op/s 2023-05-08T14:19:49.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:48 smithi096 ceph-mon[124666]: pgmap v20388: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 335 KiB/s wr, 6 op/s 2023-05-08T14:19:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38128.442728 secs 2023-05-08T14:19:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:19:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38128.996825 secs 2023-05-08T14:19:49.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38128.442728 secs 2023-05-08T14:19:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:19:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38128.996825 secs 2023-05-08T14:19:50.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38128.442728 secs 2023-05-08T14:19:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:19:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38128.996825 secs 2023-05-08T14:19:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:50 smithi186 ceph-mon[126480]: pgmap v20389: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 642 KiB/s rd, 569 KiB/s wr, 10 op/s 2023-05-08T14:19:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:19:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:19:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:19:50.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:50 smithi133 ceph-mon[125939]: pgmap v20389: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 642 KiB/s rd, 569 KiB/s wr, 10 op/s 2023-05-08T14:19:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:19:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:19:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:19:51.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:50 smithi096 ceph-mon[124666]: pgmap v20389: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 642 KiB/s rd, 569 KiB/s wr, 10 op/s 2023-05-08T14:19:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:19:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:19:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:19:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:52 smithi186 ceph-mon[126480]: pgmap v20390: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 739 KiB/s rd, 667 KiB/s wr, 7 op/s 2023-05-08T14:19:52.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:52 smithi133 ceph-mon[125939]: pgmap v20390: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 739 KiB/s rd, 667 KiB/s wr, 7 op/s 2023-05-08T14:19:53.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:52 smithi096 ceph-mon[124666]: pgmap v20390: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 739 KiB/s rd, 667 KiB/s wr, 7 op/s 2023-05-08T14:19:54.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:54 smithi133 ceph-mon[125939]: pgmap v20391: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 739 KiB/s rd, 667 KiB/s wr, 7 op/s 2023-05-08T14:19:54.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38133.442851 secs 2023-05-08T14:19:54.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:54 smithi096 ceph-mon[124666]: pgmap v20391: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 739 KiB/s rd, 667 KiB/s wr, 7 op/s 2023-05-08T14:19:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38133.442851 secs 2023-05-08T14:19:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:54 smithi186 ceph-mon[126480]: pgmap v20391: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 739 KiB/s rd, 667 KiB/s wr, 7 op/s 2023-05-08T14:19:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38133.442851 secs 2023-05-08T14:19:56.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:56 smithi186 ceph-mon[126480]: pgmap v20392: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 954 KiB/s wr, 11 op/s 2023-05-08T14:19:56.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:56 smithi133 ceph-mon[125939]: pgmap v20392: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 954 KiB/s wr, 11 op/s 2023-05-08T14:19:57.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:56 smithi096 ceph-mon[124666]: pgmap v20392: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 954 KiB/s wr, 11 op/s 2023-05-08T14:19:57.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:19:57.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:19:58.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:19:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:58 smithi186 ceph-mon[126480]: pgmap v20393: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 934 KiB/s rd, 862 KiB/s wr, 8 op/s 2023-05-08T14:19:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:58 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:19:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:19:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:19:58.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:58 smithi133 ceph-mon[125939]: pgmap v20393: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 934 KiB/s rd, 862 KiB/s wr, 8 op/s 2023-05-08T14:19:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:58 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:19:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:19:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:19:59.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:58 smithi096 ceph-mon[124666]: pgmap v20393: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 934 KiB/s rd, 862 KiB/s wr, 8 op/s 2023-05-08T14:19:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:58 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:19:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:19:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:19:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:19:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38138.443005 secs 2023-05-08T14:19:59.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:19:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38138.443005 secs 2023-05-08T14:20:00.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:19:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38138.443005 secs 2023-05-08T14:20:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:00 smithi186 ceph-mon[126480]: pgmap v20394: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2023-05-08T14:20:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:00 smithi186 ceph-mon[126480]: overall HEALTH_WARN 1 MDSs report slow requests 2023-05-08T14:20:00.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:00 smithi133 ceph-mon[125939]: pgmap v20394: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2023-05-08T14:20:00.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:00 smithi133 ceph-mon[125939]: overall HEALTH_WARN 1 MDSs report slow requests 2023-05-08T14:20:01.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:00 smithi096 ceph-mon[124666]: pgmap v20394: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2023-05-08T14:20:01.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:00 smithi096 ceph-mon[124666]: overall HEALTH_WARN 1 MDSs report slow requests 2023-05-08T14:20:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:02 smithi186 ceph-mon[126480]: pgmap v20395: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 858 KiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T14:20:02.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:02 smithi133 ceph-mon[125939]: pgmap v20395: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 858 KiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T14:20:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:02 smithi096 ceph-mon[124666]: pgmap v20395: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 858 KiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T14:20:04.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:04 smithi133 ceph-mon[125939]: pgmap v20396: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 760 KiB/s rd, 1.1 MiB/s wr, 9 op/s 2023-05-08T14:20:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:04 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:20:04.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:04 smithi096 ceph-mon[124666]: pgmap v20396: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 760 KiB/s rd, 1.1 MiB/s wr, 9 op/s 2023-05-08T14:20:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:04 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:20:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:04 smithi186 ceph-mon[126480]: pgmap v20396: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 760 KiB/s rd, 1.1 MiB/s wr, 9 op/s 2023-05-08T14:20:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:04 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:20:05.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:05 smithi133 ceph-mon[125939]: Health check cleared: MDS_SLOW_REQUEST (was: 1 MDSs report slow requests) 2023-05-08T14:20:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:05 smithi133 ceph-mon[125939]: Cluster is now healthy 2023-05-08T14:20:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T14:20:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:20:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38143.997135 secs 2023-05-08T14:20:05.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:05 smithi096 ceph-mon[124666]: Health check cleared: MDS_SLOW_REQUEST (was: 1 MDSs report slow requests) 2023-05-08T14:20:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:05 smithi096 ceph-mon[124666]: Cluster is now healthy 2023-05-08T14:20:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T14:20:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:20:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38143.997135 secs 2023-05-08T14:20:05.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:05 smithi186 ceph-mon[126480]: Health check cleared: MDS_SLOW_REQUEST (was: 1 MDSs report slow requests) 2023-05-08T14:20:05.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:05 smithi186 ceph-mon[126480]: Cluster is now healthy 2023-05-08T14:20:05.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T14:20:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:20:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38143.997135 secs 2023-05-08T14:20:06.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:06 smithi133 ceph-mon[125939]: Health check failed: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:20:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:20:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:20:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:06 smithi133 ceph-mon[125939]: pgmap v20397: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 28 op/s 2023-05-08T14:20:06.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:06 smithi096 ceph-mon[124666]: Health check failed: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:20:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:20:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:20:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:06 smithi096 ceph-mon[124666]: pgmap v20397: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 28 op/s 2023-05-08T14:20:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:06 smithi186 ceph-mon[126480]: Health check failed: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:20:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:20:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:20:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:06 smithi186 ceph-mon[126480]: pgmap v20397: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 28 op/s 2023-05-08T14:20:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:08 smithi186 ceph-mon[126480]: pgmap v20398: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 24 op/s 2023-05-08T14:20:08.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:08 smithi133 ceph-mon[125939]: pgmap v20398: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 24 op/s 2023-05-08T14:20:09.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:08 smithi096 ceph-mon[124666]: pgmap v20398: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 24 op/s 2023-05-08T14:20:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38148.997253 secs 2023-05-08T14:20:09.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38148.997253 secs 2023-05-08T14:20:10.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38148.997253 secs 2023-05-08T14:20:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:10 smithi186 ceph-mon[126480]: pgmap v20399: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 28 op/s 2023-05-08T14:20:10.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:10 smithi133 ceph-mon[125939]: pgmap v20399: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 28 op/s 2023-05-08T14:20:11.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:10 smithi096 ceph-mon[124666]: pgmap v20399: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 28 op/s 2023-05-08T14:20:12.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:12 smithi186 ceph-mon[126480]: pgmap v20400: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 812 KiB/s wr, 23 op/s 2023-05-08T14:20:12.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:12 smithi133 ceph-mon[125939]: pgmap v20400: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 812 KiB/s wr, 23 op/s 2023-05-08T14:20:13.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:12 smithi096 ceph-mon[124666]: pgmap v20400: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 812 KiB/s wr, 23 op/s 2023-05-08T14:20:14.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:14 smithi133 ceph-mon[125939]: pgmap v20401: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 812 KiB/s wr, 23 op/s 2023-05-08T14:20:14.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:14 smithi096 ceph-mon[124666]: pgmap v20401: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 812 KiB/s wr, 23 op/s 2023-05-08T14:20:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:14 smithi186 ceph-mon[126480]: pgmap v20401: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 812 KiB/s wr, 23 op/s 2023-05-08T14:20:15.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38153.997375 secs 2023-05-08T14:20:15.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38153.997375 secs 2023-05-08T14:20:15.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38153.997375 secs 2023-05-08T14:20:16.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:16 smithi133 ceph-mon[125939]: pgmap v20402: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 26 op/s 2023-05-08T14:20:16.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:16 smithi096 ceph-mon[124666]: pgmap v20402: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 26 op/s 2023-05-08T14:20:16.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:16 smithi186 ceph-mon[126480]: pgmap v20402: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 26 op/s 2023-05-08T14:20:18.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:18 smithi186 ceph-mon[126480]: pgmap v20403: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 526 KiB/s wr, 8 op/s 2023-05-08T14:20:18.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:18 smithi133 ceph-mon[125939]: pgmap v20403: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 526 KiB/s wr, 8 op/s 2023-05-08T14:20:19.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:18 smithi096 ceph-mon[124666]: pgmap v20403: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 526 KiB/s wr, 8 op/s 2023-05-08T14:20:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38158.997495 secs 2023-05-08T14:20:19.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38158.997495 secs 2023-05-08T14:20:20.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38158.997495 secs 2023-05-08T14:20:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:20 smithi186 ceph-mon[126480]: pgmap v20404: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 529 KiB/s rd, 526 KiB/s wr, 11 op/s 2023-05-08T14:20:20.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:20 smithi133 ceph-mon[125939]: pgmap v20404: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 529 KiB/s rd, 526 KiB/s wr, 11 op/s 2023-05-08T14:20:21.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:20 smithi096 ceph-mon[124666]: pgmap v20404: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 529 KiB/s rd, 526 KiB/s wr, 11 op/s 2023-05-08T14:20:22.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:22 smithi186 ceph-mon[126480]: pgmap v20405: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 526 KiB/s rd, 524 KiB/s wr, 7 op/s 2023-05-08T14:20:22.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:22 smithi133 ceph-mon[125939]: pgmap v20405: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 526 KiB/s rd, 524 KiB/s wr, 7 op/s 2023-05-08T14:20:23.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:22 smithi096 ceph-mon[124666]: pgmap v20405: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 526 KiB/s rd, 524 KiB/s wr, 7 op/s 2023-05-08T14:20:24.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:24 smithi133 ceph-mon[125939]: pgmap v20406: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 526 KiB/s rd, 524 KiB/s wr, 7 op/s 2023-05-08T14:20:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38163.443588 secs 2023-05-08T14:20:24.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:24 smithi096 ceph-mon[124666]: pgmap v20406: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 526 KiB/s rd, 524 KiB/s wr, 7 op/s 2023-05-08T14:20:24.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38163.443588 secs 2023-05-08T14:20:24.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:24 smithi186 ceph-mon[126480]: pgmap v20406: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 526 KiB/s rd, 524 KiB/s wr, 7 op/s 2023-05-08T14:20:24.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38163.443588 secs 2023-05-08T14:20:25.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:25 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:20:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:25 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T14:20:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:25 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:20:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:25 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:20:25.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:25 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:20:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:25 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T14:20:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:25 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:20:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:25 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:20:25.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:25 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:20:25.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:25 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T14:20:25.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:25 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:20:25.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:25 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:20:26.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:26 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:20:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:26 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:20:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:26 smithi133 ceph-mon[125939]: pgmap v20407: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 14 op/s 2023-05-08T14:20:26.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:26 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:20:26.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:26 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:20:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:26 smithi096 ceph-mon[124666]: pgmap v20407: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 14 op/s 2023-05-08T14:20:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:26 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:20:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:26 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:20:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:26 smithi186 ceph-mon[126480]: pgmap v20407: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 14 op/s 2023-05-08T14:20:28.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:28 smithi186 ceph-mon[126480]: pgmap v20408: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 919 KiB/s wr, 11 op/s 2023-05-08T14:20:28.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:28 smithi133 ceph-mon[125939]: pgmap v20408: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 919 KiB/s wr, 11 op/s 2023-05-08T14:20:29.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:28 smithi096 ceph-mon[124666]: pgmap v20408: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 919 KiB/s wr, 11 op/s 2023-05-08T14:20:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38168.443711 secs 2023-05-08T14:20:29.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38168.443711 secs 2023-05-08T14:20:30.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38168.443711 secs 2023-05-08T14:20:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:30 smithi186 ceph-mon[126480]: pgmap v20409: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 949 KiB/s wr, 15 op/s 2023-05-08T14:20:30.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:30 smithi133 ceph-mon[125939]: pgmap v20409: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 949 KiB/s wr, 15 op/s 2023-05-08T14:20:31.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:30 smithi096 ceph-mon[124666]: pgmap v20409: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 949 KiB/s wr, 15 op/s 2023-05-08T14:20:32.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:32 smithi186 ceph-mon[126480]: pgmap v20410: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 929 KiB/s rd, 949 KiB/s wr, 11 op/s 2023-05-08T14:20:32.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:32 smithi186 ceph-mon[126480]: osdmap e1352: 12 total, 12 up, 12 in 2023-05-08T14:20:32.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:32 smithi133 ceph-mon[125939]: pgmap v20410: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 929 KiB/s rd, 949 KiB/s wr, 11 op/s 2023-05-08T14:20:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:32 smithi133 ceph-mon[125939]: osdmap e1352: 12 total, 12 up, 12 in 2023-05-08T14:20:33.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:32 smithi096 ceph-mon[124666]: pgmap v20410: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 929 KiB/s rd, 949 KiB/s wr, 11 op/s 2023-05-08T14:20:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:32 smithi096 ceph-mon[124666]: osdmap e1352: 12 total, 12 up, 12 in 2023-05-08T14:20:33.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:33 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:20:33.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:33 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:20:34.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:33 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:20:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:34 smithi186 ceph-mon[126480]: pgmap v20412: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T14:20:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38173.443848 secs 2023-05-08T14:20:34.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:34 smithi133 ceph-mon[125939]: pgmap v20412: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T14:20:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38173.443848 secs 2023-05-08T14:20:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:34 smithi096 ceph-mon[124666]: pgmap v20412: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T14:20:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38173.443848 secs 2023-05-08T14:20:36.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:36 smithi186 ceph-mon[126480]: pgmap v20413: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 232 KiB/s wr, 9 op/s 2023-05-08T14:20:36.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:36 smithi133 ceph-mon[125939]: pgmap v20413: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 232 KiB/s wr, 9 op/s 2023-05-08T14:20:37.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:36 smithi096 ceph-mon[124666]: pgmap v20413: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 232 KiB/s wr, 9 op/s 2023-05-08T14:20:37.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:37 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:20:37.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:37 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:20:38.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:37 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:20:38.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:38 smithi186 ceph-mon[126480]: pgmap v20414: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 232 KiB/s wr, 9 op/s 2023-05-08T14:20:38.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:20:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:20:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:20:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:20:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:20:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:20:38.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:38 smithi186 ceph-mon[126480]: osdmap e1353: 12 total, 12 up, 12 in 2023-05-08T14:20:38.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:38 smithi133 ceph-mon[125939]: pgmap v20414: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 232 KiB/s wr, 9 op/s 2023-05-08T14:20:38.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:20:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:20:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:20:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:20:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:20:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:20:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:38 smithi133 ceph-mon[125939]: osdmap e1353: 12 total, 12 up, 12 in 2023-05-08T14:20:39.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:38 smithi096 ceph-mon[124666]: pgmap v20414: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 232 KiB/s wr, 9 op/s 2023-05-08T14:20:39.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:20:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:20:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:20:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:20:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:20:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:20:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:38 smithi096 ceph-mon[124666]: osdmap e1353: 12 total, 12 up, 12 in 2023-05-08T14:20:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:20:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:20:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:39 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:20:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:20:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:39 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T14:20:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:39 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T14:20:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:39 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:20:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38178.443971 secs 2023-05-08T14:20:39.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:20:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:20:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:39 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:20:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:20:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:39 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T14:20:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:39 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T14:20:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:39 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:20:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38178.443971 secs 2023-05-08T14:20:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:20:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:20:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:39 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:20:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:20:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:39 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T14:20:40.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:39 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T14:20:40.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:39 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:20:40.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38178.443971 secs 2023-05-08T14:20:40.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:40 smithi133 ceph-mon[125939]: pgmap v20416: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 498 KiB/s wr, 11 op/s 2023-05-08T14:20:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38180.339207 secs 2023-05-08T14:20:41.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:40 smithi096 ceph-mon[124666]: pgmap v20416: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 498 KiB/s wr, 11 op/s 2023-05-08T14:20:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38180.339207 secs 2023-05-08T14:20:41.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:40 smithi186 ceph-mon[126480]: pgmap v20416: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 498 KiB/s wr, 11 op/s 2023-05-08T14:20:41.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38180.339207 secs 2023-05-08T14:20:41.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:41 smithi133 ceph-mon[125939]: pgmap v20417: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 404 KiB/s rd, 402 KiB/s wr, 9 op/s 2023-05-08T14:20:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:41 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:20:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:41 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:20:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:41 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:20:42.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:41 smithi096 ceph-mon[124666]: pgmap v20417: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 404 KiB/s rd, 402 KiB/s wr, 9 op/s 2023-05-08T14:20:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:41 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:20:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:41 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:20:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:41 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:20:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:41 smithi186 ceph-mon[126480]: pgmap v20417: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 404 KiB/s rd, 402 KiB/s wr, 9 op/s 2023-05-08T14:20:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:41 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:20:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:41 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:20:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:41 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:20:44.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:44 smithi133 ceph-mon[125939]: pgmap v20418: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 399 KiB/s wr, 9 op/s 2023-05-08T14:20:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38183.444106 secs 2023-05-08T14:20:44.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:44 smithi096 ceph-mon[124666]: pgmap v20418: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 399 KiB/s wr, 9 op/s 2023-05-08T14:20:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38183.444106 secs 2023-05-08T14:20:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:44 smithi186 ceph-mon[126480]: pgmap v20418: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 399 KiB/s wr, 9 op/s 2023-05-08T14:20:44.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38183.444106 secs 2023-05-08T14:20:45.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38183.998090 secs 2023-05-08T14:20:45.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38183.998090 secs 2023-05-08T14:20:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38183.998090 secs 2023-05-08T14:20:46.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:46 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:20:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:46 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:20:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:46 smithi096 ceph-mon[124666]: pgmap v20419: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 838 KiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T14:20:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:46 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:20:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:46 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:20:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:46 smithi186 ceph-mon[126480]: pgmap v20419: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 838 KiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T14:20:46.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:46 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:20:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:46 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:20:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:46 smithi133 ceph-mon[125939]: pgmap v20419: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 838 KiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T14:20:48.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:48 smithi186 ceph-mon[126480]: pgmap v20420: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 838 KiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T14:20:48.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:48 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:20:48.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:48 smithi133 ceph-mon[125939]: pgmap v20420: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 838 KiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T14:20:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:48 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:20:49.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:48 smithi096 ceph-mon[124666]: pgmap v20420: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 838 KiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T14:20:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:48 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:20:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38188.444229 secs 2023-05-08T14:20:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:20:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38188.998186 secs 2023-05-08T14:20:49.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38188.444229 secs 2023-05-08T14:20:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:20:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38188.998186 secs 2023-05-08T14:20:50.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38188.444229 secs 2023-05-08T14:20:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:20:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38188.998186 secs 2023-05-08T14:20:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:50 smithi186 ceph-mon[126480]: pgmap v20421: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 15 op/s 2023-05-08T14:20:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:20:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:20:50.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:50 smithi133 ceph-mon[125939]: pgmap v20421: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 15 op/s 2023-05-08T14:20:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:20:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:20:51.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:50 smithi096 ceph-mon[124666]: pgmap v20421: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 15 op/s 2023-05-08T14:20:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:20:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:20:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:52 smithi186 ceph-mon[126480]: pgmap v20422: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 10 op/s 2023-05-08T14:20:52.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:52 smithi133 ceph-mon[125939]: pgmap v20422: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 10 op/s 2023-05-08T14:20:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:52 smithi096 ceph-mon[124666]: pgmap v20422: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 10 op/s 2023-05-08T14:20:53.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:53 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:20:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:53 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:20:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:53 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:20:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:54 smithi186 ceph-mon[126480]: pgmap v20423: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 10 op/s 2023-05-08T14:20:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38193.444376 secs 2023-05-08T14:20:54.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:54 smithi133 ceph-mon[125939]: pgmap v20423: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 10 op/s 2023-05-08T14:20:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38193.444376 secs 2023-05-08T14:20:55.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:54 smithi096 ceph-mon[124666]: pgmap v20423: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 10 op/s 2023-05-08T14:20:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38193.444376 secs 2023-05-08T14:20:56.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:56 smithi186 ceph-mon[126480]: pgmap v20424: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.8 MiB/s wr, 15 op/s 2023-05-08T14:20:56.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:56 smithi133 ceph-mon[125939]: pgmap v20424: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.8 MiB/s wr, 15 op/s 2023-05-08T14:20:57.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:56 smithi096 ceph-mon[124666]: pgmap v20424: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.8 MiB/s wr, 15 op/s 2023-05-08T14:20:57.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:20:57.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:20:58.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:20:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:58 smithi186 ceph-mon[126480]: pgmap v20425: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T14:20:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:20:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:20:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:58 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:20:58.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:58 smithi133 ceph-mon[125939]: pgmap v20425: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T14:20:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:20:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:20:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:58 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:20:59.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:58 smithi096 ceph-mon[124666]: pgmap v20425: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T14:20:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:20:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:20:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:58 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:20:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38198.444480 secs 2023-05-08T14:20:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:20:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38198.998410 secs 2023-05-08T14:20:59.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38198.444480 secs 2023-05-08T14:20:59.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:20:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38198.998410 secs 2023-05-08T14:21:00.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38198.444480 secs 2023-05-08T14:21:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:20:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38198.998410 secs 2023-05-08T14:21:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:00 smithi186 ceph-mon[126480]: pgmap v20426: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 17 op/s 2023-05-08T14:21:00.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:00 smithi133 ceph-mon[125939]: pgmap v20426: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 17 op/s 2023-05-08T14:21:01.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:00 smithi096 ceph-mon[124666]: pgmap v20426: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 17 op/s 2023-05-08T14:21:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:02 smithi186 ceph-mon[126480]: pgmap v20427: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.8 MiB/s wr, 12 op/s 2023-05-08T14:21:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:21:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:21:02.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:02 smithi133 ceph-mon[125939]: pgmap v20427: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.8 MiB/s wr, 12 op/s 2023-05-08T14:21:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:21:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:21:03.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:02 smithi096 ceph-mon[124666]: pgmap v20427: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.8 MiB/s wr, 12 op/s 2023-05-08T14:21:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:21:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:21:03.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:03 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:21:03.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:03 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:21:04.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:03 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:21:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:04 smithi186 ceph-mon[126480]: pgmap v20428: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.6 MiB/s wr, 12 op/s 2023-05-08T14:21:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38203.444615 secs 2023-05-08T14:21:04.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:04 smithi133 ceph-mon[125939]: pgmap v20428: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.6 MiB/s wr, 12 op/s 2023-05-08T14:21:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38203.444615 secs 2023-05-08T14:21:05.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:04 smithi096 ceph-mon[124666]: pgmap v20428: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.6 MiB/s wr, 12 op/s 2023-05-08T14:21:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38203.444615 secs 2023-05-08T14:21:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:05 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:21:05.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:05 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:21:06.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:05 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:21:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:06 smithi186 ceph-mon[126480]: pgmap v20429: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 19 op/s 2023-05-08T14:21:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:21:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:21:06.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:06 smithi133 ceph-mon[125939]: pgmap v20429: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 19 op/s 2023-05-08T14:21:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:21:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:21:07.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:06 smithi096 ceph-mon[124666]: pgmap v20429: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 19 op/s 2023-05-08T14:21:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:21:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:21:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:08 smithi186 ceph-mon[126480]: pgmap v20430: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 14 op/s 2023-05-08T14:21:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:08 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:21:08.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:08 smithi133 ceph-mon[125939]: pgmap v20430: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 14 op/s 2023-05-08T14:21:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:08 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:21:09.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:08 smithi096 ceph-mon[124666]: pgmap v20430: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 14 op/s 2023-05-08T14:21:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:08 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:21:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38208.444745 secs 2023-05-08T14:21:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38208.998658 secs 2023-05-08T14:21:09.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38208.444745 secs 2023-05-08T14:21:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38208.998658 secs 2023-05-08T14:21:10.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38208.444745 secs 2023-05-08T14:21:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38208.998658 secs 2023-05-08T14:21:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:10 smithi186 ceph-mon[126480]: pgmap v20431: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.0 MiB/s wr, 31 op/s 2023-05-08T14:21:10.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:10 smithi133 ceph-mon[125939]: pgmap v20431: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.0 MiB/s wr, 31 op/s 2023-05-08T14:21:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:10 smithi096 ceph-mon[124666]: pgmap v20431: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.0 MiB/s wr, 31 op/s 2023-05-08T14:21:11.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38210.339849 secs 2023-05-08T14:21:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:11 smithi133 ceph-mon[125939]: osdmap e1354: 12 total, 12 up, 12 in 2023-05-08T14:21:12.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38210.339849 secs 2023-05-08T14:21:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:11 smithi096 ceph-mon[124666]: osdmap e1354: 12 total, 12 up, 12 in 2023-05-08T14:21:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38210.339849 secs 2023-05-08T14:21:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:11 smithi186 ceph-mon[126480]: osdmap e1354: 12 total, 12 up, 12 in 2023-05-08T14:21:12.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:12 smithi133 ceph-mon[125939]: pgmap v20433: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.0 MiB/s wr, 31 op/s 2023-05-08T14:21:13.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:12 smithi096 ceph-mon[124666]: pgmap v20433: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.0 MiB/s wr, 31 op/s 2023-05-08T14:21:13.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:12 smithi186 ceph-mon[126480]: pgmap v20433: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.0 MiB/s wr, 31 op/s 2023-05-08T14:21:14.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:14 smithi133 ceph-mon[125939]: pgmap v20434: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.0 MiB/s wr, 31 op/s 2023-05-08T14:21:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:14 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:21:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:14 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:21:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:14 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:21:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:14 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:21:14.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38213.444873 secs 2023-05-08T14:21:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:14 smithi096 ceph-mon[124666]: pgmap v20434: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.0 MiB/s wr, 31 op/s 2023-05-08T14:21:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:14 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:21:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:14 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:21:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:14 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:21:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:14 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:21:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38213.444873 secs 2023-05-08T14:21:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:14 smithi186 ceph-mon[126480]: pgmap v20434: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.0 MiB/s wr, 31 op/s 2023-05-08T14:21:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:14 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:21:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:14 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:21:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:14 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:21:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:14 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:21:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38213.444873 secs 2023-05-08T14:21:15.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38213.998771 secs 2023-05-08T14:21:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38213.998771 secs 2023-05-08T14:21:15.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38213.998771 secs 2023-05-08T14:21:16.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:16 smithi133 ceph-mon[125939]: pgmap v20435: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 27 op/s 2023-05-08T14:21:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38215.339935 secs 2023-05-08T14:21:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:16 smithi096 ceph-mon[124666]: pgmap v20435: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 27 op/s 2023-05-08T14:21:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38215.339935 secs 2023-05-08T14:21:16.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:16 smithi186 ceph-mon[126480]: pgmap v20435: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 27 op/s 2023-05-08T14:21:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38215.339935 secs 2023-05-08T14:21:18.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:18 smithi186 ceph-mon[126480]: pgmap v20436: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 27 op/s 2023-05-08T14:21:18.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:18 smithi186 ceph-mon[126480]: osdmap e1355: 12 total, 12 up, 12 in 2023-05-08T14:21:18.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:18 smithi133 ceph-mon[125939]: pgmap v20436: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 27 op/s 2023-05-08T14:21:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:18 smithi133 ceph-mon[125939]: osdmap e1355: 12 total, 12 up, 12 in 2023-05-08T14:21:19.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:18 smithi096 ceph-mon[124666]: pgmap v20436: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 27 op/s 2023-05-08T14:21:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:18 smithi096 ceph-mon[124666]: osdmap e1355: 12 total, 12 up, 12 in 2023-05-08T14:21:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38218.445014 secs 2023-05-08T14:21:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38218.998875 secs 2023-05-08T14:21:19.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38218.445014 secs 2023-05-08T14:21:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38218.998875 secs 2023-05-08T14:21:20.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38218.445014 secs 2023-05-08T14:21:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38218.998875 secs 2023-05-08T14:21:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:20 smithi186 ceph-mon[126480]: pgmap v20438: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 753 KiB/s rd, 751 KiB/s wr, 11 op/s 2023-05-08T14:21:20.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:20 smithi133 ceph-mon[125939]: pgmap v20438: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 753 KiB/s rd, 751 KiB/s wr, 11 op/s 2023-05-08T14:21:21.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:20 smithi096 ceph-mon[124666]: pgmap v20438: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 753 KiB/s rd, 751 KiB/s wr, 11 op/s 2023-05-08T14:21:21.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38220.340073 secs 2023-05-08T14:21:21.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38220.340073 secs 2023-05-08T14:21:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38220.340073 secs 2023-05-08T14:21:22.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:22 smithi186 ceph-mon[126480]: pgmap v20439: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 668 KiB/s rd, 665 KiB/s wr, 10 op/s 2023-05-08T14:21:22.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:22 smithi133 ceph-mon[125939]: pgmap v20439: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 668 KiB/s rd, 665 KiB/s wr, 10 op/s 2023-05-08T14:21:23.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:22 smithi096 ceph-mon[124666]: pgmap v20439: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 668 KiB/s rd, 665 KiB/s wr, 10 op/s 2023-05-08T14:21:24.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:24 smithi133 ceph-mon[125939]: pgmap v20440: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 668 KiB/s rd, 665 KiB/s wr, 10 op/s 2023-05-08T14:21:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38223.445154 secs 2023-05-08T14:21:24.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:24 smithi096 ceph-mon[124666]: pgmap v20440: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 668 KiB/s rd, 665 KiB/s wr, 10 op/s 2023-05-08T14:21:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38223.445154 secs 2023-05-08T14:21:24.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:24 smithi186 ceph-mon[126480]: pgmap v20440: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 668 KiB/s rd, 665 KiB/s wr, 10 op/s 2023-05-08T14:21:24.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38223.445154 secs 2023-05-08T14:21:25.489 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38223.999003 secs 2023-05-08T14:21:25.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38223.999003 secs 2023-05-08T14:21:25.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38223.999003 secs 2023-05-08T14:21:26.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:26 smithi096 ceph-mon[124666]: pgmap v20441: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 667 KiB/s rd, 665 KiB/s wr, 9 op/s 2023-05-08T14:21:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38225.340205 secs 2023-05-08T14:21:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:26 smithi186 ceph-mon[126480]: pgmap v20441: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 667 KiB/s rd, 665 KiB/s wr, 9 op/s 2023-05-08T14:21:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38225.340205 secs 2023-05-08T14:21:26.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:26 smithi133 ceph-mon[125939]: pgmap v20441: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 667 KiB/s rd, 665 KiB/s wr, 9 op/s 2023-05-08T14:21:26.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38225.340205 secs 2023-05-08T14:21:28.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:28 smithi186 ceph-mon[126480]: pgmap v20442: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 667 KiB/s rd, 665 KiB/s wr, 9 op/s 2023-05-08T14:21:28.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:28 smithi133 ceph-mon[125939]: pgmap v20442: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 667 KiB/s rd, 665 KiB/s wr, 9 op/s 2023-05-08T14:21:29.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:28 smithi096 ceph-mon[124666]: pgmap v20442: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 667 KiB/s rd, 665 KiB/s wr, 9 op/s 2023-05-08T14:21:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38228.445301 secs 2023-05-08T14:21:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38228.999119 secs 2023-05-08T14:21:29.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38228.445301 secs 2023-05-08T14:21:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38228.999119 secs 2023-05-08T14:21:30.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38228.445301 secs 2023-05-08T14:21:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38228.999119 secs 2023-05-08T14:21:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:30 smithi186 ceph-mon[126480]: pgmap v20443: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 914 KiB/s rd, 911 KiB/s wr, 12 op/s 2023-05-08T14:21:30.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:30 smithi133 ceph-mon[125939]: pgmap v20443: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 914 KiB/s rd, 911 KiB/s wr, 12 op/s 2023-05-08T14:21:31.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:30 smithi096 ceph-mon[124666]: pgmap v20443: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 914 KiB/s rd, 911 KiB/s wr, 12 op/s 2023-05-08T14:21:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38230.340336 secs 2023-05-08T14:21:31.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38230.340336 secs 2023-05-08T14:21:32.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38230.340336 secs 2023-05-08T14:21:32.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:32 smithi186 ceph-mon[126480]: pgmap v20444: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 301 KiB/s wr, 7 op/s 2023-05-08T14:21:32.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:32 smithi133 ceph-mon[125939]: pgmap v20444: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 301 KiB/s wr, 7 op/s 2023-05-08T14:21:33.007 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:32 smithi096 ceph-mon[124666]: pgmap v20444: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 301 KiB/s wr, 7 op/s 2023-05-08T14:21:34.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:34 smithi096 ceph-mon[124666]: pgmap v20445: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 301 KiB/s wr, 7 op/s 2023-05-08T14:21:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38233.445428 secs 2023-05-08T14:21:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:34 smithi186 ceph-mon[126480]: pgmap v20445: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 301 KiB/s wr, 7 op/s 2023-05-08T14:21:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38233.445428 secs 2023-05-08T14:21:34.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:34 smithi133 ceph-mon[125939]: pgmap v20445: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 301 KiB/s wr, 7 op/s 2023-05-08T14:21:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38233.445428 secs 2023-05-08T14:21:35.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38233.999235 secs 2023-05-08T14:21:35.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38233.999235 secs 2023-05-08T14:21:35.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38233.999235 secs 2023-05-08T14:21:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:36 smithi096 ceph-mon[124666]: pgmap v20446: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 470 KiB/s wr, 11 op/s 2023-05-08T14:21:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38235.340418 secs 2023-05-08T14:21:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:36 smithi186 ceph-mon[126480]: pgmap v20446: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 470 KiB/s wr, 11 op/s 2023-05-08T14:21:36.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38235.340418 secs 2023-05-08T14:21:36.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:36 smithi133 ceph-mon[125939]: pgmap v20446: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 470 KiB/s wr, 11 op/s 2023-05-08T14:21:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38235.340418 secs 2023-05-08T14:21:38.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:38 smithi186 ceph-mon[126480]: pgmap v20447: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 469 KiB/s wr, 7 op/s 2023-05-08T14:21:38.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:38 smithi133 ceph-mon[125939]: pgmap v20447: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 469 KiB/s wr, 7 op/s 2023-05-08T14:21:39.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:38 smithi096 ceph-mon[124666]: pgmap v20447: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 469 KiB/s wr, 7 op/s 2023-05-08T14:21:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38238.445508 secs 2023-05-08T14:21:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:21:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38238.999298 secs 2023-05-08T14:21:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:21:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:21:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:21:39.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38238.445508 secs 2023-05-08T14:21:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:21:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38238.999298 secs 2023-05-08T14:21:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:21:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:21:39.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:21:40.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38238.445508 secs 2023-05-08T14:21:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:21:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38238.999298 secs 2023-05-08T14:21:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:21:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:21:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:21:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:40 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:21:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:40 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T14:21:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:40 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T14:21:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:40 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:21:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:40 smithi186 ceph-mon[126480]: pgmap v20448: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 809 KiB/s rd, 806 KiB/s wr, 10 op/s 2023-05-08T14:21:40.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:40 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:21:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:40 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T14:21:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:40 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T14:21:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:40 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:21:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:40 smithi133 ceph-mon[125939]: pgmap v20448: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 809 KiB/s rd, 806 KiB/s wr, 10 op/s 2023-05-08T14:21:41.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:40 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:21:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:40 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T14:21:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:40 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T14:21:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:40 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:21:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:40 smithi096 ceph-mon[124666]: pgmap v20448: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 809 KiB/s rd, 806 KiB/s wr, 10 op/s 2023-05-08T14:21:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38240.340546 secs 2023-05-08T14:21:41.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38240.340546 secs 2023-05-08T14:21:42.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38240.340546 secs 2023-05-08T14:21:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:42 smithi186 ceph-mon[126480]: pgmap v20449: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 505 KiB/s wr, 7 op/s 2023-05-08T14:21:42.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:42 smithi133 ceph-mon[125939]: pgmap v20449: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 505 KiB/s wr, 7 op/s 2023-05-08T14:21:43.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:42 smithi096 ceph-mon[124666]: pgmap v20449: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 505 KiB/s wr, 7 op/s 2023-05-08T14:21:44.511 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:44 smithi096 ceph-mon[124666]: pgmap v20450: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 505 KiB/s wr, 7 op/s 2023-05-08T14:21:44.512 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38243.445627 secs 2023-05-08T14:21:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:44 smithi186 ceph-mon[126480]: pgmap v20450: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 505 KiB/s wr, 7 op/s 2023-05-08T14:21:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38243.445627 secs 2023-05-08T14:21:44.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:44 smithi133 ceph-mon[125939]: pgmap v20450: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 505 KiB/s wr, 7 op/s 2023-05-08T14:21:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38243.445627 secs 2023-05-08T14:21:45.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38243.999417 secs 2023-05-08T14:21:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38243.999417 secs 2023-05-08T14:21:45.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38243.999417 secs 2023-05-08T14:21:46.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:46 smithi096 ceph-mon[124666]: pgmap v20451: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 697 KiB/s rd, 693 KiB/s wr, 10 op/s 2023-05-08T14:21:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:46 smithi186 ceph-mon[126480]: pgmap v20451: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 697 KiB/s rd, 693 KiB/s wr, 10 op/s 2023-05-08T14:21:46.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:46 smithi133 ceph-mon[125939]: pgmap v20451: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 697 KiB/s rd, 693 KiB/s wr, 10 op/s 2023-05-08T14:21:48.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:48 smithi186 ceph-mon[126480]: pgmap v20452: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 527 KiB/s rd, 525 KiB/s wr, 6 op/s 2023-05-08T14:21:48.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:48 smithi133 ceph-mon[125939]: pgmap v20452: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 527 KiB/s rd, 525 KiB/s wr, 6 op/s 2023-05-08T14:21:49.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:48 smithi096 ceph-mon[124666]: pgmap v20452: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 527 KiB/s rd, 525 KiB/s wr, 6 op/s 2023-05-08T14:21:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38248.445762 secs 2023-05-08T14:21:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:21:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38248.999552 secs 2023-05-08T14:21:49.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38248.445762 secs 2023-05-08T14:21:49.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:21:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38248.999552 secs 2023-05-08T14:21:50.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38248.445762 secs 2023-05-08T14:21:50.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:21:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38248.999552 secs 2023-05-08T14:21:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:50 smithi186 ceph-mon[126480]: pgmap v20453: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1003 KiB/s wr, 11 op/s 2023-05-08T14:21:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:21:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:21:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:21:50.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:50 smithi133 ceph-mon[125939]: pgmap v20453: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1003 KiB/s wr, 11 op/s 2023-05-08T14:21:50.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:21:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:21:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:21:51.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:50 smithi096 ceph-mon[124666]: pgmap v20453: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1003 KiB/s wr, 11 op/s 2023-05-08T14:21:51.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:21:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:21:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:21:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:52 smithi186 ceph-mon[126480]: pgmap v20454: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 727 KiB/s rd, 667 KiB/s wr, 7 op/s 2023-05-08T14:21:52.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:52 smithi133 ceph-mon[125939]: pgmap v20454: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 727 KiB/s rd, 667 KiB/s wr, 7 op/s 2023-05-08T14:21:53.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:52 smithi096 ceph-mon[124666]: pgmap v20454: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 727 KiB/s rd, 667 KiB/s wr, 7 op/s 2023-05-08T14:21:54.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:54 smithi096 ceph-mon[124666]: pgmap v20455: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 727 KiB/s rd, 667 KiB/s wr, 7 op/s 2023-05-08T14:21:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38253.445874 secs 2023-05-08T14:21:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:54 smithi186 ceph-mon[126480]: pgmap v20455: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 727 KiB/s rd, 667 KiB/s wr, 7 op/s 2023-05-08T14:21:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38253.445874 secs 2023-05-08T14:21:54.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:54 smithi133 ceph-mon[125939]: pgmap v20455: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 727 KiB/s rd, 667 KiB/s wr, 7 op/s 2023-05-08T14:21:54.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38253.445874 secs 2023-05-08T14:21:56.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:56 smithi186 ceph-mon[126480]: pgmap v20456: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T14:21:56.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:56 smithi133 ceph-mon[125939]: pgmap v20456: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T14:21:57.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:56 smithi096 ceph-mon[124666]: pgmap v20456: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T14:21:57.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:21:57.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:21:58.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:21:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:58 smithi186 ceph-mon[126480]: pgmap v20457: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1010 KiB/s wr, 9 op/s 2023-05-08T14:21:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:58 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:21:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:21:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:21:58.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:58 smithi133 ceph-mon[125939]: pgmap v20457: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1010 KiB/s wr, 9 op/s 2023-05-08T14:21:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:58 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:21:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:21:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:21:59.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:58 smithi096 ceph-mon[124666]: pgmap v20457: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1010 KiB/s wr, 9 op/s 2023-05-08T14:21:59.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:58 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:21:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:21:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:21:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:21:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38258.445977 secs 2023-05-08T14:21:59.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:21:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38258.445977 secs 2023-05-08T14:22:00.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:21:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38258.445977 secs 2023-05-08T14:22:00.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:00 smithi186 ceph-mon[126480]: pgmap v20458: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 14 op/s 2023-05-08T14:22:00.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:00 smithi133 ceph-mon[125939]: pgmap v20458: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 14 op/s 2023-05-08T14:22:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:00 smithi096 ceph-mon[124666]: pgmap v20458: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 14 op/s 2023-05-08T14:22:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:02 smithi186 ceph-mon[126480]: pgmap v20459: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T14:22:02.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:02 smithi133 ceph-mon[125939]: pgmap v20459: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T14:22:03.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:02 smithi096 ceph-mon[124666]: pgmap v20459: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T14:22:04.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:04 smithi096 ceph-mon[124666]: pgmap v20460: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T14:22:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38263.446121 secs 2023-05-08T14:22:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:04 smithi186 ceph-mon[126480]: pgmap v20460: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T14:22:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38263.446121 secs 2023-05-08T14:22:04.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:04 smithi133 ceph-mon[125939]: pgmap v20460: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T14:22:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38263.446121 secs 2023-05-08T14:22:05.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38263.999943 secs 2023-05-08T14:22:05.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38263.999943 secs 2023-05-08T14:22:05.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38263.999943 secs 2023-05-08T14:22:06.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:06 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:22:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:22:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:22:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:06 smithi096 ceph-mon[124666]: pgmap v20461: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 28 op/s 2023-05-08T14:22:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:06 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:22:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:22:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:22:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:06 smithi186 ceph-mon[126480]: pgmap v20461: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 28 op/s 2023-05-08T14:22:06.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:06 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:22:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:22:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:22:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:06 smithi133 ceph-mon[125939]: pgmap v20461: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 28 op/s 2023-05-08T14:22:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:08 smithi186 ceph-mon[126480]: pgmap v20462: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 23 op/s 2023-05-08T14:22:08.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:08 smithi133 ceph-mon[125939]: pgmap v20462: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 23 op/s 2023-05-08T14:22:09.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:08 smithi096 ceph-mon[124666]: pgmap v20462: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 23 op/s 2023-05-08T14:22:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38268.446185 secs 2023-05-08T14:22:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38269.000060 secs 2023-05-08T14:22:09.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38268.446185 secs 2023-05-08T14:22:09.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38269.000060 secs 2023-05-08T14:22:10.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38268.446185 secs 2023-05-08T14:22:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38269.000060 secs 2023-05-08T14:22:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:10 smithi186 ceph-mon[126480]: pgmap v20463: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 27 op/s 2023-05-08T14:22:10.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:10 smithi133 ceph-mon[125939]: pgmap v20463: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 27 op/s 2023-05-08T14:22:11.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:10 smithi096 ceph-mon[124666]: pgmap v20463: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 27 op/s 2023-05-08T14:22:12.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:12 smithi186 ceph-mon[126480]: pgmap v20464: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 631 KiB/s rd, 644 KiB/s wr, 22 op/s 2023-05-08T14:22:12.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:12 smithi133 ceph-mon[125939]: pgmap v20464: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 631 KiB/s rd, 644 KiB/s wr, 22 op/s 2023-05-08T14:22:13.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:12 smithi096 ceph-mon[124666]: pgmap v20464: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 631 KiB/s rd, 644 KiB/s wr, 22 op/s 2023-05-08T14:22:14.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:14 smithi096 ceph-mon[124666]: pgmap v20465: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 631 KiB/s rd, 644 KiB/s wr, 21 op/s 2023-05-08T14:22:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38273.446322 secs 2023-05-08T14:22:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:14 smithi186 ceph-mon[126480]: pgmap v20465: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 631 KiB/s rd, 644 KiB/s wr, 21 op/s 2023-05-08T14:22:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38273.446322 secs 2023-05-08T14:22:14.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:14 smithi133 ceph-mon[125939]: pgmap v20465: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 631 KiB/s rd, 644 KiB/s wr, 21 op/s 2023-05-08T14:22:14.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38273.446322 secs 2023-05-08T14:22:15.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38274.000196 secs 2023-05-08T14:22:15.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38274.000196 secs 2023-05-08T14:22:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38274.000196 secs 2023-05-08T14:22:16.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:16 smithi186 ceph-mon[126480]: pgmap v20466: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 25 op/s 2023-05-08T14:22:16.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:16 smithi133 ceph-mon[125939]: pgmap v20466: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 25 op/s 2023-05-08T14:22:16.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:16 smithi096 ceph-mon[124666]: pgmap v20466: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 25 op/s 2023-05-08T14:22:18.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:18 smithi186 ceph-mon[126480]: pgmap v20467: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 989 KiB/s rd, 861 KiB/s wr, 8 op/s 2023-05-08T14:22:18.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:18 smithi133 ceph-mon[125939]: pgmap v20467: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 989 KiB/s rd, 861 KiB/s wr, 8 op/s 2023-05-08T14:22:19.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:18 smithi096 ceph-mon[124666]: pgmap v20467: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 989 KiB/s rd, 861 KiB/s wr, 8 op/s 2023-05-08T14:22:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38278.446447 secs 2023-05-08T14:22:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38279.000314 secs 2023-05-08T14:22:19.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38278.446447 secs 2023-05-08T14:22:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38279.000314 secs 2023-05-08T14:22:20.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38278.446447 secs 2023-05-08T14:22:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38279.000314 secs 2023-05-08T14:22:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:20 smithi186 ceph-mon[126480]: pgmap v20468: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 991 KiB/s rd, 862 KiB/s wr, 11 op/s 2023-05-08T14:22:20.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:20 smithi133 ceph-mon[125939]: pgmap v20468: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 991 KiB/s rd, 862 KiB/s wr, 11 op/s 2023-05-08T14:22:21.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:20 smithi096 ceph-mon[124666]: pgmap v20468: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 991 KiB/s rd, 862 KiB/s wr, 11 op/s 2023-05-08T14:22:22.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:22 smithi186 ceph-mon[126480]: pgmap v20469: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 987 KiB/s rd, 860 KiB/s wr, 7 op/s 2023-05-08T14:22:22.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:22 smithi133 ceph-mon[125939]: pgmap v20469: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 987 KiB/s rd, 860 KiB/s wr, 7 op/s 2023-05-08T14:22:23.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:22 smithi096 ceph-mon[124666]: pgmap v20469: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 987 KiB/s rd, 860 KiB/s wr, 7 op/s 2023-05-08T14:22:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:24 smithi096 ceph-mon[124666]: pgmap v20470: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 987 KiB/s rd, 860 KiB/s wr, 7 op/s 2023-05-08T14:22:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38283.446563 secs 2023-05-08T14:22:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:24 smithi186 ceph-mon[126480]: pgmap v20470: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 987 KiB/s rd, 860 KiB/s wr, 7 op/s 2023-05-08T14:22:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38283.446563 secs 2023-05-08T14:22:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:24 smithi133 ceph-mon[125939]: pgmap v20470: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 987 KiB/s rd, 860 KiB/s wr, 7 op/s 2023-05-08T14:22:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38283.446563 secs 2023-05-08T14:22:25.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:25 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:22:25.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:25 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:22:25.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:25 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:22:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:26 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:22:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:26 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:22:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:26 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:22:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:26 smithi096 ceph-mon[124666]: pgmap v20471: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 15 op/s 2023-05-08T14:22:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:26 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:22:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:26 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:22:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:26 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:22:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:26 smithi186 ceph-mon[126480]: pgmap v20471: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 15 op/s 2023-05-08T14:22:26.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:26 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:22:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:26 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:22:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:26 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:22:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:26 smithi133 ceph-mon[125939]: pgmap v20471: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 15 op/s 2023-05-08T14:22:28.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:28 smithi186 ceph-mon[126480]: pgmap v20472: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T14:22:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:28 smithi133 ceph-mon[125939]: pgmap v20472: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T14:22:29.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:28 smithi096 ceph-mon[124666]: pgmap v20472: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T14:22:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38288.446699 secs 2023-05-08T14:22:29.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38288.446699 secs 2023-05-08T14:22:30.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38288.446699 secs 2023-05-08T14:22:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:30 smithi186 ceph-mon[126480]: pgmap v20473: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 937 KiB/s rd, 956 KiB/s wr, 14 op/s 2023-05-08T14:22:30.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:30 smithi133 ceph-mon[125939]: pgmap v20473: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 937 KiB/s rd, 956 KiB/s wr, 14 op/s 2023-05-08T14:22:31.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:30 smithi096 ceph-mon[124666]: pgmap v20473: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 937 KiB/s rd, 956 KiB/s wr, 14 op/s 2023-05-08T14:22:32.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:32 smithi186 ceph-mon[126480]: pgmap v20474: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 935 KiB/s rd, 955 KiB/s wr, 11 op/s 2023-05-08T14:22:32.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:32 smithi186 ceph-mon[126480]: osdmap e1356: 12 total, 12 up, 12 in 2023-05-08T14:22:32.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:32 smithi133 ceph-mon[125939]: pgmap v20474: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 935 KiB/s rd, 955 KiB/s wr, 11 op/s 2023-05-08T14:22:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:32 smithi133 ceph-mon[125939]: osdmap e1356: 12 total, 12 up, 12 in 2023-05-08T14:22:33.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:32 smithi096 ceph-mon[124666]: pgmap v20474: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 935 KiB/s rd, 955 KiB/s wr, 11 op/s 2023-05-08T14:22:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:32 smithi096 ceph-mon[124666]: osdmap e1356: 12 total, 12 up, 12 in 2023-05-08T14:22:34.504 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:34 smithi096 ceph-mon[124666]: pgmap v20476: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T14:22:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38293.446814 secs 2023-05-08T14:22:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:34 smithi186 ceph-mon[126480]: pgmap v20476: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T14:22:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38293.446814 secs 2023-05-08T14:22:34.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:34 smithi133 ceph-mon[125939]: pgmap v20476: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T14:22:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38293.446814 secs 2023-05-08T14:22:36.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:36 smithi186 ceph-mon[126480]: pgmap v20477: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 436 KiB/s wr, 9 op/s 2023-05-08T14:22:36.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:36 smithi133 ceph-mon[125939]: pgmap v20477: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 436 KiB/s wr, 9 op/s 2023-05-08T14:22:37.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:36 smithi096 ceph-mon[124666]: pgmap v20477: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 436 KiB/s wr, 9 op/s 2023-05-08T14:22:38.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:38 smithi186 ceph-mon[126480]: pgmap v20478: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 436 KiB/s wr, 9 op/s 2023-05-08T14:22:38.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:38 smithi186 ceph-mon[126480]: osdmap e1357: 12 total, 12 up, 12 in 2023-05-08T14:22:38.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:38 smithi133 ceph-mon[125939]: pgmap v20478: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 436 KiB/s wr, 9 op/s 2023-05-08T14:22:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:38 smithi133 ceph-mon[125939]: osdmap e1357: 12 total, 12 up, 12 in 2023-05-08T14:22:39.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:38 smithi096 ceph-mon[124666]: pgmap v20478: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 436 KiB/s wr, 9 op/s 2023-05-08T14:22:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:38 smithi096 ceph-mon[124666]: osdmap e1357: 12 total, 12 up, 12 in 2023-05-08T14:22:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38298.446923 secs 2023-05-08T14:22:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:39 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:22:39.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38298.446923 secs 2023-05-08T14:22:39.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:39 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:22:40.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38298.446923 secs 2023-05-08T14:22:40.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:39 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:22:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:40 smithi186 ceph-mon[126480]: pgmap v20480: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 501 KiB/s wr, 11 op/s 2023-05-08T14:22:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:40 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:22:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:40 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:22:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:40 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:22:40.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:40 smithi133 ceph-mon[125939]: pgmap v20480: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 501 KiB/s wr, 11 op/s 2023-05-08T14:22:40.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:40 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:22:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:40 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:22:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:40 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:22:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:40 smithi096 ceph-mon[124666]: pgmap v20480: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 501 KiB/s wr, 11 op/s 2023-05-08T14:22:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:40 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:22:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:40 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:22:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:40 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:22:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:41 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:22:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:41 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T14:22:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:41 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T14:22:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:41 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:22:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38300.342091 secs 2023-05-08T14:22:41.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:41 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:22:41.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:41 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T14:22:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:41 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T14:22:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:41 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:22:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38300.342091 secs 2023-05-08T14:22:42.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:41 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:22:42.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:41 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T14:22:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:41 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T14:22:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:41 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:22:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38300.342091 secs 2023-05-08T14:22:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:42 smithi186 ceph-mon[126480]: pgmap v20481: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 403 KiB/s wr, 9 op/s 2023-05-08T14:22:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:42 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:22:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:42 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:22:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:42 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:22:42.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:42 smithi133 ceph-mon[125939]: pgmap v20481: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 403 KiB/s wr, 9 op/s 2023-05-08T14:22:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:42 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:22:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:42 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:22:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:42 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:22:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:42 smithi096 ceph-mon[124666]: pgmap v20481: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 403 KiB/s wr, 9 op/s 2023-05-08T14:22:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:42 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:22:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:42 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:22:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:42 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:22:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:44 smithi186 ceph-mon[126480]: pgmap v20482: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 401 KiB/s wr, 9 op/s 2023-05-08T14:22:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38303.447050 secs 2023-05-08T14:22:44.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:44 smithi133 ceph-mon[125939]: pgmap v20482: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 401 KiB/s wr, 9 op/s 2023-05-08T14:22:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38303.447050 secs 2023-05-08T14:22:44.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:44 smithi096 ceph-mon[124666]: pgmap v20482: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 401 KiB/s wr, 9 op/s 2023-05-08T14:22:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38303.447050 secs 2023-05-08T14:22:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38304.000881 secs 2023-05-08T14:22:45.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38304.000881 secs 2023-05-08T14:22:45.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38304.000881 secs 2023-05-08T14:22:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:46 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:22:46.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:46 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:22:46.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:46 smithi186 ceph-mon[126480]: pgmap v20483: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 925 KiB/s rd, 1006 KiB/s wr, 11 op/s 2023-05-08T14:22:46.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:46 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:22:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:46 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:22:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:46 smithi133 ceph-mon[125939]: pgmap v20483: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 925 KiB/s rd, 1006 KiB/s wr, 11 op/s 2023-05-08T14:22:46.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:46 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:22:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:46 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:22:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:46 smithi096 ceph-mon[124666]: pgmap v20483: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 925 KiB/s rd, 1006 KiB/s wr, 11 op/s 2023-05-08T14:22:48.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:48 smithi186 ceph-mon[126480]: pgmap v20484: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 925 KiB/s rd, 1006 KiB/s wr, 11 op/s 2023-05-08T14:22:48.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:48 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:22:48.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:48 smithi133 ceph-mon[125939]: pgmap v20484: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 925 KiB/s rd, 1006 KiB/s wr, 11 op/s 2023-05-08T14:22:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:48 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:22:49.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:48 smithi096 ceph-mon[124666]: pgmap v20484: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 925 KiB/s rd, 1006 KiB/s wr, 11 op/s 2023-05-08T14:22:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:48 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:22:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38308.447183 secs 2023-05-08T14:22:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:22:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38309.001000 secs 2023-05-08T14:22:49.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38308.447183 secs 2023-05-08T14:22:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:22:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38309.001000 secs 2023-05-08T14:22:50.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38308.447183 secs 2023-05-08T14:22:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:22:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38309.001000 secs 2023-05-08T14:22:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:50 smithi186 ceph-mon[126480]: pgmap v20485: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 15 op/s 2023-05-08T14:22:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:22:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:22:50.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:50 smithi133 ceph-mon[125939]: pgmap v20485: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 15 op/s 2023-05-08T14:22:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:22:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:22:51.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:50 smithi096 ceph-mon[124666]: pgmap v20485: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 15 op/s 2023-05-08T14:22:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:22:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:22:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:52 smithi186 ceph-mon[126480]: pgmap v20486: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 10 op/s 2023-05-08T14:22:52.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:52 smithi133 ceph-mon[125939]: pgmap v20486: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 10 op/s 2023-05-08T14:22:53.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:52 smithi096 ceph-mon[124666]: pgmap v20486: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 10 op/s 2023-05-08T14:22:53.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:53 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:22:53.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:53 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:22:54.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:53 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:22:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:54 smithi186 ceph-mon[126480]: pgmap v20487: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 10 op/s 2023-05-08T14:22:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38313.447321 secs 2023-05-08T14:22:54.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:54 smithi133 ceph-mon[125939]: pgmap v20487: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 10 op/s 2023-05-08T14:22:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38313.447321 secs 2023-05-08T14:22:55.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:54 smithi096 ceph-mon[124666]: pgmap v20487: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 10 op/s 2023-05-08T14:22:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38313.447321 secs 2023-05-08T14:22:56.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:56 smithi186 ceph-mon[126480]: pgmap v20488: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.8 MiB/s wr, 16 op/s 2023-05-08T14:22:56.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:56 smithi133 ceph-mon[125939]: pgmap v20488: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.8 MiB/s wr, 16 op/s 2023-05-08T14:22:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:56 smithi096 ceph-mon[124666]: pgmap v20488: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.8 MiB/s wr, 16 op/s 2023-05-08T14:22:57.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:22:57.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:22:58.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:22:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:58 smithi186 ceph-mon[126480]: pgmap v20489: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1012 KiB/s wr, 10 op/s 2023-05-08T14:22:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:22:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:22:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:58 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:22:58.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:58 smithi133 ceph-mon[125939]: pgmap v20489: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1012 KiB/s wr, 10 op/s 2023-05-08T14:22:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:22:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:22:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:58 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:22:59.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:58 smithi096 ceph-mon[124666]: pgmap v20489: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1012 KiB/s wr, 10 op/s 2023-05-08T14:22:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:22:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:22:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:58 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:22:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38318.447445 secs 2023-05-08T14:22:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:22:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38319.001259 secs 2023-05-08T14:22:59.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38318.447445 secs 2023-05-08T14:22:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:22:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38319.001259 secs 2023-05-08T14:23:00.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38318.447445 secs 2023-05-08T14:23:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:22:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38319.001259 secs 2023-05-08T14:23:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:00 smithi186 ceph-mon[126480]: pgmap v20490: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.7 MiB/s wr, 16 op/s 2023-05-08T14:23:00.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:00 smithi133 ceph-mon[125939]: pgmap v20490: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.7 MiB/s wr, 16 op/s 2023-05-08T14:23:01.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:00 smithi096 ceph-mon[124666]: pgmap v20490: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.7 MiB/s wr, 16 op/s 2023-05-08T14:23:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:02 smithi186 ceph-mon[126480]: pgmap v20491: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.1 MiB/s wr, 12 op/s 2023-05-08T14:23:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:23:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:23:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:02 smithi133 ceph-mon[125939]: pgmap v20491: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.1 MiB/s wr, 12 op/s 2023-05-08T14:23:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:23:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:23:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:02 smithi096 ceph-mon[124666]: pgmap v20491: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.1 MiB/s wr, 12 op/s 2023-05-08T14:23:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:23:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:23:03.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:03 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:23:03.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:03 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:23:04.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:03 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:23:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:04 smithi186 ceph-mon[126480]: pgmap v20492: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.1 MiB/s wr, 11 op/s 2023-05-08T14:23:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38323.447581 secs 2023-05-08T14:23:04.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:04 smithi133 ceph-mon[125939]: pgmap v20492: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.1 MiB/s wr, 11 op/s 2023-05-08T14:23:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38323.447581 secs 2023-05-08T14:23:05.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:04 smithi096 ceph-mon[124666]: pgmap v20492: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.1 MiB/s wr, 11 op/s 2023-05-08T14:23:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38323.447581 secs 2023-05-08T14:23:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:05 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:23:05.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:05 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:23:06.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:05 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:23:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:06 smithi133 ceph-mon[125939]: pgmap v20493: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.5 MiB/s wr, 20 op/s 2023-05-08T14:23:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:23:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:23:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:06 smithi096 ceph-mon[124666]: pgmap v20493: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.5 MiB/s wr, 20 op/s 2023-05-08T14:23:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:23:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:23:07.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:06 smithi186 ceph-mon[126480]: pgmap v20493: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.5 MiB/s wr, 20 op/s 2023-05-08T14:23:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:23:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:23:08.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:08 smithi133 ceph-mon[125939]: pgmap v20494: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 14 op/s 2023-05-08T14:23:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:08 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:23:09.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:08 smithi096 ceph-mon[124666]: pgmap v20494: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 14 op/s 2023-05-08T14:23:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:08 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:23:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:08 smithi186 ceph-mon[126480]: pgmap v20494: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 14 op/s 2023-05-08T14:23:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:08 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:23:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38328.447658 secs 2023-05-08T14:23:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38329.001526 secs 2023-05-08T14:23:10.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38328.447658 secs 2023-05-08T14:23:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38329.001526 secs 2023-05-08T14:23:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38328.447658 secs 2023-05-08T14:23:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38329.001526 secs 2023-05-08T14:23:10.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:10 smithi133 ceph-mon[125939]: pgmap v20495: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.1 MiB/s wr, 33 op/s 2023-05-08T14:23:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:10 smithi096 ceph-mon[124666]: pgmap v20495: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.1 MiB/s wr, 33 op/s 2023-05-08T14:23:11.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:10 smithi186 ceph-mon[126480]: pgmap v20495: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.1 MiB/s wr, 33 op/s 2023-05-08T14:23:11.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38330.342829 secs 2023-05-08T14:23:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:11 smithi133 ceph-mon[125939]: osdmap e1358: 12 total, 12 up, 12 in 2023-05-08T14:23:12.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38330.342829 secs 2023-05-08T14:23:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:11 smithi096 ceph-mon[124666]: osdmap e1358: 12 total, 12 up, 12 in 2023-05-08T14:23:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38330.342829 secs 2023-05-08T14:23:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:11 smithi186 ceph-mon[126480]: osdmap e1358: 12 total, 12 up, 12 in 2023-05-08T14:23:12.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:12 smithi133 ceph-mon[125939]: pgmap v20497: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.6 MiB/s wr, 32 op/s 2023-05-08T14:23:13.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:12 smithi096 ceph-mon[124666]: pgmap v20497: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.6 MiB/s wr, 32 op/s 2023-05-08T14:23:13.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:12 smithi186 ceph-mon[126480]: pgmap v20497: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.6 MiB/s wr, 32 op/s 2023-05-08T14:23:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:14 smithi186 ceph-mon[126480]: pgmap v20498: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.6 MiB/s wr, 32 op/s 2023-05-08T14:23:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:14 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:23:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:14 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:23:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:14 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:23:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:14 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:23:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38333.447780 secs 2023-05-08T14:23:14.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:14 smithi133 ceph-mon[125939]: pgmap v20498: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.6 MiB/s wr, 32 op/s 2023-05-08T14:23:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:14 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:23:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:14 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:23:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:14 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:23:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:14 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:23:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38333.447780 secs 2023-05-08T14:23:14.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:14 smithi096 ceph-mon[124666]: pgmap v20498: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.6 MiB/s wr, 32 op/s 2023-05-08T14:23:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:14 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:23:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:14 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:23:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:14 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:23:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:14 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:23:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38333.447780 secs 2023-05-08T14:23:15.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38334.001613 secs 2023-05-08T14:23:15.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38334.001613 secs 2023-05-08T14:23:15.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38334.001613 secs 2023-05-08T14:23:16.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:16 smithi186 ceph-mon[126480]: pgmap v20499: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.3 MiB/s wr, 28 op/s 2023-05-08T14:23:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38335.342950 secs 2023-05-08T14:23:16.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:16 smithi133 ceph-mon[125939]: pgmap v20499: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.3 MiB/s wr, 28 op/s 2023-05-08T14:23:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38335.342950 secs 2023-05-08T14:23:16.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:16 smithi096 ceph-mon[124666]: pgmap v20499: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.3 MiB/s wr, 28 op/s 2023-05-08T14:23:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38335.342950 secs 2023-05-08T14:23:18.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:18 smithi186 ceph-mon[126480]: pgmap v20500: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.3 MiB/s wr, 28 op/s 2023-05-08T14:23:18.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:18 smithi186 ceph-mon[126480]: osdmap e1359: 12 total, 12 up, 12 in 2023-05-08T14:23:18.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:18 smithi133 ceph-mon[125939]: pgmap v20500: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.3 MiB/s wr, 28 op/s 2023-05-08T14:23:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:18 smithi133 ceph-mon[125939]: osdmap e1359: 12 total, 12 up, 12 in 2023-05-08T14:23:19.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:18 smithi096 ceph-mon[124666]: pgmap v20500: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.3 MiB/s wr, 28 op/s 2023-05-08T14:23:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:18 smithi096 ceph-mon[124666]: osdmap e1359: 12 total, 12 up, 12 in 2023-05-08T14:23:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38338.447909 secs 2023-05-08T14:23:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38339.001739 secs 2023-05-08T14:23:19.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38338.447909 secs 2023-05-08T14:23:19.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38339.001739 secs 2023-05-08T14:23:20.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38338.447909 secs 2023-05-08T14:23:20.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38339.001739 secs 2023-05-08T14:23:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:20 smithi186 ceph-mon[126480]: pgmap v20502: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T14:23:20.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:20 smithi133 ceph-mon[125939]: pgmap v20502: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T14:23:21.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:20 smithi096 ceph-mon[124666]: pgmap v20502: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T14:23:21.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38340.343051 secs 2023-05-08T14:23:21.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38340.343051 secs 2023-05-08T14:23:22.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38340.343051 secs 2023-05-08T14:23:22.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:22 smithi186 ceph-mon[126480]: pgmap v20503: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.0 MiB/s wr, 12 op/s 2023-05-08T14:23:22.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:22 smithi133 ceph-mon[125939]: pgmap v20503: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.0 MiB/s wr, 12 op/s 2023-05-08T14:23:23.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:22 smithi096 ceph-mon[124666]: pgmap v20503: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.0 MiB/s wr, 12 op/s 2023-05-08T14:23:24.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:24 smithi186 ceph-mon[126480]: pgmap v20504: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.0 MiB/s wr, 12 op/s 2023-05-08T14:23:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38343.448015 secs 2023-05-08T14:23:24.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:24 smithi133 ceph-mon[125939]: pgmap v20504: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.0 MiB/s wr, 12 op/s 2023-05-08T14:23:24.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38343.448015 secs 2023-05-08T14:23:24.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:24 smithi096 ceph-mon[124666]: pgmap v20504: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.0 MiB/s wr, 12 op/s 2023-05-08T14:23:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38343.448015 secs 2023-05-08T14:23:25.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38344.001833 secs 2023-05-08T14:23:25.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38344.001833 secs 2023-05-08T14:23:25.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38344.001833 secs 2023-05-08T14:23:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:26 smithi186 ceph-mon[126480]: pgmap v20505: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 950 KiB/s wr, 11 op/s 2023-05-08T14:23:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38345.343132 secs 2023-05-08T14:23:26.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:26 smithi133 ceph-mon[125939]: pgmap v20505: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 950 KiB/s wr, 11 op/s 2023-05-08T14:23:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38345.343132 secs 2023-05-08T14:23:26.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:26 smithi096 ceph-mon[124666]: pgmap v20505: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 950 KiB/s wr, 11 op/s 2023-05-08T14:23:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38345.343132 secs 2023-05-08T14:23:28.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:28 smithi186 ceph-mon[126480]: pgmap v20506: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 950 KiB/s wr, 11 op/s 2023-05-08T14:23:28.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:28 smithi133 ceph-mon[125939]: pgmap v20506: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 950 KiB/s wr, 11 op/s 2023-05-08T14:23:29.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:28 smithi096 ceph-mon[124666]: pgmap v20506: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 950 KiB/s wr, 11 op/s 2023-05-08T14:23:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38348.448155 secs 2023-05-08T14:23:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38349.001972 secs 2023-05-08T14:23:29.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38348.448155 secs 2023-05-08T14:23:29.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38349.001972 secs 2023-05-08T14:23:30.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38348.448155 secs 2023-05-08T14:23:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38349.001972 secs 2023-05-08T14:23:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:30 smithi186 ceph-mon[126480]: pgmap v20507: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2023-05-08T14:23:30.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:30 smithi133 ceph-mon[125939]: pgmap v20507: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2023-05-08T14:23:31.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:30 smithi096 ceph-mon[124666]: pgmap v20507: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2023-05-08T14:23:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38350.343244 secs 2023-05-08T14:23:31.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38350.343244 secs 2023-05-08T14:23:32.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38350.343244 secs 2023-05-08T14:23:32.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:32 smithi186 ceph-mon[126480]: pgmap v20508: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 333 KiB/s wr, 8 op/s 2023-05-08T14:23:32.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:32 smithi133 ceph-mon[125939]: pgmap v20508: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 333 KiB/s wr, 8 op/s 2023-05-08T14:23:33.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:32 smithi096 ceph-mon[124666]: pgmap v20508: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 333 KiB/s wr, 8 op/s 2023-05-08T14:23:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:34 smithi186 ceph-mon[126480]: pgmap v20509: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 332 KiB/s wr, 8 op/s 2023-05-08T14:23:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38353.448282 secs 2023-05-08T14:23:34.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:34 smithi133 ceph-mon[125939]: pgmap v20509: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 332 KiB/s wr, 8 op/s 2023-05-08T14:23:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38353.448282 secs 2023-05-08T14:23:34.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:34 smithi096 ceph-mon[124666]: pgmap v20509: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 332 KiB/s wr, 8 op/s 2023-05-08T14:23:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38353.448282 secs 2023-05-08T14:23:35.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38354.002044 secs 2023-05-08T14:23:35.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38354.002044 secs 2023-05-08T14:23:35.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38354.002044 secs 2023-05-08T14:23:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:36 smithi186 ceph-mon[126480]: pgmap v20510: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 839 KiB/s rd, 671 KiB/s wr, 12 op/s 2023-05-08T14:23:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38355.343384 secs 2023-05-08T14:23:36.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:36 smithi133 ceph-mon[125939]: pgmap v20510: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 839 KiB/s rd, 671 KiB/s wr, 12 op/s 2023-05-08T14:23:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38355.343384 secs 2023-05-08T14:23:36.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:36 smithi096 ceph-mon[124666]: pgmap v20510: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 839 KiB/s rd, 671 KiB/s wr, 12 op/s 2023-05-08T14:23:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38355.343384 secs 2023-05-08T14:23:38.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:38 smithi186 ceph-mon[126480]: pgmap v20511: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 673 KiB/s rd, 671 KiB/s wr, 8 op/s 2023-05-08T14:23:38.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:38 smithi133 ceph-mon[125939]: pgmap v20511: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 673 KiB/s rd, 671 KiB/s wr, 8 op/s 2023-05-08T14:23:39.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:38 smithi096 ceph-mon[124666]: pgmap v20511: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 673 KiB/s rd, 671 KiB/s wr, 8 op/s 2023-05-08T14:23:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38358.448394 secs 2023-05-08T14:23:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38359.002192 secs 2023-05-08T14:23:39.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38358.448394 secs 2023-05-08T14:23:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38359.002192 secs 2023-05-08T14:23:40.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38358.448394 secs 2023-05-08T14:23:40.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38359.002192 secs 2023-05-08T14:23:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:40 smithi186 ceph-mon[126480]: pgmap v20512: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 949 KiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T14:23:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:40 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:23:40.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:40 smithi133 ceph-mon[125939]: pgmap v20512: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 949 KiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T14:23:40.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:40 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:23:41.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:40 smithi096 ceph-mon[124666]: pgmap v20512: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 949 KiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T14:23:41.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:40 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:23:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38360.343475 secs 2023-05-08T14:23:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:23:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:23:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:23:41.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38360.343475 secs 2023-05-08T14:23:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:23:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:23:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:23:42.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38360.343475 secs 2023-05-08T14:23:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:23:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:23:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:23:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:42 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:23:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:42 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T14:23:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:42 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T14:23:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:42 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:23:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:42 smithi186 ceph-mon[126480]: pgmap v20513: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 783 KiB/s wr, 7 op/s 2023-05-08T14:23:42.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:42 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:23:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:42 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T14:23:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:42 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T14:23:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:42 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:23:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:42 smithi133 ceph-mon[125939]: pgmap v20513: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 783 KiB/s wr, 7 op/s 2023-05-08T14:23:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:42 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:23:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:42 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T14:23:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:42 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T14:23:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:42 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:23:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:42 smithi096 ceph-mon[124666]: pgmap v20513: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 783 KiB/s wr, 7 op/s 2023-05-08T14:23:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:44 smithi186 ceph-mon[126480]: pgmap v20514: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 783 KiB/s wr, 7 op/s 2023-05-08T14:23:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38363.448510 secs 2023-05-08T14:23:44.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:44 smithi133 ceph-mon[125939]: pgmap v20514: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 783 KiB/s wr, 7 op/s 2023-05-08T14:23:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38363.448510 secs 2023-05-08T14:23:44.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:44 smithi096 ceph-mon[124666]: pgmap v20514: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 783 KiB/s wr, 7 op/s 2023-05-08T14:23:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38363.448510 secs 2023-05-08T14:23:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38364.002335 secs 2023-05-08T14:23:45.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38364.002335 secs 2023-05-08T14:23:45.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38364.002335 secs 2023-05-08T14:23:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:46 smithi186 ceph-mon[126480]: pgmap v20515: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 787 KiB/s rd, 783 KiB/s wr, 10 op/s 2023-05-08T14:23:46.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:46 smithi133 ceph-mon[125939]: pgmap v20515: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 787 KiB/s rd, 783 KiB/s wr, 10 op/s 2023-05-08T14:23:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:46 smithi096 ceph-mon[124666]: pgmap v20515: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 787 KiB/s rd, 783 KiB/s wr, 10 op/s 2023-05-08T14:23:48.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:48 smithi186 ceph-mon[126480]: pgmap v20516: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 445 KiB/s wr, 6 op/s 2023-05-08T14:23:48.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:48 smithi133 ceph-mon[125939]: pgmap v20516: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 445 KiB/s wr, 6 op/s 2023-05-08T14:23:49.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:48 smithi096 ceph-mon[124666]: pgmap v20516: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 445 KiB/s wr, 6 op/s 2023-05-08T14:23:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38368.448574 secs 2023-05-08T14:23:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:23:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38369.002458 secs 2023-05-08T14:23:49.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38368.448574 secs 2023-05-08T14:23:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:23:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38369.002458 secs 2023-05-08T14:23:50.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38368.448574 secs 2023-05-08T14:23:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:23:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38369.002458 secs 2023-05-08T14:23:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:50 smithi186 ceph-mon[126480]: pgmap v20517: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 819 KiB/s rd, 781 KiB/s wr, 10 op/s 2023-05-08T14:23:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:23:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:23:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:23:50.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:50 smithi133 ceph-mon[125939]: pgmap v20517: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 819 KiB/s rd, 781 KiB/s wr, 10 op/s 2023-05-08T14:23:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:23:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:23:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:23:51.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:50 smithi096 ceph-mon[124666]: pgmap v20517: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 819 KiB/s rd, 781 KiB/s wr, 10 op/s 2023-05-08T14:23:51.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:23:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:23:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:23:52.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:52 smithi186 ceph-mon[126480]: pgmap v20518: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 542 KiB/s rd, 337 KiB/s wr, 7 op/s 2023-05-08T14:23:52.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:52 smithi133 ceph-mon[125939]: pgmap v20518: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 542 KiB/s rd, 337 KiB/s wr, 7 op/s 2023-05-08T14:23:53.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:52 smithi096 ceph-mon[124666]: pgmap v20518: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 542 KiB/s rd, 337 KiB/s wr, 7 op/s 2023-05-08T14:23:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:54 smithi186 ceph-mon[126480]: pgmap v20519: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 542 KiB/s rd, 337 KiB/s wr, 7 op/s 2023-05-08T14:23:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38373.448674 secs 2023-05-08T14:23:54.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:54 smithi133 ceph-mon[125939]: pgmap v20519: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 542 KiB/s rd, 337 KiB/s wr, 7 op/s 2023-05-08T14:23:54.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38373.448674 secs 2023-05-08T14:23:54.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:54 smithi096 ceph-mon[124666]: pgmap v20519: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 542 KiB/s rd, 337 KiB/s wr, 7 op/s 2023-05-08T14:23:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38373.448674 secs 2023-05-08T14:23:55.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38374.002493 secs 2023-05-08T14:23:55.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38374.002493 secs 2023-05-08T14:23:55.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38374.002493 secs 2023-05-08T14:23:56.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:56 smithi186 ceph-mon[126480]: pgmap v20520: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 874 KiB/s wr, 11 op/s 2023-05-08T14:23:56.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:56 smithi133 ceph-mon[125939]: pgmap v20520: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 874 KiB/s wr, 11 op/s 2023-05-08T14:23:56.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:56 smithi096 ceph-mon[124666]: pgmap v20520: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 874 KiB/s wr, 11 op/s 2023-05-08T14:23:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:58 smithi186 ceph-mon[126480]: pgmap v20521: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 909 KiB/s rd, 874 KiB/s wr, 8 op/s 2023-05-08T14:23:58.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:58 smithi133 ceph-mon[125939]: pgmap v20521: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 909 KiB/s rd, 874 KiB/s wr, 8 op/s 2023-05-08T14:23:59.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:58 smithi096 ceph-mon[124666]: pgmap v20521: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 909 KiB/s rd, 874 KiB/s wr, 8 op/s 2023-05-08T14:23:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38378.448780 secs 2023-05-08T14:23:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:23:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38379.002611 secs 2023-05-08T14:23:59.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38378.448780 secs 2023-05-08T14:23:59.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:23:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38379.002611 secs 2023-05-08T14:24:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38378.448780 secs 2023-05-08T14:24:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:23:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38379.002611 secs 2023-05-08T14:24:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:00 smithi186 ceph-mon[126480]: pgmap v20522: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1001 KiB/s rd, 1.8 MiB/s wr, 14 op/s 2023-05-08T14:24:00.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:00 smithi133 ceph-mon[125939]: pgmap v20522: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1001 KiB/s rd, 1.8 MiB/s wr, 14 op/s 2023-05-08T14:24:01.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:00 smithi096 ceph-mon[124666]: pgmap v20522: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1001 KiB/s rd, 1.8 MiB/s wr, 14 op/s 2023-05-08T14:24:01.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38380.343870 secs 2023-05-08T14:24:01.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38380.343870 secs 2023-05-08T14:24:02.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38380.343870 secs 2023-05-08T14:24:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:02 smithi186 ceph-mon[126480]: pgmap v20523: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 629 KiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T14:24:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:02 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:24:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:24:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:24:02.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:02 smithi133 ceph-mon[125939]: pgmap v20523: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 629 KiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T14:24:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:02 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:24:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:24:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:24:03.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:02 smithi096 ceph-mon[124666]: pgmap v20523: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 629 KiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T14:24:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:02 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:24:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:24:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:24:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:04 smithi186 ceph-mon[126480]: pgmap v20524: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 629 KiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T14:24:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38383.448932 secs 2023-05-08T14:24:04.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:04 smithi133 ceph-mon[125939]: pgmap v20524: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 629 KiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T14:24:04.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38383.448932 secs 2023-05-08T14:24:04.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:04 smithi096 ceph-mon[124666]: pgmap v20524: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 629 KiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T14:24:04.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38383.448932 secs 2023-05-08T14:24:05.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38384.002629 secs 2023-05-08T14:24:05.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38384.002629 secs 2023-05-08T14:24:05.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38384.002629 secs 2023-05-08T14:24:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:06 smithi186 ceph-mon[126480]: pgmap v20525: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 18 op/s 2023-05-08T14:24:06.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:06 smithi133 ceph-mon[125939]: pgmap v20525: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 18 op/s 2023-05-08T14:24:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:06 smithi096 ceph-mon[124666]: pgmap v20525: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 18 op/s 2023-05-08T14:24:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:08 smithi186 ceph-mon[126480]: pgmap v20526: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T14:24:08.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:08 smithi133 ceph-mon[125939]: pgmap v20526: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T14:24:09.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:08 smithi096 ceph-mon[124666]: pgmap v20526: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T14:24:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38388.449054 secs 2023-05-08T14:24:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:09 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:24:09.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38388.449054 secs 2023-05-08T14:24:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:09 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:24:10.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38388.449054 secs 2023-05-08T14:24:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:09 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:24:10.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:10 smithi186 ceph-mon[126480]: pgmap v20527: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 29 op/s 2023-05-08T14:24:10.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:10 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:24:10.873 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:10 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:24:10.873 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:10 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:24:10.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:10 smithi133 ceph-mon[125939]: pgmap v20527: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 29 op/s 2023-05-08T14:24:10.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:10 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:24:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:10 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:24:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:10 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:24:11.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:10 smithi096 ceph-mon[124666]: pgmap v20527: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 29 op/s 2023-05-08T14:24:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:10 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:24:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:10 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:24:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:10 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:24:12.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:12 smithi186 ceph-mon[126480]: pgmap v20528: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 828 KiB/s wr, 23 op/s 2023-05-08T14:24:12.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:12 smithi133 ceph-mon[125939]: pgmap v20528: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 828 KiB/s wr, 23 op/s 2023-05-08T14:24:13.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:12 smithi096 ceph-mon[124666]: pgmap v20528: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 828 KiB/s wr, 23 op/s 2023-05-08T14:24:13.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:13 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:24:13.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:13 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:24:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:13 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:24:14.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:14 smithi133 ceph-mon[125939]: pgmap v20529: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 828 KiB/s wr, 23 op/s 2023-05-08T14:24:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:14 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:24:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:14 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:24:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38393.449196 secs 2023-05-08T14:24:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:14 smithi096 ceph-mon[124666]: pgmap v20529: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 828 KiB/s wr, 23 op/s 2023-05-08T14:24:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:14 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:24:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:14 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:24:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38393.449196 secs 2023-05-08T14:24:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:14 smithi186 ceph-mon[126480]: pgmap v20529: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 828 KiB/s wr, 23 op/s 2023-05-08T14:24:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:14 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:24:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:14 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:24:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38393.449196 secs 2023-05-08T14:24:16.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:16 smithi133 ceph-mon[125939]: pgmap v20530: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 992 KiB/s wr, 27 op/s 2023-05-08T14:24:17.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:16 smithi096 ceph-mon[124666]: pgmap v20530: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 992 KiB/s wr, 27 op/s 2023-05-08T14:24:17.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:16 smithi186 ceph-mon[126480]: pgmap v20530: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 992 KiB/s wr, 27 op/s 2023-05-08T14:24:18.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:18 smithi133 ceph-mon[125939]: pgmap v20531: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 782 KiB/s rd, 795 KiB/s wr, 20 op/s 2023-05-08T14:24:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:18 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:24:19.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:18 smithi096 ceph-mon[124666]: pgmap v20531: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 782 KiB/s rd, 795 KiB/s wr, 20 op/s 2023-05-08T14:24:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:18 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:24:19.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:18 smithi186 ceph-mon[126480]: pgmap v20531: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 782 KiB/s rd, 795 KiB/s wr, 20 op/s 2023-05-08T14:24:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:18 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:24:19.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38398.449360 secs 2023-05-08T14:24:20.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38398.449360 secs 2023-05-08T14:24:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38398.449360 secs 2023-05-08T14:24:20.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:20 smithi133 ceph-mon[125939]: pgmap v20532: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 24 op/s 2023-05-08T14:24:21.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:20 smithi096 ceph-mon[124666]: pgmap v20532: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 24 op/s 2023-05-08T14:24:21.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:20 smithi186 ceph-mon[126480]: pgmap v20532: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 24 op/s 2023-05-08T14:24:22.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:22 smithi133 ceph-mon[125939]: pgmap v20533: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 615 KiB/s rd, 429 KiB/s wr, 8 op/s 2023-05-08T14:24:23.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:22 smithi096 ceph-mon[124666]: pgmap v20533: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 615 KiB/s rd, 429 KiB/s wr, 8 op/s 2023-05-08T14:24:23.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:22 smithi186 ceph-mon[126480]: pgmap v20533: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 615 KiB/s rd, 429 KiB/s wr, 8 op/s 2023-05-08T14:24:24.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:24 smithi186 ceph-mon[126480]: pgmap v20534: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 615 KiB/s rd, 429 KiB/s wr, 8 op/s 2023-05-08T14:24:24.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38403.449421 secs 2023-05-08T14:24:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:24 smithi133 ceph-mon[125939]: pgmap v20534: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 615 KiB/s rd, 429 KiB/s wr, 8 op/s 2023-05-08T14:24:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38403.449421 secs 2023-05-08T14:24:24.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:24 smithi096 ceph-mon[124666]: pgmap v20534: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 615 KiB/s rd, 429 KiB/s wr, 8 op/s 2023-05-08T14:24:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38403.449421 secs 2023-05-08T14:24:25.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38404.003092 secs 2023-05-08T14:24:25.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38404.003092 secs 2023-05-08T14:24:25.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38404.003092 secs 2023-05-08T14:24:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:26 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:24:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:26 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:24:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:26 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:24:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:26 smithi186 ceph-mon[126480]: pgmap v20535: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 15 op/s 2023-05-08T14:24:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38405.344527 secs 2023-05-08T14:24:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:26 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:24:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:26 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:24:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:26 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:24:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:26 smithi133 ceph-mon[125939]: pgmap v20535: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 15 op/s 2023-05-08T14:24:26.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38405.344527 secs 2023-05-08T14:24:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:26 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:24:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:26 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:24:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:26 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:24:26.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:26 smithi096 ceph-mon[124666]: pgmap v20535: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 15 op/s 2023-05-08T14:24:26.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38405.344527 secs 2023-05-08T14:24:27.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:27 smithi186 ceph-mon[126480]: osdmap e1360: 12 total, 12 up, 12 in 2023-05-08T14:24:27.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:27 smithi133 ceph-mon[125939]: osdmap e1360: 12 total, 12 up, 12 in 2023-05-08T14:24:27.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:27 smithi096 ceph-mon[124666]: osdmap e1360: 12 total, 12 up, 12 in 2023-05-08T14:24:28.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:28 smithi186 ceph-mon[126480]: pgmap v20537: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2023-05-08T14:24:28.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:28 smithi133 ceph-mon[125939]: pgmap v20537: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2023-05-08T14:24:28.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:28 smithi096 ceph-mon[124666]: pgmap v20537: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2023-05-08T14:24:29.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38408.449540 secs 2023-05-08T14:24:29.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38408.449540 secs 2023-05-08T14:24:29.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38408.449540 secs 2023-05-08T14:24:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38409.003211 secs 2023-05-08T14:24:30.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:30 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:24:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:30 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:24:30.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:30 smithi186 ceph-mon[126480]: pgmap v20538: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 15 op/s 2023-05-08T14:24:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38409.003211 secs 2023-05-08T14:24:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:30 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:24:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:30 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:24:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:30 smithi133 ceph-mon[125939]: pgmap v20538: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 15 op/s 2023-05-08T14:24:30.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38409.003211 secs 2023-05-08T14:24:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:30 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:24:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:30 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:24:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:30 smithi096 ceph-mon[124666]: pgmap v20538: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 15 op/s 2023-05-08T14:24:31.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38410.344644 secs 2023-05-08T14:24:31.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38410.344644 secs 2023-05-08T14:24:31.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38410.344644 secs 2023-05-08T14:24:32.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:32 smithi186 ceph-mon[126480]: pgmap v20539: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 15 op/s 2023-05-08T14:24:32.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:32 smithi133 ceph-mon[125939]: pgmap v20539: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 15 op/s 2023-05-08T14:24:32.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:32 smithi096 ceph-mon[124666]: pgmap v20539: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 15 op/s 2023-05-08T14:24:33.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:33 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:24:33.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:33 smithi186 ceph-mon[126480]: osdmap e1361: 12 total, 12 up, 12 in 2023-05-08T14:24:33.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:33 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:24:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:33 smithi133 ceph-mon[125939]: osdmap e1361: 12 total, 12 up, 12 in 2023-05-08T14:24:33.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:33 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:24:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:33 smithi096 ceph-mon[124666]: osdmap e1361: 12 total, 12 up, 12 in 2023-05-08T14:24:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:34 smithi186 ceph-mon[126480]: pgmap v20541: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 248 KiB/s wr, 7 op/s 2023-05-08T14:24:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38413.449696 secs 2023-05-08T14:24:34.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:34 smithi133 ceph-mon[125939]: pgmap v20541: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 248 KiB/s wr, 7 op/s 2023-05-08T14:24:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38413.449696 secs 2023-05-08T14:24:34.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:34 smithi096 ceph-mon[124666]: pgmap v20541: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 248 KiB/s wr, 7 op/s 2023-05-08T14:24:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38413.449696 secs 2023-05-08T14:24:35.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38414.003299 secs 2023-05-08T14:24:35.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38414.003299 secs 2023-05-08T14:24:35.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38414.003299 secs 2023-05-08T14:24:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:36 smithi186 ceph-mon[126480]: pgmap v20542: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 13 op/s 2023-05-08T14:24:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38415.344761 secs 2023-05-08T14:24:36.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:36 smithi133 ceph-mon[125939]: pgmap v20542: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 13 op/s 2023-05-08T14:24:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38415.344761 secs 2023-05-08T14:24:36.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:36 smithi096 ceph-mon[124666]: pgmap v20542: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 13 op/s 2023-05-08T14:24:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38415.344761 secs 2023-05-08T14:24:38.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:38 smithi186 ceph-mon[126480]: pgmap v20543: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T14:24:38.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:38 smithi133 ceph-mon[125939]: pgmap v20543: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T14:24:39.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:38 smithi096 ceph-mon[124666]: pgmap v20543: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T14:24:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38418.449833 secs 2023-05-08T14:24:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38419.003422 secs 2023-05-08T14:24:39.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38418.449833 secs 2023-05-08T14:24:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38419.003422 secs 2023-05-08T14:24:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38418.449833 secs 2023-05-08T14:24:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38419.003422 secs 2023-05-08T14:24:40.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:40 smithi133 ceph-mon[125939]: pgmap v20544: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 10 op/s 2023-05-08T14:24:41.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:40 smithi096 ceph-mon[124666]: pgmap v20544: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 10 op/s 2023-05-08T14:24:41.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:40 smithi186 ceph-mon[126480]: pgmap v20544: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 10 op/s 2023-05-08T14:24:41.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38420.344892 secs 2023-05-08T14:24:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:24:42.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38420.344892 secs 2023-05-08T14:24:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:24:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38420.344892 secs 2023-05-08T14:24:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:24:42.925 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:42 smithi096 ceph-mon[124666]: pgmap v20545: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 10 op/s 2023-05-08T14:24:42.977 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:42 smithi133 ceph-mon[125939]: pgmap v20545: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 10 op/s 2023-05-08T14:24:43.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:42 smithi186 ceph-mon[126480]: pgmap v20545: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 10 op/s 2023-05-08T14:24:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:44 smithi133 ceph-mon[125939]: pgmap v20546: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 10 op/s 2023-05-08T14:24:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38423.449946 secs 2023-05-08T14:24:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:44 smithi186 ceph-mon[126480]: pgmap v20546: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 10 op/s 2023-05-08T14:24:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38423.449946 secs 2023-05-08T14:24:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:44 smithi096 ceph-mon[124666]: pgmap v20546: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 10 op/s 2023-05-08T14:24:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38423.449946 secs 2023-05-08T14:24:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38424.003574 secs 2023-05-08T14:24:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:24:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:24:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:24:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:24:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:24:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:24:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:45 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:24:45.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:24:45.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:45 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T14:24:45.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:45 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T14:24:45.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:45 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:24:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38424.003574 secs 2023-05-08T14:24:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:24:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:24:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:24:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:24:45.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:24:45.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:24:45.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:45 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:24:45.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:24:45.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:45 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T14:24:45.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:45 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T14:24:45.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:45 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:24:45.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38424.003574 secs 2023-05-08T14:24:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:24:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:24:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:24:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:24:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:24:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:24:45.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:45 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:24:45.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:24:45.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:45 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T14:24:45.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:45 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T14:24:45.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:45 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:24:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:46 smithi186 ceph-mon[126480]: pgmap v20547: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T14:24:46.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:46 smithi133 ceph-mon[125939]: pgmap v20547: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T14:24:46.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:46 smithi096 ceph-mon[124666]: pgmap v20547: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T14:24:48.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:48 smithi186 ceph-mon[126480]: pgmap v20548: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 340 KiB/s wr, 6 op/s 2023-05-08T14:24:48.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:48 smithi133 ceph-mon[125939]: pgmap v20548: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 340 KiB/s wr, 6 op/s 2023-05-08T14:24:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:48 smithi096 ceph-mon[124666]: pgmap v20548: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 340 KiB/s wr, 6 op/s 2023-05-08T14:24:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38428.450088 secs 2023-05-08T14:24:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:24:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38429.003668 secs 2023-05-08T14:24:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38428.450088 secs 2023-05-08T14:24:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:24:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38429.003668 secs 2023-05-08T14:24:50.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38428.450088 secs 2023-05-08T14:24:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:24:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38429.003668 secs 2023-05-08T14:24:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:50 smithi186 ceph-mon[126480]: pgmap v20549: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 682 KiB/s rd, 679 KiB/s wr, 9 op/s 2023-05-08T14:24:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:24:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:24:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:24:50.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:50 smithi133 ceph-mon[125939]: pgmap v20549: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 682 KiB/s rd, 679 KiB/s wr, 9 op/s 2023-05-08T14:24:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:24:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:24:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:24:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:50 smithi096 ceph-mon[124666]: pgmap v20549: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 682 KiB/s rd, 679 KiB/s wr, 9 op/s 2023-05-08T14:24:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:24:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:24:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:24:52.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:52 smithi133 ceph-mon[125939]: pgmap v20550: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 339 KiB/s wr, 6 op/s 2023-05-08T14:24:53.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:52 smithi096 ceph-mon[124666]: pgmap v20550: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 339 KiB/s wr, 6 op/s 2023-05-08T14:24:53.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:52 smithi186 ceph-mon[126480]: pgmap v20550: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 339 KiB/s wr, 6 op/s 2023-05-08T14:24:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:54 smithi186 ceph-mon[126480]: pgmap v20551: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 339 KiB/s wr, 6 op/s 2023-05-08T14:24:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38433.450219 secs 2023-05-08T14:24:54.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:54 smithi133 ceph-mon[125939]: pgmap v20551: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 339 KiB/s wr, 6 op/s 2023-05-08T14:24:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38433.450219 secs 2023-05-08T14:24:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:54 smithi096 ceph-mon[124666]: pgmap v20551: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 339 KiB/s wr, 6 op/s 2023-05-08T14:24:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38433.450219 secs 2023-05-08T14:24:56.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:56 smithi186 ceph-mon[126480]: pgmap v20552: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 730 KiB/s rd, 711 KiB/s wr, 10 op/s 2023-05-08T14:24:56.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:56 smithi133 ceph-mon[125939]: pgmap v20552: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 730 KiB/s rd, 711 KiB/s wr, 10 op/s 2023-05-08T14:24:57.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:56 smithi096 ceph-mon[124666]: pgmap v20552: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 730 KiB/s rd, 711 KiB/s wr, 10 op/s 2023-05-08T14:24:57.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:24:57.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:24:58.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:24:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:58 smithi186 ceph-mon[126480]: pgmap v20553: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 729 KiB/s rd, 710 KiB/s wr, 7 op/s 2023-05-08T14:24:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:58 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:24:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:24:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:24:58.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:58 smithi133 ceph-mon[125939]: pgmap v20553: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 729 KiB/s rd, 710 KiB/s wr, 7 op/s 2023-05-08T14:24:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:58 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:24:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:24:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:24:59.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:58 smithi096 ceph-mon[124666]: pgmap v20553: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 729 KiB/s rd, 710 KiB/s wr, 7 op/s 2023-05-08T14:24:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:58 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:24:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:24:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:24:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:24:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38438.450331 secs 2023-05-08T14:24:59.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:24:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38438.450331 secs 2023-05-08T14:25:00.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:24:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38438.450331 secs 2023-05-08T14:25:00.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:00 smithi133 ceph-mon[125939]: pgmap v20554: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2023-05-08T14:25:01.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:00 smithi096 ceph-mon[124666]: pgmap v20554: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2023-05-08T14:25:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:00 smithi186 ceph-mon[126480]: pgmap v20554: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2023-05-08T14:25:02.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:02 smithi133 ceph-mon[125939]: pgmap v20555: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T14:25:03.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:02 smithi096 ceph-mon[124666]: pgmap v20555: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T14:25:03.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:02 smithi186 ceph-mon[126480]: pgmap v20555: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T14:25:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:04 smithi186 ceph-mon[126480]: pgmap v20556: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T14:25:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38443.450437 secs 2023-05-08T14:25:04.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:04 smithi133 ceph-mon[125939]: pgmap v20556: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T14:25:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38443.450437 secs 2023-05-08T14:25:04.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:04 smithi096 ceph-mon[124666]: pgmap v20556: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T14:25:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38443.450437 secs 2023-05-08T14:25:05.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38444.003899 secs 2023-05-08T14:25:05.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38444.003899 secs 2023-05-08T14:25:05.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38444.003899 secs 2023-05-08T14:25:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:06 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:25:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:25:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:25:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:06 smithi186 ceph-mon[126480]: pgmap v20557: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.8 MiB/s wr, 30 op/s 2023-05-08T14:25:06.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:06 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:25:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:25:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:25:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:06 smithi133 ceph-mon[125939]: pgmap v20557: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.8 MiB/s wr, 30 op/s 2023-05-08T14:25:06.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:06 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:25:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:25:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:25:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:06 smithi096 ceph-mon[124666]: pgmap v20557: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.8 MiB/s wr, 30 op/s 2023-05-08T14:25:08.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:08 smithi186 ceph-mon[126480]: pgmap v20558: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.4 MiB/s wr, 26 op/s 2023-05-08T14:25:08.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:08 smithi133 ceph-mon[125939]: pgmap v20558: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.4 MiB/s wr, 26 op/s 2023-05-08T14:25:09.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:08 smithi096 ceph-mon[124666]: pgmap v20558: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.4 MiB/s wr, 26 op/s 2023-05-08T14:25:09.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38448.450561 secs 2023-05-08T14:25:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38448.450561 secs 2023-05-08T14:25:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38448.450561 secs 2023-05-08T14:25:10.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:10 smithi133 ceph-mon[125939]: pgmap v20559: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.5 MiB/s wr, 30 op/s 2023-05-08T14:25:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:10 smithi096 ceph-mon[124666]: pgmap v20559: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.5 MiB/s wr, 30 op/s 2023-05-08T14:25:11.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:10 smithi186 ceph-mon[126480]: pgmap v20559: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.5 MiB/s wr, 30 op/s 2023-05-08T14:25:11.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:11 smithi133 ceph-mon[125939]: osdmap e1362: 12 total, 12 up, 12 in 2023-05-08T14:25:12.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:11 smithi096 ceph-mon[124666]: osdmap e1362: 12 total, 12 up, 12 in 2023-05-08T14:25:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:11 smithi186 ceph-mon[126480]: osdmap e1362: 12 total, 12 up, 12 in 2023-05-08T14:25:12.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:12 smithi133 ceph-mon[125939]: pgmap v20561: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 916 KiB/s rd, 872 KiB/s wr, 29 op/s 2023-05-08T14:25:13.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:12 smithi096 ceph-mon[124666]: pgmap v20561: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 916 KiB/s rd, 872 KiB/s wr, 29 op/s 2023-05-08T14:25:13.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:12 smithi186 ceph-mon[126480]: pgmap v20561: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 916 KiB/s rd, 872 KiB/s wr, 29 op/s 2023-05-08T14:25:13.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:13 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:25:14.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:13 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:25:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:13 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:25:14.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:14 smithi133 ceph-mon[125939]: pgmap v20562: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 916 KiB/s rd, 872 KiB/s wr, 29 op/s 2023-05-08T14:25:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:14 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:25:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:14 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:25:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:14 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:25:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38453.450680 secs 2023-05-08T14:25:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:14 smithi096 ceph-mon[124666]: pgmap v20562: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 916 KiB/s rd, 872 KiB/s wr, 29 op/s 2023-05-08T14:25:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:14 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:25:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:14 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:25:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:14 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:25:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38453.450680 secs 2023-05-08T14:25:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:14 smithi186 ceph-mon[126480]: pgmap v20562: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 916 KiB/s rd, 872 KiB/s wr, 29 op/s 2023-05-08T14:25:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:14 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:25:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:14 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:25:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:14 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:25:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38453.450680 secs 2023-05-08T14:25:16.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:16 smithi133 ceph-mon[125939]: pgmap v20563: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 997 KiB/s rd, 882 KiB/s wr, 10 op/s 2023-05-08T14:25:17.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:16 smithi096 ceph-mon[124666]: pgmap v20563: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 997 KiB/s rd, 882 KiB/s wr, 10 op/s 2023-05-08T14:25:17.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:16 smithi186 ceph-mon[126480]: pgmap v20563: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 997 KiB/s rd, 882 KiB/s wr, 10 op/s 2023-05-08T14:25:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:18 smithi133 ceph-mon[125939]: pgmap v20564: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 997 KiB/s rd, 882 KiB/s wr, 10 op/s 2023-05-08T14:25:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:18 smithi133 ceph-mon[125939]: osdmap e1363: 12 total, 12 up, 12 in 2023-05-08T14:25:19.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:18 smithi096 ceph-mon[124666]: pgmap v20564: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 997 KiB/s rd, 882 KiB/s wr, 10 op/s 2023-05-08T14:25:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:18 smithi096 ceph-mon[124666]: osdmap e1363: 12 total, 12 up, 12 in 2023-05-08T14:25:19.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:18 smithi186 ceph-mon[126480]: pgmap v20564: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 997 KiB/s rd, 882 KiB/s wr, 10 op/s 2023-05-08T14:25:19.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:18 smithi186 ceph-mon[126480]: osdmap e1363: 12 total, 12 up, 12 in 2023-05-08T14:25:19.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38458.450798 secs 2023-05-08T14:25:20.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38458.450798 secs 2023-05-08T14:25:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38458.450798 secs 2023-05-08T14:25:20.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:20 smithi133 ceph-mon[125939]: pgmap v20566: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 947 KiB/s rd, 950 KiB/s wr, 10 op/s 2023-05-08T14:25:21.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:20 smithi096 ceph-mon[124666]: pgmap v20566: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 947 KiB/s rd, 950 KiB/s wr, 10 op/s 2023-05-08T14:25:21.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:20 smithi186 ceph-mon[126480]: pgmap v20566: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 947 KiB/s rd, 950 KiB/s wr, 10 op/s 2023-05-08T14:25:22.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:22 smithi133 ceph-mon[125939]: pgmap v20567: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 846 KiB/s rd, 849 KiB/s wr, 9 op/s 2023-05-08T14:25:23.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:22 smithi096 ceph-mon[124666]: pgmap v20567: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 846 KiB/s rd, 849 KiB/s wr, 9 op/s 2023-05-08T14:25:23.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:22 smithi186 ceph-mon[126480]: pgmap v20567: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 846 KiB/s rd, 849 KiB/s wr, 9 op/s 2023-05-08T14:25:24.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:24 smithi186 ceph-mon[126480]: pgmap v20568: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 846 KiB/s rd, 849 KiB/s wr, 9 op/s 2023-05-08T14:25:24.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38463.450903 secs 2023-05-08T14:25:24.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:24 smithi133 ceph-mon[125939]: pgmap v20568: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 846 KiB/s rd, 849 KiB/s wr, 9 op/s 2023-05-08T14:25:24.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38463.450903 secs 2023-05-08T14:25:24.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:24 smithi096 ceph-mon[124666]: pgmap v20568: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 846 KiB/s rd, 849 KiB/s wr, 9 op/s 2023-05-08T14:25:24.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38463.450903 secs 2023-05-08T14:25:25.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38464.004357 secs 2023-05-08T14:25:25.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38464.004357 secs 2023-05-08T14:25:25.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38464.004357 secs 2023-05-08T14:25:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:26 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:25:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:26 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:25:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:26 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:25:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:26 smithi186 ceph-mon[126480]: pgmap v20569: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 520 KiB/s wr, 9 op/s 2023-05-08T14:25:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38465.345963 secs 2023-05-08T14:25:26.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:26 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:25:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:26 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:25:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:26 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:25:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:26 smithi133 ceph-mon[125939]: pgmap v20569: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 520 KiB/s wr, 9 op/s 2023-05-08T14:25:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38465.345963 secs 2023-05-08T14:25:26.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:26 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:25:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:26 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:25:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:26 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:25:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:26 smithi096 ceph-mon[124666]: pgmap v20569: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 520 KiB/s wr, 9 op/s 2023-05-08T14:25:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38465.345963 secs 2023-05-08T14:25:28.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:28 smithi133 ceph-mon[125939]: pgmap v20570: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 520 KiB/s wr, 9 op/s 2023-05-08T14:25:29.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:28 smithi096 ceph-mon[124666]: pgmap v20570: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 520 KiB/s wr, 9 op/s 2023-05-08T14:25:29.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:28 smithi186 ceph-mon[126480]: pgmap v20570: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 520 KiB/s wr, 9 op/s 2023-05-08T14:25:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38468.450972 secs 2023-05-08T14:25:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38469.004488 secs 2023-05-08T14:25:30.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38468.450972 secs 2023-05-08T14:25:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38469.004488 secs 2023-05-08T14:25:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38468.450972 secs 2023-05-08T14:25:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38469.004488 secs 2023-05-08T14:25:30.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:30 smithi133 ceph-mon[125939]: pgmap v20571: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 798 KiB/s rd, 795 KiB/s wr, 12 op/s 2023-05-08T14:25:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:30 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:25:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:30 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:25:31.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:30 smithi096 ceph-mon[124666]: pgmap v20571: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 798 KiB/s rd, 795 KiB/s wr, 12 op/s 2023-05-08T14:25:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:30 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:25:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:30 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:25:31.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:30 smithi186 ceph-mon[126480]: pgmap v20571: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 798 KiB/s rd, 795 KiB/s wr, 12 op/s 2023-05-08T14:25:31.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:30 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:25:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:30 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:25:31.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38470.346087 secs 2023-05-08T14:25:32.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38470.346087 secs 2023-05-08T14:25:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38470.346087 secs 2023-05-08T14:25:32.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:32 smithi133 ceph-mon[125939]: pgmap v20572: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 779 KiB/s rd, 750 KiB/s wr, 9 op/s 2023-05-08T14:25:33.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:32 smithi096 ceph-mon[124666]: pgmap v20572: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 779 KiB/s rd, 750 KiB/s wr, 9 op/s 2023-05-08T14:25:33.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:32 smithi186 ceph-mon[126480]: pgmap v20572: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 779 KiB/s rd, 750 KiB/s wr, 9 op/s 2023-05-08T14:25:33.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:33 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:25:34.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:33 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:25:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:33 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:25:34.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:34 smithi133 ceph-mon[125939]: pgmap v20573: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 779 KiB/s rd, 750 KiB/s wr, 8 op/s 2023-05-08T14:25:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38473.451086 secs 2023-05-08T14:25:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38474.004599 secs 2023-05-08T14:25:35.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:34 smithi096 ceph-mon[124666]: pgmap v20573: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 779 KiB/s rd, 750 KiB/s wr, 8 op/s 2023-05-08T14:25:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38473.451086 secs 2023-05-08T14:25:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38474.004599 secs 2023-05-08T14:25:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:34 smithi186 ceph-mon[126480]: pgmap v20573: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 779 KiB/s rd, 750 KiB/s wr, 8 op/s 2023-05-08T14:25:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38473.451086 secs 2023-05-08T14:25:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38474.004599 secs 2023-05-08T14:25:36.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:36 smithi133 ceph-mon[125939]: pgmap v20574: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T14:25:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38475.346211 secs 2023-05-08T14:25:37.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:36 smithi096 ceph-mon[124666]: pgmap v20574: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T14:25:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38475.346211 secs 2023-05-08T14:25:37.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:36 smithi186 ceph-mon[126480]: pgmap v20574: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T14:25:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38475.346211 secs 2023-05-08T14:25:38.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:38 smithi133 ceph-mon[125939]: pgmap v20575: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 763 KiB/s rd, 735 KiB/s wr, 8 op/s 2023-05-08T14:25:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:38 smithi096 ceph-mon[124666]: pgmap v20575: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 763 KiB/s rd, 735 KiB/s wr, 8 op/s 2023-05-08T14:25:39.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:38 smithi186 ceph-mon[126480]: pgmap v20575: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 763 KiB/s rd, 735 KiB/s wr, 8 op/s 2023-05-08T14:25:39.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38478.451207 secs 2023-05-08T14:25:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38479.004717 secs 2023-05-08T14:25:40.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38478.451207 secs 2023-05-08T14:25:40.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38479.004717 secs 2023-05-08T14:25:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38478.451207 secs 2023-05-08T14:25:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38479.004717 secs 2023-05-08T14:25:40.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:40 smithi133 ceph-mon[125939]: pgmap v20576: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T14:25:41.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:40 smithi096 ceph-mon[124666]: pgmap v20576: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T14:25:41.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:40 smithi186 ceph-mon[126480]: pgmap v20576: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T14:25:41.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38480.346334 secs 2023-05-08T14:25:42.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38480.346334 secs 2023-05-08T14:25:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38480.346334 secs 2023-05-08T14:25:42.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:42 smithi133 ceph-mon[125939]: pgmap v20577: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 764 KiB/s rd, 762 KiB/s wr, 7 op/s 2023-05-08T14:25:43.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:42 smithi096 ceph-mon[124666]: pgmap v20577: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 764 KiB/s rd, 762 KiB/s wr, 7 op/s 2023-05-08T14:25:43.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:42 smithi186 ceph-mon[126480]: pgmap v20577: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 764 KiB/s rd, 762 KiB/s wr, 7 op/s 2023-05-08T14:25:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:44 smithi186 ceph-mon[126480]: pgmap v20578: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 733 KiB/s rd, 731 KiB/s wr, 7 op/s 2023-05-08T14:25:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38483.451366 secs 2023-05-08T14:25:44.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:44 smithi133 ceph-mon[125939]: pgmap v20578: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 733 KiB/s rd, 731 KiB/s wr, 7 op/s 2023-05-08T14:25:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38483.451366 secs 2023-05-08T14:25:44.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:44 smithi096 ceph-mon[124666]: pgmap v20578: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 733 KiB/s rd, 731 KiB/s wr, 7 op/s 2023-05-08T14:25:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38483.451366 secs 2023-05-08T14:25:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38484.004832 secs 2023-05-08T14:25:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:25:45.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38484.004832 secs 2023-05-08T14:25:45.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:25:45.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38484.004832 secs 2023-05-08T14:25:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:25:46.602 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:46 smithi186 ceph-mon[126480]: pgmap v20579: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 734 KiB/s rd, 731 KiB/s wr, 10 op/s 2023-05-08T14:25:46.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:46 smithi133 ceph-mon[125939]: pgmap v20579: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 734 KiB/s rd, 731 KiB/s wr, 10 op/s 2023-05-08T14:25:46.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:46 smithi096 ceph-mon[124666]: pgmap v20579: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 734 KiB/s rd, 731 KiB/s wr, 10 op/s 2023-05-08T14:25:48.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:48 smithi133 ceph-mon[125939]: pgmap v20580: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 341 KiB/s wr, 6 op/s 2023-05-08T14:25:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:48 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:25:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:48 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:25:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:48 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:25:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:48 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:25:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:48 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:25:49.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:48 smithi096 ceph-mon[124666]: pgmap v20580: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 341 KiB/s wr, 6 op/s 2023-05-08T14:25:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:48 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:25:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:48 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:25:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:48 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:25:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:48 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:25:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:48 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:25:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:48 smithi186 ceph-mon[126480]: pgmap v20580: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 341 KiB/s wr, 6 op/s 2023-05-08T14:25:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:48 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:25:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:48 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:25:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:48 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:25:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:48 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:25:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:48 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:25:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:49 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:25:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:49 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T14:25:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:49 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T14:25:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:49 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:25:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38488.451485 secs 2023-05-08T14:25:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:25:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38489.004919 secs 2023-05-08T14:25:50.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:49 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:25:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:49 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T14:25:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:49 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T14:25:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:49 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:25:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38488.451485 secs 2023-05-08T14:25:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:25:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38489.004919 secs 2023-05-08T14:25:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:49 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:25:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:49 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T14:25:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:49 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T14:25:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:49 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:25:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38488.451485 secs 2023-05-08T14:25:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:25:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38489.004919 secs 2023-05-08T14:25:50.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:50 smithi133 ceph-mon[125939]: pgmap v20581: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 804 KiB/s rd, 681 KiB/s wr, 10 op/s 2023-05-08T14:25:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:25:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:25:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:25:51.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:50 smithi096 ceph-mon[124666]: pgmap v20581: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 804 KiB/s rd, 681 KiB/s wr, 10 op/s 2023-05-08T14:25:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:25:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:25:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:25:51.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:50 smithi186 ceph-mon[126480]: pgmap v20581: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 804 KiB/s rd, 681 KiB/s wr, 10 op/s 2023-05-08T14:25:51.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:25:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:25:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:25:52.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:52 smithi133 ceph-mon[125939]: pgmap v20582: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 340 KiB/s wr, 6 op/s 2023-05-08T14:25:53.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:52 smithi096 ceph-mon[124666]: pgmap v20582: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 340 KiB/s wr, 6 op/s 2023-05-08T14:25:53.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:52 smithi186 ceph-mon[126480]: pgmap v20582: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 340 KiB/s wr, 6 op/s 2023-05-08T14:25:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:54 smithi186 ceph-mon[126480]: pgmap v20583: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 340 KiB/s wr, 6 op/s 2023-05-08T14:25:54.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38493.451603 secs 2023-05-08T14:25:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:54 smithi133 ceph-mon[125939]: pgmap v20583: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 340 KiB/s wr, 6 op/s 2023-05-08T14:25:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38493.451603 secs 2023-05-08T14:25:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:54 smithi096 ceph-mon[124666]: pgmap v20583: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 340 KiB/s wr, 6 op/s 2023-05-08T14:25:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38493.451603 secs 2023-05-08T14:25:56.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:56 smithi133 ceph-mon[125939]: pgmap v20584: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1002 KiB/s rd, 879 KiB/s wr, 11 op/s 2023-05-08T14:25:57.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:56 smithi096 ceph-mon[124666]: pgmap v20584: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1002 KiB/s rd, 879 KiB/s wr, 11 op/s 2023-05-08T14:25:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:56 smithi186 ceph-mon[126480]: pgmap v20584: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1002 KiB/s rd, 879 KiB/s wr, 11 op/s 2023-05-08T14:25:57.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:25:58.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:25:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:25:58.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:58 smithi133 ceph-mon[125939]: pgmap v20585: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1000 KiB/s rd, 878 KiB/s wr, 8 op/s 2023-05-08T14:25:58.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:58 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:25:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:25:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:25:59.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:58 smithi096 ceph-mon[124666]: pgmap v20585: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1000 KiB/s rd, 878 KiB/s wr, 8 op/s 2023-05-08T14:25:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:58 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:25:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:25:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:25:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:58 smithi186 ceph-mon[126480]: pgmap v20585: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1000 KiB/s rd, 878 KiB/s wr, 8 op/s 2023-05-08T14:25:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:58 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:25:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:25:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:25:59.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:25:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38498.451725 secs 2023-05-08T14:26:00.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:25:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38498.451725 secs 2023-05-08T14:26:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:25:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38498.451725 secs 2023-05-08T14:26:00.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:00 smithi133 ceph-mon[125939]: pgmap v20586: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2023-05-08T14:26:01.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:00 smithi096 ceph-mon[124666]: pgmap v20586: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2023-05-08T14:26:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:00 smithi186 ceph-mon[126480]: pgmap v20586: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2023-05-08T14:26:02.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:02 smithi133 ceph-mon[125939]: pgmap v20587: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 863 KiB/s rd, 1.1 MiB/s wr, 9 op/s 2023-05-08T14:26:03.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:02 smithi096 ceph-mon[124666]: pgmap v20587: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 863 KiB/s rd, 1.1 MiB/s wr, 9 op/s 2023-05-08T14:26:03.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:02 smithi186 ceph-mon[126480]: pgmap v20587: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 863 KiB/s rd, 1.1 MiB/s wr, 9 op/s 2023-05-08T14:26:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:04 smithi186 ceph-mon[126480]: pgmap v20588: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 863 KiB/s rd, 1.1 MiB/s wr, 9 op/s 2023-05-08T14:26:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38503.451839 secs 2023-05-08T14:26:04.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:04 smithi133 ceph-mon[125939]: pgmap v20588: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 863 KiB/s rd, 1.1 MiB/s wr, 9 op/s 2023-05-08T14:26:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38503.451839 secs 2023-05-08T14:26:04.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:04 smithi096 ceph-mon[124666]: pgmap v20588: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 863 KiB/s rd, 1.1 MiB/s wr, 9 op/s 2023-05-08T14:26:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38503.451839 secs 2023-05-08T14:26:05.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38504.005294 secs 2023-05-08T14:26:05.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38504.005294 secs 2023-05-08T14:26:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38504.005294 secs 2023-05-08T14:26:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:06 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:26:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:26:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:26:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:06 smithi186 ceph-mon[126480]: pgmap v20589: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.9 MiB/s wr, 27 op/s 2023-05-08T14:26:06.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:06 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:26:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:26:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:26:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:06 smithi133 ceph-mon[125939]: pgmap v20589: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.9 MiB/s wr, 27 op/s 2023-05-08T14:26:06.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:06 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:26:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:26:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:26:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:06 smithi096 ceph-mon[124666]: pgmap v20589: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.9 MiB/s wr, 27 op/s 2023-05-08T14:26:08.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:08 smithi133 ceph-mon[125939]: pgmap v20590: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 23 op/s 2023-05-08T14:26:09.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:08 smithi096 ceph-mon[124666]: pgmap v20590: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 23 op/s 2023-05-08T14:26:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:08 smithi186 ceph-mon[126480]: pgmap v20590: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 23 op/s 2023-05-08T14:26:09.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38508.451959 secs 2023-05-08T14:26:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38509.005412 secs 2023-05-08T14:26:10.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38508.451959 secs 2023-05-08T14:26:10.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38509.005412 secs 2023-05-08T14:26:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38508.451959 secs 2023-05-08T14:26:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38509.005412 secs 2023-05-08T14:26:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:10 smithi133 ceph-mon[125939]: pgmap v20591: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 27 op/s 2023-05-08T14:26:11.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:10 smithi096 ceph-mon[124666]: pgmap v20591: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 27 op/s 2023-05-08T14:26:11.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:10 smithi186 ceph-mon[126480]: pgmap v20591: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 27 op/s 2023-05-08T14:26:12.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:12 smithi133 ceph-mon[125939]: pgmap v20592: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 825 KiB/s wr, 22 op/s 2023-05-08T14:26:13.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:12 smithi096 ceph-mon[124666]: pgmap v20592: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 825 KiB/s wr, 22 op/s 2023-05-08T14:26:13.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:12 smithi186 ceph-mon[126480]: pgmap v20592: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 825 KiB/s wr, 22 op/s 2023-05-08T14:26:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:14 smithi186 ceph-mon[126480]: pgmap v20593: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 825 KiB/s wr, 22 op/s 2023-05-08T14:26:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38513.452077 secs 2023-05-08T14:26:14.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:14 smithi133 ceph-mon[125939]: pgmap v20593: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 825 KiB/s wr, 22 op/s 2023-05-08T14:26:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38513.452077 secs 2023-05-08T14:26:14.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:14 smithi096 ceph-mon[124666]: pgmap v20593: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 825 KiB/s wr, 22 op/s 2023-05-08T14:26:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38513.452077 secs 2023-05-08T14:26:15.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38514.005532 secs 2023-05-08T14:26:15.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38514.005532 secs 2023-05-08T14:26:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38514.005532 secs 2023-05-08T14:26:16.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:16 smithi186 ceph-mon[126480]: pgmap v20594: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.3 MiB/s wr, 26 op/s 2023-05-08T14:26:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:16 smithi133 ceph-mon[125939]: pgmap v20594: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.3 MiB/s wr, 26 op/s 2023-05-08T14:26:16.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:16 smithi096 ceph-mon[124666]: pgmap v20594: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.3 MiB/s wr, 26 op/s 2023-05-08T14:26:18.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:18 smithi133 ceph-mon[125939]: pgmap v20595: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 536 KiB/s wr, 8 op/s 2023-05-08T14:26:19.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:18 smithi096 ceph-mon[124666]: pgmap v20595: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 536 KiB/s wr, 8 op/s 2023-05-08T14:26:19.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:18 smithi186 ceph-mon[126480]: pgmap v20595: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 536 KiB/s wr, 8 op/s 2023-05-08T14:26:19.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38518.452202 secs 2023-05-08T14:26:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38519.005655 secs 2023-05-08T14:26:20.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38518.452202 secs 2023-05-08T14:26:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38519.005655 secs 2023-05-08T14:26:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38518.452202 secs 2023-05-08T14:26:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38519.005655 secs 2023-05-08T14:26:20.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:20 smithi133 ceph-mon[125939]: pgmap v20596: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 538 KiB/s rd, 536 KiB/s wr, 11 op/s 2023-05-08T14:26:21.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:20 smithi096 ceph-mon[124666]: pgmap v20596: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 538 KiB/s rd, 536 KiB/s wr, 11 op/s 2023-05-08T14:26:21.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:20 smithi186 ceph-mon[126480]: pgmap v20596: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 538 KiB/s rd, 536 KiB/s wr, 11 op/s 2023-05-08T14:26:22.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:22 smithi133 ceph-mon[125939]: pgmap v20597: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 535 KiB/s rd, 533 KiB/s wr, 7 op/s 2023-05-08T14:26:23.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:22 smithi096 ceph-mon[124666]: pgmap v20597: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 535 KiB/s rd, 533 KiB/s wr, 7 op/s 2023-05-08T14:26:23.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:22 smithi186 ceph-mon[126480]: pgmap v20597: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 535 KiB/s rd, 533 KiB/s wr, 7 op/s 2023-05-08T14:26:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:24 smithi186 ceph-mon[126480]: pgmap v20598: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 535 KiB/s rd, 533 KiB/s wr, 7 op/s 2023-05-08T14:26:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38523.452307 secs 2023-05-08T14:26:24.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:24 smithi133 ceph-mon[125939]: pgmap v20598: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 535 KiB/s rd, 533 KiB/s wr, 7 op/s 2023-05-08T14:26:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38523.452307 secs 2023-05-08T14:26:24.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:24 smithi096 ceph-mon[124666]: pgmap v20598: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 535 KiB/s rd, 533 KiB/s wr, 7 op/s 2023-05-08T14:26:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38523.452307 secs 2023-05-08T14:26:25.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:25 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:26:25.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:25 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:26:25.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:25 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:26:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:26 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:26:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:26 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:26:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:26 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:26:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:26 smithi186 ceph-mon[126480]: pgmap v20599: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 14 op/s 2023-05-08T14:26:26.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:26 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:26:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:26 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:26:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:26 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:26:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:26 smithi133 ceph-mon[125939]: pgmap v20599: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 14 op/s 2023-05-08T14:26:26.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:26 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:26:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:26 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:26:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:26 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:26:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:26 smithi096 ceph-mon[124666]: pgmap v20599: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 14 op/s 2023-05-08T14:26:28.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:28 smithi133 ceph-mon[125939]: pgmap v20600: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 938 KiB/s wr, 10 op/s 2023-05-08T14:26:29.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:28 smithi096 ceph-mon[124666]: pgmap v20600: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 938 KiB/s wr, 10 op/s 2023-05-08T14:26:29.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:28 smithi186 ceph-mon[126480]: pgmap v20600: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 938 KiB/s wr, 10 op/s 2023-05-08T14:26:29.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38528.452429 secs 2023-05-08T14:26:30.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38528.452429 secs 2023-05-08T14:26:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38528.452429 secs 2023-05-08T14:26:30.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:30 smithi133 ceph-mon[125939]: pgmap v20601: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 14 op/s 2023-05-08T14:26:31.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:30 smithi096 ceph-mon[124666]: pgmap v20601: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 14 op/s 2023-05-08T14:26:31.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:30 smithi186 ceph-mon[126480]: pgmap v20601: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 14 op/s 2023-05-08T14:26:31.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:31 smithi133 ceph-mon[125939]: osdmap e1364: 12 total, 12 up, 12 in 2023-05-08T14:26:32.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:31 smithi096 ceph-mon[124666]: osdmap e1364: 12 total, 12 up, 12 in 2023-05-08T14:26:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:31 smithi186 ceph-mon[126480]: osdmap e1364: 12 total, 12 up, 12 in 2023-05-08T14:26:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:32 smithi133 ceph-mon[125939]: pgmap v20603: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T14:26:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:32 smithi096 ceph-mon[124666]: pgmap v20603: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T14:26:33.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:32 smithi186 ceph-mon[126480]: pgmap v20603: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T14:26:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:34 smithi186 ceph-mon[126480]: pgmap v20604: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T14:26:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38533.452544 secs 2023-05-08T14:26:34.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:34 smithi133 ceph-mon[125939]: pgmap v20604: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T14:26:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38533.452544 secs 2023-05-08T14:26:34.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:34 smithi096 ceph-mon[124666]: pgmap v20604: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T14:26:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38533.452544 secs 2023-05-08T14:26:36.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:36 smithi133 ceph-mon[125939]: pgmap v20605: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 835 KiB/s rd, 640 KiB/s wr, 9 op/s 2023-05-08T14:26:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:36 smithi096 ceph-mon[124666]: pgmap v20605: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 835 KiB/s rd, 640 KiB/s wr, 9 op/s 2023-05-08T14:26:37.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:36 smithi186 ceph-mon[126480]: pgmap v20605: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 835 KiB/s rd, 640 KiB/s wr, 9 op/s 2023-05-08T14:26:38.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:38 smithi133 ceph-mon[125939]: pgmap v20606: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 835 KiB/s rd, 640 KiB/s wr, 9 op/s 2023-05-08T14:26:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:38 smithi133 ceph-mon[125939]: osdmap e1365: 12 total, 12 up, 12 in 2023-05-08T14:26:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:38 smithi096 ceph-mon[124666]: pgmap v20606: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 835 KiB/s rd, 640 KiB/s wr, 9 op/s 2023-05-08T14:26:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:38 smithi096 ceph-mon[124666]: osdmap e1365: 12 total, 12 up, 12 in 2023-05-08T14:26:39.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:38 smithi186 ceph-mon[126480]: pgmap v20606: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 835 KiB/s rd, 640 KiB/s wr, 9 op/s 2023-05-08T14:26:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:38 smithi186 ceph-mon[126480]: osdmap e1365: 12 total, 12 up, 12 in 2023-05-08T14:26:39.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38538.452688 secs 2023-05-08T14:26:40.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38538.452688 secs 2023-05-08T14:26:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38538.452688 secs 2023-05-08T14:26:40.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:40 smithi133 ceph-mon[125939]: pgmap v20608: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 804 KiB/s wr, 11 op/s 2023-05-08T14:26:41.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:40 smithi096 ceph-mon[124666]: pgmap v20608: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 804 KiB/s wr, 11 op/s 2023-05-08T14:26:41.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:40 smithi186 ceph-mon[126480]: pgmap v20608: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 804 KiB/s wr, 11 op/s 2023-05-08T14:26:41.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38540.347756 secs 2023-05-08T14:26:42.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38540.347756 secs 2023-05-08T14:26:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38540.347756 secs 2023-05-08T14:26:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:42 smithi133 ceph-mon[125939]: pgmap v20609: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 718 KiB/s wr, 10 op/s 2023-05-08T14:26:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:42 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:26:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:42 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:26:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:42 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:26:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:42 smithi096 ceph-mon[124666]: pgmap v20609: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 718 KiB/s wr, 10 op/s 2023-05-08T14:26:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:42 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:26:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:42 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:26:43.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:42 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:26:43.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:42 smithi186 ceph-mon[126480]: pgmap v20609: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 718 KiB/s wr, 10 op/s 2023-05-08T14:26:43.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:42 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:26:43.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:42 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:26:43.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:42 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:26:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:44 smithi186 ceph-mon[126480]: pgmap v20610: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 718 KiB/s wr, 10 op/s 2023-05-08T14:26:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38543.452799 secs 2023-05-08T14:26:44.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:44 smithi133 ceph-mon[125939]: pgmap v20610: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 718 KiB/s wr, 10 op/s 2023-05-08T14:26:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38543.452799 secs 2023-05-08T14:26:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:44 smithi096 ceph-mon[124666]: pgmap v20610: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 718 KiB/s wr, 10 op/s 2023-05-08T14:26:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38543.452799 secs 2023-05-08T14:26:45.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38544.006321 secs 2023-05-08T14:26:45.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38544.006321 secs 2023-05-08T14:26:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38544.006321 secs 2023-05-08T14:26:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:46 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:26:46.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:46 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:26:46.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:46 smithi186 ceph-mon[126480]: pgmap v20611: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.7 MiB/s wr, 12 op/s 2023-05-08T14:26:46.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:46 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:26:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:46 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:26:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:46 smithi133 ceph-mon[125939]: pgmap v20611: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.7 MiB/s wr, 12 op/s 2023-05-08T14:26:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:46 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:26:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:46 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:26:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:46 smithi096 ceph-mon[124666]: pgmap v20611: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.7 MiB/s wr, 12 op/s 2023-05-08T14:26:48.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:48 smithi133 ceph-mon[125939]: pgmap v20612: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.7 MiB/s wr, 12 op/s 2023-05-08T14:26:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:48 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:26:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:48 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:26:49.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:48 smithi096 ceph-mon[124666]: pgmap v20612: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.7 MiB/s wr, 12 op/s 2023-05-08T14:26:49.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:48 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:26:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:48 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:26:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:48 smithi186 ceph-mon[126480]: pgmap v20612: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.7 MiB/s wr, 12 op/s 2023-05-08T14:26:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:48 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:26:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:48 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:26:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38548.452888 secs 2023-05-08T14:26:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:49 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:26:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:49 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:26:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:49 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:26:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:26:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38549.006439 secs 2023-05-08T14:26:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38548.452888 secs 2023-05-08T14:26:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:49 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:26:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:49 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:26:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:49 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:26:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:26:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38549.006439 secs 2023-05-08T14:26:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38548.452888 secs 2023-05-08T14:26:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:49 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:26:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:49 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:26:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:49 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:26:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:26:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38549.006439 secs 2023-05-08T14:26:50.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:50 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:26:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:50 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T14:26:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:50 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T14:26:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:50 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:26:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:50 smithi133 ceph-mon[125939]: pgmap v20613: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 16 op/s 2023-05-08T14:26:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:26:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:26:51.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:50 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:26:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:50 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T14:26:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:50 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T14:26:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:50 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:26:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:50 smithi096 ceph-mon[124666]: pgmap v20613: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 16 op/s 2023-05-08T14:26:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:26:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:26:51.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:50 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:26:51.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:50 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T14:26:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:50 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T14:26:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:50 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:26:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:50 smithi186 ceph-mon[126480]: pgmap v20613: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 16 op/s 2023-05-08T14:26:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:26:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:26:52.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:52 smithi133 ceph-mon[125939]: pgmap v20614: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T14:26:53.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:52 smithi096 ceph-mon[124666]: pgmap v20614: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T14:26:53.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:52 smithi186 ceph-mon[126480]: pgmap v20614: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T14:26:53.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:53 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:26:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:53 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:26:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:53 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:26:54.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:54 smithi133 ceph-mon[125939]: pgmap v20615: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T14:26:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38553.453007 secs 2023-05-08T14:26:55.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:54 smithi096 ceph-mon[124666]: pgmap v20615: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T14:26:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38553.453007 secs 2023-05-08T14:26:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:54 smithi186 ceph-mon[126480]: pgmap v20615: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T14:26:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38553.453007 secs 2023-05-08T14:26:56.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:56 smithi133 ceph-mon[125939]: pgmap v20616: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.5 MiB/s wr, 18 op/s 2023-05-08T14:26:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:56 smithi096 ceph-mon[124666]: pgmap v20616: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.5 MiB/s wr, 18 op/s 2023-05-08T14:26:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:56 smithi186 ceph-mon[126480]: pgmap v20616: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.5 MiB/s wr, 18 op/s 2023-05-08T14:26:57.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:26:58.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:26:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:26:58.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:58 smithi133 ceph-mon[125939]: pgmap v20617: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T14:26:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:26:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:26:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:58 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:26:59.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:58 smithi096 ceph-mon[124666]: pgmap v20617: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T14:26:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:26:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:26:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:58 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:26:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:58 smithi186 ceph-mon[126480]: pgmap v20617: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T14:26:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:26:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:26:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:58 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:26:59.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38558.453144 secs 2023-05-08T14:26:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:26:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38559.006658 secs 2023-05-08T14:27:00.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38558.453144 secs 2023-05-08T14:27:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:26:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38559.006658 secs 2023-05-08T14:27:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38558.453144 secs 2023-05-08T14:27:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:26:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38559.006658 secs 2023-05-08T14:27:00.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:00 smithi133 ceph-mon[125939]: pgmap v20618: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.1 MiB/s wr, 18 op/s 2023-05-08T14:27:01.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:00 smithi096 ceph-mon[124666]: pgmap v20618: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.1 MiB/s wr, 18 op/s 2023-05-08T14:27:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:00 smithi186 ceph-mon[126480]: pgmap v20618: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.1 MiB/s wr, 18 op/s 2023-05-08T14:27:02.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:02 smithi133 ceph-mon[125939]: pgmap v20619: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 13 op/s 2023-05-08T14:27:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:27:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:27:03.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:02 smithi096 ceph-mon[124666]: pgmap v20619: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 13 op/s 2023-05-08T14:27:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:27:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:27:03.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:02 smithi186 ceph-mon[126480]: pgmap v20619: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 13 op/s 2023-05-08T14:27:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:27:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:27:03.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:03 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:27:04.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:03 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:27:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:03 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:27:04.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:04 smithi133 ceph-mon[125939]: pgmap v20620: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 13 op/s 2023-05-08T14:27:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38563.453275 secs 2023-05-08T14:27:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38564.006773 secs 2023-05-08T14:27:05.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:04 smithi096 ceph-mon[124666]: pgmap v20620: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 13 op/s 2023-05-08T14:27:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38563.453275 secs 2023-05-08T14:27:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38564.006773 secs 2023-05-08T14:27:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:04 smithi186 ceph-mon[126480]: pgmap v20620: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 13 op/s 2023-05-08T14:27:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38563.453275 secs 2023-05-08T14:27:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38564.006773 secs 2023-05-08T14:27:05.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38565.348347 secs 2023-05-08T14:27:06.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38565.348347 secs 2023-05-08T14:27:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38565.348347 secs 2023-05-08T14:27:06.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:06 smithi133 ceph-mon[125939]: pgmap v20621: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.4 MiB/s wr, 34 op/s 2023-05-08T14:27:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:06 smithi096 ceph-mon[124666]: pgmap v20621: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.4 MiB/s wr, 34 op/s 2023-05-08T14:27:07.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:06 smithi186 ceph-mon[126480]: pgmap v20621: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.4 MiB/s wr, 34 op/s 2023-05-08T14:27:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:08 smithi133 ceph-mon[125939]: pgmap v20622: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 26 op/s 2023-05-08T14:27:09.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:08 smithi096 ceph-mon[124666]: pgmap v20622: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 26 op/s 2023-05-08T14:27:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:08 smithi186 ceph-mon[126480]: pgmap v20622: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 26 op/s 2023-05-08T14:27:09.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38568.453388 secs 2023-05-08T14:27:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38569.006856 secs 2023-05-08T14:27:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38568.453388 secs 2023-05-08T14:27:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38569.006856 secs 2023-05-08T14:27:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38568.453388 secs 2023-05-08T14:27:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38569.006856 secs 2023-05-08T14:27:10.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:10 smithi133 ceph-mon[125939]: pgmap v20623: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 30 op/s 2023-05-08T14:27:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:10 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:27:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:10 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:27:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:10 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:27:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38570.348464 secs 2023-05-08T14:27:11.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:10 smithi096 ceph-mon[124666]: pgmap v20623: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 30 op/s 2023-05-08T14:27:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:10 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:27:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:10 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:27:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:10 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:27:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38570.348464 secs 2023-05-08T14:27:11.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:10 smithi186 ceph-mon[126480]: pgmap v20623: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 30 op/s 2023-05-08T14:27:11.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:10 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:27:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:10 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:27:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:10 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:27:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38570.348464 secs 2023-05-08T14:27:11.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:11 smithi133 ceph-mon[125939]: osdmap e1366: 12 total, 12 up, 12 in 2023-05-08T14:27:12.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:11 smithi096 ceph-mon[124666]: osdmap e1366: 12 total, 12 up, 12 in 2023-05-08T14:27:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:11 smithi186 ceph-mon[126480]: osdmap e1366: 12 total, 12 up, 12 in 2023-05-08T14:27:12.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:12 smithi133 ceph-mon[125939]: pgmap v20625: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 865 KiB/s wr, 29 op/s 2023-05-08T14:27:13.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:12 smithi096 ceph-mon[124666]: pgmap v20625: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 865 KiB/s wr, 29 op/s 2023-05-08T14:27:13.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:12 smithi186 ceph-mon[126480]: pgmap v20625: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 865 KiB/s wr, 29 op/s 2023-05-08T14:27:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:14 smithi186 ceph-mon[126480]: pgmap v20626: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 865 KiB/s wr, 29 op/s 2023-05-08T14:27:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38573.453504 secs 2023-05-08T14:27:14.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:14 smithi133 ceph-mon[125939]: pgmap v20626: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 865 KiB/s wr, 29 op/s 2023-05-08T14:27:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38573.453504 secs 2023-05-08T14:27:14.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:14 smithi096 ceph-mon[124666]: pgmap v20626: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 865 KiB/s wr, 29 op/s 2023-05-08T14:27:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38573.453504 secs 2023-05-08T14:27:15.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38574.006958 secs 2023-05-08T14:27:15.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38574.006958 secs 2023-05-08T14:27:15.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38574.006958 secs 2023-05-08T14:27:16.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:16 smithi186 ceph-mon[126480]: pgmap v20627: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 862 KiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T14:27:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38575.348591 secs 2023-05-08T14:27:16.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:16 smithi133 ceph-mon[125939]: pgmap v20627: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 862 KiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T14:27:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38575.348591 secs 2023-05-08T14:27:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:16 smithi096 ceph-mon[124666]: pgmap v20627: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 862 KiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T14:27:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38575.348591 secs 2023-05-08T14:27:18.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:18 smithi133 ceph-mon[125939]: pgmap v20628: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 862 KiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T14:27:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:18 smithi133 ceph-mon[125939]: osdmap e1367: 12 total, 12 up, 12 in 2023-05-08T14:27:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:18 smithi096 ceph-mon[124666]: pgmap v20628: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 862 KiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T14:27:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:18 smithi096 ceph-mon[124666]: osdmap e1367: 12 total, 12 up, 12 in 2023-05-08T14:27:19.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:18 smithi186 ceph-mon[126480]: pgmap v20628: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 862 KiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T14:27:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:18 smithi186 ceph-mon[126480]: osdmap e1367: 12 total, 12 up, 12 in 2023-05-08T14:27:19.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38578.453658 secs 2023-05-08T14:27:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38579.007102 secs 2023-05-08T14:27:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38578.453658 secs 2023-05-08T14:27:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38579.007102 secs 2023-05-08T14:27:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38578.453658 secs 2023-05-08T14:27:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38579.007102 secs 2023-05-08T14:27:20.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:20 smithi133 ceph-mon[125939]: pgmap v20630: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 11 op/s 2023-05-08T14:27:21.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:20 smithi096 ceph-mon[124666]: pgmap v20630: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 11 op/s 2023-05-08T14:27:21.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:20 smithi186 ceph-mon[126480]: pgmap v20630: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 11 op/s 2023-05-08T14:27:21.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38580.348711 secs 2023-05-08T14:27:22.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38580.348711 secs 2023-05-08T14:27:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38580.348711 secs 2023-05-08T14:27:22.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:22 smithi133 ceph-mon[125939]: pgmap v20631: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T14:27:23.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:22 smithi096 ceph-mon[124666]: pgmap v20631: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T14:27:23.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:22 smithi186 ceph-mon[126480]: pgmap v20631: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T14:27:24.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:24 smithi186 ceph-mon[126480]: pgmap v20632: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T14:27:24.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38583.453775 secs 2023-05-08T14:27:24.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:24 smithi133 ceph-mon[125939]: pgmap v20632: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T14:27:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38583.453775 secs 2023-05-08T14:27:24.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:24 smithi096 ceph-mon[124666]: pgmap v20632: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T14:27:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38583.453775 secs 2023-05-08T14:27:25.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38584.007213 secs 2023-05-08T14:27:25.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38584.007213 secs 2023-05-08T14:27:25.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38584.007213 secs 2023-05-08T14:27:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:26 smithi186 ceph-mon[126480]: pgmap v20633: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 874 KiB/s rd, 438 KiB/s wr, 9 op/s 2023-05-08T14:27:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38585.348832 secs 2023-05-08T14:27:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:26 smithi133 ceph-mon[125939]: pgmap v20633: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 874 KiB/s rd, 438 KiB/s wr, 9 op/s 2023-05-08T14:27:26.747 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38585.348832 secs 2023-05-08T14:27:26.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:26 smithi096 ceph-mon[124666]: pgmap v20633: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 874 KiB/s rd, 438 KiB/s wr, 9 op/s 2023-05-08T14:27:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38585.348832 secs 2023-05-08T14:27:28.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:28 smithi133 ceph-mon[125939]: pgmap v20634: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 874 KiB/s rd, 438 KiB/s wr, 9 op/s 2023-05-08T14:27:29.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:28 smithi096 ceph-mon[124666]: pgmap v20634: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 874 KiB/s rd, 438 KiB/s wr, 9 op/s 2023-05-08T14:27:29.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:28 smithi186 ceph-mon[126480]: pgmap v20634: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 874 KiB/s rd, 438 KiB/s wr, 9 op/s 2023-05-08T14:27:29.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38588.453919 secs 2023-05-08T14:27:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38589.007299 secs 2023-05-08T14:27:30.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38588.453919 secs 2023-05-08T14:27:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38589.007299 secs 2023-05-08T14:27:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38588.453919 secs 2023-05-08T14:27:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38589.007299 secs 2023-05-08T14:27:30.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:30 smithi133 ceph-mon[125939]: pgmap v20635: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 801 KiB/s rd, 389 KiB/s wr, 12 op/s 2023-05-08T14:27:31.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:30 smithi096 ceph-mon[124666]: pgmap v20635: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 801 KiB/s rd, 389 KiB/s wr, 12 op/s 2023-05-08T14:27:31.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:30 smithi186 ceph-mon[126480]: pgmap v20635: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 801 KiB/s rd, 389 KiB/s wr, 12 op/s 2023-05-08T14:27:31.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38590.348949 secs 2023-05-08T14:27:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38590.348949 secs 2023-05-08T14:27:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38590.348949 secs 2023-05-08T14:27:32.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:32 smithi133 ceph-mon[125939]: pgmap v20636: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 338 KiB/s wr, 8 op/s 2023-05-08T14:27:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:32 smithi096 ceph-mon[124666]: pgmap v20636: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 338 KiB/s wr, 8 op/s 2023-05-08T14:27:33.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:32 smithi186 ceph-mon[126480]: pgmap v20636: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 338 KiB/s wr, 8 op/s 2023-05-08T14:27:34.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:34 smithi186 ceph-mon[126480]: pgmap v20637: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 338 KiB/s wr, 8 op/s 2023-05-08T14:27:34.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38593.454039 secs 2023-05-08T14:27:34.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:34 smithi133 ceph-mon[125939]: pgmap v20637: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 338 KiB/s wr, 8 op/s 2023-05-08T14:27:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38593.454039 secs 2023-05-08T14:27:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:34 smithi096 ceph-mon[124666]: pgmap v20637: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 338 KiB/s wr, 8 op/s 2023-05-08T14:27:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38593.454039 secs 2023-05-08T14:27:35.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38594.007416 secs 2023-05-08T14:27:35.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38594.007416 secs 2023-05-08T14:27:35.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38594.007416 secs 2023-05-08T14:27:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:36 smithi186 ceph-mon[126480]: pgmap v20638: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 585 KiB/s rd, 509 KiB/s wr, 11 op/s 2023-05-08T14:27:36.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38595.349074 secs 2023-05-08T14:27:36.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:36 smithi133 ceph-mon[125939]: pgmap v20638: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 585 KiB/s rd, 509 KiB/s wr, 11 op/s 2023-05-08T14:27:36.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38595.349074 secs 2023-05-08T14:27:36.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:36 smithi096 ceph-mon[124666]: pgmap v20638: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 585 KiB/s rd, 509 KiB/s wr, 11 op/s 2023-05-08T14:27:36.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38595.349074 secs 2023-05-08T14:27:38.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:38 smithi133 ceph-mon[125939]: pgmap v20639: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 173 KiB/s wr, 8 op/s 2023-05-08T14:27:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:38 smithi096 ceph-mon[124666]: pgmap v20639: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 173 KiB/s wr, 8 op/s 2023-05-08T14:27:39.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:38 smithi186 ceph-mon[126480]: pgmap v20639: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 173 KiB/s wr, 8 op/s 2023-05-08T14:27:39.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38598.454177 secs 2023-05-08T14:27:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38599.007534 secs 2023-05-08T14:27:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38598.454177 secs 2023-05-08T14:27:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38599.007534 secs 2023-05-08T14:27:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38598.454177 secs 2023-05-08T14:27:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38599.007534 secs 2023-05-08T14:27:40.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:40 smithi133 ceph-mon[125939]: pgmap v20640: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 173 KiB/s wr, 10 op/s 2023-05-08T14:27:41.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:40 smithi096 ceph-mon[124666]: pgmap v20640: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 173 KiB/s wr, 10 op/s 2023-05-08T14:27:41.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:40 smithi186 ceph-mon[126480]: pgmap v20640: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 173 KiB/s wr, 10 op/s 2023-05-08T14:27:41.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38600.349195 secs 2023-05-08T14:27:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38600.349195 secs 2023-05-08T14:27:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38600.349195 secs 2023-05-08T14:27:42.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:42 smithi133 ceph-mon[125939]: pgmap v20641: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 340 KiB/s rd, 338 KiB/s wr, 7 op/s 2023-05-08T14:27:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:42 smithi096 ceph-mon[124666]: pgmap v20641: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 340 KiB/s rd, 338 KiB/s wr, 7 op/s 2023-05-08T14:27:43.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:42 smithi186 ceph-mon[126480]: pgmap v20641: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 340 KiB/s rd, 338 KiB/s wr, 7 op/s 2023-05-08T14:27:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:44 smithi186 ceph-mon[126480]: pgmap v20642: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 336 KiB/s wr, 7 op/s 2023-05-08T14:27:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38603.454247 secs 2023-05-08T14:27:44.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:44 smithi133 ceph-mon[125939]: pgmap v20642: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 336 KiB/s wr, 7 op/s 2023-05-08T14:27:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38603.454247 secs 2023-05-08T14:27:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:44 smithi096 ceph-mon[124666]: pgmap v20642: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 336 KiB/s wr, 7 op/s 2023-05-08T14:27:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38603.454247 secs 2023-05-08T14:27:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38604.007651 secs 2023-05-08T14:27:45.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38604.007651 secs 2023-05-08T14:27:45.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38604.007651 secs 2023-05-08T14:27:46.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:46 smithi186 ceph-mon[126480]: pgmap v20643: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 738 KiB/s rd, 691 KiB/s wr, 11 op/s 2023-05-08T14:27:46.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:46 smithi133 ceph-mon[125939]: pgmap v20643: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 738 KiB/s rd, 691 KiB/s wr, 11 op/s 2023-05-08T14:27:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:46 smithi096 ceph-mon[124666]: pgmap v20643: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 738 KiB/s rd, 691 KiB/s wr, 11 op/s 2023-05-08T14:27:48.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:48 smithi133 ceph-mon[125939]: pgmap v20644: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 566 KiB/s rd, 520 KiB/s wr, 7 op/s 2023-05-08T14:27:49.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:48 smithi096 ceph-mon[124666]: pgmap v20644: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 566 KiB/s rd, 520 KiB/s wr, 7 op/s 2023-05-08T14:27:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:48 smithi186 ceph-mon[126480]: pgmap v20644: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 566 KiB/s rd, 520 KiB/s wr, 7 op/s 2023-05-08T14:27:49.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38608.454367 secs 2023-05-08T14:27:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:27:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:49 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:27:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38609.007717 secs 2023-05-08T14:27:50.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38608.454367 secs 2023-05-08T14:27:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:27:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:49 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:27:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38609.007717 secs 2023-05-08T14:27:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38608.454367 secs 2023-05-08T14:27:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:27:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:49 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:27:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38609.007717 secs 2023-05-08T14:27:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:50 smithi133 ceph-mon[125939]: pgmap v20645: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1023 KiB/s wr, 11 op/s 2023-05-08T14:27:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:27:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:27:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:27:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:50 smithi096 ceph-mon[124666]: pgmap v20645: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1023 KiB/s wr, 11 op/s 2023-05-08T14:27:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:27:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:27:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:27:51.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:50 smithi186 ceph-mon[126480]: pgmap v20645: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1023 KiB/s wr, 11 op/s 2023-05-08T14:27:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:27:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:27:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:27:52.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:52 smithi133 ceph-mon[125939]: pgmap v20646: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1023 KiB/s wr, 9 op/s 2023-05-08T14:27:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:27:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:27:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:27:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:27:52.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:27:52.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:27:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:52 smithi096 ceph-mon[124666]: pgmap v20646: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1023 KiB/s wr, 9 op/s 2023-05-08T14:27:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:27:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:27:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:27:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:27:53.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:27:53.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:27:53.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:52 smithi186 ceph-mon[126480]: pgmap v20646: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1023 KiB/s wr, 9 op/s 2023-05-08T14:27:53.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:27:53.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:27:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:27:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:27:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:27:53.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:27:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:27:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:27:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:27:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:27:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:27:54.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:27:54.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:27:54.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:27:54.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:27:54.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:27:54.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:27:54.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:27:54.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:27:54.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:27:54.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:27:54.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:54 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi186 to 78263k 2023-05-08T14:27:54.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:54 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi133 to 111.7M 2023-05-08T14:27:54.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:54 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi186 to 80141832: error parsing value: Value '80141832' is below minimum 939524096 2023-05-08T14:27:54.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:54 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi133 to 117168722: error parsing value: Value '117168722' is below minimum 939524096 2023-05-08T14:27:54.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:27:54.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:27:54.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:54 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:27:54.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:27:54.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:54 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T14:27:54.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:54 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T14:27:54.373 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:54 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:27:54.373 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:54 smithi186 ceph-mon[126480]: pgmap v20647: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 915 KiB/s rd, 858 KiB/s wr, 8 op/s 2023-05-08T14:27:54.373 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38613.454473 secs 2023-05-08T14:27:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:27:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:27:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:27:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:27:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:27:54.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:27:54.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:27:54.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:27:54.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:27:54.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:27:54.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:27:54.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:27:54.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:27:54.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:27:54.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:27:54.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:54 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi186 to 78263k 2023-05-08T14:27:54.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:54 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi133 to 111.7M 2023-05-08T14:27:54.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:54 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi186 to 80141832: error parsing value: Value '80141832' is below minimum 939524096 2023-05-08T14:27:54.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:54 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi133 to 117168722: error parsing value: Value '117168722' is below minimum 939524096 2023-05-08T14:27:54.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:27:54.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:27:54.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:54 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:27:54.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:27:54.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:54 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T14:27:54.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:54 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T14:27:54.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:54 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:27:54.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:54 smithi133 ceph-mon[125939]: pgmap v20647: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 915 KiB/s rd, 858 KiB/s wr, 8 op/s 2023-05-08T14:27:54.494 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38613.454473 secs 2023-05-08T14:27:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:27:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:27:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:27:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:27:54.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:27:54.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:27:54.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:27:54.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:27:54.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:27:54.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:27:54.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:27:54.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:27:54.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:27:54.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:27:54.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:27:54.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:54 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi186 to 78263k 2023-05-08T14:27:54.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:54 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi133 to 111.7M 2023-05-08T14:27:54.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:54 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi186 to 80141832: error parsing value: Value '80141832' is below minimum 939524096 2023-05-08T14:27:54.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:54 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi133 to 117168722: error parsing value: Value '117168722' is below minimum 939524096 2023-05-08T14:27:54.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:27:54.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:27:54.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:54 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:27:54.508 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:27:54.509 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:54 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T14:27:54.509 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:54 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T14:27:54.509 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:54 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:27:54.509 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:54 smithi096 ceph-mon[124666]: pgmap v20647: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 915 KiB/s rd, 858 KiB/s wr, 8 op/s 2023-05-08T14:27:54.509 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38613.454473 secs 2023-05-08T14:27:56.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:56 smithi133 ceph-mon[125939]: pgmap v20648: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2023-05-08T14:27:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:56 smithi096 ceph-mon[124666]: pgmap v20648: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2023-05-08T14:27:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:56 smithi186 ceph-mon[126480]: pgmap v20648: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2023-05-08T14:27:57.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:27:58.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:27:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:27:58.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:58 smithi133 ceph-mon[125939]: pgmap v20649: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 9 op/s 2023-05-08T14:27:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:58 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:27:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:27:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:27:59.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:58 smithi096 ceph-mon[124666]: pgmap v20649: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 9 op/s 2023-05-08T14:27:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:58 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:27:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:27:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:27:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:58 smithi186 ceph-mon[126480]: pgmap v20649: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 9 op/s 2023-05-08T14:27:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:58 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:27:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:27:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:27:59.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:27:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38618.454548 secs 2023-05-08T14:28:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:27:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38618.454548 secs 2023-05-08T14:28:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:27:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38618.454548 secs 2023-05-08T14:28:00.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:00 smithi133 ceph-mon[125939]: pgmap v20650: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 14 op/s 2023-05-08T14:28:01.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:00 smithi096 ceph-mon[124666]: pgmap v20650: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 14 op/s 2023-05-08T14:28:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:00 smithi186 ceph-mon[126480]: pgmap v20650: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 14 op/s 2023-05-08T14:28:02.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:02 smithi133 ceph-mon[125939]: pgmap v20651: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T14:28:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:02 smithi096 ceph-mon[124666]: pgmap v20651: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T14:28:03.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:02 smithi186 ceph-mon[126480]: pgmap v20651: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T14:28:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:04 smithi186 ceph-mon[126480]: pgmap v20652: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T14:28:04.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38623.454664 secs 2023-05-08T14:28:04.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:04 smithi133 ceph-mon[125939]: pgmap v20652: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T14:28:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38623.454664 secs 2023-05-08T14:28:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:04 smithi096 ceph-mon[124666]: pgmap v20652: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T14:28:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38623.454664 secs 2023-05-08T14:28:05.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38624.008052 secs 2023-05-08T14:28:05.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38624.008052 secs 2023-05-08T14:28:05.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38624.008052 secs 2023-05-08T14:28:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:06 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:28:06.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:28:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:28:06.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:06 smithi186 ceph-mon[126480]: pgmap v20653: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 31 op/s 2023-05-08T14:28:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:06 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:28:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:28:06.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:28:06.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:06 smithi133 ceph-mon[125939]: pgmap v20653: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 31 op/s 2023-05-08T14:28:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:06 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:28:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:28:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:28:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:06 smithi096 ceph-mon[124666]: pgmap v20653: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 31 op/s 2023-05-08T14:28:08.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:08 smithi133 ceph-mon[125939]: pgmap v20654: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 26 op/s 2023-05-08T14:28:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:08 smithi096 ceph-mon[124666]: pgmap v20654: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 26 op/s 2023-05-08T14:28:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:08 smithi186 ceph-mon[126480]: pgmap v20654: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 26 op/s 2023-05-08T14:28:09.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38628.454793 secs 2023-05-08T14:28:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38628.454793 secs 2023-05-08T14:28:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38628.454793 secs 2023-05-08T14:28:10.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:10 smithi133 ceph-mon[125939]: pgmap v20655: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 30 op/s 2023-05-08T14:28:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:10 smithi096 ceph-mon[124666]: pgmap v20655: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 30 op/s 2023-05-08T14:28:11.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:10 smithi186 ceph-mon[126480]: pgmap v20655: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 30 op/s 2023-05-08T14:28:11.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:11 smithi133 ceph-mon[125939]: osdmap e1368: 12 total, 12 up, 12 in 2023-05-08T14:28:12.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:11 smithi096 ceph-mon[124666]: osdmap e1368: 12 total, 12 up, 12 in 2023-05-08T14:28:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:11 smithi186 ceph-mon[126480]: osdmap e1368: 12 total, 12 up, 12 in 2023-05-08T14:28:12.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:12 smithi133 ceph-mon[125939]: pgmap v20657: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 657 KiB/s rd, 659 KiB/s wr, 29 op/s 2023-05-08T14:28:13.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:12 smithi096 ceph-mon[124666]: pgmap v20657: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 657 KiB/s rd, 659 KiB/s wr, 29 op/s 2023-05-08T14:28:13.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:12 smithi186 ceph-mon[126480]: pgmap v20657: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 657 KiB/s rd, 659 KiB/s wr, 29 op/s 2023-05-08T14:28:13.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:13 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:28:14.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:13 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:28:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:13 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:28:14.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:14 smithi133 ceph-mon[125939]: pgmap v20658: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 657 KiB/s rd, 659 KiB/s wr, 29 op/s 2023-05-08T14:28:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:14 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:28:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:14 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:28:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:14 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:28:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38633.454928 secs 2023-05-08T14:28:15.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:14 smithi096 ceph-mon[124666]: pgmap v20658: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 657 KiB/s rd, 659 KiB/s wr, 29 op/s 2023-05-08T14:28:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:14 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:28:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:14 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:28:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:14 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:28:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38633.454928 secs 2023-05-08T14:28:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:14 smithi186 ceph-mon[126480]: pgmap v20658: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 657 KiB/s rd, 659 KiB/s wr, 29 op/s 2023-05-08T14:28:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:14 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:28:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:14 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:28:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:14 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:28:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38633.454928 secs 2023-05-08T14:28:16.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:16 smithi133 ceph-mon[125939]: pgmap v20659: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 945 KiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T14:28:17.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:16 smithi096 ceph-mon[124666]: pgmap v20659: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 945 KiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T14:28:17.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:16 smithi186 ceph-mon[126480]: pgmap v20659: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 945 KiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T14:28:18.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:18 smithi133 ceph-mon[125939]: pgmap v20660: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 945 KiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T14:28:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:18 smithi133 ceph-mon[125939]: osdmap e1369: 12 total, 12 up, 12 in 2023-05-08T14:28:19.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:18 smithi096 ceph-mon[124666]: pgmap v20660: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 945 KiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T14:28:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:18 smithi096 ceph-mon[124666]: osdmap e1369: 12 total, 12 up, 12 in 2023-05-08T14:28:19.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:18 smithi186 ceph-mon[126480]: pgmap v20660: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 945 KiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T14:28:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:18 smithi186 ceph-mon[126480]: osdmap e1369: 12 total, 12 up, 12 in 2023-05-08T14:28:19.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38638.455050 secs 2023-05-08T14:28:20.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38638.455050 secs 2023-05-08T14:28:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38638.455050 secs 2023-05-08T14:28:20.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:20 smithi133 ceph-mon[125939]: pgmap v20662: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 11 op/s 2023-05-08T14:28:21.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:20 smithi096 ceph-mon[124666]: pgmap v20662: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 11 op/s 2023-05-08T14:28:21.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:20 smithi186 ceph-mon[126480]: pgmap v20662: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 11 op/s 2023-05-08T14:28:22.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:22 smithi133 ceph-mon[125939]: pgmap v20663: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T14:28:23.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:22 smithi096 ceph-mon[124666]: pgmap v20663: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T14:28:23.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:22 smithi186 ceph-mon[126480]: pgmap v20663: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T14:28:24.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:24 smithi186 ceph-mon[126480]: pgmap v20664: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T14:28:24.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38643.455165 secs 2023-05-08T14:28:24.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:24 smithi133 ceph-mon[125939]: pgmap v20664: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T14:28:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38643.455165 secs 2023-05-08T14:28:24.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:24 smithi096 ceph-mon[124666]: pgmap v20664: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T14:28:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38643.455165 secs 2023-05-08T14:28:25.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38644.008490 secs 2023-05-08T14:28:25.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38644.008490 secs 2023-05-08T14:28:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38644.008490 secs 2023-05-08T14:28:26.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:26 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:28:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:26 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:28:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:26 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:28:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38645.350301 secs 2023-05-08T14:28:26.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:26 smithi186 ceph-mon[126480]: pgmap v20665: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T14:28:26.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:26 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:28:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:26 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:28:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:26 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:28:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38645.350301 secs 2023-05-08T14:28:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:26 smithi133 ceph-mon[125939]: pgmap v20665: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T14:28:26.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:26 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:28:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:26 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:28:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:26 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:28:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38645.350301 secs 2023-05-08T14:28:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:26 smithi096 ceph-mon[124666]: pgmap v20665: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T14:28:28.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:28 smithi133 ceph-mon[125939]: pgmap v20666: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T14:28:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:28 smithi096 ceph-mon[124666]: pgmap v20666: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T14:28:29.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:28 smithi186 ceph-mon[126480]: pgmap v20666: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T14:28:29.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38648.455300 secs 2023-05-08T14:28:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38649.008634 secs 2023-05-08T14:28:30.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38648.455300 secs 2023-05-08T14:28:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38649.008634 secs 2023-05-08T14:28:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38648.455300 secs 2023-05-08T14:28:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38649.008634 secs 2023-05-08T14:28:30.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:30 smithi133 ceph-mon[125939]: pgmap v20667: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T14:28:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:30 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:28:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:30 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:28:31.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:30 smithi096 ceph-mon[124666]: pgmap v20667: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T14:28:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:30 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:28:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:30 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:28:31.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:30 smithi186 ceph-mon[126480]: pgmap v20667: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T14:28:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:30 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:28:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:30 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:28:31.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38650.350418 secs 2023-05-08T14:28:32.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38650.350418 secs 2023-05-08T14:28:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38650.350418 secs 2023-05-08T14:28:32.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:32 smithi133 ceph-mon[125939]: pgmap v20668: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 9 op/s 2023-05-08T14:28:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:32 smithi096 ceph-mon[124666]: pgmap v20668: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 9 op/s 2023-05-08T14:28:33.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:32 smithi186 ceph-mon[126480]: pgmap v20668: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 9 op/s 2023-05-08T14:28:33.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:33 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:28:34.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:33 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:28:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:33 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:28:34.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:34 smithi133 ceph-mon[125939]: pgmap v20669: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 9 op/s 2023-05-08T14:28:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38653.455421 secs 2023-05-08T14:28:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38654.008757 secs 2023-05-08T14:28:35.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:34 smithi096 ceph-mon[124666]: pgmap v20669: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 9 op/s 2023-05-08T14:28:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38653.455421 secs 2023-05-08T14:28:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38654.008757 secs 2023-05-08T14:28:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:34 smithi186 ceph-mon[126480]: pgmap v20669: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 9 op/s 2023-05-08T14:28:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38653.455421 secs 2023-05-08T14:28:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38654.008757 secs 2023-05-08T14:28:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38655.350555 secs 2023-05-08T14:28:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38655.350555 secs 2023-05-08T14:28:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38655.350555 secs 2023-05-08T14:28:36.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:36 smithi133 ceph-mon[125939]: pgmap v20670: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2023-05-08T14:28:37.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:36 smithi096 ceph-mon[124666]: pgmap v20670: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2023-05-08T14:28:37.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:36 smithi186 ceph-mon[126480]: pgmap v20670: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2023-05-08T14:28:38.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:38 smithi133 ceph-mon[125939]: pgmap v20671: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 511 KiB/s wr, 8 op/s 2023-05-08T14:28:39.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:38 smithi096 ceph-mon[124666]: pgmap v20671: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 511 KiB/s wr, 8 op/s 2023-05-08T14:28:39.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:38 smithi186 ceph-mon[126480]: pgmap v20671: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 511 KiB/s wr, 8 op/s 2023-05-08T14:28:39.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38658.455502 secs 2023-05-08T14:28:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38659.008874 secs 2023-05-08T14:28:40.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38658.455502 secs 2023-05-08T14:28:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38659.008874 secs 2023-05-08T14:28:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38658.455502 secs 2023-05-08T14:28:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38659.008874 secs 2023-05-08T14:28:40.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:40 smithi133 ceph-mon[125939]: pgmap v20672: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 858 KiB/s rd, 855 KiB/s wr, 11 op/s 2023-05-08T14:28:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38660.350700 secs 2023-05-08T14:28:41.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:40 smithi096 ceph-mon[124666]: pgmap v20672: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 858 KiB/s rd, 855 KiB/s wr, 11 op/s 2023-05-08T14:28:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38660.350700 secs 2023-05-08T14:28:41.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:40 smithi186 ceph-mon[126480]: pgmap v20672: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 858 KiB/s rd, 855 KiB/s wr, 11 op/s 2023-05-08T14:28:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38660.350700 secs 2023-05-08T14:28:42.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:42 smithi133 ceph-mon[125939]: pgmap v20673: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 686 KiB/s rd, 683 KiB/s wr, 8 op/s 2023-05-08T14:28:43.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:42 smithi096 ceph-mon[124666]: pgmap v20673: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 686 KiB/s rd, 683 KiB/s wr, 8 op/s 2023-05-08T14:28:43.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:42 smithi186 ceph-mon[126480]: pgmap v20673: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 686 KiB/s rd, 683 KiB/s wr, 8 op/s 2023-05-08T14:28:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:44 smithi186 ceph-mon[126480]: pgmap v20674: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 685 KiB/s rd, 683 KiB/s wr, 7 op/s 2023-05-08T14:28:44.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38663.455617 secs 2023-05-08T14:28:44.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:44 smithi133 ceph-mon[125939]: pgmap v20674: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 685 KiB/s rd, 683 KiB/s wr, 7 op/s 2023-05-08T14:28:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38663.455617 secs 2023-05-08T14:28:44.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:44 smithi096 ceph-mon[124666]: pgmap v20674: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 685 KiB/s rd, 683 KiB/s wr, 7 op/s 2023-05-08T14:28:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38663.455617 secs 2023-05-08T14:28:45.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38664.009005 secs 2023-05-08T14:28:45.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38664.009005 secs 2023-05-08T14:28:45.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38664.009005 secs 2023-05-08T14:28:46.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:46 smithi133 ceph-mon[125939]: pgmap v20675: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 996 KiB/s rd, 997 KiB/s wr, 11 op/s 2023-05-08T14:28:46.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:46 smithi096 ceph-mon[124666]: pgmap v20675: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 996 KiB/s rd, 997 KiB/s wr, 11 op/s 2023-05-08T14:28:46.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:46 smithi186 ceph-mon[126480]: pgmap v20675: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 996 KiB/s rd, 997 KiB/s wr, 11 op/s 2023-05-08T14:28:48.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:48 smithi133 ceph-mon[125939]: pgmap v20676: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 655 KiB/s rd, 658 KiB/s wr, 7 op/s 2023-05-08T14:28:49.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:48 smithi096 ceph-mon[124666]: pgmap v20676: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 655 KiB/s rd, 658 KiB/s wr, 7 op/s 2023-05-08T14:28:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:48 smithi186 ceph-mon[126480]: pgmap v20676: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 655 KiB/s rd, 658 KiB/s wr, 7 op/s 2023-05-08T14:28:49.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38668.455714 secs 2023-05-08T14:28:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:28:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38669.009122 secs 2023-05-08T14:28:50.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38668.455714 secs 2023-05-08T14:28:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:28:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38669.009122 secs 2023-05-08T14:28:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38668.455714 secs 2023-05-08T14:28:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:28:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38669.009122 secs 2023-05-08T14:28:50.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:50 smithi133 ceph-mon[125939]: pgmap v20677: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1001 KiB/s wr, 10 op/s 2023-05-08T14:28:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:28:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:28:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:28:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:50 smithi096 ceph-mon[124666]: pgmap v20677: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1001 KiB/s wr, 10 op/s 2023-05-08T14:28:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:28:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:28:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:28:51.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:50 smithi186 ceph-mon[126480]: pgmap v20677: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1001 KiB/s wr, 10 op/s 2023-05-08T14:28:51.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:28:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:28:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:28:52.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:52 smithi133 ceph-mon[125939]: pgmap v20678: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 808 KiB/s rd, 657 KiB/s wr, 8 op/s 2023-05-08T14:28:53.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:52 smithi096 ceph-mon[124666]: pgmap v20678: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 808 KiB/s rd, 657 KiB/s wr, 8 op/s 2023-05-08T14:28:53.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:52 smithi186 ceph-mon[126480]: pgmap v20678: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 808 KiB/s rd, 657 KiB/s wr, 8 op/s 2023-05-08T14:28:53.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:53 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:28:54.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:53 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:28:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:53 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:28:54.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:54 smithi133 ceph-mon[125939]: pgmap v20679: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 807 KiB/s rd, 657 KiB/s wr, 7 op/s 2023-05-08T14:28:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38673.455797 secs 2023-05-08T14:28:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:28:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:28:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:28:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:54 smithi096 ceph-mon[124666]: pgmap v20679: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 807 KiB/s rd, 657 KiB/s wr, 7 op/s 2023-05-08T14:28:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38673.455797 secs 2023-05-08T14:28:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:28:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:28:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:28:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:54 smithi186 ceph-mon[126480]: pgmap v20679: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 807 KiB/s rd, 657 KiB/s wr, 7 op/s 2023-05-08T14:28:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38673.455797 secs 2023-05-08T14:28:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:28:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:28:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:28:55.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:55 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:28:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:55 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T14:28:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:55 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T14:28:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:55 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:28:56.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:55 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:28:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:55 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T14:28:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:55 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T14:28:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:55 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:28:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:55 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:28:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:55 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T14:28:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:55 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T14:28:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:55 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:28:56.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:56 smithi133 ceph-mon[125939]: pgmap v20680: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T14:28:57.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:56 smithi096 ceph-mon[124666]: pgmap v20680: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T14:28:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:56 smithi186 ceph-mon[126480]: pgmap v20680: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T14:28:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:28:58.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:28:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:28:58.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:58 smithi133 ceph-mon[125939]: pgmap v20681: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 888 KiB/s wr, 8 op/s 2023-05-08T14:28:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:58 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:28:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:28:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:28:59.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:58 smithi096 ceph-mon[124666]: pgmap v20681: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 888 KiB/s wr, 8 op/s 2023-05-08T14:28:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:58 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:28:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:28:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:28:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:58 smithi186 ceph-mon[126480]: pgmap v20681: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 888 KiB/s wr, 8 op/s 2023-05-08T14:28:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:58 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:28:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:28:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:28:59.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:28:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38678.455918 secs 2023-05-08T14:29:00.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:28:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38678.455918 secs 2023-05-08T14:29:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:28:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38678.455918 secs 2023-05-08T14:29:00.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:00 smithi133 ceph-mon[125939]: pgmap v20682: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T14:29:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38680.351265 secs 2023-05-08T14:29:01.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:00 smithi096 ceph-mon[124666]: pgmap v20682: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T14:29:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38680.351265 secs 2023-05-08T14:29:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:00 smithi186 ceph-mon[126480]: pgmap v20682: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T14:29:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38680.351265 secs 2023-05-08T14:29:02.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:02 smithi133 ceph-mon[125939]: pgmap v20683: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T14:29:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:29:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:29:03.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:02 smithi096 ceph-mon[124666]: pgmap v20683: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T14:29:03.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:29:03.008 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:29:03.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:02 smithi186 ceph-mon[126480]: pgmap v20683: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T14:29:03.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:29:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:29:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:03 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:29:04.009 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:03 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:29:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:03 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:29:04.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:04 smithi133 ceph-mon[125939]: pgmap v20684: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T14:29:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:04 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:29:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38684.009504 secs 2023-05-08T14:29:05.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:04 smithi096 ceph-mon[124666]: pgmap v20684: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T14:29:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:04 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:29:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38684.009504 secs 2023-05-08T14:29:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:04 smithi186 ceph-mon[126480]: pgmap v20684: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T14:29:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:04 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:29:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38684.009504 secs 2023-05-08T14:29:05.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T14:29:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:29:06.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T14:29:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:29:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T14:29:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:29:06.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:06 smithi133 ceph-mon[125939]: pgmap v20685: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.9 MiB/s wr, 27 op/s 2023-05-08T14:29:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:29:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:29:07.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:06 smithi096 ceph-mon[124666]: pgmap v20685: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.9 MiB/s wr, 27 op/s 2023-05-08T14:29:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:29:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:29:07.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:06 smithi186 ceph-mon[126480]: pgmap v20685: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.9 MiB/s wr, 27 op/s 2023-05-08T14:29:07.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:29:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:29:09.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:08 smithi096 ceph-mon[124666]: pgmap v20686: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.4 MiB/s wr, 23 op/s 2023-05-08T14:29:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:08 smithi186 ceph-mon[126480]: pgmap v20686: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.4 MiB/s wr, 23 op/s 2023-05-08T14:29:09.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:08 smithi133 ceph-mon[125939]: pgmap v20686: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.4 MiB/s wr, 23 op/s 2023-05-08T14:29:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:09 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:29:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38689.009632 secs 2023-05-08T14:29:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:09 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:29:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38689.009632 secs 2023-05-08T14:29:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:09 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:29:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38689.009632 secs 2023-05-08T14:29:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:10 smithi096 ceph-mon[124666]: pgmap v20687: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.4 MiB/s wr, 27 op/s 2023-05-08T14:29:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:10 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:29:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:10 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:29:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:10 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:29:11.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:10 smithi186 ceph-mon[126480]: pgmap v20687: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.4 MiB/s wr, 27 op/s 2023-05-08T14:29:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:10 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:29:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:10 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:29:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:10 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:29:11.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:10 smithi133 ceph-mon[125939]: pgmap v20687: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.4 MiB/s wr, 27 op/s 2023-05-08T14:29:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:10 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:29:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:10 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:29:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:10 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:29:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:11 smithi186 ceph-mon[126480]: pgmap v20688: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 23 op/s 2023-05-08T14:29:12.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:11 smithi133 ceph-mon[125939]: pgmap v20688: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 23 op/s 2023-05-08T14:29:12.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:11 smithi096 ceph-mon[124666]: pgmap v20688: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 23 op/s 2023-05-08T14:29:14.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:14 smithi133 ceph-mon[125939]: pgmap v20689: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 913 KiB/s rd, 832 KiB/s wr, 22 op/s 2023-05-08T14:29:14.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:14 smithi096 ceph-mon[124666]: pgmap v20689: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 913 KiB/s rd, 832 KiB/s wr, 22 op/s 2023-05-08T14:29:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:14 smithi186 ceph-mon[126480]: pgmap v20689: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 913 KiB/s rd, 832 KiB/s wr, 22 op/s 2023-05-08T14:29:15.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38694.009758 secs 2023-05-08T14:29:15.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38694.009758 secs 2023-05-08T14:29:15.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38694.009758 secs 2023-05-08T14:29:16.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:16 smithi133 ceph-mon[125939]: pgmap v20690: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 25 op/s 2023-05-08T14:29:16.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:16 smithi096 ceph-mon[124666]: pgmap v20690: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 25 op/s 2023-05-08T14:29:16.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:16 smithi186 ceph-mon[126480]: pgmap v20690: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 25 op/s 2023-05-08T14:29:18.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:18 smithi133 ceph-mon[125939]: pgmap v20691: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 540 KiB/s wr, 7 op/s 2023-05-08T14:29:19.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:18 smithi096 ceph-mon[124666]: pgmap v20691: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 540 KiB/s wr, 7 op/s 2023-05-08T14:29:19.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:18 smithi186 ceph-mon[126480]: pgmap v20691: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 540 KiB/s wr, 7 op/s 2023-05-08T14:29:19.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38699.009882 secs 2023-05-08T14:29:20.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38699.009882 secs 2023-05-08T14:29:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38699.009882 secs 2023-05-08T14:29:20.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:20 smithi133 ceph-mon[125939]: pgmap v20692: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 543 KiB/s rd, 540 KiB/s wr, 11 op/s 2023-05-08T14:29:21.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:20 smithi096 ceph-mon[124666]: pgmap v20692: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 543 KiB/s rd, 540 KiB/s wr, 11 op/s 2023-05-08T14:29:21.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:20 smithi186 ceph-mon[126480]: pgmap v20692: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 543 KiB/s rd, 540 KiB/s wr, 11 op/s 2023-05-08T14:29:22.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:22 smithi133 ceph-mon[125939]: pgmap v20693: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 540 KiB/s rd, 537 KiB/s wr, 8 op/s 2023-05-08T14:29:23.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:22 smithi096 ceph-mon[124666]: pgmap v20693: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 540 KiB/s rd, 537 KiB/s wr, 8 op/s 2023-05-08T14:29:23.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:22 smithi186 ceph-mon[126480]: pgmap v20693: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 540 KiB/s rd, 537 KiB/s wr, 8 op/s 2023-05-08T14:29:24.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:24 smithi133 ceph-mon[125939]: pgmap v20694: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 537 KiB/s wr, 7 op/s 2023-05-08T14:29:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38703.456463 secs 2023-05-08T14:29:24.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:24 smithi096 ceph-mon[124666]: pgmap v20694: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 537 KiB/s wr, 7 op/s 2023-05-08T14:29:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38703.456463 secs 2023-05-08T14:29:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:24 smithi186 ceph-mon[126480]: pgmap v20694: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 537 KiB/s wr, 7 op/s 2023-05-08T14:29:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38703.456463 secs 2023-05-08T14:29:25.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:25 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:29:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:25 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T14:29:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:25 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:29:25.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:25 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:29:25.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:25 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:29:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:25 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T14:29:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:25 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:29:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:25 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:29:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:25 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:29:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:25 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T14:29:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:25 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:29:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:25 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:29:26.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:26 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:29:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:26 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:29:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:26 smithi133 ceph-mon[125939]: pgmap v20695: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 14 op/s 2023-05-08T14:29:26.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:26 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:29:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:26 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:29:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:26 smithi096 ceph-mon[124666]: pgmap v20695: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 14 op/s 2023-05-08T14:29:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:26 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:29:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:26 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:29:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:26 smithi186 ceph-mon[126480]: pgmap v20695: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 14 op/s 2023-05-08T14:29:27.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:27 smithi133 ceph-mon[125939]: osdmap e1370: 12 total, 12 up, 12 in 2023-05-08T14:29:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:27 smithi096 ceph-mon[124666]: osdmap e1370: 12 total, 12 up, 12 in 2023-05-08T14:29:27.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:27 smithi186 ceph-mon[126480]: osdmap e1370: 12 total, 12 up, 12 in 2023-05-08T14:29:28.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:28 smithi133 ceph-mon[125939]: pgmap v20697: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T14:29:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:28 smithi096 ceph-mon[124666]: pgmap v20697: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T14:29:28.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:28 smithi186 ceph-mon[126480]: pgmap v20697: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T14:29:29.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38708.456580 secs 2023-05-08T14:29:29.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38708.456580 secs 2023-05-08T14:29:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38708.456580 secs 2023-05-08T14:29:30.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:30 smithi133 ceph-mon[125939]: pgmap v20698: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 14 op/s 2023-05-08T14:29:30.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:30 smithi096 ceph-mon[124666]: pgmap v20698: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 14 op/s 2023-05-08T14:29:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:30 smithi186 ceph-mon[126480]: pgmap v20698: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 14 op/s 2023-05-08T14:29:32.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:32 smithi133 ceph-mon[125939]: pgmap v20699: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 14 op/s 2023-05-08T14:29:33.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:32 smithi096 ceph-mon[124666]: pgmap v20699: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 14 op/s 2023-05-08T14:29:33.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:32 smithi186 ceph-mon[126480]: pgmap v20699: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 14 op/s 2023-05-08T14:29:33.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:33 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:29:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:33 smithi133 ceph-mon[125939]: osdmap e1371: 12 total, 12 up, 12 in 2023-05-08T14:29:34.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:33 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:29:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:33 smithi096 ceph-mon[124666]: osdmap e1371: 12 total, 12 up, 12 in 2023-05-08T14:29:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:33 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:29:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:33 smithi186 ceph-mon[126480]: osdmap e1371: 12 total, 12 up, 12 in 2023-05-08T14:29:34.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:34 smithi133 ceph-mon[125939]: pgmap v20701: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 558 KiB/s wr, 7 op/s 2023-05-08T14:29:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38713.456688 secs 2023-05-08T14:29:35.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:34 smithi096 ceph-mon[124666]: pgmap v20701: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 558 KiB/s wr, 7 op/s 2023-05-08T14:29:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38713.456688 secs 2023-05-08T14:29:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:34 smithi186 ceph-mon[126480]: pgmap v20701: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 558 KiB/s wr, 7 op/s 2023-05-08T14:29:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38713.456688 secs 2023-05-08T14:29:36.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:36 smithi133 ceph-mon[125939]: pgmap v20702: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 804 KiB/s rd, 698 KiB/s wr, 11 op/s 2023-05-08T14:29:37.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:36 smithi096 ceph-mon[124666]: pgmap v20702: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 804 KiB/s rd, 698 KiB/s wr, 11 op/s 2023-05-08T14:29:37.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:36 smithi186 ceph-mon[126480]: pgmap v20702: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 804 KiB/s rd, 698 KiB/s wr, 11 op/s 2023-05-08T14:29:38.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:38 smithi133 ceph-mon[125939]: pgmap v20703: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 744 KiB/s rd, 646 KiB/s wr, 10 op/s 2023-05-08T14:29:39.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:38 smithi096 ceph-mon[124666]: pgmap v20703: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 744 KiB/s rd, 646 KiB/s wr, 10 op/s 2023-05-08T14:29:39.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:38 smithi186 ceph-mon[126480]: pgmap v20703: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 744 KiB/s rd, 646 KiB/s wr, 10 op/s 2023-05-08T14:29:39.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38718.456819 secs 2023-05-08T14:29:40.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38718.456819 secs 2023-05-08T14:29:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38718.456819 secs 2023-05-08T14:29:40.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:40 smithi133 ceph-mon[125939]: pgmap v20704: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 205 KiB/s wr, 9 op/s 2023-05-08T14:29:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38720.352243 secs 2023-05-08T14:29:41.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:40 smithi096 ceph-mon[124666]: pgmap v20704: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 205 KiB/s wr, 9 op/s 2023-05-08T14:29:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38720.352243 secs 2023-05-08T14:29:41.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:40 smithi186 ceph-mon[126480]: pgmap v20704: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 205 KiB/s wr, 9 op/s 2023-05-08T14:29:41.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38720.352243 secs 2023-05-08T14:29:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:41 smithi186 ceph-mon[126480]: pgmap v20705: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 546 KiB/s rd, 544 KiB/s wr, 10 op/s 2023-05-08T14:29:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:41 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:29:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:41 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:29:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:41 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:29:42.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:41 smithi133 ceph-mon[125939]: pgmap v20705: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 546 KiB/s rd, 544 KiB/s wr, 10 op/s 2023-05-08T14:29:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:41 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:29:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:41 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:29:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:41 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:29:42.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:41 smithi096 ceph-mon[124666]: pgmap v20705: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 546 KiB/s rd, 544 KiB/s wr, 10 op/s 2023-05-08T14:29:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:41 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:29:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:41 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:29:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:41 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:29:44.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:44 smithi133 ceph-mon[125939]: pgmap v20706: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 529 KiB/s wr, 10 op/s 2023-05-08T14:29:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38723.456940 secs 2023-05-08T14:29:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:44 smithi096 ceph-mon[124666]: pgmap v20706: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 529 KiB/s wr, 10 op/s 2023-05-08T14:29:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38723.456940 secs 2023-05-08T14:29:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:44 smithi186 ceph-mon[126480]: pgmap v20706: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 529 KiB/s wr, 10 op/s 2023-05-08T14:29:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38723.456940 secs 2023-05-08T14:29:45.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38724.010521 secs 2023-05-08T14:29:45.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38724.010521 secs 2023-05-08T14:29:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38724.010521 secs 2023-05-08T14:29:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:46 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:29:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:46 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:29:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:46 smithi133 ceph-mon[125939]: pgmap v20707: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 14 op/s 2023-05-08T14:29:46.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:46 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:29:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:46 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:29:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:46 smithi096 ceph-mon[124666]: pgmap v20707: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 14 op/s 2023-05-08T14:29:46.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:46 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:29:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:46 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:29:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:46 smithi186 ceph-mon[126480]: pgmap v20707: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 14 op/s 2023-05-08T14:29:48.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:48 smithi133 ceph-mon[125939]: pgmap v20708: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.4 MiB/s wr, 10 op/s 2023-05-08T14:29:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:48 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:29:49.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:48 smithi096 ceph-mon[124666]: pgmap v20708: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.4 MiB/s wr, 10 op/s 2023-05-08T14:29:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:48 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:29:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:48 smithi186 ceph-mon[126480]: pgmap v20708: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.4 MiB/s wr, 10 op/s 2023-05-08T14:29:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:48 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:29:49.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38728.457075 secs 2023-05-08T14:29:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:29:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38729.010614 secs 2023-05-08T14:29:50.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38728.457075 secs 2023-05-08T14:29:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:29:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38729.010614 secs 2023-05-08T14:29:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38728.457075 secs 2023-05-08T14:29:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:29:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38729.010614 secs 2023-05-08T14:29:50.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:50 smithi133 ceph-mon[125939]: pgmap v20709: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 15 op/s 2023-05-08T14:29:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:29:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:29:51.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:50 smithi096 ceph-mon[124666]: pgmap v20709: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 15 op/s 2023-05-08T14:29:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:29:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:29:51.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:50 smithi186 ceph-mon[126480]: pgmap v20709: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 15 op/s 2023-05-08T14:29:51.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:29:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:29:52.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:52 smithi133 ceph-mon[125939]: pgmap v20710: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 12 op/s 2023-05-08T14:29:53.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:52 smithi096 ceph-mon[124666]: pgmap v20710: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 12 op/s 2023-05-08T14:29:53.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:52 smithi186 ceph-mon[126480]: pgmap v20710: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 12 op/s 2023-05-08T14:29:53.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:53 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:29:54.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:53 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:29:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:53 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:29:54.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:54 smithi133 ceph-mon[125939]: pgmap v20711: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 10 op/s 2023-05-08T14:29:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38733.457147 secs 2023-05-08T14:29:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:29:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:29:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:29:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:29:55.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:54 smithi096 ceph-mon[124666]: pgmap v20711: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 10 op/s 2023-05-08T14:29:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38733.457147 secs 2023-05-08T14:29:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:29:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:29:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:29:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:29:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:54 smithi186 ceph-mon[126480]: pgmap v20711: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 10 op/s 2023-05-08T14:29:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38733.457147 secs 2023-05-08T14:29:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:29:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:29:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:29:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:29:55.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:55 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:29:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:55 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T14:29:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:55 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T14:29:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:55 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:29:56.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:55 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:29:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:55 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T14:29:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:55 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T14:29:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:55 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:29:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:55 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:29:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:55 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T14:29:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:55 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T14:29:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:55 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:29:56.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:56 smithi133 ceph-mon[125939]: pgmap v20712: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.4 MiB/s wr, 17 op/s 2023-05-08T14:29:57.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:56 smithi096 ceph-mon[124666]: pgmap v20712: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.4 MiB/s wr, 17 op/s 2023-05-08T14:29:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:56 smithi186 ceph-mon[126480]: pgmap v20712: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.4 MiB/s wr, 17 op/s 2023-05-08T14:29:57.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:29:58.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:29:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:29:58.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:58 smithi133 ceph-mon[125939]: pgmap v20713: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T14:29:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:29:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:29:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:58 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:29:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:58 smithi096 ceph-mon[124666]: pgmap v20713: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T14:29:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:29:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:29:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:58 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:29:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:58 smithi186 ceph-mon[126480]: pgmap v20713: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T14:29:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:29:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:29:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:58 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:29:59.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38738.457286 secs 2023-05-08T14:29:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:29:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38739.010821 secs 2023-05-08T14:30:00.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38738.457286 secs 2023-05-08T14:30:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:29:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38739.010821 secs 2023-05-08T14:30:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38738.457286 secs 2023-05-08T14:30:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:29:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38739.010821 secs 2023-05-08T14:30:00.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:00 smithi133 ceph-mon[125939]: pgmap v20714: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.7 MiB/s wr, 16 op/s 2023-05-08T14:30:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:00 smithi133 ceph-mon[125939]: overall HEALTH_WARN 1 MDSs report slow requests 2023-05-08T14:30:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38740.352761 secs 2023-05-08T14:30:01.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:00 smithi096 ceph-mon[124666]: pgmap v20714: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.7 MiB/s wr, 16 op/s 2023-05-08T14:30:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:00 smithi096 ceph-mon[124666]: overall HEALTH_WARN 1 MDSs report slow requests 2023-05-08T14:30:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38740.352761 secs 2023-05-08T14:30:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:00 smithi186 ceph-mon[126480]: pgmap v20714: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.7 MiB/s wr, 16 op/s 2023-05-08T14:30:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:00 smithi186 ceph-mon[126480]: overall HEALTH_WARN 1 MDSs report slow requests 2023-05-08T14:30:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38740.352761 secs 2023-05-08T14:30:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:02 smithi096 ceph-mon[124666]: pgmap v20715: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.2 MiB/s wr, 12 op/s 2023-05-08T14:30:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:30:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:30:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:30:03.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:02 smithi186 ceph-mon[126480]: pgmap v20715: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.2 MiB/s wr, 12 op/s 2023-05-08T14:30:03.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:30:03.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:30:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:30:03.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:02 smithi133 ceph-mon[125939]: pgmap v20715: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.2 MiB/s wr, 12 op/s 2023-05-08T14:30:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:30:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:30:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:30:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:03 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:30:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:03 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:30:04.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:03 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:30:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:04 smithi096 ceph-mon[124666]: pgmap v20716: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.2 MiB/s wr, 12 op/s 2023-05-08T14:30:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38743.457405 secs 2023-05-08T14:30:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:04 smithi186 ceph-mon[126480]: pgmap v20716: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.2 MiB/s wr, 12 op/s 2023-05-08T14:30:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38743.457405 secs 2023-05-08T14:30:05.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:04 smithi133 ceph-mon[125939]: pgmap v20716: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.2 MiB/s wr, 12 op/s 2023-05-08T14:30:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38743.457405 secs 2023-05-08T14:30:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:05 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:30:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:05 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:30:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:05 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:30:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:06 smithi096 ceph-mon[124666]: pgmap v20717: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.5 MiB/s wr, 31 op/s 2023-05-08T14:30:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:30:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:30:07.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:06 smithi186 ceph-mon[126480]: pgmap v20717: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.5 MiB/s wr, 31 op/s 2023-05-08T14:30:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:30:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:30:07.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:06 smithi133 ceph-mon[125939]: pgmap v20717: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.5 MiB/s wr, 31 op/s 2023-05-08T14:30:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:30:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:30:08.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:07 smithi186 ceph-mon[126480]: pgmap v20718: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 24 op/s 2023-05-08T14:30:08.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:07 smithi133 ceph-mon[125939]: pgmap v20718: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 24 op/s 2023-05-08T14:30:08.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:07 smithi096 ceph-mon[124666]: pgmap v20718: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 24 op/s 2023-05-08T14:30:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:08 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:30:09.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:08 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:30:09.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:08 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:30:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38748.457470 secs 2023-05-08T14:30:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:09 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:30:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:09 smithi186 ceph-mon[126480]: pgmap v20719: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.5 MiB/s wr, 28 op/s 2023-05-08T14:30:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38748.457470 secs 2023-05-08T14:30:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:09 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:30:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:09 smithi133 ceph-mon[125939]: pgmap v20719: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.5 MiB/s wr, 28 op/s 2023-05-08T14:30:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38748.457470 secs 2023-05-08T14:30:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:09 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:30:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:09 smithi096 ceph-mon[124666]: pgmap v20719: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.5 MiB/s wr, 28 op/s 2023-05-08T14:30:11.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:10 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:30:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:10 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:30:11.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:10 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:30:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:10 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:30:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:10 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:30:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:10 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:30:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:11 smithi186 ceph-mon[126480]: pgmap v20720: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.1 MiB/s wr, 24 op/s 2023-05-08T14:30:12.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:11 smithi133 ceph-mon[125939]: pgmap v20720: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.1 MiB/s wr, 24 op/s 2023-05-08T14:30:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:11 smithi096 ceph-mon[124666]: pgmap v20720: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.1 MiB/s wr, 24 op/s 2023-05-08T14:30:13.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:13 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:30:13.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:13 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:30:13.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:13 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:30:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:14 smithi133 ceph-mon[125939]: pgmap v20721: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.1 MiB/s wr, 23 op/s 2023-05-08T14:30:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38753.457589 secs 2023-05-08T14:30:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:14 smithi096 ceph-mon[124666]: pgmap v20721: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.1 MiB/s wr, 23 op/s 2023-05-08T14:30:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38753.457589 secs 2023-05-08T14:30:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:14 smithi186 ceph-mon[126480]: pgmap v20721: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.1 MiB/s wr, 23 op/s 2023-05-08T14:30:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38753.457589 secs 2023-05-08T14:30:16.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:16 smithi133 ceph-mon[125939]: pgmap v20722: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 1.5 MiB/s wr, 27 op/s 2023-05-08T14:30:17.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:16 smithi096 ceph-mon[124666]: pgmap v20722: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 1.5 MiB/s wr, 27 op/s 2023-05-08T14:30:17.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:16 smithi186 ceph-mon[126480]: pgmap v20722: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 1.5 MiB/s wr, 27 op/s 2023-05-08T14:30:18.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:18 smithi133 ceph-mon[125939]: pgmap v20723: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1001 KiB/s rd, 1.1 MiB/s wr, 8 op/s 2023-05-08T14:30:19.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:18 smithi096 ceph-mon[124666]: pgmap v20723: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1001 KiB/s rd, 1.1 MiB/s wr, 8 op/s 2023-05-08T14:30:19.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:18 smithi186 ceph-mon[126480]: pgmap v20723: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1001 KiB/s rd, 1.1 MiB/s wr, 8 op/s 2023-05-08T14:30:19.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38758.457658 secs 2023-05-08T14:30:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38758.457658 secs 2023-05-08T14:30:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38758.457658 secs 2023-05-08T14:30:20.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:20 smithi133 ceph-mon[125939]: pgmap v20724: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2023-05-08T14:30:21.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:20 smithi096 ceph-mon[124666]: pgmap v20724: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2023-05-08T14:30:21.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:20 smithi186 ceph-mon[126480]: pgmap v20724: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2023-05-08T14:30:22.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:22 smithi133 ceph-mon[125939]: pgmap v20725: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 829 KiB/s rd, 654 KiB/s wr, 8 op/s 2023-05-08T14:30:23.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:22 smithi096 ceph-mon[124666]: pgmap v20725: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 829 KiB/s rd, 654 KiB/s wr, 8 op/s 2023-05-08T14:30:23.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:22 smithi186 ceph-mon[126480]: pgmap v20725: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 829 KiB/s rd, 654 KiB/s wr, 8 op/s 2023-05-08T14:30:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:24 smithi133 ceph-mon[125939]: pgmap v20726: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 829 KiB/s rd, 654 KiB/s wr, 8 op/s 2023-05-08T14:30:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38763.457782 secs 2023-05-08T14:30:24.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:24 smithi096 ceph-mon[124666]: pgmap v20726: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 829 KiB/s rd, 654 KiB/s wr, 8 op/s 2023-05-08T14:30:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38763.457782 secs 2023-05-08T14:30:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:24 smithi186 ceph-mon[126480]: pgmap v20726: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 829 KiB/s rd, 654 KiB/s wr, 8 op/s 2023-05-08T14:30:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38763.457782 secs 2023-05-08T14:30:25.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38764.011447 secs 2023-05-08T14:30:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38764.011447 secs 2023-05-08T14:30:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38764.011447 secs 2023-05-08T14:30:26.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:26 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:30:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:26 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:30:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:26 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:30:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38765.353293 secs 2023-05-08T14:30:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:26 smithi133 ceph-mon[125939]: pgmap v20727: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 16 op/s 2023-05-08T14:30:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:26 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:30:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:26 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:30:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:26 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:30:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38765.353293 secs 2023-05-08T14:30:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:26 smithi096 ceph-mon[124666]: pgmap v20727: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 16 op/s 2023-05-08T14:30:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:26 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:30:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:26 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:30:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:26 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:30:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38765.353293 secs 2023-05-08T14:30:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:26 smithi186 ceph-mon[126480]: pgmap v20727: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 16 op/s 2023-05-08T14:30:27.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:27 smithi133 ceph-mon[125939]: osdmap e1372: 12 total, 12 up, 12 in 2023-05-08T14:30:27.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:27 smithi096 ceph-mon[124666]: osdmap e1372: 12 total, 12 up, 12 in 2023-05-08T14:30:27.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:27 smithi186 ceph-mon[126480]: osdmap e1372: 12 total, 12 up, 12 in 2023-05-08T14:30:28.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:28 smithi133 ceph-mon[125939]: pgmap v20729: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.6 MiB/s wr, 15 op/s 2023-05-08T14:30:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:28 smithi096 ceph-mon[124666]: pgmap v20729: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.6 MiB/s wr, 15 op/s 2023-05-08T14:30:28.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:28 smithi186 ceph-mon[126480]: pgmap v20729: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.6 MiB/s wr, 15 op/s 2023-05-08T14:30:29.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38768.457902 secs 2023-05-08T14:30:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38769.011565 secs 2023-05-08T14:30:29.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38768.457902 secs 2023-05-08T14:30:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38769.011565 secs 2023-05-08T14:30:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38768.457902 secs 2023-05-08T14:30:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38769.011565 secs 2023-05-08T14:30:30.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:30 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:30:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:30 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:30:30.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:30 smithi133 ceph-mon[125939]: pgmap v20730: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2023-05-08T14:30:30.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:30 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:30:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:30 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:30:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:30 smithi096 ceph-mon[124666]: pgmap v20730: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2023-05-08T14:30:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:30 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:30:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:30 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:30:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:30 smithi186 ceph-mon[126480]: pgmap v20730: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2023-05-08T14:30:31.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38770.353418 secs 2023-05-08T14:30:31.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38770.353418 secs 2023-05-08T14:30:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38770.353418 secs 2023-05-08T14:30:32.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:32 smithi133 ceph-mon[125939]: pgmap v20731: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2023-05-08T14:30:32.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:32 smithi096 ceph-mon[124666]: pgmap v20731: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2023-05-08T14:30:32.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:32 smithi186 ceph-mon[126480]: pgmap v20731: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2023-05-08T14:30:33.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:33 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:30:33.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:33 smithi133 ceph-mon[125939]: osdmap e1373: 12 total, 12 up, 12 in 2023-05-08T14:30:33.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:33 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:30:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:33 smithi096 ceph-mon[124666]: osdmap e1373: 12 total, 12 up, 12 in 2023-05-08T14:30:33.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:33 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:30:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:33 smithi186 ceph-mon[126480]: osdmap e1373: 12 total, 12 up, 12 in 2023-05-08T14:30:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:34 smithi133 ceph-mon[125939]: pgmap v20733: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2023-05-08T14:30:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38773.458019 secs 2023-05-08T14:30:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38774.011645 secs 2023-05-08T14:30:34.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:34 smithi096 ceph-mon[124666]: pgmap v20733: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2023-05-08T14:30:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38773.458019 secs 2023-05-08T14:30:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38774.011645 secs 2023-05-08T14:30:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:34 smithi186 ceph-mon[126480]: pgmap v20733: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2023-05-08T14:30:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38773.458019 secs 2023-05-08T14:30:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38774.011645 secs 2023-05-08T14:30:36.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38775.353538 secs 2023-05-08T14:30:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:36 smithi133 ceph-mon[125939]: pgmap v20734: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 631 KiB/s rd, 629 KiB/s wr, 11 op/s 2023-05-08T14:30:37.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38775.353538 secs 2023-05-08T14:30:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:36 smithi096 ceph-mon[124666]: pgmap v20734: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 631 KiB/s rd, 629 KiB/s wr, 11 op/s 2023-05-08T14:30:37.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38775.353538 secs 2023-05-08T14:30:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:36 smithi186 ceph-mon[126480]: pgmap v20734: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 631 KiB/s rd, 629 KiB/s wr, 11 op/s 2023-05-08T14:30:38.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:38 smithi133 ceph-mon[125939]: pgmap v20735: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 584 KiB/s rd, 582 KiB/s wr, 10 op/s 2023-05-08T14:30:39.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:38 smithi096 ceph-mon[124666]: pgmap v20735: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 584 KiB/s rd, 582 KiB/s wr, 10 op/s 2023-05-08T14:30:39.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:38 smithi186 ceph-mon[126480]: pgmap v20735: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 584 KiB/s rd, 582 KiB/s wr, 10 op/s 2023-05-08T14:30:39.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38778.458155 secs 2023-05-08T14:30:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38779.011772 secs 2023-05-08T14:30:40.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38778.458155 secs 2023-05-08T14:30:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38779.011772 secs 2023-05-08T14:30:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38778.458155 secs 2023-05-08T14:30:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38779.011772 secs 2023-05-08T14:30:40.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:40 smithi133 ceph-mon[125939]: pgmap v20736: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 584 KiB/s rd, 997 KiB/s wr, 9 op/s 2023-05-08T14:30:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38780.353657 secs 2023-05-08T14:30:41.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:40 smithi096 ceph-mon[124666]: pgmap v20736: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 584 KiB/s rd, 997 KiB/s wr, 9 op/s 2023-05-08T14:30:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38780.353657 secs 2023-05-08T14:30:41.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:40 smithi186 ceph-mon[126480]: pgmap v20736: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 584 KiB/s rd, 997 KiB/s wr, 9 op/s 2023-05-08T14:30:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38780.353657 secs 2023-05-08T14:30:42.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:42 smithi133 ceph-mon[125939]: pgmap v20737: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 584 KiB/s rd, 997 KiB/s wr, 9 op/s 2023-05-08T14:30:43.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:42 smithi096 ceph-mon[124666]: pgmap v20737: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 584 KiB/s rd, 997 KiB/s wr, 9 op/s 2023-05-08T14:30:43.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:42 smithi186 ceph-mon[126480]: pgmap v20737: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 584 KiB/s rd, 997 KiB/s wr, 9 op/s 2023-05-08T14:30:44.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:44 smithi133 ceph-mon[125939]: pgmap v20738: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 568 KiB/s rd, 970 KiB/s wr, 9 op/s 2023-05-08T14:30:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38783.458301 secs 2023-05-08T14:30:44.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:44 smithi096 ceph-mon[124666]: pgmap v20738: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 568 KiB/s rd, 970 KiB/s wr, 9 op/s 2023-05-08T14:30:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38783.458301 secs 2023-05-08T14:30:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:44 smithi186 ceph-mon[126480]: pgmap v20738: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 568 KiB/s rd, 970 KiB/s wr, 9 op/s 2023-05-08T14:30:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38783.458301 secs 2023-05-08T14:30:45.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38784.011890 secs 2023-05-08T14:30:45.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38784.011890 secs 2023-05-08T14:30:45.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38784.011890 secs 2023-05-08T14:30:46.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:46 smithi133 ceph-mon[125939]: pgmap v20739: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 835 KiB/s rd, 831 KiB/s wr, 11 op/s 2023-05-08T14:30:46.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:46 smithi096 ceph-mon[124666]: pgmap v20739: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 835 KiB/s rd, 831 KiB/s wr, 11 op/s 2023-05-08T14:30:46.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:46 smithi186 ceph-mon[126480]: pgmap v20739: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 835 KiB/s rd, 831 KiB/s wr, 11 op/s 2023-05-08T14:30:48.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:48 smithi133 ceph-mon[125939]: pgmap v20740: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 347 KiB/s wr, 6 op/s 2023-05-08T14:30:49.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:48 smithi096 ceph-mon[124666]: pgmap v20740: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 347 KiB/s wr, 6 op/s 2023-05-08T14:30:49.037 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:48 smithi186 ceph-mon[126480]: pgmap v20740: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 347 KiB/s wr, 6 op/s 2023-05-08T14:30:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38788.458394 secs 2023-05-08T14:30:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:30:49.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38789.012027 secs 2023-05-08T14:30:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38788.458394 secs 2023-05-08T14:30:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:30:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38789.012027 secs 2023-05-08T14:30:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38788.458394 secs 2023-05-08T14:30:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:30:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38789.012027 secs 2023-05-08T14:30:50.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:50 smithi133 ceph-mon[125939]: pgmap v20741: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 696 KiB/s rd, 693 KiB/s wr, 10 op/s 2023-05-08T14:30:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:30:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:30:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:30:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:50 smithi096 ceph-mon[124666]: pgmap v20741: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 696 KiB/s rd, 693 KiB/s wr, 10 op/s 2023-05-08T14:30:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:30:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:30:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:30:51.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:50 smithi186 ceph-mon[126480]: pgmap v20741: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 696 KiB/s rd, 693 KiB/s wr, 10 op/s 2023-05-08T14:30:51.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:30:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:30:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:30:52.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:52 smithi133 ceph-mon[125939]: pgmap v20742: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 695 KiB/s rd, 346 KiB/s wr, 7 op/s 2023-05-08T14:30:53.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:52 smithi096 ceph-mon[124666]: pgmap v20742: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 695 KiB/s rd, 346 KiB/s wr, 7 op/s 2023-05-08T14:30:53.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:52 smithi186 ceph-mon[126480]: pgmap v20742: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 695 KiB/s rd, 346 KiB/s wr, 7 op/s 2023-05-08T14:30:54.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:54 smithi133 ceph-mon[125939]: pgmap v20743: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 695 KiB/s rd, 346 KiB/s wr, 6 op/s 2023-05-08T14:30:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38793.458512 secs 2023-05-08T14:30:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:54 smithi096 ceph-mon[124666]: pgmap v20743: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 695 KiB/s rd, 346 KiB/s wr, 6 op/s 2023-05-08T14:30:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38793.458512 secs 2023-05-08T14:30:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:54 smithi186 ceph-mon[126480]: pgmap v20743: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 695 KiB/s rd, 346 KiB/s wr, 6 op/s 2023-05-08T14:30:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38793.458512 secs 2023-05-08T14:30:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:55 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:30:55.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:55 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:30:55.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:55 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:30:55.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:55 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:30:55.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:55 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:30:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:55 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:30:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:55 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:30:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:55 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:30:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:55 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:30:55.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:55 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:30:55.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:55 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:30:55.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:55 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:30:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:55 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:30:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:55 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:30:55.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:55 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:30:56.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:30:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:30:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:56 smithi133 ceph-mon[125939]: pgmap v20744: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 926 KiB/s wr, 11 op/s 2023-05-08T14:30:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:30:56.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:30:56.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:30:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:30:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:30:56.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:56 smithi096 ceph-mon[124666]: pgmap v20744: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 926 KiB/s wr, 11 op/s 2023-05-08T14:30:56.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:30:56.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:30:56.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:30:56.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:30:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:30:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:56 smithi186 ceph-mon[126480]: pgmap v20744: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 926 KiB/s wr, 11 op/s 2023-05-08T14:30:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:30:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:30:56.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:30:57.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:57 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:30:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:57 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T14:30:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:57 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T14:30:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:57 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:30:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:30:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:57 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:30:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:57 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T14:30:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:57 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T14:30:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:57 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:30:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:30:57.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:57 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:30:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:57 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T14:30:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:57 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T14:30:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:57 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:30:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:30:58.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:58 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:30:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:30:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:30:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:58 smithi133 ceph-mon[125939]: pgmap v20745: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1007 KiB/s rd, 925 KiB/s wr, 8 op/s 2023-05-08T14:30:58.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:58 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:30:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:30:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:30:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:58 smithi096 ceph-mon[124666]: pgmap v20745: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1007 KiB/s rd, 925 KiB/s wr, 8 op/s 2023-05-08T14:30:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:58 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:30:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:30:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:30:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:58 smithi186 ceph-mon[126480]: pgmap v20745: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1007 KiB/s rd, 925 KiB/s wr, 8 op/s 2023-05-08T14:30:59.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:30:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38798.458651 secs 2023-05-08T14:30:59.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:30:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38798.458651 secs 2023-05-08T14:30:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:30:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38798.458651 secs 2023-05-08T14:31:00.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:00 smithi133 ceph-mon[125939]: pgmap v20746: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.6 MiB/s wr, 14 op/s 2023-05-08T14:31:00.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:00 smithi096 ceph-mon[124666]: pgmap v20746: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.6 MiB/s wr, 14 op/s 2023-05-08T14:31:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:00 smithi186 ceph-mon[126480]: pgmap v20746: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.6 MiB/s wr, 14 op/s 2023-05-08T14:31:01.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38800.354027 secs 2023-05-08T14:31:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38800.354027 secs 2023-05-08T14:31:01.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38800.354027 secs 2023-05-08T14:31:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:31:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:31:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:02 smithi133 ceph-mon[125939]: pgmap v20747: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T14:31:02.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:31:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:31:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:02 smithi096 ceph-mon[124666]: pgmap v20747: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T14:31:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:31:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:31:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:02 smithi186 ceph-mon[126480]: pgmap v20747: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T14:31:03.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:03 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:31:03.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:03 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:31:03.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:03 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:31:04.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:04 smithi133 ceph-mon[125939]: pgmap v20748: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T14:31:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38803.458773 secs 2023-05-08T14:31:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38804.012364 secs 2023-05-08T14:31:04.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:04 smithi096 ceph-mon[124666]: pgmap v20748: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T14:31:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38803.458773 secs 2023-05-08T14:31:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38804.012364 secs 2023-05-08T14:31:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:04 smithi186 ceph-mon[126480]: pgmap v20748: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T14:31:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38803.458773 secs 2023-05-08T14:31:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38804.012364 secs 2023-05-08T14:31:06.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:31:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:31:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:06 smithi133 ceph-mon[125939]: pgmap v20749: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.0 MiB/s wr, 28 op/s 2023-05-08T14:31:06.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:31:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:31:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:06 smithi096 ceph-mon[124666]: pgmap v20749: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.0 MiB/s wr, 28 op/s 2023-05-08T14:31:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:31:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:31:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:06 smithi186 ceph-mon[126480]: pgmap v20749: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.0 MiB/s wr, 28 op/s 2023-05-08T14:31:08.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:08 smithi133 ceph-mon[125939]: pgmap v20750: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.4 MiB/s wr, 23 op/s 2023-05-08T14:31:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:08 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:31:09.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:08 smithi096 ceph-mon[124666]: pgmap v20750: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.4 MiB/s wr, 23 op/s 2023-05-08T14:31:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:08 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:31:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:08 smithi186 ceph-mon[126480]: pgmap v20750: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.4 MiB/s wr, 23 op/s 2023-05-08T14:31:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:08 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:31:09.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38808.458898 secs 2023-05-08T14:31:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:09 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:31:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38809.012500 secs 2023-05-08T14:31:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38808.458898 secs 2023-05-08T14:31:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:09 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:31:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38809.012500 secs 2023-05-08T14:31:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38808.458898 secs 2023-05-08T14:31:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:09 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:31:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38809.012500 secs 2023-05-08T14:31:10.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:10 smithi133 ceph-mon[125939]: pgmap v20751: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.4 MiB/s wr, 27 op/s 2023-05-08T14:31:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:10 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:31:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:10 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:31:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:10 smithi096 ceph-mon[124666]: pgmap v20751: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.4 MiB/s wr, 27 op/s 2023-05-08T14:31:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:10 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:31:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:10 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:31:11.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:10 smithi186 ceph-mon[126480]: pgmap v20751: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.4 MiB/s wr, 27 op/s 2023-05-08T14:31:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:10 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:31:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:10 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:31:12.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:12 smithi133 ceph-mon[125939]: pgmap v20752: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 692 KiB/s wr, 22 op/s 2023-05-08T14:31:13.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:12 smithi096 ceph-mon[124666]: pgmap v20752: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 692 KiB/s wr, 22 op/s 2023-05-08T14:31:13.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:12 smithi186 ceph-mon[126480]: pgmap v20752: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 692 KiB/s wr, 22 op/s 2023-05-08T14:31:13.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:13 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:31:14.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:13 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:31:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:13 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:31:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:14 smithi133 ceph-mon[125939]: pgmap v20753: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 665 KiB/s wr, 21 op/s 2023-05-08T14:31:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38813.459021 secs 2023-05-08T14:31:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38814.012622 secs 2023-05-08T14:31:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:14 smithi096 ceph-mon[124666]: pgmap v20753: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 665 KiB/s wr, 21 op/s 2023-05-08T14:31:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38813.459021 secs 2023-05-08T14:31:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38814.012622 secs 2023-05-08T14:31:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:14 smithi186 ceph-mon[126480]: pgmap v20753: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 665 KiB/s wr, 21 op/s 2023-05-08T14:31:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38813.459021 secs 2023-05-08T14:31:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38814.012622 secs 2023-05-08T14:31:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:16 smithi096 ceph-mon[124666]: pgmap v20754: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 25 op/s 2023-05-08T14:31:17.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:16 smithi186 ceph-mon[126480]: pgmap v20754: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 25 op/s 2023-05-08T14:31:17.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:16 smithi133 ceph-mon[125939]: pgmap v20754: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 25 op/s 2023-05-08T14:31:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:18 smithi096 ceph-mon[124666]: pgmap v20755: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 721 KiB/s rd, 719 KiB/s wr, 8 op/s 2023-05-08T14:31:19.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:18 smithi186 ceph-mon[126480]: pgmap v20755: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 721 KiB/s rd, 719 KiB/s wr, 8 op/s 2023-05-08T14:31:19.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:18 smithi133 ceph-mon[125939]: pgmap v20755: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 721 KiB/s rd, 719 KiB/s wr, 8 op/s 2023-05-08T14:31:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38818.459142 secs 2023-05-08T14:31:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38819.012740 secs 2023-05-08T14:31:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38818.459142 secs 2023-05-08T14:31:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38819.012740 secs 2023-05-08T14:31:20.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38818.459142 secs 2023-05-08T14:31:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38819.012740 secs 2023-05-08T14:31:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:20 smithi096 ceph-mon[124666]: pgmap v20756: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 722 KiB/s rd, 719 KiB/s wr, 11 op/s 2023-05-08T14:31:21.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:20 smithi186 ceph-mon[126480]: pgmap v20756: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 722 KiB/s rd, 719 KiB/s wr, 11 op/s 2023-05-08T14:31:21.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:20 smithi133 ceph-mon[125939]: pgmap v20756: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 722 KiB/s rd, 719 KiB/s wr, 11 op/s 2023-05-08T14:31:23.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:22 smithi186 ceph-mon[126480]: pgmap v20757: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 716 KiB/s wr, 8 op/s 2023-05-08T14:31:23.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:22 smithi133 ceph-mon[125939]: pgmap v20757: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 716 KiB/s wr, 8 op/s 2023-05-08T14:31:23.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:22 smithi096 ceph-mon[124666]: pgmap v20757: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 716 KiB/s wr, 8 op/s 2023-05-08T14:31:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:24 smithi133 ceph-mon[125939]: pgmap v20758: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 716 KiB/s wr, 7 op/s 2023-05-08T14:31:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38823.459284 secs 2023-05-08T14:31:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:24 smithi096 ceph-mon[124666]: pgmap v20758: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 716 KiB/s wr, 7 op/s 2023-05-08T14:31:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38823.459284 secs 2023-05-08T14:31:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:24 smithi186 ceph-mon[126480]: pgmap v20758: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 716 KiB/s wr, 7 op/s 2023-05-08T14:31:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38823.459284 secs 2023-05-08T14:31:25.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:25 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:31:25.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:25 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:31:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:25 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:31:26.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:26 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:31:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:26 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:31:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:26 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:31:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:26 smithi133 ceph-mon[125939]: pgmap v20759: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 15 op/s 2023-05-08T14:31:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:26 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:31:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:26 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:31:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:26 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:31:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:26 smithi096 ceph-mon[124666]: pgmap v20759: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 15 op/s 2023-05-08T14:31:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:26 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:31:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:26 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:31:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:26 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:31:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:26 smithi186 ceph-mon[126480]: pgmap v20759: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 15 op/s 2023-05-08T14:31:28.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:28 smithi133 ceph-mon[125939]: pgmap v20760: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 936 KiB/s rd, 955 KiB/s wr, 11 op/s 2023-05-08T14:31:29.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:28 smithi096 ceph-mon[124666]: pgmap v20760: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 936 KiB/s rd, 955 KiB/s wr, 11 op/s 2023-05-08T14:31:29.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:28 smithi186 ceph-mon[126480]: pgmap v20760: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 936 KiB/s rd, 955 KiB/s wr, 11 op/s 2023-05-08T14:31:29.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38828.459420 secs 2023-05-08T14:31:30.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38828.459420 secs 2023-05-08T14:31:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38828.459420 secs 2023-05-08T14:31:30.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:30 smithi133 ceph-mon[125939]: pgmap v20761: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T14:31:31.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:30 smithi096 ceph-mon[124666]: pgmap v20761: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T14:31:31.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:30 smithi186 ceph-mon[126480]: pgmap v20761: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T14:31:32.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:31 smithi096 ceph-mon[124666]: osdmap e1374: 12 total, 12 up, 12 in 2023-05-08T14:31:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:31 smithi186 ceph-mon[126480]: osdmap e1374: 12 total, 12 up, 12 in 2023-05-08T14:31:32.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:31 smithi133 ceph-mon[125939]: osdmap e1374: 12 total, 12 up, 12 in 2023-05-08T14:31:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:32 smithi096 ceph-mon[124666]: pgmap v20763: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T14:31:33.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:32 smithi186 ceph-mon[126480]: pgmap v20763: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T14:31:33.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:32 smithi133 ceph-mon[125939]: pgmap v20763: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T14:31:34.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:34 smithi133 ceph-mon[125939]: pgmap v20764: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T14:31:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38833.459546 secs 2023-05-08T14:31:34.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:34 smithi096 ceph-mon[124666]: pgmap v20764: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T14:31:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38833.459546 secs 2023-05-08T14:31:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:34 smithi186 ceph-mon[126480]: pgmap v20764: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T14:31:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38833.459546 secs 2023-05-08T14:31:36.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:36 smithi133 ceph-mon[125939]: pgmap v20765: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 651 KiB/s wr, 10 op/s 2023-05-08T14:31:37.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:36 smithi096 ceph-mon[124666]: pgmap v20765: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 651 KiB/s wr, 10 op/s 2023-05-08T14:31:37.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:36 smithi186 ceph-mon[126480]: pgmap v20765: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 651 KiB/s wr, 10 op/s 2023-05-08T14:31:38.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:38 smithi133 ceph-mon[125939]: pgmap v20766: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 651 KiB/s wr, 10 op/s 2023-05-08T14:31:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:38 smithi133 ceph-mon[125939]: osdmap e1375: 12 total, 12 up, 12 in 2023-05-08T14:31:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:38 smithi096 ceph-mon[124666]: pgmap v20766: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 651 KiB/s wr, 10 op/s 2023-05-08T14:31:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:38 smithi096 ceph-mon[124666]: osdmap e1375: 12 total, 12 up, 12 in 2023-05-08T14:31:39.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:38 smithi186 ceph-mon[126480]: pgmap v20766: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 651 KiB/s wr, 10 op/s 2023-05-08T14:31:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:38 smithi186 ceph-mon[126480]: osdmap e1375: 12 total, 12 up, 12 in 2023-05-08T14:31:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38838.459683 secs 2023-05-08T14:31:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38838.459683 secs 2023-05-08T14:31:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38838.459683 secs 2023-05-08T14:31:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:40 smithi096 ceph-mon[124666]: pgmap v20768: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 785 KiB/s wr, 10 op/s 2023-05-08T14:31:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38840.355003 secs 2023-05-08T14:31:41.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:40 smithi186 ceph-mon[126480]: pgmap v20768: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 785 KiB/s wr, 10 op/s 2023-05-08T14:31:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38840.355003 secs 2023-05-08T14:31:41.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:40 smithi133 ceph-mon[125939]: pgmap v20768: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 785 KiB/s wr, 10 op/s 2023-05-08T14:31:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38840.355003 secs 2023-05-08T14:31:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:41 smithi186 ceph-mon[126480]: pgmap v20769: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 952 KiB/s rd, 707 KiB/s wr, 9 op/s 2023-05-08T14:31:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:41 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:31:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:41 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:31:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:41 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:31:42.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:41 smithi133 ceph-mon[125939]: pgmap v20769: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 952 KiB/s rd, 707 KiB/s wr, 9 op/s 2023-05-08T14:31:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:41 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:31:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:41 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:31:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:41 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:31:42.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:41 smithi096 ceph-mon[124666]: pgmap v20769: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 952 KiB/s rd, 707 KiB/s wr, 9 op/s 2023-05-08T14:31:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:41 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:31:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:41 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:31:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:41 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:31:44.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:44 smithi133 ceph-mon[125939]: pgmap v20770: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 952 KiB/s rd, 707 KiB/s wr, 9 op/s 2023-05-08T14:31:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38843.459807 secs 2023-05-08T14:31:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38844.013352 secs 2023-05-08T14:31:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:44 smithi096 ceph-mon[124666]: pgmap v20770: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 952 KiB/s rd, 707 KiB/s wr, 9 op/s 2023-05-08T14:31:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38843.459807 secs 2023-05-08T14:31:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38844.013352 secs 2023-05-08T14:31:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:44 smithi186 ceph-mon[126480]: pgmap v20770: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 952 KiB/s rd, 707 KiB/s wr, 9 op/s 2023-05-08T14:31:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38843.459807 secs 2023-05-08T14:31:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38844.013352 secs 2023-05-08T14:31:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:46 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:31:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:46 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:31:46.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:46 smithi133 ceph-mon[125939]: pgmap v20771: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 12 op/s 2023-05-08T14:31:46.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:46 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:31:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:46 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:31:46.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:46 smithi096 ceph-mon[124666]: pgmap v20771: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 12 op/s 2023-05-08T14:31:46.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:46 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:31:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:46 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:31:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:46 smithi186 ceph-mon[126480]: pgmap v20771: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 12 op/s 2023-05-08T14:31:48.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:48 smithi133 ceph-mon[125939]: pgmap v20772: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 12 op/s 2023-05-08T14:31:48.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:48 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:31:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:48 smithi096 ceph-mon[124666]: pgmap v20772: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 12 op/s 2023-05-08T14:31:49.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:48 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:31:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:48 smithi186 ceph-mon[126480]: pgmap v20772: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 12 op/s 2023-05-08T14:31:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:48 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:31:50.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38848.459870 secs 2023-05-08T14:31:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:31:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38848.459870 secs 2023-05-08T14:31:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:31:50.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38848.459870 secs 2023-05-08T14:31:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:31:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:50 smithi096 ceph-mon[124666]: pgmap v20773: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 16 op/s 2023-05-08T14:31:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:31:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:31:51.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:50 smithi186 ceph-mon[126480]: pgmap v20773: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 16 op/s 2023-05-08T14:31:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:31:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:31:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:50 smithi133 ceph-mon[125939]: pgmap v20773: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 16 op/s 2023-05-08T14:31:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:31:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:31:53.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:52 smithi096 ceph-mon[124666]: pgmap v20774: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 12 op/s 2023-05-08T14:31:53.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:52 smithi186 ceph-mon[126480]: pgmap v20774: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 12 op/s 2023-05-08T14:31:53.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:52 smithi133 ceph-mon[125939]: pgmap v20774: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 12 op/s 2023-05-08T14:31:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:53 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:31:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:53 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:31:54.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:53 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:31:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:53 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:31:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:53 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:31:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:53 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:31:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:54 smithi186 ceph-mon[126480]: pgmap v20775: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 12 op/s 2023-05-08T14:31:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38853.459944 secs 2023-05-08T14:31:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:54 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:31:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:54 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:31:55.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:54 smithi133 ceph-mon[125939]: pgmap v20775: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 12 op/s 2023-05-08T14:31:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38853.459944 secs 2023-05-08T14:31:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:54 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:31:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:54 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:31:55.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:54 smithi096 ceph-mon[124666]: pgmap v20775: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 12 op/s 2023-05-08T14:31:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38853.459944 secs 2023-05-08T14:31:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:54 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:31:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:54 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:31:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38855.355458 secs 2023-05-08T14:31:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:55 smithi186 ceph-mon[126480]: pgmap v20776: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.9 MiB/s wr, 19 op/s 2023-05-08T14:31:56.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38855.355458 secs 2023-05-08T14:31:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:55 smithi133 ceph-mon[125939]: pgmap v20776: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.9 MiB/s wr, 19 op/s 2023-05-08T14:31:56.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38855.355458 secs 2023-05-08T14:31:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:55 smithi096 ceph-mon[124666]: pgmap v20776: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.9 MiB/s wr, 19 op/s 2023-05-08T14:31:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:31:57.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:31:57.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:31:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:31:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:31:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:57 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:31:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:31:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:57 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T14:31:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:57 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T14:31:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:57 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:31:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:57 smithi186 ceph-mon[126480]: pgmap v20777: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 12 op/s 2023-05-08T14:31:58.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:31:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:31:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:57 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:31:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:31:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:57 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T14:31:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:57 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T14:31:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:57 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:31:58.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:57 smithi133 ceph-mon[125939]: pgmap v20777: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 12 op/s 2023-05-08T14:31:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:31:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:31:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:57 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:31:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:31:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:57 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T14:31:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:57 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T14:31:58.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:57 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:31:58.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:57 smithi096 ceph-mon[124666]: pgmap v20777: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 12 op/s 2023-05-08T14:31:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:31:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:31:59.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:31:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:31:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:31:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:32:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38858.460070 secs 2023-05-08T14:32:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38859.013724 secs 2023-05-08T14:32:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:31:59 smithi186 ceph-mon[126480]: pgmap v20778: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.3 MiB/s wr, 17 op/s 2023-05-08T14:32:00.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38858.460070 secs 2023-05-08T14:32:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38859.013724 secs 2023-05-08T14:32:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:31:59 smithi133 ceph-mon[125939]: pgmap v20778: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.3 MiB/s wr, 17 op/s 2023-05-08T14:32:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38858.460070 secs 2023-05-08T14:32:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38859.013724 secs 2023-05-08T14:32:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:31:59 smithi096 ceph-mon[124666]: pgmap v20778: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.3 MiB/s wr, 17 op/s 2023-05-08T14:32:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38860.355574 secs 2023-05-08T14:32:01.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38860.355574 secs 2023-05-08T14:32:01.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38860.355574 secs 2023-05-08T14:32:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:01 smithi186 ceph-mon[126480]: pgmap v20779: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T14:32:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:01 smithi133 ceph-mon[125939]: pgmap v20779: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T14:32:02.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:01 smithi096 ceph-mon[124666]: pgmap v20779: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T14:32:03.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:02 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:32:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:32:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:32:03.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:02 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:32:03.254 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:32:03.255 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:32:03.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:02 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:32:03.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:32:03.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:32:04.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:04 smithi133 ceph-mon[125939]: pgmap v20780: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T14:32:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38863.460217 secs 2023-05-08T14:32:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:04 smithi096 ceph-mon[124666]: pgmap v20780: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T14:32:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38863.460217 secs 2023-05-08T14:32:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:04 smithi186 ceph-mon[126480]: pgmap v20780: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T14:32:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38863.460217 secs 2023-05-08T14:32:05.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:05 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:32:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:05 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:32:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:05 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:32:06.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:32:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:32:06.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:06 smithi133 ceph-mon[125939]: pgmap v20781: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.4 MiB/s wr, 29 op/s 2023-05-08T14:32:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:32:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:32:06.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:06 smithi096 ceph-mon[124666]: pgmap v20781: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.4 MiB/s wr, 29 op/s 2023-05-08T14:32:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:32:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:32:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:06 smithi186 ceph-mon[126480]: pgmap v20781: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.4 MiB/s wr, 29 op/s 2023-05-08T14:32:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:08 smithi096 ceph-mon[124666]: pgmap v20782: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.7 MiB/s wr, 22 op/s 2023-05-08T14:32:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:08 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:32:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:08 smithi186 ceph-mon[126480]: pgmap v20782: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.7 MiB/s wr, 22 op/s 2023-05-08T14:32:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:08 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:32:09.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:08 smithi133 ceph-mon[125939]: pgmap v20782: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.7 MiB/s wr, 22 op/s 2023-05-08T14:32:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:08 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:32:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38868.460283 secs 2023-05-08T14:32:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:09 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:32:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38868.460283 secs 2023-05-08T14:32:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:09 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:32:10.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38868.460283 secs 2023-05-08T14:32:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:09 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:32:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:10 smithi096 ceph-mon[124666]: pgmap v20783: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 27 op/s 2023-05-08T14:32:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:10 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:32:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:10 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:32:11.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:10 smithi186 ceph-mon[126480]: pgmap v20783: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 27 op/s 2023-05-08T14:32:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:10 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:32:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:10 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:32:11.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:10 smithi133 ceph-mon[125939]: pgmap v20783: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 27 op/s 2023-05-08T14:32:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:10 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:32:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:10 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:32:13.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:12 smithi096 ceph-mon[124666]: pgmap v20784: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 22 op/s 2023-05-08T14:32:13.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:12 smithi186 ceph-mon[126480]: pgmap v20784: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 22 op/s 2023-05-08T14:32:13.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:12 smithi133 ceph-mon[125939]: pgmap v20784: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 22 op/s 2023-05-08T14:32:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:13 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:32:14.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:13 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:32:14.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:13 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:32:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:14 smithi186 ceph-mon[126480]: pgmap v20785: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 22 op/s 2023-05-08T14:32:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38873.460401 secs 2023-05-08T14:32:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:14 smithi133 ceph-mon[125939]: pgmap v20785: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 22 op/s 2023-05-08T14:32:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38873.460401 secs 2023-05-08T14:32:15.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:14 smithi096 ceph-mon[124666]: pgmap v20785: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 22 op/s 2023-05-08T14:32:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38873.460401 secs 2023-05-08T14:32:17.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:16 smithi186 ceph-mon[126480]: pgmap v20786: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 26 op/s 2023-05-08T14:32:17.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:16 smithi133 ceph-mon[125939]: pgmap v20786: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 26 op/s 2023-05-08T14:32:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:16 smithi096 ceph-mon[124666]: pgmap v20786: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 26 op/s 2023-05-08T14:32:19.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:18 smithi186 ceph-mon[126480]: pgmap v20787: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 778 KiB/s wr, 8 op/s 2023-05-08T14:32:19.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:18 smithi133 ceph-mon[125939]: pgmap v20787: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 778 KiB/s wr, 8 op/s 2023-05-08T14:32:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:18 smithi096 ceph-mon[124666]: pgmap v20787: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 778 KiB/s wr, 8 op/s 2023-05-08T14:32:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38878.460544 secs 2023-05-08T14:32:20.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38878.460544 secs 2023-05-08T14:32:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38878.460544 secs 2023-05-08T14:32:21.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:20 smithi186 ceph-mon[126480]: pgmap v20788: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 808 KiB/s wr, 12 op/s 2023-05-08T14:32:21.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38880.356017 secs 2023-05-08T14:32:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:20 smithi133 ceph-mon[125939]: pgmap v20788: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 808 KiB/s wr, 12 op/s 2023-05-08T14:32:21.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38880.356017 secs 2023-05-08T14:32:21.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:20 smithi096 ceph-mon[124666]: pgmap v20788: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 808 KiB/s wr, 12 op/s 2023-05-08T14:32:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38880.356017 secs 2023-05-08T14:32:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:21 smithi186 ceph-mon[126480]: pgmap v20789: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 373 KiB/s wr, 7 op/s 2023-05-08T14:32:22.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:21 smithi133 ceph-mon[125939]: pgmap v20789: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 373 KiB/s wr, 7 op/s 2023-05-08T14:32:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:21 smithi096 ceph-mon[124666]: pgmap v20789: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 373 KiB/s wr, 7 op/s 2023-05-08T14:32:23.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:22 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:32:23.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:22 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:32:23.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:22 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:32:23.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:22 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:32:23.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:22 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:32:23.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:22 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:32:23.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:22 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:32:23.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:22 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:32:23.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:22 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:32:24.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:24 smithi133 ceph-mon[125939]: pgmap v20790: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 373 KiB/s wr, 7 op/s 2023-05-08T14:32:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38883.460648 secs 2023-05-08T14:32:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38884.014268 secs 2023-05-08T14:32:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:24 smithi096 ceph-mon[124666]: pgmap v20790: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 373 KiB/s wr, 7 op/s 2023-05-08T14:32:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38883.460648 secs 2023-05-08T14:32:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38884.014268 secs 2023-05-08T14:32:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:24 smithi186 ceph-mon[126480]: pgmap v20790: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 373 KiB/s wr, 7 op/s 2023-05-08T14:32:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38883.460648 secs 2023-05-08T14:32:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38884.014268 secs 2023-05-08T14:32:26.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:26 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:32:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:26 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:32:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38885.356136 secs 2023-05-08T14:32:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:26 smithi133 ceph-mon[125939]: pgmap v20791: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 967 KiB/s rd, 986 KiB/s wr, 14 op/s 2023-05-08T14:32:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:26 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:32:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:26 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:32:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38885.356136 secs 2023-05-08T14:32:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:26 smithi096 ceph-mon[124666]: pgmap v20791: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 967 KiB/s rd, 986 KiB/s wr, 14 op/s 2023-05-08T14:32:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:26 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:32:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:26 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:32:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38885.356136 secs 2023-05-08T14:32:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:26 smithi186 ceph-mon[126480]: pgmap v20791: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 967 KiB/s rd, 986 KiB/s wr, 14 op/s 2023-05-08T14:32:27.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:27 smithi133 ceph-mon[125939]: osdmap e1376: 12 total, 12 up, 12 in 2023-05-08T14:32:27.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:27 smithi096 ceph-mon[124666]: osdmap e1376: 12 total, 12 up, 12 in 2023-05-08T14:32:27.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:27 smithi186 ceph-mon[126480]: osdmap e1376: 12 total, 12 up, 12 in 2023-05-08T14:32:28.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:28 smithi133 ceph-mon[125939]: pgmap v20793: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 748 KiB/s rd, 771 KiB/s wr, 12 op/s 2023-05-08T14:32:28.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:28 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:32:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:28 smithi096 ceph-mon[124666]: pgmap v20793: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 748 KiB/s rd, 771 KiB/s wr, 12 op/s 2023-05-08T14:32:28.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:28 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:32:28.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:28 smithi186 ceph-mon[126480]: pgmap v20793: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 748 KiB/s rd, 771 KiB/s wr, 12 op/s 2023-05-08T14:32:28.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:28 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:32:29.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38888.460765 secs 2023-05-08T14:32:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38889.014389 secs 2023-05-08T14:32:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38888.460765 secs 2023-05-08T14:32:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38889.014389 secs 2023-05-08T14:32:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38888.460765 secs 2023-05-08T14:32:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38889.014389 secs 2023-05-08T14:32:30.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:30 smithi133 ceph-mon[125939]: pgmap v20794: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T14:32:30.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:30 smithi096 ceph-mon[124666]: pgmap v20794: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T14:32:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:30 smithi186 ceph-mon[126480]: pgmap v20794: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T14:32:31.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38890.356256 secs 2023-05-08T14:32:31.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38890.356256 secs 2023-05-08T14:32:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38890.356256 secs 2023-05-08T14:32:32.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:32 smithi133 ceph-mon[125939]: pgmap v20795: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T14:32:32.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:32 smithi096 ceph-mon[124666]: pgmap v20795: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T14:32:32.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:32 smithi186 ceph-mon[126480]: pgmap v20795: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T14:32:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:34 smithi133 ceph-mon[125939]: osdmap e1377: 12 total, 12 up, 12 in 2023-05-08T14:32:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:34 smithi133 ceph-mon[125939]: pgmap v20797: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 567 KiB/s rd, 566 KiB/s wr, 6 op/s 2023-05-08T14:32:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38893.460885 secs 2023-05-08T14:32:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38894.014534 secs 2023-05-08T14:32:34.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:34 smithi096 ceph-mon[124666]: osdmap e1377: 12 total, 12 up, 12 in 2023-05-08T14:32:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:34 smithi096 ceph-mon[124666]: pgmap v20797: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 567 KiB/s rd, 566 KiB/s wr, 6 op/s 2023-05-08T14:32:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38893.460885 secs 2023-05-08T14:32:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38894.014534 secs 2023-05-08T14:32:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:34 smithi186 ceph-mon[126480]: osdmap e1377: 12 total, 12 up, 12 in 2023-05-08T14:32:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:34 smithi186 ceph-mon[126480]: pgmap v20797: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 567 KiB/s rd, 566 KiB/s wr, 6 op/s 2023-05-08T14:32:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38893.460885 secs 2023-05-08T14:32:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38894.014534 secs 2023-05-08T14:32:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38895.356353 secs 2023-05-08T14:32:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:35 smithi186 ceph-mon[126480]: pgmap v20798: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 976 KiB/s rd, 974 KiB/s wr, 11 op/s 2023-05-08T14:32:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38895.356353 secs 2023-05-08T14:32:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:35 smithi133 ceph-mon[125939]: pgmap v20798: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 976 KiB/s rd, 974 KiB/s wr, 11 op/s 2023-05-08T14:32:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38895.356353 secs 2023-05-08T14:32:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:35 smithi096 ceph-mon[124666]: pgmap v20798: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 976 KiB/s rd, 974 KiB/s wr, 11 op/s 2023-05-08T14:32:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:38 smithi096 ceph-mon[124666]: pgmap v20799: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 904 KiB/s rd, 902 KiB/s wr, 11 op/s 2023-05-08T14:32:39.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:38 smithi186 ceph-mon[126480]: pgmap v20799: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 904 KiB/s rd, 902 KiB/s wr, 11 op/s 2023-05-08T14:32:39.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:38 smithi133 ceph-mon[125939]: pgmap v20799: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 904 KiB/s rd, 902 KiB/s wr, 11 op/s 2023-05-08T14:32:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38898.460959 secs 2023-05-08T14:32:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38899.014650 secs 2023-05-08T14:32:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38898.460959 secs 2023-05-08T14:32:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38899.014650 secs 2023-05-08T14:32:40.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38898.460959 secs 2023-05-08T14:32:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38899.014650 secs 2023-05-08T14:32:41.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:40 smithi186 ceph-mon[126480]: pgmap v20800: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 452 KiB/s rd, 1.1 MiB/s wr, 9 op/s 2023-05-08T14:32:41.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38900.356470 secs 2023-05-08T14:32:41.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:40 smithi133 ceph-mon[125939]: pgmap v20800: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 452 KiB/s rd, 1.1 MiB/s wr, 9 op/s 2023-05-08T14:32:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38900.356470 secs 2023-05-08T14:32:41.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:40 smithi096 ceph-mon[124666]: pgmap v20800: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 452 KiB/s rd, 1.1 MiB/s wr, 9 op/s 2023-05-08T14:32:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38900.356470 secs 2023-05-08T14:32:43.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:42 smithi186 ceph-mon[126480]: pgmap v20801: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 452 KiB/s rd, 1.1 MiB/s wr, 9 op/s 2023-05-08T14:32:43.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:42 smithi133 ceph-mon[125939]: pgmap v20801: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 452 KiB/s rd, 1.1 MiB/s wr, 9 op/s 2023-05-08T14:32:43.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:42 smithi096 ceph-mon[124666]: pgmap v20801: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 452 KiB/s rd, 1.1 MiB/s wr, 9 op/s 2023-05-08T14:32:44.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:44 smithi133 ceph-mon[125939]: pgmap v20802: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 1.1 MiB/s wr, 9 op/s 2023-05-08T14:32:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38903.461082 secs 2023-05-08T14:32:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38904.014765 secs 2023-05-08T14:32:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:44 smithi096 ceph-mon[124666]: pgmap v20802: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 1.1 MiB/s wr, 9 op/s 2023-05-08T14:32:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38903.461082 secs 2023-05-08T14:32:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38904.014765 secs 2023-05-08T14:32:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:44 smithi186 ceph-mon[126480]: pgmap v20802: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 1.1 MiB/s wr, 9 op/s 2023-05-08T14:32:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38903.461082 secs 2023-05-08T14:32:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38904.014765 secs 2023-05-08T14:32:47.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:46 smithi186 ceph-mon[126480]: pgmap v20803: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 936 KiB/s rd, 933 KiB/s wr, 11 op/s 2023-05-08T14:32:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:46 smithi133 ceph-mon[125939]: pgmap v20803: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 936 KiB/s rd, 933 KiB/s wr, 11 op/s 2023-05-08T14:32:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:46 smithi096 ceph-mon[124666]: pgmap v20803: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 936 KiB/s rd, 933 KiB/s wr, 11 op/s 2023-05-08T14:32:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:48 smithi186 ceph-mon[126480]: pgmap v20804: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 561 KiB/s rd, 559 KiB/s wr, 6 op/s 2023-05-08T14:32:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:48 smithi133 ceph-mon[125939]: pgmap v20804: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 561 KiB/s rd, 559 KiB/s wr, 6 op/s 2023-05-08T14:32:49.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:48 smithi096 ceph-mon[124666]: pgmap v20804: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 561 KiB/s rd, 559 KiB/s wr, 6 op/s 2023-05-08T14:32:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38908.461174 secs 2023-05-08T14:32:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:32:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38909.014881 secs 2023-05-08T14:32:50.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38908.461174 secs 2023-05-08T14:32:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:32:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38909.014881 secs 2023-05-08T14:32:50.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38908.461174 secs 2023-05-08T14:32:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:32:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38909.014881 secs 2023-05-08T14:32:51.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:50 smithi186 ceph-mon[126480]: pgmap v20805: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 963 KiB/s wr, 10 op/s 2023-05-08T14:32:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:32:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:32:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:32:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:50 smithi133 ceph-mon[125939]: pgmap v20805: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 963 KiB/s wr, 10 op/s 2023-05-08T14:32:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:32:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:32:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:32:51.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:50 smithi096 ceph-mon[124666]: pgmap v20805: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 963 KiB/s wr, 10 op/s 2023-05-08T14:32:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:32:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:32:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:32:53.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:52 smithi186 ceph-mon[126480]: pgmap v20806: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 405 KiB/s wr, 7 op/s 2023-05-08T14:32:53.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:52 smithi133 ceph-mon[125939]: pgmap v20806: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 405 KiB/s wr, 7 op/s 2023-05-08T14:32:53.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:52 smithi096 ceph-mon[124666]: pgmap v20806: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 405 KiB/s wr, 7 op/s 2023-05-08T14:32:54.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:54 smithi133 ceph-mon[125939]: pgmap v20807: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 405 KiB/s wr, 7 op/s 2023-05-08T14:32:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38913.461300 secs 2023-05-08T14:32:54.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:54 smithi096 ceph-mon[124666]: pgmap v20807: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 405 KiB/s wr, 7 op/s 2023-05-08T14:32:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38913.461300 secs 2023-05-08T14:32:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:54 smithi186 ceph-mon[126480]: pgmap v20807: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 405 KiB/s wr, 7 op/s 2023-05-08T14:32:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38913.461300 secs 2023-05-08T14:32:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:56 smithi186 ceph-mon[126480]: pgmap v20808: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.8 MiB/s wr, 13 op/s 2023-05-08T14:32:57.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:56 smithi133 ceph-mon[125939]: pgmap v20808: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.8 MiB/s wr, 13 op/s 2023-05-08T14:32:57.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:56 smithi096 ceph-mon[124666]: pgmap v20808: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.8 MiB/s wr, 13 op/s 2023-05-08T14:32:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:32:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:32:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:32:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:32:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:32:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:32:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:32:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:32:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:32:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:32:58.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:32:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:32:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:32:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:32:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:32:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:58 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:32:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:58 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T14:32:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:58 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T14:32:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:58 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:32:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:58 smithi186 ceph-mon[126480]: pgmap v20809: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 905 KiB/s rd, 1.8 MiB/s wr, 9 op/s 2023-05-08T14:32:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:58 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:32:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:32:59.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:32:59.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:58 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:32:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:58 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T14:32:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:58 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T14:32:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:58 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:32:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:58 smithi133 ceph-mon[125939]: pgmap v20809: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 905 KiB/s rd, 1.8 MiB/s wr, 9 op/s 2023-05-08T14:32:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:58 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:32:59.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:32:59.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:32:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:58 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:32:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:58 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T14:32:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:58 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T14:32:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:58 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:32:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:58 smithi096 ceph-mon[124666]: pgmap v20809: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 905 KiB/s rd, 1.8 MiB/s wr, 9 op/s 2023-05-08T14:32:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:58 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:32:59.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:32:59.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:33:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38918.461434 secs 2023-05-08T14:33:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:32:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38919.015115 secs 2023-05-08T14:33:00.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38918.461434 secs 2023-05-08T14:33:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:32:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38919.015115 secs 2023-05-08T14:33:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38918.461434 secs 2023-05-08T14:33:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:32:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38919.015115 secs 2023-05-08T14:33:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:00 smithi186 ceph-mon[126480]: pgmap v20810: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.8 MiB/s wr, 16 op/s 2023-05-08T14:33:01.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:00 smithi133 ceph-mon[125939]: pgmap v20810: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.8 MiB/s wr, 16 op/s 2023-05-08T14:33:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:00 smithi096 ceph-mon[124666]: pgmap v20810: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.8 MiB/s wr, 16 op/s 2023-05-08T14:33:03.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:02 smithi186 ceph-mon[126480]: pgmap v20811: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 12 op/s 2023-05-08T14:33:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:33:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:33:03.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:02 smithi133 ceph-mon[125939]: pgmap v20811: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 12 op/s 2023-05-08T14:33:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:33:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:33:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:02 smithi096 ceph-mon[124666]: pgmap v20811: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 12 op/s 2023-05-08T14:33:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:33:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:33:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:03 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:33:04.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:03 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:33:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:03 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:33:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:04 smithi186 ceph-mon[126480]: pgmap v20812: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 12 op/s 2023-05-08T14:33:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38923.461569 secs 2023-05-08T14:33:05.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:04 smithi133 ceph-mon[125939]: pgmap v20812: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 12 op/s 2023-05-08T14:33:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38923.461569 secs 2023-05-08T14:33:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:04 smithi096 ceph-mon[124666]: pgmap v20812: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 12 op/s 2023-05-08T14:33:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38923.461569 secs 2023-05-08T14:33:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:05 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:33:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:05 smithi186 ceph-mon[126480]: pgmap v20813: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.5 MiB/s wr, 31 op/s 2023-05-08T14:33:06.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:05 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:33:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:05 smithi133 ceph-mon[125939]: pgmap v20813: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.5 MiB/s wr, 31 op/s 2023-05-08T14:33:06.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:05 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:33:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:05 smithi096 ceph-mon[124666]: pgmap v20813: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.5 MiB/s wr, 31 op/s 2023-05-08T14:33:07.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:33:07.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:33:07.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:33:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:33:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:33:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:33:08.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:07 smithi186 ceph-mon[126480]: pgmap v20814: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.1 MiB/s wr, 25 op/s 2023-05-08T14:33:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:07 smithi133 ceph-mon[125939]: pgmap v20814: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.1 MiB/s wr, 25 op/s 2023-05-08T14:33:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:07 smithi096 ceph-mon[124666]: pgmap v20814: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.1 MiB/s wr, 25 op/s 2023-05-08T14:33:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:08 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:33:09.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:08 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:33:09.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:08 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:33:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38928.461705 secs 2023-05-08T14:33:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:09 smithi186 ceph-mon[126480]: pgmap v20815: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 2.8 MiB/s wr, 31 op/s 2023-05-08T14:33:10.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38928.461705 secs 2023-05-08T14:33:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:09 smithi133 ceph-mon[125939]: pgmap v20815: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 2.8 MiB/s wr, 31 op/s 2023-05-08T14:33:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38928.461705 secs 2023-05-08T14:33:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:09 smithi096 ceph-mon[124666]: pgmap v20815: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 2.8 MiB/s wr, 31 op/s 2023-05-08T14:33:13.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:12 smithi186 ceph-mon[126480]: pgmap v20816: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.9 MiB/s wr, 24 op/s 2023-05-08T14:33:13.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:12 smithi133 ceph-mon[125939]: pgmap v20816: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.9 MiB/s wr, 24 op/s 2023-05-08T14:33:13.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:12 smithi096 ceph-mon[124666]: pgmap v20816: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.9 MiB/s wr, 24 op/s 2023-05-08T14:33:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:14 smithi133 ceph-mon[125939]: pgmap v20817: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.9 MiB/s wr, 24 op/s 2023-05-08T14:33:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38933.461845 secs 2023-05-08T14:33:14.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:14 smithi096 ceph-mon[124666]: pgmap v20817: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.9 MiB/s wr, 24 op/s 2023-05-08T14:33:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38933.461845 secs 2023-05-08T14:33:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:14 smithi186 ceph-mon[126480]: pgmap v20817: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.9 MiB/s wr, 24 op/s 2023-05-08T14:33:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38933.461845 secs 2023-05-08T14:33:17.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:16 smithi186 ceph-mon[126480]: pgmap v20818: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 2.4 MiB/s wr, 29 op/s 2023-05-08T14:33:17.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:16 smithi133 ceph-mon[125939]: pgmap v20818: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 2.4 MiB/s wr, 29 op/s 2023-05-08T14:33:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:16 smithi096 ceph-mon[124666]: pgmap v20818: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 2.4 MiB/s wr, 29 op/s 2023-05-08T14:33:19.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:18 smithi186 ceph-mon[126480]: pgmap v20819: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T14:33:19.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:18 smithi133 ceph-mon[125939]: pgmap v20819: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T14:33:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:18 smithi096 ceph-mon[124666]: pgmap v20819: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T14:33:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38938.461964 secs 2023-05-08T14:33:20.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38938.461964 secs 2023-05-08T14:33:20.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38938.461964 secs 2023-05-08T14:33:21.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:20 smithi186 ceph-mon[126480]: pgmap v20820: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T14:33:21.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:20 smithi133 ceph-mon[125939]: pgmap v20820: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T14:33:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:20 smithi096 ceph-mon[124666]: pgmap v20820: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T14:33:23.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:22 smithi186 ceph-mon[126480]: pgmap v20821: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 608 KiB/s wr, 8 op/s 2023-05-08T14:33:23.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:22 smithi133 ceph-mon[125939]: pgmap v20821: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 608 KiB/s wr, 8 op/s 2023-05-08T14:33:23.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:22 smithi096 ceph-mon[124666]: pgmap v20821: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 608 KiB/s wr, 8 op/s 2023-05-08T14:33:24.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:24 smithi133 ceph-mon[125939]: pgmap v20822: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 608 KiB/s wr, 8 op/s 2023-05-08T14:33:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38943.462101 secs 2023-05-08T14:33:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38944.015593 secs 2023-05-08T14:33:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:24 smithi096 ceph-mon[124666]: pgmap v20822: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 608 KiB/s wr, 8 op/s 2023-05-08T14:33:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38943.462101 secs 2023-05-08T14:33:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38944.015593 secs 2023-05-08T14:33:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:24 smithi186 ceph-mon[126480]: pgmap v20822: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 608 KiB/s wr, 8 op/s 2023-05-08T14:33:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38943.462101 secs 2023-05-08T14:33:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38944.015593 secs 2023-05-08T14:33:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:25 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:33:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:25 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:33:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:25 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:33:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:25 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:33:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:25 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:33:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:25 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:33:25.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:25 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:33:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:25 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:33:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:25 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:33:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38945.357591 secs 2023-05-08T14:33:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:26 smithi186 ceph-mon[126480]: pgmap v20823: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.3 MiB/s wr, 15 op/s 2023-05-08T14:33:26.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38945.357591 secs 2023-05-08T14:33:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:26 smithi133 ceph-mon[125939]: pgmap v20823: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.3 MiB/s wr, 15 op/s 2023-05-08T14:33:27.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38945.357591 secs 2023-05-08T14:33:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:26 smithi096 ceph-mon[124666]: pgmap v20823: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.3 MiB/s wr, 15 op/s 2023-05-08T14:33:29.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:28 smithi186 ceph-mon[126480]: pgmap v20824: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 738 KiB/s rd, 758 KiB/s wr, 10 op/s 2023-05-08T14:33:29.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:28 smithi133 ceph-mon[125939]: pgmap v20824: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 738 KiB/s rd, 758 KiB/s wr, 10 op/s 2023-05-08T14:33:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:28 smithi096 ceph-mon[124666]: pgmap v20824: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 738 KiB/s rd, 758 KiB/s wr, 10 op/s 2023-05-08T14:33:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38948.462215 secs 2023-05-08T14:33:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38949.015712 secs 2023-05-08T14:33:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38948.462215 secs 2023-05-08T14:33:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38949.015712 secs 2023-05-08T14:33:30.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38948.462215 secs 2023-05-08T14:33:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38949.015712 secs 2023-05-08T14:33:31.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:30 smithi186 ceph-mon[126480]: pgmap v20825: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 743 KiB/s rd, 761 KiB/s wr, 14 op/s 2023-05-08T14:33:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:30 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:33:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:30 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:33:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38950.357734 secs 2023-05-08T14:33:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:30 smithi133 ceph-mon[125939]: pgmap v20825: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 743 KiB/s rd, 761 KiB/s wr, 14 op/s 2023-05-08T14:33:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:30 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:33:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:30 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:33:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38950.357734 secs 2023-05-08T14:33:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:30 smithi096 ceph-mon[124666]: pgmap v20825: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 743 KiB/s rd, 761 KiB/s wr, 14 op/s 2023-05-08T14:33:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:30 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:33:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:30 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:33:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38950.357734 secs 2023-05-08T14:33:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:31 smithi186 ceph-mon[126480]: osdmap e1378: 12 total, 12 up, 12 in 2023-05-08T14:33:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:31 smithi186 ceph-mon[126480]: pgmap v20827: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 14 op/s 2023-05-08T14:33:32.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:31 smithi133 ceph-mon[125939]: osdmap e1378: 12 total, 12 up, 12 in 2023-05-08T14:33:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:31 smithi133 ceph-mon[125939]: pgmap v20827: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 14 op/s 2023-05-08T14:33:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:31 smithi096 ceph-mon[124666]: osdmap e1378: 12 total, 12 up, 12 in 2023-05-08T14:33:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:31 smithi096 ceph-mon[124666]: pgmap v20827: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 14 op/s 2023-05-08T14:33:33.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:33 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:33:33.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:33 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:33:33.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:33 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:33:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:34 smithi096 ceph-mon[124666]: pgmap v20828: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 14 op/s 2023-05-08T14:33:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38953.462305 secs 2023-05-08T14:33:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38954.015788 secs 2023-05-08T14:33:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:34 smithi186 ceph-mon[126480]: pgmap v20828: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 14 op/s 2023-05-08T14:33:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38953.462305 secs 2023-05-08T14:33:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38954.015788 secs 2023-05-08T14:33:34.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:34 smithi133 ceph-mon[125939]: pgmap v20828: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 14 op/s 2023-05-08T14:33:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38953.462305 secs 2023-05-08T14:33:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38954.015788 secs 2023-05-08T14:33:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38955.357877 secs 2023-05-08T14:33:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:35 smithi186 ceph-mon[126480]: pgmap v20829: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 902 KiB/s rd, 900 KiB/s wr, 11 op/s 2023-05-08T14:33:36.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38955.357877 secs 2023-05-08T14:33:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:35 smithi133 ceph-mon[125939]: pgmap v20829: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 902 KiB/s rd, 900 KiB/s wr, 11 op/s 2023-05-08T14:33:36.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38955.357877 secs 2023-05-08T14:33:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:35 smithi096 ceph-mon[124666]: pgmap v20829: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 902 KiB/s rd, 900 KiB/s wr, 11 op/s 2023-05-08T14:33:39.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:38 smithi186 ceph-mon[126480]: pgmap v20830: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 902 KiB/s rd, 900 KiB/s wr, 11 op/s 2023-05-08T14:33:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:38 smithi186 ceph-mon[126480]: osdmap e1379: 12 total, 12 up, 12 in 2023-05-08T14:33:39.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:38 smithi133 ceph-mon[125939]: pgmap v20830: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 902 KiB/s rd, 900 KiB/s wr, 11 op/s 2023-05-08T14:33:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:38 smithi133 ceph-mon[125939]: osdmap e1379: 12 total, 12 up, 12 in 2023-05-08T14:33:39.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:38 smithi096 ceph-mon[124666]: pgmap v20830: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 902 KiB/s rd, 900 KiB/s wr, 11 op/s 2023-05-08T14:33:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:38 smithi096 ceph-mon[124666]: osdmap e1379: 12 total, 12 up, 12 in 2023-05-08T14:33:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38958.462434 secs 2023-05-08T14:33:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38959.015902 secs 2023-05-08T14:33:40.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38958.462434 secs 2023-05-08T14:33:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38959.015902 secs 2023-05-08T14:33:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38958.462434 secs 2023-05-08T14:33:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38959.015902 secs 2023-05-08T14:33:41.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:40 smithi186 ceph-mon[126480]: pgmap v20832: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 834 KiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T14:33:41.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38960.358009 secs 2023-05-08T14:33:41.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:40 smithi133 ceph-mon[125939]: pgmap v20832: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 834 KiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T14:33:41.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38960.358009 secs 2023-05-08T14:33:41.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:40 smithi096 ceph-mon[124666]: pgmap v20832: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 834 KiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T14:33:41.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38960.358009 secs 2023-05-08T14:33:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:41 smithi186 ceph-mon[126480]: pgmap v20833: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 745 KiB/s rd, 951 KiB/s wr, 10 op/s 2023-05-08T14:33:42.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:41 smithi133 ceph-mon[125939]: pgmap v20833: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 745 KiB/s rd, 951 KiB/s wr, 10 op/s 2023-05-08T14:33:42.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:41 smithi096 ceph-mon[124666]: pgmap v20833: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 745 KiB/s rd, 951 KiB/s wr, 10 op/s 2023-05-08T14:33:44.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:44 smithi133 ceph-mon[125939]: pgmap v20834: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 745 KiB/s rd, 951 KiB/s wr, 10 op/s 2023-05-08T14:33:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38963.462551 secs 2023-05-08T14:33:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38964.016045 secs 2023-05-08T14:33:44.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:44 smithi096 ceph-mon[124666]: pgmap v20834: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 745 KiB/s rd, 951 KiB/s wr, 10 op/s 2023-05-08T14:33:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38963.462551 secs 2023-05-08T14:33:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38964.016045 secs 2023-05-08T14:33:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:44 smithi186 ceph-mon[126480]: pgmap v20834: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 745 KiB/s rd, 951 KiB/s wr, 10 op/s 2023-05-08T14:33:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38963.462551 secs 2023-05-08T14:33:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38964.016045 secs 2023-05-08T14:33:47.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:46 smithi186 ceph-mon[126480]: pgmap v20835: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 590 KiB/s rd, 588 KiB/s wr, 9 op/s 2023-05-08T14:33:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:46 smithi133 ceph-mon[125939]: pgmap v20835: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 590 KiB/s rd, 588 KiB/s wr, 9 op/s 2023-05-08T14:33:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:46 smithi096 ceph-mon[124666]: pgmap v20835: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 590 KiB/s rd, 588 KiB/s wr, 9 op/s 2023-05-08T14:33:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:48 smithi186 ceph-mon[126480]: pgmap v20836: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 590 KiB/s rd, 588 KiB/s wr, 9 op/s 2023-05-08T14:33:49.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:48 smithi133 ceph-mon[125939]: pgmap v20836: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 590 KiB/s rd, 588 KiB/s wr, 9 op/s 2023-05-08T14:33:49.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:48 smithi096 ceph-mon[124666]: pgmap v20836: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 590 KiB/s rd, 588 KiB/s wr, 9 op/s 2023-05-08T14:33:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38968.462667 secs 2023-05-08T14:33:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:33:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38969.016166 secs 2023-05-08T14:33:50.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38968.462667 secs 2023-05-08T14:33:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:33:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38969.016166 secs 2023-05-08T14:33:50.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38968.462667 secs 2023-05-08T14:33:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:33:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38969.016166 secs 2023-05-08T14:33:51.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:50 smithi186 ceph-mon[126480]: pgmap v20837: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 897 KiB/s rd, 894 KiB/s wr, 12 op/s 2023-05-08T14:33:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:33:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:33:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:33:51.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:50 smithi133 ceph-mon[125939]: pgmap v20837: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 897 KiB/s rd, 894 KiB/s wr, 12 op/s 2023-05-08T14:33:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:33:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:33:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:33:51.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:50 smithi096 ceph-mon[124666]: pgmap v20837: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 897 KiB/s rd, 894 KiB/s wr, 12 op/s 2023-05-08T14:33:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:33:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:33:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:33:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:51 smithi186 ceph-mon[126480]: pgmap v20838: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 841 KiB/s rd, 666 KiB/s wr, 8 op/s 2023-05-08T14:33:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:51 smithi133 ceph-mon[125939]: pgmap v20838: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 841 KiB/s rd, 666 KiB/s wr, 8 op/s 2023-05-08T14:33:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:51 smithi096 ceph-mon[124666]: pgmap v20838: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 841 KiB/s rd, 666 KiB/s wr, 8 op/s 2023-05-08T14:33:54.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:54 smithi133 ceph-mon[125939]: pgmap v20839: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 841 KiB/s rd, 666 KiB/s wr, 8 op/s 2023-05-08T14:33:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38973.462806 secs 2023-05-08T14:33:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:54 smithi096 ceph-mon[124666]: pgmap v20839: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 841 KiB/s rd, 666 KiB/s wr, 8 op/s 2023-05-08T14:33:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38973.462806 secs 2023-05-08T14:33:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:54 smithi186 ceph-mon[126480]: pgmap v20839: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 841 KiB/s rd, 666 KiB/s wr, 8 op/s 2023-05-08T14:33:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38973.462806 secs 2023-05-08T14:33:57.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:56 smithi186 ceph-mon[126480]: pgmap v20840: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T14:33:57.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:56 smithi133 ceph-mon[125939]: pgmap v20840: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T14:33:57.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:56 smithi096 ceph-mon[124666]: pgmap v20840: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T14:33:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:33:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:33:58.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:33:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:33:58.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:33:58.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:33:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:58 smithi186 ceph-mon[126480]: pgmap v20841: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 935 KiB/s rd, 914 KiB/s wr, 8 op/s 2023-05-08T14:33:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:58 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:33:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:33:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:33:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:33:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:33:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:58 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:33:59.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:58 smithi133 ceph-mon[125939]: pgmap v20841: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 935 KiB/s rd, 914 KiB/s wr, 8 op/s 2023-05-08T14:33:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:58 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:33:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:33:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:33:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:33:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:33:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:58 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:33:59.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:58 smithi096 ceph-mon[124666]: pgmap v20841: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 935 KiB/s rd, 914 KiB/s wr, 8 op/s 2023-05-08T14:33:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:58 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:33:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:33:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:33:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:33:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:33:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:58 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:34:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:59 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:34:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:59 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T14:34:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:59 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T14:34:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:59 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:34:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:33:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38978.462948 secs 2023-05-08T14:34:00.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:59 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:34:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:59 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T14:34:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:59 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T14:34:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:59 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:34:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:33:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38978.462948 secs 2023-05-08T14:34:00.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:59 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:34:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:59 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T14:34:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:59 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T14:34:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:59 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:34:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:33:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38978.462948 secs 2023-05-08T14:34:01.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:34:00 smithi186 ceph-mon[126480]: pgmap v20842: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 15 op/s 2023-05-08T14:34:01.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:34:00 smithi133 ceph-mon[125939]: pgmap v20842: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 15 op/s 2023-05-08T14:34:01.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:34:00 smithi096 ceph-mon[124666]: pgmap v20842: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 15 op/s 2023-05-08T14:34:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:34:01 smithi186 ceph-mon[126480]: pgmap v20843: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T14:34:02.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:34:01 smithi133 ceph-mon[125939]: pgmap v20843: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T14:34:02.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:34:01 smithi096 ceph-mon[124666]: pgmap v20843: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T14:34:04.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:34:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38983.463092 secs 2023-05-08T14:34:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:34:04 smithi133 ceph-mon[125939]: pgmap v20844: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T14:34:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:34:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38984.016436 secs 2023-05-08T14:34:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:34:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38983.463092 secs 2023-05-08T14:34:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:34:04 smithi096 ceph-mon[124666]: pgmap v20844: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T14:34:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:34:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38984.016436 secs 2023-05-08T14:34:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:34:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38983.463092 secs 2023-05-08T14:34:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:34:04 smithi186 ceph-mon[126480]: pgmap v20844: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T14:34:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:34:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38984.016436 secs 2023-05-08T14:34:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:34:05 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:34:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:34:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:34:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:34:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:34:05.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:34:05 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:34:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:34:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:34:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:34:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:34:06.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:34:05 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:34:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:34:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:34:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:34:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:34:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:34:06 smithi186 ceph-mon[126480]: pgmap v20845: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 29 op/s 2023-05-08T14:34:06.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:34:06 smithi133 ceph-mon[125939]: pgmap v20845: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 29 op/s 2023-05-08T14:34:07.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:34:06 smithi096 ceph-mon[124666]: pgmap v20845: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 29 op/s 2023-05-08T14:34:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:34:08 smithi186 ceph-mon[126480]: pgmap v20846: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 24 op/s 2023-05-08T14:34:09.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:34:08 smithi133 ceph-mon[125939]: pgmap v20846: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 24 op/s 2023-05-08T14:34:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:34:08 smithi096 ceph-mon[124666]: pgmap v20846: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 24 op/s 2023-05-08T14:34:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:34:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38988.463213 secs 2023-05-08T14:34:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:34:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38989.016557 secs 2023-05-08T14:34:10.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:34:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38988.463213 secs 2023-05-08T14:34:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:34:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38989.016557 secs 2023-05-08T14:34:10.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:34:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38988.463213 secs 2023-05-08T14:34:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:34:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38989.016557 secs 2023-05-08T14:34:11.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:34:10 smithi186 ceph-mon[126480]: pgmap v20847: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 29 op/s 2023-05-08T14:34:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:34:10 smithi133 ceph-mon[125939]: pgmap v20847: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 29 op/s 2023-05-08T14:34:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:34:10 smithi096 ceph-mon[124666]: pgmap v20847: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 29 op/s 2023-05-08T14:34:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:34:11 smithi186 ceph-mon[126480]: pgmap v20848: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 704 KiB/s rd, 674 KiB/s wr, 23 op/s 2023-05-08T14:34:12.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:34:11 smithi133 ceph-mon[125939]: pgmap v20848: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 704 KiB/s rd, 674 KiB/s wr, 23 op/s 2023-05-08T14:34:12.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:34:11 smithi096 ceph-mon[124666]: pgmap v20848: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 704 KiB/s rd, 674 KiB/s wr, 23 op/s 2023-05-08T14:34:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:34:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38993.463315 secs 2023-05-08T14:34:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:34:14 smithi133 ceph-mon[125939]: pgmap v20849: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 704 KiB/s rd, 674 KiB/s wr, 23 op/s 2023-05-08T14:34:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:34:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38994.016676 secs 2023-05-08T14:34:14.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:34:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38993.463315 secs 2023-05-08T14:34:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:34:14 smithi096 ceph-mon[124666]: pgmap v20849: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 704 KiB/s rd, 674 KiB/s wr, 23 op/s 2023-05-08T14:34:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:34:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38994.016676 secs 2023-05-08T14:34:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:34:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38993.463315 secs 2023-05-08T14:34:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:34:14 smithi186 ceph-mon[126480]: pgmap v20849: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 704 KiB/s rd, 674 KiB/s wr, 23 op/s 2023-05-08T14:34:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:34:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38994.016676 secs 2023-05-08T14:34:17.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:34:16 smithi186 ceph-mon[126480]: pgmap v20850: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 28 op/s 2023-05-08T14:34:17.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:34:16 smithi133 ceph-mon[125939]: pgmap v20850: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 28 op/s 2023-05-08T14:34:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:34:16 smithi096 ceph-mon[124666]: pgmap v20850: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 28 op/s 2023-05-08T14:34:19.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:34:18 smithi186 ceph-mon[126480]: pgmap v20851: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 576 KiB/s wr, 9 op/s 2023-05-08T14:34:19.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:34:18 smithi133 ceph-mon[125939]: pgmap v20851: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 576 KiB/s wr, 9 op/s 2023-05-08T14:34:19.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:34:18 smithi096 ceph-mon[124666]: pgmap v20851: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 576 KiB/s wr, 9 op/s 2023-05-08T14:34:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:34:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38998.463436 secs 2023-05-08T14:34:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:34:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 38999.016798 secs 2023-05-08T14:34:20.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:34:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38998.463436 secs 2023-05-08T14:34:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:34:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 38999.016798 secs 2023-05-08T14:34:20.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:34:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38998.463436 secs 2023-05-08T14:34:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:34:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 38999.016798 secs 2023-05-08T14:34:21.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:34:20 smithi186 ceph-mon[126480]: pgmap v20852: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 579 KiB/s rd, 577 KiB/s wr, 13 op/s 2023-05-08T14:34:21.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:34:20 smithi133 ceph-mon[125939]: pgmap v20852: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 579 KiB/s rd, 577 KiB/s wr, 13 op/s 2023-05-08T14:34:21.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:34:20 smithi096 ceph-mon[124666]: pgmap v20852: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 579 KiB/s rd, 577 KiB/s wr, 13 op/s 2023-05-08T14:34:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:34:21 smithi186 ceph-mon[126480]: pgmap v20853: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 575 KiB/s rd, 573 KiB/s wr, 7 op/s 2023-05-08T14:34:22.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:34:21 smithi133 ceph-mon[125939]: pgmap v20853: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 575 KiB/s rd, 573 KiB/s wr, 7 op/s 2023-05-08T14:34:22.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:34:21 smithi096 ceph-mon[124666]: pgmap v20853: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 575 KiB/s rd, 573 KiB/s wr, 7 op/s 2023-05-08T14:34:24.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:34:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39003.463553 secs 2023-05-08T14:34:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:34:24 smithi133 ceph-mon[125939]: pgmap v20854: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 575 KiB/s rd, 573 KiB/s wr, 7 op/s 2023-05-08T14:34:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:34:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39003.463553 secs 2023-05-08T14:34:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:34:24 smithi096 ceph-mon[124666]: pgmap v20854: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 575 KiB/s rd, 573 KiB/s wr, 7 op/s 2023-05-08T14:34:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:34:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39003.463553 secs 2023-05-08T14:34:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:34:24 smithi186 ceph-mon[126480]: pgmap v20854: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 575 KiB/s rd, 573 KiB/s wr, 7 op/s 2023-05-08T14:34:25.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:34:25 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:34:25.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:34:25 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:34:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:34:25 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:34:26.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:34:26 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:34:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:34:26 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:34:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:34:26 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:34:26.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:34:26 smithi133 ceph-mon[125939]: pgmap v20855: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 16 op/s 2023-05-08T14:34:26.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:34:26 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:34:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:34:26 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:34:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:34:26 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:34:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:34:26 smithi096 ceph-mon[124666]: pgmap v20855: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 16 op/s 2023-05-08T14:34:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:34:26 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:34:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:34:26 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:34:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:34:26 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:34:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:34:26 smithi186 ceph-mon[126480]: pgmap v20855: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 16 op/s 2023-05-08T14:34:29.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:34:28 smithi186 ceph-mon[126480]: pgmap v20856: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 890 KiB/s rd, 925 KiB/s wr, 11 op/s 2023-05-08T14:34:29.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:34:28 smithi133 ceph-mon[125939]: pgmap v20856: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 890 KiB/s rd, 925 KiB/s wr, 11 op/s 2023-05-08T14:34:29.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:34:28 smithi096 ceph-mon[124666]: pgmap v20856: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 890 KiB/s rd, 925 KiB/s wr, 11 op/s 2023-05-08T14:34:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:34:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39008.463663 secs 2023-05-08T14:34:30.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:34:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39008.463663 secs 2023-05-08T14:34:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:34:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39008.463663 secs 2023-05-08T14:34:31.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:34:30 smithi186 ceph-mon[126480]: pgmap v20857: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 911 KiB/s rd, 959 KiB/s wr, 15 op/s 2023-05-08T14:34:31.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:34:30 smithi133 ceph-mon[125939]: pgmap v20857: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 911 KiB/s rd, 959 KiB/s wr, 15 op/s 2023-05-08T14:34:31.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:34:30 smithi096 ceph-mon[124666]: pgmap v20857: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 911 KiB/s rd, 959 KiB/s wr, 15 op/s 2023-05-08T14:34:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:34:31 smithi186 ceph-mon[126480]: osdmap e1380: 12 total, 12 up, 12 in 2023-05-08T14:34:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:34:31 smithi186 ceph-mon[126480]: pgmap v20859: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T14:34:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:34:31 smithi133 ceph-mon[125939]: osdmap e1380: 12 total, 12 up, 12 in 2023-05-08T14:34:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:34:31 smithi133 ceph-mon[125939]: pgmap v20859: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T14:34:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:34:31 smithi096 ceph-mon[124666]: osdmap e1380: 12 total, 12 up, 12 in 2023-05-08T14:34:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:34:31 smithi096 ceph-mon[124666]: pgmap v20859: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T14:34:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:34:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39013.463779 secs 2023-05-08T14:34:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:34:34 smithi133 ceph-mon[125939]: pgmap v20860: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T14:34:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:34:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39013.463779 secs 2023-05-08T14:34:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:34:34 smithi096 ceph-mon[124666]: pgmap v20860: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T14:34:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:34:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39013.463779 secs 2023-05-08T14:34:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:34:34 smithi186 ceph-mon[126480]: pgmap v20860: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T14:34:37.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:34:36 smithi186 ceph-mon[126480]: pgmap v20861: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 523 KiB/s wr, 9 op/s 2023-05-08T14:34:37.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:34:36 smithi133 ceph-mon[125939]: pgmap v20861: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 523 KiB/s wr, 9 op/s 2023-05-08T14:34:37.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:34:36 smithi096 ceph-mon[124666]: pgmap v20861: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 523 KiB/s wr, 9 op/s 2023-05-08T14:34:38.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:34:37 smithi186 ceph-mon[126480]: pgmap v20862: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 523 KiB/s wr, 9 op/s 2023-05-08T14:34:38.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:34:37 smithi133 ceph-mon[125939]: pgmap v20862: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 523 KiB/s wr, 9 op/s 2023-05-08T14:34:38.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:34:37 smithi096 ceph-mon[124666]: pgmap v20862: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 523 KiB/s wr, 9 op/s 2023-05-08T14:34:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:34:39 smithi133 ceph-mon[125939]: osdmap e1381: 12 total, 12 up, 12 in 2023-05-08T14:34:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:34:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39018.463844 secs 2023-05-08T14:34:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:34:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39019.017222 secs 2023-05-08T14:34:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:34:39 smithi096 ceph-mon[124666]: osdmap e1381: 12 total, 12 up, 12 in 2023-05-08T14:34:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:34:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39018.463844 secs 2023-05-08T14:34:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:34:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39019.017222 secs 2023-05-08T14:34:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:34:39 smithi186 ceph-mon[126480]: osdmap e1381: 12 total, 12 up, 12 in 2023-05-08T14:34:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:34:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39018.463844 secs 2023-05-08T14:34:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:34:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39019.017222 secs 2023-05-08T14:34:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:34:40 smithi133 ceph-mon[125939]: pgmap v20864: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 12 op/s 2023-05-08T14:34:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:34:40 smithi096 ceph-mon[124666]: pgmap v20864: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 12 op/s 2023-05-08T14:34:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:34:40 smithi186 ceph-mon[126480]: pgmap v20864: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 12 op/s 2023-05-08T14:34:41.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:34:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39020.359422 secs 2023-05-08T14:34:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:34:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39020.359422 secs 2023-05-08T14:34:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:34:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39020.359422 secs 2023-05-08T14:34:42.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:34:42 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:34:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:34:42 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:34:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:34:42 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:34:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:34:42 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:34:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:34:42 smithi133 ceph-mon[125939]: pgmap v20865: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T14:34:42.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:34:42 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:34:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:34:42 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:34:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:34:42 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:34:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:34:42 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:34:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:34:42 smithi096 ceph-mon[124666]: pgmap v20865: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T14:34:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:34:42 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:34:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:34:42 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:34:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:34:42 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:34:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:34:42 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:34:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:34:42 smithi186 ceph-mon[126480]: pgmap v20865: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T14:34:44.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:34:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39023.463965 secs 2023-05-08T14:34:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:34:44 smithi133 ceph-mon[125939]: pgmap v20866: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T14:34:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:34:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39024.017339 secs 2023-05-08T14:34:44.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:34:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39023.463965 secs 2023-05-08T14:34:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:34:44 smithi096 ceph-mon[124666]: pgmap v20866: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T14:34:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:34:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39024.017339 secs 2023-05-08T14:34:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:34:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39023.463965 secs 2023-05-08T14:34:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:34:44 smithi186 ceph-mon[126480]: pgmap v20866: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T14:34:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:34:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39024.017339 secs 2023-05-08T14:34:47.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:34:46 smithi186 ceph-mon[126480]: pgmap v20867: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 13 op/s 2023-05-08T14:34:47.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:34:46 smithi133 ceph-mon[125939]: pgmap v20867: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 13 op/s 2023-05-08T14:34:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:34:46 smithi096 ceph-mon[124666]: pgmap v20867: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 13 op/s 2023-05-08T14:34:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:34:47 smithi186 ceph-mon[126480]: pgmap v20868: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 13 op/s 2023-05-08T14:34:48.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:34:47 smithi133 ceph-mon[125939]: pgmap v20868: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 13 op/s 2023-05-08T14:34:48.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:34:47 smithi096 ceph-mon[124666]: pgmap v20868: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 13 op/s 2023-05-08T14:34:49.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:34:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39028.464063 secs 2023-05-08T14:34:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:34:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:34:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:34:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39029.017455 secs 2023-05-08T14:34:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:34:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39028.464063 secs 2023-05-08T14:34:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:34:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:34:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:34:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39029.017455 secs 2023-05-08T14:34:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:34:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39028.464063 secs 2023-05-08T14:34:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:34:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:34:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:34:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39029.017455 secs 2023-05-08T14:34:50.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:34:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:34:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:34:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:34:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:34:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:34:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:34:50 smithi133 ceph-mon[125939]: pgmap v20869: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 17 op/s 2023-05-08T14:34:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:34:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:34:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:34:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:34:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:34:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:34:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:34:50 smithi096 ceph-mon[124666]: pgmap v20869: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 17 op/s 2023-05-08T14:34:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:34:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:34:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:34:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:34:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:34:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:34:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:34:50 smithi186 ceph-mon[126480]: pgmap v20869: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 17 op/s 2023-05-08T14:34:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:34:51 smithi186 ceph-mon[126480]: pgmap v20870: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T14:34:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:34:51 smithi133 ceph-mon[125939]: pgmap v20870: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T14:34:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:34:51 smithi096 ceph-mon[124666]: pgmap v20870: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T14:34:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:34:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39033.464178 secs 2023-05-08T14:34:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:34:54 smithi133 ceph-mon[125939]: pgmap v20871: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T14:34:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:34:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39033.464178 secs 2023-05-08T14:34:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:34:54 smithi096 ceph-mon[124666]: pgmap v20871: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T14:34:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:34:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39033.464178 secs 2023-05-08T14:34:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:34:54 smithi186 ceph-mon[126480]: pgmap v20871: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T14:34:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:34:55 smithi186 ceph-mon[126480]: pgmap v20872: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 18 op/s 2023-05-08T14:34:56.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:34:55 smithi133 ceph-mon[125939]: pgmap v20872: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 18 op/s 2023-05-08T14:34:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:34:55 smithi096 ceph-mon[124666]: pgmap v20872: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 18 op/s 2023-05-08T14:34:57.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:34:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:34:57.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:34:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:34:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:34:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:34:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:34:58 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:34:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:34:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:34:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:34:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:34:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:34:58 smithi186 ceph-mon[126480]: pgmap v20873: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 12 op/s 2023-05-08T14:34:58.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:34:58 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:34:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:34:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:34:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:34:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:34:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:34:58 smithi133 ceph-mon[125939]: pgmap v20873: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 12 op/s 2023-05-08T14:34:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:34:58 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:34:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:34:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:34:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:34:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:34:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:34:58 smithi096 ceph-mon[124666]: pgmap v20873: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 12 op/s 2023-05-08T14:34:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:34:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:34:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:34:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39038.464245 secs 2023-05-08T14:34:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:34:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:34:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:34:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:34:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:34:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:34:59.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:34:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:34:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:34:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39038.464245 secs 2023-05-08T14:34:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:34:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:34:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:34:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:34:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:34:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:34:59.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:34:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:34:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:34:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39038.464245 secs 2023-05-08T14:34:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:34:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:34:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:34:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:34:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:34:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:35:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:00 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:35:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:00 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T14:35:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:00 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T14:35:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:00 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:35:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39039.017662 secs 2023-05-08T14:35:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:00 smithi186 ceph-mon[126480]: pgmap v20874: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 18 op/s 2023-05-08T14:35:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:00 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:35:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:00 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T14:35:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:00 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T14:35:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:00 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:35:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39039.017662 secs 2023-05-08T14:35:00.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:00 smithi133 ceph-mon[125939]: pgmap v20874: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 18 op/s 2023-05-08T14:35:00.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:00 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:35:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:00 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T14:35:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:00 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T14:35:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:00 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:35:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39039.017662 secs 2023-05-08T14:35:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:00 smithi096 ceph-mon[124666]: pgmap v20874: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 18 op/s 2023-05-08T14:35:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:35:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:35:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:02 smithi186 ceph-mon[126480]: pgmap v20875: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 13 op/s 2023-05-08T14:35:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:35:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:35:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:02 smithi133 ceph-mon[125939]: pgmap v20875: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 13 op/s 2023-05-08T14:35:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:35:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:35:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:02 smithi096 ceph-mon[124666]: pgmap v20875: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 13 op/s 2023-05-08T14:35:03.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:03 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:35:03.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:03 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:35:04.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:03 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:35:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39043.464363 secs 2023-05-08T14:35:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:04 smithi186 ceph-mon[126480]: pgmap v20876: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 13 op/s 2023-05-08T14:35:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39044.017802 secs 2023-05-08T14:35:04.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39043.464363 secs 2023-05-08T14:35:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:04 smithi133 ceph-mon[125939]: pgmap v20876: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 13 op/s 2023-05-08T14:35:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39044.017802 secs 2023-05-08T14:35:05.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39043.464363 secs 2023-05-08T14:35:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:04 smithi096 ceph-mon[124666]: pgmap v20876: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 13 op/s 2023-05-08T14:35:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39044.017802 secs 2023-05-08T14:35:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39045.359991 secs 2023-05-08T14:35:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:05 smithi186 ceph-mon[126480]: pgmap v20877: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.7 MiB/s wr, 34 op/s 2023-05-08T14:35:06.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39045.359991 secs 2023-05-08T14:35:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:05 smithi133 ceph-mon[125939]: pgmap v20877: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.7 MiB/s wr, 34 op/s 2023-05-08T14:35:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39045.359991 secs 2023-05-08T14:35:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:05 smithi096 ceph-mon[124666]: pgmap v20877: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.7 MiB/s wr, 34 op/s 2023-05-08T14:35:08.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:07 smithi186 ceph-mon[126480]: pgmap v20878: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 26 op/s 2023-05-08T14:35:08.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:07 smithi133 ceph-mon[125939]: pgmap v20878: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 26 op/s 2023-05-08T14:35:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:07 smithi096 ceph-mon[124666]: pgmap v20878: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 26 op/s 2023-05-08T14:35:09.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39048.464473 secs 2023-05-08T14:35:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39049.017953 secs 2023-05-08T14:35:09.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39048.464473 secs 2023-05-08T14:35:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39049.017953 secs 2023-05-08T14:35:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39048.464473 secs 2023-05-08T14:35:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39049.017953 secs 2023-05-08T14:35:10.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:10 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:35:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:10 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:35:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:10 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:35:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:10 smithi133 ceph-mon[125939]: pgmap v20879: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 31 op/s 2023-05-08T14:35:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:10 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:35:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:10 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:35:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:10 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:35:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:10 smithi096 ceph-mon[124666]: pgmap v20879: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 31 op/s 2023-05-08T14:35:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:10 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:35:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:10 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:35:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:10 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:35:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:10 smithi186 ceph-mon[126480]: pgmap v20879: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 31 op/s 2023-05-08T14:35:11.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39050.360067 secs 2023-05-08T14:35:11.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39050.360067 secs 2023-05-08T14:35:11.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39050.360067 secs 2023-05-08T14:35:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:12 smithi096 ceph-mon[124666]: osdmap e1382: 12 total, 12 up, 12 in 2023-05-08T14:35:12.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:12 smithi096 ceph-mon[124666]: pgmap v20881: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 933 KiB/s rd, 1.4 MiB/s wr, 29 op/s 2023-05-08T14:35:12.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:12 smithi186 ceph-mon[126480]: osdmap e1382: 12 total, 12 up, 12 in 2023-05-08T14:35:12.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:12 smithi186 ceph-mon[126480]: pgmap v20881: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 933 KiB/s rd, 1.4 MiB/s wr, 29 op/s 2023-05-08T14:35:12.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:12 smithi133 ceph-mon[125939]: osdmap e1382: 12 total, 12 up, 12 in 2023-05-08T14:35:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:12 smithi133 ceph-mon[125939]: pgmap v20881: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 933 KiB/s rd, 1.4 MiB/s wr, 29 op/s 2023-05-08T14:35:14.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39053.464553 secs 2023-05-08T14:35:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:14 smithi133 ceph-mon[125939]: pgmap v20882: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 933 KiB/s rd, 1.4 MiB/s wr, 29 op/s 2023-05-08T14:35:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39054.018076 secs 2023-05-08T14:35:14.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39053.464553 secs 2023-05-08T14:35:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:14 smithi096 ceph-mon[124666]: pgmap v20882: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 933 KiB/s rd, 1.4 MiB/s wr, 29 op/s 2023-05-08T14:35:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39054.018076 secs 2023-05-08T14:35:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39053.464553 secs 2023-05-08T14:35:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:14 smithi186 ceph-mon[126480]: pgmap v20882: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 933 KiB/s rd, 1.4 MiB/s wr, 29 op/s 2023-05-08T14:35:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39054.018076 secs 2023-05-08T14:35:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39055.360188 secs 2023-05-08T14:35:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:15 smithi186 ceph-mon[126480]: pgmap v20883: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 991 KiB/s rd, 990 KiB/s wr, 11 op/s 2023-05-08T14:35:16.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39055.360188 secs 2023-05-08T14:35:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:15 smithi133 ceph-mon[125939]: pgmap v20883: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 991 KiB/s rd, 990 KiB/s wr, 11 op/s 2023-05-08T14:35:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39055.360188 secs 2023-05-08T14:35:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:15 smithi096 ceph-mon[124666]: pgmap v20883: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 991 KiB/s rd, 990 KiB/s wr, 11 op/s 2023-05-08T14:35:18.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:17 smithi186 ceph-mon[126480]: pgmap v20884: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 991 KiB/s rd, 990 KiB/s wr, 11 op/s 2023-05-08T14:35:18.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:17 smithi133 ceph-mon[125939]: pgmap v20884: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 991 KiB/s rd, 990 KiB/s wr, 11 op/s 2023-05-08T14:35:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:17 smithi096 ceph-mon[124666]: pgmap v20884: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 991 KiB/s rd, 990 KiB/s wr, 11 op/s 2023-05-08T14:35:19.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:19 smithi133 ceph-mon[125939]: osdmap e1383: 12 total, 12 up, 12 in 2023-05-08T14:35:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39058.464688 secs 2023-05-08T14:35:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39059.018212 secs 2023-05-08T14:35:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:19 smithi096 ceph-mon[124666]: osdmap e1383: 12 total, 12 up, 12 in 2023-05-08T14:35:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39058.464688 secs 2023-05-08T14:35:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39059.018212 secs 2023-05-08T14:35:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:19 smithi186 ceph-mon[126480]: osdmap e1383: 12 total, 12 up, 12 in 2023-05-08T14:35:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39058.464688 secs 2023-05-08T14:35:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39059.018212 secs 2023-05-08T14:35:20.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:20 smithi133 ceph-mon[125939]: pgmap v20886: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T14:35:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:20 smithi096 ceph-mon[124666]: pgmap v20886: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T14:35:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:20 smithi186 ceph-mon[126480]: pgmap v20886: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T14:35:21.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39060.360308 secs 2023-05-08T14:35:21.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39060.360308 secs 2023-05-08T14:35:21.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39060.360308 secs 2023-05-08T14:35:22.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:22 smithi133 ceph-mon[125939]: pgmap v20887: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T14:35:22.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:22 smithi096 ceph-mon[124666]: pgmap v20887: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T14:35:22.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:22 smithi186 ceph-mon[126480]: pgmap v20887: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T14:35:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39063.464802 secs 2023-05-08T14:35:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:24 smithi133 ceph-mon[125939]: pgmap v20888: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T14:35:24.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39064.018306 secs 2023-05-08T14:35:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39063.464802 secs 2023-05-08T14:35:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:24 smithi096 ceph-mon[124666]: pgmap v20888: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T14:35:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39064.018306 secs 2023-05-08T14:35:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39063.464802 secs 2023-05-08T14:35:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:24 smithi186 ceph-mon[126480]: pgmap v20888: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T14:35:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39064.018306 secs 2023-05-08T14:35:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39065.360421 secs 2023-05-08T14:35:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:25 smithi186 ceph-mon[126480]: pgmap v20889: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T14:35:26.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39065.360421 secs 2023-05-08T14:35:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:25 smithi133 ceph-mon[125939]: pgmap v20889: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T14:35:26.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39065.360421 secs 2023-05-08T14:35:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:25 smithi096 ceph-mon[124666]: pgmap v20889: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T14:35:28.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:27 smithi186 ceph-mon[126480]: pgmap v20890: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T14:35:28.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:27 smithi133 ceph-mon[125939]: pgmap v20890: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T14:35:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:27 smithi096 ceph-mon[124666]: pgmap v20890: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T14:35:29.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39068.464937 secs 2023-05-08T14:35:29.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39069.018419 secs 2023-05-08T14:35:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39068.464937 secs 2023-05-08T14:35:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39069.018419 secs 2023-05-08T14:35:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39068.464937 secs 2023-05-08T14:35:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39069.018419 secs 2023-05-08T14:35:30.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:30 smithi133 ceph-mon[125939]: pgmap v20891: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T14:35:30.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:30 smithi096 ceph-mon[124666]: pgmap v20891: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T14:35:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:30 smithi186 ceph-mon[126480]: pgmap v20891: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T14:35:31.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39070.360533 secs 2023-05-08T14:35:31.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39070.360533 secs 2023-05-08T14:35:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39070.360533 secs 2023-05-08T14:35:32.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:32 smithi133 ceph-mon[125939]: pgmap v20892: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 960 KiB/s rd, 580 KiB/s wr, 9 op/s 2023-05-08T14:35:32.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:32 smithi096 ceph-mon[124666]: pgmap v20892: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 960 KiB/s rd, 580 KiB/s wr, 9 op/s 2023-05-08T14:35:32.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:32 smithi186 ceph-mon[126480]: pgmap v20892: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 960 KiB/s rd, 580 KiB/s wr, 9 op/s 2023-05-08T14:35:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39073.465071 secs 2023-05-08T14:35:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:34 smithi133 ceph-mon[125939]: pgmap v20893: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 643 KiB/s rd, 262 KiB/s wr, 8 op/s 2023-05-08T14:35:34.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39074.018535 secs 2023-05-08T14:35:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39073.465071 secs 2023-05-08T14:35:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:34 smithi096 ceph-mon[124666]: pgmap v20893: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 643 KiB/s rd, 262 KiB/s wr, 8 op/s 2023-05-08T14:35:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39074.018535 secs 2023-05-08T14:35:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39073.465071 secs 2023-05-08T14:35:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:34 smithi186 ceph-mon[126480]: pgmap v20893: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 643 KiB/s rd, 262 KiB/s wr, 8 op/s 2023-05-08T14:35:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39074.018535 secs 2023-05-08T14:35:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39075.360650 secs 2023-05-08T14:35:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:35 smithi186 ceph-mon[126480]: pgmap v20894: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 972 KiB/s rd, 591 KiB/s wr, 12 op/s 2023-05-08T14:35:36.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39075.360650 secs 2023-05-08T14:35:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:35 smithi133 ceph-mon[125939]: pgmap v20894: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 972 KiB/s rd, 591 KiB/s wr, 12 op/s 2023-05-08T14:35:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39075.360650 secs 2023-05-08T14:35:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:35 smithi096 ceph-mon[124666]: pgmap v20894: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 972 KiB/s rd, 591 KiB/s wr, 12 op/s 2023-05-08T14:35:38.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:37 smithi186 ceph-mon[126480]: pgmap v20895: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 381 KiB/s wr, 7 op/s 2023-05-08T14:35:38.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:37 smithi133 ceph-mon[125939]: pgmap v20895: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 381 KiB/s wr, 7 op/s 2023-05-08T14:35:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:37 smithi096 ceph-mon[124666]: pgmap v20895: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 381 KiB/s wr, 7 op/s 2023-05-08T14:35:39.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39078.465212 secs 2023-05-08T14:35:39.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39079.018653 secs 2023-05-08T14:35:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39078.465212 secs 2023-05-08T14:35:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39079.018653 secs 2023-05-08T14:35:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39078.465212 secs 2023-05-08T14:35:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39079.018653 secs 2023-05-08T14:35:40.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:40 smithi133 ceph-mon[125939]: pgmap v20896: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 384 KiB/s rd, 381 KiB/s wr, 10 op/s 2023-05-08T14:35:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:40 smithi096 ceph-mon[124666]: pgmap v20896: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 384 KiB/s rd, 381 KiB/s wr, 10 op/s 2023-05-08T14:35:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:40 smithi186 ceph-mon[126480]: pgmap v20896: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 384 KiB/s rd, 381 KiB/s wr, 10 op/s 2023-05-08T14:35:41.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39080.360770 secs 2023-05-08T14:35:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39080.360770 secs 2023-05-08T14:35:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39080.360770 secs 2023-05-08T14:35:42.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:42 smithi133 ceph-mon[125939]: pgmap v20897: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 673 KiB/s rd, 670 KiB/s wr, 7 op/s 2023-05-08T14:35:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:42 smithi096 ceph-mon[124666]: pgmap v20897: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 673 KiB/s rd, 670 KiB/s wr, 7 op/s 2023-05-08T14:35:42.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:42 smithi186 ceph-mon[126480]: pgmap v20897: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 673 KiB/s rd, 670 KiB/s wr, 7 op/s 2023-05-08T14:35:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39083.465412 secs 2023-05-08T14:35:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:44 smithi133 ceph-mon[125939]: pgmap v20898: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 648 KiB/s rd, 646 KiB/s wr, 6 op/s 2023-05-08T14:35:44.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39084.018730 secs 2023-05-08T14:35:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39083.465412 secs 2023-05-08T14:35:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:44 smithi096 ceph-mon[124666]: pgmap v20898: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 648 KiB/s rd, 646 KiB/s wr, 6 op/s 2023-05-08T14:35:44.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39084.018730 secs 2023-05-08T14:35:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39083.465412 secs 2023-05-08T14:35:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:44 smithi186 ceph-mon[126480]: pgmap v20898: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 648 KiB/s rd, 646 KiB/s wr, 6 op/s 2023-05-08T14:35:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39084.018730 secs 2023-05-08T14:35:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:45 smithi186 ceph-mon[126480]: pgmap v20899: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 686 KiB/s rd, 729 KiB/s wr, 10 op/s 2023-05-08T14:35:46.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:45 smithi133 ceph-mon[125939]: pgmap v20899: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 686 KiB/s rd, 729 KiB/s wr, 10 op/s 2023-05-08T14:35:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:45 smithi096 ceph-mon[124666]: pgmap v20899: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 686 KiB/s rd, 729 KiB/s wr, 10 op/s 2023-05-08T14:35:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:47 smithi186 ceph-mon[126480]: pgmap v20900: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 400 KiB/s wr, 6 op/s 2023-05-08T14:35:48.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:47 smithi133 ceph-mon[125939]: pgmap v20900: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 400 KiB/s wr, 6 op/s 2023-05-08T14:35:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:47 smithi096 ceph-mon[124666]: pgmap v20900: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 400 KiB/s wr, 6 op/s 2023-05-08T14:35:49.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39088.465527 secs 2023-05-08T14:35:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:35:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39089.018851 secs 2023-05-08T14:35:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39088.465527 secs 2023-05-08T14:35:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:35:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39089.018851 secs 2023-05-08T14:35:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39088.465527 secs 2023-05-08T14:35:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:35:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39089.018851 secs 2023-05-08T14:35:50.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:35:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:35:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:35:50.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:50 smithi096 ceph-mon[124666]: pgmap v20901: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 796 KiB/s rd, 706 KiB/s wr, 10 op/s 2023-05-08T14:35:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:35:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:35:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:35:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:50 smithi186 ceph-mon[126480]: pgmap v20901: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 796 KiB/s rd, 706 KiB/s wr, 10 op/s 2023-05-08T14:35:50.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:35:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:35:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:35:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:50 smithi133 ceph-mon[125939]: pgmap v20901: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 796 KiB/s rd, 706 KiB/s wr, 10 op/s 2023-05-08T14:35:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:51 smithi186 ceph-mon[126480]: pgmap v20902: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 842 KiB/s rd, 886 KiB/s wr, 8 op/s 2023-05-08T14:35:52.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:51 smithi133 ceph-mon[125939]: pgmap v20902: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 842 KiB/s rd, 886 KiB/s wr, 8 op/s 2023-05-08T14:35:52.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:51 smithi096 ceph-mon[124666]: pgmap v20902: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 842 KiB/s rd, 886 KiB/s wr, 8 op/s 2023-05-08T14:35:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39093.465638 secs 2023-05-08T14:35:54.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:54 smithi133 ceph-mon[125939]: pgmap v20903: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 525 KiB/s rd, 570 KiB/s wr, 7 op/s 2023-05-08T14:35:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39093.465638 secs 2023-05-08T14:35:54.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:54 smithi096 ceph-mon[124666]: pgmap v20903: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 525 KiB/s rd, 570 KiB/s wr, 7 op/s 2023-05-08T14:35:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39093.465638 secs 2023-05-08T14:35:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:54 smithi186 ceph-mon[126480]: pgmap v20903: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 525 KiB/s rd, 570 KiB/s wr, 7 op/s 2023-05-08T14:35:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:55 smithi186 ceph-mon[126480]: pgmap v20904: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 985 KiB/s wr, 12 op/s 2023-05-08T14:35:56.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:55 smithi133 ceph-mon[125939]: pgmap v20904: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 985 KiB/s wr, 12 op/s 2023-05-08T14:35:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:55 smithi096 ceph-mon[124666]: pgmap v20904: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 985 KiB/s wr, 12 op/s 2023-05-08T14:35:57.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:35:57.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:35:57.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:35:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:58 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:35:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:35:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:35:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:58 smithi186 ceph-mon[126480]: pgmap v20905: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 901 KiB/s wr, 9 op/s 2023-05-08T14:35:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:58 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:35:58.766 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:35:58.766 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:35:58.767 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:58 smithi133 ceph-mon[125939]: pgmap v20905: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 901 KiB/s wr, 9 op/s 2023-05-08T14:35:58.767 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:58 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:35:58.767 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:35:58.767 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:35:58.768 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:58 smithi096 ceph-mon[124666]: pgmap v20905: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 901 KiB/s wr, 9 op/s 2023-05-08T14:35:59.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39098.465760 secs 2023-05-08T14:35:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:35:59 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:35:59.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39098.465760 secs 2023-05-08T14:35:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:35:59 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:35:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39098.465760 secs 2023-05-08T14:35:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:35:59 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:36:00.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:36:00 smithi133 ceph-mon[125939]: pgmap v20906: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2023-05-08T14:36:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:36:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:36:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:36:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:36:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:36:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:36:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:36:00 smithi096 ceph-mon[124666]: pgmap v20906: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2023-05-08T14:36:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:36:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:36:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:36:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:36:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:36:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:36:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:36:00 smithi186 ceph-mon[126480]: pgmap v20906: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2023-05-08T14:36:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:36:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:36:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:36:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:36:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:36:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:36:01.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:36:01 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:36:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:36:01 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T14:36:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:36:01 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T14:36:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:36:01 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:36:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:36:01 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:36:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:36:01 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T14:36:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:36:01 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T14:36:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:36:01 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:36:01.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:36:01 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:36:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:36:01 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T14:36:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:36:01 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T14:36:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:36:01 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:36:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:36:02 smithi096 ceph-mon[124666]: pgmap v20907: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 962 KiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T14:36:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:36:02 smithi186 ceph-mon[126480]: pgmap v20907: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 962 KiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T14:36:02.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:36:02 smithi133 ceph-mon[125939]: pgmap v20907: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 962 KiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T14:36:04.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:36:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39103.465860 secs 2023-05-08T14:36:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:36:04 smithi133 ceph-mon[125939]: pgmap v20908: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 915 KiB/s rd, 1006 KiB/s wr, 9 op/s 2023-05-08T14:36:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:36:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39104.019161 secs 2023-05-08T14:36:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:36:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39103.465860 secs 2023-05-08T14:36:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:36:04 smithi096 ceph-mon[124666]: pgmap v20908: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 915 KiB/s rd, 1006 KiB/s wr, 9 op/s 2023-05-08T14:36:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:36:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39104.019161 secs 2023-05-08T14:36:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:36:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39103.465860 secs 2023-05-08T14:36:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:36:04 smithi186 ceph-mon[126480]: pgmap v20908: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 915 KiB/s rd, 1006 KiB/s wr, 9 op/s 2023-05-08T14:36:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:36:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39104.019161 secs 2023-05-08T14:36:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:36:05 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:36:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:36:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:36:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:36:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:36:05.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:36:05 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:36:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:36:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:36:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:36:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:36:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:36:05 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:36:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:36:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:36:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:36:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:36:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:36:06 smithi186 ceph-mon[126480]: pgmap v20909: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.8 MiB/s wr, 28 op/s 2023-05-08T14:36:06.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:36:06 smithi133 ceph-mon[125939]: pgmap v20909: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.8 MiB/s wr, 28 op/s 2023-05-08T14:36:07.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:36:06 smithi096 ceph-mon[124666]: pgmap v20909: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.8 MiB/s wr, 28 op/s 2023-05-08T14:36:08.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:36:07 smithi186 ceph-mon[126480]: pgmap v20910: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 23 op/s 2023-05-08T14:36:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:36:07 smithi133 ceph-mon[125939]: pgmap v20910: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 23 op/s 2023-05-08T14:36:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:36:07 smithi096 ceph-mon[124666]: pgmap v20910: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 23 op/s 2023-05-08T14:36:09.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:36:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39108.465983 secs 2023-05-08T14:36:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:36:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39109.019257 secs 2023-05-08T14:36:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:36:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39108.465983 secs 2023-05-08T14:36:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:36:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39109.019257 secs 2023-05-08T14:36:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:36:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39108.465983 secs 2023-05-08T14:36:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:36:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39109.019257 secs 2023-05-08T14:36:10.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:36:10 smithi096 ceph-mon[124666]: pgmap v20911: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.4 MiB/s wr, 27 op/s 2023-05-08T14:36:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:36:10 smithi186 ceph-mon[126480]: pgmap v20911: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.4 MiB/s wr, 27 op/s 2023-05-08T14:36:10.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:36:10 smithi133 ceph-mon[125939]: pgmap v20911: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.4 MiB/s wr, 27 op/s 2023-05-08T14:36:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:36:11 smithi186 ceph-mon[126480]: pgmap v20912: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 931 KiB/s wr, 23 op/s 2023-05-08T14:36:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:36:11 smithi133 ceph-mon[125939]: pgmap v20912: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 931 KiB/s wr, 23 op/s 2023-05-08T14:36:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:36:11 smithi096 ceph-mon[124666]: pgmap v20912: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 931 KiB/s wr, 23 op/s 2023-05-08T14:36:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:36:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39113.466103 secs 2023-05-08T14:36:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:36:14 smithi133 ceph-mon[125939]: pgmap v20913: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 860 KiB/s wr, 22 op/s 2023-05-08T14:36:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:36:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39114.019320 secs 2023-05-08T14:36:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:36:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39113.466103 secs 2023-05-08T14:36:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:36:14 smithi096 ceph-mon[124666]: pgmap v20913: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 860 KiB/s wr, 22 op/s 2023-05-08T14:36:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:36:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39114.019320 secs 2023-05-08T14:36:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:36:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39113.466103 secs 2023-05-08T14:36:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:36:14 smithi186 ceph-mon[126480]: pgmap v20913: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 860 KiB/s wr, 22 op/s 2023-05-08T14:36:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:36:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39114.019320 secs 2023-05-08T14:36:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:36:15 smithi186 ceph-mon[126480]: pgmap v20914: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 26 op/s 2023-05-08T14:36:16.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:36:15 smithi133 ceph-mon[125939]: pgmap v20914: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 26 op/s 2023-05-08T14:36:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:36:15 smithi096 ceph-mon[124666]: pgmap v20914: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 26 op/s 2023-05-08T14:36:18.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:36:17 smithi186 ceph-mon[126480]: pgmap v20915: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 553 KiB/s wr, 8 op/s 2023-05-08T14:36:18.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:36:17 smithi133 ceph-mon[125939]: pgmap v20915: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 553 KiB/s wr, 8 op/s 2023-05-08T14:36:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:36:17 smithi096 ceph-mon[124666]: pgmap v20915: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 553 KiB/s wr, 8 op/s 2023-05-08T14:36:19.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:36:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39118.466236 secs 2023-05-08T14:36:19.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:36:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39119.019437 secs 2023-05-08T14:36:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:36:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39118.466236 secs 2023-05-08T14:36:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:36:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39119.019437 secs 2023-05-08T14:36:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:36:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39118.466236 secs 2023-05-08T14:36:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:36:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39119.019437 secs 2023-05-08T14:36:20.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:36:20 smithi096 ceph-mon[124666]: pgmap v20916: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 553 KiB/s wr, 12 op/s 2023-05-08T14:36:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:36:20 smithi186 ceph-mon[126480]: pgmap v20916: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 553 KiB/s wr, 12 op/s 2023-05-08T14:36:20.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:36:20 smithi133 ceph-mon[125939]: pgmap v20916: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 553 KiB/s wr, 12 op/s 2023-05-08T14:36:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:36:21 smithi186 ceph-mon[126480]: pgmap v20917: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 550 KiB/s wr, 7 op/s 2023-05-08T14:36:22.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:36:21 smithi133 ceph-mon[125939]: pgmap v20917: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 550 KiB/s wr, 7 op/s 2023-05-08T14:36:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:36:21 smithi096 ceph-mon[124666]: pgmap v20917: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 550 KiB/s wr, 7 op/s 2023-05-08T14:36:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:36:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39123.466332 secs 2023-05-08T14:36:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:36:24 smithi096 ceph-mon[124666]: pgmap v20918: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 550 KiB/s wr, 7 op/s 2023-05-08T14:36:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:36:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39123.466332 secs 2023-05-08T14:36:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:36:24 smithi186 ceph-mon[126480]: pgmap v20918: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 550 KiB/s wr, 7 op/s 2023-05-08T14:36:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:36:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39123.466332 secs 2023-05-08T14:36:24.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:36:24 smithi133 ceph-mon[125939]: pgmap v20918: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 550 KiB/s wr, 7 op/s 2023-05-08T14:36:25.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:36:25 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:36:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:36:25 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:36:25.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:36:25 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:36:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:36:26 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:36:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:36:26 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:36:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:36:26 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:36:26.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:36:26 smithi096 ceph-mon[124666]: pgmap v20919: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 15 op/s 2023-05-08T14:36:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:36:26 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:36:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:36:26 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:36:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:36:26 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:36:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:36:26 smithi186 ceph-mon[126480]: pgmap v20919: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 15 op/s 2023-05-08T14:36:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:36:26 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:36:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:36:26 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:36:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:36:26 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:36:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:36:26 smithi133 ceph-mon[125939]: pgmap v20919: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 15 op/s 2023-05-08T14:36:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:36:27 smithi186 ceph-mon[126480]: pgmap v20920: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T14:36:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:36:27 smithi133 ceph-mon[125939]: pgmap v20920: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T14:36:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:36:27 smithi096 ceph-mon[124666]: pgmap v20920: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T14:36:29.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:36:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39128.466418 secs 2023-05-08T14:36:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:36:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39128.466418 secs 2023-05-08T14:36:29.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:36:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39128.466418 secs 2023-05-08T14:36:30.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:36:30 smithi096 ceph-mon[124666]: pgmap v20921: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 15 op/s 2023-05-08T14:36:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:36:30 smithi186 ceph-mon[126480]: pgmap v20921: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 15 op/s 2023-05-08T14:36:30.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:36:30 smithi133 ceph-mon[125939]: pgmap v20921: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 15 op/s 2023-05-08T14:36:32.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:36:32 smithi096 ceph-mon[124666]: osdmap e1384: 12 total, 12 up, 12 in 2023-05-08T14:36:32.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:36:32 smithi096 ceph-mon[124666]: pgmap v20923: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 14 op/s 2023-05-08T14:36:32.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:36:32 smithi186 ceph-mon[126480]: osdmap e1384: 12 total, 12 up, 12 in 2023-05-08T14:36:32.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:36:32 smithi186 ceph-mon[126480]: pgmap v20923: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 14 op/s 2023-05-08T14:36:32.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:36:32 smithi133 ceph-mon[125939]: osdmap e1384: 12 total, 12 up, 12 in 2023-05-08T14:36:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:36:32 smithi133 ceph-mon[125939]: pgmap v20923: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 14 op/s 2023-05-08T14:36:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:36:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39133.466536 secs 2023-05-08T14:36:34.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:36:34 smithi096 ceph-mon[124666]: pgmap v20924: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 14 op/s 2023-05-08T14:36:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:36:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39133.466536 secs 2023-05-08T14:36:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:36:34 smithi186 ceph-mon[126480]: pgmap v20924: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 14 op/s 2023-05-08T14:36:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:36:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39133.466536 secs 2023-05-08T14:36:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:36:34 smithi133 ceph-mon[125939]: pgmap v20924: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 14 op/s 2023-05-08T14:36:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:36:35 smithi186 ceph-mon[126480]: pgmap v20925: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 460 KiB/s rd, 458 KiB/s wr, 9 op/s 2023-05-08T14:36:36.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:36:35 smithi133 ceph-mon[125939]: pgmap v20925: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 460 KiB/s rd, 458 KiB/s wr, 9 op/s 2023-05-08T14:36:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:36:35 smithi096 ceph-mon[124666]: pgmap v20925: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 460 KiB/s rd, 458 KiB/s wr, 9 op/s 2023-05-08T14:36:38.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:36:37 smithi186 ceph-mon[126480]: pgmap v20926: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 460 KiB/s rd, 458 KiB/s wr, 9 op/s 2023-05-08T14:36:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:36:37 smithi133 ceph-mon[125939]: pgmap v20926: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 460 KiB/s rd, 458 KiB/s wr, 9 op/s 2023-05-08T14:36:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:36:37 smithi096 ceph-mon[124666]: pgmap v20926: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 460 KiB/s rd, 458 KiB/s wr, 9 op/s 2023-05-08T14:36:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:36:39 smithi096 ceph-mon[124666]: osdmap e1385: 12 total, 12 up, 12 in 2023-05-08T14:36:39.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:36:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39138.466695 secs 2023-05-08T14:36:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:36:39 smithi186 ceph-mon[126480]: osdmap e1385: 12 total, 12 up, 12 in 2023-05-08T14:36:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:36:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39138.466695 secs 2023-05-08T14:36:39.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:36:39 smithi133 ceph-mon[125939]: osdmap e1385: 12 total, 12 up, 12 in 2023-05-08T14:36:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:36:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39138.466695 secs 2023-05-08T14:36:40.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:36:40 smithi096 ceph-mon[124666]: pgmap v20928: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 507 KiB/s wr, 11 op/s 2023-05-08T14:36:40.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:36:40 smithi186 ceph-mon[126480]: pgmap v20928: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 507 KiB/s wr, 11 op/s 2023-05-08T14:36:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:36:40 smithi133 ceph-mon[125939]: pgmap v20928: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 507 KiB/s wr, 11 op/s 2023-05-08T14:36:41.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:36:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39140.362065 secs 2023-05-08T14:36:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:36:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39140.362065 secs 2023-05-08T14:36:41.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:36:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39140.362065 secs 2023-05-08T14:36:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:36:42 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:36:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:36:42 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:36:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:36:42 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:36:42.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:36:42 smithi096 ceph-mon[124666]: pgmap v20929: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 420 KiB/s wr, 9 op/s 2023-05-08T14:36:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:36:42 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:36:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:36:42 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:36:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:36:42 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:36:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:36:42 smithi186 ceph-mon[126480]: pgmap v20929: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 420 KiB/s wr, 9 op/s 2023-05-08T14:36:42.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:36:42 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:36:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:36:42 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:36:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:36:42 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:36:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:36:42 smithi133 ceph-mon[125939]: pgmap v20929: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 420 KiB/s wr, 9 op/s 2023-05-08T14:36:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:36:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39143.466833 secs 2023-05-08T14:36:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:36:44 smithi096 ceph-mon[124666]: pgmap v20930: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 420 KiB/s wr, 9 op/s 2023-05-08T14:36:44.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:36:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39144.019951 secs 2023-05-08T14:36:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:36:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39143.466833 secs 2023-05-08T14:36:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:36:44 smithi186 ceph-mon[126480]: pgmap v20930: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 420 KiB/s wr, 9 op/s 2023-05-08T14:36:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:36:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39144.019951 secs 2023-05-08T14:36:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:36:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39143.466833 secs 2023-05-08T14:36:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:36:44 smithi133 ceph-mon[125939]: pgmap v20930: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 420 KiB/s wr, 9 op/s 2023-05-08T14:36:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:36:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39144.019951 secs 2023-05-08T14:36:46.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:36:46 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:36:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:36:46 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:36:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:36:46 smithi186 ceph-mon[126480]: pgmap v20931: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 668 KiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T14:36:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:36:46 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:36:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:36:46 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:36:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:36:46 smithi133 ceph-mon[125939]: pgmap v20931: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 668 KiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T14:36:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:36:46 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:36:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:36:46 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:36:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:36:46 smithi096 ceph-mon[124666]: pgmap v20931: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 668 KiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T14:36:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:36:47 smithi186 ceph-mon[126480]: pgmap v20932: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 668 KiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T14:36:48.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:36:47 smithi133 ceph-mon[125939]: pgmap v20932: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 668 KiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T14:36:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:36:47 smithi096 ceph-mon[124666]: pgmap v20932: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 668 KiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T14:36:49.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:36:48 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:36:49.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:36:48 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:36:49.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:36:48 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:36:50.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:36:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39148.466949 secs 2023-05-08T14:36:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:36:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:36:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:36:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39149.020049 secs 2023-05-08T14:36:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:36:49 smithi133 ceph-mon[125939]: pgmap v20933: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 14 op/s 2023-05-08T14:36:50.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:36:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39148.466949 secs 2023-05-08T14:36:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:36:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:36:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:36:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39149.020049 secs 2023-05-08T14:36:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:36:49 smithi096 ceph-mon[124666]: pgmap v20933: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 14 op/s 2023-05-08T14:36:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:36:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39148.466949 secs 2023-05-08T14:36:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:36:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:36:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:36:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39149.020049 secs 2023-05-08T14:36:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:36:49 smithi186 ceph-mon[126480]: pgmap v20933: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 14 op/s 2023-05-08T14:36:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:36:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:36:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:36:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:36:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:36:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:36:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:36:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:36:51.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:36:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:36:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:36:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:36:52.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:36:51 smithi133 ceph-mon[125939]: pgmap v20934: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 10 op/s 2023-05-08T14:36:52.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:36:51 smithi096 ceph-mon[124666]: pgmap v20934: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 10 op/s 2023-05-08T14:36:52.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:36:51 smithi186 ceph-mon[126480]: pgmap v20934: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 10 op/s 2023-05-08T14:36:53.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:36:53 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:36:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:36:53 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:36:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:36:53 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:36:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:36:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39153.467065 secs 2023-05-08T14:36:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:36:54 smithi186 ceph-mon[126480]: pgmap v20935: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 10 op/s 2023-05-08T14:36:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:36:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39153.467065 secs 2023-05-08T14:36:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:36:54 smithi133 ceph-mon[125939]: pgmap v20935: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 10 op/s 2023-05-08T14:36:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:36:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39153.467065 secs 2023-05-08T14:36:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:36:54 smithi096 ceph-mon[124666]: pgmap v20935: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 10 op/s 2023-05-08T14:36:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:36:55 smithi186 ceph-mon[126480]: pgmap v20936: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.2 MiB/s wr, 16 op/s 2023-05-08T14:36:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:36:55 smithi133 ceph-mon[125939]: pgmap v20936: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.2 MiB/s wr, 16 op/s 2023-05-08T14:36:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:36:55 smithi096 ceph-mon[124666]: pgmap v20936: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.2 MiB/s wr, 16 op/s 2023-05-08T14:36:57.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:36:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:36:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:36:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:36:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:36:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:36:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:36:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:36:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:36:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:36:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:36:58 smithi186 ceph-mon[126480]: pgmap v20937: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T14:36:58.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:36:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:36:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:36:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:36:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:36:58 smithi133 ceph-mon[125939]: pgmap v20937: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T14:36:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:36:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:36:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:36:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:36:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:36:58 smithi096 ceph-mon[124666]: pgmap v20937: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T14:36:59.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:36:59 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:36:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:36:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39158.467184 secs 2023-05-08T14:36:59.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:36:59 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:36:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:36:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39158.467184 secs 2023-05-08T14:36:59.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:36:59 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:36:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:36:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39158.467184 secs 2023-05-08T14:37:00.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39159.020273 secs 2023-05-08T14:37:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:00 smithi186 ceph-mon[126480]: pgmap v20938: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.7 MiB/s wr, 17 op/s 2023-05-08T14:37:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:37:00.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39159.020273 secs 2023-05-08T14:37:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:00 smithi133 ceph-mon[125939]: pgmap v20938: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.7 MiB/s wr, 17 op/s 2023-05-08T14:37:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:37:00.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39159.020273 secs 2023-05-08T14:37:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:00 smithi096 ceph-mon[124666]: pgmap v20938: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.7 MiB/s wr, 17 op/s 2023-05-08T14:37:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:37:01.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:01 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:37:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:01 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:37:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:01 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:37:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:01 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:37:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:01 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T14:37:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:01 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T14:37:01.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:01 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:37:01.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:01 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:37:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:01 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:37:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:01 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:37:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:01 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:37:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:01 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T14:37:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:01 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T14:37:01.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:01 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:37:01.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:01 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:37:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:01 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:37:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:01 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:37:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:01 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:37:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:01 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T14:37:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:01 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T14:37:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:01 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:37:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:37:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:37:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:02 smithi133 ceph-mon[125939]: pgmap v20939: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 12 op/s 2023-05-08T14:37:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:37:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:37:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:02 smithi096 ceph-mon[124666]: pgmap v20939: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 12 op/s 2023-05-08T14:37:03.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:37:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:37:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:02 smithi186 ceph-mon[126480]: pgmap v20939: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 12 op/s 2023-05-08T14:37:03.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:03 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:37:04.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:03 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:37:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:03 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:37:04.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39163.467303 secs 2023-05-08T14:37:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:04 smithi133 ceph-mon[125939]: pgmap v20940: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 12 op/s 2023-05-08T14:37:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39163.467303 secs 2023-05-08T14:37:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:04 smithi096 ceph-mon[124666]: pgmap v20940: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 12 op/s 2023-05-08T14:37:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39163.467303 secs 2023-05-08T14:37:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:04 smithi186 ceph-mon[126480]: pgmap v20940: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 12 op/s 2023-05-08T14:37:05.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:05 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:37:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:05 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:37:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:05 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:37:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:37:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:37:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:06 smithi096 ceph-mon[124666]: pgmap v20941: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 2.8 MiB/s wr, 20 op/s 2023-05-08T14:37:07.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:37:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:37:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:06 smithi186 ceph-mon[126480]: pgmap v20941: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 2.8 MiB/s wr, 20 op/s 2023-05-08T14:37:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:37:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:37:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:06 smithi133 ceph-mon[125939]: pgmap v20941: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 2.8 MiB/s wr, 20 op/s 2023-05-08T14:37:08.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:07 smithi186 ceph-mon[126480]: pgmap v20942: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.1 MiB/s wr, 13 op/s 2023-05-08T14:37:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:07 smithi133 ceph-mon[125939]: pgmap v20942: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.1 MiB/s wr, 13 op/s 2023-05-08T14:37:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:07 smithi096 ceph-mon[124666]: pgmap v20942: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.1 MiB/s wr, 13 op/s 2023-05-08T14:37:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:08 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:37:09.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:08 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:37:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:08 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:37:10.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39168.467443 secs 2023-05-08T14:37:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39169.020526 secs 2023-05-08T14:37:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:09 smithi133 ceph-mon[125939]: pgmap v20943: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.1 MiB/s wr, 32 op/s 2023-05-08T14:37:10.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39168.467443 secs 2023-05-08T14:37:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39169.020526 secs 2023-05-08T14:37:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:09 smithi096 ceph-mon[124666]: pgmap v20943: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.1 MiB/s wr, 32 op/s 2023-05-08T14:37:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39168.467443 secs 2023-05-08T14:37:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39169.020526 secs 2023-05-08T14:37:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:09 smithi186 ceph-mon[126480]: pgmap v20943: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.1 MiB/s wr, 32 op/s 2023-05-08T14:37:11.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:10 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:37:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:10 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:37:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39170.362847 secs 2023-05-08T14:37:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:10 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:37:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:10 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:37:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39170.362847 secs 2023-05-08T14:37:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:10 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:37:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:10 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:37:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39170.362847 secs 2023-05-08T14:37:12.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:11 smithi133 ceph-mon[125939]: osdmap e1386: 12 total, 12 up, 12 in 2023-05-08T14:37:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:11 smithi133 ceph-mon[125939]: pgmap v20945: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 2.1 MiB/s wr, 31 op/s 2023-05-08T14:37:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:11 smithi096 ceph-mon[124666]: osdmap e1386: 12 total, 12 up, 12 in 2023-05-08T14:37:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:11 smithi096 ceph-mon[124666]: pgmap v20945: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 2.1 MiB/s wr, 31 op/s 2023-05-08T14:37:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:11 smithi186 ceph-mon[126480]: osdmap e1386: 12 total, 12 up, 12 in 2023-05-08T14:37:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:11 smithi186 ceph-mon[126480]: pgmap v20945: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 2.1 MiB/s wr, 31 op/s 2023-05-08T14:37:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:14 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:37:14.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:14 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:37:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:14 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:37:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39173.467583 secs 2023-05-08T14:37:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:14 smithi186 ceph-mon[126480]: pgmap v20946: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 2.1 MiB/s wr, 31 op/s 2023-05-08T14:37:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:14 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:37:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:14 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:37:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:14 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:37:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39173.467583 secs 2023-05-08T14:37:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:14 smithi133 ceph-mon[125939]: pgmap v20946: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 2.1 MiB/s wr, 31 op/s 2023-05-08T14:37:14.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:14 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:37:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:14 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:37:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:14 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:37:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39173.467583 secs 2023-05-08T14:37:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:14 smithi096 ceph-mon[124666]: pgmap v20946: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 2.1 MiB/s wr, 31 op/s 2023-05-08T14:37:15.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39174.020627 secs 2023-05-08T14:37:15.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39174.020627 secs 2023-05-08T14:37:15.754 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39174.020627 secs 2023-05-08T14:37:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39175.362964 secs 2023-05-08T14:37:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:16 smithi186 ceph-mon[126480]: pgmap v20947: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 27 op/s 2023-05-08T14:37:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39175.362964 secs 2023-05-08T14:37:16.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:16 smithi133 ceph-mon[125939]: pgmap v20947: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 27 op/s 2023-05-08T14:37:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39175.362964 secs 2023-05-08T14:37:16.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:16 smithi096 ceph-mon[124666]: pgmap v20947: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 27 op/s 2023-05-08T14:37:18.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:17 smithi186 ceph-mon[126480]: pgmap v20948: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 27 op/s 2023-05-08T14:37:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:17 smithi133 ceph-mon[125939]: pgmap v20948: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 27 op/s 2023-05-08T14:37:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:17 smithi096 ceph-mon[124666]: pgmap v20948: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 27 op/s 2023-05-08T14:37:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:19 smithi096 ceph-mon[124666]: osdmap e1387: 12 total, 12 up, 12 in 2023-05-08T14:37:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39178.467725 secs 2023-05-08T14:37:19.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39179.020720 secs 2023-05-08T14:37:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:19 smithi186 ceph-mon[126480]: osdmap e1387: 12 total, 12 up, 12 in 2023-05-08T14:37:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39178.467725 secs 2023-05-08T14:37:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39179.020720 secs 2023-05-08T14:37:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:19 smithi133 ceph-mon[125939]: osdmap e1387: 12 total, 12 up, 12 in 2023-05-08T14:37:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39178.467725 secs 2023-05-08T14:37:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39179.020720 secs 2023-05-08T14:37:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:20 smithi186 ceph-mon[126480]: pgmap v20950: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 586 KiB/s wr, 12 op/s 2023-05-08T14:37:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:20 smithi133 ceph-mon[125939]: pgmap v20950: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 586 KiB/s wr, 12 op/s 2023-05-08T14:37:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:20 smithi096 ceph-mon[124666]: pgmap v20950: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 586 KiB/s wr, 12 op/s 2023-05-08T14:37:21.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39180.363077 secs 2023-05-08T14:37:21.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39180.363077 secs 2023-05-08T14:37:22.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39180.363077 secs 2023-05-08T14:37:22.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:22 smithi186 ceph-mon[126480]: pgmap v20951: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 944 KiB/s rd, 914 KiB/s wr, 11 op/s 2023-05-08T14:37:22.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:22 smithi133 ceph-mon[125939]: pgmap v20951: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 944 KiB/s rd, 914 KiB/s wr, 11 op/s 2023-05-08T14:37:23.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:22 smithi096 ceph-mon[124666]: pgmap v20951: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 944 KiB/s rd, 914 KiB/s wr, 11 op/s 2023-05-08T14:37:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39183.467852 secs 2023-05-08T14:37:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:24 smithi096 ceph-mon[124666]: pgmap v20952: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 944 KiB/s rd, 914 KiB/s wr, 11 op/s 2023-05-08T14:37:24.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39184.020823 secs 2023-05-08T14:37:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39183.467852 secs 2023-05-08T14:37:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:24 smithi186 ceph-mon[126480]: pgmap v20952: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 944 KiB/s rd, 914 KiB/s wr, 11 op/s 2023-05-08T14:37:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39184.020823 secs 2023-05-08T14:37:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39183.467852 secs 2023-05-08T14:37:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:24 smithi133 ceph-mon[125939]: pgmap v20952: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 944 KiB/s rd, 914 KiB/s wr, 11 op/s 2023-05-08T14:37:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39184.020823 secs 2023-05-08T14:37:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39185.363186 secs 2023-05-08T14:37:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:25 smithi186 ceph-mon[126480]: pgmap v20953: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 958 KiB/s rd, 912 KiB/s wr, 11 op/s 2023-05-08T14:37:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39185.363186 secs 2023-05-08T14:37:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:25 smithi133 ceph-mon[125939]: pgmap v20953: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 958 KiB/s rd, 912 KiB/s wr, 11 op/s 2023-05-08T14:37:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39185.363186 secs 2023-05-08T14:37:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:25 smithi096 ceph-mon[124666]: pgmap v20953: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 958 KiB/s rd, 912 KiB/s wr, 11 op/s 2023-05-08T14:37:28.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:27 smithi133 ceph-mon[125939]: pgmap v20954: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 958 KiB/s rd, 912 KiB/s wr, 11 op/s 2023-05-08T14:37:28.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:27 smithi096 ceph-mon[124666]: pgmap v20954: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 958 KiB/s rd, 912 KiB/s wr, 11 op/s 2023-05-08T14:37:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:27 smithi186 ceph-mon[126480]: pgmap v20954: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 958 KiB/s rd, 912 KiB/s wr, 11 op/s 2023-05-08T14:37:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39188.468014 secs 2023-05-08T14:37:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39189.020939 secs 2023-05-08T14:37:29.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39188.468014 secs 2023-05-08T14:37:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39189.020939 secs 2023-05-08T14:37:30.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39188.468014 secs 2023-05-08T14:37:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39189.020939 secs 2023-05-08T14:37:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:30 smithi186 ceph-mon[126480]: pgmap v20955: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T14:37:30.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:30 smithi133 ceph-mon[125939]: pgmap v20955: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T14:37:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:30 smithi096 ceph-mon[124666]: pgmap v20955: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T14:37:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39190.363324 secs 2023-05-08T14:37:31.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39190.363324 secs 2023-05-08T14:37:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39190.363324 secs 2023-05-08T14:37:32.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:32 smithi186 ceph-mon[126480]: pgmap v20956: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 671 KiB/s rd, 656 KiB/s wr, 8 op/s 2023-05-08T14:37:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:32 smithi133 ceph-mon[125939]: pgmap v20956: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 671 KiB/s rd, 656 KiB/s wr, 8 op/s 2023-05-08T14:37:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:32 smithi096 ceph-mon[124666]: pgmap v20956: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 671 KiB/s rd, 656 KiB/s wr, 8 op/s 2023-05-08T14:37:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39193.468142 secs 2023-05-08T14:37:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:34 smithi186 ceph-mon[126480]: pgmap v20957: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 328 KiB/s wr, 7 op/s 2023-05-08T14:37:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39194.021054 secs 2023-05-08T14:37:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39193.468142 secs 2023-05-08T14:37:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:34 smithi133 ceph-mon[125939]: pgmap v20957: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 328 KiB/s wr, 7 op/s 2023-05-08T14:37:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39194.021054 secs 2023-05-08T14:37:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39193.468142 secs 2023-05-08T14:37:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:34 smithi096 ceph-mon[124666]: pgmap v20957: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 328 KiB/s wr, 7 op/s 2023-05-08T14:37:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39194.021054 secs 2023-05-08T14:37:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39195.363448 secs 2023-05-08T14:37:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:35 smithi186 ceph-mon[126480]: pgmap v20958: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 505 KiB/s wr, 12 op/s 2023-05-08T14:37:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39195.363448 secs 2023-05-08T14:37:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:35 smithi133 ceph-mon[125939]: pgmap v20958: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 505 KiB/s wr, 12 op/s 2023-05-08T14:37:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39195.363448 secs 2023-05-08T14:37:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:35 smithi096 ceph-mon[124666]: pgmap v20958: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 505 KiB/s wr, 12 op/s 2023-05-08T14:37:38.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:37 smithi133 ceph-mon[125939]: pgmap v20959: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 494 KiB/s rd, 492 KiB/s wr, 8 op/s 2023-05-08T14:37:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:37 smithi096 ceph-mon[124666]: pgmap v20959: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 494 KiB/s rd, 492 KiB/s wr, 8 op/s 2023-05-08T14:37:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:37 smithi186 ceph-mon[126480]: pgmap v20959: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 494 KiB/s rd, 492 KiB/s wr, 8 op/s 2023-05-08T14:37:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39198.468269 secs 2023-05-08T14:37:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39199.021180 secs 2023-05-08T14:37:39.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39198.468269 secs 2023-05-08T14:37:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39199.021180 secs 2023-05-08T14:37:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39198.468269 secs 2023-05-08T14:37:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39199.021180 secs 2023-05-08T14:37:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:40 smithi186 ceph-mon[126480]: pgmap v20960: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 682 KiB/s rd, 679 KiB/s wr, 11 op/s 2023-05-08T14:37:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:40 smithi133 ceph-mon[125939]: pgmap v20960: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 682 KiB/s rd, 679 KiB/s wr, 11 op/s 2023-05-08T14:37:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:40 smithi096 ceph-mon[124666]: pgmap v20960: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 682 KiB/s rd, 679 KiB/s wr, 11 op/s 2023-05-08T14:37:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39200.363567 secs 2023-05-08T14:37:41.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39200.363567 secs 2023-05-08T14:37:42.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39200.363567 secs 2023-05-08T14:37:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:42 smithi186 ceph-mon[126480]: pgmap v20961: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 534 KiB/s rd, 531 KiB/s wr, 7 op/s 2023-05-08T14:37:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:42 smithi133 ceph-mon[125939]: pgmap v20961: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 534 KiB/s rd, 531 KiB/s wr, 7 op/s 2023-05-08T14:37:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:42 smithi096 ceph-mon[124666]: pgmap v20961: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 534 KiB/s rd, 531 KiB/s wr, 7 op/s 2023-05-08T14:37:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39203.468387 secs 2023-05-08T14:37:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:44 smithi186 ceph-mon[126480]: pgmap v20962: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 534 KiB/s rd, 531 KiB/s wr, 7 op/s 2023-05-08T14:37:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39204.021291 secs 2023-05-08T14:37:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39203.468387 secs 2023-05-08T14:37:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:44 smithi133 ceph-mon[125939]: pgmap v20962: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 534 KiB/s rd, 531 KiB/s wr, 7 op/s 2023-05-08T14:37:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39204.021291 secs 2023-05-08T14:37:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39203.468387 secs 2023-05-08T14:37:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:44 smithi096 ceph-mon[124666]: pgmap v20962: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 534 KiB/s rd, 531 KiB/s wr, 7 op/s 2023-05-08T14:37:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39204.021291 secs 2023-05-08T14:37:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:45 smithi133 ceph-mon[125939]: pgmap v20963: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 712 KiB/s rd, 705 KiB/s wr, 11 op/s 2023-05-08T14:37:46.266 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:45 smithi096 ceph-mon[124666]: pgmap v20963: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 712 KiB/s rd, 705 KiB/s wr, 11 op/s 2023-05-08T14:37:46.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:45 smithi186 ceph-mon[126480]: pgmap v20963: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 712 KiB/s rd, 705 KiB/s wr, 11 op/s 2023-05-08T14:37:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:47 smithi133 ceph-mon[125939]: pgmap v20964: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 535 KiB/s rd, 529 KiB/s wr, 6 op/s 2023-05-08T14:37:48.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:47 smithi096 ceph-mon[124666]: pgmap v20964: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 535 KiB/s rd, 529 KiB/s wr, 6 op/s 2023-05-08T14:37:48.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:47 smithi186 ceph-mon[126480]: pgmap v20964: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 535 KiB/s rd, 529 KiB/s wr, 6 op/s 2023-05-08T14:37:49.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39208.468513 secs 2023-05-08T14:37:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:37:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39209.021415 secs 2023-05-08T14:37:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39208.468513 secs 2023-05-08T14:37:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:37:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39209.021415 secs 2023-05-08T14:37:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39208.468513 secs 2023-05-08T14:37:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:37:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39209.021415 secs 2023-05-08T14:37:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:37:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:37:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:37:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:50 smithi186 ceph-mon[126480]: pgmap v20965: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T14:37:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:37:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:37:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:37:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:50 smithi133 ceph-mon[125939]: pgmap v20965: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T14:37:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:37:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:37:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:37:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:50 smithi096 ceph-mon[124666]: pgmap v20965: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T14:37:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:51 smithi133 ceph-mon[125939]: pgmap v20966: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 881 KiB/s rd, 872 KiB/s wr, 8 op/s 2023-05-08T14:37:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:51 smithi096 ceph-mon[124666]: pgmap v20966: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 881 KiB/s rd, 872 KiB/s wr, 8 op/s 2023-05-08T14:37:52.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:51 smithi186 ceph-mon[126480]: pgmap v20966: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 881 KiB/s rd, 872 KiB/s wr, 8 op/s 2023-05-08T14:37:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39213.468616 secs 2023-05-08T14:37:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:54 smithi186 ceph-mon[126480]: pgmap v20967: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 713 KiB/s rd, 704 KiB/s wr, 7 op/s 2023-05-08T14:37:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39213.468616 secs 2023-05-08T14:37:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:54 smithi133 ceph-mon[125939]: pgmap v20967: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 713 KiB/s rd, 704 KiB/s wr, 7 op/s 2023-05-08T14:37:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39213.468616 secs 2023-05-08T14:37:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:54 smithi096 ceph-mon[124666]: pgmap v20967: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 713 KiB/s rd, 704 KiB/s wr, 7 op/s 2023-05-08T14:37:56.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:55 smithi133 ceph-mon[125939]: pgmap v20968: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T14:37:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:55 smithi096 ceph-mon[124666]: pgmap v20968: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T14:37:56.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:55 smithi186 ceph-mon[126480]: pgmap v20968: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T14:37:57.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:37:57.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:37:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:37:58.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:58 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:37:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:37:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:37:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:58 smithi186 ceph-mon[126480]: pgmap v20969: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 922 KiB/s rd, 917 KiB/s wr, 9 op/s 2023-05-08T14:37:58.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:58 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:37:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:37:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:37:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:58 smithi133 ceph-mon[125939]: pgmap v20969: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 922 KiB/s rd, 917 KiB/s wr, 9 op/s 2023-05-08T14:37:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:58 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:37:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:37:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:37:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:58 smithi096 ceph-mon[124666]: pgmap v20969: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 922 KiB/s rd, 917 KiB/s wr, 9 op/s 2023-05-08T14:37:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:37:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39218.468778 secs 2023-05-08T14:37:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:37:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39218.468778 secs 2023-05-08T14:38:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:37:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39218.468778 secs 2023-05-08T14:38:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:00 smithi186 ceph-mon[126480]: pgmap v20970: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 14 op/s 2023-05-08T14:38:00.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:00 smithi133 ceph-mon[125939]: pgmap v20970: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 14 op/s 2023-05-08T14:38:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:00 smithi096 ceph-mon[124666]: pgmap v20970: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 14 op/s 2023-05-08T14:38:01.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:01 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:38:01.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:01 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:38:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:01 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:38:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:02 smithi186 ceph-mon[126480]: pgmap v20971: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T14:38:02.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:02 smithi133 ceph-mon[125939]: pgmap v20971: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T14:38:03.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:02 smithi096 ceph-mon[124666]: pgmap v20971: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T14:38:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39223.468862 secs 2023-05-08T14:38:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:04 smithi186 ceph-mon[126480]: pgmap v20972: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T14:38:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39224.021762 secs 2023-05-08T14:38:04.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39223.468862 secs 2023-05-08T14:38:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:04 smithi133 ceph-mon[125939]: pgmap v20972: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T14:38:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39224.021762 secs 2023-05-08T14:38:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39223.468862 secs 2023-05-08T14:38:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:04 smithi096 ceph-mon[124666]: pgmap v20972: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T14:38:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39224.021762 secs 2023-05-08T14:38:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:05 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:38:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:38:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:38:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:05 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:38:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:38:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:38:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:05 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:38:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:38:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:38:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:06 smithi186 ceph-mon[126480]: pgmap v20973: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 29 op/s 2023-05-08T14:38:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:06 smithi133 ceph-mon[125939]: pgmap v20973: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 29 op/s 2023-05-08T14:38:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:06 smithi096 ceph-mon[124666]: pgmap v20973: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 29 op/s 2023-05-08T14:38:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:07 smithi133 ceph-mon[125939]: pgmap v20974: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 24 op/s 2023-05-08T14:38:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:07 smithi096 ceph-mon[124666]: pgmap v20974: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 24 op/s 2023-05-08T14:38:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:07 smithi186 ceph-mon[126480]: pgmap v20974: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 24 op/s 2023-05-08T14:38:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39228.468987 secs 2023-05-08T14:38:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39229.021875 secs 2023-05-08T14:38:09.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39228.468987 secs 2023-05-08T14:38:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39229.021875 secs 2023-05-08T14:38:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39228.468987 secs 2023-05-08T14:38:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39229.021875 secs 2023-05-08T14:38:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:10 smithi186 ceph-mon[126480]: pgmap v20975: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 29 op/s 2023-05-08T14:38:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:10 smithi133 ceph-mon[125939]: pgmap v20975: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 29 op/s 2023-05-08T14:38:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:10 smithi096 ceph-mon[124666]: pgmap v20975: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 29 op/s 2023-05-08T14:38:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:11 smithi133 ceph-mon[125939]: pgmap v20976: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 673 KiB/s rd, 794 KiB/s wr, 23 op/s 2023-05-08T14:38:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:11 smithi096 ceph-mon[124666]: pgmap v20976: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 673 KiB/s rd, 794 KiB/s wr, 23 op/s 2023-05-08T14:38:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:11 smithi186 ceph-mon[126480]: pgmap v20976: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 673 KiB/s rd, 794 KiB/s wr, 23 op/s 2023-05-08T14:38:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39233.469112 secs 2023-05-08T14:38:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:14 smithi186 ceph-mon[126480]: pgmap v20977: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 673 KiB/s rd, 794 KiB/s wr, 23 op/s 2023-05-08T14:38:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39234.021989 secs 2023-05-08T14:38:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39233.469112 secs 2023-05-08T14:38:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:14 smithi133 ceph-mon[125939]: pgmap v20977: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 673 KiB/s rd, 794 KiB/s wr, 23 op/s 2023-05-08T14:38:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39234.021989 secs 2023-05-08T14:38:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39233.469112 secs 2023-05-08T14:38:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:14 smithi096 ceph-mon[124666]: pgmap v20977: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 673 KiB/s rd, 794 KiB/s wr, 23 op/s 2023-05-08T14:38:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39234.021989 secs 2023-05-08T14:38:16.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:15 smithi133 ceph-mon[125939]: pgmap v20978: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 28 op/s 2023-05-08T14:38:16.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:15 smithi096 ceph-mon[124666]: pgmap v20978: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 28 op/s 2023-05-08T14:38:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:15 smithi186 ceph-mon[126480]: pgmap v20978: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 28 op/s 2023-05-08T14:38:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:17 smithi133 ceph-mon[125939]: pgmap v20979: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 910 KiB/s rd, 911 KiB/s wr, 10 op/s 2023-05-08T14:38:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:17 smithi096 ceph-mon[124666]: pgmap v20979: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 910 KiB/s rd, 911 KiB/s wr, 10 op/s 2023-05-08T14:38:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:17 smithi186 ceph-mon[126480]: pgmap v20979: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 910 KiB/s rd, 911 KiB/s wr, 10 op/s 2023-05-08T14:38:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39238.469250 secs 2023-05-08T14:38:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39239.022107 secs 2023-05-08T14:38:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39238.469250 secs 2023-05-08T14:38:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39239.022107 secs 2023-05-08T14:38:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39238.469250 secs 2023-05-08T14:38:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39239.022107 secs 2023-05-08T14:38:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:20 smithi186 ceph-mon[126480]: pgmap v20980: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 911 KiB/s wr, 14 op/s 2023-05-08T14:38:20.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:20 smithi133 ceph-mon[125939]: pgmap v20980: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 911 KiB/s wr, 14 op/s 2023-05-08T14:38:21.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:20 smithi096 ceph-mon[124666]: pgmap v20980: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 911 KiB/s wr, 14 op/s 2023-05-08T14:38:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:38:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:38:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:38:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:38:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:38:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:38:22.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:38:22.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:38:22.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:38:22.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:38:22.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:21 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi133 to 113.0M 2023-05-08T14:38:22.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:21 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi133 to 118510899: error parsing value: Value '118510899' is below minimum 939524096 2023-05-08T14:38:22.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:38:22.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:38:22.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:38:22.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:38:22.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:38:22.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:21 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi186 to 74331k 2023-05-08T14:38:22.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:21 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi186 to 76115300: error parsing value: Value '76115300' is below minimum 939524096 2023-05-08T14:38:22.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:38:22.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:38:22.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:21 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:38:22.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:21 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:38:22.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:21 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T14:38:22.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:21 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T14:38:22.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:21 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:38:22.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:21 smithi186 ceph-mon[126480]: pgmap v20981: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 903 KiB/s wr, 9 op/s 2023-05-08T14:38:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:38:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:38:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:38:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:38:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:38:22.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:38:22.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:38:22.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:38:22.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:38:22.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:38:22.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:21 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi133 to 113.0M 2023-05-08T14:38:22.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:21 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi133 to 118510899: error parsing value: Value '118510899' is below minimum 939524096 2023-05-08T14:38:22.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:38:22.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:38:22.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:38:22.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:38:22.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:38:22.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:21 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi186 to 74331k 2023-05-08T14:38:22.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:21 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi186 to 76115300: error parsing value: Value '76115300' is below minimum 939524096 2023-05-08T14:38:22.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:38:22.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:38:22.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:21 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:38:22.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:21 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:38:22.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:21 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T14:38:22.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:21 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T14:38:22.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:21 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:38:22.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:21 smithi133 ceph-mon[125939]: pgmap v20981: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 903 KiB/s wr, 9 op/s 2023-05-08T14:38:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:38:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:38:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:38:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:38:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:38:22.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:38:22.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:38:22.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:38:22.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:38:22.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:38:22.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:21 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi133 to 113.0M 2023-05-08T14:38:22.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:21 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi133 to 118510899: error parsing value: Value '118510899' is below minimum 939524096 2023-05-08T14:38:22.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:38:22.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:38:22.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:38:22.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:38:22.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:38:22.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:21 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi186 to 74331k 2023-05-08T14:38:22.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:21 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi186 to 76115300: error parsing value: Value '76115300' is below minimum 939524096 2023-05-08T14:38:22.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:38:22.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:38:22.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:21 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:38:22.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:21 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:38:22.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:21 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T14:38:22.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:21 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T14:38:22.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:21 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:38:22.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:21 smithi096 ceph-mon[124666]: pgmap v20981: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 903 KiB/s wr, 9 op/s 2023-05-08T14:38:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39243.469380 secs 2023-05-08T14:38:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:24 smithi186 ceph-mon[126480]: pgmap v20982: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 796 KiB/s wr, 8 op/s 2023-05-08T14:38:24.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39243.469380 secs 2023-05-08T14:38:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:24 smithi133 ceph-mon[125939]: pgmap v20982: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 796 KiB/s wr, 8 op/s 2023-05-08T14:38:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39243.469380 secs 2023-05-08T14:38:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:24 smithi096 ceph-mon[124666]: pgmap v20982: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 796 KiB/s wr, 8 op/s 2023-05-08T14:38:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:25 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:38:25.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:25 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:38:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:25 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:38:26.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:26 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:38:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:26 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:38:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:26 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:38:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:26 smithi186 ceph-mon[126480]: pgmap v20983: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.9 MiB/s wr, 17 op/s 2023-05-08T14:38:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:26 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:38:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:26 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:38:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:26 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:38:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:26 smithi133 ceph-mon[125939]: pgmap v20983: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.9 MiB/s wr, 17 op/s 2023-05-08T14:38:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:26 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:38:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:26 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:38:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:26 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:38:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:26 smithi096 ceph-mon[124666]: pgmap v20983: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.9 MiB/s wr, 17 op/s 2023-05-08T14:38:28.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:27 smithi133 ceph-mon[125939]: pgmap v20984: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T14:38:28.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:27 smithi096 ceph-mon[124666]: pgmap v20984: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T14:38:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:27 smithi186 ceph-mon[126480]: pgmap v20984: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T14:38:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39248.469466 secs 2023-05-08T14:38:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39248.469466 secs 2023-05-08T14:38:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39248.469466 secs 2023-05-08T14:38:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:30 smithi186 ceph-mon[126480]: pgmap v20985: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 16 op/s 2023-05-08T14:38:30.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:30 smithi133 ceph-mon[125939]: pgmap v20985: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 16 op/s 2023-05-08T14:38:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:30 smithi096 ceph-mon[124666]: pgmap v20985: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 16 op/s 2023-05-08T14:38:32.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:32 smithi186 ceph-mon[126480]: osdmap e1388: 12 total, 12 up, 12 in 2023-05-08T14:38:32.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:32 smithi186 ceph-mon[126480]: pgmap v20987: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 14 op/s 2023-05-08T14:38:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:32 smithi133 ceph-mon[125939]: osdmap e1388: 12 total, 12 up, 12 in 2023-05-08T14:38:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:32 smithi133 ceph-mon[125939]: pgmap v20987: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 14 op/s 2023-05-08T14:38:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:32 smithi096 ceph-mon[124666]: osdmap e1388: 12 total, 12 up, 12 in 2023-05-08T14:38:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:32 smithi096 ceph-mon[124666]: pgmap v20987: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 14 op/s 2023-05-08T14:38:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39253.469533 secs 2023-05-08T14:38:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:34 smithi186 ceph-mon[126480]: pgmap v20988: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 14 op/s 2023-05-08T14:38:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39253.469533 secs 2023-05-08T14:38:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:34 smithi133 ceph-mon[125939]: pgmap v20988: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 14 op/s 2023-05-08T14:38:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39253.469533 secs 2023-05-08T14:38:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:34 smithi096 ceph-mon[124666]: pgmap v20988: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 14 op/s 2023-05-08T14:38:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:35 smithi133 ceph-mon[125939]: pgmap v20989: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 244 KiB/s wr, 9 op/s 2023-05-08T14:38:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:35 smithi096 ceph-mon[124666]: pgmap v20989: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 244 KiB/s wr, 9 op/s 2023-05-08T14:38:36.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:35 smithi186 ceph-mon[126480]: pgmap v20989: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 244 KiB/s wr, 9 op/s 2023-05-08T14:38:38.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:37 smithi133 ceph-mon[125939]: pgmap v20990: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 244 KiB/s wr, 9 op/s 2023-05-08T14:38:38.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:37 smithi096 ceph-mon[124666]: pgmap v20990: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 244 KiB/s wr, 9 op/s 2023-05-08T14:38:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:37 smithi186 ceph-mon[126480]: pgmap v20990: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 244 KiB/s wr, 9 op/s 2023-05-08T14:38:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:39 smithi186 ceph-mon[126480]: osdmap e1389: 12 total, 12 up, 12 in 2023-05-08T14:38:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39258.469601 secs 2023-05-08T14:38:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:39 smithi133 ceph-mon[125939]: osdmap e1389: 12 total, 12 up, 12 in 2023-05-08T14:38:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39258.469601 secs 2023-05-08T14:38:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:39 smithi096 ceph-mon[124666]: osdmap e1389: 12 total, 12 up, 12 in 2023-05-08T14:38:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39258.469601 secs 2023-05-08T14:38:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:40 smithi186 ceph-mon[126480]: pgmap v20992: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 512 KiB/s rd, 510 KiB/s wr, 10 op/s 2023-05-08T14:38:40.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:40 smithi133 ceph-mon[125939]: pgmap v20992: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 512 KiB/s rd, 510 KiB/s wr, 10 op/s 2023-05-08T14:38:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:40 smithi096 ceph-mon[124666]: pgmap v20992: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 512 KiB/s rd, 510 KiB/s wr, 10 op/s 2023-05-08T14:38:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39260.364901 secs 2023-05-08T14:38:41.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39260.364901 secs 2023-05-08T14:38:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39260.364901 secs 2023-05-08T14:38:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:42 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:38:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:42 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:38:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:42 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:38:42.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:42 smithi186 ceph-mon[126480]: pgmap v20993: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 424 KiB/s rd, 422 KiB/s wr, 9 op/s 2023-05-08T14:38:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:42 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:38:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:42 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:38:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:42 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:38:42.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:42 smithi133 ceph-mon[125939]: pgmap v20993: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 424 KiB/s rd, 422 KiB/s wr, 9 op/s 2023-05-08T14:38:43.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:42 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:38:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:42 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:38:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:42 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:38:43.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:42 smithi096 ceph-mon[124666]: pgmap v20993: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 424 KiB/s rd, 422 KiB/s wr, 9 op/s 2023-05-08T14:38:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39263.469724 secs 2023-05-08T14:38:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:44 smithi186 ceph-mon[126480]: pgmap v20994: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 424 KiB/s rd, 422 KiB/s wr, 9 op/s 2023-05-08T14:38:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39264.022666 secs 2023-05-08T14:38:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39263.469724 secs 2023-05-08T14:38:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:44 smithi133 ceph-mon[125939]: pgmap v20994: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 424 KiB/s rd, 422 KiB/s wr, 9 op/s 2023-05-08T14:38:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39264.022666 secs 2023-05-08T14:38:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39263.469724 secs 2023-05-08T14:38:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:44 smithi096 ceph-mon[124666]: pgmap v20994: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 424 KiB/s rd, 422 KiB/s wr, 9 op/s 2023-05-08T14:38:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39264.022666 secs 2023-05-08T14:38:46.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:46 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:38:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:46 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:38:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:46 smithi186 ceph-mon[126480]: pgmap v20995: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 856 KiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T14:38:46.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:46 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:38:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:46 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:38:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:46 smithi133 ceph-mon[125939]: pgmap v20995: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 856 KiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T14:38:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:46 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:38:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:46 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:38:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:46 smithi096 ceph-mon[124666]: pgmap v20995: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 856 KiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T14:38:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:47 smithi133 ceph-mon[125939]: pgmap v20996: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 856 KiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T14:38:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:47 smithi096 ceph-mon[124666]: pgmap v20996: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 856 KiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T14:38:48.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:47 smithi186 ceph-mon[126480]: pgmap v20996: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 856 KiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T14:38:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:48 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:38:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:48 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:38:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:48 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:38:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39268.469843 secs 2023-05-08T14:38:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:38:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39269.022792 secs 2023-05-08T14:38:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:49 smithi133 ceph-mon[125939]: pgmap v20997: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 15 op/s 2023-05-08T14:38:50.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39268.469843 secs 2023-05-08T14:38:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:38:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39269.022792 secs 2023-05-08T14:38:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:49 smithi096 ceph-mon[124666]: pgmap v20997: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 15 op/s 2023-05-08T14:38:50.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39268.469843 secs 2023-05-08T14:38:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:38:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39269.022792 secs 2023-05-08T14:38:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:49 smithi186 ceph-mon[126480]: pgmap v20997: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 15 op/s 2023-05-08T14:38:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:38:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:38:51.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:38:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:38:51.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:38:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:38:52.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:51 smithi133 ceph-mon[125939]: pgmap v20998: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 11 op/s 2023-05-08T14:38:52.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:51 smithi096 ceph-mon[124666]: pgmap v20998: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 11 op/s 2023-05-08T14:38:52.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:51 smithi186 ceph-mon[126480]: pgmap v20998: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 11 op/s 2023-05-08T14:38:53.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:53 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:38:53.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:53 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:38:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:53 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:38:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39273.469981 secs 2023-05-08T14:38:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:54 smithi186 ceph-mon[126480]: pgmap v20999: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 11 op/s 2023-05-08T14:38:54.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39273.469981 secs 2023-05-08T14:38:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:54 smithi133 ceph-mon[125939]: pgmap v20999: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 11 op/s 2023-05-08T14:38:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39273.469981 secs 2023-05-08T14:38:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:54 smithi096 ceph-mon[124666]: pgmap v20999: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 11 op/s 2023-05-08T14:38:56.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:55 smithi133 ceph-mon[125939]: pgmap v21000: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.2 MiB/s wr, 17 op/s 2023-05-08T14:38:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:55 smithi096 ceph-mon[124666]: pgmap v21000: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.2 MiB/s wr, 17 op/s 2023-05-08T14:38:56.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:55 smithi186 ceph-mon[126480]: pgmap v21000: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.2 MiB/s wr, 17 op/s 2023-05-08T14:38:57.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:38:57.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:38:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:38:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:38:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:38:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:58 smithi133 ceph-mon[125939]: pgmap v21001: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T14:38:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:38:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:38:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:58 smithi096 ceph-mon[124666]: pgmap v21001: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T14:38:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:38:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:38:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:58 smithi186 ceph-mon[126480]: pgmap v21001: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T14:38:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:59 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:38:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:38:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39278.470104 secs 2023-05-08T14:38:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:59 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:38:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:38:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39278.470104 secs 2023-05-08T14:38:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:59 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:38:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:38:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39278.470104 secs 2023-05-08T14:39:00.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39279.023005 secs 2023-05-08T14:39:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:00 smithi133 ceph-mon[125939]: pgmap v21002: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.7 MiB/s wr, 16 op/s 2023-05-08T14:39:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39279.023005 secs 2023-05-08T14:39:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:00 smithi096 ceph-mon[124666]: pgmap v21002: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.7 MiB/s wr, 16 op/s 2023-05-08T14:39:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39279.023005 secs 2023-05-08T14:39:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:00 smithi186 ceph-mon[126480]: pgmap v21002: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.7 MiB/s wr, 16 op/s 2023-05-08T14:39:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:39:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:39:02.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:02 smithi133 ceph-mon[125939]: pgmap v21003: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 12 op/s 2023-05-08T14:39:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:39:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:39:02.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:02 smithi096 ceph-mon[124666]: pgmap v21003: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 12 op/s 2023-05-08T14:39:02.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:39:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:39:02.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:02 smithi186 ceph-mon[126480]: pgmap v21003: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 12 op/s 2023-05-08T14:39:03.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:03 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:39:03.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:03 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:39:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:03 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:39:04.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39283.470224 secs 2023-05-08T14:39:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:04 smithi186 ceph-mon[126480]: pgmap v21004: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 11 op/s 2023-05-08T14:39:04.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39283.470224 secs 2023-05-08T14:39:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:04 smithi133 ceph-mon[125939]: pgmap v21004: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 11 op/s 2023-05-08T14:39:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39283.470224 secs 2023-05-08T14:39:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:04 smithi096 ceph-mon[124666]: pgmap v21004: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 11 op/s 2023-05-08T14:39:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:05 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:39:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:05 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:39:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:05 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:39:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:39:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:39:06.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:06 smithi186 ceph-mon[126480]: pgmap v21005: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 2.6 MiB/s wr, 31 op/s 2023-05-08T14:39:06.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:39:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:39:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:06 smithi133 ceph-mon[125939]: pgmap v21005: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 2.6 MiB/s wr, 31 op/s 2023-05-08T14:39:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:39:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:39:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:06 smithi096 ceph-mon[124666]: pgmap v21005: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 2.6 MiB/s wr, 31 op/s 2023-05-08T14:39:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:07 smithi133 ceph-mon[125939]: pgmap v21006: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.1 MiB/s wr, 24 op/s 2023-05-08T14:39:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:07 smithi096 ceph-mon[124666]: pgmap v21006: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.1 MiB/s wr, 24 op/s 2023-05-08T14:39:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:07 smithi186 ceph-mon[126480]: pgmap v21006: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.1 MiB/s wr, 24 op/s 2023-05-08T14:39:09.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:08 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:39:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:08 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:39:09.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:08 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:39:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39288.470329 secs 2023-05-08T14:39:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:09 smithi133 ceph-mon[125939]: pgmap v21007: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 2.7 MiB/s wr, 29 op/s 2023-05-08T14:39:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39288.470329 secs 2023-05-08T14:39:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:09 smithi096 ceph-mon[124666]: pgmap v21007: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 2.7 MiB/s wr, 29 op/s 2023-05-08T14:39:10.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39288.470329 secs 2023-05-08T14:39:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:09 smithi186 ceph-mon[126480]: pgmap v21007: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 2.7 MiB/s wr, 29 op/s 2023-05-08T14:39:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:11 smithi133 ceph-mon[125939]: pgmap v21008: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 1.3 MiB/s wr, 24 op/s 2023-05-08T14:39:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:11 smithi096 ceph-mon[124666]: pgmap v21008: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 1.3 MiB/s wr, 24 op/s 2023-05-08T14:39:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:11 smithi186 ceph-mon[126480]: pgmap v21008: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 1.3 MiB/s wr, 24 op/s 2023-05-08T14:39:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39293.470450 secs 2023-05-08T14:39:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:14 smithi186 ceph-mon[126480]: pgmap v21009: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 1.3 MiB/s wr, 23 op/s 2023-05-08T14:39:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39293.470450 secs 2023-05-08T14:39:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:14 smithi133 ceph-mon[125939]: pgmap v21009: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 1.3 MiB/s wr, 23 op/s 2023-05-08T14:39:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39293.470450 secs 2023-05-08T14:39:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:14 smithi096 ceph-mon[124666]: pgmap v21009: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 1.3 MiB/s wr, 23 op/s 2023-05-08T14:39:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:15 smithi133 ceph-mon[125939]: pgmap v21010: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 1.4 MiB/s wr, 27 op/s 2023-05-08T14:39:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:15 smithi096 ceph-mon[124666]: pgmap v21010: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 1.4 MiB/s wr, 27 op/s 2023-05-08T14:39:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:15 smithi186 ceph-mon[126480]: pgmap v21010: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 1.4 MiB/s wr, 27 op/s 2023-05-08T14:39:18.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:17 smithi133 ceph-mon[125939]: pgmap v21011: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 683 KiB/s wr, 8 op/s 2023-05-08T14:39:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:17 smithi096 ceph-mon[124666]: pgmap v21011: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 683 KiB/s wr, 8 op/s 2023-05-08T14:39:18.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:17 smithi186 ceph-mon[126480]: pgmap v21011: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 683 KiB/s wr, 8 op/s 2023-05-08T14:39:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39298.470552 secs 2023-05-08T14:39:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39299.023441 secs 2023-05-08T14:39:19.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39298.470552 secs 2023-05-08T14:39:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39299.023441 secs 2023-05-08T14:39:20.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39298.470552 secs 2023-05-08T14:39:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39299.023441 secs 2023-05-08T14:39:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:20 smithi186 ceph-mon[126480]: pgmap v21012: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 15 op/s 2023-05-08T14:39:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:20 smithi133 ceph-mon[125939]: pgmap v21012: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 15 op/s 2023-05-08T14:39:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:20 smithi096 ceph-mon[124666]: pgmap v21012: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 15 op/s 2023-05-08T14:39:21.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39300.365922 secs 2023-05-08T14:39:21.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39300.365922 secs 2023-05-08T14:39:22.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39300.365922 secs 2023-05-08T14:39:22.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:22 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:39:22.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:22 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:39:22.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:22 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:39:22.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:22 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:39:22.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:22 smithi186 ceph-mon[126480]: osdmap e1390: 12 total, 12 up, 12 in 2023-05-08T14:39:22.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:22 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:39:22.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:22 smithi186 ceph-mon[126480]: pgmap v21014: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.2 MiB/s wr, 14 op/s 2023-05-08T14:39:22.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:22 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:39:22.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:22 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:39:22.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:22 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:39:22.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:22 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:39:22.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:22 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:39:22.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:22 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:39:22.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:22 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:39:22.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:22 smithi133 ceph-mon[125939]: osdmap e1390: 12 total, 12 up, 12 in 2023-05-08T14:39:22.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:22 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:39:22.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:22 smithi133 ceph-mon[125939]: pgmap v21014: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.2 MiB/s wr, 14 op/s 2023-05-08T14:39:22.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:22 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:39:22.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:22 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:39:22.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:22 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:39:23.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:22 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:39:23.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:22 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:39:23.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:22 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:39:23.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:22 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:39:23.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:22 smithi096 ceph-mon[124666]: osdmap e1390: 12 total, 12 up, 12 in 2023-05-08T14:39:23.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:22 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:39:23.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:22 smithi096 ceph-mon[124666]: pgmap v21014: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.2 MiB/s wr, 14 op/s 2023-05-08T14:39:23.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:22 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:39:23.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:22 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:39:23.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:22 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:39:23.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:23 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:39:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:23 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T14:39:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:23 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T14:39:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:23 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:39:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:23 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:39:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:23 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T14:39:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:23 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T14:39:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:23 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:39:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:23 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:39:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:23 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T14:39:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:23 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T14:39:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:23 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:39:24.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39303.470675 secs 2023-05-08T14:39:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:24 smithi186 ceph-mon[126480]: pgmap v21015: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.2 MiB/s wr, 14 op/s 2023-05-08T14:39:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39304.023554 secs 2023-05-08T14:39:24.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39303.470675 secs 2023-05-08T14:39:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:24 smithi133 ceph-mon[125939]: pgmap v21015: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.2 MiB/s wr, 14 op/s 2023-05-08T14:39:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39304.023554 secs 2023-05-08T14:39:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39303.470675 secs 2023-05-08T14:39:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:24 smithi096 ceph-mon[124666]: pgmap v21015: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.2 MiB/s wr, 14 op/s 2023-05-08T14:39:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39304.023554 secs 2023-05-08T14:39:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39305.366015 secs 2023-05-08T14:39:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:25 smithi186 ceph-mon[126480]: pgmap v21016: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 16 op/s 2023-05-08T14:39:26.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39305.366015 secs 2023-05-08T14:39:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:25 smithi133 ceph-mon[125939]: pgmap v21016: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 16 op/s 2023-05-08T14:39:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39305.366015 secs 2023-05-08T14:39:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:25 smithi096 ceph-mon[124666]: pgmap v21016: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 16 op/s 2023-05-08T14:39:28.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:27 smithi133 ceph-mon[125939]: pgmap v21017: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 16 op/s 2023-05-08T14:39:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:27 smithi096 ceph-mon[124666]: pgmap v21017: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 16 op/s 2023-05-08T14:39:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:27 smithi186 ceph-mon[126480]: pgmap v21017: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 16 op/s 2023-05-08T14:39:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:29 smithi186 ceph-mon[126480]: osdmap e1391: 12 total, 12 up, 12 in 2023-05-08T14:39:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39308.470821 secs 2023-05-08T14:39:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39309.023619 secs 2023-05-08T14:39:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:29 smithi133 ceph-mon[125939]: osdmap e1391: 12 total, 12 up, 12 in 2023-05-08T14:39:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39308.470821 secs 2023-05-08T14:39:29.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39309.023619 secs 2023-05-08T14:39:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:29 smithi096 ceph-mon[124666]: osdmap e1391: 12 total, 12 up, 12 in 2023-05-08T14:39:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39308.470821 secs 2023-05-08T14:39:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39309.023619 secs 2023-05-08T14:39:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:30 smithi186 ceph-mon[126480]: pgmap v21019: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 245 KiB/s wr, 12 op/s 2023-05-08T14:39:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:30 smithi133 ceph-mon[125939]: pgmap v21019: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 245 KiB/s wr, 12 op/s 2023-05-08T14:39:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:30 smithi096 ceph-mon[124666]: pgmap v21019: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 245 KiB/s wr, 12 op/s 2023-05-08T14:39:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39310.366134 secs 2023-05-08T14:39:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39310.366134 secs 2023-05-08T14:39:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39310.366134 secs 2023-05-08T14:39:32.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:32 smithi186 ceph-mon[126480]: pgmap v21020: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 203 KiB/s wr, 11 op/s 2023-05-08T14:39:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:32 smithi133 ceph-mon[125939]: pgmap v21020: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 203 KiB/s wr, 11 op/s 2023-05-08T14:39:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:32 smithi096 ceph-mon[124666]: pgmap v21020: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 203 KiB/s wr, 11 op/s 2023-05-08T14:39:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39313.470948 secs 2023-05-08T14:39:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:34 smithi186 ceph-mon[126480]: pgmap v21021: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 203 KiB/s wr, 11 op/s 2023-05-08T14:39:34.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39314.023734 secs 2023-05-08T14:39:34.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39313.470948 secs 2023-05-08T14:39:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:34 smithi133 ceph-mon[125939]: pgmap v21021: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 203 KiB/s wr, 11 op/s 2023-05-08T14:39:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39314.023734 secs 2023-05-08T14:39:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39313.470948 secs 2023-05-08T14:39:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:34 smithi096 ceph-mon[124666]: pgmap v21021: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 203 KiB/s wr, 11 op/s 2023-05-08T14:39:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39314.023734 secs 2023-05-08T14:39:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39315.366270 secs 2023-05-08T14:39:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:35 smithi186 ceph-mon[126480]: pgmap v21022: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 627 KiB/s wr, 9 op/s 2023-05-08T14:39:36.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39315.366270 secs 2023-05-08T14:39:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:35 smithi133 ceph-mon[125939]: pgmap v21022: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 627 KiB/s wr, 9 op/s 2023-05-08T14:39:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39315.366270 secs 2023-05-08T14:39:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:35 smithi096 ceph-mon[124666]: pgmap v21022: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 627 KiB/s wr, 9 op/s 2023-05-08T14:39:38.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:37 smithi133 ceph-mon[125939]: pgmap v21023: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 627 KiB/s wr, 9 op/s 2023-05-08T14:39:38.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:37 smithi096 ceph-mon[124666]: pgmap v21023: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 627 KiB/s wr, 9 op/s 2023-05-08T14:39:38.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:37 smithi186 ceph-mon[126480]: pgmap v21023: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 627 KiB/s wr, 9 op/s 2023-05-08T14:39:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39318.471065 secs 2023-05-08T14:39:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39319.023852 secs 2023-05-08T14:39:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39318.471065 secs 2023-05-08T14:39:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39319.023852 secs 2023-05-08T14:39:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39318.471065 secs 2023-05-08T14:39:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39319.023852 secs 2023-05-08T14:39:40.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:40 smithi186 ceph-mon[126480]: pgmap v21024: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 936 KiB/s wr, 11 op/s 2023-05-08T14:39:40.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:40 smithi133 ceph-mon[125939]: pgmap v21024: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 936 KiB/s wr, 11 op/s 2023-05-08T14:39:41.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:40 smithi096 ceph-mon[124666]: pgmap v21024: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 936 KiB/s wr, 11 op/s 2023-05-08T14:39:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39320.366382 secs 2023-05-08T14:39:41.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39320.366382 secs 2023-05-08T14:39:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39320.366382 secs 2023-05-08T14:39:42.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:42 smithi186 ceph-mon[126480]: pgmap v21025: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 716 KiB/s wr, 7 op/s 2023-05-08T14:39:42.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:42 smithi133 ceph-mon[125939]: pgmap v21025: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 716 KiB/s wr, 7 op/s 2023-05-08T14:39:43.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:42 smithi096 ceph-mon[124666]: pgmap v21025: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 716 KiB/s wr, 7 op/s 2023-05-08T14:39:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39323.471164 secs 2023-05-08T14:39:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:44 smithi186 ceph-mon[126480]: pgmap v21026: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 716 KiB/s wr, 6 op/s 2023-05-08T14:39:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39324.023964 secs 2023-05-08T14:39:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39323.471164 secs 2023-05-08T14:39:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:44 smithi133 ceph-mon[125939]: pgmap v21026: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 716 KiB/s wr, 6 op/s 2023-05-08T14:39:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39324.023964 secs 2023-05-08T14:39:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39323.471164 secs 2023-05-08T14:39:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:44 smithi096 ceph-mon[124666]: pgmap v21026: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 716 KiB/s wr, 6 op/s 2023-05-08T14:39:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39324.023964 secs 2023-05-08T14:39:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:45 smithi133 ceph-mon[125939]: pgmap v21027: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 905 KiB/s rd, 902 KiB/s wr, 10 op/s 2023-05-08T14:39:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:45 smithi096 ceph-mon[124666]: pgmap v21027: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 905 KiB/s rd, 902 KiB/s wr, 10 op/s 2023-05-08T14:39:46.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:45 smithi186 ceph-mon[126480]: pgmap v21027: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 905 KiB/s rd, 902 KiB/s wr, 10 op/s 2023-05-08T14:39:48.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:47 smithi133 ceph-mon[125939]: pgmap v21028: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 546 KiB/s rd, 544 KiB/s wr, 6 op/s 2023-05-08T14:39:48.254 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:47 smithi096 ceph-mon[124666]: pgmap v21028: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 546 KiB/s rd, 544 KiB/s wr, 6 op/s 2023-05-08T14:39:48.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:47 smithi186 ceph-mon[126480]: pgmap v21028: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 546 KiB/s rd, 544 KiB/s wr, 6 op/s 2023-05-08T14:39:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39328.471287 secs 2023-05-08T14:39:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:39:49.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39329.024102 secs 2023-05-08T14:39:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39328.471287 secs 2023-05-08T14:39:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:39:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39329.024102 secs 2023-05-08T14:39:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39328.471287 secs 2023-05-08T14:39:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:39:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39329.024102 secs 2023-05-08T14:39:50.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:39:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:39:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:39:50.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:50 smithi186 ceph-mon[126480]: pgmap v21029: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 719 KiB/s rd, 716 KiB/s wr, 9 op/s 2023-05-08T14:39:50.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:39:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:39:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:39:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:50 smithi133 ceph-mon[125939]: pgmap v21029: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 719 KiB/s rd, 716 KiB/s wr, 9 op/s 2023-05-08T14:39:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:39:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:39:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:39:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:50 smithi096 ceph-mon[124666]: pgmap v21029: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 719 KiB/s rd, 716 KiB/s wr, 9 op/s 2023-05-08T14:39:52.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:51 smithi133 ceph-mon[125939]: pgmap v21030: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 514 KiB/s wr, 7 op/s 2023-05-08T14:39:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:51 smithi096 ceph-mon[124666]: pgmap v21030: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 514 KiB/s wr, 7 op/s 2023-05-08T14:39:52.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:51 smithi186 ceph-mon[126480]: pgmap v21030: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 514 KiB/s wr, 7 op/s 2023-05-08T14:39:54.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39333.471432 secs 2023-05-08T14:39:54.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:54 smithi186 ceph-mon[126480]: pgmap v21031: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 514 KiB/s wr, 7 op/s 2023-05-08T14:39:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39333.471432 secs 2023-05-08T14:39:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:54 smithi133 ceph-mon[125939]: pgmap v21031: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 514 KiB/s wr, 7 op/s 2023-05-08T14:39:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39333.471432 secs 2023-05-08T14:39:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:54 smithi096 ceph-mon[124666]: pgmap v21031: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 514 KiB/s wr, 7 op/s 2023-05-08T14:39:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:55 smithi133 ceph-mon[125939]: pgmap v21032: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 745 KiB/s wr, 11 op/s 2023-05-08T14:39:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:55 smithi096 ceph-mon[124666]: pgmap v21032: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 745 KiB/s wr, 11 op/s 2023-05-08T14:39:56.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:55 smithi186 ceph-mon[126480]: pgmap v21032: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 745 KiB/s wr, 11 op/s 2023-05-08T14:39:57.618 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:39:57.739 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:39:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:39:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:58 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:39:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:39:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:39:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:58 smithi133 ceph-mon[125939]: pgmap v21033: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 561 KiB/s rd, 559 KiB/s wr, 8 op/s 2023-05-08T14:39:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:58 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:39:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:39:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:39:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:58 smithi096 ceph-mon[124666]: pgmap v21033: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 561 KiB/s rd, 559 KiB/s wr, 8 op/s 2023-05-08T14:39:58.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:58 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:39:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:39:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:39:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:58 smithi186 ceph-mon[126480]: pgmap v21033: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 561 KiB/s rd, 559 KiB/s wr, 8 op/s 2023-05-08T14:39:59.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:39:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39338.471557 secs 2023-05-08T14:39:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:39:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39338.471557 secs 2023-05-08T14:40:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:39:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39338.471557 secs 2023-05-08T14:40:00.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:00 smithi186 ceph-mon[126480]: pgmap v21034: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T14:40:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:00 smithi186 ceph-mon[126480]: overall HEALTH_WARN 1 MDSs report slow requests 2023-05-08T14:40:00.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:00 smithi133 ceph-mon[125939]: pgmap v21034: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T14:40:00.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:00 smithi133 ceph-mon[125939]: overall HEALTH_WARN 1 MDSs report slow requests 2023-05-08T14:40:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:00 smithi096 ceph-mon[124666]: pgmap v21034: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T14:40:01.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:00 smithi096 ceph-mon[124666]: overall HEALTH_WARN 1 MDSs report slow requests 2023-05-08T14:40:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:01 smithi133 ceph-mon[125939]: pgmap v21035: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 878 KiB/s rd, 1023 KiB/s wr, 10 op/s 2023-05-08T14:40:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:01 smithi096 ceph-mon[124666]: pgmap v21035: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 878 KiB/s rd, 1023 KiB/s wr, 10 op/s 2023-05-08T14:40:02.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:01 smithi186 ceph-mon[126480]: pgmap v21035: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 878 KiB/s rd, 1023 KiB/s wr, 10 op/s 2023-05-08T14:40:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39343.471678 secs 2023-05-08T14:40:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:04 smithi186 ceph-mon[126480]: pgmap v21036: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 878 KiB/s rd, 867 KiB/s wr, 10 op/s 2023-05-08T14:40:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39344.024493 secs 2023-05-08T14:40:04.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39343.471678 secs 2023-05-08T14:40:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:04 smithi133 ceph-mon[125939]: pgmap v21036: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 878 KiB/s rd, 867 KiB/s wr, 10 op/s 2023-05-08T14:40:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39344.024493 secs 2023-05-08T14:40:05.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39343.471678 secs 2023-05-08T14:40:05.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:04 smithi096 ceph-mon[124666]: pgmap v21036: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 878 KiB/s rd, 867 KiB/s wr, 10 op/s 2023-05-08T14:40:05.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39344.024493 secs 2023-05-08T14:40:05.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:05 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:40:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:05 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:40:05.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:05 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:40:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:05 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:40:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:05 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:40:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:05 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:40:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:05 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:40:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:05 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:40:06.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:05 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:40:06.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:06 smithi186 ceph-mon[126480]: pgmap v21037: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.7 MiB/s wr, 28 op/s 2023-05-08T14:40:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:06 smithi133 ceph-mon[125939]: pgmap v21037: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.7 MiB/s wr, 28 op/s 2023-05-08T14:40:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:06 smithi096 ceph-mon[124666]: pgmap v21037: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.7 MiB/s wr, 28 op/s 2023-05-08T14:40:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:07 smithi133 ceph-mon[125939]: pgmap v21038: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.5 MiB/s wr, 24 op/s 2023-05-08T14:40:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:07 smithi096 ceph-mon[124666]: pgmap v21038: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.5 MiB/s wr, 24 op/s 2023-05-08T14:40:08.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:07 smithi186 ceph-mon[126480]: pgmap v21038: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.5 MiB/s wr, 24 op/s 2023-05-08T14:40:09.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39348.471806 secs 2023-05-08T14:40:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39349.024561 secs 2023-05-08T14:40:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39348.471806 secs 2023-05-08T14:40:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39349.024561 secs 2023-05-08T14:40:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39348.471806 secs 2023-05-08T14:40:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39349.024561 secs 2023-05-08T14:40:10.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:10 smithi186 ceph-mon[126480]: pgmap v21039: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.5 MiB/s wr, 28 op/s 2023-05-08T14:40:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:10 smithi133 ceph-mon[125939]: pgmap v21039: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.5 MiB/s wr, 28 op/s 2023-05-08T14:40:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:10 smithi096 ceph-mon[124666]: pgmap v21039: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.5 MiB/s wr, 28 op/s 2023-05-08T14:40:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:11 smithi133 ceph-mon[125939]: pgmap v21040: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 868 KiB/s wr, 22 op/s 2023-05-08T14:40:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:11 smithi096 ceph-mon[124666]: pgmap v21040: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 868 KiB/s wr, 22 op/s 2023-05-08T14:40:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:11 smithi186 ceph-mon[126480]: pgmap v21040: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 868 KiB/s wr, 22 op/s 2023-05-08T14:40:14.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39353.471888 secs 2023-05-08T14:40:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:14 smithi186 ceph-mon[126480]: pgmap v21041: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 868 KiB/s wr, 22 op/s 2023-05-08T14:40:14.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39354.024677 secs 2023-05-08T14:40:14.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39353.471888 secs 2023-05-08T14:40:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:14 smithi133 ceph-mon[125939]: pgmap v21041: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 868 KiB/s wr, 22 op/s 2023-05-08T14:40:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39354.024677 secs 2023-05-08T14:40:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39353.471888 secs 2023-05-08T14:40:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:14 smithi096 ceph-mon[124666]: pgmap v21041: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 868 KiB/s wr, 22 op/s 2023-05-08T14:40:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39354.024677 secs 2023-05-08T14:40:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:15 smithi133 ceph-mon[125939]: pgmap v21042: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.4 MiB/s wr, 26 op/s 2023-05-08T14:40:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:15 smithi096 ceph-mon[124666]: pgmap v21042: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.4 MiB/s wr, 26 op/s 2023-05-08T14:40:16.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:15 smithi186 ceph-mon[126480]: pgmap v21042: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.4 MiB/s wr, 26 op/s 2023-05-08T14:40:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:17 smithi133 ceph-mon[125939]: pgmap v21043: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 562 KiB/s rd, 560 KiB/s wr, 8 op/s 2023-05-08T14:40:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:17 smithi096 ceph-mon[124666]: pgmap v21043: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 562 KiB/s rd, 560 KiB/s wr, 8 op/s 2023-05-08T14:40:18.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:17 smithi186 ceph-mon[126480]: pgmap v21043: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 562 KiB/s rd, 560 KiB/s wr, 8 op/s 2023-05-08T14:40:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39358.472034 secs 2023-05-08T14:40:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39359.024794 secs 2023-05-08T14:40:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39358.472034 secs 2023-05-08T14:40:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39359.024794 secs 2023-05-08T14:40:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39358.472034 secs 2023-05-08T14:40:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39359.024794 secs 2023-05-08T14:40:20.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:20 smithi186 ceph-mon[126480]: pgmap v21044: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 560 KiB/s wr, 11 op/s 2023-05-08T14:40:20.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:20 smithi133 ceph-mon[125939]: pgmap v21044: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 560 KiB/s wr, 11 op/s 2023-05-08T14:40:21.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:20 smithi096 ceph-mon[124666]: pgmap v21044: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 560 KiB/s wr, 11 op/s 2023-05-08T14:40:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:21 smithi133 ceph-mon[125939]: pgmap v21045: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 559 KiB/s rd, 557 KiB/s wr, 7 op/s 2023-05-08T14:40:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:21 smithi096 ceph-mon[124666]: pgmap v21045: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 559 KiB/s rd, 557 KiB/s wr, 7 op/s 2023-05-08T14:40:22.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:21 smithi186 ceph-mon[126480]: pgmap v21045: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 559 KiB/s rd, 557 KiB/s wr, 7 op/s 2023-05-08T14:40:22.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:22 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:40:23.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:22 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:40:23.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:22 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:40:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:40:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:40:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:23 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:40:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:40:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:23 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T14:40:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:23 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T14:40:24.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:23 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:40:24.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:23 smithi133 ceph-mon[125939]: pgmap v21046: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 559 KiB/s rd, 557 KiB/s wr, 7 op/s 2023-05-08T14:40:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:40:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:40:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:23 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:40:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:40:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:23 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T14:40:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:23 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T14:40:24.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:23 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:40:24.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:23 smithi096 ceph-mon[124666]: pgmap v21046: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 559 KiB/s rd, 557 KiB/s wr, 7 op/s 2023-05-08T14:40:24.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:40:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:40:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:23 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:40:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:40:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:23 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T14:40:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:23 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T14:40:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:23 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:40:24.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:23 smithi186 ceph-mon[126480]: pgmap v21046: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 559 KiB/s rd, 557 KiB/s wr, 7 op/s 2023-05-08T14:40:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39363.472111 secs 2023-05-08T14:40:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39363.472111 secs 2023-05-08T14:40:25.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39363.472111 secs 2023-05-08T14:40:26.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:25 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:40:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39365.367464 secs 2023-05-08T14:40:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:25 smithi133 ceph-mon[125939]: pgmap v21047: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 15 op/s 2023-05-08T14:40:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:25 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:40:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39365.367464 secs 2023-05-08T14:40:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:25 smithi096 ceph-mon[124666]: pgmap v21047: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 15 op/s 2023-05-08T14:40:26.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:25 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:40:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39365.367464 secs 2023-05-08T14:40:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:25 smithi186 ceph-mon[126480]: pgmap v21047: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 15 op/s 2023-05-08T14:40:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:26 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:40:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:26 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:40:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:26 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:40:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:26 smithi133 ceph-mon[125939]: osdmap e1392: 12 total, 12 up, 12 in 2023-05-08T14:40:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:26 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:40:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:26 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:40:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:26 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:40:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:26 smithi096 ceph-mon[124666]: osdmap e1392: 12 total, 12 up, 12 in 2023-05-08T14:40:27.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:26 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:40:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:26 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:40:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:26 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:40:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:26 smithi186 ceph-mon[126480]: osdmap e1392: 12 total, 12 up, 12 in 2023-05-08T14:40:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:27 smithi133 ceph-mon[125939]: pgmap v21049: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 13 op/s 2023-05-08T14:40:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:27 smithi096 ceph-mon[124666]: pgmap v21049: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 13 op/s 2023-05-08T14:40:28.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:27 smithi186 ceph-mon[126480]: pgmap v21049: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 13 op/s 2023-05-08T14:40:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39368.472231 secs 2023-05-08T14:40:29.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39368.472231 secs 2023-05-08T14:40:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39368.472231 secs 2023-05-08T14:40:30.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:30 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:40:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:30 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:40:30.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:30 smithi186 ceph-mon[126480]: pgmap v21050: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 15 op/s 2023-05-08T14:40:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:30 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:40:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:30 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:40:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:30 smithi133 ceph-mon[125939]: pgmap v21050: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 15 op/s 2023-05-08T14:40:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:30 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:40:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:30 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:40:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:30 smithi096 ceph-mon[124666]: pgmap v21050: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 15 op/s 2023-05-08T14:40:31.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39370.367582 secs 2023-05-08T14:40:31.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39370.367582 secs 2023-05-08T14:40:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39370.367582 secs 2023-05-08T14:40:32.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:32 smithi186 ceph-mon[126480]: pgmap v21051: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.9 MiB/s wr, 15 op/s 2023-05-08T14:40:32.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:32 smithi133 ceph-mon[125939]: pgmap v21051: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.9 MiB/s wr, 15 op/s 2023-05-08T14:40:33.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:32 smithi096 ceph-mon[124666]: pgmap v21051: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.9 MiB/s wr, 15 op/s 2023-05-08T14:40:33.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:33 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:40:33.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:33 smithi186 ceph-mon[126480]: osdmap e1393: 12 total, 12 up, 12 in 2023-05-08T14:40:33.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:33 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:40:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:33 smithi133 ceph-mon[125939]: osdmap e1393: 12 total, 12 up, 12 in 2023-05-08T14:40:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:33 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:40:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:33 smithi096 ceph-mon[124666]: osdmap e1393: 12 total, 12 up, 12 in 2023-05-08T14:40:34.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39373.472374 secs 2023-05-08T14:40:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39373.472374 secs 2023-05-08T14:40:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39373.472374 secs 2023-05-08T14:40:35.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:35 smithi186 ceph-mon[126480]: pgmap v21053: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 747 KiB/s rd, 199 KiB/s wr, 7 op/s 2023-05-08T14:40:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:35 smithi133 ceph-mon[125939]: pgmap v21053: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 747 KiB/s rd, 199 KiB/s wr, 7 op/s 2023-05-08T14:40:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:35 smithi096 ceph-mon[124666]: pgmap v21053: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 747 KiB/s rd, 199 KiB/s wr, 7 op/s 2023-05-08T14:40:36.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39375.367685 secs 2023-05-08T14:40:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39375.367685 secs 2023-05-08T14:40:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39375.367685 secs 2023-05-08T14:40:37.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:37 smithi186 ceph-mon[126480]: pgmap v21054: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 463 KiB/s wr, 10 op/s 2023-05-08T14:40:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:37 smithi133 ceph-mon[125939]: pgmap v21054: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 463 KiB/s wr, 10 op/s 2023-05-08T14:40:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:37 smithi096 ceph-mon[124666]: pgmap v21054: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 463 KiB/s wr, 10 op/s 2023-05-08T14:40:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:39 smithi186 ceph-mon[126480]: pgmap v21055: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 KiB/s rd, 460 KiB/s wr, 10 op/s 2023-05-08T14:40:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39378.472430 secs 2023-05-08T14:40:39.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:39 smithi133 ceph-mon[125939]: pgmap v21055: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 KiB/s rd, 460 KiB/s wr, 10 op/s 2023-05-08T14:40:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39378.472430 secs 2023-05-08T14:40:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:39 smithi096 ceph-mon[124666]: pgmap v21055: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 KiB/s rd, 460 KiB/s wr, 10 op/s 2023-05-08T14:40:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39378.472430 secs 2023-05-08T14:40:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:41 smithi186 ceph-mon[126480]: pgmap v21056: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 714 KiB/s rd, 424 KiB/s wr, 9 op/s 2023-05-08T14:40:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39380.367822 secs 2023-05-08T14:40:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:41 smithi133 ceph-mon[125939]: pgmap v21056: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 714 KiB/s rd, 424 KiB/s wr, 9 op/s 2023-05-08T14:40:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39380.367822 secs 2023-05-08T14:40:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:41 smithi096 ceph-mon[124666]: pgmap v21056: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 714 KiB/s rd, 424 KiB/s wr, 9 op/s 2023-05-08T14:40:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39380.367822 secs 2023-05-08T14:40:43.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:43 smithi186 ceph-mon[126480]: pgmap v21057: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 427 KiB/s rd, 437 KiB/s wr, 8 op/s 2023-05-08T14:40:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:43 smithi133 ceph-mon[125939]: pgmap v21057: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 427 KiB/s rd, 437 KiB/s wr, 8 op/s 2023-05-08T14:40:44.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:43 smithi096 ceph-mon[124666]: pgmap v21057: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 427 KiB/s rd, 437 KiB/s wr, 8 op/s 2023-05-08T14:40:44.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39383.472527 secs 2023-05-08T14:40:44.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39384.025374 secs 2023-05-08T14:40:44.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39383.472527 secs 2023-05-08T14:40:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39384.025374 secs 2023-05-08T14:40:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39383.472527 secs 2023-05-08T14:40:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39384.025374 secs 2023-05-08T14:40:45.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:45 smithi186 ceph-mon[126480]: pgmap v21058: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 425 KiB/s wr, 8 op/s 2023-05-08T14:40:45.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:45 smithi133 ceph-mon[125939]: pgmap v21058: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 425 KiB/s wr, 8 op/s 2023-05-08T14:40:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:45 smithi096 ceph-mon[124666]: pgmap v21058: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 425 KiB/s wr, 8 op/s 2023-05-08T14:40:46.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:46 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:40:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:46 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:40:46.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:46 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:40:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:46 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:40:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:46 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:40:46.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:46 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:40:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:46 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:40:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:46 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:40:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:46 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:40:47.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:47 smithi133 ceph-mon[125939]: pgmap v21059: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2023-05-08T14:40:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:47 smithi096 ceph-mon[124666]: pgmap v21059: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2023-05-08T14:40:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:47 smithi186 ceph-mon[126480]: pgmap v21059: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2023-05-08T14:40:49.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:49 smithi133 ceph-mon[125939]: pgmap v21060: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 917 KiB/s rd, 1.1 MiB/s wr, 9 op/s 2023-05-08T14:40:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39388.472643 secs 2023-05-08T14:40:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:40:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:40:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:49 smithi096 ceph-mon[124666]: pgmap v21060: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 917 KiB/s rd, 1.1 MiB/s wr, 9 op/s 2023-05-08T14:40:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39388.472643 secs 2023-05-08T14:40:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:40:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:40:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:49 smithi186 ceph-mon[126480]: pgmap v21060: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 917 KiB/s rd, 1.1 MiB/s wr, 9 op/s 2023-05-08T14:40:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39388.472643 secs 2023-05-08T14:40:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:40:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:40:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:40:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:40:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:40:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:40:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:40:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:40:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:40:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:40:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:40:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:51 smithi133 ceph-mon[125939]: pgmap v21061: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.5 MiB/s wr, 14 op/s 2023-05-08T14:40:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:51 smithi096 ceph-mon[124666]: pgmap v21061: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.5 MiB/s wr, 14 op/s 2023-05-08T14:40:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:51 smithi186 ceph-mon[126480]: pgmap v21061: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.5 MiB/s wr, 14 op/s 2023-05-08T14:40:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:53 smithi133 ceph-mon[125939]: pgmap v21062: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.8 MiB/s wr, 12 op/s 2023-05-08T14:40:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:53 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:40:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:53 smithi096 ceph-mon[124666]: pgmap v21062: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.8 MiB/s wr, 12 op/s 2023-05-08T14:40:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:53 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:40:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:53 smithi186 ceph-mon[126480]: pgmap v21062: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.8 MiB/s wr, 12 op/s 2023-05-08T14:40:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:53 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:40:54.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39393.472752 secs 2023-05-08T14:40:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39394.025639 secs 2023-05-08T14:40:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39393.472752 secs 2023-05-08T14:40:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39394.025639 secs 2023-05-08T14:40:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39393.472752 secs 2023-05-08T14:40:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39394.025639 secs 2023-05-08T14:40:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:55 smithi133 ceph-mon[125939]: pgmap v21063: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 12 op/s 2023-05-08T14:40:56.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:55 smithi096 ceph-mon[124666]: pgmap v21063: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 12 op/s 2023-05-08T14:40:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:55 smithi186 ceph-mon[126480]: pgmap v21063: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 12 op/s 2023-05-08T14:40:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:57 smithi133 ceph-mon[125939]: pgmap v21064: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.0 MiB/s wr, 18 op/s 2023-05-08T14:40:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:57 smithi096 ceph-mon[124666]: pgmap v21064: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.0 MiB/s wr, 18 op/s 2023-05-08T14:40:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:57 smithi186 ceph-mon[126480]: pgmap v21064: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.0 MiB/s wr, 18 op/s 2023-05-08T14:40:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:40:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:40:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:58 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:40:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:40:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:40:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:58 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:40:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:40:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:40:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:58 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:40:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:59 smithi133 ceph-mon[125939]: pgmap v21065: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.0 MiB/s wr, 12 op/s 2023-05-08T14:40:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:40:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39398.472868 secs 2023-05-08T14:41:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:59 smithi096 ceph-mon[124666]: pgmap v21065: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.0 MiB/s wr, 12 op/s 2023-05-08T14:41:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:40:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39398.472868 secs 2023-05-08T14:41:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:59 smithi186 ceph-mon[126480]: pgmap v21065: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.0 MiB/s wr, 12 op/s 2023-05-08T14:41:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:40:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39398.472868 secs 2023-05-08T14:41:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:01 smithi133 ceph-mon[125939]: pgmap v21066: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.6 MiB/s wr, 18 op/s 2023-05-08T14:41:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39400.368192 secs 2023-05-08T14:41:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:01 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:41:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:01 smithi096 ceph-mon[124666]: pgmap v21066: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.6 MiB/s wr, 18 op/s 2023-05-08T14:41:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39400.368192 secs 2023-05-08T14:41:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:01 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:41:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:01 smithi186 ceph-mon[126480]: pgmap v21066: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.6 MiB/s wr, 18 op/s 2023-05-08T14:41:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39400.368192 secs 2023-05-08T14:41:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:01 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:41:02.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:41:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:41:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:41:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:41:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:41:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:41:03.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:41:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:41:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:41:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:03 smithi133 ceph-mon[125939]: pgmap v21067: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 13 op/s 2023-05-08T14:41:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:03 smithi096 ceph-mon[124666]: pgmap v21067: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 13 op/s 2023-05-08T14:41:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:03 smithi186 ceph-mon[126480]: pgmap v21067: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 13 op/s 2023-05-08T14:41:04.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39403.473002 secs 2023-05-08T14:41:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39404.025799 secs 2023-05-08T14:41:05.004 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39403.473002 secs 2023-05-08T14:41:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39404.025799 secs 2023-05-08T14:41:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39403.473002 secs 2023-05-08T14:41:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39404.025799 secs 2023-05-08T14:41:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:05 smithi133 ceph-mon[125939]: pgmap v21068: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 945 KiB/s wr, 11 op/s 2023-05-08T14:41:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:05 smithi096 ceph-mon[124666]: pgmap v21068: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 945 KiB/s wr, 11 op/s 2023-05-08T14:41:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:05 smithi186 ceph-mon[126480]: pgmap v21068: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 945 KiB/s wr, 11 op/s 2023-05-08T14:41:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39405.368330 secs 2023-05-08T14:41:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:06 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:41:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:41:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:41:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:06 smithi133 ceph-mon[125939]: osdmap e1394: 12 total, 12 up, 12 in 2023-05-08T14:41:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39405.368330 secs 2023-05-08T14:41:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:06 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:41:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:41:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:41:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:06 smithi096 ceph-mon[124666]: osdmap e1394: 12 total, 12 up, 12 in 2023-05-08T14:41:07.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39405.368330 secs 2023-05-08T14:41:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:06 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:41:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:41:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:41:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:06 smithi186 ceph-mon[126480]: osdmap e1394: 12 total, 12 up, 12 in 2023-05-08T14:41:07.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:07 smithi133 ceph-mon[125939]: pgmap v21070: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 32 op/s 2023-05-08T14:41:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:07 smithi096 ceph-mon[124666]: pgmap v21070: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 32 op/s 2023-05-08T14:41:08.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:07 smithi186 ceph-mon[126480]: pgmap v21070: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 32 op/s 2023-05-08T14:41:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:09 smithi133 ceph-mon[125939]: pgmap v21071: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 32 op/s 2023-05-08T14:41:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39408.473083 secs 2023-05-08T14:41:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39409.025918 secs 2023-05-08T14:41:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:09 smithi096 ceph-mon[124666]: pgmap v21071: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 32 op/s 2023-05-08T14:41:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39408.473083 secs 2023-05-08T14:41:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39409.025918 secs 2023-05-08T14:41:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:09 smithi186 ceph-mon[126480]: pgmap v21071: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 32 op/s 2023-05-08T14:41:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39408.473083 secs 2023-05-08T14:41:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39409.025918 secs 2023-05-08T14:41:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:11 smithi133 ceph-mon[125939]: pgmap v21072: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 30 op/s 2023-05-08T14:41:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39410.368392 secs 2023-05-08T14:41:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:11 smithi096 ceph-mon[124666]: pgmap v21072: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 30 op/s 2023-05-08T14:41:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39410.368392 secs 2023-05-08T14:41:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:11 smithi186 ceph-mon[126480]: pgmap v21072: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 30 op/s 2023-05-08T14:41:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39410.368392 secs 2023-05-08T14:41:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:13 smithi133 ceph-mon[125939]: pgmap v21073: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 30 op/s 2023-05-08T14:41:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:13 smithi133 ceph-mon[125939]: osdmap e1395: 12 total, 12 up, 12 in 2023-05-08T14:41:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:13 smithi096 ceph-mon[124666]: pgmap v21073: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 30 op/s 2023-05-08T14:41:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:13 smithi096 ceph-mon[124666]: osdmap e1395: 12 total, 12 up, 12 in 2023-05-08T14:41:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:13 smithi186 ceph-mon[126480]: pgmap v21073: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 30 op/s 2023-05-08T14:41:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:13 smithi186 ceph-mon[126480]: osdmap e1395: 12 total, 12 up, 12 in 2023-05-08T14:41:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39413.473214 secs 2023-05-08T14:41:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39414.026027 secs 2023-05-08T14:41:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39413.473214 secs 2023-05-08T14:41:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39414.026027 secs 2023-05-08T14:41:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39413.473214 secs 2023-05-08T14:41:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39414.026027 secs 2023-05-08T14:41:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:15 smithi133 ceph-mon[125939]: pgmap v21075: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 477 KiB/s rd, 629 KiB/s wr, 7 op/s 2023-05-08T14:41:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:15 smithi096 ceph-mon[124666]: pgmap v21075: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 477 KiB/s rd, 629 KiB/s wr, 7 op/s 2023-05-08T14:41:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:15 smithi186 ceph-mon[126480]: pgmap v21075: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 477 KiB/s rd, 629 KiB/s wr, 7 op/s 2023-05-08T14:41:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39415.368514 secs 2023-05-08T14:41:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39415.368514 secs 2023-05-08T14:41:17.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39415.368514 secs 2023-05-08T14:41:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:17 smithi133 ceph-mon[125939]: pgmap v21076: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 819 KiB/s rd, 722 KiB/s wr, 10 op/s 2023-05-08T14:41:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:17 smithi096 ceph-mon[124666]: pgmap v21076: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 819 KiB/s rd, 722 KiB/s wr, 10 op/s 2023-05-08T14:41:18.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:17 smithi186 ceph-mon[126480]: pgmap v21076: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 819 KiB/s rd, 722 KiB/s wr, 10 op/s 2023-05-08T14:41:19.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:19 smithi133 ceph-mon[125939]: pgmap v21077: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 819 KiB/s rd, 722 KiB/s wr, 10 op/s 2023-05-08T14:41:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39418.473319 secs 2023-05-08T14:41:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39419.026088 secs 2023-05-08T14:41:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:19 smithi096 ceph-mon[124666]: pgmap v21077: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 819 KiB/s rd, 722 KiB/s wr, 10 op/s 2023-05-08T14:41:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39418.473319 secs 2023-05-08T14:41:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39419.026088 secs 2023-05-08T14:41:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:19 smithi186 ceph-mon[126480]: pgmap v21077: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 819 KiB/s rd, 722 KiB/s wr, 10 op/s 2023-05-08T14:41:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39418.473319 secs 2023-05-08T14:41:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39419.026088 secs 2023-05-08T14:41:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:21 smithi133 ceph-mon[125939]: pgmap v21078: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 525 KiB/s rd, 464 KiB/s wr, 9 op/s 2023-05-08T14:41:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39420.368631 secs 2023-05-08T14:41:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:21 smithi096 ceph-mon[124666]: pgmap v21078: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 525 KiB/s rd, 464 KiB/s wr, 9 op/s 2023-05-08T14:41:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39420.368631 secs 2023-05-08T14:41:22.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:21 smithi186 ceph-mon[126480]: pgmap v21078: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 525 KiB/s rd, 464 KiB/s wr, 9 op/s 2023-05-08T14:41:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39420.368631 secs 2023-05-08T14:41:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:23 smithi096 ceph-mon[124666]: pgmap v21079: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 431 KiB/s rd, 245 KiB/s wr, 9 op/s 2023-05-08T14:41:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:41:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:41:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:41:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:41:24.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:23 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:41:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:23 smithi186 ceph-mon[126480]: pgmap v21079: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 431 KiB/s rd, 245 KiB/s wr, 9 op/s 2023-05-08T14:41:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:41:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:41:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:41:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:41:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:23 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:41:24.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:23 smithi133 ceph-mon[125939]: pgmap v21079: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 431 KiB/s rd, 245 KiB/s wr, 9 op/s 2023-05-08T14:41:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:41:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:41:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:41:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:41:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:23 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:41:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39423.473390 secs 2023-05-08T14:41:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:41:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:41:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39424.026205 secs 2023-05-08T14:41:25.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:41:25.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:41:25.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:41:25.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39423.473390 secs 2023-05-08T14:41:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:41:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:41:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39424.026205 secs 2023-05-08T14:41:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:41:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:41:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:41:25.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39423.473390 secs 2023-05-08T14:41:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:41:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:41:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39424.026205 secs 2023-05-08T14:41:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:41:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:41:25.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:41:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:25 smithi096 ceph-mon[124666]: pgmap v21080: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 238 KiB/s wr, 9 op/s 2023-05-08T14:41:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:25 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:41:26.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:25 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T14:41:26.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:25 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T14:41:26.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:25 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:41:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:25 smithi186 ceph-mon[126480]: pgmap v21080: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 238 KiB/s wr, 9 op/s 2023-05-08T14:41:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:25 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:41:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:25 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T14:41:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:25 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T14:41:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:25 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:41:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:25 smithi133 ceph-mon[125939]: pgmap v21080: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 238 KiB/s wr, 9 op/s 2023-05-08T14:41:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:25 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:41:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:25 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T14:41:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:25 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T14:41:26.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:25 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:41:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39425.368723 secs 2023-05-08T14:41:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39425.368723 secs 2023-05-08T14:41:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39425.368723 secs 2023-05-08T14:41:28.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:27 smithi186 ceph-mon[126480]: pgmap v21081: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 492 KiB/s rd, 230 KiB/s wr, 11 op/s 2023-05-08T14:41:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:27 smithi133 ceph-mon[125939]: pgmap v21081: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 492 KiB/s rd, 230 KiB/s wr, 11 op/s 2023-05-08T14:41:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:27 smithi096 ceph-mon[124666]: pgmap v21081: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 492 KiB/s rd, 230 KiB/s wr, 11 op/s 2023-05-08T14:41:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:29 smithi186 ceph-mon[126480]: pgmap v21082: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 56 KiB/s wr, 7 op/s 2023-05-08T14:41:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39428.473512 secs 2023-05-08T14:41:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39429.026341 secs 2023-05-08T14:41:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:29 smithi133 ceph-mon[125939]: pgmap v21082: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 56 KiB/s wr, 7 op/s 2023-05-08T14:41:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39428.473512 secs 2023-05-08T14:41:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39429.026341 secs 2023-05-08T14:41:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:29 smithi096 ceph-mon[124666]: pgmap v21082: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 56 KiB/s wr, 7 op/s 2023-05-08T14:41:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39428.473512 secs 2023-05-08T14:41:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39429.026341 secs 2023-05-08T14:41:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:31 smithi186 ceph-mon[126480]: pgmap v21083: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 58 KiB/s wr, 11 op/s 2023-05-08T14:41:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39430.368894 secs 2023-05-08T14:41:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:31 smithi133 ceph-mon[125939]: pgmap v21083: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 58 KiB/s wr, 11 op/s 2023-05-08T14:41:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39430.368894 secs 2023-05-08T14:41:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:31 smithi096 ceph-mon[124666]: pgmap v21083: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 58 KiB/s wr, 11 op/s 2023-05-08T14:41:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39430.368894 secs 2023-05-08T14:41:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:33 smithi186 ceph-mon[126480]: pgmap v21084: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 29 KiB/s wr, 8 op/s 2023-05-08T14:41:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:33 smithi133 ceph-mon[125939]: pgmap v21084: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 29 KiB/s wr, 8 op/s 2023-05-08T14:41:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:33 smithi096 ceph-mon[124666]: pgmap v21084: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 29 KiB/s wr, 8 op/s 2023-05-08T14:41:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39433.473585 secs 2023-05-08T14:41:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39434.026457 secs 2023-05-08T14:41:35.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39433.473585 secs 2023-05-08T14:41:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39434.026457 secs 2023-05-08T14:41:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39433.473585 secs 2023-05-08T14:41:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39434.026457 secs 2023-05-08T14:41:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:35 smithi186 ceph-mon[126480]: pgmap v21085: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 28 KiB/s wr, 8 op/s 2023-05-08T14:41:36.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:35 smithi133 ceph-mon[125939]: pgmap v21085: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 28 KiB/s wr, 8 op/s 2023-05-08T14:41:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:35 smithi096 ceph-mon[124666]: pgmap v21085: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 28 KiB/s wr, 8 op/s 2023-05-08T14:41:37.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39435.369035 secs 2023-05-08T14:41:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39435.369035 secs 2023-05-08T14:41:37.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39435.369035 secs 2023-05-08T14:41:38.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:37 smithi186 ceph-mon[126480]: pgmap v21086: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 525 KiB/s rd, 390 KiB/s wr, 12 op/s 2023-05-08T14:41:38.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:37 smithi133 ceph-mon[125939]: pgmap v21086: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 525 KiB/s rd, 390 KiB/s wr, 12 op/s 2023-05-08T14:41:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:37 smithi096 ceph-mon[124666]: pgmap v21086: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 525 KiB/s rd, 390 KiB/s wr, 12 op/s 2023-05-08T14:41:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:39 smithi186 ceph-mon[126480]: pgmap v21087: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 364 KiB/s wr, 8 op/s 2023-05-08T14:41:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39438.473685 secs 2023-05-08T14:41:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39439.026575 secs 2023-05-08T14:41:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:39 smithi133 ceph-mon[125939]: pgmap v21087: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 364 KiB/s wr, 8 op/s 2023-05-08T14:41:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39438.473685 secs 2023-05-08T14:41:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39439.026575 secs 2023-05-08T14:41:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:39 smithi096 ceph-mon[124666]: pgmap v21087: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 364 KiB/s wr, 8 op/s 2023-05-08T14:41:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39438.473685 secs 2023-05-08T14:41:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39439.026575 secs 2023-05-08T14:41:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:41 smithi186 ceph-mon[126480]: pgmap v21088: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 393 KiB/s rd, 365 KiB/s wr, 12 op/s 2023-05-08T14:41:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39440.369173 secs 2023-05-08T14:41:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:41 smithi133 ceph-mon[125939]: pgmap v21088: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 393 KiB/s rd, 365 KiB/s wr, 12 op/s 2023-05-08T14:41:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39440.369173 secs 2023-05-08T14:41:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:41 smithi096 ceph-mon[124666]: pgmap v21088: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 393 KiB/s rd, 365 KiB/s wr, 12 op/s 2023-05-08T14:41:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39440.369173 secs 2023-05-08T14:41:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:43 smithi186 ceph-mon[126480]: pgmap v21089: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 362 KiB/s wr, 8 op/s 2023-05-08T14:41:44.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:43 smithi133 ceph-mon[125939]: pgmap v21089: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 362 KiB/s wr, 8 op/s 2023-05-08T14:41:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:43 smithi096 ceph-mon[124666]: pgmap v21089: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 362 KiB/s wr, 8 op/s 2023-05-08T14:41:45.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39443.473805 secs 2023-05-08T14:41:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39444.026711 secs 2023-05-08T14:41:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39443.473805 secs 2023-05-08T14:41:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39444.026711 secs 2023-05-08T14:41:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39443.473805 secs 2023-05-08T14:41:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39444.026711 secs 2023-05-08T14:41:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:45 smithi186 ceph-mon[126480]: pgmap v21090: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 362 KiB/s wr, 7 op/s 2023-05-08T14:41:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:45 smithi133 ceph-mon[125939]: pgmap v21090: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 362 KiB/s wr, 7 op/s 2023-05-08T14:41:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:45 smithi096 ceph-mon[124666]: pgmap v21090: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 362 KiB/s wr, 7 op/s 2023-05-08T14:41:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:47 smithi186 ceph-mon[126480]: pgmap v21091: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 935 KiB/s wr, 12 op/s 2023-05-08T14:41:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:47 smithi133 ceph-mon[125939]: pgmap v21091: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 935 KiB/s wr, 12 op/s 2023-05-08T14:41:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:47 smithi096 ceph-mon[124666]: pgmap v21091: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 935 KiB/s wr, 12 op/s 2023-05-08T14:41:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:49 smithi186 ceph-mon[126480]: pgmap v21092: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 756 KiB/s rd, 574 KiB/s wr, 8 op/s 2023-05-08T14:41:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39448.473930 secs 2023-05-08T14:41:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:41:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39449.026823 secs 2023-05-08T14:41:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:49 smithi133 ceph-mon[125939]: pgmap v21092: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 756 KiB/s rd, 574 KiB/s wr, 8 op/s 2023-05-08T14:41:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39448.473930 secs 2023-05-08T14:41:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:41:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39449.026823 secs 2023-05-08T14:41:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:49 smithi096 ceph-mon[124666]: pgmap v21092: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 756 KiB/s rd, 574 KiB/s wr, 8 op/s 2023-05-08T14:41:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39448.473930 secs 2023-05-08T14:41:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:41:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39449.026823 secs 2023-05-08T14:41:51.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:41:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:41:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:41:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:41:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:41:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:41:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:41:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:41:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:41:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:51 smithi186 ceph-mon[126480]: pgmap v21093: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T14:41:52.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:51 smithi133 ceph-mon[125939]: pgmap v21093: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T14:41:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:51 smithi096 ceph-mon[124666]: pgmap v21093: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T14:41:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:53 smithi186 ceph-mon[126480]: pgmap v21094: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 9 op/s 2023-05-08T14:41:54.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:53 smithi133 ceph-mon[125939]: pgmap v21094: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 9 op/s 2023-05-08T14:41:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:53 smithi096 ceph-mon[124666]: pgmap v21094: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 9 op/s 2023-05-08T14:41:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39453.474069 secs 2023-05-08T14:41:55.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39453.474069 secs 2023-05-08T14:41:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39453.474069 secs 2023-05-08T14:41:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:55 smithi186 ceph-mon[126480]: pgmap v21095: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 9 op/s 2023-05-08T14:41:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:55 smithi133 ceph-mon[125939]: pgmap v21095: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 9 op/s 2023-05-08T14:41:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:55 smithi096 ceph-mon[124666]: pgmap v21095: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 9 op/s 2023-05-08T14:41:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:57 smithi186 ceph-mon[126480]: pgmap v21096: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.6 MiB/s wr, 14 op/s 2023-05-08T14:41:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:41:58.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:57 smithi133 ceph-mon[125939]: pgmap v21096: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.6 MiB/s wr, 14 op/s 2023-05-08T14:41:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:41:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:57 smithi096 ceph-mon[124666]: pgmap v21096: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.6 MiB/s wr, 14 op/s 2023-05-08T14:41:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:41:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:58 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:41:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:41:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:41:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:58 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:41:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:41:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:41:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:58 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:41:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:41:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:42:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:59 smithi186 ceph-mon[126480]: pgmap v21097: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 9 op/s 2023-05-08T14:42:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:41:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39458.474203 secs 2023-05-08T14:42:00.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:59 smithi133 ceph-mon[125939]: pgmap v21097: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 9 op/s 2023-05-08T14:42:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:41:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39458.474203 secs 2023-05-08T14:42:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:59 smithi096 ceph-mon[124666]: pgmap v21097: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 9 op/s 2023-05-08T14:42:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:41:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39458.474203 secs 2023-05-08T14:42:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:01 smithi186 ceph-mon[126480]: pgmap v21098: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.0 MiB/s wr, 14 op/s 2023-05-08T14:42:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:01 smithi133 ceph-mon[125939]: pgmap v21098: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.0 MiB/s wr, 14 op/s 2023-05-08T14:42:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:01 smithi096 ceph-mon[124666]: pgmap v21098: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.0 MiB/s wr, 14 op/s 2023-05-08T14:42:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:03 smithi186 ceph-mon[126480]: pgmap v21099: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 852 KiB/s rd, 1.4 MiB/s wr, 10 op/s 2023-05-08T14:42:04.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:03 smithi133 ceph-mon[125939]: pgmap v21099: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 852 KiB/s rd, 1.4 MiB/s wr, 10 op/s 2023-05-08T14:42:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:03 smithi096 ceph-mon[124666]: pgmap v21099: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 852 KiB/s rd, 1.4 MiB/s wr, 10 op/s 2023-05-08T14:42:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39463.474328 secs 2023-05-08T14:42:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39464.027196 secs 2023-05-08T14:42:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39463.474328 secs 2023-05-08T14:42:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39464.027196 secs 2023-05-08T14:42:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39463.474328 secs 2023-05-08T14:42:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39464.027196 secs 2023-05-08T14:42:06.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:05 smithi186 ceph-mon[126480]: pgmap v21100: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 852 KiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T14:42:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39465.369736 secs 2023-05-08T14:42:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:05 smithi133 ceph-mon[125939]: pgmap v21100: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 852 KiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T14:42:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39465.369736 secs 2023-05-08T14:42:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:05 smithi096 ceph-mon[124666]: pgmap v21100: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 852 KiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T14:42:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39465.369736 secs 2023-05-08T14:42:07.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:06 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:42:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:06 smithi186 ceph-mon[126480]: pgmap v21101: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 31 op/s 2023-05-08T14:42:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:42:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:42:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:06 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:42:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:06 smithi133 ceph-mon[125939]: pgmap v21101: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 31 op/s 2023-05-08T14:42:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:42:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:42:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:06 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:42:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:06 smithi096 ceph-mon[124666]: pgmap v21101: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 31 op/s 2023-05-08T14:42:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:42:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:42:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:09 smithi186 ceph-mon[126480]: pgmap v21102: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 26 op/s 2023-05-08T14:42:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39468.474458 secs 2023-05-08T14:42:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:09 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:42:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:09 smithi133 ceph-mon[125939]: pgmap v21102: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 26 op/s 2023-05-08T14:42:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39468.474458 secs 2023-05-08T14:42:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:09 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:42:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:09 smithi096 ceph-mon[124666]: pgmap v21102: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 26 op/s 2023-05-08T14:42:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39468.474458 secs 2023-05-08T14:42:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:09 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:42:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:10 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:42:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:10 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:42:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:10 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:42:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:10 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:42:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:10 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:42:10.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:10 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:42:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:10 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:42:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:10 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:42:11.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:10 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:42:11.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:11 smithi186 ceph-mon[126480]: pgmap v21103: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 31 op/s 2023-05-08T14:42:11.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39470.369863 secs 2023-05-08T14:42:11.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:11 smithi133 ceph-mon[125939]: pgmap v21103: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 31 op/s 2023-05-08T14:42:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39470.369863 secs 2023-05-08T14:42:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:11 smithi096 ceph-mon[124666]: pgmap v21103: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 31 op/s 2023-05-08T14:42:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39470.369863 secs 2023-05-08T14:42:12.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:12 smithi186 ceph-mon[126480]: osdmap e1396: 12 total, 12 up, 12 in 2023-05-08T14:42:12.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:12 smithi133 ceph-mon[125939]: osdmap e1396: 12 total, 12 up, 12 in 2023-05-08T14:42:13.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:12 smithi096 ceph-mon[124666]: osdmap e1396: 12 total, 12 up, 12 in 2023-05-08T14:42:13.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:13 smithi186 ceph-mon[126480]: pgmap v21105: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.4 MiB/s wr, 31 op/s 2023-05-08T14:42:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:13 smithi133 ceph-mon[125939]: pgmap v21105: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.4 MiB/s wr, 31 op/s 2023-05-08T14:42:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:13 smithi096 ceph-mon[124666]: pgmap v21105: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.4 MiB/s wr, 31 op/s 2023-05-08T14:42:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39473.474515 secs 2023-05-08T14:42:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39473.474515 secs 2023-05-08T14:42:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39473.474515 secs 2023-05-08T14:42:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:15 smithi133 ceph-mon[125939]: pgmap v21106: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.4 MiB/s wr, 31 op/s 2023-05-08T14:42:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:15 smithi096 ceph-mon[124666]: pgmap v21106: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.4 MiB/s wr, 31 op/s 2023-05-08T14:42:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:15 smithi186 ceph-mon[126480]: pgmap v21106: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.4 MiB/s wr, 31 op/s 2023-05-08T14:42:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39475.369946 secs 2023-05-08T14:42:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39475.369946 secs 2023-05-08T14:42:17.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39475.369946 secs 2023-05-08T14:42:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:17 smithi133 ceph-mon[125939]: pgmap v21107: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T14:42:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:17 smithi096 ceph-mon[124666]: pgmap v21107: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T14:42:18.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:17 smithi186 ceph-mon[126480]: pgmap v21107: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T14:42:19.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:19 smithi186 ceph-mon[126480]: pgmap v21108: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T14:42:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:19 smithi186 ceph-mon[126480]: osdmap e1397: 12 total, 12 up, 12 in 2023-05-08T14:42:19.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39478.474646 secs 2023-05-08T14:42:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:19 smithi133 ceph-mon[125939]: pgmap v21108: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T14:42:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:19 smithi133 ceph-mon[125939]: osdmap e1397: 12 total, 12 up, 12 in 2023-05-08T14:42:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39478.474646 secs 2023-05-08T14:42:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:19 smithi096 ceph-mon[124666]: pgmap v21108: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T14:42:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:19 smithi096 ceph-mon[124666]: osdmap e1397: 12 total, 12 up, 12 in 2023-05-08T14:42:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39478.474646 secs 2023-05-08T14:42:21.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:21 smithi186 ceph-mon[126480]: pgmap v21110: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 12 op/s 2023-05-08T14:42:21.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39480.370038 secs 2023-05-08T14:42:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:21 smithi133 ceph-mon[125939]: pgmap v21110: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 12 op/s 2023-05-08T14:42:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39480.370038 secs 2023-05-08T14:42:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:21 smithi096 ceph-mon[124666]: pgmap v21110: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 12 op/s 2023-05-08T14:42:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39480.370038 secs 2023-05-08T14:42:23.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:23 smithi186 ceph-mon[126480]: pgmap v21111: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 943 KiB/s rd, 865 KiB/s wr, 10 op/s 2023-05-08T14:42:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:23 smithi133 ceph-mon[125939]: pgmap v21111: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 943 KiB/s rd, 865 KiB/s wr, 10 op/s 2023-05-08T14:42:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:23 smithi096 ceph-mon[124666]: pgmap v21111: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 943 KiB/s rd, 865 KiB/s wr, 10 op/s 2023-05-08T14:42:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39483.474768 secs 2023-05-08T14:42:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39484.027731 secs 2023-05-08T14:42:24.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:24 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:42:24.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39483.474768 secs 2023-05-08T14:42:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39484.027731 secs 2023-05-08T14:42:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:24 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:42:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39483.474768 secs 2023-05-08T14:42:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39484.027731 secs 2023-05-08T14:42:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:24 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:42:25.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:25 smithi186 ceph-mon[126480]: pgmap v21112: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 943 KiB/s rd, 865 KiB/s wr, 10 op/s 2023-05-08T14:42:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:25 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:42:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:25 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:42:25.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:25 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:42:25.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:25 smithi133 ceph-mon[125939]: pgmap v21112: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 943 KiB/s rd, 865 KiB/s wr, 10 op/s 2023-05-08T14:42:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:25 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:42:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:25 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:42:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:25 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:42:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:25 smithi096 ceph-mon[124666]: pgmap v21112: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 943 KiB/s rd, 865 KiB/s wr, 10 op/s 2023-05-08T14:42:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:25 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:42:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:25 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:42:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:25 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:42:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:26 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:42:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:26 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T14:42:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:26 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T14:42:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:26 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:42:26.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39485.370129 secs 2023-05-08T14:42:26.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:26 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:42:26.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:26 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:42:26.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:26 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:42:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:26 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:42:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:26 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T14:42:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:26 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T14:42:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:26 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:42:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39485.370129 secs 2023-05-08T14:42:26.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:26 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:42:26.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:26 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:42:26.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:26 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:42:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:26 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:42:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:26 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T14:42:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:26 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T14:42:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:26 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:42:27.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39485.370129 secs 2023-05-08T14:42:27.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:26 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:42:27.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:26 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:42:27.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:26 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:42:27.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:27 smithi186 ceph-mon[126480]: pgmap v21113: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 1.4 MiB/s wr, 10 op/s 2023-05-08T14:42:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:27 smithi133 ceph-mon[125939]: pgmap v21113: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 1.4 MiB/s wr, 10 op/s 2023-05-08T14:42:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:27 smithi096 ceph-mon[124666]: pgmap v21113: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 1.4 MiB/s wr, 10 op/s 2023-05-08T14:42:29.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:29 smithi186 ceph-mon[126480]: pgmap v21114: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 1.4 MiB/s wr, 10 op/s 2023-05-08T14:42:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39488.474894 secs 2023-05-08T14:42:29.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39489.027847 secs 2023-05-08T14:42:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:29 smithi133 ceph-mon[125939]: pgmap v21114: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 1.4 MiB/s wr, 10 op/s 2023-05-08T14:42:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39488.474894 secs 2023-05-08T14:42:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39489.027847 secs 2023-05-08T14:42:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:29 smithi096 ceph-mon[124666]: pgmap v21114: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 1.4 MiB/s wr, 10 op/s 2023-05-08T14:42:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39488.474894 secs 2023-05-08T14:42:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39489.027847 secs 2023-05-08T14:42:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:31 smithi186 ceph-mon[126480]: pgmap v21115: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 14 op/s 2023-05-08T14:42:31.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39490.370255 secs 2023-05-08T14:42:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:31 smithi133 ceph-mon[125939]: pgmap v21115: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 14 op/s 2023-05-08T14:42:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39490.370255 secs 2023-05-08T14:42:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:31 smithi096 ceph-mon[124666]: pgmap v21115: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 14 op/s 2023-05-08T14:42:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39490.370255 secs 2023-05-08T14:42:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:33 smithi133 ceph-mon[125939]: pgmap v21116: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1000 KiB/s rd, 1.1 MiB/s wr, 8 op/s 2023-05-08T14:42:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:33 smithi096 ceph-mon[124666]: pgmap v21116: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1000 KiB/s rd, 1.1 MiB/s wr, 8 op/s 2023-05-08T14:42:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:33 smithi186 ceph-mon[126480]: pgmap v21116: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1000 KiB/s rd, 1.1 MiB/s wr, 8 op/s 2023-05-08T14:42:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39493.475011 secs 2023-05-08T14:42:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39494.027981 secs 2023-05-08T14:42:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39493.475011 secs 2023-05-08T14:42:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39494.027981 secs 2023-05-08T14:42:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39493.475011 secs 2023-05-08T14:42:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39494.027981 secs 2023-05-08T14:42:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:35 smithi133 ceph-mon[125939]: pgmap v21117: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1000 KiB/s rd, 1.1 MiB/s wr, 8 op/s 2023-05-08T14:42:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:35 smithi096 ceph-mon[124666]: pgmap v21117: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1000 KiB/s rd, 1.1 MiB/s wr, 8 op/s 2023-05-08T14:42:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:35 smithi186 ceph-mon[126480]: pgmap v21117: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1000 KiB/s rd, 1.1 MiB/s wr, 8 op/s 2023-05-08T14:42:36.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39495.370354 secs 2023-05-08T14:42:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39495.370354 secs 2023-05-08T14:42:37.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39495.370354 secs 2023-05-08T14:42:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:37 smithi133 ceph-mon[125939]: pgmap v21118: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 13 op/s 2023-05-08T14:42:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:37 smithi096 ceph-mon[124666]: pgmap v21118: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 13 op/s 2023-05-08T14:42:38.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:37 smithi186 ceph-mon[126480]: pgmap v21118: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 13 op/s 2023-05-08T14:42:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:39 smithi133 ceph-mon[125939]: pgmap v21119: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 561 KiB/s wr, 9 op/s 2023-05-08T14:42:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39498.475152 secs 2023-05-08T14:42:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39499.028104 secs 2023-05-08T14:42:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:39 smithi096 ceph-mon[124666]: pgmap v21119: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 561 KiB/s wr, 9 op/s 2023-05-08T14:42:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39498.475152 secs 2023-05-08T14:42:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39499.028104 secs 2023-05-08T14:42:40.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:39 smithi186 ceph-mon[126480]: pgmap v21119: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 561 KiB/s wr, 9 op/s 2023-05-08T14:42:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39498.475152 secs 2023-05-08T14:42:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39499.028104 secs 2023-05-08T14:42:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:41 smithi133 ceph-mon[125939]: pgmap v21120: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 922 KiB/s wr, 13 op/s 2023-05-08T14:42:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39500.370469 secs 2023-05-08T14:42:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:41 smithi096 ceph-mon[124666]: pgmap v21120: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 922 KiB/s wr, 13 op/s 2023-05-08T14:42:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39500.370469 secs 2023-05-08T14:42:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:41 smithi186 ceph-mon[126480]: pgmap v21120: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 922 KiB/s wr, 13 op/s 2023-05-08T14:42:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39500.370469 secs 2023-05-08T14:42:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:43 smithi133 ceph-mon[125939]: pgmap v21121: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 743 KiB/s wr, 8 op/s 2023-05-08T14:42:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:43 smithi096 ceph-mon[124666]: pgmap v21121: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 743 KiB/s wr, 8 op/s 2023-05-08T14:42:44.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:43 smithi186 ceph-mon[126480]: pgmap v21121: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 743 KiB/s wr, 8 op/s 2023-05-08T14:42:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39503.475273 secs 2023-05-08T14:42:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39504.028256 secs 2023-05-08T14:42:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39503.475273 secs 2023-05-08T14:42:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39504.028256 secs 2023-05-08T14:42:45.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39503.475273 secs 2023-05-08T14:42:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39504.028256 secs 2023-05-08T14:42:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:45 smithi133 ceph-mon[125939]: pgmap v21122: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 743 KiB/s wr, 8 op/s 2023-05-08T14:42:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:45 smithi096 ceph-mon[124666]: pgmap v21122: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 743 KiB/s wr, 8 op/s 2023-05-08T14:42:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:45 smithi186 ceph-mon[126480]: pgmap v21122: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 743 KiB/s wr, 8 op/s 2023-05-08T14:42:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39505.370563 secs 2023-05-08T14:42:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39505.370563 secs 2023-05-08T14:42:47.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39505.370563 secs 2023-05-08T14:42:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:47 smithi133 ceph-mon[125939]: pgmap v21123: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 12 op/s 2023-05-08T14:42:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:47 smithi096 ceph-mon[124666]: pgmap v21123: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 12 op/s 2023-05-08T14:42:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:47 smithi186 ceph-mon[126480]: pgmap v21123: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 12 op/s 2023-05-08T14:42:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:49 smithi133 ceph-mon[125939]: pgmap v21124: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 685 KiB/s wr, 7 op/s 2023-05-08T14:42:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39508.475394 secs 2023-05-08T14:42:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39509.028400 secs 2023-05-08T14:42:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:49 smithi096 ceph-mon[124666]: pgmap v21124: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 685 KiB/s wr, 7 op/s 2023-05-08T14:42:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39508.475394 secs 2023-05-08T14:42:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39509.028400 secs 2023-05-08T14:42:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:49 smithi186 ceph-mon[126480]: pgmap v21124: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 685 KiB/s wr, 7 op/s 2023-05-08T14:42:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39508.475394 secs 2023-05-08T14:42:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39509.028400 secs 2023-05-08T14:42:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:51 smithi133 ceph-mon[125939]: pgmap v21125: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T14:42:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:51 smithi096 ceph-mon[124666]: pgmap v21125: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T14:42:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:51 smithi186 ceph-mon[126480]: pgmap v21125: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T14:42:53.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:53 smithi133 ceph-mon[125939]: pgmap v21126: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 686 KiB/s wr, 8 op/s 2023-05-08T14:42:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:53 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:42:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:53 smithi096 ceph-mon[124666]: pgmap v21126: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 686 KiB/s wr, 8 op/s 2023-05-08T14:42:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:53 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:42:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:53 smithi186 ceph-mon[126480]: pgmap v21126: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 686 KiB/s wr, 8 op/s 2023-05-08T14:42:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:53 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:42:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:54 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:42:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:54 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:42:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:54 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:42:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39513.475511 secs 2023-05-08T14:42:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:54 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:42:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:54 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:42:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:54 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:42:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39513.475511 secs 2023-05-08T14:42:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:54 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:42:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:54 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:42:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:54 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:42:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39513.475511 secs 2023-05-08T14:42:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:55 smithi133 ceph-mon[125939]: pgmap v21127: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 686 KiB/s wr, 8 op/s 2023-05-08T14:42:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:55 smithi096 ceph-mon[124666]: pgmap v21127: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 686 KiB/s wr, 8 op/s 2023-05-08T14:42:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:55 smithi186 ceph-mon[126480]: pgmap v21127: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 686 KiB/s wr, 8 op/s 2023-05-08T14:42:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:57 smithi133 ceph-mon[125939]: pgmap v21128: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T14:42:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:42:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:57 smithi096 ceph-mon[124666]: pgmap v21128: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T14:42:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:42:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:57 smithi186 ceph-mon[126480]: pgmap v21128: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T14:42:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:42:58.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:42:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:42:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:42:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:42:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:42:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:42:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:59 smithi133 ceph-mon[125939]: pgmap v21129: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 940 KiB/s wr, 9 op/s 2023-05-08T14:42:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:42:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39518.475580 secs 2023-05-08T14:43:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:59 smithi096 ceph-mon[124666]: pgmap v21129: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 940 KiB/s wr, 9 op/s 2023-05-08T14:43:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:42:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39518.475580 secs 2023-05-08T14:43:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:59 smithi186 ceph-mon[126480]: pgmap v21129: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 940 KiB/s wr, 9 op/s 2023-05-08T14:43:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:42:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39518.475580 secs 2023-05-08T14:43:01.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:01 smithi133 ceph-mon[125939]: pgmap v21130: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 14 op/s 2023-05-08T14:43:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:01 smithi096 ceph-mon[124666]: pgmap v21130: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 14 op/s 2023-05-08T14:43:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:01 smithi186 ceph-mon[126480]: pgmap v21130: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 14 op/s 2023-05-08T14:43:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:03 smithi133 ceph-mon[125939]: pgmap v21131: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T14:43:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:03 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:43:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:03 smithi096 ceph-mon[124666]: pgmap v21131: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T14:43:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:03 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:43:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:03 smithi186 ceph-mon[126480]: pgmap v21131: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T14:43:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:03 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:43:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39523.475678 secs 2023-05-08T14:43:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39524.028781 secs 2023-05-08T14:43:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39523.475678 secs 2023-05-08T14:43:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39524.028781 secs 2023-05-08T14:43:05.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39523.475678 secs 2023-05-08T14:43:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39524.028781 secs 2023-05-08T14:43:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:05 smithi133 ceph-mon[125939]: pgmap v21132: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T14:43:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:05 smithi096 ceph-mon[124666]: pgmap v21132: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T14:43:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:05 smithi186 ceph-mon[126480]: pgmap v21132: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T14:43:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:43:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:43:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:43:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:43:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:43:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:43:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:07 smithi133 ceph-mon[125939]: pgmap v21133: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.0 MiB/s wr, 28 op/s 2023-05-08T14:43:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:07 smithi096 ceph-mon[124666]: pgmap v21133: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.0 MiB/s wr, 28 op/s 2023-05-08T14:43:08.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:07 smithi186 ceph-mon[126480]: pgmap v21133: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.0 MiB/s wr, 28 op/s 2023-05-08T14:43:08.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:08 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:43:09.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:08 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:43:09.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:08 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:43:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:09 smithi096 ceph-mon[124666]: pgmap v21134: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.4 MiB/s wr, 23 op/s 2023-05-08T14:43:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39528.475750 secs 2023-05-08T14:43:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39529.028906 secs 2023-05-08T14:43:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:09 smithi186 ceph-mon[126480]: pgmap v21134: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.4 MiB/s wr, 23 op/s 2023-05-08T14:43:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39528.475750 secs 2023-05-08T14:43:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39529.028906 secs 2023-05-08T14:43:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:09 smithi133 ceph-mon[125939]: pgmap v21134: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.4 MiB/s wr, 23 op/s 2023-05-08T14:43:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39528.475750 secs 2023-05-08T14:43:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39529.028906 secs 2023-05-08T14:43:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:11 smithi096 ceph-mon[124666]: pgmap v21135: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.4 MiB/s wr, 27 op/s 2023-05-08T14:43:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:11 smithi186 ceph-mon[126480]: pgmap v21135: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.4 MiB/s wr, 27 op/s 2023-05-08T14:43:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:11 smithi133 ceph-mon[125939]: pgmap v21135: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.4 MiB/s wr, 27 op/s 2023-05-08T14:43:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:13 smithi096 ceph-mon[124666]: pgmap v21136: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 719 KiB/s wr, 22 op/s 2023-05-08T14:43:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:13 smithi186 ceph-mon[126480]: pgmap v21136: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 719 KiB/s wr, 22 op/s 2023-05-08T14:43:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:13 smithi133 ceph-mon[125939]: pgmap v21136: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 719 KiB/s wr, 22 op/s 2023-05-08T14:43:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39533.475854 secs 2023-05-08T14:43:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39534.029028 secs 2023-05-08T14:43:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39533.475854 secs 2023-05-08T14:43:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39534.029028 secs 2023-05-08T14:43:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39533.475854 secs 2023-05-08T14:43:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39534.029028 secs 2023-05-08T14:43:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:15 smithi096 ceph-mon[124666]: pgmap v21137: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 665 KiB/s wr, 21 op/s 2023-05-08T14:43:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:15 smithi186 ceph-mon[126480]: pgmap v21137: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 665 KiB/s wr, 21 op/s 2023-05-08T14:43:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:15 smithi133 ceph-mon[125939]: pgmap v21137: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 665 KiB/s wr, 21 op/s 2023-05-08T14:43:18.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:17 smithi186 ceph-mon[126480]: pgmap v21138: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.4 MiB/s wr, 26 op/s 2023-05-08T14:43:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:17 smithi133 ceph-mon[125939]: pgmap v21138: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.4 MiB/s wr, 26 op/s 2023-05-08T14:43:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:17 smithi096 ceph-mon[124666]: pgmap v21138: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.4 MiB/s wr, 26 op/s 2023-05-08T14:43:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:19 smithi186 ceph-mon[126480]: pgmap v21139: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 727 KiB/s rd, 725 KiB/s wr, 8 op/s 2023-05-08T14:43:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39538.475979 secs 2023-05-08T14:43:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39539.029160 secs 2023-05-08T14:43:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:19 smithi133 ceph-mon[125939]: pgmap v21139: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 727 KiB/s rd, 725 KiB/s wr, 8 op/s 2023-05-08T14:43:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39538.475979 secs 2023-05-08T14:43:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39539.029160 secs 2023-05-08T14:43:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:19 smithi096 ceph-mon[124666]: pgmap v21139: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 727 KiB/s rd, 725 KiB/s wr, 8 op/s 2023-05-08T14:43:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39538.475979 secs 2023-05-08T14:43:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39539.029160 secs 2023-05-08T14:43:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:21 smithi186 ceph-mon[126480]: pgmap v21140: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 729 KiB/s rd, 726 KiB/s wr, 11 op/s 2023-05-08T14:43:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:21 smithi133 ceph-mon[125939]: pgmap v21140: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 729 KiB/s rd, 726 KiB/s wr, 11 op/s 2023-05-08T14:43:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:21 smithi096 ceph-mon[124666]: pgmap v21140: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 729 KiB/s rd, 726 KiB/s wr, 11 op/s 2023-05-08T14:43:24.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:23 smithi186 ceph-mon[126480]: pgmap v21141: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 726 KiB/s rd, 724 KiB/s wr, 8 op/s 2023-05-08T14:43:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:23 smithi133 ceph-mon[125939]: pgmap v21141: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 726 KiB/s rd, 724 KiB/s wr, 8 op/s 2023-05-08T14:43:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:23 smithi096 ceph-mon[124666]: pgmap v21141: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 726 KiB/s rd, 724 KiB/s wr, 8 op/s 2023-05-08T14:43:25.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39543.476119 secs 2023-05-08T14:43:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39543.476119 secs 2023-05-08T14:43:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39543.476119 secs 2023-05-08T14:43:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:25 smithi186 ceph-mon[126480]: pgmap v21142: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 726 KiB/s rd, 724 KiB/s wr, 8 op/s 2023-05-08T14:43:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:25 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:43:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:25 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:43:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:25 smithi133 ceph-mon[125939]: pgmap v21142: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 726 KiB/s rd, 724 KiB/s wr, 8 op/s 2023-05-08T14:43:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:25 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:43:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:25 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:43:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:25 smithi096 ceph-mon[124666]: pgmap v21142: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 726 KiB/s rd, 724 KiB/s wr, 8 op/s 2023-05-08T14:43:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:25 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:43:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:25 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:43:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39545.371522 secs 2023-05-08T14:43:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:26 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:43:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:26 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:43:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:26 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:43:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:43:27.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:43:27.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:43:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39545.371522 secs 2023-05-08T14:43:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:26 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:43:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:26 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:43:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:26 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:43:27.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:43:27.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:43:27.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:43:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39545.371522 secs 2023-05-08T14:43:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:26 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:43:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:26 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:43:27.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:26 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:43:27.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:43:27.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:43:27.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:43:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:27 smithi186 ceph-mon[126480]: pgmap v21143: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 15 op/s 2023-05-08T14:43:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:27 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:43:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:27 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T14:43:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:27 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T14:43:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:27 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:43:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:27 smithi133 ceph-mon[125939]: pgmap v21143: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 15 op/s 2023-05-08T14:43:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:27 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:43:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:27 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T14:43:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:27 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T14:43:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:27 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:43:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:27 smithi096 ceph-mon[124666]: pgmap v21143: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 15 op/s 2023-05-08T14:43:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:27 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:43:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:27 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T14:43:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:27 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T14:43:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:27 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:43:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:29 smithi186 ceph-mon[126480]: pgmap v21144: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 940 KiB/s rd, 959 KiB/s wr, 11 op/s 2023-05-08T14:43:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39548.476240 secs 2023-05-08T14:43:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:29 smithi133 ceph-mon[125939]: pgmap v21144: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 940 KiB/s rd, 959 KiB/s wr, 11 op/s 2023-05-08T14:43:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39548.476240 secs 2023-05-08T14:43:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:29 smithi096 ceph-mon[124666]: pgmap v21144: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 940 KiB/s rd, 959 KiB/s wr, 11 op/s 2023-05-08T14:43:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39548.476240 secs 2023-05-08T14:43:31.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:30 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:43:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:30 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:43:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:30 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:43:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:30 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:43:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:30 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:43:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:30 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:43:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:31 smithi186 ceph-mon[126480]: pgmap v21145: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 942 KiB/s rd, 990 KiB/s wr, 15 op/s 2023-05-08T14:43:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39550.371660 secs 2023-05-08T14:43:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:31 smithi186 ceph-mon[126480]: osdmap e1398: 12 total, 12 up, 12 in 2023-05-08T14:43:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:31 smithi133 ceph-mon[125939]: pgmap v21145: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 942 KiB/s rd, 990 KiB/s wr, 15 op/s 2023-05-08T14:43:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39550.371660 secs 2023-05-08T14:43:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:31 smithi133 ceph-mon[125939]: osdmap e1398: 12 total, 12 up, 12 in 2023-05-08T14:43:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:31 smithi096 ceph-mon[124666]: pgmap v21145: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 942 KiB/s rd, 990 KiB/s wr, 15 op/s 2023-05-08T14:43:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39550.371660 secs 2023-05-08T14:43:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:31 smithi096 ceph-mon[124666]: osdmap e1398: 12 total, 12 up, 12 in 2023-05-08T14:43:34.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:33 smithi186 ceph-mon[126480]: pgmap v21147: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T14:43:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:33 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:43:34.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:33 smithi133 ceph-mon[125939]: pgmap v21147: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T14:43:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:33 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:43:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:33 smithi096 ceph-mon[124666]: pgmap v21147: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T14:43:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:33 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:43:35.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39553.476375 secs 2023-05-08T14:43:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39553.476375 secs 2023-05-08T14:43:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39553.476375 secs 2023-05-08T14:43:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:35 smithi186 ceph-mon[126480]: pgmap v21148: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T14:43:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:35 smithi133 ceph-mon[125939]: pgmap v21148: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T14:43:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:35 smithi096 ceph-mon[124666]: pgmap v21148: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T14:43:37.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39555.371752 secs 2023-05-08T14:43:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39555.371752 secs 2023-05-08T14:43:37.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39555.371752 secs 2023-05-08T14:43:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:37 smithi186 ceph-mon[126480]: pgmap v21149: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 562 KiB/s rd, 560 KiB/s wr, 10 op/s 2023-05-08T14:43:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:37 smithi133 ceph-mon[125939]: pgmap v21149: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 562 KiB/s rd, 560 KiB/s wr, 10 op/s 2023-05-08T14:43:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:37 smithi096 ceph-mon[124666]: pgmap v21149: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 562 KiB/s rd, 560 KiB/s wr, 10 op/s 2023-05-08T14:43:39.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:39 smithi186 ceph-mon[126480]: pgmap v21150: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 562 KiB/s rd, 560 KiB/s wr, 10 op/s 2023-05-08T14:43:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:39 smithi186 ceph-mon[126480]: osdmap e1399: 12 total, 12 up, 12 in 2023-05-08T14:43:39.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39558.476504 secs 2023-05-08T14:43:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:39 smithi133 ceph-mon[125939]: pgmap v21150: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 562 KiB/s rd, 560 KiB/s wr, 10 op/s 2023-05-08T14:43:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:39 smithi133 ceph-mon[125939]: osdmap e1399: 12 total, 12 up, 12 in 2023-05-08T14:43:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39558.476504 secs 2023-05-08T14:43:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:39 smithi096 ceph-mon[124666]: pgmap v21150: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 562 KiB/s rd, 560 KiB/s wr, 10 op/s 2023-05-08T14:43:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:39 smithi096 ceph-mon[124666]: osdmap e1399: 12 total, 12 up, 12 in 2023-05-08T14:43:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39558.476504 secs 2023-05-08T14:43:41.868 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:41 smithi186 ceph-mon[126480]: pgmap v21152: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 847 KiB/s rd, 806 KiB/s wr, 11 op/s 2023-05-08T14:43:41.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39560.371871 secs 2023-05-08T14:43:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:41 smithi133 ceph-mon[125939]: pgmap v21152: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 847 KiB/s rd, 806 KiB/s wr, 11 op/s 2023-05-08T14:43:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39560.371871 secs 2023-05-08T14:43:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:41 smithi096 ceph-mon[124666]: pgmap v21152: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 847 KiB/s rd, 806 KiB/s wr, 11 op/s 2023-05-08T14:43:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39560.371871 secs 2023-05-08T14:43:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:43 smithi133 ceph-mon[125939]: pgmap v21153: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 771 KiB/s rd, 733 KiB/s wr, 10 op/s 2023-05-08T14:43:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:43 smithi096 ceph-mon[124666]: pgmap v21153: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 771 KiB/s rd, 733 KiB/s wr, 10 op/s 2023-05-08T14:43:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:43 smithi186 ceph-mon[126480]: pgmap v21153: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 771 KiB/s rd, 733 KiB/s wr, 10 op/s 2023-05-08T14:43:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39563.476589 secs 2023-05-08T14:43:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39564.029822 secs 2023-05-08T14:43:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39563.476589 secs 2023-05-08T14:43:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39564.029822 secs 2023-05-08T14:43:45.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39563.476589 secs 2023-05-08T14:43:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39564.029822 secs 2023-05-08T14:43:45.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:45 smithi133 ceph-mon[125939]: pgmap v21154: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 771 KiB/s rd, 733 KiB/s wr, 10 op/s 2023-05-08T14:43:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:45 smithi096 ceph-mon[124666]: pgmap v21154: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 771 KiB/s rd, 733 KiB/s wr, 10 op/s 2023-05-08T14:43:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:45 smithi186 ceph-mon[126480]: pgmap v21154: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 771 KiB/s rd, 733 KiB/s wr, 10 op/s 2023-05-08T14:43:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:46 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:43:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:46 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:43:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:46 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:43:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39565.371935 secs 2023-05-08T14:43:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:46 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:43:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:46 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:43:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:46 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:43:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39565.371935 secs 2023-05-08T14:43:47.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:46 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:43:47.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:46 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:43:47.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:46 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:43:47.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39565.371935 secs 2023-05-08T14:43:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:47 smithi133 ceph-mon[125939]: pgmap v21155: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2023-05-08T14:43:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:47 smithi096 ceph-mon[124666]: pgmap v21155: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2023-05-08T14:43:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:47 smithi186 ceph-mon[126480]: pgmap v21155: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2023-05-08T14:43:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:49 smithi133 ceph-mon[125939]: pgmap v21156: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2023-05-08T14:43:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39568.476728 secs 2023-05-08T14:43:49.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:43:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:49 smithi096 ceph-mon[124666]: pgmap v21156: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2023-05-08T14:43:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39568.476728 secs 2023-05-08T14:43:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:43:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:49 smithi186 ceph-mon[126480]: pgmap v21156: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2023-05-08T14:43:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39568.476728 secs 2023-05-08T14:43:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:43:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:43:50.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:43:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:43:51.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:43:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:43:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:43:51.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:51 smithi133 ceph-mon[125939]: pgmap v21157: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.9 MiB/s wr, 17 op/s 2023-05-08T14:43:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:51 smithi096 ceph-mon[124666]: pgmap v21157: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.9 MiB/s wr, 17 op/s 2023-05-08T14:43:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:51 smithi186 ceph-mon[126480]: pgmap v21157: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.9 MiB/s wr, 17 op/s 2023-05-08T14:43:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:53 smithi133 ceph-mon[125939]: pgmap v21158: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 12 op/s 2023-05-08T14:43:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:53 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:43:53.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:53 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:43:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:53 smithi096 ceph-mon[124666]: pgmap v21158: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 12 op/s 2023-05-08T14:43:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:53 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:43:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:53 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:43:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:53 smithi186 ceph-mon[126480]: pgmap v21158: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 12 op/s 2023-05-08T14:43:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:53 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:43:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:53 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:43:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:54 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:43:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:54 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:43:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39573.476865 secs 2023-05-08T14:43:54.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39574.030069 secs 2023-05-08T14:43:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:54 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:43:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:54 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:43:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39573.476865 secs 2023-05-08T14:43:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39574.030069 secs 2023-05-08T14:43:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:54 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:43:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:54 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:43:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39573.476865 secs 2023-05-08T14:43:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39574.030069 secs 2023-05-08T14:43:55.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:55 smithi133 ceph-mon[125939]: pgmap v21159: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 11 op/s 2023-05-08T14:43:56.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:55 smithi096 ceph-mon[124666]: pgmap v21159: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 11 op/s 2023-05-08T14:43:56.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:55 smithi186 ceph-mon[126480]: pgmap v21159: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 11 op/s 2023-05-08T14:43:57.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:57 smithi133 ceph-mon[125939]: pgmap v21160: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.5 MiB/s wr, 20 op/s 2023-05-08T14:43:58.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:57 smithi096 ceph-mon[124666]: pgmap v21160: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.5 MiB/s wr, 20 op/s 2023-05-08T14:43:58.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:57 smithi186 ceph-mon[126480]: pgmap v21160: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.5 MiB/s wr, 20 op/s 2023-05-08T14:43:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:43:58.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:43:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:43:59.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:43:59.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:43:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:43:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:59 smithi133 ceph-mon[125939]: pgmap v21161: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 14 op/s 2023-05-08T14:43:59.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:43:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39578.477010 secs 2023-05-08T14:44:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:59 smithi096 ceph-mon[124666]: pgmap v21161: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 14 op/s 2023-05-08T14:44:00.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:43:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39578.477010 secs 2023-05-08T14:44:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:59 smithi186 ceph-mon[126480]: pgmap v21161: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 14 op/s 2023-05-08T14:44:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:43:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39578.477010 secs 2023-05-08T14:44:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:01 smithi133 ceph-mon[125939]: pgmap v21162: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.3 MiB/s wr, 19 op/s 2023-05-08T14:44:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39580.372297 secs 2023-05-08T14:44:01.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:01 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:44:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:01 smithi096 ceph-mon[124666]: pgmap v21162: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.3 MiB/s wr, 19 op/s 2023-05-08T14:44:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39580.372297 secs 2023-05-08T14:44:02.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:01 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:44:02.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:01 smithi186 ceph-mon[126480]: pgmap v21162: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.3 MiB/s wr, 19 op/s 2023-05-08T14:44:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39580.372297 secs 2023-05-08T14:44:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:01 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:44:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:44:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:44:02.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:44:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:44:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:44:03.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:44:03.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:44:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:44:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:44:03.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:03 smithi133 ceph-mon[125939]: pgmap v21163: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 14 op/s 2023-05-08T14:44:04.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:03 smithi096 ceph-mon[124666]: pgmap v21163: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 14 op/s 2023-05-08T14:44:04.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:03 smithi186 ceph-mon[126480]: pgmap v21163: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 14 op/s 2023-05-08T14:44:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39583.477147 secs 2023-05-08T14:44:04.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39584.030314 secs 2023-05-08T14:44:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39583.477147 secs 2023-05-08T14:44:05.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39584.030314 secs 2023-05-08T14:44:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39583.477147 secs 2023-05-08T14:44:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39584.030314 secs 2023-05-08T14:44:05.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:05 smithi133 ceph-mon[125939]: pgmap v21164: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 14 op/s 2023-05-08T14:44:06.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:05 smithi096 ceph-mon[124666]: pgmap v21164: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 14 op/s 2023-05-08T14:44:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:05 smithi186 ceph-mon[126480]: pgmap v21164: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 14 op/s 2023-05-08T14:44:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39585.372414 secs 2023-05-08T14:44:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:06 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:44:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:44:06.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:44:06.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:06 smithi133 ceph-mon[125939]: osdmap e1400: 12 total, 12 up, 12 in 2023-05-08T14:44:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39585.372414 secs 2023-05-08T14:44:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:06 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:44:07.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:44:07.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:44:07.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:06 smithi096 ceph-mon[124666]: osdmap e1400: 12 total, 12 up, 12 in 2023-05-08T14:44:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39585.372414 secs 2023-05-08T14:44:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:06 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:44:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:44:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:44:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:06 smithi186 ceph-mon[126480]: osdmap e1400: 12 total, 12 up, 12 in 2023-05-08T14:44:07.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:07 smithi133 ceph-mon[125939]: pgmap v21166: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 30 op/s 2023-05-08T14:44:08.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:07 smithi096 ceph-mon[124666]: pgmap v21166: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 30 op/s 2023-05-08T14:44:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:07 smithi186 ceph-mon[126480]: pgmap v21166: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 30 op/s 2023-05-08T14:44:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:09 smithi133 ceph-mon[125939]: pgmap v21167: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 30 op/s 2023-05-08T14:44:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39588.477269 secs 2023-05-08T14:44:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39589.030432 secs 2023-05-08T14:44:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:09 smithi096 ceph-mon[124666]: pgmap v21167: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 30 op/s 2023-05-08T14:44:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39588.477269 secs 2023-05-08T14:44:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39589.030432 secs 2023-05-08T14:44:10.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:09 smithi186 ceph-mon[126480]: pgmap v21167: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 30 op/s 2023-05-08T14:44:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39588.477269 secs 2023-05-08T14:44:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39589.030432 secs 2023-05-08T14:44:11.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:11 smithi133 ceph-mon[125939]: pgmap v21168: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 29 op/s 2023-05-08T14:44:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39590.372535 secs 2023-05-08T14:44:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:11 smithi096 ceph-mon[124666]: pgmap v21168: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 29 op/s 2023-05-08T14:44:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39590.372535 secs 2023-05-08T14:44:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:11 smithi186 ceph-mon[126480]: pgmap v21168: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 29 op/s 2023-05-08T14:44:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39590.372535 secs 2023-05-08T14:44:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:13 smithi133 ceph-mon[125939]: pgmap v21169: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 28 op/s 2023-05-08T14:44:13.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:13 smithi133 ceph-mon[125939]: osdmap e1401: 12 total, 12 up, 12 in 2023-05-08T14:44:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:13 smithi096 ceph-mon[124666]: pgmap v21169: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 28 op/s 2023-05-08T14:44:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:13 smithi096 ceph-mon[124666]: osdmap e1401: 12 total, 12 up, 12 in 2023-05-08T14:44:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:13 smithi186 ceph-mon[126480]: pgmap v21169: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 28 op/s 2023-05-08T14:44:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:13 smithi186 ceph-mon[126480]: osdmap e1401: 12 total, 12 up, 12 in 2023-05-08T14:44:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39593.477382 secs 2023-05-08T14:44:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39594.030652 secs 2023-05-08T14:44:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39593.477382 secs 2023-05-08T14:44:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39594.030652 secs 2023-05-08T14:44:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39593.477382 secs 2023-05-08T14:44:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39594.030652 secs 2023-05-08T14:44:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:15 smithi096 ceph-mon[124666]: pgmap v21171: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 587 KiB/s wr, 6 op/s 2023-05-08T14:44:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:15 smithi186 ceph-mon[126480]: pgmap v21171: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 587 KiB/s wr, 6 op/s 2023-05-08T14:44:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:15 smithi133 ceph-mon[125939]: pgmap v21171: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 587 KiB/s wr, 6 op/s 2023-05-08T14:44:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39595.372654 secs 2023-05-08T14:44:17.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39595.372654 secs 2023-05-08T14:44:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39595.372654 secs 2023-05-08T14:44:18.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:17 smithi186 ceph-mon[126480]: pgmap v21172: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 969 KiB/s rd, 1.0 MiB/s wr, 9 op/s 2023-05-08T14:44:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:17 smithi133 ceph-mon[125939]: pgmap v21172: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 969 KiB/s rd, 1.0 MiB/s wr, 9 op/s 2023-05-08T14:44:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:17 smithi096 ceph-mon[124666]: pgmap v21172: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 969 KiB/s rd, 1.0 MiB/s wr, 9 op/s 2023-05-08T14:44:20.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:19 smithi186 ceph-mon[126480]: pgmap v21173: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 969 KiB/s rd, 1.0 MiB/s wr, 9 op/s 2023-05-08T14:44:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39598.477466 secs 2023-05-08T14:44:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39599.030727 secs 2023-05-08T14:44:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:19 smithi133 ceph-mon[125939]: pgmap v21173: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 969 KiB/s rd, 1.0 MiB/s wr, 9 op/s 2023-05-08T14:44:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39598.477466 secs 2023-05-08T14:44:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39599.030727 secs 2023-05-08T14:44:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:19 smithi096 ceph-mon[124666]: pgmap v21173: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 969 KiB/s rd, 1.0 MiB/s wr, 9 op/s 2023-05-08T14:44:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39598.477466 secs 2023-05-08T14:44:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39599.030727 secs 2023-05-08T14:44:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:21 smithi186 ceph-mon[126480]: pgmap v21174: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 978 KiB/s wr, 10 op/s 2023-05-08T14:44:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39600.372768 secs 2023-05-08T14:44:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:21 smithi133 ceph-mon[125939]: pgmap v21174: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 978 KiB/s wr, 10 op/s 2023-05-08T14:44:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39600.372768 secs 2023-05-08T14:44:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:21 smithi096 ceph-mon[124666]: pgmap v21174: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 978 KiB/s wr, 10 op/s 2023-05-08T14:44:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39600.372768 secs 2023-05-08T14:44:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:23 smithi186 ceph-mon[126480]: pgmap v21175: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 978 KiB/s wr, 10 op/s 2023-05-08T14:44:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:23 smithi133 ceph-mon[125939]: pgmap v21175: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 978 KiB/s wr, 10 op/s 2023-05-08T14:44:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:23 smithi096 ceph-mon[124666]: pgmap v21175: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 978 KiB/s wr, 10 op/s 2023-05-08T14:44:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39603.477571 secs 2023-05-08T14:44:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39604.030854 secs 2023-05-08T14:44:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39603.477571 secs 2023-05-08T14:44:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39604.030854 secs 2023-05-08T14:44:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39603.477571 secs 2023-05-08T14:44:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39604.030854 secs 2023-05-08T14:44:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:25 smithi186 ceph-mon[126480]: pgmap v21176: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 951 KiB/s wr, 9 op/s 2023-05-08T14:44:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:25 smithi133 ceph-mon[125939]: pgmap v21176: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 951 KiB/s wr, 9 op/s 2023-05-08T14:44:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:25 smithi096 ceph-mon[124666]: pgmap v21176: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 951 KiB/s wr, 9 op/s 2023-05-08T14:44:27.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39605.372893 secs 2023-05-08T14:44:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:44:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:44:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:44:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:26 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:44:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39605.372893 secs 2023-05-08T14:44:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:44:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:44:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:44:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:26 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:44:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39605.372893 secs 2023-05-08T14:44:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:44:27.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:44:27.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:44:27.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:26 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:44:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:27 smithi186 ceph-mon[126480]: pgmap v21177: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 976 KiB/s rd, 816 KiB/s wr, 12 op/s 2023-05-08T14:44:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:27 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:44:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:27 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T14:44:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:27 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T14:44:28.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:27 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:44:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:27 smithi133 ceph-mon[125939]: pgmap v21177: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 976 KiB/s rd, 816 KiB/s wr, 12 op/s 2023-05-08T14:44:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:27 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:44:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:27 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T14:44:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:27 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T14:44:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:27 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:44:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:27 smithi096 ceph-mon[124666]: pgmap v21177: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 976 KiB/s rd, 816 KiB/s wr, 12 op/s 2023-05-08T14:44:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:27 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:44:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:27 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T14:44:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:27 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T14:44:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:27 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:44:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:29 smithi186 ceph-mon[126480]: pgmap v21178: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 570 KiB/s rd, 347 KiB/s wr, 7 op/s 2023-05-08T14:44:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39608.477695 secs 2023-05-08T14:44:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39609.031009 secs 2023-05-08T14:44:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:29 smithi133 ceph-mon[125939]: pgmap v21178: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 570 KiB/s rd, 347 KiB/s wr, 7 op/s 2023-05-08T14:44:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39608.477695 secs 2023-05-08T14:44:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39609.031009 secs 2023-05-08T14:44:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:29 smithi096 ceph-mon[124666]: pgmap v21178: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 570 KiB/s rd, 347 KiB/s wr, 7 op/s 2023-05-08T14:44:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39608.477695 secs 2023-05-08T14:44:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39609.031009 secs 2023-05-08T14:44:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:31 smithi186 ceph-mon[126480]: pgmap v21179: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 915 KiB/s rd, 1.0 MiB/s wr, 12 op/s 2023-05-08T14:44:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39610.373009 secs 2023-05-08T14:44:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:31 smithi133 ceph-mon[125939]: pgmap v21179: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 915 KiB/s rd, 1.0 MiB/s wr, 12 op/s 2023-05-08T14:44:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39610.373009 secs 2023-05-08T14:44:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:31 smithi096 ceph-mon[124666]: pgmap v21179: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 915 KiB/s rd, 1.0 MiB/s wr, 12 op/s 2023-05-08T14:44:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39610.373009 secs 2023-05-08T14:44:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:33 smithi186 ceph-mon[126480]: pgmap v21180: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 696 KiB/s wr, 7 op/s 2023-05-08T14:44:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:33 smithi133 ceph-mon[125939]: pgmap v21180: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 696 KiB/s wr, 7 op/s 2023-05-08T14:44:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:33 smithi096 ceph-mon[124666]: pgmap v21180: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 696 KiB/s wr, 7 op/s 2023-05-08T14:44:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39613.477817 secs 2023-05-08T14:44:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39614.031098 secs 2023-05-08T14:44:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39613.477817 secs 2023-05-08T14:44:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39614.031098 secs 2023-05-08T14:44:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39613.477817 secs 2023-05-08T14:44:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39614.031098 secs 2023-05-08T14:44:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:35 smithi186 ceph-mon[126480]: pgmap v21181: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 696 KiB/s wr, 7 op/s 2023-05-08T14:44:36.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:35 smithi133 ceph-mon[125939]: pgmap v21181: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 696 KiB/s wr, 7 op/s 2023-05-08T14:44:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:35 smithi096 ceph-mon[124666]: pgmap v21181: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 696 KiB/s wr, 7 op/s 2023-05-08T14:44:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39615.373130 secs 2023-05-08T14:44:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39615.373130 secs 2023-05-08T14:44:37.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39615.373130 secs 2023-05-08T14:44:38.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:37 smithi186 ceph-mon[126480]: pgmap v21182: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 729 KiB/s rd, 696 KiB/s wr, 11 op/s 2023-05-08T14:44:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:37 smithi133 ceph-mon[125939]: pgmap v21182: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 729 KiB/s rd, 696 KiB/s wr, 11 op/s 2023-05-08T14:44:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:37 smithi096 ceph-mon[124666]: pgmap v21182: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 729 KiB/s rd, 696 KiB/s wr, 11 op/s 2023-05-08T14:44:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:39 smithi186 ceph-mon[126480]: pgmap v21183: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 698 KiB/s rd, 696 KiB/s wr, 7 op/s 2023-05-08T14:44:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39618.477949 secs 2023-05-08T14:44:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39619.031242 secs 2023-05-08T14:44:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:39 smithi133 ceph-mon[125939]: pgmap v21183: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 698 KiB/s rd, 696 KiB/s wr, 7 op/s 2023-05-08T14:44:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39618.477949 secs 2023-05-08T14:44:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39619.031242 secs 2023-05-08T14:44:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:39 smithi096 ceph-mon[124666]: pgmap v21183: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 698 KiB/s rd, 696 KiB/s wr, 7 op/s 2023-05-08T14:44:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39618.477949 secs 2023-05-08T14:44:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39619.031242 secs 2023-05-08T14:44:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:41 smithi186 ceph-mon[126480]: pgmap v21184: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 700 KiB/s rd, 696 KiB/s wr, 11 op/s 2023-05-08T14:44:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39620.373225 secs 2023-05-08T14:44:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:41 smithi133 ceph-mon[125939]: pgmap v21184: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 700 KiB/s rd, 696 KiB/s wr, 11 op/s 2023-05-08T14:44:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39620.373225 secs 2023-05-08T14:44:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:41 smithi096 ceph-mon[124666]: pgmap v21184: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 700 KiB/s rd, 696 KiB/s wr, 11 op/s 2023-05-08T14:44:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39620.373225 secs 2023-05-08T14:44:44.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:43 smithi186 ceph-mon[126480]: pgmap v21185: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 682 B/s wr, 6 op/s 2023-05-08T14:44:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:43 smithi133 ceph-mon[125939]: pgmap v21185: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 682 B/s wr, 6 op/s 2023-05-08T14:44:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:43 smithi096 ceph-mon[124666]: pgmap v21185: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 682 B/s wr, 6 op/s 2023-05-08T14:44:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39623.478033 secs 2023-05-08T14:44:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39624.031372 secs 2023-05-08T14:44:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39623.478033 secs 2023-05-08T14:44:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39624.031372 secs 2023-05-08T14:44:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39623.478033 secs 2023-05-08T14:44:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39624.031372 secs 2023-05-08T14:44:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:45 smithi186 ceph-mon[126480]: pgmap v21186: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 682 B/s wr, 6 op/s 2023-05-08T14:44:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:45 smithi133 ceph-mon[125939]: pgmap v21186: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 682 B/s wr, 6 op/s 2023-05-08T14:44:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:45 smithi096 ceph-mon[124666]: pgmap v21186: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 682 B/s wr, 6 op/s 2023-05-08T14:44:47.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39625.373350 secs 2023-05-08T14:44:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39625.373350 secs 2023-05-08T14:44:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39625.373350 secs 2023-05-08T14:44:48.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:47 smithi186 ceph-mon[126480]: pgmap v21187: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 707 KiB/s rd, 352 KiB/s wr, 10 op/s 2023-05-08T14:44:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:47 smithi133 ceph-mon[125939]: pgmap v21187: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 707 KiB/s rd, 352 KiB/s wr, 10 op/s 2023-05-08T14:44:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:47 smithi096 ceph-mon[124666]: pgmap v21187: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 707 KiB/s rd, 352 KiB/s wr, 10 op/s 2023-05-08T14:44:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:49 smithi186 ceph-mon[126480]: pgmap v21188: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 352 KiB/s wr, 6 op/s 2023-05-08T14:44:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39628.478174 secs 2023-05-08T14:44:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39629.031502 secs 2023-05-08T14:44:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:49 smithi133 ceph-mon[125939]: pgmap v21188: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 352 KiB/s wr, 6 op/s 2023-05-08T14:44:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39628.478174 secs 2023-05-08T14:44:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39629.031502 secs 2023-05-08T14:44:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:49 smithi096 ceph-mon[124666]: pgmap v21188: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 352 KiB/s wr, 6 op/s 2023-05-08T14:44:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39628.478174 secs 2023-05-08T14:44:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39629.031502 secs 2023-05-08T14:44:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39630.373448 secs 2023-05-08T14:44:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39630.373448 secs 2023-05-08T14:44:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39630.373448 secs 2023-05-08T14:44:52.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:51 smithi186 ceph-mon[126480]: pgmap v21189: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 776 KiB/s rd, 701 KiB/s wr, 10 op/s 2023-05-08T14:44:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:51 smithi133 ceph-mon[125939]: pgmap v21189: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 776 KiB/s rd, 701 KiB/s wr, 10 op/s 2023-05-08T14:44:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:51 smithi096 ceph-mon[124666]: pgmap v21189: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 776 KiB/s rd, 701 KiB/s wr, 10 op/s 2023-05-08T14:44:54.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:53 smithi186 ceph-mon[126480]: pgmap v21190: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 774 KiB/s rd, 701 KiB/s wr, 7 op/s 2023-05-08T14:44:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:53 smithi133 ceph-mon[125939]: pgmap v21190: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 774 KiB/s rd, 701 KiB/s wr, 7 op/s 2023-05-08T14:44:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:53 smithi096 ceph-mon[124666]: pgmap v21190: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 774 KiB/s rd, 701 KiB/s wr, 7 op/s 2023-05-08T14:44:55.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39633.478295 secs 2023-05-08T14:44:55.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39633.478295 secs 2023-05-08T14:44:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39633.478295 secs 2023-05-08T14:44:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:55 smithi186 ceph-mon[126480]: pgmap v21191: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 774 KiB/s rd, 701 KiB/s wr, 7 op/s 2023-05-08T14:44:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:55 smithi133 ceph-mon[125939]: pgmap v21191: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 774 KiB/s rd, 701 KiB/s wr, 7 op/s 2023-05-08T14:44:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:55 smithi096 ceph-mon[124666]: pgmap v21191: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 774 KiB/s rd, 701 KiB/s wr, 7 op/s 2023-05-08T14:44:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:57 smithi133 ceph-mon[125939]: pgmap v21192: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T14:44:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:44:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:44:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:57 smithi096 ceph-mon[124666]: pgmap v21192: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T14:44:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:44:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:44:58.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:57 smithi186 ceph-mon[126480]: pgmap v21192: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T14:44:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:44:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:44:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:58 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:44:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:44:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:44:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:44:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:58 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:44:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:44:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:44:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:44:59.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:58 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:44:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:44:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:44:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:45:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:59 smithi133 ceph-mon[125939]: pgmap v21193: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 992 KiB/s rd, 919 KiB/s wr, 9 op/s 2023-05-08T14:45:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39638.478443 secs 2023-05-08T14:45:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:44:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39639.031798 secs 2023-05-08T14:45:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:59 smithi096 ceph-mon[124666]: pgmap v21193: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 992 KiB/s rd, 919 KiB/s wr, 9 op/s 2023-05-08T14:45:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39638.478443 secs 2023-05-08T14:45:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:44:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39639.031798 secs 2023-05-08T14:45:00.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:59 smithi186 ceph-mon[126480]: pgmap v21193: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 992 KiB/s rd, 919 KiB/s wr, 9 op/s 2023-05-08T14:45:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39638.478443 secs 2023-05-08T14:45:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:44:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39639.031798 secs 2023-05-08T14:45:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:01 smithi133 ceph-mon[125939]: pgmap v21194: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.9 MiB/s wr, 15 op/s 2023-05-08T14:45:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:01 smithi096 ceph-mon[124666]: pgmap v21194: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.9 MiB/s wr, 15 op/s 2023-05-08T14:45:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:01 smithi186 ceph-mon[126480]: pgmap v21194: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.9 MiB/s wr, 15 op/s 2023-05-08T14:45:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:45:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:45:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:02 smithi133 ceph-mon[125939]: pgmap v21195: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 734 KiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T14:45:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:45:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:45:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:02 smithi096 ceph-mon[124666]: pgmap v21195: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 734 KiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T14:45:03.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:45:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:45:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:02 smithi186 ceph-mon[126480]: pgmap v21195: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 734 KiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T14:45:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:03 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:45:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:03 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:45:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:03 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:45:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39643.478562 secs 2023-05-08T14:45:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:04 smithi133 ceph-mon[125939]: pgmap v21196: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 734 KiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T14:45:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39644.031928 secs 2023-05-08T14:45:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39643.478562 secs 2023-05-08T14:45:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:04 smithi096 ceph-mon[124666]: pgmap v21196: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 734 KiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T14:45:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39644.031928 secs 2023-05-08T14:45:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39643.478562 secs 2023-05-08T14:45:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:04 smithi186 ceph-mon[126480]: pgmap v21196: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 734 KiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T14:45:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39644.031928 secs 2023-05-08T14:45:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:06 smithi133 ceph-mon[125939]: pgmap v21197: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.0 MiB/s wr, 30 op/s 2023-05-08T14:45:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:06 smithi096 ceph-mon[124666]: pgmap v21197: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.0 MiB/s wr, 30 op/s 2023-05-08T14:45:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:06 smithi186 ceph-mon[126480]: pgmap v21197: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.0 MiB/s wr, 30 op/s 2023-05-08T14:45:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:09 smithi133 ceph-mon[125939]: pgmap v21198: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 25 op/s 2023-05-08T14:45:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39648.478671 secs 2023-05-08T14:45:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39649.032062 secs 2023-05-08T14:45:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:09 smithi096 ceph-mon[124666]: pgmap v21198: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 25 op/s 2023-05-08T14:45:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39648.478671 secs 2023-05-08T14:45:10.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39649.032062 secs 2023-05-08T14:45:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:09 smithi186 ceph-mon[126480]: pgmap v21198: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 25 op/s 2023-05-08T14:45:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39648.478671 secs 2023-05-08T14:45:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39649.032062 secs 2023-05-08T14:45:11.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:11 smithi133 ceph-mon[125939]: pgmap v21199: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 28 op/s 2023-05-08T14:45:12.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:11 smithi096 ceph-mon[124666]: pgmap v21199: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 28 op/s 2023-05-08T14:45:12.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:11 smithi186 ceph-mon[126480]: pgmap v21199: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 28 op/s 2023-05-08T14:45:13.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:13 smithi133 ceph-mon[125939]: pgmap v21200: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 497 KiB/s wr, 22 op/s 2023-05-08T14:45:14.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:13 smithi096 ceph-mon[124666]: pgmap v21200: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 497 KiB/s wr, 22 op/s 2023-05-08T14:45:14.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:13 smithi186 ceph-mon[126480]: pgmap v21200: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 497 KiB/s wr, 22 op/s 2023-05-08T14:45:14.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39653.478792 secs 2023-05-08T14:45:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39653.478792 secs 2023-05-08T14:45:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39653.478792 secs 2023-05-08T14:45:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:15 smithi133 ceph-mon[125939]: pgmap v21201: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 497 KiB/s wr, 22 op/s 2023-05-08T14:45:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:15 smithi096 ceph-mon[124666]: pgmap v21201: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 497 KiB/s wr, 22 op/s 2023-05-08T14:45:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:15 smithi186 ceph-mon[126480]: pgmap v21201: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 497 KiB/s wr, 22 op/s 2023-05-08T14:45:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:17 smithi133 ceph-mon[125939]: pgmap v21202: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 28 op/s 2023-05-08T14:45:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:17 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:45:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:17 smithi096 ceph-mon[124666]: pgmap v21202: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 28 op/s 2023-05-08T14:45:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:17 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:45:18.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:17 smithi186 ceph-mon[126480]: pgmap v21202: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 28 op/s 2023-05-08T14:45:18.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:17 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:45:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:18 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:45:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:18 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:45:18.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:18 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:45:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:18 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:45:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:18 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:45:19.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:18 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:45:19.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:18 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:45:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:18 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:45:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:18 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:45:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:19 smithi133 ceph-mon[125939]: pgmap v21203: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 1.4 MiB/s wr, 10 op/s 2023-05-08T14:45:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39658.478916 secs 2023-05-08T14:45:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:19 smithi096 ceph-mon[124666]: pgmap v21203: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 1.4 MiB/s wr, 10 op/s 2023-05-08T14:45:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39658.478916 secs 2023-05-08T14:45:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:19 smithi186 ceph-mon[126480]: pgmap v21203: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 1.4 MiB/s wr, 10 op/s 2023-05-08T14:45:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39658.478916 secs 2023-05-08T14:45:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:21 smithi133 ceph-mon[125939]: pgmap v21204: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 15 op/s 2023-05-08T14:45:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:21 smithi133 ceph-mon[125939]: osdmap e1402: 12 total, 12 up, 12 in 2023-05-08T14:45:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:21 smithi096 ceph-mon[124666]: pgmap v21204: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 15 op/s 2023-05-08T14:45:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:21 smithi096 ceph-mon[124666]: osdmap e1402: 12 total, 12 up, 12 in 2023-05-08T14:45:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:21 smithi186 ceph-mon[126480]: pgmap v21204: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 15 op/s 2023-05-08T14:45:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:21 smithi186 ceph-mon[126480]: osdmap e1402: 12 total, 12 up, 12 in 2023-05-08T14:45:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:23 smithi133 ceph-mon[125939]: pgmap v21206: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 14 op/s 2023-05-08T14:45:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:23 smithi096 ceph-mon[124666]: pgmap v21206: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 14 op/s 2023-05-08T14:45:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:23 smithi186 ceph-mon[126480]: pgmap v21206: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 14 op/s 2023-05-08T14:45:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39663.479038 secs 2023-05-08T14:45:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39663.479038 secs 2023-05-08T14:45:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39663.479038 secs 2023-05-08T14:45:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:25 smithi133 ceph-mon[125939]: pgmap v21207: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 14 op/s 2023-05-08T14:45:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:25 smithi096 ceph-mon[124666]: pgmap v21207: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 14 op/s 2023-05-08T14:45:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:25 smithi186 ceph-mon[126480]: pgmap v21207: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 14 op/s 2023-05-08T14:45:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:27 smithi133 ceph-mon[125939]: pgmap v21208: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 457 KiB/s wr, 11 op/s 2023-05-08T14:45:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:45:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:45:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:45:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:45:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:27 smithi096 ceph-mon[124666]: pgmap v21208: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 457 KiB/s wr, 11 op/s 2023-05-08T14:45:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:45:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:45:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:45:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:45:28.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:27 smithi186 ceph-mon[126480]: pgmap v21208: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 457 KiB/s wr, 11 op/s 2023-05-08T14:45:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:45:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:45:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:45:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:45:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:28 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:45:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:28 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T14:45:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:28 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T14:45:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:28 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:45:28.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:28 smithi133 ceph-mon[125939]: osdmap e1403: 12 total, 12 up, 12 in 2023-05-08T14:45:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:28 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:45:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:28 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T14:45:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:28 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T14:45:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:28 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:45:29.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:28 smithi096 ceph-mon[124666]: osdmap e1403: 12 total, 12 up, 12 in 2023-05-08T14:45:29.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:28 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:45:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:28 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T14:45:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:28 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T14:45:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:28 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:45:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:28 smithi186 ceph-mon[126480]: osdmap e1403: 12 total, 12 up, 12 in 2023-05-08T14:45:29.989 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:29 smithi133 ceph-mon[125939]: pgmap v21209: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 457 KiB/s wr, 11 op/s 2023-05-08T14:45:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39668.479160 secs 2023-05-08T14:45:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:29 smithi096 ceph-mon[124666]: pgmap v21209: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 457 KiB/s wr, 11 op/s 2023-05-08T14:45:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39668.479160 secs 2023-05-08T14:45:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:29 smithi186 ceph-mon[126480]: pgmap v21209: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 457 KiB/s wr, 11 op/s 2023-05-08T14:45:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39668.479160 secs 2023-05-08T14:45:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:31 smithi133 ceph-mon[125939]: pgmap v21211: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 456 KiB/s rd, 453 KiB/s wr, 8 op/s 2023-05-08T14:45:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:31 smithi096 ceph-mon[124666]: pgmap v21211: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 456 KiB/s rd, 453 KiB/s wr, 8 op/s 2023-05-08T14:45:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:31 smithi186 ceph-mon[126480]: pgmap v21211: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 456 KiB/s rd, 453 KiB/s wr, 8 op/s 2023-05-08T14:45:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:33 smithi133 ceph-mon[125939]: pgmap v21212: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 422 KiB/s rd, 419 KiB/s wr, 8 op/s 2023-05-08T14:45:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:33 smithi096 ceph-mon[124666]: pgmap v21212: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 422 KiB/s rd, 419 KiB/s wr, 8 op/s 2023-05-08T14:45:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:33 smithi186 ceph-mon[126480]: pgmap v21212: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 422 KiB/s rd, 419 KiB/s wr, 8 op/s 2023-05-08T14:45:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39673.479285 secs 2023-05-08T14:45:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39674.032663 secs 2023-05-08T14:45:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39673.479285 secs 2023-05-08T14:45:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39674.032663 secs 2023-05-08T14:45:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39673.479285 secs 2023-05-08T14:45:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39674.032663 secs 2023-05-08T14:45:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:35 smithi133 ceph-mon[125939]: pgmap v21213: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 422 KiB/s rd, 419 KiB/s wr, 8 op/s 2023-05-08T14:45:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:35 smithi096 ceph-mon[124666]: pgmap v21213: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 422 KiB/s rd, 419 KiB/s wr, 8 op/s 2023-05-08T14:45:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:35 smithi186 ceph-mon[126480]: pgmap v21213: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 422 KiB/s rd, 419 KiB/s wr, 8 op/s 2023-05-08T14:45:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39675.374535 secs 2023-05-08T14:45:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39675.374535 secs 2023-05-08T14:45:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39675.374535 secs 2023-05-08T14:45:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:37 smithi133 ceph-mon[125939]: pgmap v21214: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 786 KiB/s rd, 784 KiB/s wr, 10 op/s 2023-05-08T14:45:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:37 smithi096 ceph-mon[124666]: pgmap v21214: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 786 KiB/s rd, 784 KiB/s wr, 10 op/s 2023-05-08T14:45:38.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:37 smithi186 ceph-mon[126480]: pgmap v21214: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 786 KiB/s rd, 784 KiB/s wr, 10 op/s 2023-05-08T14:45:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:38 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:45:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:38 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:45:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:38 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:45:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:38 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:45:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:38 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:45:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:38 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:45:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:38 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:45:39.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:38 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:45:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:38 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:45:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:38 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:45:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:38 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:45:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:38 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:45:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:39 smithi133 ceph-mon[125939]: pgmap v21215: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 786 KiB/s rd, 784 KiB/s wr, 10 op/s 2023-05-08T14:45:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39678.479393 secs 2023-05-08T14:45:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39679.032737 secs 2023-05-08T14:45:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:39 smithi096 ceph-mon[124666]: pgmap v21215: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 786 KiB/s rd, 784 KiB/s wr, 10 op/s 2023-05-08T14:45:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39678.479393 secs 2023-05-08T14:45:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39679.032737 secs 2023-05-08T14:45:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:39 smithi186 ceph-mon[126480]: pgmap v21215: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 786 KiB/s rd, 784 KiB/s wr, 10 op/s 2023-05-08T14:45:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39678.479393 secs 2023-05-08T14:45:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39679.032737 secs 2023-05-08T14:45:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:41 smithi133 ceph-mon[125939]: pgmap v21216: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 699 KiB/s rd, 696 KiB/s wr, 13 op/s 2023-05-08T14:45:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39680.374654 secs 2023-05-08T14:45:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:41 smithi096 ceph-mon[124666]: pgmap v21216: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 699 KiB/s rd, 696 KiB/s wr, 13 op/s 2023-05-08T14:45:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39680.374654 secs 2023-05-08T14:45:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:41 smithi186 ceph-mon[126480]: pgmap v21216: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 699 KiB/s rd, 696 KiB/s wr, 13 op/s 2023-05-08T14:45:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39680.374654 secs 2023-05-08T14:45:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:43 smithi096 ceph-mon[124666]: pgmap v21217: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 656 KiB/s rd, 654 KiB/s wr, 9 op/s 2023-05-08T14:45:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:43 smithi186 ceph-mon[126480]: pgmap v21217: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 656 KiB/s rd, 654 KiB/s wr, 9 op/s 2023-05-08T14:45:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:43 smithi133 ceph-mon[125939]: pgmap v21217: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 656 KiB/s rd, 654 KiB/s wr, 9 op/s 2023-05-08T14:45:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39683.479464 secs 2023-05-08T14:45:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39684.032862 secs 2023-05-08T14:45:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39683.479464 secs 2023-05-08T14:45:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39684.032862 secs 2023-05-08T14:45:45.239 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39683.479464 secs 2023-05-08T14:45:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39684.032862 secs 2023-05-08T14:45:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:45 smithi096 ceph-mon[124666]: pgmap v21218: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 656 KiB/s rd, 654 KiB/s wr, 9 op/s 2023-05-08T14:45:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:45 smithi186 ceph-mon[126480]: pgmap v21218: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 656 KiB/s rd, 654 KiB/s wr, 9 op/s 2023-05-08T14:45:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:45 smithi133 ceph-mon[125939]: pgmap v21218: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 656 KiB/s rd, 654 KiB/s wr, 9 op/s 2023-05-08T14:45:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:47 smithi096 ceph-mon[124666]: pgmap v21219: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 14 op/s 2023-05-08T14:45:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:47 smithi186 ceph-mon[126480]: pgmap v21219: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 14 op/s 2023-05-08T14:45:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:47 smithi133 ceph-mon[125939]: pgmap v21219: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 14 op/s 2023-05-08T14:45:50.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:49 smithi186 ceph-mon[126480]: pgmap v21220: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 908 KiB/s wr, 9 op/s 2023-05-08T14:45:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:45:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39689.032983 secs 2023-05-08T14:45:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:49 smithi133 ceph-mon[125939]: pgmap v21220: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 908 KiB/s wr, 9 op/s 2023-05-08T14:45:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:45:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39689.032983 secs 2023-05-08T14:45:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:49 smithi096 ceph-mon[124666]: pgmap v21220: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 908 KiB/s wr, 9 op/s 2023-05-08T14:45:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:45:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39689.032983 secs 2023-05-08T14:45:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:45:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:45:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:45:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:45:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:45:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:45:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:45:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:45:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:45:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:51 smithi186 ceph-mon[126480]: pgmap v21221: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2023-05-08T14:45:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:51 smithi133 ceph-mon[125939]: pgmap v21221: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2023-05-08T14:45:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:51 smithi096 ceph-mon[124666]: pgmap v21221: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2023-05-08T14:45:53.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:52 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:45:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:52 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:45:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:52 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:45:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:53 smithi186 ceph-mon[126480]: pgmap v21222: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 9 op/s 2023-05-08T14:45:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:53 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T14:45:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:53 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:45:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:53 smithi133 ceph-mon[125939]: pgmap v21222: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 9 op/s 2023-05-08T14:45:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:53 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T14:45:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:53 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:45:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:53 smithi096 ceph-mon[124666]: pgmap v21222: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 9 op/s 2023-05-08T14:45:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:53 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T14:45:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:53 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:45:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39693.479680 secs 2023-05-08T14:45:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39693.479680 secs 2023-05-08T14:45:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39693.479680 secs 2023-05-08T14:45:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:55 smithi186 ceph-mon[126480]: pgmap v21223: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 9 op/s 2023-05-08T14:45:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:55 smithi133 ceph-mon[125939]: pgmap v21223: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 9 op/s 2023-05-08T14:45:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:55 smithi096 ceph-mon[124666]: pgmap v21223: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 9 op/s 2023-05-08T14:45:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:56 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:45:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:56 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T14:45:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:56 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:45:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:56 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:45:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:56 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T14:45:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:56 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:45:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:56 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:45:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:56 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6838/1267655485,v1:172.21.15.186:6839/1267655485] up:active 2023-05-08T14:45:57.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:56 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:45:58.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:57 smithi186 ceph-mon[126480]: pgmap v21224: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 15 op/s 2023-05-08T14:45:58.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:45:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:57 smithi133 ceph-mon[125939]: pgmap v21224: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 15 op/s 2023-05-08T14:45:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:45:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:57 smithi096 ceph-mon[124666]: pgmap v21224: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 15 op/s 2023-05-08T14:45:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:45:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:45:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:45:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:45:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:45:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:45:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:45:59.859 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:59 smithi186 ceph-mon[126480]: pgmap v21225: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T14:46:00.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:45:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39698.479800 secs 2023-05-08T14:46:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:59 smithi133 ceph-mon[125939]: pgmap v21225: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T14:46:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:45:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39698.479800 secs 2023-05-08T14:46:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:59 smithi096 ceph-mon[124666]: pgmap v21225: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T14:46:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:45:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39698.479800 secs 2023-05-08T14:46:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:01 smithi186 ceph-mon[126480]: pgmap v21226: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 15 op/s 2023-05-08T14:46:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:01 smithi133 ceph-mon[125939]: pgmap v21226: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 15 op/s 2023-05-08T14:46:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:01 smithi096 ceph-mon[124666]: pgmap v21226: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 15 op/s 2023-05-08T14:46:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:03 smithi186 ceph-mon[126480]: pgmap v21227: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 10 op/s 2023-05-08T14:46:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:03 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:46:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:03 smithi133 ceph-mon[125939]: pgmap v21227: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 10 op/s 2023-05-08T14:46:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:03 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:46:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:03 smithi096 ceph-mon[124666]: pgmap v21227: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 10 op/s 2023-05-08T14:46:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:03 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:46:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39703.479899 secs 2023-05-08T14:46:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39704.033409 secs 2023-05-08T14:46:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39703.479899 secs 2023-05-08T14:46:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39704.033409 secs 2023-05-08T14:46:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39703.479899 secs 2023-05-08T14:46:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39704.033409 secs 2023-05-08T14:46:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:05 smithi133 ceph-mon[125939]: pgmap v21228: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 10 op/s 2023-05-08T14:46:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39705.375275 secs 2023-05-08T14:46:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:05 smithi096 ceph-mon[124666]: pgmap v21228: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 10 op/s 2023-05-08T14:46:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39705.375275 secs 2023-05-08T14:46:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:05 smithi186 ceph-mon[126480]: pgmap v21228: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 10 op/s 2023-05-08T14:46:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39705.375275 secs 2023-05-08T14:46:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:46:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:46:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:46:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:46:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:46:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:46:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:07 smithi133 ceph-mon[125939]: pgmap v21229: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.2 MiB/s wr, 31 op/s 2023-05-08T14:46:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:07 smithi096 ceph-mon[124666]: pgmap v21229: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.2 MiB/s wr, 31 op/s 2023-05-08T14:46:08.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:07 smithi186 ceph-mon[126480]: pgmap v21229: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.2 MiB/s wr, 31 op/s 2023-05-08T14:46:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:08 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:46:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:08 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:46:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:08 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:46:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:09 smithi133 ceph-mon[125939]: pgmap v21230: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.5 MiB/s wr, 26 op/s 2023-05-08T14:46:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39708.480045 secs 2023-05-08T14:46:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:09 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:46:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:09 smithi096 ceph-mon[124666]: pgmap v21230: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.5 MiB/s wr, 26 op/s 2023-05-08T14:46:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39708.480045 secs 2023-05-08T14:46:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:09 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:46:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:09 smithi186 ceph-mon[126480]: pgmap v21230: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.5 MiB/s wr, 26 op/s 2023-05-08T14:46:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39708.480045 secs 2023-05-08T14:46:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:09 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:46:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:10 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:46:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:10 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:46:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:10 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:46:11.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:10 smithi133 ceph-mon[125939]: pgmap v21231: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.6 MiB/s wr, 31 op/s 2023-05-08T14:46:11.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39710.375401 secs 2023-05-08T14:46:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:10 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:46:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:10 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:46:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:10 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:46:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:10 smithi096 ceph-mon[124666]: pgmap v21231: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.6 MiB/s wr, 31 op/s 2023-05-08T14:46:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39710.375401 secs 2023-05-08T14:46:11.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:10 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:46:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:10 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:46:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:10 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:46:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:10 smithi186 ceph-mon[126480]: pgmap v21231: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.6 MiB/s wr, 31 op/s 2023-05-08T14:46:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39710.375401 secs 2023-05-08T14:46:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:11 smithi133 ceph-mon[125939]: osdmap e1404: 12 total, 12 up, 12 in 2023-05-08T14:46:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:11 smithi096 ceph-mon[124666]: osdmap e1404: 12 total, 12 up, 12 in 2023-05-08T14:46:12.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:11 smithi186 ceph-mon[126480]: osdmap e1404: 12 total, 12 up, 12 in 2023-05-08T14:46:13.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:12 smithi133 ceph-mon[125939]: pgmap v21233: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 995 KiB/s wr, 30 op/s 2023-05-08T14:46:13.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:12 smithi096 ceph-mon[124666]: pgmap v21233: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 995 KiB/s wr, 30 op/s 2023-05-08T14:46:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:12 smithi186 ceph-mon[126480]: pgmap v21233: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 995 KiB/s wr, 30 op/s 2023-05-08T14:46:14.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39713.480146 secs 2023-05-08T14:46:15.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39713.480146 secs 2023-05-08T14:46:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39713.480146 secs 2023-05-08T14:46:15.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:15 smithi133 ceph-mon[125939]: pgmap v21234: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 995 KiB/s wr, 30 op/s 2023-05-08T14:46:16.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:15 smithi096 ceph-mon[124666]: pgmap v21234: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 995 KiB/s wr, 30 op/s 2023-05-08T14:46:16.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:15 smithi186 ceph-mon[126480]: pgmap v21234: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 995 KiB/s wr, 30 op/s 2023-05-08T14:46:16.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39715.375498 secs 2023-05-08T14:46:17.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39715.375498 secs 2023-05-08T14:46:17.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39715.375498 secs 2023-05-08T14:46:17.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:17 smithi133 ceph-mon[125939]: pgmap v21235: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T14:46:18.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:17 smithi096 ceph-mon[124666]: pgmap v21235: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T14:46:18.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:17 smithi186 ceph-mon[126480]: pgmap v21235: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T14:46:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:19 smithi133 ceph-mon[125939]: pgmap v21236: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T14:46:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:19 smithi133 ceph-mon[125939]: osdmap e1405: 12 total, 12 up, 12 in 2023-05-08T14:46:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39718.480250 secs 2023-05-08T14:46:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:19 smithi096 ceph-mon[124666]: pgmap v21236: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T14:46:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:19 smithi096 ceph-mon[124666]: osdmap e1405: 12 total, 12 up, 12 in 2023-05-08T14:46:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39718.480250 secs 2023-05-08T14:46:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:19 smithi186 ceph-mon[126480]: pgmap v21236: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T14:46:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:19 smithi186 ceph-mon[126480]: osdmap e1405: 12 total, 12 up, 12 in 2023-05-08T14:46:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39718.480250 secs 2023-05-08T14:46:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:21 smithi133 ceph-mon[125939]: pgmap v21238: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T14:46:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39720.375632 secs 2023-05-08T14:46:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:21 smithi096 ceph-mon[124666]: pgmap v21238: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T14:46:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39720.375632 secs 2023-05-08T14:46:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:21 smithi186 ceph-mon[126480]: pgmap v21238: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T14:46:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39720.375632 secs 2023-05-08T14:46:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:23 smithi133 ceph-mon[125939]: pgmap v21239: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T14:46:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:23 smithi096 ceph-mon[124666]: pgmap v21239: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T14:46:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:23 smithi186 ceph-mon[126480]: pgmap v21239: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T14:46:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39723.480369 secs 2023-05-08T14:46:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39724.033865 secs 2023-05-08T14:46:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39723.480369 secs 2023-05-08T14:46:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39724.033865 secs 2023-05-08T14:46:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39723.480369 secs 2023-05-08T14:46:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39724.033865 secs 2023-05-08T14:46:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:25 smithi133 ceph-mon[125939]: pgmap v21240: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T14:46:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:25 smithi096 ceph-mon[124666]: pgmap v21240: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T14:46:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:25 smithi186 ceph-mon[126480]: pgmap v21240: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T14:46:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39725.375752 secs 2023-05-08T14:46:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:26 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:46:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:26 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:46:26.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:26 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:46:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39725.375752 secs 2023-05-08T14:46:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:26 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:46:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:26 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:46:27.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:26 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:46:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39725.375752 secs 2023-05-08T14:46:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:26 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:46:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:26 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:46:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:26 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:46:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:27 smithi133 ceph-mon[125939]: pgmap v21241: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 10 op/s 2023-05-08T14:46:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:27 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:46:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:27 smithi096 ceph-mon[124666]: pgmap v21241: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 10 op/s 2023-05-08T14:46:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:27 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:46:28.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:27 smithi186 ceph-mon[126480]: pgmap v21241: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 10 op/s 2023-05-08T14:46:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:27 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:46:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:28 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:46:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:28 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:46:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:28 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:46:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:28 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:46:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:28 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:46:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:28 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:46:29.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:28 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:46:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:28 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:46:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:28 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:46:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:29 smithi133 ceph-mon[125939]: pgmap v21242: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 10 op/s 2023-05-08T14:46:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:29 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:46:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:29 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T14:46:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:29 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T14:46:29.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:29 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:46:29.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39728.480432 secs 2023-05-08T14:46:29.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39729.033939 secs 2023-05-08T14:46:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:29 smithi096 ceph-mon[124666]: pgmap v21242: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 10 op/s 2023-05-08T14:46:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:29 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:46:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:29 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T14:46:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:29 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T14:46:30.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:29 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:46:30.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39728.480432 secs 2023-05-08T14:46:30.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39729.033939 secs 2023-05-08T14:46:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:29 smithi186 ceph-mon[126480]: pgmap v21242: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 10 op/s 2023-05-08T14:46:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:29 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:46:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:29 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T14:46:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:29 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T14:46:30.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:29 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:46:30.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39728.480432 secs 2023-05-08T14:46:30.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39729.033939 secs 2023-05-08T14:46:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:31 smithi133 ceph-mon[125939]: pgmap v21243: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 14 op/s 2023-05-08T14:46:31.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39730.375868 secs 2023-05-08T14:46:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:31 smithi096 ceph-mon[124666]: pgmap v21243: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 14 op/s 2023-05-08T14:46:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39730.375868 secs 2023-05-08T14:46:32.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:31 smithi186 ceph-mon[126480]: pgmap v21243: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 14 op/s 2023-05-08T14:46:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39730.375868 secs 2023-05-08T14:46:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:33 smithi133 ceph-mon[125939]: pgmap v21244: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 9 op/s 2023-05-08T14:46:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:33 smithi096 ceph-mon[124666]: pgmap v21244: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 9 op/s 2023-05-08T14:46:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:33 smithi186 ceph-mon[126480]: pgmap v21244: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 9 op/s 2023-05-08T14:46:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39733.480554 secs 2023-05-08T14:46:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39734.034099 secs 2023-05-08T14:46:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39733.480554 secs 2023-05-08T14:46:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39734.034099 secs 2023-05-08T14:46:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39733.480554 secs 2023-05-08T14:46:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39734.034099 secs 2023-05-08T14:46:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:35 smithi133 ceph-mon[125939]: pgmap v21245: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 9 op/s 2023-05-08T14:46:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:35 smithi096 ceph-mon[124666]: pgmap v21245: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 9 op/s 2023-05-08T14:46:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:35 smithi186 ceph-mon[126480]: pgmap v21245: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 9 op/s 2023-05-08T14:46:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39735.375988 secs 2023-05-08T14:46:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39735.375988 secs 2023-05-08T14:46:37.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39735.375988 secs 2023-05-08T14:46:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:37 smithi133 ceph-mon[125939]: pgmap v21246: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 14 op/s 2023-05-08T14:46:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:37 smithi096 ceph-mon[124666]: pgmap v21246: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 14 op/s 2023-05-08T14:46:38.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:37 smithi186 ceph-mon[126480]: pgmap v21246: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 14 op/s 2023-05-08T14:46:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:39 smithi133 ceph-mon[125939]: pgmap v21247: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 797 KiB/s rd, 525 KiB/s wr, 9 op/s 2023-05-08T14:46:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39738.480681 secs 2023-05-08T14:46:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39739.034245 secs 2023-05-08T14:46:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:39 smithi096 ceph-mon[124666]: pgmap v21247: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 797 KiB/s rd, 525 KiB/s wr, 9 op/s 2023-05-08T14:46:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39738.480681 secs 2023-05-08T14:46:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39739.034245 secs 2023-05-08T14:46:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:39 smithi186 ceph-mon[126480]: pgmap v21247: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 797 KiB/s rd, 525 KiB/s wr, 9 op/s 2023-05-08T14:46:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39738.480681 secs 2023-05-08T14:46:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39739.034245 secs 2023-05-08T14:46:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:41 smithi133 ceph-mon[125939]: pgmap v21248: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T14:46:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39740.376061 secs 2023-05-08T14:46:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:41 smithi096 ceph-mon[124666]: pgmap v21248: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T14:46:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39740.376061 secs 2023-05-08T14:46:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:41 smithi186 ceph-mon[126480]: pgmap v21248: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T14:46:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39740.376061 secs 2023-05-08T14:46:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:43 smithi133 ceph-mon[125939]: pgmap v21249: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 8 op/s 2023-05-08T14:46:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:43 smithi096 ceph-mon[124666]: pgmap v21249: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 8 op/s 2023-05-08T14:46:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:43 smithi186 ceph-mon[126480]: pgmap v21249: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 8 op/s 2023-05-08T14:46:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39743.480783 secs 2023-05-08T14:46:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39744.034380 secs 2023-05-08T14:46:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39743.480783 secs 2023-05-08T14:46:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39744.034380 secs 2023-05-08T14:46:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39743.480783 secs 2023-05-08T14:46:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39744.034380 secs 2023-05-08T14:46:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:45 smithi133 ceph-mon[125939]: pgmap v21250: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 8 op/s 2023-05-08T14:46:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:45 smithi096 ceph-mon[124666]: pgmap v21250: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 8 op/s 2023-05-08T14:46:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:45 smithi186 ceph-mon[126480]: pgmap v21250: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 8 op/s 2023-05-08T14:46:47.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:47 smithi133 ceph-mon[125939]: pgmap v21251: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T14:46:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:47 smithi096 ceph-mon[124666]: pgmap v21251: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T14:46:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:47 smithi186 ceph-mon[126480]: pgmap v21251: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T14:46:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:49 smithi096 ceph-mon[124666]: pgmap v21252: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 801 KiB/s rd, 704 KiB/s wr, 7 op/s 2023-05-08T14:46:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39748.480851 secs 2023-05-08T14:46:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:46:50.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:46:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:49 smithi186 ceph-mon[126480]: pgmap v21252: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 801 KiB/s rd, 704 KiB/s wr, 7 op/s 2023-05-08T14:46:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39748.480851 secs 2023-05-08T14:46:50.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:46:50.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:46:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:49 smithi133 ceph-mon[125939]: pgmap v21252: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 801 KiB/s rd, 704 KiB/s wr, 7 op/s 2023-05-08T14:46:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39748.480851 secs 2023-05-08T14:46:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:46:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:46:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:50 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:46:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:46:51.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:46:51.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:46:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:50 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:46:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:46:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:46:51.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:46:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:50 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:46:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:46:51.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:46:51.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:46:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:51 smithi186 ceph-mon[126480]: pgmap v21253: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2023-05-08T14:46:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:51 smithi133 ceph-mon[125939]: pgmap v21253: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2023-05-08T14:46:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:51 smithi096 ceph-mon[124666]: pgmap v21253: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2023-05-08T14:46:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:53 smithi186 ceph-mon[126480]: pgmap v21254: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 739 KiB/s rd, 738 KiB/s wr, 8 op/s 2023-05-08T14:46:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:53 smithi133 ceph-mon[125939]: pgmap v21254: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 739 KiB/s rd, 738 KiB/s wr, 8 op/s 2023-05-08T14:46:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:53 smithi096 ceph-mon[124666]: pgmap v21254: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 739 KiB/s rd, 738 KiB/s wr, 8 op/s 2023-05-08T14:46:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39753.480953 secs 2023-05-08T14:46:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39753.480953 secs 2023-05-08T14:46:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39753.480953 secs 2023-05-08T14:46:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:55 smithi186 ceph-mon[126480]: pgmap v21255: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 739 KiB/s rd, 738 KiB/s wr, 8 op/s 2023-05-08T14:46:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:55 smithi133 ceph-mon[125939]: pgmap v21255: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 739 KiB/s rd, 738 KiB/s wr, 8 op/s 2023-05-08T14:46:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:55 smithi096 ceph-mon[124666]: pgmap v21255: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 739 KiB/s rd, 738 KiB/s wr, 8 op/s 2023-05-08T14:46:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:57 smithi186 ceph-mon[126480]: pgmap v21256: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T14:46:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:57 smithi133 ceph-mon[125939]: pgmap v21256: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T14:46:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:57 smithi096 ceph-mon[124666]: pgmap v21256: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T14:47:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:59 smithi186 ceph-mon[126480]: pgmap v21257: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T14:47:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39758.481094 secs 2023-05-08T14:47:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:46:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39759.034738 secs 2023-05-08T14:47:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:59 smithi133 ceph-mon[125939]: pgmap v21257: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T14:47:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39758.481094 secs 2023-05-08T14:47:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:46:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39759.034738 secs 2023-05-08T14:47:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:59 smithi096 ceph-mon[124666]: pgmap v21257: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T14:47:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39758.481094 secs 2023-05-08T14:47:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:46:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39759.034738 secs 2023-05-08T14:47:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:01 smithi186 ceph-mon[126480]: pgmap v21258: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 15 op/s 2023-05-08T14:47:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:01 smithi133 ceph-mon[125939]: pgmap v21258: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 15 op/s 2023-05-08T14:47:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:01 smithi096 ceph-mon[124666]: pgmap v21258: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 15 op/s 2023-05-08T14:47:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:02 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:47:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:47:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:47:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:02 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:47:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:47:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:47:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:02 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:47:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:47:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:47:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:03 smithi186 ceph-mon[126480]: pgmap v21259: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 899 KiB/s wr, 10 op/s 2023-05-08T14:47:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:03 smithi133 ceph-mon[125939]: pgmap v21259: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 899 KiB/s wr, 10 op/s 2023-05-08T14:47:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:03 smithi096 ceph-mon[124666]: pgmap v21259: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 899 KiB/s wr, 10 op/s 2023-05-08T14:47:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39763.481239 secs 2023-05-08T14:47:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39763.481239 secs 2023-05-08T14:47:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39763.481239 secs 2023-05-08T14:47:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:05 smithi186 ceph-mon[126480]: pgmap v21260: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 899 KiB/s wr, 10 op/s 2023-05-08T14:47:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:05 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:47:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:05 smithi133 ceph-mon[125939]: pgmap v21260: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 899 KiB/s wr, 10 op/s 2023-05-08T14:47:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:05 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:47:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:05 smithi096 ceph-mon[124666]: pgmap v21260: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 899 KiB/s wr, 10 op/s 2023-05-08T14:47:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:05 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:47:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39765.376587 secs 2023-05-08T14:47:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:47:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:47:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39765.376587 secs 2023-05-08T14:47:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:47:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:47:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39765.376587 secs 2023-05-08T14:47:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:47:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:47:08.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:07 smithi186 ceph-mon[126480]: pgmap v21261: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.8 MiB/s wr, 17 op/s 2023-05-08T14:47:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:07 smithi133 ceph-mon[125939]: pgmap v21261: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.8 MiB/s wr, 17 op/s 2023-05-08T14:47:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:07 smithi096 ceph-mon[124666]: pgmap v21261: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.8 MiB/s wr, 17 op/s 2023-05-08T14:47:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:08 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:47:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:08 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:47:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:09 smithi186 ceph-mon[126480]: pgmap v21262: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T14:47:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39768.481374 secs 2023-05-08T14:47:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39769.035035 secs 2023-05-08T14:47:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:08 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:47:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:09 smithi133 ceph-mon[125939]: pgmap v21262: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T14:47:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39768.481374 secs 2023-05-08T14:47:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39769.035035 secs 2023-05-08T14:47:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:09 smithi096 ceph-mon[124666]: pgmap v21262: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T14:47:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39768.481374 secs 2023-05-08T14:47:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39769.035035 secs 2023-05-08T14:47:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:10 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:47:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:10 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:47:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:10 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:47:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:10 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:47:11.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:10 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:47:11.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:10 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:47:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:10 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:47:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:10 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:47:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:10 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:47:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:11 smithi186 ceph-mon[126480]: pgmap v21263: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.6 MiB/s wr, 29 op/s 2023-05-08T14:47:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39770.376725 secs 2023-05-08T14:47:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:11 smithi186 ceph-mon[126480]: osdmap e1406: 12 total, 12 up, 12 in 2023-05-08T14:47:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:11 smithi133 ceph-mon[125939]: pgmap v21263: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.6 MiB/s wr, 29 op/s 2023-05-08T14:47:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39770.376725 secs 2023-05-08T14:47:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:11 smithi133 ceph-mon[125939]: osdmap e1406: 12 total, 12 up, 12 in 2023-05-08T14:47:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:11 smithi096 ceph-mon[124666]: pgmap v21263: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.6 MiB/s wr, 29 op/s 2023-05-08T14:47:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39770.376725 secs 2023-05-08T14:47:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:11 smithi096 ceph-mon[124666]: osdmap e1406: 12 total, 12 up, 12 in 2023-05-08T14:47:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:13 smithi186 ceph-mon[126480]: pgmap v21265: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 29 op/s 2023-05-08T14:47:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:13 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:47:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:13 smithi133 ceph-mon[125939]: pgmap v21265: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 29 op/s 2023-05-08T14:47:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:13 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:47:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:13 smithi096 ceph-mon[124666]: pgmap v21265: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 29 op/s 2023-05-08T14:47:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:13 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:47:15.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39773.481497 secs 2023-05-08T14:47:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39774.035157 secs 2023-05-08T14:47:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39773.481497 secs 2023-05-08T14:47:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39774.035157 secs 2023-05-08T14:47:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39773.481497 secs 2023-05-08T14:47:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39774.035157 secs 2023-05-08T14:47:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:15 smithi186 ceph-mon[126480]: pgmap v21266: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 29 op/s 2023-05-08T14:47:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:15 smithi133 ceph-mon[125939]: pgmap v21266: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 29 op/s 2023-05-08T14:47:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:15 smithi096 ceph-mon[124666]: pgmap v21266: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 29 op/s 2023-05-08T14:47:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39775.376818 secs 2023-05-08T14:47:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39775.376818 secs 2023-05-08T14:47:17.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39775.376818 secs 2023-05-08T14:47:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:17 smithi133 ceph-mon[125939]: pgmap v21267: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 724 KiB/s rd, 766 KiB/s wr, 25 op/s 2023-05-08T14:47:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:17 smithi096 ceph-mon[124666]: pgmap v21267: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 724 KiB/s rd, 766 KiB/s wr, 25 op/s 2023-05-08T14:47:18.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:17 smithi186 ceph-mon[126480]: pgmap v21267: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 724 KiB/s rd, 766 KiB/s wr, 25 op/s 2023-05-08T14:47:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:19 smithi133 ceph-mon[125939]: pgmap v21268: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 724 KiB/s rd, 766 KiB/s wr, 25 op/s 2023-05-08T14:47:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:19 smithi133 ceph-mon[125939]: osdmap e1407: 12 total, 12 up, 12 in 2023-05-08T14:47:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39778.481582 secs 2023-05-08T14:47:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39779.035334 secs 2023-05-08T14:47:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:19 smithi096 ceph-mon[124666]: pgmap v21268: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 724 KiB/s rd, 766 KiB/s wr, 25 op/s 2023-05-08T14:47:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:19 smithi096 ceph-mon[124666]: osdmap e1407: 12 total, 12 up, 12 in 2023-05-08T14:47:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39778.481582 secs 2023-05-08T14:47:20.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39779.035334 secs 2023-05-08T14:47:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:19 smithi186 ceph-mon[126480]: pgmap v21268: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 724 KiB/s rd, 766 KiB/s wr, 25 op/s 2023-05-08T14:47:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:19 smithi186 ceph-mon[126480]: osdmap e1407: 12 total, 12 up, 12 in 2023-05-08T14:47:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39778.481582 secs 2023-05-08T14:47:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39779.035334 secs 2023-05-08T14:47:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:21 smithi133 ceph-mon[125939]: pgmap v21270: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 465 KiB/s rd, 502 KiB/s wr, 9 op/s 2023-05-08T14:47:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39780.376942 secs 2023-05-08T14:47:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:21 smithi096 ceph-mon[124666]: pgmap v21270: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 465 KiB/s rd, 502 KiB/s wr, 9 op/s 2023-05-08T14:47:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39780.376942 secs 2023-05-08T14:47:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:21 smithi186 ceph-mon[126480]: pgmap v21270: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 465 KiB/s rd, 502 KiB/s wr, 9 op/s 2023-05-08T14:47:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39780.376942 secs 2023-05-08T14:47:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:23 smithi133 ceph-mon[125939]: pgmap v21271: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 424 KiB/s rd, 458 KiB/s wr, 8 op/s 2023-05-08T14:47:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:23 smithi096 ceph-mon[124666]: pgmap v21271: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 424 KiB/s rd, 458 KiB/s wr, 8 op/s 2023-05-08T14:47:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:23 smithi186 ceph-mon[126480]: pgmap v21271: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 424 KiB/s rd, 458 KiB/s wr, 8 op/s 2023-05-08T14:47:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39783.481709 secs 2023-05-08T14:47:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39784.035483 secs 2023-05-08T14:47:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39783.481709 secs 2023-05-08T14:47:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39784.035483 secs 2023-05-08T14:47:25.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39783.481709 secs 2023-05-08T14:47:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39784.035483 secs 2023-05-08T14:47:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:25 smithi133 ceph-mon[125939]: pgmap v21272: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 424 KiB/s rd, 458 KiB/s wr, 8 op/s 2023-05-08T14:47:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:25 smithi096 ceph-mon[124666]: pgmap v21272: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 424 KiB/s rd, 458 KiB/s wr, 8 op/s 2023-05-08T14:47:26.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:25 smithi186 ceph-mon[126480]: pgmap v21272: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 424 KiB/s rd, 458 KiB/s wr, 8 op/s 2023-05-08T14:47:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39785.377059 secs 2023-05-08T14:47:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39785.377059 secs 2023-05-08T14:47:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39785.377059 secs 2023-05-08T14:47:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:27 smithi133 ceph-mon[125939]: pgmap v21273: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 492 KiB/s rd, 490 KiB/s wr, 9 op/s 2023-05-08T14:47:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:27 smithi096 ceph-mon[124666]: pgmap v21273: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 492 KiB/s rd, 490 KiB/s wr, 9 op/s 2023-05-08T14:47:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:27 smithi186 ceph-mon[126480]: pgmap v21273: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 492 KiB/s rd, 490 KiB/s wr, 9 op/s 2023-05-08T14:47:28.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:28 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:47:29.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:28 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:47:29.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:28 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:47:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:29 smithi133 ceph-mon[125939]: pgmap v21274: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 492 KiB/s rd, 490 KiB/s wr, 9 op/s 2023-05-08T14:47:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39788.481839 secs 2023-05-08T14:47:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:29 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:47:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:29 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:47:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:29 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:47:29.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39789.035568 secs 2023-05-08T14:47:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:29 smithi096 ceph-mon[124666]: pgmap v21274: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 492 KiB/s rd, 490 KiB/s wr, 9 op/s 2023-05-08T14:47:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39788.481839 secs 2023-05-08T14:47:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:29 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:47:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:29 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:47:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:29 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:47:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39789.035568 secs 2023-05-08T14:47:30.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:29 smithi186 ceph-mon[126480]: pgmap v21274: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 492 KiB/s rd, 490 KiB/s wr, 9 op/s 2023-05-08T14:47:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39788.481839 secs 2023-05-08T14:47:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:29 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:47:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:29 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:47:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:29 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:47:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39789.035568 secs 2023-05-08T14:47:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:30 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:47:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:30 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T14:47:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:30 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T14:47:30.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:30 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:47:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:30 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:47:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:30 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T14:47:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:30 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T14:47:31.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:30 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:47:31.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:30 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:47:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:30 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T14:47:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:30 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T14:47:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:30 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:47:31.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:31 smithi133 ceph-mon[125939]: pgmap v21275: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 435 KiB/s wr, 12 op/s 2023-05-08T14:47:31.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39790.377175 secs 2023-05-08T14:47:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:31 smithi096 ceph-mon[124666]: pgmap v21275: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 435 KiB/s wr, 12 op/s 2023-05-08T14:47:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39790.377175 secs 2023-05-08T14:47:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:31 smithi186 ceph-mon[126480]: pgmap v21275: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 435 KiB/s wr, 12 op/s 2023-05-08T14:47:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39790.377175 secs 2023-05-08T14:47:33.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:33 smithi133 ceph-mon[125939]: pgmap v21276: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 202 KiB/s wr, 8 op/s 2023-05-08T14:47:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:33 smithi096 ceph-mon[124666]: pgmap v21276: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 202 KiB/s wr, 8 op/s 2023-05-08T14:47:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:33 smithi186 ceph-mon[126480]: pgmap v21276: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 202 KiB/s wr, 8 op/s 2023-05-08T14:47:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39793.481991 secs 2023-05-08T14:47:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39794.035672 secs 2023-05-08T14:47:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39793.481991 secs 2023-05-08T14:47:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39794.035672 secs 2023-05-08T14:47:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39793.481991 secs 2023-05-08T14:47:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39794.035672 secs 2023-05-08T14:47:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:35 smithi133 ceph-mon[125939]: pgmap v21277: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 202 KiB/s wr, 8 op/s 2023-05-08T14:47:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:35 smithi096 ceph-mon[124666]: pgmap v21277: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 202 KiB/s wr, 8 op/s 2023-05-08T14:47:36.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:35 smithi186 ceph-mon[126480]: pgmap v21277: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 202 KiB/s wr, 8 op/s 2023-05-08T14:47:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39795.377306 secs 2023-05-08T14:47:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39795.377306 secs 2023-05-08T14:47:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39795.377306 secs 2023-05-08T14:47:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:37 smithi133 ceph-mon[125939]: pgmap v21278: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 590 KiB/s rd, 557 KiB/s wr, 11 op/s 2023-05-08T14:47:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:37 smithi096 ceph-mon[124666]: pgmap v21278: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 590 KiB/s rd, 557 KiB/s wr, 11 op/s 2023-05-08T14:47:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:37 smithi186 ceph-mon[126480]: pgmap v21278: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 590 KiB/s rd, 557 KiB/s wr, 11 op/s 2023-05-08T14:47:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:39 smithi096 ceph-mon[124666]: pgmap v21279: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 355 KiB/s wr, 7 op/s 2023-05-08T14:47:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39798.482075 secs 2023-05-08T14:47:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39799.035765 secs 2023-05-08T14:47:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:39 smithi186 ceph-mon[126480]: pgmap v21279: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 355 KiB/s wr, 7 op/s 2023-05-08T14:47:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39798.482075 secs 2023-05-08T14:47:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39799.035765 secs 2023-05-08T14:47:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:39 smithi133 ceph-mon[125939]: pgmap v21279: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 355 KiB/s wr, 7 op/s 2023-05-08T14:47:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39798.482075 secs 2023-05-08T14:47:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39799.035765 secs 2023-05-08T14:47:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:41 smithi096 ceph-mon[124666]: pgmap v21280: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 359 KiB/s rd, 356 KiB/s wr, 10 op/s 2023-05-08T14:47:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39800.377405 secs 2023-05-08T14:47:42.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:41 smithi186 ceph-mon[126480]: pgmap v21280: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 359 KiB/s rd, 356 KiB/s wr, 10 op/s 2023-05-08T14:47:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39800.377405 secs 2023-05-08T14:47:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:41 smithi133 ceph-mon[125939]: pgmap v21280: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 359 KiB/s rd, 356 KiB/s wr, 10 op/s 2023-05-08T14:47:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39800.377405 secs 2023-05-08T14:47:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:43 smithi096 ceph-mon[124666]: pgmap v21281: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 468 KiB/s rd, 466 KiB/s wr, 7 op/s 2023-05-08T14:47:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:43 smithi186 ceph-mon[126480]: pgmap v21281: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 468 KiB/s rd, 466 KiB/s wr, 7 op/s 2023-05-08T14:47:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:43 smithi133 ceph-mon[125939]: pgmap v21281: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 468 KiB/s rd, 466 KiB/s wr, 7 op/s 2023-05-08T14:47:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39803.482201 secs 2023-05-08T14:47:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39804.035906 secs 2023-05-08T14:47:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39803.482201 secs 2023-05-08T14:47:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39804.035906 secs 2023-05-08T14:47:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39803.482201 secs 2023-05-08T14:47:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39804.035906 secs 2023-05-08T14:47:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:45 smithi186 ceph-mon[126480]: pgmap v21282: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 468 KiB/s rd, 466 KiB/s wr, 7 op/s 2023-05-08T14:47:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:45 smithi133 ceph-mon[125939]: pgmap v21282: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 468 KiB/s rd, 466 KiB/s wr, 7 op/s 2023-05-08T14:47:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:45 smithi096 ceph-mon[124666]: pgmap v21282: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 468 KiB/s rd, 466 KiB/s wr, 7 op/s 2023-05-08T14:47:47.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39805.377470 secs 2023-05-08T14:47:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39805.377470 secs 2023-05-08T14:47:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39805.377470 secs 2023-05-08T14:47:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:47 smithi186 ceph-mon[126480]: pgmap v21283: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 713 KiB/s rd, 941 KiB/s wr, 10 op/s 2023-05-08T14:47:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:47 smithi133 ceph-mon[125939]: pgmap v21283: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 713 KiB/s rd, 941 KiB/s wr, 10 op/s 2023-05-08T14:47:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:47 smithi096 ceph-mon[124666]: pgmap v21283: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 713 KiB/s rd, 941 KiB/s wr, 10 op/s 2023-05-08T14:47:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:49 smithi186 ceph-mon[126480]: pgmap v21284: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 586 KiB/s wr, 6 op/s 2023-05-08T14:47:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39808.482330 secs 2023-05-08T14:47:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39809.036028 secs 2023-05-08T14:47:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:49 smithi133 ceph-mon[125939]: pgmap v21284: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 586 KiB/s wr, 6 op/s 2023-05-08T14:47:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39808.482330 secs 2023-05-08T14:47:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39809.036028 secs 2023-05-08T14:47:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:49 smithi096 ceph-mon[124666]: pgmap v21284: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 586 KiB/s wr, 6 op/s 2023-05-08T14:47:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39808.482330 secs 2023-05-08T14:47:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39809.036028 secs 2023-05-08T14:47:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:51 smithi186 ceph-mon[126480]: pgmap v21285: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 481 KiB/s rd, 708 KiB/s wr, 10 op/s 2023-05-08T14:47:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39810.377594 secs 2023-05-08T14:47:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:51 smithi133 ceph-mon[125939]: pgmap v21285: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 481 KiB/s rd, 708 KiB/s wr, 10 op/s 2023-05-08T14:47:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39810.377594 secs 2023-05-08T14:47:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:51 smithi096 ceph-mon[124666]: pgmap v21285: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 481 KiB/s rd, 708 KiB/s wr, 10 op/s 2023-05-08T14:47:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39810.377594 secs 2023-05-08T14:47:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:53 smithi186 ceph-mon[126480]: pgmap v21286: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 710 KiB/s rd, 708 KiB/s wr, 7 op/s 2023-05-08T14:47:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:53 smithi133 ceph-mon[125939]: pgmap v21286: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 710 KiB/s rd, 708 KiB/s wr, 7 op/s 2023-05-08T14:47:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:53 smithi096 ceph-mon[124666]: pgmap v21286: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 710 KiB/s rd, 708 KiB/s wr, 7 op/s 2023-05-08T14:47:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39813.482453 secs 2023-05-08T14:47:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39813.482453 secs 2023-05-08T14:47:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39813.482453 secs 2023-05-08T14:47:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:55 smithi186 ceph-mon[126480]: pgmap v21287: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 599 KiB/s rd, 597 KiB/s wr, 7 op/s 2023-05-08T14:47:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:55 smithi133 ceph-mon[125939]: pgmap v21287: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 599 KiB/s rd, 597 KiB/s wr, 7 op/s 2023-05-08T14:47:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:55 smithi096 ceph-mon[124666]: pgmap v21287: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 599 KiB/s rd, 597 KiB/s wr, 7 op/s 2023-05-08T14:47:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:57 smithi186 ceph-mon[126480]: pgmap v21288: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.2 MiB/s wr, 13 op/s 2023-05-08T14:47:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:47:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:47:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:57 smithi133 ceph-mon[125939]: pgmap v21288: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.2 MiB/s wr, 13 op/s 2023-05-08T14:47:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:47:58.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:47:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:57 smithi096 ceph-mon[124666]: pgmap v21288: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.2 MiB/s wr, 13 op/s 2023-05-08T14:47:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:47:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:47:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:58 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:47:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:47:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:47:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:47:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:58 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:47:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:47:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:47:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:47:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:58 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:47:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:47:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:47:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:48:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:59 smithi186 ceph-mon[126480]: pgmap v21289: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.8 MiB/s wr, 9 op/s 2023-05-08T14:48:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39818.482550 secs 2023-05-08T14:48:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:47:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39819.036313 secs 2023-05-08T14:48:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:59 smithi133 ceph-mon[125939]: pgmap v21289: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.8 MiB/s wr, 9 op/s 2023-05-08T14:48:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39818.482550 secs 2023-05-08T14:48:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:47:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39819.036313 secs 2023-05-08T14:48:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:59 smithi096 ceph-mon[124666]: pgmap v21289: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.8 MiB/s wr, 9 op/s 2023-05-08T14:48:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39818.482550 secs 2023-05-08T14:48:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:47:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39819.036313 secs 2023-05-08T14:48:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:01 smithi186 ceph-mon[126480]: pgmap v21290: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.7 MiB/s wr, 15 op/s 2023-05-08T14:48:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:01 smithi133 ceph-mon[125939]: pgmap v21290: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.7 MiB/s wr, 15 op/s 2023-05-08T14:48:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:01 smithi096 ceph-mon[124666]: pgmap v21290: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.7 MiB/s wr, 15 op/s 2023-05-08T14:48:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:48:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:48:03.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:48:03.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:48:03.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:48:03.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:48:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:03 smithi186 ceph-mon[126480]: pgmap v21291: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 12 op/s 2023-05-08T14:48:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:03 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:48:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:03 smithi133 ceph-mon[125939]: pgmap v21291: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 12 op/s 2023-05-08T14:48:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:03 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:48:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:03 smithi096 ceph-mon[124666]: pgmap v21291: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 12 op/s 2023-05-08T14:48:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:03 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:48:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39823.482678 secs 2023-05-08T14:48:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39824.036440 secs 2023-05-08T14:48:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39823.482678 secs 2023-05-08T14:48:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39824.036440 secs 2023-05-08T14:48:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39823.482678 secs 2023-05-08T14:48:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39824.036440 secs 2023-05-08T14:48:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:05 smithi186 ceph-mon[126480]: pgmap v21292: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.6 MiB/s wr, 11 op/s 2023-05-08T14:48:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:05 smithi133 ceph-mon[125939]: pgmap v21292: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.6 MiB/s wr, 11 op/s 2023-05-08T14:48:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:05 smithi096 ceph-mon[124666]: pgmap v21292: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.6 MiB/s wr, 11 op/s 2023-05-08T14:48:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:07 smithi186 ceph-mon[126480]: pgmap v21293: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.0 MiB/s wr, 30 op/s 2023-05-08T14:48:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:07 smithi133 ceph-mon[125939]: pgmap v21293: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.0 MiB/s wr, 30 op/s 2023-05-08T14:48:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:07 smithi096 ceph-mon[124666]: pgmap v21293: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.0 MiB/s wr, 30 op/s 2023-05-08T14:48:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:09 smithi186 ceph-mon[126480]: pgmap v21294: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 1.4 MiB/s wr, 24 op/s 2023-05-08T14:48:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39828.482808 secs 2023-05-08T14:48:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39829.036553 secs 2023-05-08T14:48:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:09 smithi133 ceph-mon[125939]: pgmap v21294: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 1.4 MiB/s wr, 24 op/s 2023-05-08T14:48:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39828.482808 secs 2023-05-08T14:48:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39829.036553 secs 2023-05-08T14:48:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:09 smithi096 ceph-mon[124666]: pgmap v21294: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 1.4 MiB/s wr, 24 op/s 2023-05-08T14:48:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39828.482808 secs 2023-05-08T14:48:10.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39829.036553 secs 2023-05-08T14:48:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:11 smithi186 ceph-mon[126480]: pgmap v21295: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 1.4 MiB/s wr, 28 op/s 2023-05-08T14:48:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:11 smithi133 ceph-mon[125939]: pgmap v21295: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 1.4 MiB/s wr, 28 op/s 2023-05-08T14:48:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:11 smithi096 ceph-mon[124666]: pgmap v21295: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 1.4 MiB/s wr, 28 op/s 2023-05-08T14:48:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:13 smithi186 ceph-mon[126480]: pgmap v21296: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 497 KiB/s wr, 22 op/s 2023-05-08T14:48:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:13 smithi133 ceph-mon[125939]: pgmap v21296: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 497 KiB/s wr, 22 op/s 2023-05-08T14:48:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:13 smithi096 ceph-mon[124666]: pgmap v21296: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 497 KiB/s wr, 22 op/s 2023-05-08T14:48:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39833.482936 secs 2023-05-08T14:48:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39833.482936 secs 2023-05-08T14:48:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39833.482936 secs 2023-05-08T14:48:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:15 smithi186 ceph-mon[126480]: pgmap v21297: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 497 KiB/s wr, 22 op/s 2023-05-08T14:48:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:15 smithi133 ceph-mon[125939]: pgmap v21297: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 497 KiB/s wr, 22 op/s 2023-05-08T14:48:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:15 smithi096 ceph-mon[124666]: pgmap v21297: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 497 KiB/s wr, 22 op/s 2023-05-08T14:48:17.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39835.378215 secs 2023-05-08T14:48:17.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:16 smithi186 ceph-mon[126480]: osdmap e1408: 12 total, 12 up, 12 in 2023-05-08T14:48:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39835.378215 secs 2023-05-08T14:48:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:16 smithi133 ceph-mon[125939]: osdmap e1408: 12 total, 12 up, 12 in 2023-05-08T14:48:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39835.378215 secs 2023-05-08T14:48:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:16 smithi096 ceph-mon[124666]: osdmap e1408: 12 total, 12 up, 12 in 2023-05-08T14:48:18.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:17 smithi186 ceph-mon[126480]: pgmap v21299: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 833 KiB/s rd, 1.6 MiB/s wr, 13 op/s 2023-05-08T14:48:18.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:17 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:48:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:17 smithi133 ceph-mon[125939]: pgmap v21299: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 833 KiB/s rd, 1.6 MiB/s wr, 13 op/s 2023-05-08T14:48:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:17 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:48:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:17 smithi096 ceph-mon[124666]: pgmap v21299: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 833 KiB/s rd, 1.6 MiB/s wr, 13 op/s 2023-05-08T14:48:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:17 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:48:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:18 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:48:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:18 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:48:19.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:18 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:48:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:18 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:48:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:18 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:48:19.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:18 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:48:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:18 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:48:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:18 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:48:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:18 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:48:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:19 smithi186 ceph-mon[126480]: pgmap v21300: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 833 KiB/s rd, 1.6 MiB/s wr, 13 op/s 2023-05-08T14:48:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39838.483040 secs 2023-05-08T14:48:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:19 smithi133 ceph-mon[125939]: pgmap v21300: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 833 KiB/s rd, 1.6 MiB/s wr, 13 op/s 2023-05-08T14:48:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39838.483040 secs 2023-05-08T14:48:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:19 smithi096 ceph-mon[124666]: pgmap v21300: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 833 KiB/s rd, 1.6 MiB/s wr, 13 op/s 2023-05-08T14:48:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39838.483040 secs 2023-05-08T14:48:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:21 smithi133 ceph-mon[125939]: pgmap v21301: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.0 MiB/s wr, 14 op/s 2023-05-08T14:48:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39840.378329 secs 2023-05-08T14:48:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:21 smithi096 ceph-mon[124666]: pgmap v21301: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.0 MiB/s wr, 14 op/s 2023-05-08T14:48:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39840.378329 secs 2023-05-08T14:48:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:21 smithi186 ceph-mon[126480]: pgmap v21301: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.0 MiB/s wr, 14 op/s 2023-05-08T14:48:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39840.378329 secs 2023-05-08T14:48:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:23 smithi133 ceph-mon[125939]: pgmap v21302: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.0 MiB/s wr, 14 op/s 2023-05-08T14:48:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:23 smithi133 ceph-mon[125939]: osdmap e1409: 12 total, 12 up, 12 in 2023-05-08T14:48:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:23 smithi096 ceph-mon[124666]: pgmap v21302: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.0 MiB/s wr, 14 op/s 2023-05-08T14:48:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:23 smithi096 ceph-mon[124666]: osdmap e1409: 12 total, 12 up, 12 in 2023-05-08T14:48:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:23 smithi186 ceph-mon[126480]: pgmap v21302: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.0 MiB/s wr, 14 op/s 2023-05-08T14:48:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:23 smithi186 ceph-mon[126480]: osdmap e1409: 12 total, 12 up, 12 in 2023-05-08T14:48:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39843.483148 secs 2023-05-08T14:48:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39843.483148 secs 2023-05-08T14:48:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39843.483148 secs 2023-05-08T14:48:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:25 smithi133 ceph-mon[125939]: pgmap v21304: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 538 KiB/s wr, 7 op/s 2023-05-08T14:48:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39845.378447 secs 2023-05-08T14:48:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:25 smithi096 ceph-mon[124666]: pgmap v21304: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 538 KiB/s wr, 7 op/s 2023-05-08T14:48:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39845.378447 secs 2023-05-08T14:48:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:25 smithi186 ceph-mon[126480]: pgmap v21304: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 538 KiB/s wr, 7 op/s 2023-05-08T14:48:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39845.378447 secs 2023-05-08T14:48:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:27 smithi133 ceph-mon[125939]: pgmap v21305: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 875 KiB/s wr, 12 op/s 2023-05-08T14:48:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:27 smithi096 ceph-mon[124666]: pgmap v21305: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 875 KiB/s wr, 12 op/s 2023-05-08T14:48:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:27 smithi186 ceph-mon[126480]: pgmap v21305: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 875 KiB/s wr, 12 op/s 2023-05-08T14:48:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:29 smithi133 ceph-mon[125939]: pgmap v21306: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 875 KiB/s wr, 12 op/s 2023-05-08T14:48:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39848.483285 secs 2023-05-08T14:48:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:29 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:48:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:29 smithi096 ceph-mon[124666]: pgmap v21306: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 875 KiB/s wr, 12 op/s 2023-05-08T14:48:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39848.483285 secs 2023-05-08T14:48:30.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:29 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:48:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:29 smithi186 ceph-mon[126480]: pgmap v21306: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 875 KiB/s wr, 12 op/s 2023-05-08T14:48:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39848.483285 secs 2023-05-08T14:48:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:29 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:48:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39850.378538 secs 2023-05-08T14:48:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39850.378538 secs 2023-05-08T14:48:31.368 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39850.378538 secs 2023-05-08T14:48:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:31 smithi133 ceph-mon[125939]: pgmap v21307: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 476 KiB/s rd, 437 KiB/s wr, 11 op/s 2023-05-08T14:48:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:31 smithi096 ceph-mon[124666]: pgmap v21307: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 476 KiB/s rd, 437 KiB/s wr, 11 op/s 2023-05-08T14:48:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:31 smithi186 ceph-mon[126480]: pgmap v21307: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 476 KiB/s rd, 437 KiB/s wr, 11 op/s 2023-05-08T14:48:33.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:48:33.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:48:33.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:32 smithi133 ceph-mon[125939]: pgmap v21308: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 476 KiB/s rd, 437 KiB/s wr, 10 op/s 2023-05-08T14:48:33.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:48:33.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:48:33.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:48:33.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:48:33.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:48:33.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:48:33.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:48:33.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:48:33.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:48:33.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:48:33.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:48:33.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:48:33.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:48:33.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:32 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi133 to 113.0M 2023-05-08T14:48:33.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:32 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi186 to 69088k 2023-05-08T14:48:33.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:32 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi133 to 118510899: error parsing value: Value '118510899' is below minimum 939524096 2023-05-08T14:48:33.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:32 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi186 to 70746591: error parsing value: Value '70746591' is below minimum 939524096 2023-05-08T14:48:33.243 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:48:33.244 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:48:33.244 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:32 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:48:33.244 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:32 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:48:33.244 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:32 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T14:48:33.244 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:32 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T14:48:33.244 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:32 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:48:33.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:48:33.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:48:33.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:32 smithi096 ceph-mon[124666]: pgmap v21308: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 476 KiB/s rd, 437 KiB/s wr, 10 op/s 2023-05-08T14:48:33.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:48:33.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:48:33.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:48:33.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:48:33.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:48:33.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:48:33.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:48:33.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:48:33.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:48:33.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:48:33.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:48:33.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:48:33.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:48:33.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:32 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi133 to 113.0M 2023-05-08T14:48:33.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:32 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi186 to 69088k 2023-05-08T14:48:33.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:32 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi133 to 118510899: error parsing value: Value '118510899' is below minimum 939524096 2023-05-08T14:48:33.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:32 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi186 to 70746591: error parsing value: Value '70746591' is below minimum 939524096 2023-05-08T14:48:33.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:48:33.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:48:33.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:32 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:48:33.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:32 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:48:33.259 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:32 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T14:48:33.259 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:32 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T14:48:33.259 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:32 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:48:33.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:48:33.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:48:33.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:32 smithi186 ceph-mon[126480]: pgmap v21308: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 476 KiB/s rd, 437 KiB/s wr, 10 op/s 2023-05-08T14:48:33.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:48:33.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:48:33.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:48:33.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:48:33.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:48:33.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:48:33.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:48:33.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:48:33.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:48:33.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:48:33.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:48:33.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:48:33.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:48:33.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:32 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi133 to 113.0M 2023-05-08T14:48:33.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:32 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi186 to 69088k 2023-05-08T14:48:33.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:32 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi133 to 118510899: error parsing value: Value '118510899' is below minimum 939524096 2023-05-08T14:48:33.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:32 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi186 to 70746591: error parsing value: Value '70746591' is below minimum 939524096 2023-05-08T14:48:33.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:48:33.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:48:33.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:32 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:48:33.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:32 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:48:33.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:32 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T14:48:33.373 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:32 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T14:48:33.373 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:32 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:48:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39853.483385 secs 2023-05-08T14:48:34.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39854.037045 secs 2023-05-08T14:48:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39853.483385 secs 2023-05-08T14:48:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39854.037045 secs 2023-05-08T14:48:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39853.483385 secs 2023-05-08T14:48:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39854.037045 secs 2023-05-08T14:48:35.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:35 smithi133 ceph-mon[125939]: pgmap v21309: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 425 KiB/s wr, 10 op/s 2023-05-08T14:48:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:35 smithi096 ceph-mon[124666]: pgmap v21309: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 425 KiB/s wr, 10 op/s 2023-05-08T14:48:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:35 smithi186 ceph-mon[126480]: pgmap v21309: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 425 KiB/s wr, 10 op/s 2023-05-08T14:48:36.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39855.378647 secs 2023-05-08T14:48:37.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39855.378647 secs 2023-05-08T14:48:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39855.378647 secs 2023-05-08T14:48:37.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:37 smithi133 ceph-mon[125939]: pgmap v21310: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1023 KiB/s wr, 15 op/s 2023-05-08T14:48:38.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:37 smithi096 ceph-mon[124666]: pgmap v21310: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1023 KiB/s wr, 15 op/s 2023-05-08T14:48:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:37 smithi186 ceph-mon[126480]: pgmap v21310: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1023 KiB/s wr, 15 op/s 2023-05-08T14:48:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:38 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:48:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:38 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:48:38.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:38 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:48:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:38 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:48:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:38 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:48:39.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:38 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:48:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:38 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:48:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:38 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:48:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:38 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:48:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:39 smithi133 ceph-mon[125939]: pgmap v21311: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 672 KiB/s rd, 659 KiB/s wr, 9 op/s 2023-05-08T14:48:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39858.483527 secs 2023-05-08T14:48:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39859.037162 secs 2023-05-08T14:48:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:39 smithi096 ceph-mon[124666]: pgmap v21311: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 672 KiB/s rd, 659 KiB/s wr, 9 op/s 2023-05-08T14:48:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39858.483527 secs 2023-05-08T14:48:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39859.037162 secs 2023-05-08T14:48:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:39 smithi186 ceph-mon[126480]: pgmap v21311: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 672 KiB/s rd, 659 KiB/s wr, 9 op/s 2023-05-08T14:48:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39858.483527 secs 2023-05-08T14:48:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39859.037162 secs 2023-05-08T14:48:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:41 smithi133 ceph-mon[125939]: pgmap v21312: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 678 KiB/s rd, 664 KiB/s wr, 14 op/s 2023-05-08T14:48:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39860.378761 secs 2023-05-08T14:48:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:41 smithi096 ceph-mon[124666]: pgmap v21312: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 678 KiB/s rd, 664 KiB/s wr, 14 op/s 2023-05-08T14:48:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39860.378761 secs 2023-05-08T14:48:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:41 smithi186 ceph-mon[126480]: pgmap v21312: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 678 KiB/s rd, 664 KiB/s wr, 14 op/s 2023-05-08T14:48:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39860.378761 secs 2023-05-08T14:48:43.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:43 smithi133 ceph-mon[125939]: pgmap v21313: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 665 KiB/s rd, 664 KiB/s wr, 10 op/s 2023-05-08T14:48:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:43 smithi096 ceph-mon[124666]: pgmap v21313: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 665 KiB/s rd, 664 KiB/s wr, 10 op/s 2023-05-08T14:48:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:43 smithi186 ceph-mon[126480]: pgmap v21313: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 665 KiB/s rd, 664 KiB/s wr, 10 op/s 2023-05-08T14:48:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39863.483607 secs 2023-05-08T14:48:44.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39864.037272 secs 2023-05-08T14:48:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39863.483607 secs 2023-05-08T14:48:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39864.037272 secs 2023-05-08T14:48:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39863.483607 secs 2023-05-08T14:48:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39864.037272 secs 2023-05-08T14:48:45.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:45 smithi133 ceph-mon[125939]: pgmap v21314: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 665 KiB/s rd, 664 KiB/s wr, 10 op/s 2023-05-08T14:48:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:45 smithi096 ceph-mon[124666]: pgmap v21314: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 665 KiB/s rd, 664 KiB/s wr, 10 op/s 2023-05-08T14:48:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:45 smithi186 ceph-mon[126480]: pgmap v21314: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 665 KiB/s rd, 664 KiB/s wr, 10 op/s 2023-05-08T14:48:46.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39865.378885 secs 2023-05-08T14:48:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39865.378885 secs 2023-05-08T14:48:47.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39865.378885 secs 2023-05-08T14:48:48.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:47 smithi096 ceph-mon[124666]: pgmap v21315: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 15 op/s 2023-05-08T14:48:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:47 smithi186 ceph-mon[126480]: pgmap v21315: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 15 op/s 2023-05-08T14:48:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:47 smithi133 ceph-mon[125939]: pgmap v21315: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 15 op/s 2023-05-08T14:48:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:49 smithi096 ceph-mon[124666]: pgmap v21316: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 568 KiB/s rd, 920 KiB/s wr, 9 op/s 2023-05-08T14:48:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39868.483725 secs 2023-05-08T14:48:50.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39869.037371 secs 2023-05-08T14:48:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:49 smithi186 ceph-mon[126480]: pgmap v21316: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 568 KiB/s rd, 920 KiB/s wr, 9 op/s 2023-05-08T14:48:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39868.483725 secs 2023-05-08T14:48:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39869.037371 secs 2023-05-08T14:48:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:49 smithi133 ceph-mon[125939]: pgmap v21316: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 568 KiB/s rd, 920 KiB/s wr, 9 op/s 2023-05-08T14:48:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39868.483725 secs 2023-05-08T14:48:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39869.037371 secs 2023-05-08T14:48:52.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:51 smithi096 ceph-mon[124666]: pgmap v21317: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T14:48:52.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39870.378976 secs 2023-05-08T14:48:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:51 smithi186 ceph-mon[126480]: pgmap v21317: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T14:48:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39870.378976 secs 2023-05-08T14:48:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:51 smithi133 ceph-mon[125939]: pgmap v21317: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T14:48:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39870.378976 secs 2023-05-08T14:48:54.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:53 smithi096 ceph-mon[124666]: pgmap v21318: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 9 op/s 2023-05-08T14:48:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:53 smithi186 ceph-mon[126480]: pgmap v21318: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 9 op/s 2023-05-08T14:48:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:53 smithi133 ceph-mon[125939]: pgmap v21318: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 9 op/s 2023-05-08T14:48:55.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39873.483832 secs 2023-05-08T14:48:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39873.483832 secs 2023-05-08T14:48:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39873.483832 secs 2023-05-08T14:48:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:55 smithi186 ceph-mon[126480]: pgmap v21319: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 9 op/s 2023-05-08T14:48:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:55 smithi133 ceph-mon[125939]: pgmap v21319: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 9 op/s 2023-05-08T14:48:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:55 smithi096 ceph-mon[124666]: pgmap v21319: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 9 op/s 2023-05-08T14:48:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39875.379059 secs 2023-05-08T14:48:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39875.379059 secs 2023-05-08T14:48:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39875.379059 secs 2023-05-08T14:48:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:57 smithi186 ceph-mon[126480]: pgmap v21320: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 14 op/s 2023-05-08T14:48:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:48:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:57 smithi133 ceph-mon[125939]: pgmap v21320: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 14 op/s 2023-05-08T14:48:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:48:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:57 smithi096 ceph-mon[124666]: pgmap v21320: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 14 op/s 2023-05-08T14:48:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:48:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:58 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:48:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:48:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:48:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:58 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:48:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:48:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:48:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:58 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:48:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:48:59.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:49:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:59 smithi186 ceph-mon[126480]: pgmap v21321: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 742 KiB/s wr, 9 op/s 2023-05-08T14:49:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:48:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39878.483934 secs 2023-05-08T14:49:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:59 smithi133 ceph-mon[125939]: pgmap v21321: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 742 KiB/s wr, 9 op/s 2023-05-08T14:49:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:48:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39878.483934 secs 2023-05-08T14:49:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:59 smithi096 ceph-mon[124666]: pgmap v21321: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 742 KiB/s wr, 9 op/s 2023-05-08T14:49:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:48:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39878.483934 secs 2023-05-08T14:49:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:01 smithi186 ceph-mon[126480]: pgmap v21322: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 14 op/s 2023-05-08T14:49:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:01 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:49:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:01 smithi133 ceph-mon[125939]: pgmap v21322: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 14 op/s 2023-05-08T14:49:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:01 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:49:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:01 smithi096 ceph-mon[124666]: pgmap v21322: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 14 op/s 2023-05-08T14:49:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:01 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:49:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:49:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:49:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:49:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:49:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:49:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:49:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:03 smithi186 ceph-mon[126480]: pgmap v21323: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 945 KiB/s rd, 1.4 MiB/s wr, 9 op/s 2023-05-08T14:49:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:03 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:49:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:03 smithi133 ceph-mon[125939]: pgmap v21323: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 945 KiB/s rd, 1.4 MiB/s wr, 9 op/s 2023-05-08T14:49:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:03 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:49:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:03 smithi096 ceph-mon[124666]: pgmap v21323: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 945 KiB/s rd, 1.4 MiB/s wr, 9 op/s 2023-05-08T14:49:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:03 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:49:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39883.484080 secs 2023-05-08T14:49:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39884.037644 secs 2023-05-08T14:49:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39883.484080 secs 2023-05-08T14:49:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39884.037644 secs 2023-05-08T14:49:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39883.484080 secs 2023-05-08T14:49:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39884.037644 secs 2023-05-08T14:49:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:05 smithi186 ceph-mon[126480]: pgmap v21324: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 945 KiB/s rd, 1.4 MiB/s wr, 9 op/s 2023-05-08T14:49:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:05 smithi133 ceph-mon[125939]: pgmap v21324: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 945 KiB/s rd, 1.4 MiB/s wr, 9 op/s 2023-05-08T14:49:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:05 smithi096 ceph-mon[124666]: pgmap v21324: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 945 KiB/s rd, 1.4 MiB/s wr, 9 op/s 2023-05-08T14:49:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39885.379299 secs 2023-05-08T14:49:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:49:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:49:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39885.379299 secs 2023-05-08T14:49:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:49:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:49:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39885.379299 secs 2023-05-08T14:49:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:49:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:49:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:07 smithi186 ceph-mon[126480]: pgmap v21325: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 30 op/s 2023-05-08T14:49:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:07 smithi133 ceph-mon[125939]: pgmap v21325: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 30 op/s 2023-05-08T14:49:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:07 smithi096 ceph-mon[124666]: pgmap v21325: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 30 op/s 2023-05-08T14:49:09.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:08 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:49:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:08 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:49:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:08 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:49:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:09 smithi186 ceph-mon[126480]: pgmap v21326: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 26 op/s 2023-05-08T14:49:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39888.484224 secs 2023-05-08T14:49:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:09 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:49:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:09 smithi133 ceph-mon[125939]: pgmap v21326: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 26 op/s 2023-05-08T14:49:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39888.484224 secs 2023-05-08T14:49:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:09 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:49:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:09 smithi096 ceph-mon[124666]: pgmap v21326: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 26 op/s 2023-05-08T14:49:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39888.484224 secs 2023-05-08T14:49:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:09 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:49:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:10 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:49:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:10 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:49:11.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:10 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:49:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:10 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:49:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:10 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:49:11.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:10 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:49:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:10 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:49:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:10 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:49:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:10 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:49:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:11 smithi186 ceph-mon[126480]: pgmap v21327: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.6 MiB/s wr, 30 op/s 2023-05-08T14:49:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39890.379434 secs 2023-05-08T14:49:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:11 smithi186 ceph-mon[126480]: osdmap e1410: 12 total, 12 up, 12 in 2023-05-08T14:49:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:11 smithi133 ceph-mon[125939]: pgmap v21327: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.6 MiB/s wr, 30 op/s 2023-05-08T14:49:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39890.379434 secs 2023-05-08T14:49:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:11 smithi133 ceph-mon[125939]: osdmap e1410: 12 total, 12 up, 12 in 2023-05-08T14:49:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:11 smithi096 ceph-mon[124666]: pgmap v21327: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.6 MiB/s wr, 30 op/s 2023-05-08T14:49:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39890.379434 secs 2023-05-08T14:49:12.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:11 smithi096 ceph-mon[124666]: osdmap e1410: 12 total, 12 up, 12 in 2023-05-08T14:49:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:13 smithi186 ceph-mon[126480]: pgmap v21329: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 950 KiB/s wr, 30 op/s 2023-05-08T14:49:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:13 smithi133 ceph-mon[125939]: pgmap v21329: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 950 KiB/s wr, 30 op/s 2023-05-08T14:49:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:13 smithi096 ceph-mon[124666]: pgmap v21329: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 950 KiB/s wr, 30 op/s 2023-05-08T14:49:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39893.484353 secs 2023-05-08T14:49:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39893.484353 secs 2023-05-08T14:49:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39893.484353 secs 2023-05-08T14:49:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:15 smithi186 ceph-mon[126480]: pgmap v21330: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 950 KiB/s wr, 30 op/s 2023-05-08T14:49:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:15 smithi133 ceph-mon[125939]: pgmap v21330: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 950 KiB/s wr, 30 op/s 2023-05-08T14:49:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:15 smithi096 ceph-mon[124666]: pgmap v21330: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 950 KiB/s wr, 30 op/s 2023-05-08T14:49:17.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39895.379554 secs 2023-05-08T14:49:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39895.379554 secs 2023-05-08T14:49:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39895.379554 secs 2023-05-08T14:49:18.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:17 smithi186 ceph-mon[126480]: pgmap v21331: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T14:49:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:17 smithi133 ceph-mon[125939]: pgmap v21331: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T14:49:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:17 smithi096 ceph-mon[124666]: pgmap v21331: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T14:49:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:19 smithi133 ceph-mon[125939]: pgmap v21332: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T14:49:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:19 smithi133 ceph-mon[125939]: osdmap e1411: 12 total, 12 up, 12 in 2023-05-08T14:49:19.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39898.484448 secs 2023-05-08T14:49:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:19 smithi096 ceph-mon[124666]: pgmap v21332: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T14:49:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:19 smithi096 ceph-mon[124666]: osdmap e1411: 12 total, 12 up, 12 in 2023-05-08T14:49:20.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39898.484448 secs 2023-05-08T14:49:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:19 smithi186 ceph-mon[126480]: pgmap v21332: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T14:49:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:19 smithi186 ceph-mon[126480]: osdmap e1411: 12 total, 12 up, 12 in 2023-05-08T14:49:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39898.484448 secs 2023-05-08T14:49:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:21 smithi133 ceph-mon[125939]: pgmap v21334: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T14:49:21.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39900.379687 secs 2023-05-08T14:49:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:21 smithi096 ceph-mon[124666]: pgmap v21334: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T14:49:22.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39900.379687 secs 2023-05-08T14:49:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:21 smithi186 ceph-mon[126480]: pgmap v21334: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T14:49:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39900.379687 secs 2023-05-08T14:49:23.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:23 smithi133 ceph-mon[125939]: pgmap v21335: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 10 op/s 2023-05-08T14:49:24.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:23 smithi096 ceph-mon[124666]: pgmap v21335: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 10 op/s 2023-05-08T14:49:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:23 smithi186 ceph-mon[126480]: pgmap v21335: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 10 op/s 2023-05-08T14:49:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39903.484571 secs 2023-05-08T14:49:24.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39904.038101 secs 2023-05-08T14:49:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39903.484571 secs 2023-05-08T14:49:25.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39904.038101 secs 2023-05-08T14:49:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39903.484571 secs 2023-05-08T14:49:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39904.038101 secs 2023-05-08T14:49:25.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:25 smithi133 ceph-mon[125939]: pgmap v21336: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 10 op/s 2023-05-08T14:49:26.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:25 smithi096 ceph-mon[124666]: pgmap v21336: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 10 op/s 2023-05-08T14:49:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:25 smithi186 ceph-mon[126480]: pgmap v21336: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 10 op/s 2023-05-08T14:49:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39905.379806 secs 2023-05-08T14:49:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:26 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:49:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:26 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:49:26.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:26 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:49:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39905.379806 secs 2023-05-08T14:49:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:26 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:49:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:26 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:49:27.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:26 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:49:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39905.379806 secs 2023-05-08T14:49:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:26 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:49:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:26 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:49:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:26 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:49:27.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:27 smithi133 ceph-mon[125939]: pgmap v21337: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 749 KiB/s rd, 1.8 MiB/s wr, 11 op/s 2023-05-08T14:49:28.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:27 smithi096 ceph-mon[124666]: pgmap v21337: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 749 KiB/s rd, 1.8 MiB/s wr, 11 op/s 2023-05-08T14:49:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:27 smithi186 ceph-mon[126480]: pgmap v21337: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 749 KiB/s rd, 1.8 MiB/s wr, 11 op/s 2023-05-08T14:49:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:29 smithi096 ceph-mon[124666]: pgmap v21338: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 749 KiB/s rd, 1.8 MiB/s wr, 11 op/s 2023-05-08T14:49:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39908.484665 secs 2023-05-08T14:49:30.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39909.038218 secs 2023-05-08T14:49:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:29 smithi186 ceph-mon[126480]: pgmap v21338: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 749 KiB/s rd, 1.8 MiB/s wr, 11 op/s 2023-05-08T14:49:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39908.484665 secs 2023-05-08T14:49:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39909.038218 secs 2023-05-08T14:49:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:29 smithi133 ceph-mon[125939]: pgmap v21338: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 749 KiB/s rd, 1.8 MiB/s wr, 11 op/s 2023-05-08T14:49:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39908.484665 secs 2023-05-08T14:49:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39909.038218 secs 2023-05-08T14:49:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:31 smithi096 ceph-mon[124666]: pgmap v21339: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 15 op/s 2023-05-08T14:49:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39910.379930 secs 2023-05-08T14:49:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:31 smithi186 ceph-mon[126480]: pgmap v21339: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 15 op/s 2023-05-08T14:49:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39910.379930 secs 2023-05-08T14:49:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:31 smithi133 ceph-mon[125939]: pgmap v21339: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 15 op/s 2023-05-08T14:49:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39910.379930 secs 2023-05-08T14:49:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:33 smithi096 ceph-mon[124666]: pgmap v21340: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T14:49:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:33 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:49:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:33 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:49:34.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:33 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:49:34.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:33 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:49:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:33 smithi186 ceph-mon[126480]: pgmap v21340: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T14:49:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:33 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:49:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:33 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:49:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:33 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:49:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:33 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:49:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:33 smithi133 ceph-mon[125939]: pgmap v21340: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T14:49:34.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:33 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:49:34.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:33 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:49:34.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:33 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:49:34.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:33 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:49:35.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:34 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:49:35.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:34 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T14:49:35.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:34 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T14:49:35.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:34 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:49:35.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39913.484790 secs 2023-05-08T14:49:35.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39914.038340 secs 2023-05-08T14:49:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:34 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:49:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:34 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T14:49:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:34 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T14:49:35.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:34 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:49:35.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39913.484790 secs 2023-05-08T14:49:35.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39914.038340 secs 2023-05-08T14:49:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:34 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:49:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:34 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T14:49:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:34 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T14:49:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:34 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:49:35.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39913.484790 secs 2023-05-08T14:49:35.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39914.038340 secs 2023-05-08T14:49:36.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:35 smithi096 ceph-mon[124666]: pgmap v21341: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T14:49:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:35 smithi186 ceph-mon[126480]: pgmap v21341: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T14:49:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:35 smithi133 ceph-mon[125939]: pgmap v21341: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T14:49:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39915.380047 secs 2023-05-08T14:49:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39915.380047 secs 2023-05-08T14:49:37.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39915.380047 secs 2023-05-08T14:49:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:37 smithi186 ceph-mon[126480]: pgmap v21342: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 14 op/s 2023-05-08T14:49:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:37 smithi133 ceph-mon[125939]: pgmap v21342: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 14 op/s 2023-05-08T14:49:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:37 smithi096 ceph-mon[124666]: pgmap v21342: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 14 op/s 2023-05-08T14:49:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:39 smithi186 ceph-mon[126480]: pgmap v21343: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 529 KiB/s wr, 9 op/s 2023-05-08T14:49:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39918.484915 secs 2023-05-08T14:49:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39919.038466 secs 2023-05-08T14:49:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:39 smithi133 ceph-mon[125939]: pgmap v21343: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 529 KiB/s wr, 9 op/s 2023-05-08T14:49:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39918.484915 secs 2023-05-08T14:49:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39919.038466 secs 2023-05-08T14:49:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:39 smithi096 ceph-mon[124666]: pgmap v21343: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 529 KiB/s wr, 9 op/s 2023-05-08T14:49:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39918.484915 secs 2023-05-08T14:49:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39919.038466 secs 2023-05-08T14:49:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:41 smithi186 ceph-mon[126480]: pgmap v21344: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 886 KiB/s wr, 12 op/s 2023-05-08T14:49:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39920.380172 secs 2023-05-08T14:49:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:41 smithi133 ceph-mon[125939]: pgmap v21344: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 886 KiB/s wr, 12 op/s 2023-05-08T14:49:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39920.380172 secs 2023-05-08T14:49:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:41 smithi096 ceph-mon[124666]: pgmap v21344: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 886 KiB/s wr, 12 op/s 2023-05-08T14:49:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39920.380172 secs 2023-05-08T14:49:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:43 smithi186 ceph-mon[126480]: pgmap v21345: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 709 KiB/s rd, 707 KiB/s wr, 7 op/s 2023-05-08T14:49:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:43 smithi133 ceph-mon[125939]: pgmap v21345: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 709 KiB/s rd, 707 KiB/s wr, 7 op/s 2023-05-08T14:49:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:43 smithi096 ceph-mon[124666]: pgmap v21345: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 709 KiB/s rd, 707 KiB/s wr, 7 op/s 2023-05-08T14:49:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39923.485066 secs 2023-05-08T14:49:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39924.038558 secs 2023-05-08T14:49:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39923.485066 secs 2023-05-08T14:49:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39924.038558 secs 2023-05-08T14:49:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39923.485066 secs 2023-05-08T14:49:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39924.038558 secs 2023-05-08T14:49:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:45 smithi186 ceph-mon[126480]: pgmap v21346: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 709 KiB/s rd, 707 KiB/s wr, 7 op/s 2023-05-08T14:49:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:45 smithi133 ceph-mon[125939]: pgmap v21346: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 709 KiB/s rd, 707 KiB/s wr, 7 op/s 2023-05-08T14:49:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:45 smithi096 ceph-mon[124666]: pgmap v21346: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 709 KiB/s rd, 707 KiB/s wr, 7 op/s 2023-05-08T14:49:47.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39925.380294 secs 2023-05-08T14:49:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39925.380294 secs 2023-05-08T14:49:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39925.380294 secs 2023-05-08T14:49:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:47 smithi186 ceph-mon[126480]: pgmap v21347: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 710 KiB/s rd, 707 KiB/s wr, 10 op/s 2023-05-08T14:49:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:47 smithi133 ceph-mon[125939]: pgmap v21347: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 710 KiB/s rd, 707 KiB/s wr, 10 op/s 2023-05-08T14:49:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:47 smithi096 ceph-mon[124666]: pgmap v21347: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 710 KiB/s rd, 707 KiB/s wr, 10 op/s 2023-05-08T14:49:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:49 smithi186 ceph-mon[126480]: pgmap v21348: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 358 KiB/s wr, 6 op/s 2023-05-08T14:49:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39928.485209 secs 2023-05-08T14:49:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39929.038623 secs 2023-05-08T14:49:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:49 smithi133 ceph-mon[125939]: pgmap v21348: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 358 KiB/s wr, 6 op/s 2023-05-08T14:49:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39928.485209 secs 2023-05-08T14:49:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39929.038623 secs 2023-05-08T14:49:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:49 smithi096 ceph-mon[124666]: pgmap v21348: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 358 KiB/s wr, 6 op/s 2023-05-08T14:49:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39928.485209 secs 2023-05-08T14:49:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39929.038623 secs 2023-05-08T14:49:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:51 smithi186 ceph-mon[126480]: pgmap v21349: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 716 KiB/s rd, 713 KiB/s wr, 10 op/s 2023-05-08T14:49:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39930.380411 secs 2023-05-08T14:49:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:51 smithi133 ceph-mon[125939]: pgmap v21349: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 716 KiB/s rd, 713 KiB/s wr, 10 op/s 2023-05-08T14:49:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39930.380411 secs 2023-05-08T14:49:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:51 smithi096 ceph-mon[124666]: pgmap v21349: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 716 KiB/s rd, 713 KiB/s wr, 10 op/s 2023-05-08T14:49:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39930.380411 secs 2023-05-08T14:49:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:53 smithi186 ceph-mon[126480]: pgmap v21350: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 356 KiB/s wr, 6 op/s 2023-05-08T14:49:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:53 smithi133 ceph-mon[125939]: pgmap v21350: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 356 KiB/s wr, 6 op/s 2023-05-08T14:49:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:53 smithi096 ceph-mon[124666]: pgmap v21350: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 356 KiB/s wr, 6 op/s 2023-05-08T14:49:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39933.485313 secs 2023-05-08T14:49:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39933.485313 secs 2023-05-08T14:49:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39933.485313 secs 2023-05-08T14:49:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:55 smithi186 ceph-mon[126480]: pgmap v21351: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 356 KiB/s wr, 6 op/s 2023-05-08T14:49:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:55 smithi133 ceph-mon[125939]: pgmap v21351: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 356 KiB/s wr, 6 op/s 2023-05-08T14:49:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:55 smithi096 ceph-mon[124666]: pgmap v21351: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 356 KiB/s wr, 6 op/s 2023-05-08T14:49:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39935.380502 secs 2023-05-08T14:49:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39935.380502 secs 2023-05-08T14:49:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39935.380502 secs 2023-05-08T14:49:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:57 smithi186 ceph-mon[126480]: pgmap v21352: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 922 KiB/s rd, 919 KiB/s wr, 11 op/s 2023-05-08T14:49:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:49:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:57 smithi133 ceph-mon[125939]: pgmap v21352: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 922 KiB/s rd, 919 KiB/s wr, 11 op/s 2023-05-08T14:49:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:49:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:57 smithi096 ceph-mon[124666]: pgmap v21352: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 922 KiB/s rd, 919 KiB/s wr, 11 op/s 2023-05-08T14:49:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:49:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:58 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:49:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:49:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:49:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:58 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:49:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:49:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:49:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:58 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:49:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:49:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:50:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:59 smithi186 ceph-mon[126480]: pgmap v21353: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 921 KiB/s rd, 919 KiB/s wr, 8 op/s 2023-05-08T14:50:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:49:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39938.485434 secs 2023-05-08T14:50:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:59 smithi133 ceph-mon[125939]: pgmap v21353: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 921 KiB/s rd, 919 KiB/s wr, 8 op/s 2023-05-08T14:50:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:49:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39938.485434 secs 2023-05-08T14:50:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:59 smithi096 ceph-mon[124666]: pgmap v21353: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 921 KiB/s rd, 919 KiB/s wr, 8 op/s 2023-05-08T14:50:00.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:49:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39938.485434 secs 2023-05-08T14:50:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:00 smithi186 ceph-mon[126480]: Health detail: HEALTH_WARN 2 MDSs report slow requests 2023-05-08T14:50:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:00 smithi186 ceph-mon[126480]: [WRN] MDS_SLOW_REQUEST: 2 MDSs report slow requests 2023-05-08T14:50:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:00 smithi186 ceph-mon[126480]: mds.i(mds.1): 1 slow requests are blocked > 180 secs 2023-05-08T14:50:01.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:00 smithi186 ceph-mon[126480]: mds.b(mds.0): 1 slow requests are blocked > 180 secs 2023-05-08T14:50:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:00 smithi133 ceph-mon[125939]: Health detail: HEALTH_WARN 2 MDSs report slow requests 2023-05-08T14:50:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:00 smithi133 ceph-mon[125939]: [WRN] MDS_SLOW_REQUEST: 2 MDSs report slow requests 2023-05-08T14:50:01.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:00 smithi133 ceph-mon[125939]: mds.i(mds.1): 1 slow requests are blocked > 180 secs 2023-05-08T14:50:01.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:00 smithi133 ceph-mon[125939]: mds.b(mds.0): 1 slow requests are blocked > 180 secs 2023-05-08T14:50:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:00 smithi096 ceph-mon[124666]: Health detail: HEALTH_WARN 2 MDSs report slow requests 2023-05-08T14:50:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:00 smithi096 ceph-mon[124666]: [WRN] MDS_SLOW_REQUEST: 2 MDSs report slow requests 2023-05-08T14:50:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:00 smithi096 ceph-mon[124666]: mds.i(mds.1): 1 slow requests are blocked > 180 secs 2023-05-08T14:50:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:00 smithi096 ceph-mon[124666]: mds.b(mds.0): 1 slow requests are blocked > 180 secs 2023-05-08T14:50:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:01 smithi186 ceph-mon[126480]: pgmap v21354: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.7 MiB/s wr, 14 op/s 2023-05-08T14:50:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:01 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:50:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:01 smithi133 ceph-mon[125939]: pgmap v21354: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.7 MiB/s wr, 14 op/s 2023-05-08T14:50:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:01 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:50:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:01 smithi096 ceph-mon[124666]: pgmap v21354: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.7 MiB/s wr, 14 op/s 2023-05-08T14:50:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:01 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:50:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:50:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:50:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:50:03.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:50:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:50:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:50:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:03 smithi186 ceph-mon[126480]: pgmap v21355: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T14:50:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:03 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:50:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:03 smithi133 ceph-mon[125939]: pgmap v21355: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T14:50:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:03 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:50:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:03 smithi096 ceph-mon[124666]: pgmap v21355: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T14:50:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:03 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:50:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39943.485551 secs 2023-05-08T14:50:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39944.038961 secs 2023-05-08T14:50:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39943.485551 secs 2023-05-08T14:50:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39944.038961 secs 2023-05-08T14:50:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39943.485551 secs 2023-05-08T14:50:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39944.038961 secs 2023-05-08T14:50:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:05 smithi186 ceph-mon[126480]: pgmap v21356: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T14:50:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:05 smithi133 ceph-mon[125939]: pgmap v21356: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T14:50:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:05 smithi096 ceph-mon[124666]: pgmap v21356: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T14:50:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:50:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:50:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:50:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:50:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:50:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:50:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:07 smithi133 ceph-mon[125939]: pgmap v21357: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.2 MiB/s wr, 28 op/s 2023-05-08T14:50:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:07 smithi096 ceph-mon[124666]: pgmap v21357: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.2 MiB/s wr, 28 op/s 2023-05-08T14:50:08.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:07 smithi186 ceph-mon[126480]: pgmap v21357: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.2 MiB/s wr, 28 op/s 2023-05-08T14:50:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:08 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:50:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:08 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:50:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:08 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:50:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:09 smithi133 ceph-mon[125939]: pgmap v21358: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.6 MiB/s wr, 24 op/s 2023-05-08T14:50:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39948.485646 secs 2023-05-08T14:50:10.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39949.039082 secs 2023-05-08T14:50:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:09 smithi096 ceph-mon[124666]: pgmap v21358: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.6 MiB/s wr, 24 op/s 2023-05-08T14:50:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39948.485646 secs 2023-05-08T14:50:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39949.039082 secs 2023-05-08T14:50:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:09 smithi186 ceph-mon[126480]: pgmap v21358: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.6 MiB/s wr, 24 op/s 2023-05-08T14:50:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39948.485646 secs 2023-05-08T14:50:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39949.039082 secs 2023-05-08T14:50:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:11 smithi133 ceph-mon[125939]: pgmap v21359: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.6 MiB/s wr, 28 op/s 2023-05-08T14:50:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:11 smithi096 ceph-mon[124666]: pgmap v21359: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.6 MiB/s wr, 28 op/s 2023-05-08T14:50:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:11 smithi186 ceph-mon[126480]: pgmap v21359: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.6 MiB/s wr, 28 op/s 2023-05-08T14:50:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:13 smithi133 ceph-mon[125939]: pgmap v21360: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 847 KiB/s rd, 860 KiB/s wr, 22 op/s 2023-05-08T14:50:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:13 smithi096 ceph-mon[124666]: pgmap v21360: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 847 KiB/s rd, 860 KiB/s wr, 22 op/s 2023-05-08T14:50:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:13 smithi186 ceph-mon[126480]: pgmap v21360: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 847 KiB/s rd, 860 KiB/s wr, 22 op/s 2023-05-08T14:50:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39953.485779 secs 2023-05-08T14:50:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39954.039221 secs 2023-05-08T14:50:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39953.485779 secs 2023-05-08T14:50:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39954.039221 secs 2023-05-08T14:50:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39953.485779 secs 2023-05-08T14:50:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39954.039221 secs 2023-05-08T14:50:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:15 smithi133 ceph-mon[125939]: pgmap v21361: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 847 KiB/s rd, 860 KiB/s wr, 22 op/s 2023-05-08T14:50:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:15 smithi096 ceph-mon[124666]: pgmap v21361: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 847 KiB/s rd, 860 KiB/s wr, 22 op/s 2023-05-08T14:50:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:15 smithi186 ceph-mon[126480]: pgmap v21361: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 847 KiB/s rd, 860 KiB/s wr, 22 op/s 2023-05-08T14:50:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:17 smithi133 ceph-mon[125939]: pgmap v21362: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 26 op/s 2023-05-08T14:50:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:17 smithi096 ceph-mon[124666]: pgmap v21362: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 26 op/s 2023-05-08T14:50:18.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:17 smithi186 ceph-mon[126480]: pgmap v21362: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 26 op/s 2023-05-08T14:50:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:19 smithi133 ceph-mon[125939]: pgmap v21363: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 563 KiB/s wr, 8 op/s 2023-05-08T14:50:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39958.485921 secs 2023-05-08T14:50:20.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39959.039343 secs 2023-05-08T14:50:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:19 smithi096 ceph-mon[124666]: pgmap v21363: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 563 KiB/s wr, 8 op/s 2023-05-08T14:50:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39958.485921 secs 2023-05-08T14:50:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39959.039343 secs 2023-05-08T14:50:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:19 smithi186 ceph-mon[126480]: pgmap v21363: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 563 KiB/s wr, 8 op/s 2023-05-08T14:50:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39958.485921 secs 2023-05-08T14:50:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39959.039343 secs 2023-05-08T14:50:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:21 smithi133 ceph-mon[125939]: pgmap v21364: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 566 KiB/s rd, 564 KiB/s wr, 12 op/s 2023-05-08T14:50:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:21 smithi096 ceph-mon[124666]: pgmap v21364: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 566 KiB/s rd, 564 KiB/s wr, 12 op/s 2023-05-08T14:50:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:21 smithi186 ceph-mon[126480]: pgmap v21364: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 566 KiB/s rd, 564 KiB/s wr, 12 op/s 2023-05-08T14:50:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:23 smithi133 ceph-mon[125939]: pgmap v21365: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 561 KiB/s wr, 7 op/s 2023-05-08T14:50:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:23 smithi096 ceph-mon[124666]: pgmap v21365: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 561 KiB/s wr, 7 op/s 2023-05-08T14:50:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:23 smithi186 ceph-mon[126480]: pgmap v21365: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 561 KiB/s wr, 7 op/s 2023-05-08T14:50:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39963.486075 secs 2023-05-08T14:50:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39963.486075 secs 2023-05-08T14:50:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39963.486075 secs 2023-05-08T14:50:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:25 smithi133 ceph-mon[125939]: pgmap v21366: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 561 KiB/s wr, 7 op/s 2023-05-08T14:50:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:25 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:50:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39965.381242 secs 2023-05-08T14:50:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:25 smithi096 ceph-mon[124666]: pgmap v21366: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 561 KiB/s wr, 7 op/s 2023-05-08T14:50:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:25 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:50:26.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39965.381242 secs 2023-05-08T14:50:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:25 smithi186 ceph-mon[126480]: pgmap v21366: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 561 KiB/s wr, 7 op/s 2023-05-08T14:50:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:25 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:50:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39965.381242 secs 2023-05-08T14:50:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:26 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:50:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:26 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:50:27.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:26 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:50:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:26 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:50:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:26 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:50:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:26 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:50:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:26 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:50:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:26 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:50:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:26 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:50:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:27 smithi133 ceph-mon[125939]: pgmap v21367: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 15 op/s 2023-05-08T14:50:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:27 smithi096 ceph-mon[124666]: pgmap v21367: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 15 op/s 2023-05-08T14:50:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:27 smithi186 ceph-mon[126480]: pgmap v21367: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 15 op/s 2023-05-08T14:50:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:29 smithi133 ceph-mon[125939]: pgmap v21368: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 961 KiB/s rd, 981 KiB/s wr, 11 op/s 2023-05-08T14:50:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39968.486204 secs 2023-05-08T14:50:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:29 smithi096 ceph-mon[124666]: pgmap v21368: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 961 KiB/s rd, 981 KiB/s wr, 11 op/s 2023-05-08T14:50:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39968.486204 secs 2023-05-08T14:50:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:29 smithi186 ceph-mon[126480]: pgmap v21368: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 961 KiB/s rd, 981 KiB/s wr, 11 op/s 2023-05-08T14:50:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39968.486204 secs 2023-05-08T14:50:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:30 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:50:31.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:30 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:50:31.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:30 smithi133 ceph-mon[125939]: pgmap v21369: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 964 KiB/s rd, 1014 KiB/s wr, 15 op/s 2023-05-08T14:50:31.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39970.381338 secs 2023-05-08T14:50:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:30 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:50:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:30 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:50:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:30 smithi096 ceph-mon[124666]: pgmap v21369: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 964 KiB/s rd, 1014 KiB/s wr, 15 op/s 2023-05-08T14:50:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39970.381338 secs 2023-05-08T14:50:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:30 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:50:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:30 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:50:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:30 smithi186 ceph-mon[126480]: pgmap v21369: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 964 KiB/s rd, 1014 KiB/s wr, 15 op/s 2023-05-08T14:50:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39970.381338 secs 2023-05-08T14:50:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:31 smithi133 ceph-mon[125939]: osdmap e1412: 12 total, 12 up, 12 in 2023-05-08T14:50:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:31 smithi096 ceph-mon[124666]: osdmap e1412: 12 total, 12 up, 12 in 2023-05-08T14:50:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:31 smithi186 ceph-mon[126480]: osdmap e1412: 12 total, 12 up, 12 in 2023-05-08T14:50:33.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:32 smithi133 ceph-mon[125939]: pgmap v21371: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T14:50:33.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:32 smithi096 ceph-mon[124666]: pgmap v21371: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T14:50:33.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:32 smithi186 ceph-mon[126480]: pgmap v21371: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T14:50:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:33 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:50:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:33 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:50:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:33 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:50:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:33 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:50:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:33 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:50:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:33 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:50:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39973.486295 secs 2023-05-08T14:50:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:34 smithi133 ceph-mon[125939]: pgmap v21372: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T14:50:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:34 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:50:35.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:34 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:50:35.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:34 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:50:35.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:34 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:50:35.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:34 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T14:50:35.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:34 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T14:50:35.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:34 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:50:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39973.486295 secs 2023-05-08T14:50:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:34 smithi096 ceph-mon[124666]: pgmap v21372: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T14:50:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:34 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:50:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:34 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:50:35.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:34 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:50:35.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:34 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:50:35.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:34 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T14:50:35.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:34 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T14:50:35.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:34 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:50:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39973.486295 secs 2023-05-08T14:50:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:34 smithi186 ceph-mon[126480]: pgmap v21372: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T14:50:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:34 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:50:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:34 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:50:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:34 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:50:35.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:34 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:50:35.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:34 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T14:50:35.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:34 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T14:50:35.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:34 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:50:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39975.381464 secs 2023-05-08T14:50:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39975.381464 secs 2023-05-08T14:50:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39975.381464 secs 2023-05-08T14:50:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:36 smithi133 ceph-mon[125939]: pgmap v21373: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 464 KiB/s wr, 9 op/s 2023-05-08T14:50:37.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:36 smithi096 ceph-mon[124666]: pgmap v21373: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 464 KiB/s wr, 9 op/s 2023-05-08T14:50:37.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:36 smithi186 ceph-mon[126480]: pgmap v21373: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 464 KiB/s wr, 9 op/s 2023-05-08T14:50:39.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:39 smithi133 ceph-mon[125939]: pgmap v21374: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 464 KiB/s wr, 9 op/s 2023-05-08T14:50:39.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:39 smithi133 ceph-mon[125939]: osdmap e1413: 12 total, 12 up, 12 in 2023-05-08T14:50:39.991 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39978.486458 secs 2023-05-08T14:50:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:39 smithi096 ceph-mon[124666]: pgmap v21374: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 464 KiB/s wr, 9 op/s 2023-05-08T14:50:40.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:39 smithi096 ceph-mon[124666]: osdmap e1413: 12 total, 12 up, 12 in 2023-05-08T14:50:40.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39978.486458 secs 2023-05-08T14:50:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:39 smithi186 ceph-mon[126480]: pgmap v21374: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 464 KiB/s wr, 9 op/s 2023-05-08T14:50:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:39 smithi186 ceph-mon[126480]: osdmap e1413: 12 total, 12 up, 12 in 2023-05-08T14:50:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39978.486458 secs 2023-05-08T14:50:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:41 smithi133 ceph-mon[125939]: pgmap v21376: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 512 KiB/s rd, 469 KiB/s wr, 10 op/s 2023-05-08T14:50:41.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39980.381581 secs 2023-05-08T14:50:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:41 smithi096 ceph-mon[124666]: pgmap v21376: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 512 KiB/s rd, 469 KiB/s wr, 10 op/s 2023-05-08T14:50:42.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39980.381581 secs 2023-05-08T14:50:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:41 smithi186 ceph-mon[126480]: pgmap v21376: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 512 KiB/s rd, 469 KiB/s wr, 10 op/s 2023-05-08T14:50:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39980.381581 secs 2023-05-08T14:50:44.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:43 smithi096 ceph-mon[124666]: pgmap v21377: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 426 KiB/s wr, 9 op/s 2023-05-08T14:50:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:43 smithi186 ceph-mon[126480]: pgmap v21377: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 426 KiB/s wr, 9 op/s 2023-05-08T14:50:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:43 smithi133 ceph-mon[125939]: pgmap v21377: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 426 KiB/s wr, 9 op/s 2023-05-08T14:50:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39983.486529 secs 2023-05-08T14:50:45.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39984.039921 secs 2023-05-08T14:50:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39983.486529 secs 2023-05-08T14:50:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39984.039921 secs 2023-05-08T14:50:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39983.486529 secs 2023-05-08T14:50:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39984.039921 secs 2023-05-08T14:50:46.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:45 smithi096 ceph-mon[124666]: pgmap v21378: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 426 KiB/s wr, 9 op/s 2023-05-08T14:50:46.118 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:45 smithi186 ceph-mon[126480]: pgmap v21378: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 426 KiB/s wr, 9 op/s 2023-05-08T14:50:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:45 smithi133 ceph-mon[125939]: pgmap v21378: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 426 KiB/s wr, 9 op/s 2023-05-08T14:50:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39985.381701 secs 2023-05-08T14:50:47.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:46 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:50:47.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:46 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:50:47.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:46 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:50:47.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39985.381701 secs 2023-05-08T14:50:47.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:46 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:50:47.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:46 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:50:47.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:46 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:50:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39985.381701 secs 2023-05-08T14:50:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:46 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:50:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:46 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:50:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:46 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:50:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:47 smithi186 ceph-mon[126480]: pgmap v21379: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 878 KiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T14:50:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:47 smithi133 ceph-mon[125939]: pgmap v21379: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 878 KiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T14:50:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:47 smithi096 ceph-mon[124666]: pgmap v21379: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 878 KiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T14:50:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:49 smithi186 ceph-mon[126480]: pgmap v21380: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 878 KiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T14:50:50.181 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39988.486656 secs 2023-05-08T14:50:50.181 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39989.040016 secs 2023-05-08T14:50:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:49 smithi133 ceph-mon[125939]: pgmap v21380: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 878 KiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T14:50:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39988.486656 secs 2023-05-08T14:50:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39989.040016 secs 2023-05-08T14:50:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:49 smithi096 ceph-mon[124666]: pgmap v21380: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 878 KiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T14:50:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39988.486656 secs 2023-05-08T14:50:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39989.040016 secs 2023-05-08T14:50:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:51 smithi186 ceph-mon[126480]: pgmap v21381: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 15 op/s 2023-05-08T14:50:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39990.381840 secs 2023-05-08T14:50:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:51 smithi133 ceph-mon[125939]: pgmap v21381: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 15 op/s 2023-05-08T14:50:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39990.381840 secs 2023-05-08T14:50:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:51 smithi096 ceph-mon[124666]: pgmap v21381: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 15 op/s 2023-05-08T14:50:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39990.381840 secs 2023-05-08T14:50:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:53 smithi186 ceph-mon[126480]: pgmap v21382: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 11 op/s 2023-05-08T14:50:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:53 smithi133 ceph-mon[125939]: pgmap v21382: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 11 op/s 2023-05-08T14:50:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:53 smithi096 ceph-mon[124666]: pgmap v21382: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 11 op/s 2023-05-08T14:50:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39993.486788 secs 2023-05-08T14:50:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39993.486788 secs 2023-05-08T14:50:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39993.486788 secs 2023-05-08T14:50:56.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:55 smithi186 ceph-mon[126480]: pgmap v21383: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 11 op/s 2023-05-08T14:50:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:55 smithi133 ceph-mon[125939]: pgmap v21383: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 11 op/s 2023-05-08T14:50:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:55 smithi096 ceph-mon[124666]: pgmap v21383: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 11 op/s 2023-05-08T14:50:57.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39995.381977 secs 2023-05-08T14:50:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39995.381977 secs 2023-05-08T14:50:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39995.381977 secs 2023-05-08T14:50:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:57 smithi186 ceph-mon[126480]: pgmap v21384: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 16 op/s 2023-05-08T14:50:58.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:50:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:57 smithi133 ceph-mon[125939]: pgmap v21384: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 16 op/s 2023-05-08T14:50:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:50:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:57 smithi096 ceph-mon[124666]: pgmap v21384: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 16 op/s 2023-05-08T14:50:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:50:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:58 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:50:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:50:59.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:50:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:58 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:50:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:50:59.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:50:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:58 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:50:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:50:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:51:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:59 smithi186 ceph-mon[126480]: pgmap v21385: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T14:51:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39998.486914 secs 2023-05-08T14:51:00.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:50:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 39999.040255 secs 2023-05-08T14:51:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:59 smithi133 ceph-mon[125939]: pgmap v21385: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T14:51:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39998.486914 secs 2023-05-08T14:51:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:50:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 39999.040255 secs 2023-05-08T14:51:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:59 smithi096 ceph-mon[124666]: pgmap v21385: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T14:51:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39998.486914 secs 2023-05-08T14:51:00.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:50:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 39999.040255 secs 2023-05-08T14:51:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:01 smithi186 ceph-mon[126480]: pgmap v21386: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.9 MiB/s wr, 17 op/s 2023-05-08T14:51:02.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:01 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:51:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:01 smithi133 ceph-mon[125939]: pgmap v21386: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.9 MiB/s wr, 17 op/s 2023-05-08T14:51:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:01 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:51:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:01 smithi096 ceph-mon[124666]: pgmap v21386: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.9 MiB/s wr, 17 op/s 2023-05-08T14:51:02.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:01 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:51:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:51:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:51:03.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:51:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:51:03.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:51:03.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:51:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:51:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:51:03.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:51:04.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:03 smithi186 ceph-mon[126480]: pgmap v21387: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.4 MiB/s wr, 12 op/s 2023-05-08T14:51:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:03 smithi133 ceph-mon[125939]: pgmap v21387: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.4 MiB/s wr, 12 op/s 2023-05-08T14:51:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:03 smithi096 ceph-mon[124666]: pgmap v21387: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.4 MiB/s wr, 12 op/s 2023-05-08T14:51:05.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40003.487064 secs 2023-05-08T14:51:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40003.487064 secs 2023-05-08T14:51:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40003.487064 secs 2023-05-08T14:51:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:05 smithi186 ceph-mon[126480]: pgmap v21388: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.1 MiB/s wr, 11 op/s 2023-05-08T14:51:06.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:05 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:51:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:05 smithi133 ceph-mon[125939]: pgmap v21388: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.1 MiB/s wr, 11 op/s 2023-05-08T14:51:06.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:05 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:51:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:05 smithi096 ceph-mon[124666]: pgmap v21388: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.1 MiB/s wr, 11 op/s 2023-05-08T14:51:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:05 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:51:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:06 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:51:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:51:07.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:51:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:06 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:51:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:51:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:51:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:06 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:51:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:51:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:51:08.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:07 smithi186 ceph-mon[126480]: pgmap v21389: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.5 MiB/s wr, 31 op/s 2023-05-08T14:51:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:07 smithi133 ceph-mon[125939]: pgmap v21389: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.5 MiB/s wr, 31 op/s 2023-05-08T14:51:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:07 smithi096 ceph-mon[124666]: pgmap v21389: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.5 MiB/s wr, 31 op/s 2023-05-08T14:51:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:09 smithi186 ceph-mon[126480]: pgmap v21390: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 26 op/s 2023-05-08T14:51:10.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40008.487126 secs 2023-05-08T14:51:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:09 smithi133 ceph-mon[125939]: pgmap v21390: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 26 op/s 2023-05-08T14:51:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40008.487126 secs 2023-05-08T14:51:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:09 smithi096 ceph-mon[124666]: pgmap v21390: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 26 op/s 2023-05-08T14:51:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40008.487126 secs 2023-05-08T14:51:12.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:11 smithi186 ceph-mon[126480]: pgmap v21391: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.5 MiB/s wr, 30 op/s 2023-05-08T14:51:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:11 smithi133 ceph-mon[125939]: pgmap v21391: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.5 MiB/s wr, 30 op/s 2023-05-08T14:51:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:11 smithi096 ceph-mon[124666]: pgmap v21391: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.5 MiB/s wr, 30 op/s 2023-05-08T14:51:14.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:13 smithi186 ceph-mon[126480]: pgmap v21392: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.1 MiB/s wr, 24 op/s 2023-05-08T14:51:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:13 smithi133 ceph-mon[125939]: pgmap v21392: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.1 MiB/s wr, 24 op/s 2023-05-08T14:51:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:13 smithi096 ceph-mon[124666]: pgmap v21392: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.1 MiB/s wr, 24 op/s 2023-05-08T14:51:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40013.487249 secs 2023-05-08T14:51:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40013.487249 secs 2023-05-08T14:51:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40013.487249 secs 2023-05-08T14:51:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:15 smithi186 ceph-mon[126480]: pgmap v21393: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.1 MiB/s wr, 24 op/s 2023-05-08T14:51:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:15 smithi133 ceph-mon[125939]: pgmap v21393: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.1 MiB/s wr, 24 op/s 2023-05-08T14:51:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:15 smithi096 ceph-mon[124666]: pgmap v21393: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.1 MiB/s wr, 24 op/s 2023-05-08T14:51:18.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:17 smithi186 ceph-mon[126480]: pgmap v21394: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 1.4 MiB/s wr, 28 op/s 2023-05-08T14:51:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:17 smithi133 ceph-mon[125939]: pgmap v21394: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 1.4 MiB/s wr, 28 op/s 2023-05-08T14:51:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:17 smithi096 ceph-mon[124666]: pgmap v21394: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 1.4 MiB/s wr, 28 op/s 2023-05-08T14:51:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:19 smithi133 ceph-mon[125939]: pgmap v21395: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 8 op/s 2023-05-08T14:51:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40018.487314 secs 2023-05-08T14:51:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40019.040839 secs 2023-05-08T14:51:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:19 smithi096 ceph-mon[124666]: pgmap v21395: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 8 op/s 2023-05-08T14:51:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40018.487314 secs 2023-05-08T14:51:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40019.040839 secs 2023-05-08T14:51:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:19 smithi186 ceph-mon[126480]: pgmap v21395: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 8 op/s 2023-05-08T14:51:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40018.487314 secs 2023-05-08T14:51:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40019.040839 secs 2023-05-08T14:51:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:21 smithi133 ceph-mon[125939]: pgmap v21396: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.7 MiB/s wr, 16 op/s 2023-05-08T14:51:22.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40020.382480 secs 2023-05-08T14:51:22.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:21 smithi133 ceph-mon[125939]: osdmap e1414: 12 total, 12 up, 12 in 2023-05-08T14:51:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:21 smithi096 ceph-mon[124666]: pgmap v21396: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.7 MiB/s wr, 16 op/s 2023-05-08T14:51:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40020.382480 secs 2023-05-08T14:51:22.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:21 smithi096 ceph-mon[124666]: osdmap e1414: 12 total, 12 up, 12 in 2023-05-08T14:51:22.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:21 smithi186 ceph-mon[126480]: pgmap v21396: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.7 MiB/s wr, 16 op/s 2023-05-08T14:51:22.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40020.382480 secs 2023-05-08T14:51:22.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:21 smithi186 ceph-mon[126480]: osdmap e1414: 12 total, 12 up, 12 in 2023-05-08T14:51:23.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:22 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:51:23.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:22 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:51:23.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:22 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:51:23.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:22 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:51:23.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:22 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:51:23.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:22 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:51:23.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:22 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:51:23.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:22 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:51:23.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:22 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:51:23.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:22 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:51:23.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:22 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:51:23.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:22 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:51:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:23 smithi133 ceph-mon[125939]: pgmap v21398: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.4 MiB/s wr, 13 op/s 2023-05-08T14:51:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:23 smithi096 ceph-mon[124666]: pgmap v21398: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.4 MiB/s wr, 13 op/s 2023-05-08T14:51:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:23 smithi186 ceph-mon[126480]: pgmap v21398: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.4 MiB/s wr, 13 op/s 2023-05-08T14:51:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40023.487370 secs 2023-05-08T14:51:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40024.040993 secs 2023-05-08T14:51:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40023.487370 secs 2023-05-08T14:51:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40024.040993 secs 2023-05-08T14:51:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40023.487370 secs 2023-05-08T14:51:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40024.040993 secs 2023-05-08T14:51:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:25 smithi133 ceph-mon[125939]: pgmap v21399: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.4 MiB/s wr, 13 op/s 2023-05-08T14:51:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:25 smithi096 ceph-mon[124666]: pgmap v21399: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.4 MiB/s wr, 13 op/s 2023-05-08T14:51:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:25 smithi186 ceph-mon[126480]: pgmap v21399: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.4 MiB/s wr, 13 op/s 2023-05-08T14:51:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40025.382632 secs 2023-05-08T14:51:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40025.382632 secs 2023-05-08T14:51:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40025.382632 secs 2023-05-08T14:51:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:27 smithi133 ceph-mon[125939]: pgmap v21400: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.1 MiB/s wr, 16 op/s 2023-05-08T14:51:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:27 smithi096 ceph-mon[124666]: pgmap v21400: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.1 MiB/s wr, 16 op/s 2023-05-08T14:51:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:27 smithi186 ceph-mon[126480]: pgmap v21400: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.1 MiB/s wr, 16 op/s 2023-05-08T14:51:30.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:29 smithi096 ceph-mon[124666]: pgmap v21401: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.1 MiB/s wr, 16 op/s 2023-05-08T14:51:30.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40028.487435 secs 2023-05-08T14:51:30.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:29 smithi096 ceph-mon[124666]: osdmap e1415: 12 total, 12 up, 12 in 2023-05-08T14:51:30.006 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40029.041095 secs 2023-05-08T14:51:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:29 smithi186 ceph-mon[126480]: pgmap v21401: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.1 MiB/s wr, 16 op/s 2023-05-08T14:51:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40028.487435 secs 2023-05-08T14:51:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:29 smithi186 ceph-mon[126480]: osdmap e1415: 12 total, 12 up, 12 in 2023-05-08T14:51:30.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40029.041095 secs 2023-05-08T14:51:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:29 smithi133 ceph-mon[125939]: pgmap v21401: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.1 MiB/s wr, 16 op/s 2023-05-08T14:51:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40028.487435 secs 2023-05-08T14:51:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:29 smithi133 ceph-mon[125939]: osdmap e1415: 12 total, 12 up, 12 in 2023-05-08T14:51:30.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40029.041095 secs 2023-05-08T14:51:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:31 smithi096 ceph-mon[124666]: pgmap v21403: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 227 KiB/s wr, 12 op/s 2023-05-08T14:51:32.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40030.382770 secs 2023-05-08T14:51:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:31 smithi186 ceph-mon[126480]: pgmap v21403: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 227 KiB/s wr, 12 op/s 2023-05-08T14:51:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40030.382770 secs 2023-05-08T14:51:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:31 smithi133 ceph-mon[125939]: pgmap v21403: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 227 KiB/s wr, 12 op/s 2023-05-08T14:51:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40030.382770 secs 2023-05-08T14:51:34.005 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:33 smithi096 ceph-mon[124666]: pgmap v21404: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 208 KiB/s wr, 11 op/s 2023-05-08T14:51:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:33 smithi186 ceph-mon[126480]: pgmap v21404: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 208 KiB/s wr, 11 op/s 2023-05-08T14:51:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:33 smithi133 ceph-mon[125939]: pgmap v21404: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 208 KiB/s wr, 11 op/s 2023-05-08T14:51:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40033.487547 secs 2023-05-08T14:51:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40034.041199 secs 2023-05-08T14:51:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:34 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:51:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40033.487547 secs 2023-05-08T14:51:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40034.041199 secs 2023-05-08T14:51:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:34 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:51:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40033.487547 secs 2023-05-08T14:51:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40034.041199 secs 2023-05-08T14:51:35.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:34 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:51:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:35 smithi186 ceph-mon[126480]: pgmap v21405: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 208 KiB/s wr, 11 op/s 2023-05-08T14:51:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:51:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:51:36.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:51:36.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:51:36.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:51:36.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:51:36.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:51:36.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:51:36.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:51:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:35 smithi133 ceph-mon[125939]: pgmap v21405: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 208 KiB/s wr, 11 op/s 2023-05-08T14:51:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:51:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:51:36.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:51:36.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:51:36.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:51:36.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:51:36.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:51:36.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:51:36.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:51:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:35 smithi096 ceph-mon[124666]: pgmap v21405: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 208 KiB/s wr, 11 op/s 2023-05-08T14:51:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:51:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:51:36.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:51:36.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:51:36.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:51:36.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:51:36.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:51:36.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:51:36.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:51:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:36 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:51:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:36 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T14:51:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:36 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T14:51:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:36 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:51:37.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40035.382892 secs 2023-05-08T14:51:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:36 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:51:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:36 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T14:51:37.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:36 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T14:51:37.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:36 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:51:37.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40035.382892 secs 2023-05-08T14:51:37.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:36 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:51:37.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:36 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T14:51:37.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:36 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T14:51:37.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:36 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:51:37.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40035.382892 secs 2023-05-08T14:51:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:37 smithi186 ceph-mon[126480]: pgmap v21406: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 642 KiB/s rd, 639 KiB/s wr, 9 op/s 2023-05-08T14:51:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:37 smithi133 ceph-mon[125939]: pgmap v21406: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 642 KiB/s rd, 639 KiB/s wr, 9 op/s 2023-05-08T14:51:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:37 smithi096 ceph-mon[124666]: pgmap v21406: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 642 KiB/s rd, 639 KiB/s wr, 9 op/s 2023-05-08T14:51:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:39 smithi186 ceph-mon[126480]: pgmap v21407: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 642 KiB/s rd, 639 KiB/s wr, 9 op/s 2023-05-08T14:51:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40038.487669 secs 2023-05-08T14:51:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40039.041299 secs 2023-05-08T14:51:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:39 smithi133 ceph-mon[125939]: pgmap v21407: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 642 KiB/s rd, 639 KiB/s wr, 9 op/s 2023-05-08T14:51:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40038.487669 secs 2023-05-08T14:51:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40039.041299 secs 2023-05-08T14:51:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:39 smithi096 ceph-mon[124666]: pgmap v21407: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 642 KiB/s rd, 639 KiB/s wr, 9 op/s 2023-05-08T14:51:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40038.487669 secs 2023-05-08T14:51:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40039.041299 secs 2023-05-08T14:51:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:41 smithi186 ceph-mon[126480]: pgmap v21408: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 570 KiB/s rd, 949 KiB/s wr, 11 op/s 2023-05-08T14:51:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40040.382973 secs 2023-05-08T14:51:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:41 smithi133 ceph-mon[125939]: pgmap v21408: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 570 KiB/s rd, 949 KiB/s wr, 11 op/s 2023-05-08T14:51:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40040.382973 secs 2023-05-08T14:51:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:41 smithi096 ceph-mon[124666]: pgmap v21408: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 570 KiB/s rd, 949 KiB/s wr, 11 op/s 2023-05-08T14:51:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40040.382973 secs 2023-05-08T14:51:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:43 smithi186 ceph-mon[126480]: pgmap v21409: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 720 KiB/s wr, 7 op/s 2023-05-08T14:51:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:43 smithi133 ceph-mon[125939]: pgmap v21409: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 720 KiB/s wr, 7 op/s 2023-05-08T14:51:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:43 smithi096 ceph-mon[124666]: pgmap v21409: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 720 KiB/s wr, 7 op/s 2023-05-08T14:51:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40043.487788 secs 2023-05-08T14:51:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40044.041432 secs 2023-05-08T14:51:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40043.487788 secs 2023-05-08T14:51:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40044.041432 secs 2023-05-08T14:51:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40043.487788 secs 2023-05-08T14:51:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40044.041432 secs 2023-05-08T14:51:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:45 smithi186 ceph-mon[126480]: pgmap v21410: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 720 KiB/s wr, 7 op/s 2023-05-08T14:51:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:45 smithi133 ceph-mon[125939]: pgmap v21410: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 720 KiB/s wr, 7 op/s 2023-05-08T14:51:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:45 smithi096 ceph-mon[124666]: pgmap v21410: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 720 KiB/s wr, 7 op/s 2023-05-08T14:51:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40045.383059 secs 2023-05-08T14:51:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40045.383059 secs 2023-05-08T14:51:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40045.383059 secs 2023-05-08T14:51:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:47 smithi133 ceph-mon[125939]: pgmap v21411: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 724 KiB/s rd, 726 KiB/s wr, 10 op/s 2023-05-08T14:51:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:47 smithi096 ceph-mon[124666]: pgmap v21411: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 724 KiB/s rd, 726 KiB/s wr, 10 op/s 2023-05-08T14:51:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:47 smithi186 ceph-mon[126480]: pgmap v21411: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 724 KiB/s rd, 726 KiB/s wr, 10 op/s 2023-05-08T14:51:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:49 smithi133 ceph-mon[125939]: pgmap v21412: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 365 KiB/s wr, 6 op/s 2023-05-08T14:51:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40048.487902 secs 2023-05-08T14:51:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40049.041548 secs 2023-05-08T14:51:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:49 smithi096 ceph-mon[124666]: pgmap v21412: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 365 KiB/s wr, 6 op/s 2023-05-08T14:51:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40048.487902 secs 2023-05-08T14:51:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40049.041548 secs 2023-05-08T14:51:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:49 smithi186 ceph-mon[126480]: pgmap v21412: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 365 KiB/s wr, 6 op/s 2023-05-08T14:51:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40048.487902 secs 2023-05-08T14:51:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40049.041548 secs 2023-05-08T14:51:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:51 smithi133 ceph-mon[125939]: pgmap v21413: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 744 KiB/s rd, 724 KiB/s wr, 10 op/s 2023-05-08T14:51:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40050.383169 secs 2023-05-08T14:51:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:51 smithi096 ceph-mon[124666]: pgmap v21413: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 744 KiB/s rd, 724 KiB/s wr, 10 op/s 2023-05-08T14:51:52.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40050.383169 secs 2023-05-08T14:51:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:51 smithi186 ceph-mon[126480]: pgmap v21413: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 744 KiB/s rd, 724 KiB/s wr, 10 op/s 2023-05-08T14:51:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40050.383169 secs 2023-05-08T14:51:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:53 smithi133 ceph-mon[125939]: pgmap v21414: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 742 KiB/s rd, 364 KiB/s wr, 7 op/s 2023-05-08T14:51:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:53 smithi096 ceph-mon[124666]: pgmap v21414: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 742 KiB/s rd, 364 KiB/s wr, 7 op/s 2023-05-08T14:51:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:53 smithi186 ceph-mon[126480]: pgmap v21414: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 742 KiB/s rd, 364 KiB/s wr, 7 op/s 2023-05-08T14:51:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40053.488023 secs 2023-05-08T14:51:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40053.488023 secs 2023-05-08T14:51:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40053.488023 secs 2023-05-08T14:51:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:55 smithi133 ceph-mon[125939]: pgmap v21415: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 742 KiB/s rd, 364 KiB/s wr, 7 op/s 2023-05-08T14:51:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:55 smithi096 ceph-mon[124666]: pgmap v21415: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 742 KiB/s rd, 364 KiB/s wr, 7 op/s 2023-05-08T14:51:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:55 smithi186 ceph-mon[126480]: pgmap v21415: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 742 KiB/s rd, 364 KiB/s wr, 7 op/s 2023-05-08T14:51:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40055.383296 secs 2023-05-08T14:51:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40055.383296 secs 2023-05-08T14:51:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40055.383296 secs 2023-05-08T14:51:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:57 smithi133 ceph-mon[125939]: pgmap v21416: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 945 KiB/s wr, 12 op/s 2023-05-08T14:51:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:51:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:57 smithi096 ceph-mon[124666]: pgmap v21416: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 945 KiB/s wr, 12 op/s 2023-05-08T14:51:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:51:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:57 smithi186 ceph-mon[126480]: pgmap v21416: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 945 KiB/s wr, 12 op/s 2023-05-08T14:51:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:51:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:58 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:51:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:51:59.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:51:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:58 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:51:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:51:59.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:51:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:58 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:51:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:51:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:52:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:59 smithi133 ceph-mon[125939]: pgmap v21417: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 963 KiB/s rd, 939 KiB/s wr, 9 op/s 2023-05-08T14:52:00.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:51:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40058.488152 secs 2023-05-08T14:52:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:59 smithi096 ceph-mon[124666]: pgmap v21417: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 963 KiB/s rd, 939 KiB/s wr, 9 op/s 2023-05-08T14:52:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:51:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40058.488152 secs 2023-05-08T14:52:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:59 smithi186 ceph-mon[126480]: pgmap v21417: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 963 KiB/s rd, 939 KiB/s wr, 9 op/s 2023-05-08T14:52:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:51:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40058.488152 secs 2023-05-08T14:52:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:01 smithi133 ceph-mon[125939]: pgmap v21418: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 15 op/s 2023-05-08T14:52:02.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:01 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:52:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:01 smithi096 ceph-mon[124666]: pgmap v21418: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 15 op/s 2023-05-08T14:52:02.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:01 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:52:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:01 smithi186 ceph-mon[126480]: pgmap v21418: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 15 op/s 2023-05-08T14:52:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:01 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:52:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:52:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:52:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:52:03.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:52:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:52:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:52:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:03 smithi133 ceph-mon[125939]: pgmap v21419: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2023-05-08T14:52:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:03 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:52:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:03 smithi096 ceph-mon[124666]: pgmap v21419: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2023-05-08T14:52:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:03 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:52:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:03 smithi186 ceph-mon[126480]: pgmap v21419: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2023-05-08T14:52:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:03 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:52:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40063.488293 secs 2023-05-08T14:52:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40064.041900 secs 2023-05-08T14:52:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40063.488293 secs 2023-05-08T14:52:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40064.041900 secs 2023-05-08T14:52:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40063.488293 secs 2023-05-08T14:52:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40064.041900 secs 2023-05-08T14:52:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:05 smithi133 ceph-mon[125939]: pgmap v21420: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2023-05-08T14:52:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:05 smithi096 ceph-mon[124666]: pgmap v21420: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2023-05-08T14:52:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:05 smithi186 ceph-mon[126480]: pgmap v21420: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2023-05-08T14:52:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:52:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:52:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:52:07.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:52:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:52:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:52:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:07 smithi133 ceph-mon[125939]: pgmap v21421: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.2 MiB/s wr, 31 op/s 2023-05-08T14:52:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:07 smithi096 ceph-mon[124666]: pgmap v21421: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.2 MiB/s wr, 31 op/s 2023-05-08T14:52:08.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:07 smithi186 ceph-mon[126480]: pgmap v21421: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.2 MiB/s wr, 31 op/s 2023-05-08T14:52:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:08 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:52:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:08 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:52:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:08 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:52:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:09 smithi133 ceph-mon[125939]: pgmap v21422: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.6 MiB/s wr, 25 op/s 2023-05-08T14:52:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40068.488416 secs 2023-05-08T14:52:10.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40069.041998 secs 2023-05-08T14:52:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:09 smithi096 ceph-mon[124666]: pgmap v21422: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.6 MiB/s wr, 25 op/s 2023-05-08T14:52:10.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40068.488416 secs 2023-05-08T14:52:10.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40069.041998 secs 2023-05-08T14:52:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:09 smithi186 ceph-mon[126480]: pgmap v21422: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.6 MiB/s wr, 25 op/s 2023-05-08T14:52:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40068.488416 secs 2023-05-08T14:52:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40069.041998 secs 2023-05-08T14:52:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:10 smithi133 ceph-mon[125939]: pgmap v21423: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.6 MiB/s wr, 30 op/s 2023-05-08T14:52:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:10 smithi096 ceph-mon[124666]: pgmap v21423: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.6 MiB/s wr, 30 op/s 2023-05-08T14:52:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:10 smithi186 ceph-mon[126480]: pgmap v21423: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.6 MiB/s wr, 30 op/s 2023-05-08T14:52:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:13 smithi186 ceph-mon[126480]: pgmap v21424: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 868 KiB/s wr, 24 op/s 2023-05-08T14:52:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:13 smithi133 ceph-mon[125939]: pgmap v21424: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 868 KiB/s wr, 24 op/s 2023-05-08T14:52:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:13 smithi096 ceph-mon[124666]: pgmap v21424: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 868 KiB/s wr, 24 op/s 2023-05-08T14:52:15.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40073.488527 secs 2023-05-08T14:52:15.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40074.042093 secs 2023-05-08T14:52:15.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40073.488527 secs 2023-05-08T14:52:15.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40074.042093 secs 2023-05-08T14:52:15.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40073.488527 secs 2023-05-08T14:52:15.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40074.042093 secs 2023-05-08T14:52:16.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:15 smithi186 ceph-mon[126480]: pgmap v21425: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 865 KiB/s wr, 24 op/s 2023-05-08T14:52:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:15 smithi133 ceph-mon[125939]: pgmap v21425: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 865 KiB/s wr, 24 op/s 2023-05-08T14:52:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:15 smithi096 ceph-mon[124666]: pgmap v21425: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 865 KiB/s wr, 24 op/s 2023-05-08T14:52:18.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:17 smithi186 ceph-mon[126480]: pgmap v21426: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 28 op/s 2023-05-08T14:52:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:17 smithi133 ceph-mon[125939]: pgmap v21426: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 28 op/s 2023-05-08T14:52:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:17 smithi096 ceph-mon[124666]: pgmap v21426: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 28 op/s 2023-05-08T14:52:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:19 smithi186 ceph-mon[126480]: pgmap v21427: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 563 KiB/s wr, 9 op/s 2023-05-08T14:52:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40078.488622 secs 2023-05-08T14:52:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40079.042210 secs 2023-05-08T14:52:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:19 smithi133 ceph-mon[125939]: pgmap v21427: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 563 KiB/s wr, 9 op/s 2023-05-08T14:52:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40078.488622 secs 2023-05-08T14:52:20.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40079.042210 secs 2023-05-08T14:52:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:19 smithi096 ceph-mon[124666]: pgmap v21427: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 563 KiB/s wr, 9 op/s 2023-05-08T14:52:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40078.488622 secs 2023-05-08T14:52:20.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40079.042210 secs 2023-05-08T14:52:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:21 smithi186 ceph-mon[126480]: pgmap v21428: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 566 KiB/s rd, 563 KiB/s wr, 12 op/s 2023-05-08T14:52:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:21 smithi133 ceph-mon[125939]: pgmap v21428: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 566 KiB/s rd, 563 KiB/s wr, 12 op/s 2023-05-08T14:52:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:21 smithi096 ceph-mon[124666]: pgmap v21428: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 566 KiB/s rd, 563 KiB/s wr, 12 op/s 2023-05-08T14:52:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:23 smithi186 ceph-mon[126480]: pgmap v21429: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 564 KiB/s rd, 562 KiB/s wr, 8 op/s 2023-05-08T14:52:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:23 smithi133 ceph-mon[125939]: pgmap v21429: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 564 KiB/s rd, 562 KiB/s wr, 8 op/s 2023-05-08T14:52:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:23 smithi096 ceph-mon[124666]: pgmap v21429: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 564 KiB/s rd, 562 KiB/s wr, 8 op/s 2023-05-08T14:52:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40083.488742 secs 2023-05-08T14:52:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40083.488742 secs 2023-05-08T14:52:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40083.488742 secs 2023-05-08T14:52:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:25 smithi186 ceph-mon[126480]: pgmap v21430: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 564 KiB/s rd, 562 KiB/s wr, 7 op/s 2023-05-08T14:52:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:25 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:52:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:25 smithi133 ceph-mon[125939]: pgmap v21430: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 564 KiB/s rd, 562 KiB/s wr, 7 op/s 2023-05-08T14:52:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:25 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:52:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:25 smithi096 ceph-mon[124666]: pgmap v21430: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 564 KiB/s rd, 562 KiB/s wr, 7 op/s 2023-05-08T14:52:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:25 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:52:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:26 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:52:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:26 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:52:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:26 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:52:27.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:26 smithi186 ceph-mon[126480]: osdmap e1416: 12 total, 12 up, 12 in 2023-05-08T14:52:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:26 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:52:27.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:26 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:52:27.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:26 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:52:27.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:26 smithi133 ceph-mon[125939]: osdmap e1416: 12 total, 12 up, 12 in 2023-05-08T14:52:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:26 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:52:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:26 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:52:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:26 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:52:27.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:26 smithi096 ceph-mon[124666]: osdmap e1416: 12 total, 12 up, 12 in 2023-05-08T14:52:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:27 smithi186 ceph-mon[126480]: pgmap v21432: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.5 MiB/s wr, 15 op/s 2023-05-08T14:52:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:27 smithi133 ceph-mon[125939]: pgmap v21432: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.5 MiB/s wr, 15 op/s 2023-05-08T14:52:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:27 smithi096 ceph-mon[124666]: pgmap v21432: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.5 MiB/s wr, 15 op/s 2023-05-08T14:52:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:29 smithi186 ceph-mon[126480]: pgmap v21433: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.5 MiB/s wr, 15 op/s 2023-05-08T14:52:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40088.488802 secs 2023-05-08T14:52:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:29 smithi133 ceph-mon[125939]: pgmap v21433: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.5 MiB/s wr, 15 op/s 2023-05-08T14:52:30.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40088.488802 secs 2023-05-08T14:52:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:29 smithi096 ceph-mon[124666]: pgmap v21433: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.5 MiB/s wr, 15 op/s 2023-05-08T14:52:30.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40088.488802 secs 2023-05-08T14:52:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:31 smithi186 ceph-mon[126480]: pgmap v21434: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.8 MiB/s wr, 15 op/s 2023-05-08T14:52:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:31 smithi133 ceph-mon[125939]: pgmap v21434: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.8 MiB/s wr, 15 op/s 2023-05-08T14:52:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:31 smithi096 ceph-mon[124666]: pgmap v21434: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.8 MiB/s wr, 15 op/s 2023-05-08T14:52:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:33 smithi186 ceph-mon[126480]: pgmap v21435: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.8 MiB/s wr, 15 op/s 2023-05-08T14:52:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:33 smithi186 ceph-mon[126480]: osdmap e1417: 12 total, 12 up, 12 in 2023-05-08T14:52:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:33 smithi133 ceph-mon[125939]: pgmap v21435: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.8 MiB/s wr, 15 op/s 2023-05-08T14:52:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:33 smithi133 ceph-mon[125939]: osdmap e1417: 12 total, 12 up, 12 in 2023-05-08T14:52:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:33 smithi096 ceph-mon[124666]: pgmap v21435: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.8 MiB/s wr, 15 op/s 2023-05-08T14:52:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:33 smithi096 ceph-mon[124666]: osdmap e1417: 12 total, 12 up, 12 in 2023-05-08T14:52:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40093.488938 secs 2023-05-08T14:52:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40093.488938 secs 2023-05-08T14:52:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40093.488938 secs 2023-05-08T14:52:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:35 smithi186 ceph-mon[126480]: pgmap v21437: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 772 KiB/s rd, 346 KiB/s wr, 6 op/s 2023-05-08T14:52:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:35 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:52:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:35 smithi133 ceph-mon[125939]: pgmap v21437: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 772 KiB/s rd, 346 KiB/s wr, 6 op/s 2023-05-08T14:52:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:35 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:52:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:35 smithi096 ceph-mon[124666]: pgmap v21437: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 772 KiB/s rd, 346 KiB/s wr, 6 op/s 2023-05-08T14:52:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:35 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:52:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:52:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:52:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:52:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:52:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:52:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:52:37.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:52:37.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:52:37.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:52:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:37 smithi186 ceph-mon[126480]: pgmap v21438: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 850 KiB/s rd, 497 KiB/s wr, 10 op/s 2023-05-08T14:52:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:37 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:52:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:37 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T14:52:38.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:37 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T14:52:38.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:37 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:52:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:37 smithi133 ceph-mon[125939]: pgmap v21438: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 850 KiB/s rd, 497 KiB/s wr, 10 op/s 2023-05-08T14:52:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:37 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:52:38.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:37 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T14:52:38.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:37 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T14:52:38.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:37 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:52:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:37 smithi096 ceph-mon[124666]: pgmap v21438: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 850 KiB/s rd, 497 KiB/s wr, 10 op/s 2023-05-08T14:52:38.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:37 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:52:38.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:37 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T14:52:38.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:37 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T14:52:38.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:37 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:52:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:39 smithi186 ceph-mon[126480]: pgmap v21439: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 850 KiB/s rd, 497 KiB/s wr, 10 op/s 2023-05-08T14:52:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40098.489066 secs 2023-05-08T14:52:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:39 smithi133 ceph-mon[125939]: pgmap v21439: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 850 KiB/s rd, 497 KiB/s wr, 10 op/s 2023-05-08T14:52:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40098.489066 secs 2023-05-08T14:52:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:39 smithi096 ceph-mon[124666]: pgmap v21439: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 850 KiB/s rd, 497 KiB/s wr, 10 op/s 2023-05-08T14:52:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40098.489066 secs 2023-05-08T14:52:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:41 smithi186 ceph-mon[126480]: pgmap v21440: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 607 KiB/s wr, 10 op/s 2023-05-08T14:52:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40100.384230 secs 2023-05-08T14:52:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:41 smithi133 ceph-mon[125939]: pgmap v21440: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 607 KiB/s wr, 10 op/s 2023-05-08T14:52:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40100.384230 secs 2023-05-08T14:52:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:41 smithi096 ceph-mon[124666]: pgmap v21440: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 607 KiB/s wr, 10 op/s 2023-05-08T14:52:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40100.384230 secs 2023-05-08T14:52:43.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:42 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:52:43.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:42 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:52:43.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:42 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:52:43.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:42 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:52:43.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:42 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:52:43.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:42 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:52:43.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:42 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:52:43.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:42 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:52:43.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:42 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:52:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:43 smithi186 ceph-mon[126480]: pgmap v21441: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 926 KiB/s wr, 10 op/s 2023-05-08T14:52:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:43 smithi133 ceph-mon[125939]: pgmap v21441: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 926 KiB/s wr, 10 op/s 2023-05-08T14:52:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:43 smithi096 ceph-mon[124666]: pgmap v21441: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 926 KiB/s wr, 10 op/s 2023-05-08T14:52:44.837 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40103.489183 secs 2023-05-08T14:52:44.837 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40104.042900 secs 2023-05-08T14:52:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40103.489183 secs 2023-05-08T14:52:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40104.042900 secs 2023-05-08T14:52:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40103.489183 secs 2023-05-08T14:52:45.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40104.042900 secs 2023-05-08T14:52:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:45 smithi186 ceph-mon[126480]: pgmap v21442: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 899 KiB/s wr, 10 op/s 2023-05-08T14:52:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:45 smithi133 ceph-mon[125939]: pgmap v21442: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 899 KiB/s wr, 10 op/s 2023-05-08T14:52:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:45 smithi096 ceph-mon[124666]: pgmap v21442: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 899 KiB/s wr, 10 op/s 2023-05-08T14:52:47.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40105.384355 secs 2023-05-08T14:52:47.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:46 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:52:47.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:46 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:52:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40105.384355 secs 2023-05-08T14:52:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:46 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:52:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:46 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:52:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40105.384355 secs 2023-05-08T14:52:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:46 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:52:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:46 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:52:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:47 smithi186 ceph-mon[126480]: pgmap v21443: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.6 MiB/s wr, 14 op/s 2023-05-08T14:52:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:47 smithi133 ceph-mon[125939]: pgmap v21443: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.6 MiB/s wr, 14 op/s 2023-05-08T14:52:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:47 smithi096 ceph-mon[124666]: pgmap v21443: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.6 MiB/s wr, 14 op/s 2023-05-08T14:52:49.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:48 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:52:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:48 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:52:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:48 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:52:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:49 smithi133 ceph-mon[125939]: pgmap v21444: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.4 MiB/s wr, 10 op/s 2023-05-08T14:52:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40108.489255 secs 2023-05-08T14:52:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:52:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:49 smithi096 ceph-mon[124666]: pgmap v21444: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.4 MiB/s wr, 10 op/s 2023-05-08T14:52:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40108.489255 secs 2023-05-08T14:52:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:52:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:49 smithi186 ceph-mon[126480]: pgmap v21444: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.4 MiB/s wr, 10 op/s 2023-05-08T14:52:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40108.489255 secs 2023-05-08T14:52:50.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:52:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:52:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:52:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:52:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:52:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:52:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:52:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:51 smithi133 ceph-mon[125939]: pgmap v21445: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.0 MiB/s wr, 16 op/s 2023-05-08T14:52:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40110.384430 secs 2023-05-08T14:52:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:51 smithi096 ceph-mon[124666]: pgmap v21445: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.0 MiB/s wr, 16 op/s 2023-05-08T14:52:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40110.384430 secs 2023-05-08T14:52:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:51 smithi186 ceph-mon[126480]: pgmap v21445: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.0 MiB/s wr, 16 op/s 2023-05-08T14:52:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40110.384430 secs 2023-05-08T14:52:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:53 smithi133 ceph-mon[125939]: pgmap v21446: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 13 op/s 2023-05-08T14:52:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:53 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:52:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:53 smithi096 ceph-mon[124666]: pgmap v21446: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 13 op/s 2023-05-08T14:52:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:53 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:52:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:53 smithi186 ceph-mon[126480]: pgmap v21446: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 13 op/s 2023-05-08T14:52:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:53 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:52:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40113.489366 secs 2023-05-08T14:52:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40113.489366 secs 2023-05-08T14:52:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40113.489366 secs 2023-05-08T14:52:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:55 smithi133 ceph-mon[125939]: pgmap v21447: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 12 op/s 2023-05-08T14:52:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:55 smithi096 ceph-mon[124666]: pgmap v21447: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 12 op/s 2023-05-08T14:52:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:55 smithi186 ceph-mon[126480]: pgmap v21447: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 12 op/s 2023-05-08T14:52:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40115.384555 secs 2023-05-08T14:52:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40115.384555 secs 2023-05-08T14:52:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40115.384555 secs 2023-05-08T14:52:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:57 smithi133 ceph-mon[125939]: pgmap v21448: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.8 MiB/s wr, 18 op/s 2023-05-08T14:52:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:57 smithi096 ceph-mon[124666]: pgmap v21448: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.8 MiB/s wr, 18 op/s 2023-05-08T14:52:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:57 smithi186 ceph-mon[126480]: pgmap v21448: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.8 MiB/s wr, 18 op/s 2023-05-08T14:53:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:59 smithi133 ceph-mon[125939]: pgmap v21449: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 12 op/s 2023-05-08T14:53:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40118.489487 secs 2023-05-08T14:53:00.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:52:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40119.043236 secs 2023-05-08T14:53:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:59 smithi096 ceph-mon[124666]: pgmap v21449: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 12 op/s 2023-05-08T14:53:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40118.489487 secs 2023-05-08T14:53:00.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:52:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40119.043236 secs 2023-05-08T14:53:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:59 smithi186 ceph-mon[126480]: pgmap v21449: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 12 op/s 2023-05-08T14:53:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40118.489487 secs 2023-05-08T14:53:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:52:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40119.043236 secs 2023-05-08T14:53:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:01 smithi133 ceph-mon[125939]: pgmap v21450: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.7 MiB/s wr, 17 op/s 2023-05-08T14:53:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:01 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:53:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:01 smithi096 ceph-mon[124666]: pgmap v21450: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.7 MiB/s wr, 17 op/s 2023-05-08T14:53:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:01 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:53:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:01 smithi186 ceph-mon[126480]: pgmap v21450: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.7 MiB/s wr, 17 op/s 2023-05-08T14:53:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:01 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:53:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:53:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:53:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:53:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:53:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:53:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:53:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:53:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:53:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:53:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:03 smithi133 ceph-mon[125939]: pgmap v21451: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T14:53:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:03 smithi096 ceph-mon[124666]: pgmap v21451: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T14:53:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:03 smithi186 ceph-mon[126480]: pgmap v21451: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T14:53:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40123.489599 secs 2023-05-08T14:53:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40123.489599 secs 2023-05-08T14:53:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40123.489599 secs 2023-05-08T14:53:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:05 smithi133 ceph-mon[125939]: pgmap v21452: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T14:53:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:05 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:53:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:05 smithi096 ceph-mon[124666]: pgmap v21452: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T14:53:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:05 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:53:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:05 smithi186 ceph-mon[126480]: pgmap v21452: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2023-05-08T14:53:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:05 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:53:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:06 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:53:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:53:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:53:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:06 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:53:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:53:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:53:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:06 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:53:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:53:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:53:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:07 smithi133 ceph-mon[125939]: pgmap v21453: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.8 MiB/s wr, 30 op/s 2023-05-08T14:53:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:07 smithi096 ceph-mon[124666]: pgmap v21453: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.8 MiB/s wr, 30 op/s 2023-05-08T14:53:08.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:07 smithi186 ceph-mon[126480]: pgmap v21453: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.8 MiB/s wr, 30 op/s 2023-05-08T14:53:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:09 smithi133 ceph-mon[125939]: pgmap v21454: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.4 MiB/s wr, 23 op/s 2023-05-08T14:53:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40128.489707 secs 2023-05-08T14:53:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:09 smithi096 ceph-mon[124666]: pgmap v21454: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.4 MiB/s wr, 23 op/s 2023-05-08T14:53:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40128.489707 secs 2023-05-08T14:53:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:09 smithi186 ceph-mon[126480]: pgmap v21454: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.4 MiB/s wr, 23 op/s 2023-05-08T14:53:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40128.489707 secs 2023-05-08T14:53:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:11 smithi133 ceph-mon[125939]: pgmap v21455: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.8 MiB/s wr, 28 op/s 2023-05-08T14:53:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:11 smithi096 ceph-mon[124666]: pgmap v21455: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.8 MiB/s wr, 28 op/s 2023-05-08T14:53:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:11 smithi186 ceph-mon[126480]: pgmap v21455: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.8 MiB/s wr, 28 op/s 2023-05-08T14:53:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:13 smithi133 ceph-mon[125939]: pgmap v21456: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.1 MiB/s wr, 23 op/s 2023-05-08T14:53:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:13 smithi096 ceph-mon[124666]: pgmap v21456: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.1 MiB/s wr, 23 op/s 2023-05-08T14:53:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:13 smithi186 ceph-mon[126480]: pgmap v21456: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.1 MiB/s wr, 23 op/s 2023-05-08T14:53:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40133.489823 secs 2023-05-08T14:53:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40133.489823 secs 2023-05-08T14:53:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40133.489823 secs 2023-05-08T14:53:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:15 smithi133 ceph-mon[125939]: pgmap v21457: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.1 MiB/s wr, 23 op/s 2023-05-08T14:53:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:15 smithi096 ceph-mon[124666]: pgmap v21457: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.1 MiB/s wr, 23 op/s 2023-05-08T14:53:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:15 smithi186 ceph-mon[126480]: pgmap v21457: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.1 MiB/s wr, 23 op/s 2023-05-08T14:53:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:16 smithi133 ceph-mon[125939]: pgmap v21458: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.1 MiB/s wr, 26 op/s 2023-05-08T14:53:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:16 smithi096 ceph-mon[124666]: pgmap v21458: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.1 MiB/s wr, 26 op/s 2023-05-08T14:53:17.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:16 smithi186 ceph-mon[126480]: pgmap v21458: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.1 MiB/s wr, 26 op/s 2023-05-08T14:53:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:19 smithi186 ceph-mon[126480]: pgmap v21459: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 386 KiB/s wr, 7 op/s 2023-05-08T14:53:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40138.489938 secs 2023-05-08T14:53:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:19 smithi133 ceph-mon[125939]: pgmap v21459: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 386 KiB/s wr, 7 op/s 2023-05-08T14:53:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40138.489938 secs 2023-05-08T14:53:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:19 smithi096 ceph-mon[124666]: pgmap v21459: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 386 KiB/s wr, 7 op/s 2023-05-08T14:53:20.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40138.489938 secs 2023-05-08T14:53:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:21 smithi186 ceph-mon[126480]: pgmap v21460: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 887 KiB/s rd, 709 KiB/s wr, 11 op/s 2023-05-08T14:53:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40140.385055 secs 2023-05-08T14:53:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:21 smithi133 ceph-mon[125939]: pgmap v21460: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 887 KiB/s rd, 709 KiB/s wr, 11 op/s 2023-05-08T14:53:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40140.385055 secs 2023-05-08T14:53:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:21 smithi096 ceph-mon[124666]: pgmap v21460: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 887 KiB/s rd, 709 KiB/s wr, 11 op/s 2023-05-08T14:53:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40140.385055 secs 2023-05-08T14:53:23.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:22 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:53:23.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:22 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:53:23.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:22 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:53:23.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:22 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:53:23.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:22 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:53:23.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:22 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:53:23.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:22 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:53:23.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:22 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:53:23.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:22 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:53:24.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:23 smithi186 ceph-mon[126480]: pgmap v21461: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 354 KiB/s wr, 7 op/s 2023-05-08T14:53:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:23 smithi133 ceph-mon[125939]: pgmap v21461: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 354 KiB/s wr, 7 op/s 2023-05-08T14:53:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:23 smithi096 ceph-mon[124666]: pgmap v21461: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 354 KiB/s wr, 7 op/s 2023-05-08T14:53:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40143.490054 secs 2023-05-08T14:53:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40144.043777 secs 2023-05-08T14:53:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40143.490054 secs 2023-05-08T14:53:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40144.043777 secs 2023-05-08T14:53:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40143.490054 secs 2023-05-08T14:53:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40144.043777 secs 2023-05-08T14:53:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:25 smithi186 ceph-mon[126480]: pgmap v21462: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 353 KiB/s wr, 6 op/s 2023-05-08T14:53:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:25 smithi133 ceph-mon[125939]: pgmap v21462: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 353 KiB/s wr, 6 op/s 2023-05-08T14:53:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:25 smithi096 ceph-mon[124666]: pgmap v21462: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 353 KiB/s wr, 6 op/s 2023-05-08T14:53:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40145.385183 secs 2023-05-08T14:53:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:26 smithi186 ceph-mon[126480]: osdmap e1418: 12 total, 12 up, 12 in 2023-05-08T14:53:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:26 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:53:27.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:26 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:53:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40145.385183 secs 2023-05-08T14:53:27.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:26 smithi133 ceph-mon[125939]: osdmap e1418: 12 total, 12 up, 12 in 2023-05-08T14:53:27.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:26 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:53:27.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:26 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:53:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40145.385183 secs 2023-05-08T14:53:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:26 smithi096 ceph-mon[124666]: osdmap e1418: 12 total, 12 up, 12 in 2023-05-08T14:53:27.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:26 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:53:27.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:26 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:53:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:27 smithi186 ceph-mon[126480]: pgmap v21464: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T14:53:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:27 smithi133 ceph-mon[125939]: pgmap v21464: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T14:53:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:27 smithi096 ceph-mon[124666]: pgmap v21464: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T14:53:29.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:28 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:53:29.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:28 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:53:29.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:28 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:53:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:29 smithi186 ceph-mon[126480]: pgmap v21465: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T14:53:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40148.490188 secs 2023-05-08T14:53:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40149.043894 secs 2023-05-08T14:53:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:29 smithi133 ceph-mon[125939]: pgmap v21465: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T14:53:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40148.490188 secs 2023-05-08T14:53:30.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40149.043894 secs 2023-05-08T14:53:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:29 smithi096 ceph-mon[124666]: pgmap v21465: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 13 op/s 2023-05-08T14:53:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40148.490188 secs 2023-05-08T14:53:30.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40149.043894 secs 2023-05-08T14:53:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:31 smithi186 ceph-mon[126480]: pgmap v21466: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 14 op/s 2023-05-08T14:53:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40150.385267 secs 2023-05-08T14:53:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:31 smithi133 ceph-mon[125939]: pgmap v21466: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 14 op/s 2023-05-08T14:53:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40150.385267 secs 2023-05-08T14:53:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:31 smithi096 ceph-mon[124666]: pgmap v21466: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 14 op/s 2023-05-08T14:53:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40150.385267 secs 2023-05-08T14:53:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:33 smithi186 ceph-mon[126480]: pgmap v21467: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1012 KiB/s rd, 1.0 MiB/s wr, 13 op/s 2023-05-08T14:53:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:33 smithi186 ceph-mon[126480]: osdmap e1419: 12 total, 12 up, 12 in 2023-05-08T14:53:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:33 smithi133 ceph-mon[125939]: pgmap v21467: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1012 KiB/s rd, 1.0 MiB/s wr, 13 op/s 2023-05-08T14:53:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:33 smithi133 ceph-mon[125939]: osdmap e1419: 12 total, 12 up, 12 in 2023-05-08T14:53:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:33 smithi096 ceph-mon[124666]: pgmap v21467: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1012 KiB/s rd, 1.0 MiB/s wr, 13 op/s 2023-05-08T14:53:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:33 smithi096 ceph-mon[124666]: osdmap e1419: 12 total, 12 up, 12 in 2023-05-08T14:53:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40153.490324 secs 2023-05-08T14:53:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40154.044013 secs 2023-05-08T14:53:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40153.490324 secs 2023-05-08T14:53:35.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40154.044013 secs 2023-05-08T14:53:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40153.490324 secs 2023-05-08T14:53:35.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40154.044013 secs 2023-05-08T14:53:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:35 smithi186 ceph-mon[126480]: pgmap v21469: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 344 KiB/s wr, 6 op/s 2023-05-08T14:53:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:35 smithi133 ceph-mon[125939]: pgmap v21469: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 344 KiB/s wr, 6 op/s 2023-05-08T14:53:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:35 smithi096 ceph-mon[124666]: pgmap v21469: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 344 KiB/s wr, 6 op/s 2023-05-08T14:53:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40155.385410 secs 2023-05-08T14:53:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:36 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:53:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40155.385410 secs 2023-05-08T14:53:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:36 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:53:37.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40155.385410 secs 2023-05-08T14:53:37.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:36 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:53:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:37 smithi186 ceph-mon[126480]: pgmap v21470: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 719 KiB/s rd, 716 KiB/s wr, 10 op/s 2023-05-08T14:53:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:37 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:53:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:37 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:53:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:37 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:53:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:37 smithi133 ceph-mon[125939]: pgmap v21470: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 719 KiB/s rd, 716 KiB/s wr, 10 op/s 2023-05-08T14:53:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:37 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:53:38.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:37 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:53:38.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:37 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:53:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:37 smithi096 ceph-mon[124666]: pgmap v21470: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 719 KiB/s rd, 716 KiB/s wr, 10 op/s 2023-05-08T14:53:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:37 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:53:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:37 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:53:38.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:37 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:53:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:38 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:53:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:38 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T14:53:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:38 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T14:53:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:38 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:53:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:38 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:53:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:38 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T14:53:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:38 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T14:53:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:38 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:53:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:38 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:53:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:38 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T14:53:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:38 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T14:53:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:38 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:53:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:39 smithi186 ceph-mon[126480]: pgmap v21471: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 719 KiB/s rd, 716 KiB/s wr, 10 op/s 2023-05-08T14:53:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40158.490461 secs 2023-05-08T14:53:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40159.044138 secs 2023-05-08T14:53:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:39 smithi133 ceph-mon[125939]: pgmap v21471: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 719 KiB/s rd, 716 KiB/s wr, 10 op/s 2023-05-08T14:53:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40158.490461 secs 2023-05-08T14:53:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40159.044138 secs 2023-05-08T14:53:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:39 smithi096 ceph-mon[124666]: pgmap v21471: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 719 KiB/s rd, 716 KiB/s wr, 10 op/s 2023-05-08T14:53:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40158.490461 secs 2023-05-08T14:53:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40159.044138 secs 2023-05-08T14:53:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:41 smithi186 ceph-mon[126480]: pgmap v21472: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 860 KiB/s wr, 9 op/s 2023-05-08T14:53:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40160.385521 secs 2023-05-08T14:53:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:41 smithi133 ceph-mon[125939]: pgmap v21472: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 860 KiB/s wr, 9 op/s 2023-05-08T14:53:42.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40160.385521 secs 2023-05-08T14:53:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:41 smithi096 ceph-mon[124666]: pgmap v21472: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 860 KiB/s wr, 9 op/s 2023-05-08T14:53:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40160.385521 secs 2023-05-08T14:53:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:43 smithi186 ceph-mon[126480]: pgmap v21473: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 860 KiB/s wr, 8 op/s 2023-05-08T14:53:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:43 smithi133 ceph-mon[125939]: pgmap v21473: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 860 KiB/s wr, 8 op/s 2023-05-08T14:53:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:43 smithi096 ceph-mon[124666]: pgmap v21473: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 860 KiB/s wr, 8 op/s 2023-05-08T14:53:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40163.490571 secs 2023-05-08T14:53:45.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40164.044272 secs 2023-05-08T14:53:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40163.490571 secs 2023-05-08T14:53:45.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40164.044272 secs 2023-05-08T14:53:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40163.490571 secs 2023-05-08T14:53:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40164.044272 secs 2023-05-08T14:53:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:45 smithi133 ceph-mon[125939]: pgmap v21474: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 422 KiB/s rd, 835 KiB/s wr, 8 op/s 2023-05-08T14:53:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:45 smithi096 ceph-mon[124666]: pgmap v21474: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 422 KiB/s rd, 835 KiB/s wr, 8 op/s 2023-05-08T14:53:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:45 smithi186 ceph-mon[126480]: pgmap v21474: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 422 KiB/s rd, 835 KiB/s wr, 8 op/s 2023-05-08T14:53:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40165.385613 secs 2023-05-08T14:53:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40165.385613 secs 2023-05-08T14:53:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40165.385613 secs 2023-05-08T14:53:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:47 smithi133 ceph-mon[125939]: pgmap v21475: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 720 KiB/s rd, 717 KiB/s wr, 10 op/s 2023-05-08T14:53:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:47 smithi096 ceph-mon[124666]: pgmap v21475: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 720 KiB/s rd, 717 KiB/s wr, 10 op/s 2023-05-08T14:53:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:47 smithi186 ceph-mon[126480]: pgmap v21475: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 720 KiB/s rd, 717 KiB/s wr, 10 op/s 2023-05-08T14:53:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:49 smithi133 ceph-mon[125939]: pgmap v21476: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 359 KiB/s rd, 357 KiB/s wr, 6 op/s 2023-05-08T14:53:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40168.490678 secs 2023-05-08T14:53:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:53:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:49 smithi096 ceph-mon[124666]: pgmap v21476: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 359 KiB/s rd, 357 KiB/s wr, 6 op/s 2023-05-08T14:53:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40168.490678 secs 2023-05-08T14:53:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:53:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:49 smithi186 ceph-mon[126480]: pgmap v21476: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 359 KiB/s rd, 357 KiB/s wr, 6 op/s 2023-05-08T14:53:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40168.490678 secs 2023-05-08T14:53:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:53:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:53:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:53:51.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:53:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:53:51.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:53:51.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:53:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:53:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:53:51.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:53:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:51 smithi133 ceph-mon[125939]: pgmap v21477: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T14:53:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40170.385704 secs 2023-05-08T14:53:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:51 smithi096 ceph-mon[124666]: pgmap v21477: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T14:53:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40170.385704 secs 2023-05-08T14:53:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:51 smithi186 ceph-mon[126480]: pgmap v21477: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T14:53:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40170.385704 secs 2023-05-08T14:53:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:53 smithi133 ceph-mon[125939]: pgmap v21478: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 748 KiB/s wr, 8 op/s 2023-05-08T14:53:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:53 smithi096 ceph-mon[124666]: pgmap v21478: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 748 KiB/s wr, 8 op/s 2023-05-08T14:53:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:53 smithi186 ceph-mon[126480]: pgmap v21478: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 748 KiB/s wr, 8 op/s 2023-05-08T14:53:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40173.490795 secs 2023-05-08T14:53:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40173.490795 secs 2023-05-08T14:53:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40173.490795 secs 2023-05-08T14:53:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:55 smithi133 ceph-mon[125939]: pgmap v21479: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 748 KiB/s wr, 8 op/s 2023-05-08T14:53:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:55 smithi096 ceph-mon[124666]: pgmap v21479: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 748 KiB/s wr, 8 op/s 2023-05-08T14:53:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:55 smithi186 ceph-mon[126480]: pgmap v21479: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 748 KiB/s wr, 8 op/s 2023-05-08T14:53:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:57 smithi133 ceph-mon[125939]: pgmap v21480: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 14 op/s 2023-05-08T14:53:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:53:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:57 smithi096 ceph-mon[124666]: pgmap v21480: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 14 op/s 2023-05-08T14:53:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:53:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:57 smithi186 ceph-mon[126480]: pgmap v21480: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 14 op/s 2023-05-08T14:53:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:53:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:58 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:53:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:53:59.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:53:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:58 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:53:59.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:53:59.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:53:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:58 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:53:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:53:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:54:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:59 smithi133 ceph-mon[125939]: pgmap v21481: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 11 op/s 2023-05-08T14:54:00.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40178.490926 secs 2023-05-08T14:54:00.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:53:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40179.044637 secs 2023-05-08T14:54:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:59 smithi096 ceph-mon[124666]: pgmap v21481: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 11 op/s 2023-05-08T14:54:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40178.490926 secs 2023-05-08T14:54:00.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:53:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40179.044637 secs 2023-05-08T14:54:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:59 smithi186 ceph-mon[126480]: pgmap v21481: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 11 op/s 2023-05-08T14:54:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40178.490926 secs 2023-05-08T14:54:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:53:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40179.044637 secs 2023-05-08T14:54:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:01 smithi133 ceph-mon[125939]: pgmap v21482: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 15 op/s 2023-05-08T14:54:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:01 smithi096 ceph-mon[124666]: pgmap v21482: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 15 op/s 2023-05-08T14:54:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:01 smithi186 ceph-mon[126480]: pgmap v21482: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 15 op/s 2023-05-08T14:54:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:54:03.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:54:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:54:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:54:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:54:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:54:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:03 smithi133 ceph-mon[125939]: pgmap v21483: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 959 KiB/s rd, 922 KiB/s wr, 11 op/s 2023-05-08T14:54:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:03 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:54:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:03 smithi096 ceph-mon[124666]: pgmap v21483: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 959 KiB/s rd, 922 KiB/s wr, 11 op/s 2023-05-08T14:54:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:03 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:54:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:03 smithi186 ceph-mon[126480]: pgmap v21483: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 959 KiB/s rd, 922 KiB/s wr, 11 op/s 2023-05-08T14:54:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:03 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:54:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40183.491018 secs 2023-05-08T14:54:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40184.044714 secs 2023-05-08T14:54:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40183.491018 secs 2023-05-08T14:54:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40184.044714 secs 2023-05-08T14:54:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40183.491018 secs 2023-05-08T14:54:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40184.044714 secs 2023-05-08T14:54:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:05 smithi133 ceph-mon[125939]: pgmap v21484: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 929 KiB/s rd, 891 KiB/s wr, 11 op/s 2023-05-08T14:54:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:05 smithi096 ceph-mon[124666]: pgmap v21484: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 929 KiB/s rd, 891 KiB/s wr, 11 op/s 2023-05-08T14:54:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:05 smithi186 ceph-mon[126480]: pgmap v21484: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 929 KiB/s rd, 891 KiB/s wr, 11 op/s 2023-05-08T14:54:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:07 smithi133 ceph-mon[125939]: pgmap v21485: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.9 MiB/s wr, 29 op/s 2023-05-08T14:54:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:07 smithi096 ceph-mon[124666]: pgmap v21485: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.9 MiB/s wr, 29 op/s 2023-05-08T14:54:08.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:07 smithi186 ceph-mon[126480]: pgmap v21485: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.9 MiB/s wr, 29 op/s 2023-05-08T14:54:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:09 smithi133 ceph-mon[125939]: pgmap v21486: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.1 MiB/s wr, 23 op/s 2023-05-08T14:54:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40188.491124 secs 2023-05-08T14:54:10.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40189.044829 secs 2023-05-08T14:54:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:09 smithi096 ceph-mon[124666]: pgmap v21486: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.1 MiB/s wr, 23 op/s 2023-05-08T14:54:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40188.491124 secs 2023-05-08T14:54:10.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40189.044829 secs 2023-05-08T14:54:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:09 smithi186 ceph-mon[126480]: pgmap v21486: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.1 MiB/s wr, 23 op/s 2023-05-08T14:54:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40188.491124 secs 2023-05-08T14:54:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40189.044829 secs 2023-05-08T14:54:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:11 smithi133 ceph-mon[125939]: pgmap v21487: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.4 MiB/s wr, 26 op/s 2023-05-08T14:54:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:11 smithi096 ceph-mon[124666]: pgmap v21487: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.4 MiB/s wr, 26 op/s 2023-05-08T14:54:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:11 smithi186 ceph-mon[126480]: pgmap v21487: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.4 MiB/s wr, 26 op/s 2023-05-08T14:54:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:13 smithi133 ceph-mon[125939]: pgmap v21488: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 22 op/s 2023-05-08T14:54:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:13 smithi096 ceph-mon[124666]: pgmap v21488: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 22 op/s 2023-05-08T14:54:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:13 smithi186 ceph-mon[126480]: pgmap v21488: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 22 op/s 2023-05-08T14:54:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40193.491246 secs 2023-05-08T14:54:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40193.491246 secs 2023-05-08T14:54:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40193.491246 secs 2023-05-08T14:54:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:15 smithi133 ceph-mon[125939]: pgmap v21489: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 22 op/s 2023-05-08T14:54:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:15 smithi096 ceph-mon[124666]: pgmap v21489: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 22 op/s 2023-05-08T14:54:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:15 smithi186 ceph-mon[126480]: pgmap v21489: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 22 op/s 2023-05-08T14:54:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:17 smithi133 ceph-mon[125939]: pgmap v21490: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.0 MiB/s wr, 30 op/s 2023-05-08T14:54:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:17 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:54:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:17 smithi096 ceph-mon[124666]: pgmap v21490: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.0 MiB/s wr, 30 op/s 2023-05-08T14:54:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:17 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:54:18.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:17 smithi186 ceph-mon[126480]: pgmap v21490: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.0 MiB/s wr, 30 op/s 2023-05-08T14:54:18.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:17 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:54:19.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:18 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:54:19.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:18 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:54:19.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:18 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:54:19.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:18 smithi133 ceph-mon[125939]: pgmap v21491: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 12 op/s 2023-05-08T14:54:19.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:18 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:54:19.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:18 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:54:19.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:18 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:54:19.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:18 smithi096 ceph-mon[124666]: pgmap v21491: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 12 op/s 2023-05-08T14:54:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:18 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:54:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:18 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:54:19.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:18 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:54:19.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:18 smithi186 ceph-mon[126480]: pgmap v21491: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 12 op/s 2023-05-08T14:54:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40198.491394 secs 2023-05-08T14:54:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40198.491394 secs 2023-05-08T14:54:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40198.491394 secs 2023-05-08T14:54:21.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:20 smithi096 ceph-mon[124666]: pgmap v21492: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 16 op/s 2023-05-08T14:54:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:20 smithi186 ceph-mon[126480]: pgmap v21492: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 16 op/s 2023-05-08T14:54:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:20 smithi133 ceph-mon[125939]: pgmap v21492: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 16 op/s 2023-05-08T14:54:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:21 smithi096 ceph-mon[124666]: osdmap e1420: 12 total, 12 up, 12 in 2023-05-08T14:54:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:21 smithi186 ceph-mon[126480]: osdmap e1420: 12 total, 12 up, 12 in 2023-05-08T14:54:22.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:21 smithi133 ceph-mon[125939]: osdmap e1420: 12 total, 12 up, 12 in 2023-05-08T14:54:23.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:22 smithi096 ceph-mon[124666]: pgmap v21494: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.0 MiB/s wr, 15 op/s 2023-05-08T14:54:23.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:22 smithi186 ceph-mon[126480]: pgmap v21494: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.0 MiB/s wr, 15 op/s 2023-05-08T14:54:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:22 smithi133 ceph-mon[125939]: pgmap v21494: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.0 MiB/s wr, 15 op/s 2023-05-08T14:54:25.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40203.491505 secs 2023-05-08T14:54:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40203.491505 secs 2023-05-08T14:54:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40203.491505 secs 2023-05-08T14:54:26.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:25 smithi186 ceph-mon[126480]: pgmap v21495: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.0 MiB/s wr, 15 op/s 2023-05-08T14:54:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:25 smithi133 ceph-mon[125939]: pgmap v21495: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.0 MiB/s wr, 15 op/s 2023-05-08T14:54:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:25 smithi096 ceph-mon[124666]: pgmap v21495: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.0 MiB/s wr, 15 op/s 2023-05-08T14:54:28.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:27 smithi186 ceph-mon[126480]: pgmap v21496: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 469 KiB/s rd, 467 KiB/s wr, 10 op/s 2023-05-08T14:54:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:27 smithi133 ceph-mon[125939]: pgmap v21496: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 469 KiB/s rd, 467 KiB/s wr, 10 op/s 2023-05-08T14:54:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:27 smithi096 ceph-mon[124666]: pgmap v21496: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 469 KiB/s rd, 467 KiB/s wr, 10 op/s 2023-05-08T14:54:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:29 smithi186 ceph-mon[126480]: pgmap v21497: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 469 KiB/s rd, 467 KiB/s wr, 10 op/s 2023-05-08T14:54:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40208.491571 secs 2023-05-08T14:54:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:29 smithi186 ceph-mon[126480]: osdmap e1421: 12 total, 12 up, 12 in 2023-05-08T14:54:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:29 smithi133 ceph-mon[125939]: pgmap v21497: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 469 KiB/s rd, 467 KiB/s wr, 10 op/s 2023-05-08T14:54:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40208.491571 secs 2023-05-08T14:54:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:29 smithi133 ceph-mon[125939]: osdmap e1421: 12 total, 12 up, 12 in 2023-05-08T14:54:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:29 smithi096 ceph-mon[124666]: pgmap v21497: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 469 KiB/s rd, 467 KiB/s wr, 10 op/s 2023-05-08T14:54:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40208.491571 secs 2023-05-08T14:54:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:29 smithi096 ceph-mon[124666]: osdmap e1421: 12 total, 12 up, 12 in 2023-05-08T14:54:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:31 smithi186 ceph-mon[126480]: pgmap v21499: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 471 KiB/s wr, 9 op/s 2023-05-08T14:54:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40210.386613 secs 2023-05-08T14:54:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:31 smithi133 ceph-mon[125939]: pgmap v21499: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 471 KiB/s wr, 9 op/s 2023-05-08T14:54:32.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40210.386613 secs 2023-05-08T14:54:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:31 smithi096 ceph-mon[124666]: pgmap v21499: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 471 KiB/s wr, 9 op/s 2023-05-08T14:54:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40210.386613 secs 2023-05-08T14:54:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:33 smithi186 ceph-mon[126480]: pgmap v21500: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 431 KiB/s rd, 429 KiB/s wr, 8 op/s 2023-05-08T14:54:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:33 smithi133 ceph-mon[125939]: pgmap v21500: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 431 KiB/s rd, 429 KiB/s wr, 8 op/s 2023-05-08T14:54:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:33 smithi096 ceph-mon[124666]: pgmap v21500: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 431 KiB/s rd, 429 KiB/s wr, 8 op/s 2023-05-08T14:54:35.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40213.491639 secs 2023-05-08T14:54:35.156 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:34 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:54:35.156 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:34 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:54:35.156 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:34 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:54:35.157 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40214.045495 secs 2023-05-08T14:54:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40213.491639 secs 2023-05-08T14:54:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:34 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:54:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:34 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:54:35.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:34 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:54:35.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40214.045495 secs 2023-05-08T14:54:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40213.491639 secs 2023-05-08T14:54:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:34 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:54:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:34 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:54:35.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:34 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:54:35.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40214.045495 secs 2023-05-08T14:54:36.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:35 smithi186 ceph-mon[126480]: pgmap v21501: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 431 KiB/s rd, 429 KiB/s wr, 8 op/s 2023-05-08T14:54:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:35 smithi133 ceph-mon[125939]: pgmap v21501: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 431 KiB/s rd, 429 KiB/s wr, 8 op/s 2023-05-08T14:54:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:35 smithi096 ceph-mon[124666]: pgmap v21501: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 431 KiB/s rd, 429 KiB/s wr, 8 op/s 2023-05-08T14:54:37.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40215.386733 secs 2023-05-08T14:54:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40215.386733 secs 2023-05-08T14:54:37.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40215.386733 secs 2023-05-08T14:54:38.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:37 smithi186 ceph-mon[126480]: pgmap v21502: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 863 KiB/s rd, 861 KiB/s wr, 10 op/s 2023-05-08T14:54:38.132 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:37 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:54:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:37 smithi133 ceph-mon[125939]: pgmap v21502: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 863 KiB/s rd, 861 KiB/s wr, 10 op/s 2023-05-08T14:54:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:37 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:54:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:37 smithi096 ceph-mon[124666]: pgmap v21502: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 863 KiB/s rd, 861 KiB/s wr, 10 op/s 2023-05-08T14:54:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:37 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:54:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:38 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:54:39.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:38 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:54:39.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:54:39.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:54:39.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:38 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:54:39.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:54:39.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:38 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T14:54:39.121 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:38 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T14:54:39.122 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:38 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:54:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:38 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:54:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:38 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:54:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:54:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:54:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:38 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:54:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:54:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:38 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T14:54:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:38 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T14:54:39.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:38 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:54:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:38 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:54:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:38 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:54:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:54:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:54:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:38 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:54:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:54:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:38 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T14:54:39.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:38 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T14:54:39.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:38 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:54:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:39 smithi186 ceph-mon[126480]: pgmap v21503: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 863 KiB/s rd, 861 KiB/s wr, 10 op/s 2023-05-08T14:54:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40218.491760 secs 2023-05-08T14:54:40.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40219.045592 secs 2023-05-08T14:54:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:39 smithi133 ceph-mon[125939]: pgmap v21503: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 863 KiB/s rd, 861 KiB/s wr, 10 op/s 2023-05-08T14:54:40.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40218.491760 secs 2023-05-08T14:54:40.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40219.045592 secs 2023-05-08T14:54:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:39 smithi096 ceph-mon[124666]: pgmap v21503: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 863 KiB/s rd, 861 KiB/s wr, 10 op/s 2023-05-08T14:54:40.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40218.491760 secs 2023-05-08T14:54:40.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40219.045592 secs 2023-05-08T14:54:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:41 smithi186 ceph-mon[126480]: pgmap v21504: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 953 KiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T14:54:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40220.386868 secs 2023-05-08T14:54:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:41 smithi133 ceph-mon[125939]: pgmap v21504: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 953 KiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T14:54:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40220.386868 secs 2023-05-08T14:54:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:41 smithi096 ceph-mon[124666]: pgmap v21504: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 953 KiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T14:54:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40220.386868 secs 2023-05-08T14:54:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:43 smithi186 ceph-mon[126480]: pgmap v21505: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 896 KiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T14:54:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:43 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:54:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:43 smithi133 ceph-mon[125939]: pgmap v21505: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 896 KiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T14:54:44.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:43 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:54:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:43 smithi096 ceph-mon[124666]: pgmap v21505: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 896 KiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T14:54:44.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:43 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:54:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40223.491871 secs 2023-05-08T14:54:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40224.045706 secs 2023-05-08T14:54:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40223.491871 secs 2023-05-08T14:54:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40224.045706 secs 2023-05-08T14:54:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40223.491871 secs 2023-05-08T14:54:45.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40224.045706 secs 2023-05-08T14:54:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:45 smithi186 ceph-mon[126480]: pgmap v21506: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 896 KiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T14:54:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:45 smithi133 ceph-mon[125939]: pgmap v21506: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 896 KiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T14:54:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:45 smithi096 ceph-mon[124666]: pgmap v21506: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 896 KiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T14:54:47.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:46 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40225.387006 secs 2023-05-08T14:54:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:46 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40225.387006 secs 2023-05-08T14:54:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:46 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40225.387006 secs 2023-05-08T14:54:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:47 smithi186 ceph-mon[126480]: pgmap v21507: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 14 op/s 2023-05-08T14:54:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:47 smithi133 ceph-mon[125939]: pgmap v21507: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 14 op/s 2023-05-08T14:54:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:47 smithi096 ceph-mon[124666]: pgmap v21507: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 14 op/s 2023-05-08T14:54:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:49 smithi186 ceph-mon[126480]: pgmap v21508: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 9 op/s 2023-05-08T14:54:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40228.492005 secs 2023-05-08T14:54:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40229.045838 secs 2023-05-08T14:54:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:49 smithi133 ceph-mon[125939]: pgmap v21508: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 9 op/s 2023-05-08T14:54:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40228.492005 secs 2023-05-08T14:54:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40229.045838 secs 2023-05-08T14:54:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:49 smithi096 ceph-mon[124666]: pgmap v21508: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 9 op/s 2023-05-08T14:54:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40228.492005 secs 2023-05-08T14:54:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40229.045838 secs 2023-05-08T14:54:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:51 smithi186 ceph-mon[126480]: pgmap v21509: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2023-05-08T14:54:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40230.387121 secs 2023-05-08T14:54:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:51 smithi133 ceph-mon[125939]: pgmap v21509: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2023-05-08T14:54:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40230.387121 secs 2023-05-08T14:54:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:51 smithi096 ceph-mon[124666]: pgmap v21509: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2023-05-08T14:54:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40230.387121 secs 2023-05-08T14:54:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:53 smithi186 ceph-mon[126480]: pgmap v21510: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 936 KiB/s wr, 9 op/s 2023-05-08T14:54:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:53 smithi133 ceph-mon[125939]: pgmap v21510: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 936 KiB/s wr, 9 op/s 2023-05-08T14:54:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:53 smithi096 ceph-mon[124666]: pgmap v21510: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 936 KiB/s wr, 9 op/s 2023-05-08T14:54:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40233.492146 secs 2023-05-08T14:54:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40233.492146 secs 2023-05-08T14:54:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40233.492146 secs 2023-05-08T14:54:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:55 smithi133 ceph-mon[125939]: pgmap v21511: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 936 KiB/s wr, 8 op/s 2023-05-08T14:54:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:55 smithi096 ceph-mon[124666]: pgmap v21511: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 936 KiB/s wr, 8 op/s 2023-05-08T14:54:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:55 smithi186 ceph-mon[126480]: pgmap v21511: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 936 KiB/s wr, 8 op/s 2023-05-08T14:54:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40235.387240 secs 2023-05-08T14:54:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40235.387240 secs 2023-05-08T14:54:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40235.387240 secs 2023-05-08T14:54:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:57 smithi133 ceph-mon[125939]: pgmap v21512: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.4 MiB/s wr, 14 op/s 2023-05-08T14:54:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:54:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:57 smithi096 ceph-mon[124666]: pgmap v21512: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.4 MiB/s wr, 14 op/s 2023-05-08T14:54:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:54:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:57 smithi186 ceph-mon[126480]: pgmap v21512: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.4 MiB/s wr, 14 op/s 2023-05-08T14:54:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:54:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:58 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:54:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:54:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:54:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:58 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:54:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:54:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:54:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:58 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:54:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:54:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:55:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:59 smithi133 ceph-mon[125939]: pgmap v21513: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1019 KiB/s rd, 1.9 MiB/s wr, 10 op/s 2023-05-08T14:55:00.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40238.492252 secs 2023-05-08T14:55:00.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:54:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40239.046088 secs 2023-05-08T14:55:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:59 smithi096 ceph-mon[124666]: pgmap v21513: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1019 KiB/s rd, 1.9 MiB/s wr, 10 op/s 2023-05-08T14:55:00.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40238.492252 secs 2023-05-08T14:55:00.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:54:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40239.046088 secs 2023-05-08T14:55:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:59 smithi186 ceph-mon[126480]: pgmap v21513: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1019 KiB/s rd, 1.9 MiB/s wr, 10 op/s 2023-05-08T14:55:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40238.492252 secs 2023-05-08T14:55:00.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:54:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40239.046088 secs 2023-05-08T14:55:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:01 smithi133 ceph-mon[125939]: pgmap v21514: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.0 MiB/s wr, 17 op/s 2023-05-08T14:55:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:01 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:55:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:01 smithi096 ceph-mon[124666]: pgmap v21514: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.0 MiB/s wr, 17 op/s 2023-05-08T14:55:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:01 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:55:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:01 smithi186 ceph-mon[126480]: pgmap v21514: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.0 MiB/s wr, 17 op/s 2023-05-08T14:55:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:01 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:55:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:55:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:55:03.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:55:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:55:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:55:03.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:55:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:55:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:55:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:55:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:03 smithi133 ceph-mon[125939]: pgmap v21515: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.6 MiB/s wr, 14 op/s 2023-05-08T14:55:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:03 smithi096 ceph-mon[124666]: pgmap v21515: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.6 MiB/s wr, 14 op/s 2023-05-08T14:55:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:03 smithi186 ceph-mon[126480]: pgmap v21515: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.6 MiB/s wr, 14 op/s 2023-05-08T14:55:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40243.492384 secs 2023-05-08T14:55:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40243.492384 secs 2023-05-08T14:55:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40243.492384 secs 2023-05-08T14:55:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:05 smithi133 ceph-mon[125939]: pgmap v21516: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.6 MiB/s wr, 13 op/s 2023-05-08T14:55:06.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:05 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:55:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:05 smithi096 ceph-mon[124666]: pgmap v21516: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.6 MiB/s wr, 13 op/s 2023-05-08T14:55:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:05 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:55:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:05 smithi186 ceph-mon[126480]: pgmap v21516: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.6 MiB/s wr, 13 op/s 2023-05-08T14:55:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:05 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:55:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:06 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:55:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:55:07.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:55:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:06 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:55:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:55:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:55:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:06 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:55:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:55:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:55:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:07 smithi133 ceph-mon[125939]: pgmap v21517: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.1 MiB/s wr, 32 op/s 2023-05-08T14:55:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:07 smithi096 ceph-mon[124666]: pgmap v21517: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.1 MiB/s wr, 32 op/s 2023-05-08T14:55:08.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:07 smithi186 ceph-mon[126480]: pgmap v21517: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.1 MiB/s wr, 32 op/s 2023-05-08T14:55:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:09 smithi133 ceph-mon[125939]: pgmap v21518: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 1.6 MiB/s wr, 26 op/s 2023-05-08T14:55:10.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40248.492504 secs 2023-05-08T14:55:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:09 smithi096 ceph-mon[124666]: pgmap v21518: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 1.6 MiB/s wr, 26 op/s 2023-05-08T14:55:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40248.492504 secs 2023-05-08T14:55:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:09 smithi186 ceph-mon[126480]: pgmap v21518: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 1.6 MiB/s wr, 26 op/s 2023-05-08T14:55:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40248.492504 secs 2023-05-08T14:55:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:11 smithi133 ceph-mon[125939]: pgmap v21519: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.9 MiB/s wr, 31 op/s 2023-05-08T14:55:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:11 smithi096 ceph-mon[124666]: pgmap v21519: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.9 MiB/s wr, 31 op/s 2023-05-08T14:55:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:11 smithi186 ceph-mon[126480]: pgmap v21519: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.9 MiB/s wr, 31 op/s 2023-05-08T14:55:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:13 smithi133 ceph-mon[125939]: pgmap v21520: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 754 KiB/s wr, 24 op/s 2023-05-08T14:55:14.270 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:13 smithi096 ceph-mon[124666]: pgmap v21520: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 754 KiB/s wr, 24 op/s 2023-05-08T14:55:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:13 smithi186 ceph-mon[126480]: pgmap v21520: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 754 KiB/s wr, 24 op/s 2023-05-08T14:55:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40253.492580 secs 2023-05-08T14:55:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40253.492580 secs 2023-05-08T14:55:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40253.492580 secs 2023-05-08T14:55:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:15 smithi133 ceph-mon[125939]: pgmap v21521: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 753 KiB/s wr, 23 op/s 2023-05-08T14:55:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:15 smithi096 ceph-mon[124666]: pgmap v21521: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 753 KiB/s wr, 23 op/s 2023-05-08T14:55:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:15 smithi186 ceph-mon[126480]: pgmap v21521: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 753 KiB/s wr, 23 op/s 2023-05-08T14:55:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:17 smithi133 ceph-mon[125939]: pgmap v21522: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.3 MiB/s wr, 28 op/s 2023-05-08T14:55:18.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:17 smithi096 ceph-mon[124666]: pgmap v21522: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.3 MiB/s wr, 28 op/s 2023-05-08T14:55:18.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:17 smithi186 ceph-mon[126480]: pgmap v21522: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.3 MiB/s wr, 28 op/s 2023-05-08T14:55:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:19 smithi133 ceph-mon[125939]: pgmap v21523: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 714 KiB/s rd, 853 KiB/s wr, 9 op/s 2023-05-08T14:55:20.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40258.492654 secs 2023-05-08T14:55:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:19 smithi096 ceph-mon[124666]: pgmap v21523: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 714 KiB/s rd, 853 KiB/s wr, 9 op/s 2023-05-08T14:55:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40258.492654 secs 2023-05-08T14:55:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:19 smithi186 ceph-mon[126480]: pgmap v21523: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 714 KiB/s rd, 853 KiB/s wr, 9 op/s 2023-05-08T14:55:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40258.492654 secs 2023-05-08T14:55:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:21 smithi133 ceph-mon[125939]: pgmap v21524: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.0 MiB/s wr, 13 op/s 2023-05-08T14:55:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:21 smithi096 ceph-mon[124666]: pgmap v21524: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.0 MiB/s wr, 13 op/s 2023-05-08T14:55:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:21 smithi186 ceph-mon[126480]: pgmap v21524: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.0 MiB/s wr, 13 op/s 2023-05-08T14:55:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:23 smithi133 ceph-mon[125939]: pgmap v21525: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 769 KiB/s wr, 10 op/s 2023-05-08T14:55:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:23 smithi096 ceph-mon[124666]: pgmap v21525: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 769 KiB/s wr, 10 op/s 2023-05-08T14:55:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:23 smithi186 ceph-mon[126480]: pgmap v21525: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 769 KiB/s wr, 10 op/s 2023-05-08T14:55:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40263.492692 secs 2023-05-08T14:55:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40264.046539 secs 2023-05-08T14:55:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40263.492692 secs 2023-05-08T14:55:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40264.046539 secs 2023-05-08T14:55:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40263.492692 secs 2023-05-08T14:55:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40264.046539 secs 2023-05-08T14:55:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:25 smithi133 ceph-mon[125939]: pgmap v21526: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 769 KiB/s wr, 9 op/s 2023-05-08T14:55:26.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40265.388001 secs 2023-05-08T14:55:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:25 smithi096 ceph-mon[124666]: pgmap v21526: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 769 KiB/s wr, 9 op/s 2023-05-08T14:55:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40265.388001 secs 2023-05-08T14:55:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:25 smithi186 ceph-mon[126480]: pgmap v21526: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 769 KiB/s wr, 9 op/s 2023-05-08T14:55:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40265.388001 secs 2023-05-08T14:55:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:26 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:55:27.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:26 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:55:27.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:26 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:55:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:26 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:55:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:26 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:55:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:26 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:55:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:26 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:55:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:26 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:55:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:26 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:55:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:27 smithi133 ceph-mon[125939]: pgmap v21527: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 1.7 MiB/s wr, 18 op/s 2023-05-08T14:55:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:27 smithi096 ceph-mon[124666]: pgmap v21527: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 1.7 MiB/s wr, 18 op/s 2023-05-08T14:55:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:27 smithi186 ceph-mon[126480]: pgmap v21527: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 1.7 MiB/s wr, 18 op/s 2023-05-08T14:55:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:29 smithi186 ceph-mon[126480]: pgmap v21528: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T14:55:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40268.492772 secs 2023-05-08T14:55:30.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40269.046664 secs 2023-05-08T14:55:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:29 smithi133 ceph-mon[125939]: pgmap v21528: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T14:55:30.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40268.492772 secs 2023-05-08T14:55:30.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40269.046664 secs 2023-05-08T14:55:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:29 smithi096 ceph-mon[124666]: pgmap v21528: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T14:55:30.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40268.492772 secs 2023-05-08T14:55:30.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40269.046664 secs 2023-05-08T14:55:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:30 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:55:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:30 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:55:31.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:30 smithi096 ceph-mon[124666]: pgmap v21529: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.2 MiB/s wr, 17 op/s 2023-05-08T14:55:31.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40270.388074 secs 2023-05-08T14:55:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:30 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:55:31.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:30 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:55:31.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:30 smithi186 ceph-mon[126480]: pgmap v21529: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.2 MiB/s wr, 17 op/s 2023-05-08T14:55:31.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40270.388074 secs 2023-05-08T14:55:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:30 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:55:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:30 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:55:31.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:30 smithi133 ceph-mon[125939]: pgmap v21529: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.2 MiB/s wr, 17 op/s 2023-05-08T14:55:31.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40270.388074 secs 2023-05-08T14:55:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:31 smithi096 ceph-mon[124666]: osdmap e1422: 12 total, 12 up, 12 in 2023-05-08T14:55:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:31 smithi186 ceph-mon[126480]: osdmap e1422: 12 total, 12 up, 12 in 2023-05-08T14:55:32.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:31 smithi133 ceph-mon[125939]: osdmap e1422: 12 total, 12 up, 12 in 2023-05-08T14:55:33.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:32 smithi096 ceph-mon[124666]: pgmap v21531: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.4 MiB/s wr, 17 op/s 2023-05-08T14:55:33.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:33 smithi186 ceph-mon[126480]: pgmap v21531: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.4 MiB/s wr, 17 op/s 2023-05-08T14:55:33.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:32 smithi133 ceph-mon[125939]: pgmap v21531: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.4 MiB/s wr, 17 op/s 2023-05-08T14:55:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:33 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:55:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:34 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:55:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:34 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:55:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40273.492909 secs 2023-05-08T14:55:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:35 smithi186 ceph-mon[126480]: pgmap v21532: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.4 MiB/s wr, 17 op/s 2023-05-08T14:55:35.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40274.046726 secs 2023-05-08T14:55:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40273.492909 secs 2023-05-08T14:55:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:35 smithi133 ceph-mon[125939]: pgmap v21532: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.4 MiB/s wr, 17 op/s 2023-05-08T14:55:35.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40274.046726 secs 2023-05-08T14:55:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40273.492909 secs 2023-05-08T14:55:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:35 smithi096 ceph-mon[124666]: pgmap v21532: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.4 MiB/s wr, 17 op/s 2023-05-08T14:55:35.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40274.046726 secs 2023-05-08T14:55:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40275.388170 secs 2023-05-08T14:55:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40275.388170 secs 2023-05-08T14:55:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40275.388170 secs 2023-05-08T14:55:37.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:37 smithi186 ceph-mon[126480]: pgmap v21533: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 647 KiB/s rd, 645 KiB/s wr, 12 op/s 2023-05-08T14:55:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:37 smithi133 ceph-mon[125939]: pgmap v21533: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 647 KiB/s rd, 645 KiB/s wr, 12 op/s 2023-05-08T14:55:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:37 smithi096 ceph-mon[124666]: pgmap v21533: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 647 KiB/s rd, 645 KiB/s wr, 12 op/s 2023-05-08T14:55:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:38 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:55:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:38 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:55:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:38 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:55:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:39 smithi186 ceph-mon[126480]: pgmap v21534: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 647 KiB/s rd, 645 KiB/s wr, 12 op/s 2023-05-08T14:55:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40278.493000 secs 2023-05-08T14:55:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:39 smithi186 ceph-mon[126480]: osdmap e1423: 12 total, 12 up, 12 in 2023-05-08T14:55:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40279.046833 secs 2023-05-08T14:55:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:39 smithi133 ceph-mon[125939]: pgmap v21534: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 647 KiB/s rd, 645 KiB/s wr, 12 op/s 2023-05-08T14:55:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40278.493000 secs 2023-05-08T14:55:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:39 smithi133 ceph-mon[125939]: osdmap e1423: 12 total, 12 up, 12 in 2023-05-08T14:55:40.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40279.046833 secs 2023-05-08T14:55:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:39 smithi096 ceph-mon[124666]: pgmap v21534: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 647 KiB/s rd, 645 KiB/s wr, 12 op/s 2023-05-08T14:55:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40278.493000 secs 2023-05-08T14:55:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:39 smithi096 ceph-mon[124666]: osdmap e1423: 12 total, 12 up, 12 in 2023-05-08T14:55:40.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40279.046833 secs 2023-05-08T14:55:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:41 smithi186 ceph-mon[126480]: pgmap v21536: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 671 KiB/s rd, 668 KiB/s wr, 9 op/s 2023-05-08T14:55:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40280.388241 secs 2023-05-08T14:55:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:55:42.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:55:42.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:55:42.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:55:42.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:55:42.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:55:42.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:55:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:41 smithi133 ceph-mon[125939]: pgmap v21536: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 671 KiB/s rd, 668 KiB/s wr, 9 op/s 2023-05-08T14:55:42.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40280.388241 secs 2023-05-08T14:55:42.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:55:42.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:55:42.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:55:42.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:55:42.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:55:42.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:55:42.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:55:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:41 smithi096 ceph-mon[124666]: pgmap v21536: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 671 KiB/s rd, 668 KiB/s wr, 9 op/s 2023-05-08T14:55:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40280.388241 secs 2023-05-08T14:55:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:55:42.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:55:42.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:55:42.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:55:42.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:55:42.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:55:42.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:55:43.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:42 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:55:43.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:42 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T14:55:43.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:42 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T14:55:43.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:42 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:55:43.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:42 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:55:43.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:42 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T14:55:43.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:42 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T14:55:43.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:42 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:55:43.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:42 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:55:43.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:42 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T14:55:43.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:42 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T14:55:43.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:42 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:55:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:43 smithi186 ceph-mon[126480]: pgmap v21537: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 611 KiB/s rd, 609 KiB/s wr, 9 op/s 2023-05-08T14:55:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:43 smithi133 ceph-mon[125939]: pgmap v21537: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 611 KiB/s rd, 609 KiB/s wr, 9 op/s 2023-05-08T14:55:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:43 smithi096 ceph-mon[124666]: pgmap v21537: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 611 KiB/s rd, 609 KiB/s wr, 9 op/s 2023-05-08T14:55:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40283.493120 secs 2023-05-08T14:55:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40284.046962 secs 2023-05-08T14:55:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40283.493120 secs 2023-05-08T14:55:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40284.046962 secs 2023-05-08T14:55:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40283.493120 secs 2023-05-08T14:55:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40284.046962 secs 2023-05-08T14:55:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:45 smithi186 ceph-mon[126480]: pgmap v21538: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 611 KiB/s rd, 609 KiB/s wr, 9 op/s 2023-05-08T14:55:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:45 smithi133 ceph-mon[125939]: pgmap v21538: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 611 KiB/s rd, 609 KiB/s wr, 9 op/s 2023-05-08T14:55:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:45 smithi096 ceph-mon[124666]: pgmap v21538: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 611 KiB/s rd, 609 KiB/s wr, 9 op/s 2023-05-08T14:55:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:47 smithi186 ceph-mon[126480]: pgmap v21539: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 217 KiB/s wr, 6 op/s 2023-05-08T14:55:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:47 smithi133 ceph-mon[125939]: pgmap v21539: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 217 KiB/s wr, 6 op/s 2023-05-08T14:55:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:47 smithi096 ceph-mon[124666]: pgmap v21539: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 217 KiB/s wr, 6 op/s 2023-05-08T14:55:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:49 smithi186 ceph-mon[126480]: pgmap v21540: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 217 KiB/s wr, 6 op/s 2023-05-08T14:55:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40288.493260 secs 2023-05-08T14:55:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:55:50.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40289.047116 secs 2023-05-08T14:55:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:49 smithi133 ceph-mon[125939]: pgmap v21540: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 217 KiB/s wr, 6 op/s 2023-05-08T14:55:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40288.493260 secs 2023-05-08T14:55:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:55:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40289.047116 secs 2023-05-08T14:55:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:49 smithi096 ceph-mon[124666]: pgmap v21540: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 217 KiB/s wr, 6 op/s 2023-05-08T14:55:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40288.493260 secs 2023-05-08T14:55:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:55:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40289.047116 secs 2023-05-08T14:55:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:55:51.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:55:51.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:55:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:55:51.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:55:51.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:55:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:55:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:55:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:55:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:51 smithi186 ceph-mon[126480]: pgmap v21541: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 386 KiB/s rd, 383 KiB/s wr, 9 op/s 2023-05-08T14:55:52.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40290.388493 secs 2023-05-08T14:55:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:51 smithi133 ceph-mon[125939]: pgmap v21541: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 386 KiB/s rd, 383 KiB/s wr, 9 op/s 2023-05-08T14:55:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40290.388493 secs 2023-05-08T14:55:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:51 smithi096 ceph-mon[124666]: pgmap v21541: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 386 KiB/s rd, 383 KiB/s wr, 9 op/s 2023-05-08T14:55:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40290.388493 secs 2023-05-08T14:55:54.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:53 smithi186 ceph-mon[126480]: pgmap v21542: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 179 KiB/s wr, 6 op/s 2023-05-08T14:55:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:53 smithi133 ceph-mon[125939]: pgmap v21542: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 179 KiB/s wr, 6 op/s 2023-05-08T14:55:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:53 smithi096 ceph-mon[124666]: pgmap v21542: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 179 KiB/s wr, 6 op/s 2023-05-08T14:55:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40293.493382 secs 2023-05-08T14:55:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:54 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:55:55.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:54 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:55:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40293.493382 secs 2023-05-08T14:55:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:54 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:55:55.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:54 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:55:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40293.493382 secs 2023-05-08T14:55:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:54 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:55:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:54 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:55:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:55 smithi133 ceph-mon[125939]: pgmap v21543: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 179 KiB/s wr, 6 op/s 2023-05-08T14:55:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:55 smithi096 ceph-mon[124666]: pgmap v21543: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 179 KiB/s wr, 6 op/s 2023-05-08T14:55:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:55 smithi186 ceph-mon[126480]: pgmap v21543: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 179 KiB/s wr, 6 op/s 2023-05-08T14:55:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40295.388610 secs 2023-05-08T14:55:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40295.388610 secs 2023-05-08T14:55:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40295.388610 secs 2023-05-08T14:55:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:57 smithi133 ceph-mon[125939]: pgmap v21544: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 756 KiB/s rd, 753 KiB/s wr, 10 op/s 2023-05-08T14:55:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:55:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:57 smithi096 ceph-mon[124666]: pgmap v21544: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 756 KiB/s rd, 753 KiB/s wr, 10 op/s 2023-05-08T14:55:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:55:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:57 smithi186 ceph-mon[126480]: pgmap v21544: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 756 KiB/s rd, 753 KiB/s wr, 10 op/s 2023-05-08T14:55:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:55:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:58 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:55:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:55:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:55:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:58 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:55:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:55:59.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:55:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:58 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:55:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:55:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:56:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:59 smithi133 ceph-mon[125939]: pgmap v21545: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 755 KiB/s rd, 753 KiB/s wr, 7 op/s 2023-05-08T14:56:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:55:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40298.493494 secs 2023-05-08T14:56:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:59 smithi096 ceph-mon[124666]: pgmap v21545: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 755 KiB/s rd, 753 KiB/s wr, 7 op/s 2023-05-08T14:56:00.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:55:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40298.493494 secs 2023-05-08T14:56:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:59 smithi186 ceph-mon[126480]: pgmap v21545: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 755 KiB/s rd, 753 KiB/s wr, 7 op/s 2023-05-08T14:56:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:55:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40298.493494 secs 2023-05-08T14:56:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:01 smithi133 ceph-mon[125939]: pgmap v21546: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2023-05-08T14:56:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40300.388733 secs 2023-05-08T14:56:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:01 smithi096 ceph-mon[124666]: pgmap v21546: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2023-05-08T14:56:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40300.388733 secs 2023-05-08T14:56:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:01 smithi186 ceph-mon[126480]: pgmap v21546: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2023-05-08T14:56:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40300.388733 secs 2023-05-08T14:56:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:03 smithi133 ceph-mon[125939]: pgmap v21547: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T14:56:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:03 smithi096 ceph-mon[124666]: pgmap v21547: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T14:56:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:03 smithi186 ceph-mon[126480]: pgmap v21547: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T14:56:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40303.493604 secs 2023-05-08T14:56:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40304.047512 secs 2023-05-08T14:56:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40303.493604 secs 2023-05-08T14:56:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40304.047512 secs 2023-05-08T14:56:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40303.493604 secs 2023-05-08T14:56:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40304.047512 secs 2023-05-08T14:56:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:05 smithi133 ceph-mon[125939]: pgmap v21548: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T14:56:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:05 smithi096 ceph-mon[124666]: pgmap v21548: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T14:56:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:05 smithi186 ceph-mon[126480]: pgmap v21548: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T14:56:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:06 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:56:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:56:07.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:56:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:06 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:56:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:56:07.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:56:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:06 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:56:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:56:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:56:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:07 smithi133 ceph-mon[125939]: pgmap v21549: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 28 op/s 2023-05-08T14:56:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:07 smithi096 ceph-mon[124666]: pgmap v21549: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 28 op/s 2023-05-08T14:56:08.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:07 smithi186 ceph-mon[126480]: pgmap v21549: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 28 op/s 2023-05-08T14:56:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:09 smithi133 ceph-mon[125939]: pgmap v21550: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 23 op/s 2023-05-08T14:56:10.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40308.493710 secs 2023-05-08T14:56:10.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:09 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:56:10.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40309.047612 secs 2023-05-08T14:56:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:09 smithi096 ceph-mon[124666]: pgmap v21550: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 23 op/s 2023-05-08T14:56:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40308.493710 secs 2023-05-08T14:56:10.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:09 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:56:10.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40309.047612 secs 2023-05-08T14:56:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:09 smithi186 ceph-mon[126480]: pgmap v21550: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 23 op/s 2023-05-08T14:56:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40308.493710 secs 2023-05-08T14:56:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:09 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:56:10.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40309.047612 secs 2023-05-08T14:56:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:10 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:56:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:10 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:56:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:10 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:56:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:10 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:56:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:10 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:56:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:10 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:56:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:11 smithi133 ceph-mon[125939]: pgmap v21551: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 27 op/s 2023-05-08T14:56:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:11 smithi096 ceph-mon[124666]: pgmap v21551: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 27 op/s 2023-05-08T14:56:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:11 smithi186 ceph-mon[126480]: pgmap v21551: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 27 op/s 2023-05-08T14:56:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:13 smithi133 ceph-mon[125939]: pgmap v21552: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 678 KiB/s rd, 691 KiB/s wr, 22 op/s 2023-05-08T14:56:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:13 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:56:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:13 smithi096 ceph-mon[124666]: pgmap v21552: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 678 KiB/s rd, 691 KiB/s wr, 22 op/s 2023-05-08T14:56:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:13 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:56:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:13 smithi186 ceph-mon[126480]: pgmap v21552: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 678 KiB/s rd, 691 KiB/s wr, 22 op/s 2023-05-08T14:56:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:13 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:56:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40313.493791 secs 2023-05-08T14:56:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40314.047730 secs 2023-05-08T14:56:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40313.493791 secs 2023-05-08T14:56:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40314.047730 secs 2023-05-08T14:56:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40313.493791 secs 2023-05-08T14:56:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40314.047730 secs 2023-05-08T14:56:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:15 smithi133 ceph-mon[125939]: pgmap v21553: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 678 KiB/s rd, 691 KiB/s wr, 22 op/s 2023-05-08T14:56:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:15 smithi096 ceph-mon[124666]: pgmap v21553: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 678 KiB/s rd, 691 KiB/s wr, 22 op/s 2023-05-08T14:56:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:15 smithi186 ceph-mon[126480]: pgmap v21553: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 678 KiB/s rd, 691 KiB/s wr, 22 op/s 2023-05-08T14:56:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:17 smithi133 ceph-mon[125939]: pgmap v21554: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 25 op/s 2023-05-08T14:56:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:17 smithi096 ceph-mon[124666]: pgmap v21554: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 25 op/s 2023-05-08T14:56:18.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:17 smithi186 ceph-mon[126480]: pgmap v21554: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 25 op/s 2023-05-08T14:56:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:19 smithi133 ceph-mon[125939]: pgmap v21555: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 573 KiB/s rd, 571 KiB/s wr, 7 op/s 2023-05-08T14:56:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40318.493927 secs 2023-05-08T14:56:20.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40319.047860 secs 2023-05-08T14:56:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:19 smithi096 ceph-mon[124666]: pgmap v21555: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 573 KiB/s rd, 571 KiB/s wr, 7 op/s 2023-05-08T14:56:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40318.493927 secs 2023-05-08T14:56:20.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40319.047860 secs 2023-05-08T14:56:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:19 smithi186 ceph-mon[126480]: pgmap v21555: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 573 KiB/s rd, 571 KiB/s wr, 7 op/s 2023-05-08T14:56:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40318.493927 secs 2023-05-08T14:56:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40319.047860 secs 2023-05-08T14:56:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:21 smithi133 ceph-mon[125939]: pgmap v21556: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 574 KiB/s rd, 571 KiB/s wr, 11 op/s 2023-05-08T14:56:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:21 smithi096 ceph-mon[124666]: pgmap v21556: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 574 KiB/s rd, 571 KiB/s wr, 11 op/s 2023-05-08T14:56:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:21 smithi186 ceph-mon[126480]: pgmap v21556: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 574 KiB/s rd, 571 KiB/s wr, 11 op/s 2023-05-08T14:56:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:23 smithi133 ceph-mon[125939]: pgmap v21557: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 572 KiB/s rd, 569 KiB/s wr, 7 op/s 2023-05-08T14:56:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:23 smithi096 ceph-mon[124666]: pgmap v21557: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 572 KiB/s rd, 569 KiB/s wr, 7 op/s 2023-05-08T14:56:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:23 smithi186 ceph-mon[126480]: pgmap v21557: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 572 KiB/s rd, 569 KiB/s wr, 7 op/s 2023-05-08T14:56:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40323.494065 secs 2023-05-08T14:56:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40323.494065 secs 2023-05-08T14:56:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40323.494065 secs 2023-05-08T14:56:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:25 smithi133 ceph-mon[125939]: pgmap v21558: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 572 KiB/s rd, 569 KiB/s wr, 7 op/s 2023-05-08T14:56:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:25 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:56:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:25 smithi096 ceph-mon[124666]: pgmap v21558: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 572 KiB/s rd, 569 KiB/s wr, 7 op/s 2023-05-08T14:56:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:25 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:56:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:25 smithi186 ceph-mon[126480]: pgmap v21558: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 572 KiB/s rd, 569 KiB/s wr, 7 op/s 2023-05-08T14:56:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:25 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:56:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:26 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:56:27.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:26 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:56:27.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:26 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:56:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:26 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:56:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:26 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:56:27.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:26 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:56:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:26 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:56:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:26 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:56:27.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:26 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:56:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:27 smithi133 ceph-mon[125939]: pgmap v21559: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 14 op/s 2023-05-08T14:56:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:27 smithi096 ceph-mon[124666]: pgmap v21559: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 14 op/s 2023-05-08T14:56:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:27 smithi186 ceph-mon[126480]: pgmap v21559: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 14 op/s 2023-05-08T14:56:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:29 smithi133 ceph-mon[125939]: pgmap v21560: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 974 KiB/s rd, 993 KiB/s wr, 10 op/s 2023-05-08T14:56:30.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40328.494181 secs 2023-05-08T14:56:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:29 smithi096 ceph-mon[124666]: pgmap v21560: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 974 KiB/s rd, 993 KiB/s wr, 10 op/s 2023-05-08T14:56:30.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40328.494181 secs 2023-05-08T14:56:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:29 smithi186 ceph-mon[126480]: pgmap v21560: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 974 KiB/s rd, 993 KiB/s wr, 10 op/s 2023-05-08T14:56:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40328.494181 secs 2023-05-08T14:56:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:31 smithi133 ceph-mon[125939]: pgmap v21561: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1007 KiB/s rd, 1.0 MiB/s wr, 14 op/s 2023-05-08T14:56:32.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:31 smithi133 ceph-mon[125939]: osdmap e1424: 12 total, 12 up, 12 in 2023-05-08T14:56:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:31 smithi096 ceph-mon[124666]: pgmap v21561: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1007 KiB/s rd, 1.0 MiB/s wr, 14 op/s 2023-05-08T14:56:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:31 smithi096 ceph-mon[124666]: osdmap e1424: 12 total, 12 up, 12 in 2023-05-08T14:56:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:31 smithi186 ceph-mon[126480]: pgmap v21561: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1007 KiB/s rd, 1.0 MiB/s wr, 14 op/s 2023-05-08T14:56:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:31 smithi186 ceph-mon[126480]: osdmap e1424: 12 total, 12 up, 12 in 2023-05-08T14:56:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:33 smithi133 ceph-mon[125939]: pgmap v21563: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T14:56:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:33 smithi096 ceph-mon[124666]: pgmap v21563: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T14:56:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:33 smithi186 ceph-mon[126480]: pgmap v21563: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T14:56:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40333.494314 secs 2023-05-08T14:56:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40333.494314 secs 2023-05-08T14:56:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40333.494314 secs 2023-05-08T14:56:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:35 smithi096 ceph-mon[124666]: pgmap v21564: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T14:56:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:35 smithi186 ceph-mon[126480]: pgmap v21564: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T14:56:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:35 smithi133 ceph-mon[125939]: pgmap v21564: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T14:56:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:37 smithi096 ceph-mon[124666]: pgmap v21565: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 470 KiB/s wr, 9 op/s 2023-05-08T14:56:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:37 smithi186 ceph-mon[126480]: pgmap v21565: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 470 KiB/s wr, 9 op/s 2023-05-08T14:56:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:37 smithi133 ceph-mon[125939]: pgmap v21565: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 470 KiB/s wr, 9 op/s 2023-05-08T14:56:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:39 smithi186 ceph-mon[126480]: pgmap v21566: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 470 KiB/s wr, 9 op/s 2023-05-08T14:56:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40338.494414 secs 2023-05-08T14:56:40.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:39 smithi186 ceph-mon[126480]: osdmap e1425: 12 total, 12 up, 12 in 2023-05-08T14:56:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:39 smithi133 ceph-mon[125939]: pgmap v21566: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 470 KiB/s wr, 9 op/s 2023-05-08T14:56:40.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40338.494414 secs 2023-05-08T14:56:40.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:39 smithi133 ceph-mon[125939]: osdmap e1425: 12 total, 12 up, 12 in 2023-05-08T14:56:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:39 smithi096 ceph-mon[124666]: pgmap v21566: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 470 KiB/s wr, 9 op/s 2023-05-08T14:56:40.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40338.494414 secs 2023-05-08T14:56:40.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:39 smithi096 ceph-mon[124666]: osdmap e1425: 12 total, 12 up, 12 in 2023-05-08T14:56:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:41 smithi186 ceph-mon[126480]: pgmap v21568: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 713 KiB/s rd, 710 KiB/s wr, 10 op/s 2023-05-08T14:56:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40340.389658 secs 2023-05-08T14:56:42.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:41 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:56:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:41 smithi133 ceph-mon[125939]: pgmap v21568: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 713 KiB/s rd, 710 KiB/s wr, 10 op/s 2023-05-08T14:56:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40340.389658 secs 2023-05-08T14:56:42.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:41 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:56:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:41 smithi096 ceph-mon[124666]: pgmap v21568: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 713 KiB/s rd, 710 KiB/s wr, 10 op/s 2023-05-08T14:56:42.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40340.389658 secs 2023-05-08T14:56:42.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:41 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:56:43.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:42 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:56:43.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:42 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:56:43.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:42 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:56:43.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:42 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:56:43.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:42 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:56:43.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:42 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:56:43.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:42 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:56:43.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:42 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:56:43.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:42 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:56:44.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:43 smithi186 ceph-mon[126480]: pgmap v21569: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 650 KiB/s wr, 9 op/s 2023-05-08T14:56:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:43 smithi133 ceph-mon[125939]: pgmap v21569: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 650 KiB/s wr, 9 op/s 2023-05-08T14:56:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:43 smithi096 ceph-mon[124666]: pgmap v21569: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 650 KiB/s wr, 9 op/s 2023-05-08T14:56:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40343.494512 secs 2023-05-08T14:56:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40344.048403 secs 2023-05-08T14:56:45.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:44 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:56:45.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:44 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:56:45.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:44 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:56:45.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:44 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:56:45.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:44 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:56:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40343.494512 secs 2023-05-08T14:56:45.284 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40344.048403 secs 2023-05-08T14:56:45.284 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:44 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:56:45.285 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:44 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:56:45.285 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:44 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:56:45.285 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:44 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:56:45.285 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:44 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:56:45.286 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40343.494512 secs 2023-05-08T14:56:45.286 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40344.048403 secs 2023-05-08T14:56:45.286 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:44 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:56:45.286 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:44 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:56:45.286 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:44 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:56:45.287 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:44 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:56:45.287 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:44 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:56:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:45 smithi186 ceph-mon[126480]: pgmap v21570: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 676 KiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T14:56:46.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:45 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:56:46.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:45 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T14:56:46.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:45 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T14:56:46.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:45 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:56:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:45 smithi133 ceph-mon[125939]: pgmap v21570: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 676 KiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T14:56:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:45 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:56:46.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:45 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T14:56:46.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:45 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T14:56:46.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:45 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:56:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:45 smithi096 ceph-mon[124666]: pgmap v21570: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 676 KiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T14:56:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:45 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:56:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:45 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T14:56:46.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:45 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T14:56:46.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:45 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:56:47.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:46 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:56:47.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:46 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:56:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:46 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:56:47.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:46 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:56:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:46 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:56:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:46 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:56:48.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:47 smithi186 ceph-mon[126480]: pgmap v21571: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 915 KiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T14:56:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:47 smithi133 ceph-mon[125939]: pgmap v21571: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 915 KiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T14:56:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:47 smithi096 ceph-mon[124666]: pgmap v21571: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 915 KiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T14:56:49.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:48 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:56:49.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:48 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:56:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:48 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:56:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:49 smithi133 ceph-mon[125939]: pgmap v21572: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 915 KiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T14:56:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40348.494599 secs 2023-05-08T14:56:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:56:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40349.048574 secs 2023-05-08T14:56:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:49 smithi096 ceph-mon[124666]: pgmap v21572: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 915 KiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T14:56:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40348.494599 secs 2023-05-08T14:56:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:56:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40349.048574 secs 2023-05-08T14:56:50.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:49 smithi186 ceph-mon[126480]: pgmap v21572: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 915 KiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T14:56:50.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40348.494599 secs 2023-05-08T14:56:50.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:56:50.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40349.048574 secs 2023-05-08T14:56:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:56:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:56:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:56:51.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:56:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:56:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:56:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:51 smithi133 ceph-mon[125939]: pgmap v21573: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 15 op/s 2023-05-08T14:56:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40350.389889 secs 2023-05-08T14:56:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:51 smithi096 ceph-mon[124666]: pgmap v21573: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 15 op/s 2023-05-08T14:56:52.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40350.389889 secs 2023-05-08T14:56:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:51 smithi186 ceph-mon[126480]: pgmap v21573: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 15 op/s 2023-05-08T14:56:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40350.389889 secs 2023-05-08T14:56:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:53 smithi133 ceph-mon[125939]: pgmap v21574: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 10 op/s 2023-05-08T14:56:54.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:53 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:56:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:53 smithi096 ceph-mon[124666]: pgmap v21574: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 10 op/s 2023-05-08T14:56:54.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:53 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:56:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:53 smithi186 ceph-mon[126480]: pgmap v21574: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 10 op/s 2023-05-08T14:56:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:53 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:56:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40353.494737 secs 2023-05-08T14:56:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:54 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:56:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:54 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:56:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40353.494737 secs 2023-05-08T14:56:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:54 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:56:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:54 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:56:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40353.494737 secs 2023-05-08T14:56:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:54 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:56:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:54 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:56:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:55 smithi133 ceph-mon[125939]: pgmap v21575: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.8 MiB/s wr, 12 op/s 2023-05-08T14:56:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:55 smithi096 ceph-mon[124666]: pgmap v21575: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.8 MiB/s wr, 12 op/s 2023-05-08T14:56:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:55 smithi186 ceph-mon[126480]: pgmap v21575: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.8 MiB/s wr, 12 op/s 2023-05-08T14:56:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40355.390007 secs 2023-05-08T14:56:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40355.390007 secs 2023-05-08T14:56:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40355.390007 secs 2023-05-08T14:56:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:57 smithi133 ceph-mon[125939]: pgmap v21576: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 1.9 MiB/s wr, 15 op/s 2023-05-08T14:56:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:56:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:57 smithi096 ceph-mon[124666]: pgmap v21576: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 1.9 MiB/s wr, 15 op/s 2023-05-08T14:56:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:56:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:57 smithi186 ceph-mon[126480]: pgmap v21576: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 1.9 MiB/s wr, 15 op/s 2023-05-08T14:56:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:56:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:56:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:56:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:56:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:56:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:56:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:57:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:59 smithi133 ceph-mon[125939]: pgmap v21577: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.4 MiB/s wr, 10 op/s 2023-05-08T14:57:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40358.494879 secs 2023-05-08T14:57:00.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:56:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40359.048705 secs 2023-05-08T14:57:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:59 smithi096 ceph-mon[124666]: pgmap v21577: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.4 MiB/s wr, 10 op/s 2023-05-08T14:57:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40358.494879 secs 2023-05-08T14:57:00.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:56:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40359.048705 secs 2023-05-08T14:57:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:59 smithi186 ceph-mon[126480]: pgmap v21577: 97 pgs: 97 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.4 MiB/s wr, 10 op/s 2023-05-08T14:57:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40358.494879 secs 2023-05-08T14:57:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:56:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40359.048705 secs 2023-05-08T14:57:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:01 smithi133 ceph-mon[125939]: pgmap v21578: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.7 MiB/s wr, 16 op/s 2023-05-08T14:57:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:01 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:57:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:01 smithi096 ceph-mon[124666]: pgmap v21578: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.7 MiB/s wr, 16 op/s 2023-05-08T14:57:02.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:01 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:57:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:01 smithi186 ceph-mon[126480]: pgmap v21578: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.7 MiB/s wr, 16 op/s 2023-05-08T14:57:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:01 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:57:03.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:57:03.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:57:03.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:57:03.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:57:03.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:57:03.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:57:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:57:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:57:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:57:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:03 smithi133 ceph-mon[125939]: pgmap v21579: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 11 op/s 2023-05-08T14:57:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:03 smithi096 ceph-mon[124666]: pgmap v21579: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 11 op/s 2023-05-08T14:57:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:03 smithi186 ceph-mon[126480]: pgmap v21579: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 11 op/s 2023-05-08T14:57:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40363.495032 secs 2023-05-08T14:57:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40363.495032 secs 2023-05-08T14:57:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40363.495032 secs 2023-05-08T14:57:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:05 smithi133 ceph-mon[125939]: pgmap v21580: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 23 op/s 2023-05-08T14:57:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:05 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:57:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:05 smithi096 ceph-mon[124666]: pgmap v21580: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 23 op/s 2023-05-08T14:57:06.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:05 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:57:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:05 smithi186 ceph-mon[126480]: pgmap v21580: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 23 op/s 2023-05-08T14:57:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:05 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:57:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:06 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:57:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:57:07.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:57:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:06 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:57:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:57:07.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:57:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:06 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:57:07.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:57:07.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:57:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:07 smithi133 ceph-mon[125939]: pgmap v21581: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.5 MiB/s wr, 29 op/s 2023-05-08T14:57:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:07 smithi096 ceph-mon[124666]: pgmap v21581: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.5 MiB/s wr, 29 op/s 2023-05-08T14:57:08.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:07 smithi186 ceph-mon[126480]: pgmap v21581: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.5 MiB/s wr, 29 op/s 2023-05-08T14:57:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:09 smithi133 ceph-mon[125939]: pgmap v21582: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.1 MiB/s wr, 24 op/s 2023-05-08T14:57:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40368.495160 secs 2023-05-08T14:57:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:09 smithi096 ceph-mon[124666]: pgmap v21582: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.1 MiB/s wr, 24 op/s 2023-05-08T14:57:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40368.495160 secs 2023-05-08T14:57:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:09 smithi186 ceph-mon[126480]: pgmap v21582: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.1 MiB/s wr, 24 op/s 2023-05-08T14:57:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40368.495160 secs 2023-05-08T14:57:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:11 smithi133 ceph-mon[125939]: pgmap v21583: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 2.9 MiB/s wr, 30 op/s 2023-05-08T14:57:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:11 smithi096 ceph-mon[124666]: pgmap v21583: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 2.9 MiB/s wr, 30 op/s 2023-05-08T14:57:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:11 smithi186 ceph-mon[126480]: pgmap v21583: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 2.9 MiB/s wr, 30 op/s 2023-05-08T14:57:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:13 smithi133 ceph-mon[125939]: pgmap v21584: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 1.5 MiB/s wr, 24 op/s 2023-05-08T14:57:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:13 smithi096 ceph-mon[124666]: pgmap v21584: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 1.5 MiB/s wr, 24 op/s 2023-05-08T14:57:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:13 smithi186 ceph-mon[126480]: pgmap v21584: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 1.5 MiB/s wr, 24 op/s 2023-05-08T14:57:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40373.495282 secs 2023-05-08T14:57:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40373.495282 secs 2023-05-08T14:57:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40373.495282 secs 2023-05-08T14:57:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:15 smithi133 ceph-mon[125939]: pgmap v21585: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.9 MiB/s wr, 25 op/s 2023-05-08T14:57:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:15 smithi096 ceph-mon[124666]: pgmap v21585: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.9 MiB/s wr, 25 op/s 2023-05-08T14:57:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:15 smithi186 ceph-mon[126480]: pgmap v21585: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.9 MiB/s wr, 25 op/s 2023-05-08T14:57:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:17 smithi133 ceph-mon[125939]: pgmap v21586: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 1.9 MiB/s wr, 16 op/s 2023-05-08T14:57:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:17 smithi096 ceph-mon[124666]: pgmap v21586: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 1.9 MiB/s wr, 16 op/s 2023-05-08T14:57:18.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:17 smithi186 ceph-mon[126480]: pgmap v21586: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 1.9 MiB/s wr, 16 op/s 2023-05-08T14:57:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:19 smithi096 ceph-mon[124666]: pgmap v21587: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 8 op/s 2023-05-08T14:57:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40378.495435 secs 2023-05-08T14:57:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:19 smithi186 ceph-mon[126480]: pgmap v21587: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 8 op/s 2023-05-08T14:57:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40378.495435 secs 2023-05-08T14:57:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:19 smithi133 ceph-mon[125939]: pgmap v21587: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 8 op/s 2023-05-08T14:57:20.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40378.495435 secs 2023-05-08T14:57:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:21 smithi096 ceph-mon[124666]: pgmap v21588: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 13 op/s 2023-05-08T14:57:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:21 smithi186 ceph-mon[126480]: pgmap v21588: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 13 op/s 2023-05-08T14:57:22.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:21 smithi133 ceph-mon[125939]: pgmap v21588: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 13 op/s 2023-05-08T14:57:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:23 smithi096 ceph-mon[124666]: pgmap v21589: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 838 KiB/s rd, 688 KiB/s wr, 8 op/s 2023-05-08T14:57:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:24 smithi186 ceph-mon[126480]: pgmap v21589: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 838 KiB/s rd, 688 KiB/s wr, 8 op/s 2023-05-08T14:57:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:24 smithi133 ceph-mon[125939]: pgmap v21589: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 838 KiB/s rd, 688 KiB/s wr, 8 op/s 2023-05-08T14:57:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40383.495500 secs 2023-05-08T14:57:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40384.049351 secs 2023-05-08T14:57:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40383.495500 secs 2023-05-08T14:57:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40384.049351 secs 2023-05-08T14:57:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40383.495500 secs 2023-05-08T14:57:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40384.049351 secs 2023-05-08T14:57:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:26 smithi186 ceph-mon[126480]: pgmap v21590: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 14 op/s 2023-05-08T14:57:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40385.390699 secs 2023-05-08T14:57:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:26 smithi133 ceph-mon[125939]: pgmap v21590: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 14 op/s 2023-05-08T14:57:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40385.390699 secs 2023-05-08T14:57:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:26 smithi096 ceph-mon[124666]: pgmap v21590: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 14 op/s 2023-05-08T14:57:26.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40385.390699 secs 2023-05-08T14:57:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:27 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:57:27.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:27 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:57:27.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:27 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:57:27.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:27 smithi186 ceph-mon[126480]: osdmap e1426: 12 total, 12 up, 12 in 2023-05-08T14:57:27.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:27 smithi186 ceph-mon[126480]: pgmap v21592: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.8 MiB/s wr, 14 op/s 2023-05-08T14:57:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:27 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:57:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:27 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:57:27.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:27 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:57:27.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:27 smithi133 ceph-mon[125939]: osdmap e1426: 12 total, 12 up, 12 in 2023-05-08T14:57:27.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:27 smithi133 ceph-mon[125939]: pgmap v21592: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.8 MiB/s wr, 14 op/s 2023-05-08T14:57:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:27 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:57:27.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:27 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:57:27.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:27 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:57:27.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:27 smithi096 ceph-mon[124666]: osdmap e1426: 12 total, 12 up, 12 in 2023-05-08T14:57:27.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:27 smithi096 ceph-mon[124666]: pgmap v21592: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.8 MiB/s wr, 14 op/s 2023-05-08T14:57:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:29 smithi186 ceph-mon[126480]: pgmap v21593: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.8 MiB/s wr, 14 op/s 2023-05-08T14:57:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40388.495648 secs 2023-05-08T14:57:30.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40389.049504 secs 2023-05-08T14:57:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:29 smithi133 ceph-mon[125939]: pgmap v21593: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.8 MiB/s wr, 14 op/s 2023-05-08T14:57:30.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40388.495648 secs 2023-05-08T14:57:30.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40389.049504 secs 2023-05-08T14:57:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:29 smithi096 ceph-mon[124666]: pgmap v21593: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.8 MiB/s wr, 14 op/s 2023-05-08T14:57:30.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40388.495648 secs 2023-05-08T14:57:30.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40389.049504 secs 2023-05-08T14:57:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:30 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:57:31.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:30 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:57:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:30 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:57:31.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:30 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:57:31.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:30 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:57:31.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:30 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:57:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:31 smithi186 ceph-mon[126480]: pgmap v21594: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 15 op/s 2023-05-08T14:57:32.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40390.390837 secs 2023-05-08T14:57:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:31 smithi133 ceph-mon[125939]: pgmap v21594: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 15 op/s 2023-05-08T14:57:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40390.390837 secs 2023-05-08T14:57:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:31 smithi096 ceph-mon[124666]: pgmap v21594: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 15 op/s 2023-05-08T14:57:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40390.390837 secs 2023-05-08T14:57:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:33 smithi186 ceph-mon[126480]: pgmap v21595: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 15 op/s 2023-05-08T14:57:34.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:33 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:57:34.120 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:33 smithi186 ceph-mon[126480]: osdmap e1427: 12 total, 12 up, 12 in 2023-05-08T14:57:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:33 smithi133 ceph-mon[125939]: pgmap v21595: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 15 op/s 2023-05-08T14:57:34.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:33 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:57:34.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:33 smithi133 ceph-mon[125939]: osdmap e1427: 12 total, 12 up, 12 in 2023-05-08T14:57:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:33 smithi096 ceph-mon[124666]: pgmap v21595: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 15 op/s 2023-05-08T14:57:34.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:33 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:57:34.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:33 smithi096 ceph-mon[124666]: osdmap e1427: 12 total, 12 up, 12 in 2023-05-08T14:57:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40393.495728 secs 2023-05-08T14:57:35.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40394.049586 secs 2023-05-08T14:57:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40393.495728 secs 2023-05-08T14:57:35.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40394.049586 secs 2023-05-08T14:57:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40393.495728 secs 2023-05-08T14:57:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40394.049586 secs 2023-05-08T14:57:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:35 smithi133 ceph-mon[125939]: pgmap v21597: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 296 KiB/s wr, 11 op/s 2023-05-08T14:57:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:35 smithi096 ceph-mon[124666]: pgmap v21597: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 296 KiB/s wr, 11 op/s 2023-05-08T14:57:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:35 smithi186 ceph-mon[126480]: pgmap v21597: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 296 KiB/s wr, 11 op/s 2023-05-08T14:57:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40395.390974 secs 2023-05-08T14:57:37.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40395.390974 secs 2023-05-08T14:57:37.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40395.390974 secs 2023-05-08T14:57:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:37 smithi133 ceph-mon[125939]: pgmap v21598: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 650 KiB/s wr, 11 op/s 2023-05-08T14:57:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:37 smithi096 ceph-mon[124666]: pgmap v21598: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 650 KiB/s wr, 11 op/s 2023-05-08T14:57:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:37 smithi186 ceph-mon[126480]: pgmap v21598: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 650 KiB/s wr, 11 op/s 2023-05-08T14:57:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:39 smithi133 ceph-mon[125939]: pgmap v21599: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 651 KiB/s rd, 650 KiB/s wr, 11 op/s 2023-05-08T14:57:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40398.495855 secs 2023-05-08T14:57:40.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40399.049679 secs 2023-05-08T14:57:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:39 smithi096 ceph-mon[124666]: pgmap v21599: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 651 KiB/s rd, 650 KiB/s wr, 11 op/s 2023-05-08T14:57:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40398.495855 secs 2023-05-08T14:57:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40399.049679 secs 2023-05-08T14:57:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:39 smithi186 ceph-mon[126480]: pgmap v21599: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 651 KiB/s rd, 650 KiB/s wr, 11 op/s 2023-05-08T14:57:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40398.495855 secs 2023-05-08T14:57:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40399.049679 secs 2023-05-08T14:57:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:41 smithi133 ceph-mon[125939]: pgmap v21600: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 1.0 MiB/s wr, 9 op/s 2023-05-08T14:57:42.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40400.391054 secs 2023-05-08T14:57:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:41 smithi096 ceph-mon[124666]: pgmap v21600: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 1.0 MiB/s wr, 9 op/s 2023-05-08T14:57:42.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40400.391054 secs 2023-05-08T14:57:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:41 smithi186 ceph-mon[126480]: pgmap v21600: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 1.0 MiB/s wr, 9 op/s 2023-05-08T14:57:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40400.391054 secs 2023-05-08T14:57:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:43 smithi133 ceph-mon[125939]: pgmap v21601: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 617 KiB/s rd, 1.0 MiB/s wr, 9 op/s 2023-05-08T14:57:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:43 smithi096 ceph-mon[124666]: pgmap v21601: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 617 KiB/s rd, 1.0 MiB/s wr, 9 op/s 2023-05-08T14:57:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:43 smithi186 ceph-mon[126480]: pgmap v21601: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 617 KiB/s rd, 1.0 MiB/s wr, 9 op/s 2023-05-08T14:57:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40403.495994 secs 2023-05-08T14:57:45.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40404.049800 secs 2023-05-08T14:57:45.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:44 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:57:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40403.495994 secs 2023-05-08T14:57:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40404.049800 secs 2023-05-08T14:57:45.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:44 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:57:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40403.495994 secs 2023-05-08T14:57:45.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40404.049800 secs 2023-05-08T14:57:45.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:44 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:57:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:45 smithi133 ceph-mon[125939]: pgmap v21602: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 889 KiB/s rd, 1022 KiB/s wr, 12 op/s 2023-05-08T14:57:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:57:46.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:57:46.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:57:46.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:45 smithi096 ceph-mon[124666]: pgmap v21602: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 889 KiB/s rd, 1022 KiB/s wr, 12 op/s 2023-05-08T14:57:46.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:57:46.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:57:46.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:57:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:45 smithi186 ceph-mon[126480]: pgmap v21602: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 889 KiB/s rd, 1022 KiB/s wr, 12 op/s 2023-05-08T14:57:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:57:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:57:46.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:57:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:46 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:57:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:46 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T14:57:47.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:46 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T14:57:47.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:46 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:57:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:46 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:57:47.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:46 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T14:57:47.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:46 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T14:57:47.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:46 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:57:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:46 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:57:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:46 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T14:57:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:46 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T14:57:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:46 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:57:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:47 smithi133 ceph-mon[125939]: pgmap v21603: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 710 KiB/s rd, 707 KiB/s wr, 8 op/s 2023-05-08T14:57:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:47 smithi096 ceph-mon[124666]: pgmap v21603: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 710 KiB/s rd, 707 KiB/s wr, 8 op/s 2023-05-08T14:57:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:47 smithi186 ceph-mon[126480]: pgmap v21603: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 710 KiB/s rd, 707 KiB/s wr, 8 op/s 2023-05-08T14:57:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:49 smithi133 ceph-mon[125939]: pgmap v21604: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 365 KiB/s wr, 7 op/s 2023-05-08T14:57:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40408.496135 secs 2023-05-08T14:57:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:57:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40409.049948 secs 2023-05-08T14:57:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:49 smithi096 ceph-mon[124666]: pgmap v21604: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 365 KiB/s wr, 7 op/s 2023-05-08T14:57:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40408.496135 secs 2023-05-08T14:57:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:57:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40409.049948 secs 2023-05-08T14:57:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:49 smithi186 ceph-mon[126480]: pgmap v21604: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 365 KiB/s wr, 7 op/s 2023-05-08T14:57:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40408.496135 secs 2023-05-08T14:57:50.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:57:50.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40409.049948 secs 2023-05-08T14:57:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:57:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:57:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:57:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:57:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:57:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:57:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:57:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:57:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:57:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:51 smithi133 ceph-mon[125939]: pgmap v21605: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 778 KiB/s rd, 728 KiB/s wr, 10 op/s 2023-05-08T14:57:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:51 smithi096 ceph-mon[124666]: pgmap v21605: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 778 KiB/s rd, 728 KiB/s wr, 10 op/s 2023-05-08T14:57:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:51 smithi186 ceph-mon[126480]: pgmap v21605: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 778 KiB/s rd, 728 KiB/s wr, 10 op/s 2023-05-08T14:57:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:53 smithi133 ceph-mon[125939]: pgmap v21606: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 776 KiB/s rd, 363 KiB/s wr, 7 op/s 2023-05-08T14:57:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:53 smithi096 ceph-mon[124666]: pgmap v21606: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 776 KiB/s rd, 363 KiB/s wr, 7 op/s 2023-05-08T14:57:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:53 smithi186 ceph-mon[126480]: pgmap v21606: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 776 KiB/s rd, 363 KiB/s wr, 7 op/s 2023-05-08T14:57:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40413.496281 secs 2023-05-08T14:57:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40413.496281 secs 2023-05-08T14:57:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40413.496281 secs 2023-05-08T14:57:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:55 smithi133 ceph-mon[125939]: pgmap v21607: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 939 KiB/s wr, 10 op/s 2023-05-08T14:57:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:55 smithi096 ceph-mon[124666]: pgmap v21607: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 939 KiB/s wr, 10 op/s 2023-05-08T14:57:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:55 smithi186 ceph-mon[126480]: pgmap v21607: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 939 KiB/s wr, 10 op/s 2023-05-08T14:57:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40415.391427 secs 2023-05-08T14:57:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40415.391427 secs 2023-05-08T14:57:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40415.391427 secs 2023-05-08T14:57:58.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:57 smithi133 ceph-mon[125939]: pgmap v21608: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 939 KiB/s wr, 10 op/s 2023-05-08T14:57:58.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:57:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:57 smithi096 ceph-mon[124666]: pgmap v21608: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 939 KiB/s wr, 10 op/s 2023-05-08T14:57:58.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:57:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:57 smithi186 ceph-mon[126480]: pgmap v21608: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 939 KiB/s wr, 10 op/s 2023-05-08T14:57:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:57:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:57:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:57:59.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:57:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:57:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:57:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:57:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:57:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:57:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:58:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:59 smithi133 ceph-mon[125939]: pgmap v21609: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 988 KiB/s rd, 939 KiB/s wr, 8 op/s 2023-05-08T14:58:00.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:57:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40418.496387 secs 2023-05-08T14:58:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:59 smithi096 ceph-mon[124666]: pgmap v21609: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 988 KiB/s rd, 939 KiB/s wr, 8 op/s 2023-05-08T14:58:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:57:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40418.496387 secs 2023-05-08T14:58:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:59 smithi186 ceph-mon[126480]: pgmap v21609: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 988 KiB/s rd, 939 KiB/s wr, 8 op/s 2023-05-08T14:58:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:57:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40418.496387 secs 2023-05-08T14:58:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:01 smithi133 ceph-mon[125939]: pgmap v21610: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 14 op/s 2023-05-08T14:58:02.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40420.391566 secs 2023-05-08T14:58:02.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:01 smithi096 ceph-mon[124666]: pgmap v21610: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 14 op/s 2023-05-08T14:58:02.259 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40420.391566 secs 2023-05-08T14:58:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:01 smithi186 ceph-mon[126480]: pgmap v21610: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 14 op/s 2023-05-08T14:58:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40420.391566 secs 2023-05-08T14:58:04.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:03 smithi133 ceph-mon[125939]: pgmap v21611: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 10 op/s 2023-05-08T14:58:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:03 smithi096 ceph-mon[124666]: pgmap v21611: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 10 op/s 2023-05-08T14:58:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:03 smithi186 ceph-mon[126480]: pgmap v21611: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 10 op/s 2023-05-08T14:58:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40423.496455 secs 2023-05-08T14:58:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40424.050324 secs 2023-05-08T14:58:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40423.496455 secs 2023-05-08T14:58:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40424.050324 secs 2023-05-08T14:58:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40423.496455 secs 2023-05-08T14:58:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40424.050324 secs 2023-05-08T14:58:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:05 smithi133 ceph-mon[125939]: pgmap v21612: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.2 MiB/s wr, 29 op/s 2023-05-08T14:58:06.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:05 smithi096 ceph-mon[124666]: pgmap v21612: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.2 MiB/s wr, 29 op/s 2023-05-08T14:58:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:05 smithi186 ceph-mon[126480]: pgmap v21612: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.2 MiB/s wr, 29 op/s 2023-05-08T14:58:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:06 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:58:07.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:58:07.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:58:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:06 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:58:07.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:58:07.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:58:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:06 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:58:07.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:58:07.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:58:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:07 smithi133 ceph-mon[125939]: pgmap v21613: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.7 MiB/s wr, 25 op/s 2023-05-08T14:58:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:07 smithi096 ceph-mon[124666]: pgmap v21613: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.7 MiB/s wr, 25 op/s 2023-05-08T14:58:08.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:07 smithi186 ceph-mon[126480]: pgmap v21613: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.7 MiB/s wr, 25 op/s 2023-05-08T14:58:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:10 smithi096 ceph-mon[124666]: pgmap v21614: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.7 MiB/s wr, 24 op/s 2023-05-08T14:58:10.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40428.496584 secs 2023-05-08T14:58:10.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40429.050493 secs 2023-05-08T14:58:10.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:10 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:58:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:10 smithi186 ceph-mon[126480]: pgmap v21614: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.7 MiB/s wr, 24 op/s 2023-05-08T14:58:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40428.496584 secs 2023-05-08T14:58:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40429.050493 secs 2023-05-08T14:58:10.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:10 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:58:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:10 smithi133 ceph-mon[125939]: pgmap v21614: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.7 MiB/s wr, 24 op/s 2023-05-08T14:58:10.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40428.496584 secs 2023-05-08T14:58:10.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40429.050493 secs 2023-05-08T14:58:10.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:10 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:58:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:11 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:58:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:11 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:58:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:11 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:58:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:11 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:58:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:11 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:58:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:11 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:58:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:12 smithi186 ceph-mon[126480]: pgmap v21615: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.7 MiB/s wr, 28 op/s 2023-05-08T14:58:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:12 smithi133 ceph-mon[125939]: pgmap v21615: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.7 MiB/s wr, 28 op/s 2023-05-08T14:58:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:12 smithi096 ceph-mon[124666]: pgmap v21615: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.7 MiB/s wr, 28 op/s 2023-05-08T14:58:13.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:13 smithi186 ceph-mon[126480]: pgmap v21616: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 878 KiB/s wr, 22 op/s 2023-05-08T14:58:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:13 smithi133 ceph-mon[125939]: pgmap v21616: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 878 KiB/s wr, 22 op/s 2023-05-08T14:58:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:13 smithi096 ceph-mon[124666]: pgmap v21616: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 878 KiB/s wr, 22 op/s 2023-05-08T14:58:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:14 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:58:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:14 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:58:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:14 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:58:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40433.496714 secs 2023-05-08T14:58:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:15 smithi186 ceph-mon[126480]: pgmap v21617: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.3 MiB/s wr, 26 op/s 2023-05-08T14:58:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40434.050609 secs 2023-05-08T14:58:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40433.496714 secs 2023-05-08T14:58:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:15 smithi133 ceph-mon[125939]: pgmap v21617: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.3 MiB/s wr, 26 op/s 2023-05-08T14:58:15.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40434.050609 secs 2023-05-08T14:58:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40433.496714 secs 2023-05-08T14:58:15.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:15 smithi096 ceph-mon[124666]: pgmap v21617: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.3 MiB/s wr, 26 op/s 2023-05-08T14:58:15.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40434.050609 secs 2023-05-08T14:58:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:17 smithi133 ceph-mon[125939]: pgmap v21618: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 575 KiB/s wr, 8 op/s 2023-05-08T14:58:17.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:17 smithi096 ceph-mon[124666]: pgmap v21618: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 575 KiB/s wr, 8 op/s 2023-05-08T14:58:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:17 smithi186 ceph-mon[126480]: pgmap v21618: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 575 KiB/s wr, 8 op/s 2023-05-08T14:58:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:19 smithi186 ceph-mon[126480]: pgmap v21619: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 575 KiB/s wr, 8 op/s 2023-05-08T14:58:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40438.496843 secs 2023-05-08T14:58:20.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40439.050776 secs 2023-05-08T14:58:20.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:19 smithi133 ceph-mon[125939]: pgmap v21619: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 575 KiB/s wr, 8 op/s 2023-05-08T14:58:20.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40438.496843 secs 2023-05-08T14:58:20.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40439.050776 secs 2023-05-08T14:58:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:19 smithi096 ceph-mon[124666]: pgmap v21619: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 575 KiB/s wr, 8 op/s 2023-05-08T14:58:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40438.496843 secs 2023-05-08T14:58:20.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40439.050776 secs 2023-05-08T14:58:22.119 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:21 smithi186 ceph-mon[126480]: pgmap v21620: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 575 KiB/s wr, 10 op/s 2023-05-08T14:58:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:21 smithi133 ceph-mon[125939]: pgmap v21620: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 575 KiB/s wr, 10 op/s 2023-05-08T14:58:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:21 smithi096 ceph-mon[124666]: pgmap v21620: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 575 KiB/s wr, 10 op/s 2023-05-08T14:58:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:23 smithi133 ceph-mon[125939]: pgmap v21621: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 575 KiB/s rd, 573 KiB/s wr, 7 op/s 2023-05-08T14:58:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:23 smithi096 ceph-mon[124666]: pgmap v21621: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 575 KiB/s rd, 573 KiB/s wr, 7 op/s 2023-05-08T14:58:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:23 smithi186 ceph-mon[126480]: pgmap v21621: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 575 KiB/s rd, 573 KiB/s wr, 7 op/s 2023-05-08T14:58:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40443.496977 secs 2023-05-08T14:58:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40443.496977 secs 2023-05-08T14:58:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40443.496977 secs 2023-05-08T14:58:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:25 smithi133 ceph-mon[125939]: pgmap v21622: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 14 op/s 2023-05-08T14:58:26.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:25 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:58:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:25 smithi096 ceph-mon[124666]: pgmap v21622: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 14 op/s 2023-05-08T14:58:26.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:25 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:58:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:25 smithi186 ceph-mon[126480]: pgmap v21622: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 14 op/s 2023-05-08T14:58:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:25 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:58:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:26 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:58:27.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:26 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:58:27.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:26 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:58:27.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:26 smithi133 ceph-mon[125939]: osdmap e1428: 12 total, 12 up, 12 in 2023-05-08T14:58:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:26 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:58:27.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:26 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:58:27.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:26 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:58:27.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:26 smithi096 ceph-mon[124666]: osdmap e1428: 12 total, 12 up, 12 in 2023-05-08T14:58:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:26 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:58:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:26 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:58:27.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:26 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:58:27.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:26 smithi186 ceph-mon[126480]: osdmap e1428: 12 total, 12 up, 12 in 2023-05-08T14:58:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:27 smithi133 ceph-mon[125939]: pgmap v21624: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 13 op/s 2023-05-08T14:58:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:27 smithi096 ceph-mon[124666]: pgmap v21624: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 13 op/s 2023-05-08T14:58:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:27 smithi186 ceph-mon[126480]: pgmap v21624: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 13 op/s 2023-05-08T14:58:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:29 smithi133 ceph-mon[125939]: pgmap v21625: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 13 op/s 2023-05-08T14:58:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40448.497106 secs 2023-05-08T14:58:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:29 smithi096 ceph-mon[124666]: pgmap v21625: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 13 op/s 2023-05-08T14:58:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40448.497106 secs 2023-05-08T14:58:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:29 smithi186 ceph-mon[126480]: pgmap v21625: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 13 op/s 2023-05-08T14:58:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40448.497106 secs 2023-05-08T14:58:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:31 smithi133 ceph-mon[125939]: pgmap v21626: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.8 MiB/s wr, 15 op/s 2023-05-08T14:58:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:31 smithi096 ceph-mon[124666]: pgmap v21626: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.8 MiB/s wr, 15 op/s 2023-05-08T14:58:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:31 smithi186 ceph-mon[126480]: pgmap v21626: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.8 MiB/s wr, 15 op/s 2023-05-08T14:58:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:33 smithi133 ceph-mon[125939]: pgmap v21627: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.8 MiB/s wr, 15 op/s 2023-05-08T14:58:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:33 smithi133 ceph-mon[125939]: osdmap e1429: 12 total, 12 up, 12 in 2023-05-08T14:58:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:33 smithi096 ceph-mon[124666]: pgmap v21627: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.8 MiB/s wr, 15 op/s 2023-05-08T14:58:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:33 smithi096 ceph-mon[124666]: osdmap e1429: 12 total, 12 up, 12 in 2023-05-08T14:58:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:33 smithi186 ceph-mon[126480]: pgmap v21627: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.8 MiB/s wr, 15 op/s 2023-05-08T14:58:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:33 smithi186 ceph-mon[126480]: osdmap e1429: 12 total, 12 up, 12 in 2023-05-08T14:58:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40453.497241 secs 2023-05-08T14:58:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40453.497241 secs 2023-05-08T14:58:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40453.497241 secs 2023-05-08T14:58:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:35 smithi133 ceph-mon[125939]: pgmap v21629: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 971 KiB/s wr, 12 op/s 2023-05-08T14:58:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:35 smithi096 ceph-mon[124666]: pgmap v21629: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 971 KiB/s wr, 12 op/s 2023-05-08T14:58:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:35 smithi186 ceph-mon[126480]: pgmap v21629: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 971 KiB/s wr, 12 op/s 2023-05-08T14:58:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:37 smithi133 ceph-mon[125939]: pgmap v21630: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1010 KiB/s rd, 804 KiB/s wr, 10 op/s 2023-05-08T14:58:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:37 smithi096 ceph-mon[124666]: pgmap v21630: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1010 KiB/s rd, 804 KiB/s wr, 10 op/s 2023-05-08T14:58:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:37 smithi186 ceph-mon[126480]: pgmap v21630: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1010 KiB/s rd, 804 KiB/s wr, 10 op/s 2023-05-08T14:58:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:39 smithi133 ceph-mon[125939]: pgmap v21631: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1010 KiB/s rd, 804 KiB/s wr, 10 op/s 2023-05-08T14:58:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40458.497366 secs 2023-05-08T14:58:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:39 smithi096 ceph-mon[124666]: pgmap v21631: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1010 KiB/s rd, 804 KiB/s wr, 10 op/s 2023-05-08T14:58:40.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40458.497366 secs 2023-05-08T14:58:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:39 smithi186 ceph-mon[126480]: pgmap v21631: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1010 KiB/s rd, 804 KiB/s wr, 10 op/s 2023-05-08T14:58:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40458.497366 secs 2023-05-08T14:58:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:41 smithi133 ceph-mon[125939]: pgmap v21632: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 686 KiB/s rd, 488 KiB/s wr, 9 op/s 2023-05-08T14:58:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40460.392554 secs 2023-05-08T14:58:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:41 smithi096 ceph-mon[124666]: pgmap v21632: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 686 KiB/s rd, 488 KiB/s wr, 9 op/s 2023-05-08T14:58:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40460.392554 secs 2023-05-08T14:58:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:41 smithi186 ceph-mon[126480]: pgmap v21632: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 686 KiB/s rd, 488 KiB/s wr, 9 op/s 2023-05-08T14:58:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40460.392554 secs 2023-05-08T14:58:43.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:42 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:58:43.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:42 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:58:43.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:42 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:58:43.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:42 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:58:43.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:42 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:58:43.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:42 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:58:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:42 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:58:43.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:42 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:58:43.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:42 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:58:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:43 smithi133 ceph-mon[125939]: pgmap v21633: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 686 KiB/s rd, 488 KiB/s wr, 9 op/s 2023-05-08T14:58:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:43 smithi096 ceph-mon[124666]: pgmap v21633: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 686 KiB/s rd, 488 KiB/s wr, 9 op/s 2023-05-08T14:58:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:43 smithi186 ceph-mon[126480]: pgmap v21633: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 686 KiB/s rd, 488 KiB/s wr, 9 op/s 2023-05-08T14:58:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40463.497498 secs 2023-05-08T14:58:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40464.051511 secs 2023-05-08T14:58:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40463.497498 secs 2023-05-08T14:58:45.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40464.051511 secs 2023-05-08T14:58:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40463.497498 secs 2023-05-08T14:58:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40464.051511 secs 2023-05-08T14:58:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:45 smithi133 ceph-mon[125939]: pgmap v21634: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.7 MiB/s wr, 17 op/s 2023-05-08T14:58:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:45 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:58:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:45 smithi096 ceph-mon[124666]: pgmap v21634: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.7 MiB/s wr, 17 op/s 2023-05-08T14:58:46.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:45 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:58:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:45 smithi186 ceph-mon[126480]: pgmap v21634: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.7 MiB/s wr, 17 op/s 2023-05-08T14:58:46.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:45 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:58:47.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:46 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:58:47.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:46 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:58:47.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:46 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:58:47.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:46 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:58:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:46 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:58:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:46 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:58:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:47 smithi133 ceph-mon[125939]: pgmap v21635: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T14:58:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:47 smithi096 ceph-mon[124666]: pgmap v21635: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T14:58:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:47 smithi186 ceph-mon[126480]: pgmap v21635: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T14:58:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:49 smithi186 ceph-mon[126480]: pgmap v21636: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T14:58:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:49 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:58:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:49 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:58:49.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:49 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:58:49.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:49 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:58:49.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:49 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:58:49.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:49 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:58:49.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40468.497567 secs 2023-05-08T14:58:49.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:49 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:58:49.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:58:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:49 smithi133 ceph-mon[125939]: pgmap v21636: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T14:58:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:49 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:58:49.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:49 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:58:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:49 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:58:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:49 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:58:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:49 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:58:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:49 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:58:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40468.497567 secs 2023-05-08T14:58:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:49 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:58:49.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:58:49.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:49 smithi096 ceph-mon[124666]: pgmap v21636: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T14:58:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:49 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:58:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:49 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:58:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:49 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:58:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:49 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:58:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:49 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:58:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:49 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:58:49.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40468.497567 secs 2023-05-08T14:58:49.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:49 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:58:49.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:58:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:50 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:58:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:58:50.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:58:50.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:58:50.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:58:50.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:58:50.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:58:50.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:58:50.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:58:50.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:58:50.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:58:50.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:58:50.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:58:50.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:58:50.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:58:50.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:58:50.621 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:50 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi186 to 64369k 2023-05-08T14:58:50.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:50 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi133 to 114.3M 2023-05-08T14:58:50.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:50 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi186 to 65914753: error parsing value: Value '65914753' is below minimum 939524096 2023-05-08T14:58:50.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:50 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi133 to 119853076: error parsing value: Value '119853076' is below minimum 939524096 2023-05-08T14:58:50.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:58:50.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:58:50.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:50 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:58:50.622 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:58:50.623 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:50 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T14:58:50.623 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:50 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T14:58:50.623 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:50 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:58:50.623 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:58:50.623 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:58:50.623 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:58:50.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:50 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:58:50.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:58:50.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:58:50.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:58:50.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:58:50.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:58:50.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:58:50.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:58:50.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:58:50.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:58:50.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:58:50.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:58:50.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:58:50.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:58:50.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:58:50.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:58:50.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:50 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi186 to 64369k 2023-05-08T14:58:50.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:50 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi133 to 114.3M 2023-05-08T14:58:50.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:50 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi186 to 65914753: error parsing value: Value '65914753' is below minimum 939524096 2023-05-08T14:58:50.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:50 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi133 to 119853076: error parsing value: Value '119853076' is below minimum 939524096 2023-05-08T14:58:50.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:58:50.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:58:50.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:50 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:58:50.744 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:58:50.744 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:50 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T14:58:50.744 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:50 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T14:58:50.744 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:50 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:58:50.744 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:58:50.744 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:58:50.744 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:58:50.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:50 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:58:50.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:58:50.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:58:50.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:58:50.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:58:50.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:58:50.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:58:50.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:58:50.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:58:50.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:58:50.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:58:50.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:58:50.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:58:50.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:58:50.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:58:50.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T14:58:50.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:50 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi186 to 64369k 2023-05-08T14:58:50.759 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:50 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi133 to 114.3M 2023-05-08T14:58:50.759 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:50 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi186 to 65914753: error parsing value: Value '65914753' is below minimum 939524096 2023-05-08T14:58:50.759 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:50 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi133 to 119853076: error parsing value: Value '119853076' is below minimum 939524096 2023-05-08T14:58:50.762 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:58:50.762 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:58:50.762 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:50 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:58:50.763 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:58:50.763 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:50 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T14:58:50.763 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:50 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T14:58:50.764 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:50 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:58:50.764 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:58:50.764 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:58:50.764 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:58:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:51 smithi133 ceph-mon[125939]: pgmap v21637: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.0 MiB/s wr, 17 op/s 2023-05-08T14:58:52.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40470.392784 secs 2023-05-08T14:58:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:51 smithi096 ceph-mon[124666]: pgmap v21637: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.0 MiB/s wr, 17 op/s 2023-05-08T14:58:52.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40470.392784 secs 2023-05-08T14:58:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:51 smithi186 ceph-mon[126480]: pgmap v21637: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.0 MiB/s wr, 17 op/s 2023-05-08T14:58:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40470.392784 secs 2023-05-08T14:58:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:53 smithi133 ceph-mon[125939]: pgmap v21638: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.3 MiB/s wr, 13 op/s 2023-05-08T14:58:54.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:53 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:58:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:53 smithi096 ceph-mon[124666]: pgmap v21638: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.3 MiB/s wr, 13 op/s 2023-05-08T14:58:54.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:53 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:58:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:53 smithi186 ceph-mon[126480]: pgmap v21638: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.3 MiB/s wr, 13 op/s 2023-05-08T14:58:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:53 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:58:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40473.497685 secs 2023-05-08T14:58:55.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:54 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:58:55.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:54 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:58:55.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40474.051759 secs 2023-05-08T14:58:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40473.497685 secs 2023-05-08T14:58:55.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:54 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:58:55.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:54 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:58:55.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40474.051759 secs 2023-05-08T14:58:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40473.497685 secs 2023-05-08T14:58:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:54 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:58:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:54 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:58:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40474.051759 secs 2023-05-08T14:58:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:55 smithi133 ceph-mon[125939]: pgmap v21639: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.3 MiB/s wr, 18 op/s 2023-05-08T14:58:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40475.392863 secs 2023-05-08T14:58:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:55 smithi096 ceph-mon[124666]: pgmap v21639: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.3 MiB/s wr, 18 op/s 2023-05-08T14:58:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40475.392863 secs 2023-05-08T14:58:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:55 smithi186 ceph-mon[126480]: pgmap v21639: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.3 MiB/s wr, 18 op/s 2023-05-08T14:58:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40475.392863 secs 2023-05-08T14:58:58.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:57 smithi133 ceph-mon[125939]: pgmap v21640: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 13 op/s 2023-05-08T14:58:58.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:57 smithi096 ceph-mon[124666]: pgmap v21640: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 13 op/s 2023-05-08T14:58:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:57 smithi186 ceph-mon[126480]: pgmap v21640: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 13 op/s 2023-05-08T14:58:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:58:59.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:58:59.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:58 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:58:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:58:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:58:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:58 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:58:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:58:59.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:58:59.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:58 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:59:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:59 smithi096 ceph-mon[124666]: pgmap v21641: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 13 op/s 2023-05-08T14:59:00.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40478.497805 secs 2023-05-08T14:59:00.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:58:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40479.051896 secs 2023-05-08T14:59:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:59 smithi186 ceph-mon[126480]: pgmap v21641: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 13 op/s 2023-05-08T14:59:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40478.497805 secs 2023-05-08T14:59:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:58:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40479.051896 secs 2023-05-08T14:59:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:59 smithi133 ceph-mon[125939]: pgmap v21641: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 13 op/s 2023-05-08T14:59:00.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40478.497805 secs 2023-05-08T14:59:00.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:58:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40479.051896 secs 2023-05-08T14:59:01.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:59:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40480.392980 secs 2023-05-08T14:59:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:59:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40480.392980 secs 2023-05-08T14:59:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:59:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40480.392980 secs 2023-05-08T14:59:02.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:59:01 smithi096 ceph-mon[124666]: pgmap v21642: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.4 MiB/s wr, 18 op/s 2023-05-08T14:59:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:59:01 smithi186 ceph-mon[126480]: pgmap v21642: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.4 MiB/s wr, 18 op/s 2023-05-08T14:59:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:59:01 smithi133 ceph-mon[125939]: pgmap v21642: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.4 MiB/s wr, 18 op/s 2023-05-08T14:59:04.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:59:04 smithi096 ceph-mon[124666]: pgmap v21643: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T14:59:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:59:04 smithi186 ceph-mon[126480]: pgmap v21643: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T14:59:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:59:04 smithi133 ceph-mon[125939]: pgmap v21643: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T14:59:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:59:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40483.497950 secs 2023-05-08T14:59:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:59:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40484.052028 secs 2023-05-08T14:59:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:59:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40483.497950 secs 2023-05-08T14:59:05.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:59:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40484.052028 secs 2023-05-08T14:59:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:59:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40483.497950 secs 2023-05-08T14:59:05.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:59:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40484.052028 secs 2023-05-08T14:59:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:59:06 smithi186 ceph-mon[126480]: pgmap v21644: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.0 MiB/s wr, 33 op/s 2023-05-08T14:59:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:59:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40485.393067 secs 2023-05-08T14:59:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:59:06 smithi133 ceph-mon[125939]: pgmap v21644: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.0 MiB/s wr, 33 op/s 2023-05-08T14:59:06.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:59:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40485.393067 secs 2023-05-08T14:59:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:59:06 smithi096 ceph-mon[124666]: pgmap v21644: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.0 MiB/s wr, 33 op/s 2023-05-08T14:59:06.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:59:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40485.393067 secs 2023-05-08T14:59:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:59:07 smithi186 ceph-mon[126480]: osdmap e1430: 12 total, 12 up, 12 in 2023-05-08T14:59:07.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:59:07 smithi186 ceph-mon[126480]: pgmap v21646: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 32 op/s 2023-05-08T14:59:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:59:07 smithi133 ceph-mon[125939]: osdmap e1430: 12 total, 12 up, 12 in 2023-05-08T14:59:07.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:59:07 smithi133 ceph-mon[125939]: pgmap v21646: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 32 op/s 2023-05-08T14:59:07.510 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:59:07 smithi096 ceph-mon[124666]: osdmap e1430: 12 total, 12 up, 12 in 2023-05-08T14:59:07.511 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:59:07 smithi096 ceph-mon[124666]: pgmap v21646: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 32 op/s 2023-05-08T14:59:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:59:09 smithi133 ceph-mon[125939]: pgmap v21647: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 32 op/s 2023-05-08T14:59:10.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:59:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40488.498022 secs 2023-05-08T14:59:10.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:59:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40489.052167 secs 2023-05-08T14:59:10.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:59:09 smithi096 ceph-mon[124666]: pgmap v21647: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 32 op/s 2023-05-08T14:59:10.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:59:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40488.498022 secs 2023-05-08T14:59:10.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:59:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40489.052167 secs 2023-05-08T14:59:10.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:59:09 smithi186 ceph-mon[126480]: pgmap v21647: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 32 op/s 2023-05-08T14:59:10.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:59:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40488.498022 secs 2023-05-08T14:59:10.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:59:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40489.052167 secs 2023-05-08T14:59:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:59:11 smithi133 ceph-mon[125939]: pgmap v21648: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 33 op/s 2023-05-08T14:59:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:59:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40490.393186 secs 2023-05-08T14:59:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:59:11 smithi096 ceph-mon[124666]: pgmap v21648: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 33 op/s 2023-05-08T14:59:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:59:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40490.393186 secs 2023-05-08T14:59:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:59:11 smithi186 ceph-mon[126480]: pgmap v21648: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 33 op/s 2023-05-08T14:59:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:59:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40490.393186 secs 2023-05-08T14:59:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:59:13 smithi133 ceph-mon[125939]: pgmap v21649: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 32 op/s 2023-05-08T14:59:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:59:13 smithi133 ceph-mon[125939]: osdmap e1431: 12 total, 12 up, 12 in 2023-05-08T14:59:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:59:13 smithi096 ceph-mon[124666]: pgmap v21649: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 32 op/s 2023-05-08T14:59:14.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:59:13 smithi096 ceph-mon[124666]: osdmap e1431: 12 total, 12 up, 12 in 2023-05-08T14:59:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:59:13 smithi186 ceph-mon[126480]: pgmap v21649: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 32 op/s 2023-05-08T14:59:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:59:13 smithi186 ceph-mon[126480]: osdmap e1431: 12 total, 12 up, 12 in 2023-05-08T14:59:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:59:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40493.498163 secs 2023-05-08T14:59:15.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:59:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40494.052300 secs 2023-05-08T14:59:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:59:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40493.498163 secs 2023-05-08T14:59:15.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:59:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40494.052300 secs 2023-05-08T14:59:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:59:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40493.498163 secs 2023-05-08T14:59:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:59:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40494.052300 secs 2023-05-08T14:59:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:59:15 smithi133 ceph-mon[125939]: pgmap v21651: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 15 op/s 2023-05-08T14:59:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:59:15 smithi096 ceph-mon[124666]: pgmap v21651: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 15 op/s 2023-05-08T14:59:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:59:15 smithi186 ceph-mon[126480]: pgmap v21651: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 15 op/s 2023-05-08T14:59:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:59:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40495.393251 secs 2023-05-08T14:59:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:59:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40495.393251 secs 2023-05-08T14:59:17.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:59:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40495.393251 secs 2023-05-08T14:59:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:59:17 smithi133 ceph-mon[125939]: pgmap v21652: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2023-05-08T14:59:18.457 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:59:17 smithi186 ceph-mon[126480]: pgmap v21652: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2023-05-08T14:59:18.458 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:59:17 smithi096 ceph-mon[124666]: pgmap v21652: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2023-05-08T14:59:20.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:59:19 smithi133 ceph-mon[125939]: pgmap v21653: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2023-05-08T14:59:20.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:59:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40498.498282 secs 2023-05-08T14:59:20.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:59:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40499.052393 secs 2023-05-08T14:59:20.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:59:19 smithi096 ceph-mon[124666]: pgmap v21653: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2023-05-08T14:59:20.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:59:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40498.498282 secs 2023-05-08T14:59:20.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:59:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40499.052393 secs 2023-05-08T14:59:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:59:19 smithi186 ceph-mon[126480]: pgmap v21653: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2023-05-08T14:59:20.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:59:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40498.498282 secs 2023-05-08T14:59:20.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:59:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40499.052393 secs 2023-05-08T14:59:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:59:21 smithi133 ceph-mon[125939]: pgmap v21654: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 884 KiB/s rd, 918 KiB/s wr, 10 op/s 2023-05-08T14:59:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:59:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40500.393390 secs 2023-05-08T14:59:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:59:21 smithi096 ceph-mon[124666]: pgmap v21654: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 884 KiB/s rd, 918 KiB/s wr, 10 op/s 2023-05-08T14:59:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:59:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40500.393390 secs 2023-05-08T14:59:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:59:21 smithi186 ceph-mon[126480]: pgmap v21654: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 884 KiB/s rd, 918 KiB/s wr, 10 op/s 2023-05-08T14:59:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:59:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40500.393390 secs 2023-05-08T14:59:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:59:23 smithi133 ceph-mon[125939]: pgmap v21655: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 884 KiB/s rd, 918 KiB/s wr, 10 op/s 2023-05-08T14:59:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:59:23 smithi096 ceph-mon[124666]: pgmap v21655: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 884 KiB/s rd, 918 KiB/s wr, 10 op/s 2023-05-08T14:59:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:59:23 smithi186 ceph-mon[126480]: pgmap v21655: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 884 KiB/s rd, 918 KiB/s wr, 10 op/s 2023-05-08T14:59:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:59:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40503.498381 secs 2023-05-08T14:59:25.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:59:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40504.052525 secs 2023-05-08T14:59:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:59:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40503.498381 secs 2023-05-08T14:59:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:59:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40504.052525 secs 2023-05-08T14:59:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:59:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40503.498381 secs 2023-05-08T14:59:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:59:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40504.052525 secs 2023-05-08T14:59:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:59:25 smithi133 ceph-mon[125939]: pgmap v21656: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 895 KiB/s rd, 892 KiB/s wr, 14 op/s 2023-05-08T14:59:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:59:25 smithi096 ceph-mon[124666]: pgmap v21656: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 895 KiB/s rd, 892 KiB/s wr, 14 op/s 2023-05-08T14:59:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:59:25 smithi186 ceph-mon[126480]: pgmap v21656: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 895 KiB/s rd, 892 KiB/s wr, 14 op/s 2023-05-08T14:59:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:59:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40505.393489 secs 2023-05-08T14:59:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:59:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40505.393489 secs 2023-05-08T14:59:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:59:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40505.393489 secs 2023-05-08T14:59:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:59:27 smithi133 ceph-mon[125939]: pgmap v21657: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 178 KiB/s wr, 7 op/s 2023-05-08T14:59:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:59:27 smithi096 ceph-mon[124666]: pgmap v21657: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 178 KiB/s wr, 7 op/s 2023-05-08T14:59:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:59:27 smithi186 ceph-mon[126480]: pgmap v21657: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 178 KiB/s wr, 7 op/s 2023-05-08T14:59:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:59:29 smithi133 ceph-mon[125939]: pgmap v21658: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 178 KiB/s wr, 7 op/s 2023-05-08T14:59:30.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:59:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40508.498468 secs 2023-05-08T14:59:30.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:59:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40509.052694 secs 2023-05-08T14:59:30.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:59:29 smithi096 ceph-mon[124666]: pgmap v21658: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 178 KiB/s wr, 7 op/s 2023-05-08T14:59:30.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:59:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40508.498468 secs 2023-05-08T14:59:30.258 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:59:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40509.052694 secs 2023-05-08T14:59:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:59:29 smithi186 ceph-mon[126480]: pgmap v21658: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 178 KiB/s wr, 7 op/s 2023-05-08T14:59:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:59:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40508.498468 secs 2023-05-08T14:59:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:59:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40509.052694 secs 2023-05-08T14:59:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:59:31 smithi133 ceph-mon[125939]: pgmap v21659: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 509 KiB/s rd, 506 KiB/s wr, 11 op/s 2023-05-08T14:59:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:59:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40510.393583 secs 2023-05-08T14:59:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:59:31 smithi096 ceph-mon[124666]: pgmap v21659: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 509 KiB/s rd, 506 KiB/s wr, 11 op/s 2023-05-08T14:59:32.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:59:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40510.393583 secs 2023-05-08T14:59:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:59:31 smithi186 ceph-mon[126480]: pgmap v21659: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 509 KiB/s rd, 506 KiB/s wr, 11 op/s 2023-05-08T14:59:32.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:59:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40510.393583 secs 2023-05-08T14:59:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:59:33 smithi133 ceph-mon[125939]: pgmap v21660: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 328 KiB/s wr, 8 op/s 2023-05-08T14:59:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:59:33 smithi096 ceph-mon[124666]: pgmap v21660: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 328 KiB/s wr, 8 op/s 2023-05-08T14:59:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:59:33 smithi186 ceph-mon[126480]: pgmap v21660: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 328 KiB/s wr, 8 op/s 2023-05-08T14:59:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:59:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40513.498577 secs 2023-05-08T14:59:35.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:59:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40514.052764 secs 2023-05-08T14:59:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:59:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40513.498577 secs 2023-05-08T14:59:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:59:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40514.052764 secs 2023-05-08T14:59:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:59:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40513.498577 secs 2023-05-08T14:59:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:59:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40514.052764 secs 2023-05-08T14:59:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:59:35 smithi133 ceph-mon[125939]: pgmap v21661: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 729 KiB/s rd, 696 KiB/s wr, 11 op/s 2023-05-08T14:59:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:59:35 smithi096 ceph-mon[124666]: pgmap v21661: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 729 KiB/s rd, 696 KiB/s wr, 11 op/s 2023-05-08T14:59:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:59:35 smithi186 ceph-mon[126480]: pgmap v21661: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 729 KiB/s rd, 696 KiB/s wr, 11 op/s 2023-05-08T14:59:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:59:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40515.393718 secs 2023-05-08T14:59:37.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:59:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40515.393718 secs 2023-05-08T14:59:37.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:59:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40515.393718 secs 2023-05-08T14:59:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:59:37 smithi133 ceph-mon[125939]: pgmap v21662: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 697 KiB/s rd, 695 KiB/s wr, 8 op/s 2023-05-08T14:59:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:59:37 smithi096 ceph-mon[124666]: pgmap v21662: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 697 KiB/s rd, 695 KiB/s wr, 8 op/s 2023-05-08T14:59:38.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:59:37 smithi186 ceph-mon[126480]: pgmap v21662: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 697 KiB/s rd, 695 KiB/s wr, 8 op/s 2023-05-08T14:59:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:59:39 smithi133 ceph-mon[125939]: pgmap v21663: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 697 KiB/s rd, 695 KiB/s wr, 8 op/s 2023-05-08T14:59:40.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:59:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40518.498658 secs 2023-05-08T14:59:40.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:59:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40519.052873 secs 2023-05-08T14:59:40.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:59:39 smithi096 ceph-mon[124666]: pgmap v21663: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 697 KiB/s rd, 695 KiB/s wr, 8 op/s 2023-05-08T14:59:40.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:59:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40518.498658 secs 2023-05-08T14:59:40.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:59:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40519.052873 secs 2023-05-08T14:59:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:59:39 smithi186 ceph-mon[126480]: pgmap v21663: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 697 KiB/s rd, 695 KiB/s wr, 8 op/s 2023-05-08T14:59:40.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:59:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40518.498658 secs 2023-05-08T14:59:40.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:59:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40519.052873 secs 2023-05-08T14:59:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:59:41 smithi133 ceph-mon[125939]: pgmap v21664: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 762 KiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T14:59:42.332 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:59:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40520.393847 secs 2023-05-08T14:59:42.333 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:59:41 smithi096 ceph-mon[124666]: pgmap v21664: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 762 KiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T14:59:42.333 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:59:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40520.393847 secs 2023-05-08T14:59:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:59:41 smithi186 ceph-mon[126480]: pgmap v21664: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 762 KiB/s rd, 1.0 MiB/s wr, 11 op/s 2023-05-08T14:59:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:59:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40520.393847 secs 2023-05-08T14:59:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:59:43 smithi133 ceph-mon[125939]: pgmap v21665: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 732 KiB/s wr, 7 op/s 2023-05-08T14:59:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:59:43 smithi096 ceph-mon[124666]: pgmap v21665: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 732 KiB/s wr, 7 op/s 2023-05-08T14:59:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:59:43 smithi186 ceph-mon[126480]: pgmap v21665: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 732 KiB/s wr, 7 op/s 2023-05-08T14:59:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:59:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40523.498779 secs 2023-05-08T14:59:45.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:59:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40524.053032 secs 2023-05-08T14:59:45.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:59:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40523.498779 secs 2023-05-08T14:59:45.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:59:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40524.053032 secs 2023-05-08T14:59:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:59:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40523.498779 secs 2023-05-08T14:59:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:59:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40524.053032 secs 2023-05-08T14:59:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:59:45 smithi133 ceph-mon[125939]: pgmap v21666: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 955 KiB/s rd, 952 KiB/s wr, 10 op/s 2023-05-08T14:59:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:59:45 smithi096 ceph-mon[124666]: pgmap v21666: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 955 KiB/s rd, 952 KiB/s wr, 10 op/s 2023-05-08T14:59:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:59:45 smithi186 ceph-mon[126480]: pgmap v21666: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 955 KiB/s rd, 952 KiB/s wr, 10 op/s 2023-05-08T14:59:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:59:47 smithi133 ceph-mon[125939]: pgmap v21667: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 587 KiB/s rd, 585 KiB/s wr, 7 op/s 2023-05-08T14:59:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:59:47 smithi096 ceph-mon[124666]: pgmap v21667: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 587 KiB/s rd, 585 KiB/s wr, 7 op/s 2023-05-08T14:59:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:59:47 smithi186 ceph-mon[126480]: pgmap v21667: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 587 KiB/s rd, 585 KiB/s wr, 7 op/s 2023-05-08T14:59:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:59:49 smithi133 ceph-mon[125939]: pgmap v21668: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 587 KiB/s rd, 585 KiB/s wr, 7 op/s 2023-05-08T14:59:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:59:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40528.498901 secs 2023-05-08T14:59:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:59:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40529.053170 secs 2023-05-08T14:59:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:59:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:59:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:59:49 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:59:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:59:49 smithi096 ceph-mon[124666]: pgmap v21668: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 587 KiB/s rd, 585 KiB/s wr, 7 op/s 2023-05-08T14:59:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:59:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40528.498901 secs 2023-05-08T14:59:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:59:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40529.053170 secs 2023-05-08T14:59:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:59:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:59:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:59:49 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:59:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:59:49 smithi186 ceph-mon[126480]: pgmap v21668: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 587 KiB/s rd, 585 KiB/s wr, 7 op/s 2023-05-08T14:59:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:59:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40528.498901 secs 2023-05-08T14:59:50.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:59:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40529.053170 secs 2023-05-08T14:59:50.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:59:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:59:50.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:59:49 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T14:59:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:59:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:59:51.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:59:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:59:51.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:59:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:59:51.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:59:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:59:51.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:59:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:59:51.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:59:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:59:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:59:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:59:51.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:59:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:59:51.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:59:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:59:51.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:59:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:59:51.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:59:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:59:51.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:59:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:59:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:59:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T14:59:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:59:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:59:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:59:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:59:51.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:59:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T14:59:51.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:59:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T14:59:51.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:59:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T14:59:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:59:51 smithi133 ceph-mon[125939]: pgmap v21669: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1012 KiB/s rd, 1009 KiB/s wr, 11 op/s 2023-05-08T14:59:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:59:51 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:59:52.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:59:51 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T14:59:52.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:59:51 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T14:59:52.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:59:51 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T14:59:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:59:51 smithi096 ceph-mon[124666]: pgmap v21669: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1012 KiB/s rd, 1009 KiB/s wr, 11 op/s 2023-05-08T14:59:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:59:51 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:59:52.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:59:51 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T14:59:52.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:59:51 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T14:59:52.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:59:51 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T14:59:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:59:51 smithi186 ceph-mon[126480]: pgmap v21669: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1012 KiB/s rd, 1009 KiB/s wr, 11 op/s 2023-05-08T14:59:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:59:51 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:59:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:59:51 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T14:59:52.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:59:51 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T14:59:52.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:59:51 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T14:59:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:59:53 smithi096 ceph-mon[124666]: pgmap v21670: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 948 KiB/s rd, 645 KiB/s wr, 7 op/s 2023-05-08T14:59:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:59:53 smithi186 ceph-mon[126480]: pgmap v21670: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 948 KiB/s rd, 645 KiB/s wr, 7 op/s 2023-05-08T14:59:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:59:53 smithi133 ceph-mon[125939]: pgmap v21670: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 948 KiB/s rd, 645 KiB/s wr, 7 op/s 2023-05-08T14:59:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:59:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40533.499025 secs 2023-05-08T14:59:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:59:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40533.499025 secs 2023-05-08T14:59:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:59:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40533.499025 secs 2023-05-08T14:59:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:59:55 smithi096 ceph-mon[124666]: pgmap v21671: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 13 op/s 2023-05-08T14:59:56.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:59:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40535.394188 secs 2023-05-08T14:59:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:59:55 smithi186 ceph-mon[126480]: pgmap v21671: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 13 op/s 2023-05-08T14:59:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:59:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40535.394188 secs 2023-05-08T14:59:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:59:55 smithi133 ceph-mon[125939]: pgmap v21671: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 13 op/s 2023-05-08T14:59:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:59:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40535.394188 secs 2023-05-08T14:59:58.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:59:58 smithi186 ceph-mon[126480]: pgmap v21672: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.8 MiB/s wr, 10 op/s 2023-05-08T14:59:58.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:59:58 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:59:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:59:58 smithi133 ceph-mon[125939]: pgmap v21672: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.8 MiB/s wr, 10 op/s 2023-05-08T14:59:58.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:59:58 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:59:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:59:58 smithi096 ceph-mon[124666]: pgmap v21672: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.8 MiB/s wr, 10 op/s 2023-05-08T14:59:58.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:59:58 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T14:59:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:59:59 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:59:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:59:59 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:59:59.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 14:59:59 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:59:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:59:59 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:59:59.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:59:59 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:59:59.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 14:59:59 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T14:59:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:59:59 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T14:59:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:59:59 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T14:59:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 14:59:59 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:00:00.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:00 smithi186 ceph-mon[126480]: pgmap v21673: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.8 MiB/s wr, 10 op/s 2023-05-08T15:00:00.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40538.499157 secs 2023-05-08T15:00:00.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40539.053392 secs 2023-05-08T15:00:00.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:00 smithi186 ceph-mon[126480]: overall HEALTH_WARN 2 MDSs report slow requests 2023-05-08T15:00:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:00 smithi133 ceph-mon[125939]: pgmap v21673: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.8 MiB/s wr, 10 op/s 2023-05-08T15:00:00.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40538.499157 secs 2023-05-08T15:00:00.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40539.053392 secs 2023-05-08T15:00:00.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:00 smithi133 ceph-mon[125939]: overall HEALTH_WARN 2 MDSs report slow requests 2023-05-08T15:00:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:00 smithi096 ceph-mon[124666]: pgmap v21673: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.8 MiB/s wr, 10 op/s 2023-05-08T15:00:00.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40538.499157 secs 2023-05-08T15:00:00.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40539.053392 secs 2023-05-08T15:00:00.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:00 smithi096 ceph-mon[124666]: overall HEALTH_WARN 2 MDSs report slow requests 2023-05-08T15:00:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40540.394326 secs 2023-05-08T15:00:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40540.394326 secs 2023-05-08T15:00:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40540.394326 secs 2023-05-08T15:00:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:02 smithi186 ceph-mon[126480]: pgmap v21674: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.1 MiB/s wr, 17 op/s 2023-05-08T15:00:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:02 smithi133 ceph-mon[125939]: pgmap v21674: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.1 MiB/s wr, 17 op/s 2023-05-08T15:00:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:02 smithi096 ceph-mon[124666]: pgmap v21674: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.1 MiB/s wr, 17 op/s 2023-05-08T15:00:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:03 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:00:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:00:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:03 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:00:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:03 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:00:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:00:03.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:03 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:00:03.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:03 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:00:03.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:00:03.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:03 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:00:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:04 smithi186 ceph-mon[126480]: pgmap v21675: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.7 MiB/s wr, 13 op/s 2023-05-08T15:00:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:04 smithi133 ceph-mon[125939]: pgmap v21675: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.7 MiB/s wr, 13 op/s 2023-05-08T15:00:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:04 smithi096 ceph-mon[124666]: pgmap v21675: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.7 MiB/s wr, 13 op/s 2023-05-08T15:00:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40543.499277 secs 2023-05-08T15:00:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:05 smithi186 ceph-mon[126480]: pgmap v21676: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.1 MiB/s wr, 35 op/s 2023-05-08T15:00:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40544.053534 secs 2023-05-08T15:00:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40543.499277 secs 2023-05-08T15:00:05.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:05 smithi133 ceph-mon[125939]: pgmap v21676: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.1 MiB/s wr, 35 op/s 2023-05-08T15:00:05.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40544.053534 secs 2023-05-08T15:00:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40543.499277 secs 2023-05-08T15:00:05.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:05 smithi096 ceph-mon[124666]: pgmap v21676: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.1 MiB/s wr, 35 op/s 2023-05-08T15:00:05.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40544.053534 secs 2023-05-08T15:00:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40545.394443 secs 2023-05-08T15:00:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40545.394443 secs 2023-05-08T15:00:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40545.394443 secs 2023-05-08T15:00:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:07 smithi186 ceph-mon[126480]: pgmap v21677: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.1 MiB/s wr, 29 op/s 2023-05-08T15:00:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:07 smithi133 ceph-mon[125939]: pgmap v21677: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.1 MiB/s wr, 29 op/s 2023-05-08T15:00:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:07 smithi096 ceph-mon[124666]: pgmap v21677: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.1 MiB/s wr, 29 op/s 2023-05-08T15:00:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:09 smithi133 ceph-mon[125939]: pgmap v21678: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 2.7 MiB/s wr, 28 op/s 2023-05-08T15:00:10.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40548.499422 secs 2023-05-08T15:00:10.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40549.053642 secs 2023-05-08T15:00:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:09 smithi096 ceph-mon[124666]: pgmap v21678: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 2.7 MiB/s wr, 28 op/s 2023-05-08T15:00:10.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40548.499422 secs 2023-05-08T15:00:10.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40549.053642 secs 2023-05-08T15:00:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:09 smithi186 ceph-mon[126480]: pgmap v21678: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 2.7 MiB/s wr, 28 op/s 2023-05-08T15:00:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40548.499422 secs 2023-05-08T15:00:10.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40549.053642 secs 2023-05-08T15:00:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:11 smithi133 ceph-mon[125939]: pgmap v21679: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.4 MiB/s wr, 34 op/s 2023-05-08T15:00:12.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40550.394559 secs 2023-05-08T15:00:12.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:11 smithi133 ceph-mon[125939]: osdmap e1432: 12 total, 12 up, 12 in 2023-05-08T15:00:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:11 smithi096 ceph-mon[124666]: pgmap v21679: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.4 MiB/s wr, 34 op/s 2023-05-08T15:00:12.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40550.394559 secs 2023-05-08T15:00:12.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:11 smithi096 ceph-mon[124666]: osdmap e1432: 12 total, 12 up, 12 in 2023-05-08T15:00:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:11 smithi186 ceph-mon[126480]: pgmap v21679: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.4 MiB/s wr, 34 op/s 2023-05-08T15:00:12.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40550.394559 secs 2023-05-08T15:00:12.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:11 smithi186 ceph-mon[126480]: osdmap e1432: 12 total, 12 up, 12 in 2023-05-08T15:00:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:13 smithi133 ceph-mon[125939]: pgmap v21681: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.6 MiB/s wr, 32 op/s 2023-05-08T15:00:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:13 smithi096 ceph-mon[124666]: pgmap v21681: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.6 MiB/s wr, 32 op/s 2023-05-08T15:00:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:13 smithi186 ceph-mon[126480]: pgmap v21681: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.6 MiB/s wr, 32 op/s 2023-05-08T15:00:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40553.499561 secs 2023-05-08T15:00:15.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40554.053768 secs 2023-05-08T15:00:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40553.499561 secs 2023-05-08T15:00:15.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40554.053768 secs 2023-05-08T15:00:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40553.499561 secs 2023-05-08T15:00:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40554.053768 secs 2023-05-08T15:00:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:15 smithi133 ceph-mon[125939]: pgmap v21682: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T15:00:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:15 smithi096 ceph-mon[124666]: pgmap v21682: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T15:00:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:15 smithi186 ceph-mon[126480]: pgmap v21682: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T15:00:17.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40555.394676 secs 2023-05-08T15:00:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40555.394676 secs 2023-05-08T15:00:17.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40555.394676 secs 2023-05-08T15:00:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:17 smithi133 ceph-mon[125939]: pgmap v21683: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T15:00:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:17 smithi096 ceph-mon[124666]: pgmap v21683: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T15:00:18.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:17 smithi186 ceph-mon[126480]: pgmap v21683: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T15:00:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:19 smithi133 ceph-mon[125939]: pgmap v21684: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T15:00:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40558.499703 secs 2023-05-08T15:00:20.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:19 smithi133 ceph-mon[125939]: osdmap e1433: 12 total, 12 up, 12 in 2023-05-08T15:00:20.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40559.053879 secs 2023-05-08T15:00:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:19 smithi096 ceph-mon[124666]: pgmap v21684: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T15:00:20.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40558.499703 secs 2023-05-08T15:00:20.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:19 smithi096 ceph-mon[124666]: osdmap e1433: 12 total, 12 up, 12 in 2023-05-08T15:00:20.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40559.053879 secs 2023-05-08T15:00:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:19 smithi186 ceph-mon[126480]: pgmap v21684: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T15:00:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40558.499703 secs 2023-05-08T15:00:20.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:19 smithi186 ceph-mon[126480]: osdmap e1433: 12 total, 12 up, 12 in 2023-05-08T15:00:20.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40559.053879 secs 2023-05-08T15:00:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:21 smithi133 ceph-mon[125939]: pgmap v21686: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T15:00:22.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40560.394811 secs 2023-05-08T15:00:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:21 smithi096 ceph-mon[124666]: pgmap v21686: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T15:00:22.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40560.394811 secs 2023-05-08T15:00:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:21 smithi186 ceph-mon[126480]: pgmap v21686: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T15:00:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40560.394811 secs 2023-05-08T15:00:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:23 smithi133 ceph-mon[125939]: pgmap v21687: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T15:00:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:23 smithi096 ceph-mon[124666]: pgmap v21687: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T15:00:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:23 smithi186 ceph-mon[126480]: pgmap v21687: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T15:00:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40563.499830 secs 2023-05-08T15:00:25.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40564.053995 secs 2023-05-08T15:00:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40563.499830 secs 2023-05-08T15:00:25.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40564.053995 secs 2023-05-08T15:00:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40563.499830 secs 2023-05-08T15:00:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40564.053995 secs 2023-05-08T15:00:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:25 smithi133 ceph-mon[125939]: pgmap v21688: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 650 KiB/s wr, 9 op/s 2023-05-08T15:00:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:25 smithi096 ceph-mon[124666]: pgmap v21688: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 650 KiB/s wr, 9 op/s 2023-05-08T15:00:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:25 smithi186 ceph-mon[126480]: pgmap v21688: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 650 KiB/s wr, 9 op/s 2023-05-08T15:00:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40565.394964 secs 2023-05-08T15:00:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40565.394964 secs 2023-05-08T15:00:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40565.394964 secs 2023-05-08T15:00:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:27 smithi133 ceph-mon[125939]: pgmap v21689: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 650 KiB/s wr, 9 op/s 2023-05-08T15:00:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:27 smithi096 ceph-mon[124666]: pgmap v21689: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 650 KiB/s wr, 9 op/s 2023-05-08T15:00:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:27 smithi186 ceph-mon[126480]: pgmap v21689: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 650 KiB/s wr, 9 op/s 2023-05-08T15:00:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:29 smithi133 ceph-mon[125939]: pgmap v21690: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 650 KiB/s wr, 9 op/s 2023-05-08T15:00:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40568.499928 secs 2023-05-08T15:00:30.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40569.054146 secs 2023-05-08T15:00:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:29 smithi096 ceph-mon[124666]: pgmap v21690: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 650 KiB/s wr, 9 op/s 2023-05-08T15:00:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40568.499928 secs 2023-05-08T15:00:30.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40569.054146 secs 2023-05-08T15:00:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:29 smithi186 ceph-mon[126480]: pgmap v21690: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 650 KiB/s wr, 9 op/s 2023-05-08T15:00:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40568.499928 secs 2023-05-08T15:00:30.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40569.054146 secs 2023-05-08T15:00:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:31 smithi133 ceph-mon[125939]: pgmap v21691: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 609 KiB/s rd, 606 KiB/s wr, 12 op/s 2023-05-08T15:00:32.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40570.395077 secs 2023-05-08T15:00:32.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:31 smithi096 ceph-mon[124666]: pgmap v21691: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 609 KiB/s rd, 606 KiB/s wr, 12 op/s 2023-05-08T15:00:32.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40570.395077 secs 2023-05-08T15:00:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:31 smithi186 ceph-mon[126480]: pgmap v21691: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 609 KiB/s rd, 606 KiB/s wr, 12 op/s 2023-05-08T15:00:32.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40570.395077 secs 2023-05-08T15:00:34.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:33 smithi133 ceph-mon[125939]: pgmap v21692: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 30 KiB/s wr, 7 op/s 2023-05-08T15:00:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:33 smithi096 ceph-mon[124666]: pgmap v21692: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 30 KiB/s wr, 7 op/s 2023-05-08T15:00:34.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:33 smithi186 ceph-mon[126480]: pgmap v21692: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 30 KiB/s wr, 7 op/s 2023-05-08T15:00:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40573.500072 secs 2023-05-08T15:00:35.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40574.054269 secs 2023-05-08T15:00:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40573.500072 secs 2023-05-08T15:00:35.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40574.054269 secs 2023-05-08T15:00:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40573.500072 secs 2023-05-08T15:00:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40574.054269 secs 2023-05-08T15:00:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:35 smithi133 ceph-mon[125939]: pgmap v21693: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 398 KiB/s wr, 12 op/s 2023-05-08T15:00:36.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:35 smithi096 ceph-mon[124666]: pgmap v21693: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 398 KiB/s wr, 12 op/s 2023-05-08T15:00:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:35 smithi186 ceph-mon[126480]: pgmap v21693: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 398 KiB/s wr, 12 op/s 2023-05-08T15:00:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40575.395193 secs 2023-05-08T15:00:37.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40575.395193 secs 2023-05-08T15:00:37.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40575.395193 secs 2023-05-08T15:00:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:37 smithi133 ceph-mon[125939]: pgmap v21694: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 398 KiB/s wr, 8 op/s 2023-05-08T15:00:38.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:37 smithi096 ceph-mon[124666]: pgmap v21694: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 398 KiB/s wr, 8 op/s 2023-05-08T15:00:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:37 smithi186 ceph-mon[126480]: pgmap v21694: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 398 KiB/s wr, 8 op/s 2023-05-08T15:00:40.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:39 smithi133 ceph-mon[125939]: pgmap v21695: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 398 KiB/s wr, 8 op/s 2023-05-08T15:00:40.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40578.500195 secs 2023-05-08T15:00:40.245 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40579.054384 secs 2023-05-08T15:00:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:39 smithi096 ceph-mon[124666]: pgmap v21695: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 398 KiB/s wr, 8 op/s 2023-05-08T15:00:40.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40578.500195 secs 2023-05-08T15:00:40.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40579.054384 secs 2023-05-08T15:00:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:39 smithi186 ceph-mon[126480]: pgmap v21695: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 398 KiB/s wr, 8 op/s 2023-05-08T15:00:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40578.500195 secs 2023-05-08T15:00:40.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40579.054384 secs 2023-05-08T15:00:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:41 smithi133 ceph-mon[125939]: pgmap v21696: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 398 KiB/s wr, 12 op/s 2023-05-08T15:00:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40580.395307 secs 2023-05-08T15:00:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:41 smithi096 ceph-mon[124666]: pgmap v21696: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 398 KiB/s wr, 12 op/s 2023-05-08T15:00:42.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40580.395307 secs 2023-05-08T15:00:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:41 smithi186 ceph-mon[126480]: pgmap v21696: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 398 KiB/s wr, 12 op/s 2023-05-08T15:00:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40580.395307 secs 2023-05-08T15:00:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:43 smithi133 ceph-mon[125939]: pgmap v21697: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 369 KiB/s wr, 8 op/s 2023-05-08T15:00:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:43 smithi096 ceph-mon[124666]: pgmap v21697: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 369 KiB/s wr, 8 op/s 2023-05-08T15:00:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:43 smithi186 ceph-mon[126480]: pgmap v21697: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 369 KiB/s wr, 8 op/s 2023-05-08T15:00:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40583.500358 secs 2023-05-08T15:00:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40584.054503 secs 2023-05-08T15:00:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40583.500358 secs 2023-05-08T15:00:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40584.054503 secs 2023-05-08T15:00:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40583.500358 secs 2023-05-08T15:00:45.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40584.054503 secs 2023-05-08T15:00:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:45 smithi133 ceph-mon[125939]: pgmap v21698: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 369 KiB/s wr, 10 op/s 2023-05-08T15:00:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:45 smithi096 ceph-mon[124666]: pgmap v21698: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 369 KiB/s wr, 10 op/s 2023-05-08T15:00:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:45 smithi186 ceph-mon[126480]: pgmap v21698: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 369 KiB/s wr, 10 op/s 2023-05-08T15:00:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:47 smithi133 ceph-mon[125939]: pgmap v21699: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 597 B/s wr, 6 op/s 2023-05-08T15:00:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:47 smithi096 ceph-mon[124666]: pgmap v21699: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 597 B/s wr, 6 op/s 2023-05-08T15:00:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:47 smithi186 ceph-mon[126480]: pgmap v21699: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 597 B/s wr, 6 op/s 2023-05-08T15:00:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:49 smithi133 ceph-mon[125939]: pgmap v21700: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 597 B/s wr, 6 op/s 2023-05-08T15:00:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40588.500425 secs 2023-05-08T15:00:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40589.054640 secs 2023-05-08T15:00:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:00:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:49 smithi096 ceph-mon[124666]: pgmap v21700: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 597 B/s wr, 6 op/s 2023-05-08T15:00:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40588.500425 secs 2023-05-08T15:00:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40589.054640 secs 2023-05-08T15:00:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:00:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:49 smithi186 ceph-mon[126480]: pgmap v21700: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 597 B/s wr, 6 op/s 2023-05-08T15:00:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40588.500425 secs 2023-05-08T15:00:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40589.054640 secs 2023-05-08T15:00:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:00:51.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:00:51.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:00:51.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:00:51.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:50 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T15:00:51.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:00:51.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:00:51.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:00:51.257 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:50 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T15:00:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:00:51.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:00:51.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:00:51.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:50 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T15:00:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:51 smithi096 ceph-mon[124666]: pgmap v21701: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 553 KiB/s rd, 182 KiB/s wr, 10 op/s 2023-05-08T15:00:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:51 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T15:00:52.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:51 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T15:00:52.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:51 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T15:00:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:51 smithi186 ceph-mon[126480]: pgmap v21701: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 553 KiB/s rd, 182 KiB/s wr, 10 op/s 2023-05-08T15:00:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:51 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T15:00:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:51 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T15:00:52.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:51 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T15:00:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:51 smithi133 ceph-mon[125939]: pgmap v21701: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 553 KiB/s rd, 182 KiB/s wr, 10 op/s 2023-05-08T15:00:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:51 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T15:00:52.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:51 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T15:00:52.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:51 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T15:00:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:52 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T15:00:53.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:52 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T15:00:53.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:52 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T15:00:53.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:52 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T15:00:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:52 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T15:00:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:52 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T15:00:53.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:52 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T15:00:53.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:52 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T15:00:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:52 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T15:00:53.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:52 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T15:00:53.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:52 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T15:00:53.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:52 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T15:00:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:54 smithi096 ceph-mon[124666]: pgmap v21702: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 182 KiB/s wr, 6 op/s 2023-05-08T15:00:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:54 smithi186 ceph-mon[126480]: pgmap v21702: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 182 KiB/s wr, 6 op/s 2023-05-08T15:00:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:54 smithi133 ceph-mon[125939]: pgmap v21702: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 182 KiB/s wr, 6 op/s 2023-05-08T15:00:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40593.500529 secs 2023-05-08T15:00:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40593.500529 secs 2023-05-08T15:00:55.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40593.500529 secs 2023-05-08T15:00:56.373 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:56 smithi186 ceph-mon[126480]: pgmap v21703: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 766 KiB/s rd, 763 KiB/s wr, 11 op/s 2023-05-08T15:00:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:56 smithi133 ceph-mon[125939]: pgmap v21703: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 766 KiB/s rd, 763 KiB/s wr, 11 op/s 2023-05-08T15:00:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:56 smithi096 ceph-mon[124666]: pgmap v21703: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 766 KiB/s rd, 763 KiB/s wr, 11 op/s 2023-05-08T15:00:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:58 smithi186 ceph-mon[126480]: pgmap v21704: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 764 KiB/s rd, 763 KiB/s wr, 8 op/s 2023-05-08T15:00:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:58 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:00:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:58 smithi133 ceph-mon[125939]: pgmap v21704: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 764 KiB/s rd, 763 KiB/s wr, 8 op/s 2023-05-08T15:00:58.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:58 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:00:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:58 smithi096 ceph-mon[124666]: pgmap v21704: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 764 KiB/s rd, 763 KiB/s wr, 8 op/s 2023-05-08T15:00:58.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:58 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:00:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:59 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:00:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:59 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:00:59.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:00:59 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:00:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:59 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:00:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:59 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:00:59.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:00:59 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:00:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:59 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:00:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:59 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:00:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:00:59 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:01:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:00 smithi186 ceph-mon[126480]: pgmap v21705: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 764 KiB/s rd, 763 KiB/s wr, 8 op/s 2023-05-08T15:01:00.497 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40598.500647 secs 2023-05-08T15:01:00.498 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:00 smithi133 ceph-mon[125939]: pgmap v21705: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 764 KiB/s rd, 763 KiB/s wr, 8 op/s 2023-05-08T15:01:00.498 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40598.500647 secs 2023-05-08T15:01:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:00 smithi096 ceph-mon[124666]: pgmap v21705: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 764 KiB/s rd, 763 KiB/s wr, 8 op/s 2023-05-08T15:01:00.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40598.500647 secs 2023-05-08T15:01:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40600.395799 secs 2023-05-08T15:01:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40600.395799 secs 2023-05-08T15:01:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40600.395799 secs 2023-05-08T15:01:02.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:02 smithi096 ceph-mon[124666]: pgmap v21706: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1020 KiB/s rd, 1.6 MiB/s wr, 14 op/s 2023-05-08T15:01:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:02 smithi186 ceph-mon[126480]: pgmap v21706: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1020 KiB/s rd, 1.6 MiB/s wr, 14 op/s 2023-05-08T15:01:02.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:02 smithi133 ceph-mon[125939]: pgmap v21706: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1020 KiB/s rd, 1.6 MiB/s wr, 14 op/s 2023-05-08T15:01:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:01:03.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:03 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:01:03.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:03 smithi186 ceph-mon[126480]: pgmap v21707: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 837 KiB/s rd, 1.4 MiB/s wr, 10 op/s 2023-05-08T15:01:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:01:03.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:03 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:01:03.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:03 smithi133 ceph-mon[125939]: pgmap v21707: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 837 KiB/s rd, 1.4 MiB/s wr, 10 op/s 2023-05-08T15:01:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:01:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:03 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:01:03.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:03 smithi096 ceph-mon[124666]: pgmap v21707: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 837 KiB/s rd, 1.4 MiB/s wr, 10 op/s 2023-05-08T15:01:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:04 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:01:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:04 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:01:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:04 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:01:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40603.500725 secs 2023-05-08T15:01:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:05 smithi186 ceph-mon[126480]: pgmap v21708: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 27 op/s 2023-05-08T15:01:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40604.054916 secs 2023-05-08T15:01:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40603.500725 secs 2023-05-08T15:01:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:05 smithi133 ceph-mon[125939]: pgmap v21708: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 27 op/s 2023-05-08T15:01:05.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40604.054916 secs 2023-05-08T15:01:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40603.500725 secs 2023-05-08T15:01:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:05 smithi096 ceph-mon[124666]: pgmap v21708: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 27 op/s 2023-05-08T15:01:05.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40604.054916 secs 2023-05-08T15:01:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:07 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:01:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:07 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:01:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:07 smithi186 ceph-mon[126480]: pgmap v21709: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 24 op/s 2023-05-08T15:01:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:07 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:01:07.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:07 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:01:07.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:07 smithi133 ceph-mon[125939]: pgmap v21709: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 24 op/s 2023-05-08T15:01:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:07 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:01:07.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:07 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:01:07.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:07 smithi096 ceph-mon[124666]: pgmap v21709: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 24 op/s 2023-05-08T15:01:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:09 smithi186 ceph-mon[126480]: pgmap v21710: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 23 op/s 2023-05-08T15:01:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:09 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:01:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:09 smithi133 ceph-mon[125939]: pgmap v21710: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 23 op/s 2023-05-08T15:01:09.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:09 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:01:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:09 smithi096 ceph-mon[124666]: pgmap v21710: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 23 op/s 2023-05-08T15:01:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:09 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:01:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40608.500843 secs 2023-05-08T15:01:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40609.055042 secs 2023-05-08T15:01:10.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:10 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:01:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40608.500843 secs 2023-05-08T15:01:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40609.055042 secs 2023-05-08T15:01:10.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:10 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:01:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40608.500843 secs 2023-05-08T15:01:10.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40609.055042 secs 2023-05-08T15:01:10.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:10 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:01:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:11 smithi186 ceph-mon[126480]: pgmap v21711: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 28 op/s 2023-05-08T15:01:11.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:11 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:01:11.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:11 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:01:11.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:11 smithi133 ceph-mon[125939]: pgmap v21711: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 28 op/s 2023-05-08T15:01:11.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:11 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:01:11.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:11 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:01:11.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:11 smithi096 ceph-mon[124666]: pgmap v21711: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 28 op/s 2023-05-08T15:01:11.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:11 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:01:11.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:11 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:01:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:13 smithi186 ceph-mon[126480]: pgmap v21712: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 886 KiB/s wr, 23 op/s 2023-05-08T15:01:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:13 smithi133 ceph-mon[125939]: pgmap v21712: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 886 KiB/s wr, 23 op/s 2023-05-08T15:01:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:13 smithi096 ceph-mon[124666]: pgmap v21712: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 886 KiB/s wr, 23 op/s 2023-05-08T15:01:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:14 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:01:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:14 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:01:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:14 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:01:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40613.500941 secs 2023-05-08T15:01:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:15 smithi186 ceph-mon[126480]: pgmap v21713: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 27 op/s 2023-05-08T15:01:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40614.055154 secs 2023-05-08T15:01:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40613.500941 secs 2023-05-08T15:01:15.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:15 smithi133 ceph-mon[125939]: pgmap v21713: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 27 op/s 2023-05-08T15:01:15.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40614.055154 secs 2023-05-08T15:01:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40613.500941 secs 2023-05-08T15:01:15.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:15 smithi096 ceph-mon[124666]: pgmap v21713: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 27 op/s 2023-05-08T15:01:15.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40614.055154 secs 2023-05-08T15:01:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:17 smithi186 ceph-mon[126480]: pgmap v21714: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 750 KiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T15:01:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:17 smithi133 ceph-mon[125939]: pgmap v21714: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 750 KiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T15:01:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:17 smithi096 ceph-mon[124666]: pgmap v21714: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 750 KiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T15:01:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:19 smithi133 ceph-mon[125939]: pgmap v21715: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 405 KiB/s rd, 766 KiB/s wr, 9 op/s 2023-05-08T15:01:20.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40618.501077 secs 2023-05-08T15:01:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:19 smithi096 ceph-mon[124666]: pgmap v21715: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 405 KiB/s rd, 766 KiB/s wr, 9 op/s 2023-05-08T15:01:20.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40618.501077 secs 2023-05-08T15:01:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:19 smithi186 ceph-mon[126480]: pgmap v21715: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 405 KiB/s rd, 766 KiB/s wr, 9 op/s 2023-05-08T15:01:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40618.501077 secs 2023-05-08T15:01:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:21 smithi133 ceph-mon[125939]: pgmap v21716: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 773 KiB/s rd, 2.3 MiB/s wr, 16 op/s 2023-05-08T15:01:22.260 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:21 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:01:22.261 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:21 smithi096 ceph-mon[124666]: pgmap v21716: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 773 KiB/s rd, 2.3 MiB/s wr, 16 op/s 2023-05-08T15:01:22.261 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:21 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:01:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:21 smithi186 ceph-mon[126480]: pgmap v21716: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 773 KiB/s rd, 2.3 MiB/s wr, 16 op/s 2023-05-08T15:01:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:21 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:01:23.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:22 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:01:23.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:22 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:01:23.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:22 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:01:23.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:22 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:01:23.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:22 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:01:23.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:22 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:01:23.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:22 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:01:23.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:22 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:01:23.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:22 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:01:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:23 smithi133 ceph-mon[125939]: pgmap v21717: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 586 KiB/s rd, 2.1 MiB/s wr, 12 op/s 2023-05-08T15:01:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:23 smithi096 ceph-mon[124666]: pgmap v21717: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 586 KiB/s rd, 2.1 MiB/s wr, 12 op/s 2023-05-08T15:01:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:23 smithi186 ceph-mon[126480]: pgmap v21717: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 586 KiB/s rd, 2.1 MiB/s wr, 12 op/s 2023-05-08T15:01:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40623.501166 secs 2023-05-08T15:01:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40623.501166 secs 2023-05-08T15:01:25.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40623.501166 secs 2023-05-08T15:01:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:25 smithi133 ceph-mon[125939]: pgmap v21718: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 16 op/s 2023-05-08T15:01:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:25 smithi096 ceph-mon[124666]: pgmap v21718: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 16 op/s 2023-05-08T15:01:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:25 smithi186 ceph-mon[126480]: pgmap v21718: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 16 op/s 2023-05-08T15:01:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:26 smithi133 ceph-mon[125939]: osdmap e1434: 12 total, 12 up, 12 in 2023-05-08T15:01:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:26 smithi096 ceph-mon[124666]: osdmap e1434: 12 total, 12 up, 12 in 2023-05-08T15:01:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:26 smithi186 ceph-mon[126480]: osdmap e1434: 12 total, 12 up, 12 in 2023-05-08T15:01:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:27 smithi133 ceph-mon[125939]: pgmap v21720: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.8 MiB/s wr, 14 op/s 2023-05-08T15:01:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:27 smithi096 ceph-mon[124666]: pgmap v21720: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.8 MiB/s wr, 14 op/s 2023-05-08T15:01:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:27 smithi186 ceph-mon[126480]: pgmap v21720: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.8 MiB/s wr, 14 op/s 2023-05-08T15:01:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:29 smithi133 ceph-mon[125939]: pgmap v21721: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.8 MiB/s wr, 14 op/s 2023-05-08T15:01:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40628.501288 secs 2023-05-08T15:01:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:29 smithi096 ceph-mon[124666]: pgmap v21721: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.8 MiB/s wr, 14 op/s 2023-05-08T15:01:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40628.501288 secs 2023-05-08T15:01:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:29 smithi186 ceph-mon[126480]: pgmap v21721: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.8 MiB/s wr, 14 op/s 2023-05-08T15:01:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40628.501288 secs 2023-05-08T15:01:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:31 smithi133 ceph-mon[125939]: pgmap v21722: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 478 KiB/s wr, 10 op/s 2023-05-08T15:01:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:31 smithi096 ceph-mon[124666]: pgmap v21722: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 478 KiB/s wr, 10 op/s 2023-05-08T15:01:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:31 smithi186 ceph-mon[126480]: pgmap v21722: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 478 KiB/s wr, 10 op/s 2023-05-08T15:01:34.242 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:33 smithi133 ceph-mon[125939]: pgmap v21723: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 478 KiB/s wr, 10 op/s 2023-05-08T15:01:34.302 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:33 smithi133 ceph-mon[125939]: osdmap e1435: 12 total, 12 up, 12 in 2023-05-08T15:01:34.303 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:33 smithi096 ceph-mon[124666]: pgmap v21723: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 478 KiB/s wr, 10 op/s 2023-05-08T15:01:34.304 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:33 smithi096 ceph-mon[124666]: osdmap e1435: 12 total, 12 up, 12 in 2023-05-08T15:01:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:33 smithi186 ceph-mon[126480]: pgmap v21723: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 478 KiB/s wr, 10 op/s 2023-05-08T15:01:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:33 smithi186 ceph-mon[126480]: osdmap e1435: 12 total, 12 up, 12 in 2023-05-08T15:01:35.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:34 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40633.501352 secs 2023-05-08T15:01:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:34 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40633.501352 secs 2023-05-08T15:01:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:34 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40633.501352 secs 2023-05-08T15:01:36.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:35 smithi133 ceph-mon[125939]: pgmap v21725: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 719 KiB/s wr, 10 op/s 2023-05-08T15:01:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:35 smithi096 ceph-mon[124666]: pgmap v21725: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 719 KiB/s wr, 10 op/s 2023-05-08T15:01:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:35 smithi186 ceph-mon[126480]: pgmap v21725: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 719 KiB/s wr, 10 op/s 2023-05-08T15:01:37.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40635.396628 secs 2023-05-08T15:01:37.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40635.396628 secs 2023-05-08T15:01:37.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40635.396628 secs 2023-05-08T15:01:38.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:37 smithi133 ceph-mon[125939]: pgmap v21726: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 955 KiB/s rd, 594 KiB/s wr, 8 op/s 2023-05-08T15:01:38.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:37 smithi096 ceph-mon[124666]: pgmap v21726: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 955 KiB/s rd, 594 KiB/s wr, 8 op/s 2023-05-08T15:01:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:37 smithi186 ceph-mon[126480]: pgmap v21726: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 955 KiB/s rd, 594 KiB/s wr, 8 op/s 2023-05-08T15:01:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:38 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:01:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:38 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:01:39.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:38 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:01:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:38 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:01:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:38 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:01:39.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:38 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:01:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:38 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:01:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:38 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:01:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:38 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:01:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:39 smithi096 ceph-mon[124666]: pgmap v21727: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 955 KiB/s rd, 594 KiB/s wr, 8 op/s 2023-05-08T15:01:40.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40638.501466 secs 2023-05-08T15:01:40.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40639.055765 secs 2023-05-08T15:01:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:39 smithi186 ceph-mon[126480]: pgmap v21727: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 955 KiB/s rd, 594 KiB/s wr, 8 op/s 2023-05-08T15:01:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40638.501466 secs 2023-05-08T15:01:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40639.055765 secs 2023-05-08T15:01:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:39 smithi133 ceph-mon[125939]: pgmap v21727: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 955 KiB/s rd, 594 KiB/s wr, 8 op/s 2023-05-08T15:01:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40638.501466 secs 2023-05-08T15:01:40.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40639.055765 secs 2023-05-08T15:01:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:41 smithi096 ceph-mon[124666]: pgmap v21728: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.5 MiB/s wr, 12 op/s 2023-05-08T15:01:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40640.396762 secs 2023-05-08T15:01:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:41 smithi186 ceph-mon[126480]: pgmap v21728: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.5 MiB/s wr, 12 op/s 2023-05-08T15:01:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40640.396762 secs 2023-05-08T15:01:42.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:41 smithi133 ceph-mon[125939]: pgmap v21728: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.5 MiB/s wr, 12 op/s 2023-05-08T15:01:42.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40640.396762 secs 2023-05-08T15:01:43.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:01:43.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:01:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:01:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:01:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:01:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:01:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:44 smithi186 ceph-mon[126480]: pgmap v21729: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.5 MiB/s wr, 12 op/s 2023-05-08T15:01:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:44 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:01:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:44 smithi133 ceph-mon[125939]: pgmap v21729: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.5 MiB/s wr, 12 op/s 2023-05-08T15:01:44.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:44 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:01:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:44 smithi096 ceph-mon[124666]: pgmap v21729: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.5 MiB/s wr, 12 op/s 2023-05-08T15:01:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:44 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:01:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40643.501551 secs 2023-05-08T15:01:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40644.055845 secs 2023-05-08T15:01:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40643.501551 secs 2023-05-08T15:01:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40644.055845 secs 2023-05-08T15:01:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40643.501551 secs 2023-05-08T15:01:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40644.055845 secs 2023-05-08T15:01:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:46 smithi186 ceph-mon[126480]: pgmap v21730: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 17 op/s 2023-05-08T15:01:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:46 smithi133 ceph-mon[125939]: pgmap v21730: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 17 op/s 2023-05-08T15:01:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:46 smithi096 ceph-mon[124666]: pgmap v21730: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 17 op/s 2023-05-08T15:01:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:48 smithi186 ceph-mon[126480]: pgmap v21731: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 10 op/s 2023-05-08T15:01:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:48 smithi133 ceph-mon[125939]: pgmap v21731: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 10 op/s 2023-05-08T15:01:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:48 smithi096 ceph-mon[124666]: pgmap v21731: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 10 op/s 2023-05-08T15:01:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:50 smithi186 ceph-mon[126480]: pgmap v21732: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 10 op/s 2023-05-08T15:01:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40648.501634 secs 2023-05-08T15:01:50.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40649.055935 secs 2023-05-08T15:01:50.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:50 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:01:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:50 smithi133 ceph-mon[125939]: pgmap v21732: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 10 op/s 2023-05-08T15:01:50.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40648.501634 secs 2023-05-08T15:01:50.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40649.055935 secs 2023-05-08T15:01:50.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:50 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:01:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:50 smithi096 ceph-mon[124666]: pgmap v21732: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 10 op/s 2023-05-08T15:01:50.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40648.501634 secs 2023-05-08T15:01:50.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40649.055935 secs 2023-05-08T15:01:50.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:50 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:01:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:51 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:01:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:01:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:01:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:51 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:01:51.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:01:51.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:01:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:51 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:01:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:01:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:01:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:52 smithi186 ceph-mon[126480]: pgmap v21733: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.5 MiB/s wr, 16 op/s 2023-05-08T15:01:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T15:01:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T15:01:52.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T15:01:52.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T15:01:52.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T15:01:52.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T15:01:52.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T15:01:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:52 smithi133 ceph-mon[125939]: pgmap v21733: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.5 MiB/s wr, 16 op/s 2023-05-08T15:01:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T15:01:52.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T15:01:52.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T15:01:52.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T15:01:52.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T15:01:52.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T15:01:52.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T15:01:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:52 smithi096 ceph-mon[124666]: pgmap v21733: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.5 MiB/s wr, 16 op/s 2023-05-08T15:01:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T15:01:52.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T15:01:52.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T15:01:52.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T15:01:52.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T15:01:52.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T15:01:52.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T15:01:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:53 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T15:01:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:53 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T15:01:53.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:53 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T15:01:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:53 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T15:01:53.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:53 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T15:01:53.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:53 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T15:01:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:53 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T15:01:53.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:53 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T15:01:53.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:53 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T15:01:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:54 smithi186 ceph-mon[126480]: pgmap v21734: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 9 op/s 2023-05-08T15:01:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:54 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T15:01:54.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:54 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T15:01:54.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:54 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T15:01:54.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:54 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T15:01:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:54 smithi133 ceph-mon[125939]: pgmap v21734: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 9 op/s 2023-05-08T15:01:54.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:54 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T15:01:54.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:54 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T15:01:54.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:54 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T15:01:54.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:54 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T15:01:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:54 smithi096 ceph-mon[124666]: pgmap v21734: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 9 op/s 2023-05-08T15:01:54.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:54 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T15:01:54.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:54 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T15:01:54.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:54 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T15:01:54.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:54 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T15:01:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40653.501705 secs 2023-05-08T15:01:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:55 smithi186 ceph-mon[126480]: pgmap v21735: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.9 MiB/s wr, 16 op/s 2023-05-08T15:01:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40653.501705 secs 2023-05-08T15:01:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:55 smithi133 ceph-mon[125939]: pgmap v21735: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.9 MiB/s wr, 16 op/s 2023-05-08T15:01:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40653.501705 secs 2023-05-08T15:01:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:55 smithi096 ceph-mon[124666]: pgmap v21735: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.9 MiB/s wr, 16 op/s 2023-05-08T15:01:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40655.397102 secs 2023-05-08T15:01:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40655.397102 secs 2023-05-08T15:01:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40655.397102 secs 2023-05-08T15:01:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:57 smithi186 ceph-mon[126480]: pgmap v21736: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.2 MiB/s wr, 12 op/s 2023-05-08T15:01:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:57 smithi133 ceph-mon[125939]: pgmap v21736: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.2 MiB/s wr, 12 op/s 2023-05-08T15:01:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:57 smithi096 ceph-mon[124666]: pgmap v21736: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.2 MiB/s wr, 12 op/s 2023-05-08T15:01:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:58 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:01:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:58 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:01:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:58 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:01:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:59 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:01:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:59 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:01:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:59 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:01:59.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:01:59 smithi186 ceph-mon[126480]: pgmap v21737: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.2 MiB/s wr, 12 op/s 2023-05-08T15:01:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:59 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:01:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:59 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:01:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:59 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:01:59.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:01:59 smithi133 ceph-mon[125939]: pgmap v21737: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.2 MiB/s wr, 12 op/s 2023-05-08T15:01:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:59 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:01:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:59 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:01:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:59 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:01:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:01:59 smithi096 ceph-mon[124666]: pgmap v21737: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.2 MiB/s wr, 12 op/s 2023-05-08T15:02:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40658.501796 secs 2023-05-08T15:02:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40659.056133 secs 2023-05-08T15:02:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40658.501796 secs 2023-05-08T15:02:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40659.056133 secs 2023-05-08T15:02:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40658.501796 secs 2023-05-08T15:02:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40659.056133 secs 2023-05-08T15:02:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:01 smithi186 ceph-mon[126480]: pgmap v21738: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.5 MiB/s wr, 19 op/s 2023-05-08T15:02:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40660.397225 secs 2023-05-08T15:02:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:01 smithi133 ceph-mon[125939]: pgmap v21738: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.5 MiB/s wr, 19 op/s 2023-05-08T15:02:01.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40660.397225 secs 2023-05-08T15:02:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:01 smithi096 ceph-mon[124666]: pgmap v21738: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.5 MiB/s wr, 19 op/s 2023-05-08T15:02:01.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40660.397225 secs 2023-05-08T15:02:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:02 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:02:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:02 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:02:02.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:02 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:02:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:02 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:02:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:02 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:02:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:02 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:02:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:02 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:02:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:02 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:02:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:02 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:02:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:03 smithi133 ceph-mon[125939]: pgmap v21739: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.9 MiB/s wr, 14 op/s 2023-05-08T15:02:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:03 smithi096 ceph-mon[124666]: pgmap v21739: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.9 MiB/s wr, 14 op/s 2023-05-08T15:02:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:03 smithi186 ceph-mon[126480]: pgmap v21739: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.9 MiB/s wr, 14 op/s 2023-05-08T15:02:05.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40663.501928 secs 2023-05-08T15:02:05.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40663.501928 secs 2023-05-08T15:02:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40663.501928 secs 2023-05-08T15:02:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:05 smithi133 ceph-mon[125939]: pgmap v21740: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.1 MiB/s wr, 31 op/s 2023-05-08T15:02:06.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:05 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:02:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:05 smithi096 ceph-mon[124666]: pgmap v21740: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.1 MiB/s wr, 31 op/s 2023-05-08T15:02:06.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:05 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:02:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:05 smithi186 ceph-mon[126480]: pgmap v21740: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.1 MiB/s wr, 31 op/s 2023-05-08T15:02:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:05 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:02:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:06 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:02:07.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:06 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:02:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:06 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:02:07.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:06 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:02:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:06 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:02:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:06 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:02:08.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:07 smithi133 ceph-mon[125939]: pgmap v21741: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.7 MiB/s wr, 25 op/s 2023-05-08T15:02:08.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:07 smithi096 ceph-mon[124666]: pgmap v21741: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.7 MiB/s wr, 25 op/s 2023-05-08T15:02:08.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:07 smithi186 ceph-mon[126480]: pgmap v21741: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.7 MiB/s wr, 25 op/s 2023-05-08T15:02:09.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:08 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:02:09.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:08 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:02:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:08 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:02:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:09 smithi133 ceph-mon[125939]: pgmap v21742: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.7 MiB/s wr, 25 op/s 2023-05-08T15:02:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40668.502061 secs 2023-05-08T15:02:10.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:09 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:02:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:09 smithi096 ceph-mon[124666]: pgmap v21742: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.7 MiB/s wr, 25 op/s 2023-05-08T15:02:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40668.502061 secs 2023-05-08T15:02:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:09 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:02:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:09 smithi186 ceph-mon[126480]: pgmap v21742: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.7 MiB/s wr, 25 op/s 2023-05-08T15:02:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40668.502061 secs 2023-05-08T15:02:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:09 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:02:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:10 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:02:11.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:10 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:02:11.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:10 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:02:11.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:10 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:02:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:10 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:02:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:10 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:02:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:11 smithi133 ceph-mon[125939]: pgmap v21743: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.8 MiB/s wr, 29 op/s 2023-05-08T15:02:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:11 smithi096 ceph-mon[124666]: pgmap v21743: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.8 MiB/s wr, 29 op/s 2023-05-08T15:02:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:11 smithi186 ceph-mon[126480]: pgmap v21743: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.8 MiB/s wr, 29 op/s 2023-05-08T15:02:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:13 smithi133 ceph-mon[125939]: pgmap v21744: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 913 KiB/s wr, 23 op/s 2023-05-08T15:02:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:13 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:02:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:13 smithi096 ceph-mon[124666]: pgmap v21744: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 913 KiB/s wr, 23 op/s 2023-05-08T15:02:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:13 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:02:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:13 smithi186 ceph-mon[126480]: pgmap v21744: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 913 KiB/s wr, 23 op/s 2023-05-08T15:02:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:13 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:02:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40673.502181 secs 2023-05-08T15:02:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40673.502181 secs 2023-05-08T15:02:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40673.502181 secs 2023-05-08T15:02:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:15 smithi133 ceph-mon[125939]: pgmap v21745: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 27 op/s 2023-05-08T15:02:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:15 smithi096 ceph-mon[124666]: pgmap v21745: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 27 op/s 2023-05-08T15:02:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:15 smithi186 ceph-mon[126480]: pgmap v21745: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 27 op/s 2023-05-08T15:02:18.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:17 smithi133 ceph-mon[125939]: pgmap v21746: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 10 op/s 2023-05-08T15:02:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:17 smithi096 ceph-mon[124666]: pgmap v21746: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 10 op/s 2023-05-08T15:02:18.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:17 smithi186 ceph-mon[126480]: pgmap v21746: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 10 op/s 2023-05-08T15:02:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:19 smithi133 ceph-mon[125939]: pgmap v21747: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 9 op/s 2023-05-08T15:02:20.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40678.502279 secs 2023-05-08T15:02:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:19 smithi096 ceph-mon[124666]: pgmap v21747: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 9 op/s 2023-05-08T15:02:20.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40678.502279 secs 2023-05-08T15:02:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:19 smithi186 ceph-mon[126480]: pgmap v21747: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 9 op/s 2023-05-08T15:02:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40678.502279 secs 2023-05-08T15:02:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:21 smithi133 ceph-mon[125939]: pgmap v21748: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T15:02:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:21 smithi096 ceph-mon[124666]: pgmap v21748: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T15:02:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:21 smithi186 ceph-mon[126480]: pgmap v21748: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T15:02:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:23 smithi096 ceph-mon[124666]: pgmap v21749: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 9 op/s 2023-05-08T15:02:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:23 smithi186 ceph-mon[126480]: pgmap v21749: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 9 op/s 2023-05-08T15:02:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:23 smithi133 ceph-mon[125939]: pgmap v21749: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 9 op/s 2023-05-08T15:02:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40683.502405 secs 2023-05-08T15:02:25.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40684.056603 secs 2023-05-08T15:02:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40683.502405 secs 2023-05-08T15:02:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40684.056603 secs 2023-05-08T15:02:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40683.502405 secs 2023-05-08T15:02:25.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40684.056603 secs 2023-05-08T15:02:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:25 smithi096 ceph-mon[124666]: pgmap v21750: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 17 op/s 2023-05-08T15:02:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:25 smithi186 ceph-mon[126480]: pgmap v21750: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 17 op/s 2023-05-08T15:02:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:25 smithi133 ceph-mon[125939]: pgmap v21750: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 17 op/s 2023-05-08T15:02:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40685.397827 secs 2023-05-08T15:02:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:26 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:02:27.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:26 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:02:27.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:26 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:02:27.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:26 smithi096 ceph-mon[124666]: osdmap e1436: 12 total, 12 up, 12 in 2023-05-08T15:02:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40685.397827 secs 2023-05-08T15:02:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:26 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:02:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:27 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:02:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:27 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:02:27.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:27 smithi186 ceph-mon[126480]: osdmap e1436: 12 total, 12 up, 12 in 2023-05-08T15:02:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40685.397827 secs 2023-05-08T15:02:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:27 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:02:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:27 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:02:27.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:27 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:02:27.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:27 smithi133 ceph-mon[125939]: osdmap e1436: 12 total, 12 up, 12 in 2023-05-08T15:02:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:28 smithi186 ceph-mon[126480]: pgmap v21752: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 15 op/s 2023-05-08T15:02:28.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:28 smithi133 ceph-mon[125939]: pgmap v21752: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 15 op/s 2023-05-08T15:02:28.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:28 smithi096 ceph-mon[124666]: pgmap v21752: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 15 op/s 2023-05-08T15:02:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:30 smithi186 ceph-mon[126480]: pgmap v21753: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 15 op/s 2023-05-08T15:02:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40688.502520 secs 2023-05-08T15:02:30.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40689.056724 secs 2023-05-08T15:02:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:30 smithi133 ceph-mon[125939]: pgmap v21753: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 15 op/s 2023-05-08T15:02:30.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40688.502520 secs 2023-05-08T15:02:30.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40689.056724 secs 2023-05-08T15:02:30.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:30 smithi096 ceph-mon[124666]: pgmap v21753: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 15 op/s 2023-05-08T15:02:30.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40688.502520 secs 2023-05-08T15:02:30.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40689.056724 secs 2023-05-08T15:02:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:31 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:02:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:31 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:02:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40690.397941 secs 2023-05-08T15:02:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:31 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:02:31.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:31 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:02:31.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40690.397941 secs 2023-05-08T15:02:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:31 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:02:31.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:31 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:02:31.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40690.397941 secs 2023-05-08T15:02:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:32 smithi186 ceph-mon[126480]: pgmap v21754: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 16 op/s 2023-05-08T15:02:32.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:32 smithi133 ceph-mon[125939]: pgmap v21754: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 16 op/s 2023-05-08T15:02:32.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:32 smithi096 ceph-mon[124666]: pgmap v21754: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 16 op/s 2023-05-08T15:02:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:34 smithi186 ceph-mon[126480]: pgmap v21755: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 16 op/s 2023-05-08T15:02:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:34 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:02:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:34 smithi186 ceph-mon[126480]: osdmap e1437: 12 total, 12 up, 12 in 2023-05-08T15:02:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:34 smithi133 ceph-mon[125939]: pgmap v21755: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 16 op/s 2023-05-08T15:02:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:34 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:02:34.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:34 smithi133 ceph-mon[125939]: osdmap e1437: 12 total, 12 up, 12 in 2023-05-08T15:02:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:34 smithi096 ceph-mon[124666]: pgmap v21755: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 16 op/s 2023-05-08T15:02:34.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:34 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:02:34.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:34 smithi096 ceph-mon[124666]: osdmap e1437: 12 total, 12 up, 12 in 2023-05-08T15:02:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40693.502634 secs 2023-05-08T15:02:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40694.056809 secs 2023-05-08T15:02:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40693.502634 secs 2023-05-08T15:02:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40694.056809 secs 2023-05-08T15:02:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40693.502634 secs 2023-05-08T15:02:35.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40694.056809 secs 2023-05-08T15:02:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:36 smithi186 ceph-mon[126480]: pgmap v21757: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T15:02:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40695.398057 secs 2023-05-08T15:02:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:36 smithi133 ceph-mon[125939]: pgmap v21757: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T15:02:36.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40695.398057 secs 2023-05-08T15:02:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:36 smithi096 ceph-mon[124666]: pgmap v21757: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2023-05-08T15:02:36.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40695.398057 secs 2023-05-08T15:02:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:38 smithi186 ceph-mon[126480]: pgmap v21758: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 921 KiB/s rd, 919 KiB/s wr, 11 op/s 2023-05-08T15:02:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:38 smithi133 ceph-mon[125939]: pgmap v21758: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 921 KiB/s rd, 919 KiB/s wr, 11 op/s 2023-05-08T15:02:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:38 smithi096 ceph-mon[124666]: pgmap v21758: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 921 KiB/s rd, 919 KiB/s wr, 11 op/s 2023-05-08T15:02:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:40 smithi186 ceph-mon[126480]: pgmap v21759: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 921 KiB/s rd, 919 KiB/s wr, 11 op/s 2023-05-08T15:02:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40698.502729 secs 2023-05-08T15:02:40.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40699.056930 secs 2023-05-08T15:02:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:40 smithi133 ceph-mon[125939]: pgmap v21759: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 921 KiB/s rd, 919 KiB/s wr, 11 op/s 2023-05-08T15:02:40.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40698.502729 secs 2023-05-08T15:02:40.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40699.056930 secs 2023-05-08T15:02:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:40 smithi096 ceph-mon[124666]: pgmap v21759: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 921 KiB/s rd, 919 KiB/s wr, 11 op/s 2023-05-08T15:02:40.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40698.502729 secs 2023-05-08T15:02:40.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40699.056930 secs 2023-05-08T15:02:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40700.398177 secs 2023-05-08T15:02:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40700.398177 secs 2023-05-08T15:02:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40700.398177 secs 2023-05-08T15:02:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:42 smithi186 ceph-mon[126480]: pgmap v21760: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 664 KiB/s rd, 661 KiB/s wr, 9 op/s 2023-05-08T15:02:42.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:42 smithi133 ceph-mon[125939]: pgmap v21760: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 664 KiB/s rd, 661 KiB/s wr, 9 op/s 2023-05-08T15:02:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:42 smithi096 ceph-mon[124666]: pgmap v21760: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 664 KiB/s rd, 661 KiB/s wr, 9 op/s 2023-05-08T15:02:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:43 smithi186 ceph-mon[126480]: pgmap v21761: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 664 KiB/s rd, 661 KiB/s wr, 9 op/s 2023-05-08T15:02:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:43 smithi133 ceph-mon[125939]: pgmap v21761: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 664 KiB/s rd, 661 KiB/s wr, 9 op/s 2023-05-08T15:02:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:43 smithi096 ceph-mon[124666]: pgmap v21761: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 664 KiB/s rd, 661 KiB/s wr, 9 op/s 2023-05-08T15:02:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40703.502846 secs 2023-05-08T15:02:45.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40704.057046 secs 2023-05-08T15:02:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40703.502846 secs 2023-05-08T15:02:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40704.057046 secs 2023-05-08T15:02:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40703.502846 secs 2023-05-08T15:02:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40704.057046 secs 2023-05-08T15:02:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:45 smithi133 ceph-mon[125939]: pgmap v21762: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 646 KiB/s rd, 641 KiB/s wr, 12 op/s 2023-05-08T15:02:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:45 smithi096 ceph-mon[124666]: pgmap v21762: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 646 KiB/s rd, 641 KiB/s wr, 12 op/s 2023-05-08T15:02:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:45 smithi186 ceph-mon[126480]: pgmap v21762: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 646 KiB/s rd, 641 KiB/s wr, 12 op/s 2023-05-08T15:02:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:47 smithi133 ceph-mon[125939]: pgmap v21763: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2023-05-08T15:02:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:47 smithi096 ceph-mon[124666]: pgmap v21763: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2023-05-08T15:02:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:47 smithi186 ceph-mon[126480]: pgmap v21763: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2023-05-08T15:02:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:49 smithi133 ceph-mon[125939]: pgmap v21764: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2023-05-08T15:02:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40708.502962 secs 2023-05-08T15:02:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40709.057168 secs 2023-05-08T15:02:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:02:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:49 smithi096 ceph-mon[124666]: pgmap v21764: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2023-05-08T15:02:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40708.502962 secs 2023-05-08T15:02:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40709.057168 secs 2023-05-08T15:02:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:02:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:49 smithi186 ceph-mon[126480]: pgmap v21764: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2023-05-08T15:02:50.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40708.502962 secs 2023-05-08T15:02:50.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40709.057168 secs 2023-05-08T15:02:50.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:02:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:50 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:02:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:02:51.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:02:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:50 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:02:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:02:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:02:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:50 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:02:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:02:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:02:52.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:51 smithi133 ceph-mon[125939]: pgmap v21765: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 369 KiB/s wr, 9 op/s 2023-05-08T15:02:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:51 smithi096 ceph-mon[124666]: pgmap v21765: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 369 KiB/s wr, 9 op/s 2023-05-08T15:02:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:51 smithi186 ceph-mon[126480]: pgmap v21765: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 369 KiB/s wr, 9 op/s 2023-05-08T15:02:53.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:52 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T15:02:53.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:52 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T15:02:53.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:52 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T15:02:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:53 smithi133 ceph-mon[125939]: pgmap v21766: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 369 KiB/s wr, 6 op/s 2023-05-08T15:02:54.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:53 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T15:02:54.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:53 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T15:02:54.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:53 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T15:02:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:53 smithi096 ceph-mon[124666]: pgmap v21766: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 369 KiB/s wr, 6 op/s 2023-05-08T15:02:54.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:53 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T15:02:54.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:53 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T15:02:54.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:53 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T15:02:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:53 smithi186 ceph-mon[126480]: pgmap v21766: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 369 KiB/s wr, 6 op/s 2023-05-08T15:02:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:53 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T15:02:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:53 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T15:02:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:53 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T15:02:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:54 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T15:02:55.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:54 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T15:02:55.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:54 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T15:02:55.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:54 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T15:02:55.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40713.503103 secs 2023-05-08T15:02:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:54 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T15:02:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:54 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T15:02:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:54 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T15:02:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:54 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T15:02:55.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40713.503103 secs 2023-05-08T15:02:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:54 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T15:02:55.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:54 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T15:02:55.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:54 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T15:02:55.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:54 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T15:02:55.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40713.503103 secs 2023-05-08T15:02:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:55 smithi096 ceph-mon[124666]: pgmap v21767: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 961 KiB/s rd, 958 KiB/s wr, 10 op/s 2023-05-08T15:02:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:55 smithi186 ceph-mon[126480]: pgmap v21767: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 961 KiB/s rd, 958 KiB/s wr, 10 op/s 2023-05-08T15:02:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:55 smithi133 ceph-mon[125939]: pgmap v21767: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 961 KiB/s rd, 958 KiB/s wr, 10 op/s 2023-05-08T15:02:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:57 smithi096 ceph-mon[124666]: pgmap v21768: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 960 KiB/s rd, 958 KiB/s wr, 8 op/s 2023-05-08T15:02:58.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:57 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:02:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:57 smithi186 ceph-mon[126480]: pgmap v21768: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 960 KiB/s rd, 958 KiB/s wr, 8 op/s 2023-05-08T15:02:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:57 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:02:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:57 smithi133 ceph-mon[125939]: pgmap v21768: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 960 KiB/s rd, 958 KiB/s wr, 8 op/s 2023-05-08T15:02:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:57 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:02:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:59 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:02:59.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:59 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:02:59.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:02:59 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:02:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:59 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:02:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:59 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:02:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:02:59 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:02:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:59 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:02:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:59 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:02:59.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:02:59 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:03:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:00 smithi096 ceph-mon[124666]: pgmap v21769: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 960 KiB/s rd, 958 KiB/s wr, 8 op/s 2023-05-08T15:03:00.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40718.503184 secs 2023-05-08T15:03:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:00 smithi186 ceph-mon[126480]: pgmap v21769: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 960 KiB/s rd, 958 KiB/s wr, 8 op/s 2023-05-08T15:03:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40718.503184 secs 2023-05-08T15:03:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:00 smithi133 ceph-mon[125939]: pgmap v21769: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 960 KiB/s rd, 958 KiB/s wr, 8 op/s 2023-05-08T15:03:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40718.503184 secs 2023-05-08T15:03:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:02 smithi186 ceph-mon[126480]: pgmap v21770: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.6 MiB/s wr, 13 op/s 2023-05-08T15:03:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:02 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40720.398672 secs 2023-05-08T15:03:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:02 smithi133 ceph-mon[125939]: pgmap v21770: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.6 MiB/s wr, 13 op/s 2023-05-08T15:03:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:02 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40720.398672 secs 2023-05-08T15:03:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:02 smithi096 ceph-mon[124666]: pgmap v21770: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.6 MiB/s wr, 13 op/s 2023-05-08T15:03:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:02 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40720.398672 secs 2023-05-08T15:03:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:03:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:03 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:03:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:03:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:03 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:03:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:03:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:03 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:03:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:04 smithi186 ceph-mon[126480]: pgmap v21771: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 683 KiB/s rd, 1.2 MiB/s wr, 9 op/s 2023-05-08T15:03:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:04 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:03:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:04 smithi133 ceph-mon[125939]: pgmap v21771: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 683 KiB/s rd, 1.2 MiB/s wr, 9 op/s 2023-05-08T15:03:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:04 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:03:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:04 smithi096 ceph-mon[124666]: pgmap v21771: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 683 KiB/s rd, 1.2 MiB/s wr, 9 op/s 2023-05-08T15:03:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:04 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:03:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40723.503297 secs 2023-05-08T15:03:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40724.057540 secs 2023-05-08T15:03:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40723.503297 secs 2023-05-08T15:03:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40724.057540 secs 2023-05-08T15:03:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40723.503297 secs 2023-05-08T15:03:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40724.057540 secs 2023-05-08T15:03:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:06 smithi186 ceph-mon[126480]: pgmap v21772: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 27 op/s 2023-05-08T15:03:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:06 smithi133 ceph-mon[125939]: pgmap v21772: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 27 op/s 2023-05-08T15:03:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:06 smithi096 ceph-mon[124666]: pgmap v21772: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 27 op/s 2023-05-08T15:03:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:07 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:03:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:07 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:03:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:07 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:03:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:07 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:03:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:07 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:03:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:07 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:03:08.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:08 smithi186 ceph-mon[126480]: pgmap v21773: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 22 op/s 2023-05-08T15:03:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:08 smithi133 ceph-mon[125939]: pgmap v21773: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 22 op/s 2023-05-08T15:03:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:08 smithi096 ceph-mon[124666]: pgmap v21773: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 22 op/s 2023-05-08T15:03:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:09 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:03:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:09 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:03:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:09 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:03:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:10 smithi186 ceph-mon[126480]: pgmap v21774: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 22 op/s 2023-05-08T15:03:10.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40728.503417 secs 2023-05-08T15:03:10.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40729.057681 secs 2023-05-08T15:03:10.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:10 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:03:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:10 smithi133 ceph-mon[125939]: pgmap v21774: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 22 op/s 2023-05-08T15:03:10.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40728.503417 secs 2023-05-08T15:03:10.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40729.057681 secs 2023-05-08T15:03:10.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:10 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:03:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:10 smithi096 ceph-mon[124666]: pgmap v21774: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 22 op/s 2023-05-08T15:03:10.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40728.503417 secs 2023-05-08T15:03:10.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40729.057681 secs 2023-05-08T15:03:10.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:10 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:03:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:11 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:03:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:11 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:03:11.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:11 smithi186 ceph-mon[126480]: pgmap v21775: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 27 op/s 2023-05-08T15:03:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:11 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:03:11.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:11 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:03:11.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:11 smithi133 ceph-mon[125939]: pgmap v21775: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 27 op/s 2023-05-08T15:03:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:11 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:03:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:11 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:03:11.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:11 smithi096 ceph-mon[124666]: pgmap v21775: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 27 op/s 2023-05-08T15:03:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:13 smithi186 ceph-mon[126480]: pgmap v21776: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 707 KiB/s wr, 22 op/s 2023-05-08T15:03:13.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:13 smithi133 ceph-mon[125939]: pgmap v21776: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 707 KiB/s wr, 22 op/s 2023-05-08T15:03:13.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:13 smithi096 ceph-mon[124666]: pgmap v21776: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 707 KiB/s wr, 22 op/s 2023-05-08T15:03:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:14 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:03:14.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:14 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:03:14.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:14 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:03:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40733.503537 secs 2023-05-08T15:03:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:15 smithi186 ceph-mon[126480]: pgmap v21777: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 26 op/s 2023-05-08T15:03:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40734.057765 secs 2023-05-08T15:03:15.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40733.503537 secs 2023-05-08T15:03:15.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:15 smithi133 ceph-mon[125939]: pgmap v21777: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 26 op/s 2023-05-08T15:03:15.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40734.057765 secs 2023-05-08T15:03:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40733.503537 secs 2023-05-08T15:03:15.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:15 smithi096 ceph-mon[124666]: pgmap v21777: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 26 op/s 2023-05-08T15:03:15.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40734.057765 secs 2023-05-08T15:03:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:17 smithi186 ceph-mon[126480]: pgmap v21778: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 583 KiB/s wr, 8 op/s 2023-05-08T15:03:17.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:17 smithi133 ceph-mon[125939]: pgmap v21778: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 583 KiB/s wr, 8 op/s 2023-05-08T15:03:17.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:17 smithi096 ceph-mon[124666]: pgmap v21778: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 583 KiB/s wr, 8 op/s 2023-05-08T15:03:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:19 smithi133 ceph-mon[125939]: pgmap v21779: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 583 KiB/s wr, 8 op/s 2023-05-08T15:03:20.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40738.503646 secs 2023-05-08T15:03:20.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40739.057889 secs 2023-05-08T15:03:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:19 smithi096 ceph-mon[124666]: pgmap v21779: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 583 KiB/s wr, 8 op/s 2023-05-08T15:03:20.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40738.503646 secs 2023-05-08T15:03:20.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40739.057889 secs 2023-05-08T15:03:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:19 smithi186 ceph-mon[126480]: pgmap v21779: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 583 KiB/s wr, 8 op/s 2023-05-08T15:03:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40738.503646 secs 2023-05-08T15:03:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40739.057889 secs 2023-05-08T15:03:22.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:21 smithi133 ceph-mon[125939]: pgmap v21780: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 587 KiB/s rd, 584 KiB/s wr, 11 op/s 2023-05-08T15:03:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:21 smithi096 ceph-mon[124666]: pgmap v21780: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 587 KiB/s rd, 584 KiB/s wr, 11 op/s 2023-05-08T15:03:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:21 smithi186 ceph-mon[126480]: pgmap v21780: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 587 KiB/s rd, 584 KiB/s wr, 11 op/s 2023-05-08T15:03:24.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:23 smithi133 ceph-mon[125939]: pgmap v21781: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 583 KiB/s rd, 581 KiB/s wr, 7 op/s 2023-05-08T15:03:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:23 smithi096 ceph-mon[124666]: pgmap v21781: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 583 KiB/s rd, 581 KiB/s wr, 7 op/s 2023-05-08T15:03:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:23 smithi186 ceph-mon[126480]: pgmap v21781: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 583 KiB/s rd, 581 KiB/s wr, 7 op/s 2023-05-08T15:03:25.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:24 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40743.503778 secs 2023-05-08T15:03:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:24 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40743.503778 secs 2023-05-08T15:03:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:24 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40743.503778 secs 2023-05-08T15:03:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:25 smithi133 ceph-mon[125939]: pgmap v21782: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T15:03:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:25 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:03:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:25 smithi096 ceph-mon[124666]: pgmap v21782: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T15:03:26.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:25 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:03:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:25 smithi186 ceph-mon[126480]: pgmap v21782: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2023-05-08T15:03:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:25 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:03:27.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:26 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:03:27.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:26 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:03:27.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:26 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:03:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:26 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:03:27.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:26 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:03:27.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:26 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:03:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:26 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:03:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:26 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:03:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:26 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:03:28.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:27 smithi133 ceph-mon[125939]: pgmap v21783: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T15:03:28.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:27 smithi096 ceph-mon[124666]: pgmap v21783: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T15:03:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:27 smithi186 ceph-mon[126480]: pgmap v21783: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T15:03:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:29 smithi133 ceph-mon[125939]: pgmap v21784: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T15:03:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40748.503911 secs 2023-05-08T15:03:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:29 smithi096 ceph-mon[124666]: pgmap v21784: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T15:03:30.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40748.503911 secs 2023-05-08T15:03:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:29 smithi186 ceph-mon[126480]: pgmap v21784: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2023-05-08T15:03:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40748.503911 secs 2023-05-08T15:03:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:31 smithi096 ceph-mon[124666]: pgmap v21785: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 15 op/s 2023-05-08T15:03:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:31 smithi096 ceph-mon[124666]: osdmap e1438: 12 total, 12 up, 12 in 2023-05-08T15:03:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:31 smithi186 ceph-mon[126480]: pgmap v21785: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 15 op/s 2023-05-08T15:03:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:31 smithi186 ceph-mon[126480]: osdmap e1438: 12 total, 12 up, 12 in 2023-05-08T15:03:32.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:31 smithi133 ceph-mon[125939]: pgmap v21785: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 15 op/s 2023-05-08T15:03:32.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:31 smithi133 ceph-mon[125939]: osdmap e1438: 12 total, 12 up, 12 in 2023-05-08T15:03:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:33 smithi096 ceph-mon[124666]: pgmap v21787: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.6 MiB/s wr, 15 op/s 2023-05-08T15:03:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:33 smithi186 ceph-mon[126480]: pgmap v21787: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.6 MiB/s wr, 15 op/s 2023-05-08T15:03:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:33 smithi133 ceph-mon[125939]: pgmap v21787: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.6 MiB/s wr, 15 op/s 2023-05-08T15:03:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40753.504049 secs 2023-05-08T15:03:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40753.504049 secs 2023-05-08T15:03:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40753.504049 secs 2023-05-08T15:03:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:36 smithi186 ceph-mon[126480]: pgmap v21788: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2023-05-08T15:03:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:36 smithi133 ceph-mon[125939]: pgmap v21788: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2023-05-08T15:03:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:36 smithi096 ceph-mon[124666]: pgmap v21788: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2023-05-08T15:03:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:38 smithi186 ceph-mon[126480]: pgmap v21789: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 698 KiB/s wr, 10 op/s 2023-05-08T15:03:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:38 smithi133 ceph-mon[125939]: pgmap v21789: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 698 KiB/s wr, 10 op/s 2023-05-08T15:03:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:38 smithi096 ceph-mon[124666]: pgmap v21789: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 698 KiB/s wr, 10 op/s 2023-05-08T15:03:40.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:39 smithi133 ceph-mon[125939]: pgmap v21790: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 698 KiB/s wr, 10 op/s 2023-05-08T15:03:40.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40758.504185 secs 2023-05-08T15:03:40.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:39 smithi133 ceph-mon[125939]: osdmap e1439: 12 total, 12 up, 12 in 2023-05-08T15:03:40.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:39 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40759.058289 secs 2023-05-08T15:03:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:39 smithi096 ceph-mon[124666]: pgmap v21790: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 698 KiB/s wr, 10 op/s 2023-05-08T15:03:40.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40758.504185 secs 2023-05-08T15:03:40.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:39 smithi096 ceph-mon[124666]: osdmap e1439: 12 total, 12 up, 12 in 2023-05-08T15:03:40.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:39 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40759.058289 secs 2023-05-08T15:03:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:39 smithi186 ceph-mon[126480]: pgmap v21790: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 698 KiB/s wr, 10 op/s 2023-05-08T15:03:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40758.504185 secs 2023-05-08T15:03:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:39 smithi186 ceph-mon[126480]: osdmap e1439: 12 total, 12 up, 12 in 2023-05-08T15:03:40.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:39 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40759.058289 secs 2023-05-08T15:03:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:41 smithi133 ceph-mon[125939]: pgmap v21792: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.5 MiB/s wr, 12 op/s 2023-05-08T15:03:42.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40760.399632 secs 2023-05-08T15:03:42.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:41 smithi096 ceph-mon[124666]: pgmap v21792: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.5 MiB/s wr, 12 op/s 2023-05-08T15:03:42.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40760.399632 secs 2023-05-08T15:03:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:41 smithi186 ceph-mon[126480]: pgmap v21792: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.5 MiB/s wr, 12 op/s 2023-05-08T15:03:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40760.399632 secs 2023-05-08T15:03:43.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:42 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:03:43.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:42 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:03:43.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:42 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:03:43.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:42 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:03:43.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:42 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:03:43.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:42 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:03:43.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:42 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:03:43.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:42 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:03:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:42 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:03:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:42 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:03:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:42 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:03:43.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:42 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:03:44.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:43 smithi133 ceph-mon[125939]: pgmap v21793: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.3 MiB/s wr, 11 op/s 2023-05-08T15:03:44.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:43 smithi096 ceph-mon[124666]: pgmap v21793: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.3 MiB/s wr, 11 op/s 2023-05-08T15:03:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:43 smithi186 ceph-mon[126480]: pgmap v21793: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.3 MiB/s wr, 11 op/s 2023-05-08T15:03:45.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40763.504301 secs 2023-05-08T15:03:45.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:44 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40764.058425 secs 2023-05-08T15:03:45.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40763.504301 secs 2023-05-08T15:03:45.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:44 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40764.058425 secs 2023-05-08T15:03:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40763.504301 secs 2023-05-08T15:03:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:44 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40764.058425 secs 2023-05-08T15:03:46.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:45 smithi133 ceph-mon[125939]: pgmap v21794: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.4 MiB/s wr, 14 op/s 2023-05-08T15:03:46.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:45 smithi096 ceph-mon[124666]: pgmap v21794: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.4 MiB/s wr, 14 op/s 2023-05-08T15:03:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:45 smithi186 ceph-mon[126480]: pgmap v21794: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.4 MiB/s wr, 14 op/s 2023-05-08T15:03:48.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:47 smithi133 ceph-mon[125939]: pgmap v21795: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 13 op/s 2023-05-08T15:03:48.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:47 smithi096 ceph-mon[124666]: pgmap v21795: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 13 op/s 2023-05-08T15:03:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:47 smithi186 ceph-mon[126480]: pgmap v21795: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 13 op/s 2023-05-08T15:03:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:49 smithi133 ceph-mon[125939]: pgmap v21796: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 13 op/s 2023-05-08T15:03:50.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:49 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40768.504421 secs 2023-05-08T15:03:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:03:50.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:49 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:03:50.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:49 smithi096 ceph-mon[124666]: pgmap v21796: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 13 op/s 2023-05-08T15:03:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:49 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40768.504421 secs 2023-05-08T15:03:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:03:50.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:49 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:03:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:49 smithi186 ceph-mon[126480]: pgmap v21796: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 13 op/s 2023-05-08T15:03:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:49 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40768.504421 secs 2023-05-08T15:03:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:03:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:49 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:03:51.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:50 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:03:51.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:03:51.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:50 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:03:51.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:50 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:03:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:50 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:03:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:03:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:50 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:03:51.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:50 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:03:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:50 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:03:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:03:51.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:50 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:03:51.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:50 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:03:52.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:51 smithi096 ceph-mon[124666]: pgmap v21797: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.2 MiB/s wr, 18 op/s 2023-05-08T15:03:52.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:51 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40770.399914 secs 2023-05-08T15:03:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:51 smithi186 ceph-mon[126480]: pgmap v21797: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.2 MiB/s wr, 18 op/s 2023-05-08T15:03:52.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:51 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40770.399914 secs 2023-05-08T15:03:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:51 smithi133 ceph-mon[125939]: pgmap v21797: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.2 MiB/s wr, 18 op/s 2023-05-08T15:03:52.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:51 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40770.399914 secs 2023-05-08T15:03:54.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:54 smithi096 ceph-mon[124666]: pgmap v21798: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.5 MiB/s wr, 11 op/s 2023-05-08T15:03:54.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T15:03:54.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T15:03:54.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T15:03:54.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T15:03:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:54 smithi186 ceph-mon[126480]: pgmap v21798: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.5 MiB/s wr, 11 op/s 2023-05-08T15:03:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T15:03:54.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T15:03:54.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T15:03:54.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T15:03:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:54 smithi133 ceph-mon[125939]: pgmap v21798: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.5 MiB/s wr, 11 op/s 2023-05-08T15:03:54.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T15:03:54.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T15:03:54.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T15:03:54.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T15:03:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40773.504490 secs 2023-05-08T15:03:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:55 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T15:03:55.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:55 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T15:03:55.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:55 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T15:03:55.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:55 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T15:03:55.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:55 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:03:55.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:55 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:03:55.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40774.058636 secs 2023-05-08T15:03:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40773.504490 secs 2023-05-08T15:03:55.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:55 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T15:03:55.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:55 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T15:03:55.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:55 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T15:03:55.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:55 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T15:03:55.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:55 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:03:55.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:55 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:03:55.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40774.058636 secs 2023-05-08T15:03:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40773.504490 secs 2023-05-08T15:03:55.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:55 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T15:03:55.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:55 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T15:03:55.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:55 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T15:03:55.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:55 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T15:03:55.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:55 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:03:55.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:55 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:03:55.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40774.058636 secs 2023-05-08T15:03:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:56 smithi186 ceph-mon[126480]: pgmap v21799: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.2 MiB/s wr, 19 op/s 2023-05-08T15:03:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:56 smithi133 ceph-mon[125939]: pgmap v21799: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.2 MiB/s wr, 19 op/s 2023-05-08T15:03:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:56 smithi096 ceph-mon[124666]: pgmap v21799: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.2 MiB/s wr, 19 op/s 2023-05-08T15:03:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:57 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40775.400032 secs 2023-05-08T15:03:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:57 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40775.400032 secs 2023-05-08T15:03:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:57 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40775.400032 secs 2023-05-08T15:03:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:58 smithi186 ceph-mon[126480]: pgmap v21800: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.7 MiB/s wr, 13 op/s 2023-05-08T15:03:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:58 smithi133 ceph-mon[125939]: pgmap v21800: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.7 MiB/s wr, 13 op/s 2023-05-08T15:03:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:58 smithi096 ceph-mon[124666]: pgmap v21800: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.7 MiB/s wr, 13 op/s 2023-05-08T15:03:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:59 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:03:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:59 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:03:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:03:59 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:03:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:59 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:03:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:59 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:03:59.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:03:59 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:03:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:59 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:03:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:59 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:03:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:03:59 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:04:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:00 smithi186 ceph-mon[126480]: pgmap v21801: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.7 MiB/s wr, 13 op/s 2023-05-08T15:04:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40778.504602 secs 2023-05-08T15:04:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40779.058784 secs 2023-05-08T15:04:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:00 smithi133 ceph-mon[125939]: pgmap v21801: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.7 MiB/s wr, 13 op/s 2023-05-08T15:04:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40778.504602 secs 2023-05-08T15:04:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40779.058784 secs 2023-05-08T15:04:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:00 smithi096 ceph-mon[124666]: pgmap v21801: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.7 MiB/s wr, 13 op/s 2023-05-08T15:04:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40778.504602 secs 2023-05-08T15:04:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40779.058784 secs 2023-05-08T15:04:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40780.400165 secs 2023-05-08T15:04:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40780.400165 secs 2023-05-08T15:04:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40780.400165 secs 2023-05-08T15:04:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:02 smithi186 ceph-mon[126480]: pgmap v21802: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.3 MiB/s wr, 21 op/s 2023-05-08T15:04:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:02 smithi133 ceph-mon[125939]: pgmap v21802: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.3 MiB/s wr, 21 op/s 2023-05-08T15:04:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:02 smithi096 ceph-mon[124666]: pgmap v21802: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.3 MiB/s wr, 21 op/s 2023-05-08T15:04:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:04 smithi186 ceph-mon[126480]: pgmap v21803: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.3 MiB/s wr, 15 op/s 2023-05-08T15:04:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:04 smithi133 ceph-mon[125939]: pgmap v21803: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.3 MiB/s wr, 15 op/s 2023-05-08T15:04:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:04 smithi096 ceph-mon[124666]: pgmap v21803: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.3 MiB/s wr, 15 op/s 2023-05-08T15:04:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40783.504717 secs 2023-05-08T15:04:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40784.058910 secs 2023-05-08T15:04:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40783.504717 secs 2023-05-08T15:04:05.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40784.058910 secs 2023-05-08T15:04:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40783.504717 secs 2023-05-08T15:04:05.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40784.058910 secs 2023-05-08T15:04:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:06 smithi186 ceph-mon[126480]: pgmap v21804: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 3.6 MiB/s wr, 35 op/s 2023-05-08T15:04:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40785.400285 secs 2023-05-08T15:04:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:06 smithi133 ceph-mon[125939]: pgmap v21804: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 3.6 MiB/s wr, 35 op/s 2023-05-08T15:04:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40785.400285 secs 2023-05-08T15:04:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:06 smithi096 ceph-mon[124666]: pgmap v21804: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 3.6 MiB/s wr, 35 op/s 2023-05-08T15:04:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40785.400285 secs 2023-05-08T15:04:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:07 smithi186 ceph-mon[126480]: osdmap e1440: 12 total, 12 up, 12 in 2023-05-08T15:04:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:07 smithi133 ceph-mon[125939]: osdmap e1440: 12 total, 12 up, 12 in 2023-05-08T15:04:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:07 smithi096 ceph-mon[124666]: osdmap e1440: 12 total, 12 up, 12 in 2023-05-08T15:04:08.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:08 smithi186 ceph-mon[126480]: pgmap v21806: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 2.2 MiB/s wr, 33 op/s 2023-05-08T15:04:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:08 smithi133 ceph-mon[125939]: pgmap v21806: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 2.2 MiB/s wr, 33 op/s 2023-05-08T15:04:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:08 smithi096 ceph-mon[124666]: pgmap v21806: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 2.2 MiB/s wr, 33 op/s 2023-05-08T15:04:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:09 smithi133 ceph-mon[125939]: pgmap v21807: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 2.2 MiB/s wr, 33 op/s 2023-05-08T15:04:10.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40788.504842 secs 2023-05-08T15:04:10.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40789.059034 secs 2023-05-08T15:04:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:09 smithi096 ceph-mon[124666]: pgmap v21807: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 2.2 MiB/s wr, 33 op/s 2023-05-08T15:04:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40788.504842 secs 2023-05-08T15:04:10.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40789.059034 secs 2023-05-08T15:04:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:09 smithi186 ceph-mon[126480]: pgmap v21807: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 2.2 MiB/s wr, 33 op/s 2023-05-08T15:04:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40788.504842 secs 2023-05-08T15:04:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40789.059034 secs 2023-05-08T15:04:12.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:11 smithi133 ceph-mon[125939]: pgmap v21808: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.1 MiB/s wr, 30 op/s 2023-05-08T15:04:12.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40790.400406 secs 2023-05-08T15:04:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:11 smithi096 ceph-mon[124666]: pgmap v21808: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.1 MiB/s wr, 30 op/s 2023-05-08T15:04:12.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40790.400406 secs 2023-05-08T15:04:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:11 smithi186 ceph-mon[126480]: pgmap v21808: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.1 MiB/s wr, 30 op/s 2023-05-08T15:04:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40790.400406 secs 2023-05-08T15:04:14.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:13 smithi133 ceph-mon[125939]: pgmap v21809: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.1 MiB/s wr, 30 op/s 2023-05-08T15:04:14.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:13 smithi133 ceph-mon[125939]: osdmap e1441: 12 total, 12 up, 12 in 2023-05-08T15:04:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:13 smithi096 ceph-mon[124666]: pgmap v21809: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.1 MiB/s wr, 30 op/s 2023-05-08T15:04:14.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:13 smithi096 ceph-mon[124666]: osdmap e1441: 12 total, 12 up, 12 in 2023-05-08T15:04:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:13 smithi186 ceph-mon[126480]: pgmap v21809: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.1 MiB/s wr, 30 op/s 2023-05-08T15:04:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:13 smithi186 ceph-mon[126480]: osdmap e1441: 12 total, 12 up, 12 in 2023-05-08T15:04:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40793.504967 secs 2023-05-08T15:04:15.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:14 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40794.059177 secs 2023-05-08T15:04:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40793.504967 secs 2023-05-08T15:04:15.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:14 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40794.059177 secs 2023-05-08T15:04:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40793.504967 secs 2023-05-08T15:04:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:14 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40794.059177 secs 2023-05-08T15:04:16.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:15 smithi133 ceph-mon[125939]: pgmap v21811: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T15:04:16.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:15 smithi096 ceph-mon[124666]: pgmap v21811: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T15:04:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:15 smithi186 ceph-mon[126480]: pgmap v21811: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T15:04:17.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40795.400528 secs 2023-05-08T15:04:17.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40795.400528 secs 2023-05-08T15:04:17.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40795.400528 secs 2023-05-08T15:04:18.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:17 smithi096 ceph-mon[124666]: pgmap v21812: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T15:04:18.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:17 smithi186 ceph-mon[126480]: pgmap v21812: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T15:04:18.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:17 smithi133 ceph-mon[125939]: pgmap v21812: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T15:04:20.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:19 smithi096 ceph-mon[124666]: pgmap v21813: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T15:04:20.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40798.505059 secs 2023-05-08T15:04:20.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:19 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40799.059324 secs 2023-05-08T15:04:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:19 smithi186 ceph-mon[126480]: pgmap v21813: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T15:04:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40798.505059 secs 2023-05-08T15:04:20.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:19 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40799.059324 secs 2023-05-08T15:04:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:19 smithi133 ceph-mon[125939]: pgmap v21813: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T15:04:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40798.505059 secs 2023-05-08T15:04:20.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:19 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40799.059324 secs 2023-05-08T15:04:22.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:21 smithi096 ceph-mon[124666]: pgmap v21814: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 845 KiB/s wr, 9 op/s 2023-05-08T15:04:22.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40800.400670 secs 2023-05-08T15:04:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:21 smithi186 ceph-mon[126480]: pgmap v21814: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 845 KiB/s wr, 9 op/s 2023-05-08T15:04:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40800.400670 secs 2023-05-08T15:04:22.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:21 smithi133 ceph-mon[125939]: pgmap v21814: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 845 KiB/s wr, 9 op/s 2023-05-08T15:04:22.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40800.400670 secs 2023-05-08T15:04:24.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:23 smithi096 ceph-mon[124666]: pgmap v21815: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 846 KiB/s wr, 9 op/s 2023-05-08T15:04:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:23 smithi186 ceph-mon[126480]: pgmap v21815: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 846 KiB/s wr, 9 op/s 2023-05-08T15:04:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:23 smithi133 ceph-mon[125939]: pgmap v21815: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 846 KiB/s wr, 9 op/s 2023-05-08T15:04:25.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40803.505191 secs 2023-05-08T15:04:25.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40804.059440 secs 2023-05-08T15:04:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40803.505191 secs 2023-05-08T15:04:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40804.059440 secs 2023-05-08T15:04:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40803.505191 secs 2023-05-08T15:04:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40804.059440 secs 2023-05-08T15:04:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:26 smithi186 ceph-mon[126480]: pgmap v21816: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 825 KiB/s rd, 821 KiB/s wr, 13 op/s 2023-05-08T15:04:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:26 smithi133 ceph-mon[125939]: pgmap v21816: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 825 KiB/s rd, 821 KiB/s wr, 13 op/s 2023-05-08T15:04:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:26 smithi096 ceph-mon[124666]: pgmap v21816: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 825 KiB/s rd, 821 KiB/s wr, 13 op/s 2023-05-08T15:04:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:27 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40805.400810 secs 2023-05-08T15:04:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:27 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40805.400810 secs 2023-05-08T15:04:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:27 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40805.400810 secs 2023-05-08T15:04:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:28 smithi186 ceph-mon[126480]: pgmap v21817: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 520 KiB/s rd, 518 KiB/s wr, 7 op/s 2023-05-08T15:04:28.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:28 smithi133 ceph-mon[125939]: pgmap v21817: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 520 KiB/s rd, 518 KiB/s wr, 7 op/s 2023-05-08T15:04:28.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:28 smithi096 ceph-mon[124666]: pgmap v21817: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 520 KiB/s rd, 518 KiB/s wr, 7 op/s 2023-05-08T15:04:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:30 smithi186 ceph-mon[126480]: pgmap v21818: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 520 KiB/s rd, 518 KiB/s wr, 7 op/s 2023-05-08T15:04:30.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40808.505308 secs 2023-05-08T15:04:30.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40809.059491 secs 2023-05-08T15:04:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:30 smithi133 ceph-mon[125939]: pgmap v21818: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 520 KiB/s rd, 518 KiB/s wr, 7 op/s 2023-05-08T15:04:30.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40808.505308 secs 2023-05-08T15:04:30.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40809.059491 secs 2023-05-08T15:04:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:30 smithi096 ceph-mon[124666]: pgmap v21818: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 520 KiB/s rd, 518 KiB/s wr, 7 op/s 2023-05-08T15:04:30.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40808.505308 secs 2023-05-08T15:04:30.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40809.059491 secs 2023-05-08T15:04:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:32 smithi186 ceph-mon[126480]: pgmap v21819: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 550 KiB/s rd, 547 KiB/s wr, 11 op/s 2023-05-08T15:04:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:32 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40810.400904 secs 2023-05-08T15:04:32.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:32 smithi133 ceph-mon[125939]: pgmap v21819: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 550 KiB/s rd, 547 KiB/s wr, 11 op/s 2023-05-08T15:04:32.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:32 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40810.400904 secs 2023-05-08T15:04:32.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:32 smithi096 ceph-mon[124666]: pgmap v21819: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 550 KiB/s rd, 547 KiB/s wr, 11 op/s 2023-05-08T15:04:32.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:32 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40810.400904 secs 2023-05-08T15:04:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:34 smithi186 ceph-mon[126480]: pgmap v21820: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 30 KiB/s wr, 7 op/s 2023-05-08T15:04:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:34 smithi133 ceph-mon[125939]: pgmap v21820: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 30 KiB/s wr, 7 op/s 2023-05-08T15:04:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:34 smithi096 ceph-mon[124666]: pgmap v21820: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 30 KiB/s wr, 7 op/s 2023-05-08T15:04:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40813.505414 secs 2023-05-08T15:04:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40814.059608 secs 2023-05-08T15:04:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40813.505414 secs 2023-05-08T15:04:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40814.059608 secs 2023-05-08T15:04:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40813.505414 secs 2023-05-08T15:04:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40814.059608 secs 2023-05-08T15:04:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:36 smithi186 ceph-mon[126480]: pgmap v21821: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 807 KiB/s rd, 403 KiB/s wr, 11 op/s 2023-05-08T15:04:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40815.401002 secs 2023-05-08T15:04:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:36 smithi133 ceph-mon[125939]: pgmap v21821: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 807 KiB/s rd, 403 KiB/s wr, 11 op/s 2023-05-08T15:04:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40815.401002 secs 2023-05-08T15:04:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:36 smithi096 ceph-mon[124666]: pgmap v21821: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 807 KiB/s rd, 403 KiB/s wr, 11 op/s 2023-05-08T15:04:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40815.401002 secs 2023-05-08T15:04:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:38 smithi186 ceph-mon[126480]: pgmap v21822: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 404 KiB/s rd, 402 KiB/s wr, 7 op/s 2023-05-08T15:04:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:38 smithi133 ceph-mon[125939]: pgmap v21822: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 404 KiB/s rd, 402 KiB/s wr, 7 op/s 2023-05-08T15:04:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:38 smithi096 ceph-mon[124666]: pgmap v21822: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 404 KiB/s rd, 402 KiB/s wr, 7 op/s 2023-05-08T15:04:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:40 smithi186 ceph-mon[126480]: pgmap v21823: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 404 KiB/s rd, 402 KiB/s wr, 7 op/s 2023-05-08T15:04:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40818.505522 secs 2023-05-08T15:04:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40819.059737 secs 2023-05-08T15:04:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:40 smithi133 ceph-mon[125939]: pgmap v21823: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 404 KiB/s rd, 402 KiB/s wr, 7 op/s 2023-05-08T15:04:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40818.505522 secs 2023-05-08T15:04:40.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40819.059737 secs 2023-05-08T15:04:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:40 smithi096 ceph-mon[124666]: pgmap v21823: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 404 KiB/s rd, 402 KiB/s wr, 7 op/s 2023-05-08T15:04:40.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40818.505522 secs 2023-05-08T15:04:40.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40819.059737 secs 2023-05-08T15:04:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40820.401118 secs 2023-05-08T15:04:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40820.401118 secs 2023-05-08T15:04:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40820.401118 secs 2023-05-08T15:04:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:42 smithi186 ceph-mon[126480]: pgmap v21824: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 403 KiB/s wr, 10 op/s 2023-05-08T15:04:42.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:42 smithi133 ceph-mon[125939]: pgmap v21824: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 403 KiB/s wr, 10 op/s 2023-05-08T15:04:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:42 smithi096 ceph-mon[124666]: pgmap v21824: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 403 KiB/s wr, 10 op/s 2023-05-08T15:04:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:44 smithi186 ceph-mon[126480]: pgmap v21825: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 373 KiB/s wr, 6 op/s 2023-05-08T15:04:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:44 smithi133 ceph-mon[125939]: pgmap v21825: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 373 KiB/s wr, 6 op/s 2023-05-08T15:04:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:44 smithi096 ceph-mon[124666]: pgmap v21825: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 373 KiB/s wr, 6 op/s 2023-05-08T15:04:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40823.505617 secs 2023-05-08T15:04:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40824.059850 secs 2023-05-08T15:04:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40823.505617 secs 2023-05-08T15:04:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40824.059850 secs 2023-05-08T15:04:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40823.505617 secs 2023-05-08T15:04:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40824.059850 secs 2023-05-08T15:04:46.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:46 smithi186 ceph-mon[126480]: pgmap v21826: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 963 KiB/s wr, 10 op/s 2023-05-08T15:04:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:46 smithi133 ceph-mon[125939]: pgmap v21826: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 963 KiB/s wr, 10 op/s 2023-05-08T15:04:46.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:46 smithi096 ceph-mon[124666]: pgmap v21826: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 963 KiB/s wr, 10 op/s 2023-05-08T15:04:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:48 smithi186 ceph-mon[126480]: pgmap v21827: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 663 KiB/s rd, 590 KiB/s wr, 7 op/s 2023-05-08T15:04:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:48 smithi133 ceph-mon[125939]: pgmap v21827: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 663 KiB/s rd, 590 KiB/s wr, 7 op/s 2023-05-08T15:04:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:48 smithi096 ceph-mon[124666]: pgmap v21827: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 663 KiB/s rd, 590 KiB/s wr, 7 op/s 2023-05-08T15:04:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:50 smithi186 ceph-mon[126480]: pgmap v21828: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 663 KiB/s rd, 590 KiB/s wr, 7 op/s 2023-05-08T15:04:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40828.505734 secs 2023-05-08T15:04:50.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:50 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:04:50.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:50 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:04:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:50 smithi133 ceph-mon[125939]: pgmap v21828: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 663 KiB/s rd, 590 KiB/s wr, 7 op/s 2023-05-08T15:04:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40828.505734 secs 2023-05-08T15:04:50.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:50 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:04:50.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:50 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:04:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:50 smithi096 ceph-mon[124666]: pgmap v21828: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 663 KiB/s rd, 590 KiB/s wr, 7 op/s 2023-05-08T15:04:50.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40828.505734 secs 2023-05-08T15:04:50.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:50 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:04:50.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:50 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:04:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:51 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:04:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:04:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:04:51.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:04:51.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:51 smithi186 ceph-mon[126480]: pgmap v21829: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T15:04:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:51 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:04:51.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:04:51.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:04:51.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:04:51.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:51 smithi133 ceph-mon[125939]: pgmap v21829: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T15:04:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:51 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:04:51.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:04:51.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:04:51.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:04:51.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:51 smithi096 ceph-mon[124666]: pgmap v21829: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T15:04:53.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:53 smithi186 ceph-mon[126480]: pgmap v21830: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 9 op/s 2023-05-08T15:04:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:53 smithi133 ceph-mon[125939]: pgmap v21830: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 9 op/s 2023-05-08T15:04:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:53 smithi096 ceph-mon[124666]: pgmap v21830: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 9 op/s 2023-05-08T15:04:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:54 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40833.505833 secs 2023-05-08T15:04:55.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T15:04:55.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T15:04:55.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T15:04:55.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:54 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T15:04:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:54 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40833.505833 secs 2023-05-08T15:04:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T15:04:55.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T15:04:55.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T15:04:55.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:54 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T15:04:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:54 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40833.505833 secs 2023-05-08T15:04:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T15:04:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T15:04:55.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T15:04:55.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:54 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T15:04:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:55 smithi133 ceph-mon[125939]: pgmap v21831: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 15 op/s 2023-05-08T15:04:56.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:55 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T15:04:56.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:55 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T15:04:56.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:55 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T15:04:56.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:55 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T15:04:56.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:55 smithi096 ceph-mon[124666]: pgmap v21831: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 15 op/s 2023-05-08T15:04:56.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:55 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T15:04:56.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:55 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T15:04:56.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:55 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T15:04:56.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:55 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T15:04:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:55 smithi186 ceph-mon[126480]: pgmap v21831: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 15 op/s 2023-05-08T15:04:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:55 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T15:04:56.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:55 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T15:04:56.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:55 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T15:04:56.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:55 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T15:04:57.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:56 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40835.401464 secs 2023-05-08T15:04:57.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:56 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40835.401464 secs 2023-05-08T15:04:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:56 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40835.401464 secs 2023-05-08T15:04:58.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:57 smithi096 ceph-mon[124666]: pgmap v21832: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 12 op/s 2023-05-08T15:04:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:57 smithi186 ceph-mon[126480]: pgmap v21832: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 12 op/s 2023-05-08T15:04:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:57 smithi133 ceph-mon[125939]: pgmap v21832: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 12 op/s 2023-05-08T15:04:59.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:58 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:04:59.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:58 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:04:59.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:58 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:04:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:58 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:04:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:58 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:04:59.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:58 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:04:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:58 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:04:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:58 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:04:59.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:58 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:05:00.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:59 smithi096 ceph-mon[124666]: pgmap v21833: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 12 op/s 2023-05-08T15:05:00.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40838.505961 secs 2023-05-08T15:05:00.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:04:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40839.060134 secs 2023-05-08T15:05:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:59 smithi186 ceph-mon[126480]: pgmap v21833: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 12 op/s 2023-05-08T15:05:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40838.505961 secs 2023-05-08T15:05:00.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:04:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40839.060134 secs 2023-05-08T15:05:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:59 smithi133 ceph-mon[125939]: pgmap v21833: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 12 op/s 2023-05-08T15:05:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40838.505961 secs 2023-05-08T15:05:00.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:04:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40839.060134 secs 2023-05-08T15:05:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:02 smithi186 ceph-mon[126480]: pgmap v21834: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.1 MiB/s wr, 17 op/s 2023-05-08T15:05:02.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:02 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:05:02.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:02 smithi133 ceph-mon[125939]: pgmap v21834: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.1 MiB/s wr, 17 op/s 2023-05-08T15:05:02.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:02 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:05:02.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:02 smithi096 ceph-mon[124666]: pgmap v21834: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.1 MiB/s wr, 17 op/s 2023-05-08T15:05:02.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:02 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:05:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:05:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:05:03.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:03 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:05:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:05:03.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:05:03.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:03 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:05:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:05:03.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:05:03.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:03 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:05:04.372 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:04 smithi186 ceph-mon[126480]: pgmap v21835: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.5 MiB/s wr, 12 op/s 2023-05-08T15:05:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:04 smithi133 ceph-mon[125939]: pgmap v21835: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.5 MiB/s wr, 12 op/s 2023-05-08T15:05:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:04 smithi096 ceph-mon[124666]: pgmap v21835: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.5 MiB/s wr, 12 op/s 2023-05-08T15:05:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40843.506078 secs 2023-05-08T15:05:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40844.060261 secs 2023-05-08T15:05:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40843.506078 secs 2023-05-08T15:05:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40844.060261 secs 2023-05-08T15:05:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40843.506078 secs 2023-05-08T15:05:05.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40844.060261 secs 2023-05-08T15:05:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:06 smithi186 ceph-mon[126480]: pgmap v21836: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.6 MiB/s wr, 29 op/s 2023-05-08T15:05:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:06 smithi133 ceph-mon[125939]: pgmap v21836: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.6 MiB/s wr, 29 op/s 2023-05-08T15:05:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:06 smithi096 ceph-mon[124666]: pgmap v21836: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.6 MiB/s wr, 29 op/s 2023-05-08T15:05:08.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:08 smithi186 ceph-mon[126480]: pgmap v21837: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.4 MiB/s wr, 24 op/s 2023-05-08T15:05:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:08 smithi133 ceph-mon[125939]: pgmap v21837: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.4 MiB/s wr, 24 op/s 2023-05-08T15:05:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:08 smithi096 ceph-mon[124666]: pgmap v21837: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.4 MiB/s wr, 24 op/s 2023-05-08T15:05:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:10 smithi186 ceph-mon[126480]: pgmap v21838: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.1 MiB/s wr, 23 op/s 2023-05-08T15:05:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40848.506192 secs 2023-05-08T15:05:10.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40849.060383 secs 2023-05-08T15:05:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:10 smithi133 ceph-mon[125939]: pgmap v21838: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.1 MiB/s wr, 23 op/s 2023-05-08T15:05:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40848.506192 secs 2023-05-08T15:05:10.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40849.060383 secs 2023-05-08T15:05:10.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:10 smithi096 ceph-mon[124666]: pgmap v21838: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.1 MiB/s wr, 23 op/s 2023-05-08T15:05:10.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40848.506192 secs 2023-05-08T15:05:10.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40849.060383 secs 2023-05-08T15:05:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:12 smithi186 ceph-mon[126480]: pgmap v21839: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.4 MiB/s wr, 26 op/s 2023-05-08T15:05:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:12 smithi133 ceph-mon[125939]: pgmap v21839: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.4 MiB/s wr, 26 op/s 2023-05-08T15:05:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:12 smithi096 ceph-mon[124666]: pgmap v21839: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.4 MiB/s wr, 26 op/s 2023-05-08T15:05:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:14 smithi186 ceph-mon[126480]: pgmap v21840: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 21 op/s 2023-05-08T15:05:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:14 smithi133 ceph-mon[125939]: pgmap v21840: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 21 op/s 2023-05-08T15:05:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:14 smithi096 ceph-mon[124666]: pgmap v21840: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 21 op/s 2023-05-08T15:05:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40853.506247 secs 2023-05-08T15:05:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40854.060526 secs 2023-05-08T15:05:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40853.506247 secs 2023-05-08T15:05:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40854.060526 secs 2023-05-08T15:05:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40853.506247 secs 2023-05-08T15:05:15.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40854.060526 secs 2023-05-08T15:05:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:16 smithi186 ceph-mon[126480]: pgmap v21841: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 25 op/s 2023-05-08T15:05:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:16 smithi133 ceph-mon[125939]: pgmap v21841: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 25 op/s 2023-05-08T15:05:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:16 smithi096 ceph-mon[124666]: pgmap v21841: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 25 op/s 2023-05-08T15:05:18.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:18 smithi186 ceph-mon[126480]: pgmap v21842: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 990 KiB/s rd, 988 KiB/s wr, 8 op/s 2023-05-08T15:05:18.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:18 smithi133 ceph-mon[125939]: pgmap v21842: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 990 KiB/s rd, 988 KiB/s wr, 8 op/s 2023-05-08T15:05:18.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:18 smithi096 ceph-mon[124666]: pgmap v21842: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 990 KiB/s rd, 988 KiB/s wr, 8 op/s 2023-05-08T15:05:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:20 smithi186 ceph-mon[126480]: pgmap v21843: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 649 KiB/s rd, 646 KiB/s wr, 7 op/s 2023-05-08T15:05:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40858.506367 secs 2023-05-08T15:05:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:20 smithi133 ceph-mon[125939]: pgmap v21843: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 649 KiB/s rd, 646 KiB/s wr, 7 op/s 2023-05-08T15:05:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40858.506367 secs 2023-05-08T15:05:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:20 smithi096 ceph-mon[124666]: pgmap v21843: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 649 KiB/s rd, 646 KiB/s wr, 7 op/s 2023-05-08T15:05:20.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40858.506367 secs 2023-05-08T15:05:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:22 smithi186 ceph-mon[126480]: pgmap v21844: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 14 op/s 2023-05-08T15:05:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:22 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:05:22.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:22 smithi133 ceph-mon[125939]: pgmap v21844: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 14 op/s 2023-05-08T15:05:22.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:22 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:05:22.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:22 smithi096 ceph-mon[124666]: pgmap v21844: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 14 op/s 2023-05-08T15:05:22.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:22 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:05:23.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:23 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:05:23.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:23 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:05:23.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:23 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:05:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:23 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:05:23.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:23 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:05:23.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:23 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:05:23.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:23 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:05:23.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:23 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:05:23.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:23 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:05:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:24 smithi186 ceph-mon[126480]: pgmap v21845: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T15:05:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:24 smithi133 ceph-mon[125939]: pgmap v21845: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T15:05:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:24 smithi096 ceph-mon[124666]: pgmap v21845: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2023-05-08T15:05:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40863.506474 secs 2023-05-08T15:05:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40863.506474 secs 2023-05-08T15:05:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40863.506474 secs 2023-05-08T15:05:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:26 smithi186 ceph-mon[126480]: pgmap v21846: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 16 op/s 2023-05-08T15:05:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:26 smithi133 ceph-mon[125939]: pgmap v21846: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 16 op/s 2023-05-08T15:05:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:26 smithi096 ceph-mon[124666]: pgmap v21846: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 16 op/s 2023-05-08T15:05:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:27 smithi186 ceph-mon[126480]: osdmap e1442: 12 total, 12 up, 12 in 2023-05-08T15:05:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:27 smithi186 ceph-mon[126480]: pgmap v21848: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2023-05-08T15:05:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:27 smithi133 ceph-mon[125939]: osdmap e1442: 12 total, 12 up, 12 in 2023-05-08T15:05:27.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:27 smithi133 ceph-mon[125939]: pgmap v21848: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2023-05-08T15:05:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:27 smithi096 ceph-mon[124666]: osdmap e1442: 12 total, 12 up, 12 in 2023-05-08T15:05:27.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:27 smithi096 ceph-mon[124666]: pgmap v21848: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2023-05-08T15:05:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:29 smithi133 ceph-mon[125939]: pgmap v21849: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2023-05-08T15:05:30.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:29 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40868.506591 secs 2023-05-08T15:05:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:29 smithi096 ceph-mon[124666]: pgmap v21849: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2023-05-08T15:05:30.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:29 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40868.506591 secs 2023-05-08T15:05:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:29 smithi186 ceph-mon[126480]: pgmap v21849: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2023-05-08T15:05:30.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:29 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40868.506591 secs 2023-05-08T15:05:32.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:31 smithi133 ceph-mon[125939]: pgmap v21850: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 487 KiB/s rd, 486 KiB/s wr, 10 op/s 2023-05-08T15:05:32.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:31 smithi096 ceph-mon[124666]: pgmap v21850: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 487 KiB/s rd, 486 KiB/s wr, 10 op/s 2023-05-08T15:05:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:31 smithi186 ceph-mon[126480]: pgmap v21850: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 487 KiB/s rd, 486 KiB/s wr, 10 op/s 2023-05-08T15:05:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:33 smithi096 ceph-mon[124666]: pgmap v21851: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 487 KiB/s rd, 486 KiB/s wr, 10 op/s 2023-05-08T15:05:34.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:33 smithi096 ceph-mon[124666]: osdmap e1443: 12 total, 12 up, 12 in 2023-05-08T15:05:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:33 smithi186 ceph-mon[126480]: pgmap v21851: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 487 KiB/s rd, 486 KiB/s wr, 10 op/s 2023-05-08T15:05:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:33 smithi186 ceph-mon[126480]: osdmap e1443: 12 total, 12 up, 12 in 2023-05-08T15:05:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:33 smithi133 ceph-mon[125939]: pgmap v21851: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 487 KiB/s rd, 486 KiB/s wr, 10 op/s 2023-05-08T15:05:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:33 smithi133 ceph-mon[125939]: osdmap e1443: 12 total, 12 up, 12 in 2023-05-08T15:05:35.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40873.506706 secs 2023-05-08T15:05:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40873.506706 secs 2023-05-08T15:05:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40873.506706 secs 2023-05-08T15:05:36.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:36 smithi096 ceph-mon[124666]: pgmap v21853: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 584 KiB/s rd, 540 KiB/s wr, 10 op/s 2023-05-08T15:05:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:36 smithi186 ceph-mon[126480]: pgmap v21853: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 584 KiB/s rd, 540 KiB/s wr, 10 op/s 2023-05-08T15:05:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:36 smithi133 ceph-mon[125939]: pgmap v21853: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 584 KiB/s rd, 540 KiB/s wr, 10 op/s 2023-05-08T15:05:37.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:37 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40875.402493 secs 2023-05-08T15:05:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:37 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40875.402493 secs 2023-05-08T15:05:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:37 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40875.402493 secs 2023-05-08T15:05:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:38 smithi186 ceph-mon[126480]: pgmap v21854: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 444 KiB/s wr, 8 op/s 2023-05-08T15:05:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:38 smithi133 ceph-mon[125939]: pgmap v21854: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 444 KiB/s wr, 8 op/s 2023-05-08T15:05:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:38 smithi096 ceph-mon[124666]: pgmap v21854: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 444 KiB/s wr, 8 op/s 2023-05-08T15:05:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:39 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:05:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:39 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:05:39.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:39 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:05:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:39 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:05:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:39 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:05:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:39 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:05:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:39 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:05:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:39 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:05:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:39 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:05:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:40 smithi186 ceph-mon[126480]: pgmap v21855: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 444 KiB/s wr, 8 op/s 2023-05-08T15:05:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40878.506768 secs 2023-05-08T15:05:40.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40879.061102 secs 2023-05-08T15:05:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:40 smithi133 ceph-mon[125939]: pgmap v21855: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 444 KiB/s wr, 8 op/s 2023-05-08T15:05:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40878.506768 secs 2023-05-08T15:05:40.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40879.061102 secs 2023-05-08T15:05:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:40 smithi096 ceph-mon[124666]: pgmap v21855: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 444 KiB/s wr, 8 op/s 2023-05-08T15:05:40.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40878.506768 secs 2023-05-08T15:05:40.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40879.061102 secs 2023-05-08T15:05:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:42 smithi186 ceph-mon[126480]: pgmap v21856: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 667 KiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T15:05:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:42 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40880.402586 secs 2023-05-08T15:05:42.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:42 smithi133 ceph-mon[125939]: pgmap v21856: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 667 KiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T15:05:42.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:42 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40880.402586 secs 2023-05-08T15:05:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:42 smithi096 ceph-mon[124666]: pgmap v21856: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 667 KiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T15:05:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:42 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40880.402586 secs 2023-05-08T15:05:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:05:43.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:05:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:05:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:05:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:05:43.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:05:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:44 smithi186 ceph-mon[126480]: pgmap v21857: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 667 KiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T15:05:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:44 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:05:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:44 smithi133 ceph-mon[125939]: pgmap v21857: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 667 KiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T15:05:44.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:44 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:05:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:44 smithi096 ceph-mon[124666]: pgmap v21857: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 667 KiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T15:05:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:44 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:05:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40883.506856 secs 2023-05-08T15:05:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40884.061200 secs 2023-05-08T15:05:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40883.506856 secs 2023-05-08T15:05:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40884.061200 secs 2023-05-08T15:05:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40883.506856 secs 2023-05-08T15:05:45.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40884.061200 secs 2023-05-08T15:05:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:46 smithi186 ceph-mon[126480]: pgmap v21858: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 16 op/s 2023-05-08T15:05:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:46 smithi133 ceph-mon[125939]: pgmap v21858: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 16 op/s 2023-05-08T15:05:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:46 smithi096 ceph-mon[124666]: pgmap v21858: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 16 op/s 2023-05-08T15:05:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:48 smithi186 ceph-mon[126480]: pgmap v21859: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T15:05:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:48 smithi133 ceph-mon[125939]: pgmap v21859: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T15:05:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:48 smithi096 ceph-mon[124666]: pgmap v21859: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T15:05:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:50 smithi186 ceph-mon[126480]: pgmap v21860: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T15:05:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40888.507003 secs 2023-05-08T15:05:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40889.061309 secs 2023-05-08T15:05:50.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:50 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:05:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:50 smithi133 ceph-mon[125939]: pgmap v21860: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T15:05:50.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40888.507003 secs 2023-05-08T15:05:50.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40889.061309 secs 2023-05-08T15:05:50.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:50 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:05:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:50 smithi096 ceph-mon[124666]: pgmap v21860: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T15:05:50.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40888.507003 secs 2023-05-08T15:05:50.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40889.061309 secs 2023-05-08T15:05:50.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:50 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:05:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:51 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:05:51.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:05:51.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:05:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:51 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:05:51.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:05:51.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:05:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:51 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:05:51.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:05:51.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:05:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:52 smithi186 ceph-mon[126480]: pgmap v21861: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 14 op/s 2023-05-08T15:05:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:52 smithi133 ceph-mon[125939]: pgmap v21861: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 14 op/s 2023-05-08T15:05:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:52 smithi096 ceph-mon[124666]: pgmap v21861: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 14 op/s 2023-05-08T15:05:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:54 smithi186 ceph-mon[126480]: pgmap v21862: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 966 KiB/s wr, 9 op/s 2023-05-08T15:05:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:54 smithi133 ceph-mon[125939]: pgmap v21862: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 966 KiB/s wr, 9 op/s 2023-05-08T15:05:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:54 smithi096 ceph-mon[124666]: pgmap v21862: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 966 KiB/s wr, 9 op/s 2023-05-08T15:05:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40893.507136 secs 2023-05-08T15:05:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:55 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T15:05:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40893.507136 secs 2023-05-08T15:05:55.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:55 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T15:05:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40893.507136 secs 2023-05-08T15:05:55.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:55 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T15:05:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:56 smithi186 ceph-mon[126480]: pgmap v21863: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.2 MiB/s wr, 15 op/s 2023-05-08T15:05:56.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T15:05:56.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T15:05:56.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T15:05:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:56 smithi133 ceph-mon[125939]: pgmap v21863: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.2 MiB/s wr, 15 op/s 2023-05-08T15:05:56.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T15:05:56.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T15:05:56.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T15:05:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:56 smithi096 ceph-mon[124666]: pgmap v21863: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.2 MiB/s wr, 15 op/s 2023-05-08T15:05:56.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T15:05:56.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T15:05:56.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T15:05:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:57 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T15:05:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:57 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T15:05:57.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:57 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T15:05:57.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:57 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T15:05:57.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:57 smithi186 ceph-mon[126480]: pgmap v21864: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.4 MiB/s wr, 11 op/s 2023-05-08T15:05:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:57 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T15:05:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:57 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T15:05:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:57 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T15:05:57.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:57 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T15:05:57.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:57 smithi133 ceph-mon[125939]: pgmap v21864: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.4 MiB/s wr, 11 op/s 2023-05-08T15:05:57.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:57 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T15:05:57.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:57 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T15:05:57.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:57 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T15:05:57.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:57 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T15:05:57.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:57 smithi096 ceph-mon[124666]: pgmap v21864: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.4 MiB/s wr, 11 op/s 2023-05-08T15:05:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:58 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:05:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:58 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:05:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:58 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:05:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:59 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:05:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:59 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:05:59.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:59 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:05:59.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:05:59 smithi186 ceph-mon[126480]: pgmap v21865: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.4 MiB/s wr, 11 op/s 2023-05-08T15:05:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:59 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:05:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:59 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:05:59.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:59 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:05:59.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:05:59 smithi133 ceph-mon[125939]: pgmap v21865: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.4 MiB/s wr, 11 op/s 2023-05-08T15:05:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:59 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:05:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:59 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:05:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:59 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:05:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:05:59 smithi096 ceph-mon[124666]: pgmap v21865: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.4 MiB/s wr, 11 op/s 2023-05-08T15:06:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40898.507200 secs 2023-05-08T15:06:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40899.061536 secs 2023-05-08T15:06:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40898.507200 secs 2023-05-08T15:06:00.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40899.061536 secs 2023-05-08T15:06:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40898.507200 secs 2023-05-08T15:06:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40899.061536 secs 2023-05-08T15:06:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:01 smithi186 ceph-mon[126480]: pgmap v21866: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.3 MiB/s wr, 18 op/s 2023-05-08T15:06:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:01 smithi133 ceph-mon[125939]: pgmap v21866: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.3 MiB/s wr, 18 op/s 2023-05-08T15:06:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:01 smithi096 ceph-mon[124666]: pgmap v21866: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.3 MiB/s wr, 18 op/s 2023-05-08T15:06:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:06:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:03 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:06:03.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:03 smithi186 ceph-mon[126480]: pgmap v21867: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.6 MiB/s wr, 13 op/s 2023-05-08T15:06:03.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:06:03.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:03 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:06:03.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:03 smithi133 ceph-mon[125939]: pgmap v21867: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.6 MiB/s wr, 13 op/s 2023-05-08T15:06:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:06:03.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:03 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:06:03.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:03 smithi096 ceph-mon[124666]: pgmap v21867: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.6 MiB/s wr, 13 op/s 2023-05-08T15:06:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:04 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:06:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:04 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:06:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:04 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:06:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40903.507356 secs 2023-05-08T15:06:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:05 smithi186 ceph-mon[126480]: pgmap v21868: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.3 MiB/s wr, 32 op/s 2023-05-08T15:06:05.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40904.061604 secs 2023-05-08T15:06:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40903.507356 secs 2023-05-08T15:06:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:05 smithi133 ceph-mon[125939]: pgmap v21868: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.3 MiB/s wr, 32 op/s 2023-05-08T15:06:05.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40904.061604 secs 2023-05-08T15:06:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40903.507356 secs 2023-05-08T15:06:05.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:05 smithi096 ceph-mon[124666]: pgmap v21868: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.3 MiB/s wr, 32 op/s 2023-05-08T15:06:05.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40904.061604 secs 2023-05-08T15:06:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:07 smithi186 ceph-mon[126480]: pgmap v21869: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 2.0 MiB/s wr, 26 op/s 2023-05-08T15:06:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:07 smithi133 ceph-mon[125939]: pgmap v21869: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 2.0 MiB/s wr, 26 op/s 2023-05-08T15:06:07.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:07 smithi096 ceph-mon[124666]: pgmap v21869: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 2.0 MiB/s wr, 26 op/s 2023-05-08T15:06:10.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:09 smithi096 ceph-mon[124666]: pgmap v21870: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 1.7 MiB/s wr, 26 op/s 2023-05-08T15:06:10.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40908.507498 secs 2023-05-08T15:06:10.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40909.061723 secs 2023-05-08T15:06:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:09 smithi186 ceph-mon[126480]: pgmap v21870: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 1.7 MiB/s wr, 26 op/s 2023-05-08T15:06:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40908.507498 secs 2023-05-08T15:06:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40909.061723 secs 2023-05-08T15:06:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:09 smithi133 ceph-mon[125939]: pgmap v21870: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 1.7 MiB/s wr, 26 op/s 2023-05-08T15:06:10.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40908.507498 secs 2023-05-08T15:06:10.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40909.061723 secs 2023-05-08T15:06:12.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:11 smithi096 ceph-mon[124666]: pgmap v21871: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 1.7 MiB/s wr, 29 op/s 2023-05-08T15:06:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:11 smithi186 ceph-mon[126480]: pgmap v21871: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 1.7 MiB/s wr, 29 op/s 2023-05-08T15:06:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:11 smithi133 ceph-mon[125939]: pgmap v21871: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 1.7 MiB/s wr, 29 op/s 2023-05-08T15:06:14.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:14 smithi096 ceph-mon[124666]: pgmap v21872: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 738 KiB/s wr, 22 op/s 2023-05-08T15:06:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:14 smithi186 ceph-mon[126480]: pgmap v21872: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 738 KiB/s wr, 22 op/s 2023-05-08T15:06:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:14 smithi133 ceph-mon[125939]: pgmap v21872: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 738 KiB/s wr, 22 op/s 2023-05-08T15:06:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40913.507611 secs 2023-05-08T15:06:15.487 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40914.061783 secs 2023-05-08T15:06:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40913.507611 secs 2023-05-08T15:06:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40914.061783 secs 2023-05-08T15:06:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40913.507611 secs 2023-05-08T15:06:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40914.061783 secs 2023-05-08T15:06:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:16 smithi186 ceph-mon[126480]: pgmap v21873: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.1 MiB/s wr, 26 op/s 2023-05-08T15:06:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:16 smithi133 ceph-mon[125939]: pgmap v21873: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.1 MiB/s wr, 26 op/s 2023-05-08T15:06:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:16 smithi096 ceph-mon[124666]: pgmap v21873: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.1 MiB/s wr, 26 op/s 2023-05-08T15:06:18.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:18 smithi186 ceph-mon[126480]: pgmap v21874: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 398 KiB/s wr, 7 op/s 2023-05-08T15:06:18.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:18 smithi133 ceph-mon[125939]: pgmap v21874: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 398 KiB/s wr, 7 op/s 2023-05-08T15:06:18.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:18 smithi096 ceph-mon[124666]: pgmap v21874: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 398 KiB/s wr, 7 op/s 2023-05-08T15:06:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:20 smithi186 ceph-mon[126480]: pgmap v21875: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 398 KiB/s wr, 7 op/s 2023-05-08T15:06:20.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40918.507709 secs 2023-05-08T15:06:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:20 smithi133 ceph-mon[125939]: pgmap v21875: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 398 KiB/s wr, 7 op/s 2023-05-08T15:06:20.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40918.507709 secs 2023-05-08T15:06:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:20 smithi096 ceph-mon[124666]: pgmap v21875: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 398 KiB/s wr, 7 op/s 2023-05-08T15:06:20.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40918.507709 secs 2023-05-08T15:06:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:22 smithi186 ceph-mon[126480]: pgmap v21876: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 899 KiB/s rd, 814 KiB/s wr, 14 op/s 2023-05-08T15:06:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:22 smithi186 ceph-mon[126480]: osdmap e1444: 12 total, 12 up, 12 in 2023-05-08T15:06:22.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:22 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:06:22.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:22 smithi133 ceph-mon[125939]: pgmap v21876: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 899 KiB/s rd, 814 KiB/s wr, 14 op/s 2023-05-08T15:06:22.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:22 smithi133 ceph-mon[125939]: osdmap e1444: 12 total, 12 up, 12 in 2023-05-08T15:06:22.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:22 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:06:22.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:22 smithi096 ceph-mon[124666]: pgmap v21876: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 899 KiB/s rd, 814 KiB/s wr, 14 op/s 2023-05-08T15:06:22.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:22 smithi096 ceph-mon[124666]: osdmap e1444: 12 total, 12 up, 12 in 2023-05-08T15:06:22.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:22 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:06:23.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:23 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:06:23.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:23 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:06:23.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:23 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:06:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:23 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:06:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:23 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:06:23.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:23 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:06:23.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:23 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:06:23.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:23 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:06:23.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:23 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:06:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:24 smithi186 ceph-mon[126480]: pgmap v21878: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 977 KiB/s wr, 13 op/s 2023-05-08T15:06:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:24 smithi133 ceph-mon[125939]: pgmap v21878: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 977 KiB/s wr, 13 op/s 2023-05-08T15:06:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:24 smithi096 ceph-mon[124666]: pgmap v21878: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 977 KiB/s wr, 13 op/s 2023-05-08T15:06:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40923.507807 secs 2023-05-08T15:06:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40923.507807 secs 2023-05-08T15:06:25.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40923.507807 secs 2023-05-08T15:06:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:26 smithi186 ceph-mon[126480]: pgmap v21879: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T15:06:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:26 smithi133 ceph-mon[125939]: pgmap v21879: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T15:06:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:26 smithi096 ceph-mon[124666]: pgmap v21879: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T15:06:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:28 smithi186 ceph-mon[126480]: pgmap v21880: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T15:06:28.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:28 smithi133 ceph-mon[125939]: pgmap v21880: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T15:06:28.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:28 smithi096 ceph-mon[124666]: pgmap v21880: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T15:06:30.255 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:30 smithi096 ceph-mon[124666]: pgmap v21881: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T15:06:30.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40928.507942 secs 2023-05-08T15:06:30.256 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:30 smithi096 ceph-mon[124666]: osdmap e1445: 12 total, 12 up, 12 in 2023-05-08T15:06:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:30 smithi186 ceph-mon[126480]: pgmap v21881: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T15:06:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40928.507942 secs 2023-05-08T15:06:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:30 smithi186 ceph-mon[126480]: osdmap e1445: 12 total, 12 up, 12 in 2023-05-08T15:06:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:30 smithi133 ceph-mon[125939]: pgmap v21881: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 14 op/s 2023-05-08T15:06:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40928.507942 secs 2023-05-08T15:06:30.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:30 smithi133 ceph-mon[125939]: osdmap e1445: 12 total, 12 up, 12 in 2023-05-08T15:06:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:32 smithi186 ceph-mon[126480]: pgmap v21883: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 874 KiB/s wr, 10 op/s 2023-05-08T15:06:32.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:32 smithi133 ceph-mon[125939]: pgmap v21883: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 874 KiB/s wr, 10 op/s 2023-05-08T15:06:32.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:32 smithi096 ceph-mon[124666]: pgmap v21883: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 874 KiB/s wr, 10 op/s 2023-05-08T15:06:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:34 smithi186 ceph-mon[126480]: pgmap v21884: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 811 KiB/s wr, 9 op/s 2023-05-08T15:06:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:34 smithi133 ceph-mon[125939]: pgmap v21884: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 811 KiB/s wr, 9 op/s 2023-05-08T15:06:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:34 smithi096 ceph-mon[124666]: pgmap v21884: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 811 KiB/s wr, 9 op/s 2023-05-08T15:06:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40933.508065 secs 2023-05-08T15:06:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40933.508065 secs 2023-05-08T15:06:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40933.508065 secs 2023-05-08T15:06:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:36 smithi186 ceph-mon[126480]: pgmap v21885: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 219 KiB/s wr, 8 op/s 2023-05-08T15:06:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:36 smithi133 ceph-mon[125939]: pgmap v21885: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 219 KiB/s wr, 8 op/s 2023-05-08T15:06:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:36 smithi096 ceph-mon[124666]: pgmap v21885: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 219 KiB/s wr, 8 op/s 2023-05-08T15:06:37.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:37 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40935.403794 secs 2023-05-08T15:06:37.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:37 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40935.403794 secs 2023-05-08T15:06:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:37 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40935.403794 secs 2023-05-08T15:06:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:38 smithi186 ceph-mon[126480]: pgmap v21886: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 788 KiB/s rd, 559 KiB/s wr, 8 op/s 2023-05-08T15:06:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:38 smithi133 ceph-mon[125939]: pgmap v21886: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 788 KiB/s rd, 559 KiB/s wr, 8 op/s 2023-05-08T15:06:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:38 smithi096 ceph-mon[124666]: pgmap v21886: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 788 KiB/s rd, 559 KiB/s wr, 8 op/s 2023-05-08T15:06:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:39 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:06:39.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:39 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:06:39.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:39 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:06:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:39 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:06:39.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:39 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:06:39.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:39 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:06:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:39 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:06:39.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:39 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:06:39.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:39 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:06:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:40 smithi186 ceph-mon[126480]: pgmap v21887: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 788 KiB/s rd, 559 KiB/s wr, 8 op/s 2023-05-08T15:06:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40938.508185 secs 2023-05-08T15:06:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40939.062438 secs 2023-05-08T15:06:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:40 smithi133 ceph-mon[125939]: pgmap v21887: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 788 KiB/s rd, 559 KiB/s wr, 8 op/s 2023-05-08T15:06:40.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40938.508185 secs 2023-05-08T15:06:40.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40939.062438 secs 2023-05-08T15:06:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:40 smithi096 ceph-mon[124666]: pgmap v21887: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 788 KiB/s rd, 559 KiB/s wr, 8 op/s 2023-05-08T15:06:40.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40938.508185 secs 2023-05-08T15:06:40.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40939.062438 secs 2023-05-08T15:06:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:42 smithi186 ceph-mon[126480]: pgmap v21888: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 13 op/s 2023-05-08T15:06:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:42 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40940.403918 secs 2023-05-08T15:06:42.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:42 smithi133 ceph-mon[125939]: pgmap v21888: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 13 op/s 2023-05-08T15:06:42.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:42 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40940.403918 secs 2023-05-08T15:06:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:42 smithi096 ceph-mon[124666]: pgmap v21888: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 13 op/s 2023-05-08T15:06:42.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:42 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40940.403918 secs 2023-05-08T15:06:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:06:43.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:06:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:06:43.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:06:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:06:43.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:06:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:44 smithi186 ceph-mon[126480]: pgmap v21889: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1005 KiB/s rd, 1004 KiB/s wr, 9 op/s 2023-05-08T15:06:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:44 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:06:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:44 smithi133 ceph-mon[125939]: pgmap v21889: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1005 KiB/s rd, 1004 KiB/s wr, 9 op/s 2023-05-08T15:06:44.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:44 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:06:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:44 smithi096 ceph-mon[124666]: pgmap v21889: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1005 KiB/s rd, 1004 KiB/s wr, 9 op/s 2023-05-08T15:06:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:44 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:06:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40943.508329 secs 2023-05-08T15:06:45.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40944.062550 secs 2023-05-08T15:06:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40943.508329 secs 2023-05-08T15:06:45.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40944.062550 secs 2023-05-08T15:06:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40943.508329 secs 2023-05-08T15:06:45.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40944.062550 secs 2023-05-08T15:06:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:46 smithi186 ceph-mon[126480]: pgmap v21890: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 12 op/s 2023-05-08T15:06:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:46 smithi133 ceph-mon[125939]: pgmap v21890: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 12 op/s 2023-05-08T15:06:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:46 smithi096 ceph-mon[124666]: pgmap v21890: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 12 op/s 2023-05-08T15:06:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:48 smithi186 ceph-mon[126480]: pgmap v21891: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.4 MiB/s wr, 9 op/s 2023-05-08T15:06:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:48 smithi133 ceph-mon[125939]: pgmap v21891: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.4 MiB/s wr, 9 op/s 2023-05-08T15:06:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:48 smithi096 ceph-mon[124666]: pgmap v21891: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.4 MiB/s wr, 9 op/s 2023-05-08T15:06:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:50 smithi186 ceph-mon[126480]: pgmap v21892: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 755 KiB/s rd, 1.1 MiB/s wr, 9 op/s 2023-05-08T15:06:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40948.508468 secs 2023-05-08T15:06:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40949.062664 secs 2023-05-08T15:06:50.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:50 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:06:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:50 smithi133 ceph-mon[125939]: pgmap v21892: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 755 KiB/s rd, 1.1 MiB/s wr, 9 op/s 2023-05-08T15:06:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40948.508468 secs 2023-05-08T15:06:50.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40949.062664 secs 2023-05-08T15:06:50.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:50 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:06:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:50 smithi096 ceph-mon[124666]: pgmap v21892: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 755 KiB/s rd, 1.1 MiB/s wr, 9 op/s 2023-05-08T15:06:50.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40948.508468 secs 2023-05-08T15:06:50.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40949.062664 secs 2023-05-08T15:06:50.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:50 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:06:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:51 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:06:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:06:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:06:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:51 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:06:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:06:51.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:06:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:51 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:06:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:06:51.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:06:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:52 smithi186 ceph-mon[126480]: pgmap v21893: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 13 op/s 2023-05-08T15:06:52.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:52 smithi133 ceph-mon[125939]: pgmap v21893: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 13 op/s 2023-05-08T15:06:52.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:52 smithi096 ceph-mon[124666]: pgmap v21893: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 13 op/s 2023-05-08T15:06:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:54 smithi186 ceph-mon[126480]: pgmap v21894: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 8 op/s 2023-05-08T15:06:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:54 smithi133 ceph-mon[125939]: pgmap v21894: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 8 op/s 2023-05-08T15:06:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:54 smithi096 ceph-mon[124666]: pgmap v21894: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 8 op/s 2023-05-08T15:06:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40953.508575 secs 2023-05-08T15:06:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40953.508575 secs 2023-05-08T15:06:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40953.508575 secs 2023-05-08T15:06:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:56 smithi186 ceph-mon[126480]: pgmap v21895: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 13 op/s 2023-05-08T15:06:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:56 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T15:06:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:56 smithi133 ceph-mon[125939]: pgmap v21895: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 13 op/s 2023-05-08T15:06:56.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:56 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T15:06:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:56 smithi096 ceph-mon[124666]: pgmap v21895: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 13 op/s 2023-05-08T15:06:56.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:56 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T15:06:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T15:06:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T15:06:57.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:57 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T15:06:57.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T15:06:57.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:57 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T15:06:57.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:57 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T15:06:57.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:57 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T15:06:57.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:57 smithi186 ceph-mon[126480]: pgmap v21896: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T15:06:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T15:06:57.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T15:06:57.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:57 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T15:06:57.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T15:06:57.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:57 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T15:06:57.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:57 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T15:06:57.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:57 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T15:06:57.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:57 smithi133 ceph-mon[125939]: pgmap v21896: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T15:06:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T15:06:57.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T15:06:57.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:57 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T15:06:57.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T15:06:57.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:57 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T15:06:57.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:57 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T15:06:57.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:57 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T15:06:57.507 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:57 smithi096 ceph-mon[124666]: pgmap v21896: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.2 MiB/s wr, 10 op/s 2023-05-08T15:06:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:58 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:06:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:58 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:06:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:58 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:06:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:59 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:06:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:59 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:06:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:59 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:06:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:06:59 smithi186 ceph-mon[126480]: pgmap v21897: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.2 MiB/s wr, 9 op/s 2023-05-08T15:06:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:59 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:06:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:59 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:06:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:59 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:06:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:06:59 smithi133 ceph-mon[125939]: pgmap v21897: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.2 MiB/s wr, 9 op/s 2023-05-08T15:06:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:59 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:06:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:59 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:06:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:59 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:06:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:06:59 smithi096 ceph-mon[124666]: pgmap v21897: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.2 MiB/s wr, 9 op/s 2023-05-08T15:07:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40958.508688 secs 2023-05-08T15:07:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40958.508688 secs 2023-05-08T15:07:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40958.508688 secs 2023-05-08T15:07:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:01 smithi186 ceph-mon[126480]: pgmap v21898: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 15 op/s 2023-05-08T15:07:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40960.404390 secs 2023-05-08T15:07:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:01 smithi133 ceph-mon[125939]: pgmap v21898: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 15 op/s 2023-05-08T15:07:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40960.404390 secs 2023-05-08T15:07:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:01 smithi096 ceph-mon[124666]: pgmap v21898: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 15 op/s 2023-05-08T15:07:01.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40960.404390 secs 2023-05-08T15:07:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:07:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:03 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:07:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:03 smithi186 ceph-mon[126480]: pgmap v21899: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.7 MiB/s wr, 11 op/s 2023-05-08T15:07:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:07:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:03 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:07:03.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:03 smithi133 ceph-mon[125939]: pgmap v21899: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.7 MiB/s wr, 11 op/s 2023-05-08T15:07:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:07:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:03 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:07:03.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:03 smithi096 ceph-mon[124666]: pgmap v21899: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.7 MiB/s wr, 11 op/s 2023-05-08T15:07:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:04 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:07:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:04 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:07:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:04 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:07:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40963.508826 secs 2023-05-08T15:07:05.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:05 smithi186 ceph-mon[126480]: pgmap v21900: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.6 MiB/s wr, 32 op/s 2023-05-08T15:07:05.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40964.062953 secs 2023-05-08T15:07:05.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40963.508826 secs 2023-05-08T15:07:05.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:05 smithi133 ceph-mon[125939]: pgmap v21900: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.6 MiB/s wr, 32 op/s 2023-05-08T15:07:05.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40964.062953 secs 2023-05-08T15:07:05.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40963.508826 secs 2023-05-08T15:07:05.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:05 smithi096 ceph-mon[124666]: pgmap v21900: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.6 MiB/s wr, 32 op/s 2023-05-08T15:07:05.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40964.062953 secs 2023-05-08T15:07:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:07 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:07:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:07 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:07:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:07 smithi186 ceph-mon[126480]: osdmap e1446: 12 total, 12 up, 12 in 2023-05-08T15:07:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:07 smithi186 ceph-mon[126480]: pgmap v21902: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.4 MiB/s wr, 32 op/s 2023-05-08T15:07:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:07 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:07:07.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:07 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:07:07.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:07 smithi133 ceph-mon[125939]: osdmap e1446: 12 total, 12 up, 12 in 2023-05-08T15:07:07.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:07 smithi133 ceph-mon[125939]: pgmap v21902: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.4 MiB/s wr, 32 op/s 2023-05-08T15:07:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:07 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:07:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:07 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:07:07.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:07 smithi096 ceph-mon[124666]: osdmap e1446: 12 total, 12 up, 12 in 2023-05-08T15:07:07.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:07 smithi096 ceph-mon[124666]: pgmap v21902: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.4 MiB/s wr, 32 op/s 2023-05-08T15:07:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:09 smithi133 ceph-mon[125939]: pgmap v21903: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.4 MiB/s wr, 32 op/s 2023-05-08T15:07:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:09 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:07:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:09 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:07:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:09 smithi096 ceph-mon[124666]: pgmap v21903: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.4 MiB/s wr, 32 op/s 2023-05-08T15:07:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:09 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:07:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:09 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:07:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:09 smithi186 ceph-mon[126480]: pgmap v21903: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.4 MiB/s wr, 32 op/s 2023-05-08T15:07:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:09 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:07:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:09 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:07:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40968.508956 secs 2023-05-08T15:07:10.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:10 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:07:10.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:10 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:07:10.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:10 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:07:10.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:10 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:07:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40968.508956 secs 2023-05-08T15:07:10.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:10 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:07:10.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:10 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:07:10.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:10 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:07:10.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:10 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:07:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40968.508956 secs 2023-05-08T15:07:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:10 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:07:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:10 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:07:10.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:10 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:07:10.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:10 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:07:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:12 smithi186 ceph-mon[126480]: pgmap v21904: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.7 MiB/s wr, 32 op/s 2023-05-08T15:07:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:12 smithi133 ceph-mon[125939]: pgmap v21904: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.7 MiB/s wr, 32 op/s 2023-05-08T15:07:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:12 smithi096 ceph-mon[124666]: pgmap v21904: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.7 MiB/s wr, 32 op/s 2023-05-08T15:07:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:14 smithi186 ceph-mon[126480]: pgmap v21905: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.1 MiB/s wr, 32 op/s 2023-05-08T15:07:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:14 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:07:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:14 smithi133 ceph-mon[125939]: pgmap v21905: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.1 MiB/s wr, 32 op/s 2023-05-08T15:07:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:14 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:07:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:14 smithi096 ceph-mon[124666]: pgmap v21905: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.1 MiB/s wr, 32 op/s 2023-05-08T15:07:14.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:14 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:07:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40973.509065 secs 2023-05-08T15:07:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:15 smithi186 ceph-mon[126480]: osdmap e1447: 12 total, 12 up, 12 in 2023-05-08T15:07:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40973.509065 secs 2023-05-08T15:07:15.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:15 smithi133 ceph-mon[125939]: osdmap e1447: 12 total, 12 up, 12 in 2023-05-08T15:07:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40973.509065 secs 2023-05-08T15:07:15.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:15 smithi096 ceph-mon[124666]: osdmap e1447: 12 total, 12 up, 12 in 2023-05-08T15:07:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:16 smithi186 ceph-mon[126480]: pgmap v21907: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.8 MiB/s wr, 16 op/s 2023-05-08T15:07:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:16 smithi133 ceph-mon[125939]: pgmap v21907: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.8 MiB/s wr, 16 op/s 2023-05-08T15:07:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:16 smithi096 ceph-mon[124666]: pgmap v21907: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.8 MiB/s wr, 16 op/s 2023-05-08T15:07:18.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:18 smithi186 ceph-mon[126480]: pgmap v21908: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.3 MiB/s wr, 13 op/s 2023-05-08T15:07:18.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:18 smithi133 ceph-mon[125939]: pgmap v21908: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.3 MiB/s wr, 13 op/s 2023-05-08T15:07:18.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:18 smithi096 ceph-mon[124666]: pgmap v21908: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.3 MiB/s wr, 13 op/s 2023-05-08T15:07:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:20 smithi186 ceph-mon[126480]: pgmap v21909: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.3 MiB/s wr, 13 op/s 2023-05-08T15:07:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40978.509195 secs 2023-05-08T15:07:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:20 smithi133 ceph-mon[125939]: pgmap v21909: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.3 MiB/s wr, 13 op/s 2023-05-08T15:07:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40978.509195 secs 2023-05-08T15:07:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:20 smithi096 ceph-mon[124666]: pgmap v21909: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.3 MiB/s wr, 13 op/s 2023-05-08T15:07:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40978.509195 secs 2023-05-08T15:07:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:22 smithi186 ceph-mon[126480]: pgmap v21910: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 10 op/s 2023-05-08T15:07:22.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:22 smithi133 ceph-mon[125939]: pgmap v21910: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 10 op/s 2023-05-08T15:07:22.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:22 smithi096 ceph-mon[124666]: pgmap v21910: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 10 op/s 2023-05-08T15:07:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:24 smithi186 ceph-mon[126480]: pgmap v21911: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T15:07:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:24 smithi133 ceph-mon[125939]: pgmap v21911: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T15:07:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:24 smithi096 ceph-mon[124666]: pgmap v21911: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2023-05-08T15:07:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40983.509364 secs 2023-05-08T15:07:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40983.509364 secs 2023-05-08T15:07:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40983.509364 secs 2023-05-08T15:07:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:26 smithi186 ceph-mon[126480]: pgmap v21912: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 14 op/s 2023-05-08T15:07:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:26 smithi133 ceph-mon[125939]: pgmap v21912: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 14 op/s 2023-05-08T15:07:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:26 smithi096 ceph-mon[124666]: pgmap v21912: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 14 op/s 2023-05-08T15:07:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:27 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40985.404986 secs 2023-05-08T15:07:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:27 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40985.404986 secs 2023-05-08T15:07:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:27 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40985.404986 secs 2023-05-08T15:07:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:28 smithi186 ceph-mon[126480]: pgmap v21913: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 745 KiB/s rd, 402 KiB/s wr, 7 op/s 2023-05-08T15:07:28.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:28 smithi133 ceph-mon[125939]: pgmap v21913: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 745 KiB/s rd, 402 KiB/s wr, 7 op/s 2023-05-08T15:07:28.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:28 smithi096 ceph-mon[124666]: pgmap v21913: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 745 KiB/s rd, 402 KiB/s wr, 7 op/s 2023-05-08T15:07:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:30 smithi186 ceph-mon[126480]: pgmap v21914: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 745 KiB/s rd, 402 KiB/s wr, 7 op/s 2023-05-08T15:07:30.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40988.509492 secs 2023-05-08T15:07:30.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40989.063443 secs 2023-05-08T15:07:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:30 smithi133 ceph-mon[125939]: pgmap v21914: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 745 KiB/s rd, 402 KiB/s wr, 7 op/s 2023-05-08T15:07:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40988.509492 secs 2023-05-08T15:07:30.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40989.063443 secs 2023-05-08T15:07:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:30 smithi096 ceph-mon[124666]: pgmap v21914: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 745 KiB/s rd, 402 KiB/s wr, 7 op/s 2023-05-08T15:07:30.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40988.509492 secs 2023-05-08T15:07:30.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40989.063443 secs 2023-05-08T15:07:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:31 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:07:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:31 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:07:31.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:31 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:07:31.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:31 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:07:31.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40990.405105 secs 2023-05-08T15:07:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:31 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:07:31.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:31 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:07:31.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:31 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:07:31.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:31 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:07:31.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40990.405105 secs 2023-05-08T15:07:31.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:31 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:07:31.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:31 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:07:31.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:31 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:07:31.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:31 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:07:31.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40990.405105 secs 2023-05-08T15:07:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:32 smithi186 ceph-mon[126480]: pgmap v21915: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2023-05-08T15:07:32.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:32 smithi133 ceph-mon[125939]: pgmap v21915: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2023-05-08T15:07:32.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:32 smithi096 ceph-mon[124666]: pgmap v21915: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2023-05-08T15:07:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:34 smithi186 ceph-mon[126480]: pgmap v21916: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 9 op/s 2023-05-08T15:07:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:34 smithi133 ceph-mon[125939]: pgmap v21916: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 9 op/s 2023-05-08T15:07:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:34 smithi096 ceph-mon[124666]: pgmap v21916: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 9 op/s 2023-05-08T15:07:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40993.509621 secs 2023-05-08T15:07:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40994.063538 secs 2023-05-08T15:07:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40993.509621 secs 2023-05-08T15:07:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40994.063538 secs 2023-05-08T15:07:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40993.509621 secs 2023-05-08T15:07:35.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40994.063538 secs 2023-05-08T15:07:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:36 smithi186 ceph-mon[126480]: pgmap v21917: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 13 op/s 2023-05-08T15:07:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40995.405188 secs 2023-05-08T15:07:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:36 smithi133 ceph-mon[125939]: pgmap v21917: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 13 op/s 2023-05-08T15:07:36.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40995.405188 secs 2023-05-08T15:07:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:36 smithi096 ceph-mon[124666]: pgmap v21917: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 13 op/s 2023-05-08T15:07:36.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40995.405188 secs 2023-05-08T15:07:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:38 smithi186 ceph-mon[126480]: pgmap v21918: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 10 op/s 2023-05-08T15:07:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:38 smithi133 ceph-mon[125939]: pgmap v21918: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 10 op/s 2023-05-08T15:07:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:38 smithi096 ceph-mon[124666]: pgmap v21918: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 10 op/s 2023-05-08T15:07:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:40 smithi186 ceph-mon[126480]: pgmap v21919: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 9 op/s 2023-05-08T15:07:40.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40998.509717 secs 2023-05-08T15:07:40.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 40999.063617 secs 2023-05-08T15:07:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:40 smithi133 ceph-mon[125939]: pgmap v21919: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 9 op/s 2023-05-08T15:07:40.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40998.509717 secs 2023-05-08T15:07:40.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 40999.063617 secs 2023-05-08T15:07:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:40 smithi096 ceph-mon[124666]: pgmap v21919: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 9 op/s 2023-05-08T15:07:40.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40998.509717 secs 2023-05-08T15:07:40.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 40999.063617 secs 2023-05-08T15:07:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41000.405336 secs 2023-05-08T15:07:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41000.405336 secs 2023-05-08T15:07:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41000.405336 secs 2023-05-08T15:07:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:42 smithi186 ceph-mon[126480]: pgmap v21920: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 13 op/s 2023-05-08T15:07:42.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:42 smithi133 ceph-mon[125939]: pgmap v21920: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 13 op/s 2023-05-08T15:07:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:42 smithi096 ceph-mon[124666]: pgmap v21920: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 13 op/s 2023-05-08T15:07:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:43 smithi186 ceph-mon[126480]: pgmap v21921: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 681 KiB/s rd, 676 KiB/s wr, 8 op/s 2023-05-08T15:07:43.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:43 smithi133 ceph-mon[125939]: pgmap v21921: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 681 KiB/s rd, 676 KiB/s wr, 8 op/s 2023-05-08T15:07:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:43 smithi096 ceph-mon[124666]: pgmap v21921: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 681 KiB/s rd, 676 KiB/s wr, 8 op/s 2023-05-08T15:07:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41003.509834 secs 2023-05-08T15:07:45.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41004.063689 secs 2023-05-08T15:07:45.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41003.509834 secs 2023-05-08T15:07:45.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41004.063689 secs 2023-05-08T15:07:45.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41003.509834 secs 2023-05-08T15:07:45.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41004.063689 secs 2023-05-08T15:07:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:46 smithi186 ceph-mon[126480]: pgmap v21922: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 748 KiB/s rd, 742 KiB/s wr, 11 op/s 2023-05-08T15:07:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:46 smithi133 ceph-mon[125939]: pgmap v21922: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 748 KiB/s rd, 742 KiB/s wr, 11 op/s 2023-05-08T15:07:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:46 smithi096 ceph-mon[124666]: pgmap v21922: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 748 KiB/s rd, 742 KiB/s wr, 11 op/s 2023-05-08T15:07:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:48 smithi186 ceph-mon[126480]: pgmap v21923: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 405 KiB/s rd, 403 KiB/s wr, 7 op/s 2023-05-08T15:07:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:48 smithi133 ceph-mon[125939]: pgmap v21923: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 405 KiB/s rd, 403 KiB/s wr, 7 op/s 2023-05-08T15:07:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:48 smithi096 ceph-mon[124666]: pgmap v21923: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 405 KiB/s rd, 403 KiB/s wr, 7 op/s 2023-05-08T15:07:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:50 smithi186 ceph-mon[126480]: pgmap v21924: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 405 KiB/s rd, 403 KiB/s wr, 7 op/s 2023-05-08T15:07:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41008.509968 secs 2023-05-08T15:07:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41009.063771 secs 2023-05-08T15:07:50.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:50 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:07:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:50 smithi133 ceph-mon[125939]: pgmap v21924: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 405 KiB/s rd, 403 KiB/s wr, 7 op/s 2023-05-08T15:07:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41008.509968 secs 2023-05-08T15:07:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41009.063771 secs 2023-05-08T15:07:50.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:50 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:07:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:50 smithi096 ceph-mon[124666]: pgmap v21924: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 405 KiB/s rd, 403 KiB/s wr, 7 op/s 2023-05-08T15:07:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41008.509968 secs 2023-05-08T15:07:50.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41009.063771 secs 2023-05-08T15:07:50.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:50 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:07:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:51 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:07:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:07:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:07:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:51 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:07:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:07:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:07:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:51 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:07:51.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:07:51.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:07:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:52 smithi186 ceph-mon[126480]: pgmap v21925: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 782 KiB/s rd, 778 KiB/s wr, 10 op/s 2023-05-08T15:07:52.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:52 smithi133 ceph-mon[125939]: pgmap v21925: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 782 KiB/s rd, 778 KiB/s wr, 10 op/s 2023-05-08T15:07:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:52 smithi096 ceph-mon[124666]: pgmap v21925: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 782 KiB/s rd, 778 KiB/s wr, 10 op/s 2023-05-08T15:07:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:54 smithi186 ceph-mon[126480]: pgmap v21926: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 754 KiB/s rd, 752 KiB/s wr, 7 op/s 2023-05-08T15:07:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:54 smithi133 ceph-mon[125939]: pgmap v21926: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 754 KiB/s rd, 752 KiB/s wr, 7 op/s 2023-05-08T15:07:54.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:54 smithi096 ceph-mon[124666]: pgmap v21926: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 754 KiB/s rd, 752 KiB/s wr, 7 op/s 2023-05-08T15:07:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41013.510080 secs 2023-05-08T15:07:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41013.510080 secs 2023-05-08T15:07:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41013.510080 secs 2023-05-08T15:07:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:56 smithi186 ceph-mon[126480]: pgmap v21927: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T15:07:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:56 smithi133 ceph-mon[125939]: pgmap v21927: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T15:07:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:56 smithi096 ceph-mon[124666]: pgmap v21927: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2023-05-08T15:07:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T15:07:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T15:07:57.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T15:07:57.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T15:07:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T15:07:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T15:07:57.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T15:07:57.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T15:07:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T15:07:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T15:07:57.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T15:07:57.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T15:07:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:58 smithi186 ceph-mon[126480]: pgmap v21928: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 974 KiB/s rd, 972 KiB/s wr, 8 op/s 2023-05-08T15:07:58.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:58 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T15:07:58.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:58 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T15:07:58.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:58 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T15:07:58.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:58 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T15:07:58.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:58 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:07:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:58 smithi133 ceph-mon[125939]: pgmap v21928: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 974 KiB/s rd, 972 KiB/s wr, 8 op/s 2023-05-08T15:07:58.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:58 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T15:07:58.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:58 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T15:07:58.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:58 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T15:07:58.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:58 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T15:07:58.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:58 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:07:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:58 smithi096 ceph-mon[124666]: pgmap v21928: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 974 KiB/s rd, 972 KiB/s wr, 8 op/s 2023-05-08T15:07:58.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:58 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T15:07:58.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:58 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T15:07:58.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:58 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T15:07:58.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:58 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T15:07:58.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:58 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:07:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:59 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:07:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:59 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:07:59.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:07:59 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:07:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:59 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:07:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:59 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:07:59.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:07:59 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:07:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:59 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:07:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:59 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:07:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:07:59 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:08:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:08:00 smithi186 ceph-mon[126480]: pgmap v21929: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 974 KiB/s rd, 972 KiB/s wr, 8 op/s 2023-05-08T15:08:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:08:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41018.510224 secs 2023-05-08T15:08:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:08:00 smithi133 ceph-mon[125939]: pgmap v21929: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 974 KiB/s rd, 972 KiB/s wr, 8 op/s 2023-05-08T15:08:00.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:08:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41018.510224 secs 2023-05-08T15:08:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:08:00 smithi096 ceph-mon[124666]: pgmap v21929: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 974 KiB/s rd, 972 KiB/s wr, 8 op/s 2023-05-08T15:08:00.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:08:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41018.510224 secs 2023-05-08T15:08:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:08:02 smithi186 ceph-mon[126480]: pgmap v21930: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 14 op/s 2023-05-08T15:08:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:08:02 smithi133 ceph-mon[125939]: pgmap v21930: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 14 op/s 2023-05-08T15:08:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:08:02 smithi096 ceph-mon[124666]: pgmap v21930: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 14 op/s 2023-05-08T15:08:04.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:08:04 smithi186 ceph-mon[126480]: pgmap v21931: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 11 op/s 2023-05-08T15:08:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:08:04 smithi133 ceph-mon[125939]: pgmap v21931: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 11 op/s 2023-05-08T15:08:04.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:08:04 smithi096 ceph-mon[124666]: pgmap v21931: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 11 op/s 2023-05-08T15:08:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:08:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41023.510356 secs 2023-05-08T15:08:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:08:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41024.064088 secs 2023-05-08T15:08:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:08:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41023.510356 secs 2023-05-08T15:08:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:08:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41024.064088 secs 2023-05-08T15:08:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:08:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41023.510356 secs 2023-05-08T15:08:05.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:08:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41024.064088 secs 2023-05-08T15:08:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:08:06 smithi186 ceph-mon[126480]: pgmap v21932: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 28 op/s 2023-05-08T15:08:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:08:06 smithi133 ceph-mon[125939]: pgmap v21932: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 28 op/s 2023-05-08T15:08:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:08:06 smithi096 ceph-mon[124666]: pgmap v21932: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 28 op/s 2023-05-08T15:08:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:08:07 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:08:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:08:07 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:08:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:08:07 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:08:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:08:07 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:08:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:08:07 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:08:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:08:07 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:08:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:08:07 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:08:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:08:07 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:08:07.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:08:07 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:08:08.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:08:08 smithi186 ceph-mon[126480]: pgmap v21933: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 24 op/s 2023-05-08T15:08:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:08:08 smithi133 ceph-mon[125939]: pgmap v21933: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 24 op/s 2023-05-08T15:08:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:08:08 smithi096 ceph-mon[124666]: pgmap v21933: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 24 op/s 2023-05-08T15:08:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:08:10 smithi186 ceph-mon[126480]: pgmap v21934: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 24 op/s 2023-05-08T15:08:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:08:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41028.510475 secs 2023-05-08T15:08:10.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:08:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41029.064230 secs 2023-05-08T15:08:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:08:10 smithi133 ceph-mon[125939]: pgmap v21934: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 24 op/s 2023-05-08T15:08:10.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:08:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41028.510475 secs 2023-05-08T15:08:10.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:08:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41029.064230 secs 2023-05-08T15:08:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:08:10 smithi096 ceph-mon[124666]: pgmap v21934: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 24 op/s 2023-05-08T15:08:10.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:08:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41028.510475 secs 2023-05-08T15:08:10.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:08:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41029.064230 secs 2023-05-08T15:08:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:08:12 smithi186 ceph-mon[126480]: pgmap v21935: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 28 op/s 2023-05-08T15:08:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:08:12 smithi133 ceph-mon[125939]: pgmap v21935: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 28 op/s 2023-05-08T15:08:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:08:12 smithi096 ceph-mon[124666]: pgmap v21935: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 28 op/s 2023-05-08T15:08:14.241 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:08:14 smithi133 ceph-mon[125939]: pgmap v21936: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 711 KiB/s rd, 724 KiB/s wr, 23 op/s 2023-05-08T15:08:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:08:14 smithi186 ceph-mon[126480]: pgmap v21936: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 711 KiB/s rd, 724 KiB/s wr, 23 op/s 2023-05-08T15:08:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:08:14 smithi096 ceph-mon[124666]: pgmap v21936: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 711 KiB/s rd, 724 KiB/s wr, 23 op/s 2023-05-08T15:08:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:08:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41033.510628 secs 2023-05-08T15:08:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:08:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41034.064360 secs 2023-05-08T15:08:15.401 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:08:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41033.510628 secs 2023-05-08T15:08:15.402 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:08:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41034.064360 secs 2023-05-08T15:08:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:08:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41033.510628 secs 2023-05-08T15:08:15.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:08:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41034.064360 secs 2023-05-08T15:08:16.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:08:16 smithi186 ceph-mon[126480]: pgmap v21937: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 27 op/s 2023-05-08T15:08:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:08:16 smithi133 ceph-mon[125939]: pgmap v21937: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 27 op/s 2023-05-08T15:08:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:08:16 smithi096 ceph-mon[124666]: pgmap v21937: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 27 op/s 2023-05-08T15:08:18.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:08:18 smithi186 ceph-mon[126480]: pgmap v21938: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 794 KiB/s rd, 792 KiB/s wr, 10 op/s 2023-05-08T15:08:18.447 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:08:18 smithi133 ceph-mon[125939]: pgmap v21938: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 794 KiB/s rd, 792 KiB/s wr, 10 op/s 2023-05-08T15:08:18.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:08:18 smithi096 ceph-mon[124666]: pgmap v21938: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 794 KiB/s rd, 792 KiB/s wr, 10 op/s 2023-05-08T15:08:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:08:20 smithi186 ceph-mon[126480]: pgmap v21939: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 786 KiB/s rd, 784 KiB/s wr, 9 op/s 2023-05-08T15:08:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:08:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41038.510762 secs 2023-05-08T15:08:20.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:08:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41039.064515 secs 2023-05-08T15:08:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:08:20 smithi133 ceph-mon[125939]: pgmap v21939: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 786 KiB/s rd, 784 KiB/s wr, 9 op/s 2023-05-08T15:08:20.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:08:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41038.510762 secs 2023-05-08T15:08:20.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:08:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41039.064515 secs 2023-05-08T15:08:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:08:20 smithi096 ceph-mon[124666]: pgmap v21939: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 786 KiB/s rd, 784 KiB/s wr, 9 op/s 2023-05-08T15:08:20.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:08:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41038.510762 secs 2023-05-08T15:08:20.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:08:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41039.064515 secs 2023-05-08T15:08:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:08:22 smithi186 ceph-mon[126480]: pgmap v21940: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 787 KiB/s rd, 784 KiB/s wr, 13 op/s 2023-05-08T15:08:22.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:08:22 smithi133 ceph-mon[125939]: pgmap v21940: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 787 KiB/s rd, 784 KiB/s wr, 13 op/s 2023-05-08T15:08:22.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:08:22 smithi096 ceph-mon[124666]: pgmap v21940: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 787 KiB/s rd, 784 KiB/s wr, 13 op/s 2023-05-08T15:08:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:08:24 smithi186 ceph-mon[126480]: pgmap v21941: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 784 KiB/s rd, 782 KiB/s wr, 9 op/s 2023-05-08T15:08:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:08:24 smithi133 ceph-mon[125939]: pgmap v21941: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 784 KiB/s rd, 782 KiB/s wr, 9 op/s 2023-05-08T15:08:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:08:24 smithi096 ceph-mon[124666]: pgmap v21941: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 784 KiB/s rd, 782 KiB/s wr, 9 op/s 2023-05-08T15:08:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:08:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41043.510889 secs 2023-05-08T15:08:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:08:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41043.510889 secs 2023-05-08T15:08:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:08:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41043.510889 secs 2023-05-08T15:08:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:08:26 smithi133 ceph-mon[125939]: pgmap v21942: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 16 op/s 2023-05-08T15:08:26.240 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:08:26 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:08:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:08:26 smithi186 ceph-mon[126480]: pgmap v21942: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 16 op/s 2023-05-08T15:08:26.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:08:26 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:08:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:08:26 smithi096 ceph-mon[124666]: pgmap v21942: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 16 op/s 2023-05-08T15:08:26.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:08:26 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:08:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:08:27 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:08:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:08:27 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:08:27.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:08:27 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:08:27.456 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:08:27 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:08:27.457 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:08:27 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:08:27.457 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:08:27 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:08:27.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:08:27 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:08:27.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:08:27 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:08:27.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:08:27 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:08:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:08:28 smithi186 ceph-mon[126480]: pgmap v21943: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T15:08:28.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:08:28 smithi133 ceph-mon[125939]: pgmap v21943: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T15:08:28.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:08:28 smithi096 ceph-mon[124666]: pgmap v21943: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T15:08:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:08:30 smithi186 ceph-mon[126480]: pgmap v21944: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T15:08:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:08:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41048.511016 secs 2023-05-08T15:08:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:08:30 smithi133 ceph-mon[125939]: pgmap v21944: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T15:08:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:08:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41048.511016 secs 2023-05-08T15:08:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:08:30 smithi096 ceph-mon[124666]: pgmap v21944: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 12 op/s 2023-05-08T15:08:30.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:08:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41048.511016 secs 2023-05-08T15:08:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:08:32 smithi186 ceph-mon[126480]: pgmap v21945: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 15 op/s 2023-05-08T15:08:32.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:08:32 smithi186 ceph-mon[126480]: osdmap e1448: 12 total, 12 up, 12 in 2023-05-08T15:08:32.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:08:32 smithi133 ceph-mon[125939]: pgmap v21945: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 15 op/s 2023-05-08T15:08:32.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:08:32 smithi133 ceph-mon[125939]: osdmap e1448: 12 total, 12 up, 12 in 2023-05-08T15:08:32.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:08:32 smithi096 ceph-mon[124666]: pgmap v21945: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 15 op/s 2023-05-08T15:08:32.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:08:32 smithi096 ceph-mon[124666]: osdmap e1448: 12 total, 12 up, 12 in 2023-05-08T15:08:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:08:34 smithi186 ceph-mon[126480]: pgmap v21947: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 14 op/s 2023-05-08T15:08:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:08:34 smithi133 ceph-mon[125939]: pgmap v21947: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 14 op/s 2023-05-08T15:08:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:08:34 smithi096 ceph-mon[124666]: pgmap v21947: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 14 op/s 2023-05-08T15:08:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:08:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41053.511149 secs 2023-05-08T15:08:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:08:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41053.511149 secs 2023-05-08T15:08:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:08:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41053.511149 secs 2023-05-08T15:08:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:08:36 smithi186 ceph-mon[126480]: pgmap v21948: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 492 KiB/s rd, 489 KiB/s wr, 9 op/s 2023-05-08T15:08:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:08:36 smithi133 ceph-mon[125939]: pgmap v21948: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 492 KiB/s rd, 489 KiB/s wr, 9 op/s 2023-05-08T15:08:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:08:36 smithi096 ceph-mon[124666]: pgmap v21948: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 492 KiB/s rd, 489 KiB/s wr, 9 op/s 2023-05-08T15:08:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:08:37 smithi133 ceph-mon[125939]: pgmap v21949: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 492 KiB/s rd, 489 KiB/s wr, 8 op/s 2023-05-08T15:08:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:08:37 smithi096 ceph-mon[124666]: pgmap v21949: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 492 KiB/s rd, 489 KiB/s wr, 8 op/s 2023-05-08T15:08:37.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:08:37 smithi186 ceph-mon[126480]: pgmap v21949: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 492 KiB/s rd, 489 KiB/s wr, 8 op/s 2023-05-08T15:08:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:08:40 smithi186 ceph-mon[126480]: pgmap v21950: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 492 KiB/s rd, 489 KiB/s wr, 8 op/s 2023-05-08T15:08:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:08:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41058.511247 secs 2023-05-08T15:08:40.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:08:40 smithi186 ceph-mon[126480]: osdmap e1449: 12 total, 12 up, 12 in 2023-05-08T15:08:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:08:40 smithi133 ceph-mon[125939]: pgmap v21950: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 492 KiB/s rd, 489 KiB/s wr, 8 op/s 2023-05-08T15:08:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:08:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41058.511247 secs 2023-05-08T15:08:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:08:40 smithi133 ceph-mon[125939]: osdmap e1449: 12 total, 12 up, 12 in 2023-05-08T15:08:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:08:40 smithi096 ceph-mon[124666]: pgmap v21950: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 492 KiB/s rd, 489 KiB/s wr, 8 op/s 2023-05-08T15:08:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:08:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41058.511247 secs 2023-05-08T15:08:40.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:08:40 smithi096 ceph-mon[124666]: osdmap e1449: 12 total, 12 up, 12 in 2023-05-08T15:08:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:08:42 smithi186 ceph-mon[126480]: pgmap v21952: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 528 KiB/s rd, 484 KiB/s wr, 9 op/s 2023-05-08T15:08:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:08:42 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41060.406608 secs 2023-05-08T15:08:42.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:08:42 smithi133 ceph-mon[125939]: pgmap v21952: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 528 KiB/s rd, 484 KiB/s wr, 9 op/s 2023-05-08T15:08:42.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:08:42 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41060.406608 secs 2023-05-08T15:08:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:08:42 smithi096 ceph-mon[124666]: pgmap v21952: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 528 KiB/s rd, 484 KiB/s wr, 9 op/s 2023-05-08T15:08:42.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:08:42 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41060.406608 secs 2023-05-08T15:08:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:08:43 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:08:43.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:08:43 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:08:43.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:08:43 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:08:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:08:43 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:08:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:08:43 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:08:43.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:08:43 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:08:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:08:43 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:08:43.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:08:43 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:08:43.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:08:43 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:08:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:08:44 smithi186 ceph-mon[126480]: pgmap v21953: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 526 KiB/s rd, 485 KiB/s wr, 9 op/s 2023-05-08T15:08:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:08:44 smithi133 ceph-mon[125939]: pgmap v21953: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 526 KiB/s rd, 485 KiB/s wr, 9 op/s 2023-05-08T15:08:44.549 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:08:44 smithi096 ceph-mon[124666]: pgmap v21953: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 526 KiB/s rd, 485 KiB/s wr, 9 op/s 2023-05-08T15:08:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:08:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41063.511361 secs 2023-05-08T15:08:45.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:08:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41064.065063 secs 2023-05-08T15:08:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:08:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41063.511361 secs 2023-05-08T15:08:45.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:08:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41064.065063 secs 2023-05-08T15:08:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:08:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41063.511361 secs 2023-05-08T15:08:45.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:08:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41064.065063 secs 2023-05-08T15:08:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:08:46 smithi186 ceph-mon[126480]: pgmap v21954: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 676 KiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T15:08:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:08:46 smithi133 ceph-mon[125939]: pgmap v21954: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 676 KiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T15:08:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:08:46 smithi096 ceph-mon[124666]: pgmap v21954: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 676 KiB/s rd, 1.1 MiB/s wr, 10 op/s 2023-05-08T15:08:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:08:47 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:08:47.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:08:47 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:08:47.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:08:47 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:08:47.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:08:47 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:08:47.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:08:47 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:08:47.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:08:47 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:08:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:08:48 smithi186 ceph-mon[126480]: pgmap v21955: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 677 KiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T15:08:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:08:48 smithi133 ceph-mon[125939]: pgmap v21955: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 677 KiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T15:08:48.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:08:48 smithi096 ceph-mon[124666]: pgmap v21955: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 677 KiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T15:08:49.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:08:49 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:08:49.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:08:49 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:08:49.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:08:49 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:08:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:08:50 smithi186 ceph-mon[126480]: pgmap v21956: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 677 KiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T15:08:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:08:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41068.511474 secs 2023-05-08T15:08:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:08:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41069.065222 secs 2023-05-08T15:08:50.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:08:50 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:08:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:08:50 smithi133 ceph-mon[125939]: pgmap v21956: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 677 KiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T15:08:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:08:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41068.511474 secs 2023-05-08T15:08:50.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:08:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41069.065222 secs 2023-05-08T15:08:50.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:08:50 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:08:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:08:50 smithi096 ceph-mon[124666]: pgmap v21956: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 677 KiB/s rd, 1.1 MiB/s wr, 11 op/s 2023-05-08T15:08:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:08:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41068.511474 secs 2023-05-08T15:08:50.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:08:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41069.065222 secs 2023-05-08T15:08:50.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:08:50 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:08:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:08:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:08:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:08:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:08:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:08:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:08:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:08:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:08:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:08:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:08:51.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:08:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:08:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:08:52 smithi186 ceph-mon[126480]: pgmap v21957: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 15 op/s 2023-05-08T15:08:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:08:52 smithi133 ceph-mon[125939]: pgmap v21957: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 15 op/s 2023-05-08T15:08:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:08:52 smithi096 ceph-mon[124666]: pgmap v21957: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 15 op/s 2023-05-08T15:08:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:08:54 smithi186 ceph-mon[126480]: pgmap v21958: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T15:08:54.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:08:54 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:08:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:08:54 smithi133 ceph-mon[125939]: pgmap v21958: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T15:08:54.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:08:54 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:08:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:08:54 smithi096 ceph-mon[124666]: pgmap v21958: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T15:08:54.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:08:54 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:08:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:08:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41073.511564 secs 2023-05-08T15:08:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:08:55 smithi186 ceph-mon[126480]: pgmap v21959: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.4 MiB/s wr, 16 op/s 2023-05-08T15:08:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:08:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41073.511564 secs 2023-05-08T15:08:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:08:55 smithi133 ceph-mon[125939]: pgmap v21959: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.4 MiB/s wr, 16 op/s 2023-05-08T15:08:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:08:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41073.511564 secs 2023-05-08T15:08:55.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:08:55 smithi096 ceph-mon[124666]: pgmap v21959: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.4 MiB/s wr, 16 op/s 2023-05-08T15:08:57.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:08:57 smithi133 ceph-mon[125939]: pgmap v21960: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.6 MiB/s wr, 13 op/s 2023-05-08T15:08:57.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:08:57 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T15:08:57.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:08:57 smithi096 ceph-mon[124666]: pgmap v21960: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.6 MiB/s wr, 13 op/s 2023-05-08T15:08:57.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:08:57 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T15:08:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:08:57 smithi186 ceph-mon[126480]: pgmap v21960: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.6 MiB/s wr, 13 op/s 2023-05-08T15:08:57.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:08:57 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T15:08:58.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:08:58 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:08:58.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:08:58 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:08:58.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:08:58 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:08:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:08:59 smithi133 ceph-mon[125939]: pgmap v21961: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.6 MiB/s wr, 12 op/s 2023-05-08T15:08:59.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:08:59 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:08:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:08:59 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:08:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:08:59 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41078.511633 secs 2023-05-08T15:08:59.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:08:59 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:08:59.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:08:59 smithi096 ceph-mon[124666]: pgmap v21961: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.6 MiB/s wr, 12 op/s 2023-05-08T15:08:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:08:59 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:08:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:08:59 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:08:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:08:59 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41078.511633 secs 2023-05-08T15:08:59.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:08:59 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:08:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:08:59 smithi186 ceph-mon[126480]: pgmap v21961: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.6 MiB/s wr, 12 op/s 2023-05-08T15:08:59.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:08:59 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:08:59.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:08:59 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:08:59.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:08:59 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41078.511633 secs 2023-05-08T15:08:59.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:08:59 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:09:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41079.065439 secs 2023-05-08T15:09:00.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T15:09:00.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T15:09:00.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T15:09:00.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T15:09:00.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T15:09:00.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:00 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T15:09:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41079.065439 secs 2023-05-08T15:09:00.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T15:09:00.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T15:09:00.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T15:09:00.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T15:09:00.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T15:09:00.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:00 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T15:09:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41079.065439 secs 2023-05-08T15:09:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T15:09:00.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T15:09:00.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T15:09:00.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T15:09:00.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T15:09:00.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:00 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T15:09:01.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:01 smithi133 ceph-mon[125939]: pgmap v21962: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.9 MiB/s wr, 17 op/s 2023-05-08T15:09:01.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:01 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T15:09:01.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:01 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T15:09:01.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:01 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T15:09:01.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:01 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T15:09:01.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:01 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T15:09:01.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:01 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi133 to 117.3M 2023-05-08T15:09:01.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:01 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi133 to 123074302: error parsing value: Value '123074302' is below minimum 939524096 2023-05-08T15:09:01.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:01 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T15:09:01.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:01 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T15:09:01.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:01 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T15:09:01.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:01 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T15:09:01.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:01 smithi133 ceph-mon[125939]: Adjusting osd_memory_target on smithi186 to 59913k 2023-05-08T15:09:01.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:01 smithi133 ceph-mon[125939]: Unable to set osd_memory_target on smithi186 to 61351350: error parsing value: Value '61351350' is below minimum 939524096 2023-05-08T15:09:01.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:01 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T15:09:01.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:01 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T15:09:01.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:01 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T15:09:01.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:01 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T15:09:01.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:01 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T15:09:01.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:01 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T15:09:01.743 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:01 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T15:09:01.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:01 smithi096 ceph-mon[124666]: pgmap v21962: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.9 MiB/s wr, 17 op/s 2023-05-08T15:09:01.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:01 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T15:09:01.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:01 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T15:09:01.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:01 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T15:09:01.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:01 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T15:09:01.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:01 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T15:09:01.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:01 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi133 to 117.3M 2023-05-08T15:09:01.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:01 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi133 to 123074302: error parsing value: Value '123074302' is below minimum 939524096 2023-05-08T15:09:01.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:01 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T15:09:01.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:01 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T15:09:01.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:01 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T15:09:01.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:01 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T15:09:01.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:01 smithi096 ceph-mon[124666]: Adjusting osd_memory_target on smithi186 to 59913k 2023-05-08T15:09:01.757 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:01 smithi096 ceph-mon[124666]: Unable to set osd_memory_target on smithi186 to 61351350: error parsing value: Value '61351350' is below minimum 939524096 2023-05-08T15:09:01.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:01 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T15:09:01.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:01 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T15:09:01.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:01 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T15:09:01.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:01 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T15:09:01.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:01 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T15:09:01.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:01 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T15:09:01.758 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:01 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T15:09:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:01 smithi186 ceph-mon[126480]: pgmap v21962: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.9 MiB/s wr, 17 op/s 2023-05-08T15:09:01.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:01 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2023-05-08T15:09:01.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:01 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-05-08T15:09:01.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:01 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-05-08T15:09:01.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:01 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-05-08T15:09:01.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:01 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-05-08T15:09:01.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:01 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi133 to 117.3M 2023-05-08T15:09:01.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:01 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi133 to 123074302: error parsing value: Value '123074302' is below minimum 939524096 2023-05-08T15:09:01.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:01 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-05-08T15:09:01.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:01 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-05-08T15:09:01.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:01 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-05-08T15:09:01.871 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:01 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-05-08T15:09:01.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:01 smithi186 ceph-mon[126480]: Adjusting osd_memory_target on smithi186 to 59913k 2023-05-08T15:09:01.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:01 smithi186 ceph-mon[126480]: Unable to set osd_memory_target on smithi186 to 61351350: error parsing value: Value '61351350' is below minimum 939524096 2023-05-08T15:09:01.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:01 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T15:09:01.872 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:01 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T15:09:01.873 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:01 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T15:09:01.873 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:01 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T15:09:01.873 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:01 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T15:09:01.873 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:01 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T15:09:01.873 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:01 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T15:09:03.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:03 smithi133 ceph-mon[125939]: pgmap v21963: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 12 op/s 2023-05-08T15:09:03.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:09:03.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:03 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:09:03.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:03 smithi096 ceph-mon[124666]: pgmap v21963: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 12 op/s 2023-05-08T15:09:03.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:09:03.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:03 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:09:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:03 smithi186 ceph-mon[126480]: pgmap v21963: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 12 op/s 2023-05-08T15:09:03.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:09:03.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:03 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:09:04.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:04 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41083.511759 secs 2023-05-08T15:09:04.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:04 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:09:04.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:04 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41083.511759 secs 2023-05-08T15:09:04.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:04 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:09:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:04 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41083.511759 secs 2023-05-08T15:09:04.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:04 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:09:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:06 smithi186 ceph-mon[126480]: pgmap v21964: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 2.7 MiB/s wr, 30 op/s 2023-05-08T15:09:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:06 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:09:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:06 smithi133 ceph-mon[125939]: pgmap v21964: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 2.7 MiB/s wr, 30 op/s 2023-05-08T15:09:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:06 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:09:06.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:06 smithi096 ceph-mon[124666]: pgmap v21964: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 2.7 MiB/s wr, 30 op/s 2023-05-08T15:09:06.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:06 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:09:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:07 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:09:07.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:07 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:09:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:07 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:09:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:07 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:09:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:07 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:09:07.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:07 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:09:08.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:08 smithi186 ceph-mon[126480]: pgmap v21965: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 1.8 MiB/s wr, 25 op/s 2023-05-08T15:09:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:08 smithi133 ceph-mon[125939]: pgmap v21965: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 1.8 MiB/s wr, 25 op/s 2023-05-08T15:09:08.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:08 smithi096 ceph-mon[124666]: pgmap v21965: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 1.8 MiB/s wr, 25 op/s 2023-05-08T15:09:09.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:09 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:09:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:09 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:09:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:09 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:09:10.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:10 smithi186 ceph-mon[126480]: pgmap v21966: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.8 MiB/s wr, 24 op/s 2023-05-08T15:09:10.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41088.511876 secs 2023-05-08T15:09:10.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:10 smithi133 ceph-mon[125939]: pgmap v21966: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.8 MiB/s wr, 24 op/s 2023-05-08T15:09:10.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41088.511876 secs 2023-05-08T15:09:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:10 smithi096 ceph-mon[124666]: pgmap v21966: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.8 MiB/s wr, 24 op/s 2023-05-08T15:09:10.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41088.511876 secs 2023-05-08T15:09:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:12 smithi186 ceph-mon[126480]: pgmap v21967: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.1 MiB/s wr, 28 op/s 2023-05-08T15:09:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:12 smithi133 ceph-mon[125939]: pgmap v21967: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.1 MiB/s wr, 28 op/s 2023-05-08T15:09:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:12 smithi096 ceph-mon[124666]: pgmap v21967: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.1 MiB/s wr, 28 op/s 2023-05-08T15:09:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:14 smithi186 ceph-mon[126480]: pgmap v21968: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.2 MiB/s wr, 25 op/s 2023-05-08T15:09:14.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:14 smithi133 ceph-mon[125939]: pgmap v21968: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.2 MiB/s wr, 25 op/s 2023-05-08T15:09:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:14 smithi096 ceph-mon[124666]: pgmap v21968: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.2 MiB/s wr, 25 op/s 2023-05-08T15:09:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41093.511991 secs 2023-05-08T15:09:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41093.511991 secs 2023-05-08T15:09:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41093.511991 secs 2023-05-08T15:09:16.373 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:16 smithi186 ceph-mon[126480]: pgmap v21969: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.1 MiB/s wr, 27 op/s 2023-05-08T15:09:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:16 smithi133 ceph-mon[125939]: pgmap v21969: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.1 MiB/s wr, 27 op/s 2023-05-08T15:09:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:16 smithi096 ceph-mon[124666]: pgmap v21969: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.1 MiB/s wr, 27 op/s 2023-05-08T15:09:18.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:18 smithi186 ceph-mon[126480]: pgmap v21970: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T15:09:18.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:18 smithi133 ceph-mon[125939]: pgmap v21970: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T15:09:18.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:18 smithi096 ceph-mon[124666]: pgmap v21970: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.0 MiB/s wr, 10 op/s 2023-05-08T15:09:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:20 smithi186 ceph-mon[126480]: pgmap v21971: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.0 MiB/s wr, 9 op/s 2023-05-08T15:09:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41098.512111 secs 2023-05-08T15:09:20.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41099.065984 secs 2023-05-08T15:09:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:20 smithi133 ceph-mon[125939]: pgmap v21971: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.0 MiB/s wr, 9 op/s 2023-05-08T15:09:20.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41098.512111 secs 2023-05-08T15:09:20.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41099.065984 secs 2023-05-08T15:09:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:20 smithi096 ceph-mon[124666]: pgmap v21971: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.0 MiB/s wr, 9 op/s 2023-05-08T15:09:20.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41098.512111 secs 2023-05-08T15:09:20.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41099.065984 secs 2023-05-08T15:09:21.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:21 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41100.407461 secs 2023-05-08T15:09:21.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:21 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41100.407461 secs 2023-05-08T15:09:21.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:21 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41100.407461 secs 2023-05-08T15:09:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:22 smithi186 ceph-mon[126480]: pgmap v21972: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.3 MiB/s wr, 15 op/s 2023-05-08T15:09:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:22 smithi186 ceph-mon[126480]: osdmap e1450: 12 total, 12 up, 12 in 2023-05-08T15:09:22.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:22 smithi133 ceph-mon[125939]: pgmap v21972: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.3 MiB/s wr, 15 op/s 2023-05-08T15:09:22.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:22 smithi133 ceph-mon[125939]: osdmap e1450: 12 total, 12 up, 12 in 2023-05-08T15:09:22.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:22 smithi096 ceph-mon[124666]: pgmap v21972: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.3 MiB/s wr, 15 op/s 2023-05-08T15:09:22.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:22 smithi096 ceph-mon[124666]: osdmap e1450: 12 total, 12 up, 12 in 2023-05-08T15:09:23.375 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:23 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:09:23.376 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:23 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:09:23.376 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:23 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:09:23.376 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:23 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:09:23.376 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:23 smithi186 ceph-mon[126480]: pgmap v21974: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.8 MiB/s wr, 15 op/s 2023-05-08T15:09:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:23 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:09:23.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:23 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:09:23.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:23 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:09:23.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:23 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:09:23.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:23 smithi133 ceph-mon[125939]: pgmap v21974: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.8 MiB/s wr, 15 op/s 2023-05-08T15:09:23.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:23 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:09:23.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:23 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:09:23.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:23 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:09:23.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:23 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:09:23.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:23 smithi096 ceph-mon[124666]: pgmap v21974: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.8 MiB/s wr, 15 op/s 2023-05-08T15:09:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41103.512223 secs 2023-05-08T15:09:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41104.066125 secs 2023-05-08T15:09:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41103.512223 secs 2023-05-08T15:09:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41104.066125 secs 2023-05-08T15:09:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41103.512223 secs 2023-05-08T15:09:25.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41104.066125 secs 2023-05-08T15:09:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:26 smithi186 ceph-mon[126480]: pgmap v21975: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.8 MiB/s wr, 17 op/s 2023-05-08T15:09:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:26 smithi133 ceph-mon[125939]: pgmap v21975: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.8 MiB/s wr, 17 op/s 2023-05-08T15:09:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:26 smithi096 ceph-mon[124666]: pgmap v21975: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.8 MiB/s wr, 17 op/s 2023-05-08T15:09:27.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:27 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41105.407579 secs 2023-05-08T15:09:27.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:27 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41105.407579 secs 2023-05-08T15:09:27.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:27 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41105.407579 secs 2023-05-08T15:09:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:28 smithi186 ceph-mon[126480]: pgmap v21976: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 16 op/s 2023-05-08T15:09:28.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:28 smithi133 ceph-mon[125939]: pgmap v21976: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 16 op/s 2023-05-08T15:09:28.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:28 smithi096 ceph-mon[124666]: pgmap v21976: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 16 op/s 2023-05-08T15:09:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:30 smithi186 ceph-mon[126480]: pgmap v21977: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 16 op/s 2023-05-08T15:09:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41108.512372 secs 2023-05-08T15:09:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:30 smithi186 ceph-mon[126480]: osdmap e1451: 12 total, 12 up, 12 in 2023-05-08T15:09:30.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41109.066281 secs 2023-05-08T15:09:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:30 smithi133 ceph-mon[125939]: pgmap v21977: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 16 op/s 2023-05-08T15:09:30.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41108.512372 secs 2023-05-08T15:09:30.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:30 smithi133 ceph-mon[125939]: osdmap e1451: 12 total, 12 up, 12 in 2023-05-08T15:09:30.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41109.066281 secs 2023-05-08T15:09:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:30 smithi096 ceph-mon[124666]: pgmap v21977: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 16 op/s 2023-05-08T15:09:30.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41108.512372 secs 2023-05-08T15:09:30.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:30 smithi096 ceph-mon[124666]: osdmap e1451: 12 total, 12 up, 12 in 2023-05-08T15:09:30.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41109.066281 secs 2023-05-08T15:09:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:32 smithi186 ceph-mon[126480]: pgmap v21979: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 233 KiB/s wr, 11 op/s 2023-05-08T15:09:32.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:32 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41110.407694 secs 2023-05-08T15:09:32.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:32 smithi133 ceph-mon[125939]: pgmap v21979: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 233 KiB/s wr, 11 op/s 2023-05-08T15:09:32.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:32 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41110.407694 secs 2023-05-08T15:09:32.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:32 smithi096 ceph-mon[124666]: pgmap v21979: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 233 KiB/s wr, 11 op/s 2023-05-08T15:09:32.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:32 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41110.407694 secs 2023-05-08T15:09:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:34 smithi186 ceph-mon[126480]: pgmap v21980: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 368 KiB/s wr, 11 op/s 2023-05-08T15:09:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:34 smithi133 ceph-mon[125939]: pgmap v21980: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 368 KiB/s wr, 11 op/s 2023-05-08T15:09:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:34 smithi096 ceph-mon[124666]: pgmap v21980: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 368 KiB/s wr, 11 op/s 2023-05-08T15:09:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41113.512489 secs 2023-05-08T15:09:35.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41114.066417 secs 2023-05-08T15:09:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41113.512489 secs 2023-05-08T15:09:35.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41114.066417 secs 2023-05-08T15:09:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41113.512489 secs 2023-05-08T15:09:35.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41114.066417 secs 2023-05-08T15:09:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:36 smithi186 ceph-mon[126480]: pgmap v21981: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 673 KiB/s rd, 671 KiB/s wr, 9 op/s 2023-05-08T15:09:36.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:36 smithi133 ceph-mon[125939]: pgmap v21981: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 673 KiB/s rd, 671 KiB/s wr, 9 op/s 2023-05-08T15:09:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:36 smithi096 ceph-mon[124666]: pgmap v21981: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 673 KiB/s rd, 671 KiB/s wr, 9 op/s 2023-05-08T15:09:37.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:37 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41115.407811 secs 2023-05-08T15:09:37.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:37 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41115.407811 secs 2023-05-08T15:09:37.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:37 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41115.407811 secs 2023-05-08T15:09:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:38 smithi186 ceph-mon[126480]: pgmap v21982: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 639 KiB/s rd, 636 KiB/s wr, 10 op/s 2023-05-08T15:09:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:38 smithi133 ceph-mon[125939]: pgmap v21982: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 639 KiB/s rd, 636 KiB/s wr, 10 op/s 2023-05-08T15:09:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:38 smithi096 ceph-mon[124666]: pgmap v21982: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 639 KiB/s rd, 636 KiB/s wr, 10 op/s 2023-05-08T15:09:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:40 smithi186 ceph-mon[126480]: pgmap v21983: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 639 KiB/s rd, 636 KiB/s wr, 10 op/s 2023-05-08T15:09:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41118.512557 secs 2023-05-08T15:09:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41119.066543 secs 2023-05-08T15:09:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:40 smithi133 ceph-mon[125939]: pgmap v21983: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 639 KiB/s rd, 636 KiB/s wr, 10 op/s 2023-05-08T15:09:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41118.512557 secs 2023-05-08T15:09:40.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41119.066543 secs 2023-05-08T15:09:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:40 smithi096 ceph-mon[124666]: pgmap v21983: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 639 KiB/s rd, 636 KiB/s wr, 10 op/s 2023-05-08T15:09:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41118.512557 secs 2023-05-08T15:09:40.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41119.066543 secs 2023-05-08T15:09:41.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41120.407933 secs 2023-05-08T15:09:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41120.407933 secs 2023-05-08T15:09:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41120.407933 secs 2023-05-08T15:09:42.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:42 smithi186 ceph-mon[126480]: pgmap v21984: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 566 KiB/s rd, 737 KiB/s wr, 10 op/s 2023-05-08T15:09:42.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:42 smithi133 ceph-mon[125939]: pgmap v21984: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 566 KiB/s rd, 737 KiB/s wr, 10 op/s 2023-05-08T15:09:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:42 smithi096 ceph-mon[124666]: pgmap v21984: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 566 KiB/s rd, 737 KiB/s wr, 10 op/s 2023-05-08T15:09:44.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:44 smithi186 ceph-mon[126480]: pgmap v21985: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 597 KiB/s rd, 759 KiB/s wr, 8 op/s 2023-05-08T15:09:44.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:44 smithi133 ceph-mon[125939]: pgmap v21985: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 597 KiB/s rd, 759 KiB/s wr, 8 op/s 2023-05-08T15:09:44.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:44 smithi096 ceph-mon[124666]: pgmap v21985: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 597 KiB/s rd, 759 KiB/s wr, 8 op/s 2023-05-08T15:09:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41123.512675 secs 2023-05-08T15:09:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41124.066672 secs 2023-05-08T15:09:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41123.512675 secs 2023-05-08T15:09:45.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41124.066672 secs 2023-05-08T15:09:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41123.512675 secs 2023-05-08T15:09:45.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41124.066672 secs 2023-05-08T15:09:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:46 smithi186 ceph-mon[126480]: pgmap v21986: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 636 KiB/s rd, 633 KiB/s wr, 9 op/s 2023-05-08T15:09:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:46 smithi133 ceph-mon[125939]: pgmap v21986: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 636 KiB/s rd, 633 KiB/s wr, 9 op/s 2023-05-08T15:09:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:46 smithi096 ceph-mon[124666]: pgmap v21986: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 636 KiB/s rd, 633 KiB/s wr, 9 op/s 2023-05-08T15:09:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:48 smithi186 ceph-mon[126480]: pgmap v21987: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 380 KiB/s wr, 6 op/s 2023-05-08T15:09:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:48 smithi133 ceph-mon[125939]: pgmap v21987: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 380 KiB/s wr, 6 op/s 2023-05-08T15:09:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:48 smithi096 ceph-mon[124666]: pgmap v21987: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 380 KiB/s wr, 6 op/s 2023-05-08T15:09:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:50 smithi186 ceph-mon[126480]: pgmap v21988: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 380 KiB/s wr, 5 op/s 2023-05-08T15:09:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41128.512776 secs 2023-05-08T15:09:50.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41129.066790 secs 2023-05-08T15:09:50.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:50 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:09:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:50 smithi133 ceph-mon[125939]: pgmap v21988: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 380 KiB/s wr, 5 op/s 2023-05-08T15:09:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41128.512776 secs 2023-05-08T15:09:50.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41129.066790 secs 2023-05-08T15:09:50.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:50 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:09:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:50 smithi096 ceph-mon[124666]: pgmap v21988: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 380 KiB/s wr, 5 op/s 2023-05-08T15:09:50.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41128.512776 secs 2023-05-08T15:09:50.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41129.066790 secs 2023-05-08T15:09:50.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:50 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:09:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:51 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:09:51.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:09:51.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:09:51.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:51 smithi133 ceph-mon[125939]: pgmap v21989: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 761 KiB/s rd, 758 KiB/s wr, 9 op/s 2023-05-08T15:09:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:51 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:09:51.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:09:51.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:09:51.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:51 smithi096 ceph-mon[124666]: pgmap v21989: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 761 KiB/s rd, 758 KiB/s wr, 9 op/s 2023-05-08T15:09:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:51 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:09:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:09:51.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:09:51.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:51 smithi186 ceph-mon[126480]: pgmap v21989: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 761 KiB/s rd, 758 KiB/s wr, 9 op/s 2023-05-08T15:09:53.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:53 smithi133 ceph-mon[125939]: pgmap v21990: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 760 KiB/s rd, 594 KiB/s wr, 7 op/s 2023-05-08T15:09:53.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:53 smithi096 ceph-mon[124666]: pgmap v21990: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 760 KiB/s rd, 594 KiB/s wr, 7 op/s 2023-05-08T15:09:53.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:53 smithi186 ceph-mon[126480]: pgmap v21990: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 760 KiB/s rd, 594 KiB/s wr, 7 op/s 2023-05-08T15:09:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41133.512876 secs 2023-05-08T15:09:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41133.512876 secs 2023-05-08T15:09:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41133.512876 secs 2023-05-08T15:09:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:56 smithi186 ceph-mon[126480]: pgmap v21991: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 959 KiB/s rd, 792 KiB/s wr, 10 op/s 2023-05-08T15:09:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:56 smithi133 ceph-mon[125939]: pgmap v21991: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 959 KiB/s rd, 792 KiB/s wr, 10 op/s 2023-05-08T15:09:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:56 smithi096 ceph-mon[124666]: pgmap v21991: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 959 KiB/s rd, 792 KiB/s wr, 10 op/s 2023-05-08T15:09:58.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:58 smithi186 ceph-mon[126480]: pgmap v21992: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 794 KiB/s rd, 792 KiB/s wr, 8 op/s 2023-05-08T15:09:58.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:58 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:09:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:58 smithi133 ceph-mon[125939]: pgmap v21992: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 794 KiB/s rd, 792 KiB/s wr, 8 op/s 2023-05-08T15:09:58.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:58 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:09:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:58 smithi096 ceph-mon[124666]: pgmap v21992: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 794 KiB/s rd, 792 KiB/s wr, 8 op/s 2023-05-08T15:09:58.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:58 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:09:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:59 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:09:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:59 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:09:59.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:09:59 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:09:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:59 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:09:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:59 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:09:59.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:09:59 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:09:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:59 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:09:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:59 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:09:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:09:59 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:10:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:00 smithi186 ceph-mon[126480]: pgmap v21993: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 794 KiB/s rd, 792 KiB/s wr, 8 op/s 2023-05-08T15:10:00.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41138.513014 secs 2023-05-08T15:10:00.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41139.067002 secs 2023-05-08T15:10:00.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:00 smithi186 ceph-mon[126480]: Health detail: HEALTH_WARN 1 MDSs report slow requests 2023-05-08T15:10:00.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:00 smithi186 ceph-mon[126480]: [WRN] MDS_SLOW_REQUEST: 1 MDSs report slow requests 2023-05-08T15:10:00.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:00 smithi186 ceph-mon[126480]: mds.i(mds.1): 1 slow requests are blocked > 180 secs 2023-05-08T15:10:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:00 smithi133 ceph-mon[125939]: pgmap v21993: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 794 KiB/s rd, 792 KiB/s wr, 8 op/s 2023-05-08T15:10:00.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41138.513014 secs 2023-05-08T15:10:00.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41139.067002 secs 2023-05-08T15:10:00.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:00 smithi133 ceph-mon[125939]: Health detail: HEALTH_WARN 1 MDSs report slow requests 2023-05-08T15:10:00.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:00 smithi133 ceph-mon[125939]: [WRN] MDS_SLOW_REQUEST: 1 MDSs report slow requests 2023-05-08T15:10:00.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:00 smithi133 ceph-mon[125939]: mds.i(mds.1): 1 slow requests are blocked > 180 secs 2023-05-08T15:10:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:00 smithi096 ceph-mon[124666]: pgmap v21993: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 794 KiB/s rd, 792 KiB/s wr, 8 op/s 2023-05-08T15:10:00.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41138.513014 secs 2023-05-08T15:10:00.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41139.067002 secs 2023-05-08T15:10:00.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:00 smithi096 ceph-mon[124666]: Health detail: HEALTH_WARN 1 MDSs report slow requests 2023-05-08T15:10:00.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:00 smithi096 ceph-mon[124666]: [WRN] MDS_SLOW_REQUEST: 1 MDSs report slow requests 2023-05-08T15:10:00.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:00 smithi096 ceph-mon[124666]: mds.i(mds.1): 1 slow requests are blocked > 180 secs 2023-05-08T15:10:01.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:01 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T15:10:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:01 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T15:10:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:01 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T15:10:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:02 smithi186 ceph-mon[126480]: pgmap v21994: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.8 MiB/s wr, 13 op/s 2023-05-08T15:10:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:02 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T15:10:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:02 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T15:10:02.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:02 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T15:10:02.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:02 smithi133 ceph-mon[125939]: pgmap v21994: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.8 MiB/s wr, 13 op/s 2023-05-08T15:10:02.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:02 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T15:10:02.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:02 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T15:10:02.492 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:02 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T15:10:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:02 smithi096 ceph-mon[124666]: pgmap v21994: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.8 MiB/s wr, 13 op/s 2023-05-08T15:10:02.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:02 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T15:10:02.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:02 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T15:10:02.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:02 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T15:10:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:03 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T15:10:03.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:03 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T15:10:03.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:03 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T15:10:03.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:03 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T15:10:03.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:10:03.371 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:03 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:10:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:03 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T15:10:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:03 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T15:10:03.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:03 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T15:10:03.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:03 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T15:10:03.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:10:03.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:03 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:10:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:03 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T15:10:03.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:03 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T15:10:03.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:03 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T15:10:03.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:03 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T15:10:03.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:10:03.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:03 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:10:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:04 smithi186 ceph-mon[126480]: pgmap v21995: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 722 KiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T15:10:04.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:04 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:10:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:04 smithi133 ceph-mon[125939]: pgmap v21995: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 722 KiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T15:10:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:04 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:10:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:04 smithi096 ceph-mon[124666]: pgmap v21995: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 722 KiB/s rd, 1.5 MiB/s wr, 11 op/s 2023-05-08T15:10:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:04 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:10:05.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41143.513151 secs 2023-05-08T15:10:05.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41143.513151 secs 2023-05-08T15:10:05.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41143.513151 secs 2023-05-08T15:10:06.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:06 smithi186 ceph-mon[126480]: pgmap v21996: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 17 op/s 2023-05-08T15:10:06.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:06 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:10:06.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:06 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41145.408611 secs 2023-05-08T15:10:06.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:06 smithi133 ceph-mon[125939]: pgmap v21996: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 17 op/s 2023-05-08T15:10:06.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:06 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:10:06.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:06 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41145.408611 secs 2023-05-08T15:10:06.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:06 smithi096 ceph-mon[124666]: pgmap v21996: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 17 op/s 2023-05-08T15:10:06.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:06 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:10:06.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:06 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41145.408611 secs 2023-05-08T15:10:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:07 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:10:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:07 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:10:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:07 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:10:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:07 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:10:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:07 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:10:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:07 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:10:08.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:08 smithi133 ceph-mon[125939]: pgmap v21997: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.7 MiB/s wr, 14 op/s 2023-05-08T15:10:08.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:08 smithi096 ceph-mon[124666]: pgmap v21997: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.7 MiB/s wr, 14 op/s 2023-05-08T15:10:08.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:08 smithi186 ceph-mon[126480]: pgmap v21997: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.7 MiB/s wr, 14 op/s 2023-05-08T15:10:09.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:09 smithi133 ceph-mon[125939]: pgmap v21998: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.7 MiB/s wr, 14 op/s 2023-05-08T15:10:09.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:09 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:10:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:09 smithi096 ceph-mon[124666]: pgmap v21998: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.7 MiB/s wr, 14 op/s 2023-05-08T15:10:09.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:09 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:10:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:09 smithi186 ceph-mon[126480]: pgmap v21998: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.7 MiB/s wr, 14 op/s 2023-05-08T15:10:09.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:09 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:10:10.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41148.513250 secs 2023-05-08T15:10:10.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:10 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41149.067285 secs 2023-05-08T15:10:10.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41148.513250 secs 2023-05-08T15:10:10.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:10 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41149.067285 secs 2023-05-08T15:10:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41148.513250 secs 2023-05-08T15:10:10.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:10 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41149.067285 secs 2023-05-08T15:10:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:11 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:10:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:11 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:10:11.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:11 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:10:11.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:11 smithi133 ceph-mon[125939]: pgmap v21999: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.2 MiB/s wr, 31 op/s 2023-05-08T15:10:11.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:11 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41150.408682 secs 2023-05-08T15:10:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:11 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:10:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:11 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:10:11.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:11 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:10:11.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:11 smithi096 ceph-mon[124666]: pgmap v21999: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.2 MiB/s wr, 31 op/s 2023-05-08T15:10:11.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:11 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41150.408682 secs 2023-05-08T15:10:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:11 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:10:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:11 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:10:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:11 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:10:11.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:11 smithi186 ceph-mon[126480]: pgmap v21999: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.2 MiB/s wr, 31 op/s 2023-05-08T15:10:11.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:11 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41150.408682 secs 2023-05-08T15:10:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:12 smithi133 ceph-mon[125939]: osdmap e1452: 12 total, 12 up, 12 in 2023-05-08T15:10:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:12 smithi096 ceph-mon[124666]: osdmap e1452: 12 total, 12 up, 12 in 2023-05-08T15:10:12.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:12 smithi186 ceph-mon[126480]: osdmap e1452: 12 total, 12 up, 12 in 2023-05-08T15:10:13.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:13 smithi133 ceph-mon[125939]: pgmap v22001: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 1.4 MiB/s wr, 31 op/s 2023-05-08T15:10:13.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:13 smithi096 ceph-mon[124666]: pgmap v22001: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 1.4 MiB/s wr, 31 op/s 2023-05-08T15:10:13.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:13 smithi186 ceph-mon[126480]: pgmap v22001: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 1.4 MiB/s wr, 31 op/s 2023-05-08T15:10:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:14 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:10:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:14 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:10:14.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:14 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:10:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41153.513327 secs 2023-05-08T15:10:15.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41154.067410 secs 2023-05-08T15:10:15.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:15 smithi133 ceph-mon[125939]: pgmap v22002: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 774 KiB/s rd, 816 KiB/s wr, 26 op/s 2023-05-08T15:10:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41153.513327 secs 2023-05-08T15:10:15.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41154.067410 secs 2023-05-08T15:10:15.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:15 smithi096 ceph-mon[124666]: pgmap v22002: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 774 KiB/s rd, 816 KiB/s wr, 26 op/s 2023-05-08T15:10:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41153.513327 secs 2023-05-08T15:10:15.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41154.067410 secs 2023-05-08T15:10:15.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:15 smithi186 ceph-mon[126480]: pgmap v22002: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 774 KiB/s rd, 816 KiB/s wr, 26 op/s 2023-05-08T15:10:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:16 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41155.408782 secs 2023-05-08T15:10:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:16 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41155.408782 secs 2023-05-08T15:10:16.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:16 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41155.408782 secs 2023-05-08T15:10:17.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:17 smithi133 ceph-mon[125939]: pgmap v22003: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 740 KiB/s rd, 781 KiB/s wr, 25 op/s 2023-05-08T15:10:17.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:17 smithi096 ceph-mon[124666]: pgmap v22003: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 740 KiB/s rd, 781 KiB/s wr, 25 op/s 2023-05-08T15:10:17.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:17 smithi186 ceph-mon[126480]: pgmap v22003: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 740 KiB/s rd, 781 KiB/s wr, 25 op/s 2023-05-08T15:10:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:20 smithi186 ceph-mon[126480]: pgmap v22004: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 740 KiB/s rd, 781 KiB/s wr, 25 op/s 2023-05-08T15:10:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41158.513445 secs 2023-05-08T15:10:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:20 smithi186 ceph-mon[126480]: osdmap e1453: 12 total, 12 up, 12 in 2023-05-08T15:10:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41159.067523 secs 2023-05-08T15:10:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:20 smithi133 ceph-mon[125939]: pgmap v22004: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 740 KiB/s rd, 781 KiB/s wr, 25 op/s 2023-05-08T15:10:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41158.513445 secs 2023-05-08T15:10:20.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:20 smithi133 ceph-mon[125939]: osdmap e1453: 12 total, 12 up, 12 in 2023-05-08T15:10:20.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41159.067523 secs 2023-05-08T15:10:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:20 smithi096 ceph-mon[124666]: pgmap v22004: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 740 KiB/s rd, 781 KiB/s wr, 25 op/s 2023-05-08T15:10:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41158.513445 secs 2023-05-08T15:10:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:20 smithi096 ceph-mon[124666]: osdmap e1453: 12 total, 12 up, 12 in 2023-05-08T15:10:20.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41159.067523 secs 2023-05-08T15:10:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:22 smithi186 ceph-mon[126480]: pgmap v22006: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 489 KiB/s wr, 8 op/s 2023-05-08T15:10:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:22 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41160.408885 secs 2023-05-08T15:10:22.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:22 smithi133 ceph-mon[125939]: pgmap v22006: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 489 KiB/s wr, 8 op/s 2023-05-08T15:10:22.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:22 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41160.408885 secs 2023-05-08T15:10:22.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:22 smithi096 ceph-mon[124666]: pgmap v22006: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 489 KiB/s wr, 8 op/s 2023-05-08T15:10:22.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:22 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41160.408885 secs 2023-05-08T15:10:24.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:24 smithi186 ceph-mon[126480]: pgmap v22007: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 452 KiB/s rd, 451 KiB/s wr, 8 op/s 2023-05-08T15:10:24.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:24 smithi133 ceph-mon[125939]: pgmap v22007: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 452 KiB/s rd, 451 KiB/s wr, 8 op/s 2023-05-08T15:10:24.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:24 smithi096 ceph-mon[124666]: pgmap v22007: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 452 KiB/s rd, 451 KiB/s wr, 8 op/s 2023-05-08T15:10:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41163.513589 secs 2023-05-08T15:10:25.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:25 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41164.067593 secs 2023-05-08T15:10:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41163.513589 secs 2023-05-08T15:10:25.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:25 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41164.067593 secs 2023-05-08T15:10:25.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41163.513589 secs 2023-05-08T15:10:25.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:25 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41164.067593 secs 2023-05-08T15:10:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:26 smithi186 ceph-mon[126480]: pgmap v22008: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 725 KiB/s rd, 717 KiB/s wr, 8 op/s 2023-05-08T15:10:26.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:26 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41165.409005 secs 2023-05-08T15:10:26.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:26 smithi133 ceph-mon[125939]: pgmap v22008: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 725 KiB/s rd, 717 KiB/s wr, 8 op/s 2023-05-08T15:10:26.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:26 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41165.409005 secs 2023-05-08T15:10:26.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:26 smithi096 ceph-mon[124666]: pgmap v22008: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 725 KiB/s rd, 717 KiB/s wr, 8 op/s 2023-05-08T15:10:26.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:26 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41165.409005 secs 2023-05-08T15:10:28.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:28 smithi186 ceph-mon[126480]: pgmap v22009: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 759 KiB/s rd, 966 KiB/s wr, 9 op/s 2023-05-08T15:10:28.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:28 smithi133 ceph-mon[125939]: pgmap v22009: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 759 KiB/s rd, 966 KiB/s wr, 9 op/s 2023-05-08T15:10:28.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:28 smithi096 ceph-mon[124666]: pgmap v22009: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 759 KiB/s rd, 966 KiB/s wr, 9 op/s 2023-05-08T15:10:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:30 smithi186 ceph-mon[126480]: pgmap v22010: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 759 KiB/s rd, 966 KiB/s wr, 9 op/s 2023-05-08T15:10:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41168.513733 secs 2023-05-08T15:10:30.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:30 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41169.067714 secs 2023-05-08T15:10:30.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:30 smithi133 ceph-mon[125939]: pgmap v22010: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 759 KiB/s rd, 966 KiB/s wr, 9 op/s 2023-05-08T15:10:30.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41168.513733 secs 2023-05-08T15:10:30.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:30 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41169.067714 secs 2023-05-08T15:10:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:30 smithi096 ceph-mon[124666]: pgmap v22010: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 759 KiB/s rd, 966 KiB/s wr, 9 op/s 2023-05-08T15:10:30.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41168.513733 secs 2023-05-08T15:10:30.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:30 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41169.067714 secs 2023-05-08T15:10:31.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:31 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41170.409099 secs 2023-05-08T15:10:31.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:31 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41170.409099 secs 2023-05-08T15:10:31.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:31 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41170.409099 secs 2023-05-08T15:10:32.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:32 smithi186 ceph-mon[126480]: pgmap v22011: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 686 KiB/s rd, 854 KiB/s wr, 12 op/s 2023-05-08T15:10:32.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:32 smithi133 ceph-mon[125939]: pgmap v22011: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 686 KiB/s rd, 854 KiB/s wr, 12 op/s 2023-05-08T15:10:32.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:32 smithi096 ceph-mon[124666]: pgmap v22011: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 686 KiB/s rd, 854 KiB/s wr, 12 op/s 2023-05-08T15:10:34.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:34 smithi186 ceph-mon[126480]: pgmap v22012: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 613 KiB/s wr, 9 op/s 2023-05-08T15:10:34.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:34 smithi133 ceph-mon[125939]: pgmap v22012: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 613 KiB/s wr, 9 op/s 2023-05-08T15:10:34.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:34 smithi096 ceph-mon[124666]: pgmap v22012: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 613 KiB/s wr, 9 op/s 2023-05-08T15:10:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41173.513843 secs 2023-05-08T15:10:35.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:35 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41174.067839 secs 2023-05-08T15:10:35.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41173.513843 secs 2023-05-08T15:10:35.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:35 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41174.067839 secs 2023-05-08T15:10:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41173.513843 secs 2023-05-08T15:10:35.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:35 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41174.067839 secs 2023-05-08T15:10:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:36 smithi186 ceph-mon[126480]: pgmap v22013: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 635 KiB/s rd, 613 KiB/s wr, 11 op/s 2023-05-08T15:10:36.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:36 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41175.409231 secs 2023-05-08T15:10:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:36 smithi133 ceph-mon[125939]: pgmap v22013: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 635 KiB/s rd, 613 KiB/s wr, 11 op/s 2023-05-08T15:10:36.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:36 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41175.409231 secs 2023-05-08T15:10:36.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:36 smithi096 ceph-mon[124666]: pgmap v22013: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 635 KiB/s rd, 613 KiB/s wr, 11 op/s 2023-05-08T15:10:36.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:36 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41175.409231 secs 2023-05-08T15:10:38.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:38 smithi186 ceph-mon[126480]: pgmap v22014: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 209 KiB/s wr, 9 op/s 2023-05-08T15:10:38.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:38 smithi133 ceph-mon[125939]: pgmap v22014: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 209 KiB/s wr, 9 op/s 2023-05-08T15:10:38.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:38 smithi096 ceph-mon[124666]: pgmap v22014: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 209 KiB/s wr, 9 op/s 2023-05-08T15:10:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:40 smithi186 ceph-mon[126480]: pgmap v22015: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2023-05-08T15:10:40.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41178.513977 secs 2023-05-08T15:10:40.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:40 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41179.067958 secs 2023-05-08T15:10:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:40 smithi133 ceph-mon[125939]: pgmap v22015: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2023-05-08T15:10:40.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41178.513977 secs 2023-05-08T15:10:40.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:40 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41179.067958 secs 2023-05-08T15:10:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:40 smithi096 ceph-mon[124666]: pgmap v22015: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2023-05-08T15:10:40.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41178.513977 secs 2023-05-08T15:10:40.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:40 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41179.067958 secs 2023-05-08T15:10:41.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:41 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41180.409300 secs 2023-05-08T15:10:41.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:41 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41180.409300 secs 2023-05-08T15:10:41.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:41 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41180.409300 secs 2023-05-08T15:10:42.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:42 smithi133 ceph-mon[125939]: pgmap v22016: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 212 KiB/s wr, 11 op/s 2023-05-08T15:10:42.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:42 smithi096 ceph-mon[124666]: pgmap v22016: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 212 KiB/s wr, 11 op/s 2023-05-08T15:10:42.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:42 smithi186 ceph-mon[126480]: pgmap v22016: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 212 KiB/s wr, 11 op/s 2023-05-08T15:10:43.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:43 smithi133 ceph-mon[125939]: pgmap v22017: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 555 KiB/s rd, 374 KiB/s wr, 9 op/s 2023-05-08T15:10:43.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:43 smithi096 ceph-mon[124666]: pgmap v22017: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 555 KiB/s rd, 374 KiB/s wr, 9 op/s 2023-05-08T15:10:43.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:43 smithi186 ceph-mon[126480]: pgmap v22017: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 555 KiB/s rd, 374 KiB/s wr, 9 op/s 2023-05-08T15:10:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41183.514093 secs 2023-05-08T15:10:45.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:45 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41184.068074 secs 2023-05-08T15:10:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41183.514093 secs 2023-05-08T15:10:45.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:45 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41184.068074 secs 2023-05-08T15:10:45.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41183.514093 secs 2023-05-08T15:10:45.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:45 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41184.068074 secs 2023-05-08T15:10:46.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:46 smithi186 ceph-mon[126480]: pgmap v22018: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 377 KiB/s rd, 374 KiB/s wr, 11 op/s 2023-05-08T15:10:46.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:46 smithi133 ceph-mon[125939]: pgmap v22018: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 377 KiB/s rd, 374 KiB/s wr, 11 op/s 2023-05-08T15:10:46.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:46 smithi096 ceph-mon[124666]: pgmap v22018: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 377 KiB/s rd, 374 KiB/s wr, 11 op/s 2023-05-08T15:10:48.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:48 smithi186 ceph-mon[126480]: pgmap v22019: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 374 KiB/s wr, 8 op/s 2023-05-08T15:10:48.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:48 smithi133 ceph-mon[125939]: pgmap v22019: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 374 KiB/s wr, 8 op/s 2023-05-08T15:10:48.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:48 smithi096 ceph-mon[124666]: pgmap v22019: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 374 KiB/s wr, 8 op/s 2023-05-08T15:10:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:50 smithi186 ceph-mon[126480]: pgmap v22020: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 374 KiB/s wr, 7 op/s 2023-05-08T15:10:50.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41188.514235 secs 2023-05-08T15:10:50.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:50 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41189.068192 secs 2023-05-08T15:10:50.370 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:50 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:10:50.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:50 smithi133 ceph-mon[125939]: pgmap v22020: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 374 KiB/s wr, 7 op/s 2023-05-08T15:10:50.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41188.514235 secs 2023-05-08T15:10:50.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:50 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41189.068192 secs 2023-05-08T15:10:50.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:50 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:10:50.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:50 smithi096 ceph-mon[124666]: pgmap v22020: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 374 KiB/s wr, 7 op/s 2023-05-08T15:10:50.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41188.514235 secs 2023-05-08T15:10:50.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:50 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41189.068192 secs 2023-05-08T15:10:50.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:50 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:10:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:51 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:10:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:51 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:10:51.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:51 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:10:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:51 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:10:51.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:51 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:10:51.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:51 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:10:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:51 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:10:51.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:51 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:10:51.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:51 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:10:52.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:52 smithi186 ceph-mon[126480]: pgmap v22021: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 561 KiB/s rd, 558 KiB/s wr, 11 op/s 2023-05-08T15:10:52.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:52 smithi133 ceph-mon[125939]: pgmap v22021: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 561 KiB/s rd, 558 KiB/s wr, 11 op/s 2023-05-08T15:10:52.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:52 smithi096 ceph-mon[124666]: pgmap v22021: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 561 KiB/s rd, 558 KiB/s wr, 11 op/s 2023-05-08T15:10:54.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:54 smithi186 ceph-mon[126480]: pgmap v22022: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 347 KiB/s wr, 8 op/s 2023-05-08T15:10:54.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:54 smithi133 ceph-mon[125939]: pgmap v22022: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 347 KiB/s wr, 8 op/s 2023-05-08T15:10:54.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:54 smithi096 ceph-mon[124666]: pgmap v22022: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 347 KiB/s wr, 8 op/s 2023-05-08T15:10:55.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:55 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41193.514370 secs 2023-05-08T15:10:55.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:55 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41193.514370 secs 2023-05-08T15:10:55.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:55 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41193.514370 secs 2023-05-08T15:10:56.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:56 smithi186 ceph-mon[126480]: pgmap v22023: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 776 KiB/s rd, 773 KiB/s wr, 11 op/s 2023-05-08T15:10:56.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:56 smithi133 ceph-mon[125939]: pgmap v22023: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 776 KiB/s rd, 773 KiB/s wr, 11 op/s 2023-05-08T15:10:56.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:56 smithi096 ceph-mon[124666]: pgmap v22023: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 776 KiB/s rd, 773 KiB/s wr, 11 op/s 2023-05-08T15:10:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:58 smithi133 ceph-mon[125939]: pgmap v22024: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 774 KiB/s rd, 772 KiB/s wr, 8 op/s 2023-05-08T15:10:58.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:58 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:10:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:58 smithi096 ceph-mon[124666]: pgmap v22024: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 774 KiB/s rd, 772 KiB/s wr, 8 op/s 2023-05-08T15:10:58.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:58 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:10:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:58 smithi186 ceph-mon[126480]: pgmap v22024: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 774 KiB/s rd, 772 KiB/s wr, 8 op/s 2023-05-08T15:10:58.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:58 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:10:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:59 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:10:59.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:59 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:10:59.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:59 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:10:59.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:10:59 smithi133 ceph-mon[125939]: pgmap v22025: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 774 KiB/s rd, 772 KiB/s wr, 8 op/s 2023-05-08T15:10:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:59 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:10:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:59 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:10:59.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:59 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:10:59.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:10:59 smithi096 ceph-mon[124666]: pgmap v22025: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 774 KiB/s rd, 772 KiB/s wr, 8 op/s 2023-05-08T15:10:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:59 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:10:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:59 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:10:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:59 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:10:59.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:10:59 smithi186 ceph-mon[126480]: pgmap v22025: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 774 KiB/s rd, 772 KiB/s wr, 8 op/s 2023-05-08T15:11:00.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:11:00 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41198.514451 secs 2023-05-08T15:11:00.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:11:00 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41198.514451 secs 2023-05-08T15:11:00.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:11:00 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41198.514451 secs 2023-05-08T15:11:01.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:11:01 smithi133 ceph-mon[125939]: pgmap v22026: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 14 op/s 2023-05-08T15:11:01.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:11:01 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41200.430794 secs 2023-05-08T15:11:01.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:11:01 smithi096 ceph-mon[124666]: pgmap v22026: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 14 op/s 2023-05-08T15:11:01.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:11:01 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41200.430794 secs 2023-05-08T15:11:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:11:01 smithi186 ceph-mon[126480]: pgmap v22026: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 14 op/s 2023-05-08T15:11:01.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:11:01 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41200.430794 secs 2023-05-08T15:11:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:11:02 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T15:11:02.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:11:02 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T15:11:02.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:11:02 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T15:11:02.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:11:02 smithi133 ceph-mon[125939]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T15:11:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:11:02 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T15:11:02.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:11:02 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T15:11:02.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:11:02 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T15:11:02.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:11:02 smithi096 ceph-mon[124666]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T15:11:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:11:02 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-05-08T15:11:02.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:11:02 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-05-08T15:11:02.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:11:02 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-05-08T15:11:02.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:11:02 smithi186 ceph-mon[126480]: from='mgr.15273 172.21.15.96:0/1105161275' entity='mgr.x' 2023-05-08T15:11:03.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:11:03 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T15:11:03.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:11:03 smithi133 ceph-mon[125939]: Service mds.all has no related daemon already placed. 2023-05-08T15:11:03.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:11:03 smithi133 ceph-mon[125939]: Service mgr has no related daemon already placed. 2023-05-08T15:11:03.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:11:03 smithi133 ceph-mon[125939]: Service mon has no related daemon already placed. 2023-05-08T15:11:03.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:11:03 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:11:03.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:11:03 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:11:03.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:11:03 smithi133 ceph-mon[125939]: pgmap v22027: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2023-05-08T15:11:03.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:11:03 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T15:11:03.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:11:03 smithi096 ceph-mon[124666]: Service mds.all has no related daemon already placed. 2023-05-08T15:11:03.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:11:03 smithi096 ceph-mon[124666]: Service mgr has no related daemon already placed. 2023-05-08T15:11:03.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:11:03 smithi096 ceph-mon[124666]: Service mon has no related daemon already placed. 2023-05-08T15:11:03.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:11:03 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:11:03.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:11:03 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:11:03.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:11:03 smithi096 ceph-mon[124666]: pgmap v22027: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2023-05-08T15:11:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:11:03 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T15:11:03.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:11:03 smithi186 ceph-mon[126480]: Service mds.all has no related daemon already placed. 2023-05-08T15:11:03.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:11:03 smithi186 ceph-mon[126480]: Service mgr has no related daemon already placed. 2023-05-08T15:11:03.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:11:03 smithi186 ceph-mon[126480]: Service mon has no related daemon already placed. 2023-05-08T15:11:03.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:11:03 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:11:03.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:11:03 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:11:03.620 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:11:03 smithi186 ceph-mon[126480]: pgmap v22027: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 12 op/s 2023-05-08T15:11:04.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:11:04 smithi133 ceph-mon[125939]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:11:04.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:11:04 smithi096 ceph-mon[124666]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:11:04.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:11:04 smithi186 ceph-mon[126480]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:11:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:11:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41203.514548 secs 2023-05-08T15:11:05.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:11:05 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41204.068607 secs 2023-05-08T15:11:05.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:11:05 smithi133 ceph-mon[125939]: pgmap v22028: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 30 op/s 2023-05-08T15:11:05.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:11:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41203.514548 secs 2023-05-08T15:11:05.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:11:05 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41204.068607 secs 2023-05-08T15:11:05.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:11:05 smithi096 ceph-mon[124666]: pgmap v22028: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 30 op/s 2023-05-08T15:11:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:11:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41203.514548 secs 2023-05-08T15:11:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:11:05 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41204.068607 secs 2023-05-08T15:11:05.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:11:05 smithi186 ceph-mon[126480]: pgmap v22028: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 30 op/s 2023-05-08T15:11:07.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:11:07 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:11:07.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:11:07 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:11:07.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:11:07 smithi133 ceph-mon[125939]: pgmap v22029: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 27 op/s 2023-05-08T15:11:07.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:11:07 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:11:07.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:11:07 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:11:07.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:11:07 smithi096 ceph-mon[124666]: pgmap v22029: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 27 op/s 2023-05-08T15:11:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:11:07 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:11:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:11:07 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:11:07.619 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:11:07 smithi186 ceph-mon[126480]: pgmap v22029: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 27 op/s 2023-05-08T15:11:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:11:09 smithi133 ceph-mon[125939]: pgmap v22030: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 26 op/s 2023-05-08T15:11:09.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:11:09 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41208.514684 secs 2023-05-08T15:11:09.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:11:09 smithi133 ceph-mon[125939]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:11:09.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:11:09 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:11:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:11:09 smithi096 ceph-mon[124666]: pgmap v22030: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 26 op/s 2023-05-08T15:11:09.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:11:09 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41208.514684 secs 2023-05-08T15:11:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:11:09 smithi096 ceph-mon[124666]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:11:09.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:11:09 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:11:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:11:09 smithi186 ceph-mon[126480]: pgmap v22030: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 26 op/s 2023-05-08T15:11:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:11:09 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41208.514684 secs 2023-05-08T15:11:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:11:09 smithi186 ceph-mon[126480]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:11:09.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:11:09 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:11:10.740 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:11:10 smithi133 ceph-mon[125939]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:11:10.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:11:10 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:11:10.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:11:10 smithi133 ceph-mon[125939]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:11:10.741 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:11:10 smithi133 ceph-mon[125939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:11:10.755 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:11:10 smithi096 ceph-mon[124666]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:11:10.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:11:10 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:11:10.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:11:10 smithi096 ceph-mon[124666]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:11:10.756 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:11:10 smithi096 ceph-mon[124666]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:11:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:11:10 smithi186 ceph-mon[126480]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2023-05-08T15:11:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:11:10 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.133:6838/2246041493,v1:172.21.15.133:6839/2246041493] up:active 2023-05-08T15:11:10.869 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:11:10 smithi186 ceph-mon[126480]: mds.? [v2:172.21.15.186:6836/1556405826,v1:172.21.15.186:6837/1556405826] up:active 2023-05-08T15:11:10.870 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:11:10 smithi186 ceph-mon[126480]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-05-08T15:11:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:11:12 smithi186 ceph-mon[126480]: pgmap v22031: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 31 op/s 2023-05-08T15:11:12.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:11:12 smithi186 ceph-mon[126480]: osdmap e1454: 12 total, 12 up, 12 in 2023-05-08T15:11:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:11:12 smithi133 ceph-mon[125939]: pgmap v22031: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 31 op/s 2023-05-08T15:11:12.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:11:12 smithi133 ceph-mon[125939]: osdmap e1454: 12 total, 12 up, 12 in 2023-05-08T15:11:12.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:11:12 smithi096 ceph-mon[124666]: pgmap v22031: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 31 op/s 2023-05-08T15:11:12.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:11:12 smithi096 ceph-mon[124666]: osdmap e1454: 12 total, 12 up, 12 in 2023-05-08T15:11:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:11:14 smithi186 ceph-mon[126480]: pgmap v22033: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 30 op/s 2023-05-08T15:11:14.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:11:14 smithi186 ceph-mon[126480]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:11:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:11:14 smithi133 ceph-mon[125939]: pgmap v22033: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 30 op/s 2023-05-08T15:11:14.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:11:14 smithi133 ceph-mon[125939]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:11:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:11:14 smithi096 ceph-mon[124666]: pgmap v22033: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 30 op/s 2023-05-08T15:11:14.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:11:14 smithi096 ceph-mon[124666]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2023-05-08T15:11:15.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:11:15 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41213.514819 secs 2023-05-08T15:11:15.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:11:15 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41213.514819 secs 2023-05-08T15:11:15.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:11:15 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41213.514819 secs 2023-05-08T15:11:16.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:11:16 smithi186 ceph-mon[126480]: pgmap v22034: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 662 KiB/s rd, 640 KiB/s wr, 11 op/s 2023-05-08T15:11:16.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:11:16 smithi133 ceph-mon[125939]: pgmap v22034: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 662 KiB/s rd, 640 KiB/s wr, 11 op/s 2023-05-08T15:11:16.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:11:16 smithi096 ceph-mon[124666]: pgmap v22034: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 662 KiB/s rd, 640 KiB/s wr, 11 op/s 2023-05-08T15:11:18.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:11:18 smithi186 ceph-mon[126480]: pgmap v22035: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 628 KiB/s rd, 605 KiB/s wr, 10 op/s 2023-05-08T15:11:18.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:11:18 smithi133 ceph-mon[125939]: pgmap v22035: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 628 KiB/s rd, 605 KiB/s wr, 10 op/s 2023-05-08T15:11:18.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:11:18 smithi096 ceph-mon[124666]: pgmap v22035: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 628 KiB/s rd, 605 KiB/s wr, 10 op/s 2023-05-08T15:11:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:11:20 smithi186 ceph-mon[126480]: pgmap v22036: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 628 KiB/s rd, 605 KiB/s wr, 10 op/s 2023-05-08T15:11:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:11:20 smithi186 ceph-mon[126480]: 1 slow requests, 0 included below; oldest blocked for > 41218.514932 secs 2023-05-08T15:11:20.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:11:20 smithi186 ceph-mon[126480]: osdmap e1455: 12 total, 12 up, 12 in 2023-05-08T15:11:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:11:20 smithi133 ceph-mon[125939]: pgmap v22036: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 628 KiB/s rd, 605 KiB/s wr, 10 op/s 2023-05-08T15:11:20.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:11:20 smithi133 ceph-mon[125939]: 1 slow requests, 0 included below; oldest blocked for > 41218.514932 secs 2023-05-08T15:11:20.491 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:11:20 smithi133 ceph-mon[125939]: osdmap e1455: 12 total, 12 up, 12 in 2023-05-08T15:11:20.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:11:20 smithi096 ceph-mon[124666]: pgmap v22036: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 628 KiB/s rd, 605 KiB/s wr, 10 op/s 2023-05-08T15:11:20.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:11:20 smithi096 ceph-mon[124666]: 1 slow requests, 0 included below; oldest blocked for > 41218.514932 secs 2023-05-08T15:11:20.506 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:11:20 smithi096 ceph-mon[124666]: osdmap e1455: 12 total, 12 up, 12 in 2023-05-08T15:11:22.369 INFO:journalctl@ceph.mon.c.smithi186.stdout:May 08 15:11:22 smithi186 ceph-mon[126480]: pgmap v22038: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 960 KiB/s wr, 10 op/s 2023-05-08T15:11:22.490 INFO:journalctl@ceph.mon.b.smithi133.stdout:May 08 15:11:22 smithi133 ceph-mon[125939]: pgmap v22038: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 960 KiB/s wr, 10 op/s 2023-05-08T15:11:22.505 INFO:journalctl@ceph.mon.a.smithi096.stdout:May 08 15:11:22 smithi096 ceph-mon[124666]: pgmap v22038: 97 pgs: 97 active+clean; 6.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 960 KiB/s wr, 10 op/s 2023-05-08T15:11:22.834 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2023-05-08T15:11:22.853 DEBUG:teuthology.task.console_log:Killing console logger for smithi096 2023-05-08T15:11:22.854 DEBUG:teuthology.task.console_log:Killing console logger for smithi133 2023-05-08T15:11:22.854 DEBUG:teuthology.task.console_log:Killing console logger for smithi186 2023-05-08T15:11:22.854 DEBUG:teuthology.exit:Finished running handlers